2023-10-01T07:37:42.667 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-01T07:37:42.668 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name dparmar-2023-10-01_07:32:21-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi --owner scheduled_dparmar@teuthology --archive /home/teuthworker/archive/dparmar-2023-10-01_07:32:21-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408165 --description fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/stress_tests/{0-client-upgrade 1-tests/fsstress}}} -- /home/teuthworker/archive/dparmar-2023-10-01_07:32:21-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408165/orig.config.yaml 2023-10-01T07:37:42.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T07:37:42.800 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/dparmar-2023-10-01_07:32:21-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408165 branch: fix-nfs-apply-err-reporting description: fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/stress_tests/{0-client-upgrade 1-tests/fsstress}}} email: null first_in_suite: false job_id: '7408165' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: dparmar-2023-10-01_07:32:21-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 8.stream overrides: admin_socket: branch: fix-nfs-apply-err-reporting ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: bluestore warn on legacy statfs: false bluestore warn on no per pool omap: false mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on osd down out interval zero: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - scrub mismatch - ScrubResult - wrongly marked - \(POOL_APP_NOT_ENABLED\) - \(SLOW_OPS\) - overall HEALTH_ - \(MON_MSGR2_NOT_ENABLED\) - slow request sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-62953 sha1: 6973b24e3d99fd494b753449d2ea12077599cbd6 owner: scheduled_dparmar@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mgr.x - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - - client.0 seed: 6124 sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 sleep_before_teardown: 0 suite: fs:upgrade suite_branch: wip-62953 suite_path: /home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa suite_relpath: qa suite_repo: https://github.com/dparmar18/ceph suite_sha1: 6973b24e3d99fd494b753449d2ea12077599cbd6 targets: smithi026.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPcv1WJET6ZJGQyR3vKmVxrKOjNwO+heVTJQhMFy39ThJkz5t0YlxifNbq8OKWY+KZ9Xvr3xx+66D7KX6SxOsNw= smithi092.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHMiSJIByvhJ8065ut6VaB+jx3WSzaIu6RYIbTppw3Z0iKf7dkMcWLxkgW58r1MvHpDhFogaFVkHOVVL+5tX46s= tasks: - install: branch: pacific exclude_packages: - cephadm - ceph-mgr-cephadm - ceph-immutable-object-cache - python3-rados - python3-rgw - python3-rbd - python3-cephfs - ceph-volume extra_packages: - python-rados - python-rgw - python-rbd - python-cephfs extra_system_packages: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - print: '**** done installing pacific' - ceph: conf: global: mon warn on pool no app: false ms bind msgr2: false log-ignorelist: - overall HEALTH_ - \(FS_ - \(MDS_ - \(OSD_ - \(MON_DOWN\) - \(CACHE_POOL_ - \(POOL_ - \(MGR_DOWN\) - \(PG_ - \(SMALLER_PGP_NUM\) - Monitor daemon marked osd - Behind on trimming - Manager daemon - exec: osd.0: - ceph osd set-require-min-compat-client pacific - print: '**** done ceph' - ceph-fuse: null - mds_pre_upgrade: null - print: '**** done mds pre-upgrade sequence' - install.upgrade: mon.a: branch: reef - print: '**** done install.upgrade the host' - ceph.restart: daemons: - mon.* - mgr.* mon-health-to-clog: false wait-for-healthy: false - ceph.healthy: null - ceph.restart: daemons: - osd.* wait-for-healthy: false wait-for-osds-up: true - ceph.stop: - mds.* - ceph.restart: daemons: - mds.* wait-for-healthy: false wait-for-osds-up: true - exec: mon.a: - ceph osd dump -f json-pretty - ceph versions - for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done - ceph osd require-osd-release reef - ceph.healthy: null - print: '**** done ceph.restart' - ceph-fuse: client.0: mounted: false - print: '**** done unmount client.0' - install.upgrade: client.0: null - print: '**** done install.upgrade on client.0' - ceph-fuse: client.0: null - print: '**** done remount client.0' - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: branch: pacific fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end - if not is_fuse() then reject() end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-01_07:32:21 tube: smithi user: dparmar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-01T07:37:42.801 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa; will attempt to use it 2023-10-01T07:37:42.868 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks 2023-10-01T07:37:42.868 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-01T07:37:42.870 INFO:teuthology.task.internal:Checking packages... 2023-10-01T07:37:42.893 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3d6eb91756d99e822eeed7c6b783104a6ad86054' 2023-10-01T07:37:42.893 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-01T07:37:42.893 INFO:teuthology.packaging:ref: None 2023-10-01T07:37:42.893 INFO:teuthology.packaging:tag: None 2023-10-01T07:37:42.893 INFO:teuthology.packaging:branch: fix-nfs-apply-err-reporting 2023-10-01T07:37:42.894 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-01T07:37:42.894 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=fix-nfs-apply-err-reporting 2023-10-01T07:37:43.034 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5795.g3d6eb917 2023-10-01T07:37:43.034 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-01T07:37:43.041 INFO:teuthology.task.internal:no buildpackages task found 2023-10-01T07:37:43.041 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-01T07:37:43.064 INFO:teuthology.task.internal:Saving configuration 2023-10-01T07:37:43.083 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-01T07:37:43.089 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-01T07:37:43.114 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-01_07:32:21-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408165', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-01 07:32:57.086519', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPcv1WJET6ZJGQyR3vKmVxrKOjNwO+heVTJQhMFy39ThJkz5t0YlxifNbq8OKWY+KZ9Xvr3xx+66D7KX6SxOsNw='} 2023-10-01T07:37:43.139 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-01_07:32:21-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408165', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-01 07:32:57.084579', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHMiSJIByvhJ8065ut6VaB+jx3WSzaIu6RYIbTppw3Z0iKf7dkMcWLxkgW58r1MvHpDhFogaFVkHOVVL+5tX46s='} 2023-10-01T07:37:43.140 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-01T07:37:43.146 INFO:teuthology.task.internal:roles: ubuntu@smithi026.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-10-01T07:37:43.146 INFO:teuthology.task.internal:roles: ubuntu@smithi092.front.sepia.ceph.com - ['client.0'] 2023-10-01T07:37:43.147 INFO:teuthology.run_tasks:Running task console_log... 2023-10-01T07:37:43.255 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6a701e1f70>, signals=[15]) 2023-10-01T07:37:43.255 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-01T07:37:43.261 INFO:teuthology.task.internal:Opening connections... 2023-10-01T07:37:43.261 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi026.front.sepia.ceph.com 2023-10-01T07:37:43.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:37:43.333 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi092.front.sepia.ceph.com 2023-10-01T07:37:43.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:37:43.403 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-01T07:37:43.409 DEBUG:teuthology.orchestra.run.smithi026:> uname -m 2023-10-01T07:37:43.433 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2023-10-01T07:37:43.433 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2023-10-01T07:37:43.495 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream" 2023-10-01T07:37:43.495 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8" 2023-10-01T07:37:43.495 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos" 2023-10-01T07:37:43.495 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora" 2023-10-01T07:37:43.495 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8" 2023-10-01T07:37:43.495 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8" 2023-10-01T07:37:43.495 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-01T07:37:43.495 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2023-10-01T07:37:43.495 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-01T07:37:43.495 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/" 2023-10-01T07:37:43.495 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-01T07:37:43.496 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-01T07:37:43.496 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-01T07:37:43.496 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-10-01T07:37:43.522 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2023-10-01T07:37:43.543 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2023-10-01T07:37:43.543 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2023-10-01T07:37:43.603 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Stream" 2023-10-01T07:37:43.603 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8" 2023-10-01T07:37:43.604 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos" 2023-10-01T07:37:43.604 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora" 2023-10-01T07:37:43.604 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8" 2023-10-01T07:37:43.604 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8" 2023-10-01T07:37:43.604 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-01T07:37:43.604 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2023-10-01T07:37:43.604 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-01T07:37:43.604 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://centos.org/" 2023-10-01T07:37:43.604 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-01T07:37:43.605 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-01T07:37:43.605 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-01T07:37:43.605 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2023-10-01T07:37:43.630 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-01T07:37:43.638 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-01T07:37:43.655 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-01T07:37:43.656 DEBUG:teuthology.orchestra.run.smithi026:> test '!' -e /home/ubuntu/cephtest 2023-10-01T07:37:43.658 DEBUG:teuthology.orchestra.run.smithi092:> test '!' -e /home/ubuntu/cephtest 2023-10-01T07:37:43.678 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-01T07:37:43.683 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-01T07:37:43.683 DEBUG:teuthology.orchestra.run.smithi026:> test -z $(ls -A /var/lib/ceph) 2023-10-01T07:37:43.720 DEBUG:teuthology.orchestra.run.smithi092:> test -z $(ls -A /var/lib/ceph) 2023-10-01T07:37:43.751 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-01T07:37:43.804 INFO:teuthology.run_tasks:Running task kernel... 2023-10-01T07:37:43.819 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-01T07:37:43.819 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-01T07:37:43.820 DEBUG:teuthology.orchestra.run.smithi026:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-01T07:37:43.820 DEBUG:teuthology.orchestra.run.smithi092:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-01T07:37:43.838 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-01T07:37:43.839 DEBUG:teuthology.orchestra.run.smithi092:> uname -r 2023-10-01T07:37:43.841 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-01T07:37:43.841 DEBUG:teuthology.orchestra.run.smithi026:> uname -r 2023-10-01T07:37:43.897 INFO:teuthology.orchestra.run.smithi092.stdout:4.18.0-489.el8.x86_64 2023-10-01T07:37:43.897 INFO:teuthology.task.kernel:Running kernel on smithi092: 4.18.0-489.el8.x86_64 2023-10-01T07:37:43.897 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum install -y kernel 2023-10-01T07:37:43.902 INFO:teuthology.orchestra.run.smithi026.stdout:4.18.0-489.el8.x86_64 2023-10-01T07:37:43.902 INFO:teuthology.task.kernel:Running kernel on smithi026: 4.18.0-489.el8.x86_64 2023-10-01T07:37:43.902 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum install -y kernel 2023-10-01T07:37:47.889 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 8 - AppStream 22 MB/s | 33 MB 00:01 2023-10-01T07:37:47.922 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 8 - AppStream 22 MB/s | 33 MB 00:01 2023-10-01T07:37:56.097 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 8 - BaseOS 25 MB/s | 48 MB 00:01 2023-10-01T07:37:56.372 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 8 - BaseOS 24 MB/s | 48 MB 00:01 2023-10-01T07:38:03.463 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 8 - Extras 81 kB/s | 18 kB 00:00 2023-10-01T07:38:05.188 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 8 - Extras common packages 4.5 kB/s | 6.9 kB 00:01 2023-10-01T07:38:05.297 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 8 - Extras 12 kB/s | 18 kB 00:01 2023-10-01T07:38:05.515 INFO:teuthology.orchestra.run.smithi092.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2023-10-01T07:38:06.022 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 8 - Extras common packages 13 kB/s | 6.9 kB 00:00 2023-10-01T07:38:06.332 INFO:teuthology.orchestra.run.smithi026.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2023-10-01T07:38:06.859 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2023-10-01T07:38:08.227 INFO:teuthology.orchestra.run.smithi026.stdout:Extra Packages for Enterprise Linux 9.2 MB/s | 16 MB 00:01 2023-10-01T07:38:10.682 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 451 kB/s | 24 kB 00:00 2023-10-01T07:38:12.289 INFO:teuthology.orchestra.run.smithi026.stdout:lab-extras 301 kB/s | 24 kB 00:00 2023-10-01T07:38:14.189 INFO:teuthology.orchestra.run.smithi092.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-10-01T07:38:14.189 INFO:teuthology.orchestra.run.smithi092.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-10-01T07:38:14.465 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-10-01T07:38:14.466 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-10-01T07:38:14.466 INFO:teuthology.orchestra.run.smithi092.stdout: Package Architecture Version Repository Size 2023-10-01T07:38:14.466 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-10-01T07:38:14.466 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2023-10-01T07:38:14.466 INFO:teuthology.orchestra.run.smithi092.stdout: kernel x86_64 4.18.0-514.el8 baseos 10 M 2023-10-01T07:38:14.466 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2023-10-01T07:38:14.466 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-core x86_64 4.18.0-514.el8 baseos 43 M 2023-10-01T07:38:14.466 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-modules x86_64 4.18.0-514.el8 baseos 35 M 2023-10-01T07:38:14.467 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:38:14.467 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2023-10-01T07:38:14.467 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-10-01T07:38:14.467 INFO:teuthology.orchestra.run.smithi092.stdout:Install 3 Packages 2023-10-01T07:38:14.467 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:38:14.467 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 88 M 2023-10-01T07:38:14.468 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 96 M 2023-10-01T07:38:14.468 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2023-10-01T07:38:16.035 INFO:teuthology.orchestra.run.smithi026.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-10-01T07:38:16.035 INFO:teuthology.orchestra.run.smithi026.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-10-01T07:38:16.306 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2023-10-01T07:38:16.306 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2023-10-01T07:38:16.307 INFO:teuthology.orchestra.run.smithi026.stdout: Package Architecture Version Repository Size 2023-10-01T07:38:16.307 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2023-10-01T07:38:16.307 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2023-10-01T07:38:16.307 INFO:teuthology.orchestra.run.smithi026.stdout: kernel x86_64 4.18.0-514.el8 baseos 10 M 2023-10-01T07:38:16.307 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2023-10-01T07:38:16.307 INFO:teuthology.orchestra.run.smithi026.stdout: kernel-core x86_64 4.18.0-514.el8 baseos 43 M 2023-10-01T07:38:16.307 INFO:teuthology.orchestra.run.smithi026.stdout: kernel-modules x86_64 4.18.0-514.el8 baseos 35 M 2023-10-01T07:38:16.307 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:38:16.307 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2023-10-01T07:38:16.307 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2023-10-01T07:38:16.307 INFO:teuthology.orchestra.run.smithi026.stdout:Install 3 Packages 2023-10-01T07:38:16.307 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:38:16.308 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 88 M 2023-10-01T07:38:16.308 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 96 M 2023-10-01T07:38:16.308 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2023-10-01T07:38:16.341 INFO:teuthology.orchestra.run.smithi092.stdout:(1/3): kernel-4.18.0-514.el8.x86_64.rpm 6.0 MB/s | 10 MB 00:01 2023-10-01T07:38:17.433 INFO:teuthology.orchestra.run.smithi026.stdout:(1/3): kernel-4.18.0-514.el8.x86_64.rpm 11 MB/s | 10 MB 00:00 2023-10-01T07:38:18.091 INFO:teuthology.orchestra.run.smithi092.stdout:(2/3): kernel-modules-4.18.0-514.el8.x86_64.rpm 10 MB/s | 35 MB 00:03 2023-10-01T07:38:18.466 INFO:teuthology.orchestra.run.smithi092.stdout:(3/3): kernel-core-4.18.0-514.el8.x86_64.rpm 11 MB/s | 43 MB 00:03 2023-10-01T07:38:18.467 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2023-10-01T07:38:18.467 INFO:teuthology.orchestra.run.smithi092.stdout:Total 22 MB/s | 88 MB 00:03 2023-10-01T07:38:18.675 INFO:teuthology.orchestra.run.smithi026.stdout:(2/3): kernel-core-4.18.0-514.el8.x86_64.rpm 20 MB/s | 43 MB 00:02 2023-10-01T07:38:19.059 INFO:teuthology.orchestra.run.smithi026.stdout:(3/3): kernel-modules-4.18.0-514.el8.x86_64.rpm 14 MB/s | 35 MB 00:02 2023-10-01T07:38:19.059 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2023-10-01T07:38:19.060 INFO:teuthology.orchestra.run.smithi026.stdout:Total 32 MB/s | 88 MB 00:02 2023-10-01T07:38:19.137 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2023-10-01T07:38:19.584 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2023-10-01T07:38:19.584 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2023-10-01T07:38:19.762 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2023-10-01T07:38:20.211 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2023-10-01T07:38:20.211 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2023-10-01T07:38:20.801 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2023-10-01T07:38:20.836 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2023-10-01T07:38:21.508 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2023-10-01T07:38:21.547 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2023-10-01T07:38:23.578 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2023-10-01T07:38:24.136 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-01T07:38:24.470 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2023-10-01T07:38:25.017 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-01T07:38:27.653 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-01T07:38:28.044 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-01T07:38:28.832 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-01T07:38:29.217 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-01T07:38:31.418 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-01T07:38:31.705 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : kernel-4.18.0-514.el8.x86_64 3/3 2023-10-01T07:38:32.841 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-01T07:38:33.176 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : kernel-4.18.0-514.el8.x86_64 3/3 2023-10-01T07:38:53.385 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 3/3 2023-10-01T07:38:53.409 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-01T07:38:53.752 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-4.18.0-514.el8.x86_64 3/3 2023-10-01T07:38:53.752 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-4.18.0-514.el8.x86_64 1/3 2023-10-01T07:38:53.752 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-core-4.18.0-514.el8.x86_64 2/3 2023-10-01T07:38:54.450 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-01T07:38:54.450 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:38:54.450 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2023-10-01T07:38:54.450 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-4.18.0-514.el8.x86_64 kernel-core-4.18.0-514.el8.x86_64 2023-10-01T07:38:54.450 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-modules-4.18.0-514.el8.x86_64 2023-10-01T07:38:54.451 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:38:54.451 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-10-01T07:38:54.585 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q kernel | sort -rV | head -n 1 2023-10-01T07:38:54.802 INFO:teuthology.orchestra.run.smithi092.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-01T07:38:54.803 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-01T07:38:54.803 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-514.el8.x86_64 2023-10-01T07:38:54.803 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-01T07:38:54.803 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-01T07:38:54.803 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-10-01T07:38:54.803 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi092.front.sepia.ceph.com, path=None, version=distro) 2023-10-01T07:38:54.804 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q kernel | sort -rV | head -n 1 2023-10-01T07:38:55.012 INFO:teuthology.orchestra.run.smithi092.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-01T07:38:55.012 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-01T07:38:55.012 DEBUG:teuthology.orchestra.run.smithi092:> sudo rpm -qi grub2-tools 2023-10-01T07:38:55.046 INFO:teuthology.orchestra.run.smithi092.stdout:Name : grub2-tools 2023-10-01T07:38:55.046 INFO:teuthology.orchestra.run.smithi092.stdout:Epoch : 1 2023-10-01T07:38:55.046 INFO:teuthology.orchestra.run.smithi092.stdout:Version : 2.02 2023-10-01T07:38:55.046 INFO:teuthology.orchestra.run.smithi092.stdout:Release : 129.el8 2023-10-01T07:38:55.046 INFO:teuthology.orchestra.run.smithi092.stdout:Architecture: x86_64 2023-10-01T07:38:55.046 INFO:teuthology.orchestra.run.smithi092.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-10-01T07:38:55.047 INFO:teuthology.orchestra.run.smithi092.stdout:Group : System Environment/Base 2023-10-01T07:38:55.047 INFO:teuthology.orchestra.run.smithi092.stdout:Size : 9265586 2023-10-01T07:38:55.047 INFO:teuthology.orchestra.run.smithi092.stdout:License : GPLv3+ 2023-10-01T07:38:55.047 INFO:teuthology.orchestra.run.smithi092.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-10-01T07:38:55.047 INFO:teuthology.orchestra.run.smithi092.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-10-01T07:38:55.047 INFO:teuthology.orchestra.run.smithi092.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-10-01T07:38:55.047 INFO:teuthology.orchestra.run.smithi092.stdout:Build Host : kbuilder.bsys.centos.org 2023-10-01T07:38:55.047 INFO:teuthology.orchestra.run.smithi092.stdout:Relocations : (not relocatable) 2023-10-01T07:38:55.047 INFO:teuthology.orchestra.run.smithi092.stdout:Packager : CentOS BuildSystem 2023-10-01T07:38:55.047 INFO:teuthology.orchestra.run.smithi092.stdout:Vendor : CentOS 2023-10-01T07:38:55.047 INFO:teuthology.orchestra.run.smithi092.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-01T07:38:55.047 INFO:teuthology.orchestra.run.smithi092.stdout:Summary : Support tools for GRUB. 2023-10-01T07:38:55.048 INFO:teuthology.orchestra.run.smithi092.stdout:Description : 2023-10-01T07:38:55.048 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:38:55.048 INFO:teuthology.orchestra.run.smithi092.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-01T07:38:55.048 INFO:teuthology.orchestra.run.smithi092.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-01T07:38:55.048 INFO:teuthology.orchestra.run.smithi092.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-01T07:38:55.048 INFO:teuthology.orchestra.run.smithi092.stdout:hardware devices. 2023-10-01T07:38:55.048 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:38:55.048 INFO:teuthology.orchestra.run.smithi092.stdout:This subpackage provides tools for support of all platforms. 2023-10-01T07:38:55.049 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-01T07:38:55.049 INFO:teuthology.task.kernel:Updating grub on smithi092 to boot 4.18.0-514.el8.x86_64 2023-10-01T07:38:55.049 DEBUG:teuthology.orchestra.run.smithi092:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-01T07:38:56.339 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 3/3 2023-10-01T07:38:56.363 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-01T07:38:56.744 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: kernel-4.18.0-514.el8.x86_64 3/3 2023-10-01T07:38:56.744 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : kernel-4.18.0-514.el8.x86_64 1/3 2023-10-01T07:38:56.744 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : kernel-core-4.18.0-514.el8.x86_64 2/3 2023-10-01T07:38:56.838 INFO:teuthology.orchestra.run.smithi092.stderr:Generating grub configuration file ... 2023-10-01T07:38:58.321 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-01T07:38:58.321 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:38:58.321 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2023-10-01T07:38:58.321 INFO:teuthology.orchestra.run.smithi026.stdout: kernel-4.18.0-514.el8.x86_64 kernel-core-4.18.0-514.el8.x86_64 2023-10-01T07:38:58.321 INFO:teuthology.orchestra.run.smithi026.stdout: kernel-modules-4.18.0-514.el8.x86_64 2023-10-01T07:38:58.321 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:38:58.321 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2023-10-01T07:38:58.506 DEBUG:teuthology.orchestra.run.smithi026:> rpm -q kernel | sort -rV | head -n 1 2023-10-01T07:38:58.730 INFO:teuthology.orchestra.run.smithi092.stderr:done 2023-10-01T07:38:58.730 INFO:teuthology.orchestra.run.smithi026.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-01T07:38:58.732 DEBUG:teuthology.orchestra.run.smithi092:> mktemp 2023-10-01T07:38:58.732 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-01T07:38:58.732 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-514.el8.x86_64 2023-10-01T07:38:58.732 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-01T07:38:58.732 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-01T07:38:58.732 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-10-01T07:38:58.733 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi026.front.sepia.ceph.com, path=None, version=distro) 2023-10-01T07:38:58.733 DEBUG:teuthology.orchestra.run.smithi026:> rpm -q kernel | sort -rV | head -n 1 2023-10-01T07:38:58.775 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.qd9Xd2qoHE 2023-10-01T07:38:58.776 DEBUG:teuthology.orchestra.run.smithi092:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.qd9Xd2qoHE 2023-10-01T07:38:58.849 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0666 /tmp/tmp.qd9Xd2qoHE 2023-10-01T07:38:58.951 INFO:teuthology.orchestra.run.smithi026.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-01T07:38:58.952 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-01T07:38:58.952 DEBUG:teuthology.orchestra.run.smithi026:> sudo rpm -qi grub2-tools 2023-10-01T07:38:58.986 INFO:teuthology.orchestra.run.smithi026.stdout:Name : grub2-tools 2023-10-01T07:38:58.986 INFO:teuthology.orchestra.run.smithi026.stdout:Epoch : 1 2023-10-01T07:38:58.986 INFO:teuthology.orchestra.run.smithi026.stdout:Version : 2.02 2023-10-01T07:38:58.986 INFO:teuthology.orchestra.run.smithi026.stdout:Release : 129.el8 2023-10-01T07:38:58.986 INFO:teuthology.orchestra.run.smithi026.stdout:Architecture: x86_64 2023-10-01T07:38:58.987 INFO:teuthology.orchestra.run.smithi026.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-10-01T07:38:58.987 INFO:teuthology.orchestra.run.smithi026.stdout:Group : System Environment/Base 2023-10-01T07:38:58.987 INFO:teuthology.orchestra.run.smithi026.stdout:Size : 9265586 2023-10-01T07:38:58.987 INFO:teuthology.orchestra.run.smithi026.stdout:License : GPLv3+ 2023-10-01T07:38:58.987 INFO:teuthology.orchestra.run.smithi026.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-10-01T07:38:58.987 INFO:teuthology.orchestra.run.smithi026.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-10-01T07:38:58.987 INFO:teuthology.orchestra.run.smithi026.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-10-01T07:38:58.987 INFO:teuthology.orchestra.run.smithi026.stdout:Build Host : kbuilder.bsys.centos.org 2023-10-01T07:38:58.987 INFO:teuthology.orchestra.run.smithi026.stdout:Relocations : (not relocatable) 2023-10-01T07:38:58.987 INFO:teuthology.orchestra.run.smithi026.stdout:Packager : CentOS BuildSystem 2023-10-01T07:38:58.987 INFO:teuthology.orchestra.run.smithi026.stdout:Vendor : CentOS 2023-10-01T07:38:58.987 INFO:teuthology.orchestra.run.smithi026.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-01T07:38:58.987 INFO:teuthology.orchestra.run.smithi026.stdout:Summary : Support tools for GRUB. 2023-10-01T07:38:58.988 INFO:teuthology.orchestra.run.smithi026.stdout:Description : 2023-10-01T07:38:58.988 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:38:58.988 INFO:teuthology.orchestra.run.smithi026.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-01T07:38:58.988 INFO:teuthology.orchestra.run.smithi026.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-01T07:38:58.988 INFO:teuthology.orchestra.run.smithi026.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-01T07:38:58.988 INFO:teuthology.orchestra.run.smithi026.stdout:hardware devices. 2023-10-01T07:38:58.988 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:38:58.988 INFO:teuthology.orchestra.run.smithi026.stdout:This subpackage provides tools for support of all platforms. 2023-10-01T07:38:58.989 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-01T07:38:58.989 INFO:teuthology.task.kernel:Updating grub on smithi026 to boot 4.18.0-514.el8.x86_64 2023-10-01T07:38:58.989 DEBUG:teuthology.orchestra.run.smithi026:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-01T07:38:58.995 DEBUG:teuthology.orchestra.remote:smithi092:/tmp/tmp.qd9Xd2qoHE is 6KB 2023-10-01T07:38:59.044 DEBUG:teuthology.orchestra.run.smithi092:> rm -fr /tmp/tmp.qd9Xd2qoHE 2023-10-01T07:38:59.061 DEBUG:teuthology.orchestra.run.smithi092:> sudo /bin/ls /boot/loader/entries || true 2023-10-01T07:38:59.134 INFO:teuthology.orchestra.run.smithi092.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-10-01T07:38:59.134 INFO:teuthology.orchestra.run.smithi092.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-10-01T07:38:59.134 INFO:teuthology.orchestra.run.smithi092.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-10-01T07:38:59.134 INFO:teuthology.orchestra.run.smithi092.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64.conf 2023-10-01T07:38:59.135 DEBUG:teuthology.orchestra.run.smithi092:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64 2023-10-01T07:38:59.298 DEBUG:teuthology.orchestra.run.smithi092:> sudo shutdown -r now 2023-10-01T07:39:00.159 INFO:teuthology.orchestra.run.smithi026.stderr:Generating grub configuration file ... 2023-10-01T07:39:02.348 INFO:teuthology.orchestra.run.smithi026.stderr:done 2023-10-01T07:39:02.349 DEBUG:teuthology.orchestra.run.smithi026:> mktemp 2023-10-01T07:39:02.381 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.uoZ37SCD8h 2023-10-01T07:39:02.381 DEBUG:teuthology.orchestra.run.smithi026:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.uoZ37SCD8h 2023-10-01T07:39:02.462 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.uoZ37SCD8h 2023-10-01T07:39:02.605 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.uoZ37SCD8h is 6KB 2023-10-01T07:39:02.653 DEBUG:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.uoZ37SCD8h 2023-10-01T07:39:02.671 DEBUG:teuthology.orchestra.run.smithi026:> sudo /bin/ls /boot/loader/entries || true 2023-10-01T07:39:02.744 INFO:teuthology.orchestra.run.smithi026.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-10-01T07:39:02.744 INFO:teuthology.orchestra.run.smithi026.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-10-01T07:39:02.744 INFO:teuthology.orchestra.run.smithi026.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-10-01T07:39:02.744 INFO:teuthology.orchestra.run.smithi026.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64.conf 2023-10-01T07:39:02.745 DEBUG:teuthology.orchestra.run.smithi026:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64 2023-10-01T07:39:02.914 DEBUG:teuthology.orchestra.run.smithi026:> sudo shutdown -r now 2023-10-01T07:39:29.326 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-01T07:39:29.327 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-10-01T07:39:29.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:39:32.918 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-01T07:39:32.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-10-01T07:39:32.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:40:29.382 DEBUG:teuthology.orchestra.remote:timed out 2023-10-01T07:40:32.922 DEBUG:teuthology.orchestra.remote:timed out 2023-10-01T07:40:38.389 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-10-01T07:40:38.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:40:38.852 DEBUG:teuthology.orchestra.run.smithi092:> true 2023-10-01T07:40:39.111 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-10-01T07:40:39.111 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-514.el8.x86_64"... 2023-10-01T07:40:39.111 DEBUG:teuthology.orchestra.run.smithi092:> uname -r 2023-10-01T07:40:39.128 INFO:teuthology.orchestra.run.smithi092.stdout:4.18.0-514.el8.x86_64 2023-10-01T07:40:39.128 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-514.el8.x86_64 vs 4.18.0-514.el8.x86_64 2023-10-01T07:40:39.128 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-01T07:40:39.129 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-01T07:40:40.130 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2023-10-01T07:40:40.130 DEBUG:teuthology.orchestra.run.smithi092:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-01T07:40:40.190 INFO:teuthology.orchestra.run.smithi092.stdout:ttyS1 2023-10-01T07:40:40.204 DEBUG:teuthology.parallel:result is None 2023-10-01T07:40:41.923 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-10-01T07:40:41.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:40:42.218 DEBUG:teuthology.orchestra.run.smithi026:> true 2023-10-01T07:40:42.530 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-10-01T07:40:42.531 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-514.el8.x86_64"... 2023-10-01T07:40:42.531 DEBUG:teuthology.orchestra.run.smithi026:> uname -r 2023-10-01T07:40:42.553 INFO:teuthology.orchestra.run.smithi026.stdout:4.18.0-514.el8.x86_64 2023-10-01T07:40:42.553 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-514.el8.x86_64 vs 4.18.0-514.el8.x86_64 2023-10-01T07:40:42.553 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-01T07:40:42.553 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-01T07:40:43.554 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-01T07:40:43.554 DEBUG:teuthology.orchestra.run.smithi026:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-01T07:40:43.639 INFO:teuthology.orchestra.run.smithi026.stdout:ttyS1 2023-10-01T07:40:43.651 DEBUG:teuthology.parallel:result is None 2023-10-01T07:40:43.651 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-01T07:40:43.676 INFO:teuthology.task.internal:Creating test directory... 2023-10-01T07:40:43.676 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-01T07:40:43.684 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-01T07:40:44.226 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-01T07:40:44.245 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-01T07:40:44.289 INFO:teuthology.task.internal:Creating archive directory... 2023-10-01T07:40:44.289 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-01T07:40:44.291 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-01T07:40:44.587 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-01T07:40:44.593 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-01T07:40:44.594 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-01T07:40:44.596 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-01T07:40:44.626 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-01T07:40:44.637 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-01T07:40:44.637 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-01T07:40:44.649 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-01T07:40:44.651 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-01T07:40:44.657 INFO:teuthology.task.internal:Configuring sudo... 2023-10-01T07:40:44.658 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-01T07:40:44.694 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-01T07:40:44.727 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-01T07:40:44.736 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-01T07:40:44.737 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-01T07:40:44.770 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-01T07:40:44.790 DEBUG:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-01T07:40:44.883 DEBUG:teuthology.orchestra.run.smithi026:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-01T07:40:44.939 DEBUG:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-01T07:40:45.026 DEBUG:teuthology.orchestra.run.smithi026:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-01T07:40:45.080 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-01T07:40:45.081 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-01T07:40:45.156 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-01T07:40:45.202 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-01T07:40:45.254 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-01T07:40:45.340 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-01T07:40:45.380 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-01T07:40:45.380 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-01T07:40:45.450 DEBUG:teuthology.orchestra.run.smithi026:> sudo service rsyslog restart 2023-10-01T07:40:45.452 DEBUG:teuthology.orchestra.run.smithi092:> sudo service rsyslog restart 2023-10-01T07:40:45.519 INFO:teuthology.orchestra.run.smithi026.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-01T07:40:45.568 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-01T07:40:46.021 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-01T07:40:46.028 INFO:teuthology.task.internal:Starting timer... 2023-10-01T07:40:46.028 INFO:teuthology.run_tasks:Running task pcp... 2023-10-01T07:40:46.071 INFO:teuthology.run_tasks:Running task selinux... 2023-10-01T07:40:46.086 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-01T07:40:46.087 DEBUG:teuthology.orchestra.run.smithi026:> sudo service auditd rotate 2023-10-01T07:40:46.159 INFO:teuthology.orchestra.run.smithi026.stdout:Rotating logs: 2023-10-01T07:40:46.161 DEBUG:teuthology.orchestra.run.smithi092:> sudo service auditd rotate 2023-10-01T07:40:46.249 INFO:teuthology.orchestra.run.smithi092.stdout:Rotating logs: 2023-10-01T07:40:46.251 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-01T07:40:46.251 DEBUG:teuthology.orchestra.run.smithi026:> /usr/sbin/getenforce 2023-10-01T07:40:46.283 INFO:teuthology.orchestra.run.smithi026.stdout:Permissive 2023-10-01T07:40:46.283 DEBUG:teuthology.orchestra.run.smithi092:> /usr/sbin/getenforce 2023-10-01T07:40:46.323 INFO:teuthology.orchestra.run.smithi092.stdout:Permissive 2023-10-01T07:40:46.323 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi026.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi092.front.sepia.ceph.com': 'permissive'} 2023-10-01T07:40:46.323 DEBUG:teuthology.orchestra.run.smithi026:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-01T07:40:46.357 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-01T07:40:46.358 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-01T07:40:46.390 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-01T07:40:46.390 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-01T07:40:46.391 DEBUG:teuthology.orchestra.run.smithi026:> sudo /usr/sbin/setenforce permissive 2023-10-01T07:40:46.433 DEBUG:teuthology.orchestra.run.smithi092:> sudo /usr/sbin/setenforce permissive 2023-10-01T07:40:46.461 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-01T07:40:46.470 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-01T07:40:46.474 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-01T07:40:46.613 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-01T07:40:46.635 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-01T07:40:46.636 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi026.front.sepia.ceph.com,smithi092.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-01T07:48:57.178 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi026.front.sepia.ceph.com'), Remote(name='ubuntu@smithi092.front.sepia.ceph.com')] 2023-10-01T07:48:57.179 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-10-01T07:48:57.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:48:57.255 DEBUG:teuthology.orchestra.run.smithi026:> true 2023-10-01T07:48:57.289 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-10-01T07:48:57.289 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-10-01T07:48:57.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:48:57.362 DEBUG:teuthology.orchestra.run.smithi092:> true 2023-10-01T07:48:57.434 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-10-01T07:48:57.434 INFO:teuthology.run_tasks:Running task clock... 2023-10-01T07:48:57.444 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-01T07:48:57.445 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-01T07:48:57.445 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-01T07:48:57.448 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-01T07:48:57.448 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-01T07:48:57.485 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-01T07:48:57.502 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-01T07:48:57.508 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-01T07:48:57.522 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-01T07:48:57.571 INFO:teuthology.orchestra.run.smithi026.stderr:sudo: ntpd: command not found 2023-10-01T07:48:57.584 INFO:teuthology.orchestra.run.smithi026.stdout:506 Cannot talk to daemon 2023-10-01T07:48:57.590 INFO:teuthology.orchestra.run.smithi092.stderr:sudo: ntpd: command not found 2023-10-01T07:48:57.601 INFO:teuthology.orchestra.run.smithi092.stdout:506 Cannot talk to daemon 2023-10-01T07:48:57.601 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-01T07:48:57.615 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-01T07:48:57.617 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-01T07:48:57.629 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-01T07:48:57.690 INFO:teuthology.orchestra.run.smithi092.stderr:bash: ntpq: command not found 2023-10-01T07:48:57.693 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-01T07:48:57.694 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2023-10-01T07:48:57.694 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-01T07:48:57.694 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-01T07:48:57.694 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-01T07:48:57.694 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-01T07:48:57.696 INFO:teuthology.orchestra.run.smithi026.stderr:bash: ntpq: command not found 2023-10-01T07:48:57.700 INFO:teuthology.orchestra.run.smithi026.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-01T07:48:57.700 INFO:teuthology.orchestra.run.smithi026.stdout:=============================================================================== 2023-10-01T07:48:57.701 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-01T07:48:57.701 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-01T07:48:57.701 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-01T07:48:57.701 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-01T07:48:57.702 INFO:teuthology.run_tasks:Running task install... 2023-10-01T07:48:57.710 DEBUG:teuthology.task.install:project ceph 2023-10-01T07:48:57.710 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}} 2023-10-01T07:48:57.710 DEBUG:teuthology.task.install:config {'branch': 'pacific', 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'} 2023-10-01T07:48:57.710 INFO:teuthology.task.install:Using flavor: default 2023-10-01T07:48:57.748 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-01T07:48:57.748 INFO:teuthology.task.install:extra packages: ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'] 2023-10-01T07:48:57.748 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'pacific', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'tag': None, 'wait_for_package': False} 2023-10-01T07:48:57.749 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-01T07:48:57.749 INFO:teuthology.packaging:ref: None 2023-10-01T07:48:57.749 INFO:teuthology.packaging:tag: None 2023-10-01T07:48:57.749 INFO:teuthology.packaging:branch: pacific 2023-10-01T07:48:57.749 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-01T07:48:57.749 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-10-01T07:48:57.751 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'pacific', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'tag': None, 'wait_for_package': False} 2023-10-01T07:48:57.751 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-01T07:48:57.751 INFO:teuthology.packaging:ref: None 2023-10-01T07:48:57.751 INFO:teuthology.packaging:tag: None 2023-10-01T07:48:57.751 INFO:teuthology.packaging:branch: pacific 2023-10-01T07:48:57.751 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-01T07:48:57.751 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-10-01T07:48:58.074 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/ 2023-10-01T07:48:58.074 INFO:teuthology.task.install.rpm:Package version is 16.2.14-44.geeb13ac9 2023-10-01T07:48:58.095 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/ 2023-10-01T07:48:58.095 INFO:teuthology.task.install.rpm:Package version is 16.2.14-44.geeb13ac9 2023-10-01T07:48:58.242 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-01T07:48:58.243 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-01T07:48:58.243 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-01T07:48:58.262 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-01T07:48:58.263 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-01T07:48:58.263 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-01T07:48:58.278 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, python-rados, python-rgw, python-rbd, python-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux on remote rpm x86_64 2023-10-01T07:48:58.278 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-01T07:48:58.278 INFO:teuthology.packaging:ref: None 2023-10-01T07:48:58.278 INFO:teuthology.packaging:tag: None 2023-10-01T07:48:58.278 INFO:teuthology.packaging:branch: pacific 2023-10-01T07:48:58.278 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-01T07:48:58.279 DEBUG:teuthology.orchestra.run.smithi026:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/pacific/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-01T07:48:58.292 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, python-rados, python-rgw, python-rbd, python-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux on remote rpm x86_64 2023-10-01T07:48:58.292 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-01T07:48:58.292 INFO:teuthology.packaging:ref: None 2023-10-01T07:48:58.292 INFO:teuthology.packaging:tag: None 2023-10-01T07:48:58.292 INFO:teuthology.packaging:branch: pacific 2023-10-01T07:48:58.293 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-01T07:48:58.293 DEBUG:teuthology.orchestra.run.smithi092:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/pacific/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-01T07:48:58.355 DEBUG:teuthology.orchestra.run.smithi026:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-01T07:48:58.361 DEBUG:teuthology.orchestra.run.smithi092:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-01T07:48:58.440 DEBUG:teuthology.orchestra.run.smithi092:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-01T07:48:58.442 DEBUG:teuthology.orchestra.run.smithi026:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-01T07:48:58.474 INFO:teuthology.orchestra.run.smithi026.stdout:check_obsoletes = 1 2023-10-01T07:48:58.476 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum clean all 2023-10-01T07:48:58.508 INFO:teuthology.orchestra.run.smithi092.stdout:check_obsoletes = 1 2023-10-01T07:48:58.509 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum clean all 2023-10-01T07:48:58.793 INFO:teuthology.orchestra.run.smithi026.stdout:76 files removed 2023-10-01T07:48:58.794 INFO:teuthology.orchestra.run.smithi092.stdout:76 files removed 2023-10-01T07:48:58.824 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 rbd-fuse rbd-mirror rbd-nbd python-rados python-rgw python-rbd python-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux 2023-10-01T07:48:58.829 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 rbd-fuse rbd-mirror rbd-nbd python-rados python-rgw python-rbd python-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux 2023-10-01T07:48:59.564 INFO:teuthology.orchestra.run.smithi026.stdout:ceph packages for x86_64 284 kB/s | 76 kB 00:00 2023-10-01T07:48:59.582 INFO:teuthology.orchestra.run.smithi092.stdout:ceph packages for x86_64 220 kB/s | 76 kB 00:00 2023-10-01T07:48:59.897 INFO:teuthology.orchestra.run.smithi026.stdout:ceph noarch packages 53 kB/s | 15 kB 00:00 2023-10-01T07:48:59.924 INFO:teuthology.orchestra.run.smithi092.stdout:ceph noarch packages 50 kB/s | 15 kB 00:00 2023-10-01T07:49:00.215 INFO:teuthology.orchestra.run.smithi026.stdout:ceph source packages 5.0 kB/s | 1.4 kB 00:00 2023-10-01T07:49:00.233 INFO:teuthology.orchestra.run.smithi092.stdout:ceph source packages 5.1 kB/s | 1.4 kB 00:00 2023-10-01T07:49:01.332 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 8 - AppStream 31 MB/s | 33 MB 00:01 2023-10-01T07:49:01.550 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 8 - AppStream 26 MB/s | 33 MB 00:01 2023-10-01T07:49:09.892 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 8 - BaseOS 26 MB/s | 48 MB 00:01 2023-10-01T07:49:10.525 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 8 - BaseOS 17 MB/s | 48 MB 00:02 2023-10-01T07:49:17.833 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 8 - Extras 42 kB/s | 18 kB 00:00 2023-10-01T07:49:18.008 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 8 - Extras 38 kB/s | 18 kB 00:00 2023-10-01T07:49:18.425 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 6.9 kB 00:00 2023-10-01T07:49:18.775 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 8 - Extras common packages 12 kB/s | 6.9 kB 00:00 2023-10-01T07:49:19.160 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 8 - PowerTools 11 MB/s | 6.5 MB 00:00 2023-10-01T07:49:20.595 INFO:teuthology.orchestra.run.smithi092.stdout:Copr repo for python3-asyncssh owned by ceph 20 kB/s | 3.5 kB 00:00 2023-10-01T07:49:21.634 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 8 - PowerTools 2.4 MB/s | 6.5 MB 00:02 2023-10-01T07:49:22.605 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 8.6 MB/s | 16 MB 00:01 2023-10-01T07:49:23.202 INFO:teuthology.orchestra.run.smithi026.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2023-10-01T07:49:24.345 INFO:teuthology.orchestra.run.smithi026.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:00 2023-10-01T07:49:26.453 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 332 kB/s | 24 kB 00:00 2023-10-01T07:49:28.695 INFO:teuthology.orchestra.run.smithi026.stdout:lab-extras 274 kB/s | 24 kB 00:00 2023-10-01T07:49:30.705 INFO:teuthology.orchestra.run.smithi092.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-01T07:49:30.706 INFO:teuthology.orchestra.run.smithi092.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-01T07:49:30.731 INFO:teuthology.orchestra.run.smithi092.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-10-01T07:49:30.731 INFO:teuthology.orchestra.run.smithi092.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-10-01T07:49:30.732 INFO:teuthology.orchestra.run.smithi092.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-10-01T07:49:30.733 INFO:teuthology.orchestra.run.smithi092.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-10-01T07:49:30.938 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-10-01T07:49:30.949 INFO:teuthology.orchestra.run.smithi092.stdout:==================================================================================================== 2023-10-01T07:49:30.949 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2023-10-01T07:49:30.949 INFO:teuthology.orchestra.run.smithi092.stdout:==================================================================================================== 2023-10-01T07:49:30.950 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2023-10-01T07:49:30.950 INFO:teuthology.orchestra.run.smithi092.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-10-01T07:49:30.950 INFO:teuthology.orchestra.run.smithi092.stdout: ceph x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.4 k 2023-10-01T07:49:30.950 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.1 M 2023-10-01T07:49:30.950 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 910 k 2023-10-01T07:49:30.950 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 1.6 M 2023-10-01T07:49:30.950 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 3.1 M 2023-10-01T07:49:30.950 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 8.6 M 2023-10-01T07:49:30.950 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 27 k 2023-10-01T07:49:30.950 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 12 M 2023-10-01T07:49:30.950 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 52 M 2023-10-01T07:49:30.951 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 baseos 62 k 2023-10-01T07:49:30.951 INFO:teuthology.orchestra.run.smithi092.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-10-01T07:49:30.951 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 25 k 2023-10-01T07:49:30.951 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 824 k 2023-10-01T07:49:30.951 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 131 k 2023-10-01T07:49:30.951 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-10-01T07:49:30.951 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 215 k 2023-10-01T07:49:30.951 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 390 k 2023-10-01T07:49:30.951 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 369 k 2023-10-01T07:49:30.951 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 114 k 2023-10-01T07:49:30.951 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 88 k 2023-10-01T07:49:30.951 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-10-01T07:49:30.952 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 173 k 2023-10-01T07:49:30.952 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrading: 2023-10-01T07:49:30.952 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 baseos 143 k 2023-10-01T07:49:30.952 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-debuginfod-client x86_64 0.189-3.el8 baseos 76 k 2023-10-01T07:49:30.952 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf x86_64 0.189-3.el8 baseos 232 k 2023-10-01T07:49:30.952 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libs x86_64 0.189-3.el8 baseos 303 k 2023-10-01T07:49:30.952 INFO:teuthology.orchestra.run.smithi092.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-10-01T07:49:30.952 INFO:teuthology.orchestra.run.smithi092.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-10-01T07:49:30.952 INFO:teuthology.orchestra.run.smithi092.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-10-01T07:49:30.952 INFO:teuthology.orchestra.run.smithi092.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-10-01T07:49:30.952 INFO:teuthology.orchestra.run.smithi092.stdout: librados2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-10-01T07:49:30.952 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 4.2 M 2023-10-01T07:49:30.953 INFO:teuthology.orchestra.run.smithi092.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-10-01T07:49:30.953 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-10-01T07:49:30.953 INFO:teuthology.orchestra.run.smithi092.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-10-01T07:49:30.953 INFO:teuthology.orchestra.run.smithi092.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-10-01T07:49:30.953 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2023-10-01T07:49:30.953 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 24 M 2023-10-01T07:49:30.953 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 24 k 2023-10-01T07:49:30.953 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 2.4 M 2023-10-01T07:49:30.953 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 244 k 2023-10-01T07:49:30.953 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 5.0 M 2023-10-01T07:49:30.953 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 18 M 2023-10-01T07:49:30.953 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 15 k 2023-10-01T07:49:30.954 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 26 k 2023-10-01T07:49:30.954 INFO:teuthology.orchestra.run.smithi092.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-10-01T07:49:30.954 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-01T07:49:30.954 INFO:teuthology.orchestra.run.smithi092.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-10-01T07:49:30.954 INFO:teuthology.orchestra.run.smithi092.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-10-01T07:49:30.954 INFO:teuthology.orchestra.run.smithi092.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-10-01T07:49:30.954 INFO:teuthology.orchestra.run.smithi092.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-10-01T07:49:30.954 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 174 k 2023-10-01T07:49:30.954 INFO:teuthology.orchestra.run.smithi092.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-10-01T07:49:30.954 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-10-01T07:49:30.954 INFO:teuthology.orchestra.run.smithi092.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-01T07:49:30.954 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-10-01T07:49:30.955 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-10-01T07:49:30.955 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 493 k 2023-10-01T07:49:30.955 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-10-01T07:49:30.955 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.8 M 2023-10-01T07:49:30.955 INFO:teuthology.orchestra.run.smithi092.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-10-01T07:49:30.955 INFO:teuthology.orchestra.run.smithi092.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-10-01T07:49:30.955 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-01T07:49:30.955 INFO:teuthology.orchestra.run.smithi092.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-10-01T07:49:30.955 INFO:teuthology.orchestra.run.smithi092.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-10-01T07:49:30.955 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-10-01T07:49:30.955 INFO:teuthology.orchestra.run.smithi092.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-10-01T07:49:30.955 INFO:teuthology.orchestra.run.smithi092.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-10-01T07:49:30.956 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-10-01T07:49:30.956 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-10-01T07:49:30.956 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-10-01T07:49:30.956 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-10-01T07:49:30.956 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-01T07:49:30.956 INFO:teuthology.orchestra.run.smithi092.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-01T07:49:30.956 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-01T07:49:30.956 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 45 k 2023-10-01T07:49:30.956 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 99 k 2023-10-01T07:49:30.956 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-01T07:49:30.956 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-10-01T07:49:30.956 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-01T07:49:30.957 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-01T07:49:30.957 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-10-01T07:49:30.957 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-01T07:49:30.957 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-01T07:49:30.957 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-01T07:49:30.957 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-10-01T07:49:30.957 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-10-01T07:49:30.957 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-10-01T07:49:30.957 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-01T07:49:30.957 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-01T07:49:30.957 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-10-01T07:49:30.957 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-10-01T07:49:30.958 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-01T07:49:30.958 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-10-01T07:49:30.958 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-10-01T07:49:30.958 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-10-01T07:49:30.958 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-01T07:49:30.958 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-01T07:49:30.958 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-10-01T07:49:30.958 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-10-01T07:49:30.958 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-10-01T07:49:30.958 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-10-01T07:49:30.958 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-10-01T07:49:30.958 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-10-01T07:49:30.959 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-01T07:49:30.959 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-10-01T07:49:30.959 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-01T07:49:30.959 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-01T07:49:30.959 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-10-01T07:49:30.959 INFO:teuthology.orchestra.run.smithi092.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-01T07:49:30.959 INFO:teuthology.orchestra.run.smithi092.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-01T07:49:30.959 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-01T07:49:30.959 INFO:teuthology.orchestra.run.smithi092.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-01T07:49:30.959 INFO:teuthology.orchestra.run.smithi092.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-01T07:49:30.959 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-01T07:49:30.960 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-01T07:49:30.960 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-01T07:49:30.960 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-10-01T07:49:30.960 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-01T07:49:30.960 INFO:teuthology.orchestra.run.smithi092.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-10-01T07:49:30.960 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-10-01T07:49:30.960 INFO:teuthology.orchestra.run.smithi092.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-10-01T07:49:30.960 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:49:30.960 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2023-10-01T07:49:30.960 INFO:teuthology.orchestra.run.smithi092.stdout:==================================================================================================== 2023-10-01T07:49:30.960 INFO:teuthology.orchestra.run.smithi092.stdout:Install 108 Packages 2023-10-01T07:49:30.960 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrade 14 Packages 2023-10-01T07:49:30.960 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:49:30.961 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 200 M 2023-10-01T07:49:30.961 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2023-10-01T07:49:31.529 INFO:teuthology.orchestra.run.smithi092.stdout:(1/122): ceph-16.2.14-44.geeb13ac9.el8.x86_64.r 52 kB/s | 6.4 kB 00:00 2023-10-01T07:49:31.746 INFO:teuthology.orchestra.run.smithi092.stdout:(2/122): ceph-fuse-16.2.14-44.geeb13ac9.el8.x86 4.1 MB/s | 910 kB 00:00 2023-10-01T07:49:32.147 INFO:teuthology.orchestra.run.smithi092.stdout:(3/122): ceph-mds-16.2.14-44.geeb13ac9.el8.x86_ 6.1 MB/s | 2.4 MB 00:00 2023-10-01T07:49:32.447 INFO:teuthology.orchestra.run.smithi092.stdout:(4/122): ceph-mgr-16.2.14-44.geeb13ac9.el8.x86_ 5.4 MB/s | 1.6 MB 00:00 2023-10-01T07:49:32.914 INFO:teuthology.orchestra.run.smithi092.stdout:(5/122): ceph-common-16.2.14-44.geeb13ac9.el8.x 16 MB/s | 24 MB 00:01 2023-10-01T07:49:33.189 INFO:teuthology.orchestra.run.smithi092.stdout:(6/122): ceph-mon-16.2.14-44.geeb13ac9.el8.x86_ 6.8 MB/s | 5.0 MB 00:00 2023-10-01T07:49:33.385 INFO:teuthology.orchestra.run.smithi026.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-01T07:49:33.386 INFO:teuthology.orchestra.run.smithi026.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-01T07:49:33.414 INFO:teuthology.orchestra.run.smithi026.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-10-01T07:49:33.414 INFO:teuthology.orchestra.run.smithi026.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-10-01T07:49:33.415 INFO:teuthology.orchestra.run.smithi026.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-10-01T07:49:33.416 INFO:teuthology.orchestra.run.smithi026.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-10-01T07:49:33.649 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2023-10-01T07:49:33.694 INFO:teuthology.orchestra.run.smithi026.stdout:==================================================================================================== 2023-10-01T07:49:33.694 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2023-10-01T07:49:33.694 INFO:teuthology.orchestra.run.smithi026.stdout:==================================================================================================== 2023-10-01T07:49:33.695 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2023-10-01T07:49:33.695 INFO:teuthology.orchestra.run.smithi026.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-10-01T07:49:33.695 INFO:teuthology.orchestra.run.smithi026.stdout: ceph x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.4 k 2023-10-01T07:49:33.695 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.1 M 2023-10-01T07:49:33.695 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 910 k 2023-10-01T07:49:33.695 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 1.6 M 2023-10-01T07:49:33.695 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-dashboard noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 3.1 M 2023-10-01T07:49:33.695 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 8.6 M 2023-10-01T07:49:33.695 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-rook noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 27 k 2023-10-01T07:49:33.695 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-radosgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 12 M 2023-10-01T07:49:33.695 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-test x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 52 M 2023-10-01T07:49:33.696 INFO:teuthology.orchestra.run.smithi026.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 baseos 62 k 2023-10-01T07:49:33.696 INFO:teuthology.orchestra.run.smithi026.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-10-01T07:49:33.696 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 25 k 2023-10-01T07:49:33.696 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 824 k 2023-10-01T07:49:33.696 INFO:teuthology.orchestra.run.smithi026.stdout: librados-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 131 k 2023-10-01T07:49:33.696 INFO:teuthology.orchestra.run.smithi026.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-10-01T07:49:33.696 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cephfs x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 215 k 2023-10-01T07:49:33.696 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 390 k 2023-10-01T07:49:33.696 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 369 k 2023-10-01T07:49:33.696 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 114 k 2023-10-01T07:49:33.696 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 88 k 2023-10-01T07:49:33.696 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-mirror x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-10-01T07:49:33.697 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-nbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 173 k 2023-10-01T07:49:33.697 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrading: 2023-10-01T07:49:33.697 INFO:teuthology.orchestra.run.smithi026.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 baseos 143 k 2023-10-01T07:49:33.697 INFO:teuthology.orchestra.run.smithi026.stdout: elfutils-debuginfod-client x86_64 0.189-3.el8 baseos 76 k 2023-10-01T07:49:33.697 INFO:teuthology.orchestra.run.smithi026.stdout: elfutils-libelf x86_64 0.189-3.el8 baseos 232 k 2023-10-01T07:49:33.697 INFO:teuthology.orchestra.run.smithi026.stdout: elfutils-libs x86_64 0.189-3.el8 baseos 303 k 2023-10-01T07:49:33.697 INFO:teuthology.orchestra.run.smithi026.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-10-01T07:49:33.697 INFO:teuthology.orchestra.run.smithi026.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-10-01T07:49:33.697 INFO:teuthology.orchestra.run.smithi026.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-10-01T07:49:33.697 INFO:teuthology.orchestra.run.smithi026.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-10-01T07:49:33.697 INFO:teuthology.orchestra.run.smithi026.stdout: librados2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-10-01T07:49:33.697 INFO:teuthology.orchestra.run.smithi026.stdout: librbd1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 4.2 M 2023-10-01T07:49:33.698 INFO:teuthology.orchestra.run.smithi026.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-10-01T07:49:33.698 INFO:teuthology.orchestra.run.smithi026.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-10-01T07:49:33.698 INFO:teuthology.orchestra.run.smithi026.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-10-01T07:49:33.698 INFO:teuthology.orchestra.run.smithi026.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-10-01T07:49:33.698 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2023-10-01T07:49:33.698 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 24 M 2023-10-01T07:49:33.698 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-grafana-dashboards noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 24 k 2023-10-01T07:49:33.698 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mds x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 2.4 M 2023-10-01T07:49:33.698 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-modules-core noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 244 k 2023-10-01T07:49:33.698 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mon x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 5.0 M 2023-10-01T07:49:33.698 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-osd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 18 M 2023-10-01T07:49:33.698 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-prometheus-alerts noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 15 k 2023-10-01T07:49:33.699 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-selinux x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 26 k 2023-10-01T07:49:33.699 INFO:teuthology.orchestra.run.smithi026.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-10-01T07:49:33.699 INFO:teuthology.orchestra.run.smithi026.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-01T07:49:33.699 INFO:teuthology.orchestra.run.smithi026.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-10-01T07:49:33.699 INFO:teuthology.orchestra.run.smithi026.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-10-01T07:49:33.699 INFO:teuthology.orchestra.run.smithi026.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-10-01T07:49:33.699 INFO:teuthology.orchestra.run.smithi026.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-10-01T07:49:33.699 INFO:teuthology.orchestra.run.smithi026.stdout: libcephsqlite x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 174 k 2023-10-01T07:49:33.699 INFO:teuthology.orchestra.run.smithi026.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-10-01T07:49:33.699 INFO:teuthology.orchestra.run.smithi026.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-10-01T07:49:33.699 INFO:teuthology.orchestra.run.smithi026.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-01T07:49:33.700 INFO:teuthology.orchestra.run.smithi026.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-10-01T07:49:33.700 INFO:teuthology.orchestra.run.smithi026.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-10-01T07:49:33.700 INFO:teuthology.orchestra.run.smithi026.stdout: libradosstriper1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 493 k 2023-10-01T07:49:33.700 INFO:teuthology.orchestra.run.smithi026.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-10-01T07:49:33.700 INFO:teuthology.orchestra.run.smithi026.stdout: librgw2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.8 M 2023-10-01T07:49:33.700 INFO:teuthology.orchestra.run.smithi026.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-10-01T07:49:33.700 INFO:teuthology.orchestra.run.smithi026.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-10-01T07:49:33.700 INFO:teuthology.orchestra.run.smithi026.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-01T07:49:33.700 INFO:teuthology.orchestra.run.smithi026.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-10-01T07:49:33.700 INFO:teuthology.orchestra.run.smithi026.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-10-01T07:49:33.700 INFO:teuthology.orchestra.run.smithi026.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-10-01T07:49:33.700 INFO:teuthology.orchestra.run.smithi026.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-10-01T07:49:33.700 INFO:teuthology.orchestra.run.smithi026.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-10-01T07:49:33.700 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-10-01T07:49:33.701 INFO:teuthology.orchestra.run.smithi026.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-10-01T07:49:33.701 INFO:teuthology.orchestra.run.smithi026.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-10-01T07:49:33.701 INFO:teuthology.orchestra.run.smithi026.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-10-01T07:49:33.701 INFO:teuthology.orchestra.run.smithi026.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-01T07:49:33.701 INFO:teuthology.orchestra.run.smithi026.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-01T07:49:33.701 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-01T07:49:33.701 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-argparse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 45 k 2023-10-01T07:49:33.701 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 99 k 2023-10-01T07:49:33.701 INFO:teuthology.orchestra.run.smithi026.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-01T07:49:33.701 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-10-01T07:49:33.701 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-01T07:49:33.701 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-01T07:49:33.701 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-10-01T07:49:33.702 INFO:teuthology.orchestra.run.smithi026.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-01T07:49:33.702 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-01T07:49:33.702 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-01T07:49:33.702 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-10-01T07:49:33.702 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-10-01T07:49:33.702 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-10-01T07:49:33.702 INFO:teuthology.orchestra.run.smithi026.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-01T07:49:33.702 INFO:teuthology.orchestra.run.smithi026.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-01T07:49:33.702 INFO:teuthology.orchestra.run.smithi026.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-10-01T07:49:33.702 INFO:teuthology.orchestra.run.smithi026.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-10-01T07:49:33.702 INFO:teuthology.orchestra.run.smithi026.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-01T07:49:33.702 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-10-01T07:49:33.703 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-10-01T07:49:33.703 INFO:teuthology.orchestra.run.smithi026.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-10-01T07:49:33.703 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-01T07:49:33.703 INFO:teuthology.orchestra.run.smithi026.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-01T07:49:33.703 INFO:teuthology.orchestra.run.smithi026.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-10-01T07:49:33.703 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-10-01T07:49:33.703 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-10-01T07:49:33.703 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-10-01T07:49:33.703 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-10-01T07:49:33.703 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-10-01T07:49:33.703 INFO:teuthology.orchestra.run.smithi026.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-01T07:49:33.703 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-10-01T07:49:33.704 INFO:teuthology.orchestra.run.smithi026.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-01T07:49:33.704 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-01T07:49:33.704 INFO:teuthology.orchestra.run.smithi026.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-10-01T07:49:33.704 INFO:teuthology.orchestra.run.smithi026.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-01T07:49:33.704 INFO:teuthology.orchestra.run.smithi026.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-01T07:49:33.704 INFO:teuthology.orchestra.run.smithi026.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-01T07:49:33.704 INFO:teuthology.orchestra.run.smithi026.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-01T07:49:33.704 INFO:teuthology.orchestra.run.smithi026.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-01T07:49:33.704 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-01T07:49:33.704 INFO:teuthology.orchestra.run.smithi026.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-01T07:49:33.704 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-01T07:49:33.704 INFO:teuthology.orchestra.run.smithi026.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-10-01T07:49:33.705 INFO:teuthology.orchestra.run.smithi026.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-01T07:49:33.705 INFO:teuthology.orchestra.run.smithi026.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-10-01T07:49:33.705 INFO:teuthology.orchestra.run.smithi026.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-10-01T07:49:33.705 INFO:teuthology.orchestra.run.smithi026.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-10-01T07:49:33.705 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:49:33.705 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2023-10-01T07:49:33.705 INFO:teuthology.orchestra.run.smithi026.stdout:==================================================================================================== 2023-10-01T07:49:33.705 INFO:teuthology.orchestra.run.smithi026.stdout:Install 108 Packages 2023-10-01T07:49:33.705 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrade 14 Packages 2023-10-01T07:49:33.705 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:49:33.705 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 200 M 2023-10-01T07:49:33.705 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2023-10-01T07:49:34.030 INFO:teuthology.orchestra.run.smithi026.stdout:(1/122): ceph-16.2.14-44.geeb13ac9.el8.x86_64.r 30 kB/s | 6.4 kB 00:00 2023-10-01T07:49:34.114 INFO:teuthology.orchestra.run.smithi092.stdout:(7/122): ceph-base-16.2.14-44.geeb13ac9.el8.x86 2.2 MB/s | 6.1 MB 00:02 2023-10-01T07:49:34.280 INFO:teuthology.orchestra.run.smithi026.stdout:(2/122): ceph-fuse-16.2.14-44.geeb13ac9.el8.x86 3.6 MB/s | 910 kB 00:00 2023-10-01T07:49:34.314 INFO:teuthology.orchestra.run.smithi092.stdout:(8/122): ceph-osd-16.2.14-44.geeb13ac9.el8.x86_ 13 MB/s | 18 MB 00:01 2023-10-01T07:49:34.339 INFO:teuthology.orchestra.run.smithi092.stdout:(9/122): ceph-selinux-16.2.14-44.geeb13ac9.el8. 114 kB/s | 26 kB 00:00 2023-10-01T07:49:34.481 INFO:teuthology.orchestra.run.smithi092.stdout:(10/122): libcephfs-devel-16.2.14-44.geeb13ac9. 180 kB/s | 25 kB 00:00 2023-10-01T07:49:34.672 INFO:teuthology.orchestra.run.smithi026.stdout:(3/122): ceph-base-16.2.14-44.geeb13ac9.el8.x86 7.1 MB/s | 6.1 MB 00:00 2023-10-01T07:49:34.722 INFO:teuthology.orchestra.run.smithi026.stdout:(4/122): ceph-mds-16.2.14-44.geeb13ac9.el8.x86_ 5.5 MB/s | 2.4 MB 00:00 2023-10-01T07:49:34.757 INFO:teuthology.orchestra.run.smithi092.stdout:(11/122): ceph-radosgw-16.2.14-44.geeb13ac9.el8 7.4 MB/s | 12 MB 00:01 2023-10-01T07:49:34.790 INFO:teuthology.orchestra.run.smithi092.stdout:(12/122): libcephfs2-16.2.14-44.geeb13ac9.el8.x 2.6 MB/s | 824 kB 00:00 2023-10-01T07:49:34.832 INFO:teuthology.orchestra.run.smithi092.stdout:(13/122): libcephsqlite-16.2.14-44.geeb13ac9.el 2.3 MB/s | 174 kB 00:00 2023-10-01T07:49:34.914 INFO:teuthology.orchestra.run.smithi026.stdout:(5/122): ceph-mgr-16.2.14-44.geeb13ac9.el8.x86_ 6.7 MB/s | 1.6 MB 00:00 2023-10-01T07:49:34.924 INFO:teuthology.orchestra.run.smithi092.stdout:(14/122): librados-devel-16.2.14-44.geeb13ac9.e 982 kB/s | 131 kB 00:00 2023-10-01T07:49:35.000 INFO:teuthology.orchestra.run.smithi092.stdout:(15/122): libradosstriper1-16.2.14-44.geeb13ac9 2.9 MB/s | 493 kB 00:00 2023-10-01T07:49:35.125 INFO:teuthology.orchestra.run.smithi092.stdout:(16/122): python3-ceph-argparse-16.2.14-44.geeb 360 kB/s | 45 kB 00:00 2023-10-01T07:49:35.225 INFO:teuthology.orchestra.run.smithi092.stdout:(17/122): python3-ceph-common-16.2.14-44.geeb13 986 kB/s | 99 kB 00:00 2023-10-01T07:49:35.317 INFO:teuthology.orchestra.run.smithi092.stdout:(18/122): python3-cephfs-16.2.14-44.geeb13ac9.e 2.3 MB/s | 215 kB 00:00 2023-10-01T07:49:35.431 INFO:teuthology.orchestra.run.smithi026.stdout:(6/122): ceph-mon-16.2.14-44.geeb13ac9.el8.x86_ 7.1 MB/s | 5.0 MB 00:00 2023-10-01T07:49:35.459 INFO:teuthology.orchestra.run.smithi092.stdout:(19/122): python3-rados-16.2.14-44.geeb13ac9.el 2.7 MB/s | 390 kB 00:00 2023-10-01T07:49:35.610 INFO:teuthology.orchestra.run.smithi092.stdout:(20/122): python3-rbd-16.2.14-44.geeb13ac9.el8. 2.4 MB/s | 369 kB 00:00 2023-10-01T07:49:35.702 INFO:teuthology.orchestra.run.smithi092.stdout:(21/122): python3-rgw-16.2.14-44.geeb13ac9.el8. 1.2 MB/s | 114 kB 00:00 2023-10-01T07:49:35.785 INFO:teuthology.orchestra.run.smithi092.stdout:(22/122): rbd-fuse-16.2.14-44.geeb13ac9.el8.x86 1.0 MB/s | 88 kB 00:00 2023-10-01T07:49:36.144 INFO:teuthology.orchestra.run.smithi092.stdout:(23/122): librgw2-16.2.14-44.geeb13ac9.el8.x86_ 3.1 MB/s | 3.8 MB 00:01 2023-10-01T07:49:36.261 INFO:teuthology.orchestra.run.smithi092.stdout:(24/122): rbd-nbd-16.2.14-44.geeb13ac9.el8.x86_ 1.5 MB/s | 173 kB 00:00 2023-10-01T07:49:36.378 INFO:teuthology.orchestra.run.smithi092.stdout:(25/122): ceph-grafana-dashboards-16.2.14-44.ge 209 kB/s | 24 kB 00:00 2023-10-01T07:49:36.622 INFO:teuthology.orchestra.run.smithi092.stdout:(26/122): rbd-mirror-16.2.14-44.geeb13ac9.el8.x 4.4 MB/s | 3.7 MB 00:00 2023-10-01T07:49:37.240 INFO:teuthology.orchestra.run.smithi026.stdout:(7/122): ceph-radosgw-16.2.14-44.geeb13ac9.el8. 6.4 MB/s | 12 MB 00:01 2023-10-01T07:49:37.367 INFO:teuthology.orchestra.run.smithi092.stdout:(27/122): ceph-mgr-dashboard-16.2.14-44.geeb13a 3.2 MB/s | 3.1 MB 00:00 2023-10-01T07:49:37.457 INFO:teuthology.orchestra.run.smithi026.stdout:(8/122): ceph-osd-16.2.14-44.geeb13ac9.el8.x86_ 7.2 MB/s | 18 MB 00:02 2023-10-01T07:49:37.470 INFO:teuthology.orchestra.run.smithi092.stdout:(28/122): ceph-mgr-modules-core-16.2.14-44.geeb 2.3 MB/s | 244 kB 00:00 2023-10-01T07:49:37.482 INFO:teuthology.orchestra.run.smithi026.stdout:(9/122): ceph-selinux-16.2.14-44.geeb13ac9.el8. 106 kB/s | 26 kB 00:00 2023-10-01T07:49:37.557 INFO:teuthology.orchestra.run.smithi026.stdout:(10/122): libcephfs-devel-16.2.14-44.geeb13ac9. 341 kB/s | 25 kB 00:00 2023-10-01T07:49:37.562 INFO:teuthology.orchestra.run.smithi092.stdout:(29/122): ceph-mgr-rook-16.2.14-44.geeb13ac9.el 299 kB/s | 27 kB 00:00 2023-10-01T07:49:37.696 INFO:teuthology.orchestra.run.smithi092.stdout:(30/122): ceph-prometheus-alerts-16.2.14-44.gee 111 kB/s | 15 kB 00:00 2023-10-01T07:49:37.707 INFO:teuthology.orchestra.run.smithi026.stdout:(11/122): libcephfs2-16.2.14-44.geeb13ac9.el8.x 5.4 MB/s | 824 kB 00:00 2023-10-01T07:49:37.791 INFO:teuthology.orchestra.run.smithi026.stdout:(12/122): libcephsqlite-16.2.14-44.geeb13ac9.el 2.0 MB/s | 174 kB 00:00 2023-10-01T07:49:37.863 INFO:teuthology.orchestra.run.smithi092.stdout:(31/122): bison-3.0.4-10.el8.x86_64.rpm 4.0 MB/s | 688 kB 00:00 2023-10-01T07:49:37.899 INFO:teuthology.orchestra.run.smithi026.stdout:(13/122): librados-devel-16.2.14-44.geeb13ac9.e 1.2 MB/s | 131 kB 00:00 2023-10-01T07:49:37.913 INFO:teuthology.orchestra.run.smithi092.stdout:(32/122): flex-2.6.1-9.el8.x86_64.rpm 6.3 MB/s | 320 kB 00:00 2023-10-01T07:49:37.990 INFO:teuthology.orchestra.run.smithi092.stdout:(33/122): jq-1.6-7.el8.x86_64.rpm 2.6 MB/s | 202 kB 00:00 2023-10-01T07:49:38.000 INFO:teuthology.orchestra.run.smithi026.stdout:(14/122): libradosstriper1-16.2.14-44.geeb13ac9 4.8 MB/s | 493 kB 00:00 2023-10-01T07:49:38.047 INFO:teuthology.orchestra.run.smithi092.stdout:(34/122): librdkafka-0.11.4-3.el8.x86_64.rpm 6.1 MB/s | 354 kB 00:00 2023-10-01T07:49:38.097 INFO:teuthology.orchestra.run.smithi092.stdout:(35/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.1 MB/s | 259 kB 00:00 2023-10-01T07:49:38.147 INFO:teuthology.orchestra.run.smithi092.stdout:(36/122): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-10-01T07:49:38.381 INFO:teuthology.orchestra.run.smithi092.stdout:(37/122): openblas-0.3.15-4.el8.x86_64.rpm 20 MB/s | 4.7 MB 00:00 2023-10-01T07:49:38.650 INFO:teuthology.orchestra.run.smithi026.stdout:(15/122): librgw2-16.2.14-44.geeb13ac9.el8.x86_ 5.8 MB/s | 3.8 MB 00:00 2023-10-01T07:49:38.706 INFO:teuthology.orchestra.run.smithi092.stdout:(38/122): ceph-mgr-diskprediction-local-16.2.14 4.1 MB/s | 8.6 MB 00:02 2023-10-01T07:49:38.708 INFO:teuthology.orchestra.run.smithi026.stdout:(16/122): python3-ceph-argparse-16.2.14-44.geeb 774 kB/s | 45 kB 00:00 2023-10-01T07:49:38.765 INFO:teuthology.orchestra.run.smithi092.stdout:(39/122): openblas-threads-0.3.15-4.el8.x86_64. 13 MB/s | 4.9 MB 00:00 2023-10-01T07:49:38.784 INFO:teuthology.orchestra.run.smithi026.stdout:(17/122): python3-ceph-common-16.2.14-44.geeb13 1.3 MB/s | 99 kB 00:00 2023-10-01T07:49:38.790 INFO:teuthology.orchestra.run.smithi092.stdout:(40/122): python3-jsonpatch-1.21-2.el8.noarch.r 318 kB/s | 27 kB 00:00 2023-10-01T07:49:38.832 INFO:teuthology.orchestra.run.smithi092.stdout:(41/122): python3-mako-1.0.6-14.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2023-10-01T07:49:38.857 INFO:teuthology.orchestra.run.smithi092.stdout:(42/122): python3-jsonpointer-1.10-11.el8.noarc 217 kB/s | 20 kB 00:00 2023-10-01T07:49:38.859 INFO:teuthology.orchestra.run.smithi026.stdout:(18/122): python3-cephfs-16.2.14-44.geeb13ac9.e 2.8 MB/s | 215 kB 00:00 2023-10-01T07:49:38.908 INFO:teuthology.orchestra.run.smithi092.stdout:(43/122): python3-markupsafe-0.23-19.el8.x86_64 516 kB/s | 39 kB 00:00 2023-10-01T07:49:38.951 INFO:teuthology.orchestra.run.smithi026.stdout:(19/122): python3-rados-16.2.14-44.geeb13ac9.el 4.2 MB/s | 390 kB 00:00 2023-10-01T07:49:38.958 INFO:teuthology.orchestra.run.smithi092.stdout:(44/122): python3-numpy-f2py-1.14.3-10.el8.x86_ 4.4 MB/s | 225 kB 00:00 2023-10-01T07:49:39.008 INFO:teuthology.orchestra.run.smithi092.stdout:(45/122): python3-prettytable-0.7.2-14.el8.noar 879 kB/s | 44 kB 00:00 2023-10-01T07:49:39.059 INFO:teuthology.orchestra.run.smithi092.stdout:(46/122): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-10-01T07:49:39.059 INFO:teuthology.orchestra.run.smithi026.stdout:(20/122): python3-rbd-16.2.14-44.geeb13ac9.el8. 3.4 MB/s | 369 kB 00:00 2023-10-01T07:49:39.109 INFO:teuthology.orchestra.run.smithi092.stdout:(47/122): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-10-01T07:49:39.142 INFO:teuthology.orchestra.run.smithi092.stdout:(48/122): python3-pyasn1-modules-0.3.7-6.el8.no 3.2 MB/s | 110 kB 00:00 2023-10-01T07:49:39.144 INFO:teuthology.orchestra.run.smithi026.stdout:(21/122): python3-rgw-16.2.14-44.geeb13ac9.el8. 1.3 MB/s | 114 kB 00:00 2023-10-01T07:49:39.176 INFO:teuthology.orchestra.run.smithi092.stdout:(49/122): python3-pytz-2017.2-11.el8.noarch.rpm 1.7 MB/s | 57 kB 00:00 2023-10-01T07:49:39.219 INFO:teuthology.orchestra.run.smithi026.stdout:(22/122): rbd-fuse-16.2.14-44.geeb13ac9.el8.x86 1.2 MB/s | 88 kB 00:00 2023-10-01T07:49:39.310 INFO:teuthology.orchestra.run.smithi092.stdout:(50/122): python3-numpy-1.14.3-10.el8.x86_64.rp 8.3 MB/s | 3.7 MB 00:00 2023-10-01T07:49:39.369 INFO:teuthology.orchestra.run.smithi092.stdout:(51/122): python3-werkzeug-0.12.2-4.el8.noarch. 7.7 MB/s | 457 kB 00:00 2023-10-01T07:49:39.444 INFO:teuthology.orchestra.run.smithi092.stdout:(52/122): socat-1.7.4.1-1.el8.x86_64.rpm 4.2 MB/s | 323 kB 00:00 2023-10-01T07:49:39.486 INFO:teuthology.orchestra.run.smithi092.stdout:(53/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.7 MB/s | 71 kB 00:00 2023-10-01T07:49:39.678 INFO:teuthology.orchestra.run.smithi092.stdout:(54/122): python3-scipy-1.0.0-21.module_el8.5.0 27 MB/s | 14 MB 00:00 2023-10-01T07:49:39.703 INFO:teuthology.orchestra.run.smithi092.stdout:(55/122): elfutils-libelf-devel-0.189-3.el8.x86 284 kB/s | 62 kB 00:00 2023-10-01T07:49:39.770 INFO:teuthology.orchestra.run.smithi092.stdout:(56/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 721 kB/s | 48 kB 00:00 2023-10-01T07:49:39.794 INFO:teuthology.orchestra.run.smithi026.stdout:(23/122): rbd-mirror-16.2.14-44.geeb13ac9.el8.x 6.4 MB/s | 3.7 MB 00:00 2023-10-01T07:49:39.878 INFO:teuthology.orchestra.run.smithi026.stdout:(24/122): rbd-nbd-16.2.14-44.geeb13ac9.el8.x86_ 2.0 MB/s | 173 kB 00:00 2023-10-01T07:49:39.887 INFO:teuthology.orchestra.run.smithi092.stdout:(57/122): fuse-2.9.7-17.el8.x86_64.rpm 398 kB/s | 83 kB 00:00 2023-10-01T07:49:39.937 INFO:teuthology.orchestra.run.smithi026.stdout:(25/122): ceph-grafana-dashboards-16.2.14-44.ge 419 kB/s | 24 kB 00:00 2023-10-01T07:49:39.962 INFO:teuthology.orchestra.run.smithi092.stdout:(58/122): libcom_err-devel-1.45.6-5.el8.x86_64. 516 kB/s | 39 kB 00:00 2023-10-01T07:49:40.038 INFO:teuthology.orchestra.run.smithi092.stdout:(59/122): krb5-devel-1.18.2-22.el8.x86_64.rpm 2.0 MB/s | 561 kB 00:00 2023-10-01T07:49:40.155 INFO:teuthology.orchestra.run.smithi092.stdout:(60/122): libquadmath-8.5.0-20.el8.x86_64.rpm 1.4 MB/s | 172 kB 00:00 2023-10-01T07:49:40.355 INFO:teuthology.orchestra.run.smithi092.stdout:(61/122): librabbitmq-0.9.0-4.el8.x86_64.rpm 234 kB/s | 47 kB 00:00 2023-10-01T07:49:40.387 INFO:teuthology.orchestra.run.smithi026.stdout:(26/122): ceph-mgr-dashboard-16.2.14-44.geeb13a 6.9 MB/s | 3.1 MB 00:00 2023-10-01T07:49:40.505 INFO:teuthology.orchestra.run.smithi092.stdout:(62/122): libgfortran-8.5.0-20.el8.x86_64.rpm 1.2 MB/s | 645 kB 00:00 2023-10-01T07:49:40.530 INFO:teuthology.orchestra.run.smithi092.stdout:(63/122): libselinux-devel-2.9-8.el8.x86_64.rpm 1.1 MB/s | 200 kB 00:00 2023-10-01T07:49:40.589 INFO:teuthology.orchestra.run.smithi092.stdout:(64/122): libverto-devel-0.3.2-2.el8.x86_64.rpm 310 kB/s | 18 kB 00:00 2023-10-01T07:49:40.615 INFO:teuthology.orchestra.run.smithi092.stdout:(65/122): libsepol-devel-2.9-3.el8.x86_64.rpm 799 kB/s | 87 kB 00:00 2023-10-01T07:49:40.656 INFO:teuthology.orchestra.run.smithi092.stdout:(66/122): libzstd-devel-1.4.4-1.el8.x86_64.rpm 657 kB/s | 44 kB 00:00 2023-10-01T07:49:40.857 INFO:teuthology.orchestra.run.smithi092.stdout:(67/122): pcre2-devel-10.32-3.el8.x86_64.rpm 3.0 MB/s | 605 kB 00:00 2023-10-01T07:49:40.982 INFO:teuthology.orchestra.run.smithi092.stdout:(68/122): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.8 MB/s | 229 kB 00:00 2023-10-01T07:49:41.524 INFO:teuthology.orchestra.run.smithi092.stdout:(69/122): ceph-test-16.2.14-44.geeb13ac9.el8.x8 7.2 MB/s | 52 MB 00:07 2023-10-01T07:49:41.549 INFO:teuthology.orchestra.run.smithi092.stdout:(70/122): pcre2-utf32-10.32-3.el8.x86_64.rpm 389 kB/s | 220 kB 00:00 2023-10-01T07:49:41.658 INFO:teuthology.orchestra.run.smithi092.stdout:(71/122): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.8 MB/s | 249 kB 00:00 2023-10-01T07:49:41.734 INFO:teuthology.orchestra.run.smithi092.stdout:(72/122): python3-jwt-1.6.1-2.el8.noarch.rpm 569 kB/s | 43 kB 00:00 2023-10-01T07:49:41.833 INFO:teuthology.orchestra.run.smithi092.stdout:(73/122): python3-oauthlib-2.1.0-1.el8.noarch.r 1.5 MB/s | 155 kB 00:00 2023-10-01T07:49:41.837 INFO:teuthology.orchestra.run.smithi026.stdout:(27/122): ceph-test-16.2.14-44.geeb13ac9.el8.x8 12 MB/s | 52 MB 00:04 2023-10-01T07:49:41.934 INFO:teuthology.orchestra.run.smithi092.stdout:(74/122): openssl-devel-1.1.1k-9.el8.x86_64.rpm 2.4 MB/s | 3.2 MB 00:01 2023-10-01T07:49:41.938 INFO:teuthology.orchestra.run.smithi026.stdout:(28/122): ceph-mgr-diskprediction-local-16.2.14 5.5 MB/s | 8.6 MB 00:01 2023-10-01T07:49:41.959 INFO:teuthology.orchestra.run.smithi092.stdout:(75/122): python3-pycparser-2.14-14.el8.noarch. 869 kB/s | 109 kB 00:00 2023-10-01T07:49:41.963 INFO:teuthology.orchestra.run.smithi026.stdout:(29/122): ceph-mgr-modules-core-16.2.14-44.geeb 1.9 MB/s | 244 kB 00:00 2023-10-01T07:49:41.984 INFO:teuthology.orchestra.run.smithi092.stdout:(76/122): python3-cryptography-3.2.1-6.el8.x86_ 1.4 MB/s | 641 kB 00:00 2023-10-01T07:49:41.988 INFO:teuthology.orchestra.run.smithi026.stdout:(30/122): ceph-mgr-rook-16.2.14-44.geeb13ac9.el 549 kB/s | 27 kB 00:00 2023-10-01T07:49:42.001 INFO:teuthology.orchestra.run.smithi092.stdout:(77/122): python3-requests-oauthlib-1.0.0-1.el8 636 kB/s | 43 kB 00:00 2023-10-01T07:49:42.014 INFO:teuthology.orchestra.run.smithi026.stdout:(31/122): ceph-prometheus-alerts-16.2.14-44.gee 296 kB/s | 15 kB 00:00 2023-10-01T07:49:42.026 INFO:teuthology.orchestra.run.smithi092.stdout:(78/122): zlib-devel-1.2.11-21.el8.x86_64.rpm 865 kB/s | 58 kB 00:00 2023-10-01T07:49:42.164 INFO:teuthology.orchestra.run.smithi026.stdout:(32/122): flex-2.6.1-9.el8.x86_64.rpm 2.1 MB/s | 320 kB 00:00 2023-10-01T07:49:42.206 INFO:teuthology.orchestra.run.smithi026.stdout:(33/122): bison-3.0.4-10.el8.x86_64.rpm 3.1 MB/s | 688 kB 00:00 2023-10-01T07:49:42.218 INFO:teuthology.orchestra.run.smithi092.stdout:(79/122): liboath-2.6.2-3.el8.x86_64.rpm 322 kB/s | 59 kB 00:00 2023-10-01T07:49:42.231 INFO:teuthology.orchestra.run.smithi026.stdout:(34/122): jq-1.6-7.el8.x86_64.rpm 3.0 MB/s | 202 kB 00:00 2023-10-01T07:49:42.243 INFO:teuthology.orchestra.run.smithi092.stdout:(80/122): leveldb-1.22-1.el8.x86_64.rpm 747 kB/s | 181 kB 00:00 2023-10-01T07:49:42.294 INFO:teuthology.orchestra.run.smithi092.stdout:(81/122): libunwind-1.3.1-3.el8.x86_64.rpm 999 kB/s | 75 kB 00:00 2023-10-01T07:49:42.306 INFO:teuthology.orchestra.run.smithi026.stdout:(35/122): librdkafka-0.11.4-3.el8.x86_64.rpm 3.4 MB/s | 354 kB 00:00 2023-10-01T07:49:42.319 INFO:teuthology.orchestra.run.smithi092.stdout:(82/122): gperftools-libs-2.7-9.el8.x86_64.rpm 915 kB/s | 306 kB 00:00 2023-10-01T07:49:42.332 INFO:teuthology.orchestra.run.smithi026.stdout:(36/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.5 MB/s | 259 kB 00:00 2023-10-01T07:49:42.336 INFO:teuthology.orchestra.run.smithi092.stdout:(83/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 474 kB/s | 44 kB 00:00 2023-10-01T07:49:42.357 INFO:teuthology.orchestra.run.smithi026.stdout:(37/122): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-10-01T07:49:42.369 INFO:teuthology.orchestra.run.smithi092.stdout:(84/122): python3-certifi-2018.10.15-7.el8.noar 493 kB/s | 16 kB 00:00 2023-10-01T07:49:42.386 INFO:teuthology.orchestra.run.smithi092.stdout:(85/122): python3-cachetools-3.1.1-4.el8.noarch 659 kB/s | 33 kB 00:00 2023-10-01T07:49:42.436 INFO:teuthology.orchestra.run.smithi092.stdout:(86/122): python3-beautifulsoup4-4.6.3-2.el8.1. 1.3 MB/s | 185 kB 00:00 2023-10-01T07:49:42.487 INFO:teuthology.orchestra.run.smithi092.stdout:(87/122): python3-cheroot-8.5.2-1.el8.noarch.rp 1.4 MB/s | 173 kB 00:00 2023-10-01T07:49:42.512 INFO:teuthology.orchestra.run.smithi092.stdout:(88/122): python3-google-auth-1.1.1-10.el8.noar 1.1 MB/s | 81 kB 00:00 2023-10-01T07:49:42.529 INFO:teuthology.orchestra.run.smithi092.stdout:(89/122): python3-jaraco-6.2-6.el8.noarch.rpm 266 kB/s | 11 kB 00:00 2023-10-01T07:49:42.563 INFO:teuthology.orchestra.run.smithi092.stdout:(90/122): python3-jaraco-functools-2.0-4.el8.no 350 kB/s | 18 kB 00:00 2023-10-01T07:49:42.613 INFO:teuthology.orchestra.run.smithi092.stdout:(91/122): python3-logutils-0.3.5-11.el8.noarch. 978 kB/s | 49 kB 00:00 2023-10-01T07:49:42.680 INFO:teuthology.orchestra.run.smithi092.stdout:(92/122): python3-cherrypy-18.4.0-1.el8.noarch. 1.3 MB/s | 384 kB 00:00 2023-10-01T07:49:42.697 INFO:teuthology.orchestra.run.smithi092.stdout:(93/122): python3-more-itertools-7.2.0-3.el8.no 703 kB/s | 59 kB 00:00 2023-10-01T07:49:42.747 INFO:teuthology.orchestra.run.smithi092.stdout:(94/122): python3-portend-2.6-1.el8.noarch.rpm 312 kB/s | 16 kB 00:00 2023-10-01T07:49:42.754 INFO:teuthology.orchestra.run.smithi026.stdout:(38/122): openblas-0.3.15-4.el8.x86_64.rpm 11 MB/s | 4.7 MB 00:00 2023-10-01T07:49:42.807 INFO:teuthology.orchestra.run.smithi026.stdout:(39/122): python3-jsonpatch-1.21-2.el8.noarch.r 501 kB/s | 27 kB 00:00 2023-10-01T07:49:42.847 INFO:teuthology.orchestra.run.smithi092.stdout:(95/122): python3-repoze-lru-0.7-6.el8.noarch.r 337 kB/s | 34 kB 00:00 2023-10-01T07:49:42.858 INFO:teuthology.orchestra.run.smithi026.stdout:(40/122): python3-jsonpointer-1.10-11.el8.noarc 400 kB/s | 20 kB 00:00 2023-10-01T07:49:42.872 INFO:teuthology.orchestra.run.smithi092.stdout:(96/122): python3-pecan-1.3.2-9.el8.noarch.rpm 1.4 MB/s | 283 kB 00:00 2023-10-01T07:49:42.925 INFO:teuthology.orchestra.run.smithi026.stdout:(41/122): openblas-threads-0.3.15-4.el8.x86_64. 8.6 MB/s | 4.9 MB 00:00 2023-10-01T07:49:42.931 INFO:teuthology.orchestra.run.smithi092.stdout:(97/122): python3-rsa-4.9-2.el8.noarch.rpm 1.1 MB/s | 64 kB 00:00 2023-10-01T07:49:42.950 INFO:teuthology.orchestra.run.smithi026.stdout:(42/122): python3-mako-1.0.6-14.el8.noarch.rpm 1.7 MB/s | 157 kB 00:00 2023-10-01T07:49:42.956 INFO:teuthology.orchestra.run.smithi092.stdout:(98/122): python3-routes-2.4.1-12.el8.noarch.rp 1.8 MB/s | 196 kB 00:00 2023-10-01T07:49:42.973 INFO:teuthology.orchestra.run.smithi092.stdout:(99/122): python3-simplegeneric-0.8.1-17.el8.no 448 kB/s | 19 kB 00:00 2023-10-01T07:49:42.998 INFO:teuthology.orchestra.run.smithi092.stdout:(100/122): python3-singledispatch-3.4.0.3-18.el 573 kB/s | 24 kB 00:00 2023-10-01T07:49:42.999 INFO:teuthology.orchestra.run.smithi026.stdout:(43/122): python3-markupsafe-0.23-19.el8.x86_64 522 kB/s | 39 kB 00:00 2023-10-01T07:49:43.043 INFO:teuthology.orchestra.run.smithi092.stdout:(101/122): python3-tempora-1.14.1-5.el8.noarch. 423 kB/s | 29 kB 00:00 2023-10-01T07:49:43.059 INFO:teuthology.orchestra.run.smithi026.stdout:(44/122): python3-numpy-f2py-1.14.3-10.el8.x86_ 3.7 MB/s | 225 kB 00:00 2023-10-01T07:49:43.066 INFO:teuthology.orchestra.run.smithi092.stdout:(102/122): python3-trustme-0.6.0-4.el8.noarch.r 411 kB/s | 27 kB 00:00 2023-10-01T07:49:43.101 INFO:teuthology.orchestra.run.smithi026.stdout:(45/122): python3-prettytable-0.7.2-14.el8.noar 1.0 MB/s | 44 kB 00:00 2023-10-01T07:49:43.149 INFO:teuthology.orchestra.run.smithi092.stdout:(103/122): python3-kubernetes-11.0.0-6.el8.noar 1.9 MB/s | 1.2 MB 00:00 2023-10-01T07:49:43.151 INFO:teuthology.orchestra.run.smithi026.stdout:(46/122): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-10-01T07:49:43.208 INFO:teuthology.orchestra.run.smithi092.stdout:(104/122): python3-websocket-client-0.56.0-5.el 1.0 MB/s | 61 kB 00:00 2023-10-01T07:49:43.237 INFO:teuthology.orchestra.run.smithi026.stdout:(47/122): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.5 MB/s | 126 kB 00:00 2023-10-01T07:49:43.241 INFO:teuthology.orchestra.run.smithi092.stdout:(105/122): python3-waitress-1.4.3-1.el8.noarch. 1.3 MB/s | 255 kB 00:00 2023-10-01T07:49:43.267 INFO:teuthology.orchestra.run.smithi092.stdout:(106/122): python3-webob-1.8.5-1.el8.1.noarch.r 1.2 MB/s | 251 kB 00:00 2023-10-01T07:49:43.292 INFO:teuthology.orchestra.run.smithi092.stdout:(107/122): python3-webtest-2.0.33-1.el8.noarch. 1.0 MB/s | 85 kB 00:00 2023-10-01T07:49:43.294 INFO:teuthology.orchestra.run.smithi026.stdout:(48/122): python3-pyasn1-modules-0.3.7-6.el8.no 1.9 MB/s | 110 kB 00:00 2023-10-01T07:49:43.318 INFO:teuthology.orchestra.run.smithi092.stdout:(108/122): python3-zc-lockfile-2.0-2.el8.noarch 304 kB/s | 23 kB 00:00 2023-10-01T07:49:43.344 INFO:teuthology.orchestra.run.smithi026.stdout:(49/122): python3-pytz-2017.2-11.el8.noarch.rpm 1.1 MB/s | 57 kB 00:00 2023-10-01T07:49:43.428 INFO:teuthology.orchestra.run.smithi026.stdout:(50/122): python3-numpy-1.14.3-10.el8.x86_64.rp 7.8 MB/s | 3.7 MB 00:00 2023-10-01T07:49:43.520 INFO:teuthology.orchestra.run.smithi026.stdout:(51/122): python3-werkzeug-0.12.2-4.el8.noarch. 4.9 MB/s | 457 kB 00:00 2023-10-01T07:49:43.535 INFO:teuthology.orchestra.run.smithi092.stdout:(109/122): NetworkManager-initscripts-updown-1. 662 kB/s | 143 kB 00:00 2023-10-01T07:49:43.596 INFO:teuthology.orchestra.run.smithi026.stdout:(52/122): socat-1.7.4.1-1.el8.x86_64.rpm 4.2 MB/s | 323 kB 00:00 2023-10-01T07:49:43.601 INFO:teuthology.orchestra.run.smithi092.stdout:(110/122): elfutils-debuginfod-client-0.189-3.e 1.1 MB/s | 76 kB 00:00 2023-10-01T07:49:43.645 INFO:teuthology.orchestra.run.smithi026.stdout:(53/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 71 kB 00:00 2023-10-01T07:49:43.718 INFO:teuthology.orchestra.run.smithi092.stdout:(111/122): librados2-16.2.14-44.geeb13ac9.el8.x 8.3 MB/s | 3.7 MB 00:00 2023-10-01T07:49:43.744 INFO:teuthology.orchestra.run.smithi092.stdout:(112/122): elfutils-libelf-0.189-3.el8.x86_64.r 1.6 MB/s | 232 kB 00:00 2023-10-01T07:49:43.879 INFO:teuthology.orchestra.run.smithi026.stdout:(54/122): elfutils-libelf-devel-0.189-3.el8.x86 264 kB/s | 62 kB 00:00 2023-10-01T07:49:44.002 INFO:teuthology.orchestra.run.smithi092.stdout:(113/122): elfutils-libs-0.189-3.el8.x86_64.rpm 1.0 MB/s | 303 kB 00:00 2023-10-01T07:49:44.004 INFO:teuthology.orchestra.run.smithi026.stdout:(55/122): fuse-2.9.7-17.el8.x86_64.rpm 665 kB/s | 83 kB 00:00 2023-10-01T07:49:44.028 INFO:teuthology.orchestra.run.smithi092.stdout:(114/122): iproute-6.2.0-2.el8.x86_64.rpm 3.0 MB/s | 880 kB 00:00 2023-10-01T07:49:44.088 INFO:teuthology.orchestra.run.smithi026.stdout:(56/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 578 kB/s | 48 kB 00:00 2023-10-01T07:49:44.161 INFO:teuthology.orchestra.run.smithi092.stdout:(115/122): librbd1-16.2.14-44.geeb13ac9.el8.x86 4.8 MB/s | 4.2 MB 00:00 2023-10-01T07:49:44.186 INFO:teuthology.orchestra.run.smithi092.stdout:(116/122): libblkid-2.32.1-43.el8.x86_64.rpm 1.2 MB/s | 220 kB 00:00 2023-10-01T07:49:44.212 INFO:teuthology.orchestra.run.smithi092.stdout:(117/122): libfdisk-2.32.1-43.el8.x86_64.rpm 1.3 MB/s | 254 kB 00:00 2023-10-01T07:49:44.295 INFO:teuthology.orchestra.run.smithi092.stdout:(118/122): libuuid-2.32.1-43.el8.x86_64.rpm 1.2 MB/s | 99 kB 00:00 2023-10-01T07:49:44.321 INFO:teuthology.orchestra.run.smithi092.stdout:(119/122): libsmartcols-2.32.1-43.el8.x86_64.rp 1.6 MB/s | 179 kB 00:00 2023-10-01T07:49:44.399 INFO:teuthology.orchestra.run.smithi092.stdout:(120/122): util-linux-user-2.32.1-43.el8.x86_64 1.3 MB/s | 103 kB 00:00 2023-10-01T07:49:44.438 INFO:teuthology.orchestra.run.smithi092.stdout:(121/122): libmount-2.32.1-43.el8.x86_64.rpm 857 kB/s | 236 kB 00:00 2023-10-01T07:49:44.572 INFO:teuthology.orchestra.run.smithi026.stdout:(57/122): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.1 MB/s | 561 kB 00:00 2023-10-01T07:49:44.655 INFO:teuthology.orchestra.run.smithi026.stdout:(58/122): libcom_err-devel-1.45.6-5.el8.x86_64. 466 kB/s | 39 kB 00:00 2023-10-01T07:49:44.911 INFO:teuthology.orchestra.run.smithi092.stdout:(122/122): util-linux-2.32.1-43.el8.x86_64.rpm 4.0 MB/s | 2.5 MB 00:00 2023-10-01T07:49:44.917 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2023-10-01T07:49:44.917 INFO:teuthology.orchestra.run.smithi092.stdout:Total 14 MB/s | 200 MB 00:13 2023-10-01T07:49:44.931 INFO:teuthology.orchestra.run.smithi026.stdout:(59/122): python3-scipy-1.0.0-21.module_el8.5.0 8.6 MB/s | 14 MB 00:01 2023-10-01T07:49:45.164 INFO:teuthology.orchestra.run.smithi026.stdout:(60/122): libgfortran-8.5.0-20.el8.x86_64.rpm 1.2 MB/s | 645 kB 00:00 2023-10-01T07:49:45.231 INFO:teuthology.orchestra.run.smithi026.stdout:(61/122): libquadmath-8.5.0-20.el8.x86_64.rpm 575 kB/s | 172 kB 00:00 2023-10-01T07:49:45.257 INFO:teuthology.orchestra.run.smithi026.stdout:(62/122): librabbitmq-0.9.0-4.el8.x86_64.rpm 509 kB/s | 47 kB 00:00 2023-10-01T07:49:45.323 INFO:teuthology.orchestra.run.smithi026.stdout:(63/122): libsepol-devel-2.9-3.el8.x86_64.rpm 1.3 MB/s | 87 kB 00:00 2023-10-01T07:49:45.424 INFO:teuthology.orchestra.run.smithi026.stdout:(64/122): libverto-devel-0.3.2-2.el8.x86_64.rpm 180 kB/s | 18 kB 00:00 2023-10-01T07:49:45.449 INFO:teuthology.orchestra.run.smithi026.stdout:(65/122): libselinux-devel-2.9-8.el8.x86_64.rpm 921 kB/s | 200 kB 00:00 2023-10-01T07:49:45.491 INFO:teuthology.orchestra.run.smithi026.stdout:(66/122): libzstd-devel-1.4.4-1.el8.x86_64.rpm 655 kB/s | 44 kB 00:00 2023-10-01T07:49:45.652 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2023-10-01T07:49:45.741 INFO:teuthology.orchestra.run.smithi026.stdout:(67/122): pcre2-devel-10.32-3.el8.x86_64.rpm 2.4 MB/s | 605 kB 00:00 2023-10-01T07:49:45.873 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2023-10-01T07:49:45.874 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2023-10-01T07:49:45.891 INFO:teuthology.orchestra.run.smithi026.stdout:(68/122): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.5 MB/s | 229 kB 00:00 2023-10-01T07:49:46.008 INFO:teuthology.orchestra.run.smithi026.stdout:(69/122): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.8 MB/s | 220 kB 00:00 2023-10-01T07:49:46.134 INFO:teuthology.orchestra.run.smithi026.stdout:(70/122): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.9 MB/s | 249 kB 00:00 2023-10-01T07:49:46.578 INFO:teuthology.orchestra.run.smithi026.stdout:(71/122): ceph-common-16.2.14-44.geeb13ac9.el8. 1.9 MB/s | 24 MB 00:12 2023-10-01T07:49:46.617 INFO:teuthology.orchestra.run.smithi026.stdout:(72/122): python3-cryptography-3.2.1-6.el8.x86_ 1.3 MB/s | 641 kB 00:00 2023-10-01T07:49:46.901 INFO:teuthology.orchestra.run.smithi026.stdout:(73/122): python3-oauthlib-2.1.0-1.el8.noarch.r 547 kB/s | 155 kB 00:00 2023-10-01T07:49:46.927 INFO:teuthology.orchestra.run.smithi026.stdout:(74/122): python3-jwt-1.6.1-2.el8.noarch.rpm 122 kB/s | 43 kB 00:00 2023-10-01T07:49:46.977 INFO:teuthology.orchestra.run.smithi026.stdout:(75/122): openssl-devel-1.1.1k-9.el8.x86_64.rpm 2.1 MB/s | 3.2 MB 00:01 2023-10-01T07:49:47.002 INFO:teuthology.orchestra.run.smithi026.stdout:(76/122): python3-requests-oauthlib-1.0.0-1.el8 568 kB/s | 43 kB 00:00 2023-10-01T07:49:47.061 INFO:teuthology.orchestra.run.smithi026.stdout:(77/122): python3-pycparser-2.14-14.el8.noarch. 685 kB/s | 109 kB 00:00 2023-10-01T07:49:47.095 INFO:teuthology.orchestra.run.smithi026.stdout:(78/122): zlib-devel-1.2.11-21.el8.x86_64.rpm 496 kB/s | 58 kB 00:00 2023-10-01T07:49:47.245 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2023-10-01T07:49:47.248 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2023-10-01T07:49:48.145 INFO:teuthology.orchestra.run.smithi026.stdout:(79/122): liboath-2.6.2-3.el8.x86_64.rpm 56 kB/s | 59 kB 00:01 2023-10-01T07:49:48.489 INFO:teuthology.orchestra.run.smithi026.stdout:(80/122): leveldb-1.22-1.el8.x86_64.rpm 127 kB/s | 181 kB 00:01 2023-10-01T07:49:48.520 INFO:teuthology.orchestra.run.smithi026.stdout:(81/122): libunwind-1.3.1-3.el8.x86_64.rpm 200 kB/s | 75 kB 00:00 2023-10-01T07:49:48.604 INFO:teuthology.orchestra.run.smithi026.stdout:(82/122): gperftools-libs-2.7-9.el8.x86_64.rpm 191 kB/s | 306 kB 00:01 2023-10-01T07:49:48.762 INFO:teuthology.orchestra.run.smithi026.stdout:(83/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 160 kB/s | 44 kB 00:00 2023-10-01T07:49:48.846 INFO:teuthology.orchestra.run.smithi026.stdout:(84/122): python3-cachetools-3.1.1-4.el8.noarch 136 kB/s | 33 kB 00:00 2023-10-01T07:49:49.004 INFO:teuthology.orchestra.run.smithi026.stdout:(85/122): python3-certifi-2018.10.15-7.el8.noar 67 kB/s | 16 kB 00:00 2023-10-01T07:49:49.038 INFO:teuthology.orchestra.run.smithi026.stdout:(86/122): python3-beautifulsoup4-4.6.3-2.el8.1. 358 kB/s | 185 kB 00:00 2023-10-01T07:49:49.205 INFO:teuthology.orchestra.run.smithi026.stdout:(87/122): python3-cheroot-8.5.2-1.el8.noarch.rp 481 kB/s | 173 kB 00:00 2023-10-01T07:49:49.313 INFO:teuthology.orchestra.run.smithi026.stdout:(88/122): python3-google-auth-1.1.1-10.el8.noar 295 kB/s | 81 kB 00:00 2023-10-01T07:49:49.456 INFO:teuthology.orchestra.run.smithi026.stdout:(89/122): python3-jaraco-6.2-6.el8.noarch.rpm 44 kB/s | 11 kB 00:00 2023-10-01T07:49:49.548 INFO:teuthology.orchestra.run.smithi026.stdout:(90/122): python3-jaraco-functools-2.0-4.el8.no 75 kB/s | 18 kB 00:00 2023-10-01T07:49:49.731 INFO:teuthology.orchestra.run.smithi026.stdout:(91/122): python3-cherrypy-18.4.0-1.el8.noarch. 529 kB/s | 384 kB 00:00 2023-10-01T07:49:49.806 INFO:teuthology.orchestra.run.smithi026.stdout:(92/122): python3-logutils-0.3.5-11.el8.noarch. 188 kB/s | 49 kB 00:00 2023-10-01T07:49:50.198 INFO:teuthology.orchestra.run.smithi026.stdout:(93/122): python3-pecan-1.3.2-9.el8.noarch.rpm 722 kB/s | 283 kB 00:00 2023-10-01T07:49:50.232 INFO:teuthology.orchestra.run.smithi026.stdout:(94/122): python3-kubernetes-11.0.0-6.el8.noarc 1.5 MB/s | 1.2 MB 00:00 2023-10-01T07:49:50.399 INFO:teuthology.orchestra.run.smithi026.stdout:(95/122): python3-more-itertools-7.2.0-3.el8.no 88 kB/s | 59 kB 00:00 2023-10-01T07:49:50.441 INFO:teuthology.orchestra.run.smithi026.stdout:(96/122): python3-portend-2.6-1.el8.noarch.rpm 64 kB/s | 16 kB 00:00 2023-10-01T07:49:50.466 INFO:teuthology.orchestra.run.smithi026.stdout:(97/122): python3-repoze-lru-0.7-6.el8.noarch.r 144 kB/s | 34 kB 00:00 2023-10-01T07:49:50.691 INFO:teuthology.orchestra.run.smithi026.stdout:(98/122): python3-routes-2.4.1-12.el8.noarch.rp 672 kB/s | 196 kB 00:00 2023-10-01T07:49:50.717 INFO:teuthology.orchestra.run.smithi026.stdout:(99/122): python3-simplegeneric-0.8.1-17.el8.no 75 kB/s | 19 kB 00:00 2023-10-01T07:49:50.733 INFO:teuthology.orchestra.run.smithi026.stdout:(100/122): python3-rsa-4.9-2.el8.noarch.rpm 220 kB/s | 64 kB 00:00 2023-10-01T07:49:50.934 INFO:teuthology.orchestra.run.smithi026.stdout:(101/122): python3-singledispatch-3.4.0.3-18.el 99 kB/s | 24 kB 00:00 2023-10-01T07:49:51.500 INFO:teuthology.orchestra.run.smithi026.stdout:(102/122): python3-tempora-1.14.1-5.el8.noarch. 120 kB/s | 29 kB 00:00 2023-10-01T07:49:51.500 INFO:teuthology.orchestra.run.smithi026.stdout:(103/122): python3-trustme-0.6.0-4.el8.noarch.r 110 kB/s | 27 kB 00:00 2023-10-01T07:49:51.500 INFO:teuthology.orchestra.run.smithi026.stdout:(104/122): python3-webob-1.8.5-1.el8.1.noarch.r 813 kB/s | 251 kB 00:00 2023-10-01T07:49:51.500 INFO:teuthology.orchestra.run.smithi026.stdout:(105/122): python3-websocket-client-0.56.0-5.el 198 kB/s | 61 kB 00:00 2023-10-01T07:49:51.501 INFO:teuthology.orchestra.run.smithi026.stdout:(106/122): python3-waitress-1.4.3-1.el8.noarch. 663 kB/s | 255 kB 00:00 2023-10-01T07:49:51.511 INFO:teuthology.orchestra.run.smithi026.stdout:(107/122): python3-webtest-2.0.33-1.el8.noarch. 353 kB/s | 85 kB 00:00 2023-10-01T07:49:51.528 INFO:teuthology.orchestra.run.smithi026.stdout:(108/122): python3-zc-lockfile-2.0-2.el8.noarch 98 kB/s | 23 kB 00:00 2023-10-01T07:49:51.653 INFO:teuthology.orchestra.run.smithi026.stdout:(109/122): librados2-16.2.14-44.geeb13ac9.el8.x 11 MB/s | 3.7 MB 00:00 2023-10-01T07:49:51.745 INFO:teuthology.orchestra.run.smithi026.stdout:(110/122): NetworkManager-initscripts-updown-1. 662 kB/s | 143 kB 00:00 2023-10-01T07:49:51.804 INFO:teuthology.orchestra.run.smithi026.stdout:(111/122): elfutils-debuginfod-client-0.189-3.e 507 kB/s | 76 kB 00:00 2023-10-01T07:49:51.879 INFO:teuthology.orchestra.run.smithi026.stdout:(112/122): elfutils-libelf-0.189-3.el8.x86_64.r 1.7 MB/s | 232 kB 00:00 2023-10-01T07:49:51.971 INFO:teuthology.orchestra.run.smithi026.stdout:(113/122): librbd1-16.2.14-44.geeb13ac9.el8.x86 9.1 MB/s | 4.2 MB 00:00 2023-10-01T07:49:52.030 INFO:teuthology.orchestra.run.smithi026.stdout:(114/122): elfutils-libs-0.189-3.el8.x86_64.rpm 1.3 MB/s | 303 kB 00:00 2023-10-01T07:49:52.138 INFO:teuthology.orchestra.run.smithi026.stdout:(115/122): libfdisk-2.32.1-43.el8.x86_64.rpm 2.3 MB/s | 254 kB 00:00 2023-10-01T07:49:52.230 INFO:teuthology.orchestra.run.smithi026.stdout:(116/122): libblkid-2.32.1-43.el8.x86_64.rpm 853 kB/s | 220 kB 00:00 2023-10-01T07:49:52.280 INFO:teuthology.orchestra.run.smithi026.stdout:(117/122): libmount-2.32.1-43.el8.x86_64.rpm 1.6 MB/s | 236 kB 00:00 2023-10-01T07:49:52.359 INFO:teuthology.orchestra.run.smithi026.stdout:(118/122): iproute-6.2.0-2.el8.x86_64.rpm 1.8 MB/s | 880 kB 00:00 2023-10-01T07:49:52.371 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2023-10-01T07:49:52.381 INFO:teuthology.orchestra.run.smithi026.stdout:(119/122): libuuid-2.32.1-43.el8.x86_64.rpm 987 kB/s | 99 kB 00:00 2023-10-01T07:49:52.407 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: liboath-2.6.2-3.el8.x86_64 1/1 2023-10-01T07:49:52.447 INFO:teuthology.orchestra.run.smithi026.stdout:(120/122): libsmartcols-2.32.1-43.el8.x86_64.rp 831 kB/s | 179 kB 00:00 2023-10-01T07:49:52.481 INFO:teuthology.orchestra.run.smithi026.stdout:(121/122): util-linux-user-2.32.1-43.el8.x86_64 1.0 MB/s | 103 kB 00:00 2023-10-01T07:49:52.590 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/136 2023-10-01T07:49:52.822 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/136 2023-10-01T07:49:52.840 INFO:teuthology.orchestra.run.smithi026.stdout:(122/122): util-linux-2.32.1-43.el8.x86_64.rpm 5.2 MB/s | 2.5 MB 00:00 2023-10-01T07:49:52.845 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2023-10-01T07:49:52.846 INFO:teuthology.orchestra.run.smithi026.stdout:Total 10 MB/s | 200 MB 00:19 2023-10-01T07:49:52.997 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/136 2023-10-01T07:49:53.064 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/136 2023-10-01T07:49:53.231 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/136 2023-10-01T07:49:53.345 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/136 2023-10-01T07:49:53.543 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 5/136 2023-10-01T07:49:53.658 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2023-10-01T07:49:53.782 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/136 2023-10-01T07:49:53.914 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2023-10-01T07:49:53.914 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2023-10-01T07:49:53.972 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-10-01T07:49:54.340 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-10-01T07:49:54.563 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-01T07:49:54.956 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-01T07:49:55.172 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-01T07:49:55.279 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-01T07:49:55.347 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2023-10-01T07:49:55.351 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2023-10-01T07:49:55.480 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-01T07:49:55.574 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-01T07:49:55.836 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-10-01T07:49:55.996 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/136 2023-10-01T07:49:56.407 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/136 2023-10-01T07:49:56.813 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-01T07:49:56.889 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-01T07:49:57.138 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/136 2023-10-01T07:49:57.362 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/136 2023-10-01T07:49:57.496 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-10-01T07:49:57.588 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-10-01T07:49:57.771 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-10-01T07:49:57.891 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-10-01T07:49:58.103 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 18/136 2023-10-01T07:49:58.298 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 19/136 2023-10-01T07:49:58.421 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 20/136 2023-10-01T07:49:58.539 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 20/136 2023-10-01T07:49:58.704 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 21/136 2023-10-01T07:49:59.305 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 21/136 2023-10-01T07:49:59.546 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-0.3.15-4.el8.x86_64 22/136 2023-10-01T07:50:00.164 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 22/136 2023-10-01T07:50:00.329 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-10-01T07:50:00.741 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2023-10-01T07:50:00.784 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: liboath-2.6.2-3.el8.x86_64 1/1 2023-10-01T07:50:00.977 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/136 2023-10-01T07:50:01.060 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-10-01T07:50:01.201 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/136 2023-10-01T07:50:01.332 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/136 2023-10-01T07:50:01.380 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 24/136 2023-10-01T07:50:01.436 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/136 2023-10-01T07:50:01.622 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/136 2023-10-01T07:50:01.682 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 25/136 2023-10-01T07:50:01.720 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/136 2023-10-01T07:50:01.835 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 26/136 2023-10-01T07:50:01.922 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 5/136 2023-10-01T07:50:02.009 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 27/136 2023-10-01T07:50:02.115 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/136 2023-10-01T07:50:02.241 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 28/136 2023-10-01T07:50:02.357 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-10-01T07:50:02.437 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-10-01T07:50:02.788 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-10-01T07:50:02.982 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-01T07:50:03.465 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-01T07:50:03.682 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-01T07:50:03.850 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-01T07:50:04.082 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-01T07:50:04.188 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-01T07:50:04.223 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-10-01T07:50:04.426 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-10-01T07:50:04.548 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 30/136 2023-10-01T07:50:04.631 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/136 2023-10-01T07:50:04.762 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 31/136 2023-10-01T07:50:04.981 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/136 2023-10-01T07:50:05.034 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/136 2023-10-01T07:50:05.231 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-01T07:50:05.245 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 33/136 2023-10-01T07:50:05.305 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-01T07:50:05.465 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 34/136 2023-10-01T07:50:05.681 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/136 2023-10-01T07:50:05.719 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 35/136 2023-10-01T07:50:05.890 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/136 2023-10-01T07:50:05.918 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 36/136 2023-10-01T07:50:06.064 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-10-01T07:50:06.136 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el8.x86_64 37/136 2023-10-01T07:50:06.181 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-10-01T07:50:06.348 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-10-01T07:50:06.386 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 38/136 2023-10-01T07:50:06.467 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 38/136 2023-10-01T07:50:06.479 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-10-01T07:50:06.680 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 18/136 2023-10-01T07:50:06.686 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 39/136 2023-10-01T07:50:06.749 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 39/136 2023-10-01T07:50:06.828 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 19/136 2023-10-01T07:50:06.903 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-10-01T07:50:06.973 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 20/136 2023-10-01T07:50:07.110 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 20/136 2023-10-01T07:50:07.289 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 21/136 2023-10-01T07:50:07.443 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-10-01T07:50:07.745 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 41/136 2023-10-01T07:50:07.759 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 41/136 2023-10-01T07:50:07.952 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 21/136 2023-10-01T07:50:07.972 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 42/136 2023-10-01T07:50:08.164 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openblas-0.3.15-4.el8.x86_64 22/136 2023-10-01T07:50:08.210 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 43/136 2023-10-01T07:50:08.450 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 44/136 2023-10-01T07:50:08.665 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 45/136 2023-10-01T07:50:08.833 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 22/136 2023-10-01T07:50:08.871 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 46/136 2023-10-01T07:50:08.989 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-10-01T07:50:09.068 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 47/136 2023-10-01T07:50:09.287 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 48/136 2023-10-01T07:50:09.488 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 49/136 2023-10-01T07:50:09.674 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 50/136 2023-10-01T07:50:09.780 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-10-01T07:50:09.843 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 51/136 2023-10-01T07:50:10.000 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 52/136 2023-10-01T07:50:10.165 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 24/136 2023-10-01T07:50:10.243 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 53/136 2023-10-01T07:50:10.452 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 25/136 2023-10-01T07:50:10.508 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 54/136 2023-10-01T07:50:10.663 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 26/136 2023-10-01T07:50:10.712 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 55/136 2023-10-01T07:50:10.881 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 27/136 2023-10-01T07:50:10.952 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 56/136 2023-10-01T07:50:11.203 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 57/136 2023-10-01T07:50:11.316 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 28/136 2023-10-01T07:50:11.467 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 58/136 2023-10-01T07:50:11.522 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-10-01T07:50:11.680 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 59/136 2023-10-01T07:50:12.063 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 60/136 2023-10-01T07:50:12.383 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 61/136 2023-10-01T07:50:12.987 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/136 2023-10-01T07:50:13.267 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 63/136 2023-10-01T07:50:13.515 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 64/136 2023-10-01T07:50:13.545 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-10-01T07:50:13.877 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 30/136 2023-10-01T07:50:14.080 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 31/136 2023-10-01T07:50:14.319 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/136 2023-10-01T07:50:14.592 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 33/136 2023-10-01T07:50:14.598 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 65/136 2023-10-01T07:50:14.795 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 34/136 2023-10-01T07:50:14.850 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 66/136 2023-10-01T07:50:15.058 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 35/136 2023-10-01T07:50:15.116 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 67/136 2023-10-01T07:50:15.277 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 36/136 2023-10-01T07:50:15.351 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 68/136 2023-10-01T07:50:15.495 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el8.x86_64 37/136 2023-10-01T07:50:15.620 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 69/136 2023-10-01T07:50:15.729 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 38/136 2023-10-01T07:50:15.802 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 38/136 2023-10-01T07:50:15.845 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 70/136 2023-10-01T07:50:16.005 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 39/136 2023-10-01T07:50:16.082 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 39/136 2023-10-01T07:50:16.136 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 71/136 2023-10-01T07:50:16.280 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-10-01T07:50:16.330 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 72/136 2023-10-01T07:50:16.502 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 73/136 2023-10-01T07:50:16.655 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 74/136 2023-10-01T07:50:16.892 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-10-01T07:50:16.957 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 75/136 2023-10-01T07:50:17.204 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 76/136 2023-10-01T07:50:17.305 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 41/136 2023-10-01T07:50:17.325 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 41/136 2023-10-01T07:50:17.353 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 77/136 2023-10-01T07:50:17.555 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 42/136 2023-10-01T07:50:17.575 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 78/136 2023-10-01T07:50:17.801 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 79/136 2023-10-01T07:50:17.837 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 43/136 2023-10-01T07:50:18.002 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : fuse-2.9.7-17.el8.x86_64 80/136 2023-10-01T07:50:18.121 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 44/136 2023-10-01T07:50:18.307 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 81/136 2023-10-01T07:50:18.343 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 45/136 2023-10-01T07:50:18.509 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 46/136 2023-10-01T07:50:18.522 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 82/136 2023-10-01T07:50:18.711 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 83/136 2023-10-01T07:50:18.727 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 47/136 2023-10-01T07:50:18.897 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 84/136 2023-10-01T07:50:18.951 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 48/136 2023-10-01T07:50:19.133 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 49/136 2023-10-01T07:50:19.183 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-portend-2.6-1.el8.noarch 85/136 2023-10-01T07:50:19.352 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 50/136 2023-10-01T07:50:19.450 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 86/136 2023-10-01T07:50:19.555 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 51/136 2023-10-01T07:50:19.633 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 87/136 2023-10-01T07:50:19.756 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 52/136 2023-10-01T07:50:19.960 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 53/136 2023-10-01T07:50:20.200 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 54/136 2023-10-01T07:50:20.385 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 55/136 2023-10-01T07:50:20.681 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 56/136 2023-10-01T07:50:20.886 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 57/136 2023-10-01T07:50:21.132 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 58/136 2023-10-01T07:50:21.349 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 59/136 2023-10-01T07:50:21.742 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 60/136 2023-10-01T07:50:22.047 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 61/136 2023-10-01T07:50:22.189 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-01T07:50:22.253 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/136 2023-10-01T07:50:22.433 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-01T07:50:22.531 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 63/136 2023-10-01T07:50:22.789 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 64/136 2023-10-01T07:50:23.134 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-01T07:50:23.492 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-10-01T07:50:23.599 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-10-01T07:50:23.749 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-10-01T07:50:23.948 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 65/136 2023-10-01T07:50:24.231 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 66/136 2023-10-01T07:50:24.506 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 67/136 2023-10-01T07:50:24.857 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 68/136 2023-10-01T07:50:25.092 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 69/136 2023-10-01T07:50:25.309 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 70/136 2023-10-01T07:50:25.649 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 71/136 2023-10-01T07:50:25.876 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 72/136 2023-10-01T07:50:26.006 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 73/136 2023-10-01T07:50:26.206 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 74/136 2023-10-01T07:50:26.545 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 75/136 2023-10-01T07:50:26.841 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 76/136 2023-10-01T07:50:26.969 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 77/136 2023-10-01T07:50:27.210 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 78/136 2023-10-01T07:50:27.423 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 79/136 2023-10-01T07:50:27.631 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : fuse-2.9.7-17.el8.x86_64 80/136 2023-10-01T07:50:27.905 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 81/136 2023-10-01T07:50:28.095 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 82/136 2023-10-01T07:50:28.317 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 83/136 2023-10-01T07:50:28.534 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 84/136 2023-10-01T07:50:28.859 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-portend-2.6-1.el8.noarch 85/136 2023-10-01T07:50:29.113 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 86/136 2023-10-01T07:50:29.270 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 87/136 2023-10-01T07:50:32.046 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-01T07:50:32.436 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-01T07:50:33.224 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-01T07:50:33.800 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-10-01T07:50:33.949 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-10-01T07:50:34.093 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-10-01T07:50:42.109 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-10-01T07:50:42.109 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /sys 2023-10-01T07:50:42.109 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /proc 2023-10-01T07:50:42.109 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /dev 2023-10-01T07:50:42.109 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /run 2023-10-01T07:50:42.109 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /mnt 2023-10-01T07:50:42.109 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /var/tmp 2023-10-01T07:50:42.109 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /home 2023-10-01T07:50:42.109 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /tmp 2023-10-01T07:50:42.110 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /dev 2023-10-01T07:50:42.110 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:50:42.569 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-10-01T07:50:42.993 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-10-01T07:50:43.203 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-10-01T07:50:44.683 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-10-01T07:50:44.919 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-10-01T07:50:44.954 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-10-01T07:50:45.170 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 94/136 2023-10-01T07:50:45.511 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 95/136 2023-10-01T07:50:45.809 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 96/136 2023-10-01T07:50:46.034 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 97/136 2023-10-01T07:50:46.300 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 98/136 2023-10-01T07:50:46.602 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 99/136 2023-10-01T07:50:46.682 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 99/136 2023-10-01T07:50:46.914 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : jq-1.6-7.el8.x86_64 100/136 2023-10-01T07:50:47.042 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 101/136 2023-10-01T07:50:48.109 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 102/136 2023-10-01T07:50:48.369 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-10-01T07:50:49.408 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-10-01T07:50:49.585 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-10-01T07:50:49.674 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-10-01T07:50:50.069 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 105/136 2023-10-01T07:50:50.320 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-10-01T07:50:50.346 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-10-01T07:50:50.493 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-10-01T07:50:50.504 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-10-01T07:50:55.164 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 108/136 2023-10-01T07:50:55.428 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-10-01T07:50:55.428 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /sys 2023-10-01T07:50:55.428 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /proc 2023-10-01T07:50:55.428 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /dev 2023-10-01T07:50:55.428 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /run 2023-10-01T07:50:55.428 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /mnt 2023-10-01T07:50:55.428 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /var/tmp 2023-10-01T07:50:55.429 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /home 2023-10-01T07:50:55.429 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /tmp 2023-10-01T07:50:55.429 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /dev 2023-10-01T07:50:55.429 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:50:55.891 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-10-01T07:50:56.377 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-10-01T07:50:56.463 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-10-01T07:50:56.565 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-10-01T07:50:56.751 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-10-01T07:50:57.154 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-10-01T07:50:57.358 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-01T07:50:57.451 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-01T07:50:58.204 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-10-01T07:50:58.339 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 112/136 2023-10-01T07:50:58.423 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-10-01T07:50:58.466 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-10-01T07:50:58.670 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 113/136 2023-10-01T07:50:58.721 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 94/136 2023-10-01T07:50:58.846 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 114/136 2023-10-01T07:50:59.045 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 115/136 2023-10-01T07:50:59.085 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 95/136 2023-10-01T07:50:59.232 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 116/136 2023-10-01T07:50:59.390 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 96/136 2023-10-01T07:50:59.431 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 117/136 2023-10-01T07:50:59.615 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 97/136 2023-10-01T07:50:59.749 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 118/136 2023-10-01T07:50:59.853 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 98/136 2023-10-01T07:50:59.998 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 99/136 2023-10-01T07:51:00.060 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 119/136 2023-10-01T07:51:00.089 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 99/136 2023-10-01T07:51:00.249 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-10-01T07:51:00.292 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : jq-1.6-7.el8.x86_64 100/136 2023-10-01T07:51:00.310 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-10-01T07:51:00.422 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 101/136 2023-10-01T07:51:00.582 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flex-2.6.1-9.el8.x86_64 121/136 2023-10-01T07:51:00.685 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 121/136 2023-10-01T07:51:00.907 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : bison-3.0.4-10.el8.x86_64 122/136 2023-10-01T07:51:00.921 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 122/136 2023-10-01T07:51:01.100 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 123/136 2023-10-01T07:51:01.294 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 124/136 2023-10-01T07:51:01.294 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-10-01T07:51:01.576 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-10-01T07:51:01.581 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-10-01T07:51:01.625 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 102/136 2023-10-01T07:51:01.710 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-10-01T07:51:01.710 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 127/136 2023-10-01T07:51:01.903 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-10-01T07:51:01.971 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 127/136 2023-10-01T07:51:02.205 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 128/136 2023-10-01T07:51:02.404 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 129/136 2023-10-01T07:51:02.633 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 130/136 2023-10-01T07:51:02.634 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 131/136 2023-10-01T07:51:02.851 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 131/136 2023-10-01T07:51:02.851 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 132/136 2023-10-01T07:51:03.062 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-10-01T07:51:03.084 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 132/136 2023-10-01T07:51:03.084 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 133/136 2023-10-01T07:51:03.257 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-10-01T07:51:03.317 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 133/136 2023-10-01T07:51:03.317 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 134/136 2023-10-01T07:51:03.364 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-10-01T07:51:03.517 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 134/136 2023-10-01T07:51:03.517 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-10-01T07:51:03.742 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-10-01T07:51:03.802 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 105/136 2023-10-01T07:51:03.966 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-10-01T07:51:04.062 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-10-01T07:51:04.095 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-10-01T07:51:04.289 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-10-01T07:51:04.303 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-10-01T07:51:04.535 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-10-01T07:51:04.535 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 1/136 2023-10-01T07:51:04.535 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2/136 2023-10-01T07:51:04.535 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 3/136 2023-10-01T07:51:04.535 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 4/136 2023-10-01T07:51:04.535 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 5/136 2023-10-01T07:51:04.535 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 6/136 2023-10-01T07:51:04.535 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 7/136 2023-10-01T07:51:04.536 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-01T07:51:04.536 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-01T07:51:04.536 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-01T07:51:04.536 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-10-01T07:51:04.536 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 12/136 2023-10-01T07:51:04.536 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-01T07:51:04.536 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 14/136 2023-10-01T07:51:04.536 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 15/136 2023-10-01T07:51:04.536 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 16/136 2023-10-01T07:51:04.536 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 17/136 2023-10-01T07:51:04.536 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 18/136 2023-10-01T07:51:04.536 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 19/136 2023-10-01T07:51:04.537 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 20/136 2023-10-01T07:51:04.537 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 21/136 2023-10-01T07:51:04.537 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 22/136 2023-10-01T07:51:04.537 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 23/136 2023-10-01T07:51:04.537 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 24/136 2023-10-01T07:51:04.537 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 25/136 2023-10-01T07:51:04.537 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 26/136 2023-10-01T07:51:04.537 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 27/136 2023-10-01T07:51:04.537 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 28/136 2023-10-01T07:51:04.537 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 29/136 2023-10-01T07:51:04.537 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 30/136 2023-10-01T07:51:04.546 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 31/136 2023-10-01T07:51:04.546 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 32/136 2023-10-01T07:51:04.546 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : bison-3.0.4-10.el8.x86_64 33/136 2023-10-01T07:51:04.546 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flex-2.6.1-9.el8.x86_64 34/136 2023-10-01T07:51:04.547 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : jq-1.6-7.el8.x86_64 35/136 2023-10-01T07:51:04.547 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 36/136 2023-10-01T07:51:04.547 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 37/136 2023-10-01T07:51:04.547 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 38/136 2023-10-01T07:51:04.547 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 39/136 2023-10-01T07:51:04.547 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 40/136 2023-10-01T07:51:04.547 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 41/136 2023-10-01T07:51:04.547 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 42/136 2023-10-01T07:51:04.547 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 43/136 2023-10-01T07:51:04.547 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 44/136 2023-10-01T07:51:04.547 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 45/136 2023-10-01T07:51:04.547 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 46/136 2023-10-01T07:51:04.548 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 47/136 2023-10-01T07:51:04.548 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 48/136 2023-10-01T07:51:04.548 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 49/136 2023-10-01T07:51:04.548 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 50/136 2023-10-01T07:51:04.548 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 51/136 2023-10-01T07:51:04.548 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 52/136 2023-10-01T07:51:04.548 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 53/136 2023-10-01T07:51:04.548 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 54/136 2023-10-01T07:51:04.548 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 55/136 2023-10-01T07:51:04.548 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 56/136 2023-10-01T07:51:04.548 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 57/136 2023-10-01T07:51:04.549 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 58/136 2023-10-01T07:51:04.549 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 59/136 2023-10-01T07:51:04.549 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 60/136 2023-10-01T07:51:04.549 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 61/136 2023-10-01T07:51:04.549 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 62/136 2023-10-01T07:51:04.549 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 63/136 2023-10-01T07:51:04.549 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 64/136 2023-10-01T07:51:04.549 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 65/136 2023-10-01T07:51:04.549 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 66/136 2023-10-01T07:51:04.549 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 67/136 2023-10-01T07:51:04.549 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 68/136 2023-10-01T07:51:04.549 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 69/136 2023-10-01T07:51:04.550 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 70/136 2023-10-01T07:51:04.550 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 71/136 2023-10-01T07:51:04.550 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 72/136 2023-10-01T07:51:04.550 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 73/136 2023-10-01T07:51:04.550 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/136 2023-10-01T07:51:04.550 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/136 2023-10-01T07:51:04.550 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/136 2023-10-01T07:51:04.550 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/136 2023-10-01T07:51:04.550 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 78/136 2023-10-01T07:51:04.550 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 79/136 2023-10-01T07:51:04.550 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : leveldb-1.22-1.el8.x86_64 80/136 2023-10-01T07:51:04.550 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 81/136 2023-10-01T07:51:04.550 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 82/136 2023-10-01T07:51:04.551 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/136 2023-10-01T07:51:04.551 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/136 2023-10-01T07:51:04.551 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 85/136 2023-10-01T07:51:04.551 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 86/136 2023-10-01T07:51:04.551 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 87/136 2023-10-01T07:51:04.551 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 88/136 2023-10-01T07:51:04.551 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 89/136 2023-10-01T07:51:04.551 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 90/136 2023-10-01T07:51:04.551 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 91/136 2023-10-01T07:51:04.551 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 92/136 2023-10-01T07:51:04.551 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 93/136 2023-10-01T07:51:04.551 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 94/136 2023-10-01T07:51:04.552 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 95/136 2023-10-01T07:51:04.553 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-portend-2.6-1.el8.noarch 96/136 2023-10-01T07:51:04.553 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 97/136 2023-10-01T07:51:04.553 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 98/136 2023-10-01T07:51:04.553 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 99/136 2023-10-01T07:51:04.553 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 100/136 2023-10-01T07:51:04.553 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 101/136 2023-10-01T07:51:04.554 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 102/136 2023-10-01T07:51:04.554 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 103/136 2023-10-01T07:51:04.554 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 104/136 2023-10-01T07:51:04.554 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 105/136 2023-10-01T07:51:04.554 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 106/136 2023-10-01T07:51:04.554 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 107/136 2023-10-01T07:51:04.554 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 108/136 2023-10-01T07:51:04.554 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-10-01T07:51:04.554 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 110/136 2023-10-01T07:51:04.554 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-01T07:51:04.554 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 112/136 2023-10-01T07:51:04.554 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 113/136 2023-10-01T07:51:04.555 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 114/136 2023-10-01T07:51:04.555 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el8.x86_64 115/136 2023-10-01T07:51:04.555 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 116/136 2023-10-01T07:51:04.555 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 117/136 2023-10-01T07:51:04.555 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 118/136 2023-10-01T07:51:04.555 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 119/136 2023-10-01T07:51:04.555 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 120/136 2023-10-01T07:51:04.555 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 121/136 2023-10-01T07:51:04.555 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 122/136 2023-10-01T07:51:04.555 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 123/136 2023-10-01T07:51:04.555 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 124/136 2023-10-01T07:51:04.556 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 125/136 2023-10-01T07:51:04.556 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 126/136 2023-10-01T07:51:04.556 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 127/136 2023-10-01T07:51:04.556 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 128/136 2023-10-01T07:51:04.556 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 129/136 2023-10-01T07:51:04.556 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 130/136 2023-10-01T07:51:04.556 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 131/136 2023-10-01T07:51:04.556 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 132/136 2023-10-01T07:51:04.556 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 133/136 2023-10-01T07:51:04.556 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 134/136 2023-10-01T07:51:04.556 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 135/136 2023-10-01T07:51:06.564 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 136/136 2023-10-01T07:51:06.565 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:51:06.565 INFO:teuthology.orchestra.run.smithi092.stdout:Upgraded: 2023-10-01T07:51:06.565 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-10-01T07:51:06.565 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-debuginfod-client-0.189-3.el8.x86_64 2023-10-01T07:51:06.565 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-10-01T07:51:06.565 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-10-01T07:51:06.565 INFO:teuthology.orchestra.run.smithi092.stdout: iproute-6.2.0-2.el8.x86_64 2023-10-01T07:51:06.565 INFO:teuthology.orchestra.run.smithi092.stdout: libblkid-2.32.1-43.el8.x86_64 2023-10-01T07:51:06.565 INFO:teuthology.orchestra.run.smithi092.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-10-01T07:51:06.565 INFO:teuthology.orchestra.run.smithi092.stdout: libmount-2.32.1-43.el8.x86_64 2023-10-01T07:51:06.565 INFO:teuthology.orchestra.run.smithi092.stdout: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:06.566 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:06.566 INFO:teuthology.orchestra.run.smithi092.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-10-01T07:51:06.566 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid-2.32.1-43.el8.x86_64 2023-10-01T07:51:06.566 INFO:teuthology.orchestra.run.smithi092.stdout: util-linux-2.32.1-43.el8.x86_64 2023-10-01T07:51:06.566 INFO:teuthology.orchestra.run.smithi092.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-10-01T07:51:06.566 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2023-10-01T07:51:06.566 INFO:teuthology.orchestra.run.smithi092.stdout: bison-3.0.4-10.el8.x86_64 2023-10-01T07:51:06.566 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:06.566 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:06.566 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:06.566 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:06.567 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-01T07:51:06.567 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:06.567 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:06.567 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-01T07:51:06.567 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-01T07:51:06.567 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-01T07:51:06.567 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-01T07:51:06.567 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:06.567 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:06.567 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-01T07:51:06.567 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:06.567 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:06.567 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:06.568 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-10-01T07:51:06.568 INFO:teuthology.orchestra.run.smithi092.stdout: flex-2.6.1-9.el8.x86_64 2023-10-01T07:51:06.568 INFO:teuthology.orchestra.run.smithi092.stdout: fuse-2.9.7-17.el8.x86_64 2023-10-01T07:51:06.568 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-01T07:51:06.568 INFO:teuthology.orchestra.run.smithi092.stdout: jq-1.6-7.el8.x86_64 2023-10-01T07:51:06.568 INFO:teuthology.orchestra.run.smithi092.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-01T07:51:06.568 INFO:teuthology.orchestra.run.smithi092.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-10-01T07:51:06.568 INFO:teuthology.orchestra.run.smithi092.stdout: leveldb-1.22-1.el8.x86_64 2023-10-01T07:51:06.568 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:06.568 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:06.568 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:06.568 INFO:teuthology.orchestra.run.smithi092.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-10-01T07:51:06.569 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-10-01T07:51:06.569 INFO:teuthology.orchestra.run.smithi092.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-01T07:51:06.569 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-10-01T07:51:06.569 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-10-01T07:51:06.569 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:06.569 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:06.569 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-01T07:51:06.569 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:06.569 INFO:teuthology.orchestra.run.smithi092.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-10-01T07:51:06.569 INFO:teuthology.orchestra.run.smithi092.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-01T07:51:06.569 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-01T07:51:06.569 INFO:teuthology.orchestra.run.smithi092.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-10-01T07:51:06.570 INFO:teuthology.orchestra.run.smithi092.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-10-01T07:51:06.570 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-01T07:51:06.570 INFO:teuthology.orchestra.run.smithi092.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-01T07:51:06.570 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-0.3.15-4.el8.x86_64 2023-10-01T07:51:06.570 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-10-01T07:51:06.570 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-10-01T07:51:06.570 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-10-01T07:51:06.570 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-10-01T07:51:06.570 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-10-01T07:51:06.570 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-01T07:51:06.570 INFO:teuthology.orchestra.run.smithi092.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-01T07:51:06.570 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-01T07:51:06.571 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:06.571 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:06.571 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:06.571 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-01T07:51:06.571 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-10-01T07:51:06.571 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-01T07:51:06.572 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-01T07:51:06.572 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-10-01T07:51:06.572 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-01T07:51:06.572 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-01T07:51:06.572 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-01T07:51:06.572 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-01T07:51:06.572 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-01T07:51:06.572 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-01T07:51:06.572 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-01T07:51:06.572 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-01T07:51:06.572 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako-1.0.6-14.el8.noarch 2023-10-01T07:51:06.573 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-01T07:51:06.573 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-01T07:51:06.573 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-01T07:51:06.573 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-01T07:51:06.573 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-01T07:51:06.573 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-01T07:51:06.573 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend-2.6-1.el8.noarch 2023-10-01T07:51:06.573 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-01T07:51:06.573 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-01T07:51:06.573 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-01T07:51:06.573 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-01T07:51:06.573 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-01T07:51:06.573 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz-2017.2-11.el8.noarch 2023-10-01T07:51:06.574 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:06.574 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:06.574 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-01T07:51:06.574 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-01T07:51:06.574 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:06.574 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-01T07:51:06.574 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-01T07:51:06.574 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-10-01T07:51:06.574 INFO:teuthology.orchestra.run.smithi092.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-01T07:51:06.574 INFO:teuthology.orchestra.run.smithi092.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-01T07:51:06.574 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-01T07:51:06.575 INFO:teuthology.orchestra.run.smithi092.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-01T07:51:06.575 INFO:teuthology.orchestra.run.smithi092.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-01T07:51:06.575 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-01T07:51:06.575 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-01T07:51:06.575 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-01T07:51:06.575 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-01T07:51:06.575 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-01T07:51:06.575 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:06.575 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:06.575 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:06.575 INFO:teuthology.orchestra.run.smithi092.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-01T07:51:06.575 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-01T07:51:06.576 INFO:teuthology.orchestra.run.smithi092.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-10-01T07:51:06.576 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:51:06.576 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-10-01T07:51:06.862 DEBUG:teuthology.parallel:result is None 2023-10-01T07:51:09.469 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 108/136 2023-10-01T07:51:10.822 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-10-01T07:51:11.202 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-10-01T07:51:11.639 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-10-01T07:51:11.888 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-01T07:51:11.993 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-01T07:51:13.027 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 112/136 2023-10-01T07:51:13.310 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 113/136 2023-10-01T07:51:13.470 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 114/136 2023-10-01T07:51:13.833 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 115/136 2023-10-01T07:51:14.021 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 116/136 2023-10-01T07:51:14.279 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 117/136 2023-10-01T07:51:14.652 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 118/136 2023-10-01T07:51:14.931 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 119/136 2023-10-01T07:51:15.120 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-10-01T07:51:15.192 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-10-01T07:51:15.387 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : flex-2.6.1-9.el8.x86_64 121/136 2023-10-01T07:51:15.491 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 121/136 2023-10-01T07:51:15.712 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : bison-3.0.4-10.el8.x86_64 122/136 2023-10-01T07:51:15.727 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 122/136 2023-10-01T07:51:15.880 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 123/136 2023-10-01T07:51:16.062 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 124/136 2023-10-01T07:51:16.062 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-10-01T07:51:16.331 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-10-01T07:51:16.337 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-10-01T07:51:16.490 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-10-01T07:51:16.491 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 127/136 2023-10-01T07:51:16.745 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 127/136 2023-10-01T07:51:16.939 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 128/136 2023-10-01T07:51:17.077 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 129/136 2023-10-01T07:51:17.305 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 130/136 2023-10-01T07:51:17.305 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 131/136 2023-10-01T07:51:17.522 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 131/136 2023-10-01T07:51:17.523 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 132/136 2023-10-01T07:51:17.731 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 132/136 2023-10-01T07:51:17.731 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 133/136 2023-10-01T07:51:17.948 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 133/136 2023-10-01T07:51:17.948 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 134/136 2023-10-01T07:51:18.173 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 134/136 2023-10-01T07:51:18.173 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-10-01T07:51:18.356 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-10-01T07:51:18.580 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-10-01T07:51:19.193 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-10-01T07:51:19.193 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 1/136 2023-10-01T07:51:19.193 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2/136 2023-10-01T07:51:19.194 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 3/136 2023-10-01T07:51:19.194 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 4/136 2023-10-01T07:51:19.194 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 5/136 2023-10-01T07:51:19.194 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 6/136 2023-10-01T07:51:19.194 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 7/136 2023-10-01T07:51:19.194 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-01T07:51:19.194 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-01T07:51:19.194 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-01T07:51:19.194 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-10-01T07:51:19.194 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 12/136 2023-10-01T07:51:19.194 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-01T07:51:19.194 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 14/136 2023-10-01T07:51:19.195 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 15/136 2023-10-01T07:51:19.195 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 16/136 2023-10-01T07:51:19.195 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 17/136 2023-10-01T07:51:19.195 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 18/136 2023-10-01T07:51:19.195 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 19/136 2023-10-01T07:51:19.195 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 20/136 2023-10-01T07:51:19.195 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 21/136 2023-10-01T07:51:19.195 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 22/136 2023-10-01T07:51:19.195 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 23/136 2023-10-01T07:51:19.196 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 24/136 2023-10-01T07:51:19.196 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 25/136 2023-10-01T07:51:19.196 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 26/136 2023-10-01T07:51:19.196 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 27/136 2023-10-01T07:51:19.196 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 28/136 2023-10-01T07:51:19.196 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 29/136 2023-10-01T07:51:19.196 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 30/136 2023-10-01T07:51:19.196 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 31/136 2023-10-01T07:51:19.196 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 32/136 2023-10-01T07:51:19.197 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : bison-3.0.4-10.el8.x86_64 33/136 2023-10-01T07:51:19.197 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : flex-2.6.1-9.el8.x86_64 34/136 2023-10-01T07:51:19.197 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : jq-1.6-7.el8.x86_64 35/136 2023-10-01T07:51:19.197 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 36/136 2023-10-01T07:51:19.197 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 37/136 2023-10-01T07:51:19.197 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 38/136 2023-10-01T07:51:19.197 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 39/136 2023-10-01T07:51:19.197 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 40/136 2023-10-01T07:51:19.197 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 41/136 2023-10-01T07:51:19.197 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 42/136 2023-10-01T07:51:19.198 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 43/136 2023-10-01T07:51:19.198 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 44/136 2023-10-01T07:51:19.198 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 45/136 2023-10-01T07:51:19.198 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 46/136 2023-10-01T07:51:19.198 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 47/136 2023-10-01T07:51:19.198 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 48/136 2023-10-01T07:51:19.198 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 49/136 2023-10-01T07:51:19.198 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 50/136 2023-10-01T07:51:19.198 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 51/136 2023-10-01T07:51:19.198 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 52/136 2023-10-01T07:51:19.198 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 53/136 2023-10-01T07:51:19.198 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 54/136 2023-10-01T07:51:19.199 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 55/136 2023-10-01T07:51:19.199 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 56/136 2023-10-01T07:51:19.199 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 57/136 2023-10-01T07:51:19.199 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 58/136 2023-10-01T07:51:19.199 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 59/136 2023-10-01T07:51:19.199 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 60/136 2023-10-01T07:51:19.199 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 61/136 2023-10-01T07:51:19.199 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 62/136 2023-10-01T07:51:19.199 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 63/136 2023-10-01T07:51:19.199 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 64/136 2023-10-01T07:51:19.199 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 65/136 2023-10-01T07:51:19.199 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 66/136 2023-10-01T07:51:19.200 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 67/136 2023-10-01T07:51:19.200 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 68/136 2023-10-01T07:51:19.200 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 69/136 2023-10-01T07:51:19.200 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 70/136 2023-10-01T07:51:19.200 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 71/136 2023-10-01T07:51:19.200 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 72/136 2023-10-01T07:51:19.200 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 73/136 2023-10-01T07:51:19.200 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/136 2023-10-01T07:51:19.200 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/136 2023-10-01T07:51:19.200 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/136 2023-10-01T07:51:19.200 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/136 2023-10-01T07:51:19.201 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 78/136 2023-10-01T07:51:19.201 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 79/136 2023-10-01T07:51:19.201 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : leveldb-1.22-1.el8.x86_64 80/136 2023-10-01T07:51:19.201 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 81/136 2023-10-01T07:51:19.201 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 82/136 2023-10-01T07:51:19.201 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/136 2023-10-01T07:51:19.201 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/136 2023-10-01T07:51:19.201 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 85/136 2023-10-01T07:51:19.201 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 86/136 2023-10-01T07:51:19.201 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 87/136 2023-10-01T07:51:19.201 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 88/136 2023-10-01T07:51:19.201 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 89/136 2023-10-01T07:51:19.202 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 90/136 2023-10-01T07:51:19.202 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 91/136 2023-10-01T07:51:19.202 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 92/136 2023-10-01T07:51:19.202 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 93/136 2023-10-01T07:51:19.202 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 94/136 2023-10-01T07:51:19.202 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 95/136 2023-10-01T07:51:19.202 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-portend-2.6-1.el8.noarch 96/136 2023-10-01T07:51:19.202 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 97/136 2023-10-01T07:51:19.202 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 98/136 2023-10-01T07:51:19.202 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 99/136 2023-10-01T07:51:19.202 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 100/136 2023-10-01T07:51:19.202 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 101/136 2023-10-01T07:51:19.203 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 102/136 2023-10-01T07:51:19.203 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 103/136 2023-10-01T07:51:19.203 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 104/136 2023-10-01T07:51:19.203 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 105/136 2023-10-01T07:51:19.203 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 106/136 2023-10-01T07:51:19.203 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 107/136 2023-10-01T07:51:19.203 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 108/136 2023-10-01T07:51:19.203 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-10-01T07:51:19.203 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 110/136 2023-10-01T07:51:19.203 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-01T07:51:19.203 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 112/136 2023-10-01T07:51:19.203 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 113/136 2023-10-01T07:51:19.204 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 114/136 2023-10-01T07:51:19.204 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el8.x86_64 115/136 2023-10-01T07:51:19.204 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 116/136 2023-10-01T07:51:19.204 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 117/136 2023-10-01T07:51:19.204 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 118/136 2023-10-01T07:51:19.204 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 119/136 2023-10-01T07:51:19.204 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 120/136 2023-10-01T07:51:19.204 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 121/136 2023-10-01T07:51:19.204 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 122/136 2023-10-01T07:51:19.205 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 123/136 2023-10-01T07:51:19.205 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 124/136 2023-10-01T07:51:19.205 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 125/136 2023-10-01T07:51:19.205 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 126/136 2023-10-01T07:51:19.205 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 127/136 2023-10-01T07:51:19.205 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 128/136 2023-10-01T07:51:19.205 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 129/136 2023-10-01T07:51:19.205 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 130/136 2023-10-01T07:51:19.205 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 131/136 2023-10-01T07:51:19.205 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 132/136 2023-10-01T07:51:19.205 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 133/136 2023-10-01T07:51:19.206 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 134/136 2023-10-01T07:51:19.206 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 135/136 2023-10-01T07:51:21.369 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 136/136 2023-10-01T07:51:21.369 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:21.369 INFO:teuthology.orchestra.run.smithi026.stdout:Upgraded: 2023-10-01T07:51:21.369 INFO:teuthology.orchestra.run.smithi026.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-10-01T07:51:21.369 INFO:teuthology.orchestra.run.smithi026.stdout: elfutils-debuginfod-client-0.189-3.el8.x86_64 2023-10-01T07:51:21.369 INFO:teuthology.orchestra.run.smithi026.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-10-01T07:51:21.369 INFO:teuthology.orchestra.run.smithi026.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-10-01T07:51:21.370 INFO:teuthology.orchestra.run.smithi026.stdout: iproute-6.2.0-2.el8.x86_64 2023-10-01T07:51:21.370 INFO:teuthology.orchestra.run.smithi026.stdout: libblkid-2.32.1-43.el8.x86_64 2023-10-01T07:51:21.370 INFO:teuthology.orchestra.run.smithi026.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-10-01T07:51:21.370 INFO:teuthology.orchestra.run.smithi026.stdout: libmount-2.32.1-43.el8.x86_64 2023-10-01T07:51:21.370 INFO:teuthology.orchestra.run.smithi026.stdout: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:21.370 INFO:teuthology.orchestra.run.smithi026.stdout: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:21.370 INFO:teuthology.orchestra.run.smithi026.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-10-01T07:51:21.370 INFO:teuthology.orchestra.run.smithi026.stdout: libuuid-2.32.1-43.el8.x86_64 2023-10-01T07:51:21.370 INFO:teuthology.orchestra.run.smithi026.stdout: util-linux-2.32.1-43.el8.x86_64 2023-10-01T07:51:21.370 INFO:teuthology.orchestra.run.smithi026.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-10-01T07:51:21.370 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2023-10-01T07:51:21.371 INFO:teuthology.orchestra.run.smithi026.stdout: bison-3.0.4-10.el8.x86_64 2023-10-01T07:51:21.371 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:21.371 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:21.371 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:21.371 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:21.371 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-01T07:51:21.371 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:21.371 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:21.371 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-01T07:51:21.371 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-01T07:51:21.371 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-01T07:51:21.371 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-01T07:51:21.372 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:21.372 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:21.372 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-01T07:51:21.372 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:21.373 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:21.373 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:21.373 INFO:teuthology.orchestra.run.smithi026.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-10-01T07:51:21.373 INFO:teuthology.orchestra.run.smithi026.stdout: flex-2.6.1-9.el8.x86_64 2023-10-01T07:51:21.374 INFO:teuthology.orchestra.run.smithi026.stdout: fuse-2.9.7-17.el8.x86_64 2023-10-01T07:51:21.374 INFO:teuthology.orchestra.run.smithi026.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-01T07:51:21.374 INFO:teuthology.orchestra.run.smithi026.stdout: jq-1.6-7.el8.x86_64 2023-10-01T07:51:21.374 INFO:teuthology.orchestra.run.smithi026.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-01T07:51:21.374 INFO:teuthology.orchestra.run.smithi026.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-10-01T07:51:21.374 INFO:teuthology.orchestra.run.smithi026.stdout: leveldb-1.22-1.el8.x86_64 2023-10-01T07:51:21.374 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:21.374 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:21.374 INFO:teuthology.orchestra.run.smithi026.stdout: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:21.374 INFO:teuthology.orchestra.run.smithi026.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-10-01T07:51:21.374 INFO:teuthology.orchestra.run.smithi026.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-10-01T07:51:21.374 INFO:teuthology.orchestra.run.smithi026.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-01T07:51:21.375 INFO:teuthology.orchestra.run.smithi026.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-10-01T07:51:21.375 INFO:teuthology.orchestra.run.smithi026.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-10-01T07:51:21.375 INFO:teuthology.orchestra.run.smithi026.stdout: librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:21.375 INFO:teuthology.orchestra.run.smithi026.stdout: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:21.375 INFO:teuthology.orchestra.run.smithi026.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-01T07:51:21.375 INFO:teuthology.orchestra.run.smithi026.stdout: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:21.375 INFO:teuthology.orchestra.run.smithi026.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-10-01T07:51:21.375 INFO:teuthology.orchestra.run.smithi026.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-01T07:51:21.375 INFO:teuthology.orchestra.run.smithi026.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-01T07:51:21.375 INFO:teuthology.orchestra.run.smithi026.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-10-01T07:51:21.375 INFO:teuthology.orchestra.run.smithi026.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-10-01T07:51:21.375 INFO:teuthology.orchestra.run.smithi026.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-01T07:51:21.376 INFO:teuthology.orchestra.run.smithi026.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-01T07:51:21.376 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-0.3.15-4.el8.x86_64 2023-10-01T07:51:21.376 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-10-01T07:51:21.376 INFO:teuthology.orchestra.run.smithi026.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-10-01T07:51:21.376 INFO:teuthology.orchestra.run.smithi026.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-10-01T07:51:21.376 INFO:teuthology.orchestra.run.smithi026.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-10-01T07:51:21.376 INFO:teuthology.orchestra.run.smithi026.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-10-01T07:51:21.376 INFO:teuthology.orchestra.run.smithi026.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-01T07:51:21.376 INFO:teuthology.orchestra.run.smithi026.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-01T07:51:21.376 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-01T07:51:21.376 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:21.376 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:21.376 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:21.377 INFO:teuthology.orchestra.run.smithi026.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-01T07:51:21.377 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-10-01T07:51:21.377 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-01T07:51:21.377 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-01T07:51:21.377 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-10-01T07:51:21.377 INFO:teuthology.orchestra.run.smithi026.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-01T07:51:21.377 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-01T07:51:21.377 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-01T07:51:21.377 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-01T07:51:21.377 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-01T07:51:21.377 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-01T07:51:21.378 INFO:teuthology.orchestra.run.smithi026.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-01T07:51:21.378 INFO:teuthology.orchestra.run.smithi026.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-01T07:51:21.378 INFO:teuthology.orchestra.run.smithi026.stdout: python3-mako-1.0.6-14.el8.noarch 2023-10-01T07:51:21.378 INFO:teuthology.orchestra.run.smithi026.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-01T07:51:21.378 INFO:teuthology.orchestra.run.smithi026.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-01T07:51:21.378 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-01T07:51:21.378 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-01T07:51:21.378 INFO:teuthology.orchestra.run.smithi026.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-01T07:51:21.378 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-01T07:51:21.378 INFO:teuthology.orchestra.run.smithi026.stdout: python3-portend-2.6-1.el8.noarch 2023-10-01T07:51:21.378 INFO:teuthology.orchestra.run.smithi026.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-01T07:51:21.378 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-01T07:51:21.379 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-01T07:51:21.379 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-01T07:51:21.379 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-01T07:51:21.379 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytz-2017.2-11.el8.noarch 2023-10-01T07:51:21.379 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:21.379 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:21.379 INFO:teuthology.orchestra.run.smithi026.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-01T07:51:21.379 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-01T07:51:21.379 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:21.379 INFO:teuthology.orchestra.run.smithi026.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-01T07:51:21.379 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-01T07:51:21.379 INFO:teuthology.orchestra.run.smithi026.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-10-01T07:51:21.379 INFO:teuthology.orchestra.run.smithi026.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-01T07:51:21.380 INFO:teuthology.orchestra.run.smithi026.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-01T07:51:21.380 INFO:teuthology.orchestra.run.smithi026.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-01T07:51:21.380 INFO:teuthology.orchestra.run.smithi026.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-01T07:51:21.380 INFO:teuthology.orchestra.run.smithi026.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-01T07:51:21.380 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-01T07:51:21.380 INFO:teuthology.orchestra.run.smithi026.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-01T07:51:21.380 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-01T07:51:21.380 INFO:teuthology.orchestra.run.smithi026.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-01T07:51:21.380 INFO:teuthology.orchestra.run.smithi026.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-01T07:51:21.380 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:21.380 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:21.380 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-01T07:51:21.381 INFO:teuthology.orchestra.run.smithi026.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-01T07:51:21.381 INFO:teuthology.orchestra.run.smithi026.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-01T07:51:21.381 INFO:teuthology.orchestra.run.smithi026.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-10-01T07:51:21.381 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:21.381 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2023-10-01T07:51:21.561 DEBUG:teuthology.parallel:result is None 2023-10-01T07:51:21.561 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-01T07:51:21.562 INFO:teuthology.packaging:ref: None 2023-10-01T07:51:21.562 INFO:teuthology.packaging:tag: None 2023-10-01T07:51:21.562 INFO:teuthology.packaging:branch: pacific 2023-10-01T07:51:21.562 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-01T07:51:21.562 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-10-01T07:51:21.862 DEBUG:teuthology.orchestra.run.smithi026:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-01T07:51:21.892 INFO:teuthology.orchestra.run.smithi026.stdout:16.2.14-44.geeb13ac9.el8 2023-10-01T07:51:21.892 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-44.geeb13ac9.el8 2023-10-01T07:51:21.892 INFO:teuthology.task.install:The correct ceph version 16.2.14-44.geeb13ac9 is installed. 2023-10-01T07:51:21.893 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-01T07:51:21.893 INFO:teuthology.packaging:ref: None 2023-10-01T07:51:21.893 INFO:teuthology.packaging:tag: None 2023-10-01T07:51:21.893 INFO:teuthology.packaging:branch: pacific 2023-10-01T07:51:21.893 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-01T07:51:21.893 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-10-01T07:51:22.100 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-01T07:51:22.129 INFO:teuthology.orchestra.run.smithi092.stdout:16.2.14-44.geeb13ac9.el8 2023-10-01T07:51:22.129 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-44.geeb13ac9.el8 2023-10-01T07:51:22.130 INFO:teuthology.task.install:The correct ceph version 16.2.14-44.geeb13ac9 is installed. 2023-10-01T07:51:22.130 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-01T07:51:22.162 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-01T07:51:22.162 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-01T07:51:22.206 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-01T07:51:22.206 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-01T07:51:22.243 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-01T07:51:22.243 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-01T07:51:22.243 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/daemon-helper 2023-10-01T07:51:22.280 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-01T07:51:22.353 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-01T07:51:22.354 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/daemon-helper 2023-10-01T07:51:22.384 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-01T07:51:22.455 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-01T07:51:22.455 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-01T07:51:22.455 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-01T07:51:22.491 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-01T07:51:22.565 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-01T07:51:22.565 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-01T07:51:22.597 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-01T07:51:22.667 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-01T07:51:22.668 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-01T07:51:22.668 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/stdin-killer 2023-10-01T07:51:22.702 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-01T07:51:22.776 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-01T07:51:22.776 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/stdin-killer 2023-10-01T07:51:22.805 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-01T07:51:22.875 INFO:teuthology.run_tasks:Running task print... 2023-10-01T07:51:22.884 INFO:teuthology.task.print:**** done installing pacific 2023-10-01T07:51:22.884 INFO:teuthology.run_tasks:Running task ceph... 2023-10-01T07:51:23.214 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-01T07:51:23.214 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 777 /var/log/ceph 2023-10-01T07:51:23.217 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 777 /var/log/ceph 2023-10-01T07:51:23.249 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-01T07:51:23.250 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-01T07:51:23.292 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-01T07:51:23.324 INFO:tasks.ceph:Creating extra log directories... 2023-10-01T07:51:23.324 DEBUG:teuthology.orchestra.run.smithi026:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-01T07:51:23.366 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-01T07:51:23.410 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-01T07:51:23.410 INFO:tasks.ceph:config {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-01T07:51:23.411 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/dparmar-2023-10-01_07:32:21-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408165', 'branch': 'fix-nfs-apply-err-reporting', 'description': 'fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/stress_tests/{0-client-upgrade 1-tests/fsstress}}}', 'email': None, 'first_in_suite': False, 'job_id': '7408165', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'dparmar-2023-10-01_07:32:21-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'fix-nfs-apply-err-reporting'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-62953', 'sha1': '6973b24e3d99fd494b753449d2ea12077599cbd6'}}, 'owner': 'scheduled_dparmar@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['client.0']], 'seed': 6124, 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'sleep_before_teardown': 0, 'suite': 'fs:upgrade', 'suite_branch': 'wip-62953', 'suite_path': '/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/dparmar18/ceph', 'suite_sha1': '6973b24e3d99fd494b753449d2ea12077599cbd6', 'targets': {'smithi026.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPcv1WJET6ZJGQyR3vKmVxrKOjNwO+heVTJQhMFy39ThJkz5t0YlxifNbq8OKWY+KZ9Xvr3xx+66D7KX6SxOsNw=', 'smithi092.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHMiSJIByvhJ8065ut6VaB+jx3WSzaIu6RYIbTppw3Z0iKf7dkMcWLxkgW58r1MvHpDhFogaFVkHOVVL+5tX46s='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'branch': 'pacific', 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}}, {'print': '**** done installing pacific'}, {'ceph': {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'log-ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'flavor': 'default', 'fs': 'xfs', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'cluster': 'ceph'}}, {'exec': {'osd.0': ['ceph osd set-require-min-compat-client pacific']}}, {'print': '**** done ceph'}, {'ceph-fuse': None}, {'mds_pre_upgrade': None}, {'print': '**** done mds pre-upgrade sequence'}, {'install.upgrade': {'mon.a': {'branch': 'reef'}}}, {'print': '**** done install.upgrade the host'}, {'ceph.restart': {'daemons': ['mon.*', 'mgr.*'], 'mon-health-to-clog': False, 'wait-for-healthy': False}}, {'ceph.healthy': None}, {'ceph.restart': {'daemons': ['osd.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'ceph.stop': ['mds.*']}, {'ceph.restart': {'daemons': ['mds.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'exec': {'mon.a': ['ceph osd dump -f json-pretty', 'ceph versions', 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done', 'ceph osd require-osd-release reef']}}, {'ceph.healthy': None}, {'print': '**** done ceph.restart'}, {'ceph-fuse': {'client.0': {'mounted': False}}}, {'print': '**** done unmount client.0'}, {'install.upgrade': {'client.0': None}}, {'print': '**** done install.upgrade on client.0'}, {'ceph-fuse': {'client.0': None}}, {'print': '**** done remount client.0'}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}, 'timeout': '6h'}}], 'teuthology': {'branch': 'pacific', 'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end", 'if not is_fuse() then reject() end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-01_07:32:21', 'tube': 'smithi', 'user': 'dparmar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-01T07:51:23.411 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-01T07:51:23.439 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-01T07:51:23.461 DEBUG:teuthology.orchestra.run.smithi026:> sudo install -d -m0777 -- /var/run/ceph 2023-10-01T07:51:23.502 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -d -m0777 -- /var/run/ceph 2023-10-01T07:51:23.535 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-01T07:51:23.535 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/scratch_devs of=/dev/stdout 2023-10-01T07:51:23.598 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-01T07:51:23.598 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_1 2023-10-01T07:51:23.661 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-01T07:51:23.661 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-01T07:51:23.662 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 389824 Links: 1 2023-10-01T07:51:23.662 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-01T07:51:23.662 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2023-10-01T07:51:23.662 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2023-10-01 07:51:18.797794243 +0000 2023-10-01T07:51:23.662 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2023-10-01 07:48:15.533634919 +0000 2023-10-01T07:51:23.662 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2023-10-01 07:48:15.533634919 +0000 2023-10-01T07:51:23.662 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2023-10-01T07:51:23.662 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-01T07:51:23.736 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2023-10-01T07:51:23.736 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2023-10-01T07:51:23.736 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000147727 s, 3.5 MB/s 2023-10-01T07:51:23.737 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-01T07:51:23.802 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_2 2023-10-01T07:51:23.865 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-01T07:51:23.865 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-01T07:51:23.866 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 394795 Links: 1 2023-10-01T07:51:23.866 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-01T07:51:23.866 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2023-10-01T07:51:23.866 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2023-10-01 07:51:18.797794243 +0000 2023-10-01T07:51:23.866 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2023-10-01 07:48:16.107626651 +0000 2023-10-01T07:51:23.866 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2023-10-01 07:48:16.107626651 +0000 2023-10-01T07:51:23.866 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2023-10-01T07:51:23.866 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-01T07:51:23.939 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2023-10-01T07:51:23.939 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2023-10-01T07:51:23.939 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000125559 s, 4.1 MB/s 2023-10-01T07:51:23.940 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-01T07:51:24.005 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_3 2023-10-01T07:51:24.069 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-01T07:51:24.069 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-01T07:51:24.069 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 395483 Links: 1 2023-10-01T07:51:24.069 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-01T07:51:24.069 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2023-10-01T07:51:24.069 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2023-10-01 07:51:18.797794243 +0000 2023-10-01T07:51:24.069 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2023-10-01 07:48:16.714617909 +0000 2023-10-01T07:51:24.070 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2023-10-01 07:48:16.714617909 +0000 2023-10-01T07:51:24.070 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2023-10-01T07:51:24.070 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-01T07:51:24.142 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2023-10-01T07:51:24.142 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2023-10-01T07:51:24.143 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000119666 s, 4.3 MB/s 2023-10-01T07:51:24.144 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-01T07:51:24.209 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_4 2023-10-01T07:51:24.272 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-01T07:51:24.272 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-01T07:51:24.272 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 392172 Links: 1 2023-10-01T07:51:24.272 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-01T07:51:24.272 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2023-10-01T07:51:24.272 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2023-10-01 07:51:18.797794243 +0000 2023-10-01T07:51:24.272 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2023-10-01 07:48:17.273609858 +0000 2023-10-01T07:51:24.273 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2023-10-01 07:48:17.273609858 +0000 2023-10-01T07:51:24.273 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2023-10-01T07:51:24.273 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-01T07:51:24.345 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2023-10-01T07:51:24.345 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2023-10-01T07:51:24.346 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000123366 s, 4.2 MB/s 2023-10-01T07:51:24.347 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-01T07:51:24.412 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-01T07:51:24.412 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi026.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2023-10-01T07:51:24.412 INFO:tasks.ceph:Generating config... 2023-10-01T07:51:24.415 INFO:tasks.ceph:[global] mon warn on pool no app = False 2023-10-01T07:51:24.415 INFO:tasks.ceph:[global] ms bind msgr2 = False 2023-10-01T07:51:24.415 INFO:tasks.ceph:[global] bluestore warn on legacy statfs = False 2023-10-01T07:51:24.415 INFO:tasks.ceph:[global] bluestore warn on no per pool omap = False 2023-10-01T07:51:24.415 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2023-10-01T07:51:24.416 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-01T07:51:24.416 INFO:tasks.ceph:[client] debug client = 20 2023-10-01T07:51:24.416 INFO:tasks.ceph:[client] debug ms = 1 2023-10-01T07:51:24.416 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-01T07:51:24.416 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-01T07:51:24.416 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-01T07:51:24.416 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-10-01T07:51:24.416 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-01T07:51:24.416 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-01T07:51:24.416 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-01T07:51:24.416 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-01T07:51:24.416 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-01T07:51:24.416 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-01T07:51:24.417 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-01T07:51:24.417 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-01T07:51:24.417 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-01T07:51:24.417 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-01T07:51:24.417 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-01T07:51:24.417 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-01T07:51:24.417 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-01T07:51:24.417 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-01T07:51:24.417 INFO:tasks.ceph:[mon] mon warn on osd down out interval zero = False 2023-10-01T07:51:24.417 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-01T07:51:24.417 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-01T07:51:24.417 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-01T07:51:24.417 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-01T07:51:24.418 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-01T07:51:24.418 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-01T07:51:24.418 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-01T07:51:24.418 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-01T07:51:24.418 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-01T07:51:24.418 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-01T07:51:24.418 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-01T07:51:24.418 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-01T07:51:24.418 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-01T07:51:24.418 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-01T07:51:24.418 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-01T07:51:24.418 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-01T07:51:24.419 INFO:tasks.ceph:Setting up mon.a... 2023-10-01T07:51:24.419 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-01T07:51:24.615 INFO:teuthology.orchestra.run.smithi026.stdout:creating /etc/ceph/ceph.keyring 2023-10-01T07:51:24.618 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-01T07:51:24.671 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-01T07:51:24.705 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.26'), ('mon.b', '[v2:172.21.15.26:3301,v1:172.21.15.26:6790]'), ('mon.c', '[v2:172.21.15.26:3302,v1:172.21.15.26:6791]')] 2023-10-01T07:51:24.705 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.26,[v2:172.21.15.26:3301,v1:172.21.15.26:6790],[v2:172.21.15.26:3302,v1:172.21.15.26:6791]', 'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-01T07:51:24.706 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-01T07:51:24.706 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-01T07:51:24.769 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.26 --addv b '[v2:172.21.15.26:3301,v1:172.21.15.26:6790]' --addv c '[v2:172.21.15.26:3302,v1:172.21.15.26:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-01T07:51:24.863 INFO:teuthology.orchestra.run.smithi026.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-01T07:51:24.863 INFO:teuthology.orchestra.run.smithi026.stdout:monmaptool: generated fsid c29fb19d-520c-42a6-90f4-e7f86de96e8e 2023-10-01T07:51:24.864 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 0 2023-10-01T07:51:24.864 INFO:teuthology.orchestra.run.smithi026.stdout:fsid c29fb19d-520c-42a6-90f4-e7f86de96e8e 2023-10-01T07:51:24.864 INFO:teuthology.orchestra.run.smithi026.stdout:last_changed 2023-10-01T07:51:24.864343+0000 2023-10-01T07:51:24.864 INFO:teuthology.orchestra.run.smithi026.stdout:created 2023-10-01T07:51:24.864343+0000 2023-10-01T07:51:24.864 INFO:teuthology.orchestra.run.smithi026.stdout:min_mon_release 0 (unknown) 2023-10-01T07:51:24.864 INFO:teuthology.orchestra.run.smithi026.stdout:election_strategy: 1 2023-10-01T07:51:24.864 INFO:teuthology.orchestra.run.smithi026.stdout:0: [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] mon.a 2023-10-01T07:51:24.864 INFO:teuthology.orchestra.run.smithi026.stdout:1: [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] mon.b 2023-10-01T07:51:24.864 INFO:teuthology.orchestra.run.smithi026.stdout:2: [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] mon.c 2023-10-01T07:51:24.864 INFO:teuthology.orchestra.run.smithi026.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-01T07:51:24.865 DEBUG:teuthology.orchestra.run.smithi026:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-01T07:51:24.886 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c29fb19d-520c-42a6-90f4-e7f86de96e8e... 2023-10-01T07:51:24.887 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-01T07:51:24.930 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-01T07:51:24.985 INFO:teuthology.orchestra.run.smithi092.stdout:[global] 2023-10-01T07:51:24.985 INFO:teuthology.orchestra.run.smithi092.stdout: chdir = "" 2023-10-01T07:51:24.986 INFO:teuthology.orchestra.run.smithi092.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-01T07:51:24.986 INFO:teuthology.orchestra.run.smithi092.stdout: auth supported = cephx 2023-10-01T07:51:24.986 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:51:24.986 INFO:teuthology.orchestra.run.smithi092.stdout: filestore xattr use omap = true 2023-10-01T07:51:24.986 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:51:24.986 INFO:teuthology.orchestra.run.smithi092.stdout: mon clock drift allowed = 1.000 2023-10-01T07:51:24.987 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:51:24.987 INFO:teuthology.orchestra.run.smithi092.stdout: osd crush chooseleaf type = 0 2023-10-01T07:51:24.987 INFO:teuthology.orchestra.run.smithi092.stdout: auth debug = true 2023-10-01T07:51:24.987 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:51:24.987 INFO:teuthology.orchestra.run.smithi092.stdout: ms die on old message = true 2023-10-01T07:51:24.987 INFO:teuthology.orchestra.run.smithi092.stdout: ms die on bug = true 2023-10-01T07:51:24.987 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:51:24.987 INFO:teuthology.orchestra.run.smithi092.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-01T07:51:24.987 INFO:teuthology.orchestra.run.smithi092.stdout: mon pg warn max object skew = 0 2023-10-01T07:51:24.988 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:51:24.988 INFO:teuthology.orchestra.run.smithi092.stdout: # disable pg_autoscaler by default for new pools 2023-10-01T07:51:24.988 INFO:teuthology.orchestra.run.smithi092.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-01T07:51:24.988 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:51:24.988 INFO:teuthology.orchestra.run.smithi092.stdout: osd pool default size = 2 2023-10-01T07:51:24.988 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:51:24.988 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd allow primary affinity = true 2023-10-01T07:51:24.988 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd allow pg remap = true 2023-10-01T07:51:24.988 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on legacy crush tunables = false 2023-10-01T07:51:24.988 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on crush straw calc version zero = false 2023-10-01T07:51:24.988 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on no sortbitwise = false 2023-10-01T07:51:24.989 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on osd down out interval zero = false 2023-10-01T07:51:24.989 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on too few osds = false 2023-10-01T07:51:24.989 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-01T07:51:24.989 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-01T07:51:24.989 INFO:teuthology.orchestra.run.smithi092.stdout: mon_allow_pool_size_one = true 2023-10-01T07:51:24.989 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:51:24.989 INFO:teuthology.orchestra.run.smithi092.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-01T07:51:24.989 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:51:24.990 INFO:teuthology.orchestra.run.smithi092.stdout: osd default data pool replay window = 5 2023-10-01T07:51:24.990 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:51:24.990 INFO:teuthology.orchestra.run.smithi092.stdout: mon allow pool delete = true 2023-10-01T07:51:24.990 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:51:24.991 INFO:teuthology.orchestra.run.smithi092.stdout: mon cluster log file level = debug 2023-10-01T07:51:24.991 INFO:teuthology.orchestra.run.smithi092.stdout: debug asserts on shutdown = true 2023-10-01T07:51:24.991 INFO:teuthology.orchestra.run.smithi092.stdout: mon health detail to clog = false 2023-10-01T07:51:24.991 INFO:teuthology.orchestra.run.smithi092.stdout: mon host = "172.21.15.26,[v2:172.21.15.26:3301,v1:172.21.15.26:6790],[v2:172.21.15.26:3302,v1:172.21.15.26:6791]" 2023-10-01T07:51:24.991 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on pool no app = False 2023-10-01T07:51:24.991 INFO:teuthology.orchestra.run.smithi092.stdout: ms bind msgr2 = False 2023-10-01T07:51:24.991 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore warn on legacy statfs = False 2023-10-01T07:51:24.992 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore warn on no per pool omap = False 2023-10-01T07:51:24.992 INFO:teuthology.orchestra.run.smithi092.stdout: mon pg warn min per osd = 0 2023-10-01T07:51:24.992 INFO:teuthology.orchestra.run.smithi092.stdout: fsid = c29fb19d-520c-42a6-90f4-e7f86de96e8e 2023-10-01T07:51:24.992 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:51:24.992 INFO:teuthology.orchestra.run.smithi092.stdout:[osd] 2023-10-01T07:51:24.992 INFO:teuthology.orchestra.run.smithi092.stdout: osd journal size = 100 2023-10-01T07:51:24.992 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:51:24.993 INFO:teuthology.orchestra.run.smithi092.stdout: osd scrub load threshold = 5.0 2023-10-01T07:51:24.993 INFO:teuthology.orchestra.run.smithi092.stdout: osd scrub max interval = 600 2023-10-01T07:51:24.993 INFO:teuthology.orchestra.run.smithi092.stdout: osd mclock profile = high_recovery_ops 2023-10-01T07:51:24.993 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:51:24.993 INFO:teuthology.orchestra.run.smithi092.stdout: osd recover clone overlap = true 2023-10-01T07:51:24.993 INFO:teuthology.orchestra.run.smithi092.stdout: osd recovery max chunk = 1048576 2023-10-01T07:51:24.994 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:51:24.994 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug shutdown = true 2023-10-01T07:51:24.994 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug op order = true 2023-10-01T07:51:24.994 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug verify stray on activate = true 2023-10-01T07:51:24.994 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:51:24.994 INFO:teuthology.orchestra.run.smithi092.stdout: osd open classes on start = true 2023-10-01T07:51:24.994 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug pg log writeout = true 2023-10-01T07:51:24.995 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:51:24.995 INFO:teuthology.orchestra.run.smithi092.stdout: osd deep scrub update digest min age = 30 2023-10-01T07:51:24.995 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:51:24.995 INFO:teuthology.orchestra.run.smithi092.stdout: osd map max advance = 10 2023-10-01T07:51:24.995 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:51:24.995 INFO:teuthology.orchestra.run.smithi092.stdout: journal zero on create = true 2023-10-01T07:51:24.996 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:51:24.996 INFO:teuthology.orchestra.run.smithi092.stdout: filestore ondisk finisher threads = 3 2023-10-01T07:51:24.996 INFO:teuthology.orchestra.run.smithi092.stdout: filestore apply finisher threads = 3 2023-10-01T07:51:24.996 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:51:24.996 INFO:teuthology.orchestra.run.smithi092.stdout: bdev debug aio = true 2023-10-01T07:51:24.996 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug misdirected ops = true 2023-10-01T07:51:24.996 INFO:teuthology.orchestra.run.smithi092.stdout: bdev async discard = True 2023-10-01T07:51:24.997 INFO:teuthology.orchestra.run.smithi092.stdout: bdev enable discard = True 2023-10-01T07:51:24.997 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore allocator = bitmap 2023-10-01T07:51:24.997 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore block size = 96636764160 2023-10-01T07:51:24.997 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore fsck on mount = True 2023-10-01T07:51:24.997 INFO:teuthology.orchestra.run.smithi092.stdout: debug bluefs = 1/20 2023-10-01T07:51:24.997 INFO:teuthology.orchestra.run.smithi092.stdout: debug bluestore = 1/20 2023-10-01T07:51:24.997 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2023-10-01T07:51:24.998 INFO:teuthology.orchestra.run.smithi092.stdout: debug osd = 20 2023-10-01T07:51:24.998 INFO:teuthology.orchestra.run.smithi092.stdout: debug rocksdb = 4/10 2023-10-01T07:51:24.998 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd backfillfull_ratio = 0.85 2023-10-01T07:51:24.998 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd full ratio = 0.9 2023-10-01T07:51:24.998 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd nearfull ratio = 0.8 2023-10-01T07:51:24.998 INFO:teuthology.orchestra.run.smithi092.stdout: osd failsafe full ratio = 0.95 2023-10-01T07:51:24.998 INFO:teuthology.orchestra.run.smithi092.stdout: osd objectstore = bluestore 2023-10-01T07:51:24.999 INFO:teuthology.orchestra.run.smithi092.stdout: osd op complaint time = 180 2023-10-01T07:51:24.999 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:51:24.999 INFO:teuthology.orchestra.run.smithi092.stdout:[mgr] 2023-10-01T07:51:24.999 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2023-10-01T07:51:24.999 INFO:teuthology.orchestra.run.smithi092.stdout: debug mgr = 20 2023-10-01T07:51:24.999 INFO:teuthology.orchestra.run.smithi092.stdout: debug mon = 20 2023-10-01T07:51:24.999 INFO:teuthology.orchestra.run.smithi092.stdout: debug auth = 20 2023-10-01T07:51:25.000 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min pgs per osd = 4 2023-10-01T07:51:25.001 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min bytes per osd = 10 2023-10-01T07:51:25.001 INFO:teuthology.orchestra.run.smithi092.stdout: mgr/telemetry/nag = false 2023-10-01T07:51:25.001 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:51:25.001 INFO:teuthology.orchestra.run.smithi092.stdout:[mon] 2023-10-01T07:51:25.001 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2023-10-01T07:51:25.001 INFO:teuthology.orchestra.run.smithi092.stdout: debug mon = 20 2023-10-01T07:51:25.002 INFO:teuthology.orchestra.run.smithi092.stdout: debug paxos = 20 2023-10-01T07:51:25.002 INFO:teuthology.orchestra.run.smithi092.stdout: debug auth = 20 2023-10-01T07:51:25.002 INFO:teuthology.orchestra.run.smithi092.stdout: mon data avail warn = 5 2023-10-01T07:51:25.002 INFO:teuthology.orchestra.run.smithi092.stdout: mon mgr mkfs grace = 240 2023-10-01T07:51:25.002 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min pgs per osd = 4 2023-10-01T07:51:25.002 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd reporter subtree level = osd 2023-10-01T07:51:25.002 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd prime pg temp = true 2023-10-01T07:51:25.003 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min bytes per osd = 10 2023-10-01T07:51:25.003 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:51:25.003 INFO:teuthology.orchestra.run.smithi092.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-01T07:51:25.003 INFO:teuthology.orchestra.run.smithi092.stdout: auth mon ticket ttl = 660 # 11m 2023-10-01T07:51:25.003 INFO:teuthology.orchestra.run.smithi092.stdout: auth service ticket ttl = 240 # 4m 2023-10-01T07:51:25.003 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:51:25.003 INFO:teuthology.orchestra.run.smithi092.stdout: # don't complain about insecure global_id in the test suite 2023-10-01T07:51:25.004 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-01T07:51:25.004 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-01T07:51:25.004 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:51:25.004 INFO:teuthology.orchestra.run.smithi092.stdout: # 1m isn't quite enough 2023-10-01T07:51:25.006 INFO:teuthology.orchestra.run.smithi092.stdout: mon_down_mkfs_grace = 2m 2023-10-01T07:51:25.006 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:51:25.006 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_filestore_osds = false 2023-10-01T07:51:25.006 INFO:teuthology.orchestra.run.smithi092.stdout: mon op complaint time = 120 2023-10-01T07:51:25.006 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on osd down out interval zero = False 2023-10-01T07:51:25.007 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-01T07:51:25.007 INFO:teuthology.orchestra.run.smithi092.stdout:[client] 2023-10-01T07:51:25.007 INFO:teuthology.orchestra.run.smithi092.stdout: rgw cache enabled = true 2023-10-01T07:51:25.007 INFO:teuthology.orchestra.run.smithi092.stdout: rgw enable ops log = true 2023-10-01T07:51:25.007 INFO:teuthology.orchestra.run.smithi092.stdout: rgw enable usage log = true 2023-10-01T07:51:25.007 INFO:teuthology.orchestra.run.smithi092.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-01T07:51:25.008 INFO:teuthology.orchestra.run.smithi092.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-01T07:51:25.008 INFO:teuthology.orchestra.run.smithi092.stdout: client mount timeout = 600 2023-10-01T07:51:25.008 INFO:teuthology.orchestra.run.smithi092.stdout: debug client = 20 2023-10-01T07:51:25.008 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2023-10-01T07:51:25.008 INFO:teuthology.orchestra.run.smithi092.stdout: rados mon op timeout = 900 2023-10-01T07:51:25.009 INFO:teuthology.orchestra.run.smithi092.stdout: rados osd op timeout = 900 2023-10-01T07:51:25.009 INFO:teuthology.orchestra.run.smithi092.stdout:[mon.a] 2023-10-01T07:51:25.009 INFO:teuthology.orchestra.run.smithi092.stdout:[mon.b] 2023-10-01T07:51:25.009 INFO:teuthology.orchestra.run.smithi092.stdout:[mon.c] 2023-10-01T07:51:25.009 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.a] 2023-10-01T07:51:25.009 INFO:teuthology.orchestra.run.smithi092.stdout:[mds] 2023-10-01T07:51:25.009 INFO:teuthology.orchestra.run.smithi092.stdout: debug mds = 20 2023-10-01T07:51:25.010 INFO:teuthology.orchestra.run.smithi092.stdout: debug mds balancer = 20 2023-10-01T07:51:25.010 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2023-10-01T07:51:25.010 INFO:teuthology.orchestra.run.smithi092.stdout: mds debug frag = True 2023-10-01T07:51:25.010 INFO:teuthology.orchestra.run.smithi092.stdout: mds debug scatterstat = True 2023-10-01T07:51:25.010 INFO:teuthology.orchestra.run.smithi092.stdout: mds op complaint time = 180 2023-10-01T07:51:25.010 INFO:teuthology.orchestra.run.smithi092.stdout: mds verify scatter = True 2023-10-01T07:51:25.011 INFO:teuthology.orchestra.run.smithi092.stdout: osd op complaint time = 180 2023-10-01T07:51:25.011 INFO:teuthology.orchestra.run.smithi092.stdout: rados mon op timeout = 900 2023-10-01T07:51:25.011 INFO:teuthology.orchestra.run.smithi092.stdout: rados osd op timeout = 900 2023-10-01T07:51:25.013 INFO:teuthology.orchestra.run.smithi026.stdout:[global] 2023-10-01T07:51:25.013 INFO:teuthology.orchestra.run.smithi026.stdout: chdir = "" 2023-10-01T07:51:25.013 INFO:teuthology.orchestra.run.smithi026.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-01T07:51:25.013 INFO:teuthology.orchestra.run.smithi026.stdout: auth supported = cephx 2023-10-01T07:51:25.014 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:25.014 INFO:teuthology.orchestra.run.smithi026.stdout: filestore xattr use omap = true 2023-10-01T07:51:25.014 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:25.014 INFO:teuthology.orchestra.run.smithi026.stdout: mon clock drift allowed = 1.000 2023-10-01T07:51:25.014 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:25.014 INFO:teuthology.orchestra.run.smithi026.stdout: osd crush chooseleaf type = 0 2023-10-01T07:51:25.014 INFO:teuthology.orchestra.run.smithi026.stdout: auth debug = true 2023-10-01T07:51:25.015 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:25.015 INFO:teuthology.orchestra.run.smithi026.stdout: ms die on old message = true 2023-10-01T07:51:25.015 INFO:teuthology.orchestra.run.smithi026.stdout: ms die on bug = true 2023-10-01T07:51:25.015 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:25.015 INFO:teuthology.orchestra.run.smithi026.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-01T07:51:25.015 INFO:teuthology.orchestra.run.smithi026.stdout: mon pg warn max object skew = 0 2023-10-01T07:51:25.015 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:25.016 INFO:teuthology.orchestra.run.smithi026.stdout: # disable pg_autoscaler by default for new pools 2023-10-01T07:51:25.016 INFO:teuthology.orchestra.run.smithi026.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-01T07:51:25.016 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:25.016 INFO:teuthology.orchestra.run.smithi026.stdout: osd pool default size = 2 2023-10-01T07:51:25.016 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:25.016 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd allow primary affinity = true 2023-10-01T07:51:25.016 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd allow pg remap = true 2023-10-01T07:51:25.017 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on legacy crush tunables = false 2023-10-01T07:51:25.017 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on crush straw calc version zero = false 2023-10-01T07:51:25.017 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on no sortbitwise = false 2023-10-01T07:51:25.017 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on osd down out interval zero = false 2023-10-01T07:51:25.017 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on too few osds = false 2023-10-01T07:51:25.017 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-01T07:51:25.017 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-01T07:51:25.017 INFO:teuthology.orchestra.run.smithi026.stdout: mon_allow_pool_size_one = true 2023-10-01T07:51:25.018 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:25.018 INFO:teuthology.orchestra.run.smithi026.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-01T07:51:25.018 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:25.018 INFO:teuthology.orchestra.run.smithi026.stdout: osd default data pool replay window = 5 2023-10-01T07:51:25.018 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:25.018 INFO:teuthology.orchestra.run.smithi026.stdout: mon allow pool delete = true 2023-10-01T07:51:25.019 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:25.019 INFO:teuthology.orchestra.run.smithi026.stdout: mon cluster log file level = debug 2023-10-01T07:51:25.019 INFO:teuthology.orchestra.run.smithi026.stdout: debug asserts on shutdown = true 2023-10-01T07:51:25.019 INFO:teuthology.orchestra.run.smithi026.stdout: mon health detail to clog = false 2023-10-01T07:51:25.019 INFO:teuthology.orchestra.run.smithi026.stdout: mon host = "172.21.15.26,[v2:172.21.15.26:3301,v1:172.21.15.26:6790],[v2:172.21.15.26:3302,v1:172.21.15.26:6791]" 2023-10-01T07:51:25.019 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on pool no app = False 2023-10-01T07:51:25.019 INFO:teuthology.orchestra.run.smithi026.stdout: ms bind msgr2 = False 2023-10-01T07:51:25.019 INFO:teuthology.orchestra.run.smithi026.stdout: bluestore warn on legacy statfs = False 2023-10-01T07:51:25.020 INFO:teuthology.orchestra.run.smithi026.stdout: bluestore warn on no per pool omap = False 2023-10-01T07:51:25.020 INFO:teuthology.orchestra.run.smithi026.stdout: mon pg warn min per osd = 0 2023-10-01T07:51:25.020 INFO:teuthology.orchestra.run.smithi026.stdout: fsid = c29fb19d-520c-42a6-90f4-e7f86de96e8e 2023-10-01T07:51:25.020 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:25.020 INFO:teuthology.orchestra.run.smithi026.stdout:[osd] 2023-10-01T07:51:25.020 INFO:teuthology.orchestra.run.smithi026.stdout: osd journal size = 100 2023-10-01T07:51:25.020 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:25.021 INFO:teuthology.orchestra.run.smithi026.stdout: osd scrub load threshold = 5.0 2023-10-01T07:51:25.021 INFO:teuthology.orchestra.run.smithi026.stdout: osd scrub max interval = 600 2023-10-01T07:51:25.021 INFO:teuthology.orchestra.run.smithi026.stdout: osd mclock profile = high_recovery_ops 2023-10-01T07:51:25.021 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:25.022 INFO:teuthology.orchestra.run.smithi026.stdout: osd recover clone overlap = true 2023-10-01T07:51:25.022 INFO:teuthology.orchestra.run.smithi026.stdout: osd recovery max chunk = 1048576 2023-10-01T07:51:25.022 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:25.022 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug shutdown = true 2023-10-01T07:51:25.023 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug op order = true 2023-10-01T07:51:25.023 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug verify stray on activate = true 2023-10-01T07:51:25.023 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:25.023 INFO:teuthology.orchestra.run.smithi026.stdout: osd open classes on start = true 2023-10-01T07:51:25.023 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug pg log writeout = true 2023-10-01T07:51:25.023 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:25.023 INFO:teuthology.orchestra.run.smithi026.stdout: osd deep scrub update digest min age = 30 2023-10-01T07:51:25.023 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:25.023 INFO:teuthology.orchestra.run.smithi026.stdout: osd map max advance = 10 2023-10-01T07:51:25.023 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:25.023 INFO:teuthology.orchestra.run.smithi026.stdout: journal zero on create = true 2023-10-01T07:51:25.023 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:25.024 INFO:teuthology.orchestra.run.smithi026.stdout: filestore ondisk finisher threads = 3 2023-10-01T07:51:25.024 INFO:teuthology.orchestra.run.smithi026.stdout: filestore apply finisher threads = 3 2023-10-01T07:51:25.024 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:25.024 INFO:teuthology.orchestra.run.smithi026.stdout: bdev debug aio = true 2023-10-01T07:51:25.024 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug misdirected ops = true 2023-10-01T07:51:25.024 INFO:teuthology.orchestra.run.smithi026.stdout: bdev async discard = True 2023-10-01T07:51:25.024 INFO:teuthology.orchestra.run.smithi026.stdout: bdev enable discard = True 2023-10-01T07:51:25.024 INFO:teuthology.orchestra.run.smithi026.stdout: bluestore allocator = bitmap 2023-10-01T07:51:25.024 INFO:teuthology.orchestra.run.smithi026.stdout: bluestore block size = 96636764160 2023-10-01T07:51:25.024 INFO:teuthology.orchestra.run.smithi026.stdout: bluestore fsck on mount = True 2023-10-01T07:51:25.024 INFO:teuthology.orchestra.run.smithi026.stdout: debug bluefs = 1/20 2023-10-01T07:51:25.024 INFO:teuthology.orchestra.run.smithi026.stdout: debug bluestore = 1/20 2023-10-01T07:51:25.024 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2023-10-01T07:51:25.025 INFO:teuthology.orchestra.run.smithi026.stdout: debug osd = 20 2023-10-01T07:51:25.025 INFO:teuthology.orchestra.run.smithi026.stdout: debug rocksdb = 4/10 2023-10-01T07:51:25.025 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd backfillfull_ratio = 0.85 2023-10-01T07:51:25.025 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd full ratio = 0.9 2023-10-01T07:51:25.025 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd nearfull ratio = 0.8 2023-10-01T07:51:25.025 INFO:teuthology.orchestra.run.smithi026.stdout: osd failsafe full ratio = 0.95 2023-10-01T07:51:25.025 INFO:teuthology.orchestra.run.smithi026.stdout: osd objectstore = bluestore 2023-10-01T07:51:25.025 INFO:teuthology.orchestra.run.smithi026.stdout: osd op complaint time = 180 2023-10-01T07:51:25.025 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:25.025 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr] 2023-10-01T07:51:25.025 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2023-10-01T07:51:25.025 INFO:teuthology.orchestra.run.smithi026.stdout: debug mgr = 20 2023-10-01T07:51:25.026 INFO:teuthology.orchestra.run.smithi026.stdout: debug mon = 20 2023-10-01T07:51:25.026 INFO:teuthology.orchestra.run.smithi026.stdout: debug auth = 20 2023-10-01T07:51:25.026 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min pgs per osd = 4 2023-10-01T07:51:25.026 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min bytes per osd = 10 2023-10-01T07:51:25.026 INFO:teuthology.orchestra.run.smithi026.stdout: mgr/telemetry/nag = false 2023-10-01T07:51:25.026 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:25.026 INFO:teuthology.orchestra.run.smithi026.stdout:[mon] 2023-10-01T07:51:25.026 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2023-10-01T07:51:25.026 INFO:teuthology.orchestra.run.smithi026.stdout: debug mon = 20 2023-10-01T07:51:25.026 INFO:teuthology.orchestra.run.smithi026.stdout: debug paxos = 20 2023-10-01T07:51:25.026 INFO:teuthology.orchestra.run.smithi026.stdout: debug auth = 20 2023-10-01T07:51:25.026 INFO:teuthology.orchestra.run.smithi026.stdout: mon data avail warn = 5 2023-10-01T07:51:25.027 INFO:teuthology.orchestra.run.smithi026.stdout: mon mgr mkfs grace = 240 2023-10-01T07:51:25.027 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min pgs per osd = 4 2023-10-01T07:51:25.027 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd reporter subtree level = osd 2023-10-01T07:51:25.027 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd prime pg temp = true 2023-10-01T07:51:25.027 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min bytes per osd = 10 2023-10-01T07:51:25.027 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:25.027 INFO:teuthology.orchestra.run.smithi026.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-01T07:51:25.027 INFO:teuthology.orchestra.run.smithi026.stdout: auth mon ticket ttl = 660 # 11m 2023-10-01T07:51:25.027 INFO:teuthology.orchestra.run.smithi026.stdout: auth service ticket ttl = 240 # 4m 2023-10-01T07:51:25.027 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:25.027 INFO:teuthology.orchestra.run.smithi026.stdout: # don't complain about insecure global_id in the test suite 2023-10-01T07:51:25.027 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-01T07:51:25.027 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-01T07:51:25.028 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:25.028 INFO:teuthology.orchestra.run.smithi026.stdout: # 1m isn't quite enough 2023-10-01T07:51:25.028 INFO:teuthology.orchestra.run.smithi026.stdout: mon_down_mkfs_grace = 2m 2023-10-01T07:51:25.028 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:25.028 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_filestore_osds = false 2023-10-01T07:51:25.028 INFO:teuthology.orchestra.run.smithi026.stdout: mon op complaint time = 120 2023-10-01T07:51:25.028 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on osd down out interval zero = False 2023-10-01T07:51:25.028 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:25.028 INFO:teuthology.orchestra.run.smithi026.stdout:[client] 2023-10-01T07:51:25.028 INFO:teuthology.orchestra.run.smithi026.stdout: rgw cache enabled = true 2023-10-01T07:51:25.028 INFO:teuthology.orchestra.run.smithi026.stdout: rgw enable ops log = true 2023-10-01T07:51:25.028 INFO:teuthology.orchestra.run.smithi026.stdout: rgw enable usage log = true 2023-10-01T07:51:25.029 INFO:teuthology.orchestra.run.smithi026.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-01T07:51:25.029 INFO:teuthology.orchestra.run.smithi026.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-01T07:51:25.029 INFO:teuthology.orchestra.run.smithi026.stdout: client mount timeout = 600 2023-10-01T07:51:25.029 INFO:teuthology.orchestra.run.smithi026.stdout: debug client = 20 2023-10-01T07:51:25.029 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2023-10-01T07:51:25.029 INFO:teuthology.orchestra.run.smithi026.stdout: rados mon op timeout = 900 2023-10-01T07:51:25.029 INFO:teuthology.orchestra.run.smithi026.stdout: rados osd op timeout = 900 2023-10-01T07:51:25.029 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.a] 2023-10-01T07:51:25.029 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.b] 2023-10-01T07:51:25.029 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.c] 2023-10-01T07:51:25.029 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.a] 2023-10-01T07:51:25.029 INFO:teuthology.orchestra.run.smithi026.stdout:[mds] 2023-10-01T07:51:25.029 INFO:teuthology.orchestra.run.smithi026.stdout: debug mds = 20 2023-10-01T07:51:25.030 INFO:teuthology.orchestra.run.smithi026.stdout: debug mds balancer = 20 2023-10-01T07:51:25.030 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2023-10-01T07:51:25.030 INFO:teuthology.orchestra.run.smithi026.stdout: mds debug frag = True 2023-10-01T07:51:25.030 INFO:teuthology.orchestra.run.smithi026.stdout: mds debug scatterstat = True 2023-10-01T07:51:25.030 INFO:teuthology.orchestra.run.smithi026.stdout: mds op complaint time = 180 2023-10-01T07:51:25.030 INFO:teuthology.orchestra.run.smithi026.stdout: mds verify scatter = True 2023-10-01T07:51:25.030 INFO:teuthology.orchestra.run.smithi026.stdout: osd op complaint time = 180 2023-10-01T07:51:25.030 INFO:teuthology.orchestra.run.smithi026.stdout: rados mon op timeout = 900 2023-10-01T07:51:25.030 INFO:teuthology.orchestra.run.smithi026.stdout: rados osd op timeout = 900 2023-10-01T07:51:25.030 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-01T07:51:25.031 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-01T07:51:25.118 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-01T07:51:25.118 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-01T07:51:25.118 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-01T07:51:25.139 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-01T07:51:25.140 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-01T07:51:25.203 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi026.front.sepia.ceph.com 2023-10-01T07:51:25.203 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-01T07:51:25.203 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-01T07:51:25.203 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-01T07:51:25.290 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-01T07:51:25.290 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-01T07:51:25.353 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi092.front.sepia.ceph.com 2023-10-01T07:51:25.353 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-01T07:51:25.353 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-01T07:51:25.353 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-01T07:51:25.398 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-01T07:51:25.398 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-01T07:51:25.460 INFO:tasks.ceph:Setting up mon nodes... 2023-10-01T07:51:25.460 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-01T07:51:25.460 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-01T07:51:25.522 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-01T07:51:25.525 INFO:tasks.ceph:Setting up mds nodes... 2023-10-01T07:51:25.525 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-01T07:51:25.584 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-01T07:51:25.586 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-01T07:51:25.618 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-01T07:51:25.618 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-01T07:51:25.758 INFO:teuthology.orchestra.run.smithi092.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-01T07:51:25.773 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-01T07:51:25.773 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi026.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2023-10-01T07:51:25.773 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-01T07:51:25.809 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-01T07:51:25.810 INFO:tasks.ceph:role: osd.0 2023-10-01T07:51:25.810 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi026.front.sepia.ceph.com 2023-10-01T07:51:25.810 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-01T07:51:25.885 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-01T07:51:25.885 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-01T07:51:25.885 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-01T07:51:25.885 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-01T07:51:25.885 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-01T07:51:25.885 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2023-10-01T07:51:25.885 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-01T07:51:25.886 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-01T07:51:25.886 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-01T07:51:25.886 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-01T07:51:25.909 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2023-10-01T07:51:25.910 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2023-10-01T07:51:25.910 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-01T07:51:26.000 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-01T07:51:26.038 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-01T07:51:26.114 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-01T07:51:26.114 INFO:tasks.ceph:role: osd.1 2023-10-01T07:51:26.114 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi026.front.sepia.ceph.com 2023-10-01T07:51:26.114 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-01T07:51:26.189 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-01T07:51:26.189 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-01T07:51:26.189 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-01T07:51:26.189 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-01T07:51:26.189 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-01T07:51:26.189 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2023-10-01T07:51:26.190 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-01T07:51:26.190 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-01T07:51:26.190 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-01T07:51:26.190 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-01T07:51:26.211 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2023-10-01T07:51:26.213 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2023-10-01T07:51:26.214 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-01T07:51:26.303 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-01T07:51:26.339 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-01T07:51:26.413 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-01T07:51:26.414 INFO:tasks.ceph:role: osd.2 2023-10-01T07:51:26.414 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi026.front.sepia.ceph.com 2023-10-01T07:51:26.414 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-01T07:51:26.490 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-01T07:51:26.490 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-01T07:51:26.491 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-01T07:51:26.491 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-01T07:51:26.491 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-01T07:51:26.491 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2023-10-01T07:51:26.491 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-01T07:51:26.491 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-01T07:51:26.491 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-01T07:51:26.492 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-01T07:51:26.511 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2023-10-01T07:51:26.513 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2023-10-01T07:51:26.514 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-01T07:51:26.601 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-01T07:51:26.638 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-01T07:51:26.713 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-01T07:51:26.713 INFO:tasks.ceph:role: osd.3 2023-10-01T07:51:26.713 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi026.front.sepia.ceph.com 2023-10-01T07:51:26.714 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-01T07:51:26.788 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-01T07:51:26.788 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-01T07:51:26.789 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-01T07:51:26.789 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-01T07:51:26.789 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-01T07:51:26.789 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2023-10-01T07:51:26.789 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-01T07:51:26.789 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-01T07:51:26.789 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-01T07:51:26.789 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-01T07:51:26.812 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2023-10-01T07:51:26.814 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2023-10-01T07:51:26.814 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-01T07:51:26.902 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-01T07:51:26.939 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-01T07:51:27.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:27.040+0000 7f9307077200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-01T07:51:27.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:27.040+0000 7f9307077200 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-01T07:51:27.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:27.040+0000 7f9307077200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-01T07:51:27.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:27.040+0000 7f9307077200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-01T07:51:27.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:27.040+0000 7f9307077200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-01T07:51:27.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:27.040+0000 7f9307077200 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-01T07:51:29.892 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-01T07:51:29.928 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-01T07:51:30.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:30.023+0000 7f000ac0b200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-01T07:51:30.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:30.023+0000 7f000ac0b200 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-01T07:51:30.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:30.023+0000 7f000ac0b200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-01T07:51:30.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:30.023+0000 7f000ac0b200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-01T07:51:30.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:30.023+0000 7f000ac0b200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-01T07:51:30.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:30.023+0000 7f000ac0b200 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-01T07:51:32.871 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-01T07:51:32.907 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-01T07:51:33.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:33.001+0000 7fd70159b200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-01T07:51:33.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:33.001+0000 7fd70159b200 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-01T07:51:33.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:33.001+0000 7fd70159b200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-01T07:51:33.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:33.001+0000 7fd70159b200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-01T07:51:33.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:33.001+0000 7fd70159b200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-01T07:51:33.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:33.001+0000 7fd70159b200 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-01T07:51:35.841 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-01T07:51:35.877 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-01T07:51:35.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:35.970+0000 7f285ca34200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-01T07:51:35.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:35.970+0000 7f285ca34200 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-01T07:51:35.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:35.970+0000 7f285ca34200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-01T07:51:35.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:35.970+0000 7f285ca34200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-01T07:51:35.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:35.970+0000 7f285ca34200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-01T07:51:35.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:35.970+0000 7f285ca34200 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-01T07:51:38.824 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-01T07:51:38.859 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-01T07:51:38.859 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-01T07:51:38.859 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-01T07:51:38.934 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-01T07:51:38.934 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-01T07:51:39.009 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-01T07:51:39.009 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-01T07:51:39.085 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-01T07:51:39.085 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-01T07:51:39.160 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-01T07:51:39.160 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-01T07:51:39.235 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-01T07:51:39.235 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-01T07:51:39.311 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-01T07:51:39.311 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-01T07:51:39.334 INFO:tasks.ceph:Adding keys to all mons... 2023-10-01T07:51:39.334 DEBUG:teuthology.orchestra.run.smithi026:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-01T07:51:39.385 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr.x] 2023-10-01T07:51:39.385 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQD9JBlloSE4HxAAXKu5UUrMbiHPvpZiF/GtLw== 2023-10-01T07:51:39.385 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.a] 2023-10-01T07:51:39.385 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQD9JBlljNTgIhAAX1e1ZwjnRqIADnYnFQQl3Q== 2023-10-01T07:51:39.385 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.0] 2023-10-01T07:51:39.386 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQD/JBllkvJxAhAAdeSmijLLCLSfXSQSAmNPoA== 2023-10-01T07:51:39.386 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.1] 2023-10-01T07:51:39.386 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQACJRll50RvARAAnSDVjGfzX4raYUYAzHQCRw== 2023-10-01T07:51:39.386 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.2] 2023-10-01T07:51:39.386 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQAFJRllsgkkABAA4yK7W8rXXJA6ksherED9qA== 2023-10-01T07:51:39.386 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.3] 2023-10-01T07:51:39.386 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQAHJRll1m3lORAAF6K5a9MmMmGtL2yjyTmY/Q== 2023-10-01T07:51:39.386 INFO:teuthology.orchestra.run.smithi026.stdout:[client.0] 2023-10-01T07:51:39.386 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQD9JBlloHJBLRAAA1GmaWPRpULAmaRBzz8h8w== 2023-10-01T07:51:39.387 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-01T07:51:39.488 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-01T07:51:39.550 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-01T07:51:39.607 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-01T07:51:39.663 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-01T07:51:39.718 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-01T07:51:39.773 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-01T07:51:39.832 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-01T07:51:39.832 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-01T07:51:39.863 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-01T07:51:39.966 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-01T07:51:39.998 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-01T07:51:40.072 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-01T07:51:40.180 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-01T07:51:40.213 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-01T07:51:40.289 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-01T07:51:40.395 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-01T07:51:40.427 DEBUG:teuthology.orchestra.run.smithi026:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-01T07:51:40.491 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-01T07:51:40.491 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-01T07:51:40.491 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-01T07:51:40.534 INFO:tasks.ceph.mon.a:Started 2023-10-01T07:51:40.534 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-01T07:51:40.534 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-01T07:51:40.536 INFO:tasks.ceph.mon.b:Started 2023-10-01T07:51:40.536 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-01T07:51:40.536 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-01T07:51:40.538 INFO:tasks.ceph.mon.c:Started 2023-10-01T07:51:40.539 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-01T07:51:40.539 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-01T07:51:40.540 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-01T07:51:40.542 INFO:tasks.ceph.mgr.x:Started 2023-10-01T07:51:40.542 INFO:tasks.ceph:Setting crush tunables to default 2023-10-01T07:51:40.542 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd crush tunables default 2023-10-01T07:51:40.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.702+0000 7fa349826700 1 Processor -- start 2023-10-01T07:51:40.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.702+0000 7fa349826700 1 -- start start 2023-10-01T07:51:40.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.703+0000 7fa349826700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa344064e90 0x7fa344096620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:40.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.703+0000 7fa349826700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa344130850 0x7fa344132c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:40.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.703+0000 7fa349826700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa344064690 con 0x7fa344096b10 2023-10-01T07:51:40.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.703+0000 7fa349826700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa344098530 con 0x7fa344064e90 2023-10-01T07:51:40.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.703+0000 7fa349826700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa344065270 con 0x7fa344130850 2023-10-01T07:51:40.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.703+0000 7fa342ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa344064e90 0x7fa344096620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:40.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.703+0000 7fa342ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa344064e90 0x7fa344096620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55066/0 (socket says 172.21.15.26:55066) 2023-10-01T07:51:40.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.703+0000 7fa342ffd700 1 -- 172.21.15.26:0/2110758538 learned_addr learned my addr 172.21.15.26:0/2110758538 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:40.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.703+0000 7fa3437fe700 1 --2- 172.21.15.26:0/2110758538 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa344130850 0x7fa344132c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:40.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.704+0000 7fa342ffd700 1 -- 172.21.15.26:0/2110758538 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa344064e90 msgr2=0x7fa344096620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-01T07:51:40.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.704+0000 7fa342ffd700 1 -- 172.21.15.26:0/2110758538 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa344064e90 msgr2=0x7fa344096620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-01T07:51:40.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.704+0000 7fa342ffd700 1 --2- 172.21.15.26:0/2110758538 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa344064e90 0x7fa344096620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-01T07:51:40.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.704+0000 7fa342ffd700 1 --2- 172.21.15.26:0/2110758538 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa344064e90 0x7fa344096620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-10-01T07:51:40.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.704+0000 7fa3437fe700 1 -- 172.21.15.26:0/2110758538 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa344130850 msgr2=0x7fa344132c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-01T07:51:40.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.704+0000 7fa3437fe700 1 -- 172.21.15.26:0/2110758538 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa344130850 msgr2=0x7fa344132c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-01T07:51:40.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.704+0000 7fa3437fe700 1 --2- 172.21.15.26:0/2110758538 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa344130850 0x7fa344132c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-01T07:51:40.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.704+0000 7fa3437fe700 1 --2- 172.21.15.26:0/2110758538 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa344130850 0x7fa344132c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-10-01T07:51:40.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.711+0000 7fa341ffb700 1 -- 172.21.15.26:0/2110758538 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374802751 0 0) 0x7fa344064690 con 0x7fa344096b10 2023-10-01T07:51:40.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.711+0000 7fa341ffb700 1 -- 172.21.15.26:0/2110758538 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa32c0033f0 con 0x7fa344096b10 2023-10-01T07:51:40.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.711+0000 7fa341ffb700 1 -- 172.21.15.26:0/2110758538 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 257309825 0 0) 0x7fa32c0033f0 con 0x7fa344096b10 2023-10-01T07:51:40.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.711+0000 7fa341ffb700 1 -- 172.21.15.26:0/2110758538 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa344130850 msgr2=0x7fa344132c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-01T07:51:40.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.711+0000 7fa341ffb700 1 --2- 172.21.15.26:0/2110758538 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa344130850 0x7fa344132c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:40.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.711+0000 7fa341ffb700 1 -- 172.21.15.26:0/2110758538 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa344064e90 msgr2=0x7fa344096620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-01T07:51:40.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.711+0000 7fa341ffb700 1 --2- 172.21.15.26:0/2110758538 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa344064e90 0x7fa344096620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:40.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.711+0000 7fa341ffb700 1 -- 172.21.15.26:0/2110758538 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3440977c0 con 0x7fa344096b10 2023-10-01T07:51:40.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.711+0000 7fa341ffb700 1 -- 172.21.15.26:0/2110758538 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3529634301 0 0) 0x7fa338001470 con 0x7fa344096b10 2023-10-01T07:51:40.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.711+0000 7fa341ffb700 1 -- 172.21.15.26:0/2110758538 >> v1:172.21.15.26:6789/0 conn(0x7fa344096b10 legacy=0x7fa344096ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:40.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.712+0000 7fa341ffb700 1 --2- 172.21.15.26:0/2110758538 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa344064e90 0x7fa32c0038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:40.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.712+0000 7fa341ffb700 1 --2- 172.21.15.26:0/2110758538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c003ec0 0x7fa32c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:40.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.712+0000 7fa341ffb700 1 --2- 172.21.15.26:0/2110758538 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa344130850 0x7fa32c004b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:40.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.712+0000 7fa341ffb700 1 -- 172.21.15.26:0/2110758538 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa344098530 con 0x7fa32c003ec0 2023-10-01T07:51:40.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.712+0000 7fa341ffb700 1 -- 172.21.15.26:0/2110758538 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa344065270 con 0x7fa344064e90 2023-10-01T07:51:40.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.712+0000 7fa341ffb700 1 -- 172.21.15.26:0/2110758538 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c0051c0 con 0x7fa344130850 2023-10-01T07:51:40.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.712+0000 7fa342ffd700 1 --2- 172.21.15.26:0/2110758538 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa344064e90 0x7fa32c0038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:40.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.712+0000 7fa3427fc700 1 --2- 172.21.15.26:0/2110758538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c003ec0 0x7fa32c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:40.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.712+0000 7fa3437fe700 1 --2- 172.21.15.26:0/2110758538 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa344130850 0x7fa32c004b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:40.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.712+0000 7fa342ffd700 1 -- 172.21.15.26:0/2110758538 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa344130850 msgr2=0x7fa32c004b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:51:40.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.712+0000 7fa342ffd700 1 --2- 172.21.15.26:0/2110758538 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa344130850 0x7fa32c004b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:40.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.712+0000 7fa342ffd700 1 -- 172.21.15.26:0/2110758538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c003ec0 msgr2=0x7fa32c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:51:40.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.712+0000 7fa342ffd700 1 --2- 172.21.15.26:0/2110758538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c003ec0 0x7fa32c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:40.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.712+0000 7fa342ffd700 1 -- 172.21.15.26:0/2110758538 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa32c0033f0 con 0x7fa344064e90 2023-10-01T07:51:40.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.712+0000 7fa3427fc700 1 --2- 172.21.15.26:0/2110758538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c003ec0 0x7fa32c004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:40.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.712+0000 7fa342ffd700 1 --2- 172.21.15.26:0/2110758538 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa344064e90 0x7fa32c0038e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7fa33400ba80 tx=0x7fa334008040).ready entity=mon.1 client_cookie=b0d5d6e50aca0fc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:40.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.712+0000 7fa341ffb700 1 -- 172.21.15.26:0/2110758538 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33400b3f0 con 0x7fa344064e90 2023-10-01T07:51:40.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.712+0000 7fa341ffb700 1 -- 172.21.15.26:0/2110758538 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33400d5d0 con 0x7fa344064e90 2023-10-01T07:51:40.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.712+0000 7fa341ffb700 1 -- 172.21.15.26:0/2110758538 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33400d950 con 0x7fa344064e90 2023-10-01T07:51:40.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.713+0000 7fa349826700 1 -- 172.21.15.26:0/2110758538 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa344064e90 msgr2=0x7fa32c0038e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:40.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.713+0000 7fa349826700 1 --2- 172.21.15.26:0/2110758538 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa344064e90 0x7fa32c0038e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7fa33400ba80 tx=0x7fa334008040).stop 2023-10-01T07:51:40.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.713+0000 7fa349826700 1 -- 172.21.15.26:0/2110758538 shutdown_connections 2023-10-01T07:51:40.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.713+0000 7fa349826700 1 --2- 172.21.15.26:0/2110758538 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa344130850 0x7fa32c004b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:40.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.713+0000 7fa349826700 1 --2- 172.21.15.26:0/2110758538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c003ec0 0x7fa32c004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:40.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.713+0000 7fa349826700 1 --2- 172.21.15.26:0/2110758538 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa344064e90 0x7fa32c0038e0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:40.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.713+0000 7fa349826700 1 -- 172.21.15.26:0/2110758538 >> 172.21.15.26:0/2110758538 conn(0x7fa344098720 msgr2=0x7fa344098b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:40.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.713+0000 7fa349826700 1 -- 172.21.15.26:0/2110758538 shutdown_connections 2023-10-01T07:51:40.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.713+0000 7fa349826700 1 -- 172.21.15.26:0/2110758538 wait complete. 2023-10-01T07:51:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.714+0000 7fa349826700 1 Processor -- start 2023-10-01T07:51:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.714+0000 7fa349826700 1 -- start start 2023-10-01T07:51:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.715+0000 7fa349826700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa32c003ec0 0x7fa344094f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.715+0000 7fa349826700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa344064e90 0x7fa344095420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.715+0000 7fa349826700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa344096b10 0x7fa344139f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.715+0000 7fa349826700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34406a710 con 0x7fa344096b10 2023-10-01T07:51:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.715+0000 7fa349826700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa344118280 con 0x7fa32c003ec0 2023-10-01T07:51:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.715+0000 7fa349826700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa344118540 con 0x7fa344064e90 2023-10-01T07:51:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.715+0000 7fa342ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa32c003ec0 0x7fa344094f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.715+0000 7fa3437fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa344096b10 0x7fa344139f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.715+0000 7fa342ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa32c003ec0 0x7fa344094f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55082/0 (socket says 172.21.15.26:55082) 2023-10-01T07:51:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.715+0000 7fa3437fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa344096b10 0x7fa344139f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41738/0 (socket says 172.21.15.26:41738) 2023-10-01T07:51:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.715+0000 7fa342ffd700 1 -- 172.21.15.26:0/2454360451 learned_addr learned my addr 172.21.15.26:0/2454360451 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.715+0000 7fa3427fc700 1 --2- 172.21.15.26:0/2454360451 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa344064e90 0x7fa344095420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:40.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.715+0000 7fa342ffd700 1 -- 172.21.15.26:0/2454360451 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa344064e90 msgr2=0x7fa344095420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:40.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.715+0000 7fa342ffd700 1 --2- 172.21.15.26:0/2454360451 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa344064e90 0x7fa344095420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:40.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.715+0000 7fa342ffd700 1 -- 172.21.15.26:0/2454360451 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa344096b10 msgr2=0x7fa344139f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:40.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.715+0000 7fa342ffd700 1 --2- 172.21.15.26:0/2454360451 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa344096b10 0x7fa344139f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:40.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.715+0000 7fa342ffd700 1 -- 172.21.15.26:0/2454360451 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa344094b50 con 0x7fa32c003ec0 2023-10-01T07:51:40.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.715+0000 7fa3437fe700 1 --2- 172.21.15.26:0/2454360451 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa344096b10 0x7fa344139f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:40.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.716+0000 7fa342ffd700 1 --2- 172.21.15.26:0/2454360451 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa32c003ec0 0x7fa344094f30 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fa33400d440 tx=0x7fa334008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:40.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.716+0000 7fa32affd700 1 -- 172.21.15.26:0/2454360451 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33400dcc0 con 0x7fa32c003ec0 2023-10-01T07:51:40.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.716+0000 7fa32affd700 1 -- 172.21.15.26:0/2454360451 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa334021070 con 0x7fa32c003ec0 2023-10-01T07:51:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.716+0000 7fa349826700 1 -- 172.21.15.26:0/2454360451 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa344118f00 con 0x7fa32c003ec0 2023-10-01T07:51:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.716+0000 7fa32affd700 1 -- 172.21.15.26:0/2454360451 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33400de80 con 0x7fa32c003ec0 2023-10-01T07:51:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.716+0000 7fa349826700 1 -- 172.21.15.26:0/2454360451 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa344116ad0 con 0x7fa32c003ec0 2023-10-01T07:51:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.716+0000 7fa32affd700 1 -- 172.21.15.26:0/2454360451 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fa334006250 con 0x7fa32c003ec0 2023-10-01T07:51:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.716+0000 7fa32affd700 1 -- 172.21.15.26:0/2454360451 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa334026420 con 0x7fa32c003ec0 2023-10-01T07:51:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.717+0000 7fa349826700 1 -- 172.21.15.26:0/2454360451 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa344094ce0 con 0x7fa32c003ec0 2023-10-01T07:51:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.720+0000 7fa32affd700 1 -- 172.21.15.26:0/2454360451 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fa334045e50 con 0x7fa32c003ec0 2023-10-01T07:51:40.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.794+0000 7fa349826700 1 -- 172.21.15.26:0/2454360451 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fa3441181e0 con 0x7fa32c003ec0 2023-10-01T07:51:40.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.797+0000 7fa32affd700 1 -- 172.21.15.26:0/2454360451 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fa334034020 con 0x7fa32c003ec0 2023-10-01T07:51:40.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.798+0000 7fa349826700 1 -- 172.21.15.26:0/2454360451 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa32c003ec0 msgr2=0x7fa344094f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:40.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.798+0000 7fa349826700 1 --2- 172.21.15.26:0/2454360451 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa32c003ec0 0x7fa344094f30 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fa33400d440 tx=0x7fa334008040).stop 2023-10-01T07:51:40.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.798+0000 7fa349826700 1 -- 172.21.15.26:0/2454360451 shutdown_connections 2023-10-01T07:51:40.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.798+0000 7fa349826700 1 --2- 172.21.15.26:0/2454360451 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa344096b10 0x7fa344139f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:40.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.798+0000 7fa349826700 1 --2- 172.21.15.26:0/2454360451 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa32c003ec0 0x7fa344094f30 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:40.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.798+0000 7fa349826700 1 --2- 172.21.15.26:0/2454360451 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa344064e90 0x7fa344095420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:40.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.798+0000 7fa349826700 1 -- 172.21.15.26:0/2454360451 >> 172.21.15.26:0/2454360451 conn(0x7fa344098720 msgr2=0x7fa34412d980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:40.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.798+0000 7fa349826700 1 -- 172.21.15.26:0/2454360451 shutdown_connections 2023-10-01T07:51:40.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:40.798+0000 7fa349826700 1 -- 172.21.15.26:0/2454360451 wait complete. 2023-10-01T07:51:40.800 INFO:teuthology.orchestra.run.smithi026.stderr:adjusted tunables profile to default 2023-10-01T07:51:40.811 INFO:tasks.ceph:check_enable_crimson: False 2023-10-01T07:51:40.811 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-01T07:51:40.812 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-01T07:51:40.812 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-01T07:51:40.843 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-01T07:51:40.843 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-01T07:51:40.913 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-01T07:51:40.914 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-01T07:51:40.984 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-01T07:51:40.984 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-01T07:51:40.984 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:51:40.984+0000 7f923f052680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-01T07:51:41.014 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd new 46569ce3-81d1-44a1-a649-691de3e6f808 0 2023-10-01T07:51:41.064 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:51:41.064+0000 7f923f052680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-01T07:51:41.162 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:51:41.162+0000 7f923f052680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-01T07:51:41.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.184+0000 7f8b5df5e700 1 Processor -- start 2023-10-01T07:51:41.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.184+0000 7f8b5df5e700 1 -- start start 2023-10-01T07:51:41.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.184+0000 7f8b5df5e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b58096c20 0x7f8b581288b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:41.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.184+0000 7f8b5df5e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b58128ed0 0x7f8b581292f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:41.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.184+0000 7f8b5df5e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8b58093bf0 0x7f8b58094050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:41.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.184+0000 7f8b5df5e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b580964b0 con 0x7f8b58093bf0 2023-10-01T07:51:41.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.184+0000 7f8b5df5e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b58096210 con 0x7f8b58096c20 2023-10-01T07:51:41.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.184+0000 7f8b5df5e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b58095790 con 0x7f8b58128ed0 2023-10-01T07:51:41.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.184+0000 7f8b56ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b58128ed0 0x7f8b581292f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:41.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.185+0000 7f8b57fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8b58093bf0 0x7f8b58094050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:41.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.185+0000 7f8b577fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b58096c20 0x7f8b581288b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:41.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.185+0000 7f8b56ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b58128ed0 0x7f8b581292f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:54310/0 (socket says 172.21.15.26:54310) 2023-10-01T07:51:41.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.185+0000 7f8b56ffd700 1 -- 172.21.15.26:0/991387877 learned_addr learned my addr 172.21.15.26:0/991387877 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:41.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.185+0000 7f8b577fe700 1 -- 172.21.15.26:0/991387877 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b58128ed0 msgr2=0x7f8b581292f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:51:41.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.185+0000 7f8b577fe700 1 --2- 172.21.15.26:0/991387877 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b58128ed0 0x7f8b581292f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:41.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.185+0000 7f8b577fe700 1 -- 172.21.15.26:0/991387877 >> v2:172.21.15.26:3300/0 conn(0x7f8b58093bf0 msgr2=0x7f8b58094050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:51:41.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.185+0000 7f8b577fe700 1 --2- 172.21.15.26:0/991387877 >> v2:172.21.15.26:3300/0 conn(0x7f8b58093bf0 0x7f8b58094050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:41.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.185+0000 7f8b577fe700 1 -- 172.21.15.26:0/991387877 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b58097000 con 0x7f8b58096c20 2023-10-01T07:51:41.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.185+0000 7f8b56ffd700 1 --2- 172.21.15.26:0/991387877 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b58128ed0 0x7f8b581292f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:41.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.185+0000 7f8b577fe700 1 --2- 172.21.15.26:0/991387877 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b58096c20 0x7f8b581288b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f8b48009790 tx=0x7f8b48009060).ready entity=mon.1 client_cookie=a5df6eaa4839b279 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:41.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.185+0000 7f8b567fc700 1 -- 172.21.15.26:0/991387877 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b480090d0 con 0x7f8b58096c20 2023-10-01T07:51:41.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.185+0000 7f8b567fc700 1 -- 172.21.15.26:0/991387877 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4800d4a0 con 0x7f8b58096c20 2023-10-01T07:51:41.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.185+0000 7f8b567fc700 1 -- 172.21.15.26:0/991387877 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4800d820 con 0x7f8b58096c20 2023-10-01T07:51:41.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.186+0000 7f8b5df5e700 1 -- 172.21.15.26:0/991387877 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b58096c20 msgr2=0x7f8b581288b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:41.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.186+0000 7f8b5df5e700 1 --2- 172.21.15.26:0/991387877 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b58096c20 0x7f8b581288b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f8b48009790 tx=0x7f8b48009060).stop 2023-10-01T07:51:41.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.186+0000 7f8b5df5e700 1 -- 172.21.15.26:0/991387877 shutdown_connections 2023-10-01T07:51:41.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.186+0000 7f8b5df5e700 1 --2- 172.21.15.26:0/991387877 >> v2:172.21.15.26:3300/0 conn(0x7f8b58093bf0 0x7f8b58094050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:41.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.186+0000 7f8b5df5e700 1 --2- 172.21.15.26:0/991387877 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b58096c20 0x7f8b581288b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:41.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.186+0000 7f8b5df5e700 1 --2- 172.21.15.26:0/991387877 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b58128ed0 0x7f8b581292f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:41.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.186+0000 7f8b5df5e700 1 -- 172.21.15.26:0/991387877 >> 172.21.15.26:0/991387877 conn(0x7f8b580974f0 msgr2=0x7f8b58097900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:41.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.186+0000 7f8b5df5e700 1 -- 172.21.15.26:0/991387877 shutdown_connections 2023-10-01T07:51:41.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.186+0000 7f8b5df5e700 1 -- 172.21.15.26:0/991387877 wait complete. 2023-10-01T07:51:41.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.188+0000 7f8b5df5e700 1 Processor -- start 2023-10-01T07:51:41.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.188+0000 7f8b5df5e700 1 -- start start 2023-10-01T07:51:41.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.188+0000 7f8b5df5e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b58093bf0 0x7f8b58117cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:41.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.188+0000 7f8b5df5e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b58096c20 0x7f8b58113c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:41.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.188+0000 7f8b5df5e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b58128ed0 0x7f8b58114170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:41.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.188+0000 7f8b5df5e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b58115120 con 0x7f8b58128ed0 2023-10-01T07:51:41.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.189+0000 7f8b5df5e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b58124de0 con 0x7f8b58096c20 2023-10-01T07:51:41.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.189+0000 7f8b5df5e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b580959c0 con 0x7f8b58093bf0 2023-10-01T07:51:41.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.189+0000 7f8b57fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b58128ed0 0x7f8b58114170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:41.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.189+0000 7f8b56ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b58096c20 0x7f8b58113c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:41.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.189+0000 7f8b57fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b58128ed0 0x7f8b58114170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41770/0 (socket says 172.21.15.26:41770) 2023-10-01T07:51:41.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.189+0000 7f8b57fff700 1 -- 172.21.15.26:0/4148074519 learned_addr learned my addr 172.21.15.26:0/4148074519 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:41.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.189+0000 7f8b577fe700 1 --2- 172.21.15.26:0/4148074519 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b58093bf0 0x7f8b58117cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:41.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.189+0000 7f8b57fff700 1 -- 172.21.15.26:0/4148074519 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b58093bf0 msgr2=0x7f8b58117cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:41.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.189+0000 7f8b57fff700 1 --2- 172.21.15.26:0/4148074519 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b58093bf0 0x7f8b58117cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:41.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.189+0000 7f8b57fff700 1 -- 172.21.15.26:0/4148074519 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b58096c20 msgr2=0x7f8b58113c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:41.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.189+0000 7f8b57fff700 1 --2- 172.21.15.26:0/4148074519 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b58096c20 0x7f8b58113c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:41.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.189+0000 7f8b57fff700 1 -- 172.21.15.26:0/4148074519 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4c009370 con 0x7f8b58128ed0 2023-10-01T07:51:41.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.189+0000 7f8b56ffd700 1 --2- 172.21.15.26:0/4148074519 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b58096c20 0x7f8b58113c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:41.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.189+0000 7f8b57fff700 1 --2- 172.21.15.26:0/4148074519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b58128ed0 0x7f8b58114170 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f8b50009ec0 tx=0x7f8b5000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:41.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.189+0000 7f8b3f7fe700 1 -- 172.21.15.26:0/4148074519 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5000cb70 con 0x7f8b58128ed0 2023-10-01T07:51:41.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.189+0000 7f8b3f7fe700 1 -- 172.21.15.26:0/4148074519 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5000f040 con 0x7f8b58128ed0 2023-10-01T07:51:41.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.189+0000 7f8b5df5e700 1 -- 172.21.15.26:0/4148074519 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b480092a0 con 0x7f8b58128ed0 2023-10-01T07:51:41.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.189+0000 7f8b3f7fe700 1 -- 172.21.15.26:0/4148074519 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5000cee0 con 0x7f8b58128ed0 2023-10-01T07:51:41.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.189+0000 7f8b5df5e700 1 -- 172.21.15.26:0/4148074519 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b581158a0 con 0x7f8b58128ed0 2023-10-01T07:51:41.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.190+0000 7f8b3f7fe700 1 -- 172.21.15.26:0/4148074519 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f8b50013870 con 0x7f8b58128ed0 2023-10-01T07:51:41.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.190+0000 7f8b3f7fe700 1 -- 172.21.15.26:0/4148074519 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f8b5001d970 con 0x7f8b58128ed0 2023-10-01T07:51:41.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.191+0000 7f8b5df5e700 1 -- 172.21.15.26:0/4148074519 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b58117710 con 0x7f8b58128ed0 2023-10-01T07:51:41.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.195+0000 7f8b3f7fe700 1 -- 172.21.15.26:0/4148074519 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f8b50013dc0 con 0x7f8b58128ed0 2023-10-01T07:51:41.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.282+0000 7f8b5df5e700 1 -- 172.21.15.26:0/4148074519 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd new", "uuid": "46569ce3-81d1-44a1-a649-691de3e6f808", "id": 0} v 0) v1 -- 0x7f8b5805a260 con 0x7f8b58128ed0 2023-10-01T07:51:41.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.285+0000 7f8b3f7fe700 1 -- 172.21.15.26:0/4148074519 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "46569ce3-81d1-44a1-a649-691de3e6f808", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8b50027430 con 0x7f8b58128ed0 2023-10-01T07:51:41.286 INFO:teuthology.orchestra.run.smithi026.stdout:0 2023-10-01T07:51:41.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.286+0000 7f8b5df5e700 1 -- 172.21.15.26:0/4148074519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b58128ed0 msgr2=0x7f8b58114170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:41.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.286+0000 7f8b5df5e700 1 --2- 172.21.15.26:0/4148074519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b58128ed0 0x7f8b58114170 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f8b50009ec0 tx=0x7f8b5000b040).stop 2023-10-01T07:51:41.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.287+0000 7f8b5df5e700 1 -- 172.21.15.26:0/4148074519 shutdown_connections 2023-10-01T07:51:41.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.287+0000 7f8b5df5e700 1 --2- 172.21.15.26:0/4148074519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b58128ed0 0x7f8b58114170 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:41.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.287+0000 7f8b5df5e700 1 --2- 172.21.15.26:0/4148074519 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b58093bf0 0x7f8b58117cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:41.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.287+0000 7f8b5df5e700 1 --2- 172.21.15.26:0/4148074519 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b58096c20 0x7f8b58113c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:41.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.287+0000 7f8b5df5e700 1 -- 172.21.15.26:0/4148074519 >> 172.21.15.26:0/4148074519 conn(0x7f8b580974f0 msgr2=0x7f8b58099fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:41.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.287+0000 7f8b5df5e700 1 -- 172.21.15.26:0/4148074519 shutdown_connections 2023-10-01T07:51:41.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.287+0000 7f8b5df5e700 1 -- 172.21.15.26:0/4148074519 wait complete. 2023-10-01T07:51:41.300 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd new 1fc1ba9b-4110-4d31-96d6-794937578cff 1 2023-10-01T07:51:41.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.468+0000 7f28bcbf3700 1 Processor -- start 2023-10-01T07:51:41.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.468+0000 7f28bcbf3700 1 -- start start 2023-10-01T07:51:41.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.468+0000 7f28bcbf3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f28b8097df0 0x7f28b8098710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:41.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.468+0000 7f28bcbf3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f28b8098c00 0x7f28b8098fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:41.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.468+0000 7f28bcbf3700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28b8096370 con 0x7f28b812f4e0 2023-10-01T07:51:41.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.468+0000 7f28bcbf3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28b80981d0 con 0x7f28b8098c00 2023-10-01T07:51:41.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.468+0000 7f28bcbf3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b8099ed0 con 0x7f28b8097df0 2023-10-01T07:51:41.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.469+0000 7f28b659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f28b8097df0 0x7f28b8098710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:41.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.469+0000 7f28b5d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f28b8098c00 0x7f28b8098fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:41.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.469+0000 7f28b6d9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f28b812f4e0 0x7f28b81318d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39672/0 (socket says 172.21.15.26:39672) 2023-10-01T07:51:41.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.469+0000 7f28b6d9d700 1 -- 172.21.15.26:0/2149615645 learned_addr learned my addr 172.21.15.26:0/2149615645 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:51:41.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.469+0000 7f28b659c700 1 -- 172.21.15.26:0/2149615645 >> v2:172.21.15.26:3300/0 conn(0x7f28b8098c00 msgr2=0x7f28b8098fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:51:41.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.469+0000 7f28b659c700 1 --2- 172.21.15.26:0/2149615645 >> v2:172.21.15.26:3300/0 conn(0x7f28b8098c00 0x7f28b8098fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:41.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.469+0000 7f28b659c700 1 -- 172.21.15.26:0/2149615645 >> v1:172.21.15.26:6789/0 conn(0x7f28b812f4e0 legacy=0x7f28b81318d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:41.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.469+0000 7f28b559a700 1 -- 172.21.15.26:0/2149615645 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3223788379 0 0) 0x7f28b8096370 con 0x7f28b812f4e0 2023-10-01T07:51:41.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.469+0000 7f28b659c700 1 -- 172.21.15.26:0/2149615645 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b8094e30 con 0x7f28b8097df0 2023-10-01T07:51:41.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.469+0000 7f28b5d9b700 1 --2- 172.21.15.26:0/2149615645 >> v2:172.21.15.26:3300/0 conn(0x7f28b8098c00 0x7f28b8098fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:41.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.469+0000 7f28b659c700 1 --2- 172.21.15.26:0/2149615645 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f28b8097df0 0x7f28b8098710 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f28a8009790 tx=0x7f28a8009060).ready entity=mon.1 client_cookie=f69ecd628d04952 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:41.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.469+0000 7f28b559a700 1 -- 172.21.15.26:0/2149615645 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a80090d0 con 0x7f28b8097df0 2023-10-01T07:51:41.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.469+0000 7f28b559a700 1 -- 172.21.15.26:0/2149615645 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a800f510 con 0x7f28b8097df0 2023-10-01T07:51:41.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.469+0000 7f28b559a700 1 -- 172.21.15.26:0/2149615645 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a800f890 con 0x7f28b8097df0 2023-10-01T07:51:41.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.470+0000 7f28bcbf3700 1 -- 172.21.15.26:0/2149615645 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f28b8097df0 msgr2=0x7f28b8098710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:41.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.470+0000 7f28bcbf3700 1 --2- 172.21.15.26:0/2149615645 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f28b8097df0 0x7f28b8098710 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f28a8009790 tx=0x7f28a8009060).stop 2023-10-01T07:51:41.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.470+0000 7f28bcbf3700 1 -- 172.21.15.26:0/2149615645 shutdown_connections 2023-10-01T07:51:41.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.470+0000 7f28bcbf3700 1 --2- 172.21.15.26:0/2149615645 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f28b8097df0 0x7f28b8098710 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:41.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.470+0000 7f28bcbf3700 1 --2- 172.21.15.26:0/2149615645 >> v2:172.21.15.26:3300/0 conn(0x7f28b8098c00 0x7f28b8098fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:41.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.470+0000 7f28bcbf3700 1 -- 172.21.15.26:0/2149615645 >> 172.21.15.26:0/2149615645 conn(0x7f28b809dcf0 msgr2=0x7f28b809e100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:41.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.470+0000 7f28bcbf3700 1 -- 172.21.15.26:0/2149615645 shutdown_connections 2023-10-01T07:51:41.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.470+0000 7f28bcbf3700 1 -- 172.21.15.26:0/2149615645 wait complete. 2023-10-01T07:51:41.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.471+0000 7f28bcbf3700 1 Processor -- start 2023-10-01T07:51:41.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.471+0000 7f28bcbf3700 1 -- start start 2023-10-01T07:51:41.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.471+0000 7f28bcbf3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28b8097df0 0x7f28b811a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:41.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.471+0000 7f28bcbf3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f28b8098c00 0x7f28b811a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:41.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.471+0000 7f28bcbf3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f28b812f4e0 0x7f28b811ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:41.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.471+0000 7f28bcbf3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b811b240 con 0x7f28b8097df0 2023-10-01T07:51:41.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.471+0000 7f28bcbf3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b811de10 con 0x7f28b8098c00 2023-10-01T07:51:41.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.471+0000 7f28bcbf3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28b811e9f0 con 0x7f28b812f4e0 2023-10-01T07:51:41.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.471+0000 7f28b659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28b8097df0 0x7f28b811a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:41.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.472+0000 7f28b659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28b8097df0 0x7f28b811a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41788/0 (socket says 172.21.15.26:41788) 2023-10-01T07:51:41.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.472+0000 7f28b6d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f28b812f4e0 0x7f28b811ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:41.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.472+0000 7f28b659c700 1 -- 172.21.15.26:0/981903961 learned_addr learned my addr 172.21.15.26:0/981903961 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:41.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.472+0000 7f28b5d9b700 1 --2- 172.21.15.26:0/981903961 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f28b8098c00 0x7f28b811a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:41.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.472+0000 7f28b659c700 1 -- 172.21.15.26:0/981903961 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f28b812f4e0 msgr2=0x7f28b811ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:41.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.472+0000 7f28b659c700 1 --2- 172.21.15.26:0/981903961 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f28b812f4e0 0x7f28b811ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:41.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.472+0000 7f28b659c700 1 -- 172.21.15.26:0/981903961 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f28b8098c00 msgr2=0x7f28b811a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:41.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.472+0000 7f28b659c700 1 --2- 172.21.15.26:0/981903961 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f28b8098c00 0x7f28b811a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:41.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.472+0000 7f28b659c700 1 -- 172.21.15.26:0/981903961 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ac0092a0 con 0x7f28b8097df0 2023-10-01T07:51:41.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.472+0000 7f28b659c700 1 --2- 172.21.15.26:0/981903961 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28b8097df0 0x7f28b811a370 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f28a8009e30 tx=0x7f28a8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:41.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.472+0000 7f28a67fc700 1 -- 172.21.15.26:0/981903961 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a8006970 con 0x7f28b8097df0 2023-10-01T07:51:41.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.472+0000 7f28a67fc700 1 -- 172.21.15.26:0/981903961 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a800fc50 con 0x7f28b8097df0 2023-10-01T07:51:41.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.472+0000 7f28bcbf3700 1 -- 172.21.15.26:0/981903961 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a80092a0 con 0x7f28b8097df0 2023-10-01T07:51:41.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.472+0000 7f28a67fc700 1 -- 172.21.15.26:0/981903961 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a800f890 con 0x7f28b8097df0 2023-10-01T07:51:41.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.472+0000 7f28bcbf3700 1 -- 172.21.15.26:0/981903961 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28b8094580 con 0x7f28b8097df0 2023-10-01T07:51:41.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.472+0000 7f28a67fc700 1 -- 172.21.15.26:0/981903961 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f28a801b880 con 0x7f28b8097df0 2023-10-01T07:51:41.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.472+0000 7f28a67fc700 1 -- 172.21.15.26:0/981903961 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f28a8024a20 con 0x7f28b8097df0 2023-10-01T07:51:41.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.473+0000 7f28bcbf3700 1 -- 172.21.15.26:0/981903961 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28b8099d20 con 0x7f28b8097df0 2023-10-01T07:51:41.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.476+0000 7f28a67fc700 1 -- 172.21.15.26:0/981903961 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f28a8043e50 con 0x7f28b8097df0 2023-10-01T07:51:41.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.560+0000 7f28bcbf3700 1 -- 172.21.15.26:0/981903961 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1fc1ba9b-4110-4d31-96d6-794937578cff", "id": 1} v 0) v1 -- 0x7f28b8095660 con 0x7f28b8097df0 2023-10-01T07:51:41.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.562+0000 7f28a67fc700 1 -- 172.21.15.26:0/981903961 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1fc1ba9b-4110-4d31-96d6-794937578cff", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f28a8032070 con 0x7f28b8097df0 2023-10-01T07:51:41.563 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-10-01T07:51:41.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.563+0000 7f28bcbf3700 1 -- 172.21.15.26:0/981903961 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28b8097df0 msgr2=0x7f28b811a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:41.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.564+0000 7f28bcbf3700 1 --2- 172.21.15.26:0/981903961 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28b8097df0 0x7f28b811a370 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f28a8009e30 tx=0x7f28a8017000).stop 2023-10-01T07:51:41.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.564+0000 7f28bcbf3700 1 -- 172.21.15.26:0/981903961 shutdown_connections 2023-10-01T07:51:41.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.564+0000 7f28bcbf3700 1 --2- 172.21.15.26:0/981903961 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f28b812f4e0 0x7f28b811ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:41.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.564+0000 7f28bcbf3700 1 --2- 172.21.15.26:0/981903961 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28b8097df0 0x7f28b811a370 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:41.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.564+0000 7f28bcbf3700 1 --2- 172.21.15.26:0/981903961 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f28b8098c00 0x7f28b811a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:41.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.564+0000 7f28bcbf3700 1 -- 172.21.15.26:0/981903961 >> 172.21.15.26:0/981903961 conn(0x7f28b809dcf0 msgr2=0x7f28b809bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:41.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.565+0000 7f28bcbf3700 1 -- 172.21.15.26:0/981903961 shutdown_connections 2023-10-01T07:51:41.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.565+0000 7f28bcbf3700 1 -- 172.21.15.26:0/981903961 wait complete. 2023-10-01T07:51:41.578 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd new 37de933d-3b8e-4b94-87bd-2f36896c7ff5 2 2023-10-01T07:51:41.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.707+0000 7f15914d2700 1 Processor -- start 2023-10-01T07:51:41.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.707+0000 7f15914d2700 1 -- start start 2023-10-01T07:51:41.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.708+0000 7f15914d2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f158c0651e0 0x7f158c098790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:41.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.708+0000 7f15914d2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f158c1306a0 0x7f158c132a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:41.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.708+0000 7f15914d2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f158c065e50 con 0x7f158c098c80 2023-10-01T07:51:41.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.708+0000 7f15914d2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f158c095830 con 0x7f158c1306a0 2023-10-01T07:51:41.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.708+0000 7f15914d2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f158c095ba0 con 0x7f158c0651e0 2023-10-01T07:51:41.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.708+0000 7f158b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f158c1306a0 0x7f158c132a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:41.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.708+0000 7f158affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f158c0651e0 0x7f158c098790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:41.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.708+0000 7f158b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f158c1306a0 0x7f158c132a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41790/0 (socket says 172.21.15.26:41790) 2023-10-01T07:51:41.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.708+0000 7f158b7fe700 1 -- 172.21.15.26:0/4155766984 learned_addr learned my addr 172.21.15.26:0/4155766984 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:41.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.708+0000 7f158affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f158c0651e0 0x7f158c098790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55134/0 (socket says 172.21.15.26:55134) 2023-10-01T07:51:41.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.708+0000 7f158b7fe700 1 -- 172.21.15.26:0/4155766984 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f158c0651e0 msgr2=0x7f158c098790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:51:41.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.708+0000 7f158b7fe700 1 --2- 172.21.15.26:0/4155766984 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f158c0651e0 0x7f158c098790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:41.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.708+0000 7f158b7fe700 1 -- 172.21.15.26:0/4155766984 >> v1:172.21.15.26:6789/0 conn(0x7f158c098c80 legacy=0x7f158c0990a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:41.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.708+0000 7f1589ffb700 1 -- 172.21.15.26:0/4155766984 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 882097815 0 0) 0x7f158c065e50 con 0x7f158c098c80 2023-10-01T07:51:41.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.708+0000 7f158b7fe700 1 -- 172.21.15.26:0/4155766984 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158c095500 con 0x7f158c1306a0 2023-10-01T07:51:41.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.708+0000 7f158affd700 1 --2- 172.21.15.26:0/4155766984 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f158c0651e0 0x7f158c098790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:41.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.709+0000 7f158b7fe700 1 --2- 172.21.15.26:0/4155766984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f158c1306a0 0x7f158c132a90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f1584006fd0 tx=0x7f15840090f0).ready entity=mon.0 client_cookie=912e7d34c1846f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:41.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.709+0000 7f1589ffb700 1 -- 172.21.15.26:0/4155766984 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158400b580 con 0x7f158c1306a0 2023-10-01T07:51:41.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.709+0000 7f1589ffb700 1 -- 172.21.15.26:0/4155766984 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158400b6e0 con 0x7f158c1306a0 2023-10-01T07:51:41.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.709+0000 7f1589ffb700 1 -- 172.21.15.26:0/4155766984 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158400ba80 con 0x7f158c1306a0 2023-10-01T07:51:41.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.710+0000 7f15914d2700 1 -- 172.21.15.26:0/4155766984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f158c1306a0 msgr2=0x7f158c132a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:41.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.710+0000 7f15914d2700 1 --2- 172.21.15.26:0/4155766984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f158c1306a0 0x7f158c132a90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f1584006fd0 tx=0x7f15840090f0).stop 2023-10-01T07:51:41.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.710+0000 7f15914d2700 1 -- 172.21.15.26:0/4155766984 shutdown_connections 2023-10-01T07:51:41.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.710+0000 7f15914d2700 1 --2- 172.21.15.26:0/4155766984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f158c1306a0 0x7f158c132a90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:41.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.710+0000 7f15914d2700 1 --2- 172.21.15.26:0/4155766984 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f158c0651e0 0x7f158c098790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:41.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.710+0000 7f15914d2700 1 -- 172.21.15.26:0/4155766984 >> 172.21.15.26:0/4155766984 conn(0x7f158c09a960 msgr2=0x7f158c09ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:41.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.711+0000 7f15914d2700 1 -- 172.21.15.26:0/4155766984 shutdown_connections 2023-10-01T07:51:41.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.711+0000 7f15914d2700 1 -- 172.21.15.26:0/4155766984 wait complete. 2023-10-01T07:51:41.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.712+0000 7f15914d2700 1 Processor -- start 2023-10-01T07:51:41.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.712+0000 7f15914d2700 1 -- start start 2023-10-01T07:51:41.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.713+0000 7f15914d2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f158c0651e0 0x7f158c11df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:41.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.713+0000 7f15914d2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f158c098c80 0x7f158c119ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:41.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.713+0000 7f15914d2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f158c1306a0 0x7f158c11a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:41.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.713+0000 7f15914d2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158c130550 con 0x7f158c0651e0 2023-10-01T07:51:41.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.713+0000 7f15914d2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f158c130140 con 0x7f158c098c80 2023-10-01T07:51:41.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.713+0000 7f15914d2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f158c099d40 con 0x7f158c1306a0 2023-10-01T07:51:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.713+0000 7f158a7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f158c098c80 0x7f158c119ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.713+0000 7f158a7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f158c098c80 0x7f158c119ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55136/0 (socket says 172.21.15.26:55136) 2023-10-01T07:51:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.713+0000 7f158a7fc700 1 -- 172.21.15.26:0/1290944670 learned_addr learned my addr 172.21.15.26:0/1290944670 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.713+0000 7f158affd700 1 --2- 172.21.15.26:0/1290944670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f158c0651e0 0x7f158c11df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.713+0000 7f158b7fe700 1 --2- 172.21.15.26:0/1290944670 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f158c1306a0 0x7f158c11a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.713+0000 7f158affd700 1 -- 172.21.15.26:0/1290944670 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f158c1306a0 msgr2=0x7f158c11a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.713+0000 7f158affd700 1 --2- 172.21.15.26:0/1290944670 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f158c1306a0 0x7f158c11a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.713+0000 7f158affd700 1 -- 172.21.15.26:0/1290944670 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f158c098c80 msgr2=0x7f158c119ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.713+0000 7f158affd700 1 --2- 172.21.15.26:0/1290944670 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f158c098c80 0x7f158c119ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.713+0000 7f158affd700 1 -- 172.21.15.26:0/1290944670 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157c009a20 con 0x7f158c0651e0 2023-10-01T07:51:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.713+0000 7f158a7fc700 1 --2- 172.21.15.26:0/1290944670 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f158c098c80 0x7f158c119ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.713+0000 7f158b7fe700 1 --2- 172.21.15.26:0/1290944670 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f158c1306a0 0x7f158c11a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:41.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.714+0000 7f158affd700 1 --2- 172.21.15.26:0/1290944670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f158c0651e0 0x7f158c11df90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f157c009fa0 tx=0x7f157c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:41.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.714+0000 7f1582ffd700 1 -- 172.21.15.26:0/1290944670 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c00cb40 con 0x7f158c0651e0 2023-10-01T07:51:41.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.714+0000 7f1582ffd700 1 -- 172.21.15.26:0/1290944670 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157c00f040 con 0x7f158c0651e0 2023-10-01T07:51:41.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.714+0000 7f15914d2700 1 -- 172.21.15.26:0/1290944670 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1584009370 con 0x7f158c0651e0 2023-10-01T07:51:41.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.714+0000 7f1582ffd700 1 -- 172.21.15.26:0/1290944670 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c013400 con 0x7f158c0651e0 2023-10-01T07:51:41.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.714+0000 7f15914d2700 1 -- 172.21.15.26:0/1290944670 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f158c11b3f0 con 0x7f158c0651e0 2023-10-01T07:51:41.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.714+0000 7f1582ffd700 1 -- 172.21.15.26:0/1290944670 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f157c013a10 con 0x7f158c0651e0 2023-10-01T07:51:41.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.714+0000 7f1582ffd700 1 -- 172.21.15.26:0/1290944670 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f157c01b790 con 0x7f158c0651e0 2023-10-01T07:51:41.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.715+0000 7f15914d2700 1 -- 172.21.15.26:0/1290944670 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f158c11d550 con 0x7f158c0651e0 2023-10-01T07:51:41.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.718+0000 7f1582ffd700 1 -- 172.21.15.26:0/1290944670 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f158c11d550 con 0x7f158c0651e0 2023-10-01T07:51:41.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.806+0000 7f15914d2700 1 -- 172.21.15.26:0/1290944670 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd new", "uuid": "37de933d-3b8e-4b94-87bd-2f36896c7ff5", "id": 2} v 0) v1 -- 0x7f158c11adf0 con 0x7f158c0651e0 2023-10-01T07:51:41.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.809+0000 7f1582ffd700 1 -- 172.21.15.26:0/1290944670 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "37de933d-3b8e-4b94-87bd-2f36896c7ff5", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f157c009880 con 0x7f158c0651e0 2023-10-01T07:51:41.809 INFO:teuthology.orchestra.run.smithi026.stdout:2 2023-10-01T07:51:41.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.810+0000 7f15914d2700 1 -- 172.21.15.26:0/1290944670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f158c0651e0 msgr2=0x7f158c11df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:41.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.810+0000 7f15914d2700 1 --2- 172.21.15.26:0/1290944670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f158c0651e0 0x7f158c11df90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f157c009fa0 tx=0x7f157c00b040).stop 2023-10-01T07:51:41.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.810+0000 7f15914d2700 1 -- 172.21.15.26:0/1290944670 shutdown_connections 2023-10-01T07:51:41.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.810+0000 7f15914d2700 1 --2- 172.21.15.26:0/1290944670 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f158c1306a0 0x7f158c11a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:41.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.810+0000 7f15914d2700 1 --2- 172.21.15.26:0/1290944670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f158c0651e0 0x7f158c11df90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:41.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.810+0000 7f15914d2700 1 --2- 172.21.15.26:0/1290944670 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f158c098c80 0x7f158c119ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:41.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.810+0000 7f15914d2700 1 -- 172.21.15.26:0/1290944670 >> 172.21.15.26:0/1290944670 conn(0x7f158c09a960 msgr2=0x7f158c093b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:41.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.810+0000 7f15914d2700 1 -- 172.21.15.26:0/1290944670 shutdown_connections 2023-10-01T07:51:41.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.810+0000 7f15914d2700 1 -- 172.21.15.26:0/1290944670 wait complete. 2023-10-01T07:51:41.823 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd new bd020309-5fd2-4d97-b36a-67e159fa3ebf 3 2023-10-01T07:51:41.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.991+0000 7f03f8af5700 1 Processor -- start 2023-10-01T07:51:41.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.991+0000 7f03f8af5700 1 -- start start 2023-10-01T07:51:41.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.991+0000 7f03f8af5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03f4066d80 0x7f03f4067160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:41.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.991+0000 7f03f8af5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03f4068590 0x7f03f4067650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:41.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.991+0000 7f03f8af5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f4069580 con 0x7f03f4128bb0 2023-10-01T07:51:41.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.991+0000 7f03f8af5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f4094430 con 0x7f03f4066d80 2023-10-01T07:51:41.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.991+0000 7f03f8af5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03f4094050 con 0x7f03f4068590 2023-10-01T07:51:41.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.992+0000 7f03f2d9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f03f4128bb0 0x7f03f4129040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39684/0 (socket says 172.21.15.26:39684) 2023-10-01T07:51:41.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.992+0000 7f03f259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03f4066d80 0x7f03f4067160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:41.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.992+0000 7f03f2d9d700 1 -- 172.21.15.26:0/3338097083 learned_addr learned my addr 172.21.15.26:0/3338097083 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:51:41.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.992+0000 7f03f1d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03f4068590 0x7f03f4067650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:41.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.992+0000 7f03f159a700 1 -- 172.21.15.26:0/3338097083 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1900165696 0 0) 0x7f03f4069580 con 0x7f03f4128bb0 2023-10-01T07:51:41.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.992+0000 7f03f159a700 1 -- 172.21.15.26:0/3338097083 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03dc0033f0 con 0x7f03f4128bb0 2023-10-01T07:51:41.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.992+0000 7f03f259c700 1 -- 172.21.15.26:0/3338097083 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03f4068590 msgr2=0x7f03f4067650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:51:41.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.992+0000 7f03f259c700 1 --2- 172.21.15.26:0/3338097083 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03f4068590 0x7f03f4067650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:41.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.992+0000 7f03f259c700 1 -- 172.21.15.26:0/3338097083 >> v1:172.21.15.26:6789/0 conn(0x7f03f4128bb0 legacy=0x7f03f4129040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:41.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.992+0000 7f03f259c700 1 -- 172.21.15.26:0/3338097083 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f4069840 con 0x7f03f4066d80 2023-10-01T07:51:41.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.992+0000 7f03f1d9b700 1 --2- 172.21.15.26:0/3338097083 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03f4068590 0x7f03f4067650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:41.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.992+0000 7f03f259c700 1 --2- 172.21.15.26:0/3338097083 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03f4066d80 0x7f03f4067160 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f03e4009790 tx=0x7f03e4009060).ready entity=mon.1 client_cookie=b5b8cd7b98945fca server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:41.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.992+0000 7f03f159a700 1 -- 172.21.15.26:0/3338097083 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e40090d0 con 0x7f03f4066d80 2023-10-01T07:51:41.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.992+0000 7f03f159a700 1 -- 172.21.15.26:0/3338097083 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e400f510 con 0x7f03f4066d80 2023-10-01T07:51:41.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.992+0000 7f03f159a700 1 -- 172.21.15.26:0/3338097083 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e400f890 con 0x7f03f4066d80 2023-10-01T07:51:41.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.993+0000 7f03f8af5700 1 -- 172.21.15.26:0/3338097083 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03f4066d80 msgr2=0x7f03f4067160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:41.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.993+0000 7f03f8af5700 1 --2- 172.21.15.26:0/3338097083 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03f4066d80 0x7f03f4067160 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f03e4009790 tx=0x7f03e4009060).stop 2023-10-01T07:51:41.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.993+0000 7f03f8af5700 1 -- 172.21.15.26:0/3338097083 shutdown_connections 2023-10-01T07:51:41.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.993+0000 7f03f8af5700 1 --2- 172.21.15.26:0/3338097083 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03f4066d80 0x7f03f4067160 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:41.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.993+0000 7f03f8af5700 1 --2- 172.21.15.26:0/3338097083 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03f4068590 0x7f03f4067650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:41.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.993+0000 7f03f8af5700 1 -- 172.21.15.26:0/3338097083 >> 172.21.15.26:0/3338097083 conn(0x7f03f409a3d0 msgr2=0x7f03f409a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:41.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.993+0000 7f03f8af5700 1 -- 172.21.15.26:0/3338097083 shutdown_connections 2023-10-01T07:51:41.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.993+0000 7f03f8af5700 1 -- 172.21.15.26:0/3338097083 wait complete. 2023-10-01T07:51:41.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.994+0000 7f03f8af5700 1 Processor -- start 2023-10-01T07:51:41.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.994+0000 7f03f8af5700 1 -- start start 2023-10-01T07:51:41.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.994+0000 7f03f8af5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03f4066d80 0x7f03f4119430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:42.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.994+0000 7f03f8af5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03f4068590 0x7f03f4119920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:42.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.994+0000 7f03f8af5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03f4128bb0 0x7f03f4119e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:42.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.994+0000 7f03f8af5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f411ba60 con 0x7f03f4068590 2023-10-01T07:51:42.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.994+0000 7f03f8af5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f41284d0 con 0x7f03f4128bb0 2023-10-01T07:51:42.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.994+0000 7f03f8af5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03f411ce90 con 0x7f03f4066d80 2023-10-01T07:51:42.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.995+0000 7f03f259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03f4066d80 0x7f03f4119430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:42.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.995+0000 7f03f259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03f4066d80 0x7f03f4119430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:54362/0 (socket says 172.21.15.26:54362) 2023-10-01T07:51:42.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.995+0000 7f03f259c700 1 -- 172.21.15.26:0/3402549845 learned_addr learned my addr 172.21.15.26:0/3402549845 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:42.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.995+0000 7f03f1d9b700 1 --2- 172.21.15.26:0/3402549845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03f4068590 0x7f03f4119920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:42.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.995+0000 7f03f2d9d700 1 --2- 172.21.15.26:0/3402549845 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03f4128bb0 0x7f03f4119e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:42.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.995+0000 7f03f259c700 1 -- 172.21.15.26:0/3402549845 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03f4128bb0 msgr2=0x7f03f4119e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:42.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.995+0000 7f03f259c700 1 --2- 172.21.15.26:0/3402549845 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03f4128bb0 0x7f03f4119e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:42.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.995+0000 7f03f259c700 1 -- 172.21.15.26:0/3402549845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03f4068590 msgr2=0x7f03f4119920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:42.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.995+0000 7f03f259c700 1 --2- 172.21.15.26:0/3402549845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03f4068590 0x7f03f4119920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:42.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.995+0000 7f03f259c700 1 -- 172.21.15.26:0/3402549845 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e80092a0 con 0x7f03f4066d80 2023-10-01T07:51:42.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.995+0000 7f03f1d9b700 1 --2- 172.21.15.26:0/3402549845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03f4068590 0x7f03f4119920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:42.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.995+0000 7f03f259c700 1 --2- 172.21.15.26:0/3402549845 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03f4066d80 0x7f03f4119430 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f03e4009d80 tx=0x7f03e4017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:42.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.995+0000 7f03e27fc700 1 -- 172.21.15.26:0/3402549845 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e4006930 con 0x7f03f4066d80 2023-10-01T07:51:42.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.995+0000 7f03e27fc700 1 -- 172.21.15.26:0/3402549845 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e40119a0 con 0x7f03f4066d80 2023-10-01T07:51:42.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.995+0000 7f03f8af5700 1 -- 172.21.15.26:0/3402549845 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e40092a0 con 0x7f03f4066d80 2023-10-01T07:51:42.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.995+0000 7f03e27fc700 1 -- 172.21.15.26:0/3402549845 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e4011d40 con 0x7f03f4066d80 2023-10-01T07:51:42.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.995+0000 7f03f8af5700 1 -- 172.21.15.26:0/3402549845 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f411d570 con 0x7f03f4066d80 2023-10-01T07:51:42.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.996+0000 7f03e27fc700 1 -- 172.21.15.26:0/3402549845 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f03e401b880 con 0x7f03f4066d80 2023-10-01T07:51:42.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.996+0000 7f03e27fc700 1 -- 172.21.15.26:0/3402549845 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f03e4024940 con 0x7f03f4066d80 2023-10-01T07:51:42.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.997+0000 7f03f8af5700 1 -- 172.21.15.26:0/3402549845 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f411d730 con 0x7f03f4066d80 2023-10-01T07:51:42.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:41.999+0000 7f03e27fc700 1 -- 172.21.15.26:0/3402549845 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f03e4043e50 con 0x7f03f4066d80 2023-10-01T07:51:42.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.083+0000 7f03f8af5700 1 -- 172.21.15.26:0/3402549845 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd new", "uuid": "bd020309-5fd2-4d97-b36a-67e159fa3ebf", "id": 3} v 0) v1 -- 0x7f03f40992e0 con 0x7f03f4066d80 2023-10-01T07:51:42.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.086+0000 7f03e27fc700 1 -- 172.21.15.26:0/3402549845 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bd020309-5fd2-4d97-b36a-67e159fa3ebf", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f03e4032030 con 0x7f03f4066d80 2023-10-01T07:51:42.086 INFO:teuthology.orchestra.run.smithi026.stdout:3 2023-10-01T07:51:42.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.087+0000 7f03f8af5700 1 -- 172.21.15.26:0/3402549845 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03f4066d80 msgr2=0x7f03f4119430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:42.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.087+0000 7f03f8af5700 1 --2- 172.21.15.26:0/3402549845 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03f4066d80 0x7f03f4119430 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f03e4009d80 tx=0x7f03e4017000).stop 2023-10-01T07:51:42.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.087+0000 7f03f8af5700 1 -- 172.21.15.26:0/3402549845 shutdown_connections 2023-10-01T07:51:42.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.087+0000 7f03f8af5700 1 --2- 172.21.15.26:0/3402549845 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03f4128bb0 0x7f03f4119e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:42.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.087+0000 7f03f8af5700 1 --2- 172.21.15.26:0/3402549845 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03f4066d80 0x7f03f4119430 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:42.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.087+0000 7f03f8af5700 1 --2- 172.21.15.26:0/3402549845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03f4068590 0x7f03f4119920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:42.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.087+0000 7f03f8af5700 1 -- 172.21.15.26:0/3402549845 >> 172.21.15.26:0/3402549845 conn(0x7f03f409a3d0 msgr2=0x7f03f40982d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:42.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.087+0000 7f03f8af5700 1 -- 172.21.15.26:0/3402549845 shutdown_connections 2023-10-01T07:51:42.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.087+0000 7f03f8af5700 1 -- 172.21.15.26:0/3402549845 wait complete. 2023-10-01T07:51:42.099 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-01T07:51:42.100 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-01T07:51:42.102 INFO:tasks.ceph.osd.0:Started 2023-10-01T07:51:42.102 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-01T07:51:42.102 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-01T07:51:42.104 INFO:tasks.ceph.osd.1:Started 2023-10-01T07:51:42.104 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-01T07:51:42.104 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-01T07:51:42.106 INFO:tasks.ceph.osd.2:Started 2023-10-01T07:51:42.106 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-01T07:51:42.106 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-01T07:51:42.109 INFO:tasks.ceph.osd.3:Started 2023-10-01T07:51:42.109 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-01T07:51:42.197 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:51:42.194+0000 7f923f052680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-01T07:51:42.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.261+0000 7f7e3a5db700 1 Processor -- start 2023-10-01T07:51:42.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.261+0000 7f7e3a5db700 1 -- start start 2023-10-01T07:51:42.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.261+0000 7f7e3a5db700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7e34098d50 0x7f7e34130480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:42.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.261+0000 7f7e3a5db700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7e34099190 0x7f7e34132980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:42.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.261+0000 7f7e3a5db700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e34065ed0 con 0x7f7e340654a0 2023-10-01T07:51:42.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.261+0000 7f7e3a5db700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e34095880 con 0x7f7e34099190 2023-10-01T07:51:42.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.261+0000 7f7e3a5db700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e34096120 con 0x7f7e34098d50 2023-10-01T07:51:42.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.261+0000 7f7e33fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7e340654a0 0x7f7e34098640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39714/0 (socket says 172.21.15.26:39714) 2023-10-01T07:51:42.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.261+0000 7f7e337fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7e34098d50 0x7f7e34130480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:42.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.261+0000 7f7e33fff700 1 -- 172.21.15.26:0/3127038129 learned_addr learned my addr 172.21.15.26:0/3127038129 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:51:42.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.261+0000 7f7e38b78700 1 --2- 172.21.15.26:0/3127038129 >> v2:172.21.15.26:3300/0 conn(0x7f7e34099190 0x7f7e34132980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:42.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.262+0000 7f7e32ffd700 1 -- 172.21.15.26:0/3127038129 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 954682191 0 0) 0x7f7e34065ed0 con 0x7f7e340654a0 2023-10-01T07:51:42.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.262+0000 7f7e32ffd700 1 -- 172.21.15.26:0/3127038129 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e200033f0 con 0x7f7e340654a0 2023-10-01T07:51:42.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.262+0000 7f7e337fe700 1 -- 172.21.15.26:0/3127038129 >> v2:172.21.15.26:3300/0 conn(0x7f7e34099190 msgr2=0x7f7e34132980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:51:42.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.262+0000 7f7e337fe700 1 --2- 172.21.15.26:0/3127038129 >> v2:172.21.15.26:3300/0 conn(0x7f7e34099190 0x7f7e34132980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:42.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.262+0000 7f7e337fe700 1 -- 172.21.15.26:0/3127038129 >> v1:172.21.15.26:6789/0 conn(0x7f7e340654a0 legacy=0x7f7e34098640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:42.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.262+0000 7f7e337fe700 1 -- 172.21.15.26:0/3127038129 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e34066280 con 0x7f7e34098d50 2023-10-01T07:51:42.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.262+0000 7f7e337fe700 1 --2- 172.21.15.26:0/3127038129 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7e34098d50 0x7f7e34130480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f7e1c009760 tx=0x7f7e1c009060).ready entity=mon.2 client_cookie=f4849efc0bb4b5cb server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:42.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.262+0000 7f7e32ffd700 1 -- 172.21.15.26:0/3127038129 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c00d4a0 con 0x7f7e34098d50 2023-10-01T07:51:42.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.262+0000 7f7e32ffd700 1 -- 172.21.15.26:0/3127038129 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1c00d600 con 0x7f7e34098d50 2023-10-01T07:51:42.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.262+0000 7f7e32ffd700 1 -- 172.21.15.26:0/3127038129 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c00d980 con 0x7f7e34098d50 2023-10-01T07:51:42.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.263+0000 7f7e3a5db700 1 -- 172.21.15.26:0/3127038129 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7e34098d50 msgr2=0x7f7e34130480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:42.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.263+0000 7f7e3a5db700 1 --2- 172.21.15.26:0/3127038129 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7e34098d50 0x7f7e34130480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f7e1c009760 tx=0x7f7e1c009060).stop 2023-10-01T07:51:42.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.263+0000 7f7e3a5db700 1 -- 172.21.15.26:0/3127038129 shutdown_connections 2023-10-01T07:51:42.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.263+0000 7f7e3a5db700 1 --2- 172.21.15.26:0/3127038129 >> v2:172.21.15.26:3300/0 conn(0x7f7e34099190 0x7f7e34132980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:42.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.263+0000 7f7e3a5db700 1 --2- 172.21.15.26:0/3127038129 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7e34098d50 0x7f7e34130480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:42.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.263+0000 7f7e3a5db700 1 -- 172.21.15.26:0/3127038129 >> 172.21.15.26:0/3127038129 conn(0x7f7e3409a740 msgr2=0x7f7e3409ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:42.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.263+0000 7f7e3a5db700 1 -- 172.21.15.26:0/3127038129 shutdown_connections 2023-10-01T07:51:42.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.263+0000 7f7e3a5db700 1 -- 172.21.15.26:0/3127038129 wait complete. 2023-10-01T07:51:42.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.264+0000 7f7e3a5db700 1 Processor -- start 2023-10-01T07:51:42.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.264+0000 7f7e3a5db700 1 -- start start 2023-10-01T07:51:42.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.265+0000 7f7e3a5db700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7e340654a0 0x7f7e3413a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.265+0000 7f7e3a5db700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7e34098d50 0x7f7e3413ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.265+0000 7f7e3a5db700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e34099190 0x7f7e3411a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.265+0000 7f7e3a5db700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3409cd50 con 0x7f7e34099190 2023-10-01T07:51:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.265+0000 7f7e3a5db700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3411b950 con 0x7f7e340654a0 2023-10-01T07:51:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.265+0000 7f7e3a5db700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3411dcc0 con 0x7f7e34098d50 2023-10-01T07:51:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.265+0000 7f7e337fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7e34098d50 0x7f7e3413ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.265+0000 7f7e337fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7e34098d50 0x7f7e3413ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:54436/0 (socket says 172.21.15.26:54436) 2023-10-01T07:51:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.265+0000 7f7e337fe700 1 -- 172.21.15.26:0/1529830663 learned_addr learned my addr 172.21.15.26:0/1529830663 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.265+0000 7f7e33fff700 1 --2- 172.21.15.26:0/1529830663 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7e340654a0 0x7f7e3413a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.265+0000 7f7e38b78700 1 --2- 172.21.15.26:0/1529830663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e34099190 0x7f7e3411a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.265+0000 7f7e337fe700 1 -- 172.21.15.26:0/1529830663 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7e340654a0 msgr2=0x7f7e3413a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:42.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.265+0000 7f7e337fe700 1 --2- 172.21.15.26:0/1529830663 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7e340654a0 0x7f7e3413a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:42.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.265+0000 7f7e337fe700 1 -- 172.21.15.26:0/1529830663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e34099190 msgr2=0x7f7e3411a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:42.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.265+0000 7f7e337fe700 1 --2- 172.21.15.26:0/1529830663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e34099190 0x7f7e3411a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:42.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.265+0000 7f7e337fe700 1 -- 172.21.15.26:0/1529830663 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1c0092a0 con 0x7f7e34098d50 2023-10-01T07:51:42.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.265+0000 7f7e38b78700 1 --2- 172.21.15.26:0/1529830663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e34099190 0x7f7e3411a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:42.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.265+0000 7f7e33fff700 1 --2- 172.21.15.26:0/1529830663 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7e340654a0 0x7f7e3413a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:42.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.265+0000 7f7e337fe700 1 --2- 172.21.15.26:0/1529830663 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7e34098d50 0x7f7e3413ae90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f7e34096260 tx=0x7f7e1c016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:42.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.266+0000 7f7e2bfff700 1 -- 172.21.15.26:0/1529830663 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c00dd30 con 0x7f7e34098d50 2023-10-01T07:51:42.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.266+0000 7f7e2bfff700 1 -- 172.21.15.26:0/1529830663 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1c00de90 con 0x7f7e34098d50 2023-10-01T07:51:42.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.266+0000 7f7e2bfff700 1 -- 172.21.15.26:0/1529830663 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c00d980 con 0x7f7e34098d50 2023-10-01T07:51:42.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.266+0000 7f7e3a5db700 1 -- 172.21.15.26:0/1529830663 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e3412f740 con 0x7f7e34098d50 2023-10-01T07:51:42.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.266+0000 7f7e3a5db700 1 -- 172.21.15.26:0/1529830663 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e3411da00 con 0x7f7e34098d50 2023-10-01T07:51:42.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.266+0000 7f7e2bfff700 1 -- 172.21.15.26:0/1529830663 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f7e1c01d640 con 0x7f7e34098d50 2023-10-01T07:51:42.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.266+0000 7f7e2bfff700 1 -- 172.21.15.26:0/1529830663 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f7e1c027460 con 0x7f7e34098d50 2023-10-01T07:51:42.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.267+0000 7f7e3a5db700 1 -- 172.21.15.26:0/1529830663 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e3409e9d0 con 0x7f7e34098d50 2023-10-01T07:51:42.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.270+0000 7f7e2bfff700 1 -- 172.21.15.26:0/1529830663 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f7e1c016070 con 0x7f7e34098d50 2023-10-01T07:51:42.331 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:51:42.330+0000 7f923f052680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-01T07:51:42.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.342+0000 7f7e3a5db700 1 -- 172.21.15.26:0/1529830663 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e34097400 con 0x7f7e34098d50 2023-10-01T07:51:42.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.343+0000 7f7e2bfff700 1 -- 172.21.15.26:0/1529830663 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4109 (secure 0 0 0) 0x7f7e1c036090 con 0x7f7e34098d50 2023-10-01T07:51:42.344 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:42.344 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":6,"fsid":"c29fb19d-520c-42a6-90f4-e7f86de96e8e","created":"2023-10-01T07:51:40.702414+0000","modified":"2023-10-01T07:51:42.084736+0000","last_up_change":"0.000000","last_in_change":"2023-10-01T07:51:42.084736+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"46569ce3-81d1-44a1-a649-691de3e6f808","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1fc1ba9b-4110-4d31-96d6-794937578cff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"37de933d-3b8e-4b94-87bd-2f36896c7ff5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"bd020309-5fd2-4d97-b36a-67e159fa3ebf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-01T07:51:42.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.344+0000 7f7e3a5db700 1 -- 172.21.15.26:0/1529830663 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7e34098d50 msgr2=0x7f7e3413ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:42.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.344+0000 7f7e3a5db700 1 --2- 172.21.15.26:0/1529830663 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7e34098d50 0x7f7e3413ae90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f7e34096260 tx=0x7f7e1c016000).stop 2023-10-01T07:51:42.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.344+0000 7f7e3a5db700 1 -- 172.21.15.26:0/1529830663 shutdown_connections 2023-10-01T07:51:42.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.344+0000 7f7e3a5db700 1 --2- 172.21.15.26:0/1529830663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e34099190 0x7f7e3411a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:42.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.344+0000 7f7e3a5db700 1 --2- 172.21.15.26:0/1529830663 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7e340654a0 0x7f7e3413a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:42.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.344+0000 7f7e3a5db700 1 --2- 172.21.15.26:0/1529830663 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7e34098d50 0x7f7e3413ae90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:42.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.344+0000 7f7e3a5db700 1 -- 172.21.15.26:0/1529830663 >> 172.21.15.26:0/1529830663 conn(0x7f7e3409a740 msgr2=0x7f7e341142e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:42.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.344+0000 7f7e3a5db700 1 -- 172.21.15.26:0/1529830663 shutdown_connections 2023-10-01T07:51:42.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:42.344+0000 7f7e3a5db700 1 -- 172.21.15.26:0/1529830663 wait complete. 2023-10-01T07:51:42.358 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-01T07:51:42.358 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-01T07:51:42.474 INFO:tasks.ceph.osd.0.smithi026.stderr:2023-10-01T07:51:42.473+0000 7fc681802200 -1 Falling back to public interface 2023-10-01T07:51:42.484 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:51:42.484+0000 7f923f052680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-01T07:51:42.748 INFO:tasks.ceph.osd.1.smithi026.stderr:2023-10-01T07:51:42.747+0000 7fd7bd753200 -1 Falling back to public interface 2023-10-01T07:51:42.748 INFO:tasks.ceph.osd.2.smithi026.stderr:2023-10-01T07:51:42.747+0000 7f300d9c6200 -1 Falling back to public interface 2023-10-01T07:51:42.749 INFO:tasks.ceph.osd.2.smithi026.stderr:2023-10-01T07:51:42.748+0000 7f3007b6e700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6804/0: (98) Address already in use 2023-10-01T07:51:42.749 INFO:tasks.ceph.osd.3.smithi026.stderr:2023-10-01T07:51:42.748+0000 7f25d24a6200 -1 Falling back to public interface 2023-10-01T07:51:42.760 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-01T07:51:42.880 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.880+0000 7f3fe41e8700 1 Processor -- start 2023-10-01T07:51:42.880 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.880+0000 7f3fe41e8700 1 -- start start 2023-10-01T07:51:42.882 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.881+0000 7f3fe41e8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3fdc0629b0 0x7f3fdc125870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:42.882 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.881+0000 7f3fe41e8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fdc125d60 0x7f3fdc093bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:42.882 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.881+0000 7f3fe41e8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fdc095d40 con 0x7f3fdc0940e0 2023-10-01T07:51:42.883 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.881+0000 7f3fe41e8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc062d90 con 0x7f3fdc125d60 2023-10-01T07:51:42.883 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.881+0000 7f3fe41e8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc0964e0 con 0x7f3fdc0629b0 2023-10-01T07:51:42.883 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.881+0000 7f3fe1f84700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3fdc0629b0 0x7f3fdc125870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:42.883 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.881+0000 7f3fe2785700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3fdc0940e0 0x7f3fdc12fd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39720/0 (socket says 172.21.15.26:39720) 2023-10-01T07:51:42.883 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.881+0000 7f3fe2785700 1 -- 172.21.15.26:0/1368225632 learned_addr learned my addr 172.21.15.26:0/1368225632 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:51:42.884 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.881+0000 7f3fe1783700 1 --2- 172.21.15.26:0/1368225632 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fdc125d60 0x7f3fdc093bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:42.884 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.882+0000 7f3fe1f84700 1 -- 172.21.15.26:0/1368225632 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fdc125d60 msgr2=0x7f3fdc093bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:51:42.884 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.882+0000 7f3fe1f84700 1 --2- 172.21.15.26:0/1368225632 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fdc125d60 0x7f3fdc093bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:42.884 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.882+0000 7f3fe0f82700 1 -- 172.21.15.26:0/1368225632 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1600502337 0 0) 0x7f3fdc095d40 con 0x7f3fdc0940e0 2023-10-01T07:51:42.885 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.882+0000 7f3fe1f84700 1 -- 172.21.15.26:0/1368225632 >> v1:172.21.15.26:6789/0 conn(0x7f3fdc0940e0 legacy=0x7f3fdc12fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:42.885 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.882+0000 7f3fe1f84700 1 -- 172.21.15.26:0/1368225632 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fdc0634d0 con 0x7f3fdc0629b0 2023-10-01T07:51:42.885 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.882+0000 7f3fe1783700 1 --2- 172.21.15.26:0/1368225632 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fdc125d60 0x7f3fdc093bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:42.885 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.882+0000 7f3fe1f84700 1 --2- 172.21.15.26:0/1368225632 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3fdc0629b0 0x7f3fdc125870 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f3fcc009e90 tx=0x7f3fcc009780).ready entity=mon.2 client_cookie=37126893d6d6b292 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:42.886 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.882+0000 7f3fe0f82700 1 -- 172.21.15.26:0/1368225632 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc00e070 con 0x7f3fdc0629b0 2023-10-01T07:51:42.886 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.882+0000 7f3fe0f82700 1 -- 172.21.15.26:0/1368225632 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fcc00bb00 con 0x7f3fdc0629b0 2023-10-01T07:51:42.886 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.882+0000 7f3fe0f82700 1 -- 172.21.15.26:0/1368225632 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc00be80 con 0x7f3fdc0629b0 2023-10-01T07:51:42.888 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.883+0000 7f3fe41e8700 1 -- 172.21.15.26:0/1368225632 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3fdc0629b0 msgr2=0x7f3fdc125870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:42.888 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.883+0000 7f3fe41e8700 1 --2- 172.21.15.26:0/1368225632 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3fdc0629b0 0x7f3fdc125870 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f3fcc009e90 tx=0x7f3fcc009780).stop 2023-10-01T07:51:42.889 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.883+0000 7f3fe41e8700 1 -- 172.21.15.26:0/1368225632 shutdown_connections 2023-10-01T07:51:42.889 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.883+0000 7f3fe41e8700 1 --2- 172.21.15.26:0/1368225632 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3fdc0629b0 0x7f3fdc125870 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:42.889 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.883+0000 7f3fe41e8700 1 --2- 172.21.15.26:0/1368225632 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fdc125d60 0x7f3fdc093bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:42.889 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.883+0000 7f3fe41e8700 1 -- 172.21.15.26:0/1368225632 >> 172.21.15.26:0/1368225632 conn(0x7f3fdc09ab90 msgr2=0x7f3fdc09afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:42.889 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.883+0000 7f3fe41e8700 1 -- 172.21.15.26:0/1368225632 shutdown_connections 2023-10-01T07:51:42.889 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.883+0000 7f3fe41e8700 1 -- 172.21.15.26:0/1368225632 wait complete. 2023-10-01T07:51:42.889 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.884+0000 7f3fe41e8700 1 Processor -- start 2023-10-01T07:51:42.889 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.884+0000 7f3fe41e8700 1 -- start start 2023-10-01T07:51:42.889 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.884+0000 7f3fe41e8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fdc0629b0 0x7f3fdc117c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:42.889 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.884+0000 7f3fe41e8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fdc0940e0 0x7f3fdc091a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:42.889 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.884+0000 7f3fe41e8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3fdc125d60 0x7f3fdc091f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:42.890 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.884+0000 7f3fe41e8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc125090 con 0x7f3fdc0629b0 2023-10-01T07:51:42.890 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.884+0000 7f3fe41e8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc092ea0 con 0x7f3fdc0940e0 2023-10-01T07:51:42.890 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.884+0000 7f3fe41e8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc095f70 con 0x7f3fdc125d60 2023-10-01T07:51:42.890 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.884+0000 7f3fe1783700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fdc0940e0 0x7f3fdc091a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:42.890 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.884+0000 7f3fe1783700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fdc0940e0 0x7f3fdc091a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55214/0 (socket says 172.21.15.26:55214) 2023-10-01T07:51:42.890 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.884+0000 7f3fe1f84700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fdc0629b0 0x7f3fdc117c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:42.890 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.884+0000 7f3fe1783700 1 -- 172.21.15.26:0/2606241367 learned_addr learned my addr 172.21.15.26:0/2606241367 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:42.890 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.884+0000 7f3fe2785700 1 --2- 172.21.15.26:0/2606241367 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3fdc125d60 0x7f3fdc091f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:42.890 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.885+0000 7f3fe1783700 1 -- 172.21.15.26:0/2606241367 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3fdc125d60 msgr2=0x7f3fdc091f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:42.890 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.885+0000 7f3fe1783700 1 --2- 172.21.15.26:0/2606241367 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3fdc125d60 0x7f3fdc091f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:42.890 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.885+0000 7f3fe1783700 1 -- 172.21.15.26:0/2606241367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fdc0629b0 msgr2=0x7f3fdc117c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:42.891 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.885+0000 7f3fe1783700 1 --2- 172.21.15.26:0/2606241367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fdc0629b0 0x7f3fdc117c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:42.891 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.885+0000 7f3fe1783700 1 -- 172.21.15.26:0/2606241367 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd00092a0 con 0x7f3fdc0940e0 2023-10-01T07:51:42.891 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.885+0000 7f3fe1f84700 1 --2- 172.21.15.26:0/2606241367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fdc0629b0 0x7f3fdc117c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:42.891 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.885+0000 7f3fe1783700 1 --2- 172.21.15.26:0/2606241367 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fdc0940e0 0x7f3fdc091a10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f3fd000ea00 tx=0x7f3fd0009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:42.891 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.885+0000 7f3fd9ffb700 1 -- 172.21.15.26:0/2606241367 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd000c6a0 con 0x7f3fdc0940e0 2023-10-01T07:51:42.891 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.885+0000 7f3fd9ffb700 1 -- 172.21.15.26:0/2606241367 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd000c800 con 0x7f3fdc0940e0 2023-10-01T07:51:42.891 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.885+0000 7f3fe41e8700 1 -- 172.21.15.26:0/2606241367 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fcc009a20 con 0x7f3fdc0940e0 2023-10-01T07:51:42.891 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.885+0000 7f3fd9ffb700 1 -- 172.21.15.26:0/2606241367 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd000cb80 con 0x7f3fdc0940e0 2023-10-01T07:51:42.891 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.885+0000 7f3fd9ffb700 1 -- 172.21.15.26:0/2606241367 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f3fd001b660 con 0x7f3fdc0940e0 2023-10-01T07:51:42.891 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.885+0000 7f3fe41e8700 1 -- 172.21.15.26:0/2606241367 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fdc0935a0 con 0x7f3fdc0940e0 2023-10-01T07:51:42.891 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.886+0000 7f3fd9ffb700 1 -- 172.21.15.26:0/2606241367 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f3fd001bb40 con 0x7f3fdc0940e0 2023-10-01T07:51:42.892 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.886+0000 7f3fe41e8700 1 -- 172.21.15.26:0/2606241367 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fdc118360 con 0x7f3fdc0940e0 2023-10-01T07:51:42.892 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.889+0000 7f3fd9ffb700 1 -- 172.21.15.26:0/2606241367 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f3fd003ae50 con 0x7f3fdc0940e0 2023-10-01T07:51:42.961 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.960+0000 7f3fe41e8700 1 -- 172.21.15.26:0/2606241367 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3fdc05a260 con 0x7f3fdc0940e0 2023-10-01T07:51:42.961 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.961+0000 7f3fd9ffb700 1 -- 172.21.15.26:0/2606241367 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4109 (secure 0 0 0) 0x7f3fd0029030 con 0x7f3fdc0940e0 2023-10-01T07:51:42.962 INFO:teuthology.misc.health.smithi026.stdout: 2023-10-01T07:51:42.962 INFO:teuthology.misc.health.smithi026.stdout:{"epoch":6,"fsid":"c29fb19d-520c-42a6-90f4-e7f86de96e8e","created":"2023-10-01T07:51:40.702414+0000","modified":"2023-10-01T07:51:42.084736+0000","last_up_change":"0.000000","last_in_change":"2023-10-01T07:51:42.084736+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"46569ce3-81d1-44a1-a649-691de3e6f808","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1fc1ba9b-4110-4d31-96d6-794937578cff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"37de933d-3b8e-4b94-87bd-2f36896c7ff5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"bd020309-5fd2-4d97-b36a-67e159fa3ebf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-01T07:51:42.963 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.962+0000 7f3fe41e8700 1 -- 172.21.15.26:0/2606241367 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fdc0940e0 msgr2=0x7f3fdc091a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:42.963 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.962+0000 7f3fe41e8700 1 --2- 172.21.15.26:0/2606241367 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fdc0940e0 0x7f3fdc091a10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f3fd000ea00 tx=0x7f3fd0009060).stop 2023-10-01T07:51:42.963 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.962+0000 7f3fe41e8700 1 -- 172.21.15.26:0/2606241367 shutdown_connections 2023-10-01T07:51:42.963 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.962+0000 7f3fe41e8700 1 --2- 172.21.15.26:0/2606241367 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3fdc125d60 0x7f3fdc091f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:42.963 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.962+0000 7f3fe41e8700 1 --2- 172.21.15.26:0/2606241367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fdc0629b0 0x7f3fdc117c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:42.963 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.962+0000 7f3fe41e8700 1 --2- 172.21.15.26:0/2606241367 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fdc0940e0 0x7f3fdc091a10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:42.963 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.962+0000 7f3fe41e8700 1 -- 172.21.15.26:0/2606241367 >> 172.21.15.26:0/2606241367 conn(0x7f3fdc09ab90 msgr2=0x7f3fdc128ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:42.963 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.962+0000 7f3fe41e8700 1 -- 172.21.15.26:0/2606241367 shutdown_connections 2023-10-01T07:51:42.964 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:42.962+0000 7f3fe41e8700 1 -- 172.21.15.26:0/2606241367 wait complete. 2023-10-01T07:51:42.974 DEBUG:teuthology.misc:0 of 4 OSDs are up 2023-10-01T07:51:42.979 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:51:42.979+0000 7f923f052680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-01T07:51:43.178 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:51:43.178+0000 7f923f052680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-01T07:51:43.252 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:51:43.251+0000 7f923f052680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-01T07:51:43.339 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:51:43.339+0000 7f923f052680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-01T07:51:43.417 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:51:43.417+0000 7f923f052680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-01T07:51:43.815 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:51:43.815+0000 7f923f052680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-01T07:51:43.911 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:51:43.910+0000 7f923f052680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-01T07:51:44.638 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:51:44.637+0000 7f923f052680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-01T07:51:44.716 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:51:44.716+0000 7f923f052680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-01T07:51:44.804 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:51:44.804+0000 7f923f052680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-01T07:51:45.136 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:51:45.136+0000 7f923f052680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-01T07:51:45.221 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:51:45.221+0000 7f923f052680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-01T07:51:45.362 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:51:45.362+0000 7f923f052680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-01T07:51:45.492 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:51:45.492+0000 7f923f052680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-01T07:51:45.707 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:51:45.706+0000 7f923f052680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-01T07:51:45.786 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:51:45.785+0000 7f923f052680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-01T07:51:45.999 INFO:tasks.ceph.osd.0.smithi026.stderr:2023-10-01T07:51:45.998+0000 7fc681802200 -1 osd.0 0 log_to_monitors {default=true} 2023-10-01T07:51:46.244 INFO:tasks.ceph.osd.2.smithi026.stderr:2023-10-01T07:51:46.243+0000 7f300d9c6200 -1 osd.2 0 log_to_monitors {default=true} 2023-10-01T07:51:46.266 INFO:tasks.ceph.osd.3.smithi026.stderr:2023-10-01T07:51:46.266+0000 7f25d24a6200 -1 osd.3 0 log_to_monitors {default=true} 2023-10-01T07:51:46.267 INFO:tasks.ceph.osd.1.smithi026.stderr:2023-10-01T07:51:46.267+0000 7fd7bd753200 -1 osd.1 0 log_to_monitors {default=true} 2023-10-01T07:51:46.809 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:51:46.809+0000 7f91f5a8f700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-01T07:51:46.809 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:51:46.809+0000 7f91f5a8f700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-01T07:51:47.854 INFO:tasks.ceph.osd.0.smithi026.stderr:2023-10-01T07:51:47.854+0000 7fc6781a3700 -1 osd.0 0 waiting for initial osdmap 2023-10-01T07:51:47.855 INFO:tasks.ceph.osd.3.smithi026.stderr:2023-10-01T07:51:47.854+0000 7f25c8e47700 -1 osd.3 0 waiting for initial osdmap 2023-10-01T07:51:47.855 INFO:tasks.ceph.osd.1.smithi026.stderr:2023-10-01T07:51:47.854+0000 7fd7b40f4700 -1 osd.1 0 waiting for initial osdmap 2023-10-01T07:51:47.856 INFO:tasks.ceph.osd.2.smithi026.stderr:2023-10-01T07:51:47.856+0000 7f3004367700 -1 osd.2 0 waiting for initial osdmap 2023-10-01T07:51:47.860 INFO:tasks.ceph.osd.0.smithi026.stderr:2023-10-01T07:51:47.859+0000 7fc67491f700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-01T07:51:47.860 INFO:tasks.ceph.osd.1.smithi026.stderr:2023-10-01T07:51:47.859+0000 7fd7b0870700 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-01T07:51:47.861 INFO:tasks.ceph.osd.2.smithi026.stderr:2023-10-01T07:51:47.861+0000 7f3000ae3700 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-01T07:51:47.861 INFO:tasks.ceph.osd.3.smithi026.stderr:2023-10-01T07:51:47.861+0000 7f25c55c3700 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-01T07:51:49.377 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-01T07:51:49.505 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.504+0000 7f8e93ee2700 1 Processor -- start 2023-10-01T07:51:49.505 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.505+0000 7f8e93ee2700 1 -- start start 2023-10-01T07:51:49.507 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.505+0000 7f8e93ee2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e8c094a60 0x7f8e8c0958e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:49.508 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.505+0000 7f8e93ee2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8e8c095dd0 0x7f8e8c0961d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:49.508 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.505+0000 7f8e93ee2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e8c096d40 con 0x7f8e8c12c1c0 2023-10-01T07:51:49.508 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.505+0000 7f8e93ee2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e8c094e40 con 0x7f8e8c095dd0 2023-10-01T07:51:49.508 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.505+0000 7f8e93ee2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c091b90 con 0x7f8e8c094a60 2023-10-01T07:51:49.508 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.505+0000 7f8e91c7e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e8c094a60 0x7f8e8c0958e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:49.508 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.505+0000 7f8e91c7e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e8c094a60 0x7f8e8c0958e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:49848/0 (socket says 172.21.15.26:49848) 2023-10-01T07:51:49.508 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.505+0000 7f8e91c7e700 1 -- 172.21.15.26:0/1559497155 learned_addr learned my addr 172.21.15.26:0/1559497155 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:49.508 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.505+0000 7f8e9147d700 1 --2- 172.21.15.26:0/1559497155 >> v2:172.21.15.26:3300/0 conn(0x7f8e8c095dd0 0x7f8e8c0961d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:49.508 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.506+0000 7f8e91c7e700 1 -- 172.21.15.26:0/1559497155 >> v2:172.21.15.26:3300/0 conn(0x7f8e8c095dd0 msgr2=0x7f8e8c0961d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:51:49.508 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.506+0000 7f8e91c7e700 1 --2- 172.21.15.26:0/1559497155 >> v2:172.21.15.26:3300/0 conn(0x7f8e8c095dd0 0x7f8e8c0961d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:49.509 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.506+0000 7f8e91c7e700 1 -- 172.21.15.26:0/1559497155 >> v1:172.21.15.26:6789/0 conn(0x7f8e8c12c1c0 legacy=0x7f8e8c12e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:49.509 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.506+0000 7f8e91c7e700 1 -- 172.21.15.26:0/1559497155 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8c0934f0 con 0x7f8e8c094a60 2023-10-01T07:51:49.509 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.506+0000 7f8e9147d700 1 --2- 172.21.15.26:0/1559497155 >> v2:172.21.15.26:3300/0 conn(0x7f8e8c095dd0 0x7f8e8c0961d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:49.509 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.506+0000 7f8e90c7c700 1 -- 172.21.15.26:0/1559497155 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4104574431 0 0) 0x7f8e8c096d40 con 0x7f8e8c12c1c0 2023-10-01T07:51:49.509 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.506+0000 7f8e91c7e700 1 --2- 172.21.15.26:0/1559497155 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e8c094a60 0x7f8e8c0958e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f8e88006fd0 tx=0x7f8e8800b3b0).ready entity=mon.1 client_cookie=4348364966a857b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:49.509 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.506+0000 7f8e90c7c700 1 -- 172.21.15.26:0/1559497155 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8800da70 con 0x7f8e8c094a60 2023-10-01T07:51:49.509 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.506+0000 7f8e90c7c700 1 -- 172.21.15.26:0/1559497155 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8800dbd0 con 0x7f8e8c094a60 2023-10-01T07:51:49.509 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.506+0000 7f8e90c7c700 1 -- 172.21.15.26:0/1559497155 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e88010470 con 0x7f8e8c094a60 2023-10-01T07:51:49.509 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.507+0000 7f8e93ee2700 1 -- 172.21.15.26:0/1559497155 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e8c094a60 msgr2=0x7f8e8c0958e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:49.509 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.507+0000 7f8e93ee2700 1 --2- 172.21.15.26:0/1559497155 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e8c094a60 0x7f8e8c0958e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f8e88006fd0 tx=0x7f8e8800b3b0).stop 2023-10-01T07:51:49.509 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.507+0000 7f8e93ee2700 1 -- 172.21.15.26:0/1559497155 shutdown_connections 2023-10-01T07:51:49.509 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.507+0000 7f8e93ee2700 1 --2- 172.21.15.26:0/1559497155 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e8c094a60 0x7f8e8c0958e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:49.510 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.507+0000 7f8e93ee2700 1 --2- 172.21.15.26:0/1559497155 >> v2:172.21.15.26:3300/0 conn(0x7f8e8c095dd0 0x7f8e8c0961d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:49.510 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.507+0000 7f8e93ee2700 1 -- 172.21.15.26:0/1559497155 >> 172.21.15.26:0/1559497155 conn(0x7f8e8c09ab90 msgr2=0x7f8e8c09afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:49.510 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.507+0000 7f8e93ee2700 1 -- 172.21.15.26:0/1559497155 shutdown_connections 2023-10-01T07:51:49.510 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.507+0000 7f8e93ee2700 1 -- 172.21.15.26:0/1559497155 wait complete. 2023-10-01T07:51:49.512 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.508+0000 7f8e93ee2700 1 Processor -- start 2023-10-01T07:51:49.512 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.508+0000 7f8e93ee2700 1 -- start start 2023-10-01T07:51:49.512 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.508+0000 7f8e93ee2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e8c094a60 0x7f8e8c1161a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:49.512 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.508+0000 7f8e93ee2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e8c095dd0 0x7f8e8c116690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:49.512 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.508+0000 7f8e93ee2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e8c12c1c0 0x7f8e8c116b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:49.512 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.508+0000 7f8e93ee2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c1187c0 con 0x7f8e8c094a60 2023-10-01T07:51:49.513 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.508+0000 7f8e93ee2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c099b10 con 0x7f8e8c095dd0 2023-10-01T07:51:49.513 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.508+0000 7f8e93ee2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c0924d0 con 0x7f8e8c12c1c0 2023-10-01T07:51:49.513 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.508+0000 7f8e9147d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e8c095dd0 0x7f8e8c116690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:49.513 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.508+0000 7f8e9147d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e8c095dd0 0x7f8e8c116690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:49856/0 (socket says 172.21.15.26:49856) 2023-10-01T07:51:49.513 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.508+0000 7f8e9247f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e8c12c1c0 0x7f8e8c116b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:49.513 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.508+0000 7f8e9147d700 1 -- 172.21.15.26:0/2393318984 learned_addr learned my addr 172.21.15.26:0/2393318984 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:49.513 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.508+0000 7f8e91c7e700 1 --2- 172.21.15.26:0/2393318984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e8c094a60 0x7f8e8c1161a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:49.513 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.509+0000 7f8e9147d700 1 -- 172.21.15.26:0/2393318984 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e8c12c1c0 msgr2=0x7f8e8c116b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:49.513 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.509+0000 7f8e9147d700 1 --2- 172.21.15.26:0/2393318984 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e8c12c1c0 0x7f8e8c116b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:49.513 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.509+0000 7f8e9147d700 1 -- 172.21.15.26:0/2393318984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e8c094a60 msgr2=0x7f8e8c1161a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:49.513 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.509+0000 7f8e9147d700 1 --2- 172.21.15.26:0/2393318984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e8c094a60 0x7f8e8c1161a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:49.513 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.509+0000 7f8e9147d700 1 -- 172.21.15.26:0/2393318984 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e7c0092a0 con 0x7f8e8c095dd0 2023-10-01T07:51:49.513 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.509+0000 7f8e9147d700 1 --2- 172.21.15.26:0/2393318984 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e8c095dd0 0x7f8e8c116690 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f8e7c00ea00 tx=0x7f8e7c009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:49.514 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.509+0000 7f8e81ffb700 1 -- 172.21.15.26:0/2393318984 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c009600 con 0x7f8e8c095dd0 2023-10-01T07:51:49.514 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.509+0000 7f8e81ffb700 1 -- 172.21.15.26:0/2393318984 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7c00c6a0 con 0x7f8e8c095dd0 2023-10-01T07:51:49.514 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.509+0000 7f8e93ee2700 1 -- 172.21.15.26:0/2393318984 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e8800b610 con 0x7f8e8c095dd0 2023-10-01T07:51:49.514 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.509+0000 7f8e81ffb700 1 -- 172.21.15.26:0/2393318984 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c00ca20 con 0x7f8e8c095dd0 2023-10-01T07:51:49.514 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.509+0000 7f8e93ee2700 1 -- 172.21.15.26:0/2393318984 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e8c117d80 con 0x7f8e8c095dd0 2023-10-01T07:51:49.514 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.510+0000 7f8e81ffb700 1 -- 172.21.15.26:0/2393318984 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f8e7c00cd90 con 0x7f8e8c095dd0 2023-10-01T07:51:49.514 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.510+0000 7f8e81ffb700 1 -- 172.21.15.26:0/2393318984 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 2069+0+0 (secure 0 0 0) 0x7f8e7c03ade0 con 0x7f8e8c095dd0 2023-10-01T07:51:49.514 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.510+0000 7f8e93ee2700 1 -- 172.21.15.26:0/2393318984 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e8c098280 con 0x7f8e8c095dd0 2023-10-01T07:51:49.515 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.515+0000 7f8e81ffb700 1 -- 172.21.15.26:0/2393318984 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f8e7c016070 con 0x7f8e8c095dd0 2023-10-01T07:51:49.691 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.690+0000 7f8e93ee2700 1 -- 172.21.15.26:0/2393318984 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e8c05a260 con 0x7f8e8c095dd0 2023-10-01T07:51:49.691 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.691+0000 7f8e81ffb700 1 -- 172.21.15.26:0/2393318984 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) v1 ==== 74+0+4936 (secure 0 0 0) 0x7f8e7c016020 con 0x7f8e8c095dd0 2023-10-01T07:51:49.692 INFO:teuthology.misc.health.smithi026.stdout: 2023-10-01T07:51:49.692 INFO:teuthology.misc.health.smithi026.stdout:{"epoch":9,"fsid":"c29fb19d-520c-42a6-90f4-e7f86de96e8e","created":"2023-10-01T07:51:40.702414+0000","modified":"2023-10-01T07:51:48.849482+0000","last_up_change":"2023-10-01T07:51:48.849482+0000","last_in_change":"2023-10-01T07:51:42.084736+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"46569ce3-81d1-44a1-a649-691de3e6f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6800","nonce":118773}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6801","nonce":118773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6803","nonce":118773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6802","nonce":118773}]},"public_addr":"172.21.15.26:6800/118773","cluster_addr":"172.21.15.26:6801/118773","heartbeat_back_addr":"172.21.15.26:6803/118773","heartbeat_front_addr":"172.21.15.26:6802/118773","state":["exists","up"]},{"osd":1,"uuid":"1fc1ba9b-4110-4d31-96d6-794937578cff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6804","nonce":118782}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6806","nonce":118782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6810","nonce":118782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6808","nonce":118782}]},"public_addr":"172.21.15.26:6804/118782","cluster_addr":"172.21.15.26:6806/118782","heartbeat_back_addr":"172.21.15.26:6810/118782","heartbeat_front_addr":"172.21.15.26:6808/118782","state":["exists","up"]},{"osd":2,"uuid":"37de933d-3b8e-4b94-87bd-2f36896c7ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6805","nonce":118789}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6807","nonce":118789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6811","nonce":118789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6809","nonce":118789}]},"public_addr":"172.21.15.26:6805/118789","cluster_addr":"172.21.15.26:6807/118789","heartbeat_back_addr":"172.21.15.26:6811/118789","heartbeat_front_addr":"172.21.15.26:6809/118789","state":["exists","up"]},{"osd":3,"uuid":"bd020309-5fd2-4d97-b36a-67e159fa3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6812","nonce":118790}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6813","nonce":118790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6815","nonce":118790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6814","nonce":118790}]},"public_addr":"172.21.15.26:6812/118790","cluster_addr":"172.21.15.26:6813/118790","heartbeat_back_addr":"172.21.15.26:6815/118790","heartbeat_front_addr":"172.21.15.26:6814/118790","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-01T07:51:49.694 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.693+0000 7f8e93ee2700 1 -- 172.21.15.26:0/2393318984 >> v1:172.21.15.26:6816/118178 conn(0x7f8e7002bb60 legacy=0x7f8e7002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:49.694 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.693+0000 7f8e93ee2700 1 -- 172.21.15.26:0/2393318984 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e8c095dd0 msgr2=0x7f8e8c116690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:49.694 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.693+0000 7f8e93ee2700 1 --2- 172.21.15.26:0/2393318984 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e8c095dd0 0x7f8e8c116690 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f8e7c00ea00 tx=0x7f8e7c009060).stop 2023-10-01T07:51:49.695 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.693+0000 7f8e93ee2700 1 -- 172.21.15.26:0/2393318984 shutdown_connections 2023-10-01T07:51:49.695 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.693+0000 7f8e93ee2700 1 --2- 172.21.15.26:0/2393318984 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e8c12c1c0 0x7f8e8c116b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:49.695 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.693+0000 7f8e93ee2700 1 --2- 172.21.15.26:0/2393318984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e8c094a60 0x7f8e8c1161a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:49.695 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.693+0000 7f8e93ee2700 1 --2- 172.21.15.26:0/2393318984 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e8c095dd0 0x7f8e8c116690 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:49.695 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.693+0000 7f8e93ee2700 1 -- 172.21.15.26:0/2393318984 >> 172.21.15.26:0/2393318984 conn(0x7f8e8c09ab90 msgr2=0x7f8e8c068e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:49.695 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.693+0000 7f8e93ee2700 1 -- 172.21.15.26:0/2393318984 shutdown_connections 2023-10-01T07:51:49.695 INFO:teuthology.misc.health.smithi026.stderr:2023-10-01T07:51:49.693+0000 7f8e93ee2700 1 -- 172.21.15.26:0/2393318984 wait complete. 2023-10-01T07:51:49.706 DEBUG:teuthology.misc:4 of 4 OSDs are up 2023-10-01T07:51:49.706 INFO:tasks.ceph:Creating RBD pool 2023-10-01T07:51:49.706 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-01T07:51:49.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.835+0000 7efe3530a700 1 Processor -- start 2023-10-01T07:51:49.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.835+0000 7efe3530a700 1 -- start start 2023-10-01T07:51:49.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.836+0000 7efe3530a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe3012add0 0x7efe30097420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:49.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.836+0000 7efe3530a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efe3012fd70 0x7efe30132160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:49.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.836+0000 7efe3530a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe30064e00 con 0x7efe30066110 2023-10-01T07:51:49.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.836+0000 7efe3530a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe300664f0 con 0x7efe3012fd70 2023-10-01T07:51:49.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.836+0000 7efe3530a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe30065d80 con 0x7efe3012add0 2023-10-01T07:51:49.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.836+0000 7efe2f7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efe3012fd70 0x7efe30132160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:49.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.836+0000 7efe2effd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7efe30066110 0x7efe3012b2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35400/0 (socket says 172.21.15.26:35400) 2023-10-01T07:51:49.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.836+0000 7efe2e7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe3012add0 0x7efe30097420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:49.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.836+0000 7efe2effd700 1 -- 172.21.15.26:0/2401312812 learned_addr learned my addr 172.21.15.26:0/2401312812 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:51:49.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.836+0000 7efe2e7fc700 1 -- 172.21.15.26:0/2401312812 >> v2:172.21.15.26:3300/0 conn(0x7efe3012fd70 msgr2=0x7efe30132160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:51:49.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.836+0000 7efe2e7fc700 1 --2- 172.21.15.26:0/2401312812 >> v2:172.21.15.26:3300/0 conn(0x7efe3012fd70 0x7efe30132160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:49.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.836+0000 7efe2e7fc700 1 -- 172.21.15.26:0/2401312812 >> v1:172.21.15.26:6789/0 conn(0x7efe30066110 legacy=0x7efe3012b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:49.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.836+0000 7efe2e7fc700 1 -- 172.21.15.26:0/2401312812 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe30065910 con 0x7efe3012add0 2023-10-01T07:51:49.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.836+0000 7efe2e7fc700 1 --2- 172.21.15.26:0/2401312812 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe3012add0 0x7efe30097420 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7efe18009760 tx=0x7efe18009060).ready entity=mon.1 client_cookie=3ec4e5e1e68ddd03 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:49.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.836+0000 7efe2dffb700 1 -- 172.21.15.26:0/2401312812 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe180090d0 con 0x7efe3012add0 2023-10-01T07:51:49.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.837+0000 7efe2dffb700 1 -- 172.21.15.26:0/2401312812 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1800f510 con 0x7efe3012add0 2023-10-01T07:51:49.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.837+0000 7efe2dffb700 1 -- 172.21.15.26:0/2401312812 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1800f890 con 0x7efe3012add0 2023-10-01T07:51:49.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.837+0000 7efe3530a700 1 -- 172.21.15.26:0/2401312812 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe3012add0 msgr2=0x7efe30097420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:49.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.837+0000 7efe3530a700 1 --2- 172.21.15.26:0/2401312812 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe3012add0 0x7efe30097420 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7efe18009760 tx=0x7efe18009060).stop 2023-10-01T07:51:49.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.837+0000 7efe3530a700 1 -- 172.21.15.26:0/2401312812 shutdown_connections 2023-10-01T07:51:49.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.837+0000 7efe3530a700 1 --2- 172.21.15.26:0/2401312812 >> v2:172.21.15.26:3300/0 conn(0x7efe3012fd70 0x7efe30132160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:49.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.837+0000 7efe3530a700 1 --2- 172.21.15.26:0/2401312812 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe3012add0 0x7efe30097420 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:49.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.837+0000 7efe3530a700 1 -- 172.21.15.26:0/2401312812 >> 172.21.15.26:0/2401312812 conn(0x7efe3009ba60 msgr2=0x7efe3009be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:49.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.837+0000 7efe3530a700 1 -- 172.21.15.26:0/2401312812 shutdown_connections 2023-10-01T07:51:49.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.837+0000 7efe3530a700 1 -- 172.21.15.26:0/2401312812 wait complete. 2023-10-01T07:51:49.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.838+0000 7efe3530a700 1 Processor -- start 2023-10-01T07:51:49.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.838+0000 7efe3530a700 1 -- start start 2023-10-01T07:51:49.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.839+0000 7efe3530a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe30066110 0x7efe3012bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:49.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.839+0000 7efe3530a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe3012add0 0x7efe3012c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:49.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.839+0000 7efe3530a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe3012fd70 0x7efe3012c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:49.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.839+0000 7efe3530a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3012ca10 con 0x7efe3012fd70 2023-10-01T07:51:49.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.839+0000 7efe3530a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe3012ccd0 con 0x7efe3012add0 2023-10-01T07:51:49.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.839+0000 7efe3530a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe3012d700 con 0x7efe30066110 2023-10-01T07:51:49.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.839+0000 7efe2f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe3012fd70 0x7efe3012c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:49.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.839+0000 7efe2e7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe3012add0 0x7efe3012c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:49.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.839+0000 7efe2effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe30066110 0x7efe3012bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:49.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.839+0000 7efe2f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe3012fd70 0x7efe3012c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50942/0 (socket says 172.21.15.26:50942) 2023-10-01T07:51:49.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.839+0000 7efe2f7fe700 1 -- 172.21.15.26:0/3897863760 learned_addr learned my addr 172.21.15.26:0/3897863760 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:49.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.839+0000 7efe2e7fc700 1 -- 172.21.15.26:0/3897863760 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe30066110 msgr2=0x7efe3012bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:49.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.839+0000 7efe2e7fc700 1 --2- 172.21.15.26:0/3897863760 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe30066110 0x7efe3012bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:49.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.839+0000 7efe2e7fc700 1 -- 172.21.15.26:0/3897863760 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe3012fd70 msgr2=0x7efe3012c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:49.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.839+0000 7efe2e7fc700 1 --2- 172.21.15.26:0/3897863760 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe3012fd70 0x7efe3012c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:49.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.839+0000 7efe2e7fc700 1 -- 172.21.15.26:0/3897863760 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe180092a0 con 0x7efe3012add0 2023-10-01T07:51:49.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.839+0000 7efe2f7fe700 1 --2- 172.21.15.26:0/3897863760 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe3012fd70 0x7efe3012c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:49.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.839+0000 7efe2e7fc700 1 --2- 172.21.15.26:0/3897863760 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe3012add0 0x7efe3012c030 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7efe18014000 tx=0x7efe18017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:49.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.840+0000 7efe26ffd700 1 -- 172.21.15.26:0/3897863760 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1800fea0 con 0x7efe3012add0 2023-10-01T07:51:49.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.840+0000 7efe26ffd700 1 -- 172.21.15.26:0/3897863760 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe18006930 con 0x7efe3012add0 2023-10-01T07:51:49.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.840+0000 7efe3530a700 1 -- 172.21.15.26:0/3897863760 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe3012f750 con 0x7efe3012add0 2023-10-01T07:51:49.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.840+0000 7efe26ffd700 1 -- 172.21.15.26:0/3897863760 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1800f8d0 con 0x7efe3012add0 2023-10-01T07:51:49.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.840+0000 7efe3530a700 1 -- 172.21.15.26:0/3897863760 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe3012eb70 con 0x7efe3012add0 2023-10-01T07:51:49.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.840+0000 7efe26ffd700 1 -- 172.21.15.26:0/3897863760 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7efe1801b620 con 0x7efe3012add0 2023-10-01T07:51:49.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.841+0000 7efe26ffd700 1 -- 172.21.15.26:0/3897863760 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 2069+0+0 (secure 0 0 0) 0x7efe1803c1a0 con 0x7efe3012add0 2023-10-01T07:51:49.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.841+0000 7efe3530a700 1 -- 172.21.15.26:0/3897863760 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe3005a260 con 0x7efe3012add0 2023-10-01T07:51:49.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:49.845+0000 7efe26ffd700 1 -- 172.21.15.26:0/3897863760 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7efe1801f020 con 0x7efe3012add0 2023-10-01T07:51:50.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:50.023+0000 7efe3530a700 1 -- 172.21.15.26:0/3897863760 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7efe30046c20 con 0x7efe3012add0 2023-10-01T07:51:50.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:50.864+0000 7efe26ffd700 1 -- 172.21.15.26:0/3897863760 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v11) v1 ==== 109+0+0 (secure 0 0 0) 0x7efe180193c0 con 0x7efe3012add0 2023-10-01T07:51:50.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:50.868+0000 7efe3530a700 1 -- 172.21.15.26:0/3897863760 >> v1:172.21.15.26:6816/118178 conn(0x7efe1002bb60 legacy=0x7efe1002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:50.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:50.868+0000 7efe3530a700 1 -- 172.21.15.26:0/3897863760 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe3012add0 msgr2=0x7efe3012c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:50.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:50.868+0000 7efe3530a700 1 --2- 172.21.15.26:0/3897863760 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe3012add0 0x7efe3012c030 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7efe18014000 tx=0x7efe18017000).stop 2023-10-01T07:51:50.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:50.870+0000 7efe3530a700 1 -- 172.21.15.26:0/3897863760 shutdown_connections 2023-10-01T07:51:50.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:50.870+0000 7efe3530a700 1 --2- 172.21.15.26:0/3897863760 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe3012fd70 0x7efe3012c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:50.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:50.870+0000 7efe3530a700 1 --2- 172.21.15.26:0/3897863760 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe30066110 0x7efe3012bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:50.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:50.870+0000 7efe3530a700 1 --2- 172.21.15.26:0/3897863760 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe3012add0 0x7efe3012c030 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:50.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:50.870+0000 7efe3530a700 1 -- 172.21.15.26:0/3897863760 >> 172.21.15.26:0/3897863760 conn(0x7efe3009ba60 msgr2=0x7efe30129670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:50.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:50.870+0000 7efe3530a700 1 -- 172.21.15.26:0/3897863760 shutdown_connections 2023-10-01T07:51:50.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:50.870+0000 7efe3530a700 1 -- 172.21.15.26:0/3897863760 wait complete. 2023-10-01T07:51:50.873 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'rbd' created 2023-10-01T07:51:50.887 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-01T07:51:51.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.022+0000 7f03c4ed3700 1 Processor -- start 2023-10-01T07:51:51.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.022+0000 7f03c4ed3700 1 -- start start 2023-10-01T07:51:51.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.023+0000 7f03c4ed3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03c0097470 0x7f03c0125710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:51.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.023+0000 7f03c4ed3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f03c0125c00 0x7f03c0126040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:51.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.023+0000 7f03c4ed3700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c00615b0 con 0x7f03c0128960 2023-10-01T07:51:51.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.023+0000 7f03c4ed3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c0097850 con 0x7f03c0125c00 2023-10-01T07:51:51.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.023+0000 7f03c4ed3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03c00903e0 con 0x7f03c0097470 2023-10-01T07:51:51.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.023+0000 7f03be59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03c0097470 0x7f03c0125710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:51.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.023+0000 7f03bdd9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f03c0125c00 0x7f03c0126040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:51.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.023+0000 7f03be59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03c0097470 0x7f03c0125710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35840/0 (socket says 172.21.15.26:35840) 2023-10-01T07:51:51.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.023+0000 7f03be59c700 1 -- 172.21.15.26:0/1234045848 learned_addr learned my addr 172.21.15.26:0/1234045848 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:51.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.023+0000 7f03bed9d700 1 --1- 172.21.15.26:0/1234045848 >> v1:172.21.15.26:6789/0 conn(0x7f03c0128960 0x7f03c0128e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35414/0 (socket says 172.21.15.26:35414) 2023-10-01T07:51:51.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.023+0000 7f03be59c700 1 -- 172.21.15.26:0/1234045848 >> v2:172.21.15.26:3300/0 conn(0x7f03c0125c00 msgr2=0x7f03c0126040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:51:51.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.023+0000 7f03be59c700 1 --2- 172.21.15.26:0/1234045848 >> v2:172.21.15.26:3300/0 conn(0x7f03c0125c00 0x7f03c0126040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:51.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.023+0000 7f03be59c700 1 -- 172.21.15.26:0/1234045848 >> v1:172.21.15.26:6789/0 conn(0x7f03c0128960 legacy=0x7f03c0128e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:51.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.023+0000 7f03be59c700 1 -- 172.21.15.26:0/1234045848 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c0090740 con 0x7f03c0097470 2023-10-01T07:51:51.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.023+0000 7f03bdd9b700 1 --2- 172.21.15.26:0/1234045848 >> v2:172.21.15.26:3300/0 conn(0x7f03c0125c00 0x7f03c0126040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:51.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.024+0000 7f03be59c700 1 --2- 172.21.15.26:0/1234045848 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03c0097470 0x7f03c0125710 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f03b0009810 tx=0x7f03b0009060).ready entity=mon.2 client_cookie=b6b0b3d0bb1ab600 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:51.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.024+0000 7f03bd59a700 1 -- 172.21.15.26:0/1234045848 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b0005880 con 0x7f03c0097470 2023-10-01T07:51:51.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.024+0000 7f03bd59a700 1 -- 172.21.15.26:0/1234045848 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b00059e0 con 0x7f03c0097470 2023-10-01T07:51:51.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.024+0000 7f03bd59a700 1 -- 172.21.15.26:0/1234045848 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b0005d60 con 0x7f03c0097470 2023-10-01T07:51:51.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.024+0000 7f03c4ed3700 1 -- 172.21.15.26:0/1234045848 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03c0097470 msgr2=0x7f03c0125710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:51.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.024+0000 7f03c4ed3700 1 --2- 172.21.15.26:0/1234045848 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03c0097470 0x7f03c0125710 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f03b0009810 tx=0x7f03b0009060).stop 2023-10-01T07:51:51.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.024+0000 7f03c4ed3700 1 -- 172.21.15.26:0/1234045848 shutdown_connections 2023-10-01T07:51:51.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.024+0000 7f03c4ed3700 1 --2- 172.21.15.26:0/1234045848 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03c0097470 0x7f03c0125710 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:51.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.024+0000 7f03c4ed3700 1 --2- 172.21.15.26:0/1234045848 >> v2:172.21.15.26:3300/0 conn(0x7f03c0125c00 0x7f03c0126040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:51.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.024+0000 7f03c4ed3700 1 -- 172.21.15.26:0/1234045848 >> 172.21.15.26:0/1234045848 conn(0x7f03c009ab00 msgr2=0x7f03c0096b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:51.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.024+0000 7f03c4ed3700 1 -- 172.21.15.26:0/1234045848 shutdown_connections 2023-10-01T07:51:51.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.025+0000 7f03c4ed3700 1 -- 172.21.15.26:0/1234045848 wait complete. 2023-10-01T07:51:51.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.025+0000 7f03c4ed3700 1 Processor -- start 2023-10-01T07:51:51.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.025+0000 7f03c4ed3700 1 -- start start 2023-10-01T07:51:51.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.026+0000 7f03c4ed3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03c0097470 0x7f03c0121ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:51.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.026+0000 7f03c4ed3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03c0125c00 0x7f03c0065d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:51.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.026+0000 7f03c4ed3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03c0128960 0x7f03c00661f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:51.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.026+0000 7f03c4ed3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c0068de0 con 0x7f03c0128960 2023-10-01T07:51:51.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.026+0000 7f03c4ed3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c00909e0 con 0x7f03c0097470 2023-10-01T07:51:51.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.026+0000 7f03c4ed3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03c00683f0 con 0x7f03c0125c00 2023-10-01T07:51:51.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.026+0000 7f03bdd9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03c0125c00 0x7f03c0065d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:51.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.026+0000 7f03be59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03c0097470 0x7f03c0121ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:51.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.026+0000 7f03bdd9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03c0125c00 0x7f03c0065d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35842/0 (socket says 172.21.15.26:35842) 2023-10-01T07:51:51.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.026+0000 7f03bdd9b700 1 -- 172.21.15.26:0/102759390 learned_addr learned my addr 172.21.15.26:0/102759390 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:51.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.026+0000 7f03bed9d700 1 --2- 172.21.15.26:0/102759390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03c0128960 0x7f03c00661f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:51.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.026+0000 7f03bdd9b700 1 -- 172.21.15.26:0/102759390 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03c0097470 msgr2=0x7f03c0121ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:51.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.026+0000 7f03bdd9b700 1 --2- 172.21.15.26:0/102759390 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03c0097470 0x7f03c0121ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:51.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.026+0000 7f03bdd9b700 1 -- 172.21.15.26:0/102759390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03c0128960 msgr2=0x7f03c00661f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:51.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.026+0000 7f03bdd9b700 1 --2- 172.21.15.26:0/102759390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03c0128960 0x7f03c00661f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:51.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.026+0000 7f03bdd9b700 1 -- 172.21.15.26:0/102759390 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a80092a0 con 0x7f03c0125c00 2023-10-01T07:51:51.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.026+0000 7f03bed9d700 1 --2- 172.21.15.26:0/102759390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03c0128960 0x7f03c00661f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:51.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.027+0000 7f03bdd9b700 1 --2- 172.21.15.26:0/102759390 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03c0125c00 0x7f03c0065d00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f03a800e9d0 tx=0x7f03a8009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:51.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.027+0000 7f03b67fc700 1 -- 172.21.15.26:0/102759390 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a800c6a0 con 0x7f03c0125c00 2023-10-01T07:51:51.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.027+0000 7f03b67fc700 1 -- 172.21.15.26:0/102759390 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a800c800 con 0x7f03c0125c00 2023-10-01T07:51:51.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.027+0000 7f03c4ed3700 1 -- 172.21.15.26:0/102759390 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03b0009300 con 0x7f03c0125c00 2023-10-01T07:51:51.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.027+0000 7f03b67fc700 1 -- 172.21.15.26:0/102759390 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a800cb80 con 0x7f03c0125c00 2023-10-01T07:51:51.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.027+0000 7f03c4ed3700 1 -- 172.21.15.26:0/102759390 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c0068110 con 0x7f03c0125c00 2023-10-01T07:51:51.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.028+0000 7f03b67fc700 1 -- 172.21.15.26:0/102759390 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f03a801b400 con 0x7f03c0125c00 2023-10-01T07:51:51.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.028+0000 7f03b67fc700 1 -- 172.21.15.26:0/102759390 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2827+0+0 (secure 0 0 0) 0x7f03a803b1a0 con 0x7f03c0125c00 2023-10-01T07:51:51.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.028+0000 7f03c4ed3700 1 -- 172.21.15.26:0/102759390 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c0122e30 con 0x7f03c0125c00 2023-10-01T07:51:51.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.033+0000 7f03b67fc700 1 -- 172.21.15.26:0/102759390 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f03a8016070 con 0x7f03c0125c00 2023-10-01T07:51:51.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.208+0000 7f03c4ed3700 1 -- 172.21.15.26:0/102759390 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f03c005a260 con 0x7f03c0125c00 2023-10-01T07:51:51.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.875+0000 7f03b67fc700 1 -- 172.21.15.26:0/102759390 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v12) v1 ==== 173+0+0 (secure 0 0 0) 0x7f03a80290c0 con 0x7f03c0125c00 2023-10-01T07:51:51.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.880+0000 7f03c4ed3700 1 -- 172.21.15.26:0/102759390 >> v1:172.21.15.26:6816/118178 conn(0x7f03a002bb60 legacy=0x7f03a002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:51.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.880+0000 7f03c4ed3700 1 -- 172.21.15.26:0/102759390 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03c0125c00 msgr2=0x7f03c0065d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:51.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.880+0000 7f03c4ed3700 1 --2- 172.21.15.26:0/102759390 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03c0125c00 0x7f03c0065d00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f03a800e9d0 tx=0x7f03a8009060).stop 2023-10-01T07:51:51.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.881+0000 7f03c4ed3700 1 -- 172.21.15.26:0/102759390 shutdown_connections 2023-10-01T07:51:51.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.881+0000 7f03c4ed3700 1 --2- 172.21.15.26:0/102759390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03c0128960 0x7f03c00661f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:51.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.881+0000 7f03c4ed3700 1 --2- 172.21.15.26:0/102759390 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03c0097470 0x7f03c0121ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:51.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.881+0000 7f03c4ed3700 1 --2- 172.21.15.26:0/102759390 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03c0125c00 0x7f03c0065d00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:51.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.881+0000 7f03c4ed3700 1 -- 172.21.15.26:0/102759390 >> 172.21.15.26:0/102759390 conn(0x7f03c009ab00 msgr2=0x7f03c0093480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:51.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.882+0000 7f03c4ed3700 1 -- 172.21.15.26:0/102759390 shutdown_connections 2023-10-01T07:51:51.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:51.882+0000 7f03c4ed3700 1 -- 172.21.15.26:0/102759390 wait complete. 2023-10-01T07:51:51.885 INFO:teuthology.orchestra.run.smithi026.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-01T07:51:51.899 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-01T07:51:51.900 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-01T07:51:51.900 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-01T07:51:51.902 INFO:tasks.ceph.mds.a:Started 2023-10-01T07:51:51.902 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-01T07:51:51.902 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-01T07:51:51.989 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2023-10-01T07:51:52.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.036+0000 7fb52698a700 1 Processor -- start 2023-10-01T07:51:52.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.036+0000 7fb52698a700 1 -- start start 2023-10-01T07:51:52.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.037+0000 7fb52698a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb520067940 0x7fb520097310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:52.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.037+0000 7fb52698a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb520097800 0x7fb520130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:52.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.037+0000 7fb52698a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb520068df0 con 0x7fb520096820 2023-10-01T07:51:52.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.037+0000 7fb52698a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb520097c90 con 0x7fb520067940 2023-10-01T07:51:52.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.037+0000 7fb52698a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb52006a4c0 con 0x7fb520097800 2023-10-01T07:51:52.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.037+0000 7fb51f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb520067940 0x7fb520097310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:52.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.037+0000 7fb524f27700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb520097800 0x7fb520130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:52.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.037+0000 7fb51f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb520067940 0x7fb520097310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:49898/0 (socket says 172.21.15.26:49898) 2023-10-01T07:51:52.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.037+0000 7fb524f27700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb520097800 0x7fb520130280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35862/0 (socket says 172.21.15.26:35862) 2023-10-01T07:51:52.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.037+0000 7fb51f7fe700 1 -- 172.21.15.26:0/3123403329 learned_addr learned my addr 172.21.15.26:0/3123403329 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:52.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.037+0000 7fb51ffff700 1 --1- 172.21.15.26:0/3123403329 >> v1:172.21.15.26:6789/0 conn(0x7fb520096820 0x7fb520096c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35426/0 (socket says 172.21.15.26:35426) 2023-10-01T07:51:52.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.037+0000 7fb524f27700 1 -- 172.21.15.26:0/3123403329 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb520067940 msgr2=0x7fb520097310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:51:52.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.037+0000 7fb524f27700 1 --2- 172.21.15.26:0/3123403329 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb520067940 0x7fb520097310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:52.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.037+0000 7fb524f27700 1 -- 172.21.15.26:0/3123403329 >> v1:172.21.15.26:6789/0 conn(0x7fb520096820 legacy=0x7fb520096c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:52.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.037+0000 7fb524f27700 1 -- 172.21.15.26:0/3123403329 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb520098260 con 0x7fb520097800 2023-10-01T07:51:52.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.037+0000 7fb51effd700 1 -- 172.21.15.26:0/3123403329 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3672773982 0 0) 0x7fb520068df0 con 0x7fb520096820 2023-10-01T07:51:52.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.037+0000 7fb51f7fe700 1 --2- 172.21.15.26:0/3123403329 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb520067940 0x7fb520097310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:52.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.038+0000 7fb524f27700 1 --2- 172.21.15.26:0/3123403329 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb520097800 0x7fb520130280 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fb518009e90 tx=0x7fb518009780).ready entity=mon.2 client_cookie=888de98c978abfba server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:52.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.038+0000 7fb51effd700 1 -- 172.21.15.26:0/3123403329 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51800e070 con 0x7fb520097800 2023-10-01T07:51:52.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.038+0000 7fb51effd700 1 -- 172.21.15.26:0/3123403329 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51800bb00 con 0x7fb520097800 2023-10-01T07:51:52.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.038+0000 7fb51effd700 1 -- 172.21.15.26:0/3123403329 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51800be80 con 0x7fb520097800 2023-10-01T07:51:52.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.038+0000 7fb52698a700 1 -- 172.21.15.26:0/3123403329 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb520097800 msgr2=0x7fb520130280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:52.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.038+0000 7fb52698a700 1 --2- 172.21.15.26:0/3123403329 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb520097800 0x7fb520130280 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fb518009e90 tx=0x7fb518009780).stop 2023-10-01T07:51:52.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.038+0000 7fb52698a700 1 -- 172.21.15.26:0/3123403329 shutdown_connections 2023-10-01T07:51:52.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.038+0000 7fb52698a700 1 --2- 172.21.15.26:0/3123403329 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb520097800 0x7fb520130280 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:52.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.038+0000 7fb52698a700 1 --2- 172.21.15.26:0/3123403329 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb520067940 0x7fb520097310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:52.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.038+0000 7fb52698a700 1 -- 172.21.15.26:0/3123403329 >> 172.21.15.26:0/3123403329 conn(0x7fb52009ba50 msgr2=0x7fb52009be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:52.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.038+0000 7fb52698a700 1 -- 172.21.15.26:0/3123403329 shutdown_connections 2023-10-01T07:51:52.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.038+0000 7fb52698a700 1 -- 172.21.15.26:0/3123403329 wait complete. 2023-10-01T07:51:52.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.039+0000 7fb52698a700 1 Processor -- start 2023-10-01T07:51:52.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.040+0000 7fb52698a700 1 -- start start 2023-10-01T07:51:52.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.040+0000 7fb52698a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb520067940 0x7fb52011e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:52.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.040+0000 7fb52698a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb520096820 0x7fb520064540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:52.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.040+0000 7fb52698a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb520097800 0x7fb520064a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:52.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.040+0000 7fb52698a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb52011d740 con 0x7fb520067940 2023-10-01T07:51:52.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.040+0000 7fb52698a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb520091cc0 con 0x7fb520097800 2023-10-01T07:51:52.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.040+0000 7fb52698a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb520067e30 con 0x7fb520096820 2023-10-01T07:51:52.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.040+0000 7fb51f7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb520096820 0x7fb520064540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:52.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.040+0000 7fb51f7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb520096820 0x7fb520064540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35868/0 (socket says 172.21.15.26:35868) 2023-10-01T07:51:52.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.040+0000 7fb51ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb520067940 0x7fb52011e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:52.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.040+0000 7fb524f27700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb520097800 0x7fb520064a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:52.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.040+0000 7fb51f7fe700 1 -- 172.21.15.26:0/1523085152 learned_addr learned my addr 172.21.15.26:0/1523085152 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:52.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.040+0000 7fb51f7fe700 1 -- 172.21.15.26:0/1523085152 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb520097800 msgr2=0x7fb520064a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:52.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.040+0000 7fb51f7fe700 1 --2- 172.21.15.26:0/1523085152 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb520097800 0x7fb520064a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:52.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.040+0000 7fb51f7fe700 1 -- 172.21.15.26:0/1523085152 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb520067940 msgr2=0x7fb52011e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:52.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.040+0000 7fb51f7fe700 1 --2- 172.21.15.26:0/1523085152 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb520067940 0x7fb52011e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:52.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.040+0000 7fb51f7fe700 1 -- 172.21.15.26:0/1523085152 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb514009370 con 0x7fb520096820 2023-10-01T07:51:52.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.041+0000 7fb51ffff700 1 --2- 172.21.15.26:0/1523085152 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb520067940 0x7fb52011e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:52.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.041+0000 7fb51f7fe700 1 --2- 172.21.15.26:0/1523085152 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb520096820 0x7fb520064540 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fb51400ea20 tx=0x7fb5140090f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:52.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.041+0000 7fb507fff700 1 -- 172.21.15.26:0/1523085152 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51400ee60 con 0x7fb520096820 2023-10-01T07:51:52.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.041+0000 7fb507fff700 1 -- 172.21.15.26:0/1523085152 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51400c850 con 0x7fb520096820 2023-10-01T07:51:52.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.041+0000 7fb52698a700 1 -- 172.21.15.26:0/1523085152 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb518009a20 con 0x7fb520096820 2023-10-01T07:51:52.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.041+0000 7fb507fff700 1 -- 172.21.15.26:0/1523085152 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51400cbd0 con 0x7fb520096820 2023-10-01T07:51:52.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.041+0000 7fb52698a700 1 -- 172.21.15.26:0/1523085152 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb520066160 con 0x7fb520096820 2023-10-01T07:51:52.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.042+0000 7fb507fff700 1 -- 172.21.15.26:0/1523085152 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb51401b400 con 0x7fb520096820 2023-10-01T07:51:52.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.042+0000 7fb507fff700 1 -- 172.21.15.26:0/1523085152 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fb51403b270 con 0x7fb520096820 2023-10-01T07:51:52.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.042+0000 7fb52698a700 1 -- 172.21.15.26:0/1523085152 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb520066350 con 0x7fb520096820 2023-10-01T07:51:52.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.047+0000 7fb507fff700 1 -- 172.21.15.26:0/1523085152 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fb514016070 con 0x7fb520096820 2023-10-01T07:51:52.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.222+0000 7fb52698a700 1 -- 172.21.15.26:0/1523085152 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb52005a260 con 0x7fb520096820 2023-10-01T07:51:52.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.223+0000 7fb507fff700 1 -- 172.21.15.26:0/1523085152 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+8137 (secure 0 0 0) 0x7fb514016020 con 0x7fb520096820 2023-10-01T07:51:52.223 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:52.223 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":12,"fsid":"c29fb19d-520c-42a6-90f4-e7f86de96e8e","created":"2023-10-01T07:51:40.702414+0000","modified":"2023-10-01T07:51:51.870070+0000","last_up_change":"2023-10-01T07:51:48.849482+0000","last_in_change":"2023-10-01T07:51:42.084736+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-01T07:51:48.906889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-01T07:51:50.071599+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"46569ce3-81d1-44a1-a649-691de3e6f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6800","nonce":118773}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6801","nonce":118773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6803","nonce":118773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6802","nonce":118773}]},"public_addr":"172.21.15.26:6800/118773","cluster_addr":"172.21.15.26:6801/118773","heartbeat_back_addr":"172.21.15.26:6803/118773","heartbeat_front_addr":"172.21.15.26:6802/118773","state":["exists","up"]},{"osd":1,"uuid":"1fc1ba9b-4110-4d31-96d6-794937578cff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6804","nonce":118782}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6806","nonce":118782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6810","nonce":118782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6808","nonce":118782}]},"public_addr":"172.21.15.26:6804/118782","cluster_addr":"172.21.15.26:6806/118782","heartbeat_back_addr":"172.21.15.26:6810/118782","heartbeat_front_addr":"172.21.15.26:6808/118782","state":["exists","up"]},{"osd":2,"uuid":"37de933d-3b8e-4b94-87bd-2f36896c7ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6805","nonce":118789}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6807","nonce":118789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6811","nonce":118789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6809","nonce":118789}]},"public_addr":"172.21.15.26:6805/118789","cluster_addr":"172.21.15.26:6807/118789","heartbeat_back_addr":"172.21.15.26:6811/118789","heartbeat_front_addr":"172.21.15.26:6809/118789","state":["exists","up"]},{"osd":3,"uuid":"bd020309-5fd2-4d97-b36a-67e159fa3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6812","nonce":118790}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6813","nonce":118790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6815","nonce":118790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6814","nonce":118790}]},"public_addr":"172.21.15.26:6812/118790","cluster_addr":"172.21.15.26:6813/118790","heartbeat_back_addr":"172.21.15.26:6815/118790","heartbeat_front_addr":"172.21.15.26:6814/118790","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.029993+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.266503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.273540+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.229731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-01T07:51:52.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.224+0000 7fb52698a700 1 -- 172.21.15.26:0/1523085152 >> v1:172.21.15.26:6816/118178 conn(0x7fb50c02bb60 legacy=0x7fb50c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:52.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.224+0000 7fb52698a700 1 -- 172.21.15.26:0/1523085152 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb520096820 msgr2=0x7fb520064540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:52.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.224+0000 7fb52698a700 1 --2- 172.21.15.26:0/1523085152 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb520096820 0x7fb520064540 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fb51400ea20 tx=0x7fb5140090f0).stop 2023-10-01T07:51:52.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.224+0000 7fb52698a700 1 -- 172.21.15.26:0/1523085152 shutdown_connections 2023-10-01T07:51:52.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.224+0000 7fb52698a700 1 --2- 172.21.15.26:0/1523085152 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb520097800 0x7fb520064a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:52.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.224+0000 7fb52698a700 1 --2- 172.21.15.26:0/1523085152 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb520067940 0x7fb52011e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:52.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.224+0000 7fb52698a700 1 --2- 172.21.15.26:0/1523085152 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb520096820 0x7fb520064540 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:52.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.225+0000 7fb52698a700 1 -- 172.21.15.26:0/1523085152 >> 172.21.15.26:0/1523085152 conn(0x7fb52009ba50 msgr2=0x7fb5201120d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:52.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.225+0000 7fb52698a700 1 -- 172.21.15.26:0/1523085152 shutdown_connections 2023-10-01T07:51:52.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.225+0000 7fb52698a700 1 -- 172.21.15.26:0/1523085152 wait complete. 2023-10-01T07:51:52.238 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-01T07:51:48.906889+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-01T07:51:50.071599+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-01T07:51:52.239 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-01T07:51:52.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.371+0000 7fdbb2faf700 1 Processor -- start 2023-10-01T07:51:52.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.371+0000 7fdbb2faf700 1 -- start start 2023-10-01T07:51:52.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.371+0000 7fdbb2faf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdbac098740 0x7fdbac098b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:52.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.371+0000 7fdbb2faf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbac099010 0x7fdbac068d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:52.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.371+0000 7fdbb2faf700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbac095270 con 0x7fdbac069210 2023-10-01T07:51:52.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.371+0000 7fdbb2faf700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac094d20 con 0x7fdbac099010 2023-10-01T07:51:52.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.371+0000 7fdbb2faf700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac096520 con 0x7fdbac098740 2023-10-01T07:51:52.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.372+0000 7fdbabfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbac099010 0x7fdbac068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:52.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.372+0000 7fdbb154c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fdbac069210 0x7fdbac12fbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35438/0 (socket says 172.21.15.26:35438) 2023-10-01T07:51:52.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.372+0000 7fdbb154c700 1 -- 172.21.15.26:0/324194124 learned_addr learned my addr 172.21.15.26:0/324194124 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:51:52.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.372+0000 7fdbb0d4b700 1 --2- 172.21.15.26:0/324194124 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdbac098740 0x7fdbac098b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:52.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.372+0000 7fdbb0d4b700 1 -- 172.21.15.26:0/324194124 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbac099010 msgr2=0x7fdbac068d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:51:52.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.372+0000 7fdbb0d4b700 1 --2- 172.21.15.26:0/324194124 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbac099010 0x7fdbac068d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:52.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.372+0000 7fdbb0d4b700 1 -- 172.21.15.26:0/324194124 >> v1:172.21.15.26:6789/0 conn(0x7fdbac069210 legacy=0x7fdbac12fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:52.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.372+0000 7fdbab7fe700 1 -- 172.21.15.26:0/324194124 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 682728124 0 0) 0x7fdbac095270 con 0x7fdbac069210 2023-10-01T07:51:52.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.372+0000 7fdbb0d4b700 1 -- 172.21.15.26:0/324194124 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbac094870 con 0x7fdbac098740 2023-10-01T07:51:52.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.372+0000 7fdbabfff700 1 --2- 172.21.15.26:0/324194124 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbac099010 0x7fdbac068d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:52.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.372+0000 7fdbb0d4b700 1 --2- 172.21.15.26:0/324194124 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdbac098740 0x7fdbac098b20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fdba0009790 tx=0x7fdba0009060).ready entity=mon.2 client_cookie=d87729740cabc60f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:52.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.372+0000 7fdbab7fe700 1 -- 172.21.15.26:0/324194124 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba00090d0 con 0x7fdbac098740 2023-10-01T07:51:52.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.372+0000 7fdbab7fe700 1 -- 172.21.15.26:0/324194124 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba000f510 con 0x7fdbac098740 2023-10-01T07:51:52.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.372+0000 7fdbab7fe700 1 -- 172.21.15.26:0/324194124 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba000f890 con 0x7fdbac098740 2023-10-01T07:51:52.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.373+0000 7fdbb2faf700 1 -- 172.21.15.26:0/324194124 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdbac098740 msgr2=0x7fdbac098b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:52.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.373+0000 7fdbb2faf700 1 --2- 172.21.15.26:0/324194124 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdbac098740 0x7fdbac098b20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fdba0009790 tx=0x7fdba0009060).stop 2023-10-01T07:51:52.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.373+0000 7fdbb2faf700 1 -- 172.21.15.26:0/324194124 shutdown_connections 2023-10-01T07:51:52.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.373+0000 7fdbb2faf700 1 --2- 172.21.15.26:0/324194124 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdbac098740 0x7fdbac098b20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:52.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.373+0000 7fdbb2faf700 1 --2- 172.21.15.26:0/324194124 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbac099010 0x7fdbac068d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:52.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.373+0000 7fdbb2faf700 1 -- 172.21.15.26:0/324194124 >> 172.21.15.26:0/324194124 conn(0x7fdbac09a1c0 msgr2=0x7fdbac09a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:52.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.373+0000 7fdbb2faf700 1 -- 172.21.15.26:0/324194124 shutdown_connections 2023-10-01T07:51:52.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.373+0000 7fdbb2faf700 1 -- 172.21.15.26:0/324194124 wait complete. 2023-10-01T07:51:52.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.374+0000 7fdbb2faf700 1 Processor -- start 2023-10-01T07:51:52.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.374+0000 7fdbb2faf700 1 -- start start 2023-10-01T07:51:52.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.374+0000 7fdbb2faf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbac069210 0x7fdbac138290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:52.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.375+0000 7fdbb2faf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbac098740 0x7fdbac138780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:52.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.375+0000 7fdbb2faf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdbac099010 0x7fdbac138c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:52.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.375+0000 7fdbb2faf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac139160 con 0x7fdbac069210 2023-10-01T07:51:52.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.375+0000 7fdbb2faf700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac118a00 con 0x7fdbac098740 2023-10-01T07:51:52.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.375+0000 7fdbb2faf700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac0980a0 con 0x7fdbac099010 2023-10-01T07:51:52.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.375+0000 7fdbabfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbac098740 0x7fdbac138780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:52.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.375+0000 7fdbb154c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdbac099010 0x7fdbac138c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:52.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.375+0000 7fdbb0d4b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbac069210 0x7fdbac138290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:52.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.375+0000 7fdbabfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbac098740 0x7fdbac138780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:49930/0 (socket says 172.21.15.26:49930) 2023-10-01T07:51:52.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.375+0000 7fdbabfff700 1 -- 172.21.15.26:0/1590705442 learned_addr learned my addr 172.21.15.26:0/1590705442 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:52.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.375+0000 7fdbb154c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdbac099010 0x7fdbac138c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35882/0 (socket says 172.21.15.26:35882) 2023-10-01T07:51:52.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.375+0000 7fdbb0d4b700 1 --2- 172.21.15.26:0/1590705442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbac069210 0x7fdbac138290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50962/0 (socket says 172.21.15.26:50962) 2023-10-01T07:51:52.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.375+0000 7fdbb154c700 1 -- 172.21.15.26:0/1590705442 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbac098740 msgr2=0x7fdbac138780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:52.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.375+0000 7fdbb154c700 1 --2- 172.21.15.26:0/1590705442 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbac098740 0x7fdbac138780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:52.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.375+0000 7fdbb154c700 1 -- 172.21.15.26:0/1590705442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbac069210 msgr2=0x7fdbac138290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:52.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.375+0000 7fdbb154c700 1 --2- 172.21.15.26:0/1590705442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbac069210 0x7fdbac138290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:52.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.375+0000 7fdbb154c700 1 -- 172.21.15.26:0/1590705442 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb980092a0 con 0x7fdbac099010 2023-10-01T07:51:52.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.375+0000 7fdbb0d4b700 1 --2- 172.21.15.26:0/1590705442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbac069210 0x7fdbac138290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:52.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.375+0000 7fdbb154c700 1 --2- 172.21.15.26:0/1590705442 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdbac099010 0x7fdbac138c70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fdba400c7e0 tx=0x7fdba4007eb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:52.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.375+0000 7fdba8ff9700 1 -- 172.21.15.26:0/1590705442 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba4005d30 con 0x7fdbac099010 2023-10-01T07:51:52.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.375+0000 7fdba8ff9700 1 -- 172.21.15.26:0/1590705442 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba4005e90 con 0x7fdbac099010 2023-10-01T07:51:52.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.375+0000 7fdbb2faf700 1 -- 172.21.15.26:0/1590705442 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba00092a0 con 0x7fdbac099010 2023-10-01T07:51:52.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.375+0000 7fdba8ff9700 1 -- 172.21.15.26:0/1590705442 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba4007360 con 0x7fdbac099010 2023-10-01T07:51:52.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.375+0000 7fdbb2faf700 1 -- 172.21.15.26:0/1590705442 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbac119230 con 0x7fdbac099010 2023-10-01T07:51:52.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.376+0000 7fdba8ff9700 1 -- 172.21.15.26:0/1590705442 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fdba4007710 con 0x7fdbac099010 2023-10-01T07:51:52.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.376+0000 7fdba8ff9700 1 -- 172.21.15.26:0/1590705442 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fdba403aa40 con 0x7fdbac099010 2023-10-01T07:51:52.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.377+0000 7fdbb2faf700 1 -- 172.21.15.26:0/1590705442 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbac119230 con 0x7fdbac099010 2023-10-01T07:51:52.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.381+0000 7fdba8ff9700 1 -- 172.21.15.26:0/1590705442 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fdbac119230 con 0x7fdbac099010 2023-10-01T07:51:52.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.553+0000 7fdbb2faf700 1 -- 172.21.15.26:0/1590705442 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fdbac119230 con 0x7fdbac099010 2023-10-01T07:51:52.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.553+0000 7fdba8ff9700 1 -- 172.21.15.26:0/1590705442 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v12) v1 ==== 110+0+10 (secure 0 0 0) 0x7fdbac119230 con 0x7fdbac099010 2023-10-01T07:51:52.554 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-01T07:51:52.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.555+0000 7fdbb2faf700 1 -- 172.21.15.26:0/1590705442 >> v1:172.21.15.26:6816/118178 conn(0x7fdb9002bb60 legacy=0x7fdb9002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:52.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.555+0000 7fdbb2faf700 1 -- 172.21.15.26:0/1590705442 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdbac099010 msgr2=0x7fdbac138c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:52.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.555+0000 7fdbb2faf700 1 --2- 172.21.15.26:0/1590705442 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdbac099010 0x7fdbac138c70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fdba400c7e0 tx=0x7fdba4007eb0).stop 2023-10-01T07:51:52.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.555+0000 7fdbb2faf700 1 -- 172.21.15.26:0/1590705442 shutdown_connections 2023-10-01T07:51:52.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.555+0000 7fdbb2faf700 1 --2- 172.21.15.26:0/1590705442 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdbac099010 0x7fdbac138c70 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:52.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.555+0000 7fdbb2faf700 1 --2- 172.21.15.26:0/1590705442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbac069210 0x7fdbac138290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:52.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.555+0000 7fdbb2faf700 1 --2- 172.21.15.26:0/1590705442 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbac098740 0x7fdbac138780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:52.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.555+0000 7fdbb2faf700 1 -- 172.21.15.26:0/1590705442 >> 172.21.15.26:0/1590705442 conn(0x7fdbac09a1c0 msgr2=0x7fdbac065d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:52.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.555+0000 7fdbb2faf700 1 -- 172.21.15.26:0/1590705442 shutdown_connections 2023-10-01T07:51:52.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.555+0000 7fdbb2faf700 1 -- 172.21.15.26:0/1590705442 wait complete. 2023-10-01T07:51:52.569 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-01T07:51:52.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.702+0000 7f56c851b700 1 Processor -- start 2023-10-01T07:51:52.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.702+0000 7f56c851b700 1 -- start start 2023-10-01T07:51:52.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.702+0000 7f56c851b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f56c01275c0 0x7f56c012fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:52.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.702+0000 7f56c851b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f56c0130220 0x7f56c0132610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:52.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.702+0000 7f56c851b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56c0091c80 con 0x7f56c00926d0 2023-10-01T07:51:52.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.702+0000 7f56c851b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56c01279e0 con 0x7f56c0130220 2023-10-01T07:51:52.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.702+0000 7f56c851b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56c00999d0 con 0x7f56c01275c0 2023-10-01T07:51:52.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.703+0000 7f56c5ab6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f56c01275c0 0x7f56c012fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:52.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.703+0000 7f56c62b7700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f56c00926d0 0x7f56c0127be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35442/0 (socket says 172.21.15.26:35442) 2023-10-01T07:51:52.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.703+0000 7f56c6ab8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f56c0130220 0x7f56c0132610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:52.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.703+0000 7f56c62b7700 1 -- 172.21.15.26:0/3813245288 learned_addr learned my addr 172.21.15.26:0/3813245288 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:51:52.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.703+0000 7f56c5ab6700 1 -- 172.21.15.26:0/3813245288 >> v2:172.21.15.26:3300/0 conn(0x7f56c0130220 msgr2=0x7f56c0132610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:51:52.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.703+0000 7f56c5ab6700 1 --2- 172.21.15.26:0/3813245288 >> v2:172.21.15.26:3300/0 conn(0x7f56c0130220 0x7f56c0132610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:52.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.703+0000 7f56c5ab6700 1 -- 172.21.15.26:0/3813245288 >> v1:172.21.15.26:6789/0 conn(0x7f56c00926d0 legacy=0x7f56c0127be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:52.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.703+0000 7f56c5ab6700 1 -- 172.21.15.26:0/3813245288 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c009a280 con 0x7f56c01275c0 2023-10-01T07:51:52.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.703+0000 7f56c52b5700 1 -- 172.21.15.26:0/3813245288 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231231259 0 0) 0x7f56c0091c80 con 0x7f56c00926d0 2023-10-01T07:51:52.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.703+0000 7f56c6ab8700 1 --2- 172.21.15.26:0/3813245288 >> v2:172.21.15.26:3300/0 conn(0x7f56c0130220 0x7f56c0132610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:52.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.703+0000 7f56c5ab6700 1 --2- 172.21.15.26:0/3813245288 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f56c01275c0 0x7f56c012fd30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f56b0009760 tx=0x7f56b0009060).ready entity=mon.2 client_cookie=f8c1a97101b39ef6 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:52.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.703+0000 7f56c52b5700 1 -- 172.21.15.26:0/3813245288 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b000f510 con 0x7f56c01275c0 2023-10-01T07:51:52.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.703+0000 7f56c52b5700 1 -- 172.21.15.26:0/3813245288 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b000f670 con 0x7f56c01275c0 2023-10-01T07:51:52.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.703+0000 7f56c52b5700 1 -- 172.21.15.26:0/3813245288 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b000f9f0 con 0x7f56c01275c0 2023-10-01T07:51:52.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.704+0000 7f56c851b700 1 -- 172.21.15.26:0/3813245288 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f56c01275c0 msgr2=0x7f56c012fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:52.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.704+0000 7f56c851b700 1 --2- 172.21.15.26:0/3813245288 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f56c01275c0 0x7f56c012fd30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f56b0009760 tx=0x7f56b0009060).stop 2023-10-01T07:51:52.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.704+0000 7f56c851b700 1 -- 172.21.15.26:0/3813245288 shutdown_connections 2023-10-01T07:51:52.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.704+0000 7f56c851b700 1 --2- 172.21.15.26:0/3813245288 >> v2:172.21.15.26:3300/0 conn(0x7f56c0130220 0x7f56c0132610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:52.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.704+0000 7f56c851b700 1 --2- 172.21.15.26:0/3813245288 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f56c01275c0 0x7f56c012fd30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:52.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.704+0000 7f56c851b700 1 -- 172.21.15.26:0/3813245288 >> 172.21.15.26:0/3813245288 conn(0x7f56c0097480 msgr2=0x7f56c0097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:52.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.704+0000 7f56c851b700 1 -- 172.21.15.26:0/3813245288 shutdown_connections 2023-10-01T07:51:52.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.704+0000 7f56c851b700 1 -- 172.21.15.26:0/3813245288 wait complete. 2023-10-01T07:51:52.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.705+0000 7f56c851b700 1 Processor -- start 2023-10-01T07:51:52.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.705+0000 7f56c851b700 1 -- start start 2023-10-01T07:51:52.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.705+0000 7f56c851b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56c00926d0 0x7f56c012e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:52.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.705+0000 7f56c851b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f56c01275c0 0x7f56c012e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:52.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.705+0000 7f56c851b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f56c0130220 0x7f56c012ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:52.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.705+0000 7f56c851b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c012ef30 con 0x7f56c00926d0 2023-10-01T07:51:52.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.705+0000 7f56c851b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56c0113880 con 0x7f56c0130220 2023-10-01T07:51:52.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.705+0000 7f56c851b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56c0112700 con 0x7f56c01275c0 2023-10-01T07:51:52.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.705+0000 7f56c5ab6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f56c01275c0 0x7f56c012e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:52.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.705+0000 7f56c6ab8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f56c0130220 0x7f56c012ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:52.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.706+0000 7f56c5ab6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f56c01275c0 0x7f56c012e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35902/0 (socket says 172.21.15.26:35902) 2023-10-01T07:51:52.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.706+0000 7f56c5ab6700 1 -- 172.21.15.26:0/865628530 learned_addr learned my addr 172.21.15.26:0/865628530 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:52.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.706+0000 7f56c62b7700 1 --2- 172.21.15.26:0/865628530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56c00926d0 0x7f56c012e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:52.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.706+0000 7f56c5ab6700 1 -- 172.21.15.26:0/865628530 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f56c0130220 msgr2=0x7f56c012ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:52.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.706+0000 7f56c5ab6700 1 --2- 172.21.15.26:0/865628530 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f56c0130220 0x7f56c012ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:52.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.706+0000 7f56c5ab6700 1 -- 172.21.15.26:0/865628530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56c00926d0 msgr2=0x7f56c012e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:52.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.706+0000 7f56c5ab6700 1 --2- 172.21.15.26:0/865628530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56c00926d0 0x7f56c012e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:52.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.706+0000 7f56c5ab6700 1 -- 172.21.15.26:0/865628530 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b8009a20 con 0x7f56c01275c0 2023-10-01T07:51:52.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.706+0000 7f56c6ab8700 1 --2- 172.21.15.26:0/865628530 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f56c0130220 0x7f56c012ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:52.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.706+0000 7f56c62b7700 1 --2- 172.21.15.26:0/865628530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56c00926d0 0x7f56c012e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:52.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.706+0000 7f56c5ab6700 1 --2- 172.21.15.26:0/865628530 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f56c01275c0 0x7f56c012e550 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f56b0009e00 tx=0x7f56b0017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:52.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.706+0000 7f56b67fc700 1 -- 172.21.15.26:0/865628530 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b000f7e0 con 0x7f56c01275c0 2023-10-01T07:51:52.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.706+0000 7f56b67fc700 1 -- 172.21.15.26:0/865628530 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b000f940 con 0x7f56c01275c0 2023-10-01T07:51:52.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.706+0000 7f56c851b700 1 -- 172.21.15.26:0/865628530 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b00092a0 con 0x7f56c01275c0 2023-10-01T07:51:52.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.706+0000 7f56b67fc700 1 -- 172.21.15.26:0/865628530 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b001b640 con 0x7f56c01275c0 2023-10-01T07:51:52.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.706+0000 7f56c851b700 1 -- 172.21.15.26:0/865628530 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c0113380 con 0x7f56c01275c0 2023-10-01T07:51:52.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.707+0000 7f56b67fc700 1 -- 172.21.15.26:0/865628530 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f56b001b9f0 con 0x7f56c01275c0 2023-10-01T07:51:52.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.707+0000 7f56b67fc700 1 -- 172.21.15.26:0/865628530 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f56b003c5c0 con 0x7f56c01275c0 2023-10-01T07:51:52.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.707+0000 7f56c851b700 1 -- 172.21.15.26:0/865628530 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c009a4b0 con 0x7f56c01275c0 2023-10-01T07:51:52.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.712+0000 7f56b67fc700 1 -- 172.21.15.26:0/865628530 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f56b001f020 con 0x7f56c01275c0 2023-10-01T07:51:52.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.888+0000 7f56c851b700 1 -- 172.21.15.26:0/865628530 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f56c005a260 con 0x7f56c01275c0 2023-10-01T07:51:52.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.889+0000 7f56b67fc700 1 -- 172.21.15.26:0/865628530 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v13) v1 ==== 92+0+10 (secure 0 0 0) 0x7f56b0022540 con 0x7f56c01275c0 2023-10-01T07:51:52.889 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 8 2023-10-01T07:51:52.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.890+0000 7f56c851b700 1 -- 172.21.15.26:0/865628530 >> v1:172.21.15.26:6816/118178 conn(0x7f56a402bb60 legacy=0x7f56a402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:52.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.891+0000 7f56c851b700 1 -- 172.21.15.26:0/865628530 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f56c01275c0 msgr2=0x7f56c012e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:52.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.891+0000 7f56c851b700 1 --2- 172.21.15.26:0/865628530 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f56c01275c0 0x7f56c012e550 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f56b0009e00 tx=0x7f56b0017000).stop 2023-10-01T07:51:52.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.891+0000 7f56c851b700 1 -- 172.21.15.26:0/865628530 shutdown_connections 2023-10-01T07:51:52.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.891+0000 7f56c851b700 1 --2- 172.21.15.26:0/865628530 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f56c0130220 0x7f56c012ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:52.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.891+0000 7f56c851b700 1 --2- 172.21.15.26:0/865628530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56c00926d0 0x7f56c012e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:52.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.891+0000 7f56c851b700 1 --2- 172.21.15.26:0/865628530 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f56c01275c0 0x7f56c012e550 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:52.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.891+0000 7f56c851b700 1 -- 172.21.15.26:0/865628530 >> 172.21.15.26:0/865628530 conn(0x7f56c0097480 msgr2=0x7f56c0092d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:52.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.891+0000 7f56c851b700 1 -- 172.21.15.26:0/865628530 shutdown_connections 2023-10-01T07:51:52.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:52.891+0000 7f56c851b700 1 -- 172.21.15.26:0/865628530 wait complete. 2023-10-01T07:51:52.904 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-01T07:51:53.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.033+0000 7f5f02218700 1 Processor -- start 2023-10-01T07:51:53.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.033+0000 7f5f02218700 1 -- start start 2023-10-01T07:51:53.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.034+0000 7f5f02218700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5efc059070 0x7f5efc127890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:53.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.034+0000 7f5f02218700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5efc127d80 0x7f5efc095a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:53.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.034+0000 7f5f02218700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5efc096900 con 0x7f5efc127390 2023-10-01T07:51:53.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.034+0000 7f5f02218700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc059c00 con 0x7f5efc127d80 2023-10-01T07:51:53.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.034+0000 7f5f02218700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc091b60 con 0x7f5efc059070 2023-10-01T07:51:53.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.034+0000 7f5efb7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5efc059070 0x7f5efc127890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:53.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.034+0000 7f5efaffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5efc127390 0x7f5efc095370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35450/0 (socket says 172.21.15.26:35450) 2023-10-01T07:51:53.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.034+0000 7f5efaffd700 1 -- 172.21.15.26:0/1111123554 learned_addr learned my addr 172.21.15.26:0/1111123554 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:51:53.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.034+0000 7f5efbfff700 1 --2- 172.21.15.26:0/1111123554 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5efc127d80 0x7f5efc095a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:53.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.034+0000 7f5efbfff700 1 -- 172.21.15.26:0/1111123554 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5efc059070 msgr2=0x7f5efc127890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:51:53.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.034+0000 7f5efbfff700 1 --2- 172.21.15.26:0/1111123554 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5efc059070 0x7f5efc127890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:53.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.034+0000 7f5efbfff700 1 -- 172.21.15.26:0/1111123554 >> v1:172.21.15.26:6789/0 conn(0x7f5efc127390 legacy=0x7f5efc095370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:53.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.034+0000 7f5efa7fc700 1 -- 172.21.15.26:0/1111123554 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1127813741 0 0) 0x7f5efc096900 con 0x7f5efc127390 2023-10-01T07:51:53.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.034+0000 7f5efbfff700 1 -- 172.21.15.26:0/1111123554 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5efc092a10 con 0x7f5efc127d80 2023-10-01T07:51:53.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.034+0000 7f5efb7fe700 1 --2- 172.21.15.26:0/1111123554 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5efc059070 0x7f5efc127890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:53.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.034+0000 7f5efbfff700 1 --2- 172.21.15.26:0/1111123554 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5efc127d80 0x7f5efc095a80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f5ef4009e90 tx=0x7f5ef4009780).ready entity=mon.1 client_cookie=70b2cd5c12c72c70 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:53.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.035+0000 7f5efa7fc700 1 -- 172.21.15.26:0/1111123554 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef400e070 con 0x7f5efc127d80 2023-10-01T07:51:53.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.035+0000 7f5efa7fc700 1 -- 172.21.15.26:0/1111123554 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef400bb60 con 0x7f5efc127d80 2023-10-01T07:51:53.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.035+0000 7f5efa7fc700 1 -- 172.21.15.26:0/1111123554 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4012410 con 0x7f5efc127d80 2023-10-01T07:51:53.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.035+0000 7f5f02218700 1 -- 172.21.15.26:0/1111123554 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5efc127d80 msgr2=0x7f5efc095a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:53.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.035+0000 7f5f02218700 1 --2- 172.21.15.26:0/1111123554 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5efc127d80 0x7f5efc095a80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f5ef4009e90 tx=0x7f5ef4009780).stop 2023-10-01T07:51:53.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.035+0000 7f5f02218700 1 -- 172.21.15.26:0/1111123554 shutdown_connections 2023-10-01T07:51:53.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.035+0000 7f5f02218700 1 --2- 172.21.15.26:0/1111123554 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5efc059070 0x7f5efc127890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:53.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.035+0000 7f5f02218700 1 --2- 172.21.15.26:0/1111123554 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5efc127d80 0x7f5efc095a80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:53.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.035+0000 7f5f02218700 1 -- 172.21.15.26:0/1111123554 >> 172.21.15.26:0/1111123554 conn(0x7f5efc097470 msgr2=0x7f5efc097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:53.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.035+0000 7f5f02218700 1 -- 172.21.15.26:0/1111123554 shutdown_connections 2023-10-01T07:51:53.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.035+0000 7f5f02218700 1 -- 172.21.15.26:0/1111123554 wait complete. 2023-10-01T07:51:53.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.036+0000 7f5f02218700 1 Processor -- start 2023-10-01T07:51:53.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.036+0000 7f5f02218700 1 -- start start 2023-10-01T07:51:53.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.037+0000 7f5f02218700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5efc059070 0x7f5efc113c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:53.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.037+0000 7f5f02218700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5efc127390 0x7f5efc114110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:53.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.037+0000 7f5f02218700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5efc127d80 0x7f5efc114600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:53.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.037+0000 7f5f02218700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc096f00 con 0x7f5efc059070 2023-10-01T07:51:53.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.037+0000 7f5f02218700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc099ed0 con 0x7f5efc127d80 2023-10-01T07:51:53.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.037+0000 7f5f02218700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc116b00 con 0x7f5efc127390 2023-10-01T07:51:53.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.037+0000 7f5efaffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5efc127390 0x7f5efc114110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:53.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.037+0000 7f5efbfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5efc127d80 0x7f5efc114600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:53.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.037+0000 7f5efaffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5efc127390 0x7f5efc114110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35910/0 (socket says 172.21.15.26:35910) 2023-10-01T07:51:53.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.037+0000 7f5efaffd700 1 -- 172.21.15.26:0/1340749291 learned_addr learned my addr 172.21.15.26:0/1340749291 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:53.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.037+0000 7f5efb7fe700 1 --2- 172.21.15.26:0/1340749291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5efc059070 0x7f5efc113c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:53.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.037+0000 7f5efaffd700 1 -- 172.21.15.26:0/1340749291 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5efc127d80 msgr2=0x7f5efc114600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:53.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.037+0000 7f5efaffd700 1 --2- 172.21.15.26:0/1340749291 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5efc127d80 0x7f5efc114600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:53.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.037+0000 7f5efaffd700 1 -- 172.21.15.26:0/1340749291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5efc059070 msgr2=0x7f5efc113c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:53.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.037+0000 7f5efaffd700 1 --2- 172.21.15.26:0/1340749291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5efc059070 0x7f5efc113c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:53.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.037+0000 7f5efaffd700 1 -- 172.21.15.26:0/1340749291 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eec0092a0 con 0x7f5efc127390 2023-10-01T07:51:53.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.037+0000 7f5efb7fe700 1 --2- 172.21.15.26:0/1340749291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5efc059070 0x7f5efc113c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:53.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.037+0000 7f5efbfff700 1 --2- 172.21.15.26:0/1340749291 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5efc127d80 0x7f5efc114600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:53.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.037+0000 7f5efaffd700 1 --2- 172.21.15.26:0/1340749291 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5efc127390 0x7f5efc114110 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f5ee4001eb0 tx=0x7f5ee4007bf0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:53.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.038+0000 7f5ef37fe700 1 -- 172.21.15.26:0/1340749291 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee400ce00 con 0x7f5efc127390 2023-10-01T07:51:53.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.038+0000 7f5ef37fe700 1 -- 172.21.15.26:0/1340749291 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee40072e0 con 0x7f5efc127390 2023-10-01T07:51:53.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.038+0000 7f5ef37fe700 1 -- 172.21.15.26:0/1340749291 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee40057a0 con 0x7f5efc127390 2023-10-01T07:51:53.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.038+0000 7f5f02218700 1 -- 172.21.15.26:0/1340749291 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef4009a20 con 0x7f5efc127390 2023-10-01T07:51:53.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.038+0000 7f5f02218700 1 -- 172.21.15.26:0/1340749291 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5efc117920 con 0x7f5efc127390 2023-10-01T07:51:53.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.039+0000 7f5ef37fe700 1 -- 172.21.15.26:0/1340749291 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f5ee4005b90 con 0x7f5efc127390 2023-10-01T07:51:53.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.039+0000 7f5ef37fe700 1 -- 172.21.15.26:0/1340749291 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f5ee403a280 con 0x7f5efc127390 2023-10-01T07:51:53.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.039+0000 7f5f02218700 1 -- 172.21.15.26:0/1340749291 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5efc114af0 con 0x7f5efc127390 2023-10-01T07:51:53.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.044+0000 7f5ef37fe700 1 -- 172.21.15.26:0/1340749291 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f5ee4013970 con 0x7f5efc127390 2023-10-01T07:51:53.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.259+0000 7f5f02218700 1 -- 172.21.15.26:0/1340749291 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5efc117920 con 0x7f5efc127390 2023-10-01T07:51:53.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.259+0000 7f5ef37fe700 1 -- 172.21.15.26:0/1340749291 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1196 (secure 0 0 0) 0x7f5efc117920 con 0x7f5efc127390 2023-10-01T07:51:53.260 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:53.260 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4189,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6817/2857714939","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6817","nonce":2857714939}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-10-01T07:51:53.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.261+0000 7f5f02218700 1 -- 172.21.15.26:0/1340749291 >> v1:172.21.15.26:6816/118178 conn(0x7f5edc02bb60 legacy=0x7f5edc02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:53.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.261+0000 7f5f02218700 1 -- 172.21.15.26:0/1340749291 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5efc127390 msgr2=0x7f5efc114110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:53.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.261+0000 7f5f02218700 1 --2- 172.21.15.26:0/1340749291 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5efc127390 0x7f5efc114110 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f5ee4001eb0 tx=0x7f5ee4007bf0).stop 2023-10-01T07:51:53.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.261+0000 7f5f02218700 1 -- 172.21.15.26:0/1340749291 shutdown_connections 2023-10-01T07:51:53.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.261+0000 7f5f02218700 1 --2- 172.21.15.26:0/1340749291 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5efc127d80 0x7f5efc114600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:53.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.261+0000 7f5f02218700 1 --2- 172.21.15.26:0/1340749291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5efc059070 0x7f5efc113c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:53.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.262+0000 7f5f02218700 1 --2- 172.21.15.26:0/1340749291 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5efc127390 0x7f5efc114110 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:53.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.262+0000 7f5f02218700 1 -- 172.21.15.26:0/1340749291 >> 172.21.15.26:0/1340749291 conn(0x7f5efc097470 msgr2=0x7f5efc12a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:53.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.262+0000 7f5f02218700 1 -- 172.21.15.26:0/1340749291 shutdown_connections 2023-10-01T07:51:53.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.262+0000 7f5f02218700 1 -- 172.21.15.26:0/1340749291 wait complete. 2023-10-01T07:51:53.264 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 2 2023-10-01T07:51:53.275 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-01T07:51:53.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.404+0000 7fe25594d700 1 Processor -- start 2023-10-01T07:51:53.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.405+0000 7fe25594d700 1 -- start start 2023-10-01T07:51:53.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.405+0000 7fe25594d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe2500650f0 0x7fe2500986a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:53.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.405+0000 7fe25594d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe250097c30 0x7fe250098b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:53.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.405+0000 7fe25594d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe250099080 0x7fe250131470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:53.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.405+0000 7fe25594d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2500654d0 con 0x7fe2500650f0 2023-10-01T07:51:53.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.405+0000 7fe25594d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe250099530 con 0x7fe250099080 2023-10-01T07:51:53.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.405+0000 7fe25594d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe250096160 con 0x7fe250097c30 2023-10-01T07:51:53.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.405+0000 7fe24effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe2500650f0 0x7fe2500986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:53.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.405+0000 7fe24e7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe250097c30 0x7fe250098b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:53.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.405+0000 7fe24f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe250099080 0x7fe250131470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:53.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.405+0000 7fe24e7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe250097c30 0x7fe250098b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59398/0 (socket says 172.21.15.26:59398) 2023-10-01T07:51:53.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.405+0000 7fe24f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe250099080 0x7fe250131470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43810/0 (socket says 172.21.15.26:43810) 2023-10-01T07:51:53.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.405+0000 7fe24effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe2500650f0 0x7fe2500986a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37766/0 (socket says 172.21.15.26:37766) 2023-10-01T07:51:53.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.405+0000 7fe24f7fe700 1 -- 172.21.15.26:0/909682645 learned_addr learned my addr 172.21.15.26:0/909682645 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:53.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.406+0000 7fe24f7fe700 1 -- 172.21.15.26:0/909682645 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe250097c30 msgr2=0x7fe250098b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:51:53.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.406+0000 7fe24f7fe700 1 --2- 172.21.15.26:0/909682645 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe250097c30 0x7fe250098b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:53.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.406+0000 7fe24f7fe700 1 -- 172.21.15.26:0/909682645 >> v2:172.21.15.26:3300/0 conn(0x7fe2500650f0 msgr2=0x7fe2500986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:51:53.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.406+0000 7fe24f7fe700 1 --2- 172.21.15.26:0/909682645 >> v2:172.21.15.26:3300/0 conn(0x7fe2500650f0 0x7fe2500986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:53.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.406+0000 7fe24f7fe700 1 -- 172.21.15.26:0/909682645 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe250099790 con 0x7fe250099080 2023-10-01T07:51:53.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.406+0000 7fe24effd700 1 --2- 172.21.15.26:0/909682645 >> v2:172.21.15.26:3300/0 conn(0x7fe2500650f0 0x7fe2500986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:53.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.406+0000 7fe24f7fe700 1 --2- 172.21.15.26:0/909682645 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe250099080 0x7fe250131470 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fe248009f50 tx=0x7fe248009840).ready entity=mon.1 client_cookie=a11e3bd60b5e8051 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:53.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.406+0000 7fe24dffb700 1 -- 172.21.15.26:0/909682645 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24800e070 con 0x7fe250099080 2023-10-01T07:51:53.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.406+0000 7fe24dffb700 1 -- 172.21.15.26:0/909682645 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24800b910 con 0x7fe250099080 2023-10-01T07:51:53.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.406+0000 7fe24dffb700 1 -- 172.21.15.26:0/909682645 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24800bc90 con 0x7fe250099080 2023-10-01T07:51:53.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.407+0000 7fe25594d700 1 -- 172.21.15.26:0/909682645 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe250099080 msgr2=0x7fe250131470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:53.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.407+0000 7fe25594d700 1 --2- 172.21.15.26:0/909682645 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe250099080 0x7fe250131470 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fe248009f50 tx=0x7fe248009840).stop 2023-10-01T07:51:53.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.407+0000 7fe25594d700 1 -- 172.21.15.26:0/909682645 shutdown_connections 2023-10-01T07:51:53.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.407+0000 7fe25594d700 1 --2- 172.21.15.26:0/909682645 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe250099080 0x7fe250131470 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:53.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.407+0000 7fe25594d700 1 --2- 172.21.15.26:0/909682645 >> v2:172.21.15.26:3300/0 conn(0x7fe2500650f0 0x7fe2500986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:53.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.407+0000 7fe25594d700 1 --2- 172.21.15.26:0/909682645 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe250097c30 0x7fe250098b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:53.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.407+0000 7fe25594d700 1 -- 172.21.15.26:0/909682645 >> 172.21.15.26:0/909682645 conn(0x7fe25009dc70 msgr2=0x7fe25009e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:53.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.407+0000 7fe25594d700 1 -- 172.21.15.26:0/909682645 shutdown_connections 2023-10-01T07:51:53.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.407+0000 7fe25594d700 1 -- 172.21.15.26:0/909682645 wait complete. 2023-10-01T07:51:53.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.408+0000 7fe25594d700 1 Processor -- start 2023-10-01T07:51:53.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.408+0000 7fe25594d700 1 -- start start 2023-10-01T07:51:53.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.408+0000 7fe25594d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2500650f0 0x7fe25013a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:53.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.408+0000 7fe25594d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe250099080 0x7fe25013a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:53.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.408+0000 7fe25594d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe25013ac00 0x7fe25011aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:53.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.408+0000 7fe25594d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25009ca40 con 0x7fe250099080 2023-10-01T07:51:53.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.408+0000 7fe25594d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe250099a80 con 0x7fe2500650f0 2023-10-01T07:51:53.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.408+0000 7fe25594d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe25013b040 con 0x7fe25013ac00 2023-10-01T07:51:53.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.408+0000 7fe24e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe250099080 0x7fe25013a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:53.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.408+0000 7fe24effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2500650f0 0x7fe25013a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:53.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.408+0000 7fe24e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe250099080 0x7fe25013a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37770/0 (socket says 172.21.15.26:37770) 2023-10-01T07:51:53.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.408+0000 7fe24e7fc700 1 -- 172.21.15.26:0/1940337206 learned_addr learned my addr 172.21.15.26:0/1940337206 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:53.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.408+0000 7fe24f7fe700 1 --2- 172.21.15.26:0/1940337206 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe25013ac00 0x7fe25011aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:53.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.409+0000 7fe24e7fc700 1 -- 172.21.15.26:0/1940337206 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe25013ac00 msgr2=0x7fe25011aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.409+0000 7fe24e7fc700 1 --2- 172.21.15.26:0/1940337206 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe25013ac00 0x7fe25011aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.409+0000 7fe24e7fc700 1 -- 172.21.15.26:0/1940337206 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2500650f0 msgr2=0x7fe25013a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.409+0000 7fe24e7fc700 1 --2- 172.21.15.26:0/1940337206 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2500650f0 0x7fe25013a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.409+0000 7fe24e7fc700 1 -- 172.21.15.26:0/1940337206 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2400092a0 con 0x7fe250099080 2023-10-01T07:51:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.409+0000 7fe24effd700 1 --2- 172.21.15.26:0/1940337206 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2500650f0 0x7fe25013a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.409+0000 7fe24f7fe700 1 --2- 172.21.15.26:0/1940337206 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe25013ac00 0x7fe25011aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.409+0000 7fe24e7fc700 1 --2- 172.21.15.26:0/1940337206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe250099080 0x7fe25013a710 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fe244009fd0 tx=0x7fe244009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.409+0000 7fe236ffd700 1 -- 172.21.15.26:0/1940337206 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe244012600 con 0x7fe250099080 2023-10-01T07:51:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.409+0000 7fe236ffd700 1 -- 172.21.15.26:0/1940337206 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe244012760 con 0x7fe250099080 2023-10-01T07:51:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.409+0000 7fe25594d700 1 -- 172.21.15.26:0/1940337206 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe248009ae0 con 0x7fe250099080 2023-10-01T07:51:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.409+0000 7fe236ffd700 1 -- 172.21.15.26:0/1940337206 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe244012ae0 con 0x7fe250099080 2023-10-01T07:51:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.409+0000 7fe25594d700 1 -- 172.21.15.26:0/1940337206 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe25011e7a0 con 0x7fe250099080 2023-10-01T07:51:53.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.410+0000 7fe236ffd700 1 -- 172.21.15.26:0/1940337206 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fe24401b400 con 0x7fe250099080 2023-10-01T07:51:53.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.410+0000 7fe236ffd700 1 -- 172.21.15.26:0/1940337206 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fe24403ae70 con 0x7fe250099080 2023-10-01T07:51:53.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.410+0000 7fe25594d700 1 -- 172.21.15.26:0/1940337206 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe25011e7a0 con 0x7fe250099080 2023-10-01T07:51:53.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.415+0000 7fe236ffd700 1 -- 172.21.15.26:0/1940337206 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fe25011e7a0 con 0x7fe250099080 2023-10-01T07:51:53.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.591+0000 7fe25594d700 1 -- 172.21.15.26:0/1940337206 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe25011e7a0 con 0x7fe250099080 2023-10-01T07:51:53.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.592+0000 7fe236ffd700 1 -- 172.21.15.26:0/1940337206 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+8124 (secure 0 0 0) 0x7fe25011e7a0 con 0x7fe250099080 2023-10-01T07:51:53.592 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:53.592 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":13,"fsid":"c29fb19d-520c-42a6-90f4-e7f86de96e8e","created":"2023-10-01T07:51:40.702414+0000","modified":"2023-10-01T07:51:52.874097+0000","last_up_change":"2023-10-01T07:51:48.849482+0000","last_in_change":"2023-10-01T07:51:42.084736+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-01T07:51:48.906889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-01T07:51:50.071599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"46569ce3-81d1-44a1-a649-691de3e6f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6800","nonce":118773}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6801","nonce":118773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6803","nonce":118773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6802","nonce":118773}]},"public_addr":"172.21.15.26:6800/118773","cluster_addr":"172.21.15.26:6801/118773","heartbeat_back_addr":"172.21.15.26:6803/118773","heartbeat_front_addr":"172.21.15.26:6802/118773","state":["exists","up"]},{"osd":1,"uuid":"1fc1ba9b-4110-4d31-96d6-794937578cff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6804","nonce":118782}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6806","nonce":118782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6810","nonce":118782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6808","nonce":118782}]},"public_addr":"172.21.15.26:6804/118782","cluster_addr":"172.21.15.26:6806/118782","heartbeat_back_addr":"172.21.15.26:6810/118782","heartbeat_front_addr":"172.21.15.26:6808/118782","state":["exists","up"]},{"osd":2,"uuid":"37de933d-3b8e-4b94-87bd-2f36896c7ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6805","nonce":118789}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6807","nonce":118789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6811","nonce":118789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6809","nonce":118789}]},"public_addr":"172.21.15.26:6805/118789","cluster_addr":"172.21.15.26:6807/118789","heartbeat_back_addr":"172.21.15.26:6811/118789","heartbeat_front_addr":"172.21.15.26:6809/118789","state":["exists","up"]},{"osd":3,"uuid":"bd020309-5fd2-4d97-b36a-67e159fa3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6812","nonce":118790}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6813","nonce":118790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6815","nonce":118790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6814","nonce":118790}]},"public_addr":"172.21.15.26:6812/118790","cluster_addr":"172.21.15.26:6813/118790","heartbeat_back_addr":"172.21.15.26:6815/118790","heartbeat_front_addr":"172.21.15.26:6814/118790","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.029993+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.266503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.273540+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.229731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-01T07:51:53.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.593+0000 7fe25594d700 1 -- 172.21.15.26:0/1940337206 >> v1:172.21.15.26:6816/118178 conn(0x7fe23c02bb60 legacy=0x7fe23c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:53.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.593+0000 7fe25594d700 1 -- 172.21.15.26:0/1940337206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe250099080 msgr2=0x7fe25013a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:53.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.593+0000 7fe25594d700 1 --2- 172.21.15.26:0/1940337206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe250099080 0x7fe25013a710 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fe244009fd0 tx=0x7fe244009060).stop 2023-10-01T07:51:53.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.594+0000 7fe25594d700 1 -- 172.21.15.26:0/1940337206 shutdown_connections 2023-10-01T07:51:53.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.594+0000 7fe25594d700 1 --2- 172.21.15.26:0/1940337206 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe25013ac00 0x7fe25011aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:53.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.594+0000 7fe25594d700 1 --2- 172.21.15.26:0/1940337206 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2500650f0 0x7fe25013a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:53.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.594+0000 7fe25594d700 1 --2- 172.21.15.26:0/1940337206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe250099080 0x7fe25013a710 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:53.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.594+0000 7fe25594d700 1 -- 172.21.15.26:0/1940337206 >> 172.21.15.26:0/1940337206 conn(0x7fe25009dc70 msgr2=0x7fe25009a760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:53.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.594+0000 7fe25594d700 1 -- 172.21.15.26:0/1940337206 shutdown_connections 2023-10-01T07:51:53.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.594+0000 7fe25594d700 1 -- 172.21.15.26:0/1940337206 wait complete. 2023-10-01T07:51:53.607 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-01T07:51:48.906889+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-01T07:51:50.071599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-01T07:51:53.607 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-01T07:51:53.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.740+0000 7f805ef9c700 1 Processor -- start 2023-10-01T07:51:53.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.740+0000 7f805ef9c700 1 -- start start 2023-10-01T07:51:53.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.740+0000 7f805ef9c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f80580613a0 0x7f805812ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:53.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.740+0000 7f805ef9c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f805812b230 0x7f8058068d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:53.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.741+0000 7f805ef9c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80580985c0 con 0x7f805812b610 2023-10-01T07:51:53.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.741+0000 7f805ef9c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8058061780 con 0x7f80580613a0 2023-10-01T07:51:53.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.741+0000 7f805ef9c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8058091dd0 con 0x7f805812b230 2023-10-01T07:51:53.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.741+0000 7f805cd38700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f80580613a0 0x7f805812ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:53.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.741+0000 7f8057fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f805812b230 0x7f8058068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:53.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.741+0000 7f8057fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f805812b230 0x7f8058068d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59408/0 (socket says 172.21.15.26:59408) 2023-10-01T07:51:53.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.741+0000 7f805cd38700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f80580613a0 0x7f805812ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37774/0 (socket says 172.21.15.26:37774) 2023-10-01T07:51:53.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.741+0000 7f805d539700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f805812b610 0x7f8058069210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37800/0 (socket says 172.21.15.26:37800) 2023-10-01T07:51:53.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.741+0000 7f8057fff700 1 -- 172.21.15.26:0/696554968 learned_addr learned my addr 172.21.15.26:0/696554968 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:53.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.741+0000 7f8057fff700 1 -- 172.21.15.26:0/696554968 >> v2:172.21.15.26:3300/0 conn(0x7f80580613a0 msgr2=0x7f805812ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:51:53.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.741+0000 7f8057fff700 1 --2- 172.21.15.26:0/696554968 >> v2:172.21.15.26:3300/0 conn(0x7f80580613a0 0x7f805812ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:53.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.741+0000 7f8057fff700 1 -- 172.21.15.26:0/696554968 >> v1:172.21.15.26:6789/0 conn(0x7f805812b610 legacy=0x7f8058069210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:53.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.741+0000 7f8057fff700 1 -- 172.21.15.26:0/696554968 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80580996a0 con 0x7f805812b230 2023-10-01T07:51:53.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.741+0000 7f805cd38700 1 --2- 172.21.15.26:0/696554968 >> v2:172.21.15.26:3300/0 conn(0x7f80580613a0 0x7f805812ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:53.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.741+0000 7f8057fff700 1 --2- 172.21.15.26:0/696554968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f805812b230 0x7f8058068d20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f8044009830 tx=0x7f80440090f0).ready entity=mon.2 client_cookie=e4478676967f3e0c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:53.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.741+0000 7f80577fe700 1 -- 172.21.15.26:0/696554968 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804400b580 con 0x7f805812b230 2023-10-01T07:51:53.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.741+0000 7f80577fe700 1 -- 172.21.15.26:0/696554968 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f804400b6e0 con 0x7f805812b230 2023-10-01T07:51:53.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.741+0000 7f80577fe700 1 -- 172.21.15.26:0/696554968 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804400ba60 con 0x7f805812b230 2023-10-01T07:51:53.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.742+0000 7f805ef9c700 1 -- 172.21.15.26:0/696554968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f805812b230 msgr2=0x7f8058068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:53.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.742+0000 7f805ef9c700 1 --2- 172.21.15.26:0/696554968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f805812b230 0x7f8058068d20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f8044009830 tx=0x7f80440090f0).stop 2023-10-01T07:51:53.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.742+0000 7f805ef9c700 1 -- 172.21.15.26:0/696554968 shutdown_connections 2023-10-01T07:51:53.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.742+0000 7f805ef9c700 1 --2- 172.21.15.26:0/696554968 >> v2:172.21.15.26:3300/0 conn(0x7f80580613a0 0x7f805812ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:53.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.742+0000 7f805ef9c700 1 --2- 172.21.15.26:0/696554968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f805812b230 0x7f8058068d20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:53.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.742+0000 7f805ef9c700 1 -- 172.21.15.26:0/696554968 >> 172.21.15.26:0/696554968 conn(0x7f805809a1c0 msgr2=0x7f805809a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:53.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.742+0000 7f805ef9c700 1 -- 172.21.15.26:0/696554968 shutdown_connections 2023-10-01T07:51:53.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.742+0000 7f805ef9c700 1 -- 172.21.15.26:0/696554968 wait complete. 2023-10-01T07:51:53.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.743+0000 7f805ef9c700 1 Processor -- start 2023-10-01T07:51:53.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.743+0000 7f805ef9c700 1 -- start start 2023-10-01T07:51:53.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.744+0000 7f805ef9c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80580613a0 0x7f8058128690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:53.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.744+0000 7f805ef9c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f805812b230 0x7f80581175d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:53.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.744+0000 7f805ef9c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f805812b610 0x7f8058117ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:53.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.744+0000 7f805ef9c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805811bae0 con 0x7f80580613a0 2023-10-01T07:51:53.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.744+0000 7f805ef9c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f805811b6f0 con 0x7f805812b230 2023-10-01T07:51:53.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.744+0000 7f805ef9c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f805811ab60 con 0x7f805812b610 2023-10-01T07:51:53.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.744+0000 7f805cd38700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80580613a0 0x7f8058128690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:53.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.744+0000 7f805cd38700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80580613a0 0x7f8058128690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37780/0 (socket says 172.21.15.26:37780) 2023-10-01T07:51:53.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.744+0000 7f805d539700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f805812b610 0x7f8058117ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:53.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.744+0000 7f805cd38700 1 -- 172.21.15.26:0/1001023398 learned_addr learned my addr 172.21.15.26:0/1001023398 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:53.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.744+0000 7f8057fff700 1 --2- 172.21.15.26:0/1001023398 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f805812b230 0x7f80581175d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:53.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.744+0000 7f805d539700 1 -- 172.21.15.26:0/1001023398 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f805812b230 msgr2=0x7f80581175d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:53.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.744+0000 7f805d539700 1 --2- 172.21.15.26:0/1001023398 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f805812b230 0x7f80581175d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:53.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.744+0000 7f805d539700 1 -- 172.21.15.26:0/1001023398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80580613a0 msgr2=0x7f8058128690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:53.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.744+0000 7f805d539700 1 --2- 172.21.15.26:0/1001023398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80580613a0 0x7f8058128690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:53.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.744+0000 7f805d539700 1 -- 172.21.15.26:0/1001023398 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804c0092a0 con 0x7f805812b610 2023-10-01T07:51:53.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.744+0000 7f805cd38700 1 --2- 172.21.15.26:0/1001023398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80580613a0 0x7f8058128690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:53.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.744+0000 7f805d539700 1 --2- 172.21.15.26:0/1001023398 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f805812b610 0x7f8058117ac0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f805000c790 tx=0x7f8050001530).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:53.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.744+0000 7f8054ff9700 1 -- 172.21.15.26:0/1001023398 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80500015c0 con 0x7f805812b610 2023-10-01T07:51:53.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.744+0000 7f8054ff9700 1 -- 172.21.15.26:0/1001023398 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8050005c70 con 0x7f805812b610 2023-10-01T07:51:53.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.744+0000 7f8054ff9700 1 -- 172.21.15.26:0/1001023398 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80500070d0 con 0x7f805812b610 2023-10-01T07:51:53.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.744+0000 7f805ef9c700 1 -- 172.21.15.26:0/1001023398 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8044009370 con 0x7f805812b610 2023-10-01T07:51:53.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.744+0000 7f805ef9c700 1 -- 172.21.15.26:0/1001023398 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80581189d0 con 0x7f805812b610 2023-10-01T07:51:53.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.745+0000 7f8054ff9700 1 -- 172.21.15.26:0/1001023398 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f80500074c0 con 0x7f805812b610 2023-10-01T07:51:53.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.745+0000 7f8054ff9700 1 -- 172.21.15.26:0/1001023398 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f805003a570 con 0x7f805812b610 2023-10-01T07:51:53.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.746+0000 7f805ef9c700 1 -- 172.21.15.26:0/1001023398 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8058068820 con 0x7f805812b610 2023-10-01T07:51:53.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.750+0000 7f8054ff9700 1 -- 172.21.15.26:0/1001023398 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f8050007770 con 0x7f805812b610 2023-10-01T07:51:53.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.929+0000 7f805ef9c700 1 -- 172.21.15.26:0/1001023398 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f805805a260 con 0x7f805812b610 2023-10-01T07:51:53.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.930+0000 7f8054ff9700 1 -- 172.21.15.26:0/1001023398 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v13) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8050011350 con 0x7f805812b610 2023-10-01T07:51:53.930 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-01T07:51:53.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.932+0000 7f805ef9c700 1 -- 172.21.15.26:0/1001023398 >> v1:172.21.15.26:6816/118178 conn(0x7f803c02bb90 legacy=0x7f803c02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:53.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.932+0000 7f805ef9c700 1 -- 172.21.15.26:0/1001023398 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f805812b610 msgr2=0x7f8058117ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:53.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.932+0000 7f805ef9c700 1 --2- 172.21.15.26:0/1001023398 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f805812b610 0x7f8058117ac0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f805000c790 tx=0x7f8050001530).stop 2023-10-01T07:51:53.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.932+0000 7f805ef9c700 1 -- 172.21.15.26:0/1001023398 shutdown_connections 2023-10-01T07:51:53.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.932+0000 7f805ef9c700 1 --2- 172.21.15.26:0/1001023398 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f805812b610 0x7f8058117ac0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:53.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.932+0000 7f805ef9c700 1 --2- 172.21.15.26:0/1001023398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80580613a0 0x7f8058128690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:53.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.932+0000 7f805ef9c700 1 --2- 172.21.15.26:0/1001023398 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f805812b230 0x7f80581175d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:53.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.932+0000 7f805ef9c700 1 -- 172.21.15.26:0/1001023398 >> 172.21.15.26:0/1001023398 conn(0x7f805809a1c0 msgr2=0x7f80581290f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:53.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.932+0000 7f805ef9c700 1 -- 172.21.15.26:0/1001023398 shutdown_connections 2023-10-01T07:51:53.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:53.932+0000 7f805ef9c700 1 -- 172.21.15.26:0/1001023398 wait complete. 2023-10-01T07:51:53.946 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-01T07:51:54.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.078+0000 7f5f1842d700 1 Processor -- start 2023-10-01T07:51:54.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.078+0000 7f5f1842d700 1 -- start start 2023-10-01T07:51:54.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.078+0000 7f5f1842d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5f10059070 0x7f5f10125250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:54.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.078+0000 7f5f1842d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f101257f0 0x7f5f10125c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:54.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.079+0000 7f5f1842d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f10098790 con 0x7f5f10093bf0 2023-10-01T07:51:54.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.079+0000 7f5f1842d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f10059450 con 0x7f5f10059070 2023-10-01T07:51:54.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.079+0000 7f5f1842d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f10059da0 con 0x7f5f101257f0 2023-10-01T07:51:54.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.079+0000 7f5f161c9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5f10059070 0x7f5f10125250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:54.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.079+0000 7f5f159c8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f101257f0 0x7f5f10125c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:54.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.079+0000 7f5f159c8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f101257f0 0x7f5f10125c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43826/0 (socket says 172.21.15.26:43826) 2023-10-01T07:51:54.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.079+0000 7f5f161c9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5f10059070 0x7f5f10125250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37794/0 (socket says 172.21.15.26:37794) 2023-10-01T07:51:54.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.079+0000 7f5f159c8700 1 -- 172.21.15.26:0/1071194632 learned_addr learned my addr 172.21.15.26:0/1071194632 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:54.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.079+0000 7f5f169ca700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5f10093bf0 0x7f5f100940a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37808/0 (socket says 172.21.15.26:37808) 2023-10-01T07:51:54.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.079+0000 7f5f161c9700 1 -- 172.21.15.26:0/1071194632 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f101257f0 msgr2=0x7f5f10125c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:51:54.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.079+0000 7f5f161c9700 1 --2- 172.21.15.26:0/1071194632 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f101257f0 0x7f5f10125c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:54.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.079+0000 7f5f161c9700 1 -- 172.21.15.26:0/1071194632 >> v1:172.21.15.26:6789/0 conn(0x7f5f10093bf0 legacy=0x7f5f100940a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:54.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.079+0000 7f5f161c9700 1 -- 172.21.15.26:0/1071194632 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f100996f0 con 0x7f5f10059070 2023-10-01T07:51:54.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.079+0000 7f5f151c7700 1 -- 172.21.15.26:0/1071194632 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3038605154 0 0) 0x7f5f10098790 con 0x7f5f10093bf0 2023-10-01T07:51:54.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.079+0000 7f5f159c8700 1 --2- 172.21.15.26:0/1071194632 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f101257f0 0x7f5f10125c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:54.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.079+0000 7f5f161c9700 1 --2- 172.21.15.26:0/1071194632 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f10059070 0x7f5f10125250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f5f0c009790 tx=0x7f5f0c009060).ready entity=mon.0 client_cookie=5eef39b0dbada824 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:54.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.079+0000 7f5f151c7700 1 -- 172.21.15.26:0/1071194632 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c0090d0 con 0x7f5f10059070 2023-10-01T07:51:54.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.079+0000 7f5f151c7700 1 -- 172.21.15.26:0/1071194632 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0c00f510 con 0x7f5f10059070 2023-10-01T07:51:54.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.079+0000 7f5f151c7700 1 -- 172.21.15.26:0/1071194632 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c00f890 con 0x7f5f10059070 2023-10-01T07:51:54.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.080+0000 7f5f1842d700 1 -- 172.21.15.26:0/1071194632 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f10059070 msgr2=0x7f5f10125250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:54.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.080+0000 7f5f1842d700 1 --2- 172.21.15.26:0/1071194632 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f10059070 0x7f5f10125250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f5f0c009790 tx=0x7f5f0c009060).stop 2023-10-01T07:51:54.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.080+0000 7f5f1842d700 1 -- 172.21.15.26:0/1071194632 shutdown_connections 2023-10-01T07:51:54.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.080+0000 7f5f1842d700 1 --2- 172.21.15.26:0/1071194632 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f10059070 0x7f5f10125250 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:54.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.080+0000 7f5f1842d700 1 --2- 172.21.15.26:0/1071194632 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f101257f0 0x7f5f10125c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:54.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.080+0000 7f5f1842d700 1 -- 172.21.15.26:0/1071194632 >> 172.21.15.26:0/1071194632 conn(0x7f5f10097480 msgr2=0x7f5f10097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:54.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.080+0000 7f5f1842d700 1 -- 172.21.15.26:0/1071194632 shutdown_connections 2023-10-01T07:51:54.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.080+0000 7f5f1842d700 1 -- 172.21.15.26:0/1071194632 wait complete. 2023-10-01T07:51:54.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.081+0000 7f5f1842d700 1 Processor -- start 2023-10-01T07:51:54.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.081+0000 7f5f1842d700 1 -- start start 2023-10-01T07:51:54.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.082+0000 7f5f1842d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f10059070 0x7f5f101381f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:54.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.082+0000 7f5f1842d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f10093bf0 0x7f5f101386e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:54.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.082+0000 7f5f1842d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f101257f0 0x7f5f10067910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:54.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.082+0000 7f5f1842d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f10098ea0 con 0x7f5f10059070 2023-10-01T07:51:54.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.082+0000 7f5f1842d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f10126de0 con 0x7f5f10093bf0 2023-10-01T07:51:54.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.082+0000 7f5f1842d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1012cf60 con 0x7f5f101257f0 2023-10-01T07:51:54.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.082+0000 7f5f161c9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f10059070 0x7f5f101381f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:54.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.082+0000 7f5f159c8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f10093bf0 0x7f5f101386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:54.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.082+0000 7f5f161c9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f10059070 0x7f5f101381f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37804/0 (socket says 172.21.15.26:37804) 2023-10-01T07:51:54.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.082+0000 7f5f161c9700 1 -- 172.21.15.26:0/527211862 learned_addr learned my addr 172.21.15.26:0/527211862 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:54.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.082+0000 7f5f169ca700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f101257f0 0x7f5f10067910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:54.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.082+0000 7f5f161c9700 1 -- 172.21.15.26:0/527211862 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f101257f0 msgr2=0x7f5f10067910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:54.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.082+0000 7f5f161c9700 1 --2- 172.21.15.26:0/527211862 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f101257f0 0x7f5f10067910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:54.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.082+0000 7f5f161c9700 1 -- 172.21.15.26:0/527211862 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f10093bf0 msgr2=0x7f5f101386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:54.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.082+0000 7f5f161c9700 1 --2- 172.21.15.26:0/527211862 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f10093bf0 0x7f5f101386e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:54.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.082+0000 7f5f161c9700 1 -- 172.21.15.26:0/527211862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f00009370 con 0x7f5f10059070 2023-10-01T07:51:54.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.082+0000 7f5f161c9700 1 --2- 172.21.15.26:0/527211862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f10059070 0x7f5f101381f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f5f10098920 tx=0x7f5f0c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:54.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.082+0000 7f5f067fc700 1 -- 172.21.15.26:0/527211862 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c00f890 con 0x7f5f10059070 2023-10-01T07:51:54.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.082+0000 7f5f067fc700 1 -- 172.21.15.26:0/527211862 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0c00fc50 con 0x7f5f10059070 2023-10-01T07:51:54.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.082+0000 7f5f1842d700 1 -- 172.21.15.26:0/527211862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f0c0092a0 con 0x7f5f10059070 2023-10-01T07:51:54.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.082+0000 7f5f067fc700 1 -- 172.21.15.26:0/527211862 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c01b410 con 0x7f5f10059070 2023-10-01T07:51:54.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.082+0000 7f5f1842d700 1 -- 172.21.15.26:0/527211862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f10112560 con 0x7f5f10059070 2023-10-01T07:51:54.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.083+0000 7f5f067fc700 1 -- 172.21.15.26:0/527211862 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f5f0c01b840 con 0x7f5f10059070 2023-10-01T07:51:54.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.083+0000 7f5f067fc700 1 -- 172.21.15.26:0/527211862 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f5f0c03c530 con 0x7f5f10059070 2023-10-01T07:51:54.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.083+0000 7f5f1842d700 1 -- 172.21.15.26:0/527211862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f1005a260 con 0x7f5f10059070 2023-10-01T07:51:54.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.088+0000 7f5f067fc700 1 -- 172.21.15.26:0/527211862 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f5f0c023400 con 0x7f5f10059070 2023-10-01T07:51:54.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.263+0000 7f5f1842d700 1 -- 172.21.15.26:0/527211862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5f10046c20 con 0x7f5f10059070 2023-10-01T07:51:54.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.263+0000 7f5f067fc700 1 -- 172.21.15.26:0/527211862 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v13) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5f0c019b70 con 0x7f5f10059070 2023-10-01T07:51:54.264 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 8 2023-10-01T07:51:54.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.265+0000 7f5f1842d700 1 -- 172.21.15.26:0/527211862 >> v1:172.21.15.26:6816/118178 conn(0x7f5ef402bb90 legacy=0x7f5ef402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:54.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.265+0000 7f5f1842d700 1 -- 172.21.15.26:0/527211862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f10059070 msgr2=0x7f5f101381f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:54.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.265+0000 7f5f1842d700 1 --2- 172.21.15.26:0/527211862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f10059070 0x7f5f101381f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f5f10098920 tx=0x7f5f0c017000).stop 2023-10-01T07:51:54.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.265+0000 7f5f1842d700 1 -- 172.21.15.26:0/527211862 shutdown_connections 2023-10-01T07:51:54.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.265+0000 7f5f1842d700 1 --2- 172.21.15.26:0/527211862 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f101257f0 0x7f5f10067910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:54.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.265+0000 7f5f1842d700 1 --2- 172.21.15.26:0/527211862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f10059070 0x7f5f101381f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:54.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.265+0000 7f5f1842d700 1 --2- 172.21.15.26:0/527211862 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f10093bf0 0x7f5f101386e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:54.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.265+0000 7f5f1842d700 1 -- 172.21.15.26:0/527211862 >> 172.21.15.26:0/527211862 conn(0x7f5f10097480 msgr2=0x7f5f1012bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:54.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.265+0000 7f5f1842d700 1 -- 172.21.15.26:0/527211862 shutdown_connections 2023-10-01T07:51:54.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.265+0000 7f5f1842d700 1 -- 172.21.15.26:0/527211862 wait complete. 2023-10-01T07:51:54.279 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-01T07:51:54.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.408+0000 7fe019f64700 1 Processor -- start 2023-10-01T07:51:54.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.408+0000 7fe019f64700 1 -- start start 2023-10-01T07:51:54.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.409+0000 7fe019f64700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe0141251c0 0x7fe01412da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:54.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.409+0000 7fe019f64700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe014125dd0 0x7fe01412ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:54.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.409+0000 7fe019f64700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe014095f00 con 0x7fe014059070 2023-10-01T07:51:54.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.409+0000 7fe019f64700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe014059450 con 0x7fe014125dd0 2023-10-01T07:51:54.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.409+0000 7fe019f64700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe014096190 con 0x7fe0141251c0 2023-10-01T07:51:54.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.409+0000 7fe013fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe014125dd0 0x7fe01412ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:54.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.409+0000 7fe012ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe0141251c0 0x7fe01412da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:54.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.409+0000 7fe013fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe014125dd0 0x7fe01412ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37816/0 (socket says 172.21.15.26:37816) 2023-10-01T07:51:54.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.409+0000 7fe012ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe0141251c0 0x7fe01412da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43854/0 (socket says 172.21.15.26:43854) 2023-10-01T07:51:54.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.409+0000 7fe013fff700 1 -- 172.21.15.26:0/2951814536 learned_addr learned my addr 172.21.15.26:0/2951814536 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:54.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.409+0000 7fe013fff700 1 -- 172.21.15.26:0/2951814536 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe0141251c0 msgr2=0x7fe01412da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:51:54.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.409+0000 7fe013fff700 1 --2- 172.21.15.26:0/2951814536 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe0141251c0 0x7fe01412da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:54.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.409+0000 7fe013fff700 1 -- 172.21.15.26:0/2951814536 >> v1:172.21.15.26:6789/0 conn(0x7fe014059070 legacy=0x7fe0141256c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:54.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.409+0000 7fe0127fc700 1 -- 172.21.15.26:0/2951814536 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3436813025 0 0) 0x7fe014095f00 con 0x7fe014059070 2023-10-01T07:51:54.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.409+0000 7fe013fff700 1 -- 172.21.15.26:0/2951814536 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe014059dd0 con 0x7fe014125dd0 2023-10-01T07:51:54.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.409+0000 7fe012ffd700 1 --2- 172.21.15.26:0/2951814536 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe0141251c0 0x7fe01412da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:54.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.409+0000 7fe013fff700 1 --2- 172.21.15.26:0/2951814536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe014125dd0 0x7fe01412ff80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fe00c009f20 tx=0x7fe00c009840).ready entity=mon.0 client_cookie=53c5b3dd6231b30e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:54.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.410+0000 7fe0127fc700 1 -- 172.21.15.26:0/2951814536 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c00e070 con 0x7fe014125dd0 2023-10-01T07:51:54.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.410+0000 7fe0127fc700 1 -- 172.21.15.26:0/2951814536 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00c00b9d0 con 0x7fe014125dd0 2023-10-01T07:51:54.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.410+0000 7fe0127fc700 1 -- 172.21.15.26:0/2951814536 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c00bd50 con 0x7fe014125dd0 2023-10-01T07:51:54.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.410+0000 7fe019f64700 1 -- 172.21.15.26:0/2951814536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe014125dd0 msgr2=0x7fe01412ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:54.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.410+0000 7fe019f64700 1 --2- 172.21.15.26:0/2951814536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe014125dd0 0x7fe01412ff80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fe00c009f20 tx=0x7fe00c009840).stop 2023-10-01T07:51:54.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.410+0000 7fe019f64700 1 -- 172.21.15.26:0/2951814536 shutdown_connections 2023-10-01T07:51:54.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.410+0000 7fe019f64700 1 --2- 172.21.15.26:0/2951814536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe014125dd0 0x7fe01412ff80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:54.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.410+0000 7fe019f64700 1 --2- 172.21.15.26:0/2951814536 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe0141251c0 0x7fe01412da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:54.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.410+0000 7fe019f64700 1 -- 172.21.15.26:0/2951814536 >> 172.21.15.26:0/2951814536 conn(0x7fe014097470 msgr2=0x7fe014097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:54.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.410+0000 7fe019f64700 1 -- 172.21.15.26:0/2951814536 shutdown_connections 2023-10-01T07:51:54.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.410+0000 7fe019f64700 1 -- 172.21.15.26:0/2951814536 wait complete. 2023-10-01T07:51:54.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.411+0000 7fe019f64700 1 Processor -- start 2023-10-01T07:51:54.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.411+0000 7fe019f64700 1 -- start start 2023-10-01T07:51:54.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.412+0000 7fe019f64700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe014059070 0x7fe0140664e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:54.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.412+0000 7fe019f64700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe0141251c0 0x7fe0140669d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:54.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.412+0000 7fe019f64700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe014125dd0 0x7fe014066ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:54.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.412+0000 7fe019f64700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01406a590 con 0x7fe014125dd0 2023-10-01T07:51:54.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.412+0000 7fe019f64700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe01412fe90 con 0x7fe0141251c0 2023-10-01T07:51:54.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.412+0000 7fe019f64700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0140958d0 con 0x7fe014059070 2023-10-01T07:51:54.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.412+0000 7fe012ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe0141251c0 0x7fe0140669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:54.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.412+0000 7fe013fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe014125dd0 0x7fe014066ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:54.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.412+0000 7fe012ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe0141251c0 0x7fe0140669d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43862/0 (socket says 172.21.15.26:43862) 2023-10-01T07:51:54.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.412+0000 7fe012ffd700 1 -- 172.21.15.26:0/2625522028 learned_addr learned my addr 172.21.15.26:0/2625522028 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:54.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.412+0000 7fe0137fe700 1 --2- 172.21.15.26:0/2625522028 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe014059070 0x7fe0140664e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:54.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.412+0000 7fe012ffd700 1 -- 172.21.15.26:0/2625522028 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe014059070 msgr2=0x7fe0140664e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:54.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.412+0000 7fe012ffd700 1 --2- 172.21.15.26:0/2625522028 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe014059070 0x7fe0140664e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:54.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.412+0000 7fe012ffd700 1 -- 172.21.15.26:0/2625522028 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe014125dd0 msgr2=0x7fe014066ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:54.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.412+0000 7fe012ffd700 1 --2- 172.21.15.26:0/2625522028 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe014125dd0 0x7fe014066ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:54.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.412+0000 7fe012ffd700 1 -- 172.21.15.26:0/2625522028 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdffc0092a0 con 0x7fe0141251c0 2023-10-01T07:51:54.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.412+0000 7fe013fff700 1 --2- 172.21.15.26:0/2625522028 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe014125dd0 0x7fe014066ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:54.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.413+0000 7fe012ffd700 1 --2- 172.21.15.26:0/2625522028 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe0141251c0 0x7fe0140669d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fdffc00ea50 tx=0x7fdffc009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:54.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.413+0000 7fe00b7fe700 1 -- 172.21.15.26:0/2625522028 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc00ee90 con 0x7fe0141251c0 2023-10-01T07:51:54.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.413+0000 7fe00b7fe700 1 -- 172.21.15.26:0/2625522028 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdffc00c850 con 0x7fe0141251c0 2023-10-01T07:51:54.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.413+0000 7fe019f64700 1 -- 172.21.15.26:0/2625522028 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe00c009ae0 con 0x7fe0141251c0 2023-10-01T07:51:54.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.413+0000 7fe00b7fe700 1 -- 172.21.15.26:0/2625522028 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc00cbd0 con 0x7fe0141251c0 2023-10-01T07:51:54.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.413+0000 7fe019f64700 1 -- 172.21.15.26:0/2625522028 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe01406a1c0 con 0x7fe0141251c0 2023-10-01T07:51:54.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.413+0000 7fe00b7fe700 1 -- 172.21.15.26:0/2625522028 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fdffc01b400 con 0x7fe0141251c0 2023-10-01T07:51:54.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.414+0000 7fe00b7fe700 1 -- 172.21.15.26:0/2625522028 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fdffc03b190 con 0x7fe0141251c0 2023-10-01T07:51:54.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.414+0000 7fe019f64700 1 -- 172.21.15.26:0/2625522028 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe01406a3e0 con 0x7fe0141251c0 2023-10-01T07:51:54.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.419+0000 7fe00b7fe700 1 -- 172.21.15.26:0/2625522028 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fdffc01be60 con 0x7fe0141251c0 2023-10-01T07:51:54.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.596+0000 7fe019f64700 1 -- 172.21.15.26:0/2625522028 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe01405a260 con 0x7fe0141251c0 2023-10-01T07:51:54.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.596+0000 7fe00b7fe700 1 -- 172.21.15.26:0/2625522028 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v13) v1 ==== 84+0+143 (secure 0 0 0) 0x7fdffc01be60 con 0x7fe0141251c0 2023-10-01T07:51:54.599 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:54.599 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-10-01T07:51:54.599 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:51:54.599 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 1, 2023-10-01T07:51:54.599 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": "device_health_metrics" 2023-10-01T07:51:54.599 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:51:54.599 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:51:54.599 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 2, 2023-10-01T07:51:54.599 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": "rbd" 2023-10-01T07:51:54.599 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:51:54.599 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-10-01T07:51:54.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.598+0000 7fe019f64700 1 -- 172.21.15.26:0/2625522028 >> v1:172.21.15.26:6816/118178 conn(0x7fdff402bb60 legacy=0x7fdff402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:54.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.598+0000 7fe019f64700 1 -- 172.21.15.26:0/2625522028 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe0141251c0 msgr2=0x7fe0140669d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:54.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.598+0000 7fe019f64700 1 --2- 172.21.15.26:0/2625522028 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe0141251c0 0x7fe0140669d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fdffc00ea50 tx=0x7fdffc009060).stop 2023-10-01T07:51:54.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.598+0000 7fe019f64700 1 -- 172.21.15.26:0/2625522028 shutdown_connections 2023-10-01T07:51:54.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.598+0000 7fe019f64700 1 --2- 172.21.15.26:0/2625522028 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe014125dd0 0x7fe014066ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:54.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.598+0000 7fe019f64700 1 --2- 172.21.15.26:0/2625522028 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe014059070 0x7fe0140664e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:54.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.598+0000 7fe019f64700 1 --2- 172.21.15.26:0/2625522028 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe0141251c0 0x7fe0140669d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:54.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.598+0000 7fe019f64700 1 -- 172.21.15.26:0/2625522028 >> 172.21.15.26:0/2625522028 conn(0x7fe014097470 msgr2=0x7fe01412f380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:54.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.598+0000 7fe019f64700 1 -- 172.21.15.26:0/2625522028 shutdown_connections 2023-10-01T07:51:54.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.598+0000 7fe019f64700 1 -- 172.21.15.26:0/2625522028 wait complete. 2023-10-01T07:51:54.611 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-01T07:51:54.611 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-01T07:51:54.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.746+0000 7f27d4deb700 1 Processor -- start 2023-10-01T07:51:54.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.746+0000 7f27d4deb700 1 -- start start 2023-10-01T07:51:54.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.746+0000 7f27d4deb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f27d0059070 0x7f27d01277f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:54.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.746+0000 7f27d4deb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f27d01280e0 0x7f27d012b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:54.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.746+0000 7f27d4deb700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d0092b60 con 0x7f27d0127ce0 2023-10-01T07:51:54.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.746+0000 7f27d4deb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d0059450 con 0x7f27d0059070 2023-10-01T07:51:54.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.746+0000 7f27d4deb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27d0091c10 con 0x7f27d01280e0 2023-10-01T07:51:54.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.747+0000 7f27ce59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f27d0059070 0x7f27d01277f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:54.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.747+0000 7f27ced9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f27d01280e0 0x7f27d012b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:54.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.747+0000 7f27cdd9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f27d0127ce0 0x7f27d012a9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37830/0 (socket says 172.21.15.26:37830) 2023-10-01T07:51:54.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.747+0000 7f27cdd9b700 1 -- 172.21.15.26:0/1855693092 learned_addr learned my addr 172.21.15.26:0/1855693092 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:51:54.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.747+0000 7f27cd59a700 1 -- 172.21.15.26:0/1855693092 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4288621272 0 0) 0x7f27d0092b60 con 0x7f27d0127ce0 2023-10-01T07:51:54.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.747+0000 7f27cd59a700 1 -- 172.21.15.26:0/1855693092 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27bc0033f0 con 0x7f27d0127ce0 2023-10-01T07:51:54.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.747+0000 7f27ce59c700 1 -- 172.21.15.26:0/1855693092 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f27d01280e0 msgr2=0x7f27d012b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:51:54.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.747+0000 7f27ce59c700 1 --2- 172.21.15.26:0/1855693092 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f27d01280e0 0x7f27d012b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:54.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.747+0000 7f27ce59c700 1 -- 172.21.15.26:0/1855693092 >> v1:172.21.15.26:6789/0 conn(0x7f27d0127ce0 legacy=0x7f27d012a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:54.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.747+0000 7f27ce59c700 1 -- 172.21.15.26:0/1855693092 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d0096810 con 0x7f27d0059070 2023-10-01T07:51:54.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.747+0000 7f27ced9d700 1 --2- 172.21.15.26:0/1855693092 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f27d01280e0 0x7f27d012b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:54.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.747+0000 7f27ce59c700 1 --2- 172.21.15.26:0/1855693092 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f27d0059070 0x7f27d01277f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f27b8009790 tx=0x7f27b8009060).ready entity=mon.1 client_cookie=555080295adba69b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:54.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.747+0000 7f27cd59a700 1 -- 172.21.15.26:0/1855693092 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b80090d0 con 0x7f27d0059070 2023-10-01T07:51:54.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.747+0000 7f27cd59a700 1 -- 172.21.15.26:0/1855693092 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b800f510 con 0x7f27d0059070 2023-10-01T07:51:54.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.747+0000 7f27cd59a700 1 -- 172.21.15.26:0/1855693092 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b800f890 con 0x7f27d0059070 2023-10-01T07:51:54.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.748+0000 7f27d4deb700 1 -- 172.21.15.26:0/1855693092 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f27d0059070 msgr2=0x7f27d01277f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:54.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.748+0000 7f27d4deb700 1 --2- 172.21.15.26:0/1855693092 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f27d0059070 0x7f27d01277f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f27b8009790 tx=0x7f27b8009060).stop 2023-10-01T07:51:54.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.748+0000 7f27d4deb700 1 -- 172.21.15.26:0/1855693092 shutdown_connections 2023-10-01T07:51:54.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.748+0000 7f27d4deb700 1 --2- 172.21.15.26:0/1855693092 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f27d01280e0 0x7f27d012b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:54.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.748+0000 7f27d4deb700 1 --2- 172.21.15.26:0/1855693092 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f27d0059070 0x7f27d01277f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:54.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.748+0000 7f27d4deb700 1 -- 172.21.15.26:0/1855693092 >> 172.21.15.26:0/1855693092 conn(0x7f27d0097560 msgr2=0x7f27d0097970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:54.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.748+0000 7f27d4deb700 1 -- 172.21.15.26:0/1855693092 shutdown_connections 2023-10-01T07:51:54.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.748+0000 7f27d4deb700 1 -- 172.21.15.26:0/1855693092 wait complete. 2023-10-01T07:51:54.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.749+0000 7f27d4deb700 1 Processor -- start 2023-10-01T07:51:54.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.749+0000 7f27d4deb700 1 -- start start 2023-10-01T07:51:54.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.749+0000 7f27d4deb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f27d0059070 0x7f27d0117d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:54.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.749+0000 7f27d4deb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f27d0127ce0 0x7f27d0113e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:54.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.750+0000 7f27d4deb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27d01280e0 0x7f27d01142f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:54.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.750+0000 7f27d4deb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d0096fd0 con 0x7f27d01280e0 2023-10-01T07:51:54.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.750+0000 7f27d4deb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d0116e70 con 0x7f27d0059070 2023-10-01T07:51:54.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.750+0000 7f27d4deb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27d01172b0 con 0x7f27d0127ce0 2023-10-01T07:51:54.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.750+0000 7f27cdd9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f27d0127ce0 0x7f27d0113e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:54.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.750+0000 7f27ced9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27d01280e0 0x7f27d01142f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:54.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.750+0000 7f27cdd9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f27d0127ce0 0x7f27d0113e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59448/0 (socket says 172.21.15.26:59448) 2023-10-01T07:51:54.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.750+0000 7f27cdd9b700 1 -- 172.21.15.26:0/3025678769 learned_addr learned my addr 172.21.15.26:0/3025678769 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:54.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.750+0000 7f27ce59c700 1 --2- 172.21.15.26:0/3025678769 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f27d0059070 0x7f27d0117d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:54.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.750+0000 7f27ced9d700 1 -- 172.21.15.26:0/3025678769 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f27d0127ce0 msgr2=0x7f27d0113e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:54.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.750+0000 7f27ced9d700 1 --2- 172.21.15.26:0/3025678769 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f27d0127ce0 0x7f27d0113e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:54.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.750+0000 7f27ced9d700 1 -- 172.21.15.26:0/3025678769 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f27d0059070 msgr2=0x7f27d0117d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:54.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.750+0000 7f27ced9d700 1 --2- 172.21.15.26:0/3025678769 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f27d0059070 0x7f27d0117d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:54.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.750+0000 7f27ced9d700 1 -- 172.21.15.26:0/3025678769 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c8009a20 con 0x7f27d01280e0 2023-10-01T07:51:54.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.750+0000 7f27ce59c700 1 --2- 172.21.15.26:0/3025678769 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f27d0059070 0x7f27d0117d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:54.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.750+0000 7f27ced9d700 1 --2- 172.21.15.26:0/3025678769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27d01280e0 0x7f27d01142f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f27c8009ee0 tx=0x7f27c800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:54.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.750+0000 7f27c67fc700 1 -- 172.21.15.26:0/3025678769 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c800cb70 con 0x7f27d01280e0 2023-10-01T07:51:54.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.750+0000 7f27c67fc700 1 -- 172.21.15.26:0/3025678769 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c800f040 con 0x7f27d01280e0 2023-10-01T07:51:54.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.750+0000 7f27d4deb700 1 -- 172.21.15.26:0/3025678769 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27b80092a0 con 0x7f27d01280e0 2023-10-01T07:51:54.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.750+0000 7f27c67fc700 1 -- 172.21.15.26:0/3025678769 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c8013400 con 0x7f27d01280e0 2023-10-01T07:51:54.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.750+0000 7f27d4deb700 1 -- 172.21.15.26:0/3025678769 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d0115940 con 0x7f27d01280e0 2023-10-01T07:51:54.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.751+0000 7f27c67fc700 1 -- 172.21.15.26:0/3025678769 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f27c80137f0 con 0x7f27d01280e0 2023-10-01T07:51:54.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.751+0000 7f27c67fc700 1 -- 172.21.15.26:0/3025678769 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f27c803b4a0 con 0x7f27d01280e0 2023-10-01T07:51:54.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.752+0000 7f27d4deb700 1 -- 172.21.15.26:0/3025678769 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d005a260 con 0x7f27d01280e0 2023-10-01T07:51:54.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.756+0000 7f27c67fc700 1 -- 172.21.15.26:0/3025678769 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f27c801bbd0 con 0x7f27d01280e0 2023-10-01T07:51:54.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:54.934+0000 7f27d4deb700 1 -- 172.21.15.26:0/3025678769 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f27d0059c50 con 0x7f27d01280e0 2023-10-01T07:51:55.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:55.886+0000 7f27c67fc700 1 -- 172.21.15.26:0/3025678769 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v14) v1 ==== 138+0+0 (secure 0 0 0) 0x7f27c802b0b0 con 0x7f27d01280e0 2023-10-01T07:51:55.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:55.893+0000 7f27d4deb700 1 -- 172.21.15.26:0/3025678769 >> v1:172.21.15.26:6816/118178 conn(0x7f27b002bb90 legacy=0x7f27b002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:55.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:55.893+0000 7f27d4deb700 1 -- 172.21.15.26:0/3025678769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27d01280e0 msgr2=0x7f27d01142f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:55.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:55.893+0000 7f27d4deb700 1 --2- 172.21.15.26:0/3025678769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27d01280e0 0x7f27d01142f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f27c8009ee0 tx=0x7f27c800b040).stop 2023-10-01T07:51:55.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:55.893+0000 7f27d4deb700 1 -- 172.21.15.26:0/3025678769 shutdown_connections 2023-10-01T07:51:55.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:55.893+0000 7f27d4deb700 1 --2- 172.21.15.26:0/3025678769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27d01280e0 0x7f27d01142f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:55.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:55.893+0000 7f27d4deb700 1 --2- 172.21.15.26:0/3025678769 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f27d0059070 0x7f27d0117d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:55.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:55.893+0000 7f27d4deb700 1 --2- 172.21.15.26:0/3025678769 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f27d0127ce0 0x7f27d0113e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:55.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:55.893+0000 7f27d4deb700 1 -- 172.21.15.26:0/3025678769 >> 172.21.15.26:0/3025678769 conn(0x7f27d0097560 msgr2=0x7f27d0129600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:55.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:55.893+0000 7f27d4deb700 1 -- 172.21.15.26:0/3025678769 shutdown_connections 2023-10-01T07:51:55.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:55.894+0000 7f27d4deb700 1 -- 172.21.15.26:0/3025678769 wait complete. 2023-10-01T07:51:55.897 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' created 2023-10-01T07:51:55.912 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-01T07:51:56.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.052+0000 7f3e09a9e700 1 Processor -- start 2023-10-01T07:51:56.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.052+0000 7f3e09a9e700 1 -- start start 2023-10-01T07:51:56.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.052+0000 7f3e09a9e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e04067e90 0x7f3e04068270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:56.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.052+0000 7f3e09a9e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e041282b0 0x7f3e0412fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:56.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.052+0000 7f3e09a9e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e040690b0 con 0x7f3e04068760 2023-10-01T07:51:56.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.052+0000 7f3e09a9e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e040920e0 con 0x7f3e04067e90 2023-10-01T07:51:56.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.052+0000 7f3e09a9e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e04092330 con 0x7f3e041282b0 2023-10-01T07:51:56.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.053+0000 7f3e03fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e041282b0 0x7f3e0412fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:56.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.053+0000 7f3e037fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e04067e90 0x7f3e04068270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:56.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.053+0000 7f3e03fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e041282b0 0x7f3e0412fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59464/0 (socket says 172.21.15.26:59464) 2023-10-01T07:51:56.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.053+0000 7f3e03fff700 1 -- 172.21.15.26:0/3431288040 learned_addr learned my addr 172.21.15.26:0/3431288040 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:56.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.053+0000 7f3e037fe700 1 -- 172.21.15.26:0/3431288040 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e041282b0 msgr2=0x7f3e0412fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:51:56.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.053+0000 7f3e037fe700 1 --2- 172.21.15.26:0/3431288040 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e041282b0 0x7f3e0412fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:56.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.053+0000 7f3e037fe700 1 -- 172.21.15.26:0/3431288040 >> v1:172.21.15.26:6789/0 conn(0x7f3e04068760 legacy=0x7f3e04127ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:56.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.053+0000 7f3e037fe700 1 -- 172.21.15.26:0/3431288040 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e04069b20 con 0x7f3e04067e90 2023-10-01T07:51:56.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.053+0000 7f3e03fff700 1 --2- 172.21.15.26:0/3431288040 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e041282b0 0x7f3e0412fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:56.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.053+0000 7f3e027fc700 1 -- 172.21.15.26:0/3431288040 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3872958983 0 0) 0x7f3e040690b0 con 0x7f3e04068760 2023-10-01T07:51:56.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.053+0000 7f3e037fe700 1 --2- 172.21.15.26:0/3431288040 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e04067e90 0x7f3e04068270 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f3df4009790 tx=0x7f3df4009060).ready entity=mon.1 client_cookie=9e6cb570ec47b3b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:56.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.053+0000 7f3e027fc700 1 -- 172.21.15.26:0/3431288040 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df400f510 con 0x7f3e04067e90 2023-10-01T07:51:56.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.053+0000 7f3e027fc700 1 -- 172.21.15.26:0/3431288040 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df400f670 con 0x7f3e04067e90 2023-10-01T07:51:56.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.053+0000 7f3e027fc700 1 -- 172.21.15.26:0/3431288040 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df400f9f0 con 0x7f3e04067e90 2023-10-01T07:51:56.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.054+0000 7f3e09a9e700 1 -- 172.21.15.26:0/3431288040 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e04067e90 msgr2=0x7f3e04068270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:56.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.054+0000 7f3e09a9e700 1 --2- 172.21.15.26:0/3431288040 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e04067e90 0x7f3e04068270 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f3df4009790 tx=0x7f3df4009060).stop 2023-10-01T07:51:56.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.054+0000 7f3e09a9e700 1 -- 172.21.15.26:0/3431288040 shutdown_connections 2023-10-01T07:51:56.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.054+0000 7f3e09a9e700 1 --2- 172.21.15.26:0/3431288040 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e041282b0 0x7f3e0412fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:56.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.054+0000 7f3e09a9e700 1 --2- 172.21.15.26:0/3431288040 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e04067e90 0x7f3e04068270 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:56.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.054+0000 7f3e09a9e700 1 -- 172.21.15.26:0/3431288040 >> 172.21.15.26:0/3431288040 conn(0x7f3e0409a3d0 msgr2=0x7f3e0409a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:56.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.054+0000 7f3e09a9e700 1 -- 172.21.15.26:0/3431288040 shutdown_connections 2023-10-01T07:51:56.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.054+0000 7f3e09a9e700 1 -- 172.21.15.26:0/3431288040 wait complete. 2023-10-01T07:51:56.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.055+0000 7f3e09a9e700 1 Processor -- start 2023-10-01T07:51:56.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.055+0000 7f3e09a9e700 1 -- start start 2023-10-01T07:51:56.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.056+0000 7f3e09a9e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e04067e90 0x7f3e04066db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:56.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.056+0000 7f3e09a9e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e04068760 0x7f3e04116450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:56.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.056+0000 7f3e09a9e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e041282b0 0x7f3e04116940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:56.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.056+0000 7f3e09a9e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0411cbf0 con 0x7f3e04067e90 2023-10-01T07:51:56.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.056+0000 7f3e09a9e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e04127a80 con 0x7f3e04068760 2023-10-01T07:51:56.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.056+0000 7f3e09a9e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e04066870 con 0x7f3e041282b0 2023-10-01T07:51:56.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.056+0000 7f3e03fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e041282b0 0x7f3e04116940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:56.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.056+0000 7f3e02ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e04068760 0x7f3e04116450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:56.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.056+0000 7f3e037fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e04067e90 0x7f3e04066db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:56.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.056+0000 7f3e03fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e041282b0 0x7f3e04116940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59466/0 (socket says 172.21.15.26:59466) 2023-10-01T07:51:56.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.056+0000 7f3e03fff700 1 -- 172.21.15.26:0/1447584856 learned_addr learned my addr 172.21.15.26:0/1447584856 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:56.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.057+0000 7f3e03fff700 1 -- 172.21.15.26:0/1447584856 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e04068760 msgr2=0x7f3e04116450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:56.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.057+0000 7f3e03fff700 1 --2- 172.21.15.26:0/1447584856 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e04068760 0x7f3e04116450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:56.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.057+0000 7f3e03fff700 1 -- 172.21.15.26:0/1447584856 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e04067e90 msgr2=0x7f3e04066db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:56.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.057+0000 7f3e03fff700 1 --2- 172.21.15.26:0/1447584856 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e04067e90 0x7f3e04066db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:56.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.057+0000 7f3e03fff700 1 -- 172.21.15.26:0/1447584856 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dfc009ae0 con 0x7f3e041282b0 2023-10-01T07:51:56.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.057+0000 7f3e03fff700 1 --2- 172.21.15.26:0/1447584856 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e041282b0 0x7f3e04116940 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f3dfc00c0c0 tx=0x7f3dfc00b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:56.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.057+0000 7f3dfb7fe700 1 -- 172.21.15.26:0/1447584856 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc0092e0 con 0x7f3e041282b0 2023-10-01T07:51:56.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.057+0000 7f3dfb7fe700 1 -- 172.21.15.26:0/1447584856 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dfc00f040 con 0x7f3e041282b0 2023-10-01T07:51:56.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.057+0000 7f3e09a9e700 1 -- 172.21.15.26:0/1447584856 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df40092a0 con 0x7f3e041282b0 2023-10-01T07:51:56.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.057+0000 7f3dfb7fe700 1 -- 172.21.15.26:0/1447584856 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc00cba0 con 0x7f3e041282b0 2023-10-01T07:51:56.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.057+0000 7f3e09a9e700 1 -- 172.21.15.26:0/1447584856 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e0411d830 con 0x7f3e041282b0 2023-10-01T07:51:56.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.058+0000 7f3dfb7fe700 1 -- 172.21.15.26:0/1447584856 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f3dfc014460 con 0x7f3e041282b0 2023-10-01T07:51:56.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.058+0000 7f3dfb7fe700 1 -- 172.21.15.26:0/1447584856 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3208+0+0 (secure 0 0 0) 0x7f3dfc03ade0 con 0x7f3e041282b0 2023-10-01T07:51:56.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.058+0000 7f3e09a9e700 1 -- 172.21.15.26:0/1447584856 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e0411cf10 con 0x7f3e041282b0 2023-10-01T07:51:56.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.063+0000 7f3dfb7fe700 1 -- 172.21.15.26:0/1447584856 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f3e0411cf10 con 0x7f3e041282b0 2023-10-01T07:51:56.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.238+0000 7f3e09a9e700 1 -- 172.21.15.26:0/1447584856 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3e0411cf10 con 0x7f3e041282b0 2023-10-01T07:51:56.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.891+0000 7f3dfb7fe700 1 -- 172.21.15.26:0/1447584856 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v15) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3e0411cf10 con 0x7f3e041282b0 2023-10-01T07:51:56.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.897+0000 7f3e09a9e700 1 -- 172.21.15.26:0/1447584856 >> v1:172.21.15.26:6816/118178 conn(0x7f3de402bb60 legacy=0x7f3de402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:56.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.897+0000 7f3e09a9e700 1 -- 172.21.15.26:0/1447584856 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e041282b0 msgr2=0x7f3e04116940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:56.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.897+0000 7f3e09a9e700 1 --2- 172.21.15.26:0/1447584856 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e041282b0 0x7f3e04116940 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f3dfc00c0c0 tx=0x7f3dfc00b040).stop 2023-10-01T07:51:56.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.900+0000 7f3e09a9e700 1 -- 172.21.15.26:0/1447584856 shutdown_connections 2023-10-01T07:51:56.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.900+0000 7f3e09a9e700 1 --2- 172.21.15.26:0/1447584856 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e041282b0 0x7f3e04116940 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:56.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.900+0000 7f3e09a9e700 1 --2- 172.21.15.26:0/1447584856 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e04067e90 0x7f3e04066db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:56.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.900+0000 7f3e09a9e700 1 --2- 172.21.15.26:0/1447584856 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e04068760 0x7f3e04116450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:56.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.900+0000 7f3e09a9e700 1 -- 172.21.15.26:0/1447584856 >> 172.21.15.26:0/1447584856 conn(0x7f3e0409a3d0 msgr2=0x7f3e04096a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:56.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.904+0000 7f3e09a9e700 1 -- 172.21.15.26:0/1447584856 shutdown_connections 2023-10-01T07:51:56.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:56.904+0000 7f3e09a9e700 1 -- 172.21.15.26:0/1447584856 wait complete. 2023-10-01T07:51:56.913 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' created 2023-10-01T07:51:56.933 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-01T07:51:57.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.067+0000 7febf7723700 1 Processor -- start 2023-10-01T07:51:57.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.068+0000 7febf7723700 1 -- start start 2023-10-01T07:51:57.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.068+0000 7febf7723700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febf01275c0 0x7febf012fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:57.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.068+0000 7febf7723700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febf0130220 0x7febf0132610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:57.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.068+0000 7febf7723700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf0091c80 con 0x7febf00926d0 2023-10-01T07:51:57.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.068+0000 7febf7723700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf01279e0 con 0x7febf0130220 2023-10-01T07:51:57.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.068+0000 7febf7723700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febf00999d0 con 0x7febf01275c0 2023-10-01T07:51:57.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.068+0000 7febf4cbe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febf01275c0 0x7febf012fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:57.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.069+0000 7febf5cc0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febf0130220 0x7febf0132610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:57.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.069+0000 7febf4cbe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febf01275c0 0x7febf012fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59472/0 (socket says 172.21.15.26:59472) 2023-10-01T07:51:57.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.069+0000 7febf4cbe700 1 -- 172.21.15.26:0/3581402229 learned_addr learned my addr 172.21.15.26:0/3581402229 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:57.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.069+0000 7febf5cc0700 1 -- 172.21.15.26:0/3581402229 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febf01275c0 msgr2=0x7febf012fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:51:57.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.069+0000 7febf5cc0700 1 --2- 172.21.15.26:0/3581402229 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febf01275c0 0x7febf012fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:57.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.069+0000 7febf5cc0700 1 -- 172.21.15.26:0/3581402229 >> v1:172.21.15.26:6789/0 conn(0x7febf00926d0 legacy=0x7febf0127be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:57.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.069+0000 7febf5cc0700 1 -- 172.21.15.26:0/3581402229 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf009a280 con 0x7febf0130220 2023-10-01T07:51:57.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.069+0000 7febe7fff700 1 -- 172.21.15.26:0/3581402229 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 584817042 0 0) 0x7febf0091c80 con 0x7febf00926d0 2023-10-01T07:51:57.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.069+0000 7febf4cbe700 1 --2- 172.21.15.26:0/3581402229 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febf01275c0 0x7febf012fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:57.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.069+0000 7febf5cc0700 1 --2- 172.21.15.26:0/3581402229 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febf0130220 0x7febf0132610 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7febe8009e90 tx=0x7febe8009780).ready entity=mon.1 client_cookie=9676068f637bb9dc server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:57.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.069+0000 7febe7fff700 1 -- 172.21.15.26:0/3581402229 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe800e070 con 0x7febf0130220 2023-10-01T07:51:57.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.069+0000 7febe7fff700 1 -- 172.21.15.26:0/3581402229 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe800bb60 con 0x7febf0130220 2023-10-01T07:51:57.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.069+0000 7febe7fff700 1 -- 172.21.15.26:0/3581402229 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe8012410 con 0x7febf0130220 2023-10-01T07:51:57.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.070+0000 7febf7723700 1 -- 172.21.15.26:0/3581402229 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febf0130220 msgr2=0x7febf0132610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:57.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.070+0000 7febf7723700 1 --2- 172.21.15.26:0/3581402229 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febf0130220 0x7febf0132610 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7febe8009e90 tx=0x7febe8009780).stop 2023-10-01T07:51:57.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.070+0000 7febf7723700 1 -- 172.21.15.26:0/3581402229 shutdown_connections 2023-10-01T07:51:57.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.070+0000 7febf7723700 1 --2- 172.21.15.26:0/3581402229 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febf0130220 0x7febf0132610 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:57.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.070+0000 7febf7723700 1 --2- 172.21.15.26:0/3581402229 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febf01275c0 0x7febf012fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:57.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.070+0000 7febf7723700 1 -- 172.21.15.26:0/3581402229 >> 172.21.15.26:0/3581402229 conn(0x7febf0097480 msgr2=0x7febf0097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:57.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.070+0000 7febf7723700 1 -- 172.21.15.26:0/3581402229 shutdown_connections 2023-10-01T07:51:57.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.070+0000 7febf7723700 1 -- 172.21.15.26:0/3581402229 wait complete. 2023-10-01T07:51:57.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.071+0000 7febf7723700 1 Processor -- start 2023-10-01T07:51:57.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.071+0000 7febf7723700 1 -- start start 2023-10-01T07:51:57.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.072+0000 7febf7723700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febf00926d0 0x7febf012def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:57.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.072+0000 7febf7723700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febf01275c0 0x7febf012e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:57.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.072+0000 7febf7723700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febf0130220 0x7febf012e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:57.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.072+0000 7febf7723700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf012edc0 con 0x7febf0130220 2023-10-01T07:51:57.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.072+0000 7febf7723700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf0099340 con 0x7febf00926d0 2023-10-01T07:51:57.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.072+0000 7febf7723700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febf009a4b0 con 0x7febf01275c0 2023-10-01T07:51:57.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.072+0000 7febf54bf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febf00926d0 0x7febf012def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:57.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.072+0000 7febf5cc0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febf0130220 0x7febf012e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:57.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.072+0000 7febf54bf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febf00926d0 0x7febf012def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43914/0 (socket says 172.21.15.26:43914) 2023-10-01T07:51:57.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.072+0000 7febf54bf700 1 -- 172.21.15.26:0/3984697521 learned_addr learned my addr 172.21.15.26:0/3984697521 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:57.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.072+0000 7febf4cbe700 1 --2- 172.21.15.26:0/3984697521 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febf01275c0 0x7febf012e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:57.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.072+0000 7febf54bf700 1 -- 172.21.15.26:0/3984697521 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febf01275c0 msgr2=0x7febf012e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:57.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.072+0000 7febf54bf700 1 --2- 172.21.15.26:0/3984697521 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febf01275c0 0x7febf012e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:57.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.072+0000 7febf54bf700 1 -- 172.21.15.26:0/3984697521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febf0130220 msgr2=0x7febf012e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:57.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.072+0000 7febf54bf700 1 --2- 172.21.15.26:0/3984697521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febf0130220 0x7febf012e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:57.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.072+0000 7febf54bf700 1 -- 172.21.15.26:0/3984697521 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe0009370 con 0x7febf00926d0 2023-10-01T07:51:57.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.072+0000 7febf54bf700 1 --2- 172.21.15.26:0/3984697521 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febf00926d0 0x7febf012def0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7febec007fd0 tx=0x7febec007c20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:57.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.072+0000 7febe57fa700 1 -- 172.21.15.26:0/3984697521 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec00ce10 con 0x7febf00926d0 2023-10-01T07:51:57.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.072+0000 7febe57fa700 1 -- 172.21.15.26:0/3984697521 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febec00f470 con 0x7febf00926d0 2023-10-01T07:51:57.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.072+0000 7febf7723700 1 -- 172.21.15.26:0/3984697521 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe8009a20 con 0x7febf00926d0 2023-10-01T07:51:57.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.072+0000 7febe57fa700 1 -- 172.21.15.26:0/3984697521 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec00f830 con 0x7febf00926d0 2023-10-01T07:51:57.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.073+0000 7febf7723700 1 -- 172.21.15.26:0/3984697521 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf01115b0 con 0x7febf00926d0 2023-10-01T07:51:57.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.073+0000 7febe57fa700 1 -- 172.21.15.26:0/3984697521 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7febec00fbe0 con 0x7febf00926d0 2023-10-01T07:51:57.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.074+0000 7febe57fa700 1 -- 172.21.15.26:0/3984697521 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3590+0+0 (secure 0 0 0) 0x7febec03a590 con 0x7febf00926d0 2023-10-01T07:51:57.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.074+0000 7febf7723700 1 -- 172.21.15.26:0/3984697521 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf005a260 con 0x7febf00926d0 2023-10-01T07:51:57.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.079+0000 7febe57fa700 1 -- 172.21.15.26:0/3984697521 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7febec010c90 con 0x7febf00926d0 2023-10-01T07:51:57.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.293+0000 7febf7723700 1 -- 172.21.15.26:0/3984697521 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7febf0046c20 con 0x7febf00926d0 2023-10-01T07:51:57.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.306+0000 7febe57fa700 1 -- 172.21.15.26:0/3984697521 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v3) v1 ==== 172+0+0 (secure 0 0 0) 0x7febec010ab0 con 0x7febf00926d0 2023-10-01T07:51:57.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.310+0000 7febf7723700 1 -- 172.21.15.26:0/3984697521 >> v1:172.21.15.26:6816/118178 conn(0x7febd402bb90 legacy=0x7febd402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:57.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.310+0000 7febf7723700 1 -- 172.21.15.26:0/3984697521 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febf00926d0 msgr2=0x7febf012def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:57.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.310+0000 7febf7723700 1 --2- 172.21.15.26:0/3984697521 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febf00926d0 0x7febf012def0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7febec007fd0 tx=0x7febec007c20).stop 2023-10-01T07:51:57.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.313+0000 7febf7723700 1 -- 172.21.15.26:0/3984697521 shutdown_connections 2023-10-01T07:51:57.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.313+0000 7febf7723700 1 --2- 172.21.15.26:0/3984697521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febf0130220 0x7febf012e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:57.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.313+0000 7febf7723700 1 --2- 172.21.15.26:0/3984697521 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febf00926d0 0x7febf012def0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:57.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.313+0000 7febf7723700 1 --2- 172.21.15.26:0/3984697521 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febf01275c0 0x7febf012e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:57.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.313+0000 7febf7723700 1 -- 172.21.15.26:0/3984697521 >> 172.21.15.26:0/3984697521 conn(0x7febf0097480 msgr2=0x7febf0092d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:57.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.313+0000 7febf7723700 1 -- 172.21.15.26:0/3984697521 shutdown_connections 2023-10-01T07:51:57.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.313+0000 7febf7723700 1 -- 172.21.15.26:0/3984697521 wait complete. 2023-10-01T07:51:57.328 INFO:teuthology.orchestra.run.smithi026.stderr:new fs with metadata pool 3 and data pool 4 2023-10-01T07:51:57.350 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-01T07:51:57.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.479+0000 7fc232ebd700 1 Processor -- start 2023-10-01T07:51:57.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.479+0000 7fc232ebd700 1 -- start start 2023-10-01T07:51:57.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.480+0000 7fc232ebd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc22c066180 0x7fc22c0977e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:57.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.480+0000 7fc232ebd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc22c12b240 0x7fc22c12b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:57.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.480+0000 7fc232ebd700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc22c0982e0 con 0x7fc22c127500 2023-10-01T07:51:57.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.480+0000 7fc232ebd700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc22c066560 con 0x7fc22c12b240 2023-10-01T07:51:57.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.480+0000 7fc232ebd700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c0657a0 con 0x7fc22c066180 2023-10-01T07:51:57.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.480+0000 7fc22bfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc22c12b240 0x7fc22c12b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:57.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.480+0000 7fc230c59700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc22c066180 0x7fc22c0977e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:57.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.480+0000 7fc23145a700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc22c127500 0x7fc22c127980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37864/0 (socket says 172.21.15.26:37864) 2023-10-01T07:51:57.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.480+0000 7fc230c59700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc22c066180 0x7fc22c0977e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59496/0 (socket says 172.21.15.26:59496) 2023-10-01T07:51:57.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.480+0000 7fc22bfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc22c12b240 0x7fc22c12b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37868/0 (socket says 172.21.15.26:37868) 2023-10-01T07:51:57.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.480+0000 7fc230c59700 1 -- 172.21.15.26:0/3575878363 learned_addr learned my addr 172.21.15.26:0/3575878363 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:57.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.480+0000 7fc22bfff700 1 -- 172.21.15.26:0/3575878363 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc22c066180 msgr2=0x7fc22c0977e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:51:57.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.481+0000 7fc22bfff700 1 --2- 172.21.15.26:0/3575878363 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc22c066180 0x7fc22c0977e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:57.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.481+0000 7fc22bfff700 1 -- 172.21.15.26:0/3575878363 >> v1:172.21.15.26:6789/0 conn(0x7fc22c127500 legacy=0x7fc22c127980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:57.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.481+0000 7fc22bfff700 1 -- 172.21.15.26:0/3575878363 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc22c064e00 con 0x7fc22c12b240 2023-10-01T07:51:57.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.481+0000 7fc22b7fe700 1 -- 172.21.15.26:0/3575878363 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1422103428 0 0) 0x7fc22c0982e0 con 0x7fc22c127500 2023-10-01T07:51:57.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.481+0000 7fc230c59700 1 --2- 172.21.15.26:0/3575878363 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc22c066180 0x7fc22c0977e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:57.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.481+0000 7fc22bfff700 1 --2- 172.21.15.26:0/3575878363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc22c12b240 0x7fc22c12b620 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fc220009790 tx=0x7fc220009060).ready entity=mon.0 client_cookie=e248bdea22395de3 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:57.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.481+0000 7fc22b7fe700 1 -- 172.21.15.26:0/3575878363 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2200090d0 con 0x7fc22c12b240 2023-10-01T07:51:57.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.481+0000 7fc22b7fe700 1 -- 172.21.15.26:0/3575878363 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22000f510 con 0x7fc22c12b240 2023-10-01T07:51:57.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.481+0000 7fc22b7fe700 1 -- 172.21.15.26:0/3575878363 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22000f890 con 0x7fc22c12b240 2023-10-01T07:51:57.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.481+0000 7fc232ebd700 1 -- 172.21.15.26:0/3575878363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc22c12b240 msgr2=0x7fc22c12b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:57.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.481+0000 7fc232ebd700 1 --2- 172.21.15.26:0/3575878363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc22c12b240 0x7fc22c12b620 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fc220009790 tx=0x7fc220009060).stop 2023-10-01T07:51:57.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.481+0000 7fc232ebd700 1 -- 172.21.15.26:0/3575878363 shutdown_connections 2023-10-01T07:51:57.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.481+0000 7fc232ebd700 1 --2- 172.21.15.26:0/3575878363 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc22c066180 0x7fc22c0977e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:57.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.481+0000 7fc232ebd700 1 --2- 172.21.15.26:0/3575878363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc22c12b240 0x7fc22c12b620 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:57.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.481+0000 7fc232ebd700 1 -- 172.21.15.26:0/3575878363 >> 172.21.15.26:0/3575878363 conn(0x7fc22c09ba50 msgr2=0x7fc22c09be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:57.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.482+0000 7fc232ebd700 1 -- 172.21.15.26:0/3575878363 shutdown_connections 2023-10-01T07:51:57.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.482+0000 7fc232ebd700 1 -- 172.21.15.26:0/3575878363 wait complete. 2023-10-01T07:51:57.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.482+0000 7fc232ebd700 1 Processor -- start 2023-10-01T07:51:57.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.483+0000 7fc232ebd700 1 -- start start 2023-10-01T07:51:57.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.483+0000 7fc232ebd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc22c066180 0x7fc22c1178b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:57.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.483+0000 7fc232ebd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc22c127500 0x7fc22c1139b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:57.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.483+0000 7fc232ebd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc22c12b240 0x7fc22c113ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:57.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.483+0000 7fc232ebd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c115d70 con 0x7fc22c127500 2023-10-01T07:51:57.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.483+0000 7fc232ebd700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c1249e0 con 0x7fc22c066180 2023-10-01T07:51:57.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.483+0000 7fc232ebd700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c125cf0 con 0x7fc22c12b240 2023-10-01T07:51:57.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.483+0000 7fc23145a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc22c12b240 0x7fc22c113ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:57.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.483+0000 7fc23145a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc22c12b240 0x7fc22c113ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59508/0 (socket says 172.21.15.26:59508) 2023-10-01T07:51:57.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.483+0000 7fc23145a700 1 -- 172.21.15.26:0/2252301813 learned_addr learned my addr 172.21.15.26:0/2252301813 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:57.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.483+0000 7fc22bfff700 1 --2- 172.21.15.26:0/2252301813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc22c127500 0x7fc22c1139b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:57.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.483+0000 7fc230c59700 1 --2- 172.21.15.26:0/2252301813 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc22c066180 0x7fc22c1178b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:57.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.484+0000 7fc22bfff700 1 -- 172.21.15.26:0/2252301813 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc22c12b240 msgr2=0x7fc22c113ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:57.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.484+0000 7fc22bfff700 1 --2- 172.21.15.26:0/2252301813 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc22c12b240 0x7fc22c113ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:57.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.484+0000 7fc22bfff700 1 -- 172.21.15.26:0/2252301813 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc22c066180 msgr2=0x7fc22c1178b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:57.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.484+0000 7fc22bfff700 1 --2- 172.21.15.26:0/2252301813 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc22c066180 0x7fc22c1178b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:57.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.484+0000 7fc22bfff700 1 -- 172.21.15.26:0/2252301813 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c009370 con 0x7fc22c127500 2023-10-01T07:51:57.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.484+0000 7fc23145a700 1 --2- 172.21.15.26:0/2252301813 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc22c12b240 0x7fc22c113ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:57.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.484+0000 7fc22bfff700 1 --2- 172.21.15.26:0/2252301813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc22c127500 0x7fc22c1139b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc220014000 tx=0x7fc220017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:57.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.484+0000 7fc228ff9700 1 -- 172.21.15.26:0/2252301813 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22000fc50 con 0x7fc22c127500 2023-10-01T07:51:57.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.484+0000 7fc228ff9700 1 -- 172.21.15.26:0/2252301813 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22000fdd0 con 0x7fc22c127500 2023-10-01T07:51:57.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.484+0000 7fc232ebd700 1 -- 172.21.15.26:0/2252301813 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2200092a0 con 0x7fc22c127500 2023-10-01T07:51:57.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.484+0000 7fc228ff9700 1 -- 172.21.15.26:0/2252301813 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22001b660 con 0x7fc22c127500 2023-10-01T07:51:57.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.484+0000 7fc232ebd700 1 -- 172.21.15.26:0/2252301813 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc22c1154a0 con 0x7fc22c127500 2023-10-01T07:51:57.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.485+0000 7fc228ff9700 1 -- 172.21.15.26:0/2252301813 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fc22001ba10 con 0x7fc22c127500 2023-10-01T07:51:57.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.485+0000 7fc228ff9700 1 -- 172.21.15.26:0/2252301813 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fc22003c920 con 0x7fc22c127500 2023-10-01T07:51:57.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.485+0000 7fc232ebd700 1 -- 172.21.15.26:0/2252301813 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc22c115630 con 0x7fc22c127500 2023-10-01T07:51:57.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.490+0000 7fc228ff9700 1 -- 172.21.15.26:0/2252301813 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fc220029080 con 0x7fc22c127500 2023-10-01T07:51:57.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.666+0000 7fc232ebd700 1 -- 172.21.15.26:0/2252301813 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc22c05a260 con 0x7fc22c127500 2023-10-01T07:51:57.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.666+0000 7fc228ff9700 1 -- 172.21.15.26:0/2252301813 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11354 (secure 0 0 0) 0x7fc22001f020 con 0x7fc22c127500 2023-10-01T07:51:57.667 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:57.667 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":16,"fsid":"c29fb19d-520c-42a6-90f4-e7f86de96e8e","created":"2023-10-01T07:51:40.702414+0000","modified":"2023-10-01T07:51:57.294943+0000","last_up_change":"2023-10-01T07:51:48.849482+0000","last_in_change":"2023-10-01T07:51:42.084736+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-01T07:51:48.906889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-01T07:51:50.071599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-01T07:51:54.981575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-01T07:51:56.286318+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46569ce3-81d1-44a1-a649-691de3e6f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6800","nonce":118773}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6801","nonce":118773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6803","nonce":118773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6802","nonce":118773}]},"public_addr":"172.21.15.26:6800/118773","cluster_addr":"172.21.15.26:6801/118773","heartbeat_back_addr":"172.21.15.26:6803/118773","heartbeat_front_addr":"172.21.15.26:6802/118773","state":["exists","up"]},{"osd":1,"uuid":"1fc1ba9b-4110-4d31-96d6-794937578cff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6804","nonce":118782}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6806","nonce":118782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6810","nonce":118782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6808","nonce":118782}]},"public_addr":"172.21.15.26:6804/118782","cluster_addr":"172.21.15.26:6806/118782","heartbeat_back_addr":"172.21.15.26:6810/118782","heartbeat_front_addr":"172.21.15.26:6808/118782","state":["exists","up"]},{"osd":2,"uuid":"37de933d-3b8e-4b94-87bd-2f36896c7ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6805","nonce":118789}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6807","nonce":118789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6811","nonce":118789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6809","nonce":118789}]},"public_addr":"172.21.15.26:6805/118789","cluster_addr":"172.21.15.26:6807/118789","heartbeat_back_addr":"172.21.15.26:6811/118789","heartbeat_front_addr":"172.21.15.26:6809/118789","state":["exists","up"]},{"osd":3,"uuid":"bd020309-5fd2-4d97-b36a-67e159fa3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6812","nonce":118790}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6813","nonce":118790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6815","nonce":118790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6814","nonce":118790}]},"public_addr":"172.21.15.26:6812/118790","cluster_addr":"172.21.15.26:6813/118790","heartbeat_back_addr":"172.21.15.26:6815/118790","heartbeat_front_addr":"172.21.15.26:6814/118790","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.029993+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.266503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.273540+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.229731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-01T07:51:57.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.668+0000 7fc232ebd700 1 -- 172.21.15.26:0/2252301813 >> v1:172.21.15.26:6816/118178 conn(0x7fc21802bb60 legacy=0x7fc21802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:57.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.668+0000 7fc232ebd700 1 -- 172.21.15.26:0/2252301813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc22c127500 msgr2=0x7fc22c1139b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:57.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.668+0000 7fc232ebd700 1 --2- 172.21.15.26:0/2252301813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc22c127500 0x7fc22c1139b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc220014000 tx=0x7fc220017000).stop 2023-10-01T07:51:57.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.669+0000 7fc232ebd700 1 -- 172.21.15.26:0/2252301813 shutdown_connections 2023-10-01T07:51:57.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.669+0000 7fc232ebd700 1 --2- 172.21.15.26:0/2252301813 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc22c12b240 0x7fc22c113ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:57.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.669+0000 7fc232ebd700 1 --2- 172.21.15.26:0/2252301813 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc22c066180 0x7fc22c1178b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:57.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.669+0000 7fc232ebd700 1 --2- 172.21.15.26:0/2252301813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc22c127500 0x7fc22c1139b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:57.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.669+0000 7fc232ebd700 1 -- 172.21.15.26:0/2252301813 >> 172.21.15.26:0/2252301813 conn(0x7fc22c09ba50 msgr2=0x7fc22c129db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:57.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.669+0000 7fc232ebd700 1 -- 172.21.15.26:0/2252301813 shutdown_connections 2023-10-01T07:51:57.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.669+0000 7fc232ebd700 1 -- 172.21.15.26:0/2252301813 wait complete. 2023-10-01T07:51:57.683 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-01T07:51:57.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.814+0000 7f3aaacf8700 1 Processor -- start 2023-10-01T07:51:57.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.814+0000 7f3aaacf8700 1 -- start start 2023-10-01T07:51:57.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.814+0000 7f3aaacf8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3aa4127390 0x7f3aa412fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:57.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.814+0000 7f3aaacf8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3aa4127fa0 0x7f3aa4132170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:57.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.814+0000 7f3aaacf8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aa4096900 con 0x7f3aa4059070 2023-10-01T07:51:57.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.814+0000 7f3aaacf8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aa4059c00 con 0x7f3aa4127fa0 2023-10-01T07:51:57.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.814+0000 7f3aaacf8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa4091b60 con 0x7f3aa4127390 2023-10-01T07:51:57.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.814+0000 7f3aa9295700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3aa4127fa0 0x7f3aa4132170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:57.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.814+0000 7f3aa3fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3aa4127390 0x7f3aa412fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:57.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.814+0000 7f3aa3fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3aa4127390 0x7f3aa412fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59514/0 (socket says 172.21.15.26:59514) 2023-10-01T07:51:57.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.814+0000 7f3aa9295700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3aa4127fa0 0x7f3aa4132170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37884/0 (socket says 172.21.15.26:37884) 2023-10-01T07:51:57.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.814+0000 7f3aa3fff700 1 -- 172.21.15.26:0/1736796133 learned_addr learned my addr 172.21.15.26:0/1736796133 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:57.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.814+0000 7f3aa8a94700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3aa4059070 0x7f3aa4127890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37866/0 (socket says 172.21.15.26:37866) 2023-10-01T07:51:57.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.815+0000 7f3aa9295700 1 -- 172.21.15.26:0/1736796133 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3aa4127390 msgr2=0x7f3aa412fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:51:57.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.815+0000 7f3aa9295700 1 --2- 172.21.15.26:0/1736796133 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3aa4127390 0x7f3aa412fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:57.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.815+0000 7f3aa9295700 1 -- 172.21.15.26:0/1736796133 >> v1:172.21.15.26:6789/0 conn(0x7f3aa4059070 legacy=0x7f3aa4127890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:57.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.815+0000 7f3aa9295700 1 -- 172.21.15.26:0/1736796133 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa4092a10 con 0x7f3aa4127fa0 2023-10-01T07:51:57.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.815+0000 7f3aa3fff700 1 --2- 172.21.15.26:0/1736796133 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3aa4127390 0x7f3aa412fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:57.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.815+0000 7f3aa37fe700 1 -- 172.21.15.26:0/1736796133 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1776620787 0 0) 0x7f3aa4096900 con 0x7f3aa4059070 2023-10-01T07:51:57.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.815+0000 7f3aa9295700 1 --2- 172.21.15.26:0/1736796133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3aa4127fa0 0x7f3aa4132170 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f3a9c009e60 tx=0x7f3a9c009780).ready entity=mon.0 client_cookie=dc5d6377fce89b37 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:57.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.815+0000 7f3aa37fe700 1 -- 172.21.15.26:0/1736796133 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c00e070 con 0x7f3aa4127fa0 2023-10-01T07:51:57.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.815+0000 7f3aa37fe700 1 -- 172.21.15.26:0/1736796133 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9c00bb60 con 0x7f3aa4127fa0 2023-10-01T07:51:57.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.815+0000 7f3aa37fe700 1 -- 172.21.15.26:0/1736796133 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c012410 con 0x7f3aa4127fa0 2023-10-01T07:51:57.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.815+0000 7f3aaacf8700 1 -- 172.21.15.26:0/1736796133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3aa4127fa0 msgr2=0x7f3aa4132170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:57.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.815+0000 7f3aaacf8700 1 --2- 172.21.15.26:0/1736796133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3aa4127fa0 0x7f3aa4132170 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f3a9c009e60 tx=0x7f3a9c009780).stop 2023-10-01T07:51:57.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.816+0000 7f3aaacf8700 1 -- 172.21.15.26:0/1736796133 shutdown_connections 2023-10-01T07:51:57.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.816+0000 7f3aaacf8700 1 --2- 172.21.15.26:0/1736796133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3aa4127fa0 0x7f3aa4132170 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:57.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.816+0000 7f3aaacf8700 1 --2- 172.21.15.26:0/1736796133 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3aa4127390 0x7f3aa412fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:57.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.816+0000 7f3aaacf8700 1 -- 172.21.15.26:0/1736796133 >> 172.21.15.26:0/1736796133 conn(0x7f3aa4097470 msgr2=0x7f3aa4097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:57.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.816+0000 7f3aaacf8700 1 -- 172.21.15.26:0/1736796133 shutdown_connections 2023-10-01T07:51:57.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.816+0000 7f3aaacf8700 1 -- 172.21.15.26:0/1736796133 wait complete. 2023-10-01T07:51:57.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.816+0000 7f3aaacf8700 1 Processor -- start 2023-10-01T07:51:57.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.817+0000 7f3aaacf8700 1 -- start start 2023-10-01T07:51:57.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.817+0000 7f3aaacf8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3aa4059070 0x7f3aa412dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:57.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.817+0000 7f3aaacf8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3aa4127390 0x7f3aa412e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:57.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.817+0000 7f3aaacf8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3aa4127fa0 0x7f3aa412e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:57.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.817+0000 7f3aaacf8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa4125540 con 0x7f3aa4127390 2023-10-01T07:51:57.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.817+0000 7f3aaacf8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa412f7d0 con 0x7f3aa4059070 2023-10-01T07:51:57.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.817+0000 7f3aaacf8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa4131360 con 0x7f3aa4127fa0 2023-10-01T07:51:57.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.817+0000 7f3aa8a94700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3aa4059070 0x7f3aa412dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:57.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.817+0000 7f3aa3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3aa4127390 0x7f3aa412e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:57.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.817+0000 7f3aa8a94700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3aa4059070 0x7f3aa412dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43928/0 (socket says 172.21.15.26:43928) 2023-10-01T07:51:57.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.817+0000 7f3aa8a94700 1 -- 172.21.15.26:0/4046989148 learned_addr learned my addr 172.21.15.26:0/4046989148 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:57.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.817+0000 7f3aa9295700 1 --2- 172.21.15.26:0/4046989148 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3aa4127fa0 0x7f3aa412e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:57.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.818+0000 7f3aa8a94700 1 -- 172.21.15.26:0/4046989148 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3aa4127fa0 msgr2=0x7f3aa412e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:57.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.818+0000 7f3aa8a94700 1 --2- 172.21.15.26:0/4046989148 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3aa4127fa0 0x7f3aa412e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:57.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.818+0000 7f3aa8a94700 1 -- 172.21.15.26:0/4046989148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3aa4127390 msgr2=0x7f3aa412e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:57.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.818+0000 7f3aa8a94700 1 --2- 172.21.15.26:0/4046989148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3aa4127390 0x7f3aa412e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:57.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.818+0000 7f3aa8a94700 1 -- 172.21.15.26:0/4046989148 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a98009370 con 0x7f3aa4059070 2023-10-01T07:51:57.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.818+0000 7f3aa3fff700 1 --2- 172.21.15.26:0/4046989148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3aa4127390 0x7f3aa412e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:57.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.818+0000 7f3aa8a94700 1 --2- 172.21.15.26:0/4046989148 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3aa4059070 0x7f3aa412dba0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f3a9400c4c0 tx=0x7f3a94007de0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:57.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.818+0000 7f3aa0ff9700 1 -- 172.21.15.26:0/4046989148 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a940070d0 con 0x7f3aa4059070 2023-10-01T07:51:57.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.818+0000 7f3aa0ff9700 1 -- 172.21.15.26:0/4046989148 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a94007250 con 0x7f3aa4059070 2023-10-01T07:51:57.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.818+0000 7f3aa0ff9700 1 -- 172.21.15.26:0/4046989148 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a940056e0 con 0x7f3aa4059070 2023-10-01T07:51:57.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.818+0000 7f3aaacf8700 1 -- 172.21.15.26:0/4046989148 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a9c009a20 con 0x7f3aa4059070 2023-10-01T07:51:57.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.818+0000 7f3aaacf8700 1 -- 172.21.15.26:0/4046989148 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa4130120 con 0x7f3aa4059070 2023-10-01T07:51:57.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.819+0000 7f3aa0ff9700 1 -- 172.21.15.26:0/4046989148 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f3a94005ad0 con 0x7f3aa4059070 2023-10-01T07:51:57.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.819+0000 7f3aa0ff9700 1 -- 172.21.15.26:0/4046989148 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f3a9403a540 con 0x7f3aa4059070 2023-10-01T07:51:57.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.819+0000 7f3aaacf8700 1 -- 172.21.15.26:0/4046989148 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aa405a260 con 0x7f3aa4059070 2023-10-01T07:51:57.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:57.824+0000 7f3aa0ff9700 1 -- 172.21.15.26:0/4046989148 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f3a94005d80 con 0x7f3aa4059070 2023-10-01T07:51:58.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.003+0000 7f3aaacf8700 1 -- 172.21.15.26:0/4046989148 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3aa4046c20 con 0x7f3aa4059070 2023-10-01T07:51:58.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.004+0000 7f3aa0ff9700 1 -- 172.21.15.26:0/4046989148 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11354 (secure 0 0 0) 0x7f3a94011350 con 0x7f3aa4059070 2023-10-01T07:51:58.005 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:51:58.005 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":16,"fsid":"c29fb19d-520c-42a6-90f4-e7f86de96e8e","created":"2023-10-01T07:51:40.702414+0000","modified":"2023-10-01T07:51:57.294943+0000","last_up_change":"2023-10-01T07:51:48.849482+0000","last_in_change":"2023-10-01T07:51:42.084736+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-01T07:51:48.906889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-01T07:51:50.071599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-01T07:51:54.981575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-01T07:51:56.286318+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46569ce3-81d1-44a1-a649-691de3e6f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6800","nonce":118773}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6801","nonce":118773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6803","nonce":118773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6802","nonce":118773}]},"public_addr":"172.21.15.26:6800/118773","cluster_addr":"172.21.15.26:6801/118773","heartbeat_back_addr":"172.21.15.26:6803/118773","heartbeat_front_addr":"172.21.15.26:6802/118773","state":["exists","up"]},{"osd":1,"uuid":"1fc1ba9b-4110-4d31-96d6-794937578cff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6804","nonce":118782}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6806","nonce":118782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6810","nonce":118782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6808","nonce":118782}]},"public_addr":"172.21.15.26:6804/118782","cluster_addr":"172.21.15.26:6806/118782","heartbeat_back_addr":"172.21.15.26:6810/118782","heartbeat_front_addr":"172.21.15.26:6808/118782","state":["exists","up"]},{"osd":2,"uuid":"37de933d-3b8e-4b94-87bd-2f36896c7ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6805","nonce":118789}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6807","nonce":118789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6811","nonce":118789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6809","nonce":118789}]},"public_addr":"172.21.15.26:6805/118789","cluster_addr":"172.21.15.26:6807/118789","heartbeat_back_addr":"172.21.15.26:6811/118789","heartbeat_front_addr":"172.21.15.26:6809/118789","state":["exists","up"]},{"osd":3,"uuid":"bd020309-5fd2-4d97-b36a-67e159fa3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6812","nonce":118790}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6813","nonce":118790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6815","nonce":118790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6814","nonce":118790}]},"public_addr":"172.21.15.26:6812/118790","cluster_addr":"172.21.15.26:6813/118790","heartbeat_back_addr":"172.21.15.26:6815/118790","heartbeat_front_addr":"172.21.15.26:6814/118790","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.029993+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.266503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.273540+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.229731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-01T07:51:58.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.006+0000 7f3aaacf8700 1 -- 172.21.15.26:0/4046989148 >> v1:172.21.15.26:6816/118178 conn(0x7f3a9002bb90 legacy=0x7f3a9002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:58.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.006+0000 7f3aaacf8700 1 -- 172.21.15.26:0/4046989148 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3aa4059070 msgr2=0x7f3aa412dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:58.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.006+0000 7f3aaacf8700 1 --2- 172.21.15.26:0/4046989148 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3aa4059070 0x7f3aa412dba0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f3a9400c4c0 tx=0x7f3a94007de0).stop 2023-10-01T07:51:58.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.006+0000 7f3aaacf8700 1 -- 172.21.15.26:0/4046989148 shutdown_connections 2023-10-01T07:51:58.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.006+0000 7f3aaacf8700 1 --2- 172.21.15.26:0/4046989148 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3aa4127fa0 0x7f3aa412e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:58.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.006+0000 7f3aaacf8700 1 --2- 172.21.15.26:0/4046989148 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3aa4059070 0x7f3aa412dba0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:58.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.006+0000 7f3aaacf8700 1 --2- 172.21.15.26:0/4046989148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3aa4127390 0x7f3aa412e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:58.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.006+0000 7f3aaacf8700 1 -- 172.21.15.26:0/4046989148 >> 172.21.15.26:0/4046989148 conn(0x7f3aa4097470 msgr2=0x7f3aa4098780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:58.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.006+0000 7f3aaacf8700 1 -- 172.21.15.26:0/4046989148 shutdown_connections 2023-10-01T07:51:58.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.006+0000 7f3aaacf8700 1 -- 172.21.15.26:0/4046989148 wait complete. 2023-10-01T07:51:58.020 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-01T07:51:58.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.152+0000 7f1365cc3700 1 Processor -- start 2023-10-01T07:51:58.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.153+0000 7f1365cc3700 1 -- start start 2023-10-01T07:51:58.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.153+0000 7f1365cc3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13600926d0 0x7f13601275c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:58.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.153+0000 7f1365cc3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1360128000 0x7f136012b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:58.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.153+0000 7f1365cc3700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1360091c80 con 0x7f1360127be0 2023-10-01T07:51:58.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.153+0000 7f1365cc3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1360099dd0 con 0x7f1360128000 2023-10-01T07:51:58.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.153+0000 7f1365cc3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13600999d0 con 0x7f13600926d0 2023-10-01T07:51:58.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.153+0000 7f135f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13600926d0 0x7f13601275c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:58.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.153+0000 7f135ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1360128000 0x7f136012b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:58.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.153+0000 7f135f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13600926d0 0x7f13601275c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43936/0 (socket says 172.21.15.26:43936) 2023-10-01T07:51:58.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.153+0000 7f135effd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1360127be0 0x7f136012a9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37876/0 (socket says 172.21.15.26:37876) 2023-10-01T07:51:58.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.153+0000 7f135f7fe700 1 -- 172.21.15.26:0/1627680190 learned_addr learned my addr 172.21.15.26:0/1627680190 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:58.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.154+0000 7f135ffff700 1 -- 172.21.15.26:0/1627680190 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13600926d0 msgr2=0x7f13601275c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:51:58.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.154+0000 7f135ffff700 1 --2- 172.21.15.26:0/1627680190 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13600926d0 0x7f13601275c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:58.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.154+0000 7f135ffff700 1 -- 172.21.15.26:0/1627680190 >> v1:172.21.15.26:6789/0 conn(0x7f1360127be0 legacy=0x7f136012a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:58.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.154+0000 7f135e7fc700 1 -- 172.21.15.26:0/1627680190 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3227991050 0 0) 0x7f1360091c80 con 0x7f1360127be0 2023-10-01T07:51:58.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.154+0000 7f135ffff700 1 -- 172.21.15.26:0/1627680190 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136009a280 con 0x7f1360128000 2023-10-01T07:51:58.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.154+0000 7f135f7fe700 1 --2- 172.21.15.26:0/1627680190 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13600926d0 0x7f13601275c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:58.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.154+0000 7f135ffff700 1 --2- 172.21.15.26:0/1627680190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1360128000 0x7f136012b0b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f1358009e60 tx=0x7f1358009780).ready entity=mon.0 client_cookie=b596660173af0863 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:58.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.154+0000 7f135e7fc700 1 -- 172.21.15.26:0/1627680190 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135800e070 con 0x7f1360128000 2023-10-01T07:51:58.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.154+0000 7f135e7fc700 1 -- 172.21.15.26:0/1627680190 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135800bb60 con 0x7f1360128000 2023-10-01T07:51:58.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.154+0000 7f135e7fc700 1 -- 172.21.15.26:0/1627680190 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1358012410 con 0x7f1360128000 2023-10-01T07:51:58.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.155+0000 7f1365cc3700 1 -- 172.21.15.26:0/1627680190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1360128000 msgr2=0x7f136012b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:58.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.155+0000 7f1365cc3700 1 --2- 172.21.15.26:0/1627680190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1360128000 0x7f136012b0b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f1358009e60 tx=0x7f1358009780).stop 2023-10-01T07:51:58.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.155+0000 7f1365cc3700 1 -- 172.21.15.26:0/1627680190 shutdown_connections 2023-10-01T07:51:58.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.155+0000 7f1365cc3700 1 --2- 172.21.15.26:0/1627680190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1360128000 0x7f136012b0b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:58.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.155+0000 7f1365cc3700 1 --2- 172.21.15.26:0/1627680190 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13600926d0 0x7f13601275c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:58.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.155+0000 7f1365cc3700 1 -- 172.21.15.26:0/1627680190 >> 172.21.15.26:0/1627680190 conn(0x7f1360097480 msgr2=0x7f1360097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:58.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.155+0000 7f1365cc3700 1 -- 172.21.15.26:0/1627680190 shutdown_connections 2023-10-01T07:51:58.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.155+0000 7f1365cc3700 1 -- 172.21.15.26:0/1627680190 wait complete. 2023-10-01T07:51:58.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.156+0000 7f1365cc3700 1 Processor -- start 2023-10-01T07:51:58.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.156+0000 7f1365cc3700 1 -- start start 2023-10-01T07:51:58.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.156+0000 7f1365cc3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13600926d0 0x7f1360113a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:58.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.156+0000 7f1365cc3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1360127be0 0x7f1360113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:58.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.156+0000 7f1365cc3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1360128000 0x7f1360114450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:58.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.156+0000 7f1365cc3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13601171b0 con 0x7f1360127be0 2023-10-01T07:51:58.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.156+0000 7f1365cc3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1360124a20 con 0x7f13600926d0 2023-10-01T07:51:58.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.156+0000 7f1365cc3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1360116c60 con 0x7f1360128000 2023-10-01T07:51:58.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.156+0000 7f135f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13600926d0 0x7f1360113a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:58.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.156+0000 7f135f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13600926d0 0x7f1360113a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43938/0 (socket says 172.21.15.26:43938) 2023-10-01T07:51:58.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.156+0000 7f135f7fe700 1 -- 172.21.15.26:0/3901866965 learned_addr learned my addr 172.21.15.26:0/3901866965 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:58.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.156+0000 7f135effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1360127be0 0x7f1360113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:58.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.156+0000 7f135ffff700 1 --2- 172.21.15.26:0/3901866965 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1360128000 0x7f1360114450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:58.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.157+0000 7f135f7fe700 1 -- 172.21.15.26:0/3901866965 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1360128000 msgr2=0x7f1360114450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:58.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.157+0000 7f135f7fe700 1 --2- 172.21.15.26:0/3901866965 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1360128000 0x7f1360114450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:58.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.157+0000 7f135f7fe700 1 -- 172.21.15.26:0/3901866965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1360127be0 msgr2=0x7f1360113f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:58.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.157+0000 7f135f7fe700 1 --2- 172.21.15.26:0/3901866965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1360127be0 0x7f1360113f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:58.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.157+0000 7f135f7fe700 1 -- 172.21.15.26:0/3901866965 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1350009370 con 0x7f13600926d0 2023-10-01T07:51:58.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.157+0000 7f135f7fe700 1 --2- 172.21.15.26:0/3901866965 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13600926d0 0x7f1360113a70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f135000ea20 tx=0x7f13500090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:58.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.157+0000 7f13477fe700 1 -- 172.21.15.26:0/3901866965 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1350009650 con 0x7f13600926d0 2023-10-01T07:51:58.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.157+0000 7f13477fe700 1 -- 172.21.15.26:0/3901866965 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135000ee60 con 0x7f13600926d0 2023-10-01T07:51:58.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.157+0000 7f1365cc3700 1 -- 172.21.15.26:0/3901866965 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1358009a20 con 0x7f13600926d0 2023-10-01T07:51:58.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.157+0000 7f13477fe700 1 -- 172.21.15.26:0/3901866965 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135000ca60 con 0x7f13600926d0 2023-10-01T07:51:58.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.157+0000 7f1365cc3700 1 -- 172.21.15.26:0/3901866965 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1360115d80 con 0x7f13600926d0 2023-10-01T07:51:58.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.158+0000 7f13477fe700 1 -- 172.21.15.26:0/3901866965 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f135001b400 con 0x7f13600926d0 2023-10-01T07:51:58.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.158+0000 7f13477fe700 1 -- 172.21.15.26:0/3901866965 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f135003b520 con 0x7f13600926d0 2023-10-01T07:51:58.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.158+0000 7f1365cc3700 1 -- 172.21.15.26:0/3901866965 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13601155d0 con 0x7f13600926d0 2023-10-01T07:51:58.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.163+0000 7f13477fe700 1 -- 172.21.15.26:0/3901866965 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f1350016030 con 0x7f13600926d0 2023-10-01T07:51:58.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:58.383+0000 7f1365cc3700 1 -- 172.21.15.26:0/3901866965 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1360116e50 con 0x7f13600926d0 2023-10-01T07:51:59.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.302+0000 7f13477fe700 1 -- 172.21.15.26:0/3901866965 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1350011d20 con 0x7f13600926d0 2023-10-01T07:51:59.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.304+0000 7f1365cc3700 1 -- 172.21.15.26:0/3901866965 >> v1:172.21.15.26:6816/118178 conn(0x7f134c02bb90 legacy=0x7f134c02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:59.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.304+0000 7f1365cc3700 1 -- 172.21.15.26:0/3901866965 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13600926d0 msgr2=0x7f1360113a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:59.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.304+0000 7f1365cc3700 1 --2- 172.21.15.26:0/3901866965 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13600926d0 0x7f1360113a70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f135000ea20 tx=0x7f13500090f0).stop 2023-10-01T07:51:59.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.304+0000 7f1365cc3700 1 -- 172.21.15.26:0/3901866965 shutdown_connections 2023-10-01T07:51:59.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.304+0000 7f1365cc3700 1 --2- 172.21.15.26:0/3901866965 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1360128000 0x7f1360114450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:59.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.304+0000 7f1365cc3700 1 --2- 172.21.15.26:0/3901866965 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13600926d0 0x7f1360113a70 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:59.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.304+0000 7f1365cc3700 1 --2- 172.21.15.26:0/3901866965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1360127be0 0x7f1360113f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:59.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.304+0000 7f1365cc3700 1 -- 172.21.15.26:0/3901866965 >> 172.21.15.26:0/3901866965 conn(0x7f1360097480 msgr2=0x7f136012a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:59.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.305+0000 7f1365cc3700 1 -- 172.21.15.26:0/3901866965 shutdown_connections 2023-10-01T07:51:59.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.305+0000 7f1365cc3700 1 -- 172.21.15.26:0/3901866965 wait complete. 2023-10-01T07:51:59.320 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-01T07:51:59.321 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-01T07:51:59.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.458+0000 7f35597a0700 1 Processor -- start 2023-10-01T07:51:59.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.458+0000 7f35597a0700 1 -- start start 2023-10-01T07:51:59.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.459+0000 7f35597a0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f35540653a0 0x7f3554098640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:59.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.459+0000 7f35597a0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3554098b30 0x7f3554098f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:59.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.459+0000 7f35597a0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f355412f430 0x7f3554131820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:59.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.459+0000 7f35597a0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3554065e80 con 0x7f35540653a0 2023-10-01T07:51:59.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.459+0000 7f35597a0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35540663b0 con 0x7f355412f430 2023-10-01T07:51:59.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.459+0000 7f35597a0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3554065780 con 0x7f3554098b30 2023-10-01T07:51:59.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.459+0000 7f3552ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f35540653a0 0x7f3554098640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:59.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.459+0000 7f35537fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f355412f430 0x7f3554131820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:59.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.459+0000 7f35527fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3554098b30 0x7f3554098f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:59.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.459+0000 7f35537fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f355412f430 0x7f3554131820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43946/0 (socket says 172.21.15.26:43946) 2023-10-01T07:51:59.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.459+0000 7f3552ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f35540653a0 0x7f3554098640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37920/0 (socket says 172.21.15.26:37920) 2023-10-01T07:51:59.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.459+0000 7f35527fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3554098b30 0x7f3554098f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59534/0 (socket says 172.21.15.26:59534) 2023-10-01T07:51:59.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.459+0000 7f35537fe700 1 -- 172.21.15.26:0/3142787339 learned_addr learned my addr 172.21.15.26:0/3142787339 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:59.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.459+0000 7f3552ffd700 1 -- 172.21.15.26:0/3142787339 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3554098b30 msgr2=0x7f3554098f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:51:59.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.459+0000 7f3552ffd700 1 --2- 172.21.15.26:0/3142787339 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3554098b30 0x7f3554098f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:59.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.460+0000 7f3552ffd700 1 -- 172.21.15.26:0/3142787339 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f355412f430 msgr2=0x7f3554131820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:51:59.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.460+0000 7f3552ffd700 1 --2- 172.21.15.26:0/3142787339 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f355412f430 0x7f3554131820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:59.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.460+0000 7f3552ffd700 1 -- 172.21.15.26:0/3142787339 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3554096180 con 0x7f35540653a0 2023-10-01T07:51:59.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.460+0000 7f35537fe700 1 --2- 172.21.15.26:0/3142787339 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f355412f430 0x7f3554131820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:59.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.460+0000 7f35527fc700 1 --2- 172.21.15.26:0/3142787339 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3554098b30 0x7f3554098f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:59.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.460+0000 7f3552ffd700 1 --2- 172.21.15.26:0/3142787339 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35540653a0 0x7f3554098640 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f3544009760 tx=0x7f3544009060).ready entity=mon.0 client_cookie=6603a1c4d8d6012f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:59.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.460+0000 7f3551ffb700 1 -- 172.21.15.26:0/3142787339 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354400d4a0 con 0x7f35540653a0 2023-10-01T07:51:59.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.460+0000 7f3551ffb700 1 -- 172.21.15.26:0/3142787339 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354400d600 con 0x7f35540653a0 2023-10-01T07:51:59.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.460+0000 7f3551ffb700 1 -- 172.21.15.26:0/3142787339 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354400d980 con 0x7f35540653a0 2023-10-01T07:51:59.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.460+0000 7f35597a0700 1 -- 172.21.15.26:0/3142787339 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35540653a0 msgr2=0x7f3554098640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:59.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.460+0000 7f35597a0700 1 --2- 172.21.15.26:0/3142787339 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35540653a0 0x7f3554098640 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f3544009760 tx=0x7f3544009060).stop 2023-10-01T07:51:59.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.461+0000 7f35597a0700 1 -- 172.21.15.26:0/3142787339 shutdown_connections 2023-10-01T07:51:59.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.461+0000 7f35597a0700 1 --2- 172.21.15.26:0/3142787339 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f355412f430 0x7f3554131820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:59.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.461+0000 7f35597a0700 1 --2- 172.21.15.26:0/3142787339 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35540653a0 0x7f3554098640 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:59.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.461+0000 7f35597a0700 1 --2- 172.21.15.26:0/3142787339 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3554098b30 0x7f3554098f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:59.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.461+0000 7f35597a0700 1 -- 172.21.15.26:0/3142787339 >> 172.21.15.26:0/3142787339 conn(0x7f355409dc20 msgr2=0x7f355409e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:51:59.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.461+0000 7f35597a0700 1 -- 172.21.15.26:0/3142787339 shutdown_connections 2023-10-01T07:51:59.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.461+0000 7f35597a0700 1 -- 172.21.15.26:0/3142787339 wait complete. 2023-10-01T07:51:59.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.462+0000 7f35597a0700 1 Processor -- start 2023-10-01T07:51:59.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.462+0000 7f35597a0700 1 -- start start 2023-10-01T07:51:59.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.462+0000 7f35597a0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35540653a0 0x7f355412e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:59.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.462+0000 7f35597a0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3554098b30 0x7f355412e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:59.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.462+0000 7f35597a0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f355412f430 0x7f355411a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:51:59.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.462+0000 7f35597a0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355411b7c0 con 0x7f35540653a0 2023-10-01T07:51:59.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.462+0000 7f35597a0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f355411c9e0 con 0x7f355412f430 2023-10-01T07:51:59.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.462+0000 7f35597a0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f355411eb80 con 0x7f3554098b30 2023-10-01T07:51:59.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.462+0000 7f3552ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35540653a0 0x7f355412e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:59.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.462+0000 7f3552ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35540653a0 0x7f355412e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37932/0 (socket says 172.21.15.26:37932) 2023-10-01T07:51:59.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.462+0000 7f3552ffd700 1 -- 172.21.15.26:0/1307280990 learned_addr learned my addr 172.21.15.26:0/1307280990 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:51:59.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.462+0000 7f35527fc700 1 --2- 172.21.15.26:0/1307280990 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3554098b30 0x7f355412e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:59.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.462+0000 7f35537fe700 1 --2- 172.21.15.26:0/1307280990 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f355412f430 0x7f355411a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:51:59.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.463+0000 7f3552ffd700 1 -- 172.21.15.26:0/1307280990 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3554098b30 msgr2=0x7f355412e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:59.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.463+0000 7f3552ffd700 1 --2- 172.21.15.26:0/1307280990 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3554098b30 0x7f355412e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:59.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.463+0000 7f3552ffd700 1 -- 172.21.15.26:0/1307280990 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f355412f430 msgr2=0x7f355411a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:51:59.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.463+0000 7f3552ffd700 1 --2- 172.21.15.26:0/1307280990 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f355412f430 0x7f355411a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:51:59.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.463+0000 7f3552ffd700 1 -- 172.21.15.26:0/1307280990 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353c0092a0 con 0x7f35540653a0 2023-10-01T07:51:59.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.463+0000 7f35527fc700 1 --2- 172.21.15.26:0/1307280990 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3554098b30 0x7f355412e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:59.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.463+0000 7f35537fe700 1 --2- 172.21.15.26:0/1307280990 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f355412f430 0x7f355411a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:51:59.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.463+0000 7f3552ffd700 1 --2- 172.21.15.26:0/1307280990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35540653a0 0x7f355412e0a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f3544011fb0 tx=0x7f3544016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:51:59.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.463+0000 7f354affd700 1 -- 172.21.15.26:0/1307280990 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354400dcf0 con 0x7f35540653a0 2023-10-01T07:51:59.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.463+0000 7f354affd700 1 -- 172.21.15.26:0/1307280990 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354400de50 con 0x7f35540653a0 2023-10-01T07:51:59.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.463+0000 7f35597a0700 1 -- 172.21.15.26:0/1307280990 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f354c009ae0 con 0x7f35540653a0 2023-10-01T07:51:59.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.463+0000 7f354affd700 1 -- 172.21.15.26:0/1307280990 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354400d980 con 0x7f35540653a0 2023-10-01T07:51:59.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.463+0000 7f35597a0700 1 -- 172.21.15.26:0/1307280990 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35440092a0 con 0x7f35540653a0 2023-10-01T07:51:59.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.464+0000 7f354affd700 1 -- 172.21.15.26:0/1307280990 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f354401d640 con 0x7f35540653a0 2023-10-01T07:51:59.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.464+0000 7f354affd700 1 -- 172.21.15.26:0/1307280990 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f354403c560 con 0x7f35540653a0 2023-10-01T07:51:59.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.464+0000 7f35597a0700 1 -- 172.21.15.26:0/1307280990 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f355405a260 con 0x7f35540653a0 2023-10-01T07:51:59.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.469+0000 7f354affd700 1 -- 172.21.15.26:0/1307280990 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f354401d8f0 con 0x7f35540653a0 2023-10-01T07:51:59.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:51:59.683+0000 7f35597a0700 1 -- 172.21.15.26:0/1307280990 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f355412f210 con 0x7f35540653a0 2023-10-01T07:52:00.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.305+0000 7f354affd700 1 -- 172.21.15.26:0/1307280990 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3544018350 con 0x7f35540653a0 2023-10-01T07:52:00.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.308+0000 7f35597a0700 1 -- 172.21.15.26:0/1307280990 >> v1:172.21.15.26:6816/118178 conn(0x7f353402bb60 legacy=0x7f353402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:00.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.308+0000 7f35597a0700 1 -- 172.21.15.26:0/1307280990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35540653a0 msgr2=0x7f355412e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:00.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.308+0000 7f35597a0700 1 --2- 172.21.15.26:0/1307280990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35540653a0 0x7f355412e0a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f3544011fb0 tx=0x7f3544016000).stop 2023-10-01T07:52:00.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.308+0000 7f35597a0700 1 -- 172.21.15.26:0/1307280990 shutdown_connections 2023-10-01T07:52:00.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.308+0000 7f35597a0700 1 --2- 172.21.15.26:0/1307280990 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f355412f430 0x7f355411a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:00.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.308+0000 7f35597a0700 1 --2- 172.21.15.26:0/1307280990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35540653a0 0x7f355412e0a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:00.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.308+0000 7f35597a0700 1 --2- 172.21.15.26:0/1307280990 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3554098b30 0x7f355412e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:00.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.308+0000 7f35597a0700 1 -- 172.21.15.26:0/1307280990 >> 172.21.15.26:0/1307280990 conn(0x7f355409dc20 msgr2=0x7f355409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:00.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.308+0000 7f35597a0700 1 -- 172.21.15.26:0/1307280990 shutdown_connections 2023-10-01T07:52:00.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.308+0000 7f35597a0700 1 -- 172.21.15.26:0/1307280990 wait complete. 2023-10-01T07:52:00.323 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-01T07:52:00.324 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-01T07:52:00.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.457+0000 7f924affc700 1 Processor -- start 2023-10-01T07:52:00.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.457+0000 7f924affc700 1 -- start start 2023-10-01T07:52:00.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.458+0000 7f924affc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9244127390 0x7f924412fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:00.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.458+0000 7f924affc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9244127fa0 0x7f9244132170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:00.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.458+0000 7f924affc700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9244096900 con 0x7f9244059070 2023-10-01T07:52:00.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.458+0000 7f924affc700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9244059c00 con 0x7f9244127390 2023-10-01T07:52:00.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.458+0000 7f924affc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9244091b60 con 0x7f9244127fa0 2023-10-01T07:52:00.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.458+0000 7f9249599700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9244127fa0 0x7f9244132170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:00.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.458+0000 7f9243fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9244127390 0x7f924412fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:00.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.458+0000 7f9248d98700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9244059070 0x7f9244127890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37884/0 (socket says 172.21.15.26:37884) 2023-10-01T07:52:00.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.458+0000 7f9248d98700 1 -- 172.21.15.26:0/3149240984 learned_addr learned my addr 172.21.15.26:0/3149240984 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:52:00.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.458+0000 7f92437fe700 1 -- 172.21.15.26:0/3149240984 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2352913688 0 0) 0x7f9244096900 con 0x7f9244059070 2023-10-01T07:52:00.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.458+0000 7f92437fe700 1 -- 172.21.15.26:0/3149240984 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92300033f0 con 0x7f9244059070 2023-10-01T07:52:00.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.458+0000 7f9249599700 1 -- 172.21.15.26:0/3149240984 >> v2:172.21.15.26:3300/0 conn(0x7f9244127390 msgr2=0x7f924412fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:00.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.458+0000 7f9249599700 1 --2- 172.21.15.26:0/3149240984 >> v2:172.21.15.26:3300/0 conn(0x7f9244127390 0x7f924412fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:00.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.458+0000 7f9249599700 1 -- 172.21.15.26:0/3149240984 >> v1:172.21.15.26:6789/0 conn(0x7f9244059070 legacy=0x7f9244127890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:00.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.459+0000 7f9249599700 1 -- 172.21.15.26:0/3149240984 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9244092a10 con 0x7f9244127fa0 2023-10-01T07:52:00.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.459+0000 7f9243fff700 1 --2- 172.21.15.26:0/3149240984 >> v2:172.21.15.26:3300/0 conn(0x7f9244127390 0x7f924412fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:00.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.459+0000 7f9249599700 1 --2- 172.21.15.26:0/3149240984 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9244127fa0 0x7f9244132170 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f923c009e60 tx=0x7f923c009780).ready entity=mon.1 client_cookie=1923289b41f1aae3 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:00.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.459+0000 7f92437fe700 1 -- 172.21.15.26:0/3149240984 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923c00e070 con 0x7f9244127fa0 2023-10-01T07:52:00.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.459+0000 7f92437fe700 1 -- 172.21.15.26:0/3149240984 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923c00bab0 con 0x7f9244127fa0 2023-10-01T07:52:00.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.459+0000 7f92437fe700 1 -- 172.21.15.26:0/3149240984 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923c00be30 con 0x7f9244127fa0 2023-10-01T07:52:00.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.459+0000 7f924affc700 1 -- 172.21.15.26:0/3149240984 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9244127fa0 msgr2=0x7f9244132170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:00.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.459+0000 7f924affc700 1 --2- 172.21.15.26:0/3149240984 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9244127fa0 0x7f9244132170 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f923c009e60 tx=0x7f923c009780).stop 2023-10-01T07:52:00.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.459+0000 7f924affc700 1 -- 172.21.15.26:0/3149240984 shutdown_connections 2023-10-01T07:52:00.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.459+0000 7f924affc700 1 --2- 172.21.15.26:0/3149240984 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9244127fa0 0x7f9244132170 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:00.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.459+0000 7f924affc700 1 --2- 172.21.15.26:0/3149240984 >> v2:172.21.15.26:3300/0 conn(0x7f9244127390 0x7f924412fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:00.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.459+0000 7f924affc700 1 -- 172.21.15.26:0/3149240984 >> 172.21.15.26:0/3149240984 conn(0x7f9244097470 msgr2=0x7f9244097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:00.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.459+0000 7f924affc700 1 -- 172.21.15.26:0/3149240984 shutdown_connections 2023-10-01T07:52:00.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.460+0000 7f924affc700 1 -- 172.21.15.26:0/3149240984 wait complete. 2023-10-01T07:52:00.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.460+0000 7f924affc700 1 Processor -- start 2023-10-01T07:52:00.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.461+0000 7f924affc700 1 -- start start 2023-10-01T07:52:00.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.461+0000 7f924affc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9244059070 0x7f9244125c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:00.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.461+0000 7f924affc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9244127390 0x7f924412e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:00.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.461+0000 7f924affc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9244127fa0 0x7f924412edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:00.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.461+0000 7f924affc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9244096f00 con 0x7f9244059070 2023-10-01T07:52:00.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.461+0000 7f924affc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92441110c0 con 0x7f9244127fa0 2023-10-01T07:52:00.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.461+0000 7f924affc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9244131d50 con 0x7f9244127390 2023-10-01T07:52:00.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.461+0000 7f9248d98700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9244059070 0x7f9244125c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:00.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.461+0000 7f9248d98700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9244059070 0x7f9244125c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37960/0 (socket says 172.21.15.26:37960) 2023-10-01T07:52:00.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.461+0000 7f9249599700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9244127fa0 0x7f924412edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:00.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.461+0000 7f9248d98700 1 -- 172.21.15.26:0/2830081982 learned_addr learned my addr 172.21.15.26:0/2830081982 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:00.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.461+0000 7f9243fff700 1 --2- 172.21.15.26:0/2830081982 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9244127390 0x7f924412e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:00.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.462+0000 7f9248d98700 1 -- 172.21.15.26:0/2830081982 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9244127390 msgr2=0x7f924412e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:00.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.462+0000 7f9248d98700 1 --2- 172.21.15.26:0/2830081982 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9244127390 0x7f924412e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:00.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.462+0000 7f9248d98700 1 -- 172.21.15.26:0/2830081982 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9244127fa0 msgr2=0x7f924412edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:00.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.462+0000 7f9248d98700 1 --2- 172.21.15.26:0/2830081982 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9244127fa0 0x7f924412edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:00.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.462+0000 7f9248d98700 1 -- 172.21.15.26:0/2830081982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f922c0092a0 con 0x7f9244059070 2023-10-01T07:52:00.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.462+0000 7f9249599700 1 --2- 172.21.15.26:0/2830081982 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9244127fa0 0x7f924412edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:00.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.462+0000 7f9248d98700 1 --2- 172.21.15.26:0/2830081982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9244059070 0x7f9244125c00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f923400c5c0 tx=0x7f9234007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:00.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.462+0000 7f9240ff9700 1 -- 172.21.15.26:0/2830081982 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92340072e0 con 0x7f9244059070 2023-10-01T07:52:00.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.462+0000 7f9240ff9700 1 -- 172.21.15.26:0/2830081982 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9234007440 con 0x7f9244059070 2023-10-01T07:52:00.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.462+0000 7f924affc700 1 -- 172.21.15.26:0/2830081982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f923c009a20 con 0x7f9244059070 2023-10-01T07:52:00.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.462+0000 7f9240ff9700 1 -- 172.21.15.26:0/2830081982 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92340057a0 con 0x7f9244059070 2023-10-01T07:52:00.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.462+0000 7f924affc700 1 -- 172.21.15.26:0/2830081982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9244111660 con 0x7f9244059070 2023-10-01T07:52:00.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.463+0000 7f9240ff9700 1 -- 172.21.15.26:0/2830081982 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f9234005bd0 con 0x7f9244059070 2023-10-01T07:52:00.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.463+0000 7f9240ff9700 1 -- 172.21.15.26:0/2830081982 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f923403a750 con 0x7f9244059070 2023-10-01T07:52:00.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.463+0000 7f924affc700 1 -- 172.21.15.26:0/2830081982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f924405a260 con 0x7f9244059070 2023-10-01T07:52:00.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.468+0000 7f9240ff9700 1 -- 172.21.15.26:0/2830081982 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f923401d3f0 con 0x7f9244059070 2023-10-01T07:52:00.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.687+0000 7f924affc700 1 -- 172.21.15.26:0/2830081982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f924412f6e0 con 0x7f9244059070 2023-10-01T07:52:00.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.688+0000 7f9240ff9700 1 -- 172.21.15.26:0/2830081982 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2156 (secure 0 0 0) 0x7f9234010300 con 0x7f9244059070 2023-10-01T07:52:00.688 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:52:00.688 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-01T07:51:57.295264+0000","modified":"2023-10-01T07:52:00.301728+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4189},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4189":{"gid":4189,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6817/2857714939","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6817","nonce":2857714939}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-01T07:52:00.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.690+0000 7f924affc700 1 -- 172.21.15.26:0/2830081982 >> v1:172.21.15.26:6816/118178 conn(0x7f922402bb60 legacy=0x7f922402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:00.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.690+0000 7f924affc700 1 -- 172.21.15.26:0/2830081982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9244059070 msgr2=0x7f9244125c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:00.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.690+0000 7f924affc700 1 --2- 172.21.15.26:0/2830081982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9244059070 0x7f9244125c00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f923400c5c0 tx=0x7f9234007c80).stop 2023-10-01T07:52:00.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.690+0000 7f924affc700 1 -- 172.21.15.26:0/2830081982 shutdown_connections 2023-10-01T07:52:00.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.690+0000 7f924affc700 1 --2- 172.21.15.26:0/2830081982 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9244127fa0 0x7f924412edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:00.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.690+0000 7f924affc700 1 --2- 172.21.15.26:0/2830081982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9244059070 0x7f9244125c00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:00.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.690+0000 7f924affc700 1 --2- 172.21.15.26:0/2830081982 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9244127390 0x7f924412e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:00.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.690+0000 7f924affc700 1 -- 172.21.15.26:0/2830081982 >> 172.21.15.26:0/2830081982 conn(0x7f9244097470 msgr2=0x7f92440942f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:00.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.690+0000 7f924affc700 1 -- 172.21.15.26:0/2830081982 shutdown_connections 2023-10-01T07:52:00.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.690+0000 7f924affc700 1 -- 172.21.15.26:0/2830081982 wait complete. 2023-10-01T07:52:00.692 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 6 2023-10-01T07:52:00.704 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-01T07:52:00.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.833+0000 7f9123971700 1 Processor -- start 2023-10-01T07:52:00.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.834+0000 7f9123971700 1 -- start start 2023-10-01T07:52:00.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.834+0000 7f9123971700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f911c0969b0 0x7f911c096d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:00.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.834+0000 7f9123971700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f911c0673e0 0x7f911c130ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:00.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.834+0000 7f9123971700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f911c092fe0 con 0x7f911c097280 2023-10-01T07:52:00.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.834+0000 7f9123971700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f911c094560 con 0x7f911c0673e0 2023-10-01T07:52:00.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.834+0000 7f9123971700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f911c093260 con 0x7f911c0969b0 2023-10-01T07:52:00.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.834+0000 7f912170d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f911c0969b0 0x7f911c096d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:00.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.834+0000 7f9121f0e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f911c0673e0 0x7f911c130ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:00.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.834+0000 7f912170d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f911c0969b0 0x7f911c096d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43974/0 (socket says 172.21.15.26:43974) 2023-10-01T07:52:00.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.834+0000 7f912170d700 1 -- 172.21.15.26:0/2465097576 learned_addr learned my addr 172.21.15.26:0/2465097576 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:00.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.834+0000 7f9121f0e700 1 --2- 172.21.15.26:0/2465097576 >> v2:172.21.15.26:3300/0 conn(0x7f911c0673e0 0x7f911c130ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37972/0 (socket says 172.21.15.26:37972) 2023-10-01T07:52:00.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.835+0000 7f912170d700 1 -- 172.21.15.26:0/2465097576 >> v2:172.21.15.26:3300/0 conn(0x7f911c0673e0 msgr2=0x7f911c130ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:00.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.835+0000 7f912170d700 1 --2- 172.21.15.26:0/2465097576 >> v2:172.21.15.26:3300/0 conn(0x7f911c0673e0 0x7f911c130ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:00.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.835+0000 7f912170d700 1 -- 172.21.15.26:0/2465097576 >> v1:172.21.15.26:6789/0 conn(0x7f911c097280 legacy=0x7f911c066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:00.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.835+0000 7f912170d700 1 -- 172.21.15.26:0/2465097576 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f911c092b30 con 0x7f911c0969b0 2023-10-01T07:52:00.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.835+0000 7f9121f0e700 1 --2- 172.21.15.26:0/2465097576 >> v2:172.21.15.26:3300/0 conn(0x7f911c0673e0 0x7f911c130ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:00.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.835+0000 7f912170d700 1 --2- 172.21.15.26:0/2465097576 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f911c0969b0 0x7f911c096d90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f9118006fd0 tx=0x7f91180090f0).ready entity=mon.1 client_cookie=a4a4a2c0d6e24337 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:00.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.835+0000 7f9113fff700 1 -- 172.21.15.26:0/2465097576 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911800b580 con 0x7f911c0969b0 2023-10-01T07:52:00.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.835+0000 7f9113fff700 1 -- 172.21.15.26:0/2465097576 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911800b6e0 con 0x7f911c0969b0 2023-10-01T07:52:00.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.835+0000 7f9113fff700 1 -- 172.21.15.26:0/2465097576 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911800ba60 con 0x7f911c0969b0 2023-10-01T07:52:00.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.835+0000 7f9123971700 1 -- 172.21.15.26:0/2465097576 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f911c0969b0 msgr2=0x7f911c096d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:00.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.835+0000 7f9123971700 1 --2- 172.21.15.26:0/2465097576 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f911c0969b0 0x7f911c096d90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f9118006fd0 tx=0x7f91180090f0).stop 2023-10-01T07:52:00.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.836+0000 7f9123971700 1 -- 172.21.15.26:0/2465097576 shutdown_connections 2023-10-01T07:52:00.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.836+0000 7f9123971700 1 --2- 172.21.15.26:0/2465097576 >> v2:172.21.15.26:3300/0 conn(0x7f911c0673e0 0x7f911c130ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:00.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.836+0000 7f9123971700 1 --2- 172.21.15.26:0/2465097576 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f911c0969b0 0x7f911c096d90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:00.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.836+0000 7f9123971700 1 -- 172.21.15.26:0/2465097576 >> 172.21.15.26:0/2465097576 conn(0x7f911c09a220 msgr2=0x7f911c09a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:00.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.836+0000 7f9123971700 1 -- 172.21.15.26:0/2465097576 shutdown_connections 2023-10-01T07:52:00.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.836+0000 7f9123971700 1 -- 172.21.15.26:0/2465097576 wait complete. 2023-10-01T07:52:00.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.837+0000 7f9123971700 1 Processor -- start 2023-10-01T07:52:00.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.837+0000 7f9123971700 1 -- start start 2023-10-01T07:52:00.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.837+0000 7f9123971700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f911c0673e0 0x7f911c138530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:00.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.837+0000 7f9123971700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f911c0969b0 0x7f911c138a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:00.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.837+0000 7f9123971700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f911c097280 0x7f911c114f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:00.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.837+0000 7f9123971700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911c12d2f0 con 0x7f911c097280 2023-10-01T07:52:00.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.837+0000 7f9123971700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f911c092d60 con 0x7f911c0673e0 2023-10-01T07:52:00.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.837+0000 7f9123971700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f911c1189c0 con 0x7f911c0969b0 2023-10-01T07:52:00.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.837+0000 7f9120f0c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f911c0969b0 0x7f911c138a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:00.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.837+0000 7f9121f0e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f911c097280 0x7f911c114f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:00.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.837+0000 7f9120f0c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f911c0969b0 0x7f911c138a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59564/0 (socket says 172.21.15.26:59564) 2023-10-01T07:52:00.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.837+0000 7f9121f0e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f911c097280 0x7f911c114f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37974/0 (socket says 172.21.15.26:37974) 2023-10-01T07:52:00.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.837+0000 7f9120f0c700 1 -- 172.21.15.26:0/1812512414 learned_addr learned my addr 172.21.15.26:0/1812512414 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:00.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.837+0000 7f912170d700 1 --2- 172.21.15.26:0/1812512414 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f911c0673e0 0x7f911c138530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:00.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.838+0000 7f9120f0c700 1 -- 172.21.15.26:0/1812512414 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f911c0673e0 msgr2=0x7f911c138530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:00.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.838+0000 7f9120f0c700 1 --2- 172.21.15.26:0/1812512414 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f911c0673e0 0x7f911c138530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:00.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.838+0000 7f9120f0c700 1 -- 172.21.15.26:0/1812512414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f911c097280 msgr2=0x7f911c114f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:00.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.838+0000 7f9120f0c700 1 --2- 172.21.15.26:0/1812512414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f911c097280 0x7f911c114f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:00.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.838+0000 7f9120f0c700 1 -- 172.21.15.26:0/1812512414 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9114009a20 con 0x7f911c0969b0 2023-10-01T07:52:00.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.838+0000 7f912170d700 1 --2- 172.21.15.26:0/1812512414 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f911c0673e0 0x7f911c138530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:00.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.838+0000 7f9121f0e700 1 --2- 172.21.15.26:0/1812512414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f911c097280 0x7f911c114f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:00.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.838+0000 7f9120f0c700 1 --2- 172.21.15.26:0/1812512414 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f911c0969b0 0x7f911c138a20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f910c00c4c0 tx=0x7f910c007e00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:00.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.838+0000 7f91117fa700 1 -- 172.21.15.26:0/1812512414 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910c007020 con 0x7f911c0969b0 2023-10-01T07:52:00.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.838+0000 7f91117fa700 1 -- 172.21.15.26:0/1812512414 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910c001e90 con 0x7f911c0969b0 2023-10-01T07:52:00.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.838+0000 7f9123971700 1 -- 172.21.15.26:0/1812512414 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9118009370 con 0x7f911c0969b0 2023-10-01T07:52:00.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.838+0000 7f91117fa700 1 -- 172.21.15.26:0/1812512414 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910c0073d0 con 0x7f911c0969b0 2023-10-01T07:52:00.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.838+0000 7f9123971700 1 -- 172.21.15.26:0/1812512414 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f911c1190a0 con 0x7f911c0969b0 2023-10-01T07:52:00.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.839+0000 7f91117fa700 1 -- 172.21.15.26:0/1812512414 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f910c0068b0 con 0x7f911c0969b0 2023-10-01T07:52:00.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.839+0000 7f91117fa700 1 -- 172.21.15.26:0/1812512414 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f910c03a830 con 0x7f911c0969b0 2023-10-01T07:52:00.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.839+0000 7f9123971700 1 -- 172.21.15.26:0/1812512414 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f911c05a260 con 0x7f911c0969b0 2023-10-01T07:52:00.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:00.844+0000 7f91117fa700 1 -- 172.21.15.26:0/1812512414 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f910c007530 con 0x7f911c0969b0 2023-10-01T07:52:01.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.020+0000 7f9123971700 1 -- 172.21.15.26:0/1812512414 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f911c046c20 con 0x7f911c0969b0 2023-10-01T07:52:01.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.021+0000 7f91117fa700 1 -- 172.21.15.26:0/1812512414 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11341 (secure 0 0 0) 0x7f910c01ab40 con 0x7f911c0969b0 2023-10-01T07:52:01.022 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:52:01.022 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":17,"fsid":"c29fb19d-520c-42a6-90f4-e7f86de96e8e","created":"2023-10-01T07:51:40.702414+0000","modified":"2023-10-01T07:51:58.296715+0000","last_up_change":"2023-10-01T07:51:48.849482+0000","last_in_change":"2023-10-01T07:51:42.084736+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-01T07:51:48.906889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-01T07:51:50.071599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-01T07:51:54.981575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-01T07:51:56.286318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46569ce3-81d1-44a1-a649-691de3e6f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6800","nonce":118773}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6801","nonce":118773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6803","nonce":118773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6802","nonce":118773}]},"public_addr":"172.21.15.26:6800/118773","cluster_addr":"172.21.15.26:6801/118773","heartbeat_back_addr":"172.21.15.26:6803/118773","heartbeat_front_addr":"172.21.15.26:6802/118773","state":["exists","up"]},{"osd":1,"uuid":"1fc1ba9b-4110-4d31-96d6-794937578cff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6804","nonce":118782}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6806","nonce":118782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6810","nonce":118782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6808","nonce":118782}]},"public_addr":"172.21.15.26:6804/118782","cluster_addr":"172.21.15.26:6806/118782","heartbeat_back_addr":"172.21.15.26:6810/118782","heartbeat_front_addr":"172.21.15.26:6808/118782","state":["exists","up"]},{"osd":2,"uuid":"37de933d-3b8e-4b94-87bd-2f36896c7ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6805","nonce":118789}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6807","nonce":118789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6811","nonce":118789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6809","nonce":118789}]},"public_addr":"172.21.15.26:6805/118789","cluster_addr":"172.21.15.26:6807/118789","heartbeat_back_addr":"172.21.15.26:6811/118789","heartbeat_front_addr":"172.21.15.26:6809/118789","state":["exists","up"]},{"osd":3,"uuid":"bd020309-5fd2-4d97-b36a-67e159fa3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6812","nonce":118790}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6813","nonce":118790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6815","nonce":118790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6814","nonce":118790}]},"public_addr":"172.21.15.26:6812/118790","cluster_addr":"172.21.15.26:6813/118790","heartbeat_back_addr":"172.21.15.26:6815/118790","heartbeat_front_addr":"172.21.15.26:6814/118790","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.029993+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.266503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.273540+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.229731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-01T07:52:01.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.023+0000 7f9123971700 1 -- 172.21.15.26:0/1812512414 >> v1:172.21.15.26:6816/118178 conn(0x7f910002bb60 legacy=0x7f910002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:01.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.023+0000 7f9123971700 1 -- 172.21.15.26:0/1812512414 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f911c0969b0 msgr2=0x7f911c138a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:01.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.023+0000 7f9123971700 1 --2- 172.21.15.26:0/1812512414 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f911c0969b0 0x7f911c138a20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f910c00c4c0 tx=0x7f910c007e00).stop 2023-10-01T07:52:01.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.023+0000 7f9123971700 1 -- 172.21.15.26:0/1812512414 shutdown_connections 2023-10-01T07:52:01.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.023+0000 7f9123971700 1 --2- 172.21.15.26:0/1812512414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f911c097280 0x7f911c114f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:01.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.023+0000 7f9123971700 1 --2- 172.21.15.26:0/1812512414 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f911c0673e0 0x7f911c138530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:01.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.023+0000 7f9123971700 1 --2- 172.21.15.26:0/1812512414 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f911c0969b0 0x7f911c138a20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:01.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.023+0000 7f9123971700 1 -- 172.21.15.26:0/1812512414 >> 172.21.15.26:0/1812512414 conn(0x7f911c09a220 msgr2=0x7f911c098190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:01.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.023+0000 7f9123971700 1 -- 172.21.15.26:0/1812512414 shutdown_connections 2023-10-01T07:52:01.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.023+0000 7f9123971700 1 -- 172.21.15.26:0/1812512414 wait complete. 2023-10-01T07:52:01.037 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-01T07:52:01.037 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-01T07:52:01.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.167+0000 7fd944eee700 1 Processor -- start 2023-10-01T07:52:01.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.167+0000 7fd944eee700 1 -- start start 2023-10-01T07:52:01.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.168+0000 7fd944eee700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd940064570 0x7fd94012b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:01.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.168+0000 7fd944eee700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd94012fe90 0x7fd940132280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:01.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.168+0000 7fd944eee700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9400656f0 con 0x7fd9400661b0 2023-10-01T07:52:01.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.168+0000 7fd944eee700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd940066590 con 0x7fd94012fe90 2023-10-01T07:52:01.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.168+0000 7fd944eee700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9400649f0 con 0x7fd940064570 2023-10-01T07:52:01.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.168+0000 7fd93ed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd94012fe90 0x7fd940132280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:01.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.168+0000 7fd93e59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd9400661b0 0x7fd94012aa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37910/0 (socket says 172.21.15.26:37910) 2023-10-01T07:52:01.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.168+0000 7fd93dd9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd940064570 0x7fd94012b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:01.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.168+0000 7fd93e59c700 1 -- 172.21.15.26:0/2941161610 learned_addr learned my addr 172.21.15.26:0/2941161610 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:52:01.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.168+0000 7fd93d59a700 1 -- 172.21.15.26:0/2941161610 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1321104216 0 0) 0x7fd9400656f0 con 0x7fd9400661b0 2023-10-01T07:52:01.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.168+0000 7fd93d59a700 1 -- 172.21.15.26:0/2941161610 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd92c0033f0 con 0x7fd9400661b0 2023-10-01T07:52:01.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.168+0000 7fd93dd9b700 1 -- 172.21.15.26:0/2941161610 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd94012fe90 msgr2=0x7fd940132280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:01.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.168+0000 7fd93dd9b700 1 --2- 172.21.15.26:0/2941161610 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd94012fe90 0x7fd940132280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:01.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.168+0000 7fd93dd9b700 1 -- 172.21.15.26:0/2941161610 >> v1:172.21.15.26:6789/0 conn(0x7fd9400661b0 legacy=0x7fd94012aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:01.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.168+0000 7fd93dd9b700 1 -- 172.21.15.26:0/2941161610 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94012b810 con 0x7fd940064570 2023-10-01T07:52:01.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.168+0000 7fd93ed9d700 1 --2- 172.21.15.26:0/2941161610 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd94012fe90 0x7fd940132280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:01.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.168+0000 7fd93dd9b700 1 --2- 172.21.15.26:0/2941161610 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd940064570 0x7fd94012b320 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fd928009790 tx=0x7fd928009060).ready entity=mon.2 client_cookie=cf95fc1c41609983 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:01.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.169+0000 7fd93d59a700 1 -- 172.21.15.26:0/2941161610 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92800f510 con 0x7fd940064570 2023-10-01T07:52:01.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.169+0000 7fd93d59a700 1 -- 172.21.15.26:0/2941161610 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd92800f670 con 0x7fd940064570 2023-10-01T07:52:01.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.169+0000 7fd93d59a700 1 -- 172.21.15.26:0/2941161610 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92800f9f0 con 0x7fd940064570 2023-10-01T07:52:01.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.169+0000 7fd944eee700 1 -- 172.21.15.26:0/2941161610 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd940064570 msgr2=0x7fd94012b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:01.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.169+0000 7fd944eee700 1 --2- 172.21.15.26:0/2941161610 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd940064570 0x7fd94012b320 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fd928009790 tx=0x7fd928009060).stop 2023-10-01T07:52:01.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.169+0000 7fd944eee700 1 -- 172.21.15.26:0/2941161610 shutdown_connections 2023-10-01T07:52:01.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.169+0000 7fd944eee700 1 --2- 172.21.15.26:0/2941161610 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd94012fe90 0x7fd940132280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:01.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.169+0000 7fd944eee700 1 --2- 172.21.15.26:0/2941161610 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd940064570 0x7fd94012b320 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:01.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.169+0000 7fd944eee700 1 -- 172.21.15.26:0/2941161610 >> 172.21.15.26:0/2941161610 conn(0x7fd94009ba50 msgr2=0x7fd94009be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:01.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.169+0000 7fd944eee700 1 -- 172.21.15.26:0/2941161610 shutdown_connections 2023-10-01T07:52:01.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.169+0000 7fd944eee700 1 -- 172.21.15.26:0/2941161610 wait complete. 2023-10-01T07:52:01.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.170+0000 7fd944eee700 1 Processor -- start 2023-10-01T07:52:01.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.170+0000 7fd944eee700 1 -- start start 2023-10-01T07:52:01.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.171+0000 7fd944eee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd940064570 0x7fd9401275c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:01.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.171+0000 7fd944eee700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9400661b0 0x7fd94012bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:01.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.171+0000 7fd944eee700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd94012fe90 0x7fd94012c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:01.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.171+0000 7fd944eee700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94012d930 con 0x7fd940064570 2023-10-01T07:52:01.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.171+0000 7fd944eee700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd940130270 con 0x7fd9400661b0 2023-10-01T07:52:01.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.171+0000 7fd944eee700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9400650b0 con 0x7fd94012fe90 2023-10-01T07:52:01.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.171+0000 7fd93ed9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd94012fe90 0x7fd94012c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:01.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.171+0000 7fd93dd9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9400661b0 0x7fd94012bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:01.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.171+0000 7fd93ed9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd94012fe90 0x7fd94012c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59572/0 (socket says 172.21.15.26:59572) 2023-10-01T07:52:01.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.171+0000 7fd93e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd940064570 0x7fd9401275c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:01.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.171+0000 7fd93ed9d700 1 -- 172.21.15.26:0/801522834 learned_addr learned my addr 172.21.15.26:0/801522834 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:01.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.171+0000 7fd93dd9b700 1 -- 172.21.15.26:0/801522834 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd94012fe90 msgr2=0x7fd94012c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:01.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.171+0000 7fd93dd9b700 1 --2- 172.21.15.26:0/801522834 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd94012fe90 0x7fd94012c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:01.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.171+0000 7fd93dd9b700 1 -- 172.21.15.26:0/801522834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd940064570 msgr2=0x7fd9401275c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:01.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.171+0000 7fd93dd9b700 1 --2- 172.21.15.26:0/801522834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd940064570 0x7fd9401275c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:01.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.171+0000 7fd93dd9b700 1 -- 172.21.15.26:0/801522834 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd938009a20 con 0x7fd9400661b0 2023-10-01T07:52:01.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.171+0000 7fd93dd9b700 1 --2- 172.21.15.26:0/801522834 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9400661b0 0x7fd94012bc60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fd94009ca10 tx=0x7fd928017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:01.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.171+0000 7fd9367fc700 1 -- 172.21.15.26:0/801522834 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92800fe70 con 0x7fd9400661b0 2023-10-01T07:52:01.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.171+0000 7fd9367fc700 1 -- 172.21.15.26:0/801522834 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd92800f7e0 con 0x7fd9400661b0 2023-10-01T07:52:01.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.171+0000 7fd944eee700 1 -- 172.21.15.26:0/801522834 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9280092a0 con 0x7fd9400661b0 2023-10-01T07:52:01.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.171+0000 7fd9367fc700 1 -- 172.21.15.26:0/801522834 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92801b410 con 0x7fd9400661b0 2023-10-01T07:52:01.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.171+0000 7fd944eee700 1 -- 172.21.15.26:0/801522834 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd94012cef0 con 0x7fd9400661b0 2023-10-01T07:52:01.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.172+0000 7fd9367fc700 1 -- 172.21.15.26:0/801522834 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fd92801b780 con 0x7fd9400661b0 2023-10-01T07:52:01.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.172+0000 7fd9367fc700 1 -- 172.21.15.26:0/801522834 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fd92803c7a0 con 0x7fd9400661b0 2023-10-01T07:52:01.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.173+0000 7fd944eee700 1 -- 172.21.15.26:0/801522834 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd94012e300 con 0x7fd9400661b0 2023-10-01T07:52:01.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.177+0000 7fd9367fc700 1 -- 172.21.15.26:0/801522834 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fd94012e300 con 0x7fd9400661b0 2023-10-01T07:52:01.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.350+0000 7fd944eee700 1 -- 172.21.15.26:0/801522834 --> v1:172.21.15.26:6816/118178 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd94012e300 con 0x7fd92002bb60 2023-10-01T07:52:01.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.358+0000 7fd9367fc700 1 -- 172.21.15.26:0/801522834 <== mgr.4107 v1:172.21.15.26:6816/118178 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+247647 (unknown 2965378022 0 1090360660) 0x7fd94012e300 con 0x7fd92002bb60 2023-10-01T07:52:01.361 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:52:01.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.361+0000 7fd944eee700 1 -- 172.21.15.26:0/801522834 >> v1:172.21.15.26:6816/118178 conn(0x7fd92002bb60 legacy=0x7fd92002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:01.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.361+0000 7fd944eee700 1 -- 172.21.15.26:0/801522834 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9400661b0 msgr2=0x7fd94012bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:01.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.361+0000 7fd944eee700 1 --2- 172.21.15.26:0/801522834 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9400661b0 0x7fd94012bc60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fd94009ca10 tx=0x7fd928017000).stop 2023-10-01T07:52:01.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.361+0000 7fd944eee700 1 -- 172.21.15.26:0/801522834 shutdown_connections 2023-10-01T07:52:01.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.361+0000 7fd944eee700 1 --2- 172.21.15.26:0/801522834 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd94012fe90 0x7fd94012c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:01.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.361+0000 7fd944eee700 1 --2- 172.21.15.26:0/801522834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd940064570 0x7fd9401275c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:01.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.361+0000 7fd944eee700 1 --2- 172.21.15.26:0/801522834 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9400661b0 0x7fd94012bc60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:01.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.361+0000 7fd944eee700 1 -- 172.21.15.26:0/801522834 >> 172.21.15.26:0/801522834 conn(0x7fd94009ba50 msgr2=0x7fd940099880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:01.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.361+0000 7fd944eee700 1 -- 172.21.15.26:0/801522834 shutdown_connections 2023-10-01T07:52:01.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.361+0000 7fd944eee700 1 -- 172.21.15.26:0/801522834 wait complete. 2023-10-01T07:52:01.364 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-01T07:52:01.374 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-10-01T07:51:59.806899+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":666,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":68,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188944,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298416,"statfs":{"total":386547056640,"available":385329577984,"internally_reserved":0,"allocated":573440,"data_stored":161864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.340051+0000","last_change":"2023-10-01T07:51:57.340051+0000","last_active":"2023-10-01T07:51:57.340051+0000","last_peered":"2023-10-01T07:51:57.340051+0000","last_clean":"2023-10-01T07:51:57.340051+0000","last_became_active":"2023-10-01T07:51:57.339739+0000","last_became_peered":"2023-10-01T07:51:57.339739+0000","last_unstale":"2023-10-01T07:51:57.340051+0000","last_undegraded":"2023-10-01T07:51:57.340051+0000","last_fullsized":"2023-10-01T07:51:57.340051+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.330147+0000","last_change":"2023-10-01T07:51:57.330147+0000","last_active":"2023-10-01T07:51:57.330147+0000","last_peered":"2023-10-01T07:51:57.330147+0000","last_clean":"2023-10-01T07:51:57.330147+0000","last_became_active":"2023-10-01T07:51:57.329793+0000","last_became_peered":"2023-10-01T07:51:57.329793+0000","last_unstale":"2023-10-01T07:51:57.330147+0000","last_undegraded":"2023-10-01T07:51:57.330147+0000","last_fullsized":"2023-10-01T07:51:57.330147+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.343537+0000","last_change":"2023-10-01T07:51:57.335404+0000","last_active":"2023-10-01T07:51:57.343537+0000","last_peered":"2023-10-01T07:51:57.343537+0000","last_clean":"2023-10-01T07:51:57.343537+0000","last_became_active":"2023-10-01T07:51:57.329225+0000","last_became_peered":"2023-10-01T07:51:57.329225+0000","last_unstale":"2023-10-01T07:51:57.343537+0000","last_undegraded":"2023-10-01T07:51:57.343537+0000","last_fullsized":"2023-10-01T07:51:57.343537+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.337475+0000","last_change":"2023-10-01T07:51:57.332237+0000","last_active":"2023-10-01T07:51:57.337475+0000","last_peered":"2023-10-01T07:51:57.337475+0000","last_clean":"2023-10-01T07:51:57.337475+0000","last_became_active":"2023-10-01T07:51:57.331857+0000","last_became_peered":"2023-10-01T07:51:57.331857+0000","last_unstale":"2023-10-01T07:51:57.337475+0000","last_undegraded":"2023-10-01T07:51:57.337475+0000","last_fullsized":"2023-10-01T07:51:57.337475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335610+0000","last_change":"2023-10-01T07:51:57.326512+0000","last_active":"2023-10-01T07:51:57.335610+0000","last_peered":"2023-10-01T07:51:57.335610+0000","last_clean":"2023-10-01T07:51:57.335610+0000","last_became_active":"2023-10-01T07:51:57.326202+0000","last_became_peered":"2023-10-01T07:51:57.326202+0000","last_unstale":"2023-10-01T07:51:57.335610+0000","last_undegraded":"2023-10-01T07:51:57.335610+0000","last_fullsized":"2023-10-01T07:51:57.335610+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335188+0000","last_change":"2023-10-01T07:51:57.323649+0000","last_active":"2023-10-01T07:51:57.335188+0000","last_peered":"2023-10-01T07:51:57.335188+0000","last_clean":"2023-10-01T07:51:57.335188+0000","last_became_active":"2023-10-01T07:51:57.319917+0000","last_became_peered":"2023-10-01T07:51:57.319917+0000","last_unstale":"2023-10-01T07:51:57.335188+0000","last_undegraded":"2023-10-01T07:51:57.335188+0000","last_fullsized":"2023-10-01T07:51:57.335188+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335645+0000","last_change":"2023-10-01T07:51:57.325845+0000","last_active":"2023-10-01T07:51:57.335645+0000","last_peered":"2023-10-01T07:51:57.335645+0000","last_clean":"2023-10-01T07:51:57.335645+0000","last_became_active":"2023-10-01T07:51:57.325346+0000","last_became_peered":"2023-10-01T07:51:57.325346+0000","last_unstale":"2023-10-01T07:51:57.335645+0000","last_undegraded":"2023-10-01T07:51:57.335645+0000","last_fullsized":"2023-10-01T07:51:57.335645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.337622+0000","last_change":"2023-10-01T07:51:57.328438+0000","last_active":"2023-10-01T07:51:57.337622+0000","last_peered":"2023-10-01T07:51:57.337622+0000","last_clean":"2023-10-01T07:51:57.337622+0000","last_became_active":"2023-10-01T07:51:57.328128+0000","last_became_peered":"2023-10-01T07:51:57.328128+0000","last_unstale":"2023-10-01T07:51:57.337622+0000","last_undegraded":"2023-10-01T07:51:57.337622+0000","last_fullsized":"2023-10-01T07:51:57.337622+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.333136+0000","last_change":"2023-10-01T07:51:57.328650+0000","last_active":"2023-10-01T07:51:57.333136+0000","last_peered":"2023-10-01T07:51:57.333136+0000","last_clean":"2023-10-01T07:51:57.333136+0000","last_became_active":"2023-10-01T07:51:57.328335+0000","last_became_peered":"2023-10-01T07:51:57.328335+0000","last_unstale":"2023-10-01T07:51:57.333136+0000","last_undegraded":"2023-10-01T07:51:57.333136+0000","last_fullsized":"2023-10-01T07:51:57.333136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.331991+0000","last_change":"2023-10-01T07:51:57.331991+0000","last_active":"2023-10-01T07:51:57.331991+0000","last_peered":"2023-10-01T07:51:57.331991+0000","last_clean":"2023-10-01T07:51:57.331991+0000","last_became_active":"2023-10-01T07:51:57.331698+0000","last_became_peered":"2023-10-01T07:51:57.331698+0000","last_unstale":"2023-10-01T07:51:57.331991+0000","last_undegraded":"2023-10-01T07:51:57.331991+0000","last_fullsized":"2023-10-01T07:51:57.331991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.342157+0000","last_change":"2023-10-01T07:51:57.342157+0000","last_active":"2023-10-01T07:51:57.342157+0000","last_peered":"2023-10-01T07:51:57.342157+0000","last_clean":"2023-10-01T07:51:57.342157+0000","last_became_active":"2023-10-01T07:51:57.341533+0000","last_became_peered":"2023-10-01T07:51:57.341533+0000","last_unstale":"2023-10-01T07:51:57.342157+0000","last_undegraded":"2023-10-01T07:51:57.342157+0000","last_fullsized":"2023-10-01T07:51:57.342157+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.323193+0000","last_change":"2023-10-01T07:51:57.318295+0000","last_active":"2023-10-01T07:51:57.323193+0000","last_peered":"2023-10-01T07:51:57.323193+0000","last_clean":"2023-10-01T07:51:57.323193+0000","last_became_active":"2023-10-01T07:51:57.317972+0000","last_became_peered":"2023-10-01T07:51:57.317972+0000","last_unstale":"2023-10-01T07:51:57.323193+0000","last_undegraded":"2023-10-01T07:51:57.323193+0000","last_fullsized":"2023-10-01T07:51:57.323193+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.334056+0000","last_change":"2023-10-01T07:51:57.321137+0000","last_active":"2023-10-01T07:51:57.334056+0000","last_peered":"2023-10-01T07:51:57.334056+0000","last_clean":"2023-10-01T07:51:57.334056+0000","last_became_active":"2023-10-01T07:51:57.320789+0000","last_became_peered":"2023-10-01T07:51:57.320789+0000","last_unstale":"2023-10-01T07:51:57.334056+0000","last_undegraded":"2023-10-01T07:51:57.334056+0000","last_fullsized":"2023-10-01T07:51:57.334056+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335623+0000","last_change":"2023-10-01T07:51:57.325641+0000","last_active":"2023-10-01T07:51:57.335623+0000","last_peered":"2023-10-01T07:51:57.335623+0000","last_clean":"2023-10-01T07:51:57.335623+0000","last_became_active":"2023-10-01T07:51:57.324956+0000","last_became_peered":"2023-10-01T07:51:57.324956+0000","last_unstale":"2023-10-01T07:51:57.335623+0000","last_undegraded":"2023-10-01T07:51:57.335623+0000","last_fullsized":"2023-10-01T07:51:57.335623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.321164+0000","last_change":"2023-10-01T07:51:57.316882+0000","last_active":"2023-10-01T07:51:57.321164+0000","last_peered":"2023-10-01T07:51:57.321164+0000","last_clean":"2023-10-01T07:51:57.321164+0000","last_became_active":"2023-10-01T07:51:57.316026+0000","last_became_peered":"2023-10-01T07:51:57.316026+0000","last_unstale":"2023-10-01T07:51:57.321164+0000","last_undegraded":"2023-10-01T07:51:57.321164+0000","last_fullsized":"2023-10-01T07:51:57.321164+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.340110+0000","last_change":"2023-10-01T07:51:57.340110+0000","last_active":"2023-10-01T07:51:57.340110+0000","last_peered":"2023-10-01T07:51:57.340110+0000","last_clean":"2023-10-01T07:51:57.340110+0000","last_became_active":"2023-10-01T07:51:57.339795+0000","last_became_peered":"2023-10-01T07:51:57.339795+0000","last_unstale":"2023-10-01T07:51:57.340110+0000","last_undegraded":"2023-10-01T07:51:57.340110+0000","last_fullsized":"2023-10-01T07:51:57.340110+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348821+0000","last_change":"2023-10-01T07:51:57.347691+0000","last_active":"2023-10-01T07:51:57.348821+0000","last_peered":"2023-10-01T07:51:57.348821+0000","last_clean":"2023-10-01T07:51:57.348821+0000","last_became_active":"2023-10-01T07:51:57.347374+0000","last_became_peered":"2023-10-01T07:51:57.347374+0000","last_unstale":"2023-10-01T07:51:57.348821+0000","last_undegraded":"2023-10-01T07:51:57.348821+0000","last_fullsized":"2023-10-01T07:51:57.348821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348551+0000","last_change":"2023-10-01T07:51:57.341479+0000","last_active":"2023-10-01T07:51:57.348551+0000","last_peered":"2023-10-01T07:51:57.348551+0000","last_clean":"2023-10-01T07:51:57.348551+0000","last_became_active":"2023-10-01T07:51:57.341064+0000","last_became_peered":"2023-10-01T07:51:57.341064+0000","last_unstale":"2023-10-01T07:51:57.348551+0000","last_undegraded":"2023-10-01T07:51:57.348551+0000","last_fullsized":"2023-10-01T07:51:57.348551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.338618+0000","last_change":"2023-10-01T07:51:57.332063+0000","last_active":"2023-10-01T07:51:57.338618+0000","last_peered":"2023-10-01T07:51:57.338618+0000","last_clean":"2023-10-01T07:51:57.338618+0000","last_became_active":"2023-10-01T07:51:57.331511+0000","last_became_peered":"2023-10-01T07:51:57.331511+0000","last_unstale":"2023-10-01T07:51:57.338618+0000","last_undegraded":"2023-10-01T07:51:57.338618+0000","last_fullsized":"2023-10-01T07:51:57.338618+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.336578+0000","last_change":"2023-10-01T07:51:57.334881+0000","last_active":"2023-10-01T07:51:57.336578+0000","last_peered":"2023-10-01T07:51:57.336578+0000","last_clean":"2023-10-01T07:51:57.336578+0000","last_became_active":"2023-10-01T07:51:57.334682+0000","last_became_peered":"2023-10-01T07:51:57.334682+0000","last_unstale":"2023-10-01T07:51:57.336578+0000","last_undegraded":"2023-10-01T07:51:57.336578+0000","last_fullsized":"2023-10-01T07:51:57.336578+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.336811+0000","last_change":"2023-10-01T07:51:57.334700+0000","last_active":"2023-10-01T07:51:57.336811+0000","last_peered":"2023-10-01T07:51:57.336811+0000","last_clean":"2023-10-01T07:51:57.336811+0000","last_became_active":"2023-10-01T07:51:57.334406+0000","last_became_peered":"2023-10-01T07:51:57.334406+0000","last_unstale":"2023-10-01T07:51:57.336811+0000","last_undegraded":"2023-10-01T07:51:57.336811+0000","last_fullsized":"2023-10-01T07:51:57.336811+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.337601+0000","last_change":"2023-10-01T07:51:57.323470+0000","last_active":"2023-10-01T07:51:57.337601+0000","last_peered":"2023-10-01T07:51:57.337601+0000","last_clean":"2023-10-01T07:51:57.337601+0000","last_became_active":"2023-10-01T07:51:57.323181+0000","last_became_peered":"2023-10-01T07:51:57.323181+0000","last_unstale":"2023-10-01T07:51:57.337601+0000","last_undegraded":"2023-10-01T07:51:57.337601+0000","last_fullsized":"2023-10-01T07:51:57.337601+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.321447+0000","last_change":"2023-10-01T07:51:56.911245+0000","last_active":"2023-10-01T07:51:57.321447+0000","last_peered":"2023-10-01T07:51:57.321447+0000","last_clean":"2023-10-01T07:51:57.321447+0000","last_became_active":"2023-10-01T07:51:56.910930+0000","last_became_peered":"2023-10-01T07:51:56.910930+0000","last_unstale":"2023-10-01T07:51:57.321447+0000","last_undegraded":"2023-10-01T07:51:57.321447+0000","last_fullsized":"2023-10-01T07:51:57.321447+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.310075+0000","last_change":"2023-10-01T07:51:56.919246+0000","last_active":"2023-10-01T07:51:57.310075+0000","last_peered":"2023-10-01T07:51:57.310075+0000","last_clean":"2023-10-01T07:51:57.310075+0000","last_became_active":"2023-10-01T07:51:56.918962+0000","last_became_peered":"2023-10-01T07:51:56.918962+0000","last_unstale":"2023-10-01T07:51:57.310075+0000","last_undegraded":"2023-10-01T07:51:57.310075+0000","last_fullsized":"2023-10-01T07:51:57.310075+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.338500+0000","last_change":"2023-10-01T07:51:57.335143+0000","last_active":"2023-10-01T07:51:57.338500+0000","last_peered":"2023-10-01T07:51:57.338500+0000","last_clean":"2023-10-01T07:51:57.338500+0000","last_became_active":"2023-10-01T07:51:57.334730+0000","last_became_peered":"2023-10-01T07:51:57.334730+0000","last_unstale":"2023-10-01T07:51:57.338500+0000","last_undegraded":"2023-10-01T07:51:57.338500+0000","last_fullsized":"2023-10-01T07:51:57.338500+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:55.881867+0000","last_change":"2023-10-01T07:51:55.881867+0000","last_active":"2023-10-01T07:51:55.881867+0000","last_peered":"2023-10-01T07:51:55.881867+0000","last_clean":"2023-10-01T07:51:55.881867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:55.881867+0000","last_undegraded":"2023-10-01T07:51:55.881867+0000","last_fullsized":"2023-10-01T07:51:55.881867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.305995+0000","last_change":"2023-10-01T07:51:56.916086+0000","last_active":"2023-10-01T07:51:57.305995+0000","last_peered":"2023-10-01T07:51:57.305995+0000","last_clean":"2023-10-01T07:51:57.305995+0000","last_became_active":"2023-10-01T07:51:56.912164+0000","last_became_peered":"2023-10-01T07:51:56.912164+0000","last_unstale":"2023-10-01T07:51:57.305995+0000","last_undegraded":"2023-10-01T07:51:57.305995+0000","last_fullsized":"2023-10-01T07:51:57.305995+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-01T07:51:56.922083+0000","last_change":"2023-10-01T07:51:56.917428+0000","last_active":"2023-10-01T07:51:56.922083+0000","last_peered":"2023-10-01T07:51:56.922083+0000","last_clean":"2023-10-01T07:51:56.922083+0000","last_became_active":"2023-10-01T07:51:56.916781+0000","last_became_peered":"2023-10-01T07:51:56.916781+0000","last_unstale":"2023-10-01T07:51:56.922083+0000","last_undegraded":"2023-10-01T07:51:56.922083+0000","last_fullsized":"2023-10-01T07:51:56.922083+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345213+0000","last_change":"2023-10-01T07:51:56.914774+0000","last_active":"2023-10-01T07:51:57.345213+0000","last_peered":"2023-10-01T07:51:57.345213+0000","last_clean":"2023-10-01T07:51:57.345213+0000","last_became_active":"2023-10-01T07:51:56.912021+0000","last_became_peered":"2023-10-01T07:51:56.912021+0000","last_unstale":"2023-10-01T07:51:57.345213+0000","last_undegraded":"2023-10-01T07:51:57.345213+0000","last_fullsized":"2023-10-01T07:51:57.345213+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.333273+0000","last_change":"2023-10-01T07:51:57.331183+0000","last_active":"2023-10-01T07:51:57.333273+0000","last_peered":"2023-10-01T07:51:57.333273+0000","last_clean":"2023-10-01T07:51:57.333273+0000","last_became_active":"2023-10-01T07:51:57.330934+0000","last_became_peered":"2023-10-01T07:51:57.330934+0000","last_unstale":"2023-10-01T07:51:57.333273+0000","last_undegraded":"2023-10-01T07:51:57.333273+0000","last_fullsized":"2023-10-01T07:51:57.333273+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:55.881867+0000","last_change":"2023-10-01T07:51:55.881867+0000","last_active":"2023-10-01T07:51:55.881867+0000","last_peered":"2023-10-01T07:51:55.881867+0000","last_clean":"2023-10-01T07:51:55.881867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:55.881867+0000","last_undegraded":"2023-10-01T07:51:55.881867+0000","last_fullsized":"2023-10-01T07:51:55.881867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.341789+0000","last_change":"2023-10-01T07:51:57.341789+0000","last_active":"2023-10-01T07:51:57.341789+0000","last_peered":"2023-10-01T07:51:57.341789+0000","last_clean":"2023-10-01T07:51:57.341789+0000","last_became_active":"2023-10-01T07:51:57.340852+0000","last_became_peered":"2023-10-01T07:51:57.340852+0000","last_unstale":"2023-10-01T07:51:57.341789+0000","last_undegraded":"2023-10-01T07:51:57.341789+0000","last_fullsized":"2023-10-01T07:51:57.341789+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:55.881867+0000","last_change":"2023-10-01T07:51:55.881867+0000","last_active":"2023-10-01T07:51:55.881867+0000","last_peered":"2023-10-01T07:51:55.881867+0000","last_clean":"2023-10-01T07:51:55.881867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:55.881867+0000","last_undegraded":"2023-10-01T07:51:55.881867+0000","last_fullsized":"2023-10-01T07:51:55.881867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.301106+0000","last_change":"2023-10-01T07:51:56.915181+0000","last_active":"2023-10-01T07:51:57.301106+0000","last_peered":"2023-10-01T07:51:57.301106+0000","last_clean":"2023-10-01T07:51:57.301106+0000","last_became_active":"2023-10-01T07:51:56.914858+0000","last_became_peered":"2023-10-01T07:51:56.914858+0000","last_unstale":"2023-10-01T07:51:57.301106+0000","last_undegraded":"2023-10-01T07:51:57.301106+0000","last_fullsized":"2023-10-01T07:51:57.301106+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:55.881867+0000","last_change":"2023-10-01T07:51:55.881867+0000","last_active":"2023-10-01T07:51:55.881867+0000","last_peered":"2023-10-01T07:51:55.881867+0000","last_clean":"2023-10-01T07:51:55.881867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:55.881867+0000","last_undegraded":"2023-10-01T07:51:55.881867+0000","last_fullsized":"2023-10-01T07:51:55.881867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335190+0000","last_change":"2023-10-01T07:51:57.325464+0000","last_active":"2023-10-01T07:51:57.335190+0000","last_peered":"2023-10-01T07:51:57.335190+0000","last_clean":"2023-10-01T07:51:57.335190+0000","last_became_active":"2023-10-01T07:51:57.325143+0000","last_became_peered":"2023-10-01T07:51:57.325143+0000","last_unstale":"2023-10-01T07:51:57.335190+0000","last_undegraded":"2023-10-01T07:51:57.335190+0000","last_fullsized":"2023-10-01T07:51:57.335190+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.346026+0000","last_change":"2023-10-01T07:51:56.922808+0000","last_active":"2023-10-01T07:51:57.346026+0000","last_peered":"2023-10-01T07:51:57.346026+0000","last_clean":"2023-10-01T07:51:57.346026+0000","last_became_active":"2023-10-01T07:51:56.922520+0000","last_became_peered":"2023-10-01T07:51:56.922520+0000","last_unstale":"2023-10-01T07:51:57.346026+0000","last_undegraded":"2023-10-01T07:51:57.346026+0000","last_fullsized":"2023-10-01T07:51:57.346026+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.334758+0000","last_change":"2023-10-01T07:51:56.922474+0000","last_active":"2023-10-01T07:51:57.334758+0000","last_peered":"2023-10-01T07:51:57.334758+0000","last_clean":"2023-10-01T07:51:57.334758+0000","last_became_active":"2023-10-01T07:51:56.921742+0000","last_became_peered":"2023-10-01T07:51:56.921742+0000","last_unstale":"2023-10-01T07:51:57.334758+0000","last_undegraded":"2023-10-01T07:51:57.334758+0000","last_fullsized":"2023-10-01T07:51:57.334758+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.323262+0000","last_change":"2023-10-01T07:51:56.917629+0000","last_active":"2023-10-01T07:51:57.323262+0000","last_peered":"2023-10-01T07:51:57.323262+0000","last_clean":"2023-10-01T07:51:57.323262+0000","last_became_active":"2023-10-01T07:51:56.917154+0000","last_became_peered":"2023-10-01T07:51:56.917154+0000","last_unstale":"2023-10-01T07:51:57.323262+0000","last_undegraded":"2023-10-01T07:51:57.323262+0000","last_fullsized":"2023-10-01T07:51:57.323262+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348565+0000","last_change":"2023-10-01T07:51:57.340793+0000","last_active":"2023-10-01T07:51:57.348565+0000","last_peered":"2023-10-01T07:51:57.348565+0000","last_clean":"2023-10-01T07:51:57.348565+0000","last_became_active":"2023-10-01T07:51:57.340504+0000","last_became_peered":"2023-10-01T07:51:57.340504+0000","last_unstale":"2023-10-01T07:51:57.348565+0000","last_undegraded":"2023-10-01T07:51:57.348565+0000","last_fullsized":"2023-10-01T07:51:57.348565+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:55.881867+0000","last_change":"2023-10-01T07:51:55.881867+0000","last_active":"2023-10-01T07:51:55.881867+0000","last_peered":"2023-10-01T07:51:55.881867+0000","last_clean":"2023-10-01T07:51:55.881867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:55.881867+0000","last_undegraded":"2023-10-01T07:51:55.881867+0000","last_fullsized":"2023-10-01T07:51:55.881867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.340445+0000","last_change":"2023-10-01T07:51:57.340445+0000","last_active":"2023-10-01T07:51:57.340445+0000","last_peered":"2023-10-01T07:51:57.340445+0000","last_clean":"2023-10-01T07:51:57.340445+0000","last_became_active":"2023-10-01T07:51:57.340180+0000","last_became_peered":"2023-10-01T07:51:57.340180+0000","last_unstale":"2023-10-01T07:51:57.340445+0000","last_undegraded":"2023-10-01T07:51:57.340445+0000","last_fullsized":"2023-10-01T07:51:57.340445+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.303411+0000","last_change":"2023-10-01T07:51:56.915532+0000","last_active":"2023-10-01T07:51:57.303411+0000","last_peered":"2023-10-01T07:51:57.303411+0000","last_clean":"2023-10-01T07:51:57.303411+0000","last_became_active":"2023-10-01T07:51:56.912225+0000","last_became_peered":"2023-10-01T07:51:56.912225+0000","last_unstale":"2023-10-01T07:51:57.303411+0000","last_undegraded":"2023-10-01T07:51:57.303411+0000","last_fullsized":"2023-10-01T07:51:57.303411+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.338026+0000","last_change":"2023-10-01T07:51:57.331858+0000","last_active":"2023-10-01T07:51:57.338026+0000","last_peered":"2023-10-01T07:51:57.338026+0000","last_clean":"2023-10-01T07:51:57.338026+0000","last_became_active":"2023-10-01T07:51:57.331568+0000","last_became_peered":"2023-10-01T07:51:57.331568+0000","last_unstale":"2023-10-01T07:51:57.338026+0000","last_undegraded":"2023-10-01T07:51:57.338026+0000","last_fullsized":"2023-10-01T07:51:57.338026+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:55.881867+0000","last_change":"2023-10-01T07:51:55.881867+0000","last_active":"2023-10-01T07:51:55.881867+0000","last_peered":"2023-10-01T07:51:55.881867+0000","last_clean":"2023-10-01T07:51:55.881867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:55.881867+0000","last_undegraded":"2023-10-01T07:51:55.881867+0000","last_fullsized":"2023-10-01T07:51:55.881867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335325+0000","last_change":"2023-10-01T07:51:57.326926+0000","last_active":"2023-10-01T07:51:57.335325+0000","last_peered":"2023-10-01T07:51:57.335325+0000","last_clean":"2023-10-01T07:51:57.335325+0000","last_became_active":"2023-10-01T07:51:57.326597+0000","last_became_peered":"2023-10-01T07:51:57.326597+0000","last_unstale":"2023-10-01T07:51:57.335325+0000","last_undegraded":"2023-10-01T07:51:57.335325+0000","last_fullsized":"2023-10-01T07:51:57.335325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:55.881867+0000","last_change":"2023-10-01T07:51:55.881867+0000","last_active":"2023-10-01T07:51:55.881867+0000","last_peered":"2023-10-01T07:51:55.881867+0000","last_clean":"2023-10-01T07:51:55.881867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:55.881867+0000","last_undegraded":"2023-10-01T07:51:55.881867+0000","last_fullsized":"2023-10-01T07:51:55.881867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:55.881867+0000","last_change":"2023-10-01T07:51:55.881867+0000","last_active":"2023-10-01T07:51:55.881867+0000","last_peered":"2023-10-01T07:51:55.881867+0000","last_clean":"2023-10-01T07:51:55.881867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:55.881867+0000","last_undegraded":"2023-10-01T07:51:55.881867+0000","last_fullsized":"2023-10-01T07:51:55.881867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.340249+0000","last_change":"2023-10-01T07:51:57.340249+0000","last_active":"2023-10-01T07:51:57.340249+0000","last_peered":"2023-10-01T07:51:57.340249+0000","last_clean":"2023-10-01T07:51:57.340249+0000","last_became_active":"2023-10-01T07:51:57.339937+0000","last_became_peered":"2023-10-01T07:51:57.339937+0000","last_unstale":"2023-10-01T07:51:57.340249+0000","last_undegraded":"2023-10-01T07:51:57.340249+0000","last_fullsized":"2023-10-01T07:51:57.340249+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:55.881867+0000","last_change":"2023-10-01T07:51:55.881867+0000","last_active":"2023-10-01T07:51:55.881867+0000","last_peered":"2023-10-01T07:51:55.881867+0000","last_clean":"2023-10-01T07:51:55.881867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:55.881867+0000","last_undegraded":"2023-10-01T07:51:55.881867+0000","last_fullsized":"2023-10-01T07:51:55.881867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348828+0000","last_change":"2023-10-01T07:51:57.347574+0000","last_active":"2023-10-01T07:51:57.348828+0000","last_peered":"2023-10-01T07:51:57.348828+0000","last_clean":"2023-10-01T07:51:57.348828+0000","last_became_active":"2023-10-01T07:51:57.347243+0000","last_became_peered":"2023-10-01T07:51:57.347243+0000","last_unstale":"2023-10-01T07:51:57.348828+0000","last_undegraded":"2023-10-01T07:51:57.348828+0000","last_fullsized":"2023-10-01T07:51:57.348828+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.310517+0000","last_change":"2023-10-01T07:51:51.883413+0000","last_active":"2023-10-01T07:51:57.310517+0000","last_peered":"2023-10-01T07:51:57.310517+0000","last_clean":"2023-10-01T07:51:57.310517+0000","last_became_active":"2023-10-01T07:51:51.883088+0000","last_became_peered":"2023-10-01T07:51:51.883088+0000","last_unstale":"2023-10-01T07:51:57.310517+0000","last_undegraded":"2023-10-01T07:51:57.310517+0000","last_fullsized":"2023-10-01T07:51:57.310517+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-01T07:51:56.922804+0000","last_change":"2023-10-01T07:51:56.914139+0000","last_active":"2023-10-01T07:51:56.922804+0000","last_peered":"2023-10-01T07:51:56.922804+0000","last_clean":"2023-10-01T07:51:56.922804+0000","last_became_active":"2023-10-01T07:51:56.913026+0000","last_became_peered":"2023-10-01T07:51:56.913026+0000","last_unstale":"2023-10-01T07:51:56.922804+0000","last_undegraded":"2023-10-01T07:51:56.922804+0000","last_fullsized":"2023-10-01T07:51:56.922804+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.336585+0000","last_change":"2023-10-01T07:51:57.334103+0000","last_active":"2023-10-01T07:51:57.336585+0000","last_peered":"2023-10-01T07:51:57.336585+0000","last_clean":"2023-10-01T07:51:57.336585+0000","last_became_active":"2023-10-01T07:51:57.333743+0000","last_became_peered":"2023-10-01T07:51:57.333743+0000","last_unstale":"2023-10-01T07:51:57.336585+0000","last_undegraded":"2023-10-01T07:51:57.336585+0000","last_fullsized":"2023-10-01T07:51:57.336585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-01T07:51:51.885667+0000","last_change":"2023-10-01T07:51:51.882685+0000","last_active":"2023-10-01T07:51:51.885667+0000","last_peered":"2023-10-01T07:51:51.885667+0000","last_clean":"2023-10-01T07:51:51.885667+0000","last_became_active":"2023-10-01T07:51:51.882396+0000","last_became_peered":"2023-10-01T07:51:51.882396+0000","last_unstale":"2023-10-01T07:51:51.885667+0000","last_undegraded":"2023-10-01T07:51:51.885667+0000","last_fullsized":"2023-10-01T07:51:51.885667+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.300924+0000","last_change":"2023-10-01T07:51:56.915631+0000","last_active":"2023-10-01T07:51:57.300924+0000","last_peered":"2023-10-01T07:51:57.300924+0000","last_clean":"2023-10-01T07:51:57.300924+0000","last_became_active":"2023-10-01T07:51:56.911566+0000","last_became_peered":"2023-10-01T07:51:56.911566+0000","last_unstale":"2023-10-01T07:51:57.300924+0000","last_undegraded":"2023-10-01T07:51:57.300924+0000","last_fullsized":"2023-10-01T07:51:57.300924+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.329388+0000","last_change":"2023-10-01T07:51:57.319612+0000","last_active":"2023-10-01T07:51:57.329388+0000","last_peered":"2023-10-01T07:51:57.329388+0000","last_clean":"2023-10-01T07:51:57.329388+0000","last_became_active":"2023-10-01T07:51:57.319125+0000","last_became_peered":"2023-10-01T07:51:57.319125+0000","last_unstale":"2023-10-01T07:51:57.329388+0000","last_undegraded":"2023-10-01T07:51:57.329388+0000","last_fullsized":"2023-10-01T07:51:57.329388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-01T07:51:56.906124+0000","last_change":"2023-10-01T07:51:51.885336+0000","last_active":"2023-10-01T07:51:56.906124+0000","last_peered":"2023-10-01T07:51:56.906124+0000","last_clean":"2023-10-01T07:51:56.906124+0000","last_became_active":"2023-10-01T07:51:51.884991+0000","last_became_peered":"2023-10-01T07:51:51.884991+0000","last_unstale":"2023-10-01T07:51:56.906124+0000","last_undegraded":"2023-10-01T07:51:56.906124+0000","last_fullsized":"2023-10-01T07:51:56.906124+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.311818+0000","last_change":"2023-10-01T07:51:56.929636+0000","last_active":"2023-10-01T07:51:57.311818+0000","last_peered":"2023-10-01T07:51:57.311818+0000","last_clean":"2023-10-01T07:51:57.311818+0000","last_became_active":"2023-10-01T07:51:56.929308+0000","last_became_peered":"2023-10-01T07:51:56.929308+0000","last_unstale":"2023-10-01T07:51:57.311818+0000","last_undegraded":"2023-10-01T07:51:57.311818+0000","last_fullsized":"2023-10-01T07:51:57.311818+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.333038+0000","last_change":"2023-10-01T07:51:57.329162+0000","last_active":"2023-10-01T07:51:57.333038+0000","last_peered":"2023-10-01T07:51:57.333038+0000","last_clean":"2023-10-01T07:51:57.333038+0000","last_became_active":"2023-10-01T07:51:57.328749+0000","last_became_peered":"2023-10-01T07:51:57.328749+0000","last_unstale":"2023-10-01T07:51:57.333038+0000","last_undegraded":"2023-10-01T07:51:57.333038+0000","last_fullsized":"2023-10-01T07:51:57.333038+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-01T07:51:51.885622+0000","last_change":"2023-10-01T07:51:51.882657+0000","last_active":"2023-10-01T07:51:51.885622+0000","last_peered":"2023-10-01T07:51:51.885622+0000","last_clean":"2023-10-01T07:51:51.885622+0000","last_became_active":"2023-10-01T07:51:51.882334+0000","last_became_peered":"2023-10-01T07:51:51.882334+0000","last_unstale":"2023-10-01T07:51:51.885622+0000","last_undegraded":"2023-10-01T07:51:51.885622+0000","last_fullsized":"2023-10-01T07:51:51.885622+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.311710+0000","last_change":"2023-10-01T07:51:50.871456+0000","last_active":"2023-10-01T07:51:57.311710+0000","last_peered":"2023-10-01T07:51:57.311710+0000","last_clean":"2023-10-01T07:51:57.311710+0000","last_became_active":"2023-10-01T07:51:50.871112+0000","last_became_peered":"2023-10-01T07:51:50.871112+0000","last_unstale":"2023-10-01T07:51:57.311710+0000","last_undegraded":"2023-10-01T07:51:57.311710+0000","last_fullsized":"2023-10-01T07:51:57.311710+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:49.856372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:49.856372+0000","last_clean_scrub_stamp":"2023-10-01T07:51:49.856372+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:55.881867+0000","last_change":"2023-10-01T07:51:55.881867+0000","last_active":"2023-10-01T07:51:55.881867+0000","last_peered":"2023-10-01T07:51:55.881867+0000","last_clean":"2023-10-01T07:51:55.881867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:55.881867+0000","last_undegraded":"2023-10-01T07:51:55.881867+0000","last_fullsized":"2023-10-01T07:51:55.881867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-01T07:51:51.885687+0000","last_change":"2023-10-01T07:51:51.882831+0000","last_active":"2023-10-01T07:51:51.885687+0000","last_peered":"2023-10-01T07:51:51.885687+0000","last_clean":"2023-10-01T07:51:51.885687+0000","last_became_active":"2023-10-01T07:51:51.882490+0000","last_became_peered":"2023-10-01T07:51:51.882490+0000","last_unstale":"2023-10-01T07:51:51.885687+0000","last_undegraded":"2023-10-01T07:51:51.885687+0000","last_fullsized":"2023-10-01T07:51:51.885687+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.300429+0000","last_change":"2023-10-01T07:51:56.929720+0000","last_active":"2023-10-01T07:51:57.300429+0000","last_peered":"2023-10-01T07:51:57.300429+0000","last_clean":"2023-10-01T07:51:57.300429+0000","last_became_active":"2023-10-01T07:51:56.929370+0000","last_became_peered":"2023-10-01T07:51:56.929370+0000","last_unstale":"2023-10-01T07:51:57.300429+0000","last_undegraded":"2023-10-01T07:51:57.300429+0000","last_fullsized":"2023-10-01T07:51:57.300429+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.338477+0000","last_change":"2023-10-01T07:51:57.335095+0000","last_active":"2023-10-01T07:51:57.338477+0000","last_peered":"2023-10-01T07:51:57.338477+0000","last_clean":"2023-10-01T07:51:57.338477+0000","last_became_active":"2023-10-01T07:51:57.334324+0000","last_became_peered":"2023-10-01T07:51:57.334324+0000","last_unstale":"2023-10-01T07:51:57.338477+0000","last_undegraded":"2023-10-01T07:51:57.338477+0000","last_fullsized":"2023-10-01T07:51:57.338477+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-01T07:51:51.886159+0000","last_change":"2023-10-01T07:51:51.884196+0000","last_active":"2023-10-01T07:51:51.886159+0000","last_peered":"2023-10-01T07:51:51.886159+0000","last_clean":"2023-10-01T07:51:51.886159+0000","last_became_active":"2023-10-01T07:51:51.883784+0000","last_became_peered":"2023-10-01T07:51:51.883784+0000","last_unstale":"2023-10-01T07:51:51.886159+0000","last_undegraded":"2023-10-01T07:51:51.886159+0000","last_fullsized":"2023-10-01T07:51:51.886159+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.310257+0000","last_change":"2023-10-01T07:51:56.913348+0000","last_active":"2023-10-01T07:51:57.310257+0000","last_peered":"2023-10-01T07:51:57.310257+0000","last_clean":"2023-10-01T07:51:57.310257+0000","last_became_active":"2023-10-01T07:51:56.913041+0000","last_became_peered":"2023-10-01T07:51:56.913041+0000","last_unstale":"2023-10-01T07:51:57.310257+0000","last_undegraded":"2023-10-01T07:51:57.310257+0000","last_fullsized":"2023-10-01T07:51:57.310257+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.320737+0000","last_change":"2023-10-01T07:51:57.313930+0000","last_active":"2023-10-01T07:51:57.320737+0000","last_peered":"2023-10-01T07:51:57.320737+0000","last_clean":"2023-10-01T07:51:57.320737+0000","last_became_active":"2023-10-01T07:51:57.313613+0000","last_became_peered":"2023-10-01T07:51:57.313613+0000","last_unstale":"2023-10-01T07:51:57.320737+0000","last_undegraded":"2023-10-01T07:51:57.320737+0000","last_fullsized":"2023-10-01T07:51:57.320737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:55.881867+0000","last_change":"2023-10-01T07:51:55.881867+0000","last_active":"2023-10-01T07:51:55.881867+0000","last_peered":"2023-10-01T07:51:55.881867+0000","last_clean":"2023-10-01T07:51:55.881867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:55.881867+0000","last_undegraded":"2023-10-01T07:51:55.881867+0000","last_fullsized":"2023-10-01T07:51:55.881867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.312442+0000","last_change":"2023-10-01T07:51:51.883317+0000","last_active":"2023-10-01T07:51:57.312442+0000","last_peered":"2023-10-01T07:51:57.312442+0000","last_clean":"2023-10-01T07:51:57.312442+0000","last_became_active":"2023-10-01T07:51:51.883005+0000","last_became_peered":"2023-10-01T07:51:51.883005+0000","last_unstale":"2023-10-01T07:51:57.312442+0000","last_undegraded":"2023-10-01T07:51:57.312442+0000","last_fullsized":"2023-10-01T07:51:57.312442+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-01T07:51:51.886113+0000","last_change":"2023-10-01T07:51:51.883299+0000","last_active":"2023-10-01T07:51:51.886113+0000","last_peered":"2023-10-01T07:51:51.886113+0000","last_clean":"2023-10-01T07:51:51.886113+0000","last_became_active":"2023-10-01T07:51:51.883001+0000","last_became_peered":"2023-10-01T07:51:51.883001+0000","last_unstale":"2023-10-01T07:51:51.886113+0000","last_undegraded":"2023-10-01T07:51:51.886113+0000","last_fullsized":"2023-10-01T07:51:51.886113+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.303139+0000","last_change":"2023-10-01T07:51:56.921291+0000","last_active":"2023-10-01T07:51:57.303139+0000","last_peered":"2023-10-01T07:51:57.303139+0000","last_clean":"2023-10-01T07:51:57.303139+0000","last_became_active":"2023-10-01T07:51:56.920989+0000","last_became_peered":"2023-10-01T07:51:56.920989+0000","last_unstale":"2023-10-01T07:51:57.303139+0000","last_undegraded":"2023-10-01T07:51:57.303139+0000","last_fullsized":"2023-10-01T07:51:57.303139+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.342916+0000","last_change":"2023-10-01T07:51:57.342916+0000","last_active":"2023-10-01T07:51:57.342916+0000","last_peered":"2023-10-01T07:51:57.342916+0000","last_clean":"2023-10-01T07:51:57.342916+0000","last_became_active":"2023-10-01T07:51:57.342653+0000","last_became_peered":"2023-10-01T07:51:57.342653+0000","last_unstale":"2023-10-01T07:51:57.342916+0000","last_undegraded":"2023-10-01T07:51:57.342916+0000","last_fullsized":"2023-10-01T07:51:57.342916+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.325920+0000","last_change":"2023-10-01T07:51:56.916437+0000","last_active":"2023-10-01T07:51:57.325920+0000","last_peered":"2023-10-01T07:51:57.325920+0000","last_clean":"2023-10-01T07:51:57.325920+0000","last_became_active":"2023-10-01T07:51:56.915935+0000","last_became_peered":"2023-10-01T07:51:56.915935+0000","last_unstale":"2023-10-01T07:51:57.325920+0000","last_undegraded":"2023-10-01T07:51:57.325920+0000","last_fullsized":"2023-10-01T07:51:57.325920+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.330536+0000","last_change":"2023-10-01T07:51:57.330536+0000","last_active":"2023-10-01T07:51:57.330536+0000","last_peered":"2023-10-01T07:51:57.330536+0000","last_clean":"2023-10-01T07:51:57.330536+0000","last_became_active":"2023-10-01T07:51:57.330151+0000","last_became_peered":"2023-10-01T07:51:57.330151+0000","last_unstale":"2023-10-01T07:51:57.330536+0000","last_undegraded":"2023-10-01T07:51:57.330536+0000","last_fullsized":"2023-10-01T07:51:57.330536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.322423+0000","last_change":"2023-10-01T07:51:56.922316+0000","last_active":"2023-10-01T07:51:57.322423+0000","last_peered":"2023-10-01T07:51:57.322423+0000","last_clean":"2023-10-01T07:51:57.322423+0000","last_became_active":"2023-10-01T07:51:56.922003+0000","last_became_peered":"2023-10-01T07:51:56.922003+0000","last_unstale":"2023-10-01T07:51:57.322423+0000","last_undegraded":"2023-10-01T07:51:57.322423+0000","last_fullsized":"2023-10-01T07:51:57.322423+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.341976+0000","last_change":"2023-10-01T07:51:57.341976+0000","last_active":"2023-10-01T07:51:57.341976+0000","last_peered":"2023-10-01T07:51:57.341976+0000","last_clean":"2023-10-01T07:51:57.341976+0000","last_became_active":"2023-10-01T07:51:57.341188+0000","last_became_peered":"2023-10-01T07:51:57.341188+0000","last_unstale":"2023-10-01T07:51:57.341976+0000","last_undegraded":"2023-10-01T07:51:57.341976+0000","last_fullsized":"2023-10-01T07:51:57.341976+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:55.881867+0000","last_change":"2023-10-01T07:51:55.881867+0000","last_active":"2023-10-01T07:51:55.881867+0000","last_peered":"2023-10-01T07:51:55.881867+0000","last_clean":"2023-10-01T07:51:55.881867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:55.881867+0000","last_undegraded":"2023-10-01T07:51:55.881867+0000","last_fullsized":"2023-10-01T07:51:55.881867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.340653+0000","last_change":"2023-10-01T07:51:57.340653+0000","last_active":"2023-10-01T07:51:57.340653+0000","last_peered":"2023-10-01T07:51:57.340653+0000","last_clean":"2023-10-01T07:51:57.340653+0000","last_became_active":"2023-10-01T07:51:57.340395+0000","last_became_peered":"2023-10-01T07:51:57.340395+0000","last_unstale":"2023-10-01T07:51:57.340653+0000","last_undegraded":"2023-10-01T07:51:57.340653+0000","last_fullsized":"2023-10-01T07:51:57.340653+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:55.881867+0000","last_change":"2023-10-01T07:51:55.881867+0000","last_active":"2023-10-01T07:51:55.881867+0000","last_peered":"2023-10-01T07:51:55.881867+0000","last_clean":"2023-10-01T07:51:55.881867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:55.881867+0000","last_undegraded":"2023-10-01T07:51:55.881867+0000","last_fullsized":"2023-10-01T07:51:55.881867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335116+0000","last_change":"2023-10-01T07:51:56.922677+0000","last_active":"2023-10-01T07:51:57.335116+0000","last_peered":"2023-10-01T07:51:57.335116+0000","last_clean":"2023-10-01T07:51:57.335116+0000","last_became_active":"2023-10-01T07:51:56.922121+0000","last_became_peered":"2023-10-01T07:51:56.922121+0000","last_unstale":"2023-10-01T07:51:57.335116+0000","last_undegraded":"2023-10-01T07:51:57.335116+0000","last_fullsized":"2023-10-01T07:51:57.335116+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.329519+0000","last_change":"2023-10-01T07:51:57.329519+0000","last_active":"2023-10-01T07:51:57.329519+0000","last_peered":"2023-10-01T07:51:57.329519+0000","last_clean":"2023-10-01T07:51:57.329519+0000","last_became_active":"2023-10-01T07:51:57.329191+0000","last_became_peered":"2023-10-01T07:51:57.329191+0000","last_unstale":"2023-10-01T07:51:57.329519+0000","last_undegraded":"2023-10-01T07:51:57.329519+0000","last_fullsized":"2023-10-01T07:51:57.329519+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335155+0000","last_change":"2023-10-01T07:51:57.320100+0000","last_active":"2023-10-01T07:51:57.335155+0000","last_peered":"2023-10-01T07:51:57.335155+0000","last_clean":"2023-10-01T07:51:57.335155+0000","last_became_active":"2023-10-01T07:51:57.319593+0000","last_became_peered":"2023-10-01T07:51:57.319593+0000","last_unstale":"2023-10-01T07:51:57.335155+0000","last_undegraded":"2023-10-01T07:51:57.335155+0000","last_fullsized":"2023-10-01T07:51:57.335155+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.334378+0000","last_change":"2023-10-01T07:51:57.326270+0000","last_active":"2023-10-01T07:51:57.334378+0000","last_peered":"2023-10-01T07:51:57.334378+0000","last_clean":"2023-10-01T07:51:57.334378+0000","last_became_active":"2023-10-01T07:51:57.325956+0000","last_became_peered":"2023-10-01T07:51:57.325956+0000","last_unstale":"2023-10-01T07:51:57.334378+0000","last_undegraded":"2023-10-01T07:51:57.334378+0000","last_fullsized":"2023-10-01T07:51:57.334378+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.329368+0000","last_change":"2023-10-01T07:51:57.319429+0000","last_active":"2023-10-01T07:51:57.329368+0000","last_peered":"2023-10-01T07:51:57.329368+0000","last_clean":"2023-10-01T07:51:57.329368+0000","last_became_active":"2023-10-01T07:51:57.318849+0000","last_became_peered":"2023-10-01T07:51:57.318849+0000","last_unstale":"2023-10-01T07:51:57.329368+0000","last_undegraded":"2023-10-01T07:51:57.329368+0000","last_fullsized":"2023-10-01T07:51:57.329368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":90,"acting":90,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":666,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":38,"acting":38,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297244,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074596,"statfs":{"total":96636764160,"available":96332386304,"internally_reserved":0,"allocated":151552,"data_stored":44462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297248,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074592,"statfs":{"total":96636764160,"available":96332382208,"internally_reserved":0,"allocated":155648,"data_stored":43626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297244,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074596,"statfs":{"total":96636764160,"available":96332386304,"internally_reserved":0,"allocated":151552,"data_stored":43572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-01T07:52:01.383 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-01T07:52:01.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.546+0000 7f23cd9d5700 1 Processor -- start 2023-10-01T07:52:01.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.547+0000 7f23cd9d5700 1 -- start start 2023-10-01T07:52:01.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.547+0000 7f23cd9d5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f23c80650f0 0x7f23c80986a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:01.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.547+0000 7f23cd9d5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f23c80992a0 0x7f23c8132480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:01.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.547+0000 7f23cd9d5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c8096160 con 0x7f23c8097c30 2023-10-01T07:52:01.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.547+0000 7f23cd9d5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c80654d0 con 0x7f23c80650f0 2023-10-01T07:52:01.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.547+0000 7f23cd9d5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c8065dd0 con 0x7f23c80992a0 2023-10-01T07:52:01.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.547+0000 7f23c77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f23c80992a0 0x7f23c8132480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:01.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.547+0000 7f23c6ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f23c80650f0 0x7f23c80986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:01.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.547+0000 7f23c77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f23c80992a0 0x7f23c8132480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44000/0 (socket says 172.21.15.26:44000) 2023-10-01T07:52:01.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.547+0000 7f23c77fe700 1 -- 172.21.15.26:0/2505236511 learned_addr learned my addr 172.21.15.26:0/2505236511 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:01.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.547+0000 7f23c6ffd700 1 --2- 172.21.15.26:0/2505236511 >> v2:172.21.15.26:3300/0 conn(0x7f23c80650f0 0x7f23c80986a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37984/0 (socket says 172.21.15.26:37984) 2023-10-01T07:52:01.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.548+0000 7f23c6ffd700 1 -- 172.21.15.26:0/2505236511 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f23c80992a0 msgr2=0x7f23c8132480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:01.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.548+0000 7f23c6ffd700 1 --2- 172.21.15.26:0/2505236511 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f23c80992a0 0x7f23c8132480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:01.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.548+0000 7f23c6ffd700 1 -- 172.21.15.26:0/2505236511 >> v1:172.21.15.26:6789/0 conn(0x7f23c8097c30 legacy=0x7f23c8098b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:01.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.548+0000 7f23c6ffd700 1 -- 172.21.15.26:0/2505236511 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c8099790 con 0x7f23c80650f0 2023-10-01T07:52:01.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.548+0000 7f23c5ffb700 1 -- 172.21.15.26:0/2505236511 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3538262539 0 0) 0x7f23c8096160 con 0x7f23c8097c30 2023-10-01T07:52:01.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.548+0000 7f23c77fe700 1 --2- 172.21.15.26:0/2505236511 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f23c80992a0 0x7f23c8132480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:01.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.548+0000 7f23c6ffd700 1 --2- 172.21.15.26:0/2505236511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23c80650f0 0x7f23c80986a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f23b8009760 tx=0x7f23b8009060).ready entity=mon.0 client_cookie=fddfe6a375c22c4f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:01.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.548+0000 7f23c5ffb700 1 -- 172.21.15.26:0/2505236511 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b800f510 con 0x7f23c80650f0 2023-10-01T07:52:01.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.548+0000 7f23c5ffb700 1 -- 172.21.15.26:0/2505236511 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b800f670 con 0x7f23c80650f0 2023-10-01T07:52:01.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.548+0000 7f23c5ffb700 1 -- 172.21.15.26:0/2505236511 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b800f9f0 con 0x7f23c80650f0 2023-10-01T07:52:01.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.548+0000 7f23cd9d5700 1 -- 172.21.15.26:0/2505236511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23c80650f0 msgr2=0x7f23c80986a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:01.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.548+0000 7f23cd9d5700 1 --2- 172.21.15.26:0/2505236511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23c80650f0 0x7f23c80986a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f23b8009760 tx=0x7f23b8009060).stop 2023-10-01T07:52:01.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.549+0000 7f23cd9d5700 1 -- 172.21.15.26:0/2505236511 shutdown_connections 2023-10-01T07:52:01.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.549+0000 7f23cd9d5700 1 --2- 172.21.15.26:0/2505236511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23c80650f0 0x7f23c80986a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:01.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.549+0000 7f23cd9d5700 1 --2- 172.21.15.26:0/2505236511 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f23c80992a0 0x7f23c8132480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:01.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.549+0000 7f23cd9d5700 1 -- 172.21.15.26:0/2505236511 >> 172.21.15.26:0/2505236511 conn(0x7f23c809dc70 msgr2=0x7f23c809e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:01.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.549+0000 7f23cd9d5700 1 -- 172.21.15.26:0/2505236511 shutdown_connections 2023-10-01T07:52:01.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.549+0000 7f23cd9d5700 1 -- 172.21.15.26:0/2505236511 wait complete. 2023-10-01T07:52:01.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.550+0000 7f23cd9d5700 1 Processor -- start 2023-10-01T07:52:01.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.550+0000 7f23cd9d5700 1 -- start start 2023-10-01T07:52:01.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.551+0000 7f23cd9d5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f23c80650f0 0x7f23c81171f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:01.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.551+0000 7f23cd9d5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23c80992a0 0x7f23c81176e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:01.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.551+0000 7f23cd9d5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f23c8117bd0 0x7f23c813ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:01.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.551+0000 7f23cd9d5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c811b870 con 0x7f23c80992a0 2023-10-01T07:52:01.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.551+0000 7f23cd9d5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c8099a80 con 0x7f23c8117bd0 2023-10-01T07:52:01.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.551+0000 7f23cd9d5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23c811a9b0 con 0x7f23c80650f0 2023-10-01T07:52:01.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.551+0000 7f23c77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f23c8117bd0 0x7f23c813ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:01.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.551+0000 7f23c6ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f23c80650f0 0x7f23c81171f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:01.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.551+0000 7f23c67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23c80992a0 0x7f23c81176e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:01.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.551+0000 7f23c77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f23c8117bd0 0x7f23c813ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44016/0 (socket says 172.21.15.26:44016) 2023-10-01T07:52:01.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.551+0000 7f23c77fe700 1 -- 172.21.15.26:0/3869980152 learned_addr learned my addr 172.21.15.26:0/3869980152 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:01.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.551+0000 7f23c77fe700 1 -- 172.21.15.26:0/3869980152 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f23c80650f0 msgr2=0x7f23c81171f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:01.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.551+0000 7f23c77fe700 1 --2- 172.21.15.26:0/3869980152 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f23c80650f0 0x7f23c81171f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:01.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.551+0000 7f23c77fe700 1 -- 172.21.15.26:0/3869980152 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23c80992a0 msgr2=0x7f23c81176e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:01.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.551+0000 7f23c77fe700 1 --2- 172.21.15.26:0/3869980152 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23c80992a0 0x7f23c81176e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:01.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.551+0000 7f23c77fe700 1 -- 172.21.15.26:0/3869980152 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c0009ae0 con 0x7f23c8117bd0 2023-10-01T07:52:01.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.551+0000 7f23c67fc700 1 --2- 172.21.15.26:0/3869980152 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23c80992a0 0x7f23c81176e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:01.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.551+0000 7f23c6ffd700 1 --2- 172.21.15.26:0/3869980152 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f23c80650f0 0x7f23c81171f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:01.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.551+0000 7f23c77fe700 1 --2- 172.21.15.26:0/3869980152 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f23c8117bd0 0x7f23c813ab10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f23c000c0c0 tx=0x7f23c000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:01.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.552+0000 7f23aeffd700 1 -- 172.21.15.26:0/3869980152 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c0009d10 con 0x7f23c8117bd0 2023-10-01T07:52:01.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.552+0000 7f23aeffd700 1 -- 172.21.15.26:0/3869980152 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c000f040 con 0x7f23c8117bd0 2023-10-01T07:52:01.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.552+0000 7f23aeffd700 1 -- 172.21.15.26:0/3869980152 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c000cc20 con 0x7f23c8117bd0 2023-10-01T07:52:01.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.552+0000 7f23cd9d5700 1 -- 172.21.15.26:0/3869980152 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23b80092a0 con 0x7f23c8117bd0 2023-10-01T07:52:01.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.552+0000 7f23cd9d5700 1 -- 172.21.15.26:0/3869980152 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c8118660 con 0x7f23c8117bd0 2023-10-01T07:52:01.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.553+0000 7f23cd9d5700 1 -- 172.21.15.26:0/3869980152 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c8118050 con 0x7f23c8117bd0 2023-10-01T07:52:01.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.553+0000 7f23aeffd700 1 -- 172.21.15.26:0/3869980152 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f23c0007400 con 0x7f23c8117bd0 2023-10-01T07:52:01.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.553+0000 7f23aeffd700 1 -- 172.21.15.26:0/3869980152 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f23c003b4a0 con 0x7f23c8117bd0 2023-10-01T07:52:01.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.558+0000 7f23aeffd700 1 -- 172.21.15.26:0/3869980152 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f23c0007e60 con 0x7f23c8117bd0 2023-10-01T07:52:01.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.728+0000 7f23cd9d5700 1 -- 172.21.15.26:0/3869980152 --> v1:172.21.15.26:6816/118178 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f23c805a260 con 0x7f23b402bb60 2023-10-01T07:52:01.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.735+0000 7f23aeffd700 1 -- 172.21.15.26:0/3869980152 <== mgr.4107 v1:172.21.15.26:6816/118178 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+247647 (unknown 2965378022 0 1090360660) 0x7f23c805a260 con 0x7f23b402bb60 2023-10-01T07:52:01.739 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:52:01.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.738+0000 7f23cd9d5700 1 -- 172.21.15.26:0/3869980152 >> v1:172.21.15.26:6816/118178 conn(0x7f23b402bb60 legacy=0x7f23b402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:01.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.738+0000 7f23cd9d5700 1 -- 172.21.15.26:0/3869980152 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f23c8117bd0 msgr2=0x7f23c813ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:01.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.739+0000 7f23cd9d5700 1 --2- 172.21.15.26:0/3869980152 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f23c8117bd0 0x7f23c813ab10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f23c000c0c0 tx=0x7f23c000b040).stop 2023-10-01T07:52:01.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.739+0000 7f23cd9d5700 1 -- 172.21.15.26:0/3869980152 shutdown_connections 2023-10-01T07:52:01.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.739+0000 7f23cd9d5700 1 --2- 172.21.15.26:0/3869980152 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f23c8117bd0 0x7f23c813ab10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:01.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.739+0000 7f23cd9d5700 1 --2- 172.21.15.26:0/3869980152 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f23c80650f0 0x7f23c81171f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:01.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.739+0000 7f23cd9d5700 1 --2- 172.21.15.26:0/3869980152 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23c80992a0 0x7f23c81176e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:01.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.739+0000 7f23cd9d5700 1 -- 172.21.15.26:0/3869980152 >> 172.21.15.26:0/3869980152 conn(0x7f23c809dc70 msgr2=0x7f23c812f690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:01.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.739+0000 7f23cd9d5700 1 -- 172.21.15.26:0/3869980152 shutdown_connections 2023-10-01T07:52:01.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.739+0000 7f23cd9d5700 1 -- 172.21.15.26:0/3869980152 wait complete. 2023-10-01T07:52:01.742 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-01T07:52:01.752 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-10-01T07:51:59.806899+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":666,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":68,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188944,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298416,"statfs":{"total":386547056640,"available":385329577984,"internally_reserved":0,"allocated":573440,"data_stored":161864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.340051+0000","last_change":"2023-10-01T07:51:57.340051+0000","last_active":"2023-10-01T07:51:57.340051+0000","last_peered":"2023-10-01T07:51:57.340051+0000","last_clean":"2023-10-01T07:51:57.340051+0000","last_became_active":"2023-10-01T07:51:57.339739+0000","last_became_peered":"2023-10-01T07:51:57.339739+0000","last_unstale":"2023-10-01T07:51:57.340051+0000","last_undegraded":"2023-10-01T07:51:57.340051+0000","last_fullsized":"2023-10-01T07:51:57.340051+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.330147+0000","last_change":"2023-10-01T07:51:57.330147+0000","last_active":"2023-10-01T07:51:57.330147+0000","last_peered":"2023-10-01T07:51:57.330147+0000","last_clean":"2023-10-01T07:51:57.330147+0000","last_became_active":"2023-10-01T07:51:57.329793+0000","last_became_peered":"2023-10-01T07:51:57.329793+0000","last_unstale":"2023-10-01T07:51:57.330147+0000","last_undegraded":"2023-10-01T07:51:57.330147+0000","last_fullsized":"2023-10-01T07:51:57.330147+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.343537+0000","last_change":"2023-10-01T07:51:57.335404+0000","last_active":"2023-10-01T07:51:57.343537+0000","last_peered":"2023-10-01T07:51:57.343537+0000","last_clean":"2023-10-01T07:51:57.343537+0000","last_became_active":"2023-10-01T07:51:57.329225+0000","last_became_peered":"2023-10-01T07:51:57.329225+0000","last_unstale":"2023-10-01T07:51:57.343537+0000","last_undegraded":"2023-10-01T07:51:57.343537+0000","last_fullsized":"2023-10-01T07:51:57.343537+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.337475+0000","last_change":"2023-10-01T07:51:57.332237+0000","last_active":"2023-10-01T07:51:57.337475+0000","last_peered":"2023-10-01T07:51:57.337475+0000","last_clean":"2023-10-01T07:51:57.337475+0000","last_became_active":"2023-10-01T07:51:57.331857+0000","last_became_peered":"2023-10-01T07:51:57.331857+0000","last_unstale":"2023-10-01T07:51:57.337475+0000","last_undegraded":"2023-10-01T07:51:57.337475+0000","last_fullsized":"2023-10-01T07:51:57.337475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335610+0000","last_change":"2023-10-01T07:51:57.326512+0000","last_active":"2023-10-01T07:51:57.335610+0000","last_peered":"2023-10-01T07:51:57.335610+0000","last_clean":"2023-10-01T07:51:57.335610+0000","last_became_active":"2023-10-01T07:51:57.326202+0000","last_became_peered":"2023-10-01T07:51:57.326202+0000","last_unstale":"2023-10-01T07:51:57.335610+0000","last_undegraded":"2023-10-01T07:51:57.335610+0000","last_fullsized":"2023-10-01T07:51:57.335610+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335188+0000","last_change":"2023-10-01T07:51:57.323649+0000","last_active":"2023-10-01T07:51:57.335188+0000","last_peered":"2023-10-01T07:51:57.335188+0000","last_clean":"2023-10-01T07:51:57.335188+0000","last_became_active":"2023-10-01T07:51:57.319917+0000","last_became_peered":"2023-10-01T07:51:57.319917+0000","last_unstale":"2023-10-01T07:51:57.335188+0000","last_undegraded":"2023-10-01T07:51:57.335188+0000","last_fullsized":"2023-10-01T07:51:57.335188+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335645+0000","last_change":"2023-10-01T07:51:57.325845+0000","last_active":"2023-10-01T07:51:57.335645+0000","last_peered":"2023-10-01T07:51:57.335645+0000","last_clean":"2023-10-01T07:51:57.335645+0000","last_became_active":"2023-10-01T07:51:57.325346+0000","last_became_peered":"2023-10-01T07:51:57.325346+0000","last_unstale":"2023-10-01T07:51:57.335645+0000","last_undegraded":"2023-10-01T07:51:57.335645+0000","last_fullsized":"2023-10-01T07:51:57.335645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.337622+0000","last_change":"2023-10-01T07:51:57.328438+0000","last_active":"2023-10-01T07:51:57.337622+0000","last_peered":"2023-10-01T07:51:57.337622+0000","last_clean":"2023-10-01T07:51:57.337622+0000","last_became_active":"2023-10-01T07:51:57.328128+0000","last_became_peered":"2023-10-01T07:51:57.328128+0000","last_unstale":"2023-10-01T07:51:57.337622+0000","last_undegraded":"2023-10-01T07:51:57.337622+0000","last_fullsized":"2023-10-01T07:51:57.337622+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.333136+0000","last_change":"2023-10-01T07:51:57.328650+0000","last_active":"2023-10-01T07:51:57.333136+0000","last_peered":"2023-10-01T07:51:57.333136+0000","last_clean":"2023-10-01T07:51:57.333136+0000","last_became_active":"2023-10-01T07:51:57.328335+0000","last_became_peered":"2023-10-01T07:51:57.328335+0000","last_unstale":"2023-10-01T07:51:57.333136+0000","last_undegraded":"2023-10-01T07:51:57.333136+0000","last_fullsized":"2023-10-01T07:51:57.333136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.331991+0000","last_change":"2023-10-01T07:51:57.331991+0000","last_active":"2023-10-01T07:51:57.331991+0000","last_peered":"2023-10-01T07:51:57.331991+0000","last_clean":"2023-10-01T07:51:57.331991+0000","last_became_active":"2023-10-01T07:51:57.331698+0000","last_became_peered":"2023-10-01T07:51:57.331698+0000","last_unstale":"2023-10-01T07:51:57.331991+0000","last_undegraded":"2023-10-01T07:51:57.331991+0000","last_fullsized":"2023-10-01T07:51:57.331991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.342157+0000","last_change":"2023-10-01T07:51:57.342157+0000","last_active":"2023-10-01T07:51:57.342157+0000","last_peered":"2023-10-01T07:51:57.342157+0000","last_clean":"2023-10-01T07:51:57.342157+0000","last_became_active":"2023-10-01T07:51:57.341533+0000","last_became_peered":"2023-10-01T07:51:57.341533+0000","last_unstale":"2023-10-01T07:51:57.342157+0000","last_undegraded":"2023-10-01T07:51:57.342157+0000","last_fullsized":"2023-10-01T07:51:57.342157+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.323193+0000","last_change":"2023-10-01T07:51:57.318295+0000","last_active":"2023-10-01T07:51:57.323193+0000","last_peered":"2023-10-01T07:51:57.323193+0000","last_clean":"2023-10-01T07:51:57.323193+0000","last_became_active":"2023-10-01T07:51:57.317972+0000","last_became_peered":"2023-10-01T07:51:57.317972+0000","last_unstale":"2023-10-01T07:51:57.323193+0000","last_undegraded":"2023-10-01T07:51:57.323193+0000","last_fullsized":"2023-10-01T07:51:57.323193+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.334056+0000","last_change":"2023-10-01T07:51:57.321137+0000","last_active":"2023-10-01T07:51:57.334056+0000","last_peered":"2023-10-01T07:51:57.334056+0000","last_clean":"2023-10-01T07:51:57.334056+0000","last_became_active":"2023-10-01T07:51:57.320789+0000","last_became_peered":"2023-10-01T07:51:57.320789+0000","last_unstale":"2023-10-01T07:51:57.334056+0000","last_undegraded":"2023-10-01T07:51:57.334056+0000","last_fullsized":"2023-10-01T07:51:57.334056+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335623+0000","last_change":"2023-10-01T07:51:57.325641+0000","last_active":"2023-10-01T07:51:57.335623+0000","last_peered":"2023-10-01T07:51:57.335623+0000","last_clean":"2023-10-01T07:51:57.335623+0000","last_became_active":"2023-10-01T07:51:57.324956+0000","last_became_peered":"2023-10-01T07:51:57.324956+0000","last_unstale":"2023-10-01T07:51:57.335623+0000","last_undegraded":"2023-10-01T07:51:57.335623+0000","last_fullsized":"2023-10-01T07:51:57.335623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.321164+0000","last_change":"2023-10-01T07:51:57.316882+0000","last_active":"2023-10-01T07:51:57.321164+0000","last_peered":"2023-10-01T07:51:57.321164+0000","last_clean":"2023-10-01T07:51:57.321164+0000","last_became_active":"2023-10-01T07:51:57.316026+0000","last_became_peered":"2023-10-01T07:51:57.316026+0000","last_unstale":"2023-10-01T07:51:57.321164+0000","last_undegraded":"2023-10-01T07:51:57.321164+0000","last_fullsized":"2023-10-01T07:51:57.321164+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.340110+0000","last_change":"2023-10-01T07:51:57.340110+0000","last_active":"2023-10-01T07:51:57.340110+0000","last_peered":"2023-10-01T07:51:57.340110+0000","last_clean":"2023-10-01T07:51:57.340110+0000","last_became_active":"2023-10-01T07:51:57.339795+0000","last_became_peered":"2023-10-01T07:51:57.339795+0000","last_unstale":"2023-10-01T07:51:57.340110+0000","last_undegraded":"2023-10-01T07:51:57.340110+0000","last_fullsized":"2023-10-01T07:51:57.340110+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348821+0000","last_change":"2023-10-01T07:51:57.347691+0000","last_active":"2023-10-01T07:51:57.348821+0000","last_peered":"2023-10-01T07:51:57.348821+0000","last_clean":"2023-10-01T07:51:57.348821+0000","last_became_active":"2023-10-01T07:51:57.347374+0000","last_became_peered":"2023-10-01T07:51:57.347374+0000","last_unstale":"2023-10-01T07:51:57.348821+0000","last_undegraded":"2023-10-01T07:51:57.348821+0000","last_fullsized":"2023-10-01T07:51:57.348821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348551+0000","last_change":"2023-10-01T07:51:57.341479+0000","last_active":"2023-10-01T07:51:57.348551+0000","last_peered":"2023-10-01T07:51:57.348551+0000","last_clean":"2023-10-01T07:51:57.348551+0000","last_became_active":"2023-10-01T07:51:57.341064+0000","last_became_peered":"2023-10-01T07:51:57.341064+0000","last_unstale":"2023-10-01T07:51:57.348551+0000","last_undegraded":"2023-10-01T07:51:57.348551+0000","last_fullsized":"2023-10-01T07:51:57.348551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.338618+0000","last_change":"2023-10-01T07:51:57.332063+0000","last_active":"2023-10-01T07:51:57.338618+0000","last_peered":"2023-10-01T07:51:57.338618+0000","last_clean":"2023-10-01T07:51:57.338618+0000","last_became_active":"2023-10-01T07:51:57.331511+0000","last_became_peered":"2023-10-01T07:51:57.331511+0000","last_unstale":"2023-10-01T07:51:57.338618+0000","last_undegraded":"2023-10-01T07:51:57.338618+0000","last_fullsized":"2023-10-01T07:51:57.338618+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.336578+0000","last_change":"2023-10-01T07:51:57.334881+0000","last_active":"2023-10-01T07:51:57.336578+0000","last_peered":"2023-10-01T07:51:57.336578+0000","last_clean":"2023-10-01T07:51:57.336578+0000","last_became_active":"2023-10-01T07:51:57.334682+0000","last_became_peered":"2023-10-01T07:51:57.334682+0000","last_unstale":"2023-10-01T07:51:57.336578+0000","last_undegraded":"2023-10-01T07:51:57.336578+0000","last_fullsized":"2023-10-01T07:51:57.336578+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.336811+0000","last_change":"2023-10-01T07:51:57.334700+0000","last_active":"2023-10-01T07:51:57.336811+0000","last_peered":"2023-10-01T07:51:57.336811+0000","last_clean":"2023-10-01T07:51:57.336811+0000","last_became_active":"2023-10-01T07:51:57.334406+0000","last_became_peered":"2023-10-01T07:51:57.334406+0000","last_unstale":"2023-10-01T07:51:57.336811+0000","last_undegraded":"2023-10-01T07:51:57.336811+0000","last_fullsized":"2023-10-01T07:51:57.336811+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.337601+0000","last_change":"2023-10-01T07:51:57.323470+0000","last_active":"2023-10-01T07:51:57.337601+0000","last_peered":"2023-10-01T07:51:57.337601+0000","last_clean":"2023-10-01T07:51:57.337601+0000","last_became_active":"2023-10-01T07:51:57.323181+0000","last_became_peered":"2023-10-01T07:51:57.323181+0000","last_unstale":"2023-10-01T07:51:57.337601+0000","last_undegraded":"2023-10-01T07:51:57.337601+0000","last_fullsized":"2023-10-01T07:51:57.337601+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.321447+0000","last_change":"2023-10-01T07:51:56.911245+0000","last_active":"2023-10-01T07:51:57.321447+0000","last_peered":"2023-10-01T07:51:57.321447+0000","last_clean":"2023-10-01T07:51:57.321447+0000","last_became_active":"2023-10-01T07:51:56.910930+0000","last_became_peered":"2023-10-01T07:51:56.910930+0000","last_unstale":"2023-10-01T07:51:57.321447+0000","last_undegraded":"2023-10-01T07:51:57.321447+0000","last_fullsized":"2023-10-01T07:51:57.321447+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.310075+0000","last_change":"2023-10-01T07:51:56.919246+0000","last_active":"2023-10-01T07:51:57.310075+0000","last_peered":"2023-10-01T07:51:57.310075+0000","last_clean":"2023-10-01T07:51:57.310075+0000","last_became_active":"2023-10-01T07:51:56.918962+0000","last_became_peered":"2023-10-01T07:51:56.918962+0000","last_unstale":"2023-10-01T07:51:57.310075+0000","last_undegraded":"2023-10-01T07:51:57.310075+0000","last_fullsized":"2023-10-01T07:51:57.310075+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.338500+0000","last_change":"2023-10-01T07:51:57.335143+0000","last_active":"2023-10-01T07:51:57.338500+0000","last_peered":"2023-10-01T07:51:57.338500+0000","last_clean":"2023-10-01T07:51:57.338500+0000","last_became_active":"2023-10-01T07:51:57.334730+0000","last_became_peered":"2023-10-01T07:51:57.334730+0000","last_unstale":"2023-10-01T07:51:57.338500+0000","last_undegraded":"2023-10-01T07:51:57.338500+0000","last_fullsized":"2023-10-01T07:51:57.338500+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:55.881867+0000","last_change":"2023-10-01T07:51:55.881867+0000","last_active":"2023-10-01T07:51:55.881867+0000","last_peered":"2023-10-01T07:51:55.881867+0000","last_clean":"2023-10-01T07:51:55.881867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:55.881867+0000","last_undegraded":"2023-10-01T07:51:55.881867+0000","last_fullsized":"2023-10-01T07:51:55.881867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.305995+0000","last_change":"2023-10-01T07:51:56.916086+0000","last_active":"2023-10-01T07:51:57.305995+0000","last_peered":"2023-10-01T07:51:57.305995+0000","last_clean":"2023-10-01T07:51:57.305995+0000","last_became_active":"2023-10-01T07:51:56.912164+0000","last_became_peered":"2023-10-01T07:51:56.912164+0000","last_unstale":"2023-10-01T07:51:57.305995+0000","last_undegraded":"2023-10-01T07:51:57.305995+0000","last_fullsized":"2023-10-01T07:51:57.305995+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-01T07:51:56.922083+0000","last_change":"2023-10-01T07:51:56.917428+0000","last_active":"2023-10-01T07:51:56.922083+0000","last_peered":"2023-10-01T07:51:56.922083+0000","last_clean":"2023-10-01T07:51:56.922083+0000","last_became_active":"2023-10-01T07:51:56.916781+0000","last_became_peered":"2023-10-01T07:51:56.916781+0000","last_unstale":"2023-10-01T07:51:56.922083+0000","last_undegraded":"2023-10-01T07:51:56.922083+0000","last_fullsized":"2023-10-01T07:51:56.922083+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345213+0000","last_change":"2023-10-01T07:51:56.914774+0000","last_active":"2023-10-01T07:51:57.345213+0000","last_peered":"2023-10-01T07:51:57.345213+0000","last_clean":"2023-10-01T07:51:57.345213+0000","last_became_active":"2023-10-01T07:51:56.912021+0000","last_became_peered":"2023-10-01T07:51:56.912021+0000","last_unstale":"2023-10-01T07:51:57.345213+0000","last_undegraded":"2023-10-01T07:51:57.345213+0000","last_fullsized":"2023-10-01T07:51:57.345213+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.333273+0000","last_change":"2023-10-01T07:51:57.331183+0000","last_active":"2023-10-01T07:51:57.333273+0000","last_peered":"2023-10-01T07:51:57.333273+0000","last_clean":"2023-10-01T07:51:57.333273+0000","last_became_active":"2023-10-01T07:51:57.330934+0000","last_became_peered":"2023-10-01T07:51:57.330934+0000","last_unstale":"2023-10-01T07:51:57.333273+0000","last_undegraded":"2023-10-01T07:51:57.333273+0000","last_fullsized":"2023-10-01T07:51:57.333273+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:55.881867+0000","last_change":"2023-10-01T07:51:55.881867+0000","last_active":"2023-10-01T07:51:55.881867+0000","last_peered":"2023-10-01T07:51:55.881867+0000","last_clean":"2023-10-01T07:51:55.881867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:55.881867+0000","last_undegraded":"2023-10-01T07:51:55.881867+0000","last_fullsized":"2023-10-01T07:51:55.881867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.341789+0000","last_change":"2023-10-01T07:51:57.341789+0000","last_active":"2023-10-01T07:51:57.341789+0000","last_peered":"2023-10-01T07:51:57.341789+0000","last_clean":"2023-10-01T07:51:57.341789+0000","last_became_active":"2023-10-01T07:51:57.340852+0000","last_became_peered":"2023-10-01T07:51:57.340852+0000","last_unstale":"2023-10-01T07:51:57.341789+0000","last_undegraded":"2023-10-01T07:51:57.341789+0000","last_fullsized":"2023-10-01T07:51:57.341789+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:55.881867+0000","last_change":"2023-10-01T07:51:55.881867+0000","last_active":"2023-10-01T07:51:55.881867+0000","last_peered":"2023-10-01T07:51:55.881867+0000","last_clean":"2023-10-01T07:51:55.881867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:55.881867+0000","last_undegraded":"2023-10-01T07:51:55.881867+0000","last_fullsized":"2023-10-01T07:51:55.881867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.301106+0000","last_change":"2023-10-01T07:51:56.915181+0000","last_active":"2023-10-01T07:51:57.301106+0000","last_peered":"2023-10-01T07:51:57.301106+0000","last_clean":"2023-10-01T07:51:57.301106+0000","last_became_active":"2023-10-01T07:51:56.914858+0000","last_became_peered":"2023-10-01T07:51:56.914858+0000","last_unstale":"2023-10-01T07:51:57.301106+0000","last_undegraded":"2023-10-01T07:51:57.301106+0000","last_fullsized":"2023-10-01T07:51:57.301106+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:55.881867+0000","last_change":"2023-10-01T07:51:55.881867+0000","last_active":"2023-10-01T07:51:55.881867+0000","last_peered":"2023-10-01T07:51:55.881867+0000","last_clean":"2023-10-01T07:51:55.881867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:55.881867+0000","last_undegraded":"2023-10-01T07:51:55.881867+0000","last_fullsized":"2023-10-01T07:51:55.881867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335190+0000","last_change":"2023-10-01T07:51:57.325464+0000","last_active":"2023-10-01T07:51:57.335190+0000","last_peered":"2023-10-01T07:51:57.335190+0000","last_clean":"2023-10-01T07:51:57.335190+0000","last_became_active":"2023-10-01T07:51:57.325143+0000","last_became_peered":"2023-10-01T07:51:57.325143+0000","last_unstale":"2023-10-01T07:51:57.335190+0000","last_undegraded":"2023-10-01T07:51:57.335190+0000","last_fullsized":"2023-10-01T07:51:57.335190+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.346026+0000","last_change":"2023-10-01T07:51:56.922808+0000","last_active":"2023-10-01T07:51:57.346026+0000","last_peered":"2023-10-01T07:51:57.346026+0000","last_clean":"2023-10-01T07:51:57.346026+0000","last_became_active":"2023-10-01T07:51:56.922520+0000","last_became_peered":"2023-10-01T07:51:56.922520+0000","last_unstale":"2023-10-01T07:51:57.346026+0000","last_undegraded":"2023-10-01T07:51:57.346026+0000","last_fullsized":"2023-10-01T07:51:57.346026+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.334758+0000","last_change":"2023-10-01T07:51:56.922474+0000","last_active":"2023-10-01T07:51:57.334758+0000","last_peered":"2023-10-01T07:51:57.334758+0000","last_clean":"2023-10-01T07:51:57.334758+0000","last_became_active":"2023-10-01T07:51:56.921742+0000","last_became_peered":"2023-10-01T07:51:56.921742+0000","last_unstale":"2023-10-01T07:51:57.334758+0000","last_undegraded":"2023-10-01T07:51:57.334758+0000","last_fullsized":"2023-10-01T07:51:57.334758+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.323262+0000","last_change":"2023-10-01T07:51:56.917629+0000","last_active":"2023-10-01T07:51:57.323262+0000","last_peered":"2023-10-01T07:51:57.323262+0000","last_clean":"2023-10-01T07:51:57.323262+0000","last_became_active":"2023-10-01T07:51:56.917154+0000","last_became_peered":"2023-10-01T07:51:56.917154+0000","last_unstale":"2023-10-01T07:51:57.323262+0000","last_undegraded":"2023-10-01T07:51:57.323262+0000","last_fullsized":"2023-10-01T07:51:57.323262+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348565+0000","last_change":"2023-10-01T07:51:57.340793+0000","last_active":"2023-10-01T07:51:57.348565+0000","last_peered":"2023-10-01T07:51:57.348565+0000","last_clean":"2023-10-01T07:51:57.348565+0000","last_became_active":"2023-10-01T07:51:57.340504+0000","last_became_peered":"2023-10-01T07:51:57.340504+0000","last_unstale":"2023-10-01T07:51:57.348565+0000","last_undegraded":"2023-10-01T07:51:57.348565+0000","last_fullsized":"2023-10-01T07:51:57.348565+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:55.881867+0000","last_change":"2023-10-01T07:51:55.881867+0000","last_active":"2023-10-01T07:51:55.881867+0000","last_peered":"2023-10-01T07:51:55.881867+0000","last_clean":"2023-10-01T07:51:55.881867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:55.881867+0000","last_undegraded":"2023-10-01T07:51:55.881867+0000","last_fullsized":"2023-10-01T07:51:55.881867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.340445+0000","last_change":"2023-10-01T07:51:57.340445+0000","last_active":"2023-10-01T07:51:57.340445+0000","last_peered":"2023-10-01T07:51:57.340445+0000","last_clean":"2023-10-01T07:51:57.340445+0000","last_became_active":"2023-10-01T07:51:57.340180+0000","last_became_peered":"2023-10-01T07:51:57.340180+0000","last_unstale":"2023-10-01T07:51:57.340445+0000","last_undegraded":"2023-10-01T07:51:57.340445+0000","last_fullsized":"2023-10-01T07:51:57.340445+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.303411+0000","last_change":"2023-10-01T07:51:56.915532+0000","last_active":"2023-10-01T07:51:57.303411+0000","last_peered":"2023-10-01T07:51:57.303411+0000","last_clean":"2023-10-01T07:51:57.303411+0000","last_became_active":"2023-10-01T07:51:56.912225+0000","last_became_peered":"2023-10-01T07:51:56.912225+0000","last_unstale":"2023-10-01T07:51:57.303411+0000","last_undegraded":"2023-10-01T07:51:57.303411+0000","last_fullsized":"2023-10-01T07:51:57.303411+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.338026+0000","last_change":"2023-10-01T07:51:57.331858+0000","last_active":"2023-10-01T07:51:57.338026+0000","last_peered":"2023-10-01T07:51:57.338026+0000","last_clean":"2023-10-01T07:51:57.338026+0000","last_became_active":"2023-10-01T07:51:57.331568+0000","last_became_peered":"2023-10-01T07:51:57.331568+0000","last_unstale":"2023-10-01T07:51:57.338026+0000","last_undegraded":"2023-10-01T07:51:57.338026+0000","last_fullsized":"2023-10-01T07:51:57.338026+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:55.881867+0000","last_change":"2023-10-01T07:51:55.881867+0000","last_active":"2023-10-01T07:51:55.881867+0000","last_peered":"2023-10-01T07:51:55.881867+0000","last_clean":"2023-10-01T07:51:55.881867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:55.881867+0000","last_undegraded":"2023-10-01T07:51:55.881867+0000","last_fullsized":"2023-10-01T07:51:55.881867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335325+0000","last_change":"2023-10-01T07:51:57.326926+0000","last_active":"2023-10-01T07:51:57.335325+0000","last_peered":"2023-10-01T07:51:57.335325+0000","last_clean":"2023-10-01T07:51:57.335325+0000","last_became_active":"2023-10-01T07:51:57.326597+0000","last_became_peered":"2023-10-01T07:51:57.326597+0000","last_unstale":"2023-10-01T07:51:57.335325+0000","last_undegraded":"2023-10-01T07:51:57.335325+0000","last_fullsized":"2023-10-01T07:51:57.335325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:55.881867+0000","last_change":"2023-10-01T07:51:55.881867+0000","last_active":"2023-10-01T07:51:55.881867+0000","last_peered":"2023-10-01T07:51:55.881867+0000","last_clean":"2023-10-01T07:51:55.881867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:55.881867+0000","last_undegraded":"2023-10-01T07:51:55.881867+0000","last_fullsized":"2023-10-01T07:51:55.881867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:55.881867+0000","last_change":"2023-10-01T07:51:55.881867+0000","last_active":"2023-10-01T07:51:55.881867+0000","last_peered":"2023-10-01T07:51:55.881867+0000","last_clean":"2023-10-01T07:51:55.881867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:55.881867+0000","last_undegraded":"2023-10-01T07:51:55.881867+0000","last_fullsized":"2023-10-01T07:51:55.881867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.340249+0000","last_change":"2023-10-01T07:51:57.340249+0000","last_active":"2023-10-01T07:51:57.340249+0000","last_peered":"2023-10-01T07:51:57.340249+0000","last_clean":"2023-10-01T07:51:57.340249+0000","last_became_active":"2023-10-01T07:51:57.339937+0000","last_became_peered":"2023-10-01T07:51:57.339937+0000","last_unstale":"2023-10-01T07:51:57.340249+0000","last_undegraded":"2023-10-01T07:51:57.340249+0000","last_fullsized":"2023-10-01T07:51:57.340249+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:55.881867+0000","last_change":"2023-10-01T07:51:55.881867+0000","last_active":"2023-10-01T07:51:55.881867+0000","last_peered":"2023-10-01T07:51:55.881867+0000","last_clean":"2023-10-01T07:51:55.881867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:55.881867+0000","last_undegraded":"2023-10-01T07:51:55.881867+0000","last_fullsized":"2023-10-01T07:51:55.881867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348828+0000","last_change":"2023-10-01T07:51:57.347574+0000","last_active":"2023-10-01T07:51:57.348828+0000","last_peered":"2023-10-01T07:51:57.348828+0000","last_clean":"2023-10-01T07:51:57.348828+0000","last_became_active":"2023-10-01T07:51:57.347243+0000","last_became_peered":"2023-10-01T07:51:57.347243+0000","last_unstale":"2023-10-01T07:51:57.348828+0000","last_undegraded":"2023-10-01T07:51:57.348828+0000","last_fullsized":"2023-10-01T07:51:57.348828+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.310517+0000","last_change":"2023-10-01T07:51:51.883413+0000","last_active":"2023-10-01T07:51:57.310517+0000","last_peered":"2023-10-01T07:51:57.310517+0000","last_clean":"2023-10-01T07:51:57.310517+0000","last_became_active":"2023-10-01T07:51:51.883088+0000","last_became_peered":"2023-10-01T07:51:51.883088+0000","last_unstale":"2023-10-01T07:51:57.310517+0000","last_undegraded":"2023-10-01T07:51:57.310517+0000","last_fullsized":"2023-10-01T07:51:57.310517+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-01T07:51:56.922804+0000","last_change":"2023-10-01T07:51:56.914139+0000","last_active":"2023-10-01T07:51:56.922804+0000","last_peered":"2023-10-01T07:51:56.922804+0000","last_clean":"2023-10-01T07:51:56.922804+0000","last_became_active":"2023-10-01T07:51:56.913026+0000","last_became_peered":"2023-10-01T07:51:56.913026+0000","last_unstale":"2023-10-01T07:51:56.922804+0000","last_undegraded":"2023-10-01T07:51:56.922804+0000","last_fullsized":"2023-10-01T07:51:56.922804+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.336585+0000","last_change":"2023-10-01T07:51:57.334103+0000","last_active":"2023-10-01T07:51:57.336585+0000","last_peered":"2023-10-01T07:51:57.336585+0000","last_clean":"2023-10-01T07:51:57.336585+0000","last_became_active":"2023-10-01T07:51:57.333743+0000","last_became_peered":"2023-10-01T07:51:57.333743+0000","last_unstale":"2023-10-01T07:51:57.336585+0000","last_undegraded":"2023-10-01T07:51:57.336585+0000","last_fullsized":"2023-10-01T07:51:57.336585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-01T07:51:51.885667+0000","last_change":"2023-10-01T07:51:51.882685+0000","last_active":"2023-10-01T07:51:51.885667+0000","last_peered":"2023-10-01T07:51:51.885667+0000","last_clean":"2023-10-01T07:51:51.885667+0000","last_became_active":"2023-10-01T07:51:51.882396+0000","last_became_peered":"2023-10-01T07:51:51.882396+0000","last_unstale":"2023-10-01T07:51:51.885667+0000","last_undegraded":"2023-10-01T07:51:51.885667+0000","last_fullsized":"2023-10-01T07:51:51.885667+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.300924+0000","last_change":"2023-10-01T07:51:56.915631+0000","last_active":"2023-10-01T07:51:57.300924+0000","last_peered":"2023-10-01T07:51:57.300924+0000","last_clean":"2023-10-01T07:51:57.300924+0000","last_became_active":"2023-10-01T07:51:56.911566+0000","last_became_peered":"2023-10-01T07:51:56.911566+0000","last_unstale":"2023-10-01T07:51:57.300924+0000","last_undegraded":"2023-10-01T07:51:57.300924+0000","last_fullsized":"2023-10-01T07:51:57.300924+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.329388+0000","last_change":"2023-10-01T07:51:57.319612+0000","last_active":"2023-10-01T07:51:57.329388+0000","last_peered":"2023-10-01T07:51:57.329388+0000","last_clean":"2023-10-01T07:51:57.329388+0000","last_became_active":"2023-10-01T07:51:57.319125+0000","last_became_peered":"2023-10-01T07:51:57.319125+0000","last_unstale":"2023-10-01T07:51:57.329388+0000","last_undegraded":"2023-10-01T07:51:57.329388+0000","last_fullsized":"2023-10-01T07:51:57.329388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-01T07:51:56.906124+0000","last_change":"2023-10-01T07:51:51.885336+0000","last_active":"2023-10-01T07:51:56.906124+0000","last_peered":"2023-10-01T07:51:56.906124+0000","last_clean":"2023-10-01T07:51:56.906124+0000","last_became_active":"2023-10-01T07:51:51.884991+0000","last_became_peered":"2023-10-01T07:51:51.884991+0000","last_unstale":"2023-10-01T07:51:56.906124+0000","last_undegraded":"2023-10-01T07:51:56.906124+0000","last_fullsized":"2023-10-01T07:51:56.906124+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.311818+0000","last_change":"2023-10-01T07:51:56.929636+0000","last_active":"2023-10-01T07:51:57.311818+0000","last_peered":"2023-10-01T07:51:57.311818+0000","last_clean":"2023-10-01T07:51:57.311818+0000","last_became_active":"2023-10-01T07:51:56.929308+0000","last_became_peered":"2023-10-01T07:51:56.929308+0000","last_unstale":"2023-10-01T07:51:57.311818+0000","last_undegraded":"2023-10-01T07:51:57.311818+0000","last_fullsized":"2023-10-01T07:51:57.311818+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.333038+0000","last_change":"2023-10-01T07:51:57.329162+0000","last_active":"2023-10-01T07:51:57.333038+0000","last_peered":"2023-10-01T07:51:57.333038+0000","last_clean":"2023-10-01T07:51:57.333038+0000","last_became_active":"2023-10-01T07:51:57.328749+0000","last_became_peered":"2023-10-01T07:51:57.328749+0000","last_unstale":"2023-10-01T07:51:57.333038+0000","last_undegraded":"2023-10-01T07:51:57.333038+0000","last_fullsized":"2023-10-01T07:51:57.333038+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-01T07:51:51.885622+0000","last_change":"2023-10-01T07:51:51.882657+0000","last_active":"2023-10-01T07:51:51.885622+0000","last_peered":"2023-10-01T07:51:51.885622+0000","last_clean":"2023-10-01T07:51:51.885622+0000","last_became_active":"2023-10-01T07:51:51.882334+0000","last_became_peered":"2023-10-01T07:51:51.882334+0000","last_unstale":"2023-10-01T07:51:51.885622+0000","last_undegraded":"2023-10-01T07:51:51.885622+0000","last_fullsized":"2023-10-01T07:51:51.885622+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.311710+0000","last_change":"2023-10-01T07:51:50.871456+0000","last_active":"2023-10-01T07:51:57.311710+0000","last_peered":"2023-10-01T07:51:57.311710+0000","last_clean":"2023-10-01T07:51:57.311710+0000","last_became_active":"2023-10-01T07:51:50.871112+0000","last_became_peered":"2023-10-01T07:51:50.871112+0000","last_unstale":"2023-10-01T07:51:57.311710+0000","last_undegraded":"2023-10-01T07:51:57.311710+0000","last_fullsized":"2023-10-01T07:51:57.311710+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:49.856372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:49.856372+0000","last_clean_scrub_stamp":"2023-10-01T07:51:49.856372+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:55.881867+0000","last_change":"2023-10-01T07:51:55.881867+0000","last_active":"2023-10-01T07:51:55.881867+0000","last_peered":"2023-10-01T07:51:55.881867+0000","last_clean":"2023-10-01T07:51:55.881867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:55.881867+0000","last_undegraded":"2023-10-01T07:51:55.881867+0000","last_fullsized":"2023-10-01T07:51:55.881867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-01T07:51:51.885687+0000","last_change":"2023-10-01T07:51:51.882831+0000","last_active":"2023-10-01T07:51:51.885687+0000","last_peered":"2023-10-01T07:51:51.885687+0000","last_clean":"2023-10-01T07:51:51.885687+0000","last_became_active":"2023-10-01T07:51:51.882490+0000","last_became_peered":"2023-10-01T07:51:51.882490+0000","last_unstale":"2023-10-01T07:51:51.885687+0000","last_undegraded":"2023-10-01T07:51:51.885687+0000","last_fullsized":"2023-10-01T07:51:51.885687+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.300429+0000","last_change":"2023-10-01T07:51:56.929720+0000","last_active":"2023-10-01T07:51:57.300429+0000","last_peered":"2023-10-01T07:51:57.300429+0000","last_clean":"2023-10-01T07:51:57.300429+0000","last_became_active":"2023-10-01T07:51:56.929370+0000","last_became_peered":"2023-10-01T07:51:56.929370+0000","last_unstale":"2023-10-01T07:51:57.300429+0000","last_undegraded":"2023-10-01T07:51:57.300429+0000","last_fullsized":"2023-10-01T07:51:57.300429+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.338477+0000","last_change":"2023-10-01T07:51:57.335095+0000","last_active":"2023-10-01T07:51:57.338477+0000","last_peered":"2023-10-01T07:51:57.338477+0000","last_clean":"2023-10-01T07:51:57.338477+0000","last_became_active":"2023-10-01T07:51:57.334324+0000","last_became_peered":"2023-10-01T07:51:57.334324+0000","last_unstale":"2023-10-01T07:51:57.338477+0000","last_undegraded":"2023-10-01T07:51:57.338477+0000","last_fullsized":"2023-10-01T07:51:57.338477+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-01T07:51:51.886159+0000","last_change":"2023-10-01T07:51:51.884196+0000","last_active":"2023-10-01T07:51:51.886159+0000","last_peered":"2023-10-01T07:51:51.886159+0000","last_clean":"2023-10-01T07:51:51.886159+0000","last_became_active":"2023-10-01T07:51:51.883784+0000","last_became_peered":"2023-10-01T07:51:51.883784+0000","last_unstale":"2023-10-01T07:51:51.886159+0000","last_undegraded":"2023-10-01T07:51:51.886159+0000","last_fullsized":"2023-10-01T07:51:51.886159+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.310257+0000","last_change":"2023-10-01T07:51:56.913348+0000","last_active":"2023-10-01T07:51:57.310257+0000","last_peered":"2023-10-01T07:51:57.310257+0000","last_clean":"2023-10-01T07:51:57.310257+0000","last_became_active":"2023-10-01T07:51:56.913041+0000","last_became_peered":"2023-10-01T07:51:56.913041+0000","last_unstale":"2023-10-01T07:51:57.310257+0000","last_undegraded":"2023-10-01T07:51:57.310257+0000","last_fullsized":"2023-10-01T07:51:57.310257+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.320737+0000","last_change":"2023-10-01T07:51:57.313930+0000","last_active":"2023-10-01T07:51:57.320737+0000","last_peered":"2023-10-01T07:51:57.320737+0000","last_clean":"2023-10-01T07:51:57.320737+0000","last_became_active":"2023-10-01T07:51:57.313613+0000","last_became_peered":"2023-10-01T07:51:57.313613+0000","last_unstale":"2023-10-01T07:51:57.320737+0000","last_undegraded":"2023-10-01T07:51:57.320737+0000","last_fullsized":"2023-10-01T07:51:57.320737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:55.881867+0000","last_change":"2023-10-01T07:51:55.881867+0000","last_active":"2023-10-01T07:51:55.881867+0000","last_peered":"2023-10-01T07:51:55.881867+0000","last_clean":"2023-10-01T07:51:55.881867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:55.881867+0000","last_undegraded":"2023-10-01T07:51:55.881867+0000","last_fullsized":"2023-10-01T07:51:55.881867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.312442+0000","last_change":"2023-10-01T07:51:51.883317+0000","last_active":"2023-10-01T07:51:57.312442+0000","last_peered":"2023-10-01T07:51:57.312442+0000","last_clean":"2023-10-01T07:51:57.312442+0000","last_became_active":"2023-10-01T07:51:51.883005+0000","last_became_peered":"2023-10-01T07:51:51.883005+0000","last_unstale":"2023-10-01T07:51:57.312442+0000","last_undegraded":"2023-10-01T07:51:57.312442+0000","last_fullsized":"2023-10-01T07:51:57.312442+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-01T07:51:51.886113+0000","last_change":"2023-10-01T07:51:51.883299+0000","last_active":"2023-10-01T07:51:51.886113+0000","last_peered":"2023-10-01T07:51:51.886113+0000","last_clean":"2023-10-01T07:51:51.886113+0000","last_became_active":"2023-10-01T07:51:51.883001+0000","last_became_peered":"2023-10-01T07:51:51.883001+0000","last_unstale":"2023-10-01T07:51:51.886113+0000","last_undegraded":"2023-10-01T07:51:51.886113+0000","last_fullsized":"2023-10-01T07:51:51.886113+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.303139+0000","last_change":"2023-10-01T07:51:56.921291+0000","last_active":"2023-10-01T07:51:57.303139+0000","last_peered":"2023-10-01T07:51:57.303139+0000","last_clean":"2023-10-01T07:51:57.303139+0000","last_became_active":"2023-10-01T07:51:56.920989+0000","last_became_peered":"2023-10-01T07:51:56.920989+0000","last_unstale":"2023-10-01T07:51:57.303139+0000","last_undegraded":"2023-10-01T07:51:57.303139+0000","last_fullsized":"2023-10-01T07:51:57.303139+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.342916+0000","last_change":"2023-10-01T07:51:57.342916+0000","last_active":"2023-10-01T07:51:57.342916+0000","last_peered":"2023-10-01T07:51:57.342916+0000","last_clean":"2023-10-01T07:51:57.342916+0000","last_became_active":"2023-10-01T07:51:57.342653+0000","last_became_peered":"2023-10-01T07:51:57.342653+0000","last_unstale":"2023-10-01T07:51:57.342916+0000","last_undegraded":"2023-10-01T07:51:57.342916+0000","last_fullsized":"2023-10-01T07:51:57.342916+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.325920+0000","last_change":"2023-10-01T07:51:56.916437+0000","last_active":"2023-10-01T07:51:57.325920+0000","last_peered":"2023-10-01T07:51:57.325920+0000","last_clean":"2023-10-01T07:51:57.325920+0000","last_became_active":"2023-10-01T07:51:56.915935+0000","last_became_peered":"2023-10-01T07:51:56.915935+0000","last_unstale":"2023-10-01T07:51:57.325920+0000","last_undegraded":"2023-10-01T07:51:57.325920+0000","last_fullsized":"2023-10-01T07:51:57.325920+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.330536+0000","last_change":"2023-10-01T07:51:57.330536+0000","last_active":"2023-10-01T07:51:57.330536+0000","last_peered":"2023-10-01T07:51:57.330536+0000","last_clean":"2023-10-01T07:51:57.330536+0000","last_became_active":"2023-10-01T07:51:57.330151+0000","last_became_peered":"2023-10-01T07:51:57.330151+0000","last_unstale":"2023-10-01T07:51:57.330536+0000","last_undegraded":"2023-10-01T07:51:57.330536+0000","last_fullsized":"2023-10-01T07:51:57.330536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.322423+0000","last_change":"2023-10-01T07:51:56.922316+0000","last_active":"2023-10-01T07:51:57.322423+0000","last_peered":"2023-10-01T07:51:57.322423+0000","last_clean":"2023-10-01T07:51:57.322423+0000","last_became_active":"2023-10-01T07:51:56.922003+0000","last_became_peered":"2023-10-01T07:51:56.922003+0000","last_unstale":"2023-10-01T07:51:57.322423+0000","last_undegraded":"2023-10-01T07:51:57.322423+0000","last_fullsized":"2023-10-01T07:51:57.322423+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.341976+0000","last_change":"2023-10-01T07:51:57.341976+0000","last_active":"2023-10-01T07:51:57.341976+0000","last_peered":"2023-10-01T07:51:57.341976+0000","last_clean":"2023-10-01T07:51:57.341976+0000","last_became_active":"2023-10-01T07:51:57.341188+0000","last_became_peered":"2023-10-01T07:51:57.341188+0000","last_unstale":"2023-10-01T07:51:57.341976+0000","last_undegraded":"2023-10-01T07:51:57.341976+0000","last_fullsized":"2023-10-01T07:51:57.341976+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:55.881867+0000","last_change":"2023-10-01T07:51:55.881867+0000","last_active":"2023-10-01T07:51:55.881867+0000","last_peered":"2023-10-01T07:51:55.881867+0000","last_clean":"2023-10-01T07:51:55.881867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:55.881867+0000","last_undegraded":"2023-10-01T07:51:55.881867+0000","last_fullsized":"2023-10-01T07:51:55.881867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.340653+0000","last_change":"2023-10-01T07:51:57.340653+0000","last_active":"2023-10-01T07:51:57.340653+0000","last_peered":"2023-10-01T07:51:57.340653+0000","last_clean":"2023-10-01T07:51:57.340653+0000","last_became_active":"2023-10-01T07:51:57.340395+0000","last_became_peered":"2023-10-01T07:51:57.340395+0000","last_unstale":"2023-10-01T07:51:57.340653+0000","last_undegraded":"2023-10-01T07:51:57.340653+0000","last_fullsized":"2023-10-01T07:51:57.340653+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:55.881867+0000","last_change":"2023-10-01T07:51:55.881867+0000","last_active":"2023-10-01T07:51:55.881867+0000","last_peered":"2023-10-01T07:51:55.881867+0000","last_clean":"2023-10-01T07:51:55.881867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:55.881867+0000","last_undegraded":"2023-10-01T07:51:55.881867+0000","last_fullsized":"2023-10-01T07:51:55.881867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335116+0000","last_change":"2023-10-01T07:51:56.922677+0000","last_active":"2023-10-01T07:51:57.335116+0000","last_peered":"2023-10-01T07:51:57.335116+0000","last_clean":"2023-10-01T07:51:57.335116+0000","last_became_active":"2023-10-01T07:51:56.922121+0000","last_became_peered":"2023-10-01T07:51:56.922121+0000","last_unstale":"2023-10-01T07:51:57.335116+0000","last_undegraded":"2023-10-01T07:51:57.335116+0000","last_fullsized":"2023-10-01T07:51:57.335116+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.329519+0000","last_change":"2023-10-01T07:51:57.329519+0000","last_active":"2023-10-01T07:51:57.329519+0000","last_peered":"2023-10-01T07:51:57.329519+0000","last_clean":"2023-10-01T07:51:57.329519+0000","last_became_active":"2023-10-01T07:51:57.329191+0000","last_became_peered":"2023-10-01T07:51:57.329191+0000","last_unstale":"2023-10-01T07:51:57.329519+0000","last_undegraded":"2023-10-01T07:51:57.329519+0000","last_fullsized":"2023-10-01T07:51:57.329519+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335155+0000","last_change":"2023-10-01T07:51:57.320100+0000","last_active":"2023-10-01T07:51:57.335155+0000","last_peered":"2023-10-01T07:51:57.335155+0000","last_clean":"2023-10-01T07:51:57.335155+0000","last_became_active":"2023-10-01T07:51:57.319593+0000","last_became_peered":"2023-10-01T07:51:57.319593+0000","last_unstale":"2023-10-01T07:51:57.335155+0000","last_undegraded":"2023-10-01T07:51:57.335155+0000","last_fullsized":"2023-10-01T07:51:57.335155+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.334378+0000","last_change":"2023-10-01T07:51:57.326270+0000","last_active":"2023-10-01T07:51:57.334378+0000","last_peered":"2023-10-01T07:51:57.334378+0000","last_clean":"2023-10-01T07:51:57.334378+0000","last_became_active":"2023-10-01T07:51:57.325956+0000","last_became_peered":"2023-10-01T07:51:57.325956+0000","last_unstale":"2023-10-01T07:51:57.334378+0000","last_undegraded":"2023-10-01T07:51:57.334378+0000","last_fullsized":"2023-10-01T07:51:57.334378+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-01T07:51:56.885908+0000","last_change":"2023-10-01T07:51:56.885908+0000","last_active":"2023-10-01T07:51:56.885908+0000","last_peered":"2023-10-01T07:51:56.885908+0000","last_clean":"2023-10-01T07:51:56.885908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-01T07:51:56.885908+0000","last_undegraded":"2023-10-01T07:51:56.885908+0000","last_fullsized":"2023-10-01T07:51:56.885908+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.329368+0000","last_change":"2023-10-01T07:51:57.319429+0000","last_active":"2023-10-01T07:51:57.329368+0000","last_peered":"2023-10-01T07:51:57.329368+0000","last_clean":"2023-10-01T07:51:57.329368+0000","last_became_active":"2023-10-01T07:51:57.318849+0000","last_became_peered":"2023-10-01T07:51:57.318849+0000","last_unstale":"2023-10-01T07:51:57.329368+0000","last_undegraded":"2023-10-01T07:51:57.329368+0000","last_fullsized":"2023-10-01T07:51:57.329368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":90,"acting":90,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":666,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":38,"acting":38,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297244,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074596,"statfs":{"total":96636764160,"available":96332386304,"internally_reserved":0,"allocated":151552,"data_stored":44462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297248,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074592,"statfs":{"total":96636764160,"available":96332382208,"internally_reserved":0,"allocated":155648,"data_stored":43626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297244,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074596,"statfs":{"total":96636764160,"available":96332386304,"internally_reserved":0,"allocated":151552,"data_stored":43572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-01T07:52:01.758 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-01T07:52:01.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.925+0000 7f137725b700 1 Processor -- start 2023-10-01T07:52:01.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.925+0000 7f137725b700 1 -- start start 2023-10-01T07:52:01.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.925+0000 7f137725b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13700654a0 0x7f1370098640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:01.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.925+0000 7f137725b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1370098b30 0x7f1370098f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:01.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.926+0000 7f137725b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f137012f470 0x7f1370131860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:01.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.926+0000 7f137725b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1370095880 con 0x7f1370098b30 2023-10-01T07:52:01.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.926+0000 7f137725b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1370065ed0 con 0x7f13700654a0 2023-10-01T07:52:01.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.926+0000 7f137725b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1370096120 con 0x7f137012f470 2023-10-01T07:52:01.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.926+0000 7f1374ff7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13700654a0 0x7f1370098640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:01.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.926+0000 7f13757f8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f137012f470 0x7f1370131860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:01.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.926+0000 7f136ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1370098b30 0x7f1370098f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:01.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.926+0000 7f1374ff7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13700654a0 0x7f1370098640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44022/0 (socket says 172.21.15.26:44022) 2023-10-01T07:52:01.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.926+0000 7f136ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1370098b30 0x7f1370098f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37996/0 (socket says 172.21.15.26:37996) 2023-10-01T07:52:01.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.926+0000 7f13757f8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f137012f470 0x7f1370131860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59588/0 (socket says 172.21.15.26:59588) 2023-10-01T07:52:01.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.926+0000 7f1374ff7700 1 -- 172.21.15.26:0/2893663563 learned_addr learned my addr 172.21.15.26:0/2893663563 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:01.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.926+0000 7f136ffff700 1 -- 172.21.15.26:0/2893663563 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f137012f470 msgr2=0x7f1370131860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:01.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.926+0000 7f136ffff700 1 --2- 172.21.15.26:0/2893663563 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f137012f470 0x7f1370131860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:01.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.926+0000 7f136ffff700 1 -- 172.21.15.26:0/2893663563 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13700654a0 msgr2=0x7f1370098640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:01.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.926+0000 7f136ffff700 1 --2- 172.21.15.26:0/2893663563 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13700654a0 0x7f1370098640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:01.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.926+0000 7f136ffff700 1 -- 172.21.15.26:0/2893663563 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1370099460 con 0x7f1370098b30 2023-10-01T07:52:01.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.926+0000 7f1374ff7700 1 --2- 172.21.15.26:0/2893663563 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13700654a0 0x7f1370098640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:01.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.926+0000 7f136ffff700 1 --2- 172.21.15.26:0/2893663563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1370098b30 0x7f1370098f70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f135c009790 tx=0x7f135c009060).ready entity=mon.0 client_cookie=4ca58e70dfc054e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:01.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.926+0000 7f136f7fe700 1 -- 172.21.15.26:0/2893663563 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c00d4a0 con 0x7f1370098b30 2023-10-01T07:52:01.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.926+0000 7f136f7fe700 1 -- 172.21.15.26:0/2893663563 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135c00d600 con 0x7f1370098b30 2023-10-01T07:52:01.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.926+0000 7f136f7fe700 1 -- 172.21.15.26:0/2893663563 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c00d980 con 0x7f1370098b30 2023-10-01T07:52:01.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.927+0000 7f137725b700 1 -- 172.21.15.26:0/2893663563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1370098b30 msgr2=0x7f1370098f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:01.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.927+0000 7f137725b700 1 --2- 172.21.15.26:0/2893663563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1370098b30 0x7f1370098f70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f135c009790 tx=0x7f135c009060).stop 2023-10-01T07:52:01.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.927+0000 7f137725b700 1 -- 172.21.15.26:0/2893663563 shutdown_connections 2023-10-01T07:52:01.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.927+0000 7f137725b700 1 --2- 172.21.15.26:0/2893663563 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f137012f470 0x7f1370131860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:01.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.927+0000 7f137725b700 1 --2- 172.21.15.26:0/2893663563 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13700654a0 0x7f1370098640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:01.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.927+0000 7f137725b700 1 --2- 172.21.15.26:0/2893663563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1370098b30 0x7f1370098f70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:01.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.927+0000 7f137725b700 1 -- 172.21.15.26:0/2893663563 >> 172.21.15.26:0/2893663563 conn(0x7f137009a740 msgr2=0x7f137009ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:01.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.927+0000 7f137725b700 1 -- 172.21.15.26:0/2893663563 shutdown_connections 2023-10-01T07:52:01.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.927+0000 7f137725b700 1 -- 172.21.15.26:0/2893663563 wait complete. 2023-10-01T07:52:01.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.928+0000 7f137725b700 1 Processor -- start 2023-10-01T07:52:01.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.928+0000 7f137725b700 1 -- start start 2023-10-01T07:52:01.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.929+0000 7f137725b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13700654a0 0x7f137011a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:01.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.929+0000 7f137725b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1370098b30 0x7f137011a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:01.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.929+0000 7f137725b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f137012f470 0x7f137011ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:01.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.929+0000 7f137725b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137011e930 con 0x7f13700654a0 2023-10-01T07:52:01.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.929+0000 7f137725b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1370099b00 con 0x7f1370098b30 2023-10-01T07:52:01.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.929+0000 7f137725b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f137011da70 con 0x7f137012f470 2023-10-01T07:52:01.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.929+0000 7f1374ff7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13700654a0 0x7f137011a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:01.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.929+0000 7f1374ff7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13700654a0 0x7f137011a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38012/0 (socket says 172.21.15.26:38012) 2023-10-01T07:52:01.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.929+0000 7f1374ff7700 1 -- 172.21.15.26:0/3715992456 learned_addr learned my addr 172.21.15.26:0/3715992456 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:01.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.929+0000 7f136ffff700 1 --2- 172.21.15.26:0/3715992456 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1370098b30 0x7f137011a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:01.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.929+0000 7f13757f8700 1 --2- 172.21.15.26:0/3715992456 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f137012f470 0x7f137011ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:01.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.929+0000 7f1374ff7700 1 -- 172.21.15.26:0/3715992456 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f137012f470 msgr2=0x7f137011ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:01.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.929+0000 7f1374ff7700 1 --2- 172.21.15.26:0/3715992456 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f137012f470 0x7f137011ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:01.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.929+0000 7f1374ff7700 1 -- 172.21.15.26:0/3715992456 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1370098b30 msgr2=0x7f137011a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:01.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.929+0000 7f1374ff7700 1 --2- 172.21.15.26:0/3715992456 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1370098b30 0x7f137011a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:01.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.929+0000 7f1374ff7700 1 -- 172.21.15.26:0/3715992456 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1364009370 con 0x7f13700654a0 2023-10-01T07:52:01.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.929+0000 7f136ffff700 1 --2- 172.21.15.26:0/3715992456 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1370098b30 0x7f137011a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:01.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.929+0000 7f1374ff7700 1 --2- 172.21.15.26:0/3715992456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13700654a0 0x7f137011a220 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f136400ea50 tx=0x7f13640090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:01.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.930+0000 7f136cff9700 1 -- 172.21.15.26:0/3715992456 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136400ee90 con 0x7f13700654a0 2023-10-01T07:52:01.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.930+0000 7f136cff9700 1 -- 172.21.15.26:0/3715992456 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136400c850 con 0x7f13700654a0 2023-10-01T07:52:01.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.930+0000 7f137725b700 1 -- 172.21.15.26:0/3715992456 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f135c0092a0 con 0x7f13700654a0 2023-10-01T07:52:01.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.930+0000 7f136cff9700 1 -- 172.21.15.26:0/3715992456 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136400cbd0 con 0x7f13700654a0 2023-10-01T07:52:01.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.930+0000 7f137725b700 1 -- 172.21.15.26:0/3715992456 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f137011d490 con 0x7f13700654a0 2023-10-01T07:52:01.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.930+0000 7f136cff9700 1 -- 172.21.15.26:0/3715992456 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f136401b400 con 0x7f13700654a0 2023-10-01T07:52:01.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.931+0000 7f136cff9700 1 -- 172.21.15.26:0/3715992456 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f136403b580 con 0x7f13700654a0 2023-10-01T07:52:01.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.931+0000 7f137725b700 1 -- 172.21.15.26:0/3715992456 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f137005a260 con 0x7f13700654a0 2023-10-01T07:52:01.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:01.935+0000 7f136cff9700 1 -- 172.21.15.26:0/3715992456 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f136401be60 con 0x7f13700654a0 2023-10-01T07:52:02.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.104+0000 7f137725b700 1 -- 172.21.15.26:0/3715992456 --> v1:172.21.15.26:6816/118178 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1370098070 con 0x7f135402bb60 2023-10-01T07:52:02.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.111+0000 7f136cff9700 1 -- 172.21.15.26:0/3715992456 <== mgr.4107 v1:172.21.15.26:6816/118178 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250014 (unknown 2965378022 0 3678127906) 0x7f1370098070 con 0x7f135402bb60 2023-10-01T07:52:02.115 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:52:02.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.114+0000 7f137725b700 1 -- 172.21.15.26:0/3715992456 >> v1:172.21.15.26:6816/118178 conn(0x7f135402bb60 legacy=0x7f135402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:02.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.114+0000 7f137725b700 1 -- 172.21.15.26:0/3715992456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13700654a0 msgr2=0x7f137011a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:02.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.114+0000 7f137725b700 1 --2- 172.21.15.26:0/3715992456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13700654a0 0x7f137011a220 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f136400ea50 tx=0x7f13640090f0).stop 2023-10-01T07:52:02.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.114+0000 7f137725b700 1 -- 172.21.15.26:0/3715992456 shutdown_connections 2023-10-01T07:52:02.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.114+0000 7f137725b700 1 --2- 172.21.15.26:0/3715992456 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f137012f470 0x7f137011ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:02.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.114+0000 7f137725b700 1 --2- 172.21.15.26:0/3715992456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13700654a0 0x7f137011a220 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:02.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.114+0000 7f137725b700 1 --2- 172.21.15.26:0/3715992456 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1370098b30 0x7f137011a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:02.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.114+0000 7f137725b700 1 -- 172.21.15.26:0/3715992456 >> 172.21.15.26:0/3715992456 conn(0x7f137009a740 msgr2=0x7f137009bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:02.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.114+0000 7f137725b700 1 -- 172.21.15.26:0/3715992456 shutdown_connections 2023-10-01T07:52:02.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.114+0000 7f137725b700 1 -- 172.21.15.26:0/3715992456 wait complete. 2023-10-01T07:52:02.118 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-01T07:52:02.128 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-01T07:52:01.807370+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":133,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189000,"kb_used_data":616,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298360,"statfs":{"total":386547056640,"available":385329520640,"internally_reserved":0,"allocated":630784,"data_stored":180589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1640,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000470"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.340051+0000","last_change":"2023-10-01T07:51:57.340051+0000","last_active":"2023-10-01T07:51:57.340051+0000","last_peered":"2023-10-01T07:51:57.340051+0000","last_clean":"2023-10-01T07:51:57.340051+0000","last_became_active":"2023-10-01T07:51:57.339739+0000","last_became_peered":"2023-10-01T07:51:57.339739+0000","last_unstale":"2023-10-01T07:51:57.340051+0000","last_undegraded":"2023-10-01T07:51:57.340051+0000","last_fullsized":"2023-10-01T07:51:57.340051+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.330147+0000","last_change":"2023-10-01T07:51:57.330147+0000","last_active":"2023-10-01T07:51:57.330147+0000","last_peered":"2023-10-01T07:51:57.330147+0000","last_clean":"2023-10-01T07:51:57.330147+0000","last_became_active":"2023-10-01T07:51:57.329793+0000","last_became_peered":"2023-10-01T07:51:57.329793+0000","last_unstale":"2023-10-01T07:51:57.330147+0000","last_undegraded":"2023-10-01T07:51:57.330147+0000","last_fullsized":"2023-10-01T07:51:57.330147+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.343537+0000","last_change":"2023-10-01T07:51:57.335404+0000","last_active":"2023-10-01T07:51:57.343537+0000","last_peered":"2023-10-01T07:51:57.343537+0000","last_clean":"2023-10-01T07:51:57.343537+0000","last_became_active":"2023-10-01T07:51:57.329225+0000","last_became_peered":"2023-10-01T07:51:57.329225+0000","last_unstale":"2023-10-01T07:51:57.343537+0000","last_undegraded":"2023-10-01T07:51:57.343537+0000","last_fullsized":"2023-10-01T07:51:57.343537+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.337475+0000","last_change":"2023-10-01T07:51:57.332237+0000","last_active":"2023-10-01T07:51:57.337475+0000","last_peered":"2023-10-01T07:51:57.337475+0000","last_clean":"2023-10-01T07:51:57.337475+0000","last_became_active":"2023-10-01T07:51:57.331857+0000","last_became_peered":"2023-10-01T07:51:57.331857+0000","last_unstale":"2023-10-01T07:51:57.337475+0000","last_undegraded":"2023-10-01T07:51:57.337475+0000","last_fullsized":"2023-10-01T07:51:57.337475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335610+0000","last_change":"2023-10-01T07:51:57.326512+0000","last_active":"2023-10-01T07:51:57.335610+0000","last_peered":"2023-10-01T07:51:57.335610+0000","last_clean":"2023-10-01T07:51:57.335610+0000","last_became_active":"2023-10-01T07:51:57.326202+0000","last_became_peered":"2023-10-01T07:51:57.326202+0000","last_unstale":"2023-10-01T07:51:57.335610+0000","last_undegraded":"2023-10-01T07:51:57.335610+0000","last_fullsized":"2023-10-01T07:51:57.335610+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345080+0000","last_change":"2023-10-01T07:51:57.323824+0000","last_active":"2023-10-01T07:51:57.345080+0000","last_peered":"2023-10-01T07:51:57.345080+0000","last_clean":"2023-10-01T07:51:57.345080+0000","last_became_active":"2023-10-01T07:51:57.322857+0000","last_became_peered":"2023-10-01T07:51:57.322857+0000","last_unstale":"2023-10-01T07:51:57.345080+0000","last_undegraded":"2023-10-01T07:51:57.345080+0000","last_fullsized":"2023-10-01T07:51:57.345080+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345129+0000","last_change":"2023-10-01T07:51:57.325909+0000","last_active":"2023-10-01T07:51:57.345129+0000","last_peered":"2023-10-01T07:51:57.345129+0000","last_clean":"2023-10-01T07:51:57.345129+0000","last_became_active":"2023-10-01T07:51:57.325226+0000","last_became_peered":"2023-10-01T07:51:57.325226+0000","last_unstale":"2023-10-01T07:51:57.345129+0000","last_undegraded":"2023-10-01T07:51:57.345129+0000","last_fullsized":"2023-10-01T07:51:57.345129+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335188+0000","last_change":"2023-10-01T07:51:57.323649+0000","last_active":"2023-10-01T07:51:57.335188+0000","last_peered":"2023-10-01T07:51:57.335188+0000","last_clean":"2023-10-01T07:51:57.335188+0000","last_became_active":"2023-10-01T07:51:57.319917+0000","last_became_peered":"2023-10-01T07:51:57.319917+0000","last_unstale":"2023-10-01T07:51:57.335188+0000","last_undegraded":"2023-10-01T07:51:57.335188+0000","last_fullsized":"2023-10-01T07:51:57.335188+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335645+0000","last_change":"2023-10-01T07:51:57.325845+0000","last_active":"2023-10-01T07:51:57.335645+0000","last_peered":"2023-10-01T07:51:57.335645+0000","last_clean":"2023-10-01T07:51:57.335645+0000","last_became_active":"2023-10-01T07:51:57.325346+0000","last_became_peered":"2023-10-01T07:51:57.325346+0000","last_unstale":"2023-10-01T07:51:57.335645+0000","last_undegraded":"2023-10-01T07:51:57.335645+0000","last_fullsized":"2023-10-01T07:51:57.335645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.337622+0000","last_change":"2023-10-01T07:51:57.328438+0000","last_active":"2023-10-01T07:51:57.337622+0000","last_peered":"2023-10-01T07:51:57.337622+0000","last_clean":"2023-10-01T07:51:57.337622+0000","last_became_active":"2023-10-01T07:51:57.328128+0000","last_became_peered":"2023-10-01T07:51:57.328128+0000","last_unstale":"2023-10-01T07:51:57.337622+0000","last_undegraded":"2023-10-01T07:51:57.337622+0000","last_fullsized":"2023-10-01T07:51:57.337622+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.333136+0000","last_change":"2023-10-01T07:51:57.328650+0000","last_active":"2023-10-01T07:51:57.333136+0000","last_peered":"2023-10-01T07:51:57.333136+0000","last_clean":"2023-10-01T07:51:57.333136+0000","last_became_active":"2023-10-01T07:51:57.328335+0000","last_became_peered":"2023-10-01T07:51:57.328335+0000","last_unstale":"2023-10-01T07:51:57.333136+0000","last_undegraded":"2023-10-01T07:51:57.333136+0000","last_fullsized":"2023-10-01T07:51:57.333136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.331991+0000","last_change":"2023-10-01T07:51:57.331991+0000","last_active":"2023-10-01T07:51:57.331991+0000","last_peered":"2023-10-01T07:51:57.331991+0000","last_clean":"2023-10-01T07:51:57.331991+0000","last_became_active":"2023-10-01T07:51:57.331698+0000","last_became_peered":"2023-10-01T07:51:57.331698+0000","last_unstale":"2023-10-01T07:51:57.331991+0000","last_undegraded":"2023-10-01T07:51:57.331991+0000","last_fullsized":"2023-10-01T07:51:57.331991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.342157+0000","last_change":"2023-10-01T07:51:57.342157+0000","last_active":"2023-10-01T07:51:57.342157+0000","last_peered":"2023-10-01T07:51:57.342157+0000","last_clean":"2023-10-01T07:51:57.342157+0000","last_became_active":"2023-10-01T07:51:57.341533+0000","last_became_peered":"2023-10-01T07:51:57.341533+0000","last_unstale":"2023-10-01T07:51:57.342157+0000","last_undegraded":"2023-10-01T07:51:57.342157+0000","last_fullsized":"2023-10-01T07:51:57.342157+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.323193+0000","last_change":"2023-10-01T07:51:57.318295+0000","last_active":"2023-10-01T07:51:57.323193+0000","last_peered":"2023-10-01T07:51:57.323193+0000","last_clean":"2023-10-01T07:51:57.323193+0000","last_became_active":"2023-10-01T07:51:57.317972+0000","last_became_peered":"2023-10-01T07:51:57.317972+0000","last_unstale":"2023-10-01T07:51:57.323193+0000","last_undegraded":"2023-10-01T07:51:57.323193+0000","last_fullsized":"2023-10-01T07:51:57.323193+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.334056+0000","last_change":"2023-10-01T07:51:57.321137+0000","last_active":"2023-10-01T07:51:57.334056+0000","last_peered":"2023-10-01T07:51:57.334056+0000","last_clean":"2023-10-01T07:51:57.334056+0000","last_became_active":"2023-10-01T07:51:57.320789+0000","last_became_peered":"2023-10-01T07:51:57.320789+0000","last_unstale":"2023-10-01T07:51:57.334056+0000","last_undegraded":"2023-10-01T07:51:57.334056+0000","last_fullsized":"2023-10-01T07:51:57.334056+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.346763+0000","last_change":"2023-10-01T07:51:57.325610+0000","last_active":"2023-10-01T07:51:57.346763+0000","last_peered":"2023-10-01T07:51:57.346763+0000","last_clean":"2023-10-01T07:51:57.346763+0000","last_became_active":"2023-10-01T07:51:57.325322+0000","last_became_peered":"2023-10-01T07:51:57.325322+0000","last_unstale":"2023-10-01T07:51:57.346763+0000","last_undegraded":"2023-10-01T07:51:57.346763+0000","last_fullsized":"2023-10-01T07:51:57.346763+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335623+0000","last_change":"2023-10-01T07:51:57.325641+0000","last_active":"2023-10-01T07:51:57.335623+0000","last_peered":"2023-10-01T07:51:57.335623+0000","last_clean":"2023-10-01T07:51:57.335623+0000","last_became_active":"2023-10-01T07:51:57.324956+0000","last_became_peered":"2023-10-01T07:51:57.324956+0000","last_unstale":"2023-10-01T07:51:57.335623+0000","last_undegraded":"2023-10-01T07:51:57.335623+0000","last_fullsized":"2023-10-01T07:51:57.335623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.321164+0000","last_change":"2023-10-01T07:51:57.316882+0000","last_active":"2023-10-01T07:51:57.321164+0000","last_peered":"2023-10-01T07:51:57.321164+0000","last_clean":"2023-10-01T07:51:57.321164+0000","last_became_active":"2023-10-01T07:51:57.316026+0000","last_became_peered":"2023-10-01T07:51:57.316026+0000","last_unstale":"2023-10-01T07:51:57.321164+0000","last_undegraded":"2023-10-01T07:51:57.321164+0000","last_fullsized":"2023-10-01T07:51:57.321164+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.340110+0000","last_change":"2023-10-01T07:51:57.340110+0000","last_active":"2023-10-01T07:51:57.340110+0000","last_peered":"2023-10-01T07:51:57.340110+0000","last_clean":"2023-10-01T07:51:57.340110+0000","last_became_active":"2023-10-01T07:51:57.339795+0000","last_became_peered":"2023-10-01T07:51:57.339795+0000","last_unstale":"2023-10-01T07:51:57.340110+0000","last_undegraded":"2023-10-01T07:51:57.340110+0000","last_fullsized":"2023-10-01T07:51:57.340110+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348821+0000","last_change":"2023-10-01T07:51:57.347691+0000","last_active":"2023-10-01T07:51:57.348821+0000","last_peered":"2023-10-01T07:51:57.348821+0000","last_clean":"2023-10-01T07:51:57.348821+0000","last_became_active":"2023-10-01T07:51:57.347374+0000","last_became_peered":"2023-10-01T07:51:57.347374+0000","last_unstale":"2023-10-01T07:51:57.348821+0000","last_undegraded":"2023-10-01T07:51:57.348821+0000","last_fullsized":"2023-10-01T07:51:57.348821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348551+0000","last_change":"2023-10-01T07:51:57.341479+0000","last_active":"2023-10-01T07:51:57.348551+0000","last_peered":"2023-10-01T07:51:57.348551+0000","last_clean":"2023-10-01T07:51:57.348551+0000","last_became_active":"2023-10-01T07:51:57.341064+0000","last_became_peered":"2023-10-01T07:51:57.341064+0000","last_unstale":"2023-10-01T07:51:57.348551+0000","last_undegraded":"2023-10-01T07:51:57.348551+0000","last_fullsized":"2023-10-01T07:51:57.348551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.338618+0000","last_change":"2023-10-01T07:51:57.332063+0000","last_active":"2023-10-01T07:51:57.338618+0000","last_peered":"2023-10-01T07:51:57.338618+0000","last_clean":"2023-10-01T07:51:57.338618+0000","last_became_active":"2023-10-01T07:51:57.331511+0000","last_became_peered":"2023-10-01T07:51:57.331511+0000","last_unstale":"2023-10-01T07:51:57.338618+0000","last_undegraded":"2023-10-01T07:51:57.338618+0000","last_fullsized":"2023-10-01T07:51:57.338618+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345085+0000","last_change":"2023-10-01T07:51:57.325516+0000","last_active":"2023-10-01T07:51:57.345085+0000","last_peered":"2023-10-01T07:51:57.345085+0000","last_clean":"2023-10-01T07:51:57.345085+0000","last_became_active":"2023-10-01T07:51:57.324549+0000","last_became_peered":"2023-10-01T07:51:57.324549+0000","last_unstale":"2023-10-01T07:51:57.345085+0000","last_undegraded":"2023-10-01T07:51:57.345085+0000","last_fullsized":"2023-10-01T07:51:57.345085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.336578+0000","last_change":"2023-10-01T07:51:57.334881+0000","last_active":"2023-10-01T07:51:57.336578+0000","last_peered":"2023-10-01T07:51:57.336578+0000","last_clean":"2023-10-01T07:51:57.336578+0000","last_became_active":"2023-10-01T07:51:57.334682+0000","last_became_peered":"2023-10-01T07:51:57.334682+0000","last_unstale":"2023-10-01T07:51:57.336578+0000","last_undegraded":"2023-10-01T07:51:57.336578+0000","last_fullsized":"2023-10-01T07:51:57.336578+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.336811+0000","last_change":"2023-10-01T07:51:57.334700+0000","last_active":"2023-10-01T07:51:57.336811+0000","last_peered":"2023-10-01T07:51:57.336811+0000","last_clean":"2023-10-01T07:51:57.336811+0000","last_became_active":"2023-10-01T07:51:57.334406+0000","last_became_peered":"2023-10-01T07:51:57.334406+0000","last_unstale":"2023-10-01T07:51:57.336811+0000","last_undegraded":"2023-10-01T07:51:57.336811+0000","last_fullsized":"2023-10-01T07:51:57.336811+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.337601+0000","last_change":"2023-10-01T07:51:57.323470+0000","last_active":"2023-10-01T07:51:57.337601+0000","last_peered":"2023-10-01T07:51:57.337601+0000","last_clean":"2023-10-01T07:51:57.337601+0000","last_became_active":"2023-10-01T07:51:57.323181+0000","last_became_peered":"2023-10-01T07:51:57.323181+0000","last_unstale":"2023-10-01T07:51:57.337601+0000","last_undegraded":"2023-10-01T07:51:57.337601+0000","last_fullsized":"2023-10-01T07:51:57.337601+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.347475+0000","last_change":"2023-10-01T07:51:57.339412+0000","last_active":"2023-10-01T07:51:57.347475+0000","last_peered":"2023-10-01T07:51:57.347475+0000","last_clean":"2023-10-01T07:51:57.347475+0000","last_became_active":"2023-10-01T07:51:57.338796+0000","last_became_peered":"2023-10-01T07:51:57.338796+0000","last_unstale":"2023-10-01T07:51:57.347475+0000","last_undegraded":"2023-10-01T07:51:57.347475+0000","last_fullsized":"2023-10-01T07:51:57.347475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.321447+0000","last_change":"2023-10-01T07:51:56.911245+0000","last_active":"2023-10-01T07:51:57.321447+0000","last_peered":"2023-10-01T07:51:57.321447+0000","last_clean":"2023-10-01T07:51:57.321447+0000","last_became_active":"2023-10-01T07:51:56.910930+0000","last_became_peered":"2023-10-01T07:51:56.910930+0000","last_unstale":"2023-10-01T07:51:57.321447+0000","last_undegraded":"2023-10-01T07:51:57.321447+0000","last_fullsized":"2023-10-01T07:51:57.321447+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348455+0000","last_change":"2023-10-01T07:51:57.343694+0000","last_active":"2023-10-01T07:51:57.348455+0000","last_peered":"2023-10-01T07:51:57.348455+0000","last_clean":"2023-10-01T07:51:57.348455+0000","last_became_active":"2023-10-01T07:51:57.343082+0000","last_became_peered":"2023-10-01T07:51:57.343082+0000","last_unstale":"2023-10-01T07:51:57.348455+0000","last_undegraded":"2023-10-01T07:51:57.348455+0000","last_fullsized":"2023-10-01T07:51:57.348455+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.310075+0000","last_change":"2023-10-01T07:51:56.919246+0000","last_active":"2023-10-01T07:51:57.310075+0000","last_peered":"2023-10-01T07:51:57.310075+0000","last_clean":"2023-10-01T07:51:57.310075+0000","last_became_active":"2023-10-01T07:51:56.918962+0000","last_became_peered":"2023-10-01T07:51:56.918962+0000","last_unstale":"2023-10-01T07:51:57.310075+0000","last_undegraded":"2023-10-01T07:51:57.310075+0000","last_fullsized":"2023-10-01T07:51:57.310075+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.338500+0000","last_change":"2023-10-01T07:51:57.335143+0000","last_active":"2023-10-01T07:51:57.338500+0000","last_peered":"2023-10-01T07:51:57.338500+0000","last_clean":"2023-10-01T07:51:57.338500+0000","last_became_active":"2023-10-01T07:51:57.334730+0000","last_became_peered":"2023-10-01T07:51:57.334730+0000","last_unstale":"2023-10-01T07:51:57.338500+0000","last_undegraded":"2023-10-01T07:51:57.338500+0000","last_fullsized":"2023-10-01T07:51:57.338500+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.309155+0000","last_change":"2023-10-01T07:51:56.914663+0000","last_active":"2023-10-01T07:51:57.309155+0000","last_peered":"2023-10-01T07:51:57.309155+0000","last_clean":"2023-10-01T07:51:57.309155+0000","last_became_active":"2023-10-01T07:51:56.914321+0000","last_became_peered":"2023-10-01T07:51:56.914321+0000","last_unstale":"2023-10-01T07:51:57.309155+0000","last_undegraded":"2023-10-01T07:51:57.309155+0000","last_fullsized":"2023-10-01T07:51:57.309155+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348872+0000","last_change":"2023-10-01T07:51:57.345818+0000","last_active":"2023-10-01T07:51:57.348872+0000","last_peered":"2023-10-01T07:51:57.348872+0000","last_clean":"2023-10-01T07:51:57.348872+0000","last_became_active":"2023-10-01T07:51:57.345561+0000","last_became_peered":"2023-10-01T07:51:57.345561+0000","last_unstale":"2023-10-01T07:51:57.348872+0000","last_undegraded":"2023-10-01T07:51:57.348872+0000","last_fullsized":"2023-10-01T07:51:57.348872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.305995+0000","last_change":"2023-10-01T07:51:56.916086+0000","last_active":"2023-10-01T07:51:57.305995+0000","last_peered":"2023-10-01T07:51:57.305995+0000","last_clean":"2023-10-01T07:51:57.305995+0000","last_became_active":"2023-10-01T07:51:56.912164+0000","last_became_peered":"2023-10-01T07:51:56.912164+0000","last_unstale":"2023-10-01T07:51:57.305995+0000","last_undegraded":"2023-10-01T07:51:57.305995+0000","last_fullsized":"2023-10-01T07:51:57.305995+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.347640+0000","last_change":"2023-10-01T07:51:57.340361+0000","last_active":"2023-10-01T07:51:57.347640+0000","last_peered":"2023-10-01T07:51:57.347640+0000","last_clean":"2023-10-01T07:51:57.347640+0000","last_became_active":"2023-10-01T07:51:57.339753+0000","last_became_peered":"2023-10-01T07:51:57.339753+0000","last_unstale":"2023-10-01T07:51:57.347640+0000","last_undegraded":"2023-10-01T07:51:57.347640+0000","last_fullsized":"2023-10-01T07:51:57.347640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-01T07:51:56.922083+0000","last_change":"2023-10-01T07:51:56.917428+0000","last_active":"2023-10-01T07:51:56.922083+0000","last_peered":"2023-10-01T07:51:56.922083+0000","last_clean":"2023-10-01T07:51:56.922083+0000","last_became_active":"2023-10-01T07:51:56.916781+0000","last_became_peered":"2023-10-01T07:51:56.916781+0000","last_unstale":"2023-10-01T07:51:56.922083+0000","last_undegraded":"2023-10-01T07:51:56.922083+0000","last_fullsized":"2023-10-01T07:51:56.922083+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.347478+0000","last_change":"2023-10-01T07:51:57.339022+0000","last_active":"2023-10-01T07:51:57.347478+0000","last_peered":"2023-10-01T07:51:57.347478+0000","last_clean":"2023-10-01T07:51:57.347478+0000","last_became_active":"2023-10-01T07:51:57.338710+0000","last_became_peered":"2023-10-01T07:51:57.338710+0000","last_unstale":"2023-10-01T07:51:57.347478+0000","last_undegraded":"2023-10-01T07:51:57.347478+0000","last_fullsized":"2023-10-01T07:51:57.347478+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345213+0000","last_change":"2023-10-01T07:51:56.914774+0000","last_active":"2023-10-01T07:51:57.345213+0000","last_peered":"2023-10-01T07:51:57.345213+0000","last_clean":"2023-10-01T07:51:57.345213+0000","last_became_active":"2023-10-01T07:51:56.912021+0000","last_became_peered":"2023-10-01T07:51:56.912021+0000","last_unstale":"2023-10-01T07:51:57.345213+0000","last_undegraded":"2023-10-01T07:51:57.345213+0000","last_fullsized":"2023-10-01T07:51:57.345213+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.333273+0000","last_change":"2023-10-01T07:51:57.331183+0000","last_active":"2023-10-01T07:51:57.333273+0000","last_peered":"2023-10-01T07:51:57.333273+0000","last_clean":"2023-10-01T07:51:57.333273+0000","last_became_active":"2023-10-01T07:51:57.330934+0000","last_became_peered":"2023-10-01T07:51:57.330934+0000","last_unstale":"2023-10-01T07:51:57.333273+0000","last_undegraded":"2023-10-01T07:51:57.333273+0000","last_fullsized":"2023-10-01T07:51:57.333273+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"16'6","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.350817+0000","last_change":"2023-10-01T07:51:56.925053+0000","last_active":"2023-10-01T07:51:57.350817+0000","last_peered":"2023-10-01T07:51:57.350817+0000","last_clean":"2023-10-01T07:51:57.350817+0000","last_became_active":"2023-10-01T07:51:56.924755+0000","last_became_peered":"2023-10-01T07:51:56.924755+0000","last_unstale":"2023-10-01T07:51:57.350817+0000","last_undegraded":"2023-10-01T07:51:57.350817+0000","last_fullsized":"2023-10-01T07:51:57.350817+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.341789+0000","last_change":"2023-10-01T07:51:57.341789+0000","last_active":"2023-10-01T07:51:57.341789+0000","last_peered":"2023-10-01T07:51:57.341789+0000","last_clean":"2023-10-01T07:51:57.341789+0000","last_became_active":"2023-10-01T07:51:57.340852+0000","last_became_peered":"2023-10-01T07:51:57.340852+0000","last_unstale":"2023-10-01T07:51:57.341789+0000","last_undegraded":"2023-10-01T07:51:57.341789+0000","last_fullsized":"2023-10-01T07:51:57.341789+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.344307+0000","last_change":"2023-10-01T07:51:56.924181+0000","last_active":"2023-10-01T07:51:57.344307+0000","last_peered":"2023-10-01T07:51:57.344307+0000","last_clean":"2023-10-01T07:51:57.344307+0000","last_became_active":"2023-10-01T07:51:56.923560+0000","last_became_peered":"2023-10-01T07:51:56.923560+0000","last_unstale":"2023-10-01T07:51:57.344307+0000","last_undegraded":"2023-10-01T07:51:57.344307+0000","last_fullsized":"2023-10-01T07:51:57.344307+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348258+0000","last_change":"2023-10-01T07:51:57.341678+0000","last_active":"2023-10-01T07:51:57.348258+0000","last_peered":"2023-10-01T07:51:57.348258+0000","last_clean":"2023-10-01T07:51:57.348258+0000","last_became_active":"2023-10-01T07:51:57.339190+0000","last_became_peered":"2023-10-01T07:51:57.339190+0000","last_unstale":"2023-10-01T07:51:57.348258+0000","last_undegraded":"2023-10-01T07:51:57.348258+0000","last_fullsized":"2023-10-01T07:51:57.348258+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.301106+0000","last_change":"2023-10-01T07:51:56.915181+0000","last_active":"2023-10-01T07:51:57.301106+0000","last_peered":"2023-10-01T07:51:57.301106+0000","last_clean":"2023-10-01T07:51:57.301106+0000","last_became_active":"2023-10-01T07:51:56.914858+0000","last_became_peered":"2023-10-01T07:51:56.914858+0000","last_unstale":"2023-10-01T07:51:57.301106+0000","last_undegraded":"2023-10-01T07:51:57.301106+0000","last_fullsized":"2023-10-01T07:51:57.301106+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.347494+0000","last_change":"2023-10-01T07:51:57.339439+0000","last_active":"2023-10-01T07:51:57.347494+0000","last_peered":"2023-10-01T07:51:57.347494+0000","last_clean":"2023-10-01T07:51:57.347494+0000","last_became_active":"2023-10-01T07:51:57.339208+0000","last_became_peered":"2023-10-01T07:51:57.339208+0000","last_unstale":"2023-10-01T07:51:57.347494+0000","last_undegraded":"2023-10-01T07:51:57.347494+0000","last_fullsized":"2023-10-01T07:51:57.347494+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.313566+0000","last_change":"2023-10-01T07:51:56.926432+0000","last_active":"2023-10-01T07:51:57.313566+0000","last_peered":"2023-10-01T07:51:57.313566+0000","last_clean":"2023-10-01T07:51:57.313566+0000","last_became_active":"2023-10-01T07:51:56.926080+0000","last_became_peered":"2023-10-01T07:51:56.926080+0000","last_unstale":"2023-10-01T07:51:57.313566+0000","last_undegraded":"2023-10-01T07:51:57.313566+0000","last_fullsized":"2023-10-01T07:51:57.313566+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335190+0000","last_change":"2023-10-01T07:51:57.325464+0000","last_active":"2023-10-01T07:51:57.335190+0000","last_peered":"2023-10-01T07:51:57.335190+0000","last_clean":"2023-10-01T07:51:57.335190+0000","last_became_active":"2023-10-01T07:51:57.325143+0000","last_became_peered":"2023-10-01T07:51:57.325143+0000","last_unstale":"2023-10-01T07:51:57.335190+0000","last_undegraded":"2023-10-01T07:51:57.335190+0000","last_fullsized":"2023-10-01T07:51:57.335190+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.346026+0000","last_change":"2023-10-01T07:51:56.922808+0000","last_active":"2023-10-01T07:51:57.346026+0000","last_peered":"2023-10-01T07:51:57.346026+0000","last_clean":"2023-10-01T07:51:57.346026+0000","last_became_active":"2023-10-01T07:51:56.922520+0000","last_became_peered":"2023-10-01T07:51:56.922520+0000","last_unstale":"2023-10-01T07:51:57.346026+0000","last_undegraded":"2023-10-01T07:51:57.346026+0000","last_fullsized":"2023-10-01T07:51:57.346026+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348893+0000","last_change":"2023-10-01T07:51:57.346026+0000","last_active":"2023-10-01T07:51:57.348893+0000","last_peered":"2023-10-01T07:51:57.348893+0000","last_clean":"2023-10-01T07:51:57.348893+0000","last_became_active":"2023-10-01T07:51:57.345720+0000","last_became_peered":"2023-10-01T07:51:57.345720+0000","last_unstale":"2023-10-01T07:51:57.348893+0000","last_undegraded":"2023-10-01T07:51:57.348893+0000","last_fullsized":"2023-10-01T07:51:57.348893+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.334758+0000","last_change":"2023-10-01T07:51:56.922474+0000","last_active":"2023-10-01T07:51:57.334758+0000","last_peered":"2023-10-01T07:51:57.334758+0000","last_clean":"2023-10-01T07:51:57.334758+0000","last_became_active":"2023-10-01T07:51:56.921742+0000","last_became_peered":"2023-10-01T07:51:56.921742+0000","last_unstale":"2023-10-01T07:51:57.334758+0000","last_undegraded":"2023-10-01T07:51:57.334758+0000","last_fullsized":"2023-10-01T07:51:57.334758+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.347658+0000","last_change":"2023-10-01T07:51:57.340546+0000","last_active":"2023-10-01T07:51:57.347658+0000","last_peered":"2023-10-01T07:51:57.347658+0000","last_clean":"2023-10-01T07:51:57.347658+0000","last_became_active":"2023-10-01T07:51:57.340112+0000","last_became_peered":"2023-10-01T07:51:57.340112+0000","last_unstale":"2023-10-01T07:51:57.347658+0000","last_undegraded":"2023-10-01T07:51:57.347658+0000","last_fullsized":"2023-10-01T07:51:57.347658+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.323262+0000","last_change":"2023-10-01T07:51:56.917629+0000","last_active":"2023-10-01T07:51:57.323262+0000","last_peered":"2023-10-01T07:51:57.323262+0000","last_clean":"2023-10-01T07:51:57.323262+0000","last_became_active":"2023-10-01T07:51:56.917154+0000","last_became_peered":"2023-10-01T07:51:56.917154+0000","last_unstale":"2023-10-01T07:51:57.323262+0000","last_undegraded":"2023-10-01T07:51:57.323262+0000","last_fullsized":"2023-10-01T07:51:57.323262+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348565+0000","last_change":"2023-10-01T07:51:57.340793+0000","last_active":"2023-10-01T07:51:57.348565+0000","last_peered":"2023-10-01T07:51:57.348565+0000","last_clean":"2023-10-01T07:51:57.348565+0000","last_became_active":"2023-10-01T07:51:57.340504+0000","last_became_peered":"2023-10-01T07:51:57.340504+0000","last_unstale":"2023-10-01T07:51:57.348565+0000","last_undegraded":"2023-10-01T07:51:57.348565+0000","last_fullsized":"2023-10-01T07:51:57.348565+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.344349+0000","last_change":"2023-10-01T07:51:56.925699+0000","last_active":"2023-10-01T07:51:57.344349+0000","last_peered":"2023-10-01T07:51:57.344349+0000","last_clean":"2023-10-01T07:51:57.344349+0000","last_became_active":"2023-10-01T07:51:56.925216+0000","last_became_peered":"2023-10-01T07:51:56.925216+0000","last_unstale":"2023-10-01T07:51:57.344349+0000","last_undegraded":"2023-10-01T07:51:57.344349+0000","last_fullsized":"2023-10-01T07:51:57.344349+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.340445+0000","last_change":"2023-10-01T07:51:57.340445+0000","last_active":"2023-10-01T07:51:57.340445+0000","last_peered":"2023-10-01T07:51:57.340445+0000","last_clean":"2023-10-01T07:51:57.340445+0000","last_became_active":"2023-10-01T07:51:57.340180+0000","last_became_peered":"2023-10-01T07:51:57.340180+0000","last_unstale":"2023-10-01T07:51:57.340445+0000","last_undegraded":"2023-10-01T07:51:57.340445+0000","last_fullsized":"2023-10-01T07:51:57.340445+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.303411+0000","last_change":"2023-10-01T07:51:56.915532+0000","last_active":"2023-10-01T07:51:57.303411+0000","last_peered":"2023-10-01T07:51:57.303411+0000","last_clean":"2023-10-01T07:51:57.303411+0000","last_became_active":"2023-10-01T07:51:56.912225+0000","last_became_peered":"2023-10-01T07:51:56.912225+0000","last_unstale":"2023-10-01T07:51:57.303411+0000","last_undegraded":"2023-10-01T07:51:57.303411+0000","last_fullsized":"2023-10-01T07:51:57.303411+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.338026+0000","last_change":"2023-10-01T07:51:57.331858+0000","last_active":"2023-10-01T07:51:57.338026+0000","last_peered":"2023-10-01T07:51:57.338026+0000","last_clean":"2023-10-01T07:51:57.338026+0000","last_became_active":"2023-10-01T07:51:57.331568+0000","last_became_peered":"2023-10-01T07:51:57.331568+0000","last_unstale":"2023-10-01T07:51:57.338026+0000","last_undegraded":"2023-10-01T07:51:57.338026+0000","last_fullsized":"2023-10-01T07:51:57.338026+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.342186+0000","last_change":"2023-10-01T07:51:56.924345+0000","last_active":"2023-10-01T07:51:57.342186+0000","last_peered":"2023-10-01T07:51:57.342186+0000","last_clean":"2023-10-01T07:51:57.342186+0000","last_became_active":"2023-10-01T07:51:56.923915+0000","last_became_peered":"2023-10-01T07:51:56.923915+0000","last_unstale":"2023-10-01T07:51:57.342186+0000","last_undegraded":"2023-10-01T07:51:57.342186+0000","last_fullsized":"2023-10-01T07:51:57.342186+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335325+0000","last_change":"2023-10-01T07:51:57.326926+0000","last_active":"2023-10-01T07:51:57.335325+0000","last_peered":"2023-10-01T07:51:57.335325+0000","last_clean":"2023-10-01T07:51:57.335325+0000","last_became_active":"2023-10-01T07:51:57.326597+0000","last_became_peered":"2023-10-01T07:51:57.326597+0000","last_unstale":"2023-10-01T07:51:57.335325+0000","last_undegraded":"2023-10-01T07:51:57.335325+0000","last_fullsized":"2023-10-01T07:51:57.335325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.306243+0000","last_change":"2023-10-01T07:51:56.918471+0000","last_active":"2023-10-01T07:51:57.306243+0000","last_peered":"2023-10-01T07:51:57.306243+0000","last_clean":"2023-10-01T07:51:57.306243+0000","last_became_active":"2023-10-01T07:51:56.918165+0000","last_became_peered":"2023-10-01T07:51:56.918165+0000","last_unstale":"2023-10-01T07:51:57.306243+0000","last_undegraded":"2023-10-01T07:51:57.306243+0000","last_fullsized":"2023-10-01T07:51:57.306243+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345107+0000","last_change":"2023-10-01T07:51:57.338218+0000","last_active":"2023-10-01T07:51:57.345107+0000","last_peered":"2023-10-01T07:51:57.345107+0000","last_clean":"2023-10-01T07:51:57.345107+0000","last_became_active":"2023-10-01T07:51:57.337910+0000","last_became_peered":"2023-10-01T07:51:57.337910+0000","last_unstale":"2023-10-01T07:51:57.345107+0000","last_undegraded":"2023-10-01T07:51:57.345107+0000","last_fullsized":"2023-10-01T07:51:57.345107+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.303371+0000","last_change":"2023-10-01T07:51:56.926078+0000","last_active":"2023-10-01T07:51:57.303371+0000","last_peered":"2023-10-01T07:51:57.303371+0000","last_clean":"2023-10-01T07:51:57.303371+0000","last_became_active":"2023-10-01T07:51:56.925681+0000","last_became_peered":"2023-10-01T07:51:56.925681+0000","last_unstale":"2023-10-01T07:51:57.303371+0000","last_undegraded":"2023-10-01T07:51:57.303371+0000","last_fullsized":"2023-10-01T07:51:57.303371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.340249+0000","last_change":"2023-10-01T07:51:57.340249+0000","last_active":"2023-10-01T07:51:57.340249+0000","last_peered":"2023-10-01T07:51:57.340249+0000","last_clean":"2023-10-01T07:51:57.340249+0000","last_became_active":"2023-10-01T07:51:57.339937+0000","last_became_peered":"2023-10-01T07:51:57.339937+0000","last_unstale":"2023-10-01T07:51:57.340249+0000","last_undegraded":"2023-10-01T07:51:57.340249+0000","last_fullsized":"2023-10-01T07:51:57.340249+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.303740+0000","last_change":"2023-10-01T07:51:56.918564+0000","last_active":"2023-10-01T07:51:57.303740+0000","last_peered":"2023-10-01T07:51:57.303740+0000","last_clean":"2023-10-01T07:51:57.303740+0000","last_became_active":"2023-10-01T07:51:56.918275+0000","last_became_peered":"2023-10-01T07:51:56.918275+0000","last_unstale":"2023-10-01T07:51:57.303740+0000","last_undegraded":"2023-10-01T07:51:57.303740+0000","last_fullsized":"2023-10-01T07:51:57.303740+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348828+0000","last_change":"2023-10-01T07:51:57.347574+0000","last_active":"2023-10-01T07:51:57.348828+0000","last_peered":"2023-10-01T07:51:57.348828+0000","last_clean":"2023-10-01T07:51:57.348828+0000","last_became_active":"2023-10-01T07:51:57.347243+0000","last_became_peered":"2023-10-01T07:51:57.347243+0000","last_unstale":"2023-10-01T07:51:57.348828+0000","last_undegraded":"2023-10-01T07:51:57.348828+0000","last_fullsized":"2023-10-01T07:51:57.348828+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.310517+0000","last_change":"2023-10-01T07:51:51.883413+0000","last_active":"2023-10-01T07:51:57.310517+0000","last_peered":"2023-10-01T07:51:57.310517+0000","last_clean":"2023-10-01T07:51:57.310517+0000","last_became_active":"2023-10-01T07:51:51.883088+0000","last_became_peered":"2023-10-01T07:51:51.883088+0000","last_unstale":"2023-10-01T07:51:57.310517+0000","last_undegraded":"2023-10-01T07:51:57.310517+0000","last_fullsized":"2023-10-01T07:51:57.310517+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-01T07:51:56.922804+0000","last_change":"2023-10-01T07:51:56.914139+0000","last_active":"2023-10-01T07:51:56.922804+0000","last_peered":"2023-10-01T07:51:56.922804+0000","last_clean":"2023-10-01T07:51:56.922804+0000","last_became_active":"2023-10-01T07:51:56.913026+0000","last_became_peered":"2023-10-01T07:51:56.913026+0000","last_unstale":"2023-10-01T07:51:56.922804+0000","last_undegraded":"2023-10-01T07:51:56.922804+0000","last_fullsized":"2023-10-01T07:51:56.922804+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.336585+0000","last_change":"2023-10-01T07:51:57.334103+0000","last_active":"2023-10-01T07:51:57.336585+0000","last_peered":"2023-10-01T07:51:57.336585+0000","last_clean":"2023-10-01T07:51:57.336585+0000","last_became_active":"2023-10-01T07:51:57.333743+0000","last_became_peered":"2023-10-01T07:51:57.333743+0000","last_unstale":"2023-10-01T07:51:57.336585+0000","last_undegraded":"2023-10-01T07:51:57.336585+0000","last_fullsized":"2023-10-01T07:51:57.336585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.309952+0000","last_change":"2023-10-01T07:51:51.882685+0000","last_active":"2023-10-01T07:51:57.309952+0000","last_peered":"2023-10-01T07:51:57.309952+0000","last_clean":"2023-10-01T07:51:57.309952+0000","last_became_active":"2023-10-01T07:51:51.882396+0000","last_became_peered":"2023-10-01T07:51:51.882396+0000","last_unstale":"2023-10-01T07:51:57.309952+0000","last_undegraded":"2023-10-01T07:51:57.309952+0000","last_fullsized":"2023-10-01T07:51:57.309952+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.300924+0000","last_change":"2023-10-01T07:51:56.915631+0000","last_active":"2023-10-01T07:51:57.300924+0000","last_peered":"2023-10-01T07:51:57.300924+0000","last_clean":"2023-10-01T07:51:57.300924+0000","last_became_active":"2023-10-01T07:51:56.911566+0000","last_became_peered":"2023-10-01T07:51:56.911566+0000","last_unstale":"2023-10-01T07:51:57.300924+0000","last_undegraded":"2023-10-01T07:51:57.300924+0000","last_fullsized":"2023-10-01T07:51:57.300924+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.329388+0000","last_change":"2023-10-01T07:51:57.319612+0000","last_active":"2023-10-01T07:51:57.329388+0000","last_peered":"2023-10-01T07:51:57.329388+0000","last_clean":"2023-10-01T07:51:57.329388+0000","last_became_active":"2023-10-01T07:51:57.319125+0000","last_became_peered":"2023-10-01T07:51:57.319125+0000","last_unstale":"2023-10-01T07:51:57.329388+0000","last_undegraded":"2023-10-01T07:51:57.329388+0000","last_fullsized":"2023-10-01T07:51:57.329388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-01T07:51:56.906124+0000","last_change":"2023-10-01T07:51:51.885336+0000","last_active":"2023-10-01T07:51:56.906124+0000","last_peered":"2023-10-01T07:51:56.906124+0000","last_clean":"2023-10-01T07:51:56.906124+0000","last_became_active":"2023-10-01T07:51:51.884991+0000","last_became_peered":"2023-10-01T07:51:51.884991+0000","last_unstale":"2023-10-01T07:51:56.906124+0000","last_undegraded":"2023-10-01T07:51:56.906124+0000","last_fullsized":"2023-10-01T07:51:56.906124+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.311818+0000","last_change":"2023-10-01T07:51:56.929636+0000","last_active":"2023-10-01T07:51:57.311818+0000","last_peered":"2023-10-01T07:51:57.311818+0000","last_clean":"2023-10-01T07:51:57.311818+0000","last_became_active":"2023-10-01T07:51:56.929308+0000","last_became_peered":"2023-10-01T07:51:56.929308+0000","last_unstale":"2023-10-01T07:51:57.311818+0000","last_undegraded":"2023-10-01T07:51:57.311818+0000","last_fullsized":"2023-10-01T07:51:57.311818+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.333038+0000","last_change":"2023-10-01T07:51:57.329162+0000","last_active":"2023-10-01T07:51:57.333038+0000","last_peered":"2023-10-01T07:51:57.333038+0000","last_clean":"2023-10-01T07:51:57.333038+0000","last_became_active":"2023-10-01T07:51:57.328749+0000","last_became_peered":"2023-10-01T07:51:57.328749+0000","last_unstale":"2023-10-01T07:51:57.333038+0000","last_undegraded":"2023-10-01T07:51:57.333038+0000","last_fullsized":"2023-10-01T07:51:57.333038+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.316966+0000","last_change":"2023-10-01T07:51:51.882657+0000","last_active":"2023-10-01T07:51:57.316966+0000","last_peered":"2023-10-01T07:51:57.316966+0000","last_clean":"2023-10-01T07:51:57.316966+0000","last_became_active":"2023-10-01T07:51:51.882334+0000","last_became_peered":"2023-10-01T07:51:51.882334+0000","last_unstale":"2023-10-01T07:51:57.316966+0000","last_undegraded":"2023-10-01T07:51:57.316966+0000","last_fullsized":"2023-10-01T07:51:57.316966+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.311710+0000","last_change":"2023-10-01T07:51:50.871456+0000","last_active":"2023-10-01T07:51:57.311710+0000","last_peered":"2023-10-01T07:51:57.311710+0000","last_clean":"2023-10-01T07:51:57.311710+0000","last_became_active":"2023-10-01T07:51:50.871112+0000","last_became_peered":"2023-10-01T07:51:50.871112+0000","last_unstale":"2023-10-01T07:51:57.311710+0000","last_undegraded":"2023-10-01T07:51:57.311710+0000","last_fullsized":"2023-10-01T07:51:57.311710+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:49.856372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:49.856372+0000","last_clean_scrub_stamp":"2023-10-01T07:51:49.856372+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.305919+0000","last_change":"2023-10-01T07:51:56.925843+0000","last_active":"2023-10-01T07:51:57.305919+0000","last_peered":"2023-10-01T07:51:57.305919+0000","last_clean":"2023-10-01T07:51:57.305919+0000","last_became_active":"2023-10-01T07:51:56.925538+0000","last_became_peered":"2023-10-01T07:51:56.925538+0000","last_unstale":"2023-10-01T07:51:57.305919+0000","last_undegraded":"2023-10-01T07:51:57.305919+0000","last_fullsized":"2023-10-01T07:51:57.305919+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.347449+0000","last_change":"2023-10-01T07:51:57.339219+0000","last_active":"2023-10-01T07:51:57.347449+0000","last_peered":"2023-10-01T07:51:57.347449+0000","last_clean":"2023-10-01T07:51:57.347449+0000","last_became_active":"2023-10-01T07:51:57.338416+0000","last_became_peered":"2023-10-01T07:51:57.338416+0000","last_unstale":"2023-10-01T07:51:57.347449+0000","last_undegraded":"2023-10-01T07:51:57.347449+0000","last_fullsized":"2023-10-01T07:51:57.347449+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.309046+0000","last_change":"2023-10-01T07:51:51.882831+0000","last_active":"2023-10-01T07:51:57.309046+0000","last_peered":"2023-10-01T07:51:57.309046+0000","last_clean":"2023-10-01T07:51:57.309046+0000","last_became_active":"2023-10-01T07:51:51.882490+0000","last_became_peered":"2023-10-01T07:51:51.882490+0000","last_unstale":"2023-10-01T07:51:57.309046+0000","last_undegraded":"2023-10-01T07:51:57.309046+0000","last_fullsized":"2023-10-01T07:51:57.309046+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.300429+0000","last_change":"2023-10-01T07:51:56.929720+0000","last_active":"2023-10-01T07:51:57.300429+0000","last_peered":"2023-10-01T07:51:57.300429+0000","last_clean":"2023-10-01T07:51:57.300429+0000","last_became_active":"2023-10-01T07:51:56.929370+0000","last_became_peered":"2023-10-01T07:51:56.929370+0000","last_unstale":"2023-10-01T07:51:57.300429+0000","last_undegraded":"2023-10-01T07:51:57.300429+0000","last_fullsized":"2023-10-01T07:51:57.300429+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.338477+0000","last_change":"2023-10-01T07:51:57.335095+0000","last_active":"2023-10-01T07:51:57.338477+0000","last_peered":"2023-10-01T07:51:57.338477+0000","last_clean":"2023-10-01T07:51:57.338477+0000","last_became_active":"2023-10-01T07:51:57.334324+0000","last_became_peered":"2023-10-01T07:51:57.334324+0000","last_unstale":"2023-10-01T07:51:57.338477+0000","last_undegraded":"2023-10-01T07:51:57.338477+0000","last_fullsized":"2023-10-01T07:51:57.338477+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.321040+0000","last_change":"2023-10-01T07:51:51.884196+0000","last_active":"2023-10-01T07:51:57.321040+0000","last_peered":"2023-10-01T07:51:57.321040+0000","last_clean":"2023-10-01T07:51:57.321040+0000","last_became_active":"2023-10-01T07:51:51.883784+0000","last_became_peered":"2023-10-01T07:51:51.883784+0000","last_unstale":"2023-10-01T07:51:57.321040+0000","last_undegraded":"2023-10-01T07:51:57.321040+0000","last_fullsized":"2023-10-01T07:51:57.321040+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.310257+0000","last_change":"2023-10-01T07:51:56.913348+0000","last_active":"2023-10-01T07:51:57.310257+0000","last_peered":"2023-10-01T07:51:57.310257+0000","last_clean":"2023-10-01T07:51:57.310257+0000","last_became_active":"2023-10-01T07:51:56.913041+0000","last_became_peered":"2023-10-01T07:51:56.913041+0000","last_unstale":"2023-10-01T07:51:57.310257+0000","last_undegraded":"2023-10-01T07:51:57.310257+0000","last_fullsized":"2023-10-01T07:51:57.310257+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.320737+0000","last_change":"2023-10-01T07:51:57.313930+0000","last_active":"2023-10-01T07:51:57.320737+0000","last_peered":"2023-10-01T07:51:57.320737+0000","last_clean":"2023-10-01T07:51:57.320737+0000","last_became_active":"2023-10-01T07:51:57.313613+0000","last_became_peered":"2023-10-01T07:51:57.313613+0000","last_unstale":"2023-10-01T07:51:57.320737+0000","last_undegraded":"2023-10-01T07:51:57.320737+0000","last_fullsized":"2023-10-01T07:51:57.320737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345351+0000","last_change":"2023-10-01T07:51:56.929769+0000","last_active":"2023-10-01T07:51:57.345351+0000","last_peered":"2023-10-01T07:51:57.345351+0000","last_clean":"2023-10-01T07:51:57.345351+0000","last_became_active":"2023-10-01T07:51:56.929479+0000","last_became_peered":"2023-10-01T07:51:56.929479+0000","last_unstale":"2023-10-01T07:51:57.345351+0000","last_undegraded":"2023-10-01T07:51:57.345351+0000","last_fullsized":"2023-10-01T07:51:57.345351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.312442+0000","last_change":"2023-10-01T07:51:51.883317+0000","last_active":"2023-10-01T07:51:57.312442+0000","last_peered":"2023-10-01T07:51:57.312442+0000","last_clean":"2023-10-01T07:51:57.312442+0000","last_became_active":"2023-10-01T07:51:51.883005+0000","last_became_peered":"2023-10-01T07:51:51.883005+0000","last_unstale":"2023-10-01T07:51:57.312442+0000","last_undegraded":"2023-10-01T07:51:57.312442+0000","last_fullsized":"2023-10-01T07:51:57.312442+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.346741+0000","last_change":"2023-10-01T07:51:57.325035+0000","last_active":"2023-10-01T07:51:57.346741+0000","last_peered":"2023-10-01T07:51:57.346741+0000","last_clean":"2023-10-01T07:51:57.346741+0000","last_became_active":"2023-10-01T07:51:57.324727+0000","last_became_peered":"2023-10-01T07:51:57.324727+0000","last_unstale":"2023-10-01T07:51:57.346741+0000","last_undegraded":"2023-10-01T07:51:57.346741+0000","last_fullsized":"2023-10-01T07:51:57.346741+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.322783+0000","last_change":"2023-10-01T07:51:51.883299+0000","last_active":"2023-10-01T07:51:57.322783+0000","last_peered":"2023-10-01T07:51:57.322783+0000","last_clean":"2023-10-01T07:51:57.322783+0000","last_became_active":"2023-10-01T07:51:51.883001+0000","last_became_peered":"2023-10-01T07:51:51.883001+0000","last_unstale":"2023-10-01T07:51:57.322783+0000","last_undegraded":"2023-10-01T07:51:57.322783+0000","last_fullsized":"2023-10-01T07:51:57.322783+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.303139+0000","last_change":"2023-10-01T07:51:56.921291+0000","last_active":"2023-10-01T07:51:57.303139+0000","last_peered":"2023-10-01T07:51:57.303139+0000","last_clean":"2023-10-01T07:51:57.303139+0000","last_became_active":"2023-10-01T07:51:56.920989+0000","last_became_peered":"2023-10-01T07:51:56.920989+0000","last_unstale":"2023-10-01T07:51:57.303139+0000","last_undegraded":"2023-10-01T07:51:57.303139+0000","last_fullsized":"2023-10-01T07:51:57.303139+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.342916+0000","last_change":"2023-10-01T07:51:57.342916+0000","last_active":"2023-10-01T07:51:57.342916+0000","last_peered":"2023-10-01T07:51:57.342916+0000","last_clean":"2023-10-01T07:51:57.342916+0000","last_became_active":"2023-10-01T07:51:57.342653+0000","last_became_peered":"2023-10-01T07:51:57.342653+0000","last_unstale":"2023-10-01T07:51:57.342916+0000","last_undegraded":"2023-10-01T07:51:57.342916+0000","last_fullsized":"2023-10-01T07:51:57.342916+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.325920+0000","last_change":"2023-10-01T07:51:56.916437+0000","last_active":"2023-10-01T07:51:57.325920+0000","last_peered":"2023-10-01T07:51:57.325920+0000","last_clean":"2023-10-01T07:51:57.325920+0000","last_became_active":"2023-10-01T07:51:56.915935+0000","last_became_peered":"2023-10-01T07:51:56.915935+0000","last_unstale":"2023-10-01T07:51:57.325920+0000","last_undegraded":"2023-10-01T07:51:57.325920+0000","last_fullsized":"2023-10-01T07:51:57.325920+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.330536+0000","last_change":"2023-10-01T07:51:57.330536+0000","last_active":"2023-10-01T07:51:57.330536+0000","last_peered":"2023-10-01T07:51:57.330536+0000","last_clean":"2023-10-01T07:51:57.330536+0000","last_became_active":"2023-10-01T07:51:57.330151+0000","last_became_peered":"2023-10-01T07:51:57.330151+0000","last_unstale":"2023-10-01T07:51:57.330536+0000","last_undegraded":"2023-10-01T07:51:57.330536+0000","last_fullsized":"2023-10-01T07:51:57.330536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.322423+0000","last_change":"2023-10-01T07:51:56.922316+0000","last_active":"2023-10-01T07:51:57.322423+0000","last_peered":"2023-10-01T07:51:57.322423+0000","last_clean":"2023-10-01T07:51:57.322423+0000","last_became_active":"2023-10-01T07:51:56.922003+0000","last_became_peered":"2023-10-01T07:51:56.922003+0000","last_unstale":"2023-10-01T07:51:57.322423+0000","last_undegraded":"2023-10-01T07:51:57.322423+0000","last_fullsized":"2023-10-01T07:51:57.322423+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.341976+0000","last_change":"2023-10-01T07:51:57.341976+0000","last_active":"2023-10-01T07:51:57.341976+0000","last_peered":"2023-10-01T07:51:57.341976+0000","last_clean":"2023-10-01T07:51:57.341976+0000","last_became_active":"2023-10-01T07:51:57.341188+0000","last_became_peered":"2023-10-01T07:51:57.341188+0000","last_unstale":"2023-10-01T07:51:57.341976+0000","last_undegraded":"2023-10-01T07:51:57.341976+0000","last_fullsized":"2023-10-01T07:51:57.341976+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.342897+0000","last_change":"2023-10-01T07:51:56.925522+0000","last_active":"2023-10-01T07:51:57.342897+0000","last_peered":"2023-10-01T07:51:57.342897+0000","last_clean":"2023-10-01T07:51:57.342897+0000","last_became_active":"2023-10-01T07:51:56.924830+0000","last_became_peered":"2023-10-01T07:51:56.924830+0000","last_unstale":"2023-10-01T07:51:57.342897+0000","last_undegraded":"2023-10-01T07:51:57.342897+0000","last_fullsized":"2023-10-01T07:51:57.342897+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.340653+0000","last_change":"2023-10-01T07:51:57.340653+0000","last_active":"2023-10-01T07:51:57.340653+0000","last_peered":"2023-10-01T07:51:57.340653+0000","last_clean":"2023-10-01T07:51:57.340653+0000","last_became_active":"2023-10-01T07:51:57.340395+0000","last_became_peered":"2023-10-01T07:51:57.340395+0000","last_unstale":"2023-10-01T07:51:57.340653+0000","last_undegraded":"2023-10-01T07:51:57.340653+0000","last_fullsized":"2023-10-01T07:51:57.340653+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.338671+0000","last_change":"2023-10-01T07:51:56.924298+0000","last_active":"2023-10-01T07:51:57.338671+0000","last_peered":"2023-10-01T07:51:57.338671+0000","last_clean":"2023-10-01T07:51:57.338671+0000","last_became_active":"2023-10-01T07:51:56.923975+0000","last_became_peered":"2023-10-01T07:51:56.923975+0000","last_unstale":"2023-10-01T07:51:57.338671+0000","last_undegraded":"2023-10-01T07:51:57.338671+0000","last_fullsized":"2023-10-01T07:51:57.338671+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.347457+0000","last_change":"2023-10-01T07:51:57.339026+0000","last_active":"2023-10-01T07:51:57.347457+0000","last_peered":"2023-10-01T07:51:57.347457+0000","last_clean":"2023-10-01T07:51:57.347457+0000","last_became_active":"2023-10-01T07:51:57.338722+0000","last_became_peered":"2023-10-01T07:51:57.338722+0000","last_unstale":"2023-10-01T07:51:57.347457+0000","last_undegraded":"2023-10-01T07:51:57.347457+0000","last_fullsized":"2023-10-01T07:51:57.347457+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335116+0000","last_change":"2023-10-01T07:51:56.922677+0000","last_active":"2023-10-01T07:51:57.335116+0000","last_peered":"2023-10-01T07:51:57.335116+0000","last_clean":"2023-10-01T07:51:57.335116+0000","last_became_active":"2023-10-01T07:51:56.922121+0000","last_became_peered":"2023-10-01T07:51:56.922121+0000","last_unstale":"2023-10-01T07:51:57.335116+0000","last_undegraded":"2023-10-01T07:51:57.335116+0000","last_fullsized":"2023-10-01T07:51:57.335116+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.329519+0000","last_change":"2023-10-01T07:51:57.329519+0000","last_active":"2023-10-01T07:51:57.329519+0000","last_peered":"2023-10-01T07:51:57.329519+0000","last_clean":"2023-10-01T07:51:57.329519+0000","last_became_active":"2023-10-01T07:51:57.329191+0000","last_became_peered":"2023-10-01T07:51:57.329191+0000","last_unstale":"2023-10-01T07:51:57.329519+0000","last_undegraded":"2023-10-01T07:51:57.329519+0000","last_fullsized":"2023-10-01T07:51:57.329519+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335155+0000","last_change":"2023-10-01T07:51:57.320100+0000","last_active":"2023-10-01T07:51:57.335155+0000","last_peered":"2023-10-01T07:51:57.335155+0000","last_clean":"2023-10-01T07:51:57.335155+0000","last_became_active":"2023-10-01T07:51:57.319593+0000","last_became_peered":"2023-10-01T07:51:57.319593+0000","last_unstale":"2023-10-01T07:51:57.335155+0000","last_undegraded":"2023-10-01T07:51:57.335155+0000","last_fullsized":"2023-10-01T07:51:57.335155+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345109+0000","last_change":"2023-10-01T07:51:57.325707+0000","last_active":"2023-10-01T07:51:57.345109+0000","last_peered":"2023-10-01T07:51:57.345109+0000","last_clean":"2023-10-01T07:51:57.345109+0000","last_became_active":"2023-10-01T07:51:57.324870+0000","last_became_peered":"2023-10-01T07:51:57.324870+0000","last_unstale":"2023-10-01T07:51:57.345109+0000","last_undegraded":"2023-10-01T07:51:57.345109+0000","last_fullsized":"2023-10-01T07:51:57.345109+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.334378+0000","last_change":"2023-10-01T07:51:57.326270+0000","last_active":"2023-10-01T07:51:57.334378+0000","last_peered":"2023-10-01T07:51:57.334378+0000","last_clean":"2023-10-01T07:51:57.334378+0000","last_became_active":"2023-10-01T07:51:57.325956+0000","last_became_peered":"2023-10-01T07:51:57.325956+0000","last_unstale":"2023-10-01T07:51:57.334378+0000","last_undegraded":"2023-10-01T07:51:57.334378+0000","last_fullsized":"2023-10-01T07:51:57.334378+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.344374+0000","last_change":"2023-10-01T07:51:57.338041+0000","last_active":"2023-10-01T07:51:57.344374+0000","last_peered":"2023-10-01T07:51:57.344374+0000","last_clean":"2023-10-01T07:51:57.344374+0000","last_became_active":"2023-10-01T07:51:57.337719+0000","last_became_peered":"2023-10-01T07:51:57.337719+0000","last_unstale":"2023-10-01T07:51:57.344374+0000","last_undegraded":"2023-10-01T07:51:57.344374+0000","last_fullsized":"2023-10-01T07:51:57.344374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.329368+0000","last_change":"2023-10-01T07:51:57.319429+0000","last_active":"2023-10-01T07:51:57.329368+0000","last_peered":"2023-10-01T07:51:57.329368+0000","last_clean":"2023-10-01T07:51:57.329368+0000","last_became_active":"2023-10-01T07:51:57.318849+0000","last_became_peered":"2023-10-01T07:51:57.318849+0000","last_unstale":"2023-10-01T07:51:57.329368+0000","last_undegraded":"2023-10-01T07:51:57.329368+0000","last_fullsized":"2023-10-01T07:51:57.329368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297264,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074576,"statfs":{"total":96636764160,"available":96332365824,"internally_reserved":0,"allocated":172032,"data_stored":48929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]}]},{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297244,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074596,"statfs":{"total":96636764160,"available":96332386304,"internally_reserved":0,"allocated":151552,"data_stored":44462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297248,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074592,"statfs":{"total":96636764160,"available":96332382208,"internally_reserved":0,"allocated":155648,"data_stored":43626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297244,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074596,"statfs":{"total":96636764160,"available":96332386304,"internally_reserved":0,"allocated":151552,"data_stored":43572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-01T07:52:02.134 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-01T07:52:02.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.300+0000 7f4f34f75700 1 Processor -- start 2023-10-01T07:52:02.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.300+0000 7f4f34f75700 1 -- start start 2023-10-01T07:52:02.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.301+0000 7f4f34f75700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4f30067940 0x7f4f30097310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:02.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.301+0000 7f4f34f75700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4f30097800 0x7f4f30130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:02.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.301+0000 7f4f34f75700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f30068df0 con 0x7f4f30096820 2023-10-01T07:52:02.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.301+0000 7f4f34f75700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3006a4c0 con 0x7f4f30097800 2023-10-01T07:52:02.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.301+0000 7f4f34f75700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f30098260 con 0x7f4f30067940 2023-10-01T07:52:02.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.301+0000 7f4f2ed9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4f30097800 0x7f4f30130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:02.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.301+0000 7f4f2dd9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4f30067940 0x7f4f30097310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:02.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.301+0000 7f4f2ed9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4f30097800 0x7f4f30130280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38024/0 (socket says 172.21.15.26:38024) 2023-10-01T07:52:02.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.301+0000 7f4f2e59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4f30096820 0x7f4f30096c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37926/0 (socket says 172.21.15.26:37926) 2023-10-01T07:52:02.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.301+0000 7f4f2ed9d700 1 -- 172.21.15.26:0/3668511697 learned_addr learned my addr 172.21.15.26:0/3668511697 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:02.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.301+0000 7f4f2ed9d700 1 -- 172.21.15.26:0/3668511697 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4f30067940 msgr2=0x7f4f30097310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.301+0000 7f4f2ed9d700 1 --2- 172.21.15.26:0/3668511697 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4f30067940 0x7f4f30097310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.301+0000 7f4f2ed9d700 1 -- 172.21.15.26:0/3668511697 >> v1:172.21.15.26:6789/0 conn(0x7f4f30096820 legacy=0x7f4f30096c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.301+0000 7f4f2ed9d700 1 -- 172.21.15.26:0/3668511697 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f30097c70 con 0x7f4f30097800 2023-10-01T07:52:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.301+0000 7f4f2d59a700 1 -- 172.21.15.26:0/3668511697 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 211919474 0 0) 0x7f4f30068df0 con 0x7f4f30096820 2023-10-01T07:52:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.301+0000 7f4f2dd9b700 1 --2- 172.21.15.26:0/3668511697 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4f30067940 0x7f4f30097310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.301+0000 7f4f2ed9d700 1 --2- 172.21.15.26:0/3668511697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f30097800 0x7f4f30130280 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f4f28009f20 tx=0x7f4f28009840).ready entity=mon.0 client_cookie=fb7ac80f85e19712 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.302+0000 7f4f2d59a700 1 -- 172.21.15.26:0/3668511697 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2800e070 con 0x7f4f30097800 2023-10-01T07:52:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.302+0000 7f4f2d59a700 1 -- 172.21.15.26:0/3668511697 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2800b9d0 con 0x7f4f30097800 2023-10-01T07:52:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.302+0000 7f4f2d59a700 1 -- 172.21.15.26:0/3668511697 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2800bd50 con 0x7f4f30097800 2023-10-01T07:52:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.302+0000 7f4f34f75700 1 -- 172.21.15.26:0/3668511697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f30097800 msgr2=0x7f4f30130280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.302+0000 7f4f34f75700 1 --2- 172.21.15.26:0/3668511697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f30097800 0x7f4f30130280 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f4f28009f20 tx=0x7f4f28009840).stop 2023-10-01T07:52:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.302+0000 7f4f34f75700 1 -- 172.21.15.26:0/3668511697 shutdown_connections 2023-10-01T07:52:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.302+0000 7f4f34f75700 1 --2- 172.21.15.26:0/3668511697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f30097800 0x7f4f30130280 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:02.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.302+0000 7f4f34f75700 1 --2- 172.21.15.26:0/3668511697 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4f30067940 0x7f4f30097310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:02.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.302+0000 7f4f34f75700 1 -- 172.21.15.26:0/3668511697 >> 172.21.15.26:0/3668511697 conn(0x7f4f3009ba50 msgr2=0x7f4f3009be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:02.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.302+0000 7f4f34f75700 1 -- 172.21.15.26:0/3668511697 shutdown_connections 2023-10-01T07:52:02.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.302+0000 7f4f34f75700 1 -- 172.21.15.26:0/3668511697 wait complete. 2023-10-01T07:52:02.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.304+0000 7f4f34f75700 1 Processor -- start 2023-10-01T07:52:02.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.304+0000 7f4f34f75700 1 -- start start 2023-10-01T07:52:02.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.304+0000 7f4f34f75700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4f30067940 0x7f4f30117eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:02.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.304+0000 7f4f34f75700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4f30096820 0x7f4f301183a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:02.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.304+0000 7f4f34f75700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f30097800 0x7f4f30118890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:02.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.304+0000 7f4f34f75700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f30130080 con 0x7f4f30097800 2023-10-01T07:52:02.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.304+0000 7f4f34f75700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3011a570 con 0x7f4f30067940 2023-10-01T07:52:02.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.304+0000 7f4f34f75700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f30067e30 con 0x7f4f30096820 2023-10-01T07:52:02.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.304+0000 7f4f2ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f30097800 0x7f4f30118890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:02.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.305+0000 7f4f2dd9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4f30096820 0x7f4f301183a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:02.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.305+0000 7f4f2ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f30097800 0x7f4f30118890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38026/0 (socket says 172.21.15.26:38026) 2023-10-01T07:52:02.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.305+0000 7f4f2ed9d700 1 -- 172.21.15.26:0/1643924127 learned_addr learned my addr 172.21.15.26:0/1643924127 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:02.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.305+0000 7f4f2e59c700 1 --2- 172.21.15.26:0/1643924127 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4f30067940 0x7f4f30117eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:02.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.305+0000 7f4f2ed9d700 1 -- 172.21.15.26:0/1643924127 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4f30096820 msgr2=0x7f4f301183a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:02.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.305+0000 7f4f2ed9d700 1 --2- 172.21.15.26:0/1643924127 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4f30096820 0x7f4f301183a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:02.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.305+0000 7f4f2ed9d700 1 -- 172.21.15.26:0/1643924127 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4f30067940 msgr2=0x7f4f30117eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:02.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.305+0000 7f4f2ed9d700 1 --2- 172.21.15.26:0/1643924127 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4f30067940 0x7f4f30117eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:02.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.305+0000 7f4f2ed9d700 1 -- 172.21.15.26:0/1643924127 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f240092a0 con 0x7f4f30097800 2023-10-01T07:52:02.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.305+0000 7f4f2ed9d700 1 --2- 172.21.15.26:0/1643924127 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f30097800 0x7f4f30118890 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f4f28009880 tx=0x7f4f30068130).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:02.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.305+0000 7f4f1e7fc700 1 -- 172.21.15.26:0/1643924127 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f280092e0 con 0x7f4f30097800 2023-10-01T07:52:02.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.305+0000 7f4f1e7fc700 1 -- 172.21.15.26:0/1643924127 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2801e470 con 0x7f4f30097800 2023-10-01T07:52:02.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.305+0000 7f4f34f75700 1 -- 172.21.15.26:0/1643924127 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f28009ae0 con 0x7f4f30097800 2023-10-01T07:52:02.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.305+0000 7f4f1e7fc700 1 -- 172.21.15.26:0/1643924127 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2801e830 con 0x7f4f30097800 2023-10-01T07:52:02.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.306+0000 7f4f34f75700 1 -- 172.21.15.26:0/1643924127 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3011c0c0 con 0x7f4f30097800 2023-10-01T07:52:02.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.307+0000 7f4f34f75700 1 -- 172.21.15.26:0/1643924127 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f3005a260 con 0x7f4f30097800 2023-10-01T07:52:02.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.308+0000 7f4f1e7fc700 1 -- 172.21.15.26:0/1643924127 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f4f28003040 con 0x7f4f30097800 2023-10-01T07:52:02.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.308+0000 7f4f1e7fc700 1 -- 172.21.15.26:0/1643924127 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f4f2803c900 con 0x7f4f30097800 2023-10-01T07:52:02.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.312+0000 7f4f1e7fc700 1 -- 172.21.15.26:0/1643924127 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f4f2801dda0 con 0x7f4f30097800 2023-10-01T07:52:02.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.554+0000 7f4f34f75700 1 -- 172.21.15.26:0/1643924127 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f4f30046c20 con 0x7f4f30097800 2023-10-01T07:52:02.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.555+0000 7f4f1e7fc700 1 -- 172.21.15.26:0/1643924127 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1014 (secure 0 0 0) 0x7f4f28023070 con 0x7f4f30097800 2023-10-01T07:52:02.555 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:52:02.556 INFO:teuthology.orchestra.run.smithi026.stdout:{"fsid":"c29fb19d-520c-42a6-90f4-e7f86de96e8e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":21,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":17,"num_osds":4,"num_up_osds":4,"osd_up_since":1696146708,"num_in_osds":4,"osd_in_since":1696146702,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":21,"data_bytes":2306,"bytes_used":1217536000,"bytes_avail":385329520640,"bytes_total":386547056640,"write_bytes_sec":5118,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4189}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-10-01T07:51:40.703391+0000","services":{}},"progress_events":{}} 2023-10-01T07:52:02.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.557+0000 7f4f34f75700 1 -- 172.21.15.26:0/1643924127 >> v1:172.21.15.26:6816/118178 conn(0x7f4f1002bb90 legacy=0x7f4f1002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:02.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.557+0000 7f4f34f75700 1 -- 172.21.15.26:0/1643924127 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f30097800 msgr2=0x7f4f30118890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:02.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.557+0000 7f4f34f75700 1 --2- 172.21.15.26:0/1643924127 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f30097800 0x7f4f30118890 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f4f28009880 tx=0x7f4f30068130).stop 2023-10-01T07:52:02.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.557+0000 7f4f34f75700 1 -- 172.21.15.26:0/1643924127 shutdown_connections 2023-10-01T07:52:02.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.557+0000 7f4f34f75700 1 --2- 172.21.15.26:0/1643924127 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f30097800 0x7f4f30118890 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:02.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.557+0000 7f4f34f75700 1 --2- 172.21.15.26:0/1643924127 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4f30067940 0x7f4f30117eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:02.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.557+0000 7f4f34f75700 1 --2- 172.21.15.26:0/1643924127 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4f30096820 0x7f4f301183a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:02.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.557+0000 7f4f34f75700 1 -- 172.21.15.26:0/1643924127 >> 172.21.15.26:0/1643924127 conn(0x7f4f3009ba50 msgr2=0x7f4f30094f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:02.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.557+0000 7f4f34f75700 1 -- 172.21.15.26:0/1643924127 shutdown_connections 2023-10-01T07:52:02.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.557+0000 7f4f34f75700 1 -- 172.21.15.26:0/1643924127 wait complete. 2023-10-01T07:52:02.570 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-01T07:52:02.570 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-01T07:52:02.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.700+0000 7f2713879700 1 Processor -- start 2023-10-01T07:52:02.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.700+0000 7f2713879700 1 -- start start 2023-10-01T07:52:02.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.701+0000 7f2713879700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f270c0965e0 0x7f270c0969c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:02.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.701+0000 7f2713879700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f270c096eb0 0x7f270c067de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:02.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.701+0000 7f2713879700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f270c0682d0 0x7f270c068720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:02.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.701+0000 7f2713879700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f270c068c10 con 0x7f270c0682d0 2023-10-01T07:52:02.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.701+0000 7f2713879700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f270c0933b0 con 0x7f270c0965e0 2023-10-01T07:52:02.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.701+0000 7f2713879700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f270c092190 con 0x7f270c096eb0 2023-10-01T07:52:02.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.701+0000 7f2711615700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f270c0965e0 0x7f270c0969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:02.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.701+0000 7f2710e14700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f270c096eb0 0x7f270c067de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:02.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.701+0000 7f2711e16700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f270c0682d0 0x7f270c068720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:02.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.701+0000 7f2711615700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f270c0965e0 0x7f270c0969c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44050/0 (socket says 172.21.15.26:44050) 2023-10-01T07:52:02.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.701+0000 7f2710e14700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f270c096eb0 0x7f270c067de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59612/0 (socket says 172.21.15.26:59612) 2023-10-01T07:52:02.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.701+0000 7f2711e16700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f270c0682d0 0x7f270c068720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38040/0 (socket says 172.21.15.26:38040) 2023-10-01T07:52:02.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.701+0000 7f2710e14700 1 -- 172.21.15.26:0/2630523982 learned_addr learned my addr 172.21.15.26:0/2630523982 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:02.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.701+0000 7f2711615700 1 -- 172.21.15.26:0/2630523982 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f270c096eb0 msgr2=0x7f270c067de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:02.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.701+0000 7f2711615700 1 --2- 172.21.15.26:0/2630523982 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f270c096eb0 0x7f270c067de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:02.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.701+0000 7f2711615700 1 -- 172.21.15.26:0/2630523982 >> v2:172.21.15.26:3300/0 conn(0x7f270c0682d0 msgr2=0x7f270c068720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:02.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.701+0000 7f2711615700 1 --2- 172.21.15.26:0/2630523982 >> v2:172.21.15.26:3300/0 conn(0x7f270c0682d0 0x7f270c068720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:02.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.701+0000 7f2711615700 1 -- 172.21.15.26:0/2630523982 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f270c069a20 con 0x7f270c0965e0 2023-10-01T07:52:02.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.701+0000 7f2710e14700 1 --2- 172.21.15.26:0/2630523982 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f270c096eb0 0x7f270c067de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:02.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.701+0000 7f2711e16700 1 --2- 172.21.15.26:0/2630523982 >> v2:172.21.15.26:3300/0 conn(0x7f270c0682d0 0x7f270c068720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:02.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.701+0000 7f2711615700 1 --2- 172.21.15.26:0/2630523982 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f270c0965e0 0x7f270c0969c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f26fc009760 tx=0x7f26fc009060).ready entity=mon.1 client_cookie=1c0ec5b92b73728e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:02.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.702+0000 7f2703fff700 1 -- 172.21.15.26:0/2630523982 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc00d4a0 con 0x7f270c0965e0 2023-10-01T07:52:02.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.702+0000 7f2703fff700 1 -- 172.21.15.26:0/2630523982 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26fc00d600 con 0x7f270c0965e0 2023-10-01T07:52:02.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.702+0000 7f2703fff700 1 -- 172.21.15.26:0/2630523982 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc00d980 con 0x7f270c0965e0 2023-10-01T07:52:02.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.702+0000 7f2713879700 1 -- 172.21.15.26:0/2630523982 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f270c0965e0 msgr2=0x7f270c0969c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:02.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.702+0000 7f2713879700 1 --2- 172.21.15.26:0/2630523982 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f270c0965e0 0x7f270c0969c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f26fc009760 tx=0x7f26fc009060).stop 2023-10-01T07:52:02.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.702+0000 7f2713879700 1 -- 172.21.15.26:0/2630523982 shutdown_connections 2023-10-01T07:52:02.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.702+0000 7f2713879700 1 --2- 172.21.15.26:0/2630523982 >> v2:172.21.15.26:3300/0 conn(0x7f270c0682d0 0x7f270c068720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:02.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.702+0000 7f2713879700 1 --2- 172.21.15.26:0/2630523982 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f270c0965e0 0x7f270c0969c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:02.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.702+0000 7f2713879700 1 --2- 172.21.15.26:0/2630523982 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f270c096eb0 0x7f270c067de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:02.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.702+0000 7f2713879700 1 -- 172.21.15.26:0/2630523982 >> 172.21.15.26:0/2630523982 conn(0x7f270c09a220 msgr2=0x7f270c09a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:02.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.702+0000 7f2713879700 1 -- 172.21.15.26:0/2630523982 shutdown_connections 2023-10-01T07:52:02.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.702+0000 7f2713879700 1 -- 172.21.15.26:0/2630523982 wait complete. 2023-10-01T07:52:02.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.703+0000 7f2713879700 1 Processor -- start 2023-10-01T07:52:02.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.703+0000 7f2713879700 1 -- start start 2023-10-01T07:52:02.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.704+0000 7f2713879700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f270c0682d0 0x7f270c1271f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:02.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.704+0000 7f2713879700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f270c0965e0 0x7f270c11a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:02.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.704+0000 7f2713879700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f270c096eb0 0x7f270c11a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:02.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.704+0000 7f2713879700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270c11b5f0 con 0x7f270c0682d0 2023-10-01T07:52:02.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.704+0000 7f2713879700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f270c11c790 con 0x7f270c096eb0 2023-10-01T07:52:02.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.704+0000 7f2713879700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f270c091c20 con 0x7f270c0965e0 2023-10-01T07:52:02.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.704+0000 7f2711615700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f270c0682d0 0x7f270c1271f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:02.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.704+0000 7f2711e16700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f270c096eb0 0x7f270c11a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:02.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.704+0000 7f2711615700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f270c0682d0 0x7f270c1271f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38056/0 (socket says 172.21.15.26:38056) 2023-10-01T07:52:02.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.704+0000 7f2711615700 1 -- 172.21.15.26:0/1814817383 learned_addr learned my addr 172.21.15.26:0/1814817383 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:02.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.704+0000 7f2710e14700 1 --2- 172.21.15.26:0/1814817383 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f270c0965e0 0x7f270c11a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:02.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.704+0000 7f2711e16700 1 -- 172.21.15.26:0/1814817383 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f270c0965e0 msgr2=0x7f270c11a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:02.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.704+0000 7f2711e16700 1 --2- 172.21.15.26:0/1814817383 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f270c0965e0 0x7f270c11a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:02.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.705+0000 7f2711e16700 1 -- 172.21.15.26:0/1814817383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f270c0682d0 msgr2=0x7f270c1271f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:02.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.705+0000 7f2711e16700 1 --2- 172.21.15.26:0/1814817383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f270c0682d0 0x7f270c1271f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:02.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.705+0000 7f2711e16700 1 -- 172.21.15.26:0/1814817383 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2704009a20 con 0x7f270c096eb0 2023-10-01T07:52:02.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.705+0000 7f2711615700 1 --2- 172.21.15.26:0/1814817383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f270c0682d0 0x7f270c1271f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:02.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.705+0000 7f2710e14700 1 --2- 172.21.15.26:0/1814817383 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f270c0965e0 0x7f270c11a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:02.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.705+0000 7f2711e16700 1 --2- 172.21.15.26:0/1814817383 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f270c096eb0 0x7f270c11a610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f2704009f10 tx=0x7f270400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:02.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.705+0000 7f27017fa700 1 -- 172.21.15.26:0/1814817383 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270400cb70 con 0x7f270c096eb0 2023-10-01T07:52:02.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.705+0000 7f27017fa700 1 -- 172.21.15.26:0/1814817383 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270400f040 con 0x7f270c096eb0 2023-10-01T07:52:02.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.705+0000 7f2713879700 1 -- 172.21.15.26:0/1814817383 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f270800b610 con 0x7f270c096eb0 2023-10-01T07:52:02.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.705+0000 7f27017fa700 1 -- 172.21.15.26:0/1814817383 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2704013400 con 0x7f270c096eb0 2023-10-01T07:52:02.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.705+0000 7f2713879700 1 -- 172.21.15.26:0/1814817383 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26fc0092a0 con 0x7f270c096eb0 2023-10-01T07:52:02.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.706+0000 7f27017fa700 1 -- 172.21.15.26:0/1814817383 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f27040137f0 con 0x7f270c096eb0 2023-10-01T07:52:02.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.706+0000 7f27017fa700 1 -- 172.21.15.26:0/1814817383 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f270403b940 con 0x7f270c096eb0 2023-10-01T07:52:02.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.706+0000 7f2713879700 1 -- 172.21.15.26:0/1814817383 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f270c05a260 con 0x7f270c096eb0 2023-10-01T07:52:02.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.711+0000 7f27017fa700 1 -- 172.21.15.26:0/1814817383 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f2704013aa0 con 0x7f270c096eb0 2023-10-01T07:52:02.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.880+0000 7f2713879700 1 -- 172.21.15.26:0/1814817383 --> v1:172.21.15.26:6816/118178 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f270c11af20 con 0x7f26f002bb30 2023-10-01T07:52:02.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.887+0000 7f27017fa700 1 -- 172.21.15.26:0/1814817383 <== mgr.4107 v1:172.21.15.26:6816/118178 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250014 (unknown 2965378022 0 3678127906) 0x7f270c11af20 con 0x7f26f002bb30 2023-10-01T07:52:02.890 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:52:02.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.890+0000 7f2713879700 1 -- 172.21.15.26:0/1814817383 >> v1:172.21.15.26:6816/118178 conn(0x7f26f002bb30 legacy=0x7f26f002dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:02.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.890+0000 7f2713879700 1 -- 172.21.15.26:0/1814817383 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f270c096eb0 msgr2=0x7f270c11a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:02.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.890+0000 7f2713879700 1 --2- 172.21.15.26:0/1814817383 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f270c096eb0 0x7f270c11a610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f2704009f10 tx=0x7f270400b040).stop 2023-10-01T07:52:02.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.891+0000 7f2713879700 1 -- 172.21.15.26:0/1814817383 shutdown_connections 2023-10-01T07:52:02.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.891+0000 7f2713879700 1 --2- 172.21.15.26:0/1814817383 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f270c096eb0 0x7f270c11a610 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:02.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.891+0000 7f2713879700 1 --2- 172.21.15.26:0/1814817383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f270c0682d0 0x7f270c1271f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:02.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.891+0000 7f2713879700 1 --2- 172.21.15.26:0/1814817383 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f270c0965e0 0x7f270c11a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:02.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.891+0000 7f2713879700 1 -- 172.21.15.26:0/1814817383 >> 172.21.15.26:0/1814817383 conn(0x7f270c09a220 msgr2=0x7f270c065cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:02.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.891+0000 7f2713879700 1 -- 172.21.15.26:0/1814817383 shutdown_connections 2023-10-01T07:52:02.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:02.891+0000 7f2713879700 1 -- 172.21.15.26:0/1814817383 wait complete. 2023-10-01T07:52:02.893 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-01T07:52:02.904 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-01T07:52:01.807370+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":133,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189000,"kb_used_data":616,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298360,"statfs":{"total":386547056640,"available":385329520640,"internally_reserved":0,"allocated":630784,"data_stored":180589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1640,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000470"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.340051+0000","last_change":"2023-10-01T07:51:57.340051+0000","last_active":"2023-10-01T07:51:57.340051+0000","last_peered":"2023-10-01T07:51:57.340051+0000","last_clean":"2023-10-01T07:51:57.340051+0000","last_became_active":"2023-10-01T07:51:57.339739+0000","last_became_peered":"2023-10-01T07:51:57.339739+0000","last_unstale":"2023-10-01T07:51:57.340051+0000","last_undegraded":"2023-10-01T07:51:57.340051+0000","last_fullsized":"2023-10-01T07:51:57.340051+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.330147+0000","last_change":"2023-10-01T07:51:57.330147+0000","last_active":"2023-10-01T07:51:57.330147+0000","last_peered":"2023-10-01T07:51:57.330147+0000","last_clean":"2023-10-01T07:51:57.330147+0000","last_became_active":"2023-10-01T07:51:57.329793+0000","last_became_peered":"2023-10-01T07:51:57.329793+0000","last_unstale":"2023-10-01T07:51:57.330147+0000","last_undegraded":"2023-10-01T07:51:57.330147+0000","last_fullsized":"2023-10-01T07:51:57.330147+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.343537+0000","last_change":"2023-10-01T07:51:57.335404+0000","last_active":"2023-10-01T07:51:57.343537+0000","last_peered":"2023-10-01T07:51:57.343537+0000","last_clean":"2023-10-01T07:51:57.343537+0000","last_became_active":"2023-10-01T07:51:57.329225+0000","last_became_peered":"2023-10-01T07:51:57.329225+0000","last_unstale":"2023-10-01T07:51:57.343537+0000","last_undegraded":"2023-10-01T07:51:57.343537+0000","last_fullsized":"2023-10-01T07:51:57.343537+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.337475+0000","last_change":"2023-10-01T07:51:57.332237+0000","last_active":"2023-10-01T07:51:57.337475+0000","last_peered":"2023-10-01T07:51:57.337475+0000","last_clean":"2023-10-01T07:51:57.337475+0000","last_became_active":"2023-10-01T07:51:57.331857+0000","last_became_peered":"2023-10-01T07:51:57.331857+0000","last_unstale":"2023-10-01T07:51:57.337475+0000","last_undegraded":"2023-10-01T07:51:57.337475+0000","last_fullsized":"2023-10-01T07:51:57.337475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335610+0000","last_change":"2023-10-01T07:51:57.326512+0000","last_active":"2023-10-01T07:51:57.335610+0000","last_peered":"2023-10-01T07:51:57.335610+0000","last_clean":"2023-10-01T07:51:57.335610+0000","last_became_active":"2023-10-01T07:51:57.326202+0000","last_became_peered":"2023-10-01T07:51:57.326202+0000","last_unstale":"2023-10-01T07:51:57.335610+0000","last_undegraded":"2023-10-01T07:51:57.335610+0000","last_fullsized":"2023-10-01T07:51:57.335610+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345080+0000","last_change":"2023-10-01T07:51:57.323824+0000","last_active":"2023-10-01T07:51:57.345080+0000","last_peered":"2023-10-01T07:51:57.345080+0000","last_clean":"2023-10-01T07:51:57.345080+0000","last_became_active":"2023-10-01T07:51:57.322857+0000","last_became_peered":"2023-10-01T07:51:57.322857+0000","last_unstale":"2023-10-01T07:51:57.345080+0000","last_undegraded":"2023-10-01T07:51:57.345080+0000","last_fullsized":"2023-10-01T07:51:57.345080+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345129+0000","last_change":"2023-10-01T07:51:57.325909+0000","last_active":"2023-10-01T07:51:57.345129+0000","last_peered":"2023-10-01T07:51:57.345129+0000","last_clean":"2023-10-01T07:51:57.345129+0000","last_became_active":"2023-10-01T07:51:57.325226+0000","last_became_peered":"2023-10-01T07:51:57.325226+0000","last_unstale":"2023-10-01T07:51:57.345129+0000","last_undegraded":"2023-10-01T07:51:57.345129+0000","last_fullsized":"2023-10-01T07:51:57.345129+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335188+0000","last_change":"2023-10-01T07:51:57.323649+0000","last_active":"2023-10-01T07:51:57.335188+0000","last_peered":"2023-10-01T07:51:57.335188+0000","last_clean":"2023-10-01T07:51:57.335188+0000","last_became_active":"2023-10-01T07:51:57.319917+0000","last_became_peered":"2023-10-01T07:51:57.319917+0000","last_unstale":"2023-10-01T07:51:57.335188+0000","last_undegraded":"2023-10-01T07:51:57.335188+0000","last_fullsized":"2023-10-01T07:51:57.335188+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335645+0000","last_change":"2023-10-01T07:51:57.325845+0000","last_active":"2023-10-01T07:51:57.335645+0000","last_peered":"2023-10-01T07:51:57.335645+0000","last_clean":"2023-10-01T07:51:57.335645+0000","last_became_active":"2023-10-01T07:51:57.325346+0000","last_became_peered":"2023-10-01T07:51:57.325346+0000","last_unstale":"2023-10-01T07:51:57.335645+0000","last_undegraded":"2023-10-01T07:51:57.335645+0000","last_fullsized":"2023-10-01T07:51:57.335645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.337622+0000","last_change":"2023-10-01T07:51:57.328438+0000","last_active":"2023-10-01T07:51:57.337622+0000","last_peered":"2023-10-01T07:51:57.337622+0000","last_clean":"2023-10-01T07:51:57.337622+0000","last_became_active":"2023-10-01T07:51:57.328128+0000","last_became_peered":"2023-10-01T07:51:57.328128+0000","last_unstale":"2023-10-01T07:51:57.337622+0000","last_undegraded":"2023-10-01T07:51:57.337622+0000","last_fullsized":"2023-10-01T07:51:57.337622+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.333136+0000","last_change":"2023-10-01T07:51:57.328650+0000","last_active":"2023-10-01T07:51:57.333136+0000","last_peered":"2023-10-01T07:51:57.333136+0000","last_clean":"2023-10-01T07:51:57.333136+0000","last_became_active":"2023-10-01T07:51:57.328335+0000","last_became_peered":"2023-10-01T07:51:57.328335+0000","last_unstale":"2023-10-01T07:51:57.333136+0000","last_undegraded":"2023-10-01T07:51:57.333136+0000","last_fullsized":"2023-10-01T07:51:57.333136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.331991+0000","last_change":"2023-10-01T07:51:57.331991+0000","last_active":"2023-10-01T07:51:57.331991+0000","last_peered":"2023-10-01T07:51:57.331991+0000","last_clean":"2023-10-01T07:51:57.331991+0000","last_became_active":"2023-10-01T07:51:57.331698+0000","last_became_peered":"2023-10-01T07:51:57.331698+0000","last_unstale":"2023-10-01T07:51:57.331991+0000","last_undegraded":"2023-10-01T07:51:57.331991+0000","last_fullsized":"2023-10-01T07:51:57.331991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.342157+0000","last_change":"2023-10-01T07:51:57.342157+0000","last_active":"2023-10-01T07:51:57.342157+0000","last_peered":"2023-10-01T07:51:57.342157+0000","last_clean":"2023-10-01T07:51:57.342157+0000","last_became_active":"2023-10-01T07:51:57.341533+0000","last_became_peered":"2023-10-01T07:51:57.341533+0000","last_unstale":"2023-10-01T07:51:57.342157+0000","last_undegraded":"2023-10-01T07:51:57.342157+0000","last_fullsized":"2023-10-01T07:51:57.342157+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.323193+0000","last_change":"2023-10-01T07:51:57.318295+0000","last_active":"2023-10-01T07:51:57.323193+0000","last_peered":"2023-10-01T07:51:57.323193+0000","last_clean":"2023-10-01T07:51:57.323193+0000","last_became_active":"2023-10-01T07:51:57.317972+0000","last_became_peered":"2023-10-01T07:51:57.317972+0000","last_unstale":"2023-10-01T07:51:57.323193+0000","last_undegraded":"2023-10-01T07:51:57.323193+0000","last_fullsized":"2023-10-01T07:51:57.323193+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.334056+0000","last_change":"2023-10-01T07:51:57.321137+0000","last_active":"2023-10-01T07:51:57.334056+0000","last_peered":"2023-10-01T07:51:57.334056+0000","last_clean":"2023-10-01T07:51:57.334056+0000","last_became_active":"2023-10-01T07:51:57.320789+0000","last_became_peered":"2023-10-01T07:51:57.320789+0000","last_unstale":"2023-10-01T07:51:57.334056+0000","last_undegraded":"2023-10-01T07:51:57.334056+0000","last_fullsized":"2023-10-01T07:51:57.334056+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.346763+0000","last_change":"2023-10-01T07:51:57.325610+0000","last_active":"2023-10-01T07:51:57.346763+0000","last_peered":"2023-10-01T07:51:57.346763+0000","last_clean":"2023-10-01T07:51:57.346763+0000","last_became_active":"2023-10-01T07:51:57.325322+0000","last_became_peered":"2023-10-01T07:51:57.325322+0000","last_unstale":"2023-10-01T07:51:57.346763+0000","last_undegraded":"2023-10-01T07:51:57.346763+0000","last_fullsized":"2023-10-01T07:51:57.346763+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335623+0000","last_change":"2023-10-01T07:51:57.325641+0000","last_active":"2023-10-01T07:51:57.335623+0000","last_peered":"2023-10-01T07:51:57.335623+0000","last_clean":"2023-10-01T07:51:57.335623+0000","last_became_active":"2023-10-01T07:51:57.324956+0000","last_became_peered":"2023-10-01T07:51:57.324956+0000","last_unstale":"2023-10-01T07:51:57.335623+0000","last_undegraded":"2023-10-01T07:51:57.335623+0000","last_fullsized":"2023-10-01T07:51:57.335623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.321164+0000","last_change":"2023-10-01T07:51:57.316882+0000","last_active":"2023-10-01T07:51:57.321164+0000","last_peered":"2023-10-01T07:51:57.321164+0000","last_clean":"2023-10-01T07:51:57.321164+0000","last_became_active":"2023-10-01T07:51:57.316026+0000","last_became_peered":"2023-10-01T07:51:57.316026+0000","last_unstale":"2023-10-01T07:51:57.321164+0000","last_undegraded":"2023-10-01T07:51:57.321164+0000","last_fullsized":"2023-10-01T07:51:57.321164+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.340110+0000","last_change":"2023-10-01T07:51:57.340110+0000","last_active":"2023-10-01T07:51:57.340110+0000","last_peered":"2023-10-01T07:51:57.340110+0000","last_clean":"2023-10-01T07:51:57.340110+0000","last_became_active":"2023-10-01T07:51:57.339795+0000","last_became_peered":"2023-10-01T07:51:57.339795+0000","last_unstale":"2023-10-01T07:51:57.340110+0000","last_undegraded":"2023-10-01T07:51:57.340110+0000","last_fullsized":"2023-10-01T07:51:57.340110+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348821+0000","last_change":"2023-10-01T07:51:57.347691+0000","last_active":"2023-10-01T07:51:57.348821+0000","last_peered":"2023-10-01T07:51:57.348821+0000","last_clean":"2023-10-01T07:51:57.348821+0000","last_became_active":"2023-10-01T07:51:57.347374+0000","last_became_peered":"2023-10-01T07:51:57.347374+0000","last_unstale":"2023-10-01T07:51:57.348821+0000","last_undegraded":"2023-10-01T07:51:57.348821+0000","last_fullsized":"2023-10-01T07:51:57.348821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348551+0000","last_change":"2023-10-01T07:51:57.341479+0000","last_active":"2023-10-01T07:51:57.348551+0000","last_peered":"2023-10-01T07:51:57.348551+0000","last_clean":"2023-10-01T07:51:57.348551+0000","last_became_active":"2023-10-01T07:51:57.341064+0000","last_became_peered":"2023-10-01T07:51:57.341064+0000","last_unstale":"2023-10-01T07:51:57.348551+0000","last_undegraded":"2023-10-01T07:51:57.348551+0000","last_fullsized":"2023-10-01T07:51:57.348551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.338618+0000","last_change":"2023-10-01T07:51:57.332063+0000","last_active":"2023-10-01T07:51:57.338618+0000","last_peered":"2023-10-01T07:51:57.338618+0000","last_clean":"2023-10-01T07:51:57.338618+0000","last_became_active":"2023-10-01T07:51:57.331511+0000","last_became_peered":"2023-10-01T07:51:57.331511+0000","last_unstale":"2023-10-01T07:51:57.338618+0000","last_undegraded":"2023-10-01T07:51:57.338618+0000","last_fullsized":"2023-10-01T07:51:57.338618+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345085+0000","last_change":"2023-10-01T07:51:57.325516+0000","last_active":"2023-10-01T07:51:57.345085+0000","last_peered":"2023-10-01T07:51:57.345085+0000","last_clean":"2023-10-01T07:51:57.345085+0000","last_became_active":"2023-10-01T07:51:57.324549+0000","last_became_peered":"2023-10-01T07:51:57.324549+0000","last_unstale":"2023-10-01T07:51:57.345085+0000","last_undegraded":"2023-10-01T07:51:57.345085+0000","last_fullsized":"2023-10-01T07:51:57.345085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.336578+0000","last_change":"2023-10-01T07:51:57.334881+0000","last_active":"2023-10-01T07:51:57.336578+0000","last_peered":"2023-10-01T07:51:57.336578+0000","last_clean":"2023-10-01T07:51:57.336578+0000","last_became_active":"2023-10-01T07:51:57.334682+0000","last_became_peered":"2023-10-01T07:51:57.334682+0000","last_unstale":"2023-10-01T07:51:57.336578+0000","last_undegraded":"2023-10-01T07:51:57.336578+0000","last_fullsized":"2023-10-01T07:51:57.336578+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.336811+0000","last_change":"2023-10-01T07:51:57.334700+0000","last_active":"2023-10-01T07:51:57.336811+0000","last_peered":"2023-10-01T07:51:57.336811+0000","last_clean":"2023-10-01T07:51:57.336811+0000","last_became_active":"2023-10-01T07:51:57.334406+0000","last_became_peered":"2023-10-01T07:51:57.334406+0000","last_unstale":"2023-10-01T07:51:57.336811+0000","last_undegraded":"2023-10-01T07:51:57.336811+0000","last_fullsized":"2023-10-01T07:51:57.336811+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.337601+0000","last_change":"2023-10-01T07:51:57.323470+0000","last_active":"2023-10-01T07:51:57.337601+0000","last_peered":"2023-10-01T07:51:57.337601+0000","last_clean":"2023-10-01T07:51:57.337601+0000","last_became_active":"2023-10-01T07:51:57.323181+0000","last_became_peered":"2023-10-01T07:51:57.323181+0000","last_unstale":"2023-10-01T07:51:57.337601+0000","last_undegraded":"2023-10-01T07:51:57.337601+0000","last_fullsized":"2023-10-01T07:51:57.337601+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.347475+0000","last_change":"2023-10-01T07:51:57.339412+0000","last_active":"2023-10-01T07:51:57.347475+0000","last_peered":"2023-10-01T07:51:57.347475+0000","last_clean":"2023-10-01T07:51:57.347475+0000","last_became_active":"2023-10-01T07:51:57.338796+0000","last_became_peered":"2023-10-01T07:51:57.338796+0000","last_unstale":"2023-10-01T07:51:57.347475+0000","last_undegraded":"2023-10-01T07:51:57.347475+0000","last_fullsized":"2023-10-01T07:51:57.347475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.321447+0000","last_change":"2023-10-01T07:51:56.911245+0000","last_active":"2023-10-01T07:51:57.321447+0000","last_peered":"2023-10-01T07:51:57.321447+0000","last_clean":"2023-10-01T07:51:57.321447+0000","last_became_active":"2023-10-01T07:51:56.910930+0000","last_became_peered":"2023-10-01T07:51:56.910930+0000","last_unstale":"2023-10-01T07:51:57.321447+0000","last_undegraded":"2023-10-01T07:51:57.321447+0000","last_fullsized":"2023-10-01T07:51:57.321447+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348455+0000","last_change":"2023-10-01T07:51:57.343694+0000","last_active":"2023-10-01T07:51:57.348455+0000","last_peered":"2023-10-01T07:51:57.348455+0000","last_clean":"2023-10-01T07:51:57.348455+0000","last_became_active":"2023-10-01T07:51:57.343082+0000","last_became_peered":"2023-10-01T07:51:57.343082+0000","last_unstale":"2023-10-01T07:51:57.348455+0000","last_undegraded":"2023-10-01T07:51:57.348455+0000","last_fullsized":"2023-10-01T07:51:57.348455+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.310075+0000","last_change":"2023-10-01T07:51:56.919246+0000","last_active":"2023-10-01T07:51:57.310075+0000","last_peered":"2023-10-01T07:51:57.310075+0000","last_clean":"2023-10-01T07:51:57.310075+0000","last_became_active":"2023-10-01T07:51:56.918962+0000","last_became_peered":"2023-10-01T07:51:56.918962+0000","last_unstale":"2023-10-01T07:51:57.310075+0000","last_undegraded":"2023-10-01T07:51:57.310075+0000","last_fullsized":"2023-10-01T07:51:57.310075+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.338500+0000","last_change":"2023-10-01T07:51:57.335143+0000","last_active":"2023-10-01T07:51:57.338500+0000","last_peered":"2023-10-01T07:51:57.338500+0000","last_clean":"2023-10-01T07:51:57.338500+0000","last_became_active":"2023-10-01T07:51:57.334730+0000","last_became_peered":"2023-10-01T07:51:57.334730+0000","last_unstale":"2023-10-01T07:51:57.338500+0000","last_undegraded":"2023-10-01T07:51:57.338500+0000","last_fullsized":"2023-10-01T07:51:57.338500+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.309155+0000","last_change":"2023-10-01T07:51:56.914663+0000","last_active":"2023-10-01T07:51:57.309155+0000","last_peered":"2023-10-01T07:51:57.309155+0000","last_clean":"2023-10-01T07:51:57.309155+0000","last_became_active":"2023-10-01T07:51:56.914321+0000","last_became_peered":"2023-10-01T07:51:56.914321+0000","last_unstale":"2023-10-01T07:51:57.309155+0000","last_undegraded":"2023-10-01T07:51:57.309155+0000","last_fullsized":"2023-10-01T07:51:57.309155+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348872+0000","last_change":"2023-10-01T07:51:57.345818+0000","last_active":"2023-10-01T07:51:57.348872+0000","last_peered":"2023-10-01T07:51:57.348872+0000","last_clean":"2023-10-01T07:51:57.348872+0000","last_became_active":"2023-10-01T07:51:57.345561+0000","last_became_peered":"2023-10-01T07:51:57.345561+0000","last_unstale":"2023-10-01T07:51:57.348872+0000","last_undegraded":"2023-10-01T07:51:57.348872+0000","last_fullsized":"2023-10-01T07:51:57.348872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.305995+0000","last_change":"2023-10-01T07:51:56.916086+0000","last_active":"2023-10-01T07:51:57.305995+0000","last_peered":"2023-10-01T07:51:57.305995+0000","last_clean":"2023-10-01T07:51:57.305995+0000","last_became_active":"2023-10-01T07:51:56.912164+0000","last_became_peered":"2023-10-01T07:51:56.912164+0000","last_unstale":"2023-10-01T07:51:57.305995+0000","last_undegraded":"2023-10-01T07:51:57.305995+0000","last_fullsized":"2023-10-01T07:51:57.305995+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.347640+0000","last_change":"2023-10-01T07:51:57.340361+0000","last_active":"2023-10-01T07:51:57.347640+0000","last_peered":"2023-10-01T07:51:57.347640+0000","last_clean":"2023-10-01T07:51:57.347640+0000","last_became_active":"2023-10-01T07:51:57.339753+0000","last_became_peered":"2023-10-01T07:51:57.339753+0000","last_unstale":"2023-10-01T07:51:57.347640+0000","last_undegraded":"2023-10-01T07:51:57.347640+0000","last_fullsized":"2023-10-01T07:51:57.347640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-01T07:51:56.922083+0000","last_change":"2023-10-01T07:51:56.917428+0000","last_active":"2023-10-01T07:51:56.922083+0000","last_peered":"2023-10-01T07:51:56.922083+0000","last_clean":"2023-10-01T07:51:56.922083+0000","last_became_active":"2023-10-01T07:51:56.916781+0000","last_became_peered":"2023-10-01T07:51:56.916781+0000","last_unstale":"2023-10-01T07:51:56.922083+0000","last_undegraded":"2023-10-01T07:51:56.922083+0000","last_fullsized":"2023-10-01T07:51:56.922083+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.347478+0000","last_change":"2023-10-01T07:51:57.339022+0000","last_active":"2023-10-01T07:51:57.347478+0000","last_peered":"2023-10-01T07:51:57.347478+0000","last_clean":"2023-10-01T07:51:57.347478+0000","last_became_active":"2023-10-01T07:51:57.338710+0000","last_became_peered":"2023-10-01T07:51:57.338710+0000","last_unstale":"2023-10-01T07:51:57.347478+0000","last_undegraded":"2023-10-01T07:51:57.347478+0000","last_fullsized":"2023-10-01T07:51:57.347478+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345213+0000","last_change":"2023-10-01T07:51:56.914774+0000","last_active":"2023-10-01T07:51:57.345213+0000","last_peered":"2023-10-01T07:51:57.345213+0000","last_clean":"2023-10-01T07:51:57.345213+0000","last_became_active":"2023-10-01T07:51:56.912021+0000","last_became_peered":"2023-10-01T07:51:56.912021+0000","last_unstale":"2023-10-01T07:51:57.345213+0000","last_undegraded":"2023-10-01T07:51:57.345213+0000","last_fullsized":"2023-10-01T07:51:57.345213+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.333273+0000","last_change":"2023-10-01T07:51:57.331183+0000","last_active":"2023-10-01T07:51:57.333273+0000","last_peered":"2023-10-01T07:51:57.333273+0000","last_clean":"2023-10-01T07:51:57.333273+0000","last_became_active":"2023-10-01T07:51:57.330934+0000","last_became_peered":"2023-10-01T07:51:57.330934+0000","last_unstale":"2023-10-01T07:51:57.333273+0000","last_undegraded":"2023-10-01T07:51:57.333273+0000","last_fullsized":"2023-10-01T07:51:57.333273+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"16'6","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.350817+0000","last_change":"2023-10-01T07:51:56.925053+0000","last_active":"2023-10-01T07:51:57.350817+0000","last_peered":"2023-10-01T07:51:57.350817+0000","last_clean":"2023-10-01T07:51:57.350817+0000","last_became_active":"2023-10-01T07:51:56.924755+0000","last_became_peered":"2023-10-01T07:51:56.924755+0000","last_unstale":"2023-10-01T07:51:57.350817+0000","last_undegraded":"2023-10-01T07:51:57.350817+0000","last_fullsized":"2023-10-01T07:51:57.350817+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.341789+0000","last_change":"2023-10-01T07:51:57.341789+0000","last_active":"2023-10-01T07:51:57.341789+0000","last_peered":"2023-10-01T07:51:57.341789+0000","last_clean":"2023-10-01T07:51:57.341789+0000","last_became_active":"2023-10-01T07:51:57.340852+0000","last_became_peered":"2023-10-01T07:51:57.340852+0000","last_unstale":"2023-10-01T07:51:57.341789+0000","last_undegraded":"2023-10-01T07:51:57.341789+0000","last_fullsized":"2023-10-01T07:51:57.341789+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.344307+0000","last_change":"2023-10-01T07:51:56.924181+0000","last_active":"2023-10-01T07:51:57.344307+0000","last_peered":"2023-10-01T07:51:57.344307+0000","last_clean":"2023-10-01T07:51:57.344307+0000","last_became_active":"2023-10-01T07:51:56.923560+0000","last_became_peered":"2023-10-01T07:51:56.923560+0000","last_unstale":"2023-10-01T07:51:57.344307+0000","last_undegraded":"2023-10-01T07:51:57.344307+0000","last_fullsized":"2023-10-01T07:51:57.344307+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348258+0000","last_change":"2023-10-01T07:51:57.341678+0000","last_active":"2023-10-01T07:51:57.348258+0000","last_peered":"2023-10-01T07:51:57.348258+0000","last_clean":"2023-10-01T07:51:57.348258+0000","last_became_active":"2023-10-01T07:51:57.339190+0000","last_became_peered":"2023-10-01T07:51:57.339190+0000","last_unstale":"2023-10-01T07:51:57.348258+0000","last_undegraded":"2023-10-01T07:51:57.348258+0000","last_fullsized":"2023-10-01T07:51:57.348258+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.301106+0000","last_change":"2023-10-01T07:51:56.915181+0000","last_active":"2023-10-01T07:51:57.301106+0000","last_peered":"2023-10-01T07:51:57.301106+0000","last_clean":"2023-10-01T07:51:57.301106+0000","last_became_active":"2023-10-01T07:51:56.914858+0000","last_became_peered":"2023-10-01T07:51:56.914858+0000","last_unstale":"2023-10-01T07:51:57.301106+0000","last_undegraded":"2023-10-01T07:51:57.301106+0000","last_fullsized":"2023-10-01T07:51:57.301106+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.347494+0000","last_change":"2023-10-01T07:51:57.339439+0000","last_active":"2023-10-01T07:51:57.347494+0000","last_peered":"2023-10-01T07:51:57.347494+0000","last_clean":"2023-10-01T07:51:57.347494+0000","last_became_active":"2023-10-01T07:51:57.339208+0000","last_became_peered":"2023-10-01T07:51:57.339208+0000","last_unstale":"2023-10-01T07:51:57.347494+0000","last_undegraded":"2023-10-01T07:51:57.347494+0000","last_fullsized":"2023-10-01T07:51:57.347494+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.313566+0000","last_change":"2023-10-01T07:51:56.926432+0000","last_active":"2023-10-01T07:51:57.313566+0000","last_peered":"2023-10-01T07:51:57.313566+0000","last_clean":"2023-10-01T07:51:57.313566+0000","last_became_active":"2023-10-01T07:51:56.926080+0000","last_became_peered":"2023-10-01T07:51:56.926080+0000","last_unstale":"2023-10-01T07:51:57.313566+0000","last_undegraded":"2023-10-01T07:51:57.313566+0000","last_fullsized":"2023-10-01T07:51:57.313566+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335190+0000","last_change":"2023-10-01T07:51:57.325464+0000","last_active":"2023-10-01T07:51:57.335190+0000","last_peered":"2023-10-01T07:51:57.335190+0000","last_clean":"2023-10-01T07:51:57.335190+0000","last_became_active":"2023-10-01T07:51:57.325143+0000","last_became_peered":"2023-10-01T07:51:57.325143+0000","last_unstale":"2023-10-01T07:51:57.335190+0000","last_undegraded":"2023-10-01T07:51:57.335190+0000","last_fullsized":"2023-10-01T07:51:57.335190+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.346026+0000","last_change":"2023-10-01T07:51:56.922808+0000","last_active":"2023-10-01T07:51:57.346026+0000","last_peered":"2023-10-01T07:51:57.346026+0000","last_clean":"2023-10-01T07:51:57.346026+0000","last_became_active":"2023-10-01T07:51:56.922520+0000","last_became_peered":"2023-10-01T07:51:56.922520+0000","last_unstale":"2023-10-01T07:51:57.346026+0000","last_undegraded":"2023-10-01T07:51:57.346026+0000","last_fullsized":"2023-10-01T07:51:57.346026+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348893+0000","last_change":"2023-10-01T07:51:57.346026+0000","last_active":"2023-10-01T07:51:57.348893+0000","last_peered":"2023-10-01T07:51:57.348893+0000","last_clean":"2023-10-01T07:51:57.348893+0000","last_became_active":"2023-10-01T07:51:57.345720+0000","last_became_peered":"2023-10-01T07:51:57.345720+0000","last_unstale":"2023-10-01T07:51:57.348893+0000","last_undegraded":"2023-10-01T07:51:57.348893+0000","last_fullsized":"2023-10-01T07:51:57.348893+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.334758+0000","last_change":"2023-10-01T07:51:56.922474+0000","last_active":"2023-10-01T07:51:57.334758+0000","last_peered":"2023-10-01T07:51:57.334758+0000","last_clean":"2023-10-01T07:51:57.334758+0000","last_became_active":"2023-10-01T07:51:56.921742+0000","last_became_peered":"2023-10-01T07:51:56.921742+0000","last_unstale":"2023-10-01T07:51:57.334758+0000","last_undegraded":"2023-10-01T07:51:57.334758+0000","last_fullsized":"2023-10-01T07:51:57.334758+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.347658+0000","last_change":"2023-10-01T07:51:57.340546+0000","last_active":"2023-10-01T07:51:57.347658+0000","last_peered":"2023-10-01T07:51:57.347658+0000","last_clean":"2023-10-01T07:51:57.347658+0000","last_became_active":"2023-10-01T07:51:57.340112+0000","last_became_peered":"2023-10-01T07:51:57.340112+0000","last_unstale":"2023-10-01T07:51:57.347658+0000","last_undegraded":"2023-10-01T07:51:57.347658+0000","last_fullsized":"2023-10-01T07:51:57.347658+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.323262+0000","last_change":"2023-10-01T07:51:56.917629+0000","last_active":"2023-10-01T07:51:57.323262+0000","last_peered":"2023-10-01T07:51:57.323262+0000","last_clean":"2023-10-01T07:51:57.323262+0000","last_became_active":"2023-10-01T07:51:56.917154+0000","last_became_peered":"2023-10-01T07:51:56.917154+0000","last_unstale":"2023-10-01T07:51:57.323262+0000","last_undegraded":"2023-10-01T07:51:57.323262+0000","last_fullsized":"2023-10-01T07:51:57.323262+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348565+0000","last_change":"2023-10-01T07:51:57.340793+0000","last_active":"2023-10-01T07:51:57.348565+0000","last_peered":"2023-10-01T07:51:57.348565+0000","last_clean":"2023-10-01T07:51:57.348565+0000","last_became_active":"2023-10-01T07:51:57.340504+0000","last_became_peered":"2023-10-01T07:51:57.340504+0000","last_unstale":"2023-10-01T07:51:57.348565+0000","last_undegraded":"2023-10-01T07:51:57.348565+0000","last_fullsized":"2023-10-01T07:51:57.348565+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.344349+0000","last_change":"2023-10-01T07:51:56.925699+0000","last_active":"2023-10-01T07:51:57.344349+0000","last_peered":"2023-10-01T07:51:57.344349+0000","last_clean":"2023-10-01T07:51:57.344349+0000","last_became_active":"2023-10-01T07:51:56.925216+0000","last_became_peered":"2023-10-01T07:51:56.925216+0000","last_unstale":"2023-10-01T07:51:57.344349+0000","last_undegraded":"2023-10-01T07:51:57.344349+0000","last_fullsized":"2023-10-01T07:51:57.344349+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.340445+0000","last_change":"2023-10-01T07:51:57.340445+0000","last_active":"2023-10-01T07:51:57.340445+0000","last_peered":"2023-10-01T07:51:57.340445+0000","last_clean":"2023-10-01T07:51:57.340445+0000","last_became_active":"2023-10-01T07:51:57.340180+0000","last_became_peered":"2023-10-01T07:51:57.340180+0000","last_unstale":"2023-10-01T07:51:57.340445+0000","last_undegraded":"2023-10-01T07:51:57.340445+0000","last_fullsized":"2023-10-01T07:51:57.340445+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.303411+0000","last_change":"2023-10-01T07:51:56.915532+0000","last_active":"2023-10-01T07:51:57.303411+0000","last_peered":"2023-10-01T07:51:57.303411+0000","last_clean":"2023-10-01T07:51:57.303411+0000","last_became_active":"2023-10-01T07:51:56.912225+0000","last_became_peered":"2023-10-01T07:51:56.912225+0000","last_unstale":"2023-10-01T07:51:57.303411+0000","last_undegraded":"2023-10-01T07:51:57.303411+0000","last_fullsized":"2023-10-01T07:51:57.303411+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.338026+0000","last_change":"2023-10-01T07:51:57.331858+0000","last_active":"2023-10-01T07:51:57.338026+0000","last_peered":"2023-10-01T07:51:57.338026+0000","last_clean":"2023-10-01T07:51:57.338026+0000","last_became_active":"2023-10-01T07:51:57.331568+0000","last_became_peered":"2023-10-01T07:51:57.331568+0000","last_unstale":"2023-10-01T07:51:57.338026+0000","last_undegraded":"2023-10-01T07:51:57.338026+0000","last_fullsized":"2023-10-01T07:51:57.338026+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.342186+0000","last_change":"2023-10-01T07:51:56.924345+0000","last_active":"2023-10-01T07:51:57.342186+0000","last_peered":"2023-10-01T07:51:57.342186+0000","last_clean":"2023-10-01T07:51:57.342186+0000","last_became_active":"2023-10-01T07:51:56.923915+0000","last_became_peered":"2023-10-01T07:51:56.923915+0000","last_unstale":"2023-10-01T07:51:57.342186+0000","last_undegraded":"2023-10-01T07:51:57.342186+0000","last_fullsized":"2023-10-01T07:51:57.342186+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335325+0000","last_change":"2023-10-01T07:51:57.326926+0000","last_active":"2023-10-01T07:51:57.335325+0000","last_peered":"2023-10-01T07:51:57.335325+0000","last_clean":"2023-10-01T07:51:57.335325+0000","last_became_active":"2023-10-01T07:51:57.326597+0000","last_became_peered":"2023-10-01T07:51:57.326597+0000","last_unstale":"2023-10-01T07:51:57.335325+0000","last_undegraded":"2023-10-01T07:51:57.335325+0000","last_fullsized":"2023-10-01T07:51:57.335325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.306243+0000","last_change":"2023-10-01T07:51:56.918471+0000","last_active":"2023-10-01T07:51:57.306243+0000","last_peered":"2023-10-01T07:51:57.306243+0000","last_clean":"2023-10-01T07:51:57.306243+0000","last_became_active":"2023-10-01T07:51:56.918165+0000","last_became_peered":"2023-10-01T07:51:56.918165+0000","last_unstale":"2023-10-01T07:51:57.306243+0000","last_undegraded":"2023-10-01T07:51:57.306243+0000","last_fullsized":"2023-10-01T07:51:57.306243+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345107+0000","last_change":"2023-10-01T07:51:57.338218+0000","last_active":"2023-10-01T07:51:57.345107+0000","last_peered":"2023-10-01T07:51:57.345107+0000","last_clean":"2023-10-01T07:51:57.345107+0000","last_became_active":"2023-10-01T07:51:57.337910+0000","last_became_peered":"2023-10-01T07:51:57.337910+0000","last_unstale":"2023-10-01T07:51:57.345107+0000","last_undegraded":"2023-10-01T07:51:57.345107+0000","last_fullsized":"2023-10-01T07:51:57.345107+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.303371+0000","last_change":"2023-10-01T07:51:56.926078+0000","last_active":"2023-10-01T07:51:57.303371+0000","last_peered":"2023-10-01T07:51:57.303371+0000","last_clean":"2023-10-01T07:51:57.303371+0000","last_became_active":"2023-10-01T07:51:56.925681+0000","last_became_peered":"2023-10-01T07:51:56.925681+0000","last_unstale":"2023-10-01T07:51:57.303371+0000","last_undegraded":"2023-10-01T07:51:57.303371+0000","last_fullsized":"2023-10-01T07:51:57.303371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.340249+0000","last_change":"2023-10-01T07:51:57.340249+0000","last_active":"2023-10-01T07:51:57.340249+0000","last_peered":"2023-10-01T07:51:57.340249+0000","last_clean":"2023-10-01T07:51:57.340249+0000","last_became_active":"2023-10-01T07:51:57.339937+0000","last_became_peered":"2023-10-01T07:51:57.339937+0000","last_unstale":"2023-10-01T07:51:57.340249+0000","last_undegraded":"2023-10-01T07:51:57.340249+0000","last_fullsized":"2023-10-01T07:51:57.340249+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.303740+0000","last_change":"2023-10-01T07:51:56.918564+0000","last_active":"2023-10-01T07:51:57.303740+0000","last_peered":"2023-10-01T07:51:57.303740+0000","last_clean":"2023-10-01T07:51:57.303740+0000","last_became_active":"2023-10-01T07:51:56.918275+0000","last_became_peered":"2023-10-01T07:51:56.918275+0000","last_unstale":"2023-10-01T07:51:57.303740+0000","last_undegraded":"2023-10-01T07:51:57.303740+0000","last_fullsized":"2023-10-01T07:51:57.303740+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348828+0000","last_change":"2023-10-01T07:51:57.347574+0000","last_active":"2023-10-01T07:51:57.348828+0000","last_peered":"2023-10-01T07:51:57.348828+0000","last_clean":"2023-10-01T07:51:57.348828+0000","last_became_active":"2023-10-01T07:51:57.347243+0000","last_became_peered":"2023-10-01T07:51:57.347243+0000","last_unstale":"2023-10-01T07:51:57.348828+0000","last_undegraded":"2023-10-01T07:51:57.348828+0000","last_fullsized":"2023-10-01T07:51:57.348828+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.310517+0000","last_change":"2023-10-01T07:51:51.883413+0000","last_active":"2023-10-01T07:51:57.310517+0000","last_peered":"2023-10-01T07:51:57.310517+0000","last_clean":"2023-10-01T07:51:57.310517+0000","last_became_active":"2023-10-01T07:51:51.883088+0000","last_became_peered":"2023-10-01T07:51:51.883088+0000","last_unstale":"2023-10-01T07:51:57.310517+0000","last_undegraded":"2023-10-01T07:51:57.310517+0000","last_fullsized":"2023-10-01T07:51:57.310517+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-01T07:51:56.922804+0000","last_change":"2023-10-01T07:51:56.914139+0000","last_active":"2023-10-01T07:51:56.922804+0000","last_peered":"2023-10-01T07:51:56.922804+0000","last_clean":"2023-10-01T07:51:56.922804+0000","last_became_active":"2023-10-01T07:51:56.913026+0000","last_became_peered":"2023-10-01T07:51:56.913026+0000","last_unstale":"2023-10-01T07:51:56.922804+0000","last_undegraded":"2023-10-01T07:51:56.922804+0000","last_fullsized":"2023-10-01T07:51:56.922804+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.336585+0000","last_change":"2023-10-01T07:51:57.334103+0000","last_active":"2023-10-01T07:51:57.336585+0000","last_peered":"2023-10-01T07:51:57.336585+0000","last_clean":"2023-10-01T07:51:57.336585+0000","last_became_active":"2023-10-01T07:51:57.333743+0000","last_became_peered":"2023-10-01T07:51:57.333743+0000","last_unstale":"2023-10-01T07:51:57.336585+0000","last_undegraded":"2023-10-01T07:51:57.336585+0000","last_fullsized":"2023-10-01T07:51:57.336585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.309952+0000","last_change":"2023-10-01T07:51:51.882685+0000","last_active":"2023-10-01T07:51:57.309952+0000","last_peered":"2023-10-01T07:51:57.309952+0000","last_clean":"2023-10-01T07:51:57.309952+0000","last_became_active":"2023-10-01T07:51:51.882396+0000","last_became_peered":"2023-10-01T07:51:51.882396+0000","last_unstale":"2023-10-01T07:51:57.309952+0000","last_undegraded":"2023-10-01T07:51:57.309952+0000","last_fullsized":"2023-10-01T07:51:57.309952+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.300924+0000","last_change":"2023-10-01T07:51:56.915631+0000","last_active":"2023-10-01T07:51:57.300924+0000","last_peered":"2023-10-01T07:51:57.300924+0000","last_clean":"2023-10-01T07:51:57.300924+0000","last_became_active":"2023-10-01T07:51:56.911566+0000","last_became_peered":"2023-10-01T07:51:56.911566+0000","last_unstale":"2023-10-01T07:51:57.300924+0000","last_undegraded":"2023-10-01T07:51:57.300924+0000","last_fullsized":"2023-10-01T07:51:57.300924+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.329388+0000","last_change":"2023-10-01T07:51:57.319612+0000","last_active":"2023-10-01T07:51:57.329388+0000","last_peered":"2023-10-01T07:51:57.329388+0000","last_clean":"2023-10-01T07:51:57.329388+0000","last_became_active":"2023-10-01T07:51:57.319125+0000","last_became_peered":"2023-10-01T07:51:57.319125+0000","last_unstale":"2023-10-01T07:51:57.329388+0000","last_undegraded":"2023-10-01T07:51:57.329388+0000","last_fullsized":"2023-10-01T07:51:57.329388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-01T07:51:56.906124+0000","last_change":"2023-10-01T07:51:51.885336+0000","last_active":"2023-10-01T07:51:56.906124+0000","last_peered":"2023-10-01T07:51:56.906124+0000","last_clean":"2023-10-01T07:51:56.906124+0000","last_became_active":"2023-10-01T07:51:51.884991+0000","last_became_peered":"2023-10-01T07:51:51.884991+0000","last_unstale":"2023-10-01T07:51:56.906124+0000","last_undegraded":"2023-10-01T07:51:56.906124+0000","last_fullsized":"2023-10-01T07:51:56.906124+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.311818+0000","last_change":"2023-10-01T07:51:56.929636+0000","last_active":"2023-10-01T07:51:57.311818+0000","last_peered":"2023-10-01T07:51:57.311818+0000","last_clean":"2023-10-01T07:51:57.311818+0000","last_became_active":"2023-10-01T07:51:56.929308+0000","last_became_peered":"2023-10-01T07:51:56.929308+0000","last_unstale":"2023-10-01T07:51:57.311818+0000","last_undegraded":"2023-10-01T07:51:57.311818+0000","last_fullsized":"2023-10-01T07:51:57.311818+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.333038+0000","last_change":"2023-10-01T07:51:57.329162+0000","last_active":"2023-10-01T07:51:57.333038+0000","last_peered":"2023-10-01T07:51:57.333038+0000","last_clean":"2023-10-01T07:51:57.333038+0000","last_became_active":"2023-10-01T07:51:57.328749+0000","last_became_peered":"2023-10-01T07:51:57.328749+0000","last_unstale":"2023-10-01T07:51:57.333038+0000","last_undegraded":"2023-10-01T07:51:57.333038+0000","last_fullsized":"2023-10-01T07:51:57.333038+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.316966+0000","last_change":"2023-10-01T07:51:51.882657+0000","last_active":"2023-10-01T07:51:57.316966+0000","last_peered":"2023-10-01T07:51:57.316966+0000","last_clean":"2023-10-01T07:51:57.316966+0000","last_became_active":"2023-10-01T07:51:51.882334+0000","last_became_peered":"2023-10-01T07:51:51.882334+0000","last_unstale":"2023-10-01T07:51:57.316966+0000","last_undegraded":"2023-10-01T07:51:57.316966+0000","last_fullsized":"2023-10-01T07:51:57.316966+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.311710+0000","last_change":"2023-10-01T07:51:50.871456+0000","last_active":"2023-10-01T07:51:57.311710+0000","last_peered":"2023-10-01T07:51:57.311710+0000","last_clean":"2023-10-01T07:51:57.311710+0000","last_became_active":"2023-10-01T07:51:50.871112+0000","last_became_peered":"2023-10-01T07:51:50.871112+0000","last_unstale":"2023-10-01T07:51:57.311710+0000","last_undegraded":"2023-10-01T07:51:57.311710+0000","last_fullsized":"2023-10-01T07:51:57.311710+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:49.856372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:49.856372+0000","last_clean_scrub_stamp":"2023-10-01T07:51:49.856372+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.305919+0000","last_change":"2023-10-01T07:51:56.925843+0000","last_active":"2023-10-01T07:51:57.305919+0000","last_peered":"2023-10-01T07:51:57.305919+0000","last_clean":"2023-10-01T07:51:57.305919+0000","last_became_active":"2023-10-01T07:51:56.925538+0000","last_became_peered":"2023-10-01T07:51:56.925538+0000","last_unstale":"2023-10-01T07:51:57.305919+0000","last_undegraded":"2023-10-01T07:51:57.305919+0000","last_fullsized":"2023-10-01T07:51:57.305919+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.347449+0000","last_change":"2023-10-01T07:51:57.339219+0000","last_active":"2023-10-01T07:51:57.347449+0000","last_peered":"2023-10-01T07:51:57.347449+0000","last_clean":"2023-10-01T07:51:57.347449+0000","last_became_active":"2023-10-01T07:51:57.338416+0000","last_became_peered":"2023-10-01T07:51:57.338416+0000","last_unstale":"2023-10-01T07:51:57.347449+0000","last_undegraded":"2023-10-01T07:51:57.347449+0000","last_fullsized":"2023-10-01T07:51:57.347449+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.309046+0000","last_change":"2023-10-01T07:51:51.882831+0000","last_active":"2023-10-01T07:51:57.309046+0000","last_peered":"2023-10-01T07:51:57.309046+0000","last_clean":"2023-10-01T07:51:57.309046+0000","last_became_active":"2023-10-01T07:51:51.882490+0000","last_became_peered":"2023-10-01T07:51:51.882490+0000","last_unstale":"2023-10-01T07:51:57.309046+0000","last_undegraded":"2023-10-01T07:51:57.309046+0000","last_fullsized":"2023-10-01T07:51:57.309046+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.300429+0000","last_change":"2023-10-01T07:51:56.929720+0000","last_active":"2023-10-01T07:51:57.300429+0000","last_peered":"2023-10-01T07:51:57.300429+0000","last_clean":"2023-10-01T07:51:57.300429+0000","last_became_active":"2023-10-01T07:51:56.929370+0000","last_became_peered":"2023-10-01T07:51:56.929370+0000","last_unstale":"2023-10-01T07:51:57.300429+0000","last_undegraded":"2023-10-01T07:51:57.300429+0000","last_fullsized":"2023-10-01T07:51:57.300429+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.338477+0000","last_change":"2023-10-01T07:51:57.335095+0000","last_active":"2023-10-01T07:51:57.338477+0000","last_peered":"2023-10-01T07:51:57.338477+0000","last_clean":"2023-10-01T07:51:57.338477+0000","last_became_active":"2023-10-01T07:51:57.334324+0000","last_became_peered":"2023-10-01T07:51:57.334324+0000","last_unstale":"2023-10-01T07:51:57.338477+0000","last_undegraded":"2023-10-01T07:51:57.338477+0000","last_fullsized":"2023-10-01T07:51:57.338477+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.321040+0000","last_change":"2023-10-01T07:51:51.884196+0000","last_active":"2023-10-01T07:51:57.321040+0000","last_peered":"2023-10-01T07:51:57.321040+0000","last_clean":"2023-10-01T07:51:57.321040+0000","last_became_active":"2023-10-01T07:51:51.883784+0000","last_became_peered":"2023-10-01T07:51:51.883784+0000","last_unstale":"2023-10-01T07:51:57.321040+0000","last_undegraded":"2023-10-01T07:51:57.321040+0000","last_fullsized":"2023-10-01T07:51:57.321040+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.310257+0000","last_change":"2023-10-01T07:51:56.913348+0000","last_active":"2023-10-01T07:51:57.310257+0000","last_peered":"2023-10-01T07:51:57.310257+0000","last_clean":"2023-10-01T07:51:57.310257+0000","last_became_active":"2023-10-01T07:51:56.913041+0000","last_became_peered":"2023-10-01T07:51:56.913041+0000","last_unstale":"2023-10-01T07:51:57.310257+0000","last_undegraded":"2023-10-01T07:51:57.310257+0000","last_fullsized":"2023-10-01T07:51:57.310257+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.320737+0000","last_change":"2023-10-01T07:51:57.313930+0000","last_active":"2023-10-01T07:51:57.320737+0000","last_peered":"2023-10-01T07:51:57.320737+0000","last_clean":"2023-10-01T07:51:57.320737+0000","last_became_active":"2023-10-01T07:51:57.313613+0000","last_became_peered":"2023-10-01T07:51:57.313613+0000","last_unstale":"2023-10-01T07:51:57.320737+0000","last_undegraded":"2023-10-01T07:51:57.320737+0000","last_fullsized":"2023-10-01T07:51:57.320737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345351+0000","last_change":"2023-10-01T07:51:56.929769+0000","last_active":"2023-10-01T07:51:57.345351+0000","last_peered":"2023-10-01T07:51:57.345351+0000","last_clean":"2023-10-01T07:51:57.345351+0000","last_became_active":"2023-10-01T07:51:56.929479+0000","last_became_peered":"2023-10-01T07:51:56.929479+0000","last_unstale":"2023-10-01T07:51:57.345351+0000","last_undegraded":"2023-10-01T07:51:57.345351+0000","last_fullsized":"2023-10-01T07:51:57.345351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.312442+0000","last_change":"2023-10-01T07:51:51.883317+0000","last_active":"2023-10-01T07:51:57.312442+0000","last_peered":"2023-10-01T07:51:57.312442+0000","last_clean":"2023-10-01T07:51:57.312442+0000","last_became_active":"2023-10-01T07:51:51.883005+0000","last_became_peered":"2023-10-01T07:51:51.883005+0000","last_unstale":"2023-10-01T07:51:57.312442+0000","last_undegraded":"2023-10-01T07:51:57.312442+0000","last_fullsized":"2023-10-01T07:51:57.312442+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.346741+0000","last_change":"2023-10-01T07:51:57.325035+0000","last_active":"2023-10-01T07:51:57.346741+0000","last_peered":"2023-10-01T07:51:57.346741+0000","last_clean":"2023-10-01T07:51:57.346741+0000","last_became_active":"2023-10-01T07:51:57.324727+0000","last_became_peered":"2023-10-01T07:51:57.324727+0000","last_unstale":"2023-10-01T07:51:57.346741+0000","last_undegraded":"2023-10-01T07:51:57.346741+0000","last_fullsized":"2023-10-01T07:51:57.346741+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.322783+0000","last_change":"2023-10-01T07:51:51.883299+0000","last_active":"2023-10-01T07:51:57.322783+0000","last_peered":"2023-10-01T07:51:57.322783+0000","last_clean":"2023-10-01T07:51:57.322783+0000","last_became_active":"2023-10-01T07:51:51.883001+0000","last_became_peered":"2023-10-01T07:51:51.883001+0000","last_unstale":"2023-10-01T07:51:57.322783+0000","last_undegraded":"2023-10-01T07:51:57.322783+0000","last_fullsized":"2023-10-01T07:51:57.322783+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.303139+0000","last_change":"2023-10-01T07:51:56.921291+0000","last_active":"2023-10-01T07:51:57.303139+0000","last_peered":"2023-10-01T07:51:57.303139+0000","last_clean":"2023-10-01T07:51:57.303139+0000","last_became_active":"2023-10-01T07:51:56.920989+0000","last_became_peered":"2023-10-01T07:51:56.920989+0000","last_unstale":"2023-10-01T07:51:57.303139+0000","last_undegraded":"2023-10-01T07:51:57.303139+0000","last_fullsized":"2023-10-01T07:51:57.303139+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.342916+0000","last_change":"2023-10-01T07:51:57.342916+0000","last_active":"2023-10-01T07:51:57.342916+0000","last_peered":"2023-10-01T07:51:57.342916+0000","last_clean":"2023-10-01T07:51:57.342916+0000","last_became_active":"2023-10-01T07:51:57.342653+0000","last_became_peered":"2023-10-01T07:51:57.342653+0000","last_unstale":"2023-10-01T07:51:57.342916+0000","last_undegraded":"2023-10-01T07:51:57.342916+0000","last_fullsized":"2023-10-01T07:51:57.342916+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.325920+0000","last_change":"2023-10-01T07:51:56.916437+0000","last_active":"2023-10-01T07:51:57.325920+0000","last_peered":"2023-10-01T07:51:57.325920+0000","last_clean":"2023-10-01T07:51:57.325920+0000","last_became_active":"2023-10-01T07:51:56.915935+0000","last_became_peered":"2023-10-01T07:51:56.915935+0000","last_unstale":"2023-10-01T07:51:57.325920+0000","last_undegraded":"2023-10-01T07:51:57.325920+0000","last_fullsized":"2023-10-01T07:51:57.325920+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.330536+0000","last_change":"2023-10-01T07:51:57.330536+0000","last_active":"2023-10-01T07:51:57.330536+0000","last_peered":"2023-10-01T07:51:57.330536+0000","last_clean":"2023-10-01T07:51:57.330536+0000","last_became_active":"2023-10-01T07:51:57.330151+0000","last_became_peered":"2023-10-01T07:51:57.330151+0000","last_unstale":"2023-10-01T07:51:57.330536+0000","last_undegraded":"2023-10-01T07:51:57.330536+0000","last_fullsized":"2023-10-01T07:51:57.330536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.322423+0000","last_change":"2023-10-01T07:51:56.922316+0000","last_active":"2023-10-01T07:51:57.322423+0000","last_peered":"2023-10-01T07:51:57.322423+0000","last_clean":"2023-10-01T07:51:57.322423+0000","last_became_active":"2023-10-01T07:51:56.922003+0000","last_became_peered":"2023-10-01T07:51:56.922003+0000","last_unstale":"2023-10-01T07:51:57.322423+0000","last_undegraded":"2023-10-01T07:51:57.322423+0000","last_fullsized":"2023-10-01T07:51:57.322423+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.341976+0000","last_change":"2023-10-01T07:51:57.341976+0000","last_active":"2023-10-01T07:51:57.341976+0000","last_peered":"2023-10-01T07:51:57.341976+0000","last_clean":"2023-10-01T07:51:57.341976+0000","last_became_active":"2023-10-01T07:51:57.341188+0000","last_became_peered":"2023-10-01T07:51:57.341188+0000","last_unstale":"2023-10-01T07:51:57.341976+0000","last_undegraded":"2023-10-01T07:51:57.341976+0000","last_fullsized":"2023-10-01T07:51:57.341976+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.342897+0000","last_change":"2023-10-01T07:51:56.925522+0000","last_active":"2023-10-01T07:51:57.342897+0000","last_peered":"2023-10-01T07:51:57.342897+0000","last_clean":"2023-10-01T07:51:57.342897+0000","last_became_active":"2023-10-01T07:51:56.924830+0000","last_became_peered":"2023-10-01T07:51:56.924830+0000","last_unstale":"2023-10-01T07:51:57.342897+0000","last_undegraded":"2023-10-01T07:51:57.342897+0000","last_fullsized":"2023-10-01T07:51:57.342897+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.340653+0000","last_change":"2023-10-01T07:51:57.340653+0000","last_active":"2023-10-01T07:51:57.340653+0000","last_peered":"2023-10-01T07:51:57.340653+0000","last_clean":"2023-10-01T07:51:57.340653+0000","last_became_active":"2023-10-01T07:51:57.340395+0000","last_became_peered":"2023-10-01T07:51:57.340395+0000","last_unstale":"2023-10-01T07:51:57.340653+0000","last_undegraded":"2023-10-01T07:51:57.340653+0000","last_fullsized":"2023-10-01T07:51:57.340653+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.338671+0000","last_change":"2023-10-01T07:51:56.924298+0000","last_active":"2023-10-01T07:51:57.338671+0000","last_peered":"2023-10-01T07:51:57.338671+0000","last_clean":"2023-10-01T07:51:57.338671+0000","last_became_active":"2023-10-01T07:51:56.923975+0000","last_became_peered":"2023-10-01T07:51:56.923975+0000","last_unstale":"2023-10-01T07:51:57.338671+0000","last_undegraded":"2023-10-01T07:51:57.338671+0000","last_fullsized":"2023-10-01T07:51:57.338671+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.347457+0000","last_change":"2023-10-01T07:51:57.339026+0000","last_active":"2023-10-01T07:51:57.347457+0000","last_peered":"2023-10-01T07:51:57.347457+0000","last_clean":"2023-10-01T07:51:57.347457+0000","last_became_active":"2023-10-01T07:51:57.338722+0000","last_became_peered":"2023-10-01T07:51:57.338722+0000","last_unstale":"2023-10-01T07:51:57.347457+0000","last_undegraded":"2023-10-01T07:51:57.347457+0000","last_fullsized":"2023-10-01T07:51:57.347457+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335116+0000","last_change":"2023-10-01T07:51:56.922677+0000","last_active":"2023-10-01T07:51:57.335116+0000","last_peered":"2023-10-01T07:51:57.335116+0000","last_clean":"2023-10-01T07:51:57.335116+0000","last_became_active":"2023-10-01T07:51:56.922121+0000","last_became_peered":"2023-10-01T07:51:56.922121+0000","last_unstale":"2023-10-01T07:51:57.335116+0000","last_undegraded":"2023-10-01T07:51:57.335116+0000","last_fullsized":"2023-10-01T07:51:57.335116+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.329519+0000","last_change":"2023-10-01T07:51:57.329519+0000","last_active":"2023-10-01T07:51:57.329519+0000","last_peered":"2023-10-01T07:51:57.329519+0000","last_clean":"2023-10-01T07:51:57.329519+0000","last_became_active":"2023-10-01T07:51:57.329191+0000","last_became_peered":"2023-10-01T07:51:57.329191+0000","last_unstale":"2023-10-01T07:51:57.329519+0000","last_undegraded":"2023-10-01T07:51:57.329519+0000","last_fullsized":"2023-10-01T07:51:57.329519+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335155+0000","last_change":"2023-10-01T07:51:57.320100+0000","last_active":"2023-10-01T07:51:57.335155+0000","last_peered":"2023-10-01T07:51:57.335155+0000","last_clean":"2023-10-01T07:51:57.335155+0000","last_became_active":"2023-10-01T07:51:57.319593+0000","last_became_peered":"2023-10-01T07:51:57.319593+0000","last_unstale":"2023-10-01T07:51:57.335155+0000","last_undegraded":"2023-10-01T07:51:57.335155+0000","last_fullsized":"2023-10-01T07:51:57.335155+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345109+0000","last_change":"2023-10-01T07:51:57.325707+0000","last_active":"2023-10-01T07:51:57.345109+0000","last_peered":"2023-10-01T07:51:57.345109+0000","last_clean":"2023-10-01T07:51:57.345109+0000","last_became_active":"2023-10-01T07:51:57.324870+0000","last_became_peered":"2023-10-01T07:51:57.324870+0000","last_unstale":"2023-10-01T07:51:57.345109+0000","last_undegraded":"2023-10-01T07:51:57.345109+0000","last_fullsized":"2023-10-01T07:51:57.345109+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.334378+0000","last_change":"2023-10-01T07:51:57.326270+0000","last_active":"2023-10-01T07:51:57.334378+0000","last_peered":"2023-10-01T07:51:57.334378+0000","last_clean":"2023-10-01T07:51:57.334378+0000","last_became_active":"2023-10-01T07:51:57.325956+0000","last_became_peered":"2023-10-01T07:51:57.325956+0000","last_unstale":"2023-10-01T07:51:57.334378+0000","last_undegraded":"2023-10-01T07:51:57.334378+0000","last_fullsized":"2023-10-01T07:51:57.334378+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.344374+0000","last_change":"2023-10-01T07:51:57.338041+0000","last_active":"2023-10-01T07:51:57.344374+0000","last_peered":"2023-10-01T07:51:57.344374+0000","last_clean":"2023-10-01T07:51:57.344374+0000","last_became_active":"2023-10-01T07:51:57.337719+0000","last_became_peered":"2023-10-01T07:51:57.337719+0000","last_unstale":"2023-10-01T07:51:57.344374+0000","last_undegraded":"2023-10-01T07:51:57.344374+0000","last_fullsized":"2023-10-01T07:51:57.344374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.329368+0000","last_change":"2023-10-01T07:51:57.319429+0000","last_active":"2023-10-01T07:51:57.329368+0000","last_peered":"2023-10-01T07:51:57.329368+0000","last_clean":"2023-10-01T07:51:57.329368+0000","last_became_active":"2023-10-01T07:51:57.318849+0000","last_became_peered":"2023-10-01T07:51:57.318849+0000","last_unstale":"2023-10-01T07:51:57.329368+0000","last_undegraded":"2023-10-01T07:51:57.329368+0000","last_fullsized":"2023-10-01T07:51:57.329368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297264,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074576,"statfs":{"total":96636764160,"available":96332365824,"internally_reserved":0,"allocated":172032,"data_stored":48929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]}]},{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297244,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074596,"statfs":{"total":96636764160,"available":96332386304,"internally_reserved":0,"allocated":151552,"data_stored":44462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297248,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074592,"statfs":{"total":96636764160,"available":96332382208,"internally_reserved":0,"allocated":155648,"data_stored":43626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297244,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074596,"statfs":{"total":96636764160,"available":96332386304,"internally_reserved":0,"allocated":151552,"data_stored":43572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-01T07:52:05.910 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-01T07:52:06.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.048+0000 7f4699ef9700 1 Processor -- start 2023-10-01T07:52:06.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.048+0000 7f4699ef9700 1 -- start start 2023-10-01T07:52:06.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.048+0000 7f4699ef9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4694067940 0x7f4694097310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:06.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.049+0000 7f4699ef9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4694097800 0x7f4694130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:06.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.049+0000 7f4699ef9700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4694068df0 con 0x7f4694096820 2023-10-01T07:52:06.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.049+0000 7f4699ef9700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4694097c90 con 0x7f4694067940 2023-10-01T07:52:06.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.049+0000 7f4699ef9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469406a4c0 con 0x7f4694097800 2023-10-01T07:52:06.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.049+0000 7f4692ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4694067940 0x7f4694097310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:06.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.049+0000 7f46937fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4694096820 0x7f4694096c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:40410/0 (socket says 172.21.15.26:40410) 2023-10-01T07:52:06.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.049+0000 7f46937fe700 1 -- 172.21.15.26:0/689995951 learned_addr learned my addr 172.21.15.26:0/689995951 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:52:06.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.049+0000 7f4693fff700 1 --2- 172.21.15.26:0/689995951 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4694097800 0x7f4694130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:06.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.049+0000 7f4692ffd700 1 -- 172.21.15.26:0/689995951 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4694097800 msgr2=0x7f4694130280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:06.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.049+0000 7f4692ffd700 1 --2- 172.21.15.26:0/689995951 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4694097800 0x7f4694130280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:06.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.049+0000 7f4692ffd700 1 -- 172.21.15.26:0/689995951 >> v1:172.21.15.26:6789/0 conn(0x7f4694096820 legacy=0x7f4694096c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:06.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.049+0000 7f4692ffd700 1 -- 172.21.15.26:0/689995951 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4694098260 con 0x7f4694067940 2023-10-01T07:52:06.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.049+0000 7f4693fff700 1 --2- 172.21.15.26:0/689995951 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4694097800 0x7f4694130280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:06.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.049+0000 7f46927fc700 1 -- 172.21.15.26:0/689995951 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2225872132 0 0) 0x7f4694068df0 con 0x7f4694096820 2023-10-01T07:52:06.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.049+0000 7f4692ffd700 1 --2- 172.21.15.26:0/689995951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4694067940 0x7f4694097310 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f4688009760 tx=0x7f4688009060).ready entity=mon.0 client_cookie=dbbd9ca58bfb6a3a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:06.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.049+0000 7f46927fc700 1 -- 172.21.15.26:0/689995951 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468800f510 con 0x7f4694067940 2023-10-01T07:52:06.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.049+0000 7f46927fc700 1 -- 172.21.15.26:0/689995951 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468800f670 con 0x7f4694067940 2023-10-01T07:52:06.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.049+0000 7f46927fc700 1 -- 172.21.15.26:0/689995951 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468800f9f0 con 0x7f4694067940 2023-10-01T07:52:06.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.050+0000 7f4699ef9700 1 -- 172.21.15.26:0/689995951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4694067940 msgr2=0x7f4694097310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:06.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.050+0000 7f4699ef9700 1 --2- 172.21.15.26:0/689995951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4694067940 0x7f4694097310 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f4688009760 tx=0x7f4688009060).stop 2023-10-01T07:52:06.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.050+0000 7f4699ef9700 1 -- 172.21.15.26:0/689995951 shutdown_connections 2023-10-01T07:52:06.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.050+0000 7f4699ef9700 1 --2- 172.21.15.26:0/689995951 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4694097800 0x7f4694130280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:06.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.050+0000 7f4699ef9700 1 --2- 172.21.15.26:0/689995951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4694067940 0x7f4694097310 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:06.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.050+0000 7f4699ef9700 1 -- 172.21.15.26:0/689995951 >> 172.21.15.26:0/689995951 conn(0x7f469409ba50 msgr2=0x7f469409be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:06.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.050+0000 7f4699ef9700 1 -- 172.21.15.26:0/689995951 shutdown_connections 2023-10-01T07:52:06.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.050+0000 7f4699ef9700 1 -- 172.21.15.26:0/689995951 wait complete. 2023-10-01T07:52:06.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.051+0000 7f4699ef9700 1 Processor -- start 2023-10-01T07:52:06.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.051+0000 7f4699ef9700 1 -- start start 2023-10-01T07:52:06.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.052+0000 7f4699ef9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4694067940 0x7f4694130240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:06.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.052+0000 7f4699ef9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4694096820 0x7f46941181a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:06.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.052+0000 7f4699ef9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4694097800 0x7f4694118690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:06.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.052+0000 7f4699ef9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469411bcb0 con 0x7f4694096820 2023-10-01T07:52:06.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.052+0000 7f4699ef9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46940919e0 con 0x7f4694097800 2023-10-01T07:52:06.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.052+0000 7f4699ef9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4694067e30 con 0x7f4694067940 2023-10-01T07:52:06.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.052+0000 7f46937fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4694067940 0x7f4694130240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:06.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.052+0000 7f46937fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4694067940 0x7f4694130240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57414/0 (socket says 172.21.15.26:57414) 2023-10-01T07:52:06.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.052+0000 7f46937fe700 1 -- 172.21.15.26:0/1244222192 learned_addr learned my addr 172.21.15.26:0/1244222192 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:06.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.052+0000 7f4692ffd700 1 --2- 172.21.15.26:0/1244222192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4694096820 0x7f46941181a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:06.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.052+0000 7f4693fff700 1 --2- 172.21.15.26:0/1244222192 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4694097800 0x7f4694118690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:06.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.052+0000 7f46937fe700 1 -- 172.21.15.26:0/1244222192 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4694097800 msgr2=0x7f4694118690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:06.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.052+0000 7f46937fe700 1 --2- 172.21.15.26:0/1244222192 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4694097800 0x7f4694118690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:06.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.052+0000 7f46937fe700 1 -- 172.21.15.26:0/1244222192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4694096820 msgr2=0x7f46941181a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:06.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.052+0000 7f46937fe700 1 --2- 172.21.15.26:0/1244222192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4694096820 0x7f46941181a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:06.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.052+0000 7f46937fe700 1 -- 172.21.15.26:0/1244222192 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468c009a20 con 0x7f4694067940 2023-10-01T07:52:06.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.052+0000 7f4692ffd700 1 --2- 172.21.15.26:0/1244222192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4694096820 0x7f46941181a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:06.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.052+0000 7f46937fe700 1 --2- 172.21.15.26:0/1244222192 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4694067940 0x7f4694130240 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f468400c4f0 tx=0x7f4684007c10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:06.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.052+0000 7f467b7fe700 1 -- 172.21.15.26:0/1244222192 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46840072e0 con 0x7f4694067940 2023-10-01T07:52:06.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.052+0000 7f467b7fe700 1 -- 172.21.15.26:0/1244222192 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4684007460 con 0x7f4694067940 2023-10-01T07:52:06.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.052+0000 7f4699ef9700 1 -- 172.21.15.26:0/1244222192 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46880092a0 con 0x7f4694067940 2023-10-01T07:52:06.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.053+0000 7f467b7fe700 1 -- 172.21.15.26:0/1244222192 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46840059f0 con 0x7f4694067940 2023-10-01T07:52:06.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.053+0000 7f4699ef9700 1 -- 172.21.15.26:0/1244222192 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f469411c200 con 0x7f4694067940 2023-10-01T07:52:06.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.053+0000 7f467b7fe700 1 -- 172.21.15.26:0/1244222192 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f4684013450 con 0x7f4694067940 2023-10-01T07:52:06.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.053+0000 7f467b7fe700 1 -- 172.21.15.26:0/1244222192 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f468403a670 con 0x7f4694067940 2023-10-01T07:52:06.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.054+0000 7f4699ef9700 1 -- 172.21.15.26:0/1244222192 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f469405a260 con 0x7f4694067940 2023-10-01T07:52:06.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.058+0000 7f467b7fe700 1 -- 172.21.15.26:0/1244222192 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f46840075d0 con 0x7f4694067940 2023-10-01T07:52:06.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.226+0000 7f4699ef9700 1 -- 172.21.15.26:0/1244222192 --> v1:172.21.15.26:6816/118178 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4694118fa0 con 0x7f468002bb60 2023-10-01T07:52:06.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.233+0000 7f467b7fe700 1 -- 172.21.15.26:0/1244222192 <== mgr.4107 v1:172.21.15.26:6816/118178 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249939 (unknown 2965378022 0 2989729351) 0x7f4694118fa0 con 0x7f468002bb60 2023-10-01T07:52:06.236 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:52:06.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.236+0000 7f4699ef9700 1 -- 172.21.15.26:0/1244222192 >> v1:172.21.15.26:6816/118178 conn(0x7f468002bb60 legacy=0x7f468002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:06.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.236+0000 7f4699ef9700 1 -- 172.21.15.26:0/1244222192 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4694067940 msgr2=0x7f4694130240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:06.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.236+0000 7f4699ef9700 1 --2- 172.21.15.26:0/1244222192 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4694067940 0x7f4694130240 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f468400c4f0 tx=0x7f4684007c10).stop 2023-10-01T07:52:06.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.236+0000 7f4699ef9700 1 -- 172.21.15.26:0/1244222192 shutdown_connections 2023-10-01T07:52:06.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.236+0000 7f4699ef9700 1 --2- 172.21.15.26:0/1244222192 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4694097800 0x7f4694118690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:06.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.236+0000 7f4699ef9700 1 --2- 172.21.15.26:0/1244222192 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4694067940 0x7f4694130240 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:06.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.236+0000 7f4699ef9700 1 --2- 172.21.15.26:0/1244222192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4694096820 0x7f46941181a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:06.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.236+0000 7f4699ef9700 1 -- 172.21.15.26:0/1244222192 >> 172.21.15.26:0/1244222192 conn(0x7f469409ba50 msgr2=0x7f4694099880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:06.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.236+0000 7f4699ef9700 1 -- 172.21.15.26:0/1244222192 shutdown_connections 2023-10-01T07:52:06.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.236+0000 7f4699ef9700 1 -- 172.21.15.26:0/1244222192 wait complete. 2023-10-01T07:52:06.239 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-01T07:52:06.249 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-01T07:52:05.808229+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189024,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298336,"statfs":{"total":386547056640,"available":385329496064,"internally_reserved":0,"allocated":655360,"data_stored":193408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1640,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001330"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.343644+0000","last_change":"2023-10-01T07:51:57.340051+0000","last_active":"2023-10-01T07:51:57.343644+0000","last_peered":"2023-10-01T07:51:57.343644+0000","last_clean":"2023-10-01T07:51:57.343644+0000","last_became_active":"2023-10-01T07:51:57.339739+0000","last_became_peered":"2023-10-01T07:51:57.339739+0000","last_unstale":"2023-10-01T07:51:57.343644+0000","last_undegraded":"2023-10-01T07:51:57.343644+0000","last_fullsized":"2023-10-01T07:51:57.343644+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.337096+0000","last_change":"2023-10-01T07:51:57.330147+0000","last_active":"2023-10-01T07:51:57.337096+0000","last_peered":"2023-10-01T07:51:57.337096+0000","last_clean":"2023-10-01T07:51:57.337096+0000","last_became_active":"2023-10-01T07:51:57.329793+0000","last_became_peered":"2023-10-01T07:51:57.329793+0000","last_unstale":"2023-10-01T07:51:57.337096+0000","last_undegraded":"2023-10-01T07:51:57.337096+0000","last_fullsized":"2023-10-01T07:51:57.337096+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.343537+0000","last_change":"2023-10-01T07:51:57.335404+0000","last_active":"2023-10-01T07:51:57.343537+0000","last_peered":"2023-10-01T07:51:57.343537+0000","last_clean":"2023-10-01T07:51:57.343537+0000","last_became_active":"2023-10-01T07:51:57.329225+0000","last_became_peered":"2023-10-01T07:51:57.329225+0000","last_unstale":"2023-10-01T07:51:57.343537+0000","last_undegraded":"2023-10-01T07:51:57.343537+0000","last_fullsized":"2023-10-01T07:51:57.343537+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.337475+0000","last_change":"2023-10-01T07:51:57.332237+0000","last_active":"2023-10-01T07:51:57.337475+0000","last_peered":"2023-10-01T07:51:57.337475+0000","last_clean":"2023-10-01T07:51:57.337475+0000","last_became_active":"2023-10-01T07:51:57.331857+0000","last_became_peered":"2023-10-01T07:51:57.331857+0000","last_unstale":"2023-10-01T07:51:57.337475+0000","last_undegraded":"2023-10-01T07:51:57.337475+0000","last_fullsized":"2023-10-01T07:51:57.337475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335610+0000","last_change":"2023-10-01T07:51:57.326512+0000","last_active":"2023-10-01T07:51:57.335610+0000","last_peered":"2023-10-01T07:51:57.335610+0000","last_clean":"2023-10-01T07:51:57.335610+0000","last_became_active":"2023-10-01T07:51:57.326202+0000","last_became_peered":"2023-10-01T07:51:57.326202+0000","last_unstale":"2023-10-01T07:51:57.335610+0000","last_undegraded":"2023-10-01T07:51:57.335610+0000","last_fullsized":"2023-10-01T07:51:57.335610+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345080+0000","last_change":"2023-10-01T07:51:57.323824+0000","last_active":"2023-10-01T07:51:57.345080+0000","last_peered":"2023-10-01T07:51:57.345080+0000","last_clean":"2023-10-01T07:51:57.345080+0000","last_became_active":"2023-10-01T07:51:57.322857+0000","last_became_peered":"2023-10-01T07:51:57.322857+0000","last_unstale":"2023-10-01T07:51:57.345080+0000","last_undegraded":"2023-10-01T07:51:57.345080+0000","last_fullsized":"2023-10-01T07:51:57.345080+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345129+0000","last_change":"2023-10-01T07:51:57.325909+0000","last_active":"2023-10-01T07:51:57.345129+0000","last_peered":"2023-10-01T07:51:57.345129+0000","last_clean":"2023-10-01T07:51:57.345129+0000","last_became_active":"2023-10-01T07:51:57.325226+0000","last_became_peered":"2023-10-01T07:51:57.325226+0000","last_unstale":"2023-10-01T07:51:57.345129+0000","last_undegraded":"2023-10-01T07:51:57.345129+0000","last_fullsized":"2023-10-01T07:51:57.345129+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335188+0000","last_change":"2023-10-01T07:51:57.323649+0000","last_active":"2023-10-01T07:51:57.335188+0000","last_peered":"2023-10-01T07:51:57.335188+0000","last_clean":"2023-10-01T07:51:57.335188+0000","last_became_active":"2023-10-01T07:51:57.319917+0000","last_became_peered":"2023-10-01T07:51:57.319917+0000","last_unstale":"2023-10-01T07:51:57.335188+0000","last_undegraded":"2023-10-01T07:51:57.335188+0000","last_fullsized":"2023-10-01T07:51:57.335188+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335645+0000","last_change":"2023-10-01T07:51:57.325845+0000","last_active":"2023-10-01T07:51:57.335645+0000","last_peered":"2023-10-01T07:51:57.335645+0000","last_clean":"2023-10-01T07:51:57.335645+0000","last_became_active":"2023-10-01T07:51:57.325346+0000","last_became_peered":"2023-10-01T07:51:57.325346+0000","last_unstale":"2023-10-01T07:51:57.335645+0000","last_undegraded":"2023-10-01T07:51:57.335645+0000","last_fullsized":"2023-10-01T07:51:57.335645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.337622+0000","last_change":"2023-10-01T07:51:57.328438+0000","last_active":"2023-10-01T07:51:57.337622+0000","last_peered":"2023-10-01T07:51:57.337622+0000","last_clean":"2023-10-01T07:51:57.337622+0000","last_became_active":"2023-10-01T07:51:57.328128+0000","last_became_peered":"2023-10-01T07:51:57.328128+0000","last_unstale":"2023-10-01T07:51:57.337622+0000","last_undegraded":"2023-10-01T07:51:57.337622+0000","last_fullsized":"2023-10-01T07:51:57.337622+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.333136+0000","last_change":"2023-10-01T07:51:57.328650+0000","last_active":"2023-10-01T07:51:57.333136+0000","last_peered":"2023-10-01T07:51:57.333136+0000","last_clean":"2023-10-01T07:51:57.333136+0000","last_became_active":"2023-10-01T07:51:57.328335+0000","last_became_peered":"2023-10-01T07:51:57.328335+0000","last_unstale":"2023-10-01T07:51:57.333136+0000","last_undegraded":"2023-10-01T07:51:57.333136+0000","last_fullsized":"2023-10-01T07:51:57.333136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.337224+0000","last_change":"2023-10-01T07:51:57.331991+0000","last_active":"2023-10-01T07:51:57.337224+0000","last_peered":"2023-10-01T07:51:57.337224+0000","last_clean":"2023-10-01T07:51:57.337224+0000","last_became_active":"2023-10-01T07:51:57.331698+0000","last_became_peered":"2023-10-01T07:51:57.331698+0000","last_unstale":"2023-10-01T07:51:57.337224+0000","last_undegraded":"2023-10-01T07:51:57.337224+0000","last_fullsized":"2023-10-01T07:51:57.337224+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.344547+0000","last_change":"2023-10-01T07:51:57.342157+0000","last_active":"2023-10-01T07:51:57.344547+0000","last_peered":"2023-10-01T07:51:57.344547+0000","last_clean":"2023-10-01T07:51:57.344547+0000","last_became_active":"2023-10-01T07:51:57.341533+0000","last_became_peered":"2023-10-01T07:51:57.341533+0000","last_unstale":"2023-10-01T07:51:57.344547+0000","last_undegraded":"2023-10-01T07:51:57.344547+0000","last_fullsized":"2023-10-01T07:51:57.344547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.323193+0000","last_change":"2023-10-01T07:51:57.318295+0000","last_active":"2023-10-01T07:51:57.323193+0000","last_peered":"2023-10-01T07:51:57.323193+0000","last_clean":"2023-10-01T07:51:57.323193+0000","last_became_active":"2023-10-01T07:51:57.317972+0000","last_became_peered":"2023-10-01T07:51:57.317972+0000","last_unstale":"2023-10-01T07:51:57.323193+0000","last_undegraded":"2023-10-01T07:51:57.323193+0000","last_fullsized":"2023-10-01T07:51:57.323193+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.334056+0000","last_change":"2023-10-01T07:51:57.321137+0000","last_active":"2023-10-01T07:51:57.334056+0000","last_peered":"2023-10-01T07:51:57.334056+0000","last_clean":"2023-10-01T07:51:57.334056+0000","last_became_active":"2023-10-01T07:51:57.320789+0000","last_became_peered":"2023-10-01T07:51:57.320789+0000","last_unstale":"2023-10-01T07:51:57.334056+0000","last_undegraded":"2023-10-01T07:51:57.334056+0000","last_fullsized":"2023-10-01T07:51:57.334056+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.346763+0000","last_change":"2023-10-01T07:51:57.325610+0000","last_active":"2023-10-01T07:51:57.346763+0000","last_peered":"2023-10-01T07:51:57.346763+0000","last_clean":"2023-10-01T07:51:57.346763+0000","last_became_active":"2023-10-01T07:51:57.325322+0000","last_became_peered":"2023-10-01T07:51:57.325322+0000","last_unstale":"2023-10-01T07:51:57.346763+0000","last_undegraded":"2023-10-01T07:51:57.346763+0000","last_fullsized":"2023-10-01T07:51:57.346763+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335623+0000","last_change":"2023-10-01T07:51:57.325641+0000","last_active":"2023-10-01T07:51:57.335623+0000","last_peered":"2023-10-01T07:51:57.335623+0000","last_clean":"2023-10-01T07:51:57.335623+0000","last_became_active":"2023-10-01T07:51:57.324956+0000","last_became_peered":"2023-10-01T07:51:57.324956+0000","last_unstale":"2023-10-01T07:51:57.335623+0000","last_undegraded":"2023-10-01T07:51:57.335623+0000","last_fullsized":"2023-10-01T07:51:57.335623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.321164+0000","last_change":"2023-10-01T07:51:57.316882+0000","last_active":"2023-10-01T07:51:57.321164+0000","last_peered":"2023-10-01T07:51:57.321164+0000","last_clean":"2023-10-01T07:51:57.321164+0000","last_became_active":"2023-10-01T07:51:57.316026+0000","last_became_peered":"2023-10-01T07:51:57.316026+0000","last_unstale":"2023-10-01T07:51:57.321164+0000","last_undegraded":"2023-10-01T07:51:57.321164+0000","last_fullsized":"2023-10-01T07:51:57.321164+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.343491+0000","last_change":"2023-10-01T07:51:57.340110+0000","last_active":"2023-10-01T07:51:57.343491+0000","last_peered":"2023-10-01T07:51:57.343491+0000","last_clean":"2023-10-01T07:51:57.343491+0000","last_became_active":"2023-10-01T07:51:57.339795+0000","last_became_peered":"2023-10-01T07:51:57.339795+0000","last_unstale":"2023-10-01T07:51:57.343491+0000","last_undegraded":"2023-10-01T07:51:57.343491+0000","last_fullsized":"2023-10-01T07:51:57.343491+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348821+0000","last_change":"2023-10-01T07:51:57.347691+0000","last_active":"2023-10-01T07:51:57.348821+0000","last_peered":"2023-10-01T07:51:57.348821+0000","last_clean":"2023-10-01T07:51:57.348821+0000","last_became_active":"2023-10-01T07:51:57.347374+0000","last_became_peered":"2023-10-01T07:51:57.347374+0000","last_unstale":"2023-10-01T07:51:57.348821+0000","last_undegraded":"2023-10-01T07:51:57.348821+0000","last_fullsized":"2023-10-01T07:51:57.348821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348551+0000","last_change":"2023-10-01T07:51:57.341479+0000","last_active":"2023-10-01T07:51:57.348551+0000","last_peered":"2023-10-01T07:51:57.348551+0000","last_clean":"2023-10-01T07:51:57.348551+0000","last_became_active":"2023-10-01T07:51:57.341064+0000","last_became_peered":"2023-10-01T07:51:57.341064+0000","last_unstale":"2023-10-01T07:51:57.348551+0000","last_undegraded":"2023-10-01T07:51:57.348551+0000","last_fullsized":"2023-10-01T07:51:57.348551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.338618+0000","last_change":"2023-10-01T07:51:57.332063+0000","last_active":"2023-10-01T07:51:57.338618+0000","last_peered":"2023-10-01T07:51:57.338618+0000","last_clean":"2023-10-01T07:51:57.338618+0000","last_became_active":"2023-10-01T07:51:57.331511+0000","last_became_peered":"2023-10-01T07:51:57.331511+0000","last_unstale":"2023-10-01T07:51:57.338618+0000","last_undegraded":"2023-10-01T07:51:57.338618+0000","last_fullsized":"2023-10-01T07:51:57.338618+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345085+0000","last_change":"2023-10-01T07:51:57.325516+0000","last_active":"2023-10-01T07:51:57.345085+0000","last_peered":"2023-10-01T07:51:57.345085+0000","last_clean":"2023-10-01T07:51:57.345085+0000","last_became_active":"2023-10-01T07:51:57.324549+0000","last_became_peered":"2023-10-01T07:51:57.324549+0000","last_unstale":"2023-10-01T07:51:57.345085+0000","last_undegraded":"2023-10-01T07:51:57.345085+0000","last_fullsized":"2023-10-01T07:51:57.345085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.336578+0000","last_change":"2023-10-01T07:51:57.334881+0000","last_active":"2023-10-01T07:51:57.336578+0000","last_peered":"2023-10-01T07:51:57.336578+0000","last_clean":"2023-10-01T07:51:57.336578+0000","last_became_active":"2023-10-01T07:51:57.334682+0000","last_became_peered":"2023-10-01T07:51:57.334682+0000","last_unstale":"2023-10-01T07:51:57.336578+0000","last_undegraded":"2023-10-01T07:51:57.336578+0000","last_fullsized":"2023-10-01T07:51:57.336578+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.336811+0000","last_change":"2023-10-01T07:51:57.334700+0000","last_active":"2023-10-01T07:51:57.336811+0000","last_peered":"2023-10-01T07:51:57.336811+0000","last_clean":"2023-10-01T07:51:57.336811+0000","last_became_active":"2023-10-01T07:51:57.334406+0000","last_became_peered":"2023-10-01T07:51:57.334406+0000","last_unstale":"2023-10-01T07:51:57.336811+0000","last_undegraded":"2023-10-01T07:51:57.336811+0000","last_fullsized":"2023-10-01T07:51:57.336811+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.337601+0000","last_change":"2023-10-01T07:51:57.323470+0000","last_active":"2023-10-01T07:51:57.337601+0000","last_peered":"2023-10-01T07:51:57.337601+0000","last_clean":"2023-10-01T07:51:57.337601+0000","last_became_active":"2023-10-01T07:51:57.323181+0000","last_became_peered":"2023-10-01T07:51:57.323181+0000","last_unstale":"2023-10-01T07:51:57.337601+0000","last_undegraded":"2023-10-01T07:51:57.337601+0000","last_fullsized":"2023-10-01T07:51:57.337601+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.347475+0000","last_change":"2023-10-01T07:51:57.339412+0000","last_active":"2023-10-01T07:51:57.347475+0000","last_peered":"2023-10-01T07:51:57.347475+0000","last_clean":"2023-10-01T07:51:57.347475+0000","last_became_active":"2023-10-01T07:51:57.338796+0000","last_became_peered":"2023-10-01T07:51:57.338796+0000","last_unstale":"2023-10-01T07:51:57.347475+0000","last_undegraded":"2023-10-01T07:51:57.347475+0000","last_fullsized":"2023-10-01T07:51:57.347475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.321447+0000","last_change":"2023-10-01T07:51:56.911245+0000","last_active":"2023-10-01T07:51:57.321447+0000","last_peered":"2023-10-01T07:51:57.321447+0000","last_clean":"2023-10-01T07:51:57.321447+0000","last_became_active":"2023-10-01T07:51:56.910930+0000","last_became_peered":"2023-10-01T07:51:56.910930+0000","last_unstale":"2023-10-01T07:51:57.321447+0000","last_undegraded":"2023-10-01T07:51:57.321447+0000","last_fullsized":"2023-10-01T07:51:57.321447+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348455+0000","last_change":"2023-10-01T07:51:57.343694+0000","last_active":"2023-10-01T07:51:57.348455+0000","last_peered":"2023-10-01T07:51:57.348455+0000","last_clean":"2023-10-01T07:51:57.348455+0000","last_became_active":"2023-10-01T07:51:57.343082+0000","last_became_peered":"2023-10-01T07:51:57.343082+0000","last_unstale":"2023-10-01T07:51:57.348455+0000","last_undegraded":"2023-10-01T07:51:57.348455+0000","last_fullsized":"2023-10-01T07:51:57.348455+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.310075+0000","last_change":"2023-10-01T07:51:56.919246+0000","last_active":"2023-10-01T07:51:57.310075+0000","last_peered":"2023-10-01T07:51:57.310075+0000","last_clean":"2023-10-01T07:51:57.310075+0000","last_became_active":"2023-10-01T07:51:56.918962+0000","last_became_peered":"2023-10-01T07:51:56.918962+0000","last_unstale":"2023-10-01T07:51:57.310075+0000","last_undegraded":"2023-10-01T07:51:57.310075+0000","last_fullsized":"2023-10-01T07:51:57.310075+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.338500+0000","last_change":"2023-10-01T07:51:57.335143+0000","last_active":"2023-10-01T07:51:57.338500+0000","last_peered":"2023-10-01T07:51:57.338500+0000","last_clean":"2023-10-01T07:51:57.338500+0000","last_became_active":"2023-10-01T07:51:57.334730+0000","last_became_peered":"2023-10-01T07:51:57.334730+0000","last_unstale":"2023-10-01T07:51:57.338500+0000","last_undegraded":"2023-10-01T07:51:57.338500+0000","last_fullsized":"2023-10-01T07:51:57.338500+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.309155+0000","last_change":"2023-10-01T07:51:56.914663+0000","last_active":"2023-10-01T07:51:57.309155+0000","last_peered":"2023-10-01T07:51:57.309155+0000","last_clean":"2023-10-01T07:51:57.309155+0000","last_became_active":"2023-10-01T07:51:56.914321+0000","last_became_peered":"2023-10-01T07:51:56.914321+0000","last_unstale":"2023-10-01T07:51:57.309155+0000","last_undegraded":"2023-10-01T07:51:57.309155+0000","last_fullsized":"2023-10-01T07:51:57.309155+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348872+0000","last_change":"2023-10-01T07:51:57.345818+0000","last_active":"2023-10-01T07:51:57.348872+0000","last_peered":"2023-10-01T07:51:57.348872+0000","last_clean":"2023-10-01T07:51:57.348872+0000","last_became_active":"2023-10-01T07:51:57.345561+0000","last_became_peered":"2023-10-01T07:51:57.345561+0000","last_unstale":"2023-10-01T07:51:57.348872+0000","last_undegraded":"2023-10-01T07:51:57.348872+0000","last_fullsized":"2023-10-01T07:51:57.348872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.305995+0000","last_change":"2023-10-01T07:51:56.916086+0000","last_active":"2023-10-01T07:51:57.305995+0000","last_peered":"2023-10-01T07:51:57.305995+0000","last_clean":"2023-10-01T07:51:57.305995+0000","last_became_active":"2023-10-01T07:51:56.912164+0000","last_became_peered":"2023-10-01T07:51:56.912164+0000","last_unstale":"2023-10-01T07:51:57.305995+0000","last_undegraded":"2023-10-01T07:51:57.305995+0000","last_fullsized":"2023-10-01T07:51:57.305995+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.347640+0000","last_change":"2023-10-01T07:51:57.340361+0000","last_active":"2023-10-01T07:51:57.347640+0000","last_peered":"2023-10-01T07:51:57.347640+0000","last_clean":"2023-10-01T07:51:57.347640+0000","last_became_active":"2023-10-01T07:51:57.339753+0000","last_became_peered":"2023-10-01T07:51:57.339753+0000","last_unstale":"2023-10-01T07:51:57.347640+0000","last_undegraded":"2023-10-01T07:51:57.347640+0000","last_fullsized":"2023-10-01T07:51:57.347640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.308978+0000","last_change":"2023-10-01T07:51:56.917428+0000","last_active":"2023-10-01T07:51:57.308978+0000","last_peered":"2023-10-01T07:51:57.308978+0000","last_clean":"2023-10-01T07:51:57.308978+0000","last_became_active":"2023-10-01T07:51:56.916781+0000","last_became_peered":"2023-10-01T07:51:56.916781+0000","last_unstale":"2023-10-01T07:51:57.308978+0000","last_undegraded":"2023-10-01T07:51:57.308978+0000","last_fullsized":"2023-10-01T07:51:57.308978+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.347478+0000","last_change":"2023-10-01T07:51:57.339022+0000","last_active":"2023-10-01T07:51:57.347478+0000","last_peered":"2023-10-01T07:51:57.347478+0000","last_clean":"2023-10-01T07:51:57.347478+0000","last_became_active":"2023-10-01T07:51:57.338710+0000","last_became_peered":"2023-10-01T07:51:57.338710+0000","last_unstale":"2023-10-01T07:51:57.347478+0000","last_undegraded":"2023-10-01T07:51:57.347478+0000","last_fullsized":"2023-10-01T07:51:57.347478+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345213+0000","last_change":"2023-10-01T07:51:56.914774+0000","last_active":"2023-10-01T07:51:57.345213+0000","last_peered":"2023-10-01T07:51:57.345213+0000","last_clean":"2023-10-01T07:51:57.345213+0000","last_became_active":"2023-10-01T07:51:56.912021+0000","last_became_peered":"2023-10-01T07:51:56.912021+0000","last_unstale":"2023-10-01T07:51:57.345213+0000","last_undegraded":"2023-10-01T07:51:57.345213+0000","last_fullsized":"2023-10-01T07:51:57.345213+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.333273+0000","last_change":"2023-10-01T07:51:57.331183+0000","last_active":"2023-10-01T07:51:57.333273+0000","last_peered":"2023-10-01T07:51:57.333273+0000","last_clean":"2023-10-01T07:51:57.333273+0000","last_became_active":"2023-10-01T07:51:57.330934+0000","last_became_peered":"2023-10-01T07:51:57.330934+0000","last_unstale":"2023-10-01T07:51:57.333273+0000","last_undegraded":"2023-10-01T07:51:57.333273+0000","last_fullsized":"2023-10-01T07:51:57.333273+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"16'6","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.350817+0000","last_change":"2023-10-01T07:51:56.925053+0000","last_active":"2023-10-01T07:51:57.350817+0000","last_peered":"2023-10-01T07:51:57.350817+0000","last_clean":"2023-10-01T07:51:57.350817+0000","last_became_active":"2023-10-01T07:51:56.924755+0000","last_became_peered":"2023-10-01T07:51:56.924755+0000","last_unstale":"2023-10-01T07:51:57.350817+0000","last_undegraded":"2023-10-01T07:51:57.350817+0000","last_fullsized":"2023-10-01T07:51:57.350817+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.344513+0000","last_change":"2023-10-01T07:51:57.341789+0000","last_active":"2023-10-01T07:51:57.344513+0000","last_peered":"2023-10-01T07:51:57.344513+0000","last_clean":"2023-10-01T07:51:57.344513+0000","last_became_active":"2023-10-01T07:51:57.340852+0000","last_became_peered":"2023-10-01T07:51:57.340852+0000","last_unstale":"2023-10-01T07:51:57.344513+0000","last_undegraded":"2023-10-01T07:51:57.344513+0000","last_fullsized":"2023-10-01T07:51:57.344513+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.344307+0000","last_change":"2023-10-01T07:51:56.924181+0000","last_active":"2023-10-01T07:51:57.344307+0000","last_peered":"2023-10-01T07:51:57.344307+0000","last_clean":"2023-10-01T07:51:57.344307+0000","last_became_active":"2023-10-01T07:51:56.923560+0000","last_became_peered":"2023-10-01T07:51:56.923560+0000","last_unstale":"2023-10-01T07:51:57.344307+0000","last_undegraded":"2023-10-01T07:51:57.344307+0000","last_fullsized":"2023-10-01T07:51:57.344307+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348258+0000","last_change":"2023-10-01T07:51:57.341678+0000","last_active":"2023-10-01T07:51:57.348258+0000","last_peered":"2023-10-01T07:51:57.348258+0000","last_clean":"2023-10-01T07:51:57.348258+0000","last_became_active":"2023-10-01T07:51:57.339190+0000","last_became_peered":"2023-10-01T07:51:57.339190+0000","last_unstale":"2023-10-01T07:51:57.348258+0000","last_undegraded":"2023-10-01T07:51:57.348258+0000","last_fullsized":"2023-10-01T07:51:57.348258+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.301106+0000","last_change":"2023-10-01T07:51:56.915181+0000","last_active":"2023-10-01T07:51:57.301106+0000","last_peered":"2023-10-01T07:51:57.301106+0000","last_clean":"2023-10-01T07:51:57.301106+0000","last_became_active":"2023-10-01T07:51:56.914858+0000","last_became_peered":"2023-10-01T07:51:56.914858+0000","last_unstale":"2023-10-01T07:51:57.301106+0000","last_undegraded":"2023-10-01T07:51:57.301106+0000","last_fullsized":"2023-10-01T07:51:57.301106+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.347494+0000","last_change":"2023-10-01T07:51:57.339439+0000","last_active":"2023-10-01T07:51:57.347494+0000","last_peered":"2023-10-01T07:51:57.347494+0000","last_clean":"2023-10-01T07:51:57.347494+0000","last_became_active":"2023-10-01T07:51:57.339208+0000","last_became_peered":"2023-10-01T07:51:57.339208+0000","last_unstale":"2023-10-01T07:51:57.347494+0000","last_undegraded":"2023-10-01T07:51:57.347494+0000","last_fullsized":"2023-10-01T07:51:57.347494+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.313566+0000","last_change":"2023-10-01T07:51:56.926432+0000","last_active":"2023-10-01T07:51:57.313566+0000","last_peered":"2023-10-01T07:51:57.313566+0000","last_clean":"2023-10-01T07:51:57.313566+0000","last_became_active":"2023-10-01T07:51:56.926080+0000","last_became_peered":"2023-10-01T07:51:56.926080+0000","last_unstale":"2023-10-01T07:51:57.313566+0000","last_undegraded":"2023-10-01T07:51:57.313566+0000","last_fullsized":"2023-10-01T07:51:57.313566+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335190+0000","last_change":"2023-10-01T07:51:57.325464+0000","last_active":"2023-10-01T07:51:57.335190+0000","last_peered":"2023-10-01T07:51:57.335190+0000","last_clean":"2023-10-01T07:51:57.335190+0000","last_became_active":"2023-10-01T07:51:57.325143+0000","last_became_peered":"2023-10-01T07:51:57.325143+0000","last_unstale":"2023-10-01T07:51:57.335190+0000","last_undegraded":"2023-10-01T07:51:57.335190+0000","last_fullsized":"2023-10-01T07:51:57.335190+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.346026+0000","last_change":"2023-10-01T07:51:56.922808+0000","last_active":"2023-10-01T07:51:57.346026+0000","last_peered":"2023-10-01T07:51:57.346026+0000","last_clean":"2023-10-01T07:51:57.346026+0000","last_became_active":"2023-10-01T07:51:56.922520+0000","last_became_peered":"2023-10-01T07:51:56.922520+0000","last_unstale":"2023-10-01T07:51:57.346026+0000","last_undegraded":"2023-10-01T07:51:57.346026+0000","last_fullsized":"2023-10-01T07:51:57.346026+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348893+0000","last_change":"2023-10-01T07:51:57.346026+0000","last_active":"2023-10-01T07:51:57.348893+0000","last_peered":"2023-10-01T07:51:57.348893+0000","last_clean":"2023-10-01T07:51:57.348893+0000","last_became_active":"2023-10-01T07:51:57.345720+0000","last_became_peered":"2023-10-01T07:51:57.345720+0000","last_unstale":"2023-10-01T07:51:57.348893+0000","last_undegraded":"2023-10-01T07:51:57.348893+0000","last_fullsized":"2023-10-01T07:51:57.348893+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.334758+0000","last_change":"2023-10-01T07:51:56.922474+0000","last_active":"2023-10-01T07:51:57.334758+0000","last_peered":"2023-10-01T07:51:57.334758+0000","last_clean":"2023-10-01T07:51:57.334758+0000","last_became_active":"2023-10-01T07:51:56.921742+0000","last_became_peered":"2023-10-01T07:51:56.921742+0000","last_unstale":"2023-10-01T07:51:57.334758+0000","last_undegraded":"2023-10-01T07:51:57.334758+0000","last_fullsized":"2023-10-01T07:51:57.334758+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.347658+0000","last_change":"2023-10-01T07:51:57.340546+0000","last_active":"2023-10-01T07:51:57.347658+0000","last_peered":"2023-10-01T07:51:57.347658+0000","last_clean":"2023-10-01T07:51:57.347658+0000","last_became_active":"2023-10-01T07:51:57.340112+0000","last_became_peered":"2023-10-01T07:51:57.340112+0000","last_unstale":"2023-10-01T07:51:57.347658+0000","last_undegraded":"2023-10-01T07:51:57.347658+0000","last_fullsized":"2023-10-01T07:51:57.347658+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.323389+0000","last_change":"2023-10-01T07:51:56.917629+0000","last_active":"2023-10-01T07:51:57.323389+0000","last_peered":"2023-10-01T07:51:57.323389+0000","last_clean":"2023-10-01T07:51:57.323389+0000","last_became_active":"2023-10-01T07:51:56.917154+0000","last_became_peered":"2023-10-01T07:51:56.917154+0000","last_unstale":"2023-10-01T07:51:57.323389+0000","last_undegraded":"2023-10-01T07:51:57.323389+0000","last_fullsized":"2023-10-01T07:51:57.323389+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348565+0000","last_change":"2023-10-01T07:51:57.340793+0000","last_active":"2023-10-01T07:51:57.348565+0000","last_peered":"2023-10-01T07:51:57.348565+0000","last_clean":"2023-10-01T07:51:57.348565+0000","last_became_active":"2023-10-01T07:51:57.340504+0000","last_became_peered":"2023-10-01T07:51:57.340504+0000","last_unstale":"2023-10-01T07:51:57.348565+0000","last_undegraded":"2023-10-01T07:51:57.348565+0000","last_fullsized":"2023-10-01T07:51:57.348565+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.344349+0000","last_change":"2023-10-01T07:51:56.925699+0000","last_active":"2023-10-01T07:51:57.344349+0000","last_peered":"2023-10-01T07:51:57.344349+0000","last_clean":"2023-10-01T07:51:57.344349+0000","last_became_active":"2023-10-01T07:51:56.925216+0000","last_became_peered":"2023-10-01T07:51:56.925216+0000","last_unstale":"2023-10-01T07:51:57.344349+0000","last_undegraded":"2023-10-01T07:51:57.344349+0000","last_fullsized":"2023-10-01T07:51:57.344349+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.343873+0000","last_change":"2023-10-01T07:51:57.340445+0000","last_active":"2023-10-01T07:51:57.343873+0000","last_peered":"2023-10-01T07:51:57.343873+0000","last_clean":"2023-10-01T07:51:57.343873+0000","last_became_active":"2023-10-01T07:51:57.340180+0000","last_became_peered":"2023-10-01T07:51:57.340180+0000","last_unstale":"2023-10-01T07:51:57.343873+0000","last_undegraded":"2023-10-01T07:51:57.343873+0000","last_fullsized":"2023-10-01T07:51:57.343873+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.303411+0000","last_change":"2023-10-01T07:51:56.915532+0000","last_active":"2023-10-01T07:51:57.303411+0000","last_peered":"2023-10-01T07:51:57.303411+0000","last_clean":"2023-10-01T07:51:57.303411+0000","last_became_active":"2023-10-01T07:51:56.912225+0000","last_became_peered":"2023-10-01T07:51:56.912225+0000","last_unstale":"2023-10-01T07:51:57.303411+0000","last_undegraded":"2023-10-01T07:51:57.303411+0000","last_fullsized":"2023-10-01T07:51:57.303411+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.338026+0000","last_change":"2023-10-01T07:51:57.331858+0000","last_active":"2023-10-01T07:51:57.338026+0000","last_peered":"2023-10-01T07:51:57.338026+0000","last_clean":"2023-10-01T07:51:57.338026+0000","last_became_active":"2023-10-01T07:51:57.331568+0000","last_became_peered":"2023-10-01T07:51:57.331568+0000","last_unstale":"2023-10-01T07:51:57.338026+0000","last_undegraded":"2023-10-01T07:51:57.338026+0000","last_fullsized":"2023-10-01T07:51:57.338026+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.342186+0000","last_change":"2023-10-01T07:51:56.924345+0000","last_active":"2023-10-01T07:51:57.342186+0000","last_peered":"2023-10-01T07:51:57.342186+0000","last_clean":"2023-10-01T07:51:57.342186+0000","last_became_active":"2023-10-01T07:51:56.923915+0000","last_became_peered":"2023-10-01T07:51:56.923915+0000","last_unstale":"2023-10-01T07:51:57.342186+0000","last_undegraded":"2023-10-01T07:51:57.342186+0000","last_fullsized":"2023-10-01T07:51:57.342186+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335325+0000","last_change":"2023-10-01T07:51:57.326926+0000","last_active":"2023-10-01T07:51:57.335325+0000","last_peered":"2023-10-01T07:51:57.335325+0000","last_clean":"2023-10-01T07:51:57.335325+0000","last_became_active":"2023-10-01T07:51:57.326597+0000","last_became_peered":"2023-10-01T07:51:57.326597+0000","last_unstale":"2023-10-01T07:51:57.335325+0000","last_undegraded":"2023-10-01T07:51:57.335325+0000","last_fullsized":"2023-10-01T07:51:57.335325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.306243+0000","last_change":"2023-10-01T07:51:56.918471+0000","last_active":"2023-10-01T07:51:57.306243+0000","last_peered":"2023-10-01T07:51:57.306243+0000","last_clean":"2023-10-01T07:51:57.306243+0000","last_became_active":"2023-10-01T07:51:56.918165+0000","last_became_peered":"2023-10-01T07:51:56.918165+0000","last_unstale":"2023-10-01T07:51:57.306243+0000","last_undegraded":"2023-10-01T07:51:57.306243+0000","last_fullsized":"2023-10-01T07:51:57.306243+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345107+0000","last_change":"2023-10-01T07:51:57.338218+0000","last_active":"2023-10-01T07:51:57.345107+0000","last_peered":"2023-10-01T07:51:57.345107+0000","last_clean":"2023-10-01T07:51:57.345107+0000","last_became_active":"2023-10-01T07:51:57.337910+0000","last_became_peered":"2023-10-01T07:51:57.337910+0000","last_unstale":"2023-10-01T07:51:57.345107+0000","last_undegraded":"2023-10-01T07:51:57.345107+0000","last_fullsized":"2023-10-01T07:51:57.345107+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.303371+0000","last_change":"2023-10-01T07:51:56.926078+0000","last_active":"2023-10-01T07:51:57.303371+0000","last_peered":"2023-10-01T07:51:57.303371+0000","last_clean":"2023-10-01T07:51:57.303371+0000","last_became_active":"2023-10-01T07:51:56.925681+0000","last_became_peered":"2023-10-01T07:51:56.925681+0000","last_unstale":"2023-10-01T07:51:57.303371+0000","last_undegraded":"2023-10-01T07:51:57.303371+0000","last_fullsized":"2023-10-01T07:51:57.303371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.344581+0000","last_change":"2023-10-01T07:51:57.340249+0000","last_active":"2023-10-01T07:51:57.344581+0000","last_peered":"2023-10-01T07:51:57.344581+0000","last_clean":"2023-10-01T07:51:57.344581+0000","last_became_active":"2023-10-01T07:51:57.339937+0000","last_became_peered":"2023-10-01T07:51:57.339937+0000","last_unstale":"2023-10-01T07:51:57.344581+0000","last_undegraded":"2023-10-01T07:51:57.344581+0000","last_fullsized":"2023-10-01T07:51:57.344581+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.303740+0000","last_change":"2023-10-01T07:51:56.918564+0000","last_active":"2023-10-01T07:51:57.303740+0000","last_peered":"2023-10-01T07:51:57.303740+0000","last_clean":"2023-10-01T07:51:57.303740+0000","last_became_active":"2023-10-01T07:51:56.918275+0000","last_became_peered":"2023-10-01T07:51:56.918275+0000","last_unstale":"2023-10-01T07:51:57.303740+0000","last_undegraded":"2023-10-01T07:51:57.303740+0000","last_fullsized":"2023-10-01T07:51:57.303740+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348828+0000","last_change":"2023-10-01T07:51:57.347574+0000","last_active":"2023-10-01T07:51:57.348828+0000","last_peered":"2023-10-01T07:51:57.348828+0000","last_clean":"2023-10-01T07:51:57.348828+0000","last_became_active":"2023-10-01T07:51:57.347243+0000","last_became_peered":"2023-10-01T07:51:57.347243+0000","last_unstale":"2023-10-01T07:51:57.348828+0000","last_undegraded":"2023-10-01T07:51:57.348828+0000","last_fullsized":"2023-10-01T07:51:57.348828+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.310517+0000","last_change":"2023-10-01T07:51:51.883413+0000","last_active":"2023-10-01T07:51:57.310517+0000","last_peered":"2023-10-01T07:51:57.310517+0000","last_clean":"2023-10-01T07:51:57.310517+0000","last_became_active":"2023-10-01T07:51:51.883088+0000","last_became_peered":"2023-10-01T07:51:51.883088+0000","last_unstale":"2023-10-01T07:51:57.310517+0000","last_undegraded":"2023-10-01T07:51:57.310517+0000","last_fullsized":"2023-10-01T07:51:57.310517+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.306486+0000","last_change":"2023-10-01T07:51:56.914139+0000","last_active":"2023-10-01T07:51:57.306486+0000","last_peered":"2023-10-01T07:51:57.306486+0000","last_clean":"2023-10-01T07:51:57.306486+0000","last_became_active":"2023-10-01T07:51:56.913026+0000","last_became_peered":"2023-10-01T07:51:56.913026+0000","last_unstale":"2023-10-01T07:51:57.306486+0000","last_undegraded":"2023-10-01T07:51:57.306486+0000","last_fullsized":"2023-10-01T07:51:57.306486+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.336585+0000","last_change":"2023-10-01T07:51:57.334103+0000","last_active":"2023-10-01T07:51:57.336585+0000","last_peered":"2023-10-01T07:51:57.336585+0000","last_clean":"2023-10-01T07:51:57.336585+0000","last_became_active":"2023-10-01T07:51:57.333743+0000","last_became_peered":"2023-10-01T07:51:57.333743+0000","last_unstale":"2023-10-01T07:51:57.336585+0000","last_undegraded":"2023-10-01T07:51:57.336585+0000","last_fullsized":"2023-10-01T07:51:57.336585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.309952+0000","last_change":"2023-10-01T07:51:51.882685+0000","last_active":"2023-10-01T07:51:57.309952+0000","last_peered":"2023-10-01T07:51:57.309952+0000","last_clean":"2023-10-01T07:51:57.309952+0000","last_became_active":"2023-10-01T07:51:51.882396+0000","last_became_peered":"2023-10-01T07:51:51.882396+0000","last_unstale":"2023-10-01T07:51:57.309952+0000","last_undegraded":"2023-10-01T07:51:57.309952+0000","last_fullsized":"2023-10-01T07:51:57.309952+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.300924+0000","last_change":"2023-10-01T07:51:56.915631+0000","last_active":"2023-10-01T07:51:57.300924+0000","last_peered":"2023-10-01T07:51:57.300924+0000","last_clean":"2023-10-01T07:51:57.300924+0000","last_became_active":"2023-10-01T07:51:56.911566+0000","last_became_peered":"2023-10-01T07:51:56.911566+0000","last_unstale":"2023-10-01T07:51:57.300924+0000","last_undegraded":"2023-10-01T07:51:57.300924+0000","last_fullsized":"2023-10-01T07:51:57.300924+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.329388+0000","last_change":"2023-10-01T07:51:57.319612+0000","last_active":"2023-10-01T07:51:57.329388+0000","last_peered":"2023-10-01T07:51:57.329388+0000","last_clean":"2023-10-01T07:51:57.329388+0000","last_became_active":"2023-10-01T07:51:57.319125+0000","last_became_peered":"2023-10-01T07:51:57.319125+0000","last_unstale":"2023-10-01T07:51:57.329388+0000","last_undegraded":"2023-10-01T07:51:57.329388+0000","last_fullsized":"2023-10-01T07:51:57.329388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.305149+0000","last_change":"2023-10-01T07:51:51.885336+0000","last_active":"2023-10-01T07:51:57.305149+0000","last_peered":"2023-10-01T07:51:57.305149+0000","last_clean":"2023-10-01T07:51:57.305149+0000","last_became_active":"2023-10-01T07:51:51.884991+0000","last_became_peered":"2023-10-01T07:51:51.884991+0000","last_unstale":"2023-10-01T07:51:57.305149+0000","last_undegraded":"2023-10-01T07:51:57.305149+0000","last_fullsized":"2023-10-01T07:51:57.305149+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.311818+0000","last_change":"2023-10-01T07:51:56.929636+0000","last_active":"2023-10-01T07:51:57.311818+0000","last_peered":"2023-10-01T07:51:57.311818+0000","last_clean":"2023-10-01T07:51:57.311818+0000","last_became_active":"2023-10-01T07:51:56.929308+0000","last_became_peered":"2023-10-01T07:51:56.929308+0000","last_unstale":"2023-10-01T07:51:57.311818+0000","last_undegraded":"2023-10-01T07:51:57.311818+0000","last_fullsized":"2023-10-01T07:51:57.311818+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.333038+0000","last_change":"2023-10-01T07:51:57.329162+0000","last_active":"2023-10-01T07:51:57.333038+0000","last_peered":"2023-10-01T07:51:57.333038+0000","last_clean":"2023-10-01T07:51:57.333038+0000","last_became_active":"2023-10-01T07:51:57.328749+0000","last_became_peered":"2023-10-01T07:51:57.328749+0000","last_unstale":"2023-10-01T07:51:57.333038+0000","last_undegraded":"2023-10-01T07:51:57.333038+0000","last_fullsized":"2023-10-01T07:51:57.333038+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.316966+0000","last_change":"2023-10-01T07:51:51.882657+0000","last_active":"2023-10-01T07:51:57.316966+0000","last_peered":"2023-10-01T07:51:57.316966+0000","last_clean":"2023-10-01T07:51:57.316966+0000","last_became_active":"2023-10-01T07:51:51.882334+0000","last_became_peered":"2023-10-01T07:51:51.882334+0000","last_unstale":"2023-10-01T07:51:57.316966+0000","last_undegraded":"2023-10-01T07:51:57.316966+0000","last_fullsized":"2023-10-01T07:51:57.316966+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.311710+0000","last_change":"2023-10-01T07:51:50.871456+0000","last_active":"2023-10-01T07:51:57.311710+0000","last_peered":"2023-10-01T07:51:57.311710+0000","last_clean":"2023-10-01T07:51:57.311710+0000","last_became_active":"2023-10-01T07:51:50.871112+0000","last_became_peered":"2023-10-01T07:51:50.871112+0000","last_unstale":"2023-10-01T07:51:57.311710+0000","last_undegraded":"2023-10-01T07:51:57.311710+0000","last_fullsized":"2023-10-01T07:51:57.311710+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:49.856372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:49.856372+0000","last_clean_scrub_stamp":"2023-10-01T07:51:49.856372+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.305919+0000","last_change":"2023-10-01T07:51:56.925843+0000","last_active":"2023-10-01T07:51:57.305919+0000","last_peered":"2023-10-01T07:51:57.305919+0000","last_clean":"2023-10-01T07:51:57.305919+0000","last_became_active":"2023-10-01T07:51:56.925538+0000","last_became_peered":"2023-10-01T07:51:56.925538+0000","last_unstale":"2023-10-01T07:51:57.305919+0000","last_undegraded":"2023-10-01T07:51:57.305919+0000","last_fullsized":"2023-10-01T07:51:57.305919+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.347449+0000","last_change":"2023-10-01T07:51:57.339219+0000","last_active":"2023-10-01T07:51:57.347449+0000","last_peered":"2023-10-01T07:51:57.347449+0000","last_clean":"2023-10-01T07:51:57.347449+0000","last_became_active":"2023-10-01T07:51:57.338416+0000","last_became_peered":"2023-10-01T07:51:57.338416+0000","last_unstale":"2023-10-01T07:51:57.347449+0000","last_undegraded":"2023-10-01T07:51:57.347449+0000","last_fullsized":"2023-10-01T07:51:57.347449+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.309046+0000","last_change":"2023-10-01T07:51:51.882831+0000","last_active":"2023-10-01T07:51:57.309046+0000","last_peered":"2023-10-01T07:51:57.309046+0000","last_clean":"2023-10-01T07:51:57.309046+0000","last_became_active":"2023-10-01T07:51:51.882490+0000","last_became_peered":"2023-10-01T07:51:51.882490+0000","last_unstale":"2023-10-01T07:51:57.309046+0000","last_undegraded":"2023-10-01T07:51:57.309046+0000","last_fullsized":"2023-10-01T07:51:57.309046+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.300429+0000","last_change":"2023-10-01T07:51:56.929720+0000","last_active":"2023-10-01T07:51:57.300429+0000","last_peered":"2023-10-01T07:51:57.300429+0000","last_clean":"2023-10-01T07:51:57.300429+0000","last_became_active":"2023-10-01T07:51:56.929370+0000","last_became_peered":"2023-10-01T07:51:56.929370+0000","last_unstale":"2023-10-01T07:51:57.300429+0000","last_undegraded":"2023-10-01T07:51:57.300429+0000","last_fullsized":"2023-10-01T07:51:57.300429+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.338477+0000","last_change":"2023-10-01T07:51:57.335095+0000","last_active":"2023-10-01T07:51:57.338477+0000","last_peered":"2023-10-01T07:51:57.338477+0000","last_clean":"2023-10-01T07:51:57.338477+0000","last_became_active":"2023-10-01T07:51:57.334324+0000","last_became_peered":"2023-10-01T07:51:57.334324+0000","last_unstale":"2023-10-01T07:51:57.338477+0000","last_undegraded":"2023-10-01T07:51:57.338477+0000","last_fullsized":"2023-10-01T07:51:57.338477+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.321040+0000","last_change":"2023-10-01T07:51:51.884196+0000","last_active":"2023-10-01T07:51:57.321040+0000","last_peered":"2023-10-01T07:51:57.321040+0000","last_clean":"2023-10-01T07:51:57.321040+0000","last_became_active":"2023-10-01T07:51:51.883784+0000","last_became_peered":"2023-10-01T07:51:51.883784+0000","last_unstale":"2023-10-01T07:51:57.321040+0000","last_undegraded":"2023-10-01T07:51:57.321040+0000","last_fullsized":"2023-10-01T07:51:57.321040+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.310257+0000","last_change":"2023-10-01T07:51:56.913348+0000","last_active":"2023-10-01T07:51:57.310257+0000","last_peered":"2023-10-01T07:51:57.310257+0000","last_clean":"2023-10-01T07:51:57.310257+0000","last_became_active":"2023-10-01T07:51:56.913041+0000","last_became_peered":"2023-10-01T07:51:56.913041+0000","last_unstale":"2023-10-01T07:51:57.310257+0000","last_undegraded":"2023-10-01T07:51:57.310257+0000","last_fullsized":"2023-10-01T07:51:57.310257+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.320737+0000","last_change":"2023-10-01T07:51:57.313930+0000","last_active":"2023-10-01T07:51:57.320737+0000","last_peered":"2023-10-01T07:51:57.320737+0000","last_clean":"2023-10-01T07:51:57.320737+0000","last_became_active":"2023-10-01T07:51:57.313613+0000","last_became_peered":"2023-10-01T07:51:57.313613+0000","last_unstale":"2023-10-01T07:51:57.320737+0000","last_undegraded":"2023-10-01T07:51:57.320737+0000","last_fullsized":"2023-10-01T07:51:57.320737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345351+0000","last_change":"2023-10-01T07:51:56.929769+0000","last_active":"2023-10-01T07:51:57.345351+0000","last_peered":"2023-10-01T07:51:57.345351+0000","last_clean":"2023-10-01T07:51:57.345351+0000","last_became_active":"2023-10-01T07:51:56.929479+0000","last_became_peered":"2023-10-01T07:51:56.929479+0000","last_unstale":"2023-10-01T07:51:57.345351+0000","last_undegraded":"2023-10-01T07:51:57.345351+0000","last_fullsized":"2023-10-01T07:51:57.345351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.312442+0000","last_change":"2023-10-01T07:51:51.883317+0000","last_active":"2023-10-01T07:51:57.312442+0000","last_peered":"2023-10-01T07:51:57.312442+0000","last_clean":"2023-10-01T07:51:57.312442+0000","last_became_active":"2023-10-01T07:51:51.883005+0000","last_became_peered":"2023-10-01T07:51:51.883005+0000","last_unstale":"2023-10-01T07:51:57.312442+0000","last_undegraded":"2023-10-01T07:51:57.312442+0000","last_fullsized":"2023-10-01T07:51:57.312442+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.346741+0000","last_change":"2023-10-01T07:51:57.325035+0000","last_active":"2023-10-01T07:51:57.346741+0000","last_peered":"2023-10-01T07:51:57.346741+0000","last_clean":"2023-10-01T07:51:57.346741+0000","last_became_active":"2023-10-01T07:51:57.324727+0000","last_became_peered":"2023-10-01T07:51:57.324727+0000","last_unstale":"2023-10-01T07:51:57.346741+0000","last_undegraded":"2023-10-01T07:51:57.346741+0000","last_fullsized":"2023-10-01T07:51:57.346741+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.322783+0000","last_change":"2023-10-01T07:51:51.883299+0000","last_active":"2023-10-01T07:51:57.322783+0000","last_peered":"2023-10-01T07:51:57.322783+0000","last_clean":"2023-10-01T07:51:57.322783+0000","last_became_active":"2023-10-01T07:51:51.883001+0000","last_became_peered":"2023-10-01T07:51:51.883001+0000","last_unstale":"2023-10-01T07:51:57.322783+0000","last_undegraded":"2023-10-01T07:51:57.322783+0000","last_fullsized":"2023-10-01T07:51:57.322783+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-01T07:51:58.305061+0000","last_change":"2023-10-01T07:51:56.921291+0000","last_active":"2023-10-01T07:51:58.305061+0000","last_peered":"2023-10-01T07:51:58.305061+0000","last_clean":"2023-10-01T07:51:58.305061+0000","last_became_active":"2023-10-01T07:51:56.920989+0000","last_became_peered":"2023-10-01T07:51:56.920989+0000","last_unstale":"2023-10-01T07:51:58.305061+0000","last_undegraded":"2023-10-01T07:51:58.305061+0000","last_fullsized":"2023-10-01T07:51:58.305061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.344273+0000","last_change":"2023-10-01T07:51:57.342916+0000","last_active":"2023-10-01T07:51:57.344273+0000","last_peered":"2023-10-01T07:51:57.344273+0000","last_clean":"2023-10-01T07:51:57.344273+0000","last_became_active":"2023-10-01T07:51:57.342653+0000","last_became_peered":"2023-10-01T07:51:57.342653+0000","last_unstale":"2023-10-01T07:51:57.344273+0000","last_undegraded":"2023-10-01T07:51:57.344273+0000","last_fullsized":"2023-10-01T07:51:57.344273+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.325920+0000","last_change":"2023-10-01T07:51:56.916437+0000","last_active":"2023-10-01T07:51:57.325920+0000","last_peered":"2023-10-01T07:51:57.325920+0000","last_clean":"2023-10-01T07:51:57.325920+0000","last_became_active":"2023-10-01T07:51:56.915935+0000","last_became_peered":"2023-10-01T07:51:56.915935+0000","last_unstale":"2023-10-01T07:51:57.325920+0000","last_undegraded":"2023-10-01T07:51:57.325920+0000","last_fullsized":"2023-10-01T07:51:57.325920+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.337204+0000","last_change":"2023-10-01T07:51:57.330536+0000","last_active":"2023-10-01T07:51:57.337204+0000","last_peered":"2023-10-01T07:51:57.337204+0000","last_clean":"2023-10-01T07:51:57.337204+0000","last_became_active":"2023-10-01T07:51:57.330151+0000","last_became_peered":"2023-10-01T07:51:57.330151+0000","last_unstale":"2023-10-01T07:51:57.337204+0000","last_undegraded":"2023-10-01T07:51:57.337204+0000","last_fullsized":"2023-10-01T07:51:57.337204+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.322423+0000","last_change":"2023-10-01T07:51:56.922316+0000","last_active":"2023-10-01T07:51:57.322423+0000","last_peered":"2023-10-01T07:51:57.322423+0000","last_clean":"2023-10-01T07:51:57.322423+0000","last_became_active":"2023-10-01T07:51:56.922003+0000","last_became_peered":"2023-10-01T07:51:56.922003+0000","last_unstale":"2023-10-01T07:51:57.322423+0000","last_undegraded":"2023-10-01T07:51:57.322423+0000","last_fullsized":"2023-10-01T07:51:57.322423+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.344530+0000","last_change":"2023-10-01T07:51:57.341976+0000","last_active":"2023-10-01T07:51:57.344530+0000","last_peered":"2023-10-01T07:51:57.344530+0000","last_clean":"2023-10-01T07:51:57.344530+0000","last_became_active":"2023-10-01T07:51:57.341188+0000","last_became_peered":"2023-10-01T07:51:57.341188+0000","last_unstale":"2023-10-01T07:51:57.344530+0000","last_undegraded":"2023-10-01T07:51:57.344530+0000","last_fullsized":"2023-10-01T07:51:57.344530+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.342897+0000","last_change":"2023-10-01T07:51:56.925522+0000","last_active":"2023-10-01T07:51:57.342897+0000","last_peered":"2023-10-01T07:51:57.342897+0000","last_clean":"2023-10-01T07:51:57.342897+0000","last_became_active":"2023-10-01T07:51:56.924830+0000","last_became_peered":"2023-10-01T07:51:56.924830+0000","last_unstale":"2023-10-01T07:51:57.342897+0000","last_undegraded":"2023-10-01T07:51:57.342897+0000","last_fullsized":"2023-10-01T07:51:57.342897+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.343893+0000","last_change":"2023-10-01T07:51:57.340653+0000","last_active":"2023-10-01T07:51:57.343893+0000","last_peered":"2023-10-01T07:51:57.343893+0000","last_clean":"2023-10-01T07:51:57.343893+0000","last_became_active":"2023-10-01T07:51:57.340395+0000","last_became_peered":"2023-10-01T07:51:57.340395+0000","last_unstale":"2023-10-01T07:51:57.343893+0000","last_undegraded":"2023-10-01T07:51:57.343893+0000","last_fullsized":"2023-10-01T07:51:57.343893+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.338671+0000","last_change":"2023-10-01T07:51:56.924298+0000","last_active":"2023-10-01T07:51:57.338671+0000","last_peered":"2023-10-01T07:51:57.338671+0000","last_clean":"2023-10-01T07:51:57.338671+0000","last_became_active":"2023-10-01T07:51:56.923975+0000","last_became_peered":"2023-10-01T07:51:56.923975+0000","last_unstale":"2023-10-01T07:51:57.338671+0000","last_undegraded":"2023-10-01T07:51:57.338671+0000","last_fullsized":"2023-10-01T07:51:57.338671+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.347457+0000","last_change":"2023-10-01T07:51:57.339026+0000","last_active":"2023-10-01T07:51:57.347457+0000","last_peered":"2023-10-01T07:51:57.347457+0000","last_clean":"2023-10-01T07:51:57.347457+0000","last_became_active":"2023-10-01T07:51:57.338722+0000","last_became_peered":"2023-10-01T07:51:57.338722+0000","last_unstale":"2023-10-01T07:51:57.347457+0000","last_undegraded":"2023-10-01T07:51:57.347457+0000","last_fullsized":"2023-10-01T07:51:57.347457+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335116+0000","last_change":"2023-10-01T07:51:56.922677+0000","last_active":"2023-10-01T07:51:57.335116+0000","last_peered":"2023-10-01T07:51:57.335116+0000","last_clean":"2023-10-01T07:51:57.335116+0000","last_became_active":"2023-10-01T07:51:56.922121+0000","last_became_peered":"2023-10-01T07:51:56.922121+0000","last_unstale":"2023-10-01T07:51:57.335116+0000","last_undegraded":"2023-10-01T07:51:57.335116+0000","last_fullsized":"2023-10-01T07:51:57.335116+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.337428+0000","last_change":"2023-10-01T07:51:57.329519+0000","last_active":"2023-10-01T07:51:57.337428+0000","last_peered":"2023-10-01T07:51:57.337428+0000","last_clean":"2023-10-01T07:51:57.337428+0000","last_became_active":"2023-10-01T07:51:57.329191+0000","last_became_peered":"2023-10-01T07:51:57.329191+0000","last_unstale":"2023-10-01T07:51:57.337428+0000","last_undegraded":"2023-10-01T07:51:57.337428+0000","last_fullsized":"2023-10-01T07:51:57.337428+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335155+0000","last_change":"2023-10-01T07:51:57.320100+0000","last_active":"2023-10-01T07:51:57.335155+0000","last_peered":"2023-10-01T07:51:57.335155+0000","last_clean":"2023-10-01T07:51:57.335155+0000","last_became_active":"2023-10-01T07:51:57.319593+0000","last_became_peered":"2023-10-01T07:51:57.319593+0000","last_unstale":"2023-10-01T07:51:57.335155+0000","last_undegraded":"2023-10-01T07:51:57.335155+0000","last_fullsized":"2023-10-01T07:51:57.335155+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345109+0000","last_change":"2023-10-01T07:51:57.325707+0000","last_active":"2023-10-01T07:51:57.345109+0000","last_peered":"2023-10-01T07:51:57.345109+0000","last_clean":"2023-10-01T07:51:57.345109+0000","last_became_active":"2023-10-01T07:51:57.324870+0000","last_became_peered":"2023-10-01T07:51:57.324870+0000","last_unstale":"2023-10-01T07:51:57.345109+0000","last_undegraded":"2023-10-01T07:51:57.345109+0000","last_fullsized":"2023-10-01T07:51:57.345109+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.334378+0000","last_change":"2023-10-01T07:51:57.326270+0000","last_active":"2023-10-01T07:51:57.334378+0000","last_peered":"2023-10-01T07:51:57.334378+0000","last_clean":"2023-10-01T07:51:57.334378+0000","last_became_active":"2023-10-01T07:51:57.325956+0000","last_became_peered":"2023-10-01T07:51:57.325956+0000","last_unstale":"2023-10-01T07:51:57.334378+0000","last_undegraded":"2023-10-01T07:51:57.334378+0000","last_fullsized":"2023-10-01T07:51:57.334378+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.344374+0000","last_change":"2023-10-01T07:51:57.338041+0000","last_active":"2023-10-01T07:51:57.344374+0000","last_peered":"2023-10-01T07:51:57.344374+0000","last_clean":"2023-10-01T07:51:57.344374+0000","last_became_active":"2023-10-01T07:51:57.337719+0000","last_became_peered":"2023-10-01T07:51:57.337719+0000","last_unstale":"2023-10-01T07:51:57.344374+0000","last_undegraded":"2023-10-01T07:51:57.344374+0000","last_fullsized":"2023-10-01T07:51:57.344374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.329368+0000","last_change":"2023-10-01T07:51:57.319429+0000","last_active":"2023-10-01T07:51:57.329368+0000","last_peered":"2023-10-01T07:51:57.329368+0000","last_clean":"2023-10-01T07:51:57.329368+0000","last_became_active":"2023-10-01T07:51:57.318849+0000","last_became_peered":"2023-10-01T07:51:57.318849+0000","last_unstale":"2023-10-01T07:51:57.329368+0000","last_undegraded":"2023-10-01T07:51:57.329368+0000","last_fullsized":"2023-10-01T07:51:57.329368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297264,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074576,"statfs":{"total":96636764160,"available":96332365824,"internally_reserved":0,"allocated":172032,"data_stored":48929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]}]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":48735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":47899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":47845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-01T07:52:06.255 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-01T07:52:06.255 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-01T07:52:06.255 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-01T07:52:06.255 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-01T07:52:06.256 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-01T07:52:06.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.423+0000 7fb50c10c700 1 Processor -- start 2023-10-01T07:52:06.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.423+0000 7fb50c10c700 1 -- start start 2023-10-01T07:52:06.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.424+0000 7fb50c10c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb50412ecd0 0x7fb50412f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:06.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.424+0000 7fb50c10c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb504134060 0x7fb504136450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:06.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.424+0000 7fb50c10c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb504059ba0 con 0x7fb504059070 2023-10-01T07:52:06.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.424+0000 7fb50c10c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5040969b0 con 0x7fb504134060 2023-10-01T07:52:06.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.424+0000 7fb50c10c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb504092320 con 0x7fb50412ecd0 2023-10-01T07:52:06.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.424+0000 7fb5096a7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb50412ecd0 0x7fb50412f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:06.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.424+0000 7fb50a6a9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb504134060 0x7fb504136450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:06.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.424+0000 7fb509ea8700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb504059070 0x7fb50412f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:40426/0 (socket says 172.21.15.26:40426) 2023-10-01T07:52:06.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.424+0000 7fb509ea8700 1 -- 172.21.15.26:0/2566753899 learned_addr learned my addr 172.21.15.26:0/2566753899 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:52:06.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.424+0000 7fb508ea6700 1 -- 172.21.15.26:0/2566753899 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4024954311 0 0) 0x7fb504059ba0 con 0x7fb504059070 2023-10-01T07:52:06.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.424+0000 7fb5096a7700 1 -- 172.21.15.26:0/2566753899 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb504134060 msgr2=0x7fb504136450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:06.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.424+0000 7fb5096a7700 1 --2- 172.21.15.26:0/2566753899 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb504134060 0x7fb504136450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:06.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.424+0000 7fb5096a7700 1 -- 172.21.15.26:0/2566753899 >> v1:172.21.15.26:6789/0 conn(0x7fb504059070 legacy=0x7fb50412f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:06.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.424+0000 7fb5096a7700 1 -- 172.21.15.26:0/2566753899 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb504091c10 con 0x7fb50412ecd0 2023-10-01T07:52:06.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.424+0000 7fb50a6a9700 1 --2- 172.21.15.26:0/2566753899 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb504134060 0x7fb504136450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:06.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.424+0000 7fb5096a7700 1 --2- 172.21.15.26:0/2566753899 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb50412ecd0 0x7fb50412f870 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fb4f8009790 tx=0x7fb4f8009060).ready entity=mon.2 client_cookie=fa2ec256befa84e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:06.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.425+0000 7fb508ea6700 1 -- 172.21.15.26:0/2566753899 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f80090d0 con 0x7fb50412ecd0 2023-10-01T07:52:06.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.425+0000 7fb508ea6700 1 -- 172.21.15.26:0/2566753899 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f800f510 con 0x7fb50412ecd0 2023-10-01T07:52:06.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.425+0000 7fb508ea6700 1 -- 172.21.15.26:0/2566753899 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f800f890 con 0x7fb50412ecd0 2023-10-01T07:52:06.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.425+0000 7fb50c10c700 1 -- 172.21.15.26:0/2566753899 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb50412ecd0 msgr2=0x7fb50412f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:06.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.425+0000 7fb50c10c700 1 --2- 172.21.15.26:0/2566753899 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb50412ecd0 0x7fb50412f870 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fb4f8009790 tx=0x7fb4f8009060).stop 2023-10-01T07:52:06.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.425+0000 7fb50c10c700 1 -- 172.21.15.26:0/2566753899 shutdown_connections 2023-10-01T07:52:06.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.425+0000 7fb50c10c700 1 --2- 172.21.15.26:0/2566753899 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb504134060 0x7fb504136450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:06.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.425+0000 7fb50c10c700 1 --2- 172.21.15.26:0/2566753899 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb50412ecd0 0x7fb50412f870 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:06.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.425+0000 7fb50c10c700 1 -- 172.21.15.26:0/2566753899 >> 172.21.15.26:0/2566753899 conn(0x7fb504097470 msgr2=0x7fb504097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:06.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.425+0000 7fb50c10c700 1 -- 172.21.15.26:0/2566753899 shutdown_connections 2023-10-01T07:52:06.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.425+0000 7fb50c10c700 1 -- 172.21.15.26:0/2566753899 wait complete. 2023-10-01T07:52:06.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.426+0000 7fb50c10c700 1 Processor -- start 2023-10-01T07:52:06.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.426+0000 7fb50c10c700 1 -- start start 2023-10-01T07:52:06.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.427+0000 7fb50c10c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb504059070 0x7fb504131e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:06.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.427+0000 7fb50c10c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb504134060 0x7fb50412f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:06.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.427+0000 7fb50c10c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb50412f860 0x7fb50412fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:06.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.427+0000 7fb50c10c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50406a520 con 0x7fb50412f860 2023-10-01T07:52:06.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.427+0000 7fb50c10c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb504132500 con 0x7fb504134060 2023-10-01T07:52:06.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.427+0000 7fb50c10c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5041301d0 con 0x7fb504059070 2023-10-01T07:52:06.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.427+0000 7fb509ea8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb504059070 0x7fb504131e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:06.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.427+0000 7fb5096a7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb504134060 0x7fb50412f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:06.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.427+0000 7fb509ea8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb504059070 0x7fb504131e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57440/0 (socket says 172.21.15.26:57440) 2023-10-01T07:52:06.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.427+0000 7fb50a6a9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb50412f860 0x7fb50412fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:06.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.427+0000 7fb509ea8700 1 -- 172.21.15.26:0/3398257178 learned_addr learned my addr 172.21.15.26:0/3398257178 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:06.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.427+0000 7fb5096a7700 1 --2- 172.21.15.26:0/3398257178 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb504134060 0x7fb50412f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55184/0 (socket says 172.21.15.26:55184) 2023-10-01T07:52:06.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.427+0000 7fb509ea8700 1 -- 172.21.15.26:0/3398257178 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb504134060 msgr2=0x7fb50412f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:06.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.427+0000 7fb509ea8700 1 --2- 172.21.15.26:0/3398257178 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb504134060 0x7fb50412f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:06.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.427+0000 7fb509ea8700 1 -- 172.21.15.26:0/3398257178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb50412f860 msgr2=0x7fb50412fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:06.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.427+0000 7fb509ea8700 1 --2- 172.21.15.26:0/3398257178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb50412f860 0x7fb50412fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:06.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.427+0000 7fb509ea8700 1 -- 172.21.15.26:0/3398257178 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4fc009a20 con 0x7fb504059070 2023-10-01T07:52:06.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.427+0000 7fb5096a7700 1 --2- 172.21.15.26:0/3398257178 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb504134060 0x7fb50412f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:06.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.427+0000 7fb50a6a9700 1 --2- 172.21.15.26:0/3398257178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb50412f860 0x7fb50412fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:06.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.427+0000 7fb509ea8700 1 --2- 172.21.15.26:0/3398257178 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb504059070 0x7fb504131e40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fb50000c520 tx=0x7fb500007c10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:06.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.428+0000 7fb4f5ffb700 1 -- 172.21.15.26:0/3398257178 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5000072e0 con 0x7fb504059070 2023-10-01T07:52:06.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.428+0000 7fb4f5ffb700 1 -- 172.21.15.26:0/3398257178 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb500007460 con 0x7fb504059070 2023-10-01T07:52:06.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.428+0000 7fb50c10c700 1 -- 172.21.15.26:0/3398257178 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f80092a0 con 0x7fb504059070 2023-10-01T07:52:06.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.428+0000 7fb4f5ffb700 1 -- 172.21.15.26:0/3398257178 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5000059f0 con 0x7fb504059070 2023-10-01T07:52:06.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.428+0000 7fb50c10c700 1 -- 172.21.15.26:0/3398257178 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb504132f10 con 0x7fb504059070 2023-10-01T07:52:06.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.429+0000 7fb4f5ffb700 1 -- 172.21.15.26:0/3398257178 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb500013450 con 0x7fb504059070 2023-10-01T07:52:06.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.429+0000 7fb4f5ffb700 1 -- 172.21.15.26:0/3398257178 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb50003a6c0 con 0x7fb504059070 2023-10-01T07:52:06.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.429+0000 7fb50c10c700 1 -- 172.21.15.26:0/3398257178 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb504132870 con 0x7fb504059070 2023-10-01T07:52:06.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.434+0000 7fb4f5ffb700 1 -- 172.21.15.26:0/3398257178 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fb504132870 con 0x7fb504059070 2023-10-01T07:52:06.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.654+0000 7fb50c10c700 1 -- 172.21.15.26:0/3398257178 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fb504132870 con 0x7fb504059070 2023-10-01T07:52:06.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.655+0000 7fb4f5ffb700 1 -- 172.21.15.26:0/3398257178 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+64129 (secure 0 0 0) 0x7fb504132870 con 0x7fb504059070 2023-10-01T07:52:06.656 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:52:06.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.657+0000 7fb50c10c700 1 -- 172.21.15.26:0/3398257178 >> v1:172.21.15.26:6816/118178 conn(0x7fb4e802bb60 legacy=0x7fb4e802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:06.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.657+0000 7fb50c10c700 1 -- 172.21.15.26:0/3398257178 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb504059070 msgr2=0x7fb504131e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:06.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.657+0000 7fb50c10c700 1 --2- 172.21.15.26:0/3398257178 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb504059070 0x7fb504131e40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fb50000c520 tx=0x7fb500007c10).stop 2023-10-01T07:52:06.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.657+0000 7fb50c10c700 1 -- 172.21.15.26:0/3398257178 shutdown_connections 2023-10-01T07:52:06.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.657+0000 7fb50c10c700 1 --2- 172.21.15.26:0/3398257178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb50412f860 0x7fb50412fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:06.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.657+0000 7fb50c10c700 1 --2- 172.21.15.26:0/3398257178 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb504059070 0x7fb504131e40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:06.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.657+0000 7fb50c10c700 1 --2- 172.21.15.26:0/3398257178 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb504134060 0x7fb50412f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:06.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.657+0000 7fb50c10c700 1 -- 172.21.15.26:0/3398257178 >> 172.21.15.26:0/3398257178 conn(0x7fb504097470 msgr2=0x7fb504135b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:06.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.657+0000 7fb50c10c700 1 -- 172.21.15.26:0/3398257178 shutdown_connections 2023-10-01T07:52:06.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.657+0000 7fb50c10c700 1 -- 172.21.15.26:0/3398257178 wait complete. 2023-10-01T07:52:06.671 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":4,"active_gid":4107,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6816","nonce":118178}]},"active_addr":"172.21.15.26:6816/118178","active_change":"2023-10-01T07:51:45.799786+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.26:0","nonce":616154075}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.26:0","nonce":1290599107}]}]} 2023-10-01T07:52:06.673 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-01T07:52:06.673 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-01T07:52:06.673 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-01T07:52:06.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.803+0000 7f0c38b10700 1 Processor -- start 2023-10-01T07:52:06.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.803+0000 7f0c38b10700 1 -- start start 2023-10-01T07:52:06.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.804+0000 7f0c38b10700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0c34066200 0x7f0c34097780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:06.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.804+0000 7f0c38b10700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c3412b300 0x7f0c34127500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:06.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.804+0000 7f0c38b10700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0c3412b720 0x7f0c341279f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:06.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.804+0000 7f0c38b10700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c34065740 con 0x7f0c3412b720 2023-10-01T07:52:06.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.804+0000 7f0c38b10700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c34064ef0 con 0x7f0c3412b300 2023-10-01T07:52:06.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.804+0000 7f0c38b10700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c34065a00 con 0x7f0c34066200 2023-10-01T07:52:06.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.804+0000 7f0c31d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c3412b300 0x7f0c34127500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:06.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.804+0000 7f0c32d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0c3412b720 0x7f0c341279f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:06.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.804+0000 7f0c3259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0c34066200 0x7f0c34097780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:06.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.804+0000 7f0c32d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0c3412b720 0x7f0c341279f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34242/0 (socket says 172.21.15.26:34242) 2023-10-01T07:52:06.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.804+0000 7f0c31d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c3412b300 0x7f0c34127500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55200/0 (socket says 172.21.15.26:55200) 2023-10-01T07:52:06.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.804+0000 7f0c32d9d700 1 -- 172.21.15.26:0/250014665 learned_addr learned my addr 172.21.15.26:0/250014665 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:06.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.804+0000 7f0c32d9d700 1 -- 172.21.15.26:0/250014665 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0c34066200 msgr2=0x7f0c34097780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:06.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.804+0000 7f0c32d9d700 1 --2- 172.21.15.26:0/250014665 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0c34066200 0x7f0c34097780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:06.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.804+0000 7f0c32d9d700 1 -- 172.21.15.26:0/250014665 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c3412b300 msgr2=0x7f0c34127500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:06.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.804+0000 7f0c32d9d700 1 --2- 172.21.15.26:0/250014665 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c3412b300 0x7f0c34127500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:06.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.804+0000 7f0c32d9d700 1 -- 172.21.15.26:0/250014665 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c340653c0 con 0x7f0c3412b720 2023-10-01T07:52:06.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.804+0000 7f0c3259c700 1 --2- 172.21.15.26:0/250014665 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0c34066200 0x7f0c34097780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:06.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.804+0000 7f0c31d9b700 1 --2- 172.21.15.26:0/250014665 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c3412b300 0x7f0c34127500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:06.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.804+0000 7f0c32d9d700 1 --2- 172.21.15.26:0/250014665 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c3412b720 0x7f0c341279f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f0c2c009f20 tx=0x7f0c2c009840).ready entity=mon.0 client_cookie=8f7221575e0fc87a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:06.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.804+0000 7f0c3159a700 1 -- 172.21.15.26:0/250014665 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c00e070 con 0x7f0c3412b720 2023-10-01T07:52:06.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.805+0000 7f0c3159a700 1 -- 172.21.15.26:0/250014665 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c2c00b970 con 0x7f0c3412b720 2023-10-01T07:52:06.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.805+0000 7f0c3159a700 1 -- 172.21.15.26:0/250014665 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c00bcf0 con 0x7f0c3412b720 2023-10-01T07:52:06.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.805+0000 7f0c38b10700 1 -- 172.21.15.26:0/250014665 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c3412b720 msgr2=0x7f0c341279f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:06.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.805+0000 7f0c38b10700 1 --2- 172.21.15.26:0/250014665 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c3412b720 0x7f0c341279f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f0c2c009f20 tx=0x7f0c2c009840).stop 2023-10-01T07:52:06.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.805+0000 7f0c38b10700 1 -- 172.21.15.26:0/250014665 shutdown_connections 2023-10-01T07:52:06.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.805+0000 7f0c38b10700 1 --2- 172.21.15.26:0/250014665 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c3412b720 0x7f0c341279f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:06.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.805+0000 7f0c38b10700 1 --2- 172.21.15.26:0/250014665 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0c34066200 0x7f0c34097780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:06.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.805+0000 7f0c38b10700 1 --2- 172.21.15.26:0/250014665 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c3412b300 0x7f0c34127500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:06.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.805+0000 7f0c38b10700 1 -- 172.21.15.26:0/250014665 >> 172.21.15.26:0/250014665 conn(0x7f0c3409ba50 msgr2=0x7f0c3409be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:06.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.805+0000 7f0c38b10700 1 -- 172.21.15.26:0/250014665 shutdown_connections 2023-10-01T07:52:06.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.805+0000 7f0c38b10700 1 -- 172.21.15.26:0/250014665 wait complete. 2023-10-01T07:52:06.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.806+0000 7f0c38b10700 1 Processor -- start 2023-10-01T07:52:06.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.807+0000 7f0c38b10700 1 -- start start 2023-10-01T07:52:06.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.807+0000 7f0c38b10700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0c34066200 0x7f0c34113e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:06.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.807+0000 7f0c38b10700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c3412b300 0x7f0c34114350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:06.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.807+0000 7f0c38b10700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c3412b720 0x7f0c34114840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:06.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.807+0000 7f0c38b10700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c34114d30 con 0x7f0c3412b300 2023-10-01T07:52:06.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.807+0000 7f0c38b10700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c341277a0 con 0x7f0c3412b720 2023-10-01T07:52:06.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.807+0000 7f0c38b10700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c34065120 con 0x7f0c34066200 2023-10-01T07:52:06.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.807+0000 7f0c31d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c3412b300 0x7f0c34114350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:06.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.807+0000 7f0c32d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c3412b720 0x7f0c34114840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:06.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.807+0000 7f0c3259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0c34066200 0x7f0c34113e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:06.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.807+0000 7f0c32d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c3412b720 0x7f0c34114840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55210/0 (socket says 172.21.15.26:55210) 2023-10-01T07:52:06.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.807+0000 7f0c3259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0c34066200 0x7f0c34113e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57450/0 (socket says 172.21.15.26:57450) 2023-10-01T07:52:06.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.807+0000 7f0c32d9d700 1 -- 172.21.15.26:0/1504012514 learned_addr learned my addr 172.21.15.26:0/1504012514 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:06.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.808+0000 7f0c32d9d700 1 -- 172.21.15.26:0/1504012514 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0c34066200 msgr2=0x7f0c34113e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:06.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.808+0000 7f0c32d9d700 1 --2- 172.21.15.26:0/1504012514 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0c34066200 0x7f0c34113e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:06.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.808+0000 7f0c32d9d700 1 -- 172.21.15.26:0/1504012514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c3412b300 msgr2=0x7f0c34114350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:06.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.808+0000 7f0c32d9d700 1 --2- 172.21.15.26:0/1504012514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c3412b300 0x7f0c34114350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:06.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.808+0000 7f0c32d9d700 1 -- 172.21.15.26:0/1504012514 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c240092a0 con 0x7f0c3412b720 2023-10-01T07:52:06.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.808+0000 7f0c31d9b700 1 --2- 172.21.15.26:0/1504012514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c3412b300 0x7f0c34114350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:06.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.808+0000 7f0c3259c700 1 --2- 172.21.15.26:0/1504012514 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0c34066200 0x7f0c34113e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:06.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.808+0000 7f0c32d9d700 1 --2- 172.21.15.26:0/1504012514 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c3412b720 0x7f0c34114840 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f0c34065880 tx=0x7f0c2c009840).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:06.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.808+0000 7f0c227fc700 1 -- 172.21.15.26:0/1504012514 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c013ea0 con 0x7f0c3412b720 2023-10-01T07:52:06.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.808+0000 7f0c227fc700 1 -- 172.21.15.26:0/1504012514 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c2c0092e0 con 0x7f0c3412b720 2023-10-01T07:52:06.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.808+0000 7f0c38b10700 1 -- 172.21.15.26:0/1504012514 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c280092a0 con 0x7f0c3412b720 2023-10-01T07:52:06.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.808+0000 7f0c227fc700 1 -- 172.21.15.26:0/1504012514 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c01f6d0 con 0x7f0c3412b720 2023-10-01T07:52:06.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.808+0000 7f0c38b10700 1 -- 172.21.15.26:0/1504012514 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c2c009ae0 con 0x7f0c3412b720 2023-10-01T07:52:06.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.809+0000 7f0c227fc700 1 -- 172.21.15.26:0/1504012514 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f0c2c003040 con 0x7f0c3412b720 2023-10-01T07:52:06.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.809+0000 7f0c227fc700 1 -- 172.21.15.26:0/1504012514 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f0c2c03ca10 con 0x7f0c3412b720 2023-10-01T07:52:06.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.809+0000 7f0c38b10700 1 -- 172.21.15.26:0/1504012514 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c34098d20 con 0x7f0c3412b720 2023-10-01T07:52:06.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.814+0000 7f0c227fc700 1 -- 172.21.15.26:0/1504012514 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f0c2c024020 con 0x7f0c3412b720 2023-10-01T07:52:06.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.990+0000 7f0c38b10700 1 -- 172.21.15.26:0/1504012514 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c34099070 con 0x7f0c3412b720 2023-10-01T07:52:06.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.991+0000 7f0c227fc700 1 -- 172.21.15.26:0/1504012514 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11341 (secure 0 0 0) 0x7f0c2c011370 con 0x7f0c3412b720 2023-10-01T07:52:06.991 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:52:06.992 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":17,"fsid":"c29fb19d-520c-42a6-90f4-e7f86de96e8e","created":"2023-10-01T07:51:40.702414+0000","modified":"2023-10-01T07:51:58.296715+0000","last_up_change":"2023-10-01T07:51:48.849482+0000","last_in_change":"2023-10-01T07:51:42.084736+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-01T07:51:48.906889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-01T07:51:50.071599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-01T07:51:54.981575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-01T07:51:56.286318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46569ce3-81d1-44a1-a649-691de3e6f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6800","nonce":118773}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6801","nonce":118773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6803","nonce":118773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6802","nonce":118773}]},"public_addr":"172.21.15.26:6800/118773","cluster_addr":"172.21.15.26:6801/118773","heartbeat_back_addr":"172.21.15.26:6803/118773","heartbeat_front_addr":"172.21.15.26:6802/118773","state":["exists","up"]},{"osd":1,"uuid":"1fc1ba9b-4110-4d31-96d6-794937578cff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6804","nonce":118782}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6806","nonce":118782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6810","nonce":118782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6808","nonce":118782}]},"public_addr":"172.21.15.26:6804/118782","cluster_addr":"172.21.15.26:6806/118782","heartbeat_back_addr":"172.21.15.26:6810/118782","heartbeat_front_addr":"172.21.15.26:6808/118782","state":["exists","up"]},{"osd":2,"uuid":"37de933d-3b8e-4b94-87bd-2f36896c7ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6805","nonce":118789}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6807","nonce":118789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6811","nonce":118789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6809","nonce":118789}]},"public_addr":"172.21.15.26:6805/118789","cluster_addr":"172.21.15.26:6807/118789","heartbeat_back_addr":"172.21.15.26:6811/118789","heartbeat_front_addr":"172.21.15.26:6809/118789","state":["exists","up"]},{"osd":3,"uuid":"bd020309-5fd2-4d97-b36a-67e159fa3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6812","nonce":118790}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6813","nonce":118790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6815","nonce":118790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6814","nonce":118790}]},"public_addr":"172.21.15.26:6812/118790","cluster_addr":"172.21.15.26:6813/118790","heartbeat_back_addr":"172.21.15.26:6815/118790","heartbeat_front_addr":"172.21.15.26:6814/118790","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.029993+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.266503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.273540+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.229731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-01T07:52:06.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.993+0000 7f0c38b10700 1 -- 172.21.15.26:0/1504012514 >> v1:172.21.15.26:6816/118178 conn(0x7f0c1402bb60 legacy=0x7f0c1402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:06.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.993+0000 7f0c38b10700 1 -- 172.21.15.26:0/1504012514 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c3412b720 msgr2=0x7f0c34114840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:06.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.993+0000 7f0c38b10700 1 --2- 172.21.15.26:0/1504012514 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c3412b720 0x7f0c34114840 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f0c34065880 tx=0x7f0c2c009840).stop 2023-10-01T07:52:06.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.993+0000 7f0c38b10700 1 -- 172.21.15.26:0/1504012514 shutdown_connections 2023-10-01T07:52:06.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.993+0000 7f0c38b10700 1 --2- 172.21.15.26:0/1504012514 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c3412b720 0x7f0c34114840 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:06.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.993+0000 7f0c38b10700 1 --2- 172.21.15.26:0/1504012514 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0c34066200 0x7f0c34113e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:06.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.993+0000 7f0c38b10700 1 --2- 172.21.15.26:0/1504012514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c3412b300 0x7f0c34114350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:06.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.993+0000 7f0c38b10700 1 -- 172.21.15.26:0/1504012514 >> 172.21.15.26:0/1504012514 conn(0x7f0c3409ba50 msgr2=0x7f0c3409ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:06.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.993+0000 7f0c38b10700 1 -- 172.21.15.26:0/1504012514 shutdown_connections 2023-10-01T07:52:06.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:06.993+0000 7f0c38b10700 1 -- 172.21.15.26:0/1504012514 wait complete. 2023-10-01T07:52:07.007 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-01T07:52:07.007 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-01T07:52:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.136+0000 7f2f84299700 1 Processor -- start 2023-10-01T07:52:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.137+0000 7f2f84299700 1 -- start start 2023-10-01T07:52:07.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.137+0000 7f2f84299700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f7c066200 0x7f2f7c0977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.137+0000 7f2f84299700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f7c1281c0 0x7f2f7c12b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.137+0000 7f2f84299700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f7c065740 con 0x7f2f7c127dc0 2023-10-01T07:52:07.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.137+0000 7f2f84299700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c0653a0 con 0x7f2f7c1281c0 2023-10-01T07:52:07.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.137+0000 7f2f84299700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c064ef0 con 0x7f2f7c066200 2023-10-01T07:52:07.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.137+0000 7f2f81834700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2f7c127dc0 0x7f2f7c12aaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:40442/0 (socket says 172.21.15.26:40442) 2023-10-01T07:52:07.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.137+0000 7f2f82035700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f7c066200 0x7f2f7c0977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.137+0000 7f2f81834700 1 -- 172.21.15.26:0/2939133191 learned_addr learned my addr 172.21.15.26:0/2939133191 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:52:07.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.137+0000 7f2f82836700 1 --2- 172.21.15.26:0/2939133191 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f7c1281c0 0x7f2f7c12b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.138+0000 7f2f81033700 1 -- 172.21.15.26:0/2939133191 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2776368084 0 0) 0x7f2f7c065740 con 0x7f2f7c127dc0 2023-10-01T07:52:07.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.138+0000 7f2f81033700 1 -- 172.21.15.26:0/2939133191 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f680033f0 con 0x7f2f7c127dc0 2023-10-01T07:52:07.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.138+0000 7f2f82035700 1 -- 172.21.15.26:0/2939133191 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f7c1281c0 msgr2=0x7f2f7c12b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:07.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.138+0000 7f2f82035700 1 --2- 172.21.15.26:0/2939133191 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f7c1281c0 0x7f2f7c12b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.138+0000 7f2f82035700 1 -- 172.21.15.26:0/2939133191 >> v1:172.21.15.26:6789/0 conn(0x7f2f7c127dc0 legacy=0x7f2f7c12aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.138+0000 7f2f82035700 1 -- 172.21.15.26:0/2939133191 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7c064a40 con 0x7f2f7c066200 2023-10-01T07:52:07.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.138+0000 7f2f82836700 1 --2- 172.21.15.26:0/2939133191 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f7c1281c0 0x7f2f7c12b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:07.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.138+0000 7f2f82035700 1 --2- 172.21.15.26:0/2939133191 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f7c066200 0x7f2f7c0977a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f2f78009790 tx=0x7f2f78009060).ready entity=mon.2 client_cookie=fd852a1e6d0f9e80 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:07.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.138+0000 7f2f81033700 1 -- 172.21.15.26:0/2939133191 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7800f510 con 0x7f2f7c066200 2023-10-01T07:52:07.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.138+0000 7f2f81033700 1 -- 172.21.15.26:0/2939133191 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7800f670 con 0x7f2f7c066200 2023-10-01T07:52:07.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.138+0000 7f2f81033700 1 -- 172.21.15.26:0/2939133191 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7800f9f0 con 0x7f2f7c066200 2023-10-01T07:52:07.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.139+0000 7f2f84299700 1 -- 172.21.15.26:0/2939133191 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f7c066200 msgr2=0x7f2f7c0977a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.139+0000 7f2f84299700 1 --2- 172.21.15.26:0/2939133191 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f7c066200 0x7f2f7c0977a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f2f78009790 tx=0x7f2f78009060).stop 2023-10-01T07:52:07.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.139+0000 7f2f84299700 1 -- 172.21.15.26:0/2939133191 shutdown_connections 2023-10-01T07:52:07.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.139+0000 7f2f84299700 1 --2- 172.21.15.26:0/2939133191 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f7c066200 0x7f2f7c0977a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.139+0000 7f2f84299700 1 --2- 172.21.15.26:0/2939133191 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f7c1281c0 0x7f2f7c12b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.139+0000 7f2f84299700 1 -- 172.21.15.26:0/2939133191 >> 172.21.15.26:0/2939133191 conn(0x7f2f7c09ba50 msgr2=0x7f2f7c09be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:07.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.139+0000 7f2f84299700 1 -- 172.21.15.26:0/2939133191 shutdown_connections 2023-10-01T07:52:07.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.139+0000 7f2f84299700 1 -- 172.21.15.26:0/2939133191 wait complete. 2023-10-01T07:52:07.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.140+0000 7f2f84299700 1 Processor -- start 2023-10-01T07:52:07.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.140+0000 7f2f84299700 1 -- start start 2023-10-01T07:52:07.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.140+0000 7f2f84299700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f7c066200 0x7f2f7c117b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.140+0000 7f2f84299700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f7c127dc0 0x7f2f7c113b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.140+0000 7f2f84299700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f7c1281c0 0x7f2f7c114050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.140+0000 7f2f84299700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c124c30 con 0x7f2f7c127dc0 2023-10-01T07:52:07.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.140+0000 7f2f84299700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c065120 con 0x7f2f7c066200 2023-10-01T07:52:07.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.140+0000 7f2f84299700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c1250c0 con 0x7f2f7c1281c0 2023-10-01T07:52:07.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.140+0000 7f2f82035700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f7c066200 0x7f2f7c117b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.140+0000 7f2f82035700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f7c066200 0x7f2f7c117b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55230/0 (socket says 172.21.15.26:55230) 2023-10-01T07:52:07.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.140+0000 7f2f82035700 1 -- 172.21.15.26:0/3061434012 learned_addr learned my addr 172.21.15.26:0/3061434012 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:07.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.140+0000 7f2f81834700 1 --2- 172.21.15.26:0/3061434012 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f7c127dc0 0x7f2f7c113b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.141+0000 7f2f82836700 1 --2- 172.21.15.26:0/3061434012 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f7c1281c0 0x7f2f7c114050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.141+0000 7f2f82035700 1 -- 172.21.15.26:0/3061434012 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f7c1281c0 msgr2=0x7f2f7c114050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.141+0000 7f2f82035700 1 --2- 172.21.15.26:0/3061434012 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f7c1281c0 0x7f2f7c114050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.141+0000 7f2f82035700 1 -- 172.21.15.26:0/3061434012 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f7c127dc0 msgr2=0x7f2f7c113b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.141+0000 7f2f82035700 1 --2- 172.21.15.26:0/3061434012 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f7c127dc0 0x7f2f7c113b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.141+0000 7f2f82035700 1 -- 172.21.15.26:0/3061434012 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f74009a20 con 0x7f2f7c066200 2023-10-01T07:52:07.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.141+0000 7f2f81834700 1 --2- 172.21.15.26:0/3061434012 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f7c127dc0 0x7f2f7c113b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:07.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.141+0000 7f2f82035700 1 --2- 172.21.15.26:0/3061434012 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f7c066200 0x7f2f7c117b00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f2f78006d90 tx=0x7f2f78017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:07.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.141+0000 7f2f727fc700 1 -- 172.21.15.26:0/3061434012 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7800f7e0 con 0x7f2f7c066200 2023-10-01T07:52:07.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.141+0000 7f2f727fc700 1 -- 172.21.15.26:0/3061434012 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7800f940 con 0x7f2f7c066200 2023-10-01T07:52:07.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.141+0000 7f2f84299700 1 -- 172.21.15.26:0/3061434012 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f780092a0 con 0x7f2f7c066200 2023-10-01T07:52:07.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.141+0000 7f2f727fc700 1 -- 172.21.15.26:0/3061434012 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7801b660 con 0x7f2f7c066200 2023-10-01T07:52:07.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.141+0000 7f2f84299700 1 -- 172.21.15.26:0/3061434012 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f7c114f60 con 0x7f2f7c066200 2023-10-01T07:52:07.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.142+0000 7f2f727fc700 1 -- 172.21.15.26:0/3061434012 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f2f7801b9d0 con 0x7f2f7c066200 2023-10-01T07:52:07.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.142+0000 7f2f727fc700 1 -- 172.21.15.26:0/3061434012 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f2f7803c8e0 con 0x7f2f7c066200 2023-10-01T07:52:07.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.142+0000 7f2f84299700 1 -- 172.21.15.26:0/3061434012 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f7c099000 con 0x7f2f7c066200 2023-10-01T07:52:07.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.147+0000 7f2f727fc700 1 -- 172.21.15.26:0/3061434012 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f2f78029080 con 0x7f2f7c066200 2023-10-01T07:52:07.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.326+0000 7f2f84299700 1 -- 172.21.15.26:0/3061434012 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f7c05a260 con 0x7f2f7c066200 2023-10-01T07:52:07.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.327+0000 7f2f727fc700 1 -- 172.21.15.26:0/3061434012 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11341 (secure 0 0 0) 0x7f2f7801f020 con 0x7f2f7c066200 2023-10-01T07:52:07.327 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:52:07.327 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":17,"fsid":"c29fb19d-520c-42a6-90f4-e7f86de96e8e","created":"2023-10-01T07:51:40.702414+0000","modified":"2023-10-01T07:51:58.296715+0000","last_up_change":"2023-10-01T07:51:48.849482+0000","last_in_change":"2023-10-01T07:51:42.084736+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-01T07:51:48.906889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-01T07:51:50.071599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-01T07:51:54.981575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-01T07:51:56.286318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46569ce3-81d1-44a1-a649-691de3e6f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6800","nonce":118773}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6801","nonce":118773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6803","nonce":118773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6802","nonce":118773}]},"public_addr":"172.21.15.26:6800/118773","cluster_addr":"172.21.15.26:6801/118773","heartbeat_back_addr":"172.21.15.26:6803/118773","heartbeat_front_addr":"172.21.15.26:6802/118773","state":["exists","up"]},{"osd":1,"uuid":"1fc1ba9b-4110-4d31-96d6-794937578cff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6804","nonce":118782}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6806","nonce":118782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6810","nonce":118782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6808","nonce":118782}]},"public_addr":"172.21.15.26:6804/118782","cluster_addr":"172.21.15.26:6806/118782","heartbeat_back_addr":"172.21.15.26:6810/118782","heartbeat_front_addr":"172.21.15.26:6808/118782","state":["exists","up"]},{"osd":2,"uuid":"37de933d-3b8e-4b94-87bd-2f36896c7ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6805","nonce":118789}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6807","nonce":118789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6811","nonce":118789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6809","nonce":118789}]},"public_addr":"172.21.15.26:6805/118789","cluster_addr":"172.21.15.26:6807/118789","heartbeat_back_addr":"172.21.15.26:6811/118789","heartbeat_front_addr":"172.21.15.26:6809/118789","state":["exists","up"]},{"osd":3,"uuid":"bd020309-5fd2-4d97-b36a-67e159fa3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6812","nonce":118790}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6813","nonce":118790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6815","nonce":118790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6814","nonce":118790}]},"public_addr":"172.21.15.26:6812/118790","cluster_addr":"172.21.15.26:6813/118790","heartbeat_back_addr":"172.21.15.26:6815/118790","heartbeat_front_addr":"172.21.15.26:6814/118790","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.029993+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.266503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.273540+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.229731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-01T07:52:07.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.329+0000 7f2f84299700 1 -- 172.21.15.26:0/3061434012 >> v1:172.21.15.26:6816/118178 conn(0x7f2f6002bb60 legacy=0x7f2f6002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.329+0000 7f2f84299700 1 -- 172.21.15.26:0/3061434012 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f7c066200 msgr2=0x7f2f7c117b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.329+0000 7f2f84299700 1 --2- 172.21.15.26:0/3061434012 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f7c066200 0x7f2f7c117b00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f2f78006d90 tx=0x7f2f78017000).stop 2023-10-01T07:52:07.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.329+0000 7f2f84299700 1 -- 172.21.15.26:0/3061434012 shutdown_connections 2023-10-01T07:52:07.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.329+0000 7f2f84299700 1 --2- 172.21.15.26:0/3061434012 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f7c1281c0 0x7f2f7c114050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.329+0000 7f2f84299700 1 --2- 172.21.15.26:0/3061434012 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f7c066200 0x7f2f7c117b00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.329+0000 7f2f84299700 1 --2- 172.21.15.26:0/3061434012 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f7c127dc0 0x7f2f7c113b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.329+0000 7f2f84299700 1 -- 172.21.15.26:0/3061434012 >> 172.21.15.26:0/3061434012 conn(0x7f2f7c09ba50 msgr2=0x7f2f7c12acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:07.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.329+0000 7f2f84299700 1 -- 172.21.15.26:0/3061434012 shutdown_connections 2023-10-01T07:52:07.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.329+0000 7f2f84299700 1 -- 172.21.15.26:0/3061434012 wait complete. 2023-10-01T07:52:07.343 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-01T07:52:07.343 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-01T07:52:07.344 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-01T07:52:07.344 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-01T07:52:07.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.485+0000 7f6576b38700 1 Processor -- start 2023-10-01T07:52:07.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.485+0000 7f80314f1700 1 Processor -- start 2023-10-01T07:52:07.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.485+0000 7f6576b38700 1 -- start start 2023-10-01T07:52:07.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.486+0000 7f80314f1700 1 -- start start 2023-10-01T07:52:07.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.485+0000 7f6576b38700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6570066cd0 0x7f65700670b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.486+0000 7f6576b38700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f65700675a0 0x7f657012f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.486+0000 7f6576b38700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f657012f6e0 0x7f657012fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.486+0000 7f6576b38700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6570068b90 con 0x7f657012f6e0 2023-10-01T07:52:07.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.486+0000 7f6576b38700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65700921c0 con 0x7f65700675a0 2023-10-01T07:52:07.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.486+0000 7f6576b38700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6570098000 con 0x7f6570066cd0 2023-10-01T07:52:07.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.486+0000 7f65748d4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6570066cd0 0x7f65700670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.486+0000 7f65750d5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f657012f6e0 0x7f657012fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.486+0000 7f65748d4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6570066cd0 0x7f65700670b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57470/0 (socket says 172.21.15.26:57470) 2023-10-01T07:52:07.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.486+0000 7f65748d4700 1 -- 172.21.15.26:0/1583125822 learned_addr learned my addr 172.21.15.26:0/1583125822 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:07.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.486+0000 7f80314f1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f802c0613a0 0x7f802c12ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.486+0000 7f65748d4700 1 -- 172.21.15.26:0/1583125822 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f65700675a0 msgr2=0x7f657012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:07.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.486+0000 7f65748d4700 1 --2- 172.21.15.26:0/1583125822 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f65700675a0 0x7f657012f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-01T07:52:07.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.486+0000 7f65748d4700 1 -- 172.21.15.26:0/1583125822 >> v2:172.21.15.26:3300/0 conn(0x7f657012f6e0 msgr2=0x7f657012fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:07.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.486+0000 7f65748d4700 1 --2- 172.21.15.26:0/1583125822 >> v2:172.21.15.26:3300/0 conn(0x7f657012f6e0 0x7f657012fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.486+0000 7f65748d4700 1 -- 172.21.15.26:0/1583125822 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65700697b0 con 0x7f6570066cd0 2023-10-01T07:52:07.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.486+0000 7f80314f1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f802c12b6d0 0x7f802c096500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.486+0000 7f80314f1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f802c12abd0 con 0x7f802c12b2f0 2023-10-01T07:52:07.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.486+0000 7f80314f1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f802c061780 con 0x7f802c0613a0 2023-10-01T07:52:07.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.486+0000 7f80314f1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802c067530 con 0x7f802c12b6d0 2023-10-01T07:52:07.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.486+0000 7f65750d5700 1 --2- 172.21.15.26:0/1583125822 >> v2:172.21.15.26:3300/0 conn(0x7f657012f6e0 0x7f657012fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:52:07.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.487+0000 7f65748d4700 1 --2- 172.21.15.26:0/1583125822 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6570066cd0 0x7f65700670b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f6564006fd0 tx=0x7f65640090f0).ready entity=mon.2 client_cookie=2fd8e0de4fc39032 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:07.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.487+0000 7f802a7fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f802c12b2f0 0x7f802c095df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:40448/0 (socket says 172.21.15.26:40448) 2023-10-01T07:52:07.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.487+0000 7f802a7fc700 1 -- 172.21.15.26:0/1592049746 learned_addr learned my addr 172.21.15.26:0/1592049746 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:52:07.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.487+0000 7f802b7fe700 1 --2- 172.21.15.26:0/1592049746 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f802c12b6d0 0x7f802c096500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.487+0000 7f802b7fe700 1 -- 172.21.15.26:0/1592049746 >> v2:172.21.15.26:3300/0 conn(0x7f802c0613a0 msgr2=0x7f802c12ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:07.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.487+0000 7f802b7fe700 1 --2- 172.21.15.26:0/1592049746 >> v2:172.21.15.26:3300/0 conn(0x7f802c0613a0 0x7f802c12ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-01T07:52:07.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.487+0000 7f802b7fe700 1 -- 172.21.15.26:0/1592049746 >> v1:172.21.15.26:6789/0 conn(0x7f802c12b2f0 legacy=0x7f802c095df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.487+0000 7f802b7fe700 1 -- 172.21.15.26:0/1592049746 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802c0683c0 con 0x7f802c12b6d0 2023-10-01T07:52:07.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.487+0000 7f802b7fe700 1 --2- 172.21.15.26:0/1592049746 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f802c12b6d0 0x7f802c096500 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f8024009e90 tx=0x7f8024009780).ready entity=mon.1 client_cookie=f08fb8b215124258 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:07.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.487+0000 7f8029ffb700 1 -- 172.21.15.26:0/1592049746 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802400e070 con 0x7f802c12b6d0 2023-10-01T07:52:07.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.487+0000 7f8029ffb700 1 -- 172.21.15.26:0/1592049746 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802400bbf0 con 0x7f802c12b6d0 2023-10-01T07:52:07.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.487+0000 7f8029ffb700 1 -- 172.21.15.26:0/1592049746 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8024012410 con 0x7f802c12b6d0 2023-10-01T07:52:07.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.488+0000 7f80314f1700 1 -- 172.21.15.26:0/1592049746 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f802c12b6d0 msgr2=0x7f802c096500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.488+0000 7f80314f1700 1 --2- 172.21.15.26:0/1592049746 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f802c12b6d0 0x7f802c096500 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f8024009e90 tx=0x7f8024009780).stop 2023-10-01T07:52:07.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.488+0000 7f80314f1700 1 -- 172.21.15.26:0/1592049746 shutdown_connections 2023-10-01T07:52:07.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.488+0000 7f80314f1700 1 --2- 172.21.15.26:0/1592049746 >> v2:172.21.15.26:3300/0 conn(0x7f802c0613a0 0x7f802c12ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-01T07:52:07.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.488+0000 7f80314f1700 1 --2- 172.21.15.26:0/1592049746 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f802c12b6d0 0x7f802c096500 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.488+0000 7f80314f1700 1 -- 172.21.15.26:0/1592049746 >> 172.21.15.26:0/1592049746 conn(0x7f802c09a220 msgr2=0x7f802c09a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:07.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.488+0000 7f80314f1700 1 -- 172.21.15.26:0/1592049746 shutdown_connections 2023-10-01T07:52:07.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.488+0000 7f80314f1700 1 -- 172.21.15.26:0/1592049746 wait complete. 2023-10-01T07:52:07.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.488+0000 7f656f7fe700 1 -- 172.21.15.26:0/1583125822 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656400b600 con 0x7f6570066cd0 2023-10-01T07:52:07.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.489+0000 7f656f7fe700 1 -- 172.21.15.26:0/1583125822 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656400b760 con 0x7f6570066cd0 2023-10-01T07:52:07.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.489+0000 7f656f7fe700 1 -- 172.21.15.26:0/1583125822 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656400bae0 con 0x7f6570066cd0 2023-10-01T07:52:07.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.490+0000 7f6576b38700 1 -- 172.21.15.26:0/1583125822 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6570066cd0 msgr2=0x7f65700670b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.490+0000 7f6576b38700 1 --2- 172.21.15.26:0/1583125822 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6570066cd0 0x7f65700670b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f6564006fd0 tx=0x7f65640090f0).stop 2023-10-01T07:52:07.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.490+0000 7f6576b38700 1 -- 172.21.15.26:0/1583125822 shutdown_connections 2023-10-01T07:52:07.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.490+0000 7f6576b38700 1 --2- 172.21.15.26:0/1583125822 >> v2:172.21.15.26:3300/0 conn(0x7f657012f6e0 0x7f657012fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.490+0000 7f6576b38700 1 --2- 172.21.15.26:0/1583125822 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6570066cd0 0x7f65700670b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.490+0000 7f6576b38700 1 --2- 172.21.15.26:0/1583125822 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f65700675a0 0x7f657012f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-01T07:52:07.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.490+0000 7f6576b38700 1 -- 172.21.15.26:0/1583125822 >> 172.21.15.26:0/1583125822 conn(0x7f657009a220 msgr2=0x7f657009a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:07.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.490+0000 7f80314f1700 1 Processor -- start 2023-10-01T07:52:07.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.490+0000 7f6576b38700 1 -- 172.21.15.26:0/1583125822 shutdown_connections 2023-10-01T07:52:07.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.490+0000 7f6576b38700 1 -- 172.21.15.26:0/1583125822 wait complete. 2023-10-01T07:52:07.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.490+0000 7f80314f1700 1 -- start start 2023-10-01T07:52:07.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.491+0000 7f80314f1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f802c0613a0 0x7f802c114bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.491+0000 7f80314f1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f802c12b2f0 0x7f802c1150a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.491+0000 7f80314f1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f802c12b6d0 0x7f802c115590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.491+0000 7f80314f1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802c115a80 con 0x7f802c0613a0 2023-10-01T07:52:07.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.491+0000 7f80314f1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802c118060 con 0x7f802c12b6d0 2023-10-01T07:52:07.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.491+0000 7f80314f1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f802c116870 con 0x7f802c12b2f0 2023-10-01T07:52:07.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.491+0000 7f802a7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f802c12b2f0 0x7f802c1150a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.491+0000 7f802affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f802c0613a0 0x7f802c114bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.491+0000 7f802a7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f802c12b2f0 0x7f802c1150a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57486/0 (socket says 172.21.15.26:57486) 2023-10-01T07:52:07.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.491+0000 7f802a7fc700 1 -- 172.21.15.26:0/1596050395 learned_addr learned my addr 172.21.15.26:0/1596050395 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:07.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.491+0000 7f802b7fe700 1 --2- 172.21.15.26:0/1596050395 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f802c12b6d0 0x7f802c115590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.491+0000 7f6576b38700 1 Processor -- start 2023-10-01T07:52:07.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.491+0000 7f802affd700 1 -- 172.21.15.26:0/1596050395 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f802c12b2f0 msgr2=0x7f802c1150a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.491+0000 7f802affd700 1 --2- 172.21.15.26:0/1596050395 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f802c12b2f0 0x7f802c1150a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.491+0000 7f802affd700 1 -- 172.21.15.26:0/1596050395 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f802c12b6d0 msgr2=0x7f802c115590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.491+0000 7f802affd700 1 --2- 172.21.15.26:0/1596050395 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f802c12b6d0 0x7f802c115590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.491+0000 7f802affd700 1 -- 172.21.15.26:0/1596050395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8024009a20 con 0x7f802c0613a0 2023-10-01T07:52:07.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.491+0000 7f6576b38700 1 -- start start 2023-10-01T07:52:07.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.492+0000 7f802affd700 1 --2- 172.21.15.26:0/1596050395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f802c0613a0 0x7f802c114bb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f801c00b4e0 tx=0x7f801c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:07.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.492+0000 7f8012ffd700 1 -- 172.21.15.26:0/1596050395 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c00be30 con 0x7f802c0613a0 2023-10-01T07:52:07.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.492+0000 7f8012ffd700 1 -- 172.21.15.26:0/1596050395 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801c002320 con 0x7f802c0613a0 2023-10-01T07:52:07.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.492+0000 7f80314f1700 1 -- 172.21.15.26:0/1596050395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f802c098ae0 con 0x7f802c0613a0 2023-10-01T07:52:07.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.492+0000 7f8012ffd700 1 -- 172.21.15.26:0/1596050395 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c0026c0 con 0x7f802c0613a0 2023-10-01T07:52:07.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.492+0000 7f80314f1700 1 -- 172.21.15.26:0/1596050395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f802c117cb0 con 0x7f802c0613a0 2023-10-01T07:52:07.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.492+0000 7f6576b38700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6570066cd0 0x7f657012e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.492+0000 7f6576b38700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f65700675a0 0x7f657011d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.492+0000 7f6576b38700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f657012f6e0 0x7f657011dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.492+0000 7f6576b38700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6570069270 con 0x7f657012f6e0 2023-10-01T07:52:07.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.492+0000 7f6576b38700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6570120e20 con 0x7f65700675a0 2023-10-01T07:52:07.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.492+0000 7f6576b38700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65701213c0 con 0x7f6570066cd0 2023-10-01T07:52:07.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.492+0000 7f65750d5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f657012f6e0 0x7f657011dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.492+0000 7f65750d5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f657012f6e0 0x7f657011dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34290/0 (socket says 172.21.15.26:34290) 2023-10-01T07:52:07.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.492+0000 7f65750d5700 1 -- 172.21.15.26:0/2735797293 learned_addr learned my addr 172.21.15.26:0/2735797293 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:07.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.493+0000 7f65748d4700 1 --2- 172.21.15.26:0/2735797293 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6570066cd0 0x7f657012e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.493+0000 7f656ffff700 1 --2- 172.21.15.26:0/2735797293 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f65700675a0 0x7f657011d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.493+0000 7f80314f1700 1 -- 172.21.15.26:0/1596050395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f802c067730 con 0x7f802c0613a0 2023-10-01T07:52:07.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.493+0000 7f65750d5700 1 -- 172.21.15.26:0/2735797293 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6570066cd0 msgr2=0x7f657012e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.493+0000 7f65750d5700 1 --2- 172.21.15.26:0/2735797293 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6570066cd0 0x7f657012e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.493+0000 7f65750d5700 1 -- 172.21.15.26:0/2735797293 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f65700675a0 msgr2=0x7f657011d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.493+0000 7f65750d5700 1 --2- 172.21.15.26:0/2735797293 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f65700675a0 0x7f657011d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.493+0000 7f65750d5700 1 -- 172.21.15.26:0/2735797293 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6564009370 con 0x7f657012f6e0 2023-10-01T07:52:07.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.493+0000 7f65750d5700 1 --2- 172.21.15.26:0/2735797293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f657012f6e0 0x7f657011dd80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f656800d0d0 tx=0x7f65680099d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:07.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.493+0000 7f656cff9700 1 -- 172.21.15.26:0/2735797293 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656800dcc0 con 0x7f657012f6e0 2023-10-01T07:52:07.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.493+0000 7f6576b38700 1 -- 172.21.15.26:0/2735797293 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f657011fd10 con 0x7f657012f6e0 2023-10-01T07:52:07.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.493+0000 7f656cff9700 1 -- 172.21.15.26:0/2735797293 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656800f040 con 0x7f657012f6e0 2023-10-01T07:52:07.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.493+0000 7f656cff9700 1 -- 172.21.15.26:0/2735797293 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6568013600 con 0x7f657012f6e0 2023-10-01T07:52:07.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.493+0000 7f6576b38700 1 -- 172.21.15.26:0/2735797293 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6570121aa0 con 0x7f657012f6e0 2023-10-01T07:52:07.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.494+0000 7f6576b38700 1 -- 172.21.15.26:0/2735797293 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6550000fc0 con 0x7f657012f6e0 2023-10-01T07:52:07.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.495+0000 7f8012ffd700 1 -- 172.21.15.26:0/1596050395 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f801c002a70 con 0x7f802c0613a0 2023-10-01T07:52:07.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.495+0000 7f656cff9700 1 -- 172.21.15.26:0/2735797293 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f6568013970 con 0x7f657012f6e0 2023-10-01T07:52:07.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.495+0000 7f8012ffd700 1 -- 172.21.15.26:0/1596050395 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f801c03b6d0 con 0x7f802c0613a0 2023-10-01T07:52:07.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.495+0000 7f8012ffd700 1 -- 172.21.15.26:0/1596050395 --> v1:172.21.15.26:6804/118782 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f80180384e0 con 0x7f80180347f0 2023-10-01T07:52:07.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.495+0000 7f8012ffd700 1 -- 172.21.15.26:0/1596050395 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f801c03b9c0 con 0x7f802c0613a0 2023-10-01T07:52:07.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.495+0000 7f656cff9700 1 -- 172.21.15.26:0/2735797293 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f656803b720 con 0x7f657012f6e0 2023-10-01T07:52:07.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.495+0000 7f656cff9700 1 -- 172.21.15.26:0/2735797293 --> v1:172.21.15.26:6812/118790 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6554038410 con 0x7f6554034720 2023-10-01T07:52:07.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.495+0000 7f656cff9700 1 -- 172.21.15.26:0/2735797293 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f656801c400 con 0x7f657012f6e0 2023-10-01T07:52:07.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.497+0000 7f8012ffd700 1 -- 172.21.15.26:0/1596050395 <== osd.1 v1:172.21.15.26:6804/118782 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f80180384e0 con 0x7f80180347f0 2023-10-01T07:52:07.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.500+0000 7f656cff9700 1 -- 172.21.15.26:0/2735797293 <== osd.3 v1:172.21.15.26:6812/118790 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f6554038410 con 0x7f6554034720 2023-10-01T07:52:07.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.508+0000 7faf576fa700 1 Processor -- start 2023-10-01T07:52:07.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.508+0000 7f6df04da700 1 Processor -- start 2023-10-01T07:52:07.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.509+0000 7f6df04da700 1 -- start start 2023-10-01T07:52:07.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.509+0000 7faf576fa700 1 -- start start 2023-10-01T07:52:07.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.509+0000 7f6df04da700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6de8096380 0x7f6de8094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.509+0000 7f6df04da700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6de8091b00 0x7f6de8127600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.509+0000 7f6df04da700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6de8094c20 0x7f6de8127af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.510+0000 7faf576fa700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faf500969b0 0x7faf50096d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.510+0000 7faf576fa700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faf50097280 0x7faf50066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.510+0000 7faf576fa700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7faf500671c0 0x7faf50067640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.510+0000 7faf576fa700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf50067b30 con 0x7faf500671c0 2023-10-01T07:52:07.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.510+0000 7faf576fa700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf50092fe0 con 0x7faf50097280 2023-10-01T07:52:07.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.510+0000 7faf576fa700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf50094560 con 0x7faf500969b0 2023-10-01T07:52:07.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.509+0000 7f6df04da700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de8096760 con 0x7f6de8091b00 2023-10-01T07:52:07.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.509+0000 7f6df04da700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de8091ff0 con 0x7f6de8096380 2023-10-01T07:52:07.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.509+0000 7f6df04da700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6de8092c80 con 0x7f6de8094c20 2023-10-01T07:52:07.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.510+0000 7f6dee276700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6de8096380 0x7f6de8094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.510+0000 7f6dee276700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6de8096380 0x7f6de8094730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55272/0 (socket says 172.21.15.26:55272) 2023-10-01T07:52:07.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.510+0000 7f6deda75700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6de8091b00 0x7f6de8127600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.510+0000 7f6dee276700 1 -- 172.21.15.26:0/530742641 learned_addr learned my addr 172.21.15.26:0/530742641 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:07.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.510+0000 7faf55496700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faf500969b0 0x7faf50096d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.510+0000 7faf55496700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faf500969b0 0x7faf50096d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57518/0 (socket says 172.21.15.26:57518) 2023-10-01T07:52:07.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.510+0000 7faf55496700 1 -- 172.21.15.26:0/2082462580 learned_addr learned my addr 172.21.15.26:0/2082462580 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:07.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.510+0000 7faf55c97700 1 --2- 172.21.15.26:0/2082462580 >> v2:172.21.15.26:3300/0 conn(0x7faf500671c0 0x7faf50067640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.510+0000 7faf54c95700 1 --2- 172.21.15.26:0/2082462580 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faf50097280 0x7faf50066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.510+0000 7f6deea77700 1 --2- 172.21.15.26:0/530742641 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6de8094c20 0x7f6de8127af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.510+0000 7f6dee276700 1 -- 172.21.15.26:0/530742641 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6de8094c20 msgr2=0x7f6de8127af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:07.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.510+0000 7f6dee276700 1 --2- 172.21.15.26:0/530742641 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6de8094c20 0x7f6de8127af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.510+0000 7f6dee276700 1 -- 172.21.15.26:0/530742641 >> v2:172.21.15.26:3300/0 conn(0x7f6de8091b00 msgr2=0x7f6de8127600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:07.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.510+0000 7f6dee276700 1 --2- 172.21.15.26:0/530742641 >> v2:172.21.15.26:3300/0 conn(0x7f6de8091b00 0x7f6de8127600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.510+0000 7f6dee276700 1 -- 172.21.15.26:0/530742641 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de8093900 con 0x7f6de8096380 2023-10-01T07:52:07.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.511+0000 7f6deda75700 1 --2- 172.21.15.26:0/530742641 >> v2:172.21.15.26:3300/0 conn(0x7f6de8091b00 0x7f6de8127600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:07.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.510+0000 7faf55496700 1 -- 172.21.15.26:0/2082462580 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faf50097280 msgr2=0x7faf50066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:07.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.510+0000 7faf55496700 1 --2- 172.21.15.26:0/2082462580 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faf50097280 0x7faf50066cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.510+0000 7faf55496700 1 -- 172.21.15.26:0/2082462580 >> v2:172.21.15.26:3300/0 conn(0x7faf500671c0 msgr2=0x7faf50067640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:07.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.510+0000 7faf55496700 1 --2- 172.21.15.26:0/2082462580 >> v2:172.21.15.26:3300/0 conn(0x7faf500671c0 0x7faf50067640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.510+0000 7faf55496700 1 -- 172.21.15.26:0/2082462580 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf50093260 con 0x7faf500969b0 2023-10-01T07:52:07.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.510+0000 7faf54c95700 1 --2- 172.21.15.26:0/2082462580 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faf50097280 0x7faf50066cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:52:07.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.511+0000 7faf55496700 1 --2- 172.21.15.26:0/2082462580 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faf500969b0 0x7faf50096d90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7faf4c006fd0 tx=0x7faf4c0090f0).ready entity=mon.2 client_cookie=921c8917566908b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:07.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.511+0000 7f6dee276700 1 --2- 172.21.15.26:0/530742641 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6de8096380 0x7f6de8094730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f6dd8006fd0 tx=0x7f6dd800d5b0).ready entity=mon.1 client_cookie=fa3208ba6cf1c82f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:07.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.511+0000 7f6ded274700 1 -- 172.21.15.26:0/530742641 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd8012070 con 0x7f6de8096380 2023-10-01T07:52:07.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.511+0000 7f6ded274700 1 -- 172.21.15.26:0/530742641 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd800d2e0 con 0x7f6de8096380 2023-10-01T07:52:07.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.511+0000 7f6ded274700 1 -- 172.21.15.26:0/530742641 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd800f8a0 con 0x7f6de8096380 2023-10-01T07:52:07.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.512+0000 7f6df04da700 1 -- 172.21.15.26:0/530742641 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6de8096380 msgr2=0x7f6de8094730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.512+0000 7f6df04da700 1 --2- 172.21.15.26:0/530742641 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6de8096380 0x7f6de8094730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f6dd8006fd0 tx=0x7f6dd800d5b0).stop 2023-10-01T07:52:07.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.512+0000 7faf43fff700 1 -- 172.21.15.26:0/2082462580 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c00b600 con 0x7faf500969b0 2023-10-01T07:52:07.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.512+0000 7faf43fff700 1 -- 172.21.15.26:0/2082462580 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4c00b760 con 0x7faf500969b0 2023-10-01T07:52:07.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.512+0000 7faf43fff700 1 -- 172.21.15.26:0/2082462580 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c00bae0 con 0x7faf500969b0 2023-10-01T07:52:07.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.512+0000 7f6df04da700 1 -- 172.21.15.26:0/530742641 shutdown_connections 2023-10-01T07:52:07.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.512+0000 7f6df04da700 1 --2- 172.21.15.26:0/530742641 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6de8094c20 0x7f6de8127af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.512+0000 7f6df04da700 1 --2- 172.21.15.26:0/530742641 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6de8096380 0x7f6de8094730 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.512+0000 7f6df04da700 1 --2- 172.21.15.26:0/530742641 >> v2:172.21.15.26:3300/0 conn(0x7f6de8091b00 0x7f6de8127600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.512+0000 7f6df04da700 1 -- 172.21.15.26:0/530742641 >> 172.21.15.26:0/530742641 conn(0x7f6de8097470 msgr2=0x7f6de8097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:07.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.512+0000 7f6df04da700 1 -- 172.21.15.26:0/530742641 shutdown_connections 2023-10-01T07:52:07.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.512+0000 7f6df04da700 1 -- 172.21.15.26:0/530742641 wait complete. 2023-10-01T07:52:07.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.513+0000 7faf576fa700 1 -- 172.21.15.26:0/2082462580 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faf500969b0 msgr2=0x7faf50096d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.513+0000 7faf576fa700 1 --2- 172.21.15.26:0/2082462580 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faf500969b0 0x7faf50096d90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7faf4c006fd0 tx=0x7faf4c0090f0).stop 2023-10-01T07:52:07.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.513+0000 7faf576fa700 1 -- 172.21.15.26:0/2082462580 shutdown_connections 2023-10-01T07:52:07.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.513+0000 7faf576fa700 1 --2- 172.21.15.26:0/2082462580 >> v2:172.21.15.26:3300/0 conn(0x7faf500671c0 0x7faf50067640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.513+0000 7faf576fa700 1 --2- 172.21.15.26:0/2082462580 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faf500969b0 0x7faf50096d90 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0x7faf4c006fd0 tx=0x7faf4c0090f0).stop 2023-10-01T07:52:07.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.513+0000 7faf576fa700 1 --2- 172.21.15.26:0/2082462580 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faf50097280 0x7faf50066cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.513+0000 7faf576fa700 1 -- 172.21.15.26:0/2082462580 >> 172.21.15.26:0/2082462580 conn(0x7faf5009a220 msgr2=0x7faf5009a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:07.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.513+0000 7f6df04da700 1 Processor -- start 2023-10-01T07:52:07.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.513+0000 7faf576fa700 1 -- 172.21.15.26:0/2082462580 shutdown_connections 2023-10-01T07:52:07.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.513+0000 7f6df04da700 1 -- start start 2023-10-01T07:52:07.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.514+0000 7f6df04da700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6de8091b00 0x7f6de8112940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.514+0000 7f6df04da700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6de8094c20 0x7f6de8112e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.514+0000 7f6df04da700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6de8096380 0x7f6de8113320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.514+0000 7f6df04da700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de8124a20 con 0x7f6de8096380 2023-10-01T07:52:07.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.514+0000 7f6df04da700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de8114f70 con 0x7f6de8091b00 2023-10-01T07:52:07.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.514+0000 7f6df04da700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6de806a520 con 0x7f6de8094c20 2023-10-01T07:52:07.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.514+0000 7faf576fa700 1 -- 172.21.15.26:0/2082462580 wait complete. 2023-10-01T07:52:07.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.514+0000 7f6deea77700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6de8096380 0x7f6de8113320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.514+0000 7f6deea77700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6de8096380 0x7f6de8113320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34320/0 (socket says 172.21.15.26:34320) 2023-10-01T07:52:07.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.514+0000 7f6deea77700 1 -- 172.21.15.26:0/1501938545 learned_addr learned my addr 172.21.15.26:0/1501938545 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:07.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.514+0000 7f6dee276700 1 --2- 172.21.15.26:0/1501938545 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6de8091b00 0x7f6de8112940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.514+0000 7f6deda75700 1 --2- 172.21.15.26:0/1501938545 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6de8094c20 0x7f6de8112e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.515+0000 7f6deea77700 1 -- 172.21.15.26:0/1501938545 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6de8094c20 msgr2=0x7f6de8112e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.515+0000 7f6deea77700 1 --2- 172.21.15.26:0/1501938545 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6de8094c20 0x7f6de8112e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.515+0000 7f6deea77700 1 -- 172.21.15.26:0/1501938545 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6de8091b00 msgr2=0x7f6de8112940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.515+0000 7f6deea77700 1 --2- 172.21.15.26:0/1501938545 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6de8091b00 0x7f6de8112940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.515+0000 7f6deea77700 1 -- 172.21.15.26:0/1501938545 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de40092a0 con 0x7f6de8096380 2023-10-01T07:52:07.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.515+0000 7f6deea77700 1 --2- 172.21.15.26:0/1501938545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6de8096380 0x7f6de8113320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f6de0009e90 tx=0x7f6de000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:07.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.515+0000 7faf576fa700 1 Processor -- start 2023-10-01T07:52:07.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.515+0000 7f6dde7fc700 1 -- 172.21.15.26:0/1501938545 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de000caa0 con 0x7f6de8096380 2023-10-01T07:52:07.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.515+0000 7f6dde7fc700 1 -- 172.21.15.26:0/1501938545 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de000f040 con 0x7f6de8096380 2023-10-01T07:52:07.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.515+0000 7f6df04da700 1 -- 172.21.15.26:0/1501938545 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd800d810 con 0x7f6de8096380 2023-10-01T07:52:07.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.515+0000 7f6dde7fc700 1 -- 172.21.15.26:0/1501938545 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de000ce10 con 0x7f6de8096380 2023-10-01T07:52:07.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.515+0000 7f6df04da700 1 -- 172.21.15.26:0/1501938545 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de8116ac0 con 0x7f6de8096380 2023-10-01T07:52:07.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.516+0000 7f6df04da700 1 -- 172.21.15.26:0/1501938545 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6de805a260 con 0x7f6de8096380 2023-10-01T07:52:07.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.515+0000 7faf576fa700 1 -- start start 2023-10-01T07:52:07.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.516+0000 7faf576fa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf500671c0 0x7faf5011a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.516+0000 7faf576fa700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faf50097280 0x7faf5011adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.516+0000 7faf576fa700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faf5011b2b0 0x7faf50067de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.516+0000 7faf576fa700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf50092d60 con 0x7faf500671c0 2023-10-01T07:52:07.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.516+0000 7faf576fa700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5011b6d0 con 0x7faf5011b2b0 2023-10-01T07:52:07.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.516+0000 7faf576fa700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf5011b840 con 0x7faf50097280 2023-10-01T07:52:07.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.517+0000 7faf55c97700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faf5011b2b0 0x7faf50067de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.517+0000 7faf54c95700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faf50097280 0x7faf5011adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.517+0000 7faf55c97700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faf5011b2b0 0x7faf50067de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55308/0 (socket says 172.21.15.26:55308) 2023-10-01T07:52:07.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.517+0000 7faf54c95700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faf50097280 0x7faf5011adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57538/0 (socket says 172.21.15.26:57538) 2023-10-01T07:52:07.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.517+0000 7faf55c97700 1 -- 172.21.15.26:0/2976241240 learned_addr learned my addr 172.21.15.26:0/2976241240 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:07.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.517+0000 7faf55496700 1 --2- 172.21.15.26:0/2976241240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf500671c0 0x7faf5011a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.517+0000 7f80314f1700 1 -- 172.21.15.26:0/1596050395 --> v1:172.21.15.26:6804/118782 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f802c118560 con 0x7f80180347f0 2023-10-01T07:52:07.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.517+0000 7faf55c97700 1 -- 172.21.15.26:0/2976241240 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faf50097280 msgr2=0x7faf5011adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.517+0000 7faf55c97700 1 --2- 172.21.15.26:0/2976241240 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faf50097280 0x7faf5011adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.517+0000 7faf55c97700 1 -- 172.21.15.26:0/2976241240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf500671c0 msgr2=0x7faf5011a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.517+0000 7faf55c97700 1 --2- 172.21.15.26:0/2976241240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf500671c0 0x7faf5011a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.517+0000 7faf55c97700 1 -- 172.21.15.26:0/2976241240 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4c009370 con 0x7faf5011b2b0 2023-10-01T07:52:07.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.516+0000 7f6dde7fc700 1 -- 172.21.15.26:0/1501938545 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f6de0013610 con 0x7f6de8096380 2023-10-01T07:52:07.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.517+0000 7f6dde7fc700 1 -- 172.21.15.26:0/1501938545 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f6de001ccd0 con 0x7f6de8096380 2023-10-01T07:52:07.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.517+0000 7f6dde7fc700 1 -- 172.21.15.26:0/1501938545 --> v1:172.21.15.26:6800/118773 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6dcc038460 con 0x7f6dcc034770 2023-10-01T07:52:07.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.517+0000 7f6dde7fc700 1 -- 172.21.15.26:0/1501938545 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6de001d460 con 0x7f6de8096380 2023-10-01T07:52:07.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.518+0000 7f8012ffd700 1 -- 172.21.15.26:0/1596050395 <== osd.1 v1:172.21.15.26:6804/118782 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7f8024012410 con 0x7f80180347f0 2023-10-01T07:52:07.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.517+0000 7faf55c97700 1 --2- 172.21.15.26:0/2976241240 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faf5011b2b0 0x7faf50067de0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7faf48009fd0 tx=0x7faf48009900).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:07.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.518+0000 7faf417fa700 1 -- 172.21.15.26:0/2976241240 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4800ebf0 con 0x7faf5011b2b0 2023-10-01T07:52:07.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.518+0000 7faf417fa700 1 -- 172.21.15.26:0/2976241240 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4800ed50 con 0x7faf5011b2b0 2023-10-01T07:52:07.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.518+0000 7faf417fa700 1 -- 172.21.15.26:0/2976241240 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf48014610 con 0x7faf5011b2b0 2023-10-01T07:52:07.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.518+0000 7faf576fa700 1 -- 172.21.15.26:0/2976241240 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf5011bad0 con 0x7faf5011b2b0 2023-10-01T07:52:07.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.518+0000 7faf576fa700 1 -- 172.21.15.26:0/2976241240 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5011bf70 con 0x7faf5011b2b0 2023-10-01T07:52:07.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.518+0000 7f80314f1700 1 -- 172.21.15.26:0/1596050395 >> v1:172.21.15.26:6804/118782 conn(0x7f80180347f0 legacy=0x7f8018036c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.518+0000 7f80314f1700 1 -- 172.21.15.26:0/1596050395 >> v1:172.21.15.26:6816/118178 conn(0x7f801802bb60 legacy=0x7f801802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.518+0000 7f80314f1700 1 -- 172.21.15.26:0/1596050395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f802c0613a0 msgr2=0x7f802c114bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.518+0000 7f80314f1700 1 --2- 172.21.15.26:0/1596050395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f802c0613a0 0x7f802c114bb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f801c00b4e0 tx=0x7f801c009060).stop 2023-10-01T07:52:07.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.519+0000 7f802b7fe700 1 -- 172.21.15.26:0/1596050395 reap_dead start 2023-10-01T07:52:07.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.519+0000 7f80314f1700 1 -- 172.21.15.26:0/1596050395 shutdown_connections 2023-10-01T07:52:07.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.519+0000 7f80314f1700 1 -- 172.21.15.26:0/1596050395 >> 172.21.15.26:0/1596050395 conn(0x7f802c09a220 msgr2=0x7f802c095df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:07.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.519+0000 7f6dde7fc700 1 -- 172.21.15.26:0/1501938545 <== osd.0 v1:172.21.15.26:6800/118773 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f6dcc038460 con 0x7f6dcc034770 2023-10-01T07:52:07.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.519+0000 7f80314f1700 1 -- 172.21.15.26:0/1596050395 shutdown_connections 2023-10-01T07:52:07.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.519+0000 7f80314f1700 1 -- 172.21.15.26:0/1596050395 wait complete. 2023-10-01T07:52:07.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.519+0000 7faf576fa700 1 -- 172.21.15.26:0/2976241240 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faf50092320 con 0x7faf5011b2b0 2023-10-01T07:52:07.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.519+0000 7faf417fa700 1 -- 172.21.15.26:0/2976241240 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7faf4801d3b0 con 0x7faf5011b2b0 2023-10-01T07:52:07.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.519+0000 7faf417fa700 1 -- 172.21.15.26:0/2976241240 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7faf4803b530 con 0x7faf5011b2b0 2023-10-01T07:52:07.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.520+0000 7faf417fa700 1 -- 172.21.15.26:0/2976241240 --> v1:172.21.15.26:6805/118789 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faf34038530 con 0x7faf34034840 2023-10-01T07:52:07.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.520+0000 7faf417fa700 1 -- 172.21.15.26:0/2976241240 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf48006000 con 0x7faf5011b2b0 2023-10-01T07:52:07.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.520+0000 7f6576b38700 1 -- 172.21.15.26:0/2735797293 --> v1:172.21.15.26:6812/118790 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6550002b10 con 0x7f6554034720 2023-10-01T07:52:07.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.521+0000 7faf417fa700 1 -- 172.21.15.26:0/2976241240 <== osd.2 v1:172.21.15.26:6805/118789 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7faf34038530 con 0x7faf34034840 2023-10-01T07:52:07.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.526+0000 7f656cff9700 1 -- 172.21.15.26:0/2735797293 <== osd.3 v1:172.21.15.26:6812/118790 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7f6550002b10 con 0x7f6554034720 2023-10-01T07:52:07.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.526+0000 7f6576b38700 1 -- 172.21.15.26:0/2735797293 >> v1:172.21.15.26:6812/118790 conn(0x7f6554034720 legacy=0x7f6554036ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.526+0000 7f6576b38700 1 -- 172.21.15.26:0/2735797293 >> v1:172.21.15.26:6816/118178 conn(0x7f655402bb90 legacy=0x7f655402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.526+0000 7f6576b38700 1 -- 172.21.15.26:0/2735797293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f657012f6e0 msgr2=0x7f657011dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.526+0000 7f6576b38700 1 --2- 172.21.15.26:0/2735797293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f657012f6e0 0x7f657011dd80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f656800d0d0 tx=0x7f65680099d0).stop 2023-10-01T07:52:07.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.527+0000 7f65750d5700 1 -- 172.21.15.26:0/2735797293 reap_dead start 2023-10-01T07:52:07.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.527+0000 7f6576b38700 1 -- 172.21.15.26:0/2735797293 shutdown_connections 2023-10-01T07:52:07.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.527+0000 7f6576b38700 1 -- 172.21.15.26:0/2735797293 >> 172.21.15.26:0/2735797293 conn(0x7f657009a220 msgr2=0x7f6570096840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:07.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.527+0000 7f6576b38700 1 -- 172.21.15.26:0/2735797293 shutdown_connections 2023-10-01T07:52:07.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.527+0000 7f6576b38700 1 -- 172.21.15.26:0/2735797293 wait complete. 2023-10-01T07:52:07.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.535+0000 7f6df04da700 1 -- 172.21.15.26:0/1501938545 --> v1:172.21.15.26:6800/118773 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6de80942e0 con 0x7f6dcc034770 2023-10-01T07:52:07.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.536+0000 7f6dde7fc700 1 -- 172.21.15.26:0/1501938545 <== osd.0 v1:172.21.15.26:6800/118773 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7f6de80942e0 con 0x7f6dcc034770 2023-10-01T07:52:07.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.536+0000 7f6df04da700 1 -- 172.21.15.26:0/1501938545 >> v1:172.21.15.26:6800/118773 conn(0x7f6dcc034770 legacy=0x7f6dcc036bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.536+0000 7f6df04da700 1 -- 172.21.15.26:0/1501938545 >> v1:172.21.15.26:6816/118178 conn(0x7f6dcc02bb60 legacy=0x7f6dcc02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.536+0000 7f6df04da700 1 -- 172.21.15.26:0/1501938545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6de8096380 msgr2=0x7f6de8113320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.536+0000 7f6df04da700 1 --2- 172.21.15.26:0/1501938545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6de8096380 0x7f6de8113320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f6de0009e90 tx=0x7f6de000b040).stop 2023-10-01T07:52:07.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.536+0000 7f6deea77700 1 -- 172.21.15.26:0/1501938545 reap_dead start 2023-10-01T07:52:07.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.537+0000 7f6df04da700 1 -- 172.21.15.26:0/1501938545 shutdown_connections 2023-10-01T07:52:07.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.537+0000 7f6df04da700 1 -- 172.21.15.26:0/1501938545 >> 172.21.15.26:0/1501938545 conn(0x7f6de8097470 msgr2=0x7f6de8126c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:07.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.537+0000 7f6df04da700 1 -- 172.21.15.26:0/1501938545 shutdown_connections 2023-10-01T07:52:07.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.537+0000 7f6df04da700 1 -- 172.21.15.26:0/1501938545 wait complete. 2023-10-01T07:52:07.539 INFO:teuthology.orchestra.run.smithi026.stdout:38654705669 2023-10-01T07:52:07.540 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:52:07.542 INFO:teuthology.orchestra.run.smithi026.stdout:38654705669 2023-10-01T07:52:07.542 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:52:07.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.545+0000 7faf576fa700 1 -- 172.21.15.26:0/2976241240 --> v1:172.21.15.26:6805/118789 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faf50118390 con 0x7faf34034840 2023-10-01T07:52:07.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.545+0000 7faf417fa700 1 -- 172.21.15.26:0/2976241240 <== osd.2 v1:172.21.15.26:6805/118789 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7faf4400c020 con 0x7faf34034840 2023-10-01T07:52:07.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.545+0000 7faf576fa700 1 -- 172.21.15.26:0/2976241240 >> v1:172.21.15.26:6805/118789 conn(0x7faf34034840 legacy=0x7faf34036cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.546+0000 7faf576fa700 1 -- 172.21.15.26:0/2976241240 >> v1:172.21.15.26:6816/118178 conn(0x7faf3402bbb0 legacy=0x7faf3402e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.546+0000 7faf576fa700 1 -- 172.21.15.26:0/2976241240 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faf5011b2b0 msgr2=0x7faf50067de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.546+0000 7faf576fa700 1 --2- 172.21.15.26:0/2976241240 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faf5011b2b0 0x7faf50067de0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7faf48009fd0 tx=0x7faf48009900).stop 2023-10-01T07:52:07.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.546+0000 7faf55c97700 1 -- 172.21.15.26:0/2976241240 reap_dead start 2023-10-01T07:52:07.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.546+0000 7faf576fa700 1 -- 172.21.15.26:0/2976241240 shutdown_connections 2023-10-01T07:52:07.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.546+0000 7faf576fa700 1 -- 172.21.15.26:0/2976241240 >> 172.21.15.26:0/2976241240 conn(0x7faf5009a220 msgr2=0x7faf50128eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:07.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.546+0000 7faf576fa700 1 -- 172.21.15.26:0/2976241240 shutdown_connections 2023-10-01T07:52:07.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.546+0000 7faf576fa700 1 -- 172.21.15.26:0/2976241240 wait complete. 2023-10-01T07:52:07.552 INFO:teuthology.orchestra.run.smithi026.stdout:38654705669 2023-10-01T07:52:07.552 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:52:07.562 INFO:teuthology.orchestra.run.smithi026.stdout:38654705669 2023-10-01T07:52:07.562 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:52:07.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.683+0000 7f845bb69700 1 Processor -- start 2023-10-01T07:52:07.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.683+0000 7f845bb69700 1 -- start start 2023-10-01T07:52:07.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.684+0000 7f845bb69700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8454096470 0x7f8454096850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.684+0000 7f845bb69700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8454134a40 0x7f8454136e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.684+0000 7f845bb69700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8454065c30 con 0x7f8454096d40 2023-10-01T07:52:07.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.684+0000 7f845bb69700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8454098330 con 0x7f8454134a40 2023-10-01T07:52:07.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.684+0000 7f845bb69700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8454065690 con 0x7f8454096470 2023-10-01T07:52:07.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.684+0000 7f845a106700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8454134a40 0x7f8454136e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.684+0000 7f845a106700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8454134a40 0x7f8454136e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34344/0 (socket says 172.21.15.26:34344) 2023-10-01T07:52:07.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.684+0000 7f845a106700 1 -- 172.21.15.26:0/4160524056 learned_addr learned my addr 172.21.15.26:0/4160524056 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:07.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.685+0000 7f845a106700 1 -- 172.21.15.26:0/4160524056 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8454096470 msgr2=0x7f8454096850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:07.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.685+0000 7f845a106700 1 --2- 172.21.15.26:0/4160524056 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8454096470 0x7f8454096850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-01T07:52:07.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.685+0000 7f845a106700 1 -- 172.21.15.26:0/4160524056 >> v1:172.21.15.26:6789/0 conn(0x7f8454096d40 legacy=0x7f84540971a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.685+0000 7f845a106700 1 -- 172.21.15.26:0/4160524056 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845406a1d0 con 0x7f8454134a40 2023-10-01T07:52:07.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.685+0000 7f845a106700 1 --2- 172.21.15.26:0/4160524056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8454134a40 0x7f8454136e30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f844c009f50 tx=0x7f844c009840).ready entity=mon.0 client_cookie=d18c871efbc75365 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:07.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.686+0000 7f8458903700 1 -- 172.21.15.26:0/4160524056 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c00e070 con 0x7f8454134a40 2023-10-01T07:52:07.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.686+0000 7f8458903700 1 -- 172.21.15.26:0/4160524056 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844c00ba70 con 0x7f8454134a40 2023-10-01T07:52:07.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.686+0000 7f8458903700 1 -- 172.21.15.26:0/4160524056 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c00bdf0 con 0x7f8454134a40 2023-10-01T07:52:07.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.687+0000 7f845bb69700 1 -- 172.21.15.26:0/4160524056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8454134a40 msgr2=0x7f8454136e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.687+0000 7f845bb69700 1 --2- 172.21.15.26:0/4160524056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8454134a40 0x7f8454136e30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f844c009f50 tx=0x7f844c009840).stop 2023-10-01T07:52:07.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.687+0000 7f845bb69700 1 -- 172.21.15.26:0/4160524056 shutdown_connections 2023-10-01T07:52:07.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.687+0000 7f845bb69700 1 --2- 172.21.15.26:0/4160524056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8454134a40 0x7f8454136e30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.687+0000 7f845bb69700 1 --2- 172.21.15.26:0/4160524056 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8454096470 0x7f8454096850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-01T07:52:07.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.687+0000 7f845bb69700 1 -- 172.21.15.26:0/4160524056 >> 172.21.15.26:0/4160524056 conn(0x7f8454059980 msgr2=0x7f845409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:07.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.688+0000 7f845bb69700 1 -- 172.21.15.26:0/4160524056 shutdown_connections 2023-10-01T07:52:07.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.688+0000 7f845bb69700 1 -- 172.21.15.26:0/4160524056 wait complete. 2023-10-01T07:52:07.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.688+0000 7f845bb69700 1 Processor -- start 2023-10-01T07:52:07.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.689+0000 7f845bb69700 1 -- start start 2023-10-01T07:52:07.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.689+0000 7f845bb69700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8454096470 0x7f8454134450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.689+0000 7f845bb69700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8454096d40 0x7f845411e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.689+0000 7f845bb69700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8454134a40 0x7f845411e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.689+0000 7f845bb69700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84541218d0 con 0x7f8454096d40 2023-10-01T07:52:07.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.689+0000 7f845bb69700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845409b970 con 0x7f8454134a40 2023-10-01T07:52:07.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.689+0000 7f845bb69700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8454064a00 con 0x7f8454096470 2023-10-01T07:52:07.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.689+0000 7f8459104700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8454096d40 0x7f845411e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.689+0000 7f8459905700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8454096470 0x7f8454134450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.689+0000 7f8459104700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8454096d40 0x7f845411e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34346/0 (socket says 172.21.15.26:34346) 2023-10-01T07:52:07.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.689+0000 7f8459104700 1 -- 172.21.15.26:0/3269346121 learned_addr learned my addr 172.21.15.26:0/3269346121 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:07.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.690+0000 7f8459905700 1 -- 172.21.15.26:0/3269346121 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8454134a40 msgr2=0x7f845411e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.690+0000 7f8459905700 1 --2- 172.21.15.26:0/3269346121 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8454134a40 0x7f845411e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-01T07:52:07.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.690+0000 7f8459905700 1 -- 172.21.15.26:0/3269346121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8454096d40 msgr2=0x7f845411e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.690+0000 7f8459905700 1 --2- 172.21.15.26:0/3269346121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8454096d40 0x7f845411e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.690+0000 7f8459905700 1 -- 172.21.15.26:0/3269346121 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f844c009ae0 con 0x7f8454096470 2023-10-01T07:52:07.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.690+0000 7f8459104700 1 --2- 172.21.15.26:0/3269346121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8454096d40 0x7f845411e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:07.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.690+0000 7f8459905700 1 --2- 172.21.15.26:0/3269346121 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8454096470 0x7f8454134450 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f844800b4e0 tx=0x7f8448009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:07.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.690+0000 7f8445ffb700 1 -- 172.21.15.26:0/3269346121 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8448002320 con 0x7f8454096470 2023-10-01T07:52:07.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.690+0000 7f8445ffb700 1 -- 172.21.15.26:0/3269346121 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8448002480 con 0x7f8454096470 2023-10-01T07:52:07.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.690+0000 7f845bb69700 1 -- 172.21.15.26:0/3269346121 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f845411f790 con 0x7f8454096470 2023-10-01T07:52:07.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.690+0000 7f8445ffb700 1 -- 172.21.15.26:0/3269346121 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8448002820 con 0x7f8454096470 2023-10-01T07:52:07.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.690+0000 7f845bb69700 1 -- 172.21.15.26:0/3269346121 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f845411ff60 con 0x7f8454096470 2023-10-01T07:52:07.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.691+0000 7f8445ffb700 1 -- 172.21.15.26:0/3269346121 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f8448002bd0 con 0x7f8454096470 2023-10-01T07:52:07.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.691+0000 7f8445ffb700 1 -- 172.21.15.26:0/3269346121 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f844803ad90 con 0x7f8454096470 2023-10-01T07:52:07.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.692+0000 7f845bb69700 1 -- 172.21.15.26:0/3269346121 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8454120150 con 0x7f8454096470 2023-10-01T07:52:07.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.696+0000 7f960ae49700 1 Processor -- start 2023-10-01T07:52:07.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.696+0000 7f960ae49700 1 -- start start 2023-10-01T07:52:07.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.697+0000 7f960ae49700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96040919e0 0x7f9604092580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.697+0000 7f960ae49700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f960412c4b0 0x7f960412e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.697+0000 7f8445ffb700 1 -- 172.21.15.26:0/3269346121 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f844801b3e0 con 0x7f8454096470 2023-10-01T07:52:07.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.697+0000 7f960ae49700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9604098f10 con 0x7f96040984b0 2023-10-01T07:52:07.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.697+0000 7f960ae49700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9604098890 con 0x7f960412c4b0 2023-10-01T07:52:07.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.697+0000 7f960ae49700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9604093f00 con 0x7f96040919e0 2023-10-01T07:52:07.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.697+0000 7f9603fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96040919e0 0x7f9604092580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.697+0000 7f9603fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96040919e0 0x7f9604092580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57568/0 (socket says 172.21.15.26:57568) 2023-10-01T07:52:07.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.697+0000 7f9608be5700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f96040984b0 0x7f9604091e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:40460/0 (socket says 172.21.15.26:40460) 2023-10-01T07:52:07.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.697+0000 7f9603fff700 1 -- 172.21.15.26:0/2669292062 learned_addr learned my addr 172.21.15.26:0/2669292062 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:07.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.698+0000 7f96037fe700 1 -- 172.21.15.26:0/2669292062 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3420263606 0 0) 0x7f9604098f10 con 0x7f96040984b0 2023-10-01T07:52:07.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.698+0000 7f96037fe700 1 -- 172.21.15.26:0/2669292062 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95f40033f0 con 0x7f96040984b0 2023-10-01T07:52:07.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.698+0000 7f9603fff700 1 -- 172.21.15.26:0/2669292062 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f960412c4b0 msgr2=0x7f960412e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:07.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.698+0000 7f9603fff700 1 --2- 172.21.15.26:0/2669292062 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f960412c4b0 0x7f960412e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-01T07:52:07.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.698+0000 7f9603fff700 1 -- 172.21.15.26:0/2669292062 >> v1:172.21.15.26:6789/0 conn(0x7f96040984b0 legacy=0x7f9604091e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.698+0000 7f9603fff700 1 -- 172.21.15.26:0/2669292062 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9604093880 con 0x7f96040919e0 2023-10-01T07:52:07.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.698+0000 7f9603fff700 1 --2- 172.21.15.26:0/2669292062 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96040919e0 0x7f9604092580 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f95f0009830 tx=0x7f95f00090f0).ready entity=mon.2 client_cookie=ec3d31769a03b436 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:07.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.698+0000 7f96037fe700 1 -- 172.21.15.26:0/2669292062 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f000b580 con 0x7f96040919e0 2023-10-01T07:52:07.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.698+0000 7f96037fe700 1 -- 172.21.15.26:0/2669292062 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f000b6e0 con 0x7f96040919e0 2023-10-01T07:52:07.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.698+0000 7f96037fe700 1 -- 172.21.15.26:0/2669292062 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f000ba80 con 0x7f96040919e0 2023-10-01T07:52:07.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.699+0000 7f960ae49700 1 -- 172.21.15.26:0/2669292062 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96040919e0 msgr2=0x7f9604092580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.699+0000 7f960ae49700 1 --2- 172.21.15.26:0/2669292062 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96040919e0 0x7f9604092580 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f95f0009830 tx=0x7f95f00090f0).stop 2023-10-01T07:52:07.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.699+0000 7f960ae49700 1 -- 172.21.15.26:0/2669292062 shutdown_connections 2023-10-01T07:52:07.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.699+0000 7f960ae49700 1 --2- 172.21.15.26:0/2669292062 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f960412c4b0 0x7f960412e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-01T07:52:07.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.699+0000 7f960ae49700 1 --2- 172.21.15.26:0/2669292062 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96040919e0 0x7f9604092580 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.699+0000 7f960ae49700 1 -- 172.21.15.26:0/2669292062 >> 172.21.15.26:0/2669292062 conn(0x7f96040998d0 msgr2=0x7f9604099ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:07.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.699+0000 7f960ae49700 1 -- 172.21.15.26:0/2669292062 shutdown_connections 2023-10-01T07:52:07.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.699+0000 7f960ae49700 1 -- 172.21.15.26:0/2669292062 wait complete. 2023-10-01T07:52:07.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.700+0000 7f960ae49700 1 Processor -- start 2023-10-01T07:52:07.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.701+0000 7f960ae49700 1 -- start start 2023-10-01T07:52:07.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.701+0000 7f960ae49700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96040984b0 0x7f960412cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.701+0000 7f960ae49700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f960412c4b0 0x7f960412d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.701+0000 7f960ae49700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960412d9d0 0x7f960412ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.701+0000 7f960ae49700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9604130600 con 0x7f960412d9d0 2023-10-01T07:52:07.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.701+0000 7f960ae49700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9604126ab0 con 0x7f960412c4b0 2023-10-01T07:52:07.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.701+0000 7f960ae49700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9604114470 con 0x7f96040984b0 2023-10-01T07:52:07.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.701+0000 7f9608be5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96040984b0 0x7f960412cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.701+0000 7f9608be5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96040984b0 0x7f960412cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57584/0 (socket says 172.21.15.26:57584) 2023-10-01T07:52:07.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.701+0000 7f9608be5700 1 -- 172.21.15.26:0/3178341219 learned_addr learned my addr 172.21.15.26:0/3178341219 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:07.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.702+0000 7f9603fff700 1 --2- 172.21.15.26:0/3178341219 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f960412c4b0 0x7f960412d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.702+0000 7f96093e6700 1 --2- 172.21.15.26:0/3178341219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960412d9d0 0x7f960412ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.702+0000 7f9608be5700 1 -- 172.21.15.26:0/3178341219 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f960412c4b0 msgr2=0x7f960412d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.702+0000 7f9608be5700 1 --2- 172.21.15.26:0/3178341219 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f960412c4b0 0x7f960412d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.702+0000 7f9608be5700 1 -- 172.21.15.26:0/3178341219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960412d9d0 msgr2=0x7f960412ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.702+0000 7f9608be5700 1 --2- 172.21.15.26:0/3178341219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960412d9d0 0x7f960412ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.702+0000 7f9608be5700 1 -- 172.21.15.26:0/3178341219 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f0009370 con 0x7f96040984b0 2023-10-01T07:52:07.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.702+0000 7f96093e6700 1 --2- 172.21.15.26:0/3178341219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960412d9d0 0x7f960412ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:52:07.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.702+0000 7f9608be5700 1 --2- 172.21.15.26:0/3178341219 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96040984b0 0x7f960412cff0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f95f800c5c0 tx=0x7f95f8007c80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:07.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.702+0000 7f9600ff9700 1 -- 172.21.15.26:0/3178341219 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f80072e0 con 0x7f96040984b0 2023-10-01T07:52:07.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.702+0000 7f960ae49700 1 -- 172.21.15.26:0/3178341219 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f960412e2e0 con 0x7f96040984b0 2023-10-01T07:52:07.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.702+0000 7f960ae49700 1 -- 172.21.15.26:0/3178341219 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960412f4a0 con 0x7f96040984b0 2023-10-01T07:52:07.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.702+0000 7f9600ff9700 1 -- 172.21.15.26:0/3178341219 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f8007440 con 0x7f96040984b0 2023-10-01T07:52:07.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.702+0000 7f9600ff9700 1 -- 172.21.15.26:0/3178341219 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f8005930 con 0x7f96040984b0 2023-10-01T07:52:07.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.703+0000 7f9600ff9700 1 -- 172.21.15.26:0/3178341219 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f95f8013450 con 0x7f96040984b0 2023-10-01T07:52:07.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.703+0000 7f9600ff9700 1 -- 172.21.15.26:0/3178341219 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f95f803a7c0 con 0x7f96040984b0 2023-10-01T07:52:07.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.708+0000 7f960ae49700 1 -- 172.21.15.26:0/3178341219 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e4005120 con 0x7f96040984b0 2023-10-01T07:52:07.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.712+0000 7f9600ff9700 1 -- 172.21.15.26:0/3178341219 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f95f801b340 con 0x7f96040984b0 2023-10-01T07:52:07.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.755+0000 7f8949402700 1 Processor -- start 2023-10-01T07:52:07.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.755+0000 7f8949402700 1 -- start start 2023-10-01T07:52:07.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.755+0000 7f8949402700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8944123a90 0x7f8944123e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.755+0000 7f8949402700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8944067ce0 0x7f8944092340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.755+0000 7f8949402700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8944068880 con 0x7f8944126f70 2023-10-01T07:52:07.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.755+0000 7f8949402700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89440680c0 con 0x7f8944067ce0 2023-10-01T07:52:07.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.755+0000 7f8949402700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8944068c90 con 0x7f8944123a90 2023-10-01T07:52:07.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.756+0000 7f8942ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8944123a90 0x7f8944123e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.756+0000 7f8942ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8944123a90 0x7f8944123e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55344/0 (socket says 172.21.15.26:55344) 2023-10-01T07:52:07.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.756+0000 7f8942ffd700 1 -- 172.21.15.26:0/3904344353 learned_addr learned my addr 172.21.15.26:0/3904344353 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:07.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.756+0000 7f89427fc700 1 --2- 172.21.15.26:0/3904344353 >> v2:172.21.15.26:3300/0 conn(0x7f8944067ce0 0x7f8944092340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.756+0000 7f8942ffd700 1 -- 172.21.15.26:0/3904344353 >> v2:172.21.15.26:3300/0 conn(0x7f8944067ce0 msgr2=0x7f8944092340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:07.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.756+0000 7f8942ffd700 1 --2- 172.21.15.26:0/3904344353 >> v2:172.21.15.26:3300/0 conn(0x7f8944067ce0 0x7f8944092340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.756+0000 7f8942ffd700 1 -- 172.21.15.26:0/3904344353 >> v1:172.21.15.26:6789/0 conn(0x7f8944126f70 legacy=0x7f8944127420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.756+0000 7f8942ffd700 1 -- 172.21.15.26:0/3904344353 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8944124430 con 0x7f8944123a90 2023-10-01T07:52:07.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.756+0000 7f8941ffb700 1 -- 172.21.15.26:0/3904344353 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3824472313 0 0) 0x7f8944068880 con 0x7f8944126f70 2023-10-01T07:52:07.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.756+0000 7f8942ffd700 1 --2- 172.21.15.26:0/3904344353 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8944123a90 0x7f8944123e70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f893400bac0 tx=0x7f893400b370).ready entity=mon.1 client_cookie=f6be8d39d55d5000 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:07.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.756+0000 7f8941ffb700 1 -- 172.21.15.26:0/3904344353 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893400db70 con 0x7f8944123a90 2023-10-01T07:52:07.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.757+0000 7f8941ffb700 1 -- 172.21.15.26:0/3904344353 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893400dcd0 con 0x7f8944123a90 2023-10-01T07:52:07.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.757+0000 7f8941ffb700 1 -- 172.21.15.26:0/3904344353 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8934015600 con 0x7f8944123a90 2023-10-01T07:52:07.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.757+0000 7f8949402700 1 -- 172.21.15.26:0/3904344353 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8944123a90 msgr2=0x7f8944123e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.757+0000 7f8949402700 1 --2- 172.21.15.26:0/3904344353 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8944123a90 0x7f8944123e70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f893400bac0 tx=0x7f893400b370).stop 2023-10-01T07:52:07.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.757+0000 7f8949402700 1 -- 172.21.15.26:0/3904344353 shutdown_connections 2023-10-01T07:52:07.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.757+0000 7f8949402700 1 --2- 172.21.15.26:0/3904344353 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8944123a90 0x7f8944123e70 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.757+0000 7f8949402700 1 --2- 172.21.15.26:0/3904344353 >> v2:172.21.15.26:3300/0 conn(0x7f8944067ce0 0x7f8944092340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.757+0000 7f8949402700 1 -- 172.21.15.26:0/3904344353 >> 172.21.15.26:0/3904344353 conn(0x7f894409a220 msgr2=0x7f894409a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:07.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.757+0000 7f8949402700 1 -- 172.21.15.26:0/3904344353 shutdown_connections 2023-10-01T07:52:07.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.757+0000 7f8949402700 1 -- 172.21.15.26:0/3904344353 wait complete. 2023-10-01T07:52:07.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.758+0000 7f8949402700 1 Processor -- start 2023-10-01T07:52:07.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.759+0000 7f8949402700 1 -- start start 2023-10-01T07:52:07.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.759+0000 7f8949402700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8944067ce0 0x7f8944115b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.759+0000 7f8949402700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8944123a90 0x7f8944116030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.759+0000 7f8949402700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8944126f70 0x7f8944116520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.759+0000 7f8949402700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89440981e0 con 0x7f8944123a90 2023-10-01T07:52:07.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.759+0000 7f8949402700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8944118d60 con 0x7f8944126f70 2023-10-01T07:52:07.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.759+0000 7f8949402700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f894411a1c0 con 0x7f8944067ce0 2023-10-01T07:52:07.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.759+0000 7f89427fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8944123a90 0x7f8944116030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.759+0000 7f89427fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8944123a90 0x7f8944116030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34374/0 (socket says 172.21.15.26:34374) 2023-10-01T07:52:07.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.759+0000 7f89427fc700 1 -- 172.21.15.26:0/3311650822 learned_addr learned my addr 172.21.15.26:0/3311650822 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:07.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.760+0000 7f89427fc700 1 -- 172.21.15.26:0/3311650822 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8944067ce0 msgr2=0x7f8944115b40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:52:07.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.760+0000 7f89427fc700 1 --2- 172.21.15.26:0/3311650822 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8944067ce0 0x7f8944115b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-01T07:52:07.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.760+0000 7f89427fc700 1 -- 172.21.15.26:0/3311650822 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8944126f70 msgr2=0x7f8944116520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.760+0000 7f89427fc700 1 --2- 172.21.15.26:0/3311650822 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8944126f70 0x7f8944116520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-01T07:52:07.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.760+0000 7f89427fc700 1 -- 172.21.15.26:0/3311650822 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893400b6a0 con 0x7f8944123a90 2023-10-01T07:52:07.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.760+0000 7f89427fc700 1 --2- 172.21.15.26:0/3311650822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8944123a90 0x7f8944116030 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f893800e930 tx=0x7f8938009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:07.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.760+0000 7f892affd700 1 -- 172.21.15.26:0/3311650822 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893800eed0 con 0x7f8944123a90 2023-10-01T07:52:07.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.760+0000 7f892affd700 1 -- 172.21.15.26:0/3311650822 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893800c850 con 0x7f8944123a90 2023-10-01T07:52:07.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.760+0000 7f892affd700 1 -- 172.21.15.26:0/3311650822 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893800cbd0 con 0x7f8944123a90 2023-10-01T07:52:07.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.761+0000 7f8949402700 1 -- 172.21.15.26:0/3311650822 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8944119300 con 0x7f8944123a90 2023-10-01T07:52:07.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.761+0000 7f8949402700 1 -- 172.21.15.26:0/3311650822 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8944119cc0 con 0x7f8944123a90 2023-10-01T07:52:07.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.762+0000 7f892affd700 1 -- 172.21.15.26:0/3311650822 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f893801b400 con 0x7f8944123a90 2023-10-01T07:52:07.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.762+0000 7f892affd700 1 -- 172.21.15.26:0/3311650822 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f893803b580 con 0x7f8944123a90 2023-10-01T07:52:07.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.763+0000 7f8949402700 1 -- 172.21.15.26:0/3311650822 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8944119540 con 0x7f8944123a90 2023-10-01T07:52:07.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.768+0000 7f892affd700 1 -- 172.21.15.26:0/3311650822 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f8938019900 con 0x7f8944123a90 2023-10-01T07:52:07.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.769+0000 7febb33bf700 1 Processor -- start 2023-10-01T07:52:07.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.770+0000 7febb33bf700 1 -- start start 2023-10-01T07:52:07.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.770+0000 7febb33bf700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7febac12b510 0x7febac12ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.770+0000 7febb33bf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febac1303f0 0x7febac1327e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.770+0000 7febb33bf700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febac12abd0 con 0x7febac0613a0 2023-10-01T07:52:07.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.770+0000 7febb33bf700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febac061780 con 0x7febac12b510 2023-10-01T07:52:07.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.770+0000 7febb33bf700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febac067530 con 0x7febac1303f0 2023-10-01T07:52:07.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.771+0000 7febb095a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7febac12b510 0x7febac12ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.771+0000 7febb095a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7febac12b510 0x7febac12ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34390/0 (socket says 172.21.15.26:34390) 2023-10-01T07:52:07.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.771+0000 7febb095a700 1 -- 172.21.15.26:0/3818877068 learned_addr learned my addr 172.21.15.26:0/3818877068 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:07.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.771+0000 7febb195c700 1 --2- 172.21.15.26:0/3818877068 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febac1303f0 0x7febac1327e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.771+0000 7febb095a700 1 -- 172.21.15.26:0/3818877068 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febac1303f0 msgr2=0x7febac1327e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:07.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.771+0000 7febb095a700 1 --2- 172.21.15.26:0/3818877068 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febac1303f0 0x7febac1327e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.771+0000 7febb095a700 1 -- 172.21.15.26:0/3818877068 >> v1:172.21.15.26:6789/0 conn(0x7febac0613a0 legacy=0x7febac12ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.771+0000 7feba3fff700 1 -- 172.21.15.26:0/3818877068 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1492477944 0 0) 0x7febac12abd0 con 0x7febac0613a0 2023-10-01T07:52:07.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.771+0000 7febb095a700 1 -- 172.21.15.26:0/3818877068 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febac0683c0 con 0x7febac12b510 2023-10-01T07:52:07.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.771+0000 7febb095a700 1 --2- 172.21.15.26:0/3818877068 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febac12b510 0x7febac12ff00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7feb9c006fd0 tx=0x7feb9c0090f0).ready entity=mon.0 client_cookie=ea4687494fa1388b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:07.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.772+0000 7feba3fff700 1 -- 172.21.15.26:0/3818877068 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c00b580 con 0x7febac12b510 2023-10-01T07:52:07.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.772+0000 7feba3fff700 1 -- 172.21.15.26:0/3818877068 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9c00b6e0 con 0x7febac12b510 2023-10-01T07:52:07.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.772+0000 7feba3fff700 1 -- 172.21.15.26:0/3818877068 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c00ba60 con 0x7febac12b510 2023-10-01T07:52:07.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.772+0000 7febb33bf700 1 -- 172.21.15.26:0/3818877068 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febac12b510 msgr2=0x7febac12ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.772+0000 7febb33bf700 1 --2- 172.21.15.26:0/3818877068 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febac12b510 0x7febac12ff00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7feb9c006fd0 tx=0x7feb9c0090f0).stop 2023-10-01T07:52:07.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.773+0000 7febb33bf700 1 -- 172.21.15.26:0/3818877068 shutdown_connections 2023-10-01T07:52:07.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.773+0000 7febb33bf700 1 --2- 172.21.15.26:0/3818877068 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febac1303f0 0x7febac1327e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.773+0000 7febb33bf700 1 --2- 172.21.15.26:0/3818877068 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febac12b510 0x7febac12ff00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.773+0000 7febb33bf700 1 -- 172.21.15.26:0/3818877068 >> 172.21.15.26:0/3818877068 conn(0x7febac09a220 msgr2=0x7febac09a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:07.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.773+0000 7febb33bf700 1 -- 172.21.15.26:0/3818877068 shutdown_connections 2023-10-01T07:52:07.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.773+0000 7febb33bf700 1 -- 172.21.15.26:0/3818877068 wait complete. 2023-10-01T07:52:07.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.774+0000 7febb33bf700 1 Processor -- start 2023-10-01T07:52:07.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.774+0000 7febb33bf700 1 -- start start 2023-10-01T07:52:07.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.775+0000 7febb33bf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febac0613a0 0x7febac13aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.775+0000 7febb33bf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febac12b510 0x7febac13afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.775+0000 7febb33bf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febac1303f0 0x7febac113a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:07.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.775+0000 7febb33bf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac098400 con 0x7febac0613a0 2023-10-01T07:52:07.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.775+0000 7febb33bf700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febac117260 con 0x7febac1303f0 2023-10-01T07:52:07.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.775+0000 7febb33bf700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febac130870 con 0x7febac12b510 2023-10-01T07:52:07.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.775+0000 7febb195c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febac1303f0 0x7febac113a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.775+0000 7febb095a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febac12b510 0x7febac13afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.775+0000 7febb115b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febac0613a0 0x7febac13aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:07.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.775+0000 7febb195c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febac1303f0 0x7febac113a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55364/0 (socket says 172.21.15.26:55364) 2023-10-01T07:52:07.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.775+0000 7febb195c700 1 -- 172.21.15.26:0/2935486736 learned_addr learned my addr 172.21.15.26:0/2935486736 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:07.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.776+0000 7febb095a700 1 -- 172.21.15.26:0/2935486736 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febac1303f0 msgr2=0x7febac113a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.776+0000 7febb095a700 1 --2- 172.21.15.26:0/2935486736 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febac1303f0 0x7febac113a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.776+0000 7febb095a700 1 -- 172.21.15.26:0/2935486736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febac0613a0 msgr2=0x7febac13aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.776+0000 7febb095a700 1 --2- 172.21.15.26:0/2935486736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febac0613a0 0x7febac13aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.776+0000 7febb095a700 1 -- 172.21.15.26:0/2935486736 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9c009370 con 0x7febac12b510 2023-10-01T07:52:07.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.776+0000 7febb195c700 1 --2- 172.21.15.26:0/2935486736 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febac1303f0 0x7febac113a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:07.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.776+0000 7febb115b700 1 --2- 172.21.15.26:0/2935486736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febac0613a0 0x7febac13aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:07.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.776+0000 7febb095a700 1 --2- 172.21.15.26:0/2935486736 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febac12b510 0x7febac13afb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7feb9c014000 tx=0x7feb9c017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:07.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.776+0000 7feba17fa700 1 -- 172.21.15.26:0/2935486736 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c006a40 con 0x7febac12b510 2023-10-01T07:52:07.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.776+0000 7feba17fa700 1 -- 172.21.15.26:0/2935486736 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9c000bc0 con 0x7febac12b510 2023-10-01T07:52:07.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.776+0000 7feba17fa700 1 -- 172.21.15.26:0/2935486736 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c01c420 con 0x7febac12b510 2023-10-01T07:52:07.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.776+0000 7febb33bf700 1 -- 172.21.15.26:0/2935486736 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febac116fa0 con 0x7febac12b510 2023-10-01T07:52:07.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.776+0000 7febb33bf700 1 -- 172.21.15.26:0/2935486736 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febac117c20 con 0x7febac12b510 2023-10-01T07:52:07.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.777+0000 7feba17fa700 1 -- 172.21.15.26:0/2935486736 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7feb9c01c7d0 con 0x7febac12b510 2023-10-01T07:52:07.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.777+0000 7feba17fa700 1 -- 172.21.15.26:0/2935486736 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7feb9c03cc30 con 0x7febac12b510 2023-10-01T07:52:07.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.778+0000 7febb33bf700 1 -- 172.21.15.26:0/2935486736 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febac096ee0 con 0x7febac12b510 2023-10-01T07:52:07.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.787+0000 7feba17fa700 1 -- 172.21.15.26:0/2935486736 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7feb9c02a020 con 0x7febac12b510 2023-10-01T07:52:07.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.900+0000 7f960ae49700 1 -- 172.21.15.26:0/3178341219 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f95e40057f0 con 0x7f96040984b0 2023-10-01T07:52:07.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.901+0000 7f9600ff9700 1 -- 172.21.15.26:0/3178341219 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f95f8018020 con 0x7f96040984b0 2023-10-01T07:52:07.902 INFO:teuthology.orchestra.run.smithi026.stdout:38654705668 2023-10-01T07:52:07.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.903+0000 7f960ae49700 1 -- 172.21.15.26:0/3178341219 >> v1:172.21.15.26:6816/118178 conn(0x7f95e802bb60 legacy=0x7f95e802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.903+0000 7f960ae49700 1 -- 172.21.15.26:0/3178341219 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96040984b0 msgr2=0x7f960412cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.903+0000 7f960ae49700 1 --2- 172.21.15.26:0/3178341219 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96040984b0 0x7f960412cff0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f95f800c5c0 tx=0x7f95f8007c80).stop 2023-10-01T07:52:07.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.903+0000 7f960ae49700 1 -- 172.21.15.26:0/3178341219 shutdown_connections 2023-10-01T07:52:07.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.903+0000 7f960ae49700 1 --2- 172.21.15.26:0/3178341219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960412d9d0 0x7f960412ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.903+0000 7f960ae49700 1 --2- 172.21.15.26:0/3178341219 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96040984b0 0x7f960412cff0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.903+0000 7f960ae49700 1 --2- 172.21.15.26:0/3178341219 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f960412c4b0 0x7f960412d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.903+0000 7f960ae49700 1 -- 172.21.15.26:0/3178341219 >> 172.21.15.26:0/3178341219 conn(0x7f96040998d0 msgr2=0x7f9604095c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:07.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.903+0000 7f960ae49700 1 -- 172.21.15.26:0/3178341219 shutdown_connections 2023-10-01T07:52:07.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.903+0000 7f960ae49700 1 -- 172.21.15.26:0/3178341219 wait complete. 2023-10-01T07:52:07.917 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.1 2023-10-01T07:52:07.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.938+0000 7f845bb69700 1 -- 172.21.15.26:0/3269346121 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8454121dd0 con 0x7f8454096470 2023-10-01T07:52:07.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.938+0000 7f8445ffb700 1 -- 172.21.15.26:0/3269346121 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8454121dd0 con 0x7f8454096470 2023-10-01T07:52:07.939 INFO:teuthology.orchestra.run.smithi026.stdout:38654705668 2023-10-01T07:52:07.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.941+0000 7f845bb69700 1 -- 172.21.15.26:0/3269346121 >> v1:172.21.15.26:6816/118178 conn(0x7f843802bb60 legacy=0x7f843802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.941+0000 7f845bb69700 1 -- 172.21.15.26:0/3269346121 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8454096470 msgr2=0x7f8454134450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.941+0000 7f845bb69700 1 --2- 172.21.15.26:0/3269346121 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8454096470 0x7f8454134450 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f844800b4e0 tx=0x7f8448009060).stop 2023-10-01T07:52:07.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.941+0000 7f845bb69700 1 -- 172.21.15.26:0/3269346121 shutdown_connections 2023-10-01T07:52:07.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.941+0000 7f845bb69700 1 --2- 172.21.15.26:0/3269346121 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8454134a40 0x7f845411e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-01T07:52:07.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.941+0000 7f845bb69700 1 --2- 172.21.15.26:0/3269346121 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8454096470 0x7f8454134450 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.941+0000 7f845bb69700 1 --2- 172.21.15.26:0/3269346121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8454096d40 0x7f845411e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.941+0000 7f845bb69700 1 -- 172.21.15.26:0/3269346121 >> 172.21.15.26:0/3269346121 conn(0x7f8454059980 msgr2=0x7f84540954f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:07.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.941+0000 7f845bb69700 1 -- 172.21.15.26:0/3269346121 shutdown_connections 2023-10-01T07:52:07.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.941+0000 7f845bb69700 1 -- 172.21.15.26:0/3269346121 wait complete. 2023-10-01T07:52:07.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.949+0000 7f8949402700 1 -- 172.21.15.26:0/3311650822 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f894405a260 con 0x7f8944123a90 2023-10-01T07:52:07.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.950+0000 7f892affd700 1 -- 172.21.15.26:0/3311650822 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8938019310 con 0x7f8944123a90 2023-10-01T07:52:07.950 INFO:teuthology.orchestra.run.smithi026.stdout:38654705668 2023-10-01T07:52:07.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.952+0000 7f8949402700 1 -- 172.21.15.26:0/3311650822 >> v1:172.21.15.26:6816/118178 conn(0x7f893002bb60 legacy=0x7f893002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.952+0000 7f8949402700 1 -- 172.21.15.26:0/3311650822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8944123a90 msgr2=0x7f8944116030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.952+0000 7f8949402700 1 --2- 172.21.15.26:0/3311650822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8944123a90 0x7f8944116030 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f893800e930 tx=0x7f8938009060).stop 2023-10-01T07:52:07.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.952+0000 7f8949402700 1 -- 172.21.15.26:0/3311650822 shutdown_connections 2023-10-01T07:52:07.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.952+0000 7f8949402700 1 --2- 172.21.15.26:0/3311650822 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8944126f70 0x7f8944116520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-01T07:52:07.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.952+0000 7f8949402700 1 --2- 172.21.15.26:0/3311650822 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8944067ce0 0x7f8944115b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-01T07:52:07.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.952+0000 7f8949402700 1 --2- 172.21.15.26:0/3311650822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8944123a90 0x7f8944116030 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.952+0000 7f8949402700 1 -- 172.21.15.26:0/3311650822 >> 172.21.15.26:0/3311650822 conn(0x7f894409a220 msgr2=0x7f8944126710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:07.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.952+0000 7f8949402700 1 -- 172.21.15.26:0/3311650822 shutdown_connections 2023-10-01T07:52:07.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.952+0000 7f8949402700 1 -- 172.21.15.26:0/3311650822 wait complete. 2023-10-01T07:52:07.955 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.3 2023-10-01T07:52:07.966 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.2 2023-10-01T07:52:07.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.992+0000 7febb33bf700 1 -- 172.21.15.26:0/2935486736 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7febac09a8c0 con 0x7febac12b510 2023-10-01T07:52:07.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.993+0000 7feba17fa700 1 -- 172.21.15.26:0/2935486736 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feb9c034090 con 0x7febac12b510 2023-10-01T07:52:07.994 INFO:teuthology.orchestra.run.smithi026.stdout:38654705668 2023-10-01T07:52:07.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.995+0000 7febb33bf700 1 -- 172.21.15.26:0/2935486736 >> v1:172.21.15.26:6816/118178 conn(0x7feb9002bbb0 legacy=0x7feb9002e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.995+0000 7febb33bf700 1 -- 172.21.15.26:0/2935486736 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febac12b510 msgr2=0x7febac13afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:07.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.995+0000 7febb33bf700 1 --2- 172.21.15.26:0/2935486736 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febac12b510 0x7febac13afb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7feb9c014000 tx=0x7feb9c017000).stop 2023-10-01T07:52:07.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.995+0000 7febb33bf700 1 -- 172.21.15.26:0/2935486736 shutdown_connections 2023-10-01T07:52:07.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.995+0000 7febb33bf700 1 --2- 172.21.15.26:0/2935486736 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febac1303f0 0x7febac113a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.995+0000 7febb33bf700 1 --2- 172.21.15.26:0/2935486736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febac0613a0 0x7febac13aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.995+0000 7febb33bf700 1 --2- 172.21.15.26:0/2935486736 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febac12b510 0x7febac13afb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:07.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.995+0000 7febb33bf700 1 -- 172.21.15.26:0/2935486736 >> 172.21.15.26:0/2935486736 conn(0x7febac09a220 msgr2=0x7febac129c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:07.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.995+0000 7febb33bf700 1 -- 172.21.15.26:0/2935486736 shutdown_connections 2023-10-01T07:52:07.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:07.995+0000 7febb33bf700 1 -- 172.21.15.26:0/2935486736 wait complete. 2023-10-01T07:52:08.008 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.0 2023-10-01T07:52:08.918 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:52:08.956 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:52:08.967 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:52:09.009 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:52:09.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.065+0000 7efd391ad700 1 Processor -- start 2023-10-01T07:52:09.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.065+0000 7efd391ad700 1 -- start start 2023-10-01T07:52:09.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.065+0000 7efd391ad700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efd34066cd0 0x7efd340670b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:09.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.065+0000 7efd391ad700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efd3412f900 0x7efd34137450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:09.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.065+0000 7efd391ad700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd34098000 con 0x7efd340675a0 2023-10-01T07:52:09.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.065+0000 7efd391ad700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd34068b90 con 0x7efd34066cd0 2023-10-01T07:52:09.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.065+0000 7efd391ad700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd340921c0 con 0x7efd3412f900 2023-10-01T07:52:09.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.066+0000 7efd3359e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efd3412f900 0x7efd34137450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:09.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.066+0000 7efd3359e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efd3412f900 0x7efd34137450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55370/0 (socket says 172.21.15.26:55370) 2023-10-01T07:52:09.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.066+0000 7efd3359e700 1 -- 172.21.15.26:0/840716910 learned_addr learned my addr 172.21.15.26:0/840716910 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:09.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.066+0000 7efd32d9d700 1 --2- 172.21.15.26:0/840716910 >> v2:172.21.15.26:3300/0 conn(0x7efd34066cd0 0x7efd340670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:09.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.066+0000 7efd3359e700 1 -- 172.21.15.26:0/840716910 >> v2:172.21.15.26:3300/0 conn(0x7efd34066cd0 msgr2=0x7efd340670b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:09.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.066+0000 7efd3359e700 1 --2- 172.21.15.26:0/840716910 >> v2:172.21.15.26:3300/0 conn(0x7efd34066cd0 0x7efd340670b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.066+0000 7efd3359e700 1 -- 172.21.15.26:0/840716910 >> v1:172.21.15.26:6789/0 conn(0x7efd340675a0 legacy=0x7efd3412f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:09.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.066+0000 7efd3359e700 1 -- 172.21.15.26:0/840716910 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd340697b0 con 0x7efd3412f900 2023-10-01T07:52:09.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.066+0000 7efd3359e700 1 --2- 172.21.15.26:0/840716910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efd3412f900 0x7efd34137450 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7efd2c009f20 tx=0x7efd2c009840).ready entity=mon.1 client_cookie=5bf8d6de6be35cc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:09.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.067+0000 7efd31d9b700 1 -- 172.21.15.26:0/840716910 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2c00e070 con 0x7efd3412f900 2023-10-01T07:52:09.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.067+0000 7efd31d9b700 1 -- 172.21.15.26:0/840716910 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2c00b9d0 con 0x7efd3412f900 2023-10-01T07:52:09.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.067+0000 7efd31d9b700 1 -- 172.21.15.26:0/840716910 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2c00bd50 con 0x7efd3412f900 2023-10-01T07:52:09.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.067+0000 7efd391ad700 1 -- 172.21.15.26:0/840716910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efd3412f900 msgr2=0x7efd34137450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:09.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.067+0000 7efd391ad700 1 --2- 172.21.15.26:0/840716910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efd3412f900 0x7efd34137450 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7efd2c009f20 tx=0x7efd2c009840).stop 2023-10-01T07:52:09.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.067+0000 7efd391ad700 1 -- 172.21.15.26:0/840716910 shutdown_connections 2023-10-01T07:52:09.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.067+0000 7efd391ad700 1 --2- 172.21.15.26:0/840716910 >> v2:172.21.15.26:3300/0 conn(0x7efd34066cd0 0x7efd340670b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.067+0000 7efd391ad700 1 --2- 172.21.15.26:0/840716910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efd3412f900 0x7efd34137450 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.068+0000 7efd391ad700 1 -- 172.21.15.26:0/840716910 >> 172.21.15.26:0/840716910 conn(0x7efd3409a220 msgr2=0x7efd3409a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:09.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.068+0000 7efd391ad700 1 -- 172.21.15.26:0/840716910 shutdown_connections 2023-10-01T07:52:09.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.068+0000 7efd391ad700 1 -- 172.21.15.26:0/840716910 wait complete. 2023-10-01T07:52:09.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.069+0000 7efd391ad700 1 Processor -- start 2023-10-01T07:52:09.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.069+0000 7efd391ad700 1 -- start start 2023-10-01T07:52:09.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.070+0000 7efd391ad700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd34066cd0 0x7efd3412ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:09.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.070+0000 7efd391ad700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efd340675a0 0x7efd3412f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:09.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.070+0000 7efd391ad700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efd3412f900 0x7efd34134a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:09.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.070+0000 7efd391ad700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd340924b0 con 0x7efd34066cd0 2023-10-01T07:52:09.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.070+0000 7efd391ad700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd34069270 con 0x7efd340675a0 2023-10-01T07:52:09.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.070+0000 7efd391ad700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd341381d0 con 0x7efd3412f900 2023-10-01T07:52:09.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.070+0000 7efd32d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd34066cd0 0x7efd3412ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:09.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.070+0000 7efd32d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd34066cd0 0x7efd3412ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34424/0 (socket says 172.21.15.26:34424) 2023-10-01T07:52:09.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.070+0000 7efd32d9d700 1 -- 172.21.15.26:0/1932214370 learned_addr learned my addr 172.21.15.26:0/1932214370 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:09.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.070+0000 7efd3359e700 1 --2- 172.21.15.26:0/1932214370 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efd3412f900 0x7efd34134a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:09.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.070+0000 7efd3259c700 1 --2- 172.21.15.26:0/1932214370 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efd340675a0 0x7efd3412f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:09.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.071+0000 7efd32d9d700 1 -- 172.21.15.26:0/1932214370 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efd3412f900 msgr2=0x7efd34134a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:09.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.071+0000 7efd32d9d700 1 --2- 172.21.15.26:0/1932214370 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efd3412f900 0x7efd34134a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.071+0000 7efd32d9d700 1 -- 172.21.15.26:0/1932214370 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efd340675a0 msgr2=0x7efd3412f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:09.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.071+0000 7efd32d9d700 1 --2- 172.21.15.26:0/1932214370 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efd340675a0 0x7efd3412f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.071+0000 7efd32d9d700 1 -- 172.21.15.26:0/1932214370 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd2c009ae0 con 0x7efd34066cd0 2023-10-01T07:52:09.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.071+0000 7efd32d9d700 1 --2- 172.21.15.26:0/1932214370 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd34066cd0 0x7efd3412ef20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7efd2400e930 tx=0x7efd24009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:09.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.071+0000 7efd1affd700 1 -- 172.21.15.26:0/1932214370 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd24009510 con 0x7efd34066cd0 2023-10-01T07:52:09.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.071+0000 7efd1affd700 1 -- 172.21.15.26:0/1932214370 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd24012600 con 0x7efd34066cd0 2023-10-01T07:52:09.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.071+0000 7efd391ad700 1 -- 172.21.15.26:0/1932214370 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd34136570 con 0x7efd34066cd0 2023-10-01T07:52:09.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.071+0000 7efd1affd700 1 -- 172.21.15.26:0/1932214370 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd24012980 con 0x7efd34066cd0 2023-10-01T07:52:09.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.071+0000 7efd391ad700 1 -- 172.21.15.26:0/1932214370 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd34111150 con 0x7efd34066cd0 2023-10-01T07:52:09.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.073+0000 7efd391ad700 1 -- 172.21.15.26:0/1932214370 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd3405a260 con 0x7efd34066cd0 2023-10-01T07:52:09.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.073+0000 7efd1affd700 1 -- 172.21.15.26:0/1932214370 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7efd2401b400 con 0x7efd34066cd0 2023-10-01T07:52:09.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.073+0000 7efd1affd700 1 -- 172.21.15.26:0/1932214370 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7efd2403b360 con 0x7efd34066cd0 2023-10-01T07:52:09.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.078+0000 7efd1affd700 1 -- 172.21.15.26:0/1932214370 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7efd24011d20 con 0x7efd34066cd0 2023-10-01T07:52:09.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.105+0000 7f9ee13d4700 1 Processor -- start 2023-10-01T07:52:09.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.105+0000 7f9ee13d4700 1 -- start start 2023-10-01T07:52:09.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.106+0000 7f9ee13d4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9edc096610 0x7f9edc0969f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:09.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.106+0000 7f9ee13d4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9edc096ee0 0x7f9edc067de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:09.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.106+0000 7f9ee13d4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9edc069ad0 con 0x7f9edc0682d0 2023-10-01T07:52:09.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.106+0000 7f9ee13d4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc093420 con 0x7f9edc096ee0 2023-10-01T07:52:09.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.106+0000 7f9ee13d4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc091ef0 con 0x7f9edc096610 2023-10-01T07:52:09.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.106+0000 7f9eda7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9edc096ee0 0x7f9edc067de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:09.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.106+0000 7f9eda7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9edc096ee0 0x7f9edc067de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55384/0 (socket says 172.21.15.26:55384) 2023-10-01T07:52:09.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.106+0000 7f9eda7fc700 1 -- 172.21.15.26:0/2528536546 learned_addr learned my addr 172.21.15.26:0/2528536546 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:09.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.106+0000 7f9edaffd700 1 --2- 172.21.15.26:0/2528536546 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9edc096610 0x7f9edc0969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:09.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.106+0000 7f9eda7fc700 1 -- 172.21.15.26:0/2528536546 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9edc096610 msgr2=0x7f9edc0969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:09.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.106+0000 7f9eda7fc700 1 --2- 172.21.15.26:0/2528536546 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9edc096610 0x7f9edc0969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.106+0000 7f9eda7fc700 1 -- 172.21.15.26:0/2528536546 >> v1:172.21.15.26:6789/0 conn(0x7f9edc0682d0 legacy=0x7f9edc12ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:09.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.106+0000 7f9eda7fc700 1 -- 172.21.15.26:0/2528536546 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc092450 con 0x7f9edc096ee0 2023-10-01T07:52:09.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.106+0000 7f9edaffd700 1 --2- 172.21.15.26:0/2528536546 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9edc096610 0x7f9edc0969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:09.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.107+0000 7f9eda7fc700 1 --2- 172.21.15.26:0/2528536546 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9edc096ee0 0x7f9edc067de0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f9ed000b910 tx=0x7f9ed00090f0).ready entity=mon.1 client_cookie=2b86877bec384dca server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:09.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.107+0000 7f9ed9ffb700 1 -- 172.21.15.26:0/2528536546 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed000c780 con 0x7f9edc096ee0 2023-10-01T07:52:09.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.107+0000 7f9ed9ffb700 1 -- 172.21.15.26:0/2528536546 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed000c8e0 con 0x7f9edc096ee0 2023-10-01T07:52:09.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.107+0000 7f9ed9ffb700 1 -- 172.21.15.26:0/2528536546 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed000cc60 con 0x7f9edc096ee0 2023-10-01T07:52:09.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.108+0000 7f9ee13d4700 1 -- 172.21.15.26:0/2528536546 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9edc096ee0 msgr2=0x7f9edc067de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:09.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.108+0000 7f9ee13d4700 1 --2- 172.21.15.26:0/2528536546 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9edc096ee0 0x7f9edc067de0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f9ed000b910 tx=0x7f9ed00090f0).stop 2023-10-01T07:52:09.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.108+0000 7f9ee13d4700 1 -- 172.21.15.26:0/2528536546 shutdown_connections 2023-10-01T07:52:09.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.108+0000 7f9ee13d4700 1 --2- 172.21.15.26:0/2528536546 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9edc096610 0x7f9edc0969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.108+0000 7f9ee13d4700 1 --2- 172.21.15.26:0/2528536546 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9edc096ee0 0x7f9edc067de0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.108+0000 7f9ee13d4700 1 -- 172.21.15.26:0/2528536546 >> 172.21.15.26:0/2528536546 conn(0x7f9edc09a220 msgr2=0x7f9edc09a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:09.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.108+0000 7f9ee13d4700 1 -- 172.21.15.26:0/2528536546 shutdown_connections 2023-10-01T07:52:09.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.108+0000 7f9ee13d4700 1 -- 172.21.15.26:0/2528536546 wait complete. 2023-10-01T07:52:09.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.110+0000 7f9ee13d4700 1 Processor -- start 2023-10-01T07:52:09.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.110+0000 7f9ee13d4700 1 -- start start 2023-10-01T07:52:09.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.110+0000 7f9ee13d4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9edc0682d0 0x7f9edc136120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:09.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.110+0000 7f9ee13d4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9edc096610 0x7f9edc136610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:09.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.110+0000 7f9ee13d4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9edc096ee0 0x7f9edc115e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:09.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.110+0000 7f9ee13d4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc12aee0 con 0x7f9edc096ee0 2023-10-01T07:52:09.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.110+0000 7f9ee13d4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc066670 con 0x7f9edc096610 2023-10-01T07:52:09.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.110+0000 7f9ee13d4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc091bf0 con 0x7f9edc0682d0 2023-10-01T07:52:09.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.111+0000 7f9edaffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9edc0682d0 0x7f9edc136120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:09.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.111+0000 7f9edaffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9edc0682d0 0x7f9edc136120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57634/0 (socket says 172.21.15.26:57634) 2023-10-01T07:52:09.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.111+0000 7f9edaffd700 1 -- 172.21.15.26:0/3108887885 learned_addr learned my addr 172.21.15.26:0/3108887885 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:09.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.111+0000 7f9eda7fc700 1 --2- 172.21.15.26:0/3108887885 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9edc096610 0x7f9edc136610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:09.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.111+0000 7f9edb7fe700 1 --2- 172.21.15.26:0/3108887885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9edc096ee0 0x7f9edc115e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:09.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.111+0000 7f9edaffd700 1 -- 172.21.15.26:0/3108887885 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9edc096610 msgr2=0x7f9edc136610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:09.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.111+0000 7f9edaffd700 1 --2- 172.21.15.26:0/3108887885 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9edc096610 0x7f9edc136610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.111+0000 7f9edaffd700 1 -- 172.21.15.26:0/3108887885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9edc096ee0 msgr2=0x7f9edc115e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:09.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.111+0000 7f9edaffd700 1 --2- 172.21.15.26:0/3108887885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9edc096ee0 0x7f9edc115e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.111+0000 7f9edaffd700 1 -- 172.21.15.26:0/3108887885 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ecc00d740 con 0x7f9edc0682d0 2023-10-01T07:52:09.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.111+0000 7f9edaffd700 1 --2- 172.21.15.26:0/3108887885 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9edc0682d0 0x7f9edc136120 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f9ecc00ddc0 tx=0x7f9ecc00f040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:09.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.111+0000 7f9ec2ffd700 1 -- 172.21.15.26:0/3108887885 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc00d2e0 con 0x7f9edc0682d0 2023-10-01T07:52:09.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.112+0000 7f9ec2ffd700 1 -- 172.21.15.26:0/3108887885 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ecc013040 con 0x7f9edc0682d0 2023-10-01T07:52:09.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.112+0000 7f9ec2ffd700 1 -- 172.21.15.26:0/3108887885 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc010b50 con 0x7f9edc0682d0 2023-10-01T07:52:09.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.112+0000 7f9ee13d4700 1 -- 172.21.15.26:0/3108887885 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ed000b420 con 0x7f9edc0682d0 2023-10-01T07:52:09.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.112+0000 7f9ee13d4700 1 -- 172.21.15.26:0/3108887885 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9edc119f90 con 0x7f9edc0682d0 2023-10-01T07:52:09.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.113+0000 7f9ee13d4700 1 -- 172.21.15.26:0/3108887885 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9edc05a260 con 0x7f9edc0682d0 2023-10-01T07:52:09.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.114+0000 7f9ec2ffd700 1 -- 172.21.15.26:0/3108887885 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f9ecc018460 con 0x7f9edc0682d0 2023-10-01T07:52:09.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.114+0000 7f9ec2ffd700 1 -- 172.21.15.26:0/3108887885 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f9ecc03f760 con 0x7f9edc0682d0 2023-10-01T07:52:09.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.118+0000 7f9ec2ffd700 1 -- 172.21.15.26:0/3108887885 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f9ecc0213b0 con 0x7f9edc0682d0 2023-10-01T07:52:09.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.148+0000 7faeb6749700 1 Processor -- start 2023-10-01T07:52:09.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.148+0000 7faeb6749700 1 -- start start 2023-10-01T07:52:09.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.149+0000 7faeb6749700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faeb0066cd0 0x7faeb00670b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:09.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.149+0000 7faeb6749700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7faeb012f900 0x7faeb0137450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:09.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.149+0000 7faeb6749700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb0098000 con 0x7faeb00675a0 2023-10-01T07:52:09.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.149+0000 7faeb6749700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb0068b90 con 0x7faeb012f900 2023-10-01T07:52:09.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.149+0000 7faeb6749700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb00921c0 con 0x7faeb0066cd0 2023-10-01T07:52:09.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.149+0000 7faeaffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faeb0066cd0 0x7faeb00670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:09.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.149+0000 7faeaf7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7faeb00675a0 0x7faeb012f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:40522/0 (socket says 172.21.15.26:40522) 2023-10-01T07:52:09.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.149+0000 7faeaf7fe700 1 -- 172.21.15.26:0/1612056499 learned_addr learned my addr 172.21.15.26:0/1612056499 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:52:09.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.149+0000 7faeb4ce6700 1 --2- 172.21.15.26:0/1612056499 >> v2:172.21.15.26:3300/0 conn(0x7faeb012f900 0x7faeb0137450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:09.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.150+0000 7faeb4ce6700 1 -- 172.21.15.26:0/1612056499 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faeb0066cd0 msgr2=0x7faeb00670b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:09.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.150+0000 7faeb4ce6700 1 --2- 172.21.15.26:0/1612056499 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faeb0066cd0 0x7faeb00670b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.150+0000 7faeb4ce6700 1 -- 172.21.15.26:0/1612056499 >> v1:172.21.15.26:6789/0 conn(0x7faeb00675a0 legacy=0x7faeb012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:09.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.150+0000 7faeb4ce6700 1 -- 172.21.15.26:0/1612056499 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb00697b0 con 0x7faeb012f900 2023-10-01T07:52:09.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.150+0000 7faeb4ce6700 1 --2- 172.21.15.26:0/1612056499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faeb012f900 0x7faeb0137450 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7faea8009e60 tx=0x7faea8009780).ready entity=mon.0 client_cookie=ae13bc22eafd0ade server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:09.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.150+0000 7faeaeffd700 1 -- 172.21.15.26:0/1612056499 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea800e070 con 0x7faeb012f900 2023-10-01T07:52:09.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.150+0000 7faeaeffd700 1 -- 172.21.15.26:0/1612056499 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea800bb60 con 0x7faeb012f900 2023-10-01T07:52:09.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.150+0000 7faeaeffd700 1 -- 172.21.15.26:0/1612056499 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea8012410 con 0x7faeb012f900 2023-10-01T07:52:09.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.151+0000 7faeb6749700 1 -- 172.21.15.26:0/1612056499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faeb012f900 msgr2=0x7faeb0137450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:09.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.151+0000 7faeb6749700 1 --2- 172.21.15.26:0/1612056499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faeb012f900 0x7faeb0137450 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7faea8009e60 tx=0x7faea8009780).stop 2023-10-01T07:52:09.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.151+0000 7faeb6749700 1 -- 172.21.15.26:0/1612056499 shutdown_connections 2023-10-01T07:52:09.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.151+0000 7faeb6749700 1 --2- 172.21.15.26:0/1612056499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faeb012f900 0x7faeb0137450 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.151+0000 7faeb6749700 1 --2- 172.21.15.26:0/1612056499 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faeb0066cd0 0x7faeb00670b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.151+0000 7faeb6749700 1 -- 172.21.15.26:0/1612056499 >> 172.21.15.26:0/1612056499 conn(0x7faeb009a220 msgr2=0x7faeb009a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:09.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.151+0000 7faeb6749700 1 -- 172.21.15.26:0/1612056499 shutdown_connections 2023-10-01T07:52:09.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.151+0000 7faeb6749700 1 -- 172.21.15.26:0/1612056499 wait complete. 2023-10-01T07:52:09.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.152+0000 7faeb6749700 1 Processor -- start 2023-10-01T07:52:09.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.152+0000 7faeb6749700 1 -- start start 2023-10-01T07:52:09.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.153+0000 7faeb6749700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faeb0066cd0 0x7faeb01216b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:09.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.153+0000 7faeb6749700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faeb00675a0 0x7faeb013ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:09.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.153+0000 7faeb6749700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faeb012f900 0x7faeb013ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:09.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.153+0000 7faeb6749700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb0120c10 con 0x7faeb0066cd0 2023-10-01T07:52:09.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.153+0000 7faeb6749700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb012f020 con 0x7faeb012f900 2023-10-01T07:52:09.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.153+0000 7faeb6749700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faeb0121390 con 0x7faeb00675a0 2023-10-01T07:52:09.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.153+0000 7faeaf7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faeb00675a0 0x7faeb013ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:09.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.153+0000 7faeaf7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faeb00675a0 0x7faeb013ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57642/0 (socket says 172.21.15.26:57642) 2023-10-01T07:52:09.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.153+0000 7faeaf7fe700 1 -- 172.21.15.26:0/1648062792 learned_addr learned my addr 172.21.15.26:0/1648062792 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:09.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.153+0000 7faeb4ce6700 1 --2- 172.21.15.26:0/1648062792 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faeb012f900 0x7faeb013ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:09.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.154+0000 7faeaf7fe700 1 -- 172.21.15.26:0/1648062792 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faeb012f900 msgr2=0x7faeb013ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:09.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.154+0000 7faeaf7fe700 1 --2- 172.21.15.26:0/1648062792 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faeb012f900 0x7faeb013ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.154+0000 7faeaf7fe700 1 -- 172.21.15.26:0/1648062792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faeb0066cd0 msgr2=0x7faeb01216b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:09.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.154+0000 7faeaffff700 1 --2- 172.21.15.26:0/1648062792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faeb0066cd0 0x7faeb01216b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:09.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.154+0000 7faeaf7fe700 1 --2- 172.21.15.26:0/1648062792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faeb0066cd0 0x7faeb01216b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.154+0000 7faeaf7fe700 1 -- 172.21.15.26:0/1648062792 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea8009a20 con 0x7faeb00675a0 2023-10-01T07:52:09.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.154+0000 7faeaffff700 1 --2- 172.21.15.26:0/1648062792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faeb0066cd0 0x7faeb01216b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:52:09.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.154+0000 7faeaf7fe700 1 --2- 172.21.15.26:0/1648062792 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faeb00675a0 0x7faeb013ea50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7faea400c4c0 tx=0x7faea4007dc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:09.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.154+0000 7fae97fff700 1 -- 172.21.15.26:0/1648062792 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea40072e0 con 0x7faeb00675a0 2023-10-01T07:52:09.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.154+0000 7fae97fff700 1 -- 172.21.15.26:0/1648062792 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea4007440 con 0x7faeb00675a0 2023-10-01T07:52:09.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.154+0000 7fae97fff700 1 -- 172.21.15.26:0/1648062792 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea40057a0 con 0x7faeb00675a0 2023-10-01T07:52:09.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.154+0000 7faeb6749700 1 -- 172.21.15.26:0/1648062792 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb0099b00 con 0x7faeb00675a0 2023-10-01T07:52:09.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.154+0000 7faeb6749700 1 -- 172.21.15.26:0/1648062792 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb011f380 con 0x7faeb00675a0 2023-10-01T07:52:09.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.155+0000 7fae97fff700 1 -- 172.21.15.26:0/1648062792 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7faea4005bd0 con 0x7faeb00675a0 2023-10-01T07:52:09.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.156+0000 7fae97fff700 1 -- 172.21.15.26:0/1648062792 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7faea403a5d0 con 0x7faeb00675a0 2023-10-01T07:52:09.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.156+0000 7faeb6749700 1 -- 172.21.15.26:0/1648062792 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb005a260 con 0x7faeb00675a0 2023-10-01T07:52:09.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.164+0000 7fae97fff700 1 -- 172.21.15.26:0/1648062792 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7faea4010d40 con 0x7faeb00675a0 2023-10-01T07:52:09.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.190+0000 7fdb3e17d700 1 Processor -- start 2023-10-01T07:52:09.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.190+0000 7fdb3e17d700 1 -- start start 2023-10-01T07:52:09.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.191+0000 7fdb3e17d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb3812bcb0 0x7fdb3812e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:09.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.191+0000 7fdb3e17d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb3812e590 0x7fdb38130980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:09.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.191+0000 7fdb3e17d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb38092fe0 con 0x7fdb380969b0 2023-10-01T07:52:09.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.191+0000 7fdb3e17d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb38094560 con 0x7fdb3812bcb0 2023-10-01T07:52:09.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.191+0000 7fdb3e17d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb38093260 con 0x7fdb3812e590 2023-10-01T07:52:09.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.191+0000 7fdb377fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fdb380969b0 0x7fdb38096d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:40526/0 (socket says 172.21.15.26:40526) 2023-10-01T07:52:09.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.191+0000 7fdb377fe700 1 -- 172.21.15.26:0/2041612112 learned_addr learned my addr 172.21.15.26:0/2041612112 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:52:09.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.191+0000 7fdb36ffd700 1 --2- 172.21.15.26:0/2041612112 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb3812bcb0 0x7fdb3812e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:09.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.191+0000 7fdb37fff700 1 --2- 172.21.15.26:0/2041612112 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb3812e590 0x7fdb38130980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:09.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.191+0000 7fdb37fff700 1 -- 172.21.15.26:0/2041612112 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb3812bcb0 msgr2=0x7fdb3812e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:09.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.191+0000 7fdb37fff700 1 --2- 172.21.15.26:0/2041612112 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb3812bcb0 0x7fdb3812e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.191+0000 7fdb37fff700 1 -- 172.21.15.26:0/2041612112 >> v1:172.21.15.26:6789/0 conn(0x7fdb380969b0 legacy=0x7fdb38096d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:09.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.191+0000 7fdb367fc700 1 -- 172.21.15.26:0/2041612112 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2752926266 0 0) 0x7fdb38092fe0 con 0x7fdb380969b0 2023-10-01T07:52:09.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.191+0000 7fdb37fff700 1 -- 172.21.15.26:0/2041612112 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb38092b30 con 0x7fdb3812e590 2023-10-01T07:52:09.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.191+0000 7fdb36ffd700 1 --2- 172.21.15.26:0/2041612112 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb3812bcb0 0x7fdb3812e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:09.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.192+0000 7fdb37fff700 1 --2- 172.21.15.26:0/2041612112 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb3812e590 0x7fdb38130980 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fdb30009e90 tx=0x7fdb30009780).ready entity=mon.2 client_cookie=9a363863d289e2a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:09.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.192+0000 7fdb367fc700 1 -- 172.21.15.26:0/2041612112 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3000bb60 con 0x7fdb3812e590 2023-10-01T07:52:09.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.192+0000 7fdb367fc700 1 -- 172.21.15.26:0/2041612112 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3000bcc0 con 0x7fdb3812e590 2023-10-01T07:52:09.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.192+0000 7fdb367fc700 1 -- 172.21.15.26:0/2041612112 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb300106e0 con 0x7fdb3812e590 2023-10-01T07:52:09.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.192+0000 7fdb3e17d700 1 -- 172.21.15.26:0/2041612112 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb3812e590 msgr2=0x7fdb38130980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:09.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.192+0000 7fdb3e17d700 1 --2- 172.21.15.26:0/2041612112 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb3812e590 0x7fdb38130980 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fdb30009e90 tx=0x7fdb30009780).stop 2023-10-01T07:52:09.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.192+0000 7fdb3e17d700 1 -- 172.21.15.26:0/2041612112 shutdown_connections 2023-10-01T07:52:09.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.192+0000 7fdb3e17d700 1 --2- 172.21.15.26:0/2041612112 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb3812e590 0x7fdb38130980 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.192+0000 7fdb3e17d700 1 --2- 172.21.15.26:0/2041612112 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb3812bcb0 0x7fdb3812e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.192+0000 7fdb3e17d700 1 -- 172.21.15.26:0/2041612112 >> 172.21.15.26:0/2041612112 conn(0x7fdb3809a220 msgr2=0x7fdb3809a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:09.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.193+0000 7fdb3e17d700 1 -- 172.21.15.26:0/2041612112 shutdown_connections 2023-10-01T07:52:09.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.193+0000 7fdb3e17d700 1 -- 172.21.15.26:0/2041612112 wait complete. 2023-10-01T07:52:09.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.194+0000 7fdb3e17d700 1 Processor -- start 2023-10-01T07:52:09.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.194+0000 7fdb3e17d700 1 -- start start 2023-10-01T07:52:09.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.194+0000 7fdb3e17d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb380969b0 0x7fdb38135c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:09.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.194+0000 7fdb3e17d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb3812bcb0 0x7fdb38136120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:09.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.194+0000 7fdb3e17d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb3812e590 0x7fdb38136610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:09.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.194+0000 7fdb3e17d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb381296d0 con 0x7fdb3812e590 2023-10-01T07:52:09.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.194+0000 7fdb3e17d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb38126f40 con 0x7fdb380969b0 2023-10-01T07:52:09.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.194+0000 7fdb3e17d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb38095770 con 0x7fdb3812bcb0 2023-10-01T07:52:09.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.194+0000 7fdb36ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb3812bcb0 0x7fdb38136120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:09.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.194+0000 7fdb36ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb3812bcb0 0x7fdb38136120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57658/0 (socket says 172.21.15.26:57658) 2023-10-01T07:52:09.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.194+0000 7fdb36ffd700 1 -- 172.21.15.26:0/753686081 learned_addr learned my addr 172.21.15.26:0/753686081 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:09.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.194+0000 7fdb37fff700 1 --2- 172.21.15.26:0/753686081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb3812e590 0x7fdb38136610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:09.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.195+0000 7fdb377fe700 1 --2- 172.21.15.26:0/753686081 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb380969b0 0x7fdb38135c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:09.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.195+0000 7fdb36ffd700 1 -- 172.21.15.26:0/753686081 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb380969b0 msgr2=0x7fdb38135c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:09.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.195+0000 7fdb36ffd700 1 --2- 172.21.15.26:0/753686081 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb380969b0 0x7fdb38135c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.195+0000 7fdb36ffd700 1 -- 172.21.15.26:0/753686081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb3812e590 msgr2=0x7fdb38136610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:09.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.195+0000 7fdb36ffd700 1 --2- 172.21.15.26:0/753686081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb3812e590 0x7fdb38136610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.195+0000 7fdb36ffd700 1 -- 172.21.15.26:0/753686081 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb2c0092a0 con 0x7fdb3812bcb0 2023-10-01T07:52:09.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.195+0000 7fdb36ffd700 1 --2- 172.21.15.26:0/753686081 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb3812bcb0 0x7fdb38136120 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fdb2c00ea20 tx=0x7fdb2c009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:09.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.195+0000 7fdb1f7fe700 1 -- 172.21.15.26:0/753686081 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c00ee60 con 0x7fdb3812bcb0 2023-10-01T07:52:09.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.195+0000 7fdb1f7fe700 1 -- 172.21.15.26:0/753686081 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2c00c850 con 0x7fdb3812bcb0 2023-10-01T07:52:09.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.195+0000 7fdb1f7fe700 1 -- 172.21.15.26:0/753686081 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c00cbd0 con 0x7fdb3812bcb0 2023-10-01T07:52:09.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.195+0000 7fdb3e17d700 1 -- 172.21.15.26:0/753686081 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb30009a20 con 0x7fdb3812bcb0 2023-10-01T07:52:09.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.195+0000 7fdb3e17d700 1 -- 172.21.15.26:0/753686081 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb38128ab0 con 0x7fdb3812bcb0 2023-10-01T07:52:09.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.197+0000 7fdb3e17d700 1 -- 172.21.15.26:0/753686081 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb38092320 con 0x7fdb3812bcb0 2023-10-01T07:52:09.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.197+0000 7fdb1f7fe700 1 -- 172.21.15.26:0/753686081 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fdb2c01b400 con 0x7fdb3812bcb0 2023-10-01T07:52:09.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.197+0000 7fdb1f7fe700 1 -- 172.21.15.26:0/753686081 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fdb2c03c700 con 0x7fdb3812bcb0 2023-10-01T07:52:09.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.202+0000 7fdb1f7fe700 1 -- 172.21.15.26:0/753686081 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fdb2c01be60 con 0x7fdb3812bcb0 2023-10-01T07:52:09.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.267+0000 7efd391ad700 1 -- 172.21.15.26:0/1932214370 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efd34046c20 con 0x7efd34066cd0 2023-10-01T07:52:09.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.267+0000 7efd1affd700 1 -- 172.21.15.26:0/1932214370 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efd24011b40 con 0x7efd34066cd0 2023-10-01T07:52:09.268 INFO:teuthology.orchestra.run.smithi026.stdout:38654705669 2023-10-01T07:52:09.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.270+0000 7efd391ad700 1 -- 172.21.15.26:0/1932214370 >> v1:172.21.15.26:6816/118178 conn(0x7efd2002bb90 legacy=0x7efd2002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:09.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.270+0000 7efd391ad700 1 -- 172.21.15.26:0/1932214370 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd34066cd0 msgr2=0x7efd3412ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:09.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.270+0000 7efd391ad700 1 --2- 172.21.15.26:0/1932214370 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd34066cd0 0x7efd3412ef20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7efd2400e930 tx=0x7efd24009060).stop 2023-10-01T07:52:09.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.270+0000 7efd391ad700 1 -- 172.21.15.26:0/1932214370 shutdown_connections 2023-10-01T07:52:09.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.270+0000 7efd391ad700 1 --2- 172.21.15.26:0/1932214370 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efd3412f900 0x7efd34134a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.270+0000 7efd391ad700 1 --2- 172.21.15.26:0/1932214370 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd34066cd0 0x7efd3412ef20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.270+0000 7efd391ad700 1 --2- 172.21.15.26:0/1932214370 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efd340675a0 0x7efd3412f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.270+0000 7efd391ad700 1 -- 172.21.15.26:0/1932214370 >> 172.21.15.26:0/1932214370 conn(0x7efd3409a220 msgr2=0x7efd34096840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:09.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.270+0000 7efd391ad700 1 -- 172.21.15.26:0/1932214370 shutdown_connections 2023-10-01T07:52:09.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.270+0000 7efd391ad700 1 -- 172.21.15.26:0/1932214370 wait complete. 2023-10-01T07:52:09.284 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.1 2023-10-01T07:52:09.284 DEBUG:teuthology.parallel:result is None 2023-10-01T07:52:09.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.307+0000 7f9ee13d4700 1 -- 172.21.15.26:0/3108887885 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9edc069ca0 con 0x7f9edc0682d0 2023-10-01T07:52:09.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.308+0000 7f9ec2ffd700 1 -- 172.21.15.26:0/3108887885 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9ecc0213b0 con 0x7f9edc0682d0 2023-10-01T07:52:09.308 INFO:teuthology.orchestra.run.smithi026.stdout:38654705669 2023-10-01T07:52:09.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.310+0000 7f9ee13d4700 1 -- 172.21.15.26:0/3108887885 >> v1:172.21.15.26:6816/118178 conn(0x7f9ec802bb90 legacy=0x7f9ec802e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:09.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.310+0000 7f9ee13d4700 1 -- 172.21.15.26:0/3108887885 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9edc0682d0 msgr2=0x7f9edc136120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:09.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.310+0000 7f9ee13d4700 1 --2- 172.21.15.26:0/3108887885 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9edc0682d0 0x7f9edc136120 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f9ecc00ddc0 tx=0x7f9ecc00f040).stop 2023-10-01T07:52:09.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.310+0000 7f9ee13d4700 1 -- 172.21.15.26:0/3108887885 shutdown_connections 2023-10-01T07:52:09.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.310+0000 7f9ee13d4700 1 --2- 172.21.15.26:0/3108887885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9edc096ee0 0x7f9edc115e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.310+0000 7f9ee13d4700 1 --2- 172.21.15.26:0/3108887885 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9edc0682d0 0x7f9edc136120 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.310+0000 7f9ee13d4700 1 --2- 172.21.15.26:0/3108887885 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9edc096610 0x7f9edc136610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.310+0000 7f9ee13d4700 1 -- 172.21.15.26:0/3108887885 >> 172.21.15.26:0/3108887885 conn(0x7f9edc09a220 msgr2=0x7f9edc0955c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:09.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.310+0000 7f9ee13d4700 1 -- 172.21.15.26:0/3108887885 shutdown_connections 2023-10-01T07:52:09.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.310+0000 7f9ee13d4700 1 -- 172.21.15.26:0/3108887885 wait complete. 2023-10-01T07:52:09.324 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.3 2023-10-01T07:52:09.326 DEBUG:teuthology.parallel:result is None 2023-10-01T07:52:09.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.349+0000 7faeb6749700 1 -- 172.21.15.26:0/1648062792 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faeb0046c20 con 0x7faeb00675a0 2023-10-01T07:52:09.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.350+0000 7fae97fff700 1 -- 172.21.15.26:0/1648062792 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faea4018030 con 0x7faeb00675a0 2023-10-01T07:52:09.351 INFO:teuthology.orchestra.run.smithi026.stdout:38654705669 2023-10-01T07:52:09.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.352+0000 7faeb6749700 1 -- 172.21.15.26:0/1648062792 >> v1:172.21.15.26:6816/118178 conn(0x7fae9c02bb60 legacy=0x7fae9c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:09.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.352+0000 7faeb6749700 1 -- 172.21.15.26:0/1648062792 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faeb00675a0 msgr2=0x7faeb013ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:09.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.352+0000 7faeb6749700 1 --2- 172.21.15.26:0/1648062792 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faeb00675a0 0x7faeb013ea50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7faea400c4c0 tx=0x7faea4007dc0).stop 2023-10-01T07:52:09.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.352+0000 7faeb6749700 1 -- 172.21.15.26:0/1648062792 shutdown_connections 2023-10-01T07:52:09.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.352+0000 7faeb6749700 1 --2- 172.21.15.26:0/1648062792 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faeb012f900 0x7faeb013ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.352+0000 7faeb6749700 1 --2- 172.21.15.26:0/1648062792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faeb0066cd0 0x7faeb01216b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.352+0000 7faeb6749700 1 --2- 172.21.15.26:0/1648062792 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faeb00675a0 0x7faeb013ea50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.352+0000 7faeb6749700 1 -- 172.21.15.26:0/1648062792 >> 172.21.15.26:0/1648062792 conn(0x7faeb009a220 msgr2=0x7faeb00956d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:09.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.352+0000 7faeb6749700 1 -- 172.21.15.26:0/1648062792 shutdown_connections 2023-10-01T07:52:09.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.352+0000 7faeb6749700 1 -- 172.21.15.26:0/1648062792 wait complete. 2023-10-01T07:52:09.365 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.2 2023-10-01T07:52:09.366 DEBUG:teuthology.parallel:result is None 2023-10-01T07:52:09.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.382+0000 7fdb3e17d700 1 -- 172.21.15.26:0/753686081 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdb3805a260 con 0x7fdb3812bcb0 2023-10-01T07:52:09.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.383+0000 7fdb1f7fe700 1 -- 172.21.15.26:0/753686081 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdb2c019310 con 0x7fdb3812bcb0 2023-10-01T07:52:09.383 INFO:teuthology.orchestra.run.smithi026.stdout:38654705669 2023-10-01T07:52:09.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.385+0000 7fdb3e17d700 1 -- 172.21.15.26:0/753686081 >> v1:172.21.15.26:6816/118178 conn(0x7fdb2402bbb0 legacy=0x7fdb2402e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:09.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.385+0000 7fdb3e17d700 1 -- 172.21.15.26:0/753686081 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb3812bcb0 msgr2=0x7fdb38136120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:09.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.385+0000 7fdb3e17d700 1 --2- 172.21.15.26:0/753686081 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb3812bcb0 0x7fdb38136120 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fdb2c00ea20 tx=0x7fdb2c009060).stop 2023-10-01T07:52:09.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.385+0000 7fdb3e17d700 1 -- 172.21.15.26:0/753686081 shutdown_connections 2023-10-01T07:52:09.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.385+0000 7fdb3e17d700 1 --2- 172.21.15.26:0/753686081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb3812e590 0x7fdb38136610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.385+0000 7fdb3e17d700 1 --2- 172.21.15.26:0/753686081 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb380969b0 0x7fdb38135c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.385+0000 7fdb3e17d700 1 --2- 172.21.15.26:0/753686081 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb3812bcb0 0x7fdb38136120 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.385+0000 7fdb3e17d700 1 -- 172.21.15.26:0/753686081 >> 172.21.15.26:0/753686081 conn(0x7fdb3809a220 msgr2=0x7fdb38094760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:09.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.385+0000 7fdb3e17d700 1 -- 172.21.15.26:0/753686081 shutdown_connections 2023-10-01T07:52:09.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.385+0000 7fdb3e17d700 1 -- 172.21.15.26:0/753686081 wait complete. 2023-10-01T07:52:09.398 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.0 2023-10-01T07:52:09.398 DEBUG:teuthology.parallel:result is None 2023-10-01T07:52:09.398 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-01T07:52:09.399 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-01T07:52:09.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.570+0000 7f403791f700 1 Processor -- start 2023-10-01T07:52:09.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.571+0000 7f403791f700 1 -- start start 2023-10-01T07:52:09.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.571+0000 7f403791f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4030059070 0x7f40301256c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:09.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.571+0000 7f403791f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f40301251c0 0x7f4030125bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:09.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.571+0000 7f403791f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4030095f00 con 0x7f4030093bf0 2023-10-01T07:52:09.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.571+0000 7f403791f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4030059450 con 0x7f40301251c0 2023-10-01T07:52:09.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.571+0000 7f403791f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4030096190 con 0x7f4030059070 2023-10-01T07:52:09.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.571+0000 7f40356bb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4030059070 0x7f40301256c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:09.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.571+0000 7f4034eba700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f40301251c0 0x7f4030125bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:09.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.571+0000 7f40356bb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4030059070 0x7f40301256c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55434/0 (socket says 172.21.15.26:55434) 2023-10-01T07:52:09.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.571+0000 7f4034eba700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f40301251c0 0x7f4030125bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34470/0 (socket says 172.21.15.26:34470) 2023-10-01T07:52:09.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.571+0000 7f4035ebc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4030093bf0 0x7f4030094080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:40538/0 (socket says 172.21.15.26:40538) 2023-10-01T07:52:09.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.571+0000 7f4034eba700 1 -- 172.21.15.26:0/635513902 learned_addr learned my addr 172.21.15.26:0/635513902 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:09.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.572+0000 7f4034eba700 1 -- 172.21.15.26:0/635513902 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4030059070 msgr2=0x7f40301256c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:09.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.572+0000 7f4034eba700 1 --2- 172.21.15.26:0/635513902 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4030059070 0x7f40301256c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.572+0000 7f4034eba700 1 -- 172.21.15.26:0/635513902 >> v1:172.21.15.26:6789/0 conn(0x7f4030093bf0 legacy=0x7f4030094080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:09.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.572+0000 7f4027fff700 1 -- 172.21.15.26:0/635513902 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1232421521 0 0) 0x7f4030095f00 con 0x7f4030093bf0 2023-10-01T07:52:09.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.572+0000 7f4034eba700 1 -- 172.21.15.26:0/635513902 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40301260a0 con 0x7f40301251c0 2023-10-01T07:52:09.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.572+0000 7f40356bb700 1 --2- 172.21.15.26:0/635513902 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4030059070 0x7f40301256c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:09.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.572+0000 7f4034eba700 1 --2- 172.21.15.26:0/635513902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40301251c0 0x7f4030125bb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f4020006fd0 tx=0x7f40200090f0).ready entity=mon.0 client_cookie=441fcb02f6148458 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:09.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.572+0000 7f4027fff700 1 -- 172.21.15.26:0/635513902 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402000b580 con 0x7f40301251c0 2023-10-01T07:52:09.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.572+0000 7f4027fff700 1 -- 172.21.15.26:0/635513902 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f402000b6e0 con 0x7f40301251c0 2023-10-01T07:52:09.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.572+0000 7f4027fff700 1 -- 172.21.15.26:0/635513902 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402000ba60 con 0x7f40301251c0 2023-10-01T07:52:09.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.573+0000 7f403791f700 1 -- 172.21.15.26:0/635513902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40301251c0 msgr2=0x7f4030125bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:09.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.573+0000 7f403791f700 1 --2- 172.21.15.26:0/635513902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40301251c0 0x7f4030125bb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f4020006fd0 tx=0x7f40200090f0).stop 2023-10-01T07:52:09.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.573+0000 7f403791f700 1 -- 172.21.15.26:0/635513902 shutdown_connections 2023-10-01T07:52:09.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.573+0000 7f403791f700 1 --2- 172.21.15.26:0/635513902 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4030059070 0x7f40301256c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.573+0000 7f403791f700 1 --2- 172.21.15.26:0/635513902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40301251c0 0x7f4030125bb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.573+0000 7f403791f700 1 -- 172.21.15.26:0/635513902 >> 172.21.15.26:0/635513902 conn(0x7f4030097470 msgr2=0x7f4030097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:09.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.573+0000 7f403791f700 1 -- 172.21.15.26:0/635513902 shutdown_connections 2023-10-01T07:52:09.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.573+0000 7f403791f700 1 -- 172.21.15.26:0/635513902 wait complete. 2023-10-01T07:52:09.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.574+0000 7f403791f700 1 Processor -- start 2023-10-01T07:52:09.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.574+0000 7f403791f700 1 -- start start 2023-10-01T07:52:09.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.575+0000 7f403791f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4030059070 0x7f4030068230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:09.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.575+0000 7f403791f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4030093bf0 0x7f4030068720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:09.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.575+0000 7f403791f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f40301251c0 0x7f4030137f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:09.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.575+0000 7f403791f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40300958d0 con 0x7f4030059070 2023-10-01T07:52:09.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.575+0000 7f403791f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40301119d0 con 0x7f40301251c0 2023-10-01T07:52:09.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.575+0000 7f403791f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4030067f20 con 0x7f4030093bf0 2023-10-01T07:52:09.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.575+0000 7f40356bb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4030059070 0x7f4030068230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:09.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.575+0000 7f40356bb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4030059070 0x7f4030068230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34474/0 (socket says 172.21.15.26:34474) 2023-10-01T07:52:09.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.575+0000 7f40356bb700 1 -- 172.21.15.26:0/1522489931 learned_addr learned my addr 172.21.15.26:0/1522489931 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:09.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.575+0000 7f4035ebc700 1 --2- 172.21.15.26:0/1522489931 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f40301251c0 0x7f4030137f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:09.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.575+0000 7f4034eba700 1 --2- 172.21.15.26:0/1522489931 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4030093bf0 0x7f4030068720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:09.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.575+0000 7f40356bb700 1 -- 172.21.15.26:0/1522489931 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4030093bf0 msgr2=0x7f4030068720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:09.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.575+0000 7f40356bb700 1 --2- 172.21.15.26:0/1522489931 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4030093bf0 0x7f4030068720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.575+0000 7f40356bb700 1 -- 172.21.15.26:0/1522489931 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f40301251c0 msgr2=0x7f4030137f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:09.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.575+0000 7f40356bb700 1 --2- 172.21.15.26:0/1522489931 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f40301251c0 0x7f4030137f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.575+0000 7f40356bb700 1 -- 172.21.15.26:0/1522489931 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f402c0092a0 con 0x7f4030059070 2023-10-01T07:52:09.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.575+0000 7f4035ebc700 1 --2- 172.21.15.26:0/1522489931 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f40301251c0 0x7f4030137f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:09.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.576+0000 7f40356bb700 1 --2- 172.21.15.26:0/1522489931 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4030059070 0x7f4030068230 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f402c00ea20 tx=0x7f402c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:09.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.576+0000 7f40257fa700 1 -- 172.21.15.26:0/1522489931 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402c00ee60 con 0x7f4030059070 2023-10-01T07:52:09.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.576+0000 7f40257fa700 1 -- 172.21.15.26:0/1522489931 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f402c009600 con 0x7f4030059070 2023-10-01T07:52:09.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.576+0000 7f403791f700 1 -- 172.21.15.26:0/1522489931 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4020009370 con 0x7f4030059070 2023-10-01T07:52:09.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.576+0000 7f40257fa700 1 -- 172.21.15.26:0/1522489931 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402c00ca60 con 0x7f4030059070 2023-10-01T07:52:09.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.576+0000 7f403791f700 1 -- 172.21.15.26:0/1522489931 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4030112810 con 0x7f4030059070 2023-10-01T07:52:09.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.577+0000 7f40257fa700 1 -- 172.21.15.26:0/1522489931 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f402c01b400 con 0x7f4030059070 2023-10-01T07:52:09.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.577+0000 7f40257fa700 1 -- 172.21.15.26:0/1522489931 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f402c03b2e0 con 0x7f4030059070 2023-10-01T07:52:09.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.577+0000 7f403791f700 1 -- 172.21.15.26:0/1522489931 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4030112810 con 0x7f4030059070 2023-10-01T07:52:09.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.582+0000 7f40257fa700 1 -- 172.21.15.26:0/1522489931 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f4030112810 con 0x7f4030059070 2023-10-01T07:52:09.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.753+0000 7f403791f700 1 -- 172.21.15.26:0/1522489931 --> v1:172.21.15.26:6816/118178 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4030112810 con 0x7f401402bb30 2023-10-01T07:52:09.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.760+0000 7f40257fa700 1 -- 172.21.15.26:0/1522489931 <== mgr.4107 v1:172.21.15.26:6816/118178 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249910 (unknown 2965378022 0 900532981) 0x7f4030112810 con 0x7f401402bb30 2023-10-01T07:52:09.763 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:52:09.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.763+0000 7f403791f700 1 -- 172.21.15.26:0/1522489931 >> v1:172.21.15.26:6816/118178 conn(0x7f401402bb30 legacy=0x7f401402dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:09.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.763+0000 7f403791f700 1 -- 172.21.15.26:0/1522489931 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4030059070 msgr2=0x7f4030068230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:09.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.763+0000 7f403791f700 1 --2- 172.21.15.26:0/1522489931 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4030059070 0x7f4030068230 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f402c00ea20 tx=0x7f402c009060).stop 2023-10-01T07:52:09.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.763+0000 7f403791f700 1 -- 172.21.15.26:0/1522489931 shutdown_connections 2023-10-01T07:52:09.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.763+0000 7f403791f700 1 --2- 172.21.15.26:0/1522489931 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f40301251c0 0x7f4030137f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.763+0000 7f403791f700 1 --2- 172.21.15.26:0/1522489931 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4030059070 0x7f4030068230 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.763+0000 7f403791f700 1 --2- 172.21.15.26:0/1522489931 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4030093bf0 0x7f4030068720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.763+0000 7f403791f700 1 -- 172.21.15.26:0/1522489931 >> 172.21.15.26:0/1522489931 conn(0x7f4030097470 msgr2=0x7f4030128730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:09.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.763+0000 7f403791f700 1 -- 172.21.15.26:0/1522489931 shutdown_connections 2023-10-01T07:52:09.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.763+0000 7f403791f700 1 -- 172.21.15.26:0/1522489931 wait complete. 2023-10-01T07:52:09.766 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-01T07:52:09.777 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-01T07:52:07.808754+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189024,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298336,"statfs":{"total":386547056640,"available":385329496064,"internally_reserved":0,"allocated":655360,"data_stored":193408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1640,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001855"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.343644+0000","last_change":"2023-10-01T07:51:57.340051+0000","last_active":"2023-10-01T07:51:57.343644+0000","last_peered":"2023-10-01T07:51:57.343644+0000","last_clean":"2023-10-01T07:51:57.343644+0000","last_became_active":"2023-10-01T07:51:57.339739+0000","last_became_peered":"2023-10-01T07:51:57.339739+0000","last_unstale":"2023-10-01T07:51:57.343644+0000","last_undegraded":"2023-10-01T07:51:57.343644+0000","last_fullsized":"2023-10-01T07:51:57.343644+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.337096+0000","last_change":"2023-10-01T07:51:57.330147+0000","last_active":"2023-10-01T07:51:57.337096+0000","last_peered":"2023-10-01T07:51:57.337096+0000","last_clean":"2023-10-01T07:51:57.337096+0000","last_became_active":"2023-10-01T07:51:57.329793+0000","last_became_peered":"2023-10-01T07:51:57.329793+0000","last_unstale":"2023-10-01T07:51:57.337096+0000","last_undegraded":"2023-10-01T07:51:57.337096+0000","last_fullsized":"2023-10-01T07:51:57.337096+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.343537+0000","last_change":"2023-10-01T07:51:57.335404+0000","last_active":"2023-10-01T07:51:57.343537+0000","last_peered":"2023-10-01T07:51:57.343537+0000","last_clean":"2023-10-01T07:51:57.343537+0000","last_became_active":"2023-10-01T07:51:57.329225+0000","last_became_peered":"2023-10-01T07:51:57.329225+0000","last_unstale":"2023-10-01T07:51:57.343537+0000","last_undegraded":"2023-10-01T07:51:57.343537+0000","last_fullsized":"2023-10-01T07:51:57.343537+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.337475+0000","last_change":"2023-10-01T07:51:57.332237+0000","last_active":"2023-10-01T07:51:57.337475+0000","last_peered":"2023-10-01T07:51:57.337475+0000","last_clean":"2023-10-01T07:51:57.337475+0000","last_became_active":"2023-10-01T07:51:57.331857+0000","last_became_peered":"2023-10-01T07:51:57.331857+0000","last_unstale":"2023-10-01T07:51:57.337475+0000","last_undegraded":"2023-10-01T07:51:57.337475+0000","last_fullsized":"2023-10-01T07:51:57.337475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335610+0000","last_change":"2023-10-01T07:51:57.326512+0000","last_active":"2023-10-01T07:51:57.335610+0000","last_peered":"2023-10-01T07:51:57.335610+0000","last_clean":"2023-10-01T07:51:57.335610+0000","last_became_active":"2023-10-01T07:51:57.326202+0000","last_became_peered":"2023-10-01T07:51:57.326202+0000","last_unstale":"2023-10-01T07:51:57.335610+0000","last_undegraded":"2023-10-01T07:51:57.335610+0000","last_fullsized":"2023-10-01T07:51:57.335610+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345080+0000","last_change":"2023-10-01T07:51:57.323824+0000","last_active":"2023-10-01T07:51:57.345080+0000","last_peered":"2023-10-01T07:51:57.345080+0000","last_clean":"2023-10-01T07:51:57.345080+0000","last_became_active":"2023-10-01T07:51:57.322857+0000","last_became_peered":"2023-10-01T07:51:57.322857+0000","last_unstale":"2023-10-01T07:51:57.345080+0000","last_undegraded":"2023-10-01T07:51:57.345080+0000","last_fullsized":"2023-10-01T07:51:57.345080+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345129+0000","last_change":"2023-10-01T07:51:57.325909+0000","last_active":"2023-10-01T07:51:57.345129+0000","last_peered":"2023-10-01T07:51:57.345129+0000","last_clean":"2023-10-01T07:51:57.345129+0000","last_became_active":"2023-10-01T07:51:57.325226+0000","last_became_peered":"2023-10-01T07:51:57.325226+0000","last_unstale":"2023-10-01T07:51:57.345129+0000","last_undegraded":"2023-10-01T07:51:57.345129+0000","last_fullsized":"2023-10-01T07:51:57.345129+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335188+0000","last_change":"2023-10-01T07:51:57.323649+0000","last_active":"2023-10-01T07:51:57.335188+0000","last_peered":"2023-10-01T07:51:57.335188+0000","last_clean":"2023-10-01T07:51:57.335188+0000","last_became_active":"2023-10-01T07:51:57.319917+0000","last_became_peered":"2023-10-01T07:51:57.319917+0000","last_unstale":"2023-10-01T07:51:57.335188+0000","last_undegraded":"2023-10-01T07:51:57.335188+0000","last_fullsized":"2023-10-01T07:51:57.335188+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335645+0000","last_change":"2023-10-01T07:51:57.325845+0000","last_active":"2023-10-01T07:51:57.335645+0000","last_peered":"2023-10-01T07:51:57.335645+0000","last_clean":"2023-10-01T07:51:57.335645+0000","last_became_active":"2023-10-01T07:51:57.325346+0000","last_became_peered":"2023-10-01T07:51:57.325346+0000","last_unstale":"2023-10-01T07:51:57.335645+0000","last_undegraded":"2023-10-01T07:51:57.335645+0000","last_fullsized":"2023-10-01T07:51:57.335645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.337622+0000","last_change":"2023-10-01T07:51:57.328438+0000","last_active":"2023-10-01T07:51:57.337622+0000","last_peered":"2023-10-01T07:51:57.337622+0000","last_clean":"2023-10-01T07:51:57.337622+0000","last_became_active":"2023-10-01T07:51:57.328128+0000","last_became_peered":"2023-10-01T07:51:57.328128+0000","last_unstale":"2023-10-01T07:51:57.337622+0000","last_undegraded":"2023-10-01T07:51:57.337622+0000","last_fullsized":"2023-10-01T07:51:57.337622+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.333136+0000","last_change":"2023-10-01T07:51:57.328650+0000","last_active":"2023-10-01T07:51:57.333136+0000","last_peered":"2023-10-01T07:51:57.333136+0000","last_clean":"2023-10-01T07:51:57.333136+0000","last_became_active":"2023-10-01T07:51:57.328335+0000","last_became_peered":"2023-10-01T07:51:57.328335+0000","last_unstale":"2023-10-01T07:51:57.333136+0000","last_undegraded":"2023-10-01T07:51:57.333136+0000","last_fullsized":"2023-10-01T07:51:57.333136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.337224+0000","last_change":"2023-10-01T07:51:57.331991+0000","last_active":"2023-10-01T07:51:57.337224+0000","last_peered":"2023-10-01T07:51:57.337224+0000","last_clean":"2023-10-01T07:51:57.337224+0000","last_became_active":"2023-10-01T07:51:57.331698+0000","last_became_peered":"2023-10-01T07:51:57.331698+0000","last_unstale":"2023-10-01T07:51:57.337224+0000","last_undegraded":"2023-10-01T07:51:57.337224+0000","last_fullsized":"2023-10-01T07:51:57.337224+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.344547+0000","last_change":"2023-10-01T07:51:57.342157+0000","last_active":"2023-10-01T07:51:57.344547+0000","last_peered":"2023-10-01T07:51:57.344547+0000","last_clean":"2023-10-01T07:51:57.344547+0000","last_became_active":"2023-10-01T07:51:57.341533+0000","last_became_peered":"2023-10-01T07:51:57.341533+0000","last_unstale":"2023-10-01T07:51:57.344547+0000","last_undegraded":"2023-10-01T07:51:57.344547+0000","last_fullsized":"2023-10-01T07:51:57.344547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.323193+0000","last_change":"2023-10-01T07:51:57.318295+0000","last_active":"2023-10-01T07:51:57.323193+0000","last_peered":"2023-10-01T07:51:57.323193+0000","last_clean":"2023-10-01T07:51:57.323193+0000","last_became_active":"2023-10-01T07:51:57.317972+0000","last_became_peered":"2023-10-01T07:51:57.317972+0000","last_unstale":"2023-10-01T07:51:57.323193+0000","last_undegraded":"2023-10-01T07:51:57.323193+0000","last_fullsized":"2023-10-01T07:51:57.323193+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.334056+0000","last_change":"2023-10-01T07:51:57.321137+0000","last_active":"2023-10-01T07:51:57.334056+0000","last_peered":"2023-10-01T07:51:57.334056+0000","last_clean":"2023-10-01T07:51:57.334056+0000","last_became_active":"2023-10-01T07:51:57.320789+0000","last_became_peered":"2023-10-01T07:51:57.320789+0000","last_unstale":"2023-10-01T07:51:57.334056+0000","last_undegraded":"2023-10-01T07:51:57.334056+0000","last_fullsized":"2023-10-01T07:51:57.334056+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.346763+0000","last_change":"2023-10-01T07:51:57.325610+0000","last_active":"2023-10-01T07:51:57.346763+0000","last_peered":"2023-10-01T07:51:57.346763+0000","last_clean":"2023-10-01T07:51:57.346763+0000","last_became_active":"2023-10-01T07:51:57.325322+0000","last_became_peered":"2023-10-01T07:51:57.325322+0000","last_unstale":"2023-10-01T07:51:57.346763+0000","last_undegraded":"2023-10-01T07:51:57.346763+0000","last_fullsized":"2023-10-01T07:51:57.346763+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335623+0000","last_change":"2023-10-01T07:51:57.325641+0000","last_active":"2023-10-01T07:51:57.335623+0000","last_peered":"2023-10-01T07:51:57.335623+0000","last_clean":"2023-10-01T07:51:57.335623+0000","last_became_active":"2023-10-01T07:51:57.324956+0000","last_became_peered":"2023-10-01T07:51:57.324956+0000","last_unstale":"2023-10-01T07:51:57.335623+0000","last_undegraded":"2023-10-01T07:51:57.335623+0000","last_fullsized":"2023-10-01T07:51:57.335623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.321164+0000","last_change":"2023-10-01T07:51:57.316882+0000","last_active":"2023-10-01T07:51:57.321164+0000","last_peered":"2023-10-01T07:51:57.321164+0000","last_clean":"2023-10-01T07:51:57.321164+0000","last_became_active":"2023-10-01T07:51:57.316026+0000","last_became_peered":"2023-10-01T07:51:57.316026+0000","last_unstale":"2023-10-01T07:51:57.321164+0000","last_undegraded":"2023-10-01T07:51:57.321164+0000","last_fullsized":"2023-10-01T07:51:57.321164+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.343491+0000","last_change":"2023-10-01T07:51:57.340110+0000","last_active":"2023-10-01T07:51:57.343491+0000","last_peered":"2023-10-01T07:51:57.343491+0000","last_clean":"2023-10-01T07:51:57.343491+0000","last_became_active":"2023-10-01T07:51:57.339795+0000","last_became_peered":"2023-10-01T07:51:57.339795+0000","last_unstale":"2023-10-01T07:51:57.343491+0000","last_undegraded":"2023-10-01T07:51:57.343491+0000","last_fullsized":"2023-10-01T07:51:57.343491+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348821+0000","last_change":"2023-10-01T07:51:57.347691+0000","last_active":"2023-10-01T07:51:57.348821+0000","last_peered":"2023-10-01T07:51:57.348821+0000","last_clean":"2023-10-01T07:51:57.348821+0000","last_became_active":"2023-10-01T07:51:57.347374+0000","last_became_peered":"2023-10-01T07:51:57.347374+0000","last_unstale":"2023-10-01T07:51:57.348821+0000","last_undegraded":"2023-10-01T07:51:57.348821+0000","last_fullsized":"2023-10-01T07:51:57.348821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348551+0000","last_change":"2023-10-01T07:51:57.341479+0000","last_active":"2023-10-01T07:51:57.348551+0000","last_peered":"2023-10-01T07:51:57.348551+0000","last_clean":"2023-10-01T07:51:57.348551+0000","last_became_active":"2023-10-01T07:51:57.341064+0000","last_became_peered":"2023-10-01T07:51:57.341064+0000","last_unstale":"2023-10-01T07:51:57.348551+0000","last_undegraded":"2023-10-01T07:51:57.348551+0000","last_fullsized":"2023-10-01T07:51:57.348551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.338618+0000","last_change":"2023-10-01T07:51:57.332063+0000","last_active":"2023-10-01T07:51:57.338618+0000","last_peered":"2023-10-01T07:51:57.338618+0000","last_clean":"2023-10-01T07:51:57.338618+0000","last_became_active":"2023-10-01T07:51:57.331511+0000","last_became_peered":"2023-10-01T07:51:57.331511+0000","last_unstale":"2023-10-01T07:51:57.338618+0000","last_undegraded":"2023-10-01T07:51:57.338618+0000","last_fullsized":"2023-10-01T07:51:57.338618+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345085+0000","last_change":"2023-10-01T07:51:57.325516+0000","last_active":"2023-10-01T07:51:57.345085+0000","last_peered":"2023-10-01T07:51:57.345085+0000","last_clean":"2023-10-01T07:51:57.345085+0000","last_became_active":"2023-10-01T07:51:57.324549+0000","last_became_peered":"2023-10-01T07:51:57.324549+0000","last_unstale":"2023-10-01T07:51:57.345085+0000","last_undegraded":"2023-10-01T07:51:57.345085+0000","last_fullsized":"2023-10-01T07:51:57.345085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.336578+0000","last_change":"2023-10-01T07:51:57.334881+0000","last_active":"2023-10-01T07:51:57.336578+0000","last_peered":"2023-10-01T07:51:57.336578+0000","last_clean":"2023-10-01T07:51:57.336578+0000","last_became_active":"2023-10-01T07:51:57.334682+0000","last_became_peered":"2023-10-01T07:51:57.334682+0000","last_unstale":"2023-10-01T07:51:57.336578+0000","last_undegraded":"2023-10-01T07:51:57.336578+0000","last_fullsized":"2023-10-01T07:51:57.336578+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.336811+0000","last_change":"2023-10-01T07:51:57.334700+0000","last_active":"2023-10-01T07:51:57.336811+0000","last_peered":"2023-10-01T07:51:57.336811+0000","last_clean":"2023-10-01T07:51:57.336811+0000","last_became_active":"2023-10-01T07:51:57.334406+0000","last_became_peered":"2023-10-01T07:51:57.334406+0000","last_unstale":"2023-10-01T07:51:57.336811+0000","last_undegraded":"2023-10-01T07:51:57.336811+0000","last_fullsized":"2023-10-01T07:51:57.336811+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.337601+0000","last_change":"2023-10-01T07:51:57.323470+0000","last_active":"2023-10-01T07:51:57.337601+0000","last_peered":"2023-10-01T07:51:57.337601+0000","last_clean":"2023-10-01T07:51:57.337601+0000","last_became_active":"2023-10-01T07:51:57.323181+0000","last_became_peered":"2023-10-01T07:51:57.323181+0000","last_unstale":"2023-10-01T07:51:57.337601+0000","last_undegraded":"2023-10-01T07:51:57.337601+0000","last_fullsized":"2023-10-01T07:51:57.337601+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.347475+0000","last_change":"2023-10-01T07:51:57.339412+0000","last_active":"2023-10-01T07:51:57.347475+0000","last_peered":"2023-10-01T07:51:57.347475+0000","last_clean":"2023-10-01T07:51:57.347475+0000","last_became_active":"2023-10-01T07:51:57.338796+0000","last_became_peered":"2023-10-01T07:51:57.338796+0000","last_unstale":"2023-10-01T07:51:57.347475+0000","last_undegraded":"2023-10-01T07:51:57.347475+0000","last_fullsized":"2023-10-01T07:51:57.347475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.321447+0000","last_change":"2023-10-01T07:51:56.911245+0000","last_active":"2023-10-01T07:51:57.321447+0000","last_peered":"2023-10-01T07:51:57.321447+0000","last_clean":"2023-10-01T07:51:57.321447+0000","last_became_active":"2023-10-01T07:51:56.910930+0000","last_became_peered":"2023-10-01T07:51:56.910930+0000","last_unstale":"2023-10-01T07:51:57.321447+0000","last_undegraded":"2023-10-01T07:51:57.321447+0000","last_fullsized":"2023-10-01T07:51:57.321447+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348455+0000","last_change":"2023-10-01T07:51:57.343694+0000","last_active":"2023-10-01T07:51:57.348455+0000","last_peered":"2023-10-01T07:51:57.348455+0000","last_clean":"2023-10-01T07:51:57.348455+0000","last_became_active":"2023-10-01T07:51:57.343082+0000","last_became_peered":"2023-10-01T07:51:57.343082+0000","last_unstale":"2023-10-01T07:51:57.348455+0000","last_undegraded":"2023-10-01T07:51:57.348455+0000","last_fullsized":"2023-10-01T07:51:57.348455+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.310075+0000","last_change":"2023-10-01T07:51:56.919246+0000","last_active":"2023-10-01T07:51:57.310075+0000","last_peered":"2023-10-01T07:51:57.310075+0000","last_clean":"2023-10-01T07:51:57.310075+0000","last_became_active":"2023-10-01T07:51:56.918962+0000","last_became_peered":"2023-10-01T07:51:56.918962+0000","last_unstale":"2023-10-01T07:51:57.310075+0000","last_undegraded":"2023-10-01T07:51:57.310075+0000","last_fullsized":"2023-10-01T07:51:57.310075+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.338500+0000","last_change":"2023-10-01T07:51:57.335143+0000","last_active":"2023-10-01T07:51:57.338500+0000","last_peered":"2023-10-01T07:51:57.338500+0000","last_clean":"2023-10-01T07:51:57.338500+0000","last_became_active":"2023-10-01T07:51:57.334730+0000","last_became_peered":"2023-10-01T07:51:57.334730+0000","last_unstale":"2023-10-01T07:51:57.338500+0000","last_undegraded":"2023-10-01T07:51:57.338500+0000","last_fullsized":"2023-10-01T07:51:57.338500+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.309155+0000","last_change":"2023-10-01T07:51:56.914663+0000","last_active":"2023-10-01T07:51:57.309155+0000","last_peered":"2023-10-01T07:51:57.309155+0000","last_clean":"2023-10-01T07:51:57.309155+0000","last_became_active":"2023-10-01T07:51:56.914321+0000","last_became_peered":"2023-10-01T07:51:56.914321+0000","last_unstale":"2023-10-01T07:51:57.309155+0000","last_undegraded":"2023-10-01T07:51:57.309155+0000","last_fullsized":"2023-10-01T07:51:57.309155+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348872+0000","last_change":"2023-10-01T07:51:57.345818+0000","last_active":"2023-10-01T07:51:57.348872+0000","last_peered":"2023-10-01T07:51:57.348872+0000","last_clean":"2023-10-01T07:51:57.348872+0000","last_became_active":"2023-10-01T07:51:57.345561+0000","last_became_peered":"2023-10-01T07:51:57.345561+0000","last_unstale":"2023-10-01T07:51:57.348872+0000","last_undegraded":"2023-10-01T07:51:57.348872+0000","last_fullsized":"2023-10-01T07:51:57.348872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.305995+0000","last_change":"2023-10-01T07:51:56.916086+0000","last_active":"2023-10-01T07:51:57.305995+0000","last_peered":"2023-10-01T07:51:57.305995+0000","last_clean":"2023-10-01T07:51:57.305995+0000","last_became_active":"2023-10-01T07:51:56.912164+0000","last_became_peered":"2023-10-01T07:51:56.912164+0000","last_unstale":"2023-10-01T07:51:57.305995+0000","last_undegraded":"2023-10-01T07:51:57.305995+0000","last_fullsized":"2023-10-01T07:51:57.305995+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.347640+0000","last_change":"2023-10-01T07:51:57.340361+0000","last_active":"2023-10-01T07:51:57.347640+0000","last_peered":"2023-10-01T07:51:57.347640+0000","last_clean":"2023-10-01T07:51:57.347640+0000","last_became_active":"2023-10-01T07:51:57.339753+0000","last_became_peered":"2023-10-01T07:51:57.339753+0000","last_unstale":"2023-10-01T07:51:57.347640+0000","last_undegraded":"2023-10-01T07:51:57.347640+0000","last_fullsized":"2023-10-01T07:51:57.347640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.308978+0000","last_change":"2023-10-01T07:51:56.917428+0000","last_active":"2023-10-01T07:51:57.308978+0000","last_peered":"2023-10-01T07:51:57.308978+0000","last_clean":"2023-10-01T07:51:57.308978+0000","last_became_active":"2023-10-01T07:51:56.916781+0000","last_became_peered":"2023-10-01T07:51:56.916781+0000","last_unstale":"2023-10-01T07:51:57.308978+0000","last_undegraded":"2023-10-01T07:51:57.308978+0000","last_fullsized":"2023-10-01T07:51:57.308978+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.347478+0000","last_change":"2023-10-01T07:51:57.339022+0000","last_active":"2023-10-01T07:51:57.347478+0000","last_peered":"2023-10-01T07:51:57.347478+0000","last_clean":"2023-10-01T07:51:57.347478+0000","last_became_active":"2023-10-01T07:51:57.338710+0000","last_became_peered":"2023-10-01T07:51:57.338710+0000","last_unstale":"2023-10-01T07:51:57.347478+0000","last_undegraded":"2023-10-01T07:51:57.347478+0000","last_fullsized":"2023-10-01T07:51:57.347478+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345213+0000","last_change":"2023-10-01T07:51:56.914774+0000","last_active":"2023-10-01T07:51:57.345213+0000","last_peered":"2023-10-01T07:51:57.345213+0000","last_clean":"2023-10-01T07:51:57.345213+0000","last_became_active":"2023-10-01T07:51:56.912021+0000","last_became_peered":"2023-10-01T07:51:56.912021+0000","last_unstale":"2023-10-01T07:51:57.345213+0000","last_undegraded":"2023-10-01T07:51:57.345213+0000","last_fullsized":"2023-10-01T07:51:57.345213+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.333273+0000","last_change":"2023-10-01T07:51:57.331183+0000","last_active":"2023-10-01T07:51:57.333273+0000","last_peered":"2023-10-01T07:51:57.333273+0000","last_clean":"2023-10-01T07:51:57.333273+0000","last_became_active":"2023-10-01T07:51:57.330934+0000","last_became_peered":"2023-10-01T07:51:57.330934+0000","last_unstale":"2023-10-01T07:51:57.333273+0000","last_undegraded":"2023-10-01T07:51:57.333273+0000","last_fullsized":"2023-10-01T07:51:57.333273+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"16'6","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.350817+0000","last_change":"2023-10-01T07:51:56.925053+0000","last_active":"2023-10-01T07:51:57.350817+0000","last_peered":"2023-10-01T07:51:57.350817+0000","last_clean":"2023-10-01T07:51:57.350817+0000","last_became_active":"2023-10-01T07:51:56.924755+0000","last_became_peered":"2023-10-01T07:51:56.924755+0000","last_unstale":"2023-10-01T07:51:57.350817+0000","last_undegraded":"2023-10-01T07:51:57.350817+0000","last_fullsized":"2023-10-01T07:51:57.350817+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.344513+0000","last_change":"2023-10-01T07:51:57.341789+0000","last_active":"2023-10-01T07:51:57.344513+0000","last_peered":"2023-10-01T07:51:57.344513+0000","last_clean":"2023-10-01T07:51:57.344513+0000","last_became_active":"2023-10-01T07:51:57.340852+0000","last_became_peered":"2023-10-01T07:51:57.340852+0000","last_unstale":"2023-10-01T07:51:57.344513+0000","last_undegraded":"2023-10-01T07:51:57.344513+0000","last_fullsized":"2023-10-01T07:51:57.344513+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.344307+0000","last_change":"2023-10-01T07:51:56.924181+0000","last_active":"2023-10-01T07:51:57.344307+0000","last_peered":"2023-10-01T07:51:57.344307+0000","last_clean":"2023-10-01T07:51:57.344307+0000","last_became_active":"2023-10-01T07:51:56.923560+0000","last_became_peered":"2023-10-01T07:51:56.923560+0000","last_unstale":"2023-10-01T07:51:57.344307+0000","last_undegraded":"2023-10-01T07:51:57.344307+0000","last_fullsized":"2023-10-01T07:51:57.344307+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348258+0000","last_change":"2023-10-01T07:51:57.341678+0000","last_active":"2023-10-01T07:51:57.348258+0000","last_peered":"2023-10-01T07:51:57.348258+0000","last_clean":"2023-10-01T07:51:57.348258+0000","last_became_active":"2023-10-01T07:51:57.339190+0000","last_became_peered":"2023-10-01T07:51:57.339190+0000","last_unstale":"2023-10-01T07:51:57.348258+0000","last_undegraded":"2023-10-01T07:51:57.348258+0000","last_fullsized":"2023-10-01T07:51:57.348258+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.301106+0000","last_change":"2023-10-01T07:51:56.915181+0000","last_active":"2023-10-01T07:51:57.301106+0000","last_peered":"2023-10-01T07:51:57.301106+0000","last_clean":"2023-10-01T07:51:57.301106+0000","last_became_active":"2023-10-01T07:51:56.914858+0000","last_became_peered":"2023-10-01T07:51:56.914858+0000","last_unstale":"2023-10-01T07:51:57.301106+0000","last_undegraded":"2023-10-01T07:51:57.301106+0000","last_fullsized":"2023-10-01T07:51:57.301106+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.347494+0000","last_change":"2023-10-01T07:51:57.339439+0000","last_active":"2023-10-01T07:51:57.347494+0000","last_peered":"2023-10-01T07:51:57.347494+0000","last_clean":"2023-10-01T07:51:57.347494+0000","last_became_active":"2023-10-01T07:51:57.339208+0000","last_became_peered":"2023-10-01T07:51:57.339208+0000","last_unstale":"2023-10-01T07:51:57.347494+0000","last_undegraded":"2023-10-01T07:51:57.347494+0000","last_fullsized":"2023-10-01T07:51:57.347494+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.313566+0000","last_change":"2023-10-01T07:51:56.926432+0000","last_active":"2023-10-01T07:51:57.313566+0000","last_peered":"2023-10-01T07:51:57.313566+0000","last_clean":"2023-10-01T07:51:57.313566+0000","last_became_active":"2023-10-01T07:51:56.926080+0000","last_became_peered":"2023-10-01T07:51:56.926080+0000","last_unstale":"2023-10-01T07:51:57.313566+0000","last_undegraded":"2023-10-01T07:51:57.313566+0000","last_fullsized":"2023-10-01T07:51:57.313566+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335190+0000","last_change":"2023-10-01T07:51:57.325464+0000","last_active":"2023-10-01T07:51:57.335190+0000","last_peered":"2023-10-01T07:51:57.335190+0000","last_clean":"2023-10-01T07:51:57.335190+0000","last_became_active":"2023-10-01T07:51:57.325143+0000","last_became_peered":"2023-10-01T07:51:57.325143+0000","last_unstale":"2023-10-01T07:51:57.335190+0000","last_undegraded":"2023-10-01T07:51:57.335190+0000","last_fullsized":"2023-10-01T07:51:57.335190+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.346026+0000","last_change":"2023-10-01T07:51:56.922808+0000","last_active":"2023-10-01T07:51:57.346026+0000","last_peered":"2023-10-01T07:51:57.346026+0000","last_clean":"2023-10-01T07:51:57.346026+0000","last_became_active":"2023-10-01T07:51:56.922520+0000","last_became_peered":"2023-10-01T07:51:56.922520+0000","last_unstale":"2023-10-01T07:51:57.346026+0000","last_undegraded":"2023-10-01T07:51:57.346026+0000","last_fullsized":"2023-10-01T07:51:57.346026+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348893+0000","last_change":"2023-10-01T07:51:57.346026+0000","last_active":"2023-10-01T07:51:57.348893+0000","last_peered":"2023-10-01T07:51:57.348893+0000","last_clean":"2023-10-01T07:51:57.348893+0000","last_became_active":"2023-10-01T07:51:57.345720+0000","last_became_peered":"2023-10-01T07:51:57.345720+0000","last_unstale":"2023-10-01T07:51:57.348893+0000","last_undegraded":"2023-10-01T07:51:57.348893+0000","last_fullsized":"2023-10-01T07:51:57.348893+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.334758+0000","last_change":"2023-10-01T07:51:56.922474+0000","last_active":"2023-10-01T07:51:57.334758+0000","last_peered":"2023-10-01T07:51:57.334758+0000","last_clean":"2023-10-01T07:51:57.334758+0000","last_became_active":"2023-10-01T07:51:56.921742+0000","last_became_peered":"2023-10-01T07:51:56.921742+0000","last_unstale":"2023-10-01T07:51:57.334758+0000","last_undegraded":"2023-10-01T07:51:57.334758+0000","last_fullsized":"2023-10-01T07:51:57.334758+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.347658+0000","last_change":"2023-10-01T07:51:57.340546+0000","last_active":"2023-10-01T07:51:57.347658+0000","last_peered":"2023-10-01T07:51:57.347658+0000","last_clean":"2023-10-01T07:51:57.347658+0000","last_became_active":"2023-10-01T07:51:57.340112+0000","last_became_peered":"2023-10-01T07:51:57.340112+0000","last_unstale":"2023-10-01T07:51:57.347658+0000","last_undegraded":"2023-10-01T07:51:57.347658+0000","last_fullsized":"2023-10-01T07:51:57.347658+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.323389+0000","last_change":"2023-10-01T07:51:56.917629+0000","last_active":"2023-10-01T07:51:57.323389+0000","last_peered":"2023-10-01T07:51:57.323389+0000","last_clean":"2023-10-01T07:51:57.323389+0000","last_became_active":"2023-10-01T07:51:56.917154+0000","last_became_peered":"2023-10-01T07:51:56.917154+0000","last_unstale":"2023-10-01T07:51:57.323389+0000","last_undegraded":"2023-10-01T07:51:57.323389+0000","last_fullsized":"2023-10-01T07:51:57.323389+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348565+0000","last_change":"2023-10-01T07:51:57.340793+0000","last_active":"2023-10-01T07:51:57.348565+0000","last_peered":"2023-10-01T07:51:57.348565+0000","last_clean":"2023-10-01T07:51:57.348565+0000","last_became_active":"2023-10-01T07:51:57.340504+0000","last_became_peered":"2023-10-01T07:51:57.340504+0000","last_unstale":"2023-10-01T07:51:57.348565+0000","last_undegraded":"2023-10-01T07:51:57.348565+0000","last_fullsized":"2023-10-01T07:51:57.348565+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.344349+0000","last_change":"2023-10-01T07:51:56.925699+0000","last_active":"2023-10-01T07:51:57.344349+0000","last_peered":"2023-10-01T07:51:57.344349+0000","last_clean":"2023-10-01T07:51:57.344349+0000","last_became_active":"2023-10-01T07:51:56.925216+0000","last_became_peered":"2023-10-01T07:51:56.925216+0000","last_unstale":"2023-10-01T07:51:57.344349+0000","last_undegraded":"2023-10-01T07:51:57.344349+0000","last_fullsized":"2023-10-01T07:51:57.344349+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.343873+0000","last_change":"2023-10-01T07:51:57.340445+0000","last_active":"2023-10-01T07:51:57.343873+0000","last_peered":"2023-10-01T07:51:57.343873+0000","last_clean":"2023-10-01T07:51:57.343873+0000","last_became_active":"2023-10-01T07:51:57.340180+0000","last_became_peered":"2023-10-01T07:51:57.340180+0000","last_unstale":"2023-10-01T07:51:57.343873+0000","last_undegraded":"2023-10-01T07:51:57.343873+0000","last_fullsized":"2023-10-01T07:51:57.343873+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.303411+0000","last_change":"2023-10-01T07:51:56.915532+0000","last_active":"2023-10-01T07:51:57.303411+0000","last_peered":"2023-10-01T07:51:57.303411+0000","last_clean":"2023-10-01T07:51:57.303411+0000","last_became_active":"2023-10-01T07:51:56.912225+0000","last_became_peered":"2023-10-01T07:51:56.912225+0000","last_unstale":"2023-10-01T07:51:57.303411+0000","last_undegraded":"2023-10-01T07:51:57.303411+0000","last_fullsized":"2023-10-01T07:51:57.303411+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.338026+0000","last_change":"2023-10-01T07:51:57.331858+0000","last_active":"2023-10-01T07:51:57.338026+0000","last_peered":"2023-10-01T07:51:57.338026+0000","last_clean":"2023-10-01T07:51:57.338026+0000","last_became_active":"2023-10-01T07:51:57.331568+0000","last_became_peered":"2023-10-01T07:51:57.331568+0000","last_unstale":"2023-10-01T07:51:57.338026+0000","last_undegraded":"2023-10-01T07:51:57.338026+0000","last_fullsized":"2023-10-01T07:51:57.338026+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.342186+0000","last_change":"2023-10-01T07:51:56.924345+0000","last_active":"2023-10-01T07:51:57.342186+0000","last_peered":"2023-10-01T07:51:57.342186+0000","last_clean":"2023-10-01T07:51:57.342186+0000","last_became_active":"2023-10-01T07:51:56.923915+0000","last_became_peered":"2023-10-01T07:51:56.923915+0000","last_unstale":"2023-10-01T07:51:57.342186+0000","last_undegraded":"2023-10-01T07:51:57.342186+0000","last_fullsized":"2023-10-01T07:51:57.342186+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335325+0000","last_change":"2023-10-01T07:51:57.326926+0000","last_active":"2023-10-01T07:51:57.335325+0000","last_peered":"2023-10-01T07:51:57.335325+0000","last_clean":"2023-10-01T07:51:57.335325+0000","last_became_active":"2023-10-01T07:51:57.326597+0000","last_became_peered":"2023-10-01T07:51:57.326597+0000","last_unstale":"2023-10-01T07:51:57.335325+0000","last_undegraded":"2023-10-01T07:51:57.335325+0000","last_fullsized":"2023-10-01T07:51:57.335325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.306243+0000","last_change":"2023-10-01T07:51:56.918471+0000","last_active":"2023-10-01T07:51:57.306243+0000","last_peered":"2023-10-01T07:51:57.306243+0000","last_clean":"2023-10-01T07:51:57.306243+0000","last_became_active":"2023-10-01T07:51:56.918165+0000","last_became_peered":"2023-10-01T07:51:56.918165+0000","last_unstale":"2023-10-01T07:51:57.306243+0000","last_undegraded":"2023-10-01T07:51:57.306243+0000","last_fullsized":"2023-10-01T07:51:57.306243+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345107+0000","last_change":"2023-10-01T07:51:57.338218+0000","last_active":"2023-10-01T07:51:57.345107+0000","last_peered":"2023-10-01T07:51:57.345107+0000","last_clean":"2023-10-01T07:51:57.345107+0000","last_became_active":"2023-10-01T07:51:57.337910+0000","last_became_peered":"2023-10-01T07:51:57.337910+0000","last_unstale":"2023-10-01T07:51:57.345107+0000","last_undegraded":"2023-10-01T07:51:57.345107+0000","last_fullsized":"2023-10-01T07:51:57.345107+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.303371+0000","last_change":"2023-10-01T07:51:56.926078+0000","last_active":"2023-10-01T07:51:57.303371+0000","last_peered":"2023-10-01T07:51:57.303371+0000","last_clean":"2023-10-01T07:51:57.303371+0000","last_became_active":"2023-10-01T07:51:56.925681+0000","last_became_peered":"2023-10-01T07:51:56.925681+0000","last_unstale":"2023-10-01T07:51:57.303371+0000","last_undegraded":"2023-10-01T07:51:57.303371+0000","last_fullsized":"2023-10-01T07:51:57.303371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.344581+0000","last_change":"2023-10-01T07:51:57.340249+0000","last_active":"2023-10-01T07:51:57.344581+0000","last_peered":"2023-10-01T07:51:57.344581+0000","last_clean":"2023-10-01T07:51:57.344581+0000","last_became_active":"2023-10-01T07:51:57.339937+0000","last_became_peered":"2023-10-01T07:51:57.339937+0000","last_unstale":"2023-10-01T07:51:57.344581+0000","last_undegraded":"2023-10-01T07:51:57.344581+0000","last_fullsized":"2023-10-01T07:51:57.344581+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.303740+0000","last_change":"2023-10-01T07:51:56.918564+0000","last_active":"2023-10-01T07:51:57.303740+0000","last_peered":"2023-10-01T07:51:57.303740+0000","last_clean":"2023-10-01T07:51:57.303740+0000","last_became_active":"2023-10-01T07:51:56.918275+0000","last_became_peered":"2023-10-01T07:51:56.918275+0000","last_unstale":"2023-10-01T07:51:57.303740+0000","last_undegraded":"2023-10-01T07:51:57.303740+0000","last_fullsized":"2023-10-01T07:51:57.303740+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348828+0000","last_change":"2023-10-01T07:51:57.347574+0000","last_active":"2023-10-01T07:51:57.348828+0000","last_peered":"2023-10-01T07:51:57.348828+0000","last_clean":"2023-10-01T07:51:57.348828+0000","last_became_active":"2023-10-01T07:51:57.347243+0000","last_became_peered":"2023-10-01T07:51:57.347243+0000","last_unstale":"2023-10-01T07:51:57.348828+0000","last_undegraded":"2023-10-01T07:51:57.348828+0000","last_fullsized":"2023-10-01T07:51:57.348828+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.310517+0000","last_change":"2023-10-01T07:51:51.883413+0000","last_active":"2023-10-01T07:51:57.310517+0000","last_peered":"2023-10-01T07:51:57.310517+0000","last_clean":"2023-10-01T07:51:57.310517+0000","last_became_active":"2023-10-01T07:51:51.883088+0000","last_became_peered":"2023-10-01T07:51:51.883088+0000","last_unstale":"2023-10-01T07:51:57.310517+0000","last_undegraded":"2023-10-01T07:51:57.310517+0000","last_fullsized":"2023-10-01T07:51:57.310517+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.306486+0000","last_change":"2023-10-01T07:51:56.914139+0000","last_active":"2023-10-01T07:51:57.306486+0000","last_peered":"2023-10-01T07:51:57.306486+0000","last_clean":"2023-10-01T07:51:57.306486+0000","last_became_active":"2023-10-01T07:51:56.913026+0000","last_became_peered":"2023-10-01T07:51:56.913026+0000","last_unstale":"2023-10-01T07:51:57.306486+0000","last_undegraded":"2023-10-01T07:51:57.306486+0000","last_fullsized":"2023-10-01T07:51:57.306486+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.336585+0000","last_change":"2023-10-01T07:51:57.334103+0000","last_active":"2023-10-01T07:51:57.336585+0000","last_peered":"2023-10-01T07:51:57.336585+0000","last_clean":"2023-10-01T07:51:57.336585+0000","last_became_active":"2023-10-01T07:51:57.333743+0000","last_became_peered":"2023-10-01T07:51:57.333743+0000","last_unstale":"2023-10-01T07:51:57.336585+0000","last_undegraded":"2023-10-01T07:51:57.336585+0000","last_fullsized":"2023-10-01T07:51:57.336585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.309952+0000","last_change":"2023-10-01T07:51:51.882685+0000","last_active":"2023-10-01T07:51:57.309952+0000","last_peered":"2023-10-01T07:51:57.309952+0000","last_clean":"2023-10-01T07:51:57.309952+0000","last_became_active":"2023-10-01T07:51:51.882396+0000","last_became_peered":"2023-10-01T07:51:51.882396+0000","last_unstale":"2023-10-01T07:51:57.309952+0000","last_undegraded":"2023-10-01T07:51:57.309952+0000","last_fullsized":"2023-10-01T07:51:57.309952+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.300924+0000","last_change":"2023-10-01T07:51:56.915631+0000","last_active":"2023-10-01T07:51:57.300924+0000","last_peered":"2023-10-01T07:51:57.300924+0000","last_clean":"2023-10-01T07:51:57.300924+0000","last_became_active":"2023-10-01T07:51:56.911566+0000","last_became_peered":"2023-10-01T07:51:56.911566+0000","last_unstale":"2023-10-01T07:51:57.300924+0000","last_undegraded":"2023-10-01T07:51:57.300924+0000","last_fullsized":"2023-10-01T07:51:57.300924+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.329388+0000","last_change":"2023-10-01T07:51:57.319612+0000","last_active":"2023-10-01T07:51:57.329388+0000","last_peered":"2023-10-01T07:51:57.329388+0000","last_clean":"2023-10-01T07:51:57.329388+0000","last_became_active":"2023-10-01T07:51:57.319125+0000","last_became_peered":"2023-10-01T07:51:57.319125+0000","last_unstale":"2023-10-01T07:51:57.329388+0000","last_undegraded":"2023-10-01T07:51:57.329388+0000","last_fullsized":"2023-10-01T07:51:57.329388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.305149+0000","last_change":"2023-10-01T07:51:51.885336+0000","last_active":"2023-10-01T07:51:57.305149+0000","last_peered":"2023-10-01T07:51:57.305149+0000","last_clean":"2023-10-01T07:51:57.305149+0000","last_became_active":"2023-10-01T07:51:51.884991+0000","last_became_peered":"2023-10-01T07:51:51.884991+0000","last_unstale":"2023-10-01T07:51:57.305149+0000","last_undegraded":"2023-10-01T07:51:57.305149+0000","last_fullsized":"2023-10-01T07:51:57.305149+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.311818+0000","last_change":"2023-10-01T07:51:56.929636+0000","last_active":"2023-10-01T07:51:57.311818+0000","last_peered":"2023-10-01T07:51:57.311818+0000","last_clean":"2023-10-01T07:51:57.311818+0000","last_became_active":"2023-10-01T07:51:56.929308+0000","last_became_peered":"2023-10-01T07:51:56.929308+0000","last_unstale":"2023-10-01T07:51:57.311818+0000","last_undegraded":"2023-10-01T07:51:57.311818+0000","last_fullsized":"2023-10-01T07:51:57.311818+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.333038+0000","last_change":"2023-10-01T07:51:57.329162+0000","last_active":"2023-10-01T07:51:57.333038+0000","last_peered":"2023-10-01T07:51:57.333038+0000","last_clean":"2023-10-01T07:51:57.333038+0000","last_became_active":"2023-10-01T07:51:57.328749+0000","last_became_peered":"2023-10-01T07:51:57.328749+0000","last_unstale":"2023-10-01T07:51:57.333038+0000","last_undegraded":"2023-10-01T07:51:57.333038+0000","last_fullsized":"2023-10-01T07:51:57.333038+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.316966+0000","last_change":"2023-10-01T07:51:51.882657+0000","last_active":"2023-10-01T07:51:57.316966+0000","last_peered":"2023-10-01T07:51:57.316966+0000","last_clean":"2023-10-01T07:51:57.316966+0000","last_became_active":"2023-10-01T07:51:51.882334+0000","last_became_peered":"2023-10-01T07:51:51.882334+0000","last_unstale":"2023-10-01T07:51:57.316966+0000","last_undegraded":"2023-10-01T07:51:57.316966+0000","last_fullsized":"2023-10-01T07:51:57.316966+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.311710+0000","last_change":"2023-10-01T07:51:50.871456+0000","last_active":"2023-10-01T07:51:57.311710+0000","last_peered":"2023-10-01T07:51:57.311710+0000","last_clean":"2023-10-01T07:51:57.311710+0000","last_became_active":"2023-10-01T07:51:50.871112+0000","last_became_peered":"2023-10-01T07:51:50.871112+0000","last_unstale":"2023-10-01T07:51:57.311710+0000","last_undegraded":"2023-10-01T07:51:57.311710+0000","last_fullsized":"2023-10-01T07:51:57.311710+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:49.856372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:49.856372+0000","last_clean_scrub_stamp":"2023-10-01T07:51:49.856372+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.305919+0000","last_change":"2023-10-01T07:51:56.925843+0000","last_active":"2023-10-01T07:51:57.305919+0000","last_peered":"2023-10-01T07:51:57.305919+0000","last_clean":"2023-10-01T07:51:57.305919+0000","last_became_active":"2023-10-01T07:51:56.925538+0000","last_became_peered":"2023-10-01T07:51:56.925538+0000","last_unstale":"2023-10-01T07:51:57.305919+0000","last_undegraded":"2023-10-01T07:51:57.305919+0000","last_fullsized":"2023-10-01T07:51:57.305919+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.347449+0000","last_change":"2023-10-01T07:51:57.339219+0000","last_active":"2023-10-01T07:51:57.347449+0000","last_peered":"2023-10-01T07:51:57.347449+0000","last_clean":"2023-10-01T07:51:57.347449+0000","last_became_active":"2023-10-01T07:51:57.338416+0000","last_became_peered":"2023-10-01T07:51:57.338416+0000","last_unstale":"2023-10-01T07:51:57.347449+0000","last_undegraded":"2023-10-01T07:51:57.347449+0000","last_fullsized":"2023-10-01T07:51:57.347449+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.309046+0000","last_change":"2023-10-01T07:51:51.882831+0000","last_active":"2023-10-01T07:51:57.309046+0000","last_peered":"2023-10-01T07:51:57.309046+0000","last_clean":"2023-10-01T07:51:57.309046+0000","last_became_active":"2023-10-01T07:51:51.882490+0000","last_became_peered":"2023-10-01T07:51:51.882490+0000","last_unstale":"2023-10-01T07:51:57.309046+0000","last_undegraded":"2023-10-01T07:51:57.309046+0000","last_fullsized":"2023-10-01T07:51:57.309046+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.300429+0000","last_change":"2023-10-01T07:51:56.929720+0000","last_active":"2023-10-01T07:51:57.300429+0000","last_peered":"2023-10-01T07:51:57.300429+0000","last_clean":"2023-10-01T07:51:57.300429+0000","last_became_active":"2023-10-01T07:51:56.929370+0000","last_became_peered":"2023-10-01T07:51:56.929370+0000","last_unstale":"2023-10-01T07:51:57.300429+0000","last_undegraded":"2023-10-01T07:51:57.300429+0000","last_fullsized":"2023-10-01T07:51:57.300429+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.338477+0000","last_change":"2023-10-01T07:51:57.335095+0000","last_active":"2023-10-01T07:51:57.338477+0000","last_peered":"2023-10-01T07:51:57.338477+0000","last_clean":"2023-10-01T07:51:57.338477+0000","last_became_active":"2023-10-01T07:51:57.334324+0000","last_became_peered":"2023-10-01T07:51:57.334324+0000","last_unstale":"2023-10-01T07:51:57.338477+0000","last_undegraded":"2023-10-01T07:51:57.338477+0000","last_fullsized":"2023-10-01T07:51:57.338477+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.321040+0000","last_change":"2023-10-01T07:51:51.884196+0000","last_active":"2023-10-01T07:51:57.321040+0000","last_peered":"2023-10-01T07:51:57.321040+0000","last_clean":"2023-10-01T07:51:57.321040+0000","last_became_active":"2023-10-01T07:51:51.883784+0000","last_became_peered":"2023-10-01T07:51:51.883784+0000","last_unstale":"2023-10-01T07:51:57.321040+0000","last_undegraded":"2023-10-01T07:51:57.321040+0000","last_fullsized":"2023-10-01T07:51:57.321040+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.310257+0000","last_change":"2023-10-01T07:51:56.913348+0000","last_active":"2023-10-01T07:51:57.310257+0000","last_peered":"2023-10-01T07:51:57.310257+0000","last_clean":"2023-10-01T07:51:57.310257+0000","last_became_active":"2023-10-01T07:51:56.913041+0000","last_became_peered":"2023-10-01T07:51:56.913041+0000","last_unstale":"2023-10-01T07:51:57.310257+0000","last_undegraded":"2023-10-01T07:51:57.310257+0000","last_fullsized":"2023-10-01T07:51:57.310257+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.320737+0000","last_change":"2023-10-01T07:51:57.313930+0000","last_active":"2023-10-01T07:51:57.320737+0000","last_peered":"2023-10-01T07:51:57.320737+0000","last_clean":"2023-10-01T07:51:57.320737+0000","last_became_active":"2023-10-01T07:51:57.313613+0000","last_became_peered":"2023-10-01T07:51:57.313613+0000","last_unstale":"2023-10-01T07:51:57.320737+0000","last_undegraded":"2023-10-01T07:51:57.320737+0000","last_fullsized":"2023-10-01T07:51:57.320737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345351+0000","last_change":"2023-10-01T07:51:56.929769+0000","last_active":"2023-10-01T07:51:57.345351+0000","last_peered":"2023-10-01T07:51:57.345351+0000","last_clean":"2023-10-01T07:51:57.345351+0000","last_became_active":"2023-10-01T07:51:56.929479+0000","last_became_peered":"2023-10-01T07:51:56.929479+0000","last_unstale":"2023-10-01T07:51:57.345351+0000","last_undegraded":"2023-10-01T07:51:57.345351+0000","last_fullsized":"2023-10-01T07:51:57.345351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.312442+0000","last_change":"2023-10-01T07:51:51.883317+0000","last_active":"2023-10-01T07:51:57.312442+0000","last_peered":"2023-10-01T07:51:57.312442+0000","last_clean":"2023-10-01T07:51:57.312442+0000","last_became_active":"2023-10-01T07:51:51.883005+0000","last_became_peered":"2023-10-01T07:51:51.883005+0000","last_unstale":"2023-10-01T07:51:57.312442+0000","last_undegraded":"2023-10-01T07:51:57.312442+0000","last_fullsized":"2023-10-01T07:51:57.312442+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.346741+0000","last_change":"2023-10-01T07:51:57.325035+0000","last_active":"2023-10-01T07:51:57.346741+0000","last_peered":"2023-10-01T07:51:57.346741+0000","last_clean":"2023-10-01T07:51:57.346741+0000","last_became_active":"2023-10-01T07:51:57.324727+0000","last_became_peered":"2023-10-01T07:51:57.324727+0000","last_unstale":"2023-10-01T07:51:57.346741+0000","last_undegraded":"2023-10-01T07:51:57.346741+0000","last_fullsized":"2023-10-01T07:51:57.346741+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.322783+0000","last_change":"2023-10-01T07:51:51.883299+0000","last_active":"2023-10-01T07:51:57.322783+0000","last_peered":"2023-10-01T07:51:57.322783+0000","last_clean":"2023-10-01T07:51:57.322783+0000","last_became_active":"2023-10-01T07:51:51.883001+0000","last_became_peered":"2023-10-01T07:51:51.883001+0000","last_unstale":"2023-10-01T07:51:57.322783+0000","last_undegraded":"2023-10-01T07:51:57.322783+0000","last_fullsized":"2023-10-01T07:51:57.322783+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-01T07:51:58.305061+0000","last_change":"2023-10-01T07:51:56.921291+0000","last_active":"2023-10-01T07:51:58.305061+0000","last_peered":"2023-10-01T07:51:58.305061+0000","last_clean":"2023-10-01T07:51:58.305061+0000","last_became_active":"2023-10-01T07:51:56.920989+0000","last_became_peered":"2023-10-01T07:51:56.920989+0000","last_unstale":"2023-10-01T07:51:58.305061+0000","last_undegraded":"2023-10-01T07:51:58.305061+0000","last_fullsized":"2023-10-01T07:51:58.305061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.344273+0000","last_change":"2023-10-01T07:51:57.342916+0000","last_active":"2023-10-01T07:51:57.344273+0000","last_peered":"2023-10-01T07:51:57.344273+0000","last_clean":"2023-10-01T07:51:57.344273+0000","last_became_active":"2023-10-01T07:51:57.342653+0000","last_became_peered":"2023-10-01T07:51:57.342653+0000","last_unstale":"2023-10-01T07:51:57.344273+0000","last_undegraded":"2023-10-01T07:51:57.344273+0000","last_fullsized":"2023-10-01T07:51:57.344273+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.325920+0000","last_change":"2023-10-01T07:51:56.916437+0000","last_active":"2023-10-01T07:51:57.325920+0000","last_peered":"2023-10-01T07:51:57.325920+0000","last_clean":"2023-10-01T07:51:57.325920+0000","last_became_active":"2023-10-01T07:51:56.915935+0000","last_became_peered":"2023-10-01T07:51:56.915935+0000","last_unstale":"2023-10-01T07:51:57.325920+0000","last_undegraded":"2023-10-01T07:51:57.325920+0000","last_fullsized":"2023-10-01T07:51:57.325920+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.337204+0000","last_change":"2023-10-01T07:51:57.330536+0000","last_active":"2023-10-01T07:51:57.337204+0000","last_peered":"2023-10-01T07:51:57.337204+0000","last_clean":"2023-10-01T07:51:57.337204+0000","last_became_active":"2023-10-01T07:51:57.330151+0000","last_became_peered":"2023-10-01T07:51:57.330151+0000","last_unstale":"2023-10-01T07:51:57.337204+0000","last_undegraded":"2023-10-01T07:51:57.337204+0000","last_fullsized":"2023-10-01T07:51:57.337204+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.322423+0000","last_change":"2023-10-01T07:51:56.922316+0000","last_active":"2023-10-01T07:51:57.322423+0000","last_peered":"2023-10-01T07:51:57.322423+0000","last_clean":"2023-10-01T07:51:57.322423+0000","last_became_active":"2023-10-01T07:51:56.922003+0000","last_became_peered":"2023-10-01T07:51:56.922003+0000","last_unstale":"2023-10-01T07:51:57.322423+0000","last_undegraded":"2023-10-01T07:51:57.322423+0000","last_fullsized":"2023-10-01T07:51:57.322423+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.344530+0000","last_change":"2023-10-01T07:51:57.341976+0000","last_active":"2023-10-01T07:51:57.344530+0000","last_peered":"2023-10-01T07:51:57.344530+0000","last_clean":"2023-10-01T07:51:57.344530+0000","last_became_active":"2023-10-01T07:51:57.341188+0000","last_became_peered":"2023-10-01T07:51:57.341188+0000","last_unstale":"2023-10-01T07:51:57.344530+0000","last_undegraded":"2023-10-01T07:51:57.344530+0000","last_fullsized":"2023-10-01T07:51:57.344530+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.342897+0000","last_change":"2023-10-01T07:51:56.925522+0000","last_active":"2023-10-01T07:51:57.342897+0000","last_peered":"2023-10-01T07:51:57.342897+0000","last_clean":"2023-10-01T07:51:57.342897+0000","last_became_active":"2023-10-01T07:51:56.924830+0000","last_became_peered":"2023-10-01T07:51:56.924830+0000","last_unstale":"2023-10-01T07:51:57.342897+0000","last_undegraded":"2023-10-01T07:51:57.342897+0000","last_fullsized":"2023-10-01T07:51:57.342897+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.343893+0000","last_change":"2023-10-01T07:51:57.340653+0000","last_active":"2023-10-01T07:51:57.343893+0000","last_peered":"2023-10-01T07:51:57.343893+0000","last_clean":"2023-10-01T07:51:57.343893+0000","last_became_active":"2023-10-01T07:51:57.340395+0000","last_became_peered":"2023-10-01T07:51:57.340395+0000","last_unstale":"2023-10-01T07:51:57.343893+0000","last_undegraded":"2023-10-01T07:51:57.343893+0000","last_fullsized":"2023-10-01T07:51:57.343893+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.338671+0000","last_change":"2023-10-01T07:51:56.924298+0000","last_active":"2023-10-01T07:51:57.338671+0000","last_peered":"2023-10-01T07:51:57.338671+0000","last_clean":"2023-10-01T07:51:57.338671+0000","last_became_active":"2023-10-01T07:51:56.923975+0000","last_became_peered":"2023-10-01T07:51:56.923975+0000","last_unstale":"2023-10-01T07:51:57.338671+0000","last_undegraded":"2023-10-01T07:51:57.338671+0000","last_fullsized":"2023-10-01T07:51:57.338671+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.347457+0000","last_change":"2023-10-01T07:51:57.339026+0000","last_active":"2023-10-01T07:51:57.347457+0000","last_peered":"2023-10-01T07:51:57.347457+0000","last_clean":"2023-10-01T07:51:57.347457+0000","last_became_active":"2023-10-01T07:51:57.338722+0000","last_became_peered":"2023-10-01T07:51:57.338722+0000","last_unstale":"2023-10-01T07:51:57.347457+0000","last_undegraded":"2023-10-01T07:51:57.347457+0000","last_fullsized":"2023-10-01T07:51:57.347457+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335116+0000","last_change":"2023-10-01T07:51:56.922677+0000","last_active":"2023-10-01T07:51:57.335116+0000","last_peered":"2023-10-01T07:51:57.335116+0000","last_clean":"2023-10-01T07:51:57.335116+0000","last_became_active":"2023-10-01T07:51:56.922121+0000","last_became_peered":"2023-10-01T07:51:56.922121+0000","last_unstale":"2023-10-01T07:51:57.335116+0000","last_undegraded":"2023-10-01T07:51:57.335116+0000","last_fullsized":"2023-10-01T07:51:57.335116+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.337428+0000","last_change":"2023-10-01T07:51:57.329519+0000","last_active":"2023-10-01T07:51:57.337428+0000","last_peered":"2023-10-01T07:51:57.337428+0000","last_clean":"2023-10-01T07:51:57.337428+0000","last_became_active":"2023-10-01T07:51:57.329191+0000","last_became_peered":"2023-10-01T07:51:57.329191+0000","last_unstale":"2023-10-01T07:51:57.337428+0000","last_undegraded":"2023-10-01T07:51:57.337428+0000","last_fullsized":"2023-10-01T07:51:57.337428+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335155+0000","last_change":"2023-10-01T07:51:57.320100+0000","last_active":"2023-10-01T07:51:57.335155+0000","last_peered":"2023-10-01T07:51:57.335155+0000","last_clean":"2023-10-01T07:51:57.335155+0000","last_became_active":"2023-10-01T07:51:57.319593+0000","last_became_peered":"2023-10-01T07:51:57.319593+0000","last_unstale":"2023-10-01T07:51:57.335155+0000","last_undegraded":"2023-10-01T07:51:57.335155+0000","last_fullsized":"2023-10-01T07:51:57.335155+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345109+0000","last_change":"2023-10-01T07:51:57.325707+0000","last_active":"2023-10-01T07:51:57.345109+0000","last_peered":"2023-10-01T07:51:57.345109+0000","last_clean":"2023-10-01T07:51:57.345109+0000","last_became_active":"2023-10-01T07:51:57.324870+0000","last_became_peered":"2023-10-01T07:51:57.324870+0000","last_unstale":"2023-10-01T07:51:57.345109+0000","last_undegraded":"2023-10-01T07:51:57.345109+0000","last_fullsized":"2023-10-01T07:51:57.345109+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.334378+0000","last_change":"2023-10-01T07:51:57.326270+0000","last_active":"2023-10-01T07:51:57.334378+0000","last_peered":"2023-10-01T07:51:57.334378+0000","last_clean":"2023-10-01T07:51:57.334378+0000","last_became_active":"2023-10-01T07:51:57.325956+0000","last_became_peered":"2023-10-01T07:51:57.325956+0000","last_unstale":"2023-10-01T07:51:57.334378+0000","last_undegraded":"2023-10-01T07:51:57.334378+0000","last_fullsized":"2023-10-01T07:51:57.334378+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.344374+0000","last_change":"2023-10-01T07:51:57.338041+0000","last_active":"2023-10-01T07:51:57.344374+0000","last_peered":"2023-10-01T07:51:57.344374+0000","last_clean":"2023-10-01T07:51:57.344374+0000","last_became_active":"2023-10-01T07:51:57.337719+0000","last_became_peered":"2023-10-01T07:51:57.337719+0000","last_unstale":"2023-10-01T07:51:57.344374+0000","last_undegraded":"2023-10-01T07:51:57.344374+0000","last_fullsized":"2023-10-01T07:51:57.344374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.329368+0000","last_change":"2023-10-01T07:51:57.319429+0000","last_active":"2023-10-01T07:51:57.329368+0000","last_peered":"2023-10-01T07:51:57.329368+0000","last_clean":"2023-10-01T07:51:57.329368+0000","last_became_active":"2023-10-01T07:51:57.318849+0000","last_became_peered":"2023-10-01T07:51:57.318849+0000","last_unstale":"2023-10-01T07:51:57.329368+0000","last_undegraded":"2023-10-01T07:51:57.329368+0000","last_fullsized":"2023-10-01T07:51:57.329368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297264,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074576,"statfs":{"total":96636764160,"available":96332365824,"internally_reserved":0,"allocated":172032,"data_stored":48929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":48735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":47899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":47845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-01T07:52:09.783 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-01T07:52:09.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.950+0000 7f73d3c12700 1 Processor -- start 2023-10-01T07:52:09.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.950+0000 7f73d3c12700 1 -- start start 2023-10-01T07:52:09.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.950+0000 7f73d3c12700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f73cc0650f0 0x7f73cc0986a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:09.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.950+0000 7f73d3c12700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f73cc097c30 0x7f73cc098b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:09.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.950+0000 7f73d3c12700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f73cc099080 0x7f73cc131470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:09.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.950+0000 7f73d3c12700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73cc0654d0 con 0x7f73cc097c30 2023-10-01T07:52:09.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.950+0000 7f73d3c12700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73cc099530 con 0x7f73cc099080 2023-10-01T07:52:09.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.950+0000 7f73d3c12700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73cc096160 con 0x7f73cc0650f0 2023-10-01T07:52:09.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.951+0000 7f73d11ad700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f73cc097c30 0x7f73cc098b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:09.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.951+0000 7f73d21af700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f73cc099080 0x7f73cc131470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:09.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.951+0000 7f73d19ae700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f73cc0650f0 0x7f73cc0986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:09.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.951+0000 7f73d11ad700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f73cc097c30 0x7f73cc098b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34482/0 (socket says 172.21.15.26:34482) 2023-10-01T07:52:09.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.951+0000 7f73d21af700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f73cc099080 0x7f73cc131470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55438/0 (socket says 172.21.15.26:55438) 2023-10-01T07:52:09.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.951+0000 7f73d19ae700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f73cc0650f0 0x7f73cc0986a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57676/0 (socket says 172.21.15.26:57676) 2023-10-01T07:52:09.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.951+0000 7f73d11ad700 1 -- 172.21.15.26:0/769211378 learned_addr learned my addr 172.21.15.26:0/769211378 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:09.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.951+0000 7f73d11ad700 1 -- 172.21.15.26:0/769211378 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f73cc0650f0 msgr2=0x7f73cc0986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:09.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.951+0000 7f73d11ad700 1 --2- 172.21.15.26:0/769211378 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f73cc0650f0 0x7f73cc0986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.951+0000 7f73d11ad700 1 -- 172.21.15.26:0/769211378 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f73cc099080 msgr2=0x7f73cc131470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:09.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.951+0000 7f73d11ad700 1 --2- 172.21.15.26:0/769211378 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f73cc099080 0x7f73cc131470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.951+0000 7f73d11ad700 1 -- 172.21.15.26:0/769211378 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73cc099790 con 0x7f73cc097c30 2023-10-01T07:52:09.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.951+0000 7f73d19ae700 1 --2- 172.21.15.26:0/769211378 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f73cc0650f0 0x7f73cc0986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:09.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.951+0000 7f73d11ad700 1 --2- 172.21.15.26:0/769211378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73cc097c30 0x7f73cc098b90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f73bc009860 tx=0x7f73bc0090f0).ready entity=mon.0 client_cookie=fbd9111ee085a46e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:09.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.951+0000 7f73d09ac700 1 -- 172.21.15.26:0/769211378 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc00f510 con 0x7f73cc097c30 2023-10-01T07:52:09.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.951+0000 7f73d09ac700 1 -- 172.21.15.26:0/769211378 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73bc00f670 con 0x7f73cc097c30 2023-10-01T07:52:09.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.951+0000 7f73d09ac700 1 -- 172.21.15.26:0/769211378 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc00f9f0 con 0x7f73cc097c30 2023-10-01T07:52:09.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.952+0000 7f73d3c12700 1 -- 172.21.15.26:0/769211378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73cc097c30 msgr2=0x7f73cc098b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:09.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.952+0000 7f73d3c12700 1 --2- 172.21.15.26:0/769211378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73cc097c30 0x7f73cc098b90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f73bc009860 tx=0x7f73bc0090f0).stop 2023-10-01T07:52:09.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.952+0000 7f73d3c12700 1 -- 172.21.15.26:0/769211378 shutdown_connections 2023-10-01T07:52:09.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.952+0000 7f73d3c12700 1 --2- 172.21.15.26:0/769211378 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f73cc099080 0x7f73cc131470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.952+0000 7f73d3c12700 1 --2- 172.21.15.26:0/769211378 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f73cc0650f0 0x7f73cc0986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.952+0000 7f73d3c12700 1 --2- 172.21.15.26:0/769211378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73cc097c30 0x7f73cc098b90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.952+0000 7f73d3c12700 1 -- 172.21.15.26:0/769211378 >> 172.21.15.26:0/769211378 conn(0x7f73cc09dc70 msgr2=0x7f73cc09e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:09.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.952+0000 7f73d3c12700 1 -- 172.21.15.26:0/769211378 shutdown_connections 2023-10-01T07:52:09.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.952+0000 7f73d3c12700 1 -- 172.21.15.26:0/769211378 wait complete. 2023-10-01T07:52:09.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.953+0000 7f73d3c12700 1 Processor -- start 2023-10-01T07:52:09.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.953+0000 7f73d3c12700 1 -- start start 2023-10-01T07:52:09.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.953+0000 7f73d3c12700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f73cc0650f0 0x7f73cc13a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:09.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.953+0000 7f73d3c12700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73cc099080 0x7f73cc13adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:09.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.953+0000 7f73d3c12700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f73cc13b2b0 0x7f73cc11a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:09.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.953+0000 7f73d3c12700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73cc09cdf0 con 0x7f73cc099080 2023-10-01T07:52:09.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.953+0000 7f73d3c12700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73cc11de50 con 0x7f73cc13b2b0 2023-10-01T07:52:09.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.953+0000 7f73d3c12700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73cc12f690 con 0x7f73cc0650f0 2023-10-01T07:52:09.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.953+0000 7f73d19ae700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f73cc0650f0 0x7f73cc13a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:09.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.954+0000 7f73d11ad700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73cc099080 0x7f73cc13adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:09.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.954+0000 7f73d21af700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f73cc13b2b0 0x7f73cc11a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:09.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.954+0000 7f73d19ae700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f73cc0650f0 0x7f73cc13a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57680/0 (socket says 172.21.15.26:57680) 2023-10-01T07:52:09.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.954+0000 7f73d19ae700 1 -- 172.21.15.26:0/1140960182 learned_addr learned my addr 172.21.15.26:0/1140960182 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:09.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.954+0000 7f73d19ae700 1 -- 172.21.15.26:0/1140960182 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f73cc13b2b0 msgr2=0x7f73cc11a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:09.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.954+0000 7f73d19ae700 1 --2- 172.21.15.26:0/1140960182 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f73cc13b2b0 0x7f73cc11a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.954+0000 7f73d19ae700 1 -- 172.21.15.26:0/1140960182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73cc099080 msgr2=0x7f73cc13adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:09.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.954+0000 7f73d19ae700 1 --2- 172.21.15.26:0/1140960182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73cc099080 0x7f73cc13adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:09.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.954+0000 7f73d19ae700 1 -- 172.21.15.26:0/1140960182 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c80092a0 con 0x7f73cc0650f0 2023-10-01T07:52:09.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.954+0000 7f73d11ad700 1 --2- 172.21.15.26:0/1140960182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73cc099080 0x7f73cc13adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:09.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.954+0000 7f73d19ae700 1 --2- 172.21.15.26:0/1140960182 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f73cc0650f0 0x7f73cc13a8d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f73c800ea50 tx=0x7f73c8009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:09.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.954+0000 7f73c1ffb700 1 -- 172.21.15.26:0/1140960182 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c800ee90 con 0x7f73cc0650f0 2023-10-01T07:52:09.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.954+0000 7f73c1ffb700 1 -- 172.21.15.26:0/1140960182 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c8009600 con 0x7f73cc0650f0 2023-10-01T07:52:09.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.954+0000 7f73d3c12700 1 -- 172.21.15.26:0/1140960182 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73bc009370 con 0x7f73cc0650f0 2023-10-01T07:52:09.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.954+0000 7f73c1ffb700 1 -- 172.21.15.26:0/1140960182 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c800ca60 con 0x7f73cc0650f0 2023-10-01T07:52:09.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.954+0000 7f73d3c12700 1 -- 172.21.15.26:0/1140960182 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73cc11c1b0 con 0x7f73cc0650f0 2023-10-01T07:52:09.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.955+0000 7f73d3c12700 1 -- 172.21.15.26:0/1140960182 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73cc11d900 con 0x7f73cc0650f0 2023-10-01T07:52:09.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.956+0000 7f73c1ffb700 1 -- 172.21.15.26:0/1140960182 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f73c801b400 con 0x7f73cc0650f0 2023-10-01T07:52:09.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.956+0000 7f73c1ffb700 1 -- 172.21.15.26:0/1140960182 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f73c803bbb0 con 0x7f73cc0650f0 2023-10-01T07:52:09.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:09.960+0000 7f73c1ffb700 1 -- 172.21.15.26:0/1140960182 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f73c8011350 con 0x7f73cc0650f0 2023-10-01T07:52:10.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.131+0000 7f73d3c12700 1 -- 172.21.15.26:0/1140960182 --> v1:172.21.15.26:6816/118178 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f73cc11dfc0 con 0x7f73b002bb90 2023-10-01T07:52:10.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.138+0000 7f73c1ffb700 1 -- 172.21.15.26:0/1140960182 <== mgr.4107 v1:172.21.15.26:6816/118178 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249911 (unknown 2965378022 0 2902196309) 0x7f73cc11dfc0 con 0x7f73b002bb90 2023-10-01T07:52:10.141 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:52:10.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.141+0000 7f73d3c12700 1 -- 172.21.15.26:0/1140960182 >> v1:172.21.15.26:6816/118178 conn(0x7f73b002bb90 legacy=0x7f73b002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:10.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.141+0000 7f73d3c12700 1 -- 172.21.15.26:0/1140960182 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f73cc0650f0 msgr2=0x7f73cc13a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:10.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.141+0000 7f73d3c12700 1 --2- 172.21.15.26:0/1140960182 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f73cc0650f0 0x7f73cc13a8d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f73c800ea50 tx=0x7f73c8009060).stop 2023-10-01T07:52:10.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.141+0000 7f73d3c12700 1 -- 172.21.15.26:0/1140960182 shutdown_connections 2023-10-01T07:52:10.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.141+0000 7f73d3c12700 1 --2- 172.21.15.26:0/1140960182 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f73cc13b2b0 0x7f73cc11a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:10.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.141+0000 7f73d3c12700 1 --2- 172.21.15.26:0/1140960182 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f73cc0650f0 0x7f73cc13a8d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:10.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.141+0000 7f73d3c12700 1 --2- 172.21.15.26:0/1140960182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73cc099080 0x7f73cc13adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:10.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.141+0000 7f73d3c12700 1 -- 172.21.15.26:0/1140960182 >> 172.21.15.26:0/1140960182 conn(0x7f73cc09dc70 msgr2=0x7f73cc1142d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:10.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.141+0000 7f73d3c12700 1 -- 172.21.15.26:0/1140960182 shutdown_connections 2023-10-01T07:52:10.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.141+0000 7f73d3c12700 1 -- 172.21.15.26:0/1140960182 wait complete. 2023-10-01T07:52:10.144 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-01T07:52:10.155 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-01T07:52:09.809304+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189024,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298336,"statfs":{"total":386547056640,"available":385329496064,"internally_reserved":0,"allocated":655360,"data_stored":193408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1640,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002405"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.343644+0000","last_change":"2023-10-01T07:51:57.340051+0000","last_active":"2023-10-01T07:51:57.343644+0000","last_peered":"2023-10-01T07:51:57.343644+0000","last_clean":"2023-10-01T07:51:57.343644+0000","last_became_active":"2023-10-01T07:51:57.339739+0000","last_became_peered":"2023-10-01T07:51:57.339739+0000","last_unstale":"2023-10-01T07:51:57.343644+0000","last_undegraded":"2023-10-01T07:51:57.343644+0000","last_fullsized":"2023-10-01T07:51:57.343644+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.337096+0000","last_change":"2023-10-01T07:51:57.330147+0000","last_active":"2023-10-01T07:51:57.337096+0000","last_peered":"2023-10-01T07:51:57.337096+0000","last_clean":"2023-10-01T07:51:57.337096+0000","last_became_active":"2023-10-01T07:51:57.329793+0000","last_became_peered":"2023-10-01T07:51:57.329793+0000","last_unstale":"2023-10-01T07:51:57.337096+0000","last_undegraded":"2023-10-01T07:51:57.337096+0000","last_fullsized":"2023-10-01T07:51:57.337096+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.343537+0000","last_change":"2023-10-01T07:51:57.335404+0000","last_active":"2023-10-01T07:51:57.343537+0000","last_peered":"2023-10-01T07:51:57.343537+0000","last_clean":"2023-10-01T07:51:57.343537+0000","last_became_active":"2023-10-01T07:51:57.329225+0000","last_became_peered":"2023-10-01T07:51:57.329225+0000","last_unstale":"2023-10-01T07:51:57.343537+0000","last_undegraded":"2023-10-01T07:51:57.343537+0000","last_fullsized":"2023-10-01T07:51:57.343537+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.337475+0000","last_change":"2023-10-01T07:51:57.332237+0000","last_active":"2023-10-01T07:51:57.337475+0000","last_peered":"2023-10-01T07:51:57.337475+0000","last_clean":"2023-10-01T07:51:57.337475+0000","last_became_active":"2023-10-01T07:51:57.331857+0000","last_became_peered":"2023-10-01T07:51:57.331857+0000","last_unstale":"2023-10-01T07:51:57.337475+0000","last_undegraded":"2023-10-01T07:51:57.337475+0000","last_fullsized":"2023-10-01T07:51:57.337475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335610+0000","last_change":"2023-10-01T07:51:57.326512+0000","last_active":"2023-10-01T07:51:57.335610+0000","last_peered":"2023-10-01T07:51:57.335610+0000","last_clean":"2023-10-01T07:51:57.335610+0000","last_became_active":"2023-10-01T07:51:57.326202+0000","last_became_peered":"2023-10-01T07:51:57.326202+0000","last_unstale":"2023-10-01T07:51:57.335610+0000","last_undegraded":"2023-10-01T07:51:57.335610+0000","last_fullsized":"2023-10-01T07:51:57.335610+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345080+0000","last_change":"2023-10-01T07:51:57.323824+0000","last_active":"2023-10-01T07:51:57.345080+0000","last_peered":"2023-10-01T07:51:57.345080+0000","last_clean":"2023-10-01T07:51:57.345080+0000","last_became_active":"2023-10-01T07:51:57.322857+0000","last_became_peered":"2023-10-01T07:51:57.322857+0000","last_unstale":"2023-10-01T07:51:57.345080+0000","last_undegraded":"2023-10-01T07:51:57.345080+0000","last_fullsized":"2023-10-01T07:51:57.345080+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345129+0000","last_change":"2023-10-01T07:51:57.325909+0000","last_active":"2023-10-01T07:51:57.345129+0000","last_peered":"2023-10-01T07:51:57.345129+0000","last_clean":"2023-10-01T07:51:57.345129+0000","last_became_active":"2023-10-01T07:51:57.325226+0000","last_became_peered":"2023-10-01T07:51:57.325226+0000","last_unstale":"2023-10-01T07:51:57.345129+0000","last_undegraded":"2023-10-01T07:51:57.345129+0000","last_fullsized":"2023-10-01T07:51:57.345129+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335188+0000","last_change":"2023-10-01T07:51:57.323649+0000","last_active":"2023-10-01T07:51:57.335188+0000","last_peered":"2023-10-01T07:51:57.335188+0000","last_clean":"2023-10-01T07:51:57.335188+0000","last_became_active":"2023-10-01T07:51:57.319917+0000","last_became_peered":"2023-10-01T07:51:57.319917+0000","last_unstale":"2023-10-01T07:51:57.335188+0000","last_undegraded":"2023-10-01T07:51:57.335188+0000","last_fullsized":"2023-10-01T07:51:57.335188+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335645+0000","last_change":"2023-10-01T07:51:57.325845+0000","last_active":"2023-10-01T07:51:57.335645+0000","last_peered":"2023-10-01T07:51:57.335645+0000","last_clean":"2023-10-01T07:51:57.335645+0000","last_became_active":"2023-10-01T07:51:57.325346+0000","last_became_peered":"2023-10-01T07:51:57.325346+0000","last_unstale":"2023-10-01T07:51:57.335645+0000","last_undegraded":"2023-10-01T07:51:57.335645+0000","last_fullsized":"2023-10-01T07:51:57.335645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.337622+0000","last_change":"2023-10-01T07:51:57.328438+0000","last_active":"2023-10-01T07:51:57.337622+0000","last_peered":"2023-10-01T07:51:57.337622+0000","last_clean":"2023-10-01T07:51:57.337622+0000","last_became_active":"2023-10-01T07:51:57.328128+0000","last_became_peered":"2023-10-01T07:51:57.328128+0000","last_unstale":"2023-10-01T07:51:57.337622+0000","last_undegraded":"2023-10-01T07:51:57.337622+0000","last_fullsized":"2023-10-01T07:51:57.337622+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.333136+0000","last_change":"2023-10-01T07:51:57.328650+0000","last_active":"2023-10-01T07:51:57.333136+0000","last_peered":"2023-10-01T07:51:57.333136+0000","last_clean":"2023-10-01T07:51:57.333136+0000","last_became_active":"2023-10-01T07:51:57.328335+0000","last_became_peered":"2023-10-01T07:51:57.328335+0000","last_unstale":"2023-10-01T07:51:57.333136+0000","last_undegraded":"2023-10-01T07:51:57.333136+0000","last_fullsized":"2023-10-01T07:51:57.333136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.337224+0000","last_change":"2023-10-01T07:51:57.331991+0000","last_active":"2023-10-01T07:51:57.337224+0000","last_peered":"2023-10-01T07:51:57.337224+0000","last_clean":"2023-10-01T07:51:57.337224+0000","last_became_active":"2023-10-01T07:51:57.331698+0000","last_became_peered":"2023-10-01T07:51:57.331698+0000","last_unstale":"2023-10-01T07:51:57.337224+0000","last_undegraded":"2023-10-01T07:51:57.337224+0000","last_fullsized":"2023-10-01T07:51:57.337224+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.344547+0000","last_change":"2023-10-01T07:51:57.342157+0000","last_active":"2023-10-01T07:51:57.344547+0000","last_peered":"2023-10-01T07:51:57.344547+0000","last_clean":"2023-10-01T07:51:57.344547+0000","last_became_active":"2023-10-01T07:51:57.341533+0000","last_became_peered":"2023-10-01T07:51:57.341533+0000","last_unstale":"2023-10-01T07:51:57.344547+0000","last_undegraded":"2023-10-01T07:51:57.344547+0000","last_fullsized":"2023-10-01T07:51:57.344547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.323193+0000","last_change":"2023-10-01T07:51:57.318295+0000","last_active":"2023-10-01T07:51:57.323193+0000","last_peered":"2023-10-01T07:51:57.323193+0000","last_clean":"2023-10-01T07:51:57.323193+0000","last_became_active":"2023-10-01T07:51:57.317972+0000","last_became_peered":"2023-10-01T07:51:57.317972+0000","last_unstale":"2023-10-01T07:51:57.323193+0000","last_undegraded":"2023-10-01T07:51:57.323193+0000","last_fullsized":"2023-10-01T07:51:57.323193+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.334056+0000","last_change":"2023-10-01T07:51:57.321137+0000","last_active":"2023-10-01T07:51:57.334056+0000","last_peered":"2023-10-01T07:51:57.334056+0000","last_clean":"2023-10-01T07:51:57.334056+0000","last_became_active":"2023-10-01T07:51:57.320789+0000","last_became_peered":"2023-10-01T07:51:57.320789+0000","last_unstale":"2023-10-01T07:51:57.334056+0000","last_undegraded":"2023-10-01T07:51:57.334056+0000","last_fullsized":"2023-10-01T07:51:57.334056+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.346763+0000","last_change":"2023-10-01T07:51:57.325610+0000","last_active":"2023-10-01T07:51:57.346763+0000","last_peered":"2023-10-01T07:51:57.346763+0000","last_clean":"2023-10-01T07:51:57.346763+0000","last_became_active":"2023-10-01T07:51:57.325322+0000","last_became_peered":"2023-10-01T07:51:57.325322+0000","last_unstale":"2023-10-01T07:51:57.346763+0000","last_undegraded":"2023-10-01T07:51:57.346763+0000","last_fullsized":"2023-10-01T07:51:57.346763+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335623+0000","last_change":"2023-10-01T07:51:57.325641+0000","last_active":"2023-10-01T07:51:57.335623+0000","last_peered":"2023-10-01T07:51:57.335623+0000","last_clean":"2023-10-01T07:51:57.335623+0000","last_became_active":"2023-10-01T07:51:57.324956+0000","last_became_peered":"2023-10-01T07:51:57.324956+0000","last_unstale":"2023-10-01T07:51:57.335623+0000","last_undegraded":"2023-10-01T07:51:57.335623+0000","last_fullsized":"2023-10-01T07:51:57.335623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.321164+0000","last_change":"2023-10-01T07:51:57.316882+0000","last_active":"2023-10-01T07:51:57.321164+0000","last_peered":"2023-10-01T07:51:57.321164+0000","last_clean":"2023-10-01T07:51:57.321164+0000","last_became_active":"2023-10-01T07:51:57.316026+0000","last_became_peered":"2023-10-01T07:51:57.316026+0000","last_unstale":"2023-10-01T07:51:57.321164+0000","last_undegraded":"2023-10-01T07:51:57.321164+0000","last_fullsized":"2023-10-01T07:51:57.321164+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.343491+0000","last_change":"2023-10-01T07:51:57.340110+0000","last_active":"2023-10-01T07:51:57.343491+0000","last_peered":"2023-10-01T07:51:57.343491+0000","last_clean":"2023-10-01T07:51:57.343491+0000","last_became_active":"2023-10-01T07:51:57.339795+0000","last_became_peered":"2023-10-01T07:51:57.339795+0000","last_unstale":"2023-10-01T07:51:57.343491+0000","last_undegraded":"2023-10-01T07:51:57.343491+0000","last_fullsized":"2023-10-01T07:51:57.343491+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348821+0000","last_change":"2023-10-01T07:51:57.347691+0000","last_active":"2023-10-01T07:51:57.348821+0000","last_peered":"2023-10-01T07:51:57.348821+0000","last_clean":"2023-10-01T07:51:57.348821+0000","last_became_active":"2023-10-01T07:51:57.347374+0000","last_became_peered":"2023-10-01T07:51:57.347374+0000","last_unstale":"2023-10-01T07:51:57.348821+0000","last_undegraded":"2023-10-01T07:51:57.348821+0000","last_fullsized":"2023-10-01T07:51:57.348821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348551+0000","last_change":"2023-10-01T07:51:57.341479+0000","last_active":"2023-10-01T07:51:57.348551+0000","last_peered":"2023-10-01T07:51:57.348551+0000","last_clean":"2023-10-01T07:51:57.348551+0000","last_became_active":"2023-10-01T07:51:57.341064+0000","last_became_peered":"2023-10-01T07:51:57.341064+0000","last_unstale":"2023-10-01T07:51:57.348551+0000","last_undegraded":"2023-10-01T07:51:57.348551+0000","last_fullsized":"2023-10-01T07:51:57.348551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.338618+0000","last_change":"2023-10-01T07:51:57.332063+0000","last_active":"2023-10-01T07:51:57.338618+0000","last_peered":"2023-10-01T07:51:57.338618+0000","last_clean":"2023-10-01T07:51:57.338618+0000","last_became_active":"2023-10-01T07:51:57.331511+0000","last_became_peered":"2023-10-01T07:51:57.331511+0000","last_unstale":"2023-10-01T07:51:57.338618+0000","last_undegraded":"2023-10-01T07:51:57.338618+0000","last_fullsized":"2023-10-01T07:51:57.338618+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345085+0000","last_change":"2023-10-01T07:51:57.325516+0000","last_active":"2023-10-01T07:51:57.345085+0000","last_peered":"2023-10-01T07:51:57.345085+0000","last_clean":"2023-10-01T07:51:57.345085+0000","last_became_active":"2023-10-01T07:51:57.324549+0000","last_became_peered":"2023-10-01T07:51:57.324549+0000","last_unstale":"2023-10-01T07:51:57.345085+0000","last_undegraded":"2023-10-01T07:51:57.345085+0000","last_fullsized":"2023-10-01T07:51:57.345085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.336578+0000","last_change":"2023-10-01T07:51:57.334881+0000","last_active":"2023-10-01T07:51:57.336578+0000","last_peered":"2023-10-01T07:51:57.336578+0000","last_clean":"2023-10-01T07:51:57.336578+0000","last_became_active":"2023-10-01T07:51:57.334682+0000","last_became_peered":"2023-10-01T07:51:57.334682+0000","last_unstale":"2023-10-01T07:51:57.336578+0000","last_undegraded":"2023-10-01T07:51:57.336578+0000","last_fullsized":"2023-10-01T07:51:57.336578+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.336811+0000","last_change":"2023-10-01T07:51:57.334700+0000","last_active":"2023-10-01T07:51:57.336811+0000","last_peered":"2023-10-01T07:51:57.336811+0000","last_clean":"2023-10-01T07:51:57.336811+0000","last_became_active":"2023-10-01T07:51:57.334406+0000","last_became_peered":"2023-10-01T07:51:57.334406+0000","last_unstale":"2023-10-01T07:51:57.336811+0000","last_undegraded":"2023-10-01T07:51:57.336811+0000","last_fullsized":"2023-10-01T07:51:57.336811+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.337601+0000","last_change":"2023-10-01T07:51:57.323470+0000","last_active":"2023-10-01T07:51:57.337601+0000","last_peered":"2023-10-01T07:51:57.337601+0000","last_clean":"2023-10-01T07:51:57.337601+0000","last_became_active":"2023-10-01T07:51:57.323181+0000","last_became_peered":"2023-10-01T07:51:57.323181+0000","last_unstale":"2023-10-01T07:51:57.337601+0000","last_undegraded":"2023-10-01T07:51:57.337601+0000","last_fullsized":"2023-10-01T07:51:57.337601+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.347475+0000","last_change":"2023-10-01T07:51:57.339412+0000","last_active":"2023-10-01T07:51:57.347475+0000","last_peered":"2023-10-01T07:51:57.347475+0000","last_clean":"2023-10-01T07:51:57.347475+0000","last_became_active":"2023-10-01T07:51:57.338796+0000","last_became_peered":"2023-10-01T07:51:57.338796+0000","last_unstale":"2023-10-01T07:51:57.347475+0000","last_undegraded":"2023-10-01T07:51:57.347475+0000","last_fullsized":"2023-10-01T07:51:57.347475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.321447+0000","last_change":"2023-10-01T07:51:56.911245+0000","last_active":"2023-10-01T07:51:57.321447+0000","last_peered":"2023-10-01T07:51:57.321447+0000","last_clean":"2023-10-01T07:51:57.321447+0000","last_became_active":"2023-10-01T07:51:56.910930+0000","last_became_peered":"2023-10-01T07:51:56.910930+0000","last_unstale":"2023-10-01T07:51:57.321447+0000","last_undegraded":"2023-10-01T07:51:57.321447+0000","last_fullsized":"2023-10-01T07:51:57.321447+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348455+0000","last_change":"2023-10-01T07:51:57.343694+0000","last_active":"2023-10-01T07:51:57.348455+0000","last_peered":"2023-10-01T07:51:57.348455+0000","last_clean":"2023-10-01T07:51:57.348455+0000","last_became_active":"2023-10-01T07:51:57.343082+0000","last_became_peered":"2023-10-01T07:51:57.343082+0000","last_unstale":"2023-10-01T07:51:57.348455+0000","last_undegraded":"2023-10-01T07:51:57.348455+0000","last_fullsized":"2023-10-01T07:51:57.348455+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.310075+0000","last_change":"2023-10-01T07:51:56.919246+0000","last_active":"2023-10-01T07:51:57.310075+0000","last_peered":"2023-10-01T07:51:57.310075+0000","last_clean":"2023-10-01T07:51:57.310075+0000","last_became_active":"2023-10-01T07:51:56.918962+0000","last_became_peered":"2023-10-01T07:51:56.918962+0000","last_unstale":"2023-10-01T07:51:57.310075+0000","last_undegraded":"2023-10-01T07:51:57.310075+0000","last_fullsized":"2023-10-01T07:51:57.310075+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.338500+0000","last_change":"2023-10-01T07:51:57.335143+0000","last_active":"2023-10-01T07:51:57.338500+0000","last_peered":"2023-10-01T07:51:57.338500+0000","last_clean":"2023-10-01T07:51:57.338500+0000","last_became_active":"2023-10-01T07:51:57.334730+0000","last_became_peered":"2023-10-01T07:51:57.334730+0000","last_unstale":"2023-10-01T07:51:57.338500+0000","last_undegraded":"2023-10-01T07:51:57.338500+0000","last_fullsized":"2023-10-01T07:51:57.338500+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.309155+0000","last_change":"2023-10-01T07:51:56.914663+0000","last_active":"2023-10-01T07:51:57.309155+0000","last_peered":"2023-10-01T07:51:57.309155+0000","last_clean":"2023-10-01T07:51:57.309155+0000","last_became_active":"2023-10-01T07:51:56.914321+0000","last_became_peered":"2023-10-01T07:51:56.914321+0000","last_unstale":"2023-10-01T07:51:57.309155+0000","last_undegraded":"2023-10-01T07:51:57.309155+0000","last_fullsized":"2023-10-01T07:51:57.309155+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348872+0000","last_change":"2023-10-01T07:51:57.345818+0000","last_active":"2023-10-01T07:51:57.348872+0000","last_peered":"2023-10-01T07:51:57.348872+0000","last_clean":"2023-10-01T07:51:57.348872+0000","last_became_active":"2023-10-01T07:51:57.345561+0000","last_became_peered":"2023-10-01T07:51:57.345561+0000","last_unstale":"2023-10-01T07:51:57.348872+0000","last_undegraded":"2023-10-01T07:51:57.348872+0000","last_fullsized":"2023-10-01T07:51:57.348872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.305995+0000","last_change":"2023-10-01T07:51:56.916086+0000","last_active":"2023-10-01T07:51:57.305995+0000","last_peered":"2023-10-01T07:51:57.305995+0000","last_clean":"2023-10-01T07:51:57.305995+0000","last_became_active":"2023-10-01T07:51:56.912164+0000","last_became_peered":"2023-10-01T07:51:56.912164+0000","last_unstale":"2023-10-01T07:51:57.305995+0000","last_undegraded":"2023-10-01T07:51:57.305995+0000","last_fullsized":"2023-10-01T07:51:57.305995+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.347640+0000","last_change":"2023-10-01T07:51:57.340361+0000","last_active":"2023-10-01T07:51:57.347640+0000","last_peered":"2023-10-01T07:51:57.347640+0000","last_clean":"2023-10-01T07:51:57.347640+0000","last_became_active":"2023-10-01T07:51:57.339753+0000","last_became_peered":"2023-10-01T07:51:57.339753+0000","last_unstale":"2023-10-01T07:51:57.347640+0000","last_undegraded":"2023-10-01T07:51:57.347640+0000","last_fullsized":"2023-10-01T07:51:57.347640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.308978+0000","last_change":"2023-10-01T07:51:56.917428+0000","last_active":"2023-10-01T07:51:57.308978+0000","last_peered":"2023-10-01T07:51:57.308978+0000","last_clean":"2023-10-01T07:51:57.308978+0000","last_became_active":"2023-10-01T07:51:56.916781+0000","last_became_peered":"2023-10-01T07:51:56.916781+0000","last_unstale":"2023-10-01T07:51:57.308978+0000","last_undegraded":"2023-10-01T07:51:57.308978+0000","last_fullsized":"2023-10-01T07:51:57.308978+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.347478+0000","last_change":"2023-10-01T07:51:57.339022+0000","last_active":"2023-10-01T07:51:57.347478+0000","last_peered":"2023-10-01T07:51:57.347478+0000","last_clean":"2023-10-01T07:51:57.347478+0000","last_became_active":"2023-10-01T07:51:57.338710+0000","last_became_peered":"2023-10-01T07:51:57.338710+0000","last_unstale":"2023-10-01T07:51:57.347478+0000","last_undegraded":"2023-10-01T07:51:57.347478+0000","last_fullsized":"2023-10-01T07:51:57.347478+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345213+0000","last_change":"2023-10-01T07:51:56.914774+0000","last_active":"2023-10-01T07:51:57.345213+0000","last_peered":"2023-10-01T07:51:57.345213+0000","last_clean":"2023-10-01T07:51:57.345213+0000","last_became_active":"2023-10-01T07:51:56.912021+0000","last_became_peered":"2023-10-01T07:51:56.912021+0000","last_unstale":"2023-10-01T07:51:57.345213+0000","last_undegraded":"2023-10-01T07:51:57.345213+0000","last_fullsized":"2023-10-01T07:51:57.345213+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.333273+0000","last_change":"2023-10-01T07:51:57.331183+0000","last_active":"2023-10-01T07:51:57.333273+0000","last_peered":"2023-10-01T07:51:57.333273+0000","last_clean":"2023-10-01T07:51:57.333273+0000","last_became_active":"2023-10-01T07:51:57.330934+0000","last_became_peered":"2023-10-01T07:51:57.330934+0000","last_unstale":"2023-10-01T07:51:57.333273+0000","last_undegraded":"2023-10-01T07:51:57.333273+0000","last_fullsized":"2023-10-01T07:51:57.333273+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"16'6","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.350817+0000","last_change":"2023-10-01T07:51:56.925053+0000","last_active":"2023-10-01T07:51:57.350817+0000","last_peered":"2023-10-01T07:51:57.350817+0000","last_clean":"2023-10-01T07:51:57.350817+0000","last_became_active":"2023-10-01T07:51:56.924755+0000","last_became_peered":"2023-10-01T07:51:56.924755+0000","last_unstale":"2023-10-01T07:51:57.350817+0000","last_undegraded":"2023-10-01T07:51:57.350817+0000","last_fullsized":"2023-10-01T07:51:57.350817+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.344513+0000","last_change":"2023-10-01T07:51:57.341789+0000","last_active":"2023-10-01T07:51:57.344513+0000","last_peered":"2023-10-01T07:51:57.344513+0000","last_clean":"2023-10-01T07:51:57.344513+0000","last_became_active":"2023-10-01T07:51:57.340852+0000","last_became_peered":"2023-10-01T07:51:57.340852+0000","last_unstale":"2023-10-01T07:51:57.344513+0000","last_undegraded":"2023-10-01T07:51:57.344513+0000","last_fullsized":"2023-10-01T07:51:57.344513+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.344307+0000","last_change":"2023-10-01T07:51:56.924181+0000","last_active":"2023-10-01T07:51:57.344307+0000","last_peered":"2023-10-01T07:51:57.344307+0000","last_clean":"2023-10-01T07:51:57.344307+0000","last_became_active":"2023-10-01T07:51:56.923560+0000","last_became_peered":"2023-10-01T07:51:56.923560+0000","last_unstale":"2023-10-01T07:51:57.344307+0000","last_undegraded":"2023-10-01T07:51:57.344307+0000","last_fullsized":"2023-10-01T07:51:57.344307+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348258+0000","last_change":"2023-10-01T07:51:57.341678+0000","last_active":"2023-10-01T07:51:57.348258+0000","last_peered":"2023-10-01T07:51:57.348258+0000","last_clean":"2023-10-01T07:51:57.348258+0000","last_became_active":"2023-10-01T07:51:57.339190+0000","last_became_peered":"2023-10-01T07:51:57.339190+0000","last_unstale":"2023-10-01T07:51:57.348258+0000","last_undegraded":"2023-10-01T07:51:57.348258+0000","last_fullsized":"2023-10-01T07:51:57.348258+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.301106+0000","last_change":"2023-10-01T07:51:56.915181+0000","last_active":"2023-10-01T07:51:57.301106+0000","last_peered":"2023-10-01T07:51:57.301106+0000","last_clean":"2023-10-01T07:51:57.301106+0000","last_became_active":"2023-10-01T07:51:56.914858+0000","last_became_peered":"2023-10-01T07:51:56.914858+0000","last_unstale":"2023-10-01T07:51:57.301106+0000","last_undegraded":"2023-10-01T07:51:57.301106+0000","last_fullsized":"2023-10-01T07:51:57.301106+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.347494+0000","last_change":"2023-10-01T07:51:57.339439+0000","last_active":"2023-10-01T07:51:57.347494+0000","last_peered":"2023-10-01T07:51:57.347494+0000","last_clean":"2023-10-01T07:51:57.347494+0000","last_became_active":"2023-10-01T07:51:57.339208+0000","last_became_peered":"2023-10-01T07:51:57.339208+0000","last_unstale":"2023-10-01T07:51:57.347494+0000","last_undegraded":"2023-10-01T07:51:57.347494+0000","last_fullsized":"2023-10-01T07:51:57.347494+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.313566+0000","last_change":"2023-10-01T07:51:56.926432+0000","last_active":"2023-10-01T07:51:57.313566+0000","last_peered":"2023-10-01T07:51:57.313566+0000","last_clean":"2023-10-01T07:51:57.313566+0000","last_became_active":"2023-10-01T07:51:56.926080+0000","last_became_peered":"2023-10-01T07:51:56.926080+0000","last_unstale":"2023-10-01T07:51:57.313566+0000","last_undegraded":"2023-10-01T07:51:57.313566+0000","last_fullsized":"2023-10-01T07:51:57.313566+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335190+0000","last_change":"2023-10-01T07:51:57.325464+0000","last_active":"2023-10-01T07:51:57.335190+0000","last_peered":"2023-10-01T07:51:57.335190+0000","last_clean":"2023-10-01T07:51:57.335190+0000","last_became_active":"2023-10-01T07:51:57.325143+0000","last_became_peered":"2023-10-01T07:51:57.325143+0000","last_unstale":"2023-10-01T07:51:57.335190+0000","last_undegraded":"2023-10-01T07:51:57.335190+0000","last_fullsized":"2023-10-01T07:51:57.335190+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.346026+0000","last_change":"2023-10-01T07:51:56.922808+0000","last_active":"2023-10-01T07:51:57.346026+0000","last_peered":"2023-10-01T07:51:57.346026+0000","last_clean":"2023-10-01T07:51:57.346026+0000","last_became_active":"2023-10-01T07:51:56.922520+0000","last_became_peered":"2023-10-01T07:51:56.922520+0000","last_unstale":"2023-10-01T07:51:57.346026+0000","last_undegraded":"2023-10-01T07:51:57.346026+0000","last_fullsized":"2023-10-01T07:51:57.346026+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348893+0000","last_change":"2023-10-01T07:51:57.346026+0000","last_active":"2023-10-01T07:51:57.348893+0000","last_peered":"2023-10-01T07:51:57.348893+0000","last_clean":"2023-10-01T07:51:57.348893+0000","last_became_active":"2023-10-01T07:51:57.345720+0000","last_became_peered":"2023-10-01T07:51:57.345720+0000","last_unstale":"2023-10-01T07:51:57.348893+0000","last_undegraded":"2023-10-01T07:51:57.348893+0000","last_fullsized":"2023-10-01T07:51:57.348893+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.334758+0000","last_change":"2023-10-01T07:51:56.922474+0000","last_active":"2023-10-01T07:51:57.334758+0000","last_peered":"2023-10-01T07:51:57.334758+0000","last_clean":"2023-10-01T07:51:57.334758+0000","last_became_active":"2023-10-01T07:51:56.921742+0000","last_became_peered":"2023-10-01T07:51:56.921742+0000","last_unstale":"2023-10-01T07:51:57.334758+0000","last_undegraded":"2023-10-01T07:51:57.334758+0000","last_fullsized":"2023-10-01T07:51:57.334758+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.347658+0000","last_change":"2023-10-01T07:51:57.340546+0000","last_active":"2023-10-01T07:51:57.347658+0000","last_peered":"2023-10-01T07:51:57.347658+0000","last_clean":"2023-10-01T07:51:57.347658+0000","last_became_active":"2023-10-01T07:51:57.340112+0000","last_became_peered":"2023-10-01T07:51:57.340112+0000","last_unstale":"2023-10-01T07:51:57.347658+0000","last_undegraded":"2023-10-01T07:51:57.347658+0000","last_fullsized":"2023-10-01T07:51:57.347658+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.323389+0000","last_change":"2023-10-01T07:51:56.917629+0000","last_active":"2023-10-01T07:51:57.323389+0000","last_peered":"2023-10-01T07:51:57.323389+0000","last_clean":"2023-10-01T07:51:57.323389+0000","last_became_active":"2023-10-01T07:51:56.917154+0000","last_became_peered":"2023-10-01T07:51:56.917154+0000","last_unstale":"2023-10-01T07:51:57.323389+0000","last_undegraded":"2023-10-01T07:51:57.323389+0000","last_fullsized":"2023-10-01T07:51:57.323389+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348565+0000","last_change":"2023-10-01T07:51:57.340793+0000","last_active":"2023-10-01T07:51:57.348565+0000","last_peered":"2023-10-01T07:51:57.348565+0000","last_clean":"2023-10-01T07:51:57.348565+0000","last_became_active":"2023-10-01T07:51:57.340504+0000","last_became_peered":"2023-10-01T07:51:57.340504+0000","last_unstale":"2023-10-01T07:51:57.348565+0000","last_undegraded":"2023-10-01T07:51:57.348565+0000","last_fullsized":"2023-10-01T07:51:57.348565+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.344349+0000","last_change":"2023-10-01T07:51:56.925699+0000","last_active":"2023-10-01T07:51:57.344349+0000","last_peered":"2023-10-01T07:51:57.344349+0000","last_clean":"2023-10-01T07:51:57.344349+0000","last_became_active":"2023-10-01T07:51:56.925216+0000","last_became_peered":"2023-10-01T07:51:56.925216+0000","last_unstale":"2023-10-01T07:51:57.344349+0000","last_undegraded":"2023-10-01T07:51:57.344349+0000","last_fullsized":"2023-10-01T07:51:57.344349+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.343873+0000","last_change":"2023-10-01T07:51:57.340445+0000","last_active":"2023-10-01T07:51:57.343873+0000","last_peered":"2023-10-01T07:51:57.343873+0000","last_clean":"2023-10-01T07:51:57.343873+0000","last_became_active":"2023-10-01T07:51:57.340180+0000","last_became_peered":"2023-10-01T07:51:57.340180+0000","last_unstale":"2023-10-01T07:51:57.343873+0000","last_undegraded":"2023-10-01T07:51:57.343873+0000","last_fullsized":"2023-10-01T07:51:57.343873+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.303411+0000","last_change":"2023-10-01T07:51:56.915532+0000","last_active":"2023-10-01T07:51:57.303411+0000","last_peered":"2023-10-01T07:51:57.303411+0000","last_clean":"2023-10-01T07:51:57.303411+0000","last_became_active":"2023-10-01T07:51:56.912225+0000","last_became_peered":"2023-10-01T07:51:56.912225+0000","last_unstale":"2023-10-01T07:51:57.303411+0000","last_undegraded":"2023-10-01T07:51:57.303411+0000","last_fullsized":"2023-10-01T07:51:57.303411+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.338026+0000","last_change":"2023-10-01T07:51:57.331858+0000","last_active":"2023-10-01T07:51:57.338026+0000","last_peered":"2023-10-01T07:51:57.338026+0000","last_clean":"2023-10-01T07:51:57.338026+0000","last_became_active":"2023-10-01T07:51:57.331568+0000","last_became_peered":"2023-10-01T07:51:57.331568+0000","last_unstale":"2023-10-01T07:51:57.338026+0000","last_undegraded":"2023-10-01T07:51:57.338026+0000","last_fullsized":"2023-10-01T07:51:57.338026+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.342186+0000","last_change":"2023-10-01T07:51:56.924345+0000","last_active":"2023-10-01T07:51:57.342186+0000","last_peered":"2023-10-01T07:51:57.342186+0000","last_clean":"2023-10-01T07:51:57.342186+0000","last_became_active":"2023-10-01T07:51:56.923915+0000","last_became_peered":"2023-10-01T07:51:56.923915+0000","last_unstale":"2023-10-01T07:51:57.342186+0000","last_undegraded":"2023-10-01T07:51:57.342186+0000","last_fullsized":"2023-10-01T07:51:57.342186+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335325+0000","last_change":"2023-10-01T07:51:57.326926+0000","last_active":"2023-10-01T07:51:57.335325+0000","last_peered":"2023-10-01T07:51:57.335325+0000","last_clean":"2023-10-01T07:51:57.335325+0000","last_became_active":"2023-10-01T07:51:57.326597+0000","last_became_peered":"2023-10-01T07:51:57.326597+0000","last_unstale":"2023-10-01T07:51:57.335325+0000","last_undegraded":"2023-10-01T07:51:57.335325+0000","last_fullsized":"2023-10-01T07:51:57.335325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.306243+0000","last_change":"2023-10-01T07:51:56.918471+0000","last_active":"2023-10-01T07:51:57.306243+0000","last_peered":"2023-10-01T07:51:57.306243+0000","last_clean":"2023-10-01T07:51:57.306243+0000","last_became_active":"2023-10-01T07:51:56.918165+0000","last_became_peered":"2023-10-01T07:51:56.918165+0000","last_unstale":"2023-10-01T07:51:57.306243+0000","last_undegraded":"2023-10-01T07:51:57.306243+0000","last_fullsized":"2023-10-01T07:51:57.306243+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345107+0000","last_change":"2023-10-01T07:51:57.338218+0000","last_active":"2023-10-01T07:51:57.345107+0000","last_peered":"2023-10-01T07:51:57.345107+0000","last_clean":"2023-10-01T07:51:57.345107+0000","last_became_active":"2023-10-01T07:51:57.337910+0000","last_became_peered":"2023-10-01T07:51:57.337910+0000","last_unstale":"2023-10-01T07:51:57.345107+0000","last_undegraded":"2023-10-01T07:51:57.345107+0000","last_fullsized":"2023-10-01T07:51:57.345107+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.303371+0000","last_change":"2023-10-01T07:51:56.926078+0000","last_active":"2023-10-01T07:51:57.303371+0000","last_peered":"2023-10-01T07:51:57.303371+0000","last_clean":"2023-10-01T07:51:57.303371+0000","last_became_active":"2023-10-01T07:51:56.925681+0000","last_became_peered":"2023-10-01T07:51:56.925681+0000","last_unstale":"2023-10-01T07:51:57.303371+0000","last_undegraded":"2023-10-01T07:51:57.303371+0000","last_fullsized":"2023-10-01T07:51:57.303371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.344581+0000","last_change":"2023-10-01T07:51:57.340249+0000","last_active":"2023-10-01T07:51:57.344581+0000","last_peered":"2023-10-01T07:51:57.344581+0000","last_clean":"2023-10-01T07:51:57.344581+0000","last_became_active":"2023-10-01T07:51:57.339937+0000","last_became_peered":"2023-10-01T07:51:57.339937+0000","last_unstale":"2023-10-01T07:51:57.344581+0000","last_undegraded":"2023-10-01T07:51:57.344581+0000","last_fullsized":"2023-10-01T07:51:57.344581+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.303740+0000","last_change":"2023-10-01T07:51:56.918564+0000","last_active":"2023-10-01T07:51:57.303740+0000","last_peered":"2023-10-01T07:51:57.303740+0000","last_clean":"2023-10-01T07:51:57.303740+0000","last_became_active":"2023-10-01T07:51:56.918275+0000","last_became_peered":"2023-10-01T07:51:56.918275+0000","last_unstale":"2023-10-01T07:51:57.303740+0000","last_undegraded":"2023-10-01T07:51:57.303740+0000","last_fullsized":"2023-10-01T07:51:57.303740+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.348828+0000","last_change":"2023-10-01T07:51:57.347574+0000","last_active":"2023-10-01T07:51:57.348828+0000","last_peered":"2023-10-01T07:51:57.348828+0000","last_clean":"2023-10-01T07:51:57.348828+0000","last_became_active":"2023-10-01T07:51:57.347243+0000","last_became_peered":"2023-10-01T07:51:57.347243+0000","last_unstale":"2023-10-01T07:51:57.348828+0000","last_undegraded":"2023-10-01T07:51:57.348828+0000","last_fullsized":"2023-10-01T07:51:57.348828+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.310517+0000","last_change":"2023-10-01T07:51:51.883413+0000","last_active":"2023-10-01T07:51:57.310517+0000","last_peered":"2023-10-01T07:51:57.310517+0000","last_clean":"2023-10-01T07:51:57.310517+0000","last_became_active":"2023-10-01T07:51:51.883088+0000","last_became_peered":"2023-10-01T07:51:51.883088+0000","last_unstale":"2023-10-01T07:51:57.310517+0000","last_undegraded":"2023-10-01T07:51:57.310517+0000","last_fullsized":"2023-10-01T07:51:57.310517+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.306486+0000","last_change":"2023-10-01T07:51:56.914139+0000","last_active":"2023-10-01T07:51:57.306486+0000","last_peered":"2023-10-01T07:51:57.306486+0000","last_clean":"2023-10-01T07:51:57.306486+0000","last_became_active":"2023-10-01T07:51:56.913026+0000","last_became_peered":"2023-10-01T07:51:56.913026+0000","last_unstale":"2023-10-01T07:51:57.306486+0000","last_undegraded":"2023-10-01T07:51:57.306486+0000","last_fullsized":"2023-10-01T07:51:57.306486+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.336585+0000","last_change":"2023-10-01T07:51:57.334103+0000","last_active":"2023-10-01T07:51:57.336585+0000","last_peered":"2023-10-01T07:51:57.336585+0000","last_clean":"2023-10-01T07:51:57.336585+0000","last_became_active":"2023-10-01T07:51:57.333743+0000","last_became_peered":"2023-10-01T07:51:57.333743+0000","last_unstale":"2023-10-01T07:51:57.336585+0000","last_undegraded":"2023-10-01T07:51:57.336585+0000","last_fullsized":"2023-10-01T07:51:57.336585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.309952+0000","last_change":"2023-10-01T07:51:51.882685+0000","last_active":"2023-10-01T07:51:57.309952+0000","last_peered":"2023-10-01T07:51:57.309952+0000","last_clean":"2023-10-01T07:51:57.309952+0000","last_became_active":"2023-10-01T07:51:51.882396+0000","last_became_peered":"2023-10-01T07:51:51.882396+0000","last_unstale":"2023-10-01T07:51:57.309952+0000","last_undegraded":"2023-10-01T07:51:57.309952+0000","last_fullsized":"2023-10-01T07:51:57.309952+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.300924+0000","last_change":"2023-10-01T07:51:56.915631+0000","last_active":"2023-10-01T07:51:57.300924+0000","last_peered":"2023-10-01T07:51:57.300924+0000","last_clean":"2023-10-01T07:51:57.300924+0000","last_became_active":"2023-10-01T07:51:56.911566+0000","last_became_peered":"2023-10-01T07:51:56.911566+0000","last_unstale":"2023-10-01T07:51:57.300924+0000","last_undegraded":"2023-10-01T07:51:57.300924+0000","last_fullsized":"2023-10-01T07:51:57.300924+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.329388+0000","last_change":"2023-10-01T07:51:57.319612+0000","last_active":"2023-10-01T07:51:57.329388+0000","last_peered":"2023-10-01T07:51:57.329388+0000","last_clean":"2023-10-01T07:51:57.329388+0000","last_became_active":"2023-10-01T07:51:57.319125+0000","last_became_peered":"2023-10-01T07:51:57.319125+0000","last_unstale":"2023-10-01T07:51:57.329388+0000","last_undegraded":"2023-10-01T07:51:57.329388+0000","last_fullsized":"2023-10-01T07:51:57.329388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.305149+0000","last_change":"2023-10-01T07:51:51.885336+0000","last_active":"2023-10-01T07:51:57.305149+0000","last_peered":"2023-10-01T07:51:57.305149+0000","last_clean":"2023-10-01T07:51:57.305149+0000","last_became_active":"2023-10-01T07:51:51.884991+0000","last_became_peered":"2023-10-01T07:51:51.884991+0000","last_unstale":"2023-10-01T07:51:57.305149+0000","last_undegraded":"2023-10-01T07:51:57.305149+0000","last_fullsized":"2023-10-01T07:51:57.305149+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.311818+0000","last_change":"2023-10-01T07:51:56.929636+0000","last_active":"2023-10-01T07:51:57.311818+0000","last_peered":"2023-10-01T07:51:57.311818+0000","last_clean":"2023-10-01T07:51:57.311818+0000","last_became_active":"2023-10-01T07:51:56.929308+0000","last_became_peered":"2023-10-01T07:51:56.929308+0000","last_unstale":"2023-10-01T07:51:57.311818+0000","last_undegraded":"2023-10-01T07:51:57.311818+0000","last_fullsized":"2023-10-01T07:51:57.311818+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.333038+0000","last_change":"2023-10-01T07:51:57.329162+0000","last_active":"2023-10-01T07:51:57.333038+0000","last_peered":"2023-10-01T07:51:57.333038+0000","last_clean":"2023-10-01T07:51:57.333038+0000","last_became_active":"2023-10-01T07:51:57.328749+0000","last_became_peered":"2023-10-01T07:51:57.328749+0000","last_unstale":"2023-10-01T07:51:57.333038+0000","last_undegraded":"2023-10-01T07:51:57.333038+0000","last_fullsized":"2023-10-01T07:51:57.333038+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.316966+0000","last_change":"2023-10-01T07:51:51.882657+0000","last_active":"2023-10-01T07:51:57.316966+0000","last_peered":"2023-10-01T07:51:57.316966+0000","last_clean":"2023-10-01T07:51:57.316966+0000","last_became_active":"2023-10-01T07:51:51.882334+0000","last_became_peered":"2023-10-01T07:51:51.882334+0000","last_unstale":"2023-10-01T07:51:57.316966+0000","last_undegraded":"2023-10-01T07:51:57.316966+0000","last_fullsized":"2023-10-01T07:51:57.316966+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.311710+0000","last_change":"2023-10-01T07:51:50.871456+0000","last_active":"2023-10-01T07:51:57.311710+0000","last_peered":"2023-10-01T07:51:57.311710+0000","last_clean":"2023-10-01T07:51:57.311710+0000","last_became_active":"2023-10-01T07:51:50.871112+0000","last_became_peered":"2023-10-01T07:51:50.871112+0000","last_unstale":"2023-10-01T07:51:57.311710+0000","last_undegraded":"2023-10-01T07:51:57.311710+0000","last_fullsized":"2023-10-01T07:51:57.311710+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:49.856372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:49.856372+0000","last_clean_scrub_stamp":"2023-10-01T07:51:49.856372+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.305919+0000","last_change":"2023-10-01T07:51:56.925843+0000","last_active":"2023-10-01T07:51:57.305919+0000","last_peered":"2023-10-01T07:51:57.305919+0000","last_clean":"2023-10-01T07:51:57.305919+0000","last_became_active":"2023-10-01T07:51:56.925538+0000","last_became_peered":"2023-10-01T07:51:56.925538+0000","last_unstale":"2023-10-01T07:51:57.305919+0000","last_undegraded":"2023-10-01T07:51:57.305919+0000","last_fullsized":"2023-10-01T07:51:57.305919+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.347449+0000","last_change":"2023-10-01T07:51:57.339219+0000","last_active":"2023-10-01T07:51:57.347449+0000","last_peered":"2023-10-01T07:51:57.347449+0000","last_clean":"2023-10-01T07:51:57.347449+0000","last_became_active":"2023-10-01T07:51:57.338416+0000","last_became_peered":"2023-10-01T07:51:57.338416+0000","last_unstale":"2023-10-01T07:51:57.347449+0000","last_undegraded":"2023-10-01T07:51:57.347449+0000","last_fullsized":"2023-10-01T07:51:57.347449+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.309046+0000","last_change":"2023-10-01T07:51:51.882831+0000","last_active":"2023-10-01T07:51:57.309046+0000","last_peered":"2023-10-01T07:51:57.309046+0000","last_clean":"2023-10-01T07:51:57.309046+0000","last_became_active":"2023-10-01T07:51:51.882490+0000","last_became_peered":"2023-10-01T07:51:51.882490+0000","last_unstale":"2023-10-01T07:51:57.309046+0000","last_undegraded":"2023-10-01T07:51:57.309046+0000","last_fullsized":"2023-10-01T07:51:57.309046+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.300429+0000","last_change":"2023-10-01T07:51:56.929720+0000","last_active":"2023-10-01T07:51:57.300429+0000","last_peered":"2023-10-01T07:51:57.300429+0000","last_clean":"2023-10-01T07:51:57.300429+0000","last_became_active":"2023-10-01T07:51:56.929370+0000","last_became_peered":"2023-10-01T07:51:56.929370+0000","last_unstale":"2023-10-01T07:51:57.300429+0000","last_undegraded":"2023-10-01T07:51:57.300429+0000","last_fullsized":"2023-10-01T07:51:57.300429+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.338477+0000","last_change":"2023-10-01T07:51:57.335095+0000","last_active":"2023-10-01T07:51:57.338477+0000","last_peered":"2023-10-01T07:51:57.338477+0000","last_clean":"2023-10-01T07:51:57.338477+0000","last_became_active":"2023-10-01T07:51:57.334324+0000","last_became_peered":"2023-10-01T07:51:57.334324+0000","last_unstale":"2023-10-01T07:51:57.338477+0000","last_undegraded":"2023-10-01T07:51:57.338477+0000","last_fullsized":"2023-10-01T07:51:57.338477+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.321040+0000","last_change":"2023-10-01T07:51:51.884196+0000","last_active":"2023-10-01T07:51:57.321040+0000","last_peered":"2023-10-01T07:51:57.321040+0000","last_clean":"2023-10-01T07:51:57.321040+0000","last_became_active":"2023-10-01T07:51:51.883784+0000","last_became_peered":"2023-10-01T07:51:51.883784+0000","last_unstale":"2023-10-01T07:51:57.321040+0000","last_undegraded":"2023-10-01T07:51:57.321040+0000","last_fullsized":"2023-10-01T07:51:57.321040+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.310257+0000","last_change":"2023-10-01T07:51:56.913348+0000","last_active":"2023-10-01T07:51:57.310257+0000","last_peered":"2023-10-01T07:51:57.310257+0000","last_clean":"2023-10-01T07:51:57.310257+0000","last_became_active":"2023-10-01T07:51:56.913041+0000","last_became_peered":"2023-10-01T07:51:56.913041+0000","last_unstale":"2023-10-01T07:51:57.310257+0000","last_undegraded":"2023-10-01T07:51:57.310257+0000","last_fullsized":"2023-10-01T07:51:57.310257+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.320737+0000","last_change":"2023-10-01T07:51:57.313930+0000","last_active":"2023-10-01T07:51:57.320737+0000","last_peered":"2023-10-01T07:51:57.320737+0000","last_clean":"2023-10-01T07:51:57.320737+0000","last_became_active":"2023-10-01T07:51:57.313613+0000","last_became_peered":"2023-10-01T07:51:57.313613+0000","last_unstale":"2023-10-01T07:51:57.320737+0000","last_undegraded":"2023-10-01T07:51:57.320737+0000","last_fullsized":"2023-10-01T07:51:57.320737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345351+0000","last_change":"2023-10-01T07:51:56.929769+0000","last_active":"2023-10-01T07:51:57.345351+0000","last_peered":"2023-10-01T07:51:57.345351+0000","last_clean":"2023-10-01T07:51:57.345351+0000","last_became_active":"2023-10-01T07:51:56.929479+0000","last_became_peered":"2023-10-01T07:51:56.929479+0000","last_unstale":"2023-10-01T07:51:57.345351+0000","last_undegraded":"2023-10-01T07:51:57.345351+0000","last_fullsized":"2023-10-01T07:51:57.345351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.312442+0000","last_change":"2023-10-01T07:51:51.883317+0000","last_active":"2023-10-01T07:51:57.312442+0000","last_peered":"2023-10-01T07:51:57.312442+0000","last_clean":"2023-10-01T07:51:57.312442+0000","last_became_active":"2023-10-01T07:51:51.883005+0000","last_became_peered":"2023-10-01T07:51:51.883005+0000","last_unstale":"2023-10-01T07:51:57.312442+0000","last_undegraded":"2023-10-01T07:51:57.312442+0000","last_fullsized":"2023-10-01T07:51:57.312442+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.346741+0000","last_change":"2023-10-01T07:51:57.325035+0000","last_active":"2023-10-01T07:51:57.346741+0000","last_peered":"2023-10-01T07:51:57.346741+0000","last_clean":"2023-10-01T07:51:57.346741+0000","last_became_active":"2023-10-01T07:51:57.324727+0000","last_became_peered":"2023-10-01T07:51:57.324727+0000","last_unstale":"2023-10-01T07:51:57.346741+0000","last_undegraded":"2023-10-01T07:51:57.346741+0000","last_fullsized":"2023-10-01T07:51:57.346741+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.322783+0000","last_change":"2023-10-01T07:51:51.883299+0000","last_active":"2023-10-01T07:51:57.322783+0000","last_peered":"2023-10-01T07:51:57.322783+0000","last_clean":"2023-10-01T07:51:57.322783+0000","last_became_active":"2023-10-01T07:51:51.883001+0000","last_became_peered":"2023-10-01T07:51:51.883001+0000","last_unstale":"2023-10-01T07:51:57.322783+0000","last_undegraded":"2023-10-01T07:51:57.322783+0000","last_fullsized":"2023-10-01T07:51:57.322783+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-01T07:51:58.305061+0000","last_change":"2023-10-01T07:51:56.921291+0000","last_active":"2023-10-01T07:51:58.305061+0000","last_peered":"2023-10-01T07:51:58.305061+0000","last_clean":"2023-10-01T07:51:58.305061+0000","last_became_active":"2023-10-01T07:51:56.920989+0000","last_became_peered":"2023-10-01T07:51:56.920989+0000","last_unstale":"2023-10-01T07:51:58.305061+0000","last_undegraded":"2023-10-01T07:51:58.305061+0000","last_fullsized":"2023-10-01T07:51:58.305061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.344273+0000","last_change":"2023-10-01T07:51:57.342916+0000","last_active":"2023-10-01T07:51:57.344273+0000","last_peered":"2023-10-01T07:51:57.344273+0000","last_clean":"2023-10-01T07:51:57.344273+0000","last_became_active":"2023-10-01T07:51:57.342653+0000","last_became_peered":"2023-10-01T07:51:57.342653+0000","last_unstale":"2023-10-01T07:51:57.344273+0000","last_undegraded":"2023-10-01T07:51:57.344273+0000","last_fullsized":"2023-10-01T07:51:57.344273+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.325920+0000","last_change":"2023-10-01T07:51:56.916437+0000","last_active":"2023-10-01T07:51:57.325920+0000","last_peered":"2023-10-01T07:51:57.325920+0000","last_clean":"2023-10-01T07:51:57.325920+0000","last_became_active":"2023-10-01T07:51:56.915935+0000","last_became_peered":"2023-10-01T07:51:56.915935+0000","last_unstale":"2023-10-01T07:51:57.325920+0000","last_undegraded":"2023-10-01T07:51:57.325920+0000","last_fullsized":"2023-10-01T07:51:57.325920+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.337204+0000","last_change":"2023-10-01T07:51:57.330536+0000","last_active":"2023-10-01T07:51:57.337204+0000","last_peered":"2023-10-01T07:51:57.337204+0000","last_clean":"2023-10-01T07:51:57.337204+0000","last_became_active":"2023-10-01T07:51:57.330151+0000","last_became_peered":"2023-10-01T07:51:57.330151+0000","last_unstale":"2023-10-01T07:51:57.337204+0000","last_undegraded":"2023-10-01T07:51:57.337204+0000","last_fullsized":"2023-10-01T07:51:57.337204+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.322423+0000","last_change":"2023-10-01T07:51:56.922316+0000","last_active":"2023-10-01T07:51:57.322423+0000","last_peered":"2023-10-01T07:51:57.322423+0000","last_clean":"2023-10-01T07:51:57.322423+0000","last_became_active":"2023-10-01T07:51:56.922003+0000","last_became_peered":"2023-10-01T07:51:56.922003+0000","last_unstale":"2023-10-01T07:51:57.322423+0000","last_undegraded":"2023-10-01T07:51:57.322423+0000","last_fullsized":"2023-10-01T07:51:57.322423+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.344530+0000","last_change":"2023-10-01T07:51:57.341976+0000","last_active":"2023-10-01T07:51:57.344530+0000","last_peered":"2023-10-01T07:51:57.344530+0000","last_clean":"2023-10-01T07:51:57.344530+0000","last_became_active":"2023-10-01T07:51:57.341188+0000","last_became_peered":"2023-10-01T07:51:57.341188+0000","last_unstale":"2023-10-01T07:51:57.344530+0000","last_undegraded":"2023-10-01T07:51:57.344530+0000","last_fullsized":"2023-10-01T07:51:57.344530+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.342897+0000","last_change":"2023-10-01T07:51:56.925522+0000","last_active":"2023-10-01T07:51:57.342897+0000","last_peered":"2023-10-01T07:51:57.342897+0000","last_clean":"2023-10-01T07:51:57.342897+0000","last_became_active":"2023-10-01T07:51:56.924830+0000","last_became_peered":"2023-10-01T07:51:56.924830+0000","last_unstale":"2023-10-01T07:51:57.342897+0000","last_undegraded":"2023-10-01T07:51:57.342897+0000","last_fullsized":"2023-10-01T07:51:57.342897+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.343893+0000","last_change":"2023-10-01T07:51:57.340653+0000","last_active":"2023-10-01T07:51:57.343893+0000","last_peered":"2023-10-01T07:51:57.343893+0000","last_clean":"2023-10-01T07:51:57.343893+0000","last_became_active":"2023-10-01T07:51:57.340395+0000","last_became_peered":"2023-10-01T07:51:57.340395+0000","last_unstale":"2023-10-01T07:51:57.343893+0000","last_undegraded":"2023-10-01T07:51:57.343893+0000","last_fullsized":"2023-10-01T07:51:57.343893+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.338671+0000","last_change":"2023-10-01T07:51:56.924298+0000","last_active":"2023-10-01T07:51:57.338671+0000","last_peered":"2023-10-01T07:51:57.338671+0000","last_clean":"2023-10-01T07:51:57.338671+0000","last_became_active":"2023-10-01T07:51:56.923975+0000","last_became_peered":"2023-10-01T07:51:56.923975+0000","last_unstale":"2023-10-01T07:51:57.338671+0000","last_undegraded":"2023-10-01T07:51:57.338671+0000","last_fullsized":"2023-10-01T07:51:57.338671+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.347457+0000","last_change":"2023-10-01T07:51:57.339026+0000","last_active":"2023-10-01T07:51:57.347457+0000","last_peered":"2023-10-01T07:51:57.347457+0000","last_clean":"2023-10-01T07:51:57.347457+0000","last_became_active":"2023-10-01T07:51:57.338722+0000","last_became_peered":"2023-10-01T07:51:57.338722+0000","last_unstale":"2023-10-01T07:51:57.347457+0000","last_undegraded":"2023-10-01T07:51:57.347457+0000","last_fullsized":"2023-10-01T07:51:57.347457+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335116+0000","last_change":"2023-10-01T07:51:56.922677+0000","last_active":"2023-10-01T07:51:57.335116+0000","last_peered":"2023-10-01T07:51:57.335116+0000","last_clean":"2023-10-01T07:51:57.335116+0000","last_became_active":"2023-10-01T07:51:56.922121+0000","last_became_peered":"2023-10-01T07:51:56.922121+0000","last_unstale":"2023-10-01T07:51:57.335116+0000","last_undegraded":"2023-10-01T07:51:57.335116+0000","last_fullsized":"2023-10-01T07:51:57.335116+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.337428+0000","last_change":"2023-10-01T07:51:57.329519+0000","last_active":"2023-10-01T07:51:57.337428+0000","last_peered":"2023-10-01T07:51:57.337428+0000","last_clean":"2023-10-01T07:51:57.337428+0000","last_became_active":"2023-10-01T07:51:57.329191+0000","last_became_peered":"2023-10-01T07:51:57.329191+0000","last_unstale":"2023-10-01T07:51:57.337428+0000","last_undegraded":"2023-10-01T07:51:57.337428+0000","last_fullsized":"2023-10-01T07:51:57.337428+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.335155+0000","last_change":"2023-10-01T07:51:57.320100+0000","last_active":"2023-10-01T07:51:57.335155+0000","last_peered":"2023-10-01T07:51:57.335155+0000","last_clean":"2023-10-01T07:51:57.335155+0000","last_became_active":"2023-10-01T07:51:57.319593+0000","last_became_peered":"2023-10-01T07:51:57.319593+0000","last_unstale":"2023-10-01T07:51:57.335155+0000","last_undegraded":"2023-10-01T07:51:57.335155+0000","last_fullsized":"2023-10-01T07:51:57.335155+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.345109+0000","last_change":"2023-10-01T07:51:57.325707+0000","last_active":"2023-10-01T07:51:57.345109+0000","last_peered":"2023-10-01T07:51:57.345109+0000","last_clean":"2023-10-01T07:51:57.345109+0000","last_became_active":"2023-10-01T07:51:57.324870+0000","last_became_peered":"2023-10-01T07:51:57.324870+0000","last_unstale":"2023-10-01T07:51:57.345109+0000","last_undegraded":"2023-10-01T07:51:57.345109+0000","last_fullsized":"2023-10-01T07:51:57.345109+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.334378+0000","last_change":"2023-10-01T07:51:57.326270+0000","last_active":"2023-10-01T07:51:57.334378+0000","last_peered":"2023-10-01T07:51:57.334378+0000","last_clean":"2023-10-01T07:51:57.334378+0000","last_became_active":"2023-10-01T07:51:57.325956+0000","last_became_peered":"2023-10-01T07:51:57.325956+0000","last_unstale":"2023-10-01T07:51:57.334378+0000","last_undegraded":"2023-10-01T07:51:57.334378+0000","last_fullsized":"2023-10-01T07:51:57.334378+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.344374+0000","last_change":"2023-10-01T07:51:57.338041+0000","last_active":"2023-10-01T07:51:57.344374+0000","last_peered":"2023-10-01T07:51:57.344374+0000","last_clean":"2023-10-01T07:51:57.344374+0000","last_became_active":"2023-10-01T07:51:57.337719+0000","last_became_peered":"2023-10-01T07:51:57.337719+0000","last_unstale":"2023-10-01T07:51:57.344374+0000","last_undegraded":"2023-10-01T07:51:57.344374+0000","last_fullsized":"2023-10-01T07:51:57.344374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-01T07:51:57.329368+0000","last_change":"2023-10-01T07:51:57.319429+0000","last_active":"2023-10-01T07:51:57.329368+0000","last_peered":"2023-10-01T07:51:57.329368+0000","last_clean":"2023-10-01T07:51:57.329368+0000","last_became_active":"2023-10-01T07:51:57.318849+0000","last_became_peered":"2023-10-01T07:51:57.318849+0000","last_unstale":"2023-10-01T07:51:57.329368+0000","last_undegraded":"2023-10-01T07:51:57.329368+0000","last_fullsized":"2023-10-01T07:51:57.329368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297264,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074576,"statfs":{"total":96636764160,"available":96332365824,"internally_reserved":0,"allocated":172032,"data_stored":48929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":48735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]}]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":47899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]}]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":47845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-01T07:52:10.160 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-01T07:52:10.160 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-01T07:52:10.160 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-01T07:52:10.160 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-01T07:52:10.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.326+0000 7fbfc3e4c700 1 Processor -- start 2023-10-01T07:52:10.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.327+0000 7fbfc3e4c700 1 -- start start 2023-10-01T07:52:10.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.327+0000 7fbfc3e4c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbfbc127390 0x7fbfbc12fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:10.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.327+0000 7fbfc3e4c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbfbc127fa0 0x7fbfbc132170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:10.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.327+0000 7fbfc3e4c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfbc091b60 con 0x7fbfbc059070 2023-10-01T07:52:10.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.327+0000 7fbfc3e4c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfbc096940 con 0x7fbfbc127390 2023-10-01T07:52:10.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.328+0000 7fbfc3e4c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc059c00 con 0x7fbfbc127fa0 2023-10-01T07:52:10.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.328+0000 7fbfc13e7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbfbc127390 0x7fbfbc12fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:10.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.328+0000 7fbfc23e9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbfbc127fa0 0x7fbfbc132170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:10.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.328+0000 7fbfc1be8700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbfbc059070 0x7fbfbc127890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:40542/0 (socket says 172.21.15.26:40542) 2023-10-01T07:52:10.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.328+0000 7fbfc13e7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbfbc127390 0x7fbfbc12fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34502/0 (socket says 172.21.15.26:34502) 2023-10-01T07:52:10.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.328+0000 7fbfc23e9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbfbc127fa0 0x7fbfbc132170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57690/0 (socket says 172.21.15.26:57690) 2023-10-01T07:52:10.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.328+0000 7fbfc1be8700 1 -- 172.21.15.26:0/216671020 learned_addr learned my addr 172.21.15.26:0/216671020 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:52:10.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.328+0000 7fbfc13e7700 1 -- 172.21.15.26:0/216671020 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbfbc127fa0 msgr2=0x7fbfbc132170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:10.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.328+0000 7fbfc13e7700 1 --2- 172.21.15.26:0/216671020 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbfbc127fa0 0x7fbfbc132170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:10.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.328+0000 7fbfc13e7700 1 -- 172.21.15.26:0/216671020 >> v1:172.21.15.26:6789/0 conn(0x7fbfbc059070 legacy=0x7fbfbc127890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:10.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.328+0000 7fbfc13e7700 1 -- 172.21.15.26:0/216671020 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfbc0929d0 con 0x7fbfbc127390 2023-10-01T07:52:10.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.328+0000 7fbfc0be6700 1 -- 172.21.15.26:0/216671020 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3967024997 0 0) 0x7fbfbc091b60 con 0x7fbfbc059070 2023-10-01T07:52:10.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.328+0000 7fbfc23e9700 1 --2- 172.21.15.26:0/216671020 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbfbc127fa0 0x7fbfbc132170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:10.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.328+0000 7fbfc13e7700 1 --2- 172.21.15.26:0/216671020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfbc127390 0x7fbfbc12fc70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fbfb0009760 tx=0x7fbfb0009060).ready entity=mon.0 client_cookie=f2526d23b9b0c31b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:10.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.328+0000 7fbfc0be6700 1 -- 172.21.15.26:0/216671020 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb00090d0 con 0x7fbfbc127390 2023-10-01T07:52:10.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.328+0000 7fbfc0be6700 1 -- 172.21.15.26:0/216671020 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb000f510 con 0x7fbfbc127390 2023-10-01T07:52:10.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.328+0000 7fbfc0be6700 1 -- 172.21.15.26:0/216671020 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb000f890 con 0x7fbfbc127390 2023-10-01T07:52:10.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.329+0000 7fbfc3e4c700 1 -- 172.21.15.26:0/216671020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfbc127390 msgr2=0x7fbfbc12fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:10.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.329+0000 7fbfc3e4c700 1 --2- 172.21.15.26:0/216671020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfbc127390 0x7fbfbc12fc70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fbfb0009760 tx=0x7fbfb0009060).stop 2023-10-01T07:52:10.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.329+0000 7fbfc3e4c700 1 -- 172.21.15.26:0/216671020 shutdown_connections 2023-10-01T07:52:10.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.329+0000 7fbfc3e4c700 1 --2- 172.21.15.26:0/216671020 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbfbc127fa0 0x7fbfbc132170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:10.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.329+0000 7fbfc3e4c700 1 --2- 172.21.15.26:0/216671020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfbc127390 0x7fbfbc12fc70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:10.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.329+0000 7fbfc3e4c700 1 -- 172.21.15.26:0/216671020 >> 172.21.15.26:0/216671020 conn(0x7fbfbc097470 msgr2=0x7fbfbc097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:10.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.329+0000 7fbfc3e4c700 1 -- 172.21.15.26:0/216671020 shutdown_connections 2023-10-01T07:52:10.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.329+0000 7fbfc3e4c700 1 -- 172.21.15.26:0/216671020 wait complete. 2023-10-01T07:52:10.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.330+0000 7fbfc3e4c700 1 Processor -- start 2023-10-01T07:52:10.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.330+0000 7fbfc3e4c700 1 -- start start 2023-10-01T07:52:10.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.331+0000 7fbfc3e4c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbfbc059070 0x7fbfbc124a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:10.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.331+0000 7fbfc3e4c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfbc127390 0x7fbfbc12ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:10.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.331+0000 7fbfc3e4c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbfbc127fa0 0x7fbfbc12bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:10.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.331+0000 7fbfc3e4c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc12ee80 con 0x7fbfbc127390 2023-10-01T07:52:10.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.331+0000 7fbfc3e4c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc131db0 con 0x7fbfbc127fa0 2023-10-01T07:52:10.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.331+0000 7fbfc3e4c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc096f20 con 0x7fbfbc059070 2023-10-01T07:52:10.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.331+0000 7fbfc1be8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbfbc059070 0x7fbfbc124a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:10.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.331+0000 7fbfc13e7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfbc127390 0x7fbfbc12ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:10.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.331+0000 7fbfc1be8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbfbc059070 0x7fbfbc124a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57698/0 (socket says 172.21.15.26:57698) 2023-10-01T07:52:10.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.331+0000 7fbfc1be8700 1 -- 172.21.15.26:0/786442551 learned_addr learned my addr 172.21.15.26:0/786442551 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:10.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.331+0000 7fbfc23e9700 1 --2- 172.21.15.26:0/786442551 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbfbc127fa0 0x7fbfbc12bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:10.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.331+0000 7fbfc13e7700 1 -- 172.21.15.26:0/786442551 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbfbc059070 msgr2=0x7fbfbc124a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:10.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.331+0000 7fbfc13e7700 1 --2- 172.21.15.26:0/786442551 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbfbc059070 0x7fbfbc124a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:10.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.331+0000 7fbfc13e7700 1 -- 172.21.15.26:0/786442551 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbfbc127fa0 msgr2=0x7fbfbc12bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:10.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.331+0000 7fbfc13e7700 1 --2- 172.21.15.26:0/786442551 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbfbc127fa0 0x7fbfbc12bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:10.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.331+0000 7fbfc13e7700 1 -- 172.21.15.26:0/786442551 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb4009a20 con 0x7fbfbc127390 2023-10-01T07:52:10.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.331+0000 7fbfc23e9700 1 --2- 172.21.15.26:0/786442551 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbfbc127fa0 0x7fbfbc12bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:10.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.331+0000 7fbfc13e7700 1 --2- 172.21.15.26:0/786442551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfbc127390 0x7fbfbc12ba40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fbfbc09a8b0 tx=0x7fbfb0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:10.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.331+0000 7fbfadffb700 1 -- 172.21.15.26:0/786442551 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb000f890 con 0x7fbfbc127390 2023-10-01T07:52:10.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.331+0000 7fbfadffb700 1 -- 172.21.15.26:0/786442551 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb0006930 con 0x7fbfbc127390 2023-10-01T07:52:10.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.331+0000 7fbfc3e4c700 1 -- 172.21.15.26:0/786442551 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfb00092a0 con 0x7fbfbc127390 2023-10-01T07:52:10.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.331+0000 7fbfadffb700 1 -- 172.21.15.26:0/786442551 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb000fea0 con 0x7fbfbc127390 2023-10-01T07:52:10.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.332+0000 7fbfc3e4c700 1 -- 172.21.15.26:0/786442551 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfbc12cdb0 con 0x7fbfbc127390 2023-10-01T07:52:10.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.332+0000 7fbfadffb700 1 -- 172.21.15.26:0/786442551 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fbfb001b620 con 0x7fbfbc127390 2023-10-01T07:52:10.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.333+0000 7fbfadffb700 1 -- 172.21.15.26:0/786442551 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fbfb003c870 con 0x7fbfbc127390 2023-10-01T07:52:10.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.333+0000 7fbfc3e4c700 1 -- 172.21.15.26:0/786442551 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfbc09a410 con 0x7fbfbc127390 2023-10-01T07:52:10.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.337+0000 7fbfadffb700 1 -- 172.21.15.26:0/786442551 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fbfb0029080 con 0x7fbfbc127390 2023-10-01T07:52:10.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.551+0000 7fbfc3e4c700 1 -- 172.21.15.26:0/786442551 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbfbc064f80 con 0x7fbfbc127390 2023-10-01T07:52:10.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.551+0000 7fbfadffb700 1 -- 172.21.15.26:0/786442551 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7fbfb001f020 con 0x7fbfbc127390 2023-10-01T07:52:10.552 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:52:10.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.553+0000 7fbfc3e4c700 1 -- 172.21.15.26:0/786442551 >> v1:172.21.15.26:6816/118178 conn(0x7fbfa002bb60 legacy=0x7fbfa002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:10.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.553+0000 7fbfc3e4c700 1 -- 172.21.15.26:0/786442551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfbc127390 msgr2=0x7fbfbc12ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:10.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.553+0000 7fbfc3e4c700 1 --2- 172.21.15.26:0/786442551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfbc127390 0x7fbfbc12ba40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fbfbc09a8b0 tx=0x7fbfb0017000).stop 2023-10-01T07:52:10.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.553+0000 7fbfc3e4c700 1 -- 172.21.15.26:0/786442551 shutdown_connections 2023-10-01T07:52:10.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.553+0000 7fbfc3e4c700 1 --2- 172.21.15.26:0/786442551 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbfbc127fa0 0x7fbfbc12bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:10.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.553+0000 7fbfc3e4c700 1 --2- 172.21.15.26:0/786442551 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbfbc059070 0x7fbfbc124a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:10.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.553+0000 7fbfc3e4c700 1 --2- 172.21.15.26:0/786442551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfbc127390 0x7fbfbc12ba40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:10.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.553+0000 7fbfc3e4c700 1 -- 172.21.15.26:0/786442551 >> 172.21.15.26:0/786442551 conn(0x7fbfbc097470 msgr2=0x7fbfbc098780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:10.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.553+0000 7fbfc3e4c700 1 -- 172.21.15.26:0/786442551 shutdown_connections 2023-10-01T07:52:10.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.553+0000 7fbfc3e4c700 1 -- 172.21.15.26:0/786442551 wait complete. 2023-10-01T07:52:10.567 INFO:teuthology.orchestra.run.smithi026.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-01T07:52:10.567 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-01T07:52:10.567 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-01T07:52:10.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.699+0000 7faacdbe2700 1 Processor -- start 2023-10-01T07:52:10.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.699+0000 7faacdbe2700 1 -- start start 2023-10-01T07:52:10.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.699+0000 7faacdbe2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faac8059070 0x7faac8127890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:10.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.699+0000 7faacdbe2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7faac8127390 0x7faac8127d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:10.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.699+0000 7faacdbe2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac8096900 con 0x7faac8095370 2023-10-01T07:52:10.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.699+0000 7faacdbe2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac8059c00 con 0x7faac8127390 2023-10-01T07:52:10.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.699+0000 7faacdbe2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faac8091b60 con 0x7faac8059070 2023-10-01T07:52:10.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.700+0000 7faabeffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7faac8127390 0x7faac8127d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:10.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.700+0000 7faabeffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7faac8127390 0x7faac8127d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34510/0 (socket says 172.21.15.26:34510) 2023-10-01T07:52:10.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.700+0000 7faac7fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7faac8095370 0x7faac8095820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:40546/0 (socket says 172.21.15.26:40546) 2023-10-01T07:52:10.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.700+0000 7faabeffd700 1 -- 172.21.15.26:0/3213133173 learned_addr learned my addr 172.21.15.26:0/3213133173 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:10.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.700+0000 7faac77fe700 1 --2- 172.21.15.26:0/3213133173 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faac8059070 0x7faac8127890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:10.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.700+0000 7faabeffd700 1 -- 172.21.15.26:0/3213133173 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faac8059070 msgr2=0x7faac8127890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:10.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.700+0000 7faabeffd700 1 --2- 172.21.15.26:0/3213133173 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faac8059070 0x7faac8127890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:10.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.700+0000 7faabeffd700 1 -- 172.21.15.26:0/3213133173 >> v1:172.21.15.26:6789/0 conn(0x7faac8095370 legacy=0x7faac8095820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:10.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.700+0000 7faabeffd700 1 -- 172.21.15.26:0/3213133173 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac8092a10 con 0x7faac8127390 2023-10-01T07:52:10.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.700+0000 7faac77fe700 1 --2- 172.21.15.26:0/3213133173 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faac8059070 0x7faac8127890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:10.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.700+0000 7faabeffd700 1 --2- 172.21.15.26:0/3213133173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac8127390 0x7faac8127d80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7faab0006fd0 tx=0x7faab00090f0).ready entity=mon.0 client_cookie=45fe24fec8663b75 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:10.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.700+0000 7faac6ffd700 1 -- 172.21.15.26:0/3213133173 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab000b580 con 0x7faac8127390 2023-10-01T07:52:10.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.701+0000 7faac6ffd700 1 -- 172.21.15.26:0/3213133173 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab000b6e0 con 0x7faac8127390 2023-10-01T07:52:10.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.701+0000 7faac6ffd700 1 -- 172.21.15.26:0/3213133173 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab000ba80 con 0x7faac8127390 2023-10-01T07:52:10.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.701+0000 7faacdbe2700 1 -- 172.21.15.26:0/3213133173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac8127390 msgr2=0x7faac8127d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:10.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.701+0000 7faacdbe2700 1 --2- 172.21.15.26:0/3213133173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac8127390 0x7faac8127d80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7faab0006fd0 tx=0x7faab00090f0).stop 2023-10-01T07:52:10.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.701+0000 7faacdbe2700 1 -- 172.21.15.26:0/3213133173 shutdown_connections 2023-10-01T07:52:10.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.701+0000 7faacdbe2700 1 --2- 172.21.15.26:0/3213133173 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faac8059070 0x7faac8127890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:10.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.701+0000 7faacdbe2700 1 --2- 172.21.15.26:0/3213133173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac8127390 0x7faac8127d80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:10.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.701+0000 7faacdbe2700 1 -- 172.21.15.26:0/3213133173 >> 172.21.15.26:0/3213133173 conn(0x7faac8097470 msgr2=0x7faac8097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:10.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.701+0000 7faacdbe2700 1 -- 172.21.15.26:0/3213133173 shutdown_connections 2023-10-01T07:52:10.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.701+0000 7faacdbe2700 1 -- 172.21.15.26:0/3213133173 wait complete. 2023-10-01T07:52:10.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.702+0000 7faacdbe2700 1 Processor -- start 2023-10-01T07:52:10.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.702+0000 7faacdbe2700 1 -- start start 2023-10-01T07:52:10.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.703+0000 7faacdbe2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac8059070 0x7faac8124950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:10.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.703+0000 7faacdbe2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faac8095370 0x7faac8113880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:10.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.703+0000 7faacdbe2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faac8127390 0x7faac8113d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:10.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.703+0000 7faacdbe2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac8117320 con 0x7faac8059070 2023-10-01T07:52:10.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.703+0000 7faacdbe2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac81254a0 con 0x7faac8095370 2023-10-01T07:52:10.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.703+0000 7faacdbe2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faac8116d80 con 0x7faac8127390 2023-10-01T07:52:10.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.703+0000 7faac77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac8059070 0x7faac8124950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:10.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.703+0000 7faac7fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faac8127390 0x7faac8113d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:10.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.703+0000 7faac77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac8059070 0x7faac8124950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34516/0 (socket says 172.21.15.26:34516) 2023-10-01T07:52:10.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.703+0000 7faabeffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faac8095370 0x7faac8113880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:10.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.703+0000 7faac77fe700 1 -- 172.21.15.26:0/2423555334 learned_addr learned my addr 172.21.15.26:0/2423555334 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:10.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.703+0000 7faac77fe700 1 -- 172.21.15.26:0/2423555334 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faac8127390 msgr2=0x7faac8113d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:10.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.703+0000 7faac77fe700 1 --2- 172.21.15.26:0/2423555334 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faac8127390 0x7faac8113d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:10.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.703+0000 7faac77fe700 1 -- 172.21.15.26:0/2423555334 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faac8095370 msgr2=0x7faac8113880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:10.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.703+0000 7faac77fe700 1 --2- 172.21.15.26:0/2423555334 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faac8095370 0x7faac8113880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:10.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.703+0000 7faac77fe700 1 -- 172.21.15.26:0/2423555334 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab80092a0 con 0x7faac8059070 2023-10-01T07:52:10.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.703+0000 7faac77fe700 1 --2- 172.21.15.26:0/2423555334 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac8059070 0x7faac8124950 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7faab800ea20 tx=0x7faab8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:10.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.704+0000 7faabffff700 1 -- 172.21.15.26:0/2423555334 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab800ee60 con 0x7faac8059070 2023-10-01T07:52:10.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.704+0000 7faabffff700 1 -- 172.21.15.26:0/2423555334 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab800c850 con 0x7faac8059070 2023-10-01T07:52:10.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.704+0000 7faacdbe2700 1 -- 172.21.15.26:0/2423555334 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faab0009370 con 0x7faac8059070 2023-10-01T07:52:10.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.704+0000 7faabffff700 1 -- 172.21.15.26:0/2423555334 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab800cbd0 con 0x7faac8059070 2023-10-01T07:52:10.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.704+0000 7faacdbe2700 1 -- 172.21.15.26:0/2423555334 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac8117a00 con 0x7faac8059070 2023-10-01T07:52:10.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.704+0000 7faabffff700 1 -- 172.21.15.26:0/2423555334 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7faab801b400 con 0x7faac8059070 2023-10-01T07:52:10.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.705+0000 7faabffff700 1 -- 172.21.15.26:0/2423555334 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7faab803b510 con 0x7faac8059070 2023-10-01T07:52:10.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.705+0000 7faacdbe2700 1 -- 172.21.15.26:0/2423555334 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac805a260 con 0x7faac8059070 2023-10-01T07:52:10.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.710+0000 7faabffff700 1 -- 172.21.15.26:0/2423555334 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7faab8019900 con 0x7faac8059070 2023-10-01T07:52:10.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.885+0000 7faacdbe2700 1 -- 172.21.15.26:0/2423555334 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faac8046c20 con 0x7faac8059070 2023-10-01T07:52:10.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.886+0000 7faabffff700 1 -- 172.21.15.26:0/2423555334 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11341 (secure 0 0 0) 0x7faab802a090 con 0x7faac8059070 2023-10-01T07:52:10.886 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:52:10.886 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":17,"fsid":"c29fb19d-520c-42a6-90f4-e7f86de96e8e","created":"2023-10-01T07:51:40.702414+0000","modified":"2023-10-01T07:51:58.296715+0000","last_up_change":"2023-10-01T07:51:48.849482+0000","last_in_change":"2023-10-01T07:51:42.084736+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-01T07:51:48.906889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-01T07:51:50.071599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-01T07:51:54.981575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-01T07:51:56.286318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46569ce3-81d1-44a1-a649-691de3e6f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6800","nonce":118773}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6801","nonce":118773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6803","nonce":118773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6802","nonce":118773}]},"public_addr":"172.21.15.26:6800/118773","cluster_addr":"172.21.15.26:6801/118773","heartbeat_back_addr":"172.21.15.26:6803/118773","heartbeat_front_addr":"172.21.15.26:6802/118773","state":["exists","up"]},{"osd":1,"uuid":"1fc1ba9b-4110-4d31-96d6-794937578cff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6804","nonce":118782}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6806","nonce":118782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6810","nonce":118782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6808","nonce":118782}]},"public_addr":"172.21.15.26:6804/118782","cluster_addr":"172.21.15.26:6806/118782","heartbeat_back_addr":"172.21.15.26:6810/118782","heartbeat_front_addr":"172.21.15.26:6808/118782","state":["exists","up"]},{"osd":2,"uuid":"37de933d-3b8e-4b94-87bd-2f36896c7ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6805","nonce":118789}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6807","nonce":118789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6811","nonce":118789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6809","nonce":118789}]},"public_addr":"172.21.15.26:6805/118789","cluster_addr":"172.21.15.26:6807/118789","heartbeat_back_addr":"172.21.15.26:6811/118789","heartbeat_front_addr":"172.21.15.26:6809/118789","state":["exists","up"]},{"osd":3,"uuid":"bd020309-5fd2-4d97-b36a-67e159fa3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6812","nonce":118790}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6813","nonce":118790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6815","nonce":118790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6814","nonce":118790}]},"public_addr":"172.21.15.26:6812/118790","cluster_addr":"172.21.15.26:6813/118790","heartbeat_back_addr":"172.21.15.26:6815/118790","heartbeat_front_addr":"172.21.15.26:6814/118790","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.029993+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.266503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.273540+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.229731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-01T07:52:10.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.887+0000 7faacdbe2700 1 -- 172.21.15.26:0/2423555334 >> v1:172.21.15.26:6816/118178 conn(0x7faaa802bb60 legacy=0x7faaa802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:10.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.887+0000 7faacdbe2700 1 -- 172.21.15.26:0/2423555334 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac8059070 msgr2=0x7faac8124950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:10.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.887+0000 7faacdbe2700 1 --2- 172.21.15.26:0/2423555334 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac8059070 0x7faac8124950 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7faab800ea20 tx=0x7faab8009060).stop 2023-10-01T07:52:10.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.888+0000 7faacdbe2700 1 -- 172.21.15.26:0/2423555334 shutdown_connections 2023-10-01T07:52:10.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.888+0000 7faacdbe2700 1 --2- 172.21.15.26:0/2423555334 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faac8127390 0x7faac8113d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:10.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.888+0000 7faacdbe2700 1 --2- 172.21.15.26:0/2423555334 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac8059070 0x7faac8124950 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:10.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.888+0000 7faacdbe2700 1 --2- 172.21.15.26:0/2423555334 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faac8095370 0x7faac8113880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:10.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.888+0000 7faacdbe2700 1 -- 172.21.15.26:0/2423555334 >> 172.21.15.26:0/2423555334 conn(0x7faac8097470 msgr2=0x7faac8094230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:10.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.888+0000 7faacdbe2700 1 -- 172.21.15.26:0/2423555334 shutdown_connections 2023-10-01T07:52:10.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:10.888+0000 7faacdbe2700 1 -- 172.21.15.26:0/2423555334 wait complete. 2023-10-01T07:52:10.902 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-01T07:51:48.906889+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-01T07:51:50.071599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-01T07:51:54.981575+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-01T07:51:56.286318+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-01T07:52:10.902 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-01T07:52:11.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.034+0000 7ff9523e1700 1 Processor -- start 2023-10-01T07:52:11.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.034+0000 7ff9523e1700 1 -- start start 2023-10-01T07:52:11.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.035+0000 7ff9523e1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94c0926d0 0x7ff94c1275c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:11.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.035+0000 7ff9523e1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff94c127be0 0x7ff94c128000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:11.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.035+0000 7ff9523e1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff94c12a9a0 0x7ff94c12ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:11.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.035+0000 7ff9523e1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff94c099dd0 con 0x7ff94c127be0 2023-10-01T07:52:11.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.035+0000 7ff9523e1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c091c80 con 0x7ff94c0926d0 2023-10-01T07:52:11.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.035+0000 7ff9523e1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c0999d0 con 0x7ff94c12a9a0 2023-10-01T07:52:11.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.035+0000 7ff95097e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff94c12a9a0 0x7ff94c12ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:11.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.035+0000 7ff94b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff94c127be0 0x7ff94c128000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:11.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.035+0000 7ff94bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94c0926d0 0x7ff94c1275c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:11.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.035+0000 7ff94b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff94c127be0 0x7ff94c128000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34522/0 (socket says 172.21.15.26:34522) 2023-10-01T07:52:11.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.035+0000 7ff95097e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff94c12a9a0 0x7ff94c12ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57732/0 (socket says 172.21.15.26:57732) 2023-10-01T07:52:11.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.035+0000 7ff94b7fe700 1 -- 172.21.15.26:0/3303801317 learned_addr learned my addr 172.21.15.26:0/3303801317 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:11.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.035+0000 7ff94bfff700 1 -- 172.21.15.26:0/3303801317 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff94c12a9a0 msgr2=0x7ff94c12ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:11.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.035+0000 7ff94bfff700 1 --2- 172.21.15.26:0/3303801317 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff94c12a9a0 0x7ff94c12ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:11.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.035+0000 7ff94bfff700 1 -- 172.21.15.26:0/3303801317 >> v2:172.21.15.26:3300/0 conn(0x7ff94c127be0 msgr2=0x7ff94c128000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:11.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.035+0000 7ff94bfff700 1 --2- 172.21.15.26:0/3303801317 >> v2:172.21.15.26:3300/0 conn(0x7ff94c127be0 0x7ff94c128000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:11.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.035+0000 7ff94bfff700 1 -- 172.21.15.26:0/3303801317 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94c09a280 con 0x7ff94c0926d0 2023-10-01T07:52:11.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.035+0000 7ff94b7fe700 1 --2- 172.21.15.26:0/3303801317 >> v2:172.21.15.26:3300/0 conn(0x7ff94c127be0 0x7ff94c128000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:11.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.035+0000 7ff94bfff700 1 --2- 172.21.15.26:0/3303801317 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94c0926d0 0x7ff94c1275c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7ff93c009760 tx=0x7ff93c009060).ready entity=mon.1 client_cookie=8f673af24703803d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:11.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.036+0000 7ff94affd700 1 -- 172.21.15.26:0/3303801317 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c00d4a0 con 0x7ff94c0926d0 2023-10-01T07:52:11.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.036+0000 7ff94affd700 1 -- 172.21.15.26:0/3303801317 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93c00d600 con 0x7ff94c0926d0 2023-10-01T07:52:11.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.036+0000 7ff94affd700 1 -- 172.21.15.26:0/3303801317 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c00d980 con 0x7ff94c0926d0 2023-10-01T07:52:11.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.036+0000 7ff9523e1700 1 -- 172.21.15.26:0/3303801317 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94c0926d0 msgr2=0x7ff94c1275c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:11.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.036+0000 7ff9523e1700 1 --2- 172.21.15.26:0/3303801317 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94c0926d0 0x7ff94c1275c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7ff93c009760 tx=0x7ff93c009060).stop 2023-10-01T07:52:11.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.036+0000 7ff9523e1700 1 -- 172.21.15.26:0/3303801317 shutdown_connections 2023-10-01T07:52:11.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.036+0000 7ff9523e1700 1 --2- 172.21.15.26:0/3303801317 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff94c12a9a0 0x7ff94c12ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:11.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.036+0000 7ff9523e1700 1 --2- 172.21.15.26:0/3303801317 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94c0926d0 0x7ff94c1275c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:11.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.036+0000 7ff9523e1700 1 --2- 172.21.15.26:0/3303801317 >> v2:172.21.15.26:3300/0 conn(0x7ff94c127be0 0x7ff94c128000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:11.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.036+0000 7ff9523e1700 1 -- 172.21.15.26:0/3303801317 >> 172.21.15.26:0/3303801317 conn(0x7ff94c097480 msgr2=0x7ff94c097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:11.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.036+0000 7ff9523e1700 1 -- 172.21.15.26:0/3303801317 shutdown_connections 2023-10-01T07:52:11.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.036+0000 7ff9523e1700 1 -- 172.21.15.26:0/3303801317 wait complete. 2023-10-01T07:52:11.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.037+0000 7ff9523e1700 1 Processor -- start 2023-10-01T07:52:11.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.037+0000 7ff9523e1700 1 -- start start 2023-10-01T07:52:11.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.038+0000 7ff9523e1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94c0926d0 0x7ff94c117a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:11.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.038+0000 7ff9523e1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff94c127be0 0x7ff94c113a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:11.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.038+0000 7ff9523e1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff94c12a9a0 0x7ff94c113f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:11.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.038+0000 7ff9523e1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c124ff0 con 0x7ff94c127be0 2023-10-01T07:52:11.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.038+0000 7ff9523e1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c09a4b0 con 0x7ff94c0926d0 2023-10-01T07:52:11.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.038+0000 7ff9523e1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c124b40 con 0x7ff94c12a9a0 2023-10-01T07:52:11.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.038+0000 7ff94bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94c0926d0 0x7ff94c117a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:11.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.038+0000 7ff94bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94c0926d0 0x7ff94c117a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55488/0 (socket says 172.21.15.26:55488) 2023-10-01T07:52:11.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.038+0000 7ff94bfff700 1 -- 172.21.15.26:0/2194053124 learned_addr learned my addr 172.21.15.26:0/2194053124 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:11.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.038+0000 7ff95097e700 1 --2- 172.21.15.26:0/2194053124 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff94c12a9a0 0x7ff94c113f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:11.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.038+0000 7ff94b7fe700 1 --2- 172.21.15.26:0/2194053124 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff94c127be0 0x7ff94c113a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:11.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.038+0000 7ff94bfff700 1 -- 172.21.15.26:0/2194053124 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff94c12a9a0 msgr2=0x7ff94c113f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:11.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.038+0000 7ff94bfff700 1 --2- 172.21.15.26:0/2194053124 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff94c12a9a0 0x7ff94c113f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:11.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.038+0000 7ff94bfff700 1 -- 172.21.15.26:0/2194053124 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff94c127be0 msgr2=0x7ff94c113a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:11.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.038+0000 7ff94bfff700 1 --2- 172.21.15.26:0/2194053124 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff94c127be0 0x7ff94c113a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:11.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.038+0000 7ff94bfff700 1 -- 172.21.15.26:0/2194053124 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff934009370 con 0x7ff94c0926d0 2023-10-01T07:52:11.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.038+0000 7ff94bfff700 1 --2- 172.21.15.26:0/2194053124 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94c0926d0 0x7ff94c117a10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7ff93c002fd0 tx=0x7ff93c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:11.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.039+0000 7ff943fff700 1 -- 172.21.15.26:0/2194053124 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c00dcf0 con 0x7ff94c0926d0 2023-10-01T07:52:11.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.039+0000 7ff943fff700 1 -- 172.21.15.26:0/2194053124 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93c00de50 con 0x7ff94c0926d0 2023-10-01T07:52:11.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.039+0000 7ff9523e1700 1 -- 172.21.15.26:0/2194053124 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff93c0092a0 con 0x7ff94c0926d0 2023-10-01T07:52:11.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.039+0000 7ff943fff700 1 -- 172.21.15.26:0/2194053124 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c00d980 con 0x7ff94c0926d0 2023-10-01T07:52:11.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.039+0000 7ff9523e1700 1 -- 172.21.15.26:0/2194053124 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94c114e30 con 0x7ff94c0926d0 2023-10-01T07:52:11.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.039+0000 7ff943fff700 1 -- 172.21.15.26:0/2194053124 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7ff93c01d640 con 0x7ff94c0926d0 2023-10-01T07:52:11.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.040+0000 7ff943fff700 1 -- 172.21.15.26:0/2194053124 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7ff93c03c5f0 con 0x7ff94c0926d0 2023-10-01T07:52:11.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.040+0000 7ff9523e1700 1 -- 172.21.15.26:0/2194053124 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff94c05a260 con 0x7ff94c0926d0 2023-10-01T07:52:11.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.044+0000 7ff943fff700 1 -- 172.21.15.26:0/2194053124 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7ff93c01d8f0 con 0x7ff94c0926d0 2023-10-01T07:52:11.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.216+0000 7ff9523e1700 1 -- 172.21.15.26:0/2194053124 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff94c059c20 con 0x7ff94c0926d0 2023-10-01T07:52:11.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.216+0000 7ff943fff700 1 -- 172.21.15.26:0/2194053124 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff93c018350 con 0x7ff94c0926d0 2023-10-01T07:52:11.218 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-01T07:52:11.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.218+0000 7ff9523e1700 1 -- 172.21.15.26:0/2194053124 >> v1:172.21.15.26:6816/118178 conn(0x7ff92c02bb60 legacy=0x7ff92c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:11.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.218+0000 7ff9523e1700 1 -- 172.21.15.26:0/2194053124 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94c0926d0 msgr2=0x7ff94c117a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:11.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.218+0000 7ff9523e1700 1 --2- 172.21.15.26:0/2194053124 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94c0926d0 0x7ff94c117a10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7ff93c002fd0 tx=0x7ff93c016000).stop 2023-10-01T07:52:11.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.218+0000 7ff9523e1700 1 -- 172.21.15.26:0/2194053124 shutdown_connections 2023-10-01T07:52:11.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.218+0000 7ff9523e1700 1 --2- 172.21.15.26:0/2194053124 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff94c12a9a0 0x7ff94c113f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:11.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.218+0000 7ff9523e1700 1 --2- 172.21.15.26:0/2194053124 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94c0926d0 0x7ff94c117a10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:11.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.218+0000 7ff9523e1700 1 --2- 172.21.15.26:0/2194053124 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff94c127be0 0x7ff94c113a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:11.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.218+0000 7ff9523e1700 1 -- 172.21.15.26:0/2194053124 >> 172.21.15.26:0/2194053124 conn(0x7ff94c097480 msgr2=0x7ff94c096030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:11.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.219+0000 7ff9523e1700 1 -- 172.21.15.26:0/2194053124 shutdown_connections 2023-10-01T07:52:11.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.219+0000 7ff9523e1700 1 -- 172.21.15.26:0/2194053124 wait complete. 2023-10-01T07:52:11.232 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-01T07:52:11.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.365+0000 7f92cece4700 1 Processor -- start 2023-10-01T07:52:11.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.365+0000 7f92cece4700 1 -- start start 2023-10-01T07:52:11.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.365+0000 7f92cece4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92c8125f00 0x7f92c812db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:11.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.365+0000 7f92cece4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f92c81252b0 0x7f92c8130040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:11.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.366+0000 7f92cece4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c8098790 con 0x7f92c806a520 2023-10-01T07:52:11.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.366+0000 7f92cece4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c806a900 con 0x7f92c81252b0 2023-10-01T07:52:11.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.366+0000 7f92cece4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92c80996f0 con 0x7f92c8125f00 2023-10-01T07:52:11.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.366+0000 7f92cd281700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f92c81252b0 0x7f92c8130040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:11.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.366+0000 7f92c7fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92c8125f00 0x7f92c812db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:11.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.366+0000 7f92cd281700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f92c81252b0 0x7f92c8130040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34550/0 (socket says 172.21.15.26:34550) 2023-10-01T07:52:11.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.366+0000 7f92c7fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92c8125f00 0x7f92c812db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57748/0 (socket says 172.21.15.26:57748) 2023-10-01T07:52:11.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.366+0000 7f92cd281700 1 -- 172.21.15.26:0/3962353795 learned_addr learned my addr 172.21.15.26:0/3962353795 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:11.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.366+0000 7f92cca80700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f92c806a520 0x7f92c81257f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:40560/0 (socket says 172.21.15.26:40560) 2023-10-01T07:52:11.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.366+0000 7f92c7fff700 1 -- 172.21.15.26:0/3962353795 >> v2:172.21.15.26:3300/0 conn(0x7f92c81252b0 msgr2=0x7f92c8130040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:11.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.366+0000 7f92c7fff700 1 --2- 172.21.15.26:0/3962353795 >> v2:172.21.15.26:3300/0 conn(0x7f92c81252b0 0x7f92c8130040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:11.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.366+0000 7f92c7fff700 1 -- 172.21.15.26:0/3962353795 >> v1:172.21.15.26:6789/0 conn(0x7f92c806a520 legacy=0x7f92c81257f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:11.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.366+0000 7f92c7fff700 1 -- 172.21.15.26:0/3962353795 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c8059d70 con 0x7f92c8125f00 2023-10-01T07:52:11.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.366+0000 7f92c77fe700 1 -- 172.21.15.26:0/3962353795 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3508533497 0 0) 0x7f92c8098790 con 0x7f92c806a520 2023-10-01T07:52:11.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.366+0000 7f92cd281700 1 --2- 172.21.15.26:0/3962353795 >> v2:172.21.15.26:3300/0 conn(0x7f92c81252b0 0x7f92c8130040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:11.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.366+0000 7f92c7fff700 1 --2- 172.21.15.26:0/3962353795 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92c8125f00 0x7f92c812db40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f92b0009760 tx=0x7f92b0009060).ready entity=mon.2 client_cookie=d9618e49c2066edc server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:11.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.366+0000 7f92c77fe700 1 -- 172.21.15.26:0/3962353795 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b00090d0 con 0x7f92c8125f00 2023-10-01T07:52:11.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.366+0000 7f92c77fe700 1 -- 172.21.15.26:0/3962353795 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b000f510 con 0x7f92c8125f00 2023-10-01T07:52:11.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.366+0000 7f92c77fe700 1 -- 172.21.15.26:0/3962353795 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b000f890 con 0x7f92c8125f00 2023-10-01T07:52:11.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.367+0000 7f92cece4700 1 -- 172.21.15.26:0/3962353795 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92c8125f00 msgr2=0x7f92c812db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:11.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.367+0000 7f92cece4700 1 --2- 172.21.15.26:0/3962353795 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92c8125f00 0x7f92c812db40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f92b0009760 tx=0x7f92b0009060).stop 2023-10-01T07:52:11.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.367+0000 7f92cece4700 1 -- 172.21.15.26:0/3962353795 shutdown_connections 2023-10-01T07:52:11.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.367+0000 7f92cece4700 1 --2- 172.21.15.26:0/3962353795 >> v2:172.21.15.26:3300/0 conn(0x7f92c81252b0 0x7f92c8130040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:11.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.367+0000 7f92cece4700 1 --2- 172.21.15.26:0/3962353795 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92c8125f00 0x7f92c812db40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:11.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.367+0000 7f92cece4700 1 -- 172.21.15.26:0/3962353795 >> 172.21.15.26:0/3962353795 conn(0x7f92c8097480 msgr2=0x7f92c8097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:11.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.367+0000 7f92cece4700 1 -- 172.21.15.26:0/3962353795 shutdown_connections 2023-10-01T07:52:11.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.367+0000 7f92cece4700 1 -- 172.21.15.26:0/3962353795 wait complete. 2023-10-01T07:52:11.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.368+0000 7f92cece4700 1 Processor -- start 2023-10-01T07:52:11.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.368+0000 7f92cece4700 1 -- start start 2023-10-01T07:52:11.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.369+0000 7f92cece4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92c806a520 0x7f92c812dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:11.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.369+0000 7f92cece4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92c81252b0 0x7f92c812e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:11.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.369+0000 7f92cece4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92c8125f00 0x7f92c812e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:11.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.369+0000 7f92cece4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c81112d0 con 0x7f92c806a520 2023-10-01T07:52:11.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.369+0000 7f92cece4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c8092fb0 con 0x7f92c8125f00 2023-10-01T07:52:11.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.369+0000 7f92cece4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92c812ffc0 con 0x7f92c81252b0 2023-10-01T07:52:11.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.369+0000 7f92cca80700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92c806a520 0x7f92c812dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:11.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.369+0000 7f92c7fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92c81252b0 0x7f92c812e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:11.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.369+0000 7f92cca80700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92c806a520 0x7f92c812dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34564/0 (socket says 172.21.15.26:34564) 2023-10-01T07:52:11.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.369+0000 7f92cca80700 1 -- 172.21.15.26:0/1834861090 learned_addr learned my addr 172.21.15.26:0/1834861090 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:11.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.369+0000 7f92cd281700 1 --2- 172.21.15.26:0/1834861090 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92c8125f00 0x7f92c812e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:11.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.369+0000 7f92cd281700 1 -- 172.21.15.26:0/1834861090 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92c81252b0 msgr2=0x7f92c812e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:11.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.369+0000 7f92cd281700 1 --2- 172.21.15.26:0/1834861090 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92c81252b0 0x7f92c812e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:11.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.369+0000 7f92cd281700 1 -- 172.21.15.26:0/1834861090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92c806a520 msgr2=0x7f92c812dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:11.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.369+0000 7f92cd281700 1 --2- 172.21.15.26:0/1834861090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92c806a520 0x7f92c812dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:11.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.369+0000 7f92cd281700 1 -- 172.21.15.26:0/1834861090 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c0009ae0 con 0x7f92c8125f00 2023-10-01T07:52:11.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.369+0000 7f92c7fff700 1 --2- 172.21.15.26:0/1834861090 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92c81252b0 0x7f92c812e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:11.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.369+0000 7f92cca80700 1 --2- 172.21.15.26:0/1834861090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92c806a520 0x7f92c812dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:11.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.369+0000 7f92cd281700 1 --2- 172.21.15.26:0/1834861090 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92c8125f00 0x7f92c812e9b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f92c0009f10 tx=0x7f92c000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:11.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.369+0000 7f92c4ff9700 1 -- 172.21.15.26:0/1834861090 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c00092e0 con 0x7f92c8125f00 2023-10-01T07:52:11.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.370+0000 7f92c4ff9700 1 -- 172.21.15.26:0/1834861090 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c000f040 con 0x7f92c8125f00 2023-10-01T07:52:11.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.370+0000 7f92cece4700 1 -- 172.21.15.26:0/1834861090 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92b00092a0 con 0x7f92c8125f00 2023-10-01T07:52:11.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.370+0000 7f92c4ff9700 1 -- 172.21.15.26:0/1834861090 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c000cb70 con 0x7f92c8125f00 2023-10-01T07:52:11.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.370+0000 7f92cece4700 1 -- 172.21.15.26:0/1834861090 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c812fa80 con 0x7f92c8125f00 2023-10-01T07:52:11.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.371+0000 7f92c4ff9700 1 -- 172.21.15.26:0/1834861090 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f92c0014460 con 0x7f92c8125f00 2023-10-01T07:52:11.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.371+0000 7f92cece4700 1 -- 172.21.15.26:0/1834861090 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c80934b0 con 0x7f92c8125f00 2023-10-01T07:52:11.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.371+0000 7f92c4ff9700 1 -- 172.21.15.26:0/1834861090 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f92c003aef0 con 0x7f92c8125f00 2023-10-01T07:52:11.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.375+0000 7f92c4ff9700 1 -- 172.21.15.26:0/1834861090 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f92c0012770 con 0x7f92c8125f00 2023-10-01T07:52:11.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.549+0000 7f92cece4700 1 -- 172.21.15.26:0/1834861090 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f92c805a260 con 0x7f92c8125f00 2023-10-01T07:52:11.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.550+0000 7f92c4ff9700 1 -- 172.21.15.26:0/1834861090 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f92c001c360 con 0x7f92c8125f00 2023-10-01T07:52:11.550 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 8 2023-10-01T07:52:11.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.552+0000 7f92cece4700 1 -- 172.21.15.26:0/1834861090 >> v1:172.21.15.26:6816/118178 conn(0x7f92a802bb60 legacy=0x7f92a802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:11.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.552+0000 7f92cece4700 1 -- 172.21.15.26:0/1834861090 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92c8125f00 msgr2=0x7f92c812e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:11.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.552+0000 7f92cece4700 1 --2- 172.21.15.26:0/1834861090 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92c8125f00 0x7f92c812e9b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f92c0009f10 tx=0x7f92c000b040).stop 2023-10-01T07:52:11.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.552+0000 7f92cece4700 1 -- 172.21.15.26:0/1834861090 shutdown_connections 2023-10-01T07:52:11.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.552+0000 7f92cece4700 1 --2- 172.21.15.26:0/1834861090 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92c8125f00 0x7f92c812e9b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:11.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.552+0000 7f92cece4700 1 --2- 172.21.15.26:0/1834861090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92c806a520 0x7f92c812dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:11.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.552+0000 7f92cece4700 1 --2- 172.21.15.26:0/1834861090 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92c81252b0 0x7f92c812e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:11.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.552+0000 7f92cece4700 1 -- 172.21.15.26:0/1834861090 >> 172.21.15.26:0/1834861090 conn(0x7f92c8097480 msgr2=0x7f92c81241f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:11.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.552+0000 7f92cece4700 1 -- 172.21.15.26:0/1834861090 shutdown_connections 2023-10-01T07:52:11.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.552+0000 7f92cece4700 1 -- 172.21.15.26:0/1834861090 wait complete. 2023-10-01T07:52:11.565 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-01T07:52:11.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.699+0000 7fd4322e3700 1 Processor -- start 2023-10-01T07:52:11.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.699+0000 7fd4322e3700 1 -- start start 2023-10-01T07:52:11.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.700+0000 7fd4322e3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd42c098740 0x7fd42c098b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:11.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.700+0000 7fd4322e3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd42c099010 0x7fd42c068d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:11.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.700+0000 7fd4322e3700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd42c095270 con 0x7fd42c069210 2023-10-01T07:52:11.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.700+0000 7fd4322e3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd42c094d20 con 0x7fd42c099010 2023-10-01T07:52:11.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.700+0000 7fd4322e3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c096520 con 0x7fd42c098740 2023-10-01T07:52:11.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.700+0000 7fd42bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd42c098740 0x7fd42c098b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:11.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.700+0000 7fd42b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd42c099010 0x7fd42c068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:11.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.700+0000 7fd430880700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd42c069210 0x7fd42c12fbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:40562/0 (socket says 172.21.15.26:40562) 2023-10-01T07:52:11.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.700+0000 7fd430880700 1 -- 172.21.15.26:0/1031048458 learned_addr learned my addr 172.21.15.26:0/1031048458 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:52:11.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.701+0000 7fd42affd700 1 -- 172.21.15.26:0/1031048458 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2809552973 0 0) 0x7fd42c095270 con 0x7fd42c069210 2023-10-01T07:52:11.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.701+0000 7fd42affd700 1 -- 172.21.15.26:0/1031048458 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4140033f0 con 0x7fd42c069210 2023-10-01T07:52:11.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.701+0000 7fd42b7fe700 1 -- 172.21.15.26:0/1031048458 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd42c098740 msgr2=0x7fd42c098b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:11.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.701+0000 7fd42b7fe700 1 --2- 172.21.15.26:0/1031048458 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd42c098740 0x7fd42c098b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:11.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.701+0000 7fd42b7fe700 1 -- 172.21.15.26:0/1031048458 >> v1:172.21.15.26:6789/0 conn(0x7fd42c069210 legacy=0x7fd42c12fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:11.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.701+0000 7fd42b7fe700 1 -- 172.21.15.26:0/1031048458 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42c094870 con 0x7fd42c099010 2023-10-01T07:52:11.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.701+0000 7fd42bfff700 1 --2- 172.21.15.26:0/1031048458 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd42c098740 0x7fd42c098b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:11.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.701+0000 7fd42b7fe700 1 --2- 172.21.15.26:0/1031048458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd42c099010 0x7fd42c068d20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fd420009760 tx=0x7fd420009060).ready entity=mon.0 client_cookie=5a099b04f11c44c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:11.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.701+0000 7fd42affd700 1 -- 172.21.15.26:0/1031048458 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4200090d0 con 0x7fd42c099010 2023-10-01T07:52:11.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.701+0000 7fd42affd700 1 -- 172.21.15.26:0/1031048458 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42000d4a0 con 0x7fd42c099010 2023-10-01T07:52:11.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.701+0000 7fd42affd700 1 -- 172.21.15.26:0/1031048458 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42000d820 con 0x7fd42c099010 2023-10-01T07:52:11.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.702+0000 7fd4322e3700 1 -- 172.21.15.26:0/1031048458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd42c099010 msgr2=0x7fd42c068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:11.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.702+0000 7fd4322e3700 1 --2- 172.21.15.26:0/1031048458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd42c099010 0x7fd42c068d20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fd420009760 tx=0x7fd420009060).stop 2023-10-01T07:52:11.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.702+0000 7fd4322e3700 1 -- 172.21.15.26:0/1031048458 shutdown_connections 2023-10-01T07:52:11.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.702+0000 7fd4322e3700 1 --2- 172.21.15.26:0/1031048458 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd42c098740 0x7fd42c098b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:11.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.702+0000 7fd4322e3700 1 --2- 172.21.15.26:0/1031048458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd42c099010 0x7fd42c068d20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:11.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.702+0000 7fd4322e3700 1 -- 172.21.15.26:0/1031048458 >> 172.21.15.26:0/1031048458 conn(0x7fd42c09a1c0 msgr2=0x7fd42c09a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:11.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.702+0000 7fd4322e3700 1 -- 172.21.15.26:0/1031048458 shutdown_connections 2023-10-01T07:52:11.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.702+0000 7fd4322e3700 1 -- 172.21.15.26:0/1031048458 wait complete. 2023-10-01T07:52:11.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.703+0000 7fd4322e3700 1 Processor -- start 2023-10-01T07:52:11.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.703+0000 7fd4322e3700 1 -- start start 2023-10-01T07:52:11.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.703+0000 7fd4322e3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd42c069210 0x7fd42c1361b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:11.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.703+0000 7fd4322e3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd42c098740 0x7fd42c1366a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:11.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.703+0000 7fd4322e3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd42c099010 0x7fd42c115da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:11.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.703+0000 7fd4322e3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c1198f0 con 0x7fd42c099010 2023-10-01T07:52:11.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.703+0000 7fd4322e3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c098270 con 0x7fd42c098740 2023-10-01T07:52:11.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.703+0000 7fd4322e3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c094f70 con 0x7fd42c069210 2023-10-01T07:52:11.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.703+0000 7fd42bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd42c069210 0x7fd42c1361b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:11.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.703+0000 7fd430880700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd42c099010 0x7fd42c115da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:11.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.703+0000 7fd42b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd42c098740 0x7fd42c1366a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:11.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.703+0000 7fd42bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd42c069210 0x7fd42c1361b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57760/0 (socket says 172.21.15.26:57760) 2023-10-01T07:52:11.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.703+0000 7fd42b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd42c098740 0x7fd42c1366a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55508/0 (socket says 172.21.15.26:55508) 2023-10-01T07:52:11.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.703+0000 7fd42bfff700 1 -- 172.21.15.26:0/2024864052 learned_addr learned my addr 172.21.15.26:0/2024864052 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:11.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.704+0000 7fd430880700 1 -- 172.21.15.26:0/2024864052 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd42c069210 msgr2=0x7fd42c1361b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:11.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.704+0000 7fd430880700 1 --2- 172.21.15.26:0/2024864052 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd42c069210 0x7fd42c1361b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:11.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.704+0000 7fd430880700 1 -- 172.21.15.26:0/2024864052 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd42c098740 msgr2=0x7fd42c1366a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:11.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.704+0000 7fd430880700 1 --2- 172.21.15.26:0/2024864052 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd42c098740 0x7fd42c1366a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:11.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.704+0000 7fd430880700 1 -- 172.21.15.26:0/2024864052 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41c00d740 con 0x7fd42c099010 2023-10-01T07:52:11.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.704+0000 7fd430880700 1 --2- 172.21.15.26:0/2024864052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd42c099010 0x7fd42c115da0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fd42400c790 tx=0x7fd424007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:11.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.704+0000 7fd413fff700 1 -- 172.21.15.26:0/2024864052 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd424005d30 con 0x7fd42c099010 2023-10-01T07:52:11.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.704+0000 7fd413fff700 1 -- 172.21.15.26:0/2024864052 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd424005e90 con 0x7fd42c099010 2023-10-01T07:52:11.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.704+0000 7fd4322e3700 1 -- 172.21.15.26:0/2024864052 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4200092a0 con 0x7fd42c099010 2023-10-01T07:52:11.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.704+0000 7fd413fff700 1 -- 172.21.15.26:0/2024864052 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4240072e0 con 0x7fd42c099010 2023-10-01T07:52:11.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.705+0000 7fd4322e3700 1 -- 172.21.15.26:0/2024864052 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd42c119f60 con 0x7fd42c099010 2023-10-01T07:52:11.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.705+0000 7fd413fff700 1 -- 172.21.15.26:0/2024864052 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fd424007710 con 0x7fd42c099010 2023-10-01T07:52:11.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.705+0000 7fd413fff700 1 -- 172.21.15.26:0/2024864052 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fd42403d220 con 0x7fd42c099010 2023-10-01T07:52:11.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.706+0000 7fd4322e3700 1 -- 172.21.15.26:0/2024864052 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd42c05a260 con 0x7fd42c099010 2023-10-01T07:52:11.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.711+0000 7fd413fff700 1 -- 172.21.15.26:0/2024864052 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fd42400ee60 con 0x7fd42c099010 2023-10-01T07:52:11.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.886+0000 7fd4322e3700 1 -- 172.21.15.26:0/2024864052 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd42c094540 con 0x7fd42c099010 2023-10-01T07:52:11.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.886+0000 7fd413fff700 1 -- 172.21.15.26:0/2024864052 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd424010300 con 0x7fd42c099010 2023-10-01T07:52:11.887 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-01T07:52:11.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.888+0000 7fd4322e3700 1 -- 172.21.15.26:0/2024864052 >> v1:172.21.15.26:6816/118178 conn(0x7fd41802bb90 legacy=0x7fd41802e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:11.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.888+0000 7fd4322e3700 1 -- 172.21.15.26:0/2024864052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd42c099010 msgr2=0x7fd42c115da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:11.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.888+0000 7fd4322e3700 1 --2- 172.21.15.26:0/2024864052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd42c099010 0x7fd42c115da0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fd42400c790 tx=0x7fd424007f10).stop 2023-10-01T07:52:11.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.888+0000 7fd4322e3700 1 -- 172.21.15.26:0/2024864052 shutdown_connections 2023-10-01T07:52:11.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.888+0000 7fd4322e3700 1 --2- 172.21.15.26:0/2024864052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd42c099010 0x7fd42c115da0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:11.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.888+0000 7fd4322e3700 1 --2- 172.21.15.26:0/2024864052 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd42c069210 0x7fd42c1361b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:11.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.888+0000 7fd4322e3700 1 --2- 172.21.15.26:0/2024864052 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd42c098740 0x7fd42c1366a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:11.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.888+0000 7fd4322e3700 1 -- 172.21.15.26:0/2024864052 >> 172.21.15.26:0/2024864052 conn(0x7fd42c09a1c0 msgr2=0x7fd42c067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:11.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.888+0000 7fd4322e3700 1 -- 172.21.15.26:0/2024864052 shutdown_connections 2023-10-01T07:52:11.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:11.888+0000 7fd4322e3700 1 -- 172.21.15.26:0/2024864052 wait complete. 2023-10-01T07:52:11.902 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-01T07:52:12.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.035+0000 7f014f0c1700 1 Processor -- start 2023-10-01T07:52:12.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.035+0000 7f014f0c1700 1 -- start start 2023-10-01T07:52:12.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.036+0000 7f014f0c1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0148059070 0x7f014812ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:12.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.036+0000 7f014f0c1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f014812a9b0 0x7f014812b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:12.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.036+0000 7f014f0c1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0148127400 0x7f0148127890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:12.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.036+0000 7f014f0c1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0148059450 con 0x7f0148059070 2023-10-01T07:52:12.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.036+0000 7f014f0c1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0148091ed0 con 0x7f0148127400 2023-10-01T07:52:12.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.036+0000 7f014f0c1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f014809a770 con 0x7f014812a9b0 2023-10-01T07:52:12.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.036+0000 7f0147fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f014812a9b0 0x7f014812b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:12.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.036+0000 7f014ce5d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0148059070 0x7f014812ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:12.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.036+0000 7f014d65e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0148127400 0x7f0148127890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:12.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.036+0000 7f014ce5d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0148059070 0x7f014812ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34596/0 (socket says 172.21.15.26:34596) 2023-10-01T07:52:12.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.036+0000 7f0147fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f014812a9b0 0x7f014812b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57766/0 (socket says 172.21.15.26:57766) 2023-10-01T07:52:12.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.036+0000 7f014d65e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0148127400 0x7f0148127890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55510/0 (socket says 172.21.15.26:55510) 2023-10-01T07:52:12.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.036+0000 7f014ce5d700 1 -- 172.21.15.26:0/4218106214 learned_addr learned my addr 172.21.15.26:0/4218106214 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:12.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.036+0000 7f014d65e700 1 -- 172.21.15.26:0/4218106214 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f014812a9b0 msgr2=0x7f014812b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:12.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.036+0000 7f014d65e700 1 --2- 172.21.15.26:0/4218106214 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f014812a9b0 0x7f014812b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:12.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.036+0000 7f014d65e700 1 -- 172.21.15.26:0/4218106214 >> v2:172.21.15.26:3300/0 conn(0x7f0148059070 msgr2=0x7f014812ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:12.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.036+0000 7f014d65e700 1 --2- 172.21.15.26:0/4218106214 >> v2:172.21.15.26:3300/0 conn(0x7f0148059070 0x7f014812ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:12.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.036+0000 7f014d65e700 1 -- 172.21.15.26:0/4218106214 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0148091c10 con 0x7f0148127400 2023-10-01T07:52:12.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.036+0000 7f0147fff700 1 --2- 172.21.15.26:0/4218106214 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f014812a9b0 0x7f014812b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:12.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.036+0000 7f014ce5d700 1 --2- 172.21.15.26:0/4218106214 >> v2:172.21.15.26:3300/0 conn(0x7f0148059070 0x7f014812ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:12.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.036+0000 7f014d65e700 1 --2- 172.21.15.26:0/4218106214 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0148127400 0x7f0148127890 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f0140009e90 tx=0x7f0140009780).ready entity=mon.1 client_cookie=26e48adab11e9dda server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:12.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.036+0000 7f01477fe700 1 -- 172.21.15.26:0/4218106214 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014000e070 con 0x7f0148127400 2023-10-01T07:52:12.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.037+0000 7f01477fe700 1 -- 172.21.15.26:0/4218106214 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014000ba70 con 0x7f0148127400 2023-10-01T07:52:12.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.037+0000 7f01477fe700 1 -- 172.21.15.26:0/4218106214 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014000bdf0 con 0x7f0148127400 2023-10-01T07:52:12.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.037+0000 7f014f0c1700 1 -- 172.21.15.26:0/4218106214 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0148127400 msgr2=0x7f0148127890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:12.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.037+0000 7f014f0c1700 1 --2- 172.21.15.26:0/4218106214 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0148127400 0x7f0148127890 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f0140009e90 tx=0x7f0140009780).stop 2023-10-01T07:52:12.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.037+0000 7f014f0c1700 1 -- 172.21.15.26:0/4218106214 shutdown_connections 2023-10-01T07:52:12.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.037+0000 7f014f0c1700 1 --2- 172.21.15.26:0/4218106214 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0148127400 0x7f0148127890 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:12.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.037+0000 7f014f0c1700 1 --2- 172.21.15.26:0/4218106214 >> v2:172.21.15.26:3300/0 conn(0x7f0148059070 0x7f014812ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:12.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.037+0000 7f014f0c1700 1 --2- 172.21.15.26:0/4218106214 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f014812a9b0 0x7f014812b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:12.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.037+0000 7f014f0c1700 1 -- 172.21.15.26:0/4218106214 >> 172.21.15.26:0/4218106214 conn(0x7f0148097480 msgr2=0x7f0148097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:12.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.037+0000 7f014f0c1700 1 -- 172.21.15.26:0/4218106214 shutdown_connections 2023-10-01T07:52:12.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.037+0000 7f014f0c1700 1 -- 172.21.15.26:0/4218106214 wait complete. 2023-10-01T07:52:12.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.038+0000 7f014f0c1700 1 Processor -- start 2023-10-01T07:52:12.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.038+0000 7f014f0c1700 1 -- start start 2023-10-01T07:52:12.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.039+0000 7f014f0c1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0148059070 0x7f0148113930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:12.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.039+0000 7f014f0c1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0148127400 0x7f0148113e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:12.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.039+0000 7f014f0c1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0148114310 0x7f0148114790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:12.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.039+0000 7f014f0c1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0148124a90 con 0x7f0148114310 2023-10-01T07:52:12.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.039+0000 7f014f0c1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014809a460 con 0x7f0148059070 2023-10-01T07:52:12.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.039+0000 7f014f0c1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0148117460 con 0x7f0148127400 2023-10-01T07:52:12.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.039+0000 7f014ce5d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0148059070 0x7f0148113930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:12.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.039+0000 7f014d65e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0148114310 0x7f0148114790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:12.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.039+0000 7f014ce5d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0148059070 0x7f0148113930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55520/0 (socket says 172.21.15.26:55520) 2023-10-01T07:52:12.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.039+0000 7f014d65e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0148114310 0x7f0148114790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34602/0 (socket says 172.21.15.26:34602) 2023-10-01T07:52:12.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.039+0000 7f014ce5d700 1 -- 172.21.15.26:0/1798515837 learned_addr learned my addr 172.21.15.26:0/1798515837 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:12.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.039+0000 7f0147fff700 1 --2- 172.21.15.26:0/1798515837 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0148127400 0x7f0148113e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:12.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.039+0000 7f014ce5d700 1 -- 172.21.15.26:0/1798515837 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0148127400 msgr2=0x7f0148113e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:12.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.039+0000 7f014ce5d700 1 --2- 172.21.15.26:0/1798515837 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0148127400 0x7f0148113e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:12.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.039+0000 7f014ce5d700 1 -- 172.21.15.26:0/1798515837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0148114310 msgr2=0x7f0148114790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:12.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.039+0000 7f014ce5d700 1 --2- 172.21.15.26:0/1798515837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0148114310 0x7f0148114790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:12.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.039+0000 7f014ce5d700 1 -- 172.21.15.26:0/1798515837 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f013c009370 con 0x7f0148059070 2023-10-01T07:52:12.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.039+0000 7f0147fff700 1 --2- 172.21.15.26:0/1798515837 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0148127400 0x7f0148113e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:12.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.039+0000 7f014d65e700 1 --2- 172.21.15.26:0/1798515837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0148114310 0x7f0148114790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:12.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.039+0000 7f014ce5d700 1 --2- 172.21.15.26:0/1798515837 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0148059070 0x7f0148113930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f013c00ea50 tx=0x7f013c0090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:12.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.040+0000 7f0144ff9700 1 -- 172.21.15.26:0/1798515837 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c00ee90 con 0x7f0148059070 2023-10-01T07:52:12.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.040+0000 7f0144ff9700 1 -- 172.21.15.26:0/1798515837 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013c00c850 con 0x7f0148059070 2023-10-01T07:52:12.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.040+0000 7f0144ff9700 1 -- 172.21.15.26:0/1798515837 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c00cbd0 con 0x7f0148059070 2023-10-01T07:52:12.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.040+0000 7f014f0c1700 1 -- 172.21.15.26:0/1798515837 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01340092a0 con 0x7f0148059070 2023-10-01T07:52:12.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.040+0000 7f014f0c1700 1 -- 172.21.15.26:0/1798515837 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0140009a20 con 0x7f0148059070 2023-10-01T07:52:12.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.040+0000 7f0144ff9700 1 -- 172.21.15.26:0/1798515837 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f013c01b400 con 0x7f0148059070 2023-10-01T07:52:12.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.041+0000 7f0144ff9700 1 -- 172.21.15.26:0/1798515837 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f013c03b5f0 con 0x7f0148059070 2023-10-01T07:52:12.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.041+0000 7f014f0c1700 1 -- 172.21.15.26:0/1798515837 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01481170b0 con 0x7f0148059070 2023-10-01T07:52:12.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.045+0000 7f0144ff9700 1 -- 172.21.15.26:0/1798515837 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f013c016070 con 0x7f0148059070 2023-10-01T07:52:12.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.218+0000 7f014f0c1700 1 -- 172.21.15.26:0/1798515837 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f014805a260 con 0x7f0148059070 2023-10-01T07:52:12.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.218+0000 7f0144ff9700 1 -- 172.21.15.26:0/1798515837 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+11 (secure 0 0 0) 0x7f013c016020 con 0x7f0148059070 2023-10-01T07:52:12.219 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-01T07:52:12.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.220+0000 7f014f0c1700 1 -- 172.21.15.26:0/1798515837 >> v1:172.21.15.26:6816/118178 conn(0x7f012c02bb60 legacy=0x7f012c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:12.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.220+0000 7f014f0c1700 1 -- 172.21.15.26:0/1798515837 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0148059070 msgr2=0x7f0148113930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:12.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.220+0000 7f014f0c1700 1 --2- 172.21.15.26:0/1798515837 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0148059070 0x7f0148113930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f013c00ea50 tx=0x7f013c0090f0).stop 2023-10-01T07:52:12.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.220+0000 7f014f0c1700 1 -- 172.21.15.26:0/1798515837 shutdown_connections 2023-10-01T07:52:12.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.220+0000 7f014f0c1700 1 --2- 172.21.15.26:0/1798515837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0148114310 0x7f0148114790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:12.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.220+0000 7f014f0c1700 1 --2- 172.21.15.26:0/1798515837 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0148059070 0x7f0148113930 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:12.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.220+0000 7f014f0c1700 1 --2- 172.21.15.26:0/1798515837 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0148127400 0x7f0148113e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:12.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.220+0000 7f014f0c1700 1 -- 172.21.15.26:0/1798515837 >> 172.21.15.26:0/1798515837 conn(0x7f0148097480 msgr2=0x7f0148093530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:12.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.220+0000 7f014f0c1700 1 -- 172.21.15.26:0/1798515837 shutdown_connections 2023-10-01T07:52:12.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.220+0000 7f014f0c1700 1 -- 172.21.15.26:0/1798515837 wait complete. 2023-10-01T07:52:12.235 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-01T07:52:12.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.364+0000 7fd12daee700 1 Processor -- start 2023-10-01T07:52:12.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.364+0000 7fd12daee700 1 -- start start 2023-10-01T07:52:12.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.364+0000 7fd12daee700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd128127390 0x7fd12812fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:12.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.364+0000 7fd12daee700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd128127fa0 0x7fd128132170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:12.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.364+0000 7fd12daee700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd128096900 con 0x7fd128059070 2023-10-01T07:52:12.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.364+0000 7fd12daee700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd128059c00 con 0x7fd128127390 2023-10-01T07:52:12.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.364+0000 7fd12daee700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd128091b60 con 0x7fd128127fa0 2023-10-01T07:52:12.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.365+0000 7fd126ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd128127390 0x7fd12812fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:12.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.365+0000 7fd127fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd128127fa0 0x7fd128132170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:12.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.365+0000 7fd127fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd128127fa0 0x7fd128132170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55524/0 (socket says 172.21.15.26:55524) 2023-10-01T07:52:12.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.365+0000 7fd1277fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd128059070 0x7fd128127890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:40572/0 (socket says 172.21.15.26:40572) 2023-10-01T07:52:12.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.365+0000 7fd126ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd128127390 0x7fd12812fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34604/0 (socket says 172.21.15.26:34604) 2023-10-01T07:52:12.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.365+0000 7fd127fff700 1 -- 172.21.15.26:0/2522827798 learned_addr learned my addr 172.21.15.26:0/2522827798 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:12.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.365+0000 7fd126ffd700 1 -- 172.21.15.26:0/2522827798 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd128127fa0 msgr2=0x7fd128132170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:12.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.365+0000 7fd126ffd700 1 --2- 172.21.15.26:0/2522827798 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd128127fa0 0x7fd128132170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:12.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.365+0000 7fd126ffd700 1 -- 172.21.15.26:0/2522827798 >> v1:172.21.15.26:6789/0 conn(0x7fd128059070 legacy=0x7fd128127890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:12.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.365+0000 7fd126ffd700 1 -- 172.21.15.26:0/2522827798 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd128092a10 con 0x7fd128127390 2023-10-01T07:52:12.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.365+0000 7fd1267fc700 1 -- 172.21.15.26:0/2522827798 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1703153601 0 0) 0x7fd128096900 con 0x7fd128059070 2023-10-01T07:52:12.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.365+0000 7fd127fff700 1 --2- 172.21.15.26:0/2522827798 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd128127fa0 0x7fd128132170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:12.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.365+0000 7fd126ffd700 1 --2- 172.21.15.26:0/2522827798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd128127390 0x7fd12812fc70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fd110009760 tx=0x7fd110009060).ready entity=mon.0 client_cookie=46ce50840ad82162 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:12.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.365+0000 7fd1267fc700 1 -- 172.21.15.26:0/2522827798 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1100090d0 con 0x7fd128127390 2023-10-01T07:52:12.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.365+0000 7fd1267fc700 1 -- 172.21.15.26:0/2522827798 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11000f510 con 0x7fd128127390 2023-10-01T07:52:12.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.365+0000 7fd1267fc700 1 -- 172.21.15.26:0/2522827798 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11000f890 con 0x7fd128127390 2023-10-01T07:52:12.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.366+0000 7fd12daee700 1 -- 172.21.15.26:0/2522827798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd128127390 msgr2=0x7fd12812fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:12.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.366+0000 7fd12daee700 1 --2- 172.21.15.26:0/2522827798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd128127390 0x7fd12812fc70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fd110009760 tx=0x7fd110009060).stop 2023-10-01T07:52:12.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.366+0000 7fd12daee700 1 -- 172.21.15.26:0/2522827798 shutdown_connections 2023-10-01T07:52:12.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.366+0000 7fd12daee700 1 --2- 172.21.15.26:0/2522827798 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd128127fa0 0x7fd128132170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:12.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.366+0000 7fd12daee700 1 --2- 172.21.15.26:0/2522827798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd128127390 0x7fd12812fc70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:12.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.366+0000 7fd12daee700 1 -- 172.21.15.26:0/2522827798 >> 172.21.15.26:0/2522827798 conn(0x7fd128097470 msgr2=0x7fd128097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:12.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.366+0000 7fd12daee700 1 -- 172.21.15.26:0/2522827798 shutdown_connections 2023-10-01T07:52:12.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.366+0000 7fd12daee700 1 -- 172.21.15.26:0/2522827798 wait complete. 2023-10-01T07:52:12.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.367+0000 7fd12daee700 1 Processor -- start 2023-10-01T07:52:12.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.367+0000 7fd12daee700 1 -- start start 2023-10-01T07:52:12.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.368+0000 7fd12daee700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd128059070 0x7fd128111c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:12.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.368+0000 7fd12daee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd128127390 0x7fd12812eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:12.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.368+0000 7fd12daee700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd128127fa0 0x7fd12812efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:12.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.368+0000 7fd12daee700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd128096f00 con 0x7fd128127390 2023-10-01T07:52:12.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.368+0000 7fd12daee700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd128131d50 con 0x7fd128059070 2023-10-01T07:52:12.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.368+0000 7fd12daee700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd128125de0 con 0x7fd128127fa0 2023-10-01T07:52:12.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.368+0000 7fd126ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd128127390 0x7fd12812eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:12.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.368+0000 7fd127fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd128127fa0 0x7fd12812efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:12.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.368+0000 7fd126ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd128127390 0x7fd12812eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34614/0 (socket says 172.21.15.26:34614) 2023-10-01T07:52:12.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.368+0000 7fd1277fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd128059070 0x7fd128111c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:12.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.368+0000 7fd126ffd700 1 -- 172.21.15.26:0/1228149534 learned_addr learned my addr 172.21.15.26:0/1228149534 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:12.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.368+0000 7fd1277fe700 1 -- 172.21.15.26:0/1228149534 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd128127fa0 msgr2=0x7fd12812efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:12.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.368+0000 7fd1277fe700 1 --2- 172.21.15.26:0/1228149534 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd128127fa0 0x7fd12812efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:12.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.368+0000 7fd1277fe700 1 -- 172.21.15.26:0/1228149534 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd128127390 msgr2=0x7fd12812eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:12.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.368+0000 7fd1277fe700 1 --2- 172.21.15.26:0/1228149534 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd128127390 0x7fd12812eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:12.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.368+0000 7fd1277fe700 1 -- 172.21.15.26:0/1228149534 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd120009ae0 con 0x7fd128059070 2023-10-01T07:52:12.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.368+0000 7fd126ffd700 1 --2- 172.21.15.26:0/1228149534 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd128127390 0x7fd12812eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:12.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.368+0000 7fd1277fe700 1 --2- 172.21.15.26:0/1228149534 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd128059070 0x7fd128111c40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fd118000c00 tx=0x7fd118007bb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:12.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.368+0000 7fd11f7fe700 1 -- 172.21.15.26:0/1228149534 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1180070d0 con 0x7fd128059070 2023-10-01T07:52:12.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.368+0000 7fd11f7fe700 1 -- 172.21.15.26:0/1228149534 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd118007230 con 0x7fd128059070 2023-10-01T07:52:12.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.368+0000 7fd12daee700 1 -- 172.21.15.26:0/1228149534 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1100092a0 con 0x7fd128059070 2023-10-01T07:52:12.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.368+0000 7fd11f7fe700 1 -- 172.21.15.26:0/1228149534 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1180056e0 con 0x7fd128059070 2023-10-01T07:52:12.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.368+0000 7fd12daee700 1 -- 172.21.15.26:0/1228149534 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1281305b0 con 0x7fd128059070 2023-10-01T07:52:12.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.369+0000 7fd11f7fe700 1 -- 172.21.15.26:0/1228149534 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fd118005a90 con 0x7fd128059070 2023-10-01T07:52:12.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.369+0000 7fd11f7fe700 1 -- 172.21.15.26:0/1228149534 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fd11803a5a0 con 0x7fd128059070 2023-10-01T07:52:12.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.369+0000 7fd12daee700 1 -- 172.21.15.26:0/1228149534 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd12805a260 con 0x7fd128059070 2023-10-01T07:52:12.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.374+0000 7fd11f7fe700 1 -- 172.21.15.26:0/1228149534 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fd11801c350 con 0x7fd128059070 2023-10-01T07:52:12.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.588+0000 7fd12daee700 1 -- 172.21.15.26:0/1228149534 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd128046c20 con 0x7fd128059070 2023-10-01T07:52:12.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.589+0000 7fd11f7fe700 1 -- 172.21.15.26:0/1228149534 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2156 (secure 0 0 0) 0x7fd118010ab0 con 0x7fd128059070 2023-10-01T07:52:12.589 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:52:12.589 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-01T07:51:57.295264+0000","modified":"2023-10-01T07:52:00.301728+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4189},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4189":{"gid":4189,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6817/2857714939","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6817","nonce":2857714939}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-01T07:52:12.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.590+0000 7fd12daee700 1 -- 172.21.15.26:0/1228149534 >> v1:172.21.15.26:6816/118178 conn(0x7fd10802bb60 legacy=0x7fd10802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:12.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.590+0000 7fd12daee700 1 -- 172.21.15.26:0/1228149534 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd128059070 msgr2=0x7fd128111c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:12.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.590+0000 7fd12daee700 1 --2- 172.21.15.26:0/1228149534 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd128059070 0x7fd128111c40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fd118000c00 tx=0x7fd118007bb0).stop 2023-10-01T07:52:12.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.590+0000 7fd12daee700 1 -- 172.21.15.26:0/1228149534 shutdown_connections 2023-10-01T07:52:12.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.590+0000 7fd12daee700 1 --2- 172.21.15.26:0/1228149534 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd128127fa0 0x7fd12812efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:12.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.590+0000 7fd12daee700 1 --2- 172.21.15.26:0/1228149534 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd128059070 0x7fd128111c40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:12.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.590+0000 7fd12daee700 1 --2- 172.21.15.26:0/1228149534 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd128127390 0x7fd12812eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:12.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.590+0000 7fd12daee700 1 -- 172.21.15.26:0/1228149534 >> 172.21.15.26:0/1228149534 conn(0x7fd128097470 msgr2=0x7fd128128710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:12.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.591+0000 7fd12daee700 1 -- 172.21.15.26:0/1228149534 shutdown_connections 2023-10-01T07:52:12.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.591+0000 7fd12daee700 1 -- 172.21.15.26:0/1228149534 wait complete. 2023-10-01T07:52:12.592 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 6 2023-10-01T07:52:12.605 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-01T07:52:12.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.737+0000 7f9b47396700 1 Processor -- start 2023-10-01T07:52:12.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.737+0000 7f9b47396700 1 -- start start 2023-10-01T07:52:12.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.737+0000 7f9b47396700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9b40096820 0x7f9b40096c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:12.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.737+0000 7f9b47396700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b40097800 0x7f9b40130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:12.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.737+0000 7f9b47396700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b40068df0 con 0x7f9b40067940 2023-10-01T07:52:12.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.737+0000 7f9b47396700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b40097c90 con 0x7f9b40096820 2023-10-01T07:52:12.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.737+0000 7f9b47396700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4006a4c0 con 0x7f9b40097800 2023-10-01T07:52:12.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.738+0000 7f9b45132700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9b40096820 0x7f9b40096c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:12.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.738+0000 7f9b45933700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b40097800 0x7f9b40130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:12.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.738+0000 7f9b45132700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9b40096820 0x7f9b40096c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34620/0 (socket says 172.21.15.26:34620) 2023-10-01T07:52:12.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.738+0000 7f9b45132700 1 -- 172.21.15.26:0/98889166 learned_addr learned my addr 172.21.15.26:0/98889166 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:12.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.738+0000 7f9b44931700 1 --1- 172.21.15.26:0/98889166 >> v1:172.21.15.26:6789/0 conn(0x7f9b40067940 0x7f9b400970f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:40588/0 (socket says 172.21.15.26:40588) 2023-10-01T07:52:12.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.738+0000 7f9b45933700 1 -- 172.21.15.26:0/98889166 >> v2:172.21.15.26:3300/0 conn(0x7f9b40096820 msgr2=0x7f9b40096c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:12.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.738+0000 7f9b45933700 1 --2- 172.21.15.26:0/98889166 >> v2:172.21.15.26:3300/0 conn(0x7f9b40096820 0x7f9b40096c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:12.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.738+0000 7f9b45933700 1 -- 172.21.15.26:0/98889166 >> v1:172.21.15.26:6789/0 conn(0x7f9b40067940 legacy=0x7f9b400970f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:12.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.738+0000 7f9b45933700 1 -- 172.21.15.26:0/98889166 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b40098260 con 0x7f9b40097800 2023-10-01T07:52:12.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.738+0000 7f9b37fff700 1 -- 172.21.15.26:0/98889166 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 301037599 0 0) 0x7f9b40068df0 con 0x7f9b40067940 2023-10-01T07:52:12.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.738+0000 7f9b45132700 1 --2- 172.21.15.26:0/98889166 >> v2:172.21.15.26:3300/0 conn(0x7f9b40096820 0x7f9b40096c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:12.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.738+0000 7f9b45933700 1 --2- 172.21.15.26:0/98889166 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b40097800 0x7f9b40130280 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f9b38009e60 tx=0x7f9b38009780).ready entity=mon.2 client_cookie=50f893969b6206a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:12.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.738+0000 7f9b37fff700 1 -- 172.21.15.26:0/98889166 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3800e070 con 0x7f9b40097800 2023-10-01T07:52:12.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.738+0000 7f9b37fff700 1 -- 172.21.15.26:0/98889166 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3800bb60 con 0x7f9b40097800 2023-10-01T07:52:12.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.738+0000 7f9b37fff700 1 -- 172.21.15.26:0/98889166 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b38012410 con 0x7f9b40097800 2023-10-01T07:52:12.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.739+0000 7f9b47396700 1 -- 172.21.15.26:0/98889166 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b40097800 msgr2=0x7f9b40130280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:12.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.739+0000 7f9b47396700 1 --2- 172.21.15.26:0/98889166 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b40097800 0x7f9b40130280 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f9b38009e60 tx=0x7f9b38009780).stop 2023-10-01T07:52:12.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.739+0000 7f9b47396700 1 -- 172.21.15.26:0/98889166 shutdown_connections 2023-10-01T07:52:12.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.739+0000 7f9b47396700 1 --2- 172.21.15.26:0/98889166 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b40097800 0x7f9b40130280 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:12.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.739+0000 7f9b47396700 1 --2- 172.21.15.26:0/98889166 >> v2:172.21.15.26:3300/0 conn(0x7f9b40096820 0x7f9b40096c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:12.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.739+0000 7f9b47396700 1 -- 172.21.15.26:0/98889166 >> 172.21.15.26:0/98889166 conn(0x7f9b4009ba50 msgr2=0x7f9b4009be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:12.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.739+0000 7f9b47396700 1 -- 172.21.15.26:0/98889166 shutdown_connections 2023-10-01T07:52:12.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.739+0000 7f9b47396700 1 -- 172.21.15.26:0/98889166 wait complete. 2023-10-01T07:52:12.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.740+0000 7f9b47396700 1 Processor -- start 2023-10-01T07:52:12.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.740+0000 7f9b47396700 1 -- start start 2023-10-01T07:52:12.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.741+0000 7f9b47396700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b40067940 0x7f9b401301c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:12.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.741+0000 7f9b47396700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9b40096820 0x7f9b40118170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:12.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.741+0000 7f9b47396700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b40097800 0x7f9b40118660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:12.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.741+0000 7f9b47396700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4011c5a0 con 0x7f9b40067940 2023-10-01T07:52:12.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.741+0000 7f9b47396700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4011c180 con 0x7f9b40096820 2023-10-01T07:52:12.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.741+0000 7f9b47396700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b40067e30 con 0x7f9b40097800 2023-10-01T07:52:12.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.741+0000 7f9b45933700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b40097800 0x7f9b40118660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:12.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.741+0000 7f9b44931700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9b40096820 0x7f9b40118170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:12.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.741+0000 7f9b45933700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b40097800 0x7f9b40118660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57792/0 (socket says 172.21.15.26:57792) 2023-10-01T07:52:12.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.741+0000 7f9b45933700 1 -- 172.21.15.26:0/819099246 learned_addr learned my addr 172.21.15.26:0/819099246 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:12.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.741+0000 7f9b45132700 1 --2- 172.21.15.26:0/819099246 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b40067940 0x7f9b401301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:12.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.741+0000 7f9b45933700 1 -- 172.21.15.26:0/819099246 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9b40096820 msgr2=0x7f9b40118170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:12.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.741+0000 7f9b45933700 1 --2- 172.21.15.26:0/819099246 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9b40096820 0x7f9b40118170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:12.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.741+0000 7f9b45933700 1 -- 172.21.15.26:0/819099246 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b40067940 msgr2=0x7f9b401301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:12.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.741+0000 7f9b45933700 1 --2- 172.21.15.26:0/819099246 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b40067940 0x7f9b401301c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:12.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.741+0000 7f9b45933700 1 -- 172.21.15.26:0/819099246 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3c009370 con 0x7f9b40097800 2023-10-01T07:52:12.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.741+0000 7f9b44931700 1 --2- 172.21.15.26:0/819099246 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9b40096820 0x7f9b40118170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:12.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.741+0000 7f9b45132700 1 --2- 172.21.15.26:0/819099246 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b40067940 0x7f9b401301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:52:12.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.741+0000 7f9b45933700 1 --2- 172.21.15.26:0/819099246 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b40097800 0x7f9b40118660 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f9b4006a600 tx=0x7f9b40068130).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:12.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.741+0000 7f9b357fa700 1 -- 172.21.15.26:0/819099246 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3801d630 con 0x7f9b40097800 2023-10-01T07:52:12.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.741+0000 7f9b357fa700 1 -- 172.21.15.26:0/819099246 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3801d790 con 0x7f9b40097800 2023-10-01T07:52:12.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.741+0000 7f9b47396700 1 -- 172.21.15.26:0/819099246 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b38009a20 con 0x7f9b40097800 2023-10-01T07:52:12.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.742+0000 7f9b357fa700 1 -- 172.21.15.26:0/819099246 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3801db50 con 0x7f9b40097800 2023-10-01T07:52:12.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.742+0000 7f9b47396700 1 -- 172.21.15.26:0/819099246 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b4011b620 con 0x7f9b40097800 2023-10-01T07:52:12.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.742+0000 7f9b357fa700 1 -- 172.21.15.26:0/819099246 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f9b38003040 con 0x7f9b40097800 2023-10-01T07:52:12.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.742+0000 7f9b357fa700 1 -- 172.21.15.26:0/819099246 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f9b3803cda0 con 0x7f9b40097800 2023-10-01T07:52:12.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.743+0000 7f9b47396700 1 -- 172.21.15.26:0/819099246 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b4005a260 con 0x7f9b40097800 2023-10-01T07:52:12.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.747+0000 7f9b357fa700 1 -- 172.21.15.26:0/819099246 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f9b38025b10 con 0x7f9b40097800 2023-10-01T07:52:12.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.924+0000 7f9b47396700 1 -- 172.21.15.26:0/819099246 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b40095320 con 0x7f9b40097800 2023-10-01T07:52:12.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.925+0000 7f9b357fa700 1 -- 172.21.15.26:0/819099246 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11341 (secure 0 0 0) 0x7f9b38025b10 con 0x7f9b40097800 2023-10-01T07:52:12.925 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:52:12.925 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":17,"fsid":"c29fb19d-520c-42a6-90f4-e7f86de96e8e","created":"2023-10-01T07:51:40.702414+0000","modified":"2023-10-01T07:51:58.296715+0000","last_up_change":"2023-10-01T07:51:48.849482+0000","last_in_change":"2023-10-01T07:51:42.084736+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-01T07:51:48.906889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-01T07:51:50.071599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-01T07:51:54.981575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-01T07:51:56.286318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46569ce3-81d1-44a1-a649-691de3e6f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6800","nonce":118773}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6801","nonce":118773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6803","nonce":118773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6802","nonce":118773}]},"public_addr":"172.21.15.26:6800/118773","cluster_addr":"172.21.15.26:6801/118773","heartbeat_back_addr":"172.21.15.26:6803/118773","heartbeat_front_addr":"172.21.15.26:6802/118773","state":["exists","up"]},{"osd":1,"uuid":"1fc1ba9b-4110-4d31-96d6-794937578cff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6804","nonce":118782}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6806","nonce":118782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6810","nonce":118782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6808","nonce":118782}]},"public_addr":"172.21.15.26:6804/118782","cluster_addr":"172.21.15.26:6806/118782","heartbeat_back_addr":"172.21.15.26:6810/118782","heartbeat_front_addr":"172.21.15.26:6808/118782","state":["exists","up"]},{"osd":2,"uuid":"37de933d-3b8e-4b94-87bd-2f36896c7ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6805","nonce":118789}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6807","nonce":118789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6811","nonce":118789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6809","nonce":118789}]},"public_addr":"172.21.15.26:6805/118789","cluster_addr":"172.21.15.26:6807/118789","heartbeat_back_addr":"172.21.15.26:6811/118789","heartbeat_front_addr":"172.21.15.26:6809/118789","state":["exists","up"]},{"osd":3,"uuid":"bd020309-5fd2-4d97-b36a-67e159fa3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6812","nonce":118790}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6813","nonce":118790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6815","nonce":118790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6814","nonce":118790}]},"public_addr":"172.21.15.26:6812/118790","cluster_addr":"172.21.15.26:6813/118790","heartbeat_back_addr":"172.21.15.26:6815/118790","heartbeat_front_addr":"172.21.15.26:6814/118790","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.029993+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.266503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.273540+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.229731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-01T07:52:12.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.927+0000 7f9b47396700 1 -- 172.21.15.26:0/819099246 >> v1:172.21.15.26:6816/118178 conn(0x7f9b2402bb60 legacy=0x7f9b2402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:12.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.927+0000 7f9b47396700 1 -- 172.21.15.26:0/819099246 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b40097800 msgr2=0x7f9b40118660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:12.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.927+0000 7f9b47396700 1 --2- 172.21.15.26:0/819099246 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b40097800 0x7f9b40118660 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f9b4006a600 tx=0x7f9b40068130).stop 2023-10-01T07:52:12.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.927+0000 7f9b47396700 1 -- 172.21.15.26:0/819099246 shutdown_connections 2023-10-01T07:52:12.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.927+0000 7f9b47396700 1 --2- 172.21.15.26:0/819099246 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b40097800 0x7f9b40118660 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:12.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.927+0000 7f9b47396700 1 --2- 172.21.15.26:0/819099246 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b40067940 0x7f9b401301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:12.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.927+0000 7f9b47396700 1 --2- 172.21.15.26:0/819099246 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9b40096820 0x7f9b40118170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:12.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.927+0000 7f9b47396700 1 -- 172.21.15.26:0/819099246 >> 172.21.15.26:0/819099246 conn(0x7f9b4009ba50 msgr2=0x7f9b401120d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:12.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.927+0000 7f9b47396700 1 -- 172.21.15.26:0/819099246 shutdown_connections 2023-10-01T07:52:12.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:12.927+0000 7f9b47396700 1 -- 172.21.15.26:0/819099246 wait complete. 2023-10-01T07:52:12.941 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-01T07:51:48.906889+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-01T07:51:50.071599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-01T07:51:54.981575+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-01T07:51:56.286318+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-01T07:52:12.941 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-01T07:52:13.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.074+0000 7fa473989700 1 Processor -- start 2023-10-01T07:52:13.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.074+0000 7fa473989700 1 -- start start 2023-10-01T07:52:13.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.075+0000 7fa473989700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa46c0613a0 0x7fa46c12ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:13.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.075+0000 7fa473989700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa46c12b340 0x7fa46c068d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:13.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.075+0000 7fa473989700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa46c069210 0x7fa46c069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:13.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.075+0000 7fa473989700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa46c093380 con 0x7fa46c12b340 2023-10-01T07:52:13.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.075+0000 7fa473989700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c098210 con 0x7fa46c0613a0 2023-10-01T07:52:13.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.075+0000 7fa473989700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c099670 con 0x7fa46c069210 2023-10-01T07:52:13.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.075+0000 7fa471725700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa46c0613a0 0x7fa46c12ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:13.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.075+0000 7fa471f26700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa46c069210 0x7fa46c069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:13.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.075+0000 7fa470f24700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa46c12b340 0x7fa46c068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:13.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.075+0000 7fa471725700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa46c0613a0 0x7fa46c12ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55546/0 (socket says 172.21.15.26:55546) 2023-10-01T07:52:13.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.075+0000 7fa471f26700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa46c069210 0x7fa46c069690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57802/0 (socket says 172.21.15.26:57802) 2023-10-01T07:52:13.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.075+0000 7fa470f24700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa46c12b340 0x7fa46c068d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34636/0 (socket says 172.21.15.26:34636) 2023-10-01T07:52:13.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.075+0000 7fa471725700 1 -- 172.21.15.26:0/3979558354 learned_addr learned my addr 172.21.15.26:0/3979558354 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:13.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.076+0000 7fa470f24700 1 -- 172.21.15.26:0/3979558354 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa46c069210 msgr2=0x7fa46c069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:13.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.076+0000 7fa470f24700 1 --2- 172.21.15.26:0/3979558354 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa46c069210 0x7fa46c069690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:13.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.076+0000 7fa470f24700 1 -- 172.21.15.26:0/3979558354 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa46c0613a0 msgr2=0x7fa46c12ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:13.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.076+0000 7fa470f24700 1 --2- 172.21.15.26:0/3979558354 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa46c0613a0 0x7fa46c12ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:13.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.076+0000 7fa470f24700 1 -- 172.21.15.26:0/3979558354 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa46c069b80 con 0x7fa46c12b340 2023-10-01T07:52:13.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.076+0000 7fa471725700 1 --2- 172.21.15.26:0/3979558354 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa46c0613a0 0x7fa46c12ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:13.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.076+0000 7fa471f26700 1 --2- 172.21.15.26:0/3979558354 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa46c069210 0x7fa46c069690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:13.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.076+0000 7fa470f24700 1 --2- 172.21.15.26:0/3979558354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa46c12b340 0x7fa46c068d20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fa45c009790 tx=0x7fa45c009060).ready entity=mon.0 client_cookie=bd7fb0fa1e7c277b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:13.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.076+0000 7fa463fff700 1 -- 172.21.15.26:0/3979558354 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45c0090d0 con 0x7fa46c12b340 2023-10-01T07:52:13.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.076+0000 7fa463fff700 1 -- 172.21.15.26:0/3979558354 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45c00d4a0 con 0x7fa46c12b340 2023-10-01T07:52:13.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.076+0000 7fa463fff700 1 -- 172.21.15.26:0/3979558354 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45c00d820 con 0x7fa46c12b340 2023-10-01T07:52:13.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.076+0000 7fa473989700 1 -- 172.21.15.26:0/3979558354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa46c12b340 msgr2=0x7fa46c068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:13.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.076+0000 7fa473989700 1 --2- 172.21.15.26:0/3979558354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa46c12b340 0x7fa46c068d20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fa45c009790 tx=0x7fa45c009060).stop 2023-10-01T07:52:13.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.076+0000 7fa473989700 1 -- 172.21.15.26:0/3979558354 shutdown_connections 2023-10-01T07:52:13.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.076+0000 7fa473989700 1 --2- 172.21.15.26:0/3979558354 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa46c069210 0x7fa46c069690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:13.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.076+0000 7fa473989700 1 --2- 172.21.15.26:0/3979558354 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa46c0613a0 0x7fa46c12ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:13.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.076+0000 7fa473989700 1 --2- 172.21.15.26:0/3979558354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa46c12b340 0x7fa46c068d20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:13.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.076+0000 7fa473989700 1 -- 172.21.15.26:0/3979558354 >> 172.21.15.26:0/3979558354 conn(0x7fa46c09a1c0 msgr2=0x7fa46c09a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:13.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.077+0000 7fa473989700 1 -- 172.21.15.26:0/3979558354 shutdown_connections 2023-10-01T07:52:13.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.077+0000 7fa473989700 1 -- 172.21.15.26:0/3979558354 wait complete. 2023-10-01T07:52:13.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.077+0000 7fa473989700 1 Processor -- start 2023-10-01T07:52:13.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.078+0000 7fa473989700 1 -- start start 2023-10-01T07:52:13.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.078+0000 7fa473989700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa46c0613a0 0x7fa46c13a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:13.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.078+0000 7fa473989700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa46c069210 0x7fa46c13a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:13.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.078+0000 7fa473989700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa46c12b340 0x7fa46c114d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:13.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.078+0000 7fa473989700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c067e30 con 0x7fa46c12b340 2023-10-01T07:52:13.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.078+0000 7fa473989700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c093940 con 0x7fa46c069210 2023-10-01T07:52:13.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.078+0000 7fa473989700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c12f230 con 0x7fa46c0613a0 2023-10-01T07:52:13.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.078+0000 7fa471725700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa46c0613a0 0x7fa46c13a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:13.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.078+0000 7fa470f24700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa46c069210 0x7fa46c13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:13.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.078+0000 7fa471725700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa46c0613a0 0x7fa46c13a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57814/0 (socket says 172.21.15.26:57814) 2023-10-01T07:52:13.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.078+0000 7fa470f24700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa46c069210 0x7fa46c13a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55552/0 (socket says 172.21.15.26:55552) 2023-10-01T07:52:13.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.078+0000 7fa471725700 1 -- 172.21.15.26:0/2530639707 learned_addr learned my addr 172.21.15.26:0/2530639707 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:13.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.078+0000 7fa471f26700 1 --2- 172.21.15.26:0/2530639707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa46c12b340 0x7fa46c114d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:13.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.079+0000 7fa471725700 1 -- 172.21.15.26:0/2530639707 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa46c069210 msgr2=0x7fa46c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:13.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.079+0000 7fa471725700 1 --2- 172.21.15.26:0/2530639707 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa46c069210 0x7fa46c13a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:13.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.079+0000 7fa471725700 1 -- 172.21.15.26:0/2530639707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa46c12b340 msgr2=0x7fa46c114d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:13.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.079+0000 7fa471725700 1 --2- 172.21.15.26:0/2530639707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa46c12b340 0x7fa46c114d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:13.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.079+0000 7fa471725700 1 -- 172.21.15.26:0/2530639707 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa468009370 con 0x7fa46c0613a0 2023-10-01T07:52:13.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.079+0000 7fa471725700 1 --2- 172.21.15.26:0/2530639707 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa46c0613a0 0x7fa46c13a490 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fa46800ea20 tx=0x7fa4680090f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:13.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.079+0000 7fa4617fa700 1 -- 172.21.15.26:0/2530639707 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa468009650 con 0x7fa46c0613a0 2023-10-01T07:52:13.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.079+0000 7fa4617fa700 1 -- 172.21.15.26:0/2530639707 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46800c850 con 0x7fa46c0613a0 2023-10-01T07:52:13.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.079+0000 7fa473989700 1 -- 172.21.15.26:0/2530639707 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa464009a20 con 0x7fa46c0613a0 2023-10-01T07:52:13.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.079+0000 7fa4617fa700 1 -- 172.21.15.26:0/2530639707 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46800cbd0 con 0x7fa46c0613a0 2023-10-01T07:52:13.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.079+0000 7fa473989700 1 -- 172.21.15.26:0/2530639707 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa45c0092a0 con 0x7fa46c0613a0 2023-10-01T07:52:13.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.080+0000 7fa4617fa700 1 -- 172.21.15.26:0/2530639707 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fa46801b400 con 0x7fa46c0613a0 2023-10-01T07:52:13.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.080+0000 7fa4617fa700 1 -- 172.21.15.26:0/2530639707 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fa46803b520 con 0x7fa46c0613a0 2023-10-01T07:52:13.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.080+0000 7fa473989700 1 -- 172.21.15.26:0/2530639707 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa46c05a260 con 0x7fa46c0613a0 2023-10-01T07:52:13.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.085+0000 7fa4617fa700 1 -- 172.21.15.26:0/2530639707 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fa468016070 con 0x7fa46c0613a0 2023-10-01T07:52:13.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.258+0000 7fa473989700 1 -- 172.21.15.26:0/2530639707 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa46c046c20 con 0x7fa46c0613a0 2023-10-01T07:52:13.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.259+0000 7fa4617fa700 1 -- 172.21.15.26:0/2530639707 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa468016020 con 0x7fa46c0613a0 2023-10-01T07:52:13.260 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-01T07:52:13.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.261+0000 7fa473989700 1 -- 172.21.15.26:0/2530639707 >> v1:172.21.15.26:6816/118178 conn(0x7fa45002bb60 legacy=0x7fa45002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:13.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.261+0000 7fa473989700 1 -- 172.21.15.26:0/2530639707 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa46c0613a0 msgr2=0x7fa46c13a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:13.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.261+0000 7fa473989700 1 --2- 172.21.15.26:0/2530639707 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa46c0613a0 0x7fa46c13a490 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fa46800ea20 tx=0x7fa4680090f0).stop 2023-10-01T07:52:13.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.261+0000 7fa473989700 1 -- 172.21.15.26:0/2530639707 shutdown_connections 2023-10-01T07:52:13.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.261+0000 7fa473989700 1 --2- 172.21.15.26:0/2530639707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa46c12b340 0x7fa46c114d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:13.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.261+0000 7fa473989700 1 --2- 172.21.15.26:0/2530639707 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa46c0613a0 0x7fa46c13a490 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:13.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.261+0000 7fa473989700 1 --2- 172.21.15.26:0/2530639707 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa46c069210 0x7fa46c13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:13.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.261+0000 7fa473989700 1 -- 172.21.15.26:0/2530639707 >> 172.21.15.26:0/2530639707 conn(0x7fa46c09a1c0 msgr2=0x7fa46c066b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:13.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.261+0000 7fa473989700 1 -- 172.21.15.26:0/2530639707 shutdown_connections 2023-10-01T07:52:13.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.261+0000 7fa473989700 1 -- 172.21.15.26:0/2530639707 wait complete. 2023-10-01T07:52:13.275 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-01T07:52:13.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.411+0000 7fc7b175a700 1 Processor -- start 2023-10-01T07:52:13.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.411+0000 7fc7b175a700 1 -- start start 2023-10-01T07:52:13.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.412+0000 7fc7b175a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc7ac093840 0x7fc7ac098790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:13.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.412+0000 7fc7b175a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc7ac098c80 0x7fc7ac099060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:13.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.412+0000 7fc7b175a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7ac092d80 con 0x7fc7ac12c150 2023-10-01T07:52:13.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.412+0000 7fc7b175a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7ac093c20 con 0x7fc7ac093840 2023-10-01T07:52:13.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.412+0000 7fc7b175a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ac092b90 con 0x7fc7ac098c80 2023-10-01T07:52:13.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.412+0000 7fc7aa7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc7ac098c80 0x7fc7ac099060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:13.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.412+0000 7fc7aaffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc7ac093840 0x7fc7ac098790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:13.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.412+0000 7fc7ab7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc7ac12c150 0x7fc7ac12e540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56522/0 (socket says 172.21.15.26:56522) 2023-10-01T07:52:13.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.412+0000 7fc7ab7fe700 1 -- 172.21.15.26:0/1355443778 learned_addr learned my addr 172.21.15.26:0/1355443778 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:52:13.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.412+0000 7fc7aaffd700 1 -- 172.21.15.26:0/1355443778 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc7ac098c80 msgr2=0x7fc7ac099060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:13.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.412+0000 7fc7aaffd700 1 --2- 172.21.15.26:0/1355443778 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc7ac098c80 0x7fc7ac099060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:13.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.412+0000 7fc7aaffd700 1 -- 172.21.15.26:0/1355443778 >> v1:172.21.15.26:6789/0 conn(0x7fc7ac12c150 legacy=0x7fc7ac12e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:13.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.412+0000 7fc7aaffd700 1 -- 172.21.15.26:0/1355443778 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ac099b70 con 0x7fc7ac093840 2023-10-01T07:52:13.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.412+0000 7fc7a9ffb700 1 -- 172.21.15.26:0/1355443778 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3164025749 0 0) 0x7fc7ac092d80 con 0x7fc7ac12c150 2023-10-01T07:52:13.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.412+0000 7fc7aa7fc700 1 --2- 172.21.15.26:0/1355443778 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc7ac098c80 0x7fc7ac099060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:13.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.413+0000 7fc7aaffd700 1 --2- 172.21.15.26:0/1355443778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7ac093840 0x7fc7ac098790 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fc794009760 tx=0x7fc794009060).ready entity=mon.0 client_cookie=17096cbcfb5e7eea server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:13.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.413+0000 7fc7a9ffb700 1 -- 172.21.15.26:0/1355443778 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79400f510 con 0x7fc7ac093840 2023-10-01T07:52:13.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.413+0000 7fc7a9ffb700 1 -- 172.21.15.26:0/1355443778 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc79400f670 con 0x7fc7ac093840 2023-10-01T07:52:13.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.413+0000 7fc7a9ffb700 1 -- 172.21.15.26:0/1355443778 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79400f9f0 con 0x7fc7ac093840 2023-10-01T07:52:13.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.413+0000 7fc7b175a700 1 -- 172.21.15.26:0/1355443778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7ac093840 msgr2=0x7fc7ac098790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:13.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.413+0000 7fc7b175a700 1 --2- 172.21.15.26:0/1355443778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7ac093840 0x7fc7ac098790 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fc794009760 tx=0x7fc794009060).stop 2023-10-01T07:52:13.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.413+0000 7fc7b175a700 1 -- 172.21.15.26:0/1355443778 shutdown_connections 2023-10-01T07:52:13.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.413+0000 7fc7b175a700 1 --2- 172.21.15.26:0/1355443778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7ac093840 0x7fc7ac098790 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:13.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.413+0000 7fc7b175a700 1 --2- 172.21.15.26:0/1355443778 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc7ac098c80 0x7fc7ac099060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:13.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.413+0000 7fc7b175a700 1 -- 172.21.15.26:0/1355443778 >> 172.21.15.26:0/1355443778 conn(0x7fc7ac097480 msgr2=0x7fc7ac097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:13.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.413+0000 7fc7b175a700 1 -- 172.21.15.26:0/1355443778 shutdown_connections 2023-10-01T07:52:13.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.413+0000 7fc7b175a700 1 -- 172.21.15.26:0/1355443778 wait complete. 2023-10-01T07:52:13.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.414+0000 7fc7b175a700 1 Processor -- start 2023-10-01T07:52:13.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.415+0000 7fc7b175a700 1 -- start start 2023-10-01T07:52:13.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.415+0000 7fc7b175a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc7ac093840 0x7fc7ac066510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:13.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.415+0000 7fc7b175a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc7ac098c80 0x7fc7ac066a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:13.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.415+0000 7fc7b175a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7ac12c150 0x7fc7ac066ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:13.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.415+0000 7fc7b175a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ac0673e0 con 0x7fc7ac12c150 2023-10-01T07:52:13.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.415+0000 7fc7b175a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ac0680a0 con 0x7fc7ac093840 2023-10-01T07:52:13.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.415+0000 7fc7b175a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ac064f30 con 0x7fc7ac098c80 2023-10-01T07:52:13.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.415+0000 7fc7ab7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7ac12c150 0x7fc7ac066ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:13.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.415+0000 7fc7aa7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc7ac098c80 0x7fc7ac066a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:13.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.415+0000 7fc7ab7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7ac12c150 0x7fc7ac066ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44082/0 (socket says 172.21.15.26:44082) 2023-10-01T07:52:13.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.415+0000 7fc7ab7fe700 1 -- 172.21.15.26:0/2226704046 learned_addr learned my addr 172.21.15.26:0/2226704046 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:13.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.415+0000 7fc7aaffd700 1 --2- 172.21.15.26:0/2226704046 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc7ac093840 0x7fc7ac066510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:13.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.416+0000 7fc7ab7fe700 1 -- 172.21.15.26:0/2226704046 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc7ac098c80 msgr2=0x7fc7ac066a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:13.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.416+0000 7fc7ab7fe700 1 --2- 172.21.15.26:0/2226704046 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc7ac098c80 0x7fc7ac066a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:13.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.416+0000 7fc7ab7fe700 1 -- 172.21.15.26:0/2226704046 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc7ac093840 msgr2=0x7fc7ac066510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:13.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.416+0000 7fc7ab7fe700 1 --2- 172.21.15.26:0/2226704046 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc7ac093840 0x7fc7ac066510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:13.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.416+0000 7fc7ab7fe700 1 -- 172.21.15.26:0/2226704046 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc79c0092a0 con 0x7fc7ac12c150 2023-10-01T07:52:13.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.416+0000 7fc7aa7fc700 1 --2- 172.21.15.26:0/2226704046 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc7ac098c80 0x7fc7ac066a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:13.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.416+0000 7fc7aaffd700 1 --2- 172.21.15.26:0/2226704046 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc7ac093840 0x7fc7ac066510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:13.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.416+0000 7fc7ab7fe700 1 --2- 172.21.15.26:0/2226704046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7ac12c150 0x7fc7ac066ef0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fc7a400c810 tx=0x7fc7a4007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:13.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.416+0000 7fc7a2ffd700 1 -- 172.21.15.26:0/2226704046 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4005d30 con 0x7fc7ac12c150 2023-10-01T07:52:13.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.416+0000 7fc7a2ffd700 1 -- 172.21.15.26:0/2226704046 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a4005e90 con 0x7fc7ac12c150 2023-10-01T07:52:13.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.416+0000 7fc7a2ffd700 1 -- 172.21.15.26:0/2226704046 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4007320 con 0x7fc7ac12c150 2023-10-01T07:52:13.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.416+0000 7fc7b175a700 1 -- 172.21.15.26:0/2226704046 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7940092a0 con 0x7fc7ac12c150 2023-10-01T07:52:13.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.416+0000 7fc7b175a700 1 -- 172.21.15.26:0/2226704046 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7ac11d220 con 0x7fc7ac12c150 2023-10-01T07:52:13.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.417+0000 7fc7a2ffd700 1 -- 172.21.15.26:0/2226704046 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fc7a4007710 con 0x7fc7ac12c150 2023-10-01T07:52:13.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.417+0000 7fc7a2ffd700 1 -- 172.21.15.26:0/2226704046 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fc7a403af90 con 0x7fc7ac12c150 2023-10-01T07:52:13.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.417+0000 7fc7b175a700 1 -- 172.21.15.26:0/2226704046 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7ac05a260 con 0x7fc7ac12c150 2023-10-01T07:52:13.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.422+0000 7fc7a2ffd700 1 -- 172.21.15.26:0/2226704046 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fc7a401c3e0 con 0x7fc7ac12c150 2023-10-01T07:52:13.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.593+0000 7fc7b175a700 1 -- 172.21.15.26:0/2226704046 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc7ac046c20 con 0x7fc7ac12c150 2023-10-01T07:52:13.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.594+0000 7fc7a2ffd700 1 -- 172.21.15.26:0/2226704046 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc7a4011360 con 0x7fc7ac12c150 2023-10-01T07:52:13.595 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 8 2023-10-01T07:52:13.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.595+0000 7fc7b175a700 1 -- 172.21.15.26:0/2226704046 >> v1:172.21.15.26:6816/118178 conn(0x7fc78c02bb90 legacy=0x7fc78c02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:13.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.595+0000 7fc7b175a700 1 -- 172.21.15.26:0/2226704046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7ac12c150 msgr2=0x7fc7ac066ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:13.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.595+0000 7fc7b175a700 1 --2- 172.21.15.26:0/2226704046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7ac12c150 0x7fc7ac066ef0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fc7a400c810 tx=0x7fc7a4007f90).stop 2023-10-01T07:52:13.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.595+0000 7fc7b175a700 1 -- 172.21.15.26:0/2226704046 shutdown_connections 2023-10-01T07:52:13.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.595+0000 7fc7b175a700 1 --2- 172.21.15.26:0/2226704046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7ac12c150 0x7fc7ac066ef0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:13.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.595+0000 7fc7b175a700 1 --2- 172.21.15.26:0/2226704046 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc7ac093840 0x7fc7ac066510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:13.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.595+0000 7fc7b175a700 1 --2- 172.21.15.26:0/2226704046 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc7ac098c80 0x7fc7ac066a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:13.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.595+0000 7fc7b175a700 1 -- 172.21.15.26:0/2226704046 >> 172.21.15.26:0/2226704046 conn(0x7fc7ac097480 msgr2=0x7fc7ac068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:13.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.595+0000 7fc7b175a700 1 -- 172.21.15.26:0/2226704046 shutdown_connections 2023-10-01T07:52:13.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.595+0000 7fc7b175a700 1 -- 172.21.15.26:0/2226704046 wait complete. 2023-10-01T07:52:13.610 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-01T07:52:13.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.743+0000 7fabc96b1700 1 Processor -- start 2023-10-01T07:52:13.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.743+0000 7fabc96b1700 1 -- start start 2023-10-01T07:52:13.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.743+0000 7fabc96b1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabc40653a0 0x7fabc4098640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:13.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.743+0000 7fabc96b1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fabc4098b30 0x7fabc4098f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:13.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.743+0000 7fabc96b1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabc412f430 0x7fabc4131820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:13.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.743+0000 7fabc96b1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabc4065e80 con 0x7fabc4098b30 2023-10-01T07:52:13.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.743+0000 7fabc96b1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc40663b0 con 0x7fabc40653a0 2023-10-01T07:52:13.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.743+0000 7fabc96b1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabc4065780 con 0x7fabc412f430 2023-10-01T07:52:13.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.743+0000 7fabc27fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fabc4098b30 0x7fabc4098f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:13.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.743+0000 7fabc37fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabc412f430 0x7fabc4131820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:13.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.743+0000 7fabc2ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabc40653a0 0x7fabc4098640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:13.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.744+0000 7fabc27fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fabc4098b30 0x7fabc4098f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44094/0 (socket says 172.21.15.26:44094) 2023-10-01T07:52:13.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.744+0000 7fabc27fc700 1 -- 172.21.15.26:0/1353848270 learned_addr learned my addr 172.21.15.26:0/1353848270 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:13.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.744+0000 7fabc37fe700 1 -- 172.21.15.26:0/1353848270 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabc40653a0 msgr2=0x7fabc4098640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:13.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.744+0000 7fabc37fe700 1 --2- 172.21.15.26:0/1353848270 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabc40653a0 0x7fabc4098640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:13.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.744+0000 7fabc37fe700 1 -- 172.21.15.26:0/1353848270 >> v2:172.21.15.26:3300/0 conn(0x7fabc4098b30 msgr2=0x7fabc4098f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:13.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.744+0000 7fabc37fe700 1 --2- 172.21.15.26:0/1353848270 >> v2:172.21.15.26:3300/0 conn(0x7fabc4098b30 0x7fabc4098f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:13.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.744+0000 7fabc37fe700 1 -- 172.21.15.26:0/1353848270 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc4096180 con 0x7fabc412f430 2023-10-01T07:52:13.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.744+0000 7fabc2ffd700 1 --2- 172.21.15.26:0/1353848270 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabc40653a0 0x7fabc4098640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:13.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.744+0000 7fabc27fc700 1 --2- 172.21.15.26:0/1353848270 >> v2:172.21.15.26:3300/0 conn(0x7fabc4098b30 0x7fabc4098f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:13.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.744+0000 7fabc37fe700 1 --2- 172.21.15.26:0/1353848270 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabc412f430 0x7fabc4131820 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fabbc009e90 tx=0x7fabbc009780).ready entity=mon.2 client_cookie=5f3c3579d6c64b8d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:13.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.744+0000 7fabc1ffb700 1 -- 172.21.15.26:0/1353848270 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc00e070 con 0x7fabc412f430 2023-10-01T07:52:13.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.744+0000 7fabc1ffb700 1 -- 172.21.15.26:0/1353848270 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabbc00ba70 con 0x7fabc412f430 2023-10-01T07:52:13.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.744+0000 7fabc1ffb700 1 -- 172.21.15.26:0/1353848270 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc00bdf0 con 0x7fabc412f430 2023-10-01T07:52:13.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.745+0000 7fabc96b1700 1 -- 172.21.15.26:0/1353848270 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabc412f430 msgr2=0x7fabc4131820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:13.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.745+0000 7fabc96b1700 1 --2- 172.21.15.26:0/1353848270 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabc412f430 0x7fabc4131820 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fabbc009e90 tx=0x7fabbc009780).stop 2023-10-01T07:52:13.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.745+0000 7fabc96b1700 1 -- 172.21.15.26:0/1353848270 shutdown_connections 2023-10-01T07:52:13.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.745+0000 7fabc96b1700 1 --2- 172.21.15.26:0/1353848270 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabc412f430 0x7fabc4131820 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:13.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.745+0000 7fabc96b1700 1 --2- 172.21.15.26:0/1353848270 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabc40653a0 0x7fabc4098640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:13.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.745+0000 7fabc96b1700 1 --2- 172.21.15.26:0/1353848270 >> v2:172.21.15.26:3300/0 conn(0x7fabc4098b30 0x7fabc4098f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:13.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.745+0000 7fabc96b1700 1 -- 172.21.15.26:0/1353848270 >> 172.21.15.26:0/1353848270 conn(0x7fabc409dc20 msgr2=0x7fabc409e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:13.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.745+0000 7fabc96b1700 1 -- 172.21.15.26:0/1353848270 shutdown_connections 2023-10-01T07:52:13.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.745+0000 7fabc96b1700 1 -- 172.21.15.26:0/1353848270 wait complete. 2023-10-01T07:52:13.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.746+0000 7fabc96b1700 1 Processor -- start 2023-10-01T07:52:13.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.746+0000 7fabc96b1700 1 -- start start 2023-10-01T07:52:13.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.746+0000 7fabc96b1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabc40653a0 0x7fabc411a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:13.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.746+0000 7fabc96b1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabc4098b30 0x7fabc411a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:13.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.746+0000 7fabc96b1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabc412f430 0x7fabc411acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:13.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.746+0000 7fabc96b1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc411ea90 con 0x7fabc412f430 2023-10-01T07:52:13.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.746+0000 7fabc96b1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc411c9a0 con 0x7fabc4098b30 2023-10-01T07:52:13.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.746+0000 7fabc96b1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabc4099a90 con 0x7fabc40653a0 2023-10-01T07:52:13.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.747+0000 7fabc2ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabc40653a0 0x7fabc411a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:13.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.747+0000 7fabc27fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabc4098b30 0x7fabc411a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:13.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.747+0000 7fabc2ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabc40653a0 0x7fabc411a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55404/0 (socket says 172.21.15.26:55404) 2023-10-01T07:52:13.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.747+0000 7fabc2ffd700 1 -- 172.21.15.26:0/1600579046 learned_addr learned my addr 172.21.15.26:0/1600579046 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:13.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.747+0000 7fabc37fe700 1 --2- 172.21.15.26:0/1600579046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabc412f430 0x7fabc411acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:13.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.747+0000 7fabc2ffd700 1 -- 172.21.15.26:0/1600579046 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabc4098b30 msgr2=0x7fabc411a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:13.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.747+0000 7fabc2ffd700 1 --2- 172.21.15.26:0/1600579046 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabc4098b30 0x7fabc411a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:13.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.747+0000 7fabc2ffd700 1 -- 172.21.15.26:0/1600579046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabc412f430 msgr2=0x7fabc411acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:13.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.747+0000 7fabc2ffd700 1 --2- 172.21.15.26:0/1600579046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabc412f430 0x7fabc411acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:13.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.747+0000 7fabc2ffd700 1 -- 172.21.15.26:0/1600579046 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb40092a0 con 0x7fabc40653a0 2023-10-01T07:52:13.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.747+0000 7fabc27fc700 1 --2- 172.21.15.26:0/1600579046 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabc4098b30 0x7fabc411a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:13.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.747+0000 7fabc2ffd700 1 --2- 172.21.15.26:0/1600579046 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabc40653a0 0x7fabc411a2e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fabb400ea50 tx=0x7fabb4009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:13.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.747+0000 7fabaaffd700 1 -- 172.21.15.26:0/1600579046 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb400ee90 con 0x7fabc40653a0 2023-10-01T07:52:13.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.747+0000 7fabaaffd700 1 -- 172.21.15.26:0/1600579046 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb400c850 con 0x7fabc40653a0 2023-10-01T07:52:13.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.747+0000 7fabc96b1700 1 -- 172.21.15.26:0/1600579046 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb8009370 con 0x7fabc40653a0 2023-10-01T07:52:13.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.747+0000 7fabaaffd700 1 -- 172.21.15.26:0/1600579046 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb400cbd0 con 0x7fabc40653a0 2023-10-01T07:52:13.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.747+0000 7fabc96b1700 1 -- 172.21.15.26:0/1600579046 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabbc009a20 con 0x7fabc40653a0 2023-10-01T07:52:13.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.748+0000 7fabaaffd700 1 -- 172.21.15.26:0/1600579046 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fabb401b400 con 0x7fabc40653a0 2023-10-01T07:52:13.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.748+0000 7fabaaffd700 1 -- 172.21.15.26:0/1600579046 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fabb403b4e0 con 0x7fabc40653a0 2023-10-01T07:52:13.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.748+0000 7fabc96b1700 1 -- 172.21.15.26:0/1600579046 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabc411dd40 con 0x7fabc40653a0 2023-10-01T07:52:13.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.753+0000 7fabaaffd700 1 -- 172.21.15.26:0/1600579046 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fabb401be60 con 0x7fabc40653a0 2023-10-01T07:52:13.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.930+0000 7fabc96b1700 1 -- 172.21.15.26:0/1600579046 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fabc405a2c0 con 0x7fabc40653a0 2023-10-01T07:52:13.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.931+0000 7fabaaffd700 1 -- 172.21.15.26:0/1600579046 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+11 (secure 0 0 0) 0x7fabb40290a0 con 0x7fabc40653a0 2023-10-01T07:52:13.932 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-01T07:52:13.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.933+0000 7fabc96b1700 1 -- 172.21.15.26:0/1600579046 >> v1:172.21.15.26:6816/118178 conn(0x7fabb002bb60 legacy=0x7fabb002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:13.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.933+0000 7fabc96b1700 1 -- 172.21.15.26:0/1600579046 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabc40653a0 msgr2=0x7fabc411a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:13.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.933+0000 7fabc96b1700 1 --2- 172.21.15.26:0/1600579046 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabc40653a0 0x7fabc411a2e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fabb400ea50 tx=0x7fabb4009060).stop 2023-10-01T07:52:13.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.933+0000 7fabc96b1700 1 -- 172.21.15.26:0/1600579046 shutdown_connections 2023-10-01T07:52:13.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.933+0000 7fabc96b1700 1 --2- 172.21.15.26:0/1600579046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabc412f430 0x7fabc411acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:13.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.933+0000 7fabc96b1700 1 --2- 172.21.15.26:0/1600579046 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabc40653a0 0x7fabc411a2e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:13.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.933+0000 7fabc96b1700 1 --2- 172.21.15.26:0/1600579046 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabc4098b30 0x7fabc411a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:13.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.933+0000 7fabc96b1700 1 -- 172.21.15.26:0/1600579046 >> 172.21.15.26:0/1600579046 conn(0x7fabc409dc20 msgr2=0x7fabc41142a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:13.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.933+0000 7fabc96b1700 1 -- 172.21.15.26:0/1600579046 shutdown_connections 2023-10-01T07:52:13.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:13.933+0000 7fabc96b1700 1 -- 172.21.15.26:0/1600579046 wait complete. 2023-10-01T07:52:13.947 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-01T07:52:14.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.079+0000 7f4ddf3a1700 1 Processor -- start 2023-10-01T07:52:14.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.080+0000 7f4ddf3a1700 1 -- start start 2023-10-01T07:52:14.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.080+0000 7f4ddf3a1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dd8093840 0x7f4dd8098790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:14.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.080+0000 7f4ddf3a1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dd8098c80 0x7f4dd8099060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:14.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.080+0000 7f4ddf3a1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dd8092d80 con 0x7f4dd812c150 2023-10-01T07:52:14.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.080+0000 7f4ddf3a1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd8093c20 con 0x7f4dd8098c80 2023-10-01T07:52:14.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.080+0000 7f4ddf3a1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd8092b90 con 0x7f4dd8093840 2023-10-01T07:52:14.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.080+0000 7f4ddd13d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dd8093840 0x7f4dd8098790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:14.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.080+0000 7f4ddc93c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dd8098c80 0x7f4dd8099060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:14.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.080+0000 7f4ddd93e700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4dd812c150 0x7f4dd812e540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56528/0 (socket says 172.21.15.26:56528) 2023-10-01T07:52:14.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.080+0000 7f4ddd93e700 1 -- 172.21.15.26:0/1526541104 learned_addr learned my addr 172.21.15.26:0/1526541104 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:52:14.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.081+0000 7f4dcffff700 1 -- 172.21.15.26:0/1526541104 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1172467966 0 0) 0x7f4dd8092d80 con 0x7f4dd812c150 2023-10-01T07:52:14.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.081+0000 7f4ddc93c700 1 -- 172.21.15.26:0/1526541104 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dd8093840 msgr2=0x7f4dd8098790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:14.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.081+0000 7f4ddc93c700 1 --2- 172.21.15.26:0/1526541104 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dd8093840 0x7f4dd8098790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:14.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.081+0000 7f4ddc93c700 1 -- 172.21.15.26:0/1526541104 >> v1:172.21.15.26:6789/0 conn(0x7f4dd812c150 legacy=0x7f4dd812e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:14.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.081+0000 7f4ddc93c700 1 -- 172.21.15.26:0/1526541104 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd8099b70 con 0x7f4dd8098c80 2023-10-01T07:52:14.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.081+0000 7f4ddd13d700 1 --2- 172.21.15.26:0/1526541104 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dd8093840 0x7f4dd8098790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:14.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.081+0000 7f4ddc93c700 1 --2- 172.21.15.26:0/1526541104 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dd8098c80 0x7f4dd8099060 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f4dc8009790 tx=0x7f4dc8009060).ready entity=mon.1 client_cookie=8c5d6b0e60cbb937 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:14.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.081+0000 7f4dcffff700 1 -- 172.21.15.26:0/1526541104 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc800f510 con 0x7f4dd8098c80 2023-10-01T07:52:14.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.081+0000 7f4dcffff700 1 -- 172.21.15.26:0/1526541104 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc800f670 con 0x7f4dd8098c80 2023-10-01T07:52:14.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.081+0000 7f4dcffff700 1 -- 172.21.15.26:0/1526541104 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc800f9f0 con 0x7f4dd8098c80 2023-10-01T07:52:14.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.082+0000 7f4ddf3a1700 1 -- 172.21.15.26:0/1526541104 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dd8098c80 msgr2=0x7f4dd8099060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:14.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.082+0000 7f4ddf3a1700 1 --2- 172.21.15.26:0/1526541104 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dd8098c80 0x7f4dd8099060 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f4dc8009790 tx=0x7f4dc8009060).stop 2023-10-01T07:52:14.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.082+0000 7f4ddf3a1700 1 -- 172.21.15.26:0/1526541104 shutdown_connections 2023-10-01T07:52:14.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.082+0000 7f4ddf3a1700 1 --2- 172.21.15.26:0/1526541104 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dd8093840 0x7f4dd8098790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:14.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.082+0000 7f4ddf3a1700 1 --2- 172.21.15.26:0/1526541104 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dd8098c80 0x7f4dd8099060 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:14.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.082+0000 7f4ddf3a1700 1 -- 172.21.15.26:0/1526541104 >> 172.21.15.26:0/1526541104 conn(0x7f4dd8097480 msgr2=0x7f4dd8097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:14.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.082+0000 7f4ddf3a1700 1 -- 172.21.15.26:0/1526541104 shutdown_connections 2023-10-01T07:52:14.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.082+0000 7f4ddf3a1700 1 -- 172.21.15.26:0/1526541104 wait complete. 2023-10-01T07:52:14.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.083+0000 7f4ddf3a1700 1 Processor -- start 2023-10-01T07:52:14.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.083+0000 7f4ddf3a1700 1 -- start start 2023-10-01T07:52:14.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.083+0000 7f4ddf3a1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dd8093840 0x7f4dd8116000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:14.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.083+0000 7f4ddf3a1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dd8098c80 0x7f4dd81164f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:14.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.083+0000 7f4ddf3a1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dd812c150 0x7f4dd81169e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:14.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.083+0000 7f4ddf3a1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd8116ed0 con 0x7f4dd812c150 2023-10-01T07:52:14.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.083+0000 7f4ddf3a1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd8119240 con 0x7f4dd8093840 2023-10-01T07:52:14.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.083+0000 7f4ddf3a1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd8117b90 con 0x7f4dd8098c80 2023-10-01T07:52:14.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.083+0000 7f4ddd13d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dd8093840 0x7f4dd8116000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:14.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.083+0000 7f4ddc93c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dd8098c80 0x7f4dd81164f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:14.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.083+0000 7f4ddd13d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dd8093840 0x7f4dd8116000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58346/0 (socket says 172.21.15.26:58346) 2023-10-01T07:52:14.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.083+0000 7f4ddc93c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dd8098c80 0x7f4dd81164f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55422/0 (socket says 172.21.15.26:55422) 2023-10-01T07:52:14.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.083+0000 7f4ddd13d700 1 -- 172.21.15.26:0/902422417 learned_addr learned my addr 172.21.15.26:0/902422417 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:14.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.083+0000 7f4ddd93e700 1 --2- 172.21.15.26:0/902422417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dd812c150 0x7f4dd81169e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:14.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.084+0000 7f4ddd93e700 1 -- 172.21.15.26:0/902422417 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dd8098c80 msgr2=0x7f4dd81164f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:14.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.084+0000 7f4ddd93e700 1 --2- 172.21.15.26:0/902422417 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dd8098c80 0x7f4dd81164f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:14.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.084+0000 7f4ddd93e700 1 -- 172.21.15.26:0/902422417 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dd8093840 msgr2=0x7f4dd8116000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:14.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.084+0000 7f4ddd93e700 1 --2- 172.21.15.26:0/902422417 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dd8093840 0x7f4dd8116000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:14.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.084+0000 7f4ddd93e700 1 -- 172.21.15.26:0/902422417 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd40092a0 con 0x7f4dd812c150 2023-10-01T07:52:14.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.084+0000 7f4ddd13d700 1 --2- 172.21.15.26:0/902422417 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dd8093840 0x7f4dd8116000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:14.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.084+0000 7f4ddc93c700 1 --2- 172.21.15.26:0/902422417 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dd8098c80 0x7f4dd81164f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:14.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.084+0000 7f4ddd93e700 1 --2- 172.21.15.26:0/902422417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dd812c150 0x7f4dd81169e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f4dd0002230 tx=0x7f4dd0007eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:14.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.084+0000 7f4dcd7fa700 1 -- 172.21.15.26:0/902422417 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd0005d30 con 0x7f4dd812c150 2023-10-01T07:52:14.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.084+0000 7f4dcd7fa700 1 -- 172.21.15.26:0/902422417 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd0007110 con 0x7f4dd812c150 2023-10-01T07:52:14.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.084+0000 7f4ddf3a1700 1 -- 172.21.15.26:0/902422417 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc80092a0 con 0x7f4dd812c150 2023-10-01T07:52:14.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.084+0000 7f4dcd7fa700 1 -- 172.21.15.26:0/902422417 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd00074d0 con 0x7f4dd812c150 2023-10-01T07:52:14.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.084+0000 7f4ddf3a1700 1 -- 172.21.15.26:0/902422417 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dd8119aa0 con 0x7f4dd812c150 2023-10-01T07:52:14.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.085+0000 7f4dcd7fa700 1 -- 172.21.15.26:0/902422417 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f4dd0013410 con 0x7f4dd812c150 2023-10-01T07:52:14.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.085+0000 7f4dcd7fa700 1 -- 172.21.15.26:0/902422417 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f4dd003afe0 con 0x7f4dd812c150 2023-10-01T07:52:14.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.085+0000 7f4ddf3a1700 1 -- 172.21.15.26:0/902422417 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dd805a260 con 0x7f4dd812c150 2023-10-01T07:52:14.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.090+0000 7f4dcd7fa700 1 -- 172.21.15.26:0/902422417 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f4dd00078c0 con 0x7f4dd812c150 2023-10-01T07:52:14.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.265+0000 7f4ddf3a1700 1 -- 172.21.15.26:0/902422417 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4dd80698c0 con 0x7f4dd812c150 2023-10-01T07:52:14.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.266+0000 7f4dcd7fa700 1 -- 172.21.15.26:0/902422417 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4dd001a300 con 0x7f4dd812c150 2023-10-01T07:52:14.267 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-01T07:52:14.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.268+0000 7f4ddf3a1700 1 -- 172.21.15.26:0/902422417 >> v1:172.21.15.26:6816/118178 conn(0x7f4dbc02bb60 legacy=0x7f4dbc02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:14.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.268+0000 7f4ddf3a1700 1 -- 172.21.15.26:0/902422417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dd812c150 msgr2=0x7f4dd81169e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:14.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.268+0000 7f4ddf3a1700 1 --2- 172.21.15.26:0/902422417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dd812c150 0x7f4dd81169e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f4dd0002230 tx=0x7f4dd0007eb0).stop 2023-10-01T07:52:14.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.268+0000 7f4ddf3a1700 1 -- 172.21.15.26:0/902422417 shutdown_connections 2023-10-01T07:52:14.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.268+0000 7f4ddf3a1700 1 --2- 172.21.15.26:0/902422417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dd812c150 0x7f4dd81169e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:14.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.268+0000 7f4ddf3a1700 1 --2- 172.21.15.26:0/902422417 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dd8093840 0x7f4dd8116000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:14.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.268+0000 7f4ddf3a1700 1 --2- 172.21.15.26:0/902422417 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dd8098c80 0x7f4dd81164f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:14.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.268+0000 7f4ddf3a1700 1 -- 172.21.15.26:0/902422417 >> 172.21.15.26:0/902422417 conn(0x7f4dd8097480 msgr2=0x7f4dd8095c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:14.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.268+0000 7f4ddf3a1700 1 -- 172.21.15.26:0/902422417 shutdown_connections 2023-10-01T07:52:14.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.268+0000 7f4ddf3a1700 1 -- 172.21.15.26:0/902422417 wait complete. 2023-10-01T07:52:14.282 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-01T07:52:14.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.411+0000 7fcf39ce1700 1 Processor -- start 2023-10-01T07:52:14.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.411+0000 7fcf39ce1700 1 -- start start 2023-10-01T07:52:14.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.411+0000 7fcf39ce1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf34059070 0x7fcf34127890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:14.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.411+0000 7fcf39ce1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcf34127390 0x7fcf34127d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:14.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.411+0000 7fcf39ce1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf34091b60 con 0x7fcf34095370 2023-10-01T07:52:14.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.411+0000 7fcf39ce1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf34059450 con 0x7fcf34127390 2023-10-01T07:52:14.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.411+0000 7fcf39ce1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf340968c0 con 0x7fcf34059070 2023-10-01T07:52:14.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.412+0000 7fcf32ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcf34127390 0x7fcf34127d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:14.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.412+0000 7fcf337fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf34059070 0x7fcf34127890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:14.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.412+0000 7fcf337fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf34059070 0x7fcf34127890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55428/0 (socket says 172.21.15.26:55428) 2023-10-01T07:52:14.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.412+0000 7fcf32ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcf34127390 0x7fcf34127d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44128/0 (socket says 172.21.15.26:44128) 2023-10-01T07:52:14.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.412+0000 7fcf337fe700 1 -- 172.21.15.26:0/4116632673 learned_addr learned my addr 172.21.15.26:0/4116632673 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:14.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.412+0000 7fcf33fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fcf34095370 0x7fcf34095820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56544/0 (socket says 172.21.15.26:56544) 2023-10-01T07:52:14.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.412+0000 7fcf337fe700 1 -- 172.21.15.26:0/4116632673 >> v2:172.21.15.26:3300/0 conn(0x7fcf34127390 msgr2=0x7fcf34127d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:14.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.412+0000 7fcf337fe700 1 --2- 172.21.15.26:0/4116632673 >> v2:172.21.15.26:3300/0 conn(0x7fcf34127390 0x7fcf34127d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:14.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.412+0000 7fcf337fe700 1 -- 172.21.15.26:0/4116632673 >> v1:172.21.15.26:6789/0 conn(0x7fcf34095370 legacy=0x7fcf34095820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:14.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.412+0000 7fcf327fc700 1 -- 172.21.15.26:0/4116632673 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2338423608 0 0) 0x7fcf34091b60 con 0x7fcf34095370 2023-10-01T07:52:14.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.412+0000 7fcf337fe700 1 -- 172.21.15.26:0/4116632673 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf34092a10 con 0x7fcf34059070 2023-10-01T07:52:14.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.412+0000 7fcf32ffd700 1 --2- 172.21.15.26:0/4116632673 >> v2:172.21.15.26:3300/0 conn(0x7fcf34127390 0x7fcf34127d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:14.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.412+0000 7fcf337fe700 1 --2- 172.21.15.26:0/4116632673 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf34059070 0x7fcf34127890 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fcf24009830 tx=0x7fcf240090f0).ready entity=mon.2 client_cookie=d971f019a8d0250d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:14.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.412+0000 7fcf327fc700 1 -- 172.21.15.26:0/4116632673 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2400b580 con 0x7fcf34059070 2023-10-01T07:52:14.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.412+0000 7fcf327fc700 1 -- 172.21.15.26:0/4116632673 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2400b6e0 con 0x7fcf34059070 2023-10-01T07:52:14.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.412+0000 7fcf327fc700 1 -- 172.21.15.26:0/4116632673 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2400ba80 con 0x7fcf34059070 2023-10-01T07:52:14.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.413+0000 7fcf39ce1700 1 -- 172.21.15.26:0/4116632673 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf34059070 msgr2=0x7fcf34127890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:14.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.413+0000 7fcf39ce1700 1 --2- 172.21.15.26:0/4116632673 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf34059070 0x7fcf34127890 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fcf24009830 tx=0x7fcf240090f0).stop 2023-10-01T07:52:14.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.413+0000 7fcf39ce1700 1 -- 172.21.15.26:0/4116632673 shutdown_connections 2023-10-01T07:52:14.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.413+0000 7fcf39ce1700 1 --2- 172.21.15.26:0/4116632673 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf34059070 0x7fcf34127890 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:14.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.413+0000 7fcf39ce1700 1 --2- 172.21.15.26:0/4116632673 >> v2:172.21.15.26:3300/0 conn(0x7fcf34127390 0x7fcf34127d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:14.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.413+0000 7fcf39ce1700 1 -- 172.21.15.26:0/4116632673 >> 172.21.15.26:0/4116632673 conn(0x7fcf34097470 msgr2=0x7fcf34097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:14.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.413+0000 7fcf39ce1700 1 -- 172.21.15.26:0/4116632673 shutdown_connections 2023-10-01T07:52:14.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.413+0000 7fcf39ce1700 1 -- 172.21.15.26:0/4116632673 wait complete. 2023-10-01T07:52:14.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.414+0000 7fcf39ce1700 1 Processor -- start 2023-10-01T07:52:14.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.414+0000 7fcf39ce1700 1 -- start start 2023-10-01T07:52:14.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.415+0000 7fcf39ce1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf34059070 0x7fcf341188f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:14.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.415+0000 7fcf39ce1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf34095370 0x7fcf34114950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:14.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.415+0000 7fcf39ce1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf34127390 0x7fcf34114e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:14.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.415+0000 7fcf39ce1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf34116db0 con 0x7fcf34095370 2023-10-01T07:52:14.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.415+0000 7fcf39ce1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf34125a20 con 0x7fcf34127390 2023-10-01T07:52:14.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.415+0000 7fcf39ce1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf34129070 con 0x7fcf34059070 2023-10-01T07:52:14.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.415+0000 7fcf32ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf34095370 0x7fcf34114950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:14.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.415+0000 7fcf337fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf34059070 0x7fcf341188f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:14.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.415+0000 7fcf33fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf34127390 0x7fcf34114e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:14.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.415+0000 7fcf32ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf34095370 0x7fcf34114950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44136/0 (socket says 172.21.15.26:44136) 2023-10-01T07:52:14.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.415+0000 7fcf32ffd700 1 -- 172.21.15.26:0/1422259852 learned_addr learned my addr 172.21.15.26:0/1422259852 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:14.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.416+0000 7fcf337fe700 1 -- 172.21.15.26:0/1422259852 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf34127390 msgr2=0x7fcf34114e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:14.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.416+0000 7fcf337fe700 1 --2- 172.21.15.26:0/1422259852 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf34127390 0x7fcf34114e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:14.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.416+0000 7fcf337fe700 1 -- 172.21.15.26:0/1422259852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf34095370 msgr2=0x7fcf34114950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:14.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.416+0000 7fcf337fe700 1 --2- 172.21.15.26:0/1422259852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf34095370 0x7fcf34114950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:14.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.416+0000 7fcf337fe700 1 -- 172.21.15.26:0/1422259852 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf280092a0 con 0x7fcf34059070 2023-10-01T07:52:14.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.416+0000 7fcf33fff700 1 --2- 172.21.15.26:0/1422259852 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf34127390 0x7fcf34114e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:14.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.416+0000 7fcf337fe700 1 --2- 172.21.15.26:0/1422259852 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf34059070 0x7fcf341188f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fcf24006fd0 tx=0x7fcf24017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:14.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.416+0000 7fcf1b7fe700 1 -- 172.21.15.26:0/1422259852 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2400b580 con 0x7fcf34059070 2023-10-01T07:52:14.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.416+0000 7fcf1b7fe700 1 -- 172.21.15.26:0/1422259852 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2400be40 con 0x7fcf34059070 2023-10-01T07:52:14.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.416+0000 7fcf39ce1700 1 -- 172.21.15.26:0/1422259852 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf24009370 con 0x7fcf34059070 2023-10-01T07:52:14.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.416+0000 7fcf1b7fe700 1 -- 172.21.15.26:0/1422259852 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2400ba80 con 0x7fcf34059070 2023-10-01T07:52:14.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.416+0000 7fcf39ce1700 1 -- 172.21.15.26:0/1422259852 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf341164e0 con 0x7fcf34059070 2023-10-01T07:52:14.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.417+0000 7fcf1b7fe700 1 -- 172.21.15.26:0/1422259852 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fcf2401c630 con 0x7fcf34059070 2023-10-01T07:52:14.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.417+0000 7fcf1b7fe700 1 -- 172.21.15.26:0/1422259852 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fcf2403cc20 con 0x7fcf34059070 2023-10-01T07:52:14.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.417+0000 7fcf39ce1700 1 -- 172.21.15.26:0/1422259852 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf34091d80 con 0x7fcf34059070 2023-10-01T07:52:14.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.422+0000 7fcf1b7fe700 1 -- 172.21.15.26:0/1422259852 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fcf2402a020 con 0x7fcf34059070 2023-10-01T07:52:14.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.640+0000 7fcf39ce1700 1 -- 172.21.15.26:0/1422259852 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf3405a260 con 0x7fcf34059070 2023-10-01T07:52:14.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.641+0000 7fcf1b7fe700 1 -- 172.21.15.26:0/1422259852 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2156 (secure 0 0 0) 0x7fcf24034090 con 0x7fcf34059070 2023-10-01T07:52:14.642 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:52:14.643 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-01T07:51:57.295264+0000","modified":"2023-10-01T07:52:00.301728+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4189},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4189":{"gid":4189,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6817/2857714939","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6817","nonce":2857714939}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-01T07:52:14.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.643+0000 7fcf39ce1700 1 -- 172.21.15.26:0/1422259852 >> v1:172.21.15.26:6816/118178 conn(0x7fcf2002bb60 legacy=0x7fcf2002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:14.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.643+0000 7fcf39ce1700 1 -- 172.21.15.26:0/1422259852 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf34059070 msgr2=0x7fcf341188f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:14.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.643+0000 7fcf39ce1700 1 --2- 172.21.15.26:0/1422259852 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf34059070 0x7fcf341188f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fcf24006fd0 tx=0x7fcf24017000).stop 2023-10-01T07:52:14.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.643+0000 7fcf39ce1700 1 -- 172.21.15.26:0/1422259852 shutdown_connections 2023-10-01T07:52:14.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.643+0000 7fcf39ce1700 1 --2- 172.21.15.26:0/1422259852 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf34127390 0x7fcf34114e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:14.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.643+0000 7fcf39ce1700 1 --2- 172.21.15.26:0/1422259852 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf34059070 0x7fcf341188f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:14.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.643+0000 7fcf39ce1700 1 --2- 172.21.15.26:0/1422259852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf34095370 0x7fcf34114950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:14.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.643+0000 7fcf39ce1700 1 -- 172.21.15.26:0/1422259852 >> 172.21.15.26:0/1422259852 conn(0x7fcf34097470 msgr2=0x7fcf34099ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:14.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.643+0000 7fcf39ce1700 1 -- 172.21.15.26:0/1422259852 shutdown_connections 2023-10-01T07:52:14.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.643+0000 7fcf39ce1700 1 -- 172.21.15.26:0/1422259852 wait complete. 2023-10-01T07:52:14.646 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 6 2023-10-01T07:52:14.658 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-01T07:52:14.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.789+0000 7f41c69f0700 1 Processor -- start 2023-10-01T07:52:14.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.789+0000 7f41c69f0700 1 -- start start 2023-10-01T07:52:14.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.789+0000 7f41c69f0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f41c0096380 0x7f41c0094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:14.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.789+0000 7f41c69f0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41c0091b00 0x7f41c0127600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:14.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.789+0000 7f41c69f0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41c0094c20 0x7f41c0127af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:14.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.789+0000 7f41c69f0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c0096760 con 0x7f41c0096380 2023-10-01T07:52:14.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.789+0000 7f41c69f0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c0091ff0 con 0x7f41c0094c20 2023-10-01T07:52:14.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.789+0000 7f41c69f0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41c0092c80 con 0x7f41c0091b00 2023-10-01T07:52:14.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.789+0000 7f41bf7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41c0091b00 0x7f41c0127600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:14.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.789+0000 7f41c4f8d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41c0094c20 0x7f41c0127af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:14.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.789+0000 7f41bffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f41c0096380 0x7f41c0094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:14.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.789+0000 7f41bf7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41c0091b00 0x7f41c0127600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55456/0 (socket says 172.21.15.26:55456) 2023-10-01T07:52:14.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.789+0000 7f41c4f8d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41c0094c20 0x7f41c0127af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58370/0 (socket says 172.21.15.26:58370) 2023-10-01T07:52:14.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.789+0000 7f41bf7fe700 1 -- 172.21.15.26:0/1412130682 learned_addr learned my addr 172.21.15.26:0/1412130682 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:14.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.790+0000 7f41c4f8d700 1 -- 172.21.15.26:0/1412130682 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41c0091b00 msgr2=0x7f41c0127600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:14.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.790+0000 7f41c4f8d700 1 --2- 172.21.15.26:0/1412130682 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41c0091b00 0x7f41c0127600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:14.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.790+0000 7f41c4f8d700 1 -- 172.21.15.26:0/1412130682 >> v2:172.21.15.26:3300/0 conn(0x7f41c0096380 msgr2=0x7f41c0094730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:14.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.790+0000 7f41c4f8d700 1 --2- 172.21.15.26:0/1412130682 >> v2:172.21.15.26:3300/0 conn(0x7f41c0096380 0x7f41c0094730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:14.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.790+0000 7f41c4f8d700 1 -- 172.21.15.26:0/1412130682 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c0093900 con 0x7f41c0094c20 2023-10-01T07:52:14.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.790+0000 7f41bf7fe700 1 --2- 172.21.15.26:0/1412130682 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41c0091b00 0x7f41c0127600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:14.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.790+0000 7f41bffff700 1 --2- 172.21.15.26:0/1412130682 >> v2:172.21.15.26:3300/0 conn(0x7f41c0096380 0x7f41c0094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:14.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.790+0000 7f41c4f8d700 1 --2- 172.21.15.26:0/1412130682 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41c0094c20 0x7f41c0127af0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f41b8009e60 tx=0x7f41b8009780).ready entity=mon.1 client_cookie=4d1b9165e5608f2d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:14.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.790+0000 7f41beffd700 1 -- 172.21.15.26:0/1412130682 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b800bab0 con 0x7f41c0094c20 2023-10-01T07:52:14.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.790+0000 7f41beffd700 1 -- 172.21.15.26:0/1412130682 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b800bc10 con 0x7f41c0094c20 2023-10-01T07:52:14.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.790+0000 7f41beffd700 1 -- 172.21.15.26:0/1412130682 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b8011480 con 0x7f41c0094c20 2023-10-01T07:52:14.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.791+0000 7f41c69f0700 1 -- 172.21.15.26:0/1412130682 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41c0094c20 msgr2=0x7f41c0127af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:14.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.791+0000 7f41c69f0700 1 --2- 172.21.15.26:0/1412130682 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41c0094c20 0x7f41c0127af0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f41b8009e60 tx=0x7f41b8009780).stop 2023-10-01T07:52:14.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.791+0000 7f41c69f0700 1 -- 172.21.15.26:0/1412130682 shutdown_connections 2023-10-01T07:52:14.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.791+0000 7f41c69f0700 1 --2- 172.21.15.26:0/1412130682 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41c0094c20 0x7f41c0127af0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:14.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.791+0000 7f41c69f0700 1 --2- 172.21.15.26:0/1412130682 >> v2:172.21.15.26:3300/0 conn(0x7f41c0096380 0x7f41c0094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:14.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.791+0000 7f41c69f0700 1 --2- 172.21.15.26:0/1412130682 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41c0091b00 0x7f41c0127600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:14.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.791+0000 7f41c69f0700 1 -- 172.21.15.26:0/1412130682 >> 172.21.15.26:0/1412130682 conn(0x7f41c0097470 msgr2=0x7f41c0097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:14.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.791+0000 7f41c69f0700 1 -- 172.21.15.26:0/1412130682 shutdown_connections 2023-10-01T07:52:14.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.791+0000 7f41c69f0700 1 -- 172.21.15.26:0/1412130682 wait complete. 2023-10-01T07:52:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.792+0000 7f41c69f0700 1 Processor -- start 2023-10-01T07:52:14.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.792+0000 7f41c69f0700 1 -- start start 2023-10-01T07:52:14.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.792+0000 7f41c69f0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41c0091b00 0x7f41c011aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:14.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.792+0000 7f41c69f0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41c0094c20 0x7f41c0116f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:14.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.792+0000 7f41c69f0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41c0096380 0x7f41c0117400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:14.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.792+0000 7f41c69f0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c01195a0 con 0x7f41c0091b00 2023-10-01T07:52:14.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.792+0000 7f41c69f0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c0098b30 con 0x7f41c0094c20 2023-10-01T07:52:14.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.792+0000 7f41c69f0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41c006a520 con 0x7f41c0096380 2023-10-01T07:52:14.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.792+0000 7f41bf7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41c0094c20 0x7f41c0116f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:14.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.792+0000 7f41c4f8d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41c0096380 0x7f41c0117400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:14.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.792+0000 7f41bf7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41c0094c20 0x7f41c0116f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58384/0 (socket says 172.21.15.26:58384) 2023-10-01T07:52:14.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.792+0000 7f41bf7fe700 1 -- 172.21.15.26:0/854803273 learned_addr learned my addr 172.21.15.26:0/854803273 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:14.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.792+0000 7f41bffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41c0091b00 0x7f41c011aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:14.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.793+0000 7f41bffff700 1 -- 172.21.15.26:0/854803273 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41c0096380 msgr2=0x7f41c0117400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:14.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.793+0000 7f41bffff700 1 --2- 172.21.15.26:0/854803273 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41c0096380 0x7f41c0117400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:14.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.793+0000 7f41bffff700 1 -- 172.21.15.26:0/854803273 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41c0094c20 msgr2=0x7f41c0116f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:14.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.793+0000 7f41bffff700 1 --2- 172.21.15.26:0/854803273 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41c0094c20 0x7f41c0116f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:14.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.793+0000 7f41bffff700 1 -- 172.21.15.26:0/854803273 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b4009370 con 0x7f41c0091b00 2023-10-01T07:52:14.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.793+0000 7f41bf7fe700 1 --2- 172.21.15.26:0/854803273 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41c0094c20 0x7f41c0116f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:14.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.793+0000 7f41c4f8d700 1 --2- 172.21.15.26:0/854803273 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41c0096380 0x7f41c0117400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:14.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.793+0000 7f41bffff700 1 --2- 172.21.15.26:0/854803273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41c0091b00 0x7f41c011aed0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f41b000e9b0 tx=0x7f41b0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:14.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.793+0000 7f41a7fff700 1 -- 172.21.15.26:0/854803273 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b0009580 con 0x7f41c0091b00 2023-10-01T07:52:14.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.793+0000 7f41a7fff700 1 -- 172.21.15.26:0/854803273 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b0012600 con 0x7f41c0091b00 2023-10-01T07:52:14.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.793+0000 7f41c69f0700 1 -- 172.21.15.26:0/854803273 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41b00092a0 con 0x7f41c0091b00 2023-10-01T07:52:14.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.793+0000 7f41a7fff700 1 -- 172.21.15.26:0/854803273 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b0012980 con 0x7f41c0091b00 2023-10-01T07:52:14.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.793+0000 7f41c69f0700 1 -- 172.21.15.26:0/854803273 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41b8009a20 con 0x7f41c0091b00 2023-10-01T07:52:14.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.794+0000 7f41a7fff700 1 -- 172.21.15.26:0/854803273 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f41b001b400 con 0x7f41c0091b00 2023-10-01T07:52:14.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.794+0000 7f41a7fff700 1 -- 172.21.15.26:0/854803273 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f41b003b360 con 0x7f41c0091b00 2023-10-01T07:52:14.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.794+0000 7f41c69f0700 1 -- 172.21.15.26:0/854803273 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41c0099920 con 0x7f41c0091b00 2023-10-01T07:52:14.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.799+0000 7f41a7fff700 1 -- 172.21.15.26:0/854803273 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f41b0019310 con 0x7f41c0091b00 2023-10-01T07:52:14.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.977+0000 7f41c69f0700 1 -- 172.21.15.26:0/854803273 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41c00942e0 con 0x7f41c0091b00 2023-10-01T07:52:14.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.978+0000 7f41a7fff700 1 -- 172.21.15.26:0/854803273 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11341 (secure 0 0 0) 0x7f41b0029090 con 0x7f41c0091b00 2023-10-01T07:52:14.980 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:52:14.980 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":17,"fsid":"c29fb19d-520c-42a6-90f4-e7f86de96e8e","created":"2023-10-01T07:51:40.702414+0000","modified":"2023-10-01T07:51:58.296715+0000","last_up_change":"2023-10-01T07:51:48.849482+0000","last_in_change":"2023-10-01T07:51:42.084736+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-01T07:51:48.906889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-01T07:51:50.071599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-01T07:51:54.981575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-01T07:51:56.286318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46569ce3-81d1-44a1-a649-691de3e6f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6800","nonce":118773}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6801","nonce":118773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6803","nonce":118773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6802","nonce":118773}]},"public_addr":"172.21.15.26:6800/118773","cluster_addr":"172.21.15.26:6801/118773","heartbeat_back_addr":"172.21.15.26:6803/118773","heartbeat_front_addr":"172.21.15.26:6802/118773","state":["exists","up"]},{"osd":1,"uuid":"1fc1ba9b-4110-4d31-96d6-794937578cff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6804","nonce":118782}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6806","nonce":118782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6810","nonce":118782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6808","nonce":118782}]},"public_addr":"172.21.15.26:6804/118782","cluster_addr":"172.21.15.26:6806/118782","heartbeat_back_addr":"172.21.15.26:6810/118782","heartbeat_front_addr":"172.21.15.26:6808/118782","state":["exists","up"]},{"osd":2,"uuid":"37de933d-3b8e-4b94-87bd-2f36896c7ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6805","nonce":118789}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6807","nonce":118789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6811","nonce":118789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6809","nonce":118789}]},"public_addr":"172.21.15.26:6805/118789","cluster_addr":"172.21.15.26:6807/118789","heartbeat_back_addr":"172.21.15.26:6811/118789","heartbeat_front_addr":"172.21.15.26:6809/118789","state":["exists","up"]},{"osd":3,"uuid":"bd020309-5fd2-4d97-b36a-67e159fa3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6812","nonce":118790}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6813","nonce":118790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6815","nonce":118790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6814","nonce":118790}]},"public_addr":"172.21.15.26:6812/118790","cluster_addr":"172.21.15.26:6813/118790","heartbeat_back_addr":"172.21.15.26:6815/118790","heartbeat_front_addr":"172.21.15.26:6814/118790","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.029993+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.266503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.273540+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.229731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-01T07:52:14.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.980+0000 7f41c69f0700 1 -- 172.21.15.26:0/854803273 >> v1:172.21.15.26:6816/118178 conn(0x7f41ac02bb60 legacy=0x7f41ac02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:14.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.980+0000 7f41c69f0700 1 -- 172.21.15.26:0/854803273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41c0091b00 msgr2=0x7f41c011aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:14.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.980+0000 7f41c69f0700 1 --2- 172.21.15.26:0/854803273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41c0091b00 0x7f41c011aed0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f41b000e9b0 tx=0x7f41b0009060).stop 2023-10-01T07:52:14.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.980+0000 7f41c69f0700 1 -- 172.21.15.26:0/854803273 shutdown_connections 2023-10-01T07:52:14.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.980+0000 7f41c69f0700 1 --2- 172.21.15.26:0/854803273 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41c0096380 0x7f41c0117400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:14.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.980+0000 7f41c69f0700 1 --2- 172.21.15.26:0/854803273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41c0091b00 0x7f41c011aed0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:14.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.980+0000 7f41c69f0700 1 --2- 172.21.15.26:0/854803273 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41c0094c20 0x7f41c0116f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:14.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.980+0000 7f41c69f0700 1 -- 172.21.15.26:0/854803273 >> 172.21.15.26:0/854803273 conn(0x7f41c0097470 msgr2=0x7f41c0127640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:14.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.980+0000 7f41c69f0700 1 -- 172.21.15.26:0/854803273 shutdown_connections 2023-10-01T07:52:14.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:14.980+0000 7f41c69f0700 1 -- 172.21.15.26:0/854803273 wait complete. 2023-10-01T07:52:14.995 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-01T07:52:15.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.124+0000 7f343f966700 1 Processor -- start 2023-10-01T07:52:15.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.124+0000 7f343f966700 1 -- start start 2023-10-01T07:52:15.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.124+0000 7f343f966700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3438096380 0x7f3438094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:15.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.125+0000 7f343f966700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3438091b00 0x7f3438127600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:15.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.125+0000 7f343f966700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3438094c20 0x7f3438127af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:15.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.125+0000 7f343f966700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3438096760 con 0x7f3438096380 2023-10-01T07:52:15.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.125+0000 7f343f966700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3438091ff0 con 0x7f3438094c20 2023-10-01T07:52:15.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.125+0000 7f343f966700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3438092c80 con 0x7f3438091b00 2023-10-01T07:52:15.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.125+0000 7f343cf01700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3438091b00 0x7f3438127600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:15.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.125+0000 7f343d702700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3438096380 0x7f3438094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:15.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.125+0000 7f343df03700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3438094c20 0x7f3438127af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:15.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.125+0000 7f343d702700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3438096380 0x7f3438094730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44178/0 (socket says 172.21.15.26:44178) 2023-10-01T07:52:15.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.125+0000 7f343df03700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3438094c20 0x7f3438127af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58388/0 (socket says 172.21.15.26:58388) 2023-10-01T07:52:15.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.125+0000 7f343cf01700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3438091b00 0x7f3438127600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55466/0 (socket says 172.21.15.26:55466) 2023-10-01T07:52:15.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.125+0000 7f343d702700 1 -- 172.21.15.26:0/450867404 learned_addr learned my addr 172.21.15.26:0/450867404 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:15.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.125+0000 7f343d702700 1 -- 172.21.15.26:0/450867404 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3438091b00 msgr2=0x7f3438127600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:15.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.125+0000 7f343d702700 1 --2- 172.21.15.26:0/450867404 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3438091b00 0x7f3438127600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.125+0000 7f343d702700 1 -- 172.21.15.26:0/450867404 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3438094c20 msgr2=0x7f3438127af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:15.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.125+0000 7f343d702700 1 --2- 172.21.15.26:0/450867404 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3438094c20 0x7f3438127af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.125+0000 7f343d702700 1 -- 172.21.15.26:0/450867404 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3438093900 con 0x7f3438096380 2023-10-01T07:52:15.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.125+0000 7f343df03700 1 --2- 172.21.15.26:0/450867404 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3438094c20 0x7f3438127af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:15.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.125+0000 7f343cf01700 1 --2- 172.21.15.26:0/450867404 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3438091b00 0x7f3438127600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:15.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.125+0000 7f343d702700 1 --2- 172.21.15.26:0/450867404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3438096380 0x7f3438094730 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f3434006fd0 tx=0x7f343400b3b0).ready entity=mon.0 client_cookie=89460598031cbe4a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:15.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.125+0000 7f342ffff700 1 -- 172.21.15.26:0/450867404 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343400da70 con 0x7f3438096380 2023-10-01T07:52:15.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.125+0000 7f342ffff700 1 -- 172.21.15.26:0/450867404 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343400dbd0 con 0x7f3438096380 2023-10-01T07:52:15.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.125+0000 7f342ffff700 1 -- 172.21.15.26:0/450867404 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3434010470 con 0x7f3438096380 2023-10-01T07:52:15.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.126+0000 7f343f966700 1 -- 172.21.15.26:0/450867404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3438096380 msgr2=0x7f3438094730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:15.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.126+0000 7f343f966700 1 --2- 172.21.15.26:0/450867404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3438096380 0x7f3438094730 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f3434006fd0 tx=0x7f343400b3b0).stop 2023-10-01T07:52:15.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.126+0000 7f343f966700 1 -- 172.21.15.26:0/450867404 shutdown_connections 2023-10-01T07:52:15.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.126+0000 7f343f966700 1 --2- 172.21.15.26:0/450867404 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3438094c20 0x7f3438127af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.126+0000 7f343f966700 1 --2- 172.21.15.26:0/450867404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3438096380 0x7f3438094730 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.126+0000 7f343f966700 1 --2- 172.21.15.26:0/450867404 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3438091b00 0x7f3438127600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.126+0000 7f343f966700 1 -- 172.21.15.26:0/450867404 >> 172.21.15.26:0/450867404 conn(0x7f3438097470 msgr2=0x7f3438097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:15.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.126+0000 7f343f966700 1 -- 172.21.15.26:0/450867404 shutdown_connections 2023-10-01T07:52:15.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.126+0000 7f343f966700 1 -- 172.21.15.26:0/450867404 wait complete. 2023-10-01T07:52:15.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.127+0000 7f343f966700 1 Processor -- start 2023-10-01T07:52:15.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.128+0000 7f343f966700 1 -- start start 2023-10-01T07:52:15.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.128+0000 7f343f966700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3438091b00 0x7f3438124af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:15.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.128+0000 7f343f966700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3438094c20 0x7f3438112af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:15.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.128+0000 7f343f966700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3438096380 0x7f3438112fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:15.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.128+0000 7f343f966700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3438116f20 con 0x7f3438096380 2023-10-01T07:52:15.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.128+0000 7f343f966700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3438116270 con 0x7f3438091b00 2023-10-01T07:52:15.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.128+0000 7f343f966700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3438116a50 con 0x7f3438094c20 2023-10-01T07:52:15.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.129+0000 7f343cf01700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3438094c20 0x7f3438112af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:15.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.129+0000 7f343d702700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3438091b00 0x7f3438124af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:15.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.129+0000 7f343cf01700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3438094c20 0x7f3438112af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55470/0 (socket says 172.21.15.26:55470) 2023-10-01T07:52:15.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.129+0000 7f343d702700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3438091b00 0x7f3438124af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58396/0 (socket says 172.21.15.26:58396) 2023-10-01T07:52:15.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.129+0000 7f343cf01700 1 -- 172.21.15.26:0/1157291305 learned_addr learned my addr 172.21.15.26:0/1157291305 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:15.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.129+0000 7f343df03700 1 --2- 172.21.15.26:0/1157291305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3438096380 0x7f3438112fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:15.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.129+0000 7f343cf01700 1 -- 172.21.15.26:0/1157291305 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3438091b00 msgr2=0x7f3438124af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:15.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.129+0000 7f343cf01700 1 --2- 172.21.15.26:0/1157291305 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3438091b00 0x7f3438124af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.129+0000 7f343cf01700 1 -- 172.21.15.26:0/1157291305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3438096380 msgr2=0x7f3438112fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:15.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.129+0000 7f343cf01700 1 --2- 172.21.15.26:0/1157291305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3438096380 0x7f3438112fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.129+0000 7f343cf01700 1 -- 172.21.15.26:0/1157291305 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34280092a0 con 0x7f3438094c20 2023-10-01T07:52:15.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.129+0000 7f343cf01700 1 --2- 172.21.15.26:0/1157291305 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3438094c20 0x7f3438112af0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f342800ea20 tx=0x7f3428009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:15.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.129+0000 7f342d7fa700 1 -- 172.21.15.26:0/1157291305 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342800c850 con 0x7f3438094c20 2023-10-01T07:52:15.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.129+0000 7f342d7fa700 1 -- 172.21.15.26:0/1157291305 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342800c9b0 con 0x7f3438094c20 2023-10-01T07:52:15.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.129+0000 7f343f966700 1 -- 172.21.15.26:0/1157291305 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3430009a20 con 0x7f3438094c20 2023-10-01T07:52:15.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.129+0000 7f342d7fa700 1 -- 172.21.15.26:0/1157291305 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342800cd30 con 0x7f3438094c20 2023-10-01T07:52:15.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.129+0000 7f343f966700 1 -- 172.21.15.26:0/1157291305 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f343400b610 con 0x7f3438094c20 2023-10-01T07:52:15.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.130+0000 7f342d7fa700 1 -- 172.21.15.26:0/1157291305 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f3428012600 con 0x7f3438094c20 2023-10-01T07:52:15.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.130+0000 7f342d7fa700 1 -- 172.21.15.26:0/1157291305 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f342803b620 con 0x7f3438094c20 2023-10-01T07:52:15.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.131+0000 7f343f966700 1 -- 172.21.15.26:0/1157291305 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34381163b0 con 0x7f3438094c20 2023-10-01T07:52:15.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.135+0000 7f342d7fa700 1 -- 172.21.15.26:0/1157291305 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f34381163b0 con 0x7f3438094c20 2023-10-01T07:52:15.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.356+0000 7f343f966700 1 -- 172.21.15.26:0/1157291305 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34381163b0 con 0x7f3438094c20 2023-10-01T07:52:15.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.357+0000 7f342d7fa700 1 -- 172.21.15.26:0/1157291305 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2156 (secure 0 0 0) 0x7f34381163b0 con 0x7f3438094c20 2023-10-01T07:52:15.358 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:52:15.358 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-01T07:51:57.295264+0000","modified":"2023-10-01T07:52:00.301728+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4189},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4189":{"gid":4189,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6817/2857714939","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6817","nonce":2857714939}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-01T07:52:15.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.359+0000 7f343f966700 1 -- 172.21.15.26:0/1157291305 >> v1:172.21.15.26:6816/118178 conn(0x7f341c02bb60 legacy=0x7f341c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:15.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.359+0000 7f343f966700 1 -- 172.21.15.26:0/1157291305 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3438094c20 msgr2=0x7f3438112af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:15.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.359+0000 7f343f966700 1 --2- 172.21.15.26:0/1157291305 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3438094c20 0x7f3438112af0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f342800ea20 tx=0x7f3428009060).stop 2023-10-01T07:52:15.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.359+0000 7f343f966700 1 -- 172.21.15.26:0/1157291305 shutdown_connections 2023-10-01T07:52:15.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.359+0000 7f343f966700 1 --2- 172.21.15.26:0/1157291305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3438096380 0x7f3438112fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.359+0000 7f343f966700 1 --2- 172.21.15.26:0/1157291305 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3438091b00 0x7f3438124af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.359+0000 7f343f966700 1 --2- 172.21.15.26:0/1157291305 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3438094c20 0x7f3438112af0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.359+0000 7f343f966700 1 -- 172.21.15.26:0/1157291305 >> 172.21.15.26:0/1157291305 conn(0x7f3438097470 msgr2=0x7f3438126d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:15.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.359+0000 7f343f966700 1 -- 172.21.15.26:0/1157291305 shutdown_connections 2023-10-01T07:52:15.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.359+0000 7f343f966700 1 -- 172.21.15.26:0/1157291305 wait complete. 2023-10-01T07:52:15.361 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 6 2023-10-01T07:52:15.474 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-01T07:51:57.295264+0000', 'modified': '2023-10-01T07:52:00.301728+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4189}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4189': {'gid': 4189, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.26:6817/2857714939', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.26:6817', 'nonce': 2857714939}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-01T07:52:15.474 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-01T07:52:15.474 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-01T07:52:15.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.609+0000 7f4d0daa0700 1 Processor -- start 2023-10-01T07:52:15.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.609+0000 7f4d0daa0700 1 -- start start 2023-10-01T07:52:15.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.610+0000 7f4d0daa0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d08096380 0x7f4d08094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:15.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.610+0000 7f4d0daa0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4d08091b00 0x7f4d08127600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:15.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.610+0000 7f4d0daa0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d08096760 con 0x7f4d08094c20 2023-10-01T07:52:15.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.610+0000 7f4d0daa0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d08091ff0 con 0x7f4d08096380 2023-10-01T07:52:15.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.610+0000 7f4d0daa0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d08092c80 con 0x7f4d08091b00 2023-10-01T07:52:15.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.610+0000 7f4d06ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4d08091b00 0x7f4d08127600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:15.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.610+0000 7f4d077fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d08096380 0x7f4d08094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:15.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.611+0000 7f4d077fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d08096380 0x7f4d08094730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58406/0 (socket says 172.21.15.26:58406) 2023-10-01T07:52:15.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.611+0000 7f4d06ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4d08091b00 0x7f4d08127600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55482/0 (socket says 172.21.15.26:55482) 2023-10-01T07:52:15.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.611+0000 7f4d077fe700 1 -- 172.21.15.26:0/378274232 learned_addr learned my addr 172.21.15.26:0/378274232 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:15.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.610+0000 7f4d07fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4d08094c20 0x7f4d08127af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56550/0 (socket says 172.21.15.26:56550) 2023-10-01T07:52:15.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.611+0000 7f4d067fc700 1 -- 172.21.15.26:0/378274232 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3059338273 0 0) 0x7f4d08096760 con 0x7f4d08094c20 2023-10-01T07:52:15.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.611+0000 7f4d06ffd700 1 -- 172.21.15.26:0/378274232 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d08096380 msgr2=0x7f4d08094730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:15.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.611+0000 7f4d06ffd700 1 --2- 172.21.15.26:0/378274232 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d08096380 0x7f4d08094730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.611+0000 7f4d06ffd700 1 -- 172.21.15.26:0/378274232 >> v1:172.21.15.26:6789/0 conn(0x7f4d08094c20 legacy=0x7f4d08127af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:15.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.611+0000 7f4d06ffd700 1 -- 172.21.15.26:0/378274232 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d08093900 con 0x7f4d08091b00 2023-10-01T07:52:15.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.611+0000 7f4d077fe700 1 --2- 172.21.15.26:0/378274232 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d08096380 0x7f4d08094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:15.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.611+0000 7f4d06ffd700 1 --2- 172.21.15.26:0/378274232 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4d08091b00 0x7f4d08127600 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f4cfc009790 tx=0x7f4cfc009060).ready entity=mon.2 client_cookie=318418d468e4a104 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:15.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.611+0000 7f4d067fc700 1 -- 172.21.15.26:0/378274232 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc00f510 con 0x7f4d08091b00 2023-10-01T07:52:15.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.611+0000 7f4d067fc700 1 -- 172.21.15.26:0/378274232 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cfc00f670 con 0x7f4d08091b00 2023-10-01T07:52:15.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.611+0000 7f4d067fc700 1 -- 172.21.15.26:0/378274232 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc00f9f0 con 0x7f4d08091b00 2023-10-01T07:52:15.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.612+0000 7f4d0daa0700 1 -- 172.21.15.26:0/378274232 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4d08091b00 msgr2=0x7f4d08127600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:15.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.612+0000 7f4d0daa0700 1 --2- 172.21.15.26:0/378274232 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4d08091b00 0x7f4d08127600 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f4cfc009790 tx=0x7f4cfc009060).stop 2023-10-01T07:52:15.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.612+0000 7f4d0daa0700 1 -- 172.21.15.26:0/378274232 shutdown_connections 2023-10-01T07:52:15.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.612+0000 7f4d0daa0700 1 --2- 172.21.15.26:0/378274232 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d08096380 0x7f4d08094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.612+0000 7f4d0daa0700 1 --2- 172.21.15.26:0/378274232 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4d08091b00 0x7f4d08127600 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.612+0000 7f4d0daa0700 1 -- 172.21.15.26:0/378274232 >> 172.21.15.26:0/378274232 conn(0x7f4d08097470 msgr2=0x7f4d08097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:15.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.612+0000 7f4d0daa0700 1 -- 172.21.15.26:0/378274232 shutdown_connections 2023-10-01T07:52:15.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.612+0000 7f4d0daa0700 1 -- 172.21.15.26:0/378274232 wait complete. 2023-10-01T07:52:15.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.613+0000 7f4d0daa0700 1 Processor -- start 2023-10-01T07:52:15.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.613+0000 7f4d0daa0700 1 -- start start 2023-10-01T07:52:15.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.614+0000 7f4d0daa0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d08091b00 0x7f4d0812e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:15.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.614+0000 7f4d0daa0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4d08094c20 0x7f4d0812b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:15.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.614+0000 7f4d0daa0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d08096380 0x7f4d0812e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:15.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.614+0000 7f4d0daa0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0812f970 con 0x7f4d08091b00 2023-10-01T07:52:15.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.614+0000 7f4d0daa0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0806a520 con 0x7f4d08096380 2023-10-01T07:52:15.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.614+0000 7f4d0daa0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0812d6e0 con 0x7f4d08094c20 2023-10-01T07:52:15.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.614+0000 7f4d06ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4d08094c20 0x7f4d0812b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:15.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.614+0000 7f4d077fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d08091b00 0x7f4d0812e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:15.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.614+0000 7f4d06ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4d08094c20 0x7f4d0812b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55488/0 (socket says 172.21.15.26:55488) 2023-10-01T07:52:15.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.614+0000 7f4d06ffd700 1 -- 172.21.15.26:0/3086423866 learned_addr learned my addr 172.21.15.26:0/3086423866 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:15.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.614+0000 7f4d07fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d08096380 0x7f4d0812e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:15.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.615+0000 7f4d06ffd700 1 -- 172.21.15.26:0/3086423866 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d08096380 msgr2=0x7f4d0812e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:15.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.615+0000 7f4d06ffd700 1 --2- 172.21.15.26:0/3086423866 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d08096380 0x7f4d0812e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.615+0000 7f4d06ffd700 1 -- 172.21.15.26:0/3086423866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d08091b00 msgr2=0x7f4d0812e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:15.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.615+0000 7f4d06ffd700 1 --2- 172.21.15.26:0/3086423866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d08091b00 0x7f4d0812e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.615+0000 7f4d06ffd700 1 -- 172.21.15.26:0/3086423866 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf8009370 con 0x7f4d08094c20 2023-10-01T07:52:15.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.615+0000 7f4d07fff700 1 --2- 172.21.15.26:0/3086423866 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d08096380 0x7f4d0812e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:15.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.615+0000 7f4d077fe700 1 --2- 172.21.15.26:0/3086423866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d08091b00 0x7f4d0812e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:15.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.615+0000 7f4d06ffd700 1 --2- 172.21.15.26:0/3086423866 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4d08094c20 0x7f4d0812b1f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f4d08092dc0 tx=0x7f4cfc017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:15.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.615+0000 7f4cef7fe700 1 -- 172.21.15.26:0/3086423866 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc00fe80 con 0x7f4d08094c20 2023-10-01T07:52:15.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.615+0000 7f4cef7fe700 1 -- 172.21.15.26:0/3086423866 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cfc00f7e0 con 0x7f4d08094c20 2023-10-01T07:52:15.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.615+0000 7f4d0daa0700 1 -- 172.21.15.26:0/3086423866 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cfc0092a0 con 0x7f4d08094c20 2023-10-01T07:52:15.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.615+0000 7f4cef7fe700 1 -- 172.21.15.26:0/3086423866 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc01b640 con 0x7f4d08094c20 2023-10-01T07:52:15.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.615+0000 7f4d0daa0700 1 -- 172.21.15.26:0/3086423866 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d08130450 con 0x7f4d08094c20 2023-10-01T07:52:15.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.616+0000 7f4cef7fe700 1 -- 172.21.15.26:0/3086423866 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f4cfc01ba30 con 0x7f4d08094c20 2023-10-01T07:52:15.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.616+0000 7f4cef7fe700 1 -- 172.21.15.26:0/3086423866 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f4cfc03c840 con 0x7f4d08094c20 2023-10-01T07:52:15.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.619+0000 7f4d1f453b80 1 Processor -- start 2023-10-01T07:52:15.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.619+0000 7f4d1f453b80 1 -- start start 2023-10-01T07:52:15.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.620+0000 7f4d1f453b80 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55a92fe79170 0x55a92fe79550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:15.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.620+0000 7f4d1f453b80 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55a92fe79a40 0x55a92fea30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:15.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.620+0000 7f4d1f453b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a92fea35b0 0x55a92fea59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:15.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.620+0000 7f4d1f453b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a92fe43610 con 0x55a92fea35b0 2023-10-01T07:52:15.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.620+0000 7f4d1f453b80 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a92fdb9db0 con 0x55a92fe79170 2023-10-01T07:52:15.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.620+0000 7f4d1f453b80 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x55a92fdcf030 con 0x55a92fe79a40 2023-10-01T07:52:15.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.620+0000 7f4d077fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55a92fe79170 0x55a92fe79550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:15.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.620+0000 7f4d07fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a92fea35b0 0x55a92fea59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:15.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.620+0000 7f4d077fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55a92fe79170 0x55a92fe79550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58420/0 (socket says 172.21.15.26:58420) 2023-10-01T07:52:15.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.620+0000 7f4d06ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55a92fe79a40 0x55a92fea30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:15.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.620+0000 7f4d077fe700 1 -- 172.21.15.26:0/2032818148 learned_addr learned my addr 172.21.15.26:0/2032818148 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:15.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.620+0000 7f4d07fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a92fea35b0 0x55a92fea59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44206/0 (socket says 172.21.15.26:44206) 2023-10-01T07:52:15.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.620+0000 7f4d077fe700 1 -- 172.21.15.26:0/2032818148 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55a92fe79a40 msgr2=0x55a92fea30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:15.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.620+0000 7f4d077fe700 1 --2- 172.21.15.26:0/2032818148 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55a92fe79a40 0x55a92fea30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.620+0000 7f4d077fe700 1 -- 172.21.15.26:0/2032818148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a92fea35b0 msgr2=0x55a92fea59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:15.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.620+0000 7f4d077fe700 1 --2- 172.21.15.26:0/2032818148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a92fea35b0 0x55a92fea59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.620+0000 7f4d077fe700 1 -- 172.21.15.26:0/2032818148 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a92fc6a710 con 0x55a92fe79170 2023-10-01T07:52:15.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.620+0000 7f4d07fff700 1 --2- 172.21.15.26:0/2032818148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a92fea35b0 0x55a92fea59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:15.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.620+0000 7f4d077fe700 1 --2- 172.21.15.26:0/2032818148 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55a92fe79170 0x55a92fe79550 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f4cf8010b10 tx=0x7f4cf80090f0).ready entity=mon.1 client_cookie=134d5251a579d582 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:15.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.620+0000 7f4cecff9700 1 -- 172.21.15.26:0/2032818148 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf8015030 con 0x55a92fe79170 2023-10-01T07:52:15.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.621+0000 7f4cecff9700 1 -- 172.21.15.26:0/2032818148 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf8016040 con 0x55a92fe79170 2023-10-01T07:52:15.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.621+0000 7f4cecff9700 1 -- 172.21.15.26:0/2032818148 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf8017b10 con 0x55a92fe79170 2023-10-01T07:52:15.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.621+0000 7f4d1f453b80 1 -- 172.21.15.26:0/2032818148 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55a92fe79170 msgr2=0x55a92fe79550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:15.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.621+0000 7f4d1f453b80 1 --2- 172.21.15.26:0/2032818148 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55a92fe79170 0x55a92fe79550 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f4cf8010b10 tx=0x7f4cf80090f0).stop 2023-10-01T07:52:15.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.621+0000 7f4d1f453b80 1 -- 172.21.15.26:0/2032818148 shutdown_connections 2023-10-01T07:52:15.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.621+0000 7f4d1f453b80 1 --2- 172.21.15.26:0/2032818148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a92fea35b0 0x55a92fea59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.621+0000 7f4d1f453b80 1 --2- 172.21.15.26:0/2032818148 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55a92fe79170 0x55a92fe79550 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.621+0000 7f4d1f453b80 1 --2- 172.21.15.26:0/2032818148 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55a92fe79a40 0x55a92fea30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.621+0000 7f4d1f453b80 1 -- 172.21.15.26:0/2032818148 >> 172.21.15.26:0/2032818148 conn(0x55a92fce7940 msgr2=0x55a92fe99cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:15.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.621+0000 7f4d1f453b80 1 -- 172.21.15.26:0/2032818148 shutdown_connections 2023-10-01T07:52:15.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.621+0000 7f4d1f453b80 1 -- 172.21.15.26:0/2032818148 wait complete. 2023-10-01T07:52:15.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.622+0000 7f4d1f453b80 1 -- start start 2023-10-01T07:52:15.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.622+0000 7f4d1f453b80 1 Processor -- start 2023-10-01T07:52:15.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.622+0000 7f4d1f453b80 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55a92fe79170 0x55a92fea8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:15.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.623+0000 7f4d1f453b80 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55a92fe79a40 0x55a92fea91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:15.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.623+0000 7f4d1f453b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a92fea35b0 0x55a92fe9e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:15.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.623+0000 7f4d1f453b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a92fdcf170 con 0x55a92fea35b0 2023-10-01T07:52:15.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.623+0000 7f4d1f453b80 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a92fdcf3f0 con 0x55a92fe79a40 2023-10-01T07:52:15.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.623+0000 7f4d1f453b80 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x55a92fd9a920 con 0x55a92fe79170 2023-10-01T07:52:15.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.623+0000 7f4d1f453b80 10 client.0 ll_register_callbacks cb 0x55a92fd6fce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-01T07:52:15.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.623+0000 7f4d06ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55a92fe79a40 0x55a92fea91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:15.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.623+0000 7f4d06ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55a92fe79a40 0x55a92fea91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58432/0 (socket says 172.21.15.26:58432) 2023-10-01T07:52:15.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.623+0000 7f4d06ffd700 1 -- 172.21.15.26:0/2517366450 learned_addr learned my addr 172.21.15.26:0/2517366450 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:15.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.623+0000 7f4d07fff700 1 --2- 172.21.15.26:0/2517366450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a92fea35b0 0x55a92fe9e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:15.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.623+0000 7f4d077fe700 1 --2- 172.21.15.26:0/2517366450 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55a92fe79170 0x55a92fea8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:15.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.623+0000 7f4d06ffd700 1 -- 172.21.15.26:0/2517366450 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55a92fe79170 msgr2=0x55a92fea8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:15.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.623+0000 7f4d06ffd700 1 --2- 172.21.15.26:0/2517366450 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55a92fe79170 0x55a92fea8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.623+0000 7f4d06ffd700 1 -- 172.21.15.26:0/2517366450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a92fea35b0 msgr2=0x55a92fe9e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:15.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.623+0000 7f4d06ffd700 1 --2- 172.21.15.26:0/2517366450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a92fea35b0 0x55a92fe9e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.623+0000 7f4d06ffd700 1 -- 172.21.15.26:0/2517366450 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf8010750 con 0x55a92fe79a40 2023-10-01T07:52:15.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.623+0000 7f4d07fff700 1 --2- 172.21.15.26:0/2517366450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a92fea35b0 0x55a92fe9e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:15.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.623+0000 7f4d06ffd700 1 --2- 172.21.15.26:0/2517366450 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55a92fe79a40 0x55a92fea91e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f4cfc03b850 tx=0x7f4cfc01c000).ready entity=mon.1 client_cookie=d2d074fa1c2126ff server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:15.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.623+0000 7f4ce5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.26:3301/0 2023-10-01T07:52:15.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.623+0000 7f4ce5ffb700 1 -- 172.21.15.26:0/2517366450 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc034070 con 0x55a92fe79a40 2023-10-01T07:52:15.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.623+0000 7f4d1f453b80 1 -- 172.21.15.26:0/2517366450 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a92fe71f20 con 0x55a92fe79a40 2023-10-01T07:52:15.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.623+0000 7f4ce5ffb700 1 -- 172.21.15.26:0/2517366450 <== mon.1 v2:172.21.15.26:3301/0 2 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f4cfc022900 con 0x55a92fe79a40 2023-10-01T07:52:15.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.624+0000 7f4ce5ffb700 1 -- 172.21.15.26:0/2517366450 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4cfc02c940 con 0x55a92fe79a40 2023-10-01T07:52:15.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.624+0000 7f4d1f453b80 10 client.4483 fetch_fsmap learned FSMap version 6 2023-10-01T07:52:15.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.624+0000 7f4d1f453b80 1 -- 172.21.15.26:0/2517366450 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55a92fda1b00 con 0x55a92fe79a40 2023-10-01T07:52:15.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.624+0000 7f4ce5ffb700 1 -- 172.21.15.26:0/2517366450 <== mon.1 v2:172.21.15.26:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cfc040070 con 0x55a92fe79a40 2023-10-01T07:52:15.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.624+0000 7f4ce5ffb700 1 -- 172.21.15.26:0/2517366450 <== mon.1 v2:172.21.15.26:3301/0 5 ==== fsmap(e 6) v1 ==== 1430+0+0 (secure 0 0 0) 0x7f4cfc010c50 con 0x55a92fe79a40 2023-10-01T07:52:15.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.624+0000 7f4d1f453b80 10 client.4483 fetch_fsmap finished waiting for FSMap version 6 2023-10-01T07:52:15.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.624+0000 7f4d1f453b80 10 client.4483 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-01T07:52:15.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.624+0000 7f4d1f453b80 20 client.4483 populate_metadata read hostname 'smithi026' 2023-10-01T07:52:15.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.624+0000 7f4d1f453b80 4 client.4483 mds_command: new command op to 4189 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-01T07:52:15.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.624+0000 7f4d1f453b80 1 -- 172.21.15.26:0/2517366450 --> v1:172.21.15.26:6817/2857714939 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a92fe47250 con 0x55a92fe9f490 2023-10-01T07:52:15.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.624+0000 7f4ce5ffb700 10 client.4483 ms_handle_connect on v1:172.21.15.26:6817/2857714939 2023-10-01T07:52:15.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.625+0000 7f4ce5ffb700 1 -- 172.21.15.26:0/2517366450 <== mds.0 v1:172.21.15.26:6817/2857714939 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (unknown 0 0 3608088055) 0x55a92fe47250 con 0x55a92fe9f490 2023-10-01T07:52:15.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.625+0000 7f4ce5ffb700 10 client.4483 handle_command_reply: tid=0 2023-10-01T07:52:15.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.625+0000 7f4d1f453b80 1 client.4483 shutdown 2023-10-01T07:52:15.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.625+0000 7f4d1f453b80 1 -- 172.21.15.26:0/2517366450 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55a92fe79a40 msgr2=0x55a92fea91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:15.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.625+0000 7f4d1f453b80 1 --2- 172.21.15.26:0/2517366450 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55a92fe79a40 0x55a92fea91e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f4cfc03b850 tx=0x7f4cfc01c000).stop 2023-10-01T07:52:15.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.625+0000 7f4d1f453b80 1 -- 172.21.15.26:0/2517366450 shutdown_connections 2023-10-01T07:52:15.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.625+0000 7f4d1f453b80 1 --2- 172.21.15.26:0/2517366450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a92fea35b0 0x55a92fe9e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.625+0000 7f4d1f453b80 1 --2- 172.21.15.26:0/2517366450 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55a92fe79170 0x55a92fea8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.625+0000 7f4ce5ffb700 0 client.4483 ms_handle_reset on v1:172.21.15.26:6817/2857714939 2023-10-01T07:52:15.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.625+0000 7f4d1f453b80 1 --2- 172.21.15.26:0/2517366450 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55a92fe79a40 0x55a92fea91e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.625+0000 7f4d1f453b80 1 -- 172.21.15.26:0/2517366450 >> 172.21.15.26:0/2517366450 conn(0x55a92fce7940 msgr2=0x55a92fe99c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:15.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.625+0000 7f4d1f453b80 1 -- 172.21.15.26:0/2517366450 shutdown_connections 2023-10-01T07:52:15.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.625+0000 7f4d1f453b80 1 -- 172.21.15.26:0/2517366450 wait complete. 2023-10-01T07:52:15.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.625+0000 7f4d1f453b80 20 client.4483 trim_cache size 0 max 16384 2023-10-01T07:52:15.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.643+0000 7f4d1f453b80 1 Processor -- start 2023-10-01T07:52:15.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.643+0000 7f4d1f453b80 1 -- start start 2023-10-01T07:52:15.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.643+0000 7f4d1f453b80 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55a92fe79170 0x55a92fe974e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:15.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.643+0000 7f4d1f453b80 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55a92fe79a40 0x55a92fe75610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:15.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.643+0000 7f4d1f453b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a92fea35b0 0x55a92fe78980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:15.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.643+0000 7f4d1f453b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a92fe9a830 con 0x55a92fea35b0 2023-10-01T07:52:15.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.643+0000 7f4d1f453b80 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a92fe9fe70 con 0x55a92fe79a40 2023-10-01T07:52:15.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.643+0000 7f4d1f453b80 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x55a92fea1a20 con 0x55a92fe79170 2023-10-01T07:52:15.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.643+0000 7f4d077fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55a92fe79170 0x55a92fe974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:15.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.643+0000 7f4d06ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55a92fe79a40 0x55a92fe75610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:15.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.643+0000 7f4d077fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55a92fe79170 0x55a92fe974e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55520/0 (socket says 172.21.15.26:55520) 2023-10-01T07:52:15.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.643+0000 7f4d077fe700 1 -- 172.21.15.26:0/2579422442 learned_addr learned my addr 172.21.15.26:0/2579422442 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:15.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.643+0000 7f4d07fff700 1 --2- 172.21.15.26:0/2579422442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a92fea35b0 0x55a92fe78980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:15.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.643+0000 7f4d06ffd700 1 -- 172.21.15.26:0/2579422442 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55a92fe79170 msgr2=0x55a92fe974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:15.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.643+0000 7f4d06ffd700 1 --2- 172.21.15.26:0/2579422442 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55a92fe79170 0x55a92fe974e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.643+0000 7f4d06ffd700 1 -- 172.21.15.26:0/2579422442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a92fea35b0 msgr2=0x55a92fe78980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:15.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.643+0000 7f4d06ffd700 1 --2- 172.21.15.26:0/2579422442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a92fea35b0 0x55a92fe78980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.643+0000 7f4d06ffd700 1 -- 172.21.15.26:0/2579422442 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a92fdc7f70 con 0x55a92fe79a40 2023-10-01T07:52:15.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.644+0000 7f4d06ffd700 1 --2- 172.21.15.26:0/2579422442 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55a92fe79a40 0x55a92fe75610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f4cfc03b850 tx=0x7f4cfc022660).ready entity=mon.1 client_cookie=869f70e580de6879 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:15.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.644+0000 7f4ced7fa700 1 -- 172.21.15.26:0/2579422442 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc034040 con 0x55a92fe79a40 2023-10-01T07:52:15.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.644+0000 7f4ced7fa700 1 -- 172.21.15.26:0/2579422442 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cfc040070 con 0x55a92fe79a40 2023-10-01T07:52:15.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.644+0000 7f4ced7fa700 1 -- 172.21.15.26:0/2579422442 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc02c350 con 0x55a92fe79a40 2023-10-01T07:52:15.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.644+0000 7f4d1f453b80 1 -- 172.21.15.26:0/2579422442 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55a92fe79a40 msgr2=0x55a92fe75610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:15.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.644+0000 7f4d1f453b80 1 --2- 172.21.15.26:0/2579422442 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55a92fe79a40 0x55a92fe75610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f4cfc03b850 tx=0x7f4cfc022660).stop 2023-10-01T07:52:15.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.644+0000 7f4d1f453b80 1 -- 172.21.15.26:0/2579422442 shutdown_connections 2023-10-01T07:52:15.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.644+0000 7f4d1f453b80 1 --2- 172.21.15.26:0/2579422442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a92fea35b0 0x55a92fe78980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.644+0000 7f4d1f453b80 1 --2- 172.21.15.26:0/2579422442 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55a92fe79170 0x55a92fe974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.644+0000 7f4d1f453b80 1 --2- 172.21.15.26:0/2579422442 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55a92fe79a40 0x55a92fe75610 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.644+0000 7f4d1f453b80 1 -- 172.21.15.26:0/2579422442 >> 172.21.15.26:0/2579422442 conn(0x55a92fce7940 msgr2=0x55a92fe7d590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:15.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.644+0000 7f4d1f453b80 1 -- 172.21.15.26:0/2579422442 shutdown_connections 2023-10-01T07:52:15.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.644+0000 7f4d1f453b80 1 -- 172.21.15.26:0/2579422442 wait complete. 2023-10-01T07:52:15.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.645+0000 7f4d1f453b80 1 -- start start 2023-10-01T07:52:15.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.645+0000 7f4d1f453b80 1 Processor -- start 2023-10-01T07:52:15.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.645+0000 7f4d1f453b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a92fe79170 0x55a92fefd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:15.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.645+0000 7f4d1f453b80 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55a92fe79a40 0x55a92fefdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:15.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.645+0000 7f4d1f453b80 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55a92fea35b0 0x55a92fea59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:15.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.645+0000 7f4d1f453b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a92fea95e0 con 0x55a92fe79170 2023-10-01T07:52:15.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.645+0000 7f4d1f453b80 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a92fefd650 con 0x55a92fe79a40 2023-10-01T07:52:15.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.645+0000 7f4d1f453b80 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x55a92fea7780 con 0x55a92fea35b0 2023-10-01T07:52:15.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.645+0000 7f4d1f453b80 10 client.0 ll_register_callbacks cb 0x55a92fd6fce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-01T07:52:15.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.646+0000 7f4d06ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55a92fe79a40 0x55a92fefdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:15.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.646+0000 7f4d077fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a92fe79170 0x55a92fefd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:15.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.646+0000 7f4d06ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55a92fe79a40 0x55a92fefdec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58438/0 (socket says 172.21.15.26:58438) 2023-10-01T07:52:15.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.646+0000 7f4d06ffd700 1 -- 172.21.15.26:0/638329952 learned_addr learned my addr 172.21.15.26:0/638329952 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:15.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.646+0000 7f4d077fe700 1 --2- 172.21.15.26:0/638329952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a92fe79170 0x55a92fefd9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44248/0 (socket says 172.21.15.26:44248) 2023-10-01T07:52:15.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.646+0000 7f4d07fff700 1 --2- 172.21.15.26:0/638329952 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55a92fea35b0 0x55a92fea59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:15.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.646+0000 7f4d077fe700 1 -- 172.21.15.26:0/638329952 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55a92fea35b0 msgr2=0x55a92fea59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:15.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.646+0000 7f4d077fe700 1 --2- 172.21.15.26:0/638329952 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55a92fea35b0 0x55a92fea59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.646+0000 7f4d077fe700 1 -- 172.21.15.26:0/638329952 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55a92fe79a40 msgr2=0x55a92fefdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:15.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.646+0000 7f4d077fe700 1 --2- 172.21.15.26:0/638329952 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55a92fe79a40 0x55a92fefdec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.646+0000 7f4d077fe700 1 -- 172.21.15.26:0/638329952 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a92fda1b00 con 0x55a92fe79170 2023-10-01T07:52:15.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.646+0000 7f4d06ffd700 1 --2- 172.21.15.26:0/638329952 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55a92fe79a40 0x55a92fefdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:15.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.646+0000 7f4d077fe700 1 --2- 172.21.15.26:0/638329952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a92fe79170 0x55a92fefd9d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f4cf801f040 tx=0x7f4cf801c000).ready entity=mon.0 client_cookie=d5b627a67cf51555 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:15.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.646+0000 7f4ce5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-01T07:52:15.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.646+0000 7f4ce5ffb700 1 -- 172.21.15.26:0/638329952 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf8015030 con 0x55a92fe79170 2023-10-01T07:52:15.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.646+0000 7f4ce5ffb700 1 -- 172.21.15.26:0/638329952 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f4cf802a0b0 con 0x55a92fe79170 2023-10-01T07:52:15.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.646+0000 7f4d1f453b80 1 -- 172.21.15.26:0/638329952 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4cf8016040 con 0x55a92fe79170 2023-10-01T07:52:15.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.646+0000 7f4ce5ffb700 1 -- 172.21.15.26:0/638329952 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4cf8009ce0 con 0x55a92fe79170 2023-10-01T07:52:15.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.646+0000 7f4d1f453b80 10 client.4635 fetch_fsmap learned FSMap version 6 2023-10-01T07:52:15.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.646+0000 7f4d1f453b80 1 -- 172.21.15.26:0/638329952 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55a92fdc3580 con 0x55a92fe79170 2023-10-01T07:52:15.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.647+0000 7f4ce5ffb700 1 -- 172.21.15.26:0/638329952 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf8016040 con 0x55a92fe79170 2023-10-01T07:52:15.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.647+0000 7f4ce5ffb700 1 -- 172.21.15.26:0/638329952 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 6) v1 ==== 1430+0+0 (secure 0 0 0) 0x7f4cf801c440 con 0x55a92fe79170 2023-10-01T07:52:15.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.647+0000 7f4d1f453b80 10 client.4635 fetch_fsmap finished waiting for FSMap version 6 2023-10-01T07:52:15.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.647+0000 7f4d1f453b80 10 client.4635 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-01T07:52:15.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.647+0000 7f4d1f453b80 20 client.4635 populate_metadata read hostname 'smithi026' 2023-10-01T07:52:15.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.647+0000 7f4d1f453b80 4 client.4635 mds_command: new command op to 4189 tid=0[{"prefix": "status"}] 2023-10-01T07:52:15.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.647+0000 7f4d1f453b80 1 -- 172.21.15.26:0/638329952 --> v1:172.21.15.26:6817/2857714939 -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a92fc37ef0 con 0x55a92fea6400 2023-10-01T07:52:15.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.647+0000 7f4ce5ffb700 10 client.4635 ms_handle_connect on v1:172.21.15.26:6817/2857714939 2023-10-01T07:52:15.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.647+0000 7f4ce5ffb700 1 -- 172.21.15.26:0/638329952 <== mds.0 v1:172.21.15.26:6817/2857714939 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (unknown 0 0 63015857) 0x55a92fc37ef0 con 0x55a92fea6400 2023-10-01T07:52:15.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.647+0000 7f4ce5ffb700 10 client.4635 handle_command_reply: tid=0 2023-10-01T07:52:15.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.647+0000 7f4d1f453b80 1 client.4635 shutdown 2023-10-01T07:52:15.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.647+0000 7f4d1f453b80 1 -- 172.21.15.26:0/638329952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a92fe79170 msgr2=0x55a92fefd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:15.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.647+0000 7f4d1f453b80 1 --2- 172.21.15.26:0/638329952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a92fe79170 0x55a92fefd9d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f4cf801f040 tx=0x7f4cf801c000).stop 2023-10-01T07:52:15.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.647+0000 7f4d1f453b80 1 -- 172.21.15.26:0/638329952 shutdown_connections 2023-10-01T07:52:15.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.647+0000 7f4d1f453b80 1 --2- 172.21.15.26:0/638329952 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55a92fea35b0 0x55a92fea59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.647+0000 7f4d1f453b80 1 --2- 172.21.15.26:0/638329952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a92fe79170 0x55a92fefd9d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.647+0000 7f4d1f453b80 1 --2- 172.21.15.26:0/638329952 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55a92fe79a40 0x55a92fefdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.647+0000 7f4ce5ffb700 0 client.4635 ms_handle_reset on v1:172.21.15.26:6817/2857714939 2023-10-01T07:52:15.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.647+0000 7f4d1f453b80 1 -- 172.21.15.26:0/638329952 >> 172.21.15.26:0/638329952 conn(0x55a92fce7940 msgr2=0x55a92fe78980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:15.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.648+0000 7f4d1f453b80 1 -- 172.21.15.26:0/638329952 shutdown_connections 2023-10-01T07:52:15.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.648+0000 7f4d1f453b80 1 -- 172.21.15.26:0/638329952 wait complete. 2023-10-01T07:52:15.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.648+0000 7f4d1f453b80 20 client.4635 trim_cache size 0 max 16384 2023-10-01T07:52:15.657 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-01T07:52:15.658 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "c29fb19d-520c-42a6-90f4-e7f86de96e8e", 2023-10-01T07:52:15.658 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2023-10-01T07:52:15.658 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4189, 2023-10-01T07:52:15.658 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2023-10-01T07:52:15.658 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2023-10-01T07:52:15.658 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2023-10-01T07:52:15.658 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 18.352262273000001, 2023-10-01T07:52:15.658 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 6, 2023-10-01T07:52:15.658 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 17, 2023-10-01T07:52:15.658 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 17, 2023-10-01T07:52:15.658 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 23.659106963999999 2023-10-01T07:52:15.659 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-01T07:52:15.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.648+0000 7f4d0daa0700 1 -- 172.21.15.26:0/3086423866 >> v1:172.21.15.26:6816/118178 conn(0x7f4cf402bb60 legacy=0x7f4cf402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:15.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.648+0000 7f4d0daa0700 1 -- 172.21.15.26:0/3086423866 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4d08094c20 msgr2=0x7f4d0812b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:15.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.648+0000 7f4d0daa0700 1 --2- 172.21.15.26:0/3086423866 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4d08094c20 0x7f4d0812b1f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f4d08092dc0 tx=0x7f4cfc017000).stop 2023-10-01T07:52:15.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.648+0000 7f4d0daa0700 1 -- 172.21.15.26:0/3086423866 shutdown_connections 2023-10-01T07:52:15.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.648+0000 7f4d0daa0700 1 --2- 172.21.15.26:0/3086423866 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d08096380 0x7f4d0812e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.648+0000 7f4d0daa0700 1 --2- 172.21.15.26:0/3086423866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d08091b00 0x7f4d0812e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.648+0000 7f4d0daa0700 1 --2- 172.21.15.26:0/3086423866 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4d08094c20 0x7f4d0812b1f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.648+0000 7f4d0daa0700 1 -- 172.21.15.26:0/3086423866 >> 172.21.15.26:0/3086423866 conn(0x7f4d08097470 msgr2=0x7f4d08127890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:15.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.648+0000 7f4d0daa0700 1 -- 172.21.15.26:0/3086423866 shutdown_connections 2023-10-01T07:52:15.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.648+0000 7f4d0daa0700 1 -- 172.21.15.26:0/3086423866 wait complete. 2023-10-01T07:52:15.663 INFO:teuthology.run_tasks:Running task exec... 2023-10-01T07:52:15.704 INFO:teuthology.task.exec:Executing custom commands... 2023-10-01T07:52:15.704 INFO:teuthology.task.exec:Running commands on role osd.0 host ubuntu@smithi026.front.sepia.ceph.com 2023-10-01T07:52:15.704 DEBUG:teuthology.orchestra.run.smithi026:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd set-require-min-compat-client pacific' 2023-10-01T07:52:15.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.834+0000 7f03e6ae9700 1 Processor -- start 2023-10-01T07:52:15.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.834+0000 7f03e6ae9700 1 -- start start 2023-10-01T07:52:15.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.834+0000 7f03e6ae9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f03e0096c70 0x7f03e00970a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:15.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.834+0000 7f03e6ae9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03e0097590 0x7f03e0130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:15.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.834+0000 7f03e6ae9700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03e0069a80 con 0x7f03e00693c0 2023-10-01T07:52:15.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.834+0000 7f03e6ae9700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03e00697a0 con 0x7f03e0096c70 2023-10-01T07:52:15.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.834+0000 7f03e6ae9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03e0068900 con 0x7f03e0097590 2023-10-01T07:52:15.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.834+0000 7f03dffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f03e0096c70 0x7f03e00970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:15.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.834+0000 7f03e5086700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03e0097590 0x7f03e0130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:15.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.834+0000 7f03dffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f03e0096c70 0x7f03e00970a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44260/0 (socket says 172.21.15.26:44260) 2023-10-01T07:52:15.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.834+0000 7f03dffff700 1 -- 172.21.15.26:0/1910655754 learned_addr learned my addr 172.21.15.26:0/1910655754 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:15.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.834+0000 7f03e4885700 1 --1- 172.21.15.26:0/1910655754 >> v1:172.21.15.26:6789/0 conn(0x7f03e00693c0 0x7f03e0096560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56558/0 (socket says 172.21.15.26:56558) 2023-10-01T07:52:15.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.835+0000 7f03e5086700 1 -- 172.21.15.26:0/1910655754 >> v2:172.21.15.26:3300/0 conn(0x7f03e0096c70 msgr2=0x7f03e00970a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:15.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.835+0000 7f03e5086700 1 --2- 172.21.15.26:0/1910655754 >> v2:172.21.15.26:3300/0 conn(0x7f03e0096c70 0x7f03e00970a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.835+0000 7f03e5086700 1 -- 172.21.15.26:0/1910655754 >> v1:172.21.15.26:6789/0 conn(0x7f03e00693c0 legacy=0x7f03e0096560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:15.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.835+0000 7f03e5086700 1 -- 172.21.15.26:0/1910655754 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e0068690 con 0x7f03e0097590 2023-10-01T07:52:15.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.835+0000 7f03dffff700 1 --2- 172.21.15.26:0/1910655754 >> v2:172.21.15.26:3300/0 conn(0x7f03e0096c70 0x7f03e00970a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:15.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.835+0000 7f03e5086700 1 --2- 172.21.15.26:0/1910655754 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03e0097590 0x7f03e0130350 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f03d8009e60 tx=0x7f03d8009780).ready entity=mon.2 client_cookie=ea4f80f569fca9f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:15.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.835+0000 7f03df7fe700 1 -- 172.21.15.26:0/1910655754 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d800e070 con 0x7f03e0097590 2023-10-01T07:52:15.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.835+0000 7f03df7fe700 1 -- 172.21.15.26:0/1910655754 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d800bb60 con 0x7f03e0097590 2023-10-01T07:52:15.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.835+0000 7f03df7fe700 1 -- 172.21.15.26:0/1910655754 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d8012410 con 0x7f03e0097590 2023-10-01T07:52:15.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.836+0000 7f03e6ae9700 1 -- 172.21.15.26:0/1910655754 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03e0097590 msgr2=0x7f03e0130350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:15.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.836+0000 7f03e6ae9700 1 --2- 172.21.15.26:0/1910655754 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03e0097590 0x7f03e0130350 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f03d8009e60 tx=0x7f03d8009780).stop 2023-10-01T07:52:15.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.836+0000 7f03e6ae9700 1 -- 172.21.15.26:0/1910655754 shutdown_connections 2023-10-01T07:52:15.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.836+0000 7f03e6ae9700 1 --2- 172.21.15.26:0/1910655754 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03e0097590 0x7f03e0130350 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.836+0000 7f03e6ae9700 1 --2- 172.21.15.26:0/1910655754 >> v2:172.21.15.26:3300/0 conn(0x7f03e0096c70 0x7f03e00970a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.836+0000 7f03e6ae9700 1 -- 172.21.15.26:0/1910655754 >> 172.21.15.26:0/1910655754 conn(0x7f03e009bb40 msgr2=0x7f03e009bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:15.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.836+0000 7f03e6ae9700 1 -- 172.21.15.26:0/1910655754 shutdown_connections 2023-10-01T07:52:15.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.836+0000 7f03e6ae9700 1 -- 172.21.15.26:0/1910655754 wait complete. 2023-10-01T07:52:15.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.837+0000 7f03e6ae9700 1 Processor -- start 2023-10-01T07:52:15.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.837+0000 7f03e6ae9700 1 -- start start 2023-10-01T07:52:15.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.838+0000 7f03e6ae9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03e00693c0 0x7f03e0137d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:15.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.838+0000 7f03e6ae9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03e0096c70 0x7f03e0138280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:15.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.838+0000 7f03e6ae9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03e0097590 0x7f03e0138770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:15.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.838+0000 7f03e6ae9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e0138c60 con 0x7f03e0097590 2023-10-01T07:52:15.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.838+0000 7f03e6ae9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e011bb00 con 0x7f03e00693c0 2023-10-01T07:52:15.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.838+0000 7f03e6ae9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03e0067c30 con 0x7f03e0096c70 2023-10-01T07:52:15.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.838+0000 7f03e4885700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03e00693c0 0x7f03e0137d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:15.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.838+0000 7f03e4885700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03e00693c0 0x7f03e0137d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58440/0 (socket says 172.21.15.26:58440) 2023-10-01T07:52:15.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.838+0000 7f03e4885700 1 -- 172.21.15.26:0/105035414 learned_addr learned my addr 172.21.15.26:0/105035414 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:15.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.838+0000 7f03dffff700 1 --2- 172.21.15.26:0/105035414 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03e0096c70 0x7f03e0138280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:15.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.838+0000 7f03e5086700 1 --2- 172.21.15.26:0/105035414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03e0097590 0x7f03e0138770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:15.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.838+0000 7f03dffff700 1 -- 172.21.15.26:0/105035414 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03e00693c0 msgr2=0x7f03e0137d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:15.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.838+0000 7f03dffff700 1 --2- 172.21.15.26:0/105035414 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03e00693c0 0x7f03e0137d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.838+0000 7f03dffff700 1 -- 172.21.15.26:0/105035414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03e0097590 msgr2=0x7f03e0138770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:15.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.838+0000 7f03dffff700 1 --2- 172.21.15.26:0/105035414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03e0097590 0x7f03e0138770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:15.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.838+0000 7f03dffff700 1 -- 172.21.15.26:0/105035414 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d4009370 con 0x7f03e0096c70 2023-10-01T07:52:15.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.838+0000 7f03e5086700 1 --2- 172.21.15.26:0/105035414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03e0097590 0x7f03e0138770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:15.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.839+0000 7f03dffff700 1 --2- 172.21.15.26:0/105035414 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03e0096c70 0x7f03e0138280 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f03d400ea30 tx=0x7f03d40090f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:15.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.839+0000 7f03dcff9700 1 -- 172.21.15.26:0/105035414 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d400ee70 con 0x7f03e0096c70 2023-10-01T07:52:15.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.839+0000 7f03dcff9700 1 -- 172.21.15.26:0/105035414 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d400c850 con 0x7f03e0096c70 2023-10-01T07:52:15.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.839+0000 7f03e6ae9700 1 -- 172.21.15.26:0/105035414 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03d8009a20 con 0x7f03e0096c70 2023-10-01T07:52:15.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.839+0000 7f03dcff9700 1 -- 172.21.15.26:0/105035414 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d400cbd0 con 0x7f03e0096c70 2023-10-01T07:52:15.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.839+0000 7f03e6ae9700 1 -- 172.21.15.26:0/105035414 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03e011c310 con 0x7f03e0096c70 2023-10-01T07:52:15.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.839+0000 7f03dcff9700 1 -- 172.21.15.26:0/105035414 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f03d401b400 con 0x7f03e0096c70 2023-10-01T07:52:15.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.840+0000 7f03dcff9700 1 -- 172.21.15.26:0/105035414 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f03d403b2e0 con 0x7f03e0096c70 2023-10-01T07:52:15.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.840+0000 7f03e6ae9700 1 -- 172.21.15.26:0/105035414 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03e011c310 con 0x7f03e0096c70 2023-10-01T07:52:15.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:15.845+0000 7f03dcff9700 1 -- 172.21.15.26:0/105035414 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f03e011c310 con 0x7f03e0096c70 2023-10-01T07:52:16.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:16.034+0000 7f03e6ae9700 1 -- 172.21.15.26:0/105035414 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd set-require-min-compat-client", "version": "pacific"} v 0) v1 -- 0x7f03e011c310 con 0x7f03e0096c70 2023-10-01T07:52:16.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:16.708+0000 7f03dcff9700 1 -- 172.21.15.26:0/105035414 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd set-require-min-compat-client", "version": "pacific"}]=0 set require_min_compat_client to pacific v18) v1 ==== 143+0+0 (secure 0 0 0) 0x7f03e011c310 con 0x7f03e0096c70 2023-10-01T07:52:16.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:16.711+0000 7f03e6ae9700 1 -- 172.21.15.26:0/105035414 >> v1:172.21.15.26:6816/118178 conn(0x7f03cc02bb90 legacy=0x7f03cc02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:16.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:16.711+0000 7f03e6ae9700 1 -- 172.21.15.26:0/105035414 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03e0096c70 msgr2=0x7f03e0138280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:16.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:16.711+0000 7f03e6ae9700 1 --2- 172.21.15.26:0/105035414 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03e0096c70 0x7f03e0138280 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f03d400ea30 tx=0x7f03d40090f0).stop 2023-10-01T07:52:16.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:16.712+0000 7f03e6ae9700 1 -- 172.21.15.26:0/105035414 shutdown_connections 2023-10-01T07:52:16.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:16.712+0000 7f03e6ae9700 1 --2- 172.21.15.26:0/105035414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03e0097590 0x7f03e0138770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:16.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:16.712+0000 7f03e6ae9700 1 --2- 172.21.15.26:0/105035414 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03e00693c0 0x7f03e0137d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:16.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:16.712+0000 7f03e6ae9700 1 --2- 172.21.15.26:0/105035414 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03e0096c70 0x7f03e0138280 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:16.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:16.712+0000 7f03e6ae9700 1 -- 172.21.15.26:0/105035414 >> 172.21.15.26:0/105035414 conn(0x7f03e009bb40 msgr2=0x7f03e009a800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:16.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:16.712+0000 7f03e6ae9700 1 -- 172.21.15.26:0/105035414 shutdown_connections 2023-10-01T07:52:16.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:16.712+0000 7f03e6ae9700 1 -- 172.21.15.26:0/105035414 wait complete. 2023-10-01T07:52:16.714 INFO:teuthology.orchestra.run.smithi026.stderr:set require_min_compat_client to pacific 2023-10-01T07:52:16.728 INFO:teuthology.run_tasks:Running task print... 2023-10-01T07:52:16.738 INFO:teuthology.task.print:**** done ceph 2023-10-01T07:52:16.738 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-10-01T07:52:16.921 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-10-01T07:52:16.921 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-10-01T07:52:16.921 INFO:tasks.ceph_fuse:client.0 config is {} 2023-10-01T07:52:16.921 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-01T07:52:16.921 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-01T07:52:16.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-01T07:52:16.922 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2023-10-01T07:52:16.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-01T07:52:16.946 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link delete ceph-brx 2023-10-01T07:52:17.023 INFO:teuthology.orchestra.run.smithi092.stderr:Cannot find device "ceph-brx" 2023-10-01T07:52:17.024 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-01T07:52:17.025 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-10-01T07:52:17.025 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-01T07:52:17.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.163+0000 7f0643041700 1 Processor -- start 2023-10-01T07:52:17.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.164+0000 7f0643041700 1 -- start start 2023-10-01T07:52:17.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.164+0000 7f0643041700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f063c0654a0 0x7f063c098640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:17.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.164+0000 7f0643041700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f063c098b30 0x7f063c098f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:17.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.164+0000 7f0643041700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063c065ed0 con 0x7f063c12f470 2023-10-01T07:52:17.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.164+0000 7f0643041700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063c095880 con 0x7f063c0654a0 2023-10-01T07:52:17.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.164+0000 7f0643041700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063c096120 con 0x7f063c098b30 2023-10-01T07:52:17.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.164+0000 7f0640ddd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f063c0654a0 0x7f063c098640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:17.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.164+0000 7f063bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f063c098b30 0x7f063c098f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:17.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.164+0000 7f0640ddd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f063c0654a0 0x7f063c098640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44282/0 (socket says 172.21.15.26:44282) 2023-10-01T07:52:17.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.164+0000 7f063bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f063c098b30 0x7f063c098f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58452/0 (socket says 172.21.15.26:58452) 2023-10-01T07:52:17.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.164+0000 7f06415de700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f063c12f470 0x7f063c131860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56566/0 (socket says 172.21.15.26:56566) 2023-10-01T07:52:17.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.164+0000 7f0640ddd700 1 -- 172.21.15.26:0/824961711 learned_addr learned my addr 172.21.15.26:0/824961711 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:17.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.165+0000 7f0640ddd700 1 -- 172.21.15.26:0/824961711 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f063c098b30 msgr2=0x7f063c098f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:17.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.165+0000 7f0640ddd700 1 --2- 172.21.15.26:0/824961711 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f063c098b30 0x7f063c098f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:17.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.165+0000 7f0640ddd700 1 -- 172.21.15.26:0/824961711 >> v1:172.21.15.26:6789/0 conn(0x7f063c12f470 legacy=0x7f063c131860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:17.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.165+0000 7f0640ddd700 1 -- 172.21.15.26:0/824961711 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c099460 con 0x7f063c0654a0 2023-10-01T07:52:17.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.165+0000 7f063bfff700 1 --2- 172.21.15.26:0/824961711 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f063c098b30 0x7f063c098f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:17.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.165+0000 7f0640ddd700 1 --2- 172.21.15.26:0/824961711 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f063c0654a0 0x7f063c098640 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f062c006fd0 tx=0x7f062c0090f0).ready entity=mon.0 client_cookie=b36f7143e52f4ee7 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:17.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.165+0000 7f063b7fe700 1 -- 172.21.15.26:0/824961711 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c00b580 con 0x7f063c0654a0 2023-10-01T07:52:17.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.165+0000 7f063b7fe700 1 -- 172.21.15.26:0/824961711 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062c00b6e0 con 0x7f063c0654a0 2023-10-01T07:52:17.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.165+0000 7f063b7fe700 1 -- 172.21.15.26:0/824961711 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c00ba60 con 0x7f063c0654a0 2023-10-01T07:52:17.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.166+0000 7f0643041700 1 -- 172.21.15.26:0/824961711 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f063c0654a0 msgr2=0x7f063c098640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:17.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.166+0000 7f0643041700 1 --2- 172.21.15.26:0/824961711 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f063c0654a0 0x7f063c098640 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f062c006fd0 tx=0x7f062c0090f0).stop 2023-10-01T07:52:17.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.166+0000 7f0643041700 1 -- 172.21.15.26:0/824961711 shutdown_connections 2023-10-01T07:52:17.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.166+0000 7f0643041700 1 --2- 172.21.15.26:0/824961711 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f063c0654a0 0x7f063c098640 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:17.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.166+0000 7f0643041700 1 --2- 172.21.15.26:0/824961711 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f063c098b30 0x7f063c098f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:17.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.166+0000 7f0643041700 1 -- 172.21.15.26:0/824961711 >> 172.21.15.26:0/824961711 conn(0x7f063c09a740 msgr2=0x7f063c09ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:17.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.166+0000 7f0643041700 1 -- 172.21.15.26:0/824961711 shutdown_connections 2023-10-01T07:52:17.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.166+0000 7f0643041700 1 -- 172.21.15.26:0/824961711 wait complete. 2023-10-01T07:52:17.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.167+0000 7f0643041700 1 Processor -- start 2023-10-01T07:52:17.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.167+0000 7f0643041700 1 -- start start 2023-10-01T07:52:17.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.167+0000 7f0643041700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f063c0654a0 0x7f063c13ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:17.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.167+0000 7f0643041700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f063c098b30 0x7f063c13b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:17.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.167+0000 7f0643041700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f063c12f470 0x7f063c1197c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:17.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.167+0000 7f0643041700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c11d480 con 0x7f063c098b30 2023-10-01T07:52:17.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.167+0000 7f0643041700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063c12f960 con 0x7f063c12f470 2023-10-01T07:52:17.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.167+0000 7f0643041700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f063c09cb10 con 0x7f063c0654a0 2023-10-01T07:52:17.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.167+0000 7f06415de700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f063c12f470 0x7f063c1197c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:17.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.167+0000 7f063bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f063c098b30 0x7f063c13b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:17.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.167+0000 7f06415de700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f063c12f470 0x7f063c1197c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58462/0 (socket says 172.21.15.26:58462) 2023-10-01T07:52:17.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.167+0000 7f06415de700 1 -- 172.21.15.26:0/3033565382 learned_addr learned my addr 172.21.15.26:0/3033565382 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:17.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.168+0000 7f0640ddd700 1 --2- 172.21.15.26:0/3033565382 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f063c0654a0 0x7f063c13ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:17.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.168+0000 7f06415de700 1 -- 172.21.15.26:0/3033565382 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f063c0654a0 msgr2=0x7f063c13ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:17.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.168+0000 7f06415de700 1 --2- 172.21.15.26:0/3033565382 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f063c0654a0 0x7f063c13ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:17.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.168+0000 7f06415de700 1 -- 172.21.15.26:0/3033565382 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f063c098b30 msgr2=0x7f063c13b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:17.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.168+0000 7f06415de700 1 --2- 172.21.15.26:0/3033565382 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f063c098b30 0x7f063c13b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:17.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.168+0000 7f06415de700 1 -- 172.21.15.26:0/3033565382 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06300092a0 con 0x7f063c12f470 2023-10-01T07:52:17.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.168+0000 7f063bfff700 1 --2- 172.21.15.26:0/3033565382 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f063c098b30 0x7f063c13b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:17.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.168+0000 7f06415de700 1 --2- 172.21.15.26:0/3033565382 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f063c12f470 0x7f063c1197c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f063400c7c0 tx=0x7f0634001560).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:17.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.168+0000 7f0638ff9700 1 -- 172.21.15.26:0/3033565382 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0634005c70 con 0x7f063c12f470 2023-10-01T07:52:17.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.168+0000 7f0638ff9700 1 -- 172.21.15.26:0/3033565382 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0634005dd0 con 0x7f063c12f470 2023-10-01T07:52:17.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.168+0000 7f0643041700 1 -- 172.21.15.26:0/3033565382 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f062c009370 con 0x7f063c12f470 2023-10-01T07:52:17.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.168+0000 7f0638ff9700 1 -- 172.21.15.26:0/3033565382 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06340072e0 con 0x7f063c12f470 2023-10-01T07:52:17.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.168+0000 7f0643041700 1 -- 172.21.15.26:0/3033565382 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f063c11d8f0 con 0x7f063c12f470 2023-10-01T07:52:17.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.169+0000 7f0638ff9700 1 -- 172.21.15.26:0/3033565382 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f06340076d0 con 0x7f063c12f470 2023-10-01T07:52:17.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.169+0000 7f0638ff9700 1 -- 172.21.15.26:0/3033565382 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f063403a7d0 con 0x7f063c12f470 2023-10-01T07:52:17.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.169+0000 7f0643041700 1 -- 172.21.15.26:0/3033565382 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f063c096fb0 con 0x7f063c12f470 2023-10-01T07:52:17.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.174+0000 7f0638ff9700 1 -- 172.21.15.26:0/3033565382 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f0634010300 con 0x7f063c12f470 2023-10-01T07:52:17.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.390+0000 7f0643041700 1 -- 172.21.15.26:0/3033565382 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f063c05a260 con 0x7f063c12f470 2023-10-01T07:52:17.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.391+0000 7f0638ff9700 1 -- 172.21.15.26:0/3033565382 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f063401c3a0 con 0x7f063c12f470 2023-10-01T07:52:17.391 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-01T07:52:17.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.392+0000 7f0643041700 1 -- 172.21.15.26:0/3033565382 >> v1:172.21.15.26:6816/118178 conn(0x7f062802bb60 legacy=0x7f062802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:17.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.392+0000 7f0643041700 1 -- 172.21.15.26:0/3033565382 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f063c12f470 msgr2=0x7f063c1197c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:17.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.392+0000 7f0643041700 1 --2- 172.21.15.26:0/3033565382 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f063c12f470 0x7f063c1197c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f063400c7c0 tx=0x7f0634001560).stop 2023-10-01T07:52:17.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.392+0000 7f0643041700 1 -- 172.21.15.26:0/3033565382 shutdown_connections 2023-10-01T07:52:17.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.392+0000 7f0643041700 1 --2- 172.21.15.26:0/3033565382 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f063c12f470 0x7f063c1197c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:17.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.392+0000 7f0643041700 1 --2- 172.21.15.26:0/3033565382 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f063c0654a0 0x7f063c13ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:17.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.392+0000 7f0643041700 1 --2- 172.21.15.26:0/3033565382 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f063c098b30 0x7f063c13b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:17.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.392+0000 7f0643041700 1 -- 172.21.15.26:0/3033565382 >> 172.21.15.26:0/3033565382 conn(0x7f063c09a740 msgr2=0x7f063c12e690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:17.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.393+0000 7f0643041700 1 -- 172.21.15.26:0/3033565382 shutdown_connections 2023-10-01T07:52:17.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:17.393+0000 7f0643041700 1 -- 172.21.15.26:0/3033565382 wait complete. 2023-10-01T07:52:17.406 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-01T07:52:17.406 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-01T07:52:17.406 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi092.front.sepia.ceph.com 2023-10-01T07:52:17.406 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-01T07:52:17.406 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-01T07:52:17.406 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-01T07:52:17.406 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-01T07:52:17.406 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-01T07:52:17.406 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-01T07:52:17.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-01T07:52:17.407 DEBUG:teuthology.orchestra.run.smithi092:> ip addr 2023-10-01T07:52:17.430 INFO:teuthology.orchestra.run.smithi092.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-01T07:52:17.430 INFO:teuthology.orchestra.run.smithi092.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-01T07:52:17.430 INFO:teuthology.orchestra.run.smithi092.stdout: inet 127.0.0.1/8 scope host lo 2023-10-01T07:52:17.430 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-10-01T07:52:17.430 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 ::1/128 scope host 2023-10-01T07:52:17.430 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-10-01T07:52:17.430 INFO:teuthology.orchestra.run.smithi092.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-01T07:52:17.430 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b2 brd ff:ff:ff:ff:ff:ff 2023-10-01T07:52:17.430 INFO:teuthology.orchestra.run.smithi092.stdout: altname enp7s0f0 2023-10-01T07:52:17.431 INFO:teuthology.orchestra.run.smithi092.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-01T07:52:17.431 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b3 brd ff:ff:ff:ff:ff:ff 2023-10-01T07:52:17.431 INFO:teuthology.orchestra.run.smithi092.stdout: altname enp7s0f1 2023-10-01T07:52:17.431 INFO:teuthology.orchestra.run.smithi092.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-01T07:52:17.431 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:44 brd ff:ff:ff:ff:ff:ff 2023-10-01T07:52:17.431 INFO:teuthology.orchestra.run.smithi092.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-01T07:52:17.431 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:45 brd ff:ff:ff:ff:ff:ff 2023-10-01T07:52:17.431 INFO:teuthology.orchestra.run.smithi092.stdout: inet 172.21.15.92/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-01T07:52:17.431 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft 42499sec preferred_lft 42499sec 2023-10-01T07:52:17.431 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::ec4:7aff:fe8f:cd45/64 scope link 2023-10-01T07:52:17.432 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-10-01T07:52:17.432 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-01T07:52:17.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-01T07:52:17.432 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-10-01T07:52:17.432 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-10-01T07:52:17.432 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link add name ceph-brx type bridge 2023-10-01T07:52:17.433 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip addr flush dev ceph-brx 2023-10-01T07:52:17.433 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set ceph-brx up 2023-10-01T07:52:17.433 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-01T07:52:17.433 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-10-01T07:52:17.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-01T07:52:17.607 DEBUG:teuthology.orchestra.run.smithi092:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-01T07:52:17.636 INFO:teuthology.orchestra.run.smithi092.stdout:1 2023-10-01T07:52:17.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-01T07:52:17.638 DEBUG:teuthology.orchestra.run.smithi092:> route 2023-10-01T07:52:17.717 INFO:teuthology.orchestra.run.smithi092.stdout:Kernel IP routing table 2023-10-01T07:52:17.717 INFO:teuthology.orchestra.run.smithi092.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-01T07:52:17.717 INFO:teuthology.orchestra.run.smithi092.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-01T07:52:17.717 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-01T07:52:17.717 INFO:teuthology.orchestra.run.smithi092.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-01T07:52:17.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-01T07:52:17.718 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-10-01T07:52:17.718 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-10-01T07:52:17.718 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-01T07:52:17.718 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-01T07:52:17.718 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-01T07:52:17.718 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-10-01T07:52:18.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-01T07:52:18.025 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2023-10-01T07:52:18.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-01T07:52:18.044 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list-id 2023-10-01T07:52:18.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-01T07:52:18.101 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-10-01T07:52:18.102 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-10-01T07:52:18.102 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-01T07:52:18.102 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-01T07:52:18.102 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-10-01T07:52:18.196 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-01T07:52:18.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-01T07:52:18.197 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-10-01T07:52:18.197 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-10-01T07:52:18.197 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-01T07:52:18.197 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-01T07:52:18.197 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-01T07:52:18.197 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-01T07:52:18.197 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-01T07:52:18.197 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-10-01T07:52:18.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-01T07:52:18.406 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-10-01T07:52:18.406 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-10-01T07:52:18.406 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set brx.0 up 2023-10-01T07:52:18.406 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set dev brx.0 master ceph-brx 2023-10-01T07:52:18.406 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-10-01T07:52:18.503 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-01T07:52:18.503 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-01T07:52:18.503 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-01T07:52:18.521 INFO:teuthology.orchestra.run.smithi092.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-01T07:52:18.521 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-01T07:52:18.521 DEBUG:teuthology.orchestra.run.smithi092:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-01T07:52:18.578 DEBUG:teuthology.orchestra.run.smithi092:> sudo modprobe fuse 2023-10-01T07:52:18.645 DEBUG:teuthology.orchestra.run.smithi092:> cat /proc/self/mounts | awk '{print $2}' 2023-10-01T07:52:18.704 INFO:teuthology.orchestra.run.smithi092.stdout:/sys 2023-10-01T07:52:18.704 INFO:teuthology.orchestra.run.smithi092.stdout:/proc 2023-10-01T07:52:18.704 INFO:teuthology.orchestra.run.smithi092.stdout:/dev 2023-10-01T07:52:18.704 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/security 2023-10-01T07:52:18.704 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/shm 2023-10-01T07:52:18.704 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/pts 2023-10-01T07:52:18.704 INFO:teuthology.orchestra.run.smithi092.stdout:/run 2023-10-01T07:52:18.704 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup 2023-10-01T07:52:18.705 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup/systemd 2023-10-01T07:52:18.705 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/pstore 2023-10-01T07:52:18.705 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/bpf 2023-10-01T07:52:18.705 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-01T07:52:18.705 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup/perf_event 2023-10-01T07:52:18.705 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup/memory 2023-10-01T07:52:18.705 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup/devices 2023-10-01T07:52:18.705 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup/cpuset 2023-10-01T07:52:18.705 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup/hugetlb 2023-10-01T07:52:18.705 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup/blkio 2023-10-01T07:52:18.705 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup/freezer 2023-10-01T07:52:18.705 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup/rdma 2023-10-01T07:52:18.706 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup/pids 2023-10-01T07:52:18.706 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-01T07:52:18.706 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/tracing 2023-10-01T07:52:18.706 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/config 2023-10-01T07:52:18.706 INFO:teuthology.orchestra.run.smithi092.stdout:/ 2023-10-01T07:52:18.706 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/selinux 2023-10-01T07:52:18.706 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/debug 2023-10-01T07:52:18.706 INFO:teuthology.orchestra.run.smithi092.stdout:/proc/sys/fs/binfmt_misc 2023-10-01T07:52:18.706 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/hugepages 2023-10-01T07:52:18.706 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/mqueue 2023-10-01T07:52:18.706 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/fuse/connections 2023-10-01T07:52:18.706 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/nfs/rpc_pipefs 2023-10-01T07:52:18.707 INFO:teuthology.orchestra.run.smithi092.stdout:/run/user/1000 2023-10-01T07:52:18.707 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/ceph 2023-10-01T07:52:18.707 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns 2023-10-01T07:52:18.707 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-01T07:52:18.707 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-01T07:52:18.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-01T07:52:18.708 DEBUG:teuthology.orchestra.run.smithi092:> ls /sys/fs/fuse/connections 2023-10-01T07:52:18.766 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-01T07:52:18.766 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-01T07:52:18.808 DEBUG:teuthology.orchestra.run.smithi092:> sudo modprobe fuse 2023-10-01T07:52:18.834 DEBUG:teuthology.orchestra.run.smithi092:> cat /proc/self/mounts | awk '{print $2}' 2023-10-01T07:52:18.892 INFO:teuthology.orchestra.run.smithi092.stdout:/sys 2023-10-01T07:52:18.892 INFO:teuthology.orchestra.run.smithi092.stdout:/proc 2023-10-01T07:52:18.893 INFO:teuthology.orchestra.run.smithi092.stdout:/dev 2023-10-01T07:52:18.893 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/security 2023-10-01T07:52:18.893 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/shm 2023-10-01T07:52:18.893 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/pts 2023-10-01T07:52:18.893 INFO:teuthology.orchestra.run.smithi092.stdout:/run 2023-10-01T07:52:18.893 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup 2023-10-01T07:52:18.893 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup/systemd 2023-10-01T07:52:18.893 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/pstore 2023-10-01T07:52:18.893 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/bpf 2023-10-01T07:52:18.893 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-01T07:52:18.893 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup/perf_event 2023-10-01T07:52:18.894 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup/memory 2023-10-01T07:52:18.894 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup/devices 2023-10-01T07:52:18.894 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup/cpuset 2023-10-01T07:52:18.894 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup/hugetlb 2023-10-01T07:52:18.894 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup/blkio 2023-10-01T07:52:18.894 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup/freezer 2023-10-01T07:52:18.894 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup/rdma 2023-10-01T07:52:18.894 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup/pids 2023-10-01T07:52:18.894 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-01T07:52:18.894 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/tracing 2023-10-01T07:52:18.894 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/config 2023-10-01T07:52:18.895 INFO:teuthology.orchestra.run.smithi092.stdout:/ 2023-10-01T07:52:18.895 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/selinux 2023-10-01T07:52:18.895 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/debug 2023-10-01T07:52:18.895 INFO:teuthology.orchestra.run.smithi092.stdout:/proc/sys/fs/binfmt_misc 2023-10-01T07:52:18.895 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/hugepages 2023-10-01T07:52:18.895 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/mqueue 2023-10-01T07:52:18.895 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/fuse/connections 2023-10-01T07:52:18.895 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/nfs/rpc_pipefs 2023-10-01T07:52:18.895 INFO:teuthology.orchestra.run.smithi092.stdout:/run/user/1000 2023-10-01T07:52:18.895 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/ceph 2023-10-01T07:52:18.896 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns 2023-10-01T07:52:18.896 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-01T07:52:18.896 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-01T07:52:18.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-01T07:52:18.896 DEBUG:teuthology.orchestra.run.smithi092:> ls /sys/fs/fuse/connections 2023-10-01T07:52:18.901 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi092.stderr:2023-10-01T07:52:18.901+0000 7faeaaaf73c0 -1 init, newargv = 0x5623384f5330 newargc=15 2023-10-01T07:52:18.901 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi092.stderr:ceph-fuse[112237]: starting ceph client 2023-10-01T07:52:18.906 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi092.stderr:ceph-fuse[112237]: starting fuse 2023-10-01T07:52:18.918 INFO:teuthology.orchestra.run.smithi092.stdout:46 2023-10-01T07:52:18.918 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-01T07:52:18.919 DEBUG:teuthology.orchestra.run.smithi092:> sudo stdin-killer -- python3 -c ' 2023-10-01T07:52:18.919 DEBUG:teuthology.orchestra.run.smithi092:> import glob 2023-10-01T07:52:18.919 DEBUG:teuthology.orchestra.run.smithi092:> import re 2023-10-01T07:52:18.919 DEBUG:teuthology.orchestra.run.smithi092:> import os 2023-10-01T07:52:18.919 DEBUG:teuthology.orchestra.run.smithi092:> import subprocess 2023-10-01T07:52:18.919 DEBUG:teuthology.orchestra.run.smithi092:> 2023-10-01T07:52:18.919 DEBUG:teuthology.orchestra.run.smithi092:> def _find_admin_socket(client_name): 2023-10-01T07:52:18.919 DEBUG:teuthology.orchestra.run.smithi092:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-01T07:52:18.919 DEBUG:teuthology.orchestra.run.smithi092:> files = glob.glob(asok_path) 2023-10-01T07:52:18.919 DEBUG:teuthology.orchestra.run.smithi092:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-01T07:52:18.919 DEBUG:teuthology.orchestra.run.smithi092:> 2023-10-01T07:52:18.919 DEBUG:teuthology.orchestra.run.smithi092:> # Given a non-glob path, it better be there 2023-10-01T07:52:18.920 DEBUG:teuthology.orchestra.run.smithi092:> if "*" not in asok_path: 2023-10-01T07:52:18.920 DEBUG:teuthology.orchestra.run.smithi092:> assert(len(files) == 1) 2023-10-01T07:52:18.920 DEBUG:teuthology.orchestra.run.smithi092:> return files[0] 2023-10-01T07:52:18.920 DEBUG:teuthology.orchestra.run.smithi092:> 2023-10-01T07:52:18.920 DEBUG:teuthology.orchestra.run.smithi092:> for f in files: 2023-10-01T07:52:18.920 DEBUG:teuthology.orchestra.run.smithi092:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-01T07:52:18.920 DEBUG:teuthology.orchestra.run.smithi092:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-01T07:52:18.920 DEBUG:teuthology.orchestra.run.smithi092:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-01T07:52:18.920 DEBUG:teuthology.orchestra.run.smithi092:> contents = proc_f.read() 2023-10-01T07:52:18.920 DEBUG:teuthology.orchestra.run.smithi092:> if mountpoint in contents: 2023-10-01T07:52:18.920 DEBUG:teuthology.orchestra.run.smithi092:> return f 2023-10-01T07:52:18.920 DEBUG:teuthology.orchestra.run.smithi092:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-01T07:52:18.920 DEBUG:teuthology.orchestra.run.smithi092:> 2023-10-01T07:52:18.921 DEBUG:teuthology.orchestra.run.smithi092:> print(_find_admin_socket("client.0")) 2023-10-01T07:52:18.921 DEBUG:teuthology.orchestra.run.smithi092:> ' 2023-10-01T07:52:19.042 INFO:teuthology.orchestra.run.smithi092.stdout:/var/run/ceph/ceph-client.0.112237.asok 2023-10-01T07:52:19.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-01T07:52:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-01T07:52:19.052 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.112237.asok 2023-10-01T07:52:19.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-01T07:52:19.052 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.112237.asok status 2023-10-01T07:52:19.202 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-10-01T07:52:19.203 INFO:teuthology.orchestra.run.smithi092.stdout: "metadata": { 2023-10-01T07:52:19.203 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_sha1": "eeb13ac974775bd0cce96a2c687e8bcc2faca43d", 2023-10-01T07:52:19.203 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_version": "ceph version 16.2.14-44-geeb13ac9 (eeb13ac974775bd0cce96a2c687e8bcc2faca43d) pacific (stable)", 2023-10-01T07:52:19.203 INFO:teuthology.orchestra.run.smithi092.stdout: "entity_id": "0", 2023-10-01T07:52:19.203 INFO:teuthology.orchestra.run.smithi092.stdout: "hostname": "smithi092", 2023-10-01T07:52:19.203 INFO:teuthology.orchestra.run.smithi092.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-01T07:52:19.203 INFO:teuthology.orchestra.run.smithi092.stdout: "pid": "112237", 2023-10-01T07:52:19.203 INFO:teuthology.orchestra.run.smithi092.stdout: "root": "/" 2023-10-01T07:52:19.203 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-01T07:52:19.204 INFO:teuthology.orchestra.run.smithi092.stdout: "dentry_count": 0, 2023-10-01T07:52:19.204 INFO:teuthology.orchestra.run.smithi092.stdout: "dentry_pinned_count": 0, 2023-10-01T07:52:19.204 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 4659, 2023-10-01T07:52:19.204 INFO:teuthology.orchestra.run.smithi092.stdout: "inst": { 2023-10-01T07:52:19.204 INFO:teuthology.orchestra.run.smithi092.stdout: "name": { 2023-10-01T07:52:19.204 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "client", 2023-10-01T07:52:19.204 INFO:teuthology.orchestra.run.smithi092.stdout: "num": 4659 2023-10-01T07:52:19.204 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-01T07:52:19.204 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": { 2023-10-01T07:52:19.204 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v1", 2023-10-01T07:52:19.204 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "172.21.15.92:0", 2023-10-01T07:52:19.204 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 2708208130 2023-10-01T07:52:19.204 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-10-01T07:52:19.205 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-01T07:52:19.205 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": { 2023-10-01T07:52:19.205 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v1", 2023-10-01T07:52:19.205 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "172.21.15.92:0", 2023-10-01T07:52:19.205 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 2708208130 2023-10-01T07:52:19.205 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-10-01T07:52:19.205 INFO:teuthology.orchestra.run.smithi092.stdout: "inst_str": "client.4659 172.21.15.92:0/2708208130", 2023-10-01T07:52:19.205 INFO:teuthology.orchestra.run.smithi092.stdout: "addr_str": "172.21.15.92:0/2708208130", 2023-10-01T07:52:19.205 INFO:teuthology.orchestra.run.smithi092.stdout: "inode_count": 1, 2023-10-01T07:52:19.205 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_epoch": 6, 2023-10-01T07:52:19.205 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_epoch": 18, 2023-10-01T07:52:19.206 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_epoch_barrier": 0, 2023-10-01T07:52:19.206 INFO:teuthology.orchestra.run.smithi092.stdout: "blocklisted": false, 2023-10-01T07:52:19.206 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs" 2023-10-01T07:52:19.206 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-10-01T07:52:19.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-01T07:52:19.212 DEBUG:teuthology.orchestra.run.smithi092:> stat --file-system '--printf=%T 2023-10-01T07:52:19.213 DEBUG:teuthology.orchestra.run.smithi092:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-01T07:52:19.231 INFO:teuthology.orchestra.run.smithi092.stdout:fuseblk 2023-10-01T07:52:19.232 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-01T07:52:19.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-01T07:52:19.232 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-01T07:52:19.300 INFO:teuthology.run_tasks:Running task mds_pre_upgrade... 2023-10-01T07:52:19.331 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-01T07:52:19.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.469+0000 7f595256b700 1 Processor -- start 2023-10-01T07:52:19.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.469+0000 7f595256b700 1 -- start start 2023-10-01T07:52:19.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.470+0000 7f595256b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f594c096820 0x7f594c096c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:19.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.470+0000 7f595256b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f594c097800 0x7f594c130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:19.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.470+0000 7f595256b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f594c068df0 con 0x7f594c067940 2023-10-01T07:52:19.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.470+0000 7f595256b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f594c097c90 con 0x7f594c096820 2023-10-01T07:52:19.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.470+0000 7f595256b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f594c06a4c0 con 0x7f594c097800 2023-10-01T07:52:19.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.470+0000 7f594bfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f594c096820 0x7f594c096c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:19.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.470+0000 7f5950b08700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f594c097800 0x7f594c130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:19.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.470+0000 7f594bfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f594c096820 0x7f594c096c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44302/0 (socket says 172.21.15.26:44302) 2023-10-01T07:52:19.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.470+0000 7f594b7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f594c067940 0x7f594c0970f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56574/0 (socket says 172.21.15.26:56574) 2023-10-01T07:52:19.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.470+0000 7f5950b08700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f594c097800 0x7f594c130280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58474/0 (socket says 172.21.15.26:58474) 2023-10-01T07:52:19.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.470+0000 7f594bfff700 1 -- 172.21.15.26:0/1391197748 learned_addr learned my addr 172.21.15.26:0/1391197748 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:19.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.470+0000 7f594bfff700 1 -- 172.21.15.26:0/1391197748 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f594c097800 msgr2=0x7f594c130280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:19.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.470+0000 7f594bfff700 1 --2- 172.21.15.26:0/1391197748 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f594c097800 0x7f594c130280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:19.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.470+0000 7f594bfff700 1 -- 172.21.15.26:0/1391197748 >> v1:172.21.15.26:6789/0 conn(0x7f594c067940 legacy=0x7f594c0970f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:19.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.470+0000 7f594bfff700 1 -- 172.21.15.26:0/1391197748 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f594c098260 con 0x7f594c096820 2023-10-01T07:52:19.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.470+0000 7f594affd700 1 -- 172.21.15.26:0/1391197748 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2758141525 0 0) 0x7f594c068df0 con 0x7f594c067940 2023-10-01T07:52:19.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.470+0000 7f5950b08700 1 --2- 172.21.15.26:0/1391197748 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f594c097800 0x7f594c130280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:19.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.471+0000 7f594bfff700 1 --2- 172.21.15.26:0/1391197748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f594c096820 0x7f594c096c00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f593c006fd0 tx=0x7f593c0090f0).ready entity=mon.0 client_cookie=ba465377d50f623 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:19.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.471+0000 7f594affd700 1 -- 172.21.15.26:0/1391197748 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c00b580 con 0x7f594c096820 2023-10-01T07:52:19.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.471+0000 7f594affd700 1 -- 172.21.15.26:0/1391197748 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593c00b6e0 con 0x7f594c096820 2023-10-01T07:52:19.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.471+0000 7f594affd700 1 -- 172.21.15.26:0/1391197748 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c00ba60 con 0x7f594c096820 2023-10-01T07:52:19.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.471+0000 7f595256b700 1 -- 172.21.15.26:0/1391197748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f594c096820 msgr2=0x7f594c096c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:19.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.471+0000 7f595256b700 1 --2- 172.21.15.26:0/1391197748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f594c096820 0x7f594c096c00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f593c006fd0 tx=0x7f593c0090f0).stop 2023-10-01T07:52:19.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.471+0000 7f595256b700 1 -- 172.21.15.26:0/1391197748 shutdown_connections 2023-10-01T07:52:19.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.471+0000 7f595256b700 1 --2- 172.21.15.26:0/1391197748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f594c096820 0x7f594c096c00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:19.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.471+0000 7f595256b700 1 --2- 172.21.15.26:0/1391197748 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f594c097800 0x7f594c130280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:19.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.471+0000 7f595256b700 1 -- 172.21.15.26:0/1391197748 >> 172.21.15.26:0/1391197748 conn(0x7f594c09ba50 msgr2=0x7f594c09be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:19.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.471+0000 7f595256b700 1 -- 172.21.15.26:0/1391197748 shutdown_connections 2023-10-01T07:52:19.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.471+0000 7f595256b700 1 -- 172.21.15.26:0/1391197748 wait complete. 2023-10-01T07:52:19.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.472+0000 7f595256b700 1 Processor -- start 2023-10-01T07:52:19.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.473+0000 7f595256b700 1 -- start start 2023-10-01T07:52:19.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.473+0000 7f595256b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f594c067940 0x7f594c11e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:19.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.473+0000 7f595256b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f594c096820 0x7f594c064540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:19.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.473+0000 7f595256b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f594c097800 0x7f594c064a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:19.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.473+0000 7f595256b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594c065fe0 con 0x7f594c096820 2023-10-01T07:52:19.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.473+0000 7f595256b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f594c0661d0 con 0x7f594c067940 2023-10-01T07:52:19.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.473+0000 7f595256b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f594c067e30 con 0x7f594c097800 2023-10-01T07:52:19.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.473+0000 7f594b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f594c096820 0x7f594c064540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:19.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.473+0000 7f5950b08700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f594c097800 0x7f594c064a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:19.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.473+0000 7f594bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f594c067940 0x7f594c11e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:19.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.473+0000 7f594b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f594c096820 0x7f594c064540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44312/0 (socket says 172.21.15.26:44312) 2023-10-01T07:52:19.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.473+0000 7f5950b08700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f594c097800 0x7f594c064a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55576/0 (socket says 172.21.15.26:55576) 2023-10-01T07:52:19.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.473+0000 7f594b7fe700 1 -- 172.21.15.26:0/2321242373 learned_addr learned my addr 172.21.15.26:0/2321242373 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:19.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.474+0000 7f594bfff700 1 -- 172.21.15.26:0/2321242373 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f594c097800 msgr2=0x7f594c064a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:19.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.474+0000 7f594bfff700 1 --2- 172.21.15.26:0/2321242373 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f594c097800 0x7f594c064a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:19.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.474+0000 7f594bfff700 1 -- 172.21.15.26:0/2321242373 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f594c096820 msgr2=0x7f594c064540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:19.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.474+0000 7f594bfff700 1 --2- 172.21.15.26:0/2321242373 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f594c096820 0x7f594c064540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:19.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.474+0000 7f594bfff700 1 -- 172.21.15.26:0/2321242373 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5944009a20 con 0x7f594c067940 2023-10-01T07:52:19.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.474+0000 7f594bfff700 1 --2- 172.21.15.26:0/2321242373 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f594c067940 0x7f594c11e480 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f593c014000 tx=0x7f593c017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:19.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.474+0000 7f5933fff700 1 -- 172.21.15.26:0/2321242373 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c00b850 con 0x7f594c067940 2023-10-01T07:52:19.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.474+0000 7f5933fff700 1 -- 172.21.15.26:0/2321242373 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593c00b9b0 con 0x7f594c067940 2023-10-01T07:52:19.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.474+0000 7f595256b700 1 -- 172.21.15.26:0/2321242373 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f593c009370 con 0x7f594c067940 2023-10-01T07:52:19.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.474+0000 7f5933fff700 1 -- 172.21.15.26:0/2321242373 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c01c670 con 0x7f594c067940 2023-10-01T07:52:19.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.474+0000 7f595256b700 1 -- 172.21.15.26:0/2321242373 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f594c11d5c0 con 0x7f594c067940 2023-10-01T07:52:19.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.475+0000 7f5933fff700 1 -- 172.21.15.26:0/2321242373 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f593c01caa0 con 0x7f594c067940 2023-10-01T07:52:19.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.475+0000 7f5933fff700 1 -- 172.21.15.26:0/2321242373 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f593c03d050 con 0x7f594c067940 2023-10-01T07:52:19.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.475+0000 7f595256b700 1 -- 172.21.15.26:0/2321242373 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f594c09b790 con 0x7f594c067940 2023-10-01T07:52:19.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.480+0000 7f5933fff700 1 -- 172.21.15.26:0/2321242373 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f593c02a020 con 0x7f594c067940 2023-10-01T07:52:19.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.656+0000 7f595256b700 1 -- 172.21.15.26:0/2321242373 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f594c05a260 con 0x7f594c067940 2023-10-01T07:52:19.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.657+0000 7f5933fff700 1 -- 172.21.15.26:0/2321242373 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+11340 (secure 0 0 0) 0x7f593c020070 con 0x7f594c067940 2023-10-01T07:52:19.657 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:52:19.657 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":18,"fsid":"c29fb19d-520c-42a6-90f4-e7f86de96e8e","created":"2023-10-01T07:51:40.702414+0000","modified":"2023-10-01T07:52:16.703654+0000","last_up_change":"2023-10-01T07:51:48.849482+0000","last_in_change":"2023-10-01T07:51:42.084736+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-01T07:51:48.906889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-01T07:51:50.071599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-01T07:51:54.981575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-01T07:51:56.286318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46569ce3-81d1-44a1-a649-691de3e6f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6800","nonce":118773}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6801","nonce":118773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6803","nonce":118773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6802","nonce":118773}]},"public_addr":"172.21.15.26:6800/118773","cluster_addr":"172.21.15.26:6801/118773","heartbeat_back_addr":"172.21.15.26:6803/118773","heartbeat_front_addr":"172.21.15.26:6802/118773","state":["exists","up"]},{"osd":1,"uuid":"1fc1ba9b-4110-4d31-96d6-794937578cff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6804","nonce":118782}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6806","nonce":118782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6810","nonce":118782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6808","nonce":118782}]},"public_addr":"172.21.15.26:6804/118782","cluster_addr":"172.21.15.26:6806/118782","heartbeat_back_addr":"172.21.15.26:6810/118782","heartbeat_front_addr":"172.21.15.26:6808/118782","state":["exists","up"]},{"osd":2,"uuid":"37de933d-3b8e-4b94-87bd-2f36896c7ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6805","nonce":118789}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6807","nonce":118789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6811","nonce":118789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6809","nonce":118789}]},"public_addr":"172.21.15.26:6805/118789","cluster_addr":"172.21.15.26:6807/118789","heartbeat_back_addr":"172.21.15.26:6811/118789","heartbeat_front_addr":"172.21.15.26:6809/118789","state":["exists","up"]},{"osd":3,"uuid":"bd020309-5fd2-4d97-b36a-67e159fa3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6812","nonce":118790}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6813","nonce":118790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6815","nonce":118790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6814","nonce":118790}]},"public_addr":"172.21.15.26:6812/118790","cluster_addr":"172.21.15.26:6813/118790","heartbeat_back_addr":"172.21.15.26:6815/118790","heartbeat_front_addr":"172.21.15.26:6814/118790","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.029993+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.266503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.273540+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.229731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-01T07:52:19.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.659+0000 7f595256b700 1 -- 172.21.15.26:0/2321242373 >> v1:172.21.15.26:6816/118178 conn(0x7f593802bb60 legacy=0x7f593802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:19.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.659+0000 7f595256b700 1 -- 172.21.15.26:0/2321242373 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f594c067940 msgr2=0x7f594c11e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:19.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.659+0000 7f595256b700 1 --2- 172.21.15.26:0/2321242373 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f594c067940 0x7f594c11e480 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f593c014000 tx=0x7f593c017000).stop 2023-10-01T07:52:19.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.659+0000 7f595256b700 1 -- 172.21.15.26:0/2321242373 shutdown_connections 2023-10-01T07:52:19.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.659+0000 7f595256b700 1 --2- 172.21.15.26:0/2321242373 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f594c097800 0x7f594c064a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:19.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.659+0000 7f595256b700 1 --2- 172.21.15.26:0/2321242373 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f594c067940 0x7f594c11e480 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:19.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.659+0000 7f595256b700 1 --2- 172.21.15.26:0/2321242373 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f594c096820 0x7f594c064540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:19.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.659+0000 7f595256b700 1 -- 172.21.15.26:0/2321242373 >> 172.21.15.26:0/2321242373 conn(0x7f594c09ba50 msgr2=0x7f594c099880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:19.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.659+0000 7f595256b700 1 -- 172.21.15.26:0/2321242373 shutdown_connections 2023-10-01T07:52:19.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.659+0000 7f595256b700 1 -- 172.21.15.26:0/2321242373 wait complete. 2023-10-01T07:52:19.672 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-01T07:51:48.906889+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-01T07:51:50.071599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-01T07:51:54.981575+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-01T07:51:56.286318+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-01T07:52:19.673 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-01T07:52:19.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.807+0000 7fa37387a700 1 Processor -- start 2023-10-01T07:52:19.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.807+0000 7fa37387a700 1 -- start start 2023-10-01T07:52:19.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.807+0000 7fa37387a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa36c093840 0x7fa36c098790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:19.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.807+0000 7fa37387a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa36c098c80 0x7fa36c099060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:19.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.807+0000 7fa37387a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa36c092d80 con 0x7fa36c12c150 2023-10-01T07:52:19.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.807+0000 7fa37387a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c093c20 con 0x7fa36c093840 2023-10-01T07:52:19.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.807+0000 7fa37387a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c092b90 con 0x7fa36c098c80 2023-10-01T07:52:19.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.808+0000 7fa370e15700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa36c098c80 0x7fa36c099060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:19.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.808+0000 7fa371616700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa36c093840 0x7fa36c098790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:19.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.808+0000 7fa371e17700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa36c12c150 0x7fa36c12e540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56588/0 (socket says 172.21.15.26:56588) 2023-10-01T07:52:19.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.808+0000 7fa371e17700 1 -- 172.21.15.26:0/438125072 learned_addr learned my addr 172.21.15.26:0/438125072 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:52:19.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.808+0000 7fa363fff700 1 -- 172.21.15.26:0/438125072 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4205799267 0 0) 0x7fa36c092d80 con 0x7fa36c12c150 2023-10-01T07:52:19.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.808+0000 7fa371616700 1 -- 172.21.15.26:0/438125072 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa36c098c80 msgr2=0x7fa36c099060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:19.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.808+0000 7fa371616700 1 --2- 172.21.15.26:0/438125072 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa36c098c80 0x7fa36c099060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:19.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.808+0000 7fa371616700 1 -- 172.21.15.26:0/438125072 >> v1:172.21.15.26:6789/0 conn(0x7fa36c12c150 legacy=0x7fa36c12e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:19.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.808+0000 7fa371616700 1 -- 172.21.15.26:0/438125072 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa36c099b70 con 0x7fa36c093840 2023-10-01T07:52:19.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.808+0000 7fa370e15700 1 --2- 172.21.15.26:0/438125072 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa36c098c80 0x7fa36c099060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:19.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.808+0000 7fa371616700 1 --2- 172.21.15.26:0/438125072 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa36c093840 0x7fa36c098790 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fa368009790 tx=0x7fa368009060).ready entity=mon.1 client_cookie=a31381379ec57502 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:19.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.808+0000 7fa363fff700 1 -- 172.21.15.26:0/438125072 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36800f510 con 0x7fa36c093840 2023-10-01T07:52:19.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.808+0000 7fa363fff700 1 -- 172.21.15.26:0/438125072 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36800f670 con 0x7fa36c093840 2023-10-01T07:52:19.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.808+0000 7fa363fff700 1 -- 172.21.15.26:0/438125072 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36800f9f0 con 0x7fa36c093840 2023-10-01T07:52:19.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.809+0000 7fa37387a700 1 -- 172.21.15.26:0/438125072 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa36c093840 msgr2=0x7fa36c098790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:19.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.809+0000 7fa37387a700 1 --2- 172.21.15.26:0/438125072 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa36c093840 0x7fa36c098790 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fa368009790 tx=0x7fa368009060).stop 2023-10-01T07:52:19.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.809+0000 7fa37387a700 1 -- 172.21.15.26:0/438125072 shutdown_connections 2023-10-01T07:52:19.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.809+0000 7fa37387a700 1 --2- 172.21.15.26:0/438125072 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa36c093840 0x7fa36c098790 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:19.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.809+0000 7fa37387a700 1 --2- 172.21.15.26:0/438125072 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa36c098c80 0x7fa36c099060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:19.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.809+0000 7fa37387a700 1 -- 172.21.15.26:0/438125072 >> 172.21.15.26:0/438125072 conn(0x7fa36c097480 msgr2=0x7fa36c097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:19.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.809+0000 7fa37387a700 1 -- 172.21.15.26:0/438125072 shutdown_connections 2023-10-01T07:52:19.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.809+0000 7fa37387a700 1 -- 172.21.15.26:0/438125072 wait complete. 2023-10-01T07:52:19.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.810+0000 7fa37387a700 1 Processor -- start 2023-10-01T07:52:19.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.810+0000 7fa37387a700 1 -- start start 2023-10-01T07:52:19.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.811+0000 7fa37387a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa36c093840 0x7fa36c12afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:19.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.811+0000 7fa37387a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa36c098c80 0x7fa36c12b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:19.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.811+0000 7fa37387a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa36c12c150 0x7fa36c11a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:19.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.811+0000 7fa37387a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c06a520 con 0x7fa36c098c80 2023-10-01T07:52:19.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.811+0000 7fa37387a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c11eb40 con 0x7fa36c12c150 2023-10-01T07:52:19.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.811+0000 7fa37387a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c11dec0 con 0x7fa36c093840 2023-10-01T07:52:19.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.811+0000 7fa370e15700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa36c098c80 0x7fa36c12b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:19.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.811+0000 7fa371616700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa36c093840 0x7fa36c12afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:19.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.811+0000 7fa370e15700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa36c098c80 0x7fa36c12b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44326/0 (socket says 172.21.15.26:44326) 2023-10-01T07:52:19.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.811+0000 7fa370e15700 1 -- 172.21.15.26:0/1361996216 learned_addr learned my addr 172.21.15.26:0/1361996216 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:19.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.811+0000 7fa371e17700 1 --2- 172.21.15.26:0/1361996216 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa36c12c150 0x7fa36c11a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:19.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.811+0000 7fa371616700 1 -- 172.21.15.26:0/1361996216 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa36c12c150 msgr2=0x7fa36c11a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:19.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.811+0000 7fa371616700 1 --2- 172.21.15.26:0/1361996216 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa36c12c150 0x7fa36c11a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:19.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.811+0000 7fa371616700 1 -- 172.21.15.26:0/1361996216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa36c098c80 msgr2=0x7fa36c12b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:19.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.811+0000 7fa371616700 1 --2- 172.21.15.26:0/1361996216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa36c098c80 0x7fa36c12b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:19.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.811+0000 7fa371616700 1 -- 172.21.15.26:0/1361996216 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa35c0092a0 con 0x7fa36c093840 2023-10-01T07:52:19.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.811+0000 7fa370e15700 1 --2- 172.21.15.26:0/1361996216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa36c098c80 0x7fa36c12b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:19.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.811+0000 7fa371616700 1 --2- 172.21.15.26:0/1361996216 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa36c093840 0x7fa36c12afe0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fa368014000 tx=0x7fa368017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:19.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.812+0000 7fa3617fa700 1 -- 172.21.15.26:0/1361996216 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36800f7e0 con 0x7fa36c093840 2023-10-01T07:52:19.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.812+0000 7fa3617fa700 1 -- 172.21.15.26:0/1361996216 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36800f940 con 0x7fa36c093840 2023-10-01T07:52:19.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.812+0000 7fa37387a700 1 -- 172.21.15.26:0/1361996216 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3680092a0 con 0x7fa36c093840 2023-10-01T07:52:19.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.812+0000 7fa3617fa700 1 -- 172.21.15.26:0/1361996216 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36801b640 con 0x7fa36c093840 2023-10-01T07:52:19.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.812+0000 7fa37387a700 1 -- 172.21.15.26:0/1361996216 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa36c11e580 con 0x7fa36c093840 2023-10-01T07:52:19.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.812+0000 7fa3617fa700 1 -- 172.21.15.26:0/1361996216 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fa36801ba70 con 0x7fa36c093840 2023-10-01T07:52:19.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.813+0000 7fa3617fa700 1 -- 172.21.15.26:0/1361996216 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fa36803c860 con 0x7fa36c093840 2023-10-01T07:52:19.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.813+0000 7fa37387a700 1 -- 172.21.15.26:0/1361996216 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa36c11dd00 con 0x7fa36c093840 2023-10-01T07:52:19.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.817+0000 7fa3617fa700 1 -- 172.21.15.26:0/1361996216 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fa36801f080 con 0x7fa36c093840 2023-10-01T07:52:19.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.989+0000 7fa37387a700 1 -- 172.21.15.26:0/1361996216 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa36c05a260 con 0x7fa36c093840 2023-10-01T07:52:19.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.990+0000 7fa3617fa700 1 -- 172.21.15.26:0/1361996216 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa368029020 con 0x7fa36c093840 2023-10-01T07:52:19.990 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-01T07:52:19.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.991+0000 7fa37387a700 1 -- 172.21.15.26:0/1361996216 >> v1:172.21.15.26:6816/118178 conn(0x7fa35002bb60 legacy=0x7fa35002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:19.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.991+0000 7fa37387a700 1 -- 172.21.15.26:0/1361996216 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa36c093840 msgr2=0x7fa36c12afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:19.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.991+0000 7fa37387a700 1 --2- 172.21.15.26:0/1361996216 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa36c093840 0x7fa36c12afe0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fa368014000 tx=0x7fa368017000).stop 2023-10-01T07:52:19.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.991+0000 7fa37387a700 1 -- 172.21.15.26:0/1361996216 shutdown_connections 2023-10-01T07:52:19.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.991+0000 7fa37387a700 1 --2- 172.21.15.26:0/1361996216 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa36c12c150 0x7fa36c11a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:19.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.991+0000 7fa37387a700 1 --2- 172.21.15.26:0/1361996216 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa36c093840 0x7fa36c12afe0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:19.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.991+0000 7fa37387a700 1 --2- 172.21.15.26:0/1361996216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa36c098c80 0x7fa36c12b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:19.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.991+0000 7fa37387a700 1 -- 172.21.15.26:0/1361996216 >> 172.21.15.26:0/1361996216 conn(0x7fa36c097480 msgr2=0x7fa36c0688a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:19.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.992+0000 7fa37387a700 1 -- 172.21.15.26:0/1361996216 shutdown_connections 2023-10-01T07:52:19.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:19.992+0000 7fa37387a700 1 -- 172.21.15.26:0/1361996216 wait complete. 2023-10-01T07:52:20.005 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-01T07:52:20.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.137+0000 7f6f2ec85700 1 Processor -- start 2023-10-01T07:52:20.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.137+0000 7f6f2ec85700 1 -- start start 2023-10-01T07:52:20.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.138+0000 7f6f2ec85700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f280694d0 0x7f6f28096410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:20.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.138+0000 7f6f2ec85700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6f28096900 0x7f6f28096d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:20.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.138+0000 7f6f2ec85700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f28095e60 con 0x7f6f2812d230 2023-10-01T07:52:20.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.138+0000 7f6f2ec85700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f28068d40 con 0x7f6f28096900 2023-10-01T07:52:20.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.138+0000 7f6f2ec85700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f28068fb0 con 0x7f6f280694d0 2023-10-01T07:52:20.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.138+0000 7f6f2ca21700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f280694d0 0x7f6f28096410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:20.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.138+0000 7f6f27fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6f28096900 0x7f6f28096d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:20.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.138+0000 7f6f2ca21700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f280694d0 0x7f6f28096410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58508/0 (socket says 172.21.15.26:58508) 2023-10-01T07:52:20.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.138+0000 7f6f2ca21700 1 -- 172.21.15.26:0/1294523975 learned_addr learned my addr 172.21.15.26:0/1294523975 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:20.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.138+0000 7f6f2d222700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6f2812d230 0x7f6f2812f620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56592/0 (socket says 172.21.15.26:56592) 2023-10-01T07:52:20.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.138+0000 7f6f27fff700 1 -- 172.21.15.26:0/1294523975 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f280694d0 msgr2=0x7f6f28096410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:20.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.138+0000 7f6f27fff700 1 --2- 172.21.15.26:0/1294523975 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f280694d0 0x7f6f28096410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:20.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.138+0000 7f6f27fff700 1 -- 172.21.15.26:0/1294523975 >> v1:172.21.15.26:6789/0 conn(0x7f6f2812d230 legacy=0x7f6f2812f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:20.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.138+0000 7f6f277fe700 1 -- 172.21.15.26:0/1294523975 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2900418330 0 0) 0x7f6f28095e60 con 0x7f6f2812d230 2023-10-01T07:52:20.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.138+0000 7f6f27fff700 1 -- 172.21.15.26:0/1294523975 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f28068a10 con 0x7f6f28096900 2023-10-01T07:52:20.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.138+0000 7f6f2ca21700 1 --2- 172.21.15.26:0/1294523975 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f280694d0 0x7f6f28096410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:20.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.139+0000 7f6f27fff700 1 --2- 172.21.15.26:0/1294523975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f28096900 0x7f6f28096d00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f6f10009760 tx=0x7f6f10009060).ready entity=mon.0 client_cookie=5d82ef1a883513ad server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:20.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.139+0000 7f6f277fe700 1 -- 172.21.15.26:0/1294523975 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1000f510 con 0x7f6f28096900 2023-10-01T07:52:20.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.139+0000 7f6f277fe700 1 -- 172.21.15.26:0/1294523975 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1000f670 con 0x7f6f28096900 2023-10-01T07:52:20.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.139+0000 7f6f277fe700 1 -- 172.21.15.26:0/1294523975 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1000f9f0 con 0x7f6f28096900 2023-10-01T07:52:20.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.139+0000 7f6f2ec85700 1 -- 172.21.15.26:0/1294523975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f28096900 msgr2=0x7f6f28096d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:20.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.139+0000 7f6f2ec85700 1 --2- 172.21.15.26:0/1294523975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f28096900 0x7f6f28096d00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f6f10009760 tx=0x7f6f10009060).stop 2023-10-01T07:52:20.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.139+0000 7f6f2ec85700 1 -- 172.21.15.26:0/1294523975 shutdown_connections 2023-10-01T07:52:20.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.139+0000 7f6f2ec85700 1 --2- 172.21.15.26:0/1294523975 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f280694d0 0x7f6f28096410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:20.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.139+0000 7f6f2ec85700 1 --2- 172.21.15.26:0/1294523975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f28096900 0x7f6f28096d00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:20.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.139+0000 7f6f2ec85700 1 -- 172.21.15.26:0/1294523975 >> 172.21.15.26:0/1294523975 conn(0x7f6f2809ba60 msgr2=0x7f6f2809be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:20.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.139+0000 7f6f2ec85700 1 -- 172.21.15.26:0/1294523975 shutdown_connections 2023-10-01T07:52:20.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.139+0000 7f6f2ec85700 1 -- 172.21.15.26:0/1294523975 wait complete. 2023-10-01T07:52:20.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.140+0000 7f6f2ec85700 1 Processor -- start 2023-10-01T07:52:20.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.141+0000 7f6f2ec85700 1 -- start start 2023-10-01T07:52:20.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.141+0000 7f6f2ec85700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f280694d0 0x7f6f2811de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:20.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.141+0000 7f6f2ec85700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f28096900 0x7f6f28064540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:20.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.141+0000 7f6f2ec85700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f2812d230 0x7f6f28064a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:20.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.141+0000 7f6f2ec85700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2811cf50 con 0x7f6f280694d0 2023-10-01T07:52:20.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.141+0000 7f6f2ec85700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f28091c30 con 0x7f6f28096900 2023-10-01T07:52:20.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.141+0000 7f6f2ec85700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f28067d80 con 0x7f6f2812d230 2023-10-01T07:52:20.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.141+0000 7f6f2ca21700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f280694d0 0x7f6f2811de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:20.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.141+0000 7f6f27fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f28096900 0x7f6f28064540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:20.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.141+0000 7f6f2ca21700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f280694d0 0x7f6f2811de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44336/0 (socket says 172.21.15.26:44336) 2023-10-01T07:52:20.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.141+0000 7f6f2ca21700 1 -- 172.21.15.26:0/3619450995 learned_addr learned my addr 172.21.15.26:0/3619450995 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:20.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.141+0000 7f6f2d222700 1 --2- 172.21.15.26:0/3619450995 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f2812d230 0x7f6f28064a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:20.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.141+0000 7f6f2ca21700 1 -- 172.21.15.26:0/3619450995 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f2812d230 msgr2=0x7f6f28064a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:20.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.141+0000 7f6f2ca21700 1 --2- 172.21.15.26:0/3619450995 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f2812d230 0x7f6f28064a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:20.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.141+0000 7f6f2ca21700 1 -- 172.21.15.26:0/3619450995 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f28096900 msgr2=0x7f6f28064540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:20.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.141+0000 7f6f2ca21700 1 --2- 172.21.15.26:0/3619450995 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f28096900 0x7f6f28064540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:20.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.142+0000 7f6f2ca21700 1 -- 172.21.15.26:0/3619450995 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f18009370 con 0x7f6f280694d0 2023-10-01T07:52:20.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.142+0000 7f6f27fff700 1 --2- 172.21.15.26:0/3619450995 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f28096900 0x7f6f28064540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:20.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.142+0000 7f6f2ca21700 1 --2- 172.21.15.26:0/3619450995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f280694d0 0x7f6f2811de30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f6f1800ea20 tx=0x7f6f180090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:20.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.142+0000 7f6f24ff9700 1 -- 172.21.15.26:0/3619450995 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f18009650 con 0x7f6f280694d0 2023-10-01T07:52:20.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.142+0000 7f6f24ff9700 1 -- 172.21.15.26:0/3619450995 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1800ee60 con 0x7f6f280694d0 2023-10-01T07:52:20.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.142+0000 7f6f2ec85700 1 -- 172.21.15.26:0/3619450995 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f100092a0 con 0x7f6f280694d0 2023-10-01T07:52:20.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.142+0000 7f6f24ff9700 1 -- 172.21.15.26:0/3619450995 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1800ca60 con 0x7f6f280694d0 2023-10-01T07:52:20.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.142+0000 7f6f2ec85700 1 -- 172.21.15.26:0/3619450995 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f280660d0 con 0x7f6f280694d0 2023-10-01T07:52:20.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.143+0000 7f6f24ff9700 1 -- 172.21.15.26:0/3619450995 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f6f1801b400 con 0x7f6f280694d0 2023-10-01T07:52:20.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.143+0000 7f6f24ff9700 1 -- 172.21.15.26:0/3619450995 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f6f1803b4b0 con 0x7f6f280694d0 2023-10-01T07:52:20.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.143+0000 7f6f2ec85700 1 -- 172.21.15.26:0/3619450995 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f2805a260 con 0x7f6f280694d0 2023-10-01T07:52:20.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.148+0000 7f6f24ff9700 1 -- 172.21.15.26:0/3619450995 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f6f18016030 con 0x7f6f280694d0 2023-10-01T07:52:20.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.320+0000 7f6f2ec85700 1 -- 172.21.15.26:0/3619450995 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6f28046c20 con 0x7f6f280694d0 2023-10-01T07:52:20.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.320+0000 7f6f24ff9700 1 -- 172.21.15.26:0/3619450995 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6f18016030 con 0x7f6f280694d0 2023-10-01T07:52:20.321 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 8 2023-10-01T07:52:20.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.322+0000 7f6f2ec85700 1 -- 172.21.15.26:0/3619450995 >> v1:172.21.15.26:6816/118178 conn(0x7f6f0802bb60 legacy=0x7f6f0802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:20.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.322+0000 7f6f2ec85700 1 -- 172.21.15.26:0/3619450995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f280694d0 msgr2=0x7f6f2811de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:20.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.322+0000 7f6f2ec85700 1 --2- 172.21.15.26:0/3619450995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f280694d0 0x7f6f2811de30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f6f1800ea20 tx=0x7f6f180090f0).stop 2023-10-01T07:52:20.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.322+0000 7f6f2ec85700 1 -- 172.21.15.26:0/3619450995 shutdown_connections 2023-10-01T07:52:20.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.322+0000 7f6f2ec85700 1 --2- 172.21.15.26:0/3619450995 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f2812d230 0x7f6f28064a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:20.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.322+0000 7f6f2ec85700 1 --2- 172.21.15.26:0/3619450995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f280694d0 0x7f6f2811de30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:20.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.322+0000 7f6f2ec85700 1 --2- 172.21.15.26:0/3619450995 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f28096900 0x7f6f28064540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:20.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.322+0000 7f6f2ec85700 1 -- 172.21.15.26:0/3619450995 >> 172.21.15.26:0/3619450995 conn(0x7f6f2809ba60 msgr2=0x7f6f28094c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:20.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.323+0000 7f6f2ec85700 1 -- 172.21.15.26:0/3619450995 shutdown_connections 2023-10-01T07:52:20.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.323+0000 7f6f2ec85700 1 -- 172.21.15.26:0/3619450995 wait complete. 2023-10-01T07:52:20.336 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-01T07:52:20.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.468+0000 7f2da03e7700 1 Processor -- start 2023-10-01T07:52:20.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.468+0000 7f2da03e7700 1 -- start start 2023-10-01T07:52:20.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.469+0000 7f2da03e7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d98066110 0x7f2d98097420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:20.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.469+0000 7f2da03e7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d9812fd70 0x7f2d98132160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:20.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.469+0000 7f2da03e7700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d98064e00 con 0x7f2d9812add0 2023-10-01T07:52:20.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.469+0000 7f2da03e7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d980664f0 con 0x7f2d98066110 2023-10-01T07:52:20.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.469+0000 7f2da03e7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d98065d80 con 0x7f2d9812fd70 2023-10-01T07:52:20.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.469+0000 7f2d9e183700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d98066110 0x7f2d98097420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:20.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.469+0000 7f2d9d982700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2d9812add0 0x7f2d9812b2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56600/0 (socket says 172.21.15.26:56600) 2023-10-01T07:52:20.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.469+0000 7f2d9d982700 1 -- 172.21.15.26:0/2875582881 learned_addr learned my addr 172.21.15.26:0/2875582881 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:52:20.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.469+0000 7f2d9e984700 1 --2- 172.21.15.26:0/2875582881 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d9812fd70 0x7f2d98132160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:20.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.470+0000 7f2d9e183700 1 -- 172.21.15.26:0/2875582881 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d9812fd70 msgr2=0x7f2d98132160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:20.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.470+0000 7f2d9e183700 1 --2- 172.21.15.26:0/2875582881 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d9812fd70 0x7f2d98132160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:20.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.470+0000 7f2d9e183700 1 -- 172.21.15.26:0/2875582881 >> v1:172.21.15.26:6789/0 conn(0x7f2d9812add0 legacy=0x7f2d9812b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:20.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.470+0000 7f2d9d181700 1 -- 172.21.15.26:0/2875582881 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 557150028 0 0) 0x7f2d98064e00 con 0x7f2d9812add0 2023-10-01T07:52:20.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.470+0000 7f2d9e183700 1 -- 172.21.15.26:0/2875582881 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d98065910 con 0x7f2d98066110 2023-10-01T07:52:20.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.470+0000 7f2d9e984700 1 --2- 172.21.15.26:0/2875582881 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d9812fd70 0x7f2d98132160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:20.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.470+0000 7f2d9e183700 1 --2- 172.21.15.26:0/2875582881 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d98066110 0x7f2d98097420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f2d94009790 tx=0x7f2d94009060).ready entity=mon.1 client_cookie=a5c4e94bae500b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:20.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.470+0000 7f2d9d181700 1 -- 172.21.15.26:0/2875582881 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d940090d0 con 0x7f2d98066110 2023-10-01T07:52:20.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.470+0000 7f2d9d181700 1 -- 172.21.15.26:0/2875582881 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9400f510 con 0x7f2d98066110 2023-10-01T07:52:20.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.470+0000 7f2d9d181700 1 -- 172.21.15.26:0/2875582881 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9400f890 con 0x7f2d98066110 2023-10-01T07:52:20.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.470+0000 7f2da03e7700 1 -- 172.21.15.26:0/2875582881 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d98066110 msgr2=0x7f2d98097420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:20.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.470+0000 7f2da03e7700 1 --2- 172.21.15.26:0/2875582881 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d98066110 0x7f2d98097420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f2d94009790 tx=0x7f2d94009060).stop 2023-10-01T07:52:20.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.471+0000 7f2da03e7700 1 -- 172.21.15.26:0/2875582881 shutdown_connections 2023-10-01T07:52:20.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.471+0000 7f2da03e7700 1 --2- 172.21.15.26:0/2875582881 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d9812fd70 0x7f2d98132160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:20.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.471+0000 7f2da03e7700 1 --2- 172.21.15.26:0/2875582881 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d98066110 0x7f2d98097420 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:20.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.471+0000 7f2da03e7700 1 -- 172.21.15.26:0/2875582881 >> 172.21.15.26:0/2875582881 conn(0x7f2d9809ba60 msgr2=0x7f2d9809be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:20.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.471+0000 7f2da03e7700 1 -- 172.21.15.26:0/2875582881 shutdown_connections 2023-10-01T07:52:20.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.471+0000 7f2da03e7700 1 -- 172.21.15.26:0/2875582881 wait complete. 2023-10-01T07:52:20.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.471+0000 7f2da03e7700 1 Processor -- start 2023-10-01T07:52:20.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.472+0000 7f2da03e7700 1 -- start start 2023-10-01T07:52:20.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.472+0000 7f2da03e7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d98066110 0x7f2d9812bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:20.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.472+0000 7f2da03e7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d9812add0 0x7f2d9812c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:20.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.472+0000 7f2da03e7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d9812fd70 0x7f2d9812c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:20.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.472+0000 7f2da03e7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9812ca10 con 0x7f2d9812fd70 2023-10-01T07:52:20.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.472+0000 7f2da03e7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9812f260 con 0x7f2d9812add0 2023-10-01T07:52:20.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.472+0000 7f2da03e7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9812e990 con 0x7f2d98066110 2023-10-01T07:52:20.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.472+0000 7f2d9e183700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d98066110 0x7f2d9812bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:20.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.472+0000 7f2d9e183700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d98066110 0x7f2d9812bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55610/0 (socket says 172.21.15.26:55610) 2023-10-01T07:52:20.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.472+0000 7f2d9d982700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d9812add0 0x7f2d9812c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:20.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.472+0000 7f2d9e183700 1 -- 172.21.15.26:0/2591672904 learned_addr learned my addr 172.21.15.26:0/2591672904 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:20.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.472+0000 7f2d9e984700 1 --2- 172.21.15.26:0/2591672904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d9812fd70 0x7f2d9812c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:20.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.472+0000 7f2d9e183700 1 -- 172.21.15.26:0/2591672904 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d9812add0 msgr2=0x7f2d9812c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:20.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.472+0000 7f2d9e183700 1 --2- 172.21.15.26:0/2591672904 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d9812add0 0x7f2d9812c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:20.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.472+0000 7f2d9e183700 1 -- 172.21.15.26:0/2591672904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d9812fd70 msgr2=0x7f2d9812c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:20.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.473+0000 7f2d9e183700 1 --2- 172.21.15.26:0/2591672904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d9812fd70 0x7f2d9812c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:20.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.473+0000 7f2d9e183700 1 -- 172.21.15.26:0/2591672904 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d90009a20 con 0x7f2d98066110 2023-10-01T07:52:20.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.473+0000 7f2d9d982700 1 --2- 172.21.15.26:0/2591672904 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d9812add0 0x7f2d9812c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:20.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.473+0000 7f2d9e984700 1 --2- 172.21.15.26:0/2591672904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d9812fd70 0x7f2d9812c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:20.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.473+0000 7f2d9e183700 1 --2- 172.21.15.26:0/2591672904 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d98066110 0x7f2d9812bb40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f2d94009e30 tx=0x7f2d94017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:20.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.473+0000 7f2d8e7fc700 1 -- 172.21.15.26:0/2591672904 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9400f890 con 0x7f2d98066110 2023-10-01T07:52:20.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.473+0000 7f2d8e7fc700 1 -- 172.21.15.26:0/2591672904 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9400fc50 con 0x7f2d98066110 2023-10-01T07:52:20.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.473+0000 7f2da03e7700 1 -- 172.21.15.26:0/2591672904 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d940092a0 con 0x7f2d98066110 2023-10-01T07:52:20.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.473+0000 7f2d8e7fc700 1 -- 172.21.15.26:0/2591672904 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9401b410 con 0x7f2d98066110 2023-10-01T07:52:20.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.473+0000 7f2da03e7700 1 -- 172.21.15.26:0/2591672904 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d9812e5a0 con 0x7f2d98066110 2023-10-01T07:52:20.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.474+0000 7f2d8e7fc700 1 -- 172.21.15.26:0/2591672904 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f2d9401b7c0 con 0x7f2d98066110 2023-10-01T07:52:20.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.474+0000 7f2d8e7fc700 1 -- 172.21.15.26:0/2591672904 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f2d9403c8e0 con 0x7f2d98066110 2023-10-01T07:52:20.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.474+0000 7f2da03e7700 1 -- 172.21.15.26:0/2591672904 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d9805a260 con 0x7f2d98066110 2023-10-01T07:52:20.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.479+0000 7f2d8e7fc700 1 -- 172.21.15.26:0/2591672904 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f2d94023400 con 0x7f2d98066110 2023-10-01T07:52:20.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.652+0000 7f2da03e7700 1 -- 172.21.15.26:0/2591672904 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2d98046c20 con 0x7f2d98066110 2023-10-01T07:52:20.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.653+0000 7f2d8e7fc700 1 -- 172.21.15.26:0/2591672904 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v18) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2d940197f0 con 0x7f2d98066110 2023-10-01T07:52:20.653 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-01T07:52:20.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.655+0000 7f2da03e7700 1 -- 172.21.15.26:0/2591672904 >> v1:172.21.15.26:6816/118178 conn(0x7f2d7c02bb60 legacy=0x7f2d7c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:20.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.655+0000 7f2da03e7700 1 -- 172.21.15.26:0/2591672904 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d98066110 msgr2=0x7f2d9812bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:20.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.655+0000 7f2da03e7700 1 --2- 172.21.15.26:0/2591672904 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d98066110 0x7f2d9812bb40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f2d94009e30 tx=0x7f2d94017000).stop 2023-10-01T07:52:20.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.655+0000 7f2da03e7700 1 -- 172.21.15.26:0/2591672904 shutdown_connections 2023-10-01T07:52:20.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.655+0000 7f2da03e7700 1 --2- 172.21.15.26:0/2591672904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d9812fd70 0x7f2d9812c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:20.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.655+0000 7f2da03e7700 1 --2- 172.21.15.26:0/2591672904 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d98066110 0x7f2d9812bb40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:20.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.655+0000 7f2da03e7700 1 --2- 172.21.15.26:0/2591672904 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d9812add0 0x7f2d9812c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:20.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.655+0000 7f2da03e7700 1 -- 172.21.15.26:0/2591672904 >> 172.21.15.26:0/2591672904 conn(0x7f2d9809ba60 msgr2=0x7f2d98128810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:20.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.655+0000 7f2da03e7700 1 -- 172.21.15.26:0/2591672904 shutdown_connections 2023-10-01T07:52:20.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.655+0000 7f2da03e7700 1 -- 172.21.15.26:0/2591672904 wait complete. 2023-10-01T07:52:20.668 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-01T07:52:20.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.803+0000 7f4aa137a700 1 Processor -- start 2023-10-01T07:52:20.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.803+0000 7f4aa137a700 1 -- start start 2023-10-01T07:52:20.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.803+0000 7f4aa137a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4a9c0653a0 0x7f4a9c098640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:20.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.803+0000 7f4aa137a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4a9c130440 0x7f4a9c132830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:20.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.803+0000 7f4aa137a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a9c0663b0 con 0x7f4a9c098b30 2023-10-01T07:52:20.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.803+0000 7f4aa137a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a9c065e80 con 0x7f4a9c130440 2023-10-01T07:52:20.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.803+0000 7f4aa137a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9c065780 con 0x7f4a9c0653a0 2023-10-01T07:52:20.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.804+0000 7f4a9b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4a9c130440 0x7f4a9c132830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:20.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.804+0000 7f4a9affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4a9c0653a0 0x7f4a9c098640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:20.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.804+0000 7f4a927fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4a9c098b30 0x7f4a9c098f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56610/0 (socket says 172.21.15.26:56610) 2023-10-01T07:52:20.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.804+0000 7f4a927fc700 1 -- 172.21.15.26:0/1377951230 learned_addr learned my addr 172.21.15.26:0/1377951230 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:52:20.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.804+0000 7f4a9affd700 1 -- 172.21.15.26:0/1377951230 >> v2:172.21.15.26:3300/0 conn(0x7f4a9c130440 msgr2=0x7f4a9c132830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:20.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.804+0000 7f4a9affd700 1 --2- 172.21.15.26:0/1377951230 >> v2:172.21.15.26:3300/0 conn(0x7f4a9c130440 0x7f4a9c132830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:20.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.804+0000 7f4a9affd700 1 -- 172.21.15.26:0/1377951230 >> v1:172.21.15.26:6789/0 conn(0x7f4a9c098b30 legacy=0x7f4a9c098f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:20.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.804+0000 7f4a9affd700 1 -- 172.21.15.26:0/1377951230 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a9c096180 con 0x7f4a9c0653a0 2023-10-01T07:52:20.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.804+0000 7f4a9b7fe700 1 --2- 172.21.15.26:0/1377951230 >> v2:172.21.15.26:3300/0 conn(0x7f4a9c130440 0x7f4a9c132830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:20.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.804+0000 7f4a9affd700 1 --2- 172.21.15.26:0/1377951230 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4a9c0653a0 0x7f4a9c098640 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f4a8c009760 tx=0x7f4a8c009060).ready entity=mon.1 client_cookie=e4acac8ef63acb09 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:20.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.804+0000 7f4a9a7fc700 1 -- 172.21.15.26:0/1377951230 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c00f510 con 0x7f4a9c0653a0 2023-10-01T07:52:20.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.804+0000 7f4a9a7fc700 1 -- 172.21.15.26:0/1377951230 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a8c00f670 con 0x7f4a9c0653a0 2023-10-01T07:52:20.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.804+0000 7f4a9a7fc700 1 -- 172.21.15.26:0/1377951230 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c00f9f0 con 0x7f4a9c0653a0 2023-10-01T07:52:20.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.805+0000 7f4aa137a700 1 -- 172.21.15.26:0/1377951230 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4a9c0653a0 msgr2=0x7f4a9c098640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:20.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.805+0000 7f4aa137a700 1 --2- 172.21.15.26:0/1377951230 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4a9c0653a0 0x7f4a9c098640 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f4a8c009760 tx=0x7f4a8c009060).stop 2023-10-01T07:52:20.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.805+0000 7f4aa137a700 1 -- 172.21.15.26:0/1377951230 shutdown_connections 2023-10-01T07:52:20.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.805+0000 7f4aa137a700 1 --2- 172.21.15.26:0/1377951230 >> v2:172.21.15.26:3300/0 conn(0x7f4a9c130440 0x7f4a9c132830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:20.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.805+0000 7f4aa137a700 1 --2- 172.21.15.26:0/1377951230 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4a9c0653a0 0x7f4a9c098640 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:20.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.805+0000 7f4aa137a700 1 -- 172.21.15.26:0/1377951230 >> 172.21.15.26:0/1377951230 conn(0x7f4a9c09dc20 msgr2=0x7f4a9c09e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:20.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.805+0000 7f4aa137a700 1 -- 172.21.15.26:0/1377951230 shutdown_connections 2023-10-01T07:52:20.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.805+0000 7f4aa137a700 1 -- 172.21.15.26:0/1377951230 wait complete. 2023-10-01T07:52:20.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.806+0000 7f4aa137a700 1 Processor -- start 2023-10-01T07:52:20.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.806+0000 7f4aa137a700 1 -- start start 2023-10-01T07:52:20.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.807+0000 7f4aa137a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a9c0653a0 0x7f4a9c13a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:20.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.807+0000 7f4aa137a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4a9c098b30 0x7f4a9c13ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:20.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.807+0000 7f4aa137a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4a9c130440 0x7f4a9c13b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:20.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.807+0000 7f4aa137a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9c09ca60 con 0x7f4a9c0653a0 2023-10-01T07:52:20.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.807+0000 7f4aa137a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9c099a90 con 0x7f4a9c098b30 2023-10-01T07:52:20.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.807+0000 7f4aa137a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9c11b860 con 0x7f4a9c130440 2023-10-01T07:52:20.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.807+0000 7f4a9affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a9c0653a0 0x7f4a9c13a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:20.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.807+0000 7f4a9affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a9c0653a0 0x7f4a9c13a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44364/0 (socket says 172.21.15.26:44364) 2023-10-01T07:52:20.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.807+0000 7f4a9affd700 1 -- 172.21.15.26:0/1368074367 learned_addr learned my addr 172.21.15.26:0/1368074367 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:20.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.807+0000 7f4a9b7fe700 1 --2- 172.21.15.26:0/1368074367 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4a9c130440 0x7f4a9c13b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:20.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.807+0000 7f4a927fc700 1 --2- 172.21.15.26:0/1368074367 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4a9c098b30 0x7f4a9c13ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:20.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.807+0000 7f4a9affd700 1 -- 172.21.15.26:0/1368074367 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4a9c130440 msgr2=0x7f4a9c13b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:20.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.807+0000 7f4a9affd700 1 --2- 172.21.15.26:0/1368074367 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4a9c130440 0x7f4a9c13b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:20.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.807+0000 7f4a9affd700 1 -- 172.21.15.26:0/1368074367 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4a9c098b30 msgr2=0x7f4a9c13ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:20.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.807+0000 7f4a9affd700 1 --2- 172.21.15.26:0/1368074367 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4a9c098b30 0x7f4a9c13ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:20.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.807+0000 7f4a9affd700 1 -- 172.21.15.26:0/1368074367 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a94009a20 con 0x7f4a9c0653a0 2023-10-01T07:52:20.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.807+0000 7f4a9affd700 1 --2- 172.21.15.26:0/1368074367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a9c0653a0 0x7f4a9c13a930 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f4a8c011e50 tx=0x7f4a8c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:20.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.807+0000 7f4a937fe700 1 -- 172.21.15.26:0/1368074367 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c00f7e0 con 0x7f4a9c0653a0 2023-10-01T07:52:20.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.807+0000 7f4a937fe700 1 -- 172.21.15.26:0/1368074367 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a8c00f940 con 0x7f4a9c0653a0 2023-10-01T07:52:20.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.807+0000 7f4a937fe700 1 -- 172.21.15.26:0/1368074367 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c01b660 con 0x7f4a9c0653a0 2023-10-01T07:52:20.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.807+0000 7f4aa137a700 1 -- 172.21.15.26:0/1368074367 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a8c0092a0 con 0x7f4a9c0653a0 2023-10-01T07:52:20.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.808+0000 7f4aa137a700 1 -- 172.21.15.26:0/1368074367 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a9c11d980 con 0x7f4a9c0653a0 2023-10-01T07:52:20.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.808+0000 7f4a937fe700 1 -- 172.21.15.26:0/1368074367 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f4a8c01ba10 con 0x7f4a9c0653a0 2023-10-01T07:52:20.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.808+0000 7f4a937fe700 1 -- 172.21.15.26:0/1368074367 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f4a8c03cb20 con 0x7f4a9c0653a0 2023-10-01T07:52:20.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.809+0000 7f4a90ff9700 1 -- 172.21.15.26:0/1368074367 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a74005120 con 0x7f4a9c0653a0 2023-10-01T07:52:20.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.813+0000 7f4a937fe700 1 -- 172.21.15.26:0/1368074367 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f4a8c028030 con 0x7f4a9c0653a0 2023-10-01T07:52:20.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.988+0000 7f4a90ff9700 1 -- 172.21.15.26:0/1368074367 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4a74005d70 con 0x7f4a9c0653a0 2023-10-01T07:52:20.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.989+0000 7f4a937fe700 1 -- 172.21.15.26:0/1368074367 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v18) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4a8c010b90 con 0x7f4a9c0653a0 2023-10-01T07:52:20.990 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-01T07:52:20.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.991+0000 7f4a90ff9700 1 -- 172.21.15.26:0/1368074367 >> v1:172.21.15.26:6816/118178 conn(0x7f4a7c02bb90 legacy=0x7f4a7c02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:20.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.991+0000 7f4a90ff9700 1 -- 172.21.15.26:0/1368074367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a9c0653a0 msgr2=0x7f4a9c13a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:20.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.991+0000 7f4a90ff9700 1 --2- 172.21.15.26:0/1368074367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a9c0653a0 0x7f4a9c13a930 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f4a8c011e50 tx=0x7f4a8c017000).stop 2023-10-01T07:52:20.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.991+0000 7f4a90ff9700 1 -- 172.21.15.26:0/1368074367 shutdown_connections 2023-10-01T07:52:20.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.991+0000 7f4a90ff9700 1 --2- 172.21.15.26:0/1368074367 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4a9c130440 0x7f4a9c13b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:20.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.991+0000 7f4a90ff9700 1 --2- 172.21.15.26:0/1368074367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a9c0653a0 0x7f4a9c13a930 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:20.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.991+0000 7f4a90ff9700 1 --2- 172.21.15.26:0/1368074367 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4a9c098b30 0x7f4a9c13ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:20.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.991+0000 7f4a90ff9700 1 -- 172.21.15.26:0/1368074367 >> 172.21.15.26:0/1368074367 conn(0x7f4a9c09dc20 msgr2=0x7f4a9c09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:20.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.991+0000 7f4a90ff9700 1 -- 172.21.15.26:0/1368074367 shutdown_connections 2023-10-01T07:52:20.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:20.991+0000 7f4a90ff9700 1 -- 172.21.15.26:0/1368074367 wait complete. 2023-10-01T07:52:21.004 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-01T07:52:21.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.134+0000 7fab9f8a7700 1 Processor -- start 2023-10-01T07:52:21.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.135+0000 7fab9f8a7700 1 -- start start 2023-10-01T07:52:21.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.135+0000 7fab9f8a7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab98098d50 0x7fab98130480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:21.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.135+0000 7fab9f8a7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fab98099190 0x7fab98132980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:21.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.135+0000 7fab9f8a7700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab98065ed0 con 0x7fab980654a0 2023-10-01T07:52:21.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.135+0000 7fab9f8a7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab98095880 con 0x7fab98099190 2023-10-01T07:52:21.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.135+0000 7fab9f8a7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab98096120 con 0x7fab98098d50 2023-10-01T07:52:21.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.135+0000 7fab9ce42700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab98098d50 0x7fab98130480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:21.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.135+0000 7fab9de44700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fab98099190 0x7fab98132980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:21.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.135+0000 7fab9d643700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fab980654a0 0x7fab98098640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56618/0 (socket says 172.21.15.26:56618) 2023-10-01T07:52:21.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.135+0000 7fab9d643700 1 -- 172.21.15.26:0/700349179 learned_addr learned my addr 172.21.15.26:0/700349179 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:52:21.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.136+0000 7fab9de44700 1 -- 172.21.15.26:0/700349179 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab98098d50 msgr2=0x7fab98130480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:21.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.136+0000 7fab9de44700 1 --2- 172.21.15.26:0/700349179 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab98098d50 0x7fab98130480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:21.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.136+0000 7fab9de44700 1 -- 172.21.15.26:0/700349179 >> v1:172.21.15.26:6789/0 conn(0x7fab980654a0 legacy=0x7fab98098640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:21.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.136+0000 7fab8bfff700 1 -- 172.21.15.26:0/700349179 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2821114849 0 0) 0x7fab98065ed0 con 0x7fab980654a0 2023-10-01T07:52:21.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.136+0000 7fab9de44700 1 -- 172.21.15.26:0/700349179 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab98066280 con 0x7fab98099190 2023-10-01T07:52:21.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.136+0000 7fab9de44700 1 --2- 172.21.15.26:0/700349179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab98099190 0x7fab98132980 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fab90009e60 tx=0x7fab90009780).ready entity=mon.0 client_cookie=e6a18f0dd6eb011b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:21.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.136+0000 7fab8bfff700 1 -- 172.21.15.26:0/700349179 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9000e070 con 0x7fab98099190 2023-10-01T07:52:21.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.136+0000 7fab8bfff700 1 -- 172.21.15.26:0/700349179 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9000bb60 con 0x7fab98099190 2023-10-01T07:52:21.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.136+0000 7fab8bfff700 1 -- 172.21.15.26:0/700349179 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab90012410 con 0x7fab98099190 2023-10-01T07:52:21.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.136+0000 7fab9f8a7700 1 -- 172.21.15.26:0/700349179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab98099190 msgr2=0x7fab98132980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:21.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.136+0000 7fab9f8a7700 1 --2- 172.21.15.26:0/700349179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab98099190 0x7fab98132980 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fab90009e60 tx=0x7fab90009780).stop 2023-10-01T07:52:21.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.137+0000 7fab9f8a7700 1 -- 172.21.15.26:0/700349179 shutdown_connections 2023-10-01T07:52:21.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.137+0000 7fab9f8a7700 1 --2- 172.21.15.26:0/700349179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab98099190 0x7fab98132980 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:21.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.137+0000 7fab9f8a7700 1 --2- 172.21.15.26:0/700349179 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab98098d50 0x7fab98130480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:21.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.137+0000 7fab9f8a7700 1 -- 172.21.15.26:0/700349179 >> 172.21.15.26:0/700349179 conn(0x7fab9809a740 msgr2=0x7fab9809ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:21.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.137+0000 7fab9f8a7700 1 -- 172.21.15.26:0/700349179 shutdown_connections 2023-10-01T07:52:21.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.137+0000 7fab9f8a7700 1 -- 172.21.15.26:0/700349179 wait complete. 2023-10-01T07:52:21.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.137+0000 7fab9f8a7700 1 Processor -- start 2023-10-01T07:52:21.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.138+0000 7fab9f8a7700 1 -- start start 2023-10-01T07:52:21.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.138+0000 7fab9f8a7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab980654a0 0x7fab9813a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:21.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.138+0000 7fab9f8a7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab98098d50 0x7fab9813a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:21.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.138+0000 7fab9f8a7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab98099190 0x7fab9813ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:21.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.138+0000 7fab9f8a7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9811e1f0 con 0x7fab980654a0 2023-10-01T07:52:21.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.138+0000 7fab9f8a7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab98099b00 con 0x7fab98099190 2023-10-01T07:52:21.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.138+0000 7fab9f8a7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab9809c7a0 con 0x7fab98098d50 2023-10-01T07:52:21.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.138+0000 7fab9de44700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab98099190 0x7fab9813ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:21.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.138+0000 7fab9d643700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab980654a0 0x7fab9813a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:21.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.138+0000 7fab9de44700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab98099190 0x7fab9813ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58570/0 (socket says 172.21.15.26:58570) 2023-10-01T07:52:21.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.138+0000 7fab9de44700 1 -- 172.21.15.26:0/1103141024 learned_addr learned my addr 172.21.15.26:0/1103141024 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:21.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.138+0000 7fab9ce42700 1 --2- 172.21.15.26:0/1103141024 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab98098d50 0x7fab9813a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:21.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.139+0000 7fab9de44700 1 -- 172.21.15.26:0/1103141024 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab98098d50 msgr2=0x7fab9813a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:21.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.139+0000 7fab9de44700 1 --2- 172.21.15.26:0/1103141024 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab98098d50 0x7fab9813a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:21.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.139+0000 7fab9de44700 1 -- 172.21.15.26:0/1103141024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab980654a0 msgr2=0x7fab9813a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:21.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.139+0000 7fab9de44700 1 --2- 172.21.15.26:0/1103141024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab980654a0 0x7fab9813a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:21.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.139+0000 7fab9de44700 1 -- 172.21.15.26:0/1103141024 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab90009a20 con 0x7fab98099190 2023-10-01T07:52:21.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.139+0000 7fab9d643700 1 --2- 172.21.15.26:0/1103141024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab980654a0 0x7fab9813a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:21.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.139+0000 7fab9de44700 1 --2- 172.21.15.26:0/1103141024 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab98099190 0x7fab9813ae60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fab9000b6c0 tx=0x7fab98095c30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:21.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.139+0000 7fab897fa700 1 -- 172.21.15.26:0/1103141024 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9001d630 con 0x7fab98099190 2023-10-01T07:52:21.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.139+0000 7fab897fa700 1 -- 172.21.15.26:0/1103141024 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9001d790 con 0x7fab98099190 2023-10-01T07:52:21.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.139+0000 7fab9f8a7700 1 -- 172.21.15.26:0/1103141024 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab9811cc80 con 0x7fab98099190 2023-10-01T07:52:21.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.139+0000 7fab897fa700 1 -- 172.21.15.26:0/1103141024 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9001db50 con 0x7fab98099190 2023-10-01T07:52:21.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.139+0000 7fab9f8a7700 1 -- 172.21.15.26:0/1103141024 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab9811c290 con 0x7fab98099190 2023-10-01T07:52:21.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.140+0000 7fab897fa700 1 -- 172.21.15.26:0/1103141024 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fab90003040 con 0x7fab98099190 2023-10-01T07:52:21.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.140+0000 7fab897fa700 1 -- 172.21.15.26:0/1103141024 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fab9003cdd0 con 0x7fab98099190 2023-10-01T07:52:21.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.140+0000 7fab9f8a7700 1 -- 172.21.15.26:0/1103141024 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab9809c530 con 0x7fab98099190 2023-10-01T07:52:21.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.145+0000 7fab897fa700 1 -- 172.21.15.26:0/1103141024 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fab9001b310 con 0x7fab98099190 2023-10-01T07:52:21.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.367+0000 7fab9f8a7700 1 -- 172.21.15.26:0/1103141024 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab9811de00 con 0x7fab98099190 2023-10-01T07:52:21.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.368+0000 7fab897fa700 1 -- 172.21.15.26:0/1103141024 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2156 (secure 0 0 0) 0x7fab90026bb0 con 0x7fab98099190 2023-10-01T07:52:21.368 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:52:21.369 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-01T07:51:57.295264+0000","modified":"2023-10-01T07:52:00.301728+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4189},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4189":{"gid":4189,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6817/2857714939","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6817","nonce":2857714939}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-01T07:52:21.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.370+0000 7fab9f8a7700 1 -- 172.21.15.26:0/1103141024 >> v1:172.21.15.26:6816/118178 conn(0x7fab7c02bb60 legacy=0x7fab7c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:21.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.370+0000 7fab9f8a7700 1 -- 172.21.15.26:0/1103141024 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab98099190 msgr2=0x7fab9813ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:21.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.370+0000 7fab9f8a7700 1 --2- 172.21.15.26:0/1103141024 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab98099190 0x7fab9813ae60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fab9000b6c0 tx=0x7fab98095c30).stop 2023-10-01T07:52:21.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.370+0000 7fab9f8a7700 1 -- 172.21.15.26:0/1103141024 shutdown_connections 2023-10-01T07:52:21.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.370+0000 7fab9f8a7700 1 --2- 172.21.15.26:0/1103141024 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab98099190 0x7fab9813ae60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:21.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.370+0000 7fab9f8a7700 1 --2- 172.21.15.26:0/1103141024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab980654a0 0x7fab9813a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:21.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.370+0000 7fab9f8a7700 1 --2- 172.21.15.26:0/1103141024 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab98098d50 0x7fab9813a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:21.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.370+0000 7fab9f8a7700 1 -- 172.21.15.26:0/1103141024 >> 172.21.15.26:0/1103141024 conn(0x7fab9809a740 msgr2=0x7fab9809dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:21.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.370+0000 7fab9f8a7700 1 -- 172.21.15.26:0/1103141024 shutdown_connections 2023-10-01T07:52:21.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.370+0000 7fab9f8a7700 1 -- 172.21.15.26:0/1103141024 wait complete. 2023-10-01T07:52:21.372 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 6 2023-10-01T07:52:21.384 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-01T07:52:21.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.513+0000 7fae21b21700 1 Processor -- start 2023-10-01T07:52:21.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.513+0000 7fae21b21700 1 -- start start 2023-10-01T07:52:21.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.513+0000 7fae21b21700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fae1c096380 0x7fae1c094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:21.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.513+0000 7fae21b21700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae1c091b00 0x7fae1c127600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:21.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.513+0000 7fae21b21700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae1c096760 con 0x7fae1c094c20 2023-10-01T07:52:21.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.513+0000 7fae21b21700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae1c091ff0 con 0x7fae1c096380 2023-10-01T07:52:21.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.513+0000 7fae21b21700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c092c80 con 0x7fae1c091b00 2023-10-01T07:52:21.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.514+0000 7fae1affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae1c091b00 0x7fae1c127600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:21.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.514+0000 7fae1b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fae1c096380 0x7fae1c094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:21.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.514+0000 7fae1bfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fae1c094c20 0x7fae1c127af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56622/0 (socket says 172.21.15.26:56622) 2023-10-01T07:52:21.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.514+0000 7fae1bfff700 1 -- 172.21.15.26:0/3438737953 learned_addr learned my addr 172.21.15.26:0/3438737953 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:52:21.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.514+0000 7fae1b7fe700 1 -- 172.21.15.26:0/3438737953 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae1c091b00 msgr2=0x7fae1c127600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:21.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.514+0000 7fae1b7fe700 1 --2- 172.21.15.26:0/3438737953 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae1c091b00 0x7fae1c127600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:21.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.514+0000 7fae1b7fe700 1 -- 172.21.15.26:0/3438737953 >> v1:172.21.15.26:6789/0 conn(0x7fae1c094c20 legacy=0x7fae1c127af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:21.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.514+0000 7fae1a7fc700 1 -- 172.21.15.26:0/3438737953 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4024363704 0 0) 0x7fae1c096760 con 0x7fae1c094c20 2023-10-01T07:52:21.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.514+0000 7fae1b7fe700 1 -- 172.21.15.26:0/3438737953 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae1c093900 con 0x7fae1c096380 2023-10-01T07:52:21.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.514+0000 7fae1affd700 1 --2- 172.21.15.26:0/3438737953 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae1c091b00 0x7fae1c127600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:21.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.514+0000 7fae1b7fe700 1 --2- 172.21.15.26:0/3438737953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae1c096380 0x7fae1c094730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fae0c009790 tx=0x7fae0c009060).ready entity=mon.0 client_cookie=5fe4912dae5dea5 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:21.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.514+0000 7fae1a7fc700 1 -- 172.21.15.26:0/3438737953 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c00f510 con 0x7fae1c096380 2023-10-01T07:52:21.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.514+0000 7fae1a7fc700 1 -- 172.21.15.26:0/3438737953 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0c00f670 con 0x7fae1c096380 2023-10-01T07:52:21.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.514+0000 7fae1a7fc700 1 -- 172.21.15.26:0/3438737953 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c00f9f0 con 0x7fae1c096380 2023-10-01T07:52:21.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.515+0000 7fae21b21700 1 -- 172.21.15.26:0/3438737953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae1c096380 msgr2=0x7fae1c094730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:21.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.515+0000 7fae21b21700 1 --2- 172.21.15.26:0/3438737953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae1c096380 0x7fae1c094730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fae0c009790 tx=0x7fae0c009060).stop 2023-10-01T07:52:21.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.515+0000 7fae21b21700 1 -- 172.21.15.26:0/3438737953 shutdown_connections 2023-10-01T07:52:21.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.515+0000 7fae21b21700 1 --2- 172.21.15.26:0/3438737953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae1c096380 0x7fae1c094730 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:21.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.515+0000 7fae21b21700 1 --2- 172.21.15.26:0/3438737953 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae1c091b00 0x7fae1c127600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:21.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.515+0000 7fae21b21700 1 -- 172.21.15.26:0/3438737953 >> 172.21.15.26:0/3438737953 conn(0x7fae1c097470 msgr2=0x7fae1c097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:21.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.515+0000 7fae21b21700 1 -- 172.21.15.26:0/3438737953 shutdown_connections 2023-10-01T07:52:21.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.515+0000 7fae21b21700 1 -- 172.21.15.26:0/3438737953 wait complete. 2023-10-01T07:52:21.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.516+0000 7fae21b21700 1 Processor -- start 2023-10-01T07:52:21.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.516+0000 7fae21b21700 1 -- start start 2023-10-01T07:52:21.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.516+0000 7fae21b21700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae1c091b00 0x7fae1c12ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:21.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.516+0000 7fae21b21700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae1c094c20 0x7fae1c12f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:21.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.516+0000 7fae21b21700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae1c096380 0x7fae1c12a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:21.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.516+0000 7fae21b21700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c12e830 con 0x7fae1c096380 2023-10-01T07:52:21.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.516+0000 7fae21b21700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c12bd40 con 0x7fae1c094c20 2023-10-01T07:52:21.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.516+0000 7fae21b21700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c098f00 con 0x7fae1c091b00 2023-10-01T07:52:21.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.517+0000 7fae1b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae1c091b00 0x7fae1c12ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:21.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.517+0000 7fae1bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae1c096380 0x7fae1c12a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:21.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.517+0000 7fae1affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae1c094c20 0x7fae1c12f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:21.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.517+0000 7fae1b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae1c091b00 0x7fae1c12ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55642/0 (socket says 172.21.15.26:55642) 2023-10-01T07:52:21.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.517+0000 7fae1b7fe700 1 -- 172.21.15.26:0/1404536044 learned_addr learned my addr 172.21.15.26:0/1404536044 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:21.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.517+0000 7fae1affd700 1 -- 172.21.15.26:0/1404536044 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae1c091b00 msgr2=0x7fae1c12ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:21.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.517+0000 7fae1affd700 1 --2- 172.21.15.26:0/1404536044 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae1c091b00 0x7fae1c12ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:21.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.517+0000 7fae1affd700 1 -- 172.21.15.26:0/1404536044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae1c096380 msgr2=0x7fae1c12a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:21.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.517+0000 7fae1affd700 1 --2- 172.21.15.26:0/1404536044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae1c096380 0x7fae1c12a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:21.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.517+0000 7fae1affd700 1 -- 172.21.15.26:0/1404536044 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae100092a0 con 0x7fae1c094c20 2023-10-01T07:52:21.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.517+0000 7fae1bfff700 1 --2- 172.21.15.26:0/1404536044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae1c096380 0x7fae1c12a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:21.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.517+0000 7fae1affd700 1 --2- 172.21.15.26:0/1404536044 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae1c094c20 0x7fae1c12f310 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fae1000e980 tx=0x7fae10009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:21.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.517+0000 7fae037fe700 1 -- 172.21.15.26:0/1404536044 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae10009580 con 0x7fae1c094c20 2023-10-01T07:52:21.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.517+0000 7fae037fe700 1 -- 172.21.15.26:0/1404536044 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae10012600 con 0x7fae1c094c20 2023-10-01T07:52:21.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.517+0000 7fae21b21700 1 -- 172.21.15.26:0/1404536044 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae0c0092a0 con 0x7fae1c094c20 2023-10-01T07:52:21.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.517+0000 7fae037fe700 1 -- 172.21.15.26:0/1404536044 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae10012980 con 0x7fae1c094c20 2023-10-01T07:52:21.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.517+0000 7fae21b21700 1 -- 172.21.15.26:0/1404536044 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae1c12dc50 con 0x7fae1c094c20 2023-10-01T07:52:21.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.518+0000 7fae037fe700 1 -- 172.21.15.26:0/1404536044 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fae10012d30 con 0x7fae1c094c20 2023-10-01T07:52:21.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.518+0000 7fae037fe700 1 -- 172.21.15.26:0/1404536044 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fae1003b3b0 con 0x7fae1c094c20 2023-10-01T07:52:21.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.518+0000 7fae21b21700 1 -- 172.21.15.26:0/1404536044 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae1c05a260 con 0x7fae1c094c20 2023-10-01T07:52:21.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.523+0000 7fae037fe700 1 -- 172.21.15.26:0/1404536044 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fae10016020 con 0x7fae1c094c20 2023-10-01T07:52:21.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.697+0000 7fae21b21700 1 -- 172.21.15.26:0/1404536044 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae1c06a750 con 0x7fae1c094c20 2023-10-01T07:52:21.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.698+0000 7fae037fe700 1 -- 172.21.15.26:0/1404536044 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+11340 (secure 0 0 0) 0x7fae1002a090 con 0x7fae1c094c20 2023-10-01T07:52:21.698 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:52:21.698 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":18,"fsid":"c29fb19d-520c-42a6-90f4-e7f86de96e8e","created":"2023-10-01T07:51:40.702414+0000","modified":"2023-10-01T07:52:16.703654+0000","last_up_change":"2023-10-01T07:51:48.849482+0000","last_in_change":"2023-10-01T07:51:42.084736+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-01T07:51:48.906889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-01T07:51:50.071599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-01T07:51:54.981575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-01T07:51:56.286318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46569ce3-81d1-44a1-a649-691de3e6f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6800","nonce":118773}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6801","nonce":118773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6803","nonce":118773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6802","nonce":118773}]},"public_addr":"172.21.15.26:6800/118773","cluster_addr":"172.21.15.26:6801/118773","heartbeat_back_addr":"172.21.15.26:6803/118773","heartbeat_front_addr":"172.21.15.26:6802/118773","state":["exists","up"]},{"osd":1,"uuid":"1fc1ba9b-4110-4d31-96d6-794937578cff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6804","nonce":118782}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6806","nonce":118782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6810","nonce":118782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6808","nonce":118782}]},"public_addr":"172.21.15.26:6804/118782","cluster_addr":"172.21.15.26:6806/118782","heartbeat_back_addr":"172.21.15.26:6810/118782","heartbeat_front_addr":"172.21.15.26:6808/118782","state":["exists","up"]},{"osd":2,"uuid":"37de933d-3b8e-4b94-87bd-2f36896c7ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6805","nonce":118789}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6807","nonce":118789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6811","nonce":118789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6809","nonce":118789}]},"public_addr":"172.21.15.26:6805/118789","cluster_addr":"172.21.15.26:6807/118789","heartbeat_back_addr":"172.21.15.26:6811/118789","heartbeat_front_addr":"172.21.15.26:6809/118789","state":["exists","up"]},{"osd":3,"uuid":"bd020309-5fd2-4d97-b36a-67e159fa3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6812","nonce":118790}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6813","nonce":118790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6815","nonce":118790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6814","nonce":118790}]},"public_addr":"172.21.15.26:6812/118790","cluster_addr":"172.21.15.26:6813/118790","heartbeat_back_addr":"172.21.15.26:6815/118790","heartbeat_front_addr":"172.21.15.26:6814/118790","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.029993+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.266503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.273540+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.229731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-01T07:52:21.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.700+0000 7fae21b21700 1 -- 172.21.15.26:0/1404536044 >> v1:172.21.15.26:6816/118178 conn(0x7fae0802bb60 legacy=0x7fae0802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:21.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.700+0000 7fae21b21700 1 -- 172.21.15.26:0/1404536044 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae1c094c20 msgr2=0x7fae1c12f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:21.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.700+0000 7fae21b21700 1 --2- 172.21.15.26:0/1404536044 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae1c094c20 0x7fae1c12f310 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fae1000e980 tx=0x7fae10009060).stop 2023-10-01T07:52:21.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.700+0000 7fae21b21700 1 -- 172.21.15.26:0/1404536044 shutdown_connections 2023-10-01T07:52:21.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.700+0000 7fae21b21700 1 --2- 172.21.15.26:0/1404536044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae1c096380 0x7fae1c12a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:21.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.700+0000 7fae21b21700 1 --2- 172.21.15.26:0/1404536044 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae1c091b00 0x7fae1c12ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:21.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.700+0000 7fae21b21700 1 --2- 172.21.15.26:0/1404536044 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae1c094c20 0x7fae1c12f310 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:21.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.700+0000 7fae21b21700 1 -- 172.21.15.26:0/1404536044 >> 172.21.15.26:0/1404536044 conn(0x7fae1c097470 msgr2=0x7fae1c126a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:21.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.700+0000 7fae21b21700 1 -- 172.21.15.26:0/1404536044 shutdown_connections 2023-10-01T07:52:21.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.700+0000 7fae21b21700 1 -- 172.21.15.26:0/1404536044 wait complete. 2023-10-01T07:52:21.714 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-01T07:52:21.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.847+0000 7fc4f1a15700 1 Processor -- start 2023-10-01T07:52:21.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.847+0000 7fc4f1a15700 1 -- start start 2023-10-01T07:52:21.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.847+0000 7fc4f1a15700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4ec098d50 0x7fc4ec099130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:21.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.847+0000 7fc4f1a15700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc4ec130440 0x7fc4ec132830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:21.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.847+0000 7fc4f1a15700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4ec0663b0 con 0x7fc4ec0653a0 2023-10-01T07:52:21.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.847+0000 7fc4f1a15700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4ec065e80 con 0x7fc4ec130440 2023-10-01T07:52:21.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.848+0000 7fc4f1a15700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec065780 con 0x7fc4ec098d50 2023-10-01T07:52:21.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.848+0000 7fc4eb7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc4ec130440 0x7fc4ec132830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:21.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.848+0000 7fc4ea7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4ec098d50 0x7fc4ec099130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:21.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.848+0000 7fc4eaffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc4ec0653a0 0x7fc4ec098640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56624/0 (socket says 172.21.15.26:56624) 2023-10-01T07:52:21.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.848+0000 7fc4eaffd700 1 -- 172.21.15.26:0/496266140 learned_addr learned my addr 172.21.15.26:0/496266140 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:52:21.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.848+0000 7fc4ea7fc700 1 -- 172.21.15.26:0/496266140 >> v2:172.21.15.26:3300/0 conn(0x7fc4ec130440 msgr2=0x7fc4ec132830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:21.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.848+0000 7fc4ea7fc700 1 --2- 172.21.15.26:0/496266140 >> v2:172.21.15.26:3300/0 conn(0x7fc4ec130440 0x7fc4ec132830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:21.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.848+0000 7fc4ea7fc700 1 -- 172.21.15.26:0/496266140 >> v1:172.21.15.26:6789/0 conn(0x7fc4ec0653a0 legacy=0x7fc4ec098640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:21.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.848+0000 7fc4ea7fc700 1 -- 172.21.15.26:0/496266140 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ec096180 con 0x7fc4ec098d50 2023-10-01T07:52:21.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.848+0000 7fc4e9ffb700 1 -- 172.21.15.26:0/496266140 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3983915651 0 0) 0x7fc4ec0663b0 con 0x7fc4ec0653a0 2023-10-01T07:52:21.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.848+0000 7fc4eb7fe700 1 --2- 172.21.15.26:0/496266140 >> v2:172.21.15.26:3300/0 conn(0x7fc4ec130440 0x7fc4ec132830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:21.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.848+0000 7fc4ea7fc700 1 --2- 172.21.15.26:0/496266140 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4ec098d50 0x7fc4ec099130 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fc4d4009760 tx=0x7fc4d4009060).ready entity=mon.1 client_cookie=7c358f91cff4fddb server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:21.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.848+0000 7fc4e9ffb700 1 -- 172.21.15.26:0/496266140 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d400f510 con 0x7fc4ec098d50 2023-10-01T07:52:21.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.848+0000 7fc4e9ffb700 1 -- 172.21.15.26:0/496266140 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d400f670 con 0x7fc4ec098d50 2023-10-01T07:52:21.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.848+0000 7fc4e9ffb700 1 -- 172.21.15.26:0/496266140 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d400f9f0 con 0x7fc4ec098d50 2023-10-01T07:52:21.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.849+0000 7fc4f1a15700 1 -- 172.21.15.26:0/496266140 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4ec098d50 msgr2=0x7fc4ec099130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:21.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.849+0000 7fc4f1a15700 1 --2- 172.21.15.26:0/496266140 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4ec098d50 0x7fc4ec099130 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fc4d4009760 tx=0x7fc4d4009060).stop 2023-10-01T07:52:21.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.849+0000 7fc4f1a15700 1 -- 172.21.15.26:0/496266140 shutdown_connections 2023-10-01T07:52:21.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.849+0000 7fc4f1a15700 1 --2- 172.21.15.26:0/496266140 >> v2:172.21.15.26:3300/0 conn(0x7fc4ec130440 0x7fc4ec132830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:21.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.849+0000 7fc4f1a15700 1 --2- 172.21.15.26:0/496266140 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4ec098d50 0x7fc4ec099130 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:21.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.849+0000 7fc4f1a15700 1 -- 172.21.15.26:0/496266140 >> 172.21.15.26:0/496266140 conn(0x7fc4ec09dc20 msgr2=0x7fc4ec09e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:21.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.849+0000 7fc4f1a15700 1 -- 172.21.15.26:0/496266140 shutdown_connections 2023-10-01T07:52:21.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.849+0000 7fc4f1a15700 1 -- 172.21.15.26:0/496266140 wait complete. 2023-10-01T07:52:21.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.850+0000 7fc4f1a15700 1 Processor -- start 2023-10-01T07:52:21.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.850+0000 7fc4f1a15700 1 -- start start 2023-10-01T07:52:21.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.851+0000 7fc4f1a15700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4ec0653a0 0x7fc4ec11a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:21.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.851+0000 7fc4f1a15700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4ec098d50 0x7fc4ec11a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:21.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.851+0000 7fc4f1a15700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4ec130440 0x7fc4ec11ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:21.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.851+0000 7fc4f1a15700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec0947b0 con 0x7fc4ec130440 2023-10-01T07:52:21.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.851+0000 7fc4f1a15700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec099a90 con 0x7fc4ec0653a0 2023-10-01T07:52:21.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.851+0000 7fc4f1a15700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec11de80 con 0x7fc4ec098d50 2023-10-01T07:52:21.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.851+0000 7fc4eaffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4ec0653a0 0x7fc4ec11a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:21.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.851+0000 7fc4eb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4ec130440 0x7fc4ec11ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:21.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.851+0000 7fc4ea7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4ec098d50 0x7fc4ec11a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:21.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.851+0000 7fc4eb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4ec130440 0x7fc4ec11ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44398/0 (socket says 172.21.15.26:44398) 2023-10-01T07:52:21.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.851+0000 7fc4eaffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4ec0653a0 0x7fc4ec11a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58586/0 (socket says 172.21.15.26:58586) 2023-10-01T07:52:21.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.851+0000 7fc4eb7fe700 1 -- 172.21.15.26:0/1736750715 learned_addr learned my addr 172.21.15.26:0/1736750715 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:21.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.851+0000 7fc4eaffd700 1 -- 172.21.15.26:0/1736750715 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4ec098d50 msgr2=0x7fc4ec11a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:21.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.851+0000 7fc4eaffd700 1 --2- 172.21.15.26:0/1736750715 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4ec098d50 0x7fc4ec11a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:21.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.851+0000 7fc4eaffd700 1 -- 172.21.15.26:0/1736750715 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4ec130440 msgr2=0x7fc4ec11ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:21.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.851+0000 7fc4eaffd700 1 --2- 172.21.15.26:0/1736750715 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4ec130440 0x7fc4ec11ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:21.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.851+0000 7fc4eaffd700 1 -- 172.21.15.26:0/1736750715 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e4009a20 con 0x7fc4ec0653a0 2023-10-01T07:52:21.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.851+0000 7fc4eb7fe700 1 --2- 172.21.15.26:0/1736750715 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4ec130440 0x7fc4ec11ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:21.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.851+0000 7fc4eaffd700 1 --2- 172.21.15.26:0/1736750715 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4ec0653a0 0x7fc4ec11a350 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fc4dc000c00 tx=0x7fc4dc007b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:21.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.851+0000 7fc4e2ffd700 1 -- 172.21.15.26:0/1736750715 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc0070d0 con 0x7fc4ec0653a0 2023-10-01T07:52:21.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.851+0000 7fc4e2ffd700 1 -- 172.21.15.26:0/1736750715 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4dc007250 con 0x7fc4ec0653a0 2023-10-01T07:52:21.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.851+0000 7fc4f1a15700 1 -- 172.21.15.26:0/1736750715 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4d40092a0 con 0x7fc4ec0653a0 2023-10-01T07:52:21.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.852+0000 7fc4e2ffd700 1 -- 172.21.15.26:0/1736750715 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc007610 con 0x7fc4ec0653a0 2023-10-01T07:52:21.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.852+0000 7fc4f1a15700 1 -- 172.21.15.26:0/1736750715 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4ec11d930 con 0x7fc4ec0653a0 2023-10-01T07:52:21.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.853+0000 7fc4f1a15700 1 -- 172.21.15.26:0/1736750715 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4ec05a260 con 0x7fc4ec0653a0 2023-10-01T07:52:21.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.853+0000 7fc4e2ffd700 1 -- 172.21.15.26:0/1736750715 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fc4dc0059b0 con 0x7fc4ec0653a0 2023-10-01T07:52:21.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.853+0000 7fc4e2ffd700 1 -- 172.21.15.26:0/1736750715 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fc4dc03ac90 con 0x7fc4ec0653a0 2023-10-01T07:52:21.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:21.857+0000 7fc4e2ffd700 1 -- 172.21.15.26:0/1736750715 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fc4dc005e40 con 0x7fc4ec0653a0 2023-10-01T07:52:22.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.076+0000 7fc4f1a15700 1 -- 172.21.15.26:0/1736750715 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc4ec046c20 con 0x7fc4ec0653a0 2023-10-01T07:52:22.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.723+0000 7fc4e2ffd700 1 -- 172.21.15.26:0/1736750715 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc4dc010300 con 0x7fc4ec0653a0 2023-10-01T07:52:22.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.725+0000 7fc4f1a15700 1 -- 172.21.15.26:0/1736750715 >> v1:172.21.15.26:6816/118178 conn(0x7fc4cc02bb60 legacy=0x7fc4cc02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:22.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.725+0000 7fc4f1a15700 1 -- 172.21.15.26:0/1736750715 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4ec0653a0 msgr2=0x7fc4ec11a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:22.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.725+0000 7fc4f1a15700 1 --2- 172.21.15.26:0/1736750715 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4ec0653a0 0x7fc4ec11a350 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fc4dc000c00 tx=0x7fc4dc007b90).stop 2023-10-01T07:52:22.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.725+0000 7fc4f1a15700 1 -- 172.21.15.26:0/1736750715 shutdown_connections 2023-10-01T07:52:22.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.725+0000 7fc4f1a15700 1 --2- 172.21.15.26:0/1736750715 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4ec130440 0x7fc4ec11ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:22.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.725+0000 7fc4f1a15700 1 --2- 172.21.15.26:0/1736750715 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4ec0653a0 0x7fc4ec11a350 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:22.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.725+0000 7fc4f1a15700 1 --2- 172.21.15.26:0/1736750715 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4ec098d50 0x7fc4ec11a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:22.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.725+0000 7fc4f1a15700 1 -- 172.21.15.26:0/1736750715 >> 172.21.15.26:0/1736750715 conn(0x7fc4ec09dc20 msgr2=0x7fc4ec09bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:22.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.726+0000 7fc4f1a15700 1 -- 172.21.15.26:0/1736750715 shutdown_connections 2023-10-01T07:52:22.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.726+0000 7fc4f1a15700 1 -- 172.21.15.26:0/1736750715 wait complete. 2023-10-01T07:52:22.741 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2023-10-01T07:52:22.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.878+0000 7f1905cda700 1 Processor -- start 2023-10-01T07:52:22.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.878+0000 7f1905cda700 1 -- start start 2023-10-01T07:52:22.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.879+0000 7f1905cda700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f19000943b0 0x7f1900126e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:22.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.879+0000 7f1905cda700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1900127440 0x7f1900127820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:22.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.879+0000 7f1905cda700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1900123950 0x7f1900123e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:22.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.879+0000 7f1905cda700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1900093e90 con 0x7f19000943b0 2023-10-01T07:52:22.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.879+0000 7f1905cda700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1900127d10 con 0x7f1900127440 2023-10-01T07:52:22.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.879+0000 7f1905cda700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1900094790 con 0x7f1900123950 2023-10-01T07:52:22.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.879+0000 7f18ff7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f19000943b0 0x7f1900126e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:22.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.879+0000 7f18feffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1900127440 0x7f1900127820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:22.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.879+0000 7f18fffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1900123950 0x7f1900123e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:22.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.879+0000 7f18ff7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f19000943b0 0x7f1900126e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44404/0 (socket says 172.21.15.26:44404) 2023-10-01T07:52:22.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.879+0000 7f18feffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1900127440 0x7f1900127820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58598/0 (socket says 172.21.15.26:58598) 2023-10-01T07:52:22.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.879+0000 7f18ff7fe700 1 -- 172.21.15.26:0/1203100233 learned_addr learned my addr 172.21.15.26:0/1203100233 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:22.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.880+0000 7f18fffff700 1 -- 172.21.15.26:0/1203100233 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1900127440 msgr2=0x7f1900127820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:22.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.880+0000 7f18fffff700 1 --2- 172.21.15.26:0/1203100233 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1900127440 0x7f1900127820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:22.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.880+0000 7f18fffff700 1 -- 172.21.15.26:0/1203100233 >> v2:172.21.15.26:3300/0 conn(0x7f19000943b0 msgr2=0x7f1900126e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:22.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.880+0000 7f18fffff700 1 --2- 172.21.15.26:0/1203100233 >> v2:172.21.15.26:3300/0 conn(0x7f19000943b0 0x7f1900126e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:22.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.880+0000 7f18fffff700 1 -- 172.21.15.26:0/1203100233 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1900093bb0 con 0x7f1900123950 2023-10-01T07:52:22.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.880+0000 7f18fffff700 1 --2- 172.21.15.26:0/1203100233 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1900123950 0x7f1900123e00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f18f800d0d0 tx=0x7f18f800b990).ready entity=mon.2 client_cookie=5404cdae3ea51cb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:22.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.880+0000 7f18fe7fc700 1 -- 172.21.15.26:0/1203100233 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f8010070 con 0x7f1900123950 2023-10-01T07:52:22.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.880+0000 7f18fe7fc700 1 -- 172.21.15.26:0/1203100233 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f800dc90 con 0x7f1900123950 2023-10-01T07:52:22.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.880+0000 7f18fe7fc700 1 -- 172.21.15.26:0/1203100233 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f8015680 con 0x7f1900123950 2023-10-01T07:52:22.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.880+0000 7f1905cda700 1 -- 172.21.15.26:0/1203100233 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1900123950 msgr2=0x7f1900123e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:22.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.880+0000 7f1905cda700 1 --2- 172.21.15.26:0/1203100233 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1900123950 0x7f1900123e00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f18f800d0d0 tx=0x7f18f800b990).stop 2023-10-01T07:52:22.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.880+0000 7f1905cda700 1 -- 172.21.15.26:0/1203100233 shutdown_connections 2023-10-01T07:52:22.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.880+0000 7f1905cda700 1 --2- 172.21.15.26:0/1203100233 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1900123950 0x7f1900123e00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:22.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.880+0000 7f1905cda700 1 --2- 172.21.15.26:0/1203100233 >> v2:172.21.15.26:3300/0 conn(0x7f19000943b0 0x7f1900126e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:22.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.880+0000 7f1905cda700 1 --2- 172.21.15.26:0/1203100233 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1900127440 0x7f1900127820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:22.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.881+0000 7f1905cda700 1 -- 172.21.15.26:0/1203100233 >> 172.21.15.26:0/1203100233 conn(0x7f190009a1c0 msgr2=0x7f190009a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:22.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.881+0000 7f1905cda700 1 -- 172.21.15.26:0/1203100233 shutdown_connections 2023-10-01T07:52:22.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.881+0000 7f1905cda700 1 -- 172.21.15.26:0/1203100233 wait complete. 2023-10-01T07:52:22.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.882+0000 7f1905cda700 1 Processor -- start 2023-10-01T07:52:22.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.882+0000 7f1905cda700 1 -- start start 2023-10-01T07:52:22.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.882+0000 7f1905cda700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19000943b0 0x7f19001223c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:22.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.882+0000 7f1905cda700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1900123950 0x7f19001228b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:22.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.882+0000 7f1905cda700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1900127440 0x7f1900122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:22.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.882+0000 7f1905cda700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1900098ef0 con 0x7f19000943b0 2023-10-01T07:52:22.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.882+0000 7f1905cda700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1900092e90 con 0x7f1900127440 2023-10-01T07:52:22.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.882+0000 7f1905cda700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1900119210 con 0x7f1900123950 2023-10-01T07:52:22.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.882+0000 7f18ff7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19000943b0 0x7f19001223c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:22.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.882+0000 7f18feffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1900123950 0x7f19001228b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:22.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.882+0000 7f18ff7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19000943b0 0x7f19001223c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44416/0 (socket says 172.21.15.26:44416) 2023-10-01T07:52:22.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.882+0000 7f18feffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1900123950 0x7f19001228b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55676/0 (socket says 172.21.15.26:55676) 2023-10-01T07:52:22.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.882+0000 7f18ff7fe700 1 -- 172.21.15.26:0/1861965812 learned_addr learned my addr 172.21.15.26:0/1861965812 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:22.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.882+0000 7f18fffff700 1 --2- 172.21.15.26:0/1861965812 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1900127440 0x7f1900122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:22.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.883+0000 7f18ff7fe700 1 -- 172.21.15.26:0/1861965812 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1900123950 msgr2=0x7f19001228b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:22.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.883+0000 7f18ff7fe700 1 --2- 172.21.15.26:0/1861965812 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1900123950 0x7f19001228b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:22.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.883+0000 7f18ff7fe700 1 -- 172.21.15.26:0/1861965812 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1900127440 msgr2=0x7f1900122da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:22.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.883+0000 7f18ff7fe700 1 --2- 172.21.15.26:0/1861965812 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1900127440 0x7f1900122da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:22.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.883+0000 7f18ff7fe700 1 -- 172.21.15.26:0/1861965812 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f800bc30 con 0x7f19000943b0 2023-10-01T07:52:22.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.883+0000 7f18fffff700 1 --2- 172.21.15.26:0/1861965812 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1900127440 0x7f1900122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:22.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.883+0000 7f18feffd700 1 --2- 172.21.15.26:0/1861965812 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1900123950 0x7f19001228b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:22.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.883+0000 7f18ff7fe700 1 --2- 172.21.15.26:0/1861965812 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19000943b0 0x7f19001223c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f18f000e930 tx=0x7f18f00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:22.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.883+0000 7f18f77fe700 1 -- 172.21.15.26:0/1861965812 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f0012600 con 0x7f19000943b0 2023-10-01T07:52:22.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.883+0000 7f18f77fe700 1 -- 172.21.15.26:0/1861965812 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f0012760 con 0x7f19000943b0 2023-10-01T07:52:22.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.883+0000 7f1905cda700 1 -- 172.21.15.26:0/1861965812 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1900118c30 con 0x7f19000943b0 2023-10-01T07:52:22.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.883+0000 7f18f77fe700 1 -- 172.21.15.26:0/1861965812 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f0012ae0 con 0x7f19000943b0 2023-10-01T07:52:22.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.883+0000 7f1905cda700 1 -- 172.21.15.26:0/1861965812 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1900119d90 con 0x7f19000943b0 2023-10-01T07:52:22.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.884+0000 7f18f77fe700 1 -- 172.21.15.26:0/1861965812 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f18f001b400 con 0x7f19000943b0 2023-10-01T07:52:22.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.884+0000 7f18f77fe700 1 -- 172.21.15.26:0/1861965812 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f18f003b1c0 con 0x7f19000943b0 2023-10-01T07:52:22.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.884+0000 7f1905cda700 1 -- 172.21.15.26:0/1861965812 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1900119d90 con 0x7f19000943b0 2023-10-01T07:52:22.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:22.889+0000 7f18f77fe700 1 -- 172.21.15.26:0/1861965812 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f1900119d90 con 0x7f19000943b0 2023-10-01T07:52:23.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.107+0000 7f1905cda700 1 -- 172.21.15.26:0/1861965812 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f1900119d90 con 0x7f19000943b0 2023-10-01T07:52:23.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.727+0000 7f18f77fe700 1 -- 172.21.15.26:0/1861965812 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v8) v1 ==== 105+0+0 (secure 0 0 0) 0x7f1900119d90 con 0x7f19000943b0 2023-10-01T07:52:23.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.729+0000 7f1905cda700 1 -- 172.21.15.26:0/1861965812 >> v1:172.21.15.26:6816/118178 conn(0x7f18e002bb60 legacy=0x7f18e002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:23.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.729+0000 7f1905cda700 1 -- 172.21.15.26:0/1861965812 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19000943b0 msgr2=0x7f19001223c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:23.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.729+0000 7f1905cda700 1 --2- 172.21.15.26:0/1861965812 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19000943b0 0x7f19001223c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f18f000e930 tx=0x7f18f00090f0).stop 2023-10-01T07:52:23.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.729+0000 7f1905cda700 1 -- 172.21.15.26:0/1861965812 shutdown_connections 2023-10-01T07:52:23.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.729+0000 7f1905cda700 1 --2- 172.21.15.26:0/1861965812 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1900127440 0x7f1900122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:23.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.729+0000 7f1905cda700 1 --2- 172.21.15.26:0/1861965812 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19000943b0 0x7f19001223c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:23.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.729+0000 7f1905cda700 1 --2- 172.21.15.26:0/1861965812 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1900123950 0x7f19001228b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:23.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.729+0000 7f1905cda700 1 -- 172.21.15.26:0/1861965812 >> 172.21.15.26:0/1861965812 conn(0x7f190009a1c0 msgr2=0x7f1900067d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:23.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.730+0000 7f1905cda700 1 -- 172.21.15.26:0/1861965812 shutdown_connections 2023-10-01T07:52:23.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.730+0000 7f1905cda700 1 -- 172.21.15.26:0/1861965812 wait complete. 2023-10-01T07:52:23.745 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-01T07:52:23.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.878+0000 7f6ac7296700 1 Processor -- start 2023-10-01T07:52:23.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.879+0000 7f6ac7296700 1 -- start start 2023-10-01T07:52:23.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.879+0000 7f6ac7296700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6ac0066200 0x7f6ac00977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:23.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.879+0000 7f6ac7296700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ac01281c0 0x7f6ac012b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:23.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.879+0000 7f6ac7296700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ac0065740 con 0x7f6ac0127dc0 2023-10-01T07:52:23.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.879+0000 7f6ac7296700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac00653a0 con 0x7f6ac0066200 2023-10-01T07:52:23.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.879+0000 7f6ac7296700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac0064ef0 con 0x7f6ac01281c0 2023-10-01T07:52:23.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.879+0000 7f6ac5032700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6ac0066200 0x7f6ac00977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:23.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.879+0000 7f6ac5833700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ac01281c0 0x7f6ac012b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:23.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.879+0000 7f6ac4831700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6ac0127dc0 0x7f6ac012aaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56272/0 (socket says 172.21.15.26:56272) 2023-10-01T07:52:23.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.879+0000 7f6ac5032700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6ac0066200 0x7f6ac00977a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52320/0 (socket says 172.21.15.26:52320) 2023-10-01T07:52:23.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.879+0000 7f6ac4831700 1 -- 172.21.15.26:0/2526177104 learned_addr learned my addr 172.21.15.26:0/2526177104 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:52:23.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.879+0000 7f6ac5833700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ac01281c0 0x7f6ac012b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:40448/0 (socket says 172.21.15.26:40448) 2023-10-01T07:52:23.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.880+0000 7f6ac5833700 1 -- 172.21.15.26:0/2526177104 >> v2:172.21.15.26:3300/0 conn(0x7f6ac0066200 msgr2=0x7f6ac00977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:23.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.880+0000 7f6ac5833700 1 --2- 172.21.15.26:0/2526177104 >> v2:172.21.15.26:3300/0 conn(0x7f6ac0066200 0x7f6ac00977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:23.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.880+0000 7f6ac5833700 1 -- 172.21.15.26:0/2526177104 >> v1:172.21.15.26:6789/0 conn(0x7f6ac0127dc0 legacy=0x7f6ac012aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:23.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.880+0000 7f6ac5833700 1 -- 172.21.15.26:0/2526177104 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac0064a40 con 0x7f6ac01281c0 2023-10-01T07:52:23.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.880+0000 7f6ab7fff700 1 -- 172.21.15.26:0/2526177104 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 653310187 0 0) 0x7f6ac0065740 con 0x7f6ac0127dc0 2023-10-01T07:52:23.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.880+0000 7f6ac5032700 1 --2- 172.21.15.26:0/2526177104 >> v2:172.21.15.26:3300/0 conn(0x7f6ac0066200 0x7f6ac00977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:23.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.880+0000 7f6ac5833700 1 --2- 172.21.15.26:0/2526177104 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ac01281c0 0x7f6ac012b1b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f6ab8009e60 tx=0x7f6ab8009780).ready entity=mon.1 client_cookie=af8016da46bb2bdf server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:23.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.880+0000 7f6ab7fff700 1 -- 172.21.15.26:0/2526177104 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab800e070 con 0x7f6ac01281c0 2023-10-01T07:52:23.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.880+0000 7f6ab7fff700 1 -- 172.21.15.26:0/2526177104 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab800bb60 con 0x7f6ac01281c0 2023-10-01T07:52:23.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.880+0000 7f6ab7fff700 1 -- 172.21.15.26:0/2526177104 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab8012410 con 0x7f6ac01281c0 2023-10-01T07:52:23.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.880+0000 7f6ac7296700 1 -- 172.21.15.26:0/2526177104 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ac01281c0 msgr2=0x7f6ac012b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:23.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.880+0000 7f6ac7296700 1 --2- 172.21.15.26:0/2526177104 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ac01281c0 0x7f6ac012b1b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f6ab8009e60 tx=0x7f6ab8009780).stop 2023-10-01T07:52:23.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.881+0000 7f6ac7296700 1 -- 172.21.15.26:0/2526177104 shutdown_connections 2023-10-01T07:52:23.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.881+0000 7f6ac7296700 1 --2- 172.21.15.26:0/2526177104 >> v2:172.21.15.26:3300/0 conn(0x7f6ac0066200 0x7f6ac00977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:23.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.881+0000 7f6ac7296700 1 --2- 172.21.15.26:0/2526177104 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ac01281c0 0x7f6ac012b1b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:23.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.881+0000 7f6ac7296700 1 -- 172.21.15.26:0/2526177104 >> 172.21.15.26:0/2526177104 conn(0x7f6ac009ba50 msgr2=0x7f6ac009be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:23.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.881+0000 7f6ac7296700 1 -- 172.21.15.26:0/2526177104 shutdown_connections 2023-10-01T07:52:23.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.881+0000 7f6ac7296700 1 -- 172.21.15.26:0/2526177104 wait complete. 2023-10-01T07:52:23.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.882+0000 7f6ac7296700 1 Processor -- start 2023-10-01T07:52:23.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.882+0000 7f6ac7296700 1 -- start start 2023-10-01T07:52:23.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.882+0000 7f6ac7296700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6ac0066200 0x7f6ac01176e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:23.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.882+0000 7f6ac7296700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ac0127dc0 0x7f6ac0114080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:23.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.882+0000 7f6ac7296700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ac01281c0 0x7f6ac0114570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:23.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.882+0000 7f6ac7296700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac0125030 con 0x7f6ac01281c0 2023-10-01T07:52:23.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.882+0000 7f6ac7296700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac01161c0 con 0x7f6ac0127dc0 2023-10-01T07:52:23.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.882+0000 7f6ac7296700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac0116c40 con 0x7f6ac0066200 2023-10-01T07:52:23.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.883+0000 7f6ac5032700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6ac0066200 0x7f6ac01176e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:23.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.883+0000 7f6ac5032700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6ac0066200 0x7f6ac01176e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:40642/0 (socket says 172.21.15.26:40642) 2023-10-01T07:52:23.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.883+0000 7f6ac5032700 1 -- 172.21.15.26:0/3221119831 learned_addr learned my addr 172.21.15.26:0/3221119831 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:23.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.883+0000 7f6ac5833700 1 --2- 172.21.15.26:0/3221119831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ac01281c0 0x7f6ac0114570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:23.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.883+0000 7f6ac4831700 1 --2- 172.21.15.26:0/3221119831 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ac0127dc0 0x7f6ac0114080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:23.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.883+0000 7f6ac5032700 1 -- 172.21.15.26:0/3221119831 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ac0127dc0 msgr2=0x7f6ac0114080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:23.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.883+0000 7f6ac5032700 1 --2- 172.21.15.26:0/3221119831 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ac0127dc0 0x7f6ac0114080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:23.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.883+0000 7f6ac5032700 1 -- 172.21.15.26:0/3221119831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ac01281c0 msgr2=0x7f6ac0114570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:23.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.883+0000 7f6ac5032700 1 --2- 172.21.15.26:0/3221119831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ac01281c0 0x7f6ac0114570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:23.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.883+0000 7f6ac5032700 1 -- 172.21.15.26:0/3221119831 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6abc0092a0 con 0x7f6ac0066200 2023-10-01T07:52:23.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.883+0000 7f6ac4831700 1 --2- 172.21.15.26:0/3221119831 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ac0127dc0 0x7f6ac0114080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:52:23.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.883+0000 7f6ac5032700 1 --2- 172.21.15.26:0/3221119831 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6ac0066200 0x7f6ac01176e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f6abc00ea20 tx=0x7f6abc009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:23.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.883+0000 7f6ab57fa700 1 -- 172.21.15.26:0/3221119831 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6abc017c60 con 0x7f6ac0066200 2023-10-01T07:52:23.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.883+0000 7f6ab57fa700 1 -- 172.21.15.26:0/3221119831 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6abc017dc0 con 0x7f6ac0066200 2023-10-01T07:52:23.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.883+0000 7f6ac7296700 1 -- 172.21.15.26:0/3221119831 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab8009a20 con 0x7f6ac0066200 2023-10-01T07:52:23.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.884+0000 7f6ab57fa700 1 -- 172.21.15.26:0/3221119831 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6abc00c850 con 0x7f6ac0066200 2023-10-01T07:52:23.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.884+0000 7f6ac7296700 1 -- 172.21.15.26:0/3221119831 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ac0114a60 con 0x7f6ac0066200 2023-10-01T07:52:23.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.884+0000 7f6ab57fa700 1 -- 172.21.15.26:0/3221119831 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f6abc01d070 con 0x7f6ac0066200 2023-10-01T07:52:23.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.884+0000 7f6ab57fa700 1 -- 172.21.15.26:0/3221119831 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f6abc043560 con 0x7f6ac0066200 2023-10-01T07:52:23.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.885+0000 7f6ac7296700 1 -- 172.21.15.26:0/3221119831 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ac01172e0 con 0x7f6ac0066200 2023-10-01T07:52:23.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:23.889+0000 7f6ab57fa700 1 -- 172.21.15.26:0/3221119831 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f6abc01d970 con 0x7f6ac0066200 2023-10-01T07:52:24.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.107+0000 7f6ac7296700 1 -- 172.21.15.26:0/3221119831 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ac005a260 con 0x7f6ac0066200 2023-10-01T07:52:24.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.107+0000 7f6ab57fa700 1 -- 172.21.15.26:0/3221119831 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2156 (secure 0 0 0) 0x7f6abc02e030 con 0x7f6ac0066200 2023-10-01T07:52:24.108 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:52:24.108 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-01T07:51:57.295264+0000","modified":"2023-10-01T07:52:23.722337+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4189},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4189":{"gid":4189,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6817/2857714939","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6817","nonce":2857714939}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-01T07:52:24.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.109+0000 7f6ac7296700 1 -- 172.21.15.26:0/3221119831 >> v1:172.21.15.26:6816/118178 conn(0x7f6aa402bb90 legacy=0x7f6aa402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:24.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.109+0000 7f6ac7296700 1 -- 172.21.15.26:0/3221119831 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6ac0066200 msgr2=0x7f6ac01176e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:24.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.109+0000 7f6ac7296700 1 --2- 172.21.15.26:0/3221119831 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6ac0066200 0x7f6ac01176e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f6abc00ea20 tx=0x7f6abc009060).stop 2023-10-01T07:52:24.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.109+0000 7f6ac7296700 1 -- 172.21.15.26:0/3221119831 shutdown_connections 2023-10-01T07:52:24.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.109+0000 7f6ac7296700 1 --2- 172.21.15.26:0/3221119831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ac01281c0 0x7f6ac0114570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:24.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.109+0000 7f6ac7296700 1 --2- 172.21.15.26:0/3221119831 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6ac0066200 0x7f6ac01176e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:24.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.109+0000 7f6ac7296700 1 --2- 172.21.15.26:0/3221119831 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ac0127dc0 0x7f6ac0114080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:24.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.109+0000 7f6ac7296700 1 -- 172.21.15.26:0/3221119831 >> 172.21.15.26:0/3221119831 conn(0x7f6ac009ba50 msgr2=0x7f6ac012ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:24.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.109+0000 7f6ac7296700 1 -- 172.21.15.26:0/3221119831 shutdown_connections 2023-10-01T07:52:24.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.109+0000 7f6ac7296700 1 -- 172.21.15.26:0/3221119831 wait complete. 2023-10-01T07:52:24.111 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2023-10-01T07:52:24.223 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-01T07:51:57.295264+0000', 'modified': '2023-10-01T07:52:23.722337+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4189}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4189': {'gid': 4189, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.26:6817/2857714939', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.26:6817', 'nonce': 2857714939}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-01T07:52:24.224 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-01T07:52:24.224 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-01T07:52:24.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.360+0000 7f7caa5dc700 1 Processor -- start 2023-10-01T07:52:24.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.360+0000 7f7caa5dc700 1 -- start start 2023-10-01T07:52:24.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.361+0000 7f7caa5dc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7ca4059070 0x7f7ca4127890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:24.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.361+0000 7f7caa5dc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7ca4127d80 0x7f7ca4095a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:24.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.361+0000 7f7caa5dc700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca4091b60 con 0x7f7ca4127390 2023-10-01T07:52:24.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.361+0000 7f7caa5dc700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca4096940 con 0x7f7ca4127d80 2023-10-01T07:52:24.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.361+0000 7f7caa5dc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca4059c00 con 0x7f7ca4059070 2023-10-01T07:52:24.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.361+0000 7f7ca3fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7ca4059070 0x7f7ca4127890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:24.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.361+0000 7f7ca8b79700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7ca4127d80 0x7f7ca4095a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:24.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.361+0000 7f7ca3fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7ca4059070 0x7f7ca4127890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:40472/0 (socket says 172.21.15.26:40472) 2023-10-01T07:52:24.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.361+0000 7f7ca3fff700 1 -- 172.21.15.26:0/1747551475 learned_addr learned my addr 172.21.15.26:0/1747551475 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:24.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.361+0000 7f7ca3fff700 1 -- 172.21.15.26:0/1747551475 >> v2:172.21.15.26:3300/0 conn(0x7f7ca4127d80 msgr2=0x7f7ca4095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:24.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.361+0000 7f7ca3fff700 1 --2- 172.21.15.26:0/1747551475 >> v2:172.21.15.26:3300/0 conn(0x7f7ca4127d80 0x7f7ca4095a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:24.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.361+0000 7f7ca3fff700 1 -- 172.21.15.26:0/1747551475 >> v1:172.21.15.26:6789/0 conn(0x7f7ca4127390 legacy=0x7f7ca4095370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:24.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.361+0000 7f7ca3fff700 1 -- 172.21.15.26:0/1747551475 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca40929d0 con 0x7f7ca4059070 2023-10-01T07:52:24.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.361+0000 7f7ca8b79700 1 --2- 172.21.15.26:0/1747551475 >> v2:172.21.15.26:3300/0 conn(0x7f7ca4127d80 0x7f7ca4095a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:24.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.361+0000 7f7ca3fff700 1 --2- 172.21.15.26:0/1747551475 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7ca4059070 0x7f7ca4127890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f7c94009830 tx=0x7f7c940090f0).ready entity=mon.1 client_cookie=a7ba42d8cc0ed551 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:24.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.362+0000 7f7ca2ffd700 1 -- 172.21.15.26:0/1747551475 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9400b580 con 0x7f7ca4059070 2023-10-01T07:52:24.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.362+0000 7f7ca2ffd700 1 -- 172.21.15.26:0/1747551475 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9400b6e0 con 0x7f7ca4059070 2023-10-01T07:52:24.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.362+0000 7f7ca2ffd700 1 -- 172.21.15.26:0/1747551475 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9400ba80 con 0x7f7ca4059070 2023-10-01T07:52:24.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.362+0000 7f7caa5dc700 1 -- 172.21.15.26:0/1747551475 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7ca4059070 msgr2=0x7f7ca4127890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:24.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.362+0000 7f7caa5dc700 1 --2- 172.21.15.26:0/1747551475 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7ca4059070 0x7f7ca4127890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f7c94009830 tx=0x7f7c940090f0).stop 2023-10-01T07:52:24.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.362+0000 7f7caa5dc700 1 -- 172.21.15.26:0/1747551475 shutdown_connections 2023-10-01T07:52:24.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.362+0000 7f7caa5dc700 1 --2- 172.21.15.26:0/1747551475 >> v2:172.21.15.26:3300/0 conn(0x7f7ca4127d80 0x7f7ca4095a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:24.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.362+0000 7f7caa5dc700 1 --2- 172.21.15.26:0/1747551475 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7ca4059070 0x7f7ca4127890 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:24.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.362+0000 7f7caa5dc700 1 -- 172.21.15.26:0/1747551475 >> 172.21.15.26:0/1747551475 conn(0x7f7ca4097470 msgr2=0x7f7ca4097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:24.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.362+0000 7f7caa5dc700 1 -- 172.21.15.26:0/1747551475 shutdown_connections 2023-10-01T07:52:24.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.362+0000 7f7caa5dc700 1 -- 172.21.15.26:0/1747551475 wait complete. 2023-10-01T07:52:24.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.364+0000 7f7caa5dc700 1 Processor -- start 2023-10-01T07:52:24.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.364+0000 7f7caa5dc700 1 -- start start 2023-10-01T07:52:24.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.364+0000 7f7caa5dc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7ca4059070 0x7f7ca4117d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:24.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.365+0000 7f7caa5dc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7ca4127390 0x7f7ca4113dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:24.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.365+0000 7f7caa5dc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ca4127d80 0x7f7ca41142c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:24.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.365+0000 7f7caa5dc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca41172d0 con 0x7f7ca4127d80 2023-10-01T07:52:24.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.365+0000 7f7caa5dc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca4116f30 con 0x7f7ca4059070 2023-10-01T07:52:24.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.365+0000 7f7caa5dc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca4125400 con 0x7f7ca4127390 2023-10-01T07:52:24.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.365+0000 7f7ca3fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7ca4059070 0x7f7ca4117d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:24.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.365+0000 7f7ca3fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7ca4059070 0x7f7ca4117d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:40474/0 (socket says 172.21.15.26:40474) 2023-10-01T07:52:24.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.365+0000 7f7ca3fff700 1 -- 172.21.15.26:0/65591236 learned_addr learned my addr 172.21.15.26:0/65591236 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:24.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.365+0000 7f7ca37fe700 1 --2- 172.21.15.26:0/65591236 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7ca4127390 0x7f7ca4113dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:24.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.365+0000 7f7ca8b79700 1 --2- 172.21.15.26:0/65591236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ca4127d80 0x7f7ca41142c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:24.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.365+0000 7f7ca3fff700 1 -- 172.21.15.26:0/65591236 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7ca4127390 msgr2=0x7f7ca4113dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:24.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.365+0000 7f7ca3fff700 1 --2- 172.21.15.26:0/65591236 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7ca4127390 0x7f7ca4113dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:24.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.365+0000 7f7ca3fff700 1 -- 172.21.15.26:0/65591236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ca4127d80 msgr2=0x7f7ca41142c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:24.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.365+0000 7f7ca3fff700 1 --2- 172.21.15.26:0/65591236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ca4127d80 0x7f7ca41142c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:24.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.365+0000 7f7ca3fff700 1 -- 172.21.15.26:0/65591236 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9c009a20 con 0x7f7ca4059070 2023-10-01T07:52:24.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.365+0000 7f7ca8b79700 1 --2- 172.21.15.26:0/65591236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ca4127d80 0x7f7ca41142c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:24.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.365+0000 7f7ca3fff700 1 --2- 172.21.15.26:0/65591236 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7ca4059070 0x7f7ca4117d70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f7c94008000 tx=0x7f7c94017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:24.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.365+0000 7f7c9bfff700 1 -- 172.21.15.26:0/65591236 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9400be40 con 0x7f7ca4059070 2023-10-01T07:52:24.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.365+0000 7f7c9bfff700 1 -- 172.21.15.26:0/65591236 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9400b850 con 0x7f7ca4059070 2023-10-01T07:52:24.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.365+0000 7f7c9bfff700 1 -- 172.21.15.26:0/65591236 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9401c420 con 0x7f7ca4059070 2023-10-01T07:52:24.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.365+0000 7f7caa5dc700 1 -- 172.21.15.26:0/65591236 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c94009370 con 0x7f7ca4059070 2023-10-01T07:52:24.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.366+0000 7f7caa5dc700 1 -- 172.21.15.26:0/65591236 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca4115960 con 0x7f7ca4059070 2023-10-01T07:52:24.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.366+0000 7f7c9bfff700 1 -- 172.21.15.26:0/65591236 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f7c9401c790 con 0x7f7ca4059070 2023-10-01T07:52:24.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.366+0000 7f7c9bfff700 1 -- 172.21.15.26:0/65591236 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f7c9403cc60 con 0x7f7ca4059070 2023-10-01T07:52:24.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.369+0000 7f7cbbf8fb80 1 Processor -- start 2023-10-01T07:52:24.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.369+0000 7f7cbbf8fb80 1 -- start start 2023-10-01T07:52:24.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.370+0000 7f7cbbf8fb80 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x556fdcda8170 0x556fdcda8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:24.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.370+0000 7f7cbbf8fb80 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x556fdcda8a40 0x556fdcdd20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:24.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.370+0000 7f7cbbf8fb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fdcdd25b0 0x556fdcdd49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:24.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.370+0000 7f7cbbf8fb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fdcd72610 con 0x556fdcdd25b0 2023-10-01T07:52:24.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.370+0000 7f7cbbf8fb80 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x556fdcce8db0 con 0x556fdcda8170 2023-10-01T07:52:24.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.370+0000 7f7cbbf8fb80 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x556fdccfe030 con 0x556fdcda8a40 2023-10-01T07:52:24.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.370+0000 7f7ca3fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x556fdcda8170 0x556fdcda8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:24.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.370+0000 7f7ca37fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x556fdcda8a40 0x556fdcdd20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:24.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.370+0000 7f7ca3fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x556fdcda8170 0x556fdcda8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:40476/0 (socket says 172.21.15.26:40476) 2023-10-01T07:52:24.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.370+0000 7f7ca37fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x556fdcda8a40 0x556fdcdd20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:40666/0 (socket says 172.21.15.26:40666) 2023-10-01T07:52:24.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.370+0000 7f7ca3fff700 1 -- 172.21.15.26:0/2645829677 learned_addr learned my addr 172.21.15.26:0/2645829677 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:24.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.370+0000 7f7ca8b79700 1 --2- 172.21.15.26:0/2645829677 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fdcdd25b0 0x556fdcdd49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:24.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.370+0000 7f7ca37fe700 1 -- 172.21.15.26:0/2645829677 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x556fdcda8170 msgr2=0x556fdcda8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:24.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.370+0000 7f7ca37fe700 1 --2- 172.21.15.26:0/2645829677 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x556fdcda8170 0x556fdcda8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:24.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.370+0000 7f7ca37fe700 1 -- 172.21.15.26:0/2645829677 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fdcdd25b0 msgr2=0x556fdcdd49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:24.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.370+0000 7f7ca37fe700 1 --2- 172.21.15.26:0/2645829677 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fdcdd25b0 0x556fdcdd49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:24.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.371+0000 7f7ca37fe700 1 -- 172.21.15.26:0/2645829677 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556fdcb99710 con 0x556fdcda8a40 2023-10-01T07:52:24.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.371+0000 7f7ca3fff700 1 --2- 172.21.15.26:0/2645829677 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x556fdcda8170 0x556fdcda8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:24.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.371+0000 7f7ca8b79700 1 --2- 172.21.15.26:0/2645829677 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fdcdd25b0 0x556fdcdd49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:24.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.371+0000 7f7ca37fe700 1 --2- 172.21.15.26:0/2645829677 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x556fdcda8a40 0x556fdcdd20c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f7ca4124740 tx=0x7f7c8c007d40).ready entity=mon.2 client_cookie=e765cd3d7b778bc5 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:24.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.371+0000 7f7c997fa700 1 -- 172.21.15.26:0/2645829677 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c011900 con 0x556fdcda8a40 2023-10-01T07:52:24.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.371+0000 7f7c997fa700 1 -- 172.21.15.26:0/2645829677 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8c011a60 con 0x556fdcda8a40 2023-10-01T07:52:24.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.371+0000 7f7c997fa700 1 -- 172.21.15.26:0/2645829677 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c011e20 con 0x556fdcda8a40 2023-10-01T07:52:24.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.371+0000 7f7cbbf8fb80 1 -- 172.21.15.26:0/2645829677 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x556fdcda8a40 msgr2=0x556fdcdd20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:24.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.371+0000 7f7cbbf8fb80 1 --2- 172.21.15.26:0/2645829677 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x556fdcda8a40 0x556fdcdd20c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f7ca4124740 tx=0x7f7c8c007d40).stop 2023-10-01T07:52:24.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.372+0000 7f7cbbf8fb80 1 -- 172.21.15.26:0/2645829677 shutdown_connections 2023-10-01T07:52:24.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.372+0000 7f7cbbf8fb80 1 --2- 172.21.15.26:0/2645829677 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fdcdd25b0 0x556fdcdd49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:24.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.372+0000 7f7cbbf8fb80 1 --2- 172.21.15.26:0/2645829677 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x556fdcda8170 0x556fdcda8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:24.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.372+0000 7f7cbbf8fb80 1 --2- 172.21.15.26:0/2645829677 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x556fdcda8a40 0x556fdcdd20c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:24.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.372+0000 7f7cbbf8fb80 1 -- 172.21.15.26:0/2645829677 >> 172.21.15.26:0/2645829677 conn(0x556fdcc16940 msgr2=0x556fdcdc8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:24.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.372+0000 7f7cbbf8fb80 1 -- 172.21.15.26:0/2645829677 shutdown_connections 2023-10-01T07:52:24.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.372+0000 7f7cbbf8fb80 1 -- 172.21.15.26:0/2645829677 wait complete. 2023-10-01T07:52:24.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.372+0000 7f7cbbf8fb80 1 -- start start 2023-10-01T07:52:24.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.372+0000 7f7cbbf8fb80 1 Processor -- start 2023-10-01T07:52:24.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.373+0000 7f7cbbf8fb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fdcda8170 0x556fdcdcdad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:24.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.373+0000 7f7cbbf8fb80 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x556fdcda8a40 0x556fdcdcdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:24.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.373+0000 7f7cbbf8fb80 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x556fdcdd25b0 0x556fdcdce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:24.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.373+0000 7f7cbbf8fb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fdccfe170 con 0x556fdcda8170 2023-10-01T07:52:24.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.373+0000 7f7cbbf8fb80 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x556fdccfe3f0 con 0x556fdcdd25b0 2023-10-01T07:52:24.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.373+0000 7f7cbbf8fb80 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x556fdccc9920 con 0x556fdcda8a40 2023-10-01T07:52:24.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.373+0000 7f7cbbf8fb80 10 client.0 ll_register_callbacks cb 0x556fdcc9ece0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-01T07:52:24.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.373+0000 7f7ca37fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x556fdcda8a40 0x556fdcdcdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:24.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.373+0000 7f7ca37fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x556fdcda8a40 0x556fdcdcdfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:40668/0 (socket says 172.21.15.26:40668) 2023-10-01T07:52:24.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.373+0000 7f7ca37fe700 1 -- 172.21.15.26:0/587397852 learned_addr learned my addr 172.21.15.26:0/587397852 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:24.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.373+0000 7f7ca8b79700 1 --2- 172.21.15.26:0/587397852 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x556fdcdd25b0 0x556fdcdce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:24.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.373+0000 7f7ca3fff700 1 --2- 172.21.15.26:0/587397852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fdcda8170 0x556fdcdcdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:24.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.373+0000 7f7ca37fe700 1 -- 172.21.15.26:0/587397852 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x556fdcdd25b0 msgr2=0x556fdcdce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:24.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.373+0000 7f7ca37fe700 1 --2- 172.21.15.26:0/587397852 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x556fdcdd25b0 0x556fdcdce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:24.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.373+0000 7f7ca37fe700 1 -- 172.21.15.26:0/587397852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fdcda8170 msgr2=0x556fdcdcdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:24.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.373+0000 7f7ca37fe700 1 --2- 172.21.15.26:0/587397852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fdcda8170 0x556fdcdcdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:24.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.373+0000 7f7ca37fe700 1 -- 172.21.15.26:0/587397852 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca4091b60 con 0x556fdcda8a40 2023-10-01T07:52:24.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.374+0000 7f7ca37fe700 1 --2- 172.21.15.26:0/587397852 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x556fdcda8a40 0x556fdcdcdfc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f7c8c00f000 tx=0x7f7c8c01a000).ready entity=mon.2 client_cookie=4e901384efa40aa1 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:24.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.374+0000 7f7c827fc700 10 client.0 ms_handle_connect on v2:172.21.15.26:3302/0 2023-10-01T07:52:24.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.374+0000 7f7c827fc700 1 -- 172.21.15.26:0/587397852 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c011900 con 0x556fdcda8a40 2023-10-01T07:52:24.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.374+0000 7f7c827fc700 1 -- 172.21.15.26:0/587397852 <== mon.2 v2:172.21.15.26:3302/0 2 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f7c8c016d20 con 0x556fdcda8a40 2023-10-01T07:52:24.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.374+0000 7f7cbbf8fb80 1 -- 172.21.15.26:0/587397852 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556fdcda0f20 con 0x556fdcda8a40 2023-10-01T07:52:24.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.374+0000 7f7c827fc700 1 -- 172.21.15.26:0/587397852 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c8c007a70 con 0x556fdcda8a40 2023-10-01T07:52:24.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.374+0000 7f7cbbf8fb80 10 client.4547 fetch_fsmap learned FSMap version 8 2023-10-01T07:52:24.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.374+0000 7f7cbbf8fb80 1 -- 172.21.15.26:0/587397852 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x556fdccd0b00 con 0x556fdcda8a40 2023-10-01T07:52:24.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.374+0000 7f7c827fc700 1 -- 172.21.15.26:0/587397852 <== mon.2 v2:172.21.15.26:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556fdcda0f20 con 0x556fdcda8a40 2023-10-01T07:52:24.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.374+0000 7f7c827fc700 1 -- 172.21.15.26:0/587397852 <== mon.2 v2:172.21.15.26:3302/0 5 ==== fsmap(e 8) v1 ==== 1430+0+0 (secure 0 0 0) 0x7f7c8c029070 con 0x556fdcda8a40 2023-10-01T07:52:24.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.374+0000 7f7cbbf8fb80 10 client.4547 fetch_fsmap finished waiting for FSMap version 8 2023-10-01T07:52:24.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.374+0000 7f7cbbf8fb80 10 client.4547 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-01T07:52:24.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.374+0000 7f7cbbf8fb80 20 client.4547 populate_metadata read hostname 'smithi026' 2023-10-01T07:52:24.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.374+0000 7f7cbbf8fb80 4 client.4547 mds_command: new command op to 4189 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-01T07:52:24.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.374+0000 7f7cbbf8fb80 1 -- 172.21.15.26:0/587397852 --> v1:172.21.15.26:6817/2857714939 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556fdcd76250 con 0x556fdcdc27b0 2023-10-01T07:52:24.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.375+0000 7f7c827fc700 10 client.4547 ms_handle_connect on v1:172.21.15.26:6817/2857714939 2023-10-01T07:52:24.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.375+0000 7f7c827fc700 1 -- 172.21.15.26:0/587397852 <== mds.0 v1:172.21.15.26:6817/2857714939 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (unknown 0 0 3608088055) 0x556fdcd76250 con 0x556fdcdc27b0 2023-10-01T07:52:24.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.375+0000 7f7c827fc700 10 client.4547 handle_command_reply: tid=0 2023-10-01T07:52:24.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.375+0000 7f7cbbf8fb80 1 client.4547 shutdown 2023-10-01T07:52:24.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.375+0000 7f7cbbf8fb80 1 -- 172.21.15.26:0/587397852 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x556fdcda8a40 msgr2=0x556fdcdcdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:24.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.375+0000 7f7cbbf8fb80 1 --2- 172.21.15.26:0/587397852 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x556fdcda8a40 0x556fdcdcdfc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f7c8c00f000 tx=0x7f7c8c01a000).stop 2023-10-01T07:52:24.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.375+0000 7f7cbbf8fb80 1 -- 172.21.15.26:0/587397852 shutdown_connections 2023-10-01T07:52:24.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.375+0000 7f7cbbf8fb80 1 --2- 172.21.15.26:0/587397852 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x556fdcdd25b0 0x556fdcdce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:24.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.375+0000 7f7cbbf8fb80 1 --2- 172.21.15.26:0/587397852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fdcda8170 0x556fdcdcdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:24.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.375+0000 7f7cbbf8fb80 1 --2- 172.21.15.26:0/587397852 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x556fdcda8a40 0x556fdcdcdfc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:24.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.375+0000 7f7c827fc700 0 client.4547 ms_handle_reset on v1:172.21.15.26:6817/2857714939 2023-10-01T07:52:24.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.375+0000 7f7cbbf8fb80 1 -- 172.21.15.26:0/587397852 >> 172.21.15.26:0/587397852 conn(0x556fdcc16940 msgr2=0x556fdcdc8c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:24.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.376+0000 7f7cbbf8fb80 1 -- 172.21.15.26:0/587397852 shutdown_connections 2023-10-01T07:52:24.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.376+0000 7f7cbbf8fb80 1 -- 172.21.15.26:0/587397852 wait complete. 2023-10-01T07:52:24.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.376+0000 7f7cbbf8fb80 20 client.4547 trim_cache size 0 max 16384 2023-10-01T07:52:24.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.393+0000 7f7cbbf8fb80 1 Processor -- start 2023-10-01T07:52:24.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.393+0000 7f7cbbf8fb80 1 -- start start 2023-10-01T07:52:24.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.393+0000 7f7cbbf8fb80 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x556fdcda8170 0x556fdcdac570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:24.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.393+0000 7f7cbbf8fb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fdcda8a40 0x556fdcdd0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:24.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.393+0000 7f7cbbf8fb80 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x556fdcdd25b0 0x556fdcda7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:24.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.393+0000 7f7cbbf8fb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fdcdaa120 con 0x556fdcda8a40 2023-10-01T07:52:24.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.393+0000 7f7cbbf8fb80 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x556fdcda8870 con 0x556fdcdd25b0 2023-10-01T07:52:24.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.393+0000 7f7cbbf8fb80 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x556fdcdd0150 con 0x556fdcda8170 2023-10-01T07:52:24.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.394+0000 7f7ca37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fdcda8a40 0x556fdcdd0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:24.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.394+0000 7f7ca3fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x556fdcda8170 0x556fdcdac570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:24.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.394+0000 7f7ca8b79700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x556fdcdd25b0 0x556fdcda7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:24.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.394+0000 7f7ca37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fdcda8a40 0x556fdcdd0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52382/0 (socket says 172.21.15.26:52382) 2023-10-01T07:52:24.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.394+0000 7f7ca37fe700 1 -- 172.21.15.26:0/3663434872 learned_addr learned my addr 172.21.15.26:0/3663434872 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:24.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.394+0000 7f7ca37fe700 1 -- 172.21.15.26:0/3663434872 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x556fdcda8170 msgr2=0x556fdcdac570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:24.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.394+0000 7f7ca37fe700 1 --2- 172.21.15.26:0/3663434872 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x556fdcda8170 0x556fdcdac570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:24.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.394+0000 7f7ca37fe700 1 -- 172.21.15.26:0/3663434872 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x556fdcdd25b0 msgr2=0x556fdcda7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:24.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.394+0000 7f7ca37fe700 1 --2- 172.21.15.26:0/3663434872 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x556fdcdd25b0 0x556fdcda7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:24.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.394+0000 7f7ca37fe700 1 -- 172.21.15.26:0/3663434872 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556fdccf6f70 con 0x556fdcda8a40 2023-10-01T07:52:24.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.394+0000 7f7ca8b79700 1 --2- 172.21.15.26:0/3663434872 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x556fdcdd25b0 0x556fdcda7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:24.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.394+0000 7f7ca37fe700 1 --2- 172.21.15.26:0/3663434872 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fdcda8a40 0x556fdcdd0650 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f7c8c02bc00 tx=0x7f7c8c021000).ready entity=mon.0 client_cookie=9b8df0c1993d492f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:24.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.394+0000 7f7c99ffb700 1 -- 172.21.15.26:0/3663434872 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c003de0 con 0x556fdcda8a40 2023-10-01T07:52:24.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.394+0000 7f7c99ffb700 1 -- 172.21.15.26:0/3663434872 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8c0079f0 con 0x556fdcda8a40 2023-10-01T07:52:24.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.394+0000 7f7c99ffb700 1 -- 172.21.15.26:0/3663434872 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c02bc80 con 0x556fdcda8a40 2023-10-01T07:52:24.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.395+0000 7f7cbbf8fb80 1 -- 172.21.15.26:0/3663434872 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fdcda8a40 msgr2=0x556fdcdd0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:24.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.395+0000 7f7cbbf8fb80 1 --2- 172.21.15.26:0/3663434872 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fdcda8a40 0x556fdcdd0650 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f7c8c02bc00 tx=0x7f7c8c021000).stop 2023-10-01T07:52:24.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.395+0000 7f7cbbf8fb80 1 -- 172.21.15.26:0/3663434872 shutdown_connections 2023-10-01T07:52:24.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.395+0000 7f7cbbf8fb80 1 --2- 172.21.15.26:0/3663434872 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x556fdcdd25b0 0x556fdcda7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:24.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.395+0000 7f7cbbf8fb80 1 --2- 172.21.15.26:0/3663434872 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x556fdcda8170 0x556fdcdac570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:24.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.395+0000 7f7cbbf8fb80 1 --2- 172.21.15.26:0/3663434872 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fdcda8a40 0x556fdcdd0650 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:24.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.395+0000 7f7cbbf8fb80 1 -- 172.21.15.26:0/3663434872 >> 172.21.15.26:0/3663434872 conn(0x556fdcc16940 msgr2=0x556fdcda4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:24.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.395+0000 7f7cbbf8fb80 1 -- 172.21.15.26:0/3663434872 shutdown_connections 2023-10-01T07:52:24.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.395+0000 7f7cbbf8fb80 1 -- 172.21.15.26:0/3663434872 wait complete. 2023-10-01T07:52:24.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.395+0000 7f7cbbf8fb80 1 -- start start 2023-10-01T07:52:24.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.396+0000 7f7cbbf8fb80 1 Processor -- start 2023-10-01T07:52:24.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.396+0000 7f7cbbf8fb80 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x556fdcda8170 0x556fdcdccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:24.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.396+0000 7f7cbbf8fb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fdcda8a40 0x556fdcdcd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:24.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.396+0000 7f7cbbf8fb80 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x556fdcdd25b0 0x556fdce2c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-01T07:52:24.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.396+0000 7f7cbbf8fb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fdce0fe10 con 0x556fdcda8a40 2023-10-01T07:52:24.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.396+0000 7f7cbbf8fb80 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x556fdcdac780 con 0x556fdcda8170 2023-10-01T07:52:24.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.396+0000 7f7cbbf8fb80 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x556fdcddecb0 con 0x556fdcdd25b0 2023-10-01T07:52:24.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.396+0000 7f7cbbf8fb80 10 client.0 ll_register_callbacks cb 0x556fdcc9ece0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-01T07:52:24.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.396+0000 7f7ca3fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x556fdcda8170 0x556fdcdccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:24.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.396+0000 7f7ca37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fdcda8a40 0x556fdcdcd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:24.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.396+0000 7f7ca37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fdcda8a40 0x556fdcdcd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52388/0 (socket says 172.21.15.26:52388) 2023-10-01T07:52:24.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.396+0000 7f7ca3fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x556fdcda8170 0x556fdcdccc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:40498/0 (socket says 172.21.15.26:40498) 2023-10-01T07:52:24.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.396+0000 7f7ca37fe700 1 -- 172.21.15.26:0/616047918 learned_addr learned my addr 172.21.15.26:0/616047918 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:52:24.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.396+0000 7f7ca8b79700 1 --2- 172.21.15.26:0/616047918 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x556fdcdd25b0 0x556fdce2c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-01T07:52:24.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.397+0000 7f7ca37fe700 1 -- 172.21.15.26:0/616047918 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x556fdcdd25b0 msgr2=0x556fdce2c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:24.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.397+0000 7f7ca37fe700 1 --2- 172.21.15.26:0/616047918 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x556fdcdd25b0 0x556fdce2c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:24.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.397+0000 7f7ca37fe700 1 -- 172.21.15.26:0/616047918 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x556fdcda8170 msgr2=0x556fdcdccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:52:24.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.397+0000 7f7ca37fe700 1 --2- 172.21.15.26:0/616047918 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x556fdcda8170 0x556fdcdccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:24.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.397+0000 7f7ca37fe700 1 -- 172.21.15.26:0/616047918 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c9c00ea10 con 0x556fdcda8a40 2023-10-01T07:52:24.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.397+0000 7f7ca3fff700 1 --2- 172.21.15.26:0/616047918 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x556fdcda8170 0x556fdcdccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:24.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.397+0000 7f7ca8b79700 1 --2- 172.21.15.26:0/616047918 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x556fdcdd25b0 0x556fdce2c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:52:24.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.397+0000 7f7ca37fe700 1 --2- 172.21.15.26:0/616047918 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fdcda8a40 0x556fdcdcd100 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f7c8c0077b0 tx=0x7f7c8c032000).ready entity=mon.0 client_cookie=469caa7d14888e29 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:52:24.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.397+0000 7f7c827fc700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-01T07:52:24.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.397+0000 7f7c827fc700 1 -- 172.21.15.26:0/616047918 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c03a070 con 0x556fdcda8a40 2023-10-01T07:52:24.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.397+0000 7f7c827fc700 1 -- 172.21.15.26:0/616047918 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f7c8c02b840 con 0x556fdcda8a40 2023-10-01T07:52:24.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.397+0000 7f7cbbf8fb80 1 -- 172.21.15.26:0/616047918 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7c8c011a60 con 0x556fdcda8a40 2023-10-01T07:52:24.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.397+0000 7f7c827fc700 1 -- 172.21.15.26:0/616047918 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c8c016240 con 0x556fdcda8a40 2023-10-01T07:52:24.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.397+0000 7f7cbbf8fb80 10 client.4761 fetch_fsmap learned FSMap version 8 2023-10-01T07:52:24.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.397+0000 7f7cbbf8fb80 1 -- 172.21.15.26:0/616047918 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x556fdccd0b00 con 0x556fdcda8a40 2023-10-01T07:52:24.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.397+0000 7f7c827fc700 1 -- 172.21.15.26:0/616047918 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8c011a60 con 0x556fdcda8a40 2023-10-01T07:52:24.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.397+0000 7f7c827fc700 1 -- 172.21.15.26:0/616047918 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) v1 ==== 1430+0+0 (secure 0 0 0) 0x7f7c8c016d20 con 0x556fdcda8a40 2023-10-01T07:52:24.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.397+0000 7f7cbbf8fb80 10 client.4761 fetch_fsmap finished waiting for FSMap version 8 2023-10-01T07:52:24.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.397+0000 7f7cbbf8fb80 10 client.4761 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-01T07:52:24.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.397+0000 7f7cbbf8fb80 20 client.4761 populate_metadata read hostname 'smithi026' 2023-10-01T07:52:24.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.397+0000 7f7cbbf8fb80 4 client.4761 mds_command: new command op to 4189 tid=0[{"prefix": "status"}] 2023-10-01T07:52:24.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.397+0000 7f7cbbf8fb80 1 -- 172.21.15.26:0/616047918 --> v1:172.21.15.26:6817/2857714939 -- command(tid 0: {"prefix": "status"}) v1 -- 0x556fdcb66ef0 con 0x556fdce2c7e0 2023-10-01T07:52:24.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.398+0000 7f7c827fc700 10 client.4761 ms_handle_connect on v1:172.21.15.26:6817/2857714939 2023-10-01T07:52:24.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.398+0000 7f7c827fc700 1 -- 172.21.15.26:0/616047918 <== mds.0 v1:172.21.15.26:6817/2857714939 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (unknown 0 0 2768366747) 0x556fdcb66ef0 con 0x556fdce2c7e0 2023-10-01T07:52:24.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.398+0000 7f7c827fc700 10 client.4761 handle_command_reply: tid=0 2023-10-01T07:52:24.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.398+0000 7f7cbbf8fb80 1 client.4761 shutdown 2023-10-01T07:52:24.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.398+0000 7f7cbbf8fb80 1 -- 172.21.15.26:0/616047918 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fdcda8a40 msgr2=0x556fdcdcd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:24.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.398+0000 7f7cbbf8fb80 1 --2- 172.21.15.26:0/616047918 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fdcda8a40 0x556fdcdcd100 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f7c8c0077b0 tx=0x7f7c8c032000).stop 2023-10-01T07:52:24.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.398+0000 7f7cbbf8fb80 1 -- 172.21.15.26:0/616047918 shutdown_connections 2023-10-01T07:52:24.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.398+0000 7f7cbbf8fb80 1 --2- 172.21.15.26:0/616047918 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x556fdcdd25b0 0x556fdce2c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:24.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.398+0000 7f7cbbf8fb80 1 --2- 172.21.15.26:0/616047918 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x556fdcda8170 0x556fdcdccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:24.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.398+0000 7f7cbbf8fb80 1 --2- 172.21.15.26:0/616047918 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fdcda8a40 0x556fdcdcd100 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:24.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.398+0000 7f7c827fc700 0 client.4761 ms_handle_reset on v1:172.21.15.26:6817/2857714939 2023-10-01T07:52:24.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.398+0000 7f7cbbf8fb80 1 -- 172.21.15.26:0/616047918 >> 172.21.15.26:0/616047918 conn(0x556fdcc16940 msgr2=0x556fdcda7980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:24.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.398+0000 7f7cbbf8fb80 1 -- 172.21.15.26:0/616047918 shutdown_connections 2023-10-01T07:52:24.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.398+0000 7f7cbbf8fb80 1 -- 172.21.15.26:0/616047918 wait complete. 2023-10-01T07:52:24.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.398+0000 7f7cbbf8fb80 20 client.4761 trim_cache size 0 max 16384 2023-10-01T07:52:24.406 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-01T07:52:24.406 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "c29fb19d-520c-42a6-90f4-e7f86de96e8e", 2023-10-01T07:52:24.406 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2023-10-01T07:52:24.406 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4189, 2023-10-01T07:52:24.406 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2023-10-01T07:52:24.406 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2023-10-01T07:52:24.406 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2023-10-01T07:52:24.406 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 27.101985409000001, 2023-10-01T07:52:24.407 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 8, 2023-10-01T07:52:24.407 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 18, 2023-10-01T07:52:24.407 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 18, 2023-10-01T07:52:24.407 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 32.408832422000003 2023-10-01T07:52:24.407 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-01T07:52:24.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.399+0000 7f7caa5dc700 1 -- 172.21.15.26:0/65591236 >> v1:172.21.15.26:6816/118178 conn(0x7f7c8402bb60 legacy=0x7f7c8402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:24.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.399+0000 7f7caa5dc700 1 -- 172.21.15.26:0/65591236 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7ca4059070 msgr2=0x7f7ca4117d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:52:24.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.399+0000 7f7caa5dc700 1 --2- 172.21.15.26:0/65591236 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7ca4059070 0x7f7ca4117d70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f7c94008000 tx=0x7f7c94017000).stop 2023-10-01T07:52:24.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.399+0000 7f7caa5dc700 1 -- 172.21.15.26:0/65591236 shutdown_connections 2023-10-01T07:52:24.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.399+0000 7f7caa5dc700 1 --2- 172.21.15.26:0/65591236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ca4127d80 0x7f7ca41142c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:24.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.399+0000 7f7caa5dc700 1 --2- 172.21.15.26:0/65591236 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7ca4059070 0x7f7ca4117d70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:24.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.399+0000 7f7caa5dc700 1 --2- 172.21.15.26:0/65591236 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7ca4127390 0x7f7ca4113dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-01T07:52:24.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.399+0000 7f7caa5dc700 1 -- 172.21.15.26:0/65591236 >> 172.21.15.26:0/65591236 conn(0x7f7ca4097470 msgr2=0x7f7ca4094470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:52:24.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.399+0000 7f7caa5dc700 1 -- 172.21.15.26:0/65591236 shutdown_connections 2023-10-01T07:52:24.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:52:24.399+0000 7f7caa5dc700 1 -- 172.21.15.26:0/65591236 wait complete. 2023-10-01T07:52:24.412 INFO:teuthology.run_tasks:Running task print... 2023-10-01T07:52:24.426 INFO:teuthology.task.print:**** done mds pre-upgrade sequence 2023-10-01T07:52:24.426 INFO:teuthology.run_tasks:Running task install.upgrade... 2023-10-01T07:52:24.456 INFO:teuthology.task.install:project ceph config {'mon.a': {'branch': 'reef'}} overrides {'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'} 2023-10-01T07:52:24.456 INFO:teuthology.task.install:config contains sha1|tag|branch, removing those keys from override 2023-10-01T07:52:24.456 INFO:teuthology.task.install:remote ubuntu@smithi026.front.sepia.ceph.com config {'branch': 'reef', 'flavor': 'default'} 2023-10-01T07:52:24.456 INFO:teuthology.task.install:extra packages: [] 2023-10-01T07:52:24.461 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-01T07:52:24.462 INFO:teuthology.task.install:Upgrading ceph rpm packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd 2023-10-01T07:52:24.462 DEBUG:teuthology.orchestra.run.smithi026:> rpm -q ceph-common --qf '%{VERSION}-%{RELEASE}' 2023-10-01T07:52:24.488 INFO:teuthology.orchestra.run.smithi026.stdout:16.2.14-44.geeb13ac9.el8 2023-10-01T07:52:24.488 INFO:teuthology.packaging:The installed version of ceph-common is 16.2.14-44.geeb13ac9.el8 2023-10-01T07:52:24.489 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2023-10-01T07:52:24.712 INFO:teuthology.task.install:Ceph rpm upgrade from 16.2.14-44.geeb13ac9.el8 to 18.2.0-501.gfc1e90a3 2023-10-01T07:52:24.713 INFO:teuthology.task.install.rpm:Host smithi026 is: centos 8 x86_64 2023-10-01T07:52:24.713 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2023-10-01T07:52:25.029 INFO:teuthology.task.install.rpm:Repo base URL: https://3.chacra.ceph.com/r/ceph/reef/fc1e90a395a6a5631142eb70fd9bf3d22740a9da/centos/8/flavors/default/ 2023-10-01T07:52:25.029 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f /etc/yum.repos.d/ceph.repo 2023-10-01T07:52:25.182 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/fc1e90a395a6a5631142eb70fd9bf3d22740a9da/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/fc1e90a395a6a5631142eb70fd9bf3d22740a9da/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/fc1e90a395a6a5631142eb70fd9bf3d22740a9da/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-01T07:52:25.183 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-10-01T07:52:25.183 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-01T07:52:25.218 DEBUG:teuthology.orchestra.run.smithi026:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-01T07:52:25.295 DEBUG:teuthology.orchestra.run.smithi026:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-01T07:52:25.371 DEBUG:teuthology.orchestra.run.smithi026:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-01T07:52:25.434 INFO:teuthology.orchestra.run.smithi026.stdout:check_obsoletes = 1 2023-10-01T07:52:25.448 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum clean all 2023-10-01T07:52:25.757 INFO:teuthology.orchestra.run.smithi026.stdout:71 files removed 2023-10-01T07:52:25.790 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y upgrade ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd 2023-10-01T07:52:26.666 INFO:teuthology.orchestra.run.smithi026.stdout:ceph packages for x86_64 204 kB/s | 80 kB 00:00 2023-10-01T07:52:27.050 INFO:teuthology.orchestra.run.smithi026.stdout:ceph noarch packages 28 kB/s | 9.4 kB 00:00 2023-10-01T07:52:27.384 INFO:teuthology.orchestra.run.smithi026.stdout:ceph source packages 5.0 kB/s | 1.5 kB 00:00 2023-10-01T07:52:29.292 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 8 - AppStream 18 MB/s | 33 MB 00:01 2023-10-01T07:52:38.067 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 8 - BaseOS 23 MB/s | 48 MB 00:02 2023-10-01T07:52:46.184 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 8 - Extras 40 kB/s | 18 kB 00:00 2023-10-01T07:52:46.819 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 8 - Extras common packages 16 kB/s | 6.9 kB 00:00 2023-10-01T07:52:48.512 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 8 - PowerTools 4.3 MB/s | 6.5 MB 00:01 2023-10-01T07:52:50.047 INFO:teuthology.orchestra.run.smithi026.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-10-01T07:52:50.939 INFO:teuthology.orchestra.run.smithi026.stdout:Extra Packages for Enterprise Linux 22 MB/s | 16 MB 00:00 2023-10-01T07:52:55.272 INFO:teuthology.orchestra.run.smithi026.stdout:lab-extras 430 kB/s | 24 kB 00:00 2023-10-01T07:52:59.949 INFO:teuthology.orchestra.run.smithi026.stderr:Package cephadm available, but not installed. 2023-10-01T07:52:59.949 INFO:teuthology.orchestra.run.smithi026.stdout:No match for argument: cephadm 2023-10-01T07:52:59.949 INFO:teuthology.orchestra.run.smithi026.stderr:Package ceph-immutable-object-cache available, but not installed. 2023-10-01T07:52:59.950 INFO:teuthology.orchestra.run.smithi026.stdout:No match for argument: ceph-immutable-object-cache 2023-10-01T07:52:59.964 INFO:teuthology.orchestra.run.smithi026.stderr:Package ceph-mgr-cephadm available, but not installed. 2023-10-01T07:52:59.964 INFO:teuthology.orchestra.run.smithi026.stdout:No match for argument: ceph-mgr-cephadm 2023-10-01T07:52:59.968 INFO:teuthology.orchestra.run.smithi026.stderr:Package ceph-volume available, but not installed. 2023-10-01T07:52:59.969 INFO:teuthology.orchestra.run.smithi026.stdout:No match for argument: ceph-volume 2023-10-01T07:53:00.278 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2023-10-01T07:53:00.284 INFO:teuthology.orchestra.run.smithi026.stdout:====================================================================================== 2023-10-01T07:53:00.284 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2023-10-01T07:53:00.284 INFO:teuthology.orchestra.run.smithi026.stdout:====================================================================================== 2023-10-01T07:53:00.284 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrading: 2023-10-01T07:53:00.284 INFO:teuthology.orchestra.run.smithi026.stdout: ceph x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 6.4 k 2023-10-01T07:53:00.284 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 5.4 M 2023-10-01T07:53:00.284 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-common x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 22 M 2023-10-01T07:53:00.284 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-fuse x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 847 k 2023-10-01T07:53:00.284 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-grafana-dashboards noarch 2:18.2.0-501.gfc1e90a3.el8 ceph-noarch 23 k 2023-10-01T07:53:00.284 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mds x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 2.3 M 2023-10-01T07:53:00.285 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 1.5 M 2023-10-01T07:53:00.285 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-dashboard noarch 2:18.2.0-501.gfc1e90a3.el8 ceph-noarch 1.7 M 2023-10-01T07:53:00.285 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-501.gfc1e90a3.el8 ceph-noarch 7.4 M 2023-10-01T07:53:00.285 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-modules-core noarch 2:18.2.0-501.gfc1e90a3.el8 ceph-noarch 241 k 2023-10-01T07:53:00.285 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-rook noarch 2:18.2.0-501.gfc1e90a3.el8 ceph-noarch 47 k 2023-10-01T07:53:00.285 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mon x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 4.6 M 2023-10-01T07:53:00.285 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-osd x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 18 M 2023-10-01T07:53:00.285 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-prometheus-alerts noarch 2:18.2.0-501.gfc1e90a3.el8 ceph-noarch 15 k 2023-10-01T07:53:00.285 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-radosgw x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 13 M 2023-10-01T07:53:00.285 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-selinux x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 24 k 2023-10-01T07:53:00.285 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-test x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 47 M 2023-10-01T07:53:00.285 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs-devel x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 30 k 2023-10-01T07:53:00.286 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs2 x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 769 k 2023-10-01T07:53:00.286 INFO:teuthology.orchestra.run.smithi026.stdout: libcephsqlite x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 137 k 2023-10-01T07:53:00.286 INFO:teuthology.orchestra.run.smithi026.stdout: librados-devel x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 139 k 2023-10-01T07:53:00.286 INFO:teuthology.orchestra.run.smithi026.stdout: librados2 x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 3.7 M 2023-10-01T07:53:00.286 INFO:teuthology.orchestra.run.smithi026.stdout: libradosstriper1 x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 474 k 2023-10-01T07:53:00.286 INFO:teuthology.orchestra.run.smithi026.stdout: librbd1 x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 3.6 M 2023-10-01T07:53:00.286 INFO:teuthology.orchestra.run.smithi026.stdout: librgw2 x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 6.5 M 2023-10-01T07:53:00.286 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-argparse x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 45 k 2023-10-01T07:53:00.286 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-common x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 123 k 2023-10-01T07:53:00.286 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cephfs x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 190 k 2023-10-01T07:53:00.287 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 371 k 2023-10-01T07:53:00.287 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rbd x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 364 k 2023-10-01T07:53:00.287 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rgw x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 107 k 2023-10-01T07:53:00.287 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-fuse x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 94 k 2023-10-01T07:53:00.287 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-mirror x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 3.4 M 2023-10-01T07:53:00.287 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-nbd x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 179 k 2023-10-01T07:53:00.287 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2023-10-01T07:53:00.287 INFO:teuthology.orchestra.run.smithi026.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-01T07:53:00.287 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:53:00.287 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2023-10-01T07:53:00.287 INFO:teuthology.orchestra.run.smithi026.stdout:====================================================================================== 2023-10-01T07:53:00.287 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2023-10-01T07:53:00.287 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrade 34 Packages 2023-10-01T07:53:00.288 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:53:00.288 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 145 M 2023-10-01T07:53:00.288 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2023-10-01T07:53:00.591 INFO:teuthology.orchestra.run.smithi026.stdout:(1/35): ceph-18.2.0-501.gfc1e90a3.el8.x86_64.rp 49 kB/s | 6.4 kB 00:00 2023-10-01T07:53:00.950 INFO:teuthology.orchestra.run.smithi026.stdout:(2/35): thrift-0.13.0-2.el8.x86_64.rpm 3.5 MB/s | 1.7 MB 00:00 2023-10-01T07:53:01.375 INFO:teuthology.orchestra.run.smithi026.stdout:(3/35): ceph-fuse-18.2.0-501.gfc1e90a3.el8.x86_ 1.9 MB/s | 847 kB 00:00 2023-10-01T07:53:01.525 INFO:teuthology.orchestra.run.smithi026.stdout:(4/35): ceph-base-18.2.0-501.gfc1e90a3.el8.x86_ 5.1 MB/s | 5.4 MB 00:01 2023-10-01T07:53:01.717 INFO:teuthology.orchestra.run.smithi026.stdout:(5/35): ceph-mgr-18.2.0-501.gfc1e90a3.el8.x86_6 8.1 MB/s | 1.5 MB 00:00 2023-10-01T07:53:01.967 INFO:teuthology.orchestra.run.smithi026.stdout:(6/35): ceph-mds-18.2.0-501.gfc1e90a3.el8.x86_6 3.9 MB/s | 2.3 MB 00:00 2023-10-01T07:53:02.209 INFO:teuthology.orchestra.run.smithi026.stdout:(7/35): ceph-mon-18.2.0-501.gfc1e90a3.el8.x86_6 9.4 MB/s | 4.6 MB 00:00 2023-10-01T07:53:02.952 INFO:teuthology.orchestra.run.smithi026.stdout:(8/35): ceph-common-18.2.0-501.gfc1e90a3.el8.x8 9.2 MB/s | 22 MB 00:02 2023-10-01T07:53:03.018 INFO:teuthology.orchestra.run.smithi026.stdout:(9/35): ceph-selinux-18.2.0-501.gfc1e90a3.el8.x 366 kB/s | 24 kB 00:00 2023-10-01T07:53:03.344 INFO:teuthology.orchestra.run.smithi026.stdout:(10/35): ceph-radosgw-18.2.0-501.gfc1e90a3.el8. 11 MB/s | 13 MB 00:01 2023-10-01T07:53:03.411 INFO:teuthology.orchestra.run.smithi026.stdout:(11/35): libcephfs-devel-18.2.0-501.gfc1e90a3.e 460 kB/s | 30 kB 00:00 2023-10-01T07:53:03.586 INFO:teuthology.orchestra.run.smithi026.stdout:(12/35): libcephfs2-18.2.0-501.gfc1e90a3.el8.x8 4.3 MB/s | 769 kB 00:00 2023-10-01T07:53:03.661 INFO:teuthology.orchestra.run.smithi026.stdout:(13/35): libcephsqlite-18.2.0-501.gfc1e90a3.el8 1.8 MB/s | 137 kB 00:00 2023-10-01T07:53:03.770 INFO:teuthology.orchestra.run.smithi026.stdout:(14/35): librados-devel-18.2.0-501.gfc1e90a3.el 1.3 MB/s | 139 kB 00:00 2023-10-01T07:53:04.304 INFO:teuthology.orchestra.run.smithi026.stdout:(15/35): ceph-osd-18.2.0-501.gfc1e90a3.el8.x86_ 7.6 MB/s | 18 MB 00:02 2023-10-01T07:53:04.362 INFO:teuthology.orchestra.run.smithi026.stdout:(16/35): librados2-18.2.0-501.gfc1e90a3.el8.x86 6.2 MB/s | 3.7 MB 00:00 2023-10-01T07:53:04.438 INFO:teuthology.orchestra.run.smithi026.stdout:(17/35): libradosstriper1-18.2.0-501.gfc1e90a3. 3.5 MB/s | 474 kB 00:00 2023-10-01T07:53:04.746 INFO:teuthology.orchestra.run.smithi026.stdout:(18/35): librbd1-18.2.0-501.gfc1e90a3.el8.x86_6 9.3 MB/s | 3.6 MB 00:00 2023-10-01T07:53:04.805 INFO:teuthology.orchestra.run.smithi026.stdout:(19/35): python3-ceph-argparse-18.2.0-501.gfc1e 771 kB/s | 45 kB 00:00 2023-10-01T07:53:05.013 INFO:teuthology.orchestra.run.smithi026.stdout:(20/35): python3-ceph-common-18.2.0-501.gfc1e90 593 kB/s | 123 kB 00:00 2023-10-01T07:53:05.094 INFO:teuthology.orchestra.run.smithi026.stdout:(21/35): python3-cephfs-18.2.0-501.gfc1e90a3.el 2.3 MB/s | 190 kB 00:00 2023-10-01T07:53:05.164 INFO:teuthology.orchestra.run.smithi026.stdout:(22/35): python3-rados-18.2.0-501.gfc1e90a3.el8 5.2 MB/s | 371 kB 00:00 2023-10-01T07:53:05.256 INFO:teuthology.orchestra.run.smithi026.stdout:(23/35): librgw2-18.2.0-501.gfc1e90a3.el8.x86_6 8.0 MB/s | 6.5 MB 00:00 2023-10-01T07:53:05.282 INFO:teuthology.orchestra.run.smithi026.stdout:(24/35): python3-rbd-18.2.0-501.gfc1e90a3.el8.x 3.0 MB/s | 364 kB 00:00 2023-10-01T07:53:05.349 INFO:teuthology.orchestra.run.smithi026.stdout:(25/35): python3-rgw-18.2.0-501.gfc1e90a3.el8.x 1.1 MB/s | 107 kB 00:00 2023-10-01T07:53:05.691 INFO:teuthology.orchestra.run.smithi026.stdout:(26/35): rbd-fuse-18.2.0-501.gfc1e90a3.el8.x86_ 231 kB/s | 94 kB 00:00 2023-10-01T07:53:05.766 INFO:teuthology.orchestra.run.smithi026.stdout:(27/35): rbd-nbd-18.2.0-501.gfc1e90a3.el8.x86_6 2.3 MB/s | 179 kB 00:00 2023-10-01T07:53:05.858 INFO:teuthology.orchestra.run.smithi026.stdout:(28/35): rbd-mirror-18.2.0-501.gfc1e90a3.el8.x8 6.8 MB/s | 3.4 MB 00:00 2023-10-01T07:53:05.883 INFO:teuthology.orchestra.run.smithi026.stdout:(29/35): ceph-grafana-dashboards-18.2.0-501.gfc 198 kB/s | 23 kB 00:00 2023-10-01T07:53:06.100 INFO:teuthology.orchestra.run.smithi026.stdout:(30/35): ceph-mgr-dashboard-18.2.0-501.gfc1e90a 7.2 MB/s | 1.7 MB 00:00 2023-10-01T07:53:06.342 INFO:teuthology.orchestra.run.smithi026.stdout:(31/35): ceph-mgr-modules-core-18.2.0-501.gfc1e 1.0 MB/s | 241 kB 00:00 2023-10-01T07:53:06.418 INFO:teuthology.orchestra.run.smithi026.stdout:(32/35): ceph-mgr-rook-18.2.0-501.gfc1e90a3.el8 633 kB/s | 47 kB 00:00 2023-10-01T07:53:06.485 INFO:teuthology.orchestra.run.smithi026.stdout:(33/35): ceph-prometheus-alerts-18.2.0-501.gfc1 221 kB/s | 15 kB 00:00 2023-10-01T07:53:06.618 INFO:teuthology.orchestra.run.smithi026.stdout:(34/35): ceph-mgr-diskprediction-local-18.2.0-5 10 MB/s | 7.4 MB 00:00 2023-10-01T07:53:07.385 INFO:teuthology.orchestra.run.smithi026.stdout:(35/35): ceph-test-18.2.0-501.gfc1e90a3.el8.x86 11 MB/s | 47 MB 00:04 2023-10-01T07:53:07.388 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2023-10-01T07:53:07.388 INFO:teuthology.orchestra.run.smithi026.stdout:Total 20 MB/s | 145 MB 00:07 2023-10-01T07:53:07.389 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2023-10-01T07:53:07.469 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2023-10-01T07:53:07.469 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2023-10-01T07:53:08.197 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2023-10-01T07:53:08.201 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2023-10-01T07:53:10.812 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2023-10-01T07:53:11.014 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-10-01T07:53:11.725 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/69 2023-10-01T07:53:11.968 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : librados2-2:18.2.0-501.gfc1e90a3.el8.x86_64 2/69 2023-10-01T07:53:12.395 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librados2-2:18.2.0-501.gfc1e90a3.el8.x86_64 2/69 2023-10-01T07:53:12.560 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : librbd1-2:18.2.0-501.gfc1e90a3.el8.x86_64 3/69 2023-10-01T07:53:12.724 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librbd1-2:18.2.0-501.gfc1e90a3.el8.x86_64 3/69 2023-10-01T07:53:12.926 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : libcephfs2-2:18.2.0-501.gfc1e90a3.el8.x86_64 4/69 2023-10-01T07:53:13.782 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephfs2-2:18.2.0-501.gfc1e90a3.el8.x86_64 4/69 2023-10-01T07:53:14.018 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : librgw2-2:18.2.0-501.gfc1e90a3.el8.x86_64 5/69 2023-10-01T07:53:14.136 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librgw2-2:18.2.0-501.gfc1e90a3.el8.x86_64 5/69 2023-10-01T07:53:14.365 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : python3-rados-2:18.2.0-501.gfc1e90a3.el8.x86_64 6/69 2023-10-01T07:53:14.559 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : libcephsqlite-2:18.2.0-501.gfc1e90a3.el8.x86_64 7/69 2023-10-01T07:53:14.670 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephsqlite-2:18.2.0-501.gfc1e90a3.el8.x86_64 7/69 2023-10-01T07:53:14.879 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : libradosstriper1-2:18.2.0-501.gfc1e90a3.el8.x86_64 8/69 2023-10-01T07:53:14.948 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libradosstriper1-2:18.2.0-501.gfc1e90a3.el8.x86_64 8/69 2023-10-01T07:53:15.140 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : python3-ceph-argparse-2:18.2.0-501.gfc1e90a3.el8.x 9/69 2023-10-01T07:53:15.400 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : python3-cephfs-2:18.2.0-501.gfc1e90a3.el8.x86_64 10/69 2023-10-01T07:53:15.640 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : python3-rbd-2:18.2.0-501.gfc1e90a3.el8.x86_64 11/69 2023-10-01T07:53:15.885 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : python3-rgw-2:18.2.0-501.gfc1e90a3.el8.x86_64 12/69 2023-10-01T07:53:16.404 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : librados-devel-2:18.2.0-501.gfc1e90a3.el8.x86_64 13/69 2023-10-01T07:53:16.506 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : ceph-prometheus-alerts-2:18.2.0-501.gfc1e90a3.el8. 14/69 2023-10-01T07:53:16.724 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : ceph-grafana-dashboards-2:18.2.0-501.gfc1e90a3.el8 15/69 2023-10-01T07:53:16.952 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : python3-ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86 16/69 2023-10-01T07:53:19.536 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86_64 17/69 2023-10-01T07:53:19.818 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86_64 17/69 2023-10-01T07:53:20.512 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86_64 17/69 2023-10-01T07:53:21.032 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : ceph-base-2:18.2.0-501.gfc1e90a3.el8.x86_64 18/69 2023-10-01T07:53:21.090 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-base-2:18.2.0-501.gfc1e90a3.el8.x86_64 18/69 2023-10-01T07:53:21.283 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : ceph-selinux-2:18.2.0-501.gfc1e90a3.el8.x86_64 19/69 2023-10-01T07:53:41.618 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-selinux-2:18.2.0-501.gfc1e90a3.el8.x86_64 19/69 2023-10-01T07:53:41.853 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : ceph-mgr-dashboard-2:18.2.0-501.gfc1e90a3.el8.noar 20/69 2023-10-01T07:53:43.169 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-501.gfc1e90a3.el8.noar 20/69 2023-10-01T07:53:43.380 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : ceph-mgr-diskprediction-local-2:18.2.0-501.gfc1e90 21/69 2023-10-01T07:53:43.488 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-501.gfc1e90 21/69 2023-10-01T07:53:43.993 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : ceph-mgr-modules-core-2:18.2.0-501.gfc1e90a3.el8.n 22/69 2023-10-01T07:53:44.245 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : ceph-mgr-2:18.2.0-501.gfc1e90a3.el8.x86_64 23/69 2023-10-01T07:53:44.273 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-2:18.2.0-501.gfc1e90a3.el8.x86_64 23/69 2023-10-01T07:53:44.463 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : ceph-mgr-rook-2:18.2.0-501.gfc1e90a3.el8.noarch 24/69 2023-10-01T07:53:44.691 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-501.gfc1e90a3.el8.noarch 24/69 2023-10-01T07:53:44.939 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : ceph-mds-2:18.2.0-501.gfc1e90a3.el8.x86_64 25/69 2023-10-01T07:53:45.552 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mds-2:18.2.0-501.gfc1e90a3.el8.x86_64 25/69 2023-10-01T07:53:45.830 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : ceph-mon-2:18.2.0-501.gfc1e90a3.el8.x86_64 26/69 2023-10-01T07:53:47.789 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mon-2:18.2.0-501.gfc1e90a3.el8.x86_64 26/69 2023-10-01T07:53:48.252 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : ceph-osd-2:18.2.0-501.gfc1e90a3.el8.x86_64 27/69 2023-10-01T07:53:48.266 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-osd-2:18.2.0-501.gfc1e90a3.el8.x86_64 27/69 2023-10-01T07:53:49.885 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : ceph-2:18.2.0-501.gfc1e90a3.el8.x86_64 28/69 2023-10-01T07:53:50.302 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : ceph-radosgw-2:18.2.0-501.gfc1e90a3.el8.x86_64 29/69 2023-10-01T07:53:50.746 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-501.gfc1e90a3.el8.x86_64 29/69 2023-10-01T07:53:50.996 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : rbd-mirror-2:18.2.0-501.gfc1e90a3.el8.x86_64 30/69 2023-10-01T07:53:56.487 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: rbd-mirror-2:18.2.0-501.gfc1e90a3.el8.x86_64 30/69 2023-10-01T07:53:56.834 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : ceph-test-2:18.2.0-501.gfc1e90a3.el8.x86_64 31/69 2023-10-01T07:53:57.047 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : libcephfs-devel-2:18.2.0-501.gfc1e90a3.el8.x86_64 32/69 2023-10-01T07:53:57.271 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : rbd-fuse-2:18.2.0-501.gfc1e90a3.el8.x86_64 33/69 2023-10-01T07:53:57.577 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : rbd-nbd-2:18.2.0-501.gfc1e90a3.el8.x86_64 34/69 2023-10-01T07:53:57.846 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : ceph-fuse-2:18.2.0-501.gfc1e90a3.el8.x86_64 35/69 2023-10-01T07:53:57.974 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 36/69 2023-10-01T07:53:58.245 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 37/69 2023-10-01T07:53:58.255 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 38/69 2023-10-01T07:53:58.255 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 38/69 2023-10-01T07:53:58.552 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 38/69 2023-10-01T07:53:58.738 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 39/69 2023-10-01T07:53:58.738 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 40/69 2023-10-01T07:53:59.055 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 40/69 2023-10-01T07:53:59.062 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 41/69 2023-10-01T07:53:59.063 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 41/69 2023-10-01T07:53:59.299 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 41/69 2023-10-01T07:53:59.518 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.n 42/69 2023-10-01T07:53:59.737 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 43/69 2023-10-01T07:53:59.744 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 44/69 2023-10-01T07:53:59.745 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 44/69 2023-10-01T07:53:59.996 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 44/69 2023-10-01T07:54:00.137 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 45/69 2023-10-01T07:54:00.137 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 46/69 2023-10-01T07:54:00.363 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 46/69 2023-10-01T07:54:00.545 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 47/69 2023-10-01T07:54:00.554 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 48/69 2023-10-01T07:54:00.554 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 48/69 2023-10-01T07:54:00.989 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 48/69 2023-10-01T07:54:00.990 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noar 49/69 2023-10-01T07:54:01.269 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noar 49/69 2023-10-01T07:54:01.276 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 50/69 2023-10-01T07:54:01.277 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 50/69 2023-10-01T07:54:01.454 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 50/69 2023-10-01T07:54:01.462 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-10-01T07:54:01.463 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-10-01T07:54:01.662 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-10-01T07:54:01.663 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 52/69 2023-10-01T07:54:01.797 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 52/69 2023-10-01T07:54:01.828 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-10-01T07:54:01.828 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-10-01T07:54:02.181 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-10-01T07:54:02.181 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 54/69 2023-10-01T07:54:02.404 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 54/69 2023-10-01T07:54:02.404 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 55/69 2023-10-01T07:54:02.646 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 55/69 2023-10-01T07:54:02.853 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 56/69 2023-10-01T07:54:03.066 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 57/69 2023-10-01T07:54:03.066 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 58/69 2023-10-01T07:54:03.346 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 58/69 2023-10-01T07:54:03.542 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 59/69 2023-10-01T07:54:03.542 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 60/69 2023-10-01T07:54:03.804 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 60/69 2023-10-01T07:54:04.001 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 61/69 2023-10-01T07:54:04.002 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 62/69 2023-10-01T07:54:04.305 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 62/69 2023-10-01T07:54:04.444 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 63/69 2023-10-01T07:54:04.588 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x 64/69 2023-10-01T07:54:04.794 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86 65/69 2023-10-01T07:54:04.919 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8 66/69 2023-10-01T07:54:05.055 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8. 67/69 2023-10-01T07:54:05.055 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13a 68/69 2023-10-01T07:54:05.229 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13a 68/69 2023-10-01T07:54:05.230 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 69/69 2023-10-01T07:54:06.082 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 69/69 2023-10-01T07:54:06.083 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 1/69 2023-10-01T07:54:06.083 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-2:18.2.0-501.gfc1e90a3.el8.x86_64 2/69 2023-10-01T07:54:06.083 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 3/69 2023-10-01T07:54:06.083 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-base-2:18.2.0-501.gfc1e90a3.el8.x86_64 4/69 2023-10-01T07:54:06.084 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 5/69 2023-10-01T07:54:06.084 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86_64 6/69 2023-10-01T07:54:06.084 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 7/69 2023-10-01T07:54:06.084 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-fuse-2:18.2.0-501.gfc1e90a3.el8.x86_64 8/69 2023-10-01T07:54:06.084 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 9/69 2023-10-01T07:54:06.084 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mds-2:18.2.0-501.gfc1e90a3.el8.x86_64 10/69 2023-10-01T07:54:06.084 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 11/69 2023-10-01T07:54:06.084 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-2:18.2.0-501.gfc1e90a3.el8.x86_64 12/69 2023-10-01T07:54:06.084 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 13/69 2023-10-01T07:54:06.084 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mon-2:18.2.0-501.gfc1e90a3.el8.x86_64 14/69 2023-10-01T07:54:06.085 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 15/69 2023-10-01T07:54:06.085 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-osd-2:18.2.0-501.gfc1e90a3.el8.x86_64 16/69 2023-10-01T07:54:06.085 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 17/69 2023-10-01T07:54:06.085 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-radosgw-2:18.2.0-501.gfc1e90a3.el8.x86_64 18/69 2023-10-01T07:54:06.085 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 19/69 2023-10-01T07:54:06.085 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-selinux-2:18.2.0-501.gfc1e90a3.el8.x86_64 20/69 2023-10-01T07:54:06.085 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 21/69 2023-10-01T07:54:06.085 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-test-2:18.2.0-501.gfc1e90a3.el8.x86_64 22/69 2023-10-01T07:54:06.085 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 23/69 2023-10-01T07:54:06.085 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephfs-devel-2:18.2.0-501.gfc1e90a3.el8.x86_64 24/69 2023-10-01T07:54:06.085 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 25/69 2023-10-01T07:54:06.086 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephfs2-2:18.2.0-501.gfc1e90a3.el8.x86_64 26/69 2023-10-01T07:54:06.086 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 27/69 2023-10-01T07:54:06.086 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephsqlite-2:18.2.0-501.gfc1e90a3.el8.x86_64 28/69 2023-10-01T07:54:06.086 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 29/69 2023-10-01T07:54:06.086 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados-devel-2:18.2.0-501.gfc1e90a3.el8.x86_64 30/69 2023-10-01T07:54:06.086 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 31/69 2023-10-01T07:54:06.086 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados2-2:18.2.0-501.gfc1e90a3.el8.x86_64 32/69 2023-10-01T07:54:06.086 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 33/69 2023-10-01T07:54:06.086 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libradosstriper1-2:18.2.0-501.gfc1e90a3.el8.x86_64 34/69 2023-10-01T07:54:06.086 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 35/69 2023-10-01T07:54:06.086 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librbd1-2:18.2.0-501.gfc1e90a3.el8.x86_64 36/69 2023-10-01T07:54:06.086 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 37/69 2023-10-01T07:54:06.087 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librgw2-2:18.2.0-501.gfc1e90a3.el8.x86_64 38/69 2023-10-01T07:54:06.087 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 39/69 2023-10-01T07:54:06.087 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-argparse-2:18.2.0-501.gfc1e90a3.el8.x 40/69 2023-10-01T07:54:06.087 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x 41/69 2023-10-01T07:54:06.087 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86 42/69 2023-10-01T07:54:06.087 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86 43/69 2023-10-01T07:54:06.087 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cephfs-2:18.2.0-501.gfc1e90a3.el8.x86_64 44/69 2023-10-01T07:54:06.087 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 45/69 2023-10-01T07:54:06.087 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rados-2:18.2.0-501.gfc1e90a3.el8.x86_64 46/69 2023-10-01T07:54:06.087 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 47/69 2023-10-01T07:54:06.087 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rbd-2:18.2.0-501.gfc1e90a3.el8.x86_64 48/69 2023-10-01T07:54:06.088 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 49/69 2023-10-01T07:54:06.088 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rgw-2:18.2.0-501.gfc1e90a3.el8.x86_64 50/69 2023-10-01T07:54:06.088 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-10-01T07:54:06.088 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-fuse-2:18.2.0-501.gfc1e90a3.el8.x86_64 52/69 2023-10-01T07:54:06.088 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-10-01T07:54:06.088 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-mirror-2:18.2.0-501.gfc1e90a3.el8.x86_64 54/69 2023-10-01T07:54:06.088 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 55/69 2023-10-01T07:54:06.088 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-nbd-2:18.2.0-501.gfc1e90a3.el8.x86_64 56/69 2023-10-01T07:54:06.088 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 57/69 2023-10-01T07:54:06.088 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-501.gfc1e90a3.el8 58/69 2023-10-01T07:54:06.088 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8 59/69 2023-10-01T07:54:06.088 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-501.gfc1e90a3.el8.noar 60/69 2023-10-01T07:54:06.089 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noar 61/69 2023-10-01T07:54:06.089 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-501.gfc1e90 62/69 2023-10-01T07:54:06.089 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13a 63/69 2023-10-01T07:54:06.089 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-501.gfc1e90a3.el8.n 64/69 2023-10-01T07:54:06.089 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.n 65/69 2023-10-01T07:54:06.089 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-rook-2:18.2.0-501.gfc1e90a3.el8.noarch 66/69 2023-10-01T07:54:06.089 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 67/69 2023-10-01T07:54:06.089 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-501.gfc1e90a3.el8. 68/69 2023-10-01T07:54:08.187 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8. 69/69 2023-10-01T07:54:08.187 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:54:08.187 INFO:teuthology.orchestra.run.smithi026.stdout:Upgraded: 2023-10-01T07:54:08.187 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-10-01T07:54:08.188 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-10-01T07:54:08.188 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-10-01T07:54:08.188 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-fuse-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-10-01T07:54:08.188 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-grafana-dashboards-2:18.2.0-501.gfc1e90a3.el8.noarch 2023-10-01T07:54:08.188 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mds-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-10-01T07:54:08.188 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-10-01T07:54:08.188 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-dashboard-2:18.2.0-501.gfc1e90a3.el8.noarch 2023-10-01T07:54:08.188 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-diskprediction-local-2:18.2.0-501.gfc1e90a3.el8.noarch 2023-10-01T07:54:08.188 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-modules-core-2:18.2.0-501.gfc1e90a3.el8.noarch 2023-10-01T07:54:08.188 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-rook-2:18.2.0-501.gfc1e90a3.el8.noarch 2023-10-01T07:54:08.188 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mon-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-10-01T07:54:08.188 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-osd-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-10-01T07:54:08.189 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-prometheus-alerts-2:18.2.0-501.gfc1e90a3.el8.noarch 2023-10-01T07:54:08.189 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-radosgw-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-10-01T07:54:08.189 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-selinux-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-10-01T07:54:08.189 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-test-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-10-01T07:54:08.189 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs-devel-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-10-01T07:54:08.189 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs2-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-10-01T07:54:08.189 INFO:teuthology.orchestra.run.smithi026.stdout: libcephsqlite-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-10-01T07:54:08.189 INFO:teuthology.orchestra.run.smithi026.stdout: librados-devel-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-10-01T07:54:08.189 INFO:teuthology.orchestra.run.smithi026.stdout: librados2-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-10-01T07:54:08.189 INFO:teuthology.orchestra.run.smithi026.stdout: libradosstriper1-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-10-01T07:54:08.189 INFO:teuthology.orchestra.run.smithi026.stdout: librbd1-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-10-01T07:54:08.190 INFO:teuthology.orchestra.run.smithi026.stdout: librgw2-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-10-01T07:54:08.190 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-argparse-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-10-01T07:54:08.190 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-10-01T07:54:08.190 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cephfs-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-10-01T07:54:08.190 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-10-01T07:54:08.190 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rbd-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-10-01T07:54:08.193 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rgw-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-10-01T07:54:08.193 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-fuse-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-10-01T07:54:08.193 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-mirror-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-10-01T07:54:08.193 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-nbd-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-10-01T07:54:08.193 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2023-10-01T07:54:08.193 INFO:teuthology.orchestra.run.smithi026.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-01T07:54:08.193 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:54:08.193 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2023-10-01T07:54:08.378 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2023-10-01T07:54:08.714 DEBUG:teuthology.orchestra.run.smithi026:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-01T07:54:08.744 INFO:teuthology.orchestra.run.smithi026.stdout:18.2.0-501.gfc1e90a3.el8 2023-10-01T07:54:08.744 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-501.gfc1e90a3.el8 2023-10-01T07:54:08.744 INFO:teuthology.task.install:The correct ceph version 18.2.0-501.gfc1e90a3 is installed. 2023-10-01T07:54:08.745 INFO:teuthology.run_tasks:Running task print... 2023-10-01T07:54:08.754 INFO:teuthology.task.print:**** done install.upgrade the host 2023-10-01T07:54:08.754 INFO:teuthology.run_tasks:Running task ceph.restart... 2023-10-01T07:54:08.777 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-01T07:54:08.778 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T07:54:08.798 INFO:tasks.ceph.mon.a:Stopped 2023-10-01T07:54:08.799 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-01T07:54:08.799 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-01T07:54:08.841 INFO:tasks.ceph.mon.a:Started 2023-10-01T07:54:08.841 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-01T07:54:08.841 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T07:54:08.858 INFO:tasks.ceph.mon.b:Stopped 2023-10-01T07:54:08.858 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-01T07:54:08.858 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-01T07:54:08.901 INFO:tasks.ceph.mon.b:Started 2023-10-01T07:54:08.902 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-01T07:54:08.902 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T07:54:08.916 INFO:tasks.ceph.mon.c:Stopped 2023-10-01T07:54:08.916 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-01T07:54:08.916 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-01T07:54:08.958 INFO:tasks.ceph.mon.c:Started 2023-10-01T07:54:08.959 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-01T07:54:08.959 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T07:54:08.990 INFO:tasks.ceph.mgr.x:Stopped 2023-10-01T07:54:08.990 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-01T07:54:08.990 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-01T07:54:09.032 INFO:tasks.ceph.mgr.x:Started 2023-10-01T07:54:09.033 INFO:teuthology.run_tasks:Running task ceph.healthy... 2023-10-01T07:54:09.042 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-01T07:54:09.042 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-01T07:54:09.043 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-01T07:54:09.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.185+0000 7f469fd49700 1 Processor -- start 2023-10-01T07:54:09.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.185+0000 7f469fd49700 1 -- start start 2023-10-01T07:54:09.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.186+0000 7f469fd49700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f469806a770 0x7f469809d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:09.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.186+0000 7f469fd49700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f469813d1f0 0x7f469813f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:09.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.186+0000 7f469fd49700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f469809a810 con 0x7f469809dc30 2023-10-01T07:54:09.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.186+0000 7f469fd49700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f469806ab40 con 0x7f469813d1f0 2023-10-01T07:54:09.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.186+0000 7f469fd49700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f469809ebc0 con 0x7f469806a770 2023-10-01T07:54:09.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.186+0000 7f469dae5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f469806a770 0x7f469809d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:09.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.186+0000 7f469e2e6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f469813d1f0 0x7f469813f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:09.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.186+0000 7f469d2e4700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f469809dc30 0x7f469809e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43810/0 (socket says 172.21.15.26:43810) 2023-10-01T07:54:09.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.186+0000 7f469d2e4700 1 -- 172.21.15.26:0/4216457667 learned_addr learned my addr 172.21.15.26:0/4216457667 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:09.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.186+0000 7f469dae5700 1 -- 172.21.15.26:0/4216457667 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f469806a770 msgr2=0x7f469809d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-01T07:54:09.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.186+0000 7f469e2e6700 1 -- 172.21.15.26:0/4216457667 >> v2:172.21.15.26:3300/0 conn(0x7f469813d1f0 msgr2=0x7f469813f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-01T07:54:09.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.186+0000 7f469e2e6700 1 -- 172.21.15.26:0/4216457667 >> v2:172.21.15.26:3300/0 conn(0x7f469813d1f0 msgr2=0x7f469813f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-01T07:54:09.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.186+0000 7f469dae5700 1 -- 172.21.15.26:0/4216457667 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f469806a770 msgr2=0x7f469809d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-01T07:54:09.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.186+0000 7f469e2e6700 1 --2- 172.21.15.26:0/4216457667 >> v2:172.21.15.26:3300/0 conn(0x7f469813d1f0 0x7f469813f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-01T07:54:09.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.186+0000 7f469dae5700 1 --2- 172.21.15.26:0/4216457667 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f469806a770 0x7f469809d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-01T07:54:09.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.186+0000 7f469dae5700 1 --2- 172.21.15.26:0/4216457667 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f469806a770 0x7f469809d6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-01T07:54:09.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.186+0000 7f469e2e6700 1 --2- 172.21.15.26:0/4216457667 >> v2:172.21.15.26:3300/0 conn(0x7f469813d1f0 0x7f469813f5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-01T07:54:09.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.208+0000 7f469cae3700 1 -- 172.21.15.26:0/4216457667 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1546834681 0 0) 0x7f469809a810 con 0x7f469809dc30 2023-10-01T07:54:09.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.208+0000 7f469cae3700 1 -- 172.21.15.26:0/4216457667 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46840035b0 con 0x7f469809dc30 2023-10-01T07:54:09.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.208+0000 7f469cae3700 1 -- 172.21.15.26:0/4216457667 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4170831175 0 0) 0x7f46840035b0 con 0x7f469809dc30 2023-10-01T07:54:09.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.208+0000 7f469cae3700 1 -- 172.21.15.26:0/4216457667 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f469806a770 msgr2=0x7f469809d6f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-01T07:54:09.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.208+0000 7f469cae3700 1 --2- 172.21.15.26:0/4216457667 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f469806a770 0x7f469809d6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:09.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.209+0000 7f469cae3700 1 -- 172.21.15.26:0/4216457667 >> v2:172.21.15.26:3300/0 conn(0x7f469813d1f0 msgr2=0x7f469813f5d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-01T07:54:09.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.209+0000 7f469cae3700 1 --2- 172.21.15.26:0/4216457667 >> v2:172.21.15.26:3300/0 conn(0x7f469813d1f0 0x7f469813f5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:09.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.209+0000 7f469cae3700 1 -- 172.21.15.26:0/4216457667 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469809e920 con 0x7f469809dc30 2023-10-01T07:54:09.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.209+0000 7f469cae3700 1 -- 172.21.15.26:0/4216457667 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1576910959 0 0) 0x7f468c001670 con 0x7f469809dc30 2023-10-01T07:54:09.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.209+0000 7f469cae3700 1 -- 172.21.15.26:0/4216457667 >> v1:172.21.15.26:6789/0 conn(0x7f469809dc30 legacy=0x7f469809e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:09.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.209+0000 7f469cae3700 1 --2- 172.21.15.26:0/4216457667 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f469806a770 0x7f4684003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:09.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.209+0000 7f469cae3700 1 --2- 172.21.15.26:0/4216457667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4684004030 0x7f4684004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:09.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.209+0000 7f469cae3700 1 --2- 172.21.15.26:0/4216457667 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4684004d90 0x7f4684005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:09.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.209+0000 7f469cae3700 1 -- 172.21.15.26:0/4216457667 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469806ab40 con 0x7f4684004030 2023-10-01T07:54:09.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.209+0000 7f469cae3700 1 -- 172.21.15.26:0/4216457667 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469809ebc0 con 0x7f4684004d90 2023-10-01T07:54:09.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.209+0000 7f469cae3700 1 -- 172.21.15.26:0/4216457667 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f468400bb10 con 0x7f469806a770 2023-10-01T07:54:09.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.209+0000 7f469dae5700 1 --2- 172.21.15.26:0/4216457667 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f469806a770 0x7f4684003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:09.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.209+0000 7f469d2e4700 1 --2- 172.21.15.26:0/4216457667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4684004030 0x7f4684004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:09.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.209+0000 7f469e2e6700 1 --2- 172.21.15.26:0/4216457667 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4684004d90 0x7f4684005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:09.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.209+0000 7f469dae5700 1 -- 172.21.15.26:0/4216457667 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4684004d90 msgr2=0x7f4684005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:09.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.209+0000 7f469dae5700 1 --2- 172.21.15.26:0/4216457667 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4684004d90 0x7f4684005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:09.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.209+0000 7f469dae5700 1 -- 172.21.15.26:0/4216457667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4684004030 msgr2=0x7f4684004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:09.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.209+0000 7f469dae5700 1 --2- 172.21.15.26:0/4216457667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4684004030 0x7f4684004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:09.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.209+0000 7f469dae5700 1 -- 172.21.15.26:0/4216457667 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46840035b0 con 0x7f469806a770 2023-10-01T07:54:09.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.210+0000 7f469dae5700 1 --2- 172.21.15.26:0/4216457667 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f469806a770 0x7f4684003a00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4694009890 tx=0x7f4684005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a928946329ac4852 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:09.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.210+0000 7f469cae3700 1 -- 172.21.15.26:0/4216457667 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469400c070 con 0x7f469806a770 2023-10-01T07:54:09.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.210+0000 7f469cae3700 1 -- 172.21.15.26:0/4216457667 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4694004020 con 0x7f469806a770 2023-10-01T07:54:09.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.210+0000 7f469cae3700 1 -- 172.21.15.26:0/4216457667 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46940043f0 con 0x7f469806a770 2023-10-01T07:54:09.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.211+0000 7f469fd49700 1 -- 172.21.15.26:0/4216457667 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f469806a770 msgr2=0x7f4684003a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:09.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.211+0000 7f469fd49700 1 --2- 172.21.15.26:0/4216457667 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f469806a770 0x7f4684003a00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4694009890 tx=0x7f4684005880 comp rx=0 tx=0).stop 2023-10-01T07:54:09.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.211+0000 7f469e2e6700 1 -- 172.21.15.26:0/4216457667 reap_dead start 2023-10-01T07:54:09.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.211+0000 7f469fd49700 1 -- 172.21.15.26:0/4216457667 shutdown_connections 2023-10-01T07:54:09.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.211+0000 7f469fd49700 1 -- 172.21.15.26:0/4216457667 >> 172.21.15.26:0/4216457667 conn(0x7f4698066f50 msgr2=0x7f469809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:09.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.211+0000 7f469fd49700 1 -- 172.21.15.26:0/4216457667 shutdown_connections 2023-10-01T07:54:09.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.211+0000 7f469fd49700 1 -- 172.21.15.26:0/4216457667 wait complete. 2023-10-01T07:54:09.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.213+0000 7f469fd49700 1 Processor -- start 2023-10-01T07:54:09.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.213+0000 7f469fd49700 1 -- start start 2023-10-01T07:54:09.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.213+0000 7f469fd49700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4698126fa0 0x7f4698127370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:09.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.213+0000 7f469fd49700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46981cc760 0x7f46981ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:09.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.213+0000 7f469fd49700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f46981cd0d0 0x7f46981d3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:09.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.213+0000 7f469fd49700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4698129e70 con 0x7f46981cc760 2023-10-01T07:54:09.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.213+0000 7f469fd49700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4698126b70 con 0x7f4698126fa0 2023-10-01T07:54:09.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.213+0000 7f469fd49700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4698129190 con 0x7f46981cd0d0 2023-10-01T07:54:09.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.214+0000 7f469d2e4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46981cc760 0x7f46981ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:09.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.214+0000 7f469dae5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4698126fa0 0x7f4698127370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:09.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.214+0000 7f469e2e6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f46981cd0d0 0x7f46981d3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:09.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.214+0000 7f469dae5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4698126fa0 0x7f4698127370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45658/0 (socket says 172.21.15.26:45658) 2023-10-01T07:54:09.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.214+0000 7f469d2e4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46981cc760 0x7f46981ccb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49468/0 (socket says 172.21.15.26:49468) 2023-10-01T07:54:09.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.214+0000 7f469dae5700 1 -- 172.21.15.26:0/1419858832 learned_addr learned my addr 172.21.15.26:0/1419858832 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:09.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.214+0000 7f469dae5700 1 -- 172.21.15.26:0/1419858832 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f46981cd0d0 msgr2=0x7f46981d3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:09.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.214+0000 7f469dae5700 1 --2- 172.21.15.26:0/1419858832 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f46981cd0d0 0x7f46981d3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:09.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.214+0000 7f469dae5700 1 -- 172.21.15.26:0/1419858832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46981cc760 msgr2=0x7f46981ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:09.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.214+0000 7f469dae5700 1 --2- 172.21.15.26:0/1419858832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46981cc760 0x7f46981ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:09.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.214+0000 7f469dae5700 1 -- 172.21.15.26:0/1419858832 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4698072590 con 0x7f4698126fa0 2023-10-01T07:54:09.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.214+0000 7f469e2e6700 1 --2- 172.21.15.26:0/1419858832 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f46981cd0d0 0x7f46981d3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:09.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.214+0000 7f469d2e4700 1 --2- 172.21.15.26:0/1419858832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46981cc760 0x7f46981ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:09.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.214+0000 7f469dae5700 1 --2- 172.21.15.26:0/1419858832 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4698126fa0 0x7f4698127370 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4694008010 tx=0x7f46940047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:09.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.214+0000 7f468a7fc700 1 -- 172.21.15.26:0/1419858832 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46940045e0 con 0x7f4698126fa0 2023-10-01T07:54:09.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.214+0000 7f468a7fc700 1 -- 172.21.15.26:0/1419858832 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4694003be0 con 0x7f4698126fa0 2023-10-01T07:54:09.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.214+0000 7f469fd49700 1 -- 172.21.15.26:0/1419858832 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f469809f1a0 con 0x7f4698126fa0 2023-10-01T07:54:09.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.215+0000 7f468a7fc700 1 -- 172.21.15.26:0/1419858832 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4694026480 con 0x7f4698126fa0 2023-10-01T07:54:09.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.215+0000 7f469fd49700 1 -- 172.21.15.26:0/1419858832 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f469812a800 con 0x7f4698126fa0 2023-10-01T07:54:09.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.215+0000 7f468a7fc700 1 -- 172.21.15.26:0/1419858832 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f46940265e0 con 0x7f4698126fa0 2023-10-01T07:54:09.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.215+0000 7f468a7fc700 1 -- 172.21.15.26:0/1419858832 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f469403c820 con 0x7f4698126fa0 2023-10-01T07:54:09.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.215+0000 7f469d2e4700 1 -- 172.21.15.26:0/1419858832 >> v1:172.21.15.26:6816/118178 conn(0x7f467c02c1b0 legacy=0x7f467c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/118178 2023-10-01T07:54:09.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.216+0000 7f467bfff700 1 -- 172.21.15.26:0/1419858832 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46740052e0 con 0x7f4698126fa0 2023-10-01T07:54:09.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.221+0000 7f468a7fc700 1 -- 172.21.15.26:0/1419858832 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f4694026890 con 0x7f4698126fa0 2023-10-01T07:54:09.347 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:09.347+0000 7f6cc52b3240 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-01T07:54:09.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.416+0000 7f469d2e4700 1 -- 172.21.15.26:0/1419858832 >> v1:172.21.15.26:6816/118178 conn(0x7f467c02c1b0 legacy=0x7f467c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/118178 2023-10-01T07:54:09.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.460+0000 7f467bfff700 1 -- 172.21.15.26:0/1419858832 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f4674005590 con 0x7f4698126fa0 2023-10-01T07:54:09.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.463+0000 7f468a7fc700 1 -- 172.21.15.26:0/1419858832 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+64281 (secure 0 0 0) 0x7f469402f3f0 con 0x7f4698126fa0 2023-10-01T07:54:09.468 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:54:09.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.467+0000 7f467bfff700 1 -- 172.21.15.26:0/1419858832 >> v1:172.21.15.26:6816/118178 conn(0x7f467c02c1b0 legacy=0x7f467c02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:09.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.467+0000 7f467bfff700 1 -- 172.21.15.26:0/1419858832 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4698126fa0 msgr2=0x7f4698127370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:09.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.467+0000 7f467bfff700 1 --2- 172.21.15.26:0/1419858832 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4698126fa0 0x7f4698127370 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4694008010 tx=0x7f46940047c0 comp rx=0 tx=0).stop 2023-10-01T07:54:09.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.468+0000 7f467bfff700 1 -- 172.21.15.26:0/1419858832 shutdown_connections 2023-10-01T07:54:09.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.468+0000 7f467bfff700 1 --2- 172.21.15.26:0/1419858832 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f46981cd0d0 0x7f46981d3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:09.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.468+0000 7f467bfff700 1 --2- 172.21.15.26:0/1419858832 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4698126fa0 0x7f4698127370 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:09.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.468+0000 7f467bfff700 1 --2- 172.21.15.26:0/1419858832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46981cc760 0x7f46981ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:09.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.468+0000 7f467bfff700 1 -- 172.21.15.26:0/1419858832 >> 172.21.15.26:0/1419858832 conn(0x7f4698066f50 msgr2=0x7f469813c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:09.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.468+0000 7f467bfff700 1 -- 172.21.15.26:0/1419858832 shutdown_connections 2023-10-01T07:54:09.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.468+0000 7f467bfff700 1 -- 172.21.15.26:0/1419858832 wait complete. 2023-10-01T07:54:09.494 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":5,"active_gid":4107,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6816","nonce":118178}]},"active_addr":"172.21.15.26:6816/118178","active_change":"2023-10-01T07:51:45.799786+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.26:0","nonce":616154075}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.26:0","nonce":1290599107}]}]} 2023-10-01T07:54:09.496 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-01T07:54:09.496 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-01T07:54:09.496 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-01T07:54:09.533 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:09.533+0000 7f6cc52b3240 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-01T07:54:09.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.646+0000 7f41fcd8b700 1 Processor -- start 2023-10-01T07:54:09.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.646+0000 7f41fcd8b700 1 -- start start 2023-10-01T07:54:09.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.646+0000 7f41fcd8b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f41f809e930 0x7f41f809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:09.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.646+0000 7f41fcd8b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41f809f240 0x7f41f81317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:09.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.646+0000 7f41fcd8b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f8070940 con 0x7f41f809f650 2023-10-01T07:54:09.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.646+0000 7f41fcd8b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f806fd60 con 0x7f41f809e930 2023-10-01T07:54:09.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.646+0000 7f41fcd8b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41f806fa80 con 0x7f41f809f240 2023-10-01T07:54:09.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.647+0000 7f41f659c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f41f809e930 0x7f41f809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:09.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.647+0000 7f41f5d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41f809f240 0x7f41f81317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:09.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.647+0000 7f41f659c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f41f809e930 0x7f41f809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49486/0 (socket says 172.21.15.26:49486) 2023-10-01T07:54:09.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.647+0000 7f41f5d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41f809f240 0x7f41f81317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:42716/0 (socket says 172.21.15.26:42716) 2023-10-01T07:54:09.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.647+0000 7f41f659c700 1 -- 172.21.15.26:0/3982470472 learned_addr learned my addr 172.21.15.26:0/3982470472 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:09.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.647+0000 7f41f5d9b700 1 -- 172.21.15.26:0/3982470472 >> v2:172.21.15.26:3300/0 conn(0x7f41f809e930 msgr2=0x7f41f809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:09.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.647+0000 7f41f5d9b700 1 --2- 172.21.15.26:0/3982470472 >> v2:172.21.15.26:3300/0 conn(0x7f41f809e930 0x7f41f809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:09.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.647+0000 7f41f5d9b700 1 -- 172.21.15.26:0/3982470472 >> v1:172.21.15.26:6789/0 conn(0x7f41f809f650 legacy=0x7f41f8131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:09.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.647+0000 7f41f5d9b700 1 -- 172.21.15.26:0/3982470472 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f809fb60 con 0x7f41f809f240 2023-10-01T07:54:09.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.647+0000 7f41f559a700 1 -- 172.21.15.26:0/3982470472 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1884122464 0 0) 0x7f41f8070940 con 0x7f41f809f650 2023-10-01T07:54:09.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.647+0000 7f41f659c700 1 --2- 172.21.15.26:0/3982470472 >> v2:172.21.15.26:3300/0 conn(0x7f41f809e930 0x7f41f809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:09.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.647+0000 7f41f5d9b700 1 --2- 172.21.15.26:0/3982470472 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41f809f240 0x7f41f81317f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f41ec009840 tx=0x7f41ec009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdcdde8ed668e5ee server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:09.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.647+0000 7f41f559a700 1 -- 172.21.15.26:0/3982470472 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ec011830 con 0x7f41f809f240 2023-10-01T07:54:09.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.647+0000 7f41f559a700 1 -- 172.21.15.26:0/3982470472 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41ec011990 con 0x7f41f809f240 2023-10-01T07:54:09.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.647+0000 7f41f559a700 1 -- 172.21.15.26:0/3982470472 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ec011d20 con 0x7f41f809f240 2023-10-01T07:54:09.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.648+0000 7f41fcd8b700 1 -- 172.21.15.26:0/3982470472 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41f809f240 msgr2=0x7f41f81317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:09.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.648+0000 7f41fcd8b700 1 --2- 172.21.15.26:0/3982470472 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41f809f240 0x7f41f81317f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f41ec009840 tx=0x7f41ec009b50 comp rx=0 tx=0).stop 2023-10-01T07:54:09.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.648+0000 7f41fcd8b700 1 -- 172.21.15.26:0/3982470472 shutdown_connections 2023-10-01T07:54:09.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.648+0000 7f41fcd8b700 1 --2- 172.21.15.26:0/3982470472 >> v2:172.21.15.26:3300/0 conn(0x7f41f809e930 0x7f41f809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:09.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.648+0000 7f41fcd8b700 1 --2- 172.21.15.26:0/3982470472 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41f809f240 0x7f41f81317f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:09.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.648+0000 7f41fcd8b700 1 -- 172.21.15.26:0/3982470472 >> 172.21.15.26:0/3982470472 conn(0x7f41f80a4210 msgr2=0x7f41f80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:09.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.648+0000 7f41fcd8b700 1 -- 172.21.15.26:0/3982470472 shutdown_connections 2023-10-01T07:54:09.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.648+0000 7f41fcd8b700 1 -- 172.21.15.26:0/3982470472 wait complete. 2023-10-01T07:54:09.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.649+0000 7f41fcd8b700 1 Processor -- start 2023-10-01T07:54:09.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.650+0000 7f41fcd8b700 1 -- start start 2023-10-01T07:54:09.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.650+0000 7f41fcd8b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41f809e930 0x7f41f806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:09.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.650+0000 7f41fcd8b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41f809f240 0x7f41f806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:09.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.650+0000 7f41fcd8b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41f809f650 0x7f41f806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:09.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.650+0000 7f41fcd8b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f81a95c0 con 0x7f41f809e930 2023-10-01T07:54:09.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.650+0000 7f41fcd8b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f806d4c0 con 0x7f41f809f650 2023-10-01T07:54:09.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.650+0000 7f41fcd8b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41f81a9260 con 0x7f41f809f240 2023-10-01T07:54:09.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.650+0000 7f41f5d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41f809f240 0x7f41f806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:09.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.650+0000 7f41f659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41f809e930 0x7f41f806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:09.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.650+0000 7f41f5d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41f809f240 0x7f41f806bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:42720/0 (socket says 172.21.15.26:42720) 2023-10-01T07:54:09.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.650+0000 7f41f5d9b700 1 -- 172.21.15.26:0/3996359892 learned_addr learned my addr 172.21.15.26:0/3996359892 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:09.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.650+0000 7f41f6d9d700 1 --2- 172.21.15.26:0/3996359892 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41f809f650 0x7f41f806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:09.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.651+0000 7f41f5d9b700 1 -- 172.21.15.26:0/3996359892 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41f809f650 msgr2=0x7f41f806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:09.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.651+0000 7f41f5d9b700 1 --2- 172.21.15.26:0/3996359892 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41f809f650 0x7f41f806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:09.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.651+0000 7f41f5d9b700 1 -- 172.21.15.26:0/3996359892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41f809e930 msgr2=0x7f41f806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:09.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.651+0000 7f41f5d9b700 1 --2- 172.21.15.26:0/3996359892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41f809e930 0x7f41f806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:09.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.651+0000 7f41f5d9b700 1 -- 172.21.15.26:0/3996359892 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e8009550 con 0x7f41f809f240 2023-10-01T07:54:09.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.651+0000 7f41f659c700 1 --2- 172.21.15.26:0/3996359892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41f809e930 0x7f41f806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:09.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.651+0000 7f41f5d9b700 1 --2- 172.21.15.26:0/3996359892 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41f809f240 0x7f41f806bdf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f41ec0090b0 tx=0x7f41ec004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:09.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.651+0000 7f41e6ffd700 1 -- 172.21.15.26:0/3996359892 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ec004400 con 0x7f41f809f240 2023-10-01T07:54:09.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.651+0000 7f41e6ffd700 1 -- 172.21.15.26:0/3996359892 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41ec01f070 con 0x7f41f809f240 2023-10-01T07:54:09.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.651+0000 7f41e6ffd700 1 -- 172.21.15.26:0/3996359892 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ec0038e0 con 0x7f41f809f240 2023-10-01T07:54:09.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.651+0000 7f41fcd8b700 1 -- 172.21.15.26:0/3996359892 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41ec0094a0 con 0x7f41f809f240 2023-10-01T07:54:09.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.651+0000 7f41fcd8b700 1 -- 172.21.15.26:0/3996359892 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f80a0190 con 0x7f41f809f240 2023-10-01T07:54:09.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.652+0000 7f41e6ffd700 1 -- 172.21.15.26:0/3996359892 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f41ec021030 con 0x7f41f809f240 2023-10-01T07:54:09.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.652+0000 7f41e6ffd700 1 -- 172.21.15.26:0/3996359892 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f41ec03ca10 con 0x7f41f809f240 2023-10-01T07:54:09.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.652+0000 7f41f659c700 1 -- 172.21.15.26:0/3996359892 >> v1:172.21.15.26:6816/118178 conn(0x7f41d802c1e0 legacy=0x7f41d802e690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/118178 2023-10-01T07:54:09.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.652+0000 7f41fcd8b700 1 -- 172.21.15.26:0/3996359892 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f81a8b40 con 0x7f41f809f240 2023-10-01T07:54:09.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.657+0000 7f41e6ffd700 1 -- 172.21.15.26:0/3996359892 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f41ec015080 con 0x7f41f809f240 2023-10-01T07:54:09.821 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:09.820+0000 7f6cc52b3240 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-01T07:54:09.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.837+0000 7f41fcd8b700 1 -- 172.21.15.26:0/3996359892 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41f81a0b30 con 0x7f41f809f240 2023-10-01T07:54:09.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.838+0000 7f41e6ffd700 1 -- 172.21.15.26:0/3996359892 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+12737 (secure 0 0 0) 0x7f41ec004560 con 0x7f41f809f240 2023-10-01T07:54:09.838 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:54:09.839 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":20,"fsid":"c29fb19d-520c-42a6-90f4-e7f86de96e8e","created":"2023-10-01T07:51:40.702414+0000","modified":"2023-10-01T07:52:47.689533+0000","last_up_change":"2023-10-01T07:51:48.849482+0000","last_in_change":"2023-10-01T07:51:42.084736+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-01T07:51:48.906889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-01T07:51:50.071599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-01T07:51:54.981575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-01T07:51:56.286318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46569ce3-81d1-44a1-a649-691de3e6f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6800","nonce":118773}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6801","nonce":118773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6803","nonce":118773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6802","nonce":118773}]},"public_addr":"172.21.15.26:6800/118773","cluster_addr":"172.21.15.26:6801/118773","heartbeat_back_addr":"172.21.15.26:6803/118773","heartbeat_front_addr":"172.21.15.26:6802/118773","state":["exists","up"]},{"osd":1,"uuid":"1fc1ba9b-4110-4d31-96d6-794937578cff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6804","nonce":118782}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6806","nonce":118782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6810","nonce":118782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6808","nonce":118782}]},"public_addr":"172.21.15.26:6804/118782","cluster_addr":"172.21.15.26:6806/118782","heartbeat_back_addr":"172.21.15.26:6810/118782","heartbeat_front_addr":"172.21.15.26:6808/118782","state":["exists","up"]},{"osd":2,"uuid":"37de933d-3b8e-4b94-87bd-2f36896c7ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6805","nonce":118789}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6807","nonce":118789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6811","nonce":118789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6809","nonce":118789}]},"public_addr":"172.21.15.26:6805/118789","cluster_addr":"172.21.15.26:6807/118789","heartbeat_back_addr":"172.21.15.26:6811/118789","heartbeat_front_addr":"172.21.15.26:6809/118789","state":["exists","up"]},{"osd":3,"uuid":"bd020309-5fd2-4d97-b36a-67e159fa3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6812","nonce":118790}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6813","nonce":118790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6815","nonce":118790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6814","nonce":118790}]},"public_addr":"172.21.15.26:6812/118790","cluster_addr":"172.21.15.26:6813/118790","heartbeat_back_addr":"172.21.15.26:6815/118790","heartbeat_front_addr":"172.21.15.26:6814/118790","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.029993+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.266503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.273540+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.229731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.e","mappings":[{"from":3,"to":0}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.39","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-01T07:54:09.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.840+0000 7f41fcd8b700 1 -- 172.21.15.26:0/3996359892 >> v1:172.21.15.26:6816/118178 conn(0x7f41d802c1e0 legacy=0x7f41d802e690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:09.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.840+0000 7f41fcd8b700 1 -- 172.21.15.26:0/3996359892 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41f809f240 msgr2=0x7f41f806bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:09.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.840+0000 7f41fcd8b700 1 --2- 172.21.15.26:0/3996359892 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41f809f240 0x7f41f806bdf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f41ec0090b0 tx=0x7f41ec004750 comp rx=0 tx=0).stop 2023-10-01T07:54:09.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.840+0000 7f41fcd8b700 1 -- 172.21.15.26:0/3996359892 shutdown_connections 2023-10-01T07:54:09.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.840+0000 7f41fcd8b700 1 --2- 172.21.15.26:0/3996359892 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41f809f650 0x7f41f806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:09.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.840+0000 7f41fcd8b700 1 --2- 172.21.15.26:0/3996359892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41f809e930 0x7f41f806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:09.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.840+0000 7f41fcd8b700 1 --2- 172.21.15.26:0/3996359892 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41f809f240 0x7f41f806bdf0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:09.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.840+0000 7f41fcd8b700 1 -- 172.21.15.26:0/3996359892 >> 172.21.15.26:0/3996359892 conn(0x7f41f80a4210 msgr2=0x7f41f81b89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:09.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.840+0000 7f41fcd8b700 1 -- 172.21.15.26:0/3996359892 shutdown_connections 2023-10-01T07:54:09.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:09.840+0000 7f41fcd8b700 1 -- 172.21.15.26:0/3996359892 wait complete. 2023-10-01T07:54:09.855 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-01T07:54:09.856 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-01T07:54:10.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.032+0000 7fc833489700 1 Processor -- start 2023-10-01T07:54:10.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.032+0000 7fc833489700 1 -- start start 2023-10-01T07:54:10.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.032+0000 7fc833489700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc82c133420 0x7fc82c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.032+0000 7fc833489700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc82c133e30 0x7fc82c12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.032+0000 7fc833489700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc82c06b990 con 0x7fc82c134260 2023-10-01T07:54:10.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.032+0000 7fc833489700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c0a0590 con 0x7fc82c133420 2023-10-01T07:54:10.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.032+0000 7fc833489700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c09fb80 con 0x7fc82c133e30 2023-10-01T07:54:10.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.033+0000 7fc831225700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc82c133420 0x7fc82c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.033+0000 7fc830a24700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc82c133e30 0x7fc82c12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.033+0000 7fc831225700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc82c133420 0x7fc82c1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45692/0 (socket says 172.21.15.26:45692) 2023-10-01T07:54:10.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.033+0000 7fc831a26700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc82c134260 0x7fc82c1304d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43822/0 (socket says 172.21.15.26:43822) 2023-10-01T07:54:10.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.033+0000 7fc831225700 1 -- 172.21.15.26:0/4010806073 learned_addr learned my addr 172.21.15.26:0/4010806073 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:10.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.033+0000 7fc830a24700 1 -- 172.21.15.26:0/4010806073 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc82c133420 msgr2=0x7fc82c1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:10.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.033+0000 7fc823fff700 1 -- 172.21.15.26:0/4010806073 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1227700800 0 0) 0x7fc82c06b990 con 0x7fc82c134260 2023-10-01T07:54:10.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.033+0000 7fc830a24700 1 --2- 172.21.15.26:0/4010806073 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc82c133420 0x7fc82c1337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.033+0000 7fc830a24700 1 -- 172.21.15.26:0/4010806073 >> v1:172.21.15.26:6789/0 conn(0x7fc82c134260 legacy=0x7fc82c1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.033+0000 7fc830a24700 1 -- 172.21.15.26:0/4010806073 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc82c0a0030 con 0x7fc82c133e30 2023-10-01T07:54:10.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.033+0000 7fc831225700 1 --2- 172.21.15.26:0/4010806073 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc82c133420 0x7fc82c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:10.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.033+0000 7fc830a24700 1 --2- 172.21.15.26:0/4010806073 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc82c133e30 0x7fc82c12ff90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc81c009870 tx=0x7fc81c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2732170ff68487e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:10.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.033+0000 7fc823fff700 1 -- 172.21.15.26:0/4010806073 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c011830 con 0x7fc82c133e30 2023-10-01T07:54:10.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.033+0000 7fc823fff700 1 -- 172.21.15.26:0/4010806073 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81c011990 con 0x7fc82c133e30 2023-10-01T07:54:10.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.034+0000 7fc823fff700 1 -- 172.21.15.26:0/4010806073 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c011d20 con 0x7fc82c133e30 2023-10-01T07:54:10.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.034+0000 7fc833489700 1 -- 172.21.15.26:0/4010806073 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc82c133e30 msgr2=0x7fc82c12ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.034+0000 7fc833489700 1 --2- 172.21.15.26:0/4010806073 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc82c133e30 0x7fc82c12ff90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc81c009870 tx=0x7fc81c009b80 comp rx=0 tx=0).stop 2023-10-01T07:54:10.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.034+0000 7fc833489700 1 -- 172.21.15.26:0/4010806073 shutdown_connections 2023-10-01T07:54:10.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.034+0000 7fc833489700 1 --2- 172.21.15.26:0/4010806073 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc82c133420 0x7fc82c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.034+0000 7fc833489700 1 --2- 172.21.15.26:0/4010806073 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc82c133e30 0x7fc82c12ff90 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.034+0000 7fc833489700 1 -- 172.21.15.26:0/4010806073 >> 172.21.15.26:0/4010806073 conn(0x7fc82c0a4210 msgr2=0x7fc82c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:10.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.034+0000 7fc833489700 1 -- 172.21.15.26:0/4010806073 shutdown_connections 2023-10-01T07:54:10.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.034+0000 7fc833489700 1 -- 172.21.15.26:0/4010806073 wait complete. 2023-10-01T07:54:10.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.035+0000 7fc833489700 1 Processor -- start 2023-10-01T07:54:10.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.035+0000 7fc833489700 1 -- start start 2023-10-01T07:54:10.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.036+0000 7fc833489700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc82c133420 0x7fc82c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.036+0000 7fc833489700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc82c133e30 0x7fc82c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.036+0000 7fc833489700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc82c134260 0x7fc82c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.036+0000 7fc833489700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c11f050 con 0x7fc82c133e30 2023-10-01T07:54:10.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.036+0000 7fc833489700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c09de50 con 0x7fc82c133420 2023-10-01T07:54:10.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.036+0000 7fc833489700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c11fc50 con 0x7fc82c134260 2023-10-01T07:54:10.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.036+0000 7fc830a24700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc82c133e30 0x7fc82c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.036+0000 7fc831a26700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc82c134260 0x7fc82c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.036+0000 7fc830a24700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc82c133e30 0x7fc82c09c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49514/0 (socket says 172.21.15.26:49514) 2023-10-01T07:54:10.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.036+0000 7fc830a24700 1 -- 172.21.15.26:0/2160622779 learned_addr learned my addr 172.21.15.26:0/2160622779 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:10.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.036+0000 7fc831a26700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc82c134260 0x7fc82c09cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:42744/0 (socket says 172.21.15.26:42744) 2023-10-01T07:54:10.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.036+0000 7fc831225700 1 --2- 172.21.15.26:0/2160622779 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc82c133420 0x7fc82c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.036+0000 7fc831a26700 1 -- 172.21.15.26:0/2160622779 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc82c133420 msgr2=0x7fc82c09c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.036+0000 7fc831a26700 1 --2- 172.21.15.26:0/2160622779 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc82c133420 0x7fc82c09c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.036+0000 7fc831a26700 1 -- 172.21.15.26:0/2160622779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc82c133e30 msgr2=0x7fc82c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.036+0000 7fc831a26700 1 --2- 172.21.15.26:0/2160622779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc82c133e30 0x7fc82c09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.036+0000 7fc831a26700 1 -- 172.21.15.26:0/2160622779 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc828009550 con 0x7fc82c134260 2023-10-01T07:54:10.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.036+0000 7fc831225700 1 --2- 172.21.15.26:0/2160622779 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc82c133420 0x7fc82c09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:10.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.036+0000 7fc830a24700 1 --2- 172.21.15.26:0/2160622779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc82c133e30 0x7fc82c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:10.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.036+0000 7fc831a26700 1 --2- 172.21.15.26:0/2160622779 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc82c134260 0x7fc82c09cf00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc82400cbe0 tx=0x7fc82400cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:10.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.037+0000 7fc821ffb700 1 -- 172.21.15.26:0/2160622779 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82400aa40 con 0x7fc82c134260 2023-10-01T07:54:10.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.037+0000 7fc821ffb700 1 -- 172.21.15.26:0/2160622779 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82400abc0 con 0x7fc82c134260 2023-10-01T07:54:10.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.037+0000 7fc833489700 1 -- 172.21.15.26:0/2160622779 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc81c0094a0 con 0x7fc82c134260 2023-10-01T07:54:10.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.037+0000 7fc821ffb700 1 -- 172.21.15.26:0/2160622779 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8240070d0 con 0x7fc82c134260 2023-10-01T07:54:10.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.037+0000 7fc833489700 1 -- 172.21.15.26:0/2160622779 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc82c09e3e0 con 0x7fc82c134260 2023-10-01T07:54:10.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.037+0000 7fc821ffb700 1 -- 172.21.15.26:0/2160622779 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fc824007230 con 0x7fc82c134260 2023-10-01T07:54:10.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.038+0000 7fc821ffb700 1 -- 172.21.15.26:0/2160622779 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3922+0+0 (secure 0 0 0) 0x7fc82403b520 con 0x7fc82c134260 2023-10-01T07:54:10.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.038+0000 7fc831225700 1 -- 172.21.15.26:0/2160622779 >> v1:172.21.15.26:6816/118178 conn(0x7fc81002c1b0 legacy=0x7fc81002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/118178 2023-10-01T07:54:10.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.038+0000 7fc833489700 1 -- 172.21.15.26:0/2160622779 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc82c120100 con 0x7fc82c134260 2023-10-01T07:54:10.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.043+0000 7fc821ffb700 1 -- 172.21.15.26:0/2160622779 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fc8240074e0 con 0x7fc82c134260 2023-10-01T07:54:10.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.226+0000 7fc833489700 1 -- 172.21.15.26:0/2160622779 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc82c074ea0 con 0x7fc82c134260 2023-10-01T07:54:10.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.228+0000 7fc821ffb700 1 -- 172.21.15.26:0/2160622779 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+12737 (secure 0 0 0) 0x7fc82401a2c0 con 0x7fc82c134260 2023-10-01T07:54:10.228 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:54:10.228 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":20,"fsid":"c29fb19d-520c-42a6-90f4-e7f86de96e8e","created":"2023-10-01T07:51:40.702414+0000","modified":"2023-10-01T07:52:47.689533+0000","last_up_change":"2023-10-01T07:51:48.849482+0000","last_in_change":"2023-10-01T07:51:42.084736+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-01T07:51:48.906889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-01T07:51:50.071599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-01T07:51:54.981575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-01T07:51:56.286318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46569ce3-81d1-44a1-a649-691de3e6f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6800","nonce":118773}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6801","nonce":118773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6803","nonce":118773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6802","nonce":118773}]},"public_addr":"172.21.15.26:6800/118773","cluster_addr":"172.21.15.26:6801/118773","heartbeat_back_addr":"172.21.15.26:6803/118773","heartbeat_front_addr":"172.21.15.26:6802/118773","state":["exists","up"]},{"osd":1,"uuid":"1fc1ba9b-4110-4d31-96d6-794937578cff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6804","nonce":118782}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6806","nonce":118782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6810","nonce":118782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6808","nonce":118782}]},"public_addr":"172.21.15.26:6804/118782","cluster_addr":"172.21.15.26:6806/118782","heartbeat_back_addr":"172.21.15.26:6810/118782","heartbeat_front_addr":"172.21.15.26:6808/118782","state":["exists","up"]},{"osd":2,"uuid":"37de933d-3b8e-4b94-87bd-2f36896c7ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6805","nonce":118789}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6807","nonce":118789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6811","nonce":118789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6809","nonce":118789}]},"public_addr":"172.21.15.26:6805/118789","cluster_addr":"172.21.15.26:6807/118789","heartbeat_back_addr":"172.21.15.26:6811/118789","heartbeat_front_addr":"172.21.15.26:6809/118789","state":["exists","up"]},{"osd":3,"uuid":"bd020309-5fd2-4d97-b36a-67e159fa3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6812","nonce":118790}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6813","nonce":118790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6815","nonce":118790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6814","nonce":118790}]},"public_addr":"172.21.15.26:6812/118790","cluster_addr":"172.21.15.26:6813/118790","heartbeat_back_addr":"172.21.15.26:6815/118790","heartbeat_front_addr":"172.21.15.26:6814/118790","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.029993+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.266503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.273540+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.229731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.e","mappings":[{"from":3,"to":0}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.39","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-01T07:54:10.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.230+0000 7fc833489700 1 -- 172.21.15.26:0/2160622779 >> v1:172.21.15.26:6816/118178 conn(0x7fc81002c1b0 legacy=0x7fc81002e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:10.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.230+0000 7fc833489700 1 -- 172.21.15.26:0/2160622779 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc82c134260 msgr2=0x7fc82c09cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.230+0000 7fc833489700 1 --2- 172.21.15.26:0/2160622779 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc82c134260 0x7fc82c09cf00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc82400cbe0 tx=0x7fc82400cef0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.230+0000 7fc833489700 1 -- 172.21.15.26:0/2160622779 shutdown_connections 2023-10-01T07:54:10.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.230+0000 7fc833489700 1 --2- 172.21.15.26:0/2160622779 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc82c134260 0x7fc82c09cf00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.230+0000 7fc833489700 1 --2- 172.21.15.26:0/2160622779 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc82c133420 0x7fc82c09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.230+0000 7fc833489700 1 --2- 172.21.15.26:0/2160622779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc82c133e30 0x7fc82c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.230+0000 7fc833489700 1 -- 172.21.15.26:0/2160622779 >> 172.21.15.26:0/2160622779 conn(0x7fc82c0a4210 msgr2=0x7fc82c0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:10.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.230+0000 7fc833489700 1 -- 172.21.15.26:0/2160622779 shutdown_connections 2023-10-01T07:54:10.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.230+0000 7fc833489700 1 -- 172.21.15.26:0/2160622779 wait complete. 2023-10-01T07:54:10.245 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-01T07:54:10.246 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-01T07:54:10.246 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-01T07:54:10.247 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-01T07:54:10.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.399+0000 7f367ae0c700 1 Processor -- start 2023-10-01T07:54:10.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.399+0000 7f367ae0c700 1 -- start start 2023-10-01T07:54:10.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.400+0000 7f367ae0c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f367406e570 0x7f367406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.400+0000 7f367ae0c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f367409eca0 0x7f367406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.400+0000 7f367ae0c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3674070ee0 con 0x7f3674134610 2023-10-01T07:54:10.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.400+0000 7f367ae0c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3674071480 con 0x7f367409eca0 2023-10-01T07:54:10.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.400+0000 7f367ae0c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f367406f3c0 con 0x7f367406e570 2023-10-01T07:54:10.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.400+0000 7f3678ba8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f367406e570 0x7f367406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.400+0000 7f36793a9700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3674134610 0x7f3674134a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43830/0 (socket says 172.21.15.26:43830) 2023-10-01T07:54:10.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.400+0000 7f36793a9700 1 -- 172.21.15.26:0/1718219326 learned_addr learned my addr 172.21.15.26:0/1718219326 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:10.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.401+0000 7f3673fff700 1 --2- 172.21.15.26:0/1718219326 >> v2:172.21.15.26:3300/0 conn(0x7f367409eca0 0x7f367406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.401+0000 7f3678ba8700 1 -- 172.21.15.26:0/1718219326 >> v2:172.21.15.26:3300/0 conn(0x7f367409eca0 msgr2=0x7f367406ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:10.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.401+0000 7f3678ba8700 1 --2- 172.21.15.26:0/1718219326 >> v2:172.21.15.26:3300/0 conn(0x7f367409eca0 0x7f367406ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.401+0000 7f3678ba8700 1 -- 172.21.15.26:0/1718219326 >> v1:172.21.15.26:6789/0 conn(0x7f3674134610 legacy=0x7f3674134a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.401+0000 7f3678ba8700 1 -- 172.21.15.26:0/1718219326 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3674071b90 con 0x7f367406e570 2023-10-01T07:54:10.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.401+0000 7f3678ba8700 1 --2- 172.21.15.26:0/1718219326 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f367406e570 0x7f367406e940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3668009840 tx=0x7f3668009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd11df59cc786d25 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:10.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.401+0000 7f36737fe700 1 -- 172.21.15.26:0/1718219326 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3668011830 con 0x7f367406e570 2023-10-01T07:54:10.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.401+0000 7f36737fe700 1 -- 172.21.15.26:0/1718219326 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3668011990 con 0x7f367406e570 2023-10-01T07:54:10.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.401+0000 7f36737fe700 1 -- 172.21.15.26:0/1718219326 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3668011d20 con 0x7f367406e570 2023-10-01T07:54:10.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.402+0000 7f367ae0c700 1 -- 172.21.15.26:0/1718219326 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f367406e570 msgr2=0x7f367406e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.402+0000 7f367ae0c700 1 --2- 172.21.15.26:0/1718219326 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f367406e570 0x7f367406e940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3668009840 tx=0x7f3668009b50 comp rx=0 tx=0).stop 2023-10-01T07:54:10.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.402+0000 7f367ae0c700 1 -- 172.21.15.26:0/1718219326 shutdown_connections 2023-10-01T07:54:10.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.402+0000 7f367ae0c700 1 --2- 172.21.15.26:0/1718219326 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f367406e570 0x7f367406e940 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.402+0000 7f367ae0c700 1 --2- 172.21.15.26:0/1718219326 >> v2:172.21.15.26:3300/0 conn(0x7f367409eca0 0x7f367406ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.402+0000 7f367ae0c700 1 -- 172.21.15.26:0/1718219326 >> 172.21.15.26:0/1718219326 conn(0x7f36740a2aa0 msgr2=0x7f36740a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:10.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.402+0000 7f367ae0c700 1 -- 172.21.15.26:0/1718219326 shutdown_connections 2023-10-01T07:54:10.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.402+0000 7f367ae0c700 1 -- 172.21.15.26:0/1718219326 wait complete. 2023-10-01T07:54:10.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.403+0000 7f367ae0c700 1 Processor -- start 2023-10-01T07:54:10.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.403+0000 7f367ae0c700 1 -- start start 2023-10-01T07:54:10.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.404+0000 7f367ae0c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f367406e570 0x7f3674122560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.404+0000 7f367ae0c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3674134610 0x7f3674122aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.404+0000 7f367ae0c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3674122fe0 0x7f36741cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.404+0000 7f367ae0c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3674125da0 con 0x7f3674134610 2023-10-01T07:54:10.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.404+0000 7f367ae0c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3674126c60 con 0x7f3674122fe0 2023-10-01T07:54:10.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.404+0000 7f367ae0c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3674124720 con 0x7f367406e570 2023-10-01T07:54:10.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.404+0000 7f3678ba8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f367406e570 0x7f3674122560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.404+0000 7f36793a9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3674122fe0 0x7f36741cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.405+0000 7f3678ba8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f367406e570 0x7f3674122560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:42762/0 (socket says 172.21.15.26:42762) 2023-10-01T07:54:10.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.405+0000 7f3673fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3674134610 0x7f3674122aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.405+0000 7f3678ba8700 1 -- 172.21.15.26:0/1911971053 learned_addr learned my addr 172.21.15.26:0/1911971053 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:10.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.405+0000 7f36793a9700 1 -- 172.21.15.26:0/1911971053 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f367406e570 msgr2=0x7f3674122560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.405+0000 7f36793a9700 1 --2- 172.21.15.26:0/1911971053 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f367406e570 0x7f3674122560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.405+0000 7f36793a9700 1 -- 172.21.15.26:0/1911971053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3674134610 msgr2=0x7f3674122aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.405+0000 7f36793a9700 1 --2- 172.21.15.26:0/1911971053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3674134610 0x7f3674122aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.405+0000 7f36793a9700 1 -- 172.21.15.26:0/1911971053 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36680094a0 con 0x7f3674122fe0 2023-10-01T07:54:10.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.405+0000 7f3678ba8700 1 --2- 172.21.15.26:0/1911971053 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f367406e570 0x7f3674122560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:10.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.405+0000 7f36793a9700 1 --2- 172.21.15.26:0/1911971053 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3674122fe0 0x7f36741cca00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f366c00caa0 tx=0x7f366c00cdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:10.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.406+0000 7f36717fa700 1 -- 172.21.15.26:0/1911971053 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366c00a9a0 con 0x7f3674122fe0 2023-10-01T07:54:10.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.406+0000 7f36717fa700 1 -- 172.21.15.26:0/1911971053 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366c00ab00 con 0x7f3674122fe0 2023-10-01T07:54:10.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.406+0000 7f36717fa700 1 -- 172.21.15.26:0/1911971053 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366c00ae70 con 0x7f3674122fe0 2023-10-01T07:54:10.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.406+0000 7f367ae0c700 1 -- 172.21.15.26:0/1911971053 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36740a2320 con 0x7f3674122fe0 2023-10-01T07:54:10.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.406+0000 7f367ae0c700 1 -- 172.21.15.26:0/1911971053 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3674124170 con 0x7f3674122fe0 2023-10-01T07:54:10.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.407+0000 7f367ae0c700 1 -- 172.21.15.26:0/1911971053 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f36740722d0 con 0x7f3674122fe0 2023-10-01T07:54:10.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.407+0000 7f36717fa700 1 -- 172.21.15.26:0/1911971053 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f366c01b3b0 con 0x7f3674122fe0 2023-10-01T07:54:10.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.407+0000 7f3678ba8700 1 -- 172.21.15.26:0/1911971053 >> v1:172.21.15.26:6816/118178 conn(0x7f365802c1b0 legacy=0x7f365802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/118178 2023-10-01T07:54:10.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.407+0000 7f36717fa700 1 -- 172.21.15.26:0/1911971053 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f366c01a360 con 0x7f3674122fe0 2023-10-01T07:54:10.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.407+0000 7f36717fa700 1 -- 172.21.15.26:0/1911971053 --> v1:172.21.15.26:6800/118773 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3658038e10 con 0x7f3658035110 2023-10-01T07:54:10.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.407+0000 7f36717fa700 1 -- 172.21.15.26:0/1911971053 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f366c0192c0 con 0x7f3674122fe0 2023-10-01T07:54:10.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.408+0000 7f03ac7d6700 1 Processor -- start 2023-10-01T07:54:10.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.408+0000 7f03ac7d6700 1 -- start start 2023-10-01T07:54:10.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.409+0000 7f36717fa700 1 -- 172.21.15.26:0/1911971053 <== osd.0 v1:172.21.15.26:6800/118773 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f3658038e10 con 0x7f3658035110 2023-10-01T07:54:10.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.409+0000 7f03ac7d6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03a41338c0 0x7f03a4133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.409+0000 7f03ac7d6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03a41341d0 0x7f03a409de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.409+0000 7f03ac7d6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f03a409e390 0x7f03a409e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.409+0000 7f03ac7d6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a4070c80 con 0x7f03a409e390 2023-10-01T07:54:10.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.409+0000 7f03ac7d6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a406f720 con 0x7f03a41338c0 2023-10-01T07:54:10.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.409+0000 7f03ac7d6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03a406fce0 con 0x7f03a41341d0 2023-10-01T07:54:10.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.409+0000 7f03a9d71700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03a41341d0 0x7f03a409de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.409+0000 7f03a9d71700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03a41341d0 0x7f03a409de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:42778/0 (socket says 172.21.15.26:42778) 2023-10-01T07:54:10.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.410+0000 7f03a9d71700 1 -- 172.21.15.26:0/552714004 learned_addr learned my addr 172.21.15.26:0/552714004 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:10.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.410+0000 7f03aa572700 1 --2- 172.21.15.26:0/552714004 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03a41338c0 0x7f03a4133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.410+0000 7f03aad73700 1 --2- 172.21.15.26:0/552714004 >> v2:172.21.15.26:3300/0 conn(0x7f03a409e390 0x7f03a409e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.410+0000 7f03aad73700 1 -- 172.21.15.26:0/552714004 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03a41341d0 msgr2=0x7f03a409de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:10.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.410+0000 7f03aad73700 1 --2- 172.21.15.26:0/552714004 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03a41341d0 0x7f03a409de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.410+0000 7f03aad73700 1 -- 172.21.15.26:0/552714004 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03a41338c0 msgr2=0x7f03a4133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:10.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.410+0000 7f03aad73700 1 --2- 172.21.15.26:0/552714004 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03a41338c0 0x7f03a4133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.410+0000 7f03aad73700 1 -- 172.21.15.26:0/552714004 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a41336a0 con 0x7f03a409e390 2023-10-01T07:54:10.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.410+0000 7f03aad73700 1 --2- 172.21.15.26:0/552714004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03a409e390 0x7f03a409e800 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f039c009d90 tx=0x7f039c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5cdff35372791c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:10.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.411+0000 7f03a9570700 1 -- 172.21.15.26:0/552714004 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039c00e070 con 0x7f03a409e390 2023-10-01T07:54:10.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.411+0000 7f03a9570700 1 -- 172.21.15.26:0/552714004 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f039c00bb20 con 0x7f03a409e390 2023-10-01T07:54:10.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.411+0000 7f03a9570700 1 -- 172.21.15.26:0/552714004 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039c012430 con 0x7f03a409e390 2023-10-01T07:54:10.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.412+0000 7f03ac7d6700 1 -- 172.21.15.26:0/552714004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03a409e390 msgr2=0x7f03a409e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.412+0000 7f03ac7d6700 1 --2- 172.21.15.26:0/552714004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03a409e390 0x7f03a409e800 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f039c009d90 tx=0x7f039c00b330 comp rx=0 tx=0).stop 2023-10-01T07:54:10.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.412+0000 7f03ac7d6700 1 -- 172.21.15.26:0/552714004 shutdown_connections 2023-10-01T07:54:10.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.412+0000 7f03ac7d6700 1 --2- 172.21.15.26:0/552714004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03a409e390 0x7f03a409e800 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.412+0000 7f03ac7d6700 1 --2- 172.21.15.26:0/552714004 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03a41338c0 0x7f03a4133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.412+0000 7f03ac7d6700 1 --2- 172.21.15.26:0/552714004 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03a41341d0 0x7f03a409de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.412+0000 7f03ac7d6700 1 -- 172.21.15.26:0/552714004 >> 172.21.15.26:0/552714004 conn(0x7f03a40a2aa0 msgr2=0x7f03a40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:10.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.412+0000 7f03ac7d6700 1 -- 172.21.15.26:0/552714004 shutdown_connections 2023-10-01T07:54:10.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.412+0000 7f03ac7d6700 1 -- 172.21.15.26:0/552714004 wait complete. 2023-10-01T07:54:10.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.414+0000 7f03ac7d6700 1 Processor -- start 2023-10-01T07:54:10.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.414+0000 7f03ac7d6700 1 -- start start 2023-10-01T07:54:10.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.414+0000 7f03ac7d6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03a409e390 0x7f03a411f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.414+0000 7f03ac7d6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03a41338c0 0x7f03a411fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.414+0000 7f03ac7d6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03a41341d0 0x7f03a4120260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.414+0000 7f03ac7d6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a4121570 con 0x7f03a41338c0 2023-10-01T07:54:10.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.414+0000 7f03ac7d6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a4122280 con 0x7f03a409e390 2023-10-01T07:54:10.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.414+0000 7f03ac7d6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03a4122640 con 0x7f03a41341d0 2023-10-01T07:54:10.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.415+0000 7f03aad73700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03a41341d0 0x7f03a4120260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.415+0000 7f03aad73700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03a41341d0 0x7f03a4120260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:42788/0 (socket says 172.21.15.26:42788) 2023-10-01T07:54:10.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.415+0000 7f03aad73700 1 -- 172.21.15.26:0/3308187722 learned_addr learned my addr 172.21.15.26:0/3308187722 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:10.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.415+0000 7f03a9d71700 1 --2- 172.21.15.26:0/3308187722 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03a41338c0 0x7f03a411fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.415+0000 7f03aad73700 1 -- 172.21.15.26:0/3308187722 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03a409e390 msgr2=0x7f03a411f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.415+0000 7f03aad73700 1 --2- 172.21.15.26:0/3308187722 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03a409e390 0x7f03a411f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.415+0000 7f03aad73700 1 -- 172.21.15.26:0/3308187722 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03a41338c0 msgr2=0x7f03a411fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.415+0000 7f03aad73700 1 --2- 172.21.15.26:0/3308187722 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03a41338c0 0x7f03a411fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.415+0000 7f03aad73700 1 -- 172.21.15.26:0/3308187722 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039c009a70 con 0x7f03a41341d0 2023-10-01T07:54:10.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.415+0000 7f03aad73700 1 --2- 172.21.15.26:0/3308187722 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03a41341d0 0x7f03a4120260 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f03a40706a0 tx=0x7f039c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:10.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.416+0000 7f039affd700 1 -- 172.21.15.26:0/3308187722 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039c004830 con 0x7f03a41341d0 2023-10-01T07:54:10.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.416+0000 7f039affd700 1 -- 172.21.15.26:0/3308187722 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f039c020070 con 0x7f03a41341d0 2023-10-01T07:54:10.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.416+0000 7f039affd700 1 -- 172.21.15.26:0/3308187722 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039c0276a0 con 0x7f03a41341d0 2023-10-01T07:54:10.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.416+0000 7f03ac7d6700 1 -- 172.21.15.26:0/3308187722 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a4123300 con 0x7f03a41341d0 2023-10-01T07:54:10.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.416+0000 7f03ac7d6700 1 -- 172.21.15.26:0/3308187722 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a4122d60 con 0x7f03a41341d0 2023-10-01T07:54:10.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.417+0000 7f03ac7d6700 1 -- 172.21.15.26:0/3308187722 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f03a4066680 con 0x7f03a41341d0 2023-10-01T07:54:10.419 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:10.416+0000 7f6cc52b3240 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-01T07:54:10.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.417+0000 7f039affd700 1 -- 172.21.15.26:0/3308187722 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f039c027800 con 0x7f03a41341d0 2023-10-01T07:54:10.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.417+0000 7f039affd700 1 -- 172.21.15.26:0/3308187722 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f039c022070 con 0x7f03a41341d0 2023-10-01T07:54:10.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.417+0000 7f03aa572700 1 -- 172.21.15.26:0/3308187722 >> v1:172.21.15.26:6816/118178 conn(0x7f038802c1b0 legacy=0x7f038802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/118178 2023-10-01T07:54:10.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.418+0000 7f039affd700 1 -- 172.21.15.26:0/3308187722 --> v1:172.21.15.26:6804/118782 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0388038e90 con 0x7f0388035190 2023-10-01T07:54:10.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.418+0000 7f039affd700 1 -- 172.21.15.26:0/3308187722 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f039c03fc50 con 0x7f03a41341d0 2023-10-01T07:54:10.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.419+0000 7f039affd700 1 -- 172.21.15.26:0/3308187722 <== osd.1 v1:172.21.15.26:6804/118782 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f0388038e90 con 0x7f0388035190 2023-10-01T07:54:10.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.429+0000 7f367ae0c700 1 -- 172.21.15.26:0/1911971053 --> v1:172.21.15.26:6800/118773 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3674135180 con 0x7f3658035110 2023-10-01T07:54:10.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.430+0000 7f36717fa700 1 -- 172.21.15.26:0/1911971053 <== osd.0 v1:172.21.15.26:6800/118773 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2188548419) 0x7f36600096c0 con 0x7f3658035110 2023-10-01T07:54:10.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.430+0000 7f367ae0c700 1 -- 172.21.15.26:0/1911971053 >> v1:172.21.15.26:6800/118773 conn(0x7f3658035110 legacy=0x7f36580375a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.430+0000 7f367ae0c700 1 -- 172.21.15.26:0/1911971053 >> v1:172.21.15.26:6816/118178 conn(0x7f365802c1b0 legacy=0x7f365802e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:10.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.430+0000 7f367ae0c700 1 -- 172.21.15.26:0/1911971053 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3674122fe0 msgr2=0x7f36741cca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.430+0000 7f367ae0c700 1 --2- 172.21.15.26:0/1911971053 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3674122fe0 0x7f36741cca00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f366c00caa0 tx=0x7f366c00cdb0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.430+0000 7f36793a9700 1 -- 172.21.15.26:0/1911971053 reap_dead start 2023-10-01T07:54:10.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.431+0000 7f367ae0c700 1 -- 172.21.15.26:0/1911971053 shutdown_connections 2023-10-01T07:54:10.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.431+0000 7f367ae0c700 1 -- 172.21.15.26:0/1911971053 >> 172.21.15.26:0/1911971053 conn(0x7f36740a2aa0 msgr2=0x7f36740a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:10.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.431+0000 7f367ae0c700 1 -- 172.21.15.26:0/1911971053 shutdown_connections 2023-10-01T07:54:10.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.431+0000 7f367ae0c700 1 -- 172.21.15.26:0/1911971053 wait complete. 2023-10-01T07:54:10.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.452+0000 7f03ac7d6700 1 -- 172.21.15.26:0/3308187722 --> v1:172.21.15.26:6804/118782 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f03a406eef0 con 0x7f0388035190 2023-10-01T07:54:10.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.452+0000 7f039affd700 1 -- 172.21.15.26:0/3308187722 <== osd.1 v1:172.21.15.26:6804/118782 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2188548419) 0x7f03940097a0 con 0x7f0388035190 2023-10-01T07:54:10.454 INFO:teuthology.orchestra.run.smithi026.stdout:38654705695 2023-10-01T07:54:10.454 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:54:10.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.453+0000 7f03ac7d6700 1 -- 172.21.15.26:0/3308187722 >> v1:172.21.15.26:6804/118782 conn(0x7f0388035190 legacy=0x7f0388037620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.453+0000 7f03ac7d6700 1 -- 172.21.15.26:0/3308187722 >> v1:172.21.15.26:6816/118178 conn(0x7f038802c1b0 legacy=0x7f038802e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:10.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.453+0000 7f03ac7d6700 1 -- 172.21.15.26:0/3308187722 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03a41341d0 msgr2=0x7f03a4120260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.453+0000 7f03ac7d6700 1 --2- 172.21.15.26:0/3308187722 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03a41341d0 0x7f03a4120260 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f03a40706a0 tx=0x7f039c004ad0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.453+0000 7f03aad73700 1 -- 172.21.15.26:0/3308187722 reap_dead start 2023-10-01T07:54:10.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.453+0000 7f03ac7d6700 1 -- 172.21.15.26:0/3308187722 shutdown_connections 2023-10-01T07:54:10.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.453+0000 7f03ac7d6700 1 -- 172.21.15.26:0/3308187722 >> 172.21.15.26:0/3308187722 conn(0x7f03a40a2aa0 msgr2=0x7f03a40a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:10.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.453+0000 7f03ac7d6700 1 -- 172.21.15.26:0/3308187722 shutdown_connections 2023-10-01T07:54:10.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.454+0000 7f03ac7d6700 1 -- 172.21.15.26:0/3308187722 wait complete. 2023-10-01T07:54:10.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.454+0000 7f3312c4c700 1 Processor -- start 2023-10-01T07:54:10.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.454+0000 7f3312c4c700 1 -- start start 2023-10-01T07:54:10.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.455+0000 7f3312c4c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f330c0a1510 0x7f330c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.455+0000 7f3312c4c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f330c139250 0x7f330c13b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.455+0000 7f3312c4c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f330c09edd0 con 0x7f330c0a0a30 2023-10-01T07:54:10.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.455+0000 7f3312c4c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f330c0a18e0 con 0x7f330c139250 2023-10-01T07:54:10.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.455+0000 7f3312c4c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f330c09e1f0 con 0x7f330c0a1510 2023-10-01T07:54:10.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.455+0000 7f33109e8700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f330c0a0a30 0x7f330c0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43832/0 (socket says 172.21.15.26:43832) 2023-10-01T07:54:10.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.455+0000 7f33109e8700 1 -- 172.21.15.26:0/2698544222 learned_addr learned my addr 172.21.15.26:0/2698544222 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:10.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.455+0000 7f33111e9700 1 --2- 172.21.15.26:0/2698544222 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f330c139250 0x7f330c13b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.456+0000 7f330bfff700 1 --2- 172.21.15.26:0/2698544222 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f330c0a1510 0x7f330c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.456+0000 7f330b7fe700 1 -- 172.21.15.26:0/2698544222 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3705223424 0 0) 0x7f330c09edd0 con 0x7f330c0a0a30 2023-10-01T07:54:10.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.456+0000 7f330b7fe700 1 -- 172.21.15.26:0/2698544222 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32fc0035b0 con 0x7f330c0a0a30 2023-10-01T07:54:10.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.456+0000 7f33111e9700 1 -- 172.21.15.26:0/2698544222 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f330c0a1510 msgr2=0x7f330c138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:10.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.456+0000 7f33111e9700 1 --2- 172.21.15.26:0/2698544222 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f330c0a1510 0x7f330c138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.456+0000 7f33111e9700 1 -- 172.21.15.26:0/2698544222 >> v1:172.21.15.26:6789/0 conn(0x7f330c0a0a30 legacy=0x7f330c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.456+0000 7f33111e9700 1 -- 172.21.15.26:0/2698544222 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330c09dc50 con 0x7f330c139250 2023-10-01T07:54:10.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.456+0000 7f33111e9700 1 --2- 172.21.15.26:0/2698544222 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f330c139250 0x7f330c13b630 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3304009dc0 tx=0x7f330400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f64cee47902f45f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:10.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.457+0000 7f330b7fe700 1 -- 172.21.15.26:0/2698544222 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330400e070 con 0x7f330c139250 2023-10-01T07:54:10.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.457+0000 7f330b7fe700 1 -- 172.21.15.26:0/2698544222 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330400bb20 con 0x7f330c139250 2023-10-01T07:54:10.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.457+0000 7f330b7fe700 1 -- 172.21.15.26:0/2698544222 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3304012430 con 0x7f330c139250 2023-10-01T07:54:10.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.457+0000 7f3312c4c700 1 -- 172.21.15.26:0/2698544222 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f330c139250 msgr2=0x7f330c13b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.457+0000 7f3312c4c700 1 --2- 172.21.15.26:0/2698544222 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f330c139250 0x7f330c13b630 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3304009dc0 tx=0x7f330400b330 comp rx=0 tx=0).stop 2023-10-01T07:54:10.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.458+0000 7f3312c4c700 1 -- 172.21.15.26:0/2698544222 shutdown_connections 2023-10-01T07:54:10.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.458+0000 7f3312c4c700 1 --2- 172.21.15.26:0/2698544222 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f330c139250 0x7f330c13b630 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.458+0000 7f3312c4c700 1 --2- 172.21.15.26:0/2698544222 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f330c0a1510 0x7f330c138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.458+0000 7f3312c4c700 1 -- 172.21.15.26:0/2698544222 >> 172.21.15.26:0/2698544222 conn(0x7f330c0a6550 msgr2=0x7f330c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:10.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.458+0000 7f3312c4c700 1 -- 172.21.15.26:0/2698544222 shutdown_connections 2023-10-01T07:54:10.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.458+0000 7f3312c4c700 1 -- 172.21.15.26:0/2698544222 wait complete. 2023-10-01T07:54:10.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.459+0000 7f3312c4c700 1 Processor -- start 2023-10-01T07:54:10.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.459+0000 7f3312c4c700 1 -- start start 2023-10-01T07:54:10.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.460+0000 7f3312c4c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f330c0a0a30 0x7f330c1226d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.460+0000 7f3312c4c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f330c0a1510 0x7f330c122c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.460+0000 7f3312c4c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f330c139250 0x7f330c123150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.460+0000 7f3312c4c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330c138000 con 0x7f330c0a0a30 2023-10-01T07:54:10.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.460+0000 7f3312c4c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f330c125c50 con 0x7f330c0a1510 2023-10-01T07:54:10.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.460+0000 7f3312c4c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f330c138a10 con 0x7f330c139250 2023-10-01T07:54:10.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.460+0000 7f33109e8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f330c0a0a30 0x7f330c1226d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.460+0000 7f33109e8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f330c0a0a30 0x7f330c1226d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49556/0 (socket says 172.21.15.26:49556) 2023-10-01T07:54:10.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.460+0000 7f33109e8700 1 -- 172.21.15.26:0/70046667 learned_addr learned my addr 172.21.15.26:0/70046667 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:10.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.460+0000 7f33111e9700 1 --2- 172.21.15.26:0/70046667 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f330c139250 0x7f330c123150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.460+0000 7f33109e8700 1 -- 172.21.15.26:0/70046667 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f330c139250 msgr2=0x7f330c123150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.460+0000 7f33109e8700 1 --2- 172.21.15.26:0/70046667 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f330c139250 0x7f330c123150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.460+0000 7f33109e8700 1 -- 172.21.15.26:0/70046667 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f330c0a1510 msgr2=0x7f330c122c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.460+0000 7f33109e8700 1 --2- 172.21.15.26:0/70046667 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f330c0a1510 0x7f330c122c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.460+0000 7f33109e8700 1 -- 172.21.15.26:0/70046667 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3304009a70 con 0x7f330c0a0a30 2023-10-01T07:54:10.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.461+0000 7f33109e8700 1 --2- 172.21.15.26:0/70046667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f330c0a0a30 0x7f330c1226d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f330000c700 tx=0x7f330000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:10.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.461+0000 7f33097fa700 1 -- 172.21.15.26:0/70046667 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3300005d70 con 0x7f330c0a0a30 2023-10-01T07:54:10.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.461+0000 7f33097fa700 1 -- 172.21.15.26:0/70046667 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33000070d0 con 0x7f330c0a0a30 2023-10-01T07:54:10.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.461+0000 7f3312c4c700 1 -- 172.21.15.26:0/70046667 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f330c1385c0 con 0x7f330c0a0a30 2023-10-01T07:54:10.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.461+0000 7f33097fa700 1 -- 172.21.15.26:0/70046667 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3300007460 con 0x7f330c0a0a30 2023-10-01T07:54:10.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.461+0000 7f3312c4c700 1 -- 172.21.15.26:0/70046667 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f330c124ae0 con 0x7f330c0a0a30 2023-10-01T07:54:10.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.463+0000 7f33097fa700 1 -- 172.21.15.26:0/70046667 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f33000075c0 con 0x7f330c0a0a30 2023-10-01T07:54:10.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.463+0000 7f3312c4c700 1 -- 172.21.15.26:0/70046667 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f330c06cf30 con 0x7f330c0a0a30 2023-10-01T07:54:10.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.463+0000 7f33097fa700 1 -- 172.21.15.26:0/70046667 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f330003af40 con 0x7f330c0a0a30 2023-10-01T07:54:10.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.463+0000 7f330bfff700 1 -- 172.21.15.26:0/70046667 >> v1:172.21.15.26:6816/118178 conn(0x7f32f002c1b0 legacy=0x7f32f002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/118178 2023-10-01T07:54:10.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.463+0000 7f33097fa700 1 -- 172.21.15.26:0/70046667 --> v1:172.21.15.26:6805/118789 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f32f0038e90 con 0x7f32f0035190 2023-10-01T07:54:10.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.463+0000 7f33097fa700 1 -- 172.21.15.26:0/70046667 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f330001b3b0 con 0x7f330c0a0a30 2023-10-01T07:54:10.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.464+0000 7f79c6f7a700 1 Processor -- start 2023-10-01T07:54:10.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.464+0000 7f79c6f7a700 1 -- start start 2023-10-01T07:54:10.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.464+0000 7f33097fa700 1 -- 172.21.15.26:0/70046667 <== osd.2 v1:172.21.15.26:6805/118789 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f32f0038e90 con 0x7f32f0035190 2023-10-01T07:54:10.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.465+0000 7f79c6f7a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f79c0071b40 0x7f79c0130420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.465+0000 7f79c6f7a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79c0130960 0x7f79c0133570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.465+0000 7f79c6f7a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c0099ef0 con 0x7f79c0130d50 2023-10-01T07:54:10.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.465+0000 7f79c6f7a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c0099500 con 0x7f79c0071b40 2023-10-01T07:54:10.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.465+0000 7f79c6f7a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79c0099c10 con 0x7f79c0130960 2023-10-01T07:54:10.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.465+0000 7f79c4d16700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f79c0071b40 0x7f79c0130420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.465+0000 7f79c5517700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f79c0130d50 0x7f79c0133ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43846/0 (socket says 172.21.15.26:43846) 2023-10-01T07:54:10.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.465+0000 7f79c5517700 1 -- 172.21.15.26:0/1382544134 learned_addr learned my addr 172.21.15.26:0/1382544134 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:10.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.465+0000 7f79bffff700 1 --2- 172.21.15.26:0/1382544134 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79c0130960 0x7f79c0133570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.466+0000 7f79bffff700 1 -- 172.21.15.26:0/1382544134 >> v2:172.21.15.26:3300/0 conn(0x7f79c0071b40 msgr2=0x7f79c0130420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:10.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.466+0000 7f79bffff700 1 --2- 172.21.15.26:0/1382544134 >> v2:172.21.15.26:3300/0 conn(0x7f79c0071b40 0x7f79c0130420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.466+0000 7f79bffff700 1 -- 172.21.15.26:0/1382544134 >> v1:172.21.15.26:6789/0 conn(0x7f79c0130d50 legacy=0x7f79c0133ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.466+0000 7f79bffff700 1 -- 172.21.15.26:0/1382544134 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c009e370 con 0x7f79c0130960 2023-10-01T07:54:10.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.466+0000 7f79bffff700 1 --2- 172.21.15.26:0/1382544134 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79c0130960 0x7f79c0133570 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f79a8009840 tx=0x7f79a8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd8e7990b3682d23 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:10.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.466+0000 7f79bf7fe700 1 -- 172.21.15.26:0/1382544134 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a8011830 con 0x7f79c0130960 2023-10-01T07:54:10.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.467+0000 7f79c4d16700 1 --2- 172.21.15.26:0/1382544134 >> v2:172.21.15.26:3300/0 conn(0x7f79c0071b40 0x7f79c0130420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:54:10.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.467+0000 7f79bf7fe700 1 -- 172.21.15.26:0/1382544134 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a8011990 con 0x7f79c0130960 2023-10-01T07:54:10.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.467+0000 7f79bf7fe700 1 -- 172.21.15.26:0/1382544134 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a8011d20 con 0x7f79c0130960 2023-10-01T07:54:10.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.468+0000 7f79c6f7a700 1 -- 172.21.15.26:0/1382544134 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79c0130960 msgr2=0x7f79c0133570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.468+0000 7f79c6f7a700 1 --2- 172.21.15.26:0/1382544134 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79c0130960 0x7f79c0133570 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f79a8009840 tx=0x7f79a8009b50 comp rx=0 tx=0).stop 2023-10-01T07:54:10.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.468+0000 7f79c6f7a700 1 -- 172.21.15.26:0/1382544134 shutdown_connections 2023-10-01T07:54:10.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.468+0000 7f79c6f7a700 1 --2- 172.21.15.26:0/1382544134 >> v2:172.21.15.26:3300/0 conn(0x7f79c0071b40 0x7f79c0130420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.468+0000 7f79c6f7a700 1 --2- 172.21.15.26:0/1382544134 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79c0130960 0x7f79c0133570 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.468+0000 7f79c6f7a700 1 -- 172.21.15.26:0/1382544134 >> 172.21.15.26:0/1382544134 conn(0x7f79c009e7e0 msgr2=0x7f79c009ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:10.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.469+0000 7f79c6f7a700 1 -- 172.21.15.26:0/1382544134 shutdown_connections 2023-10-01T07:54:10.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.469+0000 7f79c6f7a700 1 -- 172.21.15.26:0/1382544134 wait complete. 2023-10-01T07:54:10.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.470+0000 7f79c6f7a700 1 Processor -- start 2023-10-01T07:54:10.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.470+0000 7f79c6f7a700 1 -- start start 2023-10-01T07:54:10.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.471+0000 7f79c6f7a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79c0071b40 0x7f79c0126e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.471+0000 7f79c6f7a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79c0130960 0x7f79c0127340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.471+0000 7f79c6f7a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79c0130d50 0x7f79c0127880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.471+0000 7f79c6f7a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c009c150 con 0x7f79c0130960 2023-10-01T07:54:10.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.471+0000 7f79c6f7a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c012a1c0 con 0x7f79c0130d50 2023-10-01T07:54:10.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.471+0000 7f79c6f7a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79c0129040 con 0x7f79c0071b40 2023-10-01T07:54:10.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.471+0000 7f79c4d16700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79c0071b40 0x7f79c0126e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.471+0000 7f79c5517700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79c0130d50 0x7f79c0127880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.472+0000 7f79c4d16700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79c0071b40 0x7f79c0126e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:42838/0 (socket says 172.21.15.26:42838) 2023-10-01T07:54:10.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.472+0000 7f79c4d16700 1 -- 172.21.15.26:0/3315516160 learned_addr learned my addr 172.21.15.26:0/3315516160 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:10.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.472+0000 7f79c5517700 1 -- 172.21.15.26:0/3315516160 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79c0071b40 msgr2=0x7f79c0126e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.472+0000 7f79c5517700 1 --2- 172.21.15.26:0/3315516160 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79c0071b40 0x7f79c0126e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.472+0000 7f79c5517700 1 -- 172.21.15.26:0/3315516160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79c0130960 msgr2=0x7f79c0127340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.472+0000 7f79c5517700 1 --2- 172.21.15.26:0/3315516160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79c0130960 0x7f79c0127340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.472+0000 7f79c5517700 1 -- 172.21.15.26:0/3315516160 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a80094a0 con 0x7f79c0130d50 2023-10-01T07:54:10.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.472+0000 7f79c5517700 1 --2- 172.21.15.26:0/3315516160 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79c0130d50 0x7f79c0127880 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f79c009dff0 tx=0x7f79b000c6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:10.475 INFO:teuthology.orchestra.run.smithi026.stdout:38654705695 2023-10-01T07:54:10.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.474+0000 7f79bd7fa700 1 -- 172.21.15.26:0/3315516160 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b0005d70 con 0x7f79c0130d50 2023-10-01T07:54:10.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.474+0000 7f79bd7fa700 1 -- 172.21.15.26:0/3315516160 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b000ce90 con 0x7f79c0130d50 2023-10-01T07:54:10.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.474+0000 7f79bd7fa700 1 -- 172.21.15.26:0/3315516160 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b00072d0 con 0x7f79c0130d50 2023-10-01T07:54:10.476 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:54:10.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.474+0000 7f79c6f7a700 1 -- 172.21.15.26:0/3315516160 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c013b1e0 con 0x7f79c0130d50 2023-10-01T07:54:10.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.474+0000 7f79c6f7a700 1 -- 172.21.15.26:0/3315516160 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c0128d30 con 0x7f79c0130d50 2023-10-01T07:54:10.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.475+0000 7f79c6f7a700 1 -- 172.21.15.26:0/3315516160 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f79a4000fb0 con 0x7f79c0130d50 2023-10-01T07:54:10.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.475+0000 7f79bd7fa700 1 -- 172.21.15.26:0/3315516160 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f79b0007430 con 0x7f79c0130d50 2023-10-01T07:54:10.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.475+0000 7f79bd7fa700 1 -- 172.21.15.26:0/3315516160 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f79b003abb0 con 0x7f79c0130d50 2023-10-01T07:54:10.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.475+0000 7f79c4d16700 1 -- 172.21.15.26:0/3315516160 >> v1:172.21.15.26:6816/118178 conn(0x7f79a002c1b0 legacy=0x7f79a002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/118178 2023-10-01T07:54:10.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.476+0000 7f79bd7fa700 1 -- 172.21.15.26:0/3315516160 --> v1:172.21.15.26:6812/118790 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f79a0038f10 con 0x7f79a0035210 2023-10-01T07:54:10.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.476+0000 7f79bd7fa700 1 -- 172.21.15.26:0/3315516160 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79b003f220 con 0x7f79c0130d50 2023-10-01T07:54:10.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.477+0000 7f79bd7fa700 1 -- 172.21.15.26:0/3315516160 <== osd.3 v1:172.21.15.26:6812/118790 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f79a0038f10 con 0x7f79a0035210 2023-10-01T07:54:10.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.483+0000 7f3312c4c700 1 -- 172.21.15.26:0/70046667 --> v1:172.21.15.26:6805/118789 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f330c0a1d40 con 0x7f32f0035190 2023-10-01T07:54:10.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.484+0000 7f33097fa700 1 -- 172.21.15.26:0/70046667 <== osd.2 v1:172.21.15.26:6805/118789 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2188548419) 0x7f3304012430 con 0x7f32f0035190 2023-10-01T07:54:10.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.484+0000 7f3312c4c700 1 -- 172.21.15.26:0/70046667 >> v1:172.21.15.26:6805/118789 conn(0x7f32f0035190 legacy=0x7f32f0037620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.485+0000 7f3312c4c700 1 -- 172.21.15.26:0/70046667 >> v1:172.21.15.26:6816/118178 conn(0x7f32f002c1b0 legacy=0x7f32f002e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:10.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.485+0000 7f3312c4c700 1 -- 172.21.15.26:0/70046667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f330c0a0a30 msgr2=0x7f330c1226d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.485+0000 7f3312c4c700 1 --2- 172.21.15.26:0/70046667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f330c0a0a30 0x7f330c1226d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f330000c700 tx=0x7f330000cac0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.485+0000 7f33111e9700 1 -- 172.21.15.26:0/70046667 reap_dead start 2023-10-01T07:54:10.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.485+0000 7f3312c4c700 1 -- 172.21.15.26:0/70046667 shutdown_connections 2023-10-01T07:54:10.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.485+0000 7f3312c4c700 1 -- 172.21.15.26:0/70046667 >> 172.21.15.26:0/70046667 conn(0x7f330c0a6550 msgr2=0x7f330c11c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:10.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.485+0000 7f3312c4c700 1 -- 172.21.15.26:0/70046667 shutdown_connections 2023-10-01T07:54:10.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.485+0000 7f3312c4c700 1 -- 172.21.15.26:0/70046667 wait complete. 2023-10-01T07:54:10.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.499+0000 7f79c6f7a700 1 -- 172.21.15.26:0/3315516160 --> v1:172.21.15.26:6812/118790 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f79a4002d00 con 0x7f79a0035210 2023-10-01T07:54:10.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.500+0000 7f79bd7fa700 1 -- 172.21.15.26:0/3315516160 <== osd.3 v1:172.21.15.26:6812/118790 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1880693312) 0x7f79a4002d00 con 0x7f79a0035210 2023-10-01T07:54:10.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.500+0000 7f79c6f7a700 1 -- 172.21.15.26:0/3315516160 >> v1:172.21.15.26:6812/118790 conn(0x7f79a0035210 legacy=0x7f79a00376a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.500+0000 7f79c6f7a700 1 -- 172.21.15.26:0/3315516160 >> v1:172.21.15.26:6816/118178 conn(0x7f79a002c1b0 legacy=0x7f79a002e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:10.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.500+0000 7f79c6f7a700 1 -- 172.21.15.26:0/3315516160 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79c0130d50 msgr2=0x7f79c0127880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.500+0000 7f79c6f7a700 1 --2- 172.21.15.26:0/3315516160 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79c0130d50 0x7f79c0127880 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f79c009dff0 tx=0x7f79b000c6e0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.500+0000 7f79c5517700 1 -- 172.21.15.26:0/3315516160 reap_dead start 2023-10-01T07:54:10.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.501+0000 7f79c6f7a700 1 -- 172.21.15.26:0/3315516160 shutdown_connections 2023-10-01T07:54:10.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.501+0000 7f79c6f7a700 1 -- 172.21.15.26:0/3315516160 >> 172.21.15.26:0/3315516160 conn(0x7f79c009e7e0 msgr2=0x7f79c009c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:10.503 INFO:teuthology.orchestra.run.smithi026.stdout:38654705695 2023-10-01T07:54:10.503 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:54:10.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.501+0000 7f79c6f7a700 1 -- 172.21.15.26:0/3315516160 shutdown_connections 2023-10-01T07:54:10.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.501+0000 7f79c6f7a700 1 -- 172.21.15.26:0/3315516160 wait complete. 2023-10-01T07:54:10.524 INFO:teuthology.orchestra.run.smithi026.stdout:38654705694 2023-10-01T07:54:10.524 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:54:10.589 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:10.589+0000 7f6cc52b3240 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-01T07:54:10.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.625+0000 7f91d303e700 1 Processor -- start 2023-10-01T07:54:10.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.625+0000 7f91d303e700 1 -- start start 2023-10-01T07:54:10.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.626+0000 7f91d303e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91cc06a770 0x7f91cc09d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.626+0000 7f91d303e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f91cc09dc30 0x7f91cc09e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.626+0000 7f91d303e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91cc09a810 con 0x7f91cc13c1e0 2023-10-01T07:54:10.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.626+0000 7f91d303e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91cc06ab40 con 0x7f91cc09dc30 2023-10-01T07:54:10.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.626+0000 7f91d303e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc09ebc0 con 0x7f91cc06a770 2023-10-01T07:54:10.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.626+0000 7f91d0dda700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91cc06a770 0x7f91cc09d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.626+0000 7f91d0dda700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91cc06a770 0x7f91cc09d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:42840/0 (socket says 172.21.15.26:42840) 2023-10-01T07:54:10.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.626+0000 7f91d0dda700 1 -- 172.21.15.26:0/2798888037 learned_addr learned my addr 172.21.15.26:0/2798888037 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:10.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.626+0000 7f91cbfff700 1 --2- 172.21.15.26:0/2798888037 >> v2:172.21.15.26:3300/0 conn(0x7f91cc09dc30 0x7f91cc09e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.627+0000 7f91d0dda700 1 -- 172.21.15.26:0/2798888037 >> v2:172.21.15.26:3300/0 conn(0x7f91cc09dc30 msgr2=0x7f91cc09e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:10.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.627+0000 7f91d0dda700 1 --2- 172.21.15.26:0/2798888037 >> v2:172.21.15.26:3300/0 conn(0x7f91cc09dc30 0x7f91cc09e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.627+0000 7f91cb7fe700 1 -- 172.21.15.26:0/2798888037 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2446224222 0 0) 0x7f91cc09a810 con 0x7f91cc13c1e0 2023-10-01T07:54:10.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.627+0000 7f91d0dda700 1 -- 172.21.15.26:0/2798888037 >> v1:172.21.15.26:6789/0 conn(0x7f91cc13c1e0 legacy=0x7f91cc13e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.627+0000 7f91d0dda700 1 -- 172.21.15.26:0/2798888037 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91cc09e920 con 0x7f91cc06a770 2023-10-01T07:54:10.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.627+0000 7f91d0dda700 1 --2- 172.21.15.26:0/2798888037 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91cc06a770 0x7f91cc09d6f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f91c0009920 tx=0x7f91c0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=218808b64dc84c4d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:10.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.627+0000 7f91cb7fe700 1 -- 172.21.15.26:0/2798888037 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c0011830 con 0x7f91cc06a770 2023-10-01T07:54:10.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.627+0000 7f91cb7fe700 1 -- 172.21.15.26:0/2798888037 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c0011990 con 0x7f91cc06a770 2023-10-01T07:54:10.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.627+0000 7f91cb7fe700 1 -- 172.21.15.26:0/2798888037 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c0011d20 con 0x7f91cc06a770 2023-10-01T07:54:10.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.628+0000 7f91d303e700 1 -- 172.21.15.26:0/2798888037 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91cc06a770 msgr2=0x7f91cc09d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.628+0000 7f91d303e700 1 --2- 172.21.15.26:0/2798888037 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91cc06a770 0x7f91cc09d6f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f91c0009920 tx=0x7f91c0009c30 comp rx=0 tx=0).stop 2023-10-01T07:54:10.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.628+0000 7f91d303e700 1 -- 172.21.15.26:0/2798888037 shutdown_connections 2023-10-01T07:54:10.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.628+0000 7f91d303e700 1 --2- 172.21.15.26:0/2798888037 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91cc06a770 0x7f91cc09d6f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.628+0000 7f91d303e700 1 --2- 172.21.15.26:0/2798888037 >> v2:172.21.15.26:3300/0 conn(0x7f91cc09dc30 0x7f91cc09e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.628+0000 7f91d303e700 1 -- 172.21.15.26:0/2798888037 >> 172.21.15.26:0/2798888037 conn(0x7f91cc066f50 msgr2=0x7f91cc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:10.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.628+0000 7f91d303e700 1 -- 172.21.15.26:0/2798888037 shutdown_connections 2023-10-01T07:54:10.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.628+0000 7f91d303e700 1 -- 172.21.15.26:0/2798888037 wait complete. 2023-10-01T07:54:10.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.629+0000 7f91d303e700 1 Processor -- start 2023-10-01T07:54:10.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.629+0000 7f91d303e700 1 -- start start 2023-10-01T07:54:10.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.630+0000 7f91d303e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91cc06a770 0x7f91cc127a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.630+0000 7f91d303e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91cc09dc30 0x7f91cc127f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.630+0000 7f91d303e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91cc13c1e0 0x7f91cc1cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.630+0000 7f91d303e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc127690 con 0x7f91cc06a770 2023-10-01T07:54:10.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.630+0000 7f91d303e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc13bb40 con 0x7f91cc13c1e0 2023-10-01T07:54:10.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.630+0000 7f91d303e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc12a9f0 con 0x7f91cc09dc30 2023-10-01T07:54:10.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.630+0000 7f91cbfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91cc09dc30 0x7f91cc127f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.630+0000 7f91cbfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91cc09dc30 0x7f91cc127f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:42850/0 (socket says 172.21.15.26:42850) 2023-10-01T07:54:10.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.630+0000 7f91cbfff700 1 -- 172.21.15.26:0/1503576914 learned_addr learned my addr 172.21.15.26:0/1503576914 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:10.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.631+0000 7f91d0dda700 1 --2- 172.21.15.26:0/1503576914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91cc06a770 0x7f91cc127a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.631+0000 7f91cbfff700 1 -- 172.21.15.26:0/1503576914 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91cc13c1e0 msgr2=0x7f91cc1cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.631+0000 7f91cbfff700 1 --2- 172.21.15.26:0/1503576914 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91cc13c1e0 0x7f91cc1cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.631+0000 7f91cbfff700 1 -- 172.21.15.26:0/1503576914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91cc06a770 msgr2=0x7f91cc127a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.631+0000 7f91cbfff700 1 --2- 172.21.15.26:0/1503576914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91cc06a770 0x7f91cc127a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.631+0000 7f91cbfff700 1 -- 172.21.15.26:0/1503576914 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c0009550 con 0x7f91cc09dc30 2023-10-01T07:54:10.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.631+0000 7f91cbfff700 1 --2- 172.21.15.26:0/1503576914 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91cc09dc30 0x7f91cc127f80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f91b800e9b0 tx=0x7f91b800ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:10.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.631+0000 7f91c97fa700 1 -- 172.21.15.26:0/1503576914 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b8009710 con 0x7f91cc09dc30 2023-10-01T07:54:10.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.631+0000 7f91c97fa700 1 -- 172.21.15.26:0/1503576914 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b800c850 con 0x7f91cc09dc30 2023-10-01T07:54:10.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.631+0000 7f91d303e700 1 -- 172.21.15.26:0/1503576914 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91cc128dc0 con 0x7f91cc09dc30 2023-10-01T07:54:10.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.631+0000 7f91d303e700 1 -- 172.21.15.26:0/1503576914 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91cc1295b0 con 0x7f91cc09dc30 2023-10-01T07:54:10.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.632+0000 7f91c97fa700 1 -- 172.21.15.26:0/1503576914 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b800cbe0 con 0x7f91cc09dc30 2023-10-01T07:54:10.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.633+0000 7f91c97fa700 1 -- 172.21.15.26:0/1503576914 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f91b8013470 con 0x7f91cc09dc30 2023-10-01T07:54:10.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.633+0000 7f91d303e700 1 -- 172.21.15.26:0/1503576914 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91ac0052e0 con 0x7f91cc09dc30 2023-10-01T07:54:10.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.633+0000 7f91c97fa700 1 -- 172.21.15.26:0/1503576914 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f91b803b9d0 con 0x7f91cc09dc30 2023-10-01T07:54:10.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.633+0000 7f91d0dda700 1 -- 172.21.15.26:0/1503576914 >> v1:172.21.15.26:6816/118178 conn(0x7f91b002c1b0 legacy=0x7f91b002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/118178 2023-10-01T07:54:10.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.639+0000 7f91c97fa700 1 -- 172.21.15.26:0/1503576914 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f91b8013720 con 0x7f91cc09dc30 2023-10-01T07:54:10.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.655+0000 7fbcf003d700 1 Processor -- start 2023-10-01T07:54:10.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.656+0000 7fbcf003d700 1 -- start start 2023-10-01T07:54:10.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.656+0000 7fbcf003d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbce8136830 0x7fbce8138c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.656+0000 7fbcf003d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbce8139150 0x7fbce813b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.656+0000 7fbcf003d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce806f720 con 0x7fbce81338c0 2023-10-01T07:54:10.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.656+0000 7fbcf003d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce8070c80 con 0x7fbce8139150 2023-10-01T07:54:10.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.656+0000 7fbcf003d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbce806fce0 con 0x7fbce8136830 2023-10-01T07:54:10.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.657+0000 7fbcee5da700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbce8139150 0x7fbce813b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.657+0000 7fbcee5da700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbce8139150 0x7fbce813b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49586/0 (socket says 172.21.15.26:49586) 2023-10-01T07:54:10.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.657+0000 7fbcee5da700 1 -- 172.21.15.26:0/1246388273 learned_addr learned my addr 172.21.15.26:0/1246388273 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:10.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.657+0000 7fbced5d8700 1 --2- 172.21.15.26:0/1246388273 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbce8136830 0x7fbce8138c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.657+0000 7fbcee5da700 1 -- 172.21.15.26:0/1246388273 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbce8136830 msgr2=0x7fbce8138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:10.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.657+0000 7fbcee5da700 1 --2- 172.21.15.26:0/1246388273 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbce8136830 0x7fbce8138c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.657+0000 7fbcee5da700 1 -- 172.21.15.26:0/1246388273 >> v1:172.21.15.26:6789/0 conn(0x7fbce81338c0 legacy=0x7fbce8133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:10.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.657+0000 7fbcee5da700 1 -- 172.21.15.26:0/1246388273 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce81336a0 con 0x7fbce8139150 2023-10-01T07:54:10.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.657+0000 7fbcee5da700 1 --2- 172.21.15.26:0/1246388273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbce8139150 0x7fbce813b530 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbce0009e50 tx=0x7fbce000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217fc3738ff33f8c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:10.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.658+0000 7fbcecdd7700 1 -- 172.21.15.26:0/1246388273 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce000e070 con 0x7fbce8139150 2023-10-01T07:54:10.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.658+0000 7fbcecdd7700 1 -- 172.21.15.26:0/1246388273 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce0003a20 con 0x7fbce8139150 2023-10-01T07:54:10.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.658+0000 7fbcecdd7700 1 -- 172.21.15.26:0/1246388273 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce0003dd0 con 0x7fbce8139150 2023-10-01T07:54:10.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.659+0000 7fbcf003d700 1 -- 172.21.15.26:0/1246388273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbce8139150 msgr2=0x7fbce813b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.659+0000 7fbcf003d700 1 --2- 172.21.15.26:0/1246388273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbce8139150 0x7fbce813b530 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbce0009e50 tx=0x7fbce000b330 comp rx=0 tx=0).stop 2023-10-01T07:54:10.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.659+0000 7fbcf003d700 1 -- 172.21.15.26:0/1246388273 shutdown_connections 2023-10-01T07:54:10.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.659+0000 7fbcf003d700 1 --2- 172.21.15.26:0/1246388273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbce8139150 0x7fbce813b530 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.659+0000 7fbcf003d700 1 --2- 172.21.15.26:0/1246388273 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbce8136830 0x7fbce8138c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.659+0000 7fbcf003d700 1 -- 172.21.15.26:0/1246388273 >> 172.21.15.26:0/1246388273 conn(0x7fbce80a2aa0 msgr2=0x7fbce80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:10.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.659+0000 7fbcf003d700 1 -- 172.21.15.26:0/1246388273 shutdown_connections 2023-10-01T07:54:10.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.660+0000 7fbcf003d700 1 -- 172.21.15.26:0/1246388273 wait complete. 2023-10-01T07:54:10.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.661+0000 7fbcf003d700 1 Processor -- start 2023-10-01T07:54:10.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.662+0000 7fbcf003d700 1 -- start start 2023-10-01T07:54:10.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.662+0000 7fbcf003d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbce81338c0 0x7fbce8118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.662+0000 7fbcf003d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbce8136830 0x7fbce8119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.662+0000 7fbcf003d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbce8139150 0x7fbce8119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.662+0000 7fbcf003d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce811c590 con 0x7fbce8136830 2023-10-01T07:54:10.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.662+0000 7fbcf003d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce812eb60 con 0x7fbce81338c0 2023-10-01T07:54:10.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.662+0000 7fbcf003d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbce811bf00 con 0x7fbce8139150 2023-10-01T07:54:10.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.663+0000 7fbced5d8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbce8136830 0x7fbce8119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.663+0000 7fbced5d8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbce8136830 0x7fbce8119210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49594/0 (socket says 172.21.15.26:49594) 2023-10-01T07:54:10.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.663+0000 7fbced5d8700 1 -- 172.21.15.26:0/3961400193 learned_addr learned my addr 172.21.15.26:0/3961400193 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:10.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.663+0000 7fbceddd9700 1 --2- 172.21.15.26:0/3961400193 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbce81338c0 0x7fbce8118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.663+0000 7fbcee5da700 1 --2- 172.21.15.26:0/3961400193 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbce8139150 0x7fbce8119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.663+0000 7fbced5d8700 1 -- 172.21.15.26:0/3961400193 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbce8139150 msgr2=0x7fbce8119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.663+0000 7fbced5d8700 1 --2- 172.21.15.26:0/3961400193 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbce8139150 0x7fbce8119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.663+0000 7fbced5d8700 1 -- 172.21.15.26:0/3961400193 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbce81338c0 msgr2=0x7fbce8118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.663+0000 7fbced5d8700 1 --2- 172.21.15.26:0/3961400193 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbce81338c0 0x7fbce8118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.663+0000 7fbced5d8700 1 -- 172.21.15.26:0/3961400193 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce0009b30 con 0x7fbce8136830 2023-10-01T07:54:10.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.663+0000 7fbceddd9700 1 --2- 172.21.15.26:0/3961400193 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbce81338c0 0x7fbce8118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:54:10.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.663+0000 7fbced5d8700 1 --2- 172.21.15.26:0/3961400193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbce8136830 0x7fbce8119210 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbcd800e980 tx=0x7fbcd800ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:10.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.664+0000 7fbcde7fc700 1 -- 172.21.15.26:0/3961400193 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd8009710 con 0x7fbce8136830 2023-10-01T07:54:10.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.664+0000 7fbcde7fc700 1 -- 172.21.15.26:0/3961400193 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd800c850 con 0x7fbce8136830 2023-10-01T07:54:10.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.664+0000 7fbcde7fc700 1 -- 172.21.15.26:0/3961400193 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd800cc00 con 0x7fbce8136830 2023-10-01T07:54:10.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.664+0000 7fbcf003d700 1 -- 172.21.15.26:0/3961400193 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce811a920 con 0x7fbce8136830 2023-10-01T07:54:10.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.664+0000 7fbcf003d700 1 -- 172.21.15.26:0/3961400193 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce8130040 con 0x7fbce8136830 2023-10-01T07:54:10.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.665+0000 7fbcf003d700 1 -- 172.21.15.26:0/3961400193 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbce8074ea0 con 0x7fbce8136830 2023-10-01T07:54:10.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.666+0000 7fbcde7fc700 1 -- 172.21.15.26:0/3961400193 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fbcd8013470 con 0x7fbce8136830 2023-10-01T07:54:10.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.667+0000 7fbcde7fc700 1 -- 172.21.15.26:0/3961400193 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3922+0+0 (secure 0 0 0) 0x7fbcd803c270 con 0x7fbce8136830 2023-10-01T07:54:10.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.667+0000 7fbceddd9700 1 -- 172.21.15.26:0/3961400193 >> v1:172.21.15.26:6816/118178 conn(0x7fbccc02c1b0 legacy=0x7fbccc02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/118178 2023-10-01T07:54:10.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.675+0000 7fbcde7fc700 1 -- 172.21.15.26:0/3961400193 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fbcd8013720 con 0x7fbce8136830 2023-10-01T07:54:10.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.722+0000 7f1381efb700 1 Processor -- start 2023-10-01T07:54:10.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.722+0000 7f1381efb700 1 -- start start 2023-10-01T07:54:10.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.723+0000 7f1381efb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f137c09d6f0 0x7f137c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.723+0000 7f1381efb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f137c09e000 0x7f137c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.723+0000 7f1381efb700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f137c09f130 con 0x7f137c09e410 2023-10-01T07:54:10.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.723+0000 7f1381efb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f137c09f520 con 0x7f137c09e000 2023-10-01T07:54:10.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.723+0000 7f1381efb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f137c09e930 con 0x7f137c09d6f0 2023-10-01T07:54:10.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.723+0000 7f137bfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f137c09e410 0x7f137c130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43890/0 (socket says 172.21.15.26:43890) 2023-10-01T07:54:10.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.723+0000 7f137bfff700 1 -- 172.21.15.26:0/3300238681 learned_addr learned my addr 172.21.15.26:0/3300238681 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:10.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.723+0000 7f137affd700 1 --2- 172.21.15.26:0/3300238681 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f137c09e000 0x7f137c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.723+0000 7f137b7fe700 1 --2- 172.21.15.26:0/3300238681 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f137c09d6f0 0x7f137c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.724+0000 7f137affd700 1 -- 172.21.15.26:0/3300238681 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f137c09d6f0 msgr2=0x7f137c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:10.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.724+0000 7f137affd700 1 --2- 172.21.15.26:0/3300238681 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f137c09d6f0 0x7f137c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.724+0000 7f137affd700 1 -- 172.21.15.26:0/3300238681 >> v1:172.21.15.26:6789/0 conn(0x7f137c09e410 legacy=0x7f137c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.724+0000 7f137affd700 1 -- 172.21.15.26:0/3300238681 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f137c09b2d0 con 0x7f137c09e000 2023-10-01T07:54:10.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.724+0000 7f137affd700 1 --2- 172.21.15.26:0/3300238681 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f137c09e000 0x7f137c130660 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1370009870 tx=0x7f1370009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca151771351af970 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:10.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.724+0000 7f137a7fc700 1 -- 172.21.15.26:0/3300238681 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137000f8a0 con 0x7f137c09e000 2023-10-01T07:54:10.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.724+0000 7f137a7fc700 1 -- 172.21.15.26:0/3300238681 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137000fa00 con 0x7f137c09e000 2023-10-01T07:54:10.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.724+0000 7f137a7fc700 1 -- 172.21.15.26:0/3300238681 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137000fd90 con 0x7f137c09e000 2023-10-01T07:54:10.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.725+0000 7f1381efb700 1 -- 172.21.15.26:0/3300238681 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f137c09e000 msgr2=0x7f137c130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.725+0000 7f1381efb700 1 --2- 172.21.15.26:0/3300238681 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f137c09e000 0x7f137c130660 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1370009870 tx=0x7f1370009b80 comp rx=0 tx=0).stop 2023-10-01T07:54:10.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.725+0000 7f1381efb700 1 -- 172.21.15.26:0/3300238681 shutdown_connections 2023-10-01T07:54:10.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.725+0000 7f1381efb700 1 --2- 172.21.15.26:0/3300238681 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f137c09d6f0 0x7f137c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.725+0000 7f1381efb700 1 --2- 172.21.15.26:0/3300238681 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f137c09e000 0x7f137c130660 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.725+0000 7f1381efb700 1 -- 172.21.15.26:0/3300238681 >> 172.21.15.26:0/3300238681 conn(0x7f137c066f50 msgr2=0x7f137c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:10.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.725+0000 7f1381efb700 1 -- 172.21.15.26:0/3300238681 shutdown_connections 2023-10-01T07:54:10.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.725+0000 7f1381efb700 1 -- 172.21.15.26:0/3300238681 wait complete. 2023-10-01T07:54:10.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.726+0000 7f1381efb700 1 Processor -- start 2023-10-01T07:54:10.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.727+0000 7f1381efb700 1 -- start start 2023-10-01T07:54:10.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.727+0000 7f1381efb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f137c09d6f0 0x7f137c11e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.727+0000 7f1381efb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f137c09e000 0x7f137c11e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.727+0000 7f1381efb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f137c09e410 0x7f137c1cc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.727+0000 7f1381efb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137c11f410 con 0x7f137c09e410 2023-10-01T07:54:10.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.727+0000 7f1381efb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f137c121530 con 0x7f137c09e000 2023-10-01T07:54:10.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.727+0000 7f1381efb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f137c11fc60 con 0x7f137c09d6f0 2023-10-01T07:54:10.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.727+0000 7f137affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f137c09e000 0x7f137c11e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.727+0000 7f137affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f137c09e000 0x7f137c11e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45772/0 (socket says 172.21.15.26:45772) 2023-10-01T07:54:10.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.727+0000 7f137affd700 1 -- 172.21.15.26:0/3410803673 learned_addr learned my addr 172.21.15.26:0/3410803673 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:10.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.727+0000 7f137bfff700 1 --2- 172.21.15.26:0/3410803673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f137c09e410 0x7f137c1cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.728+0000 7f137b7fe700 1 --2- 172.21.15.26:0/3410803673 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f137c09d6f0 0x7f137c11e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.728+0000 7f137affd700 1 -- 172.21.15.26:0/3410803673 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f137c09d6f0 msgr2=0x7f137c11e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.728+0000 7f137affd700 1 --2- 172.21.15.26:0/3410803673 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f137c09d6f0 0x7f137c11e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.728+0000 7f137affd700 1 -- 172.21.15.26:0/3410803673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f137c09e410 msgr2=0x7f137c1cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.728+0000 7f137affd700 1 --2- 172.21.15.26:0/3410803673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f137c09e410 0x7f137c1cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.728+0000 7f137affd700 1 -- 172.21.15.26:0/3410803673 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13700094a0 con 0x7f137c09e000 2023-10-01T07:54:10.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.728+0000 7f137affd700 1 --2- 172.21.15.26:0/3410803673 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f137c09e000 0x7f137c11e760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f13700090b0 tx=0x7f1370004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:10.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.728+0000 7f1363fff700 1 -- 172.21.15.26:0/3410803673 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1370003ab0 con 0x7f137c09e000 2023-10-01T07:54:10.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.728+0000 7f1363fff700 1 -- 172.21.15.26:0/3410803673 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1370003c10 con 0x7f137c09e000 2023-10-01T07:54:10.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.728+0000 7f1381efb700 1 -- 172.21.15.26:0/3410803673 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f137c0a1e00 con 0x7f137c09e000 2023-10-01T07:54:10.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.728+0000 7f1363fff700 1 -- 172.21.15.26:0/3410803673 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1370004560 con 0x7f137c09e000 2023-10-01T07:54:10.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.728+0000 7f1381efb700 1 -- 172.21.15.26:0/3410803673 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f137c11eca0 con 0x7f137c09e000 2023-10-01T07:54:10.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.730+0000 7f1381efb700 1 -- 172.21.15.26:0/3410803673 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f137c121670 con 0x7f137c09e000 2023-10-01T07:54:10.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.730+0000 7f1363fff700 1 -- 172.21.15.26:0/3410803673 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f137002c430 con 0x7f137c09e000 2023-10-01T07:54:10.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.731+0000 7f1363fff700 1 -- 172.21.15.26:0/3410803673 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f137003ce90 con 0x7f137c09e000 2023-10-01T07:54:10.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.733+0000 7f137b7fe700 1 -- 172.21.15.26:0/3410803673 >> v1:172.21.15.26:6816/118178 conn(0x7f136802c1b0 legacy=0x7f136802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/118178 2023-10-01T07:54:10.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.738+0000 7f1363fff700 1 -- 172.21.15.26:0/3410803673 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f1370006bd0 con 0x7f137c09e000 2023-10-01T07:54:10.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.769+0000 7fdc59919700 1 Processor -- start 2023-10-01T07:54:10.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.769+0000 7fdc59919700 1 -- start start 2023-10-01T07:54:10.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.769+0000 7fdc59919700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdc54133a80 0x7fdc54133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.769+0000 7fdc59919700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc54130a70 0x7fdc5413b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.770+0000 7fdc59919700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc5406bc00 con 0x7fdc5412ff20 2023-10-01T07:54:10.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.770+0000 7fdc59919700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc5406c570 con 0x7fdc54133a80 2023-10-01T07:54:10.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.770+0000 7fdc59919700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc540a0040 con 0x7fdc54130a70 2023-10-01T07:54:10.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.770+0000 7fdc52ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdc54133a80 0x7fdc54133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.770+0000 7fdc52ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdc54133a80 0x7fdc54133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49626/0 (socket says 172.21.15.26:49626) 2023-10-01T07:54:10.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.770+0000 7fdc52ffd700 1 -- 172.21.15.26:0/2165615805 learned_addr learned my addr 172.21.15.26:0/2165615805 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:10.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.770+0000 7fdc52ffd700 1 -- 172.21.15.26:0/2165615805 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc54130a70 msgr2=0x7fdc5413b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:10.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.770+0000 7fdc52ffd700 1 --2- 172.21.15.26:0/2165615805 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc54130a70 0x7fdc5413b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.770+0000 7fdc52ffd700 1 -- 172.21.15.26:0/2165615805 >> v1:172.21.15.26:6789/0 conn(0x7fdc5412ff20 legacy=0x7fdc54130360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.770+0000 7fdc52ffd700 1 -- 172.21.15.26:0/2165615805 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc54133860 con 0x7fdc54133a80 2023-10-01T07:54:10.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.771+0000 7fdc52ffd700 1 --2- 172.21.15.26:0/2165615805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc54133a80 0x7fdc54133e50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdc440098f0 tx=0x7fdc44009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a5d7460b19620a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:10.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.771+0000 7fdc51ffb700 1 -- 172.21.15.26:0/2165615805 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4400b8a0 con 0x7fdc54133a80 2023-10-01T07:54:10.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.771+0000 7fdc51ffb700 1 -- 172.21.15.26:0/2165615805 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4400ba00 con 0x7fdc54133a80 2023-10-01T07:54:10.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.771+0000 7fdc51ffb700 1 -- 172.21.15.26:0/2165615805 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4400bd90 con 0x7fdc54133a80 2023-10-01T07:54:10.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.772+0000 7fdc59919700 1 -- 172.21.15.26:0/2165615805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc54133a80 msgr2=0x7fdc54133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.772+0000 7fdc59919700 1 --2- 172.21.15.26:0/2165615805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc54133a80 0x7fdc54133e50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdc440098f0 tx=0x7fdc44009c00 comp rx=0 tx=0).stop 2023-10-01T07:54:10.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.772+0000 7fdc59919700 1 -- 172.21.15.26:0/2165615805 shutdown_connections 2023-10-01T07:54:10.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.772+0000 7fdc59919700 1 --2- 172.21.15.26:0/2165615805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc54133a80 0x7fdc54133e50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.772+0000 7fdc59919700 1 --2- 172.21.15.26:0/2165615805 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc54130a70 0x7fdc5413b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.772+0000 7fdc59919700 1 -- 172.21.15.26:0/2165615805 >> 172.21.15.26:0/2165615805 conn(0x7fdc540a4210 msgr2=0x7fdc540a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:10.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.772+0000 7fdc59919700 1 -- 172.21.15.26:0/2165615805 shutdown_connections 2023-10-01T07:54:10.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.772+0000 7fdc59919700 1 -- 172.21.15.26:0/2165615805 wait complete. 2023-10-01T07:54:10.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.774+0000 7fdc59919700 1 Processor -- start 2023-10-01T07:54:10.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.774+0000 7fdc59919700 1 -- start start 2023-10-01T07:54:10.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.775+0000 7fdc59919700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc5412ff20 0x7fdc5409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.775+0000 7fdc59919700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc54130a70 0x7fdc5409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.775+0000 7fdc59919700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdc54133a80 0x7fdc5409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:10.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.775+0000 7fdc59919700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc541201d0 con 0x7fdc5412ff20 2023-10-01T07:54:10.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.775+0000 7fdc59919700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc541203b0 con 0x7fdc54130a70 2023-10-01T07:54:10.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.775+0000 7fdc59919700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5409e070 con 0x7fdc54133a80 2023-10-01T07:54:10.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.775+0000 7fdc52ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc5412ff20 0x7fdc5409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.775+0000 7fdc52ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc5412ff20 0x7fdc5409c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49630/0 (socket says 172.21.15.26:49630) 2023-10-01T07:54:10.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.775+0000 7fdc52ffd700 1 -- 172.21.15.26:0/3813979732 learned_addr learned my addr 172.21.15.26:0/3813979732 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:10.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.776+0000 7fdc537fe700 1 --2- 172.21.15.26:0/3813979732 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdc54133a80 0x7fdc5409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.776+0000 7fdc527fc700 1 --2- 172.21.15.26:0/3813979732 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc54130a70 0x7fdc5409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:10.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.776+0000 7fdc527fc700 1 -- 172.21.15.26:0/3813979732 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdc54133a80 msgr2=0x7fdc5409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.776+0000 7fdc527fc700 1 --2- 172.21.15.26:0/3813979732 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdc54133a80 0x7fdc5409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.776+0000 7fdc527fc700 1 -- 172.21.15.26:0/3813979732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc5412ff20 msgr2=0x7fdc5409c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.776+0000 7fdc527fc700 1 --2- 172.21.15.26:0/3813979732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc5412ff20 0x7fdc5409c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.776+0000 7fdc527fc700 1 -- 172.21.15.26:0/3813979732 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc44009550 con 0x7fdc54130a70 2023-10-01T07:54:10.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.776+0000 7fdc537fe700 1 --2- 172.21.15.26:0/3813979732 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdc54133a80 0x7fdc5409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:10.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.777+0000 7fdc527fc700 1 --2- 172.21.15.26:0/3813979732 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc54130a70 0x7fdc5409c9c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fdc48000f60 tx=0x7fdc4800c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:10.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.777+0000 7fdc3bfff700 1 -- 172.21.15.26:0/3813979732 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc480052d0 con 0x7fdc54130a70 2023-10-01T07:54:10.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.777+0000 7fdc3bfff700 1 -- 172.21.15.26:0/3813979732 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc48005430 con 0x7fdc54130a70 2023-10-01T07:54:10.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.777+0000 7fdc59919700 1 -- 172.21.15.26:0/3813979732 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc5411fe10 con 0x7fdc54130a70 2023-10-01T07:54:10.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.777+0000 7fdc3bfff700 1 -- 172.21.15.26:0/3813979732 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc480038c0 con 0x7fdc54130a70 2023-10-01T07:54:10.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.778+0000 7fdc59919700 1 -- 172.21.15.26:0/3813979732 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc5412d490 con 0x7fdc54130a70 2023-10-01T07:54:10.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.779+0000 7fdc3bfff700 1 -- 172.21.15.26:0/3813979732 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fdc48003a20 con 0x7fdc54130a70 2023-10-01T07:54:10.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.779+0000 7fdc3bfff700 1 -- 172.21.15.26:0/3813979732 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3922+0+0 (secure 0 0 0) 0x7fdc4803f170 con 0x7fdc54130a70 2023-10-01T07:54:10.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.779+0000 7fdc52ffd700 1 -- 172.21.15.26:0/3813979732 >> v1:172.21.15.26:6816/118178 conn(0x7fdc4002c1e0 legacy=0x7fdc4002e690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/118178 2023-10-01T07:54:10.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.779+0000 7fdc59919700 1 -- 172.21.15.26:0/3813979732 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc54120010 con 0x7fdc54130a70 2023-10-01T07:54:10.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.787+0000 7fdc3bfff700 1 -- 172.21.15.26:0/3813979732 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fdc54120010 con 0x7fdc54130a70 2023-10-01T07:54:10.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.834+0000 7f91d0dda700 1 -- 172.21.15.26:0/1503576914 >> v1:172.21.15.26:6816/118178 conn(0x7f91b002c1b0 legacy=0x7f91b002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/118178 2023-10-01T07:54:10.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.842+0000 7f91d303e700 1 -- 172.21.15.26:0/1503576914 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f91ac005590 con 0x7f91cc09dc30 2023-10-01T07:54:10.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.842+0000 7f91c97fa700 1 -- 172.21.15.26:0/1503576914 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f91b8021030 con 0x7f91cc09dc30 2023-10-01T07:54:10.843 INFO:teuthology.orchestra.run.smithi026.stdout:38654705693 2023-10-01T07:54:10.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.845+0000 7f91d303e700 1 -- 172.21.15.26:0/1503576914 >> v1:172.21.15.26:6816/118178 conn(0x7f91b002c1b0 legacy=0x7f91b002e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:10.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.845+0000 7f91d303e700 1 -- 172.21.15.26:0/1503576914 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91cc09dc30 msgr2=0x7f91cc127f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.845+0000 7f91d303e700 1 --2- 172.21.15.26:0/1503576914 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91cc09dc30 0x7f91cc127f80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f91b800e9b0 tx=0x7f91b800ecc0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.845+0000 7f91d303e700 1 -- 172.21.15.26:0/1503576914 shutdown_connections 2023-10-01T07:54:10.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.845+0000 7f91d303e700 1 --2- 172.21.15.26:0/1503576914 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91cc13c1e0 0x7f91cc1cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.845+0000 7f91d303e700 1 --2- 172.21.15.26:0/1503576914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91cc06a770 0x7f91cc127a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.845+0000 7f91d303e700 1 --2- 172.21.15.26:0/1503576914 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91cc09dc30 0x7f91cc127f80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.845+0000 7f91d303e700 1 -- 172.21.15.26:0/1503576914 >> 172.21.15.26:0/1503576914 conn(0x7f91cc066f50 msgr2=0x7f91cc0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:10.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.845+0000 7f91d303e700 1 -- 172.21.15.26:0/1503576914 shutdown_connections 2023-10-01T07:54:10.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.845+0000 7f91d303e700 1 -- 172.21.15.26:0/1503576914 wait complete. 2023-10-01T07:54:10.860 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705693 for osd.0 2023-10-01T07:54:10.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.868+0000 7fbceddd9700 1 -- 172.21.15.26:0/3961400193 >> v1:172.21.15.26:6816/118178 conn(0x7fbccc02c1b0 legacy=0x7fbccc02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/118178 2023-10-01T07:54:10.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.930+0000 7f1381efb700 1 -- 172.21.15.26:0/3410803673 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f137c074ea0 con 0x7f137c09e000 2023-10-01T07:54:10.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.930+0000 7f1363fff700 1 -- 172.21.15.26:0/3410803673 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1370017300 con 0x7f137c09e000 2023-10-01T07:54:10.931 INFO:teuthology.orchestra.run.smithi026.stdout:38654705693 2023-10-01T07:54:10.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.933+0000 7f1381efb700 1 -- 172.21.15.26:0/3410803673 >> v1:172.21.15.26:6816/118178 conn(0x7f136802c1b0 legacy=0x7f136802e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:10.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.933+0000 7f1381efb700 1 -- 172.21.15.26:0/3410803673 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f137c09e000 msgr2=0x7f137c11e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.933+0000 7f1381efb700 1 --2- 172.21.15.26:0/3410803673 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f137c09e000 0x7f137c11e760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f13700090b0 tx=0x7f1370004750 comp rx=0 tx=0).stop 2023-10-01T07:54:10.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.934+0000 7f1381efb700 1 -- 172.21.15.26:0/3410803673 shutdown_connections 2023-10-01T07:54:10.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.934+0000 7f1381efb700 1 --2- 172.21.15.26:0/3410803673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f137c09e410 0x7f137c1cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.934+0000 7f1381efb700 1 --2- 172.21.15.26:0/3410803673 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f137c09d6f0 0x7f137c11e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.934+0000 7f1381efb700 1 --2- 172.21.15.26:0/3410803673 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f137c09e000 0x7f137c11e760 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.934+0000 7f1381efb700 1 -- 172.21.15.26:0/3410803673 >> 172.21.15.26:0/3410803673 conn(0x7f137c066f50 msgr2=0x7f137c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:10.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.934+0000 7f1381efb700 1 -- 172.21.15.26:0/3410803673 shutdown_connections 2023-10-01T07:54:10.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.934+0000 7f1381efb700 1 -- 172.21.15.26:0/3410803673 wait complete. 2023-10-01T07:54:10.953 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.3 2023-10-01T07:54:10.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.955+0000 7fbcf003d700 1 -- 172.21.15.26:0/3961400193 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbce806b9e0 con 0x7fbce8136830 2023-10-01T07:54:10.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.956+0000 7fbcde7fc700 1 -- 172.21.15.26:0/3961400193 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbcd8021070 con 0x7fbce8136830 2023-10-01T07:54:10.956 INFO:teuthology.orchestra.run.smithi026.stdout:38654705693 2023-10-01T07:54:10.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.958+0000 7fbcf003d700 1 -- 172.21.15.26:0/3961400193 >> v1:172.21.15.26:6816/118178 conn(0x7fbccc02c1b0 legacy=0x7fbccc02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:10.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.958+0000 7fbcf003d700 1 -- 172.21.15.26:0/3961400193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbce8136830 msgr2=0x7fbce8119210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:10.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.958+0000 7fbcf003d700 1 --2- 172.21.15.26:0/3961400193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbce8136830 0x7fbce8119210 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbcd800e980 tx=0x7fbcd800ed40 comp rx=0 tx=0).stop 2023-10-01T07:54:10.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.958+0000 7fbcf003d700 1 -- 172.21.15.26:0/3961400193 shutdown_connections 2023-10-01T07:54:10.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.958+0000 7fbcf003d700 1 --2- 172.21.15.26:0/3961400193 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbce8139150 0x7fbce8119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.958+0000 7fbcf003d700 1 --2- 172.21.15.26:0/3961400193 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbce81338c0 0x7fbce8118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.958+0000 7fbcf003d700 1 --2- 172.21.15.26:0/3961400193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbce8136830 0x7fbce8119210 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:10.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.958+0000 7fbcf003d700 1 -- 172.21.15.26:0/3961400193 >> 172.21.15.26:0/3961400193 conn(0x7fbce80a2aa0 msgr2=0x7fbce812f040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:10.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.958+0000 7fbcf003d700 1 -- 172.21.15.26:0/3961400193 shutdown_connections 2023-10-01T07:54:10.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.958+0000 7fbcf003d700 1 -- 172.21.15.26:0/3961400193 wait complete. 2023-10-01T07:54:10.972 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705693 for osd.1 2023-10-01T07:54:10.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:10.980+0000 7fdc52ffd700 1 -- 172.21.15.26:0/3813979732 >> v1:172.21.15.26:6816/118178 conn(0x7fdc4002c1e0 legacy=0x7fdc4002e690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/118178 2023-10-01T07:54:10.999 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:10.999+0000 7f6cc52b3240 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-01T07:54:11.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:11.025+0000 7fdc59919700 1 -- 172.21.15.26:0/3813979732 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdc54120010 con 0x7fdc54130a70 2023-10-01T07:54:11.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:11.025+0000 7fdc3bfff700 1 -- 172.21.15.26:0/3813979732 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdc48017070 con 0x7fdc54130a70 2023-10-01T07:54:11.026 INFO:teuthology.orchestra.run.smithi026.stdout:38654705693 2023-10-01T07:54:11.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:11.027+0000 7fdc59919700 1 -- 172.21.15.26:0/3813979732 >> v1:172.21.15.26:6816/118178 conn(0x7fdc4002c1e0 legacy=0x7fdc4002e690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:11.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:11.027+0000 7fdc59919700 1 -- 172.21.15.26:0/3813979732 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc54130a70 msgr2=0x7fdc5409c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:11.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:11.027+0000 7fdc59919700 1 --2- 172.21.15.26:0/3813979732 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc54130a70 0x7fdc5409c9c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fdc48000f60 tx=0x7fdc4800c730 comp rx=0 tx=0).stop 2023-10-01T07:54:11.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:11.027+0000 7fdc59919700 1 -- 172.21.15.26:0/3813979732 shutdown_connections 2023-10-01T07:54:11.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:11.027+0000 7fdc59919700 1 --2- 172.21.15.26:0/3813979732 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdc54133a80 0x7fdc5409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:11.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:11.027+0000 7fdc59919700 1 --2- 172.21.15.26:0/3813979732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc5412ff20 0x7fdc5409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:11.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:11.027+0000 7fdc59919700 1 --2- 172.21.15.26:0/3813979732 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc54130a70 0x7fdc5409c9c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:11.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:11.027+0000 7fdc59919700 1 -- 172.21.15.26:0/3813979732 >> 172.21.15.26:0/3813979732 conn(0x7fdc540a4210 msgr2=0x7fdc5409e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:11.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:11.027+0000 7fdc59919700 1 -- 172.21.15.26:0/3813979732 shutdown_connections 2023-10-01T07:54:11.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:11.027+0000 7fdc59919700 1 -- 172.21.15.26:0/3813979732 wait complete. 2023-10-01T07:54:11.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705693 for osd.2 2023-10-01T07:54:11.163 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:11.162+0000 7f6cc52b3240 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-01T07:54:11.246 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:11.246+0000 7f6cc52b3240 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-01T07:54:11.399 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:11.399+0000 7f6cc52b3240 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-01T07:54:11.479 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:11.478+0000 7f6cc52b3240 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-01T07:54:11.662 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:11.662+0000 7f6cc52b3240 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-01T07:54:11.751 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:11.751+0000 7f6cc52b3240 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-01T07:54:11.839 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:11.838+0000 7f6cc52b3240 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-01T07:54:11.861 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:54:11.952 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:11.952+0000 7f6cc52b3240 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-01T07:54:11.955 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:54:11.973 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:54:12.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.011+0000 7fbde3db6700 1 Processor -- start 2023-10-01T07:54:12.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.012+0000 7fbde3db6700 1 -- start start 2023-10-01T07:54:12.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.013+0000 7fbde3db6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbddc0700e0 0x7fbddc0704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:12.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.013+0000 7fbde3db6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbddc0709f0 0x7fbddc12cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:12.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.013+0000 7fbde3db6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbddc12d2e0 0x7fbddc12d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:12.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.013+0000 7fbde3db6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbddc09a4a0 con 0x7fbddc12d2e0 2023-10-01T07:54:12.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.013+0000 7fbde3db6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbddc071c70 con 0x7fbddc0709f0 2023-10-01T07:54:12.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.013+0000 7fbde3db6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbddc066680 con 0x7fbddc0700e0 2023-10-01T07:54:12.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.013+0000 7fbde1b52700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbddc0700e0 0x7fbddc0704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:12.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.013+0000 7fbde1b52700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbddc0700e0 0x7fbddc0704b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:42922/0 (socket says 172.21.15.26:42922) 2023-10-01T07:54:12.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.013+0000 7fbde1b52700 1 -- 172.21.15.26:0/256998832 learned_addr learned my addr 172.21.15.26:0/256998832 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:12.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.013+0000 7fbde1351700 1 --2- 172.21.15.26:0/256998832 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbddc0709f0 0x7fbddc12cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:12.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.013+0000 7fbde2353700 1 --2- 172.21.15.26:0/256998832 >> v2:172.21.15.26:3300/0 conn(0x7fbddc12d2e0 0x7fbddc12d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:12.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.013+0000 7fbde1351700 1 -- 172.21.15.26:0/256998832 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbddc0700e0 msgr2=0x7fbddc0704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:12.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.013+0000 7fbde1351700 1 --2- 172.21.15.26:0/256998832 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbddc0700e0 0x7fbddc0704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:12.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.013+0000 7fbde1351700 1 -- 172.21.15.26:0/256998832 >> v2:172.21.15.26:3300/0 conn(0x7fbddc12d2e0 msgr2=0x7fbddc12d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:12.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.013+0000 7fbde1351700 1 --2- 172.21.15.26:0/256998832 >> v2:172.21.15.26:3300/0 conn(0x7fbddc12d2e0 0x7fbddc12d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:12.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.013+0000 7fbde1351700 1 -- 172.21.15.26:0/256998832 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbddc099ce0 con 0x7fbddc0709f0 2023-10-01T07:54:12.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.014+0000 7fbde1351700 1 --2- 172.21.15.26:0/256998832 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbddc0709f0 0x7fbddc12cda0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc009840 tx=0x7fbdcc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2eb1aa8e69a2ebe3 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:12.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.014+0000 7fbde0b50700 1 -- 172.21.15.26:0/256998832 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc011830 con 0x7fbddc0709f0 2023-10-01T07:54:12.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.014+0000 7fbde0b50700 1 -- 172.21.15.26:0/256998832 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdcc011990 con 0x7fbddc0709f0 2023-10-01T07:54:12.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.014+0000 7fbde0b50700 1 -- 172.21.15.26:0/256998832 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc011d20 con 0x7fbddc0709f0 2023-10-01T07:54:12.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.015+0000 7fbde3db6700 1 -- 172.21.15.26:0/256998832 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbddc0709f0 msgr2=0x7fbddc12cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:12.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.015+0000 7fbde3db6700 1 --2- 172.21.15.26:0/256998832 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbddc0709f0 0x7fbddc12cda0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc009840 tx=0x7fbdcc009b50 comp rx=0 tx=0).stop 2023-10-01T07:54:12.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.015+0000 7fbde3db6700 1 -- 172.21.15.26:0/256998832 shutdown_connections 2023-10-01T07:54:12.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.015+0000 7fbde3db6700 1 --2- 172.21.15.26:0/256998832 >> v2:172.21.15.26:3300/0 conn(0x7fbddc12d2e0 0x7fbddc12d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:12.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.015+0000 7fbde3db6700 1 --2- 172.21.15.26:0/256998832 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbddc0700e0 0x7fbddc0704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:12.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.015+0000 7fbde3db6700 1 --2- 172.21.15.26:0/256998832 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbddc0709f0 0x7fbddc12cda0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:12.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.015+0000 7fbde3db6700 1 -- 172.21.15.26:0/256998832 >> 172.21.15.26:0/256998832 conn(0x7fbddc0a27f0 msgr2=0x7fbddc0a2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:12.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.015+0000 7fbde3db6700 1 -- 172.21.15.26:0/256998832 shutdown_connections 2023-10-01T07:54:12.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.015+0000 7fbde3db6700 1 -- 172.21.15.26:0/256998832 wait complete. 2023-10-01T07:54:12.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.016+0000 7fbde3db6700 1 Processor -- start 2023-10-01T07:54:12.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.017+0000 7fbde3db6700 1 -- start start 2023-10-01T07:54:12.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.017+0000 7fbde3db6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbddc0700e0 0x7fbddc11eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:12.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.017+0000 7fbde3db6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbddc0709f0 0x7fbddc11f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:12.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.017+0000 7fbde3db6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbddc12d2e0 0x7fbddc11f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:12.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.017+0000 7fbde3db6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbddc1226e0 con 0x7fbddc12d2e0 2023-10-01T07:54:12.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.017+0000 7fbde3db6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbddc121ce0 con 0x7fbddc0709f0 2023-10-01T07:54:12.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.017+0000 7fbde3db6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbddc1206d0 con 0x7fbddc0700e0 2023-10-01T07:54:12.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.017+0000 7fbde1351700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbddc0709f0 0x7fbddc11f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:12.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.018+0000 7fbde1b52700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbddc0700e0 0x7fbddc11eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:12.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.018+0000 7fbde1351700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbddc0709f0 0x7fbddc11f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45802/0 (socket says 172.21.15.26:45802) 2023-10-01T07:54:12.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.018+0000 7fbde1351700 1 -- 172.21.15.26:0/980668419 learned_addr learned my addr 172.21.15.26:0/980668419 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:12.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.018+0000 7fbde1b52700 1 --2- 172.21.15.26:0/980668419 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbddc0700e0 0x7fbddc11eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:42926/0 (socket says 172.21.15.26:42926) 2023-10-01T07:54:12.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.018+0000 7fbde2353700 1 --2- 172.21.15.26:0/980668419 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbddc12d2e0 0x7fbddc11f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:12.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.018+0000 7fbde1b52700 1 -- 172.21.15.26:0/980668419 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbddc0709f0 msgr2=0x7fbddc11f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:12.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.018+0000 7fbde1b52700 1 --2- 172.21.15.26:0/980668419 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbddc0709f0 0x7fbddc11f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:12.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.018+0000 7fbde1b52700 1 -- 172.21.15.26:0/980668419 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbddc12d2e0 msgr2=0x7fbddc11f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:12.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.018+0000 7fbde1b52700 1 --2- 172.21.15.26:0/980668419 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbddc12d2e0 0x7fbddc11f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:12.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.018+0000 7fbde1b52700 1 -- 172.21.15.26:0/980668419 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdcc0094a0 con 0x7fbddc0700e0 2023-10-01T07:54:12.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.018+0000 7fbde2353700 1 --2- 172.21.15.26:0/980668419 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbddc12d2e0 0x7fbddc11f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:12.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.018+0000 7fbde1b52700 1 --2- 172.21.15.26:0/980668419 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbddc0700e0 0x7fbddc11eac0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbdd800ed70 tx=0x7fbdd800d630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:12.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.019+0000 7fbdd27fc700 1 -- 172.21.15.26:0/980668419 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd800dd90 con 0x7fbddc0700e0 2023-10-01T07:54:12.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.019+0000 7fbdd27fc700 1 -- 172.21.15.26:0/980668419 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd8010440 con 0x7fbddc0700e0 2023-10-01T07:54:12.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.019+0000 7fbde3db6700 1 -- 172.21.15.26:0/980668419 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbddc070f60 con 0x7fbddc0700e0 2023-10-01T07:54:12.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.019+0000 7fbdd27fc700 1 -- 172.21.15.26:0/980668419 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd80107d0 con 0x7fbddc0700e0 2023-10-01T07:54:12.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.019+0000 7fbde3db6700 1 -- 172.21.15.26:0/980668419 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbddc122090 con 0x7fbddc0700e0 2023-10-01T07:54:12.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.020+0000 7fbdd27fc700 1 -- 172.21.15.26:0/980668419 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fbdd8010930 con 0x7fbddc0700e0 2023-10-01T07:54:12.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.020+0000 7fbdd27fc700 1 -- 172.21.15.26:0/980668419 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3922+0+0 (secure 0 0 0) 0x7fbdd803be10 con 0x7fbddc0700e0 2023-10-01T07:54:12.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.020+0000 7fbde1351700 1 -- 172.21.15.26:0/980668419 >> v1:172.21.15.26:6816/118178 conn(0x7fbdc002c1b0 legacy=0x7fbdc002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/118178 2023-10-01T07:54:12.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.020+0000 7fbde3db6700 1 -- 172.21.15.26:0/980668419 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbddc04f2a0 con 0x7fbddc0700e0 2023-10-01T07:54:12.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.025+0000 7fbdd27fc700 1 -- 172.21.15.26:0/980668419 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fbdd8017d70 con 0x7fbddc0700e0 2023-10-01T07:54:12.043 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:54:12.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.143+0000 7f710aa3d700 1 Processor -- start 2023-10-01T07:54:12.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.143+0000 7f710aa3d700 1 -- start start 2023-10-01T07:54:12.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.144+0000 7f710aa3d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f710406e570 0x7f710406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:12.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.144+0000 7f710aa3d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f710406ee80 0x7f7104134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:12.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.144+0000 7f710aa3d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7104070ee0 con 0x7f710409eca0 2023-10-01T07:54:12.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.144+0000 7f710aa3d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7104071480 con 0x7f710406ee80 2023-10-01T07:54:12.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.144+0000 7f710aa3d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7104071b90 con 0x7f710406e570 2023-10-01T07:54:12.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.144+0000 7f71037fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f710409eca0 0x7f7104134610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43916/0 (socket says 172.21.15.26:43916) 2023-10-01T07:54:12.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.144+0000 7f71037fe700 1 -- 172.21.15.26:0/1677855420 learned_addr learned my addr 172.21.15.26:0/1677855420 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:12.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.144+0000 7f7108fda700 1 --2- 172.21.15.26:0/1677855420 >> v2:172.21.15.26:3300/0 conn(0x7f710406ee80 0x7f7104134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:12.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.145+0000 7f7108fda700 1 -- 172.21.15.26:0/1677855420 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f710406e570 msgr2=0x7f710406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:12.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.145+0000 7f7108fda700 1 --2- 172.21.15.26:0/1677855420 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f710406e570 0x7f710406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:12.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.145+0000 7f7108fda700 1 -- 172.21.15.26:0/1677855420 >> v1:172.21.15.26:6789/0 conn(0x7f710409eca0 legacy=0x7f7104134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:12.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.145+0000 7f7108fda700 1 -- 172.21.15.26:0/1677855420 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71040711a0 con 0x7f710406ee80 2023-10-01T07:54:12.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.145+0000 7f7108fda700 1 --2- 172.21.15.26:0/1677855420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f710406ee80 0x7f7104134d20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f70fc009d90 tx=0x7f70fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596b5a3bc837325 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:12.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.145+0000 7f7102ffd700 1 -- 172.21.15.26:0/1677855420 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc00e070 con 0x7f710406ee80 2023-10-01T07:54:12.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.145+0000 7f7102ffd700 1 -- 172.21.15.26:0/1677855420 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70fc00bbd0 con 0x7f710406ee80 2023-10-01T07:54:12.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.145+0000 7f7102ffd700 1 -- 172.21.15.26:0/1677855420 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc012430 con 0x7f710406ee80 2023-10-01T07:54:12.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.146+0000 7f710aa3d700 1 -- 172.21.15.26:0/1677855420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f710406ee80 msgr2=0x7f7104134d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:12.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.146+0000 7f710aa3d700 1 --2- 172.21.15.26:0/1677855420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f710406ee80 0x7f7104134d20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f70fc009d90 tx=0x7f70fc00b330 comp rx=0 tx=0).stop 2023-10-01T07:54:12.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.146+0000 7f710aa3d700 1 -- 172.21.15.26:0/1677855420 shutdown_connections 2023-10-01T07:54:12.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.146+0000 7f710aa3d700 1 --2- 172.21.15.26:0/1677855420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f710406ee80 0x7f7104134d20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:12.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.146+0000 7f710aa3d700 1 --2- 172.21.15.26:0/1677855420 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f710406e570 0x7f710406e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:12.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.146+0000 7f710aa3d700 1 -- 172.21.15.26:0/1677855420 >> 172.21.15.26:0/1677855420 conn(0x7f71040a2aa0 msgr2=0x7f71040a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:12.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.147+0000 7f710aa3d700 1 -- 172.21.15.26:0/1677855420 shutdown_connections 2023-10-01T07:54:12.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.147+0000 7f710aa3d700 1 -- 172.21.15.26:0/1677855420 wait complete. 2023-10-01T07:54:12.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.148+0000 7f710aa3d700 1 Processor -- start 2023-10-01T07:54:12.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.149+0000 7f710aa3d700 1 -- start start 2023-10-01T07:54:12.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.149+0000 7f710aa3d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f710406e570 0x7f7104123250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:12.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.149+0000 7f710aa3d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f710406ee80 0x7f7104123790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:12.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.149+0000 7f710aa3d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7104123cd0 0x7f71041cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:12.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.149+0000 7f710aa3d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7104124720 con 0x7f7104123cd0 2023-10-01T07:54:12.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.149+0000 7f710aa3d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7104126a90 con 0x7f710406e570 2023-10-01T07:54:12.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.149+0000 7f710aa3d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7104124f70 con 0x7f710406ee80 2023-10-01T07:54:12.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.150+0000 7f7103fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f710406e570 0x7f7104123250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:12.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.150+0000 7f7103fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f710406e570 0x7f7104123250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45820/0 (socket says 172.21.15.26:45820) 2023-10-01T07:54:12.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.150+0000 7f7103fff700 1 -- 172.21.15.26:0/2011216250 learned_addr learned my addr 172.21.15.26:0/2011216250 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:12.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.150+0000 7f7108fda700 1 --2- 172.21.15.26:0/2011216250 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7104123cd0 0x7f71041cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:12.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.150+0000 7f7103fff700 1 -- 172.21.15.26:0/2011216250 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f710406ee80 msgr2=0x7f7104123790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:12.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.150+0000 7f7103fff700 1 --2- 172.21.15.26:0/2011216250 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f710406ee80 0x7f7104123790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:12.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.150+0000 7f7103fff700 1 -- 172.21.15.26:0/2011216250 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7104123cd0 msgr2=0x7f71041cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:12.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.150+0000 7f7103fff700 1 --2- 172.21.15.26:0/2011216250 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7104123cd0 0x7f71041cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:12.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.150+0000 7f7103fff700 1 -- 172.21.15.26:0/2011216250 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70fc009a70 con 0x7f710406e570 2023-10-01T07:54:12.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.150+0000 7f7103fff700 1 --2- 172.21.15.26:0/2011216250 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f710406e570 0x7f7104123250 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f70f400b530 tx=0x7f70f400b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:12.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.151+0000 7f7100ff9700 1 -- 172.21.15.26:0/2011216250 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f4011830 con 0x7f710406e570 2023-10-01T07:54:12.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.151+0000 7f7100ff9700 1 -- 172.21.15.26:0/2011216250 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f40119b0 con 0x7f710406e570 2023-10-01T07:54:12.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.151+0000 7f7100ff9700 1 -- 172.21.15.26:0/2011216250 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f4011d60 con 0x7f710406e570 2023-10-01T07:54:12.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.151+0000 7f710aa3d700 1 -- 172.21.15.26:0/2011216250 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71041359e0 con 0x7f710406e570 2023-10-01T07:54:12.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.151+0000 7f710aa3d700 1 -- 172.21.15.26:0/2011216250 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7104070660 con 0x7f710406e570 2023-10-01T07:54:12.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.152+0000 7f7100ff9700 1 -- 172.21.15.26:0/2011216250 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f70f401a400 con 0x7f710406e570 2023-10-01T07:54:12.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.152+0000 7f7100ff9700 1 -- 172.21.15.26:0/2011216250 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f70f403ba60 con 0x7f710406e570 2023-10-01T07:54:12.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.153+0000 7f71037fe700 1 -- 172.21.15.26:0/2011216250 >> v1:172.21.15.26:6816/118178 conn(0x7f70f002c1b0 legacy=0x7f70f002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/118178 2023-10-01T07:54:12.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.155+0000 7f710aa3d700 1 -- 172.21.15.26:0/2011216250 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7104074ea0 con 0x7f710406e570 2023-10-01T07:54:12.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.163+0000 7f7100ff9700 1 -- 172.21.15.26:0/2011216250 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f70f4015020 con 0x7f710406e570 2023-10-01T07:54:12.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.188+0000 7f4543dbb700 1 Processor -- start 2023-10-01T07:54:12.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.188+0000 7f4543dbb700 1 -- start start 2023-10-01T07:54:12.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.189+0000 7f4543dbb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f453c133540 0x7f453c135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:12.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.189+0000 7f4543dbb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f453c135e60 0x7f453c138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:12.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.189+0000 7f4543dbb700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f453c0716a0 con 0x7f453c130540 2023-10-01T07:54:12.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.189+0000 7f4543dbb700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f453c071290 con 0x7f453c135e60 2023-10-01T07:54:12.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.189+0000 7f4543dbb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f453c130340 con 0x7f453c133540 2023-10-01T07:54:12.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.189+0000 7f4542358700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f453c135e60 0x7f453c138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:12.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.189+0000 7f4542358700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f453c135e60 0x7f453c138240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49672/0 (socket says 172.21.15.26:49672) 2023-10-01T07:54:12.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.189+0000 7f4542358700 1 -- 172.21.15.26:0/1263882982 learned_addr learned my addr 172.21.15.26:0/1263882982 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:12.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.189+0000 7f4541356700 1 --2- 172.21.15.26:0/1263882982 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f453c133540 0x7f453c135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:12.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.190+0000 7f4541356700 1 -- 172.21.15.26:0/1263882982 >> v2:172.21.15.26:3300/0 conn(0x7f453c135e60 msgr2=0x7f453c138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:12.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.190+0000 7f4541356700 1 --2- 172.21.15.26:0/1263882982 >> v2:172.21.15.26:3300/0 conn(0x7f453c135e60 0x7f453c138240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:12.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.190+0000 7f4540b55700 1 -- 172.21.15.26:0/1263882982 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1747934524 0 0) 0x7f453c0716a0 con 0x7f453c130540 2023-10-01T07:54:12.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.190+0000 7f4541356700 1 -- 172.21.15.26:0/1263882982 >> v1:172.21.15.26:6789/0 conn(0x7f453c130540 legacy=0x7f453c130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:12.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.190+0000 7f4541356700 1 -- 172.21.15.26:0/1263882982 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453c070b80 con 0x7f453c133540 2023-10-01T07:54:12.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.190+0000 7f4541356700 1 --2- 172.21.15.26:0/1263882982 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f453c133540 0x7f453c135920 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4530009840 tx=0x7f4530009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76c9aa5b08799165 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:12.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.190+0000 7f4540b55700 1 -- 172.21.15.26:0/1263882982 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4530011830 con 0x7f453c133540 2023-10-01T07:54:12.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.190+0000 7f4540b55700 1 -- 172.21.15.26:0/1263882982 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4530011990 con 0x7f453c133540 2023-10-01T07:54:12.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.190+0000 7f4540b55700 1 -- 172.21.15.26:0/1263882982 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4530011d20 con 0x7f453c133540 2023-10-01T07:54:12.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.191+0000 7f4543dbb700 1 -- 172.21.15.26:0/1263882982 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f453c133540 msgr2=0x7f453c135920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:12.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.191+0000 7f4543dbb700 1 --2- 172.21.15.26:0/1263882982 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f453c133540 0x7f453c135920 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4530009840 tx=0x7f4530009b50 comp rx=0 tx=0).stop 2023-10-01T07:54:12.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.191+0000 7f4543dbb700 1 -- 172.21.15.26:0/1263882982 shutdown_connections 2023-10-01T07:54:12.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.191+0000 7f4543dbb700 1 --2- 172.21.15.26:0/1263882982 >> v2:172.21.15.26:3300/0 conn(0x7f453c135e60 0x7f453c138240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:12.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.191+0000 7f4543dbb700 1 --2- 172.21.15.26:0/1263882982 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f453c133540 0x7f453c135920 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:12.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.192+0000 7f4543dbb700 1 -- 172.21.15.26:0/1263882982 >> 172.21.15.26:0/1263882982 conn(0x7f453c0a2aa0 msgr2=0x7f453c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:12.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.192+0000 7f4543dbb700 1 -- 172.21.15.26:0/1263882982 shutdown_connections 2023-10-01T07:54:12.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.192+0000 7f4543dbb700 1 -- 172.21.15.26:0/1263882982 wait complete. 2023-10-01T07:54:12.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.193+0000 7f4543dbb700 1 Processor -- start 2023-10-01T07:54:12.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.193+0000 7f4543dbb700 1 -- start start 2023-10-01T07:54:12.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.194+0000 7f4543dbb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f453c130540 0x7f453c09be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:12.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.194+0000 7f4543dbb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f453c133540 0x7f453c09c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:12.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.194+0000 7f4543dbb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f453c135e60 0x7f453c09c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:12.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.194+0000 7f4543dbb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453c09dbb0 con 0x7f453c133540 2023-10-01T07:54:12.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.194+0000 7f4543dbb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f453c136f70 con 0x7f453c135e60 2023-10-01T07:54:12.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.194+0000 7f4543dbb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f453c0718e0 con 0x7f453c130540 2023-10-01T07:54:12.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.194+0000 7f4541b57700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f453c130540 0x7f453c09be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:12.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.194+0000 7f4541b57700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f453c130540 0x7f453c09be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:42944/0 (socket says 172.21.15.26:42944) 2023-10-01T07:54:12.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.194+0000 7f4541b57700 1 -- 172.21.15.26:0/428696075 learned_addr learned my addr 172.21.15.26:0/428696075 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:12.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.194+0000 7f4542358700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f453c135e60 0x7f453c09c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:12.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.194+0000 7f4541356700 1 --2- 172.21.15.26:0/428696075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f453c133540 0x7f453c09c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:12.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.195+0000 7f4541b57700 1 -- 172.21.15.26:0/428696075 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f453c135e60 msgr2=0x7f453c09c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:12.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.195+0000 7f4541b57700 1 --2- 172.21.15.26:0/428696075 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f453c135e60 0x7f453c09c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:12.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.195+0000 7f4541b57700 1 -- 172.21.15.26:0/428696075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f453c133540 msgr2=0x7f453c09c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:12.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.195+0000 7f4541b57700 1 --2- 172.21.15.26:0/428696075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f453c133540 0x7f453c09c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:12.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.195+0000 7f4541b57700 1 -- 172.21.15.26:0/428696075 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45300094a0 con 0x7f453c130540 2023-10-01T07:54:12.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.195+0000 7f4541b57700 1 --2- 172.21.15.26:0/428696075 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f453c130540 0x7f453c09be20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f453800c450 tx=0x7f453800c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:12.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.196+0000 7f452e7fc700 1 -- 172.21.15.26:0/428696075 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45380054e0 con 0x7f453c130540 2023-10-01T07:54:12.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.196+0000 7f4543dbb700 1 -- 172.21.15.26:0/428696075 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f453c13b010 con 0x7f453c130540 2023-10-01T07:54:12.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.196+0000 7f452e7fc700 1 -- 172.21.15.26:0/428696075 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453800ce60 con 0x7f453c130540 2023-10-01T07:54:12.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.196+0000 7f452e7fc700 1 -- 172.21.15.26:0/428696075 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45380038c0 con 0x7f453c130540 2023-10-01T07:54:12.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.196+0000 7f4543dbb700 1 -- 172.21.15.26:0/428696075 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f453c09e340 con 0x7f453c130540 2023-10-01T07:54:12.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.197+0000 7f452e7fc700 1 -- 172.21.15.26:0/428696075 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f4538003a20 con 0x7f453c130540 2023-10-01T07:54:12.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.197+0000 7f4543dbb700 1 -- 172.21.15.26:0/428696075 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f453c074ea0 con 0x7f453c130540 2023-10-01T07:54:12.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.197+0000 7f452e7fc700 1 -- 172.21.15.26:0/428696075 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f453803acf0 con 0x7f453c130540 2023-10-01T07:54:12.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.197+0000 7f4541356700 1 -- 172.21.15.26:0/428696075 >> v1:172.21.15.26:6816/118178 conn(0x7f452002c1b0 legacy=0x7f452002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/118178 2023-10-01T07:54:12.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.203+0000 7fd0677f2700 1 Processor -- start 2023-10-01T07:54:12.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.204+0000 7fd0677f2700 1 -- start start 2023-10-01T07:54:12.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.204+0000 7fd0677f2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd06006a770 0x7fd06009d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:12.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.204+0000 7fd0677f2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd06013d1f0 0x7fd06013f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:12.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.204+0000 7fd0677f2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd06009a810 con 0x7fd06009dc30 2023-10-01T07:54:12.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.204+0000 7fd0677f2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06006ab40 con 0x7fd06013d1f0 2023-10-01T07:54:12.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.204+0000 7fd0677f2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd06009ebc0 con 0x7fd06006a770 2023-10-01T07:54:12.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.205+0000 7fd064d8d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd06009dc30 0x7fd06009e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43934/0 (socket says 172.21.15.26:43934) 2023-10-01T07:54:12.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.205+0000 7fd064d8d700 1 -- 172.21.15.26:0/2781863875 learned_addr learned my addr 172.21.15.26:0/2781863875 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:12.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.205+0000 7fd065d8f700 1 --2- 172.21.15.26:0/2781863875 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd06013d1f0 0x7fd06013f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:12.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.205+0000 7f452e7fc700 1 -- 172.21.15.26:0/428696075 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f4538019b40 con 0x7f453c130540 2023-10-01T07:54:12.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.205+0000 7fd06558e700 1 --2- 172.21.15.26:0/2781863875 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd06006a770 0x7fd06009d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:12.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.205+0000 7fd065d8f700 1 -- 172.21.15.26:0/2781863875 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd06006a770 msgr2=0x7fd06009d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:12.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.205+0000 7fd065d8f700 1 --2- 172.21.15.26:0/2781863875 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd06006a770 0x7fd06009d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:12.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.205+0000 7fd065d8f700 1 -- 172.21.15.26:0/2781863875 >> v1:172.21.15.26:6789/0 conn(0x7fd06009dc30 legacy=0x7fd06009e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:12.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.205+0000 7fd065d8f700 1 -- 172.21.15.26:0/2781863875 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06009e920 con 0x7fd06013d1f0 2023-10-01T07:54:12.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.207+0000 7fd065d8f700 1 --2- 172.21.15.26:0/2781863875 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd06013d1f0 0x7fd06013f5d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd058009dc0 tx=0x7fd05800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b45e341b57e7e8a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:12.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.207+0000 7fd057fff700 1 -- 172.21.15.26:0/2781863875 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05800e070 con 0x7fd06013d1f0 2023-10-01T07:54:12.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.207+0000 7fd057fff700 1 -- 172.21.15.26:0/2781863875 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05800bbd0 con 0x7fd06013d1f0 2023-10-01T07:54:12.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.207+0000 7fd057fff700 1 -- 172.21.15.26:0/2781863875 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd058012430 con 0x7fd06013d1f0 2023-10-01T07:54:12.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.208+0000 7fd0677f2700 1 -- 172.21.15.26:0/2781863875 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd06013d1f0 msgr2=0x7fd06013f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:12.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.208+0000 7fd0677f2700 1 --2- 172.21.15.26:0/2781863875 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd06013d1f0 0x7fd06013f5d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd058009dc0 tx=0x7fd05800b330 comp rx=0 tx=0).stop 2023-10-01T07:54:12.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.212+0000 7fd0677f2700 1 -- 172.21.15.26:0/2781863875 shutdown_connections 2023-10-01T07:54:12.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.212+0000 7fd0677f2700 1 --2- 172.21.15.26:0/2781863875 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd06006a770 0x7fd06009d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:12.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.212+0000 7fd0677f2700 1 --2- 172.21.15.26:0/2781863875 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd06013d1f0 0x7fd06013f5d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:12.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.212+0000 7fd0677f2700 1 -- 172.21.15.26:0/2781863875 >> 172.21.15.26:0/2781863875 conn(0x7fd060066f50 msgr2=0x7fd06009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:12.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.212+0000 7fd0677f2700 1 -- 172.21.15.26:0/2781863875 shutdown_connections 2023-10-01T07:54:12.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.212+0000 7fd0677f2700 1 -- 172.21.15.26:0/2781863875 wait complete. 2023-10-01T07:54:12.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.213+0000 7fd0677f2700 1 Processor -- start 2023-10-01T07:54:12.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.213+0000 7fd0677f2700 1 -- start start 2023-10-01T07:54:12.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.214+0000 7fd0677f2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd06006a770 0x7fd060071670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:12.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.214+0000 7fd0677f2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd06009dc30 0x7fd06013b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:12.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.214+0000 7fd0677f2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd06013d1f0 0x7fd06013bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:12.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.214+0000 7fd0677f2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06011e360 con 0x7fd06006a770 2023-10-01T07:54:12.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.214+0000 7fd0677f2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06011ea80 con 0x7fd06013d1f0 2023-10-01T07:54:12.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.214+0000 7fd0677f2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd06011f120 con 0x7fd06009dc30 2023-10-01T07:54:12.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.214+0000 7fd064d8d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd06009dc30 0x7fd06013b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:12.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.214+0000 7fd064d8d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd06009dc30 0x7fd06013b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:42962/0 (socket says 172.21.15.26:42962) 2023-10-01T07:54:12.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.215+0000 7fd064d8d700 1 -- 172.21.15.26:0/2754923858 learned_addr learned my addr 172.21.15.26:0/2754923858 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:12.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.215+0000 7fd065d8f700 1 --2- 172.21.15.26:0/2754923858 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd06013d1f0 0x7fd06013bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:12.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.215+0000 7fd065d8f700 1 -- 172.21.15.26:0/2754923858 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd06009dc30 msgr2=0x7fd06013b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:12.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.215+0000 7fd065d8f700 1 --2- 172.21.15.26:0/2754923858 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd06009dc30 0x7fd06013b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:12.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.215+0000 7fd065d8f700 1 -- 172.21.15.26:0/2754923858 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd06006a770 msgr2=0x7fd060071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:12.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.215+0000 7fd065d8f700 1 --2- 172.21.15.26:0/2754923858 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd06006a770 0x7fd060071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:12.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.215+0000 7fd065d8f700 1 -- 172.21.15.26:0/2754923858 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd058009a70 con 0x7fd06013d1f0 2023-10-01T07:54:12.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.215+0000 7fd065d8f700 1 --2- 172.21.15.26:0/2754923858 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd06013d1f0 0x7fd06013bbd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd058016000 tx=0x7fd058004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:12.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.215+0000 7fd055ffb700 1 -- 172.21.15.26:0/2754923858 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd058004960 con 0x7fd06013d1f0 2023-10-01T07:54:12.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.216+0000 7fd0677f2700 1 -- 172.21.15.26:0/2754923858 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd060072270 con 0x7fd06013d1f0 2023-10-01T07:54:12.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.216+0000 7fd0677f2700 1 -- 172.21.15.26:0/2754923858 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd06011d890 con 0x7fd06013d1f0 2023-10-01T07:54:12.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.216+0000 7fd055ffb700 1 -- 172.21.15.26:0/2754923858 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd058020070 con 0x7fd06013d1f0 2023-10-01T07:54:12.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.216+0000 7fd055ffb700 1 -- 172.21.15.26:0/2754923858 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0580276c0 con 0x7fd06013d1f0 2023-10-01T07:54:12.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.217+0000 7fd055ffb700 1 -- 172.21.15.26:0/2754923858 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fd058012430 con 0x7fd06013d1f0 2023-10-01T07:54:12.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.217+0000 7fd0677f2700 1 -- 172.21.15.26:0/2754923858 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd060074ea0 con 0x7fd06013d1f0 2023-10-01T07:54:12.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.218+0000 7fd06558e700 1 -- 172.21.15.26:0/2754923858 >> v1:172.21.15.26:6816/118178 conn(0x7fd04402c1b0 legacy=0x7fd04402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/118178 2023-10-01T07:54:12.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.218+0000 7fd055ffb700 1 -- 172.21.15.26:0/2754923858 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3922+0+0 (secure 0 0 0) 0x7fd058022070 con 0x7fd06013d1f0 2023-10-01T07:54:12.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.221+0000 7fbde1351700 1 -- 172.21.15.26:0/980668419 >> v1:172.21.15.26:6816/118178 conn(0x7fbdc002c1b0 legacy=0x7fbdc002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/118178 2023-10-01T07:54:12.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.226+0000 7fd055ffb700 1 -- 172.21.15.26:0/2754923858 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fd058011750 con 0x7fd06013d1f0 2023-10-01T07:54:12.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.238+0000 7fbde3db6700 1 -- 172.21.15.26:0/980668419 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbddc06b9a0 con 0x7fbddc0700e0 2023-10-01T07:54:12.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.239+0000 7fbdd27fc700 1 -- 172.21.15.26:0/980668419 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbdd8017360 con 0x7fbddc0700e0 2023-10-01T07:54:12.239 INFO:teuthology.orchestra.run.smithi026.stdout:38654705693 2023-10-01T07:54:12.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.242+0000 7fbde3db6700 1 -- 172.21.15.26:0/980668419 >> v1:172.21.15.26:6816/118178 conn(0x7fbdc002c1b0 legacy=0x7fbdc002e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:12.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.242+0000 7fbde3db6700 1 -- 172.21.15.26:0/980668419 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbddc0700e0 msgr2=0x7fbddc11eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:12.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.242+0000 7fbde3db6700 1 --2- 172.21.15.26:0/980668419 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbddc0700e0 0x7fbddc11eac0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbdd800ed70 tx=0x7fbdd800d630 comp rx=0 tx=0).stop 2023-10-01T07:54:12.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.242+0000 7fbde3db6700 1 -- 172.21.15.26:0/980668419 shutdown_connections 2023-10-01T07:54:12.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.242+0000 7fbde3db6700 1 --2- 172.21.15.26:0/980668419 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbddc12d2e0 0x7fbddc11f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:12.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.242+0000 7fbde3db6700 1 --2- 172.21.15.26:0/980668419 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbddc0700e0 0x7fbddc11eac0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:12.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.242+0000 7fbde3db6700 1 --2- 172.21.15.26:0/980668419 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbddc0709f0 0x7fbddc11f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:12.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.242+0000 7fbde3db6700 1 -- 172.21.15.26:0/980668419 >> 172.21.15.26:0/980668419 conn(0x7fbddc0a27f0 msgr2=0x7fbddc12e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:12.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.242+0000 7fbde3db6700 1 -- 172.21.15.26:0/980668419 shutdown_connections 2023-10-01T07:54:12.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.242+0000 7fbde3db6700 1 -- 172.21.15.26:0/980668419 wait complete. 2023-10-01T07:54:12.265 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705693 for osd.0 2023-10-01T07:54:12.297 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:12.296+0000 7f6cc52b3240 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-01T07:54:12.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.354+0000 7f71037fe700 1 -- 172.21.15.26:0/2011216250 >> v1:172.21.15.26:6816/118178 conn(0x7f70f002c1b0 legacy=0x7f70f002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/118178 2023-10-01T07:54:12.393 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:12.392+0000 7f6cc52b3240 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-01T07:54:12.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.398+0000 7f4541356700 1 -- 172.21.15.26:0/428696075 >> v1:172.21.15.26:6816/118178 conn(0x7f452002c1b0 legacy=0x7f452002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/118178 2023-10-01T07:54:12.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.407+0000 7f710aa3d700 1 -- 172.21.15.26:0/2011216250 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f710406b9e0 con 0x7f710406e570 2023-10-01T07:54:12.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.408+0000 7f7100ff9700 1 -- 172.21.15.26:0/2011216250 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f70f4029090 con 0x7f710406e570 2023-10-01T07:54:12.408 INFO:teuthology.orchestra.run.smithi026.stdout:38654705693 2023-10-01T07:54:12.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.411+0000 7f710aa3d700 1 -- 172.21.15.26:0/2011216250 >> v1:172.21.15.26:6816/118178 conn(0x7f70f002c1b0 legacy=0x7f70f002e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:12.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.411+0000 7f710aa3d700 1 -- 172.21.15.26:0/2011216250 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f710406e570 msgr2=0x7f7104123250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:12.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.411+0000 7f710aa3d700 1 --2- 172.21.15.26:0/2011216250 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f710406e570 0x7f7104123250 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f70f400b530 tx=0x7f70f400b840 comp rx=0 tx=0).stop 2023-10-01T07:54:12.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.411+0000 7f710aa3d700 1 -- 172.21.15.26:0/2011216250 shutdown_connections 2023-10-01T07:54:12.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.411+0000 7f710aa3d700 1 --2- 172.21.15.26:0/2011216250 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7104123cd0 0x7f71041cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:12.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.411+0000 7f710aa3d700 1 --2- 172.21.15.26:0/2011216250 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f710406e570 0x7f7104123250 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:12.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.411+0000 7f710aa3d700 1 --2- 172.21.15.26:0/2011216250 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f710406ee80 0x7f7104123790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:12.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.411+0000 7f710aa3d700 1 -- 172.21.15.26:0/2011216250 >> 172.21.15.26:0/2011216250 conn(0x7f71040a2aa0 msgr2=0x7f71041373d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:12.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.412+0000 7f710aa3d700 1 -- 172.21.15.26:0/2011216250 shutdown_connections 2023-10-01T07:54:12.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.412+0000 7f710aa3d700 1 -- 172.21.15.26:0/2011216250 wait complete. 2023-10-01T07:54:12.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.415+0000 7fd0677f2700 1 -- 172.21.15.26:0/2754923858 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd06009a3d0 con 0x7fd06013d1f0 2023-10-01T07:54:12.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.416+0000 7fd055ffb700 1 -- 172.21.15.26:0/2754923858 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd058011390 con 0x7fd06013d1f0 2023-10-01T07:54:12.416 INFO:teuthology.orchestra.run.smithi026.stdout:38654705693 2023-10-01T07:54:12.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.418+0000 7fd0677f2700 1 -- 172.21.15.26:0/2754923858 >> v1:172.21.15.26:6816/118178 conn(0x7fd04402c1b0 legacy=0x7fd04402e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:12.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.418+0000 7fd0677f2700 1 -- 172.21.15.26:0/2754923858 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd06013d1f0 msgr2=0x7fd06013bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:12.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.418+0000 7fd0677f2700 1 --2- 172.21.15.26:0/2754923858 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd06013d1f0 0x7fd06013bbd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd058016000 tx=0x7fd058004ad0 comp rx=0 tx=0).stop 2023-10-01T07:54:12.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.418+0000 7fd0677f2700 1 -- 172.21.15.26:0/2754923858 shutdown_connections 2023-10-01T07:54:12.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.418+0000 7fd0677f2700 1 --2- 172.21.15.26:0/2754923858 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd06013d1f0 0x7fd06013bbd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:12.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.418+0000 7fd0677f2700 1 --2- 172.21.15.26:0/2754923858 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd06006a770 0x7fd060071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:12.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.418+0000 7fd0677f2700 1 --2- 172.21.15.26:0/2754923858 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd06009dc30 0x7fd06013b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:12.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.418+0000 7fd0677f2700 1 -- 172.21.15.26:0/2754923858 >> 172.21.15.26:0/2754923858 conn(0x7fd060066f50 msgr2=0x7fd0600a2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:12.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.418+0000 7fd0677f2700 1 -- 172.21.15.26:0/2754923858 shutdown_connections 2023-10-01T07:54:12.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.418+0000 7fd0677f2700 1 -- 172.21.15.26:0/2754923858 wait complete. 2023-10-01T07:54:12.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705693 for osd.2 2023-10-01T07:54:12.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.3 2023-10-01T07:54:12.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.441+0000 7f4543dbb700 1 -- 172.21.15.26:0/428696075 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f453c06b9e0 con 0x7f453c130540 2023-10-01T07:54:12.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.442+0000 7f452e7fc700 1 -- 172.21.15.26:0/428696075 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4538011e40 con 0x7f453c130540 2023-10-01T07:54:12.442 INFO:teuthology.orchestra.run.smithi026.stdout:38654705693 2023-10-01T07:54:12.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.444+0000 7f4543dbb700 1 -- 172.21.15.26:0/428696075 >> v1:172.21.15.26:6816/118178 conn(0x7f452002c1b0 legacy=0x7f452002e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:12.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.444+0000 7f4543dbb700 1 -- 172.21.15.26:0/428696075 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f453c130540 msgr2=0x7f453c09be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:12.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.444+0000 7f4543dbb700 1 --2- 172.21.15.26:0/428696075 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f453c130540 0x7f453c09be20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f453800c450 tx=0x7f453800c760 comp rx=0 tx=0).stop 2023-10-01T07:54:12.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.444+0000 7f4543dbb700 1 -- 172.21.15.26:0/428696075 shutdown_connections 2023-10-01T07:54:12.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.444+0000 7f4543dbb700 1 --2- 172.21.15.26:0/428696075 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f453c135e60 0x7f453c09c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:12.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.444+0000 7f4543dbb700 1 --2- 172.21.15.26:0/428696075 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f453c130540 0x7f453c09be20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:12.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.444+0000 7f4543dbb700 1 --2- 172.21.15.26:0/428696075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f453c133540 0x7f453c09c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:12.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.444+0000 7f4543dbb700 1 -- 172.21.15.26:0/428696075 >> 172.21.15.26:0/428696075 conn(0x7f453c0a2aa0 msgr2=0x7f453c131320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:12.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.444+0000 7f4543dbb700 1 -- 172.21.15.26:0/428696075 shutdown_connections 2023-10-01T07:54:12.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:12.444+0000 7f4543dbb700 1 -- 172.21.15.26:0/428696075 wait complete. 2023-10-01T07:54:12.458 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705693 for osd.1 2023-10-01T07:54:12.581 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:12.581+0000 7f6cc52b3240 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-01T07:54:12.663 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:12.662+0000 7f6cc52b3240 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-01T07:54:13.266 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:54:13.406 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:13.406+0000 7f6cc52b3240 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-01T07:54:13.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.408+0000 7fa07190c700 1 Processor -- start 2023-10-01T07:54:13.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.408+0000 7fa07190c700 1 -- start start 2023-10-01T07:54:13.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.408+0000 7fa07190c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa06c09e1d0 0x7fa06c135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:13.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.408+0000 7fa07190c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa06c135e50 0x7fa06c138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:13.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.408+0000 7fa07190c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa06c09f130 con 0x7fa06c09d6f0 2023-10-01T07:54:13.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.408+0000 7fa07190c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa06c09f520 con 0x7fa06c09e1d0 2023-10-01T07:54:13.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.408+0000 7fa07190c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa06c09e930 con 0x7fa06c135e50 2023-10-01T07:54:13.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.409+0000 7fa06a7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa06c09e1d0 0x7fa06c135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:13.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.409+0000 7fa06b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa06c135e50 0x7fa06c138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:13.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.409+0000 7fa06a7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa06c09e1d0 0x7fa06c135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37732/0 (socket says 172.21.15.26:37732) 2023-10-01T07:54:13.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.409+0000 7fa06a7fc700 1 -- 172.21.15.26:0/2372235634 learned_addr learned my addr 172.21.15.26:0/2372235634 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:13.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.409+0000 7fa06a7fc700 1 -- 172.21.15.26:0/2372235634 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa06c135e50 msgr2=0x7fa06c138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:13.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.409+0000 7fa06a7fc700 1 --2- 172.21.15.26:0/2372235634 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa06c135e50 0x7fa06c138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.409+0000 7fa06a7fc700 1 -- 172.21.15.26:0/2372235634 >> v1:172.21.15.26:6789/0 conn(0x7fa06c09d6f0 legacy=0x7fa06c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:13.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.409+0000 7fa06a7fc700 1 -- 172.21.15.26:0/2372235634 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa06c09b2d0 con 0x7fa06c09e1d0 2023-10-01T07:54:13.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.409+0000 7fa069ffb700 1 -- 172.21.15.26:0/2372235634 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 912172590 0 0) 0x7fa06c09f130 con 0x7fa06c09d6f0 2023-10-01T07:54:13.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.409+0000 7fa06b7fe700 1 --2- 172.21.15.26:0/2372235634 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa06c135e50 0x7fa06c138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:13.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.409+0000 7fa06a7fc700 1 --2- 172.21.15.26:0/2372235634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa06c09e1d0 0x7fa06c135910 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa06000bb90 tx=0x7fa06000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e07bd1f24201dc server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:13.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.409+0000 7fa069ffb700 1 -- 172.21.15.26:0/2372235634 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06000dd30 con 0x7fa06c09e1d0 2023-10-01T07:54:13.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.409+0000 7fa069ffb700 1 -- 172.21.15.26:0/2372235634 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06000de90 con 0x7fa06c09e1d0 2023-10-01T07:54:13.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.409+0000 7fa069ffb700 1 -- 172.21.15.26:0/2372235634 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa060010690 con 0x7fa06c09e1d0 2023-10-01T07:54:13.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.410+0000 7fa07190c700 1 -- 172.21.15.26:0/2372235634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa06c09e1d0 msgr2=0x7fa06c135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:13.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.410+0000 7fa07190c700 1 --2- 172.21.15.26:0/2372235634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa06c09e1d0 0x7fa06c135910 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa06000bb90 tx=0x7fa06000bea0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.410+0000 7fa07190c700 1 -- 172.21.15.26:0/2372235634 shutdown_connections 2023-10-01T07:54:13.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.410+0000 7fa07190c700 1 --2- 172.21.15.26:0/2372235634 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa06c135e50 0x7fa06c138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.410+0000 7fa07190c700 1 --2- 172.21.15.26:0/2372235634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa06c09e1d0 0x7fa06c135910 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.410+0000 7fa07190c700 1 -- 172.21.15.26:0/2372235634 >> 172.21.15.26:0/2372235634 conn(0x7fa06c066f50 msgr2=0x7fa06c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:13.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.410+0000 7fa07190c700 1 -- 172.21.15.26:0/2372235634 shutdown_connections 2023-10-01T07:54:13.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.410+0000 7fa07190c700 1 -- 172.21.15.26:0/2372235634 wait complete. 2023-10-01T07:54:13.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.411+0000 7fa07190c700 1 Processor -- start 2023-10-01T07:54:13.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.411+0000 7fa07190c700 1 -- start start 2023-10-01T07:54:13.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.412+0000 7fa07190c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa06c09d6f0 0x7fa06c11f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:13.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.412+0000 7fa07190c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa06c09e1d0 0x7fa06c11faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:13.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.412+0000 7fa07190c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa06c135e50 0x7fa06c11ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:13.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.412+0000 7fa07190c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06c121360 con 0x7fa06c09e1d0 2023-10-01T07:54:13.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.412+0000 7fa07190c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa06c121170 con 0x7fa06c135e50 2023-10-01T07:54:13.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.412+0000 7fa07190c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa06c123080 con 0x7fa06c09d6f0 2023-10-01T07:54:13.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.412+0000 7fa06affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa06c09d6f0 0x7fa06c11f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:13.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.412+0000 7fa06b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa06c135e50 0x7fa06c11ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:13.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.412+0000 7fa06affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa06c09d6f0 0x7fa06c11f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55344/0 (socket says 172.21.15.26:55344) 2023-10-01T07:54:13.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.412+0000 7fa06b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa06c135e50 0x7fa06c11ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:60160/0 (socket says 172.21.15.26:60160) 2023-10-01T07:54:13.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.412+0000 7fa06affd700 1 -- 172.21.15.26:0/2185015196 learned_addr learned my addr 172.21.15.26:0/2185015196 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:13.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.412+0000 7fa06a7fc700 1 --2- 172.21.15.26:0/2185015196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa06c09e1d0 0x7fa06c11faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:13.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.413+0000 7fa06b7fe700 1 -- 172.21.15.26:0/2185015196 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa06c09d6f0 msgr2=0x7fa06c11f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:13.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.413+0000 7fa06b7fe700 1 --2- 172.21.15.26:0/2185015196 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa06c09d6f0 0x7fa06c11f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.413+0000 7fa06b7fe700 1 -- 172.21.15.26:0/2185015196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa06c09e1d0 msgr2=0x7fa06c11faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:13.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.413+0000 7fa06b7fe700 1 --2- 172.21.15.26:0/2185015196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa06c09e1d0 0x7fa06c11faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.413+0000 7fa06b7fe700 1 -- 172.21.15.26:0/2185015196 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa064009a70 con 0x7fa06c135e50 2023-10-01T07:54:13.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.413+0000 7fa06a7fc700 1 --2- 172.21.15.26:0/2185015196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa06c09e1d0 0x7fa06c11faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:13.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.413+0000 7fa06affd700 1 --2- 172.21.15.26:0/2185015196 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa06c09d6f0 0x7fa06c11f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:13.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.413+0000 7fa06b7fe700 1 --2- 172.21.15.26:0/2185015196 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa06c135e50 0x7fa06c11ffe0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa06400ef90 tx=0x7fa06400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:13.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.413+0000 7fa053fff700 1 -- 172.21.15.26:0/2185015196 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06400ca90 con 0x7fa06c135e50 2023-10-01T07:54:13.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.413+0000 7fa053fff700 1 -- 172.21.15.26:0/2185015196 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06400f040 con 0x7fa06c135e50 2023-10-01T07:54:13.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.413+0000 7fa07190c700 1 -- 172.21.15.26:0/2185015196 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa06000b7f0 con 0x7fa06c135e50 2023-10-01T07:54:13.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.413+0000 7fa053fff700 1 -- 172.21.15.26:0/2185015196 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06400ce30 con 0x7fa06c135e50 2023-10-01T07:54:13.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.413+0000 7fa07190c700 1 -- 172.21.15.26:0/2185015196 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa06c09c700 con 0x7fa06c135e50 2023-10-01T07:54:13.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.414+0000 7fa053fff700 1 -- 172.21.15.26:0/2185015196 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fa064014480 con 0x7fa06c135e50 2023-10-01T07:54:13.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.414+0000 7fa053fff700 1 -- 172.21.15.26:0/2185015196 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3922+0+0 (secure 0 0 0) 0x7fa06403bd80 con 0x7fa06c135e50 2023-10-01T07:54:13.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.414+0000 7fa06affd700 1 -- 172.21.15.26:0/2185015196 >> v1:172.21.15.26:6816/118178 conn(0x7fa05802c1b0 legacy=0x7fa05802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/118178 2023-10-01T07:54:13.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.414+0000 7fa07190c700 1 -- 172.21.15.26:0/2185015196 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa06c074ea0 con 0x7fa06c135e50 2023-10-01T07:54:13.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.419+0000 7fa053fff700 1 -- 172.21.15.26:0/2185015196 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fa064018070 con 0x7fa06c135e50 2023-10-01T07:54:13.435 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:54:13.435 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:54:13.458 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:54:13.560 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:13.560+0000 7f6cc52b3240 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-01T07:54:13.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.589+0000 7f0d5b96b700 1 Processor -- start 2023-10-01T07:54:13.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.589+0000 7f0d5b96b700 1 -- start start 2023-10-01T07:54:13.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.590+0000 7f0d5b96b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d5409eca0 0x7f0d5413cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:13.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.590+0000 7f0d5b96b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0d5406f050 0x7f0d5413f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:13.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.590+0000 7f0d5b96b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d54070ee0 con 0x7f0d5406e570 2023-10-01T07:54:13.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.590+0000 7f0d5b96b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d54071980 con 0x7f0d5406f050 2023-10-01T07:54:13.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.590+0000 7f0d5b96b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d54071480 con 0x7f0d5409eca0 2023-10-01T07:54:13.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.590+0000 7f0d58f06700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d5409eca0 0x7f0d5413cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:13.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.590+0000 7f0d58f06700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d5409eca0 0x7f0d5413cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55358/0 (socket says 172.21.15.26:55358) 2023-10-01T07:54:13.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.590+0000 7f0d58f06700 1 -- 172.21.15.26:0/3494499059 learned_addr learned my addr 172.21.15.26:0/3494499059 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:13.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.590+0000 7f0d59f08700 1 --2- 172.21.15.26:0/3494499059 >> v2:172.21.15.26:3300/0 conn(0x7f0d5406f050 0x7f0d5413f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:13.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.590+0000 7f0d58f06700 1 -- 172.21.15.26:0/3494499059 >> v2:172.21.15.26:3300/0 conn(0x7f0d5406f050 msgr2=0x7f0d5413f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:13.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.590+0000 7f0d58f06700 1 --2- 172.21.15.26:0/3494499059 >> v2:172.21.15.26:3300/0 conn(0x7f0d5406f050 0x7f0d5413f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.590+0000 7f0d58f06700 1 -- 172.21.15.26:0/3494499059 >> v1:172.21.15.26:6789/0 conn(0x7f0d5406e570 legacy=0x7f0d5406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:13.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.591+0000 7f0d58f06700 1 -- 172.21.15.26:0/3494499059 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d54071b90 con 0x7f0d5409eca0 2023-10-01T07:54:13.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.591+0000 7f0d58f06700 1 --2- 172.21.15.26:0/3494499059 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d5409eca0 0x7f0d5413cea0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0d480098f0 tx=0x7f0d48009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ed159028911abba server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:13.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.591+0000 7f0d47fff700 1 -- 172.21.15.26:0/3494499059 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d48004230 con 0x7f0d5409eca0 2023-10-01T07:54:13.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.591+0000 7f0d47fff700 1 -- 172.21.15.26:0/3494499059 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d48004390 con 0x7f0d5409eca0 2023-10-01T07:54:13.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.591+0000 7f0d47fff700 1 -- 172.21.15.26:0/3494499059 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d480036a0 con 0x7f0d5409eca0 2023-10-01T07:54:13.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.592+0000 7f0d5b96b700 1 -- 172.21.15.26:0/3494499059 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d5409eca0 msgr2=0x7f0d5413cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:13.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.592+0000 7f0d5b96b700 1 --2- 172.21.15.26:0/3494499059 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d5409eca0 0x7f0d5413cea0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0d480098f0 tx=0x7f0d48009c00 comp rx=0 tx=0).stop 2023-10-01T07:54:13.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.592+0000 7f0d5b96b700 1 -- 172.21.15.26:0/3494499059 shutdown_connections 2023-10-01T07:54:13.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.592+0000 7f0d5b96b700 1 --2- 172.21.15.26:0/3494499059 >> v2:172.21.15.26:3300/0 conn(0x7f0d5406f050 0x7f0d5413f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.592+0000 7f0d5b96b700 1 --2- 172.21.15.26:0/3494499059 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d5409eca0 0x7f0d5413cea0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.592+0000 7f0d5b96b700 1 -- 172.21.15.26:0/3494499059 >> 172.21.15.26:0/3494499059 conn(0x7f0d540a2aa0 msgr2=0x7f0d540a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:13.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.592+0000 7f0d5b96b700 1 -- 172.21.15.26:0/3494499059 shutdown_connections 2023-10-01T07:54:13.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.592+0000 7f0d5b96b700 1 -- 172.21.15.26:0/3494499059 wait complete. 2023-10-01T07:54:13.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.593+0000 7f0d5b96b700 1 Processor -- start 2023-10-01T07:54:13.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.593+0000 7f0d5b96b700 1 -- start start 2023-10-01T07:54:13.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.593+0000 7f0d5b96b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d5406e570 0x7f0d5413cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:13.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.593+0000 7f0d5b96b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d5406f050 0x7f0d5413d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:13.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.593+0000 7f0d5b96b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d5413da50 0x7f0d5412adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:13.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.593+0000 7f0d5b96b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5413e4a0 con 0x7f0d5406e570 2023-10-01T07:54:13.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.593+0000 7f0d5b96b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5412deb0 con 0x7f0d5413da50 2023-10-01T07:54:13.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.594+0000 7f0d5b96b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d54138730 con 0x7f0d5406f050 2023-10-01T07:54:13.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.594+0000 7f0d58f06700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d5406f050 0x7f0d5413d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:13.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.594+0000 7f0d58f06700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d5406f050 0x7f0d5413d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55364/0 (socket says 172.21.15.26:55364) 2023-10-01T07:54:13.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.594+0000 7f0d58f06700 1 -- 172.21.15.26:0/636192624 learned_addr learned my addr 172.21.15.26:0/636192624 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:13.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.594+0000 7f0d59707700 1 --2- 172.21.15.26:0/636192624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d5406e570 0x7f0d5413cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:13.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.594+0000 7f0d59f08700 1 --2- 172.21.15.26:0/636192624 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d5413da50 0x7f0d5412adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:13.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.594+0000 7f0d59707700 1 -- 172.21.15.26:0/636192624 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d5406f050 msgr2=0x7f0d5413d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:13.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.594+0000 7f0d59707700 1 --2- 172.21.15.26:0/636192624 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d5406f050 0x7f0d5413d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.594+0000 7f0d59707700 1 -- 172.21.15.26:0/636192624 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d5413da50 msgr2=0x7f0d5412adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:13.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.594+0000 7f0d59707700 1 --2- 172.21.15.26:0/636192624 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d5413da50 0x7f0d5412adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.594+0000 7f0d59707700 1 -- 172.21.15.26:0/636192624 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d48009550 con 0x7f0d5406e570 2023-10-01T07:54:13.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.594+0000 7f0d58f06700 1 --2- 172.21.15.26:0/636192624 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d5406f050 0x7f0d5413d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:13.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.595+0000 7f0d59707700 1 --2- 172.21.15.26:0/636192624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d5406e570 0x7f0d5413cfd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0d5000c4a0 tx=0x7f0d5000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:13.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.595+0000 7f0d45ffb700 1 -- 172.21.15.26:0/636192624 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d50011790 con 0x7f0d5406e570 2023-10-01T07:54:13.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.595+0000 7f0d45ffb700 1 -- 172.21.15.26:0/636192624 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d50011910 con 0x7f0d5406e570 2023-10-01T07:54:13.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.595+0000 7f0d5b96b700 1 -- 172.21.15.26:0/636192624 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d5412d640 con 0x7f0d5406e570 2023-10-01T07:54:13.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.595+0000 7f0d45ffb700 1 -- 172.21.15.26:0/636192624 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d50011cc0 con 0x7f0d5406e570 2023-10-01T07:54:13.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.595+0000 7f0d5b96b700 1 -- 172.21.15.26:0/636192624 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d54070610 con 0x7f0d5406e570 2023-10-01T07:54:13.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.596+0000 7f0d5b96b700 1 -- 172.21.15.26:0/636192624 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d54074ea0 con 0x7f0d5406e570 2023-10-01T07:54:13.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.597+0000 7f0d45ffb700 1 -- 172.21.15.26:0/636192624 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f0d5001c460 con 0x7f0d5406e570 2023-10-01T07:54:13.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.605+0000 7f0d45ffb700 1 -- 172.21.15.26:0/636192624 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f0d50011e20 con 0x7f0d5406e570 2023-10-01T07:54:13.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.605+0000 7f0d58f06700 1 -- 172.21.15.26:0/636192624 >> v1:172.21.15.26:6816/118178 conn(0x7f0d3802c1e0 legacy=0x7f0d3802e690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/118178 2023-10-01T07:54:13.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.605+0000 7f0d45ffb700 1 -- 172.21.15.26:0/636192624 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f0d500106b0 con 0x7f0d5406e570 2023-10-01T07:54:13.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.615+0000 7fa06affd700 1 -- 172.21.15.26:0/2185015196 >> v1:172.21.15.26:6816/118178 conn(0x7fa05802c1b0 legacy=0x7fa05802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/118178 2023-10-01T07:54:13.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.625+0000 7fa07190c700 1 -- 172.21.15.26:0/2185015196 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa06c06c360 con 0x7fa06c135e50 2023-10-01T07:54:13.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.626+0000 7fa053fff700 1 -- 172.21.15.26:0/2185015196 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa064018020 con 0x7fa06c135e50 2023-10-01T07:54:13.626 INFO:teuthology.orchestra.run.smithi026.stdout:38654705693 2023-10-01T07:54:13.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.627+0000 7fe75763a700 1 Processor -- start 2023-10-01T07:54:13.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.628+0000 7fe75763a700 1 -- start start 2023-10-01T07:54:13.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.628+0000 7fe75763a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe7501338c0 0x7fe750133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:13.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.629+0000 7fa07190c700 1 -- 172.21.15.26:0/2185015196 >> v1:172.21.15.26:6816/118178 conn(0x7fa05802c1b0 legacy=0x7fa05802e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:13.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.629+0000 7fa07190c700 1 -- 172.21.15.26:0/2185015196 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa06c135e50 msgr2=0x7fa06c11ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:13.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.629+0000 7fa07190c700 1 --2- 172.21.15.26:0/2185015196 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa06c135e50 0x7fa06c11ffe0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa06400ef90 tx=0x7fa06400c3a0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.628+0000 7fe75763a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe75009e560 0x7fe75013b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:13.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.629+0000 7fe75763a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe75006f720 con 0x7fe7501341d0 2023-10-01T07:54:13.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.629+0000 7fe75763a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe750070c80 con 0x7fe7501338c0 2023-10-01T07:54:13.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.629+0000 7fe75763a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe75006fce0 con 0x7fe75009e560 2023-10-01T07:54:13.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.629+0000 7fe755bd7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe75009e560 0x7fe75013b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:13.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.629+0000 7fe7553d6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe7501338c0 0x7fe750133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:13.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.629+0000 7fe755bd7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe75009e560 0x7fe75013b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:60182/0 (socket says 172.21.15.26:60182) 2023-10-01T07:54:13.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.629+0000 7fe755bd7700 1 -- 172.21.15.26:0/3728381468 learned_addr learned my addr 172.21.15.26:0/3728381468 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:13.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.629+0000 7fe755bd7700 1 -- 172.21.15.26:0/3728381468 >> v2:172.21.15.26:3300/0 conn(0x7fe7501338c0 msgr2=0x7fe750133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:13.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.629+0000 7fe755bd7700 1 --2- 172.21.15.26:0/3728381468 >> v2:172.21.15.26:3300/0 conn(0x7fe7501338c0 0x7fe750133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.629+0000 7fe755bd7700 1 -- 172.21.15.26:0/3728381468 >> v1:172.21.15.26:6789/0 conn(0x7fe7501341d0 legacy=0x7fe75009de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:13.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.629+0000 7fe755bd7700 1 -- 172.21.15.26:0/3728381468 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7501336a0 con 0x7fe75009e560 2023-10-01T07:54:13.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.629+0000 7fe7553d6700 1 --2- 172.21.15.26:0/3728381468 >> v2:172.21.15.26:3300/0 conn(0x7fe7501338c0 0x7fe750133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:13.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.629+0000 7fe755bd7700 1 --2- 172.21.15.26:0/3728381468 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe75009e560 0x7fe75013b860 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe748009e50 tx=0x7fe74800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f12dbd729f2e241f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:13.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.630+0000 7fa07190c700 1 -- 172.21.15.26:0/2185015196 shutdown_connections 2023-10-01T07:54:13.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.630+0000 7fa07190c700 1 --2- 172.21.15.26:0/2185015196 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa06c135e50 0x7fa06c11ffe0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.630+0000 7fa07190c700 1 --2- 172.21.15.26:0/2185015196 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa06c09d6f0 0x7fa06c11f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.630+0000 7fa07190c700 1 --2- 172.21.15.26:0/2185015196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa06c09e1d0 0x7fa06c11faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.630+0000 7fa07190c700 1 -- 172.21.15.26:0/2185015196 >> 172.21.15.26:0/2185015196 conn(0x7fa06c066f50 msgr2=0x7fa06c132680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:13.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.630+0000 7fa07190c700 1 -- 172.21.15.26:0/2185015196 shutdown_connections 2023-10-01T07:54:13.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.630+0000 7fe747fff700 1 -- 172.21.15.26:0/3728381468 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74800e070 con 0x7fe75009e560 2023-10-01T07:54:13.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.630+0000 7fe747fff700 1 -- 172.21.15.26:0/3728381468 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe748003a20 con 0x7fe75009e560 2023-10-01T07:54:13.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.630+0000 7fe747fff700 1 -- 172.21.15.26:0/3728381468 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe748003dd0 con 0x7fe75009e560 2023-10-01T07:54:13.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.630+0000 7fa07190c700 1 -- 172.21.15.26:0/2185015196 wait complete. 2023-10-01T07:54:13.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.631+0000 7fe75763a700 1 -- 172.21.15.26:0/3728381468 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe75009e560 msgr2=0x7fe75013b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:13.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.631+0000 7fe75763a700 1 --2- 172.21.15.26:0/3728381468 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe75009e560 0x7fe75013b860 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe748009e50 tx=0x7fe74800b330 comp rx=0 tx=0).stop 2023-10-01T07:54:13.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.631+0000 7fe75763a700 1 -- 172.21.15.26:0/3728381468 shutdown_connections 2023-10-01T07:54:13.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.631+0000 7fe75763a700 1 --2- 172.21.15.26:0/3728381468 >> v2:172.21.15.26:3300/0 conn(0x7fe7501338c0 0x7fe750133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.631+0000 7fe75763a700 1 --2- 172.21.15.26:0/3728381468 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe75009e560 0x7fe75013b860 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.631+0000 7fe75763a700 1 -- 172.21.15.26:0/3728381468 >> 172.21.15.26:0/3728381468 conn(0x7fe7500a2aa0 msgr2=0x7fe7500a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:13.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.631+0000 7fe75763a700 1 -- 172.21.15.26:0/3728381468 shutdown_connections 2023-10-01T07:54:13.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.632+0000 7fe75763a700 1 -- 172.21.15.26:0/3728381468 wait complete. 2023-10-01T07:54:13.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.633+0000 7fe75763a700 1 Processor -- start 2023-10-01T07:54:13.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.633+0000 7fe75763a700 1 -- start start 2023-10-01T07:54:13.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.634+0000 7fe75763a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe75009e560 0x7fe75011c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:13.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.634+0000 7fe75763a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe7501338c0 0x7fe75011ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:13.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.634+0000 7fe75763a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe7501341d0 0x7fe75011d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:13.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.634+0000 7fe75763a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75012dd10 con 0x7fe75009e560 2023-10-01T07:54:13.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.634+0000 7fe75763a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7500a1280 con 0x7fe7501338c0 2023-10-01T07:54:13.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.634+0000 7fe75763a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe75006f960 con 0x7fe7501341d0 2023-10-01T07:54:13.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.634+0000 7fe7553d6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe75009e560 0x7fe75011c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:13.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.634+0000 7fe7553d6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe75009e560 0x7fe75011c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37788/0 (socket says 172.21.15.26:37788) 2023-10-01T07:54:13.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.634+0000 7fe7553d6700 1 -- 172.21.15.26:0/2897574763 learned_addr learned my addr 172.21.15.26:0/2897574763 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:13.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.634+0000 7fe754bd5700 1 --2- 172.21.15.26:0/2897574763 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe7501338c0 0x7fe75011ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:13.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.634+0000 7fe755bd7700 1 --2- 172.21.15.26:0/2897574763 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe7501341d0 0x7fe75011d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:13.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.635+0000 7fe7553d6700 1 -- 172.21.15.26:0/2897574763 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe7501341d0 msgr2=0x7fe75011d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:13.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.635+0000 7fe7553d6700 1 --2- 172.21.15.26:0/2897574763 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe7501341d0 0x7fe75011d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.635+0000 7fe7553d6700 1 -- 172.21.15.26:0/2897574763 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe7501338c0 msgr2=0x7fe75011ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:13.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.635+0000 7fe7553d6700 1 --2- 172.21.15.26:0/2897574763 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe7501338c0 0x7fe75011ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.635+0000 7fe7553d6700 1 -- 172.21.15.26:0/2897574763 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74c0094a0 con 0x7fe75009e560 2023-10-01T07:54:13.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.635+0000 7fe7553d6700 1 --2- 172.21.15.26:0/2897574763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe75009e560 0x7fe75011c940 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe74c00ebe0 tx=0x7fe74c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:13.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.635+0000 7fe745ffb700 1 -- 172.21.15.26:0/2897574763 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c009800 con 0x7fe75009e560 2023-10-01T07:54:13.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.636+0000 7fe745ffb700 1 -- 172.21.15.26:0/2897574763 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74c00c910 con 0x7fe75009e560 2023-10-01T07:54:13.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.636+0000 7fe75763a700 1 -- 172.21.15.26:0/2897574763 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe748009b30 con 0x7fe75009e560 2023-10-01T07:54:13.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.636+0000 7fe75763a700 1 -- 172.21.15.26:0/2897574763 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe750120180 con 0x7fe75009e560 2023-10-01T07:54:13.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.636+0000 7fe745ffb700 1 -- 172.21.15.26:0/2897574763 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c00cc80 con 0x7fe75009e560 2023-10-01T07:54:13.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.637+0000 7fe75763a700 1 -- 172.21.15.26:0/2897574763 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7300052e0 con 0x7fe75009e560 2023-10-01T07:54:13.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.638+0000 7fe745ffb700 1 -- 172.21.15.26:0/2897574763 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fe74c013470 con 0x7fe75009e560 2023-10-01T07:54:13.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.638+0000 7fe745ffb700 1 -- 172.21.15.26:0/2897574763 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3922+0+0 (secure 0 0 0) 0x7fe74c03b960 con 0x7fe75009e560 2023-10-01T07:54:13.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.638+0000 7fe754bd5700 1 -- 172.21.15.26:0/2897574763 >> v1:172.21.15.26:6816/118178 conn(0x7fe73402c200 legacy=0x7fe73402e6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/118178 2023-10-01T07:54:13.648 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705693 for osd.0 2023-10-01T07:54:13.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.647+0000 7fe745ffb700 1 -- 172.21.15.26:0/2897574763 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fe74c013720 con 0x7fe75009e560 2023-10-01T07:54:13.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.680+0000 7fe32f2c6700 1 Processor -- start 2023-10-01T07:54:13.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.680+0000 7fe32f2c6700 1 -- start start 2023-10-01T07:54:13.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.681+0000 7fe32f2c6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe32809d6f0 0x7fe32809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:13.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.681+0000 7fe32f2c6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe32809e410 0x7fe328130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:13.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.681+0000 7fe32f2c6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe32809f130 con 0x7fe32809e000 2023-10-01T07:54:13.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.681+0000 7fe32f2c6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe32809f520 con 0x7fe32809e410 2023-10-01T07:54:13.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.681+0000 7fe32f2c6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32809e930 con 0x7fe32809d6f0 2023-10-01T07:54:13.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.681+0000 7fe32d062700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe32809d6f0 0x7fe32809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:13.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.681+0000 7fe32d062700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe32809d6f0 0x7fe32809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:60202/0 (socket says 172.21.15.26:60202) 2023-10-01T07:54:13.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.681+0000 7fe32d062700 1 -- 172.21.15.26:0/1488028286 learned_addr learned my addr 172.21.15.26:0/1488028286 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:13.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.681+0000 7fe32d863700 1 --2- 172.21.15.26:0/1488028286 >> v2:172.21.15.26:3300/0 conn(0x7fe32809e410 0x7fe328130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:13.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.682+0000 7fe32d863700 1 -- 172.21.15.26:0/1488028286 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe32809d6f0 msgr2=0x7fe32809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:13.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.682+0000 7fe32d863700 1 --2- 172.21.15.26:0/1488028286 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe32809d6f0 0x7fe32809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.682+0000 7fe32d863700 1 -- 172.21.15.26:0/1488028286 >> v1:172.21.15.26:6789/0 conn(0x7fe32809e000 legacy=0x7fe328130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:13.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.682+0000 7fe32d863700 1 -- 172.21.15.26:0/1488028286 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe32809b2d0 con 0x7fe32809e410 2023-10-01T07:54:13.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.682+0000 7fe32d062700 1 --2- 172.21.15.26:0/1488028286 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe32809d6f0 0x7fe32809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:13.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.682+0000 7fe32d863700 1 --2- 172.21.15.26:0/1488028286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe32809e410 0x7fe328130d70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe320009d90 tx=0x7fe32000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbaa7991bb804c04 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:13.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.682+0000 7fe31ffff700 1 -- 172.21.15.26:0/1488028286 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32000bd20 con 0x7fe32809e410 2023-10-01T07:54:13.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.682+0000 7fe31ffff700 1 -- 172.21.15.26:0/1488028286 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32000be80 con 0x7fe32809e410 2023-10-01T07:54:13.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.682+0000 7fe31ffff700 1 -- 172.21.15.26:0/1488028286 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3200116a0 con 0x7fe32809e410 2023-10-01T07:54:13.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.683+0000 7fe32f2c6700 1 -- 172.21.15.26:0/1488028286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe32809e410 msgr2=0x7fe328130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:13.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.683+0000 7fe32f2c6700 1 --2- 172.21.15.26:0/1488028286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe32809e410 0x7fe328130d70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe320009d90 tx=0x7fe32000b330 comp rx=0 tx=0).stop 2023-10-01T07:54:13.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.683+0000 7fe32f2c6700 1 -- 172.21.15.26:0/1488028286 shutdown_connections 2023-10-01T07:54:13.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.683+0000 7fe32f2c6700 1 --2- 172.21.15.26:0/1488028286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe32809e410 0x7fe328130d70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.683+0000 7fe32f2c6700 1 --2- 172.21.15.26:0/1488028286 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe32809d6f0 0x7fe32809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.683+0000 7fe32f2c6700 1 -- 172.21.15.26:0/1488028286 >> 172.21.15.26:0/1488028286 conn(0x7fe328066f50 msgr2=0x7fe32809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:13.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.684+0000 7fe32f2c6700 1 -- 172.21.15.26:0/1488028286 shutdown_connections 2023-10-01T07:54:13.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.684+0000 7fe32f2c6700 1 -- 172.21.15.26:0/1488028286 wait complete. 2023-10-01T07:54:13.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.685+0000 7fe32f2c6700 1 Processor -- start 2023-10-01T07:54:13.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.685+0000 7fe32f2c6700 1 -- start start 2023-10-01T07:54:13.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.686+0000 7fe32f2c6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe32809d6f0 0x7fe328122970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:13.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.686+0000 7fe32f2c6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe32809e000 0x7fe328122eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:13.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.686+0000 7fe32f2c6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe32809e410 0x7fe3281233f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:13.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.686+0000 7fe32f2c6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe328123e20 con 0x7fe32809e000 2023-10-01T07:54:13.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.686+0000 7fe32f2c6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe328124600 con 0x7fe32809d6f0 2023-10-01T07:54:13.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.686+0000 7fe32f2c6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3281303d0 con 0x7fe32809e410 2023-10-01T07:54:13.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.686+0000 7fe32d062700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe32809d6f0 0x7fe328122970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:13.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.686+0000 7fe32d062700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe32809d6f0 0x7fe328122970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:60204/0 (socket says 172.21.15.26:60204) 2023-10-01T07:54:13.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.686+0000 7fe32d062700 1 -- 172.21.15.26:0/2553606728 learned_addr learned my addr 172.21.15.26:0/2553606728 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:13.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.686+0000 7fe32c861700 1 --2- 172.21.15.26:0/2553606728 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe32809e000 0x7fe328122eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:13.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.686+0000 7fe32d863700 1 --2- 172.21.15.26:0/2553606728 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe32809e410 0x7fe3281233f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:13.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.687+0000 7fe32d062700 1 -- 172.21.15.26:0/2553606728 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe32809e410 msgr2=0x7fe3281233f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:13.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.687+0000 7fe32d062700 1 --2- 172.21.15.26:0/2553606728 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe32809e410 0x7fe3281233f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.687+0000 7fe32d062700 1 -- 172.21.15.26:0/2553606728 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe32809e000 msgr2=0x7fe328122eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:13.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.687+0000 7fe32d062700 1 --2- 172.21.15.26:0/2553606728 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe32809e000 0x7fe328122eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.687+0000 7fe32d062700 1 -- 172.21.15.26:0/2553606728 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe324009550 con 0x7fe32809d6f0 2023-10-01T07:54:13.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.687+0000 7fe32d062700 1 --2- 172.21.15.26:0/2553606728 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe32809d6f0 0x7fe328122970 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe32400ebe0 tx=0x7fe32400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:13.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.687+0000 7fe31dffb700 1 -- 172.21.15.26:0/2553606728 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32400c850 con 0x7fe32809d6f0 2023-10-01T07:54:13.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.687+0000 7fe31dffb700 1 -- 172.21.15.26:0/2553606728 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32400c9b0 con 0x7fe32809d6f0 2023-10-01T07:54:13.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.687+0000 7fe32f2c6700 1 -- 172.21.15.26:0/2553606728 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe320009a70 con 0x7fe32809d6f0 2023-10-01T07:54:13.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.687+0000 7fe31dffb700 1 -- 172.21.15.26:0/2553606728 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32400cd40 con 0x7fe32809d6f0 2023-10-01T07:54:13.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.687+0000 7fe32f2c6700 1 -- 172.21.15.26:0/2553606728 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe328126120 con 0x7fe32809d6f0 2023-10-01T07:54:13.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.689+0000 7fe32f2c6700 1 -- 172.21.15.26:0/2553606728 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe328074ea0 con 0x7fe32809d6f0 2023-10-01T07:54:13.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.689+0000 7fe31dffb700 1 -- 172.21.15.26:0/2553606728 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fe324013470 con 0x7fe32809d6f0 2023-10-01T07:54:13.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.690+0000 7fe31dffb700 1 -- 172.21.15.26:0/2553606728 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3922+0+0 (secure 0 0 0) 0x7fe32403c270 con 0x7fe32809d6f0 2023-10-01T07:54:13.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.690+0000 7fe32c861700 1 -- 172.21.15.26:0/2553606728 >> v1:172.21.15.26:6816/118178 conn(0x7fe30c02c1b0 legacy=0x7fe30c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/118178 2023-10-01T07:54:13.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.694+0000 7fe31dffb700 1 -- 172.21.15.26:0/2553606728 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fe324024760 con 0x7fe32809d6f0 2023-10-01T07:54:13.712 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:13.711+0000 7f6cc52b3240 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-01T07:54:13.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.806+0000 7f0d58f06700 1 -- 172.21.15.26:0/636192624 >> v1:172.21.15.26:6816/118178 conn(0x7f0d3802c1e0 legacy=0x7f0d3802e690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/118178 2023-10-01T07:54:13.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.815+0000 7f0d5b96b700 1 -- 172.21.15.26:0/636192624 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0d5413eb90 con 0x7f0d5406e570 2023-10-01T07:54:13.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.815+0000 7f0d45ffb700 1 -- 172.21.15.26:0/636192624 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0d5001a360 con 0x7f0d5406e570 2023-10-01T07:54:13.816 INFO:teuthology.orchestra.run.smithi026.stdout:38654705693 2023-10-01T07:54:13.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.817+0000 7f0d5b96b700 1 -- 172.21.15.26:0/636192624 >> v1:172.21.15.26:6816/118178 conn(0x7f0d3802c1e0 legacy=0x7f0d3802e690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:13.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.817+0000 7f0d5b96b700 1 -- 172.21.15.26:0/636192624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d5406e570 msgr2=0x7f0d5413cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:13.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.817+0000 7f0d5b96b700 1 --2- 172.21.15.26:0/636192624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d5406e570 0x7f0d5413cfd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0d5000c4a0 tx=0x7f0d5000c7b0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.817+0000 7f0d5b96b700 1 -- 172.21.15.26:0/636192624 shutdown_connections 2023-10-01T07:54:13.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.817+0000 7f0d5b96b700 1 --2- 172.21.15.26:0/636192624 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d5413da50 0x7f0d5412adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.817+0000 7f0d5b96b700 1 --2- 172.21.15.26:0/636192624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d5406e570 0x7f0d5413cfd0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.817+0000 7f0d5b96b700 1 --2- 172.21.15.26:0/636192624 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d5406f050 0x7f0d5413d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.817+0000 7f0d5b96b700 1 -- 172.21.15.26:0/636192624 >> 172.21.15.26:0/636192624 conn(0x7f0d540a2aa0 msgr2=0x7f0d5409cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:13.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.818+0000 7f0d5b96b700 1 -- 172.21.15.26:0/636192624 shutdown_connections 2023-10-01T07:54:13.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.818+0000 7f0d5b96b700 1 -- 172.21.15.26:0/636192624 wait complete. 2023-10-01T07:54:13.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.3 2023-10-01T07:54:13.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.839+0000 7fe754bd5700 1 -- 172.21.15.26:0/2897574763 >> v1:172.21.15.26:6816/118178 conn(0x7fe73402c200 legacy=0x7fe73402e6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/118178 2023-10-01T07:54:13.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.844+0000 7fe75763a700 1 -- 172.21.15.26:0/2897574763 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe730005590 con 0x7fe75009e560 2023-10-01T07:54:13.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.845+0000 7fe745ffb700 1 -- 172.21.15.26:0/2897574763 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe74c021020 con 0x7fe75009e560 2023-10-01T07:54:13.845 INFO:teuthology.orchestra.run.smithi026.stdout:38654705693 2023-10-01T07:54:13.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.847+0000 7fe75763a700 1 -- 172.21.15.26:0/2897574763 >> v1:172.21.15.26:6816/118178 conn(0x7fe73402c200 legacy=0x7fe73402e6b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:13.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.847+0000 7fe75763a700 1 -- 172.21.15.26:0/2897574763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe75009e560 msgr2=0x7fe75011c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:13.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.847+0000 7fe75763a700 1 --2- 172.21.15.26:0/2897574763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe75009e560 0x7fe75011c940 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe74c00ebe0 tx=0x7fe74c00eef0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.847+0000 7fe75763a700 1 -- 172.21.15.26:0/2897574763 shutdown_connections 2023-10-01T07:54:13.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.847+0000 7fe75763a700 1 --2- 172.21.15.26:0/2897574763 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe7501341d0 0x7fe75011d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.847+0000 7fe75763a700 1 --2- 172.21.15.26:0/2897574763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe75009e560 0x7fe75011c940 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.847+0000 7fe75763a700 1 --2- 172.21.15.26:0/2897574763 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe7501338c0 0x7fe75011ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.847+0000 7fe75763a700 1 -- 172.21.15.26:0/2897574763 >> 172.21.15.26:0/2897574763 conn(0x7fe7500a2aa0 msgr2=0x7fe75009f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:13.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.847+0000 7fe75763a700 1 -- 172.21.15.26:0/2897574763 shutdown_connections 2023-10-01T07:54:13.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.847+0000 7fe75763a700 1 -- 172.21.15.26:0/2897574763 wait complete. 2023-10-01T07:54:13.861 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705693 for osd.2 2023-10-01T07:54:13.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.891+0000 7fe32c861700 1 -- 172.21.15.26:0/2553606728 >> v1:172.21.15.26:6816/118178 conn(0x7fe30c02c1b0 legacy=0x7fe30c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/118178 2023-10-01T07:54:13.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.901+0000 7fe32f2c6700 1 -- 172.21.15.26:0/2553606728 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe32806c360 con 0x7fe32809d6f0 2023-10-01T07:54:13.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.901+0000 7fe31dffb700 1 -- 172.21.15.26:0/2553606728 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe324017070 con 0x7fe32809d6f0 2023-10-01T07:54:13.902 INFO:teuthology.orchestra.run.smithi026.stdout:38654705693 2023-10-01T07:54:13.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.903+0000 7fe32f2c6700 1 -- 172.21.15.26:0/2553606728 >> v1:172.21.15.26:6816/118178 conn(0x7fe30c02c1b0 legacy=0x7fe30c02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:13.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.903+0000 7fe32f2c6700 1 -- 172.21.15.26:0/2553606728 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe32809d6f0 msgr2=0x7fe328122970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:13.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.903+0000 7fe32f2c6700 1 --2- 172.21.15.26:0/2553606728 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe32809d6f0 0x7fe328122970 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe32400ebe0 tx=0x7fe32400eef0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.903+0000 7fe32f2c6700 1 -- 172.21.15.26:0/2553606728 shutdown_connections 2023-10-01T07:54:13.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.903+0000 7fe32f2c6700 1 --2- 172.21.15.26:0/2553606728 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe32809e410 0x7fe3281233f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.903+0000 7fe32f2c6700 1 --2- 172.21.15.26:0/2553606728 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe32809d6f0 0x7fe328122970 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.903+0000 7fe32f2c6700 1 --2- 172.21.15.26:0/2553606728 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe32809e000 0x7fe328122eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:13.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.903+0000 7fe32f2c6700 1 -- 172.21.15.26:0/2553606728 >> 172.21.15.26:0/2553606728 conn(0x7fe328066f50 msgr2=0x7fe32806f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:13.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.903+0000 7fe32f2c6700 1 -- 172.21.15.26:0/2553606728 shutdown_connections 2023-10-01T07:54:13.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:13.903+0000 7fe32f2c6700 1 -- 172.21.15.26:0/2553606728 wait complete. 2023-10-01T07:54:13.917 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705693 for osd.1 2023-10-01T07:54:14.358 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:14.358+0000 7f6cc52b3240 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-01T07:54:14.493 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:14.493+0000 7f6cc52b3240 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-01T07:54:14.649 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:54:14.668 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:14.668+0000 7f6cc52b3240 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-01T07:54:14.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.786+0000 7fc13b638700 1 Processor -- start 2023-10-01T07:54:14.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.787+0000 7fc13b638700 1 -- start start 2023-10-01T07:54:14.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.787+0000 7fc13b638700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc13409d6f0 0x7fc13409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:14.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.788+0000 7fc13b638700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc13409e000 0x7fc134130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:14.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.788+0000 7fc13b638700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc13409f130 con 0x7fc13409e410 2023-10-01T07:54:14.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.788+0000 7fc13b638700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc13409f520 con 0x7fc13409d6f0 2023-10-01T07:54:14.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.788+0000 7fc13b638700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc13409e930 con 0x7fc13409e000 2023-10-01T07:54:14.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.788+0000 7fc139bd5700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc13409e410 0x7fc134130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48580/0 (socket says 172.21.15.26:48580) 2023-10-01T07:54:14.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.788+0000 7fc138bd3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc13409e000 0x7fc134130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:14.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.788+0000 7fc139bd5700 1 -- 172.21.15.26:0/3208993004 learned_addr learned my addr 172.21.15.26:0/3208993004 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:14.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.788+0000 7fc1393d4700 1 --2- 172.21.15.26:0/3208993004 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc13409d6f0 0x7fc13409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:14.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.788+0000 7fc138bd3700 1 -- 172.21.15.26:0/3208993004 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc13409d6f0 msgr2=0x7fc13409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:14.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.788+0000 7fc133fff700 1 -- 172.21.15.26:0/3208993004 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3904431494 0 0) 0x7fc13409f130 con 0x7fc13409e410 2023-10-01T07:54:14.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.788+0000 7fc138bd3700 1 --2- 172.21.15.26:0/3208993004 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc13409d6f0 0x7fc13409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:14.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.788+0000 7fc138bd3700 1 -- 172.21.15.26:0/3208993004 >> v1:172.21.15.26:6789/0 conn(0x7fc13409e410 legacy=0x7fc134130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:14.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.788+0000 7fc138bd3700 1 -- 172.21.15.26:0/3208993004 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc13409b2d0 con 0x7fc13409e000 2023-10-01T07:54:14.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.788+0000 7fc1393d4700 1 --2- 172.21.15.26:0/3208993004 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc13409d6f0 0x7fc13409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:14.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.788+0000 7fc138bd3700 1 --2- 172.21.15.26:0/3208993004 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc13409e000 0x7fc134130660 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc1280098a0 tx=0x7fc128009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b343a8c570ee9ea9 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:14.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.788+0000 7fc133fff700 1 -- 172.21.15.26:0/3208993004 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc128011830 con 0x7fc13409e000 2023-10-01T07:54:14.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.789+0000 7fc133fff700 1 -- 172.21.15.26:0/3208993004 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc128011990 con 0x7fc13409e000 2023-10-01T07:54:14.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.789+0000 7fc133fff700 1 -- 172.21.15.26:0/3208993004 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc128011d20 con 0x7fc13409e000 2023-10-01T07:54:14.792 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:14.789+0000 7f6cc52b3240 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-01T07:54:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.789+0000 7fc13b638700 1 -- 172.21.15.26:0/3208993004 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc13409e000 msgr2=0x7fc134130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.789+0000 7fc13b638700 1 --2- 172.21.15.26:0/3208993004 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc13409e000 0x7fc134130660 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc1280098a0 tx=0x7fc128009bb0 comp rx=0 tx=0).stop 2023-10-01T07:54:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.789+0000 7fc13b638700 1 -- 172.21.15.26:0/3208993004 shutdown_connections 2023-10-01T07:54:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.789+0000 7fc13b638700 1 --2- 172.21.15.26:0/3208993004 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc13409d6f0 0x7fc13409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.789+0000 7fc13b638700 1 --2- 172.21.15.26:0/3208993004 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc13409e000 0x7fc134130660 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.789+0000 7fc13b638700 1 -- 172.21.15.26:0/3208993004 >> 172.21.15.26:0/3208993004 conn(0x7fc134066f50 msgr2=0x7fc13409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.789+0000 7fc13b638700 1 -- 172.21.15.26:0/3208993004 shutdown_connections 2023-10-01T07:54:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.789+0000 7fc13b638700 1 -- 172.21.15.26:0/3208993004 wait complete. 2023-10-01T07:54:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.790+0000 7fc13b638700 1 Processor -- start 2023-10-01T07:54:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.790+0000 7fc13b638700 1 -- start start 2023-10-01T07:54:14.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.791+0000 7fc13b638700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc13409d6f0 0x7fc134120050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:14.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.791+0000 7fc13b638700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc13409e000 0x7fc134120590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:14.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.791+0000 7fc13b638700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc13409e410 0x7fc134120ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:14.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.791+0000 7fc13b638700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc134123ad0 con 0x7fc13409e410 2023-10-01T07:54:14.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.791+0000 7fc13b638700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1341235c0 con 0x7fc13409e000 2023-10-01T07:54:14.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.791+0000 7fc13b638700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1340a1b80 con 0x7fc13409d6f0 2023-10-01T07:54:14.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.791+0000 7fc138bd3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc13409e000 0x7fc134120590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:14.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.791+0000 7fc139bd5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc13409e410 0x7fc134120ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:14.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.791+0000 7fc1393d4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc13409d6f0 0x7fc134120050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:14.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.791+0000 7fc1393d4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc13409d6f0 0x7fc134120050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55406/0 (socket says 172.21.15.26:55406) 2023-10-01T07:54:14.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.791+0000 7fc138bd3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc13409e000 0x7fc134120590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:60228/0 (socket says 172.21.15.26:60228) 2023-10-01T07:54:14.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.791+0000 7fc139bd5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc13409e410 0x7fc134120ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37808/0 (socket says 172.21.15.26:37808) 2023-10-01T07:54:14.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.791+0000 7fc1393d4700 1 -- 172.21.15.26:0/3525660673 learned_addr learned my addr 172.21.15.26:0/3525660673 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:14.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.791+0000 7fc1393d4700 1 -- 172.21.15.26:0/3525660673 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc13409e000 msgr2=0x7fc134120590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:14.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.791+0000 7fc1393d4700 1 --2- 172.21.15.26:0/3525660673 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc13409e000 0x7fc134120590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:14.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.791+0000 7fc1393d4700 1 -- 172.21.15.26:0/3525660673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc13409e410 msgr2=0x7fc134120ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:14.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.791+0000 7fc1393d4700 1 --2- 172.21.15.26:0/3525660673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc13409e410 0x7fc134120ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:14.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.791+0000 7fc1393d4700 1 -- 172.21.15.26:0/3525660673 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc124009a70 con 0x7fc13409d6f0 2023-10-01T07:54:14.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.791+0000 7fc139bd5700 1 --2- 172.21.15.26:0/3525660673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc13409e410 0x7fc134120ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:14.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.791+0000 7fc1393d4700 1 --2- 172.21.15.26:0/3525660673 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc13409d6f0 0x7fc134120050 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc12400efc0 tx=0x7fc12400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:14.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.792+0000 7fc131ffb700 1 -- 172.21.15.26:0/3525660673 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12400cdd0 con 0x7fc13409d6f0 2023-10-01T07:54:14.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.792+0000 7fc131ffb700 1 -- 172.21.15.26:0/3525660673 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc12400f040 con 0x7fc13409d6f0 2023-10-01T07:54:14.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.792+0000 7fc13b638700 1 -- 172.21.15.26:0/3525660673 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1280094a0 con 0x7fc13409d6f0 2023-10-01T07:54:14.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.792+0000 7fc131ffb700 1 -- 172.21.15.26:0/3525660673 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1240146a0 con 0x7fc13409d6f0 2023-10-01T07:54:14.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.792+0000 7fc13b638700 1 -- 172.21.15.26:0/3525660673 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc13409c700 con 0x7fc13409d6f0 2023-10-01T07:54:14.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.792+0000 7fc131ffb700 1 -- 172.21.15.26:0/3525660673 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fc124014800 con 0x7fc13409d6f0 2023-10-01T07:54:14.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.793+0000 7fc131ffb700 1 -- 172.21.15.26:0/3525660673 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3922+0+0 (secure 0 0 0) 0x7fc12403c510 con 0x7fc13409d6f0 2023-10-01T07:54:14.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.793+0000 7fc138bd3700 1 -- 172.21.15.26:0/3525660673 >> v1:172.21.15.26:6816/118178 conn(0x7fc12002c1b0 legacy=0x7fc12002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/118178 2023-10-01T07:54:14.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.793+0000 7fc13b638700 1 -- 172.21.15.26:0/3525660673 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc134122ea0 con 0x7fc13409d6f0 2023-10-01T07:54:14.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.798+0000 7fc131ffb700 1 -- 172.21.15.26:0/3525660673 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fc12401d400 con 0x7fc13409d6f0 2023-10-01T07:54:14.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.807+0000 7fc131ffb700 1 -- 172.21.15.26:0/3525660673 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7fc12401d780 con 0x7fc13409d6f0 2023-10-01T07:54:14.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.808+0000 7fc131ffb700 1 -- 172.21.15.26:0/3525660673 >> v1:172.21.15.26:6816/118178 conn(0x7fc12002c1b0 legacy=0x7fc12002e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:14.837 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:54:14.862 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:54:14.885 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:14.884+0000 7f6c4410c700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-01T07:54:14.885 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:14.884+0000 7f6c4410c700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-01T07:54:14.885 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:14.884+0000 7f6c4410c700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-01T07:54:14.885 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:14.884+0000 7f6c4410c700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-01T07:54:14.885 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:14.884+0000 7f6c4410c700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-01T07:54:14.886 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:14.885+0000 7f6c40104700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-01T07:54:14.886 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:14.885+0000 7f6c40104700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-01T07:54:14.886 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:14.885+0000 7f6c40104700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-01T07:54:14.886 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:14.885+0000 7f6c40104700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-01T07:54:14.886 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:14.885+0000 7f6c40104700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-01T07:54:14.918 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:54:14.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.992+0000 7f7d76bb1700 1 Processor -- start 2023-10-01T07:54:14.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.992+0000 7f7d76bb1700 1 -- start start 2023-10-01T07:54:14.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.993+0000 7f7d76bb1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7d700954c0 0x7f7d70095890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:14.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.993+0000 7f7d76bb1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7d7009a1c0 0x7f7d701385a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:14.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.993+0000 7f7d76bb1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d7009c280 con 0x7f7d70099680 2023-10-01T07:54:14.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.993+0000 7f7d76bb1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d7009aaf0 con 0x7f7d7009a1c0 2023-10-01T07:54:14.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.993+0000 7f7d76bb1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7009b960 con 0x7f7d700954c0 2023-10-01T07:54:14.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.993+0000 7f7d6ffff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7d70099680 0x7f7d70099ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48588/0 (socket says 172.21.15.26:48588) 2023-10-01T07:54:14.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.993+0000 7f7d6ffff700 1 -- 172.21.15.26:0/3211332370 learned_addr learned my addr 172.21.15.26:0/3211332370 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:14.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.993+0000 7f7d7514e700 1 --2- 172.21.15.26:0/3211332370 >> v2:172.21.15.26:3300/0 conn(0x7f7d7009a1c0 0x7f7d701385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:14.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.993+0000 7f7d7494d700 1 --2- 172.21.15.26:0/3211332370 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7d700954c0 0x7f7d70095890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:14.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.994+0000 7f7d6f7fe700 1 -- 172.21.15.26:0/3211332370 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2851762973 0 0) 0x7f7d7009c280 con 0x7f7d70099680 2023-10-01T07:54:14.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.994+0000 7f7d6f7fe700 1 -- 172.21.15.26:0/3211332370 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d600079c0 con 0x7f7d70099680 2023-10-01T07:54:14.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.994+0000 7f7d7514e700 1 -- 172.21.15.26:0/3211332370 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7d700954c0 msgr2=0x7f7d70095890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:14.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.994+0000 7f7d7514e700 1 --2- 172.21.15.26:0/3211332370 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7d700954c0 0x7f7d70095890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:14.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.994+0000 7f7d7514e700 1 -- 172.21.15.26:0/3211332370 >> v1:172.21.15.26:6789/0 conn(0x7f7d70099680 legacy=0x7f7d70099ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:14.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.994+0000 7f7d7514e700 1 -- 172.21.15.26:0/3211332370 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7009a7b0 con 0x7f7d7009a1c0 2023-10-01T07:54:14.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.994+0000 7f7d7514e700 1 --2- 172.21.15.26:0/3211332370 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d7009a1c0 0x7f7d701385a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800bfa0 tx=0x7f7d6800d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4d201a23bbd9e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:14.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.994+0000 7f7d6f7fe700 1 -- 172.21.15.26:0/3211332370 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6800d940 con 0x7f7d7009a1c0 2023-10-01T07:54:14.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.994+0000 7f7d6f7fe700 1 -- 172.21.15.26:0/3211332370 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6800daa0 con 0x7f7d7009a1c0 2023-10-01T07:54:14.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.994+0000 7f7d6f7fe700 1 -- 172.21.15.26:0/3211332370 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6800de10 con 0x7f7d7009a1c0 2023-10-01T07:54:14.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.995+0000 7f7d76bb1700 1 -- 172.21.15.26:0/3211332370 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d7009a1c0 msgr2=0x7f7d701385a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:14.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.995+0000 7f7d76bb1700 1 --2- 172.21.15.26:0/3211332370 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d7009a1c0 0x7f7d701385a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800bfa0 tx=0x7f7d6800d330 comp rx=0 tx=0).stop 2023-10-01T07:54:14.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.995+0000 7f7d76bb1700 1 -- 172.21.15.26:0/3211332370 shutdown_connections 2023-10-01T07:54:14.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.995+0000 7f7d76bb1700 1 --2- 172.21.15.26:0/3211332370 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d7009a1c0 0x7f7d701385a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:14.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.995+0000 7f7d76bb1700 1 --2- 172.21.15.26:0/3211332370 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7d700954c0 0x7f7d70095890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:14.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.995+0000 7f7d76bb1700 1 -- 172.21.15.26:0/3211332370 >> 172.21.15.26:0/3211332370 conn(0x7f7d700a2360 msgr2=0x7f7d700a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:14.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.996+0000 7f7d76bb1700 1 -- 172.21.15.26:0/3211332370 shutdown_connections 2023-10-01T07:54:14.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.996+0000 7f7d76bb1700 1 -- 172.21.15.26:0/3211332370 wait complete. 2023-10-01T07:54:15.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.997+0000 7f7d76bb1700 1 Processor -- start 2023-10-01T07:54:15.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.997+0000 7f7d76bb1700 1 -- start start 2023-10-01T07:54:15.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.998+0000 7f7d76bb1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7d700954c0 0x7f7d70071610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:15.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.998+0000 7f7d76bb1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d70099680 0x7f7d70071b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:15.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.998+0000 7f7d76bb1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7d7009a1c0 0x7f7d70072090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:15.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.998+0000 7f7d76bb1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d701281e0 con 0x7f7d70099680 2023-10-01T07:54:15.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.998+0000 7f7d76bb1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d70127810 con 0x7f7d7009a1c0 2023-10-01T07:54:15.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.998+0000 7f7d76bb1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d700a0800 con 0x7f7d700954c0 2023-10-01T07:54:15.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.998+0000 7f7d6ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d70099680 0x7f7d70071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:15.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.998+0000 7f7d6ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d70099680 0x7f7d70071b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37928/0 (socket says 172.21.15.26:37928) 2023-10-01T07:54:15.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.998+0000 7f7d6ffff700 1 -- 172.21.15.26:0/1187851459 learned_addr learned my addr 172.21.15.26:0/1187851459 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:15.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.998+0000 7f7d7494d700 1 --2- 172.21.15.26:0/1187851459 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7d700954c0 0x7f7d70071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:15.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.999+0000 7f7d7514e700 1 --2- 172.21.15.26:0/1187851459 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7d7009a1c0 0x7f7d70072090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:15.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.999+0000 7f7d7494d700 1 -- 172.21.15.26:0/1187851459 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7d7009a1c0 msgr2=0x7f7d70072090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:15.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.999+0000 7f7d7494d700 1 --2- 172.21.15.26:0/1187851459 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7d7009a1c0 0x7f7d70072090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:15.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.999+0000 7f7d7494d700 1 -- 172.21.15.26:0/1187851459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d70099680 msgr2=0x7f7d70071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:15.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.999+0000 7f7d7494d700 1 --2- 172.21.15.26:0/1187851459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d70099680 0x7f7d70071b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:15.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.999+0000 7f7d7494d700 1 -- 172.21.15.26:0/1187851459 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d6800bc80 con 0x7f7d700954c0 2023-10-01T07:54:15.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.999+0000 7f7d7494d700 1 --2- 172.21.15.26:0/1187851459 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7d700954c0 0x7f7d70071610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7d6400e930 tx=0x7f7d6400ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:15.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.999+0000 7f7d6d7fa700 1 -- 172.21.15.26:0/1187851459 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d64013680 con 0x7f7d700954c0 2023-10-01T07:54:15.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.999+0000 7f7d6d7fa700 1 -- 172.21.15.26:0/1187851459 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d640137e0 con 0x7f7d700954c0 2023-10-01T07:54:15.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.999+0000 7f7d76bb1700 1 -- 172.21.15.26:0/1187851459 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d7009b000 con 0x7f7d700954c0 2023-10-01T07:54:15.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.999+0000 7f7d6d7fa700 1 -- 172.21.15.26:0/1187851459 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d64013b50 con 0x7f7d700954c0 2023-10-01T07:54:15.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:14.999+0000 7f7d76bb1700 1 -- 172.21.15.26:0/1187851459 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d70129610 con 0x7f7d700954c0 2023-10-01T07:54:15.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.001+0000 7f7d76bb1700 1 -- 172.21.15.26:0/1187851459 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d700a02c0 con 0x7f7d700954c0 2023-10-01T07:54:15.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.001+0000 7f7d6d7fa700 1 -- 172.21.15.26:0/1187851459 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f7d64013cb0 con 0x7f7d700954c0 2023-10-01T07:54:15.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.004+0000 7f7d6d7fa700 1 -- 172.21.15.26:0/1187851459 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4055+0+0 (secure 0 0 0) 0x7f7d6401be60 con 0x7f7d700954c0 2023-10-01T07:54:15.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.006+0000 7f7d6d7fa700 1 -- 172.21.15.26:0/1187851459 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f7d64044060 con 0x7f7d700954c0 2023-10-01T07:54:15.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.026+0000 7fc13b638700 1 -- 172.21.15.26:0/3525660673 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc134130430 con 0x7fc13409d6f0 2023-10-01T07:54:15.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.026+0000 7fc131ffb700 1 -- 172.21.15.26:0/3525660673 <== mon.2 v2:172.21.15.26:3302/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc12401d400 con 0x7fc13409d6f0 2023-10-01T07:54:15.027 INFO:teuthology.orchestra.run.smithi026.stdout:38654705693 2023-10-01T07:54:15.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.029+0000 7fc13b638700 1 -- 172.21.15.26:0/3525660673 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc13409d6f0 msgr2=0x7fc134120050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:15.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.029+0000 7fc13b638700 1 --2- 172.21.15.26:0/3525660673 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc13409d6f0 0x7fc134120050 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc12400efc0 tx=0x7fc12400c3a0 comp rx=0 tx=0).stop 2023-10-01T07:54:15.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.029+0000 7fd9dd4f6700 1 Processor -- start 2023-10-01T07:54:15.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.029+0000 7fc13b638700 1 -- 172.21.15.26:0/3525660673 shutdown_connections 2023-10-01T07:54:15.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.029+0000 7fc13b638700 1 --2- 172.21.15.26:0/3525660673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc13409e410 0x7fc134120ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:15.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.029+0000 7fc13b638700 1 --2- 172.21.15.26:0/3525660673 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc13409d6f0 0x7fc134120050 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:15.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.029+0000 7fc13b638700 1 --2- 172.21.15.26:0/3525660673 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc13409e000 0x7fc134120590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:15.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.029+0000 7fc13b638700 1 -- 172.21.15.26:0/3525660673 >> 172.21.15.26:0/3525660673 conn(0x7fc134066f50 msgr2=0x7fc1340710a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:15.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.029+0000 7fd9dd4f6700 1 -- start start 2023-10-01T07:54:15.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.030+0000 7fd9dd4f6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9d806b250 0x7fd9d8136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:15.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.030+0000 7fd9dd4f6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd9d8136d80 0x7fd9d8139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:15.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.030+0000 7fd9dd4f6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d809ece0 con 0x7fd9d806a770 2023-10-01T07:54:15.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.030+0000 7fd9dd4f6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d806b640 con 0x7fd9d8136d80 2023-10-01T07:54:15.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.030+0000 7fd9dd4f6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d809e760 con 0x7fd9d806b250 2023-10-01T07:54:15.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.030+0000 7fd9d6ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd9d806a770 0x7fd9d806ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48604/0 (socket says 172.21.15.26:48604) 2023-10-01T07:54:15.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.030+0000 7fd9d67fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9d806b250 0x7fd9d8136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:15.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.030+0000 7fd9d6ffd700 1 -- 172.21.15.26:0/1805174439 learned_addr learned my addr 172.21.15.26:0/1805174439 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:15.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.030+0000 7fd9d77fe700 1 --2- 172.21.15.26:0/1805174439 >> v2:172.21.15.26:3300/0 conn(0x7fd9d8136d80 0x7fd9d8139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:15.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.030+0000 7fd9d5ffb700 1 -- 172.21.15.26:0/1805174439 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3876636914 0 0) 0x7fd9d809ece0 con 0x7fd9d806a770 2023-10-01T07:54:15.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.030+0000 7fd9d5ffb700 1 -- 172.21.15.26:0/1805174439 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9c00035b0 con 0x7fd9d806a770 2023-10-01T07:54:15.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.030+0000 7fd9d77fe700 1 -- 172.21.15.26:0/1805174439 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9d806b250 msgr2=0x7fd9d8136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:15.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.030+0000 7fd9d77fe700 1 --2- 172.21.15.26:0/1805174439 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9d806b250 0x7fd9d8136840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:15.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.030+0000 7fd9d77fe700 1 -- 172.21.15.26:0/1805174439 >> v1:172.21.15.26:6789/0 conn(0x7fd9d806a770 legacy=0x7fd9d806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:15.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.030+0000 7fd9d77fe700 1 -- 172.21.15.26:0/1805174439 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d809e040 con 0x7fd9d8136d80 2023-10-01T07:54:15.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.030+0000 7fd9d67fc700 1 --2- 172.21.15.26:0/1805174439 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9d806b250 0x7fd9d8136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:15.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.031+0000 7fc13b638700 1 -- 172.21.15.26:0/3525660673 shutdown_connections 2023-10-01T07:54:15.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.031+0000 7fc13b638700 1 -- 172.21.15.26:0/3525660673 wait complete. 2023-10-01T07:54:15.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.031+0000 7fd9d77fe700 1 --2- 172.21.15.26:0/1805174439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9d8136d80 0x7fd9d8139160 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0009d90 tx=0x7fd9d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=107bafdb8ebe7a82 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:15.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.031+0000 7fd9d5ffb700 1 -- 172.21.15.26:0/1805174439 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d000e070 con 0x7fd9d8136d80 2023-10-01T07:54:15.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.031+0000 7fd9d5ffb700 1 -- 172.21.15.26:0/1805174439 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d000bb20 con 0x7fd9d8136d80 2023-10-01T07:54:15.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.031+0000 7fd9d5ffb700 1 -- 172.21.15.26:0/1805174439 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d0012430 con 0x7fd9d8136d80 2023-10-01T07:54:15.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.032+0000 7fd9dd4f6700 1 -- 172.21.15.26:0/1805174439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9d8136d80 msgr2=0x7fd9d8139160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:15.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.032+0000 7fd9dd4f6700 1 --2- 172.21.15.26:0/1805174439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9d8136d80 0x7fd9d8139160 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0009d90 tx=0x7fd9d000b330 comp rx=0 tx=0).stop 2023-10-01T07:54:15.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.032+0000 7fd9dd4f6700 1 -- 172.21.15.26:0/1805174439 shutdown_connections 2023-10-01T07:54:15.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.032+0000 7fd9dd4f6700 1 --2- 172.21.15.26:0/1805174439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9d8136d80 0x7fd9d8139160 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:15.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.032+0000 7fd9dd4f6700 1 --2- 172.21.15.26:0/1805174439 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9d806b250 0x7fd9d8136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:15.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.032+0000 7fd9dd4f6700 1 -- 172.21.15.26:0/1805174439 >> 172.21.15.26:0/1805174439 conn(0x7fd9d8066f50 msgr2=0x7fd9d809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:15.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.032+0000 7fd9dd4f6700 1 -- 172.21.15.26:0/1805174439 shutdown_connections 2023-10-01T07:54:15.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.032+0000 7fd9dd4f6700 1 -- 172.21.15.26:0/1805174439 wait complete. 2023-10-01T07:54:15.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.033+0000 7fd9dd4f6700 1 Processor -- start 2023-10-01T07:54:15.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.033+0000 7fd9dd4f6700 1 -- start start 2023-10-01T07:54:15.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.034+0000 7fd9dd4f6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9d806a770 0x7fd9d81c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:15.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.034+0000 7fd9dd4f6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9d806b250 0x7fd9d81c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:15.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.034+0000 7fd9dd4f6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9d8136d80 0x7fd9d81c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:15.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.034+0000 7fd9dd4f6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d809bf30 con 0x7fd9d8136d80 2023-10-01T07:54:15.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.034+0000 7fd9dd4f6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d809c120 con 0x7fd9d806a770 2023-10-01T07:54:15.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.034+0000 7fd9dd4f6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d80711e0 con 0x7fd9d806b250 2023-10-01T07:54:15.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.034+0000 7fd9d67fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9d806b250 0x7fd9d81c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:15.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.034+0000 7fd9d77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9d8136d80 0x7fd9d81c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:15.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.034+0000 7fd9d67fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9d806b250 0x7fd9d81c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55542/0 (socket says 172.21.15.26:55542) 2023-10-01T07:54:15.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.034+0000 7fd9d67fc700 1 -- 172.21.15.26:0/2764186862 learned_addr learned my addr 172.21.15.26:0/2764186862 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:15.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.034+0000 7fd9d6ffd700 1 --2- 172.21.15.26:0/2764186862 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9d806a770 0x7fd9d81c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:15.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.035+0000 7fd9d77fe700 1 -- 172.21.15.26:0/2764186862 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9d806b250 msgr2=0x7fd9d81c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:15.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.035+0000 7fd9d77fe700 1 --2- 172.21.15.26:0/2764186862 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9d806b250 0x7fd9d81c84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:15.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.035+0000 7fd9d77fe700 1 -- 172.21.15.26:0/2764186862 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9d806a770 msgr2=0x7fd9d81c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:15.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.035+0000 7fd9d77fe700 1 --2- 172.21.15.26:0/2764186862 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9d806a770 0x7fd9d81c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:15.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.035+0000 7fd9d77fe700 1 -- 172.21.15.26:0/2764186862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9cc0094a0 con 0x7fd9d8136d80 2023-10-01T07:54:15.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.035+0000 7fd9d6ffd700 1 --2- 172.21.15.26:0/2764186862 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9d806a770 0x7fd9d81c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:15.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.035+0000 7fd9d77fe700 1 --2- 172.21.15.26:0/2764186862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9d8136d80 0x7fd9d81c8a10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd9d809d2a0 tx=0x7fd9d0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:15.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.035+0000 7fd9bf7fe700 1 -- 172.21.15.26:0/2764186862 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d0012430 con 0x7fd9d8136d80 2023-10-01T07:54:15.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.035+0000 7fd9bf7fe700 1 -- 172.21.15.26:0/2764186862 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d0020070 con 0x7fd9d8136d80 2023-10-01T07:54:15.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.035+0000 7fd9dd4f6700 1 -- 172.21.15.26:0/2764186862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d0009a70 con 0x7fd9d8136d80 2023-10-01T07:54:15.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.035+0000 7fd9bf7fe700 1 -- 172.21.15.26:0/2764186862 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d00098f0 con 0x7fd9d8136d80 2023-10-01T07:54:15.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.035+0000 7fd9dd4f6700 1 -- 172.21.15.26:0/2764186862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d81227a0 con 0x7fd9d8136d80 2023-10-01T07:54:15.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.036+0000 7fd9dd4f6700 1 -- 172.21.15.26:0/2764186862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d8122930 con 0x7fd9d8136d80 2023-10-01T07:54:15.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.036+0000 7fd9bf7fe700 1 -- 172.21.15.26:0/2764186862 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7fd9d0004040 con 0x7fd9d8136d80 2023-10-01T07:54:15.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.037+0000 7fd9bf7fe700 1 -- 172.21.15.26:0/2764186862 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4055+0+0 (secure 0 0 0) 0x7fd9d0022070 con 0x7fd9d8136d80 2023-10-01T07:54:15.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.042+0000 7fd9bf7fe700 1 -- 172.21.15.26:0/2764186862 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fd9d8122930 con 0x7fd9d8136d80 2023-10-01T07:54:15.052 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705693 for osd.0 2023-10-01T07:54:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.067+0000 7f15621c8700 1 Processor -- start 2023-10-01T07:54:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.067+0000 7f15621c8700 1 -- start start 2023-10-01T07:54:15.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.068+0000 7f15621c8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f155c09d6f0 0x7f155c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:15.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.068+0000 7f15621c8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f155c09e410 0x7f155c130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:15.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.068+0000 7f15621c8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f155c09f130 con 0x7f155c09e000 2023-10-01T07:54:15.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.068+0000 7f15621c8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f155c09f520 con 0x7f155c09d6f0 2023-10-01T07:54:15.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.068+0000 7f15621c8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f155c09e930 con 0x7f155c09e410 2023-10-01T07:54:15.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.068+0000 7f155b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f155c09d6f0 0x7f155c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:15.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.068+0000 7f155b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f155c09d6f0 0x7f155c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37956/0 (socket says 172.21.15.26:37956) 2023-10-01T07:54:15.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.068+0000 7f155b7fe700 1 -- 172.21.15.26:0/1941581549 learned_addr learned my addr 172.21.15.26:0/1941581549 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:15.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.068+0000 7f155bfff700 1 --2- 172.21.15.26:0/1941581549 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f155c09e410 0x7f155c130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:15.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.068+0000 7f155bfff700 1 -- 172.21.15.26:0/1941581549 >> v2:172.21.15.26:3300/0 conn(0x7f155c09d6f0 msgr2=0x7f155c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:15.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.068+0000 7f155bfff700 1 --2- 172.21.15.26:0/1941581549 >> v2:172.21.15.26:3300/0 conn(0x7f155c09d6f0 0x7f155c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:15.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.068+0000 7f155bfff700 1 -- 172.21.15.26:0/1941581549 >> v1:172.21.15.26:6789/0 conn(0x7f155c09e000 legacy=0x7f155c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:15.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.068+0000 7f155bfff700 1 -- 172.21.15.26:0/1941581549 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155c09b2d0 con 0x7f155c09e410 2023-10-01T07:54:15.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.068+0000 7f155a7fc700 1 -- 172.21.15.26:0/1941581549 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 750934366 0 0) 0x7f155c09f130 con 0x7f155c09e000 2023-10-01T07:54:15.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.069+0000 7f155bfff700 1 --2- 172.21.15.26:0/1941581549 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f155c09e410 0x7f155c130d70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1554009d90 tx=0x7f155400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25f1648d7e3ce8a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:15.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.069+0000 7f155a7fc700 1 -- 172.21.15.26:0/1941581549 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155400e070 con 0x7f155c09e410 2023-10-01T07:54:15.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.069+0000 7f155a7fc700 1 -- 172.21.15.26:0/1941581549 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155400bb20 con 0x7f155c09e410 2023-10-01T07:54:15.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.069+0000 7f155a7fc700 1 -- 172.21.15.26:0/1941581549 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1554012430 con 0x7f155c09e410 2023-10-01T07:54:15.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.070+0000 7f15621c8700 1 -- 172.21.15.26:0/1941581549 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f155c09e410 msgr2=0x7f155c130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:15.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.070+0000 7f15621c8700 1 --2- 172.21.15.26:0/1941581549 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f155c09e410 0x7f155c130d70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1554009d90 tx=0x7f155400b330 comp rx=0 tx=0).stop 2023-10-01T07:54:15.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.070+0000 7f15621c8700 1 -- 172.21.15.26:0/1941581549 shutdown_connections 2023-10-01T07:54:15.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.070+0000 7f15621c8700 1 --2- 172.21.15.26:0/1941581549 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f155c09e410 0x7f155c130d70 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:15.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.070+0000 7f15621c8700 1 --2- 172.21.15.26:0/1941581549 >> v2:172.21.15.26:3300/0 conn(0x7f155c09d6f0 0x7f155c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:15.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.070+0000 7f15621c8700 1 -- 172.21.15.26:0/1941581549 >> 172.21.15.26:0/1941581549 conn(0x7f155c066f50 msgr2=0x7f155c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:15.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.070+0000 7f15621c8700 1 -- 172.21.15.26:0/1941581549 shutdown_connections 2023-10-01T07:54:15.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.070+0000 7f15621c8700 1 -- 172.21.15.26:0/1941581549 wait complete. 2023-10-01T07:54:15.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.071+0000 7f15621c8700 1 Processor -- start 2023-10-01T07:54:15.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.072+0000 7f15621c8700 1 -- start start 2023-10-01T07:54:15.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.072+0000 7f15621c8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f155c09d6f0 0x7f155c122360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:15.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.072+0000 7f15621c8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f155c09e000 0x7f155c1228a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:15.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.072+0000 7f15621c8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f155c09e410 0x7f155c122de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:15.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.072+0000 7f15621c8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155c125560 con 0x7f155c09e000 2023-10-01T07:54:15.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.072+0000 7f15621c8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f155c124810 con 0x7f155c09d6f0 2023-10-01T07:54:15.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.072+0000 7f15621c8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f155c123f70 con 0x7f155c09e410 2023-10-01T07:54:15.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.072+0000 7f155bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f155c09e410 0x7f155c122de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:15.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.072+0000 7f155b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f155c09d6f0 0x7f155c122360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:15.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.072+0000 7f155bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f155c09e410 0x7f155c122de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55572/0 (socket says 172.21.15.26:55572) 2023-10-01T07:54:15.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.072+0000 7f155bfff700 1 -- 172.21.15.26:0/1263618367 learned_addr learned my addr 172.21.15.26:0/1263618367 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:15.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.073+0000 7f155affd700 1 --2- 172.21.15.26:0/1263618367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f155c09e000 0x7f155c1228a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:15.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.073+0000 7f155bfff700 1 -- 172.21.15.26:0/1263618367 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f155c09d6f0 msgr2=0x7f155c122360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:15.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.073+0000 7f155bfff700 1 --2- 172.21.15.26:0/1263618367 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f155c09d6f0 0x7f155c122360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:15.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.073+0000 7f155bfff700 1 -- 172.21.15.26:0/1263618367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f155c09e000 msgr2=0x7f155c1228a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:15.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.073+0000 7f155bfff700 1 --2- 172.21.15.26:0/1263618367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f155c09e000 0x7f155c1228a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:15.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.073+0000 7f155bfff700 1 -- 172.21.15.26:0/1263618367 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1554009a70 con 0x7f155c09e410 2023-10-01T07:54:15.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.073+0000 7f155b7fe700 1 --2- 172.21.15.26:0/1263618367 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f155c09d6f0 0x7f155c122360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:15.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.073+0000 7f155affd700 1 --2- 172.21.15.26:0/1263618367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f155c09e000 0x7f155c1228a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:54:15.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.073+0000 7f155bfff700 1 --2- 172.21.15.26:0/1263618367 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f155c09e410 0x7f155c122de0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f155c09ea70 tx=0x7f1554004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:15.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.073+0000 7f1543fff700 1 -- 172.21.15.26:0/1263618367 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1554012430 con 0x7f155c09e410 2023-10-01T07:54:15.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.073+0000 7f1543fff700 1 -- 172.21.15.26:0/1263618367 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1554020070 con 0x7f155c09e410 2023-10-01T07:54:15.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.073+0000 7f1543fff700 1 -- 172.21.15.26:0/1263618367 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1554004280 con 0x7f155c09e410 2023-10-01T07:54:15.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.074+0000 7f15621c8700 1 -- 172.21.15.26:0/1263618367 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f155c125e80 con 0x7f155c09e410 2023-10-01T07:54:15.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.074+0000 7f15621c8700 1 -- 172.21.15.26:0/1263618367 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f155c09c700 con 0x7f155c09e410 2023-10-01T07:54:15.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.075+0000 7f1543fff700 1 -- 172.21.15.26:0/1263618367 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f15540043e0 con 0x7f155c09e410 2023-10-01T07:54:15.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.075+0000 7f1543fff700 1 -- 172.21.15.26:0/1263618367 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4055+0+0 (secure 0 0 0) 0x7f1554022070 con 0x7f155c09e410 2023-10-01T07:54:15.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.075+0000 7f15621c8700 1 -- 172.21.15.26:0/1263618367 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f155c074ea0 con 0x7f155c09e410 2023-10-01T07:54:15.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.080+0000 7f1543fff700 1 -- 172.21.15.26:0/1263618367 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f155401b400 con 0x7f155c09e410 2023-10-01T07:54:15.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.211+0000 7f7d76bb1700 1 -- 172.21.15.26:0/1187851459 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7d70128fb0 con 0x7f7d700954c0 2023-10-01T07:54:15.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.211+0000 7f7d6d7fa700 1 -- 172.21.15.26:0/1187851459 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7d64017020 con 0x7f7d700954c0 2023-10-01T07:54:15.212 INFO:teuthology.orchestra.run.smithi026.stdout:38654705693 2023-10-01T07:54:15.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.213+0000 7f7d76bb1700 1 -- 172.21.15.26:0/1187851459 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7d700954c0 msgr2=0x7f7d70071610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:15.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.213+0000 7f7d76bb1700 1 --2- 172.21.15.26:0/1187851459 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7d700954c0 0x7f7d70071610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7d6400e930 tx=0x7f7d6400ec40 comp rx=0 tx=0).stop 2023-10-01T07:54:15.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.213+0000 7f7d76bb1700 1 -- 172.21.15.26:0/1187851459 shutdown_connections 2023-10-01T07:54:15.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.213+0000 7f7d76bb1700 1 --2- 172.21.15.26:0/1187851459 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7d7009a1c0 0x7f7d70072090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:15.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.213+0000 7f7d76bb1700 1 --2- 172.21.15.26:0/1187851459 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7d700954c0 0x7f7d70071610 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:15.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.213+0000 7f7d76bb1700 1 --2- 172.21.15.26:0/1187851459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d70099680 0x7f7d70071b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:15.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.213+0000 7f7d76bb1700 1 -- 172.21.15.26:0/1187851459 >> 172.21.15.26:0/1187851459 conn(0x7f7d700a2360 msgr2=0x7f7d70130910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:15.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.213+0000 7f7d76bb1700 1 -- 172.21.15.26:0/1187851459 shutdown_connections 2023-10-01T07:54:15.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.213+0000 7f7d76bb1700 1 -- 172.21.15.26:0/1187851459 wait complete. 2023-10-01T07:54:15.227 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.3 2023-10-01T07:54:15.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.229+0000 7fd9dd4f6700 1 -- 172.21.15.26:0/2764186862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd9d8121c20 con 0x7fd9d8136d80 2023-10-01T07:54:15.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.229+0000 7fd9bf7fe700 1 -- 172.21.15.26:0/2764186862 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd9d8121c20 con 0x7fd9d8136d80 2023-10-01T07:54:15.230 INFO:teuthology.orchestra.run.smithi026.stdout:38654705693 2023-10-01T07:54:15.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.231+0000 7fd9dd4f6700 1 -- 172.21.15.26:0/2764186862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9d8136d80 msgr2=0x7fd9d81c8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:15.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.232+0000 7fd9dd4f6700 1 --2- 172.21.15.26:0/2764186862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9d8136d80 0x7fd9d81c8a10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd9d809d2a0 tx=0x7fd9d0004ad0 comp rx=0 tx=0).stop 2023-10-01T07:54:15.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.232+0000 7fd9dd4f6700 1 -- 172.21.15.26:0/2764186862 shutdown_connections 2023-10-01T07:54:15.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.232+0000 7fd9dd4f6700 1 --2- 172.21.15.26:0/2764186862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9d8136d80 0x7fd9d81c8a10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:15.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.232+0000 7fd9dd4f6700 1 --2- 172.21.15.26:0/2764186862 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9d806a770 0x7fd9d81c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:15.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.232+0000 7fd9dd4f6700 1 --2- 172.21.15.26:0/2764186862 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9d806b250 0x7fd9d81c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:15.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.232+0000 7fd9dd4f6700 1 -- 172.21.15.26:0/2764186862 >> 172.21.15.26:0/2764186862 conn(0x7fd9d8066f50 msgr2=0x7fd9d806ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:15.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.232+0000 7fd9dd4f6700 1 -- 172.21.15.26:0/2764186862 shutdown_connections 2023-10-01T07:54:15.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.232+0000 7fd9dd4f6700 1 -- 172.21.15.26:0/2764186862 wait complete. 2023-10-01T07:54:15.245 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705693 for osd.2 2023-10-01T07:54:15.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.265+0000 7f15621c8700 1 -- 172.21.15.26:0/1263618367 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f155c06c360 con 0x7f155c09e410 2023-10-01T07:54:15.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.266+0000 7f1543fff700 1 -- 172.21.15.26:0/1263618367 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f155402c020 con 0x7f155c09e410 2023-10-01T07:54:15.266 INFO:teuthology.orchestra.run.smithi026.stdout:38654705693 2023-10-01T07:54:15.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.268+0000 7f15621c8700 1 -- 172.21.15.26:0/1263618367 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f155c09e410 msgr2=0x7f155c122de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:15.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.268+0000 7f15621c8700 1 --2- 172.21.15.26:0/1263618367 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f155c09e410 0x7f155c122de0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f155c09ea70 tx=0x7f1554004ad0 comp rx=0 tx=0).stop 2023-10-01T07:54:15.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.268+0000 7f15621c8700 1 -- 172.21.15.26:0/1263618367 shutdown_connections 2023-10-01T07:54:15.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.268+0000 7f15621c8700 1 --2- 172.21.15.26:0/1263618367 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f155c09e410 0x7f155c122de0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:15.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.268+0000 7f15621c8700 1 --2- 172.21.15.26:0/1263618367 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f155c09d6f0 0x7f155c122360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:15.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.268+0000 7f15621c8700 1 --2- 172.21.15.26:0/1263618367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f155c09e000 0x7f155c1228a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:15.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.268+0000 7f15621c8700 1 -- 172.21.15.26:0/1263618367 >> 172.21.15.26:0/1263618367 conn(0x7f155c066f50 msgr2=0x7f155c130a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:15.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.268+0000 7f15621c8700 1 -- 172.21.15.26:0/1263618367 shutdown_connections 2023-10-01T07:54:15.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:15.268+0000 7f15621c8700 1 -- 172.21.15.26:0/1263618367 wait complete. 2023-10-01T07:54:15.282 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705693 for osd.1 2023-10-01T07:54:15.813 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:15.812+0000 7f6c866ce700 -1 mgr.server handle_report got status from non-daemon mon.a 2023-10-01T07:54:15.815 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:15.813+0000 7f6c866ce700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-01T07:54:15.815 INFO:tasks.ceph.mgr.x.smithi026.stderr:2023-10-01T07:54:15.814+0000 7f6c866ce700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-01T07:54:16.054 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:54:16.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.199+0000 7fc6a1a42700 1 Processor -- start 2023-10-01T07:54:16.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.199+0000 7fc6a1a42700 1 -- start start 2023-10-01T07:54:16.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.199+0000 7fc6a1a42700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc69c133420 0x7fc69c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:16.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.199+0000 7fc6a1a42700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc69c133e30 0x7fc69c12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:16.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.199+0000 7fc6a1a42700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc69c134260 0x7fc69c1304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:16.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.200+0000 7fc6a1a42700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc69c06b990 con 0x7fc69c133e30 2023-10-01T07:54:16.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.200+0000 7fc6a1a42700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c0a0590 con 0x7fc69c134260 2023-10-01T07:54:16.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.200+0000 7fc6a1a42700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c09fb80 con 0x7fc69c133420 2023-10-01T07:54:16.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.200+0000 7fc69a7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc69c133e30 0x7fc69c12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:16.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.200+0000 7fc69b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc69c134260 0x7fc69c1304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:16.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.200+0000 7fc69affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc69c133420 0x7fc69c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:16.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.200+0000 7fc69a7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc69c133e30 0x7fc69c12ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37980/0 (socket says 172.21.15.26:37980) 2023-10-01T07:54:16.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.200+0000 7fc69affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc69c133420 0x7fc69c1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55578/0 (socket says 172.21.15.26:55578) 2023-10-01T07:54:16.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.200+0000 7fc69b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc69c134260 0x7fc69c1304d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:60372/0 (socket says 172.21.15.26:60372) 2023-10-01T07:54:16.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.200+0000 7fc69a7fc700 1 -- 172.21.15.26:0/2128549476 learned_addr learned my addr 172.21.15.26:0/2128549476 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:16.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.200+0000 7fc69affd700 1 -- 172.21.15.26:0/2128549476 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc69c134260 msgr2=0x7fc69c1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:16.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.200+0000 7fc69affd700 1 --2- 172.21.15.26:0/2128549476 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc69c134260 0x7fc69c1304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.200+0000 7fc69affd700 1 -- 172.21.15.26:0/2128549476 >> v2:172.21.15.26:3300/0 conn(0x7fc69c133e30 msgr2=0x7fc69c12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:16.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.200+0000 7fc69affd700 1 --2- 172.21.15.26:0/2128549476 >> v2:172.21.15.26:3300/0 conn(0x7fc69c133e30 0x7fc69c12ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.200+0000 7fc69affd700 1 -- 172.21.15.26:0/2128549476 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69c0a0030 con 0x7fc69c133420 2023-10-01T07:54:16.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.200+0000 7fc69a7fc700 1 --2- 172.21.15.26:0/2128549476 >> v2:172.21.15.26:3300/0 conn(0x7fc69c133e30 0x7fc69c12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:16.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.200+0000 7fc69b7fe700 1 --2- 172.21.15.26:0/2128549476 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc69c134260 0x7fc69c1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:16.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.200+0000 7fc69affd700 1 --2- 172.21.15.26:0/2128549476 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc69c133420 0x7fc69c1337f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc68c009840 tx=0x7fc68c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf92631a490a06db server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:16.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.200+0000 7fc699ffb700 1 -- 172.21.15.26:0/2128549476 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c011830 con 0x7fc69c133420 2023-10-01T07:54:16.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.200+0000 7fc699ffb700 1 -- 172.21.15.26:0/2128549476 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68c011990 con 0x7fc69c133420 2023-10-01T07:54:16.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.201+0000 7fc699ffb700 1 -- 172.21.15.26:0/2128549476 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c011d20 con 0x7fc69c133420 2023-10-01T07:54:16.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.201+0000 7fc6a1a42700 1 -- 172.21.15.26:0/2128549476 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc69c133420 msgr2=0x7fc69c1337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:16.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.201+0000 7fc6a1a42700 1 --2- 172.21.15.26:0/2128549476 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc69c133420 0x7fc69c1337f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc68c009840 tx=0x7fc68c009b50 comp rx=0 tx=0).stop 2023-10-01T07:54:16.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.201+0000 7fc6a1a42700 1 -- 172.21.15.26:0/2128549476 shutdown_connections 2023-10-01T07:54:16.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.201+0000 7fc6a1a42700 1 --2- 172.21.15.26:0/2128549476 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc69c134260 0x7fc69c1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.201+0000 7fc6a1a42700 1 --2- 172.21.15.26:0/2128549476 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc69c133420 0x7fc69c1337f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.201+0000 7fc6a1a42700 1 --2- 172.21.15.26:0/2128549476 >> v2:172.21.15.26:3300/0 conn(0x7fc69c133e30 0x7fc69c12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.201+0000 7fc6a1a42700 1 -- 172.21.15.26:0/2128549476 >> 172.21.15.26:0/2128549476 conn(0x7fc69c0a4210 msgr2=0x7fc69c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:16.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.201+0000 7fc6a1a42700 1 -- 172.21.15.26:0/2128549476 shutdown_connections 2023-10-01T07:54:16.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.201+0000 7fc6a1a42700 1 -- 172.21.15.26:0/2128549476 wait complete. 2023-10-01T07:54:16.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.203+0000 7fc6a1a42700 1 Processor -- start 2023-10-01T07:54:16.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.203+0000 7fc6a1a42700 1 -- start start 2023-10-01T07:54:16.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.203+0000 7fc6a1a42700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc69c133420 0x7fc69c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:16.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.203+0000 7fc6a1a42700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc69c133e30 0x7fc69c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:16.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.204+0000 7fc6a1a42700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc69c134260 0x7fc69c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:16.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.204+0000 7fc6a1a42700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c12dca0 con 0x7fc69c134260 2023-10-01T07:54:16.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.204+0000 7fc6a1a42700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c12d280 con 0x7fc69c133e30 2023-10-01T07:54:16.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.204+0000 7fc6a1a42700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c09dfa0 con 0x7fc69c133420 2023-10-01T07:54:16.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.204+0000 7fc69affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc69c133420 0x7fc69c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:16.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.204+0000 7fc69affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc69c133420 0x7fc69c09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55592/0 (socket says 172.21.15.26:55592) 2023-10-01T07:54:16.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.204+0000 7fc69affd700 1 -- 172.21.15.26:0/2779423088 learned_addr learned my addr 172.21.15.26:0/2779423088 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:16.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.204+0000 7fc69a7fc700 1 --2- 172.21.15.26:0/2779423088 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc69c133e30 0x7fc69c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:16.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.204+0000 7fc69b7fe700 1 --2- 172.21.15.26:0/2779423088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc69c134260 0x7fc69c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:16.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.204+0000 7fc69affd700 1 -- 172.21.15.26:0/2779423088 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc69c133e30 msgr2=0x7fc69c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:16.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.204+0000 7fc69affd700 1 --2- 172.21.15.26:0/2779423088 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc69c133e30 0x7fc69c09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.204+0000 7fc69affd700 1 -- 172.21.15.26:0/2779423088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc69c134260 msgr2=0x7fc69c09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:16.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.204+0000 7fc69affd700 1 --2- 172.21.15.26:0/2779423088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc69c134260 0x7fc69c09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.204+0000 7fc69affd700 1 -- 172.21.15.26:0/2779423088 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc684009550 con 0x7fc69c133420 2023-10-01T07:54:16.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.204+0000 7fc69affd700 1 --2- 172.21.15.26:0/2779423088 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc69c133420 0x7fc69c09c480 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc68c000c00 tx=0x7fc68c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:16.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.204+0000 7fc693fff700 1 -- 172.21.15.26:0/2779423088 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c004240 con 0x7fc69c133420 2023-10-01T07:54:16.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.204+0000 7fc693fff700 1 -- 172.21.15.26:0/2779423088 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68c01f070 con 0x7fc69c133420 2023-10-01T07:54:16.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.204+0000 7fc6a1a42700 1 -- 172.21.15.26:0/2779423088 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc694009a70 con 0x7fc69c133420 2023-10-01T07:54:16.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.204+0000 7fc693fff700 1 -- 172.21.15.26:0/2779423088 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c0045e0 con 0x7fc69c133420 2023-10-01T07:54:16.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.204+0000 7fc6a1a42700 1 -- 172.21.15.26:0/2779423088 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc68c0094a0 con 0x7fc69c133420 2023-10-01T07:54:16.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.205+0000 7fc693fff700 1 -- 172.21.15.26:0/2779423088 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7fc68c021030 con 0x7fc69c133420 2023-10-01T07:54:16.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.205+0000 7fc693fff700 1 -- 172.21.15.26:0/2779423088 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4038+0+0 (secure 0 0 0) 0x7fc68c040560 con 0x7fc69c133420 2023-10-01T07:54:16.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.206+0000 7fc6a1a42700 1 -- 172.21.15.26:0/2779423088 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc69c131520 con 0x7fc69c133420 2023-10-01T07:54:16.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.211+0000 7fc693fff700 1 -- 172.21.15.26:0/2779423088 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc68c015080 con 0x7fc69c133420 2023-10-01T07:54:16.229 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:54:16.246 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:54:16.283 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:54:16.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.373+0000 7f401a821700 1 Processor -- start 2023-10-01T07:54:16.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.373+0000 7f401a821700 1 -- start start 2023-10-01T07:54:16.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.374+0000 7f401a821700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f401409d6f0 0x7f401409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:16.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.374+0000 7f401a821700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f401409e000 0x7f401413bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:16.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.374+0000 7f401a821700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40140992c0 con 0x7f401413c470 2023-10-01T07:54:16.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.374+0000 7f401a821700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4014099520 con 0x7f401409d6f0 2023-10-01T07:54:16.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.374+0000 7f401a821700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40140997e0 con 0x7f401409e000 2023-10-01T07:54:16.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.374+0000 7f40137fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f401409e000 0x7f401413bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:16.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.374+0000 7f4013fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f401409d6f0 0x7f401409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:16.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.374+0000 7f40137fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f401409e000 0x7f401413bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55606/0 (socket says 172.21.15.26:55606) 2023-10-01T07:54:16.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.374+0000 7f40137fe700 1 -- 172.21.15.26:0/1437899853 learned_addr learned my addr 172.21.15.26:0/1437899853 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:16.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.374+0000 7f4013fff700 1 -- 172.21.15.26:0/1437899853 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f401409e000 msgr2=0x7f401413bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:16.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.374+0000 7f4013fff700 1 --2- 172.21.15.26:0/1437899853 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f401409e000 0x7f401413bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.374+0000 7f4013fff700 1 -- 172.21.15.26:0/1437899853 >> v1:172.21.15.26:6789/0 conn(0x7f401413c470 legacy=0x7f401413e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:16.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.374+0000 7f4013fff700 1 -- 172.21.15.26:0/1437899853 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4014099b30 con 0x7f401409d6f0 2023-10-01T07:54:16.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.375+0000 7f40137fe700 1 --2- 172.21.15.26:0/1437899853 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f401409e000 0x7f401413bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:16.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.375+0000 7f4013fff700 1 --2- 172.21.15.26:0/1437899853 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f401409d6f0 0x7f401409dac0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4004009870 tx=0x7f4004009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bbab5a60eedd8ac server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:16.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.375+0000 7f4012ffd700 1 -- 172.21.15.26:0/1437899853 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4004004230 con 0x7f401409d6f0 2023-10-01T07:54:16.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.375+0000 7f4012ffd700 1 -- 172.21.15.26:0/1437899853 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4004004390 con 0x7f401409d6f0 2023-10-01T07:54:16.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.375+0000 7f4012ffd700 1 -- 172.21.15.26:0/1437899853 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40040036a0 con 0x7f401409d6f0 2023-10-01T07:54:16.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.376+0000 7f401a821700 1 -- 172.21.15.26:0/1437899853 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f401409d6f0 msgr2=0x7f401409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:16.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.376+0000 7f401a821700 1 --2- 172.21.15.26:0/1437899853 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f401409d6f0 0x7f401409dac0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4004009870 tx=0x7f4004009b80 comp rx=0 tx=0).stop 2023-10-01T07:54:16.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.376+0000 7f401a821700 1 -- 172.21.15.26:0/1437899853 shutdown_connections 2023-10-01T07:54:16.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.376+0000 7f401a821700 1 --2- 172.21.15.26:0/1437899853 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f401409d6f0 0x7f401409dac0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.376+0000 7f401a821700 1 --2- 172.21.15.26:0/1437899853 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f401409e000 0x7f401413bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.376+0000 7f401a821700 1 -- 172.21.15.26:0/1437899853 >> 172.21.15.26:0/1437899853 conn(0x7f401409f470 msgr2=0x7f40140a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:16.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.376+0000 7f401a821700 1 -- 172.21.15.26:0/1437899853 shutdown_connections 2023-10-01T07:54:16.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.376+0000 7f401a821700 1 -- 172.21.15.26:0/1437899853 wait complete. 2023-10-01T07:54:16.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.377+0000 7f401a821700 1 Processor -- start 2023-10-01T07:54:16.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.377+0000 7f401a821700 1 -- start start 2023-10-01T07:54:16.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.378+0000 7f401a821700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f401409d6f0 0x7f401406f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:16.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.378+0000 7f401a821700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f401409e000 0x7f401406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:16.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.378+0000 7f401a821700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f401413c470 0x7f4014070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:16.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.378+0000 7f401a821700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40141273b0 con 0x7f401409d6f0 2023-10-01T07:54:16.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.378+0000 7f401a821700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4014070c70 con 0x7f401413c470 2023-10-01T07:54:16.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.378+0000 7f401a821700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40140a1600 con 0x7f401409e000 2023-10-01T07:54:16.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.378+0000 7f40137fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f401409e000 0x7f401406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:16.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.378+0000 7f4018dbe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f401413c470 0x7f4014070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:16.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.378+0000 7f40137fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f401409e000 0x7f401406fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55608/0 (socket says 172.21.15.26:55608) 2023-10-01T07:54:16.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.378+0000 7f4018dbe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f401413c470 0x7f4014070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:60408/0 (socket says 172.21.15.26:60408) 2023-10-01T07:54:16.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.378+0000 7f40137fe700 1 -- 172.21.15.26:0/427446464 learned_addr learned my addr 172.21.15.26:0/427446464 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:16.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.378+0000 7f4013fff700 1 --2- 172.21.15.26:0/427446464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f401409d6f0 0x7f401406f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:16.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.378+0000 7f4013fff700 1 -- 172.21.15.26:0/427446464 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f401409e000 msgr2=0x7f401406fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:16.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.378+0000 7f4013fff700 1 --2- 172.21.15.26:0/427446464 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f401409e000 0x7f401406fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.378+0000 7f4013fff700 1 -- 172.21.15.26:0/427446464 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f401413c470 msgr2=0x7f4014070290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:16.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.378+0000 7f4013fff700 1 --2- 172.21.15.26:0/427446464 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f401413c470 0x7f4014070290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.379+0000 7f4013fff700 1 -- 172.21.15.26:0/427446464 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4008009550 con 0x7f401409d6f0 2023-10-01T07:54:16.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.379+0000 7f4013fff700 1 --2- 172.21.15.26:0/427446464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f401409d6f0 0x7f401406f810 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4004015000 tx=0x7f4004004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:16.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.379+0000 7f4010ff9700 1 -- 172.21.15.26:0/427446464 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4004003d70 con 0x7f401409d6f0 2023-10-01T07:54:16.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.379+0000 7f401a821700 1 -- 172.21.15.26:0/427446464 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40040094a0 con 0x7f401409d6f0 2023-10-01T07:54:16.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.379+0000 7f4010ff9700 1 -- 172.21.15.26:0/427446464 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400401e070 con 0x7f401409d6f0 2023-10-01T07:54:16.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.379+0000 7f4010ff9700 1 -- 172.21.15.26:0/427446464 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4004011870 con 0x7f401409d6f0 2023-10-01T07:54:16.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.379+0000 7f401a821700 1 -- 172.21.15.26:0/427446464 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40141280c0 con 0x7f401409d6f0 2023-10-01T07:54:16.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.380+0000 7f401a821700 1 -- 172.21.15.26:0/427446464 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40140747f0 con 0x7f401409d6f0 2023-10-01T07:54:16.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.381+0000 7f4010ff9700 1 -- 172.21.15.26:0/427446464 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f40040119d0 con 0x7f401409d6f0 2023-10-01T07:54:16.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.381+0000 7f4010ff9700 1 -- 172.21.15.26:0/427446464 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4038+0+0 (secure 0 0 0) 0x7f40040405d0 con 0x7f401409d6f0 2023-10-01T07:54:16.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.390+0000 7f4010ff9700 1 -- 172.21.15.26:0/427446464 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4004018350 con 0x7f401409d6f0 2023-10-01T07:54:16.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.423+0000 7fd7714ff700 1 Processor -- start 2023-10-01T07:54:16.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.423+0000 7fd7714ff700 1 -- start start 2023-10-01T07:54:16.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.424+0000 7fd7714ff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd76c06a770 0x7fd76c09d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:16.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.424+0000 7fd7714ff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd76c09dc30 0x7fd76c09e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:16.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.424+0000 7fd7714ff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd76c13c1e0 0x7fd76c13e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:16.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.424+0000 7fd7714ff700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd76c06ab40 con 0x7fd76c06a770 2023-10-01T07:54:16.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.424+0000 7fd7714ff700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c09ebc0 con 0x7fd76c13c1e0 2023-10-01T07:54:16.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.424+0000 7fd7714ff700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c09a810 con 0x7fd76c09dc30 2023-10-01T07:54:16.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.424+0000 7fd76b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd76c13c1e0 0x7fd76c13e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:16.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.424+0000 7fd76b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd76c13c1e0 0x7fd76c13e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:60418/0 (socket says 172.21.15.26:60418) 2023-10-01T07:54:16.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.424+0000 7fd76b7fe700 1 -- 172.21.15.26:0/1774478208 learned_addr learned my addr 172.21.15.26:0/1774478208 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:16.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.424+0000 7fd76a7fc700 1 --2- 172.21.15.26:0/1774478208 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd76c09dc30 0x7fd76c09e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:16.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.425+0000 7fd76affd700 1 --2- 172.21.15.26:0/1774478208 >> v2:172.21.15.26:3300/0 conn(0x7fd76c06a770 0x7fd76c09d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:16.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.425+0000 7fd76b7fe700 1 -- 172.21.15.26:0/1774478208 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd76c09dc30 msgr2=0x7fd76c09e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:16.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.425+0000 7fd76b7fe700 1 --2- 172.21.15.26:0/1774478208 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd76c09dc30 0x7fd76c09e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.425+0000 7fd76b7fe700 1 -- 172.21.15.26:0/1774478208 >> v2:172.21.15.26:3300/0 conn(0x7fd76c06a770 msgr2=0x7fd76c09d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:16.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.425+0000 7fd76b7fe700 1 --2- 172.21.15.26:0/1774478208 >> v2:172.21.15.26:3300/0 conn(0x7fd76c06a770 0x7fd76c09d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.425+0000 7fd76b7fe700 1 -- 172.21.15.26:0/1774478208 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76c09e920 con 0x7fd76c13c1e0 2023-10-01T07:54:16.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.425+0000 7fd76a7fc700 1 --2- 172.21.15.26:0/1774478208 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd76c09dc30 0x7fd76c09e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:16.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.425+0000 7fd76b7fe700 1 --2- 172.21.15.26:0/1774478208 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd76c13c1e0 0x7fd76c13e5c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd764009e50 tx=0x7fd76400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e23b89efdcd1b87 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:16.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.425+0000 7fd769ffb700 1 -- 172.21.15.26:0/1774478208 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76400e070 con 0x7fd76c13c1e0 2023-10-01T07:54:16.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.425+0000 7fd769ffb700 1 -- 172.21.15.26:0/1774478208 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76400b910 con 0x7fd76c13c1e0 2023-10-01T07:54:16.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.425+0000 7fd769ffb700 1 -- 172.21.15.26:0/1774478208 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76400bcc0 con 0x7fd76c13c1e0 2023-10-01T07:54:16.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.426+0000 7fd7714ff700 1 -- 172.21.15.26:0/1774478208 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd76c13c1e0 msgr2=0x7fd76c13e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:16.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.426+0000 7fd7714ff700 1 --2- 172.21.15.26:0/1774478208 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd76c13c1e0 0x7fd76c13e5c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd764009e50 tx=0x7fd76400b330 comp rx=0 tx=0).stop 2023-10-01T07:54:16.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.427+0000 7fd7714ff700 1 -- 172.21.15.26:0/1774478208 shutdown_connections 2023-10-01T07:54:16.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.427+0000 7fd7714ff700 1 --2- 172.21.15.26:0/1774478208 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd76c13c1e0 0x7fd76c13e5c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.427+0000 7fd7714ff700 1 --2- 172.21.15.26:0/1774478208 >> v2:172.21.15.26:3300/0 conn(0x7fd76c06a770 0x7fd76c09d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.427+0000 7fd7714ff700 1 --2- 172.21.15.26:0/1774478208 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd76c09dc30 0x7fd76c09e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.427+0000 7fd7714ff700 1 -- 172.21.15.26:0/1774478208 >> 172.21.15.26:0/1774478208 conn(0x7fd76c066f50 msgr2=0x7fd76c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:16.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.427+0000 7fd7714ff700 1 -- 172.21.15.26:0/1774478208 shutdown_connections 2023-10-01T07:54:16.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.427+0000 7fd7714ff700 1 -- 172.21.15.26:0/1774478208 wait complete. 2023-10-01T07:54:16.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.428+0000 7fd7714ff700 1 Processor -- start 2023-10-01T07:54:16.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.428+0000 7fd7714ff700 1 -- start start 2023-10-01T07:54:16.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.429+0000 7fd7714ff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd76c06a770 0x7fd76c1cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:16.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.429+0000 7fd7714ff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd76c09dc30 0x7fd76c1ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:16.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.429+0000 7fd7714ff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd76c13c1e0 0x7fd76c1270f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:16.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.429+0000 7fd7714ff700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c1cd270 con 0x7fd76c13c1e0 2023-10-01T07:54:16.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.429+0000 7fd7714ff700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c12a630 con 0x7fd76c06a770 2023-10-01T07:54:16.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.429+0000 7fd7714ff700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c072370 con 0x7fd76c09dc30 2023-10-01T07:54:16.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.429+0000 7fd76affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd76c06a770 0x7fd76c1cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:16.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.429+0000 7fd76a7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd76c09dc30 0x7fd76c1ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:16.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.429+0000 7fd76affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd76c06a770 0x7fd76c1cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:60424/0 (socket says 172.21.15.26:60424) 2023-10-01T07:54:16.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.429+0000 7fd76affd700 1 -- 172.21.15.26:0/3377335821 learned_addr learned my addr 172.21.15.26:0/3377335821 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:16.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.429+0000 7fd76b7fe700 1 --2- 172.21.15.26:0/3377335821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd76c13c1e0 0x7fd76c1270f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:16.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.429+0000 7fd76b7fe700 1 -- 172.21.15.26:0/3377335821 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd76c09dc30 msgr2=0x7fd76c1ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:16.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.429+0000 7fd76b7fe700 1 --2- 172.21.15.26:0/3377335821 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd76c09dc30 0x7fd76c1ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.429+0000 7fd76b7fe700 1 -- 172.21.15.26:0/3377335821 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd76c06a770 msgr2=0x7fd76c1cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:16.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.429+0000 7fd76b7fe700 1 --2- 172.21.15.26:0/3377335821 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd76c06a770 0x7fd76c1cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.429+0000 7fd76b7fe700 1 -- 172.21.15.26:0/3377335821 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7600094a0 con 0x7fd76c13c1e0 2023-10-01T07:54:16.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.429+0000 7fd76a7fc700 1 --2- 172.21.15.26:0/3377335821 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd76c09dc30 0x7fd76c1ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:16.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.430+0000 7fd76b7fe700 1 --2- 172.21.15.26:0/3377335821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd76c13c1e0 0x7fd76c1270f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd764015000 tx=0x7fd764004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:16.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.430+0000 7fd7537fe700 1 -- 172.21.15.26:0/3377335821 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd764004450 con 0x7fd76c13c1e0 2023-10-01T07:54:16.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.430+0000 7fd7537fe700 1 -- 172.21.15.26:0/3377335821 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7640045d0 con 0x7fd76c13c1e0 2023-10-01T07:54:16.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.430+0000 7fd7714ff700 1 -- 172.21.15.26:0/3377335821 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd764009b30 con 0x7fd76c13c1e0 2023-10-01T07:54:16.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.430+0000 7fd7537fe700 1 -- 172.21.15.26:0/3377335821 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7640092e0 con 0x7fd76c13c1e0 2023-10-01T07:54:16.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.430+0000 7fd7714ff700 1 -- 172.21.15.26:0/3377335821 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd76c12b360 con 0x7fd76c13c1e0 2023-10-01T07:54:16.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.431+0000 7fd7714ff700 1 -- 172.21.15.26:0/3377335821 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd76c12a7f0 con 0x7fd76c13c1e0 2023-10-01T07:54:16.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.432+0000 7fd7537fe700 1 -- 172.21.15.26:0/3377335821 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7fd764025460 con 0x7fd76c13c1e0 2023-10-01T07:54:16.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.432+0000 7fd7537fe700 1 -- 172.21.15.26:0/3377335821 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4038+0+0 (secure 0 0 0) 0x7fd764041690 con 0x7fd76c13c1e0 2023-10-01T07:54:16.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.441+0000 7fd7537fe700 1 -- 172.21.15.26:0/3377335821 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd764011980 con 0x7fd76c13c1e0 2023-10-01T07:54:16.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.442+0000 7fc6a1a42700 1 -- 172.21.15.26:0/2779423088 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc69c074ea0 con 0x7fc69c133420 2023-10-01T07:54:16.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.442+0000 7fc693fff700 1 -- 172.21.15.26:0/2779423088 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc68c01a450 con 0x7fc69c133420 2023-10-01T07:54:16.444 INFO:teuthology.orchestra.run.smithi026.stdout:38654705693 2023-10-01T07:54:16.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.444+0000 7fc6a1a42700 1 -- 172.21.15.26:0/2779423088 >> v1:172.21.15.26:6816/126763 conn(0x7fc67c02f240 legacy=0x7fc67c0316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:16.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.444+0000 7fc6a1a42700 1 -- 172.21.15.26:0/2779423088 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc69c133420 msgr2=0x7fc69c09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:16.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.444+0000 7fc6a1a42700 1 --2- 172.21.15.26:0/2779423088 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc69c133420 0x7fc69c09c480 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc68c000c00 tx=0x7fc68c004750 comp rx=0 tx=0).stop 2023-10-01T07:54:16.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.445+0000 7fc6a1a42700 1 -- 172.21.15.26:0/2779423088 shutdown_connections 2023-10-01T07:54:16.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.445+0000 7fc6a1a42700 1 --2- 172.21.15.26:0/2779423088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc69c134260 0x7fc69c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.445+0000 7fc6a1a42700 1 --2- 172.21.15.26:0/2779423088 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc69c133420 0x7fc69c09c480 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.445+0000 7fc6a1a42700 1 --2- 172.21.15.26:0/2779423088 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc69c133e30 0x7fc69c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.445+0000 7fc6a1a42700 1 -- 172.21.15.26:0/2779423088 >> 172.21.15.26:0/2779423088 conn(0x7fc69c0a4210 msgr2=0x7fc69c0a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:16.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.445+0000 7fc6a1a42700 1 -- 172.21.15.26:0/2779423088 shutdown_connections 2023-10-01T07:54:16.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.445+0000 7fc6a1a42700 1 -- 172.21.15.26:0/2779423088 wait complete. 2023-10-01T07:54:16.459 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705693 for osd.0 2023-10-01T07:54:16.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.472+0000 7f8858a96700 1 Processor -- start 2023-10-01T07:54:16.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.472+0000 7f8858a96700 1 -- start start 2023-10-01T07:54:16.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.472+0000 7f8858a96700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f88540a0a30 0x7f88540a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:16.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.473+0000 7f8858a96700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f88540a1340 0x7f8854133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:16.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.473+0000 7f8858a96700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f885409edd0 con 0x7f8854133fa0 2023-10-01T07:54:16.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.473+0000 7f8858a96700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f885409e1f0 con 0x7f88540a1340 2023-10-01T07:54:16.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.473+0000 7f8858a96700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f885409dc50 con 0x7f88540a0a30 2023-10-01T07:54:16.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.473+0000 7f885259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f88540a0a30 0x7f88540a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:16.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.473+0000 7f8852d9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8854133fa0 0x7f885413ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48638/0 (socket says 172.21.15.26:48638) 2023-10-01T07:54:16.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.473+0000 7f885259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f88540a0a30 0x7f88540a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55622/0 (socket says 172.21.15.26:55622) 2023-10-01T07:54:16.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.473+0000 7f8852d9d700 1 -- 172.21.15.26:0/3164193526 learned_addr learned my addr 172.21.15.26:0/3164193526 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:16.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.473+0000 7f8851d9b700 1 --2- 172.21.15.26:0/3164193526 >> v2:172.21.15.26:3300/0 conn(0x7f88540a1340 0x7f8854133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:16.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.473+0000 7f885159a700 1 -- 172.21.15.26:0/3164193526 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3719345760 0 0) 0x7f885409edd0 con 0x7f8854133fa0 2023-10-01T07:54:16.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.473+0000 7f8851d9b700 1 -- 172.21.15.26:0/3164193526 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f88540a0a30 msgr2=0x7f88540a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:16.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.473+0000 7f8851d9b700 1 --2- 172.21.15.26:0/3164193526 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f88540a0a30 0x7f88540a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.473+0000 7f8851d9b700 1 -- 172.21.15.26:0/3164193526 >> v1:172.21.15.26:6789/0 conn(0x7f8854133fa0 legacy=0x7f885413ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:16.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.473+0000 7f8851d9b700 1 -- 172.21.15.26:0/3164193526 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88540a1fe0 con 0x7f88540a1340 2023-10-01T07:54:16.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.473+0000 7f885259c700 1 --2- 172.21.15.26:0/3164193526 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f88540a0a30 0x7f88540a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:16.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.473+0000 7f8851d9b700 1 --2- 172.21.15.26:0/3164193526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88540a1340 0x7f8854133a60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8848009840 tx=0x7f8848009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b8989b237393788 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:16.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.474+0000 7f885159a700 1 -- 172.21.15.26:0/3164193526 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8848011830 con 0x7f88540a1340 2023-10-01T07:54:16.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.474+0000 7f885159a700 1 -- 172.21.15.26:0/3164193526 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8848011990 con 0x7f88540a1340 2023-10-01T07:54:16.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.474+0000 7f885159a700 1 -- 172.21.15.26:0/3164193526 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8848011d20 con 0x7f88540a1340 2023-10-01T07:54:16.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.474+0000 7f8858a96700 1 -- 172.21.15.26:0/3164193526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88540a1340 msgr2=0x7f8854133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:16.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.474+0000 7f8858a96700 1 --2- 172.21.15.26:0/3164193526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88540a1340 0x7f8854133a60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8848009840 tx=0x7f8848009b50 comp rx=0 tx=0).stop 2023-10-01T07:54:16.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.474+0000 7f8858a96700 1 -- 172.21.15.26:0/3164193526 shutdown_connections 2023-10-01T07:54:16.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.474+0000 7f8858a96700 1 --2- 172.21.15.26:0/3164193526 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f88540a0a30 0x7f88540a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.474+0000 7f8858a96700 1 --2- 172.21.15.26:0/3164193526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88540a1340 0x7f8854133a60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.474+0000 7f8858a96700 1 -- 172.21.15.26:0/3164193526 >> 172.21.15.26:0/3164193526 conn(0x7f88540a6550 msgr2=0x7f88540a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:16.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.474+0000 7f8858a96700 1 -- 172.21.15.26:0/3164193526 shutdown_connections 2023-10-01T07:54:16.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.475+0000 7f8858a96700 1 -- 172.21.15.26:0/3164193526 wait complete. 2023-10-01T07:54:16.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.476+0000 7f8858a96700 1 Processor -- start 2023-10-01T07:54:16.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.476+0000 7f8858a96700 1 -- start start 2023-10-01T07:54:16.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.476+0000 7f8858a96700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88540a0a30 0x7f8854122820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:16.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.476+0000 7f8858a96700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f88540a1340 0x7f8854122d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:16.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.476+0000 7f8858a96700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8854133fa0 0x7f88541232a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:16.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.476+0000 7f8858a96700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8854124620 con 0x7f88540a0a30 2023-10-01T07:54:16.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.476+0000 7f8858a96700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8854124430 con 0x7f88540a1340 2023-10-01T07:54:16.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.476+0000 7f8858a96700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8854124cf0 con 0x7f8854133fa0 2023-10-01T07:54:16.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.476+0000 7f885259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88540a0a30 0x7f8854122820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:16.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.476+0000 7f885259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88540a0a30 0x7f8854122820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38034/0 (socket says 172.21.15.26:38034) 2023-10-01T07:54:16.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.476+0000 7f885259c700 1 -- 172.21.15.26:0/931690692 learned_addr learned my addr 172.21.15.26:0/931690692 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:16.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.476+0000 7f8851d9b700 1 --2- 172.21.15.26:0/931690692 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f88540a1340 0x7f8854122d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:16.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.476+0000 7f8852d9d700 1 --2- 172.21.15.26:0/931690692 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8854133fa0 0x7f88541232a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:16.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.477+0000 7f885259c700 1 -- 172.21.15.26:0/931690692 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8854133fa0 msgr2=0x7f88541232a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:16.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.477+0000 7f885259c700 1 --2- 172.21.15.26:0/931690692 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8854133fa0 0x7f88541232a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.477+0000 7f885259c700 1 -- 172.21.15.26:0/931690692 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f88540a1340 msgr2=0x7f8854122d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:16.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.477+0000 7f885259c700 1 --2- 172.21.15.26:0/931690692 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f88540a1340 0x7f8854122d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.477+0000 7f885259c700 1 -- 172.21.15.26:0/931690692 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88440094a0 con 0x7f88540a0a30 2023-10-01T07:54:16.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.477+0000 7f885259c700 1 --2- 172.21.15.26:0/931690692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88540a0a30 0x7f8854122820 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f884400ebe0 tx=0x7f884400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:16.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.477+0000 7f8842ffd700 1 -- 172.21.15.26:0/931690692 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884400c850 con 0x7f88540a0a30 2023-10-01T07:54:16.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.477+0000 7f8842ffd700 1 -- 172.21.15.26:0/931690692 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884400c9b0 con 0x7f88540a0a30 2023-10-01T07:54:16.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.477+0000 7f8858a96700 1 -- 172.21.15.26:0/931690692 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88480094a0 con 0x7f88540a0a30 2023-10-01T07:54:16.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.477+0000 7f8842ffd700 1 -- 172.21.15.26:0/931690692 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884400cd20 con 0x7f88540a0a30 2023-10-01T07:54:16.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.477+0000 7f8858a96700 1 -- 172.21.15.26:0/931690692 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8854133340 con 0x7f88540a0a30 2023-10-01T07:54:16.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.478+0000 7f8842ffd700 1 -- 172.21.15.26:0/931690692 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f8844013470 con 0x7f88540a0a30 2023-10-01T07:54:16.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.478+0000 7f8858a96700 1 -- 172.21.15.26:0/931690692 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8854074ea0 con 0x7f88540a0a30 2023-10-01T07:54:16.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.479+0000 7f8842ffd700 1 -- 172.21.15.26:0/931690692 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4038+0+0 (secure 0 0 0) 0x7f884403f7c0 con 0x7f88540a0a30 2023-10-01T07:54:16.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.483+0000 7f8842ffd700 1 -- 172.21.15.26:0/931690692 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8844013720 con 0x7f88540a0a30 2023-10-01T07:54:16.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.612+0000 7f401a821700 1 -- 172.21.15.26:0/427446464 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4014097de0 con 0x7f401409d6f0 2023-10-01T07:54:16.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.612+0000 7f4010ff9700 1 -- 172.21.15.26:0/427446464 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4004010b70 con 0x7f401409d6f0 2023-10-01T07:54:16.613 INFO:teuthology.orchestra.run.smithi026.stdout:38654705693 2023-10-01T07:54:16.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.614+0000 7f401a821700 1 -- 172.21.15.26:0/427446464 >> v1:172.21.15.26:6816/126763 conn(0x7f400002f240 legacy=0x7f40000316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:16.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.614+0000 7f401a821700 1 -- 172.21.15.26:0/427446464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f401409d6f0 msgr2=0x7f401406f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:16.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.614+0000 7f401a821700 1 --2- 172.21.15.26:0/427446464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f401409d6f0 0x7f401406f810 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4004015000 tx=0x7f4004004750 comp rx=0 tx=0).stop 2023-10-01T07:54:16.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.614+0000 7f401a821700 1 -- 172.21.15.26:0/427446464 shutdown_connections 2023-10-01T07:54:16.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.614+0000 7f401a821700 1 --2- 172.21.15.26:0/427446464 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f401413c470 0x7f4014070290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.614+0000 7f401a821700 1 --2- 172.21.15.26:0/427446464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f401409d6f0 0x7f401406f810 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.614+0000 7f401a821700 1 --2- 172.21.15.26:0/427446464 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f401409e000 0x7f401406fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.614+0000 7f401a821700 1 -- 172.21.15.26:0/427446464 >> 172.21.15.26:0/427446464 conn(0x7f401409f470 msgr2=0x7f401409fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:16.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.614+0000 7f401a821700 1 -- 172.21.15.26:0/427446464 shutdown_connections 2023-10-01T07:54:16.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.615+0000 7f401a821700 1 -- 172.21.15.26:0/427446464 wait complete. 2023-10-01T07:54:16.628 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.3 2023-10-01T07:54:16.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.654+0000 7fd7714ff700 1 -- 172.21.15.26:0/3377335821 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd76c074ea0 con 0x7fd76c13c1e0 2023-10-01T07:54:16.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.654+0000 7fd7537fe700 1 -- 172.21.15.26:0/3377335821 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd76401a3c0 con 0x7fd76c13c1e0 2023-10-01T07:54:16.654 INFO:teuthology.orchestra.run.smithi026.stdout:38654705693 2023-10-01T07:54:16.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.656+0000 7fd7714ff700 1 -- 172.21.15.26:0/3377335821 >> v1:172.21.15.26:6816/126763 conn(0x7fd75802f240 legacy=0x7fd7580316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:16.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.656+0000 7fd7714ff700 1 -- 172.21.15.26:0/3377335821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd76c13c1e0 msgr2=0x7fd76c1270f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:16.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.656+0000 7fd7714ff700 1 --2- 172.21.15.26:0/3377335821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd76c13c1e0 0x7fd76c1270f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd764015000 tx=0x7fd764004ad0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.656+0000 7fd7714ff700 1 -- 172.21.15.26:0/3377335821 shutdown_connections 2023-10-01T07:54:16.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.656+0000 7fd7714ff700 1 --2- 172.21.15.26:0/3377335821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd76c13c1e0 0x7fd76c1270f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.656+0000 7fd7714ff700 1 --2- 172.21.15.26:0/3377335821 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd76c06a770 0x7fd76c1cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.656+0000 7fd7714ff700 1 --2- 172.21.15.26:0/3377335821 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd76c09dc30 0x7fd76c1ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.656+0000 7fd7714ff700 1 -- 172.21.15.26:0/3377335821 >> 172.21.15.26:0/3377335821 conn(0x7fd76c066f50 msgr2=0x7fd76c09b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:16.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.656+0000 7fd7714ff700 1 -- 172.21.15.26:0/3377335821 shutdown_connections 2023-10-01T07:54:16.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.656+0000 7fd7714ff700 1 -- 172.21.15.26:0/3377335821 wait complete. 2023-10-01T07:54:16.670 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705693 for osd.2 2023-10-01T07:54:16.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.693+0000 7f8858a96700 1 -- 172.21.15.26:0/931690692 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f88540a28e0 con 0x7f88540a0a30 2023-10-01T07:54:16.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.694+0000 7f8842ffd700 1 -- 172.21.15.26:0/931690692 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8844021070 con 0x7f88540a0a30 2023-10-01T07:54:16.694 INFO:teuthology.orchestra.run.smithi026.stdout:38654705693 2023-10-01T07:54:16.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.696+0000 7f8858a96700 1 -- 172.21.15.26:0/931690692 >> v1:172.21.15.26:6816/126763 conn(0x7f883402f240 legacy=0x7f88340316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:16.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.696+0000 7f8858a96700 1 -- 172.21.15.26:0/931690692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88540a0a30 msgr2=0x7f8854122820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:16.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.696+0000 7f8858a96700 1 --2- 172.21.15.26:0/931690692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88540a0a30 0x7f8854122820 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f884400ebe0 tx=0x7f884400eef0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.696+0000 7f8858a96700 1 -- 172.21.15.26:0/931690692 shutdown_connections 2023-10-01T07:54:16.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.696+0000 7f8858a96700 1 --2- 172.21.15.26:0/931690692 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8854133fa0 0x7f88541232a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.696+0000 7f8858a96700 1 --2- 172.21.15.26:0/931690692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88540a0a30 0x7f8854122820 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.696+0000 7f8858a96700 1 --2- 172.21.15.26:0/931690692 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f88540a1340 0x7f8854122d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:16.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.696+0000 7f8858a96700 1 -- 172.21.15.26:0/931690692 >> 172.21.15.26:0/931690692 conn(0x7f88540a6550 msgr2=0x7f885411c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:16.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.696+0000 7f8858a96700 1 -- 172.21.15.26:0/931690692 shutdown_connections 2023-10-01T07:54:16.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:16.696+0000 7f8858a96700 1 -- 172.21.15.26:0/931690692 wait complete. 2023-10-01T07:54:16.710 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705693 for osd.1 2023-10-01T07:54:17.461 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:54:17.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.599+0000 7efe092b3700 1 Processor -- start 2023-10-01T07:54:17.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.600+0000 7efe092b3700 1 -- start start 2023-10-01T07:54:17.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.600+0000 7efe092b3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efe041316c0 0x7efe04131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:17.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.600+0000 7efe092b3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe0409d9f0 0x7efe0406a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:17.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.600+0000 7efe092b3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe0406acb0 0x7efe0406b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:17.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.600+0000 7efe092b3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe0409e130 con 0x7efe041316c0 2023-10-01T07:54:17.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.600+0000 7efe092b3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe041312b0 con 0x7efe0409d9f0 2023-10-01T07:54:17.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.600+0000 7efe092b3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe0409f6e0 con 0x7efe0406acb0 2023-10-01T07:54:17.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.601+0000 7efe027fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe0409d9f0 0x7efe0406a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:17.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.601+0000 7efe02ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efe041316c0 0x7efe04131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:17.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.601+0000 7efe02ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efe041316c0 0x7efe04131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38070/0 (socket says 172.21.15.26:38070) 2023-10-01T07:54:17.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.601+0000 7efe027fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe0409d9f0 0x7efe0406a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:60470/0 (socket says 172.21.15.26:60470) 2023-10-01T07:54:17.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.601+0000 7efe02ffd700 1 -- 172.21.15.26:0/771673827 learned_addr learned my addr 172.21.15.26:0/771673827 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:17.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.601+0000 7efe037fe700 1 --2- 172.21.15.26:0/771673827 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe0406acb0 0x7efe0406b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:17.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.601+0000 7efe027fc700 1 -- 172.21.15.26:0/771673827 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe0406acb0 msgr2=0x7efe0406b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:17.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.601+0000 7efe027fc700 1 --2- 172.21.15.26:0/771673827 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe0406acb0 0x7efe0406b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:17.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.601+0000 7efe027fc700 1 -- 172.21.15.26:0/771673827 >> v2:172.21.15.26:3300/0 conn(0x7efe041316c0 msgr2=0x7efe04131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:17.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.601+0000 7efe027fc700 1 --2- 172.21.15.26:0/771673827 >> v2:172.21.15.26:3300/0 conn(0x7efe041316c0 0x7efe04131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:17.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.601+0000 7efe027fc700 1 -- 172.21.15.26:0/771673827 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0409e760 con 0x7efe0409d9f0 2023-10-01T07:54:17.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.601+0000 7efe02ffd700 1 --2- 172.21.15.26:0/771673827 >> v2:172.21.15.26:3300/0 conn(0x7efe041316c0 0x7efe04131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:17.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.601+0000 7efe037fe700 1 --2- 172.21.15.26:0/771673827 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe0406acb0 0x7efe0406b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:54:17.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.601+0000 7efe027fc700 1 --2- 172.21.15.26:0/771673827 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe0409d9f0 0x7efe0406a770 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efdf8009840 tx=0x7efdf8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc75395f164194ac server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:17.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.601+0000 7efe01ffb700 1 -- 172.21.15.26:0/771673827 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf8011830 con 0x7efe0409d9f0 2023-10-01T07:54:17.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.602+0000 7efe01ffb700 1 -- 172.21.15.26:0/771673827 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf8011990 con 0x7efe0409d9f0 2023-10-01T07:54:17.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.602+0000 7efe01ffb700 1 -- 172.21.15.26:0/771673827 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf8011d20 con 0x7efe0409d9f0 2023-10-01T07:54:17.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.602+0000 7efe092b3700 1 -- 172.21.15.26:0/771673827 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe0409d9f0 msgr2=0x7efe0406a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:17.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.602+0000 7efe092b3700 1 --2- 172.21.15.26:0/771673827 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe0409d9f0 0x7efe0406a770 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efdf8009840 tx=0x7efdf8009b50 comp rx=0 tx=0).stop 2023-10-01T07:54:17.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.602+0000 7efe092b3700 1 -- 172.21.15.26:0/771673827 shutdown_connections 2023-10-01T07:54:17.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.602+0000 7efe092b3700 1 --2- 172.21.15.26:0/771673827 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe0406acb0 0x7efe0406b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:17.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.602+0000 7efe092b3700 1 --2- 172.21.15.26:0/771673827 >> v2:172.21.15.26:3300/0 conn(0x7efe041316c0 0x7efe04131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:17.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.602+0000 7efe092b3700 1 --2- 172.21.15.26:0/771673827 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe0409d9f0 0x7efe0406a770 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:17.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.602+0000 7efe092b3700 1 -- 172.21.15.26:0/771673827 >> 172.21.15.26:0/771673827 conn(0x7efe04066f50 msgr2=0x7efe0409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:17.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.602+0000 7efe092b3700 1 -- 172.21.15.26:0/771673827 shutdown_connections 2023-10-01T07:54:17.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.602+0000 7efe092b3700 1 -- 172.21.15.26:0/771673827 wait complete. 2023-10-01T07:54:17.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.604+0000 7efe092b3700 1 Processor -- start 2023-10-01T07:54:17.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.604+0000 7efe092b3700 1 -- start start 2023-10-01T07:54:17.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.605+0000 7efe092b3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe0406acb0 0x7efe04070670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:17.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.605+0000 7efe092b3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe0409d9f0 0x7efe04070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:17.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.605+0000 7efe092b3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe041316c0 0x7efe040710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:17.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.605+0000 7efe092b3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe04119cb0 con 0x7efe041316c0 2023-10-01T07:54:17.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.605+0000 7efe092b3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe0411acf0 con 0x7efe0406acb0 2023-10-01T07:54:17.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.605+0000 7efe092b3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe0412b900 con 0x7efe0409d9f0 2023-10-01T07:54:17.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.605+0000 7efe02ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe0406acb0 0x7efe04070670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:17.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.605+0000 7efe037fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe041316c0 0x7efe040710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:17.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.605+0000 7efe02ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe0406acb0 0x7efe04070670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:60482/0 (socket says 172.21.15.26:60482) 2023-10-01T07:54:17.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.605+0000 7efe02ffd700 1 -- 172.21.15.26:0/362062936 learned_addr learned my addr 172.21.15.26:0/362062936 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:17.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.605+0000 7efe027fc700 1 --2- 172.21.15.26:0/362062936 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe0409d9f0 0x7efe04070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:17.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.605+0000 7efe02ffd700 1 -- 172.21.15.26:0/362062936 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe0409d9f0 msgr2=0x7efe04070bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:17.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.605+0000 7efe02ffd700 1 --2- 172.21.15.26:0/362062936 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe0409d9f0 0x7efe04070bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:17.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.605+0000 7efe02ffd700 1 -- 172.21.15.26:0/362062936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe041316c0 msgr2=0x7efe040710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:17.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.605+0000 7efe02ffd700 1 --2- 172.21.15.26:0/362062936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe041316c0 0x7efe040710f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:17.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.605+0000 7efe02ffd700 1 -- 172.21.15.26:0/362062936 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf4009550 con 0x7efe0406acb0 2023-10-01T07:54:17.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.605+0000 7efe037fe700 1 --2- 172.21.15.26:0/362062936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe041316c0 0x7efe040710f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:17.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.606+0000 7efe02ffd700 1 --2- 172.21.15.26:0/362062936 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe0406acb0 0x7efe04070670 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efdf400ebe0 tx=0x7efdf400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:17.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.606+0000 7efdeb7fe700 1 -- 172.21.15.26:0/362062936 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf400c850 con 0x7efe0406acb0 2023-10-01T07:54:17.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.606+0000 7efdeb7fe700 1 -- 172.21.15.26:0/362062936 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf400c9b0 con 0x7efe0406acb0 2023-10-01T07:54:17.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.606+0000 7efe092b3700 1 -- 172.21.15.26:0/362062936 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf80094a0 con 0x7efe0406acb0 2023-10-01T07:54:17.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.606+0000 7efdeb7fe700 1 -- 172.21.15.26:0/362062936 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf400cd40 con 0x7efe0406acb0 2023-10-01T07:54:17.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.606+0000 7efe092b3700 1 -- 172.21.15.26:0/362062936 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe040a3660 con 0x7efe0406acb0 2023-10-01T07:54:17.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.607+0000 7efdeb7fe700 1 -- 172.21.15.26:0/362062936 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7efdf4013470 con 0x7efe0406acb0 2023-10-01T07:54:17.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.607+0000 7efdeb7fe700 1 -- 172.21.15.26:0/362062936 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4049+0+0 (secure 0 0 0) 0x7efdf403f830 con 0x7efe0406acb0 2023-10-01T07:54:17.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.607+0000 7efe092b3700 1 -- 172.21.15.26:0/362062936 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe04128600 con 0x7efe0406acb0 2023-10-01T07:54:17.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.616+0000 7efdeb7fe700 1 -- 172.21.15.26:0/362062936 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efdf4021020 con 0x7efe0406acb0 2023-10-01T07:54:17.629 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:54:17.671 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:54:17.711 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:54:17.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.778+0000 7ffa7a5da700 1 Processor -- start 2023-10-01T07:54:17.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.778+0000 7ffa7a5da700 1 -- start start 2023-10-01T07:54:17.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.779+0000 7ffa7a5da700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffa74130540 0x7ffa74130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:17.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.779+0000 7ffa7a5da700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffa74130e50 0x7ffa7406f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:17.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.779+0000 7ffa7a5da700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa7406fb20 0x7ffa7406ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:17.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.779+0000 7ffa7a5da700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa740704b0 con 0x7ffa74130e50 2023-10-01T07:54:17.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.779+0000 7ffa7a5da700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7409a390 con 0x7ffa74130540 2023-10-01T07:54:17.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.779+0000 7ffa7a5da700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa740716a0 con 0x7ffa7406fb20 2023-10-01T07:54:17.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.779+0000 7ffa78b77700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa7406fb20 0x7ffa7406ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:17.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.779+0000 7ffa78b77700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa7406fb20 0x7ffa7406ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55686/0 (socket says 172.21.15.26:55686) 2023-10-01T07:54:17.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.779+0000 7ffa78b77700 1 -- 172.21.15.26:0/3744810370 learned_addr learned my addr 172.21.15.26:0/3744810370 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:17.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.779+0000 7ffa73fff700 1 --2- 172.21.15.26:0/3744810370 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffa74130540 0x7ffa74130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:17.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.779+0000 7ffa737fe700 1 --2- 172.21.15.26:0/3744810370 >> v2:172.21.15.26:3300/0 conn(0x7ffa74130e50 0x7ffa7406f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:17.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.779+0000 7ffa78b77700 1 -- 172.21.15.26:0/3744810370 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffa74130540 msgr2=0x7ffa74130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:17.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.779+0000 7ffa78b77700 1 --2- 172.21.15.26:0/3744810370 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffa74130540 0x7ffa74130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:17.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.779+0000 7ffa78b77700 1 -- 172.21.15.26:0/3744810370 >> v2:172.21.15.26:3300/0 conn(0x7ffa74130e50 msgr2=0x7ffa7406f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:17.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.779+0000 7ffa78b77700 1 --2- 172.21.15.26:0/3744810370 >> v2:172.21.15.26:3300/0 conn(0x7ffa74130e50 0x7ffa7406f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:17.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.779+0000 7ffa78b77700 1 -- 172.21.15.26:0/3744810370 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa74071290 con 0x7ffa7406fb20 2023-10-01T07:54:17.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.780+0000 7ffa78b77700 1 --2- 172.21.15.26:0/3744810370 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa7406fb20 0x7ffa7406ff70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c009e80 tx=0x7ffa6c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba79fa8b527a9b4b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:17.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.780+0000 7ffa72ffd700 1 -- 172.21.15.26:0/3744810370 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c00bad0 con 0x7ffa7406fb20 2023-10-01T07:54:17.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.780+0000 7ffa72ffd700 1 -- 172.21.15.26:0/3744810370 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6c00bc30 con 0x7ffa7406fb20 2023-10-01T07:54:17.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.780+0000 7ffa72ffd700 1 -- 172.21.15.26:0/3744810370 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c0104d0 con 0x7ffa7406fb20 2023-10-01T07:54:17.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.781+0000 7ffa7a5da700 1 -- 172.21.15.26:0/3744810370 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa7406fb20 msgr2=0x7ffa7406ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:17.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.781+0000 7ffa7a5da700 1 --2- 172.21.15.26:0/3744810370 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa7406fb20 0x7ffa7406ff70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c009e80 tx=0x7ffa6c00b330 comp rx=0 tx=0).stop 2023-10-01T07:54:17.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.781+0000 7ffa7a5da700 1 -- 172.21.15.26:0/3744810370 shutdown_connections 2023-10-01T07:54:17.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.781+0000 7ffa7a5da700 1 --2- 172.21.15.26:0/3744810370 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa7406fb20 0x7ffa7406ff70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:17.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.781+0000 7ffa7a5da700 1 --2- 172.21.15.26:0/3744810370 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffa74130540 0x7ffa74130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:17.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.781+0000 7ffa7a5da700 1 --2- 172.21.15.26:0/3744810370 >> v2:172.21.15.26:3300/0 conn(0x7ffa74130e50 0x7ffa7406f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:17.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.781+0000 7ffa7a5da700 1 -- 172.21.15.26:0/3744810370 >> 172.21.15.26:0/3744810370 conn(0x7ffa740a2aa0 msgr2=0x7ffa740a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:17.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.781+0000 7ffa7a5da700 1 -- 172.21.15.26:0/3744810370 shutdown_connections 2023-10-01T07:54:17.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.781+0000 7ffa7a5da700 1 -- 172.21.15.26:0/3744810370 wait complete. 2023-10-01T07:54:17.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.782+0000 7ffa7a5da700 1 Processor -- start 2023-10-01T07:54:17.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.782+0000 7ffa7a5da700 1 -- start start 2023-10-01T07:54:17.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.783+0000 7ffa7a5da700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa7406fb20 0x7ffa74118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:17.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.783+0000 7ffa7a5da700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa74130540 0x7ffa74119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:17.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.783+0000 7ffa7a5da700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffa74130e50 0x7ffa74119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:17.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.783+0000 7ffa7a5da700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7409ddc0 con 0x7ffa74130540 2023-10-01T07:54:17.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.783+0000 7ffa7a5da700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7409dbd0 con 0x7ffa74130e50 2023-10-01T07:54:17.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.783+0000 7ffa7a5da700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa740a0a70 con 0x7ffa7406fb20 2023-10-01T07:54:17.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.783+0000 7ffa73fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa7406fb20 0x7ffa74118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:17.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.783+0000 7ffa73fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa7406fb20 0x7ffa74118cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55690/0 (socket says 172.21.15.26:55690) 2023-10-01T07:54:17.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.783+0000 7ffa73fff700 1 -- 172.21.15.26:0/3446017793 learned_addr learned my addr 172.21.15.26:0/3446017793 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:17.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.783+0000 7ffa78b77700 1 --2- 172.21.15.26:0/3446017793 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffa74130e50 0x7ffa74119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:17.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.783+0000 7ffa737fe700 1 --2- 172.21.15.26:0/3446017793 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa74130540 0x7ffa74119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:17.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.783+0000 7ffa73fff700 1 -- 172.21.15.26:0/3446017793 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffa74130e50 msgr2=0x7ffa74119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:17.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.783+0000 7ffa73fff700 1 --2- 172.21.15.26:0/3446017793 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffa74130e50 0x7ffa74119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:17.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.783+0000 7ffa73fff700 1 -- 172.21.15.26:0/3446017793 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa74130540 msgr2=0x7ffa74119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:17.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.783+0000 7ffa73fff700 1 --2- 172.21.15.26:0/3446017793 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa74130540 0x7ffa74119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:17.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.783+0000 7ffa73fff700 1 -- 172.21.15.26:0/3446017793 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6c009b30 con 0x7ffa7406fb20 2023-10-01T07:54:17.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.784+0000 7ffa73fff700 1 --2- 172.21.15.26:0/3446017793 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa7406fb20 0x7ffa74118cd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400fae0 tx=0x7ffa6400fdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:17.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.784+0000 7ffa70ff9700 1 -- 172.21.15.26:0/3446017793 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6400c070 con 0x7ffa7406fb20 2023-10-01T07:54:17.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.784+0000 7ffa70ff9700 1 -- 172.21.15.26:0/3446017793 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6400da60 con 0x7ffa7406fb20 2023-10-01T07:54:17.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.784+0000 7ffa70ff9700 1 -- 172.21.15.26:0/3446017793 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa64009710 con 0x7ffa7406fb20 2023-10-01T07:54:17.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.784+0000 7ffa7a5da700 1 -- 172.21.15.26:0/3446017793 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa7411b0f0 con 0x7ffa7406fb20 2023-10-01T07:54:17.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.784+0000 7ffa7a5da700 1 -- 172.21.15.26:0/3446017793 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa7411ae10 con 0x7ffa7406fb20 2023-10-01T07:54:17.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.785+0000 7ffa7a5da700 1 -- 172.21.15.26:0/3446017793 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa7411a4e0 con 0x7ffa7406fb20 2023-10-01T07:54:17.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.786+0000 7ffa70ff9700 1 -- 172.21.15.26:0/3446017793 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7ffa64011450 con 0x7ffa7406fb20 2023-10-01T07:54:17.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.786+0000 7ffa70ff9700 1 -- 172.21.15.26:0/3446017793 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4049+0+0 (secure 0 0 0) 0x7ffa64015070 con 0x7ffa7406fb20 2023-10-01T07:54:17.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.791+0000 7ffa70ff9700 1 -- 172.21.15.26:0/3446017793 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa64019450 con 0x7ffa7406fb20 2023-10-01T07:54:17.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.823+0000 7ffa70ff9700 1 -- 172.21.15.26:0/3446017793 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7ffa64011700 con 0x7ffa7406fb20 2023-10-01T07:54:17.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.824+0000 7efdeb7fe700 1 -- 172.21.15.26:0/362062936 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7efdf4013720 con 0x7efe0406acb0 2023-10-01T07:54:17.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.824+0000 7f1ceacc1700 1 Processor -- start 2023-10-01T07:54:17.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.824+0000 7f1ceacc1700 1 -- start start 2023-10-01T07:54:17.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.825+0000 7f1ceacc1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ce409cb40 0x7f1ce406e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:17.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.825+0000 7f1ceacc1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ce409cf10 0x7f1ce409d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:17.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.825+0000 7f1ceacc1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce409c6f0 con 0x7f1ce4131370 2023-10-01T07:54:17.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.825+0000 7f1ceacc1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce409e420 con 0x7f1ce409cb40 2023-10-01T07:54:17.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.825+0000 7f1ceacc1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce40723a0 con 0x7f1ce409cf10 2023-10-01T07:54:17.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.825+0000 7f1ce3fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ce409cf10 0x7f1ce409d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:17.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.826+0000 7f1ce3fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ce409cf10 0x7f1ce409d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55706/0 (socket says 172.21.15.26:55706) 2023-10-01T07:54:17.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.826+0000 7f1ce3fff700 1 -- 172.21.15.26:0/684744271 learned_addr learned my addr 172.21.15.26:0/684744271 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:17.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.826+0000 7f1ce3fff700 1 -- 172.21.15.26:0/684744271 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ce409cb40 msgr2=0x7f1ce406e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:17.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.826+0000 7f1ce3fff700 1 --2- 172.21.15.26:0/684744271 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ce409cb40 0x7f1ce406e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:17.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.826+0000 7f1ce3fff700 1 -- 172.21.15.26:0/684744271 >> v1:172.21.15.26:6789/0 conn(0x7f1ce4131370 legacy=0x7f1ce4131810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:17.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.826+0000 7f1ce3fff700 1 -- 172.21.15.26:0/684744271 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce406e080 con 0x7f1ce409cf10 2023-10-01T07:54:17.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.826+0000 7f1ce3fff700 1 --2- 172.21.15.26:0/684744271 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ce409cf10 0x7f1ce409d340 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4009920 tx=0x7f1cd4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0b9313cd9bd3519 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:17.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.827+0000 7f1ce37fe700 1 -- 172.21.15.26:0/684744271 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4004230 con 0x7f1ce409cf10 2023-10-01T07:54:17.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.827+0000 7f1ce37fe700 1 -- 172.21.15.26:0/684744271 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd4004390 con 0x7f1ce409cf10 2023-10-01T07:54:17.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.827+0000 7f1ce37fe700 1 -- 172.21.15.26:0/684744271 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4009e70 con 0x7f1ce409cf10 2023-10-01T07:54:17.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.828+0000 7f1ceacc1700 1 -- 172.21.15.26:0/684744271 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ce409cf10 msgr2=0x7f1ce409d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:17.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.828+0000 7f1ceacc1700 1 --2- 172.21.15.26:0/684744271 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ce409cf10 0x7f1ce409d340 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4009920 tx=0x7f1cd4009c30 comp rx=0 tx=0).stop 2023-10-01T07:54:17.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.828+0000 7f1ceacc1700 1 -- 172.21.15.26:0/684744271 shutdown_connections 2023-10-01T07:54:17.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.828+0000 7f1ceacc1700 1 --2- 172.21.15.26:0/684744271 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ce409cb40 0x7f1ce406e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:17.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.828+0000 7f1ceacc1700 1 --2- 172.21.15.26:0/684744271 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ce409cf10 0x7f1ce409d340 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:17.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.828+0000 7f1ceacc1700 1 -- 172.21.15.26:0/684744271 >> 172.21.15.26:0/684744271 conn(0x7f1ce409e7e0 msgr2=0x7f1ce409ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:17.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.828+0000 7f1ceacc1700 1 -- 172.21.15.26:0/684744271 shutdown_connections 2023-10-01T07:54:17.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.828+0000 7f1ceacc1700 1 -- 172.21.15.26:0/684744271 wait complete. 2023-10-01T07:54:17.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.829+0000 7f1ceacc1700 1 Processor -- start 2023-10-01T07:54:17.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.829+0000 7f1ceacc1700 1 -- start start 2023-10-01T07:54:17.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.830+0000 7f1ceacc1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ce409cb40 0x7f1ce4129bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:17.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.830+0000 7f1ceacc1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ce409cf10 0x7f1ce412a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:17.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.830+0000 7f1ceacc1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ce4131370 0x7f1ce412a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:17.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.830+0000 7f1ceacc1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce412c480 con 0x7f1ce409cf10 2023-10-01T07:54:17.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.830+0000 7f1ceacc1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce412d050 con 0x7f1ce4131370 2023-10-01T07:54:17.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.830+0000 7f1ceacc1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce40a1430 con 0x7f1ce409cb40 2023-10-01T07:54:17.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.830+0000 7f1ce8a5d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ce409cb40 0x7f1ce4129bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:17.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.830+0000 7f1ce8a5d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ce409cb40 0x7f1ce4129bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55720/0 (socket says 172.21.15.26:55720) 2023-10-01T07:54:17.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.830+0000 7f1ce8a5d700 1 -- 172.21.15.26:0/3623425453 learned_addr learned my addr 172.21.15.26:0/3623425453 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:17.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.830+0000 7f1ce3fff700 1 --2- 172.21.15.26:0/3623425453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ce409cf10 0x7f1ce412a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:17.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.830+0000 7f1ce925e700 1 --2- 172.21.15.26:0/3623425453 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ce4131370 0x7f1ce412a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:17.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.830+0000 7f1ce3fff700 1 -- 172.21.15.26:0/3623425453 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ce409cb40 msgr2=0x7f1ce4129bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:17.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.830+0000 7f1ce3fff700 1 --2- 172.21.15.26:0/3623425453 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ce409cb40 0x7f1ce4129bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:17.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.830+0000 7f1ce3fff700 1 -- 172.21.15.26:0/3623425453 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ce4131370 msgr2=0x7f1ce412a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:17.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.830+0000 7f1ce3fff700 1 --2- 172.21.15.26:0/3623425453 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ce4131370 0x7f1ce412a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:17.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.830+0000 7f1ce3fff700 1 -- 172.21.15.26:0/3623425453 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd4009550 con 0x7f1ce409cf10 2023-10-01T07:54:17.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.830+0000 7f1ce925e700 1 --2- 172.21.15.26:0/3623425453 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ce4131370 0x7f1ce412a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:54:17.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.831+0000 7f1ce3fff700 1 --2- 172.21.15.26:0/3623425453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ce409cf10 0x7f1ce412a110 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4015000 tx=0x7f1cd4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:17.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.831+0000 7f1ce17fa700 1 -- 172.21.15.26:0/3623425453 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd400bea0 con 0x7f1ce409cf10 2023-10-01T07:54:17.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.831+0000 7f1ce17fa700 1 -- 172.21.15.26:0/3623425453 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd40036a0 con 0x7f1ce409cf10 2023-10-01T07:54:17.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.831+0000 7f1ce17fa700 1 -- 172.21.15.26:0/3623425453 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4003a50 con 0x7f1ce409cf10 2023-10-01T07:54:17.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.832+0000 7f1ceacc1700 1 -- 172.21.15.26:0/3623425453 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce40725e0 con 0x7f1ce409cf10 2023-10-01T07:54:17.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.832+0000 7f1ceacc1700 1 -- 172.21.15.26:0/3623425453 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce412d560 con 0x7f1ce409cf10 2023-10-01T07:54:17.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.832+0000 7f1ce17fa700 1 -- 172.21.15.26:0/3623425453 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f1cd4022070 con 0x7f1ce409cf10 2023-10-01T07:54:17.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.833+0000 7f1ce17fa700 1 -- 172.21.15.26:0/3623425453 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f1cd4042aa0 con 0x7f1ce409cf10 2023-10-01T07:54:17.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.833+0000 7f1ceacc1700 1 -- 172.21.15.26:0/3623425453 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce40a0f80 con 0x7f1ce409cf10 2023-10-01T07:54:17.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.838+0000 7f1ce17fa700 1 -- 172.21.15.26:0/3623425453 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1cd4046060 con 0x7f1ce409cf10 2023-10-01T07:54:17.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.866+0000 7fbe9adcc700 1 Processor -- start 2023-10-01T07:54:17.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.866+0000 7fbe9adcc700 1 -- start start 2023-10-01T07:54:17.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.866+0000 7fbe9adcc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe9409e1d0 0x7fbe94138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:17.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.866+0000 7fbe9adcc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe94139170 0x7fbe9413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:17.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.866+0000 7fbe9adcc700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe9409b120 con 0x7fbe9409d6f0 2023-10-01T07:54:17.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.866+0000 7fbe9adcc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9406b460 con 0x7fbe9409e1d0 2023-10-01T07:54:17.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.866+0000 7fbe9adcc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9409a7e0 con 0x7fbe94139170 2023-10-01T07:54:17.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.866+0000 7fbe99369700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe94139170 0x7fbe9413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:17.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.867+0000 7fbe99369700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe94139170 0x7fbe9413b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55724/0 (socket says 172.21.15.26:55724) 2023-10-01T07:54:17.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.867+0000 7fbe99369700 1 -- 172.21.15.26:0/1811610352 learned_addr learned my addr 172.21.15.26:0/1811610352 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:17.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.867+0000 7fbe99369700 1 -- 172.21.15.26:0/1811610352 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe9409e1d0 msgr2=0x7fbe94138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:17.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.867+0000 7fbe99369700 1 --2- 172.21.15.26:0/1811610352 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe9409e1d0 0x7fbe94138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:17.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.867+0000 7fbe99369700 1 -- 172.21.15.26:0/1811610352 >> v1:172.21.15.26:6789/0 conn(0x7fbe9409d6f0 legacy=0x7fbe9409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:17.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.867+0000 7fbe99369700 1 -- 172.21.15.26:0/1811610352 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9409a500 con 0x7fbe94139170 2023-10-01T07:54:17.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.867+0000 7fbe99369700 1 --2- 172.21.15.26:0/1811610352 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe94139170 0x7fbe9413b550 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009eb0 tx=0x7fbe8c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98944d95fe949769 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:17.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.867+0000 7fbe937fe700 1 -- 172.21.15.26:0/1811610352 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c00e070 con 0x7fbe94139170 2023-10-01T07:54:17.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.867+0000 7fbe937fe700 1 -- 172.21.15.26:0/1811610352 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8c00b980 con 0x7fbe94139170 2023-10-01T07:54:17.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.867+0000 7fbe937fe700 1 -- 172.21.15.26:0/1811610352 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c00bd30 con 0x7fbe94139170 2023-10-01T07:54:17.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.868+0000 7fbe9adcc700 1 -- 172.21.15.26:0/1811610352 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe94139170 msgr2=0x7fbe9413b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:17.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.868+0000 7fbe9adcc700 1 --2- 172.21.15.26:0/1811610352 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe94139170 0x7fbe9413b550 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009eb0 tx=0x7fbe8c00b330 comp rx=0 tx=0).stop 2023-10-01T07:54:17.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.868+0000 7fbe9adcc700 1 -- 172.21.15.26:0/1811610352 shutdown_connections 2023-10-01T07:54:17.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.868+0000 7fbe9adcc700 1 --2- 172.21.15.26:0/1811610352 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe94139170 0x7fbe9413b550 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:17.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.868+0000 7fbe9adcc700 1 --2- 172.21.15.26:0/1811610352 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe9409e1d0 0x7fbe94138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:17.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.868+0000 7fbe9adcc700 1 -- 172.21.15.26:0/1811610352 >> 172.21.15.26:0/1811610352 conn(0x7fbe94066f50 msgr2=0x7fbe9409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:17.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.868+0000 7fbe9adcc700 1 -- 172.21.15.26:0/1811610352 shutdown_connections 2023-10-01T07:54:17.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.868+0000 7fbe9adcc700 1 -- 172.21.15.26:0/1811610352 wait complete. 2023-10-01T07:54:17.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.869+0000 7fbe9adcc700 1 Processor -- start 2023-10-01T07:54:17.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.869+0000 7fbe9adcc700 1 -- start start 2023-10-01T07:54:17.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.870+0000 7fbe9adcc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe9409d6f0 0x7fbe9411f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:17.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.870+0000 7fbe9adcc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe9409e1d0 0x7fbe9411f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:17.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.870+0000 7fbe9adcc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe94139170 0x7fbe941c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:17.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.870+0000 7fbe9adcc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9411f030 con 0x7fbe9409d6f0 2023-10-01T07:54:17.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.870+0000 7fbe9adcc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe94072090 con 0x7fbe94139170 2023-10-01T07:54:17.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.870+0000 7fbe9adcc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9409c710 con 0x7fbe9409e1d0 2023-10-01T07:54:17.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.870+0000 7fbe93fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe9409e1d0 0x7fbe9411f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:17.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.870+0000 7fbe93fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe9409e1d0 0x7fbe9411f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55726/0 (socket says 172.21.15.26:55726) 2023-10-01T07:54:17.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.870+0000 7fbe93fff700 1 -- 172.21.15.26:0/962076104 learned_addr learned my addr 172.21.15.26:0/962076104 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:17.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.870+0000 7fbe98b68700 1 --2- 172.21.15.26:0/962076104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe9409d6f0 0x7fbe9411f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:17.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.870+0000 7fbe99369700 1 --2- 172.21.15.26:0/962076104 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe94139170 0x7fbe941c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:17.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.870+0000 7fbe93fff700 1 -- 172.21.15.26:0/962076104 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe94139170 msgr2=0x7fbe941c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:17.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.870+0000 7fbe93fff700 1 --2- 172.21.15.26:0/962076104 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe94139170 0x7fbe941c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:17.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.870+0000 7fbe93fff700 1 -- 172.21.15.26:0/962076104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe9409d6f0 msgr2=0x7fbe9411f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:17.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.870+0000 7fbe93fff700 1 --2- 172.21.15.26:0/962076104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe9409d6f0 0x7fbe9411f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:17.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.870+0000 7fbe93fff700 1 -- 172.21.15.26:0/962076104 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe8c009b30 con 0x7fbe9409e1d0 2023-10-01T07:54:17.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.870+0000 7fbe98b68700 1 --2- 172.21.15.26:0/962076104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe9409d6f0 0x7fbe9411f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:17.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.871+0000 7fbe93fff700 1 --2- 172.21.15.26:0/962076104 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe9409e1d0 0x7fbe9411f850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000b530 tx=0x7fbe8000b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:17.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.871+0000 7fbe917fa700 1 -- 172.21.15.26:0/962076104 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe80011830 con 0x7fbe9409e1d0 2023-10-01T07:54:17.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.871+0000 7fbe917fa700 1 -- 172.21.15.26:0/962076104 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe80011990 con 0x7fbe9409e1d0 2023-10-01T07:54:17.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.871+0000 7fbe9adcc700 1 -- 172.21.15.26:0/962076104 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe94122d30 con 0x7fbe9409e1d0 2023-10-01T07:54:17.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.871+0000 7fbe917fa700 1 -- 172.21.15.26:0/962076104 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe80011d40 con 0x7fbe9409e1d0 2023-10-01T07:54:17.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.871+0000 7fbe9adcc700 1 -- 172.21.15.26:0/962076104 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe9411fd90 con 0x7fbe9409e1d0 2023-10-01T07:54:17.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.872+0000 7fbe9adcc700 1 -- 172.21.15.26:0/962076104 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe94074ea0 con 0x7fbe9409e1d0 2023-10-01T07:54:17.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.872+0000 7fbe917fa700 1 -- 172.21.15.26:0/962076104 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7fbe8001a400 con 0x7fbe9409e1d0 2023-10-01T07:54:17.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.873+0000 7fbe917fa700 1 -- 172.21.15.26:0/962076104 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fbe8003faa0 con 0x7fbe9409e1d0 2023-10-01T07:54:17.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.882+0000 7fbe917fa700 1 -- 172.21.15.26:0/962076104 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe8000f8d0 con 0x7fbe9409e1d0 2023-10-01T07:54:17.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.909+0000 7efe092b3700 1 -- 172.21.15.26:0/362062936 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efe04074ea0 con 0x7efe0406acb0 2023-10-01T07:54:17.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.909+0000 7efdeb7fe700 1 -- 172.21.15.26:0/362062936 <== mon.1 v2:172.21.15.26:3301/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efdf401bd40 con 0x7efe0406acb0 2023-10-01T07:54:17.910 INFO:teuthology.orchestra.run.smithi026.stdout:38654705696 2023-10-01T07:54:17.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.913+0000 7efe092b3700 1 -- 172.21.15.26:0/362062936 >> v1:172.21.15.26:6816/126763 conn(0x7efdf002f240 legacy=0x7efdf00316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:17.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.913+0000 7efe092b3700 1 -- 172.21.15.26:0/362062936 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe0406acb0 msgr2=0x7efe04070670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:17.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.913+0000 7efe092b3700 1 --2- 172.21.15.26:0/362062936 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe0406acb0 0x7efe04070670 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efdf400ebe0 tx=0x7efdf400eef0 comp rx=0 tx=0).stop 2023-10-01T07:54:17.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.913+0000 7efe092b3700 1 -- 172.21.15.26:0/362062936 shutdown_connections 2023-10-01T07:54:17.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.913+0000 7efe092b3700 1 --2- 172.21.15.26:0/362062936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe041316c0 0x7efe040710f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:17.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.913+0000 7efe092b3700 1 --2- 172.21.15.26:0/362062936 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe0406acb0 0x7efe04070670 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:17.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.913+0000 7efe092b3700 1 --2- 172.21.15.26:0/362062936 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe0409d9f0 0x7efe04070bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:17.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.913+0000 7efe092b3700 1 -- 172.21.15.26:0/362062936 >> 172.21.15.26:0/362062936 conn(0x7efe04066f50 msgr2=0x7efe040a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:17.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.913+0000 7efe092b3700 1 -- 172.21.15.26:0/362062936 shutdown_connections 2023-10-01T07:54:17.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:17.913+0000 7efe092b3700 1 -- 172.21.15.26:0/362062936 wait complete. 2023-10-01T07:54:17.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705696 for osd.0 2023-10-01T07:54:17.933 DEBUG:teuthology.parallel:result is None 2023-10-01T07:54:18.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.051+0000 7f1ceacc1700 1 -- 172.21.15.26:0/3623425453 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1ce40747f0 con 0x7f1ce409cf10 2023-10-01T07:54:18.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.051+0000 7f1ce17fa700 1 -- 172.21.15.26:0/3623425453 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1cd4025470 con 0x7f1ce409cf10 2023-10-01T07:54:18.052 INFO:teuthology.orchestra.run.smithi026.stdout:38654705696 2023-10-01T07:54:18.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.053+0000 7f1ceacc1700 1 -- 172.21.15.26:0/3623425453 >> v1:172.21.15.26:6816/126763 conn(0x7f1cd002f480 legacy=0x7f1cd0031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:18.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.053+0000 7f1ceacc1700 1 -- 172.21.15.26:0/3623425453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ce409cf10 msgr2=0x7f1ce412a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:18.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.053+0000 7f1ceacc1700 1 --2- 172.21.15.26:0/3623425453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ce409cf10 0x7f1ce412a110 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4015000 tx=0x7f1cd4004750 comp rx=0 tx=0).stop 2023-10-01T07:54:18.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.054+0000 7f1ceacc1700 1 -- 172.21.15.26:0/3623425453 shutdown_connections 2023-10-01T07:54:18.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.054+0000 7f1ceacc1700 1 --2- 172.21.15.26:0/3623425453 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ce4131370 0x7f1ce412a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:18.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.054+0000 7f1ceacc1700 1 --2- 172.21.15.26:0/3623425453 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ce409cb40 0x7f1ce4129bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:18.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.054+0000 7f1ceacc1700 1 --2- 172.21.15.26:0/3623425453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ce409cf10 0x7f1ce412a110 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:18.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.054+0000 7f1ceacc1700 1 -- 172.21.15.26:0/3623425453 >> 172.21.15.26:0/3623425453 conn(0x7f1ce409e7e0 msgr2=0x7f1ce409fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:18.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.054+0000 7f1ceacc1700 1 -- 172.21.15.26:0/3623425453 shutdown_connections 2023-10-01T07:54:18.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.054+0000 7f1ceacc1700 1 -- 172.21.15.26:0/3623425453 wait complete. 2023-10-01T07:54:18.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.068+0000 7ffa7a5da700 1 -- 172.21.15.26:0/3446017793 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffa74074ea0 con 0x7ffa7406fb20 2023-10-01T07:54:18.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.069+0000 7ffa70ff9700 1 -- 172.21.15.26:0/3446017793 <== mon.2 v2:172.21.15.26:3302/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffa6401f030 con 0x7ffa7406fb20 2023-10-01T07:54:18.069 INFO:teuthology.orchestra.run.smithi026.stdout:38654705695 2023-10-01T07:54:18.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.071+0000 7ffa7a5da700 1 -- 172.21.15.26:0/3446017793 >> v1:172.21.15.26:6816/126763 conn(0x7ffa6002f270 legacy=0x7ffa60031720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:18.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.071+0000 7ffa7a5da700 1 -- 172.21.15.26:0/3446017793 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa7406fb20 msgr2=0x7ffa74118cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:18.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.071+0000 7ffa7a5da700 1 --2- 172.21.15.26:0/3446017793 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa7406fb20 0x7ffa74118cd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400fae0 tx=0x7ffa6400fdf0 comp rx=0 tx=0).stop 2023-10-01T07:54:18.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.071+0000 7ffa7a5da700 1 -- 172.21.15.26:0/3446017793 shutdown_connections 2023-10-01T07:54:18.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.071+0000 7ffa7a5da700 1 --2- 172.21.15.26:0/3446017793 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffa74130e50 0x7ffa74119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:18.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.071+0000 7ffa7a5da700 1 --2- 172.21.15.26:0/3446017793 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa7406fb20 0x7ffa74118cd0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:18.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.071+0000 7ffa7a5da700 1 --2- 172.21.15.26:0/3446017793 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa74130540 0x7ffa74119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:18.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.071+0000 7ffa7a5da700 1 -- 172.21.15.26:0/3446017793 >> 172.21.15.26:0/3446017793 conn(0x7ffa740a2aa0 msgr2=0x7ffa7406e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:18.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.071+0000 7ffa7a5da700 1 -- 172.21.15.26:0/3446017793 shutdown_connections 2023-10-01T07:54:18.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.071+0000 7ffa7a5da700 1 -- 172.21.15.26:0/3446017793 wait complete. 2023-10-01T07:54:18.073 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705696 for osd.2 2023-10-01T07:54:18.074 DEBUG:teuthology.parallel:result is None 2023-10-01T07:54:18.085 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705695 for osd.3 2023-10-01T07:54:18.085 DEBUG:teuthology.parallel:result is None 2023-10-01T07:54:18.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.101+0000 7fbe9adcc700 1 -- 172.21.15.26:0/962076104 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbe940a1be0 con 0x7fbe9409e1d0 2023-10-01T07:54:18.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.101+0000 7fbe917fa700 1 -- 172.21.15.26:0/962076104 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbe80015020 con 0x7fbe9409e1d0 2023-10-01T07:54:18.102 INFO:teuthology.orchestra.run.smithi026.stdout:38654705696 2023-10-01T07:54:18.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.103+0000 7fbe9adcc700 1 -- 172.21.15.26:0/962076104 >> v1:172.21.15.26:6816/126763 conn(0x7fbe7802f480 legacy=0x7fbe78031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:18.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.103+0000 7fbe9adcc700 1 -- 172.21.15.26:0/962076104 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe9409e1d0 msgr2=0x7fbe9411f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:18.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.103+0000 7fbe9adcc700 1 --2- 172.21.15.26:0/962076104 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe9409e1d0 0x7fbe9411f850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000b530 tx=0x7fbe8000b840 comp rx=0 tx=0).stop 2023-10-01T07:54:18.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.103+0000 7fbe9adcc700 1 -- 172.21.15.26:0/962076104 shutdown_connections 2023-10-01T07:54:18.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.103+0000 7fbe9adcc700 1 --2- 172.21.15.26:0/962076104 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe94139170 0x7fbe941c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:18.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.103+0000 7fbe9adcc700 1 --2- 172.21.15.26:0/962076104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe9409d6f0 0x7fbe9411f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:18.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.103+0000 7fbe9adcc700 1 --2- 172.21.15.26:0/962076104 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe9409e1d0 0x7fbe9411f850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:18.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.103+0000 7fbe9adcc700 1 -- 172.21.15.26:0/962076104 >> 172.21.15.26:0/962076104 conn(0x7fbe94066f50 msgr2=0x7fbe94136b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:18.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.103+0000 7fbe9adcc700 1 -- 172.21.15.26:0/962076104 shutdown_connections 2023-10-01T07:54:18.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.103+0000 7fbe9adcc700 1 -- 172.21.15.26:0/962076104 wait complete. 2023-10-01T07:54:18.117 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705696 for osd.1 2023-10-01T07:54:18.117 DEBUG:teuthology.parallel:result is None 2023-10-01T07:54:18.117 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-01T07:54:18.118 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-01T07:54:18.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.296+0000 7f5af7a94700 1 Processor -- start 2023-10-01T07:54:18.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.296+0000 7f5af7a94700 1 -- start start 2023-10-01T07:54:18.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.297+0000 7f5af7a94700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5af0133420 0x7f5af01337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:18.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.297+0000 7f5af7a94700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5af0133e30 0x7f5af012ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:18.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.297+0000 7f5af7a94700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5af006b990 con 0x7f5af0134260 2023-10-01T07:54:18.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.297+0000 7f5af7a94700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af00a0590 con 0x7f5af0133420 2023-10-01T07:54:18.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.297+0000 7f5af7a94700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5af009fb80 con 0x7f5af0133e30 2023-10-01T07:54:18.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.297+0000 7f5af502f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5af0133e30 0x7f5af012ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:18.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.297+0000 7f5af5830700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5af0133420 0x7f5af01337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:18.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.297+0000 7f5af6031700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5af0134260 0x7f5af01304d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48672/0 (socket says 172.21.15.26:48672) 2023-10-01T07:54:18.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.297+0000 7f5af6031700 1 -- 172.21.15.26:0/1724912284 learned_addr learned my addr 172.21.15.26:0/1724912284 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:18.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.297+0000 7f5af502f700 1 -- 172.21.15.26:0/1724912284 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5af0133420 msgr2=0x7f5af01337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:18.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.297+0000 7f5af502f700 1 --2- 172.21.15.26:0/1724912284 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5af0133420 0x7f5af01337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:18.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.297+0000 7f5af502f700 1 -- 172.21.15.26:0/1724912284 >> v1:172.21.15.26:6789/0 conn(0x7f5af0134260 legacy=0x7f5af01304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:18.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.297+0000 7f5af502f700 1 -- 172.21.15.26:0/1724912284 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af00a0030 con 0x7f5af0133e30 2023-10-01T07:54:18.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.297+0000 7f5af5830700 1 --2- 172.21.15.26:0/1724912284 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5af0133420 0x7f5af01337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:18.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.298+0000 7f5af502f700 1 --2- 172.21.15.26:0/1724912284 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5af0133e30 0x7f5af012ff90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0009870 tx=0x7f5ae0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa945fec3bfc3a61 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:18.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.300+0000 7f5af482e700 1 -- 172.21.15.26:0/1724912284 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0011830 con 0x7f5af0133e30 2023-10-01T07:54:18.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.301+0000 7f5af482e700 1 -- 172.21.15.26:0/1724912284 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae0011990 con 0x7f5af0133e30 2023-10-01T07:54:18.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.301+0000 7f5af482e700 1 -- 172.21.15.26:0/1724912284 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0011d20 con 0x7f5af0133e30 2023-10-01T07:54:18.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.301+0000 7f5af7a94700 1 -- 172.21.15.26:0/1724912284 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5af0133e30 msgr2=0x7f5af012ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:18.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.301+0000 7f5af7a94700 1 --2- 172.21.15.26:0/1724912284 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5af0133e30 0x7f5af012ff90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0009870 tx=0x7f5ae0009b80 comp rx=0 tx=0).stop 2023-10-01T07:54:18.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.301+0000 7f5af7a94700 1 -- 172.21.15.26:0/1724912284 shutdown_connections 2023-10-01T07:54:18.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.301+0000 7f5af7a94700 1 --2- 172.21.15.26:0/1724912284 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5af0133420 0x7f5af01337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:18.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.301+0000 7f5af7a94700 1 --2- 172.21.15.26:0/1724912284 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5af0133e30 0x7f5af012ff90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:18.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.301+0000 7f5af7a94700 1 -- 172.21.15.26:0/1724912284 >> 172.21.15.26:0/1724912284 conn(0x7f5af00a4210 msgr2=0x7f5af00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:18.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.301+0000 7f5af7a94700 1 -- 172.21.15.26:0/1724912284 shutdown_connections 2023-10-01T07:54:18.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.301+0000 7f5af7a94700 1 -- 172.21.15.26:0/1724912284 wait complete. 2023-10-01T07:54:18.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.302+0000 7f5af7a94700 1 Processor -- start 2023-10-01T07:54:18.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.303+0000 7f5af7a94700 1 -- start start 2023-10-01T07:54:18.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.303+0000 7f5af7a94700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5af0133420 0x7f5af009c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:18.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.303+0000 7f5af7a94700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5af0133e30 0x7f5af009c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:18.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.303+0000 7f5af7a94700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5af0134260 0x7f5af009ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:18.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.303+0000 7f5af7a94700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af011ff80 con 0x7f5af0133e30 2023-10-01T07:54:18.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.303+0000 7f5af7a94700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af011fa20 con 0x7f5af0134260 2023-10-01T07:54:18.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.303+0000 7f5af7a94700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5af009e050 con 0x7f5af0133420 2023-10-01T07:54:18.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.303+0000 7f5af502f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5af0133e30 0x7f5af009c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:18.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.303+0000 7f5af5830700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5af0133420 0x7f5af009c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:18.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.303+0000 7f5af502f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5af0133e30 0x7f5af009c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38116/0 (socket says 172.21.15.26:38116) 2023-10-01T07:54:18.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.303+0000 7f5af502f700 1 -- 172.21.15.26:0/3288905894 learned_addr learned my addr 172.21.15.26:0/3288905894 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:18.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.303+0000 7f5af5830700 1 --2- 172.21.15.26:0/3288905894 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5af0133420 0x7f5af009c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55740/0 (socket says 172.21.15.26:55740) 2023-10-01T07:54:18.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.303+0000 7f5af6031700 1 --2- 172.21.15.26:0/3288905894 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5af0134260 0x7f5af009ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:18.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.303+0000 7f5af502f700 1 -- 172.21.15.26:0/3288905894 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5af0133420 msgr2=0x7f5af009c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:18.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.303+0000 7f5af502f700 1 --2- 172.21.15.26:0/3288905894 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5af0133420 0x7f5af009c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:18.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.303+0000 7f5af502f700 1 -- 172.21.15.26:0/3288905894 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5af0134260 msgr2=0x7f5af009ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:18.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.303+0000 7f5af502f700 1 --2- 172.21.15.26:0/3288905894 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5af0134260 0x7f5af009ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:18.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.303+0000 7f5af502f700 1 -- 172.21.15.26:0/3288905894 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aec0094a0 con 0x7f5af0133e30 2023-10-01T07:54:18.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.304+0000 7f5af5830700 1 --2- 172.21.15.26:0/3288905894 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5af0133420 0x7f5af009c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:18.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.304+0000 7f5af6031700 1 --2- 172.21.15.26:0/3288905894 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5af0134260 0x7f5af009ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:18.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.304+0000 7f5af502f700 1 --2- 172.21.15.26:0/3288905894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5af0133e30 0x7f5af009c990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0009bc0 tx=0x7f5ae0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:18.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.304+0000 7f5ae67fc700 1 -- 172.21.15.26:0/3288905894 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0004240 con 0x7f5af0133e30 2023-10-01T07:54:18.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.304+0000 7f5ae67fc700 1 -- 172.21.15.26:0/3288905894 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae001f070 con 0x7f5af0133e30 2023-10-01T07:54:18.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.304+0000 7f5ae67fc700 1 -- 172.21.15.26:0/3288905894 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae00045e0 con 0x7f5af0133e30 2023-10-01T07:54:18.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.304+0000 7f5af7a94700 1 -- 172.21.15.26:0/3288905894 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae00094a0 con 0x7f5af0133e30 2023-10-01T07:54:18.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.304+0000 7f5af7a94700 1 -- 172.21.15.26:0/3288905894 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af01209f0 con 0x7f5af0133e30 2023-10-01T07:54:18.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.305+0000 7f5ae67fc700 1 -- 172.21.15.26:0/3288905894 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f5ae0021030 con 0x7f5af0133e30 2023-10-01T07:54:18.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.305+0000 7f5ae67fc700 1 -- 172.21.15.26:0/3288905894 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f5ae0040c80 con 0x7f5af0133e30 2023-10-01T07:54:18.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.305+0000 7f5af7a94700 1 -- 172.21.15.26:0/3288905894 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af011fd70 con 0x7f5af0133e30 2023-10-01T07:54:18.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.310+0000 7f5ae67fc700 1 -- 172.21.15.26:0/3288905894 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5ae001a450 con 0x7f5af0133e30 2023-10-01T07:54:18.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.514+0000 7f5af7a94700 1 -- 172.21.15.26:0/3288905894 --> v1:172.21.15.26:6816/126763 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5af006c350 con 0x7f5ad402f480 2023-10-01T07:54:18.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.522+0000 7f5ae67fc700 1 -- 172.21.15.26:0/3288905894 <== mgr.14101 v1:172.21.15.26:6816/126763 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+270885 (unknown 2965378022 0 4190403224) 0x7f5aec009cc0 con 0x7f5ad402f480 2023-10-01T07:54:18.526 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:54:18.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.526+0000 7f5af7a94700 1 -- 172.21.15.26:0/3288905894 >> v1:172.21.15.26:6816/126763 conn(0x7f5ad402f480 legacy=0x7f5ad4031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:18.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.526+0000 7f5af7a94700 1 -- 172.21.15.26:0/3288905894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5af0133e30 msgr2=0x7f5af009c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:18.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.526+0000 7f5af7a94700 1 --2- 172.21.15.26:0/3288905894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5af0133e30 0x7f5af009c990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0009bc0 tx=0x7f5ae0004750 comp rx=0 tx=0).stop 2023-10-01T07:54:18.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.526+0000 7f5af7a94700 1 -- 172.21.15.26:0/3288905894 shutdown_connections 2023-10-01T07:54:18.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.526+0000 7f5af7a94700 1 --2- 172.21.15.26:0/3288905894 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5af0134260 0x7f5af009ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:18.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.526+0000 7f5af7a94700 1 --2- 172.21.15.26:0/3288905894 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5af0133420 0x7f5af009c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:18.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.526+0000 7f5af7a94700 1 --2- 172.21.15.26:0/3288905894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5af0133e30 0x7f5af009c990 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:18.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.526+0000 7f5af7a94700 1 -- 172.21.15.26:0/3288905894 >> 172.21.15.26:0/3288905894 conn(0x7f5af00a4210 msgr2=0x7f5af00a0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:18.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.526+0000 7f5af7a94700 1 -- 172.21.15.26:0/3288905894 shutdown_connections 2023-10-01T07:54:18.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.526+0000 7f5af7a94700 1 -- 172.21.15.26:0/3288905894 wait complete. 2023-10-01T07:54:18.529 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-01T07:54:18.540 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2023-10-01T07:54:16.819184+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189136,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298224,"statfs":{"total":386547056640,"available":385329381376,"internally_reserved":0,"allocated":770048,"data_stored":262906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.002882"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.699216+0000","last_change":"2023-10-01T07:51:57.340051+0000","last_active":"2023-10-01T07:52:47.699216+0000","last_peered":"2023-10-01T07:52:47.699216+0000","last_clean":"2023-10-01T07:52:47.699216+0000","last_became_active":"2023-10-01T07:51:57.339739+0000","last_became_peered":"2023-10-01T07:51:57.339739+0000","last_unstale":"2023-10-01T07:52:47.699216+0000","last_undegraded":"2023-10-01T07:52:47.699216+0000","last_fullsized":"2023-10-01T07:52:47.699216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.699373+0000","last_change":"2023-10-01T07:51:57.330147+0000","last_active":"2023-10-01T07:52:47.699373+0000","last_peered":"2023-10-01T07:52:47.699373+0000","last_clean":"2023-10-01T07:52:47.699373+0000","last_became_active":"2023-10-01T07:51:57.329793+0000","last_became_peered":"2023-10-01T07:51:57.329793+0000","last_unstale":"2023-10-01T07:52:47.699373+0000","last_undegraded":"2023-10-01T07:52:47.699373+0000","last_fullsized":"2023-10-01T07:52:47.699373+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696580+0000","last_change":"2023-10-01T07:51:57.335404+0000","last_active":"2023-10-01T07:52:47.696580+0000","last_peered":"2023-10-01T07:52:47.696580+0000","last_clean":"2023-10-01T07:52:47.696580+0000","last_became_active":"2023-10-01T07:51:57.329225+0000","last_became_peered":"2023-10-01T07:51:57.329225+0000","last_unstale":"2023-10-01T07:52:47.696580+0000","last_undegraded":"2023-10-01T07:52:47.696580+0000","last_fullsized":"2023-10-01T07:52:47.696580+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696450+0000","last_change":"2023-10-01T07:51:57.332237+0000","last_active":"2023-10-01T07:52:47.696450+0000","last_peered":"2023-10-01T07:52:47.696450+0000","last_clean":"2023-10-01T07:52:47.696450+0000","last_became_active":"2023-10-01T07:51:57.331857+0000","last_became_peered":"2023-10-01T07:51:57.331857+0000","last_unstale":"2023-10-01T07:52:47.696450+0000","last_undegraded":"2023-10-01T07:52:47.696450+0000","last_fullsized":"2023-10-01T07:52:47.696450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696508+0000","last_change":"2023-10-01T07:51:57.326512+0000","last_active":"2023-10-01T07:52:47.696508+0000","last_peered":"2023-10-01T07:52:47.696508+0000","last_clean":"2023-10-01T07:52:47.696508+0000","last_became_active":"2023-10-01T07:51:57.326202+0000","last_became_peered":"2023-10-01T07:51:57.326202+0000","last_unstale":"2023-10-01T07:52:47.696508+0000","last_undegraded":"2023-10-01T07:52:47.696508+0000","last_fullsized":"2023-10-01T07:52:47.696508+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957316+0000","last_change":"2023-10-01T07:51:57.323824+0000","last_active":"2023-10-01T07:52:47.957316+0000","last_peered":"2023-10-01T07:52:47.957316+0000","last_clean":"2023-10-01T07:52:47.957316+0000","last_became_active":"2023-10-01T07:51:57.322857+0000","last_became_peered":"2023-10-01T07:51:57.322857+0000","last_unstale":"2023-10-01T07:52:47.957316+0000","last_undegraded":"2023-10-01T07:52:47.957316+0000","last_fullsized":"2023-10-01T07:52:47.957316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.703317+0000","last_change":"2023-10-01T07:52:47.701643+0000","last_active":"2023-10-01T07:52:47.703317+0000","last_peered":"2023-10-01T07:52:47.703317+0000","last_clean":"2023-10-01T07:52:47.703317+0000","last_became_active":"2023-10-01T07:52:47.701229+0000","last_became_peered":"2023-10-01T07:52:47.701229+0000","last_unstale":"2023-10-01T07:52:47.703317+0000","last_undegraded":"2023-10-01T07:52:47.703317+0000","last_fullsized":"2023-10-01T07:52:47.703317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.955884+0000","last_change":"2023-10-01T07:51:57.323649+0000","last_active":"2023-10-01T07:52:47.955884+0000","last_peered":"2023-10-01T07:52:47.955884+0000","last_clean":"2023-10-01T07:52:47.955884+0000","last_became_active":"2023-10-01T07:51:57.319917+0000","last_became_peered":"2023-10-01T07:51:57.319917+0000","last_unstale":"2023-10-01T07:52:47.955884+0000","last_undegraded":"2023-10-01T07:52:47.955884+0000","last_fullsized":"2023-10-01T07:52:47.955884+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.697190+0000","last_change":"2023-10-01T07:51:57.325845+0000","last_active":"2023-10-01T07:52:47.697190+0000","last_peered":"2023-10-01T07:52:47.697190+0000","last_clean":"2023-10-01T07:52:47.697190+0000","last_became_active":"2023-10-01T07:51:57.325346+0000","last_became_peered":"2023-10-01T07:51:57.325346+0000","last_unstale":"2023-10-01T07:52:47.697190+0000","last_undegraded":"2023-10-01T07:52:47.697190+0000","last_fullsized":"2023-10-01T07:52:47.697190+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.958197+0000","last_change":"2023-10-01T07:51:57.328438+0000","last_active":"2023-10-01T07:52:47.958197+0000","last_peered":"2023-10-01T07:52:47.958197+0000","last_clean":"2023-10-01T07:52:47.958197+0000","last_became_active":"2023-10-01T07:51:57.328128+0000","last_became_peered":"2023-10-01T07:51:57.328128+0000","last_unstale":"2023-10-01T07:52:47.958197+0000","last_undegraded":"2023-10-01T07:52:47.958197+0000","last_fullsized":"2023-10-01T07:52:47.958197+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957395+0000","last_change":"2023-10-01T07:51:57.328650+0000","last_active":"2023-10-01T07:52:47.957395+0000","last_peered":"2023-10-01T07:52:47.957395+0000","last_clean":"2023-10-01T07:52:47.957395+0000","last_became_active":"2023-10-01T07:51:57.328335+0000","last_became_peered":"2023-10-01T07:51:57.328335+0000","last_unstale":"2023-10-01T07:52:47.957395+0000","last_undegraded":"2023-10-01T07:52:47.957395+0000","last_fullsized":"2023-10-01T07:52:47.957395+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.698217+0000","last_change":"2023-10-01T07:51:57.331991+0000","last_active":"2023-10-01T07:52:47.698217+0000","last_peered":"2023-10-01T07:52:47.698217+0000","last_clean":"2023-10-01T07:52:47.698217+0000","last_became_active":"2023-10-01T07:51:57.331698+0000","last_became_peered":"2023-10-01T07:51:57.331698+0000","last_unstale":"2023-10-01T07:52:47.698217+0000","last_undegraded":"2023-10-01T07:52:47.698217+0000","last_fullsized":"2023-10-01T07:52:47.698217+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.698435+0000","last_change":"2023-10-01T07:51:57.342157+0000","last_active":"2023-10-01T07:52:47.698435+0000","last_peered":"2023-10-01T07:52:47.698435+0000","last_clean":"2023-10-01T07:52:47.698435+0000","last_became_active":"2023-10-01T07:51:57.341533+0000","last_became_peered":"2023-10-01T07:51:57.341533+0000","last_unstale":"2023-10-01T07:52:47.698435+0000","last_undegraded":"2023-10-01T07:52:47.698435+0000","last_fullsized":"2023-10-01T07:52:47.698435+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957011+0000","last_change":"2023-10-01T07:51:57.318295+0000","last_active":"2023-10-01T07:52:47.957011+0000","last_peered":"2023-10-01T07:52:47.957011+0000","last_clean":"2023-10-01T07:52:47.957011+0000","last_became_active":"2023-10-01T07:51:57.317972+0000","last_became_peered":"2023-10-01T07:51:57.317972+0000","last_unstale":"2023-10-01T07:52:47.957011+0000","last_undegraded":"2023-10-01T07:52:47.957011+0000","last_fullsized":"2023-10-01T07:52:47.957011+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696289+0000","last_change":"2023-10-01T07:51:57.321137+0000","last_active":"2023-10-01T07:52:47.696289+0000","last_peered":"2023-10-01T07:52:47.696289+0000","last_clean":"2023-10-01T07:52:47.696289+0000","last_became_active":"2023-10-01T07:51:57.320789+0000","last_became_peered":"2023-10-01T07:51:57.320789+0000","last_unstale":"2023-10-01T07:52:47.696289+0000","last_undegraded":"2023-10-01T07:52:47.696289+0000","last_fullsized":"2023-10-01T07:52:47.696289+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.955941+0000","last_change":"2023-10-01T07:51:57.325610+0000","last_active":"2023-10-01T07:52:47.955941+0000","last_peered":"2023-10-01T07:52:47.955941+0000","last_clean":"2023-10-01T07:52:47.955941+0000","last_became_active":"2023-10-01T07:51:57.325322+0000","last_became_peered":"2023-10-01T07:51:57.325322+0000","last_unstale":"2023-10-01T07:52:47.955941+0000","last_undegraded":"2023-10-01T07:52:47.955941+0000","last_fullsized":"2023-10-01T07:52:47.955941+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.697132+0000","last_change":"2023-10-01T07:51:57.325641+0000","last_active":"2023-10-01T07:52:47.697132+0000","last_peered":"2023-10-01T07:52:47.697132+0000","last_clean":"2023-10-01T07:52:47.697132+0000","last_became_active":"2023-10-01T07:51:57.324956+0000","last_became_peered":"2023-10-01T07:51:57.324956+0000","last_unstale":"2023-10-01T07:52:47.697132+0000","last_undegraded":"2023-10-01T07:52:47.697132+0000","last_fullsized":"2023-10-01T07:52:47.697132+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.697056+0000","last_change":"2023-10-01T07:51:57.316882+0000","last_active":"2023-10-01T07:52:47.697056+0000","last_peered":"2023-10-01T07:52:47.697056+0000","last_clean":"2023-10-01T07:52:47.697056+0000","last_became_active":"2023-10-01T07:51:57.316026+0000","last_became_peered":"2023-10-01T07:51:57.316026+0000","last_unstale":"2023-10-01T07:52:47.697056+0000","last_undegraded":"2023-10-01T07:52:47.697056+0000","last_fullsized":"2023-10-01T07:52:47.697056+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.698473+0000","last_change":"2023-10-01T07:51:57.340110+0000","last_active":"2023-10-01T07:52:47.698473+0000","last_peered":"2023-10-01T07:52:47.698473+0000","last_clean":"2023-10-01T07:52:47.698473+0000","last_became_active":"2023-10-01T07:51:57.339795+0000","last_became_peered":"2023-10-01T07:51:57.339795+0000","last_unstale":"2023-10-01T07:52:47.698473+0000","last_undegraded":"2023-10-01T07:52:47.698473+0000","last_fullsized":"2023-10-01T07:52:47.698473+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957553+0000","last_change":"2023-10-01T07:51:57.347691+0000","last_active":"2023-10-01T07:52:47.957553+0000","last_peered":"2023-10-01T07:52:47.957553+0000","last_clean":"2023-10-01T07:52:47.957553+0000","last_became_active":"2023-10-01T07:51:57.347374+0000","last_became_peered":"2023-10-01T07:51:57.347374+0000","last_unstale":"2023-10-01T07:52:47.957553+0000","last_undegraded":"2023-10-01T07:52:47.957553+0000","last_fullsized":"2023-10-01T07:52:47.957553+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.956688+0000","last_change":"2023-10-01T07:51:57.341479+0000","last_active":"2023-10-01T07:52:47.956688+0000","last_peered":"2023-10-01T07:52:47.956688+0000","last_clean":"2023-10-01T07:52:47.956688+0000","last_became_active":"2023-10-01T07:51:57.341064+0000","last_became_peered":"2023-10-01T07:51:57.341064+0000","last_unstale":"2023-10-01T07:52:47.956688+0000","last_undegraded":"2023-10-01T07:52:47.956688+0000","last_fullsized":"2023-10-01T07:52:47.956688+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.695981+0000","last_change":"2023-10-01T07:51:57.332063+0000","last_active":"2023-10-01T07:52:47.695981+0000","last_peered":"2023-10-01T07:52:47.695981+0000","last_clean":"2023-10-01T07:52:47.695981+0000","last_became_active":"2023-10-01T07:51:57.331511+0000","last_became_peered":"2023-10-01T07:51:57.331511+0000","last_unstale":"2023-10-01T07:52:47.695981+0000","last_undegraded":"2023-10-01T07:52:47.695981+0000","last_fullsized":"2023-10-01T07:52:47.695981+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957715+0000","last_change":"2023-10-01T07:51:57.325516+0000","last_active":"2023-10-01T07:52:47.957715+0000","last_peered":"2023-10-01T07:52:47.957715+0000","last_clean":"2023-10-01T07:52:47.957715+0000","last_became_active":"2023-10-01T07:51:57.324549+0000","last_became_peered":"2023-10-01T07:51:57.324549+0000","last_unstale":"2023-10-01T07:52:47.957715+0000","last_undegraded":"2023-10-01T07:52:47.957715+0000","last_fullsized":"2023-10-01T07:52:47.957715+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.955894+0000","last_change":"2023-10-01T07:51:57.334881+0000","last_active":"2023-10-01T07:52:47.955894+0000","last_peered":"2023-10-01T07:52:47.955894+0000","last_clean":"2023-10-01T07:52:47.955894+0000","last_became_active":"2023-10-01T07:51:57.334682+0000","last_became_peered":"2023-10-01T07:51:57.334682+0000","last_unstale":"2023-10-01T07:52:47.955894+0000","last_undegraded":"2023-10-01T07:52:47.955894+0000","last_fullsized":"2023-10-01T07:52:47.955894+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.958724+0000","last_change":"2023-10-01T07:51:57.334700+0000","last_active":"2023-10-01T07:52:47.958724+0000","last_peered":"2023-10-01T07:52:47.958724+0000","last_clean":"2023-10-01T07:52:47.958724+0000","last_became_active":"2023-10-01T07:51:57.334406+0000","last_became_peered":"2023-10-01T07:51:57.334406+0000","last_unstale":"2023-10-01T07:52:47.958724+0000","last_undegraded":"2023-10-01T07:52:47.958724+0000","last_fullsized":"2023-10-01T07:52:47.958724+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.958110+0000","last_change":"2023-10-01T07:51:57.323470+0000","last_active":"2023-10-01T07:52:47.958110+0000","last_peered":"2023-10-01T07:52:47.958110+0000","last_clean":"2023-10-01T07:52:47.958110+0000","last_became_active":"2023-10-01T07:51:57.323181+0000","last_became_peered":"2023-10-01T07:51:57.323181+0000","last_unstale":"2023-10-01T07:52:47.958110+0000","last_undegraded":"2023-10-01T07:52:47.958110+0000","last_fullsized":"2023-10-01T07:52:47.958110+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957968+0000","last_change":"2023-10-01T07:51:57.339412+0000","last_active":"2023-10-01T07:52:47.957968+0000","last_peered":"2023-10-01T07:52:47.957968+0000","last_clean":"2023-10-01T07:52:47.957968+0000","last_became_active":"2023-10-01T07:51:57.338796+0000","last_became_peered":"2023-10-01T07:51:57.338796+0000","last_unstale":"2023-10-01T07:52:47.957968+0000","last_undegraded":"2023-10-01T07:52:47.957968+0000","last_fullsized":"2023-10-01T07:52:47.957968+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.956627+0000","last_change":"2023-10-01T07:51:56.911245+0000","last_active":"2023-10-01T07:52:47.956627+0000","last_peered":"2023-10-01T07:52:47.956627+0000","last_clean":"2023-10-01T07:52:47.956627+0000","last_became_active":"2023-10-01T07:51:56.910930+0000","last_became_peered":"2023-10-01T07:51:56.910930+0000","last_unstale":"2023-10-01T07:52:47.956627+0000","last_undegraded":"2023-10-01T07:52:47.956627+0000","last_fullsized":"2023-10-01T07:52:47.956627+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.958113+0000","last_change":"2023-10-01T07:51:57.343694+0000","last_active":"2023-10-01T07:52:47.958113+0000","last_peered":"2023-10-01T07:52:47.958113+0000","last_clean":"2023-10-01T07:52:47.958113+0000","last_became_active":"2023-10-01T07:51:57.343082+0000","last_became_peered":"2023-10-01T07:51:57.343082+0000","last_unstale":"2023-10-01T07:52:47.958113+0000","last_undegraded":"2023-10-01T07:52:47.958113+0000","last_fullsized":"2023-10-01T07:52:47.958113+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.956510+0000","last_change":"2023-10-01T07:51:56.919246+0000","last_active":"2023-10-01T07:52:47.956510+0000","last_peered":"2023-10-01T07:52:47.956510+0000","last_clean":"2023-10-01T07:52:47.956510+0000","last_became_active":"2023-10-01T07:51:56.918962+0000","last_became_peered":"2023-10-01T07:51:56.918962+0000","last_unstale":"2023-10-01T07:52:47.956510+0000","last_undegraded":"2023-10-01T07:52:47.956510+0000","last_fullsized":"2023-10-01T07:52:47.956510+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696829+0000","last_change":"2023-10-01T07:51:57.335143+0000","last_active":"2023-10-01T07:52:47.696829+0000","last_peered":"2023-10-01T07:52:47.696829+0000","last_clean":"2023-10-01T07:52:47.696829+0000","last_became_active":"2023-10-01T07:51:57.334730+0000","last_became_peered":"2023-10-01T07:51:57.334730+0000","last_unstale":"2023-10-01T07:52:47.696829+0000","last_undegraded":"2023-10-01T07:52:47.696829+0000","last_fullsized":"2023-10-01T07:52:47.696829+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.956361+0000","last_change":"2023-10-01T07:51:56.914663+0000","last_active":"2023-10-01T07:52:47.956361+0000","last_peered":"2023-10-01T07:52:47.956361+0000","last_clean":"2023-10-01T07:52:47.956361+0000","last_became_active":"2023-10-01T07:51:56.914321+0000","last_became_peered":"2023-10-01T07:51:56.914321+0000","last_unstale":"2023-10-01T07:52:47.956361+0000","last_undegraded":"2023-10-01T07:52:47.956361+0000","last_fullsized":"2023-10-01T07:52:47.956361+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.958903+0000","last_change":"2023-10-01T07:51:57.345818+0000","last_active":"2023-10-01T07:52:47.958903+0000","last_peered":"2023-10-01T07:52:47.958903+0000","last_clean":"2023-10-01T07:52:47.958903+0000","last_became_active":"2023-10-01T07:51:57.345561+0000","last_became_peered":"2023-10-01T07:51:57.345561+0000","last_unstale":"2023-10-01T07:52:47.958903+0000","last_undegraded":"2023-10-01T07:52:47.958903+0000","last_fullsized":"2023-10-01T07:52:47.958903+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.697239+0000","last_change":"2023-10-01T07:51:56.916086+0000","last_active":"2023-10-01T07:52:47.697239+0000","last_peered":"2023-10-01T07:52:47.697239+0000","last_clean":"2023-10-01T07:52:47.697239+0000","last_became_active":"2023-10-01T07:51:56.912164+0000","last_became_peered":"2023-10-01T07:51:56.912164+0000","last_unstale":"2023-10-01T07:52:47.697239+0000","last_undegraded":"2023-10-01T07:52:47.697239+0000","last_fullsized":"2023-10-01T07:52:47.697239+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.956404+0000","last_change":"2023-10-01T07:51:57.340361+0000","last_active":"2023-10-01T07:52:47.956404+0000","last_peered":"2023-10-01T07:52:47.956404+0000","last_clean":"2023-10-01T07:52:47.956404+0000","last_became_active":"2023-10-01T07:51:57.339753+0000","last_became_peered":"2023-10-01T07:51:57.339753+0000","last_unstale":"2023-10-01T07:52:47.956404+0000","last_undegraded":"2023-10-01T07:52:47.956404+0000","last_fullsized":"2023-10-01T07:52:47.956404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.699206+0000","last_change":"2023-10-01T07:51:56.917428+0000","last_active":"2023-10-01T07:52:47.699206+0000","last_peered":"2023-10-01T07:52:47.699206+0000","last_clean":"2023-10-01T07:52:47.699206+0000","last_became_active":"2023-10-01T07:51:56.916781+0000","last_became_peered":"2023-10-01T07:51:56.916781+0000","last_unstale":"2023-10-01T07:52:47.699206+0000","last_undegraded":"2023-10-01T07:52:47.699206+0000","last_fullsized":"2023-10-01T07:52:47.699206+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.958191+0000","last_change":"2023-10-01T07:51:57.339022+0000","last_active":"2023-10-01T07:52:47.958191+0000","last_peered":"2023-10-01T07:52:47.958191+0000","last_clean":"2023-10-01T07:52:47.958191+0000","last_became_active":"2023-10-01T07:51:57.338710+0000","last_became_peered":"2023-10-01T07:51:57.338710+0000","last_unstale":"2023-10-01T07:52:47.958191+0000","last_undegraded":"2023-10-01T07:52:47.958191+0000","last_fullsized":"2023-10-01T07:52:47.958191+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696536+0000","last_change":"2023-10-01T07:51:56.914774+0000","last_active":"2023-10-01T07:52:47.696536+0000","last_peered":"2023-10-01T07:52:47.696536+0000","last_clean":"2023-10-01T07:52:47.696536+0000","last_became_active":"2023-10-01T07:51:56.912021+0000","last_became_peered":"2023-10-01T07:51:56.912021+0000","last_unstale":"2023-10-01T07:52:47.696536+0000","last_undegraded":"2023-10-01T07:52:47.696536+0000","last_fullsized":"2023-10-01T07:52:47.696536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.956813+0000","last_change":"2023-10-01T07:51:57.331183+0000","last_active":"2023-10-01T07:52:47.956813+0000","last_peered":"2023-10-01T07:52:47.956813+0000","last_clean":"2023-10-01T07:52:47.956813+0000","last_became_active":"2023-10-01T07:51:57.330934+0000","last_became_peered":"2023-10-01T07:51:57.330934+0000","last_unstale":"2023-10-01T07:52:47.956813+0000","last_undegraded":"2023-10-01T07:52:47.956813+0000","last_fullsized":"2023-10-01T07:52:47.956813+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'12","reported_seq":26,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-01T07:54:14.899108+0000","last_change":"2023-10-01T07:51:56.925053+0000","last_active":"2023-10-01T07:54:14.899108+0000","last_peered":"2023-10-01T07:54:14.899108+0000","last_clean":"2023-10-01T07:54:14.899108+0000","last_became_active":"2023-10-01T07:51:56.924755+0000","last_became_peered":"2023-10-01T07:51:56.924755+0000","last_unstale":"2023-10-01T07:54:14.899108+0000","last_undegraded":"2023-10-01T07:54:14.899108+0000","last_fullsized":"2023-10-01T07:54:14.899108+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3563,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.698535+0000","last_change":"2023-10-01T07:51:57.341789+0000","last_active":"2023-10-01T07:52:47.698535+0000","last_peered":"2023-10-01T07:52:47.698535+0000","last_clean":"2023-10-01T07:52:47.698535+0000","last_became_active":"2023-10-01T07:51:57.340852+0000","last_became_peered":"2023-10-01T07:51:57.340852+0000","last_unstale":"2023-10-01T07:52:47.698535+0000","last_undegraded":"2023-10-01T07:52:47.698535+0000","last_fullsized":"2023-10-01T07:52:47.698535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957159+0000","last_change":"2023-10-01T07:51:56.924181+0000","last_active":"2023-10-01T07:52:47.957159+0000","last_peered":"2023-10-01T07:52:47.957159+0000","last_clean":"2023-10-01T07:52:47.957159+0000","last_became_active":"2023-10-01T07:51:56.923560+0000","last_became_peered":"2023-10-01T07:51:56.923560+0000","last_unstale":"2023-10-01T07:52:47.957159+0000","last_undegraded":"2023-10-01T07:52:47.957159+0000","last_fullsized":"2023-10-01T07:52:47.957159+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957659+0000","last_change":"2023-10-01T07:51:57.341678+0000","last_active":"2023-10-01T07:52:47.957659+0000","last_peered":"2023-10-01T07:52:47.957659+0000","last_clean":"2023-10-01T07:52:47.957659+0000","last_became_active":"2023-10-01T07:51:57.339190+0000","last_became_peered":"2023-10-01T07:51:57.339190+0000","last_unstale":"2023-10-01T07:52:47.957659+0000","last_undegraded":"2023-10-01T07:52:47.957659+0000","last_fullsized":"2023-10-01T07:52:47.957659+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696089+0000","last_change":"2023-10-01T07:51:56.915181+0000","last_active":"2023-10-01T07:52:47.696089+0000","last_peered":"2023-10-01T07:52:47.696089+0000","last_clean":"2023-10-01T07:52:47.696089+0000","last_became_active":"2023-10-01T07:51:56.914858+0000","last_became_peered":"2023-10-01T07:51:56.914858+0000","last_unstale":"2023-10-01T07:52:47.696089+0000","last_undegraded":"2023-10-01T07:52:47.696089+0000","last_fullsized":"2023-10-01T07:52:47.696089+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.958227+0000","last_change":"2023-10-01T07:51:57.339439+0000","last_active":"2023-10-01T07:52:47.958227+0000","last_peered":"2023-10-01T07:52:47.958227+0000","last_clean":"2023-10-01T07:52:47.958227+0000","last_became_active":"2023-10-01T07:51:57.339208+0000","last_became_peered":"2023-10-01T07:51:57.339208+0000","last_unstale":"2023-10-01T07:52:47.958227+0000","last_undegraded":"2023-10-01T07:52:47.958227+0000","last_fullsized":"2023-10-01T07:52:47.958227+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.958097+0000","last_change":"2023-10-01T07:51:56.926432+0000","last_active":"2023-10-01T07:52:47.958097+0000","last_peered":"2023-10-01T07:52:47.958097+0000","last_clean":"2023-10-01T07:52:47.958097+0000","last_became_active":"2023-10-01T07:51:56.926080+0000","last_became_peered":"2023-10-01T07:51:56.926080+0000","last_unstale":"2023-10-01T07:52:47.958097+0000","last_undegraded":"2023-10-01T07:52:47.958097+0000","last_fullsized":"2023-10-01T07:52:47.958097+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696936+0000","last_change":"2023-10-01T07:51:57.325464+0000","last_active":"2023-10-01T07:52:47.696936+0000","last_peered":"2023-10-01T07:52:47.696936+0000","last_clean":"2023-10-01T07:52:47.696936+0000","last_became_active":"2023-10-01T07:51:57.325143+0000","last_became_peered":"2023-10-01T07:51:57.325143+0000","last_unstale":"2023-10-01T07:52:47.696936+0000","last_undegraded":"2023-10-01T07:52:47.696936+0000","last_fullsized":"2023-10-01T07:52:47.696936+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.956272+0000","last_change":"2023-10-01T07:51:56.922808+0000","last_active":"2023-10-01T07:52:47.956272+0000","last_peered":"2023-10-01T07:52:47.956272+0000","last_clean":"2023-10-01T07:52:47.956272+0000","last_became_active":"2023-10-01T07:51:56.922520+0000","last_became_peered":"2023-10-01T07:51:56.922520+0000","last_unstale":"2023-10-01T07:52:47.956272+0000","last_undegraded":"2023-10-01T07:52:47.956272+0000","last_fullsized":"2023-10-01T07:52:47.956272+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.958792+0000","last_change":"2023-10-01T07:51:57.346026+0000","last_active":"2023-10-01T07:52:47.958792+0000","last_peered":"2023-10-01T07:52:47.958792+0000","last_clean":"2023-10-01T07:52:47.958792+0000","last_became_active":"2023-10-01T07:51:57.345720+0000","last_became_peered":"2023-10-01T07:51:57.345720+0000","last_unstale":"2023-10-01T07:52:47.958792+0000","last_undegraded":"2023-10-01T07:52:47.958792+0000","last_fullsized":"2023-10-01T07:52:47.958792+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696794+0000","last_change":"2023-10-01T07:51:56.922474+0000","last_active":"2023-10-01T07:52:47.696794+0000","last_peered":"2023-10-01T07:52:47.696794+0000","last_clean":"2023-10-01T07:52:47.696794+0000","last_became_active":"2023-10-01T07:51:56.921742+0000","last_became_peered":"2023-10-01T07:51:56.921742+0000","last_unstale":"2023-10-01T07:52:47.696794+0000","last_undegraded":"2023-10-01T07:52:47.696794+0000","last_fullsized":"2023-10-01T07:52:47.696794+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.956454+0000","last_change":"2023-10-01T07:51:57.340546+0000","last_active":"2023-10-01T07:52:47.956454+0000","last_peered":"2023-10-01T07:52:47.956454+0000","last_clean":"2023-10-01T07:52:47.956454+0000","last_became_active":"2023-10-01T07:51:57.340112+0000","last_became_peered":"2023-10-01T07:51:57.340112+0000","last_unstale":"2023-10-01T07:52:47.956454+0000","last_undegraded":"2023-10-01T07:52:47.956454+0000","last_fullsized":"2023-10-01T07:52:47.956454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.699264+0000","last_change":"2023-10-01T07:51:56.917629+0000","last_active":"2023-10-01T07:52:47.699264+0000","last_peered":"2023-10-01T07:52:47.699264+0000","last_clean":"2023-10-01T07:52:47.699264+0000","last_became_active":"2023-10-01T07:51:56.917154+0000","last_became_peered":"2023-10-01T07:51:56.917154+0000","last_unstale":"2023-10-01T07:52:47.699264+0000","last_undegraded":"2023-10-01T07:52:47.699264+0000","last_fullsized":"2023-10-01T07:52:47.699264+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.956751+0000","last_change":"2023-10-01T07:51:57.340793+0000","last_active":"2023-10-01T07:52:47.956751+0000","last_peered":"2023-10-01T07:52:47.956751+0000","last_clean":"2023-10-01T07:52:47.956751+0000","last_became_active":"2023-10-01T07:51:57.340504+0000","last_became_peered":"2023-10-01T07:51:57.340504+0000","last_unstale":"2023-10-01T07:52:47.956751+0000","last_undegraded":"2023-10-01T07:52:47.956751+0000","last_fullsized":"2023-10-01T07:52:47.956751+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.958465+0000","last_change":"2023-10-01T07:51:56.925699+0000","last_active":"2023-10-01T07:52:47.958465+0000","last_peered":"2023-10-01T07:52:47.958465+0000","last_clean":"2023-10-01T07:52:47.958465+0000","last_became_active":"2023-10-01T07:51:56.925216+0000","last_became_peered":"2023-10-01T07:51:56.925216+0000","last_unstale":"2023-10-01T07:52:47.958465+0000","last_undegraded":"2023-10-01T07:52:47.958465+0000","last_fullsized":"2023-10-01T07:52:47.958465+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.703331+0000","last_change":"2023-10-01T07:52:47.701820+0000","last_active":"2023-10-01T07:52:47.703331+0000","last_peered":"2023-10-01T07:52:47.703331+0000","last_clean":"2023-10-01T07:52:47.703331+0000","last_became_active":"2023-10-01T07:52:47.701336+0000","last_became_peered":"2023-10-01T07:52:47.701336+0000","last_unstale":"2023-10-01T07:52:47.703331+0000","last_undegraded":"2023-10-01T07:52:47.703331+0000","last_fullsized":"2023-10-01T07:52:47.703331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696777+0000","last_change":"2023-10-01T07:51:56.915532+0000","last_active":"2023-10-01T07:52:47.696777+0000","last_peered":"2023-10-01T07:52:47.696777+0000","last_clean":"2023-10-01T07:52:47.696777+0000","last_became_active":"2023-10-01T07:51:56.912225+0000","last_became_peered":"2023-10-01T07:51:56.912225+0000","last_unstale":"2023-10-01T07:52:47.696777+0000","last_undegraded":"2023-10-01T07:52:47.696777+0000","last_fullsized":"2023-10-01T07:52:47.696777+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696534+0000","last_change":"2023-10-01T07:51:57.331858+0000","last_active":"2023-10-01T07:52:47.696534+0000","last_peered":"2023-10-01T07:52:47.696534+0000","last_clean":"2023-10-01T07:52:47.696534+0000","last_became_active":"2023-10-01T07:51:57.331568+0000","last_became_peered":"2023-10-01T07:51:57.331568+0000","last_unstale":"2023-10-01T07:52:47.696534+0000","last_undegraded":"2023-10-01T07:52:47.696534+0000","last_fullsized":"2023-10-01T07:52:47.696534+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957094+0000","last_change":"2023-10-01T07:51:56.924345+0000","last_active":"2023-10-01T07:52:47.957094+0000","last_peered":"2023-10-01T07:52:47.957094+0000","last_clean":"2023-10-01T07:52:47.957094+0000","last_became_active":"2023-10-01T07:51:56.923915+0000","last_became_peered":"2023-10-01T07:51:56.923915+0000","last_unstale":"2023-10-01T07:52:47.957094+0000","last_undegraded":"2023-10-01T07:52:47.957094+0000","last_fullsized":"2023-10-01T07:52:47.957094+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696658+0000","last_change":"2023-10-01T07:51:57.326926+0000","last_active":"2023-10-01T07:52:47.696658+0000","last_peered":"2023-10-01T07:52:47.696658+0000","last_clean":"2023-10-01T07:52:47.696658+0000","last_became_active":"2023-10-01T07:51:57.326597+0000","last_became_peered":"2023-10-01T07:51:57.326597+0000","last_unstale":"2023-10-01T07:52:47.696658+0000","last_undegraded":"2023-10-01T07:52:47.696658+0000","last_fullsized":"2023-10-01T07:52:47.696658+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957127+0000","last_change":"2023-10-01T07:51:56.918471+0000","last_active":"2023-10-01T07:52:47.957127+0000","last_peered":"2023-10-01T07:52:47.957127+0000","last_clean":"2023-10-01T07:52:47.957127+0000","last_became_active":"2023-10-01T07:51:56.918165+0000","last_became_peered":"2023-10-01T07:51:56.918165+0000","last_unstale":"2023-10-01T07:52:47.957127+0000","last_undegraded":"2023-10-01T07:52:47.957127+0000","last_fullsized":"2023-10-01T07:52:47.957127+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.958356+0000","last_change":"2023-10-01T07:51:57.338218+0000","last_active":"2023-10-01T07:52:47.958356+0000","last_peered":"2023-10-01T07:52:47.958356+0000","last_clean":"2023-10-01T07:52:47.958356+0000","last_became_active":"2023-10-01T07:51:57.337910+0000","last_became_peered":"2023-10-01T07:51:57.337910+0000","last_unstale":"2023-10-01T07:52:47.958356+0000","last_undegraded":"2023-10-01T07:52:47.958356+0000","last_fullsized":"2023-10-01T07:52:47.958356+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957841+0000","last_change":"2023-10-01T07:51:56.926078+0000","last_active":"2023-10-01T07:52:47.957841+0000","last_peered":"2023-10-01T07:52:47.957841+0000","last_clean":"2023-10-01T07:52:47.957841+0000","last_became_active":"2023-10-01T07:51:56.925681+0000","last_became_peered":"2023-10-01T07:51:56.925681+0000","last_unstale":"2023-10-01T07:52:47.957841+0000","last_undegraded":"2023-10-01T07:52:47.957841+0000","last_fullsized":"2023-10-01T07:52:47.957841+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.703392+0000","last_change":"2023-10-01T07:52:47.702019+0000","last_active":"2023-10-01T07:52:47.703392+0000","last_peered":"2023-10-01T07:52:47.703392+0000","last_clean":"2023-10-01T07:52:47.703392+0000","last_became_active":"2023-10-01T07:52:47.701477+0000","last_became_peered":"2023-10-01T07:52:47.701477+0000","last_unstale":"2023-10-01T07:52:47.703392+0000","last_undegraded":"2023-10-01T07:52:47.703392+0000","last_fullsized":"2023-10-01T07:52:47.703392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.956060+0000","last_change":"2023-10-01T07:51:56.918564+0000","last_active":"2023-10-01T07:52:47.956060+0000","last_peered":"2023-10-01T07:52:47.956060+0000","last_clean":"2023-10-01T07:52:47.956060+0000","last_became_active":"2023-10-01T07:51:56.918275+0000","last_became_peered":"2023-10-01T07:51:56.918275+0000","last_unstale":"2023-10-01T07:52:47.956060+0000","last_undegraded":"2023-10-01T07:52:47.956060+0000","last_fullsized":"2023-10-01T07:52:47.956060+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.958567+0000","last_change":"2023-10-01T07:51:57.347574+0000","last_active":"2023-10-01T07:52:47.958567+0000","last_peered":"2023-10-01T07:52:47.958567+0000","last_clean":"2023-10-01T07:52:47.958567+0000","last_became_active":"2023-10-01T07:51:57.347243+0000","last_became_peered":"2023-10-01T07:51:57.347243+0000","last_unstale":"2023-10-01T07:52:47.958567+0000","last_undegraded":"2023-10-01T07:52:47.958567+0000","last_fullsized":"2023-10-01T07:52:47.958567+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.955885+0000","last_change":"2023-10-01T07:51:51.883413+0000","last_active":"2023-10-01T07:52:47.955885+0000","last_peered":"2023-10-01T07:52:47.955885+0000","last_clean":"2023-10-01T07:52:47.955885+0000","last_became_active":"2023-10-01T07:51:51.883088+0000","last_became_peered":"2023-10-01T07:51:51.883088+0000","last_unstale":"2023-10-01T07:52:47.955885+0000","last_undegraded":"2023-10-01T07:52:47.955885+0000","last_fullsized":"2023-10-01T07:52:47.955885+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.698357+0000","last_change":"2023-10-01T07:51:56.914139+0000","last_active":"2023-10-01T07:52:47.698357+0000","last_peered":"2023-10-01T07:52:47.698357+0000","last_clean":"2023-10-01T07:52:47.698357+0000","last_became_active":"2023-10-01T07:51:56.913026+0000","last_became_peered":"2023-10-01T07:51:56.913026+0000","last_unstale":"2023-10-01T07:52:47.698357+0000","last_undegraded":"2023-10-01T07:52:47.698357+0000","last_fullsized":"2023-10-01T07:52:47.698357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.956873+0000","last_change":"2023-10-01T07:51:57.334103+0000","last_active":"2023-10-01T07:52:47.956873+0000","last_peered":"2023-10-01T07:52:47.956873+0000","last_clean":"2023-10-01T07:52:47.956873+0000","last_became_active":"2023-10-01T07:51:57.333743+0000","last_became_peered":"2023-10-01T07:51:57.333743+0000","last_unstale":"2023-10-01T07:52:47.956873+0000","last_undegraded":"2023-10-01T07:52:47.956873+0000","last_fullsized":"2023-10-01T07:52:47.956873+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957212+0000","last_change":"2023-10-01T07:51:51.882685+0000","last_active":"2023-10-01T07:52:47.957212+0000","last_peered":"2023-10-01T07:52:47.957212+0000","last_clean":"2023-10-01T07:52:47.957212+0000","last_became_active":"2023-10-01T07:51:51.882396+0000","last_became_peered":"2023-10-01T07:51:51.882396+0000","last_unstale":"2023-10-01T07:52:47.957212+0000","last_undegraded":"2023-10-01T07:52:47.957212+0000","last_fullsized":"2023-10-01T07:52:47.957212+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696142+0000","last_change":"2023-10-01T07:51:56.915631+0000","last_active":"2023-10-01T07:52:47.696142+0000","last_peered":"2023-10-01T07:52:47.696142+0000","last_clean":"2023-10-01T07:52:47.696142+0000","last_became_active":"2023-10-01T07:51:56.911566+0000","last_became_peered":"2023-10-01T07:51:56.911566+0000","last_unstale":"2023-10-01T07:52:47.696142+0000","last_undegraded":"2023-10-01T07:52:47.696142+0000","last_fullsized":"2023-10-01T07:52:47.696142+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957246+0000","last_change":"2023-10-01T07:51:57.319612+0000","last_active":"2023-10-01T07:52:47.957246+0000","last_peered":"2023-10-01T07:52:47.957246+0000","last_clean":"2023-10-01T07:52:47.957246+0000","last_became_active":"2023-10-01T07:51:57.319125+0000","last_became_peered":"2023-10-01T07:51:57.319125+0000","last_unstale":"2023-10-01T07:52:47.957246+0000","last_undegraded":"2023-10-01T07:52:47.957246+0000","last_fullsized":"2023-10-01T07:52:47.957246+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.698762+0000","last_change":"2023-10-01T07:51:51.885336+0000","last_active":"2023-10-01T07:52:47.698762+0000","last_peered":"2023-10-01T07:52:47.698762+0000","last_clean":"2023-10-01T07:52:47.698762+0000","last_became_active":"2023-10-01T07:51:51.884991+0000","last_became_peered":"2023-10-01T07:51:51.884991+0000","last_unstale":"2023-10-01T07:52:47.698762+0000","last_undegraded":"2023-10-01T07:52:47.698762+0000","last_fullsized":"2023-10-01T07:52:47.698762+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.956099+0000","last_change":"2023-10-01T07:51:56.929636+0000","last_active":"2023-10-01T07:52:47.956099+0000","last_peered":"2023-10-01T07:52:47.956099+0000","last_clean":"2023-10-01T07:52:47.956099+0000","last_became_active":"2023-10-01T07:51:56.929308+0000","last_became_peered":"2023-10-01T07:51:56.929308+0000","last_unstale":"2023-10-01T07:52:47.956099+0000","last_undegraded":"2023-10-01T07:52:47.956099+0000","last_fullsized":"2023-10-01T07:52:47.956099+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.702622+0000","last_change":"2023-10-01T07:52:47.701115+0000","last_active":"2023-10-01T07:52:47.702622+0000","last_peered":"2023-10-01T07:52:47.702622+0000","last_clean":"2023-10-01T07:52:47.702622+0000","last_became_active":"2023-10-01T07:52:47.700737+0000","last_became_peered":"2023-10-01T07:52:47.700737+0000","last_unstale":"2023-10-01T07:52:47.702622+0000","last_undegraded":"2023-10-01T07:52:47.702622+0000","last_fullsized":"2023-10-01T07:52:47.702622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.955427+0000","last_change":"2023-10-01T07:51:51.882657+0000","last_active":"2023-10-01T07:52:47.955427+0000","last_peered":"2023-10-01T07:52:47.955427+0000","last_clean":"2023-10-01T07:52:47.955427+0000","last_became_active":"2023-10-01T07:51:51.882334+0000","last_became_peered":"2023-10-01T07:51:51.882334+0000","last_unstale":"2023-10-01T07:52:47.955427+0000","last_undegraded":"2023-10-01T07:52:47.955427+0000","last_fullsized":"2023-10-01T07:52:47.955427+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.956137+0000","last_change":"2023-10-01T07:51:50.871456+0000","last_active":"2023-10-01T07:52:47.956137+0000","last_peered":"2023-10-01T07:52:47.956137+0000","last_clean":"2023-10-01T07:52:47.956137+0000","last_became_active":"2023-10-01T07:51:50.871112+0000","last_became_peered":"2023-10-01T07:51:50.871112+0000","last_unstale":"2023-10-01T07:52:47.956137+0000","last_undegraded":"2023-10-01T07:52:47.956137+0000","last_fullsized":"2023-10-01T07:52:47.956137+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:49.856372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:49.856372+0000","last_clean_scrub_stamp":"2023-10-01T07:51:49.856372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957035+0000","last_change":"2023-10-01T07:51:56.925843+0000","last_active":"2023-10-01T07:52:47.957035+0000","last_peered":"2023-10-01T07:52:47.957035+0000","last_clean":"2023-10-01T07:52:47.957035+0000","last_became_active":"2023-10-01T07:51:56.925538+0000","last_became_peered":"2023-10-01T07:51:56.925538+0000","last_unstale":"2023-10-01T07:52:47.957035+0000","last_undegraded":"2023-10-01T07:52:47.957035+0000","last_fullsized":"2023-10-01T07:52:47.957035+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.960808+0000","last_change":"2023-10-01T07:52:47.959074+0000","last_active":"2023-10-01T07:52:47.960808+0000","last_peered":"2023-10-01T07:52:47.960808+0000","last_clean":"2023-10-01T07:52:47.960808+0000","last_became_active":"2023-10-01T07:52:47.958738+0000","last_became_peered":"2023-10-01T07:52:47.958738+0000","last_unstale":"2023-10-01T07:52:47.960808+0000","last_undegraded":"2023-10-01T07:52:47.960808+0000","last_fullsized":"2023-10-01T07:52:47.960808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.956251+0000","last_change":"2023-10-01T07:51:51.882831+0000","last_active":"2023-10-01T07:52:47.956251+0000","last_peered":"2023-10-01T07:52:47.956251+0000","last_clean":"2023-10-01T07:52:47.956251+0000","last_became_active":"2023-10-01T07:51:51.882490+0000","last_became_peered":"2023-10-01T07:51:51.882490+0000","last_unstale":"2023-10-01T07:52:47.956251+0000","last_undegraded":"2023-10-01T07:52:47.956251+0000","last_fullsized":"2023-10-01T07:52:47.956251+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696165+0000","last_change":"2023-10-01T07:51:56.929720+0000","last_active":"2023-10-01T07:52:47.696165+0000","last_peered":"2023-10-01T07:52:47.696165+0000","last_clean":"2023-10-01T07:52:47.696165+0000","last_became_active":"2023-10-01T07:51:56.929370+0000","last_became_peered":"2023-10-01T07:51:56.929370+0000","last_unstale":"2023-10-01T07:52:47.696165+0000","last_undegraded":"2023-10-01T07:52:47.696165+0000","last_fullsized":"2023-10-01T07:52:47.696165+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696992+0000","last_change":"2023-10-01T07:51:57.335095+0000","last_active":"2023-10-01T07:52:47.696992+0000","last_peered":"2023-10-01T07:52:47.696992+0000","last_clean":"2023-10-01T07:52:47.696992+0000","last_became_active":"2023-10-01T07:51:57.334324+0000","last_became_peered":"2023-10-01T07:51:57.334324+0000","last_unstale":"2023-10-01T07:52:47.696992+0000","last_undegraded":"2023-10-01T07:52:47.696992+0000","last_fullsized":"2023-10-01T07:52:47.696992+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.955620+0000","last_change":"2023-10-01T07:51:51.884196+0000","last_active":"2023-10-01T07:52:47.955620+0000","last_peered":"2023-10-01T07:52:47.955620+0000","last_clean":"2023-10-01T07:52:47.955620+0000","last_became_active":"2023-10-01T07:51:51.883784+0000","last_became_peered":"2023-10-01T07:51:51.883784+0000","last_unstale":"2023-10-01T07:52:47.955620+0000","last_undegraded":"2023-10-01T07:52:47.955620+0000","last_fullsized":"2023-10-01T07:52:47.955620+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957161+0000","last_change":"2023-10-01T07:51:56.913348+0000","last_active":"2023-10-01T07:52:47.957161+0000","last_peered":"2023-10-01T07:52:47.957161+0000","last_clean":"2023-10-01T07:52:47.957161+0000","last_became_active":"2023-10-01T07:51:56.913041+0000","last_became_peered":"2023-10-01T07:51:56.913041+0000","last_unstale":"2023-10-01T07:52:47.957161+0000","last_undegraded":"2023-10-01T07:52:47.957161+0000","last_fullsized":"2023-10-01T07:52:47.957161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696395+0000","last_change":"2023-10-01T07:51:57.313930+0000","last_active":"2023-10-01T07:52:47.696395+0000","last_peered":"2023-10-01T07:52:47.696395+0000","last_clean":"2023-10-01T07:52:47.696395+0000","last_became_active":"2023-10-01T07:51:57.313613+0000","last_became_peered":"2023-10-01T07:51:57.313613+0000","last_unstale":"2023-10-01T07:52:47.696395+0000","last_undegraded":"2023-10-01T07:52:47.696395+0000","last_fullsized":"2023-10-01T07:52:47.696395+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.958516+0000","last_change":"2023-10-01T07:51:56.929769+0000","last_active":"2023-10-01T07:52:47.958516+0000","last_peered":"2023-10-01T07:52:47.958516+0000","last_clean":"2023-10-01T07:52:47.958516+0000","last_became_active":"2023-10-01T07:51:56.929479+0000","last_became_peered":"2023-10-01T07:51:56.929479+0000","last_unstale":"2023-10-01T07:52:47.958516+0000","last_undegraded":"2023-10-01T07:52:47.958516+0000","last_fullsized":"2023-10-01T07:52:47.958516+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.956719+0000","last_change":"2023-10-01T07:51:51.883317+0000","last_active":"2023-10-01T07:52:47.956719+0000","last_peered":"2023-10-01T07:52:47.956719+0000","last_clean":"2023-10-01T07:52:47.956719+0000","last_became_active":"2023-10-01T07:51:51.883005+0000","last_became_peered":"2023-10-01T07:51:51.883005+0000","last_unstale":"2023-10-01T07:52:47.956719+0000","last_undegraded":"2023-10-01T07:52:47.956719+0000","last_fullsized":"2023-10-01T07:52:47.956719+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.961267+0000","last_change":"2023-10-01T07:52:47.959990+0000","last_active":"2023-10-01T07:52:47.961267+0000","last_peered":"2023-10-01T07:52:47.961267+0000","last_clean":"2023-10-01T07:52:47.961267+0000","last_became_active":"2023-10-01T07:52:47.959464+0000","last_became_peered":"2023-10-01T07:52:47.959464+0000","last_unstale":"2023-10-01T07:52:47.961267+0000","last_undegraded":"2023-10-01T07:52:47.961267+0000","last_fullsized":"2023-10-01T07:52:47.961267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.955730+0000","last_change":"2023-10-01T07:51:51.883299+0000","last_active":"2023-10-01T07:52:47.955730+0000","last_peered":"2023-10-01T07:52:47.955730+0000","last_clean":"2023-10-01T07:52:47.955730+0000","last_became_active":"2023-10-01T07:51:51.883001+0000","last_became_peered":"2023-10-01T07:51:51.883001+0000","last_unstale":"2023-10-01T07:52:47.955730+0000","last_undegraded":"2023-10-01T07:52:47.955730+0000","last_fullsized":"2023-10-01T07:52:47.955730+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696819+0000","last_change":"2023-10-01T07:51:56.921291+0000","last_active":"2023-10-01T07:52:47.696819+0000","last_peered":"2023-10-01T07:52:47.696819+0000","last_clean":"2023-10-01T07:52:47.696819+0000","last_became_active":"2023-10-01T07:51:56.920989+0000","last_became_peered":"2023-10-01T07:51:56.920989+0000","last_unstale":"2023-10-01T07:52:47.696819+0000","last_undegraded":"2023-10-01T07:52:47.696819+0000","last_fullsized":"2023-10-01T07:52:47.696819+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.698179+0000","last_change":"2023-10-01T07:51:57.342916+0000","last_active":"2023-10-01T07:52:47.698179+0000","last_peered":"2023-10-01T07:52:47.698179+0000","last_clean":"2023-10-01T07:52:47.698179+0000","last_became_active":"2023-10-01T07:51:57.342653+0000","last_became_peered":"2023-10-01T07:51:57.342653+0000","last_unstale":"2023-10-01T07:52:47.698179+0000","last_undegraded":"2023-10-01T07:52:47.698179+0000","last_fullsized":"2023-10-01T07:52:47.698179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696263+0000","last_change":"2023-10-01T07:51:56.916437+0000","last_active":"2023-10-01T07:52:47.696263+0000","last_peered":"2023-10-01T07:52:47.696263+0000","last_clean":"2023-10-01T07:52:47.696263+0000","last_became_active":"2023-10-01T07:51:56.915935+0000","last_became_peered":"2023-10-01T07:51:56.915935+0000","last_unstale":"2023-10-01T07:52:47.696263+0000","last_undegraded":"2023-10-01T07:52:47.696263+0000","last_fullsized":"2023-10-01T07:52:47.696263+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.698359+0000","last_change":"2023-10-01T07:51:57.330536+0000","last_active":"2023-10-01T07:52:47.698359+0000","last_peered":"2023-10-01T07:52:47.698359+0000","last_clean":"2023-10-01T07:52:47.698359+0000","last_became_active":"2023-10-01T07:51:57.330151+0000","last_became_peered":"2023-10-01T07:51:57.330151+0000","last_unstale":"2023-10-01T07:52:47.698359+0000","last_undegraded":"2023-10-01T07:52:47.698359+0000","last_fullsized":"2023-10-01T07:52:47.698359+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957335+0000","last_change":"2023-10-01T07:51:56.922316+0000","last_active":"2023-10-01T07:52:47.957335+0000","last_peered":"2023-10-01T07:52:47.957335+0000","last_clean":"2023-10-01T07:52:47.957335+0000","last_became_active":"2023-10-01T07:51:56.922003+0000","last_became_peered":"2023-10-01T07:51:56.922003+0000","last_unstale":"2023-10-01T07:52:47.957335+0000","last_undegraded":"2023-10-01T07:52:47.957335+0000","last_fullsized":"2023-10-01T07:52:47.957335+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.703370+0000","last_change":"2023-10-01T07:52:47.702289+0000","last_active":"2023-10-01T07:52:47.703370+0000","last_peered":"2023-10-01T07:52:47.703370+0000","last_clean":"2023-10-01T07:52:47.703370+0000","last_became_active":"2023-10-01T07:52:47.701419+0000","last_became_peered":"2023-10-01T07:52:47.701419+0000","last_unstale":"2023-10-01T07:52:47.703370+0000","last_undegraded":"2023-10-01T07:52:47.703370+0000","last_fullsized":"2023-10-01T07:52:47.703370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.958665+0000","last_change":"2023-10-01T07:51:56.925522+0000","last_active":"2023-10-01T07:52:47.958665+0000","last_peered":"2023-10-01T07:52:47.958665+0000","last_clean":"2023-10-01T07:52:47.958665+0000","last_became_active":"2023-10-01T07:51:56.924830+0000","last_became_peered":"2023-10-01T07:51:56.924830+0000","last_unstale":"2023-10-01T07:52:47.958665+0000","last_undegraded":"2023-10-01T07:52:47.958665+0000","last_fullsized":"2023-10-01T07:52:47.958665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.698045+0000","last_change":"2023-10-01T07:51:57.340653+0000","last_active":"2023-10-01T07:52:47.698045+0000","last_peered":"2023-10-01T07:52:47.698045+0000","last_clean":"2023-10-01T07:52:47.698045+0000","last_became_active":"2023-10-01T07:51:57.340395+0000","last_became_peered":"2023-10-01T07:51:57.340395+0000","last_unstale":"2023-10-01T07:52:47.698045+0000","last_undegraded":"2023-10-01T07:52:47.698045+0000","last_fullsized":"2023-10-01T07:52:47.698045+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.958076+0000","last_change":"2023-10-01T07:51:56.924298+0000","last_active":"2023-10-01T07:52:47.958076+0000","last_peered":"2023-10-01T07:52:47.958076+0000","last_clean":"2023-10-01T07:52:47.958076+0000","last_became_active":"2023-10-01T07:51:56.923975+0000","last_became_peered":"2023-10-01T07:51:56.923975+0000","last_unstale":"2023-10-01T07:52:47.958076+0000","last_undegraded":"2023-10-01T07:52:47.958076+0000","last_fullsized":"2023-10-01T07:52:47.958076+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.958322+0000","last_change":"2023-10-01T07:51:57.339026+0000","last_active":"2023-10-01T07:52:47.958322+0000","last_peered":"2023-10-01T07:52:47.958322+0000","last_clean":"2023-10-01T07:52:47.958322+0000","last_became_active":"2023-10-01T07:51:57.338722+0000","last_became_peered":"2023-10-01T07:51:57.338722+0000","last_unstale":"2023-10-01T07:52:47.958322+0000","last_undegraded":"2023-10-01T07:52:47.958322+0000","last_fullsized":"2023-10-01T07:52:47.958322+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.697059+0000","last_change":"2023-10-01T07:51:56.922677+0000","last_active":"2023-10-01T07:52:47.697059+0000","last_peered":"2023-10-01T07:52:47.697059+0000","last_clean":"2023-10-01T07:52:47.697059+0000","last_became_active":"2023-10-01T07:51:56.922121+0000","last_became_peered":"2023-10-01T07:51:56.922121+0000","last_unstale":"2023-10-01T07:52:47.697059+0000","last_undegraded":"2023-10-01T07:52:47.697059+0000","last_fullsized":"2023-10-01T07:52:47.697059+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.697708+0000","last_change":"2023-10-01T07:51:57.329519+0000","last_active":"2023-10-01T07:52:47.697708+0000","last_peered":"2023-10-01T07:52:47.697708+0000","last_clean":"2023-10-01T07:52:47.697708+0000","last_became_active":"2023-10-01T07:51:57.329191+0000","last_became_peered":"2023-10-01T07:51:57.329191+0000","last_unstale":"2023-10-01T07:52:47.697708+0000","last_undegraded":"2023-10-01T07:52:47.697708+0000","last_fullsized":"2023-10-01T07:52:47.697708+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.956230+0000","last_change":"2023-10-01T07:51:57.320100+0000","last_active":"2023-10-01T07:52:47.956230+0000","last_peered":"2023-10-01T07:52:47.956230+0000","last_clean":"2023-10-01T07:52:47.956230+0000","last_became_active":"2023-10-01T07:51:57.319593+0000","last_became_peered":"2023-10-01T07:51:57.319593+0000","last_unstale":"2023-10-01T07:52:47.956230+0000","last_undegraded":"2023-10-01T07:52:47.956230+0000","last_fullsized":"2023-10-01T07:52:47.956230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.961188+0000","last_change":"2023-10-01T07:52:47.959972+0000","last_active":"2023-10-01T07:52:47.961188+0000","last_peered":"2023-10-01T07:52:47.961188+0000","last_clean":"2023-10-01T07:52:47.961188+0000","last_became_active":"2023-10-01T07:52:47.959512+0000","last_became_peered":"2023-10-01T07:52:47.959512+0000","last_unstale":"2023-10-01T07:52:47.961188+0000","last_undegraded":"2023-10-01T07:52:47.961188+0000","last_fullsized":"2023-10-01T07:52:47.961188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696217+0000","last_change":"2023-10-01T07:51:57.326270+0000","last_active":"2023-10-01T07:52:47.696217+0000","last_peered":"2023-10-01T07:52:47.696217+0000","last_clean":"2023-10-01T07:52:47.696217+0000","last_became_active":"2023-10-01T07:51:57.325956+0000","last_became_peered":"2023-10-01T07:51:57.325956+0000","last_unstale":"2023-10-01T07:52:47.696217+0000","last_undegraded":"2023-10-01T07:52:47.696217+0000","last_fullsized":"2023-10-01T07:52:47.696217+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957281+0000","last_change":"2023-10-01T07:51:57.338041+0000","last_active":"2023-10-01T07:52:47.957281+0000","last_peered":"2023-10-01T07:52:47.957281+0000","last_clean":"2023-10-01T07:52:47.957281+0000","last_became_active":"2023-10-01T07:51:57.337719+0000","last_became_peered":"2023-10-01T07:51:57.337719+0000","last_unstale":"2023-10-01T07:52:47.957281+0000","last_undegraded":"2023-10-01T07:52:47.957281+0000","last_fullsized":"2023-10-01T07:52:47.957281+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957438+0000","last_change":"2023-10-01T07:51:57.319429+0000","last_active":"2023-10-01T07:52:47.957438+0000","last_peered":"2023-10-01T07:52:47.957438+0000","last_clean":"2023-10-01T07:52:47.957438+0000","last_became_active":"2023-10-01T07:51:57.318849+0000","last_became_peered":"2023-10-01T07:51:57.318849+0000","last_unstale":"2023-10-01T07:52:47.957438+0000","last_undegraded":"2023-10-01T07:52:47.957438+0000","last_fullsized":"2023-10-01T07:52:47.957438+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705696,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297280,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074560,"statfs":{"total":96636764160,"available":96332349440,"internally_reserved":0,"allocated":188416,"data_stored":67123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 07:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33000000000000002,"15min":0.32700000000000001},"min":{"1min":0.28000000000000003,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.372},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.35099999999999998,"15min":0.34899999999999998},"min":{"1min":0.27100000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.29599999999999999}]},{"osd":1,"last update":"Sun Oct 1 07:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.52700000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.311},{"interface":"front","average":{"1min":0.378,"5min":0.376,"15min":0.376},"min":{"1min":0.30299999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.50800000000000001,"5min":0.626,"15min":0.626},"last":0.32600000000000001}]},{"osd":3,"last update":"Sun Oct 1 07:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.38400000000000001,"15min":0.38600000000000001},"min":{"1min":0.29499999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.495,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.41199999999999998,"15min":0.41299999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.58399999999999996,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.35499999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705696,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297280,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074560,"statfs":{"total":96636764160,"available":96332349440,"internally_reserved":0,"allocated":188416,"data_stored":64206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 07:53:51 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.23400000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35899999999999999,"15min":0.35999999999999999},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.47499999999999998,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.44700000000000001}]},{"osd":2,"last update":"Sun Oct 1 07:53:51 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.318,"15min":0.32000000000000001},"min":{"1min":0.246,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.41599999999999998,"5min":0.505,"15min":0.505},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.45600000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.42499999999999999}]},{"osd":3,"last update":"Sun Oct 1 07:53:51 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.33600000000000002,"15min":0.33800000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.42299999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35599999999999998,"15min":0.35699999999999998},"min":{"1min":0.28599999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.45900000000000002,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.46400000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705696,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297284,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074556,"statfs":{"total":96636764160,"available":96332345344,"internally_reserved":0,"allocated":192512,"data_stored":64260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 1 07:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.36199999999999999,"15min":0.36799999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.45700000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.38900000000000001,"15min":0.39500000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.54300000000000004,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.30099999999999999}]},{"osd":2,"last update":"Sun Oct 1 07:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.40600000000000003,"15min":0.41199999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.50800000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.37,"5min":0.41499999999999998,"15min":0.42299999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.48599999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.317}]},{"osd":3,"last update":"Sun Oct 1 07:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.42099999999999999,"15min":0.42799999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.49099999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.40899999999999997,"15min":0.41699999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.497,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.26500000000000001}]}]},{"osd":3,"up_from":9,"seq":38654705695,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297292,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074548,"statfs":{"total":96636764160,"available":96332337152,"internally_reserved":0,"allocated":200704,"data_stored":67317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 07:53:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.27100000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.47299999999999998,"5min":0.501,"15min":0.501},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.41499999999999998}]},{"osd":1,"last update":"Sun Oct 1 07:53:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.35799999999999998,"15min":0.35599999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35799999999999998,"15min":0.35899999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.48299999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.40000000000000002}]},{"osd":2,"last update":"Sun Oct 1 07:53:56 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.36199999999999999,"15min":0.35699999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.37,"15min":0.37},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.442}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-01T07:54:18.546 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-01T07:54:18.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.717+0000 7fecc8e3f700 1 Processor -- start 2023-10-01T07:54:18.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.718+0000 7fecc8e3f700 1 -- start start 2023-10-01T07:54:18.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.718+0000 7fecc8e3f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fecc4133a80 0x7fecc4133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:18.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.718+0000 7fecc8e3f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fecc412ff20 0x7fecc4130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:18.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.718+0000 7fecc8e3f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fecc4130870 0x7fecc413a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:18.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.718+0000 7fecc8e3f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecc406c570 con 0x7fecc4133a80 2023-10-01T07:54:18.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.718+0000 7fecc8e3f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc406bc00 con 0x7fecc4130870 2023-10-01T07:54:18.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.718+0000 7fecc8e3f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecc40a0040 con 0x7fecc412ff20 2023-10-01T07:54:18.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.718+0000 7fecc2d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fecc4130870 0x7fecc413a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:18.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.718+0000 7fecc259c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fecc4133a80 0x7fecc4133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:18.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.718+0000 7fecc1d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fecc412ff20 0x7fecc4130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:18.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.718+0000 7fecc259c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fecc4133a80 0x7fecc4133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38124/0 (socket says 172.21.15.26:38124) 2023-10-01T07:54:18.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.718+0000 7fecc259c700 1 -- 172.21.15.26:0/3509789821 learned_addr learned my addr 172.21.15.26:0/3509789821 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:18.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.718+0000 7fecc2d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fecc4130870 0x7fecc413a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:60558/0 (socket says 172.21.15.26:60558) 2023-10-01T07:54:18.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.719+0000 7fecc259c700 1 -- 172.21.15.26:0/3509789821 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fecc412ff20 msgr2=0x7fecc4130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:18.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.719+0000 7fecc259c700 1 --2- 172.21.15.26:0/3509789821 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fecc412ff20 0x7fecc4130330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:18.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.719+0000 7fecc259c700 1 -- 172.21.15.26:0/3509789821 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fecc4130870 msgr2=0x7fecc413a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:18.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.719+0000 7fecc259c700 1 --2- 172.21.15.26:0/3509789821 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fecc4130870 0x7fecc413a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:18.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.719+0000 7fecc259c700 1 -- 172.21.15.26:0/3509789821 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc4133860 con 0x7fecc4133a80 2023-10-01T07:54:18.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.719+0000 7fecc2d9d700 1 --2- 172.21.15.26:0/3509789821 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fecc4130870 0x7fecc413a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:18.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.719+0000 7fecc259c700 1 --2- 172.21.15.26:0/3509789821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecc4133a80 0x7fecc4133e50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fecb40098f0 tx=0x7fecb4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61e8691ebafaaafd server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:18.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.719+0000 7fecc159a700 1 -- 172.21.15.26:0/3509789821 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb4011830 con 0x7fecc4133a80 2023-10-01T07:54:18.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.719+0000 7fecc159a700 1 -- 172.21.15.26:0/3509789821 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb4011990 con 0x7fecc4133a80 2023-10-01T07:54:18.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.719+0000 7fecc159a700 1 -- 172.21.15.26:0/3509789821 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb4011d20 con 0x7fecc4133a80 2023-10-01T07:54:18.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.720+0000 7fecc8e3f700 1 -- 172.21.15.26:0/3509789821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecc4133a80 msgr2=0x7fecc4133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:18.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.720+0000 7fecc8e3f700 1 --2- 172.21.15.26:0/3509789821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecc4133a80 0x7fecc4133e50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fecb40098f0 tx=0x7fecb4009c00 comp rx=0 tx=0).stop 2023-10-01T07:54:18.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.720+0000 7fecc8e3f700 1 -- 172.21.15.26:0/3509789821 shutdown_connections 2023-10-01T07:54:18.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.720+0000 7fecc8e3f700 1 --2- 172.21.15.26:0/3509789821 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fecc4130870 0x7fecc413a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:18.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.720+0000 7fecc8e3f700 1 --2- 172.21.15.26:0/3509789821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecc4133a80 0x7fecc4133e50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:18.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.720+0000 7fecc8e3f700 1 --2- 172.21.15.26:0/3509789821 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fecc412ff20 0x7fecc4130330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:18.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.720+0000 7fecc8e3f700 1 -- 172.21.15.26:0/3509789821 >> 172.21.15.26:0/3509789821 conn(0x7fecc40a4210 msgr2=0x7fecc40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:18.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.720+0000 7fecc8e3f700 1 -- 172.21.15.26:0/3509789821 shutdown_connections 2023-10-01T07:54:18.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.720+0000 7fecc8e3f700 1 -- 172.21.15.26:0/3509789821 wait complete. 2023-10-01T07:54:18.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.721+0000 7fecc8e3f700 1 Processor -- start 2023-10-01T07:54:18.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.721+0000 7fecc8e3f700 1 -- start start 2023-10-01T07:54:18.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.722+0000 7fecc8e3f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fecc412ff20 0x7fecc409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:18.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.722+0000 7fecc8e3f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fecc4130870 0x7fecc409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:18.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.722+0000 7fecc8e3f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecc4133a80 0x7fecc409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:18.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.722+0000 7fecc8e3f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc406d280 con 0x7fecc4133a80 2023-10-01T07:54:18.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.722+0000 7fecc8e3f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc411fd80 con 0x7fecc4130870 2023-10-01T07:54:18.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.722+0000 7fecc8e3f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecc412da90 con 0x7fecc412ff20 2023-10-01T07:54:18.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.722+0000 7fecc259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fecc412ff20 0x7fecc409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:18.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.722+0000 7fecc259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fecc412ff20 0x7fecc409c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55754/0 (socket says 172.21.15.26:55754) 2023-10-01T07:54:18.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.722+0000 7fecc259c700 1 -- 172.21.15.26:0/2720297065 learned_addr learned my addr 172.21.15.26:0/2720297065 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:18.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.722+0000 7fecc1d9b700 1 --2- 172.21.15.26:0/2720297065 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fecc4130870 0x7fecc409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:18.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.722+0000 7fecc2d9d700 1 --2- 172.21.15.26:0/2720297065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecc4133a80 0x7fecc409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:18.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.722+0000 7fecc2d9d700 1 -- 172.21.15.26:0/2720297065 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fecc412ff20 msgr2=0x7fecc409c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:18.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.722+0000 7fecc2d9d700 1 --2- 172.21.15.26:0/2720297065 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fecc412ff20 0x7fecc409c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:18.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.722+0000 7fecc2d9d700 1 -- 172.21.15.26:0/2720297065 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fecc4130870 msgr2=0x7fecc409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:18.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.722+0000 7fecc2d9d700 1 --2- 172.21.15.26:0/2720297065 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fecc4130870 0x7fecc409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:18.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.722+0000 7fecc2d9d700 1 -- 172.21.15.26:0/2720297065 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecbc009a70 con 0x7fecc4133a80 2023-10-01T07:54:18.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.722+0000 7fecc1d9b700 1 --2- 172.21.15.26:0/2720297065 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fecc4130870 0x7fecc409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.722+0000 7fecc2d9d700 1 --2- 172.21.15.26:0/2720297065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecc4133a80 0x7fecc409cf00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fecbc00efc0 tx=0x7fecbc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.722+0000 7fecb2ffd700 1 -- 172.21.15.26:0/2720297065 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc00ca90 con 0x7fecc4133a80 2023-10-01T07:54:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.723+0000 7fecb2ffd700 1 -- 172.21.15.26:0/2720297065 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecbc00f040 con 0x7fecc4133a80 2023-10-01T07:54:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.723+0000 7fecc8e3f700 1 -- 172.21.15.26:0/2720297065 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb4009550 con 0x7fecc4133a80 2023-10-01T07:54:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.723+0000 7fecb2ffd700 1 -- 172.21.15.26:0/2720297065 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc00ce30 con 0x7fecc4133a80 2023-10-01T07:54:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.723+0000 7fecc8e3f700 1 -- 172.21.15.26:0/2720297065 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecc409dee0 con 0x7fecc4133a80 2023-10-01T07:54:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.723+0000 7fecb2ffd700 1 -- 172.21.15.26:0/2720297065 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7fecbc014480 con 0x7fecc4133a80 2023-10-01T07:54:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.724+0000 7fecb2ffd700 1 -- 172.21.15.26:0/2720297065 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fecbc040070 con 0x7fecc4133a80 2023-10-01T07:54:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.724+0000 7fecc8e3f700 1 -- 172.21.15.26:0/2720297065 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecc411ff80 con 0x7fecc4133a80 2023-10-01T07:54:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.729+0000 7fecb2ffd700 1 -- 172.21.15.26:0/2720297065 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fecbc018020 con 0x7fecc4133a80 2023-10-01T07:54:18.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.929+0000 7fecc8e3f700 1 -- 172.21.15.26:0/2720297065 --> v1:172.21.15.26:6816/126763 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fecc40a0580 con 0x7feca402f480 2023-10-01T07:54:18.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.936+0000 7fecb2ffd700 1 -- 172.21.15.26:0/2720297065 <== mgr.14101 v1:172.21.15.26:6816/126763 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+270885 (unknown 2965378022 0 3641366132) 0x7fecb4006ca0 con 0x7feca402f480 2023-10-01T07:54:18.940 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:54:18.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.940+0000 7fecc8e3f700 1 -- 172.21.15.26:0/2720297065 >> v1:172.21.15.26:6816/126763 conn(0x7feca402f480 legacy=0x7feca4031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:18.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.940+0000 7fecc8e3f700 1 -- 172.21.15.26:0/2720297065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecc4133a80 msgr2=0x7fecc409cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:18.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.940+0000 7fecc8e3f700 1 --2- 172.21.15.26:0/2720297065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecc4133a80 0x7fecc409cf00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fecbc00efc0 tx=0x7fecbc00c3a0 comp rx=0 tx=0).stop 2023-10-01T07:54:18.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.940+0000 7fecc8e3f700 1 -- 172.21.15.26:0/2720297065 shutdown_connections 2023-10-01T07:54:18.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.940+0000 7fecc8e3f700 1 --2- 172.21.15.26:0/2720297065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecc4133a80 0x7fecc409cf00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:18.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.940+0000 7fecc8e3f700 1 --2- 172.21.15.26:0/2720297065 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fecc412ff20 0x7fecc409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:18.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.940+0000 7fecc8e3f700 1 --2- 172.21.15.26:0/2720297065 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fecc4130870 0x7fecc409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:18.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.940+0000 7fecc8e3f700 1 -- 172.21.15.26:0/2720297065 >> 172.21.15.26:0/2720297065 conn(0x7fecc40a4210 msgr2=0x7fecc409e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:18.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.940+0000 7fecc8e3f700 1 -- 172.21.15.26:0/2720297065 shutdown_connections 2023-10-01T07:54:18.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:18.940+0000 7fecc8e3f700 1 -- 172.21.15.26:0/2720297065 wait complete. 2023-10-01T07:54:18.944 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-10-01T07:54:18.954 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":7,"stamp":"2023-10-01T07:54:18.819564+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189136,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298224,"statfs":{"total":386547056640,"available":385329381376,"internally_reserved":0,"allocated":770048,"data_stored":262906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.003262"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.699216+0000","last_change":"2023-10-01T07:51:57.340051+0000","last_active":"2023-10-01T07:52:47.699216+0000","last_peered":"2023-10-01T07:52:47.699216+0000","last_clean":"2023-10-01T07:52:47.699216+0000","last_became_active":"2023-10-01T07:51:57.339739+0000","last_became_peered":"2023-10-01T07:51:57.339739+0000","last_unstale":"2023-10-01T07:52:47.699216+0000","last_undegraded":"2023-10-01T07:52:47.699216+0000","last_fullsized":"2023-10-01T07:52:47.699216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.699373+0000","last_change":"2023-10-01T07:51:57.330147+0000","last_active":"2023-10-01T07:52:47.699373+0000","last_peered":"2023-10-01T07:52:47.699373+0000","last_clean":"2023-10-01T07:52:47.699373+0000","last_became_active":"2023-10-01T07:51:57.329793+0000","last_became_peered":"2023-10-01T07:51:57.329793+0000","last_unstale":"2023-10-01T07:52:47.699373+0000","last_undegraded":"2023-10-01T07:52:47.699373+0000","last_fullsized":"2023-10-01T07:52:47.699373+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696580+0000","last_change":"2023-10-01T07:51:57.335404+0000","last_active":"2023-10-01T07:52:47.696580+0000","last_peered":"2023-10-01T07:52:47.696580+0000","last_clean":"2023-10-01T07:52:47.696580+0000","last_became_active":"2023-10-01T07:51:57.329225+0000","last_became_peered":"2023-10-01T07:51:57.329225+0000","last_unstale":"2023-10-01T07:52:47.696580+0000","last_undegraded":"2023-10-01T07:52:47.696580+0000","last_fullsized":"2023-10-01T07:52:47.696580+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696450+0000","last_change":"2023-10-01T07:51:57.332237+0000","last_active":"2023-10-01T07:52:47.696450+0000","last_peered":"2023-10-01T07:52:47.696450+0000","last_clean":"2023-10-01T07:52:47.696450+0000","last_became_active":"2023-10-01T07:51:57.331857+0000","last_became_peered":"2023-10-01T07:51:57.331857+0000","last_unstale":"2023-10-01T07:52:47.696450+0000","last_undegraded":"2023-10-01T07:52:47.696450+0000","last_fullsized":"2023-10-01T07:52:47.696450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696508+0000","last_change":"2023-10-01T07:51:57.326512+0000","last_active":"2023-10-01T07:52:47.696508+0000","last_peered":"2023-10-01T07:52:47.696508+0000","last_clean":"2023-10-01T07:52:47.696508+0000","last_became_active":"2023-10-01T07:51:57.326202+0000","last_became_peered":"2023-10-01T07:51:57.326202+0000","last_unstale":"2023-10-01T07:52:47.696508+0000","last_undegraded":"2023-10-01T07:52:47.696508+0000","last_fullsized":"2023-10-01T07:52:47.696508+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957316+0000","last_change":"2023-10-01T07:51:57.323824+0000","last_active":"2023-10-01T07:52:47.957316+0000","last_peered":"2023-10-01T07:52:47.957316+0000","last_clean":"2023-10-01T07:52:47.957316+0000","last_became_active":"2023-10-01T07:51:57.322857+0000","last_became_peered":"2023-10-01T07:51:57.322857+0000","last_unstale":"2023-10-01T07:52:47.957316+0000","last_undegraded":"2023-10-01T07:52:47.957316+0000","last_fullsized":"2023-10-01T07:52:47.957316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.703317+0000","last_change":"2023-10-01T07:52:47.701643+0000","last_active":"2023-10-01T07:52:47.703317+0000","last_peered":"2023-10-01T07:52:47.703317+0000","last_clean":"2023-10-01T07:52:47.703317+0000","last_became_active":"2023-10-01T07:52:47.701229+0000","last_became_peered":"2023-10-01T07:52:47.701229+0000","last_unstale":"2023-10-01T07:52:47.703317+0000","last_undegraded":"2023-10-01T07:52:47.703317+0000","last_fullsized":"2023-10-01T07:52:47.703317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.955884+0000","last_change":"2023-10-01T07:51:57.323649+0000","last_active":"2023-10-01T07:52:47.955884+0000","last_peered":"2023-10-01T07:52:47.955884+0000","last_clean":"2023-10-01T07:52:47.955884+0000","last_became_active":"2023-10-01T07:51:57.319917+0000","last_became_peered":"2023-10-01T07:51:57.319917+0000","last_unstale":"2023-10-01T07:52:47.955884+0000","last_undegraded":"2023-10-01T07:52:47.955884+0000","last_fullsized":"2023-10-01T07:52:47.955884+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.697190+0000","last_change":"2023-10-01T07:51:57.325845+0000","last_active":"2023-10-01T07:52:47.697190+0000","last_peered":"2023-10-01T07:52:47.697190+0000","last_clean":"2023-10-01T07:52:47.697190+0000","last_became_active":"2023-10-01T07:51:57.325346+0000","last_became_peered":"2023-10-01T07:51:57.325346+0000","last_unstale":"2023-10-01T07:52:47.697190+0000","last_undegraded":"2023-10-01T07:52:47.697190+0000","last_fullsized":"2023-10-01T07:52:47.697190+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.958197+0000","last_change":"2023-10-01T07:51:57.328438+0000","last_active":"2023-10-01T07:52:47.958197+0000","last_peered":"2023-10-01T07:52:47.958197+0000","last_clean":"2023-10-01T07:52:47.958197+0000","last_became_active":"2023-10-01T07:51:57.328128+0000","last_became_peered":"2023-10-01T07:51:57.328128+0000","last_unstale":"2023-10-01T07:52:47.958197+0000","last_undegraded":"2023-10-01T07:52:47.958197+0000","last_fullsized":"2023-10-01T07:52:47.958197+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957395+0000","last_change":"2023-10-01T07:51:57.328650+0000","last_active":"2023-10-01T07:52:47.957395+0000","last_peered":"2023-10-01T07:52:47.957395+0000","last_clean":"2023-10-01T07:52:47.957395+0000","last_became_active":"2023-10-01T07:51:57.328335+0000","last_became_peered":"2023-10-01T07:51:57.328335+0000","last_unstale":"2023-10-01T07:52:47.957395+0000","last_undegraded":"2023-10-01T07:52:47.957395+0000","last_fullsized":"2023-10-01T07:52:47.957395+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.698217+0000","last_change":"2023-10-01T07:51:57.331991+0000","last_active":"2023-10-01T07:52:47.698217+0000","last_peered":"2023-10-01T07:52:47.698217+0000","last_clean":"2023-10-01T07:52:47.698217+0000","last_became_active":"2023-10-01T07:51:57.331698+0000","last_became_peered":"2023-10-01T07:51:57.331698+0000","last_unstale":"2023-10-01T07:52:47.698217+0000","last_undegraded":"2023-10-01T07:52:47.698217+0000","last_fullsized":"2023-10-01T07:52:47.698217+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.698435+0000","last_change":"2023-10-01T07:51:57.342157+0000","last_active":"2023-10-01T07:52:47.698435+0000","last_peered":"2023-10-01T07:52:47.698435+0000","last_clean":"2023-10-01T07:52:47.698435+0000","last_became_active":"2023-10-01T07:51:57.341533+0000","last_became_peered":"2023-10-01T07:51:57.341533+0000","last_unstale":"2023-10-01T07:52:47.698435+0000","last_undegraded":"2023-10-01T07:52:47.698435+0000","last_fullsized":"2023-10-01T07:52:47.698435+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957011+0000","last_change":"2023-10-01T07:51:57.318295+0000","last_active":"2023-10-01T07:52:47.957011+0000","last_peered":"2023-10-01T07:52:47.957011+0000","last_clean":"2023-10-01T07:52:47.957011+0000","last_became_active":"2023-10-01T07:51:57.317972+0000","last_became_peered":"2023-10-01T07:51:57.317972+0000","last_unstale":"2023-10-01T07:52:47.957011+0000","last_undegraded":"2023-10-01T07:52:47.957011+0000","last_fullsized":"2023-10-01T07:52:47.957011+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696289+0000","last_change":"2023-10-01T07:51:57.321137+0000","last_active":"2023-10-01T07:52:47.696289+0000","last_peered":"2023-10-01T07:52:47.696289+0000","last_clean":"2023-10-01T07:52:47.696289+0000","last_became_active":"2023-10-01T07:51:57.320789+0000","last_became_peered":"2023-10-01T07:51:57.320789+0000","last_unstale":"2023-10-01T07:52:47.696289+0000","last_undegraded":"2023-10-01T07:52:47.696289+0000","last_fullsized":"2023-10-01T07:52:47.696289+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.955941+0000","last_change":"2023-10-01T07:51:57.325610+0000","last_active":"2023-10-01T07:52:47.955941+0000","last_peered":"2023-10-01T07:52:47.955941+0000","last_clean":"2023-10-01T07:52:47.955941+0000","last_became_active":"2023-10-01T07:51:57.325322+0000","last_became_peered":"2023-10-01T07:51:57.325322+0000","last_unstale":"2023-10-01T07:52:47.955941+0000","last_undegraded":"2023-10-01T07:52:47.955941+0000","last_fullsized":"2023-10-01T07:52:47.955941+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.697132+0000","last_change":"2023-10-01T07:51:57.325641+0000","last_active":"2023-10-01T07:52:47.697132+0000","last_peered":"2023-10-01T07:52:47.697132+0000","last_clean":"2023-10-01T07:52:47.697132+0000","last_became_active":"2023-10-01T07:51:57.324956+0000","last_became_peered":"2023-10-01T07:51:57.324956+0000","last_unstale":"2023-10-01T07:52:47.697132+0000","last_undegraded":"2023-10-01T07:52:47.697132+0000","last_fullsized":"2023-10-01T07:52:47.697132+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.697056+0000","last_change":"2023-10-01T07:51:57.316882+0000","last_active":"2023-10-01T07:52:47.697056+0000","last_peered":"2023-10-01T07:52:47.697056+0000","last_clean":"2023-10-01T07:52:47.697056+0000","last_became_active":"2023-10-01T07:51:57.316026+0000","last_became_peered":"2023-10-01T07:51:57.316026+0000","last_unstale":"2023-10-01T07:52:47.697056+0000","last_undegraded":"2023-10-01T07:52:47.697056+0000","last_fullsized":"2023-10-01T07:52:47.697056+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.698473+0000","last_change":"2023-10-01T07:51:57.340110+0000","last_active":"2023-10-01T07:52:47.698473+0000","last_peered":"2023-10-01T07:52:47.698473+0000","last_clean":"2023-10-01T07:52:47.698473+0000","last_became_active":"2023-10-01T07:51:57.339795+0000","last_became_peered":"2023-10-01T07:51:57.339795+0000","last_unstale":"2023-10-01T07:52:47.698473+0000","last_undegraded":"2023-10-01T07:52:47.698473+0000","last_fullsized":"2023-10-01T07:52:47.698473+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957553+0000","last_change":"2023-10-01T07:51:57.347691+0000","last_active":"2023-10-01T07:52:47.957553+0000","last_peered":"2023-10-01T07:52:47.957553+0000","last_clean":"2023-10-01T07:52:47.957553+0000","last_became_active":"2023-10-01T07:51:57.347374+0000","last_became_peered":"2023-10-01T07:51:57.347374+0000","last_unstale":"2023-10-01T07:52:47.957553+0000","last_undegraded":"2023-10-01T07:52:47.957553+0000","last_fullsized":"2023-10-01T07:52:47.957553+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.956688+0000","last_change":"2023-10-01T07:51:57.341479+0000","last_active":"2023-10-01T07:52:47.956688+0000","last_peered":"2023-10-01T07:52:47.956688+0000","last_clean":"2023-10-01T07:52:47.956688+0000","last_became_active":"2023-10-01T07:51:57.341064+0000","last_became_peered":"2023-10-01T07:51:57.341064+0000","last_unstale":"2023-10-01T07:52:47.956688+0000","last_undegraded":"2023-10-01T07:52:47.956688+0000","last_fullsized":"2023-10-01T07:52:47.956688+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.695981+0000","last_change":"2023-10-01T07:51:57.332063+0000","last_active":"2023-10-01T07:52:47.695981+0000","last_peered":"2023-10-01T07:52:47.695981+0000","last_clean":"2023-10-01T07:52:47.695981+0000","last_became_active":"2023-10-01T07:51:57.331511+0000","last_became_peered":"2023-10-01T07:51:57.331511+0000","last_unstale":"2023-10-01T07:52:47.695981+0000","last_undegraded":"2023-10-01T07:52:47.695981+0000","last_fullsized":"2023-10-01T07:52:47.695981+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957715+0000","last_change":"2023-10-01T07:51:57.325516+0000","last_active":"2023-10-01T07:52:47.957715+0000","last_peered":"2023-10-01T07:52:47.957715+0000","last_clean":"2023-10-01T07:52:47.957715+0000","last_became_active":"2023-10-01T07:51:57.324549+0000","last_became_peered":"2023-10-01T07:51:57.324549+0000","last_unstale":"2023-10-01T07:52:47.957715+0000","last_undegraded":"2023-10-01T07:52:47.957715+0000","last_fullsized":"2023-10-01T07:52:47.957715+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.955894+0000","last_change":"2023-10-01T07:51:57.334881+0000","last_active":"2023-10-01T07:52:47.955894+0000","last_peered":"2023-10-01T07:52:47.955894+0000","last_clean":"2023-10-01T07:52:47.955894+0000","last_became_active":"2023-10-01T07:51:57.334682+0000","last_became_peered":"2023-10-01T07:51:57.334682+0000","last_unstale":"2023-10-01T07:52:47.955894+0000","last_undegraded":"2023-10-01T07:52:47.955894+0000","last_fullsized":"2023-10-01T07:52:47.955894+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.958724+0000","last_change":"2023-10-01T07:51:57.334700+0000","last_active":"2023-10-01T07:52:47.958724+0000","last_peered":"2023-10-01T07:52:47.958724+0000","last_clean":"2023-10-01T07:52:47.958724+0000","last_became_active":"2023-10-01T07:51:57.334406+0000","last_became_peered":"2023-10-01T07:51:57.334406+0000","last_unstale":"2023-10-01T07:52:47.958724+0000","last_undegraded":"2023-10-01T07:52:47.958724+0000","last_fullsized":"2023-10-01T07:52:47.958724+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.958110+0000","last_change":"2023-10-01T07:51:57.323470+0000","last_active":"2023-10-01T07:52:47.958110+0000","last_peered":"2023-10-01T07:52:47.958110+0000","last_clean":"2023-10-01T07:52:47.958110+0000","last_became_active":"2023-10-01T07:51:57.323181+0000","last_became_peered":"2023-10-01T07:51:57.323181+0000","last_unstale":"2023-10-01T07:52:47.958110+0000","last_undegraded":"2023-10-01T07:52:47.958110+0000","last_fullsized":"2023-10-01T07:52:47.958110+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957968+0000","last_change":"2023-10-01T07:51:57.339412+0000","last_active":"2023-10-01T07:52:47.957968+0000","last_peered":"2023-10-01T07:52:47.957968+0000","last_clean":"2023-10-01T07:52:47.957968+0000","last_became_active":"2023-10-01T07:51:57.338796+0000","last_became_peered":"2023-10-01T07:51:57.338796+0000","last_unstale":"2023-10-01T07:52:47.957968+0000","last_undegraded":"2023-10-01T07:52:47.957968+0000","last_fullsized":"2023-10-01T07:52:47.957968+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.956627+0000","last_change":"2023-10-01T07:51:56.911245+0000","last_active":"2023-10-01T07:52:47.956627+0000","last_peered":"2023-10-01T07:52:47.956627+0000","last_clean":"2023-10-01T07:52:47.956627+0000","last_became_active":"2023-10-01T07:51:56.910930+0000","last_became_peered":"2023-10-01T07:51:56.910930+0000","last_unstale":"2023-10-01T07:52:47.956627+0000","last_undegraded":"2023-10-01T07:52:47.956627+0000","last_fullsized":"2023-10-01T07:52:47.956627+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.958113+0000","last_change":"2023-10-01T07:51:57.343694+0000","last_active":"2023-10-01T07:52:47.958113+0000","last_peered":"2023-10-01T07:52:47.958113+0000","last_clean":"2023-10-01T07:52:47.958113+0000","last_became_active":"2023-10-01T07:51:57.343082+0000","last_became_peered":"2023-10-01T07:51:57.343082+0000","last_unstale":"2023-10-01T07:52:47.958113+0000","last_undegraded":"2023-10-01T07:52:47.958113+0000","last_fullsized":"2023-10-01T07:52:47.958113+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.956510+0000","last_change":"2023-10-01T07:51:56.919246+0000","last_active":"2023-10-01T07:52:47.956510+0000","last_peered":"2023-10-01T07:52:47.956510+0000","last_clean":"2023-10-01T07:52:47.956510+0000","last_became_active":"2023-10-01T07:51:56.918962+0000","last_became_peered":"2023-10-01T07:51:56.918962+0000","last_unstale":"2023-10-01T07:52:47.956510+0000","last_undegraded":"2023-10-01T07:52:47.956510+0000","last_fullsized":"2023-10-01T07:52:47.956510+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696829+0000","last_change":"2023-10-01T07:51:57.335143+0000","last_active":"2023-10-01T07:52:47.696829+0000","last_peered":"2023-10-01T07:52:47.696829+0000","last_clean":"2023-10-01T07:52:47.696829+0000","last_became_active":"2023-10-01T07:51:57.334730+0000","last_became_peered":"2023-10-01T07:51:57.334730+0000","last_unstale":"2023-10-01T07:52:47.696829+0000","last_undegraded":"2023-10-01T07:52:47.696829+0000","last_fullsized":"2023-10-01T07:52:47.696829+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.956361+0000","last_change":"2023-10-01T07:51:56.914663+0000","last_active":"2023-10-01T07:52:47.956361+0000","last_peered":"2023-10-01T07:52:47.956361+0000","last_clean":"2023-10-01T07:52:47.956361+0000","last_became_active":"2023-10-01T07:51:56.914321+0000","last_became_peered":"2023-10-01T07:51:56.914321+0000","last_unstale":"2023-10-01T07:52:47.956361+0000","last_undegraded":"2023-10-01T07:52:47.956361+0000","last_fullsized":"2023-10-01T07:52:47.956361+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.958903+0000","last_change":"2023-10-01T07:51:57.345818+0000","last_active":"2023-10-01T07:52:47.958903+0000","last_peered":"2023-10-01T07:52:47.958903+0000","last_clean":"2023-10-01T07:52:47.958903+0000","last_became_active":"2023-10-01T07:51:57.345561+0000","last_became_peered":"2023-10-01T07:51:57.345561+0000","last_unstale":"2023-10-01T07:52:47.958903+0000","last_undegraded":"2023-10-01T07:52:47.958903+0000","last_fullsized":"2023-10-01T07:52:47.958903+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.697239+0000","last_change":"2023-10-01T07:51:56.916086+0000","last_active":"2023-10-01T07:52:47.697239+0000","last_peered":"2023-10-01T07:52:47.697239+0000","last_clean":"2023-10-01T07:52:47.697239+0000","last_became_active":"2023-10-01T07:51:56.912164+0000","last_became_peered":"2023-10-01T07:51:56.912164+0000","last_unstale":"2023-10-01T07:52:47.697239+0000","last_undegraded":"2023-10-01T07:52:47.697239+0000","last_fullsized":"2023-10-01T07:52:47.697239+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.956404+0000","last_change":"2023-10-01T07:51:57.340361+0000","last_active":"2023-10-01T07:52:47.956404+0000","last_peered":"2023-10-01T07:52:47.956404+0000","last_clean":"2023-10-01T07:52:47.956404+0000","last_became_active":"2023-10-01T07:51:57.339753+0000","last_became_peered":"2023-10-01T07:51:57.339753+0000","last_unstale":"2023-10-01T07:52:47.956404+0000","last_undegraded":"2023-10-01T07:52:47.956404+0000","last_fullsized":"2023-10-01T07:52:47.956404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.699206+0000","last_change":"2023-10-01T07:51:56.917428+0000","last_active":"2023-10-01T07:52:47.699206+0000","last_peered":"2023-10-01T07:52:47.699206+0000","last_clean":"2023-10-01T07:52:47.699206+0000","last_became_active":"2023-10-01T07:51:56.916781+0000","last_became_peered":"2023-10-01T07:51:56.916781+0000","last_unstale":"2023-10-01T07:52:47.699206+0000","last_undegraded":"2023-10-01T07:52:47.699206+0000","last_fullsized":"2023-10-01T07:52:47.699206+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.958191+0000","last_change":"2023-10-01T07:51:57.339022+0000","last_active":"2023-10-01T07:52:47.958191+0000","last_peered":"2023-10-01T07:52:47.958191+0000","last_clean":"2023-10-01T07:52:47.958191+0000","last_became_active":"2023-10-01T07:51:57.338710+0000","last_became_peered":"2023-10-01T07:51:57.338710+0000","last_unstale":"2023-10-01T07:52:47.958191+0000","last_undegraded":"2023-10-01T07:52:47.958191+0000","last_fullsized":"2023-10-01T07:52:47.958191+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696536+0000","last_change":"2023-10-01T07:51:56.914774+0000","last_active":"2023-10-01T07:52:47.696536+0000","last_peered":"2023-10-01T07:52:47.696536+0000","last_clean":"2023-10-01T07:52:47.696536+0000","last_became_active":"2023-10-01T07:51:56.912021+0000","last_became_peered":"2023-10-01T07:51:56.912021+0000","last_unstale":"2023-10-01T07:52:47.696536+0000","last_undegraded":"2023-10-01T07:52:47.696536+0000","last_fullsized":"2023-10-01T07:52:47.696536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.956813+0000","last_change":"2023-10-01T07:51:57.331183+0000","last_active":"2023-10-01T07:52:47.956813+0000","last_peered":"2023-10-01T07:52:47.956813+0000","last_clean":"2023-10-01T07:52:47.956813+0000","last_became_active":"2023-10-01T07:51:57.330934+0000","last_became_peered":"2023-10-01T07:51:57.330934+0000","last_unstale":"2023-10-01T07:52:47.956813+0000","last_undegraded":"2023-10-01T07:52:47.956813+0000","last_fullsized":"2023-10-01T07:52:47.956813+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'12","reported_seq":26,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-01T07:54:14.899108+0000","last_change":"2023-10-01T07:51:56.925053+0000","last_active":"2023-10-01T07:54:14.899108+0000","last_peered":"2023-10-01T07:54:14.899108+0000","last_clean":"2023-10-01T07:54:14.899108+0000","last_became_active":"2023-10-01T07:51:56.924755+0000","last_became_peered":"2023-10-01T07:51:56.924755+0000","last_unstale":"2023-10-01T07:54:14.899108+0000","last_undegraded":"2023-10-01T07:54:14.899108+0000","last_fullsized":"2023-10-01T07:54:14.899108+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3563,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.698535+0000","last_change":"2023-10-01T07:51:57.341789+0000","last_active":"2023-10-01T07:52:47.698535+0000","last_peered":"2023-10-01T07:52:47.698535+0000","last_clean":"2023-10-01T07:52:47.698535+0000","last_became_active":"2023-10-01T07:51:57.340852+0000","last_became_peered":"2023-10-01T07:51:57.340852+0000","last_unstale":"2023-10-01T07:52:47.698535+0000","last_undegraded":"2023-10-01T07:52:47.698535+0000","last_fullsized":"2023-10-01T07:52:47.698535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957159+0000","last_change":"2023-10-01T07:51:56.924181+0000","last_active":"2023-10-01T07:52:47.957159+0000","last_peered":"2023-10-01T07:52:47.957159+0000","last_clean":"2023-10-01T07:52:47.957159+0000","last_became_active":"2023-10-01T07:51:56.923560+0000","last_became_peered":"2023-10-01T07:51:56.923560+0000","last_unstale":"2023-10-01T07:52:47.957159+0000","last_undegraded":"2023-10-01T07:52:47.957159+0000","last_fullsized":"2023-10-01T07:52:47.957159+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957659+0000","last_change":"2023-10-01T07:51:57.341678+0000","last_active":"2023-10-01T07:52:47.957659+0000","last_peered":"2023-10-01T07:52:47.957659+0000","last_clean":"2023-10-01T07:52:47.957659+0000","last_became_active":"2023-10-01T07:51:57.339190+0000","last_became_peered":"2023-10-01T07:51:57.339190+0000","last_unstale":"2023-10-01T07:52:47.957659+0000","last_undegraded":"2023-10-01T07:52:47.957659+0000","last_fullsized":"2023-10-01T07:52:47.957659+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696089+0000","last_change":"2023-10-01T07:51:56.915181+0000","last_active":"2023-10-01T07:52:47.696089+0000","last_peered":"2023-10-01T07:52:47.696089+0000","last_clean":"2023-10-01T07:52:47.696089+0000","last_became_active":"2023-10-01T07:51:56.914858+0000","last_became_peered":"2023-10-01T07:51:56.914858+0000","last_unstale":"2023-10-01T07:52:47.696089+0000","last_undegraded":"2023-10-01T07:52:47.696089+0000","last_fullsized":"2023-10-01T07:52:47.696089+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.958227+0000","last_change":"2023-10-01T07:51:57.339439+0000","last_active":"2023-10-01T07:52:47.958227+0000","last_peered":"2023-10-01T07:52:47.958227+0000","last_clean":"2023-10-01T07:52:47.958227+0000","last_became_active":"2023-10-01T07:51:57.339208+0000","last_became_peered":"2023-10-01T07:51:57.339208+0000","last_unstale":"2023-10-01T07:52:47.958227+0000","last_undegraded":"2023-10-01T07:52:47.958227+0000","last_fullsized":"2023-10-01T07:52:47.958227+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.958097+0000","last_change":"2023-10-01T07:51:56.926432+0000","last_active":"2023-10-01T07:52:47.958097+0000","last_peered":"2023-10-01T07:52:47.958097+0000","last_clean":"2023-10-01T07:52:47.958097+0000","last_became_active":"2023-10-01T07:51:56.926080+0000","last_became_peered":"2023-10-01T07:51:56.926080+0000","last_unstale":"2023-10-01T07:52:47.958097+0000","last_undegraded":"2023-10-01T07:52:47.958097+0000","last_fullsized":"2023-10-01T07:52:47.958097+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696936+0000","last_change":"2023-10-01T07:51:57.325464+0000","last_active":"2023-10-01T07:52:47.696936+0000","last_peered":"2023-10-01T07:52:47.696936+0000","last_clean":"2023-10-01T07:52:47.696936+0000","last_became_active":"2023-10-01T07:51:57.325143+0000","last_became_peered":"2023-10-01T07:51:57.325143+0000","last_unstale":"2023-10-01T07:52:47.696936+0000","last_undegraded":"2023-10-01T07:52:47.696936+0000","last_fullsized":"2023-10-01T07:52:47.696936+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.956272+0000","last_change":"2023-10-01T07:51:56.922808+0000","last_active":"2023-10-01T07:52:47.956272+0000","last_peered":"2023-10-01T07:52:47.956272+0000","last_clean":"2023-10-01T07:52:47.956272+0000","last_became_active":"2023-10-01T07:51:56.922520+0000","last_became_peered":"2023-10-01T07:51:56.922520+0000","last_unstale":"2023-10-01T07:52:47.956272+0000","last_undegraded":"2023-10-01T07:52:47.956272+0000","last_fullsized":"2023-10-01T07:52:47.956272+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.958792+0000","last_change":"2023-10-01T07:51:57.346026+0000","last_active":"2023-10-01T07:52:47.958792+0000","last_peered":"2023-10-01T07:52:47.958792+0000","last_clean":"2023-10-01T07:52:47.958792+0000","last_became_active":"2023-10-01T07:51:57.345720+0000","last_became_peered":"2023-10-01T07:51:57.345720+0000","last_unstale":"2023-10-01T07:52:47.958792+0000","last_undegraded":"2023-10-01T07:52:47.958792+0000","last_fullsized":"2023-10-01T07:52:47.958792+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696794+0000","last_change":"2023-10-01T07:51:56.922474+0000","last_active":"2023-10-01T07:52:47.696794+0000","last_peered":"2023-10-01T07:52:47.696794+0000","last_clean":"2023-10-01T07:52:47.696794+0000","last_became_active":"2023-10-01T07:51:56.921742+0000","last_became_peered":"2023-10-01T07:51:56.921742+0000","last_unstale":"2023-10-01T07:52:47.696794+0000","last_undegraded":"2023-10-01T07:52:47.696794+0000","last_fullsized":"2023-10-01T07:52:47.696794+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.956454+0000","last_change":"2023-10-01T07:51:57.340546+0000","last_active":"2023-10-01T07:52:47.956454+0000","last_peered":"2023-10-01T07:52:47.956454+0000","last_clean":"2023-10-01T07:52:47.956454+0000","last_became_active":"2023-10-01T07:51:57.340112+0000","last_became_peered":"2023-10-01T07:51:57.340112+0000","last_unstale":"2023-10-01T07:52:47.956454+0000","last_undegraded":"2023-10-01T07:52:47.956454+0000","last_fullsized":"2023-10-01T07:52:47.956454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.699264+0000","last_change":"2023-10-01T07:51:56.917629+0000","last_active":"2023-10-01T07:52:47.699264+0000","last_peered":"2023-10-01T07:52:47.699264+0000","last_clean":"2023-10-01T07:52:47.699264+0000","last_became_active":"2023-10-01T07:51:56.917154+0000","last_became_peered":"2023-10-01T07:51:56.917154+0000","last_unstale":"2023-10-01T07:52:47.699264+0000","last_undegraded":"2023-10-01T07:52:47.699264+0000","last_fullsized":"2023-10-01T07:52:47.699264+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.956751+0000","last_change":"2023-10-01T07:51:57.340793+0000","last_active":"2023-10-01T07:52:47.956751+0000","last_peered":"2023-10-01T07:52:47.956751+0000","last_clean":"2023-10-01T07:52:47.956751+0000","last_became_active":"2023-10-01T07:51:57.340504+0000","last_became_peered":"2023-10-01T07:51:57.340504+0000","last_unstale":"2023-10-01T07:52:47.956751+0000","last_undegraded":"2023-10-01T07:52:47.956751+0000","last_fullsized":"2023-10-01T07:52:47.956751+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.958465+0000","last_change":"2023-10-01T07:51:56.925699+0000","last_active":"2023-10-01T07:52:47.958465+0000","last_peered":"2023-10-01T07:52:47.958465+0000","last_clean":"2023-10-01T07:52:47.958465+0000","last_became_active":"2023-10-01T07:51:56.925216+0000","last_became_peered":"2023-10-01T07:51:56.925216+0000","last_unstale":"2023-10-01T07:52:47.958465+0000","last_undegraded":"2023-10-01T07:52:47.958465+0000","last_fullsized":"2023-10-01T07:52:47.958465+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.703331+0000","last_change":"2023-10-01T07:52:47.701820+0000","last_active":"2023-10-01T07:52:47.703331+0000","last_peered":"2023-10-01T07:52:47.703331+0000","last_clean":"2023-10-01T07:52:47.703331+0000","last_became_active":"2023-10-01T07:52:47.701336+0000","last_became_peered":"2023-10-01T07:52:47.701336+0000","last_unstale":"2023-10-01T07:52:47.703331+0000","last_undegraded":"2023-10-01T07:52:47.703331+0000","last_fullsized":"2023-10-01T07:52:47.703331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696777+0000","last_change":"2023-10-01T07:51:56.915532+0000","last_active":"2023-10-01T07:52:47.696777+0000","last_peered":"2023-10-01T07:52:47.696777+0000","last_clean":"2023-10-01T07:52:47.696777+0000","last_became_active":"2023-10-01T07:51:56.912225+0000","last_became_peered":"2023-10-01T07:51:56.912225+0000","last_unstale":"2023-10-01T07:52:47.696777+0000","last_undegraded":"2023-10-01T07:52:47.696777+0000","last_fullsized":"2023-10-01T07:52:47.696777+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696534+0000","last_change":"2023-10-01T07:51:57.331858+0000","last_active":"2023-10-01T07:52:47.696534+0000","last_peered":"2023-10-01T07:52:47.696534+0000","last_clean":"2023-10-01T07:52:47.696534+0000","last_became_active":"2023-10-01T07:51:57.331568+0000","last_became_peered":"2023-10-01T07:51:57.331568+0000","last_unstale":"2023-10-01T07:52:47.696534+0000","last_undegraded":"2023-10-01T07:52:47.696534+0000","last_fullsized":"2023-10-01T07:52:47.696534+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957094+0000","last_change":"2023-10-01T07:51:56.924345+0000","last_active":"2023-10-01T07:52:47.957094+0000","last_peered":"2023-10-01T07:52:47.957094+0000","last_clean":"2023-10-01T07:52:47.957094+0000","last_became_active":"2023-10-01T07:51:56.923915+0000","last_became_peered":"2023-10-01T07:51:56.923915+0000","last_unstale":"2023-10-01T07:52:47.957094+0000","last_undegraded":"2023-10-01T07:52:47.957094+0000","last_fullsized":"2023-10-01T07:52:47.957094+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696658+0000","last_change":"2023-10-01T07:51:57.326926+0000","last_active":"2023-10-01T07:52:47.696658+0000","last_peered":"2023-10-01T07:52:47.696658+0000","last_clean":"2023-10-01T07:52:47.696658+0000","last_became_active":"2023-10-01T07:51:57.326597+0000","last_became_peered":"2023-10-01T07:51:57.326597+0000","last_unstale":"2023-10-01T07:52:47.696658+0000","last_undegraded":"2023-10-01T07:52:47.696658+0000","last_fullsized":"2023-10-01T07:52:47.696658+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957127+0000","last_change":"2023-10-01T07:51:56.918471+0000","last_active":"2023-10-01T07:52:47.957127+0000","last_peered":"2023-10-01T07:52:47.957127+0000","last_clean":"2023-10-01T07:52:47.957127+0000","last_became_active":"2023-10-01T07:51:56.918165+0000","last_became_peered":"2023-10-01T07:51:56.918165+0000","last_unstale":"2023-10-01T07:52:47.957127+0000","last_undegraded":"2023-10-01T07:52:47.957127+0000","last_fullsized":"2023-10-01T07:52:47.957127+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.958356+0000","last_change":"2023-10-01T07:51:57.338218+0000","last_active":"2023-10-01T07:52:47.958356+0000","last_peered":"2023-10-01T07:52:47.958356+0000","last_clean":"2023-10-01T07:52:47.958356+0000","last_became_active":"2023-10-01T07:51:57.337910+0000","last_became_peered":"2023-10-01T07:51:57.337910+0000","last_unstale":"2023-10-01T07:52:47.958356+0000","last_undegraded":"2023-10-01T07:52:47.958356+0000","last_fullsized":"2023-10-01T07:52:47.958356+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957841+0000","last_change":"2023-10-01T07:51:56.926078+0000","last_active":"2023-10-01T07:52:47.957841+0000","last_peered":"2023-10-01T07:52:47.957841+0000","last_clean":"2023-10-01T07:52:47.957841+0000","last_became_active":"2023-10-01T07:51:56.925681+0000","last_became_peered":"2023-10-01T07:51:56.925681+0000","last_unstale":"2023-10-01T07:52:47.957841+0000","last_undegraded":"2023-10-01T07:52:47.957841+0000","last_fullsized":"2023-10-01T07:52:47.957841+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.703392+0000","last_change":"2023-10-01T07:52:47.702019+0000","last_active":"2023-10-01T07:52:47.703392+0000","last_peered":"2023-10-01T07:52:47.703392+0000","last_clean":"2023-10-01T07:52:47.703392+0000","last_became_active":"2023-10-01T07:52:47.701477+0000","last_became_peered":"2023-10-01T07:52:47.701477+0000","last_unstale":"2023-10-01T07:52:47.703392+0000","last_undegraded":"2023-10-01T07:52:47.703392+0000","last_fullsized":"2023-10-01T07:52:47.703392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.956060+0000","last_change":"2023-10-01T07:51:56.918564+0000","last_active":"2023-10-01T07:52:47.956060+0000","last_peered":"2023-10-01T07:52:47.956060+0000","last_clean":"2023-10-01T07:52:47.956060+0000","last_became_active":"2023-10-01T07:51:56.918275+0000","last_became_peered":"2023-10-01T07:51:56.918275+0000","last_unstale":"2023-10-01T07:52:47.956060+0000","last_undegraded":"2023-10-01T07:52:47.956060+0000","last_fullsized":"2023-10-01T07:52:47.956060+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.958567+0000","last_change":"2023-10-01T07:51:57.347574+0000","last_active":"2023-10-01T07:52:47.958567+0000","last_peered":"2023-10-01T07:52:47.958567+0000","last_clean":"2023-10-01T07:52:47.958567+0000","last_became_active":"2023-10-01T07:51:57.347243+0000","last_became_peered":"2023-10-01T07:51:57.347243+0000","last_unstale":"2023-10-01T07:52:47.958567+0000","last_undegraded":"2023-10-01T07:52:47.958567+0000","last_fullsized":"2023-10-01T07:52:47.958567+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.955885+0000","last_change":"2023-10-01T07:51:51.883413+0000","last_active":"2023-10-01T07:52:47.955885+0000","last_peered":"2023-10-01T07:52:47.955885+0000","last_clean":"2023-10-01T07:52:47.955885+0000","last_became_active":"2023-10-01T07:51:51.883088+0000","last_became_peered":"2023-10-01T07:51:51.883088+0000","last_unstale":"2023-10-01T07:52:47.955885+0000","last_undegraded":"2023-10-01T07:52:47.955885+0000","last_fullsized":"2023-10-01T07:52:47.955885+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.698357+0000","last_change":"2023-10-01T07:51:56.914139+0000","last_active":"2023-10-01T07:52:47.698357+0000","last_peered":"2023-10-01T07:52:47.698357+0000","last_clean":"2023-10-01T07:52:47.698357+0000","last_became_active":"2023-10-01T07:51:56.913026+0000","last_became_peered":"2023-10-01T07:51:56.913026+0000","last_unstale":"2023-10-01T07:52:47.698357+0000","last_undegraded":"2023-10-01T07:52:47.698357+0000","last_fullsized":"2023-10-01T07:52:47.698357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.956873+0000","last_change":"2023-10-01T07:51:57.334103+0000","last_active":"2023-10-01T07:52:47.956873+0000","last_peered":"2023-10-01T07:52:47.956873+0000","last_clean":"2023-10-01T07:52:47.956873+0000","last_became_active":"2023-10-01T07:51:57.333743+0000","last_became_peered":"2023-10-01T07:51:57.333743+0000","last_unstale":"2023-10-01T07:52:47.956873+0000","last_undegraded":"2023-10-01T07:52:47.956873+0000","last_fullsized":"2023-10-01T07:52:47.956873+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957212+0000","last_change":"2023-10-01T07:51:51.882685+0000","last_active":"2023-10-01T07:52:47.957212+0000","last_peered":"2023-10-01T07:52:47.957212+0000","last_clean":"2023-10-01T07:52:47.957212+0000","last_became_active":"2023-10-01T07:51:51.882396+0000","last_became_peered":"2023-10-01T07:51:51.882396+0000","last_unstale":"2023-10-01T07:52:47.957212+0000","last_undegraded":"2023-10-01T07:52:47.957212+0000","last_fullsized":"2023-10-01T07:52:47.957212+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696142+0000","last_change":"2023-10-01T07:51:56.915631+0000","last_active":"2023-10-01T07:52:47.696142+0000","last_peered":"2023-10-01T07:52:47.696142+0000","last_clean":"2023-10-01T07:52:47.696142+0000","last_became_active":"2023-10-01T07:51:56.911566+0000","last_became_peered":"2023-10-01T07:51:56.911566+0000","last_unstale":"2023-10-01T07:52:47.696142+0000","last_undegraded":"2023-10-01T07:52:47.696142+0000","last_fullsized":"2023-10-01T07:52:47.696142+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957246+0000","last_change":"2023-10-01T07:51:57.319612+0000","last_active":"2023-10-01T07:52:47.957246+0000","last_peered":"2023-10-01T07:52:47.957246+0000","last_clean":"2023-10-01T07:52:47.957246+0000","last_became_active":"2023-10-01T07:51:57.319125+0000","last_became_peered":"2023-10-01T07:51:57.319125+0000","last_unstale":"2023-10-01T07:52:47.957246+0000","last_undegraded":"2023-10-01T07:52:47.957246+0000","last_fullsized":"2023-10-01T07:52:47.957246+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.698762+0000","last_change":"2023-10-01T07:51:51.885336+0000","last_active":"2023-10-01T07:52:47.698762+0000","last_peered":"2023-10-01T07:52:47.698762+0000","last_clean":"2023-10-01T07:52:47.698762+0000","last_became_active":"2023-10-01T07:51:51.884991+0000","last_became_peered":"2023-10-01T07:51:51.884991+0000","last_unstale":"2023-10-01T07:52:47.698762+0000","last_undegraded":"2023-10-01T07:52:47.698762+0000","last_fullsized":"2023-10-01T07:52:47.698762+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.956099+0000","last_change":"2023-10-01T07:51:56.929636+0000","last_active":"2023-10-01T07:52:47.956099+0000","last_peered":"2023-10-01T07:52:47.956099+0000","last_clean":"2023-10-01T07:52:47.956099+0000","last_became_active":"2023-10-01T07:51:56.929308+0000","last_became_peered":"2023-10-01T07:51:56.929308+0000","last_unstale":"2023-10-01T07:52:47.956099+0000","last_undegraded":"2023-10-01T07:52:47.956099+0000","last_fullsized":"2023-10-01T07:52:47.956099+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.702622+0000","last_change":"2023-10-01T07:52:47.701115+0000","last_active":"2023-10-01T07:52:47.702622+0000","last_peered":"2023-10-01T07:52:47.702622+0000","last_clean":"2023-10-01T07:52:47.702622+0000","last_became_active":"2023-10-01T07:52:47.700737+0000","last_became_peered":"2023-10-01T07:52:47.700737+0000","last_unstale":"2023-10-01T07:52:47.702622+0000","last_undegraded":"2023-10-01T07:52:47.702622+0000","last_fullsized":"2023-10-01T07:52:47.702622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.955427+0000","last_change":"2023-10-01T07:51:51.882657+0000","last_active":"2023-10-01T07:52:47.955427+0000","last_peered":"2023-10-01T07:52:47.955427+0000","last_clean":"2023-10-01T07:52:47.955427+0000","last_became_active":"2023-10-01T07:51:51.882334+0000","last_became_peered":"2023-10-01T07:51:51.882334+0000","last_unstale":"2023-10-01T07:52:47.955427+0000","last_undegraded":"2023-10-01T07:52:47.955427+0000","last_fullsized":"2023-10-01T07:52:47.955427+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.956137+0000","last_change":"2023-10-01T07:51:50.871456+0000","last_active":"2023-10-01T07:52:47.956137+0000","last_peered":"2023-10-01T07:52:47.956137+0000","last_clean":"2023-10-01T07:52:47.956137+0000","last_became_active":"2023-10-01T07:51:50.871112+0000","last_became_peered":"2023-10-01T07:51:50.871112+0000","last_unstale":"2023-10-01T07:52:47.956137+0000","last_undegraded":"2023-10-01T07:52:47.956137+0000","last_fullsized":"2023-10-01T07:52:47.956137+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:49.856372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:49.856372+0000","last_clean_scrub_stamp":"2023-10-01T07:51:49.856372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957035+0000","last_change":"2023-10-01T07:51:56.925843+0000","last_active":"2023-10-01T07:52:47.957035+0000","last_peered":"2023-10-01T07:52:47.957035+0000","last_clean":"2023-10-01T07:52:47.957035+0000","last_became_active":"2023-10-01T07:51:56.925538+0000","last_became_peered":"2023-10-01T07:51:56.925538+0000","last_unstale":"2023-10-01T07:52:47.957035+0000","last_undegraded":"2023-10-01T07:52:47.957035+0000","last_fullsized":"2023-10-01T07:52:47.957035+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.960808+0000","last_change":"2023-10-01T07:52:47.959074+0000","last_active":"2023-10-01T07:52:47.960808+0000","last_peered":"2023-10-01T07:52:47.960808+0000","last_clean":"2023-10-01T07:52:47.960808+0000","last_became_active":"2023-10-01T07:52:47.958738+0000","last_became_peered":"2023-10-01T07:52:47.958738+0000","last_unstale":"2023-10-01T07:52:47.960808+0000","last_undegraded":"2023-10-01T07:52:47.960808+0000","last_fullsized":"2023-10-01T07:52:47.960808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.956251+0000","last_change":"2023-10-01T07:51:51.882831+0000","last_active":"2023-10-01T07:52:47.956251+0000","last_peered":"2023-10-01T07:52:47.956251+0000","last_clean":"2023-10-01T07:52:47.956251+0000","last_became_active":"2023-10-01T07:51:51.882490+0000","last_became_peered":"2023-10-01T07:51:51.882490+0000","last_unstale":"2023-10-01T07:52:47.956251+0000","last_undegraded":"2023-10-01T07:52:47.956251+0000","last_fullsized":"2023-10-01T07:52:47.956251+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696165+0000","last_change":"2023-10-01T07:51:56.929720+0000","last_active":"2023-10-01T07:52:47.696165+0000","last_peered":"2023-10-01T07:52:47.696165+0000","last_clean":"2023-10-01T07:52:47.696165+0000","last_became_active":"2023-10-01T07:51:56.929370+0000","last_became_peered":"2023-10-01T07:51:56.929370+0000","last_unstale":"2023-10-01T07:52:47.696165+0000","last_undegraded":"2023-10-01T07:52:47.696165+0000","last_fullsized":"2023-10-01T07:52:47.696165+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696992+0000","last_change":"2023-10-01T07:51:57.335095+0000","last_active":"2023-10-01T07:52:47.696992+0000","last_peered":"2023-10-01T07:52:47.696992+0000","last_clean":"2023-10-01T07:52:47.696992+0000","last_became_active":"2023-10-01T07:51:57.334324+0000","last_became_peered":"2023-10-01T07:51:57.334324+0000","last_unstale":"2023-10-01T07:52:47.696992+0000","last_undegraded":"2023-10-01T07:52:47.696992+0000","last_fullsized":"2023-10-01T07:52:47.696992+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.955620+0000","last_change":"2023-10-01T07:51:51.884196+0000","last_active":"2023-10-01T07:52:47.955620+0000","last_peered":"2023-10-01T07:52:47.955620+0000","last_clean":"2023-10-01T07:52:47.955620+0000","last_became_active":"2023-10-01T07:51:51.883784+0000","last_became_peered":"2023-10-01T07:51:51.883784+0000","last_unstale":"2023-10-01T07:52:47.955620+0000","last_undegraded":"2023-10-01T07:52:47.955620+0000","last_fullsized":"2023-10-01T07:52:47.955620+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957161+0000","last_change":"2023-10-01T07:51:56.913348+0000","last_active":"2023-10-01T07:52:47.957161+0000","last_peered":"2023-10-01T07:52:47.957161+0000","last_clean":"2023-10-01T07:52:47.957161+0000","last_became_active":"2023-10-01T07:51:56.913041+0000","last_became_peered":"2023-10-01T07:51:56.913041+0000","last_unstale":"2023-10-01T07:52:47.957161+0000","last_undegraded":"2023-10-01T07:52:47.957161+0000","last_fullsized":"2023-10-01T07:52:47.957161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696395+0000","last_change":"2023-10-01T07:51:57.313930+0000","last_active":"2023-10-01T07:52:47.696395+0000","last_peered":"2023-10-01T07:52:47.696395+0000","last_clean":"2023-10-01T07:52:47.696395+0000","last_became_active":"2023-10-01T07:51:57.313613+0000","last_became_peered":"2023-10-01T07:51:57.313613+0000","last_unstale":"2023-10-01T07:52:47.696395+0000","last_undegraded":"2023-10-01T07:52:47.696395+0000","last_fullsized":"2023-10-01T07:52:47.696395+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.958516+0000","last_change":"2023-10-01T07:51:56.929769+0000","last_active":"2023-10-01T07:52:47.958516+0000","last_peered":"2023-10-01T07:52:47.958516+0000","last_clean":"2023-10-01T07:52:47.958516+0000","last_became_active":"2023-10-01T07:51:56.929479+0000","last_became_peered":"2023-10-01T07:51:56.929479+0000","last_unstale":"2023-10-01T07:52:47.958516+0000","last_undegraded":"2023-10-01T07:52:47.958516+0000","last_fullsized":"2023-10-01T07:52:47.958516+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.956719+0000","last_change":"2023-10-01T07:51:51.883317+0000","last_active":"2023-10-01T07:52:47.956719+0000","last_peered":"2023-10-01T07:52:47.956719+0000","last_clean":"2023-10-01T07:52:47.956719+0000","last_became_active":"2023-10-01T07:51:51.883005+0000","last_became_peered":"2023-10-01T07:51:51.883005+0000","last_unstale":"2023-10-01T07:52:47.956719+0000","last_undegraded":"2023-10-01T07:52:47.956719+0000","last_fullsized":"2023-10-01T07:52:47.956719+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.961267+0000","last_change":"2023-10-01T07:52:47.959990+0000","last_active":"2023-10-01T07:52:47.961267+0000","last_peered":"2023-10-01T07:52:47.961267+0000","last_clean":"2023-10-01T07:52:47.961267+0000","last_became_active":"2023-10-01T07:52:47.959464+0000","last_became_peered":"2023-10-01T07:52:47.959464+0000","last_unstale":"2023-10-01T07:52:47.961267+0000","last_undegraded":"2023-10-01T07:52:47.961267+0000","last_fullsized":"2023-10-01T07:52:47.961267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.955730+0000","last_change":"2023-10-01T07:51:51.883299+0000","last_active":"2023-10-01T07:52:47.955730+0000","last_peered":"2023-10-01T07:52:47.955730+0000","last_clean":"2023-10-01T07:52:47.955730+0000","last_became_active":"2023-10-01T07:51:51.883001+0000","last_became_peered":"2023-10-01T07:51:51.883001+0000","last_unstale":"2023-10-01T07:52:47.955730+0000","last_undegraded":"2023-10-01T07:52:47.955730+0000","last_fullsized":"2023-10-01T07:52:47.955730+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:50.861035+0000","last_clean_scrub_stamp":"2023-10-01T07:51:50.861035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696819+0000","last_change":"2023-10-01T07:51:56.921291+0000","last_active":"2023-10-01T07:52:47.696819+0000","last_peered":"2023-10-01T07:52:47.696819+0000","last_clean":"2023-10-01T07:52:47.696819+0000","last_became_active":"2023-10-01T07:51:56.920989+0000","last_became_peered":"2023-10-01T07:51:56.920989+0000","last_unstale":"2023-10-01T07:52:47.696819+0000","last_undegraded":"2023-10-01T07:52:47.696819+0000","last_fullsized":"2023-10-01T07:52:47.696819+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.698179+0000","last_change":"2023-10-01T07:51:57.342916+0000","last_active":"2023-10-01T07:52:47.698179+0000","last_peered":"2023-10-01T07:52:47.698179+0000","last_clean":"2023-10-01T07:52:47.698179+0000","last_became_active":"2023-10-01T07:51:57.342653+0000","last_became_peered":"2023-10-01T07:51:57.342653+0000","last_unstale":"2023-10-01T07:52:47.698179+0000","last_undegraded":"2023-10-01T07:52:47.698179+0000","last_fullsized":"2023-10-01T07:52:47.698179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696263+0000","last_change":"2023-10-01T07:51:56.916437+0000","last_active":"2023-10-01T07:52:47.696263+0000","last_peered":"2023-10-01T07:52:47.696263+0000","last_clean":"2023-10-01T07:52:47.696263+0000","last_became_active":"2023-10-01T07:51:56.915935+0000","last_became_peered":"2023-10-01T07:51:56.915935+0000","last_unstale":"2023-10-01T07:52:47.696263+0000","last_undegraded":"2023-10-01T07:52:47.696263+0000","last_fullsized":"2023-10-01T07:52:47.696263+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.698359+0000","last_change":"2023-10-01T07:51:57.330536+0000","last_active":"2023-10-01T07:52:47.698359+0000","last_peered":"2023-10-01T07:52:47.698359+0000","last_clean":"2023-10-01T07:52:47.698359+0000","last_became_active":"2023-10-01T07:51:57.330151+0000","last_became_peered":"2023-10-01T07:51:57.330151+0000","last_unstale":"2023-10-01T07:52:47.698359+0000","last_undegraded":"2023-10-01T07:52:47.698359+0000","last_fullsized":"2023-10-01T07:52:47.698359+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957335+0000","last_change":"2023-10-01T07:51:56.922316+0000","last_active":"2023-10-01T07:52:47.957335+0000","last_peered":"2023-10-01T07:52:47.957335+0000","last_clean":"2023-10-01T07:52:47.957335+0000","last_became_active":"2023-10-01T07:51:56.922003+0000","last_became_peered":"2023-10-01T07:51:56.922003+0000","last_unstale":"2023-10-01T07:52:47.957335+0000","last_undegraded":"2023-10-01T07:52:47.957335+0000","last_fullsized":"2023-10-01T07:52:47.957335+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.703370+0000","last_change":"2023-10-01T07:52:47.702289+0000","last_active":"2023-10-01T07:52:47.703370+0000","last_peered":"2023-10-01T07:52:47.703370+0000","last_clean":"2023-10-01T07:52:47.703370+0000","last_became_active":"2023-10-01T07:52:47.701419+0000","last_became_peered":"2023-10-01T07:52:47.701419+0000","last_unstale":"2023-10-01T07:52:47.703370+0000","last_undegraded":"2023-10-01T07:52:47.703370+0000","last_fullsized":"2023-10-01T07:52:47.703370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.958665+0000","last_change":"2023-10-01T07:51:56.925522+0000","last_active":"2023-10-01T07:52:47.958665+0000","last_peered":"2023-10-01T07:52:47.958665+0000","last_clean":"2023-10-01T07:52:47.958665+0000","last_became_active":"2023-10-01T07:51:56.924830+0000","last_became_peered":"2023-10-01T07:51:56.924830+0000","last_unstale":"2023-10-01T07:52:47.958665+0000","last_undegraded":"2023-10-01T07:52:47.958665+0000","last_fullsized":"2023-10-01T07:52:47.958665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.698045+0000","last_change":"2023-10-01T07:51:57.340653+0000","last_active":"2023-10-01T07:52:47.698045+0000","last_peered":"2023-10-01T07:52:47.698045+0000","last_clean":"2023-10-01T07:52:47.698045+0000","last_became_active":"2023-10-01T07:51:57.340395+0000","last_became_peered":"2023-10-01T07:51:57.340395+0000","last_unstale":"2023-10-01T07:52:47.698045+0000","last_undegraded":"2023-10-01T07:52:47.698045+0000","last_fullsized":"2023-10-01T07:52:47.698045+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.958076+0000","last_change":"2023-10-01T07:51:56.924298+0000","last_active":"2023-10-01T07:52:47.958076+0000","last_peered":"2023-10-01T07:52:47.958076+0000","last_clean":"2023-10-01T07:52:47.958076+0000","last_became_active":"2023-10-01T07:51:56.923975+0000","last_became_peered":"2023-10-01T07:51:56.923975+0000","last_unstale":"2023-10-01T07:52:47.958076+0000","last_undegraded":"2023-10-01T07:52:47.958076+0000","last_fullsized":"2023-10-01T07:52:47.958076+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.958322+0000","last_change":"2023-10-01T07:51:57.339026+0000","last_active":"2023-10-01T07:52:47.958322+0000","last_peered":"2023-10-01T07:52:47.958322+0000","last_clean":"2023-10-01T07:52:47.958322+0000","last_became_active":"2023-10-01T07:51:57.338722+0000","last_became_peered":"2023-10-01T07:51:57.338722+0000","last_unstale":"2023-10-01T07:52:47.958322+0000","last_undegraded":"2023-10-01T07:52:47.958322+0000","last_fullsized":"2023-10-01T07:52:47.958322+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.697059+0000","last_change":"2023-10-01T07:51:56.922677+0000","last_active":"2023-10-01T07:52:47.697059+0000","last_peered":"2023-10-01T07:52:47.697059+0000","last_clean":"2023-10-01T07:52:47.697059+0000","last_became_active":"2023-10-01T07:51:56.922121+0000","last_became_peered":"2023-10-01T07:51:56.922121+0000","last_unstale":"2023-10-01T07:52:47.697059+0000","last_undegraded":"2023-10-01T07:52:47.697059+0000","last_fullsized":"2023-10-01T07:52:47.697059+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:55.881867+0000","last_clean_scrub_stamp":"2023-10-01T07:51:55.881867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.697708+0000","last_change":"2023-10-01T07:51:57.329519+0000","last_active":"2023-10-01T07:52:47.697708+0000","last_peered":"2023-10-01T07:52:47.697708+0000","last_clean":"2023-10-01T07:52:47.697708+0000","last_became_active":"2023-10-01T07:51:57.329191+0000","last_became_peered":"2023-10-01T07:51:57.329191+0000","last_unstale":"2023-10-01T07:52:47.697708+0000","last_undegraded":"2023-10-01T07:52:47.697708+0000","last_fullsized":"2023-10-01T07:52:47.697708+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.956230+0000","last_change":"2023-10-01T07:51:57.320100+0000","last_active":"2023-10-01T07:52:47.956230+0000","last_peered":"2023-10-01T07:52:47.956230+0000","last_clean":"2023-10-01T07:52:47.956230+0000","last_became_active":"2023-10-01T07:51:57.319593+0000","last_became_peered":"2023-10-01T07:51:57.319593+0000","last_unstale":"2023-10-01T07:52:47.956230+0000","last_undegraded":"2023-10-01T07:52:47.956230+0000","last_fullsized":"2023-10-01T07:52:47.956230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.961188+0000","last_change":"2023-10-01T07:52:47.959972+0000","last_active":"2023-10-01T07:52:47.961188+0000","last_peered":"2023-10-01T07:52:47.961188+0000","last_clean":"2023-10-01T07:52:47.961188+0000","last_became_active":"2023-10-01T07:52:47.959512+0000","last_became_peered":"2023-10-01T07:52:47.959512+0000","last_unstale":"2023-10-01T07:52:47.961188+0000","last_undegraded":"2023-10-01T07:52:47.961188+0000","last_fullsized":"2023-10-01T07:52:47.961188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.696217+0000","last_change":"2023-10-01T07:51:57.326270+0000","last_active":"2023-10-01T07:52:47.696217+0000","last_peered":"2023-10-01T07:52:47.696217+0000","last_clean":"2023-10-01T07:52:47.696217+0000","last_became_active":"2023-10-01T07:51:57.325956+0000","last_became_peered":"2023-10-01T07:51:57.325956+0000","last_unstale":"2023-10-01T07:52:47.696217+0000","last_undegraded":"2023-10-01T07:52:47.696217+0000","last_fullsized":"2023-10-01T07:52:47.696217+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957281+0000","last_change":"2023-10-01T07:51:57.338041+0000","last_active":"2023-10-01T07:52:47.957281+0000","last_peered":"2023-10-01T07:52:47.957281+0000","last_clean":"2023-10-01T07:52:47.957281+0000","last_became_active":"2023-10-01T07:51:57.337719+0000","last_became_peered":"2023-10-01T07:51:57.337719+0000","last_unstale":"2023-10-01T07:52:47.957281+0000","last_undegraded":"2023-10-01T07:52:47.957281+0000","last_fullsized":"2023-10-01T07:52:47.957281+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-01T07:52:47.957438+0000","last_change":"2023-10-01T07:51:57.319429+0000","last_active":"2023-10-01T07:52:47.957438+0000","last_peered":"2023-10-01T07:52:47.957438+0000","last_clean":"2023-10-01T07:52:47.957438+0000","last_became_active":"2023-10-01T07:51:57.318849+0000","last_became_peered":"2023-10-01T07:51:57.318849+0000","last_unstale":"2023-10-01T07:52:47.957438+0000","last_undegraded":"2023-10-01T07:52:47.957438+0000","last_fullsized":"2023-10-01T07:52:47.957438+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-01T07:51:56.885908+0000","last_clean_scrub_stamp":"2023-10-01T07:51:56.885908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705696,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297280,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074560,"statfs":{"total":96636764160,"available":96332349440,"internally_reserved":0,"allocated":188416,"data_stored":67123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 07:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33000000000000002,"15min":0.32700000000000001},"min":{"1min":0.28000000000000003,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.372},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.35099999999999998,"15min":0.34899999999999998},"min":{"1min":0.27100000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.29599999999999999}]},{"osd":1,"last update":"Sun Oct 1 07:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.52700000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.311},{"interface":"front","average":{"1min":0.378,"5min":0.376,"15min":0.376},"min":{"1min":0.30299999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.50800000000000001,"5min":0.626,"15min":0.626},"last":0.32600000000000001}]},{"osd":3,"last update":"Sun Oct 1 07:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.38400000000000001,"15min":0.38600000000000001},"min":{"1min":0.29499999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.495,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.41199999999999998,"15min":0.41299999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.58399999999999996,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.35499999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705696,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297280,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074560,"statfs":{"total":96636764160,"available":96332349440,"internally_reserved":0,"allocated":188416,"data_stored":64206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 07:53:51 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.23400000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35899999999999999,"15min":0.35999999999999999},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.47499999999999998,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.44700000000000001}]},{"osd":2,"last update":"Sun Oct 1 07:53:51 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.318,"15min":0.32000000000000001},"min":{"1min":0.246,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.41599999999999998,"5min":0.505,"15min":0.505},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.45600000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.42499999999999999}]},{"osd":3,"last update":"Sun Oct 1 07:53:51 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.33600000000000002,"15min":0.33800000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.42299999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35599999999999998,"15min":0.35699999999999998},"min":{"1min":0.28599999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.45900000000000002,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.46400000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705696,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297284,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074556,"statfs":{"total":96636764160,"available":96332345344,"internally_reserved":0,"allocated":192512,"data_stored":64260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 1 07:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.36199999999999999,"15min":0.36799999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.45700000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.38900000000000001,"15min":0.39500000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.54300000000000004,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.30099999999999999}]},{"osd":2,"last update":"Sun Oct 1 07:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.40600000000000003,"15min":0.41199999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.50800000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.37,"5min":0.41499999999999998,"15min":0.42299999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.48599999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.317}]},{"osd":3,"last update":"Sun Oct 1 07:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.42099999999999999,"15min":0.42799999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.49099999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.40899999999999997,"15min":0.41699999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.497,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.26500000000000001}]}]},{"osd":3,"up_from":9,"seq":38654705695,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297292,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074548,"statfs":{"total":96636764160,"available":96332337152,"internally_reserved":0,"allocated":200704,"data_stored":67317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 07:53:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.27100000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.47299999999999998,"5min":0.501,"15min":0.501},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.41499999999999998}]},{"osd":1,"last update":"Sun Oct 1 07:53:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.35799999999999998,"15min":0.35599999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35799999999999998,"15min":0.35899999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.48299999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.40000000000000002}]},{"osd":2,"last update":"Sun Oct 1 07:53:56 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.36199999999999999,"15min":0.35699999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.37,"15min":0.37},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.442}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-01T07:54:18.960 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-01T07:54:18.960 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-01T07:54:18.960 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-01T07:54:18.960 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-01T07:54:19.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.131+0000 7fe04eda2700 1 Processor -- start 2023-10-01T07:54:19.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.131+0000 7fe04eda2700 1 -- start start 2023-10-01T07:54:19.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.131+0000 7fe04eda2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe048133420 0x7fe0481337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:19.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.131+0000 7fe04eda2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe048133e30 0x7fe04812ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:19.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.131+0000 7fe04eda2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe04806b990 con 0x7fe048134260 2023-10-01T07:54:19.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.131+0000 7fe04eda2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0480a0590 con 0x7fe048133e30 2023-10-01T07:54:19.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.131+0000 7fe04eda2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe04809fb80 con 0x7fe048133420 2023-10-01T07:54:19.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.131+0000 7fe04cb3e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe048133420 0x7fe0481337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:19.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.131+0000 7fe04cb3e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe048133420 0x7fe0481337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55768/0 (socket says 172.21.15.26:55768) 2023-10-01T07:54:19.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.132+0000 7fe04cb3e700 1 -- 172.21.15.26:0/541920142 learned_addr learned my addr 172.21.15.26:0/541920142 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:19.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.132+0000 7fe047fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe048133e30 0x7fe04812ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:19.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.132+0000 7fe04cb3e700 1 -- 172.21.15.26:0/541920142 >> v2:172.21.15.26:3300/0 conn(0x7fe048133e30 msgr2=0x7fe04812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:19.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.132+0000 7fe04cb3e700 1 --2- 172.21.15.26:0/541920142 >> v2:172.21.15.26:3300/0 conn(0x7fe048133e30 0x7fe04812ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:19.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.132+0000 7fe04cb3e700 1 -- 172.21.15.26:0/541920142 >> v1:172.21.15.26:6789/0 conn(0x7fe048134260 legacy=0x7fe0481304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:19.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.132+0000 7fe04cb3e700 1 -- 172.21.15.26:0/541920142 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0480a0030 con 0x7fe048133420 2023-10-01T07:54:19.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.132+0000 7fe0477fe700 1 -- 172.21.15.26:0/541920142 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2357845308 0 0) 0x7fe04806b990 con 0x7fe048134260 2023-10-01T07:54:19.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.132+0000 7fe047fff700 1 --2- 172.21.15.26:0/541920142 >> v2:172.21.15.26:3300/0 conn(0x7fe048133e30 0x7fe04812ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:19.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.132+0000 7fe04cb3e700 1 --2- 172.21.15.26:0/541920142 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe048133420 0x7fe0481337f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe0380098f0 tx=0x7fe038009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36744bdc40707e65 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:19.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.132+0000 7fe0477fe700 1 -- 172.21.15.26:0/541920142 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe038011830 con 0x7fe048133420 2023-10-01T07:54:19.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.132+0000 7fe0477fe700 1 -- 172.21.15.26:0/541920142 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe038011990 con 0x7fe048133420 2023-10-01T07:54:19.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.132+0000 7fe0477fe700 1 -- 172.21.15.26:0/541920142 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe038011d20 con 0x7fe048133420 2023-10-01T07:54:19.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.133+0000 7fe04eda2700 1 -- 172.21.15.26:0/541920142 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe048133420 msgr2=0x7fe0481337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:19.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.133+0000 7fe04eda2700 1 --2- 172.21.15.26:0/541920142 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe048133420 0x7fe0481337f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe0380098f0 tx=0x7fe038009c00 comp rx=0 tx=0).stop 2023-10-01T07:54:19.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.133+0000 7fe04eda2700 1 -- 172.21.15.26:0/541920142 shutdown_connections 2023-10-01T07:54:19.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.133+0000 7fe04eda2700 1 --2- 172.21.15.26:0/541920142 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe048133420 0x7fe0481337f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:19.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.133+0000 7fe04eda2700 1 --2- 172.21.15.26:0/541920142 >> v2:172.21.15.26:3300/0 conn(0x7fe048133e30 0x7fe04812ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:19.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.133+0000 7fe04eda2700 1 -- 172.21.15.26:0/541920142 >> 172.21.15.26:0/541920142 conn(0x7fe0480a4210 msgr2=0x7fe0480a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:19.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.133+0000 7fe04eda2700 1 -- 172.21.15.26:0/541920142 shutdown_connections 2023-10-01T07:54:19.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.133+0000 7fe04eda2700 1 -- 172.21.15.26:0/541920142 wait complete. 2023-10-01T07:54:19.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.134+0000 7fe04eda2700 1 Processor -- start 2023-10-01T07:54:19.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.134+0000 7fe04eda2700 1 -- start start 2023-10-01T07:54:19.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.135+0000 7fe04eda2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe048133420 0x7fe04809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:19.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.135+0000 7fe04eda2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe048133e30 0x7fe04809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:19.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.135+0000 7fe04eda2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe048134260 0x7fe04809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:19.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.135+0000 7fe04eda2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04811fad0 con 0x7fe048133e30 2023-10-01T07:54:19.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.135+0000 7fe04eda2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe04812d850 con 0x7fe048133420 2023-10-01T07:54:19.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.135+0000 7fe04eda2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe04811ee40 con 0x7fe048134260 2023-10-01T07:54:19.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.135+0000 7fe047fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe048133e30 0x7fe04809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:19.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.135+0000 7fe04cb3e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe048133420 0x7fe04809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:19.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.135+0000 7fe047fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe048133e30 0x7fe04809c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38154/0 (socket says 172.21.15.26:38154) 2023-10-01T07:54:19.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.135+0000 7fe047fff700 1 -- 172.21.15.26:0/3768290568 learned_addr learned my addr 172.21.15.26:0/3768290568 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:19.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.135+0000 7fe04d33f700 1 --2- 172.21.15.26:0/3768290568 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe048134260 0x7fe04809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:19.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.135+0000 7fe047fff700 1 -- 172.21.15.26:0/3768290568 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe048134260 msgr2=0x7fe04809cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:19.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.135+0000 7fe047fff700 1 --2- 172.21.15.26:0/3768290568 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe048134260 0x7fe04809cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:19.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.135+0000 7fe047fff700 1 -- 172.21.15.26:0/3768290568 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe048133420 msgr2=0x7fe04809c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:19.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.135+0000 7fe047fff700 1 --2- 172.21.15.26:0/3768290568 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe048133420 0x7fe04809c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:19.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.135+0000 7fe047fff700 1 -- 172.21.15.26:0/3768290568 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe03c0094a0 con 0x7fe048133e30 2023-10-01T07:54:19.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.135+0000 7fe04cb3e700 1 --2- 172.21.15.26:0/3768290568 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe048133420 0x7fe04809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:19.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.135+0000 7fe04d33f700 1 --2- 172.21.15.26:0/3768290568 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe048134260 0x7fe04809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:19.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.135+0000 7fe047fff700 1 --2- 172.21.15.26:0/3768290568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe048133e30 0x7fe04809c9c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe03c00ebb0 tx=0x7fe03c00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:19.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.136+0000 7fe0457fa700 1 -- 172.21.15.26:0/3768290568 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c00c850 con 0x7fe048133e30 2023-10-01T07:54:19.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.136+0000 7fe0457fa700 1 -- 172.21.15.26:0/3768290568 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03c00c9b0 con 0x7fe048133e30 2023-10-01T07:54:19.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.136+0000 7fe04eda2700 1 -- 172.21.15.26:0/3768290568 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe038009550 con 0x7fe048133e30 2023-10-01T07:54:19.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.136+0000 7fe0457fa700 1 -- 172.21.15.26:0/3768290568 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c00cd40 con 0x7fe048133e30 2023-10-01T07:54:19.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.136+0000 7fe04eda2700 1 -- 172.21.15.26:0/3768290568 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe04811fd20 con 0x7fe048133e30 2023-10-01T07:54:19.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.136+0000 7fe0457fa700 1 -- 172.21.15.26:0/3768290568 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7fe03c013470 con 0x7fe048133e30 2023-10-01T07:54:19.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.137+0000 7fe0457fa700 1 -- 172.21.15.26:0/3768290568 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fe03c03fbe0 con 0x7fe048133e30 2023-10-01T07:54:19.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.137+0000 7fe04eda2700 1 -- 172.21.15.26:0/3768290568 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe048074ea0 con 0x7fe048133e30 2023-10-01T07:54:19.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.142+0000 7fe0457fa700 1 -- 172.21.15.26:0/3768290568 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe03c017080 con 0x7fe048133e30 2023-10-01T07:54:19.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.303+0000 7fe0457fa700 1 -- 172.21.15.26:0/3768290568 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe03c013720 con 0x7fe048133e30 2023-10-01T07:54:19.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.394+0000 7fe04eda2700 1 -- 172.21.15.26:0/3768290568 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe04806b250 con 0x7fe048133e30 2023-10-01T07:54:19.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.394+0000 7fe0457fa700 1 -- 172.21.15.26:0/3768290568 <== mon.0 v2:172.21.15.26:3300/0 8 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fe03c021030 con 0x7fe048133e30 2023-10-01T07:54:19.395 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:54:19.395 INFO:teuthology.orchestra.run.smithi026.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-01T07:54:19.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.396+0000 7fe04eda2700 1 -- 172.21.15.26:0/3768290568 >> v1:172.21.15.26:6816/126763 conn(0x7fe03402f480 legacy=0x7fe034031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:19.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.396+0000 7fe04eda2700 1 -- 172.21.15.26:0/3768290568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe048133e30 msgr2=0x7fe04809c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:19.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.396+0000 7fe04eda2700 1 --2- 172.21.15.26:0/3768290568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe048133e30 0x7fe04809c9c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe03c00ebb0 tx=0x7fe03c00eec0 comp rx=0 tx=0).stop 2023-10-01T07:54:19.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.397+0000 7fe04eda2700 1 -- 172.21.15.26:0/3768290568 shutdown_connections 2023-10-01T07:54:19.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.397+0000 7fe04eda2700 1 --2- 172.21.15.26:0/3768290568 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe048134260 0x7fe04809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:19.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.397+0000 7fe04eda2700 1 --2- 172.21.15.26:0/3768290568 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe048133420 0x7fe04809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:19.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.397+0000 7fe04eda2700 1 --2- 172.21.15.26:0/3768290568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe048133e30 0x7fe04809c9c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:19.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.397+0000 7fe04eda2700 1 -- 172.21.15.26:0/3768290568 >> 172.21.15.26:0/3768290568 conn(0x7fe0480a4210 msgr2=0x7fe0480a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:19.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.397+0000 7fe04eda2700 1 -- 172.21.15.26:0/3768290568 shutdown_connections 2023-10-01T07:54:19.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.397+0000 7fe04eda2700 1 -- 172.21.15.26:0/3768290568 wait complete. 2023-10-01T07:54:19.410 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-01T07:54:19.411 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-01T07:54:19.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.546+0000 7f311030e700 1 Processor -- start 2023-10-01T07:54:19.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.546+0000 7f311030e700 1 -- start start 2023-10-01T07:54:19.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.547+0000 7f311030e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f310809d6d0 0x7f310809daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:19.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.547+0000 7f311030e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3108133cd0 0x7f310813ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:19.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.547+0000 7f311030e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f310809a570 con 0x7f310809dfe0 2023-10-01T07:54:19.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.547+0000 7f311030e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f310809b1c0 con 0x7f310809d6d0 2023-10-01T07:54:19.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.547+0000 7f311030e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f310809f240 con 0x7f3108133cd0 2023-10-01T07:54:19.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.547+0000 7f310e0aa700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f310809d6d0 0x7f310809daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:19.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.547+0000 7f310e0aa700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f310809d6d0 0x7f310809daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:60584/0 (socket says 172.21.15.26:60584) 2023-10-01T07:54:19.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.547+0000 7f310e8ab700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3108133cd0 0x7f310813ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:19.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.547+0000 7f310e0aa700 1 -- 172.21.15.26:0/3440309742 learned_addr learned my addr 172.21.15.26:0/3440309742 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:19.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.547+0000 7f310d8a9700 1 --1- 172.21.15.26:0/3440309742 >> v1:172.21.15.26:6789/0 conn(0x7f310809dfe0 0x7f31081335c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48688/0 (socket says 172.21.15.26:48688) 2023-10-01T07:54:19.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.547+0000 7f310e8ab700 1 -- 172.21.15.26:0/3440309742 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f310809d6d0 msgr2=0x7f310809daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:19.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.547+0000 7f310e8ab700 1 --2- 172.21.15.26:0/3440309742 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f310809d6d0 0x7f310809daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:19.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.547+0000 7f310d0a8700 1 -- 172.21.15.26:0/3440309742 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929626061 0 0) 0x7f310809a570 con 0x7f310809dfe0 2023-10-01T07:54:19.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.547+0000 7f310e8ab700 1 -- 172.21.15.26:0/3440309742 >> v1:172.21.15.26:6789/0 conn(0x7f310809dfe0 legacy=0x7f31081335c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:19.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.547+0000 7f310e8ab700 1 -- 172.21.15.26:0/3440309742 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f310809a2d0 con 0x7f3108133cd0 2023-10-01T07:54:19.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.547+0000 7f310e0aa700 1 --2- 172.21.15.26:0/3440309742 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f310809d6d0 0x7f310809daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:19.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.547+0000 7f310e8ab700 1 --2- 172.21.15.26:0/3440309742 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3108133cd0 0x7f310813ba30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3100009df0 tx=0x7f310000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4dde4a394272c99 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:19.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.548+0000 7f310d0a8700 1 -- 172.21.15.26:0/3440309742 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310000e070 con 0x7f3108133cd0 2023-10-01T07:54:19.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.548+0000 7f310d0a8700 1 -- 172.21.15.26:0/3440309742 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310000bae0 con 0x7f3108133cd0 2023-10-01T07:54:19.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.548+0000 7f310d0a8700 1 -- 172.21.15.26:0/3440309742 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310000be90 con 0x7f3108133cd0 2023-10-01T07:54:19.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.548+0000 7f311030e700 1 -- 172.21.15.26:0/3440309742 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3108133cd0 msgr2=0x7f310813ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:19.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.548+0000 7f311030e700 1 --2- 172.21.15.26:0/3440309742 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3108133cd0 0x7f310813ba30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3100009df0 tx=0x7f310000b330 comp rx=0 tx=0).stop 2023-10-01T07:54:19.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.548+0000 7f311030e700 1 -- 172.21.15.26:0/3440309742 shutdown_connections 2023-10-01T07:54:19.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.548+0000 7f311030e700 1 --2- 172.21.15.26:0/3440309742 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3108133cd0 0x7f310813ba30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:19.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.548+0000 7f311030e700 1 --2- 172.21.15.26:0/3440309742 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f310809d6d0 0x7f310809daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:19.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.548+0000 7f311030e700 1 -- 172.21.15.26:0/3440309742 >> 172.21.15.26:0/3440309742 conn(0x7f3108099c20 msgr2=0x7f31080a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:19.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.548+0000 7f311030e700 1 -- 172.21.15.26:0/3440309742 shutdown_connections 2023-10-01T07:54:19.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.548+0000 7f311030e700 1 -- 172.21.15.26:0/3440309742 wait complete. 2023-10-01T07:54:19.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.549+0000 7f311030e700 1 Processor -- start 2023-10-01T07:54:19.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.549+0000 7f311030e700 1 -- start start 2023-10-01T07:54:19.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.550+0000 7f311030e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f310809d6d0 0x7f310811bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:19.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.550+0000 7f311030e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f310809dfe0 0x7f310811c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:19.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.550+0000 7f311030e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3108133cd0 0x7f310811c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:19.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.550+0000 7f311030e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31081201e0 con 0x7f310809dfe0 2023-10-01T07:54:19.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.550+0000 7f311030e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f310811f820 con 0x7f3108133cd0 2023-10-01T07:54:19.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.550+0000 7f311030e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f310811eb60 con 0x7f310809d6d0 2023-10-01T07:54:19.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.550+0000 7f310e0aa700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f310809d6d0 0x7f310811bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:19.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.550+0000 7f310e0aa700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f310809d6d0 0x7f310811bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55790/0 (socket says 172.21.15.26:55790) 2023-10-01T07:54:19.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.550+0000 7f310e0aa700 1 -- 172.21.15.26:0/3497759778 learned_addr learned my addr 172.21.15.26:0/3497759778 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:19.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.550+0000 7f310d8a9700 1 --2- 172.21.15.26:0/3497759778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f310809dfe0 0x7f310811c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:19.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.550+0000 7f310e8ab700 1 --2- 172.21.15.26:0/3497759778 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3108133cd0 0x7f310811c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:19.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.550+0000 7f310e0aa700 1 -- 172.21.15.26:0/3497759778 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3108133cd0 msgr2=0x7f310811c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:19.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.550+0000 7f310e0aa700 1 --2- 172.21.15.26:0/3497759778 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3108133cd0 0x7f310811c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:19.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.550+0000 7f310e0aa700 1 -- 172.21.15.26:0/3497759778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f310809dfe0 msgr2=0x7f310811c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:19.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.550+0000 7f310e0aa700 1 --2- 172.21.15.26:0/3497759778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f310809dfe0 0x7f310811c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:19.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.550+0000 7f310e0aa700 1 -- 172.21.15.26:0/3497759778 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3104009550 con 0x7f310809d6d0 2023-10-01T07:54:19.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.550+0000 7f310d8a9700 1 --2- 172.21.15.26:0/3497759778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f310809dfe0 0x7f310811c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:19.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.551+0000 7f310e0aa700 1 --2- 172.21.15.26:0/3497759778 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f310809d6d0 0x7f310811bd00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f310400ec10 tx=0x7f310400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:19.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.551+0000 7f30faffd700 1 -- 172.21.15.26:0/3497759778 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310400c850 con 0x7f310809d6d0 2023-10-01T07:54:19.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.551+0000 7f30faffd700 1 -- 172.21.15.26:0/3497759778 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310400c9b0 con 0x7f310809d6d0 2023-10-01T07:54:19.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.551+0000 7f311030e700 1 -- 172.21.15.26:0/3497759778 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3100009a70 con 0x7f310809d6d0 2023-10-01T07:54:19.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.551+0000 7f30faffd700 1 -- 172.21.15.26:0/3497759778 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310400cd40 con 0x7f310809d6d0 2023-10-01T07:54:19.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.551+0000 7f311030e700 1 -- 172.21.15.26:0/3497759778 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f310811d910 con 0x7f310809d6d0 2023-10-01T07:54:19.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.552+0000 7f311030e700 1 -- 172.21.15.26:0/3497759778 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f310811f3c0 con 0x7f310809d6d0 2023-10-01T07:54:19.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.552+0000 7f30faffd700 1 -- 172.21.15.26:0/3497759778 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3104013470 con 0x7f310809d6d0 2023-10-01T07:54:19.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.552+0000 7f30faffd700 1 -- 172.21.15.26:0/3497759778 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f3104040110 con 0x7f310809d6d0 2023-10-01T07:54:19.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.557+0000 7f30faffd700 1 -- 172.21.15.26:0/3497759778 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3104013720 con 0x7f310809d6d0 2023-10-01T07:54:19.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.762+0000 7f311030e700 1 -- 172.21.15.26:0/3497759778 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f310806c230 con 0x7f310809d6d0 2023-10-01T07:54:19.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.764+0000 7f30faffd700 1 -- 172.21.15.26:0/3497759778 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+12912 (secure 0 0 0) 0x7f3104021090 con 0x7f310809d6d0 2023-10-01T07:54:19.764 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:54:19.764 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":23,"fsid":"c29fb19d-520c-42a6-90f4-e7f86de96e8e","created":"2023-10-01T07:51:40.702414+0000","modified":"2023-10-01T07:54:16.814132+0000","last_up_change":"2023-10-01T07:51:48.849482+0000","last_in_change":"2023-10-01T07:51:42.084736+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-01T07:51:48.906889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-01T07:51:50.071599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-01T07:51:54.981575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-01T07:51:56.286318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46569ce3-81d1-44a1-a649-691de3e6f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6800","nonce":118773}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6801","nonce":118773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6803","nonce":118773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6802","nonce":118773}]},"public_addr":"172.21.15.26:6800/118773","cluster_addr":"172.21.15.26:6801/118773","heartbeat_back_addr":"172.21.15.26:6803/118773","heartbeat_front_addr":"172.21.15.26:6802/118773","state":["exists","up"]},{"osd":1,"uuid":"1fc1ba9b-4110-4d31-96d6-794937578cff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6804","nonce":118782}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6806","nonce":118782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6810","nonce":118782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6808","nonce":118782}]},"public_addr":"172.21.15.26:6804/118782","cluster_addr":"172.21.15.26:6806/118782","heartbeat_back_addr":"172.21.15.26:6810/118782","heartbeat_front_addr":"172.21.15.26:6808/118782","state":["exists","up"]},{"osd":2,"uuid":"37de933d-3b8e-4b94-87bd-2f36896c7ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6805","nonce":118789}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6807","nonce":118789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6811","nonce":118789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6809","nonce":118789}]},"public_addr":"172.21.15.26:6805/118789","cluster_addr":"172.21.15.26:6807/118789","heartbeat_back_addr":"172.21.15.26:6811/118789","heartbeat_front_addr":"172.21.15.26:6809/118789","state":["exists","up"]},{"osd":3,"uuid":"bd020309-5fd2-4d97-b36a-67e159fa3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6812","nonce":118790}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6813","nonce":118790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6815","nonce":118790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6814","nonce":118790}]},"public_addr":"172.21.15.26:6812/118790","cluster_addr":"172.21.15.26:6813/118790","heartbeat_back_addr":"172.21.15.26:6815/118790","heartbeat_front_addr":"172.21.15.26:6814/118790","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.029993+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.266503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.273540+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.229731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.e","mappings":[{"from":3,"to":0}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.39","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/616154075":"2023-10-02T07:54:14.803384+0000","172.21.15.26:6816/118178":"2023-10-02T07:54:14.803384+0000","172.21.15.26:0/1290599107":"2023-10-02T07:54:14.803384+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-01T07:54:19.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.766+0000 7f311030e700 1 -- 172.21.15.26:0/3497759778 >> v1:172.21.15.26:6816/126763 conn(0x7f30ec02f510 legacy=0x7f30ec0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:19.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.766+0000 7f311030e700 1 -- 172.21.15.26:0/3497759778 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f310809d6d0 msgr2=0x7f310811bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:19.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.766+0000 7f311030e700 1 --2- 172.21.15.26:0/3497759778 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f310809d6d0 0x7f310811bd00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f310400ec10 tx=0x7f310400ef20 comp rx=0 tx=0).stop 2023-10-01T07:54:19.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.766+0000 7f311030e700 1 -- 172.21.15.26:0/3497759778 shutdown_connections 2023-10-01T07:54:19.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.766+0000 7f311030e700 1 --2- 172.21.15.26:0/3497759778 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3108133cd0 0x7f310811c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:19.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.766+0000 7f311030e700 1 --2- 172.21.15.26:0/3497759778 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f310809d6d0 0x7f310811bd00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:19.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.766+0000 7f311030e700 1 --2- 172.21.15.26:0/3497759778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f310809dfe0 0x7f310811c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:19.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.766+0000 7f311030e700 1 -- 172.21.15.26:0/3497759778 >> 172.21.15.26:0/3497759778 conn(0x7f3108099c20 msgr2=0x7f3108131f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:19.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.766+0000 7f311030e700 1 -- 172.21.15.26:0/3497759778 shutdown_connections 2023-10-01T07:54:19.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.766+0000 7f311030e700 1 -- 172.21.15.26:0/3497759778 wait complete. 2023-10-01T07:54:19.780 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-01T07:51:48.906889+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-01T07:51:50.071599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-01T07:51:54.981575+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-01T07:51:56.286318+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-01T07:54:19.781 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-01T07:54:19.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.920+0000 7f5ac28c0700 1 Processor -- start 2023-10-01T07:54:19.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.920+0000 7f5ac28c0700 1 -- start start 2023-10-01T07:54:19.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.921+0000 7f5ac28c0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5abc136b80 0x7f5abc138f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:19.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.921+0000 7f5ac28c0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5abc1394a0 0x7f5abc13b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:19.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.921+0000 7f5ac28c0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5abc06bcc0 con 0x7f5abc071cd0 2023-10-01T07:54:19.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.921+0000 7f5ac28c0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5abc06cbf0 con 0x7f5abc1394a0 2023-10-01T07:54:19.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.921+0000 7f5ac28c0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc06ba00 con 0x7f5abc136b80 2023-10-01T07:54:19.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.921+0000 7f5ac0e5d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5abc1394a0 0x7f5abc13b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:19.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.921+0000 7f5abb7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5abc136b80 0x7f5abc138f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:19.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.921+0000 7f5ac0e5d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5abc1394a0 0x7f5abc13b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38174/0 (socket says 172.21.15.26:38174) 2023-10-01T07:54:19.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.921+0000 7f5ac0e5d700 1 -- 172.21.15.26:0/2014356875 learned_addr learned my addr 172.21.15.26:0/2014356875 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:19.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.921+0000 7f5ac0e5d700 1 -- 172.21.15.26:0/2014356875 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5abc136b80 msgr2=0x7f5abc138f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:19.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.921+0000 7f5ac0e5d700 1 --2- 172.21.15.26:0/2014356875 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5abc136b80 0x7f5abc138f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:19.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.921+0000 7f5ac0e5d700 1 -- 172.21.15.26:0/2014356875 >> v1:172.21.15.26:6789/0 conn(0x7f5abc071cd0 legacy=0x7f5abc0720a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:19.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.921+0000 7f5ac0e5d700 1 -- 172.21.15.26:0/2014356875 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5abc09f860 con 0x7f5abc1394a0 2023-10-01T07:54:19.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.921+0000 7f5abb7fe700 1 --2- 172.21.15.26:0/2014356875 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5abc136b80 0x7f5abc138f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:19.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.921+0000 7f5abaffd700 1 -- 172.21.15.26:0/2014356875 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2199083964 0 0) 0x7f5abc06bcc0 con 0x7f5abc071cd0 2023-10-01T07:54:19.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.922+0000 7f5ac0e5d700 1 --2- 172.21.15.26:0/2014356875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5abc1394a0 0x7f5abc13b880 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4009e50 tx=0x7f5ab400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1bce795eb202b66 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:19.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.922+0000 7f5abaffd700 1 -- 172.21.15.26:0/2014356875 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab400e070 con 0x7f5abc1394a0 2023-10-01T07:54:19.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.922+0000 7f5abaffd700 1 -- 172.21.15.26:0/2014356875 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab400b910 con 0x7f5abc1394a0 2023-10-01T07:54:19.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.922+0000 7f5abaffd700 1 -- 172.21.15.26:0/2014356875 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab400bcc0 con 0x7f5abc1394a0 2023-10-01T07:54:19.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.922+0000 7f5ac28c0700 1 -- 172.21.15.26:0/2014356875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5abc1394a0 msgr2=0x7f5abc13b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:19.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.922+0000 7f5ac28c0700 1 --2- 172.21.15.26:0/2014356875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5abc1394a0 0x7f5abc13b880 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4009e50 tx=0x7f5ab400b330 comp rx=0 tx=0).stop 2023-10-01T07:54:19.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.922+0000 7f5ac28c0700 1 -- 172.21.15.26:0/2014356875 shutdown_connections 2023-10-01T07:54:19.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.922+0000 7f5ac28c0700 1 --2- 172.21.15.26:0/2014356875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5abc1394a0 0x7f5abc13b880 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:19.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.922+0000 7f5ac28c0700 1 --2- 172.21.15.26:0/2014356875 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5abc136b80 0x7f5abc138f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:19.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.922+0000 7f5ac28c0700 1 -- 172.21.15.26:0/2014356875 >> 172.21.15.26:0/2014356875 conn(0x7f5abc0a4130 msgr2=0x7f5abc0a4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:19.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.922+0000 7f5ac28c0700 1 -- 172.21.15.26:0/2014356875 shutdown_connections 2023-10-01T07:54:19.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.922+0000 7f5ac28c0700 1 -- 172.21.15.26:0/2014356875 wait complete. 2023-10-01T07:54:19.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.923+0000 7f5ac28c0700 1 Processor -- start 2023-10-01T07:54:19.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.924+0000 7f5ac28c0700 1 -- start start 2023-10-01T07:54:19.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.924+0000 7f5ac28c0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5abc071cd0 0x7f5abc11ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:19.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.924+0000 7f5ac28c0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5abc136b80 0x7f5abc11ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:19.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.924+0000 7f5ac28c0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5abc1394a0 0x7f5abc11f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:19.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.924+0000 7f5ac28c0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc139270 con 0x7f5abc071cd0 2023-10-01T07:54:19.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.924+0000 7f5ac28c0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc1207f0 con 0x7f5abc1394a0 2023-10-01T07:54:19.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.924+0000 7f5ac28c0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc121630 con 0x7f5abc136b80 2023-10-01T07:54:19.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.924+0000 7f5abb7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5abc136b80 0x7f5abc11ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:19.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.924+0000 7f5abbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5abc071cd0 0x7f5abc11ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:19.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.924+0000 7f5abb7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5abc136b80 0x7f5abc11ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55816/0 (socket says 172.21.15.26:55816) 2023-10-01T07:54:19.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.924+0000 7f5abb7fe700 1 -- 172.21.15.26:0/608466538 learned_addr learned my addr 172.21.15.26:0/608466538 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:19.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.924+0000 7f5ac0e5d700 1 --2- 172.21.15.26:0/608466538 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5abc1394a0 0x7f5abc11f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:19.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.925+0000 7f5abb7fe700 1 -- 172.21.15.26:0/608466538 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5abc1394a0 msgr2=0x7f5abc11f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:19.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.925+0000 7f5abb7fe700 1 --2- 172.21.15.26:0/608466538 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5abc1394a0 0x7f5abc11f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:19.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.925+0000 7f5abb7fe700 1 -- 172.21.15.26:0/608466538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5abc071cd0 msgr2=0x7f5abc11ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:19.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.925+0000 7f5abb7fe700 1 --2- 172.21.15.26:0/608466538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5abc071cd0 0x7f5abc11ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:19.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.925+0000 7f5abb7fe700 1 -- 172.21.15.26:0/608466538 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa40094a0 con 0x7f5abc136b80 2023-10-01T07:54:19.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.925+0000 7f5ac0e5d700 1 --2- 172.21.15.26:0/608466538 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5abc1394a0 0x7f5abc11f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:19.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.925+0000 7f5abbfff700 1 --2- 172.21.15.26:0/608466538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5abc071cd0 0x7f5abc11ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:19.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.925+0000 7f5abb7fe700 1 --2- 172.21.15.26:0/608466538 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5abc136b80 0x7f5abc11ef50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5aa400ebe0 tx=0x7f5aa400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:19.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.925+0000 7f5ab8ff9700 1 -- 172.21.15.26:0/608466538 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa400c850 con 0x7f5abc136b80 2023-10-01T07:54:19.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.925+0000 7f5ab8ff9700 1 -- 172.21.15.26:0/608466538 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa400c9b0 con 0x7f5abc136b80 2023-10-01T07:54:19.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.925+0000 7f5ac28c0700 1 -- 172.21.15.26:0/608466538 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab4009b30 con 0x7f5abc136b80 2023-10-01T07:54:19.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.925+0000 7f5ab8ff9700 1 -- 172.21.15.26:0/608466538 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa400cd40 con 0x7f5abc136b80 2023-10-01T07:54:19.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.925+0000 7f5ac28c0700 1 -- 172.21.15.26:0/608466538 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5abc06c0f0 con 0x7f5abc136b80 2023-10-01T07:54:19.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.926+0000 7f5ac28c0700 1 -- 172.21.15.26:0/608466538 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5abc1386f0 con 0x7f5abc136b80 2023-10-01T07:54:19.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.926+0000 7f5ab8ff9700 1 -- 172.21.15.26:0/608466538 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5aa4013470 con 0x7f5abc136b80 2023-10-01T07:54:19.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.926+0000 7f5ab8ff9700 1 -- 172.21.15.26:0/608466538 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f5aa403fc80 con 0x7f5abc136b80 2023-10-01T07:54:19.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:19.931+0000 7f5ab8ff9700 1 -- 172.21.15.26:0/608466538 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5aa4045020 con 0x7f5abc136b80 2023-10-01T07:54:20.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.136+0000 7f5ac28c0700 1 -- 172.21.15.26:0/608466538 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5abc04f2a0 con 0x7f5abc136b80 2023-10-01T07:54:20.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.136+0000 7f5ab8ff9700 1 -- 172.21.15.26:0/608466538 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5aa4021020 con 0x7f5abc136b80 2023-10-01T07:54:20.137 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-01T07:54:20.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.138+0000 7f5ac28c0700 1 -- 172.21.15.26:0/608466538 >> v1:172.21.15.26:6816/126763 conn(0x7f5a9c02f510 legacy=0x7f5a9c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:20.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.138+0000 7f5ac28c0700 1 -- 172.21.15.26:0/608466538 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5abc136b80 msgr2=0x7f5abc11ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:20.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.138+0000 7f5ac28c0700 1 --2- 172.21.15.26:0/608466538 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5abc136b80 0x7f5abc11ef50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5aa400ebe0 tx=0x7f5aa400eef0 comp rx=0 tx=0).stop 2023-10-01T07:54:20.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.138+0000 7f5ac28c0700 1 -- 172.21.15.26:0/608466538 shutdown_connections 2023-10-01T07:54:20.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.138+0000 7f5ac28c0700 1 --2- 172.21.15.26:0/608466538 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5abc1394a0 0x7f5abc11f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:20.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.138+0000 7f5ac28c0700 1 --2- 172.21.15.26:0/608466538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5abc071cd0 0x7f5abc11ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:20.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.138+0000 7f5ac28c0700 1 --2- 172.21.15.26:0/608466538 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5abc136b80 0x7f5abc11ef50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:20.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.138+0000 7f5ac28c0700 1 -- 172.21.15.26:0/608466538 >> 172.21.15.26:0/608466538 conn(0x7f5abc0a4130 msgr2=0x7f5abc071350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:20.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.138+0000 7f5ac28c0700 1 -- 172.21.15.26:0/608466538 shutdown_connections 2023-10-01T07:54:20.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.138+0000 7f5ac28c0700 1 -- 172.21.15.26:0/608466538 wait complete. 2023-10-01T07:54:20.152 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-01T07:54:20.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.291+0000 7fddc6047700 1 Processor -- start 2023-10-01T07:54:20.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.291+0000 7fddc6047700 1 -- start start 2023-10-01T07:54:20.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.292+0000 7fddc6047700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fddc0133e70 0x7fddc0134240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:20.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.292+0000 7fddc6047700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc009d880 0x7fddc009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:20.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.292+0000 7fddc6047700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddc009d060 con 0x7fddc009e230 2023-10-01T07:54:20.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.292+0000 7fddc6047700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddc009acd0 con 0x7fddc0133e70 2023-10-01T07:54:20.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.292+0000 7fddc6047700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc009eef0 con 0x7fddc009d880 2023-10-01T07:54:20.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.292+0000 7fddbeffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc009d880 0x7fddc009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:20.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.292+0000 7fddbeffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc009d880 0x7fddc009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:60622/0 (socket says 172.21.15.26:60622) 2023-10-01T07:54:20.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.292+0000 7fddbeffd700 1 -- 172.21.15.26:0/4142760117 learned_addr learned my addr 172.21.15.26:0/4142760117 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:20.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.292+0000 7fddbf7fe700 1 --2- 172.21.15.26:0/4142760117 >> v2:172.21.15.26:3300/0 conn(0x7fddc0133e70 0x7fddc0134240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:20.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.292+0000 7fddbeffd700 1 -- 172.21.15.26:0/4142760117 >> v2:172.21.15.26:3300/0 conn(0x7fddc0133e70 msgr2=0x7fddc0134240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:20.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.292+0000 7fddbeffd700 1 --2- 172.21.15.26:0/4142760117 >> v2:172.21.15.26:3300/0 conn(0x7fddc0133e70 0x7fddc0134240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:20.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.292+0000 7fddbeffd700 1 -- 172.21.15.26:0/4142760117 >> v1:172.21.15.26:6789/0 conn(0x7fddc009e230 legacy=0x7fddc013abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:20.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.292+0000 7fddbeffd700 1 -- 172.21.15.26:0/4142760117 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc0134780 con 0x7fddc009d880 2023-10-01T07:54:20.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.292+0000 7fddbeffd700 1 --2- 172.21.15.26:0/4142760117 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc009d880 0x7fddc009dcf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdda80098f0 tx=0x7fdda8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71c0622953d9596c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:20.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.293+0000 7fddbe7fc700 1 -- 172.21.15.26:0/4142760117 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda8011830 con 0x7fddc009d880 2023-10-01T07:54:20.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.293+0000 7fddbe7fc700 1 -- 172.21.15.26:0/4142760117 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda8011990 con 0x7fddc009d880 2023-10-01T07:54:20.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.293+0000 7fddbe7fc700 1 -- 172.21.15.26:0/4142760117 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda8011d20 con 0x7fddc009d880 2023-10-01T07:54:20.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.293+0000 7fddc6047700 1 -- 172.21.15.26:0/4142760117 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc009d880 msgr2=0x7fddc009dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:20.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.293+0000 7fddc6047700 1 --2- 172.21.15.26:0/4142760117 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc009d880 0x7fddc009dcf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdda80098f0 tx=0x7fdda8009c00 comp rx=0 tx=0).stop 2023-10-01T07:54:20.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.293+0000 7fddc6047700 1 -- 172.21.15.26:0/4142760117 shutdown_connections 2023-10-01T07:54:20.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.293+0000 7fddc6047700 1 --2- 172.21.15.26:0/4142760117 >> v2:172.21.15.26:3300/0 conn(0x7fddc0133e70 0x7fddc0134240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:20.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.293+0000 7fddc6047700 1 --2- 172.21.15.26:0/4142760117 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc009d880 0x7fddc009dcf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:20.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.293+0000 7fddc6047700 1 -- 172.21.15.26:0/4142760117 >> 172.21.15.26:0/4142760117 conn(0x7fddc00a2c10 msgr2=0x7fddc00a3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:20.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.293+0000 7fddc6047700 1 -- 172.21.15.26:0/4142760117 shutdown_connections 2023-10-01T07:54:20.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.293+0000 7fddc6047700 1 -- 172.21.15.26:0/4142760117 wait complete. 2023-10-01T07:54:20.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.295+0000 7fddc6047700 1 Processor -- start 2023-10-01T07:54:20.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.295+0000 7fddc6047700 1 -- start start 2023-10-01T07:54:20.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.296+0000 7fddc6047700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddc009d880 0x7fddc0118e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:20.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.296+0000 7fddc6047700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fddc009e230 0x7fddc0119380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:20.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.296+0000 7fddc6047700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc0133e70 0x7fddc01198c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:20.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.296+0000 7fddc6047700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc011c310 con 0x7fddc009d880 2023-10-01T07:54:20.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.296+0000 7fddc6047700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc0130fd0 con 0x7fddc0133e70 2023-10-01T07:54:20.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.296+0000 7fddc6047700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddc011b200 con 0x7fddc009e230 2023-10-01T07:54:20.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.296+0000 7fddbf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddc009d880 0x7fddc0118e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:20.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.296+0000 7fddbf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddc009d880 0x7fddc0118e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38204/0 (socket says 172.21.15.26:38204) 2023-10-01T07:54:20.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.296+0000 7fddbf7fe700 1 -- 172.21.15.26:0/1488810247 learned_addr learned my addr 172.21.15.26:0/1488810247 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:20.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.296+0000 7fddbffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc0133e70 0x7fddc01198c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:20.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.296+0000 7fddbeffd700 1 --2- 172.21.15.26:0/1488810247 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fddc009e230 0x7fddc0119380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:20.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.296+0000 7fddbf7fe700 1 -- 172.21.15.26:0/1488810247 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fddc009e230 msgr2=0x7fddc0119380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:20.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.296+0000 7fddbf7fe700 1 --2- 172.21.15.26:0/1488810247 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fddc009e230 0x7fddc0119380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:20.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.296+0000 7fddbf7fe700 1 -- 172.21.15.26:0/1488810247 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc0133e70 msgr2=0x7fddc01198c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:20.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.296+0000 7fddbf7fe700 1 --2- 172.21.15.26:0/1488810247 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc0133e70 0x7fddc01198c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:20.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.296+0000 7fddbf7fe700 1 -- 172.21.15.26:0/1488810247 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda8009550 con 0x7fddc009d880 2023-10-01T07:54:20.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.296+0000 7fddbffff700 1 --2- 172.21.15.26:0/1488810247 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc0133e70 0x7fddc01198c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:20.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.296+0000 7fddbf7fe700 1 --2- 172.21.15.26:0/1488810247 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddc009d880 0x7fddc0118e40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fddb000efc0 tx=0x7fddb000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:20.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.297+0000 7fddb7fff700 1 -- 172.21.15.26:0/1488810247 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb000cd10 con 0x7fddc009d880 2023-10-01T07:54:20.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.297+0000 7fddb7fff700 1 -- 172.21.15.26:0/1488810247 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb000f040 con 0x7fddc009d880 2023-10-01T07:54:20.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.297+0000 7fddc6047700 1 -- 172.21.15.26:0/1488810247 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc011a4a0 con 0x7fddc009d880 2023-10-01T07:54:20.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.297+0000 7fddb7fff700 1 -- 172.21.15.26:0/1488810247 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb00146a0 con 0x7fddc009d880 2023-10-01T07:54:20.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.297+0000 7fddc6047700 1 -- 172.21.15.26:0/1488810247 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddc012df90 con 0x7fddc009d880 2023-10-01T07:54:20.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.297+0000 7fddb7fff700 1 -- 172.21.15.26:0/1488810247 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fddb0014800 con 0x7fddc009d880 2023-10-01T07:54:20.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.298+0000 7fddb7fff700 1 -- 172.21.15.26:0/1488810247 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fddb00405c0 con 0x7fddc009d880 2023-10-01T07:54:20.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.298+0000 7fddc6047700 1 -- 172.21.15.26:0/1488810247 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddc004f2a0 con 0x7fddc009d880 2023-10-01T07:54:20.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.303+0000 7fddb7fff700 1 -- 172.21.15.26:0/1488810247 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fddb00133e0 con 0x7fddc009d880 2023-10-01T07:54:20.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.505+0000 7fddc6047700 1 -- 172.21.15.26:0/1488810247 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fddc0072d60 con 0x7fddc009d880 2023-10-01T07:54:20.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.506+0000 7fddb7fff700 1 -- 172.21.15.26:0/1488810247 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fddb002b0a0 con 0x7fddc009d880 2023-10-01T07:54:20.506 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 8 2023-10-01T07:54:20.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.508+0000 7fddc6047700 1 -- 172.21.15.26:0/1488810247 >> v1:172.21.15.26:6816/126763 conn(0x7fdda002f510 legacy=0x7fdda00319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:20.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.508+0000 7fddc6047700 1 -- 172.21.15.26:0/1488810247 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddc009d880 msgr2=0x7fddc0118e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:20.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.508+0000 7fddc6047700 1 --2- 172.21.15.26:0/1488810247 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddc009d880 0x7fddc0118e40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fddb000efc0 tx=0x7fddb000c3a0 comp rx=0 tx=0).stop 2023-10-01T07:54:20.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.508+0000 7fddc6047700 1 -- 172.21.15.26:0/1488810247 shutdown_connections 2023-10-01T07:54:20.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.508+0000 7fddc6047700 1 --2- 172.21.15.26:0/1488810247 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc0133e70 0x7fddc01198c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:20.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.508+0000 7fddc6047700 1 --2- 172.21.15.26:0/1488810247 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddc009d880 0x7fddc0118e40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:20.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.508+0000 7fddc6047700 1 --2- 172.21.15.26:0/1488810247 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fddc009e230 0x7fddc0119380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:20.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.508+0000 7fddc6047700 1 -- 172.21.15.26:0/1488810247 >> 172.21.15.26:0/1488810247 conn(0x7fddc00a2c10 msgr2=0x7fddc012d850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:20.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.508+0000 7fddc6047700 1 -- 172.21.15.26:0/1488810247 shutdown_connections 2023-10-01T07:54:20.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.508+0000 7fddc6047700 1 -- 172.21.15.26:0/1488810247 wait complete. 2023-10-01T07:54:20.522 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-01T07:54:20.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.660+0000 7fe60d0c0700 1 Processor -- start 2023-10-01T07:54:20.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.660+0000 7fe60d0c0700 1 -- start start 2023-10-01T07:54:20.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.660+0000 7fe60d0c0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe608134a90 0x7fe608136e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:20.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.661+0000 7fe60d0c0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe6081373b0 0x7fe608139790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:20.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.661+0000 7fe60d0c0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe60809ec00 con 0x7fe608131c20 2023-10-01T07:54:20.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.661+0000 7fe60d0c0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe608132700 con 0x7fe6081373b0 2023-10-01T07:54:20.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.661+0000 7fe60d0c0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe60806ee30 con 0x7fe608134a90 2023-10-01T07:54:20.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.661+0000 7fe60759e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe6081373b0 0x7fe608139790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:20.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.661+0000 7fe60659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe608134a90 0x7fe608136e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:20.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.661+0000 7fe606d9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe608131c20 0x7fe608131ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48712/0 (socket says 172.21.15.26:48712) 2023-10-01T07:54:20.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.661+0000 7fe606d9d700 1 -- 172.21.15.26:0/2877219217 learned_addr learned my addr 172.21.15.26:0/2877219217 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:20.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.661+0000 7fe60659c700 1 -- 172.21.15.26:0/2877219217 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe6081373b0 msgr2=0x7fe608139790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:20.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.661+0000 7fe60659c700 1 --2- 172.21.15.26:0/2877219217 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe6081373b0 0x7fe608139790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:20.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.661+0000 7fe60659c700 1 -- 172.21.15.26:0/2877219217 >> v1:172.21.15.26:6789/0 conn(0x7fe608131c20 legacy=0x7fe608131ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:20.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.661+0000 7fe60659c700 1 -- 172.21.15.26:0/2877219217 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe608131780 con 0x7fe608134a90 2023-10-01T07:54:20.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.661+0000 7fe605d9b700 1 -- 172.21.15.26:0/2877219217 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 566644337 0 0) 0x7fe60809ec00 con 0x7fe608131c20 2023-10-01T07:54:20.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.661+0000 7fe60759e700 1 --2- 172.21.15.26:0/2877219217 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe6081373b0 0x7fe608139790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:20.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.661+0000 7fe60659c700 1 --2- 172.21.15.26:0/2877219217 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe608134a90 0x7fe608136e70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0009870 tx=0x7fe5f0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c737343ed5b47266 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:20.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.661+0000 7fe605d9b700 1 -- 172.21.15.26:0/2877219217 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0011830 con 0x7fe608134a90 2023-10-01T07:54:20.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.661+0000 7fe605d9b700 1 -- 172.21.15.26:0/2877219217 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f0011990 con 0x7fe608134a90 2023-10-01T07:54:20.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.661+0000 7fe605d9b700 1 -- 172.21.15.26:0/2877219217 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0011d20 con 0x7fe608134a90 2023-10-01T07:54:20.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.662+0000 7fe60d0c0700 1 -- 172.21.15.26:0/2877219217 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe608134a90 msgr2=0x7fe608136e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:20.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.662+0000 7fe60d0c0700 1 --2- 172.21.15.26:0/2877219217 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe608134a90 0x7fe608136e70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0009870 tx=0x7fe5f0009b80 comp rx=0 tx=0).stop 2023-10-01T07:54:20.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.662+0000 7fe60d0c0700 1 -- 172.21.15.26:0/2877219217 shutdown_connections 2023-10-01T07:54:20.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.662+0000 7fe60d0c0700 1 --2- 172.21.15.26:0/2877219217 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe6081373b0 0x7fe608139790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:20.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.662+0000 7fe60d0c0700 1 --2- 172.21.15.26:0/2877219217 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe608134a90 0x7fe608136e70 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:20.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.662+0000 7fe60d0c0700 1 -- 172.21.15.26:0/2877219217 >> 172.21.15.26:0/2877219217 conn(0x7fe6080a2c10 msgr2=0x7fe6080a3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:20.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.662+0000 7fe60d0c0700 1 -- 172.21.15.26:0/2877219217 shutdown_connections 2023-10-01T07:54:20.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.662+0000 7fe60d0c0700 1 -- 172.21.15.26:0/2877219217 wait complete. 2023-10-01T07:54:20.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.663+0000 7fe60d0c0700 1 Processor -- start 2023-10-01T07:54:20.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.664+0000 7fe60d0c0700 1 -- start start 2023-10-01T07:54:20.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.664+0000 7fe60d0c0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe608131c20 0x7fe60806f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:20.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.664+0000 7fe60d0c0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe608134a90 0x7fe60806f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:20.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.664+0000 7fe60d0c0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe6081373b0 0x7fe60806fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:20.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.664+0000 7fe60d0c0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe608137030 con 0x7fe608134a90 2023-10-01T07:54:20.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.664+0000 7fe60d0c0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6081191f0 con 0x7fe608131c20 2023-10-01T07:54:20.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.664+0000 7fe60d0c0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe608119840 con 0x7fe6081373b0 2023-10-01T07:54:20.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.664+0000 7fe606d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe608131c20 0x7fe60806f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:20.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.664+0000 7fe606d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe608131c20 0x7fe60806f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:60636/0 (socket says 172.21.15.26:60636) 2023-10-01T07:54:20.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.664+0000 7fe60759e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe6081373b0 0x7fe60806fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:20.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.664+0000 7fe606d9d700 1 -- 172.21.15.26:0/4168102492 learned_addr learned my addr 172.21.15.26:0/4168102492 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:20.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.664+0000 7fe60659c700 1 --2- 172.21.15.26:0/4168102492 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe608134a90 0x7fe60806f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:20.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.665+0000 7fe606d9d700 1 -- 172.21.15.26:0/4168102492 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe6081373b0 msgr2=0x7fe60806fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:20.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.665+0000 7fe606d9d700 1 --2- 172.21.15.26:0/4168102492 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe6081373b0 0x7fe60806fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:20.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.665+0000 7fe606d9d700 1 -- 172.21.15.26:0/4168102492 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe608134a90 msgr2=0x7fe60806f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:20.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.665+0000 7fe606d9d700 1 --2- 172.21.15.26:0/4168102492 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe608134a90 0x7fe60806f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:20.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.665+0000 7fe606d9d700 1 -- 172.21.15.26:0/4168102492 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe600009a70 con 0x7fe608131c20 2023-10-01T07:54:20.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.665+0000 7fe60759e700 1 --2- 172.21.15.26:0/4168102492 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe6081373b0 0x7fe60806fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:20.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.665+0000 7fe60659c700 1 --2- 172.21.15.26:0/4168102492 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe608134a90 0x7fe60806f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:20.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.665+0000 7fe606d9d700 1 --2- 172.21.15.26:0/4168102492 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe608131c20 0x7fe60806f0a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe5f800c520 tx=0x7fe5f800c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:20.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.665+0000 7fe5ff7fe700 1 -- 172.21.15.26:0/4168102492 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8004c80 con 0x7fe608131c20 2023-10-01T07:54:20.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.665+0000 7fe5ff7fe700 1 -- 172.21.15.26:0/4168102492 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f8004e00 con 0x7fe608131c20 2023-10-01T07:54:20.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.665+0000 7fe60d0c0700 1 -- 172.21.15.26:0/4168102492 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f00094a0 con 0x7fe608131c20 2023-10-01T07:54:20.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.665+0000 7fe5ff7fe700 1 -- 172.21.15.26:0/4168102492 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8007310 con 0x7fe608131c20 2023-10-01T07:54:20.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.665+0000 7fe60d0c0700 1 -- 172.21.15.26:0/4168102492 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe608071410 con 0x7fe608131c20 2023-10-01T07:54:20.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.666+0000 7fe5ff7fe700 1 -- 172.21.15.26:0/4168102492 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe5f8007470 con 0x7fe608131c20 2023-10-01T07:54:20.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.666+0000 7fe5ff7fe700 1 -- 172.21.15.26:0/4168102492 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fe5f803f800 con 0x7fe608131c20 2023-10-01T07:54:20.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.666+0000 7fe60d0c0700 1 -- 172.21.15.26:0/4168102492 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe60804f2a0 con 0x7fe608131c20 2023-10-01T07:54:20.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.671+0000 7fe5ff7fe700 1 -- 172.21.15.26:0/4168102492 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe5f80123b0 con 0x7fe608131c20 2023-10-01T07:54:20.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.875+0000 7fe60d0c0700 1 -- 172.21.15.26:0/4168102492 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe608072d60 con 0x7fe608131c20 2023-10-01T07:54:20.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.875+0000 7fe5ff7fe700 1 -- 172.21.15.26:0/4168102492 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe5f800ce60 con 0x7fe608131c20 2023-10-01T07:54:20.876 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-01T07:54:20.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.877+0000 7fe60d0c0700 1 -- 172.21.15.26:0/4168102492 >> v1:172.21.15.26:6816/126763 conn(0x7fe5e802f510 legacy=0x7fe5e80319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.877+0000 7fe60d0c0700 1 -- 172.21.15.26:0/4168102492 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe608131c20 msgr2=0x7fe60806f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.877+0000 7fe60d0c0700 1 --2- 172.21.15.26:0/4168102492 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe608131c20 0x7fe60806f0a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe5f800c520 tx=0x7fe5f800c830 comp rx=0 tx=0).stop 2023-10-01T07:54:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.877+0000 7fe60d0c0700 1 -- 172.21.15.26:0/4168102492 shutdown_connections 2023-10-01T07:54:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.877+0000 7fe60d0c0700 1 --2- 172.21.15.26:0/4168102492 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe6081373b0 0x7fe60806fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.877+0000 7fe60d0c0700 1 --2- 172.21.15.26:0/4168102492 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe608131c20 0x7fe60806f0a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.877+0000 7fe60d0c0700 1 --2- 172.21.15.26:0/4168102492 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe608134a90 0x7fe60806f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.877+0000 7fe60d0c0700 1 -- 172.21.15.26:0/4168102492 >> 172.21.15.26:0/4168102492 conn(0x7fe6080a2c10 msgr2=0x7fe60812fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.877+0000 7fe60d0c0700 1 -- 172.21.15.26:0/4168102492 shutdown_connections 2023-10-01T07:54:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:20.877+0000 7fe60d0c0700 1 -- 172.21.15.26:0/4168102492 wait complete. 2023-10-01T07:54:20.891 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-01T07:54:21.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.034+0000 7f7669721700 1 Processor -- start 2023-10-01T07:54:21.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.034+0000 7f7669721700 1 -- start start 2023-10-01T07:54:21.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.034+0000 7f7669721700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f76640a0a30 0x7f76640a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:21.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.034+0000 7f7669721700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f76640a1340 0x7f7664133930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:21.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.034+0000 7f7669721700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f766409df80 con 0x7f7664133e70 2023-10-01T07:54:21.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.034+0000 7f7669721700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f766409dcc0 con 0x7f76640a1340 2023-10-01T07:54:21.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.034+0000 7f7669721700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76640a20e0 con 0x7f76640a0a30 2023-10-01T07:54:21.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.035+0000 7f76627fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f76640a1340 0x7f7664133930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:21.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.035+0000 7f7662ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f76640a0a30 0x7f76640a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:21.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.035+0000 7f76637fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7664133e70 0x7f766413ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48722/0 (socket says 172.21.15.26:48722) 2023-10-01T07:54:21.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.035+0000 7f76637fe700 1 -- 172.21.15.26:0/4255219996 learned_addr learned my addr 172.21.15.26:0/4255219996 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:21.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.035+0000 7f76627fc700 1 -- 172.21.15.26:0/4255219996 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f76640a0a30 msgr2=0x7f76640a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:21.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.035+0000 7f76627fc700 1 --2- 172.21.15.26:0/4255219996 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f76640a0a30 0x7f76640a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:21.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.035+0000 7f76627fc700 1 -- 172.21.15.26:0/4255219996 >> v1:172.21.15.26:6789/0 conn(0x7f7664133e70 legacy=0x7f766413ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:21.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.035+0000 7f76627fc700 1 -- 172.21.15.26:0/4255219996 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76640a29e0 con 0x7f76640a1340 2023-10-01T07:54:21.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.035+0000 7f7661ffb700 1 -- 172.21.15.26:0/4255219996 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 245431244 0 0) 0x7f766409df80 con 0x7f7664133e70 2023-10-01T07:54:21.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.035+0000 7f7662ffd700 1 --2- 172.21.15.26:0/4255219996 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f76640a0a30 0x7f76640a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:21.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.035+0000 7f76627fc700 1 --2- 172.21.15.26:0/4255219996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76640a1340 0x7f7664133930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7658009840 tx=0x7f7658009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1312addc925e6c74 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:21.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.035+0000 7f7661ffb700 1 -- 172.21.15.26:0/4255219996 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7658011830 con 0x7f76640a1340 2023-10-01T07:54:21.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.035+0000 7f7661ffb700 1 -- 172.21.15.26:0/4255219996 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7658011990 con 0x7f76640a1340 2023-10-01T07:54:21.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.035+0000 7f7661ffb700 1 -- 172.21.15.26:0/4255219996 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7658011d20 con 0x7f76640a1340 2023-10-01T07:54:21.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.036+0000 7f7669721700 1 -- 172.21.15.26:0/4255219996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76640a1340 msgr2=0x7f7664133930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:21.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.036+0000 7f7669721700 1 --2- 172.21.15.26:0/4255219996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76640a1340 0x7f7664133930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7658009840 tx=0x7f7658009b50 comp rx=0 tx=0).stop 2023-10-01T07:54:21.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.036+0000 7f7669721700 1 -- 172.21.15.26:0/4255219996 shutdown_connections 2023-10-01T07:54:21.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.036+0000 7f7669721700 1 --2- 172.21.15.26:0/4255219996 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f76640a0a30 0x7f76640a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:21.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.036+0000 7f7669721700 1 --2- 172.21.15.26:0/4255219996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76640a1340 0x7f7664133930 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:21.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.036+0000 7f7669721700 1 -- 172.21.15.26:0/4255219996 >> 172.21.15.26:0/4255219996 conn(0x7f76640a2e10 msgr2=0x7f76640a3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:21.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.036+0000 7f7669721700 1 -- 172.21.15.26:0/4255219996 shutdown_connections 2023-10-01T07:54:21.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.036+0000 7f7669721700 1 -- 172.21.15.26:0/4255219996 wait complete. 2023-10-01T07:54:21.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.038+0000 7f7669721700 1 Processor -- start 2023-10-01T07:54:21.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.038+0000 7f7669721700 1 -- start start 2023-10-01T07:54:21.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.038+0000 7f7669721700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76640a0a30 0x7f7664122690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:21.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.038+0000 7f7669721700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f76640a1340 0x7f7664122bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:21.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.038+0000 7f7669721700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7664133e70 0x7f7664123110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:21.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.038+0000 7f7669721700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7664125c80 con 0x7f76640a0a30 2023-10-01T07:54:21.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.038+0000 7f7669721700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7664124340 con 0x7f7664133e70 2023-10-01T07:54:21.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.038+0000 7f7669721700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7664133650 con 0x7f76640a1340 2023-10-01T07:54:21.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.038+0000 7f7662ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76640a0a30 0x7f7664122690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:21.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.039+0000 7f7662ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76640a0a30 0x7f7664122690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38242/0 (socket says 172.21.15.26:38242) 2023-10-01T07:54:21.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.039+0000 7f7662ffd700 1 -- 172.21.15.26:0/3691251268 learned_addr learned my addr 172.21.15.26:0/3691251268 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:21.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.039+0000 7f76637fe700 1 --2- 172.21.15.26:0/3691251268 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7664133e70 0x7f7664123110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:21.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.039+0000 7f76627fc700 1 --2- 172.21.15.26:0/3691251268 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f76640a1340 0x7f7664122bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:21.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.039+0000 7f76637fe700 1 -- 172.21.15.26:0/3691251268 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f76640a1340 msgr2=0x7f7664122bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:21.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.039+0000 7f76637fe700 1 --2- 172.21.15.26:0/3691251268 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f76640a1340 0x7f7664122bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:21.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.039+0000 7f76637fe700 1 -- 172.21.15.26:0/3691251268 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76640a0a30 msgr2=0x7f7664122690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:21.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.039+0000 7f76637fe700 1 --2- 172.21.15.26:0/3691251268 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76640a0a30 0x7f7664122690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:21.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.039+0000 7f76637fe700 1 -- 172.21.15.26:0/3691251268 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76540094a0 con 0x7f7664133e70 2023-10-01T07:54:21.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.039+0000 7f7662ffd700 1 --2- 172.21.15.26:0/3691251268 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76640a0a30 0x7f7664122690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:21.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.039+0000 7f76627fc700 1 --2- 172.21.15.26:0/3691251268 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f76640a1340 0x7f7664122bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:21.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.039+0000 7f76637fe700 1 --2- 172.21.15.26:0/3691251268 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7664133e70 0x7f7664123110 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f765c00cbe0 tx=0x7f765c00cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:21.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.039+0000 7f764b7fe700 1 -- 172.21.15.26:0/3691251268 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c00aa40 con 0x7f7664133e70 2023-10-01T07:54:21.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.039+0000 7f764b7fe700 1 -- 172.21.15.26:0/3691251268 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765c00abc0 con 0x7f7664133e70 2023-10-01T07:54:21.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.039+0000 7f764b7fe700 1 -- 172.21.15.26:0/3691251268 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c0070d0 con 0x7f7664133e70 2023-10-01T07:54:21.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.039+0000 7f7669721700 1 -- 172.21.15.26:0/3691251268 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76580094a0 con 0x7f7664133e70 2023-10-01T07:54:21.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.039+0000 7f7669721700 1 -- 172.21.15.26:0/3691251268 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7664125ed0 con 0x7f7664133e70 2023-10-01T07:54:21.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.040+0000 7f764b7fe700 1 -- 172.21.15.26:0/3691251268 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f765c007230 con 0x7f7664133e70 2023-10-01T07:54:21.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.040+0000 7f764b7fe700 1 -- 172.21.15.26:0/3691251268 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f765c03f530 con 0x7f7664133e70 2023-10-01T07:54:21.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.040+0000 7f7669721700 1 -- 172.21.15.26:0/3691251268 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76641260c0 con 0x7f7664133e70 2023-10-01T07:54:21.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.045+0000 7f764b7fe700 1 -- 172.21.15.26:0/3691251268 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f765c018030 con 0x7f7664133e70 2023-10-01T07:54:21.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.250+0000 7f7669721700 1 -- 172.21.15.26:0/3691251268 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f766404f2a0 con 0x7f7664133e70 2023-10-01T07:54:21.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.250+0000 7f764b7fe700 1 -- 172.21.15.26:0/3691251268 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f765c018020 con 0x7f7664133e70 2023-10-01T07:54:21.251 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-01T07:54:21.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.252+0000 7f7669721700 1 -- 172.21.15.26:0/3691251268 >> v1:172.21.15.26:6816/126763 conn(0x7f765002f510 legacy=0x7f76500319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:21.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.252+0000 7f7669721700 1 -- 172.21.15.26:0/3691251268 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7664133e70 msgr2=0x7f7664123110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:21.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.252+0000 7f7669721700 1 --2- 172.21.15.26:0/3691251268 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7664133e70 0x7f7664123110 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f765c00cbe0 tx=0x7f765c00cef0 comp rx=0 tx=0).stop 2023-10-01T07:54:21.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.252+0000 7f7669721700 1 -- 172.21.15.26:0/3691251268 shutdown_connections 2023-10-01T07:54:21.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.252+0000 7f7669721700 1 --2- 172.21.15.26:0/3691251268 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7664133e70 0x7f7664123110 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:21.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.252+0000 7f7669721700 1 --2- 172.21.15.26:0/3691251268 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76640a0a30 0x7f7664122690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:21.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.252+0000 7f7669721700 1 --2- 172.21.15.26:0/3691251268 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f76640a1340 0x7f7664122bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:21.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.252+0000 7f7669721700 1 -- 172.21.15.26:0/3691251268 >> 172.21.15.26:0/3691251268 conn(0x7f76640a2e10 msgr2=0x7f766409a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:21.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.252+0000 7f7669721700 1 -- 172.21.15.26:0/3691251268 shutdown_connections 2023-10-01T07:54:21.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.252+0000 7f7669721700 1 -- 172.21.15.26:0/3691251268 wait complete. 2023-10-01T07:54:21.266 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-01T07:54:21.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.405+0000 7f4c49c65700 1 Processor -- start 2023-10-01T07:54:21.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.405+0000 7f4c49c65700 1 -- start start 2023-10-01T07:54:21.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.405+0000 7f4c49c65700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c4406a770 0x7f4c4406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:21.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.405+0000 7f4c49c65700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4c4406b080 0x7f4c44131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:21.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.405+0000 7f4c49c65700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c4409ece0 con 0x7f4c44131b40 2023-10-01T07:54:21.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.405+0000 7f4c49c65700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c4409e760 con 0x7f4c4406b080 2023-10-01T07:54:21.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.405+0000 7f4c49c65700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4409e040 con 0x7f4c4406a770 2023-10-01T07:54:21.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.405+0000 7f4c437fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c4406a770 0x7f4c4406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:21.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.405+0000 7f4c437fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c4406a770 0x7f4c4406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55854/0 (socket says 172.21.15.26:55854) 2023-10-01T07:54:21.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.405+0000 7f4c437fe700 1 -- 172.21.15.26:0/761067089 learned_addr learned my addr 172.21.15.26:0/761067089 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:21.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.405+0000 7f4c42ffd700 1 --2- 172.21.15.26:0/761067089 >> v2:172.21.15.26:3300/0 conn(0x7f4c4406b080 0x7f4c44131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:21.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.406+0000 7f4c437fe700 1 -- 172.21.15.26:0/761067089 >> v2:172.21.15.26:3300/0 conn(0x7f4c4406b080 msgr2=0x7f4c44131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:21.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.406+0000 7f4c437fe700 1 --2- 172.21.15.26:0/761067089 >> v2:172.21.15.26:3300/0 conn(0x7f4c4406b080 0x7f4c44131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:21.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.406+0000 7f4c437fe700 1 -- 172.21.15.26:0/761067089 >> v1:172.21.15.26:6789/0 conn(0x7f4c44131b40 legacy=0x7f4c44138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:21.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.406+0000 7f4c437fe700 1 -- 172.21.15.26:0/761067089 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c4409f630 con 0x7f4c4406a770 2023-10-01T07:54:21.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.406+0000 7f4c42ffd700 1 --2- 172.21.15.26:0/761067089 >> v2:172.21.15.26:3300/0 conn(0x7f4c4406b080 0x7f4c44131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:21.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.406+0000 7f4c437fe700 1 --2- 172.21.15.26:0/761067089 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c4406a770 0x7f4c4406ab40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4c340098f0 tx=0x7f4c34009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a74927854a61343a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:21.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.406+0000 7f4c427fc700 1 -- 172.21.15.26:0/761067089 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c34011830 con 0x7f4c4406a770 2023-10-01T07:54:21.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.406+0000 7f4c427fc700 1 -- 172.21.15.26:0/761067089 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c34011990 con 0x7f4c4406a770 2023-10-01T07:54:21.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.406+0000 7f4c427fc700 1 -- 172.21.15.26:0/761067089 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c34011d20 con 0x7f4c4406a770 2023-10-01T07:54:21.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.407+0000 7f4c49c65700 1 -- 172.21.15.26:0/761067089 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c4406a770 msgr2=0x7f4c4406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:21.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.407+0000 7f4c49c65700 1 --2- 172.21.15.26:0/761067089 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c4406a770 0x7f4c4406ab40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4c340098f0 tx=0x7f4c34009c00 comp rx=0 tx=0).stop 2023-10-01T07:54:21.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.407+0000 7f4c49c65700 1 -- 172.21.15.26:0/761067089 shutdown_connections 2023-10-01T07:54:21.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.407+0000 7f4c49c65700 1 --2- 172.21.15.26:0/761067089 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c4406a770 0x7f4c4406ab40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:21.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.407+0000 7f4c49c65700 1 --2- 172.21.15.26:0/761067089 >> v2:172.21.15.26:3300/0 conn(0x7f4c4406b080 0x7f4c44131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:21.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.407+0000 7f4c49c65700 1 -- 172.21.15.26:0/761067089 >> 172.21.15.26:0/761067089 conn(0x7f4c44066f50 msgr2=0x7f4c4409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:21.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.407+0000 7f4c49c65700 1 -- 172.21.15.26:0/761067089 shutdown_connections 2023-10-01T07:54:21.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.407+0000 7f4c49c65700 1 -- 172.21.15.26:0/761067089 wait complete. 2023-10-01T07:54:21.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.408+0000 7f4c49c65700 1 Processor -- start 2023-10-01T07:54:21.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.408+0000 7f4c49c65700 1 -- start start 2023-10-01T07:54:21.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.409+0000 7f4c49c65700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c4406a770 0x7f4c4409acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:21.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.409+0000 7f4c49c65700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c4406b080 0x7f4c4409b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:21.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.409+0000 7f4c49c65700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c44131b40 0x7f4c441c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:21.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.409+0000 7f4c49c65700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4409bf10 con 0x7f4c44131b40 2023-10-01T07:54:21.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.409+0000 7f4c49c65700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c44121e40 con 0x7f4c4406b080 2023-10-01T07:54:21.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.409+0000 7f4c49c65700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c44121450 con 0x7f4c4406a770 2023-10-01T07:54:21.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.409+0000 7f4c437fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c4406a770 0x7f4c4409acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:21.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.409+0000 7f4c437fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c4406a770 0x7f4c4409acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55860/0 (socket says 172.21.15.26:55860) 2023-10-01T07:54:21.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.409+0000 7f4c437fe700 1 -- 172.21.15.26:0/1918883607 learned_addr learned my addr 172.21.15.26:0/1918883607 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:21.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.409+0000 7f4c43fff700 1 --2- 172.21.15.26:0/1918883607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c44131b40 0x7f4c441c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:21.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.409+0000 7f4c42ffd700 1 --2- 172.21.15.26:0/1918883607 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c4406b080 0x7f4c4409b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:21.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.410+0000 7f4c437fe700 1 -- 172.21.15.26:0/1918883607 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c4406b080 msgr2=0x7f4c4409b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:21.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.410+0000 7f4c437fe700 1 --2- 172.21.15.26:0/1918883607 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c4406b080 0x7f4c4409b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:21.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.410+0000 7f4c437fe700 1 -- 172.21.15.26:0/1918883607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c44131b40 msgr2=0x7f4c441c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:21.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.410+0000 7f4c437fe700 1 --2- 172.21.15.26:0/1918883607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c44131b40 0x7f4c441c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:21.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.410+0000 7f4c437fe700 1 -- 172.21.15.26:0/1918883607 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c380094a0 con 0x7f4c4406a770 2023-10-01T07:54:21.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.410+0000 7f4c43fff700 1 --2- 172.21.15.26:0/1918883607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c44131b40 0x7f4c441c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:21.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.410+0000 7f4c437fe700 1 --2- 172.21.15.26:0/1918883607 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c4406a770 0x7f4c4409acb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4c34009c40 tx=0x7f4c34004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:21.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.410+0000 7f4c2bfff700 1 -- 172.21.15.26:0/1918883607 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c34004400 con 0x7f4c4406a770 2023-10-01T07:54:21.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.410+0000 7f4c2bfff700 1 -- 172.21.15.26:0/1918883607 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3401f070 con 0x7f4c4406a770 2023-10-01T07:54:21.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.410+0000 7f4c49c65700 1 -- 172.21.15.26:0/1918883607 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c34009550 con 0x7f4c4406a770 2023-10-01T07:54:21.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.410+0000 7f4c2bfff700 1 -- 172.21.15.26:0/1918883607 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c340038e0 con 0x7f4c4406a770 2023-10-01T07:54:21.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.410+0000 7f4c49c65700 1 -- 172.21.15.26:0/1918883607 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c4409b730 con 0x7f4c4406a770 2023-10-01T07:54:21.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.411+0000 7f4c2bfff700 1 -- 172.21.15.26:0/1918883607 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4c34021030 con 0x7f4c4406a770 2023-10-01T07:54:21.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.411+0000 7f4c2bfff700 1 -- 172.21.15.26:0/1918883607 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f4c34041000 con 0x7f4c4406a770 2023-10-01T07:54:21.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.411+0000 7f4c49c65700 1 -- 172.21.15.26:0/1918883607 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c44074ea0 con 0x7f4c4406a770 2023-10-01T07:54:21.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.416+0000 7f4c2bfff700 1 -- 172.21.15.26:0/1918883607 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4c34004560 con 0x7f4c4406a770 2023-10-01T07:54:21.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.664+0000 7f4c49c65700 1 -- 172.21.15.26:0/1918883607 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c4409a0c0 con 0x7f4c4406a770 2023-10-01T07:54:21.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.664+0000 7f4c2bfff700 1 -- 172.21.15.26:0/1918883607 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2315 (secure 0 0 0) 0x7f4c340233d0 con 0x7f4c4406a770 2023-10-01T07:54:21.665 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:54:21.665 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-01T07:51:57.295264+0000","modified":"2023-10-01T07:52:23.722337+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4189},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4189":{"gid":4189,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6817/2857714939","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6817","nonce":2857714939}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-01T07:54:21.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.667+0000 7f4c49c65700 1 -- 172.21.15.26:0/1918883607 >> v1:172.21.15.26:6816/126763 conn(0x7f4c3002f510 legacy=0x7f4c300319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:21.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.667+0000 7f4c49c65700 1 -- 172.21.15.26:0/1918883607 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c4406a770 msgr2=0x7f4c4409acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:21.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.667+0000 7f4c49c65700 1 --2- 172.21.15.26:0/1918883607 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c4406a770 0x7f4c4409acb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4c34009c40 tx=0x7f4c34004750 comp rx=0 tx=0).stop 2023-10-01T07:54:21.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.667+0000 7f4c49c65700 1 -- 172.21.15.26:0/1918883607 shutdown_connections 2023-10-01T07:54:21.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.667+0000 7f4c49c65700 1 --2- 172.21.15.26:0/1918883607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c44131b40 0x7f4c441c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:21.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.667+0000 7f4c49c65700 1 --2- 172.21.15.26:0/1918883607 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c4406a770 0x7f4c4409acb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:21.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.667+0000 7f4c49c65700 1 --2- 172.21.15.26:0/1918883607 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c4406b080 0x7f4c4409b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:21.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.667+0000 7f4c49c65700 1 -- 172.21.15.26:0/1918883607 >> 172.21.15.26:0/1918883607 conn(0x7f4c44066f50 msgr2=0x7f4c44070160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:21.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.667+0000 7f4c49c65700 1 -- 172.21.15.26:0/1918883607 shutdown_connections 2023-10-01T07:54:21.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.667+0000 7f4c49c65700 1 -- 172.21.15.26:0/1918883607 wait complete. 2023-10-01T07:54:21.670 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2023-10-01T07:54:21.681 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-01T07:54:21.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.817+0000 7feb0306c700 1 Processor -- start 2023-10-01T07:54:21.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.817+0000 7feb0306c700 1 -- start start 2023-10-01T07:54:21.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.818+0000 7feb0306c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feafc09e1d0 0x7feafc135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:21.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.818+0000 7feb0306c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feafc135e50 0x7feafc138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:21.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.818+0000 7feb0306c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feafc09f130 con 0x7feafc09d6f0 2023-10-01T07:54:21.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.818+0000 7feb0306c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feafc09f520 con 0x7feafc09e1d0 2023-10-01T07:54:21.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.818+0000 7feb0306c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feafc09e930 con 0x7feafc135e50 2023-10-01T07:54:21.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.818+0000 7feb01609700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feafc135e50 0x7feafc138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:21.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.818+0000 7feafbfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feafc09e1d0 0x7feafc135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:21.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.818+0000 7feb00e08700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7feafc09d6f0 0x7feafc09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48736/0 (socket says 172.21.15.26:48736) 2023-10-01T07:54:21.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.818+0000 7feb00e08700 1 -- 172.21.15.26:0/3372687426 learned_addr learned my addr 172.21.15.26:0/3372687426 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:21.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.818+0000 7feb01609700 1 -- 172.21.15.26:0/3372687426 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feafc09e1d0 msgr2=0x7feafc135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:21.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.818+0000 7feafb7fe700 1 -- 172.21.15.26:0/3372687426 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 624802636 0 0) 0x7feafc09f130 con 0x7feafc09d6f0 2023-10-01T07:54:21.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.818+0000 7feb01609700 1 --2- 172.21.15.26:0/3372687426 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feafc09e1d0 0x7feafc135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:21.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.818+0000 7feb01609700 1 -- 172.21.15.26:0/3372687426 >> v1:172.21.15.26:6789/0 conn(0x7feafc09d6f0 legacy=0x7feafc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:21.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.818+0000 7feb01609700 1 -- 172.21.15.26:0/3372687426 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feafc09b2d0 con 0x7feafc135e50 2023-10-01T07:54:21.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.818+0000 7feafbfff700 1 --2- 172.21.15.26:0/3372687426 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feafc09e1d0 0x7feafc135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:21.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.818+0000 7feb01609700 1 --2- 172.21.15.26:0/3372687426 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feafc135e50 0x7feafc138230 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7feaf4009dc0 tx=0x7feaf400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=814d08de4bd07a58 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:21.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.819+0000 7feafb7fe700 1 -- 172.21.15.26:0/3372687426 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf400e070 con 0x7feafc135e50 2023-10-01T07:54:21.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.819+0000 7feafb7fe700 1 -- 172.21.15.26:0/3372687426 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf400bb20 con 0x7feafc135e50 2023-10-01T07:54:21.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.819+0000 7feafb7fe700 1 -- 172.21.15.26:0/3372687426 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf4012430 con 0x7feafc135e50 2023-10-01T07:54:21.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.819+0000 7feb0306c700 1 -- 172.21.15.26:0/3372687426 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feafc135e50 msgr2=0x7feafc138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:21.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.819+0000 7feb0306c700 1 --2- 172.21.15.26:0/3372687426 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feafc135e50 0x7feafc138230 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7feaf4009dc0 tx=0x7feaf400b330 comp rx=0 tx=0).stop 2023-10-01T07:54:21.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.819+0000 7feb0306c700 1 -- 172.21.15.26:0/3372687426 shutdown_connections 2023-10-01T07:54:21.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.819+0000 7feb0306c700 1 --2- 172.21.15.26:0/3372687426 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feafc135e50 0x7feafc138230 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:21.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.819+0000 7feb0306c700 1 --2- 172.21.15.26:0/3372687426 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feafc09e1d0 0x7feafc135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:21.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.819+0000 7feb0306c700 1 -- 172.21.15.26:0/3372687426 >> 172.21.15.26:0/3372687426 conn(0x7feafc066f50 msgr2=0x7feafc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:21.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.819+0000 7feb0306c700 1 -- 172.21.15.26:0/3372687426 shutdown_connections 2023-10-01T07:54:21.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.819+0000 7feb0306c700 1 -- 172.21.15.26:0/3372687426 wait complete. 2023-10-01T07:54:21.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.820+0000 7feb0306c700 1 Processor -- start 2023-10-01T07:54:21.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.820+0000 7feb0306c700 1 -- start start 2023-10-01T07:54:21.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.821+0000 7feb0306c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feafc09d6f0 0x7feafc11d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:21.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.821+0000 7feb0306c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feafc09e1d0 0x7feafc11d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:21.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.821+0000 7feb0306c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feafc135e50 0x7feafc11de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:21.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.821+0000 7feb0306c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feafc0a1c10 con 0x7feafc09d6f0 2023-10-01T07:54:21.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.821+0000 7feb0306c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feafc11f580 con 0x7feafc09e1d0 2023-10-01T07:54:21.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.821+0000 7feb0306c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feafc120bd0 con 0x7feafc135e50 2023-10-01T07:54:21.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.821+0000 7feb00e08700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feafc09d6f0 0x7feafc11d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:21.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.821+0000 7feb01609700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feafc135e50 0x7feafc11de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:21.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.821+0000 7feb00e08700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feafc09d6f0 0x7feafc11d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38272/0 (socket says 172.21.15.26:38272) 2023-10-01T07:54:21.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.821+0000 7feb00e08700 1 -- 172.21.15.26:0/4072981981 learned_addr learned my addr 172.21.15.26:0/4072981981 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:21.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.821+0000 7feafbfff700 1 --2- 172.21.15.26:0/4072981981 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feafc09e1d0 0x7feafc11d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:21.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.822+0000 7feb01609700 1 -- 172.21.15.26:0/4072981981 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feafc09e1d0 msgr2=0x7feafc11d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:21.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.822+0000 7feb01609700 1 --2- 172.21.15.26:0/4072981981 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feafc09e1d0 0x7feafc11d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:21.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.822+0000 7feb01609700 1 -- 172.21.15.26:0/4072981981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feafc09d6f0 msgr2=0x7feafc11d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:21.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.822+0000 7feb01609700 1 --2- 172.21.15.26:0/4072981981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feafc09d6f0 0x7feafc11d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:21.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.822+0000 7feb01609700 1 -- 172.21.15.26:0/4072981981 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae40094a0 con 0x7feafc135e50 2023-10-01T07:54:21.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.822+0000 7feb00e08700 1 --2- 172.21.15.26:0/4072981981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feafc09d6f0 0x7feafc11d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:21.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.822+0000 7feb01609700 1 --2- 172.21.15.26:0/4072981981 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feafc135e50 0x7feafc11de80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7feaf4016000 tx=0x7feaf4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:21.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.822+0000 7feaf97fa700 1 -- 172.21.15.26:0/4072981981 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf4004840 con 0x7feafc135e50 2023-10-01T07:54:21.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.822+0000 7feaf97fa700 1 -- 172.21.15.26:0/4072981981 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf4020070 con 0x7feafc135e50 2023-10-01T07:54:21.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.822+0000 7feb0306c700 1 -- 172.21.15.26:0/4072981981 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf4009a70 con 0x7feafc135e50 2023-10-01T07:54:21.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.822+0000 7feaf97fa700 1 -- 172.21.15.26:0/4072981981 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf40276c0 con 0x7feafc135e50 2023-10-01T07:54:21.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.822+0000 7feb0306c700 1 -- 172.21.15.26:0/4072981981 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feafc121640 con 0x7feafc135e50 2023-10-01T07:54:21.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.823+0000 7feaf97fa700 1 -- 172.21.15.26:0/4072981981 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7feaf4012430 con 0x7feafc135e50 2023-10-01T07:54:21.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.823+0000 7feaf97fa700 1 -- 172.21.15.26:0/4072981981 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4049+0+0 (secure 0 0 0) 0x7feaf4022070 con 0x7feafc135e50 2023-10-01T07:54:21.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.823+0000 7feb0306c700 1 -- 172.21.15.26:0/4072981981 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feafc074ea0 con 0x7feafc135e50 2023-10-01T07:54:21.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:21.828+0000 7feaf97fa700 1 -- 172.21.15.26:0/4072981981 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feaf402c080 con 0x7feafc135e50 2023-10-01T07:54:22.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.031+0000 7feb0306c700 1 -- 172.21.15.26:0/4072981981 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feafc06c360 con 0x7feafc135e50 2023-10-01T07:54:22.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.033+0000 7feaf97fa700 1 -- 172.21.15.26:0/4072981981 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+12912 (secure 0 0 0) 0x7feaf401b400 con 0x7feafc135e50 2023-10-01T07:54:22.033 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:54:22.033 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":23,"fsid":"c29fb19d-520c-42a6-90f4-e7f86de96e8e","created":"2023-10-01T07:51:40.702414+0000","modified":"2023-10-01T07:54:16.814132+0000","last_up_change":"2023-10-01T07:51:48.849482+0000","last_in_change":"2023-10-01T07:51:42.084736+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-01T07:51:48.906889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-01T07:51:50.071599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-01T07:51:54.981575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-01T07:51:56.286318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46569ce3-81d1-44a1-a649-691de3e6f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6800","nonce":118773}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6801","nonce":118773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6803","nonce":118773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6802","nonce":118773}]},"public_addr":"172.21.15.26:6800/118773","cluster_addr":"172.21.15.26:6801/118773","heartbeat_back_addr":"172.21.15.26:6803/118773","heartbeat_front_addr":"172.21.15.26:6802/118773","state":["exists","up"]},{"osd":1,"uuid":"1fc1ba9b-4110-4d31-96d6-794937578cff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6804","nonce":118782}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6806","nonce":118782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6810","nonce":118782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6808","nonce":118782}]},"public_addr":"172.21.15.26:6804/118782","cluster_addr":"172.21.15.26:6806/118782","heartbeat_back_addr":"172.21.15.26:6810/118782","heartbeat_front_addr":"172.21.15.26:6808/118782","state":["exists","up"]},{"osd":2,"uuid":"37de933d-3b8e-4b94-87bd-2f36896c7ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6805","nonce":118789}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6807","nonce":118789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6811","nonce":118789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6809","nonce":118789}]},"public_addr":"172.21.15.26:6805/118789","cluster_addr":"172.21.15.26:6807/118789","heartbeat_back_addr":"172.21.15.26:6811/118789","heartbeat_front_addr":"172.21.15.26:6809/118789","state":["exists","up"]},{"osd":3,"uuid":"bd020309-5fd2-4d97-b36a-67e159fa3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6812","nonce":118790}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6813","nonce":118790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6815","nonce":118790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6814","nonce":118790}]},"public_addr":"172.21.15.26:6812/118790","cluster_addr":"172.21.15.26:6813/118790","heartbeat_back_addr":"172.21.15.26:6815/118790","heartbeat_front_addr":"172.21.15.26:6814/118790","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.029993+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.266503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.273540+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.229731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.e","mappings":[{"from":3,"to":0}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.39","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/616154075":"2023-10-02T07:54:14.803384+0000","172.21.15.26:6816/118178":"2023-10-02T07:54:14.803384+0000","172.21.15.26:0/1290599107":"2023-10-02T07:54:14.803384+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-01T07:54:22.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.035+0000 7feb0306c700 1 -- 172.21.15.26:0/4072981981 >> v1:172.21.15.26:6816/126763 conn(0x7feadc02f510 legacy=0x7feadc0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:22.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.035+0000 7feb0306c700 1 -- 172.21.15.26:0/4072981981 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feafc135e50 msgr2=0x7feafc11de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:22.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.035+0000 7feb0306c700 1 --2- 172.21.15.26:0/4072981981 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feafc135e50 0x7feafc11de80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7feaf4016000 tx=0x7feaf4004ad0 comp rx=0 tx=0).stop 2023-10-01T07:54:22.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.035+0000 7feb0306c700 1 -- 172.21.15.26:0/4072981981 shutdown_connections 2023-10-01T07:54:22.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.035+0000 7feb0306c700 1 --2- 172.21.15.26:0/4072981981 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feafc135e50 0x7feafc11de80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:22.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.035+0000 7feb0306c700 1 --2- 172.21.15.26:0/4072981981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feafc09d6f0 0x7feafc11d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:22.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.035+0000 7feb0306c700 1 --2- 172.21.15.26:0/4072981981 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feafc09e1d0 0x7feafc11d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:22.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.035+0000 7feb0306c700 1 -- 172.21.15.26:0/4072981981 >> 172.21.15.26:0/4072981981 conn(0x7feafc066f50 msgr2=0x7feafc071110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:22.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.035+0000 7feb0306c700 1 -- 172.21.15.26:0/4072981981 shutdown_connections 2023-10-01T07:54:22.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.035+0000 7feb0306c700 1 -- 172.21.15.26:0/4072981981 wait complete. 2023-10-01T07:54:22.049 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-01T07:51:48.906889+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-01T07:51:50.071599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-01T07:51:54.981575+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-01T07:51:56.286318+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-01T07:54:22.049 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-01T07:54:22.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.187+0000 7f013d9b9700 1 Processor -- start 2023-10-01T07:54:22.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.187+0000 7f013d9b9700 1 -- start start 2023-10-01T07:54:22.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.188+0000 7f013d9b9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f01381303c0 0x7f0138130790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:22.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.188+0000 7f013d9b9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f013806b290 0x7f013813b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:22.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.188+0000 7f013d9b9700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f013809f620 con 0x7f013806a770 2023-10-01T07:54:22.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.188+0000 7f013d9b9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0138130280 con 0x7f01381303c0 2023-10-01T07:54:22.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.188+0000 7f013d9b9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f013809e1b0 con 0x7f013806b290 2023-10-01T07:54:22.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.188+0000 7f01377fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f013806b290 0x7f013813b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:22.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.188+0000 7f01367fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f013806a770 0x7f013806ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48742/0 (socket says 172.21.15.26:48742) 2023-10-01T07:54:22.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.188+0000 7f0136ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f01381303c0 0x7f0138130790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:22.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.188+0000 7f01367fc700 1 -- 172.21.15.26:0/417576117 learned_addr learned my addr 172.21.15.26:0/417576117 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:22.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.188+0000 7f0135ffb700 1 -- 172.21.15.26:0/417576117 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1944481391 0 0) 0x7f013809f620 con 0x7f013806a770 2023-10-01T07:54:22.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.188+0000 7f0135ffb700 1 -- 172.21.15.26:0/417576117 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01240035b0 con 0x7f013806a770 2023-10-01T07:54:22.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.188+0000 7f0136ffd700 1 -- 172.21.15.26:0/417576117 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f013806b290 msgr2=0x7f013813b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:22.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.188+0000 7f0136ffd700 1 --2- 172.21.15.26:0/417576117 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f013806b290 0x7f013813b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:22.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.188+0000 7f0136ffd700 1 -- 172.21.15.26:0/417576117 >> v1:172.21.15.26:6789/0 conn(0x7f013806a770 legacy=0x7f013806ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:22.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.188+0000 7f0136ffd700 1 -- 172.21.15.26:0/417576117 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0138130cd0 con 0x7f01381303c0 2023-10-01T07:54:22.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.188+0000 7f01377fe700 1 --2- 172.21.15.26:0/417576117 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f013806b290 0x7f013813b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:22.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.189+0000 7f0136ffd700 1 --2- 172.21.15.26:0/417576117 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f01381303c0 0x7f0138130790 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0128009870 tx=0x7f0128009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f052c76e53fefa17 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:22.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.189+0000 7f0135ffb700 1 -- 172.21.15.26:0/417576117 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0128011830 con 0x7f01381303c0 2023-10-01T07:54:22.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.189+0000 7f0135ffb700 1 -- 172.21.15.26:0/417576117 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0128011990 con 0x7f01381303c0 2023-10-01T07:54:22.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.189+0000 7f0135ffb700 1 -- 172.21.15.26:0/417576117 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0128011d00 con 0x7f01381303c0 2023-10-01T07:54:22.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.189+0000 7f013d9b9700 1 -- 172.21.15.26:0/417576117 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f01381303c0 msgr2=0x7f0138130790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:22.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.189+0000 7f013d9b9700 1 --2- 172.21.15.26:0/417576117 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f01381303c0 0x7f0138130790 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0128009870 tx=0x7f0128009b80 comp rx=0 tx=0).stop 2023-10-01T07:54:22.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.189+0000 7f013d9b9700 1 -- 172.21.15.26:0/417576117 shutdown_connections 2023-10-01T07:54:22.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.189+0000 7f013d9b9700 1 --2- 172.21.15.26:0/417576117 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f013806b290 0x7f013813b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:22.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.189+0000 7f013d9b9700 1 --2- 172.21.15.26:0/417576117 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f01381303c0 0x7f0138130790 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:22.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.189+0000 7f013d9b9700 1 -- 172.21.15.26:0/417576117 >> 172.21.15.26:0/417576117 conn(0x7f0138066d70 msgr2=0x7f01380a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:22.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.189+0000 7f013d9b9700 1 -- 172.21.15.26:0/417576117 shutdown_connections 2023-10-01T07:54:22.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.189+0000 7f013d9b9700 1 -- 172.21.15.26:0/417576117 wait complete. 2023-10-01T07:54:22.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.190+0000 7f013d9b9700 1 Processor -- start 2023-10-01T07:54:22.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.191+0000 7f013d9b9700 1 -- start start 2023-10-01T07:54:22.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.191+0000 7f013d9b9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f013806a770 0x7f013811d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.191+0000 7f013d9b9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f013806b290 0x7f013811de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.191+0000 7f013d9b9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01381303c0 0x7f013811e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.191+0000 7f013d9b9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0138072170 con 0x7f01381303c0 2023-10-01T07:54:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.191+0000 7f013d9b9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0138120a10 con 0x7f013806a770 2023-10-01T07:54:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.191+0000 7f013d9b9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0138120180 con 0x7f013806b290 2023-10-01T07:54:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.191+0000 7f0136ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f013806a770 0x7f013811d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.191+0000 7f01367fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f013806b290 0x7f013811de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.191+0000 7f01377fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01381303c0 0x7f013811e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:22.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.191+0000 7f0136ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f013806a770 0x7f013811d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:60706/0 (socket says 172.21.15.26:60706) 2023-10-01T07:54:22.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.191+0000 7f0136ffd700 1 -- 172.21.15.26:0/1006065208 learned_addr learned my addr 172.21.15.26:0/1006065208 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:22.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.192+0000 7f0136ffd700 1 -- 172.21.15.26:0/1006065208 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f013806b290 msgr2=0x7f013811de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:22.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.192+0000 7f0136ffd700 1 --2- 172.21.15.26:0/1006065208 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f013806b290 0x7f013811de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:22.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.192+0000 7f0136ffd700 1 -- 172.21.15.26:0/1006065208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01381303c0 msgr2=0x7f013811e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:22.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.192+0000 7f0136ffd700 1 --2- 172.21.15.26:0/1006065208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01381303c0 0x7f013811e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:22.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.192+0000 7f0136ffd700 1 -- 172.21.15.26:0/1006065208 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0130009a70 con 0x7f013806a770 2023-10-01T07:54:22.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.192+0000 7f01367fc700 1 --2- 172.21.15.26:0/1006065208 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f013806b290 0x7f013811de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:22.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.192+0000 7f01377fe700 1 --2- 172.21.15.26:0/1006065208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01381303c0 0x7f013811e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:22.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.192+0000 7f0136ffd700 1 --2- 172.21.15.26:0/1006065208 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f013806a770 0x7f013811d930 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0128009bc0 tx=0x7f0128004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:22.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.192+0000 7f012ffff700 1 -- 172.21.15.26:0/1006065208 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01280044d0 con 0x7f013806a770 2023-10-01T07:54:22.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.192+0000 7f012ffff700 1 -- 172.21.15.26:0/1006065208 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01280036a0 con 0x7f013806a770 2023-10-01T07:54:22.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.192+0000 7f013d9b9700 1 -- 172.21.15.26:0/1006065208 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01280094a0 con 0x7f013806a770 2023-10-01T07:54:22.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.192+0000 7f012ffff700 1 -- 172.21.15.26:0/1006065208 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0128003a30 con 0x7f013806a770 2023-10-01T07:54:22.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.192+0000 7f013d9b9700 1 -- 172.21.15.26:0/1006065208 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01380a0320 con 0x7f013806a770 2023-10-01T07:54:22.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.193+0000 7f012ffff700 1 -- 172.21.15.26:0/1006065208 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0128003b90 con 0x7f013806a770 2023-10-01T07:54:22.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.193+0000 7f012ffff700 1 -- 172.21.15.26:0/1006065208 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f0128040cd0 con 0x7f013806a770 2023-10-01T07:54:22.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.193+0000 7f013d9b9700 1 -- 172.21.15.26:0/1006065208 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f013804f2a0 con 0x7f013806a770 2023-10-01T07:54:22.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.198+0000 7f012ffff700 1 -- 172.21.15.26:0/1006065208 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0128015020 con 0x7f013806a770 2023-10-01T07:54:22.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.403+0000 7f013d9b9700 1 -- 172.21.15.26:0/1006065208 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f013812fd90 con 0x7f013806a770 2023-10-01T07:54:22.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.403+0000 7f012ffff700 1 -- 172.21.15.26:0/1006065208 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f012802e970 con 0x7f013806a770 2023-10-01T07:54:22.404 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-01T07:54:22.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.406+0000 7f013d9b9700 1 -- 172.21.15.26:0/1006065208 >> v1:172.21.15.26:6816/126763 conn(0x7f011802f510 legacy=0x7f01180319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:22.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.406+0000 7f013d9b9700 1 -- 172.21.15.26:0/1006065208 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f013806a770 msgr2=0x7f013811d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:22.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.406+0000 7f013d9b9700 1 --2- 172.21.15.26:0/1006065208 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f013806a770 0x7f013811d930 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0128009bc0 tx=0x7f0128004750 comp rx=0 tx=0).stop 2023-10-01T07:54:22.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.406+0000 7f013d9b9700 1 -- 172.21.15.26:0/1006065208 shutdown_connections 2023-10-01T07:54:22.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.406+0000 7f013d9b9700 1 --2- 172.21.15.26:0/1006065208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01381303c0 0x7f013811e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:22.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.406+0000 7f013d9b9700 1 --2- 172.21.15.26:0/1006065208 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f013806a770 0x7f013811d930 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:22.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.406+0000 7f013d9b9700 1 --2- 172.21.15.26:0/1006065208 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f013806b290 0x7f013811de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:22.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.406+0000 7f013d9b9700 1 -- 172.21.15.26:0/1006065208 >> 172.21.15.26:0/1006065208 conn(0x7f0138066d70 msgr2=0x7f01380a1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:22.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.406+0000 7f013d9b9700 1 -- 172.21.15.26:0/1006065208 shutdown_connections 2023-10-01T07:54:22.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.406+0000 7f013d9b9700 1 -- 172.21.15.26:0/1006065208 wait complete. 2023-10-01T07:54:22.420 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-01T07:54:22.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.558+0000 7fea0c387700 1 Processor -- start 2023-10-01T07:54:22.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.558+0000 7fea0c387700 1 -- start start 2023-10-01T07:54:22.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.558+0000 7fea0c387700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea04134a90 0x7fea04136e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:22.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.558+0000 7fea0c387700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fea041373b0 0x7fea04139790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:22.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.558+0000 7fea0c387700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea0409ec00 con 0x7fea04131c20 2023-10-01T07:54:22.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.558+0000 7fea0c387700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea0406ee30 con 0x7fea041373b0 2023-10-01T07:54:22.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.558+0000 7fea0c387700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea04131780 con 0x7fea04134a90 2023-10-01T07:54:22.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.559+0000 7fea0a924700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fea041373b0 0x7fea04139790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:22.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.559+0000 7fea09922700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea04134a90 0x7fea04136e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:22.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.559+0000 7fea0a123700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fea04131c20 0x7fea04131ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48750/0 (socket says 172.21.15.26:48750) 2023-10-01T07:54:22.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.559+0000 7fea0a924700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fea041373b0 0x7fea04139790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38290/0 (socket says 172.21.15.26:38290) 2023-10-01T07:54:22.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.559+0000 7fea0a123700 1 -- 172.21.15.26:0/2252022979 learned_addr learned my addr 172.21.15.26:0/2252022979 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:22.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.559+0000 7fea09922700 1 -- 172.21.15.26:0/2252022979 >> v2:172.21.15.26:3300/0 conn(0x7fea041373b0 msgr2=0x7fea04139790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:22.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.559+0000 7fea09922700 1 --2- 172.21.15.26:0/2252022979 >> v2:172.21.15.26:3300/0 conn(0x7fea041373b0 0x7fea04139790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:22.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.559+0000 7fea09922700 1 -- 172.21.15.26:0/2252022979 >> v1:172.21.15.26:6789/0 conn(0x7fea04131c20 legacy=0x7fea04131ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:22.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.559+0000 7fea09121700 1 -- 172.21.15.26:0/2252022979 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1516791775 0 0) 0x7fea0409ec00 con 0x7fea04131c20 2023-10-01T07:54:22.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.559+0000 7fea09922700 1 -- 172.21.15.26:0/2252022979 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea04131a20 con 0x7fea04134a90 2023-10-01T07:54:22.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.559+0000 7fea0a924700 1 --2- 172.21.15.26:0/2252022979 >> v2:172.21.15.26:3300/0 conn(0x7fea041373b0 0x7fea04139790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:22.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.559+0000 7fea09922700 1 --2- 172.21.15.26:0/2252022979 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea04134a90 0x7fea04136e70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4009840 tx=0x7fe9f4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86f11b3962a25f6f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:22.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.559+0000 7fea09121700 1 -- 172.21.15.26:0/2252022979 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f4011830 con 0x7fea04134a90 2023-10-01T07:54:22.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.559+0000 7fea09121700 1 -- 172.21.15.26:0/2252022979 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f4011990 con 0x7fea04134a90 2023-10-01T07:54:22.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.559+0000 7fea09121700 1 -- 172.21.15.26:0/2252022979 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f4011d20 con 0x7fea04134a90 2023-10-01T07:54:22.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.560+0000 7fea0c387700 1 -- 172.21.15.26:0/2252022979 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea04134a90 msgr2=0x7fea04136e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:22.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.560+0000 7fea0c387700 1 --2- 172.21.15.26:0/2252022979 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea04134a90 0x7fea04136e70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4009840 tx=0x7fe9f4009b50 comp rx=0 tx=0).stop 2023-10-01T07:54:22.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.560+0000 7fea0c387700 1 -- 172.21.15.26:0/2252022979 shutdown_connections 2023-10-01T07:54:22.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.560+0000 7fea0c387700 1 --2- 172.21.15.26:0/2252022979 >> v2:172.21.15.26:3300/0 conn(0x7fea041373b0 0x7fea04139790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:22.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.560+0000 7fea0c387700 1 --2- 172.21.15.26:0/2252022979 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea04134a90 0x7fea04136e70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:22.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.560+0000 7fea0c387700 1 -- 172.21.15.26:0/2252022979 >> 172.21.15.26:0/2252022979 conn(0x7fea040a2c10 msgr2=0x7fea040a3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:22.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.560+0000 7fea0c387700 1 -- 172.21.15.26:0/2252022979 shutdown_connections 2023-10-01T07:54:22.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.560+0000 7fea0c387700 1 -- 172.21.15.26:0/2252022979 wait complete. 2023-10-01T07:54:22.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.561+0000 7fea0c387700 1 Processor -- start 2023-10-01T07:54:22.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.561+0000 7fea0c387700 1 -- start start 2023-10-01T07:54:22.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.562+0000 7fea0c387700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea04131c20 0x7fea0412b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:22.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.562+0000 7fea0c387700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea04134a90 0x7fea0409a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:22.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.562+0000 7fea0c387700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fea041373b0 0x7fea0409aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:22.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.562+0000 7fea0c387700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea04071880 con 0x7fea04134a90 2023-10-01T07:54:22.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.562+0000 7fea0c387700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea0406f4e0 con 0x7fea04131c20 2023-10-01T07:54:22.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.562+0000 7fea0c387700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea041371a0 con 0x7fea041373b0 2023-10-01T07:54:22.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.562+0000 7fea0a123700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea04131c20 0x7fea0412b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:22.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.562+0000 7fea09922700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea04134a90 0x7fea0409a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:22.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.562+0000 7fea0a123700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea04131c20 0x7fea0412b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:60734/0 (socket says 172.21.15.26:60734) 2023-10-01T07:54:22.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.562+0000 7fea0a123700 1 -- 172.21.15.26:0/175793724 learned_addr learned my addr 172.21.15.26:0/175793724 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:22.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.562+0000 7fea0a924700 1 --2- 172.21.15.26:0/175793724 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fea041373b0 0x7fea0409aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:22.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.562+0000 7fea0a123700 1 -- 172.21.15.26:0/175793724 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fea041373b0 msgr2=0x7fea0409aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:22.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.562+0000 7fea0a123700 1 --2- 172.21.15.26:0/175793724 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fea041373b0 0x7fea0409aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:22.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.562+0000 7fea0a123700 1 -- 172.21.15.26:0/175793724 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea04134a90 msgr2=0x7fea0409a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:22.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.562+0000 7fea0a123700 1 --2- 172.21.15.26:0/175793724 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea04134a90 0x7fea0409a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:22.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.562+0000 7fea0a123700 1 -- 172.21.15.26:0/175793724 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9fc009a70 con 0x7fea04131c20 2023-10-01T07:54:22.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.562+0000 7fea09922700 1 --2- 172.21.15.26:0/175793724 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea04134a90 0x7fea0409a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:22.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.562+0000 7fea0a123700 1 --2- 172.21.15.26:0/175793724 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea04131c20 0x7fea0412b770 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fea0000c520 tx=0x7fea0000c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:22.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.562+0000 7fe9faffd700 1 -- 172.21.15.26:0/175793724 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea00004c80 con 0x7fea04131c20 2023-10-01T07:54:22.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.562+0000 7fe9faffd700 1 -- 172.21.15.26:0/175793724 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea00004e00 con 0x7fea04131c20 2023-10-01T07:54:22.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.562+0000 7fea0c387700 1 -- 172.21.15.26:0/175793724 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f40094a0 con 0x7fea04131c20 2023-10-01T07:54:22.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.563+0000 7fe9faffd700 1 -- 172.21.15.26:0/175793724 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea00007310 con 0x7fea04131c20 2023-10-01T07:54:22.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.563+0000 7fea0c387700 1 -- 172.21.15.26:0/175793724 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea040712b0 con 0x7fea04131c20 2023-10-01T07:54:22.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.563+0000 7fe9faffd700 1 -- 172.21.15.26:0/175793724 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fea00007470 con 0x7fea04131c20 2023-10-01T07:54:22.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.564+0000 7fe9faffd700 1 -- 172.21.15.26:0/175793724 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fea0003f750 con 0x7fea04131c20 2023-10-01T07:54:22.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.564+0000 7fea0c387700 1 -- 172.21.15.26:0/175793724 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea04071f60 con 0x7fea04131c20 2023-10-01T07:54:22.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.569+0000 7fe9faffd700 1 -- 172.21.15.26:0/175793724 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fea000123b0 con 0x7fea04131c20 2023-10-01T07:54:22.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.774+0000 7fea0c387700 1 -- 172.21.15.26:0/175793724 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fea0404f2a0 con 0x7fea04131c20 2023-10-01T07:54:22.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.774+0000 7fe9faffd700 1 -- 172.21.15.26:0/175793724 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fea0000ce60 con 0x7fea04131c20 2023-10-01T07:54:22.775 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 8 2023-10-01T07:54:22.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.776+0000 7fea0c387700 1 -- 172.21.15.26:0/175793724 >> v1:172.21.15.26:6816/126763 conn(0x7fe9e802f510 legacy=0x7fe9e80319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:22.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.776+0000 7fea0c387700 1 -- 172.21.15.26:0/175793724 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea04131c20 msgr2=0x7fea0412b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:22.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.776+0000 7fea0c387700 1 --2- 172.21.15.26:0/175793724 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea04131c20 0x7fea0412b770 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fea0000c520 tx=0x7fea0000c830 comp rx=0 tx=0).stop 2023-10-01T07:54:22.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.776+0000 7fea0c387700 1 -- 172.21.15.26:0/175793724 shutdown_connections 2023-10-01T07:54:22.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.776+0000 7fea0c387700 1 --2- 172.21.15.26:0/175793724 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fea041373b0 0x7fea0409aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:22.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.777+0000 7fea0c387700 1 --2- 172.21.15.26:0/175793724 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea04131c20 0x7fea0412b770 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:22.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.777+0000 7fea0c387700 1 --2- 172.21.15.26:0/175793724 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea04134a90 0x7fea0409a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:22.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.777+0000 7fea0c387700 1 -- 172.21.15.26:0/175793724 >> 172.21.15.26:0/175793724 conn(0x7fea040a2c10 msgr2=0x7fea04132870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:22.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.777+0000 7fea0c387700 1 -- 172.21.15.26:0/175793724 shutdown_connections 2023-10-01T07:54:22.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.777+0000 7fea0c387700 1 -- 172.21.15.26:0/175793724 wait complete. 2023-10-01T07:54:22.790 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-01T07:54:22.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.929+0000 7fd05e835700 1 Processor -- start 2023-10-01T07:54:22.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.929+0000 7fd05e835700 1 -- start start 2023-10-01T07:54:22.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.930+0000 7fd05e835700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd05809d7d0 0x7fd05809dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:22.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.930+0000 7fd05e835700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd058130e80 0x7fd058138a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:22.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.930+0000 7fd05e835700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd05809b800 con 0x7fd05809e0e0 2023-10-01T07:54:22.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.930+0000 7fd05e835700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd05809b620 con 0x7fd058130e80 2023-10-01T07:54:22.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.930+0000 7fd05e835700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd05809f370 con 0x7fd05809d7d0 2023-10-01T07:54:22.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.930+0000 7fd057fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd05809d7d0 0x7fd05809dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:22.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.930+0000 7fd05cdd2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd058130e80 0x7fd058138a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:22.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.930+0000 7fd0577fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd05809e0e0 0x7fd058130770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48754/0 (socket says 172.21.15.26:48754) 2023-10-01T07:54:22.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.930+0000 7fd0577fe700 1 -- 172.21.15.26:0/201997013 learned_addr learned my addr 172.21.15.26:0/201997013 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:22.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.930+0000 7fd057fff700 1 -- 172.21.15.26:0/201997013 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd058130e80 msgr2=0x7fd058138a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:22.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.930+0000 7fd057fff700 1 --2- 172.21.15.26:0/201997013 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd058130e80 0x7fd058138a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:22.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.930+0000 7fd057fff700 1 -- 172.21.15.26:0/201997013 >> v1:172.21.15.26:6789/0 conn(0x7fd05809e0e0 legacy=0x7fd058130770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:22.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.930+0000 7fd056ffd700 1 -- 172.21.15.26:0/201997013 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3594006272 0 0) 0x7fd05809b800 con 0x7fd05809e0e0 2023-10-01T07:54:22.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.930+0000 7fd057fff700 1 -- 172.21.15.26:0/201997013 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd05809ef80 con 0x7fd05809d7d0 2023-10-01T07:54:22.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.930+0000 7fd05cdd2700 1 --2- 172.21.15.26:0/201997013 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd058130e80 0x7fd058138a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:22.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.930+0000 7fd057fff700 1 --2- 172.21.15.26:0/201997013 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd05809d7d0 0x7fd05809dba0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd0480098a0 tx=0x7fd048009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93c62e0120d7fe0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:22.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.931+0000 7fd056ffd700 1 -- 172.21.15.26:0/201997013 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd048011830 con 0x7fd05809d7d0 2023-10-01T07:54:22.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.931+0000 7fd056ffd700 1 -- 172.21.15.26:0/201997013 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd048011990 con 0x7fd05809d7d0 2023-10-01T07:54:22.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.931+0000 7fd056ffd700 1 -- 172.21.15.26:0/201997013 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd048011d20 con 0x7fd05809d7d0 2023-10-01T07:54:22.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.931+0000 7fd05e835700 1 -- 172.21.15.26:0/201997013 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd05809d7d0 msgr2=0x7fd05809dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:22.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.931+0000 7fd05e835700 1 --2- 172.21.15.26:0/201997013 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd05809d7d0 0x7fd05809dba0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd0480098a0 tx=0x7fd048009bb0 comp rx=0 tx=0).stop 2023-10-01T07:54:22.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.931+0000 7fd05e835700 1 -- 172.21.15.26:0/201997013 shutdown_connections 2023-10-01T07:54:22.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.931+0000 7fd05e835700 1 --2- 172.21.15.26:0/201997013 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd05809d7d0 0x7fd05809dba0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:22.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.931+0000 7fd05e835700 1 --2- 172.21.15.26:0/201997013 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd058130e80 0x7fd058138a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:22.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.931+0000 7fd05e835700 1 -- 172.21.15.26:0/201997013 >> 172.21.15.26:0/201997013 conn(0x7fd058066d70 msgr2=0x7fd0580a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:22.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.931+0000 7fd05e835700 1 -- 172.21.15.26:0/201997013 shutdown_connections 2023-10-01T07:54:22.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.931+0000 7fd05e835700 1 -- 172.21.15.26:0/201997013 wait complete. 2023-10-01T07:54:22.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.932+0000 7fd05e835700 1 Processor -- start 2023-10-01T07:54:22.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.932+0000 7fd05e835700 1 -- start start 2023-10-01T07:54:22.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.933+0000 7fd05e835700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd05809d7d0 0x7fd0581204c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:22.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.933+0000 7fd05e835700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd05809e0e0 0x7fd058120a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:22.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.933+0000 7fd05e835700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd058130e80 0x7fd058120f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:22.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.933+0000 7fd05e835700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd058130500 con 0x7fd058130e80 2023-10-01T07:54:22.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.933+0000 7fd05e835700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd058122250 con 0x7fd05809d7d0 2023-10-01T07:54:22.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.933+0000 7fd05e835700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd05809c720 con 0x7fd05809e0e0 2023-10-01T07:54:22.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.933+0000 7fd057fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd05809d7d0 0x7fd0581204c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:22.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.933+0000 7fd0577fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd05809e0e0 0x7fd058120a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:22.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.933+0000 7fd05cdd2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd058130e80 0x7fd058120f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:22.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.933+0000 7fd057fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd05809d7d0 0x7fd0581204c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:60750/0 (socket says 172.21.15.26:60750) 2023-10-01T07:54:22.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.933+0000 7fd057fff700 1 -- 172.21.15.26:0/3819601974 learned_addr learned my addr 172.21.15.26:0/3819601974 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:22.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.933+0000 7fd057fff700 1 -- 172.21.15.26:0/3819601974 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd05809e0e0 msgr2=0x7fd058120a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:22.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.933+0000 7fd057fff700 1 --2- 172.21.15.26:0/3819601974 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd05809e0e0 0x7fd058120a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:22.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.933+0000 7fd057fff700 1 -- 172.21.15.26:0/3819601974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd058130e80 msgr2=0x7fd058120f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:22.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.933+0000 7fd057fff700 1 --2- 172.21.15.26:0/3819601974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd058130e80 0x7fd058120f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:22.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.933+0000 7fd057fff700 1 -- 172.21.15.26:0/3819601974 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd050009a70 con 0x7fd05809d7d0 2023-10-01T07:54:22.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.934+0000 7fd057fff700 1 --2- 172.21.15.26:0/3819601974 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd05809d7d0 0x7fd0581204c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd048000c00 tx=0x7fd048004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:22.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.934+0000 7fd054ff9700 1 -- 172.21.15.26:0/3819601974 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0480044d0 con 0x7fd05809d7d0 2023-10-01T07:54:22.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.934+0000 7fd054ff9700 1 -- 172.21.15.26:0/3819601974 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04801e070 con 0x7fd05809d7d0 2023-10-01T07:54:22.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.934+0000 7fd05e835700 1 -- 172.21.15.26:0/3819601974 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0480094a0 con 0x7fd05809d7d0 2023-10-01T07:54:22.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.934+0000 7fd054ff9700 1 -- 172.21.15.26:0/3819601974 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0480038e0 con 0x7fd05809d7d0 2023-10-01T07:54:22.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.934+0000 7fd05e835700 1 -- 172.21.15.26:0/3819601974 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd058123d00 con 0x7fd05809d7d0 2023-10-01T07:54:22.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.935+0000 7fd054ff9700 1 -- 172.21.15.26:0/3819601974 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd048003a40 con 0x7fd05809d7d0 2023-10-01T07:54:22.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.935+0000 7fd054ff9700 1 -- 172.21.15.26:0/3819601974 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fd0480408e0 con 0x7fd05809d7d0 2023-10-01T07:54:22.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.935+0000 7fd05e835700 1 -- 172.21.15.26:0/3819601974 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd058130070 con 0x7fd05809d7d0 2023-10-01T07:54:22.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:22.940+0000 7fd054ff9700 1 -- 172.21.15.26:0/3819601974 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd058130070 con 0x7fd05809d7d0 2023-10-01T07:54:23.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.145+0000 7fd05e835700 1 -- 172.21.15.26:0/3819601974 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd058130070 con 0x7fd05809d7d0 2023-10-01T07:54:23.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.146+0000 7fd054ff9700 1 -- 172.21.15.26:0/3819601974 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd058130070 con 0x7fd05809d7d0 2023-10-01T07:54:23.146 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-01T07:54:23.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.148+0000 7fd05e835700 1 -- 172.21.15.26:0/3819601974 >> v1:172.21.15.26:6816/126763 conn(0x7fd04402f510 legacy=0x7fd0440319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:23.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.148+0000 7fd05e835700 1 -- 172.21.15.26:0/3819601974 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd05809d7d0 msgr2=0x7fd0581204c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:23.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.148+0000 7fd05e835700 1 --2- 172.21.15.26:0/3819601974 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd05809d7d0 0x7fd0581204c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd048000c00 tx=0x7fd048004750 comp rx=0 tx=0).stop 2023-10-01T07:54:23.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.148+0000 7fd05e835700 1 -- 172.21.15.26:0/3819601974 shutdown_connections 2023-10-01T07:54:23.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.148+0000 7fd05e835700 1 --2- 172.21.15.26:0/3819601974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd058130e80 0x7fd058120f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:23.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.148+0000 7fd05e835700 1 --2- 172.21.15.26:0/3819601974 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd05809d7d0 0x7fd0581204c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:23.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.148+0000 7fd05e835700 1 --2- 172.21.15.26:0/3819601974 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd05809e0e0 0x7fd058120a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:23.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.148+0000 7fd05e835700 1 -- 172.21.15.26:0/3819601974 >> 172.21.15.26:0/3819601974 conn(0x7fd058066d70 msgr2=0x7fd05806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:23.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.148+0000 7fd05e835700 1 -- 172.21.15.26:0/3819601974 shutdown_connections 2023-10-01T07:54:23.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.148+0000 7fd05e835700 1 -- 172.21.15.26:0/3819601974 wait complete. 2023-10-01T07:54:23.163 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-01T07:54:23.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.302+0000 7fa6a8a18700 1 Processor -- start 2023-10-01T07:54:23.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.302+0000 7fa6a8a18700 1 -- start start 2023-10-01T07:54:23.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.303+0000 7fa6a8a18700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa6a409d9d0 0x7fa6a409dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:23.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.303+0000 7fa6a8a18700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6a409e2e0 0x7fa6a412ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:23.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.303+0000 7fa6a8a18700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6a409b390 con 0x7fa6a41304f0 2023-10-01T07:54:23.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.303+0000 7fa6a8a18700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6a409d0a0 con 0x7fa6a409d9d0 2023-10-01T07:54:23.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.303+0000 7fa6a8a18700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a4072600 con 0x7fa6a409e2e0 2023-10-01T07:54:23.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.303+0000 7fa6a259c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa6a409d9d0 0x7fa6a409dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:23.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.303+0000 7fa6a1d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6a409e2e0 0x7fa6a412ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:23.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.303+0000 7fa6a259c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa6a409d9d0 0x7fa6a409dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38310/0 (socket says 172.21.15.26:38310) 2023-10-01T07:54:23.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.303+0000 7fa6a259c700 1 -- 172.21.15.26:0/4227448636 learned_addr learned my addr 172.21.15.26:0/4227448636 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:23.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.303+0000 7fa6a2d9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa6a41304f0 0x7fa6a4137480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48762/0 (socket says 172.21.15.26:48762) 2023-10-01T07:54:23.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.303+0000 7fa6a1d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6a409e2e0 0x7fa6a412ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:60762/0 (socket says 172.21.15.26:60762) 2023-10-01T07:54:23.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.304+0000 7fa6a259c700 1 -- 172.21.15.26:0/4227448636 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6a409e2e0 msgr2=0x7fa6a412ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:23.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.304+0000 7fa6a259c700 1 --2- 172.21.15.26:0/4227448636 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6a409e2e0 0x7fa6a412ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:23.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.304+0000 7fa6a259c700 1 -- 172.21.15.26:0/4227448636 >> v1:172.21.15.26:6789/0 conn(0x7fa6a41304f0 legacy=0x7fa6a4137480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:23.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.304+0000 7fa6a259c700 1 -- 172.21.15.26:0/4227448636 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a409b8d0 con 0x7fa6a409d9d0 2023-10-01T07:54:23.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.304+0000 7fa6a159a700 1 -- 172.21.15.26:0/4227448636 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3472454879 0 0) 0x7fa6a409b390 con 0x7fa6a41304f0 2023-10-01T07:54:23.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.304+0000 7fa6a1d9b700 1 --2- 172.21.15.26:0/4227448636 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6a409e2e0 0x7fa6a412ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:23.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.304+0000 7fa6a259c700 1 --2- 172.21.15.26:0/4227448636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6a409d9d0 0x7fa6a409dda0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa69400bb90 tx=0x7fa69400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f578a1242f580ffb server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:23.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.304+0000 7fa6a159a700 1 -- 172.21.15.26:0/4227448636 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69400dd30 con 0x7fa6a409d9d0 2023-10-01T07:54:23.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.304+0000 7fa6a159a700 1 -- 172.21.15.26:0/4227448636 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa69400de90 con 0x7fa6a409d9d0 2023-10-01T07:54:23.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.304+0000 7fa6a159a700 1 -- 172.21.15.26:0/4227448636 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa694010690 con 0x7fa6a409d9d0 2023-10-01T07:54:23.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.305+0000 7fa6a8a18700 1 -- 172.21.15.26:0/4227448636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6a409d9d0 msgr2=0x7fa6a409dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:23.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.305+0000 7fa6a8a18700 1 --2- 172.21.15.26:0/4227448636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6a409d9d0 0x7fa6a409dda0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa69400bb90 tx=0x7fa69400bea0 comp rx=0 tx=0).stop 2023-10-01T07:54:23.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.305+0000 7fa6a8a18700 1 -- 172.21.15.26:0/4227448636 shutdown_connections 2023-10-01T07:54:23.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.305+0000 7fa6a8a18700 1 --2- 172.21.15.26:0/4227448636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6a409d9d0 0x7fa6a409dda0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:23.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.305+0000 7fa6a8a18700 1 --2- 172.21.15.26:0/4227448636 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6a409e2e0 0x7fa6a412ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:23.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.305+0000 7fa6a8a18700 1 -- 172.21.15.26:0/4227448636 >> 172.21.15.26:0/4227448636 conn(0x7fa6a40a2c10 msgr2=0x7fa6a40a3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:23.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.305+0000 7fa6a8a18700 1 -- 172.21.15.26:0/4227448636 shutdown_connections 2023-10-01T07:54:23.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.305+0000 7fa6a8a18700 1 -- 172.21.15.26:0/4227448636 wait complete. 2023-10-01T07:54:23.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.306+0000 7fa6a8a18700 1 Processor -- start 2023-10-01T07:54:23.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.306+0000 7fa6a8a18700 1 -- start start 2023-10-01T07:54:23.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.307+0000 7fa6a8a18700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6a409d9d0 0x7fa6a41c4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:23.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.307+0000 7fa6a8a18700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa6a409e2e0 0x7fa6a41c4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:23.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.307+0000 7fa6a8a18700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6a41304f0 0x7fa6a411aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:23.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.307+0000 7fa6a8a18700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a411e8c0 con 0x7fa6a409d9d0 2023-10-01T07:54:23.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.307+0000 7fa6a8a18700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a41b9190 con 0x7fa6a41304f0 2023-10-01T07:54:23.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.307+0000 7fa6a8a18700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a412f960 con 0x7fa6a409e2e0 2023-10-01T07:54:23.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.307+0000 7fa6a259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6a409d9d0 0x7fa6a41c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:23.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.307+0000 7fa6a1d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa6a409e2e0 0x7fa6a41c4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:23.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.307+0000 7fa6a259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6a409d9d0 0x7fa6a41c4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38316/0 (socket says 172.21.15.26:38316) 2023-10-01T07:54:23.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.307+0000 7fa6a259c700 1 -- 172.21.15.26:0/764665670 learned_addr learned my addr 172.21.15.26:0/764665670 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:23.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.307+0000 7fa6a2d9d700 1 --2- 172.21.15.26:0/764665670 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6a41304f0 0x7fa6a411aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:23.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.308+0000 7fa6a259c700 1 -- 172.21.15.26:0/764665670 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa6a409e2e0 msgr2=0x7fa6a41c4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:23.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.308+0000 7fa6a259c700 1 --2- 172.21.15.26:0/764665670 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa6a409e2e0 0x7fa6a41c4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:23.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.308+0000 7fa6a259c700 1 -- 172.21.15.26:0/764665670 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6a41304f0 msgr2=0x7fa6a411aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:23.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.308+0000 7fa6a259c700 1 --2- 172.21.15.26:0/764665670 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6a41304f0 0x7fa6a411aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:23.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.308+0000 7fa6a259c700 1 -- 172.21.15.26:0/764665670 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa68c0094a0 con 0x7fa6a409d9d0 2023-10-01T07:54:23.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.308+0000 7fa6a259c700 1 --2- 172.21.15.26:0/764665670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6a409d9d0 0x7fa6a41c4560 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa694000c00 tx=0x7fa694004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:23.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.308+0000 7fa69affd700 1 -- 172.21.15.26:0/764665670 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa694003b70 con 0x7fa6a409d9d0 2023-10-01T07:54:23.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.308+0000 7fa69affd700 1 -- 172.21.15.26:0/764665670 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa694003cf0 con 0x7fa6a409d9d0 2023-10-01T07:54:23.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.308+0000 7fa6a8a18700 1 -- 172.21.15.26:0/764665670 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa69400b7f0 con 0x7fa6a409d9d0 2023-10-01T07:54:23.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.308+0000 7fa69affd700 1 -- 172.21.15.26:0/764665670 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6940106b0 con 0x7fa6a409d9d0 2023-10-01T07:54:23.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.308+0000 7fa6a8a18700 1 -- 172.21.15.26:0/764665670 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6a40a1ab0 con 0x7fa6a409d9d0 2023-10-01T07:54:23.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.309+0000 7fa69affd700 1 -- 172.21.15.26:0/764665670 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa694019400 con 0x7fa6a409d9d0 2023-10-01T07:54:23.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.309+0000 7fa6a8a18700 1 -- 172.21.15.26:0/764665670 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6a409aa10 con 0x7fa6a409d9d0 2023-10-01T07:54:23.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.309+0000 7fa69affd700 1 -- 172.21.15.26:0/764665670 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fa694040c30 con 0x7fa6a409d9d0 2023-10-01T07:54:23.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.314+0000 7fa69affd700 1 -- 172.21.15.26:0/764665670 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa694017300 con 0x7fa6a409d9d0 2023-10-01T07:54:23.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.518+0000 7fa6a8a18700 1 -- 172.21.15.26:0/764665670 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa6a404f2a0 con 0x7fa6a409d9d0 2023-10-01T07:54:23.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.519+0000 7fa69affd700 1 -- 172.21.15.26:0/764665670 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa694029b00 con 0x7fa6a409d9d0 2023-10-01T07:54:23.519 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-01T07:54:23.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.521+0000 7fa6a8a18700 1 -- 172.21.15.26:0/764665670 >> v1:172.21.15.26:6816/126763 conn(0x7fa68402f510 legacy=0x7fa6840319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:23.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.521+0000 7fa6a8a18700 1 -- 172.21.15.26:0/764665670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6a409d9d0 msgr2=0x7fa6a41c4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:23.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.521+0000 7fa6a8a18700 1 --2- 172.21.15.26:0/764665670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6a409d9d0 0x7fa6a41c4560 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa694000c00 tx=0x7fa694004750 comp rx=0 tx=0).stop 2023-10-01T07:54:23.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.521+0000 7fa6a8a18700 1 -- 172.21.15.26:0/764665670 shutdown_connections 2023-10-01T07:54:23.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.521+0000 7fa6a8a18700 1 --2- 172.21.15.26:0/764665670 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6a41304f0 0x7fa6a411aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:23.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.521+0000 7fa6a8a18700 1 --2- 172.21.15.26:0/764665670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6a409d9d0 0x7fa6a41c4560 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:23.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.521+0000 7fa6a8a18700 1 --2- 172.21.15.26:0/764665670 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa6a409e2e0 0x7fa6a41c4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:23.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.521+0000 7fa6a8a18700 1 -- 172.21.15.26:0/764665670 >> 172.21.15.26:0/764665670 conn(0x7fa6a40a2c10 msgr2=0x7fa6a41b7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:23.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.521+0000 7fa6a8a18700 1 -- 172.21.15.26:0/764665670 shutdown_connections 2023-10-01T07:54:23.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.521+0000 7fa6a8a18700 1 -- 172.21.15.26:0/764665670 wait complete. 2023-10-01T07:54:23.535 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-01T07:54:23.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.670+0000 7f3ffaa97700 1 Processor -- start 2023-10-01T07:54:23.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.670+0000 7f3ffaa97700 1 -- start start 2023-10-01T07:54:23.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.671+0000 7f3ffaa97700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3ff4136820 0x7f3ff4138c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:23.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.671+0000 7f3ffaa97700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ff4139140 0x7f3ff413b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:23.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.671+0000 7f3ffaa97700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ff406bc00 con 0x7f3ff4133a80 2023-10-01T07:54:23.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.671+0000 7f3ffaa97700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ff406c570 con 0x7f3ff4136820 2023-10-01T07:54:23.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.671+0000 7f3ffaa97700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff40a0040 con 0x7f3ff4139140 2023-10-01T07:54:23.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.671+0000 7f3ff3fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3ff4136820 0x7f3ff4138c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:23.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.671+0000 7f3ff9034700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ff4139140 0x7f3ff413b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:23.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.671+0000 7f3ff3fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3ff4136820 0x7f3ff4138c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46932/0 (socket says 172.21.15.26:46932) 2023-10-01T07:54:23.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.671+0000 7f3ff8833700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3ff4133a80 0x7f3ff4133e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42832/0 (socket says 172.21.15.26:42832) 2023-10-01T07:54:23.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.671+0000 7f3ff3fff700 1 -- 172.21.15.26:0/3401856293 learned_addr learned my addr 172.21.15.26:0/3401856293 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:23.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.671+0000 7f3ff3fff700 1 -- 172.21.15.26:0/3401856293 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ff4139140 msgr2=0x7f3ff413b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:23.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.671+0000 7f3ff3fff700 1 --2- 172.21.15.26:0/3401856293 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ff4139140 0x7f3ff413b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:23.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.671+0000 7f3ff3fff700 1 -- 172.21.15.26:0/3401856293 >> v1:172.21.15.26:6789/0 conn(0x7f3ff4133a80 legacy=0x7f3ff4133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:23.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.671+0000 7f3ff3fff700 1 -- 172.21.15.26:0/3401856293 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff4133860 con 0x7f3ff4136820 2023-10-01T07:54:23.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.671+0000 7f3ff37fe700 1 -- 172.21.15.26:0/3401856293 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 943797516 0 0) 0x7f3ff406bc00 con 0x7f3ff4133a80 2023-10-01T07:54:23.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.671+0000 7f3ff9034700 1 --2- 172.21.15.26:0/3401856293 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ff4139140 0x7f3ff413b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:23.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.671+0000 7f3ff3fff700 1 --2- 172.21.15.26:0/3401856293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ff4136820 0x7f3ff4138c00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3fe80098f0 tx=0x7f3fe8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8fd062dd350d2c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:23.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.672+0000 7f3ff37fe700 1 -- 172.21.15.26:0/3401856293 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8011830 con 0x7f3ff4136820 2023-10-01T07:54:23.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.672+0000 7f3ff37fe700 1 -- 172.21.15.26:0/3401856293 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe8011990 con 0x7f3ff4136820 2023-10-01T07:54:23.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.672+0000 7f3ff37fe700 1 -- 172.21.15.26:0/3401856293 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8011d20 con 0x7f3ff4136820 2023-10-01T07:54:23.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.672+0000 7f3ffaa97700 1 -- 172.21.15.26:0/3401856293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ff4136820 msgr2=0x7f3ff4138c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:23.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.672+0000 7f3ffaa97700 1 --2- 172.21.15.26:0/3401856293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ff4136820 0x7f3ff4138c00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3fe80098f0 tx=0x7f3fe8009c00 comp rx=0 tx=0).stop 2023-10-01T07:54:23.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.672+0000 7f3ffaa97700 1 -- 172.21.15.26:0/3401856293 shutdown_connections 2023-10-01T07:54:23.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.672+0000 7f3ffaa97700 1 --2- 172.21.15.26:0/3401856293 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ff4139140 0x7f3ff413b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:23.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.672+0000 7f3ffaa97700 1 --2- 172.21.15.26:0/3401856293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ff4136820 0x7f3ff4138c00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:23.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.672+0000 7f3ffaa97700 1 -- 172.21.15.26:0/3401856293 >> 172.21.15.26:0/3401856293 conn(0x7f3ff40a4210 msgr2=0x7f3ff40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:23.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.672+0000 7f3ffaa97700 1 -- 172.21.15.26:0/3401856293 shutdown_connections 2023-10-01T07:54:23.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.672+0000 7f3ffaa97700 1 -- 172.21.15.26:0/3401856293 wait complete. 2023-10-01T07:54:23.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.673+0000 7f3ffaa97700 1 Processor -- start 2023-10-01T07:54:23.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.673+0000 7f3ffaa97700 1 -- start start 2023-10-01T07:54:23.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.674+0000 7f3ffaa97700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ff4133a80 0x7f3ff406f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:23.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.674+0000 7f3ffaa97700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ff4136820 0x7f3ff406fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:23.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.674+0000 7f3ffaa97700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ff4139140 0x7f3ff40703d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:23.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.674+0000 7f3ffaa97700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff4070bd0 con 0x7f3ff4139140 2023-10-01T07:54:23.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.674+0000 7f3ffaa97700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff4136530 con 0x7f3ff4136820 2023-10-01T07:54:23.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.674+0000 7f3ffaa97700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff4071f50 con 0x7f3ff4133a80 2023-10-01T07:54:23.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.674+0000 7f3ff8833700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ff4133a80 0x7f3ff406f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:23.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.674+0000 7f3ff9034700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ff4139140 0x7f3ff40703d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:23.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.674+0000 7f3ff3fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ff4136820 0x7f3ff406fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:23.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.674+0000 7f3ff8833700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ff4133a80 0x7f3ff406f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:40720/0 (socket says 172.21.15.26:40720) 2023-10-01T07:54:23.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.674+0000 7f3ff9034700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ff4139140 0x7f3ff40703d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46938/0 (socket says 172.21.15.26:46938) 2023-10-01T07:54:23.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.674+0000 7f3ff8833700 1 -- 172.21.15.26:0/94981287 learned_addr learned my addr 172.21.15.26:0/94981287 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:23.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.674+0000 7f3ff3fff700 1 -- 172.21.15.26:0/94981287 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ff4133a80 msgr2=0x7f3ff406f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:23.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.674+0000 7f3ff3fff700 1 --2- 172.21.15.26:0/94981287 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ff4133a80 0x7f3ff406f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:23.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.674+0000 7f3ff3fff700 1 -- 172.21.15.26:0/94981287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ff4139140 msgr2=0x7f3ff40703d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:23.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.674+0000 7f3ff3fff700 1 --2- 172.21.15.26:0/94981287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ff4139140 0x7f3ff40703d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:23.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.674+0000 7f3ff3fff700 1 -- 172.21.15.26:0/94981287 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fec009a70 con 0x7f3ff4136820 2023-10-01T07:54:23.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.674+0000 7f3ff9034700 1 --2- 172.21.15.26:0/94981287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ff4139140 0x7f3ff40703d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:23.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.674+0000 7f3ff8833700 1 --2- 172.21.15.26:0/94981287 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ff4133a80 0x7f3ff406f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:23.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.675+0000 7f3ff3fff700 1 --2- 172.21.15.26:0/94981287 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ff4136820 0x7f3ff406fe90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8016000 tx=0x7f3fe8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:23.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.675+0000 7f3ff17fa700 1 -- 172.21.15.26:0/94981287 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8004510 con 0x7f3ff4136820 2023-10-01T07:54:23.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.675+0000 7f3ff17fa700 1 -- 172.21.15.26:0/94981287 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe80036a0 con 0x7f3ff4136820 2023-10-01T07:54:23.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.675+0000 7f3ffaa97700 1 -- 172.21.15.26:0/94981287 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe8009550 con 0x7f3ff4136820 2023-10-01T07:54:23.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.675+0000 7f3ff17fa700 1 -- 172.21.15.26:0/94981287 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8003a10 con 0x7f3ff4136820 2023-10-01T07:54:23.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.675+0000 7f3ffaa97700 1 -- 172.21.15.26:0/94981287 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ff41300a0 con 0x7f3ff4136820 2023-10-01T07:54:23.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.676+0000 7f3ff17fa700 1 -- 172.21.15.26:0/94981287 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3fe8003b70 con 0x7f3ff4136820 2023-10-01T07:54:23.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.676+0000 7f3ff17fa700 1 -- 172.21.15.26:0/94981287 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f3fe8021030 con 0x7f3ff4136820 2023-10-01T07:54:23.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.676+0000 7f3ffaa97700 1 -- 172.21.15.26:0/94981287 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ff4072450 con 0x7f3ff4136820 2023-10-01T07:54:23.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.681+0000 7f3ff17fa700 1 -- 172.21.15.26:0/94981287 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3fe802b080 con 0x7f3ff4136820 2023-10-01T07:54:23.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.926+0000 7f3ffaa97700 1 -- 172.21.15.26:0/94981287 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ff4074ea0 con 0x7f3ff4136820 2023-10-01T07:54:23.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.927+0000 7f3ff17fa700 1 -- 172.21.15.26:0/94981287 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2315 (secure 0 0 0) 0x7f3fe801a7b0 con 0x7f3ff4136820 2023-10-01T07:54:23.928 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:54:23.928 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-01T07:51:57.295264+0000","modified":"2023-10-01T07:52:23.722337+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4189},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4189":{"gid":4189,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6817/2857714939","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6817","nonce":2857714939}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-01T07:54:23.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.929+0000 7f3ffaa97700 1 -- 172.21.15.26:0/94981287 >> v1:172.21.15.26:6816/126763 conn(0x7f3fe002f510 legacy=0x7f3fe00319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:23.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.929+0000 7f3ffaa97700 1 -- 172.21.15.26:0/94981287 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ff4136820 msgr2=0x7f3ff406fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:23.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.929+0000 7f3ffaa97700 1 --2- 172.21.15.26:0/94981287 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ff4136820 0x7f3ff406fe90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8016000 tx=0x7f3fe8004750 comp rx=0 tx=0).stop 2023-10-01T07:54:23.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.929+0000 7f3ffaa97700 1 -- 172.21.15.26:0/94981287 shutdown_connections 2023-10-01T07:54:23.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.929+0000 7f3ffaa97700 1 --2- 172.21.15.26:0/94981287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ff4139140 0x7f3ff40703d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:23.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.929+0000 7f3ffaa97700 1 --2- 172.21.15.26:0/94981287 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ff4133a80 0x7f3ff406f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:23.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.929+0000 7f3ffaa97700 1 --2- 172.21.15.26:0/94981287 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ff4136820 0x7f3ff406fe90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:23.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.929+0000 7f3ffaa97700 1 -- 172.21.15.26:0/94981287 >> 172.21.15.26:0/94981287 conn(0x7f3ff40a4210 msgr2=0x7f3ff40a0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:23.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.929+0000 7f3ffaa97700 1 -- 172.21.15.26:0/94981287 shutdown_connections 2023-10-01T07:54:23.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:23.929+0000 7f3ffaa97700 1 -- 172.21.15.26:0/94981287 wait complete. 2023-10-01T07:54:23.931 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2023-10-01T07:54:23.943 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-01T07:54:24.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.080+0000 7ffb2066a700 1 Processor -- start 2023-10-01T07:54:24.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.080+0000 7ffb2066a700 1 -- start start 2023-10-01T07:54:24.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.081+0000 7ffb2066a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffb1809d6f0 0x7ffb1809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:24.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.081+0000 7ffb2066a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffb1809e000 0x7ffb181339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:24.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.081+0000 7ffb2066a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb1809b120 con 0x7ffb1809e410 2023-10-01T07:54:24.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.081+0000 7ffb2066a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb1806b460 con 0x7ffb1809e000 2023-10-01T07:54:24.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.081+0000 7ffb2066a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1809a7e0 con 0x7ffb1809d6f0 2023-10-01T07:54:24.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.081+0000 7ffb1e406700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffb1809d6f0 0x7ffb1809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:24.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.081+0000 7ffb1dc05700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffb1809e000 0x7ffb181339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:24.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.081+0000 7ffb1dc05700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffb1809e000 0x7ffb181339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46944/0 (socket says 172.21.15.26:46944) 2023-10-01T07:54:24.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.081+0000 7ffb1e406700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffb1809d6f0 0x7ffb1809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:40732/0 (socket says 172.21.15.26:40732) 2023-10-01T07:54:24.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.081+0000 7ffb1dc05700 1 -- 172.21.15.26:0/4141889113 learned_addr learned my addr 172.21.15.26:0/4141889113 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:24.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.081+0000 7ffb1ec07700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ffb1809e410 0x7ffb18133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42846/0 (socket says 172.21.15.26:42846) 2023-10-01T07:54:24.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.082+0000 7ffb1dc05700 1 -- 172.21.15.26:0/4141889113 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffb1809d6f0 msgr2=0x7ffb1809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:24.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.082+0000 7ffb1dc05700 1 --2- 172.21.15.26:0/4141889113 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffb1809d6f0 0x7ffb1809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:24.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.082+0000 7ffb1dc05700 1 -- 172.21.15.26:0/4141889113 >> v1:172.21.15.26:6789/0 conn(0x7ffb1809e410 legacy=0x7ffb18133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:24.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.082+0000 7ffb1dc05700 1 -- 172.21.15.26:0/4141889113 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1809a500 con 0x7ffb1809e000 2023-10-01T07:54:24.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.082+0000 7ffb1d404700 1 -- 172.21.15.26:0/4141889113 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1736470525 0 0) 0x7ffb1809b120 con 0x7ffb1809e410 2023-10-01T07:54:24.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.082+0000 7ffb1e406700 1 --2- 172.21.15.26:0/4141889113 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffb1809d6f0 0x7ffb1809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:24.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.082+0000 7ffb1dc05700 1 --2- 172.21.15.26:0/4141889113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb1809e000 0x7ffb181339f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ffb080098f0 tx=0x7ffb08009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c363bb5683b818e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:24.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.082+0000 7ffb1d404700 1 -- 172.21.15.26:0/4141889113 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb08011830 con 0x7ffb1809e000 2023-10-01T07:54:24.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.082+0000 7ffb1d404700 1 -- 172.21.15.26:0/4141889113 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb08011990 con 0x7ffb1809e000 2023-10-01T07:54:24.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.082+0000 7ffb1d404700 1 -- 172.21.15.26:0/4141889113 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb08011d20 con 0x7ffb1809e000 2023-10-01T07:54:24.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.083+0000 7ffb2066a700 1 -- 172.21.15.26:0/4141889113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb1809e000 msgr2=0x7ffb181339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:24.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.083+0000 7ffb2066a700 1 --2- 172.21.15.26:0/4141889113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb1809e000 0x7ffb181339f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ffb080098f0 tx=0x7ffb08009c00 comp rx=0 tx=0).stop 2023-10-01T07:54:24.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.083+0000 7ffb2066a700 1 -- 172.21.15.26:0/4141889113 shutdown_connections 2023-10-01T07:54:24.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.083+0000 7ffb2066a700 1 --2- 172.21.15.26:0/4141889113 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffb1809d6f0 0x7ffb1809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:24.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.083+0000 7ffb2066a700 1 --2- 172.21.15.26:0/4141889113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb1809e000 0x7ffb181339f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:24.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.083+0000 7ffb2066a700 1 -- 172.21.15.26:0/4141889113 >> 172.21.15.26:0/4141889113 conn(0x7ffb18066f50 msgr2=0x7ffb1809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:24.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.083+0000 7ffb2066a700 1 -- 172.21.15.26:0/4141889113 shutdown_connections 2023-10-01T07:54:24.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.083+0000 7ffb2066a700 1 -- 172.21.15.26:0/4141889113 wait complete. 2023-10-01T07:54:24.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.084+0000 7ffb2066a700 1 Processor -- start 2023-10-01T07:54:24.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.084+0000 7ffb2066a700 1 -- start start 2023-10-01T07:54:24.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.084+0000 7ffb2066a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb1809d6f0 0x7ffb181a5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:24.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.084+0000 7ffb2066a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffb1809e000 0x7ffb181a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:24.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.084+0000 7ffb2066a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb1809e410 0x7ffb181a6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:24.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.084+0000 7ffb2066a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb181a9150 con 0x7ffb1809e410 2023-10-01T07:54:24.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.084+0000 7ffb2066a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1809c710 con 0x7ffb1809d6f0 2023-10-01T07:54:24.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.084+0000 7ffb2066a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb180a2e40 con 0x7ffb1809e000 2023-10-01T07:54:24.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.084+0000 7ffb1e406700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb1809d6f0 0x7ffb181a5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:24.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.084+0000 7ffb1dc05700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffb1809e000 0x7ffb181a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:24.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.084+0000 7ffb1ec07700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb1809e410 0x7ffb181a6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:24.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.084+0000 7ffb1dc05700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffb1809e000 0x7ffb181a63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:40744/0 (socket says 172.21.15.26:40744) 2023-10-01T07:54:24.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.084+0000 7ffb1e406700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb1809d6f0 0x7ffb181a5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55140/0 (socket says 172.21.15.26:55140) 2023-10-01T07:54:24.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.084+0000 7ffb1dc05700 1 -- 172.21.15.26:0/1459478883 learned_addr learned my addr 172.21.15.26:0/1459478883 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:24.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.085+0000 7ffb1dc05700 1 -- 172.21.15.26:0/1459478883 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb1809d6f0 msgr2=0x7ffb181a5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:24.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.085+0000 7ffb1dc05700 1 --2- 172.21.15.26:0/1459478883 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb1809d6f0 0x7ffb181a5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:24.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.085+0000 7ffb1dc05700 1 -- 172.21.15.26:0/1459478883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb1809e410 msgr2=0x7ffb181a6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:24.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.085+0000 7ffb1dc05700 1 --2- 172.21.15.26:0/1459478883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb1809e410 0x7ffb181a6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:24.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.085+0000 7ffb1dc05700 1 -- 172.21.15.26:0/1459478883 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb140094a0 con 0x7ffb1809e000 2023-10-01T07:54:24.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.085+0000 7ffb1ec07700 1 --2- 172.21.15.26:0/1459478883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb1809e410 0x7ffb181a6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:24.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.085+0000 7ffb1dc05700 1 --2- 172.21.15.26:0/1459478883 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffb1809e000 0x7ffb181a63e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ffb08000c00 tx=0x7ffb08004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:24.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.085+0000 7ffb0effd700 1 -- 172.21.15.26:0/1459478883 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0801a900 con 0x7ffb1809e000 2023-10-01T07:54:24.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.085+0000 7ffb0effd700 1 -- 172.21.15.26:0/1459478883 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0801f070 con 0x7ffb1809e000 2023-10-01T07:54:24.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.085+0000 7ffb0effd700 1 -- 172.21.15.26:0/1459478883 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0801acc0 con 0x7ffb1809e000 2023-10-01T07:54:24.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.085+0000 7ffb2066a700 1 -- 172.21.15.26:0/1459478883 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb08009550 con 0x7ffb1809e000 2023-10-01T07:54:24.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.085+0000 7ffb2066a700 1 -- 172.21.15.26:0/1459478883 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb181a8d00 con 0x7ffb1809e000 2023-10-01T07:54:24.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.086+0000 7ffb0effd700 1 -- 172.21.15.26:0/1459478883 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ffb0801b430 con 0x7ffb1809e000 2023-10-01T07:54:24.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.086+0000 7ffb0effd700 1 -- 172.21.15.26:0/1459478883 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4049+0+0 (secure 0 0 0) 0x7ffb08021070 con 0x7ffb1809e000 2023-10-01T07:54:24.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.086+0000 7ffb2066a700 1 -- 172.21.15.26:0/1459478883 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb18074ea0 con 0x7ffb1809e000 2023-10-01T07:54:24.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.091+0000 7ffb0effd700 1 -- 172.21.15.26:0/1459478883 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb0802b080 con 0x7ffb1809e000 2023-10-01T07:54:24.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.296+0000 7ffb2066a700 1 -- 172.21.15.26:0/1459478883 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb181a9540 con 0x7ffb1809e000 2023-10-01T07:54:24.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.297+0000 7ffb0effd700 1 -- 172.21.15.26:0/1459478883 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+12912 (secure 0 0 0) 0x7ffb08015020 con 0x7ffb1809e000 2023-10-01T07:54:24.297 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:54:24.297 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":23,"fsid":"c29fb19d-520c-42a6-90f4-e7f86de96e8e","created":"2023-10-01T07:51:40.702414+0000","modified":"2023-10-01T07:54:16.814132+0000","last_up_change":"2023-10-01T07:51:48.849482+0000","last_in_change":"2023-10-01T07:51:42.084736+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-01T07:51:48.906889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-01T07:51:50.071599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-01T07:51:54.981575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-01T07:51:56.286318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46569ce3-81d1-44a1-a649-691de3e6f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6800","nonce":118773}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6801","nonce":118773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6803","nonce":118773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6802","nonce":118773}]},"public_addr":"172.21.15.26:6800/118773","cluster_addr":"172.21.15.26:6801/118773","heartbeat_back_addr":"172.21.15.26:6803/118773","heartbeat_front_addr":"172.21.15.26:6802/118773","state":["exists","up"]},{"osd":1,"uuid":"1fc1ba9b-4110-4d31-96d6-794937578cff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6804","nonce":118782}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6806","nonce":118782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6810","nonce":118782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6808","nonce":118782}]},"public_addr":"172.21.15.26:6804/118782","cluster_addr":"172.21.15.26:6806/118782","heartbeat_back_addr":"172.21.15.26:6810/118782","heartbeat_front_addr":"172.21.15.26:6808/118782","state":["exists","up"]},{"osd":2,"uuid":"37de933d-3b8e-4b94-87bd-2f36896c7ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6805","nonce":118789}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6807","nonce":118789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6811","nonce":118789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6809","nonce":118789}]},"public_addr":"172.21.15.26:6805/118789","cluster_addr":"172.21.15.26:6807/118789","heartbeat_back_addr":"172.21.15.26:6811/118789","heartbeat_front_addr":"172.21.15.26:6809/118789","state":["exists","up"]},{"osd":3,"uuid":"bd020309-5fd2-4d97-b36a-67e159fa3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6812","nonce":118790}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6813","nonce":118790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6815","nonce":118790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6814","nonce":118790}]},"public_addr":"172.21.15.26:6812/118790","cluster_addr":"172.21.15.26:6813/118790","heartbeat_back_addr":"172.21.15.26:6815/118790","heartbeat_front_addr":"172.21.15.26:6814/118790","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.029993+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.266503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.273540+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.229731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.e","mappings":[{"from":3,"to":0}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.39","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/616154075":"2023-10-02T07:54:14.803384+0000","172.21.15.26:6816/118178":"2023-10-02T07:54:14.803384+0000","172.21.15.26:0/1290599107":"2023-10-02T07:54:14.803384+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-01T07:54:24.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.299+0000 7ffb2066a700 1 -- 172.21.15.26:0/1459478883 >> v1:172.21.15.26:6816/126763 conn(0x7ffafc02f510 legacy=0x7ffafc0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:24.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.299+0000 7ffb2066a700 1 -- 172.21.15.26:0/1459478883 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffb1809e000 msgr2=0x7ffb181a63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:24.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.299+0000 7ffb2066a700 1 --2- 172.21.15.26:0/1459478883 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffb1809e000 0x7ffb181a63e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ffb08000c00 tx=0x7ffb08004750 comp rx=0 tx=0).stop 2023-10-01T07:54:24.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.299+0000 7ffb2066a700 1 -- 172.21.15.26:0/1459478883 shutdown_connections 2023-10-01T07:54:24.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.299+0000 7ffb2066a700 1 --2- 172.21.15.26:0/1459478883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb1809e410 0x7ffb181a6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:24.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.299+0000 7ffb2066a700 1 --2- 172.21.15.26:0/1459478883 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb1809d6f0 0x7ffb181a5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:24.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.299+0000 7ffb2066a700 1 --2- 172.21.15.26:0/1459478883 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffb1809e000 0x7ffb181a63e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:24.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.299+0000 7ffb2066a700 1 -- 172.21.15.26:0/1459478883 >> 172.21.15.26:0/1459478883 conn(0x7ffb18066f50 msgr2=0x7ffb181bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:24.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.299+0000 7ffb2066a700 1 -- 172.21.15.26:0/1459478883 shutdown_connections 2023-10-01T07:54:24.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.299+0000 7ffb2066a700 1 -- 172.21.15.26:0/1459478883 wait complete. 2023-10-01T07:54:24.313 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-01T07:54:24.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.448+0000 7f75e48ee700 1 Processor -- start 2023-10-01T07:54:24.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.448+0000 7f75e48ee700 1 -- start start 2023-10-01T07:54:24.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.449+0000 7f75e48ee700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f75e009d6f0 0x7f75e009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:24.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.449+0000 7f75e48ee700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f75e009e440 0x7f75e0134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:24.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.449+0000 7f75e48ee700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e009b120 con 0x7f75e009e000 2023-10-01T07:54:24.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.449+0000 7f75e48ee700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e006b460 con 0x7f75e009d6f0 2023-10-01T07:54:24.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.449+0000 7f75e48ee700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75e009a7e0 con 0x7f75e009e440 2023-10-01T07:54:24.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.449+0000 7f75ded9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f75e009e440 0x7f75e0134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:24.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.449+0000 7f75de59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f75e009d6f0 0x7f75e009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:24.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.449+0000 7f75ded9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f75e009e440 0x7f75e0134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:40752/0 (socket says 172.21.15.26:40752) 2023-10-01T07:54:24.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.449+0000 7f75de59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f75e009d6f0 0x7f75e009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46956/0 (socket says 172.21.15.26:46956) 2023-10-01T07:54:24.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.449+0000 7f75ddd9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f75e009e000 0x7f75e01339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42858/0 (socket says 172.21.15.26:42858) 2023-10-01T07:54:24.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.449+0000 7f75ded9d700 1 -- 172.21.15.26:0/2550983491 learned_addr learned my addr 172.21.15.26:0/2550983491 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:24.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.450+0000 7f75de59c700 1 -- 172.21.15.26:0/2550983491 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f75e009e440 msgr2=0x7f75e0134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:24.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.450+0000 7f75de59c700 1 --2- 172.21.15.26:0/2550983491 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f75e009e440 0x7f75e0134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:24.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.450+0000 7f75de59c700 1 -- 172.21.15.26:0/2550983491 >> v1:172.21.15.26:6789/0 conn(0x7f75e009e000 legacy=0x7f75e01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:24.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.450+0000 7f75de59c700 1 -- 172.21.15.26:0/2550983491 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e009a500 con 0x7f75e009d6f0 2023-10-01T07:54:24.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.450+0000 7f75dd59a700 1 -- 172.21.15.26:0/2550983491 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 420954845 0 0) 0x7f75e009b120 con 0x7f75e009e000 2023-10-01T07:54:24.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.450+0000 7f75ded9d700 1 --2- 172.21.15.26:0/2550983491 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f75e009e440 0x7f75e0134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:24.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.450+0000 7f75de59c700 1 --2- 172.21.15.26:0/2550983491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e009d6f0 0x7f75e009dac0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f75d0009870 tx=0x7f75d0009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5829209e87c6e54 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:24.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.450+0000 7f75dd59a700 1 -- 172.21.15.26:0/2550983491 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d0011830 con 0x7f75e009d6f0 2023-10-01T07:54:24.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.450+0000 7f75dd59a700 1 -- 172.21.15.26:0/2550983491 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d0011990 con 0x7f75e009d6f0 2023-10-01T07:54:24.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.450+0000 7f75dd59a700 1 -- 172.21.15.26:0/2550983491 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d0011d20 con 0x7f75e009d6f0 2023-10-01T07:54:24.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.451+0000 7f75e48ee700 1 -- 172.21.15.26:0/2550983491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e009d6f0 msgr2=0x7f75e009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:24.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.451+0000 7f75e48ee700 1 --2- 172.21.15.26:0/2550983491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e009d6f0 0x7f75e009dac0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f75d0009870 tx=0x7f75d0009b80 comp rx=0 tx=0).stop 2023-10-01T07:54:24.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.451+0000 7f75e48ee700 1 -- 172.21.15.26:0/2550983491 shutdown_connections 2023-10-01T07:54:24.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.451+0000 7f75e48ee700 1 --2- 172.21.15.26:0/2550983491 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f75e009e440 0x7f75e0134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:24.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.451+0000 7f75e48ee700 1 --2- 172.21.15.26:0/2550983491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e009d6f0 0x7f75e009dac0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:24.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.451+0000 7f75e48ee700 1 -- 172.21.15.26:0/2550983491 >> 172.21.15.26:0/2550983491 conn(0x7f75e0066f50 msgr2=0x7f75e009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:24.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.451+0000 7f75e48ee700 1 -- 172.21.15.26:0/2550983491 shutdown_connections 2023-10-01T07:54:24.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.451+0000 7f75e48ee700 1 -- 172.21.15.26:0/2550983491 wait complete. 2023-10-01T07:54:24.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.452+0000 7f75e48ee700 1 Processor -- start 2023-10-01T07:54:24.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.453+0000 7f75e48ee700 1 -- start start 2023-10-01T07:54:24.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.453+0000 7f75e48ee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e009d6f0 0x7f75e01c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:24.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.453+0000 7f75e48ee700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f75e009e000 0x7f75e01c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:24.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.453+0000 7f75e48ee700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f75e009e440 0x7f75e01c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:24.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.453+0000 7f75e48ee700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e01a6f70 con 0x7f75e009d6f0 2023-10-01T07:54:24.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.453+0000 7f75e48ee700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e01a6410 con 0x7f75e009e440 2023-10-01T07:54:24.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.453+0000 7f75e48ee700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75e009c710 con 0x7f75e009e000 2023-10-01T07:54:24.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.453+0000 7f75de59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e009d6f0 0x7f75e01c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:24.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.453+0000 7f75de59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e009d6f0 0x7f75e01c7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46964/0 (socket says 172.21.15.26:46964) 2023-10-01T07:54:24.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.453+0000 7f75de59c700 1 -- 172.21.15.26:0/2785685333 learned_addr learned my addr 172.21.15.26:0/2785685333 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:24.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.453+0000 7f75ddd9b700 1 --2- 172.21.15.26:0/2785685333 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f75e009e000 0x7f75e01c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:24.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.453+0000 7f75ded9d700 1 --2- 172.21.15.26:0/2785685333 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f75e009e440 0x7f75e01c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:24.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.454+0000 7f75de59c700 1 -- 172.21.15.26:0/2785685333 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f75e009e000 msgr2=0x7f75e01c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:24.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.454+0000 7f75de59c700 1 --2- 172.21.15.26:0/2785685333 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f75e009e000 0x7f75e01c8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:24.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.454+0000 7f75de59c700 1 -- 172.21.15.26:0/2785685333 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f75e009e440 msgr2=0x7f75e01c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:24.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.454+0000 7f75de59c700 1 --2- 172.21.15.26:0/2785685333 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f75e009e440 0x7f75e01c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:24.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.454+0000 7f75de59c700 1 -- 172.21.15.26:0/2785685333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d8009b30 con 0x7f75e009d6f0 2023-10-01T07:54:24.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.454+0000 7f75ddd9b700 1 --2- 172.21.15.26:0/2785685333 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f75e009e000 0x7f75e01c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:24.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.454+0000 7f75de59c700 1 --2- 172.21.15.26:0/2785685333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e009d6f0 0x7f75e01c7f40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f75d00090b0 tx=0x7f75d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:24.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.454+0000 7f75ceffd700 1 -- 172.21.15.26:0/2785685333 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d001a8b0 con 0x7f75e009d6f0 2023-10-01T07:54:24.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.454+0000 7f75ceffd700 1 -- 172.21.15.26:0/2785685333 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d001aa10 con 0x7f75e009d6f0 2023-10-01T07:54:24.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.454+0000 7f75ceffd700 1 -- 172.21.15.26:0/2785685333 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d001ada0 con 0x7f75e009d6f0 2023-10-01T07:54:24.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.454+0000 7f75e48ee700 1 -- 172.21.15.26:0/2785685333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d00094a0 con 0x7f75e009d6f0 2023-10-01T07:54:24.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.454+0000 7f75e48ee700 1 -- 172.21.15.26:0/2785685333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e01a6a80 con 0x7f75e009d6f0 2023-10-01T07:54:24.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.455+0000 7f75ceffd700 1 -- 172.21.15.26:0/2785685333 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f75d00243f0 con 0x7f75e009d6f0 2023-10-01T07:54:24.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.455+0000 7f75ceffd700 1 -- 172.21.15.26:0/2785685333 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f75d0041060 con 0x7f75e009d6f0 2023-10-01T07:54:24.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.455+0000 7f75e48ee700 1 -- 172.21.15.26:0/2785685333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75e0074ea0 con 0x7f75e009d6f0 2023-10-01T07:54:24.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.460+0000 7f75ceffd700 1 -- 172.21.15.26:0/2785685333 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f75d0015070 con 0x7f75e009d6f0 2023-10-01T07:54:24.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.703+0000 7f75e48ee700 1 -- 172.21.15.26:0/2785685333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75e009f420 con 0x7f75e009d6f0 2023-10-01T07:54:24.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.704+0000 7f75ceffd700 1 -- 172.21.15.26:0/2785685333 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2315 (secure 0 0 0) 0x7f75d000b360 con 0x7f75e009d6f0 2023-10-01T07:54:24.705 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:54:24.705 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-01T07:51:57.295264+0000","modified":"2023-10-01T07:52:23.722337+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4189},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4189":{"gid":4189,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6817/2857714939","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6817","nonce":2857714939}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-01T07:54:24.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.706+0000 7f75e48ee700 1 -- 172.21.15.26:0/2785685333 >> v1:172.21.15.26:6816/126763 conn(0x7f75c002f510 legacy=0x7f75c00319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:24.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.706+0000 7f75e48ee700 1 -- 172.21.15.26:0/2785685333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e009d6f0 msgr2=0x7f75e01c7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:24.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.706+0000 7f75e48ee700 1 --2- 172.21.15.26:0/2785685333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e009d6f0 0x7f75e01c7f40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f75d00090b0 tx=0x7f75d0004750 comp rx=0 tx=0).stop 2023-10-01T07:54:24.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.706+0000 7f75e48ee700 1 -- 172.21.15.26:0/2785685333 shutdown_connections 2023-10-01T07:54:24.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.706+0000 7f75e48ee700 1 --2- 172.21.15.26:0/2785685333 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f75e009e440 0x7f75e01c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:24.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.706+0000 7f75e48ee700 1 --2- 172.21.15.26:0/2785685333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e009d6f0 0x7f75e01c7f40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:24.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.706+0000 7f75e48ee700 1 --2- 172.21.15.26:0/2785685333 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f75e009e000 0x7f75e01c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:24.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.706+0000 7f75e48ee700 1 -- 172.21.15.26:0/2785685333 >> 172.21.15.26:0/2785685333 conn(0x7f75e0066f50 msgr2=0x7f75e01bbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:24.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.706+0000 7f75e48ee700 1 -- 172.21.15.26:0/2785685333 shutdown_connections 2023-10-01T07:54:24.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.706+0000 7f75e48ee700 1 -- 172.21.15.26:0/2785685333 wait complete. 2023-10-01T07:54:24.708 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2023-10-01T07:54:24.821 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-01T07:51:57.295264+0000', 'modified': '2023-10-01T07:52:23.722337+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4189}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4189': {'gid': 4189, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.26:6817/2857714939', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.26:6817', 'nonce': 2857714939}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-01T07:54:24.821 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-01T07:54:24.821 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-01T07:54:24.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.963+0000 7f6f231db700 1 Processor -- start 2023-10-01T07:54:24.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.963+0000 7f6f231db700 1 -- start start 2023-10-01T07:54:24.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.964+0000 7f6f231db700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6f1c133420 0x7f6f1c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:24.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.964+0000 7f6f231db700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f1c134260 0x7f6f1c1306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:24.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.964+0000 7f6f231db700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f1c06b990 con 0x7f6f1c133e30 2023-10-01T07:54:24.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.964+0000 7f6f231db700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f1c0a0590 con 0x7f6f1c133420 2023-10-01T07:54:24.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.964+0000 7f6f231db700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1c09fb80 con 0x7f6f1c134260 2023-10-01T07:54:24.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.964+0000 7f6f20f77700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6f1c133420 0x7f6f1c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:24.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.964+0000 7f6f21778700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f1c134260 0x7f6f1c1306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:24.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.964+0000 7f6f1bfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6f1c133e30 0x7f6f1c12ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42868/0 (socket says 172.21.15.26:42868) 2023-10-01T07:54:24.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.964+0000 7f6f20f77700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6f1c133420 0x7f6f1c1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46980/0 (socket says 172.21.15.26:46980) 2023-10-01T07:54:24.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.964+0000 7f6f21778700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f1c134260 0x7f6f1c1306a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55168/0 (socket says 172.21.15.26:55168) 2023-10-01T07:54:24.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.964+0000 7f6f1bfff700 1 -- 172.21.15.26:0/2515995762 learned_addr learned my addr 172.21.15.26:0/2515995762 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:24.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.964+0000 7f6f20f77700 1 -- 172.21.15.26:0/2515995762 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f1c134260 msgr2=0x7f6f1c1306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:24.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.964+0000 7f6f20f77700 1 --2- 172.21.15.26:0/2515995762 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f1c134260 0x7f6f1c1306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:24.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.964+0000 7f6f20f77700 1 -- 172.21.15.26:0/2515995762 >> v1:172.21.15.26:6789/0 conn(0x7f6f1c133e30 legacy=0x7f6f1c12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:24.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.964+0000 7f6f20f77700 1 -- 172.21.15.26:0/2515995762 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f1c0a0030 con 0x7f6f1c133420 2023-10-01T07:54:24.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.964+0000 7f6f1b7fe700 1 -- 172.21.15.26:0/2515995762 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2738994384 0 0) 0x7f6f1c06b990 con 0x7f6f1c133e30 2023-10-01T07:54:24.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.965+0000 7f6f20f77700 1 --2- 172.21.15.26:0/2515995762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f1c133420 0x7f6f1c1337f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009840 tx=0x7f6f0c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe891b113c7f9ec9 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:24.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.965+0000 7f6f1b7fe700 1 -- 172.21.15.26:0/2515995762 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c011830 con 0x7f6f1c133420 2023-10-01T07:54:24.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.965+0000 7f6f1b7fe700 1 -- 172.21.15.26:0/2515995762 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0c011990 con 0x7f6f1c133420 2023-10-01T07:54:24.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.965+0000 7f6f1b7fe700 1 -- 172.21.15.26:0/2515995762 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c011d20 con 0x7f6f1c133420 2023-10-01T07:54:24.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.965+0000 7f6f231db700 1 -- 172.21.15.26:0/2515995762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f1c133420 msgr2=0x7f6f1c1337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:24.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.965+0000 7f6f231db700 1 --2- 172.21.15.26:0/2515995762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f1c133420 0x7f6f1c1337f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009840 tx=0x7f6f0c009b50 comp rx=0 tx=0).stop 2023-10-01T07:54:24.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.965+0000 7f6f231db700 1 -- 172.21.15.26:0/2515995762 shutdown_connections 2023-10-01T07:54:24.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.965+0000 7f6f231db700 1 --2- 172.21.15.26:0/2515995762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f1c133420 0x7f6f1c1337f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:24.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.965+0000 7f6f231db700 1 --2- 172.21.15.26:0/2515995762 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f1c134260 0x7f6f1c1306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:24.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.965+0000 7f6f231db700 1 -- 172.21.15.26:0/2515995762 >> 172.21.15.26:0/2515995762 conn(0x7f6f1c0a4210 msgr2=0x7f6f1c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:24.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.965+0000 7f6f231db700 1 -- 172.21.15.26:0/2515995762 shutdown_connections 2023-10-01T07:54:24.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.965+0000 7f6f231db700 1 -- 172.21.15.26:0/2515995762 wait complete. 2023-10-01T07:54:24.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.966+0000 7f6f231db700 1 Processor -- start 2023-10-01T07:54:24.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.966+0000 7f6f231db700 1 -- start start 2023-10-01T07:54:24.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.967+0000 7f6f231db700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f1c133420 0x7f6f1c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:24.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.967+0000 7f6f231db700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f1c133e30 0x7f6f1c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:24.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.967+0000 7f6f231db700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f1c134260 0x7f6f1c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:24.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.967+0000 7f6f231db700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1c131690 con 0x7f6f1c133420 2023-10-01T07:54:24.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.967+0000 7f6f231db700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1c1200b0 con 0x7f6f1c133e30 2023-10-01T07:54:24.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.967+0000 7f6f231db700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1c11fe20 con 0x7f6f1c134260 2023-10-01T07:54:24.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.967+0000 7f6f20f77700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f1c133420 0x7f6f1c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:24.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.967+0000 7f6f1bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f1c133e30 0x7f6f1c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:24.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.967+0000 7f6f20f77700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f1c133420 0x7f6f1c09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46990/0 (socket says 172.21.15.26:46990) 2023-10-01T07:54:24.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.967+0000 7f6f20f77700 1 -- 172.21.15.26:0/2358175167 learned_addr learned my addr 172.21.15.26:0/2358175167 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:24.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.967+0000 7f6f21778700 1 --2- 172.21.15.26:0/2358175167 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f1c134260 0x7f6f1c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:24.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.968+0000 7f6f20f77700 1 -- 172.21.15.26:0/2358175167 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f1c134260 msgr2=0x7f6f1c09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:24.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.968+0000 7f6f20f77700 1 --2- 172.21.15.26:0/2358175167 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f1c134260 0x7f6f1c09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:24.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.968+0000 7f6f20f77700 1 -- 172.21.15.26:0/2358175167 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f1c133e30 msgr2=0x7f6f1c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:24.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.968+0000 7f6f20f77700 1 --2- 172.21.15.26:0/2358175167 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f1c133e30 0x7f6f1c09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:24.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.968+0000 7f6f20f77700 1 -- 172.21.15.26:0/2358175167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0c0094a0 con 0x7f6f1c133420 2023-10-01T07:54:24.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.968+0000 7f6f1bfff700 1 --2- 172.21.15.26:0/2358175167 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f1c133e30 0x7f6f1c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:24.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.968+0000 7f6f20f77700 1 --2- 172.21.15.26:0/2358175167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f1c133420 0x7f6f1c09c480 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009fd0 tx=0x7f6f0c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:24.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.968+0000 7f6f197fa700 1 -- 172.21.15.26:0/2358175167 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c0036a0 con 0x7f6f1c133420 2023-10-01T07:54:24.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.968+0000 7f6f197fa700 1 -- 172.21.15.26:0/2358175167 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0c01f070 con 0x7f6f1c133420 2023-10-01T07:54:24.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.968+0000 7f6f231db700 1 -- 172.21.15.26:0/2358175167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f1c09e020 con 0x7f6f1c133420 2023-10-01T07:54:24.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.968+0000 7f6f197fa700 1 -- 172.21.15.26:0/2358175167 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c003a60 con 0x7f6f1c133420 2023-10-01T07:54:24.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.968+0000 7f6f231db700 1 -- 172.21.15.26:0/2358175167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f1c120b20 con 0x7f6f1c133420 2023-10-01T07:54:24.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.969+0000 7f6f197fa700 1 -- 172.21.15.26:0/2358175167 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6f0c003bc0 con 0x7f6f1c133420 2023-10-01T07:54:24.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.969+0000 7f6f197fa700 1 -- 172.21.15.26:0/2358175167 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f6f0c021070 con 0x7f6f1c133420 2023-10-01T07:54:24.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.972+0000 7f6f2f37eb80 1 Processor -- start 2023-10-01T07:54:24.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.972+0000 7f6f2f37eb80 1 -- start start 2023-10-01T07:54:24.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.972+0000 7f6f2f37eb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ebfed1bc50 0x55ebfed1c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:24.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.972+0000 7f6f2f37eb80 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55ebfed38100 0x55ebfed1c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:24.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.972+0000 7f6f2f37eb80 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55ebfed328f0 0x55ebfed32d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:24.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.972+0000 7f6f2f37eb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebfec7ec60 con 0x55ebfed1bc50 2023-10-01T07:54:24.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.972+0000 7f6f2f37eb80 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ebfec79a10 con 0x55ebfed38100 2023-10-01T07:54:24.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.972+0000 7f6f2f37eb80 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x55ebfec77210 con 0x55ebfed328f0 2023-10-01T07:54:24.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.972+0000 7f6f20f77700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ebfed1bc50 0x55ebfed1c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:24.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.972+0000 7f6f1bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55ebfed38100 0x55ebfed1c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:24.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.972+0000 7f6f20f77700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ebfed1bc50 0x55ebfed1c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46996/0 (socket says 172.21.15.26:46996) 2023-10-01T07:54:24.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.972+0000 7f6f20f77700 1 -- 172.21.15.26:0/2143355641 learned_addr learned my addr 172.21.15.26:0/2143355641 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:24.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.972+0000 7f6f21778700 1 --2- 172.21.15.26:0/2143355641 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55ebfed328f0 0x55ebfed32d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:24.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.973+0000 7f6f1bfff700 1 -- 172.21.15.26:0/2143355641 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55ebfed328f0 msgr2=0x55ebfed32d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:24.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.973+0000 7f6f1bfff700 1 --2- 172.21.15.26:0/2143355641 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55ebfed328f0 0x55ebfed32d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:24.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.973+0000 7f6f1bfff700 1 -- 172.21.15.26:0/2143355641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ebfed1bc50 msgr2=0x55ebfed1c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:24.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.973+0000 7f6f1bfff700 1 --2- 172.21.15.26:0/2143355641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ebfed1bc50 0x55ebfed1c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:24.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.973+0000 7f6f1bfff700 1 -- 172.21.15.26:0/2143355641 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ebfea66790 con 0x55ebfed38100 2023-10-01T07:54:24.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.973+0000 7f6f20f77700 1 --2- 172.21.15.26:0/2143355641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ebfed1bc50 0x55ebfed1c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:24.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.973+0000 7f6f21778700 1 --2- 172.21.15.26:0/2143355641 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55ebfed328f0 0x55ebfed32d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:24.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.973+0000 7f6f1bfff700 1 --2- 172.21.15.26:0/2143355641 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55ebfed38100 0x55ebfed1c560 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6f04007fd0 tx=0x7f6f040116b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29a50d6d7f95982b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:24.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.973+0000 7f6f127fc700 1 -- 172.21.15.26:0/2143355641 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f04007170 con 0x55ebfed38100 2023-10-01T07:54:24.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.973+0000 7f6f127fc700 1 -- 172.21.15.26:0/2143355641 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f040072d0 con 0x55ebfed38100 2023-10-01T07:54:24.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.973+0000 7f6f127fc700 1 -- 172.21.15.26:0/2143355641 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f04007660 con 0x55ebfed38100 2023-10-01T07:54:24.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.974+0000 7f6f2f37eb80 1 -- 172.21.15.26:0/2143355641 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55ebfed38100 msgr2=0x55ebfed1c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:24.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.974+0000 7f6f2f37eb80 1 --2- 172.21.15.26:0/2143355641 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55ebfed38100 0x55ebfed1c560 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6f04007fd0 tx=0x7f6f040116b0 comp rx=0 tx=0).stop 2023-10-01T07:54:24.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.974+0000 7f6f2f37eb80 1 -- 172.21.15.26:0/2143355641 shutdown_connections 2023-10-01T07:54:24.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.974+0000 7f6f2f37eb80 1 --2- 172.21.15.26:0/2143355641 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55ebfed328f0 0x55ebfed32d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:24.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.974+0000 7f6f2f37eb80 1 --2- 172.21.15.26:0/2143355641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ebfed1bc50 0x55ebfed1c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:24.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.974+0000 7f6f2f37eb80 1 --2- 172.21.15.26:0/2143355641 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55ebfed38100 0x55ebfed1c560 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:24.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.974+0000 7f6f2f37eb80 1 -- 172.21.15.26:0/2143355641 >> 172.21.15.26:0/2143355641 conn(0x55ebfed200f0 msgr2=0x55ebfed1f690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:24.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.974+0000 7f6f2f37eb80 1 -- 172.21.15.26:0/2143355641 shutdown_connections 2023-10-01T07:54:24.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.974+0000 7f6f2f37eb80 1 -- 172.21.15.26:0/2143355641 wait complete. 2023-10-01T07:54:24.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.974+0000 7f6f2f37eb80 1 -- start start 2023-10-01T07:54:24.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.974+0000 7f6f2f37eb80 1 Processor -- start 2023-10-01T07:54:24.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.975+0000 7f6f2f37eb80 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55ebfed1bc50 0x55ebfed34fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:24.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.975+0000 7f6f2f37eb80 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55ebfed328f0 0x55ebfed354e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:24.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.975+0000 7f6f2f37eb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ebfed38100 0x55ebfed35a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:24.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.975+0000 7f6f2f37eb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebfec72b00 con 0x55ebfed38100 2023-10-01T07:54:24.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.975+0000 7f6f2f37eb80 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ebfec0e770 con 0x55ebfed328f0 2023-10-01T07:54:24.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.975+0000 7f6f2f37eb80 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x55ebfec316f0 con 0x55ebfed1bc50 2023-10-01T07:54:24.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.975+0000 7f6f2f37eb80 10 client.0 _ll_register_callbacks cb 0x55ebfea7a5a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-01T07:54:24.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.975+0000 7f6f20f77700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55ebfed1bc50 0x55ebfed34fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:24.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.975+0000 7f6f20f77700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55ebfed1bc50 0x55ebfed34fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:40784/0 (socket says 172.21.15.26:40784) 2023-10-01T07:54:24.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.975+0000 7f6f20f77700 1 -- 172.21.15.26:0/3008334812 learned_addr learned my addr 172.21.15.26:0/3008334812 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:24.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.975+0000 7f6f1bfff700 1 --2- 172.21.15.26:0/3008334812 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55ebfed328f0 0x55ebfed354e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:24.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.975+0000 7f6f21778700 1 --2- 172.21.15.26:0/3008334812 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ebfed38100 0x55ebfed35a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:24.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.975+0000 7f6f20f77700 1 -- 172.21.15.26:0/3008334812 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55ebfed328f0 msgr2=0x55ebfed354e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:24.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.975+0000 7f6f20f77700 1 --2- 172.21.15.26:0/3008334812 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55ebfed328f0 0x55ebfed354e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:24.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.975+0000 7f6f20f77700 1 -- 172.21.15.26:0/3008334812 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ebfed38100 msgr2=0x55ebfed35a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:24.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.975+0000 7f6f20f77700 1 --2- 172.21.15.26:0/3008334812 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ebfed38100 0x55ebfed35a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:24.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.976+0000 7f6f20f77700 1 -- 172.21.15.26:0/3008334812 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f14009e10 con 0x55ebfed1bc50 2023-10-01T07:54:24.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.976+0000 7f6f1bfff700 1 --2- 172.21.15.26:0/3008334812 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55ebfed328f0 0x55ebfed354e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:24.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.976+0000 7f6f20f77700 1 --2- 172.21.15.26:0/3008334812 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55ebfed1bc50 0x55ebfed34fa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c03fe00 tx=0x7f6f0c011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7392161b29b9576 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:24.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.976+0000 7f6efb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.26:3302/0 2023-10-01T07:54:24.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.976+0000 7f6efb7fe700 1 -- 172.21.15.26:0/3008334812 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c024d50 con 0x55ebfed1bc50 2023-10-01T07:54:24.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.976+0000 7f6efb7fe700 1 -- 172.21.15.26:0/3008334812 <== mon.2 v2:172.21.15.26:3302/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f6f0c01bc80 con 0x55ebfed1bc50 2023-10-01T07:54:24.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.976+0000 7f6f2f37eb80 1 -- 172.21.15.26:0/3008334812 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ebfed142b0 con 0x55ebfed1bc50 2023-10-01T07:54:24.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.976+0000 7f6efb7fe700 1 -- 172.21.15.26:0/3008334812 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f0c024b70 con 0x55ebfed1bc50 2023-10-01T07:54:24.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.976+0000 7f6f2f37eb80 10 client.14390 fetch_fsmap learned FSMap version 8 2023-10-01T07:54:24.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.976+0000 7f6f2f37eb80 1 -- 172.21.15.26:0/3008334812 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,fsmap=8,monmap=3+}) v3 -- 0x7f6f04001cc0 con 0x55ebfed1bc50 2023-10-01T07:54:24.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.976+0000 7f6efb7fe700 1 -- 172.21.15.26:0/3008334812 <== mon.2 v2:172.21.15.26:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0c045070 con 0x55ebfed1bc50 2023-10-01T07:54:24.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.976+0000 7f6efb7fe700 1 -- 172.21.15.26:0/3008334812 <== mon.2 v2:172.21.15.26:3302/0 5 ==== fsmap(e 8) v1 ==== 1436+0+0 (secure 0 0 0) 0x7f6f0c02f9a0 con 0x55ebfed1bc50 2023-10-01T07:54:24.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.976+0000 7f6f2f37eb80 10 client.14390 fetch_fsmap finished waiting for FSMap version 8 2023-10-01T07:54:24.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.976+0000 7f6f2f37eb80 10 client.14390 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-01T07:54:24.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.976+0000 7f6f2f37eb80 20 client.14390 populate_metadata read hostname 'smithi026' 2023-10-01T07:54:24.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.976+0000 7f6f2f37eb80 4 client.14390 mds_command: new command op to 4189 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-01T07:54:24.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.976+0000 7f6f2f37eb80 1 -- 172.21.15.26:0/3008334812 --> v1:172.21.15.26:6817/2857714939 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ebfecf0f40 con 0x55ebfed550e0 2023-10-01T07:54:24.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.977+0000 7f6efb7fe700 10 client.14390 ms_handle_connect on v1:172.21.15.26:6817/2857714939 2023-10-01T07:54:24.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.977+0000 7f6efb7fe700 1 -- 172.21.15.26:0/3008334812 <== mds.0 v1:172.21.15.26:6817/2857714939 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (unknown 0 0 3608088055) 0x55ebfecf0f40 con 0x55ebfed550e0 2023-10-01T07:54:24.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.977+0000 7f6efb7fe700 10 client.14390 handle_command_reply: tid=0 2023-10-01T07:54:24.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.977+0000 7f6f2f37eb80 1 client.14390 shutdown 2023-10-01T07:54:24.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.978+0000 7f6f2f37eb80 1 -- 172.21.15.26:0/3008334812 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55ebfed1bc50 msgr2=0x55ebfed34fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:24.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.978+0000 7f6f2f37eb80 1 --2- 172.21.15.26:0/3008334812 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55ebfed1bc50 0x55ebfed34fa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c03fe00 tx=0x7f6f0c011000 comp rx=0 tx=0).stop 2023-10-01T07:54:24.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.978+0000 7f6f2f37eb80 1 -- 172.21.15.26:0/3008334812 shutdown_connections 2023-10-01T07:54:24.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.978+0000 7f6f2f37eb80 1 --2- 172.21.15.26:0/3008334812 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ebfed38100 0x55ebfed35a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:24.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.978+0000 7f6efb7fe700 0 client.14390 ms_handle_reset on v1:172.21.15.26:6817/2857714939 2023-10-01T07:54:24.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.978+0000 7f6f2f37eb80 1 --2- 172.21.15.26:0/3008334812 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55ebfed1bc50 0x55ebfed34fa0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:24.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.978+0000 7f6f2f37eb80 1 --2- 172.21.15.26:0/3008334812 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55ebfed328f0 0x55ebfed354e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:24.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.978+0000 7f6f2f37eb80 1 -- 172.21.15.26:0/3008334812 >> 172.21.15.26:0/3008334812 conn(0x55ebfed200f0 msgr2=0x55ebfed1b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:24.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.978+0000 7f6f2f37eb80 1 -- 172.21.15.26:0/3008334812 shutdown_connections 2023-10-01T07:54:24.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.978+0000 7f6f2f37eb80 1 -- 172.21.15.26:0/3008334812 wait complete. 2023-10-01T07:54:24.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.978+0000 7f6f2f37eb80 20 client.14390 trim_cache size 0 max 16384 2023-10-01T07:54:24.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.997+0000 7f6f2f37eb80 1 Processor -- start 2023-10-01T07:54:24.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.997+0000 7f6f2f37eb80 1 -- start start 2023-10-01T07:54:24.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.997+0000 7f6f2f37eb80 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55ebfed1bc50 0x55ebfed3f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:24.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.997+0000 7f6f2f37eb80 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55ebfed328f0 0x55ebfed51860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:24.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.997+0000 7f6f2f37eb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ebfed38100 0x55ebfed51da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:24.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.997+0000 7f6f2f37eb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebfed3cec0 con 0x55ebfed38100 2023-10-01T07:54:24.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.997+0000 7f6f2f37eb80 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ebfea67390 con 0x55ebfed328f0 2023-10-01T07:54:24.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.997+0000 7f6f2f37eb80 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x55ebfed3c2b0 con 0x55ebfed1bc50 2023-10-01T07:54:24.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.997+0000 7f6f1bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55ebfed328f0 0x55ebfed51860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:24.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.997+0000 7f6f21778700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ebfed38100 0x55ebfed51da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:24.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.997+0000 7f6f1bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55ebfed328f0 0x55ebfed51860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55190/0 (socket says 172.21.15.26:55190) 2023-10-01T07:54:24.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.997+0000 7f6f1bfff700 1 -- 172.21.15.26:0/672850013 learned_addr learned my addr 172.21.15.26:0/672850013 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:24.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.997+0000 7f6f20f77700 1 --2- 172.21.15.26:0/672850013 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55ebfed1bc50 0x55ebfed3f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:24.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.997+0000 7f6f21778700 1 -- 172.21.15.26:0/672850013 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55ebfed1bc50 msgr2=0x55ebfed3f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:24.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.997+0000 7f6f21778700 1 --2- 172.21.15.26:0/672850013 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55ebfed1bc50 0x55ebfed3f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:25.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.998+0000 7f6f21778700 1 -- 172.21.15.26:0/672850013 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55ebfed328f0 msgr2=0x55ebfed51860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:25.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.998+0000 7f6f21778700 1 --2- 172.21.15.26:0/672850013 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55ebfed328f0 0x55ebfed51860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:25.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.998+0000 7f6f21778700 1 -- 172.21.15.26:0/672850013 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ebfeb530a0 con 0x55ebfed38100 2023-10-01T07:54:25.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.998+0000 7f6f1bfff700 1 --2- 172.21.15.26:0/672850013 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55ebfed328f0 0x55ebfed51860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:25.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.998+0000 7f6f21778700 1 --2- 172.21.15.26:0/672850013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ebfed38100 0x55ebfed51da0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c12f180 tx=0x7f6f14009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e86eb20ed520a43e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:25.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.998+0000 7f6f12ffd700 1 -- 172.21.15.26:0/672850013 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1400e040 con 0x55ebfed38100 2023-10-01T07:54:25.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.998+0000 7f6f12ffd700 1 -- 172.21.15.26:0/672850013 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1400f040 con 0x55ebfed38100 2023-10-01T07:54:25.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.998+0000 7f6f12ffd700 1 -- 172.21.15.26:0/672850013 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f14011910 con 0x55ebfed38100 2023-10-01T07:54:25.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.999+0000 7f6f2f37eb80 1 -- 172.21.15.26:0/672850013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ebfed38100 msgr2=0x55ebfed51da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:25.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.999+0000 7f6f2f37eb80 1 --2- 172.21.15.26:0/672850013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ebfed38100 0x55ebfed51da0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c12f180 tx=0x7f6f14009750 comp rx=0 tx=0).stop 2023-10-01T07:54:25.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.999+0000 7f6f2f37eb80 1 -- 172.21.15.26:0/672850013 shutdown_connections 2023-10-01T07:54:25.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.999+0000 7f6f2f37eb80 1 --2- 172.21.15.26:0/672850013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ebfed38100 0x55ebfed51da0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:25.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.999+0000 7f6f2f37eb80 1 --2- 172.21.15.26:0/672850013 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55ebfed1bc50 0x55ebfed3f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:25.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.999+0000 7f6f2f37eb80 1 --2- 172.21.15.26:0/672850013 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55ebfed328f0 0x55ebfed51860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:25.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.999+0000 7f6f2f37eb80 1 -- 172.21.15.26:0/672850013 >> 172.21.15.26:0/672850013 conn(0x55ebfed200f0 msgr2=0x55ebfed18210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:25.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.999+0000 7f6f2f37eb80 1 -- 172.21.15.26:0/672850013 shutdown_connections 2023-10-01T07:54:25.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.999+0000 7f6f2f37eb80 1 -- 172.21.15.26:0/672850013 wait complete. 2023-10-01T07:54:25.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:24.999+0000 7f6f2f37eb80 1 -- start start 2023-10-01T07:54:25.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.000+0000 7f6f2f37eb80 1 Processor -- start 2023-10-01T07:54:25.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.000+0000 7f6f2f37eb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ebfed1bc50 0x55ebfed34000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:25.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.000+0000 7f6f2f37eb80 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55ebfed328f0 0x55ebfed34540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:25.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.000+0000 7f6f2f37eb80 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55ebfed38100 0x55ebfeda0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:25.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.000+0000 7f6f2f37eb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebfed384d0 con 0x55ebfed1bc50 2023-10-01T07:54:25.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.000+0000 7f6f2f37eb80 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ebfed3c7a0 con 0x55ebfed328f0 2023-10-01T07:54:25.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.000+0000 7f6f2f37eb80 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x55ebfed3afd0 con 0x55ebfed38100 2023-10-01T07:54:25.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.000+0000 7f6f2f37eb80 10 client.0 _ll_register_callbacks cb 0x7f6f1c1c9010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-01T07:54:25.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.001+0000 7f6f20f77700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ebfed1bc50 0x55ebfed34000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:25.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.001+0000 7f6f21778700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55ebfed38100 0x55ebfeda0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:25.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.001+0000 7f6f20f77700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ebfed1bc50 0x55ebfed34000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47022/0 (socket says 172.21.15.26:47022) 2023-10-01T07:54:25.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.001+0000 7f6f20f77700 1 -- 172.21.15.26:0/1229563333 learned_addr learned my addr 172.21.15.26:0/1229563333 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:25.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.001+0000 7f6f20f77700 1 -- 172.21.15.26:0/1229563333 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55ebfed38100 msgr2=0x55ebfeda0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:25.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.001+0000 7f6f20f77700 1 --2- 172.21.15.26:0/1229563333 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55ebfed38100 0x55ebfeda0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:25.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.001+0000 7f6f20f77700 1 -- 172.21.15.26:0/1229563333 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55ebfed328f0 msgr2=0x55ebfed34540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:25.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.001+0000 7f6f20f77700 1 --2- 172.21.15.26:0/1229563333 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55ebfed328f0 0x55ebfed34540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:25.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.001+0000 7f6f20f77700 1 -- 172.21.15.26:0/1229563333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ebfea66790 con 0x55ebfed1bc50 2023-10-01T07:54:25.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.001+0000 7f6f21778700 1 --2- 172.21.15.26:0/1229563333 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55ebfed38100 0x55ebfeda0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:25.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.001+0000 7f6f20f77700 1 --2- 172.21.15.26:0/1229563333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ebfed1bc50 0x55ebfed34000 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c010540 tx=0x7f6f0c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e55df438e1253f3d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:25.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.001+0000 7f6efb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-10-01T07:54:25.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.001+0000 7f6efb7fe700 1 -- 172.21.15.26:0/1229563333 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c057070 con 0x55ebfed1bc50 2023-10-01T07:54:25.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.001+0000 7f6efb7fe700 1 -- 172.21.15.26:0/1229563333 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f6f0c0410b0 con 0x55ebfed1bc50 2023-10-01T07:54:25.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.001+0000 7f6f2f37eb80 1 -- 172.21.15.26:0/1229563333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6f040072d0 con 0x55ebfed1bc50 2023-10-01T07:54:25.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.001+0000 7f6efb7fe700 1 -- 172.21.15.26:0/1229563333 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f0c01a950 con 0x55ebfed1bc50 2023-10-01T07:54:25.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.001+0000 7f6f2f37eb80 10 client.14493 fetch_fsmap learned FSMap version 8 2023-10-01T07:54:25.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.001+0000 7f6f2f37eb80 1 -- 172.21.15.26:0/1229563333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=3+}) v3 -- 0x7f6f14017430 con 0x55ebfed1bc50 2023-10-01T07:54:25.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.002+0000 7f6efb7fe700 1 -- 172.21.15.26:0/1229563333 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f040072d0 con 0x55ebfed1bc50 2023-10-01T07:54:25.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.002+0000 7f6efb7fe700 1 -- 172.21.15.26:0/1229563333 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) v1 ==== 1436+0+0 (secure 0 0 0) 0x7f6f0c05a020 con 0x55ebfed1bc50 2023-10-01T07:54:25.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.002+0000 7f6f2f37eb80 10 client.14493 fetch_fsmap finished waiting for FSMap version 8 2023-10-01T07:54:25.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.002+0000 7f6f2f37eb80 10 client.14493 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-01T07:54:25.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.002+0000 7f6f2f37eb80 20 client.14493 populate_metadata read hostname 'smithi026' 2023-10-01T07:54:25.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.002+0000 7f6f2f37eb80 4 client.14493 mds_command: new command op to 4189 tid=0[{"prefix": "status"}] 2023-10-01T07:54:25.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.002+0000 7f6f2f37eb80 1 -- 172.21.15.26:0/1229563333 --> v1:172.21.15.26:6817/2857714939 -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ebfec6bce0 con 0x55ebfeda1690 2023-10-01T07:54:25.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.002+0000 7f6efb7fe700 10 client.14493 ms_handle_connect on v1:172.21.15.26:6817/2857714939 2023-10-01T07:54:25.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.002+0000 7f6efb7fe700 1 -- 172.21.15.26:0/1229563333 <== mds.0 v1:172.21.15.26:6817/2857714939 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (unknown 0 0 711178538) 0x55ebfec6bce0 con 0x55ebfeda1690 2023-10-01T07:54:25.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.002+0000 7f6efb7fe700 10 client.14493 handle_command_reply: tid=0 2023-10-01T07:54:25.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.002+0000 7f6f2f37eb80 1 client.14493 shutdown 2023-10-01T07:54:25.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.003+0000 7f6f2f37eb80 1 -- 172.21.15.26:0/1229563333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ebfed1bc50 msgr2=0x55ebfed34000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:25.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.003+0000 7f6f2f37eb80 1 --2- 172.21.15.26:0/1229563333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ebfed1bc50 0x55ebfed34000 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c010540 tx=0x7f6f0c020000 comp rx=0 tx=0).stop 2023-10-01T07:54:25.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.003+0000 7f6f2f37eb80 1 -- 172.21.15.26:0/1229563333 shutdown_connections 2023-10-01T07:54:25.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.003+0000 7f6f2f37eb80 1 --2- 172.21.15.26:0/1229563333 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x55ebfed38100 0x55ebfeda0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:25.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.003+0000 7f6f2f37eb80 1 --2- 172.21.15.26:0/1229563333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ebfed1bc50 0x55ebfed34000 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:25.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.003+0000 7f6f2f37eb80 1 --2- 172.21.15.26:0/1229563333 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55ebfed328f0 0x55ebfed34540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:25.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.003+0000 7f6efb7fe700 0 client.14493 ms_handle_reset on v1:172.21.15.26:6817/2857714939 2023-10-01T07:54:25.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.003+0000 7f6f2f37eb80 1 -- 172.21.15.26:0/1229563333 >> 172.21.15.26:0/1229563333 conn(0x55ebfed200f0 msgr2=0x55ebfed3f770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:25.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.003+0000 7f6f2f37eb80 1 -- 172.21.15.26:0/1229563333 shutdown_connections 2023-10-01T07:54:25.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.003+0000 7f6f2f37eb80 1 -- 172.21.15.26:0/1229563333 wait complete. 2023-10-01T07:54:25.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.003+0000 7f6f2f37eb80 20 client.14493 trim_cache size 0 max 16384 2023-10-01T07:54:25.009 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-01T07:54:25.010 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "c29fb19d-520c-42a6-90f4-e7f86de96e8e", 2023-10-01T07:54:25.010 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2023-10-01T07:54:25.010 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4189, 2023-10-01T07:54:25.010 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2023-10-01T07:54:25.010 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2023-10-01T07:54:25.010 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2023-10-01T07:54:25.010 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 147.70647993399999, 2023-10-01T07:54:25.010 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 8, 2023-10-01T07:54:25.010 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 23, 2023-10-01T07:54:25.010 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 18, 2023-10-01T07:54:25.010 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 153.01332269100001 2023-10-01T07:54:25.011 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-01T07:54:25.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.003+0000 7f6f231db700 1 -- 172.21.15.26:0/2358175167 >> v1:172.21.15.26:6816/126763 conn(0x7f6efc02f510 legacy=0x7f6efc0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:25.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.003+0000 7f6f231db700 1 -- 172.21.15.26:0/2358175167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f1c133420 msgr2=0x7f6f1c09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:25.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.003+0000 7f6f231db700 1 --2- 172.21.15.26:0/2358175167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f1c133420 0x7f6f1c09c480 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009fd0 tx=0x7f6f0c004750 comp rx=0 tx=0).stop 2023-10-01T07:54:25.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.004+0000 7f6f231db700 1 -- 172.21.15.26:0/2358175167 shutdown_connections 2023-10-01T07:54:25.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.004+0000 7f6f231db700 1 --2- 172.21.15.26:0/2358175167 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f1c134260 0x7f6f1c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:25.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.004+0000 7f6f231db700 1 --2- 172.21.15.26:0/2358175167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f1c133420 0x7f6f1c09c480 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:25.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.004+0000 7f6f231db700 1 --2- 172.21.15.26:0/2358175167 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f1c133e30 0x7f6f1c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:25.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.004+0000 7f6f231db700 1 -- 172.21.15.26:0/2358175167 >> 172.21.15.26:0/2358175167 conn(0x7f6f1c0a4210 msgr2=0x7f6f1c0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:25.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.004+0000 7f6f231db700 1 -- 172.21.15.26:0/2358175167 shutdown_connections 2023-10-01T07:54:25.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.004+0000 7f6f231db700 1 -- 172.21.15.26:0/2358175167 wait complete. 2023-10-01T07:54:25.017 INFO:teuthology.run_tasks:Running task ceph.restart... 2023-10-01T07:54:25.028 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-01T07:54:25.028 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T07:54:25.055 INFO:tasks.ceph.osd.0:Stopped 2023-10-01T07:54:25.055 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 0 2023-10-01T07:54:25.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.236+0000 7f83acddb700 1 Processor -- start 2023-10-01T07:54:25.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.236+0000 7f83acddb700 1 -- start start 2023-10-01T07:54:25.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.237+0000 7f83acddb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f83a806a770 0x7f83a806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:25.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.237+0000 7f83acddb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f83a806b080 0x7f83a8131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:25.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.237+0000 7f83acddb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f83a8131b40 0x7f83a8131fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:25.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.237+0000 7f83acddb700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83a809ece0 con 0x7f83a806b080 2023-10-01T07:54:25.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.237+0000 7f83acddb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a809e760 con 0x7f83a8131b40 2023-10-01T07:54:25.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.237+0000 7f83acddb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83a809e040 con 0x7f83a806a770 2023-10-01T07:54:25.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.237+0000 7f83a6d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f83a8131b40 0x7f83a8131fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:25.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.237+0000 7f83a5d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f83a806b080 0x7f83a8131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:25.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.237+0000 7f83a6d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f83a8131b40 0x7f83a8131fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55216/0 (socket says 172.21.15.26:55216) 2023-10-01T07:54:25.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.237+0000 7f83a5d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f83a806b080 0x7f83a8131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47036/0 (socket says 172.21.15.26:47036) 2023-10-01T07:54:25.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.237+0000 7f83a659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f83a806a770 0x7f83a806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:25.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.237+0000 7f83a6d9d700 1 -- 172.21.15.26:0/2546115414 learned_addr learned my addr 172.21.15.26:0/2546115414 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:25.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.237+0000 7f83a5d9b700 1 -- 172.21.15.26:0/2546115414 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f83a806a770 msgr2=0x7f83a806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:25.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.237+0000 7f83a5d9b700 1 --2- 172.21.15.26:0/2546115414 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f83a806a770 0x7f83a806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:25.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.237+0000 7f83a5d9b700 1 -- 172.21.15.26:0/2546115414 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f83a8131b40 msgr2=0x7f83a8131fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:25.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.237+0000 7f83a5d9b700 1 --2- 172.21.15.26:0/2546115414 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f83a8131b40 0x7f83a8131fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:25.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.237+0000 7f83a5d9b700 1 -- 172.21.15.26:0/2546115414 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a809f630 con 0x7f83a806b080 2023-10-01T07:54:25.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.237+0000 7f83a6d9d700 1 --2- 172.21.15.26:0/2546115414 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f83a8131b40 0x7f83a8131fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:25.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.237+0000 7f83a659c700 1 --2- 172.21.15.26:0/2546115414 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f83a806a770 0x7f83a806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:25.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.238+0000 7f83a5d9b700 1 --2- 172.21.15.26:0/2546115414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83a806b080 0x7f83a8131600 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8390009840 tx=0x7f8390009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c94ff7a31cd95d1a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:25.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.238+0000 7f83a559a700 1 -- 172.21.15.26:0/2546115414 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8390011830 con 0x7f83a806b080 2023-10-01T07:54:25.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.238+0000 7f83a559a700 1 -- 172.21.15.26:0/2546115414 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8390011990 con 0x7f83a806b080 2023-10-01T07:54:25.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.238+0000 7f83a559a700 1 -- 172.21.15.26:0/2546115414 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8390011d20 con 0x7f83a806b080 2023-10-01T07:54:25.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.238+0000 7f83acddb700 1 -- 172.21.15.26:0/2546115414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83a806b080 msgr2=0x7f83a8131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:25.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.238+0000 7f83acddb700 1 --2- 172.21.15.26:0/2546115414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83a806b080 0x7f83a8131600 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8390009840 tx=0x7f8390009b50 comp rx=0 tx=0).stop 2023-10-01T07:54:25.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.238+0000 7f83acddb700 1 -- 172.21.15.26:0/2546115414 shutdown_connections 2023-10-01T07:54:25.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.239+0000 7f83acddb700 1 --2- 172.21.15.26:0/2546115414 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f83a8131b40 0x7f83a8131fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:25.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.239+0000 7f83acddb700 1 --2- 172.21.15.26:0/2546115414 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f83a806a770 0x7f83a806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:25.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.239+0000 7f83acddb700 1 --2- 172.21.15.26:0/2546115414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83a806b080 0x7f83a8131600 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:25.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.239+0000 7f83acddb700 1 -- 172.21.15.26:0/2546115414 >> 172.21.15.26:0/2546115414 conn(0x7f83a8066f50 msgr2=0x7f83a809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:25.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.239+0000 7f83acddb700 1 -- 172.21.15.26:0/2546115414 shutdown_connections 2023-10-01T07:54:25.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.239+0000 7f83acddb700 1 -- 172.21.15.26:0/2546115414 wait complete. 2023-10-01T07:54:25.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.240+0000 7f83acddb700 1 Processor -- start 2023-10-01T07:54:25.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.240+0000 7f83acddb700 1 -- start start 2023-10-01T07:54:25.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.240+0000 7f83acddb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f83a806a770 0x7f83a81202a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:25.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.240+0000 7f83acddb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83a806b080 0x7f83a81207e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:25.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.240+0000 7f83acddb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f83a8131b40 0x7f83a8120d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:25.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.240+0000 7f83acddb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a8123530 con 0x7f83a806b080 2023-10-01T07:54:25.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.240+0000 7f83acddb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a8071e60 con 0x7f83a8131b40 2023-10-01T07:54:25.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.240+0000 7f83acddb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83a8121eb0 con 0x7f83a806a770 2023-10-01T07:54:25.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.240+0000 7f83a659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f83a806a770 0x7f83a81202a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:25.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.240+0000 7f83a5d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83a806b080 0x7f83a81207e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:25.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.240+0000 7f83a659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f83a806a770 0x7f83a81202a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:40836/0 (socket says 172.21.15.26:40836) 2023-10-01T07:54:25.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.240+0000 7f83a659c700 1 -- 172.21.15.26:0/835117557 learned_addr learned my addr 172.21.15.26:0/835117557 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:25.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.240+0000 7f83a6d9d700 1 --2- 172.21.15.26:0/835117557 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f83a8131b40 0x7f83a8120d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:25.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.241+0000 7f83a659c700 1 -- 172.21.15.26:0/835117557 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f83a8131b40 msgr2=0x7f83a8120d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:25.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.241+0000 7f83a659c700 1 --2- 172.21.15.26:0/835117557 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f83a8131b40 0x7f83a8120d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:25.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.241+0000 7f83a659c700 1 -- 172.21.15.26:0/835117557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83a806b080 msgr2=0x7f83a81207e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:25.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.241+0000 7f83a659c700 1 --2- 172.21.15.26:0/835117557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83a806b080 0x7f83a81207e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:25.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.241+0000 7f83a659c700 1 -- 172.21.15.26:0/835117557 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83980094a0 con 0x7f83a806a770 2023-10-01T07:54:25.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.241+0000 7f83a5d9b700 1 --2- 172.21.15.26:0/835117557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83a806b080 0x7f83a81207e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:25.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.241+0000 7f83a6d9d700 1 --2- 172.21.15.26:0/835117557 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f83a8131b40 0x7f83a8120d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:25.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.241+0000 7f83a659c700 1 --2- 172.21.15.26:0/835117557 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f83a806a770 0x7f83a81202a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f839800ebe0 tx=0x7f839800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:25.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.241+0000 7f839effd700 1 -- 172.21.15.26:0/835117557 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839800c850 con 0x7f83a806a770 2023-10-01T07:54:25.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.241+0000 7f839effd700 1 -- 172.21.15.26:0/835117557 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839800c9b0 con 0x7f83a806a770 2023-10-01T07:54:25.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.241+0000 7f83acddb700 1 -- 172.21.15.26:0/835117557 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a0009b30 con 0x7f83a806a770 2023-10-01T07:54:25.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.241+0000 7f839effd700 1 -- 172.21.15.26:0/835117557 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839800cd40 con 0x7f83a806a770 2023-10-01T07:54:25.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.241+0000 7f83acddb700 1 -- 172.21.15.26:0/835117557 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83900094a0 con 0x7f83a806a770 2023-10-01T07:54:25.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.242+0000 7f839effd700 1 -- 172.21.15.26:0/835117557 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8398013470 con 0x7f83a806a770 2023-10-01T07:54:25.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.242+0000 7f839effd700 1 -- 172.21.15.26:0/835117557 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f839803fc60 con 0x7f83a806a770 2023-10-01T07:54:25.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.242+0000 7f83acddb700 1 -- 172.21.15.26:0/835117557 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a8074ea0 con 0x7f83a806a770 2023-10-01T07:54:25.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.248+0000 7f839effd700 1 -- 172.21.15.26:0/835117557 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8398021020 con 0x7f83a806a770 2023-10-01T07:54:25.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.462+0000 7f83acddb700 1 -- 172.21.15.26:0/835117557 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd down", "ids": ["0"]} v 0) v1 -- 0x7f83a806e8e0 con 0x7f83a806a770 2023-10-01T07:54:25.463 INFO:tasks.ceph.mon.a.smithi026.stderr:2023-10-01T07:54:25.463+0000 7fc3148c9700 -1 mon.a@0(leader).osd e23 definitely_dead 0 2023-10-01T07:54:25.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:25.995+0000 7f839effd700 1 -- 172.21.15.26:0/835117557 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["0"]}]=0 marked down osd.0. v24) v1 ==== 89+0+0 (secure 0 0 0) 0x7f8398013720 con 0x7f83a806a770 2023-10-01T07:54:26.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.002+0000 7f83acddb700 1 -- 172.21.15.26:0/835117557 >> v1:172.21.15.26:6816/126763 conn(0x7f838802f510 legacy=0x7f83880319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:26.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.002+0000 7f83acddb700 1 -- 172.21.15.26:0/835117557 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f83a806a770 msgr2=0x7f83a81202a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:26.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.002+0000 7f83acddb700 1 --2- 172.21.15.26:0/835117557 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f83a806a770 0x7f83a81202a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f839800ebe0 tx=0x7f839800eef0 comp rx=0 tx=0).stop 2023-10-01T07:54:26.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.003+0000 7f83acddb700 1 -- 172.21.15.26:0/835117557 shutdown_connections 2023-10-01T07:54:26.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.003+0000 7f83acddb700 1 --2- 172.21.15.26:0/835117557 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f83a8131b40 0x7f83a8120d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:26.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.003+0000 7f83acddb700 1 --2- 172.21.15.26:0/835117557 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f83a806a770 0x7f83a81202a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:26.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.003+0000 7f83acddb700 1 --2- 172.21.15.26:0/835117557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83a806b080 0x7f83a81207e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:26.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.003+0000 7f83acddb700 1 -- 172.21.15.26:0/835117557 >> 172.21.15.26:0/835117557 conn(0x7f83a8066f50 msgr2=0x7f83a806fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:26.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.004+0000 7f83acddb700 1 -- 172.21.15.26:0/835117557 shutdown_connections 2023-10-01T07:54:26.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.005+0000 7f83acddb700 1 -- 172.21.15.26:0/835117557 wait complete. 2023-10-01T07:54:26.011 INFO:teuthology.orchestra.run.smithi026.stderr:marked down osd.0. 2023-10-01T07:54:26.022 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-01T07:54:26.023 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-01T07:54:26.025 INFO:tasks.ceph.osd.0:Started 2023-10-01T07:54:26.025 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-01T07:54:26.025 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T07:54:26.054 INFO:tasks.ceph.osd.1:Stopped 2023-10-01T07:54:26.054 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 1 2023-10-01T07:54:26.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.231+0000 7f34d81e8700 1 Processor -- start 2023-10-01T07:54:26.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.231+0000 7f34d81e8700 1 -- start start 2023-10-01T07:54:26.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.232+0000 7f34d81e8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34d009f410 0x7f34d0136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:26.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.232+0000 7f34d81e8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f34d0136fe0 0x7f34d01393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:26.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.232+0000 7f34d81e8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d0070940 con 0x7f34d009e930 2023-10-01T07:54:26.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.232+0000 7f34d81e8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d006fd60 con 0x7f34d0136fe0 2023-10-01T07:54:26.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.232+0000 7f34d81e8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34d006fa80 con 0x7f34d009f410 2023-10-01T07:54:26.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.232+0000 7f34d5f84700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f34d009e930 0x7f34d009ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42882/0 (socket says 172.21.15.26:42882) 2023-10-01T07:54:26.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.232+0000 7f34d5f84700 1 -- 172.21.15.26:0/3524750404 learned_addr learned my addr 172.21.15.26:0/3524750404 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:26.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.232+0000 7f34d6785700 1 --2- 172.21.15.26:0/3524750404 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f34d0136fe0 0x7f34d01393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:26.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.232+0000 7f34d5783700 1 --2- 172.21.15.26:0/3524750404 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34d009f410 0x7f34d0136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:26.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.232+0000 7f34d6785700 1 -- 172.21.15.26:0/3524750404 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34d009f410 msgr2=0x7f34d0136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:26.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.232+0000 7f34d6785700 1 --2- 172.21.15.26:0/3524750404 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34d009f410 0x7f34d0136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:26.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.232+0000 7f34d6785700 1 -- 172.21.15.26:0/3524750404 >> v1:172.21.15.26:6789/0 conn(0x7f34d009e930 legacy=0x7f34d009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:26.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.232+0000 7f34d4f82700 1 -- 172.21.15.26:0/3524750404 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2104517642 0 0) 0x7f34d0070940 con 0x7f34d009e930 2023-10-01T07:54:26.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.232+0000 7f34d6785700 1 -- 172.21.15.26:0/3524750404 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d009fb60 con 0x7f34d0136fe0 2023-10-01T07:54:26.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.232+0000 7f34d6785700 1 --2- 172.21.15.26:0/3524750404 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f34d0136fe0 0x7f34d01393c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f34cc009dc0 tx=0x7f34cc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9674512683288e80 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:26.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.232+0000 7f34d4f82700 1 -- 172.21.15.26:0/3524750404 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc00e070 con 0x7f34d0136fe0 2023-10-01T07:54:26.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.232+0000 7f34d4f82700 1 -- 172.21.15.26:0/3524750404 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34cc00bb20 con 0x7f34d0136fe0 2023-10-01T07:54:26.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.233+0000 7f34d4f82700 1 -- 172.21.15.26:0/3524750404 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc012430 con 0x7f34d0136fe0 2023-10-01T07:54:26.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.233+0000 7f34d81e8700 1 -- 172.21.15.26:0/3524750404 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f34d0136fe0 msgr2=0x7f34d01393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:26.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.233+0000 7f34d81e8700 1 --2- 172.21.15.26:0/3524750404 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f34d0136fe0 0x7f34d01393c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f34cc009dc0 tx=0x7f34cc00b330 comp rx=0 tx=0).stop 2023-10-01T07:54:26.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.233+0000 7f34d81e8700 1 -- 172.21.15.26:0/3524750404 shutdown_connections 2023-10-01T07:54:26.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.233+0000 7f34d81e8700 1 --2- 172.21.15.26:0/3524750404 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f34d0136fe0 0x7f34d01393c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:26.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.233+0000 7f34d81e8700 1 --2- 172.21.15.26:0/3524750404 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34d009f410 0x7f34d0136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:26.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.233+0000 7f34d81e8700 1 -- 172.21.15.26:0/3524750404 >> 172.21.15.26:0/3524750404 conn(0x7f34d00a4210 msgr2=0x7f34d00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:26.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.233+0000 7f34d81e8700 1 -- 172.21.15.26:0/3524750404 shutdown_connections 2023-10-01T07:54:26.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.233+0000 7f34d81e8700 1 -- 172.21.15.26:0/3524750404 wait complete. 2023-10-01T07:54:26.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.234+0000 7f34d81e8700 1 Processor -- start 2023-10-01T07:54:26.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.234+0000 7f34d81e8700 1 -- start start 2023-10-01T07:54:26.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.235+0000 7f34d81e8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34d009e930 0x7f34d006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:26.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.235+0000 7f34d81e8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f34d009f410 0x7f34d006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:26.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.235+0000 7f34d81e8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34d0136fe0 0x7f34d006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:26.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.235+0000 7f34d81e8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d0135080 con 0x7f34d009e930 2023-10-01T07:54:26.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.235+0000 7f34d81e8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d0124ed0 con 0x7f34d009f410 2023-10-01T07:54:26.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.235+0000 7f34d81e8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34d006d5d0 con 0x7f34d0136fe0 2023-10-01T07:54:26.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.235+0000 7f34d5f84700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34d009e930 0x7f34d006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:26.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.235+0000 7f34d6785700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34d0136fe0 0x7f34d006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:26.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.235+0000 7f34d6785700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34d0136fe0 0x7f34d006c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:40864/0 (socket says 172.21.15.26:40864) 2023-10-01T07:54:26.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.235+0000 7f34d6785700 1 -- 172.21.15.26:0/820889114 learned_addr learned my addr 172.21.15.26:0/820889114 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:26.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.235+0000 7f34d5783700 1 --2- 172.21.15.26:0/820889114 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f34d009f410 0x7f34d006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:26.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.235+0000 7f34d5f84700 1 -- 172.21.15.26:0/820889114 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34d0136fe0 msgr2=0x7f34d006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:26.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.235+0000 7f34d5f84700 1 --2- 172.21.15.26:0/820889114 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34d0136fe0 0x7f34d006c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:26.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.235+0000 7f34d5f84700 1 -- 172.21.15.26:0/820889114 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f34d009f410 msgr2=0x7f34d006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:26.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.235+0000 7f34d5f84700 1 --2- 172.21.15.26:0/820889114 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f34d009f410 0x7f34d006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:26.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.235+0000 7f34d5f84700 1 -- 172.21.15.26:0/820889114 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34cc009a70 con 0x7f34d009e930 2023-10-01T07:54:26.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.235+0000 7f34d6785700 1 --2- 172.21.15.26:0/820889114 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34d0136fe0 0x7f34d006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:26.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.235+0000 7f34d5f84700 1 --2- 172.21.15.26:0/820889114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34d009e930 0x7f34d006b8b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f34c800c4a0 tx=0x7f34c800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:26.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.235+0000 7f34c67fc700 1 -- 172.21.15.26:0/820889114 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c8004c80 con 0x7f34d009e930 2023-10-01T07:54:26.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.236+0000 7f34c67fc700 1 -- 172.21.15.26:0/820889114 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c8004de0 con 0x7f34d009e930 2023-10-01T07:54:26.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.236+0000 7f34c67fc700 1 -- 172.21.15.26:0/820889114 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c8007310 con 0x7f34d009e930 2023-10-01T07:54:26.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.236+0000 7f34d81e8700 1 -- 172.21.15.26:0/820889114 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d00a3350 con 0x7f34d009e930 2023-10-01T07:54:26.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.236+0000 7f34d81e8700 1 -- 172.21.15.26:0/820889114 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d0125940 con 0x7f34d009e930 2023-10-01T07:54:26.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.237+0000 7f34c67fc700 1 -- 172.21.15.26:0/820889114 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f34c8007470 con 0x7f34d009e930 2023-10-01T07:54:26.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.237+0000 7f34c67fc700 1 -- 172.21.15.26:0/820889114 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f34c803f720 con 0x7f34d009e930 2023-10-01T07:54:26.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.237+0000 7f34d81e8700 1 -- 172.21.15.26:0/820889114 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d0071d80 con 0x7f34d009e930 2023-10-01T07:54:26.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.242+0000 7f34c67fc700 1 -- 172.21.15.26:0/820889114 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f34c8007720 con 0x7f34d009e930 2023-10-01T07:54:26.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:26.460+0000 7f34d81e8700 1 -- 172.21.15.26:0/820889114 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd down", "ids": ["1"]} v 0) v1 -- 0x7f34d0074ea0 con 0x7f34d009e930 2023-10-01T07:54:26.460 INFO:tasks.ceph.mon.a.smithi026.stderr:2023-10-01T07:54:26.460+0000 7fc3148c9700 -1 mon.a@0(leader).osd e24 definitely_dead 0 2023-10-01T07:54:26.633 INFO:tasks.ceph.osd.0.smithi026.stderr:2023-10-01T07:54:26.633+0000 7f4628b71680 -1 Falling back to public interface 2023-10-01T07:54:27.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.005+0000 7f34c67fc700 1 -- 172.21.15.26:0/820889114 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["1"]}]=0 marked down osd.1. v25) v1 ==== 89+0+0 (secure 0 0 0) 0x7f34c8011360 con 0x7f34d009e930 2023-10-01T07:54:27.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.009+0000 7f34d81e8700 1 -- 172.21.15.26:0/820889114 >> v1:172.21.15.26:6816/126763 conn(0x7f34b402f510 legacy=0x7f34b40319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:27.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.009+0000 7f34d81e8700 1 -- 172.21.15.26:0/820889114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34d009e930 msgr2=0x7f34d006b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:27.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.009+0000 7f34d81e8700 1 --2- 172.21.15.26:0/820889114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34d009e930 0x7f34d006b8b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f34c800c4a0 tx=0x7f34c800c7b0 comp rx=0 tx=0).stop 2023-10-01T07:54:27.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.009+0000 7f34d81e8700 1 -- 172.21.15.26:0/820889114 shutdown_connections 2023-10-01T07:54:27.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.009+0000 7f34d81e8700 1 --2- 172.21.15.26:0/820889114 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34d0136fe0 0x7f34d006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:27.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.009+0000 7f34d81e8700 1 --2- 172.21.15.26:0/820889114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34d009e930 0x7f34d006b8b0 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f34c800c4a0 tx=0x7f34c800c7b0 comp rx=0 tx=0).stop 2023-10-01T07:54:27.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.009+0000 7f34d81e8700 1 --2- 172.21.15.26:0/820889114 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f34d009f410 0x7f34d006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:27.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.009+0000 7f34d81e8700 1 -- 172.21.15.26:0/820889114 >> 172.21.15.26:0/820889114 conn(0x7f34d00a4210 msgr2=0x7f34d00a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:27.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.010+0000 7f34d81e8700 1 -- 172.21.15.26:0/820889114 shutdown_connections 2023-10-01T07:54:27.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.012+0000 7f34d81e8700 1 -- 172.21.15.26:0/820889114 wait complete. 2023-10-01T07:54:27.016 INFO:teuthology.orchestra.run.smithi026.stderr:marked down osd.1. 2023-10-01T07:54:27.033 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-01T07:54:27.033 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-01T07:54:27.035 INFO:tasks.ceph.osd.1:Started 2023-10-01T07:54:27.036 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-01T07:54:27.036 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T07:54:27.075 INFO:tasks.ceph.osd.2:Stopped 2023-10-01T07:54:27.075 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 2 2023-10-01T07:54:27.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.252+0000 7f730a813700 1 Processor -- start 2023-10-01T07:54:27.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.252+0000 7f730a813700 1 -- start start 2023-10-01T07:54:27.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.253+0000 7f730a813700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f730409d6f0 0x7f730409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:27.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.253+0000 7f730a813700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f730409e410 0x7f7304134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:27.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.253+0000 7f730a813700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f730409b120 con 0x7f730409e000 2023-10-01T07:54:27.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.253+0000 7f730a813700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730406b460 con 0x7f730409e410 2023-10-01T07:54:27.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.253+0000 7f730a813700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f730409a7e0 con 0x7f730409d6f0 2023-10-01T07:54:27.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.253+0000 7f7303fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f730409d6f0 0x7f730409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:27.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.253+0000 7f7308db0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f730409e410 0x7f7304134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:27.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.253+0000 7f7303fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f730409d6f0 0x7f730409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:40880/0 (socket says 172.21.15.26:40880) 2023-10-01T07:54:27.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.253+0000 7f7308db0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f730409e410 0x7f7304134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55262/0 (socket says 172.21.15.26:55262) 2023-10-01T07:54:27.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.253+0000 7f7303fff700 1 -- 172.21.15.26:0/3910757507 learned_addr learned my addr 172.21.15.26:0/3910757507 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:27.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.253+0000 7f73037fe700 1 --1- 172.21.15.26:0/3910757507 >> v1:172.21.15.26:6789/0 conn(0x7f730409e000 0x7f73041339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42900/0 (socket says 172.21.15.26:42900) 2023-10-01T07:54:27.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.253+0000 7f7308db0700 1 -- 172.21.15.26:0/3910757507 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f730409d6f0 msgr2=0x7f730409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:27.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.253+0000 7f7308db0700 1 --2- 172.21.15.26:0/3910757507 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f730409d6f0 0x7f730409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:27.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.253+0000 7f7308db0700 1 -- 172.21.15.26:0/3910757507 >> v1:172.21.15.26:6789/0 conn(0x7f730409e000 legacy=0x7f73041339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:27.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.253+0000 7f7302ffd700 1 -- 172.21.15.26:0/3910757507 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4241435303 0 0) 0x7f730409b120 con 0x7f730409e000 2023-10-01T07:54:27.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.253+0000 7f7308db0700 1 -- 172.21.15.26:0/3910757507 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730409a500 con 0x7f730409e410 2023-10-01T07:54:27.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.253+0000 7f7303fff700 1 --2- 172.21.15.26:0/3910757507 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f730409d6f0 0x7f730409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:27.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.253+0000 7f7308db0700 1 --2- 172.21.15.26:0/3910757507 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f730409e410 0x7f7304134100 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f72fc009dc0 tx=0x7f72fc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e54320229edcaec6 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:27.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.253+0000 7f7302ffd700 1 -- 172.21.15.26:0/3910757507 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc00e070 con 0x7f730409e410 2023-10-01T07:54:27.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.254+0000 7f7302ffd700 1 -- 172.21.15.26:0/3910757507 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72fc00bb20 con 0x7f730409e410 2023-10-01T07:54:27.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.254+0000 7f7302ffd700 1 -- 172.21.15.26:0/3910757507 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc012430 con 0x7f730409e410 2023-10-01T07:54:27.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.254+0000 7f730a813700 1 -- 172.21.15.26:0/3910757507 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f730409e410 msgr2=0x7f7304134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:27.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.254+0000 7f730a813700 1 --2- 172.21.15.26:0/3910757507 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f730409e410 0x7f7304134100 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f72fc009dc0 tx=0x7f72fc00b330 comp rx=0 tx=0).stop 2023-10-01T07:54:27.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.254+0000 7f730a813700 1 -- 172.21.15.26:0/3910757507 shutdown_connections 2023-10-01T07:54:27.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.254+0000 7f730a813700 1 --2- 172.21.15.26:0/3910757507 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f730409d6f0 0x7f730409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:27.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.254+0000 7f730a813700 1 --2- 172.21.15.26:0/3910757507 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f730409e410 0x7f7304134100 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:27.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.254+0000 7f730a813700 1 -- 172.21.15.26:0/3910757507 >> 172.21.15.26:0/3910757507 conn(0x7f7304066f50 msgr2=0x7f730409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:27.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.254+0000 7f730a813700 1 -- 172.21.15.26:0/3910757507 shutdown_connections 2023-10-01T07:54:27.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.254+0000 7f730a813700 1 -- 172.21.15.26:0/3910757507 wait complete. 2023-10-01T07:54:27.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.255+0000 7f730a813700 1 Processor -- start 2023-10-01T07:54:27.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.255+0000 7f730a813700 1 -- start start 2023-10-01T07:54:27.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.256+0000 7f730a813700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f730409d6f0 0x7f73041223c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:27.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.256+0000 7f730a813700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f730409e000 0x7f7304122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:27.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.256+0000 7f730a813700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f730409e410 0x7f7304122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:27.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.256+0000 7f730a813700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7304123890 con 0x7f730409d6f0 2023-10-01T07:54:27.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.256+0000 7f730a813700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7304133700 con 0x7f730409e000 2023-10-01T07:54:27.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.256+0000 7f730a813700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7304124dd0 con 0x7f730409e410 2023-10-01T07:54:27.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.256+0000 7f7303fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f730409d6f0 0x7f73041223c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:27.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.256+0000 7f7303fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f730409d6f0 0x7f73041223c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47058/0 (socket says 172.21.15.26:47058) 2023-10-01T07:54:27.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.256+0000 7f7303fff700 1 -- 172.21.15.26:0/3143747220 learned_addr learned my addr 172.21.15.26:0/3143747220 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:27.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.256+0000 7f7308db0700 1 --2- 172.21.15.26:0/3143747220 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f730409e410 0x7f7304122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:27.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.256+0000 7f73037fe700 1 --2- 172.21.15.26:0/3143747220 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f730409e000 0x7f7304122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:27.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.256+0000 7f73037fe700 1 -- 172.21.15.26:0/3143747220 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f730409e410 msgr2=0x7f7304122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:27.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.256+0000 7f73037fe700 1 --2- 172.21.15.26:0/3143747220 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f730409e410 0x7f7304122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:27.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.256+0000 7f73037fe700 1 -- 172.21.15.26:0/3143747220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f730409d6f0 msgr2=0x7f73041223c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:27.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.256+0000 7f73037fe700 1 --2- 172.21.15.26:0/3143747220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f730409d6f0 0x7f73041223c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:27.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.256+0000 7f73037fe700 1 -- 172.21.15.26:0/3143747220 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f4009550 con 0x7f730409e000 2023-10-01T07:54:27.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.256+0000 7f7303fff700 1 --2- 172.21.15.26:0/3143747220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f730409d6f0 0x7f73041223c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:27.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.257+0000 7f73037fe700 1 --2- 172.21.15.26:0/3143747220 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f730409e000 0x7f7304122900 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f72f800c4a0 tx=0x7f72f800c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:27.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.257+0000 7f7300ff9700 1 -- 172.21.15.26:0/3143747220 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8004c80 con 0x7f730409e000 2023-10-01T07:54:27.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.257+0000 7f7300ff9700 1 -- 172.21.15.26:0/3143747220 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f8004de0 con 0x7f730409e000 2023-10-01T07:54:27.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.257+0000 7f730a813700 1 -- 172.21.15.26:0/3143747220 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72fc009a70 con 0x7f730409e000 2023-10-01T07:54:27.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.257+0000 7f7300ff9700 1 -- 172.21.15.26:0/3143747220 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8007310 con 0x7f730409e000 2023-10-01T07:54:27.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.257+0000 7f730a813700 1 -- 172.21.15.26:0/3143747220 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73041255e0 con 0x7f730409e000 2023-10-01T07:54:27.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.258+0000 7f7300ff9700 1 -- 172.21.15.26:0/3143747220 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f72f8007470 con 0x7f730409e000 2023-10-01T07:54:27.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.258+0000 7f7300ff9700 1 -- 172.21.15.26:0/3143747220 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f72f803f6e0 con 0x7f730409e000 2023-10-01T07:54:27.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.258+0000 7f730a813700 1 -- 172.21.15.26:0/3143747220 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7304125810 con 0x7f730409e000 2023-10-01T07:54:27.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.263+0000 7f7300ff9700 1 -- 172.21.15.26:0/3143747220 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f72f8007720 con 0x7f730409e000 2023-10-01T07:54:27.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:27.483+0000 7f730a813700 1 -- 172.21.15.26:0/3143747220 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd down", "ids": ["2"]} v 0) v1 -- 0x7f73040720a0 con 0x7f730409e000 2023-10-01T07:54:27.484 INFO:tasks.ceph.mon.a.smithi026.stderr:2023-10-01T07:54:27.484+0000 7fc3148c9700 -1 mon.a@0(leader).osd e25 definitely_dead 0 2023-10-01T07:54:27.640 INFO:tasks.ceph.osd.1.smithi026.stderr:2023-10-01T07:54:27.640+0000 7fa62e996680 -1 Falling back to public interface 2023-10-01T07:54:28.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.006+0000 7f7300ff9700 1 -- 172.21.15.26:0/3143747220 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["2"]}]=0 marked down osd.2. v26) v1 ==== 89+0+0 (secure 0 0 0) 0x7f72f801b340 con 0x7f730409e000 2023-10-01T07:54:28.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.009+0000 7f730a813700 1 -- 172.21.15.26:0/3143747220 >> v1:172.21.15.26:6816/126763 conn(0x7f72f002f510 legacy=0x7f72f00319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:28.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.009+0000 7f730a813700 1 -- 172.21.15.26:0/3143747220 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f730409e000 msgr2=0x7f7304122900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:28.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.009+0000 7f730a813700 1 --2- 172.21.15.26:0/3143747220 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f730409e000 0x7f7304122900 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f72f800c4a0 tx=0x7f72f800c7b0 comp rx=0 tx=0).stop 2023-10-01T07:54:28.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.010+0000 7f730a813700 1 -- 172.21.15.26:0/3143747220 shutdown_connections 2023-10-01T07:54:28.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.010+0000 7f730a813700 1 --2- 172.21.15.26:0/3143747220 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f730409e410 0x7f7304122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:28.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.010+0000 7f730a813700 1 --2- 172.21.15.26:0/3143747220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f730409d6f0 0x7f73041223c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:28.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.010+0000 7f730a813700 1 --2- 172.21.15.26:0/3143747220 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f730409e000 0x7f7304122900 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:28.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.010+0000 7f730a813700 1 -- 172.21.15.26:0/3143747220 >> 172.21.15.26:0/3143747220 conn(0x7f7304066f50 msgr2=0x7f7304070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:28.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.010+0000 7f730a813700 1 -- 172.21.15.26:0/3143747220 shutdown_connections 2023-10-01T07:54:28.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.010+0000 7f730a813700 1 -- 172.21.15.26:0/3143747220 wait complete. 2023-10-01T07:54:28.011 INFO:teuthology.orchestra.run.smithi026.stderr:marked down osd.2. 2023-10-01T07:54:28.030 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-01T07:54:28.030 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-01T07:54:28.032 INFO:tasks.ceph.osd.2:Started 2023-10-01T07:54:28.032 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-01T07:54:28.032 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T07:54:28.071 INFO:tasks.ceph.osd.3:Stopped 2023-10-01T07:54:28.071 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 3 2023-10-01T07:54:28.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.248+0000 7f607fede700 1 Processor -- start 2023-10-01T07:54:28.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.248+0000 7f607fede700 1 -- start start 2023-10-01T07:54:28.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.249+0000 7f607fede700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f607809e1d0 0x7f6078135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:28.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.249+0000 7f607fede700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6078135e50 0x7f6078138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:28.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.249+0000 7f607fede700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f607809f130 con 0x7f607809d6f0 2023-10-01T07:54:28.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.249+0000 7f607fede700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f607809f520 con 0x7f607809e1d0 2023-10-01T07:54:28.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.249+0000 7f607fede700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f607809e930 con 0x7f6078135e50 2023-10-01T07:54:28.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.249+0000 7f607d479700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f607809e1d0 0x7f6078135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:28.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.249+0000 7f607e47b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6078135e50 0x7f6078138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:28.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.249+0000 7f607dc7a700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f607809d6f0 0x7f607809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42914/0 (socket says 172.21.15.26:42914) 2023-10-01T07:54:28.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.249+0000 7f607dc7a700 1 -- 172.21.15.26:0/1869452001 learned_addr learned my addr 172.21.15.26:0/1869452001 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:28.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.249+0000 7f607e47b700 1 -- 172.21.15.26:0/1869452001 >> v2:172.21.15.26:3300/0 conn(0x7f607809e1d0 msgr2=0x7f6078135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:28.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.249+0000 7f607e47b700 1 --2- 172.21.15.26:0/1869452001 >> v2:172.21.15.26:3300/0 conn(0x7f607809e1d0 0x7f6078135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:28.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.249+0000 7f607e47b700 1 -- 172.21.15.26:0/1869452001 >> v1:172.21.15.26:6789/0 conn(0x7f607809d6f0 legacy=0x7f607809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:28.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.249+0000 7f607e47b700 1 -- 172.21.15.26:0/1869452001 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607809b2d0 con 0x7f6078135e50 2023-10-01T07:54:28.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.249+0000 7f607d479700 1 --2- 172.21.15.26:0/1869452001 >> v2:172.21.15.26:3300/0 conn(0x7f607809e1d0 0x7f6078135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:28.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.249+0000 7f607e47b700 1 --2- 172.21.15.26:0/1869452001 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6078135e50 0x7f6078138230 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6070009d90 tx=0x7f607000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=631ca399ce0084c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:28.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.249+0000 7f607cc78700 1 -- 172.21.15.26:0/1869452001 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607000e070 con 0x7f6078135e50 2023-10-01T07:54:28.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.250+0000 7f607cc78700 1 -- 172.21.15.26:0/1869452001 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607000bb20 con 0x7f6078135e50 2023-10-01T07:54:28.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.250+0000 7f607cc78700 1 -- 172.21.15.26:0/1869452001 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6070012430 con 0x7f6078135e50 2023-10-01T07:54:28.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.250+0000 7f607fede700 1 -- 172.21.15.26:0/1869452001 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6078135e50 msgr2=0x7f6078138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:28.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.250+0000 7f607fede700 1 --2- 172.21.15.26:0/1869452001 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6078135e50 0x7f6078138230 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6070009d90 tx=0x7f607000b330 comp rx=0 tx=0).stop 2023-10-01T07:54:28.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.250+0000 7f607fede700 1 -- 172.21.15.26:0/1869452001 shutdown_connections 2023-10-01T07:54:28.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.250+0000 7f607fede700 1 --2- 172.21.15.26:0/1869452001 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6078135e50 0x7f6078138230 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:28.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.250+0000 7f607fede700 1 --2- 172.21.15.26:0/1869452001 >> v2:172.21.15.26:3300/0 conn(0x7f607809e1d0 0x7f6078135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:28.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.250+0000 7f607fede700 1 -- 172.21.15.26:0/1869452001 >> 172.21.15.26:0/1869452001 conn(0x7f6078066f50 msgr2=0x7f607809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:28.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.250+0000 7f607fede700 1 -- 172.21.15.26:0/1869452001 shutdown_connections 2023-10-01T07:54:28.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.250+0000 7f607fede700 1 -- 172.21.15.26:0/1869452001 wait complete. 2023-10-01T07:54:28.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.251+0000 7f607fede700 1 Processor -- start 2023-10-01T07:54:28.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.251+0000 7f607fede700 1 -- start start 2023-10-01T07:54:28.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.252+0000 7f607fede700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f607809d6f0 0x7f607811bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:28.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.252+0000 7f607fede700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f607809e1d0 0x7f607811c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:28.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.252+0000 7f607fede700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6078135e50 0x7f607811ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:28.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.252+0000 7f607fede700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60781333b0 con 0x7f607809e1d0 2023-10-01T07:54:28.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.252+0000 7f607fede700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607811ede0 con 0x7f607809d6f0 2023-10-01T07:54:28.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.252+0000 7f607fede700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f607811f7c0 con 0x7f6078135e50 2023-10-01T07:54:28.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.252+0000 7f607e47b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6078135e50 0x7f607811ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:28.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.252+0000 7f607dc7a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f607809d6f0 0x7f607811bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:28.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.252+0000 7f607e47b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6078135e50 0x7f607811ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:40918/0 (socket says 172.21.15.26:40918) 2023-10-01T07:54:28.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.252+0000 7f607e47b700 1 -- 172.21.15.26:0/2072923176 learned_addr learned my addr 172.21.15.26:0/2072923176 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:28.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.252+0000 7f607d479700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f607809e1d0 0x7f607811c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:28.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.252+0000 7f607e47b700 1 -- 172.21.15.26:0/2072923176 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f607809d6f0 msgr2=0x7f607811bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:28.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.252+0000 7f607e47b700 1 --2- 172.21.15.26:0/2072923176 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f607809d6f0 0x7f607811bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:28.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.252+0000 7f607e47b700 1 -- 172.21.15.26:0/2072923176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f607809e1d0 msgr2=0x7f607811c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:28.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.252+0000 7f607e47b700 1 --2- 172.21.15.26:0/2072923176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f607809e1d0 0x7f607811c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:28.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.252+0000 7f607e47b700 1 -- 172.21.15.26:0/2072923176 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60740094a0 con 0x7f6078135e50 2023-10-01T07:54:28.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.252+0000 7f607dc7a700 1 --2- 172.21.15.26:0/2072923176 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f607809d6f0 0x7f607811bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:28.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.253+0000 7f607e47b700 1 --2- 172.21.15.26:0/2072923176 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6078135e50 0x7f607811ca00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6070014040 tx=0x7f6070004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:28.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.253+0000 7f606a7fc700 1 -- 172.21.15.26:0/2072923176 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6070012430 con 0x7f6078135e50 2023-10-01T07:54:28.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.253+0000 7f606a7fc700 1 -- 172.21.15.26:0/2072923176 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6070020070 con 0x7f6078135e50 2023-10-01T07:54:28.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.253+0000 7f607fede700 1 -- 172.21.15.26:0/2072923176 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6070009a70 con 0x7f6078135e50 2023-10-01T07:54:28.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.253+0000 7f606a7fc700 1 -- 172.21.15.26:0/2072923176 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6070003ea0 con 0x7f6078135e50 2023-10-01T07:54:28.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.253+0000 7f607fede700 1 -- 172.21.15.26:0/2072923176 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f607811f230 con 0x7f6078135e50 2023-10-01T07:54:28.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.254+0000 7f606a7fc700 1 -- 172.21.15.26:0/2072923176 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6070004040 con 0x7f6078135e50 2023-10-01T07:54:28.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.254+0000 7f606a7fc700 1 -- 172.21.15.26:0/2072923176 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f6070022070 con 0x7f6078135e50 2023-10-01T07:54:28.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.254+0000 7f605bfff700 1 -- 172.21.15.26:0/2072923176 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6078074ea0 con 0x7f6078135e50 2023-10-01T07:54:28.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.259+0000 7f606a7fc700 1 -- 172.21.15.26:0/2072923176 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f607002c080 con 0x7f6078135e50 2023-10-01T07:54:28.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:28.473+0000 7f605bfff700 1 -- 172.21.15.26:0/2072923176 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd down", "ids": ["3"]} v 0) v1 -- 0x7f607811e390 con 0x7f6078135e50 2023-10-01T07:54:28.475 INFO:tasks.ceph.mon.a.smithi026.stderr:2023-10-01T07:54:28.474+0000 7fc3148c9700 -1 mon.a@0(leader).osd e26 definitely_dead 0 2023-10-01T07:54:28.638 INFO:tasks.ceph.osd.2.smithi026.stderr:2023-10-01T07:54:28.637+0000 7ff09fde4680 -1 Falling back to public interface 2023-10-01T07:54:29.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.013+0000 7f606a7fc700 1 -- 172.21.15.26:0/2072923176 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["3"]}]=0 marked down osd.3. v27) v1 ==== 89+0+0 (secure 0 0 0) 0x7f607001a970 con 0x7f6078135e50 2023-10-01T07:54:29.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.015+0000 7f605bfff700 1 -- 172.21.15.26:0/2072923176 >> v1:172.21.15.26:6816/126763 conn(0x7f605c02f510 legacy=0x7f605c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:29.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.015+0000 7f605bfff700 1 -- 172.21.15.26:0/2072923176 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6078135e50 msgr2=0x7f607811ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:29.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.015+0000 7f605bfff700 1 --2- 172.21.15.26:0/2072923176 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6078135e50 0x7f607811ca00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6070014040 tx=0x7f6070004ad0 comp rx=0 tx=0).stop 2023-10-01T07:54:29.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.016+0000 7f605bfff700 1 -- 172.21.15.26:0/2072923176 shutdown_connections 2023-10-01T07:54:29.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.016+0000 7f605bfff700 1 --2- 172.21.15.26:0/2072923176 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6078135e50 0x7f607811ca00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:29.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.016+0000 7f605bfff700 1 --2- 172.21.15.26:0/2072923176 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f607809d6f0 0x7f607811bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:29.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.016+0000 7f605bfff700 1 --2- 172.21.15.26:0/2072923176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f607809e1d0 0x7f607811c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:29.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.016+0000 7f605bfff700 1 -- 172.21.15.26:0/2072923176 >> 172.21.15.26:0/2072923176 conn(0x7f6078066f50 msgr2=0x7f607806ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:29.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.016+0000 7f605bfff700 1 -- 172.21.15.26:0/2072923176 shutdown_connections 2023-10-01T07:54:29.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.016+0000 7f605bfff700 1 -- 172.21.15.26:0/2072923176 wait complete. 2023-10-01T07:54:29.019 INFO:teuthology.orchestra.run.smithi026.stderr:marked down osd.3. 2023-10-01T07:54:29.034 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-01T07:54:29.034 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-01T07:54:29.036 INFO:tasks.ceph.osd.3:Started 2023-10-01T07:54:29.036 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-01T07:54:29.036 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-01T07:54:29.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.179+0000 7ff950cf5700 1 Processor -- start 2023-10-01T07:54:29.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.179+0000 7ff950cf5700 1 -- start start 2023-10-01T07:54:29.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.180+0000 7ff950cf5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff94c0a1510 0x7ff94c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:29.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.180+0000 7ff950cf5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94c139250 0x7ff94c13b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:29.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.180+0000 7ff950cf5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff94c09edd0 con 0x7ff94c0a0a30 2023-10-01T07:54:29.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.180+0000 7ff950cf5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c0a18e0 con 0x7ff94c139250 2023-10-01T07:54:29.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.180+0000 7ff950cf5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c09e1f0 con 0x7ff94c0a1510 2023-10-01T07:54:29.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.180+0000 7ff94a59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff94c0a0a30 0x7ff94c0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42934/0 (socket says 172.21.15.26:42934) 2023-10-01T07:54:29.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.180+0000 7ff94a59c700 1 -- 172.21.15.26:0/4047954657 learned_addr learned my addr 172.21.15.26:0/4047954657 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:29.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.180+0000 7ff94ad9d700 1 --2- 172.21.15.26:0/4047954657 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94c139250 0x7ff94c13b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:29.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.180+0000 7ff949d9b700 1 --2- 172.21.15.26:0/4047954657 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff94c0a1510 0x7ff94c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:29.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.180+0000 7ff94959a700 1 -- 172.21.15.26:0/4047954657 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3974481979 0 0) 0x7ff94c09edd0 con 0x7ff94c0a0a30 2023-10-01T07:54:29.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.180+0000 7ff94959a700 1 -- 172.21.15.26:0/4047954657 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9340035b0 con 0x7ff94c0a0a30 2023-10-01T07:54:29.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.181+0000 7ff94ad9d700 1 -- 172.21.15.26:0/4047954657 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff94c0a1510 msgr2=0x7ff94c138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:29.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.181+0000 7ff94ad9d700 1 --2- 172.21.15.26:0/4047954657 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff94c0a1510 0x7ff94c138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:29.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.181+0000 7ff94ad9d700 1 -- 172.21.15.26:0/4047954657 >> v1:172.21.15.26:6789/0 conn(0x7ff94c0a0a30 legacy=0x7ff94c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:29.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.181+0000 7ff94ad9d700 1 -- 172.21.15.26:0/4047954657 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94c09dc50 con 0x7ff94c139250 2023-10-01T07:54:29.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.181+0000 7ff949d9b700 1 --2- 172.21.15.26:0/4047954657 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff94c0a1510 0x7ff94c138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:29.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.181+0000 7ff94ad9d700 1 --2- 172.21.15.26:0/4047954657 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94c139250 0x7ff94c13b630 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff944009dc0 tx=0x7ff94400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=166be263b008f58f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:29.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.181+0000 7ff94959a700 1 -- 172.21.15.26:0/4047954657 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94400e070 con 0x7ff94c139250 2023-10-01T07:54:29.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.181+0000 7ff94959a700 1 -- 172.21.15.26:0/4047954657 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94400bb20 con 0x7ff94c139250 2023-10-01T07:54:29.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.181+0000 7ff94959a700 1 -- 172.21.15.26:0/4047954657 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff944012430 con 0x7ff94c139250 2023-10-01T07:54:29.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.182+0000 7ff950cf5700 1 -- 172.21.15.26:0/4047954657 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94c139250 msgr2=0x7ff94c13b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:29.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.182+0000 7ff950cf5700 1 --2- 172.21.15.26:0/4047954657 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94c139250 0x7ff94c13b630 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff944009dc0 tx=0x7ff94400b330 comp rx=0 tx=0).stop 2023-10-01T07:54:29.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.182+0000 7ff950cf5700 1 -- 172.21.15.26:0/4047954657 shutdown_connections 2023-10-01T07:54:29.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.182+0000 7ff950cf5700 1 --2- 172.21.15.26:0/4047954657 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94c139250 0x7ff94c13b630 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:29.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.182+0000 7ff950cf5700 1 --2- 172.21.15.26:0/4047954657 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff94c0a1510 0x7ff94c138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:29.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.182+0000 7ff950cf5700 1 -- 172.21.15.26:0/4047954657 >> 172.21.15.26:0/4047954657 conn(0x7ff94c0a6550 msgr2=0x7ff94c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:29.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.182+0000 7ff950cf5700 1 -- 172.21.15.26:0/4047954657 shutdown_connections 2023-10-01T07:54:29.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.182+0000 7ff950cf5700 1 -- 172.21.15.26:0/4047954657 wait complete. 2023-10-01T07:54:29.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.183+0000 7ff950cf5700 1 Processor -- start 2023-10-01T07:54:29.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.183+0000 7ff950cf5700 1 -- start start 2023-10-01T07:54:29.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.184+0000 7ff950cf5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94c0a0a30 0x7ff94c11e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:29.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.184+0000 7ff950cf5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff94c0a1510 0x7ff94c11eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:29.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.184+0000 7ff950cf5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff94c139250 0x7ff94c11f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:29.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.184+0000 7ff950cf5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c121e70 con 0x7ff94c139250 2023-10-01T07:54:29.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.184+0000 7ff950cf5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c122c50 con 0x7ff94c0a0a30 2023-10-01T07:54:29.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.184+0000 7ff950cf5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c122070 con 0x7ff94c0a1510 2023-10-01T07:54:29.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.184+0000 7ff94ad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff94c139250 0x7ff94c11f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:29.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.184+0000 7ff94ad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff94c139250 0x7ff94c11f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47090/0 (socket says 172.21.15.26:47090) 2023-10-01T07:54:29.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.184+0000 7ff94ad9d700 1 -- 172.21.15.26:0/1645200857 learned_addr learned my addr 172.21.15.26:0/1645200857 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:29.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.184+0000 7ff94a59c700 1 --2- 172.21.15.26:0/1645200857 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94c0a0a30 0x7ff94c11e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:29.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.184+0000 7ff949d9b700 1 --2- 172.21.15.26:0/1645200857 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff94c0a1510 0x7ff94c11eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:29.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.184+0000 7ff949d9b700 1 -- 172.21.15.26:0/1645200857 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94c0a0a30 msgr2=0x7ff94c11e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:29.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.184+0000 7ff949d9b700 1 --2- 172.21.15.26:0/1645200857 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94c0a0a30 0x7ff94c11e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:29.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.184+0000 7ff949d9b700 1 -- 172.21.15.26:0/1645200857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff94c139250 msgr2=0x7ff94c11f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:29.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.184+0000 7ff949d9b700 1 --2- 172.21.15.26:0/1645200857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff94c139250 0x7ff94c11f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:29.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.184+0000 7ff949d9b700 1 -- 172.21.15.26:0/1645200857 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9400094a0 con 0x7ff94c0a1510 2023-10-01T07:54:29.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.184+0000 7ff94a59c700 1 --2- 172.21.15.26:0/1645200857 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94c0a0a30 0x7ff94c11e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:29.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.184+0000 7ff94ad9d700 1 --2- 172.21.15.26:0/1645200857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff94c139250 0x7ff94c11f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:29.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.185+0000 7ff949d9b700 1 --2- 172.21.15.26:0/1645200857 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff94c0a1510 0x7ff94c11eb30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff94000e9b0 tx=0x7ff94000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:29.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.185+0000 7ff93affd700 1 -- 172.21.15.26:0/1645200857 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94000ee50 con 0x7ff94c0a1510 2023-10-01T07:54:29.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.185+0000 7ff93affd700 1 -- 172.21.15.26:0/1645200857 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94000c850 con 0x7ff94c0a1510 2023-10-01T07:54:29.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.185+0000 7ff950cf5700 1 -- 172.21.15.26:0/1645200857 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff944009a70 con 0x7ff94c0a1510 2023-10-01T07:54:29.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.185+0000 7ff93affd700 1 -- 172.21.15.26:0/1645200857 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94000cc00 con 0x7ff94c0a1510 2023-10-01T07:54:29.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.185+0000 7ff950cf5700 1 -- 172.21.15.26:0/1645200857 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94c120950 con 0x7ff94c0a1510 2023-10-01T07:54:29.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.186+0000 7ff93affd700 1 -- 172.21.15.26:0/1645200857 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff940013470 con 0x7ff94c0a1510 2023-10-01T07:54:29.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.186+0000 7ff950cf5700 1 -- 172.21.15.26:0/1645200857 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff94c074ea0 con 0x7ff94c0a1510 2023-10-01T07:54:29.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.186+0000 7ff93affd700 1 -- 172.21.15.26:0/1645200857 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4049+0+0 (secure 0 0 0) 0x7ff94003fba0 con 0x7ff94c0a1510 2023-10-01T07:54:29.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.191+0000 7ff93affd700 1 -- 172.21.15.26:0/1645200857 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff940013720 con 0x7ff94c0a1510 2023-10-01T07:54:29.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.398+0000 7ff950cf5700 1 -- 172.21.15.26:0/1645200857 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff94c121cd0 con 0x7ff94c0a1510 2023-10-01T07:54:29.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.399+0000 7ff93affd700 1 -- 172.21.15.26:0/1645200857 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+11944 (secure 0 0 0) 0x7ff94c121cd0 con 0x7ff94c0a1510 2023-10-01T07:54:29.400 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:54:29.400 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":27,"fsid":"c29fb19d-520c-42a6-90f4-e7f86de96e8e","created":"2023-10-01T07:51:40.702414+0000","modified":"2023-10-01T07:54:29.008198+0000","last_up_change":"2023-10-01T07:54:29.008198+0000","last_in_change":"2023-10-01T07:51:42.084736+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-01T07:51:48.906889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-01T07:51:50.071599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-01T07:51:54.981575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-01T07:51:56.286318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"46569ce3-81d1-44a1-a649-691de3e6f808","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6800","nonce":118773}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6801","nonce":118773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6803","nonce":118773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6802","nonce":118773}]},"public_addr":"172.21.15.26:6800/118773","cluster_addr":"172.21.15.26:6801/118773","heartbeat_back_addr":"172.21.15.26:6803/118773","heartbeat_front_addr":"172.21.15.26:6802/118773","state":["exists"]},{"osd":1,"uuid":"1fc1ba9b-4110-4d31-96d6-794937578cff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6804","nonce":118782}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6806","nonce":118782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6810","nonce":118782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6808","nonce":118782}]},"public_addr":"172.21.15.26:6804/118782","cluster_addr":"172.21.15.26:6806/118782","heartbeat_back_addr":"172.21.15.26:6810/118782","heartbeat_front_addr":"172.21.15.26:6808/118782","state":["exists"]},{"osd":2,"uuid":"37de933d-3b8e-4b94-87bd-2f36896c7ff5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6805","nonce":118789}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6807","nonce":118789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6811","nonce":118789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6809","nonce":118789}]},"public_addr":"172.21.15.26:6805/118789","cluster_addr":"172.21.15.26:6807/118789","heartbeat_back_addr":"172.21.15.26:6811/118789","heartbeat_front_addr":"172.21.15.26:6809/118789","state":["exists"]},{"osd":3,"uuid":"bd020309-5fd2-4d97-b36a-67e159fa3ebf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":26,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6812","nonce":118790}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6813","nonce":118790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6815","nonce":118790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6814","nonce":118790}]},"public_addr":"172.21.15.26:6812/118790","cluster_addr":"172.21.15.26:6813/118790","heartbeat_back_addr":"172.21.15.26:6815/118790","heartbeat_front_addr":"172.21.15.26:6814/118790","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.029993+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.266503+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.273540+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-10-01T07:54:29.008198+0000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.229731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.e","mappings":[{"from":3,"to":0}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.39","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/616154075":"2023-10-02T07:54:14.803384+0000","172.21.15.26:6816/118178":"2023-10-02T07:54:14.803384+0000","172.21.15.26:0/1290599107":"2023-10-02T07:54:14.803384+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-01T07:54:29.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.401+0000 7ff950cf5700 1 -- 172.21.15.26:0/1645200857 >> v1:172.21.15.26:6816/126763 conn(0x7ff92c02f510 legacy=0x7ff92c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:29.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.401+0000 7ff950cf5700 1 -- 172.21.15.26:0/1645200857 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff94c0a1510 msgr2=0x7ff94c11eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:29.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.401+0000 7ff950cf5700 1 --2- 172.21.15.26:0/1645200857 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff94c0a1510 0x7ff94c11eb30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff94000e9b0 tx=0x7ff94000ecc0 comp rx=0 tx=0).stop 2023-10-01T07:54:29.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.401+0000 7ff950cf5700 1 -- 172.21.15.26:0/1645200857 shutdown_connections 2023-10-01T07:54:29.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.401+0000 7ff950cf5700 1 --2- 172.21.15.26:0/1645200857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff94c139250 0x7ff94c11f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:29.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.401+0000 7ff950cf5700 1 --2- 172.21.15.26:0/1645200857 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94c0a0a30 0x7ff94c11e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:29.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.401+0000 7ff950cf5700 1 --2- 172.21.15.26:0/1645200857 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff94c0a1510 0x7ff94c11eb30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:29.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.401+0000 7ff950cf5700 1 -- 172.21.15.26:0/1645200857 >> 172.21.15.26:0/1645200857 conn(0x7ff94c0a6550 msgr2=0x7ff94c0a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:29.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.401+0000 7ff950cf5700 1 -- 172.21.15.26:0/1645200857 shutdown_connections 2023-10-01T07:54:29.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:29.401+0000 7ff950cf5700 1 -- 172.21.15.26:0/1645200857 wait complete. 2023-10-01T07:54:29.643 INFO:tasks.ceph.osd.3.smithi026.stderr:2023-10-01T07:54:29.642+0000 7f77afc48680 -1 Falling back to public interface 2023-10-01T07:54:30.190 INFO:tasks.ceph.osd.0.smithi026.stderr:2023-10-01T07:54:30.188+0000 7f4628b71680 -1 osd.0 23 log_to_monitors true 2023-10-01T07:54:31.459 INFO:tasks.ceph.osd.1.smithi026.stderr:2023-10-01T07:54:31.457+0000 7fa62e996680 -1 osd.1 24 log_to_monitors true 2023-10-01T07:54:31.889 INFO:tasks.ceph.osd.0.smithi026.stderr:2023-10-01T07:54:31.888+0000 7f4614aec700 -1 osd.0 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-01T07:54:32.417 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-01T07:54:32.425 INFO:tasks.ceph.osd.2.smithi026.stderr:2023-10-01T07:54:32.425+0000 7ff09fde4680 -1 osd.2 25 log_to_monitors true 2023-10-01T07:54:32.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.606+0000 7f12d6844700 1 Processor -- start 2023-10-01T07:54:32.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.606+0000 7f12d6844700 1 -- start start 2023-10-01T07:54:32.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.607+0000 7f12d6844700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f12d009e240 0x7f12d0138c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:32.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.607+0000 7f12d6844700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f12d01391a0 0x7f12d013b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:32.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.607+0000 7f12d6844700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d006b0a0 con 0x7f12d009d760 2023-10-01T07:54:32.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.607+0000 7f12d6844700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12d006b6d0 con 0x7f12d009e240 2023-10-01T07:54:32.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.607+0000 7f12d6844700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12d009b1c0 con 0x7f12d01391a0 2023-10-01T07:54:32.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.607+0000 7f12d4de1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f12d01391a0 0x7f12d013b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:32.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.607+0000 7f12cffff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f12d009d760 0x7f12d009db30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42950/0 (socket says 172.21.15.26:42950) 2023-10-01T07:54:32.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.607+0000 7f12cffff700 1 -- 172.21.15.26:0/2601454144 learned_addr learned my addr 172.21.15.26:0/2601454144 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:32.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.607+0000 7f12d4de1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f12d01391a0 0x7f12d013b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:40940/0 (socket says 172.21.15.26:40940) 2023-10-01T07:54:32.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.607+0000 7f12cf7fe700 1 --2- 172.21.15.26:0/2601454144 >> v2:172.21.15.26:3300/0 conn(0x7f12d009e240 0x7f12d0138c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:32.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.608+0000 7f12d4de1700 1 -- 172.21.15.26:0/2601454144 >> v2:172.21.15.26:3300/0 conn(0x7f12d009e240 msgr2=0x7f12d0138c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:32.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.608+0000 7f12d4de1700 1 --2- 172.21.15.26:0/2601454144 >> v2:172.21.15.26:3300/0 conn(0x7f12d009e240 0x7f12d0138c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:32.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.608+0000 7f12d4de1700 1 -- 172.21.15.26:0/2601454144 >> v1:172.21.15.26:6789/0 conn(0x7f12d009d760 legacy=0x7f12d009db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:32.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.608+0000 7f12d4de1700 1 -- 172.21.15.26:0/2601454144 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d006b490 con 0x7f12d01391a0 2023-10-01T07:54:32.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.608+0000 7f12d4de1700 1 --2- 172.21.15.26:0/2601454144 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f12d01391a0 0x7f12d013b580 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f12c8009d90 tx=0x7f12c800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b1b8fc4708b86f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:32.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.608+0000 7f12ceffd700 1 -- 172.21.15.26:0/2601454144 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c800e070 con 0x7f12d01391a0 2023-10-01T07:54:32.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.608+0000 7f12ceffd700 1 -- 172.21.15.26:0/2601454144 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c8003a20 con 0x7f12d01391a0 2023-10-01T07:54:32.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.608+0000 7f12ceffd700 1 -- 172.21.15.26:0/2601454144 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c8003dd0 con 0x7f12d01391a0 2023-10-01T07:54:32.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.609+0000 7f12d6844700 1 -- 172.21.15.26:0/2601454144 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f12d01391a0 msgr2=0x7f12d013b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:32.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.609+0000 7f12d6844700 1 --2- 172.21.15.26:0/2601454144 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f12d01391a0 0x7f12d013b580 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f12c8009d90 tx=0x7f12c800b330 comp rx=0 tx=0).stop 2023-10-01T07:54:32.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.609+0000 7f12d6844700 1 -- 172.21.15.26:0/2601454144 shutdown_connections 2023-10-01T07:54:32.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.609+0000 7f12d6844700 1 --2- 172.21.15.26:0/2601454144 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f12d01391a0 0x7f12d013b580 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:32.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.609+0000 7f12d6844700 1 --2- 172.21.15.26:0/2601454144 >> v2:172.21.15.26:3300/0 conn(0x7f12d009e240 0x7f12d0138c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:32.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.609+0000 7f12d6844700 1 -- 172.21.15.26:0/2601454144 >> 172.21.15.26:0/2601454144 conn(0x7f12d0066f50 msgr2=0x7f12d00a2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:32.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.609+0000 7f12d6844700 1 -- 172.21.15.26:0/2601454144 shutdown_connections 2023-10-01T07:54:32.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.609+0000 7f12d6844700 1 -- 172.21.15.26:0/2601454144 wait complete. 2023-10-01T07:54:32.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.610+0000 7f12d6844700 1 Processor -- start 2023-10-01T07:54:32.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.611+0000 7f12d6844700 1 -- start start 2023-10-01T07:54:32.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.611+0000 7f12d6844700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12d009d760 0x7f12d01c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:32.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.611+0000 7f12d6844700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f12d009e240 0x7f12d01c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:32.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.611+0000 7f12d6844700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f12d01391a0 0x7f12d01c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:32.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.611+0000 7f12d6844700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d0120e70 con 0x7f12d009d760 2023-10-01T07:54:32.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.611+0000 7f12d6844700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d01222b0 con 0x7f12d01391a0 2023-10-01T07:54:32.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.611+0000 7f12d6844700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12d0120790 con 0x7f12d009e240 2023-10-01T07:54:32.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.612+0000 7f12cf7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f12d009e240 0x7f12d01c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:32.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.612+0000 7f12cffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12d009d760 0x7f12d01c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:32.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.612+0000 7f12cf7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f12d009e240 0x7f12d01c88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:40950/0 (socket says 172.21.15.26:40950) 2023-10-01T07:54:32.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.612+0000 7f12cf7fe700 1 -- 172.21.15.26:0/2928066273 learned_addr learned my addr 172.21.15.26:0/2928066273 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:32.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.612+0000 7f12cf7fe700 1 -- 172.21.15.26:0/2928066273 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f12d01391a0 msgr2=0x7f12d01c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:32.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.612+0000 7f12cf7fe700 1 --2- 172.21.15.26:0/2928066273 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f12d01391a0 0x7f12d01c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:32.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.612+0000 7f12cf7fe700 1 -- 172.21.15.26:0/2928066273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12d009d760 msgr2=0x7f12d01c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:32.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.612+0000 7f12cf7fe700 1 --2- 172.21.15.26:0/2928066273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12d009d760 0x7f12d01c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:32.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.612+0000 7f12cf7fe700 1 -- 172.21.15.26:0/2928066273 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c8009a70 con 0x7f12d009e240 2023-10-01T07:54:32.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.612+0000 7f12cffff700 1 --2- 172.21.15.26:0/2928066273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12d009d760 0x7f12d01c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:32.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.612+0000 7f12cf7fe700 1 --2- 172.21.15.26:0/2928066273 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f12d009e240 0x7f12d01c88d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f12c400e9c0 tx=0x7f12c400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:32.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.612+0000 7f12ccff9700 1 -- 172.21.15.26:0/2928066273 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c40096f0 con 0x7f12d009e240 2023-10-01T07:54:32.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.612+0000 7f12ccff9700 1 -- 172.21.15.26:0/2928066273 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c400c850 con 0x7f12d009e240 2023-10-01T07:54:32.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.612+0000 7f12ccff9700 1 -- 172.21.15.26:0/2928066273 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c400cbc0 con 0x7f12d009e240 2023-10-01T07:54:32.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.612+0000 7f12d6844700 1 -- 172.21.15.26:0/2928066273 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12d01212f0 con 0x7f12d009e240 2023-10-01T07:54:32.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.612+0000 7f12d6844700 1 -- 172.21.15.26:0/2928066273 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d0121ff0 con 0x7f12d009e240 2023-10-01T07:54:32.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.614+0000 7f12d6844700 1 -- 172.21.15.26:0/2928066273 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12d0072980 con 0x7f12d009e240 2023-10-01T07:54:32.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.614+0000 7f12ccff9700 1 -- 172.21.15.26:0/2928066273 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f12c400cd20 con 0x7f12d009e240 2023-10-01T07:54:32.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.614+0000 7f12ccff9700 1 -- 172.21.15.26:0/2928066273 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f12c4040080 con 0x7f12d009e240 2023-10-01T07:54:32.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.623+0000 7f12ccff9700 1 -- 172.21.15.26:0/2928066273 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f12c401b3b0 con 0x7f12d009e240 2023-10-01T07:54:32.901 INFO:tasks.ceph.osd.1.smithi026.stderr:2023-10-01T07:54:32.900+0000 7fa61a911700 -1 osd.1 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-01T07:54:32.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.941+0000 7f12d6844700 1 -- 172.21.15.26:0/2928066273 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12d00747f0 con 0x7f12d009e240 2023-10-01T07:54:32.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.942+0000 7f12ccff9700 1 -- 172.21.15.26:0/2928066273 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+12732 (secure 0 0 0) 0x7f12c4017070 con 0x7f12d009e240 2023-10-01T07:54:32.942 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:54:32.942 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":29,"fsid":"c29fb19d-520c-42a6-90f4-e7f86de96e8e","created":"2023-10-01T07:51:40.702414+0000","modified":"2023-10-01T07:54:32.018252+0000","last_up_change":"2023-10-01T07:54:32.018252+0000","last_in_change":"2023-10-01T07:51:42.084736+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-01T07:51:48.906889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.25,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-01T07:51:50.071599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"error_message":"pool 2 has some PGs where all OSDs are with primary_affinity 0 (at least pg 2.0), read balance score may not be reliable","score_acting":0,"score_stable":0}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-01T07:51:54.981575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"error_message":"pool 3 has some PGs where all OSDs are with primary_affinity 0 (at least pg 3.0), read balance score may not be reliable","score_acting":0,"score_stable":0}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-01T07:51:56.286318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"error_message":"pool 4 has some PGs where all OSDs are with primary_affinity 0 (at least pg 4.0), read balance score may not be reliable","score_acting":0,"score_stable":0}}],"osds":[{"osd":0,"uuid":"46569ce3-81d1-44a1-a649-691de3e6f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":15,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6800","nonce":129479}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6801","nonce":129479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6803","nonce":129479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6802","nonce":129479}]},"public_addr":"172.21.15.26:6800/129479","cluster_addr":"172.21.15.26:6801/129479","heartbeat_back_addr":"172.21.15.26:6803/129479","heartbeat_front_addr":"172.21.15.26:6802/129479","state":["exists","up"]},{"osd":1,"uuid":"1fc1ba9b-4110-4d31-96d6-794937578cff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6804","nonce":118782}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6806","nonce":118782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6810","nonce":118782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6808","nonce":118782}]},"public_addr":"172.21.15.26:6804/118782","cluster_addr":"172.21.15.26:6806/118782","heartbeat_back_addr":"172.21.15.26:6810/118782","heartbeat_front_addr":"172.21.15.26:6808/118782","state":["exists"]},{"osd":2,"uuid":"37de933d-3b8e-4b94-87bd-2f36896c7ff5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6805","nonce":118789}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6807","nonce":118789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6811","nonce":118789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6809","nonce":118789}]},"public_addr":"172.21.15.26:6805/118789","cluster_addr":"172.21.15.26:6807/118789","heartbeat_back_addr":"172.21.15.26:6811/118789","heartbeat_front_addr":"172.21.15.26:6809/118789","state":["exists"]},{"osd":3,"uuid":"bd020309-5fd2-4d97-b36a-67e159fa3ebf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":26,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6812","nonce":118790}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6813","nonce":118790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6815","nonce":118790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6814","nonce":118790}]},"public_addr":"172.21.15.26:6812/118790","cluster_addr":"172.21.15.26:6813/118790","heartbeat_back_addr":"172.21.15.26:6815/118790","heartbeat_front_addr":"172.21.15.26:6814/118790","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.029993+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.266503+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.273540+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-10-01T07:54:29.008198+0000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.229731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.e","mappings":[{"from":3,"to":0}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.39","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/616154075":"2023-10-02T07:54:14.803384+0000","172.21.15.26:6816/118178":"2023-10-02T07:54:14.803384+0000","172.21.15.26:0/1290599107":"2023-10-02T07:54:14.803384+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-01T07:54:32.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.944+0000 7f12d6844700 1 -- 172.21.15.26:0/2928066273 >> v1:172.21.15.26:6816/126763 conn(0x7f12bc02f510 legacy=0x7f12bc0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:32.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.944+0000 7f12d6844700 1 -- 172.21.15.26:0/2928066273 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f12d009e240 msgr2=0x7f12d01c88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:32.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.944+0000 7f12d6844700 1 --2- 172.21.15.26:0/2928066273 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f12d009e240 0x7f12d01c88d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f12c400e9c0 tx=0x7f12c400ecd0 comp rx=0 tx=0).stop 2023-10-01T07:54:32.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.944+0000 7f12d6844700 1 -- 172.21.15.26:0/2928066273 shutdown_connections 2023-10-01T07:54:32.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.944+0000 7f12d6844700 1 --2- 172.21.15.26:0/2928066273 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f12d01391a0 0x7f12d01c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:32.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.944+0000 7f12d6844700 1 --2- 172.21.15.26:0/2928066273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12d009d760 0x7f12d01c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:32.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.944+0000 7f12d6844700 1 --2- 172.21.15.26:0/2928066273 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f12d009e240 0x7f12d01c88d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:32.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.944+0000 7f12d6844700 1 -- 172.21.15.26:0/2928066273 >> 172.21.15.26:0/2928066273 conn(0x7f12d0066f50 msgr2=0x7f12d0138250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:32.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.944+0000 7f12d6844700 1 -- 172.21.15.26:0/2928066273 shutdown_connections 2023-10-01T07:54:32.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:32.944+0000 7f12d6844700 1 -- 172.21.15.26:0/2928066273 wait complete. 2023-10-01T07:54:33.438 INFO:tasks.ceph.osd.3.smithi026.stderr:2023-10-01T07:54:33.437+0000 7f77afc48680 -1 osd.3 26 log_to_monitors true 2023-10-01T07:54:33.888 INFO:tasks.ceph.osd.2.smithi026.stderr:2023-10-01T07:54:33.887+0000 7ff08bd5f700 -1 osd.2 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-01T07:54:34.898 INFO:tasks.ceph.osd.3.smithi026.stderr:2023-10-01T07:54:34.897+0000 7f779bbc3700 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-01T07:54:35.958 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-01T07:54:36.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.121+0000 7f2e1b108700 1 Processor -- start 2023-10-01T07:54:36.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.121+0000 7f2e1b108700 1 -- start start 2023-10-01T07:54:36.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.121+0000 7f2e1b108700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e1409d6f0 0x7f2e1409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:36.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.121+0000 7f2e1b108700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e1409e000 0x7f2e14130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:36.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.121+0000 7f2e1b108700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e1409f130 con 0x7f2e1409e410 2023-10-01T07:54:36.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.121+0000 7f2e1b108700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1409f520 con 0x7f2e1409e000 2023-10-01T07:54:36.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.121+0000 7f2e1b108700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1409e930 con 0x7f2e1409d6f0 2023-10-01T07:54:36.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.122+0000 7f2e18ea4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e1409d6f0 0x7f2e1409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:36.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.122+0000 7f2e196a5700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2e1409e410 0x7f2e14130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45724/0 (socket says 172.21.15.26:45724) 2023-10-01T07:54:36.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.122+0000 7f2e196a5700 1 -- 172.21.15.26:0/3024254200 learned_addr learned my addr 172.21.15.26:0/3024254200 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:36.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.122+0000 7f2e13fff700 1 --2- 172.21.15.26:0/3024254200 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e1409e000 0x7f2e14130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:36.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.122+0000 7f2e137fe700 1 -- 172.21.15.26:0/3024254200 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638903791 0 0) 0x7f2e1409f130 con 0x7f2e1409e410 2023-10-01T07:54:36.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.122+0000 7f2e137fe700 1 -- 172.21.15.26:0/3024254200 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e040035b0 con 0x7f2e1409e410 2023-10-01T07:54:36.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.122+0000 7f2e13fff700 1 -- 172.21.15.26:0/3024254200 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e1409d6f0 msgr2=0x7f2e1409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:36.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.122+0000 7f2e13fff700 1 --2- 172.21.15.26:0/3024254200 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e1409d6f0 0x7f2e1409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:36.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.122+0000 7f2e13fff700 1 -- 172.21.15.26:0/3024254200 >> v1:172.21.15.26:6789/0 conn(0x7f2e1409e410 legacy=0x7f2e14130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:36.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.122+0000 7f2e13fff700 1 -- 172.21.15.26:0/3024254200 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1409b2d0 con 0x7f2e1409e000 2023-10-01T07:54:36.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.122+0000 7f2e13fff700 1 --2- 172.21.15.26:0/3024254200 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e1409e000 0x7f2e14130660 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2e00009870 tx=0x7f2e00009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c272e2b3ff3afbfa server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:36.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.122+0000 7f2e137fe700 1 -- 172.21.15.26:0/3024254200 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e00011830 con 0x7f2e1409e000 2023-10-01T07:54:36.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.122+0000 7f2e137fe700 1 -- 172.21.15.26:0/3024254200 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e00011990 con 0x7f2e1409e000 2023-10-01T07:54:36.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.122+0000 7f2e137fe700 1 -- 172.21.15.26:0/3024254200 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e00011d20 con 0x7f2e1409e000 2023-10-01T07:54:36.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.123+0000 7f2e1b108700 1 -- 172.21.15.26:0/3024254200 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e1409e000 msgr2=0x7f2e14130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:36.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.123+0000 7f2e1b108700 1 --2- 172.21.15.26:0/3024254200 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e1409e000 0x7f2e14130660 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2e00009870 tx=0x7f2e00009b80 comp rx=0 tx=0).stop 2023-10-01T07:54:36.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.123+0000 7f2e1b108700 1 -- 172.21.15.26:0/3024254200 shutdown_connections 2023-10-01T07:54:36.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.123+0000 7f2e1b108700 1 --2- 172.21.15.26:0/3024254200 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e1409d6f0 0x7f2e1409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:36.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.123+0000 7f2e1b108700 1 --2- 172.21.15.26:0/3024254200 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e1409e000 0x7f2e14130660 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:36.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.123+0000 7f2e1b108700 1 -- 172.21.15.26:0/3024254200 >> 172.21.15.26:0/3024254200 conn(0x7f2e14066f50 msgr2=0x7f2e1409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:36.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.123+0000 7f2e1b108700 1 -- 172.21.15.26:0/3024254200 shutdown_connections 2023-10-01T07:54:36.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.123+0000 7f2e1b108700 1 -- 172.21.15.26:0/3024254200 wait complete. 2023-10-01T07:54:36.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.124+0000 7f2e1b108700 1 Processor -- start 2023-10-01T07:54:36.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.124+0000 7f2e1b108700 1 -- start start 2023-10-01T07:54:36.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.125+0000 7f2e1b108700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e1409d6f0 0x7f2e1406e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:36.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.125+0000 7f2e1b108700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e1409e000 0x7f2e1406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:36.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.125+0000 7f2e1b108700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e1409e410 0x7f2e1406f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:36.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.125+0000 7f2e1b108700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1409c700 con 0x7f2e1409d6f0 2023-10-01T07:54:36.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.125+0000 7f2e1b108700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e140a1b80 con 0x7f2e1409e410 2023-10-01T07:54:36.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.125+0000 7f2e1b108700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e14125410 con 0x7f2e1409e000 2023-10-01T07:54:36.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.125+0000 7f2e196a5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e1409e410 0x7f2e1406f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:36.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.125+0000 7f2e18ea4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e1409d6f0 0x7f2e1406e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:36.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.125+0000 7f2e196a5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e1409e410 0x7f2e1406f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:56476/0 (socket says 172.21.15.26:56476) 2023-10-01T07:54:36.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.125+0000 7f2e18ea4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e1409d6f0 0x7f2e1406e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53166/0 (socket says 172.21.15.26:53166) 2023-10-01T07:54:36.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.125+0000 7f2e196a5700 1 -- 172.21.15.26:0/70682104 learned_addr learned my addr 172.21.15.26:0/70682104 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:36.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.125+0000 7f2e13fff700 1 --2- 172.21.15.26:0/70682104 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e1409e000 0x7f2e1406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:36.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.125+0000 7f2e13fff700 1 -- 172.21.15.26:0/70682104 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e1409e410 msgr2=0x7f2e1406f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:36.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.125+0000 7f2e13fff700 1 --2- 172.21.15.26:0/70682104 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e1409e410 0x7f2e1406f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:36.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.125+0000 7f2e13fff700 1 -- 172.21.15.26:0/70682104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e1409d6f0 msgr2=0x7f2e1406e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:36.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.125+0000 7f2e13fff700 1 --2- 172.21.15.26:0/70682104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e1409d6f0 0x7f2e1406e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:36.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.125+0000 7f2e13fff700 1 -- 172.21.15.26:0/70682104 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e000094a0 con 0x7f2e1409e000 2023-10-01T07:54:36.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.125+0000 7f2e18ea4700 1 --2- 172.21.15.26:0/70682104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e1409d6f0 0x7f2e1406e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:36.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.125+0000 7f2e196a5700 1 --2- 172.21.15.26:0/70682104 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e1409e410 0x7f2e1406f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:36.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.125+0000 7f2e13fff700 1 --2- 172.21.15.26:0/70682104 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e1409e000 0x7f2e1406edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2e140a3e20 tx=0x7f2e00004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:36.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.126+0000 7f2e117fa700 1 -- 172.21.15.26:0/70682104 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e00004450 con 0x7f2e1409e000 2023-10-01T07:54:36.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.126+0000 7f2e117fa700 1 -- 172.21.15.26:0/70682104 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0001f070 con 0x7f2e1409e000 2023-10-01T07:54:36.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.126+0000 7f2e1b108700 1 -- 172.21.15.26:0/70682104 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e141259a0 con 0x7f2e1409e000 2023-10-01T07:54:36.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.126+0000 7f2e117fa700 1 -- 172.21.15.26:0/70682104 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e000038e0 con 0x7f2e1409e000 2023-10-01T07:54:36.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.126+0000 7f2e1b108700 1 -- 172.21.15.26:0/70682104 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e14126410 con 0x7f2e1409e000 2023-10-01T07:54:36.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.126+0000 7f2e117fa700 1 -- 172.21.15.26:0/70682104 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2e00003a40 con 0x7f2e1409e000 2023-10-01T07:54:36.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.127+0000 7f2e117fa700 1 -- 172.21.15.26:0/70682104 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f2e00021070 con 0x7f2e1409e000 2023-10-01T07:54:36.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.127+0000 7f2e1b108700 1 -- 172.21.15.26:0/70682104 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e14074ea0 con 0x7f2e1409e000 2023-10-01T07:54:36.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.132+0000 7f2e117fa700 1 -- 172.21.15.26:0/70682104 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e0002b080 con 0x7f2e1409e000 2023-10-01T07:54:36.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.339+0000 7f2e1b108700 1 -- 172.21.15.26:0/70682104 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e14125640 con 0x7f2e1409e000 2023-10-01T07:54:36.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.340+0000 7f2e117fa700 1 -- 172.21.15.26:0/70682104 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+12950 (secure 0 0 0) 0x7f2e00015070 con 0x7f2e1409e000 2023-10-01T07:54:36.341 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:54:36.341 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":33,"fsid":"c29fb19d-520c-42a6-90f4-e7f86de96e8e","created":"2023-10-01T07:51:40.702414+0000","modified":"2023-10-01T07:54:36.034583+0000","last_up_change":"2023-10-01T07:54:35.033170+0000","last_in_change":"2023-10-01T07:51:42.084736+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-01T07:51:48.906889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-01T07:51:50.071599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-01T07:51:54.981575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-01T07:51:56.286318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46569ce3-81d1-44a1-a649-691de3e6f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6800","nonce":129479}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6801","nonce":129479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6803","nonce":129479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6802","nonce":129479}]},"public_addr":"172.21.15.26:6800/129479","cluster_addr":"172.21.15.26:6801/129479","heartbeat_back_addr":"172.21.15.26:6803/129479","heartbeat_front_addr":"172.21.15.26:6802/129479","state":["exists","up"]},{"osd":1,"uuid":"1fc1ba9b-4110-4d31-96d6-794937578cff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6804","nonce":129577}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6805","nonce":129577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6807","nonce":129577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6806","nonce":129577}]},"public_addr":"172.21.15.26:6804/129577","cluster_addr":"172.21.15.26:6805/129577","heartbeat_back_addr":"172.21.15.26:6807/129577","heartbeat_front_addr":"172.21.15.26:6806/129577","state":["exists","up"]},{"osd":2,"uuid":"37de933d-3b8e-4b94-87bd-2f36896c7ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6808","nonce":129687}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6809","nonce":129687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6811","nonce":129687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6810","nonce":129687}]},"public_addr":"172.21.15.26:6808/129687","cluster_addr":"172.21.15.26:6809/129687","heartbeat_back_addr":"172.21.15.26:6811/129687","heartbeat_front_addr":"172.21.15.26:6810/129687","state":["exists","up"]},{"osd":3,"uuid":"bd020309-5fd2-4d97-b36a-67e159fa3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6812","nonce":130029}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6813","nonce":130029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6815","nonce":130029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6814","nonce":130029}]},"public_addr":"172.21.15.26:6812/130029","cluster_addr":"172.21.15.26:6813/130029","heartbeat_back_addr":"172.21.15.26:6815/130029","heartbeat_front_addr":"172.21.15.26:6814/130029","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.029993+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.266503+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.273540+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-10-01T07:54:29.008198+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.229731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.e","mappings":[{"from":3,"to":0}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.39","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/616154075":"2023-10-02T07:54:14.803384+0000","172.21.15.26:6816/118178":"2023-10-02T07:54:14.803384+0000","172.21.15.26:0/1290599107":"2023-10-02T07:54:14.803384+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-01T07:54:36.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.343+0000 7f2e1b108700 1 -- 172.21.15.26:0/70682104 >> v1:172.21.15.26:6816/126763 conn(0x7f2df802f510 legacy=0x7f2df80319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:36.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.343+0000 7f2e1b108700 1 -- 172.21.15.26:0/70682104 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e1409e000 msgr2=0x7f2e1406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:36.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.343+0000 7f2e1b108700 1 --2- 172.21.15.26:0/70682104 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e1409e000 0x7f2e1406edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2e140a3e20 tx=0x7f2e00004750 comp rx=0 tx=0).stop 2023-10-01T07:54:36.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.343+0000 7f2e1b108700 1 -- 172.21.15.26:0/70682104 shutdown_connections 2023-10-01T07:54:36.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.343+0000 7f2e1b108700 1 --2- 172.21.15.26:0/70682104 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e1409e410 0x7f2e1406f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:36.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.343+0000 7f2e1b108700 1 --2- 172.21.15.26:0/70682104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e1409d6f0 0x7f2e1406e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:36.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.343+0000 7f2e1b108700 1 --2- 172.21.15.26:0/70682104 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e1409e000 0x7f2e1406edb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:36.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.343+0000 7f2e1b108700 1 -- 172.21.15.26:0/70682104 >> 172.21.15.26:0/70682104 conn(0x7f2e14066f50 msgr2=0x7f2e14071070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:36.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.343+0000 7f2e1b108700 1 -- 172.21.15.26:0/70682104 shutdown_connections 2023-10-01T07:54:36.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:36.343+0000 7f2e1b108700 1 -- 172.21.15.26:0/70682104 wait complete. 2023-10-01T07:54:36.356 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-01T07:54:36.357 INFO:teuthology.run_tasks:Running task ceph.stop... 2023-10-01T07:54:36.368 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-01T07:54:36.369 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T07:54:36.380 INFO:tasks.ceph.mds.a:Stopped 2023-10-01T07:54:39.736 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog finished 2023-10-01T07:54:39.736 INFO:teuthology.run_tasks:Running task ceph.restart... 2023-10-01T07:54:39.746 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2023-10-01T07:54:39.746 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-01T07:54:39.747 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-01T07:54:39.749 INFO:tasks.ceph.mds.a:Started 2023-10-01T07:54:39.749 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-01T07:54:39.750 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-01T07:54:39.847 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2023-10-01T07:54:39.862 INFO:tasks.ceph.mon.a.smithi026.stderr:2023-10-01T07:54:39.862+0000 7fc3148c9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-01T07:54:39.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.904+0000 7febc25d5700 1 Processor -- start 2023-10-01T07:54:39.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.904+0000 7febc25d5700 1 -- start start 2023-10-01T07:54:39.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.905+0000 7febc25d5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7febbc0a0950 0x7febbc0a2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:39.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.905+0000 7febc25d5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febbc0a0d20 0x7febbc0a1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:39.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.905+0000 7febc25d5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febbc133920 0x7febbc133d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:39.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.905+0000 7febc25d5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febbc09e0a0 con 0x7febbc0a0950 2023-10-01T07:54:39.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.905+0000 7febc25d5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febbc0a2950 con 0x7febbc133920 2023-10-01T07:54:39.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.905+0000 7febc25d5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febbc09db00 con 0x7febbc0a0d20 2023-10-01T07:54:39.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.905+0000 7febbbfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7febbc0a0950 0x7febbc0a2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:39.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.905+0000 7febbb7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febbc0a0d20 0x7febbc0a1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:39.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.905+0000 7febbbfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7febbc0a0950 0x7febbc0a2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53176/0 (socket says 172.21.15.26:53176) 2023-10-01T07:54:39.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.905+0000 7febbbfff700 1 -- 172.21.15.26:0/975744828 learned_addr learned my addr 172.21.15.26:0/975744828 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:39.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.905+0000 7febc0b72700 1 --2- 172.21.15.26:0/975744828 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febbc133920 0x7febbc133d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:39.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.905+0000 7febc0b72700 1 -- 172.21.15.26:0/975744828 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febbc0a0d20 msgr2=0x7febbc0a1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:39.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.905+0000 7febc0b72700 1 --2- 172.21.15.26:0/975744828 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febbc0a0d20 0x7febbc0a1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:39.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.905+0000 7febc0b72700 1 -- 172.21.15.26:0/975744828 >> v2:172.21.15.26:3300/0 conn(0x7febbc0a0950 msgr2=0x7febbc0a2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:39.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.905+0000 7febc0b72700 1 --2- 172.21.15.26:0/975744828 >> v2:172.21.15.26:3300/0 conn(0x7febbc0a0950 0x7febbc0a2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:39.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.905+0000 7febc0b72700 1 -- 172.21.15.26:0/975744828 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febbc09ddc0 con 0x7febbc133920 2023-10-01T07:54:39.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.905+0000 7febbb7fe700 1 --2- 172.21.15.26:0/975744828 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febbc0a0d20 0x7febbc0a1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:39.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.905+0000 7febc0b72700 1 --2- 172.21.15.26:0/975744828 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febbc133920 0x7febbc133d80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7febb4009d90 tx=0x7febb400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e128353ea8e218a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:39.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.905+0000 7febbaffd700 1 -- 172.21.15.26:0/975744828 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb400e070 con 0x7febbc133920 2023-10-01T07:54:39.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.906+0000 7febbaffd700 1 -- 172.21.15.26:0/975744828 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb400bb20 con 0x7febbc133920 2023-10-01T07:54:39.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.906+0000 7febbaffd700 1 -- 172.21.15.26:0/975744828 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb4012430 con 0x7febbc133920 2023-10-01T07:54:39.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.906+0000 7febc25d5700 1 -- 172.21.15.26:0/975744828 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febbc133920 msgr2=0x7febbc133d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:39.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.906+0000 7febc25d5700 1 --2- 172.21.15.26:0/975744828 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febbc133920 0x7febbc133d80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7febb4009d90 tx=0x7febb400b330 comp rx=0 tx=0).stop 2023-10-01T07:54:39.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.906+0000 7febc25d5700 1 -- 172.21.15.26:0/975744828 shutdown_connections 2023-10-01T07:54:39.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.906+0000 7febc25d5700 1 --2- 172.21.15.26:0/975744828 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febbc133920 0x7febbc133d80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:39.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.906+0000 7febc25d5700 1 --2- 172.21.15.26:0/975744828 >> v2:172.21.15.26:3300/0 conn(0x7febbc0a0950 0x7febbc0a2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:39.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.906+0000 7febc25d5700 1 --2- 172.21.15.26:0/975744828 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febbc0a0d20 0x7febbc0a1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:39.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.906+0000 7febc25d5700 1 -- 172.21.15.26:0/975744828 >> 172.21.15.26:0/975744828 conn(0x7febbc0a2f70 msgr2=0x7febbc0a3370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:39.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.906+0000 7febc25d5700 1 -- 172.21.15.26:0/975744828 shutdown_connections 2023-10-01T07:54:39.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.906+0000 7febc25d5700 1 -- 172.21.15.26:0/975744828 wait complete. 2023-10-01T07:54:39.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.907+0000 7febc25d5700 1 Processor -- start 2023-10-01T07:54:39.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.907+0000 7febc25d5700 1 -- start start 2023-10-01T07:54:39.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.908+0000 7febc25d5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febbc0a0950 0x7febbc11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:39.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.908+0000 7febc25d5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febbc0a0d20 0x7febbc11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:39.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.908+0000 7febc25d5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febbc133920 0x7febbc11ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:39.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.908+0000 7febc25d5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febbc11f3c0 con 0x7febbc133920 2023-10-01T07:54:39.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.908+0000 7febc25d5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febbc121260 con 0x7febbc0a0d20 2023-10-01T07:54:39.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.908+0000 7febc25d5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febbc09b0d0 con 0x7febbc0a0950 2023-10-01T07:54:39.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.908+0000 7febbbfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febbc0a0950 0x7febbc11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:39.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.908+0000 7febbb7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febbc0a0d20 0x7febbc11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:39.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.908+0000 7febbbfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febbc0a0950 0x7febbc11df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44138/0 (socket says 172.21.15.26:44138) 2023-10-01T07:54:39.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.908+0000 7febbbfff700 1 -- 172.21.15.26:0/683346680 learned_addr learned my addr 172.21.15.26:0/683346680 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:39.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.908+0000 7febc0b72700 1 --2- 172.21.15.26:0/683346680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febbc133920 0x7febbc11ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:39.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.908+0000 7febbbfff700 1 -- 172.21.15.26:0/683346680 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febbc0a0d20 msgr2=0x7febbc11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:39.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.908+0000 7febbbfff700 1 --2- 172.21.15.26:0/683346680 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febbc0a0d20 0x7febbc11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:39.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.908+0000 7febbbfff700 1 -- 172.21.15.26:0/683346680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febbc133920 msgr2=0x7febbc11ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:39.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.908+0000 7febbbfff700 1 --2- 172.21.15.26:0/683346680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febbc133920 0x7febbc11ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:39.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.908+0000 7febbbfff700 1 -- 172.21.15.26:0/683346680 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb00094a0 con 0x7febbc0a0950 2023-10-01T07:54:39.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.908+0000 7febbb7fe700 1 --2- 172.21.15.26:0/683346680 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febbc0a0d20 0x7febbc11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:39.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.908+0000 7febbbfff700 1 --2- 172.21.15.26:0/683346680 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febbc0a0950 0x7febbc11df80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7febac00e960 tx=0x7febac00ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:39.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.909+0000 7febb8ff9700 1 -- 172.21.15.26:0/683346680 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac013680 con 0x7febbc0a0950 2023-10-01T07:54:39.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.909+0000 7febb8ff9700 1 -- 172.21.15.26:0/683346680 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febac0137e0 con 0x7febbc0a0950 2023-10-01T07:54:39.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.909+0000 7febc25d5700 1 -- 172.21.15.26:0/683346680 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febb4009a70 con 0x7febbc0a0950 2023-10-01T07:54:39.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.909+0000 7febb8ff9700 1 -- 172.21.15.26:0/683346680 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac013b50 con 0x7febbc0a0950 2023-10-01T07:54:39.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.909+0000 7febc25d5700 1 -- 172.21.15.26:0/683346680 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febbc121780 con 0x7febbc0a0950 2023-10-01T07:54:39.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.910+0000 7febb8ff9700 1 -- 172.21.15.26:0/683346680 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7febac013cb0 con 0x7febbc0a0950 2023-10-01T07:54:39.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.910+0000 7febb8ff9700 1 -- 172.21.15.26:0/683346680 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4092+0+0 (secure 0 0 0) 0x7febac03fb40 con 0x7febbc0a0950 2023-10-01T07:54:39.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.910+0000 7febc25d5700 1 -- 172.21.15.26:0/683346680 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febbc0a5730 con 0x7febbc0a0950 2023-10-01T07:54:39.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:39.915+0000 7febb8ff9700 1 -- 172.21.15.26:0/683346680 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7febac021080 con 0x7febbc0a0950 2023-10-01T07:54:40.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.121+0000 7febc25d5700 1 -- 172.21.15.26:0/683346680 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7febbc04f2a0 con 0x7febbc0a0950 2023-10-01T07:54:40.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.122+0000 7febb8ff9700 1 -- 172.21.15.26:0/683346680 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+13015 (secure 0 0 0) 0x7febac017020 con 0x7febbc0a0950 2023-10-01T07:54:40.122 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:54:40.123 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":34,"fsid":"c29fb19d-520c-42a6-90f4-e7f86de96e8e","created":"2023-10-01T07:51:40.702414+0000","modified":"2023-10-01T07:54:39.862636+0000","last_up_change":"2023-10-01T07:54:35.033170+0000","last_in_change":"2023-10-01T07:51:42.084736+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-01T07:51:48.906889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-01T07:51:50.071599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-01T07:51:54.981575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-01T07:51:56.286318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46569ce3-81d1-44a1-a649-691de3e6f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6800","nonce":129479}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6801","nonce":129479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6803","nonce":129479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6802","nonce":129479}]},"public_addr":"172.21.15.26:6800/129479","cluster_addr":"172.21.15.26:6801/129479","heartbeat_back_addr":"172.21.15.26:6803/129479","heartbeat_front_addr":"172.21.15.26:6802/129479","state":["exists","up"]},{"osd":1,"uuid":"1fc1ba9b-4110-4d31-96d6-794937578cff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6804","nonce":129577}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6805","nonce":129577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6807","nonce":129577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6806","nonce":129577}]},"public_addr":"172.21.15.26:6804/129577","cluster_addr":"172.21.15.26:6805/129577","heartbeat_back_addr":"172.21.15.26:6807/129577","heartbeat_front_addr":"172.21.15.26:6806/129577","state":["exists","up"]},{"osd":2,"uuid":"37de933d-3b8e-4b94-87bd-2f36896c7ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6808","nonce":129687}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6809","nonce":129687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6811","nonce":129687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6810","nonce":129687}]},"public_addr":"172.21.15.26:6808/129687","cluster_addr":"172.21.15.26:6809/129687","heartbeat_back_addr":"172.21.15.26:6811/129687","heartbeat_front_addr":"172.21.15.26:6810/129687","state":["exists","up"]},{"osd":3,"uuid":"bd020309-5fd2-4d97-b36a-67e159fa3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6812","nonce":130029}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6813","nonce":130029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6815","nonce":130029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6814","nonce":130029}]},"public_addr":"172.21.15.26:6812/130029","cluster_addr":"172.21.15.26:6813/130029","heartbeat_back_addr":"172.21.15.26:6815/130029","heartbeat_front_addr":"172.21.15.26:6814/130029","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.029993+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.266503+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.273540+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-10-01T07:54:29.008198+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.229731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.e","mappings":[{"from":3,"to":0}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.39","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/616154075":"2023-10-02T07:54:14.803384+0000","172.21.15.26:6817/2857714939":"2023-10-02T07:54:39.862609+0000","172.21.15.26:6816/118178":"2023-10-02T07:54:14.803384+0000","172.21.15.26:0/1290599107":"2023-10-02T07:54:14.803384+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-01T07:54:40.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.124+0000 7febc25d5700 1 -- 172.21.15.26:0/683346680 >> v1:172.21.15.26:6816/126763 conn(0x7feba802f510 legacy=0x7feba80319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:40.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.124+0000 7febc25d5700 1 -- 172.21.15.26:0/683346680 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febbc0a0950 msgr2=0x7febbc11df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:40.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.124+0000 7febc25d5700 1 --2- 172.21.15.26:0/683346680 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febbc0a0950 0x7febbc11df80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7febac00e960 tx=0x7febac00ec70 comp rx=0 tx=0).stop 2023-10-01T07:54:40.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.124+0000 7febc25d5700 1 -- 172.21.15.26:0/683346680 shutdown_connections 2023-10-01T07:54:40.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.124+0000 7febc25d5700 1 --2- 172.21.15.26:0/683346680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febbc133920 0x7febbc11ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:40.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.124+0000 7febc25d5700 1 --2- 172.21.15.26:0/683346680 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febbc0a0950 0x7febbc11df80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:40.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.124+0000 7febc25d5700 1 --2- 172.21.15.26:0/683346680 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febbc0a0d20 0x7febbc11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:40.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.124+0000 7febc25d5700 1 -- 172.21.15.26:0/683346680 >> 172.21.15.26:0/683346680 conn(0x7febbc0a2f70 msgr2=0x7febbc133000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:40.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.124+0000 7febc25d5700 1 -- 172.21.15.26:0/683346680 shutdown_connections 2023-10-01T07:54:40.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.124+0000 7febc25d5700 1 -- 172.21.15.26:0/683346680 wait complete. 2023-10-01T07:54:40.138 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-01T07:54:40.139 INFO:teuthology.run_tasks:Running task exec... 2023-10-01T07:54:40.148 INFO:teuthology.task.exec:Executing custom commands... 2023-10-01T07:54:40.148 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi026.front.sepia.ceph.com 2023-10-01T07:54:40.149 DEBUG:teuthology.orchestra.run.smithi026:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd dump -f json-pretty' 2023-10-01T07:54:40.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.281+0000 7f780ba59700 1 Processor -- start 2023-10-01T07:54:40.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.282+0000 7f780ba59700 1 -- start start 2023-10-01T07:54:40.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.282+0000 7f780ba59700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f780409c980 0x7f780409cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:40.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.282+0000 7f780ba59700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7804133600 0x7f7804133a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:40.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.282+0000 7f780ba59700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7804133f90 0x7f780413a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:40.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.282+0000 7f780ba59700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78040a1320 con 0x7f7804133f90 2023-10-01T07:54:40.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.282+0000 7f780ba59700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780409f250 con 0x7f780409c980 2023-10-01T07:54:40.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.282+0000 7f780ba59700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7804134400 con 0x7f7804133600 2023-10-01T07:54:40.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.282+0000 7f7808ff4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7804133600 0x7f7804133a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:40.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.282+0000 7f78097f5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f780409c980 0x7f780409cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:40.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.282+0000 7f7809ff6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7804133f90 0x7f780413a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:40.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.282+0000 7f7808ff4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7804133600 0x7f7804133a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44154/0 (socket says 172.21.15.26:44154) 2023-10-01T07:54:40.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.282+0000 7f7809ff6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7804133f90 0x7f780413a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53188/0 (socket says 172.21.15.26:53188) 2023-10-01T07:54:40.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.282+0000 7f7808ff4700 1 -- 172.21.15.26:0/139514115 learned_addr learned my addr 172.21.15.26:0/139514115 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:40.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.282+0000 7f78097f5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f780409c980 0x7f780409cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:56518/0 (socket says 172.21.15.26:56518) 2023-10-01T07:54:40.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.283+0000 7f7808ff4700 1 -- 172.21.15.26:0/139514115 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f780409c980 msgr2=0x7f780409cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:40.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.283+0000 7f7808ff4700 1 --2- 172.21.15.26:0/139514115 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f780409c980 0x7f780409cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:40.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.283+0000 7f7808ff4700 1 -- 172.21.15.26:0/139514115 >> v2:172.21.15.26:3300/0 conn(0x7f7804133f90 msgr2=0x7f780413a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:40.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.283+0000 7f7808ff4700 1 --2- 172.21.15.26:0/139514115 >> v2:172.21.15.26:3300/0 conn(0x7f7804133f90 0x7f780413a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:40.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.283+0000 7f7808ff4700 1 -- 172.21.15.26:0/139514115 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780409ebd0 con 0x7f7804133600 2023-10-01T07:54:40.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.283+0000 7f78097f5700 1 --2- 172.21.15.26:0/139514115 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f780409c980 0x7f780409cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:40.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.283+0000 7f7809ff6700 1 --2- 172.21.15.26:0/139514115 >> v2:172.21.15.26:3300/0 conn(0x7f7804133f90 0x7f780413a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:40.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.283+0000 7f7808ff4700 1 --2- 172.21.15.26:0/139514115 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7804133600 0x7f7804133a50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f77f40098f0 tx=0x7f77f4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=580bf80293605922 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:40.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.283+0000 7f77fbfff700 1 -- 172.21.15.26:0/139514115 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f4011830 con 0x7f7804133600 2023-10-01T07:54:40.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.283+0000 7f77fbfff700 1 -- 172.21.15.26:0/139514115 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f4011990 con 0x7f7804133600 2023-10-01T07:54:40.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.283+0000 7f77fbfff700 1 -- 172.21.15.26:0/139514115 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f4011d20 con 0x7f7804133600 2023-10-01T07:54:40.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.284+0000 7f780ba59700 1 -- 172.21.15.26:0/139514115 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7804133600 msgr2=0x7f7804133a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:40.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.284+0000 7f780ba59700 1 --2- 172.21.15.26:0/139514115 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7804133600 0x7f7804133a50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f77f40098f0 tx=0x7f77f4009c00 comp rx=0 tx=0).stop 2023-10-01T07:54:40.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.284+0000 7f780ba59700 1 -- 172.21.15.26:0/139514115 shutdown_connections 2023-10-01T07:54:40.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.284+0000 7f780ba59700 1 --2- 172.21.15.26:0/139514115 >> v2:172.21.15.26:3300/0 conn(0x7f7804133f90 0x7f780413a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:40.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.284+0000 7f780ba59700 1 --2- 172.21.15.26:0/139514115 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f780409c980 0x7f780409cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:40.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.284+0000 7f780ba59700 1 --2- 172.21.15.26:0/139514115 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7804133600 0x7f7804133a50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:40.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.284+0000 7f780ba59700 1 -- 172.21.15.26:0/139514115 >> 172.21.15.26:0/139514115 conn(0x7f78040a64c0 msgr2=0x7f78040a68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:40.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.284+0000 7f780ba59700 1 -- 172.21.15.26:0/139514115 shutdown_connections 2023-10-01T07:54:40.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.284+0000 7f780ba59700 1 -- 172.21.15.26:0/139514115 wait complete. 2023-10-01T07:54:40.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.285+0000 7f780ba59700 1 Processor -- start 2023-10-01T07:54:40.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.285+0000 7f780ba59700 1 -- start start 2023-10-01T07:54:40.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.285+0000 7f780ba59700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f780409c980 0x7f780412f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:40.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.285+0000 7f780ba59700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7804133600 0x7f780412fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:40.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.285+0000 7f780ba59700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7804133f90 0x7f7804130110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:40.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.285+0000 7f780ba59700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780412c870 con 0x7f7804133600 2023-10-01T07:54:40.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.285+0000 7f780ba59700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7804130710 con 0x7f780409c980 2023-10-01T07:54:40.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.285+0000 7f780ba59700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f780409e290 con 0x7f7804133f90 2023-10-01T07:54:40.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.285+0000 7f7808ff4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7804133600 0x7f780412fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:40.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.285+0000 7f7809ff6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7804133f90 0x7f7804130110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:40.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.285+0000 7f7808ff4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7804133600 0x7f780412fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53192/0 (socket says 172.21.15.26:53192) 2023-10-01T07:54:40.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.285+0000 7f7809ff6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7804133f90 0x7f7804130110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44160/0 (socket says 172.21.15.26:44160) 2023-10-01T07:54:40.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.285+0000 7f7808ff4700 1 -- 172.21.15.26:0/3356558192 learned_addr learned my addr 172.21.15.26:0/3356558192 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:40.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.285+0000 7f78097f5700 1 --2- 172.21.15.26:0/3356558192 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f780409c980 0x7f780412f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:40.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.286+0000 7f7808ff4700 1 -- 172.21.15.26:0/3356558192 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7804133f90 msgr2=0x7f7804130110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:40.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.286+0000 7f7808ff4700 1 --2- 172.21.15.26:0/3356558192 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7804133f90 0x7f7804130110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:40.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.286+0000 7f7808ff4700 1 -- 172.21.15.26:0/3356558192 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f780409c980 msgr2=0x7f780412f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:40.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.286+0000 7f7808ff4700 1 --2- 172.21.15.26:0/3356558192 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f780409c980 0x7f780412f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:40.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.286+0000 7f7808ff4700 1 -- 172.21.15.26:0/3356558192 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78000094a0 con 0x7f7804133600 2023-10-01T07:54:40.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.286+0000 7f7809ff6700 1 --2- 172.21.15.26:0/3356558192 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7804133f90 0x7f7804130110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:40.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.286+0000 7f78097f5700 1 --2- 172.21.15.26:0/3356558192 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f780409c980 0x7f780412f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:40.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.286+0000 7f7808ff4700 1 --2- 172.21.15.26:0/3356558192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7804133600 0x7f780412fbd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f77f4013000 tx=0x7f77f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:40.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.286+0000 7f77f9ffb700 1 -- 172.21.15.26:0/3356558192 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f4004450 con 0x7f7804133600 2023-10-01T07:54:40.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.286+0000 7f77f9ffb700 1 -- 172.21.15.26:0/3356558192 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f40045b0 con 0x7f7804133600 2023-10-01T07:54:40.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.286+0000 7f77f9ffb700 1 -- 172.21.15.26:0/3356558192 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f40038e0 con 0x7f7804133600 2023-10-01T07:54:40.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.286+0000 7f780ba59700 1 -- 172.21.15.26:0/3356558192 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77fc009a70 con 0x7f7804133600 2023-10-01T07:54:40.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.286+0000 7f780ba59700 1 -- 172.21.15.26:0/3356558192 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f4009550 con 0x7f7804133600 2023-10-01T07:54:40.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.287+0000 7f77f9ffb700 1 -- 172.21.15.26:0/3356558192 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f77f4021070 con 0x7f7804133600 2023-10-01T07:54:40.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.288+0000 7f77f9ffb700 1 -- 172.21.15.26:0/3356558192 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f77f4040da0 con 0x7f7804133600 2023-10-01T07:54:40.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.288+0000 7f780ba59700 1 -- 172.21.15.26:0/3356558192 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f780404f2a0 con 0x7f7804133600 2023-10-01T07:54:40.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.293+0000 7f77f9ffb700 1 -- 172.21.15.26:0/3356558192 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f77f4029020 con 0x7f7804133600 2023-10-01T07:54:40.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.496+0000 7f780ba59700 1 -- 172.21.15.26:0/3356558192 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f780409edf0 con 0x7f7804133600 2023-10-01T07:54:40.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.497+0000 7f77f9ffb700 1 -- 172.21.15.26:0/3356558192 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v34) v1 ==== 81+0+24342 (secure 0 0 0) 0x7f77f4032070 con 0x7f7804133600 2023-10-01T07:54:40.498 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:54:40.498 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-01T07:54:40.498 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 34, 2023-10-01T07:54:40.498 INFO:teuthology.orchestra.run.smithi026.stdout: "fsid": "c29fb19d-520c-42a6-90f4-e7f86de96e8e", 2023-10-01T07:54:40.498 INFO:teuthology.orchestra.run.smithi026.stdout: "created": "2023-10-01T07:51:40.702414+0000", 2023-10-01T07:54:40.498 INFO:teuthology.orchestra.run.smithi026.stdout: "modified": "2023-10-01T07:54:39.862636+0000", 2023-10-01T07:54:40.498 INFO:teuthology.orchestra.run.smithi026.stdout: "last_up_change": "2023-10-01T07:54:35.033170+0000", 2023-10-01T07:54:40.499 INFO:teuthology.orchestra.run.smithi026.stdout: "last_in_change": "2023-10-01T07:51:42.084736+0000", 2023-10-01T07:54:40.499 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-01T07:54:40.499 INFO:teuthology.orchestra.run.smithi026.stdout: "flags_num": 5799936, 2023-10-01T07:54:40.499 INFO:teuthology.orchestra.run.smithi026.stdout: "flags_set": [ 2023-10-01T07:54:40.499 INFO:teuthology.orchestra.run.smithi026.stdout: "pglog_hardlimit", 2023-10-01T07:54:40.499 INFO:teuthology.orchestra.run.smithi026.stdout: "purged_snapdirs", 2023-10-01T07:54:40.499 INFO:teuthology.orchestra.run.smithi026.stdout: "recovery_deletes", 2023-10-01T07:54:40.499 INFO:teuthology.orchestra.run.smithi026.stdout: "sortbitwise" 2023-10-01T07:54:40.499 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-10-01T07:54:40.499 INFO:teuthology.orchestra.run.smithi026.stdout: "crush_version": 8, 2023-10-01T07:54:40.499 INFO:teuthology.orchestra.run.smithi026.stdout: "full_ratio": 0.94999998807907104, 2023-10-01T07:54:40.500 INFO:teuthology.orchestra.run.smithi026.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-10-01T07:54:40.500 INFO:teuthology.orchestra.run.smithi026.stdout: "nearfull_ratio": 0.85000002384185791, 2023-10-01T07:54:40.500 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_snapshot": "", 2023-10-01T07:54:40.500 INFO:teuthology.orchestra.run.smithi026.stdout: "pool_max": 4, 2023-10-01T07:54:40.500 INFO:teuthology.orchestra.run.smithi026.stdout: "max_osd": 4, 2023-10-01T07:54:40.500 INFO:teuthology.orchestra.run.smithi026.stdout: "require_min_compat_client": "pacific", 2023-10-01T07:54:40.500 INFO:teuthology.orchestra.run.smithi026.stdout: "min_compat_client": "luminous", 2023-10-01T07:54:40.500 INFO:teuthology.orchestra.run.smithi026.stdout: "require_osd_release": "pacific", 2023-10-01T07:54:40.500 INFO:teuthology.orchestra.run.smithi026.stdout: "allow_crimson": false, 2023-10-01T07:54:40.501 INFO:teuthology.orchestra.run.smithi026.stdout: "pools": [ 2023-10-01T07:54:40.501 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.501 INFO:teuthology.orchestra.run.smithi026.stdout: "pool": 1, 2023-10-01T07:54:40.501 INFO:teuthology.orchestra.run.smithi026.stdout: "pool_name": ".mgr", 2023-10-01T07:54:40.501 INFO:teuthology.orchestra.run.smithi026.stdout: "create_time": "2023-10-01T07:51:48.906889+0000", 2023-10-01T07:54:40.501 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-10-01T07:54:40.502 INFO:teuthology.orchestra.run.smithi026.stdout: "flags_names": "hashpspool", 2023-10-01T07:54:40.502 INFO:teuthology.orchestra.run.smithi026.stdout: "type": 1, 2023-10-01T07:54:40.502 INFO:teuthology.orchestra.run.smithi026.stdout: "size": 2, 2023-10-01T07:54:40.502 INFO:teuthology.orchestra.run.smithi026.stdout: "min_size": 1, 2023-10-01T07:54:40.502 INFO:teuthology.orchestra.run.smithi026.stdout: "crush_rule": 0, 2023-10-01T07:54:40.502 INFO:teuthology.orchestra.run.smithi026.stdout: "peering_crush_bucket_count": 0, 2023-10-01T07:54:40.503 INFO:teuthology.orchestra.run.smithi026.stdout: "peering_crush_bucket_target": 0, 2023-10-01T07:54:40.503 INFO:teuthology.orchestra.run.smithi026.stdout: "peering_crush_bucket_barrier": 0, 2023-10-01T07:54:40.503 INFO:teuthology.orchestra.run.smithi026.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-01T07:54:40.503 INFO:teuthology.orchestra.run.smithi026.stdout: "object_hash": 2, 2023-10-01T07:54:40.503 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_autoscale_mode": "off", 2023-10-01T07:54:40.503 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_num": 1, 2023-10-01T07:54:40.504 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_placement_num": 1, 2023-10-01T07:54:40.504 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_placement_num_target": 1, 2023-10-01T07:54:40.504 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_num_target": 1, 2023-10-01T07:54:40.504 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_num_pending": 1, 2023-10-01T07:54:40.504 INFO:teuthology.orchestra.run.smithi026.stdout: "last_pg_merge_meta": { 2023-10-01T07:54:40.504 INFO:teuthology.orchestra.run.smithi026.stdout: "source_pgid": "0.0", 2023-10-01T07:54:40.504 INFO:teuthology.orchestra.run.smithi026.stdout: "ready_epoch": 0, 2023-10-01T07:54:40.504 INFO:teuthology.orchestra.run.smithi026.stdout: "last_epoch_started": 0, 2023-10-01T07:54:40.505 INFO:teuthology.orchestra.run.smithi026.stdout: "last_epoch_clean": 0, 2023-10-01T07:54:40.505 INFO:teuthology.orchestra.run.smithi026.stdout: "source_version": "0'0", 2023-10-01T07:54:40.505 INFO:teuthology.orchestra.run.smithi026.stdout: "target_version": "0'0" 2023-10-01T07:54:40.505 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.505 INFO:teuthology.orchestra.run.smithi026.stdout: "last_change": "23", 2023-10-01T07:54:40.505 INFO:teuthology.orchestra.run.smithi026.stdout: "last_force_op_resend": "0", 2023-10-01T07:54:40.506 INFO:teuthology.orchestra.run.smithi026.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-01T07:54:40.506 INFO:teuthology.orchestra.run.smithi026.stdout: "last_force_op_resend_preluminous": "0", 2023-10-01T07:54:40.506 INFO:teuthology.orchestra.run.smithi026.stdout: "auid": 0, 2023-10-01T07:54:40.506 INFO:teuthology.orchestra.run.smithi026.stdout: "snap_mode": "selfmanaged", 2023-10-01T07:54:40.506 INFO:teuthology.orchestra.run.smithi026.stdout: "snap_seq": 0, 2023-10-01T07:54:40.506 INFO:teuthology.orchestra.run.smithi026.stdout: "snap_epoch": 0, 2023-10-01T07:54:40.507 INFO:teuthology.orchestra.run.smithi026.stdout: "pool_snaps": [], 2023-10-01T07:54:40.507 INFO:teuthology.orchestra.run.smithi026.stdout: "removed_snaps": "[]", 2023-10-01T07:54:40.507 INFO:teuthology.orchestra.run.smithi026.stdout: "quota_max_bytes": 0, 2023-10-01T07:54:40.507 INFO:teuthology.orchestra.run.smithi026.stdout: "quota_max_objects": 0, 2023-10-01T07:54:40.507 INFO:teuthology.orchestra.run.smithi026.stdout: "tiers": [], 2023-10-01T07:54:40.507 INFO:teuthology.orchestra.run.smithi026.stdout: "tier_of": -1, 2023-10-01T07:54:40.508 INFO:teuthology.orchestra.run.smithi026.stdout: "read_tier": -1, 2023-10-01T07:54:40.508 INFO:teuthology.orchestra.run.smithi026.stdout: "write_tier": -1, 2023-10-01T07:54:40.508 INFO:teuthology.orchestra.run.smithi026.stdout: "cache_mode": "none", 2023-10-01T07:54:40.508 INFO:teuthology.orchestra.run.smithi026.stdout: "target_max_bytes": 0, 2023-10-01T07:54:40.508 INFO:teuthology.orchestra.run.smithi026.stdout: "target_max_objects": 0, 2023-10-01T07:54:40.508 INFO:teuthology.orchestra.run.smithi026.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-01T07:54:40.508 INFO:teuthology.orchestra.run.smithi026.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-01T07:54:40.508 INFO:teuthology.orchestra.run.smithi026.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-01T07:54:40.508 INFO:teuthology.orchestra.run.smithi026.stdout: "cache_min_flush_age": 0, 2023-10-01T07:54:40.509 INFO:teuthology.orchestra.run.smithi026.stdout: "cache_min_evict_age": 0, 2023-10-01T07:54:40.509 INFO:teuthology.orchestra.run.smithi026.stdout: "erasure_code_profile": "", 2023-10-01T07:54:40.509 INFO:teuthology.orchestra.run.smithi026.stdout: "hit_set_params": { 2023-10-01T07:54:40.509 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "none" 2023-10-01T07:54:40.509 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.509 INFO:teuthology.orchestra.run.smithi026.stdout: "hit_set_period": 0, 2023-10-01T07:54:40.509 INFO:teuthology.orchestra.run.smithi026.stdout: "hit_set_count": 0, 2023-10-01T07:54:40.509 INFO:teuthology.orchestra.run.smithi026.stdout: "use_gmt_hitset": true, 2023-10-01T07:54:40.509 INFO:teuthology.orchestra.run.smithi026.stdout: "min_read_recency_for_promote": 0, 2023-10-01T07:54:40.509 INFO:teuthology.orchestra.run.smithi026.stdout: "min_write_recency_for_promote": 0, 2023-10-01T07:54:40.510 INFO:teuthology.orchestra.run.smithi026.stdout: "hit_set_grade_decay_rate": 0, 2023-10-01T07:54:40.510 INFO:teuthology.orchestra.run.smithi026.stdout: "hit_set_search_last_n": 0, 2023-10-01T07:54:40.510 INFO:teuthology.orchestra.run.smithi026.stdout: "grade_table": [], 2023-10-01T07:54:40.510 INFO:teuthology.orchestra.run.smithi026.stdout: "stripe_width": 0, 2023-10-01T07:54:40.510 INFO:teuthology.orchestra.run.smithi026.stdout: "expected_num_objects": 0, 2023-10-01T07:54:40.510 INFO:teuthology.orchestra.run.smithi026.stdout: "fast_read": false, 2023-10-01T07:54:40.510 INFO:teuthology.orchestra.run.smithi026.stdout: "options": { 2023-10-01T07:54:40.510 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_num_max": 32, 2023-10-01T07:54:40.510 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_num_min": 1 2023-10-01T07:54:40.510 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.510 INFO:teuthology.orchestra.run.smithi026.stdout: "application_metadata": { 2023-10-01T07:54:40.511 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": {}, 2023-10-01T07:54:40.511 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr_devicehealth": {} 2023-10-01T07:54:40.511 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.511 INFO:teuthology.orchestra.run.smithi026.stdout: "read_balance": { 2023-10-01T07:54:40.511 INFO:teuthology.orchestra.run.smithi026.stdout: "score_acting": 4, 2023-10-01T07:54:40.511 INFO:teuthology.orchestra.run.smithi026.stdout: "score_stable": 4, 2023-10-01T07:54:40.511 INFO:teuthology.orchestra.run.smithi026.stdout: "optimal_score": 0.5, 2023-10-01T07:54:40.511 INFO:teuthology.orchestra.run.smithi026.stdout: "raw_score_acting": 2, 2023-10-01T07:54:40.511 INFO:teuthology.orchestra.run.smithi026.stdout: "raw_score_stable": 2, 2023-10-01T07:54:40.511 INFO:teuthology.orchestra.run.smithi026.stdout: "primary_affinity_weighted": 1, 2023-10-01T07:54:40.511 INFO:teuthology.orchestra.run.smithi026.stdout: "average_primary_affinity": 1, 2023-10-01T07:54:40.511 INFO:teuthology.orchestra.run.smithi026.stdout: "average_primary_affinity_weighted": 1 2023-10-01T07:54:40.512 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.512 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.512 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.512 INFO:teuthology.orchestra.run.smithi026.stdout: "pool": 2, 2023-10-01T07:54:40.512 INFO:teuthology.orchestra.run.smithi026.stdout: "pool_name": "rbd", 2023-10-01T07:54:40.512 INFO:teuthology.orchestra.run.smithi026.stdout: "create_time": "2023-10-01T07:51:50.071599+0000", 2023-10-01T07:54:40.512 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-10-01T07:54:40.512 INFO:teuthology.orchestra.run.smithi026.stdout: "flags_names": "hashpspool", 2023-10-01T07:54:40.512 INFO:teuthology.orchestra.run.smithi026.stdout: "type": 1, 2023-10-01T07:54:40.512 INFO:teuthology.orchestra.run.smithi026.stdout: "size": 2, 2023-10-01T07:54:40.512 INFO:teuthology.orchestra.run.smithi026.stdout: "min_size": 1, 2023-10-01T07:54:40.512 INFO:teuthology.orchestra.run.smithi026.stdout: "crush_rule": 0, 2023-10-01T07:54:40.512 INFO:teuthology.orchestra.run.smithi026.stdout: "peering_crush_bucket_count": 0, 2023-10-01T07:54:40.513 INFO:teuthology.orchestra.run.smithi026.stdout: "peering_crush_bucket_target": 0, 2023-10-01T07:54:40.513 INFO:teuthology.orchestra.run.smithi026.stdout: "peering_crush_bucket_barrier": 0, 2023-10-01T07:54:40.513 INFO:teuthology.orchestra.run.smithi026.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-01T07:54:40.513 INFO:teuthology.orchestra.run.smithi026.stdout: "object_hash": 2, 2023-10-01T07:54:40.513 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_autoscale_mode": "off", 2023-10-01T07:54:40.513 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_num": 8, 2023-10-01T07:54:40.513 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_placement_num": 8, 2023-10-01T07:54:40.513 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_placement_num_target": 8, 2023-10-01T07:54:40.513 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_num_target": 8, 2023-10-01T07:54:40.513 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_num_pending": 8, 2023-10-01T07:54:40.513 INFO:teuthology.orchestra.run.smithi026.stdout: "last_pg_merge_meta": { 2023-10-01T07:54:40.514 INFO:teuthology.orchestra.run.smithi026.stdout: "source_pgid": "0.0", 2023-10-01T07:54:40.514 INFO:teuthology.orchestra.run.smithi026.stdout: "ready_epoch": 0, 2023-10-01T07:54:40.514 INFO:teuthology.orchestra.run.smithi026.stdout: "last_epoch_started": 0, 2023-10-01T07:54:40.514 INFO:teuthology.orchestra.run.smithi026.stdout: "last_epoch_clean": 0, 2023-10-01T07:54:40.514 INFO:teuthology.orchestra.run.smithi026.stdout: "source_version": "0'0", 2023-10-01T07:54:40.514 INFO:teuthology.orchestra.run.smithi026.stdout: "target_version": "0'0" 2023-10-01T07:54:40.514 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.514 INFO:teuthology.orchestra.run.smithi026.stdout: "last_change": "13", 2023-10-01T07:54:40.514 INFO:teuthology.orchestra.run.smithi026.stdout: "last_force_op_resend": "0", 2023-10-01T07:54:40.514 INFO:teuthology.orchestra.run.smithi026.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-01T07:54:40.514 INFO:teuthology.orchestra.run.smithi026.stdout: "last_force_op_resend_preluminous": "0", 2023-10-01T07:54:40.515 INFO:teuthology.orchestra.run.smithi026.stdout: "auid": 0, 2023-10-01T07:54:40.515 INFO:teuthology.orchestra.run.smithi026.stdout: "snap_mode": "selfmanaged", 2023-10-01T07:54:40.515 INFO:teuthology.orchestra.run.smithi026.stdout: "snap_seq": 0, 2023-10-01T07:54:40.515 INFO:teuthology.orchestra.run.smithi026.stdout: "snap_epoch": 0, 2023-10-01T07:54:40.515 INFO:teuthology.orchestra.run.smithi026.stdout: "pool_snaps": [], 2023-10-01T07:54:40.515 INFO:teuthology.orchestra.run.smithi026.stdout: "removed_snaps": "[]", 2023-10-01T07:54:40.515 INFO:teuthology.orchestra.run.smithi026.stdout: "quota_max_bytes": 0, 2023-10-01T07:54:40.515 INFO:teuthology.orchestra.run.smithi026.stdout: "quota_max_objects": 0, 2023-10-01T07:54:40.515 INFO:teuthology.orchestra.run.smithi026.stdout: "tiers": [], 2023-10-01T07:54:40.515 INFO:teuthology.orchestra.run.smithi026.stdout: "tier_of": -1, 2023-10-01T07:54:40.515 INFO:teuthology.orchestra.run.smithi026.stdout: "read_tier": -1, 2023-10-01T07:54:40.516 INFO:teuthology.orchestra.run.smithi026.stdout: "write_tier": -1, 2023-10-01T07:54:40.516 INFO:teuthology.orchestra.run.smithi026.stdout: "cache_mode": "none", 2023-10-01T07:54:40.516 INFO:teuthology.orchestra.run.smithi026.stdout: "target_max_bytes": 0, 2023-10-01T07:54:40.516 INFO:teuthology.orchestra.run.smithi026.stdout: "target_max_objects": 0, 2023-10-01T07:54:40.516 INFO:teuthology.orchestra.run.smithi026.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-01T07:54:40.516 INFO:teuthology.orchestra.run.smithi026.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-01T07:54:40.516 INFO:teuthology.orchestra.run.smithi026.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-01T07:54:40.516 INFO:teuthology.orchestra.run.smithi026.stdout: "cache_min_flush_age": 0, 2023-10-01T07:54:40.516 INFO:teuthology.orchestra.run.smithi026.stdout: "cache_min_evict_age": 0, 2023-10-01T07:54:40.516 INFO:teuthology.orchestra.run.smithi026.stdout: "erasure_code_profile": "", 2023-10-01T07:54:40.516 INFO:teuthology.orchestra.run.smithi026.stdout: "hit_set_params": { 2023-10-01T07:54:40.516 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "none" 2023-10-01T07:54:40.517 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.517 INFO:teuthology.orchestra.run.smithi026.stdout: "hit_set_period": 0, 2023-10-01T07:54:40.517 INFO:teuthology.orchestra.run.smithi026.stdout: "hit_set_count": 0, 2023-10-01T07:54:40.517 INFO:teuthology.orchestra.run.smithi026.stdout: "use_gmt_hitset": true, 2023-10-01T07:54:40.517 INFO:teuthology.orchestra.run.smithi026.stdout: "min_read_recency_for_promote": 0, 2023-10-01T07:54:40.517 INFO:teuthology.orchestra.run.smithi026.stdout: "min_write_recency_for_promote": 0, 2023-10-01T07:54:40.517 INFO:teuthology.orchestra.run.smithi026.stdout: "hit_set_grade_decay_rate": 0, 2023-10-01T07:54:40.517 INFO:teuthology.orchestra.run.smithi026.stdout: "hit_set_search_last_n": 0, 2023-10-01T07:54:40.517 INFO:teuthology.orchestra.run.smithi026.stdout: "grade_table": [], 2023-10-01T07:54:40.517 INFO:teuthology.orchestra.run.smithi026.stdout: "stripe_width": 0, 2023-10-01T07:54:40.517 INFO:teuthology.orchestra.run.smithi026.stdout: "expected_num_objects": 0, 2023-10-01T07:54:40.517 INFO:teuthology.orchestra.run.smithi026.stdout: "fast_read": false, 2023-10-01T07:54:40.517 INFO:teuthology.orchestra.run.smithi026.stdout: "options": {}, 2023-10-01T07:54:40.518 INFO:teuthology.orchestra.run.smithi026.stdout: "application_metadata": { 2023-10-01T07:54:40.518 INFO:teuthology.orchestra.run.smithi026.stdout: "rbd": {} 2023-10-01T07:54:40.518 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.518 INFO:teuthology.orchestra.run.smithi026.stdout: "read_balance": { 2023-10-01T07:54:40.518 INFO:teuthology.orchestra.run.smithi026.stdout: "score_acting": 2.5, 2023-10-01T07:54:40.518 INFO:teuthology.orchestra.run.smithi026.stdout: "score_stable": 2.5, 2023-10-01T07:54:40.518 INFO:teuthology.orchestra.run.smithi026.stdout: "optimal_score": 1, 2023-10-01T07:54:40.518 INFO:teuthology.orchestra.run.smithi026.stdout: "raw_score_acting": 2.5, 2023-10-01T07:54:40.518 INFO:teuthology.orchestra.run.smithi026.stdout: "raw_score_stable": 2.5, 2023-10-01T07:54:40.518 INFO:teuthology.orchestra.run.smithi026.stdout: "primary_affinity_weighted": 1, 2023-10-01T07:54:40.518 INFO:teuthology.orchestra.run.smithi026.stdout: "average_primary_affinity": 1, 2023-10-01T07:54:40.519 INFO:teuthology.orchestra.run.smithi026.stdout: "average_primary_affinity_weighted": 1 2023-10-01T07:54:40.519 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.519 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.519 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.519 INFO:teuthology.orchestra.run.smithi026.stdout: "pool": 3, 2023-10-01T07:54:40.519 INFO:teuthology.orchestra.run.smithi026.stdout: "pool_name": "cephfs_metadata", 2023-10-01T07:54:40.519 INFO:teuthology.orchestra.run.smithi026.stdout: "create_time": "2023-10-01T07:51:54.981575+0000", 2023-10-01T07:54:40.519 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-10-01T07:54:40.519 INFO:teuthology.orchestra.run.smithi026.stdout: "flags_names": "hashpspool", 2023-10-01T07:54:40.519 INFO:teuthology.orchestra.run.smithi026.stdout: "type": 1, 2023-10-01T07:54:40.520 INFO:teuthology.orchestra.run.smithi026.stdout: "size": 2, 2023-10-01T07:54:40.520 INFO:teuthology.orchestra.run.smithi026.stdout: "min_size": 1, 2023-10-01T07:54:40.520 INFO:teuthology.orchestra.run.smithi026.stdout: "crush_rule": 0, 2023-10-01T07:54:40.520 INFO:teuthology.orchestra.run.smithi026.stdout: "peering_crush_bucket_count": 0, 2023-10-01T07:54:40.520 INFO:teuthology.orchestra.run.smithi026.stdout: "peering_crush_bucket_target": 0, 2023-10-01T07:54:40.520 INFO:teuthology.orchestra.run.smithi026.stdout: "peering_crush_bucket_barrier": 0, 2023-10-01T07:54:40.520 INFO:teuthology.orchestra.run.smithi026.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-01T07:54:40.520 INFO:teuthology.orchestra.run.smithi026.stdout: "object_hash": 2, 2023-10-01T07:54:40.520 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_autoscale_mode": "off", 2023-10-01T07:54:40.520 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_num": 32, 2023-10-01T07:54:40.520 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_placement_num": 32, 2023-10-01T07:54:40.520 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_placement_num_target": 32, 2023-10-01T07:54:40.521 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_num_target": 32, 2023-10-01T07:54:40.521 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_num_pending": 32, 2023-10-01T07:54:40.521 INFO:teuthology.orchestra.run.smithi026.stdout: "last_pg_merge_meta": { 2023-10-01T07:54:40.521 INFO:teuthology.orchestra.run.smithi026.stdout: "source_pgid": "0.0", 2023-10-01T07:54:40.521 INFO:teuthology.orchestra.run.smithi026.stdout: "ready_epoch": 0, 2023-10-01T07:54:40.521 INFO:teuthology.orchestra.run.smithi026.stdout: "last_epoch_started": 0, 2023-10-01T07:54:40.521 INFO:teuthology.orchestra.run.smithi026.stdout: "last_epoch_clean": 0, 2023-10-01T07:54:40.521 INFO:teuthology.orchestra.run.smithi026.stdout: "source_version": "0'0", 2023-10-01T07:54:40.521 INFO:teuthology.orchestra.run.smithi026.stdout: "target_version": "0'0" 2023-10-01T07:54:40.521 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.521 INFO:teuthology.orchestra.run.smithi026.stdout: "last_change": "16", 2023-10-01T07:54:40.521 INFO:teuthology.orchestra.run.smithi026.stdout: "last_force_op_resend": "0", 2023-10-01T07:54:40.522 INFO:teuthology.orchestra.run.smithi026.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-01T07:54:40.522 INFO:teuthology.orchestra.run.smithi026.stdout: "last_force_op_resend_preluminous": "0", 2023-10-01T07:54:40.522 INFO:teuthology.orchestra.run.smithi026.stdout: "auid": 0, 2023-10-01T07:54:40.522 INFO:teuthology.orchestra.run.smithi026.stdout: "snap_mode": "selfmanaged", 2023-10-01T07:54:40.522 INFO:teuthology.orchestra.run.smithi026.stdout: "snap_seq": 0, 2023-10-01T07:54:40.522 INFO:teuthology.orchestra.run.smithi026.stdout: "snap_epoch": 0, 2023-10-01T07:54:40.522 INFO:teuthology.orchestra.run.smithi026.stdout: "pool_snaps": [], 2023-10-01T07:54:40.522 INFO:teuthology.orchestra.run.smithi026.stdout: "removed_snaps": "[]", 2023-10-01T07:54:40.522 INFO:teuthology.orchestra.run.smithi026.stdout: "quota_max_bytes": 0, 2023-10-01T07:54:40.522 INFO:teuthology.orchestra.run.smithi026.stdout: "quota_max_objects": 0, 2023-10-01T07:54:40.522 INFO:teuthology.orchestra.run.smithi026.stdout: "tiers": [], 2023-10-01T07:54:40.522 INFO:teuthology.orchestra.run.smithi026.stdout: "tier_of": -1, 2023-10-01T07:54:40.523 INFO:teuthology.orchestra.run.smithi026.stdout: "read_tier": -1, 2023-10-01T07:54:40.523 INFO:teuthology.orchestra.run.smithi026.stdout: "write_tier": -1, 2023-10-01T07:54:40.523 INFO:teuthology.orchestra.run.smithi026.stdout: "cache_mode": "none", 2023-10-01T07:54:40.523 INFO:teuthology.orchestra.run.smithi026.stdout: "target_max_bytes": 0, 2023-10-01T07:54:40.523 INFO:teuthology.orchestra.run.smithi026.stdout: "target_max_objects": 0, 2023-10-01T07:54:40.523 INFO:teuthology.orchestra.run.smithi026.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-01T07:54:40.523 INFO:teuthology.orchestra.run.smithi026.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-01T07:54:40.523 INFO:teuthology.orchestra.run.smithi026.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-01T07:54:40.523 INFO:teuthology.orchestra.run.smithi026.stdout: "cache_min_flush_age": 0, 2023-10-01T07:54:40.523 INFO:teuthology.orchestra.run.smithi026.stdout: "cache_min_evict_age": 0, 2023-10-01T07:54:40.523 INFO:teuthology.orchestra.run.smithi026.stdout: "erasure_code_profile": "", 2023-10-01T07:54:40.523 INFO:teuthology.orchestra.run.smithi026.stdout: "hit_set_params": { 2023-10-01T07:54:40.524 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "none" 2023-10-01T07:54:40.524 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.524 INFO:teuthology.orchestra.run.smithi026.stdout: "hit_set_period": 0, 2023-10-01T07:54:40.524 INFO:teuthology.orchestra.run.smithi026.stdout: "hit_set_count": 0, 2023-10-01T07:54:40.524 INFO:teuthology.orchestra.run.smithi026.stdout: "use_gmt_hitset": true, 2023-10-01T07:54:40.524 INFO:teuthology.orchestra.run.smithi026.stdout: "min_read_recency_for_promote": 0, 2023-10-01T07:54:40.524 INFO:teuthology.orchestra.run.smithi026.stdout: "min_write_recency_for_promote": 0, 2023-10-01T07:54:40.524 INFO:teuthology.orchestra.run.smithi026.stdout: "hit_set_grade_decay_rate": 0, 2023-10-01T07:54:40.524 INFO:teuthology.orchestra.run.smithi026.stdout: "hit_set_search_last_n": 0, 2023-10-01T07:54:40.524 INFO:teuthology.orchestra.run.smithi026.stdout: "grade_table": [], 2023-10-01T07:54:40.524 INFO:teuthology.orchestra.run.smithi026.stdout: "stripe_width": 0, 2023-10-01T07:54:40.524 INFO:teuthology.orchestra.run.smithi026.stdout: "expected_num_objects": 0, 2023-10-01T07:54:40.524 INFO:teuthology.orchestra.run.smithi026.stdout: "fast_read": false, 2023-10-01T07:54:40.525 INFO:teuthology.orchestra.run.smithi026.stdout: "options": { 2023-10-01T07:54:40.525 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_autoscale_bias": 4, 2023-10-01T07:54:40.525 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_num_min": 16, 2023-10-01T07:54:40.525 INFO:teuthology.orchestra.run.smithi026.stdout: "recovery_priority": 5 2023-10-01T07:54:40.525 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.525 INFO:teuthology.orchestra.run.smithi026.stdout: "application_metadata": { 2023-10-01T07:54:40.525 INFO:teuthology.orchestra.run.smithi026.stdout: "cephfs": { 2023-10-01T07:54:40.525 INFO:teuthology.orchestra.run.smithi026.stdout: "metadata": "cephfs" 2023-10-01T07:54:40.525 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.525 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.525 INFO:teuthology.orchestra.run.smithi026.stdout: "read_balance": { 2023-10-01T07:54:40.525 INFO:teuthology.orchestra.run.smithi026.stdout: "score_acting": 1.6299999952316284, 2023-10-01T07:54:40.525 INFO:teuthology.orchestra.run.smithi026.stdout: "score_stable": 1.6299999952316284, 2023-10-01T07:54:40.526 INFO:teuthology.orchestra.run.smithi026.stdout: "optimal_score": 1, 2023-10-01T07:54:40.526 INFO:teuthology.orchestra.run.smithi026.stdout: "raw_score_acting": 1.6299999952316284, 2023-10-01T07:54:40.526 INFO:teuthology.orchestra.run.smithi026.stdout: "raw_score_stable": 1.6299999952316284, 2023-10-01T07:54:40.526 INFO:teuthology.orchestra.run.smithi026.stdout: "primary_affinity_weighted": 1, 2023-10-01T07:54:40.526 INFO:teuthology.orchestra.run.smithi026.stdout: "average_primary_affinity": 1, 2023-10-01T07:54:40.526 INFO:teuthology.orchestra.run.smithi026.stdout: "average_primary_affinity_weighted": 1 2023-10-01T07:54:40.526 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.526 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.526 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.526 INFO:teuthology.orchestra.run.smithi026.stdout: "pool": 4, 2023-10-01T07:54:40.526 INFO:teuthology.orchestra.run.smithi026.stdout: "pool_name": "cephfs_data", 2023-10-01T07:54:40.526 INFO:teuthology.orchestra.run.smithi026.stdout: "create_time": "2023-10-01T07:51:56.286318+0000", 2023-10-01T07:54:40.527 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-10-01T07:54:40.527 INFO:teuthology.orchestra.run.smithi026.stdout: "flags_names": "hashpspool", 2023-10-01T07:54:40.527 INFO:teuthology.orchestra.run.smithi026.stdout: "type": 1, 2023-10-01T07:54:40.527 INFO:teuthology.orchestra.run.smithi026.stdout: "size": 2, 2023-10-01T07:54:40.527 INFO:teuthology.orchestra.run.smithi026.stdout: "min_size": 1, 2023-10-01T07:54:40.527 INFO:teuthology.orchestra.run.smithi026.stdout: "crush_rule": 0, 2023-10-01T07:54:40.527 INFO:teuthology.orchestra.run.smithi026.stdout: "peering_crush_bucket_count": 0, 2023-10-01T07:54:40.527 INFO:teuthology.orchestra.run.smithi026.stdout: "peering_crush_bucket_target": 0, 2023-10-01T07:54:40.527 INFO:teuthology.orchestra.run.smithi026.stdout: "peering_crush_bucket_barrier": 0, 2023-10-01T07:54:40.527 INFO:teuthology.orchestra.run.smithi026.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-01T07:54:40.527 INFO:teuthology.orchestra.run.smithi026.stdout: "object_hash": 2, 2023-10-01T07:54:40.527 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_autoscale_mode": "off", 2023-10-01T07:54:40.527 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_num": 64, 2023-10-01T07:54:40.528 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_placement_num": 64, 2023-10-01T07:54:40.528 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_placement_num_target": 64, 2023-10-01T07:54:40.528 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_num_target": 64, 2023-10-01T07:54:40.528 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_num_pending": 64, 2023-10-01T07:54:40.528 INFO:teuthology.orchestra.run.smithi026.stdout: "last_pg_merge_meta": { 2023-10-01T07:54:40.528 INFO:teuthology.orchestra.run.smithi026.stdout: "source_pgid": "0.0", 2023-10-01T07:54:40.528 INFO:teuthology.orchestra.run.smithi026.stdout: "ready_epoch": 0, 2023-10-01T07:54:40.528 INFO:teuthology.orchestra.run.smithi026.stdout: "last_epoch_started": 0, 2023-10-01T07:54:40.528 INFO:teuthology.orchestra.run.smithi026.stdout: "last_epoch_clean": 0, 2023-10-01T07:54:40.528 INFO:teuthology.orchestra.run.smithi026.stdout: "source_version": "0'0", 2023-10-01T07:54:40.528 INFO:teuthology.orchestra.run.smithi026.stdout: "target_version": "0'0" 2023-10-01T07:54:40.528 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.528 INFO:teuthology.orchestra.run.smithi026.stdout: "last_change": "17", 2023-10-01T07:54:40.529 INFO:teuthology.orchestra.run.smithi026.stdout: "last_force_op_resend": "0", 2023-10-01T07:54:40.529 INFO:teuthology.orchestra.run.smithi026.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-01T07:54:40.529 INFO:teuthology.orchestra.run.smithi026.stdout: "last_force_op_resend_preluminous": "0", 2023-10-01T07:54:40.529 INFO:teuthology.orchestra.run.smithi026.stdout: "auid": 0, 2023-10-01T07:54:40.529 INFO:teuthology.orchestra.run.smithi026.stdout: "snap_mode": "selfmanaged", 2023-10-01T07:54:40.529 INFO:teuthology.orchestra.run.smithi026.stdout: "snap_seq": 0, 2023-10-01T07:54:40.529 INFO:teuthology.orchestra.run.smithi026.stdout: "snap_epoch": 0, 2023-10-01T07:54:40.529 INFO:teuthology.orchestra.run.smithi026.stdout: "pool_snaps": [], 2023-10-01T07:54:40.529 INFO:teuthology.orchestra.run.smithi026.stdout: "removed_snaps": "[]", 2023-10-01T07:54:40.529 INFO:teuthology.orchestra.run.smithi026.stdout: "quota_max_bytes": 0, 2023-10-01T07:54:40.529 INFO:teuthology.orchestra.run.smithi026.stdout: "quota_max_objects": 0, 2023-10-01T07:54:40.529 INFO:teuthology.orchestra.run.smithi026.stdout: "tiers": [], 2023-10-01T07:54:40.530 INFO:teuthology.orchestra.run.smithi026.stdout: "tier_of": -1, 2023-10-01T07:54:40.530 INFO:teuthology.orchestra.run.smithi026.stdout: "read_tier": -1, 2023-10-01T07:54:40.530 INFO:teuthology.orchestra.run.smithi026.stdout: "write_tier": -1, 2023-10-01T07:54:40.530 INFO:teuthology.orchestra.run.smithi026.stdout: "cache_mode": "none", 2023-10-01T07:54:40.530 INFO:teuthology.orchestra.run.smithi026.stdout: "target_max_bytes": 0, 2023-10-01T07:54:40.530 INFO:teuthology.orchestra.run.smithi026.stdout: "target_max_objects": 0, 2023-10-01T07:54:40.530 INFO:teuthology.orchestra.run.smithi026.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-01T07:54:40.530 INFO:teuthology.orchestra.run.smithi026.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-01T07:54:40.530 INFO:teuthology.orchestra.run.smithi026.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-01T07:54:40.530 INFO:teuthology.orchestra.run.smithi026.stdout: "cache_min_flush_age": 0, 2023-10-01T07:54:40.530 INFO:teuthology.orchestra.run.smithi026.stdout: "cache_min_evict_age": 0, 2023-10-01T07:54:40.530 INFO:teuthology.orchestra.run.smithi026.stdout: "erasure_code_profile": "", 2023-10-01T07:54:40.530 INFO:teuthology.orchestra.run.smithi026.stdout: "hit_set_params": { 2023-10-01T07:54:40.531 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "none" 2023-10-01T07:54:40.531 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.531 INFO:teuthology.orchestra.run.smithi026.stdout: "hit_set_period": 0, 2023-10-01T07:54:40.531 INFO:teuthology.orchestra.run.smithi026.stdout: "hit_set_count": 0, 2023-10-01T07:54:40.531 INFO:teuthology.orchestra.run.smithi026.stdout: "use_gmt_hitset": true, 2023-10-01T07:54:40.531 INFO:teuthology.orchestra.run.smithi026.stdout: "min_read_recency_for_promote": 0, 2023-10-01T07:54:40.531 INFO:teuthology.orchestra.run.smithi026.stdout: "min_write_recency_for_promote": 0, 2023-10-01T07:54:40.531 INFO:teuthology.orchestra.run.smithi026.stdout: "hit_set_grade_decay_rate": 0, 2023-10-01T07:54:40.531 INFO:teuthology.orchestra.run.smithi026.stdout: "hit_set_search_last_n": 0, 2023-10-01T07:54:40.531 INFO:teuthology.orchestra.run.smithi026.stdout: "grade_table": [], 2023-10-01T07:54:40.533 INFO:teuthology.orchestra.run.smithi026.stdout: "stripe_width": 0, 2023-10-01T07:54:40.533 INFO:teuthology.orchestra.run.smithi026.stdout: "expected_num_objects": 0, 2023-10-01T07:54:40.533 INFO:teuthology.orchestra.run.smithi026.stdout: "fast_read": false, 2023-10-01T07:54:40.533 INFO:teuthology.orchestra.run.smithi026.stdout: "options": { 2023-10-01T07:54:40.533 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_num_min": 64, 2023-10-01T07:54:40.533 INFO:teuthology.orchestra.run.smithi026.stdout: "target_size_ratio": 0.89999997615814209 2023-10-01T07:54:40.533 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.533 INFO:teuthology.orchestra.run.smithi026.stdout: "application_metadata": { 2023-10-01T07:54:40.533 INFO:teuthology.orchestra.run.smithi026.stdout: "cephfs": { 2023-10-01T07:54:40.534 INFO:teuthology.orchestra.run.smithi026.stdout: "data": "cephfs" 2023-10-01T07:54:40.534 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.534 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.534 INFO:teuthology.orchestra.run.smithi026.stdout: "read_balance": { 2023-10-01T07:54:40.534 INFO:teuthology.orchestra.run.smithi026.stdout: "score_acting": 1.1299999952316284, 2023-10-01T07:54:40.534 INFO:teuthology.orchestra.run.smithi026.stdout: "score_stable": 1.1299999952316284, 2023-10-01T07:54:40.534 INFO:teuthology.orchestra.run.smithi026.stdout: "optimal_score": 1, 2023-10-01T07:54:40.534 INFO:teuthology.orchestra.run.smithi026.stdout: "raw_score_acting": 1.1299999952316284, 2023-10-01T07:54:40.534 INFO:teuthology.orchestra.run.smithi026.stdout: "raw_score_stable": 1.1299999952316284, 2023-10-01T07:54:40.534 INFO:teuthology.orchestra.run.smithi026.stdout: "primary_affinity_weighted": 1, 2023-10-01T07:54:40.535 INFO:teuthology.orchestra.run.smithi026.stdout: "average_primary_affinity": 1, 2023-10-01T07:54:40.535 INFO:teuthology.orchestra.run.smithi026.stdout: "average_primary_affinity_weighted": 1 2023-10-01T07:54:40.535 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.535 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.535 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-10-01T07:54:40.535 INFO:teuthology.orchestra.run.smithi026.stdout: "osds": [ 2023-10-01T07:54:40.535 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.535 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": 0, 2023-10-01T07:54:40.535 INFO:teuthology.orchestra.run.smithi026.stdout: "uuid": "46569ce3-81d1-44a1-a649-691de3e6f808", 2023-10-01T07:54:40.535 INFO:teuthology.orchestra.run.smithi026.stdout: "up": 1, 2023-10-01T07:54:40.536 INFO:teuthology.orchestra.run.smithi026.stdout: "in": 1, 2023-10-01T07:54:40.536 INFO:teuthology.orchestra.run.smithi026.stdout: "weight": 1, 2023-10-01T07:54:40.536 INFO:teuthology.orchestra.run.smithi026.stdout: "primary_affinity": 1, 2023-10-01T07:54:40.536 INFO:teuthology.orchestra.run.smithi026.stdout: "last_clean_begin": 9, 2023-10-01T07:54:40.536 INFO:teuthology.orchestra.run.smithi026.stdout: "last_clean_end": 23, 2023-10-01T07:54:40.536 INFO:teuthology.orchestra.run.smithi026.stdout: "up_from": 29, 2023-10-01T07:54:40.536 INFO:teuthology.orchestra.run.smithi026.stdout: "up_thru": 32, 2023-10-01T07:54:40.536 INFO:teuthology.orchestra.run.smithi026.stdout: "down_at": 24, 2023-10-01T07:54:40.536 INFO:teuthology.orchestra.run.smithi026.stdout: "lost_at": 0, 2023-10-01T07:54:40.536 INFO:teuthology.orchestra.run.smithi026.stdout: "public_addrs": { 2023-10-01T07:54:40.537 INFO:teuthology.orchestra.run.smithi026.stdout: "addrvec": [ 2023-10-01T07:54:40.537 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.537 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-10-01T07:54:40.537 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "172.21.15.26:6800", 2023-10-01T07:54:40.537 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 129479 2023-10-01T07:54:40.537 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.537 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-01T07:54:40.537 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.537 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_addrs": { 2023-10-01T07:54:40.537 INFO:teuthology.orchestra.run.smithi026.stdout: "addrvec": [ 2023-10-01T07:54:40.538 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.538 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-10-01T07:54:40.538 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "172.21.15.26:6801", 2023-10-01T07:54:40.538 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 129479 2023-10-01T07:54:40.538 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.538 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-01T07:54:40.538 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.538 INFO:teuthology.orchestra.run.smithi026.stdout: "heartbeat_back_addrs": { 2023-10-01T07:54:40.538 INFO:teuthology.orchestra.run.smithi026.stdout: "addrvec": [ 2023-10-01T07:54:40.538 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.538 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-10-01T07:54:40.539 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "172.21.15.26:6803", 2023-10-01T07:54:40.539 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 129479 2023-10-01T07:54:40.539 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.539 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-01T07:54:40.539 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.539 INFO:teuthology.orchestra.run.smithi026.stdout: "heartbeat_front_addrs": { 2023-10-01T07:54:40.539 INFO:teuthology.orchestra.run.smithi026.stdout: "addrvec": [ 2023-10-01T07:54:40.539 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.539 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-10-01T07:54:40.539 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "172.21.15.26:6802", 2023-10-01T07:54:40.540 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 129479 2023-10-01T07:54:40.540 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.540 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-01T07:54:40.540 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.540 INFO:teuthology.orchestra.run.smithi026.stdout: "public_addr": "172.21.15.26:6800/129479", 2023-10-01T07:54:40.540 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_addr": "172.21.15.26:6801/129479", 2023-10-01T07:54:40.540 INFO:teuthology.orchestra.run.smithi026.stdout: "heartbeat_back_addr": "172.21.15.26:6803/129479", 2023-10-01T07:54:40.540 INFO:teuthology.orchestra.run.smithi026.stdout: "heartbeat_front_addr": "172.21.15.26:6802/129479", 2023-10-01T07:54:40.540 INFO:teuthology.orchestra.run.smithi026.stdout: "state": [ 2023-10-01T07:54:40.540 INFO:teuthology.orchestra.run.smithi026.stdout: "exists", 2023-10-01T07:54:40.540 INFO:teuthology.orchestra.run.smithi026.stdout: "up" 2023-10-01T07:54:40.541 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-01T07:54:40.541 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.541 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.541 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": 1, 2023-10-01T07:54:40.541 INFO:teuthology.orchestra.run.smithi026.stdout: "uuid": "1fc1ba9b-4110-4d31-96d6-794937578cff", 2023-10-01T07:54:40.541 INFO:teuthology.orchestra.run.smithi026.stdout: "up": 1, 2023-10-01T07:54:40.541 INFO:teuthology.orchestra.run.smithi026.stdout: "in": 1, 2023-10-01T07:54:40.541 INFO:teuthology.orchestra.run.smithi026.stdout: "weight": 1, 2023-10-01T07:54:40.541 INFO:teuthology.orchestra.run.smithi026.stdout: "primary_affinity": 1, 2023-10-01T07:54:40.541 INFO:teuthology.orchestra.run.smithi026.stdout: "last_clean_begin": 9, 2023-10-01T07:54:40.542 INFO:teuthology.orchestra.run.smithi026.stdout: "last_clean_end": 24, 2023-10-01T07:54:40.542 INFO:teuthology.orchestra.run.smithi026.stdout: "up_from": 30, 2023-10-01T07:54:40.542 INFO:teuthology.orchestra.run.smithi026.stdout: "up_thru": 32, 2023-10-01T07:54:40.542 INFO:teuthology.orchestra.run.smithi026.stdout: "down_at": 25, 2023-10-01T07:54:40.542 INFO:teuthology.orchestra.run.smithi026.stdout: "lost_at": 0, 2023-10-01T07:54:40.542 INFO:teuthology.orchestra.run.smithi026.stdout: "public_addrs": { 2023-10-01T07:54:40.542 INFO:teuthology.orchestra.run.smithi026.stdout: "addrvec": [ 2023-10-01T07:54:40.542 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.542 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-10-01T07:54:40.542 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "172.21.15.26:6804", 2023-10-01T07:54:40.543 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 129577 2023-10-01T07:54:40.543 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.543 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-01T07:54:40.543 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.543 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_addrs": { 2023-10-01T07:54:40.543 INFO:teuthology.orchestra.run.smithi026.stdout: "addrvec": [ 2023-10-01T07:54:40.543 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.543 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-10-01T07:54:40.543 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "172.21.15.26:6805", 2023-10-01T07:54:40.543 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 129577 2023-10-01T07:54:40.544 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.544 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-01T07:54:40.544 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.544 INFO:teuthology.orchestra.run.smithi026.stdout: "heartbeat_back_addrs": { 2023-10-01T07:54:40.544 INFO:teuthology.orchestra.run.smithi026.stdout: "addrvec": [ 2023-10-01T07:54:40.544 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.544 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-10-01T07:54:40.544 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "172.21.15.26:6807", 2023-10-01T07:54:40.544 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 129577 2023-10-01T07:54:40.544 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.544 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-01T07:54:40.545 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.545 INFO:teuthology.orchestra.run.smithi026.stdout: "heartbeat_front_addrs": { 2023-10-01T07:54:40.545 INFO:teuthology.orchestra.run.smithi026.stdout: "addrvec": [ 2023-10-01T07:54:40.545 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.545 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-10-01T07:54:40.545 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "172.21.15.26:6806", 2023-10-01T07:54:40.545 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 129577 2023-10-01T07:54:40.545 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.545 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-01T07:54:40.545 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.546 INFO:teuthology.orchestra.run.smithi026.stdout: "public_addr": "172.21.15.26:6804/129577", 2023-10-01T07:54:40.546 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_addr": "172.21.15.26:6805/129577", 2023-10-01T07:54:40.546 INFO:teuthology.orchestra.run.smithi026.stdout: "heartbeat_back_addr": "172.21.15.26:6807/129577", 2023-10-01T07:54:40.546 INFO:teuthology.orchestra.run.smithi026.stdout: "heartbeat_front_addr": "172.21.15.26:6806/129577", 2023-10-01T07:54:40.546 INFO:teuthology.orchestra.run.smithi026.stdout: "state": [ 2023-10-01T07:54:40.546 INFO:teuthology.orchestra.run.smithi026.stdout: "exists", 2023-10-01T07:54:40.546 INFO:teuthology.orchestra.run.smithi026.stdout: "up" 2023-10-01T07:54:40.546 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-01T07:54:40.546 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.546 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.547 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": 2, 2023-10-01T07:54:40.547 INFO:teuthology.orchestra.run.smithi026.stdout: "uuid": "37de933d-3b8e-4b94-87bd-2f36896c7ff5", 2023-10-01T07:54:40.547 INFO:teuthology.orchestra.run.smithi026.stdout: "up": 1, 2023-10-01T07:54:40.547 INFO:teuthology.orchestra.run.smithi026.stdout: "in": 1, 2023-10-01T07:54:40.547 INFO:teuthology.orchestra.run.smithi026.stdout: "weight": 1, 2023-10-01T07:54:40.547 INFO:teuthology.orchestra.run.smithi026.stdout: "primary_affinity": 1, 2023-10-01T07:54:40.547 INFO:teuthology.orchestra.run.smithi026.stdout: "last_clean_begin": 9, 2023-10-01T07:54:40.547 INFO:teuthology.orchestra.run.smithi026.stdout: "last_clean_end": 25, 2023-10-01T07:54:40.547 INFO:teuthology.orchestra.run.smithi026.stdout: "up_from": 31, 2023-10-01T07:54:40.547 INFO:teuthology.orchestra.run.smithi026.stdout: "up_thru": 32, 2023-10-01T07:54:40.548 INFO:teuthology.orchestra.run.smithi026.stdout: "down_at": 26, 2023-10-01T07:54:40.548 INFO:teuthology.orchestra.run.smithi026.stdout: "lost_at": 0, 2023-10-01T07:54:40.548 INFO:teuthology.orchestra.run.smithi026.stdout: "public_addrs": { 2023-10-01T07:54:40.548 INFO:teuthology.orchestra.run.smithi026.stdout: "addrvec": [ 2023-10-01T07:54:40.548 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.548 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-10-01T07:54:40.548 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "172.21.15.26:6808", 2023-10-01T07:54:40.548 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 129687 2023-10-01T07:54:40.548 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.548 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-01T07:54:40.549 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.549 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_addrs": { 2023-10-01T07:54:40.549 INFO:teuthology.orchestra.run.smithi026.stdout: "addrvec": [ 2023-10-01T07:54:40.549 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.549 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-10-01T07:54:40.549 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "172.21.15.26:6809", 2023-10-01T07:54:40.549 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 129687 2023-10-01T07:54:40.549 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.549 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-01T07:54:40.549 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.550 INFO:teuthology.orchestra.run.smithi026.stdout: "heartbeat_back_addrs": { 2023-10-01T07:54:40.550 INFO:teuthology.orchestra.run.smithi026.stdout: "addrvec": [ 2023-10-01T07:54:40.550 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.550 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-10-01T07:54:40.550 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "172.21.15.26:6811", 2023-10-01T07:54:40.550 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 129687 2023-10-01T07:54:40.550 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.550 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-01T07:54:40.550 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.551 INFO:teuthology.orchestra.run.smithi026.stdout: "heartbeat_front_addrs": { 2023-10-01T07:54:40.551 INFO:teuthology.orchestra.run.smithi026.stdout: "addrvec": [ 2023-10-01T07:54:40.551 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.551 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-10-01T07:54:40.551 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "172.21.15.26:6810", 2023-10-01T07:54:40.551 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 129687 2023-10-01T07:54:40.551 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.551 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-01T07:54:40.551 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.551 INFO:teuthology.orchestra.run.smithi026.stdout: "public_addr": "172.21.15.26:6808/129687", 2023-10-01T07:54:40.551 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_addr": "172.21.15.26:6809/129687", 2023-10-01T07:54:40.552 INFO:teuthology.orchestra.run.smithi026.stdout: "heartbeat_back_addr": "172.21.15.26:6811/129687", 2023-10-01T07:54:40.552 INFO:teuthology.orchestra.run.smithi026.stdout: "heartbeat_front_addr": "172.21.15.26:6810/129687", 2023-10-01T07:54:40.552 INFO:teuthology.orchestra.run.smithi026.stdout: "state": [ 2023-10-01T07:54:40.552 INFO:teuthology.orchestra.run.smithi026.stdout: "exists", 2023-10-01T07:54:40.552 INFO:teuthology.orchestra.run.smithi026.stdout: "up" 2023-10-01T07:54:40.552 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-01T07:54:40.552 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.552 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.552 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": 3, 2023-10-01T07:54:40.553 INFO:teuthology.orchestra.run.smithi026.stdout: "uuid": "bd020309-5fd2-4d97-b36a-67e159fa3ebf", 2023-10-01T07:54:40.553 INFO:teuthology.orchestra.run.smithi026.stdout: "up": 1, 2023-10-01T07:54:40.553 INFO:teuthology.orchestra.run.smithi026.stdout: "in": 1, 2023-10-01T07:54:40.553 INFO:teuthology.orchestra.run.smithi026.stdout: "weight": 1, 2023-10-01T07:54:40.553 INFO:teuthology.orchestra.run.smithi026.stdout: "primary_affinity": 1, 2023-10-01T07:54:40.553 INFO:teuthology.orchestra.run.smithi026.stdout: "last_clean_begin": 9, 2023-10-01T07:54:40.553 INFO:teuthology.orchestra.run.smithi026.stdout: "last_clean_end": 26, 2023-10-01T07:54:40.553 INFO:teuthology.orchestra.run.smithi026.stdout: "up_from": 32, 2023-10-01T07:54:40.553 INFO:teuthology.orchestra.run.smithi026.stdout: "up_thru": 32, 2023-10-01T07:54:40.553 INFO:teuthology.orchestra.run.smithi026.stdout: "down_at": 27, 2023-10-01T07:54:40.554 INFO:teuthology.orchestra.run.smithi026.stdout: "lost_at": 0, 2023-10-01T07:54:40.554 INFO:teuthology.orchestra.run.smithi026.stdout: "public_addrs": { 2023-10-01T07:54:40.554 INFO:teuthology.orchestra.run.smithi026.stdout: "addrvec": [ 2023-10-01T07:54:40.554 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.554 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-10-01T07:54:40.554 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "172.21.15.26:6812", 2023-10-01T07:54:40.554 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 130029 2023-10-01T07:54:40.554 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.554 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-01T07:54:40.555 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.555 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_addrs": { 2023-10-01T07:54:40.555 INFO:teuthology.orchestra.run.smithi026.stdout: "addrvec": [ 2023-10-01T07:54:40.555 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.555 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-10-01T07:54:40.555 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "172.21.15.26:6813", 2023-10-01T07:54:40.555 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 130029 2023-10-01T07:54:40.555 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.555 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-01T07:54:40.555 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.556 INFO:teuthology.orchestra.run.smithi026.stdout: "heartbeat_back_addrs": { 2023-10-01T07:54:40.556 INFO:teuthology.orchestra.run.smithi026.stdout: "addrvec": [ 2023-10-01T07:54:40.556 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.556 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-10-01T07:54:40.556 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "172.21.15.26:6815", 2023-10-01T07:54:40.556 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 130029 2023-10-01T07:54:40.556 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.556 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-01T07:54:40.556 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.556 INFO:teuthology.orchestra.run.smithi026.stdout: "heartbeat_front_addrs": { 2023-10-01T07:54:40.557 INFO:teuthology.orchestra.run.smithi026.stdout: "addrvec": [ 2023-10-01T07:54:40.557 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.557 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-10-01T07:54:40.557 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "172.21.15.26:6814", 2023-10-01T07:54:40.557 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 130029 2023-10-01T07:54:40.557 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.557 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-01T07:54:40.557 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.557 INFO:teuthology.orchestra.run.smithi026.stdout: "public_addr": "172.21.15.26:6812/130029", 2023-10-01T07:54:40.557 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_addr": "172.21.15.26:6813/130029", 2023-10-01T07:54:40.558 INFO:teuthology.orchestra.run.smithi026.stdout: "heartbeat_back_addr": "172.21.15.26:6815/130029", 2023-10-01T07:54:40.558 INFO:teuthology.orchestra.run.smithi026.stdout: "heartbeat_front_addr": "172.21.15.26:6814/130029", 2023-10-01T07:54:40.558 INFO:teuthology.orchestra.run.smithi026.stdout: "state": [ 2023-10-01T07:54:40.558 INFO:teuthology.orchestra.run.smithi026.stdout: "exists", 2023-10-01T07:54:40.558 INFO:teuthology.orchestra.run.smithi026.stdout: "up" 2023-10-01T07:54:40.558 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-01T07:54:40.558 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.558 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-10-01T07:54:40.558 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_xinfo": [ 2023-10-01T07:54:40.559 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.559 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": 0, 2023-10-01T07:54:40.559 INFO:teuthology.orchestra.run.smithi026.stdout: "down_stamp": "0.000000", 2023-10-01T07:54:40.559 INFO:teuthology.orchestra.run.smithi026.stdout: "laggy_probability": 0, 2023-10-01T07:54:40.559 INFO:teuthology.orchestra.run.smithi026.stdout: "laggy_interval": 0, 2023-10-01T07:54:40.559 INFO:teuthology.orchestra.run.smithi026.stdout: "features": 4540138322906710015, 2023-10-01T07:54:40.559 INFO:teuthology.orchestra.run.smithi026.stdout: "old_weight": 0, 2023-10-01T07:54:40.559 INFO:teuthology.orchestra.run.smithi026.stdout: "last_purged_snaps_scrub": "2023-10-01T07:51:47.029993+0000", 2023-10-01T07:54:40.559 INFO:teuthology.orchestra.run.smithi026.stdout: "dead_epoch": 24 2023-10-01T07:54:40.560 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.560 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.560 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": 1, 2023-10-01T07:54:40.560 INFO:teuthology.orchestra.run.smithi026.stdout: "down_stamp": "0.000000", 2023-10-01T07:54:40.560 INFO:teuthology.orchestra.run.smithi026.stdout: "laggy_probability": 0, 2023-10-01T07:54:40.560 INFO:teuthology.orchestra.run.smithi026.stdout: "laggy_interval": 0, 2023-10-01T07:54:40.560 INFO:teuthology.orchestra.run.smithi026.stdout: "features": 4540138322906710015, 2023-10-01T07:54:40.560 INFO:teuthology.orchestra.run.smithi026.stdout: "old_weight": 0, 2023-10-01T07:54:40.560 INFO:teuthology.orchestra.run.smithi026.stdout: "last_purged_snaps_scrub": "2023-10-01T07:51:47.266503+0000", 2023-10-01T07:54:40.560 INFO:teuthology.orchestra.run.smithi026.stdout: "dead_epoch": 25 2023-10-01T07:54:40.561 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.561 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.561 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": 2, 2023-10-01T07:54:40.561 INFO:teuthology.orchestra.run.smithi026.stdout: "down_stamp": "0.000000", 2023-10-01T07:54:40.561 INFO:teuthology.orchestra.run.smithi026.stdout: "laggy_probability": 0, 2023-10-01T07:54:40.561 INFO:teuthology.orchestra.run.smithi026.stdout: "laggy_interval": 0, 2023-10-01T07:54:40.561 INFO:teuthology.orchestra.run.smithi026.stdout: "features": 4540138322906710015, 2023-10-01T07:54:40.561 INFO:teuthology.orchestra.run.smithi026.stdout: "old_weight": 0, 2023-10-01T07:54:40.561 INFO:teuthology.orchestra.run.smithi026.stdout: "last_purged_snaps_scrub": "2023-10-01T07:51:47.273540+0000", 2023-10-01T07:54:40.561 INFO:teuthology.orchestra.run.smithi026.stdout: "dead_epoch": 26 2023-10-01T07:54:40.562 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.562 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.562 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": 3, 2023-10-01T07:54:40.562 INFO:teuthology.orchestra.run.smithi026.stdout: "down_stamp": "2023-10-01T07:54:29.008198+0000", 2023-10-01T07:54:40.562 INFO:teuthology.orchestra.run.smithi026.stdout: "laggy_probability": 0, 2023-10-01T07:54:40.562 INFO:teuthology.orchestra.run.smithi026.stdout: "laggy_interval": 0, 2023-10-01T07:54:40.562 INFO:teuthology.orchestra.run.smithi026.stdout: "features": 4540138322906710015, 2023-10-01T07:54:40.562 INFO:teuthology.orchestra.run.smithi026.stdout: "old_weight": 0, 2023-10-01T07:54:40.562 INFO:teuthology.orchestra.run.smithi026.stdout: "last_purged_snaps_scrub": "2023-10-01T07:51:47.229731+0000", 2023-10-01T07:54:40.562 INFO:teuthology.orchestra.run.smithi026.stdout: "dead_epoch": 0 2023-10-01T07:54:40.563 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.563 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-10-01T07:54:40.563 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_upmap": [], 2023-10-01T07:54:40.563 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_upmap_items": [ 2023-10-01T07:54:40.563 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.563 INFO:teuthology.orchestra.run.smithi026.stdout: "pgid": "4.0", 2023-10-01T07:54:40.563 INFO:teuthology.orchestra.run.smithi026.stdout: "mappings": [ 2023-10-01T07:54:40.563 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.563 INFO:teuthology.orchestra.run.smithi026.stdout: "from": 3, 2023-10-01T07:54:40.563 INFO:teuthology.orchestra.run.smithi026.stdout: "to": 2 2023-10-01T07:54:40.563 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.564 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-01T07:54:40.564 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.564 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.564 INFO:teuthology.orchestra.run.smithi026.stdout: "pgid": "4.5", 2023-10-01T07:54:40.564 INFO:teuthology.orchestra.run.smithi026.stdout: "mappings": [ 2023-10-01T07:54:40.564 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.564 INFO:teuthology.orchestra.run.smithi026.stdout: "from": 3, 2023-10-01T07:54:40.564 INFO:teuthology.orchestra.run.smithi026.stdout: "to": 2 2023-10-01T07:54:40.564 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.564 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-01T07:54:40.564 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.565 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.565 INFO:teuthology.orchestra.run.smithi026.stdout: "pgid": "4.7", 2023-10-01T07:54:40.565 INFO:teuthology.orchestra.run.smithi026.stdout: "mappings": [ 2023-10-01T07:54:40.565 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.565 INFO:teuthology.orchestra.run.smithi026.stdout: "from": 1, 2023-10-01T07:54:40.565 INFO:teuthology.orchestra.run.smithi026.stdout: "to": 2 2023-10-01T07:54:40.565 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.565 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-01T07:54:40.565 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.565 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.566 INFO:teuthology.orchestra.run.smithi026.stdout: "pgid": "4.a", 2023-10-01T07:54:40.566 INFO:teuthology.orchestra.run.smithi026.stdout: "mappings": [ 2023-10-01T07:54:40.566 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.566 INFO:teuthology.orchestra.run.smithi026.stdout: "from": 3, 2023-10-01T07:54:40.566 INFO:teuthology.orchestra.run.smithi026.stdout: "to": 0 2023-10-01T07:54:40.566 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.566 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-01T07:54:40.566 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.566 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.566 INFO:teuthology.orchestra.run.smithi026.stdout: "pgid": "4.e", 2023-10-01T07:54:40.567 INFO:teuthology.orchestra.run.smithi026.stdout: "mappings": [ 2023-10-01T07:54:40.567 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.567 INFO:teuthology.orchestra.run.smithi026.stdout: "from": 3, 2023-10-01T07:54:40.567 INFO:teuthology.orchestra.run.smithi026.stdout: "to": 0 2023-10-01T07:54:40.567 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.567 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-01T07:54:40.567 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.567 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.567 INFO:teuthology.orchestra.run.smithi026.stdout: "pgid": "4.1b", 2023-10-01T07:54:40.567 INFO:teuthology.orchestra.run.smithi026.stdout: "mappings": [ 2023-10-01T07:54:40.567 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.568 INFO:teuthology.orchestra.run.smithi026.stdout: "from": 3, 2023-10-01T07:54:40.568 INFO:teuthology.orchestra.run.smithi026.stdout: "to": 0 2023-10-01T07:54:40.568 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.568 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-01T07:54:40.568 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.568 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.568 INFO:teuthology.orchestra.run.smithi026.stdout: "pgid": "4.21", 2023-10-01T07:54:40.568 INFO:teuthology.orchestra.run.smithi026.stdout: "mappings": [ 2023-10-01T07:54:40.568 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.568 INFO:teuthology.orchestra.run.smithi026.stdout: "from": 3, 2023-10-01T07:54:40.568 INFO:teuthology.orchestra.run.smithi026.stdout: "to": 2 2023-10-01T07:54:40.569 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.569 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-01T07:54:40.569 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.569 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.569 INFO:teuthology.orchestra.run.smithi026.stdout: "pgid": "4.39", 2023-10-01T07:54:40.569 INFO:teuthology.orchestra.run.smithi026.stdout: "mappings": [ 2023-10-01T07:54:40.569 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-10-01T07:54:40.569 INFO:teuthology.orchestra.run.smithi026.stdout: "from": 3, 2023-10-01T07:54:40.569 INFO:teuthology.orchestra.run.smithi026.stdout: "to": 2 2023-10-01T07:54:40.569 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.569 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-10-01T07:54:40.570 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.570 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-10-01T07:54:40.570 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_upmap_primaries": [], 2023-10-01T07:54:40.570 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_temp": [], 2023-10-01T07:54:40.570 INFO:teuthology.orchestra.run.smithi026.stdout: "primary_temp": [], 2023-10-01T07:54:40.570 INFO:teuthology.orchestra.run.smithi026.stdout: "blocklist": { 2023-10-01T07:54:40.570 INFO:teuthology.orchestra.run.smithi026.stdout: "172.21.15.26:0/616154075": "2023-10-02T07:54:14.803384+0000", 2023-10-01T07:54:40.570 INFO:teuthology.orchestra.run.smithi026.stdout: "172.21.15.26:6817/2857714939": "2023-10-02T07:54:39.862609+0000", 2023-10-01T07:54:40.570 INFO:teuthology.orchestra.run.smithi026.stdout: "172.21.15.26:6816/118178": "2023-10-02T07:54:14.803384+0000", 2023-10-01T07:54:40.570 INFO:teuthology.orchestra.run.smithi026.stdout: "172.21.15.26:0/1290599107": "2023-10-02T07:54:14.803384+0000" 2023-10-01T07:54:40.571 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.571 INFO:teuthology.orchestra.run.smithi026.stdout: "range_blocklist": {}, 2023-10-01T07:54:40.571 INFO:teuthology.orchestra.run.smithi026.stdout: "erasure_code_profiles": { 2023-10-01T07:54:40.571 INFO:teuthology.orchestra.run.smithi026.stdout: "default": { 2023-10-01T07:54:40.571 INFO:teuthology.orchestra.run.smithi026.stdout: "crush-failure-domain": "osd", 2023-10-01T07:54:40.571 INFO:teuthology.orchestra.run.smithi026.stdout: "k": "2", 2023-10-01T07:54:40.571 INFO:teuthology.orchestra.run.smithi026.stdout: "m": "1", 2023-10-01T07:54:40.571 INFO:teuthology.orchestra.run.smithi026.stdout: "plugin": "jerasure", 2023-10-01T07:54:40.571 INFO:teuthology.orchestra.run.smithi026.stdout: "technique": "reed_sol_van" 2023-10-01T07:54:40.571 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.571 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:40.572 INFO:teuthology.orchestra.run.smithi026.stdout: "removed_snaps_queue": [], 2023-10-01T07:54:40.572 INFO:teuthology.orchestra.run.smithi026.stdout: "new_removed_snaps": [], 2023-10-01T07:54:40.572 INFO:teuthology.orchestra.run.smithi026.stdout: "new_purged_snaps": [], 2023-10-01T07:54:40.572 INFO:teuthology.orchestra.run.smithi026.stdout: "crush_node_flags": {}, 2023-10-01T07:54:40.572 INFO:teuthology.orchestra.run.smithi026.stdout: "device_class_flags": {}, 2023-10-01T07:54:40.572 INFO:teuthology.orchestra.run.smithi026.stdout: "stretch_mode": { 2023-10-01T07:54:40.572 INFO:teuthology.orchestra.run.smithi026.stdout: "stretch_mode_enabled": false, 2023-10-01T07:54:40.572 INFO:teuthology.orchestra.run.smithi026.stdout: "stretch_bucket_count": 0, 2023-10-01T07:54:40.572 INFO:teuthology.orchestra.run.smithi026.stdout: "degraded_stretch_mode": 0, 2023-10-01T07:54:40.572 INFO:teuthology.orchestra.run.smithi026.stdout: "recovering_stretch_mode": 0, 2023-10-01T07:54:40.572 INFO:teuthology.orchestra.run.smithi026.stdout: "stretch_mode_bucket": 0 2023-10-01T07:54:40.573 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:40.573 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-01T07:54:40.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.499+0000 7f780ba59700 1 -- 172.21.15.26:0/3356558192 >> v1:172.21.15.26:6816/126763 conn(0x7f77e802f540 legacy=0x7f77e80319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:40.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.499+0000 7f780ba59700 1 -- 172.21.15.26:0/3356558192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7804133600 msgr2=0x7f780412fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:40.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.499+0000 7f780ba59700 1 --2- 172.21.15.26:0/3356558192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7804133600 0x7f780412fbd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f77f4013000 tx=0x7f77f4004750 comp rx=0 tx=0).stop 2023-10-01T07:54:40.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.499+0000 7f780ba59700 1 -- 172.21.15.26:0/3356558192 shutdown_connections 2023-10-01T07:54:40.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.499+0000 7f780ba59700 1 --2- 172.21.15.26:0/3356558192 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7804133f90 0x7f7804130110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:40.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.499+0000 7f780ba59700 1 --2- 172.21.15.26:0/3356558192 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f780409c980 0x7f780412f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:40.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.499+0000 7f780ba59700 1 --2- 172.21.15.26:0/3356558192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7804133600 0x7f780412fbd0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:40.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.500+0000 7f780ba59700 1 -- 172.21.15.26:0/3356558192 >> 172.21.15.26:0/3356558192 conn(0x7f78040a64c0 msgr2=0x7f7804131500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:40.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.500+0000 7f780ba59700 1 -- 172.21.15.26:0/3356558192 shutdown_connections 2023-10-01T07:54:40.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.500+0000 7f780ba59700 1 -- 172.21.15.26:0/3356558192 wait complete. 2023-10-01T07:54:40.575 DEBUG:teuthology.orchestra.run.smithi026:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph versions' 2023-10-01T07:54:40.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.709+0000 7f67010f6700 1 Processor -- start 2023-10-01T07:54:40.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.709+0000 7f67010f6700 1 -- start start 2023-10-01T07:54:40.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.710+0000 7f67010f6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f66fc070400 0x7f66fc130070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:40.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.710+0000 7f67010f6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66fc1305b0 0x7f66fc12cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:40.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.710+0000 7f67010f6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66fc071660 con 0x7f66fc099a50 2023-10-01T07:54:40.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.710+0000 7f67010f6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66fc0707d0 con 0x7f66fc070400 2023-10-01T07:54:40.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.710+0000 7f67010f6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc070070 con 0x7f66fc1305b0 2023-10-01T07:54:40.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.710+0000 7f66fb59e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66fc1305b0 0x7f66fc12cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:40.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.710+0000 7f66fad9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f66fc070400 0x7f66fc130070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:40.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.710+0000 7f66fb59e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66fc1305b0 0x7f66fc12cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44166/0 (socket says 172.21.15.26:44166) 2023-10-01T07:54:40.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.710+0000 7f66fa59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f66fc099a50 0x7f66fc12c4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45744/0 (socket says 172.21.15.26:45744) 2023-10-01T07:54:40.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.710+0000 7f66fb59e700 1 -- 172.21.15.26:0/3888478262 learned_addr learned my addr 172.21.15.26:0/3888478262 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:40.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.710+0000 7f66fb59e700 1 -- 172.21.15.26:0/3888478262 >> v2:172.21.15.26:3300/0 conn(0x7f66fc070400 msgr2=0x7f66fc130070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:40.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.710+0000 7f66fb59e700 1 --2- 172.21.15.26:0/3888478262 >> v2:172.21.15.26:3300/0 conn(0x7f66fc070400 0x7f66fc130070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:40.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.710+0000 7f66fb59e700 1 -- 172.21.15.26:0/3888478262 >> v1:172.21.15.26:6789/0 conn(0x7f66fc099a50 legacy=0x7f66fc12c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:40.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.710+0000 7f66fb59e700 1 -- 172.21.15.26:0/3888478262 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66fc070e80 con 0x7f66fc1305b0 2023-10-01T07:54:40.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.710+0000 7f66fad9d700 1 --2- 172.21.15.26:0/3888478262 >> v2:172.21.15.26:3300/0 conn(0x7f66fc070400 0x7f66fc130070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:40.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.711+0000 7f66fb59e700 1 --2- 172.21.15.26:0/3888478262 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66fc1305b0 0x7f66fc12cc00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f66f4009eb0 tx=0x7f66f400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77ebf22867207c76 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:40.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.711+0000 7f66f9d9b700 1 -- 172.21.15.26:0/3888478262 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f400e070 con 0x7f66fc1305b0 2023-10-01T07:54:40.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.711+0000 7f66f9d9b700 1 -- 172.21.15.26:0/3888478262 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f400b890 con 0x7f66fc1305b0 2023-10-01T07:54:40.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.711+0000 7f66f9d9b700 1 -- 172.21.15.26:0/3888478262 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f400bc40 con 0x7f66fc1305b0 2023-10-01T07:54:40.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.711+0000 7f67010f6700 1 -- 172.21.15.26:0/3888478262 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66fc1305b0 msgr2=0x7f66fc12cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:40.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.711+0000 7f67010f6700 1 --2- 172.21.15.26:0/3888478262 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66fc1305b0 0x7f66fc12cc00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f66f4009eb0 tx=0x7f66f400b330 comp rx=0 tx=0).stop 2023-10-01T07:54:40.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.711+0000 7f67010f6700 1 -- 172.21.15.26:0/3888478262 shutdown_connections 2023-10-01T07:54:40.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.711+0000 7f67010f6700 1 --2- 172.21.15.26:0/3888478262 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66fc1305b0 0x7f66fc12cc00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:40.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.711+0000 7f67010f6700 1 --2- 172.21.15.26:0/3888478262 >> v2:172.21.15.26:3300/0 conn(0x7f66fc070400 0x7f66fc130070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:40.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.711+0000 7f67010f6700 1 -- 172.21.15.26:0/3888478262 >> 172.21.15.26:0/3888478262 conn(0x7f66fc0a2700 msgr2=0x7f66fc0a2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:40.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.711+0000 7f67010f6700 1 -- 172.21.15.26:0/3888478262 shutdown_connections 2023-10-01T07:54:40.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.711+0000 7f67010f6700 1 -- 172.21.15.26:0/3888478262 wait complete. 2023-10-01T07:54:40.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.713+0000 7f67010f6700 1 Processor -- start 2023-10-01T07:54:40.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.713+0000 7f67010f6700 1 -- start start 2023-10-01T07:54:40.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.713+0000 7f67010f6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66fc070400 0x7f66fc11ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:40.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.713+0000 7f67010f6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66fc099a50 0x7f66fc11cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:40.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.713+0000 7f67010f6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f66fc1305b0 0x7f66fc11d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:40.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.713+0000 7f67010f6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc11e6c0 con 0x7f66fc099a50 2023-10-01T07:54:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.713+0000 7f67010f6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc11f790 con 0x7f66fc1305b0 2023-10-01T07:54:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.713+0000 7f67010f6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc120450 con 0x7f66fc070400 2023-10-01T07:54:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.713+0000 7f66fa59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66fc099a50 0x7f66fc11cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.713+0000 7f66fad9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66fc070400 0x7f66fc11ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.713+0000 7f66fa59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66fc099a50 0x7f66fc11cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53208/0 (socket says 172.21.15.26:53208) 2023-10-01T07:54:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.713+0000 7f66fad9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66fc070400 0x7f66fc11ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44178/0 (socket says 172.21.15.26:44178) 2023-10-01T07:54:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.714+0000 7f66fa59c700 1 -- 172.21.15.26:0/3736786609 learned_addr learned my addr 172.21.15.26:0/3736786609 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.714+0000 7f66fb59e700 1 --2- 172.21.15.26:0/3736786609 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f66fc1305b0 0x7f66fc11d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.714+0000 7f66fad9d700 1 -- 172.21.15.26:0/3736786609 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f66fc1305b0 msgr2=0x7f66fc11d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.714+0000 7f66fad9d700 1 --2- 172.21.15.26:0/3736786609 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f66fc1305b0 0x7f66fc11d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.714+0000 7f66fad9d700 1 -- 172.21.15.26:0/3736786609 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66fc099a50 msgr2=0x7f66fc11cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.714+0000 7f66fad9d700 1 --2- 172.21.15.26:0/3736786609 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66fc099a50 0x7f66fc11cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.714+0000 7f66fad9d700 1 -- 172.21.15.26:0/3736786609 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ec0094a0 con 0x7f66fc070400 2023-10-01T07:54:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.714+0000 7f66fa59c700 1 --2- 172.21.15.26:0/3736786609 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66fc099a50 0x7f66fc11cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.714+0000 7f66fb59e700 1 --2- 172.21.15.26:0/3736786609 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f66fc1305b0 0x7f66fc11d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.714+0000 7f66fad9d700 1 --2- 172.21.15.26:0/3736786609 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66fc070400 0x7f66fc11ca60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f66ec00e930 tx=0x7f66ec00ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.714+0000 7f66e37fe700 1 -- 172.21.15.26:0/3736786609 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec013680 con 0x7f66fc070400 2023-10-01T07:54:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.714+0000 7f66e37fe700 1 -- 172.21.15.26:0/3736786609 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66ec0137e0 con 0x7f66fc070400 2023-10-01T07:54:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.714+0000 7f67010f6700 1 -- 172.21.15.26:0/3736786609 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f4009b30 con 0x7f66fc070400 2023-10-01T07:54:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.714+0000 7f66e37fe700 1 -- 172.21.15.26:0/3736786609 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec013b90 con 0x7f66fc070400 2023-10-01T07:54:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.714+0000 7f67010f6700 1 -- 172.21.15.26:0/3736786609 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66fc11ed40 con 0x7f66fc070400 2023-10-01T07:54:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.715+0000 7f66e37fe700 1 -- 172.21.15.26:0/3736786609 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f66ec013cf0 con 0x7f66fc070400 2023-10-01T07:54:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.715+0000 7f66e37fe700 1 -- 172.21.15.26:0/3736786609 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f66ec03fee0 con 0x7f66fc070400 2023-10-01T07:54:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.715+0000 7f67010f6700 1 -- 172.21.15.26:0/3736786609 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66fc04f2a0 con 0x7f66fc070400 2023-10-01T07:54:40.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:40.720+0000 7f66e37fe700 1 -- 172.21.15.26:0/3736786609 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f66ec017020 con 0x7f66fc070400 2023-10-01T07:54:41.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.010+0000 7f67010f6700 1 -- 172.21.15.26:0/3736786609 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f66fc11fbe0 con 0x7f66fc070400 2023-10-01T07:54:41.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.010+0000 7f66e37fe700 1 -- 172.21.15.26:0/3736786609 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+627 (secure 0 0 0) 0x7f66ec011bd0 con 0x7f66fc070400 2023-10-01T07:54:41.011 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-10-01T07:54:41.011 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2023-10-01T07:54:41.011 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.0-501-gfc1e90a3 (fc1e90a395a6a5631142eb70fd9bf3d22740a9da) reef (stable)": 3 2023-10-01T07:54:41.011 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:41.011 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2023-10-01T07:54:41.012 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.0-501-gfc1e90a3 (fc1e90a395a6a5631142eb70fd9bf3d22740a9da) reef (stable)": 1 2023-10-01T07:54:41.012 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:41.012 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2023-10-01T07:54:41.012 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.0-501-gfc1e90a3 (fc1e90a395a6a5631142eb70fd9bf3d22740a9da) reef (stable)": 4 2023-10-01T07:54:41.012 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:41.012 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2023-10-01T07:54:41.012 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.0-501-gfc1e90a3 (fc1e90a395a6a5631142eb70fd9bf3d22740a9da) reef (stable)": 1 2023-10-01T07:54:41.012 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-10-01T07:54:41.013 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2023-10-01T07:54:41.013 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.0-501-gfc1e90a3 (fc1e90a395a6a5631142eb70fd9bf3d22740a9da) reef (stable)": 9 2023-10-01T07:54:41.013 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-10-01T07:54:41.013 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-10-01T07:54:41.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.013+0000 7f67010f6700 1 -- 172.21.15.26:0/3736786609 >> v1:172.21.15.26:6816/126763 conn(0x7f66e802f510 legacy=0x7f66e80319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:41.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.013+0000 7f67010f6700 1 -- 172.21.15.26:0/3736786609 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66fc070400 msgr2=0x7f66fc11ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:41.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.013+0000 7f67010f6700 1 --2- 172.21.15.26:0/3736786609 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66fc070400 0x7f66fc11ca60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f66ec00e930 tx=0x7f66ec00ec40 comp rx=0 tx=0).stop 2023-10-01T07:54:41.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.013+0000 7f67010f6700 1 -- 172.21.15.26:0/3736786609 shutdown_connections 2023-10-01T07:54:41.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.013+0000 7f67010f6700 1 --2- 172.21.15.26:0/3736786609 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f66fc1305b0 0x7f66fc11d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:41.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.013+0000 7f67010f6700 1 --2- 172.21.15.26:0/3736786609 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66fc070400 0x7f66fc11ca60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:41.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.013+0000 7f67010f6700 1 --2- 172.21.15.26:0/3736786609 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66fc099a50 0x7f66fc11cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:41.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.013+0000 7f67010f6700 1 -- 172.21.15.26:0/3736786609 >> 172.21.15.26:0/3736786609 conn(0x7f66fc0a2700 msgr2=0x7f66fc12c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:41.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.013+0000 7f67010f6700 1 -- 172.21.15.26:0/3736786609 shutdown_connections 2023-10-01T07:54:41.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.013+0000 7f67010f6700 1 -- 172.21.15.26:0/3736786609 wait complete. 2023-10-01T07:54:41.027 DEBUG:teuthology.orchestra.run.smithi026:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done' 2023-10-01T07:54:41.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.163+0000 7f201301e700 1 Processor -- start 2023-10-01T07:54:41.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.163+0000 7f201301e700 1 -- start start 2023-10-01T07:54:41.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.164+0000 7f201301e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f200c09e9d0 0x7f200c09eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:41.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.164+0000 7f201301e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f200c09f2e0 0x7f200c09f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:41.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.164+0000 7f201301e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f200c09abd0 con 0x7f200c1317b0 2023-10-01T07:54:41.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.164+0000 7f201301e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f200c06fd90 con 0x7f200c09f2e0 2023-10-01T07:54:41.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.164+0000 7f201301e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f200c071e80 con 0x7f200c09e9d0 2023-10-01T07:54:41.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.164+0000 7f2010dba700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f200c09e9d0 0x7f200c09eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:41.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.164+0000 7f200bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f200c09f2e0 0x7f200c09f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:41.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.164+0000 7f20115bb700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f200c1317b0 0x7f200c131c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45752/0 (socket says 172.21.15.26:45752) 2023-10-01T07:54:41.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.164+0000 7f20115bb700 1 -- 172.21.15.26:0/3724410649 learned_addr learned my addr 172.21.15.26:0/3724410649 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:41.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.164+0000 7f200b7fe700 1 -- 172.21.15.26:0/3724410649 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3021217154 0 0) 0x7f200c09abd0 con 0x7f200c1317b0 2023-10-01T07:54:41.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.164+0000 7f200b7fe700 1 -- 172.21.15.26:0/3724410649 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ffc0035b0 con 0x7f200c1317b0 2023-10-01T07:54:41.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.164+0000 7f200bfff700 1 -- 172.21.15.26:0/3724410649 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f200c09e9d0 msgr2=0x7f200c09eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:41.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.164+0000 7f200bfff700 1 --2- 172.21.15.26:0/3724410649 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f200c09e9d0 0x7f200c09eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:41.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.164+0000 7f200bfff700 1 -- 172.21.15.26:0/3724410649 >> v1:172.21.15.26:6789/0 conn(0x7f200c1317b0 legacy=0x7f200c131c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:41.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.164+0000 7f200bfff700 1 -- 172.21.15.26:0/3724410649 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f200c0a0240 con 0x7f200c09f2e0 2023-10-01T07:54:41.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.164+0000 7f2010dba700 1 --2- 172.21.15.26:0/3724410649 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f200c09e9d0 0x7f200c09eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:41.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.165+0000 7f200bfff700 1 --2- 172.21.15.26:0/3724410649 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f200c09f2e0 0x7f200c09f6b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8009870 tx=0x7f1ff8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1a839276fe385ef server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:41.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.165+0000 7f200b7fe700 1 -- 172.21.15.26:0/3724410649 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff8011830 con 0x7f200c09f2e0 2023-10-01T07:54:41.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.165+0000 7f200b7fe700 1 -- 172.21.15.26:0/3724410649 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff8011990 con 0x7f200c09f2e0 2023-10-01T07:54:41.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.165+0000 7f200b7fe700 1 -- 172.21.15.26:0/3724410649 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff8011d20 con 0x7f200c09f2e0 2023-10-01T07:54:41.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.165+0000 7f201301e700 1 -- 172.21.15.26:0/3724410649 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f200c09f2e0 msgr2=0x7f200c09f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:41.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.165+0000 7f201301e700 1 --2- 172.21.15.26:0/3724410649 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f200c09f2e0 0x7f200c09f6b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8009870 tx=0x7f1ff8009b80 comp rx=0 tx=0).stop 2023-10-01T07:54:41.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.165+0000 7f201301e700 1 -- 172.21.15.26:0/3724410649 shutdown_connections 2023-10-01T07:54:41.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.165+0000 7f201301e700 1 --2- 172.21.15.26:0/3724410649 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f200c09e9d0 0x7f200c09eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:41.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.165+0000 7f201301e700 1 --2- 172.21.15.26:0/3724410649 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f200c09f2e0 0x7f200c09f6b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:41.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.165+0000 7f201301e700 1 -- 172.21.15.26:0/3724410649 >> 172.21.15.26:0/3724410649 conn(0x7f200c0a43c0 msgr2=0x7f200c0a47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:41.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.165+0000 7f201301e700 1 -- 172.21.15.26:0/3724410649 shutdown_connections 2023-10-01T07:54:41.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.165+0000 7f201301e700 1 -- 172.21.15.26:0/3724410649 wait complete. 2023-10-01T07:54:41.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.167+0000 7f201301e700 1 Processor -- start 2023-10-01T07:54:41.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.167+0000 7f201301e700 1 -- start start 2023-10-01T07:54:41.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.168+0000 7f201301e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f200c09e9d0 0x7f200c11d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:41.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.168+0000 7f201301e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f200c09f2e0 0x7f200c11d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:41.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.168+0000 7f201301e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f200c1317b0 0x7f200c1c6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:41.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.168+0000 7f201301e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f200c11ce20 con 0x7f200c09e9d0 2023-10-01T07:54:41.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.168+0000 7f201301e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f200c131510 con 0x7f200c09f2e0 2023-10-01T07:54:41.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.168+0000 7f201301e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f200c1312d0 con 0x7f200c1317b0 2023-10-01T07:54:41.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.168+0000 7f2010dba700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f200c09e9d0 0x7f200c11d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:41.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.168+0000 7f20115bb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f200c1317b0 0x7f200c1c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:41.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.168+0000 7f2010dba700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f200c09e9d0 0x7f200c11d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53222/0 (socket says 172.21.15.26:53222) 2023-10-01T07:54:41.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.168+0000 7f2010dba700 1 -- 172.21.15.26:0/3989793848 learned_addr learned my addr 172.21.15.26:0/3989793848 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:41.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.168+0000 7f200bfff700 1 --2- 172.21.15.26:0/3989793848 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f200c09f2e0 0x7f200c11d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:41.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.168+0000 7f20115bb700 1 -- 172.21.15.26:0/3989793848 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f200c09f2e0 msgr2=0x7f200c11d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:41.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.168+0000 7f20115bb700 1 --2- 172.21.15.26:0/3989793848 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f200c09f2e0 0x7f200c11d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:41.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.168+0000 7f20115bb700 1 -- 172.21.15.26:0/3989793848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f200c09e9d0 msgr2=0x7f200c11d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:41.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.168+0000 7f20115bb700 1 --2- 172.21.15.26:0/3989793848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f200c09e9d0 0x7f200c11d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:41.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.168+0000 7f20115bb700 1 -- 172.21.15.26:0/3989793848 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20000094a0 con 0x7f200c1317b0 2023-10-01T07:54:41.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.168+0000 7f2010dba700 1 --2- 172.21.15.26:0/3989793848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f200c09e9d0 0x7f200c11d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:41.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.168+0000 7f20115bb700 1 --2- 172.21.15.26:0/3989793848 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f200c1317b0 0x7f200c1c6020 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f200400cab0 tx=0x7f200400cdc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:41.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.169+0000 7f20097fa700 1 -- 172.21.15.26:0/3989793848 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200400a9a0 con 0x7f200c1317b0 2023-10-01T07:54:41.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.169+0000 7f20097fa700 1 -- 172.21.15.26:0/3989793848 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200400ab00 con 0x7f200c1317b0 2023-10-01T07:54:41.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.169+0000 7f201301e700 1 -- 172.21.15.26:0/3989793848 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff80094a0 con 0x7f200c1317b0 2023-10-01T07:54:41.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.169+0000 7f20097fa700 1 -- 172.21.15.26:0/3989793848 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200400ae70 con 0x7f200c1317b0 2023-10-01T07:54:41.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.169+0000 7f201301e700 1 -- 172.21.15.26:0/3989793848 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f200c11ed40 con 0x7f200c1317b0 2023-10-01T07:54:41.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.169+0000 7f20097fa700 1 -- 172.21.15.26:0/3989793848 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f200401b3b0 con 0x7f200c1317b0 2023-10-01T07:54:41.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.170+0000 7f20097fa700 1 -- 172.21.15.26:0/3989793848 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f200403f700 con 0x7f200c1317b0 2023-10-01T07:54:41.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.170+0000 7f201301e700 1 -- 172.21.15.26:0/3989793848 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f200c04f2a0 con 0x7f200c1317b0 2023-10-01T07:54:41.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.175+0000 7f20097fa700 1 -- 172.21.15.26:0/3989793848 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2004017020 con 0x7f200c1317b0 2023-10-01T07:54:41.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.380+0000 7f201301e700 1 -- 172.21.15.26:0/3989793848 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd pool ls"} v 0) v1 -- 0x7f200c11ead0 con 0x7f200c1317b0 2023-10-01T07:54:41.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.381+0000 7f20097fa700 1 -- 172.21.15.26:0/3989793848 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v34) v1 ==== 59+0+37 (secure 0 0 0) 0x7f20040192c0 con 0x7f200c1317b0 2023-10-01T07:54:41.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.383+0000 7f201301e700 1 -- 172.21.15.26:0/3989793848 >> v1:172.21.15.26:6816/126763 conn(0x7f1ff002f510 legacy=0x7f1ff00319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:41.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.383+0000 7f201301e700 1 -- 172.21.15.26:0/3989793848 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f200c1317b0 msgr2=0x7f200c1c6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:41.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.383+0000 7f201301e700 1 --2- 172.21.15.26:0/3989793848 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f200c1317b0 0x7f200c1c6020 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f200400cab0 tx=0x7f200400cdc0 comp rx=0 tx=0).stop 2023-10-01T07:54:41.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.383+0000 7f201301e700 1 -- 172.21.15.26:0/3989793848 shutdown_connections 2023-10-01T07:54:41.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.383+0000 7f201301e700 1 --2- 172.21.15.26:0/3989793848 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f200c1317b0 0x7f200c1c6020 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:41.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.383+0000 7f201301e700 1 --2- 172.21.15.26:0/3989793848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f200c09e9d0 0x7f200c11d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:41.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.383+0000 7f201301e700 1 --2- 172.21.15.26:0/3989793848 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f200c09f2e0 0x7f200c11d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:41.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.383+0000 7f201301e700 1 -- 172.21.15.26:0/3989793848 >> 172.21.15.26:0/3989793848 conn(0x7f200c0a43c0 msgr2=0x7f200c1b99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:41.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.383+0000 7f201301e700 1 -- 172.21.15.26:0/3989793848 shutdown_connections 2023-10-01T07:54:41.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.383+0000 7f201301e700 1 -- 172.21.15.26:0/3989793848 wait complete. 2023-10-01T07:54:41.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.503+0000 7ff452334700 1 Processor -- start 2023-10-01T07:54:41.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.503+0000 7ff452334700 1 -- start start 2023-10-01T07:54:41.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.504+0000 7ff452334700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff44c09e9d0 0x7ff44c09eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:41.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.504+0000 7ff452334700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff44c09f2e0 0x7ff44c09f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:41.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.504+0000 7ff452334700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff44c1317b0 0x7ff44c131c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:41.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.504+0000 7ff452334700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff44c0a0140 con 0x7ff44c09e9d0 2023-10-01T07:54:41.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.504+0000 7ff452334700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c09ab50 con 0x7ff44c09f2e0 2023-10-01T07:54:41.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.504+0000 7ff452334700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c0a0330 con 0x7ff44c1317b0 2023-10-01T07:54:41.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.504+0000 7ff44bfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff44c09e9d0 0x7ff44c09eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:41.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.504+0000 7ff4508d1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff44c1317b0 0x7ff44c131c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:41.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.504+0000 7ff44b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff44c09f2e0 0x7ff44c09f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:41.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.504+0000 7ff44bfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff44c09e9d0 0x7ff44c09eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53238/0 (socket says 172.21.15.26:53238) 2023-10-01T07:54:41.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.504+0000 7ff44bfff700 1 -- 172.21.15.26:0/4001787480 learned_addr learned my addr 172.21.15.26:0/4001787480 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:41.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.504+0000 7ff4508d1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff44c1317b0 0x7ff44c131c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44214/0 (socket says 172.21.15.26:44214) 2023-10-01T07:54:41.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.504+0000 7ff44b7fe700 1 -- 172.21.15.26:0/4001787480 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff44c1317b0 msgr2=0x7ff44c131c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:41.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.504+0000 7ff44b7fe700 1 --2- 172.21.15.26:0/4001787480 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff44c1317b0 0x7ff44c131c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:41.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.504+0000 7ff44b7fe700 1 -- 172.21.15.26:0/4001787480 >> v2:172.21.15.26:3300/0 conn(0x7ff44c09e9d0 msgr2=0x7ff44c09eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:41.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.504+0000 7ff44b7fe700 1 --2- 172.21.15.26:0/4001787480 >> v2:172.21.15.26:3300/0 conn(0x7ff44c09e9d0 0x7ff44c09eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:41.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.504+0000 7ff44b7fe700 1 -- 172.21.15.26:0/4001787480 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44c06ef60 con 0x7ff44c09f2e0 2023-10-01T07:54:41.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.504+0000 7ff44bfff700 1 --2- 172.21.15.26:0/4001787480 >> v2:172.21.15.26:3300/0 conn(0x7ff44c09e9d0 0x7ff44c09eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:41.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.504+0000 7ff44b7fe700 1 --2- 172.21.15.26:0/4001787480 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff44c09f2e0 0x7ff44c09f6b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff44000dc60 tx=0x7ff44000df70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc4cbb73721dbc59 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:41.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.505+0000 7ff44affd700 1 -- 172.21.15.26:0/4001787480 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44000b070 con 0x7ff44c09f2e0 2023-10-01T07:54:41.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.505+0000 7ff44affd700 1 -- 172.21.15.26:0/4001787480 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff440008a30 con 0x7ff44c09f2e0 2023-10-01T07:54:41.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.505+0000 7ff44affd700 1 -- 172.21.15.26:0/4001787480 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff440008de0 con 0x7ff44c09f2e0 2023-10-01T07:54:41.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.505+0000 7ff452334700 1 -- 172.21.15.26:0/4001787480 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff44c09f2e0 msgr2=0x7ff44c09f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:41.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.505+0000 7ff452334700 1 --2- 172.21.15.26:0/4001787480 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff44c09f2e0 0x7ff44c09f6b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff44000dc60 tx=0x7ff44000df70 comp rx=0 tx=0).stop 2023-10-01T07:54:41.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.505+0000 7ff452334700 1 -- 172.21.15.26:0/4001787480 shutdown_connections 2023-10-01T07:54:41.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.505+0000 7ff452334700 1 --2- 172.21.15.26:0/4001787480 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff44c1317b0 0x7ff44c131c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:41.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.505+0000 7ff452334700 1 --2- 172.21.15.26:0/4001787480 >> v2:172.21.15.26:3300/0 conn(0x7ff44c09e9d0 0x7ff44c09eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:41.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.505+0000 7ff452334700 1 --2- 172.21.15.26:0/4001787480 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff44c09f2e0 0x7ff44c09f6b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:41.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.505+0000 7ff452334700 1 -- 172.21.15.26:0/4001787480 >> 172.21.15.26:0/4001787480 conn(0x7ff44c0a43f0 msgr2=0x7ff44c0a47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:41.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.505+0000 7ff452334700 1 -- 172.21.15.26:0/4001787480 shutdown_connections 2023-10-01T07:54:41.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.505+0000 7ff452334700 1 -- 172.21.15.26:0/4001787480 wait complete. 2023-10-01T07:54:41.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.507+0000 7ff452334700 1 Processor -- start 2023-10-01T07:54:41.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.507+0000 7ff452334700 1 -- start start 2023-10-01T07:54:41.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.508+0000 7ff452334700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff44c09e9d0 0x7ff44c11beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:41.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.508+0000 7ff452334700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff44c09f2e0 0x7ff44c11c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:41.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.508+0000 7ff452334700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff44c1317b0 0x7ff44c11c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:41.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.508+0000 7ff452334700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c12f6e0 con 0x7ff44c09f2e0 2023-10-01T07:54:41.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.508+0000 7ff452334700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c11f750 con 0x7ff44c09e9d0 2023-10-01T07:54:41.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.508+0000 7ff452334700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c11da70 con 0x7ff44c1317b0 2023-10-01T07:54:41.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.508+0000 7ff44bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff44c09e9d0 0x7ff44c11beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:41.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.508+0000 7ff44b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff44c09f2e0 0x7ff44c11c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:41.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.508+0000 7ff4508d1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff44c1317b0 0x7ff44c11c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:41.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.508+0000 7ff44bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff44c09e9d0 0x7ff44c11beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:56572/0 (socket says 172.21.15.26:56572) 2023-10-01T07:54:41.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.508+0000 7ff4508d1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff44c1317b0 0x7ff44c11c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44218/0 (socket says 172.21.15.26:44218) 2023-10-01T07:54:41.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.508+0000 7ff44bfff700 1 -- 172.21.15.26:0/4111645467 learned_addr learned my addr 172.21.15.26:0/4111645467 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:41.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.508+0000 7ff44b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff44c09f2e0 0x7ff44c11c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53240/0 (socket says 172.21.15.26:53240) 2023-10-01T07:54:41.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.508+0000 7ff44bfff700 1 -- 172.21.15.26:0/4111645467 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff44c1317b0 msgr2=0x7ff44c11c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:41.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.508+0000 7ff44bfff700 1 --2- 172.21.15.26:0/4111645467 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff44c1317b0 0x7ff44c11c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:41.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.508+0000 7ff44bfff700 1 -- 172.21.15.26:0/4111645467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff44c09f2e0 msgr2=0x7ff44c11c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:41.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.508+0000 7ff44bfff700 1 --2- 172.21.15.26:0/4111645467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff44c09f2e0 0x7ff44c11c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:41.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.508+0000 7ff44bfff700 1 -- 172.21.15.26:0/4111645467 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff43c009550 con 0x7ff44c09e9d0 2023-10-01T07:54:41.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.508+0000 7ff44b7fe700 1 --2- 172.21.15.26:0/4111645467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff44c09f2e0 0x7ff44c11c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:41.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.508+0000 7ff44bfff700 1 --2- 172.21.15.26:0/4111645467 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff44c09e9d0 0x7ff44c11beb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff43c00ec10 tx=0x7ff43c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:41.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.508+0000 7ff448ff9700 1 -- 172.21.15.26:0/4111645467 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c00c850 con 0x7ff44c09e9d0 2023-10-01T07:54:41.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.508+0000 7ff448ff9700 1 -- 172.21.15.26:0/4111645467 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43c00c9b0 con 0x7ff44c09e9d0 2023-10-01T07:54:41.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.508+0000 7ff452334700 1 -- 172.21.15.26:0/4111645467 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff44000d940 con 0x7ff44c09e9d0 2023-10-01T07:54:41.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.508+0000 7ff448ff9700 1 -- 172.21.15.26:0/4111645467 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c00cd40 con 0x7ff44c09e9d0 2023-10-01T07:54:41.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.509+0000 7ff452334700 1 -- 172.21.15.26:0/4111645467 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff44c0a13d0 con 0x7ff44c09e9d0 2023-10-01T07:54:41.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.509+0000 7ff448ff9700 1 -- 172.21.15.26:0/4111645467 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff43c013470 con 0x7ff44c09e9d0 2023-10-01T07:54:41.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.510+0000 7ff452334700 1 -- 172.21.15.26:0/4111645467 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff44c09cb70 con 0x7ff44c09e9d0 2023-10-01T07:54:41.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.510+0000 7ff448ff9700 1 -- 172.21.15.26:0/4111645467 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4092+0+0 (secure 0 0 0) 0x7ff43c040110 con 0x7ff44c09e9d0 2023-10-01T07:54:41.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.515+0000 7ff448ff9700 1 -- 172.21.15.26:0/4111645467 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff43c021080 con 0x7ff44c09e9d0 2023-10-01T07:54:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:41.716+0000 7ff452334700 1 -- 172.21.15.26:0/4111645467 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7ff44c04f2a0 con 0x7ff44c09e9d0 2023-10-01T07:54:41.878 INFO:tasks.ceph.mgr.x.smithi026.stderr:terminate called after throwing an instance of 'ceph::buffer::v15_2_0::end_of_buffer' 2023-10-01T07:54:41.879 INFO:tasks.ceph.mgr.x.smithi026.stderr:terminate called recursively 2023-10-01T07:54:41.879 INFO:tasks.ceph.mgr.x.smithi026.stderr: what(): End of buffer [buffer:2] 2023-10-01T07:54:41.879 INFO:tasks.ceph.mgr.x.smithi026.stderr:*** Caught signal (Aborted) ** 2023-10-01T07:54:41.879 INFO:tasks.ceph.mgr.x.smithi026.stderr: in thread 7f6c3b0fa700 thread_name:ms_dispatch 2023-10-01T07:54:42.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.086+0000 7ff448ff9700 1 -- 172.21.15.26:0/4111645467 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 1 pg_autoscale_mode to off v35) v1 ==== 153+0+0 (secure 0 0 0) 0x7ff43c013720 con 0x7ff44c09e9d0 2023-10-01T07:54:42.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.090+0000 7ff452334700 1 -- 172.21.15.26:0/4111645467 >> v1:172.21.15.26:6816/126763 conn(0x7ff43802f510 legacy=0x7ff4380319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:42.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.090+0000 7ff452334700 1 -- 172.21.15.26:0/4111645467 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff44c09e9d0 msgr2=0x7ff44c11beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:42.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.090+0000 7ff452334700 1 --2- 172.21.15.26:0/4111645467 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff44c09e9d0 0x7ff44c11beb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff43c00ec10 tx=0x7ff43c00ef20 comp rx=0 tx=0).stop 2023-10-01T07:54:42.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.090+0000 7ff452334700 1 -- 172.21.15.26:0/4111645467 shutdown_connections 2023-10-01T07:54:42.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.090+0000 7ff452334700 1 --2- 172.21.15.26:0/4111645467 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff44c1317b0 0x7ff44c11c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:42.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.090+0000 7ff452334700 1 --2- 172.21.15.26:0/4111645467 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff44c09e9d0 0x7ff44c11beb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:42.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.090+0000 7ff452334700 1 --2- 172.21.15.26:0/4111645467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff44c09f2e0 0x7ff44c11c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:42.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.090+0000 7ff452334700 1 -- 172.21.15.26:0/4111645467 >> 172.21.15.26:0/4111645467 conn(0x7ff44c0a43f0 msgr2=0x7ff44c130f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:42.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.090+0000 7ff452334700 1 -- 172.21.15.26:0/4111645467 shutdown_connections 2023-10-01T07:54:42.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.090+0000 7ff452334700 1 -- 172.21.15.26:0/4111645467 wait complete. 2023-10-01T07:54:42.092 INFO:teuthology.orchestra.run.smithi026.stderr:set pool 1 pg_autoscale_mode to off 2023-10-01T07:54:42.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.214+0000 7fc3874dc700 1 Processor -- start 2023-10-01T07:54:42.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.214+0000 7fc3874dc700 1 -- start start 2023-10-01T07:54:42.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.215+0000 7fc3874dc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc38009d950 0x7fc38009dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:42.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.215+0000 7fc3874dc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc38009e260 0x7fc380133740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:42.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.215+0000 7fc3874dc700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc38006b5a0 con 0x7fc380133c80 2023-10-01T07:54:42.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.215+0000 7fc3874dc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc38009ab70 con 0x7fc38009e260 2023-10-01T07:54:42.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.215+0000 7fc3874dc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc38009f3d0 con 0x7fc38009d950 2023-10-01T07:54:42.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.215+0000 7fc384a77700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc38009e260 0x7fc380133740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:42.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.215+0000 7fc385278700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc38009d950 0x7fc38009dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:42.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.215+0000 7fc385a79700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc380133c80 0x7fc38013ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45768/0 (socket says 172.21.15.26:45768) 2023-10-01T07:54:42.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.215+0000 7fc385a79700 1 -- 172.21.15.26:0/2834918727 learned_addr learned my addr 172.21.15.26:0/2834918727 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:42.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.215+0000 7fc385278700 1 -- 172.21.15.26:0/2834918727 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc38009e260 msgr2=0x7fc380133740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:42.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.215+0000 7fc385278700 1 --2- 172.21.15.26:0/2834918727 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc38009e260 0x7fc380133740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:42.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.215+0000 7fc385278700 1 -- 172.21.15.26:0/2834918727 >> v1:172.21.15.26:6789/0 conn(0x7fc380133c80 legacy=0x7fc38013ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:42.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.215+0000 7fc377fff700 1 -- 172.21.15.26:0/2834918727 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 192500343 0 0) 0x7fc38006b5a0 con 0x7fc380133c80 2023-10-01T07:54:42.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.215+0000 7fc385278700 1 -- 172.21.15.26:0/2834918727 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc38009a560 con 0x7fc38009d950 2023-10-01T07:54:42.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.215+0000 7fc384a77700 1 --2- 172.21.15.26:0/2834918727 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc38009e260 0x7fc380133740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:42.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.216+0000 7fc385278700 1 --2- 172.21.15.26:0/2834918727 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc38009d950 0x7fc38009dd20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc37c009e10 tx=0x7fc37c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fe9edca4e4fbb33 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:42.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.216+0000 7fc377fff700 1 -- 172.21.15.26:0/2834918727 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37c00e070 con 0x7fc38009d950 2023-10-01T07:54:42.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.216+0000 7fc377fff700 1 -- 172.21.15.26:0/2834918727 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37c00bb20 con 0x7fc38009d950 2023-10-01T07:54:42.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.216+0000 7fc377fff700 1 -- 172.21.15.26:0/2834918727 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37c012430 con 0x7fc38009d950 2023-10-01T07:54:42.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.216+0000 7fc3874dc700 1 -- 172.21.15.26:0/2834918727 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc38009d950 msgr2=0x7fc38009dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:42.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.216+0000 7fc3874dc700 1 --2- 172.21.15.26:0/2834918727 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc38009d950 0x7fc38009dd20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc37c009e10 tx=0x7fc37c00b330 comp rx=0 tx=0).stop 2023-10-01T07:54:42.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.216+0000 7fc3874dc700 1 -- 172.21.15.26:0/2834918727 shutdown_connections 2023-10-01T07:54:42.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.216+0000 7fc3874dc700 1 --2- 172.21.15.26:0/2834918727 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc38009d950 0x7fc38009dd20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:42.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.216+0000 7fc3874dc700 1 --2- 172.21.15.26:0/2834918727 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc38009e260 0x7fc380133740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:42.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.216+0000 7fc3874dc700 1 -- 172.21.15.26:0/2834918727 >> 172.21.15.26:0/2834918727 conn(0x7fc3800a2f50 msgr2=0x7fc3800a3350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:42.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.217+0000 7fc3874dc700 1 -- 172.21.15.26:0/2834918727 shutdown_connections 2023-10-01T07:54:42.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.217+0000 7fc3874dc700 1 -- 172.21.15.26:0/2834918727 wait complete. 2023-10-01T07:54:42.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.217+0000 7fc3874dc700 1 Processor -- start 2023-10-01T07:54:42.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.218+0000 7fc3874dc700 1 -- start start 2023-10-01T07:54:42.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.218+0000 7fc3874dc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc38009d950 0x7fc38011cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:42.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.218+0000 7fc3874dc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc38009e260 0x7fc38011d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:42.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.218+0000 7fc3874dc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc380133c80 0x7fc38011d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:42.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.218+0000 7fc3874dc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc380121270 con 0x7fc380133c80 2023-10-01T07:54:42.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.218+0000 7fc3874dc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc38011e9a0 con 0x7fc38009d950 2023-10-01T07:54:42.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.218+0000 7fc3874dc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc38011efc0 con 0x7fc38009e260 2023-10-01T07:54:42.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.218+0000 7fc385a79700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc380133c80 0x7fc38011d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:42.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.218+0000 7fc385278700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc38009d950 0x7fc38011cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:42.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.218+0000 7fc385278700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc38009d950 0x7fc38011cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:56598/0 (socket says 172.21.15.26:56598) 2023-10-01T07:54:42.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.218+0000 7fc385a79700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc380133c80 0x7fc38011d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53252/0 (socket says 172.21.15.26:53252) 2023-10-01T07:54:42.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.218+0000 7fc385278700 1 -- 172.21.15.26:0/872477658 learned_addr learned my addr 172.21.15.26:0/872477658 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:42.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.218+0000 7fc384a77700 1 --2- 172.21.15.26:0/872477658 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc38009e260 0x7fc38011d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:42.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.218+0000 7fc385a79700 1 -- 172.21.15.26:0/872477658 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc38009e260 msgr2=0x7fc38011d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:42.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.218+0000 7fc385a79700 1 --2- 172.21.15.26:0/872477658 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc38009e260 0x7fc38011d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:42.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.218+0000 7fc385a79700 1 -- 172.21.15.26:0/872477658 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc38009d950 msgr2=0x7fc38011cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:42.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.218+0000 7fc385a79700 1 --2- 172.21.15.26:0/872477658 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc38009d950 0x7fc38011cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:42.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.219+0000 7fc385a79700 1 -- 172.21.15.26:0/872477658 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc370009430 con 0x7fc380133c80 2023-10-01T07:54:42.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.219+0000 7fc385a79700 1 --2- 172.21.15.26:0/872477658 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc380133c80 0x7fc38011d810 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc37800c460 tx=0x7fc37800c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:42.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.219+0000 7fc375ffb700 1 -- 172.21.15.26:0/872477658 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc378004c80 con 0x7fc380133c80 2023-10-01T07:54:42.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.219+0000 7fc375ffb700 1 -- 172.21.15.26:0/872477658 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc378004e00 con 0x7fc380133c80 2023-10-01T07:54:42.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.219+0000 7fc375ffb700 1 -- 172.21.15.26:0/872477658 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc378007310 con 0x7fc380133c80 2023-10-01T07:54:42.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.219+0000 7fc3874dc700 1 -- 172.21.15.26:0/872477658 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc37c009a70 con 0x7fc380133c80 2023-10-01T07:54:42.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.219+0000 7fc3874dc700 1 -- 172.21.15.26:0/872477658 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc380132810 con 0x7fc380133c80 2023-10-01T07:54:42.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.220+0000 7fc375ffb700 1 -- 172.21.15.26:0/872477658 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc378007470 con 0x7fc380133c80 2023-10-01T07:54:42.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.220+0000 7fc375ffb700 1 -- 172.21.15.26:0/872477658 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fc37803f660 con 0x7fc380133c80 2023-10-01T07:54:42.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.220+0000 7fc385278700 1 -- 172.21.15.26:0/872477658 >> v1:172.21.15.26:6816/126763 conn(0x7fc36402f510 legacy=0x7fc3640319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:42.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.220+0000 7fc3874dc700 1 -- 172.21.15.26:0/872477658 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc38009cbd0 con 0x7fc380133c80 2023-10-01T07:54:42.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.225+0000 7fc375ffb700 1 -- 172.21.15.26:0/872477658 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc37800ce30 con 0x7fc380133c80 2023-10-01T07:54:42.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.421+0000 7fc385278700 1 -- 172.21.15.26:0/872477658 >> v1:172.21.15.26:6816/126763 conn(0x7fc36402f510 legacy=0x7fc3640319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:42.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.432+0000 7fc3874dc700 1 -- 172.21.15.26:0/872477658 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7fc38004f2a0 con 0x7fc380133c80 2023-10-01T07:54:42.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:42.822+0000 7fc385278700 1 -- 172.21.15.26:0/872477658 >> v1:172.21.15.26:6816/126763 conn(0x7fc36402f510 legacy=0x7fc3640319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:43.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.087+0000 7fc375ffb700 1 -- 172.21.15.26:0/872477658 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 2 pg_autoscale_mode to off v36) v1 ==== 152+0+0 (secure 0 0 0) 0x7fc37801baf0 con 0x7fc380133c80 2023-10-01T07:54:43.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.092+0000 7fc3874dc700 1 -- 172.21.15.26:0/872477658 >> v1:172.21.15.26:6816/126763 conn(0x7fc36402f510 legacy=0x7fc3640319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:43.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.092+0000 7fc3874dc700 1 -- 172.21.15.26:0/872477658 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc380133c80 msgr2=0x7fc38011d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:43.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.092+0000 7fc3874dc700 1 --2- 172.21.15.26:0/872477658 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc380133c80 0x7fc38011d810 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc37800c460 tx=0x7fc37800c770 comp rx=0 tx=0).stop 2023-10-01T07:54:43.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.092+0000 7fc3874dc700 1 -- 172.21.15.26:0/872477658 shutdown_connections 2023-10-01T07:54:43.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.092+0000 7fc3874dc700 1 --2- 172.21.15.26:0/872477658 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc380133c80 0x7fc38011d810 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:43.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.092+0000 7fc3874dc700 1 --2- 172.21.15.26:0/872477658 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc38009d950 0x7fc38011cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:43.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.092+0000 7fc3874dc700 1 --2- 172.21.15.26:0/872477658 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc38009e260 0x7fc38011d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:43.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.092+0000 7fc3874dc700 1 -- 172.21.15.26:0/872477658 >> 172.21.15.26:0/872477658 conn(0x7fc3800a2f50 msgr2=0x7fc380131d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:43.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.092+0000 7fc3874dc700 1 -- 172.21.15.26:0/872477658 shutdown_connections 2023-10-01T07:54:43.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.092+0000 7fc3874dc700 1 -- 172.21.15.26:0/872477658 wait complete. 2023-10-01T07:54:43.094 INFO:teuthology.orchestra.run.smithi026.stderr:set pool 2 pg_autoscale_mode to off 2023-10-01T07:54:43.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.217+0000 7f748b400700 1 Processor -- start 2023-10-01T07:54:43.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.218+0000 7f748b400700 1 -- start start 2023-10-01T07:54:43.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.218+0000 7f748b400700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f748409aef0 0x7f748409b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:43.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.218+0000 7f748b400700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f748409a630 0x7f7484130300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:43.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.218+0000 7f748b400700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7484130840 0x7f7484130cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:43.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.218+0000 7f748b400700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74841311f0 con 0x7f748409aef0 2023-10-01T07:54:43.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.218+0000 7f748b400700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748406a980 con 0x7f7484130840 2023-10-01T07:54:43.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.218+0000 7f748b400700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f748409aac0 con 0x7f748409a630 2023-10-01T07:54:43.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.218+0000 7f748919c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f748409aef0 0x7f748409b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:43.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.218+0000 7f748999d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7484130840 0x7f7484130cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:43.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.219+0000 7f748919c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f748409aef0 0x7f748409b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53268/0 (socket says 172.21.15.26:53268) 2023-10-01T07:54:43.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.219+0000 7f748919c700 1 -- 172.21.15.26:0/234069916 learned_addr learned my addr 172.21.15.26:0/234069916 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:43.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.219+0000 7f748899b700 1 --2- 172.21.15.26:0/234069916 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f748409a630 0x7f7484130300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:43.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.219+0000 7f748919c700 1 -- 172.21.15.26:0/234069916 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f748409a630 msgr2=0x7f7484130300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:43.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.219+0000 7f748919c700 1 --2- 172.21.15.26:0/234069916 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f748409a630 0x7f7484130300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:43.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.219+0000 7f748919c700 1 -- 172.21.15.26:0/234069916 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7484130840 msgr2=0x7f7484130cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:43.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.219+0000 7f748919c700 1 --2- 172.21.15.26:0/234069916 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7484130840 0x7f7484130cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:43.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.219+0000 7f748919c700 1 -- 172.21.15.26:0/234069916 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748409bdf0 con 0x7f748409aef0 2023-10-01T07:54:43.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.219+0000 7f748999d700 1 --2- 172.21.15.26:0/234069916 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7484130840 0x7f7484130cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:43.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.219+0000 7f748919c700 1 --2- 172.21.15.26:0/234069916 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f748409aef0 0x7f748409b2c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f74800098f0 tx=0x7f7480009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be7b6638351fe50 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:43.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.219+0000 7f747bfff700 1 -- 172.21.15.26:0/234069916 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7480011830 con 0x7f748409aef0 2023-10-01T07:54:43.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.219+0000 7f747bfff700 1 -- 172.21.15.26:0/234069916 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7480011990 con 0x7f748409aef0 2023-10-01T07:54:43.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.219+0000 7f747bfff700 1 -- 172.21.15.26:0/234069916 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7480011d20 con 0x7f748409aef0 2023-10-01T07:54:43.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.220+0000 7f748b400700 1 -- 172.21.15.26:0/234069916 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f748409aef0 msgr2=0x7f748409b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:43.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.220+0000 7f748b400700 1 --2- 172.21.15.26:0/234069916 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f748409aef0 0x7f748409b2c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f74800098f0 tx=0x7f7480009c00 comp rx=0 tx=0).stop 2023-10-01T07:54:43.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.220+0000 7f748b400700 1 -- 172.21.15.26:0/234069916 shutdown_connections 2023-10-01T07:54:43.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.220+0000 7f748b400700 1 --2- 172.21.15.26:0/234069916 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7484130840 0x7f7484130cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:43.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.220+0000 7f748b400700 1 --2- 172.21.15.26:0/234069916 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f748409aef0 0x7f748409b2c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:43.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.220+0000 7f748b400700 1 --2- 172.21.15.26:0/234069916 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f748409a630 0x7f7484130300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:43.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.220+0000 7f748b400700 1 -- 172.21.15.26:0/234069916 >> 172.21.15.26:0/234069916 conn(0x7f74840a2c80 msgr2=0x7f748409eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:43.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.220+0000 7f748b400700 1 -- 172.21.15.26:0/234069916 shutdown_connections 2023-10-01T07:54:43.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.220+0000 7f748b400700 1 -- 172.21.15.26:0/234069916 wait complete. 2023-10-01T07:54:43.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.221+0000 7f748b400700 1 Processor -- start 2023-10-01T07:54:43.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.221+0000 7f748b400700 1 -- start start 2023-10-01T07:54:43.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.222+0000 7f748b400700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f748409a630 0x7f74841270e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:43.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.222+0000 7f748b400700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f748409aef0 0x7f7484127620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:43.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.222+0000 7f748b400700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7484130840 0x7f7484127b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:43.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.222+0000 7f748b400700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7484128560 con 0x7f748409aef0 2023-10-01T07:54:43.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.222+0000 7f748b400700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7484071a10 con 0x7f748409a630 2023-10-01T07:54:43.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.222+0000 7f748b400700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f748412a170 con 0x7f7484130840 2023-10-01T07:54:43.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.222+0000 7f748919c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f748409a630 0x7f74841270e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:43.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.222+0000 7f748899b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f748409aef0 0x7f7484127620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:43.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.222+0000 7f748919c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f748409a630 0x7f74841270e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:56620/0 (socket says 172.21.15.26:56620) 2023-10-01T07:54:43.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.222+0000 7f748919c700 1 -- 172.21.15.26:0/3210265716 learned_addr learned my addr 172.21.15.26:0/3210265716 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:43.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.222+0000 7f748999d700 1 --2- 172.21.15.26:0/3210265716 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7484130840 0x7f7484127b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:43.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.222+0000 7f748919c700 1 -- 172.21.15.26:0/3210265716 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7484130840 msgr2=0x7f7484127b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:43.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.222+0000 7f748919c700 1 --2- 172.21.15.26:0/3210265716 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7484130840 0x7f7484127b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:43.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.222+0000 7f748919c700 1 -- 172.21.15.26:0/3210265716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f748409aef0 msgr2=0x7f7484127620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:43.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.222+0000 7f748919c700 1 --2- 172.21.15.26:0/3210265716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f748409aef0 0x7f7484127620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:43.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.222+0000 7f748919c700 1 -- 172.21.15.26:0/3210265716 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747c009a70 con 0x7f748409a630 2023-10-01T07:54:43.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.222+0000 7f748899b700 1 --2- 172.21.15.26:0/3210265716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f748409aef0 0x7f7484127620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:43.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.222+0000 7f748919c700 1 --2- 172.21.15.26:0/3210265716 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f748409a630 0x7f74841270e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7480000c00 tx=0x7f7480004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:43.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.222+0000 7f7479ffb700 1 -- 172.21.15.26:0/3210265716 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7480004240 con 0x7f748409a630 2023-10-01T07:54:43.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.222+0000 7f7479ffb700 1 -- 172.21.15.26:0/3210265716 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748001f070 con 0x7f748409a630 2023-10-01T07:54:43.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.222+0000 7f7479ffb700 1 -- 172.21.15.26:0/3210265716 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74800045c0 con 0x7f748409a630 2023-10-01T07:54:43.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.223+0000 7f748b400700 1 -- 172.21.15.26:0/3210265716 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7480009550 con 0x7f748409a630 2023-10-01T07:54:43.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.223+0000 7f748b400700 1 -- 172.21.15.26:0/3210265716 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7484129790 con 0x7f748409a630 2023-10-01T07:54:43.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.223+0000 7f7479ffb700 1 -- 172.21.15.26:0/3210265716 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7480021030 con 0x7f748409a630 2023-10-01T07:54:43.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.224+0000 7f7479ffb700 1 -- 172.21.15.26:0/3210265716 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f7480040c00 con 0x7f748409a630 2023-10-01T07:54:43.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.224+0000 7f748899b700 1 -- 172.21.15.26:0/3210265716 >> v1:172.21.15.26:6816/126763 conn(0x7f746802f510 legacy=0x7f74680319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:43.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.224+0000 7f748b400700 1 -- 172.21.15.26:0/3210265716 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f748404f2a0 con 0x7f748409a630 2023-10-01T07:54:43.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.229+0000 7f7479ffb700 1 -- 172.21.15.26:0/3210265716 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7480015020 con 0x7f748409a630 2023-10-01T07:54:43.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.425+0000 7f748899b700 1 -- 172.21.15.26:0/3210265716 >> v1:172.21.15.26:6816/126763 conn(0x7f746802f510 legacy=0x7f74680319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:43.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.435+0000 7f748b400700 1 -- 172.21.15.26:0/3210265716 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f7484129f40 con 0x7f748409a630 2023-10-01T07:54:43.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:43.826+0000 7f748899b700 1 -- 172.21.15.26:0/3210265716 >> v1:172.21.15.26:6816/126763 conn(0x7f746802f510 legacy=0x7f74680319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:44.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.098+0000 7f7479ffb700 1 -- 172.21.15.26:0/3210265716 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 3 pg_autoscale_mode to off v37) v1 ==== 164+0+0 (secure 0 0 0) 0x7f748001a450 con 0x7f748409a630 2023-10-01T07:54:44.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.104+0000 7f748b400700 1 -- 172.21.15.26:0/3210265716 >> v1:172.21.15.26:6816/126763 conn(0x7f746802f510 legacy=0x7f74680319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:44.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.104+0000 7f748b400700 1 -- 172.21.15.26:0/3210265716 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f748409a630 msgr2=0x7f74841270e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:44.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.104+0000 7f748b400700 1 --2- 172.21.15.26:0/3210265716 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f748409a630 0x7f74841270e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7480000c00 tx=0x7f7480004750 comp rx=0 tx=0).stop 2023-10-01T07:54:44.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.104+0000 7f748b400700 1 -- 172.21.15.26:0/3210265716 shutdown_connections 2023-10-01T07:54:44.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.104+0000 7f748b400700 1 --2- 172.21.15.26:0/3210265716 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7484130840 0x7f7484127b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:44.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.104+0000 7f748b400700 1 --2- 172.21.15.26:0/3210265716 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f748409a630 0x7f74841270e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:44.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.104+0000 7f748b400700 1 --2- 172.21.15.26:0/3210265716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f748409aef0 0x7f7484127620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:44.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.104+0000 7f748b400700 1 -- 172.21.15.26:0/3210265716 >> 172.21.15.26:0/3210265716 conn(0x7f74840a2c80 msgr2=0x7f7484098810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:44.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.104+0000 7f748b400700 1 -- 172.21.15.26:0/3210265716 shutdown_connections 2023-10-01T07:54:44.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.104+0000 7f748b400700 1 -- 172.21.15.26:0/3210265716 wait complete. 2023-10-01T07:54:44.105 INFO:teuthology.orchestra.run.smithi026.stderr:set pool 3 pg_autoscale_mode to off 2023-10-01T07:54:44.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.229+0000 7f2e0b846700 1 Processor -- start 2023-10-01T07:54:44.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.229+0000 7f2e0b846700 1 -- start start 2023-10-01T07:54:44.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.230+0000 7f2e0b846700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e0409d950 0x7f2e0409dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:44.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.230+0000 7f2e0b846700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2e0409e260 0x7f2e04130780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:44.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.230+0000 7f2e0b846700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e04130cc0 0x7f2e04131140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:44.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.230+0000 7f2e0b846700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e0409f510 con 0x7f2e0409e260 2023-10-01T07:54:44.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.230+0000 7f2e0b846700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0409bd00 con 0x7f2e0409d950 2023-10-01T07:54:44.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.230+0000 7f2e0b846700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0409a350 con 0x7f2e04130cc0 2023-10-01T07:54:44.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.230+0000 7f2e095e2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e0409d950 0x7f2e0409dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:44.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.230+0000 7f2e08de1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2e0409e260 0x7f2e04130780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:44.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.230+0000 7f2e08de1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2e0409e260 0x7f2e04130780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41552/0 (socket says 172.21.15.26:41552) 2023-10-01T07:54:44.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.230+0000 7f2e095e2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e0409d950 0x7f2e0409dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45986/0 (socket says 172.21.15.26:45986) 2023-10-01T07:54:44.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.230+0000 7f2e08de1700 1 -- 172.21.15.26:0/2610546828 learned_addr learned my addr 172.21.15.26:0/2610546828 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:44.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.230+0000 7f2e09de3700 1 --2- 172.21.15.26:0/2610546828 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e04130cc0 0x7f2e04131140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:44.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.230+0000 7f2e08de1700 1 -- 172.21.15.26:0/2610546828 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e04130cc0 msgr2=0x7f2e04131140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:44.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.230+0000 7f2e08de1700 1 --2- 172.21.15.26:0/2610546828 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e04130cc0 0x7f2e04131140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:44.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.230+0000 7f2e08de1700 1 -- 172.21.15.26:0/2610546828 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e0409d950 msgr2=0x7f2e0409dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:44.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.230+0000 7f2e08de1700 1 --2- 172.21.15.26:0/2610546828 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e0409d950 0x7f2e0409dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:44.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.230+0000 7f2e08de1700 1 -- 172.21.15.26:0/2610546828 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e0409ac70 con 0x7f2e0409e260 2023-10-01T07:54:44.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.230+0000 7f2e09de3700 1 --2- 172.21.15.26:0/2610546828 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e04130cc0 0x7f2e04131140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:44.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.230+0000 7f2e095e2700 1 --2- 172.21.15.26:0/2610546828 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e0409d950 0x7f2e0409dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:44.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.231+0000 7f2e08de1700 1 --2- 172.21.15.26:0/2610546828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e0409e260 0x7f2e04130780 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2df8006fd0 tx=0x7f2df80096e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=379695021fc7d4e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:44.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.231+0000 7f2df7fff700 1 -- 172.21.15.26:0/2610546828 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df8005a20 con 0x7f2e0409e260 2023-10-01T07:54:44.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.231+0000 7f2df7fff700 1 -- 172.21.15.26:0/2610546828 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df8005b80 con 0x7f2e0409e260 2023-10-01T07:54:44.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.231+0000 7f2df7fff700 1 -- 172.21.15.26:0/2610546828 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df8004030 con 0x7f2e0409e260 2023-10-01T07:54:44.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.231+0000 7f2e0b846700 1 -- 172.21.15.26:0/2610546828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e0409e260 msgr2=0x7f2e04130780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:44.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.231+0000 7f2e0b846700 1 --2- 172.21.15.26:0/2610546828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e0409e260 0x7f2e04130780 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2df8006fd0 tx=0x7f2df80096e0 comp rx=0 tx=0).stop 2023-10-01T07:54:44.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.231+0000 7f2e0b846700 1 -- 172.21.15.26:0/2610546828 shutdown_connections 2023-10-01T07:54:44.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.231+0000 7f2e0b846700 1 --2- 172.21.15.26:0/2610546828 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e04130cc0 0x7f2e04131140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:44.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.231+0000 7f2e0b846700 1 --2- 172.21.15.26:0/2610546828 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e0409d950 0x7f2e0409dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:44.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.231+0000 7f2e0b846700 1 --2- 172.21.15.26:0/2610546828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e0409e260 0x7f2e04130780 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:44.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.231+0000 7f2e0b846700 1 -- 172.21.15.26:0/2610546828 >> 172.21.15.26:0/2610546828 conn(0x7f2e040a2f50 msgr2=0x7f2e040a3350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:44.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.232+0000 7f2e0b846700 1 -- 172.21.15.26:0/2610546828 shutdown_connections 2023-10-01T07:54:44.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.232+0000 7f2e0b846700 1 -- 172.21.15.26:0/2610546828 wait complete. 2023-10-01T07:54:44.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.233+0000 7f2e0b846700 1 Processor -- start 2023-10-01T07:54:44.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.233+0000 7f2e0b846700 1 -- start start 2023-10-01T07:54:44.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.233+0000 7f2e0b846700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e0409d950 0x7f2e0411e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:44.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.233+0000 7f2e0b846700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e0409e260 0x7f2e0411e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:44.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.233+0000 7f2e0b846700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e04130cc0 0x7f2e0411ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:44.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.233+0000 7f2e0b846700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e04120710 con 0x7f2e0409e260 2023-10-01T07:54:44.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.233+0000 7f2e0b846700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e04121d50 con 0x7f2e0409d950 2023-10-01T07:54:44.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.233+0000 7f2e0b846700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e041203f0 con 0x7f2e04130cc0 2023-10-01T07:54:44.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.233+0000 7f2e095e2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e0409d950 0x7f2e0411e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:44.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.233+0000 7f2e095e2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e0409d950 0x7f2e0411e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45992/0 (socket says 172.21.15.26:45992) 2023-10-01T07:54:44.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.233+0000 7f2e095e2700 1 -- 172.21.15.26:0/19108582 learned_addr learned my addr 172.21.15.26:0/19108582 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:44.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.233+0000 7f2e09de3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e04130cc0 0x7f2e0411ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:44.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.233+0000 7f2e08de1700 1 --2- 172.21.15.26:0/19108582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e0409e260 0x7f2e0411e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:44.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.234+0000 7f2e09de3700 1 -- 172.21.15.26:0/19108582 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e0409d950 msgr2=0x7f2e0411e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:44.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.234+0000 7f2e09de3700 1 --2- 172.21.15.26:0/19108582 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e0409d950 0x7f2e0411e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:44.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.234+0000 7f2e09de3700 1 -- 172.21.15.26:0/19108582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e0409e260 msgr2=0x7f2e0411e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:44.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.234+0000 7f2e09de3700 1 --2- 172.21.15.26:0/19108582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e0409e260 0x7f2e0411e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:44.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.234+0000 7f2e09de3700 1 -- 172.21.15.26:0/19108582 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e0000d8d0 con 0x7f2e04130cc0 2023-10-01T07:54:44.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.234+0000 7f2e08de1700 1 --2- 172.21.15.26:0/19108582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e0409e260 0x7f2e0411e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:44.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.234+0000 7f2e09de3700 1 --2- 172.21.15.26:0/19108582 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e04130cc0 0x7f2e0411ecb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc00efc0 tx=0x7f2dfc00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:44.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.234+0000 7f2df5ffb700 1 -- 172.21.15.26:0/19108582 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc00ca90 con 0x7f2e04130cc0 2023-10-01T07:54:44.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.234+0000 7f2df5ffb700 1 -- 172.21.15.26:0/19108582 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dfc00f040 con 0x7f2e04130cc0 2023-10-01T07:54:44.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.234+0000 7f2e0b846700 1 -- 172.21.15.26:0/19108582 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dfc009a70 con 0x7f2e04130cc0 2023-10-01T07:54:44.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.234+0000 7f2df5ffb700 1 -- 172.21.15.26:0/19108582 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc00ce30 con 0x7f2e04130cc0 2023-10-01T07:54:44.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.234+0000 7f2e0b846700 1 -- 172.21.15.26:0/19108582 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df80139f0 con 0x7f2e04130cc0 2023-10-01T07:54:44.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.235+0000 7f2df5ffb700 1 -- 172.21.15.26:0/19108582 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2dfc014480 con 0x7f2e04130cc0 2023-10-01T07:54:44.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.235+0000 7f2df5ffb700 1 -- 172.21.15.26:0/19108582 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f2dfc040220 con 0x7f2e04130cc0 2023-10-01T07:54:44.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.235+0000 7f2e095e2700 1 -- 172.21.15.26:0/19108582 >> v1:172.21.15.26:6816/126763 conn(0x7f2de802f510 legacy=0x7f2de80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:44.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.235+0000 7f2e0b846700 1 -- 172.21.15.26:0/19108582 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e04121870 con 0x7f2e04130cc0 2023-10-01T07:54:44.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.241+0000 7f2df5ffb700 1 -- 172.21.15.26:0/19108582 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2dfc012930 con 0x7f2e04130cc0 2023-10-01T07:54:44.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.436+0000 7f2e095e2700 1 -- 172.21.15.26:0/19108582 >> v1:172.21.15.26:6816/126763 conn(0x7f2de802f510 legacy=0x7f2de80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:44.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.445+0000 7f2e0b846700 1 -- 172.21.15.26:0/19108582 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f2e0404f2a0 con 0x7f2e04130cc0 2023-10-01T07:54:44.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:44.837+0000 7f2e095e2700 1 -- 172.21.15.26:0/19108582 >> v1:172.21.15.26:6816/126763 conn(0x7f2de802f510 legacy=0x7f2de80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:45.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.109+0000 7f2df5ffb700 1 -- 172.21.15.26:0/19108582 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 4 pg_autoscale_mode to off v38) v1 ==== 160+0+0 (secure 0 0 0) 0x7f2dfc012340 con 0x7f2e04130cc0 2023-10-01T07:54:45.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.112+0000 7f2e0b846700 1 -- 172.21.15.26:0/19108582 >> v1:172.21.15.26:6816/126763 conn(0x7f2de802f510 legacy=0x7f2de80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:45.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.112+0000 7f2e0b846700 1 -- 172.21.15.26:0/19108582 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e04130cc0 msgr2=0x7f2e0411ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:45.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.112+0000 7f2e0b846700 1 --2- 172.21.15.26:0/19108582 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e04130cc0 0x7f2e0411ecb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc00efc0 tx=0x7f2dfc00c3a0 comp rx=0 tx=0).stop 2023-10-01T07:54:45.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.112+0000 7f2e0b846700 1 -- 172.21.15.26:0/19108582 shutdown_connections 2023-10-01T07:54:45.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.112+0000 7f2e0b846700 1 --2- 172.21.15.26:0/19108582 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e04130cc0 0x7f2e0411ecb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:45.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.112+0000 7f2e0b846700 1 --2- 172.21.15.26:0/19108582 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e0409d950 0x7f2e0411e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:45.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.112+0000 7f2e0b846700 1 --2- 172.21.15.26:0/19108582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e0409e260 0x7f2e0411e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:45.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.112+0000 7f2e0b846700 1 -- 172.21.15.26:0/19108582 >> 172.21.15.26:0/19108582 conn(0x7f2e040a2f50 msgr2=0x7f2e040a0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:45.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.112+0000 7f2e0b846700 1 -- 172.21.15.26:0/19108582 shutdown_connections 2023-10-01T07:54:45.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.112+0000 7f2e0b846700 1 -- 172.21.15.26:0/19108582 wait complete. 2023-10-01T07:54:45.113 INFO:teuthology.orchestra.run.smithi026.stderr:set pool 4 pg_autoscale_mode to off 2023-10-01T07:54:45.128 DEBUG:teuthology.orchestra.run.smithi026:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd require-osd-release reef' 2023-10-01T07:54:45.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.267+0000 7f564f640700 1 Processor -- start 2023-10-01T07:54:45.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.267+0000 7f564f640700 1 -- start start 2023-10-01T07:54:45.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.267+0000 7f564f640700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f564809e9d0 0x7f564809eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:45.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.267+0000 7f564f640700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f56481342b0 0x7f564813be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:45.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.267+0000 7f564f640700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f564806db50 con 0x7f564809f2e0 2023-10-01T07:54:45.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.267+0000 7f564f640700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564806d7d0 con 0x7f56481342b0 2023-10-01T07:54:45.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.267+0000 7f564f640700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f564809ae00 con 0x7f564809e9d0 2023-10-01T07:54:45.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.268+0000 7f564dbdd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f56481342b0 0x7f564813be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:45.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.268+0000 7f564cbdb700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f564809f2e0 0x7f5648133ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59996/0 (socket says 172.21.15.26:59996) 2023-10-01T07:54:45.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.268+0000 7f564d3dc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f564809e9d0 0x7f564809eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:45.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.268+0000 7f564cbdb700 1 -- 172.21.15.26:0/1805101051 learned_addr learned my addr 172.21.15.26:0/1805101051 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:45.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.268+0000 7f564dbdd700 1 -- 172.21.15.26:0/1805101051 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f564809e9d0 msgr2=0x7f564809eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:45.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.268+0000 7f563ffff700 1 -- 172.21.15.26:0/1805101051 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 75610594 0 0) 0x7f564806db50 con 0x7f564809f2e0 2023-10-01T07:54:45.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.268+0000 7f564dbdd700 1 --2- 172.21.15.26:0/1805101051 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f564809e9d0 0x7f564809eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:45.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.268+0000 7f564dbdd700 1 -- 172.21.15.26:0/1805101051 >> v1:172.21.15.26:6789/0 conn(0x7f564809f2e0 legacy=0x7f5648133ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:45.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.268+0000 7f564dbdd700 1 -- 172.21.15.26:0/1805101051 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564806cb10 con 0x7f56481342b0 2023-10-01T07:54:45.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.268+0000 7f564d3dc700 1 --2- 172.21.15.26:0/1805101051 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f564809e9d0 0x7f564809eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:45.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.268+0000 7f564dbdd700 1 --2- 172.21.15.26:0/1805101051 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f56481342b0 0x7f564813be00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5640009dc0 tx=0x7f564000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1c42210c0234f73 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:45.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.268+0000 7f563ffff700 1 -- 172.21.15.26:0/1805101051 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564000e070 con 0x7f56481342b0 2023-10-01T07:54:45.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.268+0000 7f563ffff700 1 -- 172.21.15.26:0/1805101051 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564000bb20 con 0x7f56481342b0 2023-10-01T07:54:45.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.268+0000 7f563ffff700 1 -- 172.21.15.26:0/1805101051 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5640012430 con 0x7f56481342b0 2023-10-01T07:54:45.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.269+0000 7f564f640700 1 -- 172.21.15.26:0/1805101051 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f56481342b0 msgr2=0x7f564813be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:45.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.269+0000 7f564f640700 1 --2- 172.21.15.26:0/1805101051 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f56481342b0 0x7f564813be00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5640009dc0 tx=0x7f564000b330 comp rx=0 tx=0).stop 2023-10-01T07:54:45.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.269+0000 7f564f640700 1 -- 172.21.15.26:0/1805101051 shutdown_connections 2023-10-01T07:54:45.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.269+0000 7f564f640700 1 --2- 172.21.15.26:0/1805101051 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f564809e9d0 0x7f564809eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:45.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.269+0000 7f564f640700 1 --2- 172.21.15.26:0/1805101051 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f56481342b0 0x7f564813be00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:45.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.269+0000 7f564f640700 1 -- 172.21.15.26:0/1805101051 >> 172.21.15.26:0/1805101051 conn(0x7f56480a43c0 msgr2=0x7f56480a47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:45.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.269+0000 7f564f640700 1 -- 172.21.15.26:0/1805101051 shutdown_connections 2023-10-01T07:54:45.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.269+0000 7f564f640700 1 -- 172.21.15.26:0/1805101051 wait complete. 2023-10-01T07:54:45.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.271+0000 7f564f640700 1 Processor -- start 2023-10-01T07:54:45.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.271+0000 7f564f640700 1 -- start start 2023-10-01T07:54:45.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.271+0000 7f564f640700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f564809e9d0 0x7f5648122880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:45.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.271+0000 7f564f640700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f564809f2e0 0x7f5648122dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:45.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.271+0000 7f564f640700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f56481342b0 0x7f5648123300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:45.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.271+0000 7f564f640700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5648124c50 con 0x7f564809e9d0 2023-10-01T07:54:45.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.271+0000 7f564f640700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56480a3c80 con 0x7f56481342b0 2023-10-01T07:54:45.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.271+0000 7f564f640700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5648124490 con 0x7f564809f2e0 2023-10-01T07:54:45.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.272+0000 7f564cbdb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f564809f2e0 0x7f5648122dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:45.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.272+0000 7f564d3dc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f564809e9d0 0x7f5648122880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:45.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.272+0000 7f564d3dc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f564809e9d0 0x7f5648122880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41570/0 (socket says 172.21.15.26:41570) 2023-10-01T07:54:45.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.272+0000 7f564cbdb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f564809f2e0 0x7f5648122dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41342/0 (socket says 172.21.15.26:41342) 2023-10-01T07:54:45.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.272+0000 7f564d3dc700 1 -- 172.21.15.26:0/4179455988 learned_addr learned my addr 172.21.15.26:0/4179455988 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:45.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.272+0000 7f564dbdd700 1 --2- 172.21.15.26:0/4179455988 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f56481342b0 0x7f5648123300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:45.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.272+0000 7f564d3dc700 1 -- 172.21.15.26:0/4179455988 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f564809f2e0 msgr2=0x7f5648122dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:45.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.272+0000 7f564d3dc700 1 --2- 172.21.15.26:0/4179455988 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f564809f2e0 0x7f5648122dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:45.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.272+0000 7f564d3dc700 1 -- 172.21.15.26:0/4179455988 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f56481342b0 msgr2=0x7f5648123300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:45.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.272+0000 7f564d3dc700 1 --2- 172.21.15.26:0/4179455988 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f56481342b0 0x7f5648123300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:45.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.272+0000 7f564d3dc700 1 -- 172.21.15.26:0/4179455988 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56440094a0 con 0x7f564809e9d0 2023-10-01T07:54:45.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.272+0000 7f564cbdb700 1 --2- 172.21.15.26:0/4179455988 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f564809f2e0 0x7f5648122dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:45.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.272+0000 7f564d3dc700 1 --2- 172.21.15.26:0/4179455988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f564809e9d0 0x7f5648122880 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f564400ebe0 tx=0x7f564400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:45.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.272+0000 7f563dffb700 1 -- 172.21.15.26:0/4179455988 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564400c850 con 0x7f564809e9d0 2023-10-01T07:54:45.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.272+0000 7f563dffb700 1 -- 172.21.15.26:0/4179455988 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564400c9b0 con 0x7f564809e9d0 2023-10-01T07:54:45.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.272+0000 7f564f640700 1 -- 172.21.15.26:0/4179455988 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5640009a70 con 0x7f564809e9d0 2023-10-01T07:54:45.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.272+0000 7f563dffb700 1 -- 172.21.15.26:0/4179455988 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564400cd40 con 0x7f564809e9d0 2023-10-01T07:54:45.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.273+0000 7f564f640700 1 -- 172.21.15.26:0/4179455988 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5648125fb0 con 0x7f564809e9d0 2023-10-01T07:54:45.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.273+0000 7f563dffb700 1 -- 172.21.15.26:0/4179455988 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5644013470 con 0x7f564809e9d0 2023-10-01T07:54:45.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.274+0000 7f563dffb700 1 -- 172.21.15.26:0/4179455988 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f564403fff0 con 0x7f564809e9d0 2023-10-01T07:54:45.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.274+0000 7f564cbdb700 1 -- 172.21.15.26:0/4179455988 >> v1:172.21.15.26:6816/126763 conn(0x7f562c02f510 legacy=0x7f562c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:45.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.274+0000 7f564f640700 1 -- 172.21.15.26:0/4179455988 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f564804f2a0 con 0x7f564809e9d0 2023-10-01T07:54:45.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.279+0000 7f563dffb700 1 -- 172.21.15.26:0/4179455988 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5644017020 con 0x7f564809e9d0 2023-10-01T07:54:45.346 INFO:tasks.ceph.mgr.x.smithi026.stderr:daemon-helper: command crashed with signal 6 2023-10-01T07:54:45.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.475+0000 7f564cbdb700 1 -- 172.21.15.26:0/4179455988 >> v1:172.21.15.26:6816/126763 conn(0x7f562c02f510 legacy=0x7f562c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:45.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.497+0000 7f564f640700 1 -- 172.21.15.26:0/4179455988 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd require-osd-release", "release": "reef"} v 0) v1 -- 0x7f564806b830 con 0x7f564809e9d0 2023-10-01T07:54:45.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:45.876+0000 7f564cbdb700 1 -- 172.21.15.26:0/4179455988 >> v1:172.21.15.26:6816/126763 conn(0x7f562c02f510 legacy=0x7f562c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:46.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.109+0000 7f563dffb700 1 -- 172.21.15.26:0/4179455988 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd require-osd-release", "release": "reef"}]=0 v39) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5644013720 con 0x7f564809e9d0 2023-10-01T07:54:46.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.113+0000 7f564f640700 1 -- 172.21.15.26:0/4179455988 >> v1:172.21.15.26:6816/126763 conn(0x7f562c02f510 legacy=0x7f562c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:46.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.113+0000 7f564f640700 1 -- 172.21.15.26:0/4179455988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f564809e9d0 msgr2=0x7f5648122880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:46.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.113+0000 7f564f640700 1 --2- 172.21.15.26:0/4179455988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f564809e9d0 0x7f5648122880 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f564400ebe0 tx=0x7f564400eef0 comp rx=0 tx=0).stop 2023-10-01T07:54:46.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.113+0000 7f564f640700 1 -- 172.21.15.26:0/4179455988 shutdown_connections 2023-10-01T07:54:46.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.113+0000 7f564f640700 1 --2- 172.21.15.26:0/4179455988 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f56481342b0 0x7f5648123300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:46.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.113+0000 7f564f640700 1 --2- 172.21.15.26:0/4179455988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f564809e9d0 0x7f5648122880 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:46.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.113+0000 7f564f640700 1 --2- 172.21.15.26:0/4179455988 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f564809f2e0 0x7f5648122dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:46.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.113+0000 7f564f640700 1 -- 172.21.15.26:0/4179455988 >> 172.21.15.26:0/4179455988 conn(0x7f56480a43c0 msgr2=0x7f564809c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:46.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.115+0000 7f564f640700 1 -- 172.21.15.26:0/4179455988 shutdown_connections 2023-10-01T07:54:46.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.115+0000 7f564f640700 1 -- 172.21.15.26:0/4179455988 wait complete. 2023-10-01T07:54:46.131 INFO:teuthology.run_tasks:Running task ceph.healthy... 2023-10-01T07:54:46.142 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-01T07:54:46.142 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-01T07:54:46.143 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-01T07:54:46.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.283+0000 7f74f8d61700 1 Processor -- start 2023-10-01T07:54:46.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.284+0000 7f74f8d61700 1 -- start start 2023-10-01T07:54:46.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.284+0000 7f74f8d61700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f74f409d6f0 0x7f74f409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:46.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.284+0000 7f74f8d61700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f74f409e000 0x7f74f41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:46.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.284+0000 7f74f8d61700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f74f409e410 0x7f74f4133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:46.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.284+0000 7f74f8d61700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74f406b460 con 0x7f74f409d6f0 2023-10-01T07:54:46.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.284+0000 7f74f8d61700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74f409b120 con 0x7f74f409e000 2023-10-01T07:54:46.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.284+0000 7f74f8d61700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74f409a7e0 con 0x7f74f409e410 2023-10-01T07:54:46.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.284+0000 7f74f259c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f74f409d6f0 0x7f74f409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:46.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.284+0000 7f74ebfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f74f409e000 0x7f74f41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:46.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.284+0000 7f74f2d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f74f409e410 0x7f74f4133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:46.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.284+0000 7f74f259c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f74f409d6f0 0x7f74f409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41584/0 (socket says 172.21.15.26:41584) 2023-10-01T07:54:46.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.284+0000 7f74ebfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f74f409e000 0x7f74f41339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46006/0 (socket says 172.21.15.26:46006) 2023-10-01T07:54:46.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.284+0000 7f74f259c700 1 -- 172.21.15.26:0/2960023939 learned_addr learned my addr 172.21.15.26:0/2960023939 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:46.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.285+0000 7f74f259c700 1 -- 172.21.15.26:0/2960023939 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f74f409e410 msgr2=0x7f74f4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:46.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.285+0000 7f74f259c700 1 --2- 172.21.15.26:0/2960023939 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f74f409e410 0x7f74f4133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:46.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.285+0000 7f74f259c700 1 -- 172.21.15.26:0/2960023939 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f74f409e000 msgr2=0x7f74f41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:46.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.285+0000 7f74f259c700 1 --2- 172.21.15.26:0/2960023939 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f74f409e000 0x7f74f41339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:46.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.285+0000 7f74f259c700 1 -- 172.21.15.26:0/2960023939 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f409a500 con 0x7f74f409d6f0 2023-10-01T07:54:46.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.285+0000 7f74f2d9d700 1 --2- 172.21.15.26:0/2960023939 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f74f409e410 0x7f74f4133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:46.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.285+0000 7f74ebfff700 1 --2- 172.21.15.26:0/2960023939 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f74f409e000 0x7f74f41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:46.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.285+0000 7f74f259c700 1 --2- 172.21.15.26:0/2960023939 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74f409d6f0 0x7f74f409dac0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f74e40098f0 tx=0x7f74e4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd9639c36cff30cb server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:46.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.285+0000 7f74f1d9b700 1 -- 172.21.15.26:0/2960023939 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e4011830 con 0x7f74f409d6f0 2023-10-01T07:54:46.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.285+0000 7f74f1d9b700 1 -- 172.21.15.26:0/2960023939 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e4011990 con 0x7f74f409d6f0 2023-10-01T07:54:46.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.285+0000 7f74f1d9b700 1 -- 172.21.15.26:0/2960023939 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e4011d20 con 0x7f74f409d6f0 2023-10-01T07:54:46.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.286+0000 7f74f8d61700 1 -- 172.21.15.26:0/2960023939 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74f409d6f0 msgr2=0x7f74f409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:46.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.286+0000 7f74f8d61700 1 --2- 172.21.15.26:0/2960023939 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74f409d6f0 0x7f74f409dac0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f74e40098f0 tx=0x7f74e4009c00 comp rx=0 tx=0).stop 2023-10-01T07:54:46.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.286+0000 7f74f8d61700 1 -- 172.21.15.26:0/2960023939 shutdown_connections 2023-10-01T07:54:46.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.286+0000 7f74f8d61700 1 --2- 172.21.15.26:0/2960023939 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f74f409e410 0x7f74f4133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:46.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.286+0000 7f74f8d61700 1 --2- 172.21.15.26:0/2960023939 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74f409d6f0 0x7f74f409dac0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:46.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.286+0000 7f74f8d61700 1 --2- 172.21.15.26:0/2960023939 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f74f409e000 0x7f74f41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:46.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.286+0000 7f74f8d61700 1 -- 172.21.15.26:0/2960023939 >> 172.21.15.26:0/2960023939 conn(0x7f74f4066f50 msgr2=0x7f74f409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:46.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.286+0000 7f74f8d61700 1 -- 172.21.15.26:0/2960023939 shutdown_connections 2023-10-01T07:54:46.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.286+0000 7f74f8d61700 1 -- 172.21.15.26:0/2960023939 wait complete. 2023-10-01T07:54:46.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.287+0000 7f74f8d61700 1 Processor -- start 2023-10-01T07:54:46.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.287+0000 7f74f8d61700 1 -- start start 2023-10-01T07:54:46.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.287+0000 7f74f8d61700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74f409d6f0 0x7f74f41c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:46.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.287+0000 7f74f8d61700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f74f409e000 0x7f74f41c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:46.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.287+0000 7f74f8d61700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f74f409e410 0x7f74f41c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:46.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.287+0000 7f74f8d61700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f41a6660 con 0x7f74f409d6f0 2023-10-01T07:54:46.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.287+0000 7f74f8d61700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74f41a6430 con 0x7f74f409e000 2023-10-01T07:54:46.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.287+0000 7f74f8d61700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74f41a70a0 con 0x7f74f409e410 2023-10-01T07:54:46.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.288+0000 7f74ebfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f74f409e000 0x7f74f41c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:46.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.288+0000 7f74f2d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f74f409e410 0x7f74f41c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:46.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.288+0000 7f74ebfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f74f409e000 0x7f74f41c85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46016/0 (socket says 172.21.15.26:46016) 2023-10-01T07:54:46.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.288+0000 7f74ebfff700 1 -- 172.21.15.26:0/1287361572 learned_addr learned my addr 172.21.15.26:0/1287361572 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:46.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.288+0000 7f74f259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74f409d6f0 0x7f74f41c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:46.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.288+0000 7f74f2d9d700 1 -- 172.21.15.26:0/1287361572 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f74f409e000 msgr2=0x7f74f41c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:46.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.288+0000 7f74f2d9d700 1 --2- 172.21.15.26:0/1287361572 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f74f409e000 0x7f74f41c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:46.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.288+0000 7f74f2d9d700 1 -- 172.21.15.26:0/1287361572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74f409d6f0 msgr2=0x7f74f41c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:46.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.288+0000 7f74f2d9d700 1 --2- 172.21.15.26:0/1287361572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74f409d6f0 0x7f74f41c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:46.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.288+0000 7f74f2d9d700 1 -- 172.21.15.26:0/1287361572 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74dc0094a0 con 0x7f74f409e410 2023-10-01T07:54:46.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.288+0000 7f74f259c700 1 --2- 172.21.15.26:0/1287361572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74f409d6f0 0x7f74f41c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:46.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.288+0000 7f74ebfff700 1 --2- 172.21.15.26:0/1287361572 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f74f409e000 0x7f74f41c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:46.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.288+0000 7f74f2d9d700 1 --2- 172.21.15.26:0/1287361572 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f74f409e410 0x7f74f41c8b10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f74ec009e50 tx=0x7f74ec00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:46.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.288+0000 7f74eaffd700 1 -- 172.21.15.26:0/1287361572 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec00ca90 con 0x7f74f409e410 2023-10-01T07:54:46.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.288+0000 7f74eaffd700 1 -- 172.21.15.26:0/1287361572 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ec00f040 con 0x7f74f409e410 2023-10-01T07:54:46.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.288+0000 7f74eaffd700 1 -- 172.21.15.26:0/1287361572 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec00ce50 con 0x7f74f409e410 2023-10-01T07:54:46.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.288+0000 7f74f8d61700 1 -- 172.21.15.26:0/1287361572 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74ec009a70 con 0x7f74f409e410 2023-10-01T07:54:46.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.288+0000 7f74f8d61700 1 -- 172.21.15.26:0/1287361572 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e4009550 con 0x7f74f409e410 2023-10-01T07:54:46.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.289+0000 7f74eaffd700 1 -- 172.21.15.26:0/1287361572 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f74ec014480 con 0x7f74f409e410 2023-10-01T07:54:46.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.289+0000 7f74eaffd700 1 -- 172.21.15.26:0/1287361572 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f74ec0401f0 con 0x7f74f409e410 2023-10-01T07:54:46.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.289+0000 7f74f259c700 1 -- 172.21.15.26:0/1287361572 >> v1:172.21.15.26:6816/126763 conn(0x7f74d402f510 legacy=0x7f74d40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:46.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.290+0000 7f74f8d61700 1 -- 172.21.15.26:0/1287361572 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74f41a7fc0 con 0x7f74f409e410 2023-10-01T07:54:46.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.295+0000 7f74eaffd700 1 -- 172.21.15.26:0/1287361572 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f74ec012930 con 0x7f74f409e410 2023-10-01T07:54:46.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.490+0000 7f74f259c700 1 -- 172.21.15.26:0/1287361572 >> v1:172.21.15.26:6816/126763 conn(0x7f74d402f510 legacy=0x7f74d40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:46.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.560+0000 7f74f8d61700 1 -- 172.21.15.26:0/1287361572 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f74f409c710 con 0x7f74f409e410 2023-10-01T07:54:46.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.562+0000 7f74eaffd700 1 -- 172.21.15.26:0/1287361572 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v9) v1 ==== 74+0+70484 (secure 0 0 0) 0x7f74ec018020 con 0x7f74f409e410 2023-10-01T07:54:46.563 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:54:46.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.564+0000 7f74f8d61700 1 -- 172.21.15.26:0/1287361572 >> v1:172.21.15.26:6816/126763 conn(0x7f74d402f510 legacy=0x7f74d40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:46.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.565+0000 7f74f8d61700 1 -- 172.21.15.26:0/1287361572 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f74f409e410 msgr2=0x7f74f41c8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:46.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.565+0000 7f74f8d61700 1 --2- 172.21.15.26:0/1287361572 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f74f409e410 0x7f74f41c8b10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f74ec009e50 tx=0x7f74ec00c3a0 comp rx=0 tx=0).stop 2023-10-01T07:54:46.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.565+0000 7f74f8d61700 1 -- 172.21.15.26:0/1287361572 shutdown_connections 2023-10-01T07:54:46.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.565+0000 7f74f8d61700 1 --2- 172.21.15.26:0/1287361572 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f74f409e410 0x7f74f41c8b10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:46.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.565+0000 7f74f8d61700 1 --2- 172.21.15.26:0/1287361572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74f409d6f0 0x7f74f41c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:46.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.565+0000 7f74f8d61700 1 --2- 172.21.15.26:0/1287361572 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f74f409e000 0x7f74f41c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:46.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.565+0000 7f74f8d61700 1 -- 172.21.15.26:0/1287361572 >> 172.21.15.26:0/1287361572 conn(0x7f74f4066f50 msgr2=0x7f74f406f350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:46.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.565+0000 7f74f8d61700 1 -- 172.21.15.26:0/1287361572 shutdown_connections 2023-10-01T07:54:46.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.565+0000 7f74f8d61700 1 -- 172.21.15.26:0/1287361572 wait complete. 2023-10-01T07:54:46.579 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":9,"active_gid":14101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6816","nonce":126763}]},"active_addr":"172.21.15.26:6816/126763","active_change":"2023-10-01T07:54:14.803577+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":21,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.26:0","nonce":3996608962}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.26:0","nonce":3694083100}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.26:0","nonce":2793881876}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.26:0","nonce":3455045759}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.26:0","nonce":3315382155}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.26:0","nonce":1542035933}]}]} 2023-10-01T07:54:46.581 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-01T07:54:46.581 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-01T07:54:46.581 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-01T07:54:46.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.716+0000 7f2e33fb9700 1 Processor -- start 2023-10-01T07:54:46.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.716+0000 7f2e33fb9700 1 -- start start 2023-10-01T07:54:46.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.717+0000 7f2e33fb9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2e2c09d6f0 0x7f2e2c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:46.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.717+0000 7f2e33fb9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e2c09e000 0x7f2e2c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:46.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.717+0000 7f2e33fb9700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e2c09b120 con 0x7f2e2c09e410 2023-10-01T07:54:46.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.717+0000 7f2e33fb9700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e2c06b460 con 0x7f2e2c09d6f0 2023-10-01T07:54:46.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.717+0000 7f2e33fb9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c09a7e0 con 0x7f2e2c09e000 2023-10-01T07:54:46.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.717+0000 7f2e31554700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e2c09e000 0x7f2e2c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:46.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.717+0000 7f2e31d55700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2e2c09d6f0 0x7f2e2c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:46.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.717+0000 7f2e32556700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2e2c09e410 0x7f2e2c133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59998/0 (socket says 172.21.15.26:59998) 2023-10-01T07:54:46.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.717+0000 7f2e32556700 1 -- 172.21.15.26:0/801490679 learned_addr learned my addr 172.21.15.26:0/801490679 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:46.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.717+0000 7f2e31d55700 1 -- 172.21.15.26:0/801490679 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e2c09e000 msgr2=0x7f2e2c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:46.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.717+0000 7f2e31d55700 1 --2- 172.21.15.26:0/801490679 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e2c09e000 0x7f2e2c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:46.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.717+0000 7f2e31d55700 1 -- 172.21.15.26:0/801490679 >> v1:172.21.15.26:6789/0 conn(0x7f2e2c09e410 legacy=0x7f2e2c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:46.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.717+0000 7f2e31d55700 1 -- 172.21.15.26:0/801490679 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2c09a500 con 0x7f2e2c09d6f0 2023-10-01T07:54:46.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.717+0000 7f2e31554700 1 --2- 172.21.15.26:0/801490679 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e2c09e000 0x7f2e2c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:46.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.717+0000 7f2e31d55700 1 --2- 172.21.15.26:0/801490679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e2c09d6f0 0x7f2e2c09dac0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2e28009840 tx=0x7f2e28009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=493d71071c9a92bf server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:46.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.718+0000 7f2e30d53700 1 -- 172.21.15.26:0/801490679 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e28011830 con 0x7f2e2c09d6f0 2023-10-01T07:54:46.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.718+0000 7f2e30d53700 1 -- 172.21.15.26:0/801490679 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e28011990 con 0x7f2e2c09d6f0 2023-10-01T07:54:46.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.718+0000 7f2e30d53700 1 -- 172.21.15.26:0/801490679 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e28011d20 con 0x7f2e2c09d6f0 2023-10-01T07:54:46.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.718+0000 7f2e33fb9700 1 -- 172.21.15.26:0/801490679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e2c09d6f0 msgr2=0x7f2e2c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:46.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.718+0000 7f2e33fb9700 1 --2- 172.21.15.26:0/801490679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e2c09d6f0 0x7f2e2c09dac0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2e28009840 tx=0x7f2e28009b50 comp rx=0 tx=0).stop 2023-10-01T07:54:46.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.718+0000 7f2e33fb9700 1 -- 172.21.15.26:0/801490679 shutdown_connections 2023-10-01T07:54:46.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.718+0000 7f2e33fb9700 1 --2- 172.21.15.26:0/801490679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e2c09d6f0 0x7f2e2c09dac0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:46.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.718+0000 7f2e33fb9700 1 --2- 172.21.15.26:0/801490679 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e2c09e000 0x7f2e2c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:46.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.718+0000 7f2e33fb9700 1 -- 172.21.15.26:0/801490679 >> 172.21.15.26:0/801490679 conn(0x7f2e2c066f50 msgr2=0x7f2e2c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:46.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.718+0000 7f2e33fb9700 1 -- 172.21.15.26:0/801490679 shutdown_connections 2023-10-01T07:54:46.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.718+0000 7f2e33fb9700 1 -- 172.21.15.26:0/801490679 wait complete. 2023-10-01T07:54:46.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.719+0000 7f2e33fb9700 1 Processor -- start 2023-10-01T07:54:46.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.719+0000 7f2e33fb9700 1 -- start start 2023-10-01T07:54:46.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.720+0000 7f2e33fb9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e2c09d6f0 0x7f2e2c1a5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:46.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.720+0000 7f2e33fb9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e2c09e000 0x7f2e2c1a63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:46.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.720+0000 7f2e33fb9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e2c09e410 0x7f2e2c1a6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:46.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.720+0000 7f2e33fb9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c1a7340 con 0x7f2e2c09d6f0 2023-10-01T07:54:46.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.720+0000 7f2e33fb9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c1a7ac0 con 0x7f2e2c09e410 2023-10-01T07:54:46.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.720+0000 7f2e33fb9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c1a80e0 con 0x7f2e2c09e000 2023-10-01T07:54:46.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.720+0000 7f2e31d55700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e2c09d6f0 0x7f2e2c1a5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:46.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.720+0000 7f2e31554700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e2c09e000 0x7f2e2c1a63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:46.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.720+0000 7f2e31d55700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e2c09d6f0 0x7f2e2c1a5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41616/0 (socket says 172.21.15.26:41616) 2023-10-01T07:54:46.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.720+0000 7f2e31d55700 1 -- 172.21.15.26:0/876240156 learned_addr learned my addr 172.21.15.26:0/876240156 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:46.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.720+0000 7f2e32556700 1 --2- 172.21.15.26:0/876240156 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e2c09e410 0x7f2e2c1a6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:46.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.720+0000 7f2e31554700 1 -- 172.21.15.26:0/876240156 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e2c09e410 msgr2=0x7f2e2c1a6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:46.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.720+0000 7f2e31554700 1 --2- 172.21.15.26:0/876240156 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e2c09e410 0x7f2e2c1a6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:46.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.720+0000 7f2e31554700 1 -- 172.21.15.26:0/876240156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e2c09d6f0 msgr2=0x7f2e2c1a5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:46.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.720+0000 7f2e31554700 1 --2- 172.21.15.26:0/876240156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e2c09d6f0 0x7f2e2c1a5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:46.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.720+0000 7f2e31554700 1 -- 172.21.15.26:0/876240156 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1c0094a0 con 0x7f2e2c09e000 2023-10-01T07:54:46.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.720+0000 7f2e31d55700 1 --2- 172.21.15.26:0/876240156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e2c09d6f0 0x7f2e2c1a5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:46.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.721+0000 7f2e31554700 1 --2- 172.21.15.26:0/876240156 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e2c09e000 0x7f2e2c1a63f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c00e9e0 tx=0x7f2e1c00ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:46.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.721+0000 7f2e227fc700 1 -- 172.21.15.26:0/876240156 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c00ee80 con 0x7f2e2c09e000 2023-10-01T07:54:46.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.721+0000 7f2e227fc700 1 -- 172.21.15.26:0/876240156 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1c00c850 con 0x7f2e2c09e000 2023-10-01T07:54:46.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.721+0000 7f2e33fb9700 1 -- 172.21.15.26:0/876240156 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e280094a0 con 0x7f2e2c09e000 2023-10-01T07:54:46.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.721+0000 7f2e227fc700 1 -- 172.21.15.26:0/876240156 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c00cc00 con 0x7f2e2c09e000 2023-10-01T07:54:46.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.721+0000 7f2e33fb9700 1 -- 172.21.15.26:0/876240156 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e2c0a3220 con 0x7f2e2c09e000 2023-10-01T07:54:46.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.722+0000 7f2e227fc700 1 -- 172.21.15.26:0/876240156 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2e1c00cd60 con 0x7f2e2c09e000 2023-10-01T07:54:46.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.722+0000 7f2e33fb9700 1 -- 172.21.15.26:0/876240156 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e2c09c770 con 0x7f2e2c09e000 2023-10-01T07:54:46.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.722+0000 7f2e31d55700 1 -- 172.21.15.26:0/876240156 >> v1:172.21.15.26:6816/126763 conn(0x7f2e1002f510 legacy=0x7f2e100319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:46.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.722+0000 7f2e227fc700 1 -- 172.21.15.26:0/876240156 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f2e1c03fc10 con 0x7f2e2c09e000 2023-10-01T07:54:46.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.727+0000 7f2e227fc700 1 -- 172.21.15.26:0/876240156 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e1c01b3b0 con 0x7f2e2c09e000 2023-10-01T07:54:46.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.923+0000 7f2e31d55700 1 -- 172.21.15.26:0/876240156 >> v1:172.21.15.26:6816/126763 conn(0x7f2e1002f510 legacy=0x7f2e100319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:46.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.933+0000 7f2e33fb9700 1 -- 172.21.15.26:0/876240156 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e2c1a95c0 con 0x7f2e2c09e000 2023-10-01T07:54:46.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.934+0000 7f2e227fc700 1 -- 172.21.15.26:0/876240156 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+13012 (secure 0 0 0) 0x7f2e1c017070 con 0x7f2e2c09e000 2023-10-01T07:54:46.934 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:54:46.935 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":39,"fsid":"c29fb19d-520c-42a6-90f4-e7f86de96e8e","created":"2023-10-01T07:51:40.702414+0000","modified":"2023-10-01T07:54:46.105745+0000","last_up_change":"2023-10-01T07:54:35.033170+0000","last_in_change":"2023-10-01T07:51:42.084736+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-01T07:51:48.906889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-01T07:51:50.071599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-01T07:51:54.981575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-01T07:51:56.286318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46569ce3-81d1-44a1-a649-691de3e6f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6800","nonce":129479}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6801","nonce":129479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6803","nonce":129479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6802","nonce":129479}]},"public_addr":"172.21.15.26:6800/129479","cluster_addr":"172.21.15.26:6801/129479","heartbeat_back_addr":"172.21.15.26:6803/129479","heartbeat_front_addr":"172.21.15.26:6802/129479","state":["exists","up"]},{"osd":1,"uuid":"1fc1ba9b-4110-4d31-96d6-794937578cff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6804","nonce":129577}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6805","nonce":129577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6807","nonce":129577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6806","nonce":129577}]},"public_addr":"172.21.15.26:6804/129577","cluster_addr":"172.21.15.26:6805/129577","heartbeat_back_addr":"172.21.15.26:6807/129577","heartbeat_front_addr":"172.21.15.26:6806/129577","state":["exists","up"]},{"osd":2,"uuid":"37de933d-3b8e-4b94-87bd-2f36896c7ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6808","nonce":129687}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6809","nonce":129687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6811","nonce":129687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6810","nonce":129687}]},"public_addr":"172.21.15.26:6808/129687","cluster_addr":"172.21.15.26:6809/129687","heartbeat_back_addr":"172.21.15.26:6811/129687","heartbeat_front_addr":"172.21.15.26:6810/129687","state":["exists","up"]},{"osd":3,"uuid":"bd020309-5fd2-4d97-b36a-67e159fa3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6812","nonce":130029}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6813","nonce":130029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6815","nonce":130029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6814","nonce":130029}]},"public_addr":"172.21.15.26:6812/130029","cluster_addr":"172.21.15.26:6813/130029","heartbeat_back_addr":"172.21.15.26:6815/130029","heartbeat_front_addr":"172.21.15.26:6814/130029","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.029993+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.266503+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.273540+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-10-01T07:54:29.008198+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.229731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.e","mappings":[{"from":3,"to":0}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.39","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/616154075":"2023-10-02T07:54:14.803384+0000","172.21.15.26:6817/2857714939":"2023-10-02T07:54:39.862609+0000","172.21.15.26:6816/118178":"2023-10-02T07:54:14.803384+0000","172.21.15.26:0/1290599107":"2023-10-02T07:54:14.803384+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-01T07:54:46.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.936+0000 7f2e33fb9700 1 -- 172.21.15.26:0/876240156 >> v1:172.21.15.26:6816/126763 conn(0x7f2e1002f510 legacy=0x7f2e100319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:46.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.936+0000 7f2e33fb9700 1 -- 172.21.15.26:0/876240156 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e2c09e000 msgr2=0x7f2e2c1a63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:46.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.936+0000 7f2e33fb9700 1 --2- 172.21.15.26:0/876240156 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e2c09e000 0x7f2e2c1a63f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c00e9e0 tx=0x7f2e1c00ecf0 comp rx=0 tx=0).stop 2023-10-01T07:54:46.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.936+0000 7f2e33fb9700 1 -- 172.21.15.26:0/876240156 shutdown_connections 2023-10-01T07:54:46.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.936+0000 7f2e33fb9700 1 --2- 172.21.15.26:0/876240156 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e2c09e410 0x7f2e2c1a6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:46.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.936+0000 7f2e33fb9700 1 --2- 172.21.15.26:0/876240156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e2c09d6f0 0x7f2e2c1a5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:46.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.936+0000 7f2e33fb9700 1 --2- 172.21.15.26:0/876240156 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e2c09e000 0x7f2e2c1a63f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:46.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.936+0000 7f2e33fb9700 1 -- 172.21.15.26:0/876240156 >> 172.21.15.26:0/876240156 conn(0x7f2e2c066f50 msgr2=0x7f2e2c1badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:46.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.936+0000 7f2e33fb9700 1 -- 172.21.15.26:0/876240156 shutdown_connections 2023-10-01T07:54:46.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:46.936+0000 7f2e33fb9700 1 -- 172.21.15.26:0/876240156 wait complete. 2023-10-01T07:54:46.951 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-01T07:54:46.951 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-01T07:54:47.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.086+0000 7f5275793700 1 Processor -- start 2023-10-01T07:54:47.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.086+0000 7f5275793700 1 -- start start 2023-10-01T07:54:47.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.087+0000 7f5275793700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f52700a0a30 0x7f52700a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.087+0000 7f5275793700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f52700a1340 0x7f5270133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.087+0000 7f5275793700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5270133fa0 0x7f5270134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.087+0000 7f5275793700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f527009edd0 con 0x7f5270133fa0 2023-10-01T07:54:47.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.087+0000 7f5275793700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f527009e1f0 con 0x7f52700a1340 2023-10-01T07:54:47.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.087+0000 7f5275793700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f527009dc50 con 0x7f52700a0a30 2023-10-01T07:54:47.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.087+0000 7f526e7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f52700a1340 0x7f5270133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.087+0000 7f526f7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5270133fa0 0x7f5270134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.087+0000 7f526effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f52700a0a30 0x7f52700a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.087+0000 7f526f7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5270133fa0 0x7f5270134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41622/0 (socket says 172.21.15.26:41622) 2023-10-01T07:54:47.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.087+0000 7f526e7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f52700a1340 0x7f5270133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46036/0 (socket says 172.21.15.26:46036) 2023-10-01T07:54:47.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.087+0000 7f526f7fe700 1 -- 172.21.15.26:0/4091557437 learned_addr learned my addr 172.21.15.26:0/4091557437 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:47.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.087+0000 7f526effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f52700a0a30 0x7f52700a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41392/0 (socket says 172.21.15.26:41392) 2023-10-01T07:54:47.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.087+0000 7f526f7fe700 1 -- 172.21.15.26:0/4091557437 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f52700a0a30 msgr2=0x7f52700a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:47.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.087+0000 7f526f7fe700 1 --2- 172.21.15.26:0/4091557437 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f52700a0a30 0x7f52700a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.087+0000 7f526f7fe700 1 -- 172.21.15.26:0/4091557437 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f52700a1340 msgr2=0x7f5270133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:47.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.087+0000 7f526f7fe700 1 --2- 172.21.15.26:0/4091557437 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f52700a1340 0x7f5270133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.087+0000 7f526f7fe700 1 -- 172.21.15.26:0/4091557437 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52700a1fe0 con 0x7f5270133fa0 2023-10-01T07:54:47.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.087+0000 7f526effd700 1 --2- 172.21.15.26:0/4091557437 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f52700a0a30 0x7f52700a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:47.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.088+0000 7f526f7fe700 1 --2- 172.21.15.26:0/4091557437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5270133fa0 0x7f5270134410 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5268009e50 tx=0x7f526800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f140a1f3cf96d23 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:47.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.088+0000 7f526dffb700 1 -- 172.21.15.26:0/4091557437 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526800e070 con 0x7f5270133fa0 2023-10-01T07:54:47.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.088+0000 7f526dffb700 1 -- 172.21.15.26:0/4091557437 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526800b910 con 0x7f5270133fa0 2023-10-01T07:54:47.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.088+0000 7f526dffb700 1 -- 172.21.15.26:0/4091557437 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526800bcc0 con 0x7f5270133fa0 2023-10-01T07:54:47.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.088+0000 7f5275793700 1 -- 172.21.15.26:0/4091557437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5270133fa0 msgr2=0x7f5270134410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.088+0000 7f5275793700 1 --2- 172.21.15.26:0/4091557437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5270133fa0 0x7f5270134410 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5268009e50 tx=0x7f526800b330 comp rx=0 tx=0).stop 2023-10-01T07:54:47.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.088+0000 7f5275793700 1 -- 172.21.15.26:0/4091557437 shutdown_connections 2023-10-01T07:54:47.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.088+0000 7f5275793700 1 --2- 172.21.15.26:0/4091557437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5270133fa0 0x7f5270134410 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.088+0000 7f5275793700 1 --2- 172.21.15.26:0/4091557437 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f52700a0a30 0x7f52700a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.088+0000 7f5275793700 1 --2- 172.21.15.26:0/4091557437 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f52700a1340 0x7f5270133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.088+0000 7f5275793700 1 -- 172.21.15.26:0/4091557437 >> 172.21.15.26:0/4091557437 conn(0x7f52700a6550 msgr2=0x7f52700a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:47.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.088+0000 7f5275793700 1 -- 172.21.15.26:0/4091557437 shutdown_connections 2023-10-01T07:54:47.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.088+0000 7f5275793700 1 -- 172.21.15.26:0/4091557437 wait complete. 2023-10-01T07:54:47.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.090+0000 7f5275793700 1 Processor -- start 2023-10-01T07:54:47.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.090+0000 7f5275793700 1 -- start start 2023-10-01T07:54:47.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.090+0000 7f5275793700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f52700a0a30 0x7f52701200b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.090+0000 7f5275793700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f52700a1340 0x7f52701205f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.090+0000 7f5275793700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5270133fa0 0x7f5270120b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.090+0000 7f5275793700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52701238f0 con 0x7f5270133fa0 2023-10-01T07:54:47.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.090+0000 7f5275793700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5270123af0 con 0x7f52700a1340 2023-10-01T07:54:47.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.090+0000 7f5275793700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52701229e0 con 0x7f52700a0a30 2023-10-01T07:54:47.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.090+0000 7f526effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f52700a0a30 0x7f52701200b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.090+0000 7f526e7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f52700a1340 0x7f52701205f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.090+0000 7f526effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f52700a0a30 0x7f52701200b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41406/0 (socket says 172.21.15.26:41406) 2023-10-01T07:54:47.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.090+0000 7f526e7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f52700a1340 0x7f52701205f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46052/0 (socket says 172.21.15.26:46052) 2023-10-01T07:54:47.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.090+0000 7f526effd700 1 -- 172.21.15.26:0/3047336837 learned_addr learned my addr 172.21.15.26:0/3047336837 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:47.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.090+0000 7f526f7fe700 1 --2- 172.21.15.26:0/3047336837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5270133fa0 0x7f5270120b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.091+0000 7f526e7fc700 1 -- 172.21.15.26:0/3047336837 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f52700a0a30 msgr2=0x7f52701200b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.091+0000 7f526e7fc700 1 --2- 172.21.15.26:0/3047336837 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f52700a0a30 0x7f52701200b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.091+0000 7f526e7fc700 1 -- 172.21.15.26:0/3047336837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5270133fa0 msgr2=0x7f5270120b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.091+0000 7f526e7fc700 1 --2- 172.21.15.26:0/3047336837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5270133fa0 0x7f5270120b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.091+0000 7f526e7fc700 1 -- 172.21.15.26:0/3047336837 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52600094a0 con 0x7f52700a1340 2023-10-01T07:54:47.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.091+0000 7f526effd700 1 --2- 172.21.15.26:0/3047336837 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f52700a0a30 0x7f52701200b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:47.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.091+0000 7f526f7fe700 1 --2- 172.21.15.26:0/3047336837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5270133fa0 0x7f5270120b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:47.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.091+0000 7f526e7fc700 1 --2- 172.21.15.26:0/3047336837 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f52700a1340 0x7f52701205f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f525800e930 tx=0x7f525800ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:47.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.091+0000 7f52677fe700 1 -- 172.21.15.26:0/3047336837 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5258013680 con 0x7f52700a1340 2023-10-01T07:54:47.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.091+0000 7f52677fe700 1 -- 172.21.15.26:0/3047336837 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52580137e0 con 0x7f52700a1340 2023-10-01T07:54:47.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.091+0000 7f5275793700 1 -- 172.21.15.26:0/3047336837 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5268009b30 con 0x7f52700a1340 2023-10-01T07:54:47.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.091+0000 7f52677fe700 1 -- 172.21.15.26:0/3047336837 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5258013b50 con 0x7f52700a1340 2023-10-01T07:54:47.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.091+0000 7f5275793700 1 -- 172.21.15.26:0/3047336837 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5270122ea0 con 0x7f52700a1340 2023-10-01T07:54:47.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.092+0000 7f5275793700 1 -- 172.21.15.26:0/3047336837 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52700a0220 con 0x7f52700a1340 2023-10-01T07:54:47.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.093+0000 7f52677fe700 1 -- 172.21.15.26:0/3047336837 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5258013cb0 con 0x7f52700a1340 2023-10-01T07:54:47.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.093+0000 7f52677fe700 1 -- 172.21.15.26:0/3047336837 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f52580402e0 con 0x7f52700a1340 2023-10-01T07:54:47.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.093+0000 7f526effd700 1 -- 172.21.15.26:0/3047336837 >> v1:172.21.15.26:6816/126763 conn(0x7f525002f510 legacy=0x7f52500319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:47.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.097+0000 7f52677fe700 1 -- 172.21.15.26:0/3047336837 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5258011350 con 0x7f52700a1340 2023-10-01T07:54:47.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.294+0000 7f526effd700 1 -- 172.21.15.26:0/3047336837 >> v1:172.21.15.26:6816/126763 conn(0x7f525002f510 legacy=0x7f52500319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:47.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.303+0000 7f5275793700 1 -- 172.21.15.26:0/3047336837 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5270074ea0 con 0x7f52700a1340 2023-10-01T07:54:47.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.304+0000 7f52677fe700 1 -- 172.21.15.26:0/3047336837 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+13012 (secure 0 0 0) 0x7f5258021070 con 0x7f52700a1340 2023-10-01T07:54:47.305 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T07:54:47.306 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":39,"fsid":"c29fb19d-520c-42a6-90f4-e7f86de96e8e","created":"2023-10-01T07:51:40.702414+0000","modified":"2023-10-01T07:54:46.105745+0000","last_up_change":"2023-10-01T07:54:35.033170+0000","last_in_change":"2023-10-01T07:51:42.084736+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-01T07:51:48.906889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-01T07:51:50.071599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-01T07:51:54.981575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-01T07:51:56.286318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46569ce3-81d1-44a1-a649-691de3e6f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6800","nonce":129479}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6801","nonce":129479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6803","nonce":129479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6802","nonce":129479}]},"public_addr":"172.21.15.26:6800/129479","cluster_addr":"172.21.15.26:6801/129479","heartbeat_back_addr":"172.21.15.26:6803/129479","heartbeat_front_addr":"172.21.15.26:6802/129479","state":["exists","up"]},{"osd":1,"uuid":"1fc1ba9b-4110-4d31-96d6-794937578cff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6804","nonce":129577}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6805","nonce":129577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6807","nonce":129577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6806","nonce":129577}]},"public_addr":"172.21.15.26:6804/129577","cluster_addr":"172.21.15.26:6805/129577","heartbeat_back_addr":"172.21.15.26:6807/129577","heartbeat_front_addr":"172.21.15.26:6806/129577","state":["exists","up"]},{"osd":2,"uuid":"37de933d-3b8e-4b94-87bd-2f36896c7ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6808","nonce":129687}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6809","nonce":129687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6811","nonce":129687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6810","nonce":129687}]},"public_addr":"172.21.15.26:6808/129687","cluster_addr":"172.21.15.26:6809/129687","heartbeat_back_addr":"172.21.15.26:6811/129687","heartbeat_front_addr":"172.21.15.26:6810/129687","state":["exists","up"]},{"osd":3,"uuid":"bd020309-5fd2-4d97-b36a-67e159fa3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6812","nonce":130029}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6813","nonce":130029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6815","nonce":130029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6814","nonce":130029}]},"public_addr":"172.21.15.26:6812/130029","cluster_addr":"172.21.15.26:6813/130029","heartbeat_back_addr":"172.21.15.26:6815/130029","heartbeat_front_addr":"172.21.15.26:6814/130029","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.029993+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.266503+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.273540+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-10-01T07:54:29.008198+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.229731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.e","mappings":[{"from":3,"to":0}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.39","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/616154075":"2023-10-02T07:54:14.803384+0000","172.21.15.26:6817/2857714939":"2023-10-02T07:54:39.862609+0000","172.21.15.26:6816/118178":"2023-10-02T07:54:14.803384+0000","172.21.15.26:0/1290599107":"2023-10-02T07:54:14.803384+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-01T07:54:47.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.306+0000 7f5275793700 1 -- 172.21.15.26:0/3047336837 >> v1:172.21.15.26:6816/126763 conn(0x7f525002f510 legacy=0x7f52500319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:47.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.306+0000 7f5275793700 1 -- 172.21.15.26:0/3047336837 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f52700a1340 msgr2=0x7f52701205f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.306+0000 7f5275793700 1 --2- 172.21.15.26:0/3047336837 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f52700a1340 0x7f52701205f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f525800e930 tx=0x7f525800ec40 comp rx=0 tx=0).stop 2023-10-01T07:54:47.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.307+0000 7f5275793700 1 -- 172.21.15.26:0/3047336837 shutdown_connections 2023-10-01T07:54:47.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.307+0000 7f5275793700 1 --2- 172.21.15.26:0/3047336837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5270133fa0 0x7f5270120b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.307+0000 7f5275793700 1 --2- 172.21.15.26:0/3047336837 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f52700a0a30 0x7f52701200b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.307+0000 7f5275793700 1 --2- 172.21.15.26:0/3047336837 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f52700a1340 0x7f52701205f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.307+0000 7f5275793700 1 -- 172.21.15.26:0/3047336837 >> 172.21.15.26:0/3047336837 conn(0x7f52700a6550 msgr2=0x7f527009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:47.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.307+0000 7f5275793700 1 -- 172.21.15.26:0/3047336837 shutdown_connections 2023-10-01T07:54:47.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.307+0000 7f5275793700 1 -- 172.21.15.26:0/3047336837 wait complete. 2023-10-01T07:54:47.322 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-01T07:54:47.322 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-01T07:54:47.322 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-01T07:54:47.323 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-01T07:54:47.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.470+0000 7ff334bc8700 1 Processor -- start 2023-10-01T07:54:47.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.470+0000 7ff334bc8700 1 -- start start 2023-10-01T07:54:47.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.471+0000 7ff334bc8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff330133420 0x7ff3301337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.471+0000 7ff334bc8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff330134260 0x7ff3301306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.471+0000 7ff334bc8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff33006b990 con 0x7ff330133e30 2023-10-01T07:54:47.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.471+0000 7ff334bc8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3300a0590 con 0x7ff330133420 2023-10-01T07:54:47.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.471+0000 7ff334bc8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff33009fb80 con 0x7ff330134260 2023-10-01T07:54:47.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.471+0000 7ff32dd9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff330133e30 0x7ff33012ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60002/0 (socket says 172.21.15.26:60002) 2023-10-01T07:54:47.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.471+0000 7ff32dd9b700 1 -- 172.21.15.26:0/1099705363 learned_addr learned my addr 172.21.15.26:0/1099705363 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:47.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.471+0000 7ff32e59c700 1 --2- 172.21.15.26:0/1099705363 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff330133420 0x7ff3301337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.471+0000 7ff32ed9d700 1 --2- 172.21.15.26:0/1099705363 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff330134260 0x7ff3301306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.472+0000 7ff32e59c700 1 -- 172.21.15.26:0/1099705363 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff330134260 msgr2=0x7ff3301306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:47.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.472+0000 7ff32e59c700 1 --2- 172.21.15.26:0/1099705363 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff330134260 0x7ff3301306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.472+0000 7ff32e59c700 1 -- 172.21.15.26:0/1099705363 >> v1:172.21.15.26:6789/0 conn(0x7ff330133e30 legacy=0x7ff33012ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.472+0000 7ff32d59a700 1 -- 172.21.15.26:0/1099705363 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 862481965 0 0) 0x7ff33006b990 con 0x7ff330133e30 2023-10-01T07:54:47.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.472+0000 7fa7884ff700 1 Processor -- start 2023-10-01T07:54:47.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.472+0000 7ff32e59c700 1 -- 172.21.15.26:0/1099705363 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3300a0030 con 0x7ff330133420 2023-10-01T07:54:47.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.472+0000 7fa7884ff700 1 -- start start 2023-10-01T07:54:47.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.472+0000 7ff32e59c700 1 --2- 172.21.15.26:0/1099705363 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff330133420 0x7ff3301337f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff320009870 tx=0x7ff320009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18718e5b2cac53ad server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:47.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.472+0000 7ff32d59a700 1 -- 172.21.15.26:0/1099705363 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff320011830 con 0x7ff330133420 2023-10-01T07:54:47.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.473+0000 7fa7884ff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa78009d6f0 0x7fa78009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.473+0000 7fa7884ff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa78009e000 0x7fa7801339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.473+0000 7fa7884ff700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa78009b120 con 0x7fa78009e410 2023-10-01T07:54:47.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.473+0000 7fa7884ff700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa78006b460 con 0x7fa78009d6f0 2023-10-01T07:54:47.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.473+0000 7fa7884ff700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa78009a7e0 con 0x7fa78009e000 2023-10-01T07:54:47.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.473+0000 7fa78629b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa78009d6f0 0x7fa78009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.473+0000 7fa786a9c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa78009e410 0x7fa780133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60014/0 (socket says 172.21.15.26:60014) 2023-10-01T07:54:47.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.473+0000 7fa786a9c700 1 -- 172.21.15.26:0/2862285693 learned_addr learned my addr 172.21.15.26:0/2862285693 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:47.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.473+0000 7fa78629b700 1 -- 172.21.15.26:0/2862285693 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa78009e000 msgr2=0x7fa7801339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:47.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.473+0000 7fa78629b700 1 --2- 172.21.15.26:0/2862285693 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa78009e000 0x7fa7801339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.473+0000 7fa78629b700 1 -- 172.21.15.26:0/2862285693 >> v1:172.21.15.26:6789/0 conn(0x7fa78009e410 legacy=0x7fa780133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.473+0000 7fa78629b700 1 -- 172.21.15.26:0/2862285693 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa78009a500 con 0x7fa78009d6f0 2023-10-01T07:54:47.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.473+0000 7fa785299700 1 -- 172.21.15.26:0/2862285693 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1360906898 0 0) 0x7fa78009b120 con 0x7fa78009e410 2023-10-01T07:54:47.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.474+0000 7fa78629b700 1 --2- 172.21.15.26:0/2862285693 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa78009d6f0 0x7fa78009dac0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa77c009870 tx=0x7fa77c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=181fd338c24993e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:47.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.474+0000 7fa785299700 1 -- 172.21.15.26:0/2862285693 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c011830 con 0x7fa78009d6f0 2023-10-01T07:54:47.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.474+0000 7fa785299700 1 -- 172.21.15.26:0/2862285693 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77c011990 con 0x7fa78009d6f0 2023-10-01T07:54:47.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.474+0000 7fa785299700 1 -- 172.21.15.26:0/2862285693 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c011d20 con 0x7fa78009d6f0 2023-10-01T07:54:47.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.475+0000 7fa7884ff700 1 -- 172.21.15.26:0/2862285693 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa78009d6f0 msgr2=0x7fa78009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.475+0000 7fa7884ff700 1 --2- 172.21.15.26:0/2862285693 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa78009d6f0 0x7fa78009dac0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa77c009870 tx=0x7fa77c009b80 comp rx=0 tx=0).stop 2023-10-01T07:54:47.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.475+0000 7fa7884ff700 1 -- 172.21.15.26:0/2862285693 shutdown_connections 2023-10-01T07:54:47.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.475+0000 7fa7884ff700 1 --2- 172.21.15.26:0/2862285693 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa78009d6f0 0x7fa78009dac0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.475+0000 7fa7884ff700 1 --2- 172.21.15.26:0/2862285693 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa78009e000 0x7fa7801339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.475+0000 7fa7884ff700 1 -- 172.21.15.26:0/2862285693 >> 172.21.15.26:0/2862285693 conn(0x7fa780066f50 msgr2=0x7fa78009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:47.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.475+0000 7fa7884ff700 1 -- 172.21.15.26:0/2862285693 shutdown_connections 2023-10-01T07:54:47.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.475+0000 7fa7884ff700 1 -- 172.21.15.26:0/2862285693 wait complete. 2023-10-01T07:54:47.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.473+0000 7ff32d59a700 1 -- 172.21.15.26:0/1099705363 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff320011990 con 0x7ff330133420 2023-10-01T07:54:47.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.473+0000 7ff32d59a700 1 -- 172.21.15.26:0/1099705363 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff320011d20 con 0x7ff330133420 2023-10-01T07:54:47.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.474+0000 7ff334bc8700 1 -- 172.21.15.26:0/1099705363 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff330133420 msgr2=0x7ff3301337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.474+0000 7ff334bc8700 1 --2- 172.21.15.26:0/1099705363 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff330133420 0x7ff3301337f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff320009870 tx=0x7ff320009b80 comp rx=0 tx=0).stop 2023-10-01T07:54:47.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.474+0000 7ff334bc8700 1 -- 172.21.15.26:0/1099705363 shutdown_connections 2023-10-01T07:54:47.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.474+0000 7ff334bc8700 1 --2- 172.21.15.26:0/1099705363 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff330134260 0x7ff3301306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.474+0000 7ff334bc8700 1 --2- 172.21.15.26:0/1099705363 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff330133420 0x7ff3301337f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.474+0000 7ff334bc8700 1 -- 172.21.15.26:0/1099705363 >> 172.21.15.26:0/1099705363 conn(0x7ff3300a4210 msgr2=0x7ff3300a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:47.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.474+0000 7ff334bc8700 1 -- 172.21.15.26:0/1099705363 shutdown_connections 2023-10-01T07:54:47.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.474+0000 7ff334bc8700 1 -- 172.21.15.26:0/1099705363 wait complete. 2023-10-01T07:54:47.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.475+0000 7ff334bc8700 1 Processor -- start 2023-10-01T07:54:47.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.475+0000 7ff334bc8700 1 -- start start 2023-10-01T07:54:47.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.476+0000 7ff334bc8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff330133420 0x7ff33012cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.476+0000 7ff334bc8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff330133e30 0x7ff33009b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.476+0000 7ff334bc8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff330134260 0x7ff33009bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.476+0000 7ff334bc8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33009d430 con 0x7ff330134260 2023-10-01T07:54:47.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.476+0000 7ff334bc8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33009d8d0 con 0x7ff330133420 2023-10-01T07:54:47.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.476+0000 7ff334bc8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff33012d940 con 0x7ff330133e30 2023-10-01T07:54:47.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.476+0000 7ff32dd9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff330133e30 0x7ff33009b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.476+0000 7ff32dd9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff330133e30 0x7ff33009b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41428/0 (socket says 172.21.15.26:41428) 2023-10-01T07:54:47.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.476+0000 7ff32dd9b700 1 -- 172.21.15.26:0/2901667802 learned_addr learned my addr 172.21.15.26:0/2901667802 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:47.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.476+0000 7ff32dd9b700 1 -- 172.21.15.26:0/2901667802 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff330133420 msgr2=0x7ff33012cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.476+0000 7ff32dd9b700 1 --2- 172.21.15.26:0/2901667802 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff330133420 0x7ff33012cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.476+0000 7ff32dd9b700 1 -- 172.21.15.26:0/2901667802 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff330134260 msgr2=0x7ff33009bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.476+0000 7ff32dd9b700 1 --2- 172.21.15.26:0/2901667802 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff330134260 0x7ff33009bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.476+0000 7ff32dd9b700 1 -- 172.21.15.26:0/2901667802 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3200094a0 con 0x7ff330133e30 2023-10-01T07:54:47.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.477+0000 7ff32dd9b700 1 --2- 172.21.15.26:0/2901667802 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff330133e30 0x7ff33009b710 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff324001eb0 tx=0x7ff32400c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:47.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.476+0000 7fa7884ff700 1 Processor -- start 2023-10-01T07:54:47.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.477+0000 7ff31effd700 1 -- 172.21.15.26:0/2901667802 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff324004c80 con 0x7ff330133e30 2023-10-01T07:54:47.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.477+0000 7ff31effd700 1 -- 172.21.15.26:0/2901667802 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff324004de0 con 0x7ff330133e30 2023-10-01T07:54:47.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.477+0000 7ff31effd700 1 -- 172.21.15.26:0/2901667802 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3240072f0 con 0x7ff330133e30 2023-10-01T07:54:47.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.477+0000 7ff334bc8700 1 -- 172.21.15.26:0/2901667802 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff330135050 con 0x7ff330133e30 2023-10-01T07:54:47.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.477+0000 7ff334bc8700 1 -- 172.21.15.26:0/2901667802 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff330135ac0 con 0x7ff330133e30 2023-10-01T07:54:47.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.477+0000 7fa7884ff700 1 -- start start 2023-10-01T07:54:47.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.478+0000 7fa7884ff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa78009d6f0 0x7fa7801cc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.478+0000 7fa7884ff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa78009e000 0x7fa7801cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.478+0000 7fa7884ff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa78009e410 0x7fa7801194b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.478+0000 7fa7884ff700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7801337e0 con 0x7fa78009e410 2023-10-01T07:54:47.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.478+0000 7fa7884ff700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa78011ccf0 con 0x7fa78009d6f0 2023-10-01T07:54:47.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.478+0000 7fa785a9a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa78009e000 0x7fa7801cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.478+0000 7fa785a9a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa78009e000 0x7fa7801cced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41442/0 (socket says 172.21.15.26:41442) 2023-10-01T07:54:47.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.478+0000 7fa785a9a700 1 -- 172.21.15.26:0/2017387231 learned_addr learned my addr 172.21.15.26:0/2017387231 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:47.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.478+0000 7fa78629b700 1 --2- 172.21.15.26:0/2017387231 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa78009d6f0 0x7fa7801cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.478+0000 7fa786a9c700 1 --2- 172.21.15.26:0/2017387231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa78009e410 0x7fa7801194b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.478+0000 7ff31effd700 1 -- 172.21.15.26:0/2901667802 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff324007450 con 0x7ff330133e30 2023-10-01T07:54:47.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.478+0000 7fa7884ff700 1 -- 172.21.15.26:0/2017387231 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7800a2b90 con 0x7fa78009e000 2023-10-01T07:54:47.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.478+0000 7ff31effd700 1 -- 172.21.15.26:0/2901667802 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7ff32403f920 con 0x7ff330133e30 2023-10-01T07:54:47.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.479+0000 7ff32e59c700 1 -- 172.21.15.26:0/2901667802 >> v1:172.21.15.26:6816/126763 conn(0x7ff31002f510 legacy=0x7ff3100319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:47.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.479+0000 7fa786a9c700 1 -- 172.21.15.26:0/2017387231 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa78009e000 msgr2=0x7fa7801cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.479+0000 7fa786a9c700 1 --2- 172.21.15.26:0/2017387231 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa78009e000 0x7fa7801cced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.479+0000 7fa786a9c700 1 -- 172.21.15.26:0/2017387231 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa78009d6f0 msgr2=0x7fa7801cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.479+0000 7fa786a9c700 1 --2- 172.21.15.26:0/2017387231 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa78009d6f0 0x7fa7801cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.479+0000 7fa786a9c700 1 -- 172.21.15.26:0/2017387231 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa77c0094a0 con 0x7fa78009e410 2023-10-01T07:54:47.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.479+0000 7fa78629b700 1 --2- 172.21.15.26:0/2017387231 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa78009d6f0 0x7fa7801cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:47.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.479+0000 7fa786a9c700 1 --2- 172.21.15.26:0/2017387231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa78009e410 0x7fa7801194b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa78009e8b0 tx=0x7fa77800cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:47.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.479+0000 7ff334bc8700 1 -- 172.21.15.26:0/2901667802 --> v1:172.21.15.26:6800/129479 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff3300621a0 con 0x7ff330135240 2023-10-01T07:54:47.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.479+0000 7fa776ffd700 1 -- 172.21.15.26:0/2017387231 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77800aaa0 con 0x7fa78009e410 2023-10-01T07:54:47.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.479+0000 7fa776ffd700 1 -- 172.21.15.26:0/2017387231 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77800ac00 con 0x7fa78009e410 2023-10-01T07:54:47.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.479+0000 7fa776ffd700 1 -- 172.21.15.26:0/2017387231 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7780070d0 con 0x7fa78009e410 2023-10-01T07:54:47.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.480+0000 7fa7884ff700 1 -- 172.21.15.26:0/2017387231 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa78011b0c0 con 0x7fa78009e410 2023-10-01T07:54:47.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.480+0000 7fa7884ff700 1 -- 172.21.15.26:0/2017387231 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7801cd410 con 0x7fa78009e410 2023-10-01T07:54:47.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.480+0000 7fe410130700 1 Processor -- start 2023-10-01T07:54:47.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.480+0000 7ff31effd700 1 -- 172.21.15.26:0/2901667802 <== osd.0 v1:172.21.15.26:6800/129479 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7ff3300621a0 con 0x7ff330135240 2023-10-01T07:54:47.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.480+0000 7fe410130700 1 -- start start 2023-10-01T07:54:47.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.481+0000 7fa7884ff700 1 -- 172.21.15.26:0/2017387231 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa78006a9e0 con 0x7fa78009e410 2023-10-01T07:54:47.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.481+0000 7fa776ffd700 1 -- 172.21.15.26:0/2017387231 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa778007230 con 0x7fa78009e410 2023-10-01T07:54:47.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.481+0000 7fe410130700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe40812fc70 0x7fe408130040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.481+0000 7fe410130700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe40812c060 0x7fe40812c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.481+0000 7fe410130700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe40809be70 con 0x7fe40812c970 2023-10-01T07:54:47.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.481+0000 7fe410130700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe408130580 con 0x7fe40812c060 2023-10-01T07:54:47.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.481+0000 7fe410130700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe40809a6e0 con 0x7fe40812fc70 2023-10-01T07:54:47.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.481+0000 7fe40decc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe40812fc70 0x7fe408130040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.481+0000 7fe40decc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe40812fc70 0x7fe408130040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41450/0 (socket says 172.21.15.26:41450) 2023-10-01T07:54:47.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.481+0000 7fe40decc700 1 -- 172.21.15.26:0/2666581726 learned_addr learned my addr 172.21.15.26:0/2666581726 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:47.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.481+0000 7fa776ffd700 1 -- 172.21.15.26:0/2017387231 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fa77803f9a0 con 0x7fa78009e410 2023-10-01T07:54:47.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.481+0000 7fa776ffd700 1 -- 172.21.15.26:0/2017387231 --> v1:172.21.15.26:6804/129577 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa76403c460 con 0x7fa764038760 2023-10-01T07:54:47.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.481+0000 7fa776ffd700 1 -- 172.21.15.26:0/2017387231 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa778044240 con 0x7fa78009e410 2023-10-01T07:54:47.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.482+0000 7fa78629b700 1 -- 172.21.15.26:0/2017387231 >> v1:172.21.15.26:6816/126763 conn(0x7fa76402f590 legacy=0x7fa764031a40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:47.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.482+0000 7fe40decc700 1 -- 172.21.15.26:0/2666581726 >> v2:172.21.15.26:3300/0 conn(0x7fe40812c060 msgr2=0x7fe40812c430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-01T07:54:47.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.482+0000 7fe40decc700 1 --2- 172.21.15.26:0/2666581726 >> v2:172.21.15.26:3300/0 conn(0x7fe40812c060 0x7fe40812c430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.482+0000 7fe40decc700 1 -- 172.21.15.26:0/2666581726 >> v1:172.21.15.26:6789/0 conn(0x7fe40812c970 legacy=0x7fe408136940 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-01T07:54:47.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.482+0000 7fe40decc700 1 -- 172.21.15.26:0/2666581726 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe40809ac80 con 0x7fe40812fc70 2023-10-01T07:54:47.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.482+0000 7f2b99623700 1 Processor -- start 2023-10-01T07:54:47.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.482+0000 7f2b99623700 1 -- start start 2023-10-01T07:54:47.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.482+0000 7fe40decc700 1 --2- 172.21.15.26:0/2666581726 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe40812fc70 0x7fe408130040 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8009e50 tx=0x7fe3f800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ef4a248c1c2b5eb server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:47.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.483+0000 7fa776ffd700 1 -- 172.21.15.26:0/2017387231 <== osd.1 v1:172.21.15.26:6804/129577 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7fa76403c460 con 0x7fa764038760 2023-10-01T07:54:47.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.483+0000 7f2b99623700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2b94134630 0x7f2b94136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.483+0000 7f2b99623700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2b94136f50 0x7f2b94139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.483+0000 7f2b99623700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b9409b4f0 con 0x7f2b94131810 2023-10-01T07:54:47.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.483+0000 7f2b99623700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b941313c0 con 0x7f2b94136f50 2023-10-01T07:54:47.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.483+0000 7f2b99623700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9406e8c0 con 0x7f2b94134630 2023-10-01T07:54:47.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.483+0000 7f2b937fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2b94136f50 0x7f2b94139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.483+0000 7f2b92ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2b94131810 0x7f2b94131be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60022/0 (socket says 172.21.15.26:60022) 2023-10-01T07:54:47.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.483+0000 7f2b92ffd700 1 -- 172.21.15.26:0/3323761994 learned_addr learned my addr 172.21.15.26:0/3323761994 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:47.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.483+0000 7f2b927fc700 1 --2- 172.21.15.26:0/3323761994 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2b94134630 0x7f2b94136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.483+0000 7fe40ceca700 1 -- 172.21.15.26:0/2666581726 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f8003c20 con 0x7fe40812fc70 2023-10-01T07:54:47.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.484+0000 7f2b927fc700 1 -- 172.21.15.26:0/3323761994 >> v2:172.21.15.26:3300/0 conn(0x7f2b94136f50 msgr2=0x7f2b94139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:47.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.484+0000 7f2b927fc700 1 --2- 172.21.15.26:0/3323761994 >> v2:172.21.15.26:3300/0 conn(0x7f2b94136f50 0x7f2b94139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.484+0000 7f2b927fc700 1 -- 172.21.15.26:0/3323761994 >> v1:172.21.15.26:6789/0 conn(0x7f2b94131810 legacy=0x7f2b94131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.484+0000 7f2b927fc700 1 -- 172.21.15.26:0/3323761994 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b94071d20 con 0x7f2b94134630 2023-10-01T07:54:47.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.484+0000 7f2b91ffb700 1 -- 172.21.15.26:0/3323761994 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2567570047 0 0) 0x7f2b9409b4f0 con 0x7f2b94131810 2023-10-01T07:54:47.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.484+0000 7fe40ceca700 1 -- 172.21.15.26:0/2666581726 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f8003d80 con 0x7fe40812fc70 2023-10-01T07:54:47.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.484+0000 7fe40ceca700 1 -- 172.21.15.26:0/2666581726 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f800bbc0 con 0x7fe40812fc70 2023-10-01T07:54:47.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.484+0000 7f2b927fc700 1 --2- 172.21.15.26:0/3323761994 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2b94134630 0x7f2b94136a10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2b88009840 tx=0x7f2b88009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=212f1e0033f95156 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:47.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.484+0000 7f2b91ffb700 1 -- 172.21.15.26:0/3323761994 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b88011830 con 0x7f2b94134630 2023-10-01T07:54:47.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.484+0000 7f2b91ffb700 1 -- 172.21.15.26:0/3323761994 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b88011990 con 0x7f2b94134630 2023-10-01T07:54:47.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.484+0000 7f2b91ffb700 1 -- 172.21.15.26:0/3323761994 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b88011d20 con 0x7f2b94134630 2023-10-01T07:54:47.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.484+0000 7fe410130700 1 -- 172.21.15.26:0/2666581726 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe40812fc70 msgr2=0x7fe408130040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.484+0000 7fe410130700 1 --2- 172.21.15.26:0/2666581726 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe40812fc70 0x7fe408130040 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8009e50 tx=0x7fe3f800b330 comp rx=0 tx=0).stop 2023-10-01T07:54:47.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.484+0000 7fe410130700 1 -- 172.21.15.26:0/2666581726 shutdown_connections 2023-10-01T07:54:47.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.484+0000 7fe410130700 1 --2- 172.21.15.26:0/2666581726 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe40812fc70 0x7fe408130040 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.484+0000 7fe410130700 1 --2- 172.21.15.26:0/2666581726 >> v2:172.21.15.26:3300/0 conn(0x7fe40812c060 0x7fe40812c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.484+0000 7fe410130700 1 -- 172.21.15.26:0/2666581726 >> 172.21.15.26:0/2666581726 conn(0x7fe40809e7e0 msgr2=0x7fe40809ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:47.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.485+0000 7fe410130700 1 -- 172.21.15.26:0/2666581726 shutdown_connections 2023-10-01T07:54:47.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.485+0000 7fe410130700 1 -- 172.21.15.26:0/2666581726 wait complete. 2023-10-01T07:54:47.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.485+0000 7f2b99623700 1 -- 172.21.15.26:0/3323761994 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2b94134630 msgr2=0x7f2b94136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.485+0000 7f2b99623700 1 --2- 172.21.15.26:0/3323761994 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2b94134630 0x7f2b94136a10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2b88009840 tx=0x7f2b88009b50 comp rx=0 tx=0).stop 2023-10-01T07:54:47.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.485+0000 7f2b99623700 1 -- 172.21.15.26:0/3323761994 shutdown_connections 2023-10-01T07:54:47.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.485+0000 7f2b99623700 1 --2- 172.21.15.26:0/3323761994 >> v2:172.21.15.26:3300/0 conn(0x7f2b94136f50 0x7f2b94139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.485+0000 7f2b99623700 1 --2- 172.21.15.26:0/3323761994 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2b94134630 0x7f2b94136a10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.485+0000 7f2b99623700 1 -- 172.21.15.26:0/3323761994 >> 172.21.15.26:0/3323761994 conn(0x7f2b940a2aa0 msgr2=0x7f2b940a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:47.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.486+0000 7f2b99623700 1 -- 172.21.15.26:0/3323761994 shutdown_connections 2023-10-01T07:54:47.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.486+0000 7f2b99623700 1 -- 172.21.15.26:0/3323761994 wait complete. 2023-10-01T07:54:47.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.486+0000 7fe410130700 1 Processor -- start 2023-10-01T07:54:47.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.486+0000 7fe410130700 1 -- start start 2023-10-01T07:54:47.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.487+0000 7fe410130700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe40812c060 0x7fe40806d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.487+0000 7fe410130700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe40812c970 0x7fe40806dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.487+0000 7fe410130700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe40812fc70 0x7fe40806e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.487+0000 7fe410130700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe408070730 con 0x7fe40812fc70 2023-10-01T07:54:47.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.487+0000 7fe410130700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe408070a10 con 0x7fe40812c970 2023-10-01T07:54:47.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.487+0000 7fe410130700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe40806f280 con 0x7fe40812c060 2023-10-01T07:54:47.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.487+0000 7fe40decc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe40812c060 0x7fe40806d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.487+0000 7f2b99623700 1 Processor -- start 2023-10-01T07:54:47.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.487+0000 7f2b99623700 1 -- start start 2023-10-01T07:54:47.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.487+0000 7fe40decc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe40812c060 0x7fe40806d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41466/0 (socket says 172.21.15.26:41466) 2023-10-01T07:54:47.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.487+0000 7fe40decc700 1 -- 172.21.15.26:0/1406909534 learned_addr learned my addr 172.21.15.26:0/1406909534 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:47.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.487+0000 7fe40decc700 1 -- 172.21.15.26:0/1406909534 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe40812c970 msgr2=0x7fe40806dc70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:47.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.487+0000 7fe40decc700 1 --2- 172.21.15.26:0/1406909534 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe40812c970 0x7fe40806dc70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.487+0000 7fe40decc700 1 -- 172.21.15.26:0/1406909534 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe40812fc70 msgr2=0x7fe40806e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.487+0000 7fe40decc700 1 --2- 172.21.15.26:0/1406909534 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe40812fc70 0x7fe40806e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.487+0000 7fe40decc700 1 -- 172.21.15.26:0/1406909534 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f8009b30 con 0x7fe40812c060 2023-10-01T07:54:47.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.488+0000 7fe40decc700 1 --2- 172.21.15.26:0/1406909534 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe40812c060 0x7fe40806d730 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe40809a820 tx=0x7fe3f8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:47.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.487+0000 7f2b99623700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b94131810 0x7f2b941c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.487+0000 7f2b99623700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b94134630 0x7f2b941c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.487+0000 7f2b99623700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2b94136f50 0x7f2b94118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.487+0000 7f2b99623700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9411a920 con 0x7f2b94131810 2023-10-01T07:54:47.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.487+0000 7f2b99623700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9412ea60 con 0x7f2b94134630 2023-10-01T07:54:47.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.487+0000 7f2b99623700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9411c110 con 0x7f2b94136f50 2023-10-01T07:54:47.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.488+0000 7f2b927fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b94134630 0x7f2b941c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.488+0000 7f2b927fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b94134630 0x7f2b941c6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46090/0 (socket says 172.21.15.26:46090) 2023-10-01T07:54:47.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.488+0000 7f2b927fc700 1 -- 172.21.15.26:0/1857069677 learned_addr learned my addr 172.21.15.26:0/1857069677 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:47.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.488+0000 7f2b937fe700 1 --2- 172.21.15.26:0/1857069677 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2b94136f50 0x7f2b94118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.488+0000 7f2b92ffd700 1 --2- 172.21.15.26:0/1857069677 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b94131810 0x7f2b941c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.488+0000 7f2b927fc700 1 -- 172.21.15.26:0/1857069677 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2b94136f50 msgr2=0x7f2b94118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.488+0000 7f2b927fc700 1 --2- 172.21.15.26:0/1857069677 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2b94136f50 0x7f2b94118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.488+0000 7f2b927fc700 1 -- 172.21.15.26:0/1857069677 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b94131810 msgr2=0x7f2b941c61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.488+0000 7f2b927fc700 1 --2- 172.21.15.26:0/1857069677 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b94131810 0x7f2b941c61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.488+0000 7f2b927fc700 1 -- 172.21.15.26:0/1857069677 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b880094a0 con 0x7f2b94134630 2023-10-01T07:54:47.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.488+0000 7f2b927fc700 1 --2- 172.21.15.26:0/1857069677 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b94134630 0x7f2b941c6710 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2b88009fd0 tx=0x7f2b88004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:47.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.488+0000 7fe4067fc700 1 -- 172.21.15.26:0/1406909534 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f801e070 con 0x7fe40812c060 2023-10-01T07:54:47.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.488+0000 7fe4067fc700 1 -- 172.21.15.26:0/1406909534 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f80092e0 con 0x7fe40812c060 2023-10-01T07:54:47.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.488+0000 7fe4067fc700 1 -- 172.21.15.26:0/1406909534 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f80048f0 con 0x7fe40812c060 2023-10-01T07:54:47.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.489+0000 7fe410130700 1 -- 172.21.15.26:0/1406909534 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4080715f0 con 0x7fe40812c060 2023-10-01T07:54:47.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.489+0000 7fe410130700 1 -- 172.21.15.26:0/1406909534 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe408070f10 con 0x7fe40812c060 2023-10-01T07:54:47.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.490+0000 7fe410130700 1 -- 172.21.15.26:0/1406909534 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe4080708a0 con 0x7fe40812c060 2023-10-01T07:54:47.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.491+0000 7fe4067fc700 1 -- 172.21.15.26:0/1406909534 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe3f8011460 con 0x7fe40812c060 2023-10-01T07:54:47.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.491+0000 7fe4067fc700 1 -- 172.21.15.26:0/1406909534 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fe3f8041270 con 0x7fe40812c060 2023-10-01T07:54:47.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.491+0000 7f2b7b7fe700 1 -- 172.21.15.26:0/1857069677 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b88004480 con 0x7f2b94134630 2023-10-01T07:54:47.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.491+0000 7fe40d6cb700 1 -- 172.21.15.26:0/1406909534 >> v1:172.21.15.26:6816/126763 conn(0x7fe3f402f510 legacy=0x7fe3f40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:47.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.491+0000 7f2b7b7fe700 1 -- 172.21.15.26:0/1857069677 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8801f070 con 0x7f2b94134630 2023-10-01T07:54:47.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.491+0000 7f2b7b7fe700 1 -- 172.21.15.26:0/1857069677 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b880038c0 con 0x7f2b94134630 2023-10-01T07:54:47.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.491+0000 7f2b99623700 1 -- 172.21.15.26:0/1857069677 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b9406eb00 con 0x7f2b94134630 2023-10-01T07:54:47.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.491+0000 7f2b99623700 1 -- 172.21.15.26:0/1857069677 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b9411ce40 con 0x7f2b94134630 2023-10-01T07:54:47.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.491+0000 7fe4067fc700 1 -- 172.21.15.26:0/1406909534 --> v1:172.21.15.26:6808/129687 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe3f403c2e0 con 0x7fe3f40385e0 2023-10-01T07:54:47.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.491+0000 7fe4067fc700 1 -- 172.21.15.26:0/1406909534 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3f800f340 con 0x7fe40812c060 2023-10-01T07:54:47.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.492+0000 7f2b7b7fe700 1 -- 172.21.15.26:0/1857069677 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2b88021030 con 0x7f2b94134630 2023-10-01T07:54:47.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.492+0000 7f2b99623700 1 -- 172.21.15.26:0/1857069677 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2b94066680 con 0x7f2b94134630 2023-10-01T07:54:47.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.493+0000 7f2b7b7fe700 1 -- 172.21.15.26:0/1857069677 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f2b88040da0 con 0x7f2b94134630 2023-10-01T07:54:47.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.493+0000 7f2b7b7fe700 1 -- 172.21.15.26:0/1857069677 --> v1:172.21.15.26:6812/130029 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b8003c3b0 con 0x7f2b800386b0 2023-10-01T07:54:47.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.493+0000 7f2b7b7fe700 1 -- 172.21.15.26:0/1857069677 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b88003a20 con 0x7f2b94134630 2023-10-01T07:54:47.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.493+0000 7f2b92ffd700 1 -- 172.21.15.26:0/1857069677 >> v1:172.21.15.26:6816/126763 conn(0x7f2b8002f560 legacy=0x7f2b80031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:47.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.493+0000 7fe4067fc700 1 -- 172.21.15.26:0/1406909534 <== osd.2 v1:172.21.15.26:6808/129687 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7fe3f403c2e0 con 0x7fe3f40385e0 2023-10-01T07:54:47.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.497+0000 7f2b7b7fe700 1 -- 172.21.15.26:0/1857069677 <== osd.3 v1:172.21.15.26:6812/130029 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7f2b8003c3b0 con 0x7f2b800386b0 2023-10-01T07:54:47.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.501+0000 7ff334bc8700 1 -- 172.21.15.26:0/2901667802 --> v1:172.21.15.26:6800/129479 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff330134cf0 con 0x7ff330135240 2023-10-01T07:54:47.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.502+0000 7ff31effd700 1 -- 172.21.15.26:0/2901667802 <== osd.0 v1:172.21.15.26:6800/129479 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 277563570) 0x7ff328007330 con 0x7ff330135240 2023-10-01T07:54:47.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.502+0000 7ff334bc8700 1 -- 172.21.15.26:0/2901667802 >> v1:172.21.15.26:6800/129479 conn(0x7ff330135240 legacy=0x7ff3300a23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.502+0000 7ff334bc8700 1 -- 172.21.15.26:0/2901667802 >> v1:172.21.15.26:6816/126763 conn(0x7ff31002f510 legacy=0x7ff3100319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:47.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.502+0000 7ff334bc8700 1 -- 172.21.15.26:0/2901667802 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff330133e30 msgr2=0x7ff33009b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.502+0000 7ff334bc8700 1 --2- 172.21.15.26:0/2901667802 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff330133e30 0x7ff33009b710 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff324001eb0 tx=0x7ff32400c8b0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.502+0000 7ff32ed9d700 1 -- 172.21.15.26:0/2901667802 reap_dead start 2023-10-01T07:54:47.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.502+0000 7ff334bc8700 1 -- 172.21.15.26:0/2901667802 shutdown_connections 2023-10-01T07:54:47.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.502+0000 7ff334bc8700 1 -- 172.21.15.26:0/2901667802 >> 172.21.15.26:0/2901667802 conn(0x7ff3300a4210 msgr2=0x7ff33012fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:47.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.503+0000 7ff334bc8700 1 -- 172.21.15.26:0/2901667802 shutdown_connections 2023-10-01T07:54:47.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.503+0000 7ff334bc8700 1 -- 172.21.15.26:0/2901667802 wait complete. 2023-10-01T07:54:47.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.514+0000 7fa7884ff700 1 -- 172.21.15.26:0/2017387231 --> v1:172.21.15.26:6804/129577 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa78011c990 con 0x7fa764038760 2023-10-01T07:54:47.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.514+0000 7f2b99623700 1 -- 172.21.15.26:0/1857069677 --> v1:172.21.15.26:6812/130029 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2b940721a0 con 0x7f2b800386b0 2023-10-01T07:54:47.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.515+0000 7fa776ffd700 1 -- 172.21.15.26:0/2017387231 <== osd.1 v1:172.21.15.26:6804/129577 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 2827348261) 0x7fa770005a50 con 0x7fa764038760 2023-10-01T07:54:47.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.515+0000 7f2b7b7fe700 1 -- 172.21.15.26:0/1857069677 <== osd.3 v1:172.21.15.26:6812/130029 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 3191560019) 0x7f2b8c00f040 con 0x7f2b800386b0 2023-10-01T07:54:47.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.515+0000 7f2b99623700 1 -- 172.21.15.26:0/1857069677 >> v1:172.21.15.26:6812/130029 conn(0x7f2b800386b0 legacy=0x7f2b8003ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.515+0000 7f2b99623700 1 -- 172.21.15.26:0/1857069677 >> v1:172.21.15.26:6816/126763 conn(0x7f2b8002f560 legacy=0x7f2b80031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:47.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.515+0000 7f2b99623700 1 -- 172.21.15.26:0/1857069677 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b94134630 msgr2=0x7f2b941c6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.515+0000 7f2b99623700 1 --2- 172.21.15.26:0/1857069677 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b94134630 0x7f2b941c6710 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2b88009fd0 tx=0x7f2b88004750 comp rx=0 tx=0).stop 2023-10-01T07:54:47.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.515+0000 7f2b937fe700 1 -- 172.21.15.26:0/1857069677 reap_dead start 2023-10-01T07:54:47.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.516+0000 7f2b99623700 1 -- 172.21.15.26:0/1857069677 shutdown_connections 2023-10-01T07:54:47.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.516+0000 7f2b99623700 1 -- 172.21.15.26:0/1857069677 >> 172.21.15.26:0/1857069677 conn(0x7f2b940a2aa0 msgr2=0x7f2b94132e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:47.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.516+0000 7f2b99623700 1 -- 172.21.15.26:0/1857069677 shutdown_connections 2023-10-01T07:54:47.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.516+0000 7f2b99623700 1 -- 172.21.15.26:0/1857069677 wait complete. 2023-10-01T07:54:47.518 INFO:teuthology.orchestra.run.smithi026.stdout:124554051588 2023-10-01T07:54:47.519 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:54:47.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.516+0000 7fa7884ff700 1 -- 172.21.15.26:0/2017387231 >> v1:172.21.15.26:6804/129577 conn(0x7fa764038760 legacy=0x7fa76403abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.516+0000 7fa7884ff700 1 -- 172.21.15.26:0/2017387231 >> v1:172.21.15.26:6816/126763 conn(0x7fa76402f590 legacy=0x7fa764031a40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:47.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.516+0000 7fa7884ff700 1 -- 172.21.15.26:0/2017387231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa78009e410 msgr2=0x7fa7801194b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.516+0000 7fa7884ff700 1 --2- 172.21.15.26:0/2017387231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa78009e410 0x7fa7801194b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa78009e8b0 tx=0x7fa77800cec0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.516+0000 7fa786a9c700 1 -- 172.21.15.26:0/2017387231 reap_dead start 2023-10-01T07:54:47.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.516+0000 7fa7884ff700 1 -- 172.21.15.26:0/2017387231 shutdown_connections 2023-10-01T07:54:47.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.516+0000 7fa7884ff700 1 -- 172.21.15.26:0/2017387231 >> 172.21.15.26:0/2017387231 conn(0x7fa780066f50 msgr2=0x7fa7800710c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:47.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.517+0000 7fa7884ff700 1 -- 172.21.15.26:0/2017387231 shutdown_connections 2023-10-01T07:54:47.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.517+0000 7fa7884ff700 1 -- 172.21.15.26:0/2017387231 wait complete. 2023-10-01T07:54:47.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.522+0000 7fe410130700 1 -- 172.21.15.26:0/1406909534 --> v1:172.21.15.26:6808/129687 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe40809b9b0 con 0x7fe3f40385e0 2023-10-01T07:54:47.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.523+0000 7fe4067fc700 1 -- 172.21.15.26:0/1406909534 <== osd.2 v1:172.21.15.26:6808/129687 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 1985872850) 0x7fe4000079a0 con 0x7fe3f40385e0 2023-10-01T07:54:47.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.523+0000 7fe410130700 1 -- 172.21.15.26:0/1406909534 >> v1:172.21.15.26:6808/129687 conn(0x7fe3f40385e0 legacy=0x7fe3f403aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.524+0000 7fe410130700 1 -- 172.21.15.26:0/1406909534 >> v1:172.21.15.26:6816/126763 conn(0x7fe3f402f510 legacy=0x7fe3f40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:47.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.524+0000 7fe410130700 1 -- 172.21.15.26:0/1406909534 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe40812c060 msgr2=0x7fe40806d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.524+0000 7fe410130700 1 --2- 172.21.15.26:0/1406909534 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe40812c060 0x7fe40806d730 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe40809a820 tx=0x7fe3f8004ad0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.524+0000 7fe40e6cd700 1 -- 172.21.15.26:0/1406909534 reap_dead start 2023-10-01T07:54:47.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.524+0000 7fe410130700 1 -- 172.21.15.26:0/1406909534 shutdown_connections 2023-10-01T07:54:47.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.524+0000 7fe410130700 1 -- 172.21.15.26:0/1406909534 >> 172.21.15.26:0/1406909534 conn(0x7fe40809e7e0 msgr2=0x7fe4081b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:47.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.524+0000 7fe410130700 1 -- 172.21.15.26:0/1406909534 shutdown_connections 2023-10-01T07:54:47.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.524+0000 7fe410130700 1 -- 172.21.15.26:0/1406909534 wait complete. 2023-10-01T07:54:47.533 INFO:teuthology.orchestra.run.smithi026.stdout:137438953475 2023-10-01T07:54:47.533 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:54:47.535 INFO:teuthology.orchestra.run.smithi026.stdout:128849018884 2023-10-01T07:54:47.535 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:54:47.541 INFO:teuthology.orchestra.run.smithi026.stdout:133143986179 2023-10-01T07:54:47.541 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:54:47.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.669+0000 7f6674fd3700 1 Processor -- start 2023-10-01T07:54:47.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.669+0000 7f6674fd3700 1 -- start start 2023-10-01T07:54:47.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.670+0000 7f6674fd3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f667006a770 0x7f667006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.670+0000 7f6674fd3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f667006b080 0x7f6670131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.670+0000 7f6674fd3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6670131b40 0x7f6670131fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.670+0000 7f6674fd3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f667009ece0 con 0x7f667006a770 2023-10-01T07:54:47.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.670+0000 7f6674fd3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667009e760 con 0x7f6670131b40 2023-10-01T07:54:47.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.670+0000 7f6674fd3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f667009e040 con 0x7f667006b080 2023-10-01T07:54:47.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.670+0000 7f666ed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6670131b40 0x7f6670131fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.670+0000 7f666ed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6670131b40 0x7f6670131fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46094/0 (socket says 172.21.15.26:46094) 2023-10-01T07:54:47.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.670+0000 7f666ed9d700 1 -- 172.21.15.26:0/1171639024 learned_addr learned my addr 172.21.15.26:0/1171639024 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:47.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.670+0000 7f666e59c700 1 --2- 172.21.15.26:0/1171639024 >> v2:172.21.15.26:3300/0 conn(0x7f667006a770 0x7f667006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.670+0000 7f666dd9b700 1 --2- 172.21.15.26:0/1171639024 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f667006b080 0x7f6670131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.670+0000 7f666e59c700 1 -- 172.21.15.26:0/1171639024 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f667006b080 msgr2=0x7f6670131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:47.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.670+0000 7f666e59c700 1 --2- 172.21.15.26:0/1171639024 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f667006b080 0x7f6670131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.670+0000 7f666e59c700 1 -- 172.21.15.26:0/1171639024 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6670131b40 msgr2=0x7f6670131fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:47.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.670+0000 7f666e59c700 1 --2- 172.21.15.26:0/1171639024 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6670131b40 0x7f6670131fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.670+0000 7f666e59c700 1 -- 172.21.15.26:0/1171639024 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667009f630 con 0x7f667006a770 2023-10-01T07:54:47.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.670+0000 7f666ed9d700 1 --2- 172.21.15.26:0/1171639024 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6670131b40 0x7f6670131fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:47.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.671+0000 7f666e59c700 1 --2- 172.21.15.26:0/1171639024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f667006a770 0x7f667006ab40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6660009840 tx=0x7f6660009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c53a84e5f8707e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:47.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.671+0000 7f666d59a700 1 -- 172.21.15.26:0/1171639024 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6660011830 con 0x7f667006a770 2023-10-01T07:54:47.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.671+0000 7f666d59a700 1 -- 172.21.15.26:0/1171639024 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6660011990 con 0x7f667006a770 2023-10-01T07:54:47.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.671+0000 7f666d59a700 1 -- 172.21.15.26:0/1171639024 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6660011d20 con 0x7f667006a770 2023-10-01T07:54:47.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.671+0000 7f6674fd3700 1 -- 172.21.15.26:0/1171639024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f667006a770 msgr2=0x7f667006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.672+0000 7f6674fd3700 1 --2- 172.21.15.26:0/1171639024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f667006a770 0x7f667006ab40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6660009840 tx=0x7f6660009b50 comp rx=0 tx=0).stop 2023-10-01T07:54:47.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.672+0000 7f6674fd3700 1 -- 172.21.15.26:0/1171639024 shutdown_connections 2023-10-01T07:54:47.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.672+0000 7f6674fd3700 1 --2- 172.21.15.26:0/1171639024 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6670131b40 0x7f6670131fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.672+0000 7f6674fd3700 1 --2- 172.21.15.26:0/1171639024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f667006a770 0x7f667006ab40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.672+0000 7f6674fd3700 1 --2- 172.21.15.26:0/1171639024 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f667006b080 0x7f6670131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.672+0000 7f6674fd3700 1 -- 172.21.15.26:0/1171639024 >> 172.21.15.26:0/1171639024 conn(0x7f6670066f50 msgr2=0x7f667009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:47.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.672+0000 7f6674fd3700 1 -- 172.21.15.26:0/1171639024 shutdown_connections 2023-10-01T07:54:47.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.672+0000 7f6674fd3700 1 -- 172.21.15.26:0/1171639024 wait complete. 2023-10-01T07:54:47.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.673+0000 7f6674fd3700 1 Processor -- start 2023-10-01T07:54:47.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.673+0000 7f6674fd3700 1 -- start start 2023-10-01T07:54:47.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.674+0000 7f6674fd3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f667006a770 0x7f667011d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.674+0000 7f6674fd3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f667006b080 0x7f667011ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.674+0000 7f6674fd3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6670131b40 0x7f667011e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.674+0000 7f6674fd3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667011ed10 con 0x7f6670131b40 2023-10-01T07:54:47.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.674+0000 7f6674fd3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6670071790 con 0x7f667006b080 2023-10-01T07:54:47.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.674+0000 7f6674fd3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6670131470 con 0x7f667006a770 2023-10-01T07:54:47.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.674+0000 7f666ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6670131b40 0x7f667011e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.674+0000 7f666ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6670131b40 0x7f667011e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41676/0 (socket says 172.21.15.26:41676) 2023-10-01T07:54:47.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.674+0000 7f666ed9d700 1 -- 172.21.15.26:0/3585741602 learned_addr learned my addr 172.21.15.26:0/3585741602 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:47.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.674+0000 7f666dd9b700 1 --2- 172.21.15.26:0/3585741602 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f667006b080 0x7f667011ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.674+0000 7f666e59c700 1 --2- 172.21.15.26:0/3585741602 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f667006a770 0x7f667011d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.674+0000 7f666ed9d700 1 -- 172.21.15.26:0/3585741602 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f667006a770 msgr2=0x7f667011d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.674+0000 7f666ed9d700 1 --2- 172.21.15.26:0/3585741602 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f667006a770 0x7f667011d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.674+0000 7f666ed9d700 1 -- 172.21.15.26:0/3585741602 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f667006b080 msgr2=0x7f667011ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.674+0000 7f666ed9d700 1 --2- 172.21.15.26:0/3585741602 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f667006b080 0x7f667011ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.674+0000 7f666ed9d700 1 -- 172.21.15.26:0/3585741602 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6668009b30 con 0x7f6670131b40 2023-10-01T07:54:47.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.674+0000 7f666e59c700 1 --2- 172.21.15.26:0/3585741602 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f667006a770 0x7f667011d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:54:47.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.674+0000 7f666ed9d700 1 --2- 172.21.15.26:0/3585741602 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6670131b40 0x7f667011e310 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f666800efc0 tx=0x7f666800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:47.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.675+0000 7f665effd700 1 -- 172.21.15.26:0/3585741602 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668018070 con 0x7f6670131b40 2023-10-01T07:54:47.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.675+0000 7f665effd700 1 -- 172.21.15.26:0/3585741602 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666800f040 con 0x7f6670131b40 2023-10-01T07:54:47.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.675+0000 7f6674fd3700 1 -- 172.21.15.26:0/3585741602 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66600094a0 con 0x7f6670131b40 2023-10-01T07:54:47.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.675+0000 7f665effd700 1 -- 172.21.15.26:0/3585741602 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668003c20 con 0x7f6670131b40 2023-10-01T07:54:47.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.675+0000 7f6674fd3700 1 -- 172.21.15.26:0/3585741602 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f667011fe90 con 0x7f6670131b40 2023-10-01T07:54:47.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.676+0000 7f665effd700 1 -- 172.21.15.26:0/3585741602 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f666800c930 con 0x7f6670131b40 2023-10-01T07:54:47.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.676+0000 7f665effd700 1 -- 172.21.15.26:0/3585741602 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f666803fd50 con 0x7f6670131b40 2023-10-01T07:54:47.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.676+0000 7f666e59c700 1 -- 172.21.15.26:0/3585741602 >> v1:172.21.15.26:6816/126763 conn(0x7f665002f510 legacy=0x7f66500319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:47.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.676+0000 7f6674fd3700 1 -- 172.21.15.26:0/3585741602 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6670074ea0 con 0x7f6670131b40 2023-10-01T07:54:47.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.685+0000 7f665effd700 1 -- 172.21.15.26:0/3585741602 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6668012340 con 0x7f6670131b40 2023-10-01T07:54:47.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.687+0000 7fe37663b700 1 Processor -- start 2023-10-01T07:54:47.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.687+0000 7fe37663b700 1 -- start start 2023-10-01T07:54:47.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.688+0000 7fe37663b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe3701305f0 0x7fe3701309c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.688+0000 7fe37663b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe370070160 0x7fe370138540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.688+0000 7fe37663b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3701301c0 con 0x7fe37006f660 2023-10-01T07:54:47.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.688+0000 7fe37663b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe37009a2e0 con 0x7fe370070160 2023-10-01T07:54:47.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.688+0000 7fe37663b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe370071ff0 con 0x7fe3701305f0 2023-10-01T07:54:47.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.688+0000 7fe36f7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe37006f660 0x7fe37006fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60028/0 (socket says 172.21.15.26:60028) 2023-10-01T07:54:47.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.688+0000 7fe36f7fe700 1 -- 172.21.15.26:0/1788110121 learned_addr learned my addr 172.21.15.26:0/1788110121 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:47.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.688+0000 7fe36ffff700 1 --2- 172.21.15.26:0/1788110121 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe3701305f0 0x7fe3701309c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.688+0000 7fe374bd8700 1 --2- 172.21.15.26:0/1788110121 >> v2:172.21.15.26:3300/0 conn(0x7fe370070160 0x7fe370138540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.688+0000 7fe36effd700 1 -- 172.21.15.26:0/1788110121 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2588837960 0 0) 0x7fe3701301c0 con 0x7fe37006f660 2023-10-01T07:54:47.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.688+0000 7fe36effd700 1 -- 172.21.15.26:0/1788110121 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3580035b0 con 0x7fe37006f660 2023-10-01T07:54:47.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.688+0000 7fe374bd8700 1 -- 172.21.15.26:0/1788110121 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe3701305f0 msgr2=0x7fe3701309c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:47.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.688+0000 7fe374bd8700 1 --2- 172.21.15.26:0/1788110121 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe3701305f0 0x7fe3701309c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.688+0000 7fe374bd8700 1 -- 172.21.15.26:0/1788110121 >> v1:172.21.15.26:6789/0 conn(0x7fe37006f660 legacy=0x7fe37006fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.688+0000 7fe374bd8700 1 -- 172.21.15.26:0/1788110121 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe370070e70 con 0x7fe370070160 2023-10-01T07:54:47.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.689+0000 7fe374bd8700 1 --2- 172.21.15.26:0/1788110121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe370070160 0x7fe370138540 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe368009d90 tx=0x7fe36800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a2bff0c343c929e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:47.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.689+0000 7fe36effd700 1 -- 172.21.15.26:0/1788110121 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36800bd20 con 0x7fe370070160 2023-10-01T07:54:47.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.689+0000 7fe36effd700 1 -- 172.21.15.26:0/1788110121 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36800be80 con 0x7fe370070160 2023-10-01T07:54:47.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.689+0000 7fe36effd700 1 -- 172.21.15.26:0/1788110121 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3680116a0 con 0x7fe370070160 2023-10-01T07:54:47.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.690+0000 7fe37663b700 1 -- 172.21.15.26:0/1788110121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe370070160 msgr2=0x7fe370138540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.690+0000 7fe37663b700 1 --2- 172.21.15.26:0/1788110121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe370070160 0x7fe370138540 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe368009d90 tx=0x7fe36800b330 comp rx=0 tx=0).stop 2023-10-01T07:54:47.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.690+0000 7fe37663b700 1 -- 172.21.15.26:0/1788110121 shutdown_connections 2023-10-01T07:54:47.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.690+0000 7fe37663b700 1 --2- 172.21.15.26:0/1788110121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe370070160 0x7fe370138540 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.690+0000 7fe37663b700 1 --2- 172.21.15.26:0/1788110121 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe3701305f0 0x7fe3701309c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.690+0000 7fe37663b700 1 -- 172.21.15.26:0/1788110121 >> 172.21.15.26:0/1788110121 conn(0x7fe3700a2aa0 msgr2=0x7fe3700a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:47.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.690+0000 7fe37663b700 1 -- 172.21.15.26:0/1788110121 shutdown_connections 2023-10-01T07:54:47.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.690+0000 7fe37663b700 1 -- 172.21.15.26:0/1788110121 wait complete. 2023-10-01T07:54:47.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.691+0000 7fe37663b700 1 Processor -- start 2023-10-01T07:54:47.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.691+0000 7fe37663b700 1 -- start start 2023-10-01T07:54:47.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.692+0000 7fe37663b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe37006f660 0x7fe37011ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.692+0000 7fe37663b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe370070160 0x7fe37011b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.692+0000 7fe37663b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3701305f0 0x7fe37011b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.692+0000 7fe37663b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37011bf70 con 0x7fe370070160 2023-10-01T07:54:47.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.692+0000 7fe37663b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe37011e2f0 con 0x7fe3701305f0 2023-10-01T07:54:47.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.692+0000 7fe37663b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3700a11c0 con 0x7fe37006f660 2023-10-01T07:54:47.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.692+0000 7fe36f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe370070160 0x7fe37011b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.692+0000 7fe36f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe370070160 0x7fe37011b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41690/0 (socket says 172.21.15.26:41690) 2023-10-01T07:54:47.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.692+0000 7fe36f7fe700 1 -- 172.21.15.26:0/1689524836 learned_addr learned my addr 172.21.15.26:0/1689524836 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:47.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.692+0000 7fe374bd8700 1 --2- 172.21.15.26:0/1689524836 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3701305f0 0x7fe37011b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.693+0000 7fe374bd8700 1 -- 172.21.15.26:0/1689524836 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe37006f660 msgr2=0x7fe37011ab30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:47.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.693+0000 7fe374bd8700 1 --2- 172.21.15.26:0/1689524836 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe37006f660 0x7fe37011ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.693+0000 7fe374bd8700 1 -- 172.21.15.26:0/1689524836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe370070160 msgr2=0x7fe37011b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.693+0000 7fe374bd8700 1 --2- 172.21.15.26:0/1689524836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe370070160 0x7fe37011b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.693+0000 7fe374bd8700 1 -- 172.21.15.26:0/1689524836 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe368009a70 con 0x7fe3701305f0 2023-10-01T07:54:47.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.693+0000 7fe36f7fe700 1 --2- 172.21.15.26:0/1689524836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe370070160 0x7fe37011b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:47.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.693+0000 7fe374bd8700 1 --2- 172.21.15.26:0/1689524836 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3701305f0 0x7fe37011b5b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe368018000 tx=0x7fe368004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:47.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.693+0000 7fe36cff9700 1 -- 172.21.15.26:0/1689524836 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe368020070 con 0x7fe3701305f0 2023-10-01T07:54:47.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.693+0000 7fe36cff9700 1 -- 172.21.15.26:0/1689524836 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe368003e10 con 0x7fe3701305f0 2023-10-01T07:54:47.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.693+0000 7fe37663b700 1 -- 172.21.15.26:0/1689524836 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe370071820 con 0x7fe3701305f0 2023-10-01T07:54:47.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.693+0000 7fe36cff9700 1 -- 172.21.15.26:0/1689524836 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3680048f0 con 0x7fe3701305f0 2023-10-01T07:54:47.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.693+0000 7fe37663b700 1 -- 172.21.15.26:0/1689524836 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe37011ed60 con 0x7fe3701305f0 2023-10-01T07:54:47.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.695+0000 7fe37663b700 1 -- 172.21.15.26:0/1689524836 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe37012da20 con 0x7fe3701305f0 2023-10-01T07:54:47.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.695+0000 7fe36cff9700 1 -- 172.21.15.26:0/1689524836 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe368011460 con 0x7fe3701305f0 2023-10-01T07:54:47.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.696+0000 7fe36cff9700 1 -- 172.21.15.26:0/1689524836 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fe368043760 con 0x7fe3701305f0 2023-10-01T07:54:47.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.696+0000 7fe36ffff700 1 -- 172.21.15.26:0/1689524836 >> v1:172.21.15.26:6816/126763 conn(0x7fe35c02f510 legacy=0x7fe35c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:47.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.700+0000 7fe36cff9700 1 -- 172.21.15.26:0/1689524836 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe3680087a0 con 0x7fe3701305f0 2023-10-01T07:54:47.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.733+0000 7f5d0ed6e700 1 Processor -- start 2023-10-01T07:54:47.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.733+0000 7f5d0ed6e700 1 -- start start 2023-10-01T07:54:47.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.733+0000 7f5d0ed6e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5d08130540 0x7f5d08130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.733+0000 7f5d0ed6e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5d08130e50 0x7f5d0806f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.733+0000 7f5d0ed6e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d080716a0 con 0x7f5d0806fb20 2023-10-01T07:54:47.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.733+0000 7f5d0ed6e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d0809a390 con 0x7f5d08130540 2023-10-01T07:54:47.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.733+0000 7f5d0ed6e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d08071290 con 0x7f5d08130e50 2023-10-01T07:54:47.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.734+0000 7f5d0cb0a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5d08130540 0x7f5d08130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.734+0000 7f5d0cb0a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5d08130540 0x7f5d08130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41706/0 (socket says 172.21.15.26:41706) 2023-10-01T07:54:47.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.734+0000 7f5d0cb0a700 1 -- 172.21.15.26:0/124995094 learned_addr learned my addr 172.21.15.26:0/124995094 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:47.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.734+0000 7f5d07fff700 1 --2- 172.21.15.26:0/124995094 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5d08130e50 0x7f5d0806f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.734+0000 7f5d0cb0a700 1 -- 172.21.15.26:0/124995094 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5d08130e50 msgr2=0x7f5d0806f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:47.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.734+0000 7f5d0cb0a700 1 --2- 172.21.15.26:0/124995094 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5d08130e50 0x7f5d0806f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.734+0000 7f5d0cb0a700 1 -- 172.21.15.26:0/124995094 >> v1:172.21.15.26:6789/0 conn(0x7f5d0806fb20 legacy=0x7f5d08137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.734+0000 7f5d0cb0a700 1 -- 172.21.15.26:0/124995094 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d08130340 con 0x7f5d08130540 2023-10-01T07:54:47.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.734+0000 7f5d0cb0a700 1 --2- 172.21.15.26:0/124995094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d08130540 0x7f5d08130910 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc0098f0 tx=0x7f5cfc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0b54ef7dbd47e23 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:47.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.735+0000 7f5d077fe700 1 -- 172.21.15.26:0/124995094 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc011830 con 0x7f5d08130540 2023-10-01T07:54:47.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.735+0000 7f5d077fe700 1 -- 172.21.15.26:0/124995094 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cfc011990 con 0x7f5d08130540 2023-10-01T07:54:47.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.735+0000 7f5d077fe700 1 -- 172.21.15.26:0/124995094 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc011d20 con 0x7f5d08130540 2023-10-01T07:54:47.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.735+0000 7f5d0ed6e700 1 -- 172.21.15.26:0/124995094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d08130540 msgr2=0x7f5d08130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.735+0000 7f5d0ed6e700 1 --2- 172.21.15.26:0/124995094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d08130540 0x7f5d08130910 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc0098f0 tx=0x7f5cfc009c00 comp rx=0 tx=0).stop 2023-10-01T07:54:47.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.735+0000 7f5d0ed6e700 1 -- 172.21.15.26:0/124995094 shutdown_connections 2023-10-01T07:54:47.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.735+0000 7f5d0ed6e700 1 --2- 172.21.15.26:0/124995094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d08130540 0x7f5d08130910 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.735+0000 7f5d0ed6e700 1 --2- 172.21.15.26:0/124995094 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5d08130e50 0x7f5d0806f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.735+0000 7f5d0ed6e700 1 -- 172.21.15.26:0/124995094 >> 172.21.15.26:0/124995094 conn(0x7f5d080a2aa0 msgr2=0x7f5d080a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:47.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.736+0000 7f5d0ed6e700 1 -- 172.21.15.26:0/124995094 shutdown_connections 2023-10-01T07:54:47.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.736+0000 7f5d0ed6e700 1 -- 172.21.15.26:0/124995094 wait complete. 2023-10-01T07:54:47.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.737+0000 7f5d0ed6e700 1 Processor -- start 2023-10-01T07:54:47.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.737+0000 7f5d0ed6e700 1 -- start start 2023-10-01T07:54:47.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.737+0000 7f5d0ed6e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5d0806fb20 0x7f5d081c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.737+0000 7f5d0ed6e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d08130540 0x7f5d081c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.737+0000 7f5d0ed6e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5d08130e50 0x7f5d081c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.737+0000 7f5d0ed6e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0812c780 con 0x7f5d08130540 2023-10-01T07:54:47.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.737+0000 7f5d0ed6e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0813a2c0 con 0x7f5d08130e50 2023-10-01T07:54:47.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.737+0000 7f5d0ed6e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d08139e90 con 0x7f5d0806fb20 2023-10-01T07:54:47.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.738+0000 7f5d07fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d08130540 0x7f5d081c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.738+0000 7f5d0cb0a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5d0806fb20 0x7f5d081c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.738+0000 7f5d07fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d08130540 0x7f5d081c85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41720/0 (socket says 172.21.15.26:41720) 2023-10-01T07:54:47.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.738+0000 7f5d07fff700 1 -- 172.21.15.26:0/1835926583 learned_addr learned my addr 172.21.15.26:0/1835926583 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:47.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.738+0000 7f5d0d30b700 1 --2- 172.21.15.26:0/1835926583 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5d08130e50 0x7f5d081c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.738+0000 7f5d07fff700 1 -- 172.21.15.26:0/1835926583 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5d0806fb20 msgr2=0x7f5d081c8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.738+0000 7f5d07fff700 1 --2- 172.21.15.26:0/1835926583 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5d0806fb20 0x7f5d081c8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.738+0000 7f5d07fff700 1 -- 172.21.15.26:0/1835926583 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5d08130e50 msgr2=0x7f5d081c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.738+0000 7f5d07fff700 1 --2- 172.21.15.26:0/1835926583 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5d08130e50 0x7f5d081c8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.738+0000 7f5d07fff700 1 -- 172.21.15.26:0/1835926583 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cfc009550 con 0x7f5d08130540 2023-10-01T07:54:47.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.738+0000 7f5d0cb0a700 1 --2- 172.21.15.26:0/1835926583 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5d0806fb20 0x7f5d081c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:54:47.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.738+0000 7f5d07fff700 1 --2- 172.21.15.26:0/1835926583 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d08130540 0x7f5d081c85c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5cf400e9b0 tx=0x7f5cf400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:47.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.738+0000 7f5d057fa700 1 -- 172.21.15.26:0/1835926583 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf4009710 con 0x7f5d08130540 2023-10-01T07:54:47.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.738+0000 7f5d057fa700 1 -- 172.21.15.26:0/1835926583 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf400c850 con 0x7f5d08130540 2023-10-01T07:54:47.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.738+0000 7f5d057fa700 1 -- 172.21.15.26:0/1835926583 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf400cbc0 con 0x7f5d08130540 2023-10-01T07:54:47.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.739+0000 7f5d0ed6e700 1 -- 172.21.15.26:0/1835926583 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d0813ae30 con 0x7f5d08130540 2023-10-01T07:54:47.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.739+0000 7f5d0ed6e700 1 -- 172.21.15.26:0/1835926583 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d0809dca0 con 0x7f5d08130540 2023-10-01T07:54:47.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.739+0000 7f5d057fa700 1 -- 172.21.15.26:0/1835926583 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5cf400cd20 con 0x7f5d08130540 2023-10-01T07:54:47.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.740+0000 7f5d0cb0a700 1 -- 172.21.15.26:0/1835926583 >> v1:172.21.15.26:6816/126763 conn(0x7f5cec02f510 legacy=0x7f5cec0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:47.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.740+0000 7f5d057fa700 1 -- 172.21.15.26:0/1835926583 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f5cf403fd00 con 0x7f5d08130540 2023-10-01T07:54:47.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.740+0000 7f5d0ed6e700 1 -- 172.21.15.26:0/1835926583 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d08074ea0 con 0x7f5d08130540 2023-10-01T07:54:47.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.745+0000 7f5d057fa700 1 -- 172.21.15.26:0/1835926583 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5cf40232f0 con 0x7f5d08130540 2023-10-01T07:54:47.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.750+0000 7f8af10f4700 1 Processor -- start 2023-10-01T07:54:47.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.750+0000 7f8af10f4700 1 -- start start 2023-10-01T07:54:47.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.751+0000 7f8af10f4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8aec06c0e0 0x7f8aec09ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.751+0000 7f8af10f4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8aec134ec0 0x7f8aec1379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.751+0000 7f8af10f4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aec134980 con 0x7f8aec137f20 2023-10-01T07:54:47.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.751+0000 7f8af10f4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aec06c4b0 con 0x7f8aec06c0e0 2023-10-01T07:54:47.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.751+0000 7f8af10f4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec0a09c0 con 0x7f8aec134ec0 2023-10-01T07:54:47.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.751+0000 7f8aea59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8aec134ec0 0x7f8aec1379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.751+0000 7f8aea59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8aec134ec0 0x7f8aec1379e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46130/0 (socket says 172.21.15.26:46130) 2023-10-01T07:54:47.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.751+0000 7f8aead9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8aec06c0e0 0x7f8aec09ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.751+0000 7f8aea59c700 1 -- 172.21.15.26:0/159101853 learned_addr learned my addr 172.21.15.26:0/159101853 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:47.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.751+0000 7f8aea59c700 1 -- 172.21.15.26:0/159101853 >> v2:172.21.15.26:3300/0 conn(0x7f8aec06c0e0 msgr2=0x7f8aec09ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:47.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.751+0000 7f8aea59c700 1 --2- 172.21.15.26:0/159101853 >> v2:172.21.15.26:3300/0 conn(0x7f8aec06c0e0 0x7f8aec09ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.752+0000 7f8aea59c700 1 -- 172.21.15.26:0/159101853 >> v1:172.21.15.26:6789/0 conn(0x7f8aec137f20 legacy=0x7f8aec13ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.752+0000 7f8aea59c700 1 -- 172.21.15.26:0/159101853 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aec0a0600 con 0x7f8aec134ec0 2023-10-01T07:54:47.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.752+0000 7f8aea59c700 1 --2- 172.21.15.26:0/159101853 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8aec134ec0 0x7f8aec1379e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8ae00098f0 tx=0x7f8ae0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb2720767eefc919 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:47.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.752+0000 7f8ae9d9b700 1 -- 172.21.15.26:0/159101853 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae0011830 con 0x7f8aec134ec0 2023-10-01T07:54:47.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.752+0000 7f8ae9d9b700 1 -- 172.21.15.26:0/159101853 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae0011990 con 0x7f8aec134ec0 2023-10-01T07:54:47.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.752+0000 7f8ae9d9b700 1 -- 172.21.15.26:0/159101853 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae0011d20 con 0x7f8aec134ec0 2023-10-01T07:54:47.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.753+0000 7f8af10f4700 1 -- 172.21.15.26:0/159101853 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8aec134ec0 msgr2=0x7f8aec1379e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.753+0000 7f8af10f4700 1 --2- 172.21.15.26:0/159101853 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8aec134ec0 0x7f8aec1379e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8ae00098f0 tx=0x7f8ae0009c00 comp rx=0 tx=0).stop 2023-10-01T07:54:47.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.753+0000 7f8af10f4700 1 -- 172.21.15.26:0/159101853 shutdown_connections 2023-10-01T07:54:47.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.753+0000 7f8af10f4700 1 --2- 172.21.15.26:0/159101853 >> v2:172.21.15.26:3300/0 conn(0x7f8aec06c0e0 0x7f8aec09ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.753+0000 7f8af10f4700 1 --2- 172.21.15.26:0/159101853 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8aec134ec0 0x7f8aec1379e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.753+0000 7f8af10f4700 1 -- 172.21.15.26:0/159101853 >> 172.21.15.26:0/159101853 conn(0x7f8aec0a4210 msgr2=0x7f8aec0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:47.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.753+0000 7f8af10f4700 1 -- 172.21.15.26:0/159101853 shutdown_connections 2023-10-01T07:54:47.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.753+0000 7f8af10f4700 1 -- 172.21.15.26:0/159101853 wait complete. 2023-10-01T07:54:47.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.755+0000 7f8af10f4700 1 Processor -- start 2023-10-01T07:54:47.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.755+0000 7f8af10f4700 1 -- start start 2023-10-01T07:54:47.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.756+0000 7f8af10f4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8aec06c0e0 0x7f8aec1ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.756+0000 7f8af10f4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8aec134ec0 0x7f8aec1cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.756+0000 7f8af10f4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8aec137f20 0x7f8aec11a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:47.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.756+0000 7f8af10f4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec11e3a0 con 0x7f8aec137f20 2023-10-01T07:54:47.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.756+0000 7f8af10f4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec11dea0 con 0x7f8aec06c0e0 2023-10-01T07:54:47.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.756+0000 7f8af10f4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec11d900 con 0x7f8aec134ec0 2023-10-01T07:54:47.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.756+0000 7f8aea59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8aec134ec0 0x7f8aec1cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.756+0000 7f8aeb59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8aec137f20 0x7f8aec11a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.756+0000 7f8aead9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8aec06c0e0 0x7f8aec1ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:47.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.756+0000 7f8aea59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8aec134ec0 0x7f8aec1cd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41536/0 (socket says 172.21.15.26:41536) 2023-10-01T07:54:47.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.756+0000 7f8aea59c700 1 -- 172.21.15.26:0/2977875146 learned_addr learned my addr 172.21.15.26:0/2977875146 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:47.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.757+0000 7f8aea59c700 1 -- 172.21.15.26:0/2977875146 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8aec06c0e0 msgr2=0x7f8aec1ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.757+0000 7f8aea59c700 1 --2- 172.21.15.26:0/2977875146 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8aec06c0e0 0x7f8aec1ccd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.757+0000 7f8aea59c700 1 -- 172.21.15.26:0/2977875146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8aec137f20 msgr2=0x7f8aec11a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.757+0000 7f8aea59c700 1 --2- 172.21.15.26:0/2977875146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8aec137f20 0x7f8aec11a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.757+0000 7f8aea59c700 1 -- 172.21.15.26:0/2977875146 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae0009550 con 0x7f8aec134ec0 2023-10-01T07:54:47.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.757+0000 7f8aea59c700 1 --2- 172.21.15.26:0/2977875146 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8aec134ec0 0x7f8aec1cd290 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0000c00 tx=0x7f8ae0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:47.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.757+0000 7f8ad37fe700 1 -- 172.21.15.26:0/2977875146 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae00036a0 con 0x7f8aec134ec0 2023-10-01T07:54:47.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.757+0000 7f8ad37fe700 1 -- 172.21.15.26:0/2977875146 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae0003800 con 0x7f8aec134ec0 2023-10-01T07:54:47.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.757+0000 7f8af10f4700 1 -- 172.21.15.26:0/2977875146 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aec137c20 con 0x7f8aec134ec0 2023-10-01T07:54:47.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.757+0000 7f8ad37fe700 1 -- 172.21.15.26:0/2977875146 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae0003bb0 con 0x7f8aec134ec0 2023-10-01T07:54:47.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.757+0000 7f8af10f4700 1 -- 172.21.15.26:0/2977875146 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aec11c490 con 0x7f8aec134ec0 2023-10-01T07:54:47.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.758+0000 7f8ad37fe700 1 -- 172.21.15.26:0/2977875146 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8ae0021070 con 0x7f8aec134ec0 2023-10-01T07:54:47.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.759+0000 7f8ad37fe700 1 -- 172.21.15.26:0/2977875146 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f8ae0041200 con 0x7f8aec134ec0 2023-10-01T07:54:47.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.759+0000 7f8aead9d700 1 -- 172.21.15.26:0/2977875146 >> v1:172.21.15.26:6816/126763 conn(0x7f8ad802f510 legacy=0x7f8ad80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:47.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.760+0000 7f8af10f4700 1 -- 172.21.15.26:0/2977875146 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aec074ea0 con 0x7f8aec134ec0 2023-10-01T07:54:47.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.770+0000 7f8ad37fe700 1 -- 172.21.15.26:0/2977875146 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ae0029020 con 0x7f8aec134ec0 2023-10-01T07:54:47.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.877+0000 7f666e59c700 1 -- 172.21.15.26:0/3585741602 >> v1:172.21.15.26:6816/126763 conn(0x7f665002f510 legacy=0x7f66500319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:47.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.897+0000 7fe36ffff700 1 -- 172.21.15.26:0/1689524836 >> v1:172.21.15.26:6816/126763 conn(0x7fe35c02f510 legacy=0x7fe35c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:47.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.904+0000 7f6674fd3700 1 -- 172.21.15.26:0/3585741602 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6670070cf0 con 0x7f6670131b40 2023-10-01T07:54:47.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.904+0000 7f665effd700 1 -- 172.21.15.26:0/3585741602 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f666802b090 con 0x7f6670131b40 2023-10-01T07:54:47.905 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:54:47.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.906+0000 7f6674fd3700 1 -- 172.21.15.26:0/3585741602 >> v1:172.21.15.26:6816/126763 conn(0x7f665002f510 legacy=0x7f66500319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:47.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.906+0000 7f6674fd3700 1 -- 172.21.15.26:0/3585741602 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6670131b40 msgr2=0x7f667011e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.906+0000 7f6674fd3700 1 --2- 172.21.15.26:0/3585741602 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6670131b40 0x7f667011e310 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f666800efc0 tx=0x7f666800c3a0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.907+0000 7f6674fd3700 1 -- 172.21.15.26:0/3585741602 shutdown_connections 2023-10-01T07:54:47.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.907+0000 7f6674fd3700 1 --2- 172.21.15.26:0/3585741602 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6670131b40 0x7f667011e310 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.907+0000 7f6674fd3700 1 --2- 172.21.15.26:0/3585741602 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f667006a770 0x7f667011d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.907+0000 7f6674fd3700 1 --2- 172.21.15.26:0/3585741602 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f667006b080 0x7f667011ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.907+0000 7f6674fd3700 1 -- 172.21.15.26:0/3585741602 >> 172.21.15.26:0/3585741602 conn(0x7f6670066f50 msgr2=0x7f66701bbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:47.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.907+0000 7f6674fd3700 1 -- 172.21.15.26:0/3585741602 shutdown_connections 2023-10-01T07:54:47.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.907+0000 7f6674fd3700 1 -- 172.21.15.26:0/3585741602 wait complete. 2023-10-01T07:54:47.921 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:54:47.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.941+0000 7f5d0cb0a700 1 -- 172.21.15.26:0/1835926583 >> v1:172.21.15.26:6816/126763 conn(0x7f5cec02f510 legacy=0x7f5cec0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:47.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.949+0000 7fe37663b700 1 -- 172.21.15.26:0/1689524836 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe370074ea0 con 0x7fe3701305f0 2023-10-01T07:54:47.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.949+0000 7fe36cff9700 1 -- 172.21.15.26:0/1689524836 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe368029070 con 0x7fe3701305f0 2023-10-01T07:54:47.950 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:54:47.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.951+0000 7fe37663b700 1 -- 172.21.15.26:0/1689524836 >> v1:172.21.15.26:6816/126763 conn(0x7fe35c02f510 legacy=0x7fe35c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:47.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.951+0000 7fe37663b700 1 -- 172.21.15.26:0/1689524836 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3701305f0 msgr2=0x7fe37011b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.951+0000 7fe37663b700 1 --2- 172.21.15.26:0/1689524836 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3701305f0 0x7fe37011b5b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe368018000 tx=0x7fe368004ad0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.951+0000 7fe37663b700 1 -- 172.21.15.26:0/1689524836 shutdown_connections 2023-10-01T07:54:47.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.951+0000 7fe37663b700 1 --2- 172.21.15.26:0/1689524836 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3701305f0 0x7fe37011b5b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.951+0000 7fe37663b700 1 --2- 172.21.15.26:0/1689524836 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe37006f660 0x7fe37011ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.951+0000 7fe37663b700 1 --2- 172.21.15.26:0/1689524836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe370070160 0x7fe37011b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.951+0000 7fe37663b700 1 -- 172.21.15.26:0/1689524836 >> 172.21.15.26:0/1689524836 conn(0x7fe3700a2aa0 msgr2=0x7fe37012fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:47.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.952+0000 7fe37663b700 1 -- 172.21.15.26:0/1689524836 shutdown_connections 2023-10-01T07:54:47.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.952+0000 7fe37663b700 1 -- 172.21.15.26:0/1689524836 wait complete. 2023-10-01T07:54:47.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.960+0000 7f8aead9d700 1 -- 172.21.15.26:0/2977875146 >> v1:172.21.15.26:6816/126763 conn(0x7f8ad802f510 legacy=0x7f8ad80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:47.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.960+0000 7f5d0ed6e700 1 -- 172.21.15.26:0/1835926583 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5d0806b9e0 con 0x7f5d08130540 2023-10-01T07:54:47.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.961+0000 7f5d057fa700 1 -- 172.21.15.26:0/1835926583 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5cf401ae80 con 0x7f5d08130540 2023-10-01T07:54:47.961 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:54:47.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.963+0000 7f5d0ed6e700 1 -- 172.21.15.26:0/1835926583 >> v1:172.21.15.26:6816/126763 conn(0x7f5cec02f510 legacy=0x7f5cec0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:47.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.963+0000 7f5d0ed6e700 1 -- 172.21.15.26:0/1835926583 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d08130540 msgr2=0x7f5d081c85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:47.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.963+0000 7f5d0ed6e700 1 --2- 172.21.15.26:0/1835926583 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d08130540 0x7f5d081c85c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5cf400e9b0 tx=0x7f5cf400ecc0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.963+0000 7f5d0ed6e700 1 -- 172.21.15.26:0/1835926583 shutdown_connections 2023-10-01T07:54:47.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.963+0000 7f5d0ed6e700 1 --2- 172.21.15.26:0/1835926583 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5d08130e50 0x7f5d081c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.963+0000 7f5d0ed6e700 1 --2- 172.21.15.26:0/1835926583 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5d0806fb20 0x7f5d081c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.963+0000 7f5d0ed6e700 1 --2- 172.21.15.26:0/1835926583 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d08130540 0x7f5d081c85c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:47.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.963+0000 7f5d0ed6e700 1 -- 172.21.15.26:0/1835926583 >> 172.21.15.26:0/1835926583 conn(0x7f5d080a2aa0 msgr2=0x7f5d0806e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:47.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.963+0000 7f5d0ed6e700 1 -- 172.21.15.26:0/1835926583 shutdown_connections 2023-10-01T07:54:47.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.963+0000 7f5d0ed6e700 1 -- 172.21.15.26:0/1835926583 wait complete. 2023-10-01T07:54:47.966 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:54:47.978 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:54:47.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.996+0000 7f8af10f4700 1 -- 172.21.15.26:0/2977875146 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8aec06b250 con 0x7f8aec134ec0 2023-10-01T07:54:47.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.996+0000 7f8ad37fe700 1 -- 172.21.15.26:0/2977875146 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ae0015070 con 0x7f8aec134ec0 2023-10-01T07:54:47.997 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:54:47.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.998+0000 7f8af10f4700 1 -- 172.21.15.26:0/2977875146 >> v1:172.21.15.26:6816/126763 conn(0x7f8ad802f510 legacy=0x7f8ad80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:47.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.998+0000 7f8af10f4700 1 -- 172.21.15.26:0/2977875146 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8aec134ec0 msgr2=0x7f8aec1cd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:48.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.998+0000 7f8af10f4700 1 --2- 172.21.15.26:0/2977875146 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8aec134ec0 0x7f8aec1cd290 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0000c00 tx=0x7f8ae0004750 comp rx=0 tx=0).stop 2023-10-01T07:54:48.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.998+0000 7f8af10f4700 1 -- 172.21.15.26:0/2977875146 shutdown_connections 2023-10-01T07:54:48.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.998+0000 7f8af10f4700 1 --2- 172.21.15.26:0/2977875146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8aec137f20 0x7f8aec11a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:48.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.998+0000 7f8af10f4700 1 --2- 172.21.15.26:0/2977875146 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8aec06c0e0 0x7f8aec1ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:48.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.998+0000 7f8af10f4700 1 --2- 172.21.15.26:0/2977875146 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8aec134ec0 0x7f8aec1cd290 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:48.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.998+0000 7f8af10f4700 1 -- 172.21.15.26:0/2977875146 >> 172.21.15.26:0/2977875146 conn(0x7f8aec0a4210 msgr2=0x7f8aec06c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:48.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.999+0000 7f8af10f4700 1 -- 172.21.15.26:0/2977875146 shutdown_connections 2023-10-01T07:54:48.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:47.999+0000 7f8af10f4700 1 -- 172.21.15.26:0/2977875146 wait complete. 2023-10-01T07:54:48.013 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:54:48.922 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:54:48.968 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:54:48.978 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:54:49.013 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:54:49.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.085+0000 7ff51e4f6700 1 Processor -- start 2023-10-01T07:54:49.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.085+0000 7ff51e4f6700 1 -- start start 2023-10-01T07:54:49.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.086+0000 7ff51e4f6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff51806e570 0x7ff51806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:49.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.086+0000 7ff51e4f6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff51809eca0 0x7ff51806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:49.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.086+0000 7ff51e4f6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff518134610 0x7ff518134a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:49.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.086+0000 7ff51e4f6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff518070ee0 con 0x7ff51806e570 2023-10-01T07:54:49.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.086+0000 7ff51e4f6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff518071480 con 0x7ff51809eca0 2023-10-01T07:54:49.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.086+0000 7ff51e4f6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff51806f3c0 con 0x7ff518134610 2023-10-01T07:54:49.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.086+0000 7ff5177fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff51809eca0 0x7ff51806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:49.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.086+0000 7ff5177fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff51809eca0 0x7ff51806ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46148/0 (socket says 172.21.15.26:46148) 2023-10-01T07:54:49.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.086+0000 7ff5177fe700 1 -- 172.21.15.26:0/3746131847 learned_addr learned my addr 172.21.15.26:0/3746131847 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:49.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.086+0000 7ff517fff700 1 --2- 172.21.15.26:0/3746131847 >> v2:172.21.15.26:3300/0 conn(0x7ff51806e570 0x7ff51806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:49.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.086+0000 7ff51ca93700 1 --2- 172.21.15.26:0/3746131847 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff518134610 0x7ff518134a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:49.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.087+0000 7ff5177fe700 1 -- 172.21.15.26:0/3746131847 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff518134610 msgr2=0x7ff518134a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:49.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.087+0000 7ff5177fe700 1 --2- 172.21.15.26:0/3746131847 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff518134610 0x7ff518134a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.087+0000 7ff5177fe700 1 -- 172.21.15.26:0/3746131847 >> v2:172.21.15.26:3300/0 conn(0x7ff51806e570 msgr2=0x7ff51806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:49.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.087+0000 7ff5177fe700 1 --2- 172.21.15.26:0/3746131847 >> v2:172.21.15.26:3300/0 conn(0x7ff51806e570 0x7ff51806e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.087+0000 7ff5177fe700 1 -- 172.21.15.26:0/3746131847 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff518071b90 con 0x7ff51809eca0 2023-10-01T07:54:49.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.087+0000 7ff5177fe700 1 --2- 172.21.15.26:0/3746131847 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff51809eca0 0x7ff51806ee80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff50c0098f0 tx=0x7ff50c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=daad2a5dd2c25a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:49.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.087+0000 7ff516ffd700 1 -- 172.21.15.26:0/3746131847 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c011830 con 0x7ff51809eca0 2023-10-01T07:54:49.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.087+0000 7ff516ffd700 1 -- 172.21.15.26:0/3746131847 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50c011990 con 0x7ff51809eca0 2023-10-01T07:54:49.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.087+0000 7ff516ffd700 1 -- 172.21.15.26:0/3746131847 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c011d20 con 0x7ff51809eca0 2023-10-01T07:54:49.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.088+0000 7ff51e4f6700 1 -- 172.21.15.26:0/3746131847 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff51809eca0 msgr2=0x7ff51806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:49.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.088+0000 7ff51e4f6700 1 --2- 172.21.15.26:0/3746131847 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff51809eca0 0x7ff51806ee80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff50c0098f0 tx=0x7ff50c009c00 comp rx=0 tx=0).stop 2023-10-01T07:54:49.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.088+0000 7ff51e4f6700 1 -- 172.21.15.26:0/3746131847 shutdown_connections 2023-10-01T07:54:49.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.088+0000 7ff51e4f6700 1 --2- 172.21.15.26:0/3746131847 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff518134610 0x7ff518134a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.088+0000 7ff51e4f6700 1 --2- 172.21.15.26:0/3746131847 >> v2:172.21.15.26:3300/0 conn(0x7ff51806e570 0x7ff51806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.088+0000 7ff51e4f6700 1 --2- 172.21.15.26:0/3746131847 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff51809eca0 0x7ff51806ee80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.088+0000 7ff51e4f6700 1 -- 172.21.15.26:0/3746131847 >> 172.21.15.26:0/3746131847 conn(0x7ff5180a2aa0 msgr2=0x7ff5180a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:49.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.089+0000 7ff51e4f6700 1 -- 172.21.15.26:0/3746131847 shutdown_connections 2023-10-01T07:54:49.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.089+0000 7ff51e4f6700 1 -- 172.21.15.26:0/3746131847 wait complete. 2023-10-01T07:54:49.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.090+0000 7ff51e4f6700 1 Processor -- start 2023-10-01T07:54:49.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.090+0000 7ff51e4f6700 1 -- start start 2023-10-01T07:54:49.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.091+0000 7ff51e4f6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff51806e570 0x7ff518127490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:49.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.091+0000 7ff51e4f6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff518134610 0x7ff51809bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:49.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.091+0000 7ff51e4f6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff5181279d0 0x7ff51809c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:49.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.091+0000 7ff51e4f6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff518138ca0 con 0x7ff51806e570 2023-10-01T07:54:49.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.091+0000 7ff51e4f6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51809dbd0 con 0x7ff5181279d0 2023-10-01T07:54:49.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.091+0000 7ff51e4f6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff518139690 con 0x7ff518134610 2023-10-01T07:54:49.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.091+0000 7ff5177fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff518134610 0x7ff51809bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:49.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.091+0000 7ff517fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff51806e570 0x7ff518127490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:49.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.091+0000 7ff5177fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff518134610 0x7ff51809bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41546/0 (socket says 172.21.15.26:41546) 2023-10-01T07:54:49.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.091+0000 7ff5177fe700 1 -- 172.21.15.26:0/4232033040 learned_addr learned my addr 172.21.15.26:0/4232033040 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:49.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.091+0000 7ff51ca93700 1 --2- 172.21.15.26:0/4232033040 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff5181279d0 0x7ff51809c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:49.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.091+0000 7ff517fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff51806e570 0x7ff518127490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41752/0 (socket says 172.21.15.26:41752) 2023-10-01T07:54:49.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.092+0000 7ff51ca93700 1 -- 172.21.15.26:0/4232033040 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff518134610 msgr2=0x7ff51809bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:49.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.092+0000 7ff51ca93700 1 --2- 172.21.15.26:0/4232033040 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff518134610 0x7ff51809bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.092+0000 7ff51ca93700 1 -- 172.21.15.26:0/4232033040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff51806e570 msgr2=0x7ff518127490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:49.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.092+0000 7ff51ca93700 1 --2- 172.21.15.26:0/4232033040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff51806e570 0x7ff518127490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.092+0000 7ff51ca93700 1 -- 172.21.15.26:0/4232033040 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50c009550 con 0x7ff5181279d0 2023-10-01T07:54:49.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.092+0000 7ff5177fe700 1 --2- 172.21.15.26:0/4232033040 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff518134610 0x7ff51809bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:49.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.092+0000 7ff51ca93700 1 --2- 172.21.15.26:0/4232033040 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff5181279d0 0x7ff51809c2d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff51000efc0 tx=0x7ff51000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:49.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.092+0000 7ff514ff9700 1 -- 172.21.15.26:0/4232033040 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51000cc90 con 0x7ff5181279d0 2023-10-01T07:54:49.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.093+0000 7ff514ff9700 1 -- 172.21.15.26:0/4232033040 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51000f040 con 0x7ff5181279d0 2023-10-01T07:54:49.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.093+0000 7ff51e4f6700 1 -- 172.21.15.26:0/4232033040 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff518139010 con 0x7ff5181279d0 2023-10-01T07:54:49.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.093+0000 7ff514ff9700 1 -- 172.21.15.26:0/4232033040 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5100146c0 con 0x7ff5181279d0 2023-10-01T07:54:49.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.093+0000 7ff51e4f6700 1 -- 172.21.15.26:0/4232033040 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff518139d40 con 0x7ff5181279d0 2023-10-01T07:54:49.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.094+0000 7ff514ff9700 1 -- 172.21.15.26:0/4232033040 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff510014820 con 0x7ff5181279d0 2023-10-01T07:54:49.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.094+0000 7ff514ff9700 1 -- 172.21.15.26:0/4232033040 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7ff510040800 con 0x7ff5181279d0 2023-10-01T07:54:49.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.094+0000 7ff517fff700 1 -- 172.21.15.26:0/4232033040 >> v1:172.21.15.26:6816/126763 conn(0x7ff50402f510 legacy=0x7ff5040319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:49.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.094+0000 7ff51e4f6700 1 -- 172.21.15.26:0/4232033040 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff518074ea0 con 0x7ff5181279d0 2023-10-01T07:54:49.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.099+0000 7ff514ff9700 1 -- 172.21.15.26:0/4232033040 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff510018020 con 0x7ff5181279d0 2023-10-01T07:54:49.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.126+0000 7f4e2023d700 1 Processor -- start 2023-10-01T07:54:49.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.127+0000 7f4e2023d700 1 -- start start 2023-10-01T07:54:49.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.127+0000 7f4e2023d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4e18130540 0x7f4e18130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:49.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.127+0000 7f4e2023d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4e18130e50 0x7f4e1806f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:49.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.127+0000 7f4e2023d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e180716a0 con 0x7f4e1806fb20 2023-10-01T07:54:49.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.127+0000 7f4e2023d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1809a390 con 0x7f4e18130540 2023-10-01T07:54:49.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.127+0000 7f4e2023d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e18071290 con 0x7f4e18130e50 2023-10-01T07:54:49.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.127+0000 7f4e1d7d8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4e18130e50 0x7f4e1806f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:49.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.127+0000 7f4e1d7d8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4e18130e50 0x7f4e1806f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41556/0 (socket says 172.21.15.26:41556) 2023-10-01T07:54:49.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.127+0000 7f4e1d7d8700 1 -- 172.21.15.26:0/4023382696 learned_addr learned my addr 172.21.15.26:0/4023382696 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:49.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.127+0000 7f4e1dfd9700 1 --2- 172.21.15.26:0/4023382696 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4e18130540 0x7f4e18130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:49.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.128+0000 7f4e1dfd9700 1 -- 172.21.15.26:0/4023382696 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4e18130e50 msgr2=0x7f4e1806f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:49.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.128+0000 7f4e1dfd9700 1 --2- 172.21.15.26:0/4023382696 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4e18130e50 0x7f4e1806f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.128+0000 7f4e1dfd9700 1 -- 172.21.15.26:0/4023382696 >> v1:172.21.15.26:6789/0 conn(0x7f4e1806fb20 legacy=0x7f4e18137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:49.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.128+0000 7f4e1dfd9700 1 -- 172.21.15.26:0/4023382696 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e18130340 con 0x7f4e18130540 2023-10-01T07:54:49.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.128+0000 7f4e1d7d8700 1 --2- 172.21.15.26:0/4023382696 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4e18130e50 0x7f4e1806f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:49.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.128+0000 7f4e1dfd9700 1 --2- 172.21.15.26:0/4023382696 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4e18130540 0x7f4e18130910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4e140098a0 tx=0x7f4e14009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cd8339038e29afb server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:49.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.128+0000 7f4e1cfd7700 1 -- 172.21.15.26:0/4023382696 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e14011830 con 0x7f4e18130540 2023-10-01T07:54:49.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.128+0000 7f4e1cfd7700 1 -- 172.21.15.26:0/4023382696 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e14011990 con 0x7f4e18130540 2023-10-01T07:54:49.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.128+0000 7f4e1cfd7700 1 -- 172.21.15.26:0/4023382696 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e14011d20 con 0x7f4e18130540 2023-10-01T07:54:49.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.129+0000 7f4e2023d700 1 -- 172.21.15.26:0/4023382696 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4e18130540 msgr2=0x7f4e18130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:49.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.129+0000 7f4e2023d700 1 --2- 172.21.15.26:0/4023382696 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4e18130540 0x7f4e18130910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4e140098a0 tx=0x7f4e14009bb0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.129+0000 7f4e2023d700 1 -- 172.21.15.26:0/4023382696 shutdown_connections 2023-10-01T07:54:49.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.129+0000 7f4e2023d700 1 --2- 172.21.15.26:0/4023382696 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4e18130540 0x7f4e18130910 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.129+0000 7f4e2023d700 1 --2- 172.21.15.26:0/4023382696 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4e18130e50 0x7f4e1806f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.129+0000 7f4e2023d700 1 -- 172.21.15.26:0/4023382696 >> 172.21.15.26:0/4023382696 conn(0x7f4e180a2aa0 msgr2=0x7f4e180a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:49.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.129+0000 7f4e2023d700 1 -- 172.21.15.26:0/4023382696 shutdown_connections 2023-10-01T07:54:49.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.129+0000 7f4e2023d700 1 -- 172.21.15.26:0/4023382696 wait complete. 2023-10-01T07:54:49.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.131+0000 7f4e2023d700 1 Processor -- start 2023-10-01T07:54:49.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.131+0000 7f4e2023d700 1 -- start start 2023-10-01T07:54:49.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.132+0000 7f4e2023d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4e1806fb20 0x7f4e1812abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:49.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.132+0000 7f4e2023d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e18130540 0x7f4e1812b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:49.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.132+0000 7f4e2023d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4e18130e50 0x7f4e181c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:49.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.132+0000 7f4e2023d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1812ddf0 con 0x7f4e18130540 2023-10-01T07:54:49.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.132+0000 7f4e2023d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1812a7e0 con 0x7f4e1806fb20 2023-10-01T07:54:49.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.132+0000 7f4e2023d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e18139a80 con 0x7f4e18130e50 2023-10-01T07:54:49.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.132+0000 7f4e1dfd9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4e1806fb20 0x7f4e1812abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:49.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.132+0000 7f4e1dfd9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4e1806fb20 0x7f4e1812abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46158/0 (socket says 172.21.15.26:46158) 2023-10-01T07:54:49.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.132+0000 7f4e1dfd9700 1 -- 172.21.15.26:0/2286233951 learned_addr learned my addr 172.21.15.26:0/2286233951 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:49.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.132+0000 7f4e1e7da700 1 --2- 172.21.15.26:0/2286233951 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4e18130e50 0x7f4e181c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:49.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.132+0000 7f4e1d7d8700 1 --2- 172.21.15.26:0/2286233951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e18130540 0x7f4e1812b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:49.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.132+0000 7f4e1dfd9700 1 -- 172.21.15.26:0/2286233951 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4e18130e50 msgr2=0x7f4e181c5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:49.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.132+0000 7f4e1dfd9700 1 --2- 172.21.15.26:0/2286233951 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4e18130e50 0x7f4e181c5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.132+0000 7f4e1dfd9700 1 -- 172.21.15.26:0/2286233951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e18130540 msgr2=0x7f4e1812b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:49.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.132+0000 7f4e1dfd9700 1 --2- 172.21.15.26:0/2286233951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e18130540 0x7f4e1812b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.133+0000 7f4e1dfd9700 1 -- 172.21.15.26:0/2286233951 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e08009550 con 0x7f4e1806fb20 2023-10-01T07:54:49.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.133+0000 7f4e1e7da700 1 --2- 172.21.15.26:0/2286233951 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4e18130e50 0x7f4e181c5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:49.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.133+0000 7f4e1dfd9700 1 --2- 172.21.15.26:0/2286233951 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4e1806fb20 0x7f4e1812abf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4e140090b0 tx=0x7f4e14004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:49.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.133+0000 7f4e0e7fc700 1 -- 172.21.15.26:0/2286233951 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e14004240 con 0x7f4e1806fb20 2023-10-01T07:54:49.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.133+0000 7f4e0e7fc700 1 -- 172.21.15.26:0/2286233951 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1401f070 con 0x7f4e1806fb20 2023-10-01T07:54:49.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.133+0000 7f4e2023d700 1 -- 172.21.15.26:0/2286233951 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e140094a0 con 0x7f4e1806fb20 2023-10-01T07:54:49.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.133+0000 7f4e0e7fc700 1 -- 172.21.15.26:0/2286233951 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e140045e0 con 0x7f4e1806fb20 2023-10-01T07:54:49.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.133+0000 7f4e2023d700 1 -- 172.21.15.26:0/2286233951 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e1812b670 con 0x7f4e1806fb20 2023-10-01T07:54:49.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.134+0000 7f4e0e7fc700 1 -- 172.21.15.26:0/2286233951 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4e14021030 con 0x7f4e1806fb20 2023-10-01T07:54:49.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.134+0000 7f4e0e7fc700 1 -- 172.21.15.26:0/2286233951 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f4e14040d10 con 0x7f4e1806fb20 2023-10-01T07:54:49.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.134+0000 7f4e1d7d8700 1 -- 172.21.15.26:0/2286233951 >> v1:172.21.15.26:6816/126763 conn(0x7f4dfc02f510 legacy=0x7f4dfc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:49.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.134+0000 7f4e2023d700 1 -- 172.21.15.26:0/2286233951 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e1812dc30 con 0x7f4e1806fb20 2023-10-01T07:54:49.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.144+0000 7f4e0e7fc700 1 -- 172.21.15.26:0/2286233951 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4e1812dc30 con 0x7f4e1806fb20 2023-10-01T07:54:49.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.160+0000 7f6c41830700 1 Processor -- start 2023-10-01T07:54:49.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.160+0000 7f6c41830700 1 -- start start 2023-10-01T07:54:49.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.161+0000 7f6c41830700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c3c09d6f0 0x7f6c3c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:49.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.161+0000 7f6c41830700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6c3c09e000 0x7f6c3c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:49.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.161+0000 7f6c41830700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6c3c09e410 0x7f6c3c133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:49.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.161+0000 7f6c41830700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c3c06b460 con 0x7f6c3c09e410 2023-10-01T07:54:49.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.161+0000 7f6c41830700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c09b120 con 0x7f6c3c09d6f0 2023-10-01T07:54:49.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.161+0000 7f6c41830700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c09a7e0 con 0x7f6c3c09e000 2023-10-01T07:54:49.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.162+0000 7f6c3b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6c3c09e410 0x7f6c3c133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:49.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.162+0000 7f6c3a7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6c3c09e000 0x7f6c3c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:49.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.162+0000 7f6c3b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6c3c09e410 0x7f6c3c133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41766/0 (socket says 172.21.15.26:41766) 2023-10-01T07:54:49.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.162+0000 7f6c3a7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6c3c09e000 0x7f6c3c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41572/0 (socket says 172.21.15.26:41572) 2023-10-01T07:54:49.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.162+0000 7f6c3affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c3c09d6f0 0x7f6c3c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:49.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.162+0000 7f6c3b7fe700 1 -- 172.21.15.26:0/1173416578 learned_addr learned my addr 172.21.15.26:0/1173416578 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:49.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.162+0000 7f6c3b7fe700 1 -- 172.21.15.26:0/1173416578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6c3c09e000 msgr2=0x7f6c3c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:49.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.162+0000 7f6c3b7fe700 1 --2- 172.21.15.26:0/1173416578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6c3c09e000 0x7f6c3c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.162+0000 7f6c3b7fe700 1 -- 172.21.15.26:0/1173416578 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c3c09d6f0 msgr2=0x7f6c3c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:49.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.162+0000 7f6c3b7fe700 1 --2- 172.21.15.26:0/1173416578 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c3c09d6f0 0x7f6c3c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.162+0000 7f6c3b7fe700 1 -- 172.21.15.26:0/1173416578 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3c09a500 con 0x7f6c3c09e410 2023-10-01T07:54:49.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.162+0000 7f6c3b7fe700 1 --2- 172.21.15.26:0/1173416578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c3c09e410 0x7f6c3c133f30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6c34009e50 tx=0x7f6c3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=747b315035da327f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:49.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.162+0000 7f6c39ffb700 1 -- 172.21.15.26:0/1173416578 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3400e070 con 0x7f6c3c09e410 2023-10-01T07:54:49.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.163+0000 7f6c39ffb700 1 -- 172.21.15.26:0/1173416578 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3400b910 con 0x7f6c3c09e410 2023-10-01T07:54:49.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.163+0000 7f6c39ffb700 1 -- 172.21.15.26:0/1173416578 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3400bcc0 con 0x7f6c3c09e410 2023-10-01T07:54:49.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.163+0000 7f6c41830700 1 -- 172.21.15.26:0/1173416578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c3c09e410 msgr2=0x7f6c3c133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:49.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.163+0000 7f6c41830700 1 --2- 172.21.15.26:0/1173416578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c3c09e410 0x7f6c3c133f30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6c34009e50 tx=0x7f6c3400b330 comp rx=0 tx=0).stop 2023-10-01T07:54:49.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.163+0000 7f6c41830700 1 -- 172.21.15.26:0/1173416578 shutdown_connections 2023-10-01T07:54:49.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.163+0000 7f6c41830700 1 --2- 172.21.15.26:0/1173416578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c3c09e410 0x7f6c3c133f30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.163+0000 7f6c41830700 1 --2- 172.21.15.26:0/1173416578 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c3c09d6f0 0x7f6c3c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.163+0000 7f6c41830700 1 --2- 172.21.15.26:0/1173416578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6c3c09e000 0x7f6c3c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.163+0000 7f6c41830700 1 -- 172.21.15.26:0/1173416578 >> 172.21.15.26:0/1173416578 conn(0x7f6c3c066f50 msgr2=0x7f6c3c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:49.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.163+0000 7f6c41830700 1 -- 172.21.15.26:0/1173416578 shutdown_connections 2023-10-01T07:54:49.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.163+0000 7f6c41830700 1 -- 172.21.15.26:0/1173416578 wait complete. 2023-10-01T07:54:49.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.164+0000 7f6c41830700 1 Processor -- start 2023-10-01T07:54:49.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.165+0000 7f6c41830700 1 -- start start 2023-10-01T07:54:49.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.165+0000 7f6c41830700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c3c09d6f0 0x7f6c3c1a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:49.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.165+0000 7f6c41830700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6c3c09e000 0x7f6c3c1a56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:49.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.165+0000 7f6c41830700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c3c09e410 0x7f6c3c1c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:49.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.165+0000 7f6c41830700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c1a5c00 con 0x7f6c3c09d6f0 2023-10-01T07:54:49.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.165+0000 7f6c41830700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c1a83d0 con 0x7f6c3c09e410 2023-10-01T07:54:49.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.165+0000 7f6c41830700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c1a4c70 con 0x7f6c3c09e000 2023-10-01T07:54:49.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.165+0000 7f6c3affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c3c09d6f0 0x7f6c3c1a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:49.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.165+0000 7f6c3affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c3c09d6f0 0x7f6c3c1a5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41780/0 (socket says 172.21.15.26:41780) 2023-10-01T07:54:49.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.165+0000 7f6c3affd700 1 -- 172.21.15.26:0/2050957289 learned_addr learned my addr 172.21.15.26:0/2050957289 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:49.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.166+0000 7f6c3a7fc700 1 --2- 172.21.15.26:0/2050957289 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6c3c09e000 0x7f6c3c1a56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:49.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.166+0000 7f6c3b7fe700 1 --2- 172.21.15.26:0/2050957289 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c3c09e410 0x7f6c3c1c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:49.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.166+0000 7f6c3a7fc700 1 -- 172.21.15.26:0/2050957289 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c3c09e410 msgr2=0x7f6c3c1c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:49.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.166+0000 7f6c3a7fc700 1 --2- 172.21.15.26:0/2050957289 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c3c09e410 0x7f6c3c1c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.166+0000 7f6c3a7fc700 1 -- 172.21.15.26:0/2050957289 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c3c09d6f0 msgr2=0x7f6c3c1a5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:49.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.166+0000 7f6c3a7fc700 1 --2- 172.21.15.26:0/2050957289 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c3c09d6f0 0x7f6c3c1a5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.166+0000 7f6c3a7fc700 1 -- 172.21.15.26:0/2050957289 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c34009b30 con 0x7f6c3c09e000 2023-10-01T07:54:49.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.166+0000 7f6c3a7fc700 1 --2- 172.21.15.26:0/2050957289 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6c3c09e000 0x7f6c3c1a56c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6c3000e8d0 tx=0x7f6c3000ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:49.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.166+0000 7f6c23fff700 1 -- 172.21.15.26:0/2050957289 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c30013680 con 0x7f6c3c09e000 2023-10-01T07:54:49.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.166+0000 7f6c23fff700 1 -- 172.21.15.26:0/2050957289 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c300137e0 con 0x7f6c3c09e000 2023-10-01T07:54:49.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.166+0000 7f6c23fff700 1 -- 172.21.15.26:0/2050957289 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c30013b50 con 0x7f6c3c09e000 2023-10-01T07:54:49.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.167+0000 7f6c41830700 1 -- 172.21.15.26:0/2050957289 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c3c0a2f60 con 0x7f6c3c09e000 2023-10-01T07:54:49.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.167+0000 7f6c41830700 1 -- 172.21.15.26:0/2050957289 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c3c1a7030 con 0x7f6c3c09e000 2023-10-01T07:54:49.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.168+0000 7f6c41830700 1 -- 172.21.15.26:0/2050957289 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c3c1a8210 con 0x7f6c3c09e000 2023-10-01T07:54:49.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.168+0000 7f6c23fff700 1 -- 172.21.15.26:0/2050957289 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6c30013cb0 con 0x7f6c3c09e000 2023-10-01T07:54:49.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.168+0000 7f6c23fff700 1 -- 172.21.15.26:0/2050957289 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f6c3003fe90 con 0x7f6c3c09e000 2023-10-01T07:54:49.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.168+0000 7f6c3affd700 1 -- 172.21.15.26:0/2050957289 >> v1:172.21.15.26:6816/126763 conn(0x7f6c2802f510 legacy=0x7f6c280319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:49.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.173+0000 7f6c23fff700 1 -- 172.21.15.26:0/2050957289 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6c3c1a8210 con 0x7f6c3c09e000 2023-10-01T07:54:49.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.206+0000 7f1b8c7a5700 1 Processor -- start 2023-10-01T07:54:49.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.206+0000 7f1b8c7a5700 1 -- start start 2023-10-01T07:54:49.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.206+0000 7f1b8c7a5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b8412cf60 0x7f1b8406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:49.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.206+0000 7f1b8c7a5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b8412f8b0 0x7f1b8412fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:49.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.206+0000 7f1b8c7a5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1b84130260 0x7f1b84136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:49.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.206+0000 7f1b8c7a5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b8412d330 con 0x7f1b84130260 2023-10-01T07:54:49.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.206+0000 7f1b8c7a5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8412cd90 con 0x7f1b8412f8b0 2023-10-01T07:54:49.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.206+0000 7f1b8c7a5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b841306d0 con 0x7f1b8412cf60 2023-10-01T07:54:49.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.207+0000 7f1b8ad42700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1b84130260 0x7f1b84136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:49.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.207+0000 7f1b8a541700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b8412cf60 0x7f1b8406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:49.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.207+0000 7f1b8ad42700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1b84130260 0x7f1b84136c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41788/0 (socket says 172.21.15.26:41788) 2023-10-01T07:54:49.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.207+0000 7f1b8ad42700 1 -- 172.21.15.26:0/1079319268 learned_addr learned my addr 172.21.15.26:0/1079319268 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:49.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.207+0000 7f1b89d40700 1 --2- 172.21.15.26:0/1079319268 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b8412f8b0 0x7f1b8412fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:49.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.207+0000 7f1b8ad42700 1 -- 172.21.15.26:0/1079319268 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b8412cf60 msgr2=0x7f1b8406f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:49.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.207+0000 7f1b8ad42700 1 --2- 172.21.15.26:0/1079319268 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b8412cf60 0x7f1b8406f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.207+0000 7f1b8ad42700 1 -- 172.21.15.26:0/1079319268 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b8412f8b0 msgr2=0x7f1b8412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:49.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.207+0000 7f1b8ad42700 1 --2- 172.21.15.26:0/1079319268 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b8412f8b0 0x7f1b8412fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.207+0000 7f1b8ad42700 1 -- 172.21.15.26:0/1079319268 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b84071780 con 0x7f1b84130260 2023-10-01T07:54:49.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.207+0000 7f1b8ad42700 1 --2- 172.21.15.26:0/1079319268 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b84130260 0x7f1b84136c20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c009e50 tx=0x7f1b7c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c428cc39944fced2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:49.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.208+0000 7f1b8953f700 1 -- 172.21.15.26:0/1079319268 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c00e070 con 0x7f1b84130260 2023-10-01T07:54:49.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.208+0000 7f1b8953f700 1 -- 172.21.15.26:0/1079319268 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7c00b910 con 0x7f1b84130260 2023-10-01T07:54:49.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.208+0000 7f1b8953f700 1 -- 172.21.15.26:0/1079319268 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c00bcc0 con 0x7f1b84130260 2023-10-01T07:54:49.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.208+0000 7f1b8c7a5700 1 -- 172.21.15.26:0/1079319268 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b84130260 msgr2=0x7f1b84136c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:49.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.208+0000 7f1b8c7a5700 1 --2- 172.21.15.26:0/1079319268 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b84130260 0x7f1b84136c20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c009e50 tx=0x7f1b7c00b330 comp rx=0 tx=0).stop 2023-10-01T07:54:49.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.208+0000 7f1b8c7a5700 1 -- 172.21.15.26:0/1079319268 shutdown_connections 2023-10-01T07:54:49.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.208+0000 7f1b8c7a5700 1 --2- 172.21.15.26:0/1079319268 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b84130260 0x7f1b84136c20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.208+0000 7f1b8c7a5700 1 --2- 172.21.15.26:0/1079319268 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b8412cf60 0x7f1b8406f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.208+0000 7f1b8c7a5700 1 --2- 172.21.15.26:0/1079319268 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b8412f8b0 0x7f1b8412fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.208+0000 7f1b8c7a5700 1 -- 172.21.15.26:0/1079319268 >> 172.21.15.26:0/1079319268 conn(0x7f1b840a2aa0 msgr2=0x7f1b840a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:49.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.209+0000 7f1b8c7a5700 1 -- 172.21.15.26:0/1079319268 shutdown_connections 2023-10-01T07:54:49.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.209+0000 7f1b8c7a5700 1 -- 172.21.15.26:0/1079319268 wait complete. 2023-10-01T07:54:49.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.210+0000 7f1b8c7a5700 1 Processor -- start 2023-10-01T07:54:49.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.210+0000 7f1b8c7a5700 1 -- start start 2023-10-01T07:54:49.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.210+0000 7f1b8c7a5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b8412cf60 0x7f1b841214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:49.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.210+0000 7f1b8c7a5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b8412f8b0 0x7f1b84121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:49.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.210+0000 7f1b8c7a5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b84130260 0x7f1b84121f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:49.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.210+0000 7f1b8c7a5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b841227d0 con 0x7f1b8412cf60 2023-10-01T07:54:49.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.210+0000 7f1b8c7a5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8412d960 con 0x7f1b8412f8b0 2023-10-01T07:54:49.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.210+0000 7f1b8c7a5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b84129fa0 con 0x7f1b84130260 2023-10-01T07:54:49.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.210+0000 7f1b8a541700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b8412cf60 0x7f1b841214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:49.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.210+0000 7f1b8a541700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b8412cf60 0x7f1b841214e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41796/0 (socket says 172.21.15.26:41796) 2023-10-01T07:54:49.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.210+0000 7f1b8a541700 1 -- 172.21.15.26:0/3586239508 learned_addr learned my addr 172.21.15.26:0/3586239508 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:49.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.211+0000 7f1b8ad42700 1 --2- 172.21.15.26:0/3586239508 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b84130260 0x7f1b84121f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:49.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.211+0000 7f1b8a541700 1 -- 172.21.15.26:0/3586239508 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b84130260 msgr2=0x7f1b84121f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:49.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.211+0000 7f1b8a541700 1 --2- 172.21.15.26:0/3586239508 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b84130260 0x7f1b84121f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.211+0000 7f1b8a541700 1 -- 172.21.15.26:0/3586239508 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b8412f8b0 msgr2=0x7f1b84121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:49.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.211+0000 7f1b8a541700 1 --2- 172.21.15.26:0/3586239508 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b8412f8b0 0x7f1b84121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.211+0000 7f1b8a541700 1 -- 172.21.15.26:0/3586239508 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b7c009b30 con 0x7f1b8412cf60 2023-10-01T07:54:49.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.211+0000 7f1b8ad42700 1 --2- 172.21.15.26:0/3586239508 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b84130260 0x7f1b84121f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:49.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.211+0000 7f1b8a541700 1 --2- 172.21.15.26:0/3586239508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b8412cf60 0x7f1b841214e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1b8000db90 tx=0x7f1b8000dea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:49.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.211+0000 7f1b7affd700 1 -- 172.21.15.26:0/3586239508 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8000ce00 con 0x7f1b8412cf60 2023-10-01T07:54:49.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.211+0000 7f1b7affd700 1 -- 172.21.15.26:0/3586239508 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b80015420 con 0x7f1b8412cf60 2023-10-01T07:54:49.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.211+0000 7f1b7affd700 1 -- 172.21.15.26:0/3586239508 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b800157b0 con 0x7f1b8412cf60 2023-10-01T07:54:49.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.212+0000 7f1b8c7a5700 1 -- 172.21.15.26:0/3586239508 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b84123f20 con 0x7f1b8412cf60 2023-10-01T07:54:49.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.212+0000 7f1b8c7a5700 1 -- 172.21.15.26:0/3586239508 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b84123b30 con 0x7f1b8412cf60 2023-10-01T07:54:49.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.213+0000 7f1b7affd700 1 -- 172.21.15.26:0/3586239508 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1b80015910 con 0x7f1b8412cf60 2023-10-01T07:54:49.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.213+0000 7f1b7affd700 1 -- 172.21.15.26:0/3586239508 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f1b80040190 con 0x7f1b8412cf60 2023-10-01T07:54:49.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.213+0000 7f1b8c7a5700 1 -- 172.21.15.26:0/3586239508 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b84123770 con 0x7f1b8412cf60 2023-10-01T07:54:49.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.213+0000 7f1b89d40700 1 -- 172.21.15.26:0/3586239508 >> v1:172.21.15.26:6816/126763 conn(0x7f1b6802f510 legacy=0x7f1b680319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:49.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.223+0000 7f1b7affd700 1 -- 172.21.15.26:0/3586239508 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1b800132e0 con 0x7f1b8412cf60 2023-10-01T07:54:49.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.295+0000 7ff517fff700 1 -- 172.21.15.26:0/4232033040 >> v1:172.21.15.26:6816/126763 conn(0x7ff50402f510 legacy=0x7ff5040319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:49.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.331+0000 7ff51e4f6700 1 -- 172.21.15.26:0/4232033040 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff518071100 con 0x7ff5181279d0 2023-10-01T07:54:49.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.332+0000 7ff514ff9700 1 -- 172.21.15.26:0/4232033040 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff51002b090 con 0x7ff5181279d0 2023-10-01T07:54:49.333 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:54:49.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.335+0000 7f4e1d7d8700 1 -- 172.21.15.26:0/2286233951 >> v1:172.21.15.26:6816/126763 conn(0x7f4dfc02f510 legacy=0x7f4dfc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:49.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.335+0000 7ff51e4f6700 1 -- 172.21.15.26:0/4232033040 >> v1:172.21.15.26:6816/126763 conn(0x7ff50402f510 legacy=0x7ff5040319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:49.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.335+0000 7ff51e4f6700 1 -- 172.21.15.26:0/4232033040 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff5181279d0 msgr2=0x7ff51809c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:49.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.335+0000 7ff51e4f6700 1 --2- 172.21.15.26:0/4232033040 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff5181279d0 0x7ff51809c2d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff51000efc0 tx=0x7ff51000c3a0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.335+0000 7ff51e4f6700 1 -- 172.21.15.26:0/4232033040 shutdown_connections 2023-10-01T07:54:49.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.335+0000 7ff51e4f6700 1 --2- 172.21.15.26:0/4232033040 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff5181279d0 0x7ff51809c2d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.335+0000 7ff51e4f6700 1 --2- 172.21.15.26:0/4232033040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff51806e570 0x7ff518127490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.335+0000 7ff51e4f6700 1 --2- 172.21.15.26:0/4232033040 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff518134610 0x7ff51809bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.335+0000 7ff51e4f6700 1 -- 172.21.15.26:0/4232033040 >> 172.21.15.26:0/4232033040 conn(0x7ff5180a2aa0 msgr2=0x7ff518136660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:49.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.336+0000 7ff51e4f6700 1 -- 172.21.15.26:0/4232033040 shutdown_connections 2023-10-01T07:54:49.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.336+0000 7ff51e4f6700 1 -- 172.21.15.26:0/4232033040 wait complete. 2023-10-01T07:54:49.351 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:54:49.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.368+0000 7f4e2023d700 1 -- 172.21.15.26:0/2286233951 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4e1812dc30 con 0x7f4e1806fb20 2023-10-01T07:54:49.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.368+0000 7f4e0e7fc700 1 -- 172.21.15.26:0/2286233951 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4e1812dc30 con 0x7f4e1806fb20 2023-10-01T07:54:49.369 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:54:49.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.369+0000 7f6c3affd700 1 -- 172.21.15.26:0/2050957289 >> v1:172.21.15.26:6816/126763 conn(0x7f6c2802f510 legacy=0x7f6c280319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:49.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.371+0000 7f4e2023d700 1 -- 172.21.15.26:0/2286233951 >> v1:172.21.15.26:6816/126763 conn(0x7f4dfc02f510 legacy=0x7f4dfc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:49.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.371+0000 7f4e2023d700 1 -- 172.21.15.26:0/2286233951 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4e1806fb20 msgr2=0x7f4e1812abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:49.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.371+0000 7f4e2023d700 1 --2- 172.21.15.26:0/2286233951 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4e1806fb20 0x7f4e1812abf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4e140090b0 tx=0x7f4e14004750 comp rx=0 tx=0).stop 2023-10-01T07:54:49.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.371+0000 7f4e2023d700 1 -- 172.21.15.26:0/2286233951 shutdown_connections 2023-10-01T07:54:49.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.371+0000 7f4e2023d700 1 --2- 172.21.15.26:0/2286233951 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4e18130e50 0x7f4e181c5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.371+0000 7f4e2023d700 1 --2- 172.21.15.26:0/2286233951 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4e1806fb20 0x7f4e1812abf0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.371+0000 7f4e2023d700 1 --2- 172.21.15.26:0/2286233951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e18130540 0x7f4e1812b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.371+0000 7f4e2023d700 1 -- 172.21.15.26:0/2286233951 >> 172.21.15.26:0/2286233951 conn(0x7f4e180a2aa0 msgr2=0x7f4e1806e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:49.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.371+0000 7f4e2023d700 1 -- 172.21.15.26:0/2286233951 shutdown_connections 2023-10-01T07:54:49.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.371+0000 7f4e2023d700 1 -- 172.21.15.26:0/2286233951 wait complete. 2023-10-01T07:54:49.386 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:54:49.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.385+0000 7f6c41830700 1 -- 172.21.15.26:0/2050957289 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6c3c1a8210 con 0x7f6c3c09e000 2023-10-01T07:54:49.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.385+0000 7f6c23fff700 1 -- 172.21.15.26:0/2050957289 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6c3c1a8210 con 0x7f6c3c09e000 2023-10-01T07:54:49.387 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:54:49.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.388+0000 7f6c41830700 1 -- 172.21.15.26:0/2050957289 >> v1:172.21.15.26:6816/126763 conn(0x7f6c2802f510 legacy=0x7f6c280319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:49.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.388+0000 7f6c41830700 1 -- 172.21.15.26:0/2050957289 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6c3c09e000 msgr2=0x7f6c3c1a56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:49.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.388+0000 7f6c41830700 1 --2- 172.21.15.26:0/2050957289 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6c3c09e000 0x7f6c3c1a56c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6c3000e8d0 tx=0x7f6c3000ebe0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.388+0000 7f6c41830700 1 -- 172.21.15.26:0/2050957289 shutdown_connections 2023-10-01T07:54:49.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.388+0000 7f6c41830700 1 --2- 172.21.15.26:0/2050957289 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c3c09e410 0x7f6c3c1c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.388+0000 7f6c41830700 1 --2- 172.21.15.26:0/2050957289 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c3c09d6f0 0x7f6c3c1a5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.388+0000 7f6c41830700 1 --2- 172.21.15.26:0/2050957289 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6c3c09e000 0x7f6c3c1a56c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.388+0000 7f6c41830700 1 -- 172.21.15.26:0/2050957289 >> 172.21.15.26:0/2050957289 conn(0x7f6c3c066f50 msgr2=0x7f6c3c1bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:49.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.388+0000 7f6c41830700 1 -- 172.21.15.26:0/2050957289 shutdown_connections 2023-10-01T07:54:49.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.388+0000 7f6c41830700 1 -- 172.21.15.26:0/2050957289 wait complete. 2023-10-01T07:54:49.402 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:54:49.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.414+0000 7f1b89d40700 1 -- 172.21.15.26:0/3586239508 >> v1:172.21.15.26:6816/126763 conn(0x7f1b6802f510 legacy=0x7f1b680319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:49.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.434+0000 7f1b8c7a5700 1 -- 172.21.15.26:0/3586239508 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1b8406fd60 con 0x7f1b8412cf60 2023-10-01T07:54:49.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.434+0000 7f1b7affd700 1 -- 172.21.15.26:0/3586239508 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1b8001cb00 con 0x7f1b8412cf60 2023-10-01T07:54:49.435 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:54:49.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.436+0000 7f1b8c7a5700 1 -- 172.21.15.26:0/3586239508 >> v1:172.21.15.26:6816/126763 conn(0x7f1b6802f510 legacy=0x7f1b680319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:49.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.436+0000 7f1b8c7a5700 1 -- 172.21.15.26:0/3586239508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b8412cf60 msgr2=0x7f1b841214e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:49.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.436+0000 7f1b8c7a5700 1 --2- 172.21.15.26:0/3586239508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b8412cf60 0x7f1b841214e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1b8000db90 tx=0x7f1b8000dea0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.436+0000 7f1b8c7a5700 1 -- 172.21.15.26:0/3586239508 shutdown_connections 2023-10-01T07:54:49.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.436+0000 7f1b8c7a5700 1 --2- 172.21.15.26:0/3586239508 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b84130260 0x7f1b84121f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.436+0000 7f1b8c7a5700 1 --2- 172.21.15.26:0/3586239508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b8412cf60 0x7f1b841214e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.436+0000 7f1b8c7a5700 1 --2- 172.21.15.26:0/3586239508 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b8412f8b0 0x7f1b84121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:49.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.437+0000 7f1b8c7a5700 1 -- 172.21.15.26:0/3586239508 >> 172.21.15.26:0/3586239508 conn(0x7f1b840a2aa0 msgr2=0x7f1b840a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:49.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.437+0000 7f1b8c7a5700 1 -- 172.21.15.26:0/3586239508 shutdown_connections 2023-10-01T07:54:49.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:49.437+0000 7f1b8c7a5700 1 -- 172.21.15.26:0/3586239508 wait complete. 2023-10-01T07:54:49.450 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:54:50.352 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:54:50.387 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:54:50.403 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:54:50.451 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:54:50.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.502+0000 7f0022eb6700 1 Processor -- start 2023-10-01T07:54:50.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.502+0000 7f0022eb6700 1 -- start start 2023-10-01T07:54:50.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.502+0000 7f0022eb6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f001c09d6f0 0x7f001c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:50.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.502+0000 7f0022eb6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f001c09e000 0x7f001c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:50.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.502+0000 7f0022eb6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f001c09b120 con 0x7f001c09e410 2023-10-01T07:54:50.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.502+0000 7f0022eb6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f001c06b460 con 0x7f001c09d6f0 2023-10-01T07:54:50.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.502+0000 7f0022eb6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f001c09a7e0 con 0x7f001c09e000 2023-10-01T07:54:50.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.503+0000 7f0021453700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f001c09e410 0x7f001c133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60072/0 (socket says 172.21.15.26:60072) 2023-10-01T07:54:50.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.503+0000 7f0020c52700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f001c09d6f0 0x7f001c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:50.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.503+0000 7f0021453700 1 -- 172.21.15.26:0/932091574 learned_addr learned my addr 172.21.15.26:0/932091574 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:50.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.503+0000 7f001bfff700 1 --2- 172.21.15.26:0/932091574 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f001c09e000 0x7f001c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:50.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.503+0000 7f0020c52700 1 -- 172.21.15.26:0/932091574 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f001c09e000 msgr2=0x7f001c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:50.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.503+0000 7f0020c52700 1 --2- 172.21.15.26:0/932091574 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f001c09e000 0x7f001c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.503+0000 7f0020c52700 1 -- 172.21.15.26:0/932091574 >> v1:172.21.15.26:6789/0 conn(0x7f001c09e410 legacy=0x7f001c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:50.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.503+0000 7f0020c52700 1 -- 172.21.15.26:0/932091574 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f001c09a500 con 0x7f001c09d6f0 2023-10-01T07:54:50.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.503+0000 7f0020c52700 1 --2- 172.21.15.26:0/932091574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f001c09d6f0 0x7f001c09dac0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0010009840 tx=0x7f0010009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e47125bbf23dbd server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:50.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.503+0000 7f001b7fe700 1 -- 172.21.15.26:0/932091574 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0010011830 con 0x7f001c09d6f0 2023-10-01T07:54:50.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.504+0000 7f001b7fe700 1 -- 172.21.15.26:0/932091574 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0010011990 con 0x7f001c09d6f0 2023-10-01T07:54:50.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.504+0000 7f001b7fe700 1 -- 172.21.15.26:0/932091574 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0010011d20 con 0x7f001c09d6f0 2023-10-01T07:54:50.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.504+0000 7f0022eb6700 1 -- 172.21.15.26:0/932091574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f001c09d6f0 msgr2=0x7f001c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:50.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.504+0000 7f0022eb6700 1 --2- 172.21.15.26:0/932091574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f001c09d6f0 0x7f001c09dac0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0010009840 tx=0x7f0010009b50 comp rx=0 tx=0).stop 2023-10-01T07:54:50.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.504+0000 7f0022eb6700 1 -- 172.21.15.26:0/932091574 shutdown_connections 2023-10-01T07:54:50.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.504+0000 7f0022eb6700 1 --2- 172.21.15.26:0/932091574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f001c09d6f0 0x7f001c09dac0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.504+0000 7f0022eb6700 1 --2- 172.21.15.26:0/932091574 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f001c09e000 0x7f001c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.504+0000 7f0022eb6700 1 -- 172.21.15.26:0/932091574 >> 172.21.15.26:0/932091574 conn(0x7f001c066f50 msgr2=0x7f001c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:50.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.505+0000 7f0022eb6700 1 -- 172.21.15.26:0/932091574 shutdown_connections 2023-10-01T07:54:50.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.505+0000 7f0022eb6700 1 -- 172.21.15.26:0/932091574 wait complete. 2023-10-01T07:54:50.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.506+0000 7f0022eb6700 1 Processor -- start 2023-10-01T07:54:50.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.506+0000 7f0022eb6700 1 -- start start 2023-10-01T07:54:50.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.507+0000 7f0022eb6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f001c09d6f0 0x7f001c1a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:50.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.507+0000 7f0022eb6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f001c09e000 0x7f001c1a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:50.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.507+0000 7f0022eb6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f001c09e410 0x7f001c1a6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:50.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.507+0000 7f0022eb6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001c1aa360 con 0x7f001c09e410 2023-10-01T07:54:50.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.507+0000 7f0022eb6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f001c1a99a0 con 0x7f001c09e000 2023-10-01T07:54:50.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.507+0000 7f0022eb6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f001c1a8ce0 con 0x7f001c09d6f0 2023-10-01T07:54:50.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.507+0000 7f0021453700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f001c09e410 0x7f001c1a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:50.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.507+0000 7f0021453700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f001c09e410 0x7f001c1a6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41812/0 (socket says 172.21.15.26:41812) 2023-10-01T07:54:50.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.507+0000 7f0021453700 1 -- 172.21.15.26:0/3240705621 learned_addr learned my addr 172.21.15.26:0/3240705621 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:50.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.507+0000 7f001bfff700 1 --2- 172.21.15.26:0/3240705621 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f001c09e000 0x7f001c1a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:50.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.508+0000 7f0021453700 1 -- 172.21.15.26:0/3240705621 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f001c09d6f0 msgr2=0x7f001c1a5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:50.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.508+0000 7f0021453700 1 --2- 172.21.15.26:0/3240705621 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f001c09d6f0 0x7f001c1a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.508+0000 7f0021453700 1 -- 172.21.15.26:0/3240705621 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f001c09e000 msgr2=0x7f001c1a6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:50.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.508+0000 7f0021453700 1 --2- 172.21.15.26:0/3240705621 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f001c09e000 0x7f001c1a6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.508+0000 7f0021453700 1 -- 172.21.15.26:0/3240705621 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00100094a0 con 0x7f001c09e410 2023-10-01T07:54:50.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.508+0000 7f001bfff700 1 --2- 172.21.15.26:0/3240705621 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f001c09e000 0x7f001c1a6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:50.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.508+0000 7f0021453700 1 --2- 172.21.15.26:0/3240705621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f001c09e410 0x7f001c1a6950 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f001400cbc0 tx=0x7f001400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:50.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.508+0000 7f00197fa700 1 -- 172.21.15.26:0/3240705621 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001400aaa0 con 0x7f001c09e410 2023-10-01T07:54:50.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.508+0000 7f00197fa700 1 -- 172.21.15.26:0/3240705621 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001400ac00 con 0x7f001c09e410 2023-10-01T07:54:50.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.508+0000 7f00197fa700 1 -- 172.21.15.26:0/3240705621 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0014012400 con 0x7f001c09e410 2023-10-01T07:54:50.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.508+0000 7f0022eb6700 1 -- 172.21.15.26:0/3240705621 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f001c0a3280 con 0x7f001c09e410 2023-10-01T07:54:50.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.508+0000 7f0022eb6700 1 -- 172.21.15.26:0/3240705621 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f001c1a7a90 con 0x7f001c09e410 2023-10-01T07:54:50.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.510+0000 7f00197fa700 1 -- 172.21.15.26:0/3240705621 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f001401b3b0 con 0x7f001c09e410 2023-10-01T07:54:50.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.510+0000 7f0022eb6700 1 -- 172.21.15.26:0/3240705621 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f001c1a9540 con 0x7f001c09e410 2023-10-01T07:54:50.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.510+0000 7f00197fa700 1 -- 172.21.15.26:0/3240705621 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f001403f800 con 0x7f001c09e410 2023-10-01T07:54:50.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.510+0000 7f0020c52700 1 -- 172.21.15.26:0/3240705621 >> v1:172.21.15.26:6816/126763 conn(0x7f000002f510 legacy=0x7f00000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:50.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.515+0000 7f00197fa700 1 -- 172.21.15.26:0/3240705621 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f00140192c0 con 0x7f001c09e410 2023-10-01T07:54:50.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.551+0000 7f822dbf2700 1 Processor -- start 2023-10-01T07:54:50.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.551+0000 7f822dbf2700 1 -- start start 2023-10-01T07:54:50.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.551+0000 7f822dbf2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82280700e0 0x7f82280704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:50.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.551+0000 7f822dbf2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82280709f0 0x7f822812cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:50.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.552+0000 7f822dbf2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f822809a530 con 0x7f822812d2e0 2023-10-01T07:54:50.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.552+0000 7f822dbf2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8228071c70 con 0x7f82280709f0 2023-10-01T07:54:50.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.552+0000 7f822dbf2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8228066680 con 0x7f82280700e0 2023-10-01T07:54:50.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.552+0000 7f82277fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82280700e0 0x7f82280704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:50.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.552+0000 7f8227fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f822812d2e0 0x7f8228137640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60086/0 (socket says 172.21.15.26:60086) 2023-10-01T07:54:50.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.552+0000 7f8227fff700 1 -- 172.21.15.26:0/726313534 learned_addr learned my addr 172.21.15.26:0/726313534 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:50.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.552+0000 7f8226ffd700 1 --2- 172.21.15.26:0/726313534 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82280709f0 0x7f822812cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:50.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.552+0000 7f8226ffd700 1 -- 172.21.15.26:0/726313534 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82280700e0 msgr2=0x7f82280704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:50.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.552+0000 7f8226ffd700 1 --2- 172.21.15.26:0/726313534 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82280700e0 0x7f82280704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.552+0000 7f8226ffd700 1 -- 172.21.15.26:0/726313534 >> v1:172.21.15.26:6789/0 conn(0x7f822812d2e0 legacy=0x7f8228137640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:50.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.552+0000 7f8226ffd700 1 -- 172.21.15.26:0/726313534 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8228099ce0 con 0x7f82280709f0 2023-10-01T07:54:50.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.552+0000 7f82277fe700 1 --2- 172.21.15.26:0/726313534 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82280700e0 0x7f82280704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:50.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.552+0000 7f8226ffd700 1 --2- 172.21.15.26:0/726313534 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82280709f0 0x7f822812cda0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f821c009870 tx=0x7f821c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a892d72fde9ab2c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:50.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.553+0000 7f82267fc700 1 -- 172.21.15.26:0/726313534 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821c011830 con 0x7f82280709f0 2023-10-01T07:54:50.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.553+0000 7f82267fc700 1 -- 172.21.15.26:0/726313534 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821c011990 con 0x7f82280709f0 2023-10-01T07:54:50.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.553+0000 7f82267fc700 1 -- 172.21.15.26:0/726313534 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821c011d20 con 0x7f82280709f0 2023-10-01T07:54:50.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.553+0000 7f822dbf2700 1 -- 172.21.15.26:0/726313534 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82280709f0 msgr2=0x7f822812cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:50.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.553+0000 7f822dbf2700 1 --2- 172.21.15.26:0/726313534 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82280709f0 0x7f822812cda0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f821c009870 tx=0x7f821c009b80 comp rx=0 tx=0).stop 2023-10-01T07:54:50.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.554+0000 7f822dbf2700 1 -- 172.21.15.26:0/726313534 shutdown_connections 2023-10-01T07:54:50.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.554+0000 7f822dbf2700 1 --2- 172.21.15.26:0/726313534 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82280700e0 0x7f82280704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.554+0000 7f822dbf2700 1 --2- 172.21.15.26:0/726313534 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82280709f0 0x7f822812cda0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.554+0000 7f822dbf2700 1 -- 172.21.15.26:0/726313534 >> 172.21.15.26:0/726313534 conn(0x7f82280a27f0 msgr2=0x7f82280a2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:50.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.554+0000 7f822dbf2700 1 -- 172.21.15.26:0/726313534 shutdown_connections 2023-10-01T07:54:50.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.554+0000 7f822dbf2700 1 -- 172.21.15.26:0/726313534 wait complete. 2023-10-01T07:54:50.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.555+0000 7f822dbf2700 1 Processor -- start 2023-10-01T07:54:50.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.555+0000 7f822dbf2700 1 -- start start 2023-10-01T07:54:50.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.556+0000 7f822dbf2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82280700e0 0x7f822811b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:50.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.556+0000 7f822dbf2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82280709f0 0x7f822811bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:50.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.556+0000 7f822dbf2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f822812d2e0 0x7f822811c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:50.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.556+0000 7f822dbf2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82281227d0 con 0x7f82280700e0 2023-10-01T07:54:50.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.556+0000 7f822dbf2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8228121ea0 con 0x7f82280709f0 2023-10-01T07:54:50.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.556+0000 7f822dbf2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f822812df20 con 0x7f822812d2e0 2023-10-01T07:54:50.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.556+0000 7f82277fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82280700e0 0x7f822811b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:50.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.556+0000 7f82277fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82280700e0 0x7f822811b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41828/0 (socket says 172.21.15.26:41828) 2023-10-01T07:54:50.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.557+0000 7f82277fe700 1 -- 172.21.15.26:0/631808399 learned_addr learned my addr 172.21.15.26:0/631808399 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:50.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.557+0000 7f8227fff700 1 --2- 172.21.15.26:0/631808399 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f822812d2e0 0x7f822811c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:50.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.557+0000 7f8226ffd700 1 --2- 172.21.15.26:0/631808399 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82280709f0 0x7f822811bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:50.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.557+0000 7f82277fe700 1 -- 172.21.15.26:0/631808399 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f822812d2e0 msgr2=0x7f822811c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:50.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.557+0000 7f82277fe700 1 --2- 172.21.15.26:0/631808399 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f822812d2e0 0x7f822811c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.557+0000 7f82277fe700 1 -- 172.21.15.26:0/631808399 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82280709f0 msgr2=0x7f822811bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:50.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.557+0000 7f82277fe700 1 --2- 172.21.15.26:0/631808399 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82280709f0 0x7f822811bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.557+0000 7f82277fe700 1 -- 172.21.15.26:0/631808399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82180094a0 con 0x7f82280700e0 2023-10-01T07:54:50.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.557+0000 7f82277fe700 1 --2- 172.21.15.26:0/631808399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82280700e0 0x7f822811b8b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f821800ebe0 tx=0x7f8218009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:50.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.557+0000 7f820ffff700 1 -- 172.21.15.26:0/631808399 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821800c910 con 0x7f82280700e0 2023-10-01T07:54:50.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.557+0000 7f822dbf2700 1 -- 172.21.15.26:0/631808399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f821c0094a0 con 0x7f82280700e0 2023-10-01T07:54:50.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.557+0000 7f820ffff700 1 -- 172.21.15.26:0/631808399 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821800ca70 con 0x7f82280700e0 2023-10-01T07:54:50.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.557+0000 7f820ffff700 1 -- 172.21.15.26:0/631808399 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821800cde0 con 0x7f82280700e0 2023-10-01T07:54:50.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.558+0000 7f822dbf2700 1 -- 172.21.15.26:0/631808399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8228070f60 con 0x7f82280700e0 2023-10-01T07:54:50.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.559+0000 7f820ffff700 1 -- 172.21.15.26:0/631808399 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8218013470 con 0x7f82280700e0 2023-10-01T07:54:50.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.559+0000 7f820ffff700 1 -- 172.21.15.26:0/631808399 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f8218041930 con 0x7f82280700e0 2023-10-01T07:54:50.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.559+0000 7f822dbf2700 1 -- 172.21.15.26:0/631808399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f822804f2a0 con 0x7f82280700e0 2023-10-01T07:54:50.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.559+0000 7f8226ffd700 1 -- 172.21.15.26:0/631808399 >> v1:172.21.15.26:6816/126763 conn(0x7f821402f510 legacy=0x7f82140319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:50.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.568+0000 7f820ffff700 1 -- 172.21.15.26:0/631808399 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8218017020 con 0x7f82280700e0 2023-10-01T07:54:50.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.602+0000 7f33dfe1a700 1 Processor -- start 2023-10-01T07:54:50.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.603+0000 7f33dfe1a700 1 -- start start 2023-10-01T07:54:50.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.603+0000 7f33dfe1a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f33d809d6f0 0x7f33d809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:50.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.603+0000 7f33dfe1a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33d809e000 0x7f33d8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:50.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.603+0000 7f33dfe1a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33d809e410 0x7f33d8130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:50.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.603+0000 7f33dfe1a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33d809f520 con 0x7f33d809d6f0 2023-10-01T07:54:50.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.603+0000 7f33dfe1a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d809f130 con 0x7f33d809e410 2023-10-01T07:54:50.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.603+0000 7f33dfe1a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33d809e930 con 0x7f33d809e000 2023-10-01T07:54:50.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.604+0000 7f33de3b7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33d809e410 0x7f33d8130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:50.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.604+0000 7f33ddbb6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f33d809d6f0 0x7f33d809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:50.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.604+0000 7f33ddbb6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f33d809d6f0 0x7f33d809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41836/0 (socket says 172.21.15.26:41836) 2023-10-01T07:54:50.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.604+0000 7f33de3b7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33d809e410 0x7f33d8130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46226/0 (socket says 172.21.15.26:46226) 2023-10-01T07:54:50.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.604+0000 7f33ddbb6700 1 -- 172.21.15.26:0/232388809 learned_addr learned my addr 172.21.15.26:0/232388809 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:50.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.604+0000 7f33dd3b5700 1 --2- 172.21.15.26:0/232388809 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33d809e000 0x7f33d8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:50.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.604+0000 7f33ddbb6700 1 -- 172.21.15.26:0/232388809 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33d809e000 msgr2=0x7f33d8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:50.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.604+0000 7f33ddbb6700 1 --2- 172.21.15.26:0/232388809 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33d809e000 0x7f33d8130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.604+0000 7f33ddbb6700 1 -- 172.21.15.26:0/232388809 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33d809e410 msgr2=0x7f33d8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:50.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.604+0000 7f33ddbb6700 1 --2- 172.21.15.26:0/232388809 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33d809e410 0x7f33d8130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.604+0000 7f33ddbb6700 1 -- 172.21.15.26:0/232388809 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d809b2d0 con 0x7f33d809d6f0 2023-10-01T07:54:50.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.604+0000 7f33ddbb6700 1 --2- 172.21.15.26:0/232388809 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33d809d6f0 0x7f33d809dac0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f33d400b970 tx=0x7f33d400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d5b9ef55ed6006b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:50.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.605+0000 7f33dcbb4700 1 -- 172.21.15.26:0/232388809 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d400aa00 con 0x7f33d809d6f0 2023-10-01T07:54:50.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.605+0000 7f33dcbb4700 1 -- 172.21.15.26:0/232388809 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d400ab60 con 0x7f33d809d6f0 2023-10-01T07:54:50.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.605+0000 7f33dcbb4700 1 -- 172.21.15.26:0/232388809 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d400aed0 con 0x7f33d809d6f0 2023-10-01T07:54:50.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.606+0000 7f33dfe1a700 1 -- 172.21.15.26:0/232388809 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33d809d6f0 msgr2=0x7f33d809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:50.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.606+0000 7f33dfe1a700 1 --2- 172.21.15.26:0/232388809 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33d809d6f0 0x7f33d809dac0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f33d400b970 tx=0x7f33d400bc80 comp rx=0 tx=0).stop 2023-10-01T07:54:50.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.606+0000 7f33dfe1a700 1 -- 172.21.15.26:0/232388809 shutdown_connections 2023-10-01T07:54:50.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.606+0000 7f33dfe1a700 1 --2- 172.21.15.26:0/232388809 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33d809e410 0x7f33d8130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.606+0000 7f33dfe1a700 1 --2- 172.21.15.26:0/232388809 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33d809d6f0 0x7f33d809dac0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.606+0000 7f33dfe1a700 1 --2- 172.21.15.26:0/232388809 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33d809e000 0x7f33d8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.606+0000 7f33dfe1a700 1 -- 172.21.15.26:0/232388809 >> 172.21.15.26:0/232388809 conn(0x7f33d8066f50 msgr2=0x7f33d809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:50.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.606+0000 7f33dfe1a700 1 -- 172.21.15.26:0/232388809 shutdown_connections 2023-10-01T07:54:50.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.606+0000 7f33dfe1a700 1 -- 172.21.15.26:0/232388809 wait complete. 2023-10-01T07:54:50.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.607+0000 7f33dfe1a700 1 Processor -- start 2023-10-01T07:54:50.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.608+0000 7f33dfe1a700 1 -- start start 2023-10-01T07:54:50.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.608+0000 7f33dfe1a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33d809d6f0 0x7f33d811e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:50.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.608+0000 7f33dfe1a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33d809e000 0x7f33d811e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:50.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.608+0000 7f33dfe1a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33d809e410 0x7f33d811eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:50.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.608+0000 7f33dfe1a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d809c770 con 0x7f33d809e000 2023-10-01T07:54:50.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.608+0000 7f33dfe1a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d80a1a50 con 0x7f33d809e410 2023-10-01T07:54:50.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.608+0000 7f33dfe1a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33d81201f0 con 0x7f33d809d6f0 2023-10-01T07:54:50.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.608+0000 7f33ddbb6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33d809d6f0 0x7f33d811e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:50.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.608+0000 7f33ddbb6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33d809d6f0 0x7f33d811e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41642/0 (socket says 172.21.15.26:41642) 2023-10-01T07:54:50.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.608+0000 7f33ddbb6700 1 -- 172.21.15.26:0/2455346294 learned_addr learned my addr 172.21.15.26:0/2455346294 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:50.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.609+0000 7f33dd3b5700 1 --2- 172.21.15.26:0/2455346294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33d809e000 0x7f33d811e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:50.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.609+0000 7f33de3b7700 1 --2- 172.21.15.26:0/2455346294 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33d809e410 0x7f33d811eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:50.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.609+0000 7f33ddbb6700 1 -- 172.21.15.26:0/2455346294 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33d809e410 msgr2=0x7f33d811eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:50.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.609+0000 7f33ddbb6700 1 --2- 172.21.15.26:0/2455346294 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33d809e410 0x7f33d811eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.609+0000 7f33ddbb6700 1 -- 172.21.15.26:0/2455346294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33d809e000 msgr2=0x7f33d811e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:50.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.609+0000 7f33ddbb6700 1 --2- 172.21.15.26:0/2455346294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33d809e000 0x7f33d811e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.609+0000 7f33ddbb6700 1 -- 172.21.15.26:0/2455346294 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d400b5a0 con 0x7f33d809d6f0 2023-10-01T07:54:50.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.609+0000 7f33de3b7700 1 --2- 172.21.15.26:0/2455346294 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33d809e410 0x7f33d811eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:54:50.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.609+0000 7f33ddbb6700 1 --2- 172.21.15.26:0/2455346294 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33d809d6f0 0x7f33d811e030 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f33d400d010 tx=0x7f33d4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:50.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.609+0000 7f33ce7fc700 1 -- 172.21.15.26:0/2455346294 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d40036a0 con 0x7f33d809d6f0 2023-10-01T07:54:50.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.609+0000 7f33ce7fc700 1 -- 172.21.15.26:0/2455346294 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d4003820 con 0x7f33d809d6f0 2023-10-01T07:54:50.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.609+0000 7f33dfe1a700 1 -- 172.21.15.26:0/2455346294 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33d8120460 con 0x7f33d809d6f0 2023-10-01T07:54:50.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.609+0000 7f33ce7fc700 1 -- 172.21.15.26:0/2455346294 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d4003bd0 con 0x7f33d809d6f0 2023-10-01T07:54:50.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.610+0000 7f33dfe1a700 1 -- 172.21.15.26:0/2455346294 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d81212e0 con 0x7f33d809d6f0 2023-10-01T07:54:50.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.611+0000 7f33ce7fc700 1 -- 172.21.15.26:0/2455346294 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f33d4003d30 con 0x7f33d809d6f0 2023-10-01T07:54:50.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.611+0000 7f33ce7fc700 1 -- 172.21.15.26:0/2455346294 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f33d4041040 con 0x7f33d809d6f0 2023-10-01T07:54:50.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.611+0000 7f33dd3b5700 1 -- 172.21.15.26:0/2455346294 >> v1:172.21.15.26:6816/126763 conn(0x7f33bc02f510 legacy=0x7f33bc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:50.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.611+0000 7f33dfe1a700 1 -- 172.21.15.26:0/2455346294 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33d8074ea0 con 0x7f33d809d6f0 2023-10-01T07:54:50.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.617+0000 7f33ce7fc700 1 -- 172.21.15.26:0/2455346294 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f33d401d7c0 con 0x7f33d809d6f0 2023-10-01T07:54:50.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.643+0000 7f78868c0700 1 Processor -- start 2023-10-01T07:54:50.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.643+0000 7f78868c0700 1 -- start start 2023-10-01T07:54:50.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.643+0000 7f78868c0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f78800a0a30 0x7f78800a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:50.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.643+0000 7f78868c0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f788009d630 0x7f78800a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:50.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.643+0000 7f78868c0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78800a2a70 con 0x7f7880133930 2023-10-01T07:54:50.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.643+0000 7f78868c0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78800a01d0 con 0x7f788009d630 2023-10-01T07:54:50.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.643+0000 7f78868c0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f788009e2b0 con 0x7f78800a0a30 2023-10-01T07:54:50.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.644+0000 7f7884e5d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7880133930 0x7f7880133db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60088/0 (socket says 172.21.15.26:60088) 2023-10-01T07:54:50.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.644+0000 7f7884e5d700 1 -- 172.21.15.26:0/4073571124 learned_addr learned my addr 172.21.15.26:0/4073571124 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:50.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.644+0000 7f787ffff700 1 --2- 172.21.15.26:0/4073571124 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f78800a0a30 0x7f78800a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:50.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.644+0000 7f787f7fe700 1 --2- 172.21.15.26:0/4073571124 >> v2:172.21.15.26:3300/0 conn(0x7f788009d630 0x7f78800a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:50.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.644+0000 7f787ffff700 1 -- 172.21.15.26:0/4073571124 >> v2:172.21.15.26:3300/0 conn(0x7f788009d630 msgr2=0x7f78800a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:50.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.644+0000 7f787ffff700 1 --2- 172.21.15.26:0/4073571124 >> v2:172.21.15.26:3300/0 conn(0x7f788009d630 0x7f78800a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.644+0000 7f787ffff700 1 -- 172.21.15.26:0/4073571124 >> v1:172.21.15.26:6789/0 conn(0x7f7880133930 legacy=0x7f7880133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:50.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.644+0000 7f787ffff700 1 -- 172.21.15.26:0/4073571124 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788009dc50 con 0x7f78800a0a30 2023-10-01T07:54:50.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.644+0000 7f787effd700 1 -- 172.21.15.26:0/4073571124 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2361850250 0 0) 0x7f78800a2a70 con 0x7f7880133930 2023-10-01T07:54:50.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.644+0000 7f787ffff700 1 --2- 172.21.15.26:0/4073571124 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f78800a0a30 0x7f78800a0e00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7870009840 tx=0x7f7870009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb0aaf6f88df91c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:50.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.644+0000 7f787effd700 1 -- 172.21.15.26:0/4073571124 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7870011830 con 0x7f78800a0a30 2023-10-01T07:54:50.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.645+0000 7f787effd700 1 -- 172.21.15.26:0/4073571124 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7870011990 con 0x7f78800a0a30 2023-10-01T07:54:50.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.645+0000 7f787effd700 1 -- 172.21.15.26:0/4073571124 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7870011d20 con 0x7f78800a0a30 2023-10-01T07:54:50.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.645+0000 7f78868c0700 1 -- 172.21.15.26:0/4073571124 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f78800a0a30 msgr2=0x7f78800a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:50.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.645+0000 7f78868c0700 1 --2- 172.21.15.26:0/4073571124 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f78800a0a30 0x7f78800a0e00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7870009840 tx=0x7f7870009b50 comp rx=0 tx=0).stop 2023-10-01T07:54:50.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.645+0000 7f78868c0700 1 -- 172.21.15.26:0/4073571124 shutdown_connections 2023-10-01T07:54:50.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.645+0000 7f78868c0700 1 --2- 172.21.15.26:0/4073571124 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f78800a0a30 0x7f78800a0e00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.645+0000 7f78868c0700 1 --2- 172.21.15.26:0/4073571124 >> v2:172.21.15.26:3300/0 conn(0x7f788009d630 0x7f78800a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.645+0000 7f78868c0700 1 -- 172.21.15.26:0/4073571124 >> 172.21.15.26:0/4073571124 conn(0x7f78800a3050 msgr2=0x7f78800a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:50.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.645+0000 7f78868c0700 1 -- 172.21.15.26:0/4073571124 shutdown_connections 2023-10-01T07:54:50.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.645+0000 7f78868c0700 1 -- 172.21.15.26:0/4073571124 wait complete. 2023-10-01T07:54:50.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.646+0000 7f78868c0700 1 Processor -- start 2023-10-01T07:54:50.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.647+0000 7f78868c0700 1 -- start start 2023-10-01T07:54:50.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.647+0000 7f78868c0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f788009d630 0x7f78801c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:50.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.647+0000 7f78868c0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f78800a0a30 0x7f78801c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:50.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.647+0000 7f78868c0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7880133930 0x7f78801c8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:50.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.647+0000 7f78868c0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78801206e0 con 0x7f7880133930 2023-10-01T07:54:50.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.647+0000 7f78868c0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78800a52d0 con 0x7f78800a0a30 2023-10-01T07:54:50.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.647+0000 7f78868c0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78800a0410 con 0x7f788009d630 2023-10-01T07:54:50.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.647+0000 7f7884e5d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7880133930 0x7f78801c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:50.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.647+0000 7f787ffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f788009d630 0x7f78801c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:50.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.647+0000 7f787ffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f788009d630 0x7f78801c7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41662/0 (socket says 172.21.15.26:41662) 2023-10-01T07:54:50.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.647+0000 7f7884e5d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7880133930 0x7f78801c8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41872/0 (socket says 172.21.15.26:41872) 2023-10-01T07:54:50.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.647+0000 7f787ffff700 1 -- 172.21.15.26:0/3301033081 learned_addr learned my addr 172.21.15.26:0/3301033081 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:50.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.647+0000 7f787f7fe700 1 --2- 172.21.15.26:0/3301033081 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f78800a0a30 0x7f78801c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:50.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.648+0000 7f7884e5d700 1 -- 172.21.15.26:0/3301033081 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f788009d630 msgr2=0x7f78801c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:50.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.648+0000 7f7884e5d700 1 --2- 172.21.15.26:0/3301033081 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f788009d630 0x7f78801c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.648+0000 7f7884e5d700 1 -- 172.21.15.26:0/3301033081 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f78800a0a30 msgr2=0x7f78801c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:50.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.648+0000 7f7884e5d700 1 --2- 172.21.15.26:0/3301033081 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f78800a0a30 0x7f78801c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.648+0000 7f7884e5d700 1 -- 172.21.15.26:0/3301033081 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78700094a0 con 0x7f7880133930 2023-10-01T07:54:50.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.648+0000 7f787ffff700 1 --2- 172.21.15.26:0/3301033081 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f788009d630 0x7f78801c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:50.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.648+0000 7f787f7fe700 1 --2- 172.21.15.26:0/3301033081 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f78800a0a30 0x7f78801c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:50.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.648+0000 7f7884e5d700 1 --2- 172.21.15.26:0/3301033081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7880133930 0x7f78801c8990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f787800cbe0 tx=0x7f787800cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:50.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.648+0000 7f787cff9700 1 -- 172.21.15.26:0/3301033081 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787800aa40 con 0x7f7880133930 2023-10-01T07:54:50.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.648+0000 7f787cff9700 1 -- 172.21.15.26:0/3301033081 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787800abc0 con 0x7f7880133930 2023-10-01T07:54:50.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.648+0000 7f78868c0700 1 -- 172.21.15.26:0/3301033081 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7880133470 con 0x7f7880133930 2023-10-01T07:54:50.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.648+0000 7f787cff9700 1 -- 172.21.15.26:0/3301033081 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78780070d0 con 0x7f7880133930 2023-10-01T07:54:50.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.649+0000 7f78868c0700 1 -- 172.21.15.26:0/3301033081 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7880122c00 con 0x7f7880133930 2023-10-01T07:54:50.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.649+0000 7f787cff9700 1 -- 172.21.15.26:0/3301033081 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7878007230 con 0x7f7880133930 2023-10-01T07:54:50.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.649+0000 7f787ffff700 1 -- 172.21.15.26:0/3301033081 >> v1:172.21.15.26:6816/126763 conn(0x7f786c02f510 legacy=0x7f786c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:50.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.649+0000 7f787cff9700 1 -- 172.21.15.26:0/3301033081 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f78780419c0 con 0x7f7880133930 2023-10-01T07:54:50.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.650+0000 7f78868c0700 1 -- 172.21.15.26:0/3301033081 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78801220b0 con 0x7f7880133930 2023-10-01T07:54:50.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.655+0000 7f787cff9700 1 -- 172.21.15.26:0/3301033081 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7878018070 con 0x7f7880133930 2023-10-01T07:54:50.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.711+0000 7f0020c52700 1 -- 172.21.15.26:0/3240705621 >> v1:172.21.15.26:6816/126763 conn(0x7f000002f510 legacy=0x7f00000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:50.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.738+0000 7f0022eb6700 1 -- 172.21.15.26:0/3240705621 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f001c074ea0 con 0x7f001c09e410 2023-10-01T07:54:50.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.739+0000 7f00197fa700 1 -- 172.21.15.26:0/3240705621 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0014017070 con 0x7f001c09e410 2023-10-01T07:54:50.739 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:54:50.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.742+0000 7f0022eb6700 1 -- 172.21.15.26:0/3240705621 >> v1:172.21.15.26:6816/126763 conn(0x7f000002f510 legacy=0x7f00000319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:50.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.742+0000 7f0022eb6700 1 -- 172.21.15.26:0/3240705621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f001c09e410 msgr2=0x7f001c1a6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:50.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.742+0000 7f0022eb6700 1 --2- 172.21.15.26:0/3240705621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f001c09e410 0x7f001c1a6950 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f001400cbc0 tx=0x7f001400ced0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.742+0000 7f0022eb6700 1 -- 172.21.15.26:0/3240705621 shutdown_connections 2023-10-01T07:54:50.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.742+0000 7f0022eb6700 1 --2- 172.21.15.26:0/3240705621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f001c09e410 0x7f001c1a6950 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.742+0000 7f0022eb6700 1 --2- 172.21.15.26:0/3240705621 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f001c09d6f0 0x7f001c1a5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.742+0000 7f0022eb6700 1 --2- 172.21.15.26:0/3240705621 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f001c09e000 0x7f001c1a6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.742+0000 7f0022eb6700 1 -- 172.21.15.26:0/3240705621 >> 172.21.15.26:0/3240705621 conn(0x7f001c066f50 msgr2=0x7f001c1baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:50.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.742+0000 7f0022eb6700 1 -- 172.21.15.26:0/3240705621 shutdown_connections 2023-10-01T07:54:50.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.742+0000 7f0022eb6700 1 -- 172.21.15.26:0/3240705621 wait complete. 2023-10-01T07:54:50.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.760+0000 7f8226ffd700 1 -- 172.21.15.26:0/631808399 >> v1:172.21.15.26:6816/126763 conn(0x7f821402f510 legacy=0x7f82140319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:50.761 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:54:50.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.812+0000 7f33dd3b5700 1 -- 172.21.15.26:0/2455346294 >> v1:172.21.15.26:6816/126763 conn(0x7f33bc02f510 legacy=0x7f33bc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:50.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.826+0000 7f822dbf2700 1 -- 172.21.15.26:0/631808399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f822806b9a0 con 0x7f82280700e0 2023-10-01T07:54:50.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.827+0000 7f820ffff700 1 -- 172.21.15.26:0/631808399 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8218045060 con 0x7f82280700e0 2023-10-01T07:54:50.827 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:54:50.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.830+0000 7f822dbf2700 1 -- 172.21.15.26:0/631808399 >> v1:172.21.15.26:6816/126763 conn(0x7f821402f510 legacy=0x7f82140319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:50.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.830+0000 7f822dbf2700 1 -- 172.21.15.26:0/631808399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82280700e0 msgr2=0x7f822811b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:50.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.830+0000 7f822dbf2700 1 --2- 172.21.15.26:0/631808399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82280700e0 0x7f822811b8b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f821800ebe0 tx=0x7f8218009ec0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.830+0000 7f822dbf2700 1 -- 172.21.15.26:0/631808399 shutdown_connections 2023-10-01T07:54:50.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.830+0000 7f822dbf2700 1 --2- 172.21.15.26:0/631808399 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f822812d2e0 0x7f822811c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.830+0000 7f822dbf2700 1 --2- 172.21.15.26:0/631808399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82280700e0 0x7f822811b8b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.830+0000 7f822dbf2700 1 --2- 172.21.15.26:0/631808399 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82280709f0 0x7f822811bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.830+0000 7f822dbf2700 1 -- 172.21.15.26:0/631808399 >> 172.21.15.26:0/631808399 conn(0x7f82280a27f0 msgr2=0x7f8228130cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:50.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.830+0000 7f822dbf2700 1 -- 172.21.15.26:0/631808399 shutdown_connections 2023-10-01T07:54:50.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.830+0000 7f822dbf2700 1 -- 172.21.15.26:0/631808399 wait complete. 2023-10-01T07:54:50.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:54:50.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.850+0000 7f787ffff700 1 -- 172.21.15.26:0/3301033081 >> v1:172.21.15.26:6816/126763 conn(0x7f786c02f510 legacy=0x7f786c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:50.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.861+0000 7f78868c0700 1 -- 172.21.15.26:0/3301033081 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f78800747f0 con 0x7f7880133930 2023-10-01T07:54:50.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.862+0000 7f787cff9700 1 -- 172.21.15.26:0/3301033081 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7878018030 con 0x7f7880133930 2023-10-01T07:54:50.862 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:54:50.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.864+0000 7f78868c0700 1 -- 172.21.15.26:0/3301033081 >> v1:172.21.15.26:6816/126763 conn(0x7f786c02f510 legacy=0x7f786c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:50.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.864+0000 7f78868c0700 1 -- 172.21.15.26:0/3301033081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7880133930 msgr2=0x7f78801c8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:50.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.864+0000 7f78868c0700 1 --2- 172.21.15.26:0/3301033081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7880133930 0x7f78801c8990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f787800cbe0 tx=0x7f787800cef0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.864+0000 7f78868c0700 1 -- 172.21.15.26:0/3301033081 shutdown_connections 2023-10-01T07:54:50.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.864+0000 7f78868c0700 1 --2- 172.21.15.26:0/3301033081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7880133930 0x7f78801c8990 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.864+0000 7f78868c0700 1 --2- 172.21.15.26:0/3301033081 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f788009d630 0x7f78801c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.864+0000 7f78868c0700 1 --2- 172.21.15.26:0/3301033081 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f78800a0a30 0x7f78801c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.864+0000 7f78868c0700 1 -- 172.21.15.26:0/3301033081 >> 172.21.15.26:0/3301033081 conn(0x7f78800a3050 msgr2=0x7f78801bb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:50.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.864+0000 7f78868c0700 1 -- 172.21.15.26:0/3301033081 shutdown_connections 2023-10-01T07:54:50.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.864+0000 7f78868c0700 1 -- 172.21.15.26:0/3301033081 wait complete. 2023-10-01T07:54:50.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.872+0000 7f33dfe1a700 1 -- 172.21.15.26:0/2455346294 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f33d806c360 con 0x7f33d809d6f0 2023-10-01T07:54:50.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.872+0000 7f33ce7fc700 1 -- 172.21.15.26:0/2455346294 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f33d401a030 con 0x7f33d809d6f0 2023-10-01T07:54:50.873 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:54:50.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.875+0000 7f33dfe1a700 1 -- 172.21.15.26:0/2455346294 >> v1:172.21.15.26:6816/126763 conn(0x7f33bc02f510 legacy=0x7f33bc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:50.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.875+0000 7f33dfe1a700 1 -- 172.21.15.26:0/2455346294 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33d809d6f0 msgr2=0x7f33d811e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:50.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.875+0000 7f33dfe1a700 1 --2- 172.21.15.26:0/2455346294 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33d809d6f0 0x7f33d811e030 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f33d400d010 tx=0x7f33d4004750 comp rx=0 tx=0).stop 2023-10-01T07:54:50.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.875+0000 7f33dfe1a700 1 -- 172.21.15.26:0/2455346294 shutdown_connections 2023-10-01T07:54:50.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.875+0000 7f33dfe1a700 1 --2- 172.21.15.26:0/2455346294 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33d809e410 0x7f33d811eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.875+0000 7f33dfe1a700 1 --2- 172.21.15.26:0/2455346294 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33d809d6f0 0x7f33d811e030 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.875+0000 7f33dfe1a700 1 --2- 172.21.15.26:0/2455346294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33d809e000 0x7f33d811e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:50.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.875+0000 7f33dfe1a700 1 -- 172.21.15.26:0/2455346294 >> 172.21.15.26:0/2455346294 conn(0x7f33d8066f50 msgr2=0x7f33d806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:50.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.875+0000 7f33dfe1a700 1 -- 172.21.15.26:0/2455346294 shutdown_connections 2023-10-01T07:54:50.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:50.875+0000 7f33dfe1a700 1 -- 172.21.15.26:0/2455346294 wait complete. 2023-10-01T07:54:50.879 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:54:50.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:54:51.762 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:54:51.846 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:54:51.880 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:54:51.890 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:54:51.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.915+0000 7f7e27293700 1 Processor -- start 2023-10-01T07:54:51.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.916+0000 7f7e27293700 1 -- start start 2023-10-01T07:54:51.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.916+0000 7f7e27293700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7e2012cf60 0x7f7e2006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:51.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.916+0000 7f7e27293700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7e2012f8b0 0x7f7e2012fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:51.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.916+0000 7f7e27293700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7e20130260 0x7f7e20136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:51.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.916+0000 7f7e27293700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e2012d330 con 0x7f7e20130260 2023-10-01T07:54:51.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.916+0000 7f7e27293700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2012cd90 con 0x7f7e2012f8b0 2023-10-01T07:54:51.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.916+0000 7f7e27293700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e201306d0 con 0x7f7e2012cf60 2023-10-01T07:54:51.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.916+0000 7f7e25830700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7e20130260 0x7f7e20136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:51.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.916+0000 7f7e25830700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7e20130260 0x7f7e20136c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41882/0 (socket says 172.21.15.26:41882) 2023-10-01T07:54:51.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.916+0000 7f7e25830700 1 -- 172.21.15.26:0/4024689824 learned_addr learned my addr 172.21.15.26:0/4024689824 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:51.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.916+0000 7f7e2482e700 1 --2- 172.21.15.26:0/4024689824 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7e2012f8b0 0x7f7e2012fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:51.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.917+0000 7f7e25830700 1 -- 172.21.15.26:0/4024689824 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7e2012cf60 msgr2=0x7f7e2006f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:51.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.917+0000 7f7e25830700 1 --2- 172.21.15.26:0/4024689824 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7e2012cf60 0x7f7e2006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:51.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.917+0000 7f7e25830700 1 -- 172.21.15.26:0/4024689824 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7e2012f8b0 msgr2=0x7f7e2012fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:51.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.917+0000 7f7e25830700 1 --2- 172.21.15.26:0/4024689824 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7e2012f8b0 0x7f7e2012fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:51.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.917+0000 7f7e25830700 1 -- 172.21.15.26:0/4024689824 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e20071780 con 0x7f7e20130260 2023-10-01T07:54:51.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.917+0000 7f7e2482e700 1 --2- 172.21.15.26:0/4024689824 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7e2012f8b0 0x7f7e2012fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:51.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.917+0000 7f7e25830700 1 --2- 172.21.15.26:0/4024689824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e20130260 0x7f7e20136c20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7e18009e50 tx=0x7f7e1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3af1374bf9069fba server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:51.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.917+0000 7f7e17fff700 1 -- 172.21.15.26:0/4024689824 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1800bb10 con 0x7f7e20130260 2023-10-01T07:54:51.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.917+0000 7f7e17fff700 1 -- 172.21.15.26:0/4024689824 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1800e070 con 0x7f7e20130260 2023-10-01T07:54:51.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.917+0000 7f7e17fff700 1 -- 172.21.15.26:0/4024689824 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e18011480 con 0x7f7e20130260 2023-10-01T07:54:51.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.918+0000 7f7e27293700 1 -- 172.21.15.26:0/4024689824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e20130260 msgr2=0x7f7e20136c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:51.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.918+0000 7f7e27293700 1 --2- 172.21.15.26:0/4024689824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e20130260 0x7f7e20136c20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7e18009e50 tx=0x7f7e1800b330 comp rx=0 tx=0).stop 2023-10-01T07:54:51.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.919+0000 7f7e27293700 1 -- 172.21.15.26:0/4024689824 shutdown_connections 2023-10-01T07:54:51.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.919+0000 7f7e27293700 1 --2- 172.21.15.26:0/4024689824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e20130260 0x7f7e20136c20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:51.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.919+0000 7f7e27293700 1 --2- 172.21.15.26:0/4024689824 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7e2012cf60 0x7f7e2006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:51.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.919+0000 7f7e27293700 1 --2- 172.21.15.26:0/4024689824 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7e2012f8b0 0x7f7e2012fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:51.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.919+0000 7f7e27293700 1 -- 172.21.15.26:0/4024689824 >> 172.21.15.26:0/4024689824 conn(0x7f7e200a2aa0 msgr2=0x7f7e200a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:51.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.919+0000 7f7e27293700 1 -- 172.21.15.26:0/4024689824 shutdown_connections 2023-10-01T07:54:51.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.919+0000 7f7e27293700 1 -- 172.21.15.26:0/4024689824 wait complete. 2023-10-01T07:54:51.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.921+0000 7f7e27293700 1 Processor -- start 2023-10-01T07:54:51.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.921+0000 7f7e27293700 1 -- start start 2023-10-01T07:54:51.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.921+0000 7f7e27293700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7e2012cf60 0x7f7e201309e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:51.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.921+0000 7f7e27293700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7e2012f8b0 0x7f7e20130f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:51.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.921+0000 7f7e27293700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e20130260 0x7f7e20131460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:51.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.921+0000 7f7e27293700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e20133130 con 0x7f7e20130260 2023-10-01T07:54:51.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.921+0000 7f7e27293700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e201341d0 con 0x7f7e2012cf60 2023-10-01T07:54:51.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.921+0000 7f7e27293700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e20136e00 con 0x7f7e2012f8b0 2023-10-01T07:54:51.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.922+0000 7f7e2502f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7e2012cf60 0x7f7e201309e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:51.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.922+0000 7f7e2502f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7e2012cf60 0x7f7e201309e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46256/0 (socket says 172.21.15.26:46256) 2023-10-01T07:54:51.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.922+0000 7f7e2502f700 1 -- 172.21.15.26:0/4004008478 learned_addr learned my addr 172.21.15.26:0/4004008478 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:51.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.922+0000 7f7e25830700 1 --2- 172.21.15.26:0/4004008478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e20130260 0x7f7e20131460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:51.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.922+0000 7f7e2482e700 1 --2- 172.21.15.26:0/4004008478 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7e2012f8b0 0x7f7e20130f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:51.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.922+0000 7f7e25830700 1 -- 172.21.15.26:0/4004008478 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7e2012f8b0 msgr2=0x7f7e20130f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:51.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.922+0000 7f7e25830700 1 --2- 172.21.15.26:0/4004008478 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7e2012f8b0 0x7f7e20130f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:51.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.922+0000 7f7e25830700 1 -- 172.21.15.26:0/4004008478 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7e2012cf60 msgr2=0x7f7e201309e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:51.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.922+0000 7f7e25830700 1 --2- 172.21.15.26:0/4004008478 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7e2012cf60 0x7f7e201309e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:51.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.922+0000 7f7e25830700 1 -- 172.21.15.26:0/4004008478 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e100094a0 con 0x7f7e20130260 2023-10-01T07:54:51.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.922+0000 7f7e25830700 1 --2- 172.21.15.26:0/4004008478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e20130260 0x7f7e20131460 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7e18015000 tx=0x7f7e18004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:51.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.923+0000 7f7e15ffb700 1 -- 172.21.15.26:0/4004008478 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e18011480 con 0x7f7e20130260 2023-10-01T07:54:51.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.923+0000 7f7e15ffb700 1 -- 172.21.15.26:0/4004008478 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1801f070 con 0x7f7e20130260 2023-10-01T07:54:51.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.923+0000 7f7e15ffb700 1 -- 172.21.15.26:0/4004008478 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e18007000 con 0x7f7e20130260 2023-10-01T07:54:51.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.923+0000 7f7e27293700 1 -- 172.21.15.26:0/4004008478 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e18009b30 con 0x7f7e20130260 2023-10-01T07:54:51.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.923+0000 7f7e27293700 1 -- 172.21.15.26:0/4004008478 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e20131ed0 con 0x7f7e20130260 2023-10-01T07:54:51.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.925+0000 7f7e15ffb700 1 -- 172.21.15.26:0/4004008478 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7e18011cd0 con 0x7f7e20130260 2023-10-01T07:54:51.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.925+0000 7f7e27293700 1 -- 172.21.15.26:0/4004008478 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e20074ea0 con 0x7f7e20130260 2023-10-01T07:54:51.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.925+0000 7f7e15ffb700 1 -- 172.21.15.26:0/4004008478 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f7e18021070 con 0x7f7e20130260 2023-10-01T07:54:51.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.925+0000 7f7e2502f700 1 -- 172.21.15.26:0/4004008478 >> v1:172.21.15.26:6816/126763 conn(0x7f7e0402f510 legacy=0x7f7e040319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:51.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:51.930+0000 7f7e15ffb700 1 -- 172.21.15.26:0/4004008478 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e18004040 con 0x7f7e20130260 2023-10-01T07:54:52.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.007+0000 7f0f3936a700 1 Processor -- start 2023-10-01T07:54:52.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.008+0000 7f0f3936a700 1 -- start start 2023-10-01T07:54:52.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.008+0000 7f0f3936a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0f3409d6f0 0x7f0f3409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:52.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.008+0000 7f0f3936a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f3409e000 0x7f0f341339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:52.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.008+0000 7f0f3936a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f3409b120 con 0x7f0f3409e410 2023-10-01T07:54:52.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.008+0000 7f0f3936a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f3406b460 con 0x7f0f3409d6f0 2023-10-01T07:54:52.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.008+0000 7f0f3936a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3409a7e0 con 0x7f0f3409e000 2023-10-01T07:54:52.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.008+0000 7f0f327fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f3409e000 0x7f0f341339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:52.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.008+0000 7f0f337fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0f3409e410 0x7f0f34133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60090/0 (socket says 172.21.15.26:60090) 2023-10-01T07:54:52.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.008+0000 7f0f337fe700 1 -- 172.21.15.26:0/2021863229 learned_addr learned my addr 172.21.15.26:0/2021863229 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:52.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.008+0000 7f0f32ffd700 1 --2- 172.21.15.26:0/2021863229 >> v2:172.21.15.26:3300/0 conn(0x7f0f3409d6f0 0x7f0f3409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:52.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.009+0000 7f0f32ffd700 1 -- 172.21.15.26:0/2021863229 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f3409e000 msgr2=0x7f0f341339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:52.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.009+0000 7f0f32ffd700 1 --2- 172.21.15.26:0/2021863229 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f3409e000 0x7f0f341339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:52.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.009+0000 7f0f32ffd700 1 -- 172.21.15.26:0/2021863229 >> v1:172.21.15.26:6789/0 conn(0x7f0f3409e410 legacy=0x7f0f34133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:52.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.009+0000 7f0f32ffd700 1 -- 172.21.15.26:0/2021863229 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3409a500 con 0x7f0f3409d6f0 2023-10-01T07:54:52.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.009+0000 7f0f32ffd700 1 --2- 172.21.15.26:0/2021863229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f3409d6f0 0x7f0f3409dac0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0f24009840 tx=0x7f0f24009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f9e4c70e51c705 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:52.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.009+0000 7f0f31ffb700 1 -- 172.21.15.26:0/2021863229 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f24011830 con 0x7f0f3409d6f0 2023-10-01T07:54:52.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.009+0000 7f0f31ffb700 1 -- 172.21.15.26:0/2021863229 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f24011990 con 0x7f0f3409d6f0 2023-10-01T07:54:52.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.009+0000 7f0f31ffb700 1 -- 172.21.15.26:0/2021863229 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f24011d20 con 0x7f0f3409d6f0 2023-10-01T07:54:52.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.010+0000 7f0f3936a700 1 -- 172.21.15.26:0/2021863229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f3409d6f0 msgr2=0x7f0f3409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:52.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.010+0000 7f0f3936a700 1 --2- 172.21.15.26:0/2021863229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f3409d6f0 0x7f0f3409dac0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0f24009840 tx=0x7f0f24009b50 comp rx=0 tx=0).stop 2023-10-01T07:54:52.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.010+0000 7f0f3936a700 1 -- 172.21.15.26:0/2021863229 shutdown_connections 2023-10-01T07:54:52.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.010+0000 7f0f3936a700 1 --2- 172.21.15.26:0/2021863229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f3409d6f0 0x7f0f3409dac0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:52.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.010+0000 7f0f3936a700 1 --2- 172.21.15.26:0/2021863229 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f3409e000 0x7f0f341339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:52.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.010+0000 7f0f3936a700 1 -- 172.21.15.26:0/2021863229 >> 172.21.15.26:0/2021863229 conn(0x7f0f34066f50 msgr2=0x7f0f3409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:52.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.011+0000 7f0f3936a700 1 -- 172.21.15.26:0/2021863229 shutdown_connections 2023-10-01T07:54:52.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.011+0000 7f0f3936a700 1 -- 172.21.15.26:0/2021863229 wait complete. 2023-10-01T07:54:52.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.012+0000 7f0f3936a700 1 Processor -- start 2023-10-01T07:54:52.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.012+0000 7f0f3936a700 1 -- start start 2023-10-01T07:54:52.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.012+0000 7f0f3936a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f3409d6f0 0x7f0f341a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:52.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.013+0000 7f0f3936a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f3409e000 0x7f0f341a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:52.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.013+0000 7f0f3936a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f3409e410 0x7f0f341a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:52.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.013+0000 7f0f3936a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f340a2240 con 0x7f0f3409e000 2023-10-01T07:54:52.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.013+0000 7f0f3936a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f341a7c90 con 0x7f0f3409d6f0 2023-10-01T07:54:52.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.013+0000 7f0f3936a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3409c710 con 0x7f0f3409e410 2023-10-01T07:54:52.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.013+0000 7f0f32ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f3409d6f0 0x7f0f341a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:52.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.013+0000 7f0f32ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f3409d6f0 0x7f0f341a4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46272/0 (socket says 172.21.15.26:46272) 2023-10-01T07:54:52.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.013+0000 7f0f32ffd700 1 -- 172.21.15.26:0/169948543 learned_addr learned my addr 172.21.15.26:0/169948543 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:52.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.013+0000 7f0f32ffd700 1 -- 172.21.15.26:0/169948543 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f3409e410 msgr2=0x7f0f341a5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:52.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.013+0000 7f0f32ffd700 1 --2- 172.21.15.26:0/169948543 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f3409e410 0x7f0f341a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:52.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.013+0000 7f0f32ffd700 1 -- 172.21.15.26:0/169948543 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f3409e000 msgr2=0x7f0f341a5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:52.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.013+0000 7f0f32ffd700 1 --2- 172.21.15.26:0/169948543 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f3409e000 0x7f0f341a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:52.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.013+0000 7f0f32ffd700 1 -- 172.21.15.26:0/169948543 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f240094a0 con 0x7f0f3409d6f0 2023-10-01T07:54:52.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.013+0000 7f0f32ffd700 1 --2- 172.21.15.26:0/169948543 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f3409d6f0 0x7f0f341a4dc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0f24009b90 tx=0x7f0f24004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:52.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.014+0000 7f0f1b7fe700 1 -- 172.21.15.26:0/169948543 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f240038a0 con 0x7f0f3409d6f0 2023-10-01T07:54:52.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.014+0000 7f0f1b7fe700 1 -- 172.21.15.26:0/169948543 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2401e070 con 0x7f0f3409d6f0 2023-10-01T07:54:52.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.014+0000 7f0f1b7fe700 1 -- 172.21.15.26:0/169948543 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f24003c40 con 0x7f0f3409d6f0 2023-10-01T07:54:52.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.014+0000 7f0f3936a700 1 -- 172.21.15.26:0/169948543 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f341a6ae0 con 0x7f0f3409d6f0 2023-10-01T07:54:52.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.014+0000 7f0f3936a700 1 -- 172.21.15.26:0/169948543 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f341a88e0 con 0x7f0f3409d6f0 2023-10-01T07:54:52.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.015+0000 7f0f1b7fe700 1 -- 172.21.15.26:0/169948543 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0f2402d450 con 0x7f0f3409d6f0 2023-10-01T07:54:52.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.015+0000 7f0f3936a700 1 -- 172.21.15.26:0/169948543 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f341a8220 con 0x7f0f3409d6f0 2023-10-01T07:54:52.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.016+0000 7f0f327fc700 1 -- 172.21.15.26:0/169948543 >> v1:172.21.15.26:6816/126763 conn(0x7f0f2002f510 legacy=0x7f0f200319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:52.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.016+0000 7f0f1b7fe700 1 -- 172.21.15.26:0/169948543 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f0f24040b60 con 0x7f0f3409d6f0 2023-10-01T07:54:52.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.021+0000 7f0f1b7fe700 1 -- 172.21.15.26:0/169948543 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f2402d700 con 0x7f0f3409d6f0 2023-10-01T07:54:52.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.035+0000 7f1dbb52e700 1 Processor -- start 2023-10-01T07:54:52.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.035+0000 7f1dbb52e700 1 -- start start 2023-10-01T07:54:52.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.036+0000 7f1dbb52e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1db4130540 0x7f1db4130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:52.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.036+0000 7f1dbb52e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1db4130e50 0x7f1db406f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:52.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.036+0000 7f1dbb52e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1db406fb20 0x7f1db406ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:52.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.036+0000 7f1dbb52e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1db409a390 con 0x7f1db406fb20 2023-10-01T07:54:52.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.036+0000 7f1dbb52e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db40716a0 con 0x7f1db4130e50 2023-10-01T07:54:52.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.036+0000 7f1dbb52e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1db4071290 con 0x7f1db4130540 2023-10-01T07:54:52.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.036+0000 7f1db8ac9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1db4130e50 0x7f1db406f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:52.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.036+0000 7f1db9acb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1db406fb20 0x7f1db406ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:52.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.036+0000 7f1db9acb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1db406fb20 0x7f1db406ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41904/0 (socket says 172.21.15.26:41904) 2023-10-01T07:54:52.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.036+0000 7f1db8ac9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1db4130e50 0x7f1db406f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46284/0 (socket says 172.21.15.26:46284) 2023-10-01T07:54:52.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.036+0000 7f1db9acb700 1 -- 172.21.15.26:0/2530634674 learned_addr learned my addr 172.21.15.26:0/2530634674 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:52.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.036+0000 7f1db92ca700 1 --2- 172.21.15.26:0/2530634674 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1db4130540 0x7f1db4130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:52.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.036+0000 7f1db9acb700 1 -- 172.21.15.26:0/2530634674 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1db4130540 msgr2=0x7f1db4130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:52.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.037+0000 7f1db9acb700 1 --2- 172.21.15.26:0/2530634674 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1db4130540 0x7f1db4130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:52.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.037+0000 7f1db9acb700 1 -- 172.21.15.26:0/2530634674 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1db4130e50 msgr2=0x7f1db406f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:52.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.037+0000 7f1db9acb700 1 --2- 172.21.15.26:0/2530634674 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1db4130e50 0x7f1db406f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:52.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.037+0000 7f1db9acb700 1 -- 172.21.15.26:0/2530634674 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db4130340 con 0x7f1db406fb20 2023-10-01T07:54:52.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.037+0000 7f1db8ac9700 1 --2- 172.21.15.26:0/2530634674 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1db4130e50 0x7f1db406f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:52.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.037+0000 7f1db9acb700 1 --2- 172.21.15.26:0/2530634674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1db406fb20 0x7f1db406ffc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1dac009e80 tx=0x7f1dac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2fa64edbe096984 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:52.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.037+0000 7f1dabfff700 1 -- 172.21.15.26:0/2530634674 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac00e070 con 0x7f1db406fb20 2023-10-01T07:54:52.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.037+0000 7f1dabfff700 1 -- 172.21.15.26:0/2530634674 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dac00b8d0 con 0x7f1db406fb20 2023-10-01T07:54:52.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.037+0000 7f1dabfff700 1 -- 172.21.15.26:0/2530634674 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac00bc80 con 0x7f1db406fb20 2023-10-01T07:54:52.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.038+0000 7f1dbb52e700 1 -- 172.21.15.26:0/2530634674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1db406fb20 msgr2=0x7f1db406ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:52.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.038+0000 7f1dbb52e700 1 --2- 172.21.15.26:0/2530634674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1db406fb20 0x7f1db406ffc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1dac009e80 tx=0x7f1dac00b330 comp rx=0 tx=0).stop 2023-10-01T07:54:52.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.038+0000 7f1dbb52e700 1 -- 172.21.15.26:0/2530634674 shutdown_connections 2023-10-01T07:54:52.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.038+0000 7f1dbb52e700 1 --2- 172.21.15.26:0/2530634674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1db406fb20 0x7f1db406ffc0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:52.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.038+0000 7f1dbb52e700 1 --2- 172.21.15.26:0/2530634674 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1db4130540 0x7f1db4130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:52.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.038+0000 7f1dbb52e700 1 --2- 172.21.15.26:0/2530634674 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1db4130e50 0x7f1db406f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:52.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.038+0000 7f1dbb52e700 1 -- 172.21.15.26:0/2530634674 >> 172.21.15.26:0/2530634674 conn(0x7f1db40a2aa0 msgr2=0x7f1db40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:52.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.038+0000 7f1dbb52e700 1 -- 172.21.15.26:0/2530634674 shutdown_connections 2023-10-01T07:54:52.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.038+0000 7f1dbb52e700 1 -- 172.21.15.26:0/2530634674 wait complete. 2023-10-01T07:54:52.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.039+0000 7f1dbb52e700 1 Processor -- start 2023-10-01T07:54:52.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.039+0000 7f1dbb52e700 1 -- start start 2023-10-01T07:54:52.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.040+0000 7f1dbb52e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1db406fb20 0x7f1db411e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:52.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.040+0000 7f1dbb52e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1db4130540 0x7f1db411ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:52.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.040+0000 7f1dbb52e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1db4130e50 0x7f1db411f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:52.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.040+0000 7f1dbb52e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db41221a0 con 0x7f1db406fb20 2023-10-01T07:54:52.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.040+0000 7f1dbb52e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db4121480 con 0x7f1db4130e50 2023-10-01T07:54:52.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.040+0000 7f1dbb52e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1db40a0830 con 0x7f1db4130540 2023-10-01T07:54:52.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.040+0000 7f1db92ca700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1db406fb20 0x7f1db411e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:52.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.040+0000 7f1db92ca700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1db406fb20 0x7f1db411e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41920/0 (socket says 172.21.15.26:41920) 2023-10-01T07:54:52.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.040+0000 7f1db92ca700 1 -- 172.21.15.26:0/4019258409 learned_addr learned my addr 172.21.15.26:0/4019258409 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:52.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.040+0000 7f1db9acb700 1 --2- 172.21.15.26:0/4019258409 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1db4130e50 0x7f1db411f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:52.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.040+0000 7f1db8ac9700 1 --2- 172.21.15.26:0/4019258409 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1db4130540 0x7f1db411ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:52.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.041+0000 7f1db9acb700 1 -- 172.21.15.26:0/4019258409 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1db4130540 msgr2=0x7f1db411ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:52.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.041+0000 7f1db9acb700 1 --2- 172.21.15.26:0/4019258409 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1db4130540 0x7f1db411ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:52.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.041+0000 7f1db9acb700 1 -- 172.21.15.26:0/4019258409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1db406fb20 msgr2=0x7f1db411e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:52.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.041+0000 7f1db9acb700 1 --2- 172.21.15.26:0/4019258409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1db406fb20 0x7f1db411e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:52.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.041+0000 7f1db9acb700 1 -- 172.21.15.26:0/4019258409 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da40094a0 con 0x7f1db4130e50 2023-10-01T07:54:52.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.041+0000 7f1db9acb700 1 --2- 172.21.15.26:0/4019258409 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1db4130e50 0x7f1db411f470 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1dac015000 tx=0x7f1dac004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:52.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.041+0000 7f1da9ffb700 1 -- 172.21.15.26:0/4019258409 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac003e10 con 0x7f1db4130e50 2023-10-01T07:54:52.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.041+0000 7f1da9ffb700 1 -- 172.21.15.26:0/4019258409 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dac004250 con 0x7f1db4130e50 2023-10-01T07:54:52.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.041+0000 7f1dbb52e700 1 -- 172.21.15.26:0/4019258409 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dac009b30 con 0x7f1db4130e50 2023-10-01T07:54:52.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.041+0000 7f1da9ffb700 1 -- 172.21.15.26:0/4019258409 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac004600 con 0x7f1db4130e50 2023-10-01T07:54:52.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.041+0000 7f1dbb52e700 1 -- 172.21.15.26:0/4019258409 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db4122c10 con 0x7f1db4130e50 2023-10-01T07:54:52.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.042+0000 7f1da9ffb700 1 -- 172.21.15.26:0/4019258409 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1dac004760 con 0x7f1db4130e50 2023-10-01T07:54:52.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.043+0000 7f1da9ffb700 1 -- 172.21.15.26:0/4019258409 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f1dac040e70 con 0x7f1db4130e50 2023-10-01T07:54:52.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.043+0000 7f1db92ca700 1 -- 172.21.15.26:0/4019258409 >> v1:172.21.15.26:6816/126763 conn(0x7f1d9802f510 legacy=0x7f1d980319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:52.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.043+0000 7f1dbb52e700 1 -- 172.21.15.26:0/4019258409 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db4074ea0 con 0x7f1db4130e50 2023-10-01T07:54:52.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.047+0000 7fd359d2c700 1 Processor -- start 2023-10-01T07:54:52.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.047+0000 7fd359d2c700 1 -- start start 2023-10-01T07:54:52.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.048+0000 7fd359d2c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd35409d6f0 0x7fd35409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:52.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.048+0000 7fd359d2c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd35409e000 0x7fd354130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:52.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.048+0000 7fd359d2c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd35409e410 0x7fd354130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:52.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.048+0000 7fd359d2c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd35409f520 con 0x7fd35409e000 2023-10-01T07:54:52.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.048+0000 7fd359d2c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd35409f130 con 0x7fd35409d6f0 2023-10-01T07:54:52.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.048+0000 7fd359d2c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd35409e930 con 0x7fd35409e410 2023-10-01T07:54:52.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.048+0000 7fd352ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd35409e000 0x7fd354130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:52.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.048+0000 7fd353fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd35409e410 0x7fd354130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:52.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.048+0000 7fd353fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd35409e410 0x7fd354130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41740/0 (socket says 172.21.15.26:41740) 2023-10-01T07:54:52.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.048+0000 7fd352ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd35409e000 0x7fd354130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41928/0 (socket says 172.21.15.26:41928) 2023-10-01T07:54:52.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.048+0000 7fd353fff700 1 -- 172.21.15.26:0/1483747702 learned_addr learned my addr 172.21.15.26:0/1483747702 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:52.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.048+0000 7fd3537fe700 1 --2- 172.21.15.26:0/1483747702 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd35409d6f0 0x7fd35409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:52.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.049+0000 7fd352ffd700 1 -- 172.21.15.26:0/1483747702 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd35409e410 msgr2=0x7fd354130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:52.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.049+0000 7fd352ffd700 1 --2- 172.21.15.26:0/1483747702 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd35409e410 0x7fd354130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:52.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.049+0000 7fd352ffd700 1 -- 172.21.15.26:0/1483747702 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd35409d6f0 msgr2=0x7fd35409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:52.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.049+0000 7fd352ffd700 1 --2- 172.21.15.26:0/1483747702 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd35409d6f0 0x7fd35409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:52.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.049+0000 7fd352ffd700 1 -- 172.21.15.26:0/1483747702 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd35409b2d0 con 0x7fd35409e000 2023-10-01T07:54:52.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.049+0000 7fd353fff700 1 --2- 172.21.15.26:0/1483747702 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd35409e410 0x7fd354130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:52.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.049+0000 7fd352ffd700 1 --2- 172.21.15.26:0/1483747702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd35409e000 0x7fd354130660 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd348009870 tx=0x7fd348009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad3acca329d0636 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:52.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.049+0000 7fd3527fc700 1 -- 172.21.15.26:0/1483747702 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd348010a90 con 0x7fd35409e000 2023-10-01T07:54:52.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.049+0000 7fd3527fc700 1 -- 172.21.15.26:0/1483747702 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd348010bf0 con 0x7fd35409e000 2023-10-01T07:54:52.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.049+0000 7fd3527fc700 1 -- 172.21.15.26:0/1483747702 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd348018440 con 0x7fd35409e000 2023-10-01T07:54:52.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.050+0000 7fd359d2c700 1 -- 172.21.15.26:0/1483747702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd35409e000 msgr2=0x7fd354130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:52.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.050+0000 7fd359d2c700 1 --2- 172.21.15.26:0/1483747702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd35409e000 0x7fd354130660 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd348009870 tx=0x7fd348009b80 comp rx=0 tx=0).stop 2023-10-01T07:54:52.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.050+0000 7fd359d2c700 1 -- 172.21.15.26:0/1483747702 shutdown_connections 2023-10-01T07:54:52.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.050+0000 7fd359d2c700 1 --2- 172.21.15.26:0/1483747702 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd35409e410 0x7fd354130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:52.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.050+0000 7fd359d2c700 1 --2- 172.21.15.26:0/1483747702 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd35409d6f0 0x7fd35409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:52.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.050+0000 7fd359d2c700 1 --2- 172.21.15.26:0/1483747702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd35409e000 0x7fd354130660 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:52.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.050+0000 7fd359d2c700 1 -- 172.21.15.26:0/1483747702 >> 172.21.15.26:0/1483747702 conn(0x7fd354066f50 msgr2=0x7fd35409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:52.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.050+0000 7fd359d2c700 1 -- 172.21.15.26:0/1483747702 shutdown_connections 2023-10-01T07:54:52.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.051+0000 7fd359d2c700 1 -- 172.21.15.26:0/1483747702 wait complete. 2023-10-01T07:54:52.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.051+0000 7f1da9ffb700 1 -- 172.21.15.26:0/4019258409 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1dac020070 con 0x7f1db4130e50 2023-10-01T07:54:52.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.052+0000 7fd359d2c700 1 Processor -- start 2023-10-01T07:54:52.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.053+0000 7fd359d2c700 1 -- start start 2023-10-01T07:54:52.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.053+0000 7fd359d2c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd35409d6f0 0x7fd3541bea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:52.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.053+0000 7fd359d2c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd35409e000 0x7fd3541bef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:52.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.054+0000 7fd359d2c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd35409e410 0x7fd3541bf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:52.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.054+0000 7fd359d2c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3541bdf40 con 0x7fd35409e000 2023-10-01T07:54:52.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.054+0000 7fd359d2c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3541ba800 con 0x7fd35409e410 2023-10-01T07:54:52.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.054+0000 7fd359d2c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3541bd8c0 con 0x7fd35409d6f0 2023-10-01T07:54:52.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.054+0000 7fd353fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd35409e410 0x7fd3541bf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:52.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.054+0000 7fd352ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd35409e000 0x7fd3541bef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:52.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.054+0000 7fd353fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd35409e410 0x7fd3541bf4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46318/0 (socket says 172.21.15.26:46318) 2023-10-01T07:54:52.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.054+0000 7fd353fff700 1 -- 172.21.15.26:0/1615880919 learned_addr learned my addr 172.21.15.26:0/1615880919 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:52.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.054+0000 7fd3537fe700 1 --2- 172.21.15.26:0/1615880919 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd35409d6f0 0x7fd3541bea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:52.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.054+0000 7fd352ffd700 1 -- 172.21.15.26:0/1615880919 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd35409d6f0 msgr2=0x7fd3541bea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:52.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.054+0000 7fd352ffd700 1 --2- 172.21.15.26:0/1615880919 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd35409d6f0 0x7fd3541bea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:52.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.054+0000 7fd352ffd700 1 -- 172.21.15.26:0/1615880919 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd35409e410 msgr2=0x7fd3541bf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:52.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.054+0000 7fd352ffd700 1 --2- 172.21.15.26:0/1615880919 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd35409e410 0x7fd3541bf4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:52.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.054+0000 7fd352ffd700 1 -- 172.21.15.26:0/1615880919 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34c00bd40 con 0x7fd35409e000 2023-10-01T07:54:52.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.054+0000 7fd353fff700 1 --2- 172.21.15.26:0/1615880919 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd35409e410 0x7fd3541bf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:54:52.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.055+0000 7fd352ffd700 1 --2- 172.21.15.26:0/1615880919 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd35409e000 0x7fd3541bef80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd34801a000 tx=0x7fd348004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:52.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.058+0000 7fd33bfff700 1 -- 172.21.15.26:0/1615880919 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd348003ab0 con 0x7fd35409e000 2023-10-01T07:54:52.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.058+0000 7fd33bfff700 1 -- 172.21.15.26:0/1615880919 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd348003c10 con 0x7fd35409e000 2023-10-01T07:54:52.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.058+0000 7fd33bfff700 1 -- 172.21.15.26:0/1615880919 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd348021450 con 0x7fd35409e000 2023-10-01T07:54:52.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.058+0000 7fd359d2c700 1 -- 172.21.15.26:0/1615880919 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3480094a0 con 0x7fd35409e000 2023-10-01T07:54:52.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.058+0000 7fd359d2c700 1 -- 172.21.15.26:0/1615880919 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3541be5f0 con 0x7fd35409e000 2023-10-01T07:54:52.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.059+0000 7fd33bfff700 1 -- 172.21.15.26:0/1615880919 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd348018440 con 0x7fd35409e000 2023-10-01T07:54:52.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.059+0000 7fd33bfff700 1 -- 172.21.15.26:0/1615880919 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fd348040890 con 0x7fd35409e000 2023-10-01T07:54:52.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.059+0000 7fd3537fe700 1 -- 172.21.15.26:0/1615880919 >> v1:172.21.15.26:6816/126763 conn(0x7fd34002f510 legacy=0x7fd3400319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:52.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.059+0000 7fd359d2c700 1 -- 172.21.15.26:0/1615880919 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd354074ea0 con 0x7fd35409e000 2023-10-01T07:54:52.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.069+0000 7fd33bfff700 1 -- 172.21.15.26:0/1615880919 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd34801d080 con 0x7fd35409e000 2023-10-01T07:54:52.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.126+0000 7f7e2502f700 1 -- 172.21.15.26:0/4004008478 >> v1:172.21.15.26:6816/126763 conn(0x7f7e0402f510 legacy=0x7f7e040319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:52.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.182+0000 7f7e27293700 1 -- 172.21.15.26:0/4004008478 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7e200719a0 con 0x7f7e20130260 2023-10-01T07:54:52.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.182+0000 7f7e15ffb700 1 -- 172.21.15.26:0/4004008478 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7e18024b70 con 0x7f7e20130260 2023-10-01T07:54:52.183 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:54:52.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.185+0000 7f7e27293700 1 -- 172.21.15.26:0/4004008478 >> v1:172.21.15.26:6816/126763 conn(0x7f7e0402f510 legacy=0x7f7e040319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:52.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.185+0000 7f7e27293700 1 -- 172.21.15.26:0/4004008478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e20130260 msgr2=0x7f7e20131460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:52.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.185+0000 7f7e27293700 1 --2- 172.21.15.26:0/4004008478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e20130260 0x7f7e20131460 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7e18015000 tx=0x7f7e18004ad0 comp rx=0 tx=0).stop 2023-10-01T07:54:52.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.185+0000 7f7e27293700 1 -- 172.21.15.26:0/4004008478 shutdown_connections 2023-10-01T07:54:52.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.185+0000 7f7e27293700 1 --2- 172.21.15.26:0/4004008478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e20130260 0x7f7e20131460 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:52.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.185+0000 7f7e27293700 1 --2- 172.21.15.26:0/4004008478 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7e2012cf60 0x7f7e201309e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:52.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.185+0000 7f7e27293700 1 --2- 172.21.15.26:0/4004008478 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7e2012f8b0 0x7f7e20130f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:52.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.185+0000 7f7e27293700 1 -- 172.21.15.26:0/4004008478 >> 172.21.15.26:0/4004008478 conn(0x7f7e200a2aa0 msgr2=0x7f7e2006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:52.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.185+0000 7f7e27293700 1 -- 172.21.15.26:0/4004008478 shutdown_connections 2023-10-01T07:54:52.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.185+0000 7f7e27293700 1 -- 172.21.15.26:0/4004008478 wait complete. 2023-10-01T07:54:52.199 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:54:52.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.217+0000 7f0f327fc700 1 -- 172.21.15.26:0/169948543 >> v1:172.21.15.26:6816/126763 conn(0x7f0f2002f510 legacy=0x7f0f200319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:52.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.241+0000 7f0f3936a700 1 -- 172.21.15.26:0/169948543 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0f34074ea0 con 0x7f0f3409d6f0 2023-10-01T07:54:52.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.241+0000 7f0f1b7fe700 1 -- 172.21.15.26:0/169948543 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0f24015020 con 0x7f0f3409d6f0 2023-10-01T07:54:52.242 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:54:52.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.244+0000 7f1db92ca700 1 -- 172.21.15.26:0/4019258409 >> v1:172.21.15.26:6816/126763 conn(0x7f1d9802f510 legacy=0x7f1d980319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:52.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.244+0000 7f0f3936a700 1 -- 172.21.15.26:0/169948543 >> v1:172.21.15.26:6816/126763 conn(0x7f0f2002f510 legacy=0x7f0f200319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:52.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.244+0000 7f0f3936a700 1 -- 172.21.15.26:0/169948543 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f3409d6f0 msgr2=0x7f0f341a4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:52.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.244+0000 7f0f3936a700 1 --2- 172.21.15.26:0/169948543 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f3409d6f0 0x7f0f341a4dc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0f24009b90 tx=0x7f0f24004750 comp rx=0 tx=0).stop 2023-10-01T07:54:52.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.244+0000 7f0f3936a700 1 -- 172.21.15.26:0/169948543 shutdown_connections 2023-10-01T07:54:52.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.244+0000 7f0f3936a700 1 --2- 172.21.15.26:0/169948543 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f3409e410 0x7f0f341a5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:52.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.244+0000 7f0f3936a700 1 --2- 172.21.15.26:0/169948543 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f3409d6f0 0x7f0f341a4dc0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:52.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.244+0000 7f0f3936a700 1 --2- 172.21.15.26:0/169948543 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f3409e000 0x7f0f341a5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:52.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.244+0000 7f0f3936a700 1 -- 172.21.15.26:0/169948543 >> 172.21.15.26:0/169948543 conn(0x7f0f34066f50 msgr2=0x7f0f341bb010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:52.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.244+0000 7f0f3936a700 1 -- 172.21.15.26:0/169948543 shutdown_connections 2023-10-01T07:54:52.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.244+0000 7f0f3936a700 1 -- 172.21.15.26:0/169948543 wait complete. 2023-10-01T07:54:52.259 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:54:52.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.260+0000 7fd3537fe700 1 -- 172.21.15.26:0/1615880919 >> v1:172.21.15.26:6816/126763 conn(0x7fd34002f510 legacy=0x7fd3400319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:52.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.267+0000 7f1dbb52e700 1 -- 172.21.15.26:0/4019258409 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1db406b9e0 con 0x7f1db4130e50 2023-10-01T07:54:52.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.267+0000 7f1da9ffb700 1 -- 172.21.15.26:0/4019258409 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1dac01a740 con 0x7f1db4130e50 2023-10-01T07:54:52.268 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:54:52.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.269+0000 7f1dbb52e700 1 -- 172.21.15.26:0/4019258409 >> v1:172.21.15.26:6816/126763 conn(0x7f1d9802f510 legacy=0x7f1d980319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:52.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.269+0000 7f1dbb52e700 1 -- 172.21.15.26:0/4019258409 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1db4130e50 msgr2=0x7f1db411f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:52.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.269+0000 7f1dbb52e700 1 --2- 172.21.15.26:0/4019258409 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1db4130e50 0x7f1db411f470 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1dac015000 tx=0x7f1dac004ad0 comp rx=0 tx=0).stop 2023-10-01T07:54:52.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.269+0000 7f1dbb52e700 1 -- 172.21.15.26:0/4019258409 shutdown_connections 2023-10-01T07:54:52.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.269+0000 7f1dbb52e700 1 --2- 172.21.15.26:0/4019258409 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1db4130e50 0x7f1db411f470 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:52.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.269+0000 7f1dbb52e700 1 --2- 172.21.15.26:0/4019258409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1db406fb20 0x7f1db411e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:52.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.269+0000 7f1dbb52e700 1 --2- 172.21.15.26:0/4019258409 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1db4130540 0x7f1db411ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:52.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.270+0000 7f1dbb52e700 1 -- 172.21.15.26:0/4019258409 >> 172.21.15.26:0/4019258409 conn(0x7f1db40a2aa0 msgr2=0x7f1db412d500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:52.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.270+0000 7f1dbb52e700 1 -- 172.21.15.26:0/4019258409 shutdown_connections 2023-10-01T07:54:52.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.270+0000 7f1dbb52e700 1 -- 172.21.15.26:0/4019258409 wait complete. 2023-10-01T07:54:52.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.281+0000 7fd359d2c700 1 -- 172.21.15.26:0/1615880919 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd35406c360 con 0x7fd35409e000 2023-10-01T07:54:52.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.282+0000 7fd33bfff700 1 -- 172.21.15.26:0/1615880919 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd348026070 con 0x7fd35409e000 2023-10-01T07:54:52.282 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:54:52.284 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:54:52.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.284+0000 7fd359d2c700 1 -- 172.21.15.26:0/1615880919 >> v1:172.21.15.26:6816/126763 conn(0x7fd34002f510 legacy=0x7fd3400319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:52.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.284+0000 7fd359d2c700 1 -- 172.21.15.26:0/1615880919 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd35409e000 msgr2=0x7fd3541bef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:52.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.284+0000 7fd359d2c700 1 --2- 172.21.15.26:0/1615880919 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd35409e000 0x7fd3541bef80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd34801a000 tx=0x7fd348004750 comp rx=0 tx=0).stop 2023-10-01T07:54:52.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.284+0000 7fd359d2c700 1 -- 172.21.15.26:0/1615880919 shutdown_connections 2023-10-01T07:54:52.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.284+0000 7fd359d2c700 1 --2- 172.21.15.26:0/1615880919 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd35409e410 0x7fd3541bf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:52.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.284+0000 7fd359d2c700 1 --2- 172.21.15.26:0/1615880919 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd35409d6f0 0x7fd3541bea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:52.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.284+0000 7fd359d2c700 1 --2- 172.21.15.26:0/1615880919 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd35409e000 0x7fd3541bef80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:52.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.284+0000 7fd359d2c700 1 -- 172.21.15.26:0/1615880919 >> 172.21.15.26:0/1615880919 conn(0x7fd354066f50 msgr2=0x7fd35406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:52.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.284+0000 7fd359d2c700 1 -- 172.21.15.26:0/1615880919 shutdown_connections 2023-10-01T07:54:52.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:52.284+0000 7fd359d2c700 1 -- 172.21.15.26:0/1615880919 wait complete. 2023-10-01T07:54:52.299 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:54:53.201 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:54:53.260 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:54:53.285 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:54:53.301 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:54:53.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.360+0000 7f8d580d1700 1 Processor -- start 2023-10-01T07:54:53.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.360+0000 7f8d580d1700 1 -- start start 2023-10-01T07:54:53.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.361+0000 7f8d580d1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d5009d6f0 0x7f8d5009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:53.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.361+0000 7f8d580d1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d5009e000 0x7f8d501339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:53.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.361+0000 7f8d580d1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8d5009e410 0x7f8d50133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:53.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.361+0000 7f8d580d1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d5006b460 con 0x7f8d5009e410 2023-10-01T07:54:53.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.361+0000 7f8d580d1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5009b120 con 0x7f8d5009e000 2023-10-01T07:54:53.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.361+0000 7f8d580d1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5009a7e0 con 0x7f8d5009d6f0 2023-10-01T07:54:53.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.361+0000 7f8d5566c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d5009e000 0x7f8d501339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:53.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.361+0000 7f8d5566c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d5009e000 0x7f8d501339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46328/0 (socket says 172.21.15.26:46328) 2023-10-01T07:54:53.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.361+0000 7f8d5566c700 1 -- 172.21.15.26:0/1283939343 learned_addr learned my addr 172.21.15.26:0/1283939343 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:53.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.361+0000 7f8d5666e700 1 --2- 172.21.15.26:0/1283939343 >> v2:172.21.15.26:3300/0 conn(0x7f8d5009e410 0x7f8d50133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:53.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.361+0000 7f8d55e6d700 1 --2- 172.21.15.26:0/1283939343 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d5009d6f0 0x7f8d5009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:53.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.362+0000 7f8d5566c700 1 -- 172.21.15.26:0/1283939343 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d5009d6f0 msgr2=0x7f8d5009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:53.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.362+0000 7f8d5566c700 1 --2- 172.21.15.26:0/1283939343 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d5009d6f0 0x7f8d5009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.362+0000 7f8d5566c700 1 -- 172.21.15.26:0/1283939343 >> v2:172.21.15.26:3300/0 conn(0x7f8d5009e410 msgr2=0x7f8d50133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:53.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.362+0000 7f8d5566c700 1 --2- 172.21.15.26:0/1283939343 >> v2:172.21.15.26:3300/0 conn(0x7f8d5009e410 0x7f8d50133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.362+0000 7f8d5566c700 1 -- 172.21.15.26:0/1283939343 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d5009a500 con 0x7f8d5009e000 2023-10-01T07:54:53.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.362+0000 7f8d5566c700 1 --2- 172.21.15.26:0/1283939343 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d5009e000 0x7f8d501339f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8d40009920 tx=0x7f8d40009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8350d31451629205 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:53.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.362+0000 7f8d54e6b700 1 -- 172.21.15.26:0/1283939343 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d40011830 con 0x7f8d5009e000 2023-10-01T07:54:53.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.362+0000 7f8d54e6b700 1 -- 172.21.15.26:0/1283939343 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d40011990 con 0x7f8d5009e000 2023-10-01T07:54:53.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.362+0000 7f8d54e6b700 1 -- 172.21.15.26:0/1283939343 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d40011d20 con 0x7f8d5009e000 2023-10-01T07:54:53.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.363+0000 7f8d580d1700 1 -- 172.21.15.26:0/1283939343 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d5009e000 msgr2=0x7f8d501339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:53.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.363+0000 7f8d580d1700 1 --2- 172.21.15.26:0/1283939343 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d5009e000 0x7f8d501339f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8d40009920 tx=0x7f8d40009c30 comp rx=0 tx=0).stop 2023-10-01T07:54:53.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.363+0000 7f8d580d1700 1 -- 172.21.15.26:0/1283939343 shutdown_connections 2023-10-01T07:54:53.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.363+0000 7f8d580d1700 1 --2- 172.21.15.26:0/1283939343 >> v2:172.21.15.26:3300/0 conn(0x7f8d5009e410 0x7f8d50133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.363+0000 7f8d580d1700 1 --2- 172.21.15.26:0/1283939343 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d5009d6f0 0x7f8d5009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.363+0000 7f8d580d1700 1 --2- 172.21.15.26:0/1283939343 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d5009e000 0x7f8d501339f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.363+0000 7f8d580d1700 1 -- 172.21.15.26:0/1283939343 >> 172.21.15.26:0/1283939343 conn(0x7f8d50066f50 msgr2=0x7f8d5009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:53.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.363+0000 7f8d580d1700 1 -- 172.21.15.26:0/1283939343 shutdown_connections 2023-10-01T07:54:53.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.363+0000 7f8d580d1700 1 -- 172.21.15.26:0/1283939343 wait complete. 2023-10-01T07:54:53.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.364+0000 7f8d580d1700 1 Processor -- start 2023-10-01T07:54:53.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.364+0000 7f8d580d1700 1 -- start start 2023-10-01T07:54:53.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.365+0000 7f8d580d1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d5009d6f0 0x7f8d501a5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:53.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.365+0000 7f8d580d1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d5009e000 0x7f8d501a6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:53.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.365+0000 7f8d580d1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d5009e410 0x7f8d501a69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:53.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.365+0000 7f8d580d1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d501a8090 con 0x7f8d5009e000 2023-10-01T07:54:53.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.365+0000 7f8d580d1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d501a9150 con 0x7f8d5009d6f0 2023-10-01T07:54:53.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.365+0000 7f8d580d1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5009c710 con 0x7f8d5009e410 2023-10-01T07:54:53.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.365+0000 7f8d5666e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d5009e410 0x7f8d501a69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:53.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.365+0000 7f8d5666e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d5009e410 0x7f8d501a69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41764/0 (socket says 172.21.15.26:41764) 2023-10-01T07:54:53.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.365+0000 7f8d5666e700 1 -- 172.21.15.26:0/452502558 learned_addr learned my addr 172.21.15.26:0/452502558 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:53.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.365+0000 7f8d55e6d700 1 --2- 172.21.15.26:0/452502558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d5009d6f0 0x7f8d501a5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:53.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.365+0000 7f8d5566c700 1 --2- 172.21.15.26:0/452502558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d5009e000 0x7f8d501a6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:53.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.365+0000 7f8d5666e700 1 -- 172.21.15.26:0/452502558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d5009d6f0 msgr2=0x7f8d501a5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:53.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.365+0000 7f8d5666e700 1 --2- 172.21.15.26:0/452502558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d5009d6f0 0x7f8d501a5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.365+0000 7f8d5666e700 1 -- 172.21.15.26:0/452502558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d5009e000 msgr2=0x7f8d501a6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:53.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.365+0000 7f8d5666e700 1 --2- 172.21.15.26:0/452502558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d5009e000 0x7f8d501a6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.365+0000 7f8d5666e700 1 -- 172.21.15.26:0/452502558 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d40009550 con 0x7f8d5009e410 2023-10-01T07:54:53.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.366+0000 7f8d5666e700 1 --2- 172.21.15.26:0/452502558 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d5009e410 0x7f8d501a69b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8d4800efc0 tx=0x7f8d4800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:53.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.366+0000 7f8d467fc700 1 -- 172.21.15.26:0/452502558 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4800cc90 con 0x7f8d5009e410 2023-10-01T07:54:53.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.366+0000 7f8d580d1700 1 -- 172.21.15.26:0/452502558 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d500a3060 con 0x7f8d5009e410 2023-10-01T07:54:53.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.366+0000 7f8d467fc700 1 -- 172.21.15.26:0/452502558 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4800f040 con 0x7f8d5009e410 2023-10-01T07:54:53.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.366+0000 7f8d467fc700 1 -- 172.21.15.26:0/452502558 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d480146c0 con 0x7f8d5009e410 2023-10-01T07:54:53.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.366+0000 7f8d580d1700 1 -- 172.21.15.26:0/452502558 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d501a8d00 con 0x7f8d5009e410 2023-10-01T07:54:53.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.367+0000 7f8d467fc700 1 -- 172.21.15.26:0/452502558 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8d48014820 con 0x7f8d5009e410 2023-10-01T07:54:53.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.367+0000 7f8d467fc700 1 -- 172.21.15.26:0/452502558 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f8d480407f0 con 0x7f8d5009e410 2023-10-01T07:54:53.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.367+0000 7f8d55e6d700 1 -- 172.21.15.26:0/452502558 >> v1:172.21.15.26:6816/126763 conn(0x7f8d3402f510 legacy=0x7f8d340319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:53.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.368+0000 7f8d580d1700 1 -- 172.21.15.26:0/452502558 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d50074ea0 con 0x7f8d5009e410 2023-10-01T07:54:53.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.377+0000 7f8d467fc700 1 -- 172.21.15.26:0/452502558 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8d48007330 con 0x7f8d5009e410 2023-10-01T07:54:53.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.416+0000 7f2762f5a700 1 Processor -- start 2023-10-01T07:54:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.416+0000 7f2762f5a700 1 -- start start 2023-10-01T07:54:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.417+0000 7f2762f5a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f275c09e930 0x7f275c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.417+0000 7f2762f5a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f275c09f240 0x7f275c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.417+0000 7f2762f5a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f275c09f650 0x7f275c131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.417+0000 7f2762f5a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f275c070940 con 0x7f275c09e930 2023-10-01T07:54:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.417+0000 7f2762f5a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f275c06fd60 con 0x7f275c09f240 2023-10-01T07:54:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.417+0000 7f2762f5a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f275c06fa80 con 0x7f275c09f650 2023-10-01T07:54:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.417+0000 7f275bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f275c09f240 0x7f275c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.417+0000 7f2760cf6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f275c09e930 0x7f275c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.417+0000 7f275bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f275c09f240 0x7f275c1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:32794/0 (socket says 172.21.15.26:32794) 2023-10-01T07:54:53.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.417+0000 7f2760cf6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f275c09e930 0x7f275c09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60488/0 (socket says 172.21.15.26:60488) 2023-10-01T07:54:53.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.417+0000 7f27614f7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f275c09f650 0x7f275c131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:53.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.417+0000 7f275bfff700 1 -- 172.21.15.26:0/1387626839 learned_addr learned my addr 172.21.15.26:0/1387626839 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:53.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.418+0000 7f275bfff700 1 -- 172.21.15.26:0/1387626839 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f275c09f650 msgr2=0x7f275c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:53.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.418+0000 7f275bfff700 1 --2- 172.21.15.26:0/1387626839 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f275c09f650 0x7f275c131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.418+0000 7f275bfff700 1 -- 172.21.15.26:0/1387626839 >> v2:172.21.15.26:3300/0 conn(0x7f275c09e930 msgr2=0x7f275c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:53.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.418+0000 7f275bfff700 1 --2- 172.21.15.26:0/1387626839 >> v2:172.21.15.26:3300/0 conn(0x7f275c09e930 0x7f275c09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.418+0000 7f275bfff700 1 -- 172.21.15.26:0/1387626839 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275c09fb60 con 0x7f275c09f240 2023-10-01T07:54:53.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.418+0000 7f275bfff700 1 --2- 172.21.15.26:0/1387626839 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f275c09f240 0x7f275c1317f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f27480098f0 tx=0x7f2748009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4810c6056a60dcd server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:53.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.418+0000 7f275b7fe700 1 -- 172.21.15.26:0/1387626839 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2748011830 con 0x7f275c09f240 2023-10-01T07:54:53.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.418+0000 7f275b7fe700 1 -- 172.21.15.26:0/1387626839 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2748011990 con 0x7f275c09f240 2023-10-01T07:54:53.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.418+0000 7f275b7fe700 1 -- 172.21.15.26:0/1387626839 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2748011d20 con 0x7f275c09f240 2023-10-01T07:54:53.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.419+0000 7f2762f5a700 1 -- 172.21.15.26:0/1387626839 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f275c09f240 msgr2=0x7f275c1317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:53.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.419+0000 7f2762f5a700 1 --2- 172.21.15.26:0/1387626839 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f275c09f240 0x7f275c1317f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f27480098f0 tx=0x7f2748009c00 comp rx=0 tx=0).stop 2023-10-01T07:54:53.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.419+0000 7f2762f5a700 1 -- 172.21.15.26:0/1387626839 shutdown_connections 2023-10-01T07:54:53.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.419+0000 7f2762f5a700 1 --2- 172.21.15.26:0/1387626839 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f275c09f650 0x7f275c131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.419+0000 7f2762f5a700 1 --2- 172.21.15.26:0/1387626839 >> v2:172.21.15.26:3300/0 conn(0x7f275c09e930 0x7f275c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.419+0000 7f2762f5a700 1 --2- 172.21.15.26:0/1387626839 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f275c09f240 0x7f275c1317f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.419+0000 7f2762f5a700 1 -- 172.21.15.26:0/1387626839 >> 172.21.15.26:0/1387626839 conn(0x7f275c0a4210 msgr2=0x7f275c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:53.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.419+0000 7f2762f5a700 1 -- 172.21.15.26:0/1387626839 shutdown_connections 2023-10-01T07:54:53.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.419+0000 7f2762f5a700 1 -- 172.21.15.26:0/1387626839 wait complete. 2023-10-01T07:54:53.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.420+0000 7f2762f5a700 1 Processor -- start 2023-10-01T07:54:53.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.420+0000 7f2762f5a700 1 -- start start 2023-10-01T07:54:53.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.421+0000 7f2762f5a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f275c09e930 0x7f275c1c4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:53.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.421+0000 7f2762f5a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f275c09f240 0x7f275c1c4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:53.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.421+0000 7f2762f5a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f275c09f650 0x7f275c1c07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:53.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.421+0000 7f2762f5a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275c1a52d0 con 0x7f275c09f240 2023-10-01T07:54:53.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.421+0000 7f2762f5a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f275c1c4c80 con 0x7f275c09f650 2023-10-01T07:54:53.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.421+0000 7f2762f5a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f275c1a3c50 con 0x7f275c09e930 2023-10-01T07:54:53.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.421+0000 7f27614f7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f275c09f650 0x7f275c1c07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:53.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.421+0000 7f27614f7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f275c09f650 0x7f275c1c07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:32808/0 (socket says 172.21.15.26:32808) 2023-10-01T07:54:53.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.421+0000 7f27614f7700 1 -- 172.21.15.26:0/2031951843 learned_addr learned my addr 172.21.15.26:0/2031951843 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:53.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.421+0000 7f2760cf6700 1 --2- 172.21.15.26:0/2031951843 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f275c09e930 0x7f275c1c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:53.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.421+0000 7f275bfff700 1 --2- 172.21.15.26:0/2031951843 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f275c09f240 0x7f275c1c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:53.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.422+0000 7f27614f7700 1 -- 172.21.15.26:0/2031951843 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f275c09e930 msgr2=0x7f275c1c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:53.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.422+0000 7f27614f7700 1 --2- 172.21.15.26:0/2031951843 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f275c09e930 0x7f275c1c4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.422+0000 7f27614f7700 1 -- 172.21.15.26:0/2031951843 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f275c09f240 msgr2=0x7f275c1c4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:53.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.422+0000 7f27614f7700 1 --2- 172.21.15.26:0/2031951843 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f275c09f240 0x7f275c1c4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.422+0000 7f27614f7700 1 -- 172.21.15.26:0/2031951843 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2748009550 con 0x7f275c09f650 2023-10-01T07:54:53.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.422+0000 7f27614f7700 1 --2- 172.21.15.26:0/2031951843 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f275c09f650 0x7f275c1c07b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f275400efc0 tx=0x7f275400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:53.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.422+0000 7f27597fa700 1 -- 172.21.15.26:0/2031951843 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2754009ea0 con 0x7f275c09f650 2023-10-01T07:54:53.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.422+0000 7f27597fa700 1 -- 172.21.15.26:0/2031951843 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275400f040 con 0x7f275c09f650 2023-10-01T07:54:53.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.422+0000 7f2762f5a700 1 -- 172.21.15.26:0/2031951843 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f275c0a0190 con 0x7f275c09f650 2023-10-01T07:54:53.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.422+0000 7f2762f5a700 1 -- 172.21.15.26:0/2031951843 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f275c071d70 con 0x7f275c09f650 2023-10-01T07:54:53.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.422+0000 7f27597fa700 1 -- 172.21.15.26:0/2031951843 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275400ce90 con 0x7f275c09f650 2023-10-01T07:54:53.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.424+0000 7f2762f5a700 1 -- 172.21.15.26:0/2031951843 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f273c0052e0 con 0x7f275c09f650 2023-10-01T07:54:53.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.424+0000 7f27597fa700 1 -- 172.21.15.26:0/2031951843 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2754014480 con 0x7f275c09f650 2023-10-01T07:54:53.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.424+0000 7f27597fa700 1 -- 172.21.15.26:0/2031951843 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f2754040480 con 0x7f275c09f650 2023-10-01T07:54:53.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.429+0000 7f27597fa700 1 -- 172.21.15.26:0/2031951843 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f275401a8b0 con 0x7f275c09f650 2023-10-01T07:54:53.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.451+0000 7ff4f8caf700 1 Processor -- start 2023-10-01T07:54:53.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.451+0000 7ff4f8caf700 1 -- start start 2023-10-01T07:54:53.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.452+0000 7ff4f8caf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4f4130670 0x7ff4f4130a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:53.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.452+0000 7ff4f8caf700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff4f40701a0 0x7ff4f4138540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:53.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.452+0000 7ff4f8caf700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f4130260 con 0x7ff4f406f680 2023-10-01T07:54:53.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.452+0000 7ff4f8caf700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f4071ff0 con 0x7ff4f40701a0 2023-10-01T07:54:53.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.452+0000 7ff4f8caf700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f409ecf0 con 0x7ff4f4130670 2023-10-01T07:54:53.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.452+0000 7ff4f259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4f4130670 0x7ff4f4130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:53.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.452+0000 7ff4f1d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff4f406f680 0x7ff4f406fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33332/0 (socket says 172.21.15.26:33332) 2023-10-01T07:54:53.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.452+0000 7ff4f1d9b700 1 -- 172.21.15.26:0/3480332260 learned_addr learned my addr 172.21.15.26:0/3480332260 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:53.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.452+0000 7ff4f2d9d700 1 --2- 172.21.15.26:0/3480332260 >> v2:172.21.15.26:3300/0 conn(0x7ff4f40701a0 0x7ff4f4138540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:53.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.452+0000 7ff4f2d9d700 1 -- 172.21.15.26:0/3480332260 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4f4130670 msgr2=0x7ff4f4130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:53.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.452+0000 7ff4f2d9d700 1 --2- 172.21.15.26:0/3480332260 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4f4130670 0x7ff4f4130a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.452+0000 7ff4f2d9d700 1 -- 172.21.15.26:0/3480332260 >> v1:172.21.15.26:6789/0 conn(0x7ff4f406f680 legacy=0x7ff4f406fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:53.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.452+0000 7ff4f2d9d700 1 -- 172.21.15.26:0/3480332260 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f4070e70 con 0x7ff4f40701a0 2023-10-01T07:54:53.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.453+0000 7ff4f2d9d700 1 --2- 172.21.15.26:0/3480332260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4f40701a0 0x7ff4f4138540 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec009d90 tx=0x7ff4ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eecebfce53ede449 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:53.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.453+0000 7ff4f159a700 1 -- 172.21.15.26:0/3480332260 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec00e070 con 0x7ff4f40701a0 2023-10-01T07:54:53.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.453+0000 7ff4f159a700 1 -- 172.21.15.26:0/3480332260 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ec003a20 con 0x7ff4f40701a0 2023-10-01T07:54:53.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.453+0000 7ff4f159a700 1 -- 172.21.15.26:0/3480332260 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec003dd0 con 0x7ff4f40701a0 2023-10-01T07:54:53.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.454+0000 7ff4f8caf700 1 -- 172.21.15.26:0/3480332260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4f40701a0 msgr2=0x7ff4f4138540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:53.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.454+0000 7ff4f8caf700 1 --2- 172.21.15.26:0/3480332260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4f40701a0 0x7ff4f4138540 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec009d90 tx=0x7ff4ec00b330 comp rx=0 tx=0).stop 2023-10-01T07:54:53.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.454+0000 7ff4f8caf700 1 -- 172.21.15.26:0/3480332260 shutdown_connections 2023-10-01T07:54:53.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.454+0000 7ff4f8caf700 1 --2- 172.21.15.26:0/3480332260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4f40701a0 0x7ff4f4138540 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.454+0000 7ff4f8caf700 1 --2- 172.21.15.26:0/3480332260 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4f4130670 0x7ff4f4130a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.454+0000 7ff4f8caf700 1 -- 172.21.15.26:0/3480332260 >> 172.21.15.26:0/3480332260 conn(0x7ff4f40a2aa0 msgr2=0x7ff4f40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:53.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.454+0000 7ff4f8caf700 1 -- 172.21.15.26:0/3480332260 shutdown_connections 2023-10-01T07:54:53.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.454+0000 7ff4f8caf700 1 -- 172.21.15.26:0/3480332260 wait complete. 2023-10-01T07:54:53.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.456+0000 7ff4f8caf700 1 Processor -- start 2023-10-01T07:54:53.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.456+0000 7ff4f8caf700 1 -- start start 2023-10-01T07:54:53.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.457+0000 7ff4f8caf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4f406f680 0x7ff4f41c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:53.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.457+0000 7ff4f8caf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4f40701a0 0x7ff4f4127250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:53.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.457+0000 7ff4f8caf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4f4130670 0x7ff4f41c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:53.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.457+0000 7ff4f8caf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f41c89d0 con 0x7ff4f40701a0 2023-10-01T07:54:53.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.457+0000 7ff4f8caf700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f41289e0 con 0x7ff4f4130670 2023-10-01T07:54:53.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.457+0000 7ff4f8caf700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f4128ca0 con 0x7ff4f406f680 2023-10-01T07:54:53.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.457+0000 7ff4f259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4f406f680 0x7ff4f41c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:53.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.457+0000 7ff4f259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4f406f680 0x7ff4f41c83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35412/0 (socket says 172.21.15.26:35412) 2023-10-01T07:54:53.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.457+0000 7ff4f259c700 1 -- 172.21.15.26:0/955937092 learned_addr learned my addr 172.21.15.26:0/955937092 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:53.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.457+0000 7ff4f2d9d700 1 --2- 172.21.15.26:0/955937092 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4f4130670 0x7ff4f41c4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:53.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.457+0000 7ff4f1d9b700 1 --2- 172.21.15.26:0/955937092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4f40701a0 0x7ff4f4127250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:53.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.457+0000 7ff4f259c700 1 -- 172.21.15.26:0/955937092 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4f4130670 msgr2=0x7ff4f41c4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:53.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.457+0000 7ff4f259c700 1 --2- 172.21.15.26:0/955937092 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4f4130670 0x7ff4f41c4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.457+0000 7ff4f259c700 1 -- 172.21.15.26:0/955937092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4f40701a0 msgr2=0x7ff4f4127250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:53.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.457+0000 7ff4f259c700 1 --2- 172.21.15.26:0/955937092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4f40701a0 0x7ff4f4127250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.457+0000 7ff4f259c700 1 -- 172.21.15.26:0/955937092 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ec009a70 con 0x7ff4f406f680 2023-10-01T07:54:53.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.458+0000 7ff4f259c700 1 --2- 172.21.15.26:0/955937092 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4f406f680 0x7ff4f41c83b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400e9b0 tx=0x7ff4e400ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:53.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.458+0000 7ff4e2ffd700 1 -- 172.21.15.26:0/955937092 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4009710 con 0x7ff4f406f680 2023-10-01T07:54:53.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.458+0000 7ff4e2ffd700 1 -- 172.21.15.26:0/955937092 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e400ee50 con 0x7ff4f406f680 2023-10-01T07:54:53.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.458+0000 7ff4e2ffd700 1 -- 172.21.15.26:0/955937092 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e400ca50 con 0x7ff4f406f680 2023-10-01T07:54:53.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.458+0000 7ff4f8caf700 1 -- 172.21.15.26:0/955937092 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f4128f80 con 0x7ff4f406f680 2023-10-01T07:54:53.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.458+0000 7ff4f8caf700 1 -- 172.21.15.26:0/955937092 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f4127970 con 0x7ff4f406f680 2023-10-01T07:54:53.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.459+0000 7ff4f8caf700 1 -- 172.21.15.26:0/955937092 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f4074ea0 con 0x7ff4f406f680 2023-10-01T07:54:53.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.459+0000 7ff4e2ffd700 1 -- 172.21.15.26:0/955937092 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff4e400cbb0 con 0x7ff4f406f680 2023-10-01T07:54:53.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.460+0000 7ff4e2ffd700 1 -- 172.21.15.26:0/955937092 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7ff4e403fd80 con 0x7ff4f406f680 2023-10-01T07:54:53.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.460+0000 7f8b7b4e4700 1 Processor -- start 2023-10-01T07:54:53.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.460+0000 7f8b7b4e4700 1 -- start start 2023-10-01T07:54:53.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.461+0000 7f8b7b4e4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8b74130540 0x7f8b74130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:53.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.461+0000 7f8b7b4e4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b74130e50 0x7f8b7406f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:53.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.461+0000 7f8b7b4e4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b7406fb20 0x7f8b7406ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:53.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.461+0000 7f8b7b4e4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b7409a390 con 0x7f8b74130540 2023-10-01T07:54:53.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.461+0000 7f8b7b4e4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b740716a0 con 0x7f8b74130e50 2023-10-01T07:54:53.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.461+0000 7f8b7b4e4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b74071290 con 0x7f8b7406fb20 2023-10-01T07:54:53.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.461+0000 7f8b79280700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8b74130540 0x7f8b74130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:53.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.461+0000 7f8b79280700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8b74130540 0x7f8b74130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60524/0 (socket says 172.21.15.26:60524) 2023-10-01T07:54:53.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.461+0000 7f8b79280700 1 -- 172.21.15.26:0/3416024631 learned_addr learned my addr 172.21.15.26:0/3416024631 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:53.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.461+0000 7f8b78a7f700 1 --2- 172.21.15.26:0/3416024631 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b74130e50 0x7f8b7406f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:53.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.461+0000 7f8b79a81700 1 --2- 172.21.15.26:0/3416024631 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b7406fb20 0x7f8b7406ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:53.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.462+0000 7f8b79280700 1 -- 172.21.15.26:0/3416024631 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b7406fb20 msgr2=0x7f8b7406ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:53.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.462+0000 7f8b79280700 1 --2- 172.21.15.26:0/3416024631 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b7406fb20 0x7f8b7406ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.462+0000 7f8b79280700 1 -- 172.21.15.26:0/3416024631 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b74130e50 msgr2=0x7f8b7406f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:53.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.462+0000 7f8b79280700 1 --2- 172.21.15.26:0/3416024631 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b74130e50 0x7f8b7406f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.462+0000 7f8b79280700 1 -- 172.21.15.26:0/3416024631 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b74130340 con 0x7f8b74130540 2023-10-01T07:54:53.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.462+0000 7f8b79280700 1 --2- 172.21.15.26:0/3416024631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b74130540 0x7f8b74130910 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8b700098f0 tx=0x7f8b70009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7804eb1135e0b2b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:53.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.462+0000 7f8b6bfff700 1 -- 172.21.15.26:0/3416024631 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b70011830 con 0x7f8b74130540 2023-10-01T07:54:53.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.462+0000 7f8b6bfff700 1 -- 172.21.15.26:0/3416024631 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b70011990 con 0x7f8b74130540 2023-10-01T07:54:53.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.462+0000 7f8b6bfff700 1 -- 172.21.15.26:0/3416024631 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b70011d00 con 0x7f8b74130540 2023-10-01T07:54:53.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.463+0000 7f8b7b4e4700 1 -- 172.21.15.26:0/3416024631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b74130540 msgr2=0x7f8b74130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:53.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.463+0000 7f8b7b4e4700 1 --2- 172.21.15.26:0/3416024631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b74130540 0x7f8b74130910 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8b700098f0 tx=0x7f8b70009c00 comp rx=0 tx=0).stop 2023-10-01T07:54:53.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.463+0000 7f8b7b4e4700 1 -- 172.21.15.26:0/3416024631 shutdown_connections 2023-10-01T07:54:53.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.463+0000 7f8b7b4e4700 1 --2- 172.21.15.26:0/3416024631 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b7406fb20 0x7f8b7406ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.463+0000 7f8b7b4e4700 1 --2- 172.21.15.26:0/3416024631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b74130540 0x7f8b74130910 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.463+0000 7f8b7b4e4700 1 --2- 172.21.15.26:0/3416024631 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b74130e50 0x7f8b7406f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.463+0000 7f8b7b4e4700 1 -- 172.21.15.26:0/3416024631 >> 172.21.15.26:0/3416024631 conn(0x7f8b740a2aa0 msgr2=0x7f8b740a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:53.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.463+0000 7f8b7b4e4700 1 -- 172.21.15.26:0/3416024631 shutdown_connections 2023-10-01T07:54:53.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.463+0000 7f8b7b4e4700 1 -- 172.21.15.26:0/3416024631 wait complete. 2023-10-01T07:54:53.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.465+0000 7f8b7b4e4700 1 Processor -- start 2023-10-01T07:54:53.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.465+0000 7f8b7b4e4700 1 -- start start 2023-10-01T07:54:53.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.466+0000 7f8b7b4e4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b7406fb20 0x7f8b74132ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:53.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.466+0000 7f8b7b4e4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b74130540 0x7f8b74133530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:53.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.466+0000 7f8b7b4e4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b74130e50 0x7f8b74133a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:53.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.466+0000 7f8b7b4e4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b741193f0 con 0x7f8b7406fb20 2023-10-01T07:54:53.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.466+0000 7f8b7b4e4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b740718e0 con 0x7f8b74130e50 2023-10-01T07:54:53.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.466+0000 7f8b7b4e4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b740a0b90 con 0x7f8b74130540 2023-10-01T07:54:53.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.466+0000 7f8b79a81700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b74130e50 0x7f8b74133a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:53.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.466+0000 7ff4e2ffd700 1 -- 172.21.15.26:0/955937092 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff4e40232f0 con 0x7ff4f406f680 2023-10-01T07:54:53.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.466+0000 7f8b79a81700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b74130e50 0x7f8b74133a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:32854/0 (socket says 172.21.15.26:32854) 2023-10-01T07:54:53.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.466+0000 7f8b79a81700 1 -- 172.21.15.26:0/1430457174 learned_addr learned my addr 172.21.15.26:0/1430457174 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:53.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.466+0000 7f8b78a7f700 1 --2- 172.21.15.26:0/1430457174 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b74130540 0x7f8b74133530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:53.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.466+0000 7f8b79280700 1 --2- 172.21.15.26:0/1430457174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b7406fb20 0x7f8b74132ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:53.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.466+0000 7f8b78a7f700 1 -- 172.21.15.26:0/1430457174 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b74130e50 msgr2=0x7f8b74133a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:53.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.466+0000 7f8b78a7f700 1 --2- 172.21.15.26:0/1430457174 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b74130e50 0x7f8b74133a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.466+0000 7f8b78a7f700 1 -- 172.21.15.26:0/1430457174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b7406fb20 msgr2=0x7f8b74132ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:53.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.466+0000 7f8b78a7f700 1 --2- 172.21.15.26:0/1430457174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b7406fb20 0x7f8b74132ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.466+0000 7f8b78a7f700 1 -- 172.21.15.26:0/1430457174 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b70009550 con 0x7f8b74130540 2023-10-01T07:54:53.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.467+0000 7f8b79280700 1 --2- 172.21.15.26:0/1430457174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b7406fb20 0x7f8b74132ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:54:53.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.467+0000 7f8b78a7f700 1 --2- 172.21.15.26:0/1430457174 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b74130540 0x7f8b74133530 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8b6400e900 tx=0x7f8b6400ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:53.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.467+0000 7f8b69ffb700 1 -- 172.21.15.26:0/1430457174 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b64009650 con 0x7f8b74130540 2023-10-01T07:54:53.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.467+0000 7f8b69ffb700 1 -- 172.21.15.26:0/1430457174 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b64013860 con 0x7f8b74130540 2023-10-01T07:54:53.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.467+0000 7f8b69ffb700 1 -- 172.21.15.26:0/1430457174 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b64013bd0 con 0x7f8b74130540 2023-10-01T07:54:53.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.467+0000 7f8b7b4e4700 1 -- 172.21.15.26:0/1430457174 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b7412dd10 con 0x7f8b74130540 2023-10-01T07:54:53.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.467+0000 7f8b7b4e4700 1 -- 172.21.15.26:0/1430457174 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b74118eb0 con 0x7f8b74130540 2023-10-01T07:54:53.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.468+0000 7f8b69ffb700 1 -- 172.21.15.26:0/1430457174 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8b64013d30 con 0x7f8b74130540 2023-10-01T07:54:53.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.469+0000 7f8b69ffb700 1 -- 172.21.15.26:0/1430457174 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f8b64043b00 con 0x7f8b74130540 2023-10-01T07:54:53.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.469+0000 7f8b79280700 1 -- 172.21.15.26:0/1430457174 >> v1:172.21.15.26:6816/126763 conn(0x7f8b5802f510 legacy=0x7f8b580319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:53.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.469+0000 7f8b7b4e4700 1 -- 172.21.15.26:0/1430457174 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b540052e0 con 0x7f8b74130540 2023-10-01T07:54:53.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.474+0000 7f8b69ffb700 1 -- 172.21.15.26:0/1430457174 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8b64020080 con 0x7f8b74130540 2023-10-01T07:54:53.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.568+0000 7f8d55e6d700 1 -- 172.21.15.26:0/452502558 >> v1:172.21.15.26:6816/126763 conn(0x7f8d3402f510 legacy=0x7f8d340319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:53.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.595+0000 7f8d580d1700 1 -- 172.21.15.26:0/452502558 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8d5006c360 con 0x7f8d5009e410 2023-10-01T07:54:53.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.596+0000 7f8d467fc700 1 -- 172.21.15.26:0/452502558 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8d4802c090 con 0x7f8d5009e410 2023-10-01T07:54:53.596 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:54:53.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.598+0000 7f8d580d1700 1 -- 172.21.15.26:0/452502558 >> v1:172.21.15.26:6816/126763 conn(0x7f8d3402f510 legacy=0x7f8d340319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:53.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.598+0000 7f8d580d1700 1 -- 172.21.15.26:0/452502558 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d5009e410 msgr2=0x7f8d501a69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:53.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.598+0000 7f8d580d1700 1 --2- 172.21.15.26:0/452502558 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d5009e410 0x7f8d501a69b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8d4800efc0 tx=0x7f8d4800c3a0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.598+0000 7f8d580d1700 1 -- 172.21.15.26:0/452502558 shutdown_connections 2023-10-01T07:54:53.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.598+0000 7f8d580d1700 1 --2- 172.21.15.26:0/452502558 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d5009e410 0x7f8d501a69b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.598+0000 7f8d580d1700 1 --2- 172.21.15.26:0/452502558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d5009d6f0 0x7f8d501a5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.598+0000 7f8d580d1700 1 --2- 172.21.15.26:0/452502558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d5009e000 0x7f8d501a6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.598+0000 7f8d580d1700 1 -- 172.21.15.26:0/452502558 >> 172.21.15.26:0/452502558 conn(0x7f8d50066f50 msgr2=0x7f8d501baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:53.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.598+0000 7f8d580d1700 1 -- 172.21.15.26:0/452502558 shutdown_connections 2023-10-01T07:54:53.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.598+0000 7f8d580d1700 1 -- 172.21.15.26:0/452502558 wait complete. 2023-10-01T07:54:53.613 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:54:53.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.644+0000 7f2762f5a700 1 -- 172.21.15.26:0/2031951843 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f273c005860 con 0x7f275c09f650 2023-10-01T07:54:53.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.645+0000 7f27597fa700 1 -- 172.21.15.26:0/2031951843 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2754018020 con 0x7f275c09f650 2023-10-01T07:54:53.645 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:54:53.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.647+0000 7f2762f5a700 1 -- 172.21.15.26:0/2031951843 >> v1:172.21.15.26:6816/126763 conn(0x7f274002f510 legacy=0x7f27400319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-01T07:54:53.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.647+0000 7f2762f5a700 1 -- 172.21.15.26:0/2031951843 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f275c09f650 msgr2=0x7f275c1c07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:53.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.647+0000 7f2762f5a700 1 --2- 172.21.15.26:0/2031951843 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f275c09f650 0x7f275c1c07b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f275400efc0 tx=0x7f275400c3a0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.647+0000 7f2762f5a700 1 -- 172.21.15.26:0/2031951843 shutdown_connections 2023-10-01T07:54:53.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.647+0000 7f2762f5a700 1 --2- 172.21.15.26:0/2031951843 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f275c09f650 0x7f275c1c07b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.647+0000 7f2762f5a700 1 --2- 172.21.15.26:0/2031951843 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f275c09e930 0x7f275c1c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.647+0000 7f2762f5a700 1 --2- 172.21.15.26:0/2031951843 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f275c09f240 0x7f275c1c4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.647+0000 7f2762f5a700 1 -- 172.21.15.26:0/2031951843 >> 172.21.15.26:0/2031951843 conn(0x7f275c0a4210 msgr2=0x7f275c1b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:53.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.647+0000 7f2762f5a700 1 -- 172.21.15.26:0/2031951843 shutdown_connections 2023-10-01T07:54:53.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.647+0000 7f2762f5a700 1 -- 172.21.15.26:0/2031951843 wait complete. 2023-10-01T07:54:53.662 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:54:53.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.670+0000 7f8b79280700 1 -- 172.21.15.26:0/1430457174 >> v1:172.21.15.26:6816/126763 conn(0x7f8b5802f510 legacy=0x7f8b580319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:53.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.673+0000 7ff4f8caf700 1 -- 172.21.15.26:0/955937092 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff4f4072210 con 0x7ff4f406f680 2023-10-01T07:54:53.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.674+0000 7ff4e2ffd700 1 -- 172.21.15.26:0/955937092 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff4e401ae80 con 0x7ff4f406f680 2023-10-01T07:54:53.674 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:54:53.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.676+0000 7ff4f8caf700 1 -- 172.21.15.26:0/955937092 >> v1:172.21.15.26:6816/126763 conn(0x7ff4d402f510 legacy=0x7ff4d40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-01T07:54:53.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.676+0000 7ff4f8caf700 1 -- 172.21.15.26:0/955937092 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4f406f680 msgr2=0x7ff4f41c83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:53.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.676+0000 7ff4f8caf700 1 --2- 172.21.15.26:0/955937092 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4f406f680 0x7ff4f41c83b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400e9b0 tx=0x7ff4e400ecc0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.676+0000 7ff4f8caf700 1 -- 172.21.15.26:0/955937092 shutdown_connections 2023-10-01T07:54:53.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.676+0000 7ff4f8caf700 1 --2- 172.21.15.26:0/955937092 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4f4130670 0x7ff4f41c4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.676+0000 7ff4f8caf700 1 --2- 172.21.15.26:0/955937092 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4f406f680 0x7ff4f41c83b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.676+0000 7ff4f8caf700 1 --2- 172.21.15.26:0/955937092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4f40701a0 0x7ff4f4127250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.676+0000 7ff4f8caf700 1 -- 172.21.15.26:0/955937092 >> 172.21.15.26:0/955937092 conn(0x7ff4f40a2aa0 msgr2=0x7ff4f4124f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:53.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.676+0000 7ff4f8caf700 1 -- 172.21.15.26:0/955937092 shutdown_connections 2023-10-01T07:54:53.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.676+0000 7ff4f8caf700 1 -- 172.21.15.26:0/955937092 wait complete. 2023-10-01T07:54:53.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.681+0000 7f8b7b4e4700 1 -- 172.21.15.26:0/1430457174 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8b54005150 con 0x7f8b74130540 2023-10-01T07:54:53.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.681+0000 7f8b69ffb700 1 -- 172.21.15.26:0/1430457174 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8b6401a3a0 con 0x7f8b74130540 2023-10-01T07:54:53.682 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:54:53.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.683+0000 7f8b7b4e4700 1 -- 172.21.15.26:0/1430457174 >> v1:172.21.15.26:6816/126763 conn(0x7f8b5802f510 legacy=0x7f8b580319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:53.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.683+0000 7f8b7b4e4700 1 -- 172.21.15.26:0/1430457174 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b74130540 msgr2=0x7f8b74133530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:53.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.683+0000 7f8b7b4e4700 1 --2- 172.21.15.26:0/1430457174 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b74130540 0x7f8b74133530 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8b6400e900 tx=0x7f8b6400ecc0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.683+0000 7f8b7b4e4700 1 -- 172.21.15.26:0/1430457174 shutdown_connections 2023-10-01T07:54:53.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.683+0000 7f8b7b4e4700 1 --2- 172.21.15.26:0/1430457174 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b74130e50 0x7f8b74133a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.683+0000 7f8b7b4e4700 1 --2- 172.21.15.26:0/1430457174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b7406fb20 0x7f8b74132ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.683+0000 7f8b7b4e4700 1 --2- 172.21.15.26:0/1430457174 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b74130540 0x7f8b74133530 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:53.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.684+0000 7f8b7b4e4700 1 -- 172.21.15.26:0/1430457174 >> 172.21.15.26:0/1430457174 conn(0x7f8b740a2aa0 msgr2=0x7f8b7406e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:53.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.684+0000 7f8b7b4e4700 1 -- 172.21.15.26:0/1430457174 shutdown_connections 2023-10-01T07:54:53.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:53.684+0000 7f8b7b4e4700 1 -- 172.21.15.26:0/1430457174 wait complete. 2023-10-01T07:54:53.691 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:54:53.698 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:54:54.613 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:54:54.663 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:54:54.692 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:54:54.699 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:54:54.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.769+0000 7fa1c64ea700 1 Processor -- start 2023-10-01T07:54:54.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.769+0000 7fa1c64ea700 1 -- start start 2023-10-01T07:54:54.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.770+0000 7fa1c64ea700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa1c009d6f0 0x7fa1c009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:54.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.770+0000 7fa1c64ea700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa1c009e410 0x7fa1c0134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:54.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.770+0000 7fa1c64ea700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1c009b120 con 0x7fa1c009e000 2023-10-01T07:54:54.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.770+0000 7fa1c64ea700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c006b460 con 0x7fa1c009d6f0 2023-10-01T07:54:54.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.770+0000 7fa1c64ea700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c009a7e0 con 0x7fa1c009e410 2023-10-01T07:54:54.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.770+0000 7fa1bffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa1c009d6f0 0x7fa1c009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:54.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.770+0000 7fa1bffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa1c009d6f0 0x7fa1c009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:32864/0 (socket says 172.21.15.26:32864) 2023-10-01T07:54:54.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.770+0000 7fa1bffff700 1 -- 172.21.15.26:0/1536969602 learned_addr learned my addr 172.21.15.26:0/1536969602 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:54.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.770+0000 7fa1c4a87700 1 --2- 172.21.15.26:0/1536969602 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa1c009e410 0x7fa1c0134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:54.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.771+0000 7fa1bffff700 1 -- 172.21.15.26:0/1536969602 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa1c009e410 msgr2=0x7fa1c0134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:54.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.771+0000 7fa1bffff700 1 --2- 172.21.15.26:0/1536969602 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa1c009e410 0x7fa1c0134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:54.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.771+0000 7fa1bffff700 1 -- 172.21.15.26:0/1536969602 >> v1:172.21.15.26:6789/0 conn(0x7fa1c009e000 legacy=0x7fa1c01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:54.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.771+0000 7fa1bffff700 1 -- 172.21.15.26:0/1536969602 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c009a500 con 0x7fa1c009d6f0 2023-10-01T07:54:54.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.771+0000 7fa1bffff700 1 --2- 172.21.15.26:0/1536969602 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa1c009d6f0 0x7fa1c009dac0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0009920 tx=0x7fa1b0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0d3cdacdf7c721d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:54.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.771+0000 7fa1beffd700 1 -- 172.21.15.26:0/1536969602 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0011830 con 0x7fa1c009d6f0 2023-10-01T07:54:54.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.771+0000 7fa1beffd700 1 -- 172.21.15.26:0/1536969602 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b0011990 con 0x7fa1c009d6f0 2023-10-01T07:54:54.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.771+0000 7fa1beffd700 1 -- 172.21.15.26:0/1536969602 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0011d20 con 0x7fa1c009d6f0 2023-10-01T07:54:54.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.772+0000 7fa1c64ea700 1 -- 172.21.15.26:0/1536969602 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa1c009d6f0 msgr2=0x7fa1c009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:54.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.772+0000 7fa1c64ea700 1 --2- 172.21.15.26:0/1536969602 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa1c009d6f0 0x7fa1c009dac0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0009920 tx=0x7fa1b0009c30 comp rx=0 tx=0).stop 2023-10-01T07:54:54.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.772+0000 7fa1c64ea700 1 -- 172.21.15.26:0/1536969602 shutdown_connections 2023-10-01T07:54:54.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.772+0000 7fa1c64ea700 1 --2- 172.21.15.26:0/1536969602 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa1c009e410 0x7fa1c0134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:54.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.772+0000 7fa1c64ea700 1 --2- 172.21.15.26:0/1536969602 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa1c009d6f0 0x7fa1c009dac0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:54.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.772+0000 7fa1c64ea700 1 -- 172.21.15.26:0/1536969602 >> 172.21.15.26:0/1536969602 conn(0x7fa1c0066f50 msgr2=0x7fa1c009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:54.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.773+0000 7fa1c64ea700 1 -- 172.21.15.26:0/1536969602 shutdown_connections 2023-10-01T07:54:54.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.773+0000 7fa1c64ea700 1 -- 172.21.15.26:0/1536969602 wait complete. 2023-10-01T07:54:54.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.774+0000 7fa1c64ea700 1 Processor -- start 2023-10-01T07:54:54.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.774+0000 7fa1c64ea700 1 -- start start 2023-10-01T07:54:54.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.774+0000 7fa1c64ea700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa1c009d6f0 0x7fa1c0122710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:54.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.774+0000 7fa1c64ea700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1c009e000 0x7fa1c0122c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:54.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.774+0000 7fa1c64ea700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa1c009e410 0x7fa1c0123190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:54.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.774+0000 7fa1c64ea700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c0123be0 con 0x7fa1c009e000 2023-10-01T07:54:54.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.774+0000 7fa1c64ea700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c0125e70 con 0x7fa1c009d6f0 2023-10-01T07:54:54.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.774+0000 7fa1c64ea700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c0124350 con 0x7fa1c009e410 2023-10-01T07:54:54.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.775+0000 7fa1bffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa1c009d6f0 0x7fa1c0122710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:54.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.775+0000 7fa1bffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa1c009d6f0 0x7fa1c0122710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:32870/0 (socket says 172.21.15.26:32870) 2023-10-01T07:54:54.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.775+0000 7fa1bffff700 1 -- 172.21.15.26:0/1390319171 learned_addr learned my addr 172.21.15.26:0/1390319171 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:54.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.775+0000 7fa1bf7fe700 1 --2- 172.21.15.26:0/1390319171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1c009e000 0x7fa1c0122c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:54.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.775+0000 7fa1c4a87700 1 --2- 172.21.15.26:0/1390319171 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa1c009e410 0x7fa1c0123190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:54.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.775+0000 7fa1c4a87700 1 -- 172.21.15.26:0/1390319171 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa1c009d6f0 msgr2=0x7fa1c0122710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:54.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.775+0000 7fa1c4a87700 1 --2- 172.21.15.26:0/1390319171 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa1c009d6f0 0x7fa1c0122710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:54.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.775+0000 7fa1c4a87700 1 -- 172.21.15.26:0/1390319171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1c009e000 msgr2=0x7fa1c0122c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:54.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.775+0000 7fa1c4a87700 1 --2- 172.21.15.26:0/1390319171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1c009e000 0x7fa1c0122c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:54.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.775+0000 7fa1c4a87700 1 -- 172.21.15.26:0/1390319171 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b0009550 con 0x7fa1c009e410 2023-10-01T07:54:54.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.775+0000 7fa1bf7fe700 1 --2- 172.21.15.26:0/1390319171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1c009e000 0x7fa1c0122c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:54.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.775+0000 7fa1c4a87700 1 --2- 172.21.15.26:0/1390319171 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa1c009e410 0x7fa1c0123190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8009d90 tx=0x7fa1b800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:54.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.776+0000 7fa1bcff9700 1 -- 172.21.15.26:0/1390319171 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8009c00 con 0x7fa1c009e410 2023-10-01T07:54:54.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.776+0000 7fa1bcff9700 1 -- 172.21.15.26:0/1390319171 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b800f040 con 0x7fa1c009e410 2023-10-01T07:54:54.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.776+0000 7fa1bcff9700 1 -- 172.21.15.26:0/1390319171 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8014480 con 0x7fa1c009e410 2023-10-01T07:54:54.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.776+0000 7fa1c64ea700 1 -- 172.21.15.26:0/1390319171 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1c00a1e20 con 0x7fa1c009e410 2023-10-01T07:54:54.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.776+0000 7fa1c64ea700 1 -- 172.21.15.26:0/1390319171 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1c0126150 con 0x7fa1c009e410 2023-10-01T07:54:54.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.777+0000 7fa1bcff9700 1 -- 172.21.15.26:0/1390319171 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa1b80145e0 con 0x7fa1c009e410 2023-10-01T07:54:54.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.777+0000 7fa1bcff9700 1 -- 172.21.15.26:0/1390319171 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fa1b8040840 con 0x7fa1c009e410 2023-10-01T07:54:54.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.777+0000 7fa1c64ea700 1 -- 172.21.15.26:0/1390319171 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1c0125fb0 con 0x7fa1c009e410 2023-10-01T07:54:54.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.777+0000 7fa1bffff700 1 -- 172.21.15.26:0/1390319171 >> v1:172.21.15.26:6816/126763 conn(0x7fa1ac02f510 legacy=0x7fa1ac0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:54.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.787+0000 7fa1bcff9700 1 -- 172.21.15.26:0/1390319171 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa1c0125fb0 con 0x7fa1c009e410 2023-10-01T07:54:54.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.824+0000 7f92b0a8d700 1 Processor -- start 2023-10-01T07:54:54.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.825+0000 7f92b0a8d700 1 -- start start 2023-10-01T07:54:54.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.826+0000 7f92b0a8d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f92ac09e1d0 0x7f92ac138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:54.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.826+0000 7f92b0a8d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92ac139170 0x7f92ac13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:54.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.826+0000 7f92b0a8d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92ac09b120 con 0x7f92ac09d6f0 2023-10-01T07:54:54.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.826+0000 7f92b0a8d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92ac06b460 con 0x7f92ac09e1d0 2023-10-01T07:54:54.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.826+0000 7f92b0a8d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac09a7e0 con 0x7f92ac139170 2023-10-01T07:54:54.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.826+0000 7f92a9d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f92ac09e1d0 0x7f92ac138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:54.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.826+0000 7f92a9d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f92ac09e1d0 0x7f92ac138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60558/0 (socket says 172.21.15.26:60558) 2023-10-01T07:54:54.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.826+0000 7f92a9d9b700 1 -- 172.21.15.26:0/1521932013 learned_addr learned my addr 172.21.15.26:0/1521932013 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:54.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.826+0000 7f92aad9d700 1 --2- 172.21.15.26:0/1521932013 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92ac139170 0x7f92ac13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:54.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.826+0000 7f92a9d9b700 1 -- 172.21.15.26:0/1521932013 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92ac139170 msgr2=0x7f92ac13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:54.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.826+0000 7f92a9d9b700 1 --2- 172.21.15.26:0/1521932013 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92ac139170 0x7f92ac13b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:54.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.826+0000 7f92a9d9b700 1 -- 172.21.15.26:0/1521932013 >> v1:172.21.15.26:6789/0 conn(0x7f92ac09d6f0 legacy=0x7f92ac09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:54.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.826+0000 7f92a9d9b700 1 -- 172.21.15.26:0/1521932013 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ac09a500 con 0x7f92ac09e1d0 2023-10-01T07:54:54.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.826+0000 7f92aad9d700 1 --2- 172.21.15.26:0/1521932013 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92ac139170 0x7f92ac13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:54.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.827+0000 7f92a9d9b700 1 --2- 172.21.15.26:0/1521932013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92ac09e1d0 0x7f92ac138c30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009920 tx=0x7f92a0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=506ec2db6dbbff0d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:54.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.827+0000 7f92a959a700 1 -- 172.21.15.26:0/1521932013 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a0011830 con 0x7f92ac09e1d0 2023-10-01T07:54:54.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.827+0000 7f92a959a700 1 -- 172.21.15.26:0/1521932013 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a0011990 con 0x7f92ac09e1d0 2023-10-01T07:54:54.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.827+0000 7f92a959a700 1 -- 172.21.15.26:0/1521932013 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a0011d20 con 0x7f92ac09e1d0 2023-10-01T07:54:54.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.828+0000 7f92b0a8d700 1 -- 172.21.15.26:0/1521932013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92ac09e1d0 msgr2=0x7f92ac138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:54.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.828+0000 7f92b0a8d700 1 --2- 172.21.15.26:0/1521932013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92ac09e1d0 0x7f92ac138c30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009920 tx=0x7f92a0009c30 comp rx=0 tx=0).stop 2023-10-01T07:54:54.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.828+0000 7f92b0a8d700 1 -- 172.21.15.26:0/1521932013 shutdown_connections 2023-10-01T07:54:54.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.828+0000 7f92b0a8d700 1 --2- 172.21.15.26:0/1521932013 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92ac139170 0x7f92ac13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:54.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.828+0000 7f92b0a8d700 1 --2- 172.21.15.26:0/1521932013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92ac09e1d0 0x7f92ac138c30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:54.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.828+0000 7f92b0a8d700 1 -- 172.21.15.26:0/1521932013 >> 172.21.15.26:0/1521932013 conn(0x7f92ac066f50 msgr2=0x7f92ac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:54.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.828+0000 7f92b0a8d700 1 -- 172.21.15.26:0/1521932013 shutdown_connections 2023-10-01T07:54:54.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.828+0000 7f92b0a8d700 1 -- 172.21.15.26:0/1521932013 wait complete. 2023-10-01T07:54:54.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.829+0000 7f92b0a8d700 1 Processor -- start 2023-10-01T07:54:54.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.829+0000 7f92b0a8d700 1 -- start start 2023-10-01T07:54:54.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.830+0000 7f92b0a8d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92ac09d6f0 0x7f92ac1c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:54.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.830+0000 7f92b0a8d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92ac09e1d0 0x7f92ac1c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:54.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.830+0000 7f92b0a8d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92ac139170 0x7f92ac11e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:54.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.830+0000 7f92b0a8d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac0a1a50 con 0x7f92ac09e1d0 2023-10-01T07:54:54.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.830+0000 7f92b0a8d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac121d20 con 0x7f92ac09d6f0 2023-10-01T07:54:54.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.830+0000 7f92b0a8d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac09c710 con 0x7f92ac139170 2023-10-01T07:54:54.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.830+0000 7f92aa59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92ac09d6f0 0x7f92ac1c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:54.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.830+0000 7f92aa59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92ac09d6f0 0x7f92ac1c84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:32886/0 (socket says 172.21.15.26:32886) 2023-10-01T07:54:54.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.830+0000 7f92aa59c700 1 -- 172.21.15.26:0/373356392 learned_addr learned my addr 172.21.15.26:0/373356392 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:54.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.830+0000 7f92aad9d700 1 --2- 172.21.15.26:0/373356392 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92ac139170 0x7f92ac11e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:54.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.830+0000 7f92a9d9b700 1 --2- 172.21.15.26:0/373356392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92ac09e1d0 0x7f92ac1c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:54.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.830+0000 7f92aad9d700 1 -- 172.21.15.26:0/373356392 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92ac09d6f0 msgr2=0x7f92ac1c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:54.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.830+0000 7f92aad9d700 1 --2- 172.21.15.26:0/373356392 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92ac09d6f0 0x7f92ac1c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:54.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.830+0000 7f92aad9d700 1 -- 172.21.15.26:0/373356392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92ac09e1d0 msgr2=0x7f92ac1c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:54.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.830+0000 7f92aad9d700 1 --2- 172.21.15.26:0/373356392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92ac09e1d0 0x7f92ac1c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:54.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.830+0000 7f92aad9d700 1 -- 172.21.15.26:0/373356392 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a4009a70 con 0x7f92ac139170 2023-10-01T07:54:54.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.830+0000 7f92a9d9b700 1 --2- 172.21.15.26:0/373356392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92ac09e1d0 0x7f92ac1c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:54.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.831+0000 7f92aad9d700 1 --2- 172.21.15.26:0/373356392 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92ac139170 0x7f92ac11e7e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f92a4009e40 tx=0x7f92a400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:54.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.831+0000 7f929affd700 1 -- 172.21.15.26:0/373356392 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a400cc90 con 0x7f92ac139170 2023-10-01T07:54:54.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.831+0000 7f929affd700 1 -- 172.21.15.26:0/373356392 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a400f040 con 0x7f92ac139170 2023-10-01T07:54:54.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.831+0000 7f929affd700 1 -- 172.21.15.26:0/373356392 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a4014480 con 0x7f92ac139170 2023-10-01T07:54:54.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.831+0000 7f92b0a8d700 1 -- 172.21.15.26:0/373356392 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92a0009550 con 0x7f92ac139170 2023-10-01T07:54:54.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.831+0000 7f92b0a8d700 1 -- 172.21.15.26:0/373356392 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92ac120450 con 0x7f92ac139170 2023-10-01T07:54:54.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.832+0000 7f92b0a8d700 1 -- 172.21.15.26:0/373356392 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92ac1be2b0 con 0x7f92ac139170 2023-10-01T07:54:54.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.832+0000 7f929affd700 1 -- 172.21.15.26:0/373356392 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f92a40145e0 con 0x7f92ac139170 2023-10-01T07:54:54.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.833+0000 7f929affd700 1 -- 172.21.15.26:0/373356392 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f92a4040570 con 0x7f92ac139170 2023-10-01T07:54:54.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.833+0000 7f92aa59c700 1 -- 172.21.15.26:0/373356392 >> v1:172.21.15.26:6816/126763 conn(0x7f928c02f510 legacy=0x7f928c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:54.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.841+0000 7f929affd700 1 -- 172.21.15.26:0/373356392 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f92ac1be2b0 con 0x7f92ac139170 2023-10-01T07:54:54.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.860+0000 7f357badd700 1 Processor -- start 2023-10-01T07:54:54.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.860+0000 7f357badd700 1 -- start start 2023-10-01T07:54:54.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.861+0000 7f357badd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f357406a770 0x7f357406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:54.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.861+0000 7f357badd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3574131d10 0x7f3574139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:54.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.861+0000 7f357badd700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f357409ece0 con 0x7f357406b080 2023-10-01T07:54:54.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.861+0000 7f357badd700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357409e760 con 0x7f357406a770 2023-10-01T07:54:54.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.861+0000 7f357badd700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f357409e040 con 0x7f3574131d10 2023-10-01T07:54:54.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.861+0000 7f3579879700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f357406a770 0x7f357406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:54.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.861+0000 7f3579078700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f357406b080 0x7f3574131600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33368/0 (socket says 172.21.15.26:33368) 2023-10-01T07:54:54.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.861+0000 7f3579078700 1 -- 172.21.15.26:0/3368472614 learned_addr learned my addr 172.21.15.26:0/3368472614 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:54.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.861+0000 7f3578877700 1 -- 172.21.15.26:0/3368472614 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1914285170 0 0) 0x7f357409ece0 con 0x7f357406b080 2023-10-01T07:54:54.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.861+0000 7f3578877700 1 -- 172.21.15.26:0/3368472614 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35600035b0 con 0x7f357406b080 2023-10-01T07:54:54.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.862+0000 7f3579879700 1 -- 172.21.15.26:0/3368472614 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3574131d10 msgr2=0x7f3574139860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:54.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.862+0000 7f357a07a700 1 --2- 172.21.15.26:0/3368472614 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3574131d10 0x7f3574139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:54.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.862+0000 7f3579879700 1 --2- 172.21.15.26:0/3368472614 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3574131d10 0x7f3574139860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:54.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.862+0000 7f3579879700 1 -- 172.21.15.26:0/3368472614 >> v1:172.21.15.26:6789/0 conn(0x7f357406b080 legacy=0x7f3574131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:54.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.862+0000 7f3578877700 1 -- 172.21.15.26:0/3368472614 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 586829531 0 0) 0x7f35600035b0 con 0x7f357406b080 2023-10-01T07:54:54.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.862+0000 7f3579879700 1 -- 172.21.15.26:0/3368472614 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357409f630 con 0x7f357406a770 2023-10-01T07:54:54.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.862+0000 7f357a07a700 1 --2- 172.21.15.26:0/3368472614 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3574131d10 0x7f3574139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:54:54.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.862+0000 7f3579879700 1 --2- 172.21.15.26:0/3368472614 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f357406a770 0x7f357406ab40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3570009870 tx=0x7f3570009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ce1baebfbe77d8e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:54.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.862+0000 7f3429327700 1 Processor -- start 2023-10-01T07:54:54.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.862+0000 7f3429327700 1 -- start start 2023-10-01T07:54:54.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.862+0000 7f3578877700 1 -- 172.21.15.26:0/3368472614 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3564001670 con 0x7f357406a770 2023-10-01T07:54:54.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.862+0000 7f3578877700 1 -- 172.21.15.26:0/3368472614 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3570004030 con 0x7f357406a770 2023-10-01T07:54:54.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.862+0000 7f3578877700 1 -- 172.21.15.26:0/3368472614 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35700043c0 con 0x7f357406a770 2023-10-01T07:54:54.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.863+0000 7f3429327700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3424071f40 0x7f3424133a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:54.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.863+0000 7f3429327700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f342409e000 0x7f3424133f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:54.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.863+0000 7f3429327700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3424133620 con 0x7f342409ce60 2023-10-01T07:54:54.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.863+0000 7f3429327700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3424072310 con 0x7f342409e000 2023-10-01T07:54:54.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.863+0000 7f3429327700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f342409a190 con 0x7f3424071f40 2023-10-01T07:54:54.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.863+0000 7f3422ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3424071f40 0x7f3424133a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:54.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.863+0000 7f3422ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3424071f40 0x7f3424133a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35498/0 (socket says 172.21.15.26:35498) 2023-10-01T07:54:54.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.863+0000 7f3422ffd700 1 -- 172.21.15.26:0/381467129 learned_addr learned my addr 172.21.15.26:0/381467129 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:54.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.863+0000 7f3422ffd700 1 -- 172.21.15.26:0/381467129 >> v2:172.21.15.26:3300/0 conn(0x7f342409e000 msgr2=0x7f3424133f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-01T07:54:54.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.863+0000 7f3422ffd700 1 --2- 172.21.15.26:0/381467129 >> v2:172.21.15.26:3300/0 conn(0x7f342409e000 0x7f3424133f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:54.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.863+0000 7f3422ffd700 1 -- 172.21.15.26:0/381467129 >> v1:172.21.15.26:6789/0 conn(0x7f342409ce60 legacy=0x7f342409d300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-01T07:54:54.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.863+0000 7f357badd700 1 -- 172.21.15.26:0/3368472614 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f357406a770 msgr2=0x7f357406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:54.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.863+0000 7f3422ffd700 1 -- 172.21.15.26:0/381467129 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3424134480 con 0x7f3424071f40 2023-10-01T07:54:54.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.863+0000 7f357badd700 1 --2- 172.21.15.26:0/3368472614 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f357406a770 0x7f357406ab40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3570009870 tx=0x7f3570009b80 comp rx=0 tx=0).stop 2023-10-01T07:54:54.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.863+0000 7f357badd700 1 -- 172.21.15.26:0/3368472614 shutdown_connections 2023-10-01T07:54:54.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.863+0000 7f357badd700 1 --2- 172.21.15.26:0/3368472614 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3574131d10 0x7f3574139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:54.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.863+0000 7f357badd700 1 --2- 172.21.15.26:0/3368472614 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f357406a770 0x7f357406ab40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:54.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.863+0000 7f357badd700 1 -- 172.21.15.26:0/3368472614 >> 172.21.15.26:0/3368472614 conn(0x7f3574066f50 msgr2=0x7f357409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:54.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.864+0000 7f3422ffd700 1 --2- 172.21.15.26:0/381467129 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3424071f40 0x7f3424133a00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f34140098f0 tx=0x7f3414009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e200bf89b644188 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:54.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.864+0000 7f357badd700 1 -- 172.21.15.26:0/3368472614 shutdown_connections 2023-10-01T07:54:54.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.864+0000 7f357badd700 1 -- 172.21.15.26:0/3368472614 wait complete. 2023-10-01T07:54:54.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.864+0000 7f3421ffb700 1 -- 172.21.15.26:0/381467129 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3414004230 con 0x7f3424071f40 2023-10-01T07:54:54.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.864+0000 7f3421ffb700 1 -- 172.21.15.26:0/381467129 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3414004390 con 0x7f3424071f40 2023-10-01T07:54:54.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.865+0000 7f357badd700 1 Processor -- start 2023-10-01T07:54:54.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.865+0000 7f357badd700 1 -- start start 2023-10-01T07:54:54.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.865+0000 7f357badd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f357406a770 0x7f357411d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:54.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.865+0000 7f357badd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f357406b080 0x7f357411ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:54.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.865+0000 7f357badd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3574131d10 0x7f357411e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:54.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.865+0000 7f357badd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357411ff50 con 0x7f3574131d10 2023-10-01T07:54:54.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.865+0000 7f357badd700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3574071e60 con 0x7f357406a770 2023-10-01T07:54:54.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.865+0000 7f357badd700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35741201a0 con 0x7f357406b080 2023-10-01T07:54:54.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.865+0000 7f3579879700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f357406a770 0x7f357411d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:54.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.865+0000 7f3579879700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f357406a770 0x7f357411d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:32900/0 (socket says 172.21.15.26:32900) 2023-10-01T07:54:54.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.865+0000 7f3579879700 1 -- 172.21.15.26:0/3210396248 learned_addr learned my addr 172.21.15.26:0/3210396248 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:54.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.865+0000 7f357a07a700 1 --2- 172.21.15.26:0/3210396248 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3574131d10 0x7f357411e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:54.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.866+0000 7f3579078700 1 --2- 172.21.15.26:0/3210396248 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f357406b080 0x7f357411ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:54.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.866+0000 7f3421ffb700 1 -- 172.21.15.26:0/381467129 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34140036a0 con 0x7f3424071f40 2023-10-01T07:54:54.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.866+0000 7f3579879700 1 -- 172.21.15.26:0/3210396248 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f357406b080 msgr2=0x7f357411ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:54.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.866+0000 7f3579879700 1 --2- 172.21.15.26:0/3210396248 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f357406b080 0x7f357411ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:54.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.866+0000 7f3579879700 1 -- 172.21.15.26:0/3210396248 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3574131d10 msgr2=0x7f357411e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:54.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.866+0000 7f3579879700 1 --2- 172.21.15.26:0/3210396248 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3574131d10 0x7f357411e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:54.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.866+0000 7f3579879700 1 -- 172.21.15.26:0/3210396248 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35700094a0 con 0x7f357406a770 2023-10-01T07:54:54.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.866+0000 7f3579879700 1 --2- 172.21.15.26:0/3210396248 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f357406a770 0x7f357411d890 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3570009840 tx=0x7f3570004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:54.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.866+0000 7f3429327700 1 -- 172.21.15.26:0/381467129 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3424071f40 msgr2=0x7f3424133a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:54.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.867+0000 7f3429327700 1 --2- 172.21.15.26:0/381467129 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3424071f40 0x7f3424133a00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f34140098f0 tx=0x7f3414009c00 comp rx=0 tx=0).stop 2023-10-01T07:54:54.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.866+0000 7f356a7fc700 1 -- 172.21.15.26:0/3210396248 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3570011630 con 0x7f357406a770 2023-10-01T07:54:54.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.867+0000 7f356a7fc700 1 -- 172.21.15.26:0/3210396248 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357001f070 con 0x7f357406a770 2023-10-01T07:54:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.867+0000 7f356a7fc700 1 -- 172.21.15.26:0/3210396248 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35700119f0 con 0x7f357406a770 2023-10-01T07:54:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.867+0000 7f357badd700 1 -- 172.21.15.26:0/3210396248 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3574131130 con 0x7f357406a770 2023-10-01T07:54:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.867+0000 7f357badd700 1 -- 172.21.15.26:0/3210396248 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35741bc990 con 0x7f357406a770 2023-10-01T07:54:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.867+0000 7f3429327700 1 -- 172.21.15.26:0/381467129 shutdown_connections 2023-10-01T07:54:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.867+0000 7f3429327700 1 --2- 172.21.15.26:0/381467129 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3424071f40 0x7f3424133a00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.867+0000 7f3429327700 1 --2- 172.21.15.26:0/381467129 >> v2:172.21.15.26:3300/0 conn(0x7f342409e000 0x7f3424133f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.867+0000 7f3429327700 1 -- 172.21.15.26:0/381467129 >> 172.21.15.26:0/381467129 conn(0x7f34240a2360 msgr2=0x7f34240a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.867+0000 7f3429327700 1 -- 172.21.15.26:0/381467129 shutdown_connections 2023-10-01T07:54:54.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.867+0000 7f3429327700 1 -- 172.21.15.26:0/381467129 wait complete. 2023-10-01T07:54:54.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.868+0000 7f356a7fc700 1 -- 172.21.15.26:0/3210396248 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3570011b50 con 0x7f357406a770 2023-10-01T07:54:54.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.868+0000 7f356a7fc700 1 -- 172.21.15.26:0/3210396248 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f3570021070 con 0x7f357406a770 2023-10-01T07:54:54.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.868+0000 7f357badd700 1 -- 172.21.15.26:0/3210396248 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f357411f9a0 con 0x7f357406a770 2023-10-01T07:54:54.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.868+0000 7f3429327700 1 Processor -- start 2023-10-01T07:54:54.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.868+0000 7f3579078700 1 -- 172.21.15.26:0/3210396248 >> v1:172.21.15.26:6816/126763 conn(0x7f355802f560 legacy=0x7f3558031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:54.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.869+0000 7f3429327700 1 -- start start 2023-10-01T07:54:54.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.869+0000 7f3429327700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3424071f40 0x7f342412e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:54.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.869+0000 7f3429327700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f342409ce60 0x7f342412eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:54.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.869+0000 7f3429327700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f342409e000 0x7f342412f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:54.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.869+0000 7f3429327700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342408b4a0 con 0x7f342409ce60 2023-10-01T07:54:54.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.869+0000 7f3429327700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f342409c150 con 0x7f3424071f40 2023-10-01T07:54:54.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.869+0000 7f3429327700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f342412fb50 con 0x7f342409e000 2023-10-01T07:54:54.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.869+0000 7f34227fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f342409ce60 0x7f342412eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:54.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.869+0000 7f34227fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f342409ce60 0x7f342412eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60568/0 (socket says 172.21.15.26:60568) 2023-10-01T07:54:54.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.869+0000 7f34227fc700 1 -- 172.21.15.26:0/2476497930 learned_addr learned my addr 172.21.15.26:0/2476497930 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:54.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.870+0000 7f34227fc700 1 -- 172.21.15.26:0/2476497930 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f342409e000 msgr2=0x7f342412f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:54.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.870+0000 7f34227fc700 1 --2- 172.21.15.26:0/2476497930 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f342409e000 0x7f342412f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:54.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.870+0000 7f34227fc700 1 -- 172.21.15.26:0/2476497930 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3424071f40 msgr2=0x7f342412e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:54.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.870+0000 7f34227fc700 1 --2- 172.21.15.26:0/2476497930 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3424071f40 0x7f342412e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:54.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.870+0000 7f34227fc700 1 -- 172.21.15.26:0/2476497930 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3414009550 con 0x7f342409ce60 2023-10-01T07:54:54.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.870+0000 7f34227fc700 1 --2- 172.21.15.26:0/2476497930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f342409ce60 0x7f342412eca0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f341800b550 tx=0x7f341800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:54.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.872+0000 7f340b7fe700 1 -- 172.21.15.26:0/2476497930 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3418011830 con 0x7f342409ce60 2023-10-01T07:54:54.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.872+0000 7f340b7fe700 1 -- 172.21.15.26:0/2476497930 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3418011990 con 0x7f342409ce60 2023-10-01T07:54:54.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.872+0000 7f340b7fe700 1 -- 172.21.15.26:0/2476497930 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3418011d40 con 0x7f342409ce60 2023-10-01T07:54:54.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.872+0000 7f3429327700 1 -- 172.21.15.26:0/2476497930 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3424130f40 con 0x7f342409ce60 2023-10-01T07:54:54.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.872+0000 7f3429327700 1 -- 172.21.15.26:0/2476497930 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34240a0e40 con 0x7f342409ce60 2023-10-01T07:54:54.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.873+0000 7f3429327700 1 -- 172.21.15.26:0/2476497930 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3424074ea0 con 0x7f342409ce60 2023-10-01T07:54:54.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.874+0000 7f340b7fe700 1 -- 172.21.15.26:0/2476497930 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f341801a400 con 0x7f342409ce60 2023-10-01T07:54:54.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.874+0000 7f340b7fe700 1 -- 172.21.15.26:0/2476497930 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f341803fc50 con 0x7f342409ce60 2023-10-01T07:54:54.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.874+0000 7f3422ffd700 1 -- 172.21.15.26:0/2476497930 >> v1:172.21.15.26:6816/126763 conn(0x7f341002f510 legacy=0x7f34100319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:54.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.875+0000 7f356a7fc700 1 -- 172.21.15.26:0/3210396248 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f35700197d0 con 0x7f357406a770 2023-10-01T07:54:54.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.883+0000 7f340b7fe700 1 -- 172.21.15.26:0/2476497930 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f341800f8d0 con 0x7f342409ce60 2023-10-01T07:54:54.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:54.979+0000 7fa1bffff700 1 -- 172.21.15.26:0/1390319171 >> v1:172.21.15.26:6816/126763 conn(0x7fa1ac02f510 legacy=0x7fa1ac0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:55.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.008+0000 7fa1c64ea700 1 -- 172.21.15.26:0/1390319171 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa1c0125fb0 con 0x7fa1c009e410 2023-10-01T07:54:55.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.008+0000 7fa1bcff9700 1 -- 172.21.15.26:0/1390319171 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa1c0125fb0 con 0x7fa1c009e410 2023-10-01T07:54:55.009 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:54:55.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.010+0000 7fa1c64ea700 1 -- 172.21.15.26:0/1390319171 >> v1:172.21.15.26:6816/126763 conn(0x7fa1ac02f510 legacy=0x7fa1ac0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:55.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.011+0000 7fa1c64ea700 1 -- 172.21.15.26:0/1390319171 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa1c009e410 msgr2=0x7fa1c0123190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:55.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.011+0000 7fa1c64ea700 1 --2- 172.21.15.26:0/1390319171 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa1c009e410 0x7fa1c0123190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8009d90 tx=0x7fa1b800c3a0 comp rx=0 tx=0).stop 2023-10-01T07:54:55.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.011+0000 7fa1c64ea700 1 -- 172.21.15.26:0/1390319171 shutdown_connections 2023-10-01T07:54:55.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.011+0000 7fa1c64ea700 1 --2- 172.21.15.26:0/1390319171 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa1c009e410 0x7fa1c0123190 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:55.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.011+0000 7fa1c64ea700 1 --2- 172.21.15.26:0/1390319171 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa1c009d6f0 0x7fa1c0122710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:55.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.011+0000 7fa1c64ea700 1 --2- 172.21.15.26:0/1390319171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1c009e000 0x7fa1c0122c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:55.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.011+0000 7fa1c64ea700 1 -- 172.21.15.26:0/1390319171 >> 172.21.15.26:0/1390319171 conn(0x7fa1c0066f50 msgr2=0x7fa1c006f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:55.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.011+0000 7fa1c64ea700 1 -- 172.21.15.26:0/1390319171 shutdown_connections 2023-10-01T07:54:55.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.011+0000 7fa1c64ea700 1 -- 172.21.15.26:0/1390319171 wait complete. 2023-10-01T07:54:55.026 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:54:55.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.034+0000 7f92aa59c700 1 -- 172.21.15.26:0/373356392 >> v1:172.21.15.26:6816/126763 conn(0x7f928c02f510 legacy=0x7f928c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:55.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.054+0000 7f92b0a8d700 1 -- 172.21.15.26:0/373356392 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f92ac09f420 con 0x7f92ac139170 2023-10-01T07:54:55.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.054+0000 7f929affd700 1 -- 172.21.15.26:0/373356392 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f92a4018090 con 0x7f92ac139170 2023-10-01T07:54:55.055 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:54:55.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.056+0000 7f92b0a8d700 1 -- 172.21.15.26:0/373356392 >> v1:172.21.15.26:6816/126763 conn(0x7f928c02f510 legacy=0x7f928c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:55.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.056+0000 7f92b0a8d700 1 -- 172.21.15.26:0/373356392 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92ac139170 msgr2=0x7f92ac11e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:55.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.056+0000 7f92b0a8d700 1 --2- 172.21.15.26:0/373356392 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92ac139170 0x7f92ac11e7e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f92a4009e40 tx=0x7f92a400c3a0 comp rx=0 tx=0).stop 2023-10-01T07:54:55.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.056+0000 7f92b0a8d700 1 -- 172.21.15.26:0/373356392 shutdown_connections 2023-10-01T07:54:55.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.056+0000 7f92b0a8d700 1 --2- 172.21.15.26:0/373356392 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92ac139170 0x7f92ac11e7e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:55.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.056+0000 7f92b0a8d700 1 --2- 172.21.15.26:0/373356392 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92ac09d6f0 0x7f92ac1c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:55.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.056+0000 7f92b0a8d700 1 --2- 172.21.15.26:0/373356392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92ac09e1d0 0x7f92ac1c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:55.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.056+0000 7f92b0a8d700 1 -- 172.21.15.26:0/373356392 >> 172.21.15.26:0/373356392 conn(0x7f92ac066f50 msgr2=0x7f92ac09b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:55.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.057+0000 7f92b0a8d700 1 -- 172.21.15.26:0/373356392 shutdown_connections 2023-10-01T07:54:55.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.057+0000 7f92b0a8d700 1 -- 172.21.15.26:0/373356392 wait complete. 2023-10-01T07:54:55.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.069+0000 7f3579078700 1 -- 172.21.15.26:0/3210396248 >> v1:172.21.15.26:6816/126763 conn(0x7f355802f560 legacy=0x7f3558031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:55.071 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:54:55.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.075+0000 7f3422ffd700 1 -- 172.21.15.26:0/2476497930 >> v1:172.21.15.26:6816/126763 conn(0x7f341002f510 legacy=0x7f34100319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:55.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.107+0000 7f357badd700 1 -- 172.21.15.26:0/3210396248 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3574074ea0 con 0x7f357406a770 2023-10-01T07:54:55.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.107+0000 7f356a7fc700 1 -- 172.21.15.26:0/3210396248 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f357002f3f0 con 0x7f357406a770 2023-10-01T07:54:55.108 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:54:55.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.108+0000 7f3429327700 1 -- 172.21.15.26:0/2476497930 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f342408b270 con 0x7f342409ce60 2023-10-01T07:54:55.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.108+0000 7f340b7fe700 1 -- 172.21.15.26:0/2476497930 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f341800f2e0 con 0x7f342409ce60 2023-10-01T07:54:55.109 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:54:55.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.109+0000 7f357badd700 1 -- 172.21.15.26:0/3210396248 >> v1:172.21.15.26:6816/126763 conn(0x7f355802f560 legacy=0x7f3558031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:55.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.109+0000 7f357badd700 1 -- 172.21.15.26:0/3210396248 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f357406a770 msgr2=0x7f357411d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:55.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.109+0000 7f357badd700 1 --2- 172.21.15.26:0/3210396248 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f357406a770 0x7f357411d890 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3570009840 tx=0x7f3570004750 comp rx=0 tx=0).stop 2023-10-01T07:54:55.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.109+0000 7f357badd700 1 -- 172.21.15.26:0/3210396248 shutdown_connections 2023-10-01T07:54:55.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.109+0000 7f357badd700 1 --2- 172.21.15.26:0/3210396248 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3574131d10 0x7f357411e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:55.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.109+0000 7f357badd700 1 --2- 172.21.15.26:0/3210396248 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f357406a770 0x7f357411d890 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:55.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.109+0000 7f357badd700 1 --2- 172.21.15.26:0/3210396248 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f357406b080 0x7f357411ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:55.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.109+0000 7f357badd700 1 -- 172.21.15.26:0/3210396248 >> 172.21.15.26:0/3210396248 conn(0x7f3574066f50 msgr2=0x7f35740a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:55.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.109+0000 7f357badd700 1 -- 172.21.15.26:0/3210396248 shutdown_connections 2023-10-01T07:54:55.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.110+0000 7f357badd700 1 -- 172.21.15.26:0/3210396248 wait complete. 2023-10-01T07:54:55.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.111+0000 7f3429327700 1 -- 172.21.15.26:0/2476497930 >> v1:172.21.15.26:6816/126763 conn(0x7f341002f510 legacy=0x7f34100319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:55.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.111+0000 7f3429327700 1 -- 172.21.15.26:0/2476497930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f342409ce60 msgr2=0x7f342412eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:55.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.111+0000 7f3429327700 1 --2- 172.21.15.26:0/2476497930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f342409ce60 0x7f342412eca0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f341800b550 tx=0x7f341800b910 comp rx=0 tx=0).stop 2023-10-01T07:54:55.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.111+0000 7f3429327700 1 -- 172.21.15.26:0/2476497930 shutdown_connections 2023-10-01T07:54:55.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.111+0000 7f3429327700 1 --2- 172.21.15.26:0/2476497930 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f342409e000 0x7f342412f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:55.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.111+0000 7f3429327700 1 --2- 172.21.15.26:0/2476497930 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3424071f40 0x7f342412e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:55.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.111+0000 7f3429327700 1 --2- 172.21.15.26:0/2476497930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f342409ce60 0x7f342412eca0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:55.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.111+0000 7f3429327700 1 -- 172.21.15.26:0/2476497930 >> 172.21.15.26:0/2476497930 conn(0x7f34240a2360 msgr2=0x7f342409ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:55.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.111+0000 7f3429327700 1 -- 172.21.15.26:0/2476497930 shutdown_connections 2023-10-01T07:54:55.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:55.111+0000 7f3429327700 1 -- 172.21.15.26:0/2476497930 wait complete. 2023-10-01T07:54:55.126 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:54:55.127 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:54:56.027 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:54:56.072 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:54:56.126 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:54:56.127 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:54:56.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.180+0000 7fe4156f8700 1 Processor -- start 2023-10-01T07:54:56.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.180+0000 7fe4156f8700 1 -- start start 2023-10-01T07:54:56.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.181+0000 7fe4156f8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe4101338a0 0x7fe410133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:56.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.181+0000 7fe4156f8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41009e930 0x7fe41013b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:56.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.181+0000 7fe4156f8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe41006ef30 con 0x7fe41009de50 2023-10-01T07:54:56.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.181+0000 7fe4156f8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41006fef0 con 0x7fe41009e930 2023-10-01T07:54:56.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.181+0000 7fe4156f8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4101334b0 con 0x7fe4101338a0 2023-10-01T07:54:56.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.181+0000 7fe40effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe4101338a0 0x7fe410133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:56.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.181+0000 7fe40effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe4101338a0 0x7fe410133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35530/0 (socket says 172.21.15.26:35530) 2023-10-01T07:54:56.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.181+0000 7fe40effd700 1 -- 172.21.15.26:0/3996542848 learned_addr learned my addr 172.21.15.26:0/3996542848 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:56.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.181+0000 7fe40f7fe700 1 --2- 172.21.15.26:0/3996542848 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41009e930 0x7fe41013b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:56.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.182+0000 7fe40effd700 1 -- 172.21.15.26:0/3996542848 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41009e930 msgr2=0x7fe41013b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:56.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.182+0000 7fe40effd700 1 --2- 172.21.15.26:0/3996542848 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41009e930 0x7fe41013b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:56.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.182+0000 7fe40effd700 1 -- 172.21.15.26:0/3996542848 >> v1:172.21.15.26:6789/0 conn(0x7fe41009de50 legacy=0x7fe41009e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:56.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.182+0000 7fe40effd700 1 -- 172.21.15.26:0/3996542848 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41006fc30 con 0x7fe4101338a0 2023-10-01T07:54:56.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.182+0000 7fe40f7fe700 1 --2- 172.21.15.26:0/3996542848 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41009e930 0x7fe41013b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:54:56.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.182+0000 7fe40effd700 1 --2- 172.21.15.26:0/3996542848 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe4101338a0 0x7fe410133c70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe400009920 tx=0x7fe400009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0edd02fb6492e7e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:56.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.182+0000 7fe40dffb700 1 -- 172.21.15.26:0/3996542848 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40000ba60 con 0x7fe4101338a0 2023-10-01T07:54:56.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.182+0000 7fe40dffb700 1 -- 172.21.15.26:0/3996542848 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40000bbc0 con 0x7fe4101338a0 2023-10-01T07:54:56.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.182+0000 7fe40dffb700 1 -- 172.21.15.26:0/3996542848 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe400009e70 con 0x7fe4101338a0 2023-10-01T07:54:56.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.183+0000 7fe4156f8700 1 -- 172.21.15.26:0/3996542848 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe4101338a0 msgr2=0x7fe410133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:56.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.183+0000 7fe4156f8700 1 --2- 172.21.15.26:0/3996542848 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe4101338a0 0x7fe410133c70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe400009920 tx=0x7fe400009c30 comp rx=0 tx=0).stop 2023-10-01T07:54:56.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.183+0000 7fe4156f8700 1 -- 172.21.15.26:0/3996542848 shutdown_connections 2023-10-01T07:54:56.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.183+0000 7fe4156f8700 1 --2- 172.21.15.26:0/3996542848 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe4101338a0 0x7fe410133c70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:56.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.183+0000 7fe4156f8700 1 --2- 172.21.15.26:0/3996542848 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41009e930 0x7fe41013b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:56.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.183+0000 7fe4156f8700 1 -- 172.21.15.26:0/3996542848 >> 172.21.15.26:0/3996542848 conn(0x7fe4100a2aa0 msgr2=0x7fe4100a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:56.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.184+0000 7fe4156f8700 1 -- 172.21.15.26:0/3996542848 shutdown_connections 2023-10-01T07:54:56.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.184+0000 7fe4156f8700 1 -- 172.21.15.26:0/3996542848 wait complete. 2023-10-01T07:54:56.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.185+0000 7fe4156f8700 1 Processor -- start 2023-10-01T07:54:56.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.185+0000 7fe4156f8700 1 -- start start 2023-10-01T07:54:56.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.186+0000 7fe4156f8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe41009de50 0x7fe41011d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:56.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.186+0000 7fe4156f8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41009e930 0x7fe41011dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:56.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.186+0000 7fe4156f8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe4101338a0 0x7fe41011e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:56.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.186+0000 7fe4156f8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41011f2e0 con 0x7fe41009de50 2023-10-01T07:54:56.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.186+0000 7fe4156f8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe410120530 con 0x7fe41009e930 2023-10-01T07:54:56.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.186+0000 7fe4156f8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe41011f8c0 con 0x7fe4101338a0 2023-10-01T07:54:56.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.186+0000 7fe40effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe41009de50 0x7fe41011d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:56.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.186+0000 7fe40effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe41009de50 0x7fe41011d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60570/0 (socket says 172.21.15.26:60570) 2023-10-01T07:54:56.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.186+0000 7fe40effd700 1 -- 172.21.15.26:0/2008146499 learned_addr learned my addr 172.21.15.26:0/2008146499 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:56.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.186+0000 7fe40e7fc700 1 --2- 172.21.15.26:0/2008146499 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41009e930 0x7fe41011dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:56.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.187+0000 7fe40f7fe700 1 --2- 172.21.15.26:0/2008146499 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe4101338a0 0x7fe41011e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:56.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.187+0000 7fe40effd700 1 -- 172.21.15.26:0/2008146499 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe4101338a0 msgr2=0x7fe41011e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:56.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.187+0000 7fe40effd700 1 --2- 172.21.15.26:0/2008146499 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe4101338a0 0x7fe41011e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:56.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.187+0000 7fe40effd700 1 -- 172.21.15.26:0/2008146499 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41009e930 msgr2=0x7fe41011dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:56.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.187+0000 7fe40effd700 1 --2- 172.21.15.26:0/2008146499 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41009e930 0x7fe41011dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:56.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.187+0000 7fe40effd700 1 -- 172.21.15.26:0/2008146499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe400009550 con 0x7fe41009de50 2023-10-01T07:54:56.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.187+0000 7fe40e7fc700 1 --2- 172.21.15.26:0/2008146499 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41009e930 0x7fe41011dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:56.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.187+0000 7fe40effd700 1 --2- 172.21.15.26:0/2008146499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe41009de50 0x7fe41011d720 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe4000098f0 tx=0x7fe400004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:56.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.187+0000 7fe3f77fe700 1 -- 172.21.15.26:0/2008146499 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe400004510 con 0x7fe41009de50 2023-10-01T07:54:56.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.187+0000 7fe3f77fe700 1 -- 172.21.15.26:0/2008146499 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4000036a0 con 0x7fe41009de50 2023-10-01T07:54:56.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.187+0000 7fe4156f8700 1 -- 172.21.15.26:0/2008146499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe410120f10 con 0x7fe41009de50 2023-10-01T07:54:56.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.187+0000 7fe3f77fe700 1 -- 172.21.15.26:0/2008146499 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe400003a30 con 0x7fe41009de50 2023-10-01T07:54:56.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.188+0000 7fe4156f8700 1 -- 172.21.15.26:0/2008146499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe41006f640 con 0x7fe41009de50 2023-10-01T07:54:56.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.188+0000 7fe3f77fe700 1 -- 172.21.15.26:0/2008146499 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe400003b90 con 0x7fe41009de50 2023-10-01T07:54:56.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.189+0000 7fe4156f8700 1 -- 172.21.15.26:0/2008146499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe41011a470 con 0x7fe41009de50 2023-10-01T07:54:56.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.189+0000 7fe3f77fe700 1 -- 172.21.15.26:0/2008146499 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fe400041160 con 0x7fe41009de50 2023-10-01T07:54:56.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.189+0000 7fe40e7fc700 1 -- 172.21.15.26:0/2008146499 >> v1:172.21.15.26:6816/126763 conn(0x7fe3fc02f540 legacy=0x7fe3fc0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:56.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.198+0000 7fe3f77fe700 1 -- 172.21.15.26:0/2008146499 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe400010380 con 0x7fe41009de50 2023-10-01T07:54:56.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.228+0000 7f4151234700 1 Processor -- start 2023-10-01T07:54:56.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.228+0000 7f4151234700 1 -- start start 2023-10-01T07:54:56.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.228+0000 7f4151234700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f414c0a0a30 0x7f414c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:56.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.228+0000 7f4151234700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f414c134170 0x7f414c13bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:56.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.228+0000 7f4151234700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f414c09edd0 con 0x7f414c0a1340 2023-10-01T07:54:56.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.228+0000 7f4151234700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f414c09e1f0 con 0x7f414c134170 2023-10-01T07:54:56.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.228+0000 7f4151234700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414c09dc50 con 0x7f414c0a0a30 2023-10-01T07:54:56.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.229+0000 7f414b59e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f414c134170 0x7f414c13bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:56.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.229+0000 7f414a59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f414c0a1340 0x7f414c133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33380/0 (socket says 172.21.15.26:33380) 2023-10-01T07:54:56.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.229+0000 7f414a59c700 1 -- 172.21.15.26:0/3074249376 learned_addr learned my addr 172.21.15.26:0/3074249376 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:56.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.229+0000 7f414b59e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f414c134170 0x7f414c13bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60574/0 (socket says 172.21.15.26:60574) 2023-10-01T07:54:56.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.229+0000 7f414ad9d700 1 --2- 172.21.15.26:0/3074249376 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f414c0a0a30 0x7f414c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:56.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.229+0000 7f414b59e700 1 -- 172.21.15.26:0/3074249376 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f414c0a0a30 msgr2=0x7f414c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:56.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.229+0000 7f414b59e700 1 --2- 172.21.15.26:0/3074249376 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f414c0a0a30 0x7f414c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:56.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.229+0000 7f414b59e700 1 -- 172.21.15.26:0/3074249376 >> v1:172.21.15.26:6789/0 conn(0x7f414c0a1340 legacy=0x7f414c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:56.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.229+0000 7f414b59e700 1 -- 172.21.15.26:0/3074249376 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414c0a1fe0 con 0x7f414c134170 2023-10-01T07:54:56.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.229+0000 7f414ad9d700 1 --2- 172.21.15.26:0/3074249376 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f414c0a0a30 0x7f414c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:54:56.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.229+0000 7f414b59e700 1 --2- 172.21.15.26:0/3074249376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f414c134170 0x7f414c13bd30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4144014a00 tx=0x7f4144014d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f9c05afba0e805 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:56.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.229+0000 7f4149d9b700 1 -- 172.21.15.26:0/3074249376 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414400fd50 con 0x7f414c134170 2023-10-01T07:54:56.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.230+0000 7f4149d9b700 1 -- 172.21.15.26:0/3074249376 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41440138e0 con 0x7f414c134170 2023-10-01T07:54:56.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.230+0000 7f4149d9b700 1 -- 172.21.15.26:0/3074249376 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4144013c90 con 0x7f414c134170 2023-10-01T07:54:56.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.230+0000 7f4151234700 1 -- 172.21.15.26:0/3074249376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f414c134170 msgr2=0x7f414c13bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:56.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.230+0000 7f4151234700 1 --2- 172.21.15.26:0/3074249376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f414c134170 0x7f414c13bd30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4144014a00 tx=0x7f4144014d10 comp rx=0 tx=0).stop 2023-10-01T07:54:56.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.231+0000 7f4151234700 1 -- 172.21.15.26:0/3074249376 shutdown_connections 2023-10-01T07:54:56.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.231+0000 7f4151234700 1 --2- 172.21.15.26:0/3074249376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f414c134170 0x7f414c13bd30 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:56.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.231+0000 7f4151234700 1 --2- 172.21.15.26:0/3074249376 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f414c0a0a30 0x7f414c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:56.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.231+0000 7f4151234700 1 -- 172.21.15.26:0/3074249376 >> 172.21.15.26:0/3074249376 conn(0x7f414c0a6550 msgr2=0x7f414c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:56.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.231+0000 7f4151234700 1 -- 172.21.15.26:0/3074249376 shutdown_connections 2023-10-01T07:54:56.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.231+0000 7f4151234700 1 -- 172.21.15.26:0/3074249376 wait complete. 2023-10-01T07:54:56.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.232+0000 7f4151234700 1 Processor -- start 2023-10-01T07:54:56.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.232+0000 7f4151234700 1 -- start start 2023-10-01T07:54:56.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.233+0000 7f4151234700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f414c0a0a30 0x7f414c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:56.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.233+0000 7f4151234700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f414c0a1340 0x7f414c11ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:56.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.233+0000 7f4151234700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f414c134170 0x7f414c11ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:56.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.233+0000 7f4151234700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414c121420 con 0x7f414c0a0a30 2023-10-01T07:54:56.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.233+0000 7f4151234700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414c11f920 con 0x7f414c0a1340 2023-10-01T07:54:56.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.233+0000 7f4151234700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f414c121fe0 con 0x7f414c134170 2023-10-01T07:54:56.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.233+0000 7f414ad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f414c0a0a30 0x7f414c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:56.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.233+0000 7f414ad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f414c0a0a30 0x7f414c11e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60588/0 (socket says 172.21.15.26:60588) 2023-10-01T07:54:56.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.233+0000 7f414ad9d700 1 -- 172.21.15.26:0/462819822 learned_addr learned my addr 172.21.15.26:0/462819822 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:56.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.233+0000 7f414b59e700 1 --2- 172.21.15.26:0/462819822 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f414c134170 0x7f414c11ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:56.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.233+0000 7f414a59c700 1 --2- 172.21.15.26:0/462819822 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f414c0a1340 0x7f414c11ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:56.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.233+0000 7f414b59e700 1 -- 172.21.15.26:0/462819822 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f414c0a1340 msgr2=0x7f414c11ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:56.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.233+0000 7f414b59e700 1 --2- 172.21.15.26:0/462819822 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f414c0a1340 0x7f414c11ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:56.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.233+0000 7f414b59e700 1 -- 172.21.15.26:0/462819822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f414c0a0a30 msgr2=0x7f414c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:56.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.233+0000 7f414b59e700 1 --2- 172.21.15.26:0/462819822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f414c0a0a30 0x7f414c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:56.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.233+0000 7f414b59e700 1 -- 172.21.15.26:0/462819822 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4144014660 con 0x7f414c134170 2023-10-01T07:54:56.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.234+0000 7f414a59c700 1 --2- 172.21.15.26:0/462819822 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f414c0a1340 0x7f414c11ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:56.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.234+0000 7f414ad9d700 1 --2- 172.21.15.26:0/462819822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f414c0a0a30 0x7f414c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:56.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.234+0000 7f414b59e700 1 --2- 172.21.15.26:0/462819822 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f414c134170 0x7f414c11ef40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f414401e000 tx=0x7f4144004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:56.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.234+0000 7f41337fe700 1 -- 172.21.15.26:0/462819822 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4144004240 con 0x7f414c134170 2023-10-01T07:54:56.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.234+0000 7f41337fe700 1 -- 172.21.15.26:0/462819822 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41440043c0 con 0x7f414c134170 2023-10-01T07:54:56.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.234+0000 7f41337fe700 1 -- 172.21.15.26:0/462819822 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4144004770 con 0x7f414c134170 2023-10-01T07:54:56.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.234+0000 7f4151234700 1 -- 172.21.15.26:0/462819822 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f414c0a4c40 con 0x7f414c134170 2023-10-01T07:54:56.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.234+0000 7f4151234700 1 -- 172.21.15.26:0/462819822 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f414c121d00 con 0x7f414c134170 2023-10-01T07:54:56.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.235+0000 7f4151234700 1 -- 172.21.15.26:0/462819822 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f414c074ea0 con 0x7f414c134170 2023-10-01T07:54:56.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.235+0000 7f41337fe700 1 -- 172.21.15.26:0/462819822 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4144023040 con 0x7f414c134170 2023-10-01T07:54:56.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.236+0000 7f414ad9d700 1 -- 172.21.15.26:0/462819822 >> v1:172.21.15.26:6816/126763 conn(0x7f413802f510 legacy=0x7f41380319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:56.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.244+0000 7f41337fe700 1 -- 172.21.15.26:0/462819822 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f414402ce10 con 0x7f414c134170 2023-10-01T07:54:56.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.245+0000 7f41337fe700 1 -- 172.21.15.26:0/462819822 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4144003e30 con 0x7f414c134170 2023-10-01T07:54:56.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.280+0000 7f2fc254c700 1 Processor -- start 2023-10-01T07:54:56.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.281+0000 7f2fc254c700 1 -- start start 2023-10-01T07:54:56.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.281+0000 7f2fc254c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2fbc09e1d0 0x7f2fbc135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:56.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.281+0000 7f2fc254c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2fbc135e50 0x7f2fbc138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:56.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.281+0000 7f2fc254c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fbc09f130 con 0x7f2fbc09d6f0 2023-10-01T07:54:56.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.281+0000 7f2fc254c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fbc09f520 con 0x7f2fbc135e50 2023-10-01T07:54:56.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.281+0000 7f2fc254c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc09e930 con 0x7f2fbc09e1d0 2023-10-01T07:54:56.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.281+0000 7f2fbb7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2fbc09e1d0 0x7f2fbc135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:56.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.281+0000 7f2fbb7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2fbc09e1d0 0x7f2fbc135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:32942/0 (socket says 172.21.15.26:32942) 2023-10-01T07:54:56.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.281+0000 7f2fbbfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2fbc09d6f0 0x7f2fbc09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33396/0 (socket says 172.21.15.26:33396) 2023-10-01T07:54:56.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.281+0000 7f2fbb7fe700 1 -- 172.21.15.26:0/4040911571 learned_addr learned my addr 172.21.15.26:0/4040911571 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:56.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.281+0000 7f2fc0ae9700 1 --2- 172.21.15.26:0/4040911571 >> v2:172.21.15.26:3300/0 conn(0x7f2fbc135e50 0x7f2fbc138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:56.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.282+0000 7f2fbb7fe700 1 -- 172.21.15.26:0/4040911571 >> v2:172.21.15.26:3300/0 conn(0x7f2fbc135e50 msgr2=0x7f2fbc138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:56.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.282+0000 7f2fbb7fe700 1 --2- 172.21.15.26:0/4040911571 >> v2:172.21.15.26:3300/0 conn(0x7f2fbc135e50 0x7f2fbc138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:56.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.282+0000 7f2fbb7fe700 1 -- 172.21.15.26:0/4040911571 >> v1:172.21.15.26:6789/0 conn(0x7f2fbc09d6f0 legacy=0x7f2fbc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:56.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.282+0000 7f2fbaffd700 1 -- 172.21.15.26:0/4040911571 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2263413338 0 0) 0x7f2fbc09f130 con 0x7f2fbc09d6f0 2023-10-01T07:54:56.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.282+0000 7f2fbb7fe700 1 -- 172.21.15.26:0/4040911571 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc09b2d0 con 0x7f2fbc09e1d0 2023-10-01T07:54:56.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.282+0000 7f2fbb7fe700 1 --2- 172.21.15.26:0/4040911571 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2fbc09e1d0 0x7f2fbc135910 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2fb000bbc0 tx=0x7f2fb000bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f41cb755c221cd65 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:56.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.282+0000 7f2fbaffd700 1 -- 172.21.15.26:0/4040911571 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb000dc30 con 0x7f2fbc09e1d0 2023-10-01T07:54:56.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.282+0000 7f2fbaffd700 1 -- 172.21.15.26:0/4040911571 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb000dd90 con 0x7f2fbc09e1d0 2023-10-01T07:54:56.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.282+0000 7f2fbaffd700 1 -- 172.21.15.26:0/4040911571 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb0012990 con 0x7f2fbc09e1d0 2023-10-01T07:54:56.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.283+0000 7f2fc254c700 1 -- 172.21.15.26:0/4040911571 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2fbc09e1d0 msgr2=0x7f2fbc135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:56.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.283+0000 7f2fc254c700 1 --2- 172.21.15.26:0/4040911571 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2fbc09e1d0 0x7f2fbc135910 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2fb000bbc0 tx=0x7f2fb000bed0 comp rx=0 tx=0).stop 2023-10-01T07:54:56.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.283+0000 7f2fc254c700 1 -- 172.21.15.26:0/4040911571 shutdown_connections 2023-10-01T07:54:56.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.283+0000 7f2fc254c700 1 --2- 172.21.15.26:0/4040911571 >> v2:172.21.15.26:3300/0 conn(0x7f2fbc135e50 0x7f2fbc138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:56.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.283+0000 7f2fc254c700 1 --2- 172.21.15.26:0/4040911571 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2fbc09e1d0 0x7f2fbc135910 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:56.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.283+0000 7f2fc254c700 1 -- 172.21.15.26:0/4040911571 >> 172.21.15.26:0/4040911571 conn(0x7f2fbc066f50 msgr2=0x7f2fbc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:56.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.283+0000 7f2fc254c700 1 -- 172.21.15.26:0/4040911571 shutdown_connections 2023-10-01T07:54:56.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.283+0000 7f2fc254c700 1 -- 172.21.15.26:0/4040911571 wait complete. 2023-10-01T07:54:56.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.285+0000 7f2fc254c700 1 Processor -- start 2023-10-01T07:54:56.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.285+0000 7f2fc254c700 1 -- start start 2023-10-01T07:54:56.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.286+0000 7f2fc254c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2fbc09d6f0 0x7f2fbc11b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:56.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.286+0000 7f2fc254c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fbc09e1d0 0x7f2fbc11b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:56.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.286+0000 7f2fc254c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2fbc135e50 0x7f2fbc11bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:56.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.286+0000 7f2fc254c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc11eda0 con 0x7f2fbc09e1d0 2023-10-01T07:54:56.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.286+0000 7f2fc254c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc072630 con 0x7f2fbc135e50 2023-10-01T07:54:56.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.286+0000 7f2fc254c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc09c700 con 0x7f2fbc09d6f0 2023-10-01T07:54:56.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.286+0000 7f2fc0ae9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2fbc135e50 0x7f2fbc11bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:56.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.286+0000 7f2fc0ae9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2fbc135e50 0x7f2fbc11bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:32944/0 (socket says 172.21.15.26:32944) 2023-10-01T07:54:56.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.286+0000 7f2fc0ae9700 1 -- 172.21.15.26:0/500391731 learned_addr learned my addr 172.21.15.26:0/500391731 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:56.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.286+0000 7f2fbbfff700 1 --2- 172.21.15.26:0/500391731 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2fbc09d6f0 0x7f2fbc11b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:56.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.286+0000 7f2fbb7fe700 1 --2- 172.21.15.26:0/500391731 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fbc09e1d0 0x7f2fbc11b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:56.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.287+0000 7f2fc0ae9700 1 -- 172.21.15.26:0/500391731 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2fbc09d6f0 msgr2=0x7f2fbc11b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:56.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.287+0000 7f2fc0ae9700 1 --2- 172.21.15.26:0/500391731 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2fbc09d6f0 0x7f2fbc11b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:56.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.287+0000 7f2fc0ae9700 1 -- 172.21.15.26:0/500391731 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fbc09e1d0 msgr2=0x7f2fbc11b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:56.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.287+0000 7f2fc0ae9700 1 --2- 172.21.15.26:0/500391731 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fbc09e1d0 0x7f2fbc11b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:56.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.287+0000 7f2fc0ae9700 1 -- 172.21.15.26:0/500391731 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb000b7f0 con 0x7f2fbc135e50 2023-10-01T07:54:56.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.287+0000 7f2fc0ae9700 1 --2- 172.21.15.26:0/500391731 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2fbc135e50 0x7f2fbc11bd00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2fb400ef90 tx=0x7f2fb400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:56.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.287+0000 7f2fb8ff9700 1 -- 172.21.15.26:0/500391731 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb400cc90 con 0x7f2fbc135e50 2023-10-01T07:54:56.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.287+0000 7f2fb8ff9700 1 -- 172.21.15.26:0/500391731 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb400f040 con 0x7f2fbc135e50 2023-10-01T07:54:56.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.287+0000 7f2fc254c700 1 -- 172.21.15.26:0/500391731 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fbc11e800 con 0x7f2fbc135e50 2023-10-01T07:54:56.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.287+0000 7f2fb8ff9700 1 -- 172.21.15.26:0/500391731 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4014480 con 0x7f2fbc135e50 2023-10-01T07:54:56.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.287+0000 7f2fc254c700 1 -- 172.21.15.26:0/500391731 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fbc11d680 con 0x7f2fbc135e50 2023-10-01T07:54:56.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.288+0000 7f2fc254c700 1 -- 172.21.15.26:0/500391731 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fbc074ea0 con 0x7f2fbc135e50 2023-10-01T07:54:56.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.289+0000 7f2fb8ff9700 1 -- 172.21.15.26:0/500391731 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2fb40145e0 con 0x7f2fbc135e50 2023-10-01T07:54:56.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.289+0000 7f2fb8ff9700 1 -- 172.21.15.26:0/500391731 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f2fb40408b0 con 0x7f2fbc135e50 2023-10-01T07:54:56.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.289+0000 7f2fbbfff700 1 -- 172.21.15.26:0/500391731 >> v1:172.21.15.26:6816/126763 conn(0x7f2fa802f510 legacy=0x7f2fa80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:56.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.298+0000 7f2fb8ff9700 1 -- 172.21.15.26:0/500391731 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2fb4007900 con 0x7f2fbc135e50 2023-10-01T07:54:56.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.318+0000 7f141c025700 1 Processor -- start 2023-10-01T07:54:56.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.318+0000 7f141c025700 1 -- start start 2023-10-01T07:54:56.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.319+0000 7f141c025700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f141409e1d0 0x7f1414138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:56.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.319+0000 7f141c025700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1414139170 0x7f141413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:56.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.319+0000 7f141c025700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f141409b120 con 0x7f141409d6f0 2023-10-01T07:54:56.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.319+0000 7f141c025700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f141406b460 con 0x7f141409e1d0 2023-10-01T07:54:56.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.319+0000 7f141c025700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141409a7e0 con 0x7f1414139170 2023-10-01T07:54:56.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.320+0000 7f14195c0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f141409e1d0 0x7f1414138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:56.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.320+0000 7f1419dc1700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f141409d6f0 0x7f141409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33408/0 (socket says 172.21.15.26:33408) 2023-10-01T07:54:56.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.320+0000 7f1419dc1700 1 -- 172.21.15.26:0/3336281069 learned_addr learned my addr 172.21.15.26:0/3336281069 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:56.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.320+0000 7f141a5c2700 1 --2- 172.21.15.26:0/3336281069 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1414139170 0x7f141413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:56.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.320+0000 7f1418dbf700 1 -- 172.21.15.26:0/3336281069 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1296145584 0 0) 0x7f141409b120 con 0x7f141409d6f0 2023-10-01T07:54:56.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.320+0000 7f14195c0700 1 -- 172.21.15.26:0/3336281069 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1414139170 msgr2=0x7f141413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:56.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.320+0000 7f14195c0700 1 --2- 172.21.15.26:0/3336281069 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1414139170 0x7f141413b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:56.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.320+0000 7f14195c0700 1 -- 172.21.15.26:0/3336281069 >> v1:172.21.15.26:6789/0 conn(0x7f141409d6f0 legacy=0x7f141409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:56.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.320+0000 7f14195c0700 1 -- 172.21.15.26:0/3336281069 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141409a500 con 0x7f141409e1d0 2023-10-01T07:54:56.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.320+0000 7f14195c0700 1 --2- 172.21.15.26:0/3336281069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f141409e1d0 0x7f1414138c30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1404009870 tx=0x7f1404009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d07e6f98f7c28b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:56.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.320+0000 7f1418dbf700 1 -- 172.21.15.26:0/3336281069 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1404011830 con 0x7f141409e1d0 2023-10-01T07:54:56.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.321+0000 7f1418dbf700 1 -- 172.21.15.26:0/3336281069 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1404011990 con 0x7f141409e1d0 2023-10-01T07:54:56.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.321+0000 7f1418dbf700 1 -- 172.21.15.26:0/3336281069 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1404011d20 con 0x7f141409e1d0 2023-10-01T07:54:56.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.321+0000 7f141c025700 1 -- 172.21.15.26:0/3336281069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f141409e1d0 msgr2=0x7f1414138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:56.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.321+0000 7f141c025700 1 --2- 172.21.15.26:0/3336281069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f141409e1d0 0x7f1414138c30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1404009870 tx=0x7f1404009b80 comp rx=0 tx=0).stop 2023-10-01T07:54:56.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.322+0000 7f141c025700 1 -- 172.21.15.26:0/3336281069 shutdown_connections 2023-10-01T07:54:56.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.322+0000 7f141c025700 1 --2- 172.21.15.26:0/3336281069 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1414139170 0x7f141413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:56.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.322+0000 7f141c025700 1 --2- 172.21.15.26:0/3336281069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f141409e1d0 0x7f1414138c30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:56.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.322+0000 7f141c025700 1 -- 172.21.15.26:0/3336281069 >> 172.21.15.26:0/3336281069 conn(0x7f1414066f50 msgr2=0x7f141409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:56.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.322+0000 7f141c025700 1 -- 172.21.15.26:0/3336281069 shutdown_connections 2023-10-01T07:54:56.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.322+0000 7f141c025700 1 -- 172.21.15.26:0/3336281069 wait complete. 2023-10-01T07:54:56.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.323+0000 7f141c025700 1 Processor -- start 2023-10-01T07:54:56.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.323+0000 7f141c025700 1 -- start start 2023-10-01T07:54:56.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.324+0000 7f141c025700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f141409d6f0 0x7f1414121750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:56.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.324+0000 7f141c025700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f141409e1d0 0x7f1414121c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:56.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.324+0000 7f141c025700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1414139170 0x7f14141221d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:56.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.324+0000 7f141c025700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141409c710 con 0x7f1414139170 2023-10-01T07:54:56.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.324+0000 7f141c025700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1414123bc0 con 0x7f141409d6f0 2023-10-01T07:54:56.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.324+0000 7f141c025700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1414137640 con 0x7f141409e1d0 2023-10-01T07:54:56.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.324+0000 7f14195c0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f141409e1d0 0x7f1414121c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:56.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.324+0000 7f14195c0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f141409e1d0 0x7f1414121c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35566/0 (socket says 172.21.15.26:35566) 2023-10-01T07:54:56.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.324+0000 7f14195c0700 1 -- 172.21.15.26:0/1114289881 learned_addr learned my addr 172.21.15.26:0/1114289881 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:56.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.324+0000 7f141a5c2700 1 --2- 172.21.15.26:0/1114289881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1414139170 0x7f14141221d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:56.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.325+0000 7f1419dc1700 1 --2- 172.21.15.26:0/1114289881 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f141409d6f0 0x7f1414121750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:56.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.325+0000 7f14195c0700 1 -- 172.21.15.26:0/1114289881 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f141409d6f0 msgr2=0x7f1414121750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:56.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.325+0000 7f14195c0700 1 --2- 172.21.15.26:0/1114289881 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f141409d6f0 0x7f1414121750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:56.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.325+0000 7f14195c0700 1 -- 172.21.15.26:0/1114289881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1414139170 msgr2=0x7f14141221d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:56.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.325+0000 7f14195c0700 1 --2- 172.21.15.26:0/1114289881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1414139170 0x7f14141221d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:56.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.325+0000 7f14195c0700 1 -- 172.21.15.26:0/1114289881 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14040094a0 con 0x7f141409e1d0 2023-10-01T07:54:56.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.325+0000 7f141a5c2700 1 --2- 172.21.15.26:0/1114289881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1414139170 0x7f14141221d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:54:56.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.325+0000 7f1419dc1700 1 --2- 172.21.15.26:0/1114289881 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f141409d6f0 0x7f1414121750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:54:56.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.325+0000 7f14195c0700 1 --2- 172.21.15.26:0/1114289881 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f141409e1d0 0x7f1414121c90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1404000c00 tx=0x7f1404004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:56.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.325+0000 7f140a7fc700 1 -- 172.21.15.26:0/1114289881 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14040036a0 con 0x7f141409e1d0 2023-10-01T07:54:56.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.325+0000 7f140a7fc700 1 -- 172.21.15.26:0/1114289881 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140401f070 con 0x7f141409e1d0 2023-10-01T07:54:56.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.325+0000 7f141c025700 1 -- 172.21.15.26:0/1114289881 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1414123400 con 0x7f141409e1d0 2023-10-01T07:54:56.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.325+0000 7f140a7fc700 1 -- 172.21.15.26:0/1114289881 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1404003a00 con 0x7f141409e1d0 2023-10-01T07:54:56.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.325+0000 7f141c025700 1 -- 172.21.15.26:0/1114289881 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1414124960 con 0x7f141409e1d0 2023-10-01T07:54:56.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.326+0000 7f140a7fc700 1 -- 172.21.15.26:0/1114289881 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1404003b60 con 0x7f141409e1d0 2023-10-01T07:54:56.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.326+0000 7f140a7fc700 1 -- 172.21.15.26:0/1114289881 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f1404021070 con 0x7f141409e1d0 2023-10-01T07:54:56.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.326+0000 7f1419dc1700 1 -- 172.21.15.26:0/1114289881 >> v1:172.21.15.26:6816/126763 conn(0x7f13f802f510 legacy=0x7f13f80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:56.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.327+0000 7f141c025700 1 -- 172.21.15.26:0/1114289881 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1414074ea0 con 0x7f141409e1d0 2023-10-01T07:54:56.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.336+0000 7f140a7fc700 1 -- 172.21.15.26:0/1114289881 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1404015020 con 0x7f141409e1d0 2023-10-01T07:54:56.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.390+0000 7fe40e7fc700 1 -- 172.21.15.26:0/2008146499 >> v1:172.21.15.26:6816/126763 conn(0x7fe3fc02f540 legacy=0x7fe3fc0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:56.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.437+0000 7f414ad9d700 1 -- 172.21.15.26:0/462819822 >> v1:172.21.15.26:6816/126763 conn(0x7f413802f510 legacy=0x7f41380319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:56.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.466+0000 7f4151234700 1 -- 172.21.15.26:0/462819822 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f414c0a28e0 con 0x7f414c134170 2023-10-01T07:54:56.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.467+0000 7f41337fe700 1 -- 172.21.15.26:0/462819822 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4144021070 con 0x7f414c134170 2023-10-01T07:54:56.467 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:54:56.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.470+0000 7f4151234700 1 -- 172.21.15.26:0/462819822 >> v1:172.21.15.26:6816/126763 conn(0x7f413802f510 legacy=0x7f41380319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:56.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.470+0000 7f4151234700 1 -- 172.21.15.26:0/462819822 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f414c134170 msgr2=0x7f414c11ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:56.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.470+0000 7f4151234700 1 --2- 172.21.15.26:0/462819822 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f414c134170 0x7f414c11ef40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f414401e000 tx=0x7f4144004ad0 comp rx=0 tx=0).stop 2023-10-01T07:54:56.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.470+0000 7f4151234700 1 -- 172.21.15.26:0/462819822 shutdown_connections 2023-10-01T07:54:56.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.470+0000 7f4151234700 1 --2- 172.21.15.26:0/462819822 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f414c134170 0x7f414c11ef40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:56.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.470+0000 7f4151234700 1 --2- 172.21.15.26:0/462819822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f414c0a0a30 0x7f414c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:56.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.470+0000 7f4151234700 1 --2- 172.21.15.26:0/462819822 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f414c0a1340 0x7f414c11ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:56.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.470+0000 7f4151234700 1 -- 172.21.15.26:0/462819822 >> 172.21.15.26:0/462819822 conn(0x7f414c0a6550 msgr2=0x7f414c09c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:56.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.470+0000 7f4151234700 1 -- 172.21.15.26:0/462819822 shutdown_connections 2023-10-01T07:54:56.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.470+0000 7f4151234700 1 -- 172.21.15.26:0/462819822 wait complete. 2023-10-01T07:54:56.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.485+0000 7fe4156f8700 1 -- 172.21.15.26:0/2008146499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe410074ea0 con 0x7fe41009de50 2023-10-01T07:54:56.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.486+0000 7fe3f77fe700 1 -- 172.21.15.26:0/2008146499 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe400015090 con 0x7fe41009de50 2023-10-01T07:54:56.486 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:54:56.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.489+0000 7fe4156f8700 1 -- 172.21.15.26:0/2008146499 >> v1:172.21.15.26:6816/126763 conn(0x7fe3fc02f540 legacy=0x7fe3fc0319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:56.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.489+0000 7fe4156f8700 1 -- 172.21.15.26:0/2008146499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe41009de50 msgr2=0x7fe41011d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:56.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.489+0000 7fe4156f8700 1 --2- 172.21.15.26:0/2008146499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe41009de50 0x7fe41011d720 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe4000098f0 tx=0x7fe400004750 comp rx=0 tx=0).stop 2023-10-01T07:54:56.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.489+0000 7fe4156f8700 1 -- 172.21.15.26:0/2008146499 shutdown_connections 2023-10-01T07:54:56.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.489+0000 7fe4156f8700 1 --2- 172.21.15.26:0/2008146499 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe4101338a0 0x7fe41011e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:56.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.489+0000 7fe4156f8700 1 --2- 172.21.15.26:0/2008146499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe41009de50 0x7fe41011d720 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:56.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.489+0000 7fe4156f8700 1 --2- 172.21.15.26:0/2008146499 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41009e930 0x7fe41011dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:56.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.489+0000 7fe4156f8700 1 -- 172.21.15.26:0/2008146499 >> 172.21.15.26:0/2008146499 conn(0x7fe4100a2aa0 msgr2=0x7fe41009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:56.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.489+0000 7fe4156f8700 1 -- 172.21.15.26:0/2008146499 shutdown_connections 2023-10-01T07:54:56.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.489+0000 7fe4156f8700 1 -- 172.21.15.26:0/2008146499 wait complete. 2023-10-01T07:54:56.491 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:54:56.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.490+0000 7f2fbbfff700 1 -- 172.21.15.26:0/500391731 >> v1:172.21.15.26:6816/126763 conn(0x7f2fa802f510 legacy=0x7f2fa80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:56.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:54:56.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.519+0000 7f2fc254c700 1 -- 172.21.15.26:0/500391731 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2fbc06c360 con 0x7f2fbc135e50 2023-10-01T07:54:56.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.521+0000 7f2fb8ff9700 1 -- 172.21.15.26:0/500391731 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2fb4009ca0 con 0x7f2fbc135e50 2023-10-01T07:54:56.522 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:54:56.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.523+0000 7f2fc254c700 1 -- 172.21.15.26:0/500391731 >> v1:172.21.15.26:6816/126763 conn(0x7f2fa802f510 legacy=0x7f2fa80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:56.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.523+0000 7f2fc254c700 1 -- 172.21.15.26:0/500391731 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2fbc135e50 msgr2=0x7f2fbc11bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:56.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.523+0000 7f2fc254c700 1 --2- 172.21.15.26:0/500391731 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2fbc135e50 0x7f2fbc11bd00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2fb400ef90 tx=0x7f2fb400c3a0 comp rx=0 tx=0).stop 2023-10-01T07:54:56.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.524+0000 7f2fc254c700 1 -- 172.21.15.26:0/500391731 shutdown_connections 2023-10-01T07:54:56.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.524+0000 7f2fc254c700 1 --2- 172.21.15.26:0/500391731 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2fbc135e50 0x7f2fbc11bd00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:56.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.524+0000 7f2fc254c700 1 --2- 172.21.15.26:0/500391731 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2fbc09d6f0 0x7f2fbc11b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:56.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.524+0000 7f2fc254c700 1 --2- 172.21.15.26:0/500391731 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fbc09e1d0 0x7f2fbc11b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:56.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.524+0000 7f2fc254c700 1 -- 172.21.15.26:0/500391731 >> 172.21.15.26:0/500391731 conn(0x7f2fbc066f50 msgr2=0x7f2fbc0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:56.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.524+0000 7f2fc254c700 1 -- 172.21.15.26:0/500391731 shutdown_connections 2023-10-01T07:54:56.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.524+0000 7f2fc254c700 1 -- 172.21.15.26:0/500391731 wait complete. 2023-10-01T07:54:56.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.527+0000 7f1419dc1700 1 -- 172.21.15.26:0/1114289881 >> v1:172.21.15.26:6816/126763 conn(0x7f13f802f510 legacy=0x7f13f80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:56.538 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:54:56.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.561+0000 7f141c025700 1 -- 172.21.15.26:0/1114289881 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1414137880 con 0x7f141409e1d0 2023-10-01T07:54:56.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.562+0000 7f140a7fc700 1 -- 172.21.15.26:0/1114289881 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1404003e10 con 0x7f141409e1d0 2023-10-01T07:54:56.563 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:54:56.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.564+0000 7f141c025700 1 -- 172.21.15.26:0/1114289881 >> v1:172.21.15.26:6816/126763 conn(0x7f13f802f510 legacy=0x7f13f80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:56.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.564+0000 7f141c025700 1 -- 172.21.15.26:0/1114289881 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f141409e1d0 msgr2=0x7f1414121c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:56.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.564+0000 7f141c025700 1 --2- 172.21.15.26:0/1114289881 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f141409e1d0 0x7f1414121c90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1404000c00 tx=0x7f1404004750 comp rx=0 tx=0).stop 2023-10-01T07:54:56.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.564+0000 7f141c025700 1 -- 172.21.15.26:0/1114289881 shutdown_connections 2023-10-01T07:54:56.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.564+0000 7f141c025700 1 --2- 172.21.15.26:0/1114289881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1414139170 0x7f14141221d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:56.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.564+0000 7f141c025700 1 --2- 172.21.15.26:0/1114289881 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f141409d6f0 0x7f1414121750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:56.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.564+0000 7f141c025700 1 --2- 172.21.15.26:0/1114289881 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f141409e1d0 0x7f1414121c90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:56.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.564+0000 7f141c025700 1 -- 172.21.15.26:0/1114289881 >> 172.21.15.26:0/1114289881 conn(0x7f1414066f50 msgr2=0x7f1414070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:56.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.564+0000 7f141c025700 1 -- 172.21.15.26:0/1114289881 shutdown_connections 2023-10-01T07:54:56.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:56.564+0000 7f141c025700 1 -- 172.21.15.26:0/1114289881 wait complete. 2023-10-01T07:54:56.578 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:54:57.492 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:54:57.505 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:54:57.539 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:54:57.578 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:54:57.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.647+0000 7f8afac54700 1 Processor -- start 2023-10-01T07:54:57.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.647+0000 7f8afac54700 1 -- start start 2023-10-01T07:54:57.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.647+0000 7f8afac54700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8af40a0a30 0x7f8af40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:57.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.647+0000 7f8afac54700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8af40a1340 0x7f8af4133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:57.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.647+0000 7f8afac54700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8af4133fa0 0x7f8af4134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:57.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.647+0000 7f8afac54700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af409edd0 con 0x7f8af40a0a30 2023-10-01T07:54:57.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.647+0000 7f8afac54700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af409e1f0 con 0x7f8af40a1340 2023-10-01T07:54:57.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.647+0000 7f8afac54700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8af409dc50 con 0x7f8af4133fa0 2023-10-01T07:54:57.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.648+0000 7f8af3fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8af40a1340 0x7f8af4133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:57.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.648+0000 7f8af3fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8af40a1340 0x7f8af4133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:32966/0 (socket says 172.21.15.26:32966) 2023-10-01T07:54:57.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.648+0000 7f8af3fff700 1 -- 172.21.15.26:0/3457819625 learned_addr learned my addr 172.21.15.26:0/3457819625 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:57.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.648+0000 7f8af89f0700 1 --2- 172.21.15.26:0/3457819625 >> v2:172.21.15.26:3300/0 conn(0x7f8af40a0a30 0x7f8af40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:57.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.648+0000 7f8af91f1700 1 --2- 172.21.15.26:0/3457819625 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8af4133fa0 0x7f8af4134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:57.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.648+0000 7f8af3fff700 1 -- 172.21.15.26:0/3457819625 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8af4133fa0 msgr2=0x7f8af4134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:57.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.648+0000 7f8af3fff700 1 --2- 172.21.15.26:0/3457819625 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8af4133fa0 0x7f8af4134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:57.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.648+0000 7f8af3fff700 1 -- 172.21.15.26:0/3457819625 >> v2:172.21.15.26:3300/0 conn(0x7f8af40a0a30 msgr2=0x7f8af40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:57.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.648+0000 7f8af3fff700 1 --2- 172.21.15.26:0/3457819625 >> v2:172.21.15.26:3300/0 conn(0x7f8af40a0a30 0x7f8af40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:57.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.648+0000 7f8af3fff700 1 -- 172.21.15.26:0/3457819625 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af40a1fe0 con 0x7f8af40a1340 2023-10-01T07:54:57.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.648+0000 7f8af3fff700 1 --2- 172.21.15.26:0/3457819625 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8af40a1340 0x7f8af4133a60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0009920 tx=0x7f8ae0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a4a4330b9d9ec32 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:57.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.648+0000 7f8af37fe700 1 -- 172.21.15.26:0/3457819625 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae0011830 con 0x7f8af40a1340 2023-10-01T07:54:57.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.649+0000 7f8af37fe700 1 -- 172.21.15.26:0/3457819625 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae0011990 con 0x7f8af40a1340 2023-10-01T07:54:57.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.649+0000 7f8af37fe700 1 -- 172.21.15.26:0/3457819625 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae0011d20 con 0x7f8af40a1340 2023-10-01T07:54:57.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.649+0000 7f8afac54700 1 -- 172.21.15.26:0/3457819625 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8af40a1340 msgr2=0x7f8af4133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:57.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.649+0000 7f8afac54700 1 --2- 172.21.15.26:0/3457819625 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8af40a1340 0x7f8af4133a60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0009920 tx=0x7f8ae0009c30 comp rx=0 tx=0).stop 2023-10-01T07:54:57.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.649+0000 7f8afac54700 1 -- 172.21.15.26:0/3457819625 shutdown_connections 2023-10-01T07:54:57.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.649+0000 7f8afac54700 1 --2- 172.21.15.26:0/3457819625 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8af4133fa0 0x7f8af4134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:57.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.649+0000 7f8afac54700 1 --2- 172.21.15.26:0/3457819625 >> v2:172.21.15.26:3300/0 conn(0x7f8af40a0a30 0x7f8af40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:57.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.649+0000 7f8afac54700 1 --2- 172.21.15.26:0/3457819625 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8af40a1340 0x7f8af4133a60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:57.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.649+0000 7f8afac54700 1 -- 172.21.15.26:0/3457819625 >> 172.21.15.26:0/3457819625 conn(0x7f8af40a6550 msgr2=0x7f8af40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:57.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.649+0000 7f8afac54700 1 -- 172.21.15.26:0/3457819625 shutdown_connections 2023-10-01T07:54:57.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.650+0000 7f8afac54700 1 -- 172.21.15.26:0/3457819625 wait complete. 2023-10-01T07:54:57.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.650+0000 7f8afac54700 1 Processor -- start 2023-10-01T07:54:57.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.651+0000 7f8afac54700 1 -- start start 2023-10-01T07:54:57.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.651+0000 7f8afac54700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8af40a0a30 0x7f8af4121430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:57.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.651+0000 7f8afac54700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8af40a1340 0x7f8af4121970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:57.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.651+0000 7f8afac54700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8af4133fa0 0x7f8af4121eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:57.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.651+0000 7f8afac54700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af40a0220 con 0x7f8af40a0a30 2023-10-01T07:54:57.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.651+0000 7f8afac54700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af40a37e0 con 0x7f8af40a1340 2023-10-01T07:54:57.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.651+0000 7f8afac54700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8af4123e60 con 0x7f8af4133fa0 2023-10-01T07:54:57.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.651+0000 7f8af89f0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8af40a0a30 0x7f8af4121430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:57.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.651+0000 7f8af89f0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8af40a0a30 0x7f8af4121430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60670/0 (socket says 172.21.15.26:60670) 2023-10-01T07:54:57.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.651+0000 7f8af89f0700 1 -- 172.21.15.26:0/3234870893 learned_addr learned my addr 172.21.15.26:0/3234870893 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:57.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.652+0000 7f8af3fff700 1 --2- 172.21.15.26:0/3234870893 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8af40a1340 0x7f8af4121970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:57.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.652+0000 7f8af91f1700 1 --2- 172.21.15.26:0/3234870893 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8af4133fa0 0x7f8af4121eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:57.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.652+0000 7f8af89f0700 1 -- 172.21.15.26:0/3234870893 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8af4133fa0 msgr2=0x7f8af4121eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:57.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.652+0000 7f8af89f0700 1 --2- 172.21.15.26:0/3234870893 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8af4133fa0 0x7f8af4121eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:57.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.652+0000 7f8af89f0700 1 -- 172.21.15.26:0/3234870893 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8af40a1340 msgr2=0x7f8af4121970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:57.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.652+0000 7f8af89f0700 1 --2- 172.21.15.26:0/3234870893 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8af40a1340 0x7f8af4121970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:57.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.652+0000 7f8af89f0700 1 -- 172.21.15.26:0/3234870893 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae0009550 con 0x7f8af40a0a30 2023-10-01T07:54:57.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.652+0000 7f8af3fff700 1 --2- 172.21.15.26:0/3234870893 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8af40a1340 0x7f8af4121970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:57.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.652+0000 7f8af89f0700 1 --2- 172.21.15.26:0/3234870893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8af40a0a30 0x7f8af4121430 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800e870 tx=0x7f8ae800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:57.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.652+0000 7f8af17fa700 1 -- 172.21.15.26:0/3234870893 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae8009590 con 0x7f8af40a0a30 2023-10-01T07:54:57.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.653+0000 7f8af17fa700 1 -- 172.21.15.26:0/3234870893 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae8013680 con 0x7f8af40a0a30 2023-10-01T07:54:57.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.653+0000 7f8afac54700 1 -- 172.21.15.26:0/3234870893 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af41246e0 con 0x7f8af40a0a30 2023-10-01T07:54:57.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.653+0000 7f8af17fa700 1 -- 172.21.15.26:0/3234870893 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae80139f0 con 0x7f8af40a0a30 2023-10-01T07:54:57.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.653+0000 7f8afac54700 1 -- 172.21.15.26:0/3234870893 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af41256e0 con 0x7f8af40a0a30 2023-10-01T07:54:57.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.654+0000 7f8af17fa700 1 -- 172.21.15.26:0/3234870893 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8ae8013b50 con 0x7f8af40a0a30 2023-10-01T07:54:57.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.654+0000 7f8af17fa700 1 -- 172.21.15.26:0/3234870893 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f8ae803fbd0 con 0x7f8af40a0a30 2023-10-01T07:54:57.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.654+0000 7f8af3fff700 1 -- 172.21.15.26:0/3234870893 >> v1:172.21.15.26:6816/126763 conn(0x7f8ad802f510 legacy=0x7f8ad80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:57.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.654+0000 7f8afac54700 1 -- 172.21.15.26:0/3234870893 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af4074ea0 con 0x7f8af40a0a30 2023-10-01T07:54:57.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.663+0000 7f8af17fa700 1 -- 172.21.15.26:0/3234870893 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ae800c970 con 0x7f8af40a0a30 2023-10-01T07:54:57.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.687+0000 7f6ff8000700 1 Processor -- start 2023-10-01T07:54:57.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.687+0000 7f6ff8000700 1 -- start start 2023-10-01T07:54:57.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.687+0000 7f6ff8000700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6ff00a0a30 0x7f6ff00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:57.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.687+0000 7f6ff8000700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6ff00a1340 0x7f6ff0133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:57.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.687+0000 7f6ff8000700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff009edd0 con 0x7f6ff0133fa0 2023-10-01T07:54:57.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.687+0000 7f6ff8000700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ff009e1f0 con 0x7f6ff00a1340 2023-10-01T07:54:57.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.688+0000 7f6ff8000700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff009dc50 con 0x7f6ff00a0a30 2023-10-01T07:54:57.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.688+0000 7f6ff559b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6ff00a1340 0x7f6ff0133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:57.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.688+0000 7f6ff659d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6ff0133fa0 0x7f6ff013ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33414/0 (socket says 172.21.15.26:33414) 2023-10-01T07:54:57.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.688+0000 7f6ff659d700 1 -- 172.21.15.26:0/2034546474 learned_addr learned my addr 172.21.15.26:0/2034546474 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:57.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.688+0000 7f6ff5d9c700 1 --2- 172.21.15.26:0/2034546474 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6ff00a0a30 0x7f6ff00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:57.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.688+0000 7f6ff4d9a700 1 -- 172.21.15.26:0/2034546474 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1165805466 0 0) 0x7f6ff009edd0 con 0x7f6ff0133fa0 2023-10-01T07:54:57.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.688+0000 7f6ff4d9a700 1 -- 172.21.15.26:0/2034546474 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fdc0035b0 con 0x7f6ff0133fa0 2023-10-01T07:54:57.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.688+0000 7f6ff5d9c700 1 -- 172.21.15.26:0/2034546474 >> v2:172.21.15.26:3300/0 conn(0x7f6ff00a1340 msgr2=0x7f6ff0133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:57.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.688+0000 7f6ff5d9c700 1 --2- 172.21.15.26:0/2034546474 >> v2:172.21.15.26:3300/0 conn(0x7f6ff00a1340 0x7f6ff0133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:57.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.688+0000 7f6ff5d9c700 1 -- 172.21.15.26:0/2034546474 >> v1:172.21.15.26:6789/0 conn(0x7f6ff0133fa0 legacy=0x7f6ff013ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:57.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.688+0000 7f6ff5d9c700 1 -- 172.21.15.26:0/2034546474 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff00a1fe0 con 0x7f6ff00a0a30 2023-10-01T07:54:57.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.688+0000 7f6ff559b700 1 --2- 172.21.15.26:0/2034546474 >> v2:172.21.15.26:3300/0 conn(0x7f6ff00a1340 0x7f6ff0133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:57.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.689+0000 7f6ff5d9c700 1 --2- 172.21.15.26:0/2034546474 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6ff00a0a30 0x7f6ff00a0e00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6fec009840 tx=0x7f6fec009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e6636b4578bf793 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:57.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.689+0000 7f6ff4d9a700 1 -- 172.21.15.26:0/2034546474 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec004230 con 0x7f6ff00a0a30 2023-10-01T07:54:57.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.689+0000 7f6ff4d9a700 1 -- 172.21.15.26:0/2034546474 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fec004390 con 0x7f6ff00a0a30 2023-10-01T07:54:57.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.689+0000 7f6ff4d9a700 1 -- 172.21.15.26:0/2034546474 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec0036a0 con 0x7f6ff00a0a30 2023-10-01T07:54:57.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.689+0000 7f6ff8000700 1 -- 172.21.15.26:0/2034546474 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6ff00a0a30 msgr2=0x7f6ff00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:57.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.689+0000 7f6ff8000700 1 --2- 172.21.15.26:0/2034546474 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6ff00a0a30 0x7f6ff00a0e00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6fec009840 tx=0x7f6fec009b50 comp rx=0 tx=0).stop 2023-10-01T07:54:57.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.690+0000 7f6ff8000700 1 -- 172.21.15.26:0/2034546474 shutdown_connections 2023-10-01T07:54:57.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.690+0000 7f6ff8000700 1 --2- 172.21.15.26:0/2034546474 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6ff00a0a30 0x7f6ff00a0e00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:57.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.690+0000 7f6ff8000700 1 --2- 172.21.15.26:0/2034546474 >> v2:172.21.15.26:3300/0 conn(0x7f6ff00a1340 0x7f6ff0133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:57.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.690+0000 7f6ff8000700 1 -- 172.21.15.26:0/2034546474 >> 172.21.15.26:0/2034546474 conn(0x7f6ff00a6550 msgr2=0x7f6ff00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:57.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.690+0000 7f6ff8000700 1 -- 172.21.15.26:0/2034546474 shutdown_connections 2023-10-01T07:54:57.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.690+0000 7f6ff8000700 1 -- 172.21.15.26:0/2034546474 wait complete. 2023-10-01T07:54:57.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.691+0000 7f6ff8000700 1 Processor -- start 2023-10-01T07:54:57.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.691+0000 7f6ff8000700 1 -- start start 2023-10-01T07:54:57.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.691+0000 7f6ff8000700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6ff00a0a30 0x7f6ff011e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:57.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.691+0000 7f6ff8000700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ff00a1340 0x7f6ff011eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:57.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.691+0000 7f6ff8000700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ff0133fa0 0x7f6ff011f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:57.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.691+0000 7f6ff8000700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff0121f50 con 0x7f6ff0133fa0 2023-10-01T07:54:57.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.692+0000 7f6ff8000700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff0122150 con 0x7f6ff00a1340 2023-10-01T07:54:57.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.692+0000 7f6ff8000700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff01218c0 con 0x7f6ff00a0a30 2023-10-01T07:54:57.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.692+0000 7f6ff559b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ff00a1340 0x7f6ff011eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:57.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.692+0000 7f6ff559b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ff00a1340 0x7f6ff011eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:32986/0 (socket says 172.21.15.26:32986) 2023-10-01T07:54:57.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.692+0000 7f6ff559b700 1 -- 172.21.15.26:0/1494391469 learned_addr learned my addr 172.21.15.26:0/1494391469 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:57.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.692+0000 7f6ff5d9c700 1 --2- 172.21.15.26:0/1494391469 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6ff00a0a30 0x7f6ff011e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:57.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.692+0000 7f6ff659d700 1 --2- 172.21.15.26:0/1494391469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ff0133fa0 0x7f6ff011f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:57.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.692+0000 7f6ff559b700 1 -- 172.21.15.26:0/1494391469 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6ff00a0a30 msgr2=0x7f6ff011e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:57.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.692+0000 7f6ff559b700 1 --2- 172.21.15.26:0/1494391469 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6ff00a0a30 0x7f6ff011e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:57.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.692+0000 7f6ff559b700 1 -- 172.21.15.26:0/1494391469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ff0133fa0 msgr2=0x7f6ff011f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:57.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.692+0000 7f6ff559b700 1 --2- 172.21.15.26:0/1494391469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ff0133fa0 0x7f6ff011f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:57.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.692+0000 7f6ff559b700 1 -- 172.21.15.26:0/1494391469 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe00094a0 con 0x7f6ff00a1340 2023-10-01T07:54:57.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.692+0000 7f6ff559b700 1 --2- 172.21.15.26:0/1494391469 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ff00a1340 0x7f6ff011eb70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6fe000ebe0 tx=0x7f6fe000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:57.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.693+0000 7f6fe67fc700 1 -- 172.21.15.26:0/1494391469 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe000c850 con 0x7f6ff00a1340 2023-10-01T07:54:57.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.693+0000 7f6fe67fc700 1 -- 172.21.15.26:0/1494391469 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe000c9b0 con 0x7f6ff00a1340 2023-10-01T07:54:57.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.693+0000 7f6fe67fc700 1 -- 172.21.15.26:0/1494391469 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe000cd20 con 0x7f6ff00a1340 2023-10-01T07:54:57.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.693+0000 7f6ff8000700 1 -- 172.21.15.26:0/1494391469 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fec0094a0 con 0x7f6ff00a1340 2023-10-01T07:54:57.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.693+0000 7f6ff8000700 1 -- 172.21.15.26:0/1494391469 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff00a0220 con 0x7f6ff00a1340 2023-10-01T07:54:57.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.694+0000 7f6fe67fc700 1 -- 172.21.15.26:0/1494391469 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6fe0013470 con 0x7f6ff00a1340 2023-10-01T07:54:57.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.694+0000 7f6fe67fc700 1 -- 172.21.15.26:0/1494391469 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f6fe003fcf0 con 0x7f6ff00a1340 2023-10-01T07:54:57.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.694+0000 7f6ff5d9c700 1 -- 172.21.15.26:0/1494391469 >> v1:172.21.15.26:6816/126763 conn(0x7f6fd402f510 legacy=0x7f6fd40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:57.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.694+0000 7f6ff8000700 1 -- 172.21.15.26:0/1494391469 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff00a1d40 con 0x7f6ff00a1340 2023-10-01T07:54:57.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.699+0000 7f6fe67fc700 1 -- 172.21.15.26:0/1494391469 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6fe0017080 con 0x7f6ff00a1340 2023-10-01T07:54:57.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.729+0000 7f69254bc700 1 Processor -- start 2023-10-01T07:54:57.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.729+0000 7f69254bc700 1 -- start start 2023-10-01T07:54:57.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.730+0000 7f69254bc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f69201338c0 0x7f6920133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:57.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.730+0000 7f69254bc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f692009e560 0x7f692013b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:57.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.730+0000 7f69254bc700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f692006f720 con 0x7f69201341d0 2023-10-01T07:54:57.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.730+0000 7f69254bc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6920070c80 con 0x7f692009e560 2023-10-01T07:54:57.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.730+0000 7f69254bc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f692006fce0 con 0x7f69201338c0 2023-10-01T07:54:57.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.730+0000 7f691effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f69201338c0 0x7f6920133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:57.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.730+0000 7f691e7fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f69201341d0 0x7f692009de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33430/0 (socket says 172.21.15.26:33430) 2023-10-01T07:54:57.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.730+0000 7f691effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f69201338c0 0x7f6920133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35600/0 (socket says 172.21.15.26:35600) 2023-10-01T07:54:57.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.730+0000 7f691e7fc700 1 -- 172.21.15.26:0/1012587288 learned_addr learned my addr 172.21.15.26:0/1012587288 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:57.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.730+0000 7f691f7fe700 1 --2- 172.21.15.26:0/1012587288 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f692009e560 0x7f692013b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:57.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.731+0000 7f691effd700 1 -- 172.21.15.26:0/1012587288 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f692009e560 msgr2=0x7f692013b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:57.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.731+0000 7f691effd700 1 --2- 172.21.15.26:0/1012587288 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f692009e560 0x7f692013b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:57.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.731+0000 7f691effd700 1 -- 172.21.15.26:0/1012587288 >> v1:172.21.15.26:6789/0 conn(0x7f69201341d0 legacy=0x7f692009de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:57.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.731+0000 7f691effd700 1 -- 172.21.15.26:0/1012587288 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69201336a0 con 0x7f69201338c0 2023-10-01T07:54:57.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.731+0000 7f691effd700 1 --2- 172.21.15.26:0/1012587288 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f69201338c0 0x7f6920133c90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6910009870 tx=0x7f6910009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=356284c3586b2512 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:57.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.731+0000 7f691dffb700 1 -- 172.21.15.26:0/1012587288 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6910004230 con 0x7f69201338c0 2023-10-01T07:54:57.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.731+0000 7f691dffb700 1 -- 172.21.15.26:0/1012587288 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6910004390 con 0x7f69201338c0 2023-10-01T07:54:57.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.731+0000 7f691dffb700 1 -- 172.21.15.26:0/1012587288 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69100036a0 con 0x7f69201338c0 2023-10-01T07:54:57.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.732+0000 7f69254bc700 1 -- 172.21.15.26:0/1012587288 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f69201338c0 msgr2=0x7f6920133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:57.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.732+0000 7f69254bc700 1 --2- 172.21.15.26:0/1012587288 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f69201338c0 0x7f6920133c90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6910009870 tx=0x7f6910009b80 comp rx=0 tx=0).stop 2023-10-01T07:54:57.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.732+0000 7f69254bc700 1 -- 172.21.15.26:0/1012587288 shutdown_connections 2023-10-01T07:54:57.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.732+0000 7f69254bc700 1 --2- 172.21.15.26:0/1012587288 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f69201338c0 0x7f6920133c90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:57.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.732+0000 7f69254bc700 1 --2- 172.21.15.26:0/1012587288 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f692009e560 0x7f692013b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:57.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.732+0000 7f69254bc700 1 -- 172.21.15.26:0/1012587288 >> 172.21.15.26:0/1012587288 conn(0x7f69200a2aa0 msgr2=0x7f69200a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:57.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.732+0000 7f69254bc700 1 -- 172.21.15.26:0/1012587288 shutdown_connections 2023-10-01T07:54:57.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.732+0000 7f69254bc700 1 -- 172.21.15.26:0/1012587288 wait complete. 2023-10-01T07:54:57.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.734+0000 7f69254bc700 1 Processor -- start 2023-10-01T07:54:57.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.734+0000 7f69254bc700 1 -- start start 2023-10-01T07:54:57.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.735+0000 7f69254bc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f692009e560 0x7f692011fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:57.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.735+0000 7f69254bc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f69201338c0 0x7f692011ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:57.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.735+0000 7f69254bc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69201341d0 0x7f69201204a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:57.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.735+0000 7f69254bc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6920123540 con 0x7f692009e560 2023-10-01T07:54:57.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.735+0000 7f69254bc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6920121630 con 0x7f69201341d0 2023-10-01T07:54:57.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.735+0000 7f69254bc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6920132260 con 0x7f69201338c0 2023-10-01T07:54:57.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.735+0000 7f691e7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f69201338c0 0x7f692011ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:57.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.735+0000 7f691effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f692009e560 0x7f692011fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:57.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.735+0000 7f691e7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f69201338c0 0x7f692011ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35612/0 (socket says 172.21.15.26:35612) 2023-10-01T07:54:57.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.735+0000 7f691effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f692009e560 0x7f692011fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60684/0 (socket says 172.21.15.26:60684) 2023-10-01T07:54:57.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.735+0000 7f691e7fc700 1 -- 172.21.15.26:0/3052348206 learned_addr learned my addr 172.21.15.26:0/3052348206 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:57.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.735+0000 7f691f7fe700 1 --2- 172.21.15.26:0/3052348206 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69201341d0 0x7f69201204a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:57.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.736+0000 7f691effd700 1 -- 172.21.15.26:0/3052348206 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f69201338c0 msgr2=0x7f692011ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:57.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.736+0000 7f691effd700 1 --2- 172.21.15.26:0/3052348206 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f69201338c0 0x7f692011ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:57.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.736+0000 7f691effd700 1 -- 172.21.15.26:0/3052348206 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69201341d0 msgr2=0x7f69201204a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:57.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.736+0000 7f691effd700 1 --2- 172.21.15.26:0/3052348206 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69201341d0 0x7f69201204a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:57.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.736+0000 7f691effd700 1 -- 172.21.15.26:0/3052348206 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69100094a0 con 0x7f692009e560 2023-10-01T07:54:57.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.736+0000 7f691f7fe700 1 --2- 172.21.15.26:0/3052348206 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69201341d0 0x7f69201204a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:57.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.736+0000 7f691effd700 1 --2- 172.21.15.26:0/3052348206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f692009e560 0x7f692011fa20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6910015000 tx=0x7f6910004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:57.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.736+0000 7f69077fe700 1 -- 172.21.15.26:0/3052348206 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6910003e60 con 0x7f692009e560 2023-10-01T07:54:57.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.736+0000 7f69077fe700 1 -- 172.21.15.26:0/3052348206 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691001f070 con 0x7f692009e560 2023-10-01T07:54:57.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.736+0000 7f69254bc700 1 -- 172.21.15.26:0/3052348206 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f692006f960 con 0x7f692009e560 2023-10-01T07:54:57.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.736+0000 7f69077fe700 1 -- 172.21.15.26:0/3052348206 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6910011850 con 0x7f692009e560 2023-10-01T07:54:57.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.736+0000 7f69254bc700 1 -- 172.21.15.26:0/3052348206 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6920120df0 con 0x7f692009e560 2023-10-01T07:54:57.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.737+0000 7f69077fe700 1 -- 172.21.15.26:0/3052348206 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f69100119b0 con 0x7f692009e560 2023-10-01T07:54:57.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.738+0000 7f69254bc700 1 -- 172.21.15.26:0/3052348206 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6920074ea0 con 0x7f692009e560 2023-10-01T07:54:57.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.738+0000 7f69077fe700 1 -- 172.21.15.26:0/3052348206 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f6910021070 con 0x7f692009e560 2023-10-01T07:54:57.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.738+0000 7f691e7fc700 1 -- 172.21.15.26:0/3052348206 >> v1:172.21.15.26:6816/126763 conn(0x7f690c02f510 legacy=0x7f690c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:57.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.748+0000 7f69077fe700 1 -- 172.21.15.26:0/3052348206 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6910024380 con 0x7f692009e560 2023-10-01T07:54:57.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.761+0000 7f2ac8d5b700 1 Processor -- start 2023-10-01T07:54:57.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.761+0000 7f2ac8d5b700 1 -- start start 2023-10-01T07:54:57.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.761+0000 7f2ac8d5b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2ac412cf60 0x7f2ac406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:57.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.762+0000 7f2ac8d5b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2ac412f8b0 0x7f2ac412fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:57.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.762+0000 7f2ac8d5b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2ac4130260 0x7f2ac4136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:57.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.762+0000 7f2ac8d5b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac412d330 con 0x7f2ac412f8b0 2023-10-01T07:54:57.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.762+0000 7f2ac8d5b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac412cd90 con 0x7f2ac4130260 2023-10-01T07:54:57.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.762+0000 7f2ac8d5b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac41306d0 con 0x7f2ac412cf60 2023-10-01T07:54:57.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.762+0000 7f2ac259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2ac412cf60 0x7f2ac406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:57.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.762+0000 7f2ac259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2ac412cf60 0x7f2ac406f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35620/0 (socket says 172.21.15.26:35620) 2023-10-01T07:54:57.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.762+0000 7f2ac259c700 1 -- 172.21.15.26:0/2767797483 learned_addr learned my addr 172.21.15.26:0/2767797483 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:57.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.762+0000 7f2ac1d9b700 1 --2- 172.21.15.26:0/2767797483 >> v2:172.21.15.26:3300/0 conn(0x7f2ac412f8b0 0x7f2ac412fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:57.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.762+0000 7f2ac2d9d700 1 --2- 172.21.15.26:0/2767797483 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2ac4130260 0x7f2ac4136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:57.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.762+0000 7f2ac259c700 1 -- 172.21.15.26:0/2767797483 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2ac4130260 msgr2=0x7f2ac4136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:57.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.762+0000 7f2ac259c700 1 --2- 172.21.15.26:0/2767797483 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2ac4130260 0x7f2ac4136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:57.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.762+0000 7f2ac259c700 1 -- 172.21.15.26:0/2767797483 >> v2:172.21.15.26:3300/0 conn(0x7f2ac412f8b0 msgr2=0x7f2ac412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:57.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.762+0000 7f2ac259c700 1 --2- 172.21.15.26:0/2767797483 >> v2:172.21.15.26:3300/0 conn(0x7f2ac412f8b0 0x7f2ac412fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:57.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.762+0000 7f2ac259c700 1 -- 172.21.15.26:0/2767797483 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac4071780 con 0x7f2ac412cf60 2023-10-01T07:54:57.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.763+0000 7f2ac259c700 1 --2- 172.21.15.26:0/2767797483 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2ac412cf60 0x7f2ac406f5d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4009920 tx=0x7f2ab4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3028d836d29a543 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:57.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.763+0000 7f2ac159a700 1 -- 172.21.15.26:0/2767797483 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4011830 con 0x7f2ac412cf60 2023-10-01T07:54:57.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.763+0000 7f2ac159a700 1 -- 172.21.15.26:0/2767797483 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab4011990 con 0x7f2ac412cf60 2023-10-01T07:54:57.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.763+0000 7f2ac159a700 1 -- 172.21.15.26:0/2767797483 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4011d20 con 0x7f2ac412cf60 2023-10-01T07:54:57.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.764+0000 7f2ac8d5b700 1 -- 172.21.15.26:0/2767797483 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2ac412cf60 msgr2=0x7f2ac406f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:57.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.764+0000 7f2ac8d5b700 1 --2- 172.21.15.26:0/2767797483 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2ac412cf60 0x7f2ac406f5d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4009920 tx=0x7f2ab4009c30 comp rx=0 tx=0).stop 2023-10-01T07:54:57.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.764+0000 7f2ac8d5b700 1 -- 172.21.15.26:0/2767797483 shutdown_connections 2023-10-01T07:54:57.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.764+0000 7f2ac8d5b700 1 --2- 172.21.15.26:0/2767797483 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2ac4130260 0x7f2ac4136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:57.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.764+0000 7f2ac8d5b700 1 --2- 172.21.15.26:0/2767797483 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2ac412cf60 0x7f2ac406f5d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:57.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.764+0000 7f2ac8d5b700 1 --2- 172.21.15.26:0/2767797483 >> v2:172.21.15.26:3300/0 conn(0x7f2ac412f8b0 0x7f2ac412fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:57.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.764+0000 7f2ac8d5b700 1 -- 172.21.15.26:0/2767797483 >> 172.21.15.26:0/2767797483 conn(0x7f2ac40a2aa0 msgr2=0x7f2ac40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:57.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.764+0000 7f2ac8d5b700 1 -- 172.21.15.26:0/2767797483 shutdown_connections 2023-10-01T07:54:57.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.764+0000 7f2ac8d5b700 1 -- 172.21.15.26:0/2767797483 wait complete. 2023-10-01T07:54:57.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.766+0000 7f2ac8d5b700 1 Processor -- start 2023-10-01T07:54:57.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.766+0000 7f2ac8d5b700 1 -- start start 2023-10-01T07:54:57.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.766+0000 7f2ac8d5b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2ac412cf60 0x7f2ac41c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:57.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.766+0000 7f2ac8d5b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2ac412f8b0 0x7f2ac41c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:57.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.766+0000 7f2ac8d5b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ac4130260 0x7f2ac41c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:57.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.767+0000 7f2ac8d5b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac41b9e90 con 0x7f2ac4130260 2023-10-01T07:54:57.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.767+0000 7f2ac8d5b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac41ba870 con 0x7f2ac412f8b0 2023-10-01T07:54:57.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.767+0000 7f2ac8d5b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac409e160 con 0x7f2ac412cf60 2023-10-01T07:54:57.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.767+0000 7f2ac259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2ac412cf60 0x7f2ac41c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:57.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.767+0000 7f2ac2d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ac4130260 0x7f2ac41c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:57.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.767+0000 7f2ac259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2ac412cf60 0x7f2ac41c8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35624/0 (socket says 172.21.15.26:35624) 2023-10-01T07:54:57.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.767+0000 7f2ac259c700 1 -- 172.21.15.26:0/3390312262 learned_addr learned my addr 172.21.15.26:0/3390312262 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:57.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.767+0000 7f2ac1d9b700 1 --2- 172.21.15.26:0/3390312262 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2ac412f8b0 0x7f2ac41c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:57.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.767+0000 7f2ac2d9d700 1 -- 172.21.15.26:0/3390312262 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2ac412cf60 msgr2=0x7f2ac41c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:57.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.767+0000 7f2ac2d9d700 1 --2- 172.21.15.26:0/3390312262 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2ac412cf60 0x7f2ac41c8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:57.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.767+0000 7f2ac2d9d700 1 -- 172.21.15.26:0/3390312262 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2ac412f8b0 msgr2=0x7f2ac41c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:57.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.767+0000 7f2ac2d9d700 1 --2- 172.21.15.26:0/3390312262 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2ac412f8b0 0x7f2ac41c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:57.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.767+0000 7f2ac2d9d700 1 -- 172.21.15.26:0/3390312262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab4009550 con 0x7f2ac4130260 2023-10-01T07:54:57.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.767+0000 7f2ac259c700 1 --2- 172.21.15.26:0/3390312262 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2ac412cf60 0x7f2ac41c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:57.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.767+0000 7f2ac1d9b700 1 --2- 172.21.15.26:0/3390312262 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2ac412f8b0 0x7f2ac41c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:54:57.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.768+0000 7f2ac2d9d700 1 --2- 172.21.15.26:0/3390312262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ac4130260 0x7f2ac41c8cf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2abc009d90 tx=0x7f2abc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:57.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.768+0000 7f2ab2ffd700 1 -- 172.21.15.26:0/3390312262 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc009c00 con 0x7f2ac4130260 2023-10-01T07:54:57.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.768+0000 7f2ab2ffd700 1 -- 172.21.15.26:0/3390312262 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2abc00f040 con 0x7f2ac4130260 2023-10-01T07:54:57.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.768+0000 7f2ab2ffd700 1 -- 172.21.15.26:0/3390312262 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc014480 con 0x7f2ac4130260 2023-10-01T07:54:57.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.768+0000 7f2ac8d5b700 1 -- 172.21.15.26:0/3390312262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac41b8d50 con 0x7f2ac4130260 2023-10-01T07:54:57.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.768+0000 7f2ac8d5b700 1 -- 172.21.15.26:0/3390312262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac41bb2e0 con 0x7f2ac4130260 2023-10-01T07:54:57.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.769+0000 7f2ac8d5b700 1 -- 172.21.15.26:0/3390312262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac4074ea0 con 0x7f2ac4130260 2023-10-01T07:54:57.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.770+0000 7f2ab2ffd700 1 -- 172.21.15.26:0/3390312262 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2abc0145e0 con 0x7f2ac4130260 2023-10-01T07:54:57.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.770+0000 7f2ab2ffd700 1 -- 172.21.15.26:0/3390312262 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f2abc040d40 con 0x7f2ac4130260 2023-10-01T07:54:57.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.770+0000 7f2ac259c700 1 -- 172.21.15.26:0/3390312262 >> v1:172.21.15.26:6816/126763 conn(0x7f2aa402f560 legacy=0x7f2aa4031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:57.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.774+0000 7f2ab2ffd700 1 -- 172.21.15.26:0/3390312262 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2abc012930 con 0x7f2ac4130260 2023-10-01T07:54:57.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.855+0000 7f8af3fff700 1 -- 172.21.15.26:0/3234870893 >> v1:172.21.15.26:6816/126763 conn(0x7f8ad802f510 legacy=0x7f8ad80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:57.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.895+0000 7f6ff5d9c700 1 -- 172.21.15.26:0/1494391469 >> v1:172.21.15.26:6816/126763 conn(0x7f6fd402f510 legacy=0x7f6fd40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:57.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.910+0000 7f6ff8000700 1 -- 172.21.15.26:0/1494391469 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6ff0074ea0 con 0x7f6ff00a1340 2023-10-01T07:54:57.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.910+0000 7f6fe67fc700 1 -- 172.21.15.26:0/1494391469 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6fe000ce80 con 0x7f6ff00a1340 2023-10-01T07:54:57.911 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:54:57.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.914+0000 7f6ff8000700 1 -- 172.21.15.26:0/1494391469 >> v1:172.21.15.26:6816/126763 conn(0x7f6fd402f510 legacy=0x7f6fd40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:57.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.914+0000 7f6ff8000700 1 -- 172.21.15.26:0/1494391469 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ff00a1340 msgr2=0x7f6ff011eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:57.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.914+0000 7f6ff8000700 1 --2- 172.21.15.26:0/1494391469 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ff00a1340 0x7f6ff011eb70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6fe000ebe0 tx=0x7f6fe000eef0 comp rx=0 tx=0).stop 2023-10-01T07:54:57.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.914+0000 7f6ff8000700 1 -- 172.21.15.26:0/1494391469 shutdown_connections 2023-10-01T07:54:57.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.914+0000 7f6ff8000700 1 --2- 172.21.15.26:0/1494391469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ff0133fa0 0x7f6ff011f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:57.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.914+0000 7f6ff8000700 1 --2- 172.21.15.26:0/1494391469 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6ff00a0a30 0x7f6ff011e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:57.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.914+0000 7f6ff8000700 1 --2- 172.21.15.26:0/1494391469 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ff00a1340 0x7f6ff011eb70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:57.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.914+0000 7f6ff8000700 1 -- 172.21.15.26:0/1494391469 >> 172.21.15.26:0/1494391469 conn(0x7f6ff00a6550 msgr2=0x7f6ff01b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:57.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.914+0000 7f6ff8000700 1 -- 172.21.15.26:0/1494391469 shutdown_connections 2023-10-01T07:54:57.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.914+0000 7f6ff8000700 1 -- 172.21.15.26:0/1494391469 wait complete. 2023-10-01T07:54:57.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:54:57.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.939+0000 7f691e7fc700 1 -- 172.21.15.26:0/3052348206 >> v1:172.21.15.26:6816/126763 conn(0x7f690c02f510 legacy=0x7f690c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:57.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.940+0000 7f8afac54700 1 -- 172.21.15.26:0/3234870893 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8af40a28e0 con 0x7f8af40a0a30 2023-10-01T07:54:57.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.940+0000 7f8af17fa700 1 -- 172.21.15.26:0/3234870893 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ae801b3b0 con 0x7f8af40a0a30 2023-10-01T07:54:57.941 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:54:57.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.944+0000 7f8afac54700 1 -- 172.21.15.26:0/3234870893 >> v1:172.21.15.26:6816/126763 conn(0x7f8ad802f510 legacy=0x7f8ad80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:57.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.944+0000 7f8afac54700 1 -- 172.21.15.26:0/3234870893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8af40a0a30 msgr2=0x7f8af4121430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:57.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.944+0000 7f8afac54700 1 --2- 172.21.15.26:0/3234870893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8af40a0a30 0x7f8af4121430 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800e870 tx=0x7f8ae800eb80 comp rx=0 tx=0).stop 2023-10-01T07:54:57.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.944+0000 7f8afac54700 1 -- 172.21.15.26:0/3234870893 shutdown_connections 2023-10-01T07:54:57.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.944+0000 7f8afac54700 1 --2- 172.21.15.26:0/3234870893 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8af4133fa0 0x7f8af4121eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:57.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.944+0000 7f8afac54700 1 --2- 172.21.15.26:0/3234870893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8af40a0a30 0x7f8af4121430 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:57.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.944+0000 7f8afac54700 1 --2- 172.21.15.26:0/3234870893 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8af40a1340 0x7f8af4121970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:57.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.944+0000 7f8afac54700 1 -- 172.21.15.26:0/3234870893 >> 172.21.15.26:0/3234870893 conn(0x7f8af40a6550 msgr2=0x7f8af40a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:57.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.944+0000 7f8afac54700 1 -- 172.21.15.26:0/3234870893 shutdown_connections 2023-10-01T07:54:57.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.944+0000 7f8afac54700 1 -- 172.21.15.26:0/3234870893 wait complete. 2023-10-01T07:54:57.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:54:57.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.971+0000 7f69254bc700 1 -- 172.21.15.26:0/3052348206 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f692006b9e0 con 0x7f692009e560 2023-10-01T07:54:57.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.971+0000 7f2ac259c700 1 -- 172.21.15.26:0/3390312262 >> v1:172.21.15.26:6816/126763 conn(0x7f2aa402f560 legacy=0x7f2aa4031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:57.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.971+0000 7f69077fe700 1 -- 172.21.15.26:0/3052348206 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6910025b40 con 0x7f692009e560 2023-10-01T07:54:57.972 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:54:57.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.973+0000 7f69254bc700 1 -- 172.21.15.26:0/3052348206 >> v1:172.21.15.26:6816/126763 conn(0x7f690c02f510 legacy=0x7f690c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:57.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.973+0000 7f69254bc700 1 -- 172.21.15.26:0/3052348206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f692009e560 msgr2=0x7f692011fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:57.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.973+0000 7f69254bc700 1 --2- 172.21.15.26:0/3052348206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f692009e560 0x7f692011fa20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6910015000 tx=0x7f6910004750 comp rx=0 tx=0).stop 2023-10-01T07:54:57.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.973+0000 7f69254bc700 1 -- 172.21.15.26:0/3052348206 shutdown_connections 2023-10-01T07:54:57.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.973+0000 7f69254bc700 1 --2- 172.21.15.26:0/3052348206 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69201341d0 0x7f69201204a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:57.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.973+0000 7f69254bc700 1 --2- 172.21.15.26:0/3052348206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f692009e560 0x7f692011fa20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:57.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.973+0000 7f69254bc700 1 --2- 172.21.15.26:0/3052348206 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f69201338c0 0x7f692011ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:57.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.973+0000 7f69254bc700 1 -- 172.21.15.26:0/3052348206 >> 172.21.15.26:0/3052348206 conn(0x7f69200a2aa0 msgr2=0x7f692009f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:57.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.973+0000 7f69254bc700 1 -- 172.21.15.26:0/3052348206 shutdown_connections 2023-10-01T07:54:57.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:57.973+0000 7f69254bc700 1 -- 172.21.15.26:0/3052348206 wait complete. 2023-10-01T07:54:57.987 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:54:58.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:58.017+0000 7f2ac8d5b700 1 -- 172.21.15.26:0/3390312262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2ac41bb730 con 0x7f2ac4130260 2023-10-01T07:54:58.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:58.017+0000 7f2ab2ffd700 1 -- 172.21.15.26:0/3390312262 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2abc02a020 con 0x7f2ac4130260 2023-10-01T07:54:58.018 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:54:58.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:58.020+0000 7f2ac8d5b700 1 -- 172.21.15.26:0/3390312262 >> v1:172.21.15.26:6816/126763 conn(0x7f2aa402f560 legacy=0x7f2aa4031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:58.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:58.020+0000 7f2ac8d5b700 1 -- 172.21.15.26:0/3390312262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ac4130260 msgr2=0x7f2ac41c8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:58.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:58.020+0000 7f2ac8d5b700 1 --2- 172.21.15.26:0/3390312262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ac4130260 0x7f2ac41c8cf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2abc009d90 tx=0x7f2abc00c3a0 comp rx=0 tx=0).stop 2023-10-01T07:54:58.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:58.020+0000 7f2ac8d5b700 1 -- 172.21.15.26:0/3390312262 shutdown_connections 2023-10-01T07:54:58.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:58.020+0000 7f2ac8d5b700 1 --2- 172.21.15.26:0/3390312262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ac4130260 0x7f2ac41c8cf0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:58.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:58.020+0000 7f2ac8d5b700 1 --2- 172.21.15.26:0/3390312262 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2ac412cf60 0x7f2ac41c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:58.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:58.020+0000 7f2ac8d5b700 1 --2- 172.21.15.26:0/3390312262 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2ac412f8b0 0x7f2ac41c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:58.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:58.020+0000 7f2ac8d5b700 1 -- 172.21.15.26:0/3390312262 >> 172.21.15.26:0/3390312262 conn(0x7f2ac40a2aa0 msgr2=0x7f2ac4129530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:58.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:58.020+0000 7f2ac8d5b700 1 -- 172.21.15.26:0/3390312262 shutdown_connections 2023-10-01T07:54:58.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:58.020+0000 7f2ac8d5b700 1 -- 172.21.15.26:0/3390312262 wait complete. 2023-10-01T07:54:58.034 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:54:58.935 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:54:58.965 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:54:58.989 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:54:59.035 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:54:59.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.089+0000 7fe66774d700 1 Processor -- start 2023-10-01T07:54:59.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.089+0000 7fe66774d700 1 -- start start 2023-10-01T07:54:59.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.089+0000 7fe66774d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe66006e570 0x7fe66006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:59.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.089+0000 7fe66774d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe66006ee80 0x7fe660134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:59.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.089+0000 7fe66774d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe660070ee0 con 0x7fe66009eca0 2023-10-01T07:54:59.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.089+0000 7fe66774d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe660071480 con 0x7fe66006ee80 2023-10-01T07:54:59.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.089+0000 7fe66774d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe660071b90 con 0x7fe66006e570 2023-10-01T07:54:59.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.090+0000 7fe6654e9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe66006e570 0x7fe66006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:59.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.090+0000 7fe6654e9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe66006e570 0x7fe66006e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35638/0 (socket says 172.21.15.26:35638) 2023-10-01T07:54:59.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.090+0000 7fe6654e9700 1 -- 172.21.15.26:0/3394396307 learned_addr learned my addr 172.21.15.26:0/3394396307 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:59.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.090+0000 7fe665cea700 1 --2- 172.21.15.26:0/3394396307 >> v2:172.21.15.26:3300/0 conn(0x7fe66006ee80 0x7fe660134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:59.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.090+0000 7fe6654e9700 1 -- 172.21.15.26:0/3394396307 >> v2:172.21.15.26:3300/0 conn(0x7fe66006ee80 msgr2=0x7fe660134d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:59.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.090+0000 7fe6654e9700 1 --2- 172.21.15.26:0/3394396307 >> v2:172.21.15.26:3300/0 conn(0x7fe66006ee80 0x7fe660134d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:59.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.090+0000 7fe6654e9700 1 -- 172.21.15.26:0/3394396307 >> v1:172.21.15.26:6789/0 conn(0x7fe66009eca0 legacy=0x7fe660134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:59.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.090+0000 7fe6654e9700 1 -- 172.21.15.26:0/3394396307 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6600711a0 con 0x7fe66006e570 2023-10-01T07:54:59.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.090+0000 7fe6654e9700 1 --2- 172.21.15.26:0/3394396307 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe66006e570 0x7fe66006e940 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe65c0098f0 tx=0x7fe65c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1572881f4ec3cf42 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:59.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.091+0000 7fe657fff700 1 -- 172.21.15.26:0/3394396307 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c011830 con 0x7fe66006e570 2023-10-01T07:54:59.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.091+0000 7fe657fff700 1 -- 172.21.15.26:0/3394396307 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65c011990 con 0x7fe66006e570 2023-10-01T07:54:59.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.091+0000 7fe657fff700 1 -- 172.21.15.26:0/3394396307 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c011d20 con 0x7fe66006e570 2023-10-01T07:54:59.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.091+0000 7fe66774d700 1 -- 172.21.15.26:0/3394396307 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe66006e570 msgr2=0x7fe66006e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:59.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.091+0000 7fe66774d700 1 --2- 172.21.15.26:0/3394396307 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe66006e570 0x7fe66006e940 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe65c0098f0 tx=0x7fe65c009c00 comp rx=0 tx=0).stop 2023-10-01T07:54:59.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.092+0000 7fe66774d700 1 -- 172.21.15.26:0/3394396307 shutdown_connections 2023-10-01T07:54:59.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.092+0000 7fe66774d700 1 --2- 172.21.15.26:0/3394396307 >> v2:172.21.15.26:3300/0 conn(0x7fe66006ee80 0x7fe660134d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:59.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.092+0000 7fe66774d700 1 --2- 172.21.15.26:0/3394396307 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe66006e570 0x7fe66006e940 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:59.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.092+0000 7fe66774d700 1 -- 172.21.15.26:0/3394396307 >> 172.21.15.26:0/3394396307 conn(0x7fe6600a2aa0 msgr2=0x7fe6600a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:59.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.092+0000 7fe66774d700 1 -- 172.21.15.26:0/3394396307 shutdown_connections 2023-10-01T07:54:59.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.092+0000 7fe66774d700 1 -- 172.21.15.26:0/3394396307 wait complete. 2023-10-01T07:54:59.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.093+0000 7fe66774d700 1 Processor -- start 2023-10-01T07:54:59.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.093+0000 7fe66774d700 1 -- start start 2023-10-01T07:54:59.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.094+0000 7fe66774d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe66006e570 0x7fe660134780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:59.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.094+0000 7fe66774d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe66006ee80 0x7fe660134cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:59.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.094+0000 7fe66774d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6601389f0 0x7fe660138e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:59.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.094+0000 7fe66774d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66009e920 con 0x7fe6601389f0 2023-10-01T07:54:59.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.094+0000 7fe66774d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe66013b4e0 con 0x7fe66006ee80 2023-10-01T07:54:59.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.094+0000 7fe66774d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe660135900 con 0x7fe66006e570 2023-10-01T07:54:59.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.094+0000 7fe6654e9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe66006e570 0x7fe660134780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:59.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.094+0000 7fe6654e9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe66006e570 0x7fe660134780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35652/0 (socket says 172.21.15.26:35652) 2023-10-01T07:54:59.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.094+0000 7fe6654e9700 1 -- 172.21.15.26:0/1352681508 learned_addr learned my addr 172.21.15.26:0/1352681508 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:59.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.094+0000 7fe665cea700 1 --2- 172.21.15.26:0/1352681508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6601389f0 0x7fe660138e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:59.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.094+0000 7fe664ce8700 1 --2- 172.21.15.26:0/1352681508 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe66006ee80 0x7fe660134cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:59.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.095+0000 7fe664ce8700 1 -- 172.21.15.26:0/1352681508 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe66006e570 msgr2=0x7fe660134780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:59.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.095+0000 7fe664ce8700 1 --2- 172.21.15.26:0/1352681508 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe66006e570 0x7fe660134780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:59.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.095+0000 7fe664ce8700 1 -- 172.21.15.26:0/1352681508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6601389f0 msgr2=0x7fe660138e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:59.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.095+0000 7fe664ce8700 1 --2- 172.21.15.26:0/1352681508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6601389f0 0x7fe660138e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:59.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.095+0000 7fe664ce8700 1 -- 172.21.15.26:0/1352681508 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65c009550 con 0x7fe66006ee80 2023-10-01T07:54:59.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.095+0000 7fe665cea700 1 --2- 172.21.15.26:0/1352681508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6601389f0 0x7fe660138e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:59.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.095+0000 7fe664ce8700 1 --2- 172.21.15.26:0/1352681508 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe66006ee80 0x7fe660134cc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe650000f60 tx=0x7fe65000c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:59.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.095+0000 7fe655ffb700 1 -- 172.21.15.26:0/1352681508 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6500050d0 con 0x7fe66006ee80 2023-10-01T07:54:59.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.095+0000 7fe655ffb700 1 -- 172.21.15.26:0/1352681508 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe650005230 con 0x7fe66006ee80 2023-10-01T07:54:59.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.095+0000 7fe655ffb700 1 -- 172.21.15.26:0/1352681508 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe650003680 con 0x7fe66006ee80 2023-10-01T07:54:59.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.095+0000 7fe66774d700 1 -- 172.21.15.26:0/1352681508 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe66009e220 con 0x7fe66006ee80 2023-10-01T07:54:59.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.096+0000 7fe66774d700 1 -- 172.21.15.26:0/1352681508 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe660139f10 con 0x7fe66006ee80 2023-10-01T07:54:59.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.097+0000 7fe655ffb700 1 -- 172.21.15.26:0/1352681508 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe6500037e0 con 0x7fe66006ee80 2023-10-01T07:54:59.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.097+0000 7fe66774d700 1 -- 172.21.15.26:0/1352681508 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe66013b110 con 0x7fe66006ee80 2023-10-01T07:54:59.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.097+0000 7fe6654e9700 1 -- 172.21.15.26:0/1352681508 >> v1:172.21.15.26:6816/126763 conn(0x7fe64402f510 legacy=0x7fe6440319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:59.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.097+0000 7fe655ffb700 1 -- 172.21.15.26:0/1352681508 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fe65001a9b0 con 0x7fe66006ee80 2023-10-01T07:54:59.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.107+0000 7fe655ffb700 1 -- 172.21.15.26:0/1352681508 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe650017030 con 0x7fe66006ee80 2023-10-01T07:54:59.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.130+0000 7fac28d10700 1 Processor -- start 2023-10-01T07:54:59.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.130+0000 7fac28d10700 1 -- start start 2023-10-01T07:54:59.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.131+0000 7fac28d10700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fac2406e570 0x7fac2406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:59.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.131+0000 7fac28d10700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac2406ee80 0x7fac24134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:59.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.131+0000 7fac28d10700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac24070ee0 con 0x7fac2409eca0 2023-10-01T07:54:59.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.131+0000 7fac28d10700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac24071480 con 0x7fac2406e570 2023-10-01T07:54:59.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.131+0000 7fac28d10700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac24071b90 con 0x7fac2406ee80 2023-10-01T07:54:59.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.131+0000 7fac2259c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fac2406e570 0x7fac2406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:59.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.131+0000 7fac2259c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fac2406e570 0x7fac2406e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60730/0 (socket says 172.21.15.26:60730) 2023-10-01T07:54:59.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.131+0000 7fac21d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fac2409eca0 0x7fac24134610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33458/0 (socket says 172.21.15.26:33458) 2023-10-01T07:54:59.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.131+0000 7fac2259c700 1 -- 172.21.15.26:0/3106487210 learned_addr learned my addr 172.21.15.26:0/3106487210 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:59.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.131+0000 7fac22d9d700 1 --2- 172.21.15.26:0/3106487210 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac2406ee80 0x7fac24134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:59.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.132+0000 7fac2259c700 1 -- 172.21.15.26:0/3106487210 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac2406ee80 msgr2=0x7fac24134d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:59.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.132+0000 7fac2259c700 1 --2- 172.21.15.26:0/3106487210 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac2406ee80 0x7fac24134d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:59.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.132+0000 7fac2259c700 1 -- 172.21.15.26:0/3106487210 >> v1:172.21.15.26:6789/0 conn(0x7fac2409eca0 legacy=0x7fac24134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:59.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.132+0000 7fac2159a700 1 -- 172.21.15.26:0/3106487210 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3887840185 0 0) 0x7fac24070ee0 con 0x7fac2409eca0 2023-10-01T07:54:59.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.132+0000 7fac2259c700 1 -- 172.21.15.26:0/3106487210 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac240711a0 con 0x7fac2406e570 2023-10-01T07:54:59.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.132+0000 7fac22d9d700 1 --2- 172.21.15.26:0/3106487210 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac2406ee80 0x7fac24134d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:59.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.132+0000 7fac2259c700 1 --2- 172.21.15.26:0/3106487210 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac2406e570 0x7fac2406e940 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fac140098f0 tx=0x7fac14009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ad7db8b57e1685 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:59.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.132+0000 7fac2159a700 1 -- 172.21.15.26:0/3106487210 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac14011830 con 0x7fac2406e570 2023-10-01T07:54:59.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.132+0000 7fac2159a700 1 -- 172.21.15.26:0/3106487210 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac14011990 con 0x7fac2406e570 2023-10-01T07:54:59.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.132+0000 7fac2159a700 1 -- 172.21.15.26:0/3106487210 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac14011d20 con 0x7fac2406e570 2023-10-01T07:54:59.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.133+0000 7fac28d10700 1 -- 172.21.15.26:0/3106487210 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac2406e570 msgr2=0x7fac2406e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:59.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.133+0000 7fac28d10700 1 --2- 172.21.15.26:0/3106487210 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac2406e570 0x7fac2406e940 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fac140098f0 tx=0x7fac14009c00 comp rx=0 tx=0).stop 2023-10-01T07:54:59.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.133+0000 7fac28d10700 1 -- 172.21.15.26:0/3106487210 shutdown_connections 2023-10-01T07:54:59.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.133+0000 7fac28d10700 1 --2- 172.21.15.26:0/3106487210 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac2406ee80 0x7fac24134d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:59.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.133+0000 7fac28d10700 1 --2- 172.21.15.26:0/3106487210 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac2406e570 0x7fac2406e940 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:59.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.133+0000 7fac28d10700 1 -- 172.21.15.26:0/3106487210 >> 172.21.15.26:0/3106487210 conn(0x7fac240a2aa0 msgr2=0x7fac240a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:59.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.133+0000 7fac28d10700 1 -- 172.21.15.26:0/3106487210 shutdown_connections 2023-10-01T07:54:59.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.133+0000 7fac28d10700 1 -- 172.21.15.26:0/3106487210 wait complete. 2023-10-01T07:54:59.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.134+0000 7fac28d10700 1 Processor -- start 2023-10-01T07:54:59.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.135+0000 7fac28d10700 1 -- start start 2023-10-01T07:54:59.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.135+0000 7fac28d10700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac2406e570 0x7fac24126690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:59.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.135+0000 7fac28d10700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac2406ee80 0x7fac24124e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:59.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.135+0000 7fac28d10700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac2413db00 0x7fac241253d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:59.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.135+0000 7fac28d10700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2413d700 con 0x7fac2406ee80 2023-10-01T07:54:59.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.135+0000 7fac28d10700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac24135800 con 0x7fac2406e570 2023-10-01T07:54:59.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.135+0000 7fac28d10700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac24070610 con 0x7fac2413db00 2023-10-01T07:54:59.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.135+0000 7fac2259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac2406e570 0x7fac24126690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:59.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.135+0000 7fac21d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac2406ee80 0x7fac24124e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:59.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.135+0000 7fac2259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac2406e570 0x7fac24126690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33044/0 (socket says 172.21.15.26:33044) 2023-10-01T07:54:59.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.135+0000 7fac2259c700 1 -- 172.21.15.26:0/2573902005 learned_addr learned my addr 172.21.15.26:0/2573902005 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:59.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.135+0000 7fac22d9d700 1 --2- 172.21.15.26:0/2573902005 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac2413db00 0x7fac241253d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:59.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.136+0000 7fac2259c700 1 -- 172.21.15.26:0/2573902005 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac2413db00 msgr2=0x7fac241253d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:59.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.136+0000 7fac2259c700 1 --2- 172.21.15.26:0/2573902005 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac2413db00 0x7fac241253d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:59.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.136+0000 7fac2259c700 1 -- 172.21.15.26:0/2573902005 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac2406ee80 msgr2=0x7fac24124e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:59.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.136+0000 7fac2259c700 1 --2- 172.21.15.26:0/2573902005 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac2406ee80 0x7fac24124e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:59.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.136+0000 7fac2259c700 1 -- 172.21.15.26:0/2573902005 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac1c009a70 con 0x7fac2406e570 2023-10-01T07:54:59.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.136+0000 7fac2259c700 1 --2- 172.21.15.26:0/2573902005 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac2406e570 0x7fac24126690 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fac14009c40 tx=0x7fac14004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:59.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.136+0000 7fac12ffd700 1 -- 172.21.15.26:0/2573902005 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac140045d0 con 0x7fac2406e570 2023-10-01T07:54:59.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.136+0000 7fac12ffd700 1 -- 172.21.15.26:0/2573902005 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1401f070 con 0x7fac2406e570 2023-10-01T07:54:59.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.136+0000 7fac12ffd700 1 -- 172.21.15.26:0/2573902005 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac140038a0 con 0x7fac2406e570 2023-10-01T07:54:59.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.136+0000 7fac28d10700 1 -- 172.21.15.26:0/2573902005 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac14009550 con 0x7fac2406e570 2023-10-01T07:54:59.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.137+0000 7fac28d10700 1 -- 172.21.15.26:0/2573902005 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac2413b6f0 con 0x7fac2406e570 2023-10-01T07:54:59.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.138+0000 7fac12ffd700 1 -- 172.21.15.26:0/2573902005 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fac14003a00 con 0x7fac2406e570 2023-10-01T07:54:59.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.138+0000 7fac12ffd700 1 -- 172.21.15.26:0/2573902005 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fac14021070 con 0x7fac2406e570 2023-10-01T07:54:59.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.138+0000 7fac21d9b700 1 -- 172.21.15.26:0/2573902005 >> v1:172.21.15.26:6816/126763 conn(0x7fac0402f540 legacy=0x7fac040319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:59.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.138+0000 7fac28d10700 1 -- 172.21.15.26:0/2573902005 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac24074ea0 con 0x7fac2406e570 2023-10-01T07:54:59.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.147+0000 7fac12ffd700 1 -- 172.21.15.26:0/2573902005 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fac14015080 con 0x7fac2406e570 2023-10-01T07:54:59.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.175+0000 7fd76d721700 1 Processor -- start 2023-10-01T07:54:59.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.175+0000 7fd76d721700 1 -- start start 2023-10-01T07:54:59.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.175+0000 7fd76d721700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd76809e930 0x7fd76809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:59.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.175+0000 7fd76d721700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd76809f240 0x7fd7681317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:59.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.175+0000 7fd76d721700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd76809f650 0x7fd768131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:59.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.175+0000 7fd76d721700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd768070940 con 0x7fd76809e930 2023-10-01T07:54:59.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.175+0000 7fd76d721700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76806fd60 con 0x7fd76809f240 2023-10-01T07:54:59.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.175+0000 7fd76d721700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd76806fa80 con 0x7fd76809f650 2023-10-01T07:54:59.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.176+0000 7fd766ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd76809e930 0x7fd76809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:59.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.176+0000 7fd766ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd76809e930 0x7fd76809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60758/0 (socket says 172.21.15.26:60758) 2023-10-01T07:54:59.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.176+0000 7fd766ffd700 1 -- 172.21.15.26:0/1683228974 learned_addr learned my addr 172.21.15.26:0/1683228974 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:59.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.176+0000 7fd7667fc700 1 --2- 172.21.15.26:0/1683228974 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd76809f240 0x7fd7681317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:59.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.176+0000 7fd7677fe700 1 --2- 172.21.15.26:0/1683228974 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd76809f650 0x7fd768131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:59.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.176+0000 7fd766ffd700 1 -- 172.21.15.26:0/1683228974 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd76809f650 msgr2=0x7fd768131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:59.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.176+0000 7fd766ffd700 1 --2- 172.21.15.26:0/1683228974 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd76809f650 0x7fd768131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:59.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.176+0000 7fd766ffd700 1 -- 172.21.15.26:0/1683228974 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd76809f240 msgr2=0x7fd7681317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:59.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.176+0000 7fd766ffd700 1 --2- 172.21.15.26:0/1683228974 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd76809f240 0x7fd7681317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:59.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.176+0000 7fd766ffd700 1 -- 172.21.15.26:0/1683228974 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76809fb60 con 0x7fd76809e930 2023-10-01T07:54:59.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.176+0000 7fd7667fc700 1 --2- 172.21.15.26:0/1683228974 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd76809f240 0x7fd7681317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:54:59.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.176+0000 7fd766ffd700 1 --2- 172.21.15.26:0/1683228974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd76809e930 0x7fd76809ed00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd7580098f0 tx=0x7fd758009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4449527f426a225a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:59.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.177+0000 7fd765ffb700 1 -- 172.21.15.26:0/1683228974 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd758011830 con 0x7fd76809e930 2023-10-01T07:54:59.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.177+0000 7fd765ffb700 1 -- 172.21.15.26:0/1683228974 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd758011990 con 0x7fd76809e930 2023-10-01T07:54:59.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.177+0000 7fd765ffb700 1 -- 172.21.15.26:0/1683228974 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd758011d20 con 0x7fd76809e930 2023-10-01T07:54:59.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.177+0000 7fd76d721700 1 -- 172.21.15.26:0/1683228974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd76809e930 msgr2=0x7fd76809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:59.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.177+0000 7fd76d721700 1 --2- 172.21.15.26:0/1683228974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd76809e930 0x7fd76809ed00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd7580098f0 tx=0x7fd758009c00 comp rx=0 tx=0).stop 2023-10-01T07:54:59.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.177+0000 7fd76d721700 1 -- 172.21.15.26:0/1683228974 shutdown_connections 2023-10-01T07:54:59.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.177+0000 7fd76d721700 1 --2- 172.21.15.26:0/1683228974 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd76809f650 0x7fd768131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:59.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.177+0000 7fd76d721700 1 --2- 172.21.15.26:0/1683228974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd76809e930 0x7fd76809ed00 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:59.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.177+0000 7fd76d721700 1 --2- 172.21.15.26:0/1683228974 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd76809f240 0x7fd7681317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:59.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.177+0000 7fd76d721700 1 -- 172.21.15.26:0/1683228974 >> 172.21.15.26:0/1683228974 conn(0x7fd7680a4210 msgr2=0x7fd7680a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:59.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.178+0000 7fd76d721700 1 -- 172.21.15.26:0/1683228974 shutdown_connections 2023-10-01T07:54:59.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.178+0000 7fd76d721700 1 -- 172.21.15.26:0/1683228974 wait complete. 2023-10-01T07:54:59.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.179+0000 7fd76d721700 1 Processor -- start 2023-10-01T07:54:59.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.179+0000 7fd76d721700 1 -- start start 2023-10-01T07:54:59.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.179+0000 7fd76d721700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd76809e930 0x7fd7681aa200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:59.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.180+0000 7fd76d721700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd76809f240 0x7fd7681aa740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:59.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.180+0000 7fd76d721700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd76809f650 0x7fd7681aac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:59.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.180+0000 7fd76d721700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7681ad400 con 0x7fd76809e930 2023-10-01T07:54:59.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.180+0000 7fd76d721700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7681abe10 con 0x7fd76809f650 2023-10-01T07:54:59.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.180+0000 7fd76d721700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7681ac6a0 con 0x7fd76809f240 2023-10-01T07:54:59.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.180+0000 7fd7677fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd76809f650 0x7fd7681aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:59.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.180+0000 7fd7677fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd76809f650 0x7fd7681aac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33068/0 (socket says 172.21.15.26:33068) 2023-10-01T07:54:59.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.180+0000 7fd7677fe700 1 -- 172.21.15.26:0/4065627584 learned_addr learned my addr 172.21.15.26:0/4065627584 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:59.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.180+0000 7fd7667fc700 1 --2- 172.21.15.26:0/4065627584 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd76809f240 0x7fd7681aa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:59.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.180+0000 7fd766ffd700 1 --2- 172.21.15.26:0/4065627584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd76809e930 0x7fd7681aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:59.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.180+0000 7fd7667fc700 1 -- 172.21.15.26:0/4065627584 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd76809f650 msgr2=0x7fd7681aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:59.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.180+0000 7fd7667fc700 1 --2- 172.21.15.26:0/4065627584 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd76809f650 0x7fd7681aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:59.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.180+0000 7fd7667fc700 1 -- 172.21.15.26:0/4065627584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd76809e930 msgr2=0x7fd7681aa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:59.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.180+0000 7fd7667fc700 1 --2- 172.21.15.26:0/4065627584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd76809e930 0x7fd7681aa200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:59.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.180+0000 7fd7667fc700 1 -- 172.21.15.26:0/4065627584 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75c00f610 con 0x7fd76809f240 2023-10-01T07:54:59.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.180+0000 7fd7667fc700 1 --2- 172.21.15.26:0/4065627584 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd76809f240 0x7fd7681aa740 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0098f0 tx=0x7fd75c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:59.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.181+0000 7fd74f7fe700 1 -- 172.21.15.26:0/4065627584 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c00c070 con 0x7fd76809f240 2023-10-01T07:54:59.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.181+0000 7fd74f7fe700 1 -- 172.21.15.26:0/4065627584 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75c004030 con 0x7fd76809f240 2023-10-01T07:54:59.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.181+0000 7fd76d721700 1 -- 172.21.15.26:0/4065627584 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd758009550 con 0x7fd76809f240 2023-10-01T07:54:59.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.181+0000 7fd74f7fe700 1 -- 172.21.15.26:0/4065627584 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c0043c0 con 0x7fd76809f240 2023-10-01T07:54:59.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.181+0000 7fd76d721700 1 -- 172.21.15.26:0/4065627584 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7680a0190 con 0x7fd76809f240 2023-10-01T07:54:59.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.182+0000 7fd74f7fe700 1 -- 172.21.15.26:0/4065627584 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd75c0036a0 con 0x7fd76809f240 2023-10-01T07:54:59.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.182+0000 7fd76d721700 1 -- 172.21.15.26:0/4065627584 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd768071d20 con 0x7fd76809f240 2023-10-01T07:54:59.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.182+0000 7fd766ffd700 1 -- 172.21.15.26:0/4065627584 >> v1:172.21.15.26:6816/126763 conn(0x7fd75402f510 legacy=0x7fd7540319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:59.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.182+0000 7fd74f7fe700 1 -- 172.21.15.26:0/4065627584 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fd75c03f120 con 0x7fd76809f240 2023-10-01T07:54:59.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.187+0000 7fd74f7fe700 1 -- 172.21.15.26:0/4065627584 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd75c00e600 con 0x7fd76809f240 2023-10-01T07:54:59.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.248+0000 7f26aeb1f700 1 Processor -- start 2023-10-01T07:54:59.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.248+0000 7f26aeb1f700 1 -- start start 2023-10-01T07:54:59.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.249+0000 7f26aeb1f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f26a80954c0 0x7f26a8095890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:59.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.249+0000 7f26aeb1f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f26a8099680 0x7f26a8099ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:59.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.249+0000 7f26aeb1f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a809c280 con 0x7f26a8099ff0 2023-10-01T07:54:59.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.249+0000 7f26aeb1f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a809aaf0 con 0x7f26a8099680 2023-10-01T07:54:59.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.249+0000 7f26aeb1f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a809b960 con 0x7f26a80954c0 2023-10-01T07:54:59.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.249+0000 7f26ad0bc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f26a8099ff0 0x7f26a8137590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33470/0 (socket says 172.21.15.26:33470) 2023-10-01T07:54:59.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.249+0000 7f26ad0bc700 1 -- 172.21.15.26:0/3049172060 learned_addr learned my addr 172.21.15.26:0/3049172060 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:54:59.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.249+0000 7f26ac8bb700 1 --2- 172.21.15.26:0/3049172060 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f26a80954c0 0x7f26a8095890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:59.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.249+0000 7f26a7fff700 1 --2- 172.21.15.26:0/3049172060 >> v2:172.21.15.26:3300/0 conn(0x7f26a8099680 0x7f26a8099ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:59.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.249+0000 7f26ac8bb700 1 -- 172.21.15.26:0/3049172060 >> v2:172.21.15.26:3300/0 conn(0x7f26a8099680 msgr2=0x7f26a8099ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:54:59.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.250+0000 7f26ac8bb700 1 --2- 172.21.15.26:0/3049172060 >> v2:172.21.15.26:3300/0 conn(0x7f26a8099680 0x7f26a8099ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:59.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.250+0000 7f26ac8bb700 1 -- 172.21.15.26:0/3049172060 >> v1:172.21.15.26:6789/0 conn(0x7f26a8099ff0 legacy=0x7f26a8137590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:59.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.250+0000 7f26ac8bb700 1 -- 172.21.15.26:0/3049172060 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a809a7b0 con 0x7f26a80954c0 2023-10-01T07:54:59.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.250+0000 7f26ac8bb700 1 --2- 172.21.15.26:0/3049172060 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f26a80954c0 0x7f26a8095890 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f269c009840 tx=0x7f269c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2367160ffc1acf6 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:59.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.250+0000 7f26a77fe700 1 -- 172.21.15.26:0/3049172060 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c011830 con 0x7f26a80954c0 2023-10-01T07:54:59.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.250+0000 7f26a77fe700 1 -- 172.21.15.26:0/3049172060 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269c011990 con 0x7f26a80954c0 2023-10-01T07:54:59.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.250+0000 7f26a77fe700 1 -- 172.21.15.26:0/3049172060 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c011d20 con 0x7f26a80954c0 2023-10-01T07:54:59.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.251+0000 7f26aeb1f700 1 -- 172.21.15.26:0/3049172060 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f26a80954c0 msgr2=0x7f26a8095890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:59.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.251+0000 7f26aeb1f700 1 --2- 172.21.15.26:0/3049172060 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f26a80954c0 0x7f26a8095890 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f269c009840 tx=0x7f269c009b50 comp rx=0 tx=0).stop 2023-10-01T07:54:59.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.251+0000 7f26aeb1f700 1 -- 172.21.15.26:0/3049172060 shutdown_connections 2023-10-01T07:54:59.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.251+0000 7f26aeb1f700 1 --2- 172.21.15.26:0/3049172060 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f26a80954c0 0x7f26a8095890 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:59.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.251+0000 7f26aeb1f700 1 --2- 172.21.15.26:0/3049172060 >> v2:172.21.15.26:3300/0 conn(0x7f26a8099680 0x7f26a8099ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:59.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.251+0000 7f26aeb1f700 1 -- 172.21.15.26:0/3049172060 >> 172.21.15.26:0/3049172060 conn(0x7f26a80a2360 msgr2=0x7f26a80a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:59.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.251+0000 7f26aeb1f700 1 -- 172.21.15.26:0/3049172060 shutdown_connections 2023-10-01T07:54:59.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.251+0000 7f26aeb1f700 1 -- 172.21.15.26:0/3049172060 wait complete. 2023-10-01T07:54:59.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.252+0000 7f26aeb1f700 1 Processor -- start 2023-10-01T07:54:59.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.252+0000 7f26aeb1f700 1 -- start start 2023-10-01T07:54:59.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.253+0000 7f26aeb1f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f26a80954c0 0x7f26a8071510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:59.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.253+0000 7f26aeb1f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f26a8099680 0x7f26a8071a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:59.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.253+0000 7f26aeb1f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26a8099ff0 0x7f26a8071f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:54:59.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.253+0000 7f26aeb1f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a8128160 con 0x7f26a8099ff0 2023-10-01T07:54:59.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.253+0000 7f26aeb1f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a8129030 con 0x7f26a8099680 2023-10-01T07:54:59.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.253+0000 7f26aeb1f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26a81277d0 con 0x7f26a80954c0 2023-10-01T07:54:59.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.253+0000 7f26ac8bb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f26a80954c0 0x7f26a8071510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:59.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.253+0000 7f26ac8bb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f26a80954c0 0x7f26a8071510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35704/0 (socket says 172.21.15.26:35704) 2023-10-01T07:54:59.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.253+0000 7f26ac8bb700 1 -- 172.21.15.26:0/3248572920 learned_addr learned my addr 172.21.15.26:0/3248572920 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:54:59.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.253+0000 7f26ad0bc700 1 --2- 172.21.15.26:0/3248572920 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26a8099ff0 0x7f26a8071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:59.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.253+0000 7f26a7fff700 1 --2- 172.21.15.26:0/3248572920 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f26a8099680 0x7f26a8071a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:54:59.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.253+0000 7f26ac8bb700 1 -- 172.21.15.26:0/3248572920 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f26a8099680 msgr2=0x7f26a8071a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:59.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.253+0000 7f26ac8bb700 1 --2- 172.21.15.26:0/3248572920 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f26a8099680 0x7f26a8071a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:59.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.253+0000 7f26ac8bb700 1 -- 172.21.15.26:0/3248572920 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26a8099ff0 msgr2=0x7f26a8071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:59.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.253+0000 7f26ac8bb700 1 --2- 172.21.15.26:0/3248572920 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26a8099ff0 0x7f26a8071f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:59.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.253+0000 7f26ac8bb700 1 -- 172.21.15.26:0/3248572920 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f269c0094a0 con 0x7f26a80954c0 2023-10-01T07:54:59.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.254+0000 7f26ac8bb700 1 --2- 172.21.15.26:0/3248572920 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f26a80954c0 0x7f26a8071510 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f269c009fd0 tx=0x7f269c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:54:59.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.254+0000 7f26a57fa700 1 -- 172.21.15.26:0/3248572920 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c0036a0 con 0x7f26a80954c0 2023-10-01T07:54:59.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.254+0000 7f26a57fa700 1 -- 172.21.15.26:0/3248572920 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269c01f070 con 0x7f26a80954c0 2023-10-01T07:54:59.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.254+0000 7f26a57fa700 1 -- 172.21.15.26:0/3248572920 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c003a60 con 0x7f26a80954c0 2023-10-01T07:54:59.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.254+0000 7f26aeb1f700 1 -- 172.21.15.26:0/3248572920 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a80a0ad0 con 0x7f26a80954c0 2023-10-01T07:54:59.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.254+0000 7f26aeb1f700 1 -- 172.21.15.26:0/3248572920 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a81295d0 con 0x7f26a80954c0 2023-10-01T07:54:59.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.255+0000 7f26a57fa700 1 -- 172.21.15.26:0/3248572920 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f269c003bc0 con 0x7f26a80954c0 2023-10-01T07:54:59.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.256+0000 7f26aeb1f700 1 -- 172.21.15.26:0/3248572920 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a809afc0 con 0x7f26a80954c0 2023-10-01T07:54:59.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.256+0000 7f26a7fff700 1 -- 172.21.15.26:0/3248572920 >> v1:172.21.15.26:6816/126763 conn(0x7f268c02f540 legacy=0x7f268c0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:59.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.256+0000 7f26a57fa700 1 -- 172.21.15.26:0/3248572920 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f269c021070 con 0x7f26a80954c0 2023-10-01T07:54:59.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.261+0000 7f26a57fa700 1 -- 172.21.15.26:0/3248572920 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f269c02f3a0 con 0x7f26a80954c0 2023-10-01T07:54:59.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.298+0000 7fe6654e9700 1 -- 172.21.15.26:0/1352681508 >> v1:172.21.15.26:6816/126763 conn(0x7fe64402f510 legacy=0x7fe6440319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:59.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.329+0000 7fe66774d700 1 -- 172.21.15.26:0/1352681508 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe660135200 con 0x7fe66006ee80 2023-10-01T07:54:59.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.330+0000 7fe655ffb700 1 -- 172.21.15.26:0/1352681508 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe650017030 con 0x7fe66006ee80 2023-10-01T07:54:59.331 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:54:59.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.332+0000 7fe66774d700 1 -- 172.21.15.26:0/1352681508 >> v1:172.21.15.26:6816/126763 conn(0x7fe64402f510 legacy=0x7fe6440319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:59.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.332+0000 7fe66774d700 1 -- 172.21.15.26:0/1352681508 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe66006ee80 msgr2=0x7fe660134cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:59.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.332+0000 7fe66774d700 1 --2- 172.21.15.26:0/1352681508 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe66006ee80 0x7fe660134cc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe650000f60 tx=0x7fe65000c730 comp rx=0 tx=0).stop 2023-10-01T07:54:59.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.332+0000 7fe66774d700 1 -- 172.21.15.26:0/1352681508 shutdown_connections 2023-10-01T07:54:59.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.332+0000 7fe66774d700 1 --2- 172.21.15.26:0/1352681508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6601389f0 0x7fe660138e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:59.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.332+0000 7fe66774d700 1 --2- 172.21.15.26:0/1352681508 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe66006e570 0x7fe660134780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:59.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.332+0000 7fe66774d700 1 --2- 172.21.15.26:0/1352681508 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe66006ee80 0x7fe660134cc0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:59.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.332+0000 7fe66774d700 1 -- 172.21.15.26:0/1352681508 >> 172.21.15.26:0/1352681508 conn(0x7fe6600a2aa0 msgr2=0x7fe6600a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:59.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.332+0000 7fe66774d700 1 -- 172.21.15.26:0/1352681508 shutdown_connections 2023-10-01T07:54:59.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.332+0000 7fe66774d700 1 -- 172.21.15.26:0/1352681508 wait complete. 2023-10-01T07:54:59.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.339+0000 7fac21d9b700 1 -- 172.21.15.26:0/2573902005 >> v1:172.21.15.26:6816/126763 conn(0x7fac0402f540 legacy=0x7fac040319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:59.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:54:59.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.383+0000 7fd766ffd700 1 -- 172.21.15.26:0/4065627584 >> v1:172.21.15.26:6816/126763 conn(0x7fd75402f510 legacy=0x7fd7540319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:59.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.399+0000 7fd76d721700 1 -- 172.21.15.26:0/4065627584 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd768074ea0 con 0x7fd76809f240 2023-10-01T07:54:59.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.399+0000 7fd74f7fe700 1 -- 172.21.15.26:0/4065627584 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd75c0163b0 con 0x7fd76809f240 2023-10-01T07:54:59.400 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:54:59.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.403+0000 7fd76d721700 1 -- 172.21.15.26:0/4065627584 >> v1:172.21.15.26:6816/126763 conn(0x7fd75402f510 legacy=0x7fd7540319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:59.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.403+0000 7fd76d721700 1 -- 172.21.15.26:0/4065627584 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd76809f240 msgr2=0x7fd7681aa740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:59.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.403+0000 7fd76d721700 1 --2- 172.21.15.26:0/4065627584 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd76809f240 0x7fd7681aa740 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0098f0 tx=0x7fd75c009c00 comp rx=0 tx=0).stop 2023-10-01T07:54:59.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.403+0000 7fd76d721700 1 -- 172.21.15.26:0/4065627584 shutdown_connections 2023-10-01T07:54:59.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.403+0000 7fd76d721700 1 --2- 172.21.15.26:0/4065627584 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd76809f650 0x7fd7681aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:59.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.403+0000 7fd76d721700 1 --2- 172.21.15.26:0/4065627584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd76809e930 0x7fd7681aa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:59.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.403+0000 7fd76d721700 1 --2- 172.21.15.26:0/4065627584 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd76809f240 0x7fd7681aa740 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:59.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.403+0000 7fd76d721700 1 -- 172.21.15.26:0/4065627584 >> 172.21.15.26:0/4065627584 conn(0x7fd7680a4210 msgr2=0x7fd7681b6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:59.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.403+0000 7fd76d721700 1 -- 172.21.15.26:0/4065627584 shutdown_connections 2023-10-01T07:54:59.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.403+0000 7fd76d721700 1 -- 172.21.15.26:0/4065627584 wait complete. 2023-10-01T07:54:59.422 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:54:59.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.428+0000 7fac28d10700 1 -- 172.21.15.26:0/2573902005 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fac24126bd0 con 0x7fac2406e570 2023-10-01T07:54:59.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.429+0000 7fac12ffd700 1 -- 172.21.15.26:0/2573902005 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fac1402b070 con 0x7fac2406e570 2023-10-01T07:54:59.429 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:54:59.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.431+0000 7fac28d10700 1 -- 172.21.15.26:0/2573902005 >> v1:172.21.15.26:6816/126763 conn(0x7fac0402f540 legacy=0x7fac040319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:59.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.431+0000 7fac28d10700 1 -- 172.21.15.26:0/2573902005 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac2406e570 msgr2=0x7fac24126690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:59.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.431+0000 7fac28d10700 1 --2- 172.21.15.26:0/2573902005 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac2406e570 0x7fac24126690 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fac14009c40 tx=0x7fac14004750 comp rx=0 tx=0).stop 2023-10-01T07:54:59.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.431+0000 7fac28d10700 1 -- 172.21.15.26:0/2573902005 shutdown_connections 2023-10-01T07:54:59.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.431+0000 7fac28d10700 1 --2- 172.21.15.26:0/2573902005 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac2413db00 0x7fac241253d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:59.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.431+0000 7fac28d10700 1 --2- 172.21.15.26:0/2573902005 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac2406e570 0x7fac24126690 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:59.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.431+0000 7fac28d10700 1 --2- 172.21.15.26:0/2573902005 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac2406ee80 0x7fac24124e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:59.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.431+0000 7fac28d10700 1 -- 172.21.15.26:0/2573902005 >> 172.21.15.26:0/2573902005 conn(0x7fac240a2aa0 msgr2=0x7fac240a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:59.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.431+0000 7fac28d10700 1 -- 172.21.15.26:0/2573902005 shutdown_connections 2023-10-01T07:54:59.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.431+0000 7fac28d10700 1 -- 172.21.15.26:0/2573902005 wait complete. 2023-10-01T07:54:59.445 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:54:59.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.457+0000 7f26a7fff700 1 -- 172.21.15.26:0/3248572920 >> v1:172.21.15.26:6816/126763 conn(0x7f268c02f540 legacy=0x7f268c0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:54:59.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.475+0000 7f26aeb1f700 1 -- 172.21.15.26:0/3248572920 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f26a8074ea0 con 0x7f26a80954c0 2023-10-01T07:54:59.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.476+0000 7f26a57fa700 1 -- 172.21.15.26:0/3248572920 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f269c015090 con 0x7f26a80954c0 2023-10-01T07:54:59.476 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:54:59.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.478+0000 7f26aeb1f700 1 -- 172.21.15.26:0/3248572920 >> v1:172.21.15.26:6816/126763 conn(0x7f268c02f540 legacy=0x7f268c0319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:54:59.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.478+0000 7f26aeb1f700 1 -- 172.21.15.26:0/3248572920 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f26a80954c0 msgr2=0x7f26a8071510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:54:59.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.478+0000 7f26aeb1f700 1 --2- 172.21.15.26:0/3248572920 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f26a80954c0 0x7f26a8071510 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f269c009fd0 tx=0x7f269c004750 comp rx=0 tx=0).stop 2023-10-01T07:54:59.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.478+0000 7f26aeb1f700 1 -- 172.21.15.26:0/3248572920 shutdown_connections 2023-10-01T07:54:59.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.478+0000 7f26aeb1f700 1 --2- 172.21.15.26:0/3248572920 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26a8099ff0 0x7f26a8071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:59.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.478+0000 7f26aeb1f700 1 --2- 172.21.15.26:0/3248572920 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f26a80954c0 0x7f26a8071510 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:59.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.478+0000 7f26aeb1f700 1 --2- 172.21.15.26:0/3248572920 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f26a8099680 0x7f26a8071a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:54:59.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.478+0000 7f26aeb1f700 1 -- 172.21.15.26:0/3248572920 >> 172.21.15.26:0/3248572920 conn(0x7f26a80a2360 msgr2=0x7f26a8130a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:54:59.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.478+0000 7f26aeb1f700 1 -- 172.21.15.26:0/3248572920 shutdown_connections 2023-10-01T07:54:59.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:54:59.478+0000 7f26aeb1f700 1 -- 172.21.15.26:0/3248572920 wait complete. 2023-10-01T07:54:59.492 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:00.348 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:00.423 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:00.447 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:00.493 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:00.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.496+0000 7f9596f8d700 1 Processor -- start 2023-10-01T07:55:00.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.497+0000 7f9596f8d700 1 -- start start 2023-10-01T07:55:00.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.497+0000 7f9596f8d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f95901338c0 0x7f9590133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:00.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.497+0000 7f9596f8d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f95901341d0 0x7f959009de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:00.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.497+0000 7f9596f8d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f959006f720 con 0x7f959009e390 2023-10-01T07:55:00.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.498+0000 7f9596f8d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9590070c80 con 0x7f95901341d0 2023-10-01T07:55:00.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.498+0000 7f9596f8d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f959006fce0 con 0x7f95901338c0 2023-10-01T07:55:00.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.498+0000 7f958ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f95901341d0 0x7f959009de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:00.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.498+0000 7f958ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f95901341d0 0x7f959009de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60780/0 (socket says 172.21.15.26:60780) 2023-10-01T07:55:00.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.498+0000 7f958ffff700 1 -- 172.21.15.26:0/1112160319 learned_addr learned my addr 172.21.15.26:0/1112160319 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:00.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.498+0000 7f9594d29700 1 --2- 172.21.15.26:0/1112160319 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f95901338c0 0x7f9590133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:00.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.498+0000 7f958ffff700 1 -- 172.21.15.26:0/1112160319 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f95901338c0 msgr2=0x7f9590133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:00.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.498+0000 7f958ffff700 1 --2- 172.21.15.26:0/1112160319 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f95901338c0 0x7f9590133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.498+0000 7f958ffff700 1 -- 172.21.15.26:0/1112160319 >> v1:172.21.15.26:6789/0 conn(0x7f959009e390 legacy=0x7f959013a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:00.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.498+0000 7f958ffff700 1 -- 172.21.15.26:0/1112160319 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95901336a0 con 0x7f95901341d0 2023-10-01T07:55:00.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.498+0000 7f958f7fe700 1 -- 172.21.15.26:0/1112160319 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4111392024 0 0) 0x7f959006f720 con 0x7f959009e390 2023-10-01T07:55:00.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.498+0000 7f958ffff700 1 --2- 172.21.15.26:0/1112160319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95901341d0 0x7f959009de50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f957c0098f0 tx=0x7f957c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0c7c643546d3bb server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:00.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.499+0000 7f958f7fe700 1 -- 172.21.15.26:0/1112160319 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c011830 con 0x7f95901341d0 2023-10-01T07:55:00.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.499+0000 7f958f7fe700 1 -- 172.21.15.26:0/1112160319 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957c011990 con 0x7f95901341d0 2023-10-01T07:55:00.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.499+0000 7f958f7fe700 1 -- 172.21.15.26:0/1112160319 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c011d20 con 0x7f95901341d0 2023-10-01T07:55:00.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.500+0000 7f9596f8d700 1 -- 172.21.15.26:0/1112160319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95901341d0 msgr2=0x7f959009de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:00.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.500+0000 7f9596f8d700 1 --2- 172.21.15.26:0/1112160319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95901341d0 0x7f959009de50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f957c0098f0 tx=0x7f957c009c00 comp rx=0 tx=0).stop 2023-10-01T07:55:00.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.500+0000 7f9596f8d700 1 -- 172.21.15.26:0/1112160319 shutdown_connections 2023-10-01T07:55:00.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.500+0000 7f9596f8d700 1 --2- 172.21.15.26:0/1112160319 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f95901338c0 0x7f9590133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.500+0000 7f9596f8d700 1 --2- 172.21.15.26:0/1112160319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95901341d0 0x7f959009de50 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.500+0000 7f9596f8d700 1 -- 172.21.15.26:0/1112160319 >> 172.21.15.26:0/1112160319 conn(0x7f95900a2aa0 msgr2=0x7f95900a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:00.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.500+0000 7f9596f8d700 1 -- 172.21.15.26:0/1112160319 shutdown_connections 2023-10-01T07:55:00.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.500+0000 7f9596f8d700 1 -- 172.21.15.26:0/1112160319 wait complete. 2023-10-01T07:55:00.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.501+0000 7f9596f8d700 1 Processor -- start 2023-10-01T07:55:00.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.501+0000 7f9596f8d700 1 -- start start 2023-10-01T07:55:00.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.502+0000 7f9596f8d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f959009e390 0x7f959011f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:00.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.502+0000 7f9596f8d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f95901338c0 0x7f959011fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:00.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.502+0000 7f9596f8d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f95901341d0 0x7f9590120170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:00.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.502+0000 7f9596f8d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9590120bc0 con 0x7f959009e390 2023-10-01T07:55:00.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.502+0000 7f9596f8d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95901231c0 con 0x7f95901341d0 2023-10-01T07:55:00.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.502+0000 7f9596f8d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9590121350 con 0x7f95901338c0 2023-10-01T07:55:00.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.503+0000 7f959552a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f95901341d0 0x7f9590120170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:00.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.503+0000 7f959552a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f95901341d0 0x7f9590120170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33104/0 (socket says 172.21.15.26:33104) 2023-10-01T07:55:00.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.503+0000 7f959552a700 1 -- 172.21.15.26:0/4259955150 learned_addr learned my addr 172.21.15.26:0/4259955150 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:00.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.503+0000 7f9594d29700 1 --2- 172.21.15.26:0/4259955150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f959009e390 0x7f959011f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:00.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.503+0000 7f958ffff700 1 --2- 172.21.15.26:0/4259955150 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f95901338c0 0x7f959011fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:00.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.503+0000 7f959552a700 1 -- 172.21.15.26:0/4259955150 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f95901338c0 msgr2=0x7f959011fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:00.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.503+0000 7f959552a700 1 --2- 172.21.15.26:0/4259955150 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f95901338c0 0x7f959011fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.503+0000 7f959552a700 1 -- 172.21.15.26:0/4259955150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f959009e390 msgr2=0x7f959011f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:00.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.503+0000 7f959552a700 1 --2- 172.21.15.26:0/4259955150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f959009e390 0x7f959011f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.503+0000 7f959552a700 1 -- 172.21.15.26:0/4259955150 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f957c009550 con 0x7f95901341d0 2023-10-01T07:55:00.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.503+0000 7f959552a700 1 --2- 172.21.15.26:0/4259955150 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f95901341d0 0x7f9590120170 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9588001560 tx=0x7f958800cb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:00.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.504+0000 7f958d7fa700 1 -- 172.21.15.26:0/4259955150 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9588003e30 con 0x7f95901341d0 2023-10-01T07:55:00.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.504+0000 7f958d7fa700 1 -- 172.21.15.26:0/4259955150 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9588005070 con 0x7f95901341d0 2023-10-01T07:55:00.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.504+0000 7f958d7fa700 1 -- 172.21.15.26:0/4259955150 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9588005420 con 0x7f95901341d0 2023-10-01T07:55:00.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.504+0000 7f9596f8d700 1 -- 172.21.15.26:0/4259955150 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9590122c20 con 0x7f95901341d0 2023-10-01T07:55:00.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.504+0000 7f9596f8d700 1 -- 172.21.15.26:0/4259955150 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f959006f960 con 0x7f95901341d0 2023-10-01T07:55:00.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.505+0000 7f958d7fa700 1 -- 172.21.15.26:0/4259955150 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9588005580 con 0x7f95901341d0 2023-10-01T07:55:00.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.505+0000 7f958d7fa700 1 -- 172.21.15.26:0/4259955150 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f958803f300 con 0x7f95901341d0 2023-10-01T07:55:00.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.505+0000 7f9594d29700 1 -- 172.21.15.26:0/4259955150 >> v1:172.21.15.26:6816/126763 conn(0x7f957402f510 legacy=0x7f95740319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:00.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.505+0000 7f9596f8d700 1 -- 172.21.15.26:0/4259955150 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f959011c480 con 0x7f95901341d0 2023-10-01T07:55:00.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.511+0000 7f958d7fa700 1 -- 172.21.15.26:0/4259955150 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9588017030 con 0x7f95901341d0 2023-10-01T07:55:00.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.572+0000 7f90e2741700 1 Processor -- start 2023-10-01T07:55:00.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.572+0000 7f90e2741700 1 -- start start 2023-10-01T07:55:00.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.572+0000 7f90e2741700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f90dc1338a0 0x7f90dc133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:00.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.572+0000 7f90e2741700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f90dc09de50 0x7f90dc09e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:00.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.572+0000 7f90e2741700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f90dc09e760 0x7f90dc13a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:00.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.572+0000 7f90e2741700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90dc06fef0 con 0x7f90dc09de50 2023-10-01T07:55:00.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.572+0000 7f90e2741700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90dc06ef30 con 0x7f90dc1338a0 2023-10-01T07:55:00.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.572+0000 7f90e2741700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90dc1334b0 con 0x7f90dc09e760 2023-10-01T07:55:00.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.573+0000 7f90dbfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f90dc1338a0 0x7f90dc133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:00.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.573+0000 7f90dbfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f90dc1338a0 0x7f90dc133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33114/0 (socket says 172.21.15.26:33114) 2023-10-01T07:55:00.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.573+0000 7f90dbfff700 1 -- 172.21.15.26:0/3848592662 learned_addr learned my addr 172.21.15.26:0/3848592662 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:00.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.573+0000 7f90db7fe700 1 --2- 172.21.15.26:0/3848592662 >> v2:172.21.15.26:3300/0 conn(0x7f90dc09de50 0x7f90dc09e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:00.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.573+0000 7f90e0cde700 1 --2- 172.21.15.26:0/3848592662 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f90dc09e760 0x7f90dc13a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:00.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.573+0000 7f90db7fe700 1 -- 172.21.15.26:0/3848592662 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f90dc09e760 msgr2=0x7f90dc13a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:00.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.573+0000 7f90db7fe700 1 --2- 172.21.15.26:0/3848592662 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f90dc09e760 0x7f90dc13a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.573+0000 7f90db7fe700 1 -- 172.21.15.26:0/3848592662 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f90dc1338a0 msgr2=0x7f90dc133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:00.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.573+0000 7f90db7fe700 1 --2- 172.21.15.26:0/3848592662 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f90dc1338a0 0x7f90dc133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.573+0000 7f90db7fe700 1 -- 172.21.15.26:0/3848592662 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90dc06fc30 con 0x7f90dc09de50 2023-10-01T07:55:00.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.573+0000 7f90dbfff700 1 --2- 172.21.15.26:0/3848592662 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f90dc1338a0 0x7f90dc133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:00.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.573+0000 7f90db7fe700 1 --2- 172.21.15.26:0/3848592662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90dc09de50 0x7f90dc09e220 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f90d0009840 tx=0x7f90d0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf23e6c89fb02f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:00.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.574+0000 7f90daffd700 1 -- 172.21.15.26:0/3848592662 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d0011830 con 0x7f90dc09de50 2023-10-01T07:55:00.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.574+0000 7f90daffd700 1 -- 172.21.15.26:0/3848592662 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d0011990 con 0x7f90dc09de50 2023-10-01T07:55:00.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.574+0000 7f90daffd700 1 -- 172.21.15.26:0/3848592662 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d0011d20 con 0x7f90dc09de50 2023-10-01T07:55:00.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.574+0000 7f90e2741700 1 -- 172.21.15.26:0/3848592662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90dc09de50 msgr2=0x7f90dc09e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:00.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.574+0000 7f90e2741700 1 --2- 172.21.15.26:0/3848592662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90dc09de50 0x7f90dc09e220 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f90d0009840 tx=0x7f90d0009b50 comp rx=0 tx=0).stop 2023-10-01T07:55:00.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.574+0000 7f90e2741700 1 -- 172.21.15.26:0/3848592662 shutdown_connections 2023-10-01T07:55:00.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.574+0000 7f90e2741700 1 --2- 172.21.15.26:0/3848592662 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f90dc09e760 0x7f90dc13a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.574+0000 7f90e2741700 1 --2- 172.21.15.26:0/3848592662 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f90dc1338a0 0x7f90dc133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.574+0000 7f90e2741700 1 --2- 172.21.15.26:0/3848592662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90dc09de50 0x7f90dc09e220 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.574+0000 7f90e2741700 1 -- 172.21.15.26:0/3848592662 >> 172.21.15.26:0/3848592662 conn(0x7f90dc0a2aa0 msgr2=0x7f90dc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:00.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.575+0000 7f90e2741700 1 -- 172.21.15.26:0/3848592662 shutdown_connections 2023-10-01T07:55:00.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.575+0000 7f90e2741700 1 -- 172.21.15.26:0/3848592662 wait complete. 2023-10-01T07:55:00.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.576+0000 7f90e2741700 1 Processor -- start 2023-10-01T07:55:00.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.576+0000 7f90e2741700 1 -- start start 2023-10-01T07:55:00.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.577+0000 7f90e2741700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f90dc09de50 0x7f90dc11ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:00.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.577+0000 7f90e2741700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f90dc09e760 0x7f90dc11f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:00.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.577+0000 7f90e2741700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90dc1338a0 0x7f90dc11f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:00.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.577+0000 7f90e2741700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90dc122760 con 0x7f90dc1338a0 2023-10-01T07:55:00.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.577+0000 7f90e2741700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90dc06f640 con 0x7f90dc09e760 2023-10-01T07:55:00.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.577+0000 7f90e2741700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90dc1208f0 con 0x7f90dc09de50 2023-10-01T07:55:00.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.577+0000 7f90dbfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f90dc09de50 0x7f90dc11ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:00.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.577+0000 7f90dbfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f90dc09de50 0x7f90dc11ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35720/0 (socket says 172.21.15.26:35720) 2023-10-01T07:55:00.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.577+0000 7f90dbfff700 1 -- 172.21.15.26:0/1791685727 learned_addr learned my addr 172.21.15.26:0/1791685727 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:00.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.577+0000 7f90e0cde700 1 --2- 172.21.15.26:0/1791685727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90dc1338a0 0x7f90dc11f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:00.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.577+0000 7f90db7fe700 1 --2- 172.21.15.26:0/1791685727 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f90dc09e760 0x7f90dc11f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:00.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.578+0000 7f90dbfff700 1 -- 172.21.15.26:0/1791685727 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f90dc09e760 msgr2=0x7f90dc11f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:00.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.578+0000 7f90dbfff700 1 --2- 172.21.15.26:0/1791685727 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f90dc09e760 0x7f90dc11f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.578+0000 7f90dbfff700 1 -- 172.21.15.26:0/1791685727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90dc1338a0 msgr2=0x7f90dc11f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:00.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.578+0000 7f90dbfff700 1 --2- 172.21.15.26:0/1791685727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90dc1338a0 0x7f90dc11f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.578+0000 7f90dbfff700 1 -- 172.21.15.26:0/1791685727 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90cc009550 con 0x7f90dc09de50 2023-10-01T07:55:00.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.578+0000 7f90dbfff700 1 --2- 172.21.15.26:0/1791685727 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f90dc09de50 0x7f90dc11ec40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f90cc00ebe0 tx=0x7f90cc00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:00.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.578+0000 7f90d8ff9700 1 -- 172.21.15.26:0/1791685727 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90cc00c850 con 0x7f90dc09de50 2023-10-01T07:55:00.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.578+0000 7f90d8ff9700 1 -- 172.21.15.26:0/1791685727 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90cc00c9b0 con 0x7f90dc09de50 2023-10-01T07:55:00.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.578+0000 7f90e2741700 1 -- 172.21.15.26:0/1791685727 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d00094a0 con 0x7f90dc09de50 2023-10-01T07:55:00.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.578+0000 7f90d8ff9700 1 -- 172.21.15.26:0/1791685727 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90cc00cd20 con 0x7f90dc09de50 2023-10-01T07:55:00.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.578+0000 7f90e2741700 1 -- 172.21.15.26:0/1791685727 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90dc120010 con 0x7f90dc09de50 2023-10-01T07:55:00.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.580+0000 7f90d8ff9700 1 -- 172.21.15.26:0/1791685727 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f90cc013470 con 0x7f90dc09de50 2023-10-01T07:55:00.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.580+0000 7f90e2741700 1 -- 172.21.15.26:0/1791685727 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90dc1223a0 con 0x7f90dc09de50 2023-10-01T07:55:00.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.580+0000 7f90d8ff9700 1 -- 172.21.15.26:0/1791685727 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f90cc03f980 con 0x7f90dc09de50 2023-10-01T07:55:00.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.580+0000 7f90db7fe700 1 -- 172.21.15.26:0/1791685727 >> v1:172.21.15.26:6816/126763 conn(0x7f90c802f510 legacy=0x7f90c80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:00.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.585+0000 7f90d8ff9700 1 -- 172.21.15.26:0/1791685727 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f90cc0102b0 con 0x7f90dc09de50 2023-10-01T07:55:00.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.614+0000 7fd0412de700 1 Processor -- start 2023-10-01T07:55:00.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.614+0000 7fd0412de700 1 -- start start 2023-10-01T07:55:00.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.614+0000 7fd0412de700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd03c12cf60 0x7fd03c06f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:00.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.614+0000 7fd0412de700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd03c12f8b0 0x7fd03c12fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:00.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.614+0000 7fd0412de700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd03c130260 0x7fd03c136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:00.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.614+0000 7fd0412de700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd03c12d330 con 0x7fd03c130260 2023-10-01T07:55:00.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.614+0000 7fd0412de700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd03c12cd90 con 0x7fd03c12cf60 2023-10-01T07:55:00.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.614+0000 7fd0412de700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd03c1306d0 con 0x7fd03c12f8b0 2023-10-01T07:55:00.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.615+0000 7fd03a7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd03c12f8b0 0x7fd03c12fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:00.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.615+0000 7fd03a7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd03c12f8b0 0x7fd03c12fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35722/0 (socket says 172.21.15.26:35722) 2023-10-01T07:55:00.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.615+0000 7fd03a7fc700 1 -- 172.21.15.26:0/886998287 learned_addr learned my addr 172.21.15.26:0/886998287 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:00.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.615+0000 7fd03affd700 1 --2- 172.21.15.26:0/886998287 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd03c12cf60 0x7fd03c06f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:00.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.615+0000 7fd03b7fe700 1 --2- 172.21.15.26:0/886998287 >> v2:172.21.15.26:3300/0 conn(0x7fd03c130260 0x7fd03c136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:00.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.615+0000 7fd03a7fc700 1 -- 172.21.15.26:0/886998287 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd03c12cf60 msgr2=0x7fd03c06f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:00.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.615+0000 7fd03a7fc700 1 --2- 172.21.15.26:0/886998287 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd03c12cf60 0x7fd03c06f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.615+0000 7fd03a7fc700 1 -- 172.21.15.26:0/886998287 >> v2:172.21.15.26:3300/0 conn(0x7fd03c130260 msgr2=0x7fd03c136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:00.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.615+0000 7fd03a7fc700 1 --2- 172.21.15.26:0/886998287 >> v2:172.21.15.26:3300/0 conn(0x7fd03c130260 0x7fd03c136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.615+0000 7fd03a7fc700 1 -- 172.21.15.26:0/886998287 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd03c071780 con 0x7fd03c12f8b0 2023-10-01T07:55:00.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.615+0000 7fd03affd700 1 --2- 172.21.15.26:0/886998287 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd03c12cf60 0x7fd03c06f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:00.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.615+0000 7fd03b7fe700 1 --2- 172.21.15.26:0/886998287 >> v2:172.21.15.26:3300/0 conn(0x7fd03c130260 0x7fd03c136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:00.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.615+0000 7fd03a7fc700 1 --2- 172.21.15.26:0/886998287 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd03c12f8b0 0x7fd03c12fd20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd03000aa90 tx=0x7fd03000ada0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b35104184a99b96 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:00.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.616+0000 7fd039ffb700 1 -- 172.21.15.26:0/886998287 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03000cb70 con 0x7fd03c12f8b0 2023-10-01T07:55:00.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.616+0000 7fd039ffb700 1 -- 172.21.15.26:0/886998287 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03000ccd0 con 0x7fd03c12f8b0 2023-10-01T07:55:00.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.616+0000 7fd039ffb700 1 -- 172.21.15.26:0/886998287 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd030010640 con 0x7fd03c12f8b0 2023-10-01T07:55:00.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.616+0000 7fd0412de700 1 -- 172.21.15.26:0/886998287 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd03c12f8b0 msgr2=0x7fd03c12fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:00.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.616+0000 7fd0412de700 1 --2- 172.21.15.26:0/886998287 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd03c12f8b0 0x7fd03c12fd20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd03000aa90 tx=0x7fd03000ada0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.616+0000 7fd0412de700 1 -- 172.21.15.26:0/886998287 shutdown_connections 2023-10-01T07:55:00.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.616+0000 7fd0412de700 1 --2- 172.21.15.26:0/886998287 >> v2:172.21.15.26:3300/0 conn(0x7fd03c130260 0x7fd03c136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.616+0000 7fd0412de700 1 --2- 172.21.15.26:0/886998287 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd03c12cf60 0x7fd03c06f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.616+0000 7fd0412de700 1 --2- 172.21.15.26:0/886998287 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd03c12f8b0 0x7fd03c12fd20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.616+0000 7fd0412de700 1 -- 172.21.15.26:0/886998287 >> 172.21.15.26:0/886998287 conn(0x7fd03c0a2aa0 msgr2=0x7fd03c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:00.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.617+0000 7fd0412de700 1 -- 172.21.15.26:0/886998287 shutdown_connections 2023-10-01T07:55:00.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.617+0000 7fd0412de700 1 -- 172.21.15.26:0/886998287 wait complete. 2023-10-01T07:55:00.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.618+0000 7fd0412de700 1 Processor -- start 2023-10-01T07:55:00.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.618+0000 7fd0412de700 1 -- start start 2023-10-01T07:55:00.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.619+0000 7fd0412de700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd03c12cf60 0x7fd03c1214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:00.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.619+0000 7fd0412de700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd03c12f8b0 0x7fd03c121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:00.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.619+0000 7fd0412de700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd03c130260 0x7fd03c121f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:00.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.619+0000 7fd0412de700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd03c124950 con 0x7fd03c130260 2023-10-01T07:55:00.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.619+0000 7fd0412de700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd03c12f390 con 0x7fd03c12f8b0 2023-10-01T07:55:00.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.619+0000 7fd0412de700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd03c129fa0 con 0x7fd03c12cf60 2023-10-01T07:55:00.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.619+0000 7fd03affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd03c12cf60 0x7fd03c1214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:00.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.619+0000 7fd03affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd03c12cf60 0x7fd03c1214e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35738/0 (socket says 172.21.15.26:35738) 2023-10-01T07:55:00.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.619+0000 7fd03affd700 1 -- 172.21.15.26:0/2412523952 learned_addr learned my addr 172.21.15.26:0/2412523952 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:00.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.619+0000 7fd03a7fc700 1 --2- 172.21.15.26:0/2412523952 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd03c12f8b0 0x7fd03c121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:00.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.619+0000 7fd03b7fe700 1 --2- 172.21.15.26:0/2412523952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd03c130260 0x7fd03c121f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:00.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.619+0000 7fd03a7fc700 1 -- 172.21.15.26:0/2412523952 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd03c12cf60 msgr2=0x7fd03c1214e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:00.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.619+0000 7fd03a7fc700 1 --2- 172.21.15.26:0/2412523952 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd03c12cf60 0x7fd03c1214e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.619+0000 7fd03a7fc700 1 -- 172.21.15.26:0/2412523952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd03c130260 msgr2=0x7fd03c121f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:00.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.619+0000 7fd03a7fc700 1 --2- 172.21.15.26:0/2412523952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd03c130260 0x7fd03c121f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.619+0000 7fd03a7fc700 1 -- 172.21.15.26:0/2412523952 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd02c0094a0 con 0x7fd03c12f8b0 2023-10-01T07:55:00.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.619+0000 7fd03a7fc700 1 --2- 172.21.15.26:0/2412523952 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd03c12f8b0 0x7fd03c121a20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd030016000 tx=0x7fd030004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:00.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.620+0000 7fd0237fe700 1 -- 172.21.15.26:0/2412523952 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03001e070 con 0x7fd03c12f8b0 2023-10-01T07:55:00.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.620+0000 7fd0237fe700 1 -- 172.21.15.26:0/2412523952 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03000ce40 con 0x7fd03c12f8b0 2023-10-01T07:55:00.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.620+0000 7fd0237fe700 1 -- 172.21.15.26:0/2412523952 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0300036a0 con 0x7fd03c12f8b0 2023-10-01T07:55:00.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.620+0000 7fd0412de700 1 -- 172.21.15.26:0/2412523952 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd034009a70 con 0x7fd03c12f8b0 2023-10-01T07:55:00.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.620+0000 7fd0412de700 1 -- 172.21.15.26:0/2412523952 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd03000a6f0 con 0x7fd03c12f8b0 2023-10-01T07:55:00.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.621+0000 7fd0237fe700 1 -- 172.21.15.26:0/2412523952 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd030022070 con 0x7fd03c12f8b0 2023-10-01T07:55:00.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.621+0000 7fd0412de700 1 -- 172.21.15.26:0/2412523952 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd03c12f390 con 0x7fd03c12f8b0 2023-10-01T07:55:00.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.621+0000 7fd0237fe700 1 -- 172.21.15.26:0/2412523952 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fd030040560 con 0x7fd03c12f8b0 2023-10-01T07:55:00.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.621+0000 7fd03affd700 1 -- 172.21.15.26:0/2412523952 >> v1:172.21.15.26:6816/126763 conn(0x7fd02802f510 legacy=0x7fd0280319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:00.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.626+0000 7fd0237fe700 1 -- 172.21.15.26:0/2412523952 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd030003800 con 0x7fd03c12f8b0 2023-10-01T07:55:00.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.645+0000 7fae89e67700 1 Processor -- start 2023-10-01T07:55:00.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.645+0000 7fae89e67700 1 -- start start 2023-10-01T07:55:00.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.646+0000 7fae89e67700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae8409d6f0 0x7fae8409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:00.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.646+0000 7fae89e67700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae8409e000 0x7fae841339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:00.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.646+0000 7fae89e67700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fae8409e410 0x7fae84133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:00.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.646+0000 7fae89e67700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae8406b460 con 0x7fae8409e410 2023-10-01T07:55:00.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.646+0000 7fae89e67700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8409b120 con 0x7fae8409d6f0 2023-10-01T07:55:00.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.646+0000 7fae89e67700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae8409a7e0 con 0x7fae8409e000 2023-10-01T07:55:00.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.646+0000 7fae82ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae8409e000 0x7fae841339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:00.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.646+0000 7fae82ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae8409e000 0x7fae841339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35752/0 (socket says 172.21.15.26:35752) 2023-10-01T07:55:00.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.646+0000 7fae82ffd700 1 -- 172.21.15.26:0/3956907039 learned_addr learned my addr 172.21.15.26:0/3956907039 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:00.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.646+0000 7fae837fe700 1 --2- 172.21.15.26:0/3956907039 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae8409d6f0 0x7fae8409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:00.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.646+0000 7fae83fff700 1 --2- 172.21.15.26:0/3956907039 >> v2:172.21.15.26:3300/0 conn(0x7fae8409e410 0x7fae84133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:00.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.647+0000 7fae82ffd700 1 -- 172.21.15.26:0/3956907039 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae8409d6f0 msgr2=0x7fae8409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:00.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.647+0000 7fae82ffd700 1 --2- 172.21.15.26:0/3956907039 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae8409d6f0 0x7fae8409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.647+0000 7fae82ffd700 1 -- 172.21.15.26:0/3956907039 >> v2:172.21.15.26:3300/0 conn(0x7fae8409e410 msgr2=0x7fae84133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:00.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.647+0000 7fae82ffd700 1 --2- 172.21.15.26:0/3956907039 >> v2:172.21.15.26:3300/0 conn(0x7fae8409e410 0x7fae84133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.647+0000 7fae82ffd700 1 -- 172.21.15.26:0/3956907039 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8409a500 con 0x7fae8409e000 2023-10-01T07:55:00.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.647+0000 7fae82ffd700 1 --2- 172.21.15.26:0/3956907039 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae8409e000 0x7fae841339f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fae78009920 tx=0x7fae78009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79431be1e4ac79f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:00.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.647+0000 7fae827fc700 1 -- 172.21.15.26:0/3956907039 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae78011830 con 0x7fae8409e000 2023-10-01T07:55:00.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.647+0000 7fae827fc700 1 -- 172.21.15.26:0/3956907039 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae78011990 con 0x7fae8409e000 2023-10-01T07:55:00.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.647+0000 7fae827fc700 1 -- 172.21.15.26:0/3956907039 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae78011d20 con 0x7fae8409e000 2023-10-01T07:55:00.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.648+0000 7fae89e67700 1 -- 172.21.15.26:0/3956907039 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae8409e000 msgr2=0x7fae841339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:00.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.648+0000 7fae89e67700 1 --2- 172.21.15.26:0/3956907039 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae8409e000 0x7fae841339f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fae78009920 tx=0x7fae78009c30 comp rx=0 tx=0).stop 2023-10-01T07:55:00.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.648+0000 7fae89e67700 1 -- 172.21.15.26:0/3956907039 shutdown_connections 2023-10-01T07:55:00.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.648+0000 7fae89e67700 1 --2- 172.21.15.26:0/3956907039 >> v2:172.21.15.26:3300/0 conn(0x7fae8409e410 0x7fae84133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.648+0000 7fae89e67700 1 --2- 172.21.15.26:0/3956907039 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae8409d6f0 0x7fae8409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.648+0000 7fae89e67700 1 --2- 172.21.15.26:0/3956907039 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae8409e000 0x7fae841339f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.648+0000 7fae89e67700 1 -- 172.21.15.26:0/3956907039 >> 172.21.15.26:0/3956907039 conn(0x7fae84066f50 msgr2=0x7fae8409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:00.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.648+0000 7fae89e67700 1 -- 172.21.15.26:0/3956907039 shutdown_connections 2023-10-01T07:55:00.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.648+0000 7fae89e67700 1 -- 172.21.15.26:0/3956907039 wait complete. 2023-10-01T07:55:00.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.650+0000 7fae89e67700 1 Processor -- start 2023-10-01T07:55:00.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.650+0000 7fae89e67700 1 -- start start 2023-10-01T07:55:00.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.651+0000 7fae89e67700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae8409d6f0 0x7fae841a6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:00.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.651+0000 7fae89e67700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae8409e000 0x7fae841a65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:00.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.651+0000 7fae89e67700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae8409e410 0x7fae841a6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:00.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.651+0000 7fae89e67700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae841b9390 con 0x7fae8409e000 2023-10-01T07:55:00.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.651+0000 7fae89e67700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae841a74e0 con 0x7fae8409e410 2023-10-01T07:55:00.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.651+0000 7fae89e67700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae841a8e00 con 0x7fae8409d6f0 2023-10-01T07:55:00.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.651+0000 7fae83fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae8409e410 0x7fae841a6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:00.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.651+0000 7fae837fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae8409d6f0 0x7fae841a6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:00.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.651+0000 7fae83fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae8409e410 0x7fae841a6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33152/0 (socket says 172.21.15.26:33152) 2023-10-01T07:55:00.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.651+0000 7fae83fff700 1 -- 172.21.15.26:0/1643490876 learned_addr learned my addr 172.21.15.26:0/1643490876 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:00.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.651+0000 7fae82ffd700 1 --2- 172.21.15.26:0/1643490876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae8409e000 0x7fae841a65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:00.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.651+0000 7fae83fff700 1 -- 172.21.15.26:0/1643490876 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae8409d6f0 msgr2=0x7fae841a6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:00.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.651+0000 7fae83fff700 1 --2- 172.21.15.26:0/1643490876 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae8409d6f0 0x7fae841a6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.651+0000 7fae83fff700 1 -- 172.21.15.26:0/1643490876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae8409e000 msgr2=0x7fae841a65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:00.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.651+0000 7fae83fff700 1 --2- 172.21.15.26:0/1643490876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae8409e000 0x7fae841a65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.651+0000 7fae83fff700 1 -- 172.21.15.26:0/1643490876 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae78009550 con 0x7fae8409e410 2023-10-01T07:55:00.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.652+0000 7fae83fff700 1 --2- 172.21.15.26:0/1643490876 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae8409e410 0x7fae841a6b00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fae7c007e90 tx=0x7fae7c00e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:00.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.652+0000 7fae6bfff700 1 -- 172.21.15.26:0/1643490876 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c00ed30 con 0x7fae8409e410 2023-10-01T07:55:00.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.652+0000 7fae89e67700 1 -- 172.21.15.26:0/1643490876 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae841a8190 con 0x7fae8409e410 2023-10-01T07:55:00.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.652+0000 7fae6bfff700 1 -- 172.21.15.26:0/1643490876 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7c00ee90 con 0x7fae8409e410 2023-10-01T07:55:00.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.652+0000 7fae6bfff700 1 -- 172.21.15.26:0/1643490876 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c014660 con 0x7fae8409e410 2023-10-01T07:55:00.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.652+0000 7fae89e67700 1 -- 172.21.15.26:0/1643490876 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae840a30d0 con 0x7fae8409e410 2023-10-01T07:55:00.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.653+0000 7fae89e67700 1 -- 172.21.15.26:0/1643490876 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae840723c0 con 0x7fae8409e410 2023-10-01T07:55:00.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.654+0000 7fae6bfff700 1 -- 172.21.15.26:0/1643490876 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fae7c0147c0 con 0x7fae8409e410 2023-10-01T07:55:00.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.654+0000 7fae837fe700 1 -- 172.21.15.26:0/1643490876 >> v1:172.21.15.26:6816/126763 conn(0x7fae7002f510 legacy=0x7fae700319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:00.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.659+0000 7fae6bfff700 1 -- 172.21.15.26:0/1643490876 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fae7c013bd0 con 0x7fae8409e410 2023-10-01T07:55:00.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.659+0000 7fae6bfff700 1 -- 172.21.15.26:0/1643490876 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fae7c045060 con 0x7fae8409e410 2023-10-01T07:55:00.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.706+0000 7f9594d29700 1 -- 172.21.15.26:0/4259955150 >> v1:172.21.15.26:6816/126763 conn(0x7f957402f510 legacy=0x7f95740319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:00.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.727+0000 7f9596f8d700 1 -- 172.21.15.26:0/4259955150 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9590123a10 con 0x7f95901341d0 2023-10-01T07:55:00.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.727+0000 7f958d7fa700 1 -- 172.21.15.26:0/4259955150 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9588017020 con 0x7f95901341d0 2023-10-01T07:55:00.727 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:00.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.730+0000 7f9596f8d700 1 -- 172.21.15.26:0/4259955150 >> v1:172.21.15.26:6816/126763 conn(0x7f957402f510 legacy=0x7f95740319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:00.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.730+0000 7f9596f8d700 1 -- 172.21.15.26:0/4259955150 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f95901341d0 msgr2=0x7f9590120170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:00.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.730+0000 7f9596f8d700 1 --2- 172.21.15.26:0/4259955150 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f95901341d0 0x7f9590120170 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9588001560 tx=0x7f958800cb50 comp rx=0 tx=0).stop 2023-10-01T07:55:00.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.730+0000 7f9596f8d700 1 -- 172.21.15.26:0/4259955150 shutdown_connections 2023-10-01T07:55:00.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.730+0000 7f9596f8d700 1 --2- 172.21.15.26:0/4259955150 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f95901341d0 0x7f9590120170 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.730+0000 7f9596f8d700 1 --2- 172.21.15.26:0/4259955150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f959009e390 0x7f959011f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.730+0000 7f9596f8d700 1 --2- 172.21.15.26:0/4259955150 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f95901338c0 0x7f959011fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.730+0000 7f9596f8d700 1 -- 172.21.15.26:0/4259955150 >> 172.21.15.26:0/4259955150 conn(0x7f95900a2aa0 msgr2=0x7f9590132c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:00.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.730+0000 7f9596f8d700 1 -- 172.21.15.26:0/4259955150 shutdown_connections 2023-10-01T07:55:00.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.731+0000 7f9596f8d700 1 -- 172.21.15.26:0/4259955150 wait complete. 2023-10-01T07:55:00.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:00.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.781+0000 7f90db7fe700 1 -- 172.21.15.26:0/1791685727 >> v1:172.21.15.26:6816/126763 conn(0x7f90c802f510 legacy=0x7f90c80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:00.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.799+0000 7f90e2741700 1 -- 172.21.15.26:0/1791685727 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f90dc074ea0 con 0x7f90dc09de50 2023-10-01T07:55:00.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.799+0000 7f90d8ff9700 1 -- 172.21.15.26:0/1791685727 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f90cc017020 con 0x7f90dc09de50 2023-10-01T07:55:00.800 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:00.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.802+0000 7f90e2741700 1 -- 172.21.15.26:0/1791685727 >> v1:172.21.15.26:6816/126763 conn(0x7f90c802f510 legacy=0x7f90c80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:00.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.802+0000 7f90e2741700 1 -- 172.21.15.26:0/1791685727 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f90dc09de50 msgr2=0x7f90dc11ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:00.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.802+0000 7f90e2741700 1 --2- 172.21.15.26:0/1791685727 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f90dc09de50 0x7f90dc11ec40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f90cc00ebe0 tx=0x7f90cc00eef0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.802+0000 7f90e2741700 1 -- 172.21.15.26:0/1791685727 shutdown_connections 2023-10-01T07:55:00.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.802+0000 7f90e2741700 1 --2- 172.21.15.26:0/1791685727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90dc1338a0 0x7f90dc11f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.802+0000 7f90e2741700 1 --2- 172.21.15.26:0/1791685727 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f90dc09de50 0x7f90dc11ec40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.802+0000 7f90e2741700 1 --2- 172.21.15.26:0/1791685727 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f90dc09e760 0x7f90dc11f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.802+0000 7f90e2741700 1 -- 172.21.15.26:0/1791685727 >> 172.21.15.26:0/1791685727 conn(0x7f90dc0a2aa0 msgr2=0x7f90dc09ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:00.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.802+0000 7f90e2741700 1 -- 172.21.15.26:0/1791685727 shutdown_connections 2023-10-01T07:55:00.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.802+0000 7f90e2741700 1 -- 172.21.15.26:0/1791685727 wait complete. 2023-10-01T07:55:00.816 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:00.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.822+0000 7fd03affd700 1 -- 172.21.15.26:0/2412523952 >> v1:172.21.15.26:6816/126763 conn(0x7fd02802f510 legacy=0x7fd0280319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:00.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.836+0000 7fd0412de700 1 -- 172.21.15.26:0/2412523952 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd03c074ea0 con 0x7fd03c12f8b0 2023-10-01T07:55:00.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.836+0000 7fd0237fe700 1 -- 172.21.15.26:0/2412523952 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd030029090 con 0x7fd03c12f8b0 2023-10-01T07:55:00.837 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:00.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.838+0000 7fd0412de700 1 -- 172.21.15.26:0/2412523952 >> v1:172.21.15.26:6816/126763 conn(0x7fd02802f510 legacy=0x7fd0280319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:00.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.838+0000 7fd0412de700 1 -- 172.21.15.26:0/2412523952 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd03c12f8b0 msgr2=0x7fd03c121a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:00.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.838+0000 7fd0412de700 1 --2- 172.21.15.26:0/2412523952 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd03c12f8b0 0x7fd03c121a20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd030016000 tx=0x7fd030004750 comp rx=0 tx=0).stop 2023-10-01T07:55:00.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.838+0000 7fd0412de700 1 -- 172.21.15.26:0/2412523952 shutdown_connections 2023-10-01T07:55:00.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.838+0000 7fd0412de700 1 --2- 172.21.15.26:0/2412523952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd03c130260 0x7fd03c121f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.838+0000 7fd0412de700 1 --2- 172.21.15.26:0/2412523952 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd03c12cf60 0x7fd03c1214e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.838+0000 7fd0412de700 1 --2- 172.21.15.26:0/2412523952 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd03c12f8b0 0x7fd03c121a20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.838+0000 7fd0412de700 1 -- 172.21.15.26:0/2412523952 >> 172.21.15.26:0/2412523952 conn(0x7fd03c0a2aa0 msgr2=0x7fd03c06e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:00.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.838+0000 7fd0412de700 1 -- 172.21.15.26:0/2412523952 shutdown_connections 2023-10-01T07:55:00.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.838+0000 7fd0412de700 1 -- 172.21.15.26:0/2412523952 wait complete. 2023-10-01T07:55:00.852 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:00.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.855+0000 7fae837fe700 1 -- 172.21.15.26:0/1643490876 >> v1:172.21.15.26:6816/126763 conn(0x7fae7002f510 legacy=0x7fae700319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:00.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.876+0000 7fae89e67700 1 -- 172.21.15.26:0/1643490876 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fae8409c710 con 0x7fae8409e410 2023-10-01T07:55:00.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.877+0000 7fae6bfff700 1 -- 172.21.15.26:0/1643490876 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fae7c045030 con 0x7fae8409e410 2023-10-01T07:55:00.877 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:00.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.879+0000 7fae89e67700 1 -- 172.21.15.26:0/1643490876 >> v1:172.21.15.26:6816/126763 conn(0x7fae7002f510 legacy=0x7fae700319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:00.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.879+0000 7fae89e67700 1 -- 172.21.15.26:0/1643490876 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae8409e410 msgr2=0x7fae841a6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:00.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.879+0000 7fae89e67700 1 --2- 172.21.15.26:0/1643490876 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae8409e410 0x7fae841a6b00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fae7c007e90 tx=0x7fae7c00e3c0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.879+0000 7fae89e67700 1 -- 172.21.15.26:0/1643490876 shutdown_connections 2023-10-01T07:55:00.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.879+0000 7fae89e67700 1 --2- 172.21.15.26:0/1643490876 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae8409e410 0x7fae841a6b00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.879+0000 7fae89e67700 1 --2- 172.21.15.26:0/1643490876 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae8409d6f0 0x7fae841a6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.879+0000 7fae89e67700 1 --2- 172.21.15.26:0/1643490876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae8409e000 0x7fae841a65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:00.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.879+0000 7fae89e67700 1 -- 172.21.15.26:0/1643490876 >> 172.21.15.26:0/1643490876 conn(0x7fae84066f50 msgr2=0x7fae840a3620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:00.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.879+0000 7fae89e67700 1 -- 172.21.15.26:0/1643490876 shutdown_connections 2023-10-01T07:55:00.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:00.879+0000 7fae89e67700 1 -- 172.21.15.26:0/1643490876 wait complete. 2023-10-01T07:55:00.893 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:01.751 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:01.817 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:01.853 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:01.894 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:01.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.902+0000 7fedcadb5700 1 Processor -- start 2023-10-01T07:55:01.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.903+0000 7fedcadb5700 1 -- start start 2023-10-01T07:55:01.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.903+0000 7fedcadb5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fedc409d6f0 0x7fedc409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:01.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.903+0000 7fedcadb5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedc409e000 0x7fedc41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:01.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.903+0000 7fedcadb5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedc409e410 0x7fedc4133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:01.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.903+0000 7fedcadb5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedc406b460 con 0x7fedc409d6f0 2023-10-01T07:55:01.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.903+0000 7fedcadb5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc409b120 con 0x7fedc409e000 2023-10-01T07:55:01.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.903+0000 7fedcadb5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fedc409a7e0 con 0x7fedc409e410 2023-10-01T07:55:01.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.903+0000 7fedc8b51700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fedc409d6f0 0x7fedc409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:01.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.903+0000 7fedc3fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedc409e000 0x7fedc41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:01.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.903+0000 7fedc9352700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedc409e410 0x7fedc4133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:01.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.903+0000 7fedc3fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedc409e000 0x7fedc41339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33162/0 (socket says 172.21.15.26:33162) 2023-10-01T07:55:01.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.903+0000 7fedc8b51700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fedc409d6f0 0x7fedc409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60862/0 (socket says 172.21.15.26:60862) 2023-10-01T07:55:01.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.903+0000 7fedc3fff700 1 -- 172.21.15.26:0/2991107578 learned_addr learned my addr 172.21.15.26:0/2991107578 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:01.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.904+0000 7fedc3fff700 1 -- 172.21.15.26:0/2991107578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedc409e410 msgr2=0x7fedc4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:01.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.904+0000 7fedc3fff700 1 --2- 172.21.15.26:0/2991107578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedc409e410 0x7fedc4133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:01.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.904+0000 7fedc3fff700 1 -- 172.21.15.26:0/2991107578 >> v2:172.21.15.26:3300/0 conn(0x7fedc409d6f0 msgr2=0x7fedc409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:01.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.904+0000 7fedc3fff700 1 --2- 172.21.15.26:0/2991107578 >> v2:172.21.15.26:3300/0 conn(0x7fedc409d6f0 0x7fedc409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:01.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.904+0000 7fedc3fff700 1 -- 172.21.15.26:0/2991107578 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc409a500 con 0x7fedc409e000 2023-10-01T07:55:01.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.904+0000 7fedc9352700 1 --2- 172.21.15.26:0/2991107578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedc409e410 0x7fedc4133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:01.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.904+0000 7fedc3fff700 1 --2- 172.21.15.26:0/2991107578 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedc409e000 0x7fedc41339f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fedb0009920 tx=0x7fedb0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e926583804465fe server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:01.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.904+0000 7fedc37fe700 1 -- 172.21.15.26:0/2991107578 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb0011830 con 0x7fedc409e000 2023-10-01T07:55:01.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.904+0000 7fedc37fe700 1 -- 172.21.15.26:0/2991107578 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb0011990 con 0x7fedc409e000 2023-10-01T07:55:01.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.904+0000 7fedc37fe700 1 -- 172.21.15.26:0/2991107578 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb0011d00 con 0x7fedc409e000 2023-10-01T07:55:01.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.905+0000 7fedcadb5700 1 -- 172.21.15.26:0/2991107578 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedc409e000 msgr2=0x7fedc41339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:01.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.905+0000 7fedcadb5700 1 --2- 172.21.15.26:0/2991107578 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedc409e000 0x7fedc41339f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fedb0009920 tx=0x7fedb0009c30 comp rx=0 tx=0).stop 2023-10-01T07:55:01.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.905+0000 7fedcadb5700 1 -- 172.21.15.26:0/2991107578 shutdown_connections 2023-10-01T07:55:01.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.905+0000 7fedcadb5700 1 --2- 172.21.15.26:0/2991107578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedc409e410 0x7fedc4133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:01.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.905+0000 7fedcadb5700 1 --2- 172.21.15.26:0/2991107578 >> v2:172.21.15.26:3300/0 conn(0x7fedc409d6f0 0x7fedc409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:01.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.905+0000 7fedcadb5700 1 --2- 172.21.15.26:0/2991107578 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedc409e000 0x7fedc41339f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:01.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.905+0000 7fedcadb5700 1 -- 172.21.15.26:0/2991107578 >> 172.21.15.26:0/2991107578 conn(0x7fedc4066f50 msgr2=0x7fedc409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:01.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.905+0000 7fedcadb5700 1 -- 172.21.15.26:0/2991107578 shutdown_connections 2023-10-01T07:55:01.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.905+0000 7fedcadb5700 1 -- 172.21.15.26:0/2991107578 wait complete. 2023-10-01T07:55:01.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.906+0000 7fedcadb5700 1 Processor -- start 2023-10-01T07:55:01.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.906+0000 7fedcadb5700 1 -- start start 2023-10-01T07:55:01.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.907+0000 7fedcadb5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedc409d6f0 0x7fedc41196f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:01.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.907+0000 7fedcadb5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedc409e000 0x7fedc4119c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:01.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.907+0000 7fedcadb5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedc409e410 0x7fedc411a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:01.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.907+0000 7fedcadb5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc411c3a0 con 0x7fedc409e410 2023-10-01T07:55:01.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.907+0000 7fedcadb5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc411c710 con 0x7fedc409e000 2023-10-01T07:55:01.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.907+0000 7fedcadb5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fedc40a2000 con 0x7fedc409d6f0 2023-10-01T07:55:01.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.907+0000 7fedc3fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedc409e000 0x7fedc4119c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:01.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.907+0000 7fedc3fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedc409e000 0x7fedc4119c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33172/0 (socket says 172.21.15.26:33172) 2023-10-01T07:55:01.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.907+0000 7fedc3fff700 1 -- 172.21.15.26:0/2372991616 learned_addr learned my addr 172.21.15.26:0/2372991616 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:01.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.907+0000 7fedc9352700 1 --2- 172.21.15.26:0/2372991616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedc409e410 0x7fedc411a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:01.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.908+0000 7fedc8b51700 1 --2- 172.21.15.26:0/2372991616 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedc409d6f0 0x7fedc41196f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:01.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.908+0000 7fedc3fff700 1 -- 172.21.15.26:0/2372991616 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedc409d6f0 msgr2=0x7fedc41196f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:01.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.908+0000 7fedc3fff700 1 --2- 172.21.15.26:0/2372991616 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedc409d6f0 0x7fedc41196f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:01.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.908+0000 7fedc3fff700 1 -- 172.21.15.26:0/2372991616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedc409e410 msgr2=0x7fedc411a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:01.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.908+0000 7fedc3fff700 1 --2- 172.21.15.26:0/2372991616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedc409e410 0x7fedc411a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:01.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.908+0000 7fedc3fff700 1 -- 172.21.15.26:0/2372991616 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedbc009a70 con 0x7fedc409e000 2023-10-01T07:55:01.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.908+0000 7fedc3fff700 1 --2- 172.21.15.26:0/2372991616 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedc409e000 0x7fedc4119c30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fedb0009130 tx=0x7fedb0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:01.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.909+0000 7fedc17fa700 1 -- 172.21.15.26:0/2372991616 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb0004240 con 0x7fedc409e000 2023-10-01T07:55:01.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.909+0000 7fedc17fa700 1 -- 172.21.15.26:0/2372991616 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb001f070 con 0x7fedc409e000 2023-10-01T07:55:01.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.909+0000 7fedcadb5700 1 -- 172.21.15.26:0/2372991616 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb0009550 con 0x7fedc409e000 2023-10-01T07:55:01.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.909+0000 7fedc17fa700 1 -- 172.21.15.26:0/2372991616 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb00036a0 con 0x7fedc409e000 2023-10-01T07:55:01.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.909+0000 7fedcadb5700 1 -- 172.21.15.26:0/2372991616 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc411b860 con 0x7fedc409e000 2023-10-01T07:55:01.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.910+0000 7fedc17fa700 1 -- 172.21.15.26:0/2372991616 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fedb0021030 con 0x7fedc409e000 2023-10-01T07:55:01.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.910+0000 7fedc17fa700 1 -- 172.21.15.26:0/2372991616 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fedb0040c50 con 0x7fedc409e000 2023-10-01T07:55:01.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.910+0000 7fedcadb5700 1 -- 172.21.15.26:0/2372991616 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedc4074ea0 con 0x7fedc409e000 2023-10-01T07:55:01.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.910+0000 7fedc8b51700 1 -- 172.21.15.26:0/2372991616 >> v1:172.21.15.26:6816/126763 conn(0x7feda802f510 legacy=0x7feda80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:01.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.916+0000 7fedc17fa700 1 -- 172.21.15.26:0/2372991616 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fedb0015080 con 0x7fedc409e000 2023-10-01T07:55:01.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.973+0000 7fc9e7c5c700 1 Processor -- start 2023-10-01T07:55:01.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.973+0000 7fc9e7c5c700 1 -- start start 2023-10-01T07:55:01.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.974+0000 7fc9e7c5c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc9e00a0a30 0x7fc9e00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:01.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.974+0000 7fc9e7c5c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc9e00a1340 0x7fc9e0133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:01.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.974+0000 7fc9e7c5c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9e0133fa0 0x7fc9e0134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:01.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.974+0000 7fc9e7c5c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9e009edd0 con 0x7fc9e00a0a30 2023-10-01T07:55:01.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.974+0000 7fc9e7c5c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e009e1f0 con 0x7fc9e0133fa0 2023-10-01T07:55:01.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.974+0000 7fc9e7c5c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e009dc50 con 0x7fc9e00a1340 2023-10-01T07:55:01.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.974+0000 7fc9e61f9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9e0133fa0 0x7fc9e0134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:01.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.974+0000 7fc9e59f8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc9e00a0a30 0x7fc9e00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:01.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.974+0000 7fc9e61f9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9e0133fa0 0x7fc9e0134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33188/0 (socket says 172.21.15.26:33188) 2023-10-01T07:55:01.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.974+0000 7fc9e61f9700 1 -- 172.21.15.26:0/3598477082 learned_addr learned my addr 172.21.15.26:0/3598477082 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:01.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.974+0000 7fc9e51f7700 1 --2- 172.21.15.26:0/3598477082 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc9e00a1340 0x7fc9e0133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:01.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.975+0000 7fc9e59f8700 1 -- 172.21.15.26:0/3598477082 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc9e00a1340 msgr2=0x7fc9e0133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:01.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.975+0000 7fc9e59f8700 1 --2- 172.21.15.26:0/3598477082 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc9e00a1340 0x7fc9e0133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:01.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.975+0000 7fc9e59f8700 1 -- 172.21.15.26:0/3598477082 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9e0133fa0 msgr2=0x7fc9e0134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:01.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.975+0000 7fc9e59f8700 1 --2- 172.21.15.26:0/3598477082 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9e0133fa0 0x7fc9e0134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:01.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.975+0000 7fc9e59f8700 1 -- 172.21.15.26:0/3598477082 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e00a1fe0 con 0x7fc9e00a0a30 2023-10-01T07:55:01.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.975+0000 7fc9e61f9700 1 --2- 172.21.15.26:0/3598477082 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9e0133fa0 0x7fc9e0134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:01.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.975+0000 7fc9e59f8700 1 --2- 172.21.15.26:0/3598477082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9e00a0a30 0x7fc9e00a0e00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc009840 tx=0x7fc9dc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7288266647034adb server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:01.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.975+0000 7fc9e49f6700 1 -- 172.21.15.26:0/3598477082 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc011830 con 0x7fc9e00a0a30 2023-10-01T07:55:01.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.975+0000 7fc9e49f6700 1 -- 172.21.15.26:0/3598477082 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9dc011990 con 0x7fc9e00a0a30 2023-10-01T07:55:01.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.975+0000 7fc9e49f6700 1 -- 172.21.15.26:0/3598477082 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc011d20 con 0x7fc9e00a0a30 2023-10-01T07:55:01.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.976+0000 7fc9e7c5c700 1 -- 172.21.15.26:0/3598477082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9e00a0a30 msgr2=0x7fc9e00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:01.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.976+0000 7fc9e7c5c700 1 --2- 172.21.15.26:0/3598477082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9e00a0a30 0x7fc9e00a0e00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc009840 tx=0x7fc9dc009b50 comp rx=0 tx=0).stop 2023-10-01T07:55:01.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.976+0000 7fc9e7c5c700 1 -- 172.21.15.26:0/3598477082 shutdown_connections 2023-10-01T07:55:01.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.976+0000 7fc9e7c5c700 1 --2- 172.21.15.26:0/3598477082 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9e0133fa0 0x7fc9e0134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:01.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.976+0000 7fc9e7c5c700 1 --2- 172.21.15.26:0/3598477082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9e00a0a30 0x7fc9e00a0e00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:01.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.976+0000 7fc9e7c5c700 1 --2- 172.21.15.26:0/3598477082 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc9e00a1340 0x7fc9e0133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:01.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.976+0000 7fc9e7c5c700 1 -- 172.21.15.26:0/3598477082 >> 172.21.15.26:0/3598477082 conn(0x7fc9e00a6550 msgr2=0x7fc9e00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:01.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.976+0000 7fc9e7c5c700 1 -- 172.21.15.26:0/3598477082 shutdown_connections 2023-10-01T07:55:01.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.977+0000 7fc9e7c5c700 1 -- 172.21.15.26:0/3598477082 wait complete. 2023-10-01T07:55:01.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.978+0000 7fc9e7c5c700 1 Processor -- start 2023-10-01T07:55:01.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.978+0000 7fc9e7c5c700 1 -- start start 2023-10-01T07:55:01.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.979+0000 7fc9e7c5c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9e00a0a30 0x7fc9e01212d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:01.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.979+0000 7fc9e7c5c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9e00a1340 0x7fc9e0121810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:01.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.979+0000 7fc9e7c5c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc9e0133fa0 0x7fc9e0121d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:01.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.979+0000 7fc9e7c5c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e01326a0 con 0x7fc9e00a0a30 2023-10-01T07:55:01.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.979+0000 7fc9e7c5c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e0123d70 con 0x7fc9e00a1340 2023-10-01T07:55:01.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.979+0000 7fc9e7c5c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e0124850 con 0x7fc9e0133fa0 2023-10-01T07:55:01.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.979+0000 7fc9e59f8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9e00a0a30 0x7fc9e01212d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:01.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.979+0000 7fc9e59f8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9e00a0a30 0x7fc9e01212d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60888/0 (socket says 172.21.15.26:60888) 2023-10-01T07:55:01.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.979+0000 7fc9e59f8700 1 -- 172.21.15.26:0/2445496974 learned_addr learned my addr 172.21.15.26:0/2445496974 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:01.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.979+0000 7fc9e61f9700 1 --2- 172.21.15.26:0/2445496974 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc9e0133fa0 0x7fc9e0121d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:01.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.980+0000 7fc9e51f7700 1 --2- 172.21.15.26:0/2445496974 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9e00a1340 0x7fc9e0121810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:01.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.980+0000 7fc9e59f8700 1 -- 172.21.15.26:0/2445496974 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc9e0133fa0 msgr2=0x7fc9e0121d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:01.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.980+0000 7fc9e59f8700 1 --2- 172.21.15.26:0/2445496974 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc9e0133fa0 0x7fc9e0121d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:01.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.980+0000 7fc9e59f8700 1 -- 172.21.15.26:0/2445496974 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9e00a1340 msgr2=0x7fc9e0121810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:01.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.980+0000 7fc9e59f8700 1 --2- 172.21.15.26:0/2445496974 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9e00a1340 0x7fc9e0121810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:01.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.980+0000 7fc9e59f8700 1 -- 172.21.15.26:0/2445496974 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d8009b30 con 0x7fc9e00a0a30 2023-10-01T07:55:01.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.980+0000 7fc9e61f9700 1 --2- 172.21.15.26:0/2445496974 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc9e0133fa0 0x7fc9e0121d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:01.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.980+0000 7fc9e51f7700 1 --2- 172.21.15.26:0/2445496974 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9e00a1340 0x7fc9e0121810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:55:01.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.980+0000 7fc9e59f8700 1 --2- 172.21.15.26:0/2445496974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9e00a0a30 0x7fc9e01212d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc0090b0 tx=0x7fc9dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:01.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.980+0000 7fc9d67fc700 1 -- 172.21.15.26:0/2445496974 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc004510 con 0x7fc9e00a0a30 2023-10-01T07:55:01.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.980+0000 7fc9d67fc700 1 -- 172.21.15.26:0/2445496974 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9dc01f070 con 0x7fc9e00a0a30 2023-10-01T07:55:01.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.980+0000 7fc9d67fc700 1 -- 172.21.15.26:0/2445496974 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc0038e0 con 0x7fc9e00a0a30 2023-10-01T07:55:01.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.981+0000 7fc9e7c5c700 1 -- 172.21.15.26:0/2445496974 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9dc0094a0 con 0x7fc9e00a0a30 2023-10-01T07:55:01.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.981+0000 7fc9e7c5c700 1 -- 172.21.15.26:0/2445496974 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9e00a36e0 con 0x7fc9e00a0a30 2023-10-01T07:55:01.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.982+0000 7fc9e7c5c700 1 -- 172.21.15.26:0/2445496974 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9e0074ea0 con 0x7fc9e00a0a30 2023-10-01T07:55:01.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.982+0000 7fc9d67fc700 1 -- 172.21.15.26:0/2445496974 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc9dc003a40 con 0x7fc9e00a0a30 2023-10-01T07:55:01.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.982+0000 7fc9d67fc700 1 -- 172.21.15.26:0/2445496974 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fc9dc021070 con 0x7fc9e00a0a30 2023-10-01T07:55:01.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.982+0000 7fc9e51f7700 1 -- 172.21.15.26:0/2445496974 >> v1:172.21.15.26:6816/126763 conn(0x7fc9c402f510 legacy=0x7fc9c40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:01.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:01.991+0000 7fc9d67fc700 1 -- 172.21.15.26:0/2445496974 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc9dc0253e0 con 0x7fc9e00a0a30 2023-10-01T07:55:02.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.016+0000 7efc5b130700 1 Processor -- start 2023-10-01T07:55:02.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.016+0000 7efc5b130700 1 -- start start 2023-10-01T07:55:02.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.017+0000 7efc5b130700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc5409d9f0 0x7efc54136530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:02.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.017+0000 7efc5b130700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efc54136a70 0x7efc54138e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:02.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.017+0000 7efc5b130700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc5409e130 con 0x7efc541316c0 2023-10-01T07:55:02.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.017+0000 7efc5b130700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc541321a0 con 0x7efc54136a70 2023-10-01T07:55:02.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.017+0000 7efc5b130700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc541312b0 con 0x7efc5409d9f0 2023-10-01T07:55:02.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.017+0000 7efc58ecc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7efc541316c0 0x7efc54131a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33490/0 (socket says 172.21.15.26:33490) 2023-10-01T07:55:02.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.017+0000 7efc58ecc700 1 -- 172.21.15.26:0/3869313172 learned_addr learned my addr 172.21.15.26:0/3869313172 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:02.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.017+0000 7efc53fff700 1 --2- 172.21.15.26:0/3869313172 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc5409d9f0 0x7efc54136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:02.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.017+0000 7efc596cd700 1 --2- 172.21.15.26:0/3869313172 >> v2:172.21.15.26:3300/0 conn(0x7efc54136a70 0x7efc54138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:02.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.018+0000 7efc537fe700 1 -- 172.21.15.26:0/3869313172 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2100840882 0 0) 0x7efc48001110 con 0x7efc541316c0 2023-10-01T07:55:02.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.018+0000 7efc596cd700 1 -- 172.21.15.26:0/3869313172 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc5409d9f0 msgr2=0x7efc54136530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:02.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.018+0000 7efc596cd700 1 --2- 172.21.15.26:0/3869313172 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc5409d9f0 0x7efc54136530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:02.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.018+0000 7efc596cd700 1 -- 172.21.15.26:0/3869313172 >> v1:172.21.15.26:6789/0 conn(0x7efc541316c0 legacy=0x7efc54131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:02.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.018+0000 7efc596cd700 1 -- 172.21.15.26:0/3869313172 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5409f6e0 con 0x7efc54136a70 2023-10-01T07:55:02.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.018+0000 7efc596cd700 1 --2- 172.21.15.26:0/3869313172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc54136a70 0x7efc54138e50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efc4c009d90 tx=0x7efc4c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9a6c364e034ec00 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:02.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.018+0000 7efc537fe700 1 -- 172.21.15.26:0/3869313172 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c00e070 con 0x7efc54136a70 2023-10-01T07:55:02.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.018+0000 7efc537fe700 1 -- 172.21.15.26:0/3869313172 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4c00bb20 con 0x7efc54136a70 2023-10-01T07:55:02.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.018+0000 7efc537fe700 1 -- 172.21.15.26:0/3869313172 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c012430 con 0x7efc54136a70 2023-10-01T07:55:02.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.019+0000 7efc5b130700 1 -- 172.21.15.26:0/3869313172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc54136a70 msgr2=0x7efc54138e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:02.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.019+0000 7efc5b130700 1 --2- 172.21.15.26:0/3869313172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc54136a70 0x7efc54138e50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efc4c009d90 tx=0x7efc4c00b330 comp rx=0 tx=0).stop 2023-10-01T07:55:02.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.019+0000 7efc5b130700 1 -- 172.21.15.26:0/3869313172 shutdown_connections 2023-10-01T07:55:02.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.019+0000 7efc5b130700 1 --2- 172.21.15.26:0/3869313172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc54136a70 0x7efc54138e50 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:02.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.019+0000 7efc5b130700 1 --2- 172.21.15.26:0/3869313172 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc5409d9f0 0x7efc54136530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:02.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.019+0000 7efc5b130700 1 -- 172.21.15.26:0/3869313172 >> 172.21.15.26:0/3869313172 conn(0x7efc54066f50 msgr2=0x7efc5409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:02.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.019+0000 7efc5b130700 1 -- 172.21.15.26:0/3869313172 shutdown_connections 2023-10-01T07:55:02.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.020+0000 7efc5b130700 1 -- 172.21.15.26:0/3869313172 wait complete. 2023-10-01T07:55:02.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.021+0000 7efc5b130700 1 Processor -- start 2023-10-01T07:55:02.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.021+0000 7efc5b130700 1 -- start start 2023-10-01T07:55:02.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.022+0000 7efc5b130700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc5409d9f0 0x7efc54070d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:02.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.022+0000 7efc5b130700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efc541316c0 0x7efc540712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:02.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.022+0000 7efc5b130700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc54136a70 0x7efc540717f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:02.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.022+0000 7efc5b130700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5406ffb0 con 0x7efc54136a70 2023-10-01T07:55:02.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.022+0000 7efc5b130700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc54070190 con 0x7efc541316c0 2023-10-01T07:55:02.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.022+0000 7efc5b130700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc54072690 con 0x7efc5409d9f0 2023-10-01T07:55:02.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.022+0000 7efc596cd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc54136a70 0x7efc540717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:02.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.022+0000 7efc596cd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc54136a70 0x7efc540717f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60910/0 (socket says 172.21.15.26:60910) 2023-10-01T07:55:02.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.022+0000 7efc596cd700 1 -- 172.21.15.26:0/3583003853 learned_addr learned my addr 172.21.15.26:0/3583003853 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:02.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.022+0000 7efc53fff700 1 --2- 172.21.15.26:0/3583003853 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efc541316c0 0x7efc540712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:02.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.022+0000 7efc58ecc700 1 --2- 172.21.15.26:0/3583003853 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc5409d9f0 0x7efc54070d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:02.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.023+0000 7efc596cd700 1 -- 172.21.15.26:0/3583003853 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc5409d9f0 msgr2=0x7efc54070d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:02.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.023+0000 7efc596cd700 1 --2- 172.21.15.26:0/3583003853 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc5409d9f0 0x7efc54070d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:02.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.023+0000 7efc596cd700 1 -- 172.21.15.26:0/3583003853 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efc541316c0 msgr2=0x7efc540712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:02.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.023+0000 7efc596cd700 1 --2- 172.21.15.26:0/3583003853 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efc541316c0 0x7efc540712b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:02.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.023+0000 7efc596cd700 1 -- 172.21.15.26:0/3583003853 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4c009a70 con 0x7efc54136a70 2023-10-01T07:55:02.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.023+0000 7efc596cd700 1 --2- 172.21.15.26:0/3583003853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc54136a70 0x7efc540717f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efc5409e4a0 tx=0x7efc4c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:02.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.023+0000 7efc517fa700 1 -- 172.21.15.26:0/3583003853 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c012430 con 0x7efc54136a70 2023-10-01T07:55:02.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.023+0000 7efc517fa700 1 -- 172.21.15.26:0/3583003853 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4c024070 con 0x7efc54136a70 2023-10-01T07:55:02.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.023+0000 7efc5b130700 1 -- 172.21.15.26:0/3583003853 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc54138e60 con 0x7efc54136a70 2023-10-01T07:55:02.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.023+0000 7efc517fa700 1 -- 172.21.15.26:0/3583003853 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c020e80 con 0x7efc54136a70 2023-10-01T07:55:02.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.023+0000 7efc5b130700 1 -- 172.21.15.26:0/3583003853 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc54135c90 con 0x7efc54136a70 2023-10-01T07:55:02.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.024+0000 7efc517fa700 1 -- 172.21.15.26:0/3583003853 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7efc4c012810 con 0x7efc54136a70 2023-10-01T07:55:02.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.025+0000 7efc517fa700 1 -- 172.21.15.26:0/3583003853 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7efc4c026070 con 0x7efc54136a70 2023-10-01T07:55:02.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.025+0000 7efc58ecc700 1 -- 172.21.15.26:0/3583003853 >> v1:172.21.15.26:6816/126763 conn(0x7efc3802f510 legacy=0x7efc380319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:02.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.025+0000 7efc5b130700 1 -- 172.21.15.26:0/3583003853 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc5406fdd0 con 0x7efc54136a70 2023-10-01T07:55:02.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.030+0000 7efc517fa700 1 -- 172.21.15.26:0/3583003853 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efc4c030080 con 0x7efc54136a70 2023-10-01T07:55:02.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.058+0000 7f4dc60e9700 1 Processor -- start 2023-10-01T07:55:02.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.059+0000 7f4dc60e9700 1 -- start start 2023-10-01T07:55:02.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.059+0000 7f4dc60e9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dc009d6f0 0x7f4dc009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:02.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.059+0000 7f4dc60e9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4dc009e410 0x7f4dc0130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:02.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.059+0000 7f4dc60e9700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc009f130 con 0x7f4dc009e000 2023-10-01T07:55:02.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.059+0000 7f4dc60e9700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc009f520 con 0x7f4dc009e410 2023-10-01T07:55:02.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.059+0000 7f4dc60e9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc009e930 con 0x7f4dc009d6f0 2023-10-01T07:55:02.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.059+0000 7f4dbf7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dc009d6f0 0x7f4dc009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:02.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.059+0000 7f4dbf7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dc009d6f0 0x7f4dc009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33214/0 (socket says 172.21.15.26:33214) 2023-10-01T07:55:02.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.059+0000 7f4dbf7fe700 1 -- 172.21.15.26:0/1455881635 learned_addr learned my addr 172.21.15.26:0/1455881635 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:02.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.059+0000 7f4dbffff700 1 --2- 172.21.15.26:0/1455881635 >> v2:172.21.15.26:3300/0 conn(0x7f4dc009e410 0x7f4dc0130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:02.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.060+0000 7f4dbf7fe700 1 -- 172.21.15.26:0/1455881635 >> v2:172.21.15.26:3300/0 conn(0x7f4dc009e410 msgr2=0x7f4dc0130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:02.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.060+0000 7f4dbf7fe700 1 --2- 172.21.15.26:0/1455881635 >> v2:172.21.15.26:3300/0 conn(0x7f4dc009e410 0x7f4dc0130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:02.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.060+0000 7f4dbf7fe700 1 -- 172.21.15.26:0/1455881635 >> v1:172.21.15.26:6789/0 conn(0x7f4dc009e000 legacy=0x7f4dc0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:02.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.060+0000 7f4dbf7fe700 1 -- 172.21.15.26:0/1455881635 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc009b2d0 con 0x7f4dc009d6f0 2023-10-01T07:55:02.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.060+0000 7f4dbf7fe700 1 --2- 172.21.15.26:0/1455881635 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dc009d6f0 0x7f4dc009dac0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4db00098f0 tx=0x7f4db0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cb5af9a856193bb server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:02.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.060+0000 7f4dbe7fc700 1 -- 172.21.15.26:0/1455881635 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db0011830 con 0x7f4dc009d6f0 2023-10-01T07:55:02.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.060+0000 7f4dbe7fc700 1 -- 172.21.15.26:0/1455881635 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db0011990 con 0x7f4dc009d6f0 2023-10-01T07:55:02.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.060+0000 7f4dbe7fc700 1 -- 172.21.15.26:0/1455881635 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db0011d20 con 0x7f4dc009d6f0 2023-10-01T07:55:02.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.061+0000 7f4dc60e9700 1 -- 172.21.15.26:0/1455881635 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dc009d6f0 msgr2=0x7f4dc009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:02.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.061+0000 7f4dc60e9700 1 --2- 172.21.15.26:0/1455881635 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dc009d6f0 0x7f4dc009dac0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4db00098f0 tx=0x7f4db0009c00 comp rx=0 tx=0).stop 2023-10-01T07:55:02.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.061+0000 7f4dc60e9700 1 -- 172.21.15.26:0/1455881635 shutdown_connections 2023-10-01T07:55:02.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.061+0000 7f4dc60e9700 1 --2- 172.21.15.26:0/1455881635 >> v2:172.21.15.26:3300/0 conn(0x7f4dc009e410 0x7f4dc0130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:02.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.061+0000 7f4dc60e9700 1 --2- 172.21.15.26:0/1455881635 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dc009d6f0 0x7f4dc009dac0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:02.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.061+0000 7f4dc60e9700 1 -- 172.21.15.26:0/1455881635 >> 172.21.15.26:0/1455881635 conn(0x7f4dc0066f50 msgr2=0x7f4dc009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:02.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.061+0000 7f4dc60e9700 1 -- 172.21.15.26:0/1455881635 shutdown_connections 2023-10-01T07:55:02.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.062+0000 7f4dc60e9700 1 -- 172.21.15.26:0/1455881635 wait complete. 2023-10-01T07:55:02.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.063+0000 7f4dc60e9700 1 Processor -- start 2023-10-01T07:55:02.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.063+0000 7f4dc60e9700 1 -- start start 2023-10-01T07:55:02.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.064+0000 7f4dc60e9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dc009d6f0 0x7f4dc011e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:02.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.064+0000 7f4dc60e9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dc009e000 0x7f4dc011e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:02.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.064+0000 7f4dc60e9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dc009e410 0x7f4dc011eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:02.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.064+0000 7f4dc60e9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc011f510 con 0x7f4dc009e000 2023-10-01T07:55:02.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.064+0000 7f4dc60e9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc0121b10 con 0x7f4dc009d6f0 2023-10-01T07:55:02.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.064+0000 7f4dc60e9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc01303d0 con 0x7f4dc009e410 2023-10-01T07:55:02.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.064+0000 7f4dbf7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dc009d6f0 0x7f4dc011e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:02.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.064+0000 7f4dbf7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dc009d6f0 0x7f4dc011e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33228/0 (socket says 172.21.15.26:33228) 2023-10-01T07:55:02.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.064+0000 7f4dbf7fe700 1 -- 172.21.15.26:0/2037299350 learned_addr learned my addr 172.21.15.26:0/2037299350 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:02.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.064+0000 7f4dbffff700 1 --2- 172.21.15.26:0/2037299350 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dc009e410 0x7f4dc011eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:02.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.064+0000 7f4dbeffd700 1 --2- 172.21.15.26:0/2037299350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dc009e000 0x7f4dc011e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:02.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.065+0000 7f4dbffff700 1 -- 172.21.15.26:0/2037299350 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dc009d6f0 msgr2=0x7f4dc011e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:02.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.065+0000 7f4dbffff700 1 --2- 172.21.15.26:0/2037299350 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dc009d6f0 0x7f4dc011e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:02.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.065+0000 7f4dbffff700 1 -- 172.21.15.26:0/2037299350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dc009e000 msgr2=0x7f4dc011e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:02.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.065+0000 7f4dbffff700 1 --2- 172.21.15.26:0/2037299350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dc009e000 0x7f4dc011e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:02.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.065+0000 7f4dbffff700 1 -- 172.21.15.26:0/2037299350 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db0009550 con 0x7f4dc009e410 2023-10-01T07:55:02.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.065+0000 7f4dbffff700 1 --2- 172.21.15.26:0/2037299350 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dc009e410 0x7f4dc011eac0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4db8010f30 tx=0x7f4db800e3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:02.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.065+0000 7f4da7fff700 1 -- 172.21.15.26:0/2037299350 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db800e880 con 0x7f4dc009e410 2023-10-01T07:55:02.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.065+0000 7f4da7fff700 1 -- 172.21.15.26:0/2037299350 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db8011040 con 0x7f4dc009e410 2023-10-01T07:55:02.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.065+0000 7f4dc60e9700 1 -- 172.21.15.26:0/2037299350 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc01201e0 con 0x7f4dc009e410 2023-10-01T07:55:02.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.065+0000 7f4da7fff700 1 -- 172.21.15.26:0/2037299350 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db800ec40 con 0x7f4dc009e410 2023-10-01T07:55:02.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.065+0000 7f4dc60e9700 1 -- 172.21.15.26:0/2037299350 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc009c750 con 0x7f4dc009e410 2023-10-01T07:55:02.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.066+0000 7f4dc60e9700 1 -- 172.21.15.26:0/2037299350 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc01213c0 con 0x7f4dc009e410 2023-10-01T07:55:02.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.067+0000 7f4da7fff700 1 -- 172.21.15.26:0/2037299350 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4db8009070 con 0x7f4dc009e410 2023-10-01T07:55:02.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.067+0000 7f4da7fff700 1 -- 172.21.15.26:0/2037299350 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f4db80445f0 con 0x7f4dc009e410 2023-10-01T07:55:02.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.067+0000 7f4dbf7fe700 1 -- 172.21.15.26:0/2037299350 >> v1:172.21.15.26:6816/126763 conn(0x7f4dac02f510 legacy=0x7f4dac0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:02.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.076+0000 7f4da7fff700 1 -- 172.21.15.26:0/2037299350 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4db801d770 con 0x7f4dc009e410 2023-10-01T07:55:02.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.111+0000 7fedc8b51700 1 -- 172.21.15.26:0/2372991616 >> v1:172.21.15.26:6816/126763 conn(0x7feda802f510 legacy=0x7feda80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:02.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.135+0000 7fedcadb5700 1 -- 172.21.15.26:0/2372991616 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fedc40008d0 con 0x7fedc409e000 2023-10-01T07:55:02.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.136+0000 7fedc17fa700 1 -- 172.21.15.26:0/2372991616 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fedb00239c0 con 0x7fedc409e000 2023-10-01T07:55:02.136 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:02.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.138+0000 7fedcadb5700 1 -- 172.21.15.26:0/2372991616 >> v1:172.21.15.26:6816/126763 conn(0x7feda802f510 legacy=0x7feda80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:02.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.138+0000 7fedcadb5700 1 -- 172.21.15.26:0/2372991616 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedc409e000 msgr2=0x7fedc4119c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:02.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.138+0000 7fedcadb5700 1 --2- 172.21.15.26:0/2372991616 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedc409e000 0x7fedc4119c30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fedb0009130 tx=0x7fedb0004750 comp rx=0 tx=0).stop 2023-10-01T07:55:02.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.138+0000 7fedcadb5700 1 -- 172.21.15.26:0/2372991616 shutdown_connections 2023-10-01T07:55:02.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.138+0000 7fedcadb5700 1 --2- 172.21.15.26:0/2372991616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedc409e410 0x7fedc411a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:02.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.138+0000 7fedcadb5700 1 --2- 172.21.15.26:0/2372991616 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedc409d6f0 0x7fedc41196f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:02.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.138+0000 7fedcadb5700 1 --2- 172.21.15.26:0/2372991616 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedc409e000 0x7fedc4119c30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:02.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.138+0000 7fedcadb5700 1 -- 172.21.15.26:0/2372991616 >> 172.21.15.26:0/2372991616 conn(0x7fedc4066f50 msgr2=0x7fedc41bae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:02.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.138+0000 7fedcadb5700 1 -- 172.21.15.26:0/2372991616 shutdown_connections 2023-10-01T07:55:02.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.138+0000 7fedcadb5700 1 -- 172.21.15.26:0/2372991616 wait complete. 2023-10-01T07:55:02.153 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:02.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.183+0000 7fc9e51f7700 1 -- 172.21.15.26:0/2445496974 >> v1:172.21.15.26:6816/126763 conn(0x7fc9c402f510 legacy=0x7fc9c40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:02.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.215+0000 7fc9e7c5c700 1 -- 172.21.15.26:0/2445496974 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc9e00a28e0 con 0x7fc9e00a0a30 2023-10-01T07:55:02.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.215+0000 7fc9d67fc700 1 -- 172.21.15.26:0/2445496974 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc9dc010b70 con 0x7fc9e00a0a30 2023-10-01T07:55:02.215 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:02.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.217+0000 7fc9e7c5c700 1 -- 172.21.15.26:0/2445496974 >> v1:172.21.15.26:6816/126763 conn(0x7fc9c402f510 legacy=0x7fc9c40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:02.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.217+0000 7fc9e7c5c700 1 -- 172.21.15.26:0/2445496974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9e00a0a30 msgr2=0x7fc9e01212d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:02.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.217+0000 7fc9e7c5c700 1 --2- 172.21.15.26:0/2445496974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9e00a0a30 0x7fc9e01212d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc0090b0 tx=0x7fc9dc004750 comp rx=0 tx=0).stop 2023-10-01T07:55:02.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.218+0000 7fc9e7c5c700 1 -- 172.21.15.26:0/2445496974 shutdown_connections 2023-10-01T07:55:02.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.218+0000 7fc9e7c5c700 1 --2- 172.21.15.26:0/2445496974 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc9e0133fa0 0x7fc9e0121d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:02.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.218+0000 7fc9e7c5c700 1 --2- 172.21.15.26:0/2445496974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9e00a0a30 0x7fc9e01212d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:02.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.218+0000 7fc9e7c5c700 1 --2- 172.21.15.26:0/2445496974 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9e00a1340 0x7fc9e0121810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:02.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.218+0000 7fc9e7c5c700 1 -- 172.21.15.26:0/2445496974 >> 172.21.15.26:0/2445496974 conn(0x7fc9e00a6550 msgr2=0x7fc9e00a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:02.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.218+0000 7fc9e7c5c700 1 -- 172.21.15.26:0/2445496974 shutdown_connections 2023-10-01T07:55:02.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.218+0000 7fc9e7c5c700 1 -- 172.21.15.26:0/2445496974 wait complete. 2023-10-01T07:55:02.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.226+0000 7efc58ecc700 1 -- 172.21.15.26:0/3583003853 >> v1:172.21.15.26:6816/126763 conn(0x7efc3802f510 legacy=0x7efc380319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:02.232 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:02.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.246+0000 7efc5b130700 1 -- 172.21.15.26:0/3583003853 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efc54074ea0 con 0x7efc54136a70 2023-10-01T07:55:02.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.246+0000 7efc517fa700 1 -- 172.21.15.26:0/3583003853 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efc4c004040 con 0x7efc54136a70 2023-10-01T07:55:02.247 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:02.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.249+0000 7efc5b130700 1 -- 172.21.15.26:0/3583003853 >> v1:172.21.15.26:6816/126763 conn(0x7efc3802f510 legacy=0x7efc380319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:02.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.249+0000 7efc5b130700 1 -- 172.21.15.26:0/3583003853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc54136a70 msgr2=0x7efc540717f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:02.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.249+0000 7efc5b130700 1 --2- 172.21.15.26:0/3583003853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc54136a70 0x7efc540717f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efc5409e4a0 tx=0x7efc4c004ad0 comp rx=0 tx=0).stop 2023-10-01T07:55:02.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.249+0000 7efc5b130700 1 -- 172.21.15.26:0/3583003853 shutdown_connections 2023-10-01T07:55:02.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.249+0000 7efc5b130700 1 --2- 172.21.15.26:0/3583003853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc54136a70 0x7efc540717f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:02.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.249+0000 7efc5b130700 1 --2- 172.21.15.26:0/3583003853 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc5409d9f0 0x7efc54070d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:02.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.249+0000 7efc5b130700 1 --2- 172.21.15.26:0/3583003853 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efc541316c0 0x7efc540712b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:02.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.249+0000 7efc5b130700 1 -- 172.21.15.26:0/3583003853 >> 172.21.15.26:0/3583003853 conn(0x7efc54066f50 msgr2=0x7efc540a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:02.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.249+0000 7efc5b130700 1 -- 172.21.15.26:0/3583003853 shutdown_connections 2023-10-01T07:55:02.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.249+0000 7efc5b130700 1 -- 172.21.15.26:0/3583003853 wait complete. 2023-10-01T07:55:02.263 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:02.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.268+0000 7f4dbf7fe700 1 -- 172.21.15.26:0/2037299350 >> v1:172.21.15.26:6816/126763 conn(0x7f4dac02f510 legacy=0x7f4dac0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:02.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.284+0000 7f4dc60e9700 1 -- 172.21.15.26:0/2037299350 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4dc0074ea0 con 0x7f4dc009e410 2023-10-01T07:55:02.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.284+0000 7f4da7fff700 1 -- 172.21.15.26:0/2037299350 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4db802d020 con 0x7f4dc009e410 2023-10-01T07:55:02.285 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:02.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.287+0000 7f4dc60e9700 1 -- 172.21.15.26:0/2037299350 >> v1:172.21.15.26:6816/126763 conn(0x7f4dac02f510 legacy=0x7f4dac0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:02.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.287+0000 7f4dc60e9700 1 -- 172.21.15.26:0/2037299350 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dc009e410 msgr2=0x7f4dc011eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:02.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.287+0000 7f4dc60e9700 1 --2- 172.21.15.26:0/2037299350 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dc009e410 0x7f4dc011eac0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4db8010f30 tx=0x7f4db800e3a0 comp rx=0 tx=0).stop 2023-10-01T07:55:02.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.287+0000 7f4dc60e9700 1 -- 172.21.15.26:0/2037299350 shutdown_connections 2023-10-01T07:55:02.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.287+0000 7f4dc60e9700 1 --2- 172.21.15.26:0/2037299350 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dc009e410 0x7f4dc011eac0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:02.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.287+0000 7f4dc60e9700 1 --2- 172.21.15.26:0/2037299350 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dc009d6f0 0x7f4dc011e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:02.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.287+0000 7f4dc60e9700 1 --2- 172.21.15.26:0/2037299350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dc009e000 0x7f4dc011e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:02.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.287+0000 7f4dc60e9700 1 -- 172.21.15.26:0/2037299350 >> 172.21.15.26:0/2037299350 conn(0x7f4dc0066f50 msgr2=0x7f4dc00a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:02.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.287+0000 7f4dc60e9700 1 -- 172.21.15.26:0/2037299350 shutdown_connections 2023-10-01T07:55:02.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:02.287+0000 7f4dc60e9700 1 -- 172.21.15.26:0/2037299350 wait complete. 2023-10-01T07:55:02.301 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:03.155 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:03.233 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:03.264 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:03.302 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:03.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.305+0000 7f59cb618700 1 Processor -- start 2023-10-01T07:55:03.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.306+0000 7f59cb618700 1 -- start start 2023-10-01T07:55:03.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.306+0000 7f59cb618700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f59c409d6f0 0x7f59c409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:03.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.306+0000 7f59cb618700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f59c409e410 0x7f59c4130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:03.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.306+0000 7f59cb618700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c409f130 con 0x7f59c409e000 2023-10-01T07:55:03.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.306+0000 7f59cb618700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c409f520 con 0x7f59c409e410 2023-10-01T07:55:03.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.306+0000 7f59cb618700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59c409e930 con 0x7f59c409d6f0 2023-10-01T07:55:03.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.307+0000 7f59c9bb5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f59c409e410 0x7f59c4130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:03.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.307+0000 7f59c8bb3700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f59c409e000 0x7f59c4130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33512/0 (socket says 172.21.15.26:33512) 2023-10-01T07:55:03.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.307+0000 7f59c9bb5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f59c409e410 0x7f59c4130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60948/0 (socket says 172.21.15.26:60948) 2023-10-01T07:55:03.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.307+0000 7f59c8bb3700 1 -- 172.21.15.26:0/1035209278 learned_addr learned my addr 172.21.15.26:0/1035209278 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:03.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.307+0000 7f59c93b4700 1 --2- 172.21.15.26:0/1035209278 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f59c409d6f0 0x7f59c409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:03.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.307+0000 7f59c93b4700 1 -- 172.21.15.26:0/1035209278 >> v2:172.21.15.26:3300/0 conn(0x7f59c409e410 msgr2=0x7f59c4130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:03.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.307+0000 7f59c93b4700 1 --2- 172.21.15.26:0/1035209278 >> v2:172.21.15.26:3300/0 conn(0x7f59c409e410 0x7f59c4130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.307+0000 7f59c93b4700 1 -- 172.21.15.26:0/1035209278 >> v1:172.21.15.26:6789/0 conn(0x7f59c409e000 legacy=0x7f59c4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:03.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.307+0000 7f59c93b4700 1 -- 172.21.15.26:0/1035209278 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c409b2d0 con 0x7f59c409d6f0 2023-10-01T07:55:03.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.307+0000 7f59c9bb5700 1 --2- 172.21.15.26:0/1035209278 >> v2:172.21.15.26:3300/0 conn(0x7f59c409e410 0x7f59c4130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:03.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.307+0000 7f59c93b4700 1 --2- 172.21.15.26:0/1035209278 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f59c409d6f0 0x7f59c409dac0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f59c0009840 tx=0x7f59c0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc9229064d420497 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:03.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.308+0000 7f59bbfff700 1 -- 172.21.15.26:0/1035209278 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c0011830 con 0x7f59c409d6f0 2023-10-01T07:55:03.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.308+0000 7f59bbfff700 1 -- 172.21.15.26:0/1035209278 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c0011990 con 0x7f59c409d6f0 2023-10-01T07:55:03.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.308+0000 7f59bbfff700 1 -- 172.21.15.26:0/1035209278 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c0011d20 con 0x7f59c409d6f0 2023-10-01T07:55:03.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.309+0000 7f59cb618700 1 -- 172.21.15.26:0/1035209278 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f59c409d6f0 msgr2=0x7f59c409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:03.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.309+0000 7f59cb618700 1 --2- 172.21.15.26:0/1035209278 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f59c409d6f0 0x7f59c409dac0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f59c0009840 tx=0x7f59c0009b50 comp rx=0 tx=0).stop 2023-10-01T07:55:03.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.309+0000 7f59cb618700 1 -- 172.21.15.26:0/1035209278 shutdown_connections 2023-10-01T07:55:03.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.309+0000 7f59cb618700 1 --2- 172.21.15.26:0/1035209278 >> v2:172.21.15.26:3300/0 conn(0x7f59c409e410 0x7f59c4130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.309+0000 7f59cb618700 1 --2- 172.21.15.26:0/1035209278 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f59c409d6f0 0x7f59c409dac0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.309+0000 7f59cb618700 1 -- 172.21.15.26:0/1035209278 >> 172.21.15.26:0/1035209278 conn(0x7f59c4066f50 msgr2=0x7f59c409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:03.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.309+0000 7f59cb618700 1 -- 172.21.15.26:0/1035209278 shutdown_connections 2023-10-01T07:55:03.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.309+0000 7f59cb618700 1 -- 172.21.15.26:0/1035209278 wait complete. 2023-10-01T07:55:03.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.310+0000 7f59cb618700 1 Processor -- start 2023-10-01T07:55:03.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.310+0000 7f59cb618700 1 -- start start 2023-10-01T07:55:03.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.311+0000 7f59cb618700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f59c409d6f0 0x7f59c411e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:03.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.311+0000 7f59cb618700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59c409e000 0x7f59c411e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:03.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.311+0000 7f59cb618700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f59c409e410 0x7f59c411eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:03.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.311+0000 7f59cb618700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c4121b40 con 0x7f59c409e000 2023-10-01T07:55:03.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.311+0000 7f59cb618700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c409c770 con 0x7f59c409d6f0 2023-10-01T07:55:03.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.311+0000 7f59cb618700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59c40a1e90 con 0x7f59c409e410 2023-10-01T07:55:03.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.311+0000 7f59c93b4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f59c409d6f0 0x7f59c411e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:03.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.311+0000 7f59c93b4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f59c409d6f0 0x7f59c411e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33240/0 (socket says 172.21.15.26:33240) 2023-10-01T07:55:03.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.311+0000 7f59c93b4700 1 -- 172.21.15.26:0/1521272886 learned_addr learned my addr 172.21.15.26:0/1521272886 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:03.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.311+0000 7f59c8bb3700 1 --2- 172.21.15.26:0/1521272886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59c409e000 0x7f59c411e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:03.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.311+0000 7f59c93b4700 1 -- 172.21.15.26:0/1521272886 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f59c409e410 msgr2=0x7f59c411eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:03.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.311+0000 7f59c93b4700 1 --2- 172.21.15.26:0/1521272886 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f59c409e410 0x7f59c411eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.311+0000 7f59c93b4700 1 -- 172.21.15.26:0/1521272886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59c409e000 msgr2=0x7f59c411e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:03.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.311+0000 7f59c93b4700 1 --2- 172.21.15.26:0/1521272886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59c409e000 0x7f59c411e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.311+0000 7f59c93b4700 1 -- 172.21.15.26:0/1521272886 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59bc00a470 con 0x7f59c409d6f0 2023-10-01T07:55:03.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.311+0000 7f59c8bb3700 1 --2- 172.21.15.26:0/1521272886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59c409e000 0x7f59c411e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:03.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.312+0000 7f59c93b4700 1 --2- 172.21.15.26:0/1521272886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f59c409d6f0 0x7f59c411e0b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f59c0009b90 tx=0x7f59c0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:03.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.312+0000 7f59b9ffb700 1 -- 172.21.15.26:0/1521272886 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c0004510 con 0x7f59c409d6f0 2023-10-01T07:55:03.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.312+0000 7f59b9ffb700 1 -- 172.21.15.26:0/1521272886 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c00036a0 con 0x7f59c409d6f0 2023-10-01T07:55:03.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.312+0000 7f59cb618700 1 -- 172.21.15.26:0/1521272886 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c00094a0 con 0x7f59c409d6f0 2023-10-01T07:55:03.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.312+0000 7f59b9ffb700 1 -- 172.21.15.26:0/1521272886 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c0003a50 con 0x7f59c409d6f0 2023-10-01T07:55:03.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.312+0000 7f59cb618700 1 -- 172.21.15.26:0/1521272886 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c41215a0 con 0x7f59c409d6f0 2023-10-01T07:55:03.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.314+0000 7f59cb618700 1 -- 172.21.15.26:0/1521272886 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c4074ea0 con 0x7f59c409d6f0 2023-10-01T07:55:03.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.314+0000 7f59b9ffb700 1 -- 172.21.15.26:0/1521272886 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f59c0003bb0 con 0x7f59c409d6f0 2023-10-01T07:55:03.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.315+0000 7f59b9ffb700 1 -- 172.21.15.26:0/1521272886 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f59c0041440 con 0x7f59c409d6f0 2023-10-01T07:55:03.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.315+0000 7f59c8bb3700 1 -- 172.21.15.26:0/1521272886 >> v1:172.21.15.26:6816/126763 conn(0x7f59a802f510 legacy=0x7f59a80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:03.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.319+0000 7f59b9ffb700 1 -- 172.21.15.26:0/1521272886 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f59c001a420 con 0x7f59c409d6f0 2023-10-01T07:55:03.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.389+0000 7f4a44278700 1 Processor -- start 2023-10-01T07:55:03.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.390+0000 7f4a44278700 1 -- start start 2023-10-01T07:55:03.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.391+0000 7f4a44278700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4a3c130540 0x7f4a3c130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:03.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.391+0000 7f4a44278700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4a3c130e50 0x7f4a3c06f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:03.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.391+0000 7f4a44278700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a3c0716a0 con 0x7f4a3c06fb20 2023-10-01T07:55:03.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.391+0000 7f4a44278700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a3c09a390 con 0x7f4a3c130e50 2023-10-01T07:55:03.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.391+0000 7f4a44278700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3c071290 con 0x7f4a3c130540 2023-10-01T07:55:03.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.391+0000 7f4a42014700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4a3c130540 0x7f4a3c130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:03.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.391+0000 7f4a42815700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4a3c06fb20 0x7f4a3c137560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33526/0 (socket says 172.21.15.26:33526) 2023-10-01T07:55:03.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.391+0000 7f4a41813700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4a3c130e50 0x7f4a3c06f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:03.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.391+0000 7f4a42815700 1 -- 172.21.15.26:0/2514594297 learned_addr learned my addr 172.21.15.26:0/2514594297 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:03.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.391+0000 7f4a41813700 1 -- 172.21.15.26:0/2514594297 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4a3c130540 msgr2=0x7f4a3c130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:03.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.391+0000 7f4a41813700 1 --2- 172.21.15.26:0/2514594297 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4a3c130540 0x7f4a3c130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.391+0000 7f4a41813700 1 -- 172.21.15.26:0/2514594297 >> v1:172.21.15.26:6789/0 conn(0x7f4a3c06fb20 legacy=0x7f4a3c137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:03.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.391+0000 7f4a41012700 1 -- 172.21.15.26:0/2514594297 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3560206199 0 0) 0x7f4a3c0716a0 con 0x7f4a3c06fb20 2023-10-01T07:55:03.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.391+0000 7f4a41813700 1 -- 172.21.15.26:0/2514594297 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a3c130340 con 0x7f4a3c130e50 2023-10-01T07:55:03.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.391+0000 7f4a42014700 1 --2- 172.21.15.26:0/2514594297 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4a3c130540 0x7f4a3c130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:03.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.392+0000 7f4a41813700 1 --2- 172.21.15.26:0/2514594297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a3c130e50 0x7f4a3c06f5e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c009840 tx=0x7f4a2c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d3d84f4eed22d77 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:03.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.392+0000 7f4a41012700 1 -- 172.21.15.26:0/2514594297 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c011830 con 0x7f4a3c130e50 2023-10-01T07:55:03.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.392+0000 7f4a41012700 1 -- 172.21.15.26:0/2514594297 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2c011990 con 0x7f4a3c130e50 2023-10-01T07:55:03.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.392+0000 7f4a41012700 1 -- 172.21.15.26:0/2514594297 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c011d20 con 0x7f4a3c130e50 2023-10-01T07:55:03.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.393+0000 7f4a44278700 1 -- 172.21.15.26:0/2514594297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a3c130e50 msgr2=0x7f4a3c06f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:03.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.393+0000 7f4a44278700 1 --2- 172.21.15.26:0/2514594297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a3c130e50 0x7f4a3c06f5e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c009840 tx=0x7f4a2c009b50 comp rx=0 tx=0).stop 2023-10-01T07:55:03.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.393+0000 7f4a44278700 1 -- 172.21.15.26:0/2514594297 shutdown_connections 2023-10-01T07:55:03.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.393+0000 7f4a44278700 1 --2- 172.21.15.26:0/2514594297 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4a3c130540 0x7f4a3c130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.393+0000 7f4a44278700 1 --2- 172.21.15.26:0/2514594297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a3c130e50 0x7f4a3c06f5e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.393+0000 7f4a44278700 1 -- 172.21.15.26:0/2514594297 >> 172.21.15.26:0/2514594297 conn(0x7f4a3c0a2aa0 msgr2=0x7f4a3c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:03.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.393+0000 7f4a44278700 1 -- 172.21.15.26:0/2514594297 shutdown_connections 2023-10-01T07:55:03.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.393+0000 7f4a44278700 1 -- 172.21.15.26:0/2514594297 wait complete. 2023-10-01T07:55:03.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.394+0000 7f4a44278700 1 Processor -- start 2023-10-01T07:55:03.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.394+0000 7f4a44278700 1 -- start start 2023-10-01T07:55:03.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.395+0000 7f4a44278700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4a3c06fb20 0x7f4a3c11a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:03.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.395+0000 7f4a44278700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a3c130540 0x7f4a3c11a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:03.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.395+0000 7f4a44278700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4a3c130e50 0x7f4a3c11af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:03.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.395+0000 7f4a44278700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3c11e990 con 0x7f4a3c130540 2023-10-01T07:55:03.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.395+0000 7f4a44278700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3c11dfd0 con 0x7f4a3c06fb20 2023-10-01T07:55:03.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.395+0000 7f4a44278700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3c11c160 con 0x7f4a3c130e50 2023-10-01T07:55:03.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.395+0000 7f4a41813700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a3c130540 0x7f4a3c11a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:03.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.395+0000 7f4a41813700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a3c130540 0x7f4a3c11a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60982/0 (socket says 172.21.15.26:60982) 2023-10-01T07:55:03.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.395+0000 7f4a42014700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4a3c06fb20 0x7f4a3c11a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:03.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.395+0000 7f4a41813700 1 -- 172.21.15.26:0/786718697 learned_addr learned my addr 172.21.15.26:0/786718697 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:03.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.395+0000 7f4a42815700 1 --2- 172.21.15.26:0/786718697 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4a3c130e50 0x7f4a3c11af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:03.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.396+0000 7f4a42815700 1 -- 172.21.15.26:0/786718697 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4a3c06fb20 msgr2=0x7f4a3c11a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:03.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.396+0000 7f4a42815700 1 --2- 172.21.15.26:0/786718697 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4a3c06fb20 0x7f4a3c11a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.396+0000 7f4a42815700 1 -- 172.21.15.26:0/786718697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a3c130540 msgr2=0x7f4a3c11a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:03.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.396+0000 7f4a42815700 1 --2- 172.21.15.26:0/786718697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a3c130540 0x7f4a3c11a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.396+0000 7f4a42815700 1 -- 172.21.15.26:0/786718697 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a3800da70 con 0x7f4a3c130e50 2023-10-01T07:55:03.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.396+0000 7f4a42815700 1 --2- 172.21.15.26:0/786718697 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4a3c130e50 0x7f4a3c11af30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4a3400cc10 tx=0x7f4a3400cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:03.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.396+0000 7f4a32ffd700 1 -- 172.21.15.26:0/786718697 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3400aa60 con 0x7f4a3c130e50 2023-10-01T07:55:03.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.396+0000 7f4a32ffd700 1 -- 172.21.15.26:0/786718697 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3400abc0 con 0x7f4a3c130e50 2023-10-01T07:55:03.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.396+0000 7f4a44278700 1 -- 172.21.15.26:0/786718697 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a2c0094a0 con 0x7f4a3c130e50 2023-10-01T07:55:03.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.396+0000 7f4a32ffd700 1 -- 172.21.15.26:0/786718697 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a340070d0 con 0x7f4a3c130e50 2023-10-01T07:55:03.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.396+0000 7f4a44278700 1 -- 172.21.15.26:0/786718697 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a3c11d380 con 0x7f4a3c130e50 2023-10-01T07:55:03.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.397+0000 7f4a32ffd700 1 -- 172.21.15.26:0/786718697 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4a34007230 con 0x7f4a3c130e50 2023-10-01T07:55:03.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.398+0000 7f4a32ffd700 1 -- 172.21.15.26:0/786718697 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f4a3403f990 con 0x7f4a3c130e50 2023-10-01T07:55:03.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.398+0000 7f4a42014700 1 -- 172.21.15.26:0/786718697 >> v1:172.21.15.26:6816/126763 conn(0x7f4a2002f510 legacy=0x7f4a200319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:03.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.398+0000 7f4a44278700 1 -- 172.21.15.26:0/786718697 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a3c09cd40 con 0x7f4a3c130e50 2023-10-01T07:55:03.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.407+0000 7f4a32ffd700 1 -- 172.21.15.26:0/786718697 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4a34018070 con 0x7f4a3c130e50 2023-10-01T07:55:03.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.429+0000 7f995a529700 1 Processor -- start 2023-10-01T07:55:03.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.430+0000 7f995a529700 1 -- start start 2023-10-01T07:55:03.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.430+0000 7f995a529700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f995406a770 0x7f995409d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:03.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.430+0000 7f995a529700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f995409dc30 0x7f995409e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:03.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.430+0000 7f995a529700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f995413c1e0 0x7f995413e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:03.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.430+0000 7f995a529700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f995406ab40 con 0x7f995409dc30 2023-10-01T07:55:03.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.430+0000 7f995a529700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f995409ebc0 con 0x7f995406a770 2023-10-01T07:55:03.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.430+0000 7f995a529700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f995409a810 con 0x7f995413c1e0 2023-10-01T07:55:03.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.431+0000 7f9958ac6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f995413c1e0 0x7f995413e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:03.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.431+0000 7f9958ac6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f995413c1e0 0x7f995413e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35582/0 (socket says 172.21.15.26:35582) 2023-10-01T07:55:03.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.431+0000 7f9958ac6700 1 -- 172.21.15.26:0/2881545348 learned_addr learned my addr 172.21.15.26:0/2881545348 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:03.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.431+0000 7f99537fe700 1 --2- 172.21.15.26:0/2881545348 >> v2:172.21.15.26:3300/0 conn(0x7f995409dc30 0x7f995409e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:03.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.431+0000 7f9958ac6700 1 -- 172.21.15.26:0/2881545348 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f995406a770 msgr2=0x7f995409d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:03.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.431+0000 7f9953fff700 1 --2- 172.21.15.26:0/2881545348 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f995406a770 0x7f995409d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:03.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.431+0000 7f9958ac6700 1 --2- 172.21.15.26:0/2881545348 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f995406a770 0x7f995409d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.431+0000 7f9958ac6700 1 -- 172.21.15.26:0/2881545348 >> v2:172.21.15.26:3300/0 conn(0x7f995409dc30 msgr2=0x7f995409e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:03.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.431+0000 7f9958ac6700 1 --2- 172.21.15.26:0/2881545348 >> v2:172.21.15.26:3300/0 conn(0x7f995409dc30 0x7f995409e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.431+0000 7f9958ac6700 1 -- 172.21.15.26:0/2881545348 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f995409e920 con 0x7f995413c1e0 2023-10-01T07:55:03.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.431+0000 7f9953fff700 1 --2- 172.21.15.26:0/2881545348 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f995406a770 0x7f995409d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:55:03.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.431+0000 7f9958ac6700 1 --2- 172.21.15.26:0/2881545348 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f995413c1e0 0x7f995413e5c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f994c009e80 tx=0x7f994c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb4c16cbf3abf99 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:03.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.432+0000 7f9952ffd700 1 -- 172.21.15.26:0/2881545348 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c00e070 con 0x7f995413c1e0 2023-10-01T07:55:03.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.432+0000 7f9952ffd700 1 -- 172.21.15.26:0/2881545348 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994c00b8d0 con 0x7f995413c1e0 2023-10-01T07:55:03.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.432+0000 7f9952ffd700 1 -- 172.21.15.26:0/2881545348 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c00bc80 con 0x7f995413c1e0 2023-10-01T07:55:03.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.432+0000 7f995a529700 1 -- 172.21.15.26:0/2881545348 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f995413c1e0 msgr2=0x7f995413e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:03.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.432+0000 7f995a529700 1 --2- 172.21.15.26:0/2881545348 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f995413c1e0 0x7f995413e5c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f994c009e80 tx=0x7f994c00b330 comp rx=0 tx=0).stop 2023-10-01T07:55:03.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.432+0000 7f995a529700 1 -- 172.21.15.26:0/2881545348 shutdown_connections 2023-10-01T07:55:03.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.432+0000 7f995a529700 1 --2- 172.21.15.26:0/2881545348 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f995413c1e0 0x7f995413e5c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.432+0000 7f995a529700 1 --2- 172.21.15.26:0/2881545348 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f995406a770 0x7f995409d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.432+0000 7f995a529700 1 --2- 172.21.15.26:0/2881545348 >> v2:172.21.15.26:3300/0 conn(0x7f995409dc30 0x7f995409e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.432+0000 7f995a529700 1 -- 172.21.15.26:0/2881545348 >> 172.21.15.26:0/2881545348 conn(0x7f9954066f50 msgr2=0x7f995409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:03.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.433+0000 7f995a529700 1 -- 172.21.15.26:0/2881545348 shutdown_connections 2023-10-01T07:55:03.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.433+0000 7f995a529700 1 -- 172.21.15.26:0/2881545348 wait complete. 2023-10-01T07:55:03.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.434+0000 7f995a529700 1 Processor -- start 2023-10-01T07:55:03.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.434+0000 7f995a529700 1 -- start start 2023-10-01T07:55:03.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.434+0000 7f995a529700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f995406a770 0x7f995411c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:03.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.434+0000 7f995a529700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f995409dc30 0x7f995412dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:03.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.434+0000 7f995a529700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f995413c1e0 0x7f995412e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:03.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.434+0000 7f995a529700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9954131840 con 0x7f995406a770 2023-10-01T07:55:03.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.434+0000 7f995a529700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9954131a20 con 0x7f995413c1e0 2023-10-01T07:55:03.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.434+0000 7f995a529700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f995412fed0 con 0x7f995409dc30 2023-10-01T07:55:03.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.434+0000 7f9958ac6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f995413c1e0 0x7f995412e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:03.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.435+0000 7f9958ac6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f995413c1e0 0x7f995412e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45856/0 (socket says 172.21.15.26:45856) 2023-10-01T07:55:03.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.435+0000 7f9958ac6700 1 -- 172.21.15.26:0/1001400203 learned_addr learned my addr 172.21.15.26:0/1001400203 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:03.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.435+0000 7f99537fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f995409dc30 0x7f995412dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:03.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.435+0000 7f9953fff700 1 --2- 172.21.15.26:0/1001400203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f995406a770 0x7f995411c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:03.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.435+0000 7f9958ac6700 1 -- 172.21.15.26:0/1001400203 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f995409dc30 msgr2=0x7f995412dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:03.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.435+0000 7f9958ac6700 1 --2- 172.21.15.26:0/1001400203 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f995409dc30 0x7f995412dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.435+0000 7f9958ac6700 1 -- 172.21.15.26:0/1001400203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f995406a770 msgr2=0x7f995411c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:03.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.435+0000 7f9958ac6700 1 --2- 172.21.15.26:0/1001400203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f995406a770 0x7f995411c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.435+0000 7f9958ac6700 1 -- 172.21.15.26:0/1001400203 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f994c009b30 con 0x7f995413c1e0 2023-10-01T07:55:03.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.435+0000 7f9958ac6700 1 --2- 172.21.15.26:0/1001400203 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f995413c1e0 0x7f995412e0e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f994c00b680 tx=0x7f994c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:03.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.435+0000 7f9950ff9700 1 -- 172.21.15.26:0/1001400203 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c004450 con 0x7f995413c1e0 2023-10-01T07:55:03.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.435+0000 7f9950ff9700 1 -- 172.21.15.26:0/1001400203 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994c0045b0 con 0x7f995413c1e0 2023-10-01T07:55:03.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.435+0000 7f9950ff9700 1 -- 172.21.15.26:0/1001400203 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c004960 con 0x7f995413c1e0 2023-10-01T07:55:03.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.435+0000 7f995a529700 1 -- 172.21.15.26:0/1001400203 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99540a3740 con 0x7f995413c1e0 2023-10-01T07:55:03.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.436+0000 7f995a529700 1 -- 172.21.15.26:0/1001400203 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f995412fbc0 con 0x7f995413c1e0 2023-10-01T07:55:03.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.437+0000 7f9950ff9700 1 -- 172.21.15.26:0/1001400203 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f994c01c410 con 0x7f995413c1e0 2023-10-01T07:55:03.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.437+0000 7f995a529700 1 -- 172.21.15.26:0/1001400203 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9954071700 con 0x7f995413c1e0 2023-10-01T07:55:03.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.437+0000 7f9950ff9700 1 -- 172.21.15.26:0/1001400203 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f994c041590 con 0x7f995413c1e0 2023-10-01T07:55:03.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.437+0000 7f9953fff700 1 -- 172.21.15.26:0/1001400203 >> v1:172.21.15.26:6816/126763 conn(0x7f994002f510 legacy=0x7f99400319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:03.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.446+0000 7f9950ff9700 1 -- 172.21.15.26:0/1001400203 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f994c01c6c0 con 0x7f995413c1e0 2023-10-01T07:55:03.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.458+0000 7f92e686d700 1 Processor -- start 2023-10-01T07:55:03.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.458+0000 7f92e686d700 1 -- start start 2023-10-01T07:55:03.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.459+0000 7f92e686d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f92e009d6f0 0x7f92e009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:03.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.459+0000 7f92e686d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92e009e000 0x7f92e0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:03.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.459+0000 7f92e686d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92e009f130 con 0x7f92e009e410 2023-10-01T07:55:03.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.459+0000 7f92e686d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92e009f520 con 0x7f92e009d6f0 2023-10-01T07:55:03.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.459+0000 7f92e686d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92e009e930 con 0x7f92e009e000 2023-10-01T07:55:03.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.459+0000 7f92dffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f92e009d6f0 0x7f92e009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:03.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.459+0000 7f92dffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f92e009d6f0 0x7f92e009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53552/0 (socket says 172.21.15.26:53552) 2023-10-01T07:55:03.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.459+0000 7f92dffff700 1 -- 172.21.15.26:0/294124718 learned_addr learned my addr 172.21.15.26:0/294124718 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:03.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.459+0000 7f92e4e0a700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f92e009e410 0x7f92e0130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54908/0 (socket says 172.21.15.26:54908) 2023-10-01T07:55:03.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.459+0000 7f92df7fe700 1 --2- 172.21.15.26:0/294124718 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92e009e000 0x7f92e0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:03.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.459+0000 7f92dffff700 1 -- 172.21.15.26:0/294124718 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92e009e000 msgr2=0x7f92e0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:03.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.459+0000 7f92dffff700 1 --2- 172.21.15.26:0/294124718 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92e009e000 0x7f92e0130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.459+0000 7f92dffff700 1 -- 172.21.15.26:0/294124718 >> v1:172.21.15.26:6789/0 conn(0x7f92e009e410 legacy=0x7f92e0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:03.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.459+0000 7f92dffff700 1 -- 172.21.15.26:0/294124718 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e009b2d0 con 0x7f92e009d6f0 2023-10-01T07:55:03.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.460+0000 7f92dffff700 1 --2- 172.21.15.26:0/294124718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92e009d6f0 0x7f92e009dac0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f92d000bb90 tx=0x7f92d000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad6e45e88fa8edcb server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:03.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.460+0000 7f92deffd700 1 -- 172.21.15.26:0/294124718 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d000dd30 con 0x7f92e009d6f0 2023-10-01T07:55:03.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.460+0000 7f92deffd700 1 -- 172.21.15.26:0/294124718 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d000de90 con 0x7f92e009d6f0 2023-10-01T07:55:03.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.460+0000 7f92deffd700 1 -- 172.21.15.26:0/294124718 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d0010690 con 0x7f92e009d6f0 2023-10-01T07:55:03.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.460+0000 7f92e686d700 1 -- 172.21.15.26:0/294124718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92e009d6f0 msgr2=0x7f92e009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:03.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.460+0000 7f92e686d700 1 --2- 172.21.15.26:0/294124718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92e009d6f0 0x7f92e009dac0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f92d000bb90 tx=0x7f92d000bea0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.461+0000 7f92e686d700 1 -- 172.21.15.26:0/294124718 shutdown_connections 2023-10-01T07:55:03.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.461+0000 7f92e686d700 1 --2- 172.21.15.26:0/294124718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92e009d6f0 0x7f92e009dac0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.461+0000 7f92e686d700 1 --2- 172.21.15.26:0/294124718 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92e009e000 0x7f92e0130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.461+0000 7f92e686d700 1 -- 172.21.15.26:0/294124718 >> 172.21.15.26:0/294124718 conn(0x7f92e0066f50 msgr2=0x7f92e009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:03.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.461+0000 7f92e686d700 1 -- 172.21.15.26:0/294124718 shutdown_connections 2023-10-01T07:55:03.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.461+0000 7f92e686d700 1 -- 172.21.15.26:0/294124718 wait complete. 2023-10-01T07:55:03.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.462+0000 7f92e686d700 1 Processor -- start 2023-10-01T07:55:03.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.462+0000 7f92e686d700 1 -- start start 2023-10-01T07:55:03.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.462+0000 7f92e686d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92e009d6f0 0x7f92e0122450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:03.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.462+0000 7f92e686d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92e009e000 0x7f92e0122990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:03.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.463+0000 7f92e686d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92e009e410 0x7f92e0122ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:03.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.463+0000 7f92e686d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e0125ee0 con 0x7f92e009e410 2023-10-01T07:55:03.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.463+0000 7f92e686d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e0123fd0 con 0x7f92e009d6f0 2023-10-01T07:55:03.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.463+0000 7f92e686d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92e00a1d90 con 0x7f92e009e000 2023-10-01T07:55:03.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.463+0000 7f92df7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92e009e000 0x7f92e0122990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:03.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.463+0000 7f92df7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92e009e000 0x7f92e0122990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35598/0 (socket says 172.21.15.26:35598) 2023-10-01T07:55:03.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.463+0000 7f92df7fe700 1 -- 172.21.15.26:0/1715200879 learned_addr learned my addr 172.21.15.26:0/1715200879 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:03.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.463+0000 7f92e4e0a700 1 --2- 172.21.15.26:0/1715200879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92e009e410 0x7f92e0122ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:03.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.463+0000 7f92df7fe700 1 -- 172.21.15.26:0/1715200879 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92e009d6f0 msgr2=0x7f92e0122450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:03.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.463+0000 7f92df7fe700 1 --2- 172.21.15.26:0/1715200879 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92e009d6f0 0x7f92e0122450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.463+0000 7f92df7fe700 1 -- 172.21.15.26:0/1715200879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92e009e410 msgr2=0x7f92e0122ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:03.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.463+0000 7f92df7fe700 1 --2- 172.21.15.26:0/1715200879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92e009e410 0x7f92e0122ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.463+0000 7f92df7fe700 1 -- 172.21.15.26:0/1715200879 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d000b7f0 con 0x7f92e009e000 2023-10-01T07:55:03.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.463+0000 7f92df7fe700 1 --2- 172.21.15.26:0/1715200879 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92e009e000 0x7f92e0122990 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f92d400e9d0 tx=0x7f92d400ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:03.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.464+0000 7f92dcff9700 1 -- 172.21.15.26:0/1715200879 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d4009730 con 0x7f92e009e000 2023-10-01T07:55:03.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.464+0000 7f92dcff9700 1 -- 172.21.15.26:0/1715200879 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d400c850 con 0x7f92e009e000 2023-10-01T07:55:03.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.464+0000 7f92e686d700 1 -- 172.21.15.26:0/1715200879 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e009c700 con 0x7f92e009e000 2023-10-01T07:55:03.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.464+0000 7f92dcff9700 1 -- 172.21.15.26:0/1715200879 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d400cbe0 con 0x7f92e009e000 2023-10-01T07:55:03.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.464+0000 7f92e686d700 1 -- 172.21.15.26:0/1715200879 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92e01247c0 con 0x7f92e009e000 2023-10-01T07:55:03.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.465+0000 7f92e686d700 1 -- 172.21.15.26:0/1715200879 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92e0074ea0 con 0x7f92e009e000 2023-10-01T07:55:03.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.465+0000 7f92dcff9700 1 -- 172.21.15.26:0/1715200879 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f92d400cd40 con 0x7f92e009e000 2023-10-01T07:55:03.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.465+0000 7f92dffff700 1 -- 172.21.15.26:0/1715200879 >> v1:172.21.15.26:6816/126763 conn(0x7f92cc02f510 legacy=0x7f92cc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:03.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.465+0000 7f92dcff9700 1 -- 172.21.15.26:0/1715200879 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f92d4041730 con 0x7f92e009e000 2023-10-01T07:55:03.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.470+0000 7f92dcff9700 1 -- 172.21.15.26:0/1715200879 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f92d4045060 con 0x7f92e009e000 2023-10-01T07:55:03.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.516+0000 7f59c8bb3700 1 -- 172.21.15.26:0/1521272886 >> v1:172.21.15.26:6816/126763 conn(0x7f59a802f510 legacy=0x7f59a80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:03.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.592+0000 7f59cb618700 1 -- 172.21.15.26:0/1521272886 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f59c406c360 con 0x7f59c409d6f0 2023-10-01T07:55:03.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.593+0000 7f59b9ffb700 1 -- 172.21.15.26:0/1521272886 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f59c0015020 con 0x7f59c409d6f0 2023-10-01T07:55:03.593 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:03.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.595+0000 7f59cb618700 1 -- 172.21.15.26:0/1521272886 >> v1:172.21.15.26:6816/126763 conn(0x7f59a802f510 legacy=0x7f59a80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:03.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.595+0000 7f59cb618700 1 -- 172.21.15.26:0/1521272886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f59c409d6f0 msgr2=0x7f59c411e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:03.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.595+0000 7f59cb618700 1 --2- 172.21.15.26:0/1521272886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f59c409d6f0 0x7f59c411e0b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f59c0009b90 tx=0x7f59c0004750 comp rx=0 tx=0).stop 2023-10-01T07:55:03.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.595+0000 7f59cb618700 1 -- 172.21.15.26:0/1521272886 shutdown_connections 2023-10-01T07:55:03.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.595+0000 7f59cb618700 1 --2- 172.21.15.26:0/1521272886 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f59c409e410 0x7f59c411eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.595+0000 7f59cb618700 1 --2- 172.21.15.26:0/1521272886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f59c409d6f0 0x7f59c411e0b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.595+0000 7f59cb618700 1 --2- 172.21.15.26:0/1521272886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59c409e000 0x7f59c411e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.595+0000 7f59cb618700 1 -- 172.21.15.26:0/1521272886 >> 172.21.15.26:0/1521272886 conn(0x7f59c4066f50 msgr2=0x7f59c40a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:03.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.595+0000 7f59cb618700 1 -- 172.21.15.26:0/1521272886 shutdown_connections 2023-10-01T07:55:03.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.596+0000 7f59cb618700 1 -- 172.21.15.26:0/1521272886 wait complete. 2023-10-01T07:55:03.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.599+0000 7f4a42014700 1 -- 172.21.15.26:0/786718697 >> v1:172.21.15.26:6816/126763 conn(0x7f4a2002f510 legacy=0x7f4a200319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:03.610 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:03.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.638+0000 7f9953fff700 1 -- 172.21.15.26:0/1001400203 >> v1:172.21.15.26:6816/126763 conn(0x7f994002f510 legacy=0x7f99400319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:03.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.658+0000 7f995a529700 1 -- 172.21.15.26:0/1001400203 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9954074ea0 con 0x7f995413c1e0 2023-10-01T07:55:03.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.658+0000 7f9950ff9700 1 -- 172.21.15.26:0/1001400203 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f994c02a090 con 0x7f995413c1e0 2023-10-01T07:55:03.659 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:03.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.660+0000 7f995a529700 1 -- 172.21.15.26:0/1001400203 >> v1:172.21.15.26:6816/126763 conn(0x7f994002f510 legacy=0x7f99400319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:03.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.660+0000 7f995a529700 1 -- 172.21.15.26:0/1001400203 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f995413c1e0 msgr2=0x7f995412e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:03.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.660+0000 7f995a529700 1 --2- 172.21.15.26:0/1001400203 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f995413c1e0 0x7f995412e0e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f994c00b680 tx=0x7f994c004ad0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.660+0000 7f995a529700 1 -- 172.21.15.26:0/1001400203 shutdown_connections 2023-10-01T07:55:03.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.660+0000 7f995a529700 1 --2- 172.21.15.26:0/1001400203 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f995413c1e0 0x7f995412e0e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.660+0000 7f995a529700 1 --2- 172.21.15.26:0/1001400203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f995406a770 0x7f995411c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.660+0000 7f995a529700 1 --2- 172.21.15.26:0/1001400203 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f995409dc30 0x7f995412dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.660+0000 7f995a529700 1 -- 172.21.15.26:0/1001400203 >> 172.21.15.26:0/1001400203 conn(0x7f9954066f50 msgr2=0x7f995406e840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:03.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.661+0000 7f995a529700 1 -- 172.21.15.26:0/1001400203 shutdown_connections 2023-10-01T07:55:03.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.661+0000 7f995a529700 1 -- 172.21.15.26:0/1001400203 wait complete. 2023-10-01T07:55:03.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.667+0000 7f92dffff700 1 -- 172.21.15.26:0/1715200879 >> v1:172.21.15.26:6816/126763 conn(0x7f92cc02f510 legacy=0x7f92cc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:03.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.673+0000 7f4a44278700 1 -- 172.21.15.26:0/786718697 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4a3c11cf20 con 0x7f4a3c130e50 2023-10-01T07:55:03.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.674+0000 7f4a32ffd700 1 -- 172.21.15.26:0/786718697 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4a3401a8b0 con 0x7f4a3c130e50 2023-10-01T07:55:03.675 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:03.675 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:03.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.676+0000 7f4a44278700 1 -- 172.21.15.26:0/786718697 >> v1:172.21.15.26:6816/126763 conn(0x7f4a2002f510 legacy=0x7f4a200319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:03.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.676+0000 7f4a44278700 1 -- 172.21.15.26:0/786718697 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4a3c130e50 msgr2=0x7f4a3c11af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:03.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.676+0000 7f4a44278700 1 --2- 172.21.15.26:0/786718697 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4a3c130e50 0x7f4a3c11af30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4a3400cc10 tx=0x7f4a3400cf20 comp rx=0 tx=0).stop 2023-10-01T07:55:03.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.676+0000 7f4a44278700 1 -- 172.21.15.26:0/786718697 shutdown_connections 2023-10-01T07:55:03.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.676+0000 7f4a44278700 1 --2- 172.21.15.26:0/786718697 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4a3c130e50 0x7f4a3c11af30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.676+0000 7f4a44278700 1 --2- 172.21.15.26:0/786718697 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4a3c06fb20 0x7f4a3c11a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.676+0000 7f4a44278700 1 --2- 172.21.15.26:0/786718697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a3c130540 0x7f4a3c11a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.676+0000 7f4a44278700 1 -- 172.21.15.26:0/786718697 >> 172.21.15.26:0/786718697 conn(0x7f4a3c0a2aa0 msgr2=0x7f4a3c12d450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:03.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.676+0000 7f4a44278700 1 -- 172.21.15.26:0/786718697 shutdown_connections 2023-10-01T07:55:03.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.676+0000 7f4a44278700 1 -- 172.21.15.26:0/786718697 wait complete. 2023-10-01T07:55:03.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.677+0000 7f92e686d700 1 -- 172.21.15.26:0/1715200879 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f92e006c360 con 0x7f92e009e000 2023-10-01T07:55:03.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.678+0000 7f92dcff9700 1 -- 172.21.15.26:0/1715200879 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f92d4045090 con 0x7f92e009e000 2023-10-01T07:55:03.679 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:03.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.680+0000 7f92e686d700 1 -- 172.21.15.26:0/1715200879 >> v1:172.21.15.26:6816/126763 conn(0x7f92cc02f510 legacy=0x7f92cc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:03.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.680+0000 7f92e686d700 1 -- 172.21.15.26:0/1715200879 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92e009e000 msgr2=0x7f92e0122990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:03.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.680+0000 7f92e686d700 1 --2- 172.21.15.26:0/1715200879 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92e009e000 0x7f92e0122990 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f92d400e9d0 tx=0x7f92d400ece0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.680+0000 7f92e686d700 1 -- 172.21.15.26:0/1715200879 shutdown_connections 2023-10-01T07:55:03.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.680+0000 7f92e686d700 1 --2- 172.21.15.26:0/1715200879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92e009e410 0x7f92e0122ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.680+0000 7f92e686d700 1 --2- 172.21.15.26:0/1715200879 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92e009d6f0 0x7f92e0122450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.680+0000 7f92e686d700 1 --2- 172.21.15.26:0/1715200879 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92e009e000 0x7f92e0122990 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:03.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.680+0000 7f92e686d700 1 -- 172.21.15.26:0/1715200879 >> 172.21.15.26:0/1715200879 conn(0x7f92e0066f50 msgr2=0x7f92e006f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:03.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.680+0000 7f92e686d700 1 -- 172.21.15.26:0/1715200879 shutdown_connections 2023-10-01T07:55:03.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:03.680+0000 7f92e686d700 1 -- 172.21.15.26:0/1715200879 wait complete. 2023-10-01T07:55:03.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:03.695 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:04.611 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:04.676 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:04.693 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:04.696 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:04.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.761+0000 7ff510d85700 1 Processor -- start 2023-10-01T07:55:04.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.761+0000 7ff510d85700 1 -- start start 2023-10-01T07:55:04.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.761+0000 7ff510d85700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff50c09d6f0 0x7ff50c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:04.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.761+0000 7ff510d85700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff50c09e000 0x7ff50c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:04.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.762+0000 7ff510d85700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff50c09e410 0x7ff50c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:04.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.762+0000 7ff510d85700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff50c09f520 con 0x7ff50c09e410 2023-10-01T07:55:04.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.762+0000 7ff510d85700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c09f130 con 0x7ff50c09e000 2023-10-01T07:55:04.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.762+0000 7ff510d85700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c09e930 con 0x7ff50c09d6f0 2023-10-01T07:55:04.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.762+0000 7ff50a59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff50c09d6f0 0x7ff50c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:04.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.762+0000 7ff50a59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff50c09d6f0 0x7ff50c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35614/0 (socket says 172.21.15.26:35614) 2023-10-01T07:55:04.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.762+0000 7ff50a59c700 1 -- 172.21.15.26:0/3465804079 learned_addr learned my addr 172.21.15.26:0/3465804079 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:04.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.762+0000 7ff509d9b700 1 --2- 172.21.15.26:0/3465804079 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff50c09e000 0x7ff50c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:04.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.762+0000 7ff50a59c700 1 -- 172.21.15.26:0/3465804079 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff50c09e000 msgr2=0x7ff50c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:04.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.762+0000 7ff50a59c700 1 --2- 172.21.15.26:0/3465804079 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff50c09e000 0x7ff50c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:04.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.762+0000 7ff50a59c700 1 -- 172.21.15.26:0/3465804079 >> v2:172.21.15.26:3300/0 conn(0x7ff50c09e410 msgr2=0x7ff50c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:04.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.762+0000 7ff50a59c700 1 --2- 172.21.15.26:0/3465804079 >> v2:172.21.15.26:3300/0 conn(0x7ff50c09e410 0x7ff50c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:04.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.762+0000 7ff50a59c700 1 -- 172.21.15.26:0/3465804079 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50c09b2d0 con 0x7ff50c09d6f0 2023-10-01T07:55:04.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.763+0000 7ff50a59c700 1 --2- 172.21.15.26:0/3465804079 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff50c09d6f0 0x7ff50c09dac0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc00bbc0 tx=0x7ff4fc00bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0a300bc58815e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:04.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.763+0000 7ff50959a700 1 -- 172.21.15.26:0/3465804079 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc00dc30 con 0x7ff50c09d6f0 2023-10-01T07:55:04.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.763+0000 7ff50959a700 1 -- 172.21.15.26:0/3465804079 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4fc00dd90 con 0x7ff50c09d6f0 2023-10-01T07:55:04.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.763+0000 7ff50959a700 1 -- 172.21.15.26:0/3465804079 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc012990 con 0x7ff50c09d6f0 2023-10-01T07:55:04.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.764+0000 7ff510d85700 1 -- 172.21.15.26:0/3465804079 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff50c09d6f0 msgr2=0x7ff50c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:04.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.764+0000 7ff510d85700 1 --2- 172.21.15.26:0/3465804079 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff50c09d6f0 0x7ff50c09dac0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc00bbc0 tx=0x7ff4fc00bed0 comp rx=0 tx=0).stop 2023-10-01T07:55:04.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.764+0000 7ff510d85700 1 -- 172.21.15.26:0/3465804079 shutdown_connections 2023-10-01T07:55:04.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.764+0000 7ff510d85700 1 --2- 172.21.15.26:0/3465804079 >> v2:172.21.15.26:3300/0 conn(0x7ff50c09e410 0x7ff50c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:04.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.764+0000 7ff510d85700 1 --2- 172.21.15.26:0/3465804079 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff50c09d6f0 0x7ff50c09dac0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:04.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.764+0000 7ff510d85700 1 --2- 172.21.15.26:0/3465804079 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff50c09e000 0x7ff50c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:04.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.764+0000 7ff510d85700 1 -- 172.21.15.26:0/3465804079 >> 172.21.15.26:0/3465804079 conn(0x7ff50c066f50 msgr2=0x7ff50c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:04.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.764+0000 7ff510d85700 1 -- 172.21.15.26:0/3465804079 shutdown_connections 2023-10-01T07:55:04.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.764+0000 7ff510d85700 1 -- 172.21.15.26:0/3465804079 wait complete. 2023-10-01T07:55:04.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.766+0000 7ff510d85700 1 Processor -- start 2023-10-01T07:55:04.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.766+0000 7ff510d85700 1 -- start start 2023-10-01T07:55:04.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.767+0000 7ff510d85700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff50c09d6f0 0x7ff50c11e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:04.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.767+0000 7ff510d85700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff50c09e000 0x7ff50c11e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:04.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.767+0000 7ff510d85700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff50c09e410 0x7ff50c11ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:04.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.767+0000 7ff510d85700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c121a20 con 0x7ff50c09d6f0 2023-10-01T07:55:04.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.767+0000 7ff510d85700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c12fca0 con 0x7ff50c09e410 2023-10-01T07:55:04.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.767+0000 7ff510d85700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c0a1ae0 con 0x7ff50c09e000 2023-10-01T07:55:04.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.767+0000 7ff50ad9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff50c09e410 0x7ff50c11ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:04.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.767+0000 7ff50ad9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff50c09e410 0x7ff50c11ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45872/0 (socket says 172.21.15.26:45872) 2023-10-01T07:55:04.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.767+0000 7ff50ad9d700 1 -- 172.21.15.26:0/1097019315 learned_addr learned my addr 172.21.15.26:0/1097019315 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:04.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.767+0000 7ff50a59c700 1 --2- 172.21.15.26:0/1097019315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff50c09d6f0 0x7ff50c11e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:04.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.767+0000 7ff509d9b700 1 --2- 172.21.15.26:0/1097019315 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff50c09e000 0x7ff50c11e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:04.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.767+0000 7ff50a59c700 1 -- 172.21.15.26:0/1097019315 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff50c09e000 msgr2=0x7ff50c11e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:04.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.767+0000 7ff50a59c700 1 --2- 172.21.15.26:0/1097019315 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff50c09e000 0x7ff50c11e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:04.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.767+0000 7ff50a59c700 1 -- 172.21.15.26:0/1097019315 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff50c09e410 msgr2=0x7ff50c11ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:04.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.767+0000 7ff50a59c700 1 --2- 172.21.15.26:0/1097019315 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff50c09e410 0x7ff50c11ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:04.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.767+0000 7ff50a59c700 1 -- 172.21.15.26:0/1097019315 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4fc00b7f0 con 0x7ff50c09d6f0 2023-10-01T07:55:04.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.768+0000 7ff50ad9d700 1 --2- 172.21.15.26:0/1097019315 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff50c09e410 0x7ff50c11ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:04.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.768+0000 7ff50a59c700 1 --2- 172.21.15.26:0/1097019315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff50c09d6f0 0x7ff50c11e1f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc01a000 tx=0x7ff4fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:04.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.768+0000 7ff4faffd700 1 -- 172.21.15.26:0/1097019315 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc020070 con 0x7ff50c09d6f0 2023-10-01T07:55:04.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.768+0000 7ff4faffd700 1 -- 172.21.15.26:0/1097019315 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4fc012770 con 0x7ff50c09d6f0 2023-10-01T07:55:04.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.768+0000 7ff4faffd700 1 -- 172.21.15.26:0/1097019315 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc012b40 con 0x7ff50c09d6f0 2023-10-01T07:55:04.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.768+0000 7ff510d85700 1 -- 172.21.15.26:0/1097019315 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff50c09c700 con 0x7ff50c09d6f0 2023-10-01T07:55:04.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.768+0000 7ff510d85700 1 -- 172.21.15.26:0/1097019315 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff50c122190 con 0x7ff50c09d6f0 2023-10-01T07:55:04.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.769+0000 7ff4faffd700 1 -- 172.21.15.26:0/1097019315 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff4fc024070 con 0x7ff50c09d6f0 2023-10-01T07:55:04.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.769+0000 7ff4faffd700 1 -- 172.21.15.26:0/1097019315 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7ff4fc044b60 con 0x7ff50c09d6f0 2023-10-01T07:55:04.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.769+0000 7ff509d9b700 1 -- 172.21.15.26:0/1097019315 >> v1:172.21.15.26:6816/126763 conn(0x7ff4ec02f510 legacy=0x7ff4ec0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:04.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.769+0000 7ff510d85700 1 -- 172.21.15.26:0/1097019315 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff50c121650 con 0x7ff50c09d6f0 2023-10-01T07:55:04.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.779+0000 7ff4faffd700 1 -- 172.21.15.26:0/1097019315 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff4fc01b400 con 0x7ff50c09d6f0 2023-10-01T07:55:04.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.837+0000 7f0555170700 1 Processor -- start 2023-10-01T07:55:04.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.837+0000 7f0555170700 1 -- start start 2023-10-01T07:55:04.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.837+0000 7f0555170700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f05501338a0 0x7f0550133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:04.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.837+0000 7f0555170700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f055009de50 0x7f055009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:04.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.837+0000 7f0555170700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f055009e760 0x7f055013a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:04.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.837+0000 7f0555170700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055006fef0 con 0x7f05501338a0 2023-10-01T07:55:04.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.837+0000 7f0555170700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055006ef30 con 0x7f055009e760 2023-10-01T07:55:04.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.837+0000 7f0555170700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05501334b0 con 0x7f055009de50 2023-10-01T07:55:04.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.838+0000 7f054ed9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f05501338a0 0x7f0550133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:04.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.838+0000 7f054e59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f055009de50 0x7f055009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:04.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.838+0000 7f054ed9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f05501338a0 0x7f0550133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53592/0 (socket says 172.21.15.26:53592) 2023-10-01T07:55:04.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.838+0000 7f054e59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f055009de50 0x7f055009e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35632/0 (socket says 172.21.15.26:35632) 2023-10-01T07:55:04.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.838+0000 7f054ed9d700 1 -- 172.21.15.26:0/2793118323 learned_addr learned my addr 172.21.15.26:0/2793118323 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:04.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.838+0000 7f054f59e700 1 --2- 172.21.15.26:0/2793118323 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f055009e760 0x7f055013a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:04.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.838+0000 7f054ed9d700 1 -- 172.21.15.26:0/2793118323 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f055009de50 msgr2=0x7f055009e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:04.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.838+0000 7f054ed9d700 1 --2- 172.21.15.26:0/2793118323 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f055009de50 0x7f055009e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:04.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.838+0000 7f054ed9d700 1 -- 172.21.15.26:0/2793118323 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f055009e760 msgr2=0x7f055013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:04.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.838+0000 7f054ed9d700 1 --2- 172.21.15.26:0/2793118323 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f055009e760 0x7f055013a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:04.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.838+0000 7f054ed9d700 1 -- 172.21.15.26:0/2793118323 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055006fc30 con 0x7f05501338a0 2023-10-01T07:55:04.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.838+0000 7f054ed9d700 1 --2- 172.21.15.26:0/2793118323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05501338a0 0x7f0550133c70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f05400098f0 tx=0x7f0540009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=613c8c9a97756025 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:04.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.839+0000 7f054dd9b700 1 -- 172.21.15.26:0/2793118323 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0540011830 con 0x7f05501338a0 2023-10-01T07:55:04.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.839+0000 7f054dd9b700 1 -- 172.21.15.26:0/2793118323 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0540011990 con 0x7f05501338a0 2023-10-01T07:55:04.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.839+0000 7f054dd9b700 1 -- 172.21.15.26:0/2793118323 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0540011d20 con 0x7f05501338a0 2023-10-01T07:55:04.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.839+0000 7f0555170700 1 -- 172.21.15.26:0/2793118323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05501338a0 msgr2=0x7f0550133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:04.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.839+0000 7f0555170700 1 --2- 172.21.15.26:0/2793118323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05501338a0 0x7f0550133c70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f05400098f0 tx=0x7f0540009c00 comp rx=0 tx=0).stop 2023-10-01T07:55:04.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.839+0000 7f0555170700 1 -- 172.21.15.26:0/2793118323 shutdown_connections 2023-10-01T07:55:04.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.839+0000 7f0555170700 1 --2- 172.21.15.26:0/2793118323 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f055009e760 0x7f055013a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:04.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.839+0000 7f0555170700 1 --2- 172.21.15.26:0/2793118323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05501338a0 0x7f0550133c70 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:04.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.839+0000 7f0555170700 1 --2- 172.21.15.26:0/2793118323 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f055009de50 0x7f055009e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:04.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.839+0000 7f0555170700 1 -- 172.21.15.26:0/2793118323 >> 172.21.15.26:0/2793118323 conn(0x7f05500a2aa0 msgr2=0x7f05500a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:04.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.839+0000 7f0555170700 1 -- 172.21.15.26:0/2793118323 shutdown_connections 2023-10-01T07:55:04.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.839+0000 7f0555170700 1 -- 172.21.15.26:0/2793118323 wait complete. 2023-10-01T07:55:04.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.841+0000 7f0555170700 1 Processor -- start 2023-10-01T07:55:04.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.841+0000 7f0555170700 1 -- start start 2023-10-01T07:55:04.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.841+0000 7f0555170700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f055009de50 0x7f055011d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:04.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.841+0000 7f0555170700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f055009e760 0x7f055011db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:04.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.841+0000 7f0555170700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f05501338a0 0x7f055011e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:04.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.841+0000 7f0555170700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05501208e0 con 0x7f055009de50 2023-10-01T07:55:04.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.841+0000 7f0555170700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055011f200 con 0x7f055009e760 2023-10-01T07:55:04.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.841+0000 7f0555170700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0550120d90 con 0x7f05501338a0 2023-10-01T07:55:04.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.842+0000 7f054ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f055009de50 0x7f055011d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:04.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.842+0000 7f054ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f055009de50 0x7f055011d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53602/0 (socket says 172.21.15.26:53602) 2023-10-01T07:55:04.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.842+0000 7f054ed9d700 1 -- 172.21.15.26:0/670019239 learned_addr learned my addr 172.21.15.26:0/670019239 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:04.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.842+0000 7f054f59e700 1 --2- 172.21.15.26:0/670019239 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f05501338a0 0x7f055011e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:04.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.842+0000 7f054e59c700 1 --2- 172.21.15.26:0/670019239 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f055009e760 0x7f055011db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:04.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.842+0000 7f054ed9d700 1 -- 172.21.15.26:0/670019239 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f05501338a0 msgr2=0x7f055011e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:04.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.842+0000 7f054ed9d700 1 --2- 172.21.15.26:0/670019239 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f05501338a0 0x7f055011e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:04.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.842+0000 7f054ed9d700 1 -- 172.21.15.26:0/670019239 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f055009e760 msgr2=0x7f055011db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:04.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.842+0000 7f054ed9d700 1 --2- 172.21.15.26:0/670019239 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f055009e760 0x7f055011db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:04.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.842+0000 7f054ed9d700 1 -- 172.21.15.26:0/670019239 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0540009550 con 0x7f055009de50 2023-10-01T07:55:04.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.842+0000 7f054e59c700 1 --2- 172.21.15.26:0/670019239 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f055009e760 0x7f055011db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:55:04.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.842+0000 7f054ed9d700 1 --2- 172.21.15.26:0/670019239 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f055009de50 0x7f055011d5e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0540000c00 tx=0x7f0540004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:04.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.842+0000 7f05377fe700 1 -- 172.21.15.26:0/670019239 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0540004380 con 0x7f055009de50 2023-10-01T07:55:04.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.843+0000 7f05377fe700 1 -- 172.21.15.26:0/670019239 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054001f070 con 0x7f055009de50 2023-10-01T07:55:04.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.843+0000 7f0555170700 1 -- 172.21.15.26:0/670019239 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05500a0f90 con 0x7f055009de50 2023-10-01T07:55:04.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.843+0000 7f05377fe700 1 -- 172.21.15.26:0/670019239 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05400036a0 con 0x7f055009de50 2023-10-01T07:55:04.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.843+0000 7f0555170700 1 -- 172.21.15.26:0/670019239 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055006f690 con 0x7f055009de50 2023-10-01T07:55:04.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.844+0000 7f05377fe700 1 -- 172.21.15.26:0/670019239 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0540021030 con 0x7f055009de50 2023-10-01T07:55:04.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.844+0000 7f0555170700 1 -- 172.21.15.26:0/670019239 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f055011a470 con 0x7f055009de50 2023-10-01T07:55:04.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.844+0000 7f05377fe700 1 -- 172.21.15.26:0/670019239 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f0540040d90 con 0x7f055009de50 2023-10-01T07:55:04.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.844+0000 7f054e59c700 1 -- 172.21.15.26:0/670019239 >> v1:172.21.15.26:6816/126763 conn(0x7f053c02f510 legacy=0x7f053c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:04.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.853+0000 7f05377fe700 1 -- 172.21.15.26:0/670019239 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f05400199a0 con 0x7f055009de50 2023-10-01T07:55:04.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.866+0000 7effb878e700 1 Processor -- start 2023-10-01T07:55:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.866+0000 7effb878e700 1 -- start start 2023-10-01T07:55:04.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.867+0000 7effb878e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7effb009d6f0 0x7effb009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:04.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.867+0000 7effb878e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effb009e000 0x7effb01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:04.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.867+0000 7effb878e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effb009e410 0x7effb0133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:04.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.867+0000 7effb878e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb006b460 con 0x7effb009d6f0 2023-10-01T07:55:04.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.867+0000 7effb878e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb009b120 con 0x7effb009e000 2023-10-01T07:55:04.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.867+0000 7effb878e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effb009a7e0 con 0x7effb009e410 2023-10-01T07:55:04.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.867+0000 7effb6d2b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effb009e410 0x7effb0133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:04.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.867+0000 7effb6d2b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effb009e410 0x7effb0133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35650/0 (socket says 172.21.15.26:35650) 2023-10-01T07:55:04.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.867+0000 7effb6d2b700 1 -- 172.21.15.26:0/380112607 learned_addr learned my addr 172.21.15.26:0/380112607 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:04.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.867+0000 7effb5d29700 1 --2- 172.21.15.26:0/380112607 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effb009e000 0x7effb01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:04.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.867+0000 7effb652a700 1 --2- 172.21.15.26:0/380112607 >> v2:172.21.15.26:3300/0 conn(0x7effb009d6f0 0x7effb009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:04.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.868+0000 7effb6d2b700 1 -- 172.21.15.26:0/380112607 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effb009e000 msgr2=0x7effb01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:04.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.868+0000 7effb6d2b700 1 --2- 172.21.15.26:0/380112607 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effb009e000 0x7effb01339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:04.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.868+0000 7effb6d2b700 1 -- 172.21.15.26:0/380112607 >> v2:172.21.15.26:3300/0 conn(0x7effb009d6f0 msgr2=0x7effb009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:04.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.868+0000 7effb6d2b700 1 --2- 172.21.15.26:0/380112607 >> v2:172.21.15.26:3300/0 conn(0x7effb009d6f0 0x7effb009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:04.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.868+0000 7effb6d2b700 1 -- 172.21.15.26:0/380112607 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb009a500 con 0x7effb009e410 2023-10-01T07:55:04.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.868+0000 7effb6d2b700 1 --2- 172.21.15.26:0/380112607 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effb009e410 0x7effb0133f30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7effa8009e80 tx=0x7effa800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b89de7d62b61e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:04.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.868+0000 7effb5528700 1 -- 172.21.15.26:0/380112607 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa800e070 con 0x7effb009e410 2023-10-01T07:55:04.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.868+0000 7effb5528700 1 -- 172.21.15.26:0/380112607 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa800b8d0 con 0x7effb009e410 2023-10-01T07:55:04.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.868+0000 7effb5528700 1 -- 172.21.15.26:0/380112607 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa800bc80 con 0x7effb009e410 2023-10-01T07:55:04.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.869+0000 7effb878e700 1 -- 172.21.15.26:0/380112607 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effb009e410 msgr2=0x7effb0133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:04.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.869+0000 7effb878e700 1 --2- 172.21.15.26:0/380112607 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effb009e410 0x7effb0133f30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7effa8009e80 tx=0x7effa800b330 comp rx=0 tx=0).stop 2023-10-01T07:55:04.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.869+0000 7effb878e700 1 -- 172.21.15.26:0/380112607 shutdown_connections 2023-10-01T07:55:04.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.869+0000 7effb878e700 1 --2- 172.21.15.26:0/380112607 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effb009e410 0x7effb0133f30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:04.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.869+0000 7effb878e700 1 --2- 172.21.15.26:0/380112607 >> v2:172.21.15.26:3300/0 conn(0x7effb009d6f0 0x7effb009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:04.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.869+0000 7effb878e700 1 --2- 172.21.15.26:0/380112607 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effb009e000 0x7effb01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:04.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.869+0000 7effb878e700 1 -- 172.21.15.26:0/380112607 >> 172.21.15.26:0/380112607 conn(0x7effb0066f50 msgr2=0x7effb009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:04.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.869+0000 7effb878e700 1 -- 172.21.15.26:0/380112607 shutdown_connections 2023-10-01T07:55:04.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.869+0000 7effb878e700 1 -- 172.21.15.26:0/380112607 wait complete. 2023-10-01T07:55:04.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.870+0000 7effb878e700 1 Processor -- start 2023-10-01T07:55:04.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.870+0000 7effb878e700 1 -- start start 2023-10-01T07:55:04.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.871+0000 7effb878e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effb009d6f0 0x7effb01a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:04.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.871+0000 7effb878e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effb009e000 0x7effb01a5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:04.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.871+0000 7effb878e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb009e410 0x7effb01c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:04.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.871+0000 7effb878e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb01a6a00 con 0x7effb009e410 2023-10-01T07:55:04.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.871+0000 7effb878e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb01b9360 con 0x7effb009d6f0 2023-10-01T07:55:04.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.871+0000 7effb878e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effb01a7e30 con 0x7effb009e000 2023-10-01T07:55:04.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.871+0000 7effb5d29700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effb009e000 0x7effb01a5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:04.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.871+0000 7effb652a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effb009d6f0 0x7effb01a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:04.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.871+0000 7effb5d29700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effb009e000 0x7effb01a5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35658/0 (socket says 172.21.15.26:35658) 2023-10-01T07:55:04.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.871+0000 7effb5d29700 1 -- 172.21.15.26:0/1012308981 learned_addr learned my addr 172.21.15.26:0/1012308981 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:04.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.871+0000 7effb6d2b700 1 --2- 172.21.15.26:0/1012308981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb009e410 0x7effb01c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:04.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.871+0000 7effb652a700 1 -- 172.21.15.26:0/1012308981 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effb009e000 msgr2=0x7effb01a5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:04.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.871+0000 7effb652a700 1 --2- 172.21.15.26:0/1012308981 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effb009e000 0x7effb01a5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:04.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.871+0000 7effb652a700 1 -- 172.21.15.26:0/1012308981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb009e410 msgr2=0x7effb01c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:04.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.871+0000 7effb652a700 1 --2- 172.21.15.26:0/1012308981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb009e410 0x7effb01c7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:04.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.872+0000 7effb652a700 1 -- 172.21.15.26:0/1012308981 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa8009b30 con 0x7effb009d6f0 2023-10-01T07:55:04.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.872+0000 7f732362f700 1 Processor -- start 2023-10-01T07:55:04.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.872+0000 7effb652a700 1 --2- 172.21.15.26:0/1012308981 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effb009d6f0 0x7effb01a5230 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7effac00e900 tx=0x7effac00ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:04.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.872+0000 7effa6ffd700 1 -- 172.21.15.26:0/1012308981 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac013680 con 0x7effb009d6f0 2023-10-01T07:55:04.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.872+0000 7effa6ffd700 1 -- 172.21.15.26:0/1012308981 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac0137e0 con 0x7effb009d6f0 2023-10-01T07:55:04.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.872+0000 7effb878e700 1 -- 172.21.15.26:0/1012308981 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb009c710 con 0x7effb009d6f0 2023-10-01T07:55:04.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.872+0000 7effa6ffd700 1 -- 172.21.15.26:0/1012308981 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac013b50 con 0x7effb009d6f0 2023-10-01T07:55:04.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.872+0000 7effb878e700 1 -- 172.21.15.26:0/1012308981 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb01a4a30 con 0x7effb009d6f0 2023-10-01T07:55:04.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.872+0000 7f732362f700 1 -- start start 2023-10-01T07:55:04.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.873+0000 7f732362f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f731c071b40 0x7f731c130420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:04.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.873+0000 7f732362f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f731c130960 0x7f731c133570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:04.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.873+0000 7f732362f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f731c099ef0 con 0x7f731c130d50 2023-10-01T07:55:04.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.873+0000 7f732362f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f731c099500 con 0x7f731c130960 2023-10-01T07:55:04.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.873+0000 7f732362f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f731c099c10 con 0x7f731c071b40 2023-10-01T07:55:04.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.873+0000 7f7320bca700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f731c130960 0x7f731c133570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:04.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.873+0000 7f7320bca700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f731c130960 0x7f731c133570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53626/0 (socket says 172.21.15.26:53626) 2023-10-01T07:55:04.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.873+0000 7f7320bca700 1 -- 172.21.15.26:0/2283050489 learned_addr learned my addr 172.21.15.26:0/2283050489 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:04.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.873+0000 7f73213cb700 1 --2- 172.21.15.26:0/2283050489 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f731c071b40 0x7f731c130420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:04.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.874+0000 7f7320bca700 1 -- 172.21.15.26:0/2283050489 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f731c071b40 msgr2=0x7f731c130420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:04.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.874+0000 7f7320bca700 1 --2- 172.21.15.26:0/2283050489 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f731c071b40 0x7f731c130420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:04.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.874+0000 7f7320bca700 1 -- 172.21.15.26:0/2283050489 >> v1:172.21.15.26:6789/0 conn(0x7f731c130d50 legacy=0x7f731c133ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:04.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.874+0000 7f7320bca700 1 -- 172.21.15.26:0/2283050489 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731c09e370 con 0x7f731c130960 2023-10-01T07:55:04.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.874+0000 7effb878e700 1 -- 172.21.15.26:0/1012308981 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb0074ea0 con 0x7effb009d6f0 2023-10-01T07:55:04.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.874+0000 7f7320bca700 1 --2- 172.21.15.26:0/2283050489 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f731c130960 0x7f731c133570 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f730c014500 tx=0x7f730c014810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5065bda34da759a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:04.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.874+0000 7f7313fff700 1 -- 172.21.15.26:0/2283050489 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c015850 con 0x7f731c130960 2023-10-01T07:55:04.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.874+0000 7f7313fff700 1 -- 172.21.15.26:0/2283050489 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730c0159b0 con 0x7f731c130960 2023-10-01T07:55:04.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.874+0000 7f7313fff700 1 -- 172.21.15.26:0/2283050489 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c015d40 con 0x7f731c130960 2023-10-01T07:55:04.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.874+0000 7effa6ffd700 1 -- 172.21.15.26:0/1012308981 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7effac013cb0 con 0x7effb009d6f0 2023-10-01T07:55:04.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.874+0000 7effa6ffd700 1 -- 172.21.15.26:0/1012308981 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7effac03fd10 con 0x7effb009d6f0 2023-10-01T07:55:04.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.874+0000 7effb5d29700 1 -- 172.21.15.26:0/1012308981 >> v1:172.21.15.26:6816/126763 conn(0x7eff9402f510 legacy=0x7eff940319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:04.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.875+0000 7f732362f700 1 -- 172.21.15.26:0/2283050489 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f731c130960 msgr2=0x7f731c133570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:04.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.875+0000 7f732362f700 1 --2- 172.21.15.26:0/2283050489 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f731c130960 0x7f731c133570 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f730c014500 tx=0x7f730c014810 comp rx=0 tx=0).stop 2023-10-01T07:55:04.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.875+0000 7f732362f700 1 -- 172.21.15.26:0/2283050489 shutdown_connections 2023-10-01T07:55:04.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.875+0000 7f732362f700 1 --2- 172.21.15.26:0/2283050489 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f731c071b40 0x7f731c130420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:04.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.875+0000 7f732362f700 1 --2- 172.21.15.26:0/2283050489 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f731c130960 0x7f731c133570 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:04.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.875+0000 7f732362f700 1 -- 172.21.15.26:0/2283050489 >> 172.21.15.26:0/2283050489 conn(0x7f731c09e7e0 msgr2=0x7f731c09ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:04.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.876+0000 7f732362f700 1 -- 172.21.15.26:0/2283050489 shutdown_connections 2023-10-01T07:55:04.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.876+0000 7f732362f700 1 -- 172.21.15.26:0/2283050489 wait complete. 2023-10-01T07:55:04.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.877+0000 7f732362f700 1 Processor -- start 2023-10-01T07:55:04.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.877+0000 7f732362f700 1 -- start start 2023-10-01T07:55:04.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.878+0000 7f732362f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f731c071b40 0x7f731c1288d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:04.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.878+0000 7f732362f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f731c130960 0x7f731c128e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:04.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.878+0000 7f732362f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f731c130d50 0x7f731c129350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:04.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.878+0000 7f732362f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731c12c0e0 con 0x7f731c130960 2023-10-01T07:55:04.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.878+0000 7f732362f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f731c12c330 con 0x7f731c071b40 2023-10-01T07:55:04.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.878+0000 7f732362f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f731c12b220 con 0x7f731c130d50 2023-10-01T07:55:04.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.878+0000 7f73213cb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f731c071b40 0x7f731c1288d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:04.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.878+0000 7f73213cb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f731c071b40 0x7f731c1288d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45920/0 (socket says 172.21.15.26:45920) 2023-10-01T07:55:04.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.878+0000 7f73213cb700 1 -- 172.21.15.26:0/1504158998 learned_addr learned my addr 172.21.15.26:0/1504158998 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:04.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.878+0000 7f7321bcc700 1 --2- 172.21.15.26:0/1504158998 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f731c130d50 0x7f731c129350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:04.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.878+0000 7f7320bca700 1 --2- 172.21.15.26:0/1504158998 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f731c130960 0x7f731c128e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:04.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.879+0000 7f73213cb700 1 -- 172.21.15.26:0/1504158998 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f731c130d50 msgr2=0x7f731c129350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:04.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.879+0000 7f73213cb700 1 --2- 172.21.15.26:0/1504158998 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f731c130d50 0x7f731c129350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:04.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.879+0000 7f73213cb700 1 -- 172.21.15.26:0/1504158998 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f731c130960 msgr2=0x7f731c128e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:04.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.879+0000 7f73213cb700 1 --2- 172.21.15.26:0/1504158998 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f731c130960 0x7f731c128e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:04.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.879+0000 7f73213cb700 1 -- 172.21.15.26:0/1504158998 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730c00fd90 con 0x7f731c071b40 2023-10-01T07:55:04.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.879+0000 7f7321bcc700 1 --2- 172.21.15.26:0/1504158998 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f731c130d50 0x7f731c129350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:04.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.879+0000 7f73213cb700 1 --2- 172.21.15.26:0/1504158998 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f731c071b40 0x7f731c1288d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f731800e9b0 tx=0x7f731800ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:04.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.879+0000 7f7311ffb700 1 -- 172.21.15.26:0/1504158998 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7318009710 con 0x7f731c071b40 2023-10-01T07:55:04.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.880+0000 7f7311ffb700 1 -- 172.21.15.26:0/1504158998 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731800c850 con 0x7f731c071b40 2023-10-01T07:55:04.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.880+0000 7f732362f700 1 -- 172.21.15.26:0/1504158998 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f731c09fbe0 con 0x7f731c071b40 2023-10-01T07:55:04.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.880+0000 7f7311ffb700 1 -- 172.21.15.26:0/1504158998 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731800cbc0 con 0x7f731c071b40 2023-10-01T07:55:04.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.880+0000 7effa6ffd700 1 -- 172.21.15.26:0/1012308981 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7effac01bc40 con 0x7effb009d6f0 2023-10-01T07:55:04.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.880+0000 7f732362f700 1 -- 172.21.15.26:0/1504158998 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f731c12b6e0 con 0x7f731c071b40 2023-10-01T07:55:04.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.881+0000 7f732362f700 1 -- 172.21.15.26:0/1504158998 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f731c12bcc0 con 0x7f731c071b40 2023-10-01T07:55:04.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.882+0000 7f7311ffb700 1 -- 172.21.15.26:0/1504158998 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f731800cd20 con 0x7f731c071b40 2023-10-01T07:55:04.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.882+0000 7f7311ffb700 1 -- 172.21.15.26:0/1504158998 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f7318040470 con 0x7f731c071b40 2023-10-01T07:55:04.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.882+0000 7f7320bca700 1 -- 172.21.15.26:0/1504158998 >> v1:172.21.15.26:6816/126763 conn(0x7f730002f560 legacy=0x7f7300031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:04.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.886+0000 7f7311ffb700 1 -- 172.21.15.26:0/1504158998 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f731801a360 con 0x7f731c071b40 2023-10-01T07:55:04.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:04.970+0000 7ff509d9b700 1 -- 172.21.15.26:0/1097019315 >> v1:172.21.15.26:6816/126763 conn(0x7ff4ec02f510 legacy=0x7ff4ec0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:05.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.008+0000 7ff510d85700 1 -- 172.21.15.26:0/1097019315 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff50c074ea0 con 0x7ff50c09d6f0 2023-10-01T07:55:05.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.008+0000 7ff4faffd700 1 -- 172.21.15.26:0/1097019315 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff4fc024320 con 0x7ff50c09d6f0 2023-10-01T07:55:05.009 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:05.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.010+0000 7ff510d85700 1 -- 172.21.15.26:0/1097019315 >> v1:172.21.15.26:6816/126763 conn(0x7ff4ec02f510 legacy=0x7ff4ec0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:05.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.010+0000 7ff510d85700 1 -- 172.21.15.26:0/1097019315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff50c09d6f0 msgr2=0x7ff50c11e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:05.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.010+0000 7ff510d85700 1 --2- 172.21.15.26:0/1097019315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff50c09d6f0 0x7ff50c11e1f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc01a000 tx=0x7ff4fc004750 comp rx=0 tx=0).stop 2023-10-01T07:55:05.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.011+0000 7ff510d85700 1 -- 172.21.15.26:0/1097019315 shutdown_connections 2023-10-01T07:55:05.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.011+0000 7ff510d85700 1 --2- 172.21.15.26:0/1097019315 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff50c09e410 0x7ff50c11ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:05.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.011+0000 7ff510d85700 1 --2- 172.21.15.26:0/1097019315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff50c09d6f0 0x7ff50c11e1f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:05.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.011+0000 7ff510d85700 1 --2- 172.21.15.26:0/1097019315 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff50c09e000 0x7ff50c11e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:05.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.011+0000 7ff510d85700 1 -- 172.21.15.26:0/1097019315 >> 172.21.15.26:0/1097019315 conn(0x7ff50c066f50 msgr2=0x7ff50c06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:05.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.011+0000 7ff510d85700 1 -- 172.21.15.26:0/1097019315 shutdown_connections 2023-10-01T07:55:05.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.011+0000 7ff510d85700 1 -- 172.21.15.26:0/1097019315 wait complete. 2023-10-01T07:55:05.026 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:05.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.045+0000 7f054e59c700 1 -- 172.21.15.26:0/670019239 >> v1:172.21.15.26:6816/126763 conn(0x7f053c02f510 legacy=0x7f053c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:05.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.075+0000 7effb5d29700 1 -- 172.21.15.26:0/1012308981 >> v1:172.21.15.26:6816/126763 conn(0x7eff9402f510 legacy=0x7eff940319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:05.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.083+0000 7f7320bca700 1 -- 172.21.15.26:0/1504158998 >> v1:172.21.15.26:6816/126763 conn(0x7f730002f560 legacy=0x7f7300031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:05.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.093+0000 7f732362f700 1 -- 172.21.15.26:0/1504158998 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f731c0747f0 con 0x7f731c071b40 2023-10-01T07:55:05.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.093+0000 7f7311ffb700 1 -- 172.21.15.26:0/1504158998 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7318024b00 con 0x7f731c071b40 2023-10-01T07:55:05.093 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:05.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.095+0000 7f732362f700 1 -- 172.21.15.26:0/1504158998 >> v1:172.21.15.26:6816/126763 conn(0x7f730002f560 legacy=0x7f7300031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:05.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.095+0000 7f732362f700 1 -- 172.21.15.26:0/1504158998 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f731c071b40 msgr2=0x7f731c1288d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:05.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.095+0000 7f732362f700 1 --2- 172.21.15.26:0/1504158998 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f731c071b40 0x7f731c1288d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f731800e9b0 tx=0x7f731800ecc0 comp rx=0 tx=0).stop 2023-10-01T07:55:05.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.095+0000 7f732362f700 1 -- 172.21.15.26:0/1504158998 shutdown_connections 2023-10-01T07:55:05.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.095+0000 7f732362f700 1 --2- 172.21.15.26:0/1504158998 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f731c130d50 0x7f731c129350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:05.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.095+0000 7f732362f700 1 --2- 172.21.15.26:0/1504158998 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f731c071b40 0x7f731c1288d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:05.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.095+0000 7f732362f700 1 --2- 172.21.15.26:0/1504158998 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f731c130960 0x7f731c128e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:05.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.095+0000 7f732362f700 1 -- 172.21.15.26:0/1504158998 >> 172.21.15.26:0/1504158998 conn(0x7f731c09e7e0 msgr2=0x7f731c1339f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:05.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.096+0000 7f732362f700 1 -- 172.21.15.26:0/1504158998 shutdown_connections 2023-10-01T07:55:05.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.096+0000 7f732362f700 1 -- 172.21.15.26:0/1504158998 wait complete. 2023-10-01T07:55:05.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.100+0000 7f0555170700 1 -- 172.21.15.26:0/670019239 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0550121190 con 0x7f055009de50 2023-10-01T07:55:05.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.100+0000 7f05377fe700 1 -- 172.21.15.26:0/670019239 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f05400193b0 con 0x7f055009de50 2023-10-01T07:55:05.100 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:05.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.102+0000 7f0555170700 1 -- 172.21.15.26:0/670019239 >> v1:172.21.15.26:6816/126763 conn(0x7f053c02f510 legacy=0x7f053c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:05.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.102+0000 7f0555170700 1 -- 172.21.15.26:0/670019239 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f055009de50 msgr2=0x7f055011d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:05.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.102+0000 7f0555170700 1 --2- 172.21.15.26:0/670019239 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f055009de50 0x7f055011d5e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0540000c00 tx=0x7f0540004750 comp rx=0 tx=0).stop 2023-10-01T07:55:05.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.102+0000 7f0555170700 1 -- 172.21.15.26:0/670019239 shutdown_connections 2023-10-01T07:55:05.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.102+0000 7f0555170700 1 --2- 172.21.15.26:0/670019239 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f05501338a0 0x7f055011e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:05.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.102+0000 7f0555170700 1 --2- 172.21.15.26:0/670019239 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f055009de50 0x7f055011d5e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:05.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.102+0000 7f0555170700 1 --2- 172.21.15.26:0/670019239 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f055009e760 0x7f055011db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:05.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.102+0000 7f0555170700 1 -- 172.21.15.26:0/670019239 >> 172.21.15.26:0/670019239 conn(0x7f05500a2aa0 msgr2=0x7f05501baea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:05.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.102+0000 7f0555170700 1 -- 172.21.15.26:0/670019239 shutdown_connections 2023-10-01T07:55:05.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.102+0000 7f0555170700 1 -- 172.21.15.26:0/670019239 wait complete. 2023-10-01T07:55:05.111 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:05.118 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:05.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.121+0000 7effb878e700 1 -- 172.21.15.26:0/1012308981 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7effb006c360 con 0x7effb009d6f0 2023-10-01T07:55:05.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.121+0000 7effa6ffd700 1 -- 172.21.15.26:0/1012308981 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7effac017030 con 0x7effb009d6f0 2023-10-01T07:55:05.122 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:05.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.123+0000 7effb878e700 1 -- 172.21.15.26:0/1012308981 >> v1:172.21.15.26:6816/126763 conn(0x7eff9402f510 legacy=0x7eff940319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:05.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.123+0000 7effb878e700 1 -- 172.21.15.26:0/1012308981 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effb009d6f0 msgr2=0x7effb01a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:05.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.123+0000 7effb878e700 1 --2- 172.21.15.26:0/1012308981 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effb009d6f0 0x7effb01a5230 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7effac00e900 tx=0x7effac00ec10 comp rx=0 tx=0).stop 2023-10-01T07:55:05.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.123+0000 7effb878e700 1 -- 172.21.15.26:0/1012308981 shutdown_connections 2023-10-01T07:55:05.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.123+0000 7effb878e700 1 --2- 172.21.15.26:0/1012308981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb009e410 0x7effb01c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:05.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.123+0000 7effb878e700 1 --2- 172.21.15.26:0/1012308981 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effb009d6f0 0x7effb01a5230 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:05.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.123+0000 7effb878e700 1 --2- 172.21.15.26:0/1012308981 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effb009e000 0x7effb01a5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:05.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.124+0000 7effb878e700 1 -- 172.21.15.26:0/1012308981 >> 172.21.15.26:0/1012308981 conn(0x7effb0066f50 msgr2=0x7effb00a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:05.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.124+0000 7effb878e700 1 -- 172.21.15.26:0/1012308981 shutdown_connections 2023-10-01T07:55:05.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:05.124+0000 7effb878e700 1 -- 172.21.15.26:0/1012308981 wait complete. 2023-10-01T07:55:05.138 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:06.029 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:06.112 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:06.119 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:06.139 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:06.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.183+0000 7f0fb5e64700 1 Processor -- start 2023-10-01T07:55:06.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.183+0000 7f0fb5e64700 1 -- start start 2023-10-01T07:55:06.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.184+0000 7f0fb5e64700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0fb009d6f0 0x7f0fb009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:06.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.184+0000 7f0fb5e64700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0fb009e440 0x7f0fb0134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:06.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.184+0000 7f0fb5e64700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fb009b120 con 0x7f0fb009e000 2023-10-01T07:55:06.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.184+0000 7f0fb5e64700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fb006b460 con 0x7f0fb009d6f0 2023-10-01T07:55:06.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.184+0000 7f0fb5e64700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb009a7e0 con 0x7f0fb009e440 2023-10-01T07:55:06.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.184+0000 7f0faf7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0fb009d6f0 0x7f0fb009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:06.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.184+0000 7f0faf7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0fb009d6f0 0x7f0fb009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53634/0 (socket says 172.21.15.26:53634) 2023-10-01T07:55:06.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.184+0000 7f0faf7fe700 1 -- 172.21.15.26:0/1157872621 learned_addr learned my addr 172.21.15.26:0/1157872621 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:06.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.184+0000 7f0faffff700 1 --2- 172.21.15.26:0/1157872621 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0fb009e440 0x7f0fb0134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:06.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.185+0000 7f0faffff700 1 -- 172.21.15.26:0/1157872621 >> v2:172.21.15.26:3300/0 conn(0x7f0fb009d6f0 msgr2=0x7f0fb009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:06.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.185+0000 7f0faffff700 1 --2- 172.21.15.26:0/1157872621 >> v2:172.21.15.26:3300/0 conn(0x7f0fb009d6f0 0x7f0fb009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.185+0000 7f0faffff700 1 -- 172.21.15.26:0/1157872621 >> v1:172.21.15.26:6789/0 conn(0x7f0fb009e000 legacy=0x7f0fb01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:06.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.185+0000 7f0faffff700 1 -- 172.21.15.26:0/1157872621 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb009a500 con 0x7f0fb009e440 2023-10-01T07:55:06.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.185+0000 7f0faffff700 1 --2- 172.21.15.26:0/1157872621 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0fb009e440 0x7f0fb0134100 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8009dc0 tx=0x7f0fa800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3647eb617e3da9a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:06.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.185+0000 7f0fae7fc700 1 -- 172.21.15.26:0/1157872621 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa800e070 con 0x7f0fb009e440 2023-10-01T07:55:06.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.185+0000 7f0fae7fc700 1 -- 172.21.15.26:0/1157872621 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa800bae0 con 0x7f0fb009e440 2023-10-01T07:55:06.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.185+0000 7f0fae7fc700 1 -- 172.21.15.26:0/1157872621 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa800be90 con 0x7f0fb009e440 2023-10-01T07:55:06.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.186+0000 7f0fb5e64700 1 -- 172.21.15.26:0/1157872621 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0fb009e440 msgr2=0x7f0fb0134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:06.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.186+0000 7f0fb5e64700 1 --2- 172.21.15.26:0/1157872621 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0fb009e440 0x7f0fb0134100 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8009dc0 tx=0x7f0fa800b330 comp rx=0 tx=0).stop 2023-10-01T07:55:06.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.186+0000 7f0fb5e64700 1 -- 172.21.15.26:0/1157872621 shutdown_connections 2023-10-01T07:55:06.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.186+0000 7f0fb5e64700 1 --2- 172.21.15.26:0/1157872621 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0fb009e440 0x7f0fb0134100 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.186+0000 7f0fb5e64700 1 --2- 172.21.15.26:0/1157872621 >> v2:172.21.15.26:3300/0 conn(0x7f0fb009d6f0 0x7f0fb009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.186+0000 7f0fb5e64700 1 -- 172.21.15.26:0/1157872621 >> 172.21.15.26:0/1157872621 conn(0x7f0fb0066f50 msgr2=0x7f0fb009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:06.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.186+0000 7f0fb5e64700 1 -- 172.21.15.26:0/1157872621 shutdown_connections 2023-10-01T07:55:06.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.187+0000 7f0fb5e64700 1 -- 172.21.15.26:0/1157872621 wait complete. 2023-10-01T07:55:06.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.188+0000 7f0fb5e64700 1 Processor -- start 2023-10-01T07:55:06.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.188+0000 7f0fb5e64700 1 -- start start 2023-10-01T07:55:06.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.189+0000 7f0fb5e64700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0fb009d6f0 0x7f0fb01a5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:06.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.189+0000 7f0fb5e64700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0fb009e000 0x7f0fb01a63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:06.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.189+0000 7f0fb5e64700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fb009e440 0x7f0fb01a6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:06.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.189+0000 7f0fb5e64700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb01a99d0 con 0x7f0fb009e440 2023-10-01T07:55:06.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.189+0000 7f0fb5e64700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb01a7b60 con 0x7f0fb009d6f0 2023-10-01T07:55:06.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.189+0000 7f0fb5e64700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb00a1f90 con 0x7f0fb009e000 2023-10-01T07:55:06.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.189+0000 7f0faf7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0fb009d6f0 0x7f0fb01a5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:06.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.189+0000 7f0faf7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0fb009d6f0 0x7f0fb01a5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45930/0 (socket says 172.21.15.26:45930) 2023-10-01T07:55:06.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.189+0000 7f0faf7fe700 1 -- 172.21.15.26:0/2353442952 learned_addr learned my addr 172.21.15.26:0/2353442952 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:06.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.189+0000 7f0faffff700 1 --2- 172.21.15.26:0/2353442952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fb009e440 0x7f0fb01a6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:06.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.189+0000 7f0faf7fe700 1 -- 172.21.15.26:0/2353442952 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0fb009e000 msgr2=0x7f0fb01a63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:06.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.189+0000 7f0faf7fe700 1 --2- 172.21.15.26:0/2353442952 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0fb009e000 0x7f0fb01a63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.189+0000 7f0faf7fe700 1 -- 172.21.15.26:0/2353442952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fb009e440 msgr2=0x7f0fb01a6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:06.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.189+0000 7f0faf7fe700 1 --2- 172.21.15.26:0/2353442952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fb009e440 0x7f0fb01a6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.189+0000 7f0faf7fe700 1 -- 172.21.15.26:0/2353442952 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa8009a70 con 0x7f0fb009d6f0 2023-10-01T07:55:06.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.189+0000 7f0faffff700 1 --2- 172.21.15.26:0/2353442952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fb009e440 0x7f0fb01a6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:55:06.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.190+0000 7f0faf7fe700 1 --2- 172.21.15.26:0/2353442952 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0fb009d6f0 0x7f0fb01a5eb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0fa000e910 tx=0x7f0fa000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:06.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.190+0000 7f0f97fff700 1 -- 172.21.15.26:0/2353442952 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa00096a0 con 0x7f0fb009d6f0 2023-10-01T07:55:06.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.190+0000 7f0f97fff700 1 -- 172.21.15.26:0/2353442952 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa000c850 con 0x7f0fb009d6f0 2023-10-01T07:55:06.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.190+0000 7f0f97fff700 1 -- 172.21.15.26:0/2353442952 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa000cc00 con 0x7f0fb009d6f0 2023-10-01T07:55:06.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.190+0000 7f0fb5e64700 1 -- 172.21.15.26:0/2353442952 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fb009c710 con 0x7f0fb009d6f0 2023-10-01T07:55:06.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.190+0000 7f0fb5e64700 1 -- 172.21.15.26:0/2353442952 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb01a88c0 con 0x7f0fb009d6f0 2023-10-01T07:55:06.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.191+0000 7f0f97fff700 1 -- 172.21.15.26:0/2353442952 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0fa000cd60 con 0x7f0fb009d6f0 2023-10-01T07:55:06.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.192+0000 7f0f97fff700 1 -- 172.21.15.26:0/2353442952 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f0fa0040090 con 0x7f0fb009d6f0 2023-10-01T07:55:06.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.192+0000 7f0faeffd700 1 -- 172.21.15.26:0/2353442952 >> v1:172.21.15.26:6816/126763 conn(0x7f0f9c02f510 legacy=0x7f0f9c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:06.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.192+0000 7f0fb5e64700 1 -- 172.21.15.26:0/2353442952 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fb0074ea0 con 0x7f0fb009d6f0 2023-10-01T07:55:06.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.197+0000 7f0f97fff700 1 -- 172.21.15.26:0/2353442952 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0fa0017070 con 0x7f0fb009d6f0 2023-10-01T07:55:06.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.290+0000 7f5054ba3700 1 Processor -- start 2023-10-01T07:55:06.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.290+0000 7f5054ba3700 1 -- start start 2023-10-01T07:55:06.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.291+0000 7f5054ba3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f505009d630 0x7f50500a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:06.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.292+0000 7f5054ba3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5050138d80 0x7f505013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:06.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.292+0000 7f5054ba3700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50500a2a70 con 0x7f50500a0a30 2023-10-01T07:55:06.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.292+0000 7f5054ba3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50500a01d0 con 0x7f5050138d80 2023-10-01T07:55:06.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.292+0000 7f5054ba3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505009e2b0 con 0x7f505009d630 2023-10-01T07:55:06.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.292+0000 7f504dd9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f505009d630 0x7f50500a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:06.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.292+0000 7f504e59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f50500a0a30 0x7f50500a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54932/0 (socket says 172.21.15.26:54932) 2023-10-01T07:55:06.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.292+0000 7f504e59c700 1 -- 172.21.15.26:0/3468252041 learned_addr learned my addr 172.21.15.26:0/3468252041 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:06.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.292+0000 7f504ed9d700 1 --2- 172.21.15.26:0/3468252041 >> v2:172.21.15.26:3300/0 conn(0x7f5050138d80 0x7f505013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:06.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.292+0000 7f504dd9b700 1 -- 172.21.15.26:0/3468252041 >> v2:172.21.15.26:3300/0 conn(0x7f5050138d80 msgr2=0x7f505013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:06.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.292+0000 7f504dd9b700 1 --2- 172.21.15.26:0/3468252041 >> v2:172.21.15.26:3300/0 conn(0x7f5050138d80 0x7f505013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.292+0000 7f504dd9b700 1 -- 172.21.15.26:0/3468252041 >> v1:172.21.15.26:6789/0 conn(0x7f50500a0a30 legacy=0x7f50500a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:06.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.292+0000 7f504dd9b700 1 -- 172.21.15.26:0/3468252041 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f505009dc50 con 0x7f505009d630 2023-10-01T07:55:06.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.292+0000 7f504dd9b700 1 --2- 172.21.15.26:0/3468252041 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f505009d630 0x7f50500a1510 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5044009840 tx=0x7f5044009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e618c4beafda18b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:06.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.293+0000 7f504d59a700 1 -- 172.21.15.26:0/3468252041 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5044011830 con 0x7f505009d630 2023-10-01T07:55:06.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.293+0000 7f504d59a700 1 -- 172.21.15.26:0/3468252041 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5044011990 con 0x7f505009d630 2023-10-01T07:55:06.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.293+0000 7f504d59a700 1 -- 172.21.15.26:0/3468252041 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5044011d20 con 0x7f505009d630 2023-10-01T07:55:06.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.294+0000 7f5054ba3700 1 -- 172.21.15.26:0/3468252041 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f505009d630 msgr2=0x7f50500a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:06.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.294+0000 7f5054ba3700 1 --2- 172.21.15.26:0/3468252041 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f505009d630 0x7f50500a1510 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5044009840 tx=0x7f5044009b50 comp rx=0 tx=0).stop 2023-10-01T07:55:06.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.294+0000 7f5054ba3700 1 -- 172.21.15.26:0/3468252041 shutdown_connections 2023-10-01T07:55:06.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.294+0000 7f5054ba3700 1 --2- 172.21.15.26:0/3468252041 >> v2:172.21.15.26:3300/0 conn(0x7f5050138d80 0x7f505013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.294+0000 7f5054ba3700 1 --2- 172.21.15.26:0/3468252041 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f505009d630 0x7f50500a1510 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.294+0000 7f5054ba3700 1 -- 172.21.15.26:0/3468252041 >> 172.21.15.26:0/3468252041 conn(0x7f50500a3050 msgr2=0x7f50500a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:06.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.294+0000 7f5054ba3700 1 -- 172.21.15.26:0/3468252041 shutdown_connections 2023-10-01T07:55:06.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.294+0000 7f5054ba3700 1 -- 172.21.15.26:0/3468252041 wait complete. 2023-10-01T07:55:06.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.295+0000 7f5054ba3700 1 Processor -- start 2023-10-01T07:55:06.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.295+0000 7f5054ba3700 1 -- start start 2023-10-01T07:55:06.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.295+0000 7f5054ba3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f505009d630 0x7f5050133ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:06.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.295+0000 7f5054ba3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50500a0a30 0x7f5050134010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:06.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.295+0000 7f5054ba3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5050138d80 0x7f5050134550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:06.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.296+0000 7f5054ba3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5050137520 con 0x7f50500a0a30 2023-10-01T07:55:06.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.296+0000 7f5054ba3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505013af80 con 0x7f505009d630 2023-10-01T07:55:06.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.296+0000 7f5054ba3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50500a0410 con 0x7f5050138d80 2023-10-01T07:55:06.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.296+0000 7f504ed9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5050138d80 0x7f5050134550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:06.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.296+0000 7f504e59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f505009d630 0x7f5050133ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:06.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.296+0000 7f504ed9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5050138d80 0x7f5050134550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35724/0 (socket says 172.21.15.26:35724) 2023-10-01T07:55:06.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.296+0000 7f504e59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f505009d630 0x7f5050133ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45938/0 (socket says 172.21.15.26:45938) 2023-10-01T07:55:06.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.296+0000 7f504ed9d700 1 -- 172.21.15.26:0/1249251477 learned_addr learned my addr 172.21.15.26:0/1249251477 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:06.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.296+0000 7f504dd9b700 1 --2- 172.21.15.26:0/1249251477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50500a0a30 0x7f5050134010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:06.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.296+0000 7f504ed9d700 1 -- 172.21.15.26:0/1249251477 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f505009d630 msgr2=0x7f5050133ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:06.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.296+0000 7f504ed9d700 1 --2- 172.21.15.26:0/1249251477 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f505009d630 0x7f5050133ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.296+0000 7f504ed9d700 1 -- 172.21.15.26:0/1249251477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50500a0a30 msgr2=0x7f5050134010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:06.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.296+0000 7f504ed9d700 1 --2- 172.21.15.26:0/1249251477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50500a0a30 0x7f5050134010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.296+0000 7f504ed9d700 1 -- 172.21.15.26:0/1249251477 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50440094a0 con 0x7f5050138d80 2023-10-01T07:55:06.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.296+0000 7f504e59c700 1 --2- 172.21.15.26:0/1249251477 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f505009d630 0x7f5050133ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:06.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.296+0000 7f504dd9b700 1 --2- 172.21.15.26:0/1249251477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50500a0a30 0x7f5050134010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:55:06.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.296+0000 7f504ed9d700 1 --2- 172.21.15.26:0/1249251477 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5050138d80 0x7f5050134550 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5048007e30 tx=0x7f504800e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:06.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.297+0000 7f503effd700 1 -- 172.21.15.26:0/1249251477 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504800ede0 con 0x7f5050138d80 2023-10-01T07:55:06.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.297+0000 7f503effd700 1 -- 172.21.15.26:0/1249251477 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5048014420 con 0x7f5050138d80 2023-10-01T07:55:06.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.297+0000 7f5054ba3700 1 -- 172.21.15.26:0/1249251477 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50501381a0 con 0x7f5050138d80 2023-10-01T07:55:06.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.297+0000 7f503effd700 1 -- 172.21.15.26:0/1249251477 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50480147d0 con 0x7f5050138d80 2023-10-01T07:55:06.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.297+0000 7f5054ba3700 1 -- 172.21.15.26:0/1249251477 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5050136c70 con 0x7f5050138d80 2023-10-01T07:55:06.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.298+0000 7f503effd700 1 -- 172.21.15.26:0/1249251477 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5048014930 con 0x7f5050138d80 2023-10-01T07:55:06.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.298+0000 7f503effd700 1 -- 172.21.15.26:0/1249251477 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f5048040370 con 0x7f5050138d80 2023-10-01T07:55:06.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.298+0000 7f504e59c700 1 -- 172.21.15.26:0/1249251477 >> v1:172.21.15.26:6816/126763 conn(0x7f503002f510 legacy=0x7f50300319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:06.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.298+0000 7f5054ba3700 1 -- 172.21.15.26:0/1249251477 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50500747f0 con 0x7f5050138d80 2023-10-01T07:55:06.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.304+0000 7f503effd700 1 -- 172.21.15.26:0/1249251477 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5048014be0 con 0x7f5050138d80 2023-10-01T07:55:06.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.341+0000 7f839fa39700 1 Processor -- start 2023-10-01T07:55:06.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.342+0000 7f839fa39700 1 -- start start 2023-10-01T07:55:06.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.343+0000 7f839fa39700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f839809d6f0 0x7f839809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:06.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.343+0000 7f839fa39700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f839809e410 0x7f8398134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:06.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.343+0000 7f839fa39700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f839809b120 con 0x7f839809e000 2023-10-01T07:55:06.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.343+0000 7f839fa39700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f839806b460 con 0x7f839809e410 2023-10-01T07:55:06.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.343+0000 7f839fa39700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f839809a7e0 con 0x7f839809d6f0 2023-10-01T07:55:06.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.343+0000 7f839d7d5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f839809d6f0 0x7f839809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:06.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.343+0000 7f839d7d5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f839809d6f0 0x7f839809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35726/0 (socket says 172.21.15.26:35726) 2023-10-01T07:55:06.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.343+0000 7f839d7d5700 1 -- 172.21.15.26:0/25366319 learned_addr learned my addr 172.21.15.26:0/25366319 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:06.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.343+0000 7f839dfd6700 1 --2- 172.21.15.26:0/25366319 >> v2:172.21.15.26:3300/0 conn(0x7f839809e410 0x7f8398134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:06.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.343+0000 7f839d7d5700 1 -- 172.21.15.26:0/25366319 >> v2:172.21.15.26:3300/0 conn(0x7f839809e410 msgr2=0x7f8398134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:06.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.343+0000 7f839d7d5700 1 --2- 172.21.15.26:0/25366319 >> v2:172.21.15.26:3300/0 conn(0x7f839809e410 0x7f8398134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.343+0000 7f839d7d5700 1 -- 172.21.15.26:0/25366319 >> v1:172.21.15.26:6789/0 conn(0x7f839809e000 legacy=0x7f83981339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:06.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.343+0000 7f839d7d5700 1 -- 172.21.15.26:0/25366319 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839809a500 con 0x7f839809d6f0 2023-10-01T07:55:06.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.344+0000 7f839d7d5700 1 --2- 172.21.15.26:0/25366319 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f839809d6f0 0x7f839809dac0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8394009920 tx=0x7f8394009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30533d6c107eba16 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:06.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.344+0000 7f838ffff700 1 -- 172.21.15.26:0/25366319 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8394011830 con 0x7f839809d6f0 2023-10-01T07:55:06.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.344+0000 7f838ffff700 1 -- 172.21.15.26:0/25366319 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8394011990 con 0x7f839809d6f0 2023-10-01T07:55:06.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.344+0000 7f838ffff700 1 -- 172.21.15.26:0/25366319 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8394011d20 con 0x7f839809d6f0 2023-10-01T07:55:06.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.345+0000 7f839fa39700 1 -- 172.21.15.26:0/25366319 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f839809d6f0 msgr2=0x7f839809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:06.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.345+0000 7f839fa39700 1 --2- 172.21.15.26:0/25366319 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f839809d6f0 0x7f839809dac0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8394009920 tx=0x7f8394009c30 comp rx=0 tx=0).stop 2023-10-01T07:55:06.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.345+0000 7f839fa39700 1 -- 172.21.15.26:0/25366319 shutdown_connections 2023-10-01T07:55:06.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.345+0000 7f839fa39700 1 --2- 172.21.15.26:0/25366319 >> v2:172.21.15.26:3300/0 conn(0x7f839809e410 0x7f8398134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.345+0000 7f839fa39700 1 --2- 172.21.15.26:0/25366319 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f839809d6f0 0x7f839809dac0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.345+0000 7f839fa39700 1 -- 172.21.15.26:0/25366319 >> 172.21.15.26:0/25366319 conn(0x7f8398066f50 msgr2=0x7f839809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:06.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.345+0000 7f839fa39700 1 -- 172.21.15.26:0/25366319 shutdown_connections 2023-10-01T07:55:06.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.345+0000 7f839fa39700 1 -- 172.21.15.26:0/25366319 wait complete. 2023-10-01T07:55:06.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.346+0000 7f839fa39700 1 Processor -- start 2023-10-01T07:55:06.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.347+0000 7f839fa39700 1 -- start start 2023-10-01T07:55:06.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.347+0000 7f839fa39700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f839809d6f0 0x7f83981a5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:06.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.347+0000 7f839fa39700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f839809e000 0x7f83981a64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:06.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.347+0000 7f839fa39700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f839809e410 0x7f83981a69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:06.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.347+0000 7f839fa39700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83981a8da0 con 0x7f839809d6f0 2023-10-01T07:55:06.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.347+0000 7f839fa39700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83981a7410 con 0x7f839809e410 2023-10-01T07:55:06.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.347+0000 7f839fa39700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83981a97f0 con 0x7f839809e000 2023-10-01T07:55:06.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.347+0000 7f839d7d5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f839809d6f0 0x7f83981a5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:06.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.347+0000 7f839d7d5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f839809d6f0 0x7f83981a5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53690/0 (socket says 172.21.15.26:53690) 2023-10-01T07:55:06.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.348+0000 7f839d7d5700 1 -- 172.21.15.26:0/1901149393 learned_addr learned my addr 172.21.15.26:0/1901149393 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:06.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.348+0000 7f839dfd6700 1 --2- 172.21.15.26:0/1901149393 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f839809e410 0x7f83981a69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:06.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.348+0000 7f839cfd4700 1 --2- 172.21.15.26:0/1901149393 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f839809e000 0x7f83981a64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:06.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.348+0000 7f839d7d5700 1 -- 172.21.15.26:0/1901149393 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f839809e000 msgr2=0x7f83981a64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:06.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.348+0000 7f839d7d5700 1 --2- 172.21.15.26:0/1901149393 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f839809e000 0x7f83981a64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.348+0000 7f839d7d5700 1 -- 172.21.15.26:0/1901149393 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f839809e410 msgr2=0x7f83981a69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:06.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.348+0000 7f839d7d5700 1 --2- 172.21.15.26:0/1901149393 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f839809e410 0x7f83981a69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.348+0000 7f839d7d5700 1 -- 172.21.15.26:0/1901149393 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8394009550 con 0x7f839809d6f0 2023-10-01T07:55:06.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.348+0000 7f839d7d5700 1 --2- 172.21.15.26:0/1901149393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f839809d6f0 0x7f83981a5f60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8394009870 tx=0x7f8394004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:06.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.348+0000 7f838dffb700 1 -- 172.21.15.26:0/1901149393 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8394004240 con 0x7f839809d6f0 2023-10-01T07:55:06.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.348+0000 7f838dffb700 1 -- 172.21.15.26:0/1901149393 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83940043a0 con 0x7f839809d6f0 2023-10-01T07:55:06.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.348+0000 7f839fa39700 1 -- 172.21.15.26:0/1901149393 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83981a88e0 con 0x7f839809d6f0 2023-10-01T07:55:06.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.348+0000 7f838dffb700 1 -- 172.21.15.26:0/1901149393 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83940036a0 con 0x7f839809d6f0 2023-10-01T07:55:06.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.349+0000 7f839fa39700 1 -- 172.21.15.26:0/1901149393 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83981a7bd0 con 0x7f839809d6f0 2023-10-01T07:55:06.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.350+0000 7f838dffb700 1 -- 172.21.15.26:0/1901149393 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8394003800 con 0x7f839809d6f0 2023-10-01T07:55:06.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.350+0000 7f838dffb700 1 -- 172.21.15.26:0/1901149393 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f83940494d0 con 0x7f839809d6f0 2023-10-01T07:55:06.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.350+0000 7f839cfd4700 1 -- 172.21.15.26:0/1901149393 >> v1:172.21.15.26:6816/126763 conn(0x7f837c02f510 legacy=0x7f837c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:06.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.351+0000 7f839fa39700 1 -- 172.21.15.26:0/1901149393 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83780052e0 con 0x7f839809d6f0 2023-10-01T07:55:06.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.352+0000 7f3b094df700 1 Processor -- start 2023-10-01T07:55:06.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.352+0000 7f3b094df700 1 -- start start 2023-10-01T07:55:06.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.352+0000 7f3b094df700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3b0406a770 0x7f3b0409d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:06.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.353+0000 7f3b094df700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3b0409dc30 0x7f3b0409e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:06.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.353+0000 7f3b094df700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3b0413c1e0 0x7f3b0413e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:06.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.353+0000 7f3b094df700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b0406ab40 con 0x7f3b0406a770 2023-10-01T07:55:06.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.353+0000 7f3b094df700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0409ebc0 con 0x7f3b0413c1e0 2023-10-01T07:55:06.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.353+0000 7f3b094df700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0409a810 con 0x7f3b0409dc30 2023-10-01T07:55:06.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.353+0000 7f3b02ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3b0406a770 0x7f3b0409d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:06.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.353+0000 7f3b02ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3b0406a770 0x7f3b0409d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53700/0 (socket says 172.21.15.26:53700) 2023-10-01T07:55:06.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.353+0000 7f3b02ffd700 1 -- 172.21.15.26:0/2113105968 learned_addr learned my addr 172.21.15.26:0/2113105968 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:06.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.353+0000 7f3b037fe700 1 --2- 172.21.15.26:0/2113105968 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3b0413c1e0 0x7f3b0413e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:06.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.353+0000 7f3b027fc700 1 --2- 172.21.15.26:0/2113105968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3b0409dc30 0x7f3b0409e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:06.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.353+0000 7f3b02ffd700 1 -- 172.21.15.26:0/2113105968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3b0409dc30 msgr2=0x7f3b0409e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:06.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.353+0000 7f3b02ffd700 1 --2- 172.21.15.26:0/2113105968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3b0409dc30 0x7f3b0409e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.353+0000 7f3b02ffd700 1 -- 172.21.15.26:0/2113105968 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3b0413c1e0 msgr2=0x7f3b0413e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:06.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.353+0000 7f3b02ffd700 1 --2- 172.21.15.26:0/2113105968 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3b0413c1e0 0x7f3b0413e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.353+0000 7f3b02ffd700 1 -- 172.21.15.26:0/2113105968 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0409e920 con 0x7f3b0406a770 2023-10-01T07:55:06.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.353+0000 7f3b037fe700 1 --2- 172.21.15.26:0/2113105968 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3b0413c1e0 0x7f3b0413e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:55:06.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.353+0000 7f3b02ffd700 1 --2- 172.21.15.26:0/2113105968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b0406a770 0x7f3b0409d6f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3af4009920 tx=0x7f3af4009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22b37affdffdc69 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:06.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.357+0000 7f3b01ffb700 1 -- 172.21.15.26:0/2113105968 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af4011830 con 0x7f3b0406a770 2023-10-01T07:55:06.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.357+0000 7f3b01ffb700 1 -- 172.21.15.26:0/2113105968 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af4011990 con 0x7f3b0406a770 2023-10-01T07:55:06.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.357+0000 7f3b01ffb700 1 -- 172.21.15.26:0/2113105968 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af4011d20 con 0x7f3b0406a770 2023-10-01T07:55:06.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.357+0000 7f838dffb700 1 -- 172.21.15.26:0/1901149393 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8394015020 con 0x7f839809d6f0 2023-10-01T07:55:06.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.357+0000 7f3b094df700 1 -- 172.21.15.26:0/2113105968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b0406a770 msgr2=0x7f3b0409d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:06.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.357+0000 7f3b094df700 1 --2- 172.21.15.26:0/2113105968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b0406a770 0x7f3b0409d6f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3af4009920 tx=0x7f3af4009c30 comp rx=0 tx=0).stop 2023-10-01T07:55:06.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.357+0000 7f3b094df700 1 -- 172.21.15.26:0/2113105968 shutdown_connections 2023-10-01T07:55:06.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.357+0000 7f3b094df700 1 --2- 172.21.15.26:0/2113105968 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3b0413c1e0 0x7f3b0413e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.357+0000 7f3b094df700 1 --2- 172.21.15.26:0/2113105968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b0406a770 0x7f3b0409d6f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.357+0000 7f3b094df700 1 --2- 172.21.15.26:0/2113105968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3b0409dc30 0x7f3b0409e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.357+0000 7f3b094df700 1 -- 172.21.15.26:0/2113105968 >> 172.21.15.26:0/2113105968 conn(0x7f3b04066f50 msgr2=0x7f3b0409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:06.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.358+0000 7f3b094df700 1 -- 172.21.15.26:0/2113105968 shutdown_connections 2023-10-01T07:55:06.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.358+0000 7f3b094df700 1 -- 172.21.15.26:0/2113105968 wait complete. 2023-10-01T07:55:06.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.359+0000 7f3b094df700 1 Processor -- start 2023-10-01T07:55:06.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.359+0000 7f3b094df700 1 -- start start 2023-10-01T07:55:06.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.359+0000 7f3b094df700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3b0406a770 0x7f3b0413bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:06.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.359+0000 7f3b094df700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b0409dc30 0x7f3b0413a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:06.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.359+0000 7f3b094df700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3b0413c1e0 0x7f3b0413a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:06.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.359+0000 7f3b094df700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b04072360 con 0x7f3b0409dc30 2023-10-01T07:55:06.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.359+0000 7f3b094df700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b04072170 con 0x7f3b0406a770 2023-10-01T07:55:06.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.359+0000 7f3b094df700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0409f1a0 con 0x7f3b0413c1e0 2023-10-01T07:55:06.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.360+0000 7f3b02ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3b0406a770 0x7f3b0413bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:06.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.360+0000 7f3b02ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3b0406a770 0x7f3b0413bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45962/0 (socket says 172.21.15.26:45962) 2023-10-01T07:55:06.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.360+0000 7f3b02ffd700 1 -- 172.21.15.26:0/3207589633 learned_addr learned my addr 172.21.15.26:0/3207589633 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:06.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.360+0000 7f3b037fe700 1 --2- 172.21.15.26:0/3207589633 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3b0413c1e0 0x7f3b0413a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:06.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.360+0000 7f3b027fc700 1 --2- 172.21.15.26:0/3207589633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b0409dc30 0x7f3b0413a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:06.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.360+0000 7f3b02ffd700 1 -- 172.21.15.26:0/3207589633 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3b0413c1e0 msgr2=0x7f3b0413a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:06.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.360+0000 7f3b02ffd700 1 --2- 172.21.15.26:0/3207589633 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3b0413c1e0 0x7f3b0413a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.360+0000 7f3b02ffd700 1 -- 172.21.15.26:0/3207589633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b0409dc30 msgr2=0x7f3b0413a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:06.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.360+0000 7f3b02ffd700 1 --2- 172.21.15.26:0/3207589633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b0409dc30 0x7f3b0413a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.360+0000 7f3b02ffd700 1 -- 172.21.15.26:0/3207589633 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af4009550 con 0x7f3b0406a770 2023-10-01T07:55:06.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.360+0000 7f3b027fc700 1 --2- 172.21.15.26:0/3207589633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b0409dc30 0x7f3b0413a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:55:06.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.360+0000 7f3b02ffd700 1 --2- 172.21.15.26:0/3207589633 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3b0406a770 0x7f3b0413bba0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3b0411d760 tx=0x7f3af4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:06.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.360+0000 7f3aeb7fe700 1 -- 172.21.15.26:0/3207589633 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af4004300 con 0x7f3b0406a770 2023-10-01T07:55:06.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.361+0000 7f3b094df700 1 -- 172.21.15.26:0/3207589633 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b0411f170 con 0x7f3b0406a770 2023-10-01T07:55:06.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.361+0000 7f3aeb7fe700 1 -- 172.21.15.26:0/3207589633 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af401f070 con 0x7f3b0406a770 2023-10-01T07:55:06.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.361+0000 7f3aeb7fe700 1 -- 172.21.15.26:0/3207589633 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af40036a0 con 0x7f3b0406a770 2023-10-01T07:55:06.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.361+0000 7f3b094df700 1 -- 172.21.15.26:0/3207589633 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b0411fc00 con 0x7f3b0406a770 2023-10-01T07:55:06.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.362+0000 7f3aeb7fe700 1 -- 172.21.15.26:0/3207589633 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3af4021030 con 0x7f3b0406a770 2023-10-01T07:55:06.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.362+0000 7f3b094df700 1 -- 172.21.15.26:0/3207589633 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0411fa60 con 0x7f3b0406a770 2023-10-01T07:55:06.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.362+0000 7f3aeb7fe700 1 -- 172.21.15.26:0/3207589633 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f3af4040ec0 con 0x7f3b0406a770 2023-10-01T07:55:06.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.362+0000 7f3b027fc700 1 -- 172.21.15.26:0/3207589633 >> v1:172.21.15.26:6816/126763 conn(0x7f3af002f510 legacy=0x7f3af00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:06.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.367+0000 7f3aeb7fe700 1 -- 172.21.15.26:0/3207589633 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3b0411fa60 con 0x7f3b0406a770 2023-10-01T07:55:06.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.393+0000 7f0faeffd700 1 -- 172.21.15.26:0/2353442952 >> v1:172.21.15.26:6816/126763 conn(0x7f0f9c02f510 legacy=0x7f0f9c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:06.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.458+0000 7f0fb5e64700 1 -- 172.21.15.26:0/2353442952 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0fb009f420 con 0x7f0fb009d6f0 2023-10-01T07:55:06.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.459+0000 7f0f97fff700 1 -- 172.21.15.26:0/2353442952 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0fa001b3b0 con 0x7f0fb009d6f0 2023-10-01T07:55:06.460 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:06.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.461+0000 7f0fb5e64700 1 -- 172.21.15.26:0/2353442952 >> v1:172.21.15.26:6816/126763 conn(0x7f0f9c02f510 legacy=0x7f0f9c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:06.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.461+0000 7f0fb5e64700 1 -- 172.21.15.26:0/2353442952 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0fb009d6f0 msgr2=0x7f0fb01a5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:06.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.461+0000 7f0fb5e64700 1 --2- 172.21.15.26:0/2353442952 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0fb009d6f0 0x7f0fb01a5eb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0fa000e910 tx=0x7f0fa000ecd0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.461+0000 7f0fb5e64700 1 -- 172.21.15.26:0/2353442952 shutdown_connections 2023-10-01T07:55:06.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.461+0000 7f0fb5e64700 1 --2- 172.21.15.26:0/2353442952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fb009e440 0x7f0fb01a6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.461+0000 7f0fb5e64700 1 --2- 172.21.15.26:0/2353442952 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0fb009d6f0 0x7f0fb01a5eb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.461+0000 7f0fb5e64700 1 --2- 172.21.15.26:0/2353442952 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0fb009e000 0x7f0fb01a63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.461+0000 7f0fb5e64700 1 -- 172.21.15.26:0/2353442952 >> 172.21.15.26:0/2353442952 conn(0x7f0fb0066f50 msgr2=0x7f0fb01badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:06.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.462+0000 7f0fb5e64700 1 -- 172.21.15.26:0/2353442952 shutdown_connections 2023-10-01T07:55:06.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.462+0000 7f0fb5e64700 1 -- 172.21.15.26:0/2353442952 wait complete. 2023-10-01T07:55:06.476 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:06.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.499+0000 7f504e59c700 1 -- 172.21.15.26:0/1249251477 >> v1:172.21.15.26:6816/126763 conn(0x7f503002f510 legacy=0x7f50300319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:06.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.547+0000 7f5054ba3700 1 -- 172.21.15.26:0/1249251477 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f50501371a0 con 0x7f5050138d80 2023-10-01T07:55:06.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.548+0000 7f503effd700 1 -- 172.21.15.26:0/1249251477 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f50501371a0 con 0x7f5050138d80 2023-10-01T07:55:06.548 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:06.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.551+0000 7f839cfd4700 1 -- 172.21.15.26:0/1901149393 >> v1:172.21.15.26:6816/126763 conn(0x7f837c02f510 legacy=0x7f837c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:06.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.551+0000 7f5054ba3700 1 -- 172.21.15.26:0/1249251477 >> v1:172.21.15.26:6816/126763 conn(0x7f503002f510 legacy=0x7f50300319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:06.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.551+0000 7f5054ba3700 1 -- 172.21.15.26:0/1249251477 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5050138d80 msgr2=0x7f5050134550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:06.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.551+0000 7f5054ba3700 1 --2- 172.21.15.26:0/1249251477 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5050138d80 0x7f5050134550 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5048007e30 tx=0x7f504800e3c0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.551+0000 7f5054ba3700 1 -- 172.21.15.26:0/1249251477 shutdown_connections 2023-10-01T07:55:06.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.551+0000 7f5054ba3700 1 --2- 172.21.15.26:0/1249251477 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5050138d80 0x7f5050134550 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.551+0000 7f5054ba3700 1 --2- 172.21.15.26:0/1249251477 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f505009d630 0x7f5050133ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.551+0000 7f5054ba3700 1 --2- 172.21.15.26:0/1249251477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50500a0a30 0x7f5050134010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.551+0000 7f5054ba3700 1 -- 172.21.15.26:0/1249251477 >> 172.21.15.26:0/1249251477 conn(0x7f50500a3050 msgr2=0x7f50501399e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:06.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.551+0000 7f5054ba3700 1 -- 172.21.15.26:0/1249251477 shutdown_connections 2023-10-01T07:55:06.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.551+0000 7f5054ba3700 1 -- 172.21.15.26:0/1249251477 wait complete. 2023-10-01T07:55:06.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.563+0000 7f3b027fc700 1 -- 172.21.15.26:0/3207589633 >> v1:172.21.15.26:6816/126763 conn(0x7f3af002f510 legacy=0x7f3af00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:06.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:06.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.577+0000 7f3b094df700 1 -- 172.21.15.26:0/3207589633 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3b0411fa40 con 0x7f3b0406a770 2023-10-01T07:55:06.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.578+0000 7f3aeb7fe700 1 -- 172.21.15.26:0/3207589633 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3af4015070 con 0x7f3b0406a770 2023-10-01T07:55:06.579 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:06.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.580+0000 7f3b094df700 1 -- 172.21.15.26:0/3207589633 >> v1:172.21.15.26:6816/126763 conn(0x7f3af002f510 legacy=0x7f3af00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:06.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.580+0000 7f3b094df700 1 -- 172.21.15.26:0/3207589633 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3b0406a770 msgr2=0x7f3b0413bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:06.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.580+0000 7f3b094df700 1 --2- 172.21.15.26:0/3207589633 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3b0406a770 0x7f3b0413bba0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3b0411d760 tx=0x7f3af4004750 comp rx=0 tx=0).stop 2023-10-01T07:55:06.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.580+0000 7f3b094df700 1 -- 172.21.15.26:0/3207589633 shutdown_connections 2023-10-01T07:55:06.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.580+0000 7f3b094df700 1 --2- 172.21.15.26:0/3207589633 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3b0413c1e0 0x7f3b0413a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.580+0000 7f3b094df700 1 --2- 172.21.15.26:0/3207589633 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3b0406a770 0x7f3b0413bba0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.580+0000 7f3b094df700 1 --2- 172.21.15.26:0/3207589633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b0409dc30 0x7f3b0413a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.580+0000 7f3b094df700 1 -- 172.21.15.26:0/3207589633 >> 172.21.15.26:0/3207589633 conn(0x7f3b04066f50 msgr2=0x7f3b0409b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:06.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.580+0000 7f3b094df700 1 -- 172.21.15.26:0/3207589633 shutdown_connections 2023-10-01T07:55:06.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.580+0000 7f3b094df700 1 -- 172.21.15.26:0/3207589633 wait complete. 2023-10-01T07:55:06.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.583+0000 7f839fa39700 1 -- 172.21.15.26:0/1901149393 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8378005860 con 0x7f839809d6f0 2023-10-01T07:55:06.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.584+0000 7f838dffb700 1 -- 172.21.15.26:0/1901149393 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f83940357d0 con 0x7f839809d6f0 2023-10-01T07:55:06.584 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:06.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.586+0000 7f839fa39700 1 -- 172.21.15.26:0/1901149393 >> v1:172.21.15.26:6816/126763 conn(0x7f837c02f510 legacy=0x7f837c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:06.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.586+0000 7f839fa39700 1 -- 172.21.15.26:0/1901149393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f839809d6f0 msgr2=0x7f83981a5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:06.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.586+0000 7f839fa39700 1 --2- 172.21.15.26:0/1901149393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f839809d6f0 0x7f83981a5f60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8394009870 tx=0x7f8394004750 comp rx=0 tx=0).stop 2023-10-01T07:55:06.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.586+0000 7f839fa39700 1 -- 172.21.15.26:0/1901149393 shutdown_connections 2023-10-01T07:55:06.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.586+0000 7f839fa39700 1 --2- 172.21.15.26:0/1901149393 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f839809e410 0x7f83981a69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.586+0000 7f839fa39700 1 --2- 172.21.15.26:0/1901149393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f839809d6f0 0x7f83981a5f60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.586+0000 7f839fa39700 1 --2- 172.21.15.26:0/1901149393 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f839809e000 0x7f83981a64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:06.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.586+0000 7f839fa39700 1 -- 172.21.15.26:0/1901149393 >> 172.21.15.26:0/1901149393 conn(0x7f8398066f50 msgr2=0x7f83981baed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:06.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.586+0000 7f839fa39700 1 -- 172.21.15.26:0/1901149393 shutdown_connections 2023-10-01T07:55:06.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:06.586+0000 7f839fa39700 1 -- 172.21.15.26:0/1901149393 wait complete. 2023-10-01T07:55:06.596 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:06.601 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:07.478 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:07.567 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:07.597 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:07.602 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:07.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.626+0000 7f0ae990d700 1 Processor -- start 2023-10-01T07:55:07.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.626+0000 7f0ae990d700 1 -- start start 2023-10-01T07:55:07.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.627+0000 7f0ae990d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ae409d6f0 0x7f0ae409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:07.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.627+0000 7f0ae990d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0ae409e410 0x7f0ae4130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:07.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.627+0000 7f0ae990d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ae409f130 con 0x7f0ae409e000 2023-10-01T07:55:07.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.627+0000 7f0ae990d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae409f520 con 0x7f0ae409e410 2023-10-01T07:55:07.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.627+0000 7f0ae990d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae409e930 con 0x7f0ae409d6f0 2023-10-01T07:55:07.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.627+0000 7f0ae2ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ae409d6f0 0x7f0ae409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:07.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.627+0000 7f0ae2ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ae409d6f0 0x7f0ae409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35754/0 (socket says 172.21.15.26:35754) 2023-10-01T07:55:07.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.627+0000 7f0ae2ffd700 1 -- 172.21.15.26:0/4187000617 learned_addr learned my addr 172.21.15.26:0/4187000617 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:07.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.628+0000 7f0ae2ffd700 1 -- 172.21.15.26:0/4187000617 >> v2:172.21.15.26:3300/0 conn(0x7f0ae409e410 msgr2=0x7f0ae4130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:07.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.628+0000 7f0ae2ffd700 1 --2- 172.21.15.26:0/4187000617 >> v2:172.21.15.26:3300/0 conn(0x7f0ae409e410 0x7f0ae4130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.628+0000 7f0ae2ffd700 1 -- 172.21.15.26:0/4187000617 >> v1:172.21.15.26:6789/0 conn(0x7f0ae409e000 legacy=0x7f0ae4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:07.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.628+0000 7f0ae2ffd700 1 -- 172.21.15.26:0/4187000617 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae409b2d0 con 0x7f0ae409d6f0 2023-10-01T07:55:07.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.628+0000 7f0ae2ffd700 1 --2- 172.21.15.26:0/4187000617 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ae409d6f0 0x7f0ae409dac0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0ad400bb90 tx=0x7f0ad400bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=621e0d22bd6a205c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:07.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.628+0000 7f0ae1ffb700 1 -- 172.21.15.26:0/4187000617 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad400dd10 con 0x7f0ae409d6f0 2023-10-01T07:55:07.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.628+0000 7f0ae1ffb700 1 -- 172.21.15.26:0/4187000617 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad400de70 con 0x7f0ae409d6f0 2023-10-01T07:55:07.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.628+0000 7f0ae1ffb700 1 -- 172.21.15.26:0/4187000617 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad4004230 con 0x7f0ae409d6f0 2023-10-01T07:55:07.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.629+0000 7f0ae990d700 1 -- 172.21.15.26:0/4187000617 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ae409d6f0 msgr2=0x7f0ae409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:07.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.629+0000 7f0ae990d700 1 --2- 172.21.15.26:0/4187000617 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ae409d6f0 0x7f0ae409dac0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0ad400bb90 tx=0x7f0ad400bea0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.629+0000 7f0ae990d700 1 -- 172.21.15.26:0/4187000617 shutdown_connections 2023-10-01T07:55:07.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.629+0000 7f0ae990d700 1 --2- 172.21.15.26:0/4187000617 >> v2:172.21.15.26:3300/0 conn(0x7f0ae409e410 0x7f0ae4130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.629+0000 7f0ae990d700 1 --2- 172.21.15.26:0/4187000617 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ae409d6f0 0x7f0ae409dac0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.630+0000 7f0ae990d700 1 -- 172.21.15.26:0/4187000617 >> 172.21.15.26:0/4187000617 conn(0x7f0ae4066f50 msgr2=0x7f0ae409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:07.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.630+0000 7f0ae990d700 1 -- 172.21.15.26:0/4187000617 shutdown_connections 2023-10-01T07:55:07.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.630+0000 7f0ae990d700 1 -- 172.21.15.26:0/4187000617 wait complete. 2023-10-01T07:55:07.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.631+0000 7f0ae990d700 1 Processor -- start 2023-10-01T07:55:07.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.631+0000 7f0ae990d700 1 -- start start 2023-10-01T07:55:07.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.631+0000 7f0ae990d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ae409d6f0 0x7f0ae411e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:07.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.632+0000 7f0ae990d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ae409e000 0x7f0ae411e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:07.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.632+0000 7f0ae990d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ae409e410 0x7f0ae411eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:07.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.632+0000 7f0ae990d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae4120580 con 0x7f0ae409e410 2023-10-01T07:55:07.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.632+0000 7f0ae990d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae4121bc0 con 0x7f0ae409d6f0 2023-10-01T07:55:07.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.632+0000 7f0ae990d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae4120260 con 0x7f0ae409e000 2023-10-01T07:55:07.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.632+0000 7f0ae2ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ae409d6f0 0x7f0ae411e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:07.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.632+0000 7f0ae2ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ae409d6f0 0x7f0ae411e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45970/0 (socket says 172.21.15.26:45970) 2023-10-01T07:55:07.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.632+0000 7f0ae2ffd700 1 -- 172.21.15.26:0/2612771698 learned_addr learned my addr 172.21.15.26:0/2612771698 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:07.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.632+0000 7f0ae37fe700 1 --2- 172.21.15.26:0/2612771698 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ae409e410 0x7f0ae411eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:07.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.632+0000 7f0ae27fc700 1 --2- 172.21.15.26:0/2612771698 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ae409e000 0x7f0ae411e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:07.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.632+0000 7f0ae2ffd700 1 -- 172.21.15.26:0/2612771698 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ae409e000 msgr2=0x7f0ae411e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:07.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.632+0000 7f0ae2ffd700 1 --2- 172.21.15.26:0/2612771698 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ae409e000 0x7f0ae411e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.632+0000 7f0ae2ffd700 1 -- 172.21.15.26:0/2612771698 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ae409e410 msgr2=0x7f0ae411eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:07.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.632+0000 7f0ae2ffd700 1 --2- 172.21.15.26:0/2612771698 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ae409e410 0x7f0ae411eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.632+0000 7f0ae2ffd700 1 -- 172.21.15.26:0/2612771698 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad400b7f0 con 0x7f0ae409d6f0 2023-10-01T07:55:07.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.632+0000 7f0ae2ffd700 1 --2- 172.21.15.26:0/2612771698 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ae409d6f0 0x7f0ae411e0f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0ad400b340 tx=0x7f0ad4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:07.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.633+0000 7f0acbfff700 1 -- 172.21.15.26:0/2612771698 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad4003c70 con 0x7f0ae409d6f0 2023-10-01T07:55:07.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.633+0000 7f0acbfff700 1 -- 172.21.15.26:0/2612771698 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad4003dd0 con 0x7f0ae409d6f0 2023-10-01T07:55:07.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.633+0000 7f0ae990d700 1 -- 172.21.15.26:0/2612771698 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae40a1ee0 con 0x7f0ae409d6f0 2023-10-01T07:55:07.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.633+0000 7f0acbfff700 1 -- 172.21.15.26:0/2612771698 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad4022710 con 0x7f0ae409d6f0 2023-10-01T07:55:07.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.633+0000 7f0ae990d700 1 -- 172.21.15.26:0/2612771698 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae4121350 con 0x7f0ae409d6f0 2023-10-01T07:55:07.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.634+0000 7f0acbfff700 1 -- 172.21.15.26:0/2612771698 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0ad4022870 con 0x7f0ae409d6f0 2023-10-01T07:55:07.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.634+0000 7f0ae990d700 1 -- 172.21.15.26:0/2612771698 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae4074ea0 con 0x7f0ae409d6f0 2023-10-01T07:55:07.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.634+0000 7f0acbfff700 1 -- 172.21.15.26:0/2612771698 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f0ad40454d0 con 0x7f0ae409d6f0 2023-10-01T07:55:07.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.634+0000 7f0ae27fc700 1 -- 172.21.15.26:0/2612771698 >> v1:172.21.15.26:6816/126763 conn(0x7f0ad002f510 legacy=0x7f0ad00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:07.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.639+0000 7f0acbfff700 1 -- 172.21.15.26:0/2612771698 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0ad402a980 con 0x7f0ae409d6f0 2023-10-01T07:55:07.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.714+0000 7f5a9431c700 1 Processor -- start 2023-10-01T07:55:07.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.714+0000 7f5a9431c700 1 -- start start 2023-10-01T07:55:07.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.715+0000 7f5a9431c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5a8c1338c0 0x7f5a8c133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:07.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.715+0000 7f5a9431c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5a8c1341d0 0x7f5a8c09de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:07.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.715+0000 7f5a9431c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5a8c09e390 0x7f5a8c09e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:07.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.715+0000 7f5a9431c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a8c070c80 con 0x7f5a8c09e390 2023-10-01T07:55:07.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.715+0000 7f5a9431c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c06f720 con 0x7f5a8c1338c0 2023-10-01T07:55:07.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.715+0000 7f5a9431c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c06fce0 con 0x7f5a8c1341d0 2023-10-01T07:55:07.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.715+0000 7f5a918b7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5a8c1341d0 0x7f5a8c09de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:07.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.715+0000 7f5a920b8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5a8c1338c0 0x7f5a8c133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:07.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.715+0000 7f5a918b7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5a8c1341d0 0x7f5a8c09de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35784/0 (socket says 172.21.15.26:35784) 2023-10-01T07:55:07.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.715+0000 7f5a918b7700 1 -- 172.21.15.26:0/257453514 learned_addr learned my addr 172.21.15.26:0/257453514 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:07.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.715+0000 7f5a928b9700 1 --2- 172.21.15.26:0/257453514 >> v2:172.21.15.26:3300/0 conn(0x7f5a8c09e390 0x7f5a8c09e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:07.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.716+0000 7f5a918b7700 1 -- 172.21.15.26:0/257453514 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5a8c1338c0 msgr2=0x7f5a8c133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:07.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.716+0000 7f5a918b7700 1 --2- 172.21.15.26:0/257453514 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5a8c1338c0 0x7f5a8c133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.716+0000 7f5a918b7700 1 -- 172.21.15.26:0/257453514 >> v2:172.21.15.26:3300/0 conn(0x7f5a8c09e390 msgr2=0x7f5a8c09e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:07.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.716+0000 7f5a918b7700 1 --2- 172.21.15.26:0/257453514 >> v2:172.21.15.26:3300/0 conn(0x7f5a8c09e390 0x7f5a8c09e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.716+0000 7f5a918b7700 1 -- 172.21.15.26:0/257453514 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8c1336a0 con 0x7f5a8c1341d0 2023-10-01T07:55:07.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.716+0000 7f5a928b9700 1 --2- 172.21.15.26:0/257453514 >> v2:172.21.15.26:3300/0 conn(0x7f5a8c09e390 0x7f5a8c09e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:07.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.716+0000 7f5a920b8700 1 --2- 172.21.15.26:0/257453514 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5a8c1338c0 0x7f5a8c133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:07.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.716+0000 7f5a918b7700 1 --2- 172.21.15.26:0/257453514 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5a8c1341d0 0x7f5a8c09de50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c0098f0 tx=0x7f5a7c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a29805eacafc2e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:07.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.716+0000 7f5a910b6700 1 -- 172.21.15.26:0/257453514 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c011830 con 0x7f5a8c1341d0 2023-10-01T07:55:07.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.716+0000 7f5a910b6700 1 -- 172.21.15.26:0/257453514 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7c011990 con 0x7f5a8c1341d0 2023-10-01T07:55:07.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.716+0000 7f5a910b6700 1 -- 172.21.15.26:0/257453514 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c011d20 con 0x7f5a8c1341d0 2023-10-01T07:55:07.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.717+0000 7f5a9431c700 1 -- 172.21.15.26:0/257453514 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5a8c1341d0 msgr2=0x7f5a8c09de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:07.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.717+0000 7f5a9431c700 1 --2- 172.21.15.26:0/257453514 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5a8c1341d0 0x7f5a8c09de50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c0098f0 tx=0x7f5a7c009c00 comp rx=0 tx=0).stop 2023-10-01T07:55:07.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.717+0000 7f5a9431c700 1 -- 172.21.15.26:0/257453514 shutdown_connections 2023-10-01T07:55:07.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.717+0000 7f5a9431c700 1 --2- 172.21.15.26:0/257453514 >> v2:172.21.15.26:3300/0 conn(0x7f5a8c09e390 0x7f5a8c09e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.717+0000 7f5a9431c700 1 --2- 172.21.15.26:0/257453514 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5a8c1338c0 0x7f5a8c133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.717+0000 7f5a9431c700 1 --2- 172.21.15.26:0/257453514 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5a8c1341d0 0x7f5a8c09de50 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.717+0000 7f5a9431c700 1 -- 172.21.15.26:0/257453514 >> 172.21.15.26:0/257453514 conn(0x7f5a8c0a2aa0 msgr2=0x7f5a8c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:07.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.717+0000 7f5a9431c700 1 -- 172.21.15.26:0/257453514 shutdown_connections 2023-10-01T07:55:07.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.717+0000 7f5a9431c700 1 -- 172.21.15.26:0/257453514 wait complete. 2023-10-01T07:55:07.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.719+0000 7f5a9431c700 1 Processor -- start 2023-10-01T07:55:07.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.719+0000 7f5a9431c700 1 -- start start 2023-10-01T07:55:07.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.720+0000 7f5a9431c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5a8c09e390 0x7f5a8c11f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:07.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.720+0000 7f5a9431c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5a8c1338c0 0x7f5a8c11fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:07.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.720+0000 7f5a9431c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a8c1341d0 0x7f5a8c120340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:07.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.720+0000 7f5a9431c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c1213e0 con 0x7f5a8c1341d0 2023-10-01T07:55:07.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.720+0000 7f5a9431c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c121a00 con 0x7f5a8c09e390 2023-10-01T07:55:07.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.720+0000 7f5a9431c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c1320e0 con 0x7f5a8c1338c0 2023-10-01T07:55:07.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.720+0000 7f5a920b8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5a8c09e390 0x7f5a8c11f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:07.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.720+0000 7f5a928b9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a8c1341d0 0x7f5a8c120340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:07.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.720+0000 7f5a920b8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5a8c09e390 0x7f5a8c11f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45986/0 (socket says 172.21.15.26:45986) 2023-10-01T07:55:07.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.720+0000 7f5a928b9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a8c1341d0 0x7f5a8c120340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53736/0 (socket says 172.21.15.26:53736) 2023-10-01T07:55:07.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.720+0000 7f5a920b8700 1 -- 172.21.15.26:0/1051968806 learned_addr learned my addr 172.21.15.26:0/1051968806 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:07.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.720+0000 7f5a918b7700 1 --2- 172.21.15.26:0/1051968806 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5a8c1338c0 0x7f5a8c11fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:07.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.720+0000 7f5a920b8700 1 -- 172.21.15.26:0/1051968806 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5a8c1338c0 msgr2=0x7f5a8c11fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:07.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.720+0000 7f5a920b8700 1 --2- 172.21.15.26:0/1051968806 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5a8c1338c0 0x7f5a8c11fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.720+0000 7f5a920b8700 1 -- 172.21.15.26:0/1051968806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a8c1341d0 msgr2=0x7f5a8c120340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:07.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.720+0000 7f5a920b8700 1 --2- 172.21.15.26:0/1051968806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a8c1341d0 0x7f5a8c120340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.720+0000 7f5a920b8700 1 -- 172.21.15.26:0/1051968806 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a84009a70 con 0x7f5a8c09e390 2023-10-01T07:55:07.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.720+0000 7f5a918b7700 1 --2- 172.21.15.26:0/1051968806 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5a8c1338c0 0x7f5a8c11fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:07.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.721+0000 7f5a920b8700 1 --2- 172.21.15.26:0/1051968806 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5a8c09e390 0x7f5a8c11f8c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5a8800ebe0 tx=0x7f5a8800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:07.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.721+0000 7f5a82ffd700 1 -- 172.21.15.26:0/1051968806 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a88009800 con 0x7f5a8c09e390 2023-10-01T07:55:07.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.721+0000 7f5a82ffd700 1 -- 172.21.15.26:0/1051968806 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8800c850 con 0x7f5a8c09e390 2023-10-01T07:55:07.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.721+0000 7f5a82ffd700 1 -- 172.21.15.26:0/1051968806 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8800cbc0 con 0x7f5a8c09e390 2023-10-01T07:55:07.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.721+0000 7f5a9431c700 1 -- 172.21.15.26:0/1051968806 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a880094a0 con 0x7f5a8c09e390 2023-10-01T07:55:07.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.721+0000 7f5a9431c700 1 -- 172.21.15.26:0/1051968806 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a7c009550 con 0x7f5a8c09e390 2023-10-01T07:55:07.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.722+0000 7f5a82ffd700 1 -- 172.21.15.26:0/1051968806 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5a8800cd20 con 0x7f5a8c09e390 2023-10-01T07:55:07.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.722+0000 7f5a9431c700 1 -- 172.21.15.26:0/1051968806 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a8c122240 con 0x7f5a8c09e390 2023-10-01T07:55:07.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.722+0000 7f5a82ffd700 1 -- 172.21.15.26:0/1051968806 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f5a8803fc90 con 0x7f5a8c09e390 2023-10-01T07:55:07.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.722+0000 7f5a918b7700 1 -- 172.21.15.26:0/1051968806 >> v1:172.21.15.26:6816/126763 conn(0x7f5a7002f510 legacy=0x7f5a700319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:07.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.727+0000 7f5a82ffd700 1 -- 172.21.15.26:0/1051968806 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5a8801be10 con 0x7f5a8c09e390 2023-10-01T07:55:07.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.757+0000 7f92e0c51700 1 Processor -- start 2023-10-01T07:55:07.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.757+0000 7f92e0c51700 1 -- start start 2023-10-01T07:55:07.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.758+0000 7f77aa807700 1 Processor -- start 2023-10-01T07:55:07.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.758+0000 7f77aa807700 1 -- start start 2023-10-01T07:55:07.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.758+0000 7f77aa807700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f77a41338a0 0x7f77a4133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:07.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.758+0000 7f92e0c51700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f92dc06c0e0 0x7f92dc09ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:07.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.758+0000 7f92e0c51700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92dc134ec0 0x7f92dc1379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:07.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.758+0000 7f77aa807700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f77a409de50 0x7f77a409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:07.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.758+0000 7f77aa807700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77a409e760 0x7f77a413a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:07.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.758+0000 7f77aa807700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a406fef0 con 0x7f77a41338a0 2023-10-01T07:55:07.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.758+0000 7f77aa807700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a406ef30 con 0x7f77a409e760 2023-10-01T07:55:07.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.758+0000 7f77aa807700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77a41334b0 con 0x7f77a409de50 2023-10-01T07:55:07.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.759+0000 7f77a8da4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77a409e760 0x7f77a413a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:07.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.759+0000 7f77a8da4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77a409e760 0x7f77a413a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46010/0 (socket says 172.21.15.26:46010) 2023-10-01T07:55:07.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.759+0000 7f77a8da4700 1 -- 172.21.15.26:0/2284335367 learned_addr learned my addr 172.21.15.26:0/2284335367 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:07.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.759+0000 7f77a3fff700 1 --2- 172.21.15.26:0/2284335367 >> v2:172.21.15.26:3300/0 conn(0x7f77a41338a0 0x7f77a4133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:07.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.758+0000 7f92e0c51700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92dc137f20 0x7f92dc138370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:07.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.758+0000 7f92e0c51700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92dc06c4b0 con 0x7f92dc06c0e0 2023-10-01T07:55:07.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.758+0000 7f92e0c51700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92dc1388b0 con 0x7f92dc137f20 2023-10-01T07:55:07.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.758+0000 7f92e0c51700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92dc0a09c0 con 0x7f92dc134ec0 2023-10-01T07:55:07.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.759+0000 7f92d9d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92dc134ec0 0x7f92dc1379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:07.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.759+0000 7f92d9d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92dc134ec0 0x7f92dc1379e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35806/0 (socket says 172.21.15.26:35806) 2023-10-01T07:55:07.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.759+0000 7f92d9d9b700 1 -- 172.21.15.26:0/2899893314 learned_addr learned my addr 172.21.15.26:0/2899893314 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:07.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.759+0000 7f92da59c700 1 --2- 172.21.15.26:0/2899893314 >> v2:172.21.15.26:3300/0 conn(0x7f92dc06c0e0 0x7f92dc09ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:07.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.759+0000 7f92dad9d700 1 --2- 172.21.15.26:0/2899893314 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92dc137f20 0x7f92dc138370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:07.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.759+0000 7f77a37fe700 1 --2- 172.21.15.26:0/2284335367 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f77a409de50 0x7f77a409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:07.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.759+0000 7f77a8da4700 1 -- 172.21.15.26:0/2284335367 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f77a409de50 msgr2=0x7f77a409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:07.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.759+0000 7f77a8da4700 1 --2- 172.21.15.26:0/2284335367 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f77a409de50 0x7f77a409e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.759+0000 7f77a8da4700 1 -- 172.21.15.26:0/2284335367 >> v2:172.21.15.26:3300/0 conn(0x7f77a41338a0 msgr2=0x7f77a4133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:07.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.759+0000 7f77a8da4700 1 --2- 172.21.15.26:0/2284335367 >> v2:172.21.15.26:3300/0 conn(0x7f77a41338a0 0x7f77a4133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.759+0000 7f92d9d9b700 1 -- 172.21.15.26:0/2899893314 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92dc137f20 msgr2=0x7f92dc138370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:07.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.759+0000 7f92d9d9b700 1 --2- 172.21.15.26:0/2899893314 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92dc137f20 0x7f92dc138370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.759+0000 7f92d9d9b700 1 -- 172.21.15.26:0/2899893314 >> v2:172.21.15.26:3300/0 conn(0x7f92dc06c0e0 msgr2=0x7f92dc09ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:07.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.759+0000 7f92d9d9b700 1 --2- 172.21.15.26:0/2899893314 >> v2:172.21.15.26:3300/0 conn(0x7f92dc06c0e0 0x7f92dc09ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.759+0000 7f77a8da4700 1 -- 172.21.15.26:0/2284335367 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a406fc30 con 0x7f77a409e760 2023-10-01T07:55:07.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.759+0000 7f92d9d9b700 1 -- 172.21.15.26:0/2899893314 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92dc134980 con 0x7f92dc134ec0 2023-10-01T07:55:07.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.759+0000 7f77a8da4700 1 --2- 172.21.15.26:0/2284335367 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77a409e760 0x7f77a413a730 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f779c009e50 tx=0x7f779c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1aaafae4b3d01234 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:07.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.759+0000 7f92d9d9b700 1 --2- 172.21.15.26:0/2899893314 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92dc134ec0 0x7f92dc1379e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f92d00098f0 tx=0x7f92d0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5e8f0c8c88f3ce3 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:07.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.760+0000 7f92d959a700 1 -- 172.21.15.26:0/2899893314 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d0011830 con 0x7f92dc134ec0 2023-10-01T07:55:07.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.760+0000 7f92d959a700 1 -- 172.21.15.26:0/2899893314 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d0011990 con 0x7f92dc134ec0 2023-10-01T07:55:07.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.760+0000 7f92d959a700 1 -- 172.21.15.26:0/2899893314 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d0011d20 con 0x7f92dc134ec0 2023-10-01T07:55:07.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.760+0000 7f77a2ffd700 1 -- 172.21.15.26:0/2284335367 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c00e070 con 0x7f77a409e760 2023-10-01T07:55:07.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.760+0000 7f77a2ffd700 1 -- 172.21.15.26:0/2284335367 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779c00b910 con 0x7f77a409e760 2023-10-01T07:55:07.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.760+0000 7f77a2ffd700 1 -- 172.21.15.26:0/2284335367 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c00bcc0 con 0x7f77a409e760 2023-10-01T07:55:07.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.761+0000 7f92e0c51700 1 -- 172.21.15.26:0/2899893314 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92dc134ec0 msgr2=0x7f92dc1379e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:07.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.761+0000 7f92e0c51700 1 --2- 172.21.15.26:0/2899893314 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92dc134ec0 0x7f92dc1379e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f92d00098f0 tx=0x7f92d0009c00 comp rx=0 tx=0).stop 2023-10-01T07:55:07.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.761+0000 7f77aa807700 1 -- 172.21.15.26:0/2284335367 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77a409e760 msgr2=0x7f77a413a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:07.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.761+0000 7f77aa807700 1 --2- 172.21.15.26:0/2284335367 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77a409e760 0x7f77a413a730 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f779c009e50 tx=0x7f779c00b330 comp rx=0 tx=0).stop 2023-10-01T07:55:07.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.761+0000 7f77aa807700 1 -- 172.21.15.26:0/2284335367 shutdown_connections 2023-10-01T07:55:07.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.761+0000 7f77aa807700 1 --2- 172.21.15.26:0/2284335367 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77a409e760 0x7f77a413a730 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.761+0000 7f77aa807700 1 --2- 172.21.15.26:0/2284335367 >> v2:172.21.15.26:3300/0 conn(0x7f77a41338a0 0x7f77a4133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.761+0000 7f77aa807700 1 --2- 172.21.15.26:0/2284335367 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f77a409de50 0x7f77a409e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.761+0000 7f77aa807700 1 -- 172.21.15.26:0/2284335367 >> 172.21.15.26:0/2284335367 conn(0x7f77a40a2aa0 msgr2=0x7f77a40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:07.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.761+0000 7f77aa807700 1 -- 172.21.15.26:0/2284335367 shutdown_connections 2023-10-01T07:55:07.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.761+0000 7f92e0c51700 1 -- 172.21.15.26:0/2899893314 shutdown_connections 2023-10-01T07:55:07.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.761+0000 7f92e0c51700 1 --2- 172.21.15.26:0/2899893314 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92dc137f20 0x7f92dc138370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.761+0000 7f92e0c51700 1 --2- 172.21.15.26:0/2899893314 >> v2:172.21.15.26:3300/0 conn(0x7f92dc06c0e0 0x7f92dc09ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.761+0000 7f92e0c51700 1 --2- 172.21.15.26:0/2899893314 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92dc134ec0 0x7f92dc1379e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.761+0000 7f92e0c51700 1 -- 172.21.15.26:0/2899893314 >> 172.21.15.26:0/2899893314 conn(0x7f92dc0a4210 msgr2=0x7f92dc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:07.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.761+0000 7f92e0c51700 1 -- 172.21.15.26:0/2899893314 shutdown_connections 2023-10-01T07:55:07.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.761+0000 7f92e0c51700 1 -- 172.21.15.26:0/2899893314 wait complete. 2023-10-01T07:55:07.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.762+0000 7f77aa807700 1 -- 172.21.15.26:0/2284335367 wait complete. 2023-10-01T07:55:07.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.762+0000 7f92e0c51700 1 Processor -- start 2023-10-01T07:55:07.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.762+0000 7f92e0c51700 1 -- start start 2023-10-01T07:55:07.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.762+0000 7f77aa807700 1 Processor -- start 2023-10-01T07:55:07.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.763+0000 7f92e0c51700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92dc06c0e0 0x7f92dc1ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:07.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.763+0000 7f92e0c51700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92dc134ec0 0x7f92dc1cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:07.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.763+0000 7f92e0c51700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92dc137f20 0x7f92dc11a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:07.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.763+0000 7f92e0c51700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92dc11c0a0 con 0x7f92dc06c0e0 2023-10-01T07:55:07.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.763+0000 7f92e0c51700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92dc11d900 con 0x7f92dc137f20 2023-10-01T07:55:07.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.763+0000 7f92e0c51700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92dc1343c0 con 0x7f92dc134ec0 2023-10-01T07:55:07.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.763+0000 7f92dad9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92dc137f20 0x7f92dc11a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:07.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.763+0000 7f92dad9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92dc137f20 0x7f92dc11a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46024/0 (socket says 172.21.15.26:46024) 2023-10-01T07:55:07.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.763+0000 7f92dad9d700 1 -- 172.21.15.26:0/4209990357 learned_addr learned my addr 172.21.15.26:0/4209990357 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:07.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.763+0000 7f92d9d9b700 1 --2- 172.21.15.26:0/4209990357 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92dc134ec0 0x7f92dc1cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:07.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.763+0000 7f92da59c700 1 --2- 172.21.15.26:0/4209990357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92dc06c0e0 0x7f92dc1ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:07.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.763+0000 7f77aa807700 1 -- start start 2023-10-01T07:55:07.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.763+0000 7f77aa807700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f77a409de50 0x7f77a411eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:07.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.763+0000 7f77aa807700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77a409e760 0x7f77a411f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:07.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.763+0000 7f77aa807700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77a41338a0 0x7f77a411f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:07.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.763+0000 7f77aa807700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a4120f30 con 0x7f77a41338a0 2023-10-01T07:55:07.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.763+0000 7f77aa807700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a4120840 con 0x7f77a409e760 2023-10-01T07:55:07.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.763+0000 7f77aa807700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77a406f640 con 0x7f77a409de50 2023-10-01T07:55:07.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.763+0000 7f92da59c700 1 -- 172.21.15.26:0/4209990357 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92dc134ec0 msgr2=0x7f92dc1cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:07.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.763+0000 7f92da59c700 1 --2- 172.21.15.26:0/4209990357 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92dc134ec0 0x7f92dc1cd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.763+0000 7f92da59c700 1 -- 172.21.15.26:0/4209990357 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92dc137f20 msgr2=0x7f92dc11a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:07.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.763+0000 7f92da59c700 1 --2- 172.21.15.26:0/4209990357 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92dc137f20 0x7f92dc11a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.763+0000 7f92da59c700 1 -- 172.21.15.26:0/4209990357 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d0009550 con 0x7f92dc06c0e0 2023-10-01T07:55:07.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.763+0000 7f92d9d9b700 1 --2- 172.21.15.26:0/4209990357 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92dc134ec0 0x7f92dc1cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:55:07.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.763+0000 7f77a3fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f77a409de50 0x7f77a411eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:07.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.764+0000 7f77a3fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f77a409de50 0x7f77a411eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35822/0 (socket says 172.21.15.26:35822) 2023-10-01T07:55:07.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.764+0000 7f77a3fff700 1 -- 172.21.15.26:0/3882640020 learned_addr learned my addr 172.21.15.26:0/3882640020 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:07.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.764+0000 7f77a8da4700 1 --2- 172.21.15.26:0/3882640020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77a41338a0 0x7f77a411f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:07.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.764+0000 7f92dad9d700 1 --2- 172.21.15.26:0/4209990357 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92dc137f20 0x7f92dc11a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:55:07.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.764+0000 7f92da59c700 1 --2- 172.21.15.26:0/4209990357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92dc06c0e0 0x7f92dc1ccd50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f92cc00e8a0 tx=0x7f92cc00ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:07.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.764+0000 7f77a3fff700 1 -- 172.21.15.26:0/3882640020 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77a409e760 msgr2=0x7f77a411f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:07.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.764+0000 7f77a3fff700 1 --2- 172.21.15.26:0/3882640020 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77a409e760 0x7f77a411f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.764+0000 7f77a3fff700 1 -- 172.21.15.26:0/3882640020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77a41338a0 msgr2=0x7f77a411f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:07.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.764+0000 7f77a3fff700 1 --2- 172.21.15.26:0/3882640020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77a41338a0 0x7f77a411f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.764+0000 7f77a3fff700 1 -- 172.21.15.26:0/3882640020 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779c009b30 con 0x7f77a409de50 2023-10-01T07:55:07.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.764+0000 7f77a8da4700 1 --2- 172.21.15.26:0/3882640020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77a41338a0 0x7f77a411f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:07.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.764+0000 7f77a3fff700 1 --2- 172.21.15.26:0/3882640020 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f77a409de50 0x7f77a411eb20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f779400e9b0 tx=0x7f779400ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:07.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.764+0000 7f92caffd700 1 -- 172.21.15.26:0/4209990357 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92cc00ee40 con 0x7f92dc06c0e0 2023-10-01T07:55:07.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.764+0000 7f92caffd700 1 -- 172.21.15.26:0/4209990357 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92cc00c850 con 0x7f92dc06c0e0 2023-10-01T07:55:07.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.764+0000 7f92caffd700 1 -- 172.21.15.26:0/4209990357 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92cc00cbe0 con 0x7f92dc06c0e0 2023-10-01T07:55:07.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.765+0000 7f92e0c51700 1 -- 172.21.15.26:0/4209990357 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92dc11c780 con 0x7f92dc06c0e0 2023-10-01T07:55:07.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.765+0000 7f92e0c51700 1 -- 172.21.15.26:0/4209990357 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92dc11c4d0 con 0x7f92dc06c0e0 2023-10-01T07:55:07.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.764+0000 7f77a0ff9700 1 -- 172.21.15.26:0/3882640020 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779400c850 con 0x7f77a409de50 2023-10-01T07:55:07.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.765+0000 7f77a0ff9700 1 -- 172.21.15.26:0/3882640020 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779400c9b0 con 0x7f77a409de50 2023-10-01T07:55:07.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.765+0000 7f77a0ff9700 1 -- 172.21.15.26:0/3882640020 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779400cd20 con 0x7f77a409de50 2023-10-01T07:55:07.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.765+0000 7f77aa807700 1 -- 172.21.15.26:0/3882640020 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a40a0fb0 con 0x7f77a409de50 2023-10-01T07:55:07.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.765+0000 7f77aa807700 1 -- 172.21.15.26:0/3882640020 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a4122d60 con 0x7f77a409de50 2023-10-01T07:55:07.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.766+0000 7f92e0c51700 1 -- 172.21.15.26:0/4209990357 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92dc11cd40 con 0x7f92dc06c0e0 2023-10-01T07:55:07.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.766+0000 7f92caffd700 1 -- 172.21.15.26:0/4209990357 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f92cc00cd40 con 0x7f92dc06c0e0 2023-10-01T07:55:07.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.766+0000 7f77aa807700 1 -- 172.21.15.26:0/3882640020 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77840052e0 con 0x7f77a409de50 2023-10-01T07:55:07.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.766+0000 7f92caffd700 1 -- 172.21.15.26:0/4209990357 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f92cc03feb0 con 0x7f92dc06c0e0 2023-10-01T07:55:07.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.766+0000 7f92d9d9b700 1 -- 172.21.15.26:0/4209990357 >> v1:172.21.15.26:6816/126763 conn(0x7f92bc02f540 legacy=0x7f92bc0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:07.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.767+0000 7f77a0ff9700 1 -- 172.21.15.26:0/3882640020 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7794013470 con 0x7f77a409de50 2023-10-01T07:55:07.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.767+0000 7f77a37fe700 1 -- 172.21.15.26:0/3882640020 >> v1:172.21.15.26:6816/126763 conn(0x7f779002f510 legacy=0x7f77900319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:07.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.767+0000 7f77a0ff9700 1 -- 172.21.15.26:0/3882640020 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f7794040010 con 0x7f77a409de50 2023-10-01T07:55:07.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.771+0000 7f92caffd700 1 -- 172.21.15.26:0/4209990357 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f92cc0119a0 con 0x7f92dc06c0e0 2023-10-01T07:55:07.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.773+0000 7f77a0ff9700 1 -- 172.21.15.26:0/3882640020 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f779401b3b0 con 0x7f77a409de50 2023-10-01T07:55:07.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.835+0000 7f0ae27fc700 1 -- 172.21.15.26:0/2612771698 >> v1:172.21.15.26:6816/126763 conn(0x7f0ad002f510 legacy=0x7f0ad00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:07.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.857+0000 7f0ae990d700 1 -- 172.21.15.26:0/2612771698 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0ae4131260 con 0x7f0ae409d6f0 2023-10-01T07:55:07.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.857+0000 7f0acbfff700 1 -- 172.21.15.26:0/2612771698 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0ad4026090 con 0x7f0ae409d6f0 2023-10-01T07:55:07.858 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:07.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.860+0000 7f0ae990d700 1 -- 172.21.15.26:0/2612771698 >> v1:172.21.15.26:6816/126763 conn(0x7f0ad002f510 legacy=0x7f0ad00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:07.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.860+0000 7f0ae990d700 1 -- 172.21.15.26:0/2612771698 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ae409d6f0 msgr2=0x7f0ae411e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:07.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.860+0000 7f0ae990d700 1 --2- 172.21.15.26:0/2612771698 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ae409d6f0 0x7f0ae411e0f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0ad400b340 tx=0x7f0ad4004750 comp rx=0 tx=0).stop 2023-10-01T07:55:07.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.860+0000 7f0ae990d700 1 -- 172.21.15.26:0/2612771698 shutdown_connections 2023-10-01T07:55:07.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.860+0000 7f0ae990d700 1 --2- 172.21.15.26:0/2612771698 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ae409e410 0x7f0ae411eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.860+0000 7f0ae990d700 1 --2- 172.21.15.26:0/2612771698 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ae409d6f0 0x7f0ae411e0f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.860+0000 7f0ae990d700 1 --2- 172.21.15.26:0/2612771698 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ae409e000 0x7f0ae411e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.860+0000 7f0ae990d700 1 -- 172.21.15.26:0/2612771698 >> 172.21.15.26:0/2612771698 conn(0x7f0ae4066f50 msgr2=0x7f0ae40a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:07.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.860+0000 7f0ae990d700 1 -- 172.21.15.26:0/2612771698 shutdown_connections 2023-10-01T07:55:07.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.860+0000 7f0ae990d700 1 -- 172.21.15.26:0/2612771698 wait complete. 2023-10-01T07:55:07.875 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:07.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.923+0000 7f5a918b7700 1 -- 172.21.15.26:0/1051968806 >> v1:172.21.15.26:6816/126763 conn(0x7f5a7002f510 legacy=0x7f5a700319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:07.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.940+0000 7f5a9431c700 1 -- 172.21.15.26:0/1051968806 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5a8c122fa0 con 0x7f5a8c09e390 2023-10-01T07:55:07.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.940+0000 7f5a82ffd700 1 -- 172.21.15.26:0/1051968806 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5a8801b3b0 con 0x7f5a8c09e390 2023-10-01T07:55:07.941 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:07.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.943+0000 7f5a9431c700 1 -- 172.21.15.26:0/1051968806 >> v1:172.21.15.26:6816/126763 conn(0x7f5a7002f510 legacy=0x7f5a700319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:07.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.943+0000 7f5a9431c700 1 -- 172.21.15.26:0/1051968806 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5a8c09e390 msgr2=0x7f5a8c11f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:07.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.943+0000 7f5a9431c700 1 --2- 172.21.15.26:0/1051968806 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5a8c09e390 0x7f5a8c11f8c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5a8800ebe0 tx=0x7f5a8800eef0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.943+0000 7f5a9431c700 1 -- 172.21.15.26:0/1051968806 shutdown_connections 2023-10-01T07:55:07.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.943+0000 7f5a9431c700 1 --2- 172.21.15.26:0/1051968806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a8c1341d0 0x7f5a8c120340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.943+0000 7f5a9431c700 1 --2- 172.21.15.26:0/1051968806 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5a8c09e390 0x7f5a8c11f8c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.943+0000 7f5a9431c700 1 --2- 172.21.15.26:0/1051968806 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5a8c1338c0 0x7f5a8c11fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.943+0000 7f5a9431c700 1 -- 172.21.15.26:0/1051968806 >> 172.21.15.26:0/1051968806 conn(0x7f5a8c0a2aa0 msgr2=0x7f5a8c0a0620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:07.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.943+0000 7f5a9431c700 1 -- 172.21.15.26:0/1051968806 shutdown_connections 2023-10-01T07:55:07.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.943+0000 7f5a9431c700 1 -- 172.21.15.26:0/1051968806 wait complete. 2023-10-01T07:55:07.957 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:07.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.967+0000 7f92d9d9b700 1 -- 172.21.15.26:0/4209990357 >> v1:172.21.15.26:6816/126763 conn(0x7f92bc02f540 legacy=0x7f92bc0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:07.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.968+0000 7f77a37fe700 1 -- 172.21.15.26:0/3882640020 >> v1:172.21.15.26:6816/126763 conn(0x7f779002f510 legacy=0x7f77900319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:07.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.980+0000 7f92e0c51700 1 -- 172.21.15.26:0/4209990357 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f92dc074ea0 con 0x7f92dc06c0e0 2023-10-01T07:55:07.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.980+0000 7f92caffd700 1 -- 172.21.15.26:0/4209990357 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f92cc017070 con 0x7f92dc06c0e0 2023-10-01T07:55:07.981 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:07.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.982+0000 7f77aa807700 1 -- 172.21.15.26:0/3882640020 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7784005860 con 0x7f77a409de50 2023-10-01T07:55:07.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.982+0000 7f77a0ff9700 1 -- 172.21.15.26:0/3882640020 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7794021020 con 0x7f77a409de50 2023-10-01T07:55:07.983 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:07.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.983+0000 7f92e0c51700 1 -- 172.21.15.26:0/4209990357 >> v1:172.21.15.26:6816/126763 conn(0x7f92bc02f540 legacy=0x7f92bc0319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:07.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.983+0000 7f92e0c51700 1 -- 172.21.15.26:0/4209990357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92dc06c0e0 msgr2=0x7f92dc1ccd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:07.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.983+0000 7f92e0c51700 1 --2- 172.21.15.26:0/4209990357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92dc06c0e0 0x7f92dc1ccd50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f92cc00e8a0 tx=0x7f92cc00ec60 comp rx=0 tx=0).stop 2023-10-01T07:55:07.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.983+0000 7f92e0c51700 1 -- 172.21.15.26:0/4209990357 shutdown_connections 2023-10-01T07:55:07.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.983+0000 7f92e0c51700 1 --2- 172.21.15.26:0/4209990357 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92dc137f20 0x7f92dc11a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.983+0000 7f92e0c51700 1 --2- 172.21.15.26:0/4209990357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92dc06c0e0 0x7f92dc1ccd50 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.983+0000 7f92e0c51700 1 --2- 172.21.15.26:0/4209990357 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92dc134ec0 0x7f92dc1cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.983+0000 7f92e0c51700 1 -- 172.21.15.26:0/4209990357 >> 172.21.15.26:0/4209990357 conn(0x7f92dc0a4210 msgr2=0x7f92dc099c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:07.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.983+0000 7f92e0c51700 1 -- 172.21.15.26:0/4209990357 shutdown_connections 2023-10-01T07:55:07.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.983+0000 7f92e0c51700 1 -- 172.21.15.26:0/4209990357 wait complete. 2023-10-01T07:55:07.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.985+0000 7f77aa807700 1 -- 172.21.15.26:0/3882640020 >> v1:172.21.15.26:6816/126763 conn(0x7f779002f510 legacy=0x7f77900319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:07.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.985+0000 7f77aa807700 1 -- 172.21.15.26:0/3882640020 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f77a409de50 msgr2=0x7f77a411eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:07.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.985+0000 7f77aa807700 1 --2- 172.21.15.26:0/3882640020 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f77a409de50 0x7f77a411eb20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f779400e9b0 tx=0x7f779400ecc0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.985+0000 7f77aa807700 1 -- 172.21.15.26:0/3882640020 shutdown_connections 2023-10-01T07:55:07.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.985+0000 7f77aa807700 1 --2- 172.21.15.26:0/3882640020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77a41338a0 0x7f77a411f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.985+0000 7f77aa807700 1 --2- 172.21.15.26:0/3882640020 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f77a409de50 0x7f77a411eb20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.985+0000 7f77aa807700 1 --2- 172.21.15.26:0/3882640020 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77a409e760 0x7f77a411f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:07.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.985+0000 7f77aa807700 1 -- 172.21.15.26:0/3882640020 >> 172.21.15.26:0/3882640020 conn(0x7f77a40a2aa0 msgr2=0x7f77a409ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:07.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.985+0000 7f77aa807700 1 -- 172.21.15.26:0/3882640020 shutdown_connections 2023-10-01T07:55:07.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:07.985+0000 7f77aa807700 1 -- 172.21.15.26:0/3882640020 wait complete. 2023-10-01T07:55:07.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:08.000 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:08.876 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:08.958 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:09.000 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:09.001 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:09.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.030+0000 7f5e0125c700 1 Processor -- start 2023-10-01T07:55:09.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.030+0000 7f5e0125c700 1 -- start start 2023-10-01T07:55:09.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.030+0000 7f5e0125c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5dfc1338c0 0x7f5dfc133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:09.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.030+0000 7f5e0125c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5dfc1341d0 0x7f5dfc09de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:09.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.030+0000 7f5e0125c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5dfc09e390 0x7f5dfc09e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:09.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.030+0000 7f5e0125c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dfc070c80 con 0x7f5dfc1338c0 2023-10-01T07:55:09.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.030+0000 7f5e0125c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc09ed20 con 0x7f5dfc09e390 2023-10-01T07:55:09.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.030+0000 7f5e0125c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc06f720 con 0x7f5dfc1341d0 2023-10-01T07:55:09.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.031+0000 7f5dfa59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5dfc1341d0 0x7f5dfc09de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:09.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.031+0000 7f5dfa59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5dfc1341d0 0x7f5dfc09de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35828/0 (socket says 172.21.15.26:35828) 2023-10-01T07:55:09.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.031+0000 7f5dfa59c700 1 -- 172.21.15.26:0/1005499625 learned_addr learned my addr 172.21.15.26:0/1005499625 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:09.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.031+0000 7f5dfa59c700 1 -- 172.21.15.26:0/1005499625 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5dfc09e390 msgr2=0x7f5dfc09e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:09.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.031+0000 7f5dfa59c700 1 --2- 172.21.15.26:0/1005499625 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5dfc09e390 0x7f5dfc09e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.031+0000 7f5dfa59c700 1 -- 172.21.15.26:0/1005499625 >> v2:172.21.15.26:3300/0 conn(0x7f5dfc1338c0 msgr2=0x7f5dfc133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:09.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.031+0000 7f5dfa59c700 1 --2- 172.21.15.26:0/1005499625 >> v2:172.21.15.26:3300/0 conn(0x7f5dfc1338c0 0x7f5dfc133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.031+0000 7f5dfa59c700 1 -- 172.21.15.26:0/1005499625 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dfc06fce0 con 0x7f5dfc1341d0 2023-10-01T07:55:09.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.031+0000 7f5dfa59c700 1 --2- 172.21.15.26:0/1005499625 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5dfc1341d0 0x7f5dfc09de50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5df0009920 tx=0x7f5df0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16e1f170bbdcf6ca server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:09.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.031+0000 7f5df9d9b700 1 -- 172.21.15.26:0/1005499625 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df000ba20 con 0x7f5dfc1341d0 2023-10-01T07:55:09.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.032+0000 7f5df9d9b700 1 -- 172.21.15.26:0/1005499625 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df000bb80 con 0x7f5dfc1341d0 2023-10-01T07:55:09.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.032+0000 7f5df9d9b700 1 -- 172.21.15.26:0/1005499625 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df0009e70 con 0x7f5dfc1341d0 2023-10-01T07:55:09.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.032+0000 7f5e0125c700 1 -- 172.21.15.26:0/1005499625 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5dfc1341d0 msgr2=0x7f5dfc09de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:09.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.032+0000 7f5e0125c700 1 --2- 172.21.15.26:0/1005499625 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5dfc1341d0 0x7f5dfc09de50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5df0009920 tx=0x7f5df0009c30 comp rx=0 tx=0).stop 2023-10-01T07:55:09.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.033+0000 7f5e0125c700 1 -- 172.21.15.26:0/1005499625 shutdown_connections 2023-10-01T07:55:09.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.033+0000 7f5e0125c700 1 --2- 172.21.15.26:0/1005499625 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5dfc09e390 0x7f5dfc09e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.033+0000 7f5e0125c700 1 --2- 172.21.15.26:0/1005499625 >> v2:172.21.15.26:3300/0 conn(0x7f5dfc1338c0 0x7f5dfc133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.033+0000 7f5e0125c700 1 --2- 172.21.15.26:0/1005499625 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5dfc1341d0 0x7f5dfc09de50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.033+0000 7f5e0125c700 1 -- 172.21.15.26:0/1005499625 >> 172.21.15.26:0/1005499625 conn(0x7f5dfc0a2aa0 msgr2=0x7f5dfc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:09.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.033+0000 7f5e0125c700 1 -- 172.21.15.26:0/1005499625 shutdown_connections 2023-10-01T07:55:09.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.033+0000 7f5e0125c700 1 -- 172.21.15.26:0/1005499625 wait complete. 2023-10-01T07:55:09.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.034+0000 7f5e0125c700 1 Processor -- start 2023-10-01T07:55:09.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.034+0000 7f5e0125c700 1 -- start start 2023-10-01T07:55:09.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.035+0000 7f5e0125c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5dfc09e390 0x7f5dfc123240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:09.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.035+0000 7f5e0125c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5dfc1338c0 0x7f5dfc123780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:09.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.035+0000 7f5e0125c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5dfc1341d0 0x7f5dfc1cc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:09.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.035+0000 7f5e0125c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc130e40 con 0x7f5dfc1338c0 2023-10-01T07:55:09.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.035+0000 7f5e0125c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc125f70 con 0x7f5dfc1341d0 2023-10-01T07:55:09.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.035+0000 7f5e0125c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc122e50 con 0x7f5dfc09e390 2023-10-01T07:55:09.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.035+0000 7f5dfb59e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5dfc1341d0 0x7f5dfc1cc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:09.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.035+0000 7f5dfb59e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5dfc1341d0 0x7f5dfc1cc740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46046/0 (socket says 172.21.15.26:46046) 2023-10-01T07:55:09.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.035+0000 7f5dfb59e700 1 -- 172.21.15.26:0/1152416137 learned_addr learned my addr 172.21.15.26:0/1152416137 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:09.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.036+0000 7f5dfad9d700 1 --2- 172.21.15.26:0/1152416137 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5dfc09e390 0x7f5dfc123240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:09.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.036+0000 7f5dfb59e700 1 -- 172.21.15.26:0/1152416137 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5dfc09e390 msgr2=0x7f5dfc123240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:09.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.036+0000 7f5dfb59e700 1 --2- 172.21.15.26:0/1152416137 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5dfc09e390 0x7f5dfc123240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.036+0000 7f5dfb59e700 1 -- 172.21.15.26:0/1152416137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5dfc1338c0 msgr2=0x7f5dfc123780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:09.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.036+0000 7f5dfb59e700 1 --2- 172.21.15.26:0/1152416137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5dfc1338c0 0x7f5dfc123780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.036+0000 7f5dfb59e700 1 -- 172.21.15.26:0/1152416137 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df0009550 con 0x7f5dfc1341d0 2023-10-01T07:55:09.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.036+0000 7f5dfad9d700 1 --2- 172.21.15.26:0/1152416137 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5dfc09e390 0x7f5dfc123240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:55:09.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.036+0000 7f5dfb59e700 1 --2- 172.21.15.26:0/1152416137 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5dfc1341d0 0x7f5dfc1cc740 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5df400b9a0 tx=0x7f5df400bd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:09.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.036+0000 7f5de37fe700 1 -- 172.21.15.26:0/1152416137 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df400c9b0 con 0x7f5dfc1341d0 2023-10-01T07:55:09.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.036+0000 7f5de37fe700 1 -- 172.21.15.26:0/1152416137 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df400cb30 con 0x7f5dfc1341d0 2023-10-01T07:55:09.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.036+0000 7f5de37fe700 1 -- 172.21.15.26:0/1152416137 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df4014440 con 0x7f5dfc1341d0 2023-10-01T07:55:09.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.037+0000 7f5e0125c700 1 -- 172.21.15.26:0/1152416137 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dfc06f960 con 0x7f5dfc1341d0 2023-10-01T07:55:09.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.037+0000 7f5e0125c700 1 -- 172.21.15.26:0/1152416137 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dfc12f1f0 con 0x7f5dfc1341d0 2023-10-01T07:55:09.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.038+0000 7f5de37fe700 1 -- 172.21.15.26:0/1152416137 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5df401d3b0 con 0x7f5dfc1341d0 2023-10-01T07:55:09.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.038+0000 7f5de37fe700 1 -- 172.21.15.26:0/1152416137 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f5df403f9d0 con 0x7f5dfc1341d0 2023-10-01T07:55:09.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.038+0000 7f5dfad9d700 1 -- 172.21.15.26:0/1152416137 >> v1:172.21.15.26:6816/126763 conn(0x7f5de802f540 legacy=0x7f5de80319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:09.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.038+0000 7f5e0125c700 1 -- 172.21.15.26:0/1152416137 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dfc074ea0 con 0x7f5dfc1341d0 2023-10-01T07:55:09.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.044+0000 7f5de37fe700 1 -- 172.21.15.26:0/1152416137 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5df4019030 con 0x7f5dfc1341d0 2023-10-01T07:55:09.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.112+0000 7fa6b12f5700 1 Processor -- start 2023-10-01T07:55:09.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.112+0000 7fa6b12f5700 1 -- start start 2023-10-01T07:55:09.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.113+0000 7fa6b12f5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6ac09e850 0x7fa6ac09ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:09.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.113+0000 7fa6b12f5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa6ac09f160 0x7fa6ac133c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:09.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.113+0000 7fa6b12f5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa6ac09f5b0 0x7fa6ac1341a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:09.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.113+0000 7fa6b12f5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6ac06bec0 con 0x7fa6ac09f5b0 2023-10-01T07:55:09.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.113+0000 7fa6b12f5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ac0a0030 con 0x7fa6ac09e850 2023-10-01T07:55:09.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.113+0000 7fa6b12f5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ac0a0830 con 0x7fa6ac09f160 2023-10-01T07:55:09.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.113+0000 7fa6aa7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa6ac09f160 0x7fa6ac133c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:09.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.113+0000 7fa6aa7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa6ac09f160 0x7fa6ac133c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35840/0 (socket says 172.21.15.26:35840) 2023-10-01T07:55:09.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.113+0000 7fa6aa7fc700 1 -- 172.21.15.26:0/3111999839 learned_addr learned my addr 172.21.15.26:0/3111999839 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:09.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.113+0000 7fa6aaffd700 1 --2- 172.21.15.26:0/3111999839 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6ac09e850 0x7fa6ac09ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:09.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.113+0000 7fa6ab7fe700 1 --2- 172.21.15.26:0/3111999839 >> v2:172.21.15.26:3300/0 conn(0x7fa6ac09f5b0 0x7fa6ac1341a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:09.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.114+0000 7fa6aa7fc700 1 -- 172.21.15.26:0/3111999839 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6ac09e850 msgr2=0x7fa6ac09ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:09.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.114+0000 7fa6aa7fc700 1 --2- 172.21.15.26:0/3111999839 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6ac09e850 0x7fa6ac09ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.114+0000 7fa6aa7fc700 1 -- 172.21.15.26:0/3111999839 >> v2:172.21.15.26:3300/0 conn(0x7fa6ac09f5b0 msgr2=0x7fa6ac1341a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:09.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.114+0000 7fa6aa7fc700 1 --2- 172.21.15.26:0/3111999839 >> v2:172.21.15.26:3300/0 conn(0x7fa6ac09f5b0 0x7fa6ac1341a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.114+0000 7fa6aa7fc700 1 -- 172.21.15.26:0/3111999839 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6ac06caa0 con 0x7fa6ac09f160 2023-10-01T07:55:09.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.114+0000 7fa6aaffd700 1 --2- 172.21.15.26:0/3111999839 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6ac09e850 0x7fa6ac09ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:09.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.114+0000 7fa6aa7fc700 1 --2- 172.21.15.26:0/3111999839 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa6ac09f160 0x7fa6ac133c60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0009950 tx=0x7fa6a0009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec16549f2bc59743 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:09.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.114+0000 7fa6a9ffb700 1 -- 172.21.15.26:0/3111999839 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a0004030 con 0x7fa6ac09f160 2023-10-01T07:55:09.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.114+0000 7fa6a9ffb700 1 -- 172.21.15.26:0/3111999839 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a0004190 con 0x7fa6ac09f160 2023-10-01T07:55:09.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.114+0000 7fa6a9ffb700 1 -- 172.21.15.26:0/3111999839 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a0004540 con 0x7fa6ac09f160 2023-10-01T07:55:09.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.115+0000 7fa6b12f5700 1 -- 172.21.15.26:0/3111999839 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa6ac09f160 msgr2=0x7fa6ac133c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:09.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.115+0000 7fa6b12f5700 1 --2- 172.21.15.26:0/3111999839 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa6ac09f160 0x7fa6ac133c60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0009950 tx=0x7fa6a0009c60 comp rx=0 tx=0).stop 2023-10-01T07:55:09.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.115+0000 7fa6b12f5700 1 -- 172.21.15.26:0/3111999839 shutdown_connections 2023-10-01T07:55:09.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.115+0000 7fa6b12f5700 1 --2- 172.21.15.26:0/3111999839 >> v2:172.21.15.26:3300/0 conn(0x7fa6ac09f5b0 0x7fa6ac1341a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.115+0000 7fa6b12f5700 1 --2- 172.21.15.26:0/3111999839 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6ac09e850 0x7fa6ac09ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.115+0000 7fa6b12f5700 1 --2- 172.21.15.26:0/3111999839 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa6ac09f160 0x7fa6ac133c60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.115+0000 7fa6b12f5700 1 -- 172.21.15.26:0/3111999839 >> 172.21.15.26:0/3111999839 conn(0x7fa6ac0a3f70 msgr2=0x7fa6ac0a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:09.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.115+0000 7fa6b12f5700 1 -- 172.21.15.26:0/3111999839 shutdown_connections 2023-10-01T07:55:09.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.115+0000 7fa6b12f5700 1 -- 172.21.15.26:0/3111999839 wait complete. 2023-10-01T07:55:09.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.117+0000 7fa6b12f5700 1 Processor -- start 2023-10-01T07:55:09.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.117+0000 7fa6b12f5700 1 -- start start 2023-10-01T07:55:09.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.117+0000 7fa6b12f5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa6ac09e850 0x7fa6ac11af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:09.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.117+0000 7fa6b12f5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6ac09f160 0x7fa6ac11b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:09.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.117+0000 7fa6b12f5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6ac09f5b0 0x7fa6ac11b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:09.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.117+0000 7fa6b12f5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ac11e1f0 con 0x7fa6ac09f5b0 2023-10-01T07:55:09.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.117+0000 7fa6b12f5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ac06ccc0 con 0x7fa6ac09f160 2023-10-01T07:55:09.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.117+0000 7fa6b12f5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ac0a3820 con 0x7fa6ac09e850 2023-10-01T07:55:09.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.117+0000 7fa6aa7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6ac09f160 0x7fa6ac11b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:09.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.118+0000 7fa6aa7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6ac09f160 0x7fa6ac11b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46070/0 (socket says 172.21.15.26:46070) 2023-10-01T07:55:09.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.118+0000 7fa6aa7fc700 1 -- 172.21.15.26:0/3092402266 learned_addr learned my addr 172.21.15.26:0/3092402266 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:09.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.118+0000 7fa6ab7fe700 1 --2- 172.21.15.26:0/3092402266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6ac09f5b0 0x7fa6ac11b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:09.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.118+0000 7fa6aaffd700 1 --2- 172.21.15.26:0/3092402266 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa6ac09e850 0x7fa6ac11af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:09.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.118+0000 7fa6ab7fe700 1 -- 172.21.15.26:0/3092402266 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa6ac09e850 msgr2=0x7fa6ac11af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:09.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.118+0000 7fa6ab7fe700 1 --2- 172.21.15.26:0/3092402266 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa6ac09e850 0x7fa6ac11af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.118+0000 7fa6ab7fe700 1 -- 172.21.15.26:0/3092402266 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6ac09f160 msgr2=0x7fa6ac11b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:09.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.118+0000 7fa6ab7fe700 1 --2- 172.21.15.26:0/3092402266 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6ac09f160 0x7fa6ac11b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.118+0000 7fa6ab7fe700 1 -- 172.21.15.26:0/3092402266 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69c0094a0 con 0x7fa6ac09f5b0 2023-10-01T07:55:09.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.118+0000 7fa6ab7fe700 1 --2- 172.21.15.26:0/3092402266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6ac09f5b0 0x7fa6ac11b9c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4007d90 tx=0x7fa6a400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:09.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.118+0000 7fa6937fe700 1 -- 172.21.15.26:0/3092402266 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a4018070 con 0x7fa6ac09f5b0 2023-10-01T07:55:09.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.119+0000 7fa6937fe700 1 -- 172.21.15.26:0/3092402266 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a400eb30 con 0x7fa6ac09f5b0 2023-10-01T07:55:09.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.119+0000 7fa6b12f5700 1 -- 172.21.15.26:0/3092402266 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6a0009550 con 0x7fa6ac09f5b0 2023-10-01T07:55:09.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.119+0000 7fa6937fe700 1 -- 172.21.15.26:0/3092402266 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a4003a20 con 0x7fa6ac09f5b0 2023-10-01T07:55:09.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.119+0000 7fa6b12f5700 1 -- 172.21.15.26:0/3092402266 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6ac11dda0 con 0x7fa6ac09f5b0 2023-10-01T07:55:09.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.120+0000 7fa6937fe700 1 -- 172.21.15.26:0/3092402266 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa6a4014420 con 0x7fa6ac09f5b0 2023-10-01T07:55:09.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.120+0000 7fa6937fe700 1 -- 172.21.15.26:0/3092402266 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fa6a403fa90 con 0x7fa6ac09f5b0 2023-10-01T07:55:09.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.120+0000 7fa6aaffd700 1 -- 172.21.15.26:0/3092402266 >> v1:172.21.15.26:6816/126763 conn(0x7fa69802f510 legacy=0x7fa6980319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:09.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.120+0000 7fa6b12f5700 1 -- 172.21.15.26:0/3092402266 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6ac11e600 con 0x7fa6ac09f5b0 2023-10-01T07:55:09.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.125+0000 7fa6937fe700 1 -- 172.21.15.26:0/3092402266 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa6a40146d0 con 0x7fa6ac09f5b0 2023-10-01T07:55:09.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.150+0000 7f5336e39700 1 Processor -- start 2023-10-01T07:55:09.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.150+0000 7f36cd76b700 1 Processor -- start 2023-10-01T07:55:09.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.150+0000 7f5336e39700 1 -- start start 2023-10-01T07:55:09.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.150+0000 7f36cd76b700 1 -- start start 2023-10-01T07:55:09.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.150+0000 7f5336e39700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f533009e850 0x7f533009ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:09.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.150+0000 7f5336e39700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f533009f160 0x7f5330133bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:09.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.150+0000 7f5336e39700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f533006bf30 con 0x7f533009f5b0 2023-10-01T07:55:09.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.150+0000 7f5336e39700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f533009ffb0 con 0x7f533009f160 2023-10-01T07:55:09.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.150+0000 7f5336e39700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f533006cb10 con 0x7f533009e850 2023-10-01T07:55:09.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.150+0000 7f36cd76b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f36c809d6f0 0x7f36c809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:09.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.150+0000 7f36cd76b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36c809e000 0x7f36c81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:09.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.150+0000 7f36cd76b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f36c809e410 0x7f36c8133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:09.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.150+0000 7f36cd76b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36c806b460 con 0x7f36c809e410 2023-10-01T07:55:09.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.150+0000 7f36cd76b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c809b120 con 0x7f36c809e000 2023-10-01T07:55:09.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.150+0000 7f36cd76b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36c809a7e0 con 0x7f36c809d6f0 2023-10-01T07:55:09.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.151+0000 7f5334bd5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f533009e850 0x7f533009ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:09.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.151+0000 7f36c77fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f36c809e410 0x7f36c8133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:09.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.151+0000 7f532ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f533009f160 0x7f5330133bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:09.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.151+0000 7f36c77fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f36c809e410 0x7f36c8133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53804/0 (socket says 172.21.15.26:53804) 2023-10-01T07:55:09.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.151+0000 7f36c77fe700 1 -- 172.21.15.26:0/2849324290 learned_addr learned my addr 172.21.15.26:0/2849324290 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:09.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.151+0000 7f532ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f533009f160 0x7f5330133bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53802/0 (socket says 172.21.15.26:53802) 2023-10-01T07:55:09.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.151+0000 7f532ffff700 1 -- 172.21.15.26:0/1728542620 learned_addr learned my addr 172.21.15.26:0/1728542620 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:09.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.151+0000 7f36c6ffd700 1 --2- 172.21.15.26:0/2849324290 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f36c809d6f0 0x7f36c809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:09.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.151+0000 7f36c67fc700 1 --2- 172.21.15.26:0/2849324290 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36c809e000 0x7f36c81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:09.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.151+0000 7f36c77fe700 1 -- 172.21.15.26:0/2849324290 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f36c809d6f0 msgr2=0x7f36c809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:09.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.151+0000 7f36c77fe700 1 --2- 172.21.15.26:0/2849324290 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f36c809d6f0 0x7f36c809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.151+0000 7f36c77fe700 1 -- 172.21.15.26:0/2849324290 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36c809e000 msgr2=0x7f36c81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:09.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.151+0000 7f36c77fe700 1 --2- 172.21.15.26:0/2849324290 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36c809e000 0x7f36c81339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.151+0000 7f36c77fe700 1 -- 172.21.15.26:0/2849324290 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c809a500 con 0x7f36c809e410 2023-10-01T07:55:09.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.151+0000 7f36c6ffd700 1 --2- 172.21.15.26:0/2849324290 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f36c809d6f0 0x7f36c809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:55:09.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.151+0000 7f36c77fe700 1 --2- 172.21.15.26:0/2849324290 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36c809e410 0x7f36c8133f30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f36c0009e50 tx=0x7f36c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c09c16e792578 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:09.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.151+0000 7f5334bd5700 1 -- 172.21.15.26:0/1728542620 >> v2:172.21.15.26:3300/0 conn(0x7f533009f160 msgr2=0x7f5330133bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:09.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.151+0000 7f5334bd5700 1 --2- 172.21.15.26:0/1728542620 >> v2:172.21.15.26:3300/0 conn(0x7f533009f160 0x7f5330133bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.151+0000 7f5334bd5700 1 -- 172.21.15.26:0/1728542620 >> v1:172.21.15.26:6789/0 conn(0x7f533009f5b0 legacy=0x7f5330134130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:09.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.151+0000 7f5334bd5700 1 -- 172.21.15.26:0/1728542620 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53300a0270 con 0x7f533009e850 2023-10-01T07:55:09.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.152+0000 7f36c5ffb700 1 -- 172.21.15.26:0/2849324290 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c000e070 con 0x7f36c809e410 2023-10-01T07:55:09.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.152+0000 7f36c5ffb700 1 -- 172.21.15.26:0/2849324290 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c000b9c0 con 0x7f36c809e410 2023-10-01T07:55:09.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.152+0000 7f36c5ffb700 1 -- 172.21.15.26:0/2849324290 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c000bd70 con 0x7f36c809e410 2023-10-01T07:55:09.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.152+0000 7f5334bd5700 1 --2- 172.21.15.26:0/1728542620 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f533009e850 0x7f533009ec20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5324009870 tx=0x7f5324009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65d22ee0fcc060ba server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:09.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.152+0000 7f532f7fe700 1 -- 172.21.15.26:0/1728542620 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5324004230 con 0x7f533009e850 2023-10-01T07:55:09.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.152+0000 7f532f7fe700 1 -- 172.21.15.26:0/1728542620 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5324004390 con 0x7f533009e850 2023-10-01T07:55:09.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.152+0000 7f532f7fe700 1 -- 172.21.15.26:0/1728542620 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53240036a0 con 0x7f533009e850 2023-10-01T07:55:09.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.152+0000 7f36cd76b700 1 -- 172.21.15.26:0/2849324290 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36c809e410 msgr2=0x7f36c8133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:09.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.152+0000 7f36cd76b700 1 --2- 172.21.15.26:0/2849324290 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36c809e410 0x7f36c8133f30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f36c0009e50 tx=0x7f36c000b330 comp rx=0 tx=0).stop 2023-10-01T07:55:09.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.153+0000 7f36cd76b700 1 -- 172.21.15.26:0/2849324290 shutdown_connections 2023-10-01T07:55:09.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.153+0000 7f36cd76b700 1 --2- 172.21.15.26:0/2849324290 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36c809e410 0x7f36c8133f30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.153+0000 7f36cd76b700 1 --2- 172.21.15.26:0/2849324290 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f36c809d6f0 0x7f36c809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.153+0000 7f36cd76b700 1 --2- 172.21.15.26:0/2849324290 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36c809e000 0x7f36c81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.153+0000 7f36cd76b700 1 -- 172.21.15.26:0/2849324290 >> 172.21.15.26:0/2849324290 conn(0x7f36c8066f50 msgr2=0x7f36c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:09.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.153+0000 7f36cd76b700 1 -- 172.21.15.26:0/2849324290 shutdown_connections 2023-10-01T07:55:09.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.153+0000 7f36cd76b700 1 -- 172.21.15.26:0/2849324290 wait complete. 2023-10-01T07:55:09.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.153+0000 7f5336e39700 1 -- 172.21.15.26:0/1728542620 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f533009e850 msgr2=0x7f533009ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:09.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.153+0000 7f5336e39700 1 --2- 172.21.15.26:0/1728542620 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f533009e850 0x7f533009ec20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5324009870 tx=0x7f5324009b80 comp rx=0 tx=0).stop 2023-10-01T07:55:09.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.154+0000 7f36cd76b700 1 Processor -- start 2023-10-01T07:55:09.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.154+0000 7f36cd76b700 1 -- start start 2023-10-01T07:55:09.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.155+0000 7f36cd76b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36c809d6f0 0x7f36c81a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:09.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.155+0000 7f36cd76b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36c809e000 0x7f36c81a56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:09.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.155+0000 7f36cd76b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f36c809e410 0x7f36c81c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:09.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.155+0000 7f36cd76b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c81a4cf0 con 0x7f36c809e000 2023-10-01T07:55:09.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.155+0000 7f36cd76b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c81a5c20 con 0x7f36c809d6f0 2023-10-01T07:55:09.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.155+0000 7f36cd76b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36c81b90e0 con 0x7f36c809e410 2023-10-01T07:55:09.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.155+0000 7f36c6ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36c809d6f0 0x7f36c81a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:09.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.155+0000 7f36c6ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36c809d6f0 0x7f36c81a51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46094/0 (socket says 172.21.15.26:46094) 2023-10-01T07:55:09.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.155+0000 7f36c6ffd700 1 -- 172.21.15.26:0/1395762070 learned_addr learned my addr 172.21.15.26:0/1395762070 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:09.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.155+0000 7f36c67fc700 1 --2- 172.21.15.26:0/1395762070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36c809e000 0x7f36c81a56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:09.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.155+0000 7f36c77fe700 1 --2- 172.21.15.26:0/1395762070 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f36c809e410 0x7f36c81c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:09.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.155+0000 7f36c67fc700 1 -- 172.21.15.26:0/1395762070 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f36c809e410 msgr2=0x7f36c81c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:09.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.155+0000 7f36c67fc700 1 --2- 172.21.15.26:0/1395762070 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f36c809e410 0x7f36c81c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.155+0000 7f36c67fc700 1 -- 172.21.15.26:0/1395762070 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36c809d6f0 msgr2=0x7f36c81a51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:09.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.155+0000 7f36c67fc700 1 --2- 172.21.15.26:0/1395762070 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36c809d6f0 0x7f36c81a51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.155+0000 7f36c67fc700 1 -- 172.21.15.26:0/1395762070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c0009b30 con 0x7f36c809e000 2023-10-01T07:55:09.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.155+0000 7f36c77fe700 1 --2- 172.21.15.26:0/1395762070 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f36c809e410 0x7f36c81c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:09.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.156+0000 7f36c67fc700 1 --2- 172.21.15.26:0/1395762070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36c809e000 0x7f36c81a56e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f36bc00e810 tx=0x7f36bc00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:09.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.156+0000 7f36af7fe700 1 -- 172.21.15.26:0/1395762070 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36bc00c070 con 0x7f36c809e000 2023-10-01T07:55:09.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.156+0000 7f36af7fe700 1 -- 172.21.15.26:0/1395762070 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36bc004020 con 0x7f36c809e000 2023-10-01T07:55:09.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.156+0000 7f36cd76b700 1 -- 172.21.15.26:0/1395762070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36c809c710 con 0x7f36c809e000 2023-10-01T07:55:09.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.156+0000 7f36af7fe700 1 -- 172.21.15.26:0/1395762070 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36bc0043d0 con 0x7f36c809e000 2023-10-01T07:55:09.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.156+0000 7f36cd76b700 1 -- 172.21.15.26:0/1395762070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36c81a6360 con 0x7f36c809e000 2023-10-01T07:55:09.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.157+0000 7f36cd76b700 1 -- 172.21.15.26:0/1395762070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36c8074ea0 con 0x7f36c809e000 2023-10-01T07:55:09.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.157+0000 7f5336e39700 1 -- 172.21.15.26:0/1728542620 shutdown_connections 2023-10-01T07:55:09.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.157+0000 7f5336e39700 1 --2- 172.21.15.26:0/1728542620 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f533009e850 0x7f533009ec20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.157+0000 7f5336e39700 1 --2- 172.21.15.26:0/1728542620 >> v2:172.21.15.26:3300/0 conn(0x7f533009f160 0x7f5330133bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.157+0000 7f5336e39700 1 -- 172.21.15.26:0/1728542620 >> 172.21.15.26:0/1728542620 conn(0x7f53300a3f70 msgr2=0x7f53300a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:09.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.157+0000 7f36af7fe700 1 -- 172.21.15.26:0/1395762070 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f36bc0036a0 con 0x7f36c809e000 2023-10-01T07:55:09.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.157+0000 7f5336e39700 1 -- 172.21.15.26:0/1728542620 shutdown_connections 2023-10-01T07:55:09.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.157+0000 7f36c6ffd700 1 -- 172.21.15.26:0/1395762070 >> v1:172.21.15.26:6816/126763 conn(0x7f36b402f540 legacy=0x7f36b40319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:09.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.157+0000 7f5336e39700 1 -- 172.21.15.26:0/1728542620 wait complete. 2023-10-01T07:55:09.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.159+0000 7f5336e39700 1 Processor -- start 2023-10-01T07:55:09.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.159+0000 7f5336e39700 1 -- start start 2023-10-01T07:55:09.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.160+0000 7f5336e39700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f533009e850 0x7f533011a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:09.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.160+0000 7f5336e39700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f533009f160 0x7f533011ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:09.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.160+0000 7f5336e39700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f533009f5b0 0x7f533011b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:09.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.160+0000 7f5336e39700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533011bb00 con 0x7f533009f160 2023-10-01T07:55:09.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.160+0000 7f5336e39700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f533012b040 con 0x7f533009e850 2023-10-01T07:55:09.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.160+0000 7f5336e39700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f533011dbd0 con 0x7f533009f5b0 2023-10-01T07:55:09.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.160+0000 7f532ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f533009f160 0x7f533011ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:09.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.160+0000 7f532ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f533009f160 0x7f533011ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53814/0 (socket says 172.21.15.26:53814) 2023-10-01T07:55:09.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.160+0000 7f532ffff700 1 -- 172.21.15.26:0/2102100990 learned_addr learned my addr 172.21.15.26:0/2102100990 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:09.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.160+0000 7f5334bd5700 1 --2- 172.21.15.26:0/2102100990 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f533009e850 0x7f533011a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:09.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.160+0000 7f53353d6700 1 --2- 172.21.15.26:0/2102100990 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f533009f5b0 0x7f533011b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:09.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.161+0000 7f532ffff700 1 -- 172.21.15.26:0/2102100990 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f533009f5b0 msgr2=0x7f533011b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:09.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.161+0000 7f532ffff700 1 --2- 172.21.15.26:0/2102100990 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f533009f5b0 0x7f533011b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.161+0000 7f532ffff700 1 -- 172.21.15.26:0/2102100990 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f533009e850 msgr2=0x7f533011a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:09.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.161+0000 7f532ffff700 1 --2- 172.21.15.26:0/2102100990 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f533009e850 0x7f533011a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.161+0000 7f532ffff700 1 -- 172.21.15.26:0/2102100990 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53240094a0 con 0x7f533009f160 2023-10-01T07:55:09.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.161+0000 7f532ffff700 1 --2- 172.21.15.26:0/2102100990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f533009f160 0x7f533011ab90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f531c00e810 tx=0x7f531c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:09.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.165+0000 7f36af7fe700 1 -- 172.21.15.26:0/1395762070 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f36bc012de0 con 0x7f36c809e000 2023-10-01T07:55:09.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.167+0000 7f532d7fa700 1 -- 172.21.15.26:0/2102100990 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c004230 con 0x7f533009f160 2023-10-01T07:55:09.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.167+0000 7f532d7fa700 1 -- 172.21.15.26:0/2102100990 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531c004390 con 0x7f533009f160 2023-10-01T07:55:09.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.167+0000 7f5336e39700 1 -- 172.21.15.26:0/2102100990 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f533011ca50 con 0x7f533009f160 2023-10-01T07:55:09.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.167+0000 7f532d7fa700 1 -- 172.21.15.26:0/2102100990 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c0036a0 con 0x7f533009f160 2023-10-01T07:55:09.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.167+0000 7f5336e39700 1 -- 172.21.15.26:0/2102100990 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53301ccb30 con 0x7f533009f160 2023-10-01T07:55:09.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.167+0000 7f36af7fe700 1 -- 172.21.15.26:0/1395762070 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f36bc044060 con 0x7f36c809e000 2023-10-01T07:55:09.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.168+0000 7f532d7fa700 1 -- 172.21.15.26:0/2102100990 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f531c003800 con 0x7f533009f160 2023-10-01T07:55:09.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.168+0000 7f5336e39700 1 -- 172.21.15.26:0/2102100990 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f533011dfa0 con 0x7f533009f160 2023-10-01T07:55:09.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.168+0000 7f532d7fa700 1 -- 172.21.15.26:0/2102100990 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f531c03f730 con 0x7f533009f160 2023-10-01T07:55:09.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.168+0000 7f5334bd5700 1 -- 172.21.15.26:0/2102100990 >> v1:172.21.15.26:6816/126763 conn(0x7f531402f510 legacy=0x7f53140319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:09.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.177+0000 7f532d7fa700 1 -- 172.21.15.26:0/2102100990 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f531c01b950 con 0x7f533009f160 2023-10-01T07:55:09.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.239+0000 7f5dfad9d700 1 -- 172.21.15.26:0/1152416137 >> v1:172.21.15.26:6816/126763 conn(0x7f5de802f540 legacy=0x7f5de80319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:09.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.265+0000 7f5e0125c700 1 -- 172.21.15.26:0/1152416137 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5dfc124fb0 con 0x7f5dfc1341d0 2023-10-01T07:55:09.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.265+0000 7f5de37fe700 1 -- 172.21.15.26:0/1152416137 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5df4019020 con 0x7f5dfc1341d0 2023-10-01T07:55:09.266 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:09.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.268+0000 7f5e0125c700 1 -- 172.21.15.26:0/1152416137 >> v1:172.21.15.26:6816/126763 conn(0x7f5de802f540 legacy=0x7f5de80319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:09.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.268+0000 7f5e0125c700 1 -- 172.21.15.26:0/1152416137 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5dfc1341d0 msgr2=0x7f5dfc1cc740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:09.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.268+0000 7f5e0125c700 1 --2- 172.21.15.26:0/1152416137 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5dfc1341d0 0x7f5dfc1cc740 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5df400b9a0 tx=0x7f5df400bd60 comp rx=0 tx=0).stop 2023-10-01T07:55:09.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.269+0000 7f5e0125c700 1 -- 172.21.15.26:0/1152416137 shutdown_connections 2023-10-01T07:55:09.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.269+0000 7f5e0125c700 1 --2- 172.21.15.26:0/1152416137 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5dfc1341d0 0x7f5dfc1cc740 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.269+0000 7f5e0125c700 1 --2- 172.21.15.26:0/1152416137 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5dfc09e390 0x7f5dfc123240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.269+0000 7f5e0125c700 1 --2- 172.21.15.26:0/1152416137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5dfc1338c0 0x7f5dfc123780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.269+0000 7f5e0125c700 1 -- 172.21.15.26:0/1152416137 >> 172.21.15.26:0/1152416137 conn(0x7f5dfc0a2aa0 msgr2=0x7f5dfc09f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:09.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.269+0000 7f5e0125c700 1 -- 172.21.15.26:0/1152416137 shutdown_connections 2023-10-01T07:55:09.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.269+0000 7f5e0125c700 1 -- 172.21.15.26:0/1152416137 wait complete. 2023-10-01T07:55:09.288 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:09.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.321+0000 7fa6aaffd700 1 -- 172.21.15.26:0/3092402266 >> v1:172.21.15.26:6816/126763 conn(0x7fa69802f510 legacy=0x7fa6980319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:09.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.347+0000 7fa6b12f5700 1 -- 172.21.15.26:0/3092402266 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa6ac11e420 con 0x7fa6ac09f5b0 2023-10-01T07:55:09.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.347+0000 7fa6937fe700 1 -- 172.21.15.26:0/3092402266 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa6ac11e420 con 0x7fa6ac09f5b0 2023-10-01T07:55:09.348 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:09.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.350+0000 7fa6b12f5700 1 -- 172.21.15.26:0/3092402266 >> v1:172.21.15.26:6816/126763 conn(0x7fa69802f510 legacy=0x7fa6980319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:09.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.350+0000 7fa6b12f5700 1 -- 172.21.15.26:0/3092402266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6ac09f5b0 msgr2=0x7fa6ac11b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:09.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.350+0000 7fa6b12f5700 1 --2- 172.21.15.26:0/3092402266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6ac09f5b0 0x7fa6ac11b9c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4007d90 tx=0x7fa6a400e3c0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.350+0000 7fa6b12f5700 1 -- 172.21.15.26:0/3092402266 shutdown_connections 2023-10-01T07:55:09.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.350+0000 7fa6b12f5700 1 --2- 172.21.15.26:0/3092402266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6ac09f5b0 0x7fa6ac11b9c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.350+0000 7fa6b12f5700 1 --2- 172.21.15.26:0/3092402266 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa6ac09e850 0x7fa6ac11af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.350+0000 7fa6b12f5700 1 --2- 172.21.15.26:0/3092402266 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6ac09f160 0x7fa6ac11b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.350+0000 7fa6b12f5700 1 -- 172.21.15.26:0/3092402266 >> 172.21.15.26:0/3092402266 conn(0x7fa6ac0a3f70 msgr2=0x7fa6ac133310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:09.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.350+0000 7fa6b12f5700 1 -- 172.21.15.26:0/3092402266 shutdown_connections 2023-10-01T07:55:09.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.350+0000 7fa6b12f5700 1 -- 172.21.15.26:0/3092402266 wait complete. 2023-10-01T07:55:09.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.358+0000 7f36c6ffd700 1 -- 172.21.15.26:0/1395762070 >> v1:172.21.15.26:6816/126763 conn(0x7f36b402f540 legacy=0x7f36b40319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:09.364 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:09.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.369+0000 7f5334bd5700 1 -- 172.21.15.26:0/2102100990 >> v1:172.21.15.26:6816/126763 conn(0x7f531402f510 legacy=0x7f53140319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:09.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.384+0000 7f36cd76b700 1 -- 172.21.15.26:0/1395762070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f36c809f420 con 0x7f36c809e000 2023-10-01T07:55:09.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.385+0000 7f36af7fe700 1 -- 172.21.15.26:0/1395762070 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f36bc017020 con 0x7f36c809e000 2023-10-01T07:55:09.385 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.387+0000 7f36cd76b700 1 -- 172.21.15.26:0/1395762070 >> v1:172.21.15.26:6816/126763 conn(0x7f36b402f540 legacy=0x7f36b40319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.387+0000 7f36cd76b700 1 -- 172.21.15.26:0/1395762070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36c809e000 msgr2=0x7f36c81a56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.387+0000 7f36cd76b700 1 --2- 172.21.15.26:0/1395762070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36c809e000 0x7f36c81a56e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f36bc00e810 tx=0x7f36bc00eb20 comp rx=0 tx=0).stop 2023-10-01T07:55:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.387+0000 7f36cd76b700 1 -- 172.21.15.26:0/1395762070 shutdown_connections 2023-10-01T07:55:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.387+0000 7f36cd76b700 1 --2- 172.21.15.26:0/1395762070 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f36c809e410 0x7f36c81c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.387+0000 7f36cd76b700 1 --2- 172.21.15.26:0/1395762070 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36c809d6f0 0x7f36c81a51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.387+0000 7f36cd76b700 1 --2- 172.21.15.26:0/1395762070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36c809e000 0x7f36c81a56e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.387+0000 7f36cd76b700 1 -- 172.21.15.26:0/1395762070 >> 172.21.15.26:0/1395762070 conn(0x7f36c8066f50 msgr2=0x7f36c80a1580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.387+0000 7f36cd76b700 1 -- 172.21.15.26:0/1395762070 shutdown_connections 2023-10-01T07:55:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.387+0000 7f36cd76b700 1 -- 172.21.15.26:0/1395762070 wait complete. 2023-10-01T07:55:09.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.388+0000 7f5336e39700 1 -- 172.21.15.26:0/2102100990 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f53300747f0 con 0x7f533009f160 2023-10-01T07:55:09.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.388+0000 7f532d7fa700 1 -- 172.21.15.26:0/2102100990 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f531c01b360 con 0x7f533009f160 2023-10-01T07:55:09.389 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.390+0000 7f5336e39700 1 -- 172.21.15.26:0/2102100990 >> v1:172.21.15.26:6816/126763 conn(0x7f531402f510 legacy=0x7f53140319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.390+0000 7f5336e39700 1 -- 172.21.15.26:0/2102100990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f533009f160 msgr2=0x7f533011ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.390+0000 7f5336e39700 1 --2- 172.21.15.26:0/2102100990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f533009f160 0x7f533011ab90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f531c00e810 tx=0x7f531c00eb20 comp rx=0 tx=0).stop 2023-10-01T07:55:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.390+0000 7f5336e39700 1 -- 172.21.15.26:0/2102100990 shutdown_connections 2023-10-01T07:55:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.390+0000 7f5336e39700 1 --2- 172.21.15.26:0/2102100990 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f533009f5b0 0x7f533011b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.390+0000 7f5336e39700 1 --2- 172.21.15.26:0/2102100990 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f533009e850 0x7f533011a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.390+0000 7f5336e39700 1 --2- 172.21.15.26:0/2102100990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f533009f160 0x7f533011ab90 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.390+0000 7f5336e39700 1 -- 172.21.15.26:0/2102100990 >> 172.21.15.26:0/2102100990 conn(0x7f53300a3f70 msgr2=0x7f5330071190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:09.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.390+0000 7f5336e39700 1 -- 172.21.15.26:0/2102100990 shutdown_connections 2023-10-01T07:55:09.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:09.390+0000 7f5336e39700 1 -- 172.21.15.26:0/2102100990 wait complete. 2023-10-01T07:55:09.403 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:09.405 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:10.289 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:10.365 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:10.404 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:10.406 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:10.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.446+0000 7f9d283c3700 1 Processor -- start 2023-10-01T07:55:10.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.446+0000 7f9d283c3700 1 -- start start 2023-10-01T07:55:10.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.447+0000 7f9d283c3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d201338a0 0x7f9d20133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:10.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.447+0000 7f9d283c3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d2009de50 0x7f9d2009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:10.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.447+0000 7f9d283c3700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d2006ef30 con 0x7f9d2009e760 2023-10-01T07:55:10.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.447+0000 7f9d283c3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2006fef0 con 0x7f9d201338a0 2023-10-01T07:55:10.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.447+0000 7f9d283c3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d201334b0 con 0x7f9d2009de50 2023-10-01T07:55:10.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.448+0000 7f9d26960700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9d2009e760 0x7f9d2013a730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54962/0 (socket says 172.21.15.26:54962) 2023-10-01T07:55:10.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.448+0000 7f9d26960700 1 -- 172.21.15.26:0/4043941547 learned_addr learned my addr 172.21.15.26:0/4043941547 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:10.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.448+0000 7f9d2615f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d201338a0 0x7f9d20133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:10.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.448+0000 7f9d2615f700 1 -- 172.21.15.26:0/4043941547 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d2009de50 msgr2=0x7f9d2009e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:10.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.448+0000 7f9d2615f700 1 --2- 172.21.15.26:0/4043941547 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d2009de50 0x7f9d2009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.448+0000 7f9d2615f700 1 -- 172.21.15.26:0/4043941547 >> v1:172.21.15.26:6789/0 conn(0x7f9d2009e760 legacy=0x7f9d2013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:10.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.448+0000 7f9d2615f700 1 -- 172.21.15.26:0/4043941547 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d2006fc30 con 0x7f9d201338a0 2023-10-01T07:55:10.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.448+0000 7f9d2615f700 1 --2- 172.21.15.26:0/4043941547 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d201338a0 0x7f9d20133c70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009870 tx=0x7f9d1c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7386910d415e1a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:10.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.449+0000 7f9d2515d700 1 -- 172.21.15.26:0/4043941547 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c004230 con 0x7f9d201338a0 2023-10-01T07:55:10.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.449+0000 7f9d2515d700 1 -- 172.21.15.26:0/4043941547 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1c004390 con 0x7f9d201338a0 2023-10-01T07:55:10.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.449+0000 7f9d2515d700 1 -- 172.21.15.26:0/4043941547 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c0036a0 con 0x7f9d201338a0 2023-10-01T07:55:10.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.450+0000 7f9d283c3700 1 -- 172.21.15.26:0/4043941547 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d201338a0 msgr2=0x7f9d20133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:10.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.450+0000 7f9d283c3700 1 --2- 172.21.15.26:0/4043941547 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d201338a0 0x7f9d20133c70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009870 tx=0x7f9d1c009b80 comp rx=0 tx=0).stop 2023-10-01T07:55:10.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.450+0000 7f9d283c3700 1 -- 172.21.15.26:0/4043941547 shutdown_connections 2023-10-01T07:55:10.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.450+0000 7f9d283c3700 1 --2- 172.21.15.26:0/4043941547 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d201338a0 0x7f9d20133c70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.450+0000 7f9d283c3700 1 --2- 172.21.15.26:0/4043941547 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d2009de50 0x7f9d2009e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.450+0000 7f9d283c3700 1 -- 172.21.15.26:0/4043941547 >> 172.21.15.26:0/4043941547 conn(0x7f9d200a2aa0 msgr2=0x7f9d200a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:10.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.450+0000 7f9d283c3700 1 -- 172.21.15.26:0/4043941547 shutdown_connections 2023-10-01T07:55:10.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.450+0000 7f9d283c3700 1 -- 172.21.15.26:0/4043941547 wait complete. 2023-10-01T07:55:10.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.451+0000 7f9d283c3700 1 Processor -- start 2023-10-01T07:55:10.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.451+0000 7f9d283c3700 1 -- start start 2023-10-01T07:55:10.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.451+0000 7f9d283c3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d2009de50 0x7f9d2011eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:10.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.451+0000 7f9d283c3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d2009e760 0x7f9d2011f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:10.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.451+0000 7f9d283c3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d201338a0 0x7f9d2011f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:10.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.451+0000 7f9d283c3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d20121e10 con 0x7f9d2009e760 2023-10-01T07:55:10.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.452+0000 7f9d283c3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d201226a0 con 0x7f9d2009de50 2023-10-01T07:55:10.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.452+0000 7f9d283c3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d200a1140 con 0x7f9d201338a0 2023-10-01T07:55:10.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.452+0000 7f9d2615f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d2009de50 0x7f9d2011eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:10.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.452+0000 7f9d2615f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d2009de50 0x7f9d2011eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46128/0 (socket says 172.21.15.26:46128) 2023-10-01T07:55:10.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.452+0000 7f9d2615f700 1 -- 172.21.15.26:0/2249715601 learned_addr learned my addr 172.21.15.26:0/2249715601 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:10.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.452+0000 7f9d2595e700 1 --2- 172.21.15.26:0/2249715601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d2009e760 0x7f9d2011f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:10.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.452+0000 7f9d2615f700 1 -- 172.21.15.26:0/2249715601 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d201338a0 msgr2=0x7f9d2011f600 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:10.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.452+0000 7f9d2615f700 1 --2- 172.21.15.26:0/2249715601 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d201338a0 0x7f9d2011f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.452+0000 7f9d2615f700 1 -- 172.21.15.26:0/2249715601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d2009e760 msgr2=0x7f9d2011f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:10.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.452+0000 7f9d2615f700 1 --2- 172.21.15.26:0/2249715601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d2009e760 0x7f9d2011f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.452+0000 7f9d2615f700 1 -- 172.21.15.26:0/2249715601 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1c0094a0 con 0x7f9d2009de50 2023-10-01T07:55:10.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.452+0000 7f9d2595e700 1 --2- 172.21.15.26:0/2249715601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d2009e760 0x7f9d2011f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:10.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.452+0000 7f9d2615f700 1 --2- 172.21.15.26:0/2249715601 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d2009de50 0x7f9d2011eb80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c000c00 tx=0x7f9d1c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:10.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.453+0000 7f9d16ffd700 1 -- 172.21.15.26:0/2249715601 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c003d80 con 0x7f9d2009de50 2023-10-01T07:55:10.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.453+0000 7f9d16ffd700 1 -- 172.21.15.26:0/2249715601 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1c020070 con 0x7f9d2009de50 2023-10-01T07:55:10.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.453+0000 7f9d16ffd700 1 -- 172.21.15.26:0/2249715601 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c011870 con 0x7f9d2009de50 2023-10-01T07:55:10.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.453+0000 7f9d283c3700 1 -- 172.21.15.26:0/2249715601 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d2006f6a0 con 0x7f9d2009de50 2023-10-01T07:55:10.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.453+0000 7f9d283c3700 1 -- 172.21.15.26:0/2249715601 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d201223c0 con 0x7f9d2009de50 2023-10-01T07:55:10.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.454+0000 7f9d16ffd700 1 -- 172.21.15.26:0/2249715601 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9d1c022030 con 0x7f9d2009de50 2023-10-01T07:55:10.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.454+0000 7f9d2595e700 1 -- 172.21.15.26:0/2249715601 >> v1:172.21.15.26:6816/126763 conn(0x7f9d0402f510 legacy=0x7f9d040319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:10.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.454+0000 7f9d16ffd700 1 -- 172.21.15.26:0/2249715601 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f9d1c01b450 con 0x7f9d2009de50 2023-10-01T07:55:10.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.455+0000 7f9d283c3700 1 -- 172.21.15.26:0/2249715601 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d20074ea0 con 0x7f9d2009de50 2023-10-01T07:55:10.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.464+0000 7f9d16ffd700 1 -- 172.21.15.26:0/2249715601 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d1c01b970 con 0x7f9d2009de50 2023-10-01T07:55:10.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.518+0000 7f5fd3f94700 1 Processor -- start 2023-10-01T07:55:10.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.518+0000 7f5fd3f94700 1 -- start start 2023-10-01T07:55:10.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.519+0000 7f5fd3f94700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5fcc133510 0x7f5fcc1358f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:10.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.519+0000 7f5fd3f94700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5fcc135e30 0x7f5fcc138210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:10.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.519+0000 7f5fd3f94700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fcc130260 con 0x7f5fcc130670 2023-10-01T07:55:10.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.519+0000 7f5fd3f94700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fcc09a350 con 0x7f5fcc133510 2023-10-01T07:55:10.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.519+0000 7f5fd3f94700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc071ff0 con 0x7f5fcc135e30 2023-10-01T07:55:10.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.519+0000 7f5fd152f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5fcc133510 0x7f5fcc1358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:10.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.519+0000 7f5fd1d30700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5fcc130670 0x7f5fcc130a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54968/0 (socket says 172.21.15.26:54968) 2023-10-01T07:55:10.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.519+0000 7f5fd1d30700 1 -- 172.21.15.26:0/929916121 learned_addr learned my addr 172.21.15.26:0/929916121 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:10.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.519+0000 7f5fd2531700 1 --2- 172.21.15.26:0/929916121 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5fcc135e30 0x7f5fcc138210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:10.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.520+0000 7f5fd152f700 1 -- 172.21.15.26:0/929916121 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5fcc135e30 msgr2=0x7f5fcc138210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:10.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.520+0000 7f5fd152f700 1 --2- 172.21.15.26:0/929916121 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5fcc135e30 0x7f5fcc138210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.520+0000 7f5fd152f700 1 -- 172.21.15.26:0/929916121 >> v1:172.21.15.26:6789/0 conn(0x7f5fcc130670 legacy=0x7f5fcc130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:10.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.520+0000 7f5fd0d2e700 1 -- 172.21.15.26:0/929916121 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1857760672 0 0) 0x7f5fcc130260 con 0x7f5fcc130670 2023-10-01T07:55:10.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.520+0000 7f5fd152f700 1 -- 172.21.15.26:0/929916121 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fcc09ecf0 con 0x7f5fcc133510 2023-10-01T07:55:10.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.520+0000 7f5fd2531700 1 --2- 172.21.15.26:0/929916121 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5fcc135e30 0x7f5fcc138210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:10.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.520+0000 7f5fd152f700 1 --2- 172.21.15.26:0/929916121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fcc133510 0x7f5fcc1358f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc009840 tx=0x7f5fbc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f306daa8c31b0f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:10.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.520+0000 7f5fd0d2e700 1 -- 172.21.15.26:0/929916121 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc011830 con 0x7f5fcc133510 2023-10-01T07:55:10.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.520+0000 7f5fd0d2e700 1 -- 172.21.15.26:0/929916121 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fbc011990 con 0x7f5fcc133510 2023-10-01T07:55:10.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.520+0000 7f5fd0d2e700 1 -- 172.21.15.26:0/929916121 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc011d20 con 0x7f5fcc133510 2023-10-01T07:55:10.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.521+0000 7f5fd3f94700 1 -- 172.21.15.26:0/929916121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fcc133510 msgr2=0x7f5fcc1358f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:10.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.521+0000 7f5fd3f94700 1 --2- 172.21.15.26:0/929916121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fcc133510 0x7f5fcc1358f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc009840 tx=0x7f5fbc009b50 comp rx=0 tx=0).stop 2023-10-01T07:55:10.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.521+0000 7f5fd3f94700 1 -- 172.21.15.26:0/929916121 shutdown_connections 2023-10-01T07:55:10.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.521+0000 7f5fd3f94700 1 --2- 172.21.15.26:0/929916121 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5fcc135e30 0x7f5fcc138210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.521+0000 7f5fd3f94700 1 --2- 172.21.15.26:0/929916121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fcc133510 0x7f5fcc1358f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.521+0000 7f5fd3f94700 1 -- 172.21.15.26:0/929916121 >> 172.21.15.26:0/929916121 conn(0x7f5fcc0a2aa0 msgr2=0x7f5fcc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:10.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.522+0000 7f5fd3f94700 1 -- 172.21.15.26:0/929916121 shutdown_connections 2023-10-01T07:55:10.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.522+0000 7f5fd3f94700 1 -- 172.21.15.26:0/929916121 wait complete. 2023-10-01T07:55:10.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.523+0000 7f5fd3f94700 1 Processor -- start 2023-10-01T07:55:10.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.523+0000 7f5fd3f94700 1 -- start start 2023-10-01T07:55:10.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.523+0000 7f5fd3f94700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5fcc130670 0x7f5fcc09c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:10.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.523+0000 7f5fd3f94700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fcc133510 0x7f5fcc09ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:10.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.523+0000 7f5fd3f94700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5fcc135e30 0x7f5fcc09d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:10.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.523+0000 7f5fd3f94700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc137cf0 con 0x7f5fcc133510 2023-10-01T07:55:10.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.523+0000 7f5fd3f94700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc136670 con 0x7f5fcc135e30 2023-10-01T07:55:10.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.523+0000 7f5fd3f94700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc12ff50 con 0x7f5fcc130670 2023-10-01T07:55:10.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.523+0000 7f5fd152f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fcc133510 0x7f5fcc09ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:10.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.523+0000 7f5fd1d30700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5fcc130670 0x7f5fcc09c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:10.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.523+0000 7f5fd2531700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5fcc135e30 0x7f5fcc09d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:10.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.524+0000 7f5fd152f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fcc133510 0x7f5fcc09ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53834/0 (socket says 172.21.15.26:53834) 2023-10-01T07:55:10.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.524+0000 7f5fd152f700 1 -- 172.21.15.26:0/3626946499 learned_addr learned my addr 172.21.15.26:0/3626946499 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:10.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.524+0000 7f5fd2531700 1 --2- 172.21.15.26:0/3626946499 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5fcc135e30 0x7f5fcc09d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46142/0 (socket says 172.21.15.26:46142) 2023-10-01T07:55:10.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.524+0000 7f5fd1d30700 1 -- 172.21.15.26:0/3626946499 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5fcc135e30 msgr2=0x7f5fcc09d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:10.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.524+0000 7f5fd1d30700 1 --2- 172.21.15.26:0/3626946499 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5fcc135e30 0x7f5fcc09d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.524+0000 7f5fd1d30700 1 -- 172.21.15.26:0/3626946499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fcc133510 msgr2=0x7f5fcc09ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:10.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.524+0000 7f5fd1d30700 1 --2- 172.21.15.26:0/3626946499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fcc133510 0x7f5fcc09ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.524+0000 7f5fd1d30700 1 -- 172.21.15.26:0/3626946499 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc4009a70 con 0x7f5fcc130670 2023-10-01T07:55:10.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.524+0000 7f5fd1d30700 1 --2- 172.21.15.26:0/3626946499 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5fcc130670 0x7f5fcc09c770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5fc800c470 tx=0x7f5fc800c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:10.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.524+0000 7f5fc27fc700 1 -- 172.21.15.26:0/3626946499 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc8004c80 con 0x7f5fcc130670 2023-10-01T07:55:10.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.524+0000 7f5fc27fc700 1 -- 172.21.15.26:0/3626946499 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc8004de0 con 0x7f5fcc130670 2023-10-01T07:55:10.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.525+0000 7f5fd3f94700 1 -- 172.21.15.26:0/3626946499 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fbc0094a0 con 0x7f5fcc130670 2023-10-01T07:55:10.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.525+0000 7f5fc27fc700 1 -- 172.21.15.26:0/3626946499 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc8007310 con 0x7f5fcc130670 2023-10-01T07:55:10.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.525+0000 7f5fd3f94700 1 -- 172.21.15.26:0/3626946499 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fcc071820 con 0x7f5fcc130670 2023-10-01T07:55:10.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.526+0000 7f5fd3f94700 1 -- 172.21.15.26:0/3626946499 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fcc09e300 con 0x7f5fcc130670 2023-10-01T07:55:10.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.526+0000 7f5fc27fc700 1 -- 172.21.15.26:0/3626946499 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5fc8007470 con 0x7f5fcc130670 2023-10-01T07:55:10.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.526+0000 7f5fc27fc700 1 -- 172.21.15.26:0/3626946499 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f5fc803f810 con 0x7f5fcc130670 2023-10-01T07:55:10.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.526+0000 7f5fd152f700 1 -- 172.21.15.26:0/3626946499 >> v1:172.21.15.26:6816/126763 conn(0x7f5fb002f560 legacy=0x7f5fb0031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:10.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.531+0000 7f5fc27fc700 1 -- 172.21.15.26:0/3626946499 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5fc8007720 con 0x7f5fcc130670 2023-10-01T07:55:10.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.560+0000 7f9dad4de700 1 Processor -- start 2023-10-01T07:55:10.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.560+0000 7f9dad4de700 1 -- start start 2023-10-01T07:55:10.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.561+0000 7f9dad4de700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9da809d6f0 0x7f9da809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:10.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.561+0000 7f9dad4de700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9da809e000 0x7f9da81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:10.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.561+0000 7f9dad4de700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9da809e410 0x7f9da8133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:10.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.561+0000 7f9dad4de700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9da806b460 con 0x7f9da809e410 2023-10-01T07:55:10.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.561+0000 7f9dad4de700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da809b120 con 0x7f9da809d6f0 2023-10-01T07:55:10.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.561+0000 7f9dad4de700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9da809a7e0 con 0x7f9da809e000 2023-10-01T07:55:10.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.561+0000 7f9da6ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9da809d6f0 0x7f9da809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:10.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.561+0000 7f9da6ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9da809d6f0 0x7f9da809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46154/0 (socket says 172.21.15.26:46154) 2023-10-01T07:55:10.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.561+0000 7f9da6ffd700 1 -- 172.21.15.26:0/3957335024 learned_addr learned my addr 172.21.15.26:0/3957335024 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:10.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.561+0000 7f9da67fc700 1 --2- 172.21.15.26:0/3957335024 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9da809e000 0x7f9da81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:10.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.561+0000 7f9da6ffd700 1 -- 172.21.15.26:0/3957335024 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9da809e000 msgr2=0x7f9da81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:10.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.561+0000 7f9da6ffd700 1 --2- 172.21.15.26:0/3957335024 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9da809e000 0x7f9da81339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.561+0000 7f9da6ffd700 1 -- 172.21.15.26:0/3957335024 >> v2:172.21.15.26:3300/0 conn(0x7f9da809e410 msgr2=0x7f9da8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:10.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.561+0000 7f9da6ffd700 1 --2- 172.21.15.26:0/3957335024 >> v2:172.21.15.26:3300/0 conn(0x7f9da809e410 0x7f9da8133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.561+0000 7f9da6ffd700 1 -- 172.21.15.26:0/3957335024 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da809a500 con 0x7f9da809d6f0 2023-10-01T07:55:10.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.562+0000 7f9da6ffd700 1 --2- 172.21.15.26:0/3957335024 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9da809d6f0 0x7f9da809dac0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9d98009920 tx=0x7f9d98009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e123649630dab05 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:10.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.562+0000 7f9da5ffb700 1 -- 172.21.15.26:0/3957335024 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d98011830 con 0x7f9da809d6f0 2023-10-01T07:55:10.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.562+0000 7f9da5ffb700 1 -- 172.21.15.26:0/3957335024 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d98011990 con 0x7f9da809d6f0 2023-10-01T07:55:10.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.562+0000 7f9da5ffb700 1 -- 172.21.15.26:0/3957335024 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d98011d20 con 0x7f9da809d6f0 2023-10-01T07:55:10.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.563+0000 7f9dad4de700 1 -- 172.21.15.26:0/3957335024 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9da809d6f0 msgr2=0x7f9da809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:10.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.563+0000 7f9dad4de700 1 --2- 172.21.15.26:0/3957335024 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9da809d6f0 0x7f9da809dac0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9d98009920 tx=0x7f9d98009c30 comp rx=0 tx=0).stop 2023-10-01T07:55:10.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.563+0000 7f9dad4de700 1 -- 172.21.15.26:0/3957335024 shutdown_connections 2023-10-01T07:55:10.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.563+0000 7f9dad4de700 1 --2- 172.21.15.26:0/3957335024 >> v2:172.21.15.26:3300/0 conn(0x7f9da809e410 0x7f9da8133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.563+0000 7f9dad4de700 1 --2- 172.21.15.26:0/3957335024 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9da809d6f0 0x7f9da809dac0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.563+0000 7f9dad4de700 1 --2- 172.21.15.26:0/3957335024 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9da809e000 0x7f9da81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.563+0000 7f9dad4de700 1 -- 172.21.15.26:0/3957335024 >> 172.21.15.26:0/3957335024 conn(0x7f9da8066f50 msgr2=0x7f9da809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:10.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.563+0000 7f9dad4de700 1 -- 172.21.15.26:0/3957335024 shutdown_connections 2023-10-01T07:55:10.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.563+0000 7f9dad4de700 1 -- 172.21.15.26:0/3957335024 wait complete. 2023-10-01T07:55:10.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.564+0000 7f9dad4de700 1 Processor -- start 2023-10-01T07:55:10.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.564+0000 7f9dad4de700 1 -- start start 2023-10-01T07:55:10.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.565+0000 7f9dad4de700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9da809d6f0 0x7f9da81a5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:10.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.565+0000 7f9dad4de700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9da809e000 0x7f9da81a64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:10.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.565+0000 7f9dad4de700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9da809e410 0x7f9da81a6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:10.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.565+0000 7f9dad4de700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da81a7440 con 0x7f9da809e000 2023-10-01T07:55:10.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.565+0000 7f9dad4de700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da81a7a70 con 0x7f9da809e410 2023-10-01T07:55:10.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.565+0000 7f9dad4de700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9da81a8cc0 con 0x7f9da809d6f0 2023-10-01T07:55:10.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.565+0000 7f9da6ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9da809d6f0 0x7f9da81a5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:10.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.565+0000 7f9da6ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9da809d6f0 0x7f9da81a5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35934/0 (socket says 172.21.15.26:35934) 2023-10-01T07:55:10.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.565+0000 7f9da6ffd700 1 -- 172.21.15.26:0/3813814315 learned_addr learned my addr 172.21.15.26:0/3813814315 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:10.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.565+0000 7f9da67fc700 1 --2- 172.21.15.26:0/3813814315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9da809e000 0x7f9da81a64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:10.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.565+0000 7f9da77fe700 1 --2- 172.21.15.26:0/3813814315 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9da809e410 0x7f9da81a6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:10.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.566+0000 7f9da67fc700 1 -- 172.21.15.26:0/3813814315 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9da809d6f0 msgr2=0x7f9da81a5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:10.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.566+0000 7f9da67fc700 1 --2- 172.21.15.26:0/3813814315 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9da809d6f0 0x7f9da81a5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.566+0000 7f9da67fc700 1 -- 172.21.15.26:0/3813814315 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9da809e410 msgr2=0x7f9da81a6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:10.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.566+0000 7f9da67fc700 1 --2- 172.21.15.26:0/3813814315 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9da809e410 0x7f9da81a6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.566+0000 7f9da67fc700 1 -- 172.21.15.26:0/3813814315 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d98009550 con 0x7f9da809e000 2023-10-01T07:55:10.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.566+0000 7f9da67fc700 1 --2- 172.21.15.26:0/3813814315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9da809e000 0x7f9da81a64d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c00e900 tx=0x7f9d9c00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:10.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.566+0000 7f9d8f7fe700 1 -- 172.21.15.26:0/3813814315 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c013680 con 0x7f9da809e000 2023-10-01T07:55:10.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.566+0000 7f9d8f7fe700 1 -- 172.21.15.26:0/3813814315 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9c0137e0 con 0x7f9da809e000 2023-10-01T07:55:10.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.566+0000 7f9dad4de700 1 -- 172.21.15.26:0/3813814315 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da81a96a0 con 0x7f9da809e000 2023-10-01T07:55:10.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.566+0000 7f9d8f7fe700 1 -- 172.21.15.26:0/3813814315 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c013b50 con 0x7f9da809e000 2023-10-01T07:55:10.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.566+0000 7f9dad4de700 1 -- 172.21.15.26:0/3813814315 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da80a3180 con 0x7f9da809e000 2023-10-01T07:55:10.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.567+0000 7f9d8f7fe700 1 -- 172.21.15.26:0/3813814315 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9d9c013cb0 con 0x7f9da809e000 2023-10-01T07:55:10.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.568+0000 7f9d8f7fe700 1 -- 172.21.15.26:0/3813814315 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f9d9c03fb80 con 0x7f9da809e000 2023-10-01T07:55:10.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.568+0000 7f9da6ffd700 1 -- 172.21.15.26:0/3813814315 >> v1:172.21.15.26:6816/126763 conn(0x7f9d9402f560 legacy=0x7f9d94031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:10.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.568+0000 7f9dad4de700 1 -- 172.21.15.26:0/3813814315 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9da8074ea0 con 0x7f9da809e000 2023-10-01T07:55:10.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.571+0000 7fc4c9671700 1 Processor -- start 2023-10-01T07:55:10.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.571+0000 7fc4c9671700 1 -- start start 2023-10-01T07:55:10.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.572+0000 7fc4c9671700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4c409d6f0 0x7fc4c409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:10.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.572+0000 7fc4c9671700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4c409e000 0x7fc4c4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:10.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.572+0000 7fc4c9671700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc4c409e410 0x7fc4c4130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:10.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.572+0000 7fc4c9671700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4c409f520 con 0x7fc4c409e410 2023-10-01T07:55:10.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.572+0000 7fc4c9671700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c409f130 con 0x7fc4c409d6f0 2023-10-01T07:55:10.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.572+0000 7fc4c9671700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c409e930 con 0x7fc4c409e000 2023-10-01T07:55:10.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.572+0000 7fc4c2ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4c409d6f0 0x7fc4c409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:10.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.572+0000 7fc4c2ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4c409d6f0 0x7fc4c409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46174/0 (socket says 172.21.15.26:46174) 2023-10-01T07:55:10.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.572+0000 7fc4c2ffd700 1 -- 172.21.15.26:0/871689329 learned_addr learned my addr 172.21.15.26:0/871689329 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:10.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.572+0000 7fc4c37fe700 1 --2- 172.21.15.26:0/871689329 >> v2:172.21.15.26:3300/0 conn(0x7fc4c409e410 0x7fc4c4130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:10.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.572+0000 7fc4c27fc700 1 --2- 172.21.15.26:0/871689329 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4c409e000 0x7fc4c4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:10.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.573+0000 7fc4c2ffd700 1 -- 172.21.15.26:0/871689329 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4c409e000 msgr2=0x7fc4c4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:10.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.573+0000 7fc4c2ffd700 1 --2- 172.21.15.26:0/871689329 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4c409e000 0x7fc4c4130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.573+0000 7fc4c2ffd700 1 -- 172.21.15.26:0/871689329 >> v2:172.21.15.26:3300/0 conn(0x7fc4c409e410 msgr2=0x7fc4c4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:10.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.573+0000 7fc4c2ffd700 1 --2- 172.21.15.26:0/871689329 >> v2:172.21.15.26:3300/0 conn(0x7fc4c409e410 0x7fc4c4130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.573+0000 7fc4c2ffd700 1 -- 172.21.15.26:0/871689329 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c409b2d0 con 0x7fc4c409d6f0 2023-10-01T07:55:10.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.573+0000 7fc4c2ffd700 1 --2- 172.21.15.26:0/871689329 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4c409d6f0 0x7fc4c409dac0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4009920 tx=0x7fc4b4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3b1d05fef0a2143 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:10.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.573+0000 7fc4c1ffb700 1 -- 172.21.15.26:0/871689329 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4011830 con 0x7fc4c409d6f0 2023-10-01T07:55:10.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.573+0000 7fc4c1ffb700 1 -- 172.21.15.26:0/871689329 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b4011990 con 0x7fc4c409d6f0 2023-10-01T07:55:10.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.573+0000 7fc4c1ffb700 1 -- 172.21.15.26:0/871689329 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4011d20 con 0x7fc4c409d6f0 2023-10-01T07:55:10.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.574+0000 7fc4c9671700 1 -- 172.21.15.26:0/871689329 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4c409d6f0 msgr2=0x7fc4c409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:10.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.574+0000 7fc4c9671700 1 --2- 172.21.15.26:0/871689329 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4c409d6f0 0x7fc4c409dac0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4009920 tx=0x7fc4b4009c30 comp rx=0 tx=0).stop 2023-10-01T07:55:10.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.574+0000 7fc4c9671700 1 -- 172.21.15.26:0/871689329 shutdown_connections 2023-10-01T07:55:10.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.574+0000 7fc4c9671700 1 --2- 172.21.15.26:0/871689329 >> v2:172.21.15.26:3300/0 conn(0x7fc4c409e410 0x7fc4c4130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.574+0000 7fc4c9671700 1 --2- 172.21.15.26:0/871689329 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4c409d6f0 0x7fc4c409dac0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.574+0000 7fc4c9671700 1 --2- 172.21.15.26:0/871689329 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4c409e000 0x7fc4c4130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.574+0000 7fc4c9671700 1 -- 172.21.15.26:0/871689329 >> 172.21.15.26:0/871689329 conn(0x7fc4c4066f50 msgr2=0x7fc4c409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:10.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.574+0000 7fc4c9671700 1 -- 172.21.15.26:0/871689329 shutdown_connections 2023-10-01T07:55:10.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.574+0000 7fc4c9671700 1 -- 172.21.15.26:0/871689329 wait complete. 2023-10-01T07:55:10.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.575+0000 7f9d8f7fe700 1 -- 172.21.15.26:0/3813814315 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d9c017020 con 0x7f9da809e000 2023-10-01T07:55:10.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.576+0000 7fc4c9671700 1 Processor -- start 2023-10-01T07:55:10.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.580+0000 7fc4c9671700 1 -- start start 2023-10-01T07:55:10.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.580+0000 7fc4c9671700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4c409e000 0x7fc4c4119f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:10.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.580+0000 7fc4c9671700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4c409e410 0x7fc4c411a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:10.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.580+0000 7fc4c9671700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4c411a990 0x7fc4c41cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:10.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.580+0000 7fc4c9671700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c411b3e0 con 0x7fc4c409e000 2023-10-01T07:55:10.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.580+0000 7fc4c9671700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c411d950 con 0x7fc4c409e410 2023-10-01T07:55:10.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.580+0000 7fc4c9671700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c411c060 con 0x7fc4c411a990 2023-10-01T07:55:10.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.581+0000 7fc4c37fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4c411a990 0x7fc4c41cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:10.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.581+0000 7fc4c27fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4c409e410 0x7fc4c411a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:10.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.581+0000 7fc4c2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4c409e000 0x7fc4c4119f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:10.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.581+0000 7fc4c37fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4c411a990 0x7fc4c41cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35952/0 (socket says 172.21.15.26:35952) 2023-10-01T07:55:10.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.581+0000 7fc4c37fe700 1 -- 172.21.15.26:0/1678917060 learned_addr learned my addr 172.21.15.26:0/1678917060 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:10.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.581+0000 7fc4c2ffd700 1 -- 172.21.15.26:0/1678917060 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4c411a990 msgr2=0x7fc4c41cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:10.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.581+0000 7fc4c2ffd700 1 --2- 172.21.15.26:0/1678917060 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4c411a990 0x7fc4c41cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.581+0000 7fc4c2ffd700 1 -- 172.21.15.26:0/1678917060 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4c409e410 msgr2=0x7fc4c411a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:10.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.581+0000 7fc4c2ffd700 1 --2- 172.21.15.26:0/1678917060 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4c409e410 0x7fc4c411a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.581+0000 7fc4c2ffd700 1 -- 172.21.15.26:0/1678917060 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b4009550 con 0x7fc4c409e000 2023-10-01T07:55:10.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.581+0000 7fc4c27fc700 1 --2- 172.21.15.26:0/1678917060 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4c409e410 0x7fc4c411a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:10.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.581+0000 7fc4c37fe700 1 --2- 172.21.15.26:0/1678917060 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4c411a990 0x7fc4c41cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:10.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.582+0000 7fc4c2ffd700 1 --2- 172.21.15.26:0/1678917060 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4c409e000 0x7fc4c4119f10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4072a80 tx=0x7fc4b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:10.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.582+0000 7fc4ab7fe700 1 -- 172.21.15.26:0/1678917060 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4004240 con 0x7fc4c409e000 2023-10-01T07:55:10.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.582+0000 7fc4ab7fe700 1 -- 172.21.15.26:0/1678917060 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b401f070 con 0x7fc4c409e000 2023-10-01T07:55:10.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.582+0000 7fc4c9671700 1 -- 172.21.15.26:0/1678917060 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4c411cd20 con 0x7fc4c409e000 2023-10-01T07:55:10.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.582+0000 7fc4ab7fe700 1 -- 172.21.15.26:0/1678917060 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b40036a0 con 0x7fc4c409e000 2023-10-01T07:55:10.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.582+0000 7fc4c9671700 1 -- 172.21.15.26:0/1678917060 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c40a2020 con 0x7fc4c409e000 2023-10-01T07:55:10.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.583+0000 7fc4ab7fe700 1 -- 172.21.15.26:0/1678917060 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc4b4021030 con 0x7fc4c409e000 2023-10-01T07:55:10.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.583+0000 7fc4ab7fe700 1 -- 172.21.15.26:0/1678917060 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fc4b4040e00 con 0x7fc4c409e000 2023-10-01T07:55:10.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.583+0000 7fc4c27fc700 1 -- 172.21.15.26:0/1678917060 >> v1:172.21.15.26:6816/126763 conn(0x7fc4b002f510 legacy=0x7fc4b00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:10.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.585+0000 7fc4c9671700 1 -- 172.21.15.26:0/1678917060 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4c411d310 con 0x7fc4c409e000 2023-10-01T07:55:10.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.591+0000 7fc4ab7fe700 1 -- 172.21.15.26:0/1678917060 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc4b4015080 con 0x7fc4c409e000 2023-10-01T07:55:10.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.655+0000 7f9d2595e700 1 -- 172.21.15.26:0/2249715601 >> v1:172.21.15.26:6816/126763 conn(0x7f9d0402f510 legacy=0x7f9d040319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:10.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.700+0000 7f9d283c3700 1 -- 172.21.15.26:0/2249715601 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9d20074ea0 con 0x7f9d2009de50 2023-10-01T07:55:10.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.700+0000 7f9d16ffd700 1 -- 172.21.15.26:0/2249715601 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9d1c01ab80 con 0x7f9d2009de50 2023-10-01T07:55:10.701 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:10.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.704+0000 7f9d283c3700 1 -- 172.21.15.26:0/2249715601 >> v1:172.21.15.26:6816/126763 conn(0x7f9d0402f510 legacy=0x7f9d040319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:10.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.704+0000 7f9d283c3700 1 -- 172.21.15.26:0/2249715601 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d2009de50 msgr2=0x7f9d2011eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:10.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.704+0000 7f9d283c3700 1 --2- 172.21.15.26:0/2249715601 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d2009de50 0x7f9d2011eb80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c000c00 tx=0x7f9d1c004750 comp rx=0 tx=0).stop 2023-10-01T07:55:10.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.704+0000 7f9d283c3700 1 -- 172.21.15.26:0/2249715601 shutdown_connections 2023-10-01T07:55:10.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.704+0000 7f9d283c3700 1 --2- 172.21.15.26:0/2249715601 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d201338a0 0x7f9d2011f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.704+0000 7f9d283c3700 1 --2- 172.21.15.26:0/2249715601 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d2009de50 0x7f9d2011eb80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.704+0000 7f9d283c3700 1 --2- 172.21.15.26:0/2249715601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d2009e760 0x7f9d2011f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.704+0000 7f9d283c3700 1 -- 172.21.15.26:0/2249715601 >> 172.21.15.26:0/2249715601 conn(0x7f9d200a2aa0 msgr2=0x7f9d2009ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:10.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.704+0000 7f9d283c3700 1 -- 172.21.15.26:0/2249715601 shutdown_connections 2023-10-01T07:55:10.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.704+0000 7f9d283c3700 1 -- 172.21.15.26:0/2249715601 wait complete. 2023-10-01T07:55:10.725 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:10.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.727+0000 7f5fd152f700 1 -- 172.21.15.26:0/3626946499 >> v1:172.21.15.26:6816/126763 conn(0x7f5fb002f560 legacy=0x7f5fb0031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:10.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.769+0000 7f9da6ffd700 1 -- 172.21.15.26:0/3813814315 >> v1:172.21.15.26:6816/126763 conn(0x7f9d9402f560 legacy=0x7f9d94031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:10.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.785+0000 7fc4c27fc700 1 -- 172.21.15.26:0/1678917060 >> v1:172.21.15.26:6816/126763 conn(0x7fc4b002f510 legacy=0x7fc4b00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:10.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.790+0000 7f9dad4de700 1 -- 172.21.15.26:0/3813814315 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9da806c360 con 0x7f9da809e000 2023-10-01T07:55:10.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.791+0000 7f9d8f7fe700 1 -- 172.21.15.26:0/3813814315 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9d9c01b820 con 0x7f9da809e000 2023-10-01T07:55:10.791 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:10.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.793+0000 7f9dad4de700 1 -- 172.21.15.26:0/3813814315 >> v1:172.21.15.26:6816/126763 conn(0x7f9d9402f560 legacy=0x7f9d94031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:10.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.793+0000 7f9dad4de700 1 -- 172.21.15.26:0/3813814315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9da809e000 msgr2=0x7f9da81a64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:10.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.793+0000 7f9dad4de700 1 --2- 172.21.15.26:0/3813814315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9da809e000 0x7f9da81a64d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c00e900 tx=0x7f9d9c00ec10 comp rx=0 tx=0).stop 2023-10-01T07:55:10.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.793+0000 7f9dad4de700 1 -- 172.21.15.26:0/3813814315 shutdown_connections 2023-10-01T07:55:10.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.793+0000 7f9dad4de700 1 --2- 172.21.15.26:0/3813814315 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9da809e410 0x7f9da81a6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.793+0000 7f9dad4de700 1 --2- 172.21.15.26:0/3813814315 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9da809d6f0 0x7f9da81a5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.793+0000 7f9dad4de700 1 --2- 172.21.15.26:0/3813814315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9da809e000 0x7f9da81a64d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.793+0000 7f9dad4de700 1 -- 172.21.15.26:0/3813814315 >> 172.21.15.26:0/3813814315 conn(0x7f9da8066f50 msgr2=0x7f9da81bae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:10.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.793+0000 7f9dad4de700 1 -- 172.21.15.26:0/3813814315 shutdown_connections 2023-10-01T07:55:10.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.793+0000 7f9dad4de700 1 -- 172.21.15.26:0/3813814315 wait complete. 2023-10-01T07:55:10.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.802+0000 7f5fd3f94700 1 -- 172.21.15.26:0/3626946499 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5fcc074ea0 con 0x7f5fcc130670 2023-10-01T07:55:10.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.803+0000 7f5fc27fc700 1 -- 172.21.15.26:0/3626946499 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5fc8011360 con 0x7f5fcc130670 2023-10-01T07:55:10.803 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:10.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.805+0000 7f5fd3f94700 1 -- 172.21.15.26:0/3626946499 >> v1:172.21.15.26:6816/126763 conn(0x7f5fb002f560 legacy=0x7f5fb0031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:10.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.805+0000 7f5fd3f94700 1 -- 172.21.15.26:0/3626946499 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5fcc130670 msgr2=0x7f5fcc09c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:10.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.805+0000 7f5fd3f94700 1 --2- 172.21.15.26:0/3626946499 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5fcc130670 0x7f5fcc09c770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5fc800c470 tx=0x7f5fc800c780 comp rx=0 tx=0).stop 2023-10-01T07:55:10.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.805+0000 7f5fd3f94700 1 -- 172.21.15.26:0/3626946499 shutdown_connections 2023-10-01T07:55:10.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.805+0000 7f5fd3f94700 1 --2- 172.21.15.26:0/3626946499 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5fcc135e30 0x7f5fcc09d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.805+0000 7f5fd3f94700 1 --2- 172.21.15.26:0/3626946499 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5fcc130670 0x7f5fcc09c770 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.805+0000 7f5fd3f94700 1 --2- 172.21.15.26:0/3626946499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fcc133510 0x7f5fcc09ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.805+0000 7f5fd3f94700 1 -- 172.21.15.26:0/3626946499 >> 172.21.15.26:0/3626946499 conn(0x7f5fcc0a2aa0 msgr2=0x7f5fcc12e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:10.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.805+0000 7f5fd3f94700 1 -- 172.21.15.26:0/3626946499 shutdown_connections 2023-10-01T07:55:10.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.805+0000 7f5fd3f94700 1 -- 172.21.15.26:0/3626946499 wait complete. 2023-10-01T07:55:10.808 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:10.819 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:10.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.863+0000 7fc4c9671700 1 -- 172.21.15.26:0/1678917060 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc4c4074ea0 con 0x7fc4c409e000 2023-10-01T07:55:10.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.863+0000 7fc4ab7fe700 1 -- 172.21.15.26:0/1678917060 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc4b40239c0 con 0x7fc4c409e000 2023-10-01T07:55:10.864 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:10.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.865+0000 7fc4c9671700 1 -- 172.21.15.26:0/1678917060 >> v1:172.21.15.26:6816/126763 conn(0x7fc4b002f510 legacy=0x7fc4b00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:10.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.865+0000 7fc4c9671700 1 -- 172.21.15.26:0/1678917060 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4c409e000 msgr2=0x7fc4c4119f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:10.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.865+0000 7fc4c9671700 1 --2- 172.21.15.26:0/1678917060 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4c409e000 0x7fc4c4119f10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4072a80 tx=0x7fc4b4004750 comp rx=0 tx=0).stop 2023-10-01T07:55:10.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.866+0000 7fc4c9671700 1 -- 172.21.15.26:0/1678917060 shutdown_connections 2023-10-01T07:55:10.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.866+0000 7fc4c9671700 1 --2- 172.21.15.26:0/1678917060 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4c411a990 0x7fc4c41cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.866+0000 7fc4c9671700 1 --2- 172.21.15.26:0/1678917060 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4c409e000 0x7fc4c4119f10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.866+0000 7fc4c9671700 1 --2- 172.21.15.26:0/1678917060 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4c409e410 0x7fc4c411a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:10.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.866+0000 7fc4c9671700 1 -- 172.21.15.26:0/1678917060 >> 172.21.15.26:0/1678917060 conn(0x7fc4c4066f50 msgr2=0x7fc4c4131cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:10.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.866+0000 7fc4c9671700 1 -- 172.21.15.26:0/1678917060 shutdown_connections 2023-10-01T07:55:10.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:10.866+0000 7fc4c9671700 1 -- 172.21.15.26:0/1678917060 wait complete. 2023-10-01T07:55:10.880 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:11.726 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:11.809 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:11.820 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:11.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.877+0000 7fec1a0cb700 1 Processor -- start 2023-10-01T07:55:11.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.877+0000 7fec1a0cb700 1 -- start start 2023-10-01T07:55:11.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.878+0000 7fec1a0cb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fec1409e1d0 0x7fec14135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:11.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.878+0000 7fec1a0cb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fec14135e50 0x7fec14138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:11.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.878+0000 7fec1a0cb700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec1409f130 con 0x7fec1409d6f0 2023-10-01T07:55:11.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.878+0000 7fec1a0cb700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec1409f520 con 0x7fec1409e1d0 2023-10-01T07:55:11.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.878+0000 7fec1a0cb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec1409e930 con 0x7fec14135e50 2023-10-01T07:55:11.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.878+0000 7fec12ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fec1409e1d0 0x7fec14135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:11.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.878+0000 7fec12ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fec1409e1d0 0x7fec14135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53866/0 (socket says 172.21.15.26:53866) 2023-10-01T07:55:11.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.878+0000 7fec13fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fec14135e50 0x7fec14138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:11.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.878+0000 7fec137fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fec1409d6f0 0x7fec1409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54976/0 (socket says 172.21.15.26:54976) 2023-10-01T07:55:11.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.878+0000 7fec12ffd700 1 -- 172.21.15.26:0/4278096299 learned_addr learned my addr 172.21.15.26:0/4278096299 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:11.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.879+0000 7fec13fff700 1 -- 172.21.15.26:0/4278096299 >> v2:172.21.15.26:3300/0 conn(0x7fec1409e1d0 msgr2=0x7fec14135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:11.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.879+0000 7fec13fff700 1 --2- 172.21.15.26:0/4278096299 >> v2:172.21.15.26:3300/0 conn(0x7fec1409e1d0 0x7fec14135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:11.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.879+0000 7fec13fff700 1 -- 172.21.15.26:0/4278096299 >> v1:172.21.15.26:6789/0 conn(0x7fec1409d6f0 legacy=0x7fec1409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:11.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.879+0000 7fec13fff700 1 -- 172.21.15.26:0/4278096299 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1409b2d0 con 0x7fec14135e50 2023-10-01T07:55:11.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.879+0000 7fec12ffd700 1 --2- 172.21.15.26:0/4278096299 >> v2:172.21.15.26:3300/0 conn(0x7fec1409e1d0 0x7fec14135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:11.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.879+0000 7fec13fff700 1 --2- 172.21.15.26:0/4278096299 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fec14135e50 0x7fec14138230 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fec0c009d90 tx=0x7fec0c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d7f34911eae13a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:11.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.879+0000 7fec127fc700 1 -- 172.21.15.26:0/4278096299 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c00e070 con 0x7fec14135e50 2023-10-01T07:55:11.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.879+0000 7fec127fc700 1 -- 172.21.15.26:0/4278096299 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0c00bb20 con 0x7fec14135e50 2023-10-01T07:55:11.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.879+0000 7fec127fc700 1 -- 172.21.15.26:0/4278096299 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c012430 con 0x7fec14135e50 2023-10-01T07:55:11.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.880+0000 7fec1a0cb700 1 -- 172.21.15.26:0/4278096299 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fec14135e50 msgr2=0x7fec14138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:11.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.880+0000 7fec1a0cb700 1 --2- 172.21.15.26:0/4278096299 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fec14135e50 0x7fec14138230 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fec0c009d90 tx=0x7fec0c00b330 comp rx=0 tx=0).stop 2023-10-01T07:55:11.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.880+0000 7fec1a0cb700 1 -- 172.21.15.26:0/4278096299 shutdown_connections 2023-10-01T07:55:11.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.880+0000 7fec1a0cb700 1 --2- 172.21.15.26:0/4278096299 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fec14135e50 0x7fec14138230 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:11.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.880+0000 7fec1a0cb700 1 --2- 172.21.15.26:0/4278096299 >> v2:172.21.15.26:3300/0 conn(0x7fec1409e1d0 0x7fec14135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:11.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.880+0000 7fec1a0cb700 1 -- 172.21.15.26:0/4278096299 >> 172.21.15.26:0/4278096299 conn(0x7fec14066f50 msgr2=0x7fec1409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:11.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.880+0000 7fec1a0cb700 1 -- 172.21.15.26:0/4278096299 shutdown_connections 2023-10-01T07:55:11.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.880+0000 7fec1a0cb700 1 -- 172.21.15.26:0/4278096299 wait complete. 2023-10-01T07:55:11.882 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:11.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.882+0000 7fec1a0cb700 1 Processor -- start 2023-10-01T07:55:11.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.882+0000 7fec1a0cb700 1 -- start start 2023-10-01T07:55:11.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.883+0000 7fec1a0cb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec1409d6f0 0x7fec1411b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:11.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.883+0000 7fec1a0cb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fec1409e1d0 0x7fec1411b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:11.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.883+0000 7fec1a0cb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fec14135e50 0x7fec1411bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:11.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.883+0000 7fec1a0cb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1411d100 con 0x7fec1409d6f0 2023-10-01T07:55:11.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.883+0000 7fec1a0cb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1411ec20 con 0x7fec1409e1d0 2023-10-01T07:55:11.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.883+0000 7fec1a0cb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec140a1e20 con 0x7fec14135e50 2023-10-01T07:55:11.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.883+0000 7fec137fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec1409d6f0 0x7fec1411b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:11.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.883+0000 7fec12ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fec1409e1d0 0x7fec1411b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:11.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.883+0000 7fec13fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fec14135e50 0x7fec1411bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:11.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.883+0000 7fec12ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fec1409e1d0 0x7fec1411b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46198/0 (socket says 172.21.15.26:46198) 2023-10-01T07:55:11.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.883+0000 7fec137fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec1409d6f0 0x7fec1411b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53880/0 (socket says 172.21.15.26:53880) 2023-10-01T07:55:11.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.883+0000 7fec12ffd700 1 -- 172.21.15.26:0/6772670 learned_addr learned my addr 172.21.15.26:0/6772670 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:11.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.883+0000 7fec12ffd700 1 -- 172.21.15.26:0/6772670 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fec14135e50 msgr2=0x7fec1411bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:11.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.883+0000 7fec12ffd700 1 --2- 172.21.15.26:0/6772670 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fec14135e50 0x7fec1411bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:11.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.883+0000 7fec12ffd700 1 -- 172.21.15.26:0/6772670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec1409d6f0 msgr2=0x7fec1411b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:11.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.883+0000 7fec12ffd700 1 --2- 172.21.15.26:0/6772670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec1409d6f0 0x7fec1411b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:11.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.883+0000 7fec12ffd700 1 -- 172.21.15.26:0/6772670 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0800da00 con 0x7fec1409e1d0 2023-10-01T07:55:11.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.883+0000 7fec137fe700 1 --2- 172.21.15.26:0/6772670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec1409d6f0 0x7fec1411b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:11.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.883+0000 7fec13fff700 1 --2- 172.21.15.26:0/6772670 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fec14135e50 0x7fec1411bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:11.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.884+0000 7fec12ffd700 1 --2- 172.21.15.26:0/6772670 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fec1409e1d0 0x7fec1411b9c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fec08012fc0 tx=0x7fec080100c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:11.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.884+0000 7febfbfff700 1 -- 172.21.15.26:0/6772670 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec08010b50 con 0x7fec1409e1d0 2023-10-01T07:55:11.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.884+0000 7febfbfff700 1 -- 172.21.15.26:0/6772670 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec08013040 con 0x7fec1409e1d0 2023-10-01T07:55:11.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.884+0000 7febfbfff700 1 -- 172.21.15.26:0/6772670 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec08018480 con 0x7fec1409e1d0 2023-10-01T07:55:11.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.884+0000 7fec1a0cb700 1 -- 172.21.15.26:0/6772670 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec0c009a70 con 0x7fec1409e1d0 2023-10-01T07:55:11.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.884+0000 7fec1a0cb700 1 -- 172.21.15.26:0/6772670 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec1411d7a0 con 0x7fec1409e1d0 2023-10-01T07:55:11.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.885+0000 7fec1a0cb700 1 -- 172.21.15.26:0/6772670 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec14074ea0 con 0x7fec1409e1d0 2023-10-01T07:55:11.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.885+0000 7febfbfff700 1 -- 172.21.15.26:0/6772670 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fec080185e0 con 0x7fec1409e1d0 2023-10-01T07:55:11.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.886+0000 7febfbfff700 1 -- 172.21.15.26:0/6772670 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fec080441d0 con 0x7fec1409e1d0 2023-10-01T07:55:11.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.886+0000 7fec137fe700 1 -- 172.21.15.26:0/6772670 >> v1:172.21.15.26:6816/126763 conn(0x7fec0002f510 legacy=0x7fec000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:11.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.891+0000 7febfbfff700 1 -- 172.21.15.26:0/6772670 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fec080288f0 con 0x7fec1409e1d0 2023-10-01T07:55:11.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.966+0000 7fe99062a700 1 Processor -- start 2023-10-01T07:55:11.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.966+0000 7fe99062a700 1 -- start start 2023-10-01T07:55:11.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.966+0000 7fe99062a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe98809f330 0x7fe988138e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:11.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.966+0000 7fe99062a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe988139370 0x7fe98813b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:11.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.967+0000 7fe99062a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe98806bec0 con 0x7fe98809e850 2023-10-01T07:55:11.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.967+0000 7fe99062a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe98806bce0 con 0x7fe988139370 2023-10-01T07:55:11.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.967+0000 7fe99062a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe98806caa0 con 0x7fe98809f330 2023-10-01T07:55:11.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.967+0000 7fe98dbc5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe98809f330 0x7fe988138e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:11.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.967+0000 7fe98dbc5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe98809f330 0x7fe988138e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35980/0 (socket says 172.21.15.26:35980) 2023-10-01T07:55:11.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.967+0000 7fe98dbc5700 1 -- 172.21.15.26:0/922820127 learned_addr learned my addr 172.21.15.26:0/922820127 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:11.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.967+0000 7fe98ebc7700 1 --2- 172.21.15.26:0/922820127 >> v2:172.21.15.26:3300/0 conn(0x7fe988139370 0x7fe98813b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:11.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.967+0000 7fe98dbc5700 1 -- 172.21.15.26:0/922820127 >> v2:172.21.15.26:3300/0 conn(0x7fe988139370 msgr2=0x7fe98813b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:11.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.967+0000 7fe98dbc5700 1 --2- 172.21.15.26:0/922820127 >> v2:172.21.15.26:3300/0 conn(0x7fe988139370 0x7fe98813b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:11.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.967+0000 7fe98dbc5700 1 -- 172.21.15.26:0/922820127 >> v1:172.21.15.26:6789/0 conn(0x7fe98809e850 legacy=0x7fe98809ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:11.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.967+0000 7fe98dbc5700 1 -- 172.21.15.26:0/922820127 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9880a00a0 con 0x7fe98809f330 2023-10-01T07:55:11.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.967+0000 7fe98dbc5700 1 --2- 172.21.15.26:0/922820127 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe98809f330 0x7fe988138e30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe9780098f0 tx=0x7fe978009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fca0f4dd63d7f5cc server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:11.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.968+0000 7fe98d3c4700 1 -- 172.21.15.26:0/922820127 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe978011830 con 0x7fe98809f330 2023-10-01T07:55:11.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.968+0000 7fe98d3c4700 1 -- 172.21.15.26:0/922820127 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe978011990 con 0x7fe98809f330 2023-10-01T07:55:11.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.968+0000 7fe98d3c4700 1 -- 172.21.15.26:0/922820127 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe978011d20 con 0x7fe98809f330 2023-10-01T07:55:11.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.969+0000 7fe99062a700 1 -- 172.21.15.26:0/922820127 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe98809f330 msgr2=0x7fe988138e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:11.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.969+0000 7fe99062a700 1 --2- 172.21.15.26:0/922820127 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe98809f330 0x7fe988138e30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe9780098f0 tx=0x7fe978009c00 comp rx=0 tx=0).stop 2023-10-01T07:55:11.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.969+0000 7fe99062a700 1 -- 172.21.15.26:0/922820127 shutdown_connections 2023-10-01T07:55:11.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.969+0000 7fe99062a700 1 --2- 172.21.15.26:0/922820127 >> v2:172.21.15.26:3300/0 conn(0x7fe988139370 0x7fe98813b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:11.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.969+0000 7fe99062a700 1 --2- 172.21.15.26:0/922820127 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe98809f330 0x7fe988138e30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:11.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.969+0000 7fe99062a700 1 -- 172.21.15.26:0/922820127 >> 172.21.15.26:0/922820127 conn(0x7fe9880a3f70 msgr2=0x7fe9880a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:11.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.969+0000 7fe99062a700 1 -- 172.21.15.26:0/922820127 shutdown_connections 2023-10-01T07:55:11.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.969+0000 7fe99062a700 1 -- 172.21.15.26:0/922820127 wait complete. 2023-10-01T07:55:11.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.970+0000 7fe99062a700 1 Processor -- start 2023-10-01T07:55:11.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.971+0000 7fe99062a700 1 -- start start 2023-10-01T07:55:11.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.971+0000 7fe99062a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe98809e850 0x7fe9881c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:11.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.971+0000 7fe99062a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe98809f330 0x7fe9881c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:11.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.971+0000 7fe99062a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe988139370 0x7fe98811ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:11.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.971+0000 7fe99062a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe988122690 con 0x7fe98809f330 2023-10-01T07:55:11.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.971+0000 7fe99062a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98806ccc0 con 0x7fe988139370 2023-10-01T07:55:11.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.971+0000 7fe99062a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9881be5d0 con 0x7fe98809e850 2023-10-01T07:55:11.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.971+0000 7fe98e3c6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe98809e850 0x7fe9881c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:11.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.972+0000 7fe98e3c6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe98809e850 0x7fe9881c8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35986/0 (socket says 172.21.15.26:35986) 2023-10-01T07:55:11.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.972+0000 7fe98e3c6700 1 -- 172.21.15.26:0/3889999066 learned_addr learned my addr 172.21.15.26:0/3889999066 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:11.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.972+0000 7fe98ebc7700 1 --2- 172.21.15.26:0/3889999066 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe988139370 0x7fe98811ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:11.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.972+0000 7fe98dbc5700 1 --2- 172.21.15.26:0/3889999066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe98809f330 0x7fe9881c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:11.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.972+0000 7fe98e3c6700 1 -- 172.21.15.26:0/3889999066 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe988139370 msgr2=0x7fe98811ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:11.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.972+0000 7fe98e3c6700 1 --2- 172.21.15.26:0/3889999066 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe988139370 0x7fe98811ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:11.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.972+0000 7fe98e3c6700 1 -- 172.21.15.26:0/3889999066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe98809f330 msgr2=0x7fe9881c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:11.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.972+0000 7fe98e3c6700 1 --2- 172.21.15.26:0/3889999066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe98809f330 0x7fe9881c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:11.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.972+0000 7fe98e3c6700 1 -- 172.21.15.26:0/3889999066 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe978009550 con 0x7fe98809e850 2023-10-01T07:55:11.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.972+0000 7fe98dbc5700 1 --2- 172.21.15.26:0/3889999066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe98809f330 0x7fe9881c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:55:11.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.972+0000 7fe98e3c6700 1 --2- 172.21.15.26:0/3889999066 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe98809e850 0x7fe9881c8a20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe98400c450 tx=0x7fe98400c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:11.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.972+0000 7fe97effd700 1 -- 172.21.15.26:0/3889999066 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9840052d0 con 0x7fe98809e850 2023-10-01T07:55:11.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.972+0000 7fe97effd700 1 -- 172.21.15.26:0/3889999066 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe984005430 con 0x7fe98809e850 2023-10-01T07:55:11.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.972+0000 7fe97effd700 1 -- 172.21.15.26:0/3889999066 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9840038c0 con 0x7fe98809e850 2023-10-01T07:55:11.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.972+0000 7fe99062a700 1 -- 172.21.15.26:0/3889999066 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe988134940 con 0x7fe98809e850 2023-10-01T07:55:11.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.973+0000 7fe99062a700 1 -- 172.21.15.26:0/3889999066 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe988122d20 con 0x7fe98809e850 2023-10-01T07:55:11.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.974+0000 7fe99062a700 1 -- 172.21.15.26:0/3889999066 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9880747f0 con 0x7fe98809e850 2023-10-01T07:55:11.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.975+0000 7fe97effd700 1 -- 172.21.15.26:0/3889999066 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe984003a20 con 0x7fe98809e850 2023-10-01T07:55:11.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.975+0000 7fe98dbc5700 1 -- 172.21.15.26:0/3889999066 >> v1:172.21.15.26:6816/126763 conn(0x7fe96c02f510 legacy=0x7fe96c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:11.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.976+0000 7fe97effd700 1 -- 172.21.15.26:0/3889999066 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fe984010cb0 con 0x7fe98809e850 2023-10-01T07:55:11.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:11.984+0000 7fe97effd700 1 -- 172.21.15.26:0/3889999066 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe9840192c0 con 0x7fe98809e850 2023-10-01T07:55:12.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.006+0000 7f9575b45700 1 Processor -- start 2023-10-01T07:55:12.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.006+0000 7f9575b45700 1 -- start start 2023-10-01T07:55:12.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.007+0000 7f9575b45700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f957009e1d0 0x7f9570135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:12.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.007+0000 7f9575b45700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9570135e50 0x7f9570138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:12.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.007+0000 7f9575b45700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f957009f130 con 0x7f957009d6f0 2023-10-01T07:55:12.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.007+0000 7f9575b45700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f957009f520 con 0x7f957009e1d0 2023-10-01T07:55:12.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.007+0000 7f9575b45700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f957009e930 con 0x7f9570135e50 2023-10-01T07:55:12.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.008+0000 7f956f7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f957009d6f0 0x7f957009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:55004/0 (socket says 172.21.15.26:55004) 2023-10-01T07:55:12.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.008+0000 7f956f7fe700 1 -- 172.21.15.26:0/741576388 learned_addr learned my addr 172.21.15.26:0/741576388 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:12.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.008+0000 7f956effd700 1 --2- 172.21.15.26:0/741576388 >> v2:172.21.15.26:3300/0 conn(0x7f957009e1d0 0x7f9570135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:12.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.008+0000 7f956ffff700 1 --2- 172.21.15.26:0/741576388 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9570135e50 0x7f9570138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:12.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.008+0000 7f956e7fc700 1 -- 172.21.15.26:0/741576388 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2418645160 0 0) 0x7f957009f130 con 0x7f957009d6f0 2023-10-01T07:55:12.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.008+0000 7f956e7fc700 1 -- 172.21.15.26:0/741576388 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95580035b0 con 0x7f957009d6f0 2023-10-01T07:55:12.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.008+0000 7f956effd700 1 -- 172.21.15.26:0/741576388 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9570135e50 msgr2=0x7f9570138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:12.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.008+0000 7f956effd700 1 --2- 172.21.15.26:0/741576388 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9570135e50 0x7f9570138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:12.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.008+0000 7f956effd700 1 -- 172.21.15.26:0/741576388 >> v1:172.21.15.26:6789/0 conn(0x7f957009d6f0 legacy=0x7f957009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:12.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.008+0000 7f956effd700 1 -- 172.21.15.26:0/741576388 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f957009b2d0 con 0x7f957009e1d0 2023-10-01T07:55:12.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.008+0000 7f956ffff700 1 --2- 172.21.15.26:0/741576388 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9570135e50 0x7f9570138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:12.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.008+0000 7f956effd700 1 --2- 172.21.15.26:0/741576388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f957009e1d0 0x7f9570135910 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9564009840 tx=0x7f9564009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9d05c7a55913d4b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:12.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.009+0000 7f956e7fc700 1 -- 172.21.15.26:0/741576388 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9564011830 con 0x7f957009e1d0 2023-10-01T07:55:12.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.009+0000 7f956e7fc700 1 -- 172.21.15.26:0/741576388 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9564011990 con 0x7f957009e1d0 2023-10-01T07:55:12.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.009+0000 7f956e7fc700 1 -- 172.21.15.26:0/741576388 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9564011d20 con 0x7f957009e1d0 2023-10-01T07:55:12.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.009+0000 7f9575b45700 1 -- 172.21.15.26:0/741576388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f957009e1d0 msgr2=0x7f9570135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:12.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.009+0000 7f9575b45700 1 --2- 172.21.15.26:0/741576388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f957009e1d0 0x7f9570135910 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9564009840 tx=0x7f9564009b50 comp rx=0 tx=0).stop 2023-10-01T07:55:12.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.009+0000 7f9575b45700 1 -- 172.21.15.26:0/741576388 shutdown_connections 2023-10-01T07:55:12.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.009+0000 7f9575b45700 1 --2- 172.21.15.26:0/741576388 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9570135e50 0x7f9570138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:12.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.009+0000 7f9575b45700 1 --2- 172.21.15.26:0/741576388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f957009e1d0 0x7f9570135910 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:12.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.009+0000 7f9575b45700 1 -- 172.21.15.26:0/741576388 >> 172.21.15.26:0/741576388 conn(0x7f9570066f50 msgr2=0x7f957009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:12.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.010+0000 7f9575b45700 1 -- 172.21.15.26:0/741576388 shutdown_connections 2023-10-01T07:55:12.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.010+0000 7f9575b45700 1 -- 172.21.15.26:0/741576388 wait complete. 2023-10-01T07:55:12.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.011+0000 7f9575b45700 1 Processor -- start 2023-10-01T07:55:12.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.011+0000 7f9575b45700 1 -- start start 2023-10-01T07:55:12.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.012+0000 7f9575b45700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f957009d6f0 0x7f9570119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:12.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.012+0000 7f9575b45700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f957009e1d0 0x7f95701199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:12.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.012+0000 7f9575b45700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9570135e50 0x7f9570119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:12.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.012+0000 7f9575b45700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957011c8e0 con 0x7f9570135e50 2023-10-01T07:55:12.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.012+0000 7f9575b45700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f957011ceb0 con 0x7f957009d6f0 2023-10-01T07:55:12.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.012+0000 7f9575b45700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f957012fbc0 con 0x7f957009e1d0 2023-10-01T07:55:12.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.012+0000 7f956f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f957009d6f0 0x7f9570119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:12.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.012+0000 7f956f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f957009d6f0 0x7f9570119480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46214/0 (socket says 172.21.15.26:46214) 2023-10-01T07:55:12.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.012+0000 7f956f7fe700 1 -- 172.21.15.26:0/1737190501 learned_addr learned my addr 172.21.15.26:0/1737190501 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:12.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.012+0000 7f956effd700 1 --2- 172.21.15.26:0/1737190501 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f957009e1d0 0x7f95701199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:12.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.012+0000 7f956ffff700 1 --2- 172.21.15.26:0/1737190501 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9570135e50 0x7f9570119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:12.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.013+0000 7f956effd700 1 -- 172.21.15.26:0/1737190501 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f957009d6f0 msgr2=0x7f9570119480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:12.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.013+0000 7f956effd700 1 --2- 172.21.15.26:0/1737190501 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f957009d6f0 0x7f9570119480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:12.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.013+0000 7f956effd700 1 -- 172.21.15.26:0/1737190501 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9570135e50 msgr2=0x7f9570119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:12.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.013+0000 7f956effd700 1 --2- 172.21.15.26:0/1737190501 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9570135e50 0x7f9570119f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:12.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.013+0000 7f956effd700 1 -- 172.21.15.26:0/1737190501 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9568009a70 con 0x7f957009e1d0 2023-10-01T07:55:12.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.013+0000 7f956f7fe700 1 --2- 172.21.15.26:0/1737190501 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f957009d6f0 0x7f9570119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:12.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.013+0000 7f956effd700 1 --2- 172.21.15.26:0/1737190501 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f957009e1d0 0x7f95701199c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f957009f6f0 tx=0x7f9564004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:12.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.013+0000 7f9557fff700 1 -- 172.21.15.26:0/1737190501 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9564004550 con 0x7f957009e1d0 2023-10-01T07:55:12.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.013+0000 7f9557fff700 1 -- 172.21.15.26:0/1737190501 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956401d7c0 con 0x7f957009e1d0 2023-10-01T07:55:12.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.013+0000 7f9575b45700 1 -- 172.21.15.26:0/1737190501 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95640094a0 con 0x7f957009e1d0 2023-10-01T07:55:12.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.013+0000 7f9575b45700 1 -- 172.21.15.26:0/1737190501 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9570072670 con 0x7f957009e1d0 2023-10-01T07:55:12.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.013+0000 7f9557fff700 1 -- 172.21.15.26:0/1737190501 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956401db70 con 0x7f957009e1d0 2023-10-01T07:55:12.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.014+0000 7f9557fff700 1 -- 172.21.15.26:0/1737190501 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f956401dcd0 con 0x7f957009e1d0 2023-10-01T07:55:12.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.014+0000 7f9557fff700 1 -- 172.21.15.26:0/1737190501 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f9564044c80 con 0x7f957009e1d0 2023-10-01T07:55:12.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.015+0000 7f956f7fe700 1 -- 172.21.15.26:0/1737190501 >> v1:172.21.15.26:6816/126763 conn(0x7f955c02f510 legacy=0x7f955c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:12.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.015+0000 7f9575b45700 1 -- 172.21.15.26:0/1737190501 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95500052e0 con 0x7f957009e1d0 2023-10-01T07:55:12.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.020+0000 7f9557fff700 1 -- 172.21.15.26:0/1737190501 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9564015020 con 0x7f957009e1d0 2023-10-01T07:55:12.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.036+0000 7f25fa2a0700 1 Processor -- start 2023-10-01T07:55:12.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.036+0000 7f25fa2a0700 1 -- start start 2023-10-01T07:55:12.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.037+0000 7f25fa2a0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25f406c0e0 0x7f25f409ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:12.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.037+0000 7f25fa2a0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f25f4134ec0 0x7f25f41379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:12.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.037+0000 7f25fa2a0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f4137f20 0x7f25f41383c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:12.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.037+0000 7f25fa2a0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f406c4b0 con 0x7f25f4134ec0 2023-10-01T07:55:12.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.037+0000 7f25fa2a0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f40a09c0 con 0x7f25f406c0e0 2023-10-01T07:55:12.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.037+0000 7f25fa2a0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25f4134980 con 0x7f25f4137f20 2023-10-01T07:55:12.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.037+0000 7f25f37fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f25f4134ec0 0x7f25f41379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:12.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.037+0000 7f25f37fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f25f4134ec0 0x7f25f41379e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53918/0 (socket says 172.21.15.26:53918) 2023-10-01T07:55:12.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.037+0000 7f25f37fe700 1 -- 172.21.15.26:0/122451659 learned_addr learned my addr 172.21.15.26:0/122451659 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:12.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.038+0000 7f25f3fff700 1 --2- 172.21.15.26:0/122451659 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25f406c0e0 0x7f25f409ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:12.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.038+0000 7f25f883d700 1 --2- 172.21.15.26:0/122451659 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f4137f20 0x7f25f41383c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:12.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.038+0000 7f25f37fe700 1 -- 172.21.15.26:0/122451659 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f4137f20 msgr2=0x7f25f41383c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:12.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.038+0000 7f25f37fe700 1 --2- 172.21.15.26:0/122451659 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f4137f20 0x7f25f41383c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:12.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.038+0000 7f25f37fe700 1 -- 172.21.15.26:0/122451659 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25f406c0e0 msgr2=0x7f25f409ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:12.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.038+0000 7f25f37fe700 1 --2- 172.21.15.26:0/122451659 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25f406c0e0 0x7f25f409ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:12.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.038+0000 7f25f37fe700 1 -- 172.21.15.26:0/122451659 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f40a0600 con 0x7f25f4134ec0 2023-10-01T07:55:12.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.038+0000 7f25f37fe700 1 --2- 172.21.15.26:0/122451659 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f4134ec0 0x7f25f41379e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f25e80098f0 tx=0x7f25e8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760aa69a1256b7d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:12.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.038+0000 7f25f2ffd700 1 -- 172.21.15.26:0/122451659 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e8011830 con 0x7f25f4134ec0 2023-10-01T07:55:12.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.038+0000 7f25f2ffd700 1 -- 172.21.15.26:0/122451659 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e8011990 con 0x7f25f4134ec0 2023-10-01T07:55:12.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.038+0000 7f25f2ffd700 1 -- 172.21.15.26:0/122451659 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e8011d20 con 0x7f25f4134ec0 2023-10-01T07:55:12.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.039+0000 7f25fa2a0700 1 -- 172.21.15.26:0/122451659 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f4134ec0 msgr2=0x7f25f41379e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:12.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.039+0000 7f25fa2a0700 1 --2- 172.21.15.26:0/122451659 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f4134ec0 0x7f25f41379e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f25e80098f0 tx=0x7f25e8009c00 comp rx=0 tx=0).stop 2023-10-01T07:55:12.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.039+0000 7f25fa2a0700 1 -- 172.21.15.26:0/122451659 shutdown_connections 2023-10-01T07:55:12.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.039+0000 7f25fa2a0700 1 --2- 172.21.15.26:0/122451659 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f4137f20 0x7f25f41383c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:12.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.039+0000 7f25fa2a0700 1 --2- 172.21.15.26:0/122451659 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25f406c0e0 0x7f25f409ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:12.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.039+0000 7f25fa2a0700 1 --2- 172.21.15.26:0/122451659 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f4134ec0 0x7f25f41379e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:12.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.039+0000 7f25fa2a0700 1 -- 172.21.15.26:0/122451659 >> 172.21.15.26:0/122451659 conn(0x7f25f40a4210 msgr2=0x7f25f40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:12.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.039+0000 7f25fa2a0700 1 -- 172.21.15.26:0/122451659 shutdown_connections 2023-10-01T07:55:12.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.039+0000 7f25fa2a0700 1 -- 172.21.15.26:0/122451659 wait complete. 2023-10-01T07:55:12.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.040+0000 7f25fa2a0700 1 Processor -- start 2023-10-01T07:55:12.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.040+0000 7f25fa2a0700 1 -- start start 2023-10-01T07:55:12.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.041+0000 7f25fa2a0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f406c0e0 0x7f25f41ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:12.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.041+0000 7f25fa2a0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25f4134ec0 0x7f25f41cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:12.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.041+0000 7f25fa2a0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f4137f20 0x7f25f411a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:12.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.041+0000 7f25fa2a0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f4127420 con 0x7f25f4137f20 2023-10-01T07:55:12.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.041+0000 7f25fa2a0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f411d950 con 0x7f25f4134ec0 2023-10-01T07:55:12.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.041+0000 7f25fa2a0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25f40a03f0 con 0x7f25f406c0e0 2023-10-01T07:55:12.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.041+0000 7f25f37fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25f4134ec0 0x7f25f41cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:12.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.041+0000 7f25f37fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25f4134ec0 0x7f25f41cd2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46234/0 (socket says 172.21.15.26:46234) 2023-10-01T07:55:12.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.041+0000 7f25f37fe700 1 -- 172.21.15.26:0/3069059411 learned_addr learned my addr 172.21.15.26:0/3069059411 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:12.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.041+0000 7f25f883d700 1 --2- 172.21.15.26:0/3069059411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f4137f20 0x7f25f411a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:12.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.041+0000 7f25f3fff700 1 --2- 172.21.15.26:0/3069059411 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f406c0e0 0x7f25f41ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:12.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.042+0000 7f25f37fe700 1 -- 172.21.15.26:0/3069059411 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f406c0e0 msgr2=0x7f25f41ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:12.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.042+0000 7f25f37fe700 1 --2- 172.21.15.26:0/3069059411 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f406c0e0 0x7f25f41ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:12.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.042+0000 7f25f37fe700 1 -- 172.21.15.26:0/3069059411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f4137f20 msgr2=0x7f25f411a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:12.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.042+0000 7f25f37fe700 1 --2- 172.21.15.26:0/3069059411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f4137f20 0x7f25f411a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:12.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.042+0000 7f25f37fe700 1 -- 172.21.15.26:0/3069059411 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e8009550 con 0x7f25f4134ec0 2023-10-01T07:55:12.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.042+0000 7f25f37fe700 1 --2- 172.21.15.26:0/3069059411 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25f4134ec0 0x7f25f41cd2e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f25e8000c00 tx=0x7f25e8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:12.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.042+0000 7f25f0ff9700 1 -- 172.21.15.26:0/3069059411 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e8004450 con 0x7f25f4134ec0 2023-10-01T07:55:12.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.042+0000 7f25f0ff9700 1 -- 172.21.15.26:0/3069059411 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e80045b0 con 0x7f25f4134ec0 2023-10-01T07:55:12.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.042+0000 7f25fa2a0700 1 -- 172.21.15.26:0/3069059411 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f4133f10 con 0x7f25f4134ec0 2023-10-01T07:55:12.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.042+0000 7f25f0ff9700 1 -- 172.21.15.26:0/3069059411 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e80038e0 con 0x7f25f4134ec0 2023-10-01T07:55:12.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.042+0000 7f25fa2a0700 1 -- 172.21.15.26:0/3069059411 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f411e3f0 con 0x7f25f4134ec0 2023-10-01T07:55:12.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.043+0000 7f25fa2a0700 1 -- 172.21.15.26:0/3069059411 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f4074ea0 con 0x7f25f4134ec0 2023-10-01T07:55:12.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.044+0000 7f25f0ff9700 1 -- 172.21.15.26:0/3069059411 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f25e8021070 con 0x7f25f4134ec0 2023-10-01T07:55:12.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.044+0000 7f25f0ff9700 1 -- 172.21.15.26:0/3069059411 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f25e80411c0 con 0x7f25f4134ec0 2023-10-01T07:55:12.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.044+0000 7f25f3fff700 1 -- 172.21.15.26:0/3069059411 >> v1:172.21.15.26:6816/126763 conn(0x7f25e002f540 legacy=0x7f25e00319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:12.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.049+0000 7f25f0ff9700 1 -- 172.21.15.26:0/3069059411 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25e8019770 con 0x7f25f4134ec0 2023-10-01T07:55:12.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.087+0000 7fec137fe700 1 -- 172.21.15.26:0/6772670 >> v1:172.21.15.26:6816/126763 conn(0x7fec0002f510 legacy=0x7fec000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:12.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.173+0000 7fec1a0cb700 1 -- 172.21.15.26:0/6772670 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fec1406c360 con 0x7fec1409e1d0 2023-10-01T07:55:12.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.174+0000 7febfbfff700 1 -- 172.21.15.26:0/6772670 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fec08028300 con 0x7fec1409e1d0 2023-10-01T07:55:12.174 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:12.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.176+0000 7fe98dbc5700 1 -- 172.21.15.26:0/3889999066 >> v1:172.21.15.26:6816/126763 conn(0x7fe96c02f510 legacy=0x7fe96c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:12.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.177+0000 7fec1a0cb700 1 -- 172.21.15.26:0/6772670 >> v1:172.21.15.26:6816/126763 conn(0x7fec0002f510 legacy=0x7fec000319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:12.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.177+0000 7fec1a0cb700 1 -- 172.21.15.26:0/6772670 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fec1409e1d0 msgr2=0x7fec1411b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:12.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.177+0000 7fec1a0cb700 1 --2- 172.21.15.26:0/6772670 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fec1409e1d0 0x7fec1411b9c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fec08012fc0 tx=0x7fec080100c0 comp rx=0 tx=0).stop 2023-10-01T07:55:12.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.177+0000 7fec1a0cb700 1 -- 172.21.15.26:0/6772670 shutdown_connections 2023-10-01T07:55:12.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.177+0000 7fec1a0cb700 1 --2- 172.21.15.26:0/6772670 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fec14135e50 0x7fec1411bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:12.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.177+0000 7fec1a0cb700 1 --2- 172.21.15.26:0/6772670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec1409d6f0 0x7fec1411b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:12.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.177+0000 7fec1a0cb700 1 --2- 172.21.15.26:0/6772670 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fec1409e1d0 0x7fec1411b9c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:12.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.177+0000 7fec1a0cb700 1 -- 172.21.15.26:0/6772670 >> 172.21.15.26:0/6772670 conn(0x7fec14066f50 msgr2=0x7fec140a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:12.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.177+0000 7fec1a0cb700 1 -- 172.21.15.26:0/6772670 shutdown_connections 2023-10-01T07:55:12.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.178+0000 7fec1a0cb700 1 -- 172.21.15.26:0/6772670 wait complete. 2023-10-01T07:55:12.192 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:12.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.194+0000 7fe99062a700 1 -- 172.21.15.26:0/3889999066 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe988072820 con 0x7fe98809e850 2023-10-01T07:55:12.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.194+0000 7fe97effd700 1 -- 172.21.15.26:0/3889999066 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe984017090 con 0x7fe98809e850 2023-10-01T07:55:12.195 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:12.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.196+0000 7fe99062a700 1 -- 172.21.15.26:0/3889999066 >> v1:172.21.15.26:6816/126763 conn(0x7fe96c02f510 legacy=0x7fe96c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:12.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.196+0000 7fe99062a700 1 -- 172.21.15.26:0/3889999066 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe98809e850 msgr2=0x7fe9881c8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:12.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.196+0000 7fe99062a700 1 --2- 172.21.15.26:0/3889999066 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe98809e850 0x7fe9881c8a20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe98400c450 tx=0x7fe98400c810 comp rx=0 tx=0).stop 2023-10-01T07:55:12.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.197+0000 7fe99062a700 1 -- 172.21.15.26:0/3889999066 shutdown_connections 2023-10-01T07:55:12.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.197+0000 7fe99062a700 1 --2- 172.21.15.26:0/3889999066 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe988139370 0x7fe98811ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:12.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.197+0000 7fe99062a700 1 --2- 172.21.15.26:0/3889999066 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe98809e850 0x7fe9881c8a20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:12.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.197+0000 7fe99062a700 1 --2- 172.21.15.26:0/3889999066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe98809f330 0x7fe9881c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:12.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.197+0000 7fe99062a700 1 -- 172.21.15.26:0/3889999066 >> 172.21.15.26:0/3889999066 conn(0x7fe9880a3f70 msgr2=0x7fe988070fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:12.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.197+0000 7fe99062a700 1 -- 172.21.15.26:0/3889999066 shutdown_connections 2023-10-01T07:55:12.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.197+0000 7fe99062a700 1 -- 172.21.15.26:0/3889999066 wait complete. 2023-10-01T07:55:12.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:12.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.216+0000 7f956f7fe700 1 -- 172.21.15.26:0/1737190501 >> v1:172.21.15.26:6816/126763 conn(0x7f955c02f510 legacy=0x7f955c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:12.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.245+0000 7f25f3fff700 1 -- 172.21.15.26:0/3069059411 >> v1:172.21.15.26:6816/126763 conn(0x7f25e002f540 legacy=0x7f25e00319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:12.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.259+0000 7f25fa2a0700 1 -- 172.21.15.26:0/3069059411 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f25f4134150 con 0x7f25f4134ec0 2023-10-01T07:55:12.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.260+0000 7f25f0ff9700 1 -- 172.21.15.26:0/3069059411 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f25e8015030 con 0x7f25f4134ec0 2023-10-01T07:55:12.260 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:12.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.262+0000 7f25fa2a0700 1 -- 172.21.15.26:0/3069059411 >> v1:172.21.15.26:6816/126763 conn(0x7f25e002f540 legacy=0x7f25e00319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:12.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.262+0000 7f25fa2a0700 1 -- 172.21.15.26:0/3069059411 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25f4134ec0 msgr2=0x7f25f41cd2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:12.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.262+0000 7f25fa2a0700 1 --2- 172.21.15.26:0/3069059411 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25f4134ec0 0x7f25f41cd2e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f25e8000c00 tx=0x7f25e8004750 comp rx=0 tx=0).stop 2023-10-01T07:55:12.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.262+0000 7f25fa2a0700 1 -- 172.21.15.26:0/3069059411 shutdown_connections 2023-10-01T07:55:12.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.262+0000 7f25fa2a0700 1 --2- 172.21.15.26:0/3069059411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f4137f20 0x7f25f411a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:12.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.262+0000 7f25fa2a0700 1 --2- 172.21.15.26:0/3069059411 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f406c0e0 0x7f25f41ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:12.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.262+0000 7f25fa2a0700 1 --2- 172.21.15.26:0/3069059411 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25f4134ec0 0x7f25f41cd2e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:12.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.262+0000 7f25fa2a0700 1 -- 172.21.15.26:0/3069059411 >> 172.21.15.26:0/3069059411 conn(0x7f25f40a4210 msgr2=0x7f25f4099c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:12.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.262+0000 7f25fa2a0700 1 -- 172.21.15.26:0/3069059411 shutdown_connections 2023-10-01T07:55:12.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.262+0000 7f25fa2a0700 1 -- 172.21.15.26:0/3069059411 wait complete. 2023-10-01T07:55:12.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:12.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.276+0000 7f9575b45700 1 -- 172.21.15.26:0/1737190501 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9550005860 con 0x7f957009e1d0 2023-10-01T07:55:12.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.276+0000 7f9557fff700 1 -- 172.21.15.26:0/1737190501 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9564030450 con 0x7f957009e1d0 2023-10-01T07:55:12.277 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:12.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.278+0000 7f9575b45700 1 -- 172.21.15.26:0/1737190501 >> v1:172.21.15.26:6816/126763 conn(0x7f955c02f510 legacy=0x7f955c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:12.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.278+0000 7f9575b45700 1 -- 172.21.15.26:0/1737190501 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f957009e1d0 msgr2=0x7f95701199c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:12.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.278+0000 7f9575b45700 1 --2- 172.21.15.26:0/1737190501 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f957009e1d0 0x7f95701199c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f957009f6f0 tx=0x7f9564004750 comp rx=0 tx=0).stop 2023-10-01T07:55:12.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.278+0000 7f9575b45700 1 -- 172.21.15.26:0/1737190501 shutdown_connections 2023-10-01T07:55:12.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.278+0000 7f9575b45700 1 --2- 172.21.15.26:0/1737190501 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9570135e50 0x7f9570119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:12.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.278+0000 7f9575b45700 1 --2- 172.21.15.26:0/1737190501 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f957009d6f0 0x7f9570119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:12.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.278+0000 7f9575b45700 1 --2- 172.21.15.26:0/1737190501 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f957009e1d0 0x7f95701199c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:12.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.278+0000 7f9575b45700 1 -- 172.21.15.26:0/1737190501 >> 172.21.15.26:0/1737190501 conn(0x7f9570066f50 msgr2=0x7f95700a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:12.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.279+0000 7f9575b45700 1 -- 172.21.15.26:0/1737190501 shutdown_connections 2023-10-01T07:55:12.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:12.279+0000 7f9575b45700 1 -- 172.21.15.26:0/1737190501 wait complete. 2023-10-01T07:55:12.292 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:13.193 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:13.212 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:13.278 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:13.293 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:13.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.349+0000 7f3792bf1700 1 Processor -- start 2023-10-01T07:55:13.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.349+0000 7f3792bf1700 1 -- start start 2023-10-01T07:55:13.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.350+0000 7f3792bf1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f378c133420 0x7f378c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:13.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.350+0000 7f3792bf1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f378c133e30 0x7f378c12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:13.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.350+0000 7f3792bf1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f378c134260 0x7f378c1304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:13.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.350+0000 7f3792bf1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f378c06b990 con 0x7f378c134260 2023-10-01T07:55:13.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.350+0000 7f3792bf1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f378c0a0590 con 0x7f378c133e30 2023-10-01T07:55:13.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.350+0000 7f3792bf1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f378c09fb80 con 0x7f378c133420 2023-10-01T07:55:13.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.350+0000 7f379098d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f378c133420 0x7f378c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:13.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.350+0000 7f379098d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f378c133420 0x7f378c1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:36016/0 (socket says 172.21.15.26:36016) 2023-10-01T07:55:13.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.350+0000 7f378bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f378c133e30 0x7f378c12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:13.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.350+0000 7f379098d700 1 -- 172.21.15.26:0/235701493 learned_addr learned my addr 172.21.15.26:0/235701493 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:13.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.350+0000 7f379118e700 1 --2- 172.21.15.26:0/235701493 >> v2:172.21.15.26:3300/0 conn(0x7f378c134260 0x7f378c1304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:13.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.351+0000 7f379118e700 1 -- 172.21.15.26:0/235701493 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f378c133420 msgr2=0x7f378c1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:13.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.351+0000 7f379118e700 1 --2- 172.21.15.26:0/235701493 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f378c133420 0x7f378c1337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.351+0000 7f379118e700 1 -- 172.21.15.26:0/235701493 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f378c133e30 msgr2=0x7f378c12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:13.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.351+0000 7f379118e700 1 --2- 172.21.15.26:0/235701493 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f378c133e30 0x7f378c12ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.351+0000 7f379118e700 1 -- 172.21.15.26:0/235701493 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f378c0a0030 con 0x7f378c134260 2023-10-01T07:55:13.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.351+0000 7f378bfff700 1 --2- 172.21.15.26:0/235701493 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f378c133e30 0x7f378c12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:13.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.351+0000 7f379098d700 1 --2- 172.21.15.26:0/235701493 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f378c133420 0x7f378c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:13.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.351+0000 7f379118e700 1 --2- 172.21.15.26:0/235701493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f378c134260 0x7f378c1304d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3784009d90 tx=0x7f378400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc4316d1e01570b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:13.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.351+0000 7f378b7fe700 1 -- 172.21.15.26:0/235701493 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378400e070 con 0x7f378c134260 2023-10-01T07:55:13.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.351+0000 7f378b7fe700 1 -- 172.21.15.26:0/235701493 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378400bb20 con 0x7f378c134260 2023-10-01T07:55:13.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.351+0000 7f378b7fe700 1 -- 172.21.15.26:0/235701493 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3784012430 con 0x7f378c134260 2023-10-01T07:55:13.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.352+0000 7f3792bf1700 1 -- 172.21.15.26:0/235701493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f378c134260 msgr2=0x7f378c1304d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:13.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.352+0000 7f3792bf1700 1 --2- 172.21.15.26:0/235701493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f378c134260 0x7f378c1304d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3784009d90 tx=0x7f378400b330 comp rx=0 tx=0).stop 2023-10-01T07:55:13.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.352+0000 7f3792bf1700 1 -- 172.21.15.26:0/235701493 shutdown_connections 2023-10-01T07:55:13.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.352+0000 7f3792bf1700 1 --2- 172.21.15.26:0/235701493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f378c134260 0x7f378c1304d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.352+0000 7f3792bf1700 1 --2- 172.21.15.26:0/235701493 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f378c133420 0x7f378c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.352+0000 7f3792bf1700 1 --2- 172.21.15.26:0/235701493 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f378c133e30 0x7f378c12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.352+0000 7f3792bf1700 1 -- 172.21.15.26:0/235701493 >> 172.21.15.26:0/235701493 conn(0x7f378c0a4210 msgr2=0x7f378c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:13.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.353+0000 7f3792bf1700 1 -- 172.21.15.26:0/235701493 shutdown_connections 2023-10-01T07:55:13.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.353+0000 7f3792bf1700 1 -- 172.21.15.26:0/235701493 wait complete. 2023-10-01T07:55:13.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.354+0000 7f3792bf1700 1 Processor -- start 2023-10-01T07:55:13.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.354+0000 7f3792bf1700 1 -- start start 2023-10-01T07:55:13.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.355+0000 7f3792bf1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f378c133420 0x7f378c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:13.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.355+0000 7f3792bf1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f378c133e30 0x7f378c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:13.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.355+0000 7f3792bf1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f378c134260 0x7f378c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:13.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.355+0000 7f3792bf1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378c12d940 con 0x7f378c133420 2023-10-01T07:55:13.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.355+0000 7f3792bf1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f378c11ff20 con 0x7f378c134260 2023-10-01T07:55:13.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.355+0000 7f3792bf1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f378c120170 con 0x7f378c133e30 2023-10-01T07:55:13.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.355+0000 7f379098d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f378c133420 0x7f378c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:13.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.355+0000 7f379098d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f378c133420 0x7f378c09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53942/0 (socket says 172.21.15.26:53942) 2023-10-01T07:55:13.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.355+0000 7f379098d700 1 -- 172.21.15.26:0/2204356402 learned_addr learned my addr 172.21.15.26:0/2204356402 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:13.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.355+0000 7f379118e700 1 --2- 172.21.15.26:0/2204356402 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f378c134260 0x7f378c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:13.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.355+0000 7f378bfff700 1 --2- 172.21.15.26:0/2204356402 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f378c133e30 0x7f378c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:13.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.356+0000 7f379118e700 1 -- 172.21.15.26:0/2204356402 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f378c133e30 msgr2=0x7f378c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:13.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.356+0000 7f379118e700 1 --2- 172.21.15.26:0/2204356402 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f378c133e30 0x7f378c09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.356+0000 7f379118e700 1 -- 172.21.15.26:0/2204356402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f378c133420 msgr2=0x7f378c09c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:13.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.356+0000 7f379118e700 1 --2- 172.21.15.26:0/2204356402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f378c133420 0x7f378c09c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.356+0000 7f379118e700 1 -- 172.21.15.26:0/2204356402 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3780009550 con 0x7f378c134260 2023-10-01T07:55:13.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.356+0000 7f378bfff700 1 --2- 172.21.15.26:0/2204356402 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f378c133e30 0x7f378c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:13.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.356+0000 7f379098d700 1 --2- 172.21.15.26:0/2204356402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f378c133420 0x7f378c09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:13.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.356+0000 7f379118e700 1 --2- 172.21.15.26:0/2204356402 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f378c134260 0x7f378c09cf00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f378c09ea50 tx=0x7f3784004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:13.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.356+0000 7f37897fa700 1 -- 172.21.15.26:0/2204356402 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3784012430 con 0x7f378c134260 2023-10-01T07:55:13.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.357+0000 7f37897fa700 1 -- 172.21.15.26:0/2204356402 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3784020070 con 0x7f378c134260 2023-10-01T07:55:13.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.357+0000 7f37897fa700 1 -- 172.21.15.26:0/2204356402 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3784004280 con 0x7f378c134260 2023-10-01T07:55:13.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.357+0000 7f3792bf1700 1 -- 172.21.15.26:0/2204356402 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37780094a0 con 0x7f378c134260 2023-10-01T07:55:13.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.357+0000 7f3792bf1700 1 -- 172.21.15.26:0/2204356402 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3784009a70 con 0x7f378c134260 2023-10-01T07:55:13.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.357+0000 7f37897fa700 1 -- 172.21.15.26:0/2204356402 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f37840043e0 con 0x7f378c134260 2023-10-01T07:55:13.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.358+0000 7f37897fa700 1 -- 172.21.15.26:0/2204356402 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f3784022070 con 0x7f378c134260 2023-10-01T07:55:13.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.358+0000 7f379098d700 1 -- 172.21.15.26:0/2204356402 >> v1:172.21.15.26:6816/126763 conn(0x7f377002f510 legacy=0x7f37700319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:13.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.358+0000 7f3792bf1700 1 -- 172.21.15.26:0/2204356402 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f378c131400 con 0x7f378c134260 2023-10-01T07:55:13.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.363+0000 7f37897fa700 1 -- 172.21.15.26:0/2204356402 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f378402c080 con 0x7f378c134260 2023-10-01T07:55:13.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.395+0000 7f917b9ee700 1 Processor -- start 2023-10-01T07:55:13.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.396+0000 7f917b9ee700 1 -- start start 2023-10-01T07:55:13.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.396+0000 7f917b9ee700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f917409e1d0 0x7f9174138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:13.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.396+0000 7f917b9ee700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9174139170 0x7f917413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:13.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.396+0000 7f917b9ee700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f917409b120 con 0x7f917409d6f0 2023-10-01T07:55:13.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.396+0000 7f917b9ee700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917406b460 con 0x7f917409e1d0 2023-10-01T07:55:13.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.396+0000 7f917b9ee700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f917409a7e0 con 0x7f9174139170 2023-10-01T07:55:13.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.397+0000 7f9179f8b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9174139170 0x7f917413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:13.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.397+0000 7f9178f89700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f917409e1d0 0x7f9174138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:13.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.397+0000 7f9179f8b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9174139170 0x7f917413b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46266/0 (socket says 172.21.15.26:46266) 2023-10-01T07:55:13.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.397+0000 7f9179f8b700 1 -- 172.21.15.26:0/1089369606 learned_addr learned my addr 172.21.15.26:0/1089369606 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:13.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.397+0000 7f9179f8b700 1 -- 172.21.15.26:0/1089369606 >> v2:172.21.15.26:3300/0 conn(0x7f917409e1d0 msgr2=0x7f9174138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:13.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.397+0000 7f9179f8b700 1 --2- 172.21.15.26:0/1089369606 >> v2:172.21.15.26:3300/0 conn(0x7f917409e1d0 0x7f9174138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.397+0000 7f9179f8b700 1 -- 172.21.15.26:0/1089369606 >> v1:172.21.15.26:6789/0 conn(0x7f917409d6f0 legacy=0x7f917409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:13.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.397+0000 7f9179f8b700 1 -- 172.21.15.26:0/1089369606 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f917409a500 con 0x7f9174139170 2023-10-01T07:55:13.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.397+0000 7f9178f89700 1 --2- 172.21.15.26:0/1089369606 >> v2:172.21.15.26:3300/0 conn(0x7f917409e1d0 0x7f9174138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:13.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.397+0000 7f9179f8b700 1 --2- 172.21.15.26:0/1089369606 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9174139170 0x7f917413b550 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f916c009e80 tx=0x7f916c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d0226097c163aa7 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:13.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.397+0000 7f916bfff700 1 -- 172.21.15.26:0/1089369606 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c00e070 con 0x7f9174139170 2023-10-01T07:55:13.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.398+0000 7f916bfff700 1 -- 172.21.15.26:0/1089369606 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916c00b8d0 con 0x7f9174139170 2023-10-01T07:55:13.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.398+0000 7f916bfff700 1 -- 172.21.15.26:0/1089369606 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c00bc80 con 0x7f9174139170 2023-10-01T07:55:13.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.398+0000 7f917b9ee700 1 -- 172.21.15.26:0/1089369606 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9174139170 msgr2=0x7f917413b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:13.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.398+0000 7f917b9ee700 1 --2- 172.21.15.26:0/1089369606 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9174139170 0x7f917413b550 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f916c009e80 tx=0x7f916c00b330 comp rx=0 tx=0).stop 2023-10-01T07:55:13.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.398+0000 7f917b9ee700 1 -- 172.21.15.26:0/1089369606 shutdown_connections 2023-10-01T07:55:13.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.398+0000 7f917b9ee700 1 --2- 172.21.15.26:0/1089369606 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9174139170 0x7f917413b550 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.398+0000 7f917b9ee700 1 --2- 172.21.15.26:0/1089369606 >> v2:172.21.15.26:3300/0 conn(0x7f917409e1d0 0x7f9174138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.398+0000 7f917b9ee700 1 -- 172.21.15.26:0/1089369606 >> 172.21.15.26:0/1089369606 conn(0x7f9174066f50 msgr2=0x7f917409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:13.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.399+0000 7f917b9ee700 1 -- 172.21.15.26:0/1089369606 shutdown_connections 2023-10-01T07:55:13.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.399+0000 7f917b9ee700 1 -- 172.21.15.26:0/1089369606 wait complete. 2023-10-01T07:55:13.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.400+0000 7f917b9ee700 1 Processor -- start 2023-10-01T07:55:13.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.400+0000 7f917b9ee700 1 -- start start 2023-10-01T07:55:13.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.401+0000 7f917b9ee700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f917409d6f0 0x7f91741c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:13.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.401+0000 7f917b9ee700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f917409e1d0 0x7f91741c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:13.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.401+0000 7f917b9ee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9174139170 0x7f917411e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:13.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.401+0000 7f917b9ee700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9174122110 con 0x7f9174139170 2023-10-01T07:55:13.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.401+0000 7f917b9ee700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9174120400 con 0x7f917409e1d0 2023-10-01T07:55:13.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.401+0000 7f917b9ee700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9174121d70 con 0x7f917409d6f0 2023-10-01T07:55:13.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.401+0000 7f9178f89700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f917409e1d0 0x7f91741c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:13.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.401+0000 7f9178f89700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f917409e1d0 0x7f91741c8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46274/0 (socket says 172.21.15.26:46274) 2023-10-01T07:55:13.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.401+0000 7f9178f89700 1 -- 172.21.15.26:0/2256279298 learned_addr learned my addr 172.21.15.26:0/2256279298 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:13.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.401+0000 7f9179f8b700 1 --2- 172.21.15.26:0/2256279298 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9174139170 0x7f917411e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:13.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.401+0000 7f9178f89700 1 -- 172.21.15.26:0/2256279298 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f917409d6f0 msgr2=0x7f91741c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:13.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.401+0000 7f9178f89700 1 --2- 172.21.15.26:0/2256279298 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f917409d6f0 0x7f91741c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.401+0000 7f9178f89700 1 -- 172.21.15.26:0/2256279298 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9174139170 msgr2=0x7f917411e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:13.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.401+0000 7f9178f89700 1 --2- 172.21.15.26:0/2256279298 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9174139170 0x7f917411e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.401+0000 7f9178f89700 1 -- 172.21.15.26:0/2256279298 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91640094a0 con 0x7f917409e1d0 2023-10-01T07:55:13.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.402+0000 7f9178f89700 1 --2- 172.21.15.26:0/2256279298 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f917409e1d0 0x7f91741c8a10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f916400ebe0 tx=0x7f9164009ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:13.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.402+0000 7f9169ffb700 1 -- 172.21.15.26:0/2256279298 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916400c910 con 0x7f917409e1d0 2023-10-01T07:55:13.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.402+0000 7f9169ffb700 1 -- 172.21.15.26:0/2256279298 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916400ca70 con 0x7f917409e1d0 2023-10-01T07:55:13.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.402+0000 7f917b9ee700 1 -- 172.21.15.26:0/2256279298 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f916c009b30 con 0x7f917409e1d0 2023-10-01T07:55:13.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.402+0000 7f9169ffb700 1 -- 172.21.15.26:0/2256279298 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916400cde0 con 0x7f917409e1d0 2023-10-01T07:55:13.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.402+0000 7f917b9ee700 1 -- 172.21.15.26:0/2256279298 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9174122aa0 con 0x7f917409e1d0 2023-10-01T07:55:13.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.403+0000 7f9169ffb700 1 -- 172.21.15.26:0/2256279298 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9164013470 con 0x7f917409e1d0 2023-10-01T07:55:13.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.403+0000 7f9169ffb700 1 -- 172.21.15.26:0/2256279298 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f9164040190 con 0x7f917409e1d0 2023-10-01T07:55:13.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.404+0000 7f917978a700 1 -- 172.21.15.26:0/2256279298 >> v1:172.21.15.26:6816/126763 conn(0x7f915802f510 legacy=0x7f91580319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:13.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.404+0000 7f917b9ee700 1 -- 172.21.15.26:0/2256279298 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9174074ea0 con 0x7f917409e1d0 2023-10-01T07:55:13.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.413+0000 7f9169ffb700 1 -- 172.21.15.26:0/2256279298 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9164021080 con 0x7f917409e1d0 2023-10-01T07:55:13.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.437+0000 7fac90b1d700 1 Processor -- start 2023-10-01T07:55:13.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.437+0000 7fac90b1d700 1 -- start start 2023-10-01T07:55:13.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.437+0000 7fac90b1d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac8c133420 0x7fac8c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:13.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.437+0000 7fac90b1d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac8c133e30 0x7fac8c12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:13.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.437+0000 7fac90b1d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fac8c134260 0x7fac8c1304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:13.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.437+0000 7fac90b1d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac8c06b990 con 0x7fac8c134260 2023-10-01T07:55:13.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.437+0000 7fac90b1d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c0a0590 con 0x7fac8c133420 2023-10-01T07:55:13.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.437+0000 7fac90b1d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c09fb80 con 0x7fac8c133e30 2023-10-01T07:55:13.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.438+0000 7fac8a59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac8c133420 0x7fac8c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:13.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.438+0000 7fac8a59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac8c133420 0x7fac8c1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37386/0 (socket says 172.21.15.26:37386) 2023-10-01T07:55:13.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.438+0000 7fac8a59c700 1 -- 172.21.15.26:0/2049434895 learned_addr learned my addr 172.21.15.26:0/2049434895 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:13.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.438+0000 7fac89d9b700 1 --2- 172.21.15.26:0/2049434895 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac8c133e30 0x7fac8c12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:13.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.438+0000 7fac8ad9d700 1 --2- 172.21.15.26:0/2049434895 >> v2:172.21.15.26:3300/0 conn(0x7fac8c134260 0x7fac8c1304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:13.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.438+0000 7fac8a59c700 1 -- 172.21.15.26:0/2049434895 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac8c133e30 msgr2=0x7fac8c12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:13.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.438+0000 7fac8a59c700 1 --2- 172.21.15.26:0/2049434895 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac8c133e30 0x7fac8c12ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.438+0000 7fac8a59c700 1 -- 172.21.15.26:0/2049434895 >> v2:172.21.15.26:3300/0 conn(0x7fac8c134260 msgr2=0x7fac8c1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:13.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.438+0000 7fac8a59c700 1 --2- 172.21.15.26:0/2049434895 >> v2:172.21.15.26:3300/0 conn(0x7fac8c134260 0x7fac8c1304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.438+0000 7fac8a59c700 1 -- 172.21.15.26:0/2049434895 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac8c0a0030 con 0x7fac8c133420 2023-10-01T07:55:13.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.438+0000 7fac8a59c700 1 --2- 172.21.15.26:0/2049434895 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac8c133420 0x7fac8c1337f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fac7c0098f0 tx=0x7fac7c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8df2944e2a3abe4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:13.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.439+0000 7fac8959a700 1 -- 172.21.15.26:0/2049434895 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c011830 con 0x7fac8c133420 2023-10-01T07:55:13.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.439+0000 7fac8959a700 1 -- 172.21.15.26:0/2049434895 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7c011990 con 0x7fac8c133420 2023-10-01T07:55:13.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.439+0000 7fac8959a700 1 -- 172.21.15.26:0/2049434895 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c011d20 con 0x7fac8c133420 2023-10-01T07:55:13.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.439+0000 7fac90b1d700 1 -- 172.21.15.26:0/2049434895 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac8c133420 msgr2=0x7fac8c1337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:13.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.439+0000 7fac90b1d700 1 --2- 172.21.15.26:0/2049434895 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac8c133420 0x7fac8c1337f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fac7c0098f0 tx=0x7fac7c009c00 comp rx=0 tx=0).stop 2023-10-01T07:55:13.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.439+0000 7fac90b1d700 1 -- 172.21.15.26:0/2049434895 shutdown_connections 2023-10-01T07:55:13.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.439+0000 7fac90b1d700 1 --2- 172.21.15.26:0/2049434895 >> v2:172.21.15.26:3300/0 conn(0x7fac8c134260 0x7fac8c1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.439+0000 7fac90b1d700 1 --2- 172.21.15.26:0/2049434895 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac8c133420 0x7fac8c1337f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.439+0000 7fac90b1d700 1 --2- 172.21.15.26:0/2049434895 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac8c133e30 0x7fac8c12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.439+0000 7fac90b1d700 1 -- 172.21.15.26:0/2049434895 >> 172.21.15.26:0/2049434895 conn(0x7fac8c0a4210 msgr2=0x7fac8c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:13.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.440+0000 7fac90b1d700 1 -- 172.21.15.26:0/2049434895 shutdown_connections 2023-10-01T07:55:13.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.440+0000 7fac90b1d700 1 -- 172.21.15.26:0/2049434895 wait complete. 2023-10-01T07:55:13.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.441+0000 7fac90b1d700 1 Processor -- start 2023-10-01T07:55:13.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.441+0000 7fac90b1d700 1 -- start start 2023-10-01T07:55:13.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.442+0000 7fac90b1d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac8c133420 0x7fac8c09c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:13.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.442+0000 7fac90b1d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac8c133e30 0x7fac8c09c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:13.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.442+0000 7fac90b1d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac8c134260 0x7fac8c09cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:13.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.442+0000 7fac90b1d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c11f160 con 0x7fac8c133e30 2023-10-01T07:55:13.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.442+0000 7fac90b1d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c11fe90 con 0x7fac8c134260 2023-10-01T07:55:13.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.442+0000 7fac90b1d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c131400 con 0x7fac8c133420 2023-10-01T07:55:13.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.442+0000 7fac8a59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac8c133420 0x7fac8c09c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:13.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.442+0000 7fac8a59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac8c133420 0x7fac8c09c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:54998/0 (socket says 172.21.15.26:54998) 2023-10-01T07:55:13.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.442+0000 7fac8a59c700 1 -- 172.21.15.26:0/587853336 learned_addr learned my addr 172.21.15.26:0/587853336 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:13.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.442+0000 7fac8ad9d700 1 --2- 172.21.15.26:0/587853336 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac8c134260 0x7fac8c09cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:13.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.442+0000 7fac89d9b700 1 --2- 172.21.15.26:0/587853336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac8c133e30 0x7fac8c09c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:13.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.443+0000 7fac8ad9d700 1 -- 172.21.15.26:0/587853336 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac8c133420 msgr2=0x7fac8c09c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:13.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.443+0000 7fac8ad9d700 1 --2- 172.21.15.26:0/587853336 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac8c133420 0x7fac8c09c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.443+0000 7fac8ad9d700 1 -- 172.21.15.26:0/587853336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac8c133e30 msgr2=0x7fac8c09c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:13.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.443+0000 7fac8ad9d700 1 --2- 172.21.15.26:0/587853336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac8c133e30 0x7fac8c09c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.443+0000 7fac8ad9d700 1 -- 172.21.15.26:0/587853336 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac7c009550 con 0x7fac8c134260 2023-10-01T07:55:13.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.443+0000 7fac89d9b700 1 --2- 172.21.15.26:0/587853336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac8c133e30 0x7fac8c09c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:13.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.443+0000 7fac8a59c700 1 --2- 172.21.15.26:0/587853336 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac8c133420 0x7fac8c09c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:13.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.443+0000 7fac8ad9d700 1 --2- 172.21.15.26:0/587853336 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac8c134260 0x7fac8c09cd20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fac84009d90 tx=0x7fac8400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:13.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.443+0000 7fac7affd700 1 -- 172.21.15.26:0/587853336 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8400cc90 con 0x7fac8c134260 2023-10-01T07:55:13.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.443+0000 7fac7affd700 1 -- 172.21.15.26:0/587853336 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac8400f040 con 0x7fac8c134260 2023-10-01T07:55:13.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.443+0000 7fac90b1d700 1 -- 172.21.15.26:0/587853336 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac8c12db30 con 0x7fac8c134260 2023-10-01T07:55:13.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.444+0000 7fac7affd700 1 -- 172.21.15.26:0/587853336 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac84014480 con 0x7fac8c134260 2023-10-01T07:55:13.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.444+0000 7fac90b1d700 1 -- 172.21.15.26:0/587853336 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac8c120900 con 0x7fac8c134260 2023-10-01T07:55:13.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.445+0000 7fac90b1d700 1 -- 172.21.15.26:0/587853336 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac8c074ea0 con 0x7fac8c134260 2023-10-01T07:55:13.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.445+0000 7fac7affd700 1 -- 172.21.15.26:0/587853336 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fac840145e0 con 0x7fac8c134260 2023-10-01T07:55:13.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.446+0000 7fac7affd700 1 -- 172.21.15.26:0/587853336 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fac840404b0 con 0x7fac8c134260 2023-10-01T07:55:13.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.446+0000 7fac8a59c700 1 -- 172.21.15.26:0/587853336 >> v1:172.21.15.26:6816/126763 conn(0x7fac6c02f510 legacy=0x7fac6c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:13.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.450+0000 7fac7affd700 1 -- 172.21.15.26:0/587853336 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fac840118b0 con 0x7fac8c134260 2023-10-01T07:55:13.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.484+0000 7f35cb4d1700 1 Processor -- start 2023-10-01T07:55:13.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.484+0000 7f35cb4d1700 1 -- start start 2023-10-01T07:55:13.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.485+0000 7f35cb4d1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f35c409f330 0x7f35c4138ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:13.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.485+0000 7f35cb4d1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f35c41393e0 0x7f35c413b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:13.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.485+0000 7f35cb4d1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c406bf30 con 0x7f35c409e850 2023-10-01T07:55:13.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.485+0000 7f35cb4d1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c409ffb0 con 0x7f35c409f330 2023-10-01T07:55:13.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.485+0000 7f35cb4d1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35c406cb10 con 0x7f35c41393e0 2023-10-01T07:55:13.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.485+0000 7f35c8a6c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f35c409f330 0x7f35c4138ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:13.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.485+0000 7f35c8a6c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f35c409f330 0x7f35c4138ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37408/0 (socket says 172.21.15.26:37408) 2023-10-01T07:55:13.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.485+0000 7f35c8a6c700 1 -- 172.21.15.26:0/1386689826 learned_addr learned my addr 172.21.15.26:0/1386689826 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:13.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.485+0000 7f35c9a6e700 1 --2- 172.21.15.26:0/1386689826 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f35c41393e0 0x7f35c413b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:13.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.485+0000 7f35c8a6c700 1 -- 172.21.15.26:0/1386689826 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f35c41393e0 msgr2=0x7f35c413b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:13.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.485+0000 7f35c8a6c700 1 --2- 172.21.15.26:0/1386689826 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f35c41393e0 0x7f35c413b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.485+0000 7f35c8a6c700 1 -- 172.21.15.26:0/1386689826 >> v1:172.21.15.26:6789/0 conn(0x7f35c409e850 legacy=0x7f35c409ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:13.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.485+0000 7f35bbfff700 1 -- 172.21.15.26:0/1386689826 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3705527465 0 0) 0x7f35c406bf30 con 0x7f35c409e850 2023-10-01T07:55:13.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.485+0000 7f35c8a6c700 1 -- 172.21.15.26:0/1386689826 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c40a0270 con 0x7f35c409f330 2023-10-01T07:55:13.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.485+0000 7f35c8a6c700 1 --2- 172.21.15.26:0/1386689826 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f35c409f330 0x7f35c4138ea0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009920 tx=0x7f35b4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da06a48b6c2262f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:13.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.486+0000 7f35bbfff700 1 -- 172.21.15.26:0/1386689826 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b400ba60 con 0x7f35c409f330 2023-10-01T07:55:13.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.486+0000 7f35bbfff700 1 -- 172.21.15.26:0/1386689826 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b400bbc0 con 0x7f35c409f330 2023-10-01T07:55:13.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.486+0000 7f35bbfff700 1 -- 172.21.15.26:0/1386689826 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b4009e70 con 0x7f35c409f330 2023-10-01T07:55:13.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.487+0000 7f35cb4d1700 1 -- 172.21.15.26:0/1386689826 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f35c409f330 msgr2=0x7f35c4138ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:13.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.487+0000 7f35cb4d1700 1 --2- 172.21.15.26:0/1386689826 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f35c409f330 0x7f35c4138ea0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009920 tx=0x7f35b4009c30 comp rx=0 tx=0).stop 2023-10-01T07:55:13.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.487+0000 7f35cb4d1700 1 -- 172.21.15.26:0/1386689826 shutdown_connections 2023-10-01T07:55:13.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.487+0000 7f35cb4d1700 1 --2- 172.21.15.26:0/1386689826 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f35c41393e0 0x7f35c413b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.487+0000 7f35cb4d1700 1 --2- 172.21.15.26:0/1386689826 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f35c409f330 0x7f35c4138ea0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.487+0000 7f35cb4d1700 1 -- 172.21.15.26:0/1386689826 >> 172.21.15.26:0/1386689826 conn(0x7f35c40a3f70 msgr2=0x7f35c40a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:13.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.487+0000 7f35cb4d1700 1 -- 172.21.15.26:0/1386689826 shutdown_connections 2023-10-01T07:55:13.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.487+0000 7f35cb4d1700 1 -- 172.21.15.26:0/1386689826 wait complete. 2023-10-01T07:55:13.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.488+0000 7f35cb4d1700 1 Processor -- start 2023-10-01T07:55:13.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.488+0000 7f35cb4d1700 1 -- start start 2023-10-01T07:55:13.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.488+0000 7f35cb4d1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f35c409e850 0x7f35c411af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:13.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.488+0000 7f35cb4d1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f35c409f330 0x7f35c411b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:13.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.488+0000 7f35cb4d1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35c41393e0 0x7f35c41cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:13.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.488+0000 7f35cb4d1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c411ab00 con 0x7f35c41393e0 2023-10-01T07:55:13.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.488+0000 7f35cb4d1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c411b9c0 con 0x7f35c409f330 2023-10-01T07:55:13.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.488+0000 7f35cb4d1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35c406cd30 con 0x7f35c409e850 2023-10-01T07:55:13.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.489+0000 7f35c9a6e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35c41393e0 0x7f35c41cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:13.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.489+0000 7f35c9a6e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35c41393e0 0x7f35c41cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36774/0 (socket says 172.21.15.26:36774) 2023-10-01T07:55:13.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.489+0000 7f35c9a6e700 1 -- 172.21.15.26:0/34812791 learned_addr learned my addr 172.21.15.26:0/34812791 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:13.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.489+0000 7f35c926d700 1 --2- 172.21.15.26:0/34812791 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f35c409e850 0x7f35c411af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:13.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.489+0000 7f35c8a6c700 1 --2- 172.21.15.26:0/34812791 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f35c409f330 0x7f35c411b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:13.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.489+0000 7f35c8a6c700 1 -- 172.21.15.26:0/34812791 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f35c409e850 msgr2=0x7f35c411af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:13.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.489+0000 7f35c8a6c700 1 --2- 172.21.15.26:0/34812791 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f35c409e850 0x7f35c411af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.489+0000 7f35c8a6c700 1 -- 172.21.15.26:0/34812791 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35c41393e0 msgr2=0x7f35c41cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:13.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.489+0000 7f35c8a6c700 1 --2- 172.21.15.26:0/34812791 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35c41393e0 0x7f35c41cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.489+0000 7f35c8a6c700 1 -- 172.21.15.26:0/34812791 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b4009550 con 0x7f35c409f330 2023-10-01T07:55:13.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.489+0000 7f35c8a6c700 1 --2- 172.21.15.26:0/34812791 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f35c409f330 0x7f35c411b480 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f35c40a09b0 tx=0x7f35b4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:13.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.489+0000 7f35b9ffb700 1 -- 172.21.15.26:0/34812791 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b4004450 con 0x7f35c409f330 2023-10-01T07:55:13.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.489+0000 7f35b9ffb700 1 -- 172.21.15.26:0/34812791 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b40045b0 con 0x7f35c409f330 2023-10-01T07:55:13.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.489+0000 7f35b9ffb700 1 -- 172.21.15.26:0/34812791 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b40038e0 con 0x7f35c409f330 2023-10-01T07:55:13.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.490+0000 7f35cb4d1700 1 -- 172.21.15.26:0/34812791 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c406fa30 con 0x7f35c409f330 2023-10-01T07:55:13.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.490+0000 7f35cb4d1700 1 -- 172.21.15.26:0/34812791 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c411c0e0 con 0x7f35c409f330 2023-10-01T07:55:13.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.491+0000 7f35b9ffb700 1 -- 172.21.15.26:0/34812791 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f35b4003a40 con 0x7f35c409f330 2023-10-01T07:55:13.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.491+0000 7f35b9ffb700 1 -- 172.21.15.26:0/34812791 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f35b4021030 con 0x7f35c409f330 2023-10-01T07:55:13.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.491+0000 7f35c926d700 1 -- 172.21.15.26:0/34812791 >> v1:172.21.15.26:6816/126763 conn(0x7f35a802f510 legacy=0x7f35a80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:13.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.491+0000 7f35cb4d1700 1 -- 172.21.15.26:0/34812791 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c40747f0 con 0x7f35c409f330 2023-10-01T07:55:13.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.496+0000 7f35b9ffb700 1 -- 172.21.15.26:0/34812791 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f35b4015020 con 0x7f35c409f330 2023-10-01T07:55:13.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.559+0000 7f379098d700 1 -- 172.21.15.26:0/2204356402 >> v1:172.21.15.26:6816/126763 conn(0x7f377002f510 legacy=0x7f37700319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:13.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.605+0000 7f917978a700 1 -- 172.21.15.26:0/2256279298 >> v1:172.21.15.26:6816/126763 conn(0x7f915802f510 legacy=0x7f91580319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:13.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.620+0000 7f3792bf1700 1 -- 172.21.15.26:0/2204356402 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f378c074ea0 con 0x7f378c134260 2023-10-01T07:55:13.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.620+0000 7f37897fa700 1 -- 172.21.15.26:0/2204356402 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3784004690 con 0x7f378c134260 2023-10-01T07:55:13.621 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:13.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.623+0000 7f3792bf1700 1 -- 172.21.15.26:0/2204356402 >> v1:172.21.15.26:6816/126763 conn(0x7f377002f510 legacy=0x7f37700319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:13.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.623+0000 7f3792bf1700 1 -- 172.21.15.26:0/2204356402 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f378c134260 msgr2=0x7f378c09cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:13.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.623+0000 7f3792bf1700 1 --2- 172.21.15.26:0/2204356402 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f378c134260 0x7f378c09cf00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f378c09ea50 tx=0x7f3784004ad0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.624+0000 7f3792bf1700 1 -- 172.21.15.26:0/2204356402 shutdown_connections 2023-10-01T07:55:13.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.624+0000 7f3792bf1700 1 --2- 172.21.15.26:0/2204356402 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f378c134260 0x7f378c09cf00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.624+0000 7f3792bf1700 1 --2- 172.21.15.26:0/2204356402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f378c133420 0x7f378c09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.624+0000 7f3792bf1700 1 --2- 172.21.15.26:0/2204356402 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f378c133e30 0x7f378c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.624+0000 7f3792bf1700 1 -- 172.21.15.26:0/2204356402 >> 172.21.15.26:0/2204356402 conn(0x7f378c0a4210 msgr2=0x7f378c0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:13.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.624+0000 7f3792bf1700 1 -- 172.21.15.26:0/2204356402 shutdown_connections 2023-10-01T07:55:13.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.624+0000 7f3792bf1700 1 -- 172.21.15.26:0/2204356402 wait complete. 2023-10-01T07:55:13.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.641+0000 7f917b9ee700 1 -- 172.21.15.26:0/2256279298 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f917409f420 con 0x7f917409e1d0 2023-10-01T07:55:13.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.642+0000 7f9169ffb700 1 -- 172.21.15.26:0/2256279298 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f916401b3b0 con 0x7f917409e1d0 2023-10-01T07:55:13.642 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:13.643 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:13.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.644+0000 7f917b9ee700 1 -- 172.21.15.26:0/2256279298 >> v1:172.21.15.26:6816/126763 conn(0x7f915802f510 legacy=0x7f91580319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:13.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.645+0000 7f917b9ee700 1 -- 172.21.15.26:0/2256279298 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f917409e1d0 msgr2=0x7f91741c8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:13.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.645+0000 7f917b9ee700 1 --2- 172.21.15.26:0/2256279298 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f917409e1d0 0x7f91741c8a10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f916400ebe0 tx=0x7f9164009ec0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.645+0000 7f917b9ee700 1 -- 172.21.15.26:0/2256279298 shutdown_connections 2023-10-01T07:55:13.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.645+0000 7f917b9ee700 1 --2- 172.21.15.26:0/2256279298 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9174139170 0x7f917411e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.645+0000 7f917b9ee700 1 --2- 172.21.15.26:0/2256279298 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f917409d6f0 0x7f91741c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.645+0000 7f917b9ee700 1 --2- 172.21.15.26:0/2256279298 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f917409e1d0 0x7f91741c8a10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.645+0000 7f917b9ee700 1 -- 172.21.15.26:0/2256279298 >> 172.21.15.26:0/2256279298 conn(0x7f9174066f50 msgr2=0x7f91740a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:13.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.645+0000 7f917b9ee700 1 -- 172.21.15.26:0/2256279298 shutdown_connections 2023-10-01T07:55:13.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.645+0000 7f917b9ee700 1 -- 172.21.15.26:0/2256279298 wait complete. 2023-10-01T07:55:13.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.647+0000 7fac8a59c700 1 -- 172.21.15.26:0/587853336 >> v1:172.21.15.26:6816/126763 conn(0x7fac6c02f510 legacy=0x7fac6c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:13.659 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:13.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.692+0000 7f35c926d700 1 -- 172.21.15.26:0/34812791 >> v1:172.21.15.26:6816/126763 conn(0x7f35a802f510 legacy=0x7f35a80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.26:6816/126763 2023-10-01T07:55:13.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.707+0000 7f35cb4d1700 1 -- 172.21.15.26:0/34812791 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f35c406bbb0 con 0x7f35c409f330 2023-10-01T07:55:13.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.707+0000 7f35b9ffb700 1 -- 172.21.15.26:0/34812791 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f35b402b070 con 0x7f35c409f330 2023-10-01T07:55:13.707 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:13.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.708+0000 7fac90b1d700 1 -- 172.21.15.26:0/587853336 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fac8c06b250 con 0x7fac8c134260 2023-10-01T07:55:13.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.708+0000 7fac7affd700 1 -- 172.21.15.26:0/587853336 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fac84018090 con 0x7fac8c134260 2023-10-01T07:55:13.709 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:13.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.710+0000 7f35cb4d1700 1 -- 172.21.15.26:0/34812791 >> v1:172.21.15.26:6816/126763 conn(0x7f35a802f510 legacy=0x7f35a80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:13.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.710+0000 7f35cb4d1700 1 -- 172.21.15.26:0/34812791 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f35c409f330 msgr2=0x7f35c411b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:13.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.710+0000 7f35cb4d1700 1 --2- 172.21.15.26:0/34812791 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f35c409f330 0x7f35c411b480 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f35c40a09b0 tx=0x7f35b4004750 comp rx=0 tx=0).stop 2023-10-01T07:55:13.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.710+0000 7f35cb4d1700 1 -- 172.21.15.26:0/34812791 shutdown_connections 2023-10-01T07:55:13.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.710+0000 7f35cb4d1700 1 --2- 172.21.15.26:0/34812791 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35c41393e0 0x7f35c41cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.710+0000 7f35cb4d1700 1 --2- 172.21.15.26:0/34812791 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f35c409e850 0x7f35c411af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.710+0000 7f35cb4d1700 1 --2- 172.21.15.26:0/34812791 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f35c409f330 0x7f35c411b480 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.710+0000 7f35cb4d1700 1 -- 172.21.15.26:0/34812791 >> 172.21.15.26:0/34812791 conn(0x7f35c40a3f70 msgr2=0x7f35c4070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:13.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.710+0000 7f35cb4d1700 1 -- 172.21.15.26:0/34812791 shutdown_connections 2023-10-01T07:55:13.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.710+0000 7f35cb4d1700 1 -- 172.21.15.26:0/34812791 wait complete. 2023-10-01T07:55:13.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.711+0000 7fac90b1d700 1 -- 172.21.15.26:0/587853336 >> v1:172.21.15.26:6816/126763 conn(0x7fac6c02f510 legacy=0x7fac6c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:13.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.711+0000 7fac90b1d700 1 -- 172.21.15.26:0/587853336 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac8c134260 msgr2=0x7fac8c09cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:13.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.711+0000 7fac90b1d700 1 --2- 172.21.15.26:0/587853336 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac8c134260 0x7fac8c09cd20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fac84009d90 tx=0x7fac8400c3a0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.711+0000 7fac90b1d700 1 -- 172.21.15.26:0/587853336 shutdown_connections 2023-10-01T07:55:13.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.711+0000 7fac90b1d700 1 --2- 172.21.15.26:0/587853336 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac8c134260 0x7fac8c09cd20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.711+0000 7fac90b1d700 1 --2- 172.21.15.26:0/587853336 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac8c133420 0x7fac8c09c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.711+0000 7fac90b1d700 1 --2- 172.21.15.26:0/587853336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac8c133e30 0x7fac8c09c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:13.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.711+0000 7fac90b1d700 1 -- 172.21.15.26:0/587853336 >> 172.21.15.26:0/587853336 conn(0x7fac8c0a4210 msgr2=0x7fac8c1302c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:13.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.711+0000 7fac90b1d700 1 -- 172.21.15.26:0/587853336 shutdown_connections 2023-10-01T07:55:13.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:13.711+0000 7fac90b1d700 1 -- 172.21.15.26:0/587853336 wait complete. 2023-10-01T07:55:13.725 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:13.725 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:14.644 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:14.660 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:14.726 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:14.726 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:14.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.801+0000 7f8b56f50700 1 Processor -- start 2023-10-01T07:55:14.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.801+0000 7f8b56f50700 1 -- start start 2023-10-01T07:55:14.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.802+0000 7f8b56f50700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b5009d6f0 0x7f8b5009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:14.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.802+0000 7f8b56f50700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8b5009e000 0x7f8b50130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:14.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.802+0000 7f8b56f50700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b5009f130 con 0x7f8b5009e410 2023-10-01T07:55:14.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.802+0000 7f8b56f50700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b5009f520 con 0x7f8b5009e000 2023-10-01T07:55:14.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.802+0000 7f8b56f50700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5009e930 con 0x7f8b5009d6f0 2023-10-01T07:55:14.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.802+0000 7f8b4ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8b5009e000 0x7f8b50130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:14.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.802+0000 7f8b4ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8b5009e000 0x7f8b50130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36790/0 (socket says 172.21.15.26:36790) 2023-10-01T07:55:14.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.802+0000 7f8b4ffff700 1 -- 172.21.15.26:0/3147912949 learned_addr learned my addr 172.21.15.26:0/3147912949 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:14.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.802+0000 7f8b4ffff700 1 -- 172.21.15.26:0/3147912949 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b5009d6f0 msgr2=0x7f8b5009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:14.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.802+0000 7f8b4ffff700 1 --2- 172.21.15.26:0/3147912949 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b5009d6f0 0x7f8b5009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:14.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.802+0000 7f8b4ffff700 1 -- 172.21.15.26:0/3147912949 >> v1:172.21.15.26:6789/0 conn(0x7f8b5009e410 legacy=0x7f8b50130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:14.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.802+0000 7f8b4ffff700 1 -- 172.21.15.26:0/3147912949 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b5009b2d0 con 0x7f8b5009e000 2023-10-01T07:55:14.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.802+0000 7f8b4ffff700 1 --2- 172.21.15.26:0/3147912949 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b5009e000 0x7f8b50130660 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c00bb90 tx=0x7f8b3c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4488605098b655aa server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:14.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.803+0000 7f8b4f7fe700 1 -- 172.21.15.26:0/3147912949 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c00dd50 con 0x7f8b5009e000 2023-10-01T07:55:14.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.803+0000 7f8b4f7fe700 1 -- 172.21.15.26:0/3147912949 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3c010470 con 0x7f8b5009e000 2023-10-01T07:55:14.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.803+0000 7f8b4f7fe700 1 -- 172.21.15.26:0/3147912949 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c010800 con 0x7f8b5009e000 2023-10-01T07:55:14.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.803+0000 7f8b56f50700 1 -- 172.21.15.26:0/3147912949 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b5009e000 msgr2=0x7f8b50130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:14.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.803+0000 7f8b56f50700 1 --2- 172.21.15.26:0/3147912949 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b5009e000 0x7f8b50130660 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c00bb90 tx=0x7f8b3c00bea0 comp rx=0 tx=0).stop 2023-10-01T07:55:14.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.804+0000 7f8b56f50700 1 -- 172.21.15.26:0/3147912949 shutdown_connections 2023-10-01T07:55:14.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.804+0000 7f8b56f50700 1 --2- 172.21.15.26:0/3147912949 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b5009d6f0 0x7f8b5009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:14.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.804+0000 7f8b56f50700 1 --2- 172.21.15.26:0/3147912949 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b5009e000 0x7f8b50130660 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:14.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.804+0000 7f8b56f50700 1 -- 172.21.15.26:0/3147912949 >> 172.21.15.26:0/3147912949 conn(0x7f8b50066f50 msgr2=0x7f8b5009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:14.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.804+0000 7f8b56f50700 1 -- 172.21.15.26:0/3147912949 shutdown_connections 2023-10-01T07:55:14.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.804+0000 7f8b56f50700 1 -- 172.21.15.26:0/3147912949 wait complete. 2023-10-01T07:55:14.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.805+0000 7f8b56f50700 1 Processor -- start 2023-10-01T07:55:14.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.805+0000 7f8b56f50700 1 -- start start 2023-10-01T07:55:14.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.806+0000 7f8b56f50700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b5009d6f0 0x7f8b501224d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:14.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.806+0000 7f8b56f50700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b5009e000 0x7f8b50122a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:14.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.806+0000 7f8b56f50700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b5009e410 0x7f8b50122f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:14.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.806+0000 7f8b56f50700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b501248d0 con 0x7f8b5009e000 2023-10-01T07:55:14.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.806+0000 7f8b56f50700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b501241f0 con 0x7f8b5009d6f0 2023-10-01T07:55:14.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.806+0000 7f8b56f50700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5012ffc0 con 0x7f8b5009e410 2023-10-01T07:55:14.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.806+0000 7f8b54cec700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b5009d6f0 0x7f8b501224d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:14.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.806+0000 7f8b54cec700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b5009d6f0 0x7f8b501224d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37422/0 (socket says 172.21.15.26:37422) 2023-10-01T07:55:14.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.806+0000 7f8b54cec700 1 -- 172.21.15.26:0/4141312573 learned_addr learned my addr 172.21.15.26:0/4141312573 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:14.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.806+0000 7f8b4ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b5009e000 0x7f8b50122a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:14.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.807+0000 7f8b554ed700 1 --2- 172.21.15.26:0/4141312573 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b5009e410 0x7f8b50122f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:14.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.807+0000 7f8b54cec700 1 -- 172.21.15.26:0/4141312573 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b5009e410 msgr2=0x7f8b50122f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:14.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.807+0000 7f8b54cec700 1 --2- 172.21.15.26:0/4141312573 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b5009e410 0x7f8b50122f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:14.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.807+0000 7f8b54cec700 1 -- 172.21.15.26:0/4141312573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b5009e000 msgr2=0x7f8b50122a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:14.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.807+0000 7f8b54cec700 1 --2- 172.21.15.26:0/4141312573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b5009e000 0x7f8b50122a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:14.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.807+0000 7f8b54cec700 1 -- 172.21.15.26:0/4141312573 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3c00b7f0 con 0x7f8b5009d6f0 2023-10-01T07:55:14.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.807+0000 7f8b54cec700 1 --2- 172.21.15.26:0/4141312573 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b5009d6f0 0x7f8b501224d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8b4400b530 tx=0x7f8b4400b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:14.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.807+0000 7f8b4d7fa700 1 -- 172.21.15.26:0/4141312573 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b44011830 con 0x7f8b5009d6f0 2023-10-01T07:55:14.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.807+0000 7f8b4d7fa700 1 -- 172.21.15.26:0/4141312573 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b44011990 con 0x7f8b5009d6f0 2023-10-01T07:55:14.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.807+0000 7f8b56f50700 1 -- 172.21.15.26:0/4141312573 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b50125a50 con 0x7f8b5009d6f0 2023-10-01T07:55:14.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.808+0000 7f8b4d7fa700 1 -- 172.21.15.26:0/4141312573 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b44011d20 con 0x7f8b5009d6f0 2023-10-01T07:55:14.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.808+0000 7f8b56f50700 1 -- 172.21.15.26:0/4141312573 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b50124630 con 0x7f8b5009d6f0 2023-10-01T07:55:14.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.809+0000 7f8b56f50700 1 -- 172.21.15.26:0/4141312573 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b50074ea0 con 0x7f8b5009d6f0 2023-10-01T07:55:14.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.809+0000 7f8b4d7fa700 1 -- 172.21.15.26:0/4141312573 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8b4401a400 con 0x7f8b5009d6f0 2023-10-01T07:55:14.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.809+0000 7f8b4d7fa700 1 -- 172.21.15.26:0/4141312573 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8b4403f6c0 con 0x7f8b5009d6f0 2023-10-01T07:55:14.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.818+0000 7f8b4d7fa700 1 -- 172.21.15.26:0/4141312573 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8b4400f6f0 con 0x7f8b5009d6f0 2023-10-01T07:55:14.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.842+0000 7fd35f923700 1 Processor -- start 2023-10-01T07:55:14.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.843+0000 7fd35f923700 1 -- start start 2023-10-01T07:55:14.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.843+0000 7fd35f923700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd358131810 0x7fd358131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:14.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.843+0000 7fd35f923700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd358099a40 0x7fd358099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:14.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.843+0000 7fd35f923700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3581313c0 con 0x7fd35809a3b0 2023-10-01T07:55:14.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.843+0000 7fd35f923700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd35809b580 con 0x7fd358099a40 2023-10-01T07:55:14.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.843+0000 7fd35f923700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd35806e8c0 con 0x7fd358131810 2023-10-01T07:55:14.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.843+0000 7fd35cebe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd358099a40 0x7fd358099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:14.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.844+0000 7fd35cebe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd358099a40 0x7fd358099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37436/0 (socket says 172.21.15.26:37436) 2023-10-01T07:55:14.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.844+0000 7fd35cebe700 1 -- 172.21.15.26:0/3988835130 learned_addr learned my addr 172.21.15.26:0/3988835130 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:14.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.844+0000 7fd35cebe700 1 -- 172.21.15.26:0/3988835130 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd358131810 msgr2=0x7fd358131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:14.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.844+0000 7fd35cebe700 1 --2- 172.21.15.26:0/3988835130 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd358131810 0x7fd358131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:14.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.844+0000 7fd35cebe700 1 -- 172.21.15.26:0/3988835130 >> v1:172.21.15.26:6789/0 conn(0x7fd35809a3b0 legacy=0x7fd358138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:14.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.844+0000 7fd35cebe700 1 -- 172.21.15.26:0/3988835130 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd35809a820 con 0x7fd358099a40 2023-10-01T07:55:14.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.844+0000 7fd35cebe700 1 --2- 172.21.15.26:0/3988835130 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd358099a40 0x7fd358099e70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd348009920 tx=0x7fd348009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e1a61d253b0b788 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:14.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.844+0000 7fd34ffff700 1 -- 172.21.15.26:0/3988835130 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34800ba60 con 0x7fd358099a40 2023-10-01T07:55:14.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.844+0000 7fd34ffff700 1 -- 172.21.15.26:0/3988835130 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34800bbc0 con 0x7fd358099a40 2023-10-01T07:55:14.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.844+0000 7fd34ffff700 1 -- 172.21.15.26:0/3988835130 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd348009e70 con 0x7fd358099a40 2023-10-01T07:55:14.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.845+0000 7fd35f923700 1 -- 172.21.15.26:0/3988835130 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd358099a40 msgr2=0x7fd358099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:14.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.845+0000 7fd35f923700 1 --2- 172.21.15.26:0/3988835130 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd358099a40 0x7fd358099e70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd348009920 tx=0x7fd348009c30 comp rx=0 tx=0).stop 2023-10-01T07:55:14.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.845+0000 7fd35f923700 1 -- 172.21.15.26:0/3988835130 shutdown_connections 2023-10-01T07:55:14.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.845+0000 7fd35f923700 1 --2- 172.21.15.26:0/3988835130 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd358131810 0x7fd358131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:14.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.845+0000 7fd35f923700 1 --2- 172.21.15.26:0/3988835130 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd358099a40 0x7fd358099e70 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:14.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.845+0000 7fd35f923700 1 -- 172.21.15.26:0/3988835130 >> 172.21.15.26:0/3988835130 conn(0x7fd3580a2aa0 msgr2=0x7fd3580a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:14.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.845+0000 7fd35f923700 1 -- 172.21.15.26:0/3988835130 shutdown_connections 2023-10-01T07:55:14.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.845+0000 7fd35f923700 1 -- 172.21.15.26:0/3988835130 wait complete. 2023-10-01T07:55:14.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.846+0000 7fd35f923700 1 Processor -- start 2023-10-01T07:55:14.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.846+0000 7fd35f923700 1 -- start start 2023-10-01T07:55:14.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.847+0000 7fd35f923700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd358099a40 0x7fd35811b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:14.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.847+0000 7fd35f923700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd35809a3b0 0x7fd35811bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:14.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.847+0000 7fd35f923700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd358131810 0x7fd35811c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:14.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.847+0000 7fd35f923700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35811f3a0 con 0x7fd358131810 2023-10-01T07:55:14.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.847+0000 7fd35f923700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd35811e6e0 con 0x7fd358099a40 2023-10-01T07:55:14.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.847+0000 7fd35f923700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd358130a20 con 0x7fd35809a3b0 2023-10-01T07:55:14.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.847+0000 7fd35cebe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd35809a3b0 0x7fd35811bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:14.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.847+0000 7fd35cebe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd35809a3b0 0x7fd35811bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55036/0 (socket says 172.21.15.26:55036) 2023-10-01T07:55:14.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.847+0000 7fd35cebe700 1 -- 172.21.15.26:0/686553285 learned_addr learned my addr 172.21.15.26:0/686553285 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:14.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.847+0000 7fd35d6bf700 1 --2- 172.21.15.26:0/686553285 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd358099a40 0x7fd35811b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:14.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.847+0000 7fd35dec0700 1 --2- 172.21.15.26:0/686553285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd358131810 0x7fd35811c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:14.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.847+0000 7fd35cebe700 1 -- 172.21.15.26:0/686553285 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd358099a40 msgr2=0x7fd35811b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:14.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.847+0000 7fd35cebe700 1 --2- 172.21.15.26:0/686553285 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd358099a40 0x7fd35811b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:14.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.847+0000 7fd35cebe700 1 -- 172.21.15.26:0/686553285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd358131810 msgr2=0x7fd35811c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:14.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.847+0000 7fd35cebe700 1 --2- 172.21.15.26:0/686553285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd358131810 0x7fd35811c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:14.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.847+0000 7fd35cebe700 1 -- 172.21.15.26:0/686553285 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd348009550 con 0x7fd35809a3b0 2023-10-01T07:55:14.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.847+0000 7fd35dec0700 1 --2- 172.21.15.26:0/686553285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd358131810 0x7fd35811c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:55:14.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.848+0000 7fd35cebe700 1 --2- 172.21.15.26:0/686553285 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd35809a3b0 0x7fd35811bdc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd348000c00 tx=0x7fd348004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:14.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.848+0000 7fd34dffb700 1 -- 172.21.15.26:0/686553285 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3480036a0 con 0x7fd35809a3b0 2023-10-01T07:55:14.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.848+0000 7fd34dffb700 1 -- 172.21.15.26:0/686553285 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34801f070 con 0x7fd35809a3b0 2023-10-01T07:55:14.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.848+0000 7fd35f923700 1 -- 172.21.15.26:0/686553285 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd35811da50 con 0x7fd35809a3b0 2023-10-01T07:55:14.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.848+0000 7fd34dffb700 1 -- 172.21.15.26:0/686553285 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd348003a60 con 0x7fd35809a3b0 2023-10-01T07:55:14.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.848+0000 7fd35f923700 1 -- 172.21.15.26:0/686553285 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd35806eb00 con 0x7fd35809a3b0 2023-10-01T07:55:14.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.849+0000 7fd35f923700 1 -- 172.21.15.26:0/686553285 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd358074ea0 con 0x7fd35809a3b0 2023-10-01T07:55:14.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.849+0000 7fd34dffb700 1 -- 172.21.15.26:0/686553285 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd348003bc0 con 0x7fd35809a3b0 2023-10-01T07:55:14.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.850+0000 7fd34dffb700 1 -- 172.21.15.26:0/686553285 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd348021070 con 0x7fd35809a3b0 2023-10-01T07:55:14.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.859+0000 7fd34dffb700 1 -- 172.21.15.26:0/686553285 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd348042e60 con 0x7fd35809a3b0 2023-10-01T07:55:14.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.881+0000 7fc4e358f700 1 Processor -- start 2023-10-01T07:55:14.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.882+0000 7fc4e358f700 1 -- start start 2023-10-01T07:55:14.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.882+0000 7fc4e358f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc4dc06a770 0x7fc4dc09d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:14.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.882+0000 7fc4e358f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4dc13d1f0 0x7fc4dc13f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:14.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.882+0000 7fc4e358f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4dc09a810 con 0x7fc4dc09dc30 2023-10-01T07:55:14.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.882+0000 7fc4e358f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4dc06ab40 con 0x7fc4dc06a770 2023-10-01T07:55:14.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.882+0000 7fc4e358f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4dc09ebc0 con 0x7fc4dc13d1f0 2023-10-01T07:55:14.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.883+0000 7fc4e132b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc4dc06a770 0x7fc4dc09d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:14.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.883+0000 7fc4e132b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc4dc06a770 0x7fc4dc09d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36824/0 (socket says 172.21.15.26:36824) 2023-10-01T07:55:14.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.883+0000 7fc4e132b700 1 -- 172.21.15.26:0/4069607184 learned_addr learned my addr 172.21.15.26:0/4069607184 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:14.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.883+0000 7fc4e1b2c700 1 --2- 172.21.15.26:0/4069607184 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4dc13d1f0 0x7fc4dc13f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:14.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.883+0000 7fc4e132b700 1 -- 172.21.15.26:0/4069607184 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4dc13d1f0 msgr2=0x7fc4dc13f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:14.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.883+0000 7fc4e132b700 1 --2- 172.21.15.26:0/4069607184 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4dc13d1f0 0x7fc4dc13f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:14.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.883+0000 7fc4e132b700 1 -- 172.21.15.26:0/4069607184 >> v1:172.21.15.26:6789/0 conn(0x7fc4dc09dc30 legacy=0x7fc4dc09e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:14.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.883+0000 7fc4e132b700 1 -- 172.21.15.26:0/4069607184 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4dc09e920 con 0x7fc4dc06a770 2023-10-01T07:55:14.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.883+0000 7fc4e132b700 1 --2- 172.21.15.26:0/4069607184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4dc06a770 0x7fc4dc09d6f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc4d80098f0 tx=0x7fc4d8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2ea63462894a50 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:14.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.883+0000 7fc4d3fff700 1 -- 172.21.15.26:0/4069607184 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8011830 con 0x7fc4dc06a770 2023-10-01T07:55:14.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.884+0000 7fc4d3fff700 1 -- 172.21.15.26:0/4069607184 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d8011990 con 0x7fc4dc06a770 2023-10-01T07:55:14.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.884+0000 7fc4d3fff700 1 -- 172.21.15.26:0/4069607184 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8011d20 con 0x7fc4dc06a770 2023-10-01T07:55:14.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.885+0000 7fc4e358f700 1 -- 172.21.15.26:0/4069607184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4dc06a770 msgr2=0x7fc4dc09d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:14.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.885+0000 7fc4e358f700 1 --2- 172.21.15.26:0/4069607184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4dc06a770 0x7fc4dc09d6f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc4d80098f0 tx=0x7fc4d8009c00 comp rx=0 tx=0).stop 2023-10-01T07:55:14.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.885+0000 7fc4e358f700 1 -- 172.21.15.26:0/4069607184 shutdown_connections 2023-10-01T07:55:14.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.885+0000 7fc4e358f700 1 --2- 172.21.15.26:0/4069607184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4dc06a770 0x7fc4dc09d6f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:14.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.885+0000 7fc4e358f700 1 --2- 172.21.15.26:0/4069607184 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4dc13d1f0 0x7fc4dc13f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:14.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.885+0000 7fc4e358f700 1 -- 172.21.15.26:0/4069607184 >> 172.21.15.26:0/4069607184 conn(0x7fc4dc066f50 msgr2=0x7fc4dc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:14.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.885+0000 7fc4e358f700 1 -- 172.21.15.26:0/4069607184 shutdown_connections 2023-10-01T07:55:14.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.885+0000 7fc4e358f700 1 -- 172.21.15.26:0/4069607184 wait complete. 2023-10-01T07:55:14.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.886+0000 7faf3c488700 1 Processor -- start 2023-10-01T07:55:14.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.886+0000 7fc4e358f700 1 Processor -- start 2023-10-01T07:55:14.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.886+0000 7faf3c488700 1 -- start start 2023-10-01T07:55:14.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.886+0000 7faf3c488700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faf3409e930 0x7faf3409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:14.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.886+0000 7faf3c488700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faf3409f650 0x7faf34131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:14.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.886+0000 7faf3c488700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf34070940 con 0x7faf3409f240 2023-10-01T07:55:14.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.886+0000 7faf3c488700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3406fd60 con 0x7faf3409f650 2023-10-01T07:55:14.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.886+0000 7faf3c488700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf3406fa80 con 0x7faf3409e930 2023-10-01T07:55:14.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.887+0000 7faf39a23700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7faf3409f240 0x7faf341317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41188/0 (socket says 172.21.15.26:41188) 2023-10-01T07:55:14.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.887+0000 7faf39a23700 1 -- 172.21.15.26:0/2235746315 learned_addr learned my addr 172.21.15.26:0/2235746315 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:14.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.887+0000 7faf3aa25700 1 --2- 172.21.15.26:0/2235746315 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faf3409f650 0x7faf34131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:14.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.887+0000 7faf39222700 1 -- 172.21.15.26:0/2235746315 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1052885362 0 0) 0x7faf34070940 con 0x7faf3409f240 2023-10-01T07:55:14.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.887+0000 7faf39222700 1 -- 172.21.15.26:0/2235746315 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf200035b0 con 0x7faf3409f240 2023-10-01T07:55:14.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.886+0000 7fc4e358f700 1 -- start start 2023-10-01T07:55:14.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.887+0000 7fc4e358f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4dc06a770 0x7fc4dc11c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:14.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.887+0000 7fc4e358f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4dc09dc30 0x7fc4dc13b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:14.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.887+0000 7fc4e358f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4dc13d1f0 0x7fc4dc13bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:14.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.887+0000 7fc4e358f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4dc11e3c0 con 0x7fc4dc09dc30 2023-10-01T07:55:14.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.887+0000 7fc4e358f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4dc11ce40 con 0x7fc4dc06a770 2023-10-01T07:55:14.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.887+0000 7fc4e358f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4dc09f1a0 con 0x7fc4dc13d1f0 2023-10-01T07:55:14.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.887+0000 7faf3aa25700 1 -- 172.21.15.26:0/2235746315 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faf3409e930 msgr2=0x7faf3409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:14.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.887+0000 7faf3aa25700 1 --2- 172.21.15.26:0/2235746315 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faf3409e930 0x7faf3409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:14.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.887+0000 7faf3aa25700 1 -- 172.21.15.26:0/2235746315 >> v1:172.21.15.26:6789/0 conn(0x7faf3409f240 legacy=0x7faf341317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:14.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.887+0000 7faf3aa25700 1 -- 172.21.15.26:0/2235746315 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3409fb60 con 0x7faf3409f650 2023-10-01T07:55:14.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.888+0000 7faf3aa25700 1 --2- 172.21.15.26:0/2235746315 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faf3409f650 0x7faf34131f00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7faf2c009dc0 tx=0x7faf2c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b686cca1bdbd246 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:14.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.888+0000 7fc4e132b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4dc06a770 0x7fc4dc11c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:14.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.888+0000 7fc4e0b2a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4dc09dc30 0x7fc4dc13b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:14.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.888+0000 7fc4e132b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4dc06a770 0x7fc4dc11c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37476/0 (socket says 172.21.15.26:37476) 2023-10-01T07:55:14.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.888+0000 7fc4e132b700 1 -- 172.21.15.26:0/2495125453 learned_addr learned my addr 172.21.15.26:0/2495125453 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:14.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.888+0000 7fc4e0b2a700 1 -- 172.21.15.26:0/2495125453 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4dc13d1f0 msgr2=0x7fc4dc13bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:14.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.888+0000 7fc4e0b2a700 1 --2- 172.21.15.26:0/2495125453 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4dc13d1f0 0x7fc4dc13bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:14.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.888+0000 7fc4e0b2a700 1 -- 172.21.15.26:0/2495125453 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4dc06a770 msgr2=0x7fc4dc11c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:14.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.888+0000 7fc4e0b2a700 1 --2- 172.21.15.26:0/2495125453 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4dc06a770 0x7fc4dc11c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:14.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.888+0000 7fc4e0b2a700 1 -- 172.21.15.26:0/2495125453 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d8009550 con 0x7fc4dc09dc30 2023-10-01T07:55:14.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.888+0000 7faf39222700 1 -- 172.21.15.26:0/2235746315 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c00e070 con 0x7faf3409f650 2023-10-01T07:55:14.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.888+0000 7faf39222700 1 -- 172.21.15.26:0/2235746315 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c00bb20 con 0x7faf3409f650 2023-10-01T07:55:14.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.888+0000 7faf39222700 1 -- 172.21.15.26:0/2235746315 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c012430 con 0x7faf3409f650 2023-10-01T07:55:14.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.888+0000 7fc4e132b700 1 --2- 172.21.15.26:0/2495125453 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4dc06a770 0x7fc4dc11c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:14.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.888+0000 7fc4e0b2a700 1 --2- 172.21.15.26:0/2495125453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4dc09dc30 0x7fc4dc13b6f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc000f60 tx=0x7fc4cc00c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:14.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.889+0000 7fc4d1ffb700 1 -- 172.21.15.26:0/2495125453 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc0052d0 con 0x7fc4dc09dc30 2023-10-01T07:55:14.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.889+0000 7fc4d1ffb700 1 -- 172.21.15.26:0/2495125453 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4cc005450 con 0x7fc4dc09dc30 2023-10-01T07:55:14.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.889+0000 7fc4e358f700 1 -- 172.21.15.26:0/2495125453 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4dc11eae0 con 0x7fc4dc09dc30 2023-10-01T07:55:14.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.889+0000 7fc4d1ffb700 1 -- 172.21.15.26:0/2495125453 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc0038c0 con 0x7fc4dc09dc30 2023-10-01T07:55:14.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.889+0000 7fc4e358f700 1 -- 172.21.15.26:0/2495125453 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4dc13ce60 con 0x7fc4dc09dc30 2023-10-01T07:55:14.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.889+0000 7faf3c488700 1 -- 172.21.15.26:0/2235746315 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faf3409f650 msgr2=0x7faf34131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:14.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.889+0000 7faf3c488700 1 --2- 172.21.15.26:0/2235746315 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faf3409f650 0x7faf34131f00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7faf2c009dc0 tx=0x7faf2c00b330 comp rx=0 tx=0).stop 2023-10-01T07:55:14.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.890+0000 7fc4d1ffb700 1 -- 172.21.15.26:0/2495125453 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc4cc003a20 con 0x7fc4dc09dc30 2023-10-01T07:55:14.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.890+0000 7fc4d1ffb700 1 -- 172.21.15.26:0/2495125453 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc4cc03ea30 con 0x7fc4dc09dc30 2023-10-01T07:55:14.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.890+0000 7fc4e358f700 1 -- 172.21.15.26:0/2495125453 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4dc11ed00 con 0x7fc4dc09dc30 2023-10-01T07:55:14.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.890+0000 7faf3c488700 1 -- 172.21.15.26:0/2235746315 shutdown_connections 2023-10-01T07:55:14.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.890+0000 7faf3c488700 1 --2- 172.21.15.26:0/2235746315 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faf3409e930 0x7faf3409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:14.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.890+0000 7faf3c488700 1 --2- 172.21.15.26:0/2235746315 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faf3409f650 0x7faf34131f00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:14.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.890+0000 7faf3c488700 1 -- 172.21.15.26:0/2235746315 >> 172.21.15.26:0/2235746315 conn(0x7faf340a4210 msgr2=0x7faf340a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:14.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.890+0000 7faf3c488700 1 -- 172.21.15.26:0/2235746315 shutdown_connections 2023-10-01T07:55:14.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.890+0000 7faf3c488700 1 -- 172.21.15.26:0/2235746315 wait complete. 2023-10-01T07:55:14.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.891+0000 7faf3c488700 1 Processor -- start 2023-10-01T07:55:14.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.892+0000 7faf3c488700 1 -- start start 2023-10-01T07:55:14.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.892+0000 7faf3c488700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf3409e930 0x7faf341a0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:14.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.892+0000 7faf3c488700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faf3409f240 0x7faf341a14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:14.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.892+0000 7faf3c488700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faf3409f650 0x7faf341c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:14.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.892+0000 7faf3c488700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf341a0b70 con 0x7faf3409e930 2023-10-01T07:55:14.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.892+0000 7faf3c488700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf341b5260 con 0x7faf3409f240 2023-10-01T07:55:14.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.892+0000 7faf3c488700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf341b5020 con 0x7faf3409f650 2023-10-01T07:55:14.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.892+0000 7faf3a224700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf3409e930 0x7faf341a0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:14.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.892+0000 7faf3a224700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf3409e930 0x7faf341a0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36844/0 (socket says 172.21.15.26:36844) 2023-10-01T07:55:14.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.892+0000 7faf3a224700 1 -- 172.21.15.26:0/2574158072 learned_addr learned my addr 172.21.15.26:0/2574158072 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:14.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.892+0000 7faf39a23700 1 --2- 172.21.15.26:0/2574158072 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faf3409f240 0x7faf341a14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:14.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.892+0000 7faf3aa25700 1 --2- 172.21.15.26:0/2574158072 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faf3409f650 0x7faf341c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:14.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.893+0000 7faf3a224700 1 -- 172.21.15.26:0/2574158072 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faf3409f650 msgr2=0x7faf341c3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:14.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.893+0000 7faf3a224700 1 --2- 172.21.15.26:0/2574158072 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faf3409f650 0x7faf341c3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:14.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.893+0000 7faf3a224700 1 -- 172.21.15.26:0/2574158072 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faf3409f240 msgr2=0x7faf341a14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:14.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.893+0000 7faf3a224700 1 --2- 172.21.15.26:0/2574158072 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faf3409f240 0x7faf341a14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:14.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.893+0000 7faf3a224700 1 -- 172.21.15.26:0/2574158072 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2c009a70 con 0x7faf3409e930 2023-10-01T07:55:14.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.893+0000 7faf3a224700 1 --2- 172.21.15.26:0/2574158072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf3409e930 0x7faf341a0fb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7faf3000b560 tx=0x7faf3000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:14.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.900+0000 7faf2affd700 1 -- 172.21.15.26:0/2574158072 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf30011830 con 0x7faf3409e930 2023-10-01T07:55:14.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.900+0000 7faf2affd700 1 -- 172.21.15.26:0/2574158072 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf30011990 con 0x7faf3409e930 2023-10-01T07:55:14.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.900+0000 7faf3c488700 1 -- 172.21.15.26:0/2574158072 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf340a0190 con 0x7faf3409e930 2023-10-01T07:55:14.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.900+0000 7fc4d1ffb700 1 -- 172.21.15.26:0/2495125453 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc4cc019e60 con 0x7fc4dc09dc30 2023-10-01T07:55:14.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.900+0000 7faf3c488700 1 -- 172.21.15.26:0/2574158072 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf340a3060 con 0x7faf3409e930 2023-10-01T07:55:14.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.900+0000 7faf2affd700 1 -- 172.21.15.26:0/2574158072 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf30011d40 con 0x7faf3409e930 2023-10-01T07:55:14.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.901+0000 7faf2affd700 1 -- 172.21.15.26:0/2574158072 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faf3001a400 con 0x7faf3409e930 2023-10-01T07:55:14.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.901+0000 7faf2affd700 1 -- 172.21.15.26:0/2574158072 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faf3003f570 con 0x7faf3409e930 2023-10-01T07:55:14.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.901+0000 7faf3c488700 1 -- 172.21.15.26:0/2574158072 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf1c0052e0 con 0x7faf3409e930 2023-10-01T07:55:14.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:14.911+0000 7faf2affd700 1 -- 172.21.15.26:0/2574158072 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faf3000f8d0 con 0x7faf3409e930 2023-10-01T07:55:15.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.069+0000 7f8b56f50700 1 -- 172.21.15.26:0/4141312573 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8b50131290 con 0x7f8b5009d6f0 2023-10-01T07:55:15.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.070+0000 7f8b4d7fa700 1 -- 172.21.15.26:0/4141312573 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8b50131290 con 0x7f8b5009d6f0 2023-10-01T07:55:15.070 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:15.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.073+0000 7f8b56f50700 1 -- 172.21.15.26:0/4141312573 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b5009d6f0 msgr2=0x7f8b501224d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:15.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.073+0000 7f8b56f50700 1 --2- 172.21.15.26:0/4141312573 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b5009d6f0 0x7f8b501224d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8b4400b530 tx=0x7f8b4400b840 comp rx=0 tx=0).stop 2023-10-01T07:55:15.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.073+0000 7f8b56f50700 1 -- 172.21.15.26:0/4141312573 shutdown_connections 2023-10-01T07:55:15.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.073+0000 7f8b56f50700 1 --2- 172.21.15.26:0/4141312573 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b5009e410 0x7f8b50122f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:15.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.073+0000 7f8b56f50700 1 --2- 172.21.15.26:0/4141312573 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b5009d6f0 0x7f8b501224d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:15.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.073+0000 7f8b56f50700 1 --2- 172.21.15.26:0/4141312573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b5009e000 0x7f8b50122a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:15.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.073+0000 7f8b56f50700 1 -- 172.21.15.26:0/4141312573 >> 172.21.15.26:0/4141312573 conn(0x7f8b50066f50 msgr2=0x7f8b500a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:15.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.073+0000 7f8b56f50700 1 -- 172.21.15.26:0/4141312573 shutdown_connections 2023-10-01T07:55:15.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.073+0000 7f8b56f50700 1 -- 172.21.15.26:0/4141312573 wait complete. 2023-10-01T07:55:15.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.081+0000 7fd35f923700 1 -- 172.21.15.26:0/686553285 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd35806b9e0 con 0x7fd35809a3b0 2023-10-01T07:55:15.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.082+0000 7fd34dffb700 1 -- 172.21.15.26:0/686553285 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd348015030 con 0x7fd35809a3b0 2023-10-01T07:55:15.082 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:15.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.084+0000 7fd35f923700 1 -- 172.21.15.26:0/686553285 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd35809a3b0 msgr2=0x7fd35811bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:15.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.084+0000 7fd35f923700 1 --2- 172.21.15.26:0/686553285 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd35809a3b0 0x7fd35811bdc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd348000c00 tx=0x7fd348004750 comp rx=0 tx=0).stop 2023-10-01T07:55:15.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.084+0000 7fd35f923700 1 -- 172.21.15.26:0/686553285 shutdown_connections 2023-10-01T07:55:15.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.084+0000 7fd35f923700 1 --2- 172.21.15.26:0/686553285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd358131810 0x7fd35811c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:15.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.084+0000 7fd35f923700 1 --2- 172.21.15.26:0/686553285 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd358099a40 0x7fd35811b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:15.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.084+0000 7fd35f923700 1 --2- 172.21.15.26:0/686553285 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd35809a3b0 0x7fd35811bdc0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:15.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.084+0000 7fd35f923700 1 -- 172.21.15.26:0/686553285 >> 172.21.15.26:0/686553285 conn(0x7fd3580a2aa0 msgr2=0x7fd3581b8b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:15.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.084+0000 7fd35f923700 1 -- 172.21.15.26:0/686553285 shutdown_connections 2023-10-01T07:55:15.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.084+0000 7fd35f923700 1 -- 172.21.15.26:0/686553285 wait complete. 2023-10-01T07:55:15.094 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:15.099 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:15.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.115+0000 7fc4e358f700 1 -- 172.21.15.26:0/2495125453 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc4dc11e810 con 0x7fc4dc09dc30 2023-10-01T07:55:15.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.115+0000 7fc4d1ffb700 1 -- 172.21.15.26:0/2495125453 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc4cc0102e0 con 0x7fc4dc09dc30 2023-10-01T07:55:15.116 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:15.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.119+0000 7fc4e358f700 1 -- 172.21.15.26:0/2495125453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4dc09dc30 msgr2=0x7fc4dc13b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:15.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.119+0000 7fc4e358f700 1 --2- 172.21.15.26:0/2495125453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4dc09dc30 0x7fc4dc13b6f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc000f60 tx=0x7fc4cc00c730 comp rx=0 tx=0).stop 2023-10-01T07:55:15.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.119+0000 7fc4e358f700 1 -- 172.21.15.26:0/2495125453 shutdown_connections 2023-10-01T07:55:15.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.119+0000 7fc4e358f700 1 --2- 172.21.15.26:0/2495125453 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4dc13d1f0 0x7fc4dc13bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:15.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.119+0000 7fc4e358f700 1 --2- 172.21.15.26:0/2495125453 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4dc06a770 0x7fc4dc11c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:15.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.119+0000 7fc4e358f700 1 --2- 172.21.15.26:0/2495125453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4dc09dc30 0x7fc4dc13b6f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:15.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.119+0000 7fc4e358f700 1 -- 172.21.15.26:0/2495125453 >> 172.21.15.26:0/2495125453 conn(0x7fc4dc066f50 msgr2=0x7fc4dc09b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:15.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.119+0000 7fc4e358f700 1 -- 172.21.15.26:0/2495125453 shutdown_connections 2023-10-01T07:55:15.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.119+0000 7fc4e358f700 1 -- 172.21.15.26:0/2495125453 wait complete. 2023-10-01T07:55:15.137 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:15.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.166+0000 7faf3c488700 1 -- 172.21.15.26:0/2574158072 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7faf1c005590 con 0x7faf3409e930 2023-10-01T07:55:15.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.167+0000 7faf2affd700 1 -- 172.21.15.26:0/2574158072 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faf3000f2e0 con 0x7faf3409e930 2023-10-01T07:55:15.167 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:15.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.169+0000 7faf3c488700 1 -- 172.21.15.26:0/2574158072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf3409e930 msgr2=0x7faf341a0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:15.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.169+0000 7faf3c488700 1 --2- 172.21.15.26:0/2574158072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf3409e930 0x7faf341a0fb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7faf3000b560 tx=0x7faf3000b870 comp rx=0 tx=0).stop 2023-10-01T07:55:15.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.169+0000 7faf3c488700 1 -- 172.21.15.26:0/2574158072 shutdown_connections 2023-10-01T07:55:15.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.169+0000 7faf3c488700 1 --2- 172.21.15.26:0/2574158072 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faf3409f650 0x7faf341c3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:15.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.169+0000 7faf3c488700 1 --2- 172.21.15.26:0/2574158072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf3409e930 0x7faf341a0fb0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:15.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.169+0000 7faf3c488700 1 --2- 172.21.15.26:0/2574158072 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faf3409f240 0x7faf341a14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:15.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.169+0000 7faf3c488700 1 -- 172.21.15.26:0/2574158072 >> 172.21.15.26:0/2574158072 conn(0x7faf340a4210 msgr2=0x7faf3406c320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:15.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.169+0000 7faf3c488700 1 -- 172.21.15.26:0/2574158072 shutdown_connections 2023-10-01T07:55:15.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:15.169+0000 7faf3c488700 1 -- 172.21.15.26:0/2574158072 wait complete. 2023-10-01T07:55:15.183 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:16.096 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:16.099 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:16.138 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:16.184 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:16.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.250+0000 7f294a8ea700 1 Processor -- start 2023-10-01T07:55:16.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.250+0000 7f294a8ea700 1 -- start start 2023-10-01T07:55:16.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.251+0000 7f294a8ea700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f294406f5d0 0x7f294412ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:16.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.251+0000 7f294a8ea700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2944135c20 0x7f2944138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:16.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.251+0000 7f294a8ea700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f294406fa40 con 0x7f294412cf60 2023-10-01T07:55:16.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.251+0000 7f294a8ea700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294412cd90 con 0x7f294406f5d0 2023-10-01T07:55:16.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.251+0000 7f294a8ea700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2944071780 con 0x7f2944135c20 2023-10-01T07:55:16.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.251+0000 7f2948e87700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2944135c20 0x7f2944138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:16.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.251+0000 7f29437fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f294406f5d0 0x7f294412ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:16.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.251+0000 7f2948e87700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2944135c20 0x7f2944138000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55068/0 (socket says 172.21.15.26:55068) 2023-10-01T07:55:16.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.251+0000 7f2948e87700 1 -- 172.21.15.26:0/600838643 learned_addr learned my addr 172.21.15.26:0/600838643 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:16.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.251+0000 7f2948e87700 1 -- 172.21.15.26:0/600838643 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f294406f5d0 msgr2=0x7f294412ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:16.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.251+0000 7f2948e87700 1 --2- 172.21.15.26:0/600838643 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f294406f5d0 0x7f294412ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.251+0000 7f2948e87700 1 -- 172.21.15.26:0/600838643 >> v1:172.21.15.26:6789/0 conn(0x7f294412cf60 legacy=0x7f294412f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:16.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.251+0000 7f2948e87700 1 -- 172.21.15.26:0/600838643 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2944071a40 con 0x7f2944135c20 2023-10-01T07:55:16.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.252+0000 7f2948e87700 1 --2- 172.21.15.26:0/600838643 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2944135c20 0x7f2944138000 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f293c009eb0 tx=0x7f293c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d12ab89ed2d62201 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:16.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.252+0000 7f2942ffd700 1 -- 172.21.15.26:0/600838643 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c00bad0 con 0x7f2944135c20 2023-10-01T07:55:16.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.252+0000 7f2942ffd700 1 -- 172.21.15.26:0/600838643 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293c00bc30 con 0x7f2944135c20 2023-10-01T07:55:16.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.252+0000 7f2942ffd700 1 -- 172.21.15.26:0/600838643 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c011460 con 0x7f2944135c20 2023-10-01T07:55:16.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.253+0000 7f294a8ea700 1 -- 172.21.15.26:0/600838643 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2944135c20 msgr2=0x7f2944138000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:16.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.253+0000 7f294a8ea700 1 --2- 172.21.15.26:0/600838643 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2944135c20 0x7f2944138000 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f293c009eb0 tx=0x7f293c00b330 comp rx=0 tx=0).stop 2023-10-01T07:55:16.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.253+0000 7f294a8ea700 1 -- 172.21.15.26:0/600838643 shutdown_connections 2023-10-01T07:55:16.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.253+0000 7f294a8ea700 1 --2- 172.21.15.26:0/600838643 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2944135c20 0x7f2944138000 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.253+0000 7f294a8ea700 1 --2- 172.21.15.26:0/600838643 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f294406f5d0 0x7f294412ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.253+0000 7f294a8ea700 1 -- 172.21.15.26:0/600838643 >> 172.21.15.26:0/600838643 conn(0x7f29440a2aa0 msgr2=0x7f29440a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:16.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.253+0000 7f294a8ea700 1 -- 172.21.15.26:0/600838643 shutdown_connections 2023-10-01T07:55:16.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.253+0000 7f294a8ea700 1 -- 172.21.15.26:0/600838643 wait complete. 2023-10-01T07:55:16.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.254+0000 7f294a8ea700 1 Processor -- start 2023-10-01T07:55:16.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.254+0000 7f294a8ea700 1 -- start start 2023-10-01T07:55:16.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.255+0000 7f294a8ea700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f294406f5d0 0x7f2944130900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:16.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.255+0000 7f294a8ea700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f294412cf60 0x7f2944130e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:16.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.255+0000 7f294a8ea700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2944135c20 0x7f2944131380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:16.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.255+0000 7f294a8ea700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29440a16a0 con 0x7f294412cf60 2023-10-01T07:55:16.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.255+0000 7f294a8ea700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294409d730 con 0x7f294406f5d0 2023-10-01T07:55:16.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.255+0000 7f294a8ea700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2944132c30 con 0x7f2944135c20 2023-10-01T07:55:16.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.255+0000 7f2948e87700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2944135c20 0x7f2944131380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:16.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.255+0000 7f2948e87700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2944135c20 0x7f2944131380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55084/0 (socket says 172.21.15.26:55084) 2023-10-01T07:55:16.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.255+0000 7f2948e87700 1 -- 172.21.15.26:0/3068366197 learned_addr learned my addr 172.21.15.26:0/3068366197 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:16.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.255+0000 7f29437fe700 1 --2- 172.21.15.26:0/3068366197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f294412cf60 0x7f2944130e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:16.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.255+0000 7f2943fff700 1 --2- 172.21.15.26:0/3068366197 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f294406f5d0 0x7f2944130900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:16.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.255+0000 7f2948e87700 1 -- 172.21.15.26:0/3068366197 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f294406f5d0 msgr2=0x7f2944130900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:16.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.255+0000 7f2948e87700 1 --2- 172.21.15.26:0/3068366197 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f294406f5d0 0x7f2944130900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.255+0000 7f2948e87700 1 -- 172.21.15.26:0/3068366197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f294412cf60 msgr2=0x7f2944130e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:16.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.255+0000 7f2948e87700 1 --2- 172.21.15.26:0/3068366197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f294412cf60 0x7f2944130e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.255+0000 7f2948e87700 1 -- 172.21.15.26:0/3068366197 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f293c009b30 con 0x7f2944135c20 2023-10-01T07:55:16.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.256+0000 7f2948e87700 1 --2- 172.21.15.26:0/3068366197 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2944135c20 0x7f2944131380 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2944071910 tx=0x7f293c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:16.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.256+0000 7f2940ff9700 1 -- 172.21.15.26:0/3068366197 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c004800 con 0x7f2944135c20 2023-10-01T07:55:16.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.256+0000 7f2940ff9700 1 -- 172.21.15.26:0/3068366197 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293c004960 con 0x7f2944135c20 2023-10-01T07:55:16.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.256+0000 7f294a8ea700 1 -- 172.21.15.26:0/3068366197 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f294409db50 con 0x7f2944135c20 2023-10-01T07:55:16.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.256+0000 7f2940ff9700 1 -- 172.21.15.26:0/3068366197 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c0116a0 con 0x7f2944135c20 2023-10-01T07:55:16.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.256+0000 7f294a8ea700 1 -- 172.21.15.26:0/3068366197 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2944132f10 con 0x7f2944135c20 2023-10-01T07:55:16.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.257+0000 7f294a8ea700 1 -- 172.21.15.26:0/3068366197 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2944074ea0 con 0x7f2944135c20 2023-10-01T07:55:16.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.257+0000 7f2940ff9700 1 -- 172.21.15.26:0/3068366197 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f293c011800 con 0x7f2944135c20 2023-10-01T07:55:16.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.258+0000 7f2940ff9700 1 -- 172.21.15.26:0/3068366197 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f293c041200 con 0x7f2944135c20 2023-10-01T07:55:16.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.267+0000 7f2940ff9700 1 -- 172.21.15.26:0/3068366197 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f293c011e30 con 0x7f2944135c20 2023-10-01T07:55:16.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.291+0000 7f48da39f700 1 Processor -- start 2023-10-01T07:55:16.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.292+0000 7f48da39f700 1 -- start start 2023-10-01T07:55:16.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.292+0000 7f48da39f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f48d409d8d0 0x7f48d409dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:16.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.292+0000 7f48da39f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48d409e610 0x7f48d4130b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:16.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.292+0000 7f48da39f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48d409b6e0 con 0x7f48d409e1e0 2023-10-01T07:55:16.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.292+0000 7f48da39f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48d409b470 con 0x7f48d409d8d0 2023-10-01T07:55:16.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.292+0000 7f48da39f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48d409eb80 con 0x7f48d409e610 2023-10-01T07:55:16.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.292+0000 7f48d9b9e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48d409e610 0x7f48d4130b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:16.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.293+0000 7f48d9b9e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48d409e610 0x7f48d4130b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55086/0 (socket says 172.21.15.26:55086) 2023-10-01T07:55:16.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.293+0000 7f48d9b9e700 1 -- 172.21.15.26:0/1839661619 learned_addr learned my addr 172.21.15.26:0/1839661619 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:16.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.293+0000 7f48d939d700 1 --2- 172.21.15.26:0/1839661619 >> v2:172.21.15.26:3300/0 conn(0x7f48d409d8d0 0x7f48d409dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:16.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.293+0000 7f48d9b9e700 1 -- 172.21.15.26:0/1839661619 >> v2:172.21.15.26:3300/0 conn(0x7f48d409d8d0 msgr2=0x7f48d409dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:16.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.293+0000 7f48d9b9e700 1 --2- 172.21.15.26:0/1839661619 >> v2:172.21.15.26:3300/0 conn(0x7f48d409d8d0 0x7f48d409dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.293+0000 7f48d9b9e700 1 -- 172.21.15.26:0/1839661619 >> v1:172.21.15.26:6789/0 conn(0x7f48d409e1e0 legacy=0x7f48d4130460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:16.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.293+0000 7f48d9b9e700 1 -- 172.21.15.26:0/1839661619 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d409ae00 con 0x7f48d409e610 2023-10-01T07:55:16.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.293+0000 7f48d939d700 1 --2- 172.21.15.26:0/1839661619 >> v2:172.21.15.26:3300/0 conn(0x7f48d409d8d0 0x7f48d409dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:16.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.293+0000 7f48d9b9e700 1 --2- 172.21.15.26:0/1839661619 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48d409e610 0x7f48d4130b70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f48cc009e50 tx=0x7f48cc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=704e622412e285d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:16.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.293+0000 7f48cbfff700 1 -- 172.21.15.26:0/1839661619 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48cc00e070 con 0x7f48d409e610 2023-10-01T07:55:16.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.293+0000 7f48cbfff700 1 -- 172.21.15.26:0/1839661619 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48cc00b910 con 0x7f48d409e610 2023-10-01T07:55:16.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.293+0000 7f48cbfff700 1 -- 172.21.15.26:0/1839661619 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48cc00bcc0 con 0x7f48d409e610 2023-10-01T07:55:16.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.294+0000 7f48da39f700 1 -- 172.21.15.26:0/1839661619 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48d409e610 msgr2=0x7f48d4130b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:16.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.294+0000 7f48da39f700 1 --2- 172.21.15.26:0/1839661619 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48d409e610 0x7f48d4130b70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f48cc009e50 tx=0x7f48cc00b330 comp rx=0 tx=0).stop 2023-10-01T07:55:16.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.294+0000 7f48da39f700 1 -- 172.21.15.26:0/1839661619 shutdown_connections 2023-10-01T07:55:16.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.294+0000 7f48da39f700 1 --2- 172.21.15.26:0/1839661619 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48d409e610 0x7f48d4130b70 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.294+0000 7f48da39f700 1 --2- 172.21.15.26:0/1839661619 >> v2:172.21.15.26:3300/0 conn(0x7f48d409d8d0 0x7f48d409dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.294+0000 7f48da39f700 1 -- 172.21.15.26:0/1839661619 >> 172.21.15.26:0/1839661619 conn(0x7f48d40a2e20 msgr2=0x7f48d40a3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:16.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.294+0000 7f48da39f700 1 -- 172.21.15.26:0/1839661619 shutdown_connections 2023-10-01T07:55:16.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.294+0000 7f48da39f700 1 -- 172.21.15.26:0/1839661619 wait complete. 2023-10-01T07:55:16.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.296+0000 7f48da39f700 1 Processor -- start 2023-10-01T07:55:16.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.296+0000 7f48da39f700 1 -- start start 2023-10-01T07:55:16.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.297+0000 7f48da39f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48d409d8d0 0x7f48d4122250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:16.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.297+0000 7f48da39f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48d409e1e0 0x7f48d4122790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:16.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.297+0000 7f48da39f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48d409e610 0x7f48d4122cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:16.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.297+0000 7f48da39f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d41253b0 con 0x7f48d409e1e0 2023-10-01T07:55:16.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.297+0000 7f48da39f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d4124660 con 0x7f48d409d8d0 2023-10-01T07:55:16.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.297+0000 7f48da39f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48d4123dc0 con 0x7f48d409e610 2023-10-01T07:55:16.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.297+0000 7f48d8b9c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48d409e1e0 0x7f48d4122790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:16.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.297+0000 7f48d9b9e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48d409e610 0x7f48d4122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:16.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.297+0000 7f48d8b9c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48d409e1e0 0x7f48d4122790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36888/0 (socket says 172.21.15.26:36888) 2023-10-01T07:55:16.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.297+0000 7f48d8b9c700 1 -- 172.21.15.26:0/1666140115 learned_addr learned my addr 172.21.15.26:0/1666140115 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:16.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.297+0000 7f48d939d700 1 --2- 172.21.15.26:0/1666140115 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48d409d8d0 0x7f48d4122250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:16.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.297+0000 7f48d8b9c700 1 -- 172.21.15.26:0/1666140115 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48d409e610 msgr2=0x7f48d4122cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:16.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.297+0000 7f48d8b9c700 1 --2- 172.21.15.26:0/1666140115 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48d409e610 0x7f48d4122cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.297+0000 7f48d8b9c700 1 -- 172.21.15.26:0/1666140115 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48d409d8d0 msgr2=0x7f48d4122250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:16.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.297+0000 7f48d8b9c700 1 --2- 172.21.15.26:0/1666140115 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48d409d8d0 0x7f48d4122250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.298+0000 7f48d8b9c700 1 -- 172.21.15.26:0/1666140115 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d00094a0 con 0x7f48d409e1e0 2023-10-01T07:55:16.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.298+0000 7f48d8b9c700 1 --2- 172.21.15.26:0/1666140115 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48d409e1e0 0x7f48d4122790 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f48c400c4d0 tx=0x7f48c400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:16.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.298+0000 7f48c9ffb700 1 -- 172.21.15.26:0/1666140115 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c40054e0 con 0x7f48d409e1e0 2023-10-01T07:55:16.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.298+0000 7f48c9ffb700 1 -- 172.21.15.26:0/1666140115 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c4003680 con 0x7f48d409e1e0 2023-10-01T07:55:16.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.298+0000 7f48da39f700 1 -- 172.21.15.26:0/1666140115 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48cc009b30 con 0x7f48d409e1e0 2023-10-01T07:55:16.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.298+0000 7f48c9ffb700 1 -- 172.21.15.26:0/1666140115 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c4003a30 con 0x7f48d409e1e0 2023-10-01T07:55:16.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.298+0000 7f48da39f700 1 -- 172.21.15.26:0/1666140115 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48d4125730 con 0x7f48d409e1e0 2023-10-01T07:55:16.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.299+0000 7f48c9ffb700 1 -- 172.21.15.26:0/1666140115 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f48c4003b90 con 0x7f48d409e1e0 2023-10-01T07:55:16.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.299+0000 7f48c9ffb700 1 -- 172.21.15.26:0/1666140115 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f48c403ea60 con 0x7f48d409e1e0 2023-10-01T07:55:16.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.300+0000 7f48da39f700 1 -- 172.21.15.26:0/1666140115 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b40052e0 con 0x7f48d409e1e0 2023-10-01T07:55:16.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.301+0000 7f36e4984700 1 Processor -- start 2023-10-01T07:55:16.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.301+0000 7f36e4984700 1 -- start start 2023-10-01T07:55:16.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.302+0000 7f36e4984700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f36e0131630 0x7f36e0131a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:16.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.302+0000 7f36e4984700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f36e0131f40 0x7f36e006e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:16.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.302+0000 7f36e4984700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36e006e9d0 0x7f36e006ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:16.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.302+0000 7f36e4984700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36e0071a00 con 0x7f36e0131630 2023-10-01T07:55:16.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.302+0000 7f36e4984700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e0131430 con 0x7f36e006e9d0 2023-10-01T07:55:16.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.302+0000 7f36e4984700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36e009a510 con 0x7f36e0131f40 2023-10-01T07:55:16.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.302+0000 7f36ded9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36e006e9d0 0x7f36e006ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:16.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.302+0000 7f36ded9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36e006e9d0 0x7f36e006ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37512/0 (socket says 172.21.15.26:37512) 2023-10-01T07:55:16.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.302+0000 7f36ded9d700 1 -- 172.21.15.26:0/2869711591 learned_addr learned my addr 172.21.15.26:0/2869711591 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:16.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.302+0000 7f36ddd9b700 1 --2- 172.21.15.26:0/2869711591 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f36e0131f40 0x7f36e006e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:16.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.302+0000 7f36de59c700 1 --2- 172.21.15.26:0/2869711591 >> v2:172.21.15.26:3300/0 conn(0x7f36e0131630 0x7f36e0131a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:16.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.303+0000 7f36ded9d700 1 -- 172.21.15.26:0/2869711591 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f36e0131f40 msgr2=0x7f36e006e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:16.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.303+0000 7f36ded9d700 1 --2- 172.21.15.26:0/2869711591 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f36e0131f40 0x7f36e006e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.303+0000 7f36ded9d700 1 -- 172.21.15.26:0/2869711591 >> v2:172.21.15.26:3300/0 conn(0x7f36e0131630 msgr2=0x7f36e0131a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:16.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.303+0000 7f36ded9d700 1 --2- 172.21.15.26:0/2869711591 >> v2:172.21.15.26:3300/0 conn(0x7f36e0131630 0x7f36e0131a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.303+0000 7f36ded9d700 1 -- 172.21.15.26:0/2869711591 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e00721c0 con 0x7f36e006e9d0 2023-10-01T07:55:16.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.303+0000 7f36ded9d700 1 --2- 172.21.15.26:0/2869711591 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36e006e9d0 0x7f36e006ee50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f36d8009e50 tx=0x7f36d800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddde25184f35b6a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:16.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.303+0000 7f36dd59a700 1 -- 172.21.15.26:0/2869711591 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d800e070 con 0x7f36e006e9d0 2023-10-01T07:55:16.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.303+0000 7f36dd59a700 1 -- 172.21.15.26:0/2869711591 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d800b910 con 0x7f36e006e9d0 2023-10-01T07:55:16.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.303+0000 7f36dd59a700 1 -- 172.21.15.26:0/2869711591 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d800bcc0 con 0x7f36e006e9d0 2023-10-01T07:55:16.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.304+0000 7f36e4984700 1 -- 172.21.15.26:0/2869711591 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36e006e9d0 msgr2=0x7f36e006ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:16.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.304+0000 7f36e4984700 1 --2- 172.21.15.26:0/2869711591 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36e006e9d0 0x7f36e006ee50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f36d8009e50 tx=0x7f36d800b330 comp rx=0 tx=0).stop 2023-10-01T07:55:16.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.304+0000 7f36e4984700 1 -- 172.21.15.26:0/2869711591 shutdown_connections 2023-10-01T07:55:16.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.304+0000 7f36e4984700 1 --2- 172.21.15.26:0/2869711591 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36e006e9d0 0x7f36e006ee50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.304+0000 7f36e4984700 1 --2- 172.21.15.26:0/2869711591 >> v2:172.21.15.26:3300/0 conn(0x7f36e0131630 0x7f36e0131a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.304+0000 7f36e4984700 1 --2- 172.21.15.26:0/2869711591 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f36e0131f40 0x7f36e006e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.304+0000 7f36e4984700 1 -- 172.21.15.26:0/2869711591 >> 172.21.15.26:0/2869711591 conn(0x7f36e00a2aa0 msgr2=0x7f36e00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:16.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.305+0000 7f36e4984700 1 -- 172.21.15.26:0/2869711591 shutdown_connections 2023-10-01T07:55:16.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.305+0000 7f36e4984700 1 -- 172.21.15.26:0/2869711591 wait complete. 2023-10-01T07:55:16.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.306+0000 7f36e4984700 1 Processor -- start 2023-10-01T07:55:16.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.306+0000 7f36e4984700 1 -- start start 2023-10-01T07:55:16.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.307+0000 7f36e4984700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36e006e9d0 0x7f36e011b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:16.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.307+0000 7f36e4984700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36e0131630 0x7f36e011bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:16.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.307+0000 7f36e4984700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f36e0131f40 0x7f36e011c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:16.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.307+0000 7f36e4984700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e011d210 con 0x7f36e0131630 2023-10-01T07:55:16.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.307+0000 7f36e4984700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e0099f20 con 0x7f36e006e9d0 2023-10-01T07:55:16.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.307+0000 7f36e4984700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36e011ee40 con 0x7f36e0131f40 2023-10-01T07:55:16.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.307+0000 7f36ded9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f36e0131f40 0x7f36e011c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:16.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.307+0000 7f36ded9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f36e0131f40 0x7f36e011c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55104/0 (socket says 172.21.15.26:55104) 2023-10-01T07:55:16.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.307+0000 7f36ddd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36e0131630 0x7f36e011bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:16.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.307+0000 7f36ded9d700 1 -- 172.21.15.26:0/27311429 learned_addr learned my addr 172.21.15.26:0/27311429 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:16.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.307+0000 7f36de59c700 1 --2- 172.21.15.26:0/27311429 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36e006e9d0 0x7f36e011b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:16.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.308+0000 7f36ded9d700 1 -- 172.21.15.26:0/27311429 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36e006e9d0 msgr2=0x7f36e011b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:16.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.308+0000 7f36ded9d700 1 --2- 172.21.15.26:0/27311429 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36e006e9d0 0x7f36e011b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.308+0000 7f36ded9d700 1 -- 172.21.15.26:0/27311429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36e0131630 msgr2=0x7f36e011bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:16.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.308+0000 7f36ded9d700 1 --2- 172.21.15.26:0/27311429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36e0131630 0x7f36e011bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.308+0000 7f36ded9d700 1 -- 172.21.15.26:0/27311429 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d8009b30 con 0x7f36e0131f40 2023-10-01T07:55:16.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.308+0000 7f36ded9d700 1 --2- 172.21.15.26:0/27311429 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f36e0131f40 0x7f36e011c190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f36e0131570 tx=0x7f36d8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:16.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.308+0000 7f48c9ffb700 1 -- 172.21.15.26:0/1666140115 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f48c4017080 con 0x7f48d409e1e0 2023-10-01T07:55:16.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.308+0000 7f36ceffd700 1 -- 172.21.15.26:0/27311429 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d800ce80 con 0x7f36e0131f40 2023-10-01T07:55:16.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.308+0000 7f36ceffd700 1 -- 172.21.15.26:0/27311429 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d8004250 con 0x7f36e0131f40 2023-10-01T07:55:16.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.308+0000 7f36ceffd700 1 -- 172.21.15.26:0/27311429 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d8004600 con 0x7f36e0131f40 2023-10-01T07:55:16.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.308+0000 7f36e4984700 1 -- 172.21.15.26:0/27311429 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e00a2e70 con 0x7f36e0131f40 2023-10-01T07:55:16.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.309+0000 7f36e4984700 1 -- 172.21.15.26:0/27311429 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e011e8b0 con 0x7f36e0131f40 2023-10-01T07:55:16.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.310+0000 7f36ceffd700 1 -- 172.21.15.26:0/27311429 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f36d8004760 con 0x7f36e0131f40 2023-10-01T07:55:16.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.310+0000 7f36e4984700 1 -- 172.21.15.26:0/27311429 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36e0074ea0 con 0x7f36e0131f40 2023-10-01T07:55:16.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.310+0000 7f36ceffd700 1 -- 172.21.15.26:0/27311429 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f36d8040ef0 con 0x7f36e0131f40 2023-10-01T07:55:16.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.319+0000 7f36ceffd700 1 -- 172.21.15.26:0/27311429 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f36d8011780 con 0x7f36e0131f40 2023-10-01T07:55:16.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.336+0000 7f09faa8f700 1 Processor -- start 2023-10-01T07:55:16.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.336+0000 7f09faa8f700 1 -- start start 2023-10-01T07:55:16.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.336+0000 7f09faa8f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f09f4131810 0x7f09f4131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:16.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.336+0000 7f09faa8f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f09f4099a40 0x7f09f4099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:16.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.336+0000 7f09faa8f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f41313c0 con 0x7f09f409a3b0 2023-10-01T07:55:16.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.336+0000 7f09faa8f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f409b580 con 0x7f09f4131810 2023-10-01T07:55:16.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.336+0000 7f09faa8f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f406e8c0 con 0x7f09f4099a40 2023-10-01T07:55:16.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.337+0000 7f09f902c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f09f409a3b0 0x7f09f4138650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41222/0 (socket says 172.21.15.26:41222) 2023-10-01T07:55:16.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.337+0000 7f09f902c700 1 -- 172.21.15.26:0/3958128109 learned_addr learned my addr 172.21.15.26:0/3958128109 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:16.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.337+0000 7f09f882b700 1 --2- 172.21.15.26:0/3958128109 >> v2:172.21.15.26:3300/0 conn(0x7f09f4131810 0x7f09f4131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:16.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.337+0000 7f09f3fff700 1 --2- 172.21.15.26:0/3958128109 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f09f4099a40 0x7f09f4099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:16.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.337+0000 7f09f3fff700 1 -- 172.21.15.26:0/3958128109 >> v2:172.21.15.26:3300/0 conn(0x7f09f4131810 msgr2=0x7f09f4131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:16.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.337+0000 7f09f3fff700 1 --2- 172.21.15.26:0/3958128109 >> v2:172.21.15.26:3300/0 conn(0x7f09f4131810 0x7f09f4131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.337+0000 7f09f3fff700 1 -- 172.21.15.26:0/3958128109 >> v1:172.21.15.26:6789/0 conn(0x7f09f409a3b0 legacy=0x7f09f4138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:16.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.337+0000 7f09f3fff700 1 -- 172.21.15.26:0/3958128109 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f409a830 con 0x7f09f4099a40 2023-10-01T07:55:16.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.337+0000 7f09f37fe700 1 -- 172.21.15.26:0/3958128109 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1351224376 0 0) 0x7f09f41313c0 con 0x7f09f409a3b0 2023-10-01T07:55:16.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.337+0000 7f09f3fff700 1 --2- 172.21.15.26:0/3958128109 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f09f4099a40 0x7f09f4099e70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f09e0009870 tx=0x7f09e0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1335ebeda5511082 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:16.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.338+0000 7f09f37fe700 1 -- 172.21.15.26:0/3958128109 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e0011830 con 0x7f09f4099a40 2023-10-01T07:55:16.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.338+0000 7f09f37fe700 1 -- 172.21.15.26:0/3958128109 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e0011990 con 0x7f09f4099a40 2023-10-01T07:55:16.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.338+0000 7f09f37fe700 1 -- 172.21.15.26:0/3958128109 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e0011d20 con 0x7f09f4099a40 2023-10-01T07:55:16.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.339+0000 7f09faa8f700 1 -- 172.21.15.26:0/3958128109 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f09f4099a40 msgr2=0x7f09f4099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:16.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.339+0000 7f09faa8f700 1 --2- 172.21.15.26:0/3958128109 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f09f4099a40 0x7f09f4099e70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f09e0009870 tx=0x7f09e0009b80 comp rx=0 tx=0).stop 2023-10-01T07:55:16.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.339+0000 7f09faa8f700 1 -- 172.21.15.26:0/3958128109 shutdown_connections 2023-10-01T07:55:16.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.339+0000 7f09faa8f700 1 --2- 172.21.15.26:0/3958128109 >> v2:172.21.15.26:3300/0 conn(0x7f09f4131810 0x7f09f4131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.339+0000 7f09faa8f700 1 --2- 172.21.15.26:0/3958128109 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f09f4099a40 0x7f09f4099e70 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.339+0000 7f09faa8f700 1 -- 172.21.15.26:0/3958128109 >> 172.21.15.26:0/3958128109 conn(0x7f09f40a2aa0 msgr2=0x7f09f40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:16.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.339+0000 7f09faa8f700 1 -- 172.21.15.26:0/3958128109 shutdown_connections 2023-10-01T07:55:16.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.339+0000 7f09faa8f700 1 -- 172.21.15.26:0/3958128109 wait complete. 2023-10-01T07:55:16.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.340+0000 7f09faa8f700 1 Processor -- start 2023-10-01T07:55:16.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.340+0000 7f09faa8f700 1 -- start start 2023-10-01T07:55:16.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.341+0000 7f09faa8f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f09f4099a40 0x7f09f411b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:16.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.341+0000 7f09faa8f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f09f409a3b0 0x7f09f411bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:16.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.341+0000 7f09faa8f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09f4131810 0x7f09f411c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:16.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.341+0000 7f09faa8f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f411cb10 con 0x7f09f4131810 2023-10-01T07:55:16.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.341+0000 7f09faa8f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f411d8a0 con 0x7f09f409a3b0 2023-10-01T07:55:16.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.341+0000 7f09faa8f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09f411e960 con 0x7f09f4099a40 2023-10-01T07:55:16.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.341+0000 7f09f882b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f09f4099a40 0x7f09f411b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:16.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.342+0000 7f09f882b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f09f4099a40 0x7f09f411b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55116/0 (socket says 172.21.15.26:55116) 2023-10-01T07:55:16.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.342+0000 7f09f882b700 1 -- 172.21.15.26:0/3771159022 learned_addr learned my addr 172.21.15.26:0/3771159022 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:16.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.342+0000 7f09f3fff700 1 --2- 172.21.15.26:0/3771159022 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f09f409a3b0 0x7f09f411bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:16.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.342+0000 7f09f882b700 1 -- 172.21.15.26:0/3771159022 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f09f409a3b0 msgr2=0x7f09f411bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:16.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.342+0000 7f09f882b700 1 --2- 172.21.15.26:0/3771159022 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f09f409a3b0 0x7f09f411bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.342+0000 7f09f882b700 1 -- 172.21.15.26:0/3771159022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09f4131810 msgr2=0x7f09f411c130 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:16.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.342+0000 7f09f882b700 1 --2- 172.21.15.26:0/3771159022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09f4131810 0x7f09f411c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.342+0000 7f09f882b700 1 -- 172.21.15.26:0/3771159022 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e00094a0 con 0x7f09f4099a40 2023-10-01T07:55:16.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.342+0000 7f09f3fff700 1 --2- 172.21.15.26:0/3771159022 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f09f409a3b0 0x7f09f411bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:16.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.343+0000 7f09f882b700 1 --2- 172.21.15.26:0/3771159022 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f09f4099a40 0x7f09f411b6b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f09e800e9e0 tx=0x7f09e800ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:16.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.343+0000 7f09f17fa700 1 -- 172.21.15.26:0/3771159022 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e8009710 con 0x7f09f4099a40 2023-10-01T07:55:16.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.343+0000 7f09f17fa700 1 -- 172.21.15.26:0/3771159022 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e800c850 con 0x7f09f4099a40 2023-10-01T07:55:16.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.343+0000 7f09faa8f700 1 -- 172.21.15.26:0/3771159022 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f4071dd0 con 0x7f09f4099a40 2023-10-01T07:55:16.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.343+0000 7f09f17fa700 1 -- 172.21.15.26:0/3771159022 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e800cbc0 con 0x7f09f4099a40 2023-10-01T07:55:16.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.343+0000 7f09faa8f700 1 -- 172.21.15.26:0/3771159022 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f40a1a90 con 0x7f09f4099a40 2023-10-01T07:55:16.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.344+0000 7f09f17fa700 1 -- 172.21.15.26:0/3771159022 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f09e800cd20 con 0x7f09f4099a40 2023-10-01T07:55:16.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.344+0000 7f09faa8f700 1 -- 172.21.15.26:0/3771159022 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f4074ea0 con 0x7f09f4099a40 2023-10-01T07:55:16.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.344+0000 7f09f17fa700 1 -- 172.21.15.26:0/3771159022 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f09e801b890 con 0x7f09f4099a40 2023-10-01T07:55:16.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.349+0000 7f09f17fa700 1 -- 172.21.15.26:0/3771159022 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f09e80102b0 con 0x7f09f4099a40 2023-10-01T07:55:16.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.524+0000 7f48da39f700 1 -- 172.21.15.26:0/1666140115 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f48b4005590 con 0x7f48d409e1e0 2023-10-01T07:55:16.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.525+0000 7f48c9ffb700 1 -- 172.21.15.26:0/1666140115 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f48c4003e40 con 0x7f48d409e1e0 2023-10-01T07:55:16.525 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:16.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.527+0000 7f36e4984700 1 -- 172.21.15.26:0/27311429 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f36e006b9e0 con 0x7f36e0131f40 2023-10-01T07:55:16.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.527+0000 7f36ceffd700 1 -- 172.21.15.26:0/27311429 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f36d8011390 con 0x7f36e0131f40 2023-10-01T07:55:16.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.527+0000 7f294a8ea700 1 -- 172.21.15.26:0/3068366197 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f29440713a0 con 0x7f2944135c20 2023-10-01T07:55:16.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.527+0000 7f48da39f700 1 -- 172.21.15.26:0/1666140115 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48d409e1e0 msgr2=0x7f48d4122790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:16.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.527+0000 7f48da39f700 1 --2- 172.21.15.26:0/1666140115 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48d409e1e0 0x7f48d4122790 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f48c400c4d0 tx=0x7f48c400c7e0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.528 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:16.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.527+0000 7f48da39f700 1 -- 172.21.15.26:0/1666140115 shutdown_connections 2023-10-01T07:55:16.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.527+0000 7f48da39f700 1 --2- 172.21.15.26:0/1666140115 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48d409e610 0x7f48d4122cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.527+0000 7f48da39f700 1 --2- 172.21.15.26:0/1666140115 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48d409d8d0 0x7f48d4122250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.527+0000 7f48da39f700 1 --2- 172.21.15.26:0/1666140115 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48d409e1e0 0x7f48d4122790 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.527+0000 7f48da39f700 1 -- 172.21.15.26:0/1666140115 >> 172.21.15.26:0/1666140115 conn(0x7f48d40a2e20 msgr2=0x7f48d4130700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:16.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.528+0000 7f2940ff9700 1 -- 172.21.15.26:0/3068366197 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f293c015030 con 0x7f2944135c20 2023-10-01T07:55:16.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.528+0000 7f48da39f700 1 -- 172.21.15.26:0/1666140115 shutdown_connections 2023-10-01T07:55:16.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.528+0000 7f48da39f700 1 -- 172.21.15.26:0/1666140115 wait complete. 2023-10-01T07:55:16.530 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:16.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.530+0000 7f36e4984700 1 -- 172.21.15.26:0/27311429 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f36e0131f40 msgr2=0x7f36e011c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:16.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.530+0000 7f36e4984700 1 --2- 172.21.15.26:0/27311429 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f36e0131f40 0x7f36e011c190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f36e0131570 tx=0x7f36d8004ad0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.530+0000 7f36e4984700 1 -- 172.21.15.26:0/27311429 shutdown_connections 2023-10-01T07:55:16.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.530+0000 7f36e4984700 1 --2- 172.21.15.26:0/27311429 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f36e0131f40 0x7f36e011c190 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.530+0000 7f36e4984700 1 --2- 172.21.15.26:0/27311429 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36e006e9d0 0x7f36e011b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.530+0000 7f36e4984700 1 --2- 172.21.15.26:0/27311429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36e0131630 0x7f36e011bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.530+0000 7f36e4984700 1 -- 172.21.15.26:0/27311429 >> 172.21.15.26:0/27311429 conn(0x7f36e00a2aa0 msgr2=0x7f36e01b8c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:16.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.530+0000 7f36e4984700 1 -- 172.21.15.26:0/27311429 shutdown_connections 2023-10-01T07:55:16.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.530+0000 7f36e4984700 1 -- 172.21.15.26:0/27311429 wait complete. 2023-10-01T07:55:16.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.531+0000 7f294a8ea700 1 -- 172.21.15.26:0/3068366197 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2944135c20 msgr2=0x7f2944131380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:16.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.531+0000 7f294a8ea700 1 --2- 172.21.15.26:0/3068366197 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2944135c20 0x7f2944131380 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2944071910 tx=0x7f293c004ad0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.531+0000 7f294a8ea700 1 -- 172.21.15.26:0/3068366197 shutdown_connections 2023-10-01T07:55:16.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.531+0000 7f294a8ea700 1 --2- 172.21.15.26:0/3068366197 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2944135c20 0x7f2944131380 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.531+0000 7f294a8ea700 1 --2- 172.21.15.26:0/3068366197 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f294406f5d0 0x7f2944130900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.531+0000 7f294a8ea700 1 --2- 172.21.15.26:0/3068366197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f294412cf60 0x7f2944130e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.531+0000 7f294a8ea700 1 -- 172.21.15.26:0/3068366197 >> 172.21.15.26:0/3068366197 conn(0x7f29440a2aa0 msgr2=0x7f294406e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:16.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.531+0000 7f294a8ea700 1 -- 172.21.15.26:0/3068366197 shutdown_connections 2023-10-01T07:55:16.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.531+0000 7f294a8ea700 1 -- 172.21.15.26:0/3068366197 wait complete. 2023-10-01T07:55:16.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:16.546 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:16.554 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:16.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.606+0000 7f09faa8f700 1 -- 172.21.15.26:0/3771159022 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f09f411e510 con 0x7f09f4099a40 2023-10-01T07:55:16.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.606+0000 7f09f17fa700 1 -- 172.21.15.26:0/3771159022 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f09e8017070 con 0x7f09f4099a40 2023-10-01T07:55:16.607 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:16.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.608+0000 7f09faa8f700 1 -- 172.21.15.26:0/3771159022 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f09f4099a40 msgr2=0x7f09f411b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:16.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.608+0000 7f09faa8f700 1 --2- 172.21.15.26:0/3771159022 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f09f4099a40 0x7f09f411b6b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f09e800e9e0 tx=0x7f09e800ecf0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.608+0000 7f09faa8f700 1 -- 172.21.15.26:0/3771159022 shutdown_connections 2023-10-01T07:55:16.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.608+0000 7f09faa8f700 1 --2- 172.21.15.26:0/3771159022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09f4131810 0x7f09f411c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.608+0000 7f09faa8f700 1 --2- 172.21.15.26:0/3771159022 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f09f4099a40 0x7f09f411b6b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.608+0000 7f09faa8f700 1 --2- 172.21.15.26:0/3771159022 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f09f409a3b0 0x7f09f411bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:16.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.608+0000 7f09faa8f700 1 -- 172.21.15.26:0/3771159022 >> 172.21.15.26:0/3771159022 conn(0x7f09f40a2aa0 msgr2=0x7f09f41b8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:16.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.609+0000 7f09faa8f700 1 -- 172.21.15.26:0/3771159022 shutdown_connections 2023-10-01T07:55:16.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:16.609+0000 7f09faa8f700 1 -- 172.21.15.26:0/3771159022 wait complete. 2023-10-01T07:55:16.622 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:17.546 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:17.547 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:17.556 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:17.623 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:17.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.700+0000 7f08e62cf700 1 Processor -- start 2023-10-01T07:55:17.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.700+0000 7f08e62cf700 1 -- start start 2023-10-01T07:55:17.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.701+0000 7f08e62cf700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f08e009d6f0 0x7f08e009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:17.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.701+0000 7f08e62cf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08e009e440 0x7f08e0134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:17.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.701+0000 7f08e62cf700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e009b120 con 0x7f08e009e000 2023-10-01T07:55:17.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.701+0000 7f08e62cf700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e006b460 con 0x7f08e009d6f0 2023-10-01T07:55:17.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.701+0000 7f08e62cf700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08e009a7e0 con 0x7f08e009e440 2023-10-01T07:55:17.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.701+0000 7f08e486c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08e009e440 0x7f08e0134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:17.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.701+0000 7f08e486c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08e009e440 0x7f08e0134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55120/0 (socket says 172.21.15.26:55120) 2023-10-01T07:55:17.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.701+0000 7f08e486c700 1 -- 172.21.15.26:0/3909236190 learned_addr learned my addr 172.21.15.26:0/3909236190 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:17.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.701+0000 7f08dffff700 1 --2- 172.21.15.26:0/3909236190 >> v2:172.21.15.26:3300/0 conn(0x7f08e009d6f0 0x7f08e009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:17.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.702+0000 7f08e486c700 1 -- 172.21.15.26:0/3909236190 >> v2:172.21.15.26:3300/0 conn(0x7f08e009d6f0 msgr2=0x7f08e009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:17.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.702+0000 7f08e486c700 1 --2- 172.21.15.26:0/3909236190 >> v2:172.21.15.26:3300/0 conn(0x7f08e009d6f0 0x7f08e009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:17.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.702+0000 7f08e486c700 1 -- 172.21.15.26:0/3909236190 >> v1:172.21.15.26:6789/0 conn(0x7f08e009e000 legacy=0x7f08e01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:17.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.702+0000 7f08e486c700 1 -- 172.21.15.26:0/3909236190 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e009a500 con 0x7f08e009e440 2023-10-01T07:55:17.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.702+0000 7f08dffff700 1 --2- 172.21.15.26:0/3909236190 >> v2:172.21.15.26:3300/0 conn(0x7f08e009d6f0 0x7f08e009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:55:17.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.702+0000 7f08e486c700 1 --2- 172.21.15.26:0/3909236190 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08e009e440 0x7f08e0134100 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f08d8009e80 tx=0x7f08d800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49b906ab7de7024b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:17.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.702+0000 7f08deffd700 1 -- 172.21.15.26:0/3909236190 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d800e070 con 0x7f08e009e440 2023-10-01T07:55:17.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.702+0000 7f08deffd700 1 -- 172.21.15.26:0/3909236190 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d800b980 con 0x7f08e009e440 2023-10-01T07:55:17.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.702+0000 7f08deffd700 1 -- 172.21.15.26:0/3909236190 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d800bd30 con 0x7f08e009e440 2023-10-01T07:55:17.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.703+0000 7f08e62cf700 1 -- 172.21.15.26:0/3909236190 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08e009e440 msgr2=0x7f08e0134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:17.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.703+0000 7f08e62cf700 1 --2- 172.21.15.26:0/3909236190 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08e009e440 0x7f08e0134100 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f08d8009e80 tx=0x7f08d800b330 comp rx=0 tx=0).stop 2023-10-01T07:55:17.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.703+0000 7f08e62cf700 1 -- 172.21.15.26:0/3909236190 shutdown_connections 2023-10-01T07:55:17.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.703+0000 7f08e62cf700 1 --2- 172.21.15.26:0/3909236190 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08e009e440 0x7f08e0134100 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:17.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.703+0000 7f08e62cf700 1 --2- 172.21.15.26:0/3909236190 >> v2:172.21.15.26:3300/0 conn(0x7f08e009d6f0 0x7f08e009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:17.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.703+0000 7f08e62cf700 1 -- 172.21.15.26:0/3909236190 >> 172.21.15.26:0/3909236190 conn(0x7f08e0066f50 msgr2=0x7f08e009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:17.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.703+0000 7f08e62cf700 1 -- 172.21.15.26:0/3909236190 shutdown_connections 2023-10-01T07:55:17.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.703+0000 7f08e62cf700 1 -- 172.21.15.26:0/3909236190 wait complete. 2023-10-01T07:55:17.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.704+0000 7f08e62cf700 1 Processor -- start 2023-10-01T07:55:17.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.705+0000 7f08e62cf700 1 -- start start 2023-10-01T07:55:17.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.705+0000 7f08e62cf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08e009d6f0 0x7f08e01a5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:17.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.706+0000 7f08e62cf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08e009e000 0x7f08e01a6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:17.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.706+0000 7f08e62cf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08e009e440 0x7f08e01a68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:17.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.706+0000 7f08e62cf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e01aa2b0 con 0x7f08e009e440 2023-10-01T07:55:17.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.706+0000 7f08e62cf700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e01a98f0 con 0x7f08e009e000 2023-10-01T07:55:17.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.706+0000 7f08e62cf700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08e00a1fb0 con 0x7f08e009d6f0 2023-10-01T07:55:17.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.706+0000 7f08dffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08e009d6f0 0x7f08e01a5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:17.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.706+0000 7f08dffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08e009d6f0 0x7f08e01a5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55130/0 (socket says 172.21.15.26:55130) 2023-10-01T07:55:17.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.706+0000 7f08dffff700 1 -- 172.21.15.26:0/746899531 learned_addr learned my addr 172.21.15.26:0/746899531 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:17.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.706+0000 7f08e486c700 1 --2- 172.21.15.26:0/746899531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08e009e440 0x7f08e01a68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:17.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.706+0000 7f08e486c700 1 -- 172.21.15.26:0/746899531 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08e009d6f0 msgr2=0x7f08e01a5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:17.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.706+0000 7f08e486c700 1 --2- 172.21.15.26:0/746899531 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08e009d6f0 0x7f08e01a5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:17.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.706+0000 7f08e486c700 1 -- 172.21.15.26:0/746899531 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08e009e000 msgr2=0x7f08e01a6360 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:17.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.706+0000 7f08e486c700 1 --2- 172.21.15.26:0/746899531 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08e009e000 0x7f08e01a6360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:17.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.706+0000 7f08e486c700 1 -- 172.21.15.26:0/746899531 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d8009b30 con 0x7f08e009e440 2023-10-01T07:55:17.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.706+0000 7f08dffff700 1 --2- 172.21.15.26:0/746899531 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08e009d6f0 0x7f08e01a5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:17.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.706+0000 7f08e486c700 1 --2- 172.21.15.26:0/746899531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08e009e440 0x7f08e01a68a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f08d8015000 tx=0x7f08d8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:17.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.707+0000 7f08dcff9700 1 -- 172.21.15.26:0/746899531 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d80048b0 con 0x7f08e009e440 2023-10-01T07:55:17.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.707+0000 7f08dcff9700 1 -- 172.21.15.26:0/746899531 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d80092e0 con 0x7f08e009e440 2023-10-01T07:55:17.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.707+0000 7f08e62cf700 1 -- 172.21.15.26:0/746899531 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e01a9080 con 0x7f08e009e440 2023-10-01T07:55:17.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.707+0000 7f08dcff9700 1 -- 172.21.15.26:0/746899531 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d801c660 con 0x7f08e009e440 2023-10-01T07:55:17.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.707+0000 7f08e62cf700 1 -- 172.21.15.26:0/746899531 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e01a79e0 con 0x7f08e009e440 2023-10-01T07:55:17.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.708+0000 7f08dcff9700 1 -- 172.21.15.26:0/746899531 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f08d801c7c0 con 0x7f08e009e440 2023-10-01T07:55:17.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.708+0000 7f08dcff9700 1 -- 172.21.15.26:0/746899531 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f08d8040ee0 con 0x7f08e009e440 2023-10-01T07:55:17.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.708+0000 7f08e62cf700 1 -- 172.21.15.26:0/746899531 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e0074ea0 con 0x7f08e009e440 2023-10-01T07:55:17.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.710+0000 7f57c51a8700 1 Processor -- start 2023-10-01T07:55:17.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.710+0000 7f57c51a8700 1 -- start start 2023-10-01T07:55:17.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.711+0000 7f57c51a8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f57c009d6f0 0x7f57c009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:17.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.711+0000 7f57c51a8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57c009e000 0x7f57c01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:17.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.711+0000 7f57c51a8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c009b120 con 0x7f57c009e410 2023-10-01T07:55:17.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.711+0000 7f57c51a8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c006b460 con 0x7f57c009d6f0 2023-10-01T07:55:17.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.711+0000 7f57c51a8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c009a7e0 con 0x7f57c009e000 2023-10-01T07:55:17.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.711+0000 7f57bf59e700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f57c009e410 0x7f57c0133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41244/0 (socket says 172.21.15.26:41244) 2023-10-01T07:55:17.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.711+0000 7f57bf59e700 1 -- 172.21.15.26:0/472107644 learned_addr learned my addr 172.21.15.26:0/472107644 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:17.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.711+0000 7f57bed9d700 1 --2- 172.21.15.26:0/472107644 >> v2:172.21.15.26:3300/0 conn(0x7f57c009d6f0 0x7f57c009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:17.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.712+0000 7f57bed9d700 1 -- 172.21.15.26:0/472107644 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57c009e000 msgr2=0x7f57c01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:17.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.712+0000 7f57bed9d700 1 --2- 172.21.15.26:0/472107644 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57c009e000 0x7f57c01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:17.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.712+0000 7f57bed9d700 1 -- 172.21.15.26:0/472107644 >> v1:172.21.15.26:6789/0 conn(0x7f57c009e410 legacy=0x7f57c0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:17.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.712+0000 7f57bed9d700 1 -- 172.21.15.26:0/472107644 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c009a500 con 0x7f57c009d6f0 2023-10-01T07:55:17.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.712+0000 7f57bed9d700 1 --2- 172.21.15.26:0/472107644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57c009d6f0 0x7f57c009dac0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f57b0009840 tx=0x7f57b0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11fa18f42d10669f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:17.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.714+0000 7f57bdd9b700 1 -- 172.21.15.26:0/472107644 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b0011830 con 0x7f57c009d6f0 2023-10-01T07:55:17.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.714+0000 7f08dcff9700 1 -- 172.21.15.26:0/746899531 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f08d80123f0 con 0x7f08e009e440 2023-10-01T07:55:17.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.714+0000 7f57bdd9b700 1 -- 172.21.15.26:0/472107644 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b0011990 con 0x7f57c009d6f0 2023-10-01T07:55:17.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.714+0000 7f57bdd9b700 1 -- 172.21.15.26:0/472107644 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b0011d20 con 0x7f57c009d6f0 2023-10-01T07:55:17.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.715+0000 7f57c51a8700 1 -- 172.21.15.26:0/472107644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57c009d6f0 msgr2=0x7f57c009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:17.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.715+0000 7f57c51a8700 1 --2- 172.21.15.26:0/472107644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57c009d6f0 0x7f57c009dac0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f57b0009840 tx=0x7f57b0009b50 comp rx=0 tx=0).stop 2023-10-01T07:55:17.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.715+0000 7f57c51a8700 1 -- 172.21.15.26:0/472107644 shutdown_connections 2023-10-01T07:55:17.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.715+0000 7f57c51a8700 1 --2- 172.21.15.26:0/472107644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57c009d6f0 0x7f57c009dac0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:17.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.715+0000 7f57c51a8700 1 --2- 172.21.15.26:0/472107644 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57c009e000 0x7f57c01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:17.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.715+0000 7f57c51a8700 1 -- 172.21.15.26:0/472107644 >> 172.21.15.26:0/472107644 conn(0x7f57c0066f50 msgr2=0x7f57c009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:17.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.715+0000 7f57c51a8700 1 -- 172.21.15.26:0/472107644 shutdown_connections 2023-10-01T07:55:17.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.715+0000 7f57c51a8700 1 -- 172.21.15.26:0/472107644 wait complete. 2023-10-01T07:55:17.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.717+0000 7f57c51a8700 1 Processor -- start 2023-10-01T07:55:17.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.717+0000 7f57c51a8700 1 -- start start 2023-10-01T07:55:17.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.718+0000 7f57c51a8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f57c009d6f0 0x7f57c01a6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:17.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.718+0000 7f57c51a8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57c009e000 0x7f57c01a6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:17.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.718+0000 7f57c51a8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57c009e410 0x7f57c01a6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:17.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.718+0000 7f57c51a8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c01a7c10 con 0x7f57c009e410 2023-10-01T07:55:17.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.718+0000 7f57c51a8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c01a8230 con 0x7f57c009e000 2023-10-01T07:55:17.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.718+0000 7f57c51a8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f57c01a8e60 con 0x7f57c009d6f0 2023-10-01T07:55:17.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.718+0000 7f57bf59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57c009e410 0x7f57c01a6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:17.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.718+0000 7f57bf59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57c009e410 0x7f57c01a6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36950/0 (socket says 172.21.15.26:36950) 2023-10-01T07:55:17.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.718+0000 7f57bf59e700 1 -- 172.21.15.26:0/4126875408 learned_addr learned my addr 172.21.15.26:0/4126875408 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:17.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.718+0000 7f57bed9d700 1 --2- 172.21.15.26:0/4126875408 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f57c009d6f0 0x7f57c01a6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:17.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.718+0000 7f57be59c700 1 --2- 172.21.15.26:0/4126875408 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57c009e000 0x7f57c01a6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:17.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.719+0000 7f57bed9d700 1 -- 172.21.15.26:0/4126875408 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57c009e000 msgr2=0x7f57c01a6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:17.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.719+0000 7f57bed9d700 1 --2- 172.21.15.26:0/4126875408 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57c009e000 0x7f57c01a6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:17.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.719+0000 7f57bed9d700 1 -- 172.21.15.26:0/4126875408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57c009e410 msgr2=0x7f57c01a6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:17.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.719+0000 7f57bed9d700 1 --2- 172.21.15.26:0/4126875408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57c009e410 0x7f57c01a6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:17.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.719+0000 7f57bed9d700 1 -- 172.21.15.26:0/4126875408 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b00094a0 con 0x7f57c009d6f0 2023-10-01T07:55:17.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.719+0000 7f57bf59e700 1 --2- 172.21.15.26:0/4126875408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57c009e410 0x7f57c01a6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:17.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.719+0000 7f57bed9d700 1 --2- 172.21.15.26:0/4126875408 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f57c009d6f0 0x7f57c01a6000 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f57b0009840 tx=0x7f57b0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:17.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.719+0000 7f57a77fe700 1 -- 172.21.15.26:0/4126875408 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b0004510 con 0x7f57c009d6f0 2023-10-01T07:55:17.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.719+0000 7f57a77fe700 1 -- 172.21.15.26:0/4126875408 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b001e070 con 0x7f57c009d6f0 2023-10-01T07:55:17.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.719+0000 7f57a77fe700 1 -- 172.21.15.26:0/4126875408 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b00038e0 con 0x7f57c009d6f0 2023-10-01T07:55:17.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.719+0000 7f57c51a8700 1 -- 172.21.15.26:0/4126875408 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c01a9840 con 0x7f57c009d6f0 2023-10-01T07:55:17.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.719+0000 7f57c51a8700 1 -- 172.21.15.26:0/4126875408 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c01a9310 con 0x7f57c009d6f0 2023-10-01T07:55:17.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.720+0000 7f57a77fe700 1 -- 172.21.15.26:0/4126875408 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f57b0003a40 con 0x7f57c009d6f0 2023-10-01T07:55:17.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.721+0000 7f57c51a8700 1 -- 172.21.15.26:0/4126875408 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c0074ea0 con 0x7f57c009d6f0 2023-10-01T07:55:17.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.721+0000 7f57a77fe700 1 -- 172.21.15.26:0/4126875408 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f57b00403a0 con 0x7f57c009d6f0 2023-10-01T07:55:17.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.726+0000 7f57a77fe700 1 -- 172.21.15.26:0/4126875408 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f57b00239a0 con 0x7f57c009d6f0 2023-10-01T07:55:17.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.756+0000 7ff9dbdc8700 1 Processor -- start 2023-10-01T07:55:17.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.756+0000 7ff9dbdc8700 1 -- start start 2023-10-01T07:55:17.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.757+0000 7ff9dbdc8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff9d409d6f0 0x7ff9d409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.757+0000 7ff9dbdc8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff9d409e000 0x7ff9d41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.757+0000 7ff9dbdc8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d409b120 con 0x7ff9d409e410 2023-10-01T07:55:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.757+0000 7ff9dbdc8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9d406b460 con 0x7ff9d409e000 2023-10-01T07:55:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.757+0000 7ff9dbdc8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d409a7e0 con 0x7ff9d409d6f0 2023-10-01T07:55:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.757+0000 7ff9d9363700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff9d409e000 0x7ff9d41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.757+0000 7ff9d9b64700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff9d409d6f0 0x7ff9d409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.757+0000 7ff9da365700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff9d409e410 0x7ff9d4133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41254/0 (socket says 172.21.15.26:41254) 2023-10-01T07:55:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.757+0000 7ff9da365700 1 -- 172.21.15.26:0/2511714909 learned_addr learned my addr 172.21.15.26:0/2511714909 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.757+0000 7ff9d9363700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff9d409e000 0x7ff9d41339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36964/0 (socket says 172.21.15.26:36964) 2023-10-01T07:55:17.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.758+0000 7ff9d9363700 1 -- 172.21.15.26:0/2511714909 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff9d409d6f0 msgr2=0x7ff9d409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:17.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.758+0000 7ff9d9363700 1 --2- 172.21.15.26:0/2511714909 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff9d409d6f0 0x7ff9d409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:17.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.758+0000 7ff9d9363700 1 -- 172.21.15.26:0/2511714909 >> v1:172.21.15.26:6789/0 conn(0x7ff9d409e410 legacy=0x7ff9d4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:17.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.758+0000 7ff9d9363700 1 -- 172.21.15.26:0/2511714909 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d409a500 con 0x7ff9d409e000 2023-10-01T07:55:17.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.758+0000 7ff9d8b62700 1 -- 172.21.15.26:0/2511714909 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 108265558 0 0) 0x7ff9d409b120 con 0x7ff9d409e410 2023-10-01T07:55:17.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.758+0000 7ff9d9b64700 1 --2- 172.21.15.26:0/2511714909 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff9d409d6f0 0x7ff9d409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:17.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.758+0000 7ff9d9363700 1 --2- 172.21.15.26:0/2511714909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9d409e000 0x7ff9d41339f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4009840 tx=0x7ff9c4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f28b513366e6849 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:17.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.758+0000 7ff9d8b62700 1 -- 172.21.15.26:0/2511714909 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4011830 con 0x7ff9d409e000 2023-10-01T07:55:17.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.758+0000 7ff9d8b62700 1 -- 172.21.15.26:0/2511714909 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c4011990 con 0x7ff9d409e000 2023-10-01T07:55:17.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.758+0000 7ff9d8b62700 1 -- 172.21.15.26:0/2511714909 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4011d20 con 0x7ff9d409e000 2023-10-01T07:55:17.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.759+0000 7ff9dbdc8700 1 -- 172.21.15.26:0/2511714909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9d409e000 msgr2=0x7ff9d41339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:17.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.759+0000 7ff9dbdc8700 1 --2- 172.21.15.26:0/2511714909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9d409e000 0x7ff9d41339f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4009840 tx=0x7ff9c4009b50 comp rx=0 tx=0).stop 2023-10-01T07:55:17.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.759+0000 7ff9dbdc8700 1 -- 172.21.15.26:0/2511714909 shutdown_connections 2023-10-01T07:55:17.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.759+0000 7ff9dbdc8700 1 --2- 172.21.15.26:0/2511714909 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff9d409d6f0 0x7ff9d409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:17.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.759+0000 7ff9dbdc8700 1 --2- 172.21.15.26:0/2511714909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9d409e000 0x7ff9d41339f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:17.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.759+0000 7ff9dbdc8700 1 -- 172.21.15.26:0/2511714909 >> 172.21.15.26:0/2511714909 conn(0x7ff9d4066f50 msgr2=0x7ff9d409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:17.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.759+0000 7ff9dbdc8700 1 -- 172.21.15.26:0/2511714909 shutdown_connections 2023-10-01T07:55:17.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.759+0000 7ff9dbdc8700 1 -- 172.21.15.26:0/2511714909 wait complete. 2023-10-01T07:55:17.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.761+0000 7ff9dbdc8700 1 Processor -- start 2023-10-01T07:55:17.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.761+0000 7ff9dbdc8700 1 -- start start 2023-10-01T07:55:17.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.762+0000 7ff9dbdc8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff9d409d6f0 0x7ff9d41ab930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:17.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.762+0000 7ff9dbdc8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9d409e000 0x7ff9d41abe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:17.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.762+0000 7ff9dbdc8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff9d409e410 0x7ff9d41ac3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:17.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.762+0000 7ff9dbdc8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d41bac50 con 0x7ff9d409e000 2023-10-01T07:55:17.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.762+0000 7ff9dbdc8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d41aee20 con 0x7ff9d409d6f0 2023-10-01T07:55:17.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.762+0000 7ff9dbdc8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d41af0e0 con 0x7ff9d409e410 2023-10-01T07:55:17.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.762+0000 7ff9d9363700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9d409e000 0x7ff9d41abe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:17.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.762+0000 7ff9d9363700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9d409e000 0x7ff9d41abe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36980/0 (socket says 172.21.15.26:36980) 2023-10-01T07:55:17.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.762+0000 7ff9d9363700 1 -- 172.21.15.26:0/3887369738 learned_addr learned my addr 172.21.15.26:0/3887369738 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:17.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.762+0000 7ff9da365700 1 --2- 172.21.15.26:0/3887369738 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff9d409e410 0x7ff9d41ac3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:17.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.762+0000 7ff9da365700 1 -- 172.21.15.26:0/3887369738 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff9d409d6f0 msgr2=0x7ff9d41ab930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:17.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.762+0000 7ff9da365700 1 --2- 172.21.15.26:0/3887369738 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff9d409d6f0 0x7ff9d41ab930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:17.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.762+0000 7ff9da365700 1 -- 172.21.15.26:0/3887369738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9d409e000 msgr2=0x7ff9d41abe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:17.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.762+0000 7ff9da365700 1 --2- 172.21.15.26:0/3887369738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9d409e000 0x7ff9d41abe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:17.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.762+0000 7ff9da365700 1 -- 172.21.15.26:0/3887369738 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d00094a0 con 0x7ff9d409e410 2023-10-01T07:55:17.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.762+0000 7ff9d9363700 1 --2- 172.21.15.26:0/3887369738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9d409e000 0x7ff9d41abe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:17.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.763+0000 7ff9da365700 1 --2- 172.21.15.26:0/3887369738 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff9d409e410 0x7ff9d41ac3b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00cbe0 tx=0x7ff9cc00cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:17.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.763+0000 7ff9ca7fc700 1 -- 172.21.15.26:0/3887369738 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc00ab50 con 0x7ff9d409e410 2023-10-01T07:55:17.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.763+0000 7ff9ca7fc700 1 -- 172.21.15.26:0/3887369738 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9cc00acb0 con 0x7ff9d409e410 2023-10-01T07:55:17.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.763+0000 7ff9ca7fc700 1 -- 172.21.15.26:0/3887369738 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc007310 con 0x7ff9d409e410 2023-10-01T07:55:17.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.763+0000 7ff9dbdc8700 1 -- 172.21.15.26:0/3887369738 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c40094a0 con 0x7ff9d409e410 2023-10-01T07:55:17.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.763+0000 7ff9dbdc8700 1 -- 172.21.15.26:0/3887369738 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d40a2f10 con 0x7ff9d409e410 2023-10-01T07:55:17.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.764+0000 7ff9ca7fc700 1 -- 172.21.15.26:0/3887369738 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff9cc007470 con 0x7ff9d409e410 2023-10-01T07:55:17.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.764+0000 7ff9dbdc8700 1 -- 172.21.15.26:0/3887369738 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d41aec70 con 0x7ff9d409e410 2023-10-01T07:55:17.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.764+0000 7ff9ca7fc700 1 -- 172.21.15.26:0/3887369738 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff9cc03f110 con 0x7ff9d409e410 2023-10-01T07:55:17.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.770+0000 7ff9ca7fc700 1 -- 172.21.15.26:0/3887369738 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff9cc019680 con 0x7ff9d409e410 2023-10-01T07:55:17.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.786+0000 7f6b50bab700 1 Processor -- start 2023-10-01T07:55:17.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.786+0000 7f6b50bab700 1 -- start start 2023-10-01T07:55:17.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.787+0000 7f6b50bab700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b4c06a770 0x7f6b4c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:17.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.787+0000 7f6b50bab700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6b4c06b080 0x7f6b4c131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:17.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.787+0000 7f6b50bab700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b4c09ece0 con 0x7f6b4c131b40 2023-10-01T07:55:17.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.787+0000 7f6b50bab700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b4c09e760 con 0x7f6b4c06b080 2023-10-01T07:55:17.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.787+0000 7f6b50bab700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c09e040 con 0x7f6b4c06a770 2023-10-01T07:55:17.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.787+0000 7f6b4a59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b4c06a770 0x7f6b4c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:17.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.787+0000 7f6b4ad9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6b4c131b40 0x7f6b4c138850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41256/0 (socket says 172.21.15.26:41256) 2023-10-01T07:55:17.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.787+0000 7f6b4ad9d700 1 -- 172.21.15.26:0/2098363226 learned_addr learned my addr 172.21.15.26:0/2098363226 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:17.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.787+0000 7f6b4a59c700 1 --2- 172.21.15.26:0/2098363226 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b4c06a770 0x7f6b4c06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37586/0 (socket says 172.21.15.26:37586) 2023-10-01T07:55:17.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.787+0000 7f6b49d9b700 1 --2- 172.21.15.26:0/2098363226 >> v2:172.21.15.26:3300/0 conn(0x7f6b4c06b080 0x7f6b4c131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:17.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.787+0000 7f6b4959a700 1 -- 172.21.15.26:0/2098363226 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266726906 0 0) 0x7f6b4c09ece0 con 0x7f6b4c131b40 2023-10-01T07:55:17.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.787+0000 7f6b4959a700 1 -- 172.21.15.26:0/2098363226 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b340035b0 con 0x7f6b4c131b40 2023-10-01T07:55:17.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.787+0000 7f6b4a59c700 1 -- 172.21.15.26:0/2098363226 >> v2:172.21.15.26:3300/0 conn(0x7f6b4c06b080 msgr2=0x7f6b4c131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:17.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.787+0000 7f6b4a59c700 1 --2- 172.21.15.26:0/2098363226 >> v2:172.21.15.26:3300/0 conn(0x7f6b4c06b080 0x7f6b4c131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:17.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.787+0000 7f6b4a59c700 1 -- 172.21.15.26:0/2098363226 >> v1:172.21.15.26:6789/0 conn(0x7f6b4c131b40 legacy=0x7f6b4c138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:17.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.787+0000 7f6b4a59c700 1 -- 172.21.15.26:0/2098363226 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4c09f630 con 0x7f6b4c06a770 2023-10-01T07:55:17.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.788+0000 7f6b4a59c700 1 --2- 172.21.15.26:0/2098363226 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b4c06a770 0x7f6b4c06ab40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c009840 tx=0x7f6b3c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42db16ae6ff0e378 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:17.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.788+0000 7f6b4959a700 1 -- 172.21.15.26:0/2098363226 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c011830 con 0x7f6b4c06a770 2023-10-01T07:55:17.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.788+0000 7f6b4959a700 1 -- 172.21.15.26:0/2098363226 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3c011990 con 0x7f6b4c06a770 2023-10-01T07:55:17.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.788+0000 7f6b4959a700 1 -- 172.21.15.26:0/2098363226 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c011d20 con 0x7f6b4c06a770 2023-10-01T07:55:17.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.789+0000 7f6b50bab700 1 -- 172.21.15.26:0/2098363226 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b4c06a770 msgr2=0x7f6b4c06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:17.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.789+0000 7f6b50bab700 1 --2- 172.21.15.26:0/2098363226 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b4c06a770 0x7f6b4c06ab40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c009840 tx=0x7f6b3c009b50 comp rx=0 tx=0).stop 2023-10-01T07:55:17.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.789+0000 7f6b50bab700 1 -- 172.21.15.26:0/2098363226 shutdown_connections 2023-10-01T07:55:17.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.789+0000 7f6b50bab700 1 --2- 172.21.15.26:0/2098363226 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b4c06a770 0x7f6b4c06ab40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:17.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.789+0000 7f6b50bab700 1 --2- 172.21.15.26:0/2098363226 >> v2:172.21.15.26:3300/0 conn(0x7f6b4c06b080 0x7f6b4c131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:17.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.789+0000 7f6b50bab700 1 -- 172.21.15.26:0/2098363226 >> 172.21.15.26:0/2098363226 conn(0x7f6b4c066f50 msgr2=0x7f6b4c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:17.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.789+0000 7f6b50bab700 1 -- 172.21.15.26:0/2098363226 shutdown_connections 2023-10-01T07:55:17.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.789+0000 7f6b50bab700 1 -- 172.21.15.26:0/2098363226 wait complete. 2023-10-01T07:55:17.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.790+0000 7f6b50bab700 1 Processor -- start 2023-10-01T07:55:17.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.790+0000 7f6b50bab700 1 -- start start 2023-10-01T07:55:17.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.791+0000 7f6b50bab700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b4c06a770 0x7f6b4c11ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:17.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.791+0000 7f6b50bab700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b4c06b080 0x7f6b4c11f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:17.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.791+0000 7f6b50bab700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b4c131b40 0x7f6b4c1c3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:17.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.791+0000 7f6b50bab700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c11ea90 con 0x7f6b4c131b40 2023-10-01T07:55:17.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.791+0000 7f6b50bab700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c130f20 con 0x7f6b4c06b080 2023-10-01T07:55:17.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.791+0000 7f6b50bab700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c09a680 con 0x7f6b4c06a770 2023-10-01T07:55:17.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.791+0000 7f6b4ad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b4c131b40 0x7f6b4c1c3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:17.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.791+0000 7f6b49d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b4c06b080 0x7f6b4c11f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:17.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.791+0000 7f6b4ad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b4c131b40 0x7f6b4c1c3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37010/0 (socket says 172.21.15.26:37010) 2023-10-01T07:55:17.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.791+0000 7f6b4ad9d700 1 -- 172.21.15.26:0/2426354795 learned_addr learned my addr 172.21.15.26:0/2426354795 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:17.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.791+0000 7f6b4a59c700 1 --2- 172.21.15.26:0/2426354795 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b4c06a770 0x7f6b4c11ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:17.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.791+0000 7f6b49d9b700 1 -- 172.21.15.26:0/2426354795 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b4c06a770 msgr2=0x7f6b4c11ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:17.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.791+0000 7f6b49d9b700 1 --2- 172.21.15.26:0/2426354795 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b4c06a770 0x7f6b4c11ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:17.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.791+0000 7f6b49d9b700 1 -- 172.21.15.26:0/2426354795 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b4c131b40 msgr2=0x7f6b4c1c3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:17.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.791+0000 7f6b49d9b700 1 --2- 172.21.15.26:0/2426354795 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b4c131b40 0x7f6b4c1c3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:17.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.791+0000 7f6b49d9b700 1 -- 172.21.15.26:0/2426354795 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b3c0094a0 con 0x7f6b4c06b080 2023-10-01T07:55:17.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.791+0000 7f6b4ad9d700 1 --2- 172.21.15.26:0/2426354795 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b4c131b40 0x7f6b4c1c3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:17.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.792+0000 7f6b49d9b700 1 --2- 172.21.15.26:0/2426354795 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b4c06b080 0x7f6b4c11f380 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000ddb0 tx=0x7f6b400103a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:17.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.792+0000 7f6b3affd700 1 -- 172.21.15.26:0/2426354795 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b40010d10 con 0x7f6b4c06b080 2023-10-01T07:55:17.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.792+0000 7f6b3affd700 1 -- 172.21.15.26:0/2426354795 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b40013040 con 0x7f6b4c06b080 2023-10-01T07:55:17.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.792+0000 7f6b50bab700 1 -- 172.21.15.26:0/2426354795 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b4c121df0 con 0x7f6b4c06b080 2023-10-01T07:55:17.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.792+0000 7f6b3affd700 1 -- 172.21.15.26:0/2426354795 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b40018680 con 0x7f6b4c06b080 2023-10-01T07:55:17.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.792+0000 7f6b50bab700 1 -- 172.21.15.26:0/2426354795 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b4c1209b0 con 0x7f6b4c06b080 2023-10-01T07:55:17.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.793+0000 7f6b50bab700 1 -- 172.21.15.26:0/2426354795 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b4c074ea0 con 0x7f6b4c06b080 2023-10-01T07:55:17.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.798+0000 7f6b3affd700 1 -- 172.21.15.26:0/2426354795 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6b400187e0 con 0x7f6b4c06b080 2023-10-01T07:55:17.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.798+0000 7f6b3affd700 1 -- 172.21.15.26:0/2426354795 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6b40044890 con 0x7f6b4c06b080 2023-10-01T07:55:17.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.803+0000 7f6b3affd700 1 -- 172.21.15.26:0/2426354795 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6b40016930 con 0x7f6b4c06b080 2023-10-01T07:55:17.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.936+0000 7f57c51a8700 1 -- 172.21.15.26:0/4126875408 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f57c01a92f0 con 0x7f57c009d6f0 2023-10-01T07:55:17.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.936+0000 7f57a77fe700 1 -- 172.21.15.26:0/4126875408 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f57b0015020 con 0x7f57c009d6f0 2023-10-01T07:55:17.937 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:17.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.938+0000 7f57c51a8700 1 -- 172.21.15.26:0/4126875408 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f57c009d6f0 msgr2=0x7f57c01a6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:17.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.938+0000 7f57c51a8700 1 --2- 172.21.15.26:0/4126875408 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f57c009d6f0 0x7f57c01a6000 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f57b0009840 tx=0x7f57b0004750 comp rx=0 tx=0).stop 2023-10-01T07:55:17.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.939+0000 7f57c51a8700 1 -- 172.21.15.26:0/4126875408 shutdown_connections 2023-10-01T07:55:17.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.939+0000 7f57c51a8700 1 --2- 172.21.15.26:0/4126875408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57c009e410 0x7f57c01a6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:17.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.939+0000 7f57c51a8700 1 --2- 172.21.15.26:0/4126875408 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f57c009d6f0 0x7f57c01a6000 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:17.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.939+0000 7f57c51a8700 1 --2- 172.21.15.26:0/4126875408 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57c009e000 0x7f57c01a6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:17.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.939+0000 7f57c51a8700 1 -- 172.21.15.26:0/4126875408 >> 172.21.15.26:0/4126875408 conn(0x7f57c0066f50 msgr2=0x7f57c01baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:17.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.939+0000 7f57c51a8700 1 -- 172.21.15.26:0/4126875408 shutdown_connections 2023-10-01T07:55:17.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.939+0000 7f57c51a8700 1 -- 172.21.15.26:0/4126875408 wait complete. 2023-10-01T07:55:17.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.949+0000 7f08e62cf700 1 -- 172.21.15.26:0/746899531 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f08e009f420 con 0x7f08e009e440 2023-10-01T07:55:17.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.949+0000 7f08dcff9700 1 -- 172.21.15.26:0/746899531 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f08d8033090 con 0x7f08e009e440 2023-10-01T07:55:17.950 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:17.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.953+0000 7f08e62cf700 1 -- 172.21.15.26:0/746899531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08e009e440 msgr2=0x7f08e01a68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:17.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.953+0000 7f08e62cf700 1 --2- 172.21.15.26:0/746899531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08e009e440 0x7f08e01a68a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f08d8015000 tx=0x7f08d8004ad0 comp rx=0 tx=0).stop 2023-10-01T07:55:17.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.953+0000 7f08e62cf700 1 -- 172.21.15.26:0/746899531 shutdown_connections 2023-10-01T07:55:17.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.953+0000 7f08e62cf700 1 --2- 172.21.15.26:0/746899531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08e009e440 0x7f08e01a68a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:17.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.953+0000 7f08e62cf700 1 --2- 172.21.15.26:0/746899531 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08e009d6f0 0x7f08e01a5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:17.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.953+0000 7f08e62cf700 1 --2- 172.21.15.26:0/746899531 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08e009e000 0x7f08e01a6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:17.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.953+0000 7f08e62cf700 1 -- 172.21.15.26:0/746899531 >> 172.21.15.26:0/746899531 conn(0x7f08e0066f50 msgr2=0x7f08e01baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:17.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.953+0000 7f08e62cf700 1 -- 172.21.15.26:0/746899531 shutdown_connections 2023-10-01T07:55:17.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.953+0000 7f08e62cf700 1 -- 172.21.15.26:0/746899531 wait complete. 2023-10-01T07:55:17.957 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:17.968 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:17.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.981+0000 7ff9dbdc8700 1 -- 172.21.15.26:0/3887369738 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff9d4074ea0 con 0x7ff9d409e410 2023-10-01T07:55:17.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.982+0000 7ff9ca7fc700 1 -- 172.21.15.26:0/3887369738 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff9cc01a310 con 0x7ff9d409e410 2023-10-01T07:55:17.983 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:17.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.984+0000 7ff9dbdc8700 1 -- 172.21.15.26:0/3887369738 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff9d409e410 msgr2=0x7ff9d41ac3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:17.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.984+0000 7ff9dbdc8700 1 --2- 172.21.15.26:0/3887369738 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff9d409e410 0x7ff9d41ac3b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00cbe0 tx=0x7ff9cc00cef0 comp rx=0 tx=0).stop 2023-10-01T07:55:17.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.984+0000 7ff9dbdc8700 1 -- 172.21.15.26:0/3887369738 shutdown_connections 2023-10-01T07:55:17.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.984+0000 7ff9dbdc8700 1 --2- 172.21.15.26:0/3887369738 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff9d409e410 0x7ff9d41ac3b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:17.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.984+0000 7ff9dbdc8700 1 --2- 172.21.15.26:0/3887369738 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff9d409d6f0 0x7ff9d41ab930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:17.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.984+0000 7ff9dbdc8700 1 --2- 172.21.15.26:0/3887369738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9d409e000 0x7ff9d41abe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:17.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.984+0000 7ff9dbdc8700 1 -- 172.21.15.26:0/3887369738 >> 172.21.15.26:0/3887369738 conn(0x7ff9d4066f50 msgr2=0x7ff9d40a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:17.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.984+0000 7ff9dbdc8700 1 -- 172.21.15.26:0/3887369738 shutdown_connections 2023-10-01T07:55:17.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:17.984+0000 7ff9dbdc8700 1 -- 172.21.15.26:0/3887369738 wait complete. 2023-10-01T07:55:17.998 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:18.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:18.011+0000 7f6b50bab700 1 -- 172.21.15.26:0/2426354795 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6b4c06c360 con 0x7f6b4c06b080 2023-10-01T07:55:18.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:18.012+0000 7f6b3affd700 1 -- 172.21.15.26:0/2426354795 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6b4002e030 con 0x7f6b4c06b080 2023-10-01T07:55:18.012 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:18.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:18.014+0000 7f6b50bab700 1 -- 172.21.15.26:0/2426354795 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b4c06b080 msgr2=0x7f6b4c11f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:18.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:18.014+0000 7f6b50bab700 1 --2- 172.21.15.26:0/2426354795 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b4c06b080 0x7f6b4c11f380 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000ddb0 tx=0x7f6b400103a0 comp rx=0 tx=0).stop 2023-10-01T07:55:18.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:18.014+0000 7f6b50bab700 1 -- 172.21.15.26:0/2426354795 shutdown_connections 2023-10-01T07:55:18.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:18.014+0000 7f6b50bab700 1 --2- 172.21.15.26:0/2426354795 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b4c131b40 0x7f6b4c1c3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:18.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:18.014+0000 7f6b50bab700 1 --2- 172.21.15.26:0/2426354795 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b4c06a770 0x7f6b4c11ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:18.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:18.014+0000 7f6b50bab700 1 --2- 172.21.15.26:0/2426354795 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b4c06b080 0x7f6b4c11f380 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:18.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:18.014+0000 7f6b50bab700 1 -- 172.21.15.26:0/2426354795 >> 172.21.15.26:0/2426354795 conn(0x7f6b4c066f50 msgr2=0x7f6b4c0a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:18.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:18.014+0000 7f6b50bab700 1 -- 172.21.15.26:0/2426354795 shutdown_connections 2023-10-01T07:55:18.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:18.014+0000 7f6b50bab700 1 -- 172.21.15.26:0/2426354795 wait complete. 2023-10-01T07:55:18.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:18.958 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:18.969 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:18.999 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:19.029 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:19.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.122+0000 7f3d58c06700 1 Processor -- start 2023-10-01T07:55:19.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.122+0000 7f3d58c06700 1 -- start start 2023-10-01T07:55:19.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.123+0000 7f3d58c06700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3d541338c0 0x7f3d54133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:19.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.123+0000 7f3d58c06700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d541341d0 0x7f3d5409de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:19.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.123+0000 7f3d58c06700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d5406f720 con 0x7f3d5409e390 2023-10-01T07:55:19.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.123+0000 7f3d58c06700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d54070c80 con 0x7f3d541341d0 2023-10-01T07:55:19.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.123+0000 7f3d58c06700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5406fce0 con 0x7f3d541338c0 2023-10-01T07:55:19.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.123+0000 7f3d52d9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3d5409e390 0x7f3d5413a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41266/0 (socket says 172.21.15.26:41266) 2023-10-01T07:55:19.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.123+0000 7f3d52d9d700 1 -- 172.21.15.26:0/3050096758 learned_addr learned my addr 172.21.15.26:0/3050096758 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:19.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.123+0000 7f3d5259c700 1 --2- 172.21.15.26:0/3050096758 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3d541338c0 0x7f3d54133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:19.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.123+0000 7f3d4bfff700 1 --2- 172.21.15.26:0/3050096758 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d541341d0 0x7f3d5409de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:19.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.123+0000 7f3d5259c700 1 -- 172.21.15.26:0/3050096758 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d541341d0 msgr2=0x7f3d5409de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:19.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.123+0000 7f3d5259c700 1 --2- 172.21.15.26:0/3050096758 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d541341d0 0x7f3d5409de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:19.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.123+0000 7f3d5259c700 1 -- 172.21.15.26:0/3050096758 >> v1:172.21.15.26:6789/0 conn(0x7f3d5409e390 legacy=0x7f3d5413a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:19.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.123+0000 7f3d5259c700 1 -- 172.21.15.26:0/3050096758 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d541336a0 con 0x7f3d541338c0 2023-10-01T07:55:19.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.124+0000 7f3d4bfff700 1 --2- 172.21.15.26:0/3050096758 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d541341d0 0x7f3d5409de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:55:19.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.124+0000 7f3d5259c700 1 --2- 172.21.15.26:0/3050096758 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3d541338c0 0x7f3d54133c90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3d44009870 tx=0x7f3d44009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b49204176a4ffbb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:19.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.124+0000 7f3d51d9b700 1 -- 172.21.15.26:0/3050096758 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d44011830 con 0x7f3d541338c0 2023-10-01T07:55:19.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.124+0000 7f3d51d9b700 1 -- 172.21.15.26:0/3050096758 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d44011990 con 0x7f3d541338c0 2023-10-01T07:55:19.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.124+0000 7f3d51d9b700 1 -- 172.21.15.26:0/3050096758 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d44011d20 con 0x7f3d541338c0 2023-10-01T07:55:19.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.125+0000 7f3d58c06700 1 -- 172.21.15.26:0/3050096758 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3d541338c0 msgr2=0x7f3d54133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:19.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.125+0000 7f3d58c06700 1 --2- 172.21.15.26:0/3050096758 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3d541338c0 0x7f3d54133c90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3d44009870 tx=0x7f3d44009b80 comp rx=0 tx=0).stop 2023-10-01T07:55:19.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.125+0000 7f3d58c06700 1 -- 172.21.15.26:0/3050096758 shutdown_connections 2023-10-01T07:55:19.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.125+0000 7f3d58c06700 1 --2- 172.21.15.26:0/3050096758 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3d541338c0 0x7f3d54133c90 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:19.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.125+0000 7f3d58c06700 1 --2- 172.21.15.26:0/3050096758 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d541341d0 0x7f3d5409de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:19.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.125+0000 7f3d58c06700 1 -- 172.21.15.26:0/3050096758 >> 172.21.15.26:0/3050096758 conn(0x7f3d540a2aa0 msgr2=0x7f3d540a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:19.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.125+0000 7f3d58c06700 1 -- 172.21.15.26:0/3050096758 shutdown_connections 2023-10-01T07:55:19.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.125+0000 7f3d58c06700 1 -- 172.21.15.26:0/3050096758 wait complete. 2023-10-01T07:55:19.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.127+0000 7f3d58c06700 1 Processor -- start 2023-10-01T07:55:19.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.127+0000 7f3d58c06700 1 -- start start 2023-10-01T07:55:19.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.127+0000 7f3d58c06700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d5409e390 0x7f3d5411f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:19.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.128+0000 7f3d58c06700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d541338c0 0x7f3d5411fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:19.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.128+0000 7f3d58c06700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3d541341d0 0x7f3d541203e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:19.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.128+0000 7f3d58c06700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d54130eb0 con 0x7f3d541338c0 2023-10-01T07:55:19.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.128+0000 7f3d58c06700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d54122400 con 0x7f3d5409e390 2023-10-01T07:55:19.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.128+0000 7f3d58c06700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5406f960 con 0x7f3d541341d0 2023-10-01T07:55:19.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.128+0000 7f3d4bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d541338c0 0x7f3d5411fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:19.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.128+0000 7f3d5259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d5409e390 0x7f3d5411f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:19.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.128+0000 7f3d52d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3d541341d0 0x7f3d541203e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:19.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.128+0000 7f3d5259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d5409e390 0x7f3d5411f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37604/0 (socket says 172.21.15.26:37604) 2023-10-01T07:55:19.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.128+0000 7f3d4bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d541338c0 0x7f3d5411fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37018/0 (socket says 172.21.15.26:37018) 2023-10-01T07:55:19.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.128+0000 7f3d5259c700 1 -- 172.21.15.26:0/2096248511 learned_addr learned my addr 172.21.15.26:0/2096248511 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:19.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.128+0000 7f3d52d9d700 1 -- 172.21.15.26:0/2096248511 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d5409e390 msgr2=0x7f3d5411f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:19.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.128+0000 7f3d52d9d700 1 --2- 172.21.15.26:0/2096248511 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d5409e390 0x7f3d5411f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:19.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.128+0000 7f3d52d9d700 1 -- 172.21.15.26:0/2096248511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d541338c0 msgr2=0x7f3d5411fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:19.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.128+0000 7f3d52d9d700 1 --2- 172.21.15.26:0/2096248511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d541338c0 0x7f3d5411fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:19.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.128+0000 7f3d52d9d700 1 -- 172.21.15.26:0/2096248511 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d440094a0 con 0x7f3d541341d0 2023-10-01T07:55:19.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.129+0000 7f3d52d9d700 1 --2- 172.21.15.26:0/2096248511 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3d541341d0 0x7f3d541203e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c00cad0 tx=0x7f3d4c00cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:19.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.129+0000 7f3d4affd700 1 -- 172.21.15.26:0/2096248511 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c00a960 con 0x7f3d541341d0 2023-10-01T07:55:19.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.129+0000 7f3d4affd700 1 -- 172.21.15.26:0/2096248511 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4c00aac0 con 0x7f3d541341d0 2023-10-01T07:55:19.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.129+0000 7f3d58c06700 1 -- 172.21.15.26:0/2096248511 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d54123480 con 0x7f3d541341d0 2023-10-01T07:55:19.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.129+0000 7f3d4affd700 1 -- 172.21.15.26:0/2096248511 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c00ae30 con 0x7f3d541341d0 2023-10-01T07:55:19.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.129+0000 7f3d58c06700 1 -- 172.21.15.26:0/2096248511 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d541231a0 con 0x7f3d541341d0 2023-10-01T07:55:19.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.130+0000 7f3d4affd700 1 -- 172.21.15.26:0/2096248511 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3d4c012400 con 0x7f3d541341d0 2023-10-01T07:55:19.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.130+0000 7f3d4affd700 1 -- 172.21.15.26:0/2096248511 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3d4c011b60 con 0x7f3d541341d0 2023-10-01T07:55:19.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.130+0000 7f3d58c06700 1 -- 172.21.15.26:0/2096248511 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d54123cd0 con 0x7f3d541341d0 2023-10-01T07:55:19.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.136+0000 7f3d4affd700 1 -- 172.21.15.26:0/2096248511 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3d4c017020 con 0x7f3d541341d0 2023-10-01T07:55:19.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.151+0000 7fcf3d12f700 1 Processor -- start 2023-10-01T07:55:19.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.151+0000 7fcf3d12f700 1 -- start start 2023-10-01T07:55:19.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.151+0000 7fcf3d12f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf3806e570 0x7fcf3806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:19.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.151+0000 7fcf3d12f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf3809eca0 0x7fcf3806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:19.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.152+0000 7fcf3d12f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf38070ee0 con 0x7fcf38134610 2023-10-01T07:55:19.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.152+0000 7fcf3d12f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf38071480 con 0x7fcf3809eca0 2023-10-01T07:55:19.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.152+0000 7fcf3d12f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3806f3c0 con 0x7fcf3806e570 2023-10-01T07:55:19.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.152+0000 7fcf3659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf3809eca0 0x7fcf3806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:19.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.152+0000 7fcf3659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf3809eca0 0x7fcf3806ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37608/0 (socket says 172.21.15.26:37608) 2023-10-01T07:55:19.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.152+0000 7fcf3659c700 1 -- 172.21.15.26:0/2396474667 learned_addr learned my addr 172.21.15.26:0/2396474667 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:19.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.152+0000 7fcf36d9d700 1 --2- 172.21.15.26:0/2396474667 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf3806e570 0x7fcf3806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:19.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.152+0000 7fcf36d9d700 1 -- 172.21.15.26:0/2396474667 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf3809eca0 msgr2=0x7fcf3806ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:19.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.152+0000 7fcf36d9d700 1 --2- 172.21.15.26:0/2396474667 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf3809eca0 0x7fcf3806ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:19.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.152+0000 7fcf36d9d700 1 -- 172.21.15.26:0/2396474667 >> v1:172.21.15.26:6789/0 conn(0x7fcf38134610 legacy=0x7fcf38134ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:19.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.152+0000 7fcf36d9d700 1 -- 172.21.15.26:0/2396474667 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf38071b90 con 0x7fcf3806e570 2023-10-01T07:55:19.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.152+0000 7fcf36d9d700 1 --2- 172.21.15.26:0/2396474667 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf3806e570 0x7fcf3806e940 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcf28009870 tx=0x7fcf28009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31b0c89753c03890 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:19.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.153+0000 7fcf35d9b700 1 -- 172.21.15.26:0/2396474667 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf28011830 con 0x7fcf3806e570 2023-10-01T07:55:19.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.153+0000 7fcf35d9b700 1 -- 172.21.15.26:0/2396474667 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf28011990 con 0x7fcf3806e570 2023-10-01T07:55:19.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.153+0000 7fcf35d9b700 1 -- 172.21.15.26:0/2396474667 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf28011d20 con 0x7fcf3806e570 2023-10-01T07:55:19.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.153+0000 7fcf3d12f700 1 -- 172.21.15.26:0/2396474667 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf3806e570 msgr2=0x7fcf3806e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:19.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.153+0000 7fcf3d12f700 1 --2- 172.21.15.26:0/2396474667 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf3806e570 0x7fcf3806e940 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcf28009870 tx=0x7fcf28009b80 comp rx=0 tx=0).stop 2023-10-01T07:55:19.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.154+0000 7fcf3d12f700 1 -- 172.21.15.26:0/2396474667 shutdown_connections 2023-10-01T07:55:19.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.154+0000 7fcf3d12f700 1 --2- 172.21.15.26:0/2396474667 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf3806e570 0x7fcf3806e940 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:19.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.154+0000 7fcf3d12f700 1 --2- 172.21.15.26:0/2396474667 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf3809eca0 0x7fcf3806ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:19.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.154+0000 7fcf3d12f700 1 -- 172.21.15.26:0/2396474667 >> 172.21.15.26:0/2396474667 conn(0x7fcf380a2aa0 msgr2=0x7fcf380a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:19.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.154+0000 7fcf3d12f700 1 -- 172.21.15.26:0/2396474667 shutdown_connections 2023-10-01T07:55:19.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.154+0000 7fcf3d12f700 1 -- 172.21.15.26:0/2396474667 wait complete. 2023-10-01T07:55:19.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.156+0000 7fcf3d12f700 1 Processor -- start 2023-10-01T07:55:19.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.156+0000 7fcf3d12f700 1 -- start start 2023-10-01T07:55:19.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.156+0000 7fcf3d12f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf3806e570 0x7fcf381232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:19.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.156+0000 7fcf3d12f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf38134610 0x7fcf38123820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:19.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.156+0000 7fcf3d12f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf38123d60 0x7fcf381cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:19.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.156+0000 7fcf3d12f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf381241b0 con 0x7fcf3806e570 2023-10-01T07:55:19.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.157+0000 7fcf3d12f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf38133e20 con 0x7fcf38123d60 2023-10-01T07:55:19.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.157+0000 7fcf3d12f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf38126810 con 0x7fcf38134610 2023-10-01T07:55:19.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.157+0000 7fcf3759e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf38123d60 0x7fcf381cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:19.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.157+0000 7fcf3659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf38134610 0x7fcf38123820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:19.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.157+0000 7fcf3759e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf38123d60 0x7fcf381cca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37624/0 (socket says 172.21.15.26:37624) 2023-10-01T07:55:19.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.157+0000 7fcf3759e700 1 -- 172.21.15.26:0/670649384 learned_addr learned my addr 172.21.15.26:0/670649384 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:19.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.157+0000 7fcf3659c700 1 -- 172.21.15.26:0/670649384 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf38123d60 msgr2=0x7fcf381cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:19.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.157+0000 7fcf3659c700 1 --2- 172.21.15.26:0/670649384 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf38123d60 0x7fcf381cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:19.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.157+0000 7fcf3659c700 1 -- 172.21.15.26:0/670649384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf3806e570 msgr2=0x7fcf381232e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:19.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.157+0000 7fcf3659c700 1 --2- 172.21.15.26:0/670649384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf3806e570 0x7fcf381232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:19.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.157+0000 7fcf3659c700 1 -- 172.21.15.26:0/670649384 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf280094a0 con 0x7fcf38134610 2023-10-01T07:55:19.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.157+0000 7fcf3659c700 1 --2- 172.21.15.26:0/670649384 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf38134610 0x7fcf38123820 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c00e8b0 tx=0x7fcf2c00ebc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:19.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.158+0000 7fcf1f7fe700 1 -- 172.21.15.26:0/670649384 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c013680 con 0x7fcf38134610 2023-10-01T07:55:19.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.158+0000 7fcf1f7fe700 1 -- 172.21.15.26:0/670649384 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2c0137e0 con 0x7fcf38134610 2023-10-01T07:55:19.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.158+0000 7fcf1f7fe700 1 -- 172.21.15.26:0/670649384 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c013b70 con 0x7fcf38134610 2023-10-01T07:55:19.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.158+0000 7fcf3d12f700 1 -- 172.21.15.26:0/670649384 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf38126db0 con 0x7fcf38134610 2023-10-01T07:55:19.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.158+0000 7fcf3d12f700 1 -- 172.21.15.26:0/670649384 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf38070610 con 0x7fcf38134610 2023-10-01T07:55:19.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.159+0000 7fcf3d12f700 1 -- 172.21.15.26:0/670649384 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf38074ea0 con 0x7fcf38134610 2023-10-01T07:55:19.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.159+0000 7fcf1f7fe700 1 -- 172.21.15.26:0/670649384 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcf2c013cd0 con 0x7fcf38134610 2023-10-01T07:55:19.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.160+0000 7fcf1f7fe700 1 -- 172.21.15.26:0/670649384 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcf2c03faf0 con 0x7fcf38134610 2023-10-01T07:55:19.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.160+0000 7f3dab929700 1 Processor -- start 2023-10-01T07:55:19.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.160+0000 7f3dab929700 1 -- start start 2023-10-01T07:55:19.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.161+0000 7f3dab929700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3da412c2f0 0x7f3da4130040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:19.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.161+0000 7f3dab929700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3da412cff0 0x7f3da4137cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:19.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.161+0000 7f3dab929700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da409a510 con 0x7f3da412cc20 2023-10-01T07:55:19.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.161+0000 7f3dab929700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da412c7d0 con 0x7f3da412cff0 2023-10-01T07:55:19.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.161+0000 7f3dab929700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da409c190 con 0x7f3da412c2f0 2023-10-01T07:55:19.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.161+0000 7f3da8ec4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3da412c2f0 0x7f3da4130040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:19.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.161+0000 7f3da96c5700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3da412cc20 0x7f3da412f930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41274/0 (socket says 172.21.15.26:41274) 2023-10-01T07:55:19.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.161+0000 7f3da96c5700 1 -- 172.21.15.26:0/2015992385 learned_addr learned my addr 172.21.15.26:0/2015992385 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:19.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.161+0000 7f3da9ec6700 1 --2- 172.21.15.26:0/2015992385 >> v2:172.21.15.26:3300/0 conn(0x7f3da412cff0 0x7f3da4137cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:19.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.162+0000 7f3d9bfff700 1 -- 172.21.15.26:0/2015992385 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1861333065 0 0) 0x7f3da409a510 con 0x7f3da412cc20 2023-10-01T07:55:19.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.162+0000 7f3d9bfff700 1 -- 172.21.15.26:0/2015992385 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d900035b0 con 0x7f3da412cc20 2023-10-01T07:55:19.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.162+0000 7f3da9ec6700 1 -- 172.21.15.26:0/2015992385 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3da412c2f0 msgr2=0x7f3da4130040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:19.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.162+0000 7f3da9ec6700 1 --2- 172.21.15.26:0/2015992385 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3da412c2f0 0x7f3da4130040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:19.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.162+0000 7f3da9ec6700 1 -- 172.21.15.26:0/2015992385 >> v1:172.21.15.26:6789/0 conn(0x7f3da412cc20 legacy=0x7f3da412f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:19.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.162+0000 7f3da9ec6700 1 -- 172.21.15.26:0/2015992385 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da409b540 con 0x7f3da412cff0 2023-10-01T07:55:19.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.162+0000 7f3da9ec6700 1 --2- 172.21.15.26:0/2015992385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3da412cff0 0x7f3da4137cd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c009d90 tx=0x7f3d9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c8214aece31f3ab server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:19.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.162+0000 7f3d9bfff700 1 -- 172.21.15.26:0/2015992385 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c00e070 con 0x7f3da412cff0 2023-10-01T07:55:19.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.162+0000 7f3d9bfff700 1 -- 172.21.15.26:0/2015992385 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9c00bb20 con 0x7f3da412cff0 2023-10-01T07:55:19.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.162+0000 7f3d9bfff700 1 -- 172.21.15.26:0/2015992385 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c012430 con 0x7f3da412cff0 2023-10-01T07:55:19.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.163+0000 7f3dab929700 1 -- 172.21.15.26:0/2015992385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3da412cff0 msgr2=0x7f3da4137cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:19.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.163+0000 7f3dab929700 1 --2- 172.21.15.26:0/2015992385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3da412cff0 0x7f3da4137cd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c009d90 tx=0x7f3d9c00b330 comp rx=0 tx=0).stop 2023-10-01T07:55:19.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.163+0000 7f3dab929700 1 -- 172.21.15.26:0/2015992385 shutdown_connections 2023-10-01T07:55:19.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.163+0000 7f3dab929700 1 --2- 172.21.15.26:0/2015992385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3da412cff0 0x7f3da4137cd0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:19.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.163+0000 7f3dab929700 1 --2- 172.21.15.26:0/2015992385 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3da412c2f0 0x7f3da4130040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:19.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.164+0000 7f3dab929700 1 -- 172.21.15.26:0/2015992385 >> 172.21.15.26:0/2015992385 conn(0x7f3da409f470 msgr2=0x7f3da40a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:19.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.164+0000 7f3dab929700 1 -- 172.21.15.26:0/2015992385 shutdown_connections 2023-10-01T07:55:19.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.164+0000 7f3dab929700 1 -- 172.21.15.26:0/2015992385 wait complete. 2023-10-01T07:55:19.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.165+0000 7f3dab929700 1 Processor -- start 2023-10-01T07:55:19.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.165+0000 7fcf1f7fe700 1 -- 172.21.15.26:0/670649384 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcf2c011db0 con 0x7fcf38134610 2023-10-01T07:55:19.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.165+0000 7f3dab929700 1 -- start start 2023-10-01T07:55:19.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.166+0000 7f3dab929700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3da412c2f0 0x7f3da40708e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:19.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.166+0000 7f3dab929700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3da412cc20 0x7f3da4098260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:19.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.166+0000 7f3dab929700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3da412cff0 0x7f3da40987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:19.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.166+0000 7f3dab929700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da4072110 con 0x7f3da412cc20 2023-10-01T07:55:19.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.166+0000 7f3dab929700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da40722f0 con 0x7f3da412cff0 2023-10-01T07:55:19.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.166+0000 7f3dab929700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3da4098ce0 con 0x7f3da412c2f0 2023-10-01T07:55:19.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.166+0000 7f3da96c5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3da412c2f0 0x7f3da40708e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:19.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.166+0000 7f3da96c5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3da412c2f0 0x7f3da40708e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55212/0 (socket says 172.21.15.26:55212) 2023-10-01T07:55:19.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.166+0000 7f3da96c5700 1 -- 172.21.15.26:0/165413244 learned_addr learned my addr 172.21.15.26:0/165413244 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:19.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.166+0000 7f3da9ec6700 1 --2- 172.21.15.26:0/165413244 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3da412cff0 0x7f3da40987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:19.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.167+0000 7f3da96c5700 1 -- 172.21.15.26:0/165413244 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3da412cff0 msgr2=0x7f3da40987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:19.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.167+0000 7f3da96c5700 1 --2- 172.21.15.26:0/165413244 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3da412cff0 0x7f3da40987a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:19.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.167+0000 7f3da96c5700 1 -- 172.21.15.26:0/165413244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3da412cc20 msgr2=0x7f3da4098260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:19.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.167+0000 7f3da96c5700 1 --2- 172.21.15.26:0/165413244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3da412cc20 0x7f3da4098260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:19.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.167+0000 7f3da96c5700 1 -- 172.21.15.26:0/165413244 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9c009a70 con 0x7f3da412c2f0 2023-10-01T07:55:19.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.167+0000 7f3da96c5700 1 --2- 172.21.15.26:0/165413244 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3da412c2f0 0x7f3da40708e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3da000c730 tx=0x7f3da000ca40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:19.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.167+0000 7f3d99ffb700 1 -- 172.21.15.26:0/165413244 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da0005d70 con 0x7f3da412c2f0 2023-10-01T07:55:19.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.167+0000 7f3d99ffb700 1 -- 172.21.15.26:0/165413244 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da00070d0 con 0x7f3da412c2f0 2023-10-01T07:55:19.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.167+0000 7f3d99ffb700 1 -- 172.21.15.26:0/165413244 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da0007460 con 0x7f3da412c2f0 2023-10-01T07:55:19.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.167+0000 7f3dab929700 1 -- 172.21.15.26:0/165413244 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da412b690 con 0x7f3da412c2f0 2023-10-01T07:55:19.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.167+0000 7f3dab929700 1 -- 172.21.15.26:0/165413244 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da406efe0 con 0x7f3da412c2f0 2023-10-01T07:55:19.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.168+0000 7f3dab929700 1 -- 172.21.15.26:0/165413244 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da406ed30 con 0x7f3da412c2f0 2023-10-01T07:55:19.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.169+0000 7f3d99ffb700 1 -- 172.21.15.26:0/165413244 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3da00075c0 con 0x7f3da412c2f0 2023-10-01T07:55:19.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.169+0000 7f3d99ffb700 1 -- 172.21.15.26:0/165413244 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3da003ec10 con 0x7f3da412c2f0 2023-10-01T07:55:19.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.178+0000 7f3d99ffb700 1 -- 172.21.15.26:0/165413244 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3da000e280 con 0x7f3da412c2f0 2023-10-01T07:55:19.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.207+0000 7f9b47d6c700 1 Processor -- start 2023-10-01T07:55:19.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.207+0000 7f9b47d6c700 1 -- start start 2023-10-01T07:55:19.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.207+0000 7f9b47d6c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9b4009d6f0 0x7f9b4009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:19.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.207+0000 7f9b47d6c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b4009e000 0x7f9b40130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:19.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.207+0000 7f9b47d6c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b4009f130 con 0x7f9b4009e410 2023-10-01T07:55:19.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.207+0000 7f9b47d6c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b4009f520 con 0x7f9b4009d6f0 2023-10-01T07:55:19.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.207+0000 7f9b47d6c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4009e930 con 0x7f9b4009e000 2023-10-01T07:55:19.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.208+0000 7f9b45b08700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9b4009d6f0 0x7f9b4009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:19.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.208+0000 7f9b45307700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b4009e000 0x7f9b40130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:19.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.208+0000 7f9b45307700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b4009e000 0x7f9b40130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55228/0 (socket says 172.21.15.26:55228) 2023-10-01T07:55:19.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.208+0000 7f9b45b08700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9b4009d6f0 0x7f9b4009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37060/0 (socket says 172.21.15.26:37060) 2023-10-01T07:55:19.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.208+0000 7f9b45307700 1 -- 172.21.15.26:0/2140112856 learned_addr learned my addr 172.21.15.26:0/2140112856 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:19.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.208+0000 7f9b45307700 1 -- 172.21.15.26:0/2140112856 >> v2:172.21.15.26:3300/0 conn(0x7f9b4009d6f0 msgr2=0x7f9b4009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:19.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.208+0000 7f9b45307700 1 --2- 172.21.15.26:0/2140112856 >> v2:172.21.15.26:3300/0 conn(0x7f9b4009d6f0 0x7f9b4009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:19.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.208+0000 7f9b45307700 1 -- 172.21.15.26:0/2140112856 >> v1:172.21.15.26:6789/0 conn(0x7f9b4009e410 legacy=0x7f9b40130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:19.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.208+0000 7f9b45307700 1 -- 172.21.15.26:0/2140112856 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4009b2d0 con 0x7f9b4009e000 2023-10-01T07:55:19.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.208+0000 7f9b45307700 1 --2- 172.21.15.26:0/2140112856 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b4009e000 0x7f9b40130660 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9b3000dd20 tx=0x7f9b3000f330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d15087e0b6d3d7e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:19.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.208+0000 7f9b44b06700 1 -- 172.21.15.26:0/2140112856 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b30012070 con 0x7f9b4009e000 2023-10-01T07:55:19.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.208+0000 7f9b44b06700 1 -- 172.21.15.26:0/2140112856 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3000de70 con 0x7f9b4009e000 2023-10-01T07:55:19.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.209+0000 7f9b44b06700 1 -- 172.21.15.26:0/2140112856 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3000fd20 con 0x7f9b4009e000 2023-10-01T07:55:19.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.209+0000 7f9b47d6c700 1 -- 172.21.15.26:0/2140112856 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b4009e000 msgr2=0x7f9b40130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:19.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.209+0000 7f9b47d6c700 1 --2- 172.21.15.26:0/2140112856 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b4009e000 0x7f9b40130660 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9b3000dd20 tx=0x7f9b3000f330 comp rx=0 tx=0).stop 2023-10-01T07:55:19.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.209+0000 7f9b47d6c700 1 -- 172.21.15.26:0/2140112856 shutdown_connections 2023-10-01T07:55:19.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.209+0000 7f9b47d6c700 1 --2- 172.21.15.26:0/2140112856 >> v2:172.21.15.26:3300/0 conn(0x7f9b4009d6f0 0x7f9b4009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:19.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.209+0000 7f9b47d6c700 1 --2- 172.21.15.26:0/2140112856 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b4009e000 0x7f9b40130660 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:19.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.209+0000 7f9b47d6c700 1 -- 172.21.15.26:0/2140112856 >> 172.21.15.26:0/2140112856 conn(0x7f9b40066f50 msgr2=0x7f9b4009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:19.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.209+0000 7f9b47d6c700 1 -- 172.21.15.26:0/2140112856 shutdown_connections 2023-10-01T07:55:19.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.209+0000 7f9b47d6c700 1 -- 172.21.15.26:0/2140112856 wait complete. 2023-10-01T07:55:19.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.211+0000 7f9b47d6c700 1 Processor -- start 2023-10-01T07:55:19.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.211+0000 7f9b47d6c700 1 -- start start 2023-10-01T07:55:19.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.212+0000 7f9b47d6c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9b4009d6f0 0x7f9b4011ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:19.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.212+0000 7f9b47d6c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b4009e000 0x7f9b4011e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:19.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.212+0000 7f9b47d6c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b4009e410 0x7f9b4011e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:19.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.212+0000 7f9b47d6c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b401302b0 con 0x7f9b4009e410 2023-10-01T07:55:19.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.212+0000 7f9b47d6c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b40120d30 con 0x7f9b4009d6f0 2023-10-01T07:55:19.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.212+0000 7f9b47d6c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4011f330 con 0x7f9b4009e000 2023-10-01T07:55:19.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.212+0000 7f9b45307700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b4009e000 0x7f9b4011e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:19.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.212+0000 7f9b45307700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b4009e000 0x7f9b4011e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55230/0 (socket says 172.21.15.26:55230) 2023-10-01T07:55:19.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.212+0000 7f9b45307700 1 -- 172.21.15.26:0/1198254682 learned_addr learned my addr 172.21.15.26:0/1198254682 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:19.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.212+0000 7f9b46309700 1 --2- 172.21.15.26:0/1198254682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b4009e410 0x7f9b4011e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:19.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.212+0000 7f9b45307700 1 -- 172.21.15.26:0/1198254682 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9b4009d6f0 msgr2=0x7f9b4011ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:19.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.212+0000 7f9b45307700 1 --2- 172.21.15.26:0/1198254682 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9b4009d6f0 0x7f9b4011ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:19.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.212+0000 7f9b45307700 1 -- 172.21.15.26:0/1198254682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b4009e410 msgr2=0x7f9b4011e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:19.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.212+0000 7f9b45307700 1 --2- 172.21.15.26:0/1198254682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b4009e410 0x7f9b4011e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:19.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.212+0000 7f9b45307700 1 -- 172.21.15.26:0/1198254682 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3000da00 con 0x7f9b4009e000 2023-10-01T07:55:19.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.213+0000 7f9b45307700 1 --2- 172.21.15.26:0/1198254682 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b4009e000 0x7f9b4011e410 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9b30018040 tx=0x7f9b30004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:19.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.213+0000 7f9b367fc700 1 -- 172.21.15.26:0/1198254682 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b30003b30 con 0x7f9b4009e000 2023-10-01T07:55:19.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.213+0000 7f9b367fc700 1 -- 172.21.15.26:0/1198254682 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b30003cb0 con 0x7f9b4009e000 2023-10-01T07:55:19.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.213+0000 7f9b367fc700 1 -- 172.21.15.26:0/1198254682 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b30016670 con 0x7f9b4009e000 2023-10-01T07:55:19.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.213+0000 7f9b47d6c700 1 -- 172.21.15.26:0/1198254682 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b40121710 con 0x7f9b4009e000 2023-10-01T07:55:19.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.213+0000 7f9b47d6c700 1 -- 172.21.15.26:0/1198254682 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b40120100 con 0x7f9b4009e000 2023-10-01T07:55:19.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.214+0000 7f9b367fc700 1 -- 172.21.15.26:0/1198254682 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9b300167d0 con 0x7f9b4009e000 2023-10-01T07:55:19.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.215+0000 7f9b47d6c700 1 -- 172.21.15.26:0/1198254682 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b4009c700 con 0x7f9b4009e000 2023-10-01T07:55:19.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.215+0000 7f9b367fc700 1 -- 172.21.15.26:0/1198254682 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9b30044fd0 con 0x7f9b4009e000 2023-10-01T07:55:19.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.224+0000 7f9b367fc700 1 -- 172.21.15.26:0/1198254682 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9b3002e080 con 0x7f9b4009e000 2023-10-01T07:55:19.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.355+0000 7f3d58c06700 1 -- 172.21.15.26:0/2096248511 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3d5406f150 con 0x7f3d541341d0 2023-10-01T07:55:19.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.356+0000 7f3d4affd700 1 -- 172.21.15.26:0/2096248511 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3d5406f150 con 0x7f3d541341d0 2023-10-01T07:55:19.356 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:19.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.358+0000 7f3d58c06700 1 -- 172.21.15.26:0/2096248511 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3d541341d0 msgr2=0x7f3d541203e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:19.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.358+0000 7f3d58c06700 1 --2- 172.21.15.26:0/2096248511 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3d541341d0 0x7f3d541203e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c00cad0 tx=0x7f3d4c00cde0 comp rx=0 tx=0).stop 2023-10-01T07:55:19.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.358+0000 7f3d58c06700 1 -- 172.21.15.26:0/2096248511 shutdown_connections 2023-10-01T07:55:19.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.358+0000 7f3d58c06700 1 --2- 172.21.15.26:0/2096248511 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3d541341d0 0x7f3d541203e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:19.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.358+0000 7f3d58c06700 1 --2- 172.21.15.26:0/2096248511 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d5409e390 0x7f3d5411f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:19.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.358+0000 7f3d58c06700 1 --2- 172.21.15.26:0/2096248511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d541338c0 0x7f3d5411fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:19.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.358+0000 7f3d58c06700 1 -- 172.21.15.26:0/2096248511 >> 172.21.15.26:0/2096248511 conn(0x7f3d540a2aa0 msgr2=0x7f3d5409f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:19.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.358+0000 7f3d58c06700 1 -- 172.21.15.26:0/2096248511 shutdown_connections 2023-10-01T07:55:19.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.359+0000 7f3d58c06700 1 -- 172.21.15.26:0/2096248511 wait complete. 2023-10-01T07:55:19.374 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:19.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.385+0000 7fcf3d12f700 1 -- 172.21.15.26:0/670649384 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcf38071100 con 0x7fcf38134610 2023-10-01T07:55:19.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.386+0000 7fcf1f7fe700 1 -- 172.21.15.26:0/670649384 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcf2c021070 con 0x7fcf38134610 2023-10-01T07:55:19.386 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:19.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.388+0000 7fcf3d12f700 1 -- 172.21.15.26:0/670649384 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf38134610 msgr2=0x7fcf38123820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:19.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.388+0000 7fcf3d12f700 1 --2- 172.21.15.26:0/670649384 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf38134610 0x7fcf38123820 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c00e8b0 tx=0x7fcf2c00ebc0 comp rx=0 tx=0).stop 2023-10-01T07:55:19.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.388+0000 7fcf3d12f700 1 -- 172.21.15.26:0/670649384 shutdown_connections 2023-10-01T07:55:19.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.388+0000 7fcf3d12f700 1 --2- 172.21.15.26:0/670649384 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf38123d60 0x7fcf381cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:19.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.388+0000 7fcf3d12f700 1 --2- 172.21.15.26:0/670649384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf3806e570 0x7fcf381232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:19.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.388+0000 7fcf3d12f700 1 --2- 172.21.15.26:0/670649384 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf38134610 0x7fcf38123820 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:19.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.388+0000 7fcf3d12f700 1 -- 172.21.15.26:0/670649384 >> 172.21.15.26:0/670649384 conn(0x7fcf380a2aa0 msgr2=0x7fcf380a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:19.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.388+0000 7fcf3d12f700 1 -- 172.21.15.26:0/670649384 shutdown_connections 2023-10-01T07:55:19.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.388+0000 7fcf3d12f700 1 -- 172.21.15.26:0/670649384 wait complete. 2023-10-01T07:55:19.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.389+0000 7f3dab929700 1 -- 172.21.15.26:0/165413244 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3da4072430 con 0x7f3da412c2f0 2023-10-01T07:55:19.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.390+0000 7f3d99ffb700 1 -- 172.21.15.26:0/165413244 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3da4072430 con 0x7f3da412c2f0 2023-10-01T07:55:19.390 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:19.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.392+0000 7f3dab929700 1 -- 172.21.15.26:0/165413244 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3da412c2f0 msgr2=0x7f3da40708e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:19.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.392+0000 7f3dab929700 1 --2- 172.21.15.26:0/165413244 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3da412c2f0 0x7f3da40708e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3da000c730 tx=0x7f3da000ca40 comp rx=0 tx=0).stop 2023-10-01T07:55:19.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.392+0000 7f3dab929700 1 -- 172.21.15.26:0/165413244 shutdown_connections 2023-10-01T07:55:19.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.392+0000 7f3dab929700 1 --2- 172.21.15.26:0/165413244 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3da412cff0 0x7f3da40987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:19.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.392+0000 7f3dab929700 1 --2- 172.21.15.26:0/165413244 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3da412c2f0 0x7f3da40708e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:19.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.392+0000 7f3dab929700 1 --2- 172.21.15.26:0/165413244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3da412cc20 0x7f3da4098260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:19.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.392+0000 7f3dab929700 1 -- 172.21.15.26:0/165413244 >> 172.21.15.26:0/165413244 conn(0x7f3da409f470 msgr2=0x7f3da40a1720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:19.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.392+0000 7f3dab929700 1 -- 172.21.15.26:0/165413244 shutdown_connections 2023-10-01T07:55:19.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.392+0000 7f3dab929700 1 -- 172.21.15.26:0/165413244 wait complete. 2023-10-01T07:55:19.404 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:19.407 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:19.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.437+0000 7f9b47d6c700 1 -- 172.21.15.26:0/1198254682 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9b40074ea0 con 0x7f9b4009e000 2023-10-01T07:55:19.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.437+0000 7f9b367fc700 1 -- 172.21.15.26:0/1198254682 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9b30038090 con 0x7f9b4009e000 2023-10-01T07:55:19.438 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:19.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.440+0000 7f9b47d6c700 1 -- 172.21.15.26:0/1198254682 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b4009e000 msgr2=0x7f9b4011e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:19.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.440+0000 7f9b47d6c700 1 --2- 172.21.15.26:0/1198254682 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b4009e000 0x7f9b4011e410 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9b30018040 tx=0x7f9b30004750 comp rx=0 tx=0).stop 2023-10-01T07:55:19.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.440+0000 7f9b47d6c700 1 -- 172.21.15.26:0/1198254682 shutdown_connections 2023-10-01T07:55:19.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.440+0000 7f9b47d6c700 1 --2- 172.21.15.26:0/1198254682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b4009e410 0x7f9b4011e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:19.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.440+0000 7f9b47d6c700 1 --2- 172.21.15.26:0/1198254682 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9b4009d6f0 0x7f9b4011ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:19.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.440+0000 7f9b47d6c700 1 --2- 172.21.15.26:0/1198254682 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b4009e000 0x7f9b4011e410 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:19.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.440+0000 7f9b47d6c700 1 -- 172.21.15.26:0/1198254682 >> 172.21.15.26:0/1198254682 conn(0x7f9b40066f50 msgr2=0x7f9b40070ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:19.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.440+0000 7f9b47d6c700 1 -- 172.21.15.26:0/1198254682 shutdown_connections 2023-10-01T07:55:19.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:19.440+0000 7f9b47d6c700 1 -- 172.21.15.26:0/1198254682 wait complete. 2023-10-01T07:55:19.454 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:20.375 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:20.405 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:20.408 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:20.455 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:20.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.539+0000 7fc63d94d700 1 Processor -- start 2023-10-01T07:55:20.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.539+0000 7fc63d94d700 1 -- start start 2023-10-01T07:55:20.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.540+0000 7fc63d94d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc63809d6f0 0x7fc63809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:20.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.540+0000 7fc63d94d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc63809e410 0x7fc638134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:20.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.540+0000 7fc63d94d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc63809b120 con 0x7fc63809e000 2023-10-01T07:55:20.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.540+0000 7fc63d94d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63806b460 con 0x7fc63809d6f0 2023-10-01T07:55:20.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.540+0000 7fc63d94d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc63809a7e0 con 0x7fc63809e410 2023-10-01T07:55:20.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.540+0000 7fc636ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc63809d6f0 0x7fc63809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:20.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.540+0000 7fc6367fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc63809e000 0x7fc6381339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41292/0 (socket says 172.21.15.26:41292) 2023-10-01T07:55:20.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.540+0000 7fc6367fc700 1 -- 172.21.15.26:0/862910006 learned_addr learned my addr 172.21.15.26:0/862910006 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:20.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.540+0000 7fc6377fe700 1 --2- 172.21.15.26:0/862910006 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc63809e410 0x7fc638134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:20.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.540+0000 7fc635ffb700 1 -- 172.21.15.26:0/862910006 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1851850713 0 0) 0x7fc63809b120 con 0x7fc63809e000 2023-10-01T07:55:20.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.540+0000 7fc635ffb700 1 -- 172.21.15.26:0/862910006 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6200035b0 con 0x7fc63809e000 2023-10-01T07:55:20.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.540+0000 7fc636ffd700 1 -- 172.21.15.26:0/862910006 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc63809e410 msgr2=0x7fc638134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:20.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.540+0000 7fc636ffd700 1 --2- 172.21.15.26:0/862910006 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc63809e410 0x7fc638134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.540+0000 7fc636ffd700 1 -- 172.21.15.26:0/862910006 >> v1:172.21.15.26:6789/0 conn(0x7fc63809e000 legacy=0x7fc6381339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:20.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.541+0000 7fc636ffd700 1 -- 172.21.15.26:0/862910006 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63809a500 con 0x7fc63809d6f0 2023-10-01T07:55:20.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.541+0000 7fc636ffd700 1 --2- 172.21.15.26:0/862910006 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc63809d6f0 0x7fc63809dac0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc628009870 tx=0x7fc628009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9b054c2c85bc990 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:20.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.541+0000 7fc635ffb700 1 -- 172.21.15.26:0/862910006 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc628011830 con 0x7fc63809d6f0 2023-10-01T07:55:20.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.541+0000 7fc635ffb700 1 -- 172.21.15.26:0/862910006 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc628011990 con 0x7fc63809d6f0 2023-10-01T07:55:20.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.541+0000 7fc635ffb700 1 -- 172.21.15.26:0/862910006 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc628011d20 con 0x7fc63809d6f0 2023-10-01T07:55:20.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.542+0000 7fc63d94d700 1 -- 172.21.15.26:0/862910006 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc63809d6f0 msgr2=0x7fc63809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:20.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.542+0000 7fc63d94d700 1 --2- 172.21.15.26:0/862910006 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc63809d6f0 0x7fc63809dac0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc628009870 tx=0x7fc628009b80 comp rx=0 tx=0).stop 2023-10-01T07:55:20.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.542+0000 7fc63d94d700 1 -- 172.21.15.26:0/862910006 shutdown_connections 2023-10-01T07:55:20.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.542+0000 7fc63d94d700 1 --2- 172.21.15.26:0/862910006 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc63809e410 0x7fc638134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.542+0000 7fc63d94d700 1 --2- 172.21.15.26:0/862910006 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc63809d6f0 0x7fc63809dac0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.542+0000 7fc63d94d700 1 -- 172.21.15.26:0/862910006 >> 172.21.15.26:0/862910006 conn(0x7fc638066f50 msgr2=0x7fc63809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:20.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.542+0000 7fc63d94d700 1 -- 172.21.15.26:0/862910006 shutdown_connections 2023-10-01T07:55:20.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.542+0000 7fc63d94d700 1 -- 172.21.15.26:0/862910006 wait complete. 2023-10-01T07:55:20.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.544+0000 7fc63d94d700 1 Processor -- start 2023-10-01T07:55:20.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.544+0000 7fc63d94d700 1 -- start start 2023-10-01T07:55:20.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.545+0000 7fc63d94d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc63809d6f0 0x7fc6381224d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:20.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.545+0000 7fc63d94d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc63809e000 0x7fc638122a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:20.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.545+0000 7fc63d94d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc63809e410 0x7fc638122f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:20.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.545+0000 7fc63d94d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc638124f20 con 0x7fc63809d6f0 2023-10-01T07:55:20.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.545+0000 7fc63d94d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc638125f60 con 0x7fc63809e410 2023-10-01T07:55:20.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.545+0000 7fc63d94d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc638125a50 con 0x7fc63809e000 2023-10-01T07:55:20.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.545+0000 7fc636ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc63809d6f0 0x7fc6381224d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:20.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.545+0000 7fc636ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc63809d6f0 0x7fc6381224d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37080/0 (socket says 172.21.15.26:37080) 2023-10-01T07:55:20.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.545+0000 7fc636ffd700 1 -- 172.21.15.26:0/3431114965 learned_addr learned my addr 172.21.15.26:0/3431114965 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:20.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.545+0000 7fc6377fe700 1 --2- 172.21.15.26:0/3431114965 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc63809e410 0x7fc638122f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:20.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.545+0000 7fc6367fc700 1 --2- 172.21.15.26:0/3431114965 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc63809e000 0x7fc638122a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:20.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.545+0000 7fc6377fe700 1 -- 172.21.15.26:0/3431114965 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc63809e000 msgr2=0x7fc638122a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:20.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.545+0000 7fc6377fe700 1 --2- 172.21.15.26:0/3431114965 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc63809e000 0x7fc638122a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.545+0000 7fc6377fe700 1 -- 172.21.15.26:0/3431114965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc63809d6f0 msgr2=0x7fc6381224d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:20.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.545+0000 7fc6377fe700 1 --2- 172.21.15.26:0/3431114965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc63809d6f0 0x7fc6381224d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.545+0000 7fc6377fe700 1 -- 172.21.15.26:0/3431114965 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6280094a0 con 0x7fc63809e410 2023-10-01T07:55:20.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.545+0000 7fc6367fc700 1 --2- 172.21.15.26:0/3431114965 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc63809e000 0x7fc638122a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:20.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.546+0000 7fc6377fe700 1 --2- 172.21.15.26:0/3431114965 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc63809e410 0x7fc638122f50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc630009d90 tx=0x7fc63000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:20.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.546+0000 7fc61ffff700 1 -- 172.21.15.26:0/3431114965 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc630009c00 con 0x7fc63809e410 2023-10-01T07:55:20.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.546+0000 7fc61ffff700 1 -- 172.21.15.26:0/3431114965 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63000f040 con 0x7fc63809e410 2023-10-01T07:55:20.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.546+0000 7fc63d94d700 1 -- 172.21.15.26:0/3431114965 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6380a19d0 con 0x7fc63809e410 2023-10-01T07:55:20.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.546+0000 7fc61ffff700 1 -- 172.21.15.26:0/3431114965 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc630014480 con 0x7fc63809e410 2023-10-01T07:55:20.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.546+0000 7fc63d94d700 1 -- 172.21.15.26:0/3431114965 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc63809c770 con 0x7fc63809e410 2023-10-01T07:55:20.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.547+0000 7fc61ffff700 1 -- 172.21.15.26:0/3431114965 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc6300145e0 con 0x7fc63809e410 2023-10-01T07:55:20.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.547+0000 7fc61ffff700 1 -- 172.21.15.26:0/3431114965 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc6300401d0 con 0x7fc63809e410 2023-10-01T07:55:20.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.547+0000 7fc63d94d700 1 -- 172.21.15.26:0/3431114965 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc63811f030 con 0x7fc63809e410 2023-10-01T07:55:20.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.553+0000 7fc61ffff700 1 -- 172.21.15.26:0/3431114965 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc630018020 con 0x7fc63809e410 2023-10-01T07:55:20.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.571+0000 7f2b5238e700 1 Processor -- start 2023-10-01T07:55:20.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.572+0000 7f5a3708b700 1 Processor -- start 2023-10-01T07:55:20.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.572+0000 7f2b5238e700 1 -- start start 2023-10-01T07:55:20.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.572+0000 7f5a3708b700 1 -- start start 2023-10-01T07:55:20.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.572+0000 7f2b5238e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b4c09d6f0 0x7f2b4c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:20.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.572+0000 7f2b5238e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2b4c09e000 0x7f2b4c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:20.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.572+0000 7f2b5238e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2b4c09e410 0x7f2b4c133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:20.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.572+0000 7f2b5238e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b4c06b460 con 0x7f2b4c09e410 2023-10-01T07:55:20.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.572+0000 7f2b5238e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c09b120 con 0x7f2b4c09d6f0 2023-10-01T07:55:20.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.572+0000 7f2b5238e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c09a7e0 con 0x7f2b4c09e000 2023-10-01T07:55:20.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.572+0000 7f5a3708b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5a3009d630 0x7f5a300a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:20.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.572+0000 7f5a3708b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5a30138d80 0x7f5a3013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:20.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.572+0000 7f5a3708b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a300a2a70 con 0x7f5a300a0a30 2023-10-01T07:55:20.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.572+0000 7f5a3708b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a300a01d0 con 0x7f5a3009d630 2023-10-01T07:55:20.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.572+0000 7f5a3708b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3009e2b0 con 0x7f5a30138d80 2023-10-01T07:55:20.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.573+0000 7f5a34e27700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5a300a0a30 0x7f5a300a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41304/0 (socket says 172.21.15.26:41304) 2023-10-01T07:55:20.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.573+0000 7f5a34e27700 1 -- 172.21.15.26:0/3506282756 learned_addr learned my addr 172.21.15.26:0/3506282756 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:20.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.573+0000 7f2b4bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b4c09d6f0 0x7f2b4c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:20.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.573+0000 7f2b5092b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2b4c09e410 0x7f2b4c133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:20.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.573+0000 7f2b4bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b4c09d6f0 0x7f2b4c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37666/0 (socket says 172.21.15.26:37666) 2023-10-01T07:55:20.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.573+0000 7f2b4bfff700 1 -- 172.21.15.26:0/1708095107 learned_addr learned my addr 172.21.15.26:0/1708095107 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:20.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.573+0000 7f5a2ffff700 1 --2- 172.21.15.26:0/3506282756 >> v2:172.21.15.26:3300/0 conn(0x7f5a3009d630 0x7f5a300a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:20.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.573+0000 7f5a35628700 1 --2- 172.21.15.26:0/3506282756 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5a30138d80 0x7f5a3013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:20.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.573+0000 7f2b4bfff700 1 -- 172.21.15.26:0/1708095107 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2b4c09e000 msgr2=0x7f2b4c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:20.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.573+0000 7f2b4bfff700 1 --2- 172.21.15.26:0/1708095107 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2b4c09e000 0x7f2b4c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.573+0000 7f2b4bfff700 1 -- 172.21.15.26:0/1708095107 >> v2:172.21.15.26:3300/0 conn(0x7f2b4c09e410 msgr2=0x7f2b4c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:20.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.573+0000 7f2b4bfff700 1 --2- 172.21.15.26:0/1708095107 >> v2:172.21.15.26:3300/0 conn(0x7f2b4c09e410 0x7f2b4c133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.573+0000 7f2b4bfff700 1 -- 172.21.15.26:0/1708095107 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4c09a500 con 0x7f2b4c09d6f0 2023-10-01T07:55:20.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.573+0000 7f5a2ffff700 1 -- 172.21.15.26:0/3506282756 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5a30138d80 msgr2=0x7f5a3013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:20.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.573+0000 7f5a2ffff700 1 --2- 172.21.15.26:0/3506282756 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5a30138d80 0x7f5a3013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.573+0000 7f5a2ffff700 1 -- 172.21.15.26:0/3506282756 >> v1:172.21.15.26:6789/0 conn(0x7f5a300a0a30 legacy=0x7f5a300a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:20.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.573+0000 7f5a2f7fe700 1 -- 172.21.15.26:0/3506282756 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1232425372 0 0) 0x7f5a300a2a70 con 0x7f5a300a0a30 2023-10-01T07:55:20.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.573+0000 7f5a2ffff700 1 -- 172.21.15.26:0/3506282756 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3009dc50 con 0x7f5a3009d630 2023-10-01T07:55:20.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.574+0000 7f2b4bfff700 1 --2- 172.21.15.26:0/1708095107 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b4c09d6f0 0x7f2b4c09dac0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c009920 tx=0x7f2b3c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ed976c672a4aca5 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:20.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.574+0000 7f5a2ffff700 1 --2- 172.21.15.26:0/3506282756 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a3009d630 0x7f5a300a1510 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c009840 tx=0x7f5a1c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd733ac65a65f41c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:20.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.574+0000 7f5a2f7fe700 1 -- 172.21.15.26:0/3506282756 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c011830 con 0x7f5a3009d630 2023-10-01T07:55:20.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.574+0000 7f5a2f7fe700 1 -- 172.21.15.26:0/3506282756 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1c011990 con 0x7f5a3009d630 2023-10-01T07:55:20.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.574+0000 7f5a2f7fe700 1 -- 172.21.15.26:0/3506282756 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c011d20 con 0x7f5a3009d630 2023-10-01T07:55:20.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.575+0000 7f2b4affd700 1 -- 172.21.15.26:0/1708095107 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c011830 con 0x7f2b4c09d6f0 2023-10-01T07:55:20.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.575+0000 7f5a3708b700 1 -- 172.21.15.26:0/3506282756 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a3009d630 msgr2=0x7f5a300a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:20.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.575+0000 7f5a3708b700 1 --2- 172.21.15.26:0/3506282756 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a3009d630 0x7f5a300a1510 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c009840 tx=0x7f5a1c009b50 comp rx=0 tx=0).stop 2023-10-01T07:55:20.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.575+0000 7f2b4affd700 1 -- 172.21.15.26:0/1708095107 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3c011990 con 0x7f2b4c09d6f0 2023-10-01T07:55:20.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.575+0000 7f2b4affd700 1 -- 172.21.15.26:0/1708095107 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c011d20 con 0x7f2b4c09d6f0 2023-10-01T07:55:20.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.575+0000 7f2b5238e700 1 -- 172.21.15.26:0/1708095107 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b4c09d6f0 msgr2=0x7f2b4c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:20.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.575+0000 7f2b5238e700 1 --2- 172.21.15.26:0/1708095107 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b4c09d6f0 0x7f2b4c09dac0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c009920 tx=0x7f2b3c009c30 comp rx=0 tx=0).stop 2023-10-01T07:55:20.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.576+0000 7f5a3708b700 1 -- 172.21.15.26:0/3506282756 shutdown_connections 2023-10-01T07:55:20.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.576+0000 7f5a3708b700 1 --2- 172.21.15.26:0/3506282756 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5a30138d80 0x7f5a3013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.576+0000 7f5a3708b700 1 --2- 172.21.15.26:0/3506282756 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a3009d630 0x7f5a300a1510 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.576+0000 7f5a3708b700 1 -- 172.21.15.26:0/3506282756 >> 172.21.15.26:0/3506282756 conn(0x7f5a300a3050 msgr2=0x7f5a300a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:20.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.576+0000 7f2b5238e700 1 -- 172.21.15.26:0/1708095107 shutdown_connections 2023-10-01T07:55:20.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.576+0000 7f2b5238e700 1 --2- 172.21.15.26:0/1708095107 >> v2:172.21.15.26:3300/0 conn(0x7f2b4c09e410 0x7f2b4c133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.576+0000 7f2b5238e700 1 --2- 172.21.15.26:0/1708095107 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b4c09d6f0 0x7f2b4c09dac0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.576+0000 7f2b5238e700 1 --2- 172.21.15.26:0/1708095107 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2b4c09e000 0x7f2b4c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.576+0000 7f2b5238e700 1 -- 172.21.15.26:0/1708095107 >> 172.21.15.26:0/1708095107 conn(0x7f2b4c066f50 msgr2=0x7f2b4c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:20.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.576+0000 7f2b5238e700 1 -- 172.21.15.26:0/1708095107 shutdown_connections 2023-10-01T07:55:20.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.576+0000 7f5a3708b700 1 -- 172.21.15.26:0/3506282756 shutdown_connections 2023-10-01T07:55:20.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.576+0000 7f5a3708b700 1 -- 172.21.15.26:0/3506282756 wait complete. 2023-10-01T07:55:20.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.577+0000 7f5a3708b700 1 Processor -- start 2023-10-01T07:55:20.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.577+0000 7f2b5238e700 1 -- 172.21.15.26:0/1708095107 wait complete. 2023-10-01T07:55:20.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.577+0000 7f5a3708b700 1 -- start start 2023-10-01T07:55:20.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.577+0000 7f5a3708b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5a3009d630 0x7f5a301336e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:20.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.577+0000 7f5a3708b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a300a0a30 0x7f5a30133c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:20.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.577+0000 7f5a3708b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5a30138d80 0x7f5a30134160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:20.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.577+0000 7f5a3708b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a300a04a0 con 0x7f5a300a0a30 2023-10-01T07:55:20.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.577+0000 7f5a3708b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a30134b40 con 0x7f5a30138d80 2023-10-01T07:55:20.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.577+0000 7f5a3708b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a30135b50 con 0x7f5a3009d630 2023-10-01T07:55:20.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.578+0000 7f2b5238e700 1 Processor -- start 2023-10-01T07:55:20.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.578+0000 7f5a35628700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5a30138d80 0x7f5a30134160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:20.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.578+0000 7f5a2ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a300a0a30 0x7f5a30133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:20.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.578+0000 7f5a35628700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5a30138d80 0x7f5a30134160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37688/0 (socket says 172.21.15.26:37688) 2023-10-01T07:55:20.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.578+0000 7f5a35628700 1 -- 172.21.15.26:0/2668485793 learned_addr learned my addr 172.21.15.26:0/2668485793 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:20.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.578+0000 7f2b5238e700 1 -- start start 2023-10-01T07:55:20.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.578+0000 7f5a2ffff700 1 -- 172.21.15.26:0/2668485793 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5a3009d630 msgr2=0x7f5a301336e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:20.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.578+0000 7f5a2ffff700 1 --2- 172.21.15.26:0/2668485793 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5a3009d630 0x7f5a301336e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.578+0000 7f5a2ffff700 1 -- 172.21.15.26:0/2668485793 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5a30138d80 msgr2=0x7f5a30134160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:20.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.578+0000 7f5a2ffff700 1 --2- 172.21.15.26:0/2668485793 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5a30138d80 0x7f5a30134160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.578+0000 7f5a2ffff700 1 -- 172.21.15.26:0/2668485793 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a1c0094a0 con 0x7f5a300a0a30 2023-10-01T07:55:20.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.578+0000 7f5a2ffff700 1 --2- 172.21.15.26:0/2668485793 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a300a0a30 0x7f5a30133c20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5a300a1fb0 tx=0x7f5a1c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:20.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.579+0000 7f5a2d7fa700 1 -- 172.21.15.26:0/2668485793 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c004480 con 0x7f5a300a0a30 2023-10-01T07:55:20.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.579+0000 7f2b5238e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b4c09d6f0 0x7f2b4c1227d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:20.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.579+0000 7f2b5238e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2b4c09e000 0x7f2b4c122d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:20.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.579+0000 7f2b5238e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b4c09e410 0x7f2b4c123250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:20.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.579+0000 7f2b5238e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c125c00 con 0x7f2b4c09d6f0 2023-10-01T07:55:20.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.579+0000 7f2b5238e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c1262a0 con 0x7f2b4c09e410 2023-10-01T07:55:20.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.579+0000 7f2b5238e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c09c710 con 0x7f2b4c09e000 2023-10-01T07:55:20.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.579+0000 7f2b4bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b4c09d6f0 0x7f2b4c1227d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:20.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.579+0000 7f2b4b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2b4c09e000 0x7f2b4c122d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:20.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.579+0000 7f2b4bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b4c09d6f0 0x7f2b4c1227d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37104/0 (socket says 172.21.15.26:37104) 2023-10-01T07:55:20.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.579+0000 7f2b4bfff700 1 -- 172.21.15.26:0/2476658778 learned_addr learned my addr 172.21.15.26:0/2476658778 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:20.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.579+0000 7f2b4b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2b4c09e000 0x7f2b4c122d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55280/0 (socket says 172.21.15.26:55280) 2023-10-01T07:55:20.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.579+0000 7f2b5092b700 1 --2- 172.21.15.26:0/2476658778 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b4c09e410 0x7f2b4c123250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:20.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.579+0000 7f2b5092b700 1 -- 172.21.15.26:0/2476658778 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2b4c09e000 msgr2=0x7f2b4c122d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:20.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.579+0000 7f2b5092b700 1 --2- 172.21.15.26:0/2476658778 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2b4c09e000 0x7f2b4c122d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.579+0000 7f2b5092b700 1 -- 172.21.15.26:0/2476658778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b4c09d6f0 msgr2=0x7f2b4c1227d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:20.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.579+0000 7f2b5092b700 1 --2- 172.21.15.26:0/2476658778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b4c09d6f0 0x7f2b4c1227d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.579+0000 7f2b5092b700 1 -- 172.21.15.26:0/2476658778 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3c009550 con 0x7f2b4c09e410 2023-10-01T07:55:20.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.580+0000 7f2b5092b700 1 --2- 172.21.15.26:0/2476658778 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b4c09e410 0x7f2b4c123250 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2b4400ef90 tx=0x7f2b4400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:20.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.579+0000 7f5a2d7fa700 1 -- 172.21.15.26:0/2668485793 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1c01f070 con 0x7f5a300a0a30 2023-10-01T07:55:20.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.579+0000 7f5a2d7fa700 1 -- 172.21.15.26:0/2668485793 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c0038a0 con 0x7f5a300a0a30 2023-10-01T07:55:20.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.579+0000 7f5a3708b700 1 -- 172.21.15.26:0/2668485793 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a30136c60 con 0x7f5a300a0a30 2023-10-01T07:55:20.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.579+0000 7f5a3708b700 1 -- 172.21.15.26:0/2668485793 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a300a4b80 con 0x7f5a300a0a30 2023-10-01T07:55:20.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.580+0000 7f2b48ff9700 1 -- 172.21.15.26:0/2476658778 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4400cc90 con 0x7f2b4c09e410 2023-10-01T07:55:20.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.580+0000 7f2b48ff9700 1 -- 172.21.15.26:0/2476658778 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4400f040 con 0x7f2b4c09e410 2023-10-01T07:55:20.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.580+0000 7f2b48ff9700 1 -- 172.21.15.26:0/2476658778 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b440146c0 con 0x7f2b4c09e410 2023-10-01T07:55:20.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.580+0000 7f2b5238e700 1 -- 172.21.15.26:0/2476658778 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b4c124330 con 0x7f2b4c09e410 2023-10-01T07:55:20.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.580+0000 7f2b5238e700 1 -- 172.21.15.26:0/2476658778 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b4c1258a0 con 0x7f2b4c09e410 2023-10-01T07:55:20.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.581+0000 7f5a3708b700 1 -- 172.21.15.26:0/2668485793 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a301389f0 con 0x7f5a300a0a30 2023-10-01T07:55:20.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.582+0000 7f5a2d7fa700 1 -- 172.21.15.26:0/2668485793 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5a1c021030 con 0x7f5a300a0a30 2023-10-01T07:55:20.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.582+0000 7f5a2d7fa700 1 -- 172.21.15.26:0/2668485793 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5a1c040f00 con 0x7f5a300a0a30 2023-10-01T07:55:20.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.582+0000 7f2b48ff9700 1 -- 172.21.15.26:0/2476658778 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2b44014820 con 0x7f2b4c09e410 2023-10-01T07:55:20.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.582+0000 7f2b48ff9700 1 -- 172.21.15.26:0/2476658778 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2b44040230 con 0x7f2b4c09e410 2023-10-01T07:55:20.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.583+0000 7f2b5238e700 1 -- 172.21.15.26:0/2476658778 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b4c125ef0 con 0x7f2b4c09e410 2023-10-01T07:55:20.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.589+0000 7f5a2d7fa700 1 -- 172.21.15.26:0/2668485793 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5a1c0199a0 con 0x7f5a300a0a30 2023-10-01T07:55:20.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.591+0000 7f2b48ff9700 1 -- 172.21.15.26:0/2476658778 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2b44018030 con 0x7f2b4c09e410 2023-10-01T07:55:20.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.619+0000 7fab68a92700 1 Processor -- start 2023-10-01T07:55:20.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.619+0000 7fab68a92700 1 -- start start 2023-10-01T07:55:20.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.620+0000 7fab68a92700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fab640a0a30 0x7fab640a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:20.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.620+0000 7fab68a92700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab6409d630 0x7fab640a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:20.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.621+0000 7fab68a92700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab640a2a70 con 0x7fab64133930 2023-10-01T07:55:20.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.621+0000 7fab68a92700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab640a01d0 con 0x7fab640a0a30 2023-10-01T07:55:20.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.621+0000 7fab68a92700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6409e2b0 con 0x7fab6409d630 2023-10-01T07:55:20.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.621+0000 7fab61d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab6409d630 0x7fab640a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:20.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.621+0000 7fab62d9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fab64133930 0x7fab64133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41314/0 (socket says 172.21.15.26:41314) 2023-10-01T07:55:20.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.621+0000 7fab62d9d700 1 -- 172.21.15.26:0/3327371259 learned_addr learned my addr 172.21.15.26:0/3327371259 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:20.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.621+0000 7fab6259c700 1 --2- 172.21.15.26:0/3327371259 >> v2:172.21.15.26:3300/0 conn(0x7fab640a0a30 0x7fab640a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:20.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.621+0000 7fab61d9b700 1 -- 172.21.15.26:0/3327371259 >> v2:172.21.15.26:3300/0 conn(0x7fab640a0a30 msgr2=0x7fab640a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:20.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.621+0000 7fab61d9b700 1 --2- 172.21.15.26:0/3327371259 >> v2:172.21.15.26:3300/0 conn(0x7fab640a0a30 0x7fab640a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.621+0000 7fab61d9b700 1 -- 172.21.15.26:0/3327371259 >> v1:172.21.15.26:6789/0 conn(0x7fab64133930 legacy=0x7fab64133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:20.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.621+0000 7fab61d9b700 1 -- 172.21.15.26:0/3327371259 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6409dc50 con 0x7fab6409d630 2023-10-01T07:55:20.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.621+0000 7fab61d9b700 1 --2- 172.21.15.26:0/3327371259 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab6409d630 0x7fab640a1340 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fab58009840 tx=0x7fab58009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1ce6198019cc81b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:20.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.622+0000 7fab6159a700 1 -- 172.21.15.26:0/3327371259 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab58011830 con 0x7fab6409d630 2023-10-01T07:55:20.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.622+0000 7fab6159a700 1 -- 172.21.15.26:0/3327371259 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab58011990 con 0x7fab6409d630 2023-10-01T07:55:20.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.622+0000 7fab6159a700 1 -- 172.21.15.26:0/3327371259 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab58011d20 con 0x7fab6409d630 2023-10-01T07:55:20.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.623+0000 7fab68a92700 1 -- 172.21.15.26:0/3327371259 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab6409d630 msgr2=0x7fab640a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:20.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.623+0000 7fab68a92700 1 --2- 172.21.15.26:0/3327371259 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab6409d630 0x7fab640a1340 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fab58009840 tx=0x7fab58009b50 comp rx=0 tx=0).stop 2023-10-01T07:55:20.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.623+0000 7fab68a92700 1 -- 172.21.15.26:0/3327371259 shutdown_connections 2023-10-01T07:55:20.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.623+0000 7fab68a92700 1 --2- 172.21.15.26:0/3327371259 >> v2:172.21.15.26:3300/0 conn(0x7fab640a0a30 0x7fab640a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.623+0000 7fab68a92700 1 --2- 172.21.15.26:0/3327371259 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab6409d630 0x7fab640a1340 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.623+0000 7fab68a92700 1 -- 172.21.15.26:0/3327371259 >> 172.21.15.26:0/3327371259 conn(0x7fab640a3050 msgr2=0x7fab640a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:20.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.623+0000 7fab68a92700 1 -- 172.21.15.26:0/3327371259 shutdown_connections 2023-10-01T07:55:20.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.623+0000 7fab68a92700 1 -- 172.21.15.26:0/3327371259 wait complete. 2023-10-01T07:55:20.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.624+0000 7fab68a92700 1 Processor -- start 2023-10-01T07:55:20.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.624+0000 7fab68a92700 1 -- start start 2023-10-01T07:55:20.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.625+0000 7fab68a92700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab6409d630 0x7fab6411f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:20.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.625+0000 7fab68a92700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab640a0a30 0x7fab6411f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:20.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.625+0000 7fab68a92700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab64133930 0x7fab641c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:20.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.625+0000 7fab68a92700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab64121fb0 con 0x7fab640a0a30 2023-10-01T07:55:20.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.625+0000 7fab68a92700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6411eef0 con 0x7fab64133930 2023-10-01T07:55:20.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.625+0000 7fab68a92700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab64120640 con 0x7fab6409d630 2023-10-01T07:55:20.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.625+0000 7fab61d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab640a0a30 0x7fab6411f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:20.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.625+0000 7fab61d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab640a0a30 0x7fab6411f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37114/0 (socket says 172.21.15.26:37114) 2023-10-01T07:55:20.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.625+0000 7fab61d9b700 1 -- 172.21.15.26:0/422554058 learned_addr learned my addr 172.21.15.26:0/422554058 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:20.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.625+0000 7fab6259c700 1 --2- 172.21.15.26:0/422554058 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab6409d630 0x7fab6411f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:20.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.625+0000 7fab61d9b700 1 -- 172.21.15.26:0/422554058 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab6409d630 msgr2=0x7fab6411f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:20.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.625+0000 7fab61d9b700 1 --2- 172.21.15.26:0/422554058 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab6409d630 0x7fab6411f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.625+0000 7fab61d9b700 1 -- 172.21.15.26:0/422554058 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab64133930 msgr2=0x7fab641c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:20.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.625+0000 7fab61d9b700 1 --2- 172.21.15.26:0/422554058 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab64133930 0x7fab641c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.625+0000 7fab61d9b700 1 -- 172.21.15.26:0/422554058 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab580094a0 con 0x7fab640a0a30 2023-10-01T07:55:20.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.626+0000 7fab61d9b700 1 --2- 172.21.15.26:0/422554058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab640a0a30 0x7fab6411f9d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fab58009fd0 tx=0x7fab58004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:20.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.626+0000 7fab52ffd700 1 -- 172.21.15.26:0/422554058 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab58004530 con 0x7fab640a0a30 2023-10-01T07:55:20.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.626+0000 7fab52ffd700 1 -- 172.21.15.26:0/422554058 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab5801f070 con 0x7fab640a0a30 2023-10-01T07:55:20.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.626+0000 7fab52ffd700 1 -- 172.21.15.26:0/422554058 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab580038e0 con 0x7fab640a0a30 2023-10-01T07:55:20.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.626+0000 7fab68a92700 1 -- 172.21.15.26:0/422554058 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab640a5040 con 0x7fab640a0a30 2023-10-01T07:55:20.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.626+0000 7fab68a92700 1 -- 172.21.15.26:0/422554058 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab641334e0 con 0x7fab640a0a30 2023-10-01T07:55:20.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.627+0000 7fab68a92700 1 -- 172.21.15.26:0/422554058 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab6411ff10 con 0x7fab640a0a30 2023-10-01T07:55:20.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.628+0000 7fab52ffd700 1 -- 172.21.15.26:0/422554058 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab58021030 con 0x7fab640a0a30 2023-10-01T07:55:20.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.628+0000 7fab52ffd700 1 -- 172.21.15.26:0/422554058 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fab58040da0 con 0x7fab640a0a30 2023-10-01T07:55:20.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.637+0000 7fab52ffd700 1 -- 172.21.15.26:0/422554058 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab5801a450 con 0x7fab640a0a30 2023-10-01T07:55:20.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.789+0000 7fc63d94d700 1 -- 172.21.15.26:0/3431114965 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc638074ea0 con 0x7fc63809e410 2023-10-01T07:55:20.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.789+0000 7fc61ffff700 1 -- 172.21.15.26:0/3431114965 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc63002b090 con 0x7fc63809e410 2023-10-01T07:55:20.790 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:20.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.792+0000 7fc63d94d700 1 -- 172.21.15.26:0/3431114965 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc63809e410 msgr2=0x7fc638122f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:20.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.792+0000 7fc63d94d700 1 --2- 172.21.15.26:0/3431114965 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc63809e410 0x7fc638122f50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc630009d90 tx=0x7fc63000c3a0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.792+0000 7fc63d94d700 1 -- 172.21.15.26:0/3431114965 shutdown_connections 2023-10-01T07:55:20.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.792+0000 7fc63d94d700 1 --2- 172.21.15.26:0/3431114965 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc63809e410 0x7fc638122f50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.792+0000 7fc63d94d700 1 --2- 172.21.15.26:0/3431114965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc63809d6f0 0x7fc6381224d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.792+0000 7fc63d94d700 1 --2- 172.21.15.26:0/3431114965 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc63809e000 0x7fc638122a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.792+0000 7fc63d94d700 1 -- 172.21.15.26:0/3431114965 >> 172.21.15.26:0/3431114965 conn(0x7fc638066f50 msgr2=0x7fc638133e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:20.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.792+0000 7fc63d94d700 1 -- 172.21.15.26:0/3431114965 shutdown_connections 2023-10-01T07:55:20.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.792+0000 7fc63d94d700 1 -- 172.21.15.26:0/3431114965 wait complete. 2023-10-01T07:55:20.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.800+0000 7f2b5238e700 1 -- 172.21.15.26:0/2476658778 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2b4c074ea0 con 0x7f2b4c09e410 2023-10-01T07:55:20.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.800+0000 7f2b48ff9700 1 -- 172.21.15.26:0/2476658778 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2b44009e60 con 0x7f2b4c09e410 2023-10-01T07:55:20.801 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:20.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.803+0000 7f2b5238e700 1 -- 172.21.15.26:0/2476658778 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b4c09e410 msgr2=0x7f2b4c123250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:20.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.803+0000 7f2b5238e700 1 --2- 172.21.15.26:0/2476658778 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b4c09e410 0x7f2b4c123250 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2b4400ef90 tx=0x7f2b4400c3a0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.803+0000 7f2b5238e700 1 -- 172.21.15.26:0/2476658778 shutdown_connections 2023-10-01T07:55:20.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.803+0000 7f2b5238e700 1 --2- 172.21.15.26:0/2476658778 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b4c09e410 0x7f2b4c123250 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.803+0000 7f2b5238e700 1 --2- 172.21.15.26:0/2476658778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b4c09d6f0 0x7f2b4c1227d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.803+0000 7f2b5238e700 1 --2- 172.21.15.26:0/2476658778 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2b4c09e000 0x7f2b4c122d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.803+0000 7f2b5238e700 1 -- 172.21.15.26:0/2476658778 >> 172.21.15.26:0/2476658778 conn(0x7f2b4c066f50 msgr2=0x7f2b4c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:20.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.803+0000 7f2b5238e700 1 -- 172.21.15.26:0/2476658778 shutdown_connections 2023-10-01T07:55:20.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.803+0000 7f2b5238e700 1 -- 172.21.15.26:0/2476658778 wait complete. 2023-10-01T07:55:20.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.805+0000 7f5a3708b700 1 -- 172.21.15.26:0/2668485793 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5a300747f0 con 0x7f5a300a0a30 2023-10-01T07:55:20.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.806+0000 7f5a2d7fa700 1 -- 172.21.15.26:0/2668485793 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5a1c015070 con 0x7f5a300a0a30 2023-10-01T07:55:20.806 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:20.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.808+0000 7f5a3708b700 1 -- 172.21.15.26:0/2668485793 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a300a0a30 msgr2=0x7f5a30133c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:20.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.808+0000 7f5a3708b700 1 --2- 172.21.15.26:0/2668485793 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a300a0a30 0x7f5a30133c20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5a300a1fb0 tx=0x7f5a1c004750 comp rx=0 tx=0).stop 2023-10-01T07:55:20.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.808+0000 7f5a3708b700 1 -- 172.21.15.26:0/2668485793 shutdown_connections 2023-10-01T07:55:20.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.808+0000 7f5a3708b700 1 --2- 172.21.15.26:0/2668485793 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5a30138d80 0x7f5a30134160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.808+0000 7f5a3708b700 1 --2- 172.21.15.26:0/2668485793 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5a3009d630 0x7f5a301336e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.808+0000 7f5a3708b700 1 --2- 172.21.15.26:0/2668485793 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a300a0a30 0x7f5a30133c20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.808+0000 7f5a3708b700 1 -- 172.21.15.26:0/2668485793 >> 172.21.15.26:0/2668485793 conn(0x7f5a300a3050 msgr2=0x7f5a3009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:20.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.808+0000 7f5a3708b700 1 -- 172.21.15.26:0/2668485793 shutdown_connections 2023-10-01T07:55:20.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.808+0000 7f5a3708b700 1 -- 172.21.15.26:0/2668485793 wait complete. 2023-10-01T07:55:20.813 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:20.820 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:20.824 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:20.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.866+0000 7fab68a92700 1 -- 172.21.15.26:0/422554058 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fab640747f0 con 0x7fab640a0a30 2023-10-01T07:55:20.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.867+0000 7fab52ffd700 1 -- 172.21.15.26:0/422554058 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fab58015070 con 0x7fab640a0a30 2023-10-01T07:55:20.867 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:20.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.869+0000 7fab68a92700 1 -- 172.21.15.26:0/422554058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab640a0a30 msgr2=0x7fab6411f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:20.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.869+0000 7fab68a92700 1 --2- 172.21.15.26:0/422554058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab640a0a30 0x7fab6411f9d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fab58009fd0 tx=0x7fab58004750 comp rx=0 tx=0).stop 2023-10-01T07:55:20.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.869+0000 7fab68a92700 1 -- 172.21.15.26:0/422554058 shutdown_connections 2023-10-01T07:55:20.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.869+0000 7fab68a92700 1 --2- 172.21.15.26:0/422554058 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab64133930 0x7fab641c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.869+0000 7fab68a92700 1 --2- 172.21.15.26:0/422554058 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab6409d630 0x7fab6411f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.869+0000 7fab68a92700 1 --2- 172.21.15.26:0/422554058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab640a0a30 0x7fab6411f9d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:20.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.869+0000 7fab68a92700 1 -- 172.21.15.26:0/422554058 >> 172.21.15.26:0/422554058 conn(0x7fab640a3050 msgr2=0x7fab641bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:20.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.869+0000 7fab68a92700 1 -- 172.21.15.26:0/422554058 shutdown_connections 2023-10-01T07:55:20.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:20.869+0000 7fab68a92700 1 -- 172.21.15.26:0/422554058 wait complete. 2023-10-01T07:55:20.883 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:21.814 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:21.821 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:21.824 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:21.884 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:21.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.967+0000 7f149500a700 1 Processor -- start 2023-10-01T07:55:21.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.967+0000 7f149500a700 1 -- start start 2023-10-01T07:55:21.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.967+0000 7f149500a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f149009d6f0 0x7f149009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:21.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.967+0000 7f149500a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f149009e000 0x7f14901339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:21.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.967+0000 7f149500a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f149009e410 0x7f1490133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:21.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.967+0000 7f149500a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f149006b460 con 0x7f149009d6f0 2023-10-01T07:55:21.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.967+0000 7f149500a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149009b120 con 0x7f149009e410 2023-10-01T07:55:21.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.967+0000 7f149500a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f149009a7e0 con 0x7f149009e000 2023-10-01T07:55:21.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.968+0000 7f148ed9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f149009d6f0 0x7f149009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:21.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.968+0000 7f148f59e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f149009e410 0x7f1490133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:21.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.968+0000 7f148e59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f149009e000 0x7f14901339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:21.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.968+0000 7f148f59e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f149009e410 0x7f1490133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37714/0 (socket says 172.21.15.26:37714) 2023-10-01T07:55:21.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.968+0000 7f148ed9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f149009d6f0 0x7f149009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37128/0 (socket says 172.21.15.26:37128) 2023-10-01T07:55:21.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.968+0000 7f148f59e700 1 -- 172.21.15.26:0/2601683240 learned_addr learned my addr 172.21.15.26:0/2601683240 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:21.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.968+0000 7f148f59e700 1 -- 172.21.15.26:0/2601683240 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f149009e000 msgr2=0x7f14901339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:21.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.968+0000 7f148f59e700 1 --2- 172.21.15.26:0/2601683240 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f149009e000 0x7f14901339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:21.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.968+0000 7f148f59e700 1 -- 172.21.15.26:0/2601683240 >> v2:172.21.15.26:3300/0 conn(0x7f149009d6f0 msgr2=0x7f149009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:21.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.968+0000 7f148f59e700 1 --2- 172.21.15.26:0/2601683240 >> v2:172.21.15.26:3300/0 conn(0x7f149009d6f0 0x7f149009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:21.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.968+0000 7f148f59e700 1 -- 172.21.15.26:0/2601683240 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149009a500 con 0x7f149009e410 2023-10-01T07:55:21.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.968+0000 7f148f59e700 1 --2- 172.21.15.26:0/2601683240 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f149009e410 0x7f1490133f30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1488009e80 tx=0x7f148800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42ca6c56e3f4df9c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:21.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.969+0000 7f148dd9b700 1 -- 172.21.15.26:0/2601683240 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148800e070 con 0x7f149009e410 2023-10-01T07:55:21.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.969+0000 7f148dd9b700 1 -- 172.21.15.26:0/2601683240 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148800b8d0 con 0x7f149009e410 2023-10-01T07:55:21.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.969+0000 7f148dd9b700 1 -- 172.21.15.26:0/2601683240 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148800bc80 con 0x7f149009e410 2023-10-01T07:55:21.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.969+0000 7f149500a700 1 -- 172.21.15.26:0/2601683240 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f149009e410 msgr2=0x7f1490133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:21.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.969+0000 7f149500a700 1 --2- 172.21.15.26:0/2601683240 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f149009e410 0x7f1490133f30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1488009e80 tx=0x7f148800b330 comp rx=0 tx=0).stop 2023-10-01T07:55:21.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.969+0000 7f149500a700 1 -- 172.21.15.26:0/2601683240 shutdown_connections 2023-10-01T07:55:21.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.969+0000 7f149500a700 1 --2- 172.21.15.26:0/2601683240 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f149009e410 0x7f1490133f30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:21.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.969+0000 7f149500a700 1 --2- 172.21.15.26:0/2601683240 >> v2:172.21.15.26:3300/0 conn(0x7f149009d6f0 0x7f149009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:21.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.969+0000 7f149500a700 1 --2- 172.21.15.26:0/2601683240 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f149009e000 0x7f14901339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:21.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.969+0000 7f149500a700 1 -- 172.21.15.26:0/2601683240 >> 172.21.15.26:0/2601683240 conn(0x7f1490066f50 msgr2=0x7f149009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:21.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.970+0000 7f149500a700 1 -- 172.21.15.26:0/2601683240 shutdown_connections 2023-10-01T07:55:21.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.970+0000 7f149500a700 1 -- 172.21.15.26:0/2601683240 wait complete. 2023-10-01T07:55:21.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.971+0000 7f149500a700 1 Processor -- start 2023-10-01T07:55:21.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.971+0000 7f149500a700 1 -- start start 2023-10-01T07:55:21.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.972+0000 7f149500a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f149009d6f0 0x7f14901c50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:21.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.972+0000 7f149500a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f149009e000 0x7f14901c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:21.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.972+0000 7f149500a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f149009e410 0x7f14901c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:21.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.972+0000 7f149500a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14901c48b0 con 0x7f149009e000 2023-10-01T07:55:21.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.972+0000 7f149500a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14900a1f90 con 0x7f149009e410 2023-10-01T07:55:21.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.972+0000 7f149500a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f149009c710 con 0x7f149009d6f0 2023-10-01T07:55:21.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.972+0000 7f148e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f149009e000 0x7f14901c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:21.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.972+0000 7f148e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f149009e000 0x7f14901c55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37134/0 (socket says 172.21.15.26:37134) 2023-10-01T07:55:21.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.972+0000 7f148e59c700 1 -- 172.21.15.26:0/2643860431 learned_addr learned my addr 172.21.15.26:0/2643860431 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:21.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.972+0000 7f148f59e700 1 --2- 172.21.15.26:0/2643860431 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f149009e410 0x7f14901c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:21.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.972+0000 7f148ed9d700 1 --2- 172.21.15.26:0/2643860431 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f149009d6f0 0x7f14901c50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:21.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.972+0000 7f148ed9d700 1 -- 172.21.15.26:0/2643860431 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f149009e410 msgr2=0x7f14901c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:21.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.972+0000 7f148ed9d700 1 --2- 172.21.15.26:0/2643860431 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f149009e410 0x7f14901c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:21.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.972+0000 7f148ed9d700 1 -- 172.21.15.26:0/2643860431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f149009e000 msgr2=0x7f14901c55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:21.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.972+0000 7f148ed9d700 1 --2- 172.21.15.26:0/2643860431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f149009e000 0x7f14901c55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:21.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.972+0000 7f148ed9d700 1 -- 172.21.15.26:0/2643860431 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1488009b30 con 0x7f149009d6f0 2023-10-01T07:55:21.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.972+0000 7f148f59e700 1 --2- 172.21.15.26:0/2643860431 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f149009e410 0x7f14901c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:21.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.973+0000 7f148e59c700 1 --2- 172.21.15.26:0/2643860431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f149009e000 0x7f14901c55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:21.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.973+0000 7f148ed9d700 1 --2- 172.21.15.26:0/2643860431 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f149009d6f0 0x7f14901c50b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f148000e900 tx=0x7f148000ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:21.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.973+0000 7f14777fe700 1 -- 172.21.15.26:0/2643860431 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1480013680 con 0x7f149009d6f0 2023-10-01T07:55:21.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.973+0000 7f14777fe700 1 -- 172.21.15.26:0/2643860431 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14800137e0 con 0x7f149009d6f0 2023-10-01T07:55:21.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.973+0000 7f149500a700 1 -- 172.21.15.26:0/2643860431 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14901abac0 con 0x7f149009d6f0 2023-10-01T07:55:21.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.973+0000 7f14777fe700 1 -- 172.21.15.26:0/2643860431 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1480013b50 con 0x7f149009d6f0 2023-10-01T07:55:21.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.973+0000 7f149500a700 1 -- 172.21.15.26:0/2643860431 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14901a9cb0 con 0x7f149009d6f0 2023-10-01T07:55:21.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.974+0000 7f14777fe700 1 -- 172.21.15.26:0/2643860431 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1480013cb0 con 0x7f149009d6f0 2023-10-01T07:55:21.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.974+0000 7f149500a700 1 -- 172.21.15.26:0/2643860431 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1490074ea0 con 0x7f149009d6f0 2023-10-01T07:55:21.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.975+0000 7f14777fe700 1 -- 172.21.15.26:0/2643860431 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f148003f6a0 con 0x7f149009d6f0 2023-10-01T07:55:21.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:21.984+0000 7f14777fe700 1 -- 172.21.15.26:0/2643860431 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f148000c3f0 con 0x7f149009d6f0 2023-10-01T07:55:22.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.012+0000 7f29c9a3d700 1 Processor -- start 2023-10-01T07:55:22.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.012+0000 7f29c9a3d700 1 -- start start 2023-10-01T07:55:22.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.013+0000 7f29c9a3d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29c406e570 0x7f29c406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:22.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.013+0000 7f29c9a3d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f29c406ee80 0x7f29c4134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:22.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.013+0000 7f29c9a3d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29c4070ee0 con 0x7f29c409eca0 2023-10-01T07:55:22.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.013+0000 7f29c9a3d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29c4071480 con 0x7f29c406ee80 2023-10-01T07:55:22.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.013+0000 7f29c9a3d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c4071b90 con 0x7f29c406e570 2023-10-01T07:55:22.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.013+0000 7f29c37fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f29c406ee80 0x7f29c4134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:22.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.013+0000 7f29c2ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29c406e570 0x7f29c406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:22.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.013+0000 7f29c37fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f29c406ee80 0x7f29c4134d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37142/0 (socket says 172.21.15.26:37142) 2023-10-01T07:55:22.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.013+0000 7f29c37fe700 1 -- 172.21.15.26:0/1073289457 learned_addr learned my addr 172.21.15.26:0/1073289457 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:22.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.014+0000 7f29c37fe700 1 -- 172.21.15.26:0/1073289457 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29c406e570 msgr2=0x7f29c406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:22.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.014+0000 7f29c37fe700 1 --2- 172.21.15.26:0/1073289457 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29c406e570 0x7f29c406e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:22.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.014+0000 7f29c37fe700 1 -- 172.21.15.26:0/1073289457 >> v1:172.21.15.26:6789/0 conn(0x7f29c409eca0 legacy=0x7f29c4134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:22.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.014+0000 7f29c37fe700 1 -- 172.21.15.26:0/1073289457 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c40711a0 con 0x7f29c406ee80 2023-10-01T07:55:22.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.014+0000 7f29c1ffb700 1 -- 172.21.15.26:0/1073289457 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1420493689 0 0) 0x7f29c4070ee0 con 0x7f29c409eca0 2023-10-01T07:55:22.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.014+0000 7f29c2ffd700 1 --2- 172.21.15.26:0/1073289457 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29c406e570 0x7f29c406e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:22.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.014+0000 7f29c37fe700 1 --2- 172.21.15.26:0/1073289457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29c406ee80 0x7f29c4134d20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f29bc009e50 tx=0x7f29bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51f2478eaaa7f558 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:22.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.014+0000 7f29c1ffb700 1 -- 172.21.15.26:0/1073289457 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc00e070 con 0x7f29c406ee80 2023-10-01T07:55:22.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.014+0000 7f29c1ffb700 1 -- 172.21.15.26:0/1073289457 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29bc00b910 con 0x7f29c406ee80 2023-10-01T07:55:22.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.014+0000 7f29c1ffb700 1 -- 172.21.15.26:0/1073289457 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc00bcc0 con 0x7f29c406ee80 2023-10-01T07:55:22.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.015+0000 7f29c9a3d700 1 -- 172.21.15.26:0/1073289457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29c406ee80 msgr2=0x7f29c4134d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:22.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.015+0000 7f29c9a3d700 1 --2- 172.21.15.26:0/1073289457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29c406ee80 0x7f29c4134d20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f29bc009e50 tx=0x7f29bc00b330 comp rx=0 tx=0).stop 2023-10-01T07:55:22.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.015+0000 7f29c9a3d700 1 -- 172.21.15.26:0/1073289457 shutdown_connections 2023-10-01T07:55:22.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.015+0000 7f29c9a3d700 1 --2- 172.21.15.26:0/1073289457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29c406ee80 0x7f29c4134d20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:22.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.015+0000 7f29c9a3d700 1 --2- 172.21.15.26:0/1073289457 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29c406e570 0x7f29c406e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:22.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.015+0000 7f29c9a3d700 1 -- 172.21.15.26:0/1073289457 >> 172.21.15.26:0/1073289457 conn(0x7f29c40a2aa0 msgr2=0x7f29c40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:22.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.015+0000 7f29c9a3d700 1 -- 172.21.15.26:0/1073289457 shutdown_connections 2023-10-01T07:55:22.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.015+0000 7f29c9a3d700 1 -- 172.21.15.26:0/1073289457 wait complete. 2023-10-01T07:55:22.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.016+0000 7f29c9a3d700 1 Processor -- start 2023-10-01T07:55:22.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.016+0000 7f29c9a3d700 1 -- start start 2023-10-01T07:55:22.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.017+0000 7f29c9a3d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29c406e570 0x7f29c41231a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:22.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.017+0000 7f29c9a3d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29c406ee80 0x7f29c41236e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:22.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.017+0000 7f29c9a3d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29c4123c20 0x7f29c41d2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:22.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.017+0000 7f29c9a3d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c4124cc0 con 0x7f29c406e570 2023-10-01T07:55:22.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.017+0000 7f29c9a3d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c4126300 con 0x7f29c4123c20 2023-10-01T07:55:22.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.017+0000 7f29c9a3d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29c41269d0 con 0x7f29c406ee80 2023-10-01T07:55:22.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.017+0000 7f29c37fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29c4123c20 0x7f29c41d2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:22.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.017+0000 7f29c37fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29c4123c20 0x7f29c41d2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37746/0 (socket says 172.21.15.26:37746) 2023-10-01T07:55:22.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.017+0000 7f29c37fe700 1 -- 172.21.15.26:0/449708724 learned_addr learned my addr 172.21.15.26:0/449708724 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:22.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.017+0000 7f29c27fc700 1 --2- 172.21.15.26:0/449708724 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29c406ee80 0x7f29c41236e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:22.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.017+0000 7f29c2ffd700 1 --2- 172.21.15.26:0/449708724 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29c406e570 0x7f29c41231a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:22.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.017+0000 7f29c37fe700 1 -- 172.21.15.26:0/449708724 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29c406ee80 msgr2=0x7f29c41236e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:22.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.017+0000 7f29c37fe700 1 --2- 172.21.15.26:0/449708724 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29c406ee80 0x7f29c41236e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:22.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.017+0000 7f29c37fe700 1 -- 172.21.15.26:0/449708724 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29c406e570 msgr2=0x7f29c41231a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:22.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.017+0000 7f29c37fe700 1 --2- 172.21.15.26:0/449708724 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29c406e570 0x7f29c41231a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:22.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.017+0000 7f29c37fe700 1 -- 172.21.15.26:0/449708724 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b40094a0 con 0x7f29c4123c20 2023-10-01T07:55:22.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.018+0000 7f29c37fe700 1 --2- 172.21.15.26:0/449708724 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29c4123c20 0x7f29c41d2a30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f29bc004270 tx=0x7f29bc004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:22.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.018+0000 7f29c2ffd700 1 --2- 172.21.15.26:0/449708724 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29c406e570 0x7f29c41231a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:55:22.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.018+0000 7f29abfff700 1 -- 172.21.15.26:0/449708724 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc0099b0 con 0x7f29c4123c20 2023-10-01T07:55:22.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.018+0000 7f29abfff700 1 -- 172.21.15.26:0/449708724 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29bc004950 con 0x7f29c4123c20 2023-10-01T07:55:22.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.018+0000 7f29c9a3d700 1 -- 172.21.15.26:0/449708724 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29bc009b30 con 0x7f29c4123c20 2023-10-01T07:55:22.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.018+0000 7f29abfff700 1 -- 172.21.15.26:0/449708724 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc01c660 con 0x7f29c4123c20 2023-10-01T07:55:22.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.018+0000 7f29c9a3d700 1 -- 172.21.15.26:0/449708724 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c41266a0 con 0x7f29c4123c20 2023-10-01T07:55:22.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.019+0000 7f29c9a3d700 1 -- 172.21.15.26:0/449708724 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c4135780 con 0x7f29c4123c20 2023-10-01T07:55:22.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.019+0000 7f83695a7700 1 Processor -- start 2023-10-01T07:55:22.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.019+0000 7f83695a7700 1 -- start start 2023-10-01T07:55:22.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.020+0000 7f83695a7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f836406e570 0x7f836406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:22.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.020+0000 7f83695a7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f836409eca0 0x7f836406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:22.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.020+0000 7f83695a7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8364134610 0x7f8364134a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:22.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.020+0000 7f83695a7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8364070ee0 con 0x7f836406e570 2023-10-01T07:55:22.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.020+0000 7f83695a7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8364071480 con 0x7f8364134610 2023-10-01T07:55:22.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.020+0000 7f83695a7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f836406f3c0 con 0x7f836409eca0 2023-10-01T07:55:22.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.020+0000 7f83627fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f836409eca0 0x7f836406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:22.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.020+0000 7f83627fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f836409eca0 0x7f836406ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55332/0 (socket says 172.21.15.26:55332) 2023-10-01T07:55:22.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.020+0000 7f83627fc700 1 -- 172.21.15.26:0/2272043929 learned_addr learned my addr 172.21.15.26:0/2272043929 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:22.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.020+0000 7f83637fe700 1 --2- 172.21.15.26:0/2272043929 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8364134610 0x7f8364134a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:22.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.020+0000 7f29abfff700 1 -- 172.21.15.26:0/449708724 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f29bc01c7c0 con 0x7f29c4123c20 2023-10-01T07:55:22.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.020+0000 7f29abfff700 1 -- 172.21.15.26:0/449708724 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f29bc041510 con 0x7f29c4123c20 2023-10-01T07:55:22.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.021+0000 7f83627fc700 1 -- 172.21.15.26:0/2272043929 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8364134610 msgr2=0x7f8364134a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:22.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.021+0000 7f83627fc700 1 --2- 172.21.15.26:0/2272043929 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8364134610 0x7f8364134a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:22.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.021+0000 7f83627fc700 1 -- 172.21.15.26:0/2272043929 >> v2:172.21.15.26:3300/0 conn(0x7f836406e570 msgr2=0x7f836406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:22.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.021+0000 7f83627fc700 1 --2- 172.21.15.26:0/2272043929 >> v2:172.21.15.26:3300/0 conn(0x7f836406e570 0x7f836406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:22.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.021+0000 7f83627fc700 1 -- 172.21.15.26:0/2272043929 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8364071b90 con 0x7f836409eca0 2023-10-01T07:55:22.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.021+0000 7f83627fc700 1 --2- 172.21.15.26:0/2272043929 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f836409eca0 0x7f836406ee80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f83580098f0 tx=0x7f8358009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a173382c210f7384 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:22.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.021+0000 7f8361ffb700 1 -- 172.21.15.26:0/2272043929 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8358011830 con 0x7f836409eca0 2023-10-01T07:55:22.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.021+0000 7f8361ffb700 1 -- 172.21.15.26:0/2272043929 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8358011990 con 0x7f836409eca0 2023-10-01T07:55:22.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.021+0000 7f8361ffb700 1 -- 172.21.15.26:0/2272043929 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8358011d20 con 0x7f836409eca0 2023-10-01T07:55:22.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.022+0000 7f83695a7700 1 -- 172.21.15.26:0/2272043929 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f836409eca0 msgr2=0x7f836406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:22.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.022+0000 7f83695a7700 1 --2- 172.21.15.26:0/2272043929 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f836409eca0 0x7f836406ee80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f83580098f0 tx=0x7f8358009c00 comp rx=0 tx=0).stop 2023-10-01T07:55:22.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.022+0000 7f83695a7700 1 -- 172.21.15.26:0/2272043929 shutdown_connections 2023-10-01T07:55:22.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.022+0000 7f83695a7700 1 --2- 172.21.15.26:0/2272043929 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8364134610 0x7f8364134a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:22.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.022+0000 7f83695a7700 1 --2- 172.21.15.26:0/2272043929 >> v2:172.21.15.26:3300/0 conn(0x7f836406e570 0x7f836406e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:22.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.022+0000 7f83695a7700 1 --2- 172.21.15.26:0/2272043929 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f836409eca0 0x7f836406ee80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:22.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.022+0000 7f83695a7700 1 -- 172.21.15.26:0/2272043929 >> 172.21.15.26:0/2272043929 conn(0x7f83640a2aa0 msgr2=0x7f83640a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:22.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.022+0000 7f83695a7700 1 -- 172.21.15.26:0/2272043929 shutdown_connections 2023-10-01T07:55:22.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.022+0000 7f83695a7700 1 -- 172.21.15.26:0/2272043929 wait complete. 2023-10-01T07:55:22.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.024+0000 7f83695a7700 1 Processor -- start 2023-10-01T07:55:22.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.024+0000 7f83695a7700 1 -- start start 2023-10-01T07:55:22.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.025+0000 7f29abfff700 1 -- 172.21.15.26:0/449708724 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f29bc023950 con 0x7f29c4123c20 2023-10-01T07:55:22.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.025+0000 7f83695a7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f836406e570 0x7f836413b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:22.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.025+0000 7f83695a7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8364134610 0x7f8364132800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:22.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.025+0000 7f83695a7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8364133c40 0x7f8364132d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:22.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.025+0000 7f83695a7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836413daa0 con 0x7f836406e570 2023-10-01T07:55:22.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.025+0000 7f83695a7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836413c3c0 con 0x7f8364134610 2023-10-01T07:55:22.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.025+0000 7f83695a7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83640a2000 con 0x7f8364133c40 2023-10-01T07:55:22.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.025+0000 7f8362ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f836406e570 0x7f836413b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:22.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.025+0000 7f8362ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f836406e570 0x7f836413b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37154/0 (socket says 172.21.15.26:37154) 2023-10-01T07:55:22.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.025+0000 7f8362ffd700 1 -- 172.21.15.26:0/3161055424 learned_addr learned my addr 172.21.15.26:0/3161055424 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:22.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.025+0000 7f83627fc700 1 --2- 172.21.15.26:0/3161055424 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8364134610 0x7f8364132800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:22.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.025+0000 7f83637fe700 1 --2- 172.21.15.26:0/3161055424 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8364133c40 0x7f8364132d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:22.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.026+0000 7f8362ffd700 1 -- 172.21.15.26:0/3161055424 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8364133c40 msgr2=0x7f8364132d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:22.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.026+0000 7f8362ffd700 1 --2- 172.21.15.26:0/3161055424 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8364133c40 0x7f8364132d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:22.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.026+0000 7f8362ffd700 1 -- 172.21.15.26:0/3161055424 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8364134610 msgr2=0x7f8364132800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:22.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.026+0000 7f8362ffd700 1 --2- 172.21.15.26:0/3161055424 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8364134610 0x7f8364132800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:22.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.026+0000 7f8362ffd700 1 -- 172.21.15.26:0/3161055424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8358009550 con 0x7f836406e570 2023-10-01T07:55:22.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.026+0000 7f8362ffd700 1 --2- 172.21.15.26:0/3161055424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f836406e570 0x7f836413b720 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f835400b530 tx=0x7f835400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:22.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.026+0000 7f834b7fe700 1 -- 172.21.15.26:0/3161055424 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8354011830 con 0x7f836406e570 2023-10-01T07:55:22.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.026+0000 7f834b7fe700 1 -- 172.21.15.26:0/3161055424 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8354011990 con 0x7f836406e570 2023-10-01T07:55:22.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.026+0000 7f83695a7700 1 -- 172.21.15.26:0/3161055424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8364070610 con 0x7f836406e570 2023-10-01T07:55:22.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.026+0000 7f834b7fe700 1 -- 172.21.15.26:0/3161055424 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8354011d40 con 0x7f836406e570 2023-10-01T07:55:22.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.026+0000 7f83695a7700 1 -- 172.21.15.26:0/3161055424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f836413d5c0 con 0x7f836406e570 2023-10-01T07:55:22.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.028+0000 7f83695a7700 1 -- 172.21.15.26:0/3161055424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8364074ea0 con 0x7f836406e570 2023-10-01T07:55:22.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.028+0000 7f834b7fe700 1 -- 172.21.15.26:0/3161055424 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f835401a400 con 0x7f836406e570 2023-10-01T07:55:22.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.028+0000 7f834b7fe700 1 -- 172.21.15.26:0/3161055424 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f835403f680 con 0x7f836406e570 2023-10-01T07:55:22.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.033+0000 7f834b7fe700 1 -- 172.21.15.26:0/3161055424 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f835400f8d0 con 0x7f836406e570 2023-10-01T07:55:22.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.063+0000 7fc1b4ee6700 1 Processor -- start 2023-10-01T07:55:22.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.063+0000 7fc1b4ee6700 1 -- start start 2023-10-01T07:55:22.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.063+0000 7fc1b4ee6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc1b009d6f0 0x7fc1b009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:22.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.063+0000 7fc1b4ee6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc1b009e000 0x7fc1b01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:22.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.064+0000 7fc1b4ee6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b009b120 con 0x7fc1b009e410 2023-10-01T07:55:22.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.064+0000 7fc1b4ee6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b006b460 con 0x7fc1b009e000 2023-10-01T07:55:22.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.064+0000 7fc1b4ee6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b009a7e0 con 0x7fc1b009d6f0 2023-10-01T07:55:22.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.064+0000 7fc1add9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc1b009e000 0x7fc1b01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:22.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.064+0000 7fc1aed9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc1b009e410 0x7fc1b0133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41334/0 (socket says 172.21.15.26:41334) 2023-10-01T07:55:22.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.064+0000 7fc1add9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc1b009e000 0x7fc1b01339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37164/0 (socket says 172.21.15.26:37164) 2023-10-01T07:55:22.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.064+0000 7fc1aed9d700 1 -- 172.21.15.26:0/2226068885 learned_addr learned my addr 172.21.15.26:0/2226068885 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:22.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.064+0000 7fc1ae59c700 1 --2- 172.21.15.26:0/2226068885 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc1b009d6f0 0x7fc1b009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:22.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.064+0000 7fc1ad59a700 1 -- 172.21.15.26:0/2226068885 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4076670584 0 0) 0x7fc1b009b120 con 0x7fc1b009e410 2023-10-01T07:55:22.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.064+0000 7fc1ad59a700 1 -- 172.21.15.26:0/2226068885 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1980035b0 con 0x7fc1b009e410 2023-10-01T07:55:22.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.064+0000 7fc1add9b700 1 -- 172.21.15.26:0/2226068885 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc1b009d6f0 msgr2=0x7fc1b009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:22.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.064+0000 7fc1add9b700 1 --2- 172.21.15.26:0/2226068885 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc1b009d6f0 0x7fc1b009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:22.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.064+0000 7fc1add9b700 1 -- 172.21.15.26:0/2226068885 >> v1:172.21.15.26:6789/0 conn(0x7fc1b009e410 legacy=0x7fc1b0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:22.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.064+0000 7fc1add9b700 1 -- 172.21.15.26:0/2226068885 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b009a500 con 0x7fc1b009e000 2023-10-01T07:55:22.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.065+0000 7fc1add9b700 1 --2- 172.21.15.26:0/2226068885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1b009e000 0x7fc1b01339f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009840 tx=0x7fc1a4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=992f561400bd8674 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:22.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.065+0000 7fc1ad59a700 1 -- 172.21.15.26:0/2226068885 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4011830 con 0x7fc1b009e000 2023-10-01T07:55:22.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.065+0000 7fc1ad59a700 1 -- 172.21.15.26:0/2226068885 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a4011990 con 0x7fc1b009e000 2023-10-01T07:55:22.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.065+0000 7fc1ad59a700 1 -- 172.21.15.26:0/2226068885 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4011d00 con 0x7fc1b009e000 2023-10-01T07:55:22.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.066+0000 7fc1b4ee6700 1 -- 172.21.15.26:0/2226068885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1b009e000 msgr2=0x7fc1b01339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:22.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.066+0000 7fc1b4ee6700 1 --2- 172.21.15.26:0/2226068885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1b009e000 0x7fc1b01339f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009840 tx=0x7fc1a4009b50 comp rx=0 tx=0).stop 2023-10-01T07:55:22.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.066+0000 7fc1b4ee6700 1 -- 172.21.15.26:0/2226068885 shutdown_connections 2023-10-01T07:55:22.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.066+0000 7fc1b4ee6700 1 --2- 172.21.15.26:0/2226068885 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc1b009d6f0 0x7fc1b009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:22.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.066+0000 7fc1b4ee6700 1 --2- 172.21.15.26:0/2226068885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1b009e000 0x7fc1b01339f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:22.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.066+0000 7fc1b4ee6700 1 -- 172.21.15.26:0/2226068885 >> 172.21.15.26:0/2226068885 conn(0x7fc1b0066f50 msgr2=0x7fc1b009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:22.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.066+0000 7fc1b4ee6700 1 -- 172.21.15.26:0/2226068885 shutdown_connections 2023-10-01T07:55:22.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.066+0000 7fc1b4ee6700 1 -- 172.21.15.26:0/2226068885 wait complete. 2023-10-01T07:55:22.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.067+0000 7fc1b4ee6700 1 Processor -- start 2023-10-01T07:55:22.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.067+0000 7fc1b4ee6700 1 -- start start 2023-10-01T07:55:22.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.068+0000 7fc1b4ee6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1b009d6f0 0x7fc1b01cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:22.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.068+0000 7fc1b4ee6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1b009e000 0x7fc1b01cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:22.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.068+0000 7fc1b4ee6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc1b009e410 0x7fc1b01cce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:22.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.068+0000 7fc1b4ee6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b01af970 con 0x7fc1b009d6f0 2023-10-01T07:55:22.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.068+0000 7fc1b4ee6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b01adc60 con 0x7fc1b009e000 2023-10-01T07:55:22.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.068+0000 7fc1b4ee6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b00a2d20 con 0x7fc1b009e410 2023-10-01T07:55:22.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.068+0000 7fc1add9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1b009e000 0x7fc1b01cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:22.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.068+0000 7fc1add9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1b009e000 0x7fc1b01cc8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37788/0 (socket says 172.21.15.26:37788) 2023-10-01T07:55:22.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.068+0000 7fc1add9b700 1 -- 172.21.15.26:0/1218810196 learned_addr learned my addr 172.21.15.26:0/1218810196 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:22.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.068+0000 7fc1aed9d700 1 --2- 172.21.15.26:0/1218810196 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc1b009e410 0x7fc1b01cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:22.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.068+0000 7fc1ae59c700 1 --2- 172.21.15.26:0/1218810196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1b009d6f0 0x7fc1b01cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:22.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.068+0000 7fc1add9b700 1 -- 172.21.15.26:0/1218810196 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc1b009e410 msgr2=0x7fc1b01cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:22.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.068+0000 7fc1add9b700 1 --2- 172.21.15.26:0/1218810196 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc1b009e410 0x7fc1b01cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:22.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.068+0000 7fc1add9b700 1 -- 172.21.15.26:0/1218810196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1b009d6f0 msgr2=0x7fc1b01cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:22.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.068+0000 7fc1add9b700 1 --2- 172.21.15.26:0/1218810196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1b009d6f0 0x7fc1b01cc3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:22.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.068+0000 7fc1add9b700 1 -- 172.21.15.26:0/1218810196 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a40094a0 con 0x7fc1b009e000 2023-10-01T07:55:22.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.069+0000 7fc1add9b700 1 --2- 172.21.15.26:0/1218810196 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1b009e000 0x7fc1b01cc8f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc1b009ac00 tx=0x7fc1a4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:22.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.069+0000 7fc19effd700 1 -- 172.21.15.26:0/1218810196 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a40036a0 con 0x7fc1b009e000 2023-10-01T07:55:22.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.069+0000 7fc19effd700 1 -- 172.21.15.26:0/1218810196 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a401f070 con 0x7fc1b009e000 2023-10-01T07:55:22.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.069+0000 7fc1b4ee6700 1 -- 172.21.15.26:0/1218810196 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b009c710 con 0x7fc1b009e000 2023-10-01T07:55:22.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.069+0000 7fc19effd700 1 -- 172.21.15.26:0/1218810196 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4003a40 con 0x7fc1b009e000 2023-10-01T07:55:22.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.069+0000 7fc1b4ee6700 1 -- 172.21.15.26:0/1218810196 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b01b0300 con 0x7fc1b009e000 2023-10-01T07:55:22.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.070+0000 7fc19effd700 1 -- 172.21.15.26:0/1218810196 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc1a4003ba0 con 0x7fc1b009e000 2023-10-01T07:55:22.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.070+0000 7fc19effd700 1 -- 172.21.15.26:0/1218810196 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc1a4021070 con 0x7fc1b009e000 2023-10-01T07:55:22.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.071+0000 7fc1b4ee6700 1 -- 172.21.15.26:0/1218810196 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b0074ea0 con 0x7fc1b009e000 2023-10-01T07:55:22.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.076+0000 7fc19effd700 1 -- 172.21.15.26:0/1218810196 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc1a4015020 con 0x7fc1b009e000 2023-10-01T07:55:22.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.211+0000 7f149500a700 1 -- 172.21.15.26:0/2643860431 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f14901a9cb0 con 0x7f149009d6f0 2023-10-01T07:55:22.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.211+0000 7f14777fe700 1 -- 172.21.15.26:0/2643860431 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f14901a9cb0 con 0x7f149009d6f0 2023-10-01T07:55:22.212 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:22.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.214+0000 7f149500a700 1 -- 172.21.15.26:0/2643860431 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f149009d6f0 msgr2=0x7f14901c50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:22.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.214+0000 7f149500a700 1 --2- 172.21.15.26:0/2643860431 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f149009d6f0 0x7f14901c50b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f148000e900 tx=0x7f148000ec10 comp rx=0 tx=0).stop 2023-10-01T07:55:22.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.214+0000 7f149500a700 1 -- 172.21.15.26:0/2643860431 shutdown_connections 2023-10-01T07:55:22.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.214+0000 7f149500a700 1 --2- 172.21.15.26:0/2643860431 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f149009e410 0x7f14901c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:22.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.214+0000 7f149500a700 1 --2- 172.21.15.26:0/2643860431 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f149009d6f0 0x7f14901c50b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:22.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.214+0000 7f149500a700 1 --2- 172.21.15.26:0/2643860431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f149009e000 0x7f14901c55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:22.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.214+0000 7f149500a700 1 -- 172.21.15.26:0/2643860431 >> 172.21.15.26:0/2643860431 conn(0x7f1490066f50 msgr2=0x7f14900708d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:22.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.214+0000 7f149500a700 1 -- 172.21.15.26:0/2643860431 shutdown_connections 2023-10-01T07:55:22.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.214+0000 7f149500a700 1 -- 172.21.15.26:0/2643860431 wait complete. 2023-10-01T07:55:22.229 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:22.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.239+0000 7f29c9a3d700 1 -- 172.21.15.26:0/449708724 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f29c4070610 con 0x7f29c4123c20 2023-10-01T07:55:22.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.240+0000 7f29abfff700 1 -- 172.21.15.26:0/449708724 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f29bc023360 con 0x7f29c4123c20 2023-10-01T07:55:22.240 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:22.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.242+0000 7f29c9a3d700 1 -- 172.21.15.26:0/449708724 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29c4123c20 msgr2=0x7f29c41d2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:22.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.242+0000 7f29c9a3d700 1 --2- 172.21.15.26:0/449708724 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29c4123c20 0x7f29c41d2a30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f29bc004270 tx=0x7f29bc004ad0 comp rx=0 tx=0).stop 2023-10-01T07:55:22.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.242+0000 7f29c9a3d700 1 -- 172.21.15.26:0/449708724 shutdown_connections 2023-10-01T07:55:22.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.242+0000 7f29c9a3d700 1 --2- 172.21.15.26:0/449708724 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29c4123c20 0x7f29c41d2a30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:22.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.242+0000 7f29c9a3d700 1 --2- 172.21.15.26:0/449708724 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29c406e570 0x7f29c41231a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:22.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.242+0000 7f29c9a3d700 1 --2- 172.21.15.26:0/449708724 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29c406ee80 0x7f29c41236e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:22.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.242+0000 7f29c9a3d700 1 -- 172.21.15.26:0/449708724 >> 172.21.15.26:0/449708724 conn(0x7f29c40a2aa0 msgr2=0x7f29c40a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:22.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.242+0000 7f29c9a3d700 1 -- 172.21.15.26:0/449708724 shutdown_connections 2023-10-01T07:55:22.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.242+0000 7f29c9a3d700 1 -- 172.21.15.26:0/449708724 wait complete. 2023-10-01T07:55:22.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.246+0000 7f83695a7700 1 -- 172.21.15.26:0/3161055424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8364071100 con 0x7f836406e570 2023-10-01T07:55:22.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.246+0000 7f834b7fe700 1 -- 172.21.15.26:0/3161055424 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8354015030 con 0x7f836406e570 2023-10-01T07:55:22.247 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:22.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.249+0000 7f83695a7700 1 -- 172.21.15.26:0/3161055424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f836406e570 msgr2=0x7f836413b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:22.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.249+0000 7f83695a7700 1 --2- 172.21.15.26:0/3161055424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f836406e570 0x7f836413b720 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f835400b530 tx=0x7f835400b840 comp rx=0 tx=0).stop 2023-10-01T07:55:22.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.249+0000 7f83695a7700 1 -- 172.21.15.26:0/3161055424 shutdown_connections 2023-10-01T07:55:22.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.249+0000 7f83695a7700 1 --2- 172.21.15.26:0/3161055424 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8364133c40 0x7f8364132d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:22.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.249+0000 7f83695a7700 1 --2- 172.21.15.26:0/3161055424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f836406e570 0x7f836413b720 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:22.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.249+0000 7f83695a7700 1 --2- 172.21.15.26:0/3161055424 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8364134610 0x7f8364132800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:22.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.249+0000 7f83695a7700 1 -- 172.21.15.26:0/3161055424 >> 172.21.15.26:0/3161055424 conn(0x7f83640a2aa0 msgr2=0x7f83640a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:22.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.249+0000 7f83695a7700 1 -- 172.21.15.26:0/3161055424 shutdown_connections 2023-10-01T07:55:22.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.249+0000 7f83695a7700 1 -- 172.21.15.26:0/3161055424 wait complete. 2023-10-01T07:55:22.258 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:22.264 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:22.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.284+0000 7fc1b4ee6700 1 -- 172.21.15.26:0/1218810196 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc1b01af7d0 con 0x7fc1b009e000 2023-10-01T07:55:22.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.284+0000 7fc19effd700 1 -- 172.21.15.26:0/1218810196 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc1b01af7d0 con 0x7fc1b009e000 2023-10-01T07:55:22.285 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:22.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.287+0000 7fc1b4ee6700 1 -- 172.21.15.26:0/1218810196 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1b009e000 msgr2=0x7fc1b01cc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:22.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.287+0000 7fc1b4ee6700 1 --2- 172.21.15.26:0/1218810196 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1b009e000 0x7fc1b01cc8f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc1b009ac00 tx=0x7fc1a4004750 comp rx=0 tx=0).stop 2023-10-01T07:55:22.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.287+0000 7fc1b4ee6700 1 -- 172.21.15.26:0/1218810196 shutdown_connections 2023-10-01T07:55:22.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.287+0000 7fc1b4ee6700 1 --2- 172.21.15.26:0/1218810196 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc1b009e410 0x7fc1b01cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:22.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.287+0000 7fc1b4ee6700 1 --2- 172.21.15.26:0/1218810196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1b009d6f0 0x7fc1b01cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:22.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.287+0000 7fc1b4ee6700 1 --2- 172.21.15.26:0/1218810196 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1b009e000 0x7fc1b01cc8f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:22.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.287+0000 7fc1b4ee6700 1 -- 172.21.15.26:0/1218810196 >> 172.21.15.26:0/1218810196 conn(0x7fc1b0066f50 msgr2=0x7fc1b00710c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:22.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.287+0000 7fc1b4ee6700 1 -- 172.21.15.26:0/1218810196 shutdown_connections 2023-10-01T07:55:22.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:22.287+0000 7fc1b4ee6700 1 -- 172.21.15.26:0/1218810196 wait complete. 2023-10-01T07:55:22.301 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:23.230 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:23.258 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:23.264 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:23.302 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:23.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.392+0000 7fa8440e9700 1 Processor -- start 2023-10-01T07:55:23.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.392+0000 7fa8440e9700 1 -- start start 2023-10-01T07:55:23.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.393+0000 7fa8440e9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa83c09f410 0x7fa83c136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:23.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.393+0000 7fa8440e9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa83c136fe0 0x7fa83c1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:23.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.393+0000 7fa8440e9700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa83c070940 con 0x7fa83c09e930 2023-10-01T07:55:23.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.393+0000 7fa8440e9700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa83c06fd60 con 0x7fa83c136fe0 2023-10-01T07:55:23.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.393+0000 7fa8440e9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c06fa80 con 0x7fa83c09f410 2023-10-01T07:55:23.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.393+0000 7fa841684700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa83c09f410 0x7fa83c136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:23.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.393+0000 7fa841684700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa83c09f410 0x7fa83c136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37790/0 (socket says 172.21.15.26:37790) 2023-10-01T07:55:23.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.393+0000 7fa841684700 1 -- 172.21.15.26:0/2328047857 learned_addr learned my addr 172.21.15.26:0/2328047857 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:23.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.393+0000 7fa842686700 1 --2- 172.21.15.26:0/2328047857 >> v2:172.21.15.26:3300/0 conn(0x7fa83c136fe0 0x7fa83c1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:23.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.394+0000 7fa842686700 1 -- 172.21.15.26:0/2328047857 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa83c09f410 msgr2=0x7fa83c136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:23.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.394+0000 7fa842686700 1 --2- 172.21.15.26:0/2328047857 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa83c09f410 0x7fa83c136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.394+0000 7fa842686700 1 -- 172.21.15.26:0/2328047857 >> v1:172.21.15.26:6789/0 conn(0x7fa83c09e930 legacy=0x7fa83c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:23.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.394+0000 7fa842686700 1 -- 172.21.15.26:0/2328047857 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83c09fb60 con 0x7fa83c136fe0 2023-10-01T07:55:23.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.394+0000 7fa842686700 1 --2- 172.21.15.26:0/2328047857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa83c136fe0 0x7fa83c1393c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa834009d90 tx=0x7fa83400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27d82f44a4ae6378 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:23.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.394+0000 7fa840e83700 1 -- 172.21.15.26:0/2328047857 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83400e070 con 0x7fa83c136fe0 2023-10-01T07:55:23.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.394+0000 7fa840e83700 1 -- 172.21.15.26:0/2328047857 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83400bb20 con 0x7fa83c136fe0 2023-10-01T07:55:23.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.394+0000 7fa840e83700 1 -- 172.21.15.26:0/2328047857 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa834012430 con 0x7fa83c136fe0 2023-10-01T07:55:23.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.395+0000 7fa8440e9700 1 -- 172.21.15.26:0/2328047857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa83c136fe0 msgr2=0x7fa83c1393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:23.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.395+0000 7fa8440e9700 1 --2- 172.21.15.26:0/2328047857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa83c136fe0 0x7fa83c1393c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa834009d90 tx=0x7fa83400b330 comp rx=0 tx=0).stop 2023-10-01T07:55:23.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.395+0000 7fa8440e9700 1 -- 172.21.15.26:0/2328047857 shutdown_connections 2023-10-01T07:55:23.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.395+0000 7fa8440e9700 1 --2- 172.21.15.26:0/2328047857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa83c136fe0 0x7fa83c1393c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.395+0000 7fa8440e9700 1 --2- 172.21.15.26:0/2328047857 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa83c09f410 0x7fa83c136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.395+0000 7fa8440e9700 1 -- 172.21.15.26:0/2328047857 >> 172.21.15.26:0/2328047857 conn(0x7fa83c0a4210 msgr2=0x7fa83c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:23.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.395+0000 7fa8440e9700 1 -- 172.21.15.26:0/2328047857 shutdown_connections 2023-10-01T07:55:23.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.395+0000 7fa8440e9700 1 -- 172.21.15.26:0/2328047857 wait complete. 2023-10-01T07:55:23.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.396+0000 7fa8440e9700 1 Processor -- start 2023-10-01T07:55:23.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.396+0000 7fa8440e9700 1 -- start start 2023-10-01T07:55:23.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.397+0000 7fa8440e9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa83c09e930 0x7fa83c11e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:23.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.397+0000 7fa8440e9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa83c09f410 0x7fa83c11eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:23.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.397+0000 7fa8440e9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa83c136fe0 0x7fa83c11f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:23.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.397+0000 7fa8440e9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c133ef0 con 0x7fa83c09f410 2023-10-01T07:55:23.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.397+0000 7fa8440e9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c1201d0 con 0x7fa83c136fe0 2023-10-01T07:55:23.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.397+0000 7fa8440e9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c1344b0 con 0x7fa83c09e930 2023-10-01T07:55:23.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.397+0000 7fa841684700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa83c09f410 0x7fa83c11eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:23.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.397+0000 7fa841684700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa83c09f410 0x7fa83c11eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37198/0 (socket says 172.21.15.26:37198) 2023-10-01T07:55:23.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.397+0000 7fa841684700 1 -- 172.21.15.26:0/2730904081 learned_addr learned my addr 172.21.15.26:0/2730904081 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:23.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.397+0000 7fa842686700 1 --2- 172.21.15.26:0/2730904081 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa83c136fe0 0x7fa83c11f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:23.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.398+0000 7fa841e85700 1 --2- 172.21.15.26:0/2730904081 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa83c09e930 0x7fa83c11e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:23.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.398+0000 7fa842686700 1 -- 172.21.15.26:0/2730904081 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa83c09e930 msgr2=0x7fa83c11e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:23.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.398+0000 7fa842686700 1 --2- 172.21.15.26:0/2730904081 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa83c09e930 0x7fa83c11e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.398+0000 7fa842686700 1 -- 172.21.15.26:0/2730904081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa83c09f410 msgr2=0x7fa83c11eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:23.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.398+0000 7fa842686700 1 --2- 172.21.15.26:0/2730904081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa83c09f410 0x7fa83c11eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.398+0000 7fa842686700 1 -- 172.21.15.26:0/2730904081 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa834009a70 con 0x7fa83c136fe0 2023-10-01T07:55:23.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.398+0000 7fa841e85700 1 --2- 172.21.15.26:0/2730904081 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa83c09e930 0x7fa83c11e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:55:23.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.398+0000 7fa842686700 1 --2- 172.21.15.26:0/2730904081 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa83c136fe0 0x7fa83c11f040 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa834016000 tx=0x7fa834004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:23.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.398+0000 7fa8327fc700 1 -- 172.21.15.26:0/2730904081 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa834012430 con 0x7fa83c136fe0 2023-10-01T07:55:23.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.398+0000 7fa8327fc700 1 -- 172.21.15.26:0/2730904081 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa834020070 con 0x7fa83c136fe0 2023-10-01T07:55:23.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.398+0000 7fa8440e9700 1 -- 172.21.15.26:0/2730904081 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa83c071d20 con 0x7fa83c136fe0 2023-10-01T07:55:23.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.398+0000 7fa8327fc700 1 -- 172.21.15.26:0/2730904081 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa834004280 con 0x7fa83c136fe0 2023-10-01T07:55:23.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.398+0000 7fa8440e9700 1 -- 172.21.15.26:0/2730904081 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa83c121870 con 0x7fa83c136fe0 2023-10-01T07:55:23.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.399+0000 7fa8327fc700 1 -- 172.21.15.26:0/2730904081 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa8340043e0 con 0x7fa83c136fe0 2023-10-01T07:55:23.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.400+0000 7fa8440e9700 1 -- 172.21.15.26:0/2730904081 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa83c0a2f40 con 0x7fa83c136fe0 2023-10-01T07:55:23.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.400+0000 7fa8327fc700 1 -- 172.21.15.26:0/2730904081 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa834022070 con 0x7fa83c136fe0 2023-10-01T07:55:23.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.405+0000 7fa8327fc700 1 -- 172.21.15.26:0/2730904081 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa83401a380 con 0x7fa83c136fe0 2023-10-01T07:55:23.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.424+0000 7fbaec1cf700 1 Processor -- start 2023-10-01T07:55:23.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.424+0000 7f1ca7121700 1 Processor -- start 2023-10-01T07:55:23.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.424+0000 7fbaec1cf700 1 -- start start 2023-10-01T07:55:23.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.424+0000 7f1ca7121700 1 -- start start 2023-10-01T07:55:23.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.424+0000 7fbaec1cf700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbae412cf60 0x7fbae406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:23.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.424+0000 7fbaec1cf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbae412f8b0 0x7fbae412fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:23.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.424+0000 7fbaec1cf700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbae412cd90 con 0x7fbae4130260 2023-10-01T07:55:23.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.424+0000 7fbaec1cf700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbae412d330 con 0x7fbae412cf60 2023-10-01T07:55:23.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.424+0000 7fbaec1cf700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae41306d0 con 0x7fbae412f8b0 2023-10-01T07:55:23.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.425+0000 7f1ca7121700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ca0131810 0x7f1ca0131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:23.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.425+0000 7f1ca7121700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ca0099a40 0x7f1ca0099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:23.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.425+0000 7f1ca7121700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ca01313c0 con 0x7f1ca009a3b0 2023-10-01T07:55:23.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.425+0000 7f1ca7121700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca009b580 con 0x7f1ca0099a40 2023-10-01T07:55:23.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.425+0000 7f1ca7121700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca006e8c0 con 0x7f1ca0131810 2023-10-01T07:55:23.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.425+0000 7f1ca56be700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1ca009a3b0 0x7f1ca0138650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38474/0 (socket says 172.21.15.26:38474) 2023-10-01T07:55:23.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.425+0000 7f1ca56be700 1 -- 172.21.15.26:0/2175721976 learned_addr learned my addr 172.21.15.26:0/2175721976 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:23.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.425+0000 7fbae976a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbae412f8b0 0x7fbae412fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:23.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.425+0000 7fbae976a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbae412f8b0 0x7fbae412fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:53286/0 (socket says 172.21.15.26:53286) 2023-10-01T07:55:23.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.425+0000 7fbae976a700 1 -- 172.21.15.26:0/3868131830 learned_addr learned my addr 172.21.15.26:0/3868131830 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:23.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.425+0000 7fbae9f6b700 1 --2- 172.21.15.26:0/3868131830 >> v2:172.21.15.26:3300/0 conn(0x7fbae412cf60 0x7fbae406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:23.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.425+0000 7fbae976a700 1 -- 172.21.15.26:0/3868131830 >> v2:172.21.15.26:3300/0 conn(0x7fbae412cf60 msgr2=0x7fbae406f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:23.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.425+0000 7fbae976a700 1 --2- 172.21.15.26:0/3868131830 >> v2:172.21.15.26:3300/0 conn(0x7fbae412cf60 0x7fbae406f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.425+0000 7fbae976a700 1 -- 172.21.15.26:0/3868131830 >> v1:172.21.15.26:6789/0 conn(0x7fbae4130260 legacy=0x7fbae4136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:23.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.425+0000 7fbae976a700 1 -- 172.21.15.26:0/3868131830 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae4071780 con 0x7fbae412f8b0 2023-10-01T07:55:23.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.425+0000 7f1c9f7fe700 1 -- 172.21.15.26:0/2175721976 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4026405251 0 0) 0x7f1ca01313c0 con 0x7f1ca009a3b0 2023-10-01T07:55:23.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.425+0000 7f1c9f7fe700 1 -- 172.21.15.26:0/2175721976 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c900035b0 con 0x7f1ca009a3b0 2023-10-01T07:55:23.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.425+0000 7fbae976a700 1 --2- 172.21.15.26:0/3868131830 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbae412f8b0 0x7fbae412fd20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbad40098f0 tx=0x7fbad4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbf6a341aad91723 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:23.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.426+0000 7f1c9ffff700 1 --2- 172.21.15.26:0/2175721976 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ca0099a40 0x7f1ca0099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:23.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.426+0000 7fbae8f69700 1 -- 172.21.15.26:0/3868131830 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad4004230 con 0x7fbae412f8b0 2023-10-01T07:55:23.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.426+0000 7fbae8f69700 1 -- 172.21.15.26:0/3868131830 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad4004390 con 0x7fbae412f8b0 2023-10-01T07:55:23.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.426+0000 7fbae8f69700 1 -- 172.21.15.26:0/3868131830 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad40036a0 con 0x7fbae412f8b0 2023-10-01T07:55:23.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.426+0000 7f1c9f7fe700 1 -- 172.21.15.26:0/2175721976 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2777593868 0 0) 0x7f1c900035b0 con 0x7f1ca009a3b0 2023-10-01T07:55:23.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.426+0000 7f1c9f7fe700 1 -- 172.21.15.26:0/2175721976 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ca0131810 msgr2=0x7f1ca0131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:23.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.426+0000 7f1c9f7fe700 1 --2- 172.21.15.26:0/2175721976 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ca0131810 0x7f1ca0131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.426+0000 7f1c9f7fe700 1 -- 172.21.15.26:0/2175721976 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ca0099a40 msgr2=0x7f1ca0099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:23.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.426+0000 7f1c9f7fe700 1 --2- 172.21.15.26:0/2175721976 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ca0099a40 0x7f1ca0099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.426+0000 7f1c9f7fe700 1 -- 172.21.15.26:0/2175721976 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca009a820 con 0x7f1ca009a3b0 2023-10-01T07:55:23.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.426+0000 7f1c9f7fe700 1 -- 172.21.15.26:0/2175721976 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1576910959 0 0) 0x7f1c980019f0 con 0x7f1ca009a3b0 2023-10-01T07:55:23.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.426+0000 7f1c9f7fe700 1 -- 172.21.15.26:0/2175721976 >> v1:172.21.15.26:6789/0 conn(0x7f1ca009a3b0 legacy=0x7f1ca0138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:23.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.426+0000 7f1c9f7fe700 1 --2- 172.21.15.26:0/2175721976 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c90003a00 0x7f1c90003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:23.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.426+0000 7f1c9f7fe700 1 --2- 172.21.15.26:0/2175721976 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ca0099a40 0x7f1c90004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:23.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.426+0000 7f1c9f7fe700 1 --2- 172.21.15.26:0/2175721976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c90004d90 0x7f1c90005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:23.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.426+0000 7f1c9f7fe700 1 -- 172.21.15.26:0/2175721976 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca009b580 con 0x7f1c90004d90 2023-10-01T07:55:23.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.426+0000 7f1c9f7fe700 1 -- 172.21.15.26:0/2175721976 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca006e8c0 con 0x7f1ca0099a40 2023-10-01T07:55:23.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.426+0000 7f1c9f7fe700 1 -- 172.21.15.26:0/2175721976 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9000bb70 con 0x7f1c90003a00 2023-10-01T07:55:23.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.426+0000 7f1ca56be700 1 --2- 172.21.15.26:0/2175721976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c90004d90 0x7f1c90005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:23.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.426+0000 7f1ca4ebd700 1 --2- 172.21.15.26:0/2175721976 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c90003a00 0x7f1c90003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:23.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.426+0000 7f1c9ffff700 1 --2- 172.21.15.26:0/2175721976 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ca0099a40 0x7f1c90004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:23.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.427+0000 7f1ca56be700 1 -- 172.21.15.26:0/2175721976 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c90003a00 msgr2=0x7f1c90003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:23.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.427+0000 7f1ca56be700 1 --2- 172.21.15.26:0/2175721976 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c90003a00 0x7f1c90003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.427+0000 7f1ca56be700 1 -- 172.21.15.26:0/2175721976 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ca0099a40 msgr2=0x7f1c90004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:23.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.427+0000 7f1ca56be700 1 --2- 172.21.15.26:0/2175721976 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ca0099a40 0x7f1c90004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.427+0000 7f1ca56be700 1 -- 172.21.15.26:0/2175721976 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca009a820 con 0x7f1c90004d90 2023-10-01T07:55:23.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.427+0000 7fbaec1cf700 1 -- 172.21.15.26:0/3868131830 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbae412f8b0 msgr2=0x7fbae412fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:23.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.427+0000 7fbaec1cf700 1 --2- 172.21.15.26:0/3868131830 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbae412f8b0 0x7fbae412fd20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbad40098f0 tx=0x7fbad4009c00 comp rx=0 tx=0).stop 2023-10-01T07:55:23.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.427+0000 7fbaec1cf700 1 -- 172.21.15.26:0/3868131830 shutdown_connections 2023-10-01T07:55:23.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.427+0000 7fbaec1cf700 1 --2- 172.21.15.26:0/3868131830 >> v2:172.21.15.26:3300/0 conn(0x7fbae412cf60 0x7fbae406f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.427+0000 7fbaec1cf700 1 --2- 172.21.15.26:0/3868131830 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbae412f8b0 0x7fbae412fd20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.427+0000 7fbaec1cf700 1 -- 172.21.15.26:0/3868131830 >> 172.21.15.26:0/3868131830 conn(0x7fbae40a2aa0 msgr2=0x7fbae40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:23.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.427+0000 7f1ca56be700 1 --2- 172.21.15.26:0/2175721976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c90004d90 0x7f1c90005200 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1c9800a8a0 tx=0x7f1c90005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b85fd11453ce282 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:23.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.427+0000 7f1c9f7fe700 1 -- 172.21.15.26:0/2175721976 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c98012600 con 0x7f1c90004d90 2023-10-01T07:55:23.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.427+0000 7fbaec1cf700 1 -- 172.21.15.26:0/3868131830 shutdown_connections 2023-10-01T07:55:23.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.427+0000 7f1c9f7fe700 1 -- 172.21.15.26:0/2175721976 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c98012760 con 0x7f1c90004d90 2023-10-01T07:55:23.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.427+0000 7f1c9f7fe700 1 -- 172.21.15.26:0/2175721976 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c98012af0 con 0x7f1c90004d90 2023-10-01T07:55:23.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.427+0000 7fbaec1cf700 1 -- 172.21.15.26:0/3868131830 wait complete. 2023-10-01T07:55:23.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.428+0000 7fbaec1cf700 1 Processor -- start 2023-10-01T07:55:23.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.428+0000 7f1ca7121700 1 -- 172.21.15.26:0/2175721976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c90004d90 msgr2=0x7f1c90005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:23.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.428+0000 7f1ca7121700 1 --2- 172.21.15.26:0/2175721976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c90004d90 0x7f1c90005200 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1c9800a8a0 tx=0x7f1c90005880 comp rx=0 tx=0).stop 2023-10-01T07:55:23.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.428+0000 7f1ca7121700 1 -- 172.21.15.26:0/2175721976 shutdown_connections 2023-10-01T07:55:23.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.428+0000 7f1ca7121700 1 --2- 172.21.15.26:0/2175721976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c90004d90 0x7f1c90005200 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.428+0000 7f1ca7121700 1 --2- 172.21.15.26:0/2175721976 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c90003a00 0x7f1c90003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.428+0000 7f1ca7121700 1 --2- 172.21.15.26:0/2175721976 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ca0099a40 0x7f1c90004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.428+0000 7f1ca7121700 1 -- 172.21.15.26:0/2175721976 >> 172.21.15.26:0/2175721976 conn(0x7f1ca00a2aa0 msgr2=0x7f1ca00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:23.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.428+0000 7f1ca7121700 1 -- 172.21.15.26:0/2175721976 shutdown_connections 2023-10-01T07:55:23.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.428+0000 7f1ca7121700 1 -- 172.21.15.26:0/2175721976 wait complete. 2023-10-01T07:55:23.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.429+0000 7f1ca7121700 1 Processor -- start 2023-10-01T07:55:23.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.429+0000 7f1ca7121700 1 -- start start 2023-10-01T07:55:23.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.429+0000 7fbaec1cf700 1 -- start start 2023-10-01T07:55:23.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.430+0000 7f1ca7121700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c90003a00 0x7f1ca008a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:23.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.430+0000 7f1ca7121700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c90004d90 0x7f1ca0129f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:23.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.430+0000 7f1ca7121700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ca0099a40 0x7f1ca012a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:23.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.430+0000 7f1ca7121700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca012c3c0 con 0x7f1ca0099a40 2023-10-01T07:55:23.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.430+0000 7f1ca7121700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca012e740 con 0x7f1c90004d90 2023-10-01T07:55:23.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.430+0000 7f1ca7121700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca012d440 con 0x7f1c90003a00 2023-10-01T07:55:23.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.430+0000 7f1ca56be700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ca0099a40 0x7f1ca012a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:23.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.430+0000 7f1ca4ebd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c90003a00 0x7f1ca008a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:23.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.430+0000 7f1ca4ebd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c90003a00 0x7f1ca008a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59292/0 (socket says 172.21.15.26:59292) 2023-10-01T07:55:23.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.430+0000 7f1ca56be700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ca0099a40 0x7f1ca012a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40736/0 (socket says 172.21.15.26:40736) 2023-10-01T07:55:23.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.430+0000 7f1ca4ebd700 1 -- 172.21.15.26:0/2943417982 learned_addr learned my addr 172.21.15.26:0/2943417982 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:23.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.430+0000 7f1c9ffff700 1 --2- 172.21.15.26:0/2943417982 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c90004d90 0x7f1ca0129f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:23.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.430+0000 7f1ca56be700 1 -- 172.21.15.26:0/2943417982 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c90003a00 msgr2=0x7f1ca008a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:23.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.430+0000 7f1ca56be700 1 --2- 172.21.15.26:0/2943417982 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c90003a00 0x7f1ca008a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.430+0000 7f1ca56be700 1 -- 172.21.15.26:0/2943417982 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c90004d90 msgr2=0x7f1ca0129f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:23.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.430+0000 7f1ca56be700 1 --2- 172.21.15.26:0/2943417982 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c90004d90 0x7f1ca0129f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.430+0000 7f1ca56be700 1 -- 172.21.15.26:0/2943417982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca013a9c0 con 0x7f1ca0099a40 2023-10-01T07:55:23.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.430+0000 7fbaec1cf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbae412cf60 0x7fbae41309e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:23.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.430+0000 7fbaec1cf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbae412f8b0 0x7fbae4130f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:23.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.430+0000 7fbaec1cf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbae4130260 0x7fbae4131460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:23.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.430+0000 7fbaec1cf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae4133090 con 0x7fbae412cf60 2023-10-01T07:55:23.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.430+0000 7fbaec1cf700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae412f4d0 con 0x7fbae4130260 2023-10-01T07:55:23.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.430+0000 7fbaec1cf700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbae4132dd0 con 0x7fbae412f8b0 2023-10-01T07:55:23.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.430+0000 7fbae9f6b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbae412cf60 0x7fbae41309e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:23.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.431+0000 7fbae976a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbae412f8b0 0x7fbae4130f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:23.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.431+0000 7fbae9f6b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbae412cf60 0x7fbae41309e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40742/0 (socket says 172.21.15.26:40742) 2023-10-01T07:55:23.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.431+0000 7fbae9f6b700 1 -- 172.21.15.26:0/3029618912 learned_addr learned my addr 172.21.15.26:0/3029618912 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:23.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.431+0000 7fbaea76c700 1 --2- 172.21.15.26:0/3029618912 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbae4130260 0x7fbae4131460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:23.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.431+0000 7f1ca56be700 1 --2- 172.21.15.26:0/2943417982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ca0099a40 0x7f1ca012a480 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1c980013d0 tx=0x7f1c98001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:23.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.431+0000 7fbae976a700 1 -- 172.21.15.26:0/3029618912 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbae4130260 msgr2=0x7fbae4131460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:23.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.431+0000 7fbae976a700 1 --2- 172.21.15.26:0/3029618912 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbae4130260 0x7fbae4131460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.431+0000 7fbae976a700 1 -- 172.21.15.26:0/3029618912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbae412cf60 msgr2=0x7fbae41309e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:23.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.431+0000 7fbae976a700 1 --2- 172.21.15.26:0/3029618912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbae412cf60 0x7fbae41309e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.431+0000 7fbae976a700 1 -- 172.21.15.26:0/3029618912 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad4009550 con 0x7fbae412f8b0 2023-10-01T07:55:23.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.431+0000 7fbaea76c700 1 --2- 172.21.15.26:0/3029618912 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbae4130260 0x7fbae4131460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:55:23.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.431+0000 7fbae976a700 1 --2- 172.21.15.26:0/3029618912 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbae412f8b0 0x7fbae4130f20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbad4015000 tx=0x7fbad4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:23.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.431+0000 7f1c9d7fa700 1 -- 172.21.15.26:0/2943417982 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9802e630 con 0x7f1ca0099a40 2023-10-01T07:55:23.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.431+0000 7f1c9d7fa700 1 -- 172.21.15.26:0/2943417982 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9802e7d0 con 0x7f1ca0099a40 2023-10-01T07:55:23.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.431+0000 7f1c9d7fa700 1 -- 172.21.15.26:0/2943417982 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9802eb80 con 0x7f1ca0099a40 2023-10-01T07:55:23.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.431+0000 7f1ca7121700 1 -- 172.21.15.26:0/2943417982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca012e900 con 0x7f1ca0099a40 2023-10-01T07:55:23.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.431+0000 7fbada7fc700 1 -- 172.21.15.26:0/3029618912 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad4003c50 con 0x7fbae412f8b0 2023-10-01T07:55:23.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.431+0000 7fbada7fc700 1 -- 172.21.15.26:0/3029618912 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad401f070 con 0x7fbae412f8b0 2023-10-01T07:55:23.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.431+0000 7fbada7fc700 1 -- 172.21.15.26:0/3029618912 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad4011630 con 0x7fbae412f8b0 2023-10-01T07:55:23.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.431+0000 7f1ca7121700 1 -- 172.21.15.26:0/2943417982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca012e170 con 0x7f1ca0099a40 2023-10-01T07:55:23.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.431+0000 7fbaec1cf700 1 -- 172.21.15.26:0/3029618912 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae413c470 con 0x7fbae412f8b0 2023-10-01T07:55:23.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.432+0000 7fbaec1cf700 1 -- 172.21.15.26:0/3029618912 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae409ea90 con 0x7fbae412f8b0 2023-10-01T07:55:23.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.433+0000 7fbaec1cf700 1 -- 172.21.15.26:0/3029618912 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbae41332d0 con 0x7fbae412f8b0 2023-10-01T07:55:23.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.433+0000 7f1c9d7fa700 1 -- 172.21.15.26:0/2943417982 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1c9802ece0 con 0x7f1ca0099a40 2023-10-01T07:55:23.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.433+0000 7f1ca7121700 1 -- 172.21.15.26:0/2943417982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ca0074ea0 con 0x7f1ca0099a40 2023-10-01T07:55:23.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.433+0000 7f1c9d7fa700 1 -- 172.21.15.26:0/2943417982 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1c980522c0 con 0x7f1ca0099a40 2023-10-01T07:55:23.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.433+0000 7fbada7fc700 1 -- 172.21.15.26:0/3029618912 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbad4021030 con 0x7fbae412f8b0 2023-10-01T07:55:23.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.434+0000 7fbada7fc700 1 -- 172.21.15.26:0/3029618912 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbad4040ca0 con 0x7fbae412f8b0 2023-10-01T07:55:23.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.442+0000 7f1c9d7fa700 1 -- 172.21.15.26:0/2943417982 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1c9803d080 con 0x7f1ca0099a40 2023-10-01T07:55:23.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.442+0000 7fbada7fc700 1 -- 172.21.15.26:0/3029618912 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbad4023790 con 0x7fbae412f8b0 2023-10-01T07:55:23.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.504+0000 7fbda804a700 1 Processor -- start 2023-10-01T07:55:23.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.504+0000 7fbda804a700 1 -- start start 2023-10-01T07:55:23.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.505+0000 7fbda804a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbda0133a80 0x7fbda0133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:23.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.505+0000 7fbda804a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbda012ff20 0x7fbda0130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:23.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.505+0000 7fbda804a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda006bc00 con 0x7fbda0130870 2023-10-01T07:55:23.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.505+0000 7fbda804a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda006c570 con 0x7fbda0133a80 2023-10-01T07:55:23.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.505+0000 7fbda804a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbda00a0040 con 0x7fbda012ff20 2023-10-01T07:55:23.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.505+0000 7fbda65e7700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbda0130870 0x7fbda013a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38490/0 (socket says 172.21.15.26:38490) 2023-10-01T07:55:23.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.505+0000 7fbda55e5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbda012ff20 0x7fbda0130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:23.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.505+0000 7fbda5de6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbda0133a80 0x7fbda0133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:23.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.505+0000 7fbda65e7700 1 -- 172.21.15.26:0/4074144512 learned_addr learned my addr 172.21.15.26:0/4074144512 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:23.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.506+0000 7fbda4de4700 1 -- 172.21.15.26:0/4074144512 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 77975939 0 0) 0x7fbda006bc00 con 0x7fbda0130870 2023-10-01T07:55:23.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.506+0000 7fbda4de4700 1 -- 172.21.15.26:0/4074144512 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd8c0035b0 con 0x7fbda0130870 2023-10-01T07:55:23.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.506+0000 7fbda55e5700 1 -- 172.21.15.26:0/4074144512 >> v2:172.21.15.26:3300/0 conn(0x7fbda0133a80 msgr2=0x7fbda0133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:23.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.506+0000 7fbda55e5700 1 --2- 172.21.15.26:0/4074144512 >> v2:172.21.15.26:3300/0 conn(0x7fbda0133a80 0x7fbda0133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.506+0000 7fbda55e5700 1 -- 172.21.15.26:0/4074144512 >> v1:172.21.15.26:6789/0 conn(0x7fbda0130870 legacy=0x7fbda013a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:23.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.506+0000 7fbda55e5700 1 -- 172.21.15.26:0/4074144512 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda0133860 con 0x7fbda012ff20 2023-10-01T07:55:23.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.506+0000 7fbda55e5700 1 --2- 172.21.15.26:0/4074144512 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbda012ff20 0x7fbda0130330 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbd90009840 tx=0x7fbd90009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cbefb6f29e032e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:23.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.506+0000 7fbda4de4700 1 -- 172.21.15.26:0/4074144512 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd90011830 con 0x7fbda012ff20 2023-10-01T07:55:23.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.506+0000 7fbda4de4700 1 -- 172.21.15.26:0/4074144512 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd90011990 con 0x7fbda012ff20 2023-10-01T07:55:23.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.506+0000 7fbda4de4700 1 -- 172.21.15.26:0/4074144512 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd90011d20 con 0x7fbda012ff20 2023-10-01T07:55:23.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.507+0000 7fbda804a700 1 -- 172.21.15.26:0/4074144512 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbda012ff20 msgr2=0x7fbda0130330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:23.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.507+0000 7fbda804a700 1 --2- 172.21.15.26:0/4074144512 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbda012ff20 0x7fbda0130330 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbd90009840 tx=0x7fbd90009b50 comp rx=0 tx=0).stop 2023-10-01T07:55:23.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.507+0000 7fbda804a700 1 -- 172.21.15.26:0/4074144512 shutdown_connections 2023-10-01T07:55:23.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.507+0000 7fbda804a700 1 --2- 172.21.15.26:0/4074144512 >> v2:172.21.15.26:3300/0 conn(0x7fbda0133a80 0x7fbda0133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.507+0000 7fbda804a700 1 --2- 172.21.15.26:0/4074144512 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbda012ff20 0x7fbda0130330 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.507+0000 7fbda804a700 1 -- 172.21.15.26:0/4074144512 >> 172.21.15.26:0/4074144512 conn(0x7fbda00a4210 msgr2=0x7fbda00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:23.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.507+0000 7fbda804a700 1 -- 172.21.15.26:0/4074144512 shutdown_connections 2023-10-01T07:55:23.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.507+0000 7fbda804a700 1 -- 172.21.15.26:0/4074144512 wait complete. 2023-10-01T07:55:23.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.509+0000 7fbda804a700 1 Processor -- start 2023-10-01T07:55:23.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.509+0000 7fbda804a700 1 -- start start 2023-10-01T07:55:23.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.509+0000 7fbda804a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbda012ff20 0x7fbda009c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:23.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.509+0000 7fbda804a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbda0130870 0x7fbda009c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:23.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.509+0000 7fbda804a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbda0133a80 0x7fbda009caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:23.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.509+0000 7fbda804a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda009de20 con 0x7fbda0130870 2023-10-01T07:55:23.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.509+0000 7fbda804a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda00a20e0 con 0x7fbda0133a80 2023-10-01T07:55:23.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.509+0000 7fbda804a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbda0120180 con 0x7fbda012ff20 2023-10-01T07:55:23.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.510+0000 7fbda5de6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbda012ff20 0x7fbda009c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:23.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.510+0000 7fbda5de6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbda012ff20 0x7fbda009c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59316/0 (socket says 172.21.15.26:59316) 2023-10-01T07:55:23.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.510+0000 7fbda5de6700 1 -- 172.21.15.26:0/1366798460 learned_addr learned my addr 172.21.15.26:0/1366798460 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:23.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.510+0000 7fbda55e5700 1 --2- 172.21.15.26:0/1366798460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbda0130870 0x7fbda009c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:23.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.510+0000 7fbda5de6700 1 -- 172.21.15.26:0/1366798460 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbda0133a80 msgr2=0x7fbda009caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:23.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.510+0000 7fbda5de6700 1 --2- 172.21.15.26:0/1366798460 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbda0133a80 0x7fbda009caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.510+0000 7fbda5de6700 1 -- 172.21.15.26:0/1366798460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbda0130870 msgr2=0x7fbda009c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:23.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.510+0000 7fbda5de6700 1 --2- 172.21.15.26:0/1366798460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbda0130870 0x7fbda009c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.510+0000 7fbda5de6700 1 -- 172.21.15.26:0/1366798460 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd900094a0 con 0x7fbda012ff20 2023-10-01T07:55:23.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.510+0000 7fbda5de6700 1 --2- 172.21.15.26:0/1366798460 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbda012ff20 0x7fbda009c020 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c00e9b0 tx=0x7fbd9c00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:23.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.510+0000 7fbd967fc700 1 -- 172.21.15.26:0/1366798460 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c009710 con 0x7fbda012ff20 2023-10-01T07:55:23.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.510+0000 7fbd967fc700 1 -- 172.21.15.26:0/1366798460 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9c00c850 con 0x7fbda012ff20 2023-10-01T07:55:23.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.510+0000 7fbda804a700 1 -- 172.21.15.26:0/1366798460 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda011fad0 con 0x7fbda012ff20 2023-10-01T07:55:23.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.510+0000 7fbd967fc700 1 -- 172.21.15.26:0/1366798460 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c00cbc0 con 0x7fbda012ff20 2023-10-01T07:55:23.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.511+0000 7fbda804a700 1 -- 172.21.15.26:0/1366798460 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda011fd90 con 0x7fbda012ff20 2023-10-01T07:55:23.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.512+0000 7fbda804a700 1 -- 172.21.15.26:0/1366798460 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbda0074ea0 con 0x7fbda012ff20 2023-10-01T07:55:23.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.512+0000 7fbd967fc700 1 -- 172.21.15.26:0/1366798460 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbd9c00cd20 con 0x7fbda012ff20 2023-10-01T07:55:23.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.512+0000 7fbd967fc700 1 -- 172.21.15.26:0/1366798460 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbd9c03f750 con 0x7fbda012ff20 2023-10-01T07:55:23.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.517+0000 7fbd967fc700 1 -- 172.21.15.26:0/1366798460 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbd9c0232f0 con 0x7fbda012ff20 2023-10-01T07:55:23.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.660+0000 7fa8440e9700 1 -- 172.21.15.26:0/2730904081 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa83c074ea0 con 0x7fa83c136fe0 2023-10-01T07:55:23.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.661+0000 7fa8327fc700 1 -- 172.21.15.26:0/2730904081 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa834025b70 con 0x7fa83c136fe0 2023-10-01T07:55:23.661 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:23.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.664+0000 7fa8440e9700 1 -- 172.21.15.26:0/2730904081 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa83c136fe0 msgr2=0x7fa83c11f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:23.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.664+0000 7fa8440e9700 1 --2- 172.21.15.26:0/2730904081 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa83c136fe0 0x7fa83c11f040 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa834016000 tx=0x7fa834004ad0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.664+0000 7fa8440e9700 1 -- 172.21.15.26:0/2730904081 shutdown_connections 2023-10-01T07:55:23.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.664+0000 7fa8440e9700 1 --2- 172.21.15.26:0/2730904081 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa83c136fe0 0x7fa83c11f040 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.664+0000 7fa8440e9700 1 --2- 172.21.15.26:0/2730904081 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa83c09e930 0x7fa83c11e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.664+0000 7fa8440e9700 1 --2- 172.21.15.26:0/2730904081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa83c09f410 0x7fa83c11eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.664+0000 7fa8440e9700 1 -- 172.21.15.26:0/2730904081 >> 172.21.15.26:0/2730904081 conn(0x7fa83c0a4210 msgr2=0x7fa83c0a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:23.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.664+0000 7fa8440e9700 1 -- 172.21.15.26:0/2730904081 shutdown_connections 2023-10-01T07:55:23.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.664+0000 7fa8440e9700 1 -- 172.21.15.26:0/2730904081 wait complete. 2023-10-01T07:55:23.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:23.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.725+0000 7fbda804a700 1 -- 172.21.15.26:0/1366798460 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbda0134360 con 0x7fbda012ff20 2023-10-01T07:55:23.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.726+0000 7fbd967fc700 1 -- 172.21.15.26:0/1366798460 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbd9c021070 con 0x7fbda012ff20 2023-10-01T07:55:23.726 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:23.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.726+0000 7fbaec1cf700 1 -- 172.21.15.26:0/3029618912 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbae41332d0 con 0x7fbae412f8b0 2023-10-01T07:55:23.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.726+0000 7fbada7fc700 1 -- 172.21.15.26:0/3029618912 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbad402c3e0 con 0x7fbae412f8b0 2023-10-01T07:55:23.727 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:23.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.729+0000 7fbaec1cf700 1 -- 172.21.15.26:0/3029618912 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbae412f8b0 msgr2=0x7fbae4130f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:23.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.729+0000 7fbaec1cf700 1 --2- 172.21.15.26:0/3029618912 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbae412f8b0 0x7fbae4130f20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbad4015000 tx=0x7fbad4004750 comp rx=0 tx=0).stop 2023-10-01T07:55:23.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.729+0000 7fbaec1cf700 1 -- 172.21.15.26:0/3029618912 shutdown_connections 2023-10-01T07:55:23.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.729+0000 7fbaec1cf700 1 --2- 172.21.15.26:0/3029618912 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbae4130260 0x7fbae4131460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.729+0000 7fbaec1cf700 1 --2- 172.21.15.26:0/3029618912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbae412cf60 0x7fbae41309e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.729+0000 7fbaec1cf700 1 --2- 172.21.15.26:0/3029618912 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbae412f8b0 0x7fbae4130f20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.729+0000 7fbaec1cf700 1 -- 172.21.15.26:0/3029618912 >> 172.21.15.26:0/3029618912 conn(0x7fbae40a2aa0 msgr2=0x7fbae406e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:23.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.729+0000 7fbaec1cf700 1 -- 172.21.15.26:0/3029618912 shutdown_connections 2023-10-01T07:55:23.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.729+0000 7fbda804a700 1 -- 172.21.15.26:0/1366798460 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbda012ff20 msgr2=0x7fbda009c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:23.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.729+0000 7fbaec1cf700 1 -- 172.21.15.26:0/3029618912 wait complete. 2023-10-01T07:55:23.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.729+0000 7fbda804a700 1 --2- 172.21.15.26:0/1366798460 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbda012ff20 0x7fbda009c020 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c00e9b0 tx=0x7fbd9c00ecc0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.729+0000 7fbda804a700 1 -- 172.21.15.26:0/1366798460 shutdown_connections 2023-10-01T07:55:23.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.729+0000 7fbda804a700 1 --2- 172.21.15.26:0/1366798460 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbda0133a80 0x7fbda009caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.729+0000 7fbda804a700 1 --2- 172.21.15.26:0/1366798460 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbda012ff20 0x7fbda009c020 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.729+0000 7fbda804a700 1 --2- 172.21.15.26:0/1366798460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbda0130870 0x7fbda009c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.729+0000 7fbda804a700 1 -- 172.21.15.26:0/1366798460 >> 172.21.15.26:0/1366798460 conn(0x7fbda00a4210 msgr2=0x7fbda012f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:23.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.729+0000 7fbda804a700 1 -- 172.21.15.26:0/1366798460 shutdown_connections 2023-10-01T07:55:23.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.729+0000 7fbda804a700 1 -- 172.21.15.26:0/1366798460 wait complete. 2023-10-01T07:55:23.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.737+0000 7f1ca7121700 1 -- 172.21.15.26:0/2943417982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1ca0071db0 con 0x7f1ca0099a40 2023-10-01T07:55:23.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.737+0000 7f1c9d7fa700 1 -- 172.21.15.26:0/2943417982 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1c98017070 con 0x7f1ca0099a40 2023-10-01T07:55:23.738 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:23.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.739+0000 7f1ca7121700 1 -- 172.21.15.26:0/2943417982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ca0099a40 msgr2=0x7f1ca012a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:23.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.739+0000 7f1ca7121700 1 --2- 172.21.15.26:0/2943417982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ca0099a40 0x7f1ca012a480 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1c980013d0 tx=0x7f1c98001360 comp rx=0 tx=0).stop 2023-10-01T07:55:23.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.739+0000 7f1ca7121700 1 -- 172.21.15.26:0/2943417982 shutdown_connections 2023-10-01T07:55:23.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.739+0000 7f1ca7121700 1 --2- 172.21.15.26:0/2943417982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ca0099a40 0x7f1ca012a480 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.739+0000 7f1ca7121700 1 --2- 172.21.15.26:0/2943417982 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c90003a00 0x7f1ca008a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.739+0000 7f1ca7121700 1 --2- 172.21.15.26:0/2943417982 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c90004d90 0x7f1ca0129f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:23.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.739+0000 7f1ca7121700 1 -- 172.21.15.26:0/2943417982 >> 172.21.15.26:0/2943417982 conn(0x7f1ca00a2aa0 msgr2=0x7f1ca00a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:23.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.740+0000 7f1ca7121700 1 -- 172.21.15.26:0/2943417982 shutdown_connections 2023-10-01T07:55:23.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:23.740+0000 7f1ca7121700 1 -- 172.21.15.26:0/2943417982 wait complete. 2023-10-01T07:55:23.746 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:23.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:23.755 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:24.684 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:24.746 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:24.747 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:24.755 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:24.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.839+0000 7fbd7dda2700 1 Processor -- start 2023-10-01T07:55:24.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.839+0000 7fbd7dda2700 1 -- start start 2023-10-01T07:55:24.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.840+0000 7fbd7dda2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd7809e2e0 0x7fbd78138aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:24.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.840+0000 7fbd7dda2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd78138fe0 0x7fbd7813b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:24.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.840+0000 7fbd7dda2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd78099e10 con 0x7fbd7809d800 2023-10-01T07:55:24.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.840+0000 7fbd7dda2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7809f560 con 0x7fbd7809e2e0 2023-10-01T07:55:24.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.840+0000 7fbd7dda2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7809e6b0 con 0x7fbd78138fe0 2023-10-01T07:55:24.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.840+0000 7fbd7d5a1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd78138fe0 0x7fbd7813b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:24.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.840+0000 7fbd7cda0700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbd7809d800 0x7fbd7809dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38496/0 (socket says 172.21.15.26:38496) 2023-10-01T07:55:24.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.840+0000 7fbd7cda0700 1 -- 172.21.15.26:0/92152224 learned_addr learned my addr 172.21.15.26:0/92152224 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:24.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.840+0000 7fbd7d5a1700 1 --2- 172.21.15.26:0/92152224 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd78138fe0 0x7fbd7813b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59326/0 (socket says 172.21.15.26:59326) 2023-10-01T07:55:24.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.840+0000 7fbd77fff700 1 --2- 172.21.15.26:0/92152224 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd7809e2e0 0x7fbd78138aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:24.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.841+0000 7fbd7d5a1700 1 -- 172.21.15.26:0/92152224 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd7809e2e0 msgr2=0x7fbd78138aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:24.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.841+0000 7fbd7d5a1700 1 --2- 172.21.15.26:0/92152224 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd7809e2e0 0x7fbd78138aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:24.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.841+0000 7fbd7d5a1700 1 -- 172.21.15.26:0/92152224 >> v1:172.21.15.26:6789/0 conn(0x7fbd7809d800 legacy=0x7fbd7809dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:24.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.841+0000 7fbd7d5a1700 1 -- 172.21.15.26:0/92152224 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd7806b4d0 con 0x7fbd78138fe0 2023-10-01T07:55:24.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.841+0000 7fbd7d5a1700 1 --2- 172.21.15.26:0/92152224 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd78138fe0 0x7fbd7813b3c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009dc0 tx=0x7fbd7000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86f1be6b365421e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:24.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.841+0000 7fbd777fe700 1 -- 172.21.15.26:0/92152224 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7000e070 con 0x7fbd78138fe0 2023-10-01T07:55:24.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.841+0000 7fbd777fe700 1 -- 172.21.15.26:0/92152224 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd7000bac0 con 0x7fbd78138fe0 2023-10-01T07:55:24.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.841+0000 7fbd777fe700 1 -- 172.21.15.26:0/92152224 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7000be70 con 0x7fbd78138fe0 2023-10-01T07:55:24.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.842+0000 7fbd7dda2700 1 -- 172.21.15.26:0/92152224 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd78138fe0 msgr2=0x7fbd7813b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:24.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.842+0000 7fbd7dda2700 1 --2- 172.21.15.26:0/92152224 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd78138fe0 0x7fbd7813b3c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009dc0 tx=0x7fbd7000b330 comp rx=0 tx=0).stop 2023-10-01T07:55:24.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.842+0000 7fbd7dda2700 1 -- 172.21.15.26:0/92152224 shutdown_connections 2023-10-01T07:55:24.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.842+0000 7fbd7dda2700 1 --2- 172.21.15.26:0/92152224 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd78138fe0 0x7fbd7813b3c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:24.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.842+0000 7fbd7dda2700 1 --2- 172.21.15.26:0/92152224 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd7809e2e0 0x7fbd78138aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:24.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.842+0000 7fbd7dda2700 1 -- 172.21.15.26:0/92152224 >> 172.21.15.26:0/92152224 conn(0x7fbd780a2e20 msgr2=0x7fbd780a3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:24.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.842+0000 7fbd7dda2700 1 -- 172.21.15.26:0/92152224 shutdown_connections 2023-10-01T07:55:24.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.842+0000 7fbd7dda2700 1 -- 172.21.15.26:0/92152224 wait complete. 2023-10-01T07:55:24.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.844+0000 7fbd7dda2700 1 Processor -- start 2023-10-01T07:55:24.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.844+0000 7fbd7dda2700 1 -- start start 2023-10-01T07:55:24.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.845+0000 7fbd7dda2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd7809d800 0x7fbd7811e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:24.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.845+0000 7fbd7dda2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd7809e2e0 0x7fbd7811ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:24.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.845+0000 7fbd7dda2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd78138fe0 0x7fbd7811f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:24.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.845+0000 7fbd7dda2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd78121a50 con 0x7fbd7809d800 2023-10-01T07:55:24.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.845+0000 7fbd7dda2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd781345b0 con 0x7fbd7809e2e0 2023-10-01T07:55:24.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.845+0000 7fbd7dda2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd78120370 con 0x7fbd78138fe0 2023-10-01T07:55:24.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.845+0000 7fbd7cda0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd7809d800 0x7fbd7811e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:24.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.845+0000 7fbd7d5a1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd78138fe0 0x7fbd7811f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:24.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.845+0000 7fbd7d5a1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd78138fe0 0x7fbd7811f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59328/0 (socket says 172.21.15.26:59328) 2023-10-01T07:55:24.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.845+0000 7fbd7d5a1700 1 -- 172.21.15.26:0/800747133 learned_addr learned my addr 172.21.15.26:0/800747133 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:24.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.845+0000 7fbd77fff700 1 --2- 172.21.15.26:0/800747133 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd7809e2e0 0x7fbd7811ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:24.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.846+0000 7fbd7d5a1700 1 -- 172.21.15.26:0/800747133 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd7809e2e0 msgr2=0x7fbd7811ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:24.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.846+0000 7fbd7d5a1700 1 --2- 172.21.15.26:0/800747133 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd7809e2e0 0x7fbd7811ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:24.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.846+0000 7fbd7d5a1700 1 -- 172.21.15.26:0/800747133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd7809d800 msgr2=0x7fbd7811e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:24.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.846+0000 7fbd7d5a1700 1 --2- 172.21.15.26:0/800747133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd7809d800 0x7fbd7811e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:24.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.846+0000 7fbd7d5a1700 1 -- 172.21.15.26:0/800747133 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd70009a70 con 0x7fbd78138fe0 2023-10-01T07:55:24.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.846+0000 7fbd7d5a1700 1 --2- 172.21.15.26:0/800747133 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd78138fe0 0x7fbd7811f1d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbd70013000 tx=0x7fbd70004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:24.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.846+0000 7fbd757fa700 1 -- 172.21.15.26:0/800747133 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd700045d0 con 0x7fbd78138fe0 2023-10-01T07:55:24.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.846+0000 7fbd757fa700 1 -- 172.21.15.26:0/800747133 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd70020070 con 0x7fbd78138fe0 2023-10-01T07:55:24.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.846+0000 7fbd757fa700 1 -- 172.21.15.26:0/800747133 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd70027480 con 0x7fbd78138fe0 2023-10-01T07:55:24.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.846+0000 7fbd7dda2700 1 -- 172.21.15.26:0/800747133 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd78121f00 con 0x7fbd78138fe0 2023-10-01T07:55:24.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.846+0000 7fbd7dda2700 1 -- 172.21.15.26:0/800747133 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd78122970 con 0x7fbd78138fe0 2023-10-01T07:55:24.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.847+0000 7fbd757fa700 1 -- 172.21.15.26:0/800747133 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbd70012430 con 0x7fbd78138fe0 2023-10-01T07:55:24.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.847+0000 7fbd7dda2700 1 -- 172.21.15.26:0/800747133 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd7804f2a0 con 0x7fbd78138fe0 2023-10-01T07:55:24.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.848+0000 7fbd757fa700 1 -- 172.21.15.26:0/800747133 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbd70022070 con 0x7fbd78138fe0 2023-10-01T07:55:24.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.857+0000 7fbd757fa700 1 -- 172.21.15.26:0/800747133 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbd7001c400 con 0x7fbd78138fe0 2023-10-01T07:55:24.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.895+0000 7fb44efec700 1 Processor -- start 2023-10-01T07:55:24.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.895+0000 7fb44efec700 1 -- start start 2023-10-01T07:55:24.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.896+0000 7fb44efec700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb44809d6f0 0x7fb44809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:24.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.896+0000 7fb44efec700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb44809e410 0x7fb448130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:24.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.896+0000 7fb44efec700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb44809f130 con 0x7fb44809e000 2023-10-01T07:55:24.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.896+0000 7fb44efec700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb44809f520 con 0x7fb44809d6f0 2023-10-01T07:55:24.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.896+0000 7fb44efec700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb44809e930 con 0x7fb44809e410 2023-10-01T07:55:24.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.896+0000 7fb44d589700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb44809e410 0x7fb448130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:24.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.896+0000 7fb44d589700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb44809e410 0x7fb448130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:53364/0 (socket says 172.21.15.26:53364) 2023-10-01T07:55:24.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.896+0000 7fb44d589700 1 -- 172.21.15.26:0/836646175 learned_addr learned my addr 172.21.15.26:0/836646175 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:24.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.896+0000 7fb44cd88700 1 --2- 172.21.15.26:0/836646175 >> v2:172.21.15.26:3300/0 conn(0x7fb44809d6f0 0x7fb44809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:24.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.896+0000 7fb44d589700 1 -- 172.21.15.26:0/836646175 >> v2:172.21.15.26:3300/0 conn(0x7fb44809d6f0 msgr2=0x7fb44809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:24.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.896+0000 7fb44d589700 1 --2- 172.21.15.26:0/836646175 >> v2:172.21.15.26:3300/0 conn(0x7fb44809d6f0 0x7fb44809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:24.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.896+0000 7fb44d589700 1 -- 172.21.15.26:0/836646175 >> v1:172.21.15.26:6789/0 conn(0x7fb44809e000 legacy=0x7fb448130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:24.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.896+0000 7fb44d589700 1 -- 172.21.15.26:0/836646175 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44809b2d0 con 0x7fb44809e410 2023-10-01T07:55:24.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.896+0000 7fb44cd88700 1 --2- 172.21.15.26:0/836646175 >> v2:172.21.15.26:3300/0 conn(0x7fb44809d6f0 0x7fb44809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:55:24.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.896+0000 7fb44d589700 1 --2- 172.21.15.26:0/836646175 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb44809e410 0x7fb448130d70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb440009e50 tx=0x7fb44000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d6964096eaa3441 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:24.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.897+0000 7fb4477fe700 1 -- 172.21.15.26:0/836646175 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44000e070 con 0x7fb44809e410 2023-10-01T07:55:24.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.897+0000 7fb4477fe700 1 -- 172.21.15.26:0/836646175 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44000b9c0 con 0x7fb44809e410 2023-10-01T07:55:24.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.897+0000 7fb4477fe700 1 -- 172.21.15.26:0/836646175 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44000bd70 con 0x7fb44809e410 2023-10-01T07:55:24.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.897+0000 7fb44efec700 1 -- 172.21.15.26:0/836646175 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb44809e410 msgr2=0x7fb448130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:24.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.897+0000 7fb44efec700 1 --2- 172.21.15.26:0/836646175 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb44809e410 0x7fb448130d70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb440009e50 tx=0x7fb44000b330 comp rx=0 tx=0).stop 2023-10-01T07:55:24.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.898+0000 7fb44efec700 1 -- 172.21.15.26:0/836646175 shutdown_connections 2023-10-01T07:55:24.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.898+0000 7fb44efec700 1 --2- 172.21.15.26:0/836646175 >> v2:172.21.15.26:3300/0 conn(0x7fb44809d6f0 0x7fb44809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:24.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.898+0000 7fb44efec700 1 --2- 172.21.15.26:0/836646175 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb44809e410 0x7fb448130d70 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:24.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.898+0000 7fb44efec700 1 -- 172.21.15.26:0/836646175 >> 172.21.15.26:0/836646175 conn(0x7fb448066f50 msgr2=0x7fb44809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:24.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.898+0000 7fb44efec700 1 -- 172.21.15.26:0/836646175 shutdown_connections 2023-10-01T07:55:24.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.898+0000 7fb44efec700 1 -- 172.21.15.26:0/836646175 wait complete. 2023-10-01T07:55:24.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.899+0000 7fb44efec700 1 Processor -- start 2023-10-01T07:55:24.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.899+0000 7fb44efec700 1 -- start start 2023-10-01T07:55:24.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.899+0000 7ff37ab8b700 1 Processor -- start 2023-10-01T07:55:24.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.900+0000 7fb44efec700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb44809d6f0 0x7fb4481227c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:24.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.900+0000 7fb44efec700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb44809e000 0x7fb448122d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:24.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.900+0000 7fb44efec700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb44809e410 0x7fb448123240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:24.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.900+0000 7fb44efec700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb448126290 con 0x7fb44809e000 2023-10-01T07:55:24.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.900+0000 7fb44efec700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb448124380 con 0x7fb44809d6f0 2023-10-01T07:55:24.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.900+0000 7fb44efec700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4480a1b80 con 0x7fb44809e410 2023-10-01T07:55:24.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.900+0000 7fb447fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb44809e000 0x7fb448122d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:24.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.900+0000 7fb447fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb44809e000 0x7fb448122d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40780/0 (socket says 172.21.15.26:40780) 2023-10-01T07:55:24.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.900+0000 7fb447fff700 1 -- 172.21.15.26:0/2866632767 learned_addr learned my addr 172.21.15.26:0/2866632767 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:24.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.900+0000 7fb44cd88700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb44809d6f0 0x7fb4481227c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:24.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.899+0000 7ff37ab8b700 1 -- start start 2023-10-01T07:55:24.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.900+0000 7ff37ab8b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff37409d6f0 0x7ff37409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:24.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.900+0000 7ff37ab8b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff37409e410 0x7ff374130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:24.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.900+0000 7ff37ab8b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff37409f130 con 0x7ff37409e000 2023-10-01T07:55:24.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.900+0000 7ff37ab8b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff37409f520 con 0x7ff37409d6f0 2023-10-01T07:55:24.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.900+0000 7ff37ab8b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff37409e930 con 0x7ff37409e410 2023-10-01T07:55:24.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.900+0000 7ff379128700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff37409e410 0x7ff374130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:24.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.900+0000 7ff379128700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff37409e410 0x7ff374130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:53380/0 (socket says 172.21.15.26:53380) 2023-10-01T07:55:24.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.900+0000 7ff379128700 1 -- 172.21.15.26:0/53965906 learned_addr learned my addr 172.21.15.26:0/53965906 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:24.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.900+0000 7ff378927700 1 --2- 172.21.15.26:0/53965906 >> v2:172.21.15.26:3300/0 conn(0x7ff37409d6f0 0x7ff37409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:24.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.901+0000 7fb447fff700 1 -- 172.21.15.26:0/2866632767 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb44809e410 msgr2=0x7fb448123240 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:24.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.901+0000 7fb447fff700 1 --2- 172.21.15.26:0/2866632767 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb44809e410 0x7fb448123240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:24.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.901+0000 7fb447fff700 1 -- 172.21.15.26:0/2866632767 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb44809d6f0 msgr2=0x7fb4481227c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:24.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.901+0000 7fb447fff700 1 --2- 172.21.15.26:0/2866632767 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb44809d6f0 0x7fb4481227c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:24.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.901+0000 7fb447fff700 1 -- 172.21.15.26:0/2866632767 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb440009b30 con 0x7fb44809e000 2023-10-01T07:55:24.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.901+0000 7ff379128700 1 -- 172.21.15.26:0/53965906 >> v2:172.21.15.26:3300/0 conn(0x7ff37409d6f0 msgr2=0x7ff37409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:24.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.901+0000 7ff379128700 1 --2- 172.21.15.26:0/53965906 >> v2:172.21.15.26:3300/0 conn(0x7ff37409d6f0 0x7ff37409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:24.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.901+0000 7ff379128700 1 -- 172.21.15.26:0/53965906 >> v1:172.21.15.26:6789/0 conn(0x7ff37409e000 legacy=0x7ff374130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:24.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.901+0000 7ff379128700 1 -- 172.21.15.26:0/53965906 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff37409b2d0 con 0x7ff37409e410 2023-10-01T07:55:24.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.901+0000 7fb44cd88700 1 --2- 172.21.15.26:0/2866632767 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb44809d6f0 0x7fb4481227c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:55:24.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.901+0000 7fb447fff700 1 --2- 172.21.15.26:0/2866632767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb44809e000 0x7fb448122d00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb43400c4e0 tx=0x7fb43400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:24.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.901+0000 7ff379128700 1 --2- 172.21.15.26:0/53965906 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff37409e410 0x7ff374130d70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff36c009e50 tx=0x7ff36c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5551695352a7308 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:24.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.901+0000 7fb4457fa700 1 -- 172.21.15.26:0/2866632767 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4340052d0 con 0x7fb44809e000 2023-10-01T07:55:24.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.901+0000 7fb4457fa700 1 -- 172.21.15.26:0/2866632767 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb434005430 con 0x7fb44809e000 2023-10-01T07:55:24.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.901+0000 7fb44efec700 1 -- 172.21.15.26:0/2866632767 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb448130690 con 0x7fb44809e000 2023-10-01T07:55:24.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.901+0000 7ff3737fe700 1 -- 172.21.15.26:0/53965906 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c00e070 con 0x7ff37409e410 2023-10-01T07:55:24.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.901+0000 7ff3737fe700 1 -- 172.21.15.26:0/53965906 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36c00b9c0 con 0x7ff37409e410 2023-10-01T07:55:24.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.901+0000 7ff3737fe700 1 -- 172.21.15.26:0/53965906 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c00bd70 con 0x7ff37409e410 2023-10-01T07:55:24.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.901+0000 7fb44efec700 1 -- 172.21.15.26:0/2866632767 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb448126a20 con 0x7fb44809e000 2023-10-01T07:55:24.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.901+0000 7fb4457fa700 1 -- 172.21.15.26:0/2866632767 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4340038c0 con 0x7fb44809e000 2023-10-01T07:55:24.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.903+0000 7fb4457fa700 1 -- 172.21.15.26:0/2866632767 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb434003a20 con 0x7fb44809e000 2023-10-01T07:55:24.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.902+0000 7ff37ab8b700 1 -- 172.21.15.26:0/53965906 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff37409e410 msgr2=0x7ff374130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:24.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.902+0000 7ff37ab8b700 1 --2- 172.21.15.26:0/53965906 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff37409e410 0x7ff374130d70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff36c009e50 tx=0x7ff36c00b330 comp rx=0 tx=0).stop 2023-10-01T07:55:24.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.902+0000 7ff37ab8b700 1 -- 172.21.15.26:0/53965906 shutdown_connections 2023-10-01T07:55:24.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.902+0000 7ff37ab8b700 1 --2- 172.21.15.26:0/53965906 >> v2:172.21.15.26:3300/0 conn(0x7ff37409d6f0 0x7ff37409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:24.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.903+0000 7ff37ab8b700 1 --2- 172.21.15.26:0/53965906 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff37409e410 0x7ff374130d70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:24.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.903+0000 7ff37ab8b700 1 -- 172.21.15.26:0/53965906 >> 172.21.15.26:0/53965906 conn(0x7ff374066f50 msgr2=0x7ff37409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:24.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.903+0000 7ff37ab8b700 1 -- 172.21.15.26:0/53965906 shutdown_connections 2023-10-01T07:55:24.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.903+0000 7ff37ab8b700 1 -- 172.21.15.26:0/53965906 wait complete. 2023-10-01T07:55:24.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.903+0000 7fb4457fa700 1 -- 172.21.15.26:0/2866632767 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb43403eb90 con 0x7fb44809e000 2023-10-01T07:55:24.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.904+0000 7fb44efec700 1 -- 172.21.15.26:0/2866632767 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4280052e0 con 0x7fb44809e000 2023-10-01T07:55:24.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.904+0000 7ff37ab8b700 1 Processor -- start 2023-10-01T07:55:24.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.904+0000 7ff37ab8b700 1 -- start start 2023-10-01T07:55:24.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.904+0000 7ff37ab8b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff37409d6f0 0x7ff3741c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:24.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.904+0000 7ff37ab8b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff37409e000 0x7ff3741c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:24.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.905+0000 7ff37ab8b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff37409e410 0x7ff3741c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:24.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.905+0000 7ff37ab8b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3741310b0 con 0x7ff37409e000 2023-10-01T07:55:24.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.905+0000 7ff37ab8b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff37413a1f0 con 0x7ff37409d6f0 2023-10-01T07:55:24.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.905+0000 7ff37ab8b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3741386d0 con 0x7ff37409e410 2023-10-01T07:55:24.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.905+0000 7ff378927700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff37409d6f0 0x7ff3741c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:24.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.905+0000 7ff373fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff37409e000 0x7ff3741c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:24.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.905+0000 7ff378927700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff37409d6f0 0x7ff3741c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:53392/0 (socket says 172.21.15.26:53392) 2023-10-01T07:55:24.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.905+0000 7ff378927700 1 -- 172.21.15.26:0/2603184773 learned_addr learned my addr 172.21.15.26:0/2603184773 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:24.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.905+0000 7ff378927700 1 -- 172.21.15.26:0/2603184773 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff37409e410 msgr2=0x7ff3741c8b80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:24.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.905+0000 7ff378927700 1 --2- 172.21.15.26:0/2603184773 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff37409e410 0x7ff3741c8b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:24.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.905+0000 7ff378927700 1 -- 172.21.15.26:0/2603184773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff37409e000 msgr2=0x7ff3741c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:24.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.905+0000 7ff378927700 1 --2- 172.21.15.26:0/2603184773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff37409e000 0x7ff3741c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:24.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.905+0000 7ff378927700 1 -- 172.21.15.26:0/2603184773 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36c009b30 con 0x7ff37409d6f0 2023-10-01T07:55:24.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.905+0000 7ff378927700 1 --2- 172.21.15.26:0/2603184773 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff37409d6f0 0x7ff3741c8100 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff36800e810 tx=0x7ff36800eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:24.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.906+0000 7ff3717fa700 1 -- 172.21.15.26:0/2603184773 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff368013610 con 0x7ff37409d6f0 2023-10-01T07:55:24.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.906+0000 7ff3717fa700 1 -- 172.21.15.26:0/2603184773 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff368013770 con 0x7ff37409d6f0 2023-10-01T07:55:24.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.906+0000 7ff3717fa700 1 -- 172.21.15.26:0/2603184773 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff368013b20 con 0x7ff37409d6f0 2023-10-01T07:55:24.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.906+0000 7ff37ab8b700 1 -- 172.21.15.26:0/2603184773 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff37409c700 con 0x7ff37409d6f0 2023-10-01T07:55:24.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.906+0000 7ff37ab8b700 1 -- 172.21.15.26:0/2603184773 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3741199d0 con 0x7ff37409d6f0 2023-10-01T07:55:24.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.907+0000 7ff3717fa700 1 -- 172.21.15.26:0/2603184773 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff368013c80 con 0x7ff37409d6f0 2023-10-01T07:55:24.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.907+0000 7ff3717fa700 1 -- 172.21.15.26:0/2603184773 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff36803f370 con 0x7ff37409d6f0 2023-10-01T07:55:24.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.910+0000 7ff37ab8b700 1 -- 172.21.15.26:0/2603184773 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff374074ea0 con 0x7ff37409d6f0 2023-10-01T07:55:24.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.910+0000 7fb4457fa700 1 -- 172.21.15.26:0/2866632767 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb434019d20 con 0x7fb44809e000 2023-10-01T07:55:24.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.919+0000 7ff3717fa700 1 -- 172.21.15.26:0/2603184773 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff368012370 con 0x7ff37409d6f0 2023-10-01T07:55:24.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.943+0000 7fd1a09f0700 1 Processor -- start 2023-10-01T07:55:24.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.943+0000 7fd1a09f0700 1 -- start start 2023-10-01T07:55:24.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.944+0000 7fd1a09f0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd19c09d6f0 0x7fd19c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:24.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.944+0000 7fd1a09f0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd19c09e000 0x7fd19c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:24.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.944+0000 7fd1a09f0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd19c09e410 0x7fd19c133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:24.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.944+0000 7fd1a09f0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd19c06b460 con 0x7fd19c09d6f0 2023-10-01T07:55:24.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.944+0000 7fd1a09f0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c09b120 con 0x7fd19c09e410 2023-10-01T07:55:24.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.944+0000 7fd1a09f0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c09a7e0 con 0x7fd19c09e000 2023-10-01T07:55:24.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.944+0000 7fd199d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd19c09e000 0x7fd19c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:24.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.944+0000 7fd19ad9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd19c09e410 0x7fd19c133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:24.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.944+0000 7fd199d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd19c09e000 0x7fd19c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59338/0 (socket says 172.21.15.26:59338) 2023-10-01T07:55:24.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.944+0000 7fd199d9b700 1 -- 172.21.15.26:0/844321794 learned_addr learned my addr 172.21.15.26:0/844321794 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:24.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.945+0000 7fd19a59c700 1 --2- 172.21.15.26:0/844321794 >> v2:172.21.15.26:3300/0 conn(0x7fd19c09d6f0 0x7fd19c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:24.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.945+0000 7fd19ad9d700 1 -- 172.21.15.26:0/844321794 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd19c09e000 msgr2=0x7fd19c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:24.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.945+0000 7fd19ad9d700 1 --2- 172.21.15.26:0/844321794 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd19c09e000 0x7fd19c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:24.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.945+0000 7fd19ad9d700 1 -- 172.21.15.26:0/844321794 >> v2:172.21.15.26:3300/0 conn(0x7fd19c09d6f0 msgr2=0x7fd19c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:24.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.945+0000 7fd19ad9d700 1 --2- 172.21.15.26:0/844321794 >> v2:172.21.15.26:3300/0 conn(0x7fd19c09d6f0 0x7fd19c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:24.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.945+0000 7fd19ad9d700 1 -- 172.21.15.26:0/844321794 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19c09a500 con 0x7fd19c09e410 2023-10-01T07:55:24.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.945+0000 7fd199d9b700 1 --2- 172.21.15.26:0/844321794 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd19c09e000 0x7fd19c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:24.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.945+0000 7fd19ad9d700 1 --2- 172.21.15.26:0/844321794 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd19c09e410 0x7fd19c133f30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd194009dc0 tx=0x7fd19400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23ad13cf612b4eba server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:24.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.945+0000 7fd19959a700 1 -- 172.21.15.26:0/844321794 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19400e070 con 0x7fd19c09e410 2023-10-01T07:55:24.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.945+0000 7fd19959a700 1 -- 172.21.15.26:0/844321794 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd19400bae0 con 0x7fd19c09e410 2023-10-01T07:55:24.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.945+0000 7fd19959a700 1 -- 172.21.15.26:0/844321794 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19400be90 con 0x7fd19c09e410 2023-10-01T07:55:24.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.946+0000 7fd1a09f0700 1 -- 172.21.15.26:0/844321794 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd19c09e410 msgr2=0x7fd19c133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:24.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.946+0000 7fd1a09f0700 1 --2- 172.21.15.26:0/844321794 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd19c09e410 0x7fd19c133f30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd194009dc0 tx=0x7fd19400b330 comp rx=0 tx=0).stop 2023-10-01T07:55:24.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.946+0000 7fd1a09f0700 1 -- 172.21.15.26:0/844321794 shutdown_connections 2023-10-01T07:55:24.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.946+0000 7fd1a09f0700 1 --2- 172.21.15.26:0/844321794 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd19c09e410 0x7fd19c133f30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:24.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.946+0000 7fd1a09f0700 1 --2- 172.21.15.26:0/844321794 >> v2:172.21.15.26:3300/0 conn(0x7fd19c09d6f0 0x7fd19c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:24.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.946+0000 7fd1a09f0700 1 --2- 172.21.15.26:0/844321794 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd19c09e000 0x7fd19c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:24.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.946+0000 7fd1a09f0700 1 -- 172.21.15.26:0/844321794 >> 172.21.15.26:0/844321794 conn(0x7fd19c066f50 msgr2=0x7fd19c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:24.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.947+0000 7fd1a09f0700 1 -- 172.21.15.26:0/844321794 shutdown_connections 2023-10-01T07:55:24.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.947+0000 7fd1a09f0700 1 -- 172.21.15.26:0/844321794 wait complete. 2023-10-01T07:55:24.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.948+0000 7fd1a09f0700 1 Processor -- start 2023-10-01T07:55:24.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.948+0000 7fd1a09f0700 1 -- start start 2023-10-01T07:55:24.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.949+0000 7fd1a09f0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd19c09d6f0 0x7fd19c1a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:24.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.949+0000 7fd1a09f0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd19c09e000 0x7fd19c1a3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:24.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.949+0000 7fd1a09f0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd19c09e410 0x7fd19c1a4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:24.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.949+0000 7fd1a09f0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c1a5260 con 0x7fd19c09d6f0 2023-10-01T07:55:24.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.949+0000 7fd1a09f0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c0a2000 con 0x7fd19c09e410 2023-10-01T07:55:24.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.949+0000 7fd1a09f0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c09c710 con 0x7fd19c09e000 2023-10-01T07:55:24.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.949+0000 7fd19ad9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd19c09e410 0x7fd19c1a4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:24.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.949+0000 7fd19a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd19c09d6f0 0x7fd19c1a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:24.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.949+0000 7fd19ad9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd19c09e410 0x7fd19c1a4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:53418/0 (socket says 172.21.15.26:53418) 2023-10-01T07:55:24.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.949+0000 7fd19a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd19c09d6f0 0x7fd19c1a36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40824/0 (socket says 172.21.15.26:40824) 2023-10-01T07:55:24.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.949+0000 7fd19ad9d700 1 -- 172.21.15.26:0/26694187 learned_addr learned my addr 172.21.15.26:0/26694187 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:24.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.949+0000 7fd199d9b700 1 --2- 172.21.15.26:0/26694187 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd19c09e000 0x7fd19c1a3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:24.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.950+0000 7fd199d9b700 1 -- 172.21.15.26:0/26694187 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd19c09e410 msgr2=0x7fd19c1a4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:24.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.950+0000 7fd199d9b700 1 --2- 172.21.15.26:0/26694187 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd19c09e410 0x7fd19c1a4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:24.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.950+0000 7fd199d9b700 1 -- 172.21.15.26:0/26694187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd19c09d6f0 msgr2=0x7fd19c1a36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:24.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.950+0000 7fd199d9b700 1 --2- 172.21.15.26:0/26694187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd19c09d6f0 0x7fd19c1a36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:24.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.950+0000 7fd199d9b700 1 -- 172.21.15.26:0/26694187 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd190009550 con 0x7fd19c09e000 2023-10-01T07:55:24.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.950+0000 7fd199d9b700 1 --2- 172.21.15.26:0/26694187 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd19c09e000 0x7fd19c1a3c30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd19000e9d0 tx=0x7fd19000ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:24.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.950+0000 7fd18affd700 1 -- 172.21.15.26:0/26694187 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19000ee70 con 0x7fd19c09e000 2023-10-01T07:55:24.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.950+0000 7fd18affd700 1 -- 172.21.15.26:0/26694187 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd190004030 con 0x7fd19c09e000 2023-10-01T07:55:24.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.950+0000 7fd18affd700 1 -- 172.21.15.26:0/26694187 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1900043c0 con 0x7fd19c09e000 2023-10-01T07:55:24.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.950+0000 7fd1a09f0700 1 -- 172.21.15.26:0/26694187 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd194009a70 con 0x7fd19c09e000 2023-10-01T07:55:24.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.950+0000 7fd1a09f0700 1 -- 172.21.15.26:0/26694187 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd19c1a5a50 con 0x7fd19c09e000 2023-10-01T07:55:24.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.952+0000 7fd18affd700 1 -- 172.21.15.26:0/26694187 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd19000c850 con 0x7fd19c09e000 2023-10-01T07:55:24.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.952+0000 7fd1a09f0700 1 -- 172.21.15.26:0/26694187 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd19c074ea0 con 0x7fd19c09e000 2023-10-01T07:55:24.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.952+0000 7fd18affd700 1 -- 172.21.15.26:0/26694187 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd190047350 con 0x7fd19c09e000 2023-10-01T07:55:24.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:24.957+0000 7fd18affd700 1 -- 172.21.15.26:0/26694187 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd190044060 con 0x7fd19c09e000 2023-10-01T07:55:25.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.073+0000 7fbd7dda2700 1 -- 172.21.15.26:0/800747133 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbd7806c0a0 con 0x7fbd78138fe0 2023-10-01T07:55:25.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.073+0000 7fbd757fa700 1 -- 172.21.15.26:0/800747133 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbd7001a380 con 0x7fbd78138fe0 2023-10-01T07:55:25.074 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:25.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.076+0000 7fbd7dda2700 1 -- 172.21.15.26:0/800747133 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd78138fe0 msgr2=0x7fbd7811f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:25.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.076+0000 7fbd7dda2700 1 --2- 172.21.15.26:0/800747133 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd78138fe0 0x7fbd7811f1d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbd70013000 tx=0x7fbd70004ad0 comp rx=0 tx=0).stop 2023-10-01T07:55:25.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.076+0000 7fbd7dda2700 1 -- 172.21.15.26:0/800747133 shutdown_connections 2023-10-01T07:55:25.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.076+0000 7fbd7dda2700 1 --2- 172.21.15.26:0/800747133 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd78138fe0 0x7fbd7811f1d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:25.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.076+0000 7fbd7dda2700 1 --2- 172.21.15.26:0/800747133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd7809d800 0x7fbd7811e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:25.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.076+0000 7fbd7dda2700 1 --2- 172.21.15.26:0/800747133 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd7809e2e0 0x7fbd7811ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:25.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.076+0000 7fbd7dda2700 1 -- 172.21.15.26:0/800747133 >> 172.21.15.26:0/800747133 conn(0x7fbd780a2e20 msgr2=0x7fbd780a0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:25.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.076+0000 7fbd7dda2700 1 -- 172.21.15.26:0/800747133 shutdown_connections 2023-10-01T07:55:25.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.076+0000 7fbd7dda2700 1 -- 172.21.15.26:0/800747133 wait complete. 2023-10-01T07:55:25.090 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:25.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.120+0000 7fb44efec700 1 -- 172.21.15.26:0/2866632767 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb428005590 con 0x7fb44809e000 2023-10-01T07:55:25.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.120+0000 7fb4457fa700 1 -- 172.21.15.26:0/2866632767 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb4340192c0 con 0x7fb44809e000 2023-10-01T07:55:25.121 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:25.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.122+0000 7fb44efec700 1 -- 172.21.15.26:0/2866632767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb44809e000 msgr2=0x7fb448122d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:25.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.122+0000 7fb44efec700 1 --2- 172.21.15.26:0/2866632767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb44809e000 0x7fb448122d00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb43400c4e0 tx=0x7fb43400c8a0 comp rx=0 tx=0).stop 2023-10-01T07:55:25.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.122+0000 7fb44efec700 1 -- 172.21.15.26:0/2866632767 shutdown_connections 2023-10-01T07:55:25.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.122+0000 7fb44efec700 1 --2- 172.21.15.26:0/2866632767 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb44809e410 0x7fb448123240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:25.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.122+0000 7fb44efec700 1 --2- 172.21.15.26:0/2866632767 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb44809d6f0 0x7fb4481227c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:25.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.122+0000 7fb44efec700 1 --2- 172.21.15.26:0/2866632767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb44809e000 0x7fb448122d00 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:25.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.122+0000 7fb44efec700 1 -- 172.21.15.26:0/2866632767 >> 172.21.15.26:0/2866632767 conn(0x7fb448066f50 msgr2=0x7fb448070f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:25.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.122+0000 7fb44efec700 1 -- 172.21.15.26:0/2866632767 shutdown_connections 2023-10-01T07:55:25.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.122+0000 7fb44efec700 1 -- 172.21.15.26:0/2866632767 wait complete. 2023-10-01T07:55:25.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.130+0000 7ff37ab8b700 1 -- 172.21.15.26:0/2603184773 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff37406c360 con 0x7ff37409d6f0 2023-10-01T07:55:25.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.131+0000 7ff3717fa700 1 -- 172.21.15.26:0/2603184773 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff368021020 con 0x7ff37409d6f0 2023-10-01T07:55:25.131 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:25.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.133+0000 7ff37ab8b700 1 -- 172.21.15.26:0/2603184773 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff37409d6f0 msgr2=0x7ff3741c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:25.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.133+0000 7ff37ab8b700 1 --2- 172.21.15.26:0/2603184773 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff37409d6f0 0x7ff3741c8100 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff36800e810 tx=0x7ff36800eb20 comp rx=0 tx=0).stop 2023-10-01T07:55:25.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.133+0000 7ff37ab8b700 1 -- 172.21.15.26:0/2603184773 shutdown_connections 2023-10-01T07:55:25.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.133+0000 7ff37ab8b700 1 --2- 172.21.15.26:0/2603184773 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff37409e410 0x7ff3741c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:25.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.133+0000 7ff37ab8b700 1 --2- 172.21.15.26:0/2603184773 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff37409d6f0 0x7ff3741c8100 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:25.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.133+0000 7ff37ab8b700 1 --2- 172.21.15.26:0/2603184773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff37409e000 0x7ff3741c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:25.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.133+0000 7ff37ab8b700 1 -- 172.21.15.26:0/2603184773 >> 172.21.15.26:0/2603184773 conn(0x7ff374066f50 msgr2=0x7ff3740a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:25.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.133+0000 7ff37ab8b700 1 -- 172.21.15.26:0/2603184773 shutdown_connections 2023-10-01T07:55:25.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.133+0000 7ff37ab8b700 1 -- 172.21.15.26:0/2603184773 wait complete. 2023-10-01T07:55:25.137 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:25.148 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:25.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.165+0000 7fd1a09f0700 1 -- 172.21.15.26:0/26694187 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd19c1a7960 con 0x7fd19c09e000 2023-10-01T07:55:25.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.166+0000 7fd18affd700 1 -- 172.21.15.26:0/26694187 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd190044020 con 0x7fd19c09e000 2023-10-01T07:55:25.166 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:25.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.168+0000 7fd1a09f0700 1 -- 172.21.15.26:0/26694187 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd19c09e000 msgr2=0x7fd19c1a3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:25.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.168+0000 7fd1a09f0700 1 --2- 172.21.15.26:0/26694187 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd19c09e000 0x7fd19c1a3c30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd19000e9d0 tx=0x7fd19000ece0 comp rx=0 tx=0).stop 2023-10-01T07:55:25.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.168+0000 7fd1a09f0700 1 -- 172.21.15.26:0/26694187 shutdown_connections 2023-10-01T07:55:25.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.168+0000 7fd1a09f0700 1 --2- 172.21.15.26:0/26694187 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd19c09e410 0x7fd19c1a4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:25.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.168+0000 7fd1a09f0700 1 --2- 172.21.15.26:0/26694187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd19c09d6f0 0x7fd19c1a36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:25.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.168+0000 7fd1a09f0700 1 --2- 172.21.15.26:0/26694187 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd19c09e000 0x7fd19c1a3c30 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:25.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.168+0000 7fd1a09f0700 1 -- 172.21.15.26:0/26694187 >> 172.21.15.26:0/26694187 conn(0x7fd19c066f50 msgr2=0x7fd19c06f390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:25.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.168+0000 7fd1a09f0700 1 -- 172.21.15.26:0/26694187 shutdown_connections 2023-10-01T07:55:25.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:25.168+0000 7fd1a09f0700 1 -- 172.21.15.26:0/26694187 wait complete. 2023-10-01T07:55:25.182 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:26.092 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:26.138 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:26.148 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:26.183 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:26.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.248+0000 7fae0b32d700 1 Processor -- start 2023-10-01T07:55:26.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.248+0000 7fae0b32d700 1 -- start start 2023-10-01T07:55:26.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.249+0000 7fae0b32d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae0409d6f0 0x7fae0409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:26.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.249+0000 7fae0b32d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae0409e410 0x7fae04134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:26.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.249+0000 7fae0b32d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae0409b120 con 0x7fae0409e000 2023-10-01T07:55:26.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.249+0000 7fae0b32d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae0406b460 con 0x7fae0409e410 2023-10-01T07:55:26.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.249+0000 7fae0b32d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae0409a7e0 con 0x7fae0409d6f0 2023-10-01T07:55:26.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.249+0000 7fae098ca700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae0409e410 0x7fae04134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:26.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.249+0000 7fae088c8700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fae0409e000 0x7fae041339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38512/0 (socket says 172.21.15.26:38512) 2023-10-01T07:55:26.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.249+0000 7fae088c8700 1 -- 172.21.15.26:0/2142090945 learned_addr learned my addr 172.21.15.26:0/2142090945 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:26.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.249+0000 7fae098ca700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae0409e410 0x7fae04134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:53432/0 (socket says 172.21.15.26:53432) 2023-10-01T07:55:26.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.249+0000 7fae090c9700 1 --2- 172.21.15.26:0/2142090945 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae0409d6f0 0x7fae0409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:26.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.250+0000 7fae098ca700 1 -- 172.21.15.26:0/2142090945 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae0409d6f0 msgr2=0x7fae0409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:26.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.250+0000 7fae098ca700 1 --2- 172.21.15.26:0/2142090945 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae0409d6f0 0x7fae0409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:26.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.250+0000 7fae098ca700 1 -- 172.21.15.26:0/2142090945 >> v1:172.21.15.26:6789/0 conn(0x7fae0409e000 legacy=0x7fae041339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:26.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.250+0000 7fadfbfff700 1 -- 172.21.15.26:0/2142090945 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 828751666 0 0) 0x7fae0409b120 con 0x7fae0409e000 2023-10-01T07:55:26.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.250+0000 7fae098ca700 1 -- 172.21.15.26:0/2142090945 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0409a500 con 0x7fae0409e410 2023-10-01T07:55:26.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.250+0000 7fae098ca700 1 --2- 172.21.15.26:0/2142090945 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae0409e410 0x7fae04134100 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fadfc009dc0 tx=0x7fadfc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4da03285ea2a82f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:26.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.250+0000 7fadfbfff700 1 -- 172.21.15.26:0/2142090945 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc00e070 con 0x7fae0409e410 2023-10-01T07:55:26.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.250+0000 7fadfbfff700 1 -- 172.21.15.26:0/2142090945 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadfc00bb20 con 0x7fae0409e410 2023-10-01T07:55:26.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.250+0000 7fadfbfff700 1 -- 172.21.15.26:0/2142090945 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc012430 con 0x7fae0409e410 2023-10-01T07:55:26.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.251+0000 7fae0b32d700 1 -- 172.21.15.26:0/2142090945 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae0409e410 msgr2=0x7fae04134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:26.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.251+0000 7fae0b32d700 1 --2- 172.21.15.26:0/2142090945 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae0409e410 0x7fae04134100 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fadfc009dc0 tx=0x7fadfc00b330 comp rx=0 tx=0).stop 2023-10-01T07:55:26.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.251+0000 7fae0b32d700 1 -- 172.21.15.26:0/2142090945 shutdown_connections 2023-10-01T07:55:26.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.251+0000 7fae0b32d700 1 --2- 172.21.15.26:0/2142090945 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae0409d6f0 0x7fae0409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:26.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.251+0000 7fae0b32d700 1 --2- 172.21.15.26:0/2142090945 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae0409e410 0x7fae04134100 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:26.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.251+0000 7fae0b32d700 1 -- 172.21.15.26:0/2142090945 >> 172.21.15.26:0/2142090945 conn(0x7fae04066f50 msgr2=0x7fae0409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:26.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.251+0000 7fae0b32d700 1 -- 172.21.15.26:0/2142090945 shutdown_connections 2023-10-01T07:55:26.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.251+0000 7fae0b32d700 1 -- 172.21.15.26:0/2142090945 wait complete. 2023-10-01T07:55:26.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.252+0000 7fae0b32d700 1 Processor -- start 2023-10-01T07:55:26.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.252+0000 7fae0b32d700 1 -- start start 2023-10-01T07:55:26.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.253+0000 7fae0b32d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae0409d6f0 0x7fae041a3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:26.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.253+0000 7fae0b32d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae0409e000 0x7fae041a3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:26.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.253+0000 7fae0b32d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae0409e410 0x7fae041a40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:26.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.253+0000 7fae0b32d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae041a52c0 con 0x7fae0409d6f0 2023-10-01T07:55:26.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.253+0000 7fae0b32d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae040a1d90 con 0x7fae0409e410 2023-10-01T07:55:26.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.253+0000 7fae0b32d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae0409c710 con 0x7fae0409e000 2023-10-01T07:55:26.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.253+0000 7fae098ca700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae0409e410 0x7fae041a40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:26.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.253+0000 7fae098ca700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae0409e410 0x7fae041a40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:53434/0 (socket says 172.21.15.26:53434) 2023-10-01T07:55:26.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.253+0000 7fae098ca700 1 -- 172.21.15.26:0/191799700 learned_addr learned my addr 172.21.15.26:0/191799700 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:26.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.253+0000 7fae090c9700 1 --2- 172.21.15.26:0/191799700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae0409d6f0 0x7fae041a3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:26.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.253+0000 7fae088c8700 1 --2- 172.21.15.26:0/191799700 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae0409e000 0x7fae041a3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:26.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.254+0000 7fae098ca700 1 -- 172.21.15.26:0/191799700 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae0409e000 msgr2=0x7fae041a3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:26.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.254+0000 7fae098ca700 1 --2- 172.21.15.26:0/191799700 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae0409e000 0x7fae041a3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:26.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.254+0000 7fae098ca700 1 -- 172.21.15.26:0/191799700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae0409d6f0 msgr2=0x7fae041a3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:26.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.254+0000 7fae098ca700 1 --2- 172.21.15.26:0/191799700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae0409d6f0 0x7fae041a3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:26.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.254+0000 7fae098ca700 1 -- 172.21.15.26:0/191799700 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadfc009a70 con 0x7fae0409e410 2023-10-01T07:55:26.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.254+0000 7fae088c8700 1 --2- 172.21.15.26:0/191799700 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae0409e000 0x7fae041a3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:55:26.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.254+0000 7fae098ca700 1 --2- 172.21.15.26:0/191799700 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae0409e410 0x7fae041a40c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00b680 tx=0x7fadfc004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:26.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.254+0000 7fadf9ffb700 1 -- 172.21.15.26:0/191799700 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc012430 con 0x7fae0409e410 2023-10-01T07:55:26.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.254+0000 7fadf9ffb700 1 -- 172.21.15.26:0/191799700 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadfc020070 con 0x7fae0409e410 2023-10-01T07:55:26.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.254+0000 7fae0b32d700 1 -- 172.21.15.26:0/191799700 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae041a5960 con 0x7fae0409e410 2023-10-01T07:55:26.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.254+0000 7fadf9ffb700 1 -- 172.21.15.26:0/191799700 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc004280 con 0x7fae0409e410 2023-10-01T07:55:26.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.255+0000 7fae0b32d700 1 -- 172.21.15.26:0/191799700 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae041a77c0 con 0x7fae0409e410 2023-10-01T07:55:26.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.256+0000 7fae0b32d700 1 -- 172.21.15.26:0/191799700 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae04074ea0 con 0x7fae0409e410 2023-10-01T07:55:26.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.256+0000 7fadf9ffb700 1 -- 172.21.15.26:0/191799700 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fadfc0043e0 con 0x7fae0409e410 2023-10-01T07:55:26.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.257+0000 7fadf9ffb700 1 -- 172.21.15.26:0/191799700 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fadfc022070 con 0x7fae0409e410 2023-10-01T07:55:26.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.266+0000 7fadf9ffb700 1 -- 172.21.15.26:0/191799700 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fadfc046060 con 0x7fae0409e410 2023-10-01T07:55:26.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.298+0000 7f31df592700 1 Processor -- start 2023-10-01T07:55:26.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.298+0000 7f31df592700 1 -- start start 2023-10-01T07:55:26.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.299+0000 7f31df592700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f31d809d6f0 0x7f31d809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:26.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.299+0000 7f31df592700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f31d809e410 0x7f31d8134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:26.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.299+0000 7f31df592700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d809b120 con 0x7f31d809e000 2023-10-01T07:55:26.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.299+0000 7f31df592700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d806b460 con 0x7f31d809e410 2023-10-01T07:55:26.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.299+0000 7f31df592700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31d809a7e0 con 0x7f31d809d6f0 2023-10-01T07:55:26.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.299+0000 7f31dd32e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f31d809d6f0 0x7f31d809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:26.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.299+0000 7f31dd32e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f31d809d6f0 0x7f31d809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59370/0 (socket says 172.21.15.26:59370) 2023-10-01T07:55:26.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.299+0000 7f31dd32e700 1 -- 172.21.15.26:0/4068799880 learned_addr learned my addr 172.21.15.26:0/4068799880 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:26.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.299+0000 7f31ddb2f700 1 --2- 172.21.15.26:0/4068799880 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f31d809e410 0x7f31d8134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:26.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.299+0000 7f31dd32e700 1 -- 172.21.15.26:0/4068799880 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f31d809e410 msgr2=0x7f31d8134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:26.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.299+0000 7f31dd32e700 1 --2- 172.21.15.26:0/4068799880 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f31d809e410 0x7f31d8134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:26.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.299+0000 7f31dd32e700 1 -- 172.21.15.26:0/4068799880 >> v1:172.21.15.26:6789/0 conn(0x7f31d809e000 legacy=0x7f31d81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:26.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.299+0000 7f31dd32e700 1 -- 172.21.15.26:0/4068799880 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d809a500 con 0x7f31d809d6f0 2023-10-01T07:55:26.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.299+0000 7f31ddb2f700 1 --2- 172.21.15.26:0/4068799880 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f31d809e410 0x7f31d8134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:26.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.300+0000 7f31dd32e700 1 --2- 172.21.15.26:0/4068799880 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f31d809d6f0 0x7f31d809dac0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f31d4009950 tx=0x7f31d4009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbcb9119141b1dc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:26.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.300+0000 7f31cffff700 1 -- 172.21.15.26:0/4068799880 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d4004230 con 0x7f31d809d6f0 2023-10-01T07:55:26.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.300+0000 7f31cffff700 1 -- 172.21.15.26:0/4068799880 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d4004390 con 0x7f31d809d6f0 2023-10-01T07:55:26.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.300+0000 7f31cffff700 1 -- 172.21.15.26:0/4068799880 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d40036a0 con 0x7f31d809d6f0 2023-10-01T07:55:26.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.301+0000 7f31df592700 1 -- 172.21.15.26:0/4068799880 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f31d809d6f0 msgr2=0x7f31d809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:26.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.301+0000 7f31df592700 1 --2- 172.21.15.26:0/4068799880 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f31d809d6f0 0x7f31d809dac0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f31d4009950 tx=0x7f31d4009c60 comp rx=0 tx=0).stop 2023-10-01T07:55:26.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.301+0000 7f31df592700 1 -- 172.21.15.26:0/4068799880 shutdown_connections 2023-10-01T07:55:26.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.301+0000 7f31df592700 1 --2- 172.21.15.26:0/4068799880 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f31d809d6f0 0x7f31d809dac0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:26.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.301+0000 7f31df592700 1 --2- 172.21.15.26:0/4068799880 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f31d809e410 0x7f31d8134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:26.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.301+0000 7f31df592700 1 -- 172.21.15.26:0/4068799880 >> 172.21.15.26:0/4068799880 conn(0x7f31d8066f50 msgr2=0x7f31d809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:26.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.301+0000 7f31df592700 1 -- 172.21.15.26:0/4068799880 shutdown_connections 2023-10-01T07:55:26.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.301+0000 7f31df592700 1 -- 172.21.15.26:0/4068799880 wait complete. 2023-10-01T07:55:26.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.303+0000 7f31df592700 1 Processor -- start 2023-10-01T07:55:26.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.303+0000 7f31df592700 1 -- start start 2023-10-01T07:55:26.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.303+0000 7f31df592700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31d809d6f0 0x7f31d81223c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:26.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.304+0000 7f31df592700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f31d809e000 0x7f31d8122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:26.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.304+0000 7f31df592700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f31d809e410 0x7f31d8122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:26.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.304+0000 7f31df592700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d8124ee0 con 0x7f31d809d6f0 2023-10-01T07:55:26.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.304+0000 7f31df592700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d8123820 con 0x7f31d809e000 2023-10-01T07:55:26.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.304+0000 7f31df592700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31d8125940 con 0x7f31d809e410 2023-10-01T07:55:26.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.304+0000 7f31dd32e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31d809d6f0 0x7f31d81223c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:26.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.304+0000 7f31dd32e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31d809d6f0 0x7f31d81223c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40832/0 (socket says 172.21.15.26:40832) 2023-10-01T07:55:26.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.304+0000 7f31dd32e700 1 -- 172.21.15.26:0/2981625860 learned_addr learned my addr 172.21.15.26:0/2981625860 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:26.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.304+0000 7f31dcb2d700 1 --2- 172.21.15.26:0/2981625860 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f31d809e000 0x7f31d8122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:26.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.304+0000 7f31ddb2f700 1 --2- 172.21.15.26:0/2981625860 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f31d809e410 0x7f31d8122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:26.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.304+0000 7f31dd32e700 1 -- 172.21.15.26:0/2981625860 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f31d809e410 msgr2=0x7f31d8122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:26.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.304+0000 7f31dd32e700 1 --2- 172.21.15.26:0/2981625860 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f31d809e410 0x7f31d8122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:26.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.304+0000 7f31dd32e700 1 -- 172.21.15.26:0/2981625860 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f31d809e000 msgr2=0x7f31d8122900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:26.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.304+0000 7f31dd32e700 1 --2- 172.21.15.26:0/2981625860 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f31d809e000 0x7f31d8122900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:26.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.304+0000 7f31dd32e700 1 -- 172.21.15.26:0/2981625860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d0009a70 con 0x7f31d809d6f0 2023-10-01T07:55:26.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.305+0000 7f31dd32e700 1 --2- 172.21.15.26:0/2981625860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31d809d6f0 0x7f31d81223c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f31d4004000 tx=0x7f31d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:26.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.305+0000 7f31cdffb700 1 -- 172.21.15.26:0/2981625860 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d4003d60 con 0x7f31d809d6f0 2023-10-01T07:55:26.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.305+0000 7f31cdffb700 1 -- 172.21.15.26:0/2981625860 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d4011630 con 0x7f31d809d6f0 2023-10-01T07:55:26.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.305+0000 7f31cdffb700 1 -- 172.21.15.26:0/2981625860 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d40119e0 con 0x7f31d809d6f0 2023-10-01T07:55:26.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.305+0000 7f31df592700 1 -- 172.21.15.26:0/2981625860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d4009550 con 0x7f31d809d6f0 2023-10-01T07:55:26.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.305+0000 7f31df592700 1 -- 172.21.15.26:0/2981625860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d809c710 con 0x7f31d809d6f0 2023-10-01T07:55:26.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.306+0000 7f31cdffb700 1 -- 172.21.15.26:0/2981625860 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f31d4021070 con 0x7f31d809d6f0 2023-10-01T07:55:26.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.306+0000 7f31df592700 1 -- 172.21.15.26:0/2981625860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31d811f030 con 0x7f31d809d6f0 2023-10-01T07:55:26.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.307+0000 7f31cdffb700 1 -- 172.21.15.26:0/2981625860 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f31d4040e20 con 0x7f31d809d6f0 2023-10-01T07:55:26.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.316+0000 7f31cdffb700 1 -- 172.21.15.26:0/2981625860 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f31d4010380 con 0x7f31d809d6f0 2023-10-01T07:55:26.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.332+0000 7fa7fd83c700 1 Processor -- start 2023-10-01T07:55:26.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.332+0000 7fa7fd83c700 1 -- start start 2023-10-01T07:55:26.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.333+0000 7fa7fd83c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa7f806e570 0x7fa7f806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:26.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.333+0000 7fa7fd83c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7f806ee80 0x7fa7f8134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:26.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.333+0000 7fa7fd83c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f8070ee0 con 0x7fa7f809eca0 2023-10-01T07:55:26.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.333+0000 7fa7fd83c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7f8071480 con 0x7fa7f806e570 2023-10-01T07:55:26.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.333+0000 7fa7fd83c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f8071b90 con 0x7fa7f806ee80 2023-10-01T07:55:26.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.333+0000 7fa7f77fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7f806ee80 0x7fa7f8134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:26.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.333+0000 7fa7f6ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa7f806e570 0x7fa7f806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:26.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.333+0000 7fa7f77fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7f806ee80 0x7fa7f8134d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59390/0 (socket says 172.21.15.26:59390) 2023-10-01T07:55:26.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.333+0000 7fa7f77fe700 1 -- 172.21.15.26:0/2073135093 learned_addr learned my addr 172.21.15.26:0/2073135093 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:26.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.333+0000 7f5873026700 1 Processor -- start 2023-10-01T07:55:26.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.333+0000 7f5873026700 1 -- start start 2023-10-01T07:55:26.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.333+0000 7fa7f6ffd700 1 -- 172.21.15.26:0/2073135093 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7f806ee80 msgr2=0x7fa7f8134d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:26.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.333+0000 7fa7f6ffd700 1 --2- 172.21.15.26:0/2073135093 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7f806ee80 0x7fa7f8134d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:26.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.334+0000 7f5873026700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f586c09e1d0 0x7f586c135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:26.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.334+0000 7f5873026700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f586c135e50 0x7f586c138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:26.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.334+0000 7f5873026700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f586c09f130 con 0x7f586c09d6f0 2023-10-01T07:55:26.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.334+0000 7f5873026700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f586c09f520 con 0x7f586c09e1d0 2023-10-01T07:55:26.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.334+0000 7f5873026700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f586c09e930 con 0x7f586c135e50 2023-10-01T07:55:26.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.334+0000 7f5870dc2700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f586c09d6f0 0x7f586c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38540/0 (socket says 172.21.15.26:38540) 2023-10-01T07:55:26.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.334+0000 7f5870dc2700 1 -- 172.21.15.26:0/2903476030 learned_addr learned my addr 172.21.15.26:0/2903476030 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:26.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.334+0000 7f586bfff700 1 --2- 172.21.15.26:0/2903476030 >> v2:172.21.15.26:3300/0 conn(0x7f586c09e1d0 0x7f586c135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:26.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.335+0000 7f58715c3700 1 --2- 172.21.15.26:0/2903476030 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f586c135e50 0x7f586c138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:26.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.335+0000 7f586b7fe700 1 -- 172.21.15.26:0/2903476030 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1274467055 0 0) 0x7f586c09f130 con 0x7f586c09d6f0 2023-10-01T07:55:26.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.335+0000 7f586b7fe700 1 -- 172.21.15.26:0/2903476030 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58540079c0 con 0x7f586c09d6f0 2023-10-01T07:55:26.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.335+0000 7f586bfff700 1 -- 172.21.15.26:0/2903476030 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f586c135e50 msgr2=0x7f586c138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:26.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.335+0000 7f586bfff700 1 --2- 172.21.15.26:0/2903476030 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f586c135e50 0x7f586c138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:26.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.335+0000 7f586bfff700 1 -- 172.21.15.26:0/2903476030 >> v1:172.21.15.26:6789/0 conn(0x7f586c09d6f0 legacy=0x7f586c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:26.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.335+0000 7f586bfff700 1 -- 172.21.15.26:0/2903476030 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f586c09b2d0 con 0x7f586c09e1d0 2023-10-01T07:55:26.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.335+0000 7fa7f6ffd700 1 -- 172.21.15.26:0/2073135093 >> v1:172.21.15.26:6789/0 conn(0x7fa7f809eca0 legacy=0x7fa7f8134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:26.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.335+0000 7fa7f6ffd700 1 -- 172.21.15.26:0/2073135093 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f80711a0 con 0x7fa7f806e570 2023-10-01T07:55:26.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.335+0000 7f58715c3700 1 --2- 172.21.15.26:0/2903476030 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f586c135e50 0x7f586c138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:55:26.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.335+0000 7f586bfff700 1 --2- 172.21.15.26:0/2903476030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f586c09e1d0 0x7f586c135910 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f585c009840 tx=0x7f585c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8bea56cb5c60753 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:26.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.335+0000 7f586b7fe700 1 -- 172.21.15.26:0/2903476030 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c011830 con 0x7f586c09e1d0 2023-10-01T07:55:26.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.336+0000 7fa7f6ffd700 1 --2- 172.21.15.26:0/2073135093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f806e570 0x7fa7f806e940 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8009840 tx=0x7fa7e8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a332f2ca3efa40fb server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:26.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.336+0000 7f586b7fe700 1 -- 172.21.15.26:0/2903476030 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585c011990 con 0x7f586c09e1d0 2023-10-01T07:55:26.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.336+0000 7f586b7fe700 1 -- 172.21.15.26:0/2903476030 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c011d20 con 0x7f586c09e1d0 2023-10-01T07:55:26.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.336+0000 7fa7f5ffb700 1 -- 172.21.15.26:0/2073135093 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e8004230 con 0x7fa7f806e570 2023-10-01T07:55:26.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.336+0000 7fa7f5ffb700 1 -- 172.21.15.26:0/2073135093 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e8004390 con 0x7fa7f806e570 2023-10-01T07:55:26.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.336+0000 7fa7f5ffb700 1 -- 172.21.15.26:0/2073135093 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e80036a0 con 0x7fa7f806e570 2023-10-01T07:55:26.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.336+0000 7f5873026700 1 -- 172.21.15.26:0/2903476030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f586c09e1d0 msgr2=0x7f586c135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:26.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.336+0000 7f5873026700 1 --2- 172.21.15.26:0/2903476030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f586c09e1d0 0x7f586c135910 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f585c009840 tx=0x7f585c009b50 comp rx=0 tx=0).stop 2023-10-01T07:55:26.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.336+0000 7f5873026700 1 -- 172.21.15.26:0/2903476030 shutdown_connections 2023-10-01T07:55:26.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.336+0000 7f5873026700 1 --2- 172.21.15.26:0/2903476030 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f586c135e50 0x7f586c138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:26.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.336+0000 7f5873026700 1 --2- 172.21.15.26:0/2903476030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f586c09e1d0 0x7f586c135910 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:26.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.336+0000 7f5873026700 1 -- 172.21.15.26:0/2903476030 >> 172.21.15.26:0/2903476030 conn(0x7f586c066f50 msgr2=0x7f586c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:26.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.337+0000 7fa7fd83c700 1 -- 172.21.15.26:0/2073135093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f806e570 msgr2=0x7fa7f806e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:26.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.337+0000 7fa7fd83c700 1 --2- 172.21.15.26:0/2073135093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f806e570 0x7fa7f806e940 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8009840 tx=0x7fa7e8009b50 comp rx=0 tx=0).stop 2023-10-01T07:55:26.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.337+0000 7fa7fd83c700 1 -- 172.21.15.26:0/2073135093 shutdown_connections 2023-10-01T07:55:26.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.337+0000 7fa7fd83c700 1 --2- 172.21.15.26:0/2073135093 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7f806ee80 0x7fa7f8134d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:26.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.337+0000 7fa7fd83c700 1 --2- 172.21.15.26:0/2073135093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f806e570 0x7fa7f806e940 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:26.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.337+0000 7fa7fd83c700 1 -- 172.21.15.26:0/2073135093 >> 172.21.15.26:0/2073135093 conn(0x7fa7f80a2aa0 msgr2=0x7fa7f80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:26.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.337+0000 7fa7fd83c700 1 -- 172.21.15.26:0/2073135093 shutdown_connections 2023-10-01T07:55:26.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.337+0000 7fa7fd83c700 1 -- 172.21.15.26:0/2073135093 wait complete. 2023-10-01T07:55:26.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.338+0000 7fa7fd83c700 1 Processor -- start 2023-10-01T07:55:26.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.338+0000 7fa7fd83c700 1 -- start start 2023-10-01T07:55:26.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.339+0000 7fa7fd83c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7f806e570 0x7fa7f81231a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:26.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.339+0000 7fa7fd83c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7f806ee80 0x7fa7f81236e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:26.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.339+0000 7fa7fd83c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f8123c20 0x7fa7f81cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:26.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.339+0000 7fa7fd83c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f81266d0 con 0x7fa7f8123c20 2023-10-01T07:55:26.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.339+0000 7fa7fd83c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f8126a70 con 0x7fa7f806e570 2023-10-01T07:55:26.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.339+0000 7fa7fd83c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f8124600 con 0x7fa7f806ee80 2023-10-01T07:55:26.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.339+0000 7f5873026700 1 -- 172.21.15.26:0/2903476030 shutdown_connections 2023-10-01T07:55:26.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.339+0000 7f5873026700 1 -- 172.21.15.26:0/2903476030 wait complete. 2023-10-01T07:55:26.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.339+0000 7fa7f6ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7f806e570 0x7fa7f81231a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:26.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.339+0000 7fa7f6ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7f806e570 0x7fa7f81231a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:53454/0 (socket says 172.21.15.26:53454) 2023-10-01T07:55:26.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.339+0000 7fa7f67fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7f806ee80 0x7fa7f81236e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:26.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.339+0000 7fa7f6ffd700 1 -- 172.21.15.26:0/2878748738 learned_addr learned my addr 172.21.15.26:0/2878748738 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:26.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.339+0000 7fa7f77fe700 1 --2- 172.21.15.26:0/2878748738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f8123c20 0x7fa7f81cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:26.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.339+0000 7fa7f67fc700 1 -- 172.21.15.26:0/2878748738 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7f806e570 msgr2=0x7fa7f81231a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:26.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.339+0000 7fa7f67fc700 1 --2- 172.21.15.26:0/2878748738 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7f806e570 0x7fa7f81231a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:26.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.339+0000 7fa7f67fc700 1 -- 172.21.15.26:0/2878748738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f8123c20 msgr2=0x7fa7f81cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:26.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.339+0000 7fa7f67fc700 1 --2- 172.21.15.26:0/2878748738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f8123c20 0x7fa7f81cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:26.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.339+0000 7fa7f67fc700 1 -- 172.21.15.26:0/2878748738 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e80094a0 con 0x7fa7f806ee80 2023-10-01T07:55:26.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.339+0000 7fa7f67fc700 1 --2- 172.21.15.26:0/2878748738 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7f806ee80 0x7fa7f81236e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa7f80a35d0 tx=0x7fa7ec00ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:26.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.340+0000 7fa7dffff700 1 -- 172.21.15.26:0/2878748738 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec0054e0 con 0x7fa7f806ee80 2023-10-01T07:55:26.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.340+0000 7fa7fd83c700 1 -- 172.21.15.26:0/2878748738 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f8126c70 con 0x7fa7f806ee80 2023-10-01T07:55:26.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.340+0000 7fa7fd83c700 1 -- 172.21.15.26:0/2878748738 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f8070610 con 0x7fa7f806ee80 2023-10-01T07:55:26.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.340+0000 7f5873026700 1 Processor -- start 2023-10-01T07:55:26.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.340+0000 7f5873026700 1 -- start start 2023-10-01T07:55:26.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.341+0000 7f5873026700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f586c09d6f0 0x7f586c119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:26.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.341+0000 7f5873026700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f586c09e1d0 0x7f586c1199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:26.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.341+0000 7f5873026700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f586c135e50 0x7f586c119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:26.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.341+0000 7f5873026700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586c11cc20 con 0x7f586c135e50 2023-10-01T07:55:26.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.341+0000 7f5873026700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f586c11af10 con 0x7f586c09e1d0 2023-10-01T07:55:26.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.341+0000 7f5873026700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f586c072670 con 0x7f586c09d6f0 2023-10-01T07:55:26.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.342+0000 7f5870dc2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f586c09d6f0 0x7f586c119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:26.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.342+0000 7f5870dc2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f586c09d6f0 0x7f586c119480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59418/0 (socket says 172.21.15.26:59418) 2023-10-01T07:55:26.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.342+0000 7f5870dc2700 1 -- 172.21.15.26:0/3864667694 learned_addr learned my addr 172.21.15.26:0/3864667694 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:26.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.341+0000 7fa7dffff700 1 -- 172.21.15.26:0/2878748738 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7ec006840 con 0x7fa7f806ee80 2023-10-01T07:55:26.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.341+0000 7fa7dffff700 1 -- 172.21.15.26:0/2878748738 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec006bd0 con 0x7fa7f806ee80 2023-10-01T07:55:26.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.342+0000 7fa7fd83c700 1 -- 172.21.15.26:0/2878748738 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d80052e0 con 0x7fa7f806ee80 2023-10-01T07:55:26.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.342+0000 7fa7dffff700 1 -- 172.21.15.26:0/2878748738 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa7ec007030 con 0x7fa7f806ee80 2023-10-01T07:55:26.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.342+0000 7f586bfff700 1 --2- 172.21.15.26:0/3864667694 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f586c09e1d0 0x7f586c1199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:26.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.342+0000 7f5870dc2700 1 -- 172.21.15.26:0/3864667694 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f586c09e1d0 msgr2=0x7f586c1199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:26.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.342+0000 7f5870dc2700 1 --2- 172.21.15.26:0/3864667694 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f586c09e1d0 0x7f586c1199c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:26.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.342+0000 7f5870dc2700 1 -- 172.21.15.26:0/3864667694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f586c135e50 msgr2=0x7f586c119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:26.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.342+0000 7f5870dc2700 1 --2- 172.21.15.26:0/3864667694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f586c135e50 0x7f586c119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:26.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.342+0000 7fa7dffff700 1 -- 172.21.15.26:0/2878748738 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa7ec03f100 con 0x7fa7f806ee80 2023-10-01T07:55:26.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.342+0000 7f5870dc2700 1 -- 172.21.15.26:0/3864667694 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585c0094a0 con 0x7f586c09d6f0 2023-10-01T07:55:26.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.344+0000 7f5870dc2700 1 --2- 172.21.15.26:0/3864667694 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f586c09d6f0 0x7f586c119480 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f586400cbf0 tx=0x7f58640021c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:26.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.347+0000 7f58697fa700 1 -- 172.21.15.26:0/3864667694 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586400ab40 con 0x7f586c09d6f0 2023-10-01T07:55:26.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.347+0000 7f58697fa700 1 -- 172.21.15.26:0/3864667694 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586400aca0 con 0x7f586c09d6f0 2023-10-01T07:55:26.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.347+0000 7f58697fa700 1 -- 172.21.15.26:0/3864667694 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5864012620 con 0x7f586c09d6f0 2023-10-01T07:55:26.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.347+0000 7f5873026700 1 -- 172.21.15.26:0/3864667694 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f586c09c700 con 0x7f586c09d6f0 2023-10-01T07:55:26.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.347+0000 7f5873026700 1 -- 172.21.15.26:0/3864667694 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f586c130120 con 0x7f586c09d6f0 2023-10-01T07:55:26.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.347+0000 7fa7dffff700 1 -- 172.21.15.26:0/2878748738 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa7ec0012b0 con 0x7fa7f806ee80 2023-10-01T07:55:26.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.348+0000 7f58697fa700 1 -- 172.21.15.26:0/3864667694 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f586401b3b0 con 0x7f586c09d6f0 2023-10-01T07:55:26.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.348+0000 7f5873026700 1 -- 172.21.15.26:0/3864667694 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f586c11d670 con 0x7f586c09d6f0 2023-10-01T07:55:26.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.348+0000 7f58697fa700 1 -- 172.21.15.26:0/3864667694 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f586403f6b0 con 0x7f586c09d6f0 2023-10-01T07:55:26.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.358+0000 7f58697fa700 1 -- 172.21.15.26:0/3864667694 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f58640192c0 con 0x7f586c09d6f0 2023-10-01T07:55:26.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.490+0000 7fae0b32d700 1 -- 172.21.15.26:0/191799700 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fae041a6ea0 con 0x7fae0409e410 2023-10-01T07:55:26.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.491+0000 7fadf9ffb700 1 -- 172.21.15.26:0/191799700 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fadfc046020 con 0x7fae0409e410 2023-10-01T07:55:26.491 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.493+0000 7fae0b32d700 1 -- 172.21.15.26:0/191799700 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae0409e410 msgr2=0x7fae041a40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.493+0000 7fae0b32d700 1 --2- 172.21.15.26:0/191799700 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae0409e410 0x7fae041a40c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00b680 tx=0x7fadfc004ad0 comp rx=0 tx=0).stop 2023-10-01T07:55:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.493+0000 7fae0b32d700 1 -- 172.21.15.26:0/191799700 shutdown_connections 2023-10-01T07:55:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.493+0000 7fae0b32d700 1 --2- 172.21.15.26:0/191799700 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae0409e410 0x7fae041a40c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.493+0000 7fae0b32d700 1 --2- 172.21.15.26:0/191799700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae0409d6f0 0x7fae041a3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.493+0000 7fae0b32d700 1 --2- 172.21.15.26:0/191799700 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae0409e000 0x7fae041a3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:26.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.493+0000 7fae0b32d700 1 -- 172.21.15.26:0/191799700 >> 172.21.15.26:0/191799700 conn(0x7fae04066f50 msgr2=0x7fae0406f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:26.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.493+0000 7fae0b32d700 1 -- 172.21.15.26:0/191799700 shutdown_connections 2023-10-01T07:55:26.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.493+0000 7fae0b32d700 1 -- 172.21.15.26:0/191799700 wait complete. 2023-10-01T07:55:26.508 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:26.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.532+0000 7f31df592700 1 -- 172.21.15.26:0/2981625860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f31d8126730 con 0x7f31d809d6f0 2023-10-01T07:55:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.532+0000 7f31cdffb700 1 -- 172.21.15.26:0/2981625860 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f31d4029030 con 0x7f31d809d6f0 2023-10-01T07:55:26.533 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:26.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.534+0000 7f31df592700 1 -- 172.21.15.26:0/2981625860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31d809d6f0 msgr2=0x7f31d81223c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:26.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.534+0000 7f31df592700 1 --2- 172.21.15.26:0/2981625860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31d809d6f0 0x7f31d81223c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f31d4004000 tx=0x7f31d4004750 comp rx=0 tx=0).stop 2023-10-01T07:55:26.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.535+0000 7f31df592700 1 -- 172.21.15.26:0/2981625860 shutdown_connections 2023-10-01T07:55:26.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.535+0000 7f31df592700 1 --2- 172.21.15.26:0/2981625860 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f31d809e410 0x7f31d8122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:26.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.535+0000 7f31df592700 1 --2- 172.21.15.26:0/2981625860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31d809d6f0 0x7f31d81223c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:26.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.535+0000 7f31df592700 1 --2- 172.21.15.26:0/2981625860 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f31d809e000 0x7f31d8122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:26.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.535+0000 7f31df592700 1 -- 172.21.15.26:0/2981625860 >> 172.21.15.26:0/2981625860 conn(0x7f31d8066f50 msgr2=0x7f31d8133f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:26.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.535+0000 7f31df592700 1 -- 172.21.15.26:0/2981625860 shutdown_connections 2023-10-01T07:55:26.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.535+0000 7f31df592700 1 -- 172.21.15.26:0/2981625860 wait complete. 2023-10-01T07:55:26.550 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:26.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.574+0000 7fa7fd83c700 1 -- 172.21.15.26:0/2878748738 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa7d8005590 con 0x7fa7f806ee80 2023-10-01T07:55:26.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.574+0000 7fa7dffff700 1 -- 172.21.15.26:0/2878748738 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa7ec01b810 con 0x7fa7f806ee80 2023-10-01T07:55:26.576 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:26.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.577+0000 7fa7fd83c700 1 -- 172.21.15.26:0/2878748738 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7f806ee80 msgr2=0x7fa7f81236e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:26.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.577+0000 7fa7fd83c700 1 --2- 172.21.15.26:0/2878748738 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7f806ee80 0x7fa7f81236e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa7f80a35d0 tx=0x7fa7ec00ca30 comp rx=0 tx=0).stop 2023-10-01T07:55:26.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.577+0000 7fa7fd83c700 1 -- 172.21.15.26:0/2878748738 shutdown_connections 2023-10-01T07:55:26.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.577+0000 7fa7fd83c700 1 --2- 172.21.15.26:0/2878748738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f8123c20 0x7fa7f81cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:26.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.577+0000 7fa7fd83c700 1 --2- 172.21.15.26:0/2878748738 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7f806e570 0x7fa7f81231a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:26.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.577+0000 7fa7fd83c700 1 --2- 172.21.15.26:0/2878748738 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7f806ee80 0x7fa7f81236e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:26.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.577+0000 7fa7fd83c700 1 -- 172.21.15.26:0/2878748738 >> 172.21.15.26:0/2878748738 conn(0x7fa7f80a2aa0 msgr2=0x7fa7f80a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:26.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.577+0000 7fa7fd83c700 1 -- 172.21.15.26:0/2878748738 shutdown_connections 2023-10-01T07:55:26.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.577+0000 7fa7fd83c700 1 -- 172.21.15.26:0/2878748738 wait complete. 2023-10-01T07:55:26.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.581+0000 7f5873026700 1 -- 172.21.15.26:0/3864667694 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f586c074ea0 con 0x7f586c09d6f0 2023-10-01T07:55:26.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.582+0000 7f58697fa700 1 -- 172.21.15.26:0/3864667694 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5864017020 con 0x7f586c09d6f0 2023-10-01T07:55:26.582 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:26.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.586+0000 7f5873026700 1 -- 172.21.15.26:0/3864667694 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f586c09d6f0 msgr2=0x7f586c119480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:26.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.586+0000 7f5873026700 1 --2- 172.21.15.26:0/3864667694 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f586c09d6f0 0x7f586c119480 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f586400cbf0 tx=0x7f58640021c0 comp rx=0 tx=0).stop 2023-10-01T07:55:26.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.586+0000 7f5873026700 1 -- 172.21.15.26:0/3864667694 shutdown_connections 2023-10-01T07:55:26.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.586+0000 7f5873026700 1 --2- 172.21.15.26:0/3864667694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f586c135e50 0x7f586c119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:26.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.586+0000 7f5873026700 1 --2- 172.21.15.26:0/3864667694 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f586c09d6f0 0x7f586c119480 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:26.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.586+0000 7f5873026700 1 --2- 172.21.15.26:0/3864667694 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f586c09e1d0 0x7f586c1199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:26.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.586+0000 7f5873026700 1 -- 172.21.15.26:0/3864667694 >> 172.21.15.26:0/3864667694 conn(0x7f586c066f50 msgr2=0x7f586c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:26.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.586+0000 7f5873026700 1 -- 172.21.15.26:0/3864667694 shutdown_connections 2023-10-01T07:55:26.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:26.586+0000 7f5873026700 1 -- 172.21.15.26:0/3864667694 wait complete. 2023-10-01T07:55:26.593 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:26.601 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:27.509 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:27.551 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:27.594 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:27.602 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:27.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.670+0000 7fe7a414d700 1 Processor -- start 2023-10-01T07:55:27.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.670+0000 7fe7a414d700 1 -- start start 2023-10-01T07:55:27.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.670+0000 7fe7a414d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe79c06e570 0x7fe79c06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:27.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.670+0000 7fe7a414d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe79c09eca0 0x7fe79c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:27.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.670+0000 7fe7a414d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe79c134610 0x7fe79c134a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:27.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.670+0000 7fe7a414d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe79c070ee0 con 0x7fe79c06e570 2023-10-01T07:55:27.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.670+0000 7fe7a414d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c071480 con 0x7fe79c134610 2023-10-01T07:55:27.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.671+0000 7fe7a414d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c06f3c0 con 0x7fe79c09eca0 2023-10-01T07:55:27.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.671+0000 7fe7a26ea700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe79c134610 0x7fe79c134a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:27.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.671+0000 7fe7a26ea700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe79c134610 0x7fe79c134a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:53472/0 (socket says 172.21.15.26:53472) 2023-10-01T07:55:27.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.671+0000 7fe7a26ea700 1 -- 172.21.15.26:0/2640184969 learned_addr learned my addr 172.21.15.26:0/2640184969 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:27.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.671+0000 7fe7a1ee9700 1 --2- 172.21.15.26:0/2640184969 >> v2:172.21.15.26:3300/0 conn(0x7fe79c06e570 0x7fe79c06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:27.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.671+0000 7fe7a16e8700 1 --2- 172.21.15.26:0/2640184969 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe79c09eca0 0x7fe79c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:27.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.671+0000 7fe7a1ee9700 1 -- 172.21.15.26:0/2640184969 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe79c09eca0 msgr2=0x7fe79c06ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:27.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.671+0000 7fe7a1ee9700 1 --2- 172.21.15.26:0/2640184969 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe79c09eca0 0x7fe79c06ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.671+0000 7fe7a1ee9700 1 -- 172.21.15.26:0/2640184969 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe79c134610 msgr2=0x7fe79c134a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:27.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.671+0000 7fe7a1ee9700 1 --2- 172.21.15.26:0/2640184969 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe79c134610 0x7fe79c134a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.671+0000 7fe7a1ee9700 1 -- 172.21.15.26:0/2640184969 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79c071b90 con 0x7fe79c06e570 2023-10-01T07:55:27.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.671+0000 7fe7a1ee9700 1 --2- 172.21.15.26:0/2640184969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe79c06e570 0x7fe79c06e940 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe798009840 tx=0x7fe798009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7276554fa4188d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:27.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.672+0000 7fe7a0ee7700 1 -- 172.21.15.26:0/2640184969 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe798011830 con 0x7fe79c06e570 2023-10-01T07:55:27.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.672+0000 7fe7a0ee7700 1 -- 172.21.15.26:0/2640184969 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe798011990 con 0x7fe79c06e570 2023-10-01T07:55:27.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.672+0000 7fe7a0ee7700 1 -- 172.21.15.26:0/2640184969 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe798011d20 con 0x7fe79c06e570 2023-10-01T07:55:27.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.672+0000 7fe7a414d700 1 -- 172.21.15.26:0/2640184969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe79c06e570 msgr2=0x7fe79c06e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:27.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.672+0000 7fe7a414d700 1 --2- 172.21.15.26:0/2640184969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe79c06e570 0x7fe79c06e940 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe798009840 tx=0x7fe798009b50 comp rx=0 tx=0).stop 2023-10-01T07:55:27.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.673+0000 7fe7a414d700 1 -- 172.21.15.26:0/2640184969 shutdown_connections 2023-10-01T07:55:27.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.673+0000 7fe7a414d700 1 --2- 172.21.15.26:0/2640184969 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe79c134610 0x7fe79c134a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.673+0000 7fe7a414d700 1 --2- 172.21.15.26:0/2640184969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe79c06e570 0x7fe79c06e940 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.673+0000 7fe7a414d700 1 --2- 172.21.15.26:0/2640184969 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe79c09eca0 0x7fe79c06ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.673+0000 7fe7a414d700 1 -- 172.21.15.26:0/2640184969 >> 172.21.15.26:0/2640184969 conn(0x7fe79c0a2aa0 msgr2=0x7fe79c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:27.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.673+0000 7fe7a414d700 1 -- 172.21.15.26:0/2640184969 shutdown_connections 2023-10-01T07:55:27.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.673+0000 7fe7a414d700 1 -- 172.21.15.26:0/2640184969 wait complete. 2023-10-01T07:55:27.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.675+0000 7fe7a414d700 1 Processor -- start 2023-10-01T07:55:27.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.675+0000 7fe7a414d700 1 -- start start 2023-10-01T07:55:27.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.675+0000 7fe7a414d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe79c06e570 0x7fe79c1274a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:27.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.675+0000 7fe7a414d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe79c134610 0x7fe79c125ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:27.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.675+0000 7fe7a414d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe79c1279e0 0x7fe79c1263e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:27.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.675+0000 7fe7a414d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c13d650 con 0x7fe79c134610 2023-10-01T07:55:27.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.675+0000 7fe7a414d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c13bc00 con 0x7fe79c1279e0 2023-10-01T07:55:27.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.675+0000 7fe7a414d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c0a1fa0 con 0x7fe79c06e570 2023-10-01T07:55:27.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.676+0000 7fe7a26ea700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe79c1279e0 0x7fe79c1263e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:27.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.676+0000 7fe7a16e8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe79c134610 0x7fe79c125ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:27.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.676+0000 7fe7a16e8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe79c134610 0x7fe79c125ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40866/0 (socket says 172.21.15.26:40866) 2023-10-01T07:55:27.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.676+0000 7fe7a26ea700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe79c1279e0 0x7fe79c1263e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:53480/0 (socket says 172.21.15.26:53480) 2023-10-01T07:55:27.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.676+0000 7fe7a16e8700 1 -- 172.21.15.26:0/3911961398 learned_addr learned my addr 172.21.15.26:0/3911961398 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:27.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.676+0000 7fe7a1ee9700 1 --2- 172.21.15.26:0/3911961398 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe79c06e570 0x7fe79c1274a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:27.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.676+0000 7fe7a16e8700 1 -- 172.21.15.26:0/3911961398 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe79c06e570 msgr2=0x7fe79c1274a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:27.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.676+0000 7fe7a16e8700 1 --2- 172.21.15.26:0/3911961398 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe79c06e570 0x7fe79c1274a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.676+0000 7fe7a16e8700 1 -- 172.21.15.26:0/3911961398 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe79c1279e0 msgr2=0x7fe79c1263e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:27.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.676+0000 7fe7a16e8700 1 --2- 172.21.15.26:0/3911961398 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe79c1279e0 0x7fe79c1263e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.676+0000 7fe7a16e8700 1 -- 172.21.15.26:0/3911961398 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7980094a0 con 0x7fe79c134610 2023-10-01T07:55:27.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.676+0000 7fe7a16e8700 1 --2- 172.21.15.26:0/3911961398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe79c134610 0x7fe79c125ea0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe78c00e9b0 tx=0x7fe78c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:27.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.677+0000 7fe7927fc700 1 -- 172.21.15.26:0/3911961398 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c009710 con 0x7fe79c134610 2023-10-01T07:55:27.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.677+0000 7fe7927fc700 1 -- 172.21.15.26:0/3911961398 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78c00ee50 con 0x7fe79c134610 2023-10-01T07:55:27.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.677+0000 7fe7a414d700 1 -- 172.21.15.26:0/3911961398 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe79c070610 con 0x7fe79c134610 2023-10-01T07:55:27.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.677+0000 7fe7927fc700 1 -- 172.21.15.26:0/3911961398 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c00ca10 con 0x7fe79c134610 2023-10-01T07:55:27.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.677+0000 7fe7a414d700 1 -- 172.21.15.26:0/3911961398 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe79c13cfa0 con 0x7fe79c134610 2023-10-01T07:55:27.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.678+0000 7fe7927fc700 1 -- 172.21.15.26:0/3911961398 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe78c00cb70 con 0x7fe79c134610 2023-10-01T07:55:27.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.678+0000 7fe7927fc700 1 -- 172.21.15.26:0/3911961398 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe78c03f6c0 con 0x7fe79c134610 2023-10-01T07:55:27.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.679+0000 7fe7a414d700 1 -- 172.21.15.26:0/3911961398 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7840052e0 con 0x7fe79c134610 2023-10-01T07:55:27.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.684+0000 7fe7927fc700 1 -- 172.21.15.26:0/3911961398 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe78c01bdf0 con 0x7fe79c134610 2023-10-01T07:55:27.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.713+0000 7f9d1386f700 1 Processor -- start 2023-10-01T07:55:27.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.714+0000 7f9d1386f700 1 -- start start 2023-10-01T07:55:27.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.714+0000 7f9d1386f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d0c131810 0x7f9d0c131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:27.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.715+0000 7f9d1386f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9d0c099a40 0x7f9d0c099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:27.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.715+0000 7f9d1386f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d0c09a850 con 0x7f9d0c09a3b0 2023-10-01T07:55:27.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.715+0000 7f9d1386f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d0c09b580 con 0x7f9d0c099a40 2023-10-01T07:55:27.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.715+0000 7f9d1386f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c1313c0 con 0x7f9d0c131810 2023-10-01T07:55:27.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.715+0000 7f9d10e0a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9d0c099a40 0x7f9d0c099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:27.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.715+0000 7f9d10e0a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9d0c099a40 0x7f9d0c099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40876/0 (socket says 172.21.15.26:40876) 2023-10-01T07:55:27.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.715+0000 7f9d10e0a700 1 -- 172.21.15.26:0/652137440 learned_addr learned my addr 172.21.15.26:0/652137440 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:27.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.715+0000 7f9d1160b700 1 --2- 172.21.15.26:0/652137440 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d0c131810 0x7f9d0c131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:27.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.715+0000 7f9d10e0a700 1 -- 172.21.15.26:0/652137440 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d0c131810 msgr2=0x7f9d0c131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:27.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.715+0000 7f9d10e0a700 1 --2- 172.21.15.26:0/652137440 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d0c131810 0x7f9d0c131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.715+0000 7f9d10e0a700 1 -- 172.21.15.26:0/652137440 >> v1:172.21.15.26:6789/0 conn(0x7f9d0c09a3b0 legacy=0x7f9d0c138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:27.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.715+0000 7f9d10e0a700 1 -- 172.21.15.26:0/652137440 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0c06e8c0 con 0x7f9d0c099a40 2023-10-01T07:55:27.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.715+0000 7f9d10e0a700 1 --2- 172.21.15.26:0/652137440 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d0c099a40 0x7f9d0c099e70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009920 tx=0x7f9cfc009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=477f3eacc7dbb34c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:27.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.716+0000 7f9d03fff700 1 -- 172.21.15.26:0/652137440 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc011830 con 0x7f9d0c099a40 2023-10-01T07:55:27.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.716+0000 7f9d03fff700 1 -- 172.21.15.26:0/652137440 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cfc011990 con 0x7f9d0c099a40 2023-10-01T07:55:27.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.716+0000 7f9d03fff700 1 -- 172.21.15.26:0/652137440 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc011d20 con 0x7f9d0c099a40 2023-10-01T07:55:27.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.716+0000 7f9d1386f700 1 -- 172.21.15.26:0/652137440 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d0c099a40 msgr2=0x7f9d0c099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:27.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.716+0000 7f9d1386f700 1 --2- 172.21.15.26:0/652137440 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d0c099a40 0x7f9d0c099e70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009920 tx=0x7f9cfc009c30 comp rx=0 tx=0).stop 2023-10-01T07:55:27.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.716+0000 7f9d1386f700 1 -- 172.21.15.26:0/652137440 shutdown_connections 2023-10-01T07:55:27.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.716+0000 7f9d1386f700 1 --2- 172.21.15.26:0/652137440 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d0c131810 0x7f9d0c131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.716+0000 7f9d1386f700 1 --2- 172.21.15.26:0/652137440 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d0c099a40 0x7f9d0c099e70 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.716+0000 7f9d1386f700 1 -- 172.21.15.26:0/652137440 >> 172.21.15.26:0/652137440 conn(0x7f9d0c0a2aa0 msgr2=0x7f9d0c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:27.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.717+0000 7f9d1386f700 1 -- 172.21.15.26:0/652137440 shutdown_connections 2023-10-01T07:55:27.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.717+0000 7f9d1386f700 1 -- 172.21.15.26:0/652137440 wait complete. 2023-10-01T07:55:27.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.718+0000 7f9d1386f700 1 Processor -- start 2023-10-01T07:55:27.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.718+0000 7f9d1386f700 1 -- start start 2023-10-01T07:55:27.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.718+0000 7f9d1386f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d0c099a40 0x7f9d0c06f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:27.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.718+0000 7f9d1386f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d0c09a3b0 0x7f9d0c06fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:27.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.718+0000 7f9d1386f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d0c131810 0x7f9d0c070060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:27.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.718+0000 7f9d1386f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c120380 con 0x7f9d0c131810 2023-10-01T07:55:27.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.718+0000 7f9d1386f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c1213e0 con 0x7f9d0c09a3b0 2023-10-01T07:55:27.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.718+0000 7f9d1386f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c12ec90 con 0x7f9d0c099a40 2023-10-01T07:55:27.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.718+0000 7f9d10e0a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d0c09a3b0 0x7f9d0c06fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:27.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.718+0000 7f9d10e0a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d0c09a3b0 0x7f9d0c06fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:53482/0 (socket says 172.21.15.26:53482) 2023-10-01T07:55:27.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.718+0000 7f9d10e0a700 1 -- 172.21.15.26:0/332829059 learned_addr learned my addr 172.21.15.26:0/332829059 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:27.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.719+0000 7f9d11e0c700 1 --2- 172.21.15.26:0/332829059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d0c131810 0x7f9d0c070060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:27.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.719+0000 7f9d1160b700 1 --2- 172.21.15.26:0/332829059 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d0c099a40 0x7f9d0c06f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:27.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.719+0000 7f9d11e0c700 1 -- 172.21.15.26:0/332829059 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d0c099a40 msgr2=0x7f9d0c06f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:27.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.719+0000 7f9d11e0c700 1 --2- 172.21.15.26:0/332829059 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d0c099a40 0x7f9d0c06f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.719+0000 7f9d11e0c700 1 -- 172.21.15.26:0/332829059 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d0c09a3b0 msgr2=0x7f9d0c06fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:27.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.719+0000 7f9d11e0c700 1 --2- 172.21.15.26:0/332829059 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d0c09a3b0 0x7f9d0c06fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.719+0000 7f9d11e0c700 1 -- 172.21.15.26:0/332829059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cfc009550 con 0x7f9d0c131810 2023-10-01T07:55:27.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.719+0000 7f9d1160b700 1 --2- 172.21.15.26:0/332829059 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d0c099a40 0x7f9d0c06f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:55:27.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.719+0000 7f9d10e0a700 1 --2- 172.21.15.26:0/332829059 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d0c09a3b0 0x7f9d0c06fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:27.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.719+0000 7f9d11e0c700 1 --2- 172.21.15.26:0/332829059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d0c131810 0x7f9d0c070060 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9d0400cb90 tx=0x7f9d0400cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:27.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.719+0000 7f9d01ffb700 1 -- 172.21.15.26:0/332829059 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d04003c00 con 0x7f9d0c131810 2023-10-01T07:55:27.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.720+0000 7f9d01ffb700 1 -- 172.21.15.26:0/332829059 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d04003d60 con 0x7f9d0c131810 2023-10-01T07:55:27.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.720+0000 7f9d01ffb700 1 -- 172.21.15.26:0/332829059 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0400aaa0 con 0x7f9d0c131810 2023-10-01T07:55:27.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.720+0000 7f9d1386f700 1 -- 172.21.15.26:0/332829059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d0c0a1c40 con 0x7f9d0c131810 2023-10-01T07:55:27.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.720+0000 7f9d1386f700 1 -- 172.21.15.26:0/332829059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d0c06eb60 con 0x7f9d0c131810 2023-10-01T07:55:27.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.721+0000 7f9d01ffb700 1 -- 172.21.15.26:0/332829059 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d0400ac00 con 0x7f9d0c131810 2023-10-01T07:55:27.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.722+0000 7f9d01ffb700 1 -- 172.21.15.26:0/332829059 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9d04011540 con 0x7f9d0c131810 2023-10-01T07:55:27.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.722+0000 7f9d1386f700 1 -- 172.21.15.26:0/332829059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d0c074ea0 con 0x7f9d0c131810 2023-10-01T07:55:27.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.731+0000 7f9d01ffb700 1 -- 172.21.15.26:0/332829059 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d040198f0 con 0x7f9d0c131810 2023-10-01T07:55:27.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.759+0000 7f662f84c700 1 Processor -- start 2023-10-01T07:55:27.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.760+0000 7f662f84c700 1 -- start start 2023-10-01T07:55:27.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.760+0000 7f662f84c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f662809d6f0 0x7f662809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:27.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.760+0000 7f662f84c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f662809e410 0x7f6628134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:27.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.760+0000 7f662f84c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f662809b120 con 0x7f662809e000 2023-10-01T07:55:27.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.760+0000 7f662f84c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f662806b460 con 0x7f662809e410 2023-10-01T07:55:27.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.760+0000 7f662f84c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f662809a7e0 con 0x7f662809d6f0 2023-10-01T07:55:27.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.761+0000 7f662cde7700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f662809e000 0x7f66281339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38570/0 (socket says 172.21.15.26:38570) 2023-10-01T07:55:27.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.761+0000 7f662cde7700 1 -- 172.21.15.26:0/1339182810 learned_addr learned my addr 172.21.15.26:0/1339182810 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:27.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.761+0000 7f662dde9700 1 --2- 172.21.15.26:0/1339182810 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f662809e410 0x7f6628134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:27.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.761+0000 7f662d5e8700 1 --2- 172.21.15.26:0/1339182810 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f662809d6f0 0x7f662809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:27.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.761+0000 7f661ffff700 1 -- 172.21.15.26:0/1339182810 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4189876520 0 0) 0x7f662809b120 con 0x7f662809e000 2023-10-01T07:55:27.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.761+0000 7f661ffff700 1 -- 172.21.15.26:0/1339182810 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66140035b0 con 0x7f662809e000 2023-10-01T07:55:27.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.761+0000 7f662d5e8700 1 -- 172.21.15.26:0/1339182810 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f662809e410 msgr2=0x7f6628134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:27.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.761+0000 7f662d5e8700 1 --2- 172.21.15.26:0/1339182810 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f662809e410 0x7f6628134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.761+0000 7f662d5e8700 1 -- 172.21.15.26:0/1339182810 >> v1:172.21.15.26:6789/0 conn(0x7f662809e000 legacy=0x7f66281339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:27.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.761+0000 7f662d5e8700 1 -- 172.21.15.26:0/1339182810 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f662809a500 con 0x7f662809d6f0 2023-10-01T07:55:27.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.761+0000 7f662d5e8700 1 --2- 172.21.15.26:0/1339182810 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f662809d6f0 0x7f662809dac0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f66240098a0 tx=0x7f6624009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4b03e10cab71863 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:27.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.762+0000 7f661ffff700 1 -- 172.21.15.26:0/1339182810 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6624011830 con 0x7f662809d6f0 2023-10-01T07:55:27.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.762+0000 7f661ffff700 1 -- 172.21.15.26:0/1339182810 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6624011990 con 0x7f662809d6f0 2023-10-01T07:55:27.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.762+0000 7f661ffff700 1 -- 172.21.15.26:0/1339182810 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6624011d20 con 0x7f662809d6f0 2023-10-01T07:55:27.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.763+0000 7f662f84c700 1 -- 172.21.15.26:0/1339182810 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f662809d6f0 msgr2=0x7f662809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:27.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.763+0000 7f662f84c700 1 --2- 172.21.15.26:0/1339182810 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f662809d6f0 0x7f662809dac0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f66240098a0 tx=0x7f6624009bb0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.763+0000 7f662f84c700 1 -- 172.21.15.26:0/1339182810 shutdown_connections 2023-10-01T07:55:27.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.763+0000 7f662f84c700 1 --2- 172.21.15.26:0/1339182810 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f662809d6f0 0x7f662809dac0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.763+0000 7f662f84c700 1 --2- 172.21.15.26:0/1339182810 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f662809e410 0x7f6628134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.763+0000 7f662f84c700 1 -- 172.21.15.26:0/1339182810 >> 172.21.15.26:0/1339182810 conn(0x7f6628066f50 msgr2=0x7f662809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:27.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.763+0000 7f662f84c700 1 -- 172.21.15.26:0/1339182810 shutdown_connections 2023-10-01T07:55:27.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.763+0000 7f662f84c700 1 -- 172.21.15.26:0/1339182810 wait complete. 2023-10-01T07:55:27.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.764+0000 7f662f84c700 1 Processor -- start 2023-10-01T07:55:27.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.764+0000 7f662f84c700 1 -- start start 2023-10-01T07:55:27.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.765+0000 7f662f84c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f662809d6f0 0x7f6628122370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:27.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.765+0000 7f662f84c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f662809e000 0x7f66281228b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:27.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.765+0000 7f662f84c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f662809e410 0x7f6628122df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:27.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.765+0000 7f662f84c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6628125c70 con 0x7f662809e410 2023-10-01T07:55:27.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.765+0000 7f662f84c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6628125e50 con 0x7f662809d6f0 2023-10-01T07:55:27.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.765+0000 7f662f84c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66280a1980 con 0x7f662809e000 2023-10-01T07:55:27.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.765+0000 7f662dde9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f662809e410 0x7f6628122df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:27.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.765+0000 7f662d5e8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f662809d6f0 0x7f6628122370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:27.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.765+0000 7f662dde9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f662809e410 0x7f6628122df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40892/0 (socket says 172.21.15.26:40892) 2023-10-01T07:55:27.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.765+0000 7f662dde9700 1 -- 172.21.15.26:0/154719217 learned_addr learned my addr 172.21.15.26:0/154719217 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:27.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.766+0000 7f662cde7700 1 --2- 172.21.15.26:0/154719217 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f662809e000 0x7f66281228b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:27.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.766+0000 7f662dde9700 1 -- 172.21.15.26:0/154719217 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f662809e000 msgr2=0x7f66281228b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:27.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.766+0000 7f662dde9700 1 --2- 172.21.15.26:0/154719217 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f662809e000 0x7f66281228b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.766+0000 7f662dde9700 1 -- 172.21.15.26:0/154719217 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f662809d6f0 msgr2=0x7f6628122370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:27.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.766+0000 7f662dde9700 1 --2- 172.21.15.26:0/154719217 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f662809d6f0 0x7f6628122370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.766+0000 7f662dde9700 1 -- 172.21.15.26:0/154719217 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66240094a0 con 0x7f662809e410 2023-10-01T07:55:27.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.766+0000 7f662cde7700 1 --2- 172.21.15.26:0/154719217 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f662809e000 0x7f66281228b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:55:27.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.766+0000 7f662dde9700 1 --2- 172.21.15.26:0/154719217 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f662809e410 0x7f6628122df0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f662000efc0 tx=0x7f662000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:27.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.766+0000 7f661dffb700 1 -- 172.21.15.26:0/154719217 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6620009ea0 con 0x7f662809e410 2023-10-01T07:55:27.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.766+0000 7f661dffb700 1 -- 172.21.15.26:0/154719217 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662000f040 con 0x7f662809e410 2023-10-01T07:55:27.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.766+0000 7f662f84c700 1 -- 172.21.15.26:0/154719217 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6628123740 con 0x7f662809e410 2023-10-01T07:55:27.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.766+0000 7f661dffb700 1 -- 172.21.15.26:0/154719217 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6620014480 con 0x7f662809e410 2023-10-01T07:55:27.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.767+0000 7f662f84c700 1 -- 172.21.15.26:0/154719217 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66281337f0 con 0x7f662809e410 2023-10-01T07:55:27.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.768+0000 7f661dffb700 1 -- 172.21.15.26:0/154719217 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f66200145e0 con 0x7f662809e410 2023-10-01T07:55:27.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.769+0000 7f661dffb700 1 -- 172.21.15.26:0/154719217 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f662003feb0 con 0x7f662809e410 2023-10-01T07:55:27.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.769+0000 7f662f84c700 1 -- 172.21.15.26:0/154719217 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6628074ea0 con 0x7f662809e410 2023-10-01T07:55:27.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.778+0000 7f661dffb700 1 -- 172.21.15.26:0/154719217 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6620018020 con 0x7f662809e410 2023-10-01T07:55:27.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.792+0000 7f2388663700 1 Processor -- start 2023-10-01T07:55:27.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.792+0000 7f2388663700 1 -- start start 2023-10-01T07:55:27.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.793+0000 7f2388663700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f238009e930 0x7f238009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:27.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.793+0000 7f2388663700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f238009f240 0x7f23801317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:27.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.793+0000 7f2388663700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f238009f650 0x7f2380131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:27.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.793+0000 7f2388663700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2380070940 con 0x7f238009f240 2023-10-01T07:55:27.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.793+0000 7f2388663700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f238006fd60 con 0x7f238009f650 2023-10-01T07:55:27.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.793+0000 7f2388663700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f238006fa80 con 0x7f238009e930 2023-10-01T07:55:27.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.793+0000 7f2385bfe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f238009f240 0x7f23801317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:27.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.793+0000 7f23863ff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f238009e930 0x7f238009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:27.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.793+0000 7f2386c00700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f238009f650 0x7f2380131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:27.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.793+0000 7f2385bfe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f238009f240 0x7f23801317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40904/0 (socket says 172.21.15.26:40904) 2023-10-01T07:55:27.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.793+0000 7f2385bfe700 1 -- 172.21.15.26:0/2951176180 learned_addr learned my addr 172.21.15.26:0/2951176180 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:27.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.794+0000 7f2385bfe700 1 -- 172.21.15.26:0/2951176180 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f238009e930 msgr2=0x7f238009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:27.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.794+0000 7f2385bfe700 1 --2- 172.21.15.26:0/2951176180 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f238009e930 0x7f238009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.794+0000 7f2385bfe700 1 -- 172.21.15.26:0/2951176180 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f238009f650 msgr2=0x7f2380131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:27.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.794+0000 7f2385bfe700 1 --2- 172.21.15.26:0/2951176180 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f238009f650 0x7f2380131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.794+0000 7f2385bfe700 1 -- 172.21.15.26:0/2951176180 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238009fb60 con 0x7f238009f240 2023-10-01T07:55:27.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.794+0000 7f23863ff700 1 --2- 172.21.15.26:0/2951176180 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f238009e930 0x7f238009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:27.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.794+0000 7f2385bfe700 1 --2- 172.21.15.26:0/2951176180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f238009f240 0x7f23801317f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f237000dd10 tx=0x7f237000f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb65976227d8fdfb server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:27.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.794+0000 7f23853fd700 1 -- 172.21.15.26:0/2951176180 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2370012070 con 0x7f238009f240 2023-10-01T07:55:27.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.794+0000 7f23853fd700 1 -- 172.21.15.26:0/2951176180 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237000d2e0 con 0x7f238009f240 2023-10-01T07:55:27.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.794+0000 7f23853fd700 1 -- 172.21.15.26:0/2951176180 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237000fb10 con 0x7f238009f240 2023-10-01T07:55:27.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.795+0000 7f2388663700 1 -- 172.21.15.26:0/2951176180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f238009f240 msgr2=0x7f23801317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:27.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.795+0000 7f2388663700 1 --2- 172.21.15.26:0/2951176180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f238009f240 0x7f23801317f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f237000dd10 tx=0x7f237000f330 comp rx=0 tx=0).stop 2023-10-01T07:55:27.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.795+0000 7f2388663700 1 -- 172.21.15.26:0/2951176180 shutdown_connections 2023-10-01T07:55:27.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.795+0000 7f2388663700 1 --2- 172.21.15.26:0/2951176180 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f238009f650 0x7f2380131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.795+0000 7f2388663700 1 --2- 172.21.15.26:0/2951176180 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f238009e930 0x7f238009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.795+0000 7f2388663700 1 --2- 172.21.15.26:0/2951176180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f238009f240 0x7f23801317f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.795+0000 7f2388663700 1 -- 172.21.15.26:0/2951176180 >> 172.21.15.26:0/2951176180 conn(0x7f23800a4210 msgr2=0x7f23800a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:27.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.795+0000 7f2388663700 1 -- 172.21.15.26:0/2951176180 shutdown_connections 2023-10-01T07:55:27.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.796+0000 7f2388663700 1 -- 172.21.15.26:0/2951176180 wait complete. 2023-10-01T07:55:27.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.797+0000 7f2388663700 1 Processor -- start 2023-10-01T07:55:27.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.797+0000 7f2388663700 1 -- start start 2023-10-01T07:55:27.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.797+0000 7f2388663700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f238009e930 0x7f23801c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:27.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.797+0000 7f2388663700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f238009f240 0x7f23801c4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:27.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.797+0000 7f2388663700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f238009f650 0x7f23801c48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:27.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.797+0000 7f2388663700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23801a2380 con 0x7f238009e930 2023-10-01T07:55:27.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.797+0000 7f2388663700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23801a2190 con 0x7f238009f650 2023-10-01T07:55:27.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.797+0000 7f2388663700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23801a40a0 con 0x7f238009f240 2023-10-01T07:55:27.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.797+0000 7f23863ff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f238009e930 0x7f23801c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:27.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.797+0000 7f23863ff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f238009e930 0x7f23801c3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40906/0 (socket says 172.21.15.26:40906) 2023-10-01T07:55:27.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.797+0000 7f23863ff700 1 -- 172.21.15.26:0/164049309 learned_addr learned my addr 172.21.15.26:0/164049309 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:27.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.797+0000 7f2386c00700 1 --2- 172.21.15.26:0/164049309 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f238009f650 0x7f23801c48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:27.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.798+0000 7f2385bfe700 1 --2- 172.21.15.26:0/164049309 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f238009f240 0x7f23801c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:27.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.798+0000 7f23863ff700 1 -- 172.21.15.26:0/164049309 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f238009f240 msgr2=0x7f23801c4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:27.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.798+0000 7f23863ff700 1 --2- 172.21.15.26:0/164049309 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f238009f240 0x7f23801c4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.798+0000 7f23863ff700 1 -- 172.21.15.26:0/164049309 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f238009f650 msgr2=0x7f23801c48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:27.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.798+0000 7f23863ff700 1 --2- 172.21.15.26:0/164049309 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f238009f650 0x7f23801c48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.798+0000 7f23863ff700 1 -- 172.21.15.26:0/164049309 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237c0094a0 con 0x7f238009e930 2023-10-01T07:55:27.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.798+0000 7f2386c00700 1 --2- 172.21.15.26:0/164049309 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f238009f650 0x7f23801c48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:27.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.798+0000 7f23863ff700 1 --2- 172.21.15.26:0/164049309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f238009e930 0x7f23801c3e20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f237c00ebe0 tx=0x7f237c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:27.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.798+0000 7f2376ffd700 1 -- 172.21.15.26:0/164049309 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c009780 con 0x7f238009e930 2023-10-01T07:55:27.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.798+0000 7f2376ffd700 1 -- 172.21.15.26:0/164049309 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237c00c850 con 0x7f238009e930 2023-10-01T07:55:27.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.798+0000 7f2376ffd700 1 -- 172.21.15.26:0/164049309 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c00cbe0 con 0x7f238009e930 2023-10-01T07:55:27.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.798+0000 7f2388663700 1 -- 172.21.15.26:0/164049309 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f237000d9f0 con 0x7f238009e930 2023-10-01T07:55:27.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.798+0000 7f2388663700 1 -- 172.21.15.26:0/164049309 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23800a0190 con 0x7f238009e930 2023-10-01T07:55:27.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.800+0000 7f2388663700 1 -- 172.21.15.26:0/164049309 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2380074ea0 con 0x7f238009e930 2023-10-01T07:55:27.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.800+0000 7f2376ffd700 1 -- 172.21.15.26:0/164049309 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f237c00cd40 con 0x7f238009e930 2023-10-01T07:55:27.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.800+0000 7f2376ffd700 1 -- 172.21.15.26:0/164049309 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f237c03f7a0 con 0x7f238009e930 2023-10-01T07:55:27.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.809+0000 7f2376ffd700 1 -- 172.21.15.26:0/164049309 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f237c0232f0 con 0x7f238009e930 2023-10-01T07:55:27.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.902+0000 7fe7a414d700 1 -- 172.21.15.26:0/3911961398 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe784005590 con 0x7fe79c134610 2023-10-01T07:55:27.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.903+0000 7fe7927fc700 1 -- 172.21.15.26:0/3911961398 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe78c017030 con 0x7fe79c134610 2023-10-01T07:55:27.903 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:27.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.905+0000 7fe7a414d700 1 -- 172.21.15.26:0/3911961398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe79c134610 msgr2=0x7fe79c125ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:27.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.905+0000 7fe7a414d700 1 --2- 172.21.15.26:0/3911961398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe79c134610 0x7fe79c125ea0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe78c00e9b0 tx=0x7fe78c00ecc0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.905+0000 7fe7a414d700 1 -- 172.21.15.26:0/3911961398 shutdown_connections 2023-10-01T07:55:27.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.905+0000 7fe7a414d700 1 --2- 172.21.15.26:0/3911961398 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe79c1279e0 0x7fe79c1263e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.905+0000 7fe7a414d700 1 --2- 172.21.15.26:0/3911961398 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe79c06e570 0x7fe79c1274a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.905+0000 7fe7a414d700 1 --2- 172.21.15.26:0/3911961398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe79c134610 0x7fe79c125ea0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.905+0000 7fe7a414d700 1 -- 172.21.15.26:0/3911961398 >> 172.21.15.26:0/3911961398 conn(0x7fe79c0a2aa0 msgr2=0x7fe79c099a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:27.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.905+0000 7fe7a414d700 1 -- 172.21.15.26:0/3911961398 shutdown_connections 2023-10-01T07:55:27.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.905+0000 7fe7a414d700 1 -- 172.21.15.26:0/3911961398 wait complete. 2023-10-01T07:55:27.922 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:27.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.963+0000 7f9d1386f700 1 -- 172.21.15.26:0/332829059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9d0c06b9e0 con 0x7f9d0c131810 2023-10-01T07:55:27.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.963+0000 7f9d01ffb700 1 -- 172.21.15.26:0/332829059 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9d04011380 con 0x7f9d0c131810 2023-10-01T07:55:27.964 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:27.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.965+0000 7f9d1386f700 1 -- 172.21.15.26:0/332829059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d0c131810 msgr2=0x7f9d0c070060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:27.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.965+0000 7f9d1386f700 1 --2- 172.21.15.26:0/332829059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d0c131810 0x7f9d0c070060 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9d0400cb90 tx=0x7f9d0400cea0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.965+0000 7f9d1386f700 1 -- 172.21.15.26:0/332829059 shutdown_connections 2023-10-01T07:55:27.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.966+0000 7f9d1386f700 1 --2- 172.21.15.26:0/332829059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d0c131810 0x7f9d0c070060 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.966+0000 7f9d1386f700 1 --2- 172.21.15.26:0/332829059 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d0c099a40 0x7f9d0c06f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.966+0000 7f9d1386f700 1 --2- 172.21.15.26:0/332829059 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d0c09a3b0 0x7f9d0c06fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.966+0000 7f9d1386f700 1 -- 172.21.15.26:0/332829059 >> 172.21.15.26:0/332829059 conn(0x7f9d0c0a2aa0 msgr2=0x7f9d0c09d770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:27.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.966+0000 7f9d1386f700 1 -- 172.21.15.26:0/332829059 shutdown_connections 2023-10-01T07:55:27.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.966+0000 7f9d1386f700 1 -- 172.21.15.26:0/332829059 wait complete. 2023-10-01T07:55:27.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:27.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.989+0000 7f662f84c700 1 -- 172.21.15.26:0/154719217 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f662809c710 con 0x7f662809e410 2023-10-01T07:55:27.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.989+0000 7f661dffb700 1 -- 172.21.15.26:0/154719217 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f662001a4a0 con 0x7f662809e410 2023-10-01T07:55:27.989 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:27.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.991+0000 7f662f84c700 1 -- 172.21.15.26:0/154719217 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f662809e410 msgr2=0x7f6628122df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:27.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.991+0000 7f662f84c700 1 --2- 172.21.15.26:0/154719217 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f662809e410 0x7f6628122df0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f662000efc0 tx=0x7f662000c3a0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.991+0000 7f662f84c700 1 -- 172.21.15.26:0/154719217 shutdown_connections 2023-10-01T07:55:27.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.991+0000 7f662f84c700 1 --2- 172.21.15.26:0/154719217 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f662809e410 0x7f6628122df0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.991+0000 7f662f84c700 1 --2- 172.21.15.26:0/154719217 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f662809d6f0 0x7f6628122370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.991+0000 7f662f84c700 1 --2- 172.21.15.26:0/154719217 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f662809e000 0x7f66281228b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:27.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.991+0000 7f662f84c700 1 -- 172.21.15.26:0/154719217 >> 172.21.15.26:0/154719217 conn(0x7f6628066f50 msgr2=0x7f6628133cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:27.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.992+0000 7f662f84c700 1 -- 172.21.15.26:0/154719217 shutdown_connections 2023-10-01T07:55:27.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:27.992+0000 7f662f84c700 1 -- 172.21.15.26:0/154719217 wait complete. 2023-10-01T07:55:28.005 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:28.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:28.019+0000 7f2388663700 1 -- 172.21.15.26:0/164049309 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f23801a2980 con 0x7f238009e930 2023-10-01T07:55:28.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:28.019+0000 7f2376ffd700 1 -- 172.21.15.26:0/164049309 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f237c021070 con 0x7f238009e930 2023-10-01T07:55:28.020 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:28.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:28.022+0000 7f2388663700 1 -- 172.21.15.26:0/164049309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f238009e930 msgr2=0x7f23801c3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:28.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:28.022+0000 7f2388663700 1 --2- 172.21.15.26:0/164049309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f238009e930 0x7f23801c3e20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f237c00ebe0 tx=0x7f237c00eef0 comp rx=0 tx=0).stop 2023-10-01T07:55:28.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:28.022+0000 7f2388663700 1 -- 172.21.15.26:0/164049309 shutdown_connections 2023-10-01T07:55:28.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:28.022+0000 7f2388663700 1 --2- 172.21.15.26:0/164049309 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f238009f650 0x7f23801c48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:28.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:28.022+0000 7f2388663700 1 --2- 172.21.15.26:0/164049309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f238009e930 0x7f23801c3e20 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:28.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:28.022+0000 7f2388663700 1 --2- 172.21.15.26:0/164049309 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f238009f240 0x7f23801c4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:28.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:28.022+0000 7f2388663700 1 -- 172.21.15.26:0/164049309 >> 172.21.15.26:0/164049309 conn(0x7f23800a4210 msgr2=0x7f23801b7900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:28.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:28.022+0000 7f2388663700 1 -- 172.21.15.26:0/164049309 shutdown_connections 2023-10-01T07:55:28.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:28.022+0000 7f2388663700 1 -- 172.21.15.26:0/164049309 wait complete. 2023-10-01T07:55:28.036 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:28.923 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:28.981 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:29.006 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:29.037 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:29.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.083+0000 7f7a09157700 1 Processor -- start 2023-10-01T07:55:29.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.083+0000 7f7a09157700 1 -- start start 2023-10-01T07:55:29.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.084+0000 7f7a09157700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7a04131810 0x7f7a04131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:29.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.084+0000 7f7a09157700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7a0409a580 0x7f7a04139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:29.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.084+0000 7f7a09157700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a041313c0 con 0x7f7a04099a40 2023-10-01T07:55:29.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.084+0000 7f7a09157700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0406e8c0 con 0x7f7a0409a580 2023-10-01T07:55:29.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.084+0000 7f7a09157700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a04071d20 con 0x7f7a04131810 2023-10-01T07:55:29.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.084+0000 7f7a0359e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7a0409a580 0x7f7a04139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:29.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.084+0000 7f7a0359e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7a0409a580 0x7f7a04139660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:53542/0 (socket says 172.21.15.26:53542) 2023-10-01T07:55:29.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.084+0000 7f7a0359e700 1 -- 172.21.15.26:0/1561436658 learned_addr learned my addr 172.21.15.26:0/1561436658 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:29.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.084+0000 7f7a0259c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7a04099a40 0x7f7a04099e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38574/0 (socket says 172.21.15.26:38574) 2023-10-01T07:55:29.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.084+0000 7f7a02d9d700 1 --2- 172.21.15.26:0/1561436658 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7a04131810 0x7f7a04131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:29.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.085+0000 7f7a0359e700 1 -- 172.21.15.26:0/1561436658 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7a04131810 msgr2=0x7f7a04131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:29.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.085+0000 7f7a0359e700 1 --2- 172.21.15.26:0/1561436658 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7a04131810 0x7f7a04131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:29.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.085+0000 7f7a0359e700 1 -- 172.21.15.26:0/1561436658 >> v1:172.21.15.26:6789/0 conn(0x7f7a04099a40 legacy=0x7f7a04099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:29.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.085+0000 7f7a0359e700 1 -- 172.21.15.26:0/1561436658 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a040721a0 con 0x7f7a0409a580 2023-10-01T07:55:29.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.085+0000 7f7a0359e700 1 --2- 172.21.15.26:0/1561436658 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7a0409a580 0x7f7a04139660 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f79fc009e80 tx=0x7f79fc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60bbf32e23c680c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:29.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.085+0000 7f7a01d9b700 1 -- 172.21.15.26:0/1561436658 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc00e070 con 0x7f7a0409a580 2023-10-01T07:55:29.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.085+0000 7f7a01d9b700 1 -- 172.21.15.26:0/1561436658 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79fc00b910 con 0x7f7a0409a580 2023-10-01T07:55:29.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.085+0000 7f7a01d9b700 1 -- 172.21.15.26:0/1561436658 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc00bcc0 con 0x7f7a0409a580 2023-10-01T07:55:29.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.086+0000 7f7a09157700 1 -- 172.21.15.26:0/1561436658 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7a0409a580 msgr2=0x7f7a04139660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:29.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.086+0000 7f7a09157700 1 --2- 172.21.15.26:0/1561436658 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7a0409a580 0x7f7a04139660 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f79fc009e80 tx=0x7f79fc00b330 comp rx=0 tx=0).stop 2023-10-01T07:55:29.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.086+0000 7f7a09157700 1 -- 172.21.15.26:0/1561436658 shutdown_connections 2023-10-01T07:55:29.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.086+0000 7f7a09157700 1 --2- 172.21.15.26:0/1561436658 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7a04131810 0x7f7a04131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:29.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.086+0000 7f7a09157700 1 --2- 172.21.15.26:0/1561436658 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7a0409a580 0x7f7a04139660 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:29.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.086+0000 7f7a09157700 1 -- 172.21.15.26:0/1561436658 >> 172.21.15.26:0/1561436658 conn(0x7f7a040a2aa0 msgr2=0x7f7a040a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:29.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.086+0000 7f7a09157700 1 -- 172.21.15.26:0/1561436658 shutdown_connections 2023-10-01T07:55:29.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.086+0000 7f7a09157700 1 -- 172.21.15.26:0/1561436658 wait complete. 2023-10-01T07:55:29.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.088+0000 7f7a09157700 1 Processor -- start 2023-10-01T07:55:29.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.088+0000 7f7a09157700 1 -- start start 2023-10-01T07:55:29.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.089+0000 7f7a09157700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7a04099a40 0x7f7a0406f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:29.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.089+0000 7f7a09157700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a0409a580 0x7f7a0406fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:29.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.089+0000 7f7a09157700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7a04131810 0x7f7a04070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:29.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.089+0000 7f7a09157700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a040a1cf0 con 0x7f7a0409a580 2023-10-01T07:55:29.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.089+0000 7f7a09157700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a04070a50 con 0x7f7a04131810 2023-10-01T07:55:29.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.089+0000 7f7a09157700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0406eb00 con 0x7f7a04099a40 2023-10-01T07:55:29.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.089+0000 7f7a0359e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7a04131810 0x7f7a04070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:29.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.089+0000 7f7a0359e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7a04131810 0x7f7a04070090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:53546/0 (socket says 172.21.15.26:53546) 2023-10-01T07:55:29.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.089+0000 7f7a0359e700 1 -- 172.21.15.26:0/3315747537 learned_addr learned my addr 172.21.15.26:0/3315747537 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:29.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.089+0000 7f7a02d9d700 1 --2- 172.21.15.26:0/3315747537 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7a04099a40 0x7f7a0406f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:29.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.090+0000 7f7a0359e700 1 -- 172.21.15.26:0/3315747537 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7a04099a40 msgr2=0x7f7a0406f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:29.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.090+0000 7f7a0359e700 1 --2- 172.21.15.26:0/3315747537 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7a04099a40 0x7f7a0406f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:29.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.090+0000 7f7a0359e700 1 -- 172.21.15.26:0/3315747537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a0409a580 msgr2=0x7f7a0406fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:29.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.090+0000 7f7a0359e700 1 --2- 172.21.15.26:0/3315747537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a0409a580 0x7f7a0406fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:29.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.090+0000 7f7a0359e700 1 -- 172.21.15.26:0/3315747537 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79fc009b30 con 0x7f7a04131810 2023-10-01T07:55:29.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.090+0000 7f7a0359e700 1 --2- 172.21.15.26:0/3315747537 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7a04131810 0x7f7a04070090 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7a0406ea00 tx=0x7f79fc004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:29.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.090+0000 7f79eb7fe700 1 -- 172.21.15.26:0/3315747537 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc004040 con 0x7f7a04131810 2023-10-01T07:55:29.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.090+0000 7f79eb7fe700 1 -- 172.21.15.26:0/3315747537 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79fc0041e0 con 0x7f7a04131810 2023-10-01T07:55:29.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.090+0000 7f7a09157700 1 -- 172.21.15.26:0/3315747537 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a041203f0 con 0x7f7a04131810 2023-10-01T07:55:29.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.090+0000 7f79eb7fe700 1 -- 172.21.15.26:0/3315747537 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc004590 con 0x7f7a04131810 2023-10-01T07:55:29.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.090+0000 7f7a09157700 1 -- 172.21.15.26:0/3315747537 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a04121200 con 0x7f7a04131810 2023-10-01T07:55:29.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.091+0000 7f79eb7fe700 1 -- 172.21.15.26:0/3315747537 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f79fc0046f0 con 0x7f7a04131810 2023-10-01T07:55:29.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.091+0000 7f79e97fa700 1 -- 172.21.15.26:0/3315747537 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79dc0052e0 con 0x7f7a04131810 2023-10-01T07:55:29.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.091+0000 7f79eb7fe700 1 -- 172.21.15.26:0/3315747537 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f79fc040bd0 con 0x7f7a04131810 2023-10-01T07:55:29.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.098+0000 7f79eb7fe700 1 -- 172.21.15.26:0/3315747537 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f79fc0117a0 con 0x7f7a04131810 2023-10-01T07:55:29.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.139+0000 7fd98083e700 1 Processor -- start 2023-10-01T07:55:29.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.140+0000 7fd98083e700 1 -- start start 2023-10-01T07:55:29.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.140+0000 7fd98083e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd97c09eca0 0x7fd97c13cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:29.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.140+0000 7fd98083e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd97c06f050 0x7fd97c13f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:29.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.140+0000 7fd98083e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd97c070ee0 con 0x7fd97c06e570 2023-10-01T07:55:29.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.140+0000 7fd98083e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd97c071980 con 0x7fd97c06f050 2023-10-01T07:55:29.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.140+0000 7fd98083e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c071480 con 0x7fd97c09eca0 2023-10-01T07:55:29.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.140+0000 7fd97a59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd97c06e570 0x7fd97c06e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38576/0 (socket says 172.21.15.26:38576) 2023-10-01T07:55:29.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.141+0000 7fd97a59c700 1 -- 172.21.15.26:0/3065282865 learned_addr learned my addr 172.21.15.26:0/3065282865 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:29.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.141+0000 7fd97ad9d700 1 --2- 172.21.15.26:0/3065282865 >> v2:172.21.15.26:3300/0 conn(0x7fd97c06f050 0x7fd97c13f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:29.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.141+0000 7fd979d9b700 1 --2- 172.21.15.26:0/3065282865 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd97c09eca0 0x7fd97c13cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:29.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.141+0000 7fd97959a700 1 -- 172.21.15.26:0/3065282865 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 648005605 0 0) 0x7fd97c070ee0 con 0x7fd97c06e570 2023-10-01T07:55:29.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.141+0000 7fd97959a700 1 -- 172.21.15.26:0/3065282865 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9640035b0 con 0x7fd97c06e570 2023-10-01T07:55:29.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.141+0000 7fd979d9b700 1 -- 172.21.15.26:0/3065282865 >> v2:172.21.15.26:3300/0 conn(0x7fd97c06f050 msgr2=0x7fd97c13f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:29.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.141+0000 7fd979d9b700 1 --2- 172.21.15.26:0/3065282865 >> v2:172.21.15.26:3300/0 conn(0x7fd97c06f050 0x7fd97c13f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:29.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.141+0000 7fd979d9b700 1 -- 172.21.15.26:0/3065282865 >> v1:172.21.15.26:6789/0 conn(0x7fd97c06e570 legacy=0x7fd97c06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:29.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.141+0000 7fd979d9b700 1 -- 172.21.15.26:0/3065282865 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd97c071b90 con 0x7fd97c09eca0 2023-10-01T07:55:29.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.141+0000 7fd97ad9d700 1 --2- 172.21.15.26:0/3065282865 >> v2:172.21.15.26:3300/0 conn(0x7fd97c06f050 0x7fd97c13f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:29.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.141+0000 7fd979d9b700 1 --2- 172.21.15.26:0/3065282865 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd97c09eca0 0x7fd97c13cea0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd970009840 tx=0x7fd970009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=776d0f5f546926b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:29.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.142+0000 7fd97959a700 1 -- 172.21.15.26:0/3065282865 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd970011830 con 0x7fd97c09eca0 2023-10-01T07:55:29.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.142+0000 7fd97959a700 1 -- 172.21.15.26:0/3065282865 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd970011990 con 0x7fd97c09eca0 2023-10-01T07:55:29.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.142+0000 7fd97959a700 1 -- 172.21.15.26:0/3065282865 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd970011d20 con 0x7fd97c09eca0 2023-10-01T07:55:29.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.143+0000 7fd98083e700 1 -- 172.21.15.26:0/3065282865 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd97c09eca0 msgr2=0x7fd97c13cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:29.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.143+0000 7fd98083e700 1 --2- 172.21.15.26:0/3065282865 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd97c09eca0 0x7fd97c13cea0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd970009840 tx=0x7fd970009b50 comp rx=0 tx=0).stop 2023-10-01T07:55:29.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.143+0000 7fd98083e700 1 -- 172.21.15.26:0/3065282865 shutdown_connections 2023-10-01T07:55:29.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.143+0000 7fd98083e700 1 --2- 172.21.15.26:0/3065282865 >> v2:172.21.15.26:3300/0 conn(0x7fd97c06f050 0x7fd97c13f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:29.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.143+0000 7fd98083e700 1 --2- 172.21.15.26:0/3065282865 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd97c09eca0 0x7fd97c13cea0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:29.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.143+0000 7fd98083e700 1 -- 172.21.15.26:0/3065282865 >> 172.21.15.26:0/3065282865 conn(0x7fd97c0a2aa0 msgr2=0x7fd97c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:29.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.143+0000 7fd98083e700 1 -- 172.21.15.26:0/3065282865 shutdown_connections 2023-10-01T07:55:29.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.143+0000 7fd98083e700 1 -- 172.21.15.26:0/3065282865 wait complete. 2023-10-01T07:55:29.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.145+0000 7fd98083e700 1 Processor -- start 2023-10-01T07:55:29.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.145+0000 7fd98083e700 1 -- start start 2023-10-01T07:55:29.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.145+0000 7fd98083e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd97c06e570 0x7fd97c13e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:29.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.145+0000 7fd98083e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd97c06f050 0x7fd97c136430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:29.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.145+0000 7fd98083e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd97c136970 0x7fd97c136dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:29.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.145+0000 7fd98083e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c13e570 con 0x7fd97c06f050 2023-10-01T07:55:29.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.145+0000 7fd98083e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c070610 con 0x7fd97c06e570 2023-10-01T07:55:29.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.145+0000 7fd98083e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c138cd0 con 0x7fd97c136970 2023-10-01T07:55:29.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.146+0000 7fd97ad9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd97c136970 0x7fd97c136dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:29.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.146+0000 7fd97ad9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd97c136970 0x7fd97c136dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59524/0 (socket says 172.21.15.26:59524) 2023-10-01T07:55:29.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.146+0000 7fd97ad9d700 1 -- 172.21.15.26:0/2737198863 learned_addr learned my addr 172.21.15.26:0/2737198863 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:29.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.146+0000 7fd979d9b700 1 --2- 172.21.15.26:0/2737198863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd97c06f050 0x7fd97c136430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:29.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.146+0000 7fd97ad9d700 1 -- 172.21.15.26:0/2737198863 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd97c06e570 msgr2=0x7fd97c13e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:29.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.146+0000 7fd97ad9d700 1 --2- 172.21.15.26:0/2737198863 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd97c06e570 0x7fd97c13e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:29.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.146+0000 7fd97ad9d700 1 -- 172.21.15.26:0/2737198863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd97c06f050 msgr2=0x7fd97c136430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:29.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.146+0000 7fd97ad9d700 1 --2- 172.21.15.26:0/2737198863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd97c06f050 0x7fd97c136430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:29.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.146+0000 7fd97ad9d700 1 -- 172.21.15.26:0/2737198863 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd974009a70 con 0x7fd97c136970 2023-10-01T07:55:29.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.146+0000 7fd979d9b700 1 --2- 172.21.15.26:0/2737198863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd97c06f050 0x7fd97c136430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:29.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.146+0000 7fd97ad9d700 1 --2- 172.21.15.26:0/2737198863 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd97c136970 0x7fd97c136dc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd974009f00 tx=0x7fd97400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:29.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.147+0000 7fd96affd700 1 -- 172.21.15.26:0/2737198863 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd974009d70 con 0x7fd97c136970 2023-10-01T07:55:29.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.147+0000 7fd96affd700 1 -- 172.21.15.26:0/2737198863 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97400f040 con 0x7fd97c136970 2023-10-01T07:55:29.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.147+0000 7fd96affd700 1 -- 172.21.15.26:0/2737198863 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97400ce20 con 0x7fd97c136970 2023-10-01T07:55:29.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.147+0000 7fd98083e700 1 -- 172.21.15.26:0/2737198863 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9700094a0 con 0x7fd97c136970 2023-10-01T07:55:29.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.147+0000 7fd98083e700 1 -- 172.21.15.26:0/2737198863 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd97c1398b0 con 0x7fd97c136970 2023-10-01T07:55:29.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.148+0000 7fd98083e700 1 -- 172.21.15.26:0/2737198863 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd97c074ea0 con 0x7fd97c136970 2023-10-01T07:55:29.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.149+0000 7fd96affd700 1 -- 172.21.15.26:0/2737198863 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd974003a20 con 0x7fd97c136970 2023-10-01T07:55:29.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.149+0000 7fd96affd700 1 -- 172.21.15.26:0/2737198863 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd974040860 con 0x7fd97c136970 2023-10-01T07:55:29.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.153+0000 7fd96affd700 1 -- 172.21.15.26:0/2737198863 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd97401c7c0 con 0x7fd97c136970 2023-10-01T07:55:29.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.181+0000 7fd6bbb38700 1 Processor -- start 2023-10-01T07:55:29.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.182+0000 7fd6bbb38700 1 -- start start 2023-10-01T07:55:29.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.182+0000 7fd6bbb38700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6b406a770 0x7fd6b409d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:29.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.182+0000 7fd6bbb38700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6b409dc30 0x7fd6b409e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:29.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.182+0000 7fd6bbb38700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b409a810 con 0x7fd6b413c1e0 2023-10-01T07:55:29.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.182+0000 7fd6bbb38700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b406ab40 con 0x7fd6b406a770 2023-10-01T07:55:29.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.182+0000 7fd6bbb38700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b409ebc0 con 0x7fd6b409dc30 2023-10-01T07:55:29.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.182+0000 7fd6b98d4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6b406a770 0x7fd6b409d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:29.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.182+0000 7fd6b98d4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6b406a770 0x7fd6b409d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:53570/0 (socket says 172.21.15.26:53570) 2023-10-01T07:55:29.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.182+0000 7fd6b98d4700 1 -- 172.21.15.26:0/2262133022 learned_addr learned my addr 172.21.15.26:0/2262133022 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:29.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.183+0000 7fd6b90d3700 1 --2- 172.21.15.26:0/2262133022 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6b409dc30 0x7fd6b409e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:29.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.183+0000 7fd6b98d4700 1 -- 172.21.15.26:0/2262133022 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6b409dc30 msgr2=0x7fd6b409e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:29.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.183+0000 7fd6b98d4700 1 --2- 172.21.15.26:0/2262133022 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6b409dc30 0x7fd6b409e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:29.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.183+0000 7fd6b98d4700 1 -- 172.21.15.26:0/2262133022 >> v1:172.21.15.26:6789/0 conn(0x7fd6b413c1e0 legacy=0x7fd6b413e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:29.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.183+0000 7fd6b98d4700 1 -- 172.21.15.26:0/2262133022 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b409e920 con 0x7fd6b406a770 2023-10-01T07:55:29.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.183+0000 7fd6b98d4700 1 --2- 172.21.15.26:0/2262133022 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6b406a770 0x7fd6b409d6f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0009920 tx=0x7fd6b0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31cc58747655e58e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:29.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.183+0000 7fd6b88d2700 1 -- 172.21.15.26:0/2262133022 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b0004230 con 0x7fd6b406a770 2023-10-01T07:55:29.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.183+0000 7fd6b88d2700 1 -- 172.21.15.26:0/2262133022 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b0004390 con 0x7fd6b406a770 2023-10-01T07:55:29.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.183+0000 7fd6b88d2700 1 -- 172.21.15.26:0/2262133022 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b0009e70 con 0x7fd6b406a770 2023-10-01T07:55:29.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.184+0000 7fd6bbb38700 1 -- 172.21.15.26:0/2262133022 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6b406a770 msgr2=0x7fd6b409d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:29.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.184+0000 7fd6bbb38700 1 --2- 172.21.15.26:0/2262133022 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6b406a770 0x7fd6b409d6f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0009920 tx=0x7fd6b0009c30 comp rx=0 tx=0).stop 2023-10-01T07:55:29.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.184+0000 7fd6bbb38700 1 -- 172.21.15.26:0/2262133022 shutdown_connections 2023-10-01T07:55:29.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.184+0000 7fd6bbb38700 1 --2- 172.21.15.26:0/2262133022 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6b406a770 0x7fd6b409d6f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:29.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.184+0000 7fd6bbb38700 1 --2- 172.21.15.26:0/2262133022 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6b409dc30 0x7fd6b409e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:29.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.184+0000 7fd6bbb38700 1 -- 172.21.15.26:0/2262133022 >> 172.21.15.26:0/2262133022 conn(0x7fd6b4066f50 msgr2=0x7fd6b409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:29.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.184+0000 7fd6bbb38700 1 -- 172.21.15.26:0/2262133022 shutdown_connections 2023-10-01T07:55:29.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.184+0000 7fd6bbb38700 1 -- 172.21.15.26:0/2262133022 wait complete. 2023-10-01T07:55:29.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.185+0000 7fd6bbb38700 1 Processor -- start 2023-10-01T07:55:29.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.185+0000 7fd6bbb38700 1 -- start start 2023-10-01T07:55:29.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.186+0000 7fd6bbb38700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6b406a770 0x7fd6b411b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:29.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.186+0000 7fd6bbb38700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6b409dc30 0x7fd6b413a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:29.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.186+0000 7fd6bbb38700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6b413c1e0 0x7fd6b413aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:29.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.186+0000 7fd6bbb38700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b411bed0 con 0x7fd6b406a770 2023-10-01T07:55:29.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.186+0000 7fd6bbb38700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b411bce0 con 0x7fd6b413c1e0 2023-10-01T07:55:29.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.186+0000 7fd6bbb38700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b4134d10 con 0x7fd6b409dc30 2023-10-01T07:55:29.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.186+0000 7fd6b98d4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6b406a770 0x7fd6b411b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:29.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.186+0000 7fd6b98d4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6b406a770 0x7fd6b411b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40926/0 (socket says 172.21.15.26:40926) 2023-10-01T07:55:29.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.186+0000 7fd6b98d4700 1 -- 172.21.15.26:0/3488964378 learned_addr learned my addr 172.21.15.26:0/3488964378 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:29.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.186+0000 7fd6ba0d5700 1 --2- 172.21.15.26:0/3488964378 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6b413c1e0 0x7fd6b413aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:29.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.186+0000 7fd6b90d3700 1 --2- 172.21.15.26:0/3488964378 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6b409dc30 0x7fd6b413a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:29.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.187+0000 7fd6b98d4700 1 -- 172.21.15.26:0/3488964378 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6b409dc30 msgr2=0x7fd6b413a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:29.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.187+0000 7fd6b98d4700 1 --2- 172.21.15.26:0/3488964378 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6b409dc30 0x7fd6b413a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:29.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.187+0000 7fd6b98d4700 1 -- 172.21.15.26:0/3488964378 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6b413c1e0 msgr2=0x7fd6b413aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:29.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.187+0000 7fd6b98d4700 1 --2- 172.21.15.26:0/3488964378 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6b413c1e0 0x7fd6b413aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:29.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.187+0000 7fd6b98d4700 1 -- 172.21.15.26:0/3488964378 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b0009550 con 0x7fd6b406a770 2023-10-01T07:55:29.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.187+0000 7fd6b98d4700 1 --2- 172.21.15.26:0/3488964378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6b406a770 0x7fd6b411b1c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd6b000b3c0 tx=0x7fd6b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:29.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.187+0000 7fd6aa7fc700 1 -- 172.21.15.26:0/3488964378 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b000bb20 con 0x7fd6b406a770 2023-10-01T07:55:29.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.187+0000 7fd6aa7fc700 1 -- 172.21.15.26:0/3488964378 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b001f070 con 0x7fd6b406a770 2023-10-01T07:55:29.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.187+0000 7fd6bbb38700 1 -- 172.21.15.26:0/3488964378 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b411cfc0 con 0x7fd6b406a770 2023-10-01T07:55:29.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.187+0000 7fd6aa7fc700 1 -- 172.21.15.26:0/3488964378 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b000bec0 con 0x7fd6b406a770 2023-10-01T07:55:29.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.187+0000 7fd6bbb38700 1 -- 172.21.15.26:0/3488964378 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b411d410 con 0x7fd6b406a770 2023-10-01T07:55:29.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.188+0000 7fd6aa7fc700 1 -- 172.21.15.26:0/3488964378 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd6b0021030 con 0x7fd6b406a770 2023-10-01T07:55:29.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.188+0000 7fd6aa7fc700 1 -- 172.21.15.26:0/3488964378 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd6b0040c30 con 0x7fd6b406a770 2023-10-01T07:55:29.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.188+0000 7fd6bbb38700 1 -- 172.21.15.26:0/3488964378 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b4074ea0 con 0x7fd6b406a770 2023-10-01T07:55:29.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.194+0000 7fd6aa7fc700 1 -- 172.21.15.26:0/3488964378 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd6b00239c0 con 0x7fd6b406a770 2023-10-01T07:55:29.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.227+0000 7f110c38a700 1 Processor -- start 2023-10-01T07:55:29.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.227+0000 7f110c38a700 1 -- start start 2023-10-01T07:55:29.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.228+0000 7f110c38a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f11040a0a30 0x7f11040a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:29.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.228+0000 7f110c38a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f11040a1340 0x7f1104133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:29.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.228+0000 7f110c38a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f110409edd0 con 0x7f1104133fa0 2023-10-01T07:55:29.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.228+0000 7f110c38a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f110409e1f0 con 0x7f11040a1340 2023-10-01T07:55:29.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.228+0000 7f110c38a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110409dc50 con 0x7f11040a0a30 2023-10-01T07:55:29.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.228+0000 7f1109925700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f11040a1340 0x7f1104133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:29.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.228+0000 7f110a126700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f11040a0a30 0x7f11040a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:29.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.228+0000 7f110a927700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1104133fa0 0x7f110413ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38594/0 (socket says 172.21.15.26:38594) 2023-10-01T07:55:29.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.228+0000 7f110a927700 1 -- 172.21.15.26:0/1514704533 learned_addr learned my addr 172.21.15.26:0/1514704533 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:29.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.229+0000 7f1109124700 1 -- 172.21.15.26:0/1514704533 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 228222394 0 0) 0x7f110409edd0 con 0x7f1104133fa0 2023-10-01T07:55:29.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.229+0000 7f1109124700 1 -- 172.21.15.26:0/1514704533 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10f00035b0 con 0x7f1104133fa0 2023-10-01T07:55:29.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.229+0000 7f1109925700 1 -- 172.21.15.26:0/1514704533 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f11040a0a30 msgr2=0x7f11040a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:29.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.229+0000 7f1109925700 1 --2- 172.21.15.26:0/1514704533 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f11040a0a30 0x7f11040a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:29.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.229+0000 7f1109925700 1 -- 172.21.15.26:0/1514704533 >> v1:172.21.15.26:6789/0 conn(0x7f1104133fa0 legacy=0x7f110413ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:29.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.229+0000 7f1109925700 1 -- 172.21.15.26:0/1514704533 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11040a1fe0 con 0x7f11040a1340 2023-10-01T07:55:29.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.229+0000 7f1109925700 1 --2- 172.21.15.26:0/1514704533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11040a1340 0x7f1104133a60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f10f4009840 tx=0x7f10f4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa13886cc8790929 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:29.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.229+0000 7f1109124700 1 -- 172.21.15.26:0/1514704533 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f4011830 con 0x7f11040a1340 2023-10-01T07:55:29.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.229+0000 7f1109124700 1 -- 172.21.15.26:0/1514704533 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f4011990 con 0x7f11040a1340 2023-10-01T07:55:29.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.229+0000 7f1109124700 1 -- 172.21.15.26:0/1514704533 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f4011d20 con 0x7f11040a1340 2023-10-01T07:55:29.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.230+0000 7f110c38a700 1 -- 172.21.15.26:0/1514704533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11040a1340 msgr2=0x7f1104133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:29.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.230+0000 7f110c38a700 1 --2- 172.21.15.26:0/1514704533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11040a1340 0x7f1104133a60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f10f4009840 tx=0x7f10f4009b50 comp rx=0 tx=0).stop 2023-10-01T07:55:29.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.230+0000 7f110c38a700 1 -- 172.21.15.26:0/1514704533 shutdown_connections 2023-10-01T07:55:29.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.230+0000 7f110c38a700 1 --2- 172.21.15.26:0/1514704533 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f11040a0a30 0x7f11040a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:29.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.230+0000 7f110c38a700 1 --2- 172.21.15.26:0/1514704533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11040a1340 0x7f1104133a60 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:29.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.230+0000 7f110c38a700 1 -- 172.21.15.26:0/1514704533 >> 172.21.15.26:0/1514704533 conn(0x7f11040a6550 msgr2=0x7f11040a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:29.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.230+0000 7f110c38a700 1 -- 172.21.15.26:0/1514704533 shutdown_connections 2023-10-01T07:55:29.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.230+0000 7f110c38a700 1 -- 172.21.15.26:0/1514704533 wait complete. 2023-10-01T07:55:29.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.231+0000 7f110c38a700 1 Processor -- start 2023-10-01T07:55:29.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.231+0000 7f110c38a700 1 -- start start 2023-10-01T07:55:29.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.232+0000 7f110c38a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11040a0a30 0x7f11041227e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:29.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.232+0000 7f110c38a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f11040a1340 0x7f1104122d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:29.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.232+0000 7f110c38a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1104133fa0 0x7f1104123260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:29.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.232+0000 7f110c38a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1104126ee0 con 0x7f11040a0a30 2023-10-01T07:55:29.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.232+0000 7f110c38a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11040a3580 con 0x7f1104133fa0 2023-10-01T07:55:29.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.232+0000 7f110c38a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11041249d0 con 0x7f11040a1340 2023-10-01T07:55:29.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.232+0000 7f110a126700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11040a0a30 0x7f11041227e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:29.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.232+0000 7f110a126700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11040a0a30 0x7f11041227e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40938/0 (socket says 172.21.15.26:40938) 2023-10-01T07:55:29.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.232+0000 7f110a126700 1 -- 172.21.15.26:0/855783165 learned_addr learned my addr 172.21.15.26:0/855783165 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:29.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.232+0000 7f110a927700 1 --2- 172.21.15.26:0/855783165 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1104133fa0 0x7f1104123260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:29.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.232+0000 7f1109925700 1 --2- 172.21.15.26:0/855783165 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f11040a1340 0x7f1104122d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:29.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.233+0000 7f110a126700 1 -- 172.21.15.26:0/855783165 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f11040a1340 msgr2=0x7f1104122d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:29.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.233+0000 7f110a126700 1 --2- 172.21.15.26:0/855783165 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f11040a1340 0x7f1104122d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:29.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.233+0000 7f110a126700 1 -- 172.21.15.26:0/855783165 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1104133fa0 msgr2=0x7f1104123260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:29.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.233+0000 7f110a126700 1 --2- 172.21.15.26:0/855783165 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1104133fa0 0x7f1104123260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:29.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.233+0000 7f110a126700 1 -- 172.21.15.26:0/855783165 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f40094a0 con 0x7f11040a0a30 2023-10-01T07:55:29.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.233+0000 7f110a126700 1 --2- 172.21.15.26:0/855783165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11040a0a30 0x7f11041227e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f110000e9e0 tx=0x7f110000ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:29.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.233+0000 7f10faffd700 1 -- 172.21.15.26:0/855783165 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1100009710 con 0x7f11040a0a30 2023-10-01T07:55:29.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.233+0000 7f10faffd700 1 -- 172.21.15.26:0/855783165 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110000c850 con 0x7f11040a0a30 2023-10-01T07:55:29.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.233+0000 7f110c38a700 1 -- 172.21.15.26:0/855783165 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1104126020 con 0x7f11040a0a30 2023-10-01T07:55:29.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.233+0000 7f10faffd700 1 -- 172.21.15.26:0/855783165 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110000cbc0 con 0x7f11040a0a30 2023-10-01T07:55:29.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.233+0000 7f110c38a700 1 -- 172.21.15.26:0/855783165 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1104124440 con 0x7f11040a0a30 2023-10-01T07:55:29.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.234+0000 7f10faffd700 1 -- 172.21.15.26:0/855783165 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f110000cd20 con 0x7f11040a0a30 2023-10-01T07:55:29.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.234+0000 7f10faffd700 1 -- 172.21.15.26:0/855783165 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f110003f7e0 con 0x7f11040a0a30 2023-10-01T07:55:29.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.235+0000 7f110c38a700 1 -- 172.21.15.26:0/855783165 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11040a1d40 con 0x7f11040a0a30 2023-10-01T07:55:29.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.240+0000 7f10faffd700 1 -- 172.21.15.26:0/855783165 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f11000232f0 con 0x7f11040a0a30 2023-10-01T07:55:29.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.326+0000 7f79e97fa700 1 -- 172.21.15.26:0/3315747537 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f79dc005590 con 0x7f7a04131810 2023-10-01T07:55:29.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.327+0000 7f79eb7fe700 1 -- 172.21.15.26:0/3315747537 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f79fc011390 con 0x7f7a04131810 2023-10-01T07:55:29.327 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:29.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.330+0000 7f79e97fa700 1 -- 172.21.15.26:0/3315747537 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7a04131810 msgr2=0x7f7a04070090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:29.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.330+0000 7f79e97fa700 1 --2- 172.21.15.26:0/3315747537 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7a04131810 0x7f7a04070090 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7a0406ea00 tx=0x7f79fc004ad0 comp rx=0 tx=0).stop 2023-10-01T07:55:29.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.330+0000 7f79e97fa700 1 -- 172.21.15.26:0/3315747537 shutdown_connections 2023-10-01T07:55:29.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.330+0000 7f79e97fa700 1 --2- 172.21.15.26:0/3315747537 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7a04131810 0x7f7a04070090 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:29.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.330+0000 7f79e97fa700 1 --2- 172.21.15.26:0/3315747537 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7a04099a40 0x7f7a0406f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:29.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.330+0000 7f79e97fa700 1 --2- 172.21.15.26:0/3315747537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a0409a580 0x7f7a0406fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:29.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.330+0000 7f79e97fa700 1 -- 172.21.15.26:0/3315747537 >> 172.21.15.26:0/3315747537 conn(0x7f7a040a2aa0 msgr2=0x7f7a041b8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:29.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.330+0000 7f79e97fa700 1 -- 172.21.15.26:0/3315747537 shutdown_connections 2023-10-01T07:55:29.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.331+0000 7f79e97fa700 1 -- 172.21.15.26:0/3315747537 wait complete. 2023-10-01T07:55:29.350 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:29.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.399+0000 7fd98083e700 1 -- 172.21.15.26:0/2737198863 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd97c139ee0 con 0x7fd97c136970 2023-10-01T07:55:29.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.400+0000 7fd96affd700 1 -- 172.21.15.26:0/2737198863 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd97402b090 con 0x7fd97c136970 2023-10-01T07:55:29.400 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:29.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.403+0000 7fd98083e700 1 -- 172.21.15.26:0/2737198863 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd97c136970 msgr2=0x7fd97c136dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:29.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.403+0000 7fd98083e700 1 --2- 172.21.15.26:0/2737198863 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd97c136970 0x7fd97c136dc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd974009f00 tx=0x7fd97400c3a0 comp rx=0 tx=0).stop 2023-10-01T07:55:29.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.403+0000 7fd98083e700 1 -- 172.21.15.26:0/2737198863 shutdown_connections 2023-10-01T07:55:29.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.403+0000 7fd98083e700 1 --2- 172.21.15.26:0/2737198863 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd97c136970 0x7fd97c136dc0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:29.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.403+0000 7fd98083e700 1 --2- 172.21.15.26:0/2737198863 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd97c06e570 0x7fd97c13e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:29.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.403+0000 7fd98083e700 1 --2- 172.21.15.26:0/2737198863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd97c06f050 0x7fd97c136430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:29.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.403+0000 7fd98083e700 1 -- 172.21.15.26:0/2737198863 >> 172.21.15.26:0/2737198863 conn(0x7fd97c0a2aa0 msgr2=0x7fd97c09ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:29.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.403+0000 7fd98083e700 1 -- 172.21.15.26:0/2737198863 shutdown_connections 2023-10-01T07:55:29.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.403+0000 7fd98083e700 1 -- 172.21.15.26:0/2737198863 wait complete. 2023-10-01T07:55:29.418 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:29.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.417+0000 7fd6bbb38700 1 -- 172.21.15.26:0/3488964378 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd6b4074ea0 con 0x7fd6b406a770 2023-10-01T07:55:29.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.418+0000 7fd6aa7fc700 1 -- 172.21.15.26:0/3488964378 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd6b00233d0 con 0x7fd6b406a770 2023-10-01T07:55:29.419 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:29.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.420+0000 7fd6bbb38700 1 -- 172.21.15.26:0/3488964378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6b406a770 msgr2=0x7fd6b411b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:29.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.420+0000 7fd6bbb38700 1 --2- 172.21.15.26:0/3488964378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6b406a770 0x7fd6b411b1c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd6b000b3c0 tx=0x7fd6b0004750 comp rx=0 tx=0).stop 2023-10-01T07:55:29.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.420+0000 7fd6bbb38700 1 -- 172.21.15.26:0/3488964378 shutdown_connections 2023-10-01T07:55:29.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.420+0000 7fd6bbb38700 1 --2- 172.21.15.26:0/3488964378 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6b413c1e0 0x7fd6b413aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:29.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.420+0000 7fd6bbb38700 1 --2- 172.21.15.26:0/3488964378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6b406a770 0x7fd6b411b1c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:29.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.420+0000 7fd6bbb38700 1 --2- 172.21.15.26:0/3488964378 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6b409dc30 0x7fd6b413a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:29.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.420+0000 7fd6bbb38700 1 -- 172.21.15.26:0/3488964378 >> 172.21.15.26:0/3488964378 conn(0x7fd6b4066f50 msgr2=0x7fd6b40a1590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:29.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.420+0000 7fd6bbb38700 1 -- 172.21.15.26:0/3488964378 shutdown_connections 2023-10-01T07:55:29.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.420+0000 7fd6bbb38700 1 -- 172.21.15.26:0/3488964378 wait complete. 2023-10-01T07:55:29.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:29.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.466+0000 7f110c38a700 1 -- 172.21.15.26:0/855783165 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1104074ea0 con 0x7f11040a0a30 2023-10-01T07:55:29.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.466+0000 7f10faffd700 1 -- 172.21.15.26:0/855783165 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f110001ae80 con 0x7f11040a0a30 2023-10-01T07:55:29.467 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:29.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.468+0000 7f110c38a700 1 -- 172.21.15.26:0/855783165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11040a0a30 msgr2=0x7f11041227e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:29.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.468+0000 7f110c38a700 1 --2- 172.21.15.26:0/855783165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11040a0a30 0x7f11041227e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f110000e9e0 tx=0x7f110000ecf0 comp rx=0 tx=0).stop 2023-10-01T07:55:29.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.469+0000 7f110c38a700 1 -- 172.21.15.26:0/855783165 shutdown_connections 2023-10-01T07:55:29.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.469+0000 7f110c38a700 1 --2- 172.21.15.26:0/855783165 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1104133fa0 0x7f1104123260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:29.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.469+0000 7f110c38a700 1 --2- 172.21.15.26:0/855783165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11040a0a30 0x7f11041227e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:29.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.469+0000 7f110c38a700 1 --2- 172.21.15.26:0/855783165 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f11040a1340 0x7f1104122d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:29.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.469+0000 7f110c38a700 1 -- 172.21.15.26:0/855783165 >> 172.21.15.26:0/855783165 conn(0x7f11040a6550 msgr2=0x7f110411c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:29.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.469+0000 7f110c38a700 1 -- 172.21.15.26:0/855783165 shutdown_connections 2023-10-01T07:55:29.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:29.469+0000 7f110c38a700 1 -- 172.21.15.26:0/855783165 wait complete. 2023-10-01T07:55:29.482 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:30.351 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:30.418 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:30.435 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:30.483 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:30.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.504+0000 7f9eef05b700 1 Processor -- start 2023-10-01T07:55:30.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.504+0000 7f9eef05b700 1 -- start start 2023-10-01T07:55:30.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.505+0000 7f9eef05b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9ee80a0a30 0x7f9ee80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:30.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.505+0000 7f9eef05b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ee80a1340 0x7f9ee8133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:30.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.505+0000 7f9eef05b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee809edd0 con 0x7f9ee8133fa0 2023-10-01T07:55:30.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.505+0000 7f9eef05b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ee809e1f0 con 0x7f9ee80a0a30 2023-10-01T07:55:30.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.505+0000 7f9eef05b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee809dc50 con 0x7f9ee80a1340 2023-10-01T07:55:30.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.505+0000 7f9eecdf7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9ee80a0a30 0x7f9ee80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:30.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.505+0000 7f9ee7fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ee80a1340 0x7f9ee8133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:30.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.505+0000 7f9eecdf7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9ee80a0a30 0x7f9ee80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40950/0 (socket says 172.21.15.26:40950) 2023-10-01T07:55:30.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.505+0000 7f9eecdf7700 1 -- 172.21.15.26:0/3403027032 learned_addr learned my addr 172.21.15.26:0/3403027032 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:30.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.505+0000 7f9eecdf7700 1 -- 172.21.15.26:0/3403027032 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ee80a1340 msgr2=0x7f9ee8133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:30.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.505+0000 7f9eecdf7700 1 --2- 172.21.15.26:0/3403027032 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ee80a1340 0x7f9ee8133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.505+0000 7f9eecdf7700 1 -- 172.21.15.26:0/3403027032 >> v1:172.21.15.26:6789/0 conn(0x7f9ee8133fa0 legacy=0x7f9ee813ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:30.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.505+0000 7f9eecdf7700 1 -- 172.21.15.26:0/3403027032 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee80a1fe0 con 0x7f9ee80a0a30 2023-10-01T07:55:30.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.505+0000 7f9ee7fff700 1 --2- 172.21.15.26:0/3403027032 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ee80a1340 0x7f9ee8133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:30.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.506+0000 7f9eecdf7700 1 --2- 172.21.15.26:0/3403027032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ee80a0a30 0x7f9ee80a0e00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9edc0098f0 tx=0x7f9edc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b38dccab76c73ba server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:30.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.506+0000 7f9ee77fe700 1 -- 172.21.15.26:0/3403027032 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc011830 con 0x7f9ee80a0a30 2023-10-01T07:55:30.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.506+0000 7f9ee77fe700 1 -- 172.21.15.26:0/3403027032 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9edc011990 con 0x7f9ee80a0a30 2023-10-01T07:55:30.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.506+0000 7f9ee77fe700 1 -- 172.21.15.26:0/3403027032 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc011d20 con 0x7f9ee80a0a30 2023-10-01T07:55:30.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.507+0000 7f9eef05b700 1 -- 172.21.15.26:0/3403027032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ee80a0a30 msgr2=0x7f9ee80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:30.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.507+0000 7f9eef05b700 1 --2- 172.21.15.26:0/3403027032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ee80a0a30 0x7f9ee80a0e00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9edc0098f0 tx=0x7f9edc009c00 comp rx=0 tx=0).stop 2023-10-01T07:55:30.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.507+0000 7f9eef05b700 1 -- 172.21.15.26:0/3403027032 shutdown_connections 2023-10-01T07:55:30.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.507+0000 7f9eef05b700 1 --2- 172.21.15.26:0/3403027032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ee80a0a30 0x7f9ee80a0e00 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.507+0000 7f9eef05b700 1 --2- 172.21.15.26:0/3403027032 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ee80a1340 0x7f9ee8133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.507+0000 7f9eef05b700 1 -- 172.21.15.26:0/3403027032 >> 172.21.15.26:0/3403027032 conn(0x7f9ee80a6550 msgr2=0x7f9ee80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:30.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.507+0000 7f9eef05b700 1 -- 172.21.15.26:0/3403027032 shutdown_connections 2023-10-01T07:55:30.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.507+0000 7f9eef05b700 1 -- 172.21.15.26:0/3403027032 wait complete. 2023-10-01T07:55:30.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.508+0000 7f9eef05b700 1 Processor -- start 2023-10-01T07:55:30.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.508+0000 7f9eef05b700 1 -- start start 2023-10-01T07:55:30.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.509+0000 7f9eef05b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ee80a0a30 0x7f9ee81c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:30.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.509+0000 7f9eef05b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ee80a1340 0x7f9ee81c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:30.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.509+0000 7f9eef05b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ee8133fa0 0x7f9ee81c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:30.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.509+0000 7f9eef05b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee8124820 con 0x7f9ee8133fa0 2023-10-01T07:55:30.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.509+0000 7f9eef05b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee8133730 con 0x7f9ee80a1340 2023-10-01T07:55:30.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.509+0000 7f9eef05b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee81257a0 con 0x7f9ee80a0a30 2023-10-01T07:55:30.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.509+0000 7f9eed5f8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ee8133fa0 0x7f9ee81c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:30.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.509+0000 7f9eecdf7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ee80a0a30 0x7f9ee81c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:30.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.509+0000 7f9eed5f8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ee8133fa0 0x7f9ee81c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40958/0 (socket says 172.21.15.26:40958) 2023-10-01T07:55:30.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.509+0000 7f9eed5f8700 1 -- 172.21.15.26:0/4000939194 learned_addr learned my addr 172.21.15.26:0/4000939194 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:30.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.509+0000 7f9eecdf7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ee80a0a30 0x7f9ee81c85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59558/0 (socket says 172.21.15.26:59558) 2023-10-01T07:55:30.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.509+0000 7f9ee7fff700 1 --2- 172.21.15.26:0/4000939194 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ee80a1340 0x7f9ee81c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:30.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.509+0000 7f9eed5f8700 1 -- 172.21.15.26:0/4000939194 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ee80a0a30 msgr2=0x7f9ee81c85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:30.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.509+0000 7f9eed5f8700 1 --2- 172.21.15.26:0/4000939194 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ee80a0a30 0x7f9ee81c85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.509+0000 7f9eed5f8700 1 -- 172.21.15.26:0/4000939194 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ee80a1340 msgr2=0x7f9ee81c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:30.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.509+0000 7f9eed5f8700 1 --2- 172.21.15.26:0/4000939194 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ee80a1340 0x7f9ee81c8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.509+0000 7f9eed5f8700 1 -- 172.21.15.26:0/4000939194 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed40094a0 con 0x7f9ee8133fa0 2023-10-01T07:55:30.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.509+0000 7f9ee7fff700 1 --2- 172.21.15.26:0/4000939194 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ee80a1340 0x7f9ee81c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:30.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.510+0000 7f9eed5f8700 1 --2- 172.21.15.26:0/4000939194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ee8133fa0 0x7f9ee81c9040 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9ee000cc50 tx=0x7f9ee000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:30.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.510+0000 7f9ee57fa700 1 -- 172.21.15.26:0/4000939194 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee0003c00 con 0x7f9ee8133fa0 2023-10-01T07:55:30.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.510+0000 7f9ee57fa700 1 -- 172.21.15.26:0/4000939194 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee0003d60 con 0x7f9ee8133fa0 2023-10-01T07:55:30.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.510+0000 7f9eef05b700 1 -- 172.21.15.26:0/4000939194 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9edc009550 con 0x7f9ee8133fa0 2023-10-01T07:55:30.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.510+0000 7f9eef05b700 1 -- 172.21.15.26:0/4000939194 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee8126190 con 0x7f9ee8133fa0 2023-10-01T07:55:30.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.511+0000 7f9ee57fa700 1 -- 172.21.15.26:0/4000939194 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee000aab0 con 0x7f9ee8133fa0 2023-10-01T07:55:30.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.511+0000 7f9ee57fa700 1 -- 172.21.15.26:0/4000939194 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9ee000ac50 con 0x7f9ee8133fa0 2023-10-01T07:55:30.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.511+0000 7f9ee57fa700 1 -- 172.21.15.26:0/4000939194 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9ee003f640 con 0x7f9ee8133fa0 2023-10-01T07:55:30.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.511+0000 7f9eef05b700 1 -- 172.21.15.26:0/4000939194 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec80052e0 con 0x7f9ee8133fa0 2023-10-01T07:55:30.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.521+0000 7f9ee57fa700 1 -- 172.21.15.26:0/4000939194 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9ee00198f0 con 0x7f9ee8133fa0 2023-10-01T07:55:30.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.570+0000 7f7528f79700 1 Processor -- start 2023-10-01T07:55:30.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.570+0000 7f7528f79700 1 -- start start 2023-10-01T07:55:30.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.571+0000 7f7528f79700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f75241338a0 0x7f7524133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:30.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.571+0000 7f7528f79700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f752409de50 0x7f752409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:30.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.571+0000 7f7528f79700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f752406ef30 con 0x7f752409e760 2023-10-01T07:55:30.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.571+0000 7f7528f79700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752406fef0 con 0x7f75241338a0 2023-10-01T07:55:30.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.571+0000 7f7528f79700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75241334b0 con 0x7f752409de50 2023-10-01T07:55:30.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.571+0000 7f752259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f75241338a0 0x7f7524133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:30.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.571+0000 7f752259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f75241338a0 0x7f7524133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:53642/0 (socket says 172.21.15.26:53642) 2023-10-01T07:55:30.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.571+0000 7f752259c700 1 -- 172.21.15.26:0/170122676 learned_addr learned my addr 172.21.15.26:0/170122676 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:30.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.571+0000 7f7521d9b700 1 --2- 172.21.15.26:0/170122676 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f752409de50 0x7f752409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:30.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.571+0000 7f752159a700 1 -- 172.21.15.26:0/170122676 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4121310933 0 0) 0x7f752406ef30 con 0x7f752409e760 2023-10-01T07:55:30.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.571+0000 7f752259c700 1 -- 172.21.15.26:0/170122676 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f752409de50 msgr2=0x7f752409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:30.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.571+0000 7f752259c700 1 --2- 172.21.15.26:0/170122676 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f752409de50 0x7f752409e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.571+0000 7f752259c700 1 -- 172.21.15.26:0/170122676 >> v1:172.21.15.26:6789/0 conn(0x7f752409e760 legacy=0x7f752413a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:30.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.571+0000 7f752259c700 1 -- 172.21.15.26:0/170122676 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752406fc30 con 0x7f75241338a0 2023-10-01T07:55:30.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.572+0000 7f752259c700 1 --2- 172.21.15.26:0/170122676 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f75241338a0 0x7f7524133c70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7514009920 tx=0x7f7514009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aaeef94632a59cc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:30.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.572+0000 7f752159a700 1 -- 172.21.15.26:0/170122676 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7514011830 con 0x7f75241338a0 2023-10-01T07:55:30.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.572+0000 7f752159a700 1 -- 172.21.15.26:0/170122676 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7514011990 con 0x7f75241338a0 2023-10-01T07:55:30.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.572+0000 7f752159a700 1 -- 172.21.15.26:0/170122676 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7514011d20 con 0x7f75241338a0 2023-10-01T07:55:30.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.573+0000 7f7528f79700 1 -- 172.21.15.26:0/170122676 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f75241338a0 msgr2=0x7f7524133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:30.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.573+0000 7f7528f79700 1 --2- 172.21.15.26:0/170122676 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f75241338a0 0x7f7524133c70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7514009920 tx=0x7f7514009c30 comp rx=0 tx=0).stop 2023-10-01T07:55:30.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.573+0000 7f7528f79700 1 -- 172.21.15.26:0/170122676 shutdown_connections 2023-10-01T07:55:30.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.573+0000 7f7528f79700 1 --2- 172.21.15.26:0/170122676 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f75241338a0 0x7f7524133c70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.573+0000 7f7528f79700 1 --2- 172.21.15.26:0/170122676 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f752409de50 0x7f752409e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.573+0000 7f7528f79700 1 -- 172.21.15.26:0/170122676 >> 172.21.15.26:0/170122676 conn(0x7f75240a2aa0 msgr2=0x7f75240a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:30.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.573+0000 7f7528f79700 1 -- 172.21.15.26:0/170122676 shutdown_connections 2023-10-01T07:55:30.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.573+0000 7f7528f79700 1 -- 172.21.15.26:0/170122676 wait complete. 2023-10-01T07:55:30.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.575+0000 7f7528f79700 1 Processor -- start 2023-10-01T07:55:30.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.575+0000 7f7528f79700 1 -- start start 2023-10-01T07:55:30.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.576+0000 7f7528f79700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f752409de50 0x7f752411b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:30.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.576+0000 7f7528f79700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f752409e760 0x7f752411bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:30.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.576+0000 7f7528f79700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75241338a0 0x7f752411c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:30.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.576+0000 7f7528f79700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752411d270 con 0x7f75241338a0 2023-10-01T07:55:30.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.576+0000 7f7528f79700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752411d820 con 0x7f752409e760 2023-10-01T07:55:30.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.576+0000 7f7528f79700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f752411e450 con 0x7f752409de50 2023-10-01T07:55:30.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.576+0000 7f752259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f752409de50 0x7f752411b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:30.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.576+0000 7f752259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f752409de50 0x7f752411b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59568/0 (socket says 172.21.15.26:59568) 2023-10-01T07:55:30.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.576+0000 7f752259c700 1 -- 172.21.15.26:0/1789254905 learned_addr learned my addr 172.21.15.26:0/1789254905 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:30.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.576+0000 7f7521d9b700 1 --2- 172.21.15.26:0/1789254905 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f752409e760 0x7f752411bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:30.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.576+0000 7f7522d9d700 1 --2- 172.21.15.26:0/1789254905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75241338a0 0x7f752411c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:30.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.576+0000 7f752259c700 1 -- 172.21.15.26:0/1789254905 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f752409e760 msgr2=0x7f752411bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:30.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.576+0000 7f752259c700 1 --2- 172.21.15.26:0/1789254905 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f752409e760 0x7f752411bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.576+0000 7f752259c700 1 -- 172.21.15.26:0/1789254905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75241338a0 msgr2=0x7f752411c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:30.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.576+0000 7f752259c700 1 --2- 172.21.15.26:0/1789254905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75241338a0 0x7f752411c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.576+0000 7f752259c700 1 -- 172.21.15.26:0/1789254905 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7514009550 con 0x7f752409de50 2023-10-01T07:55:30.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.577+0000 7f752259c700 1 --2- 172.21.15.26:0/1789254905 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f752409de50 0x7f752411b6b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7514009c70 tx=0x7f7514004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:30.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.577+0000 7f7512ffd700 1 -- 172.21.15.26:0/1789254905 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7514004450 con 0x7f752409de50 2023-10-01T07:55:30.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.577+0000 7f7512ffd700 1 -- 172.21.15.26:0/1789254905 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75140045b0 con 0x7f752409de50 2023-10-01T07:55:30.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.577+0000 7f7528f79700 1 -- 172.21.15.26:0/1789254905 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f752411ee30 con 0x7f752409de50 2023-10-01T07:55:30.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.577+0000 7f7512ffd700 1 -- 172.21.15.26:0/1789254905 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75140038c0 con 0x7f752409de50 2023-10-01T07:55:30.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.577+0000 7f7528f79700 1 -- 172.21.15.26:0/1789254905 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f752406f640 con 0x7f752409de50 2023-10-01T07:55:30.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.578+0000 7f7512ffd700 1 -- 172.21.15.26:0/1789254905 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7514003a20 con 0x7f752409de50 2023-10-01T07:55:30.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.578+0000 7f7512ffd700 1 -- 172.21.15.26:0/1789254905 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7514040720 con 0x7f752409de50 2023-10-01T07:55:30.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.578+0000 7f7528f79700 1 -- 172.21.15.26:0/1789254905 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7524074ea0 con 0x7f752409de50 2023-10-01T07:55:30.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.588+0000 7f7512ffd700 1 -- 172.21.15.26:0/1789254905 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f751401a420 con 0x7f752409de50 2023-10-01T07:55:30.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.616+0000 7f46c5c8a700 1 Processor -- start 2023-10-01T07:55:30.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.616+0000 7f46c5c8a700 1 -- start start 2023-10-01T07:55:30.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.617+0000 7f46c5c8a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f46c01305f0 0x7f46c01309c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:30.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.617+0000 7f46c5c8a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f46c006f660 0x7f46c006fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:30.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.617+0000 7f46c5c8a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f46c006ff90 0x7f46c0137530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:30.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.617+0000 7f46c5c8a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c01301c0 con 0x7f46c006f660 2023-10-01T07:55:30.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.617+0000 7f46c5c8a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c0071ff0 con 0x7f46c006ff90 2023-10-01T07:55:30.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.617+0000 7f46c5c8a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46c0070e70 con 0x7f46c01305f0 2023-10-01T07:55:30.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.617+0000 7f46beffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f46c006f660 0x7f46c006fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:30.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.617+0000 7f46beffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f46c006f660 0x7f46c006fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40968/0 (socket says 172.21.15.26:40968) 2023-10-01T07:55:30.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.617+0000 7f46beffd700 1 -- 172.21.15.26:0/1105026557 learned_addr learned my addr 172.21.15.26:0/1105026557 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:30.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.617+0000 7f46bf7fe700 1 --2- 172.21.15.26:0/1105026557 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f46c01305f0 0x7f46c01309c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:30.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.618+0000 7f46bffff700 1 --2- 172.21.15.26:0/1105026557 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f46c006ff90 0x7f46c0137530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:30.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.618+0000 7f46beffd700 1 -- 172.21.15.26:0/1105026557 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f46c01305f0 msgr2=0x7f46c01309c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:30.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.618+0000 7f46beffd700 1 --2- 172.21.15.26:0/1105026557 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f46c01305f0 0x7f46c01309c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.618+0000 7f46beffd700 1 -- 172.21.15.26:0/1105026557 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f46c006ff90 msgr2=0x7f46c0137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:30.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.618+0000 7f46beffd700 1 --2- 172.21.15.26:0/1105026557 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f46c006ff90 0x7f46c0137530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.618+0000 7f46beffd700 1 -- 172.21.15.26:0/1105026557 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c00722b0 con 0x7f46c006f660 2023-10-01T07:55:30.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.618+0000 7f46bffff700 1 --2- 172.21.15.26:0/1105026557 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f46c006ff90 0x7f46c0137530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:55:30.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.618+0000 7f46beffd700 1 --2- 172.21.15.26:0/1105026557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46c006f660 0x7f46c006fa50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f46b40098f0 tx=0x7f46b4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ad7dd2e189bf44 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:30.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.618+0000 7f46be7fc700 1 -- 172.21.15.26:0/1105026557 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b4011830 con 0x7f46c006f660 2023-10-01T07:55:30.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.618+0000 7f46be7fc700 1 -- 172.21.15.26:0/1105026557 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b4011990 con 0x7f46c006f660 2023-10-01T07:55:30.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.618+0000 7f46be7fc700 1 -- 172.21.15.26:0/1105026557 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b4011d20 con 0x7f46c006f660 2023-10-01T07:55:30.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.619+0000 7f46c5c8a700 1 -- 172.21.15.26:0/1105026557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46c006f660 msgr2=0x7f46c006fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:30.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.619+0000 7f46c5c8a700 1 --2- 172.21.15.26:0/1105026557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46c006f660 0x7f46c006fa50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f46b40098f0 tx=0x7f46b4009c00 comp rx=0 tx=0).stop 2023-10-01T07:55:30.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.619+0000 7f46c5c8a700 1 -- 172.21.15.26:0/1105026557 shutdown_connections 2023-10-01T07:55:30.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.619+0000 7f46c5c8a700 1 --2- 172.21.15.26:0/1105026557 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f46c006ff90 0x7f46c0137530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.619+0000 7f46c5c8a700 1 --2- 172.21.15.26:0/1105026557 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f46c01305f0 0x7f46c01309c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.619+0000 7f46c5c8a700 1 --2- 172.21.15.26:0/1105026557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46c006f660 0x7f46c006fa50 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.619+0000 7f46c5c8a700 1 -- 172.21.15.26:0/1105026557 >> 172.21.15.26:0/1105026557 conn(0x7f46c00a2aa0 msgr2=0x7f46c00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:30.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.619+0000 7f46c5c8a700 1 -- 172.21.15.26:0/1105026557 shutdown_connections 2023-10-01T07:55:30.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.619+0000 7f46c5c8a700 1 -- 172.21.15.26:0/1105026557 wait complete. 2023-10-01T07:55:30.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.620+0000 7f46c5c8a700 1 Processor -- start 2023-10-01T07:55:30.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.621+0000 7f46c5c8a700 1 -- start start 2023-10-01T07:55:30.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.621+0000 7f46c5c8a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f46c006f660 0x7f46c0138430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:30.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.621+0000 7f46c5c8a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f46c006ff90 0x7f46c0138970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:30.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.621+0000 7f46c5c8a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46c01305f0 0x7f46c01c8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:30.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.621+0000 7f46c5c8a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c0135480 con 0x7f46c01305f0 2023-10-01T07:55:30.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.621+0000 7f46c5c8a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c0137120 con 0x7f46c006ff90 2023-10-01T07:55:30.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.621+0000 7f46c5c8a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46c012e560 con 0x7f46c006f660 2023-10-01T07:55:30.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.622+0000 7f46bffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46c01305f0 0x7f46c01c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:30.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.622+0000 7f46bf7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f46c006f660 0x7f46c0138430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:30.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.622+0000 7f46bffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46c01305f0 0x7f46c01c8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40972/0 (socket says 172.21.15.26:40972) 2023-10-01T07:55:30.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.622+0000 7f46bf7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f46c006f660 0x7f46c0138430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59578/0 (socket says 172.21.15.26:59578) 2023-10-01T07:55:30.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.622+0000 7f46bffff700 1 -- 172.21.15.26:0/2319282412 learned_addr learned my addr 172.21.15.26:0/2319282412 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:30.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.622+0000 7f46beffd700 1 --2- 172.21.15.26:0/2319282412 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f46c006ff90 0x7f46c0138970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:30.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.622+0000 7f46bffff700 1 -- 172.21.15.26:0/2319282412 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f46c006f660 msgr2=0x7f46c0138430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:30.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.622+0000 7f46bffff700 1 --2- 172.21.15.26:0/2319282412 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f46c006f660 0x7f46c0138430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.622+0000 7f46bffff700 1 -- 172.21.15.26:0/2319282412 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f46c006ff90 msgr2=0x7f46c0138970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:30.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.622+0000 7f46bffff700 1 --2- 172.21.15.26:0/2319282412 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f46c006ff90 0x7f46c0138970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.622+0000 7f46bffff700 1 -- 172.21.15.26:0/2319282412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b4009550 con 0x7f46c01305f0 2023-10-01T07:55:30.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.622+0000 7f46beffd700 1 --2- 172.21.15.26:0/2319282412 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f46c006ff90 0x7f46c0138970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:55:30.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.622+0000 7f46bf7fe700 1 --2- 172.21.15.26:0/2319282412 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f46c006f660 0x7f46c0138430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:30.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.622+0000 7f46bffff700 1 --2- 172.21.15.26:0/2319282412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46c01305f0 0x7f46c01c8070 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f46b800cef0 tx=0x7f46b800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:30.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.623+0000 7f46a7fff700 1 -- 172.21.15.26:0/2319282412 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b800adb0 con 0x7f46c01305f0 2023-10-01T07:55:30.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.623+0000 7f46a7fff700 1 -- 172.21.15.26:0/2319282412 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b8015440 con 0x7f46c01305f0 2023-10-01T07:55:30.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.623+0000 7f46a7fff700 1 -- 172.21.15.26:0/2319282412 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b80157f0 con 0x7f46c01305f0 2023-10-01T07:55:30.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.623+0000 7f46c5c8a700 1 -- 172.21.15.26:0/2319282412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c01359d0 con 0x7f46c01305f0 2023-10-01T07:55:30.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.623+0000 7f46c5c8a700 1 -- 172.21.15.26:0/2319282412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c0137390 con 0x7f46c01305f0 2023-10-01T07:55:30.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.624+0000 7f46c5c8a700 1 -- 172.21.15.26:0/2319282412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c0136f80 con 0x7f46c01305f0 2023-10-01T07:55:30.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.624+0000 7f46a7fff700 1 -- 172.21.15.26:0/2319282412 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f46b800d430 con 0x7f46c01305f0 2023-10-01T07:55:30.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.624+0000 7f46a7fff700 1 -- 172.21.15.26:0/2319282412 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f46b803fce0 con 0x7f46c01305f0 2023-10-01T07:55:30.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.634+0000 7f46a7fff700 1 -- 172.21.15.26:0/2319282412 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f46c0136f80 con 0x7f46c01305f0 2023-10-01T07:55:30.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.659+0000 7fa7a1960700 1 Processor -- start 2023-10-01T07:55:30.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.659+0000 7fa7a1960700 1 -- start start 2023-10-01T07:55:30.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.660+0000 7fa7a1960700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa79c1338a0 0x7fa79c133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:30.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.660+0000 7fa7a1960700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa79c09de50 0x7fa79c09e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:30.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.660+0000 7fa7a1960700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa79c09e760 0x7fa79c13a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:30.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.660+0000 7fa7a1960700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa79c06fef0 con 0x7fa79c09de50 2023-10-01T07:55:30.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.660+0000 7fa7a1960700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c06ef30 con 0x7fa79c09e760 2023-10-01T07:55:30.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.660+0000 7fa7a1960700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c1334b0 con 0x7fa79c1338a0 2023-10-01T07:55:30.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.660+0000 7fa79b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa79c09e760 0x7fa79c13a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:30.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.660+0000 7fa79b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa79c09e760 0x7fa79c13a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:53696/0 (socket says 172.21.15.26:53696) 2023-10-01T07:55:30.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.660+0000 7fa79b7fe700 1 -- 172.21.15.26:0/151258738 learned_addr learned my addr 172.21.15.26:0/151258738 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:30.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.660+0000 7fa79affd700 1 --2- 172.21.15.26:0/151258738 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa79c1338a0 0x7fa79c133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:30.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.660+0000 7fa79a7fc700 1 --2- 172.21.15.26:0/151258738 >> v2:172.21.15.26:3300/0 conn(0x7fa79c09de50 0x7fa79c09e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:30.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.661+0000 7fa79a7fc700 1 -- 172.21.15.26:0/151258738 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa79c1338a0 msgr2=0x7fa79c133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:30.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.661+0000 7fa79a7fc700 1 --2- 172.21.15.26:0/151258738 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa79c1338a0 0x7fa79c133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.661+0000 7fa79a7fc700 1 -- 172.21.15.26:0/151258738 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa79c09e760 msgr2=0x7fa79c13a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:30.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.661+0000 7fa79a7fc700 1 --2- 172.21.15.26:0/151258738 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa79c09e760 0x7fa79c13a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.661+0000 7fa79a7fc700 1 -- 172.21.15.26:0/151258738 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79c06fc30 con 0x7fa79c09de50 2023-10-01T07:55:30.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.661+0000 7fa79affd700 1 --2- 172.21.15.26:0/151258738 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa79c1338a0 0x7fa79c133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:30.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.661+0000 7fa79a7fc700 1 --2- 172.21.15.26:0/151258738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa79c09de50 0x7fa79c09e220 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa790009840 tx=0x7fa790009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d02cd4a31dc84624 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:30.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.661+0000 7fa799ffb700 1 -- 172.21.15.26:0/151258738 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa790011830 con 0x7fa79c09de50 2023-10-01T07:55:30.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.661+0000 7fa799ffb700 1 -- 172.21.15.26:0/151258738 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa790011990 con 0x7fa79c09de50 2023-10-01T07:55:30.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.661+0000 7fa799ffb700 1 -- 172.21.15.26:0/151258738 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa790011d20 con 0x7fa79c09de50 2023-10-01T07:55:30.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.662+0000 7fa7a1960700 1 -- 172.21.15.26:0/151258738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa79c09de50 msgr2=0x7fa79c09e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:30.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.662+0000 7fa7a1960700 1 --2- 172.21.15.26:0/151258738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa79c09de50 0x7fa79c09e220 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa790009840 tx=0x7fa790009b50 comp rx=0 tx=0).stop 2023-10-01T07:55:30.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.662+0000 7fa7a1960700 1 -- 172.21.15.26:0/151258738 shutdown_connections 2023-10-01T07:55:30.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.662+0000 7fa7a1960700 1 --2- 172.21.15.26:0/151258738 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa79c09e760 0x7fa79c13a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.662+0000 7fa7a1960700 1 --2- 172.21.15.26:0/151258738 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa79c1338a0 0x7fa79c133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.662+0000 7fa7a1960700 1 --2- 172.21.15.26:0/151258738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa79c09de50 0x7fa79c09e220 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.662+0000 7fa7a1960700 1 -- 172.21.15.26:0/151258738 >> 172.21.15.26:0/151258738 conn(0x7fa79c0a2aa0 msgr2=0x7fa79c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:30.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.662+0000 7fa7a1960700 1 -- 172.21.15.26:0/151258738 shutdown_connections 2023-10-01T07:55:30.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.662+0000 7fa7a1960700 1 -- 172.21.15.26:0/151258738 wait complete. 2023-10-01T07:55:30.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.663+0000 7fa7a1960700 1 Processor -- start 2023-10-01T07:55:30.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.664+0000 7fa7a1960700 1 -- start start 2023-10-01T07:55:30.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.664+0000 7fa7a1960700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa79c09de50 0x7fa79c11d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:30.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.664+0000 7fa7a1960700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa79c09e760 0x7fa79c11dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:30.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.664+0000 7fa7a1960700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa79c1338a0 0x7fa79c11e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:30.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.664+0000 7fa7a1960700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c120fe0 con 0x7fa79c09e760 2023-10-01T07:55:30.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.664+0000 7fa7a1960700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c11f330 con 0x7fa79c1338a0 2023-10-01T07:55:30.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.664+0000 7fa7a1960700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c11f930 con 0x7fa79c09de50 2023-10-01T07:55:30.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.665+0000 7fa79affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa79c09de50 0x7fa79c11d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:30.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.665+0000 7fa79affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa79c09de50 0x7fa79c11d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59608/0 (socket says 172.21.15.26:59608) 2023-10-01T07:55:30.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.665+0000 7fa79affd700 1 -- 172.21.15.26:0/4043345802 learned_addr learned my addr 172.21.15.26:0/4043345802 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:30.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.665+0000 7fa79b7fe700 1 --2- 172.21.15.26:0/4043345802 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa79c1338a0 0x7fa79c11e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:30.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.665+0000 7fa79a7fc700 1 --2- 172.21.15.26:0/4043345802 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa79c09e760 0x7fa79c11dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:30.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.665+0000 7fa79a7fc700 1 -- 172.21.15.26:0/4043345802 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa79c09de50 msgr2=0x7fa79c11d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:30.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.665+0000 7fa79a7fc700 1 --2- 172.21.15.26:0/4043345802 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa79c09de50 0x7fa79c11d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.665+0000 7fa79a7fc700 1 -- 172.21.15.26:0/4043345802 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa79c1338a0 msgr2=0x7fa79c11e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:30.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.665+0000 7fa79a7fc700 1 --2- 172.21.15.26:0/4043345802 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa79c1338a0 0x7fa79c11e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.665+0000 7fa79a7fc700 1 -- 172.21.15.26:0/4043345802 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa78c0094a0 con 0x7fa79c09e760 2023-10-01T07:55:30.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.665+0000 7fa79affd700 1 --2- 172.21.15.26:0/4043345802 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa79c09de50 0x7fa79c11d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:30.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.665+0000 7fa79a7fc700 1 --2- 172.21.15.26:0/4043345802 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa79c09e760 0x7fa79c11dd40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa790016000 tx=0x7fa790004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:30.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.666+0000 7fa783fff700 1 -- 172.21.15.26:0/4043345802 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa790004450 con 0x7fa79c09e760 2023-10-01T07:55:30.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.666+0000 7fa783fff700 1 -- 172.21.15.26:0/4043345802 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79001e070 con 0x7fa79c09e760 2023-10-01T07:55:30.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.666+0000 7fa7a1960700 1 -- 172.21.15.26:0/4043345802 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7900094a0 con 0x7fa79c09e760 2023-10-01T07:55:30.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.666+0000 7fa783fff700 1 -- 172.21.15.26:0/4043345802 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7900038c0 con 0x7fa79c09e760 2023-10-01T07:55:30.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.666+0000 7fa7a1960700 1 -- 172.21.15.26:0/4043345802 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa79c0a0ff0 con 0x7fa79c09e760 2023-10-01T07:55:30.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.667+0000 7fa783fff700 1 -- 172.21.15.26:0/4043345802 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa790003a20 con 0x7fa79c09e760 2023-10-01T07:55:30.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.667+0000 7fa7a1960700 1 -- 172.21.15.26:0/4043345802 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa79c06f6a0 con 0x7fa79c09e760 2023-10-01T07:55:30.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.667+0000 7fa783fff700 1 -- 172.21.15.26:0/4043345802 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa7900402b0 con 0x7fa79c09e760 2023-10-01T07:55:30.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.677+0000 7fa783fff700 1 -- 172.21.15.26:0/4043345802 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa7900045b0 con 0x7fa79c09e760 2023-10-01T07:55:30.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.742+0000 7f9eef05b700 1 -- 172.21.15.26:0/4000939194 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9ec8005590 con 0x7f9ee8133fa0 2023-10-01T07:55:30.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.742+0000 7f9ee57fa700 1 -- 172.21.15.26:0/4000939194 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9ee0029090 con 0x7f9ee8133fa0 2023-10-01T07:55:30.743 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:30.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.745+0000 7f9eef05b700 1 -- 172.21.15.26:0/4000939194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ee8133fa0 msgr2=0x7f9ee81c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:30.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.745+0000 7f9eef05b700 1 --2- 172.21.15.26:0/4000939194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ee8133fa0 0x7f9ee81c9040 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9ee000cc50 tx=0x7f9ee000cf60 comp rx=0 tx=0).stop 2023-10-01T07:55:30.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.746+0000 7f9eef05b700 1 -- 172.21.15.26:0/4000939194 shutdown_connections 2023-10-01T07:55:30.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.746+0000 7f9eef05b700 1 --2- 172.21.15.26:0/4000939194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ee8133fa0 0x7f9ee81c9040 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.746+0000 7f9eef05b700 1 --2- 172.21.15.26:0/4000939194 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ee80a0a30 0x7f9ee81c85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.746+0000 7f9eef05b700 1 --2- 172.21.15.26:0/4000939194 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ee80a1340 0x7f9ee81c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.746+0000 7f9eef05b700 1 -- 172.21.15.26:0/4000939194 >> 172.21.15.26:0/4000939194 conn(0x7f9ee80a6550 msgr2=0x7f9ee811c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:30.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.746+0000 7f9eef05b700 1 -- 172.21.15.26:0/4000939194 shutdown_connections 2023-10-01T07:55:30.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.746+0000 7f9eef05b700 1 -- 172.21.15.26:0/4000939194 wait complete. 2023-10-01T07:55:30.766 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:30.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.812+0000 7f7528f79700 1 -- 172.21.15.26:0/1789254905 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f752411e960 con 0x7f752409de50 2023-10-01T07:55:30.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.812+0000 7f7512ffd700 1 -- 172.21.15.26:0/1789254905 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7514015020 con 0x7f752409de50 2023-10-01T07:55:30.813 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:30.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.815+0000 7f7528f79700 1 -- 172.21.15.26:0/1789254905 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f752409de50 msgr2=0x7f752411b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:30.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.815+0000 7f7528f79700 1 --2- 172.21.15.26:0/1789254905 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f752409de50 0x7f752411b6b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7514009c70 tx=0x7f7514004750 comp rx=0 tx=0).stop 2023-10-01T07:55:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.815+0000 7f7528f79700 1 -- 172.21.15.26:0/1789254905 shutdown_connections 2023-10-01T07:55:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.815+0000 7f7528f79700 1 --2- 172.21.15.26:0/1789254905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75241338a0 0x7f752411c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.815+0000 7f7528f79700 1 --2- 172.21.15.26:0/1789254905 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f752409de50 0x7f752411b6b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.815+0000 7f7528f79700 1 --2- 172.21.15.26:0/1789254905 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f752409e760 0x7f752411bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.815+0000 7f7528f79700 1 -- 172.21.15.26:0/1789254905 >> 172.21.15.26:0/1789254905 conn(0x7f75240a2aa0 msgr2=0x7f75241306c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.815+0000 7f7528f79700 1 -- 172.21.15.26:0/1789254905 shutdown_connections 2023-10-01T07:55:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.815+0000 7f7528f79700 1 -- 172.21.15.26:0/1789254905 wait complete. 2023-10-01T07:55:30.829 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:30.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.849+0000 7f46c5c8a700 1 -- 172.21.15.26:0/2319282412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f46c0136f80 con 0x7f46c01305f0 2023-10-01T07:55:30.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.849+0000 7f46a7fff700 1 -- 172.21.15.26:0/2319282412 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f46c0136f80 con 0x7f46c01305f0 2023-10-01T07:55:30.850 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:30.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.852+0000 7f46c5c8a700 1 -- 172.21.15.26:0/2319282412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46c01305f0 msgr2=0x7f46c01c8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:30.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.852+0000 7f46c5c8a700 1 --2- 172.21.15.26:0/2319282412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46c01305f0 0x7f46c01c8070 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f46b800cef0 tx=0x7f46b800cf20 comp rx=0 tx=0).stop 2023-10-01T07:55:30.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.852+0000 7f46c5c8a700 1 -- 172.21.15.26:0/2319282412 shutdown_connections 2023-10-01T07:55:30.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.852+0000 7f46c5c8a700 1 --2- 172.21.15.26:0/2319282412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46c01305f0 0x7f46c01c8070 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.852+0000 7f46c5c8a700 1 --2- 172.21.15.26:0/2319282412 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f46c006f660 0x7f46c0138430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.852+0000 7f46c5c8a700 1 --2- 172.21.15.26:0/2319282412 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f46c006ff90 0x7f46c0138970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.852+0000 7f46c5c8a700 1 -- 172.21.15.26:0/2319282412 >> 172.21.15.26:0/2319282412 conn(0x7f46c00a2aa0 msgr2=0x7f46c00a1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:30.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.852+0000 7f46c5c8a700 1 -- 172.21.15.26:0/2319282412 shutdown_connections 2023-10-01T07:55:30.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.852+0000 7f46c5c8a700 1 -- 172.21.15.26:0/2319282412 wait complete. 2023-10-01T07:55:30.866 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:30.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.894+0000 7fa7a1960700 1 -- 172.21.15.26:0/4043345802 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa79c11a470 con 0x7fa79c09e760 2023-10-01T07:55:30.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.894+0000 7fa783fff700 1 -- 172.21.15.26:0/4043345802 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa790015020 con 0x7fa79c09e760 2023-10-01T07:55:30.895 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:30.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.896+0000 7fa7a1960700 1 -- 172.21.15.26:0/4043345802 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa79c09e760 msgr2=0x7fa79c11dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:30.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.896+0000 7fa7a1960700 1 --2- 172.21.15.26:0/4043345802 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa79c09e760 0x7fa79c11dd40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa790016000 tx=0x7fa790004750 comp rx=0 tx=0).stop 2023-10-01T07:55:30.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.897+0000 7fa7a1960700 1 -- 172.21.15.26:0/4043345802 shutdown_connections 2023-10-01T07:55:30.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.897+0000 7fa7a1960700 1 --2- 172.21.15.26:0/4043345802 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa79c1338a0 0x7fa79c11e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.897+0000 7fa7a1960700 1 --2- 172.21.15.26:0/4043345802 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa79c09de50 0x7fa79c11d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.897+0000 7fa7a1960700 1 --2- 172.21.15.26:0/4043345802 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa79c09e760 0x7fa79c11dd40 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:30.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.897+0000 7fa7a1960700 1 -- 172.21.15.26:0/4043345802 >> 172.21.15.26:0/4043345802 conn(0x7fa79c0a2aa0 msgr2=0x7fa79c1bae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:30.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.897+0000 7fa7a1960700 1 -- 172.21.15.26:0/4043345802 shutdown_connections 2023-10-01T07:55:30.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:30.897+0000 7fa7a1960700 1 -- 172.21.15.26:0/4043345802 wait complete. 2023-10-01T07:55:30.910 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:31.767 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:31.830 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:31.867 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:31.912 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:31.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.917+0000 7f2865615700 1 Processor -- start 2023-10-01T07:55:31.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.917+0000 7f2865615700 1 -- start start 2023-10-01T07:55:31.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.917+0000 7f2865615700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f286009d6f0 0x7f286009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:31.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.917+0000 7f2865615700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f286009e000 0x7f28601339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:31.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.917+0000 7f2865615700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f286009b120 con 0x7f286009e410 2023-10-01T07:55:31.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.917+0000 7f2865615700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f286006b460 con 0x7f286009e000 2023-10-01T07:55:31.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.917+0000 7f2865615700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f286009a7e0 con 0x7f286009d6f0 2023-10-01T07:55:31.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.918+0000 7f285e7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f286009e000 0x7f28601339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:31.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.918+0000 7f285effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f286009d6f0 0x7f286009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:31.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.918+0000 7f285effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f286009d6f0 0x7f286009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59620/0 (socket says 172.21.15.26:59620) 2023-10-01T07:55:31.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.918+0000 7f285effd700 1 -- 172.21.15.26:0/363196488 learned_addr learned my addr 172.21.15.26:0/363196488 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:31.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.918+0000 7f285e7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f286009e000 0x7f28601339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:53708/0 (socket says 172.21.15.26:53708) 2023-10-01T07:55:31.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.918+0000 7f285e7fc700 1 -- 172.21.15.26:0/363196488 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f286009d6f0 msgr2=0x7f286009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:31.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.918+0000 7f285e7fc700 1 --2- 172.21.15.26:0/363196488 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f286009d6f0 0x7f286009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:31.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.918+0000 7f285e7fc700 1 -- 172.21.15.26:0/363196488 >> v1:172.21.15.26:6789/0 conn(0x7f286009e410 legacy=0x7f2860133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:31.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.918+0000 7f285dffb700 1 -- 172.21.15.26:0/363196488 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1161711121 0 0) 0x7f286009b120 con 0x7f286009e410 2023-10-01T07:55:31.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.918+0000 7f285e7fc700 1 -- 172.21.15.26:0/363196488 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286009a500 con 0x7f286009e000 2023-10-01T07:55:31.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.918+0000 7f285e7fc700 1 --2- 172.21.15.26:0/363196488 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f286009e000 0x7f28601339f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2854009870 tx=0x7f2854009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46f0859195e15fec server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:31.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.919+0000 7f285dffb700 1 -- 172.21.15.26:0/363196488 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2854011830 con 0x7f286009e000 2023-10-01T07:55:31.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.919+0000 7f285dffb700 1 -- 172.21.15.26:0/363196488 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2854011990 con 0x7f286009e000 2023-10-01T07:55:31.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.919+0000 7f285dffb700 1 -- 172.21.15.26:0/363196488 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2854011d20 con 0x7f286009e000 2023-10-01T07:55:31.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.920+0000 7f2865615700 1 -- 172.21.15.26:0/363196488 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f286009e000 msgr2=0x7f28601339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:31.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.920+0000 7f2865615700 1 --2- 172.21.15.26:0/363196488 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f286009e000 0x7f28601339f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2854009870 tx=0x7f2854009b80 comp rx=0 tx=0).stop 2023-10-01T07:55:31.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.920+0000 7f2865615700 1 -- 172.21.15.26:0/363196488 shutdown_connections 2023-10-01T07:55:31.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.920+0000 7f2865615700 1 --2- 172.21.15.26:0/363196488 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f286009d6f0 0x7f286009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:31.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.920+0000 7f2865615700 1 --2- 172.21.15.26:0/363196488 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f286009e000 0x7f28601339f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:31.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.920+0000 7f2865615700 1 -- 172.21.15.26:0/363196488 >> 172.21.15.26:0/363196488 conn(0x7f2860066f50 msgr2=0x7f286009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:31.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.920+0000 7f2865615700 1 -- 172.21.15.26:0/363196488 shutdown_connections 2023-10-01T07:55:31.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.920+0000 7f2865615700 1 -- 172.21.15.26:0/363196488 wait complete. 2023-10-01T07:55:31.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.922+0000 7f2865615700 1 Processor -- start 2023-10-01T07:55:31.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.922+0000 7f2865615700 1 -- start start 2023-10-01T07:55:31.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.922+0000 7f2865615700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f286009d6f0 0x7f28601223b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:31.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.922+0000 7f2865615700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f286009e000 0x7f28601228f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:31.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.922+0000 7f2865615700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f286009e410 0x7f2860122e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:31.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.922+0000 7f2865615700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2860125ed0 con 0x7f286009e000 2023-10-01T07:55:31.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.922+0000 7f2865615700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2860124e70 con 0x7f286009e410 2023-10-01T07:55:31.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.922+0000 7f2865615700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28601259c0 con 0x7f286009d6f0 2023-10-01T07:55:31.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.923+0000 7f285effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f286009d6f0 0x7f28601223b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:31.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.923+0000 7f285effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f286009d6f0 0x7f28601223b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59622/0 (socket says 172.21.15.26:59622) 2023-10-01T07:55:31.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.923+0000 7f285effd700 1 -- 172.21.15.26:0/3869148327 learned_addr learned my addr 172.21.15.26:0/3869148327 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:31.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.923+0000 7f285f7fe700 1 --2- 172.21.15.26:0/3869148327 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f286009e410 0x7f2860122e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:31.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.923+0000 7f285e7fc700 1 --2- 172.21.15.26:0/3869148327 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f286009e000 0x7f28601228f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:31.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.923+0000 7f285f7fe700 1 -- 172.21.15.26:0/3869148327 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f286009d6f0 msgr2=0x7f28601223b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:31.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.923+0000 7f285f7fe700 1 --2- 172.21.15.26:0/3869148327 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f286009d6f0 0x7f28601223b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:31.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.923+0000 7f285f7fe700 1 -- 172.21.15.26:0/3869148327 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f286009e000 msgr2=0x7f28601228f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:31.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.923+0000 7f285f7fe700 1 --2- 172.21.15.26:0/3869148327 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f286009e000 0x7f28601228f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:31.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.923+0000 7f285f7fe700 1 -- 172.21.15.26:0/3869148327 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28540094a0 con 0x7f286009e410 2023-10-01T07:55:31.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.923+0000 7f285e7fc700 1 --2- 172.21.15.26:0/3869148327 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f286009e000 0x7f28601228f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:31.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.923+0000 7f285effd700 1 --2- 172.21.15.26:0/3869148327 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f286009d6f0 0x7f28601223b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:31.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.923+0000 7f285f7fe700 1 --2- 172.21.15.26:0/3869148327 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f286009e410 0x7f2860122e30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f286009e8b0 tx=0x7f285800caa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:31.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.924+0000 7f28477fe700 1 -- 172.21.15.26:0/3869148327 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2858003e30 con 0x7f286009e410 2023-10-01T07:55:31.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.924+0000 7f28477fe700 1 -- 172.21.15.26:0/3869148327 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2858005070 con 0x7f286009e410 2023-10-01T07:55:31.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.924+0000 7f2865615700 1 -- 172.21.15.26:0/3869148327 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2860125660 con 0x7f286009e410 2023-10-01T07:55:31.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.924+0000 7f28477fe700 1 -- 172.21.15.26:0/3869148327 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2858005420 con 0x7f286009e410 2023-10-01T07:55:31.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.924+0000 7f2865615700 1 -- 172.21.15.26:0/3869148327 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2860072100 con 0x7f286009e410 2023-10-01T07:55:31.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.925+0000 7f28477fe700 1 -- 172.21.15.26:0/3869148327 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2858005580 con 0x7f286009e410 2023-10-01T07:55:31.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.925+0000 7f2865615700 1 -- 172.21.15.26:0/3869148327 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f286011f030 con 0x7f286009e410 2023-10-01T07:55:31.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.925+0000 7f28477fe700 1 -- 172.21.15.26:0/3869148327 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f285803ec30 con 0x7f286009e410 2023-10-01T07:55:31.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.930+0000 7f28477fe700 1 -- 172.21.15.26:0/3869148327 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2858045080 con 0x7f286009e410 2023-10-01T07:55:31.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.975+0000 7fca009d5700 1 Processor -- start 2023-10-01T07:55:31.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.975+0000 7fca009d5700 1 -- start start 2023-10-01T07:55:31.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.976+0000 7fca009d5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc9fc06a770 0x7fc9fc06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:31.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.976+0000 7fca009d5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc9fc06b080 0x7fc9fc131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:31.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.976+0000 7fca009d5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9fc131b40 0x7fc9fc131fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:31.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.976+0000 7fca009d5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9fc09ece0 con 0x7fc9fc06a770 2023-10-01T07:55:31.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.976+0000 7fca009d5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc09e760 con 0x7fc9fc131b40 2023-10-01T07:55:31.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.976+0000 7fca009d5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc09e040 con 0x7fc9fc06b080 2023-10-01T07:55:31.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.976+0000 7fc9fad9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9fc131b40 0x7fc9fc131fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:31.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.976+0000 7fc9f9d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc9fc06b080 0x7fc9fc131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:31.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.976+0000 7fc9fad9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9fc131b40 0x7fc9fc131fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:53726/0 (socket says 172.21.15.26:53726) 2023-10-01T07:55:31.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.976+0000 7fc9fad9d700 1 -- 172.21.15.26:0/648601413 learned_addr learned my addr 172.21.15.26:0/648601413 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:31.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.976+0000 7fc9fa59c700 1 --2- 172.21.15.26:0/648601413 >> v2:172.21.15.26:3300/0 conn(0x7fc9fc06a770 0x7fc9fc06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:31.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.977+0000 7fc9fa59c700 1 -- 172.21.15.26:0/648601413 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc9fc06b080 msgr2=0x7fc9fc131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:31.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.977+0000 7fc9fa59c700 1 --2- 172.21.15.26:0/648601413 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc9fc06b080 0x7fc9fc131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:31.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.977+0000 7fc9fa59c700 1 -- 172.21.15.26:0/648601413 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9fc131b40 msgr2=0x7fc9fc131fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:31.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.977+0000 7fc9fa59c700 1 --2- 172.21.15.26:0/648601413 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9fc131b40 0x7fc9fc131fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:31.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.977+0000 7fc9fa59c700 1 -- 172.21.15.26:0/648601413 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9fc09f630 con 0x7fc9fc06a770 2023-10-01T07:55:31.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.977+0000 7fc9fad9d700 1 --2- 172.21.15.26:0/648601413 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9fc131b40 0x7fc9fc131fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:31.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.977+0000 7fc9fa59c700 1 --2- 172.21.15.26:0/648601413 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9fc06a770 0x7fc9fc06ab40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec009840 tx=0x7fc9ec009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=945510c4e82e0ba4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:31.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.977+0000 7fc9f959a700 1 -- 172.21.15.26:0/648601413 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec011830 con 0x7fc9fc06a770 2023-10-01T07:55:31.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.977+0000 7fc9f959a700 1 -- 172.21.15.26:0/648601413 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ec011990 con 0x7fc9fc06a770 2023-10-01T07:55:31.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.977+0000 7fc9f959a700 1 -- 172.21.15.26:0/648601413 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec011d20 con 0x7fc9fc06a770 2023-10-01T07:55:31.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.978+0000 7fca009d5700 1 -- 172.21.15.26:0/648601413 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9fc06a770 msgr2=0x7fc9fc06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:31.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.978+0000 7fca009d5700 1 --2- 172.21.15.26:0/648601413 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9fc06a770 0x7fc9fc06ab40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec009840 tx=0x7fc9ec009b50 comp rx=0 tx=0).stop 2023-10-01T07:55:31.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.978+0000 7fca009d5700 1 -- 172.21.15.26:0/648601413 shutdown_connections 2023-10-01T07:55:31.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.978+0000 7fca009d5700 1 --2- 172.21.15.26:0/648601413 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9fc131b40 0x7fc9fc131fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:31.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.978+0000 7fca009d5700 1 --2- 172.21.15.26:0/648601413 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9fc06a770 0x7fc9fc06ab40 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:31.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.978+0000 7fca009d5700 1 --2- 172.21.15.26:0/648601413 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc9fc06b080 0x7fc9fc131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:31.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.978+0000 7fca009d5700 1 -- 172.21.15.26:0/648601413 >> 172.21.15.26:0/648601413 conn(0x7fc9fc066f50 msgr2=0x7fc9fc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:31.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.978+0000 7fca009d5700 1 -- 172.21.15.26:0/648601413 shutdown_connections 2023-10-01T07:55:31.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.978+0000 7fca009d5700 1 -- 172.21.15.26:0/648601413 wait complete. 2023-10-01T07:55:31.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.980+0000 7fca009d5700 1 Processor -- start 2023-10-01T07:55:31.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.980+0000 7fca009d5700 1 -- start start 2023-10-01T07:55:31.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.980+0000 7fca009d5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9fc06a770 0x7fc9fc11c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:31.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.980+0000 7fca009d5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9fc06b080 0x7fc9fc11c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:31.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.980+0000 7fca009d5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc9fc131b40 0x7fc9fc11cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:31.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.980+0000 7fca009d5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc11fdb0 con 0x7fc9fc06a770 2023-10-01T07:55:31.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.980+0000 7fca009d5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc131530 con 0x7fc9fc06b080 2023-10-01T07:55:31.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.980+0000 7fca009d5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc11e650 con 0x7fc9fc131b40 2023-10-01T07:55:31.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.980+0000 7fc9f9d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9fc06b080 0x7fc9fc11c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:31.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.980+0000 7fc9f9d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9fc06b080 0x7fc9fc11c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:53740/0 (socket says 172.21.15.26:53740) 2023-10-01T07:55:31.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.980+0000 7fc9f9d9b700 1 -- 172.21.15.26:0/3963333370 learned_addr learned my addr 172.21.15.26:0/3963333370 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:31.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.980+0000 7fc9fa59c700 1 --2- 172.21.15.26:0/3963333370 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9fc06a770 0x7fc9fc11c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:31.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.981+0000 7fc9fad9d700 1 --2- 172.21.15.26:0/3963333370 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc9fc131b40 0x7fc9fc11cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:31.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.981+0000 7fc9f9d9b700 1 -- 172.21.15.26:0/3963333370 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc9fc131b40 msgr2=0x7fc9fc11cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:31.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.981+0000 7fc9f9d9b700 1 --2- 172.21.15.26:0/3963333370 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc9fc131b40 0x7fc9fc11cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:31.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.981+0000 7fc9f9d9b700 1 -- 172.21.15.26:0/3963333370 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9fc06a770 msgr2=0x7fc9fc11c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:31.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.981+0000 7fc9f9d9b700 1 --2- 172.21.15.26:0/3963333370 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9fc06a770 0x7fc9fc11c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:31.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.981+0000 7fc9f9d9b700 1 -- 172.21.15.26:0/3963333370 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f4009b30 con 0x7fc9fc06b080 2023-10-01T07:55:31.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.981+0000 7fc9f9d9b700 1 --2- 172.21.15.26:0/3963333370 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9fc06b080 0x7fc9fc11c9d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc9f000e9b0 tx=0x7fc9f000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:31.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.981+0000 7fc9eaffd700 1 -- 172.21.15.26:0/3963333370 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f0009710 con 0x7fc9fc06b080 2023-10-01T07:55:31.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.981+0000 7fc9eaffd700 1 -- 172.21.15.26:0/3963333370 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f000ee50 con 0x7fc9fc06b080 2023-10-01T07:55:31.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.981+0000 7fca009d5700 1 -- 172.21.15.26:0/3963333370 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9ec0094a0 con 0x7fc9fc06b080 2023-10-01T07:55:31.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.981+0000 7fc9eaffd700 1 -- 172.21.15.26:0/3963333370 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f000ca50 con 0x7fc9fc06b080 2023-10-01T07:55:31.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.982+0000 7fca009d5700 1 -- 172.21.15.26:0/3963333370 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9fc1206b0 con 0x7fc9fc06b080 2023-10-01T07:55:31.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.983+0000 7fc9eaffd700 1 -- 172.21.15.26:0/3963333370 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc9f000cbb0 con 0x7fc9fc06b080 2023-10-01T07:55:31.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.983+0000 7fc9eaffd700 1 -- 172.21.15.26:0/3963333370 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc9f003fac0 con 0x7fc9fc06b080 2023-10-01T07:55:31.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.983+0000 7fca009d5700 1 -- 172.21.15.26:0/3963333370 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9fc074ea0 con 0x7fc9fc06b080 2023-10-01T07:55:31.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:31.988+0000 7fc9eaffd700 1 -- 172.21.15.26:0/3963333370 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc9f0017080 con 0x7fc9fc06b080 2023-10-01T07:55:32.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.023+0000 7fa966294700 1 Processor -- start 2023-10-01T07:55:32.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.023+0000 7fa966294700 1 -- start start 2023-10-01T07:55:32.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.024+0000 7fa966294700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa96009d6f0 0x7fa96009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:32.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.024+0000 7fa966294700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa96009e000 0x7fa960130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:32.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.024+0000 7fa966294700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa96009f130 con 0x7fa96009e410 2023-10-01T07:55:32.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.024+0000 7fa966294700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa96009f520 con 0x7fa96009d6f0 2023-10-01T07:55:32.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.024+0000 7fa966294700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa96009e930 con 0x7fa96009e000 2023-10-01T07:55:32.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.024+0000 7fa95ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa96009d6f0 0x7fa96009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:32.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.024+0000 7fa95ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa96009d6f0 0x7fa96009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41030/0 (socket says 172.21.15.26:41030) 2023-10-01T07:55:32.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.024+0000 7fa95ffff700 1 -- 172.21.15.26:0/1847273355 learned_addr learned my addr 172.21.15.26:0/1847273355 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:32.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.024+0000 7fa95f7fe700 1 --2- 172.21.15.26:0/1847273355 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa96009e000 0x7fa960130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:32.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.025+0000 7fa95f7fe700 1 -- 172.21.15.26:0/1847273355 >> v2:172.21.15.26:3300/0 conn(0x7fa96009d6f0 msgr2=0x7fa96009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:32.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.025+0000 7fa95f7fe700 1 --2- 172.21.15.26:0/1847273355 >> v2:172.21.15.26:3300/0 conn(0x7fa96009d6f0 0x7fa96009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:32.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.025+0000 7fa95f7fe700 1 -- 172.21.15.26:0/1847273355 >> v1:172.21.15.26:6789/0 conn(0x7fa96009e410 legacy=0x7fa960130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:32.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.025+0000 7fa95f7fe700 1 -- 172.21.15.26:0/1847273355 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa96009b2d0 con 0x7fa96009e000 2023-10-01T07:55:32.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.025+0000 7fa95f7fe700 1 --2- 172.21.15.26:0/1847273355 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa96009e000 0x7fa960130660 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa954009840 tx=0x7fa954009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fac7414df4079deb server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:32.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.025+0000 7fa95effd700 1 -- 172.21.15.26:0/1847273355 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa954011830 con 0x7fa96009e000 2023-10-01T07:55:32.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.025+0000 7fa95effd700 1 -- 172.21.15.26:0/1847273355 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa954011990 con 0x7fa96009e000 2023-10-01T07:55:32.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.025+0000 7fa95effd700 1 -- 172.21.15.26:0/1847273355 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa954011d20 con 0x7fa96009e000 2023-10-01T07:55:32.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.026+0000 7fa966294700 1 -- 172.21.15.26:0/1847273355 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa96009e000 msgr2=0x7fa960130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:32.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.026+0000 7fa966294700 1 --2- 172.21.15.26:0/1847273355 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa96009e000 0x7fa960130660 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa954009840 tx=0x7fa954009b50 comp rx=0 tx=0).stop 2023-10-01T07:55:32.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.026+0000 7fa966294700 1 -- 172.21.15.26:0/1847273355 shutdown_connections 2023-10-01T07:55:32.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.026+0000 7fa966294700 1 --2- 172.21.15.26:0/1847273355 >> v2:172.21.15.26:3300/0 conn(0x7fa96009d6f0 0x7fa96009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:32.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.026+0000 7fa966294700 1 --2- 172.21.15.26:0/1847273355 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa96009e000 0x7fa960130660 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:32.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.026+0000 7fa966294700 1 -- 172.21.15.26:0/1847273355 >> 172.21.15.26:0/1847273355 conn(0x7fa960066f50 msgr2=0x7fa96009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:32.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.026+0000 7fa966294700 1 -- 172.21.15.26:0/1847273355 shutdown_connections 2023-10-01T07:55:32.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.026+0000 7fa966294700 1 -- 172.21.15.26:0/1847273355 wait complete. 2023-10-01T07:55:32.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.028+0000 7fa966294700 1 Processor -- start 2023-10-01T07:55:32.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.028+0000 7fa966294700 1 -- start start 2023-10-01T07:55:32.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.029+0000 7fa966294700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa96009d6f0 0x7fa960131630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:32.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.029+0000 7fa966294700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa96009e000 0x7fa960131b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:32.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.029+0000 7fa966294700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa96009e410 0x7fa9601320b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:32.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.029+0000 7fa966294700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa960134390 con 0x7fa96009d6f0 2023-10-01T07:55:32.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.029+0000 7fa966294700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa960133530 con 0x7fa96009e000 2023-10-01T07:55:32.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.029+0000 7fa966294700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa960132de0 con 0x7fa96009e410 2023-10-01T07:55:32.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.029+0000 7fa964831700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa96009e410 0x7fa9601320b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:32.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.029+0000 7fa95f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa96009e000 0x7fa960131b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:32.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.029+0000 7fa95f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa96009e000 0x7fa960131b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:53754/0 (socket says 172.21.15.26:53754) 2023-10-01T07:55:32.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.029+0000 7fa95f7fe700 1 -- 172.21.15.26:0/18469403 learned_addr learned my addr 172.21.15.26:0/18469403 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:32.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.029+0000 7fa964831700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa96009e410 0x7fa9601320b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59654/0 (socket says 172.21.15.26:59654) 2023-10-01T07:55:32.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.029+0000 7fa95ffff700 1 --2- 172.21.15.26:0/18469403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa96009d6f0 0x7fa960131630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:32.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.029+0000 7fa964831700 1 -- 172.21.15.26:0/18469403 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa96009e000 msgr2=0x7fa960131b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:32.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.030+0000 7fa964831700 1 --2- 172.21.15.26:0/18469403 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa96009e000 0x7fa960131b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:32.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.030+0000 7fa964831700 1 -- 172.21.15.26:0/18469403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa96009d6f0 msgr2=0x7fa960131630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:32.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.030+0000 7fa964831700 1 --2- 172.21.15.26:0/18469403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa96009d6f0 0x7fa960131630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:32.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.030+0000 7fa964831700 1 -- 172.21.15.26:0/18469403 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9540094a0 con 0x7fa96009e410 2023-10-01T07:55:32.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.030+0000 7fa95f7fe700 1 --2- 172.21.15.26:0/18469403 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa96009e000 0x7fa960131b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:32.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.030+0000 7fa964831700 1 --2- 172.21.15.26:0/18469403 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa96009e410 0x7fa9601320b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa958010fa0 tx=0x7fa95800a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:32.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.030+0000 7fa95cff9700 1 -- 172.21.15.26:0/18469403 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95800ac70 con 0x7fa96009e410 2023-10-01T07:55:32.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.030+0000 7fa95cff9700 1 -- 172.21.15.26:0/18469403 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95800add0 con 0x7fa96009e410 2023-10-01T07:55:32.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.030+0000 7fa966294700 1 -- 172.21.15.26:0/18469403 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa96009c700 con 0x7fa96009e410 2023-10-01T07:55:32.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.030+0000 7fa95cff9700 1 -- 172.21.15.26:0/18469403 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa958003c40 con 0x7fa96009e410 2023-10-01T07:55:32.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.030+0000 7fa966294700 1 -- 172.21.15.26:0/18469403 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa960134be0 con 0x7fa96009e410 2023-10-01T07:55:32.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.031+0000 7fa95cff9700 1 -- 172.21.15.26:0/18469403 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa9580050d0 con 0x7fa96009e410 2023-10-01T07:55:32.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.031+0000 7fa95cff9700 1 -- 172.21.15.26:0/18469403 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa9580431f0 con 0x7fa96009e410 2023-10-01T07:55:32.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.031+0000 7fa966294700 1 -- 172.21.15.26:0/18469403 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa960074ea0 con 0x7fa96009e410 2023-10-01T07:55:32.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.036+0000 7fa95cff9700 1 -- 172.21.15.26:0/18469403 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa958018400 con 0x7fa96009e410 2023-10-01T07:55:32.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.068+0000 7fddcf07f700 1 Processor -- start 2023-10-01T07:55:32.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.068+0000 7fddcf07f700 1 -- start start 2023-10-01T07:55:32.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.068+0000 7fddcf07f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc809d630 0x7fddc80a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:32.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.068+0000 7fddcf07f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fddc8138d80 0x7fddc813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:32.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.069+0000 7fddcf07f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddc80a2a70 con 0x7fddc80a0a30 2023-10-01T07:55:32.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.069+0000 7fddcf07f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddc80a01d0 con 0x7fddc8138d80 2023-10-01T07:55:32.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.069+0000 7fddcf07f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc809e2b0 con 0x7fddc809d630 2023-10-01T07:55:32.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.069+0000 7fddcce1b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fddc80a0a30 0x7fddc80a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38636/0 (socket says 172.21.15.26:38636) 2023-10-01T07:55:32.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.069+0000 7fddcce1b700 1 -- 172.21.15.26:0/827404280 learned_addr learned my addr 172.21.15.26:0/827404280 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:32.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.069+0000 7fddcd61c700 1 --2- 172.21.15.26:0/827404280 >> v2:172.21.15.26:3300/0 conn(0x7fddc8138d80 0x7fddc813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:32.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.069+0000 7fddcd61c700 1 -- 172.21.15.26:0/827404280 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc809d630 msgr2=0x7fddc80a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:32.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.069+0000 7fddcd61c700 1 --2- 172.21.15.26:0/827404280 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc809d630 0x7fddc80a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:32.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.069+0000 7fddcd61c700 1 -- 172.21.15.26:0/827404280 >> v1:172.21.15.26:6789/0 conn(0x7fddc80a0a30 legacy=0x7fddc80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:32.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.069+0000 7fddcd61c700 1 -- 172.21.15.26:0/827404280 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc809dc50 con 0x7fddc8138d80 2023-10-01T07:55:32.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.069+0000 7fddcd61c700 1 --2- 172.21.15.26:0/827404280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddc8138d80 0x7fddc813b160 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fddbc009840 tx=0x7fddbc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7267f58744b30d44 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:32.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.071+0000 7fddc77fe700 1 -- 172.21.15.26:0/827404280 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc011830 con 0x7fddc8138d80 2023-10-01T07:55:32.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.071+0000 7fddc77fe700 1 -- 172.21.15.26:0/827404280 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddbc011990 con 0x7fddc8138d80 2023-10-01T07:55:32.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.071+0000 7fddc77fe700 1 -- 172.21.15.26:0/827404280 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc011d20 con 0x7fddc8138d80 2023-10-01T07:55:32.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.071+0000 7fddcf07f700 1 -- 172.21.15.26:0/827404280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddc8138d80 msgr2=0x7fddc813b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:32.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.071+0000 7fddcf07f700 1 --2- 172.21.15.26:0/827404280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddc8138d80 0x7fddc813b160 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fddbc009840 tx=0x7fddbc009b50 comp rx=0 tx=0).stop 2023-10-01T07:55:32.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.072+0000 7fddcf07f700 1 -- 172.21.15.26:0/827404280 shutdown_connections 2023-10-01T07:55:32.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.072+0000 7fddcf07f700 1 --2- 172.21.15.26:0/827404280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddc8138d80 0x7fddc813b160 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:32.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.072+0000 7fddcf07f700 1 --2- 172.21.15.26:0/827404280 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc809d630 0x7fddc80a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:32.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.072+0000 7fddcf07f700 1 -- 172.21.15.26:0/827404280 >> 172.21.15.26:0/827404280 conn(0x7fddc80a3050 msgr2=0x7fddc80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:32.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.072+0000 7fddcf07f700 1 -- 172.21.15.26:0/827404280 shutdown_connections 2023-10-01T07:55:32.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.072+0000 7fddcf07f700 1 -- 172.21.15.26:0/827404280 wait complete. 2023-10-01T07:55:32.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.073+0000 7fddcf07f700 1 Processor -- start 2023-10-01T07:55:32.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.073+0000 7fddcf07f700 1 -- start start 2023-10-01T07:55:32.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.074+0000 7fddcf07f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fddc809d630 0x7fddc8133830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:32.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.074+0000 7fddcf07f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddc80a0a30 0x7fddc8133d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:32.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.074+0000 7fddcf07f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc8138d80 0x7fddc81342b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:32.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.074+0000 7fddcf07f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc80a0410 con 0x7fddc80a0a30 2023-10-01T07:55:32.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.074+0000 7fddcf07f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc8136d20 con 0x7fddc8138d80 2023-10-01T07:55:32.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.074+0000 7fddcf07f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddc80a4c90 con 0x7fddc809d630 2023-10-01T07:55:32.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.074+0000 7fddc7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddc80a0a30 0x7fddc8133d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:32.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.074+0000 7fddcd61c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc8138d80 0x7fddc81342b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:32.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.074+0000 7fddcd61c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc8138d80 0x7fddc81342b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:53774/0 (socket says 172.21.15.26:53774) 2023-10-01T07:55:32.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.074+0000 7fddc7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddc80a0a30 0x7fddc8133d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41060/0 (socket says 172.21.15.26:41060) 2023-10-01T07:55:32.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.074+0000 7fddcd61c700 1 -- 172.21.15.26:0/136878124 learned_addr learned my addr 172.21.15.26:0/136878124 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:32.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.075+0000 7fddcd61c700 1 -- 172.21.15.26:0/136878124 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fddc809d630 msgr2=0x7fddc8133830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:32.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.075+0000 7fddcd61c700 1 --2- 172.21.15.26:0/136878124 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fddc809d630 0x7fddc8133830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:32.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.075+0000 7fddcd61c700 1 -- 172.21.15.26:0/136878124 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddc80a0a30 msgr2=0x7fddc8133d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:32.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.075+0000 7fddcd61c700 1 --2- 172.21.15.26:0/136878124 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddc80a0a30 0x7fddc8133d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:32.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.075+0000 7fddcd61c700 1 -- 172.21.15.26:0/136878124 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddbc0094a0 con 0x7fddc8138d80 2023-10-01T07:55:32.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.075+0000 7fddcd61c700 1 --2- 172.21.15.26:0/136878124 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc8138d80 0x7fddc81342b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fddbc013000 tx=0x7fddbc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:32.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.075+0000 7fddc57fa700 1 -- 172.21.15.26:0/136878124 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc0036a0 con 0x7fddc8138d80 2023-10-01T07:55:32.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.075+0000 7fddc57fa700 1 -- 172.21.15.26:0/136878124 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddbc01f070 con 0x7fddc8138d80 2023-10-01T07:55:32.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.075+0000 7fddcf07f700 1 -- 172.21.15.26:0/136878124 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc8136fe0 con 0x7fddc8138d80 2023-10-01T07:55:32.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.075+0000 7fddc57fa700 1 -- 172.21.15.26:0/136878124 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc003a40 con 0x7fddc8138d80 2023-10-01T07:55:32.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.076+0000 7fddcf07f700 1 -- 172.21.15.26:0/136878124 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddc8137a50 con 0x7fddc8138d80 2023-10-01T07:55:32.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.077+0000 7fddc57fa700 1 -- 172.21.15.26:0/136878124 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fddbc003ba0 con 0x7fddc8138d80 2023-10-01T07:55:32.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.077+0000 7fddc57fa700 1 -- 172.21.15.26:0/136878124 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fddbc021070 con 0x7fddc8138d80 2023-10-01T07:55:32.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.077+0000 7fddcf07f700 1 -- 172.21.15.26:0/136878124 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddc80747f0 con 0x7fddc8138d80 2023-10-01T07:55:32.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.087+0000 7fddc57fa700 1 -- 172.21.15.26:0/136878124 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fddbc01a430 con 0x7fddc8138d80 2023-10-01T07:55:32.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.219+0000 7f2865615700 1 -- 172.21.15.26:0/3869148327 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2860074ea0 con 0x7f286009e410 2023-10-01T07:55:32.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.220+0000 7f28477fe700 1 -- 172.21.15.26:0/3869148327 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2858017030 con 0x7f286009e410 2023-10-01T07:55:32.220 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:32.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.222+0000 7f2865615700 1 -- 172.21.15.26:0/3869148327 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f286009e410 msgr2=0x7f2860122e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:32.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.222+0000 7f2865615700 1 --2- 172.21.15.26:0/3869148327 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f286009e410 0x7f2860122e30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f286009e8b0 tx=0x7f285800caa0 comp rx=0 tx=0).stop 2023-10-01T07:55:32.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.222+0000 7f2865615700 1 -- 172.21.15.26:0/3869148327 shutdown_connections 2023-10-01T07:55:32.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.222+0000 7f2865615700 1 --2- 172.21.15.26:0/3869148327 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f286009e410 0x7f2860122e30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:32.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.222+0000 7f2865615700 1 --2- 172.21.15.26:0/3869148327 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f286009d6f0 0x7f28601223b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:32.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.222+0000 7f2865615700 1 --2- 172.21.15.26:0/3869148327 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f286009e000 0x7f28601228f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:32.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.222+0000 7f2865615700 1 -- 172.21.15.26:0/3869148327 >> 172.21.15.26:0/3869148327 conn(0x7f2860066f50 msgr2=0x7f2860133de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:32.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.222+0000 7f2865615700 1 -- 172.21.15.26:0/3869148327 shutdown_connections 2023-10-01T07:55:32.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.222+0000 7f2865615700 1 -- 172.21.15.26:0/3869148327 wait complete. 2023-10-01T07:55:32.237 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:32.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.257+0000 7fa966294700 1 -- 172.21.15.26:0/18469403 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa960134700 con 0x7fa96009e410 2023-10-01T07:55:32.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.257+0000 7fa95cff9700 1 -- 172.21.15.26:0/18469403 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa958016310 con 0x7fa96009e410 2023-10-01T07:55:32.258 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:32.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.261+0000 7fa966294700 1 -- 172.21.15.26:0/18469403 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa96009e410 msgr2=0x7fa9601320b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:32.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.261+0000 7fa966294700 1 --2- 172.21.15.26:0/18469403 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa96009e410 0x7fa9601320b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa958010fa0 tx=0x7fa95800a340 comp rx=0 tx=0).stop 2023-10-01T07:55:32.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.261+0000 7fa966294700 1 -- 172.21.15.26:0/18469403 shutdown_connections 2023-10-01T07:55:32.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.261+0000 7fa966294700 1 --2- 172.21.15.26:0/18469403 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa96009e410 0x7fa9601320b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:32.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.261+0000 7fa966294700 1 --2- 172.21.15.26:0/18469403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa96009d6f0 0x7fa960131630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:32.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.261+0000 7fa966294700 1 --2- 172.21.15.26:0/18469403 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa96009e000 0x7fa960131b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:32.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.261+0000 7fa966294700 1 -- 172.21.15.26:0/18469403 >> 172.21.15.26:0/18469403 conn(0x7fa960066f50 msgr2=0x7fa9600a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:32.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.261+0000 7fa966294700 1 -- 172.21.15.26:0/18469403 shutdown_connections 2023-10-01T07:55:32.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.261+0000 7fa966294700 1 -- 172.21.15.26:0/18469403 wait complete. 2023-10-01T07:55:32.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.274+0000 7fca009d5700 1 -- 172.21.15.26:0/3963333370 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc9fc06c360 con 0x7fc9fc06b080 2023-10-01T07:55:32.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.275+0000 7fc9eaffd700 1 -- 172.21.15.26:0/3963333370 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc9f0021020 con 0x7fc9fc06b080 2023-10-01T07:55:32.275 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:32.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.277+0000 7fca009d5700 1 -- 172.21.15.26:0/3963333370 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9fc06b080 msgr2=0x7fc9fc11c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:32.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.277+0000 7fca009d5700 1 --2- 172.21.15.26:0/3963333370 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9fc06b080 0x7fc9fc11c9d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc9f000e9b0 tx=0x7fc9f000ecc0 comp rx=0 tx=0).stop 2023-10-01T07:55:32.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.277+0000 7fca009d5700 1 -- 172.21.15.26:0/3963333370 shutdown_connections 2023-10-01T07:55:32.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.277+0000 7fca009d5700 1 --2- 172.21.15.26:0/3963333370 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc9fc131b40 0x7fc9fc11cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:32.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.277+0000 7fca009d5700 1 --2- 172.21.15.26:0/3963333370 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9fc06a770 0x7fc9fc11c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:32.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.277+0000 7fca009d5700 1 --2- 172.21.15.26:0/3963333370 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9fc06b080 0x7fc9fc11c9d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:32.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.277+0000 7fca009d5700 1 -- 172.21.15.26:0/3963333370 >> 172.21.15.26:0/3963333370 conn(0x7fc9fc066f50 msgr2=0x7fc9fc070110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:32.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.278+0000 7fca009d5700 1 -- 172.21.15.26:0/3963333370 shutdown_connections 2023-10-01T07:55:32.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.278+0000 7fca009d5700 1 -- 172.21.15.26:0/3963333370 wait complete. 2023-10-01T07:55:32.281 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:32.292 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:32.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.310+0000 7fddcf07f700 1 -- 172.21.15.26:0/136878124 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fddc8137ea0 con 0x7fddc8138d80 2023-10-01T07:55:32.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.310+0000 7fddc57fa700 1 -- 172.21.15.26:0/136878124 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fddbc015020 con 0x7fddc8138d80 2023-10-01T07:55:32.310 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:32.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.312+0000 7fddcf07f700 1 -- 172.21.15.26:0/136878124 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc8138d80 msgr2=0x7fddc81342b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:32.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.312+0000 7fddcf07f700 1 --2- 172.21.15.26:0/136878124 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc8138d80 0x7fddc81342b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fddbc013000 tx=0x7fddbc004750 comp rx=0 tx=0).stop 2023-10-01T07:55:32.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.313+0000 7fddcf07f700 1 -- 172.21.15.26:0/136878124 shutdown_connections 2023-10-01T07:55:32.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.313+0000 7fddcf07f700 1 --2- 172.21.15.26:0/136878124 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc8138d80 0x7fddc81342b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:32.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.313+0000 7fddcf07f700 1 --2- 172.21.15.26:0/136878124 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fddc809d630 0x7fddc8133830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:32.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.313+0000 7fddcf07f700 1 --2- 172.21.15.26:0/136878124 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddc80a0a30 0x7fddc8133d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:32.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.313+0000 7fddcf07f700 1 -- 172.21.15.26:0/136878124 >> 172.21.15.26:0/136878124 conn(0x7fddc80a3050 msgr2=0x7fddc809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:32.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.313+0000 7fddcf07f700 1 -- 172.21.15.26:0/136878124 shutdown_connections 2023-10-01T07:55:32.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:32.313+0000 7fddcf07f700 1 -- 172.21.15.26:0/136878124 wait complete. 2023-10-01T07:55:32.326 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:33.241 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:33.281 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:33.293 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:33.327 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:33.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.397+0000 7f08b4d7e700 1 Processor -- start 2023-10-01T07:55:33.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.397+0000 7f08b4d7e700 1 -- start start 2023-10-01T07:55:33.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.398+0000 7f08b4d7e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08b01338a0 0x7f08b0133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:33.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.398+0000 7f08b4d7e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08b009e930 0x7f08b013b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:33.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.398+0000 7f08b4d7e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b006ef30 con 0x7f08b009de50 2023-10-01T07:55:33.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.398+0000 7f08b4d7e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b006fef0 con 0x7f08b009e930 2023-10-01T07:55:33.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.398+0000 7f08b4d7e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08b01334b0 con 0x7f08b01338a0 2023-10-01T07:55:33.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.398+0000 7f08aed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08b009e930 0x7f08b013b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:33.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.398+0000 7f08add9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f08b009de50 0x7f08b009e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38648/0 (socket says 172.21.15.26:38648) 2023-10-01T07:55:33.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.398+0000 7f08aed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08b009e930 0x7f08b013b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:53778/0 (socket says 172.21.15.26:53778) 2023-10-01T07:55:33.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.398+0000 7f08add9b700 1 -- 172.21.15.26:0/973494737 learned_addr learned my addr 172.21.15.26:0/973494737 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:33.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.398+0000 7f08ae59c700 1 --2- 172.21.15.26:0/973494737 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08b01338a0 0x7f08b0133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:33.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.399+0000 7f08aed9d700 1 -- 172.21.15.26:0/973494737 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08b01338a0 msgr2=0x7f08b0133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:33.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.399+0000 7f08aed9d700 1 --2- 172.21.15.26:0/973494737 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08b01338a0 0x7f08b0133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:33.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.399+0000 7f08aed9d700 1 -- 172.21.15.26:0/973494737 >> v1:172.21.15.26:6789/0 conn(0x7f08b009de50 legacy=0x7f08b009e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:33.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.399+0000 7f08aed9d700 1 -- 172.21.15.26:0/973494737 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b006fc30 con 0x7f08b009e930 2023-10-01T07:55:33.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.399+0000 7f08aed9d700 1 --2- 172.21.15.26:0/973494737 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08b009e930 0x7f08b013b740 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f08a8009dc0 tx=0x7f08a800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db686faddd5c546 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:33.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.399+0000 7f08ad59a700 1 -- 172.21.15.26:0/973494737 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a800e070 con 0x7f08b009e930 2023-10-01T07:55:33.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.399+0000 7f08ad59a700 1 -- 172.21.15.26:0/973494737 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a800bb20 con 0x7f08b009e930 2023-10-01T07:55:33.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.399+0000 7f08ad59a700 1 -- 172.21.15.26:0/973494737 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a8012430 con 0x7f08b009e930 2023-10-01T07:55:33.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.400+0000 7f08b4d7e700 1 -- 172.21.15.26:0/973494737 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08b009e930 msgr2=0x7f08b013b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:33.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.400+0000 7f08b4d7e700 1 --2- 172.21.15.26:0/973494737 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08b009e930 0x7f08b013b740 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f08a8009dc0 tx=0x7f08a800b330 comp rx=0 tx=0).stop 2023-10-01T07:55:33.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.400+0000 7f08b4d7e700 1 -- 172.21.15.26:0/973494737 shutdown_connections 2023-10-01T07:55:33.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.400+0000 7f08b4d7e700 1 --2- 172.21.15.26:0/973494737 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08b01338a0 0x7f08b0133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:33.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.400+0000 7f08b4d7e700 1 --2- 172.21.15.26:0/973494737 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08b009e930 0x7f08b013b740 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:33.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.400+0000 7f08b4d7e700 1 -- 172.21.15.26:0/973494737 >> 172.21.15.26:0/973494737 conn(0x7f08b00a2aa0 msgr2=0x7f08b00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:33.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.400+0000 7f08b4d7e700 1 -- 172.21.15.26:0/973494737 shutdown_connections 2023-10-01T07:55:33.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.400+0000 7f08b4d7e700 1 -- 172.21.15.26:0/973494737 wait complete. 2023-10-01T07:55:33.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.401+0000 7f08b4d7e700 1 Processor -- start 2023-10-01T07:55:33.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.401+0000 7f08b4d7e700 1 -- start start 2023-10-01T07:55:33.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.402+0000 7f08b4d7e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08b009de50 0x7f08b011d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:33.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.402+0000 7f08b4d7e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08b009e930 0x7f08b011dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:33.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.402+0000 7f08b4d7e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08b01338a0 0x7f08b011e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:33.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.402+0000 7f08b4d7e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b0121120 con 0x7f08b009de50 2023-10-01T07:55:33.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.402+0000 7f08b4d7e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b00a0f90 con 0x7f08b009e930 2023-10-01T07:55:33.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.402+0000 7f08b4d7e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08b01208b0 con 0x7f08b01338a0 2023-10-01T07:55:33.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.402+0000 7f08add9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08b009e930 0x7f08b011dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:33.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.402+0000 7f08add9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08b009e930 0x7f08b011dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:53786/0 (socket says 172.21.15.26:53786) 2023-10-01T07:55:33.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.402+0000 7f08add9b700 1 -- 172.21.15.26:0/1252380149 learned_addr learned my addr 172.21.15.26:0/1252380149 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:33.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.402+0000 7f08ae59c700 1 --2- 172.21.15.26:0/1252380149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08b009de50 0x7f08b011d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:33.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.402+0000 7f08aed9d700 1 --2- 172.21.15.26:0/1252380149 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08b01338a0 0x7f08b011e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:33.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.403+0000 7f08ae59c700 1 -- 172.21.15.26:0/1252380149 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08b01338a0 msgr2=0x7f08b011e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:33.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.403+0000 7f08ae59c700 1 --2- 172.21.15.26:0/1252380149 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08b01338a0 0x7f08b011e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:33.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.403+0000 7f08ae59c700 1 -- 172.21.15.26:0/1252380149 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08b009e930 msgr2=0x7f08b011dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:33.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.403+0000 7f08ae59c700 1 --2- 172.21.15.26:0/1252380149 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08b009e930 0x7f08b011dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:33.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.403+0000 7f08ae59c700 1 -- 172.21.15.26:0/1252380149 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a8009a70 con 0x7f08b009de50 2023-10-01T07:55:33.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.403+0000 7f08ae59c700 1 --2- 172.21.15.26:0/1252380149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08b009de50 0x7f08b011d690 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f08a000e900 tx=0x7f08a000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:33.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.403+0000 7f089effd700 1 -- 172.21.15.26:0/1252380149 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a0013680 con 0x7f08b009de50 2023-10-01T07:55:33.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.403+0000 7f089effd700 1 -- 172.21.15.26:0/1252380149 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a00137e0 con 0x7f08b009de50 2023-10-01T07:55:33.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.403+0000 7f089effd700 1 -- 172.21.15.26:0/1252380149 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a0013b50 con 0x7f08b009de50 2023-10-01T07:55:33.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.403+0000 7f08b4d7e700 1 -- 172.21.15.26:0/1252380149 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b006f640 con 0x7f08b009de50 2023-10-01T07:55:33.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.403+0000 7f08b4d7e700 1 -- 172.21.15.26:0/1252380149 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b0120460 con 0x7f08b009de50 2023-10-01T07:55:33.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.405+0000 7f089effd700 1 -- 172.21.15.26:0/1252380149 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f08a0013cb0 con 0x7f08b009de50 2023-10-01T07:55:33.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.405+0000 7f08b4d7e700 1 -- 172.21.15.26:0/1252380149 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b011a470 con 0x7f08b009de50 2023-10-01T07:55:33.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.405+0000 7f089effd700 1 -- 172.21.15.26:0/1252380149 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f08a003f760 con 0x7f08b009de50 2023-10-01T07:55:33.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.410+0000 7f089effd700 1 -- 172.21.15.26:0/1252380149 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f08a001be10 con 0x7f08b009de50 2023-10-01T07:55:33.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.437+0000 7fe2c7013700 1 Processor -- start 2023-10-01T07:55:33.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.437+0000 7fe2c7013700 1 -- start start 2023-10-01T07:55:33.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.437+0000 7fe2c7013700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe2c0131810 0x7fe2c0131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:33.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.437+0000 7fe2c7013700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2c009a580 0x7fe2c0139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:33.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.437+0000 7fe2c7013700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c01313c0 con 0x7fe2c0099a40 2023-10-01T07:55:33.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.437+0000 7fe2c7013700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c006e8c0 con 0x7fe2c009a580 2023-10-01T07:55:33.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.437+0000 7fe2c7013700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c0071d20 con 0x7fe2c0131810 2023-10-01T07:55:33.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.437+0000 7fe2c4daf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe2c0131810 0x7fe2c0131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:33.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.437+0000 7fe2c55b0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2c009a580 0x7fe2c0139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:33.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.438+0000 7fe2c4daf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe2c0131810 0x7fe2c0131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35186/0 (socket says 172.21.15.26:35186) 2023-10-01T07:55:33.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.438+0000 7fe2c4daf700 1 -- 172.21.15.26:0/1698889561 learned_addr learned my addr 172.21.15.26:0/1698889561 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:33.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.438+0000 7fe2c55b0700 1 -- 172.21.15.26:0/1698889561 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe2c0131810 msgr2=0x7fe2c0131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:33.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.438+0000 7fe2c55b0700 1 --2- 172.21.15.26:0/1698889561 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe2c0131810 0x7fe2c0131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:33.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.438+0000 7fe2c55b0700 1 -- 172.21.15.26:0/1698889561 >> v1:172.21.15.26:6789/0 conn(0x7fe2c0099a40 legacy=0x7fe2c0099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:33.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.438+0000 7fe2c55b0700 1 -- 172.21.15.26:0/1698889561 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c00721a0 con 0x7fe2c009a580 2023-10-01T07:55:33.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.438+0000 7fe2c4daf700 1 --2- 172.21.15.26:0/1698889561 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe2c0131810 0x7fe2c0131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:33.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.438+0000 7fe2c55b0700 1 --2- 172.21.15.26:0/1698889561 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2c009a580 0x7fe2c0139660 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8009dc0 tx=0x7fe2b800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=feffdf1f2527754f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:33.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.438+0000 7fe2bf7fe700 1 -- 172.21.15.26:0/1698889561 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b800e070 con 0x7fe2c009a580 2023-10-01T07:55:33.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.439+0000 7fe2bf7fe700 1 -- 172.21.15.26:0/1698889561 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b800bb20 con 0x7fe2c009a580 2023-10-01T07:55:33.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.439+0000 7fe2bf7fe700 1 -- 172.21.15.26:0/1698889561 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8012430 con 0x7fe2c009a580 2023-10-01T07:55:33.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.439+0000 7fe2c7013700 1 -- 172.21.15.26:0/1698889561 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2c009a580 msgr2=0x7fe2c0139660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:33.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.439+0000 7fe2c7013700 1 --2- 172.21.15.26:0/1698889561 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2c009a580 0x7fe2c0139660 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8009dc0 tx=0x7fe2b800b330 comp rx=0 tx=0).stop 2023-10-01T07:55:33.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.439+0000 7fe2c7013700 1 -- 172.21.15.26:0/1698889561 shutdown_connections 2023-10-01T07:55:33.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.439+0000 7fe2c7013700 1 --2- 172.21.15.26:0/1698889561 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe2c0131810 0x7fe2c0131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:33.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.439+0000 7fe2c7013700 1 --2- 172.21.15.26:0/1698889561 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2c009a580 0x7fe2c0139660 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:33.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.439+0000 7fe2c7013700 1 -- 172.21.15.26:0/1698889561 >> 172.21.15.26:0/1698889561 conn(0x7fe2c00a2aa0 msgr2=0x7fe2c00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:33.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.439+0000 7fe2c7013700 1 -- 172.21.15.26:0/1698889561 shutdown_connections 2023-10-01T07:55:33.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.439+0000 7fe2c7013700 1 -- 172.21.15.26:0/1698889561 wait complete. 2023-10-01T07:55:33.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.441+0000 7fe2c7013700 1 Processor -- start 2023-10-01T07:55:33.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.441+0000 7fe2c7013700 1 -- start start 2023-10-01T07:55:33.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.442+0000 7fe2c7013700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe2c0099a40 0x7fe2c006f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:33.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.442+0000 7fe2c7013700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2c009a580 0x7fe2c006fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:33.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.442+0000 7fe2c7013700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2c0131810 0x7fe2c0070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:33.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.442+0000 7fe2c7013700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c0121360 con 0x7fe2c0131810 2023-10-01T07:55:33.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.442+0000 7fe2c7013700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c0120300 con 0x7fe2c009a580 2023-10-01T07:55:33.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.442+0000 7fe2c7013700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c0120e50 con 0x7fe2c0099a40 2023-10-01T07:55:33.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.442+0000 7fe2c55b0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2c0131810 0x7fe2c0070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:33.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.442+0000 7fe2c55b0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2c0131810 0x7fe2c0070090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50152/0 (socket says 172.21.15.26:50152) 2023-10-01T07:55:33.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.442+0000 7fe2c55b0700 1 -- 172.21.15.26:0/1769411221 learned_addr learned my addr 172.21.15.26:0/1769411221 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:33.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.442+0000 7fe2bffff700 1 --2- 172.21.15.26:0/1769411221 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2c009a580 0x7fe2c006fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:33.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.442+0000 7fe2c4daf700 1 --2- 172.21.15.26:0/1769411221 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe2c0099a40 0x7fe2c006f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:33.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.443+0000 7fe2c55b0700 1 -- 172.21.15.26:0/1769411221 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe2c0099a40 msgr2=0x7fe2c006f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:33.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.443+0000 7fe2c55b0700 1 --2- 172.21.15.26:0/1769411221 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe2c0099a40 0x7fe2c006f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:33.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.443+0000 7fe2c55b0700 1 -- 172.21.15.26:0/1769411221 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2c009a580 msgr2=0x7fe2c006fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:33.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.443+0000 7fe2c55b0700 1 --2- 172.21.15.26:0/1769411221 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2c009a580 0x7fe2c006fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:33.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.443+0000 7fe2c55b0700 1 -- 172.21.15.26:0/1769411221 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b4009550 con 0x7fe2c0131810 2023-10-01T07:55:33.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.443+0000 7fe2c55b0700 1 --2- 172.21.15.26:0/1769411221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2c0131810 0x7fe2c0070090 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800b370 tx=0x7fe2b8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:33.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.443+0000 7fe2bd7fa700 1 -- 172.21.15.26:0/1769411221 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8012430 con 0x7fe2c0131810 2023-10-01T07:55:33.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.443+0000 7fe2bd7fa700 1 -- 172.21.15.26:0/1769411221 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b8020070 con 0x7fe2c0131810 2023-10-01T07:55:33.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.443+0000 7fe2c7013700 1 -- 172.21.15.26:0/1769411221 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b8009a70 con 0x7fe2c0131810 2023-10-01T07:55:33.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.443+0000 7fe2bd7fa700 1 -- 172.21.15.26:0/1769411221 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8004280 con 0x7fe2c0131810 2023-10-01T07:55:33.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.443+0000 7fe2c7013700 1 -- 172.21.15.26:0/1769411221 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c006eb00 con 0x7fe2c0131810 2023-10-01T07:55:33.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.444+0000 7fe2bd7fa700 1 -- 172.21.15.26:0/1769411221 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe2b80043e0 con 0x7fe2c0131810 2023-10-01T07:55:33.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.445+0000 7fe2aaffd700 1 -- 172.21.15.26:0/1769411221 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2980052e0 con 0x7fe2c0131810 2023-10-01T07:55:33.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.445+0000 7fe2bd7fa700 1 -- 172.21.15.26:0/1769411221 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe2b8022070 con 0x7fe2c0131810 2023-10-01T07:55:33.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.454+0000 7fe2bd7fa700 1 -- 172.21.15.26:0/1769411221 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe2b8012e10 con 0x7fe2c0131810 2023-10-01T07:55:33.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.478+0000 7f4bb5ac5700 1 Processor -- start 2023-10-01T07:55:33.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.478+0000 7f4bb5ac5700 1 -- start start 2023-10-01T07:55:33.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.479+0000 7f4bb5ac5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4bb009d6f0 0x7f4bb009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:33.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.479+0000 7f4bb5ac5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bb009e410 0x7f4bb0130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:33.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.479+0000 7f4bb5ac5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb009f130 con 0x7f4bb009e000 2023-10-01T07:55:33.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.479+0000 7f4bb5ac5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb009f520 con 0x7f4bb009d6f0 2023-10-01T07:55:33.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.479+0000 7f4bb5ac5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb009e930 con 0x7f4bb009e410 2023-10-01T07:55:33.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.479+0000 7f4baeffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4bb009e000 0x7f4bb0130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52210/0 (socket says 172.21.15.26:52210) 2023-10-01T07:55:33.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.479+0000 7f4baeffd700 1 -- 172.21.15.26:0/1299348475 learned_addr learned my addr 172.21.15.26:0/1299348475 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:33.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.479+0000 7f4baffff700 1 --2- 172.21.15.26:0/1299348475 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bb009e410 0x7f4bb0130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:33.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.479+0000 7f4baf7fe700 1 --2- 172.21.15.26:0/1299348475 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4bb009d6f0 0x7f4bb009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:33.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.480+0000 7f4baf7fe700 1 -- 172.21.15.26:0/1299348475 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bb009e410 msgr2=0x7f4bb0130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:33.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.480+0000 7f4bae7fc700 1 -- 172.21.15.26:0/1299348475 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 345415220 0 0) 0x7f4bb009f130 con 0x7f4bb009e000 2023-10-01T07:55:33.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.480+0000 7f4baf7fe700 1 --2- 172.21.15.26:0/1299348475 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bb009e410 0x7f4bb0130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:33.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.480+0000 7f4baf7fe700 1 -- 172.21.15.26:0/1299348475 >> v1:172.21.15.26:6789/0 conn(0x7f4bb009e000 legacy=0x7f4bb0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:33.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.480+0000 7f4baf7fe700 1 -- 172.21.15.26:0/1299348475 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb009b2d0 con 0x7f4bb009d6f0 2023-10-01T07:55:33.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.480+0000 7f4baf7fe700 1 --2- 172.21.15.26:0/1299348475 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4bb009d6f0 0x7f4bb009dac0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0009870 tx=0x7f4ba0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=beb3af4812a59543 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:33.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.480+0000 7f4bae7fc700 1 -- 172.21.15.26:0/1299348475 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba000f8a0 con 0x7f4bb009d6f0 2023-10-01T07:55:33.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.480+0000 7f4bae7fc700 1 -- 172.21.15.26:0/1299348475 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba000fa00 con 0x7f4bb009d6f0 2023-10-01T07:55:33.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.480+0000 7f4bae7fc700 1 -- 172.21.15.26:0/1299348475 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba000fd90 con 0x7f4bb009d6f0 2023-10-01T07:55:33.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.481+0000 7f4bb5ac5700 1 -- 172.21.15.26:0/1299348475 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4bb009d6f0 msgr2=0x7f4bb009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:33.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.481+0000 7f4bb5ac5700 1 --2- 172.21.15.26:0/1299348475 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4bb009d6f0 0x7f4bb009dac0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0009870 tx=0x7f4ba0009b80 comp rx=0 tx=0).stop 2023-10-01T07:55:33.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.481+0000 7f4bb5ac5700 1 -- 172.21.15.26:0/1299348475 shutdown_connections 2023-10-01T07:55:33.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.481+0000 7f4bb5ac5700 1 --2- 172.21.15.26:0/1299348475 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bb009e410 0x7f4bb0130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:33.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.481+0000 7f4bb5ac5700 1 --2- 172.21.15.26:0/1299348475 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4bb009d6f0 0x7f4bb009dac0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:33.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.481+0000 7f4bb5ac5700 1 -- 172.21.15.26:0/1299348475 >> 172.21.15.26:0/1299348475 conn(0x7f4bb0066f50 msgr2=0x7f4bb009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:33.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.481+0000 7f4bb5ac5700 1 -- 172.21.15.26:0/1299348475 shutdown_connections 2023-10-01T07:55:33.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.481+0000 7f4bb5ac5700 1 -- 172.21.15.26:0/1299348475 wait complete. 2023-10-01T07:55:33.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.483+0000 7f4bb5ac5700 1 Processor -- start 2023-10-01T07:55:33.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.483+0000 7f4bb5ac5700 1 -- start start 2023-10-01T07:55:33.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.483+0000 7f9ea10aa700 1 Processor -- start 2023-10-01T07:55:33.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.483+0000 7f9ea10aa700 1 -- start start 2023-10-01T07:55:33.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.484+0000 7f9ea10aa700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9e9c09e1d0 0x7f9e9c135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:33.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.484+0000 7f9ea10aa700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e9c135e50 0x7f9e9c138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:33.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.484+0000 7f9ea10aa700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e9c09f130 con 0x7f9e9c09d6f0 2023-10-01T07:55:33.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.484+0000 7f9ea10aa700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c09f520 con 0x7f9e9c135e50 2023-10-01T07:55:33.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.484+0000 7f9ea10aa700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c09e930 con 0x7f9e9c09e1d0 2023-10-01T07:55:33.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.484+0000 7f4bb5ac5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bb009d6f0 0x7f4bb0122680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:33.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.484+0000 7f4bb5ac5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bb009e000 0x7f4bb0122bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:33.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.484+0000 7f4bb5ac5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4bb009e410 0x7f4bb0123100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:33.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.484+0000 7f4bb5ac5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb0125c00 con 0x7f4bb009e000 2023-10-01T07:55:33.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.484+0000 7f4bb5ac5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb01261a0 con 0x7f4bb009e410 2023-10-01T07:55:33.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.484+0000 7f4bb5ac5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb0124ab0 con 0x7f4bb009d6f0 2023-10-01T07:55:33.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.484+0000 7f9e9b59e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e9c135e50 0x7f9e9c138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:33.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.484+0000 7f9e9ad9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9e9c09d6f0 0x7f9e9c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52226/0 (socket says 172.21.15.26:52226) 2023-10-01T07:55:33.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.484+0000 7f9e9ad9d700 1 -- 172.21.15.26:0/2639645689 learned_addr learned my addr 172.21.15.26:0/2639645689 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:33.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.484+0000 7f4baffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4bb009e410 0x7f4bb0123100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:33.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.484+0000 7f4baffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4bb009e410 0x7f4bb0123100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:53788/0 (socket says 172.21.15.26:53788) 2023-10-01T07:55:33.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.484+0000 7f4baffff700 1 -- 172.21.15.26:0/1111377699 learned_addr learned my addr 172.21.15.26:0/1111377699 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:33.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.484+0000 7f9e9a59c700 1 --2- 172.21.15.26:0/2639645689 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9e9c09e1d0 0x7f9e9c135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:33.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.485+0000 7f9e9b59e700 1 -- 172.21.15.26:0/2639645689 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9e9c09e1d0 msgr2=0x7f9e9c135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:33.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.485+0000 7f9e9b59e700 1 --2- 172.21.15.26:0/2639645689 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9e9c09e1d0 0x7f9e9c135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:33.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.485+0000 7f9e9b59e700 1 -- 172.21.15.26:0/2639645689 >> v1:172.21.15.26:6789/0 conn(0x7f9e9c09d6f0 legacy=0x7f9e9c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:33.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.485+0000 7f9e9b59e700 1 -- 172.21.15.26:0/2639645689 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e9c09b2d0 con 0x7f9e9c135e50 2023-10-01T07:55:33.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.485+0000 7f4baf7fe700 1 --2- 172.21.15.26:0/1111377699 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bb009d6f0 0x7f4bb0122680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:33.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.485+0000 7f4baeffd700 1 --2- 172.21.15.26:0/1111377699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bb009e000 0x7f4bb0122bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:33.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.485+0000 7f4baffff700 1 -- 172.21.15.26:0/1111377699 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bb009d6f0 msgr2=0x7f4bb0122680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:33.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.485+0000 7f4baffff700 1 --2- 172.21.15.26:0/1111377699 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bb009d6f0 0x7f4bb0122680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:33.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.485+0000 7f4baffff700 1 -- 172.21.15.26:0/1111377699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bb009e000 msgr2=0x7f4bb0122bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:33.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.485+0000 7f4baffff700 1 --2- 172.21.15.26:0/1111377699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bb009e000 0x7f4bb0122bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:33.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.485+0000 7f9e9b59e700 1 --2- 172.21.15.26:0/2639645689 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e9c135e50 0x7f9e9c138230 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9e94009df0 tx=0x7f9e9400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdcbca9aa599b846 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:33.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.485+0000 7f4baffff700 1 -- 172.21.15.26:0/1111377699 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba00094a0 con 0x7f4bb009e410 2023-10-01T07:55:33.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.485+0000 7f4baeffd700 1 --2- 172.21.15.26:0/1111377699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bb009e000 0x7f4bb0122bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:55:33.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.485+0000 7f4baffff700 1 --2- 172.21.15.26:0/1111377699 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4bb009e410 0x7f4bb0123100 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4ba800efc0 tx=0x7f4ba800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:33.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.485+0000 7f9e99d9b700 1 -- 172.21.15.26:0/2639645689 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9400e070 con 0x7f9e9c135e50 2023-10-01T07:55:33.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.485+0000 7f9e99d9b700 1 -- 172.21.15.26:0/2639645689 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9400bae0 con 0x7f9e9c135e50 2023-10-01T07:55:33.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.485+0000 7f9e99d9b700 1 -- 172.21.15.26:0/2639645689 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9400be90 con 0x7f9e9c135e50 2023-10-01T07:55:33.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.485+0000 7f4b97fff700 1 -- 172.21.15.26:0/1111377699 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba800cd40 con 0x7f4bb009e410 2023-10-01T07:55:33.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.485+0000 7f4b97fff700 1 -- 172.21.15.26:0/1111377699 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba800f040 con 0x7f4bb009e410 2023-10-01T07:55:33.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.485+0000 7f4bb5ac5700 1 -- 172.21.15.26:0/1111377699 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb00a1d00 con 0x7f4bb009e410 2023-10-01T07:55:33.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.486+0000 7f9ea10aa700 1 -- 172.21.15.26:0/2639645689 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e9c135e50 msgr2=0x7f9e9c138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:33.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.486+0000 7f9ea10aa700 1 --2- 172.21.15.26:0/2639645689 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e9c135e50 0x7f9e9c138230 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9e94009df0 tx=0x7f9e9400b330 comp rx=0 tx=0).stop 2023-10-01T07:55:33.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.486+0000 7f9ea10aa700 1 -- 172.21.15.26:0/2639645689 shutdown_connections 2023-10-01T07:55:33.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.486+0000 7f9ea10aa700 1 --2- 172.21.15.26:0/2639645689 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e9c135e50 0x7f9e9c138230 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:33.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.486+0000 7f9ea10aa700 1 --2- 172.21.15.26:0/2639645689 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9e9c09e1d0 0x7f9e9c135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:33.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.486+0000 7f9ea10aa700 1 -- 172.21.15.26:0/2639645689 >> 172.21.15.26:0/2639645689 conn(0x7f9e9c066f50 msgr2=0x7f9e9c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:33.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.485+0000 7f4b97fff700 1 -- 172.21.15.26:0/1111377699 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba80146c0 con 0x7f4bb009e410 2023-10-01T07:55:33.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.485+0000 7f4bb5ac5700 1 -- 172.21.15.26:0/1111377699 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb0125ec0 con 0x7f4bb009e410 2023-10-01T07:55:33.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.486+0000 7f9ea10aa700 1 -- 172.21.15.26:0/2639645689 shutdown_connections 2023-10-01T07:55:33.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.487+0000 7f9ea10aa700 1 -- 172.21.15.26:0/2639645689 wait complete. 2023-10-01T07:55:33.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.486+0000 7f4b97fff700 1 -- 172.21.15.26:0/1111377699 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4ba8014820 con 0x7f4bb009e410 2023-10-01T07:55:33.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.487+0000 7f4b97fff700 1 -- 172.21.15.26:0/1111377699 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4ba80405b0 con 0x7f4bb009e410 2023-10-01T07:55:33.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.487+0000 7f4bb5ac5700 1 -- 172.21.15.26:0/1111377699 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bb01305a0 con 0x7f4bb009e410 2023-10-01T07:55:33.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.488+0000 7f9ea10aa700 1 Processor -- start 2023-10-01T07:55:33.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.489+0000 7f9ea10aa700 1 -- start start 2023-10-01T07:55:33.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.489+0000 7f9ea10aa700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9e9c09d6f0 0x7f9e9c133fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:33.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.489+0000 7f9ea10aa700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e9c09e1d0 0x7f9e9c134500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:33.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.489+0000 7f9ea10aa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e9c135e50 0x7f9e9c134a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:33.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.489+0000 7f9ea10aa700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c11b050 con 0x7f9e9c135e50 2023-10-01T07:55:33.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.489+0000 7f9ea10aa700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c11d920 con 0x7f9e9c09e1d0 2023-10-01T07:55:33.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.489+0000 7f9ea10aa700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c11c9c0 con 0x7f9e9c09d6f0 2023-10-01T07:55:33.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.489+0000 7f9e9a59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e9c09e1d0 0x7f9e9c134500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:33.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.490+0000 7f9e9a59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e9c09e1d0 0x7f9e9c134500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:53804/0 (socket says 172.21.15.26:53804) 2023-10-01T07:55:33.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.490+0000 7f9e9a59c700 1 -- 172.21.15.26:0/109005216 learned_addr learned my addr 172.21.15.26:0/109005216 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:33.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.490+0000 7f9e9b59e700 1 --2- 172.21.15.26:0/109005216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e9c135e50 0x7f9e9c134a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:33.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.490+0000 7f9e9b59e700 1 -- 172.21.15.26:0/109005216 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9e9c09d6f0 msgr2=0x7f9e9c133fc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:55:33.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.490+0000 7f9e9b59e700 1 --2- 172.21.15.26:0/109005216 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9e9c09d6f0 0x7f9e9c133fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:33.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.490+0000 7f9e9b59e700 1 -- 172.21.15.26:0/109005216 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e9c09e1d0 msgr2=0x7f9e9c134500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:33.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.490+0000 7f9e9b59e700 1 --2- 172.21.15.26:0/109005216 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e9c09e1d0 0x7f9e9c134500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:33.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.490+0000 7f9e9b59e700 1 -- 172.21.15.26:0/109005216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e94009a70 con 0x7f9e9c135e50 2023-10-01T07:55:33.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.490+0000 7f9e9b59e700 1 --2- 172.21.15.26:0/109005216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e9c135e50 0x7f9e9c134a40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9e94016000 tx=0x7f9e94004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:33.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.491+0000 7f9e837fe700 1 -- 172.21.15.26:0/109005216 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e940046a0 con 0x7f9e9c135e50 2023-10-01T07:55:33.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.491+0000 7f9e837fe700 1 -- 172.21.15.26:0/109005216 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e94020070 con 0x7f9e9c135e50 2023-10-01T07:55:33.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.491+0000 7f9ea10aa700 1 -- 172.21.15.26:0/109005216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e9c11cf60 con 0x7f9e9c135e50 2023-10-01T07:55:33.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.491+0000 7f9e837fe700 1 -- 172.21.15.26:0/109005216 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e94027480 con 0x7f9e9c135e50 2023-10-01T07:55:33.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.491+0000 7f9ea10aa700 1 -- 172.21.15.26:0/109005216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e9c11c2a0 con 0x7f9e9c135e50 2023-10-01T07:55:33.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.492+0000 7f9e817fa700 1 -- 172.21.15.26:0/109005216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e740052e0 con 0x7f9e9c135e50 2023-10-01T07:55:33.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.492+0000 7f9e837fe700 1 -- 172.21.15.26:0/109005216 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9e940275e0 con 0x7f9e9c135e50 2023-10-01T07:55:33.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.492+0000 7f9e837fe700 1 -- 172.21.15.26:0/109005216 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9e94022070 con 0x7f9e9c135e50 2023-10-01T07:55:33.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.496+0000 7f4b97fff700 1 -- 172.21.15.26:0/1111377699 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4ba8018030 con 0x7f4bb009e410 2023-10-01T07:55:33.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.499+0000 7f9e837fe700 1 -- 172.21.15.26:0/109005216 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9e94027890 con 0x7f9e9c135e50 2023-10-01T07:55:33.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.625+0000 7f08b4d7e700 1 -- 172.21.15.26:0/1252380149 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f08b0074ea0 con 0x7f08b009de50 2023-10-01T07:55:33.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.625+0000 7f089effd700 1 -- 172.21.15.26:0/1252380149 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f08a001b3b0 con 0x7f08b009de50 2023-10-01T07:55:33.626 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:33.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.628+0000 7f08b4d7e700 1 -- 172.21.15.26:0/1252380149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08b009de50 msgr2=0x7f08b011d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:33.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.628+0000 7f08b4d7e700 1 --2- 172.21.15.26:0/1252380149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08b009de50 0x7f08b011d690 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f08a000e900 tx=0x7f08a000ec10 comp rx=0 tx=0).stop 2023-10-01T07:55:33.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.628+0000 7f08b4d7e700 1 -- 172.21.15.26:0/1252380149 shutdown_connections 2023-10-01T07:55:33.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.628+0000 7f08b4d7e700 1 --2- 172.21.15.26:0/1252380149 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08b01338a0 0x7f08b011e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:33.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.628+0000 7f08b4d7e700 1 --2- 172.21.15.26:0/1252380149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08b009de50 0x7f08b011d690 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:33.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.628+0000 7f08b4d7e700 1 --2- 172.21.15.26:0/1252380149 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08b009e930 0x7f08b011dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:33.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.628+0000 7f08b4d7e700 1 -- 172.21.15.26:0/1252380149 >> 172.21.15.26:0/1252380149 conn(0x7f08b00a2aa0 msgr2=0x7f08b009f860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:33.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.628+0000 7f08b4d7e700 1 -- 172.21.15.26:0/1252380149 shutdown_connections 2023-10-01T07:55:33.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.628+0000 7f08b4d7e700 1 -- 172.21.15.26:0/1252380149 wait complete. 2023-10-01T07:55:33.647 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:33.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.666+0000 7fe2aaffd700 1 -- 172.21.15.26:0/1769411221 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe298005590 con 0x7fe2c0131810 2023-10-01T07:55:33.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.666+0000 7fe2bd7fa700 1 -- 172.21.15.26:0/1769411221 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe2b801a380 con 0x7fe2c0131810 2023-10-01T07:55:33.667 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:33.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.669+0000 7fe2aaffd700 1 -- 172.21.15.26:0/1769411221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2c0131810 msgr2=0x7fe2c0070090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:33.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.669+0000 7fe2aaffd700 1 --2- 172.21.15.26:0/1769411221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2c0131810 0x7fe2c0070090 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800b370 tx=0x7fe2b8004ad0 comp rx=0 tx=0).stop 2023-10-01T07:55:33.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.669+0000 7fe2aaffd700 1 -- 172.21.15.26:0/1769411221 shutdown_connections 2023-10-01T07:55:33.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.669+0000 7fe2aaffd700 1 --2- 172.21.15.26:0/1769411221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2c0131810 0x7fe2c0070090 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:33.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.669+0000 7fe2aaffd700 1 --2- 172.21.15.26:0/1769411221 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe2c0099a40 0x7fe2c006f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:33.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.669+0000 7fe2aaffd700 1 --2- 172.21.15.26:0/1769411221 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2c009a580 0x7fe2c006fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:33.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.669+0000 7fe2aaffd700 1 -- 172.21.15.26:0/1769411221 >> 172.21.15.26:0/1769411221 conn(0x7fe2c00a2aa0 msgr2=0x7fe2c01b8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:33.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.669+0000 7fe2aaffd700 1 -- 172.21.15.26:0/1769411221 shutdown_connections 2023-10-01T07:55:33.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.669+0000 7fe2aaffd700 1 -- 172.21.15.26:0/1769411221 wait complete. 2023-10-01T07:55:33.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:33.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.704+0000 7f4bb5ac5700 1 -- 172.21.15.26:0/1111377699 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4bb0074ea0 con 0x7f4bb009e410 2023-10-01T07:55:33.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.705+0000 7f4b97fff700 1 -- 172.21.15.26:0/1111377699 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4ba802c090 con 0x7f4bb009e410 2023-10-01T07:55:33.706 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:33.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.707+0000 7f4bb5ac5700 1 -- 172.21.15.26:0/1111377699 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4bb009e410 msgr2=0x7f4bb0123100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:33.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.707+0000 7f4bb5ac5700 1 --2- 172.21.15.26:0/1111377699 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4bb009e410 0x7f4bb0123100 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4ba800efc0 tx=0x7f4ba800c3a0 comp rx=0 tx=0).stop 2023-10-01T07:55:33.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.707+0000 7f4bb5ac5700 1 -- 172.21.15.26:0/1111377699 shutdown_connections 2023-10-01T07:55:33.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.707+0000 7f4bb5ac5700 1 --2- 172.21.15.26:0/1111377699 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4bb009e410 0x7f4bb0123100 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:33.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.707+0000 7f4bb5ac5700 1 --2- 172.21.15.26:0/1111377699 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bb009d6f0 0x7f4bb0122680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:33.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.707+0000 7f4bb5ac5700 1 --2- 172.21.15.26:0/1111377699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bb009e000 0x7f4bb0122bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:33.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.707+0000 7f4bb5ac5700 1 -- 172.21.15.26:0/1111377699 >> 172.21.15.26:0/1111377699 conn(0x7f4bb0066f50 msgr2=0x7f4bb0070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:33.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.707+0000 7f4bb5ac5700 1 -- 172.21.15.26:0/1111377699 shutdown_connections 2023-10-01T07:55:33.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.707+0000 7f4bb5ac5700 1 -- 172.21.15.26:0/1111377699 wait complete. 2023-10-01T07:55:33.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.716+0000 7f9e817fa700 1 -- 172.21.15.26:0/109005216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9e74005590 con 0x7f9e9c135e50 2023-10-01T07:55:33.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.716+0000 7f9e837fe700 1 -- 172.21.15.26:0/109005216 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9e9402c030 con 0x7f9e9c135e50 2023-10-01T07:55:33.717 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:33.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.719+0000 7f9e817fa700 1 -- 172.21.15.26:0/109005216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e9c135e50 msgr2=0x7f9e9c134a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:33.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.719+0000 7f9e817fa700 1 --2- 172.21.15.26:0/109005216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e9c135e50 0x7f9e9c134a40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9e94016000 tx=0x7f9e94004ad0 comp rx=0 tx=0).stop 2023-10-01T07:55:33.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.719+0000 7f9e817fa700 1 -- 172.21.15.26:0/109005216 shutdown_connections 2023-10-01T07:55:33.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.719+0000 7f9e817fa700 1 --2- 172.21.15.26:0/109005216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e9c135e50 0x7f9e9c134a40 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:33.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.719+0000 7f9e817fa700 1 --2- 172.21.15.26:0/109005216 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9e9c09d6f0 0x7f9e9c133fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:33.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.719+0000 7f9e817fa700 1 --2- 172.21.15.26:0/109005216 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e9c09e1d0 0x7f9e9c134500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:33.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.719+0000 7f9e817fa700 1 -- 172.21.15.26:0/109005216 >> 172.21.15.26:0/109005216 conn(0x7f9e9c066f50 msgr2=0x7f9e9c0a1580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:33.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.719+0000 7f9e817fa700 1 -- 172.21.15.26:0/109005216 shutdown_connections 2023-10-01T07:55:33.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:33.719+0000 7f9e817fa700 1 -- 172.21.15.26:0/109005216 wait complete. 2023-10-01T07:55:33.722 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:33.734 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:34.648 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:34.684 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:34.723 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:34.735 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:34.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.800+0000 7f81c83fe700 1 Processor -- start 2023-10-01T07:55:34.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.800+0000 7f81c83fe700 1 -- start start 2023-10-01T07:55:34.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.800+0000 7f81c83fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81c009d6f0 0x7f81c009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:34.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.800+0000 7f81c83fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f81c009e000 0x7f81c0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:34.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.800+0000 7f81c83fe700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c009f130 con 0x7f81c009e410 2023-10-01T07:55:34.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.800+0000 7f81c83fe700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c009f520 con 0x7f81c009e000 2023-10-01T07:55:34.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.800+0000 7f81c83fe700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c009e930 con 0x7f81c009d6f0 2023-10-01T07:55:34.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.801+0000 7f81c5999700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f81c009e000 0x7f81c0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:34.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.801+0000 7f81c619a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81c009d6f0 0x7f81c009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:34.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.801+0000 7f81c5999700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f81c009e000 0x7f81c0130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50178/0 (socket says 172.21.15.26:50178) 2023-10-01T07:55:34.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.801+0000 7f81c619a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81c009d6f0 0x7f81c009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:53808/0 (socket says 172.21.15.26:53808) 2023-10-01T07:55:34.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.801+0000 7f81c5999700 1 -- 172.21.15.26:0/2708763937 learned_addr learned my addr 172.21.15.26:0/2708763937 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:34.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.801+0000 7f81c619a700 1 -- 172.21.15.26:0/2708763937 >> v2:172.21.15.26:3300/0 conn(0x7f81c009e000 msgr2=0x7f81c0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:34.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.801+0000 7f81c619a700 1 --2- 172.21.15.26:0/2708763937 >> v2:172.21.15.26:3300/0 conn(0x7f81c009e000 0x7f81c0130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:34.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.801+0000 7f81c619a700 1 -- 172.21.15.26:0/2708763937 >> v1:172.21.15.26:6789/0 conn(0x7f81c009e410 legacy=0x7f81c0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:34.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.801+0000 7f81c619a700 1 -- 172.21.15.26:0/2708763937 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c009b2d0 con 0x7f81c009d6f0 2023-10-01T07:55:34.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.801+0000 7f81c619a700 1 --2- 172.21.15.26:0/2708763937 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81c009d6f0 0x7f81c009dac0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f81bc009840 tx=0x7f81bc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c75011b7163920d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:34.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.802+0000 7f81c5198700 1 -- 172.21.15.26:0/2708763937 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81bc011830 con 0x7f81c009d6f0 2023-10-01T07:55:34.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.802+0000 7f81c5198700 1 -- 172.21.15.26:0/2708763937 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81bc011990 con 0x7f81c009d6f0 2023-10-01T07:55:34.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.802+0000 7f81c5198700 1 -- 172.21.15.26:0/2708763937 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81bc011d20 con 0x7f81c009d6f0 2023-10-01T07:55:34.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.803+0000 7f81c83fe700 1 -- 172.21.15.26:0/2708763937 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81c009d6f0 msgr2=0x7f81c009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:34.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.803+0000 7f81c83fe700 1 --2- 172.21.15.26:0/2708763937 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81c009d6f0 0x7f81c009dac0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f81bc009840 tx=0x7f81bc009b50 comp rx=0 tx=0).stop 2023-10-01T07:55:34.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.803+0000 7f81c83fe700 1 -- 172.21.15.26:0/2708763937 shutdown_connections 2023-10-01T07:55:34.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.803+0000 7f81c83fe700 1 --2- 172.21.15.26:0/2708763937 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81c009d6f0 0x7f81c009dac0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:34.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.803+0000 7f81c83fe700 1 --2- 172.21.15.26:0/2708763937 >> v2:172.21.15.26:3300/0 conn(0x7f81c009e000 0x7f81c0130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:34.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.803+0000 7f81c83fe700 1 -- 172.21.15.26:0/2708763937 >> 172.21.15.26:0/2708763937 conn(0x7f81c0066f50 msgr2=0x7f81c009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:34.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.803+0000 7f81c83fe700 1 -- 172.21.15.26:0/2708763937 shutdown_connections 2023-10-01T07:55:34.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.803+0000 7f81c83fe700 1 -- 172.21.15.26:0/2708763937 wait complete. 2023-10-01T07:55:34.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.804+0000 7f81c83fe700 1 Processor -- start 2023-10-01T07:55:34.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.805+0000 7f81c83fe700 1 -- start start 2023-10-01T07:55:34.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.805+0000 7f81c83fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81c009d6f0 0x7f81c011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:34.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.805+0000 7f81c83fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81c009e000 0x7f81c011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:34.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.805+0000 7f81c83fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f81c009e410 0x7f81c011ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:34.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.805+0000 7f81c83fe700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c011f450 con 0x7f81c009d6f0 2023-10-01T07:55:34.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.805+0000 7f81c83fe700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c0130360 con 0x7f81c009e000 2023-10-01T07:55:34.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.805+0000 7f81c83fe700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81c01201b0 con 0x7f81c009e410 2023-10-01T07:55:34.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.805+0000 7f81c5999700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81c009e000 0x7f81c011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:34.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.805+0000 7f81c5999700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81c009e000 0x7f81c011e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:53816/0 (socket says 172.21.15.26:53816) 2023-10-01T07:55:34.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.805+0000 7f81c5999700 1 -- 172.21.15.26:0/2218547868 learned_addr learned my addr 172.21.15.26:0/2218547868 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:34.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.806+0000 7f81c619a700 1 --2- 172.21.15.26:0/2218547868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81c009d6f0 0x7f81c011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:34.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.806+0000 7f81c699b700 1 --2- 172.21.15.26:0/2218547868 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f81c009e410 0x7f81c011ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:34.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.806+0000 7f81c5999700 1 -- 172.21.15.26:0/2218547868 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f81c009e410 msgr2=0x7f81c011ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:34.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.806+0000 7f81c5999700 1 --2- 172.21.15.26:0/2218547868 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f81c009e410 0x7f81c011ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:34.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.806+0000 7f81c5999700 1 -- 172.21.15.26:0/2218547868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81c009d6f0 msgr2=0x7f81c011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:34.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.806+0000 7f81c5999700 1 --2- 172.21.15.26:0/2218547868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81c009d6f0 0x7f81c011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:34.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.806+0000 7f81c5999700 1 -- 172.21.15.26:0/2218547868 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81bc0094a0 con 0x7f81c009e000 2023-10-01T07:55:34.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.806+0000 7f81c5999700 1 --2- 172.21.15.26:0/2218547868 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81c009e000 0x7f81c011e4c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f81b0012c10 tx=0x7f81b0012f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:34.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.806+0000 7f81b6ffd700 1 -- 172.21.15.26:0/2218547868 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b0010a80 con 0x7f81c009e000 2023-10-01T07:55:34.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.806+0000 7f81b6ffd700 1 -- 172.21.15.26:0/2218547868 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b0013040 con 0x7f81c009e000 2023-10-01T07:55:34.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.806+0000 7f81b6ffd700 1 -- 172.21.15.26:0/2218547868 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b0010de0 con 0x7f81c009e000 2023-10-01T07:55:34.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.806+0000 7f81c83fe700 1 -- 172.21.15.26:0/2218547868 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c0120de0 con 0x7f81c009e000 2023-10-01T07:55:34.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.807+0000 7f81c83fe700 1 -- 172.21.15.26:0/2218547868 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c00a1e00 con 0x7f81c009e000 2023-10-01T07:55:34.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.808+0000 7f81b6ffd700 1 -- 172.21.15.26:0/2218547868 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f81b0018480 con 0x7f81c009e000 2023-10-01T07:55:34.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.808+0000 7f81c83fe700 1 -- 172.21.15.26:0/2218547868 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c009c700 con 0x7f81c009e000 2023-10-01T07:55:34.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.808+0000 7f81b6ffd700 1 -- 172.21.15.26:0/2218547868 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f81b0043820 con 0x7f81c009e000 2023-10-01T07:55:34.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.813+0000 7f81b6ffd700 1 -- 172.21.15.26:0/2218547868 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f81b0016520 con 0x7f81c009e000 2023-10-01T07:55:34.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.843+0000 7fe557278700 1 Processor -- start 2023-10-01T07:55:34.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.843+0000 7fe557278700 1 -- start start 2023-10-01T07:55:34.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.844+0000 7fe557278700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe550134630 0x7fe550136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:34.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.844+0000 7fe557278700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe550136f50 0x7fe550139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:34.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.844+0000 7fe557278700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe55009b4f0 con 0x7fe550131810 2023-10-01T07:55:34.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.844+0000 7fe557278700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5501313c0 con 0x7fe550134630 2023-10-01T07:55:34.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.844+0000 7fe557278700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe55006e8c0 con 0x7fe550136f50 2023-10-01T07:55:34.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.844+0000 7fe555815700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe550136f50 0x7fe550139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:34.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.844+0000 7fe555815700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe550136f50 0x7fe550139330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:53828/0 (socket says 172.21.15.26:53828) 2023-10-01T07:55:34.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.844+0000 7fe555815700 1 -- 172.21.15.26:0/4056279595 learned_addr learned my addr 172.21.15.26:0/4056279595 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:34.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.844+0000 7fe555014700 1 --1- 172.21.15.26:0/4056279595 >> v1:172.21.15.26:6789/0 conn(0x7fe550131810 0x7fe550131be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52244/0 (socket says 172.21.15.26:52244) 2023-10-01T07:55:34.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.844+0000 7fe554813700 1 --2- 172.21.15.26:0/4056279595 >> v2:172.21.15.26:3300/0 conn(0x7fe550134630 0x7fe550136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:34.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.845+0000 7fe555815700 1 -- 172.21.15.26:0/4056279595 >> v2:172.21.15.26:3300/0 conn(0x7fe550134630 msgr2=0x7fe550136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:34.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.845+0000 7fe555815700 1 --2- 172.21.15.26:0/4056279595 >> v2:172.21.15.26:3300/0 conn(0x7fe550134630 0x7fe550136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:34.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.845+0000 7fe555815700 1 -- 172.21.15.26:0/4056279595 >> v1:172.21.15.26:6789/0 conn(0x7fe550131810 legacy=0x7fe550131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:34.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.845+0000 7fe555815700 1 -- 172.21.15.26:0/4056279595 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe550071d20 con 0x7fe550136f50 2023-10-01T07:55:34.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.845+0000 7fe555815700 1 --2- 172.21.15.26:0/4056279595 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe550136f50 0x7fe550139330 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe548009e50 tx=0x7fe54800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25a2cec530e0448 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:34.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.845+0000 7fe547fff700 1 -- 172.21.15.26:0/4056279595 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54800e070 con 0x7fe550136f50 2023-10-01T07:55:34.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.845+0000 7fe547fff700 1 -- 172.21.15.26:0/4056279595 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54800b910 con 0x7fe550136f50 2023-10-01T07:55:34.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.845+0000 7fe547fff700 1 -- 172.21.15.26:0/4056279595 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54800bcc0 con 0x7fe550136f50 2023-10-01T07:55:34.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.846+0000 7fe557278700 1 -- 172.21.15.26:0/4056279595 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe550136f50 msgr2=0x7fe550139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:34.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.846+0000 7fe557278700 1 --2- 172.21.15.26:0/4056279595 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe550136f50 0x7fe550139330 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe548009e50 tx=0x7fe54800b330 comp rx=0 tx=0).stop 2023-10-01T07:55:34.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.846+0000 7fe557278700 1 -- 172.21.15.26:0/4056279595 shutdown_connections 2023-10-01T07:55:34.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.846+0000 7fe557278700 1 --2- 172.21.15.26:0/4056279595 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe550136f50 0x7fe550139330 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:34.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.846+0000 7fe557278700 1 --2- 172.21.15.26:0/4056279595 >> v2:172.21.15.26:3300/0 conn(0x7fe550134630 0x7fe550136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:34.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.846+0000 7fe557278700 1 -- 172.21.15.26:0/4056279595 >> 172.21.15.26:0/4056279595 conn(0x7fe5500a2aa0 msgr2=0x7fe5500a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:34.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.846+0000 7fe557278700 1 -- 172.21.15.26:0/4056279595 shutdown_connections 2023-10-01T07:55:34.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.846+0000 7fe557278700 1 -- 172.21.15.26:0/4056279595 wait complete. 2023-10-01T07:55:34.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.848+0000 7fe557278700 1 Processor -- start 2023-10-01T07:55:34.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.848+0000 7fe557278700 1 -- start start 2023-10-01T07:55:34.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.848+0000 7fe557278700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe550131810 0x7fe5501c8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:34.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.848+0000 7fe557278700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe550134630 0x7fe5501c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:34.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.848+0000 7fe557278700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe550136f50 0x7fe5501c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:34.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.848+0000 7fe557278700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55012ed50 con 0x7fe550134630 2023-10-01T07:55:34.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.848+0000 7fe557278700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe55009e3b0 con 0x7fe550131810 2023-10-01T07:55:34.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.848+0000 7fe557278700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe550136c40 con 0x7fe550136f50 2023-10-01T07:55:34.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.849+0000 7fe555014700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe550131810 0x7fe5501c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:34.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.849+0000 7fe555014700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe550131810 0x7fe5501c8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:53838/0 (socket says 172.21.15.26:53838) 2023-10-01T07:55:34.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.849+0000 7fe555014700 1 -- 172.21.15.26:0/4206993616 learned_addr learned my addr 172.21.15.26:0/4206993616 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:34.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.849+0000 7fe555815700 1 --2- 172.21.15.26:0/4206993616 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe550136f50 0x7fe5501c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:34.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.849+0000 7fe554813700 1 --2- 172.21.15.26:0/4206993616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe550134630 0x7fe5501c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:34.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.849+0000 7fe555815700 1 -- 172.21.15.26:0/4206993616 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe550131810 msgr2=0x7fe5501c8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:34.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.849+0000 7fe555815700 1 --2- 172.21.15.26:0/4206993616 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe550131810 0x7fe5501c8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:34.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.849+0000 7fe555815700 1 -- 172.21.15.26:0/4206993616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe550134630 msgr2=0x7fe5501c88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:34.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.849+0000 7fe555815700 1 --2- 172.21.15.26:0/4206993616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe550134630 0x7fe5501c88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:34.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.849+0000 7fe555815700 1 -- 172.21.15.26:0/4206993616 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe548009b30 con 0x7fe550136f50 2023-10-01T07:55:34.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.849+0000 7fe555014700 1 --2- 172.21.15.26:0/4206993616 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe550131810 0x7fe5501c8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:34.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.850+0000 7fe555815700 1 --2- 172.21.15.26:0/4206993616 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe550136f50 0x7fe5501c8df0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe548015000 tx=0x7fe548004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:34.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.850+0000 7fe545ffb700 1 -- 172.21.15.26:0/4206993616 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe548004570 con 0x7fe550136f50 2023-10-01T07:55:34.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.850+0000 7fe545ffb700 1 -- 172.21.15.26:0/4206993616 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5480092e0 con 0x7fe550136f50 2023-10-01T07:55:34.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.850+0000 7fe545ffb700 1 -- 172.21.15.26:0/4206993616 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe548004910 con 0x7fe550136f50 2023-10-01T07:55:34.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.850+0000 7fe557278700 1 -- 172.21.15.26:0/4206993616 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe55006eb00 con 0x7fe550136f50 2023-10-01T07:55:34.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.850+0000 7fe557278700 1 -- 172.21.15.26:0/4206993616 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe55011e960 con 0x7fe550136f50 2023-10-01T07:55:34.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.851+0000 7fe557278700 1 -- 172.21.15.26:0/4206993616 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe550132110 con 0x7fe550136f50 2023-10-01T07:55:34.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.852+0000 7fe545ffb700 1 -- 172.21.15.26:0/4206993616 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe54801c410 con 0x7fe550136f50 2023-10-01T07:55:34.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.852+0000 7fe545ffb700 1 -- 172.21.15.26:0/4206993616 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe548040d20 con 0x7fe550136f50 2023-10-01T07:55:34.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.861+0000 7fe545ffb700 1 -- 172.21.15.26:0/4206993616 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe548045070 con 0x7fe550136f50 2023-10-01T07:55:34.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.885+0000 7fa948e25700 1 Processor -- start 2023-10-01T07:55:34.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.885+0000 7fa948e25700 1 -- start start 2023-10-01T07:55:34.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.885+0000 7fd69a28e700 1 Processor -- start 2023-10-01T07:55:34.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.885+0000 7fd69a28e700 1 -- start start 2023-10-01T07:55:34.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.886+0000 7fd69a28e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd69412cf60 0x7fd69406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:34.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.886+0000 7fd69a28e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd69412f8b0 0x7fd69412fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:34.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.886+0000 7fd69a28e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd69412cd90 con 0x7fd694130260 2023-10-01T07:55:34.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.886+0000 7fd69a28e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd69412d330 con 0x7fd69412f8b0 2023-10-01T07:55:34.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.886+0000 7fd69a28e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6941306d0 con 0x7fd69412cf60 2023-10-01T07:55:34.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.886+0000 7fd693fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd69412cf60 0x7fd69406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:34.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.886+0000 7fd693fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd69412cf60 0x7fd69406f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35252/0 (socket says 172.21.15.26:35252) 2023-10-01T07:55:34.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.886+0000 7fd693fff700 1 -- 172.21.15.26:0/4245178814 learned_addr learned my addr 172.21.15.26:0/4245178814 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:34.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.886+0000 7fa948e25700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa94409d630 0x7fa9440a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:34.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.886+0000 7fa948e25700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa944138d80 0x7fa94413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:34.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.886+0000 7fa948e25700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9440a2a70 con 0x7fa9440a0a30 2023-10-01T07:55:34.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.886+0000 7fa948e25700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9440a01d0 con 0x7fa944138d80 2023-10-01T07:55:34.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.886+0000 7fa948e25700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa94409e2b0 con 0x7fa94409d630 2023-10-01T07:55:34.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.886+0000 7fa941d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa94409d630 0x7fa9440a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:34.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.886+0000 7fa941d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa94409d630 0x7fa9440a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35254/0 (socket says 172.21.15.26:35254) 2023-10-01T07:55:34.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.886+0000 7fa941d9b700 1 -- 172.21.15.26:0/1998344889 learned_addr learned my addr 172.21.15.26:0/1998344889 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:34.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.886+0000 7fd693fff700 1 -- 172.21.15.26:0/4245178814 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd69412f8b0 msgr2=0x7fd69412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:34.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.886+0000 7fd693fff700 1 --2- 172.21.15.26:0/4245178814 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd69412f8b0 0x7fd69412fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:34.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.886+0000 7fd693fff700 1 -- 172.21.15.26:0/4245178814 >> v1:172.21.15.26:6789/0 conn(0x7fd694130260 legacy=0x7fd694136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:34.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.886+0000 7fd693fff700 1 -- 172.21.15.26:0/4245178814 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd694071780 con 0x7fd69412cf60 2023-10-01T07:55:34.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.886+0000 7fa941d9b700 1 -- 172.21.15.26:0/1998344889 >> v2:172.21.15.26:3300/0 conn(0x7fa944138d80 msgr2=0x7fa94413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:34.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.886+0000 7fa941d9b700 1 --2- 172.21.15.26:0/1998344889 >> v2:172.21.15.26:3300/0 conn(0x7fa944138d80 0x7fa94413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:34.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.886+0000 7fa941d9b700 1 -- 172.21.15.26:0/1998344889 >> v1:172.21.15.26:6789/0 conn(0x7fa9440a0a30 legacy=0x7fa9440a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:34.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.886+0000 7fa941d9b700 1 -- 172.21.15.26:0/1998344889 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94409dc50 con 0x7fa94409d630 2023-10-01T07:55:34.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.886+0000 7fd693fff700 1 --2- 172.21.15.26:0/4245178814 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd69412cf60 0x7fd69406f5d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd68400bbc0 tx=0x7fd68400bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8abe1181dde8ef70 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:34.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.887+0000 7fa941d9b700 1 --2- 172.21.15.26:0/1998344889 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa94409d630 0x7fa9440a1510 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa9380098f0 tx=0x7fa938009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7e14cd6517577d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:34.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.887+0000 7fd692ffd700 1 -- 172.21.15.26:0/4245178814 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68400dc40 con 0x7fd69412cf60 2023-10-01T07:55:34.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.887+0000 7fd692ffd700 1 -- 172.21.15.26:0/4245178814 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68400dda0 con 0x7fd69412cf60 2023-10-01T07:55:34.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.887+0000 7fd692ffd700 1 -- 172.21.15.26:0/4245178814 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd684004270 con 0x7fd69412cf60 2023-10-01T07:55:34.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.887+0000 7fa94159a700 1 -- 172.21.15.26:0/1998344889 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa938004230 con 0x7fa94409d630 2023-10-01T07:55:34.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.887+0000 7fa94159a700 1 -- 172.21.15.26:0/1998344889 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa938004390 con 0x7fa94409d630 2023-10-01T07:55:34.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.887+0000 7fa94159a700 1 -- 172.21.15.26:0/1998344889 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9380036a0 con 0x7fa94409d630 2023-10-01T07:55:34.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.888+0000 7fd69a28e700 1 -- 172.21.15.26:0/4245178814 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd69412cf60 msgr2=0x7fd69406f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:34.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.888+0000 7fd69a28e700 1 --2- 172.21.15.26:0/4245178814 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd69412cf60 0x7fd69406f5d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd68400bbc0 tx=0x7fd68400bed0 comp rx=0 tx=0).stop 2023-10-01T07:55:34.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.888+0000 7fd69a28e700 1 -- 172.21.15.26:0/4245178814 shutdown_connections 2023-10-01T07:55:34.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.888+0000 7fd69a28e700 1 --2- 172.21.15.26:0/4245178814 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd69412cf60 0x7fd69406f5d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:34.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.888+0000 7fa948e25700 1 -- 172.21.15.26:0/1998344889 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa94409d630 msgr2=0x7fa9440a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:34.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.888+0000 7fa948e25700 1 --2- 172.21.15.26:0/1998344889 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa94409d630 0x7fa9440a1510 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa9380098f0 tx=0x7fa938009c00 comp rx=0 tx=0).stop 2023-10-01T07:55:34.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.888+0000 7fd69a28e700 1 --2- 172.21.15.26:0/4245178814 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd69412f8b0 0x7fd69412fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:34.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.888+0000 7fd69a28e700 1 -- 172.21.15.26:0/4245178814 >> 172.21.15.26:0/4245178814 conn(0x7fd6940a2aa0 msgr2=0x7fd6940a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:34.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.888+0000 7fa948e25700 1 -- 172.21.15.26:0/1998344889 shutdown_connections 2023-10-01T07:55:34.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.888+0000 7fa948e25700 1 --2- 172.21.15.26:0/1998344889 >> v2:172.21.15.26:3300/0 conn(0x7fa944138d80 0x7fa94413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:34.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.888+0000 7fa948e25700 1 --2- 172.21.15.26:0/1998344889 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa94409d630 0x7fa9440a1510 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:34.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.888+0000 7fa948e25700 1 -- 172.21.15.26:0/1998344889 >> 172.21.15.26:0/1998344889 conn(0x7fa9440a3050 msgr2=0x7fa9440a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:34.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.888+0000 7fd69a28e700 1 -- 172.21.15.26:0/4245178814 shutdown_connections 2023-10-01T07:55:34.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.888+0000 7fd69a28e700 1 -- 172.21.15.26:0/4245178814 wait complete. 2023-10-01T07:55:34.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.888+0000 7fa948e25700 1 -- 172.21.15.26:0/1998344889 shutdown_connections 2023-10-01T07:55:34.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.888+0000 7fa948e25700 1 -- 172.21.15.26:0/1998344889 wait complete. 2023-10-01T07:55:34.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.889+0000 7fd69a28e700 1 Processor -- start 2023-10-01T07:55:34.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.889+0000 7fa948e25700 1 Processor -- start 2023-10-01T07:55:34.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.889+0000 7fd69a28e700 1 -- start start 2023-10-01T07:55:34.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.889+0000 7fa948e25700 1 -- start start 2023-10-01T07:55:34.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.890+0000 7fd69a28e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd69412cf60 0x7fd6941c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:34.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.890+0000 7fd69a28e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd69412f8b0 0x7fd6941c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:34.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.890+0000 7fd69a28e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd694130260 0x7fd6941c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:34.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.890+0000 7fd69a28e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69412d7b0 con 0x7fd69412cf60 2023-10-01T07:55:34.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.890+0000 7fd69a28e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd694129fa0 con 0x7fd69412f8b0 2023-10-01T07:55:34.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.890+0000 7fd69a28e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd69409d790 con 0x7fd694130260 2023-10-01T07:55:34.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.890+0000 7fa948e25700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa94409d630 0x7fa94406dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:34.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.890+0000 7fa948e25700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9440a0a30 0x7fa94406e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:34.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.890+0000 7fa948e25700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa944138d80 0x7fa9441cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:34.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.890+0000 7fa948e25700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9440a4eb0 con 0x7fa9440a0a30 2023-10-01T07:55:34.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.890+0000 7fa948e25700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa94406f750 con 0x7fa94409d630 2023-10-01T07:55:34.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.890+0000 7fa948e25700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa944071270 con 0x7fa944138d80 2023-10-01T07:55:34.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.890+0000 7fa942d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa944138d80 0x7fa9441cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:34.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.890+0000 7fa942d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa944138d80 0x7fa9441cc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35280/0 (socket says 172.21.15.26:35280) 2023-10-01T07:55:34.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.890+0000 7fa942d9d700 1 -- 172.21.15.26:0/854664933 learned_addr learned my addr 172.21.15.26:0/854664933 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:34.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.890+0000 7fd69882b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd694130260 0x7fd6941c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:34.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.890+0000 7fd69882b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd694130260 0x7fd6941c4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35266/0 (socket says 172.21.15.26:35266) 2023-10-01T07:55:34.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.890+0000 7fd69882b700 1 -- 172.21.15.26:0/2660220664 learned_addr learned my addr 172.21.15.26:0/2660220664 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:34.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.890+0000 7fd693fff700 1 --2- 172.21.15.26:0/2660220664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd69412cf60 0x7fd6941c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:34.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.890+0000 7fa942d9d700 1 -- 172.21.15.26:0/854664933 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa94409d630 msgr2=0x7fa94406dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:34.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.890+0000 7fa942d9d700 1 --2- 172.21.15.26:0/854664933 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa94409d630 0x7fa94406dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:34.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.890+0000 7fa942d9d700 1 -- 172.21.15.26:0/854664933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9440a0a30 msgr2=0x7fa94406e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:34.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.890+0000 7fa942d9d700 1 --2- 172.21.15.26:0/854664933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9440a0a30 0x7fa94406e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:34.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.890+0000 7fa942d9d700 1 -- 172.21.15.26:0/854664933 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa938009550 con 0x7fa944138d80 2023-10-01T07:55:34.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.891+0000 7fd693fff700 1 -- 172.21.15.26:0/2660220664 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd694130260 msgr2=0x7fd6941c4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:34.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.891+0000 7fd693fff700 1 --2- 172.21.15.26:0/2660220664 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd694130260 0x7fd6941c4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:34.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.891+0000 7fd693fff700 1 -- 172.21.15.26:0/2660220664 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd69412f8b0 msgr2=0x7fd6941c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:34.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.891+0000 7fd693fff700 1 --2- 172.21.15.26:0/2660220664 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd69412f8b0 0x7fd6941c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:34.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.891+0000 7fd693fff700 1 -- 172.21.15.26:0/2660220664 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68400b7f0 con 0x7fd69412cf60 2023-10-01T07:55:34.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.891+0000 7fa942d9d700 1 --2- 172.21.15.26:0/854664933 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa944138d80 0x7fa9441cc6b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa93c00b9e0 tx=0x7fa93c00bda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:34.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.891+0000 7fd693fff700 1 --2- 172.21.15.26:0/2660220664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd69412cf60 0x7fd6941c41c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd684018000 tx=0x7fd684004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:34.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.891+0000 7fa932ffd700 1 -- 172.21.15.26:0/854664933 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c00c9b0 con 0x7fa944138d80 2023-10-01T07:55:34.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.891+0000 7fa932ffd700 1 -- 172.21.15.26:0/854664933 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93c00cb30 con 0x7fa944138d80 2023-10-01T07:55:34.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.892+0000 7fa948e25700 1 -- 172.21.15.26:0/854664933 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa944125d40 con 0x7fa944138d80 2023-10-01T07:55:34.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.892+0000 7fd690ff9700 1 -- 172.21.15.26:0/2660220664 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd684009040 con 0x7fd69412cf60 2023-10-01T07:55:34.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.892+0000 7fd69a28e700 1 -- 172.21.15.26:0/2660220664 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd69409d0e0 con 0x7fd69412cf60 2023-10-01T07:55:34.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.892+0000 7fd690ff9700 1 -- 172.21.15.26:0/2660220664 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6840045a0 con 0x7fd69412cf60 2023-10-01T07:55:34.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.892+0000 7fd69a28e700 1 -- 172.21.15.26:0/2660220664 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd694129b60 con 0x7fd69412cf60 2023-10-01T07:55:34.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.892+0000 7fd690ff9700 1 -- 172.21.15.26:0/2660220664 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6840206b0 con 0x7fd69412cf60 2023-10-01T07:55:34.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.892+0000 7fa948e25700 1 -- 172.21.15.26:0/854664933 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94406ee90 con 0x7fa944138d80 2023-10-01T07:55:34.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.892+0000 7fa932ffd700 1 -- 172.21.15.26:0/854664933 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c014440 con 0x7fa944138d80 2023-10-01T07:55:34.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.893+0000 7fd690ff9700 1 -- 172.21.15.26:0/2660220664 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd684015070 con 0x7fd69412cf60 2023-10-01T07:55:34.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.893+0000 7fd690ff9700 1 -- 172.21.15.26:0/2660220664 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd684040d10 con 0x7fd69412cf60 2023-10-01T07:55:34.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.893+0000 7fd69a28e700 1 -- 172.21.15.26:0/2660220664 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6740052e0 con 0x7fd69412cf60 2023-10-01T07:55:34.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.893+0000 7fa948e25700 1 -- 172.21.15.26:0/854664933 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9280052e0 con 0x7fa944138d80 2023-10-01T07:55:34.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.894+0000 7fa932ffd700 1 -- 172.21.15.26:0/854664933 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa93c01d3b0 con 0x7fa944138d80 2023-10-01T07:55:34.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.894+0000 7fa932ffd700 1 -- 172.21.15.26:0/854664933 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa93c006e40 con 0x7fa944138d80 2023-10-01T07:55:34.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.899+0000 7fa932ffd700 1 -- 172.21.15.26:0/854664933 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa93c01c360 con 0x7fa944138d80 2023-10-01T07:55:34.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:34.903+0000 7fd690ff9700 1 -- 172.21.15.26:0/2660220664 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd684017410 con 0x7fd69412cf60 2023-10-01T07:55:35.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.035+0000 7f81c83fe700 1 -- 172.21.15.26:0/2218547868 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f81c0074ea0 con 0x7f81c009e000 2023-10-01T07:55:35.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.035+0000 7f81b6ffd700 1 -- 172.21.15.26:0/2218547868 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f81b0016340 con 0x7f81c009e000 2023-10-01T07:55:35.036 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:35.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.039+0000 7f81c83fe700 1 -- 172.21.15.26:0/2218547868 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81c009e000 msgr2=0x7f81c011e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:35.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.039+0000 7f81c83fe700 1 --2- 172.21.15.26:0/2218547868 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81c009e000 0x7f81c011e4c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f81b0012c10 tx=0x7f81b0012f20 comp rx=0 tx=0).stop 2023-10-01T07:55:35.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.039+0000 7f81c83fe700 1 -- 172.21.15.26:0/2218547868 shutdown_connections 2023-10-01T07:55:35.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.039+0000 7f81c83fe700 1 --2- 172.21.15.26:0/2218547868 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f81c009e410 0x7f81c011ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:35.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.039+0000 7f81c83fe700 1 --2- 172.21.15.26:0/2218547868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81c009d6f0 0x7f81c011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:35.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.039+0000 7f81c83fe700 1 --2- 172.21.15.26:0/2218547868 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81c009e000 0x7f81c011e4c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:35.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.039+0000 7f81c83fe700 1 -- 172.21.15.26:0/2218547868 >> 172.21.15.26:0/2218547868 conn(0x7f81c0066f50 msgr2=0x7f81c0071110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:35.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.039+0000 7f81c83fe700 1 -- 172.21.15.26:0/2218547868 shutdown_connections 2023-10-01T07:55:35.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.039+0000 7f81c83fe700 1 -- 172.21.15.26:0/2218547868 wait complete. 2023-10-01T07:55:35.053 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:35.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.076+0000 7fe557278700 1 -- 172.21.15.26:0/4206993616 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe550074ea0 con 0x7fe550136f50 2023-10-01T07:55:35.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.076+0000 7fe545ffb700 1 -- 172.21.15.26:0/4206993616 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe548029030 con 0x7fe550136f50 2023-10-01T07:55:35.077 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:35.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.079+0000 7fe557278700 1 -- 172.21.15.26:0/4206993616 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe550136f50 msgr2=0x7fe5501c8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:35.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.079+0000 7fe557278700 1 --2- 172.21.15.26:0/4206993616 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe550136f50 0x7fe5501c8df0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe548015000 tx=0x7fe548004ad0 comp rx=0 tx=0).stop 2023-10-01T07:55:35.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.079+0000 7fe557278700 1 -- 172.21.15.26:0/4206993616 shutdown_connections 2023-10-01T07:55:35.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.079+0000 7fe557278700 1 --2- 172.21.15.26:0/4206993616 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe550136f50 0x7fe5501c8df0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:35.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.079+0000 7fe557278700 1 --2- 172.21.15.26:0/4206993616 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe550131810 0x7fe5501c8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:35.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.079+0000 7fe557278700 1 --2- 172.21.15.26:0/4206993616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe550134630 0x7fe5501c88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:35.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.079+0000 7fe557278700 1 -- 172.21.15.26:0/4206993616 >> 172.21.15.26:0/4206993616 conn(0x7fe5500a2aa0 msgr2=0x7fe55012f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:35.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.079+0000 7fe557278700 1 -- 172.21.15.26:0/4206993616 shutdown_connections 2023-10-01T07:55:35.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.079+0000 7fe557278700 1 -- 172.21.15.26:0/4206993616 wait complete. 2023-10-01T07:55:35.094 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:35.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.122+0000 7fa948e25700 1 -- 172.21.15.26:0/854664933 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa928005150 con 0x7fa944138d80 2023-10-01T07:55:35.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.122+0000 7fa932ffd700 1 -- 172.21.15.26:0/854664933 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa93c019070 con 0x7fa944138d80 2023-10-01T07:55:35.123 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:35.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.124+0000 7fa948e25700 1 -- 172.21.15.26:0/854664933 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa944138d80 msgr2=0x7fa9441cc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:35.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.124+0000 7fa948e25700 1 --2- 172.21.15.26:0/854664933 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa944138d80 0x7fa9441cc6b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa93c00b9e0 tx=0x7fa93c00bda0 comp rx=0 tx=0).stop 2023-10-01T07:55:35.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.124+0000 7fa948e25700 1 -- 172.21.15.26:0/854664933 shutdown_connections 2023-10-01T07:55:35.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.124+0000 7fa948e25700 1 --2- 172.21.15.26:0/854664933 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa944138d80 0x7fa9441cc6b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:35.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.124+0000 7fa948e25700 1 --2- 172.21.15.26:0/854664933 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa94409d630 0x7fa94406dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:35.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.124+0000 7fa948e25700 1 --2- 172.21.15.26:0/854664933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9440a0a30 0x7fa94406e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:35.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.124+0000 7fa948e25700 1 -- 172.21.15.26:0/854664933 >> 172.21.15.26:0/854664933 conn(0x7fa9440a3050 msgr2=0x7fa9440a52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:35.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.124+0000 7fa948e25700 1 -- 172.21.15.26:0/854664933 shutdown_connections 2023-10-01T07:55:35.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.124+0000 7fa948e25700 1 -- 172.21.15.26:0/854664933 wait complete. 2023-10-01T07:55:35.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.130+0000 7fd69a28e700 1 -- 172.21.15.26:0/2660220664 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd674005590 con 0x7fd69412cf60 2023-10-01T07:55:35.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.130+0000 7fd690ff9700 1 -- 172.21.15.26:0/2660220664 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd684028360 con 0x7fd69412cf60 2023-10-01T07:55:35.131 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:35.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.132+0000 7fd69a28e700 1 -- 172.21.15.26:0/2660220664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd69412cf60 msgr2=0x7fd6941c41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:35.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.132+0000 7fd69a28e700 1 --2- 172.21.15.26:0/2660220664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd69412cf60 0x7fd6941c41c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd684018000 tx=0x7fd684004750 comp rx=0 tx=0).stop 2023-10-01T07:55:35.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.133+0000 7fd69a28e700 1 -- 172.21.15.26:0/2660220664 shutdown_connections 2023-10-01T07:55:35.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.133+0000 7fd69a28e700 1 --2- 172.21.15.26:0/2660220664 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd694130260 0x7fd6941c4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:35.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.133+0000 7fd69a28e700 1 --2- 172.21.15.26:0/2660220664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd69412cf60 0x7fd6941c41c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:35.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.133+0000 7fd69a28e700 1 --2- 172.21.15.26:0/2660220664 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd69412f8b0 0x7fd6941c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:35.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.133+0000 7fd69a28e700 1 -- 172.21.15.26:0/2660220664 >> 172.21.15.26:0/2660220664 conn(0x7fd6940a2aa0 msgr2=0x7fd69406e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:35.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.133+0000 7fd69a28e700 1 -- 172.21.15.26:0/2660220664 shutdown_connections 2023-10-01T07:55:35.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:35.133+0000 7fd69a28e700 1 -- 172.21.15.26:0/2660220664 wait complete. 2023-10-01T07:55:35.139 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:35.147 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:36.055 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:36.095 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:36.140 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:36.148 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:36.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.213+0000 7f61a91fd700 1 Processor -- start 2023-10-01T07:55:36.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.213+0000 7f61a91fd700 1 -- start start 2023-10-01T07:55:36.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.214+0000 7f61a91fd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f61a409d6f0 0x7f61a409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:36.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.214+0000 7f61a91fd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61a409e000 0x7f61a41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:36.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.214+0000 7f61a91fd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f61a409e410 0x7f61a4133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:36.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.214+0000 7f61a91fd700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61a406b460 con 0x7f61a409e410 2023-10-01T07:55:36.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.214+0000 7f61a91fd700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a409b120 con 0x7f61a409e000 2023-10-01T07:55:36.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.214+0000 7f61a91fd700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61a409a7e0 con 0x7f61a409d6f0 2023-10-01T07:55:36.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.215+0000 7f61a2d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f61a409d6f0 0x7f61a409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:36.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.215+0000 7f61a2d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f61a409d6f0 0x7f61a409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35284/0 (socket says 172.21.15.26:35284) 2023-10-01T07:55:36.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.215+0000 7f61a2d9d700 1 -- 172.21.15.26:0/1568276922 learned_addr learned my addr 172.21.15.26:0/1568276922 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:36.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.215+0000 7f61a259c700 1 --2- 172.21.15.26:0/1568276922 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61a409e000 0x7f61a41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:36.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.215+0000 7f61a359e700 1 --2- 172.21.15.26:0/1568276922 >> v2:172.21.15.26:3300/0 conn(0x7f61a409e410 0x7f61a4133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:36.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.215+0000 7f61a2d9d700 1 -- 172.21.15.26:0/1568276922 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61a409e000 msgr2=0x7f61a41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:36.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.215+0000 7f61a2d9d700 1 --2- 172.21.15.26:0/1568276922 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61a409e000 0x7f61a41339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.215+0000 7f61a2d9d700 1 -- 172.21.15.26:0/1568276922 >> v2:172.21.15.26:3300/0 conn(0x7f61a409e410 msgr2=0x7f61a4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:36.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.215+0000 7f61a2d9d700 1 --2- 172.21.15.26:0/1568276922 >> v2:172.21.15.26:3300/0 conn(0x7f61a409e410 0x7f61a4133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.215+0000 7f61a2d9d700 1 -- 172.21.15.26:0/1568276922 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a409a500 con 0x7f61a409d6f0 2023-10-01T07:55:36.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.215+0000 7f61a2d9d700 1 --2- 172.21.15.26:0/1568276922 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f61a409d6f0 0x7f61a409dac0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6194009920 tx=0x7f6194009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4608636a094d4913 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:36.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.216+0000 7f61a1d9b700 1 -- 172.21.15.26:0/1568276922 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619400ba20 con 0x7f61a409d6f0 2023-10-01T07:55:36.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.216+0000 7f61a1d9b700 1 -- 172.21.15.26:0/1568276922 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619400bb80 con 0x7f61a409d6f0 2023-10-01T07:55:36.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.216+0000 7f61a1d9b700 1 -- 172.21.15.26:0/1568276922 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6194009e70 con 0x7f61a409d6f0 2023-10-01T07:55:36.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.217+0000 7f61a91fd700 1 -- 172.21.15.26:0/1568276922 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f61a409d6f0 msgr2=0x7f61a409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:36.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.217+0000 7f61a91fd700 1 --2- 172.21.15.26:0/1568276922 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f61a409d6f0 0x7f61a409dac0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6194009920 tx=0x7f6194009c30 comp rx=0 tx=0).stop 2023-10-01T07:55:36.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.217+0000 7f61a91fd700 1 -- 172.21.15.26:0/1568276922 shutdown_connections 2023-10-01T07:55:36.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.217+0000 7f61a91fd700 1 --2- 172.21.15.26:0/1568276922 >> v2:172.21.15.26:3300/0 conn(0x7f61a409e410 0x7f61a4133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.217+0000 7f61a91fd700 1 --2- 172.21.15.26:0/1568276922 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f61a409d6f0 0x7f61a409dac0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.217+0000 7f61a91fd700 1 --2- 172.21.15.26:0/1568276922 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61a409e000 0x7f61a41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.217+0000 7f61a91fd700 1 -- 172.21.15.26:0/1568276922 >> 172.21.15.26:0/1568276922 conn(0x7f61a4066f50 msgr2=0x7f61a409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:36.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.219+0000 7f61a91fd700 1 -- 172.21.15.26:0/1568276922 shutdown_connections 2023-10-01T07:55:36.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.219+0000 7f61a91fd700 1 -- 172.21.15.26:0/1568276922 wait complete. 2023-10-01T07:55:36.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.220+0000 7f61a91fd700 1 Processor -- start 2023-10-01T07:55:36.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.220+0000 7f61a91fd700 1 -- start start 2023-10-01T07:55:36.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.221+0000 7f61a91fd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f61a409d6f0 0x7f61a41a4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:36.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.221+0000 7f61a91fd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61a409e000 0x7f61a41a5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:36.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.221+0000 7f61a91fd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61a409e410 0x7f61a41a5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:36.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.221+0000 7f61a91fd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a41a8600 con 0x7f61a409e000 2023-10-01T07:55:36.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.221+0000 7f61a91fd700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a40a31a0 con 0x7f61a409e410 2023-10-01T07:55:36.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.221+0000 7f61a91fd700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61a41a6ae0 con 0x7f61a409d6f0 2023-10-01T07:55:36.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.221+0000 7f61a359e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61a409e410 0x7f61a41a5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:36.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.221+0000 7f61a259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61a409e000 0x7f61a41a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:36.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.221+0000 7f61a359e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61a409e410 0x7f61a41a5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:53878/0 (socket says 172.21.15.26:53878) 2023-10-01T07:55:36.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.221+0000 7f61a259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61a409e000 0x7f61a41a5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50236/0 (socket says 172.21.15.26:50236) 2023-10-01T07:55:36.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.221+0000 7f61a359e700 1 -- 172.21.15.26:0/3065821428 learned_addr learned my addr 172.21.15.26:0/3065821428 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:36.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.221+0000 7f61a2d9d700 1 --2- 172.21.15.26:0/3065821428 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f61a409d6f0 0x7f61a41a4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:36.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.221+0000 7f61a259c700 1 -- 172.21.15.26:0/3065821428 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f61a409d6f0 msgr2=0x7f61a41a4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:36.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.221+0000 7f61a259c700 1 --2- 172.21.15.26:0/3065821428 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f61a409d6f0 0x7f61a41a4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.221+0000 7f61a259c700 1 -- 172.21.15.26:0/3065821428 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61a409e410 msgr2=0x7f61a41a5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:36.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.221+0000 7f61a259c700 1 --2- 172.21.15.26:0/3065821428 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61a409e410 0x7f61a41a5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.221+0000 7f61a259c700 1 -- 172.21.15.26:0/3065821428 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6194009550 con 0x7f61a409e000 2023-10-01T07:55:36.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.222+0000 7f61a259c700 1 --2- 172.21.15.26:0/3065821428 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61a409e000 0x7f61a41a5410 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f619800e7e0 tx=0x7f619800eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:36.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.222+0000 7f618b7fe700 1 -- 172.21.15.26:0/3065821428 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619800c070 con 0x7f61a409e000 2023-10-01T07:55:36.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.222+0000 7f618b7fe700 1 -- 172.21.15.26:0/3065821428 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6198004020 con 0x7f61a409e000 2023-10-01T07:55:36.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.222+0000 7f618b7fe700 1 -- 172.21.15.26:0/3065821428 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61980043d0 con 0x7f61a409e000 2023-10-01T07:55:36.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.222+0000 7f61a91fd700 1 -- 172.21.15.26:0/3065821428 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61a409c710 con 0x7f61a409e000 2023-10-01T07:55:36.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.222+0000 7f61a91fd700 1 -- 172.21.15.26:0/3065821428 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a41a88e0 con 0x7f61a409e000 2023-10-01T07:55:36.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.223+0000 7f618b7fe700 1 -- 172.21.15.26:0/3065821428 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f61980036a0 con 0x7f61a409e000 2023-10-01T07:55:36.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.223+0000 7f618b7fe700 1 -- 172.21.15.26:0/3065821428 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f619803ef40 con 0x7f61a409e000 2023-10-01T07:55:36.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.224+0000 7f61a91fd700 1 -- 172.21.15.26:0/3065821428 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61a41a8740 con 0x7f61a409e000 2023-10-01T07:55:36.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.229+0000 7f618b7fe700 1 -- 172.21.15.26:0/3065821428 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f61a41a8740 con 0x7f61a409e000 2023-10-01T07:55:36.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.252+0000 7f9fef7d7700 1 Processor -- start 2023-10-01T07:55:36.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.252+0000 7f9fef7d7700 1 -- start start 2023-10-01T07:55:36.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.253+0000 7f9fef7d7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fe8131810 0x7f9fe8131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:36.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.253+0000 7f9fef7d7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9fe8099a40 0x7f9fe8099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:36.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.253+0000 7f9fef7d7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9fe809a3b0 0x7f9fe8138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:36.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.253+0000 7f9fef7d7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe81313c0 con 0x7f9fe8099a40 2023-10-01T07:55:36.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.253+0000 7f9fef7d7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe806e8c0 con 0x7f9fe809a3b0 2023-10-01T07:55:36.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.253+0000 7f9fef7d7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe809a820 con 0x7f9fe8131810 2023-10-01T07:55:36.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.253+0000 7f9fecd72700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9fe8099a40 0x7f9fe8099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:36.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.253+0000 7f9fecd72700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9fe8099a40 0x7f9fe8099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50252/0 (socket says 172.21.15.26:50252) 2023-10-01T07:55:36.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.253+0000 7f9fecd72700 1 -- 172.21.15.26:0/1605483871 learned_addr learned my addr 172.21.15.26:0/1605483871 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:36.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.253+0000 7f9fed573700 1 --2- 172.21.15.26:0/1605483871 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fe8131810 0x7f9fe8131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:36.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.254+0000 7f9fedd74700 1 --2- 172.21.15.26:0/1605483871 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9fe809a3b0 0x7f9fe8138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:36.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.254+0000 7f9fecd72700 1 -- 172.21.15.26:0/1605483871 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fe8131810 msgr2=0x7f9fe8131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:36.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.254+0000 7f9fecd72700 1 --2- 172.21.15.26:0/1605483871 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fe8131810 0x7f9fe8131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.254+0000 7f9fecd72700 1 -- 172.21.15.26:0/1605483871 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9fe809a3b0 msgr2=0x7f9fe8138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:36.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.254+0000 7f9fecd72700 1 --2- 172.21.15.26:0/1605483871 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9fe809a3b0 0x7f9fe8138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.254+0000 7f9fecd72700 1 -- 172.21.15.26:0/1605483871 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe8071d20 con 0x7f9fe8099a40 2023-10-01T07:55:36.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.254+0000 7f9fecd72700 1 --2- 172.21.15.26:0/1605483871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe8099a40 0x7f9fe8099e70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9fd80098f0 tx=0x7f9fd8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d000f6aaa1d482 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:36.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.254+0000 7f9fdffff700 1 -- 172.21.15.26:0/1605483871 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8011830 con 0x7f9fe8099a40 2023-10-01T07:55:36.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.254+0000 7f9fdffff700 1 -- 172.21.15.26:0/1605483871 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd8011990 con 0x7f9fe8099a40 2023-10-01T07:55:36.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.254+0000 7f9fdffff700 1 -- 172.21.15.26:0/1605483871 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8011d20 con 0x7f9fe8099a40 2023-10-01T07:55:36.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.255+0000 7f9fef7d7700 1 -- 172.21.15.26:0/1605483871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe8099a40 msgr2=0x7f9fe8099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:36.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.255+0000 7f9fef7d7700 1 --2- 172.21.15.26:0/1605483871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe8099a40 0x7f9fe8099e70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9fd80098f0 tx=0x7f9fd8009c00 comp rx=0 tx=0).stop 2023-10-01T07:55:36.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.255+0000 7f9fef7d7700 1 -- 172.21.15.26:0/1605483871 shutdown_connections 2023-10-01T07:55:36.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.255+0000 7f9fef7d7700 1 --2- 172.21.15.26:0/1605483871 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9fe809a3b0 0x7f9fe8138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.255+0000 7f9fef7d7700 1 --2- 172.21.15.26:0/1605483871 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fe8131810 0x7f9fe8131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.255+0000 7f9fef7d7700 1 --2- 172.21.15.26:0/1605483871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe8099a40 0x7f9fe8099e70 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.255+0000 7f9fef7d7700 1 -- 172.21.15.26:0/1605483871 >> 172.21.15.26:0/1605483871 conn(0x7f9fe80a2aa0 msgr2=0x7f9fe80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:36.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.256+0000 7f9fef7d7700 1 -- 172.21.15.26:0/1605483871 shutdown_connections 2023-10-01T07:55:36.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.256+0000 7f9fef7d7700 1 -- 172.21.15.26:0/1605483871 wait complete. 2023-10-01T07:55:36.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.257+0000 7f9fef7d7700 1 Processor -- start 2023-10-01T07:55:36.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.257+0000 7f9fef7d7700 1 -- start start 2023-10-01T07:55:36.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.257+0000 7f9fef7d7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe8099a40 0x7f9fe8119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:36.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.257+0000 7f9fef7d7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fe809a3b0 0x7f9fe8119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:36.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.257+0000 7f9fef7d7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9fe8131810 0x7f9fe811a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:36.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.257+0000 7f9fef7d7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe811aa40 con 0x7f9fe8099a40 2023-10-01T07:55:36.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.257+0000 7f9fef7d7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe811b1a0 con 0x7f9fe8131810 2023-10-01T07:55:36.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.257+0000 7f9fef7d7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe811c3f0 con 0x7f9fe809a3b0 2023-10-01T07:55:36.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.257+0000 7f9fedd74700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9fe8131810 0x7f9fe811a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:36.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.257+0000 7f9fedd74700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9fe8131810 0x7f9fe811a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:53900/0 (socket says 172.21.15.26:53900) 2023-10-01T07:55:36.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.257+0000 7f9fecd72700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fe809a3b0 0x7f9fe8119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:36.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.257+0000 7f9fedd74700 1 -- 172.21.15.26:0/3871945188 learned_addr learned my addr 172.21.15.26:0/3871945188 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:36.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.258+0000 7f9fed573700 1 --2- 172.21.15.26:0/3871945188 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe8099a40 0x7f9fe8119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:36.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.258+0000 7f9fecd72700 1 -- 172.21.15.26:0/3871945188 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9fe8131810 msgr2=0x7f9fe811a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:36.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.258+0000 7f9fecd72700 1 --2- 172.21.15.26:0/3871945188 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9fe8131810 0x7f9fe811a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.258+0000 7f9fecd72700 1 -- 172.21.15.26:0/3871945188 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe8099a40 msgr2=0x7f9fe8119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:36.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.258+0000 7f9fecd72700 1 --2- 172.21.15.26:0/3871945188 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe8099a40 0x7f9fe8119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.258+0000 7f9fecd72700 1 -- 172.21.15.26:0/3871945188 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd8009550 con 0x7f9fe809a3b0 2023-10-01T07:55:36.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.258+0000 7f9fedd74700 1 --2- 172.21.15.26:0/3871945188 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9fe8131810 0x7f9fe811a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:36.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.258+0000 7f9fecd72700 1 --2- 172.21.15.26:0/3871945188 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fe809a3b0 0x7f9fe8119ad0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9fe806dc90 tx=0x7f9fd8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:36.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.258+0000 7f9fddffb700 1 -- 172.21.15.26:0/3871945188 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8004240 con 0x7f9fe809a3b0 2023-10-01T07:55:36.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.258+0000 7f9fddffb700 1 -- 172.21.15.26:0/3871945188 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd801f070 con 0x7f9fe809a3b0 2023-10-01T07:55:36.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.258+0000 7f9fef7d7700 1 -- 172.21.15.26:0/3871945188 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe811cdd0 con 0x7f9fe809a3b0 2023-10-01T07:55:36.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.258+0000 7f9fddffb700 1 -- 172.21.15.26:0/3871945188 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd80036a0 con 0x7f9fe809a3b0 2023-10-01T07:55:36.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.259+0000 7f9fef7d7700 1 -- 172.21.15.26:0/3871945188 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe80a1cc0 con 0x7f9fe809a3b0 2023-10-01T07:55:36.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.260+0000 7f9fddffb700 1 -- 172.21.15.26:0/3871945188 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9fd8021030 con 0x7f9fe809a3b0 2023-10-01T07:55:36.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.260+0000 7f9fddffb700 1 -- 172.21.15.26:0/3871945188 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9fd8040650 con 0x7f9fe809a3b0 2023-10-01T07:55:36.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.260+0000 7f9fef7d7700 1 -- 172.21.15.26:0/3871945188 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe8074ea0 con 0x7f9fe809a3b0 2023-10-01T07:55:36.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.267+0000 7f9fddffb700 1 -- 172.21.15.26:0/3871945188 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9fd8015020 con 0x7f9fe809a3b0 2023-10-01T07:55:36.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.320+0000 7f8aebbf0700 1 Processor -- start 2023-10-01T07:55:36.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.321+0000 7f8aebbf0700 1 -- start start 2023-10-01T07:55:36.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.321+0000 7f8aebbf0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ae409e1d0 0x7f8ae4135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:36.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.321+0000 7f8aebbf0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8ae4135e50 0x7f8ae4138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:36.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.321+0000 7f8aebbf0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae409f130 con 0x7f8ae409d6f0 2023-10-01T07:55:36.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.321+0000 7f8aebbf0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae409f520 con 0x7f8ae409e1d0 2023-10-01T07:55:36.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.321+0000 7f8aebbf0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae409e930 con 0x7f8ae4135e50 2023-10-01T07:55:36.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.322+0000 7f8ae918b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ae409e1d0 0x7f8ae4135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:36.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.322+0000 7f8ae918b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ae409e1d0 0x7f8ae4135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:53906/0 (socket says 172.21.15.26:53906) 2023-10-01T07:55:36.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.322+0000 7f8aea18d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8ae4135e50 0x7f8ae4138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:36.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.322+0000 7f8ae918b700 1 -- 172.21.15.26:0/383826486 learned_addr learned my addr 172.21.15.26:0/383826486 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:36.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.322+0000 7f8ae918b700 1 -- 172.21.15.26:0/383826486 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8ae4135e50 msgr2=0x7f8ae4138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:36.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.322+0000 7f8ae918b700 1 --2- 172.21.15.26:0/383826486 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8ae4135e50 0x7f8ae4138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.322+0000 7f8ae918b700 1 -- 172.21.15.26:0/383826486 >> v1:172.21.15.26:6789/0 conn(0x7f8ae409d6f0 legacy=0x7f8ae409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:36.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.322+0000 7f8ae918b700 1 -- 172.21.15.26:0/383826486 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae409b2d0 con 0x7f8ae409e1d0 2023-10-01T07:55:36.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.322+0000 7f8ae918b700 1 --2- 172.21.15.26:0/383826486 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ae409e1d0 0x7f8ae4135910 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4009920 tx=0x7f8ad4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c16c555e591c3fa server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:36.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.322+0000 7f8ae898a700 1 -- 172.21.15.26:0/383826486 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad4004230 con 0x7f8ae409e1d0 2023-10-01T07:55:36.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.322+0000 7f8ae898a700 1 -- 172.21.15.26:0/383826486 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad4004390 con 0x7f8ae409e1d0 2023-10-01T07:55:36.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.323+0000 7f8ae898a700 1 -- 172.21.15.26:0/383826486 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad4009e70 con 0x7f8ae409e1d0 2023-10-01T07:55:36.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.323+0000 7f8aebbf0700 1 -- 172.21.15.26:0/383826486 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ae409e1d0 msgr2=0x7f8ae4135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:36.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.323+0000 7f8aebbf0700 1 --2- 172.21.15.26:0/383826486 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ae409e1d0 0x7f8ae4135910 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4009920 tx=0x7f8ad4009c30 comp rx=0 tx=0).stop 2023-10-01T07:55:36.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.324+0000 7f8aebbf0700 1 -- 172.21.15.26:0/383826486 shutdown_connections 2023-10-01T07:55:36.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.324+0000 7f8aebbf0700 1 --2- 172.21.15.26:0/383826486 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8ae4135e50 0x7f8ae4138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.324+0000 7f8aebbf0700 1 --2- 172.21.15.26:0/383826486 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ae409e1d0 0x7f8ae4135910 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.324+0000 7f8aebbf0700 1 -- 172.21.15.26:0/383826486 >> 172.21.15.26:0/383826486 conn(0x7f8ae4066f50 msgr2=0x7f8ae409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:36.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.324+0000 7f8aebbf0700 1 -- 172.21.15.26:0/383826486 shutdown_connections 2023-10-01T07:55:36.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.324+0000 7f8aebbf0700 1 -- 172.21.15.26:0/383826486 wait complete. 2023-10-01T07:55:36.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.325+0000 7f8aebbf0700 1 Processor -- start 2023-10-01T07:55:36.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.325+0000 7f8aebbf0700 1 -- start start 2023-10-01T07:55:36.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.325+0000 7f8aebbf0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ae409d6f0 0x7f8ae411f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:36.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.325+0000 7f8aebbf0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ae409e1d0 0x7f8ae411f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:36.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.325+0000 7f8aebbf0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8ae4135e50 0x7f8ae411fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:36.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.325+0000 7f8aebbf0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae41229c0 con 0x7f8ae409d6f0 2023-10-01T07:55:36.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.325+0000 7f8aebbf0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae4121080 con 0x7f8ae409e1d0 2023-10-01T07:55:36.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.325+0000 7f8aebbf0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae4122c10 con 0x7f8ae4135e50 2023-10-01T07:55:36.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.325+0000 7f8ae998c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ae409d6f0 0x7f8ae411f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:36.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.326+0000 7f8ae918b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ae409e1d0 0x7f8ae411f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:36.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.326+0000 7f8ae918b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ae409e1d0 0x7f8ae411f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:53914/0 (socket says 172.21.15.26:53914) 2023-10-01T07:55:36.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.326+0000 7f8ae998c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ae409d6f0 0x7f8ae411f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50278/0 (socket says 172.21.15.26:50278) 2023-10-01T07:55:36.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.326+0000 7f8ae918b700 1 -- 172.21.15.26:0/2799080195 learned_addr learned my addr 172.21.15.26:0/2799080195 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:36.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.326+0000 7f8aea18d700 1 --2- 172.21.15.26:0/2799080195 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8ae4135e50 0x7f8ae411fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:36.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.326+0000 7f8ae918b700 1 -- 172.21.15.26:0/2799080195 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8ae4135e50 msgr2=0x7f8ae411fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:36.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.326+0000 7f8ae918b700 1 --2- 172.21.15.26:0/2799080195 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8ae4135e50 0x7f8ae411fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.326+0000 7f8ae918b700 1 -- 172.21.15.26:0/2799080195 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ae409d6f0 msgr2=0x7f8ae411f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:36.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.326+0000 7f8ae918b700 1 --2- 172.21.15.26:0/2799080195 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ae409d6f0 0x7f8ae411f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.326+0000 7f8ae918b700 1 -- 172.21.15.26:0/2799080195 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad4009550 con 0x7f8ae409e1d0 2023-10-01T07:55:36.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.326+0000 7f8ae998c700 1 --2- 172.21.15.26:0/2799080195 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ae409d6f0 0x7f8ae411f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:36.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.326+0000 7f8ae918b700 1 --2- 172.21.15.26:0/2799080195 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ae409e1d0 0x7f8ae411f910 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8ad40098f0 tx=0x7f8ad4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:36.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.327+0000 7f8ada7fc700 1 -- 172.21.15.26:0/2799080195 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad4021070 con 0x7f8ae409e1d0 2023-10-01T07:55:36.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.327+0000 7f8ada7fc700 1 -- 172.21.15.26:0/2799080195 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad400baf0 con 0x7f8ae409e1d0 2023-10-01T07:55:36.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.327+0000 7f8aebbf0700 1 -- 172.21.15.26:0/2799080195 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae4071cf0 con 0x7f8ae409e1d0 2023-10-01T07:55:36.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.327+0000 7f8ada7fc700 1 -- 172.21.15.26:0/2799080195 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad400be80 con 0x7f8ae409e1d0 2023-10-01T07:55:36.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.327+0000 7f8aebbf0700 1 -- 172.21.15.26:0/2799080195 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae4123680 con 0x7f8ae409e1d0 2023-10-01T07:55:36.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.328+0000 7f8ada7fc700 1 -- 172.21.15.26:0/2799080195 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8ad401c760 con 0x7f8ae409e1d0 2023-10-01T07:55:36.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.328+0000 7f8ac7fff700 1 -- 172.21.15.26:0/2799080195 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ac00052e0 con 0x7f8ae409e1d0 2023-10-01T07:55:36.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.328+0000 7f8ada7fc700 1 -- 172.21.15.26:0/2799080195 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8ad4044820 con 0x7f8ae409e1d0 2023-10-01T07:55:36.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.338+0000 7f8ada7fc700 1 -- 172.21.15.26:0/2799080195 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ad401ca10 con 0x7f8ae409e1d0 2023-10-01T07:55:36.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.374+0000 7f6d54a88700 1 Processor -- start 2023-10-01T07:55:36.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.374+0000 7f6d54a88700 1 -- start start 2023-10-01T07:55:36.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.375+0000 7f6d54a88700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6d50130540 0x7f6d50130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:36.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.375+0000 7f6d54a88700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6d5006fcf0 0x7f6d50138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:36.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.375+0000 7f6d54a88700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d500716a0 con 0x7f6d50130e50 2023-10-01T07:55:36.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.375+0000 7f6d54a88700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5009a390 con 0x7f6d50130540 2023-10-01T07:55:36.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.375+0000 7f6d54a88700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d50071290 con 0x7f6d5006fcf0 2023-10-01T07:55:36.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.375+0000 7f6d4ed9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6d5006fcf0 0x7f6d50138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:36.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.376+0000 7f6d4ed9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6d5006fcf0 0x7f6d50138570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35354/0 (socket says 172.21.15.26:35354) 2023-10-01T07:55:36.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.376+0000 7f6d4ed9d700 1 -- 172.21.15.26:0/415088128 learned_addr learned my addr 172.21.15.26:0/415088128 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:36.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.376+0000 7f6d4e59c700 1 --2- 172.21.15.26:0/415088128 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6d50130540 0x7f6d50130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:36.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.376+0000 7f6d4ed9d700 1 -- 172.21.15.26:0/415088128 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6d50130540 msgr2=0x7f6d50130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:36.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.376+0000 7f6d4ed9d700 1 --2- 172.21.15.26:0/415088128 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6d50130540 0x7f6d50130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.376+0000 7f6d4ed9d700 1 -- 172.21.15.26:0/415088128 >> v1:172.21.15.26:6789/0 conn(0x7f6d50130e50 legacy=0x7f6d5006f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:36.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.376+0000 7f6d4ed9d700 1 -- 172.21.15.26:0/415088128 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d50130340 con 0x7f6d5006fcf0 2023-10-01T07:55:36.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.376+0000 7f6d4d59a700 1 -- 172.21.15.26:0/415088128 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3989034272 0 0) 0x7f6d500716a0 con 0x7f6d50130e50 2023-10-01T07:55:36.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.376+0000 7f6d4ed9d700 1 --2- 172.21.15.26:0/415088128 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6d5006fcf0 0x7f6d50138570 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800d180 tx=0x7f6d4800d490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31722fb7b96d678f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:36.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.376+0000 7f6d4d59a700 1 -- 172.21.15.26:0/415088128 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d48010070 con 0x7f6d5006fcf0 2023-10-01T07:55:36.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.376+0000 7f6d4d59a700 1 -- 172.21.15.26:0/415088128 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4800dd40 con 0x7f6d5006fcf0 2023-10-01T07:55:36.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.376+0000 7f6d4d59a700 1 -- 172.21.15.26:0/415088128 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4800b310 con 0x7f6d5006fcf0 2023-10-01T07:55:36.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.377+0000 7f6d54a88700 1 -- 172.21.15.26:0/415088128 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6d5006fcf0 msgr2=0x7f6d50138570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:36.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.377+0000 7f6d54a88700 1 --2- 172.21.15.26:0/415088128 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6d5006fcf0 0x7f6d50138570 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800d180 tx=0x7f6d4800d490 comp rx=0 tx=0).stop 2023-10-01T07:55:36.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.377+0000 7f6d54a88700 1 -- 172.21.15.26:0/415088128 shutdown_connections 2023-10-01T07:55:36.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.377+0000 7f6d54a88700 1 --2- 172.21.15.26:0/415088128 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6d5006fcf0 0x7f6d50138570 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.377+0000 7f6d54a88700 1 --2- 172.21.15.26:0/415088128 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6d50130540 0x7f6d50130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.377+0000 7f6d54a88700 1 -- 172.21.15.26:0/415088128 >> 172.21.15.26:0/415088128 conn(0x7f6d500a2aa0 msgr2=0x7f6d500a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:36.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.377+0000 7f6d54a88700 1 -- 172.21.15.26:0/415088128 shutdown_connections 2023-10-01T07:55:36.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.377+0000 7f6d54a88700 1 -- 172.21.15.26:0/415088128 wait complete. 2023-10-01T07:55:36.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.378+0000 7f6d54a88700 1 Processor -- start 2023-10-01T07:55:36.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.378+0000 7f6d54a88700 1 -- start start 2023-10-01T07:55:36.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.379+0000 7f6d54a88700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6d5006fcf0 0x7f6d5011eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:36.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.379+0000 7f6d54a88700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d50130540 0x7f6d5011f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:36.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.379+0000 7f6d54a88700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6d50130e50 0x7f6d5011f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:36.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.379+0000 7f6d54a88700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d501223d0 con 0x7f6d50130540 2023-10-01T07:55:36.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.379+0000 7f6d54a88700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5012c580 con 0x7f6d5006fcf0 2023-10-01T07:55:36.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.379+0000 7f6d54a88700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d50120760 con 0x7f6d50130e50 2023-10-01T07:55:36.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.379+0000 7f6d4ed9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6d50130e50 0x7f6d5011f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:36.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.379+0000 7f6d4ed9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6d50130e50 0x7f6d5011f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35358/0 (socket says 172.21.15.26:35358) 2023-10-01T07:55:36.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.379+0000 7f6d4ed9d700 1 -- 172.21.15.26:0/4072327565 learned_addr learned my addr 172.21.15.26:0/4072327565 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:36.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.379+0000 7f6d4dd9b700 1 --2- 172.21.15.26:0/4072327565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d50130540 0x7f6d5011f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:36.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.379+0000 7f6d4e59c700 1 --2- 172.21.15.26:0/4072327565 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6d5006fcf0 0x7f6d5011eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:36.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.379+0000 7f6d4ed9d700 1 -- 172.21.15.26:0/4072327565 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6d5006fcf0 msgr2=0x7f6d5011eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:36.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.379+0000 7f6d4ed9d700 1 --2- 172.21.15.26:0/4072327565 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6d5006fcf0 0x7f6d5011eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.379+0000 7f6d4ed9d700 1 -- 172.21.15.26:0/4072327565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d50130540 msgr2=0x7f6d5011f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:36.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.379+0000 7f6d4ed9d700 1 --2- 172.21.15.26:0/4072327565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d50130540 0x7f6d5011f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.379+0000 7f6d4ed9d700 1 -- 172.21.15.26:0/4072327565 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4800bd40 con 0x7f6d50130e50 2023-10-01T07:55:36.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.380+0000 7f6d4e59c700 1 --2- 172.21.15.26:0/4072327565 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6d5006fcf0 0x7f6d5011eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:55:36.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.380+0000 7f6d4ed9d700 1 --2- 172.21.15.26:0/4072327565 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6d50130e50 0x7f6d5011f5c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800d7e0 tx=0x7f6d48004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:36.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.380+0000 7f6d3effd700 1 -- 172.21.15.26:0/4072327565 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d48009a10 con 0x7f6d50130e50 2023-10-01T07:55:36.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.380+0000 7f6d3effd700 1 -- 172.21.15.26:0/4072327565 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d48009b70 con 0x7f6d50130e50 2023-10-01T07:55:36.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.380+0000 7f6d54a88700 1 -- 172.21.15.26:0/4072327565 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d500a07a0 con 0x7f6d50130e50 2023-10-01T07:55:36.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.380+0000 7f6d54a88700 1 -- 172.21.15.26:0/4072327565 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d50122d60 con 0x7f6d50130e50 2023-10-01T07:55:36.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.380+0000 7f6d3effd700 1 -- 172.21.15.26:0/4072327565 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d48004040 con 0x7f6d50130e50 2023-10-01T07:55:36.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.381+0000 7f6d3effd700 1 -- 172.21.15.26:0/4072327565 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6d480041a0 con 0x7f6d50130e50 2023-10-01T07:55:36.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.381+0000 7f6d54a88700 1 -- 172.21.15.26:0/4072327565 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d50122210 con 0x7f6d50130e50 2023-10-01T07:55:36.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.381+0000 7f6d3effd700 1 -- 172.21.15.26:0/4072327565 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6d480411d0 con 0x7f6d50130e50 2023-10-01T07:55:36.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.386+0000 7f6d3effd700 1 -- 172.21.15.26:0/4072327565 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6d48013980 con 0x7f6d50130e50 2023-10-01T07:55:36.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.454+0000 7f61a91fd700 1 -- 172.21.15.26:0/3065821428 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f61a41a8740 con 0x7f61a409e000 2023-10-01T07:55:36.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.454+0000 7f618b7fe700 1 -- 172.21.15.26:0/3065821428 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f61a41a8740 con 0x7f61a409e000 2023-10-01T07:55:36.456 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:36.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.458+0000 7f61a91fd700 1 -- 172.21.15.26:0/3065821428 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61a409e000 msgr2=0x7f61a41a5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:36.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.458+0000 7f61a91fd700 1 --2- 172.21.15.26:0/3065821428 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61a409e000 0x7f61a41a5410 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f619800e7e0 tx=0x7f619800eaf0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.458+0000 7f61a91fd700 1 -- 172.21.15.26:0/3065821428 shutdown_connections 2023-10-01T07:55:36.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.458+0000 7f61a91fd700 1 --2- 172.21.15.26:0/3065821428 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61a409e410 0x7f61a41a5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.458+0000 7f61a91fd700 1 --2- 172.21.15.26:0/3065821428 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f61a409d6f0 0x7f61a41a4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.458+0000 7f61a91fd700 1 --2- 172.21.15.26:0/3065821428 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61a409e000 0x7f61a41a5410 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.458+0000 7f61a91fd700 1 -- 172.21.15.26:0/3065821428 >> 172.21.15.26:0/3065821428 conn(0x7f61a4066f50 msgr2=0x7f61a41b9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:36.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.458+0000 7f61a91fd700 1 -- 172.21.15.26:0/3065821428 shutdown_connections 2023-10-01T07:55:36.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.458+0000 7f61a91fd700 1 -- 172.21.15.26:0/3065821428 wait complete. 2023-10-01T07:55:36.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:36.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.484+0000 7f9fef7d7700 1 -- 172.21.15.26:0/3871945188 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9fe811cbc0 con 0x7f9fe809a3b0 2023-10-01T07:55:36.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.485+0000 7f9fddffb700 1 -- 172.21.15.26:0/3871945188 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9fd8003800 con 0x7f9fe809a3b0 2023-10-01T07:55:36.486 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:36.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.487+0000 7f9fef7d7700 1 -- 172.21.15.26:0/3871945188 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fe809a3b0 msgr2=0x7f9fe8119ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:36.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.487+0000 7f9fef7d7700 1 --2- 172.21.15.26:0/3871945188 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fe809a3b0 0x7f9fe8119ad0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9fe806dc90 tx=0x7f9fd8004750 comp rx=0 tx=0).stop 2023-10-01T07:55:36.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.487+0000 7f9fef7d7700 1 -- 172.21.15.26:0/3871945188 shutdown_connections 2023-10-01T07:55:36.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.487+0000 7f9fef7d7700 1 --2- 172.21.15.26:0/3871945188 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9fe8131810 0x7f9fe811a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.487+0000 7f9fef7d7700 1 --2- 172.21.15.26:0/3871945188 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe8099a40 0x7f9fe8119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.487+0000 7f9fef7d7700 1 --2- 172.21.15.26:0/3871945188 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fe809a3b0 0x7f9fe8119ad0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.487+0000 7f9fef7d7700 1 -- 172.21.15.26:0/3871945188 >> 172.21.15.26:0/3871945188 conn(0x7f9fe80a2aa0 msgr2=0x7f9fe812e610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:36.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.487+0000 7f9fef7d7700 1 -- 172.21.15.26:0/3871945188 shutdown_connections 2023-10-01T07:55:36.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.487+0000 7f9fef7d7700 1 -- 172.21.15.26:0/3871945188 wait complete. 2023-10-01T07:55:36.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:36.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.566+0000 7f8ac7fff700 1 -- 172.21.15.26:0/2799080195 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8ac0005590 con 0x7f8ae409e1d0 2023-10-01T07:55:36.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.566+0000 7f8ada7fc700 1 -- 172.21.15.26:0/2799080195 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ad4010b70 con 0x7f8ae409e1d0 2023-10-01T07:55:36.568 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:36.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.568+0000 7f8ac7fff700 1 -- 172.21.15.26:0/2799080195 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ae409e1d0 msgr2=0x7f8ae411f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:36.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.568+0000 7f8ac7fff700 1 --2- 172.21.15.26:0/2799080195 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ae409e1d0 0x7f8ae411f910 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8ad40098f0 tx=0x7f8ad4004750 comp rx=0 tx=0).stop 2023-10-01T07:55:36.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.568+0000 7f8ac7fff700 1 -- 172.21.15.26:0/2799080195 shutdown_connections 2023-10-01T07:55:36.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.569+0000 7f8ac7fff700 1 --2- 172.21.15.26:0/2799080195 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8ae4135e50 0x7f8ae411fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.569+0000 7f8ac7fff700 1 --2- 172.21.15.26:0/2799080195 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ae409d6f0 0x7f8ae411f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.569+0000 7f8ac7fff700 1 --2- 172.21.15.26:0/2799080195 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ae409e1d0 0x7f8ae411f910 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.569+0000 7f8ac7fff700 1 -- 172.21.15.26:0/2799080195 >> 172.21.15.26:0/2799080195 conn(0x7f8ae4066f50 msgr2=0x7f8ae40a17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:36.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.569+0000 7f8ac7fff700 1 -- 172.21.15.26:0/2799080195 shutdown_connections 2023-10-01T07:55:36.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.569+0000 7f8ac7fff700 1 -- 172.21.15.26:0/2799080195 wait complete. 2023-10-01T07:55:36.583 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:36.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.595+0000 7f6d54a88700 1 -- 172.21.15.26:0/4072327565 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6d50074ea0 con 0x7f6d50130e50 2023-10-01T07:55:36.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.595+0000 7f6d3effd700 1 -- 172.21.15.26:0/4072327565 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6d48021020 con 0x7f6d50130e50 2023-10-01T07:55:36.597 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:36.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.598+0000 7f6d54a88700 1 -- 172.21.15.26:0/4072327565 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6d50130e50 msgr2=0x7f6d5011f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:36.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.598+0000 7f6d54a88700 1 --2- 172.21.15.26:0/4072327565 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6d50130e50 0x7f6d5011f5c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800d7e0 tx=0x7f6d48004ad0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.598+0000 7f6d54a88700 1 -- 172.21.15.26:0/4072327565 shutdown_connections 2023-10-01T07:55:36.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.598+0000 7f6d54a88700 1 --2- 172.21.15.26:0/4072327565 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6d50130e50 0x7f6d5011f5c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.598+0000 7f6d54a88700 1 --2- 172.21.15.26:0/4072327565 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6d5006fcf0 0x7f6d5011eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.598+0000 7f6d54a88700 1 --2- 172.21.15.26:0/4072327565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d50130540 0x7f6d5011f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:36.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.598+0000 7f6d54a88700 1 -- 172.21.15.26:0/4072327565 >> 172.21.15.26:0/4072327565 conn(0x7f6d500a2aa0 msgr2=0x7f6d5012d690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:36.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.598+0000 7f6d54a88700 1 -- 172.21.15.26:0/4072327565 shutdown_connections 2023-10-01T07:55:36.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:36.598+0000 7f6d54a88700 1 -- 172.21.15.26:0/4072327565 wait complete. 2023-10-01T07:55:36.613 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:37.480 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:37.504 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:37.584 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:37.614 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:37.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.633+0000 7f0198b44700 1 Processor -- start 2023-10-01T07:55:37.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.633+0000 7f0198b44700 1 -- start start 2023-10-01T07:55:37.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.634+0000 7f0198b44700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f019409d6f0 0x7f019409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:37.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.634+0000 7f0198b44700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f019409e440 0x7f0194134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:37.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.634+0000 7f0198b44700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f019409b120 con 0x7f019409e000 2023-10-01T07:55:37.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.634+0000 7f0198b44700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f019406b460 con 0x7f019409d6f0 2023-10-01T07:55:37.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.634+0000 7f0198b44700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f019409a7e0 con 0x7f019409e440 2023-10-01T07:55:37.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.634+0000 7f019259c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f019409d6f0 0x7f019409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:37.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.634+0000 7f019259c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f019409d6f0 0x7f019409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50292/0 (socket says 172.21.15.26:50292) 2023-10-01T07:55:37.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.634+0000 7f019259c700 1 -- 172.21.15.26:0/3005788627 learned_addr learned my addr 172.21.15.26:0/3005788627 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:37.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.634+0000 7f0192d9d700 1 --2- 172.21.15.26:0/3005788627 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f019409e440 0x7f0194134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:37.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.634+0000 7f019259c700 1 -- 172.21.15.26:0/3005788627 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f019409e440 msgr2=0x7f0194134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:37.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.634+0000 7f019259c700 1 --2- 172.21.15.26:0/3005788627 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f019409e440 0x7f0194134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.634+0000 7f019259c700 1 -- 172.21.15.26:0/3005788627 >> v1:172.21.15.26:6789/0 conn(0x7f019409e000 legacy=0x7f01941339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:37.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.634+0000 7f019259c700 1 -- 172.21.15.26:0/3005788627 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f019409a500 con 0x7f019409d6f0 2023-10-01T07:55:37.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.635+0000 7f019259c700 1 --2- 172.21.15.26:0/3005788627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f019409d6f0 0x7f019409dac0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0184009920 tx=0x7f0184009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f411d0d72b082fa3 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:37.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.635+0000 7f019159a700 1 -- 172.21.15.26:0/3005788627 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0184014e90 con 0x7f019409d6f0 2023-10-01T07:55:37.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.635+0000 7f019159a700 1 -- 172.21.15.26:0/3005788627 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018401c440 con 0x7f019409d6f0 2023-10-01T07:55:37.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.635+0000 7f019159a700 1 -- 172.21.15.26:0/3005788627 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018401c7d0 con 0x7f019409d6f0 2023-10-01T07:55:37.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.636+0000 7f0198b44700 1 -- 172.21.15.26:0/3005788627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f019409d6f0 msgr2=0x7f019409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:37.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.636+0000 7f0198b44700 1 --2- 172.21.15.26:0/3005788627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f019409d6f0 0x7f019409dac0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0184009920 tx=0x7f0184009c30 comp rx=0 tx=0).stop 2023-10-01T07:55:37.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.636+0000 7f0198b44700 1 -- 172.21.15.26:0/3005788627 shutdown_connections 2023-10-01T07:55:37.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.636+0000 7f0198b44700 1 --2- 172.21.15.26:0/3005788627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f019409d6f0 0x7f019409dac0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.636+0000 7f0198b44700 1 --2- 172.21.15.26:0/3005788627 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f019409e440 0x7f0194134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.636+0000 7f0198b44700 1 -- 172.21.15.26:0/3005788627 >> 172.21.15.26:0/3005788627 conn(0x7f0194066f50 msgr2=0x7f019409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:37.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.636+0000 7f0198b44700 1 -- 172.21.15.26:0/3005788627 shutdown_connections 2023-10-01T07:55:37.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.636+0000 7f0198b44700 1 -- 172.21.15.26:0/3005788627 wait complete. 2023-10-01T07:55:37.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.637+0000 7f0198b44700 1 Processor -- start 2023-10-01T07:55:37.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.637+0000 7f0198b44700 1 -- start start 2023-10-01T07:55:37.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.638+0000 7f0198b44700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f019409d6f0 0x7f019411ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:37.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.638+0000 7f0198b44700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f019409e000 0x7f019411b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:37.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.638+0000 7f0198b44700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f019409e440 0x7f019411b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:37.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.638+0000 7f0198b44700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019411e750 con 0x7f019409e440 2023-10-01T07:55:37.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.638+0000 7f0198b44700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f019411d840 con 0x7f019409d6f0 2023-10-01T07:55:37.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.638+0000 7f0198b44700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f019411cae0 con 0x7f019409e000 2023-10-01T07:55:37.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.638+0000 7f019259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f019409d6f0 0x7f019411ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:37.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.638+0000 7f019259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f019409d6f0 0x7f019411ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:53954/0 (socket says 172.21.15.26:53954) 2023-10-01T07:55:37.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.638+0000 7f019259c700 1 -- 172.21.15.26:0/3527978505 learned_addr learned my addr 172.21.15.26:0/3527978505 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:37.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.638+0000 7f0191d9b700 1 --2- 172.21.15.26:0/3527978505 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f019409e000 0x7f019411b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:37.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.638+0000 7f0192d9d700 1 --2- 172.21.15.26:0/3527978505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f019409e440 0x7f019411b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:37.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.638+0000 7f0192d9d700 1 -- 172.21.15.26:0/3527978505 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f019409e000 msgr2=0x7f019411b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:37.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.638+0000 7f0192d9d700 1 --2- 172.21.15.26:0/3527978505 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f019409e000 0x7f019411b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.639+0000 7f0192d9d700 1 -- 172.21.15.26:0/3527978505 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f019409d6f0 msgr2=0x7f019411ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:37.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.639+0000 7f0192d9d700 1 --2- 172.21.15.26:0/3527978505 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f019409d6f0 0x7f019411ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.639+0000 7f0192d9d700 1 -- 172.21.15.26:0/3527978505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0184009550 con 0x7f019409e440 2023-10-01T07:55:37.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.639+0000 7f0191d9b700 1 --2- 172.21.15.26:0/3527978505 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f019409e000 0x7f019411b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:37.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.639+0000 7f0192d9d700 1 --2- 172.21.15.26:0/3527978505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f019409e440 0x7f019411b8b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f018c00efc0 tx=0x7f018c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:37.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.639+0000 7f0182ffd700 1 -- 172.21.15.26:0/3527978505 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c00cc90 con 0x7f019409e440 2023-10-01T07:55:37.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.639+0000 7f0182ffd700 1 -- 172.21.15.26:0/3527978505 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018c00f040 con 0x7f019409e440 2023-10-01T07:55:37.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.639+0000 7f0182ffd700 1 -- 172.21.15.26:0/3527978505 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c0146c0 con 0x7f019409e440 2023-10-01T07:55:37.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.639+0000 7f0198b44700 1 -- 172.21.15.26:0/3527978505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01940a1d00 con 0x7f019409e440 2023-10-01T07:55:37.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.639+0000 7f0198b44700 1 -- 172.21.15.26:0/3527978505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f019409c770 con 0x7f019409e440 2023-10-01T07:55:37.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.640+0000 7f0198b44700 1 -- 172.21.15.26:0/3527978505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f019411f1a0 con 0x7f019409e440 2023-10-01T07:55:37.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.641+0000 7f0182ffd700 1 -- 172.21.15.26:0/3527978505 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f018c014820 con 0x7f019409e440 2023-10-01T07:55:37.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.641+0000 7f0182ffd700 1 -- 172.21.15.26:0/3527978505 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f018c040300 con 0x7f019409e440 2023-10-01T07:55:37.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.650+0000 7f0182ffd700 1 -- 172.21.15.26:0/3527978505 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f018c007920 con 0x7f019409e440 2023-10-01T07:55:37.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.673+0000 7f9d6fa42700 1 Processor -- start 2023-10-01T07:55:37.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.674+0000 7f9d6fa42700 1 -- start start 2023-10-01T07:55:37.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.674+0000 7f9d6fa42700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d6809d6f0 0x7f9d6809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:37.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.674+0000 7f9d6fa42700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d6809e000 0x7f9d68130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:37.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.674+0000 7f9d6fa42700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9d6809e410 0x7f9d68130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:37.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.674+0000 7f9d6fa42700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d6809f520 con 0x7f9d6809e410 2023-10-01T07:55:37.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.675+0000 7f9d6fa42700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6809f130 con 0x7f9d6809d6f0 2023-10-01T07:55:37.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.675+0000 7f9d6fa42700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6809e930 con 0x7f9d6809e000 2023-10-01T07:55:37.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.675+0000 7f9d6cfdd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d6809e000 0x7f9d68130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:37.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.675+0000 7f9d6d7de700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d6809d6f0 0x7f9d6809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:37.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.675+0000 7f9d6cfdd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d6809e000 0x7f9d68130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35374/0 (socket says 172.21.15.26:35374) 2023-10-01T07:55:37.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.675+0000 7f9d6cfdd700 1 -- 172.21.15.26:0/695202310 learned_addr learned my addr 172.21.15.26:0/695202310 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:37.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.675+0000 7f9d6dfdf700 1 --2- 172.21.15.26:0/695202310 >> v2:172.21.15.26:3300/0 conn(0x7f9d6809e410 0x7f9d68130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:37.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.675+0000 7f9d6cfdd700 1 -- 172.21.15.26:0/695202310 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d6809d6f0 msgr2=0x7f9d6809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:37.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.675+0000 7f9d6cfdd700 1 --2- 172.21.15.26:0/695202310 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d6809d6f0 0x7f9d6809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.675+0000 7f9d6cfdd700 1 -- 172.21.15.26:0/695202310 >> v2:172.21.15.26:3300/0 conn(0x7f9d6809e410 msgr2=0x7f9d68130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:37.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.675+0000 7f9d6cfdd700 1 --2- 172.21.15.26:0/695202310 >> v2:172.21.15.26:3300/0 conn(0x7f9d6809e410 0x7f9d68130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.675+0000 7f9d6cfdd700 1 -- 172.21.15.26:0/695202310 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d6809b2d0 con 0x7f9d6809e000 2023-10-01T07:55:37.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.675+0000 7f9d6dfdf700 1 --2- 172.21.15.26:0/695202310 >> v2:172.21.15.26:3300/0 conn(0x7f9d6809e410 0x7f9d68130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:55:37.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.676+0000 7f9d6cfdd700 1 --2- 172.21.15.26:0/695202310 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d6809e000 0x7f9d68130660 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9d5800b9d0 tx=0x7f9d5800bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b7225a5d8453efa server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:37.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.676+0000 7f9d5ffff700 1 -- 172.21.15.26:0/695202310 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5800cc20 con 0x7f9d6809e000 2023-10-01T07:55:37.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.676+0000 7f9d5ffff700 1 -- 172.21.15.26:0/695202310 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5800cd80 con 0x7f9d6809e000 2023-10-01T07:55:37.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.676+0000 7f9d5ffff700 1 -- 172.21.15.26:0/695202310 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5800f680 con 0x7f9d6809e000 2023-10-01T07:55:37.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.677+0000 7f9d6fa42700 1 -- 172.21.15.26:0/695202310 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d6809e000 msgr2=0x7f9d68130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:37.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.677+0000 7f9d6fa42700 1 --2- 172.21.15.26:0/695202310 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d6809e000 0x7f9d68130660 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9d5800b9d0 tx=0x7f9d5800bce0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.677+0000 7f9d6fa42700 1 -- 172.21.15.26:0/695202310 shutdown_connections 2023-10-01T07:55:37.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.677+0000 7f9d6fa42700 1 --2- 172.21.15.26:0/695202310 >> v2:172.21.15.26:3300/0 conn(0x7f9d6809e410 0x7f9d68130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.677+0000 7f9d6fa42700 1 --2- 172.21.15.26:0/695202310 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d6809d6f0 0x7f9d6809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.677+0000 7f9d6fa42700 1 --2- 172.21.15.26:0/695202310 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d6809e000 0x7f9d68130660 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.677+0000 7f9d6fa42700 1 -- 172.21.15.26:0/695202310 >> 172.21.15.26:0/695202310 conn(0x7f9d68066f50 msgr2=0x7f9d6809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:37.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.677+0000 7f9d6fa42700 1 -- 172.21.15.26:0/695202310 shutdown_connections 2023-10-01T07:55:37.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.677+0000 7f9d6fa42700 1 -- 172.21.15.26:0/695202310 wait complete. 2023-10-01T07:55:37.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.679+0000 7f9d6fa42700 1 Processor -- start 2023-10-01T07:55:37.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.679+0000 7f9d6fa42700 1 -- start start 2023-10-01T07:55:37.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.679+0000 7f9d6fa42700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d6809d6f0 0x7f9d6811e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:37.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.679+0000 7f9d6fa42700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d6809e000 0x7f9d6811e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:37.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.679+0000 7f9d6fa42700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d6809e410 0x7f9d6811eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:37.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.680+0000 7f9d6fa42700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d68121bc0 con 0x7f9d6809d6f0 2023-10-01T07:55:37.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.680+0000 7f9d6fa42700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d680a1b10 con 0x7f9d6809e000 2023-10-01T07:55:37.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.680+0000 7f9d6fa42700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6809c700 con 0x7f9d6809e410 2023-10-01T07:55:37.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.680+0000 7f9d6dfdf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d6809e410 0x7f9d6811eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:37.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.680+0000 7f9d6d7de700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d6809d6f0 0x7f9d6811e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:37.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.680+0000 7f9d6dfdf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d6809e410 0x7f9d6811eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35382/0 (socket says 172.21.15.26:35382) 2023-10-01T07:55:37.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.680+0000 7f9d6dfdf700 1 -- 172.21.15.26:0/3613519306 learned_addr learned my addr 172.21.15.26:0/3613519306 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:37.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.680+0000 7f9d6cfdd700 1 --2- 172.21.15.26:0/3613519306 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d6809e000 0x7f9d6811e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:37.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.680+0000 7f9d6d7de700 1 -- 172.21.15.26:0/3613519306 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d6809e410 msgr2=0x7f9d6811eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:37.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.680+0000 7f9d6d7de700 1 --2- 172.21.15.26:0/3613519306 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d6809e410 0x7f9d6811eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.680+0000 7f9d6d7de700 1 -- 172.21.15.26:0/3613519306 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d6809e000 msgr2=0x7f9d6811e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:37.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.680+0000 7f9d6d7de700 1 --2- 172.21.15.26:0/3613519306 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d6809e000 0x7f9d6811e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.680+0000 7f9d6d7de700 1 -- 172.21.15.26:0/3613519306 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5800b600 con 0x7f9d6809d6f0 2023-10-01T07:55:37.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.680+0000 7f9d6d7de700 1 --2- 172.21.15.26:0/3613519306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d6809d6f0 0x7f9d6811e0f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9d64012b20 tx=0x7f9d64012e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:37.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.681+0000 7f9d5dffb700 1 -- 172.21.15.26:0/3613519306 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d64014040 con 0x7f9d6809d6f0 2023-10-01T07:55:37.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.681+0000 7f9d5dffb700 1 -- 172.21.15.26:0/3613519306 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6400f860 con 0x7f9d6809d6f0 2023-10-01T07:55:37.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.681+0000 7f9d6fa42700 1 -- 172.21.15.26:0/3613519306 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d68121620 con 0x7f9d6809d6f0 2023-10-01T07:55:37.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.681+0000 7f9d5dffb700 1 -- 172.21.15.26:0/3613519306 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6400fbd0 con 0x7f9d6809d6f0 2023-10-01T07:55:37.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.681+0000 7f9d6fa42700 1 -- 172.21.15.26:0/3613519306 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d68120200 con 0x7f9d6809d6f0 2023-10-01T07:55:37.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.682+0000 7f9d5dffb700 1 -- 172.21.15.26:0/3613519306 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d6400fd30 con 0x7f9d6809d6f0 2023-10-01T07:55:37.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.682+0000 7f9d5dffb700 1 -- 172.21.15.26:0/3613519306 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9d64043260 con 0x7f9d6809d6f0 2023-10-01T07:55:37.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.683+0000 7f9d6fa42700 1 -- 172.21.15.26:0/3613519306 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d68074ea0 con 0x7f9d6809d6f0 2023-10-01T07:55:37.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.688+0000 7f9d5dffb700 1 -- 172.21.15.26:0/3613519306 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d64021410 con 0x7f9d6809d6f0 2023-10-01T07:55:37.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.731+0000 7f7999054700 1 Processor -- start 2023-10-01T07:55:37.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.731+0000 7f7999054700 1 -- start start 2023-10-01T07:55:37.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.732+0000 7f7999054700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7994133420 0x7f79941337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:37.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.732+0000 7f7999054700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7994133e30 0x7f799412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:37.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.732+0000 7f7999054700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7994134260 0x7f79941304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:37.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.732+0000 7f7999054700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f799406b990 con 0x7f7994134260 2023-10-01T07:55:37.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.732+0000 7f7999054700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79940a0590 con 0x7f7994133e30 2023-10-01T07:55:37.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.732+0000 7f7999054700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f799409fb80 con 0x7f7994133420 2023-10-01T07:55:37.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.732+0000 7f798a59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7994133e30 0x7f799412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:37.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.732+0000 7f798a59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7994133e30 0x7f799412ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:53980/0 (socket says 172.21.15.26:53980) 2023-10-01T07:55:37.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.732+0000 7f798a59c700 1 -- 172.21.15.26:0/267945209 learned_addr learned my addr 172.21.15.26:0/267945209 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:37.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.732+0000 7f799359e700 1 --2- 172.21.15.26:0/267945209 >> v2:172.21.15.26:3300/0 conn(0x7f7994134260 0x7f79941304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:37.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.732+0000 7f7992d9d700 1 --2- 172.21.15.26:0/267945209 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7994133420 0x7f79941337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:37.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.732+0000 7f798a59c700 1 -- 172.21.15.26:0/267945209 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7994133420 msgr2=0x7f79941337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:37.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.732+0000 7f798a59c700 1 --2- 172.21.15.26:0/267945209 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7994133420 0x7f79941337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.732+0000 7f798a59c700 1 -- 172.21.15.26:0/267945209 >> v2:172.21.15.26:3300/0 conn(0x7f7994134260 msgr2=0x7f79941304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:37.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.732+0000 7f798a59c700 1 --2- 172.21.15.26:0/267945209 >> v2:172.21.15.26:3300/0 conn(0x7f7994134260 0x7f79941304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.732+0000 7f798a59c700 1 -- 172.21.15.26:0/267945209 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79940a0030 con 0x7f7994133e30 2023-10-01T07:55:37.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.732+0000 7f7992d9d700 1 --2- 172.21.15.26:0/267945209 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7994133420 0x7f79941337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:55:37.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.733+0000 7f798a59c700 1 --2- 172.21.15.26:0/267945209 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7994133e30 0x7f799412ff90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f797c0098f0 tx=0x7f797c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4f2b5fb814c1a97 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:37.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.733+0000 7f799259c700 1 -- 172.21.15.26:0/267945209 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c011830 con 0x7f7994133e30 2023-10-01T07:55:37.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.733+0000 7f799259c700 1 -- 172.21.15.26:0/267945209 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797c011990 con 0x7f7994133e30 2023-10-01T07:55:37.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.733+0000 7f799259c700 1 -- 172.21.15.26:0/267945209 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c011d20 con 0x7f7994133e30 2023-10-01T07:55:37.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.733+0000 7f7999054700 1 -- 172.21.15.26:0/267945209 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7994133e30 msgr2=0x7f799412ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:37.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.733+0000 7f7999054700 1 --2- 172.21.15.26:0/267945209 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7994133e30 0x7f799412ff90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f797c0098f0 tx=0x7f797c009c00 comp rx=0 tx=0).stop 2023-10-01T07:55:37.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.734+0000 7f7999054700 1 -- 172.21.15.26:0/267945209 shutdown_connections 2023-10-01T07:55:37.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.734+0000 7f7999054700 1 --2- 172.21.15.26:0/267945209 >> v2:172.21.15.26:3300/0 conn(0x7f7994134260 0x7f79941304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.734+0000 7f7999054700 1 --2- 172.21.15.26:0/267945209 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7994133420 0x7f79941337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.734+0000 7f7999054700 1 --2- 172.21.15.26:0/267945209 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7994133e30 0x7f799412ff90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.734+0000 7f7999054700 1 -- 172.21.15.26:0/267945209 >> 172.21.15.26:0/267945209 conn(0x7f79940a4210 msgr2=0x7f79940a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:37.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.734+0000 7f7999054700 1 -- 172.21.15.26:0/267945209 shutdown_connections 2023-10-01T07:55:37.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.734+0000 7f7999054700 1 -- 172.21.15.26:0/267945209 wait complete. 2023-10-01T07:55:37.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.735+0000 7f7999054700 1 Processor -- start 2023-10-01T07:55:37.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.736+0000 7f7999054700 1 -- start start 2023-10-01T07:55:37.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.736+0000 7f7999054700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7994133420 0x7f799409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:37.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.736+0000 7f7999054700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7994133e30 0x7f799409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:37.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.736+0000 7f7999054700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7994134260 0x7f799409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:37.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.736+0000 7f7999054700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799411faf0 con 0x7f7994133420 2023-10-01T07:55:37.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.736+0000 7f7999054700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f799411f0a0 con 0x7f7994133e30 2023-10-01T07:55:37.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.736+0000 7f7999054700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7994120090 con 0x7f7994134260 2023-10-01T07:55:37.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.736+0000 7f7992d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7994133420 0x7f799409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:37.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.736+0000 7f7992d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7994133420 0x7f799409c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50324/0 (socket says 172.21.15.26:50324) 2023-10-01T07:55:37.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.736+0000 7f7992d9d700 1 -- 172.21.15.26:0/3624572856 learned_addr learned my addr 172.21.15.26:0/3624572856 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:37.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.736+0000 7f799359e700 1 --2- 172.21.15.26:0/3624572856 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7994134260 0x7f799409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:37.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.736+0000 7f798a59c700 1 --2- 172.21.15.26:0/3624572856 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7994133e30 0x7f799409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:37.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.737+0000 7f799359e700 1 -- 172.21.15.26:0/3624572856 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7994133e30 msgr2=0x7f799409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:37.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.737+0000 7f799359e700 1 --2- 172.21.15.26:0/3624572856 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7994133e30 0x7f799409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.737+0000 7f799359e700 1 -- 172.21.15.26:0/3624572856 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7994133420 msgr2=0x7f799409c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:37.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.737+0000 7f799359e700 1 --2- 172.21.15.26:0/3624572856 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7994133420 0x7f799409c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.737+0000 7f799359e700 1 -- 172.21.15.26:0/3624572856 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797c009550 con 0x7f7994134260 2023-10-01T07:55:37.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.737+0000 7f7992d9d700 1 --2- 172.21.15.26:0/3624572856 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7994133420 0x7f799409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:37.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.737+0000 7f799359e700 1 --2- 172.21.15.26:0/3624572856 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7994134260 0x7f799409cf00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f798c00efc0 tx=0x7f798c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:37.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.737+0000 7f798bfff700 1 -- 172.21.15.26:0/3624572856 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c00cc90 con 0x7f7994134260 2023-10-01T07:55:37.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.737+0000 7f798bfff700 1 -- 172.21.15.26:0/3624572856 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798c00f040 con 0x7f7994134260 2023-10-01T07:55:37.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.737+0000 7f7999054700 1 -- 172.21.15.26:0/3624572856 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f799409de60 con 0x7f7994134260 2023-10-01T07:55:37.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.737+0000 7f798bfff700 1 -- 172.21.15.26:0/3624572856 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c0146c0 con 0x7f7994134260 2023-10-01T07:55:37.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.737+0000 7f7999054700 1 -- 172.21.15.26:0/3624572856 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7994131490 con 0x7f7994134260 2023-10-01T07:55:37.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.738+0000 7f798bfff700 1 -- 172.21.15.26:0/3624572856 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f798c014820 con 0x7f7994134260 2023-10-01T07:55:37.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.738+0000 7f7999054700 1 -- 172.21.15.26:0/3624572856 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7994074ea0 con 0x7f7994134260 2023-10-01T07:55:37.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.738+0000 7f798bfff700 1 -- 172.21.15.26:0/3624572856 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f798c0402f0 con 0x7f7994134260 2023-10-01T07:55:37.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.743+0000 7f798bfff700 1 -- 172.21.15.26:0/3624572856 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f798c007900 con 0x7f7994134260 2023-10-01T07:55:37.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.780+0000 7fd6af89d700 1 Processor -- start 2023-10-01T07:55:37.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.781+0000 7fd6af89d700 1 -- start start 2023-10-01T07:55:37.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.781+0000 7fd6af89d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6a8133420 0x7fd6a81337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:37.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.781+0000 7fd6af89d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6a8133e30 0x7fd6a812ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:37.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.781+0000 7fd6af89d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd6a8134260 0x7fd6a81304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:37.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.781+0000 7fd6af89d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6a806b990 con 0x7fd6a8134260 2023-10-01T07:55:37.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.781+0000 7fd6af89d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a80a0590 con 0x7fd6a8133420 2023-10-01T07:55:37.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.781+0000 7fd6af89d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a809fb80 con 0x7fd6a8133e30 2023-10-01T07:55:37.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.781+0000 7fd6ad639700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6a8133420 0x7fd6a81337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:37.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.781+0000 7fd6ad639700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6a8133420 0x7fd6a81337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:54006/0 (socket says 172.21.15.26:54006) 2023-10-01T07:55:37.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.781+0000 7fd6ad639700 1 -- 172.21.15.26:0/2281429572 learned_addr learned my addr 172.21.15.26:0/2281429572 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:37.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.782+0000 7fd6ace38700 1 --2- 172.21.15.26:0/2281429572 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6a8133e30 0x7fd6a812ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:37.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.782+0000 7fd6ade3a700 1 --2- 172.21.15.26:0/2281429572 >> v2:172.21.15.26:3300/0 conn(0x7fd6a8134260 0x7fd6a81304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:37.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.782+0000 7fd6ad639700 1 -- 172.21.15.26:0/2281429572 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6a8133e30 msgr2=0x7fd6a812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:37.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.782+0000 7fd6ad639700 1 --2- 172.21.15.26:0/2281429572 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6a8133e30 0x7fd6a812ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.782+0000 7fd6ad639700 1 -- 172.21.15.26:0/2281429572 >> v2:172.21.15.26:3300/0 conn(0x7fd6a8134260 msgr2=0x7fd6a81304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:37.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.782+0000 7fd6ad639700 1 --2- 172.21.15.26:0/2281429572 >> v2:172.21.15.26:3300/0 conn(0x7fd6a8134260 0x7fd6a81304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.782+0000 7fd6ad639700 1 -- 172.21.15.26:0/2281429572 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a80a0030 con 0x7fd6a8133420 2023-10-01T07:55:37.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.782+0000 7fd6ad639700 1 --2- 172.21.15.26:0/2281429572 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6a8133420 0x7fd6a81337f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd6a40098f0 tx=0x7fd6a4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5581319453b8b0bb server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:37.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.782+0000 7fd69ffff700 1 -- 172.21.15.26:0/2281429572 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4011830 con 0x7fd6a8133420 2023-10-01T07:55:37.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.782+0000 7fd69ffff700 1 -- 172.21.15.26:0/2281429572 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a4011990 con 0x7fd6a8133420 2023-10-01T07:55:37.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.782+0000 7fd69ffff700 1 -- 172.21.15.26:0/2281429572 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4011d20 con 0x7fd6a8133420 2023-10-01T07:55:37.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.783+0000 7fd6af89d700 1 -- 172.21.15.26:0/2281429572 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6a8133420 msgr2=0x7fd6a81337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:37.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.783+0000 7fd6af89d700 1 --2- 172.21.15.26:0/2281429572 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6a8133420 0x7fd6a81337f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd6a40098f0 tx=0x7fd6a4009c00 comp rx=0 tx=0).stop 2023-10-01T07:55:37.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.783+0000 7fd6af89d700 1 -- 172.21.15.26:0/2281429572 shutdown_connections 2023-10-01T07:55:37.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.783+0000 7fd6af89d700 1 --2- 172.21.15.26:0/2281429572 >> v2:172.21.15.26:3300/0 conn(0x7fd6a8134260 0x7fd6a81304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.783+0000 7fd6af89d700 1 --2- 172.21.15.26:0/2281429572 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6a8133420 0x7fd6a81337f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.783+0000 7fd6af89d700 1 --2- 172.21.15.26:0/2281429572 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6a8133e30 0x7fd6a812ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.783+0000 7fd6af89d700 1 -- 172.21.15.26:0/2281429572 >> 172.21.15.26:0/2281429572 conn(0x7fd6a80a4210 msgr2=0x7fd6a80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:37.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.783+0000 7fd6af89d700 1 -- 172.21.15.26:0/2281429572 shutdown_connections 2023-10-01T07:55:37.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.783+0000 7fd6af89d700 1 -- 172.21.15.26:0/2281429572 wait complete. 2023-10-01T07:55:37.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.784+0000 7fd6af89d700 1 Processor -- start 2023-10-01T07:55:37.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.784+0000 7fd6af89d700 1 -- start start 2023-10-01T07:55:37.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.785+0000 7fd6af89d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6a8133420 0x7fd6a809c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:37.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.785+0000 7fd6af89d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6a8133e30 0x7fd6a809c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:37.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.785+0000 7fd6af89d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6a8134260 0x7fd6a809cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:37.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.785+0000 7fd6af89d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a811f160 con 0x7fd6a8133e30 2023-10-01T07:55:37.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.785+0000 7fd6af89d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a811fe90 con 0x7fd6a8133420 2023-10-01T07:55:37.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.785+0000 7fd6af89d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a8131400 con 0x7fd6a8134260 2023-10-01T07:55:37.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.785+0000 7fd6ad639700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6a8133420 0x7fd6a809c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:37.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.785+0000 7fd6ad639700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6a8133420 0x7fd6a809c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:54022/0 (socket says 172.21.15.26:54022) 2023-10-01T07:55:37.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.785+0000 7fd6ad639700 1 -- 172.21.15.26:0/2356208842 learned_addr learned my addr 172.21.15.26:0/2356208842 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:37.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.785+0000 7fd6ace38700 1 --2- 172.21.15.26:0/2356208842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6a8133e30 0x7fd6a809c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:37.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.785+0000 7fd6ade3a700 1 --2- 172.21.15.26:0/2356208842 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6a8134260 0x7fd6a809cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:37.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.785+0000 7fd6ad639700 1 -- 172.21.15.26:0/2356208842 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6a8134260 msgr2=0x7fd6a809cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:37.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.785+0000 7fd6ad639700 1 --2- 172.21.15.26:0/2356208842 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6a8134260 0x7fd6a809cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.785+0000 7fd6ad639700 1 -- 172.21.15.26:0/2356208842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6a8133e30 msgr2=0x7fd6a809c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:37.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.785+0000 7fd6ad639700 1 --2- 172.21.15.26:0/2356208842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6a8133e30 0x7fd6a809c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.785+0000 7fd6ad639700 1 -- 172.21.15.26:0/2356208842 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a4009550 con 0x7fd6a8133420 2023-10-01T07:55:37.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.786+0000 7fd6ad639700 1 --2- 172.21.15.26:0/2356208842 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6a8133420 0x7fd6a809c2a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4009c40 tx=0x7fd6a4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:37.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.786+0000 7fd69dffb700 1 -- 172.21.15.26:0/2356208842 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4004450 con 0x7fd6a8133420 2023-10-01T07:55:37.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.786+0000 7fd69dffb700 1 -- 172.21.15.26:0/2356208842 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a40045b0 con 0x7fd6a8133420 2023-10-01T07:55:37.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.786+0000 7fd69dffb700 1 -- 172.21.15.26:0/2356208842 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a40038c0 con 0x7fd6a8133420 2023-10-01T07:55:37.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.786+0000 7fd6af89d700 1 -- 172.21.15.26:0/2356208842 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6a812db30 con 0x7fd6a8133420 2023-10-01T07:55:37.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.786+0000 7fd6af89d700 1 -- 172.21.15.26:0/2356208842 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6a8120900 con 0x7fd6a8133420 2023-10-01T07:55:37.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.787+0000 7fd6af89d700 1 -- 172.21.15.26:0/2356208842 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6a8074ea0 con 0x7fd6a8133420 2023-10-01T07:55:37.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.788+0000 7fd69dffb700 1 -- 172.21.15.26:0/2356208842 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd6a4021070 con 0x7fd6a8133420 2023-10-01T07:55:37.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.788+0000 7fd69dffb700 1 -- 172.21.15.26:0/2356208842 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd6a4040dd0 con 0x7fd6a8133420 2023-10-01T07:55:37.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.797+0000 7fd69dffb700 1 -- 172.21.15.26:0/2356208842 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd6a402d760 con 0x7fd6a8133420 2023-10-01T07:55:37.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.917+0000 7f0198b44700 1 -- 172.21.15.26:0/3527978505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0194074ea0 con 0x7f019409e440 2023-10-01T07:55:37.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.918+0000 7f0182ffd700 1 -- 172.21.15.26:0/3527978505 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f018c018070 con 0x7f019409e440 2023-10-01T07:55:37.919 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:37.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.921+0000 7f0198b44700 1 -- 172.21.15.26:0/3527978505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f019409e440 msgr2=0x7f019411b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:37.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.921+0000 7f0198b44700 1 --2- 172.21.15.26:0/3527978505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f019409e440 0x7f019411b8b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f018c00efc0 tx=0x7f018c00c3a0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.921+0000 7f0198b44700 1 -- 172.21.15.26:0/3527978505 shutdown_connections 2023-10-01T07:55:37.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.921+0000 7f0198b44700 1 --2- 172.21.15.26:0/3527978505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f019409e440 0x7f019411b8b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.921+0000 7f0198b44700 1 --2- 172.21.15.26:0/3527978505 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f019409d6f0 0x7f019411ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.921+0000 7f0198b44700 1 --2- 172.21.15.26:0/3527978505 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f019409e000 0x7f019411b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.921+0000 7f0198b44700 1 -- 172.21.15.26:0/3527978505 >> 172.21.15.26:0/3527978505 conn(0x7f0194066f50 msgr2=0x7f019409b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:37.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.921+0000 7f0198b44700 1 -- 172.21.15.26:0/3527978505 shutdown_connections 2023-10-01T07:55:37.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.921+0000 7f0198b44700 1 -- 172.21.15.26:0/3527978505 wait complete. 2023-10-01T07:55:37.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:37.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.958+0000 7f9d6fa42700 1 -- 172.21.15.26:0/3613519306 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9d6806c360 con 0x7f9d6809d6f0 2023-10-01T07:55:37.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.958+0000 7f7999054700 1 -- 172.21.15.26:0/3624572856 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f799411fe70 con 0x7f7994134260 2023-10-01T07:55:37.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.958+0000 7f9d5dffb700 1 -- 172.21.15.26:0/3613519306 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9d64017360 con 0x7f9d6809d6f0 2023-10-01T07:55:37.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.958+0000 7f798bfff700 1 -- 172.21.15.26:0/3624572856 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f798c018030 con 0x7f7994134260 2023-10-01T07:55:37.960 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:37.961 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:37.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.962+0000 7f7999054700 1 -- 172.21.15.26:0/3624572856 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7994134260 msgr2=0x7f799409cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:37.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.962+0000 7f7999054700 1 --2- 172.21.15.26:0/3624572856 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7994134260 0x7f799409cf00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f798c00efc0 tx=0x7f798c00c3a0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.962+0000 7f9d6fa42700 1 -- 172.21.15.26:0/3613519306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d6809d6f0 msgr2=0x7f9d6811e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:37.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.962+0000 7f9d6fa42700 1 --2- 172.21.15.26:0/3613519306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d6809d6f0 0x7f9d6811e0f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9d64012b20 tx=0x7f9d64012e30 comp rx=0 tx=0).stop 2023-10-01T07:55:37.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.962+0000 7f7999054700 1 -- 172.21.15.26:0/3624572856 shutdown_connections 2023-10-01T07:55:37.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.962+0000 7f7999054700 1 --2- 172.21.15.26:0/3624572856 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7994134260 0x7f799409cf00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.962+0000 7f7999054700 1 --2- 172.21.15.26:0/3624572856 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7994133420 0x7f799409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.962+0000 7f7999054700 1 --2- 172.21.15.26:0/3624572856 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7994133e30 0x7f799409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.962+0000 7f7999054700 1 -- 172.21.15.26:0/3624572856 >> 172.21.15.26:0/3624572856 conn(0x7f79940a4210 msgr2=0x7f79940a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:37.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.962+0000 7f9d6fa42700 1 -- 172.21.15.26:0/3613519306 shutdown_connections 2023-10-01T07:55:37.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.962+0000 7f9d6fa42700 1 --2- 172.21.15.26:0/3613519306 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d6809e410 0x7f9d6811eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.962+0000 7f9d6fa42700 1 --2- 172.21.15.26:0/3613519306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d6809d6f0 0x7f9d6811e0f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.962+0000 7f9d6fa42700 1 --2- 172.21.15.26:0/3613519306 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d6809e000 0x7f9d6811e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:37.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.962+0000 7f9d6fa42700 1 -- 172.21.15.26:0/3613519306 >> 172.21.15.26:0/3613519306 conn(0x7f9d68066f50 msgr2=0x7f9d6806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:37.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.962+0000 7f7999054700 1 -- 172.21.15.26:0/3624572856 shutdown_connections 2023-10-01T07:55:37.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.962+0000 7f7999054700 1 -- 172.21.15.26:0/3624572856 wait complete. 2023-10-01T07:55:37.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.962+0000 7f9d6fa42700 1 -- 172.21.15.26:0/3613519306 shutdown_connections 2023-10-01T07:55:37.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:37.962+0000 7f9d6fa42700 1 -- 172.21.15.26:0/3613519306 wait complete. 2023-10-01T07:55:37.979 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:37.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:38.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:38.005+0000 7fd6af89d700 1 -- 172.21.15.26:0/2356208842 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd6a81200b0 con 0x7fd6a8133420 2023-10-01T07:55:38.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:38.006+0000 7fd69dffb700 1 -- 172.21.15.26:0/2356208842 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd6a4015020 con 0x7fd6a8133420 2023-10-01T07:55:38.007 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:38.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:38.008+0000 7fd6af89d700 1 -- 172.21.15.26:0/2356208842 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6a8133420 msgr2=0x7fd6a809c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:38.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:38.008+0000 7fd6af89d700 1 --2- 172.21.15.26:0/2356208842 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6a8133420 0x7fd6a809c2a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4009c40 tx=0x7fd6a4004750 comp rx=0 tx=0).stop 2023-10-01T07:55:38.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:38.008+0000 7fd6af89d700 1 -- 172.21.15.26:0/2356208842 shutdown_connections 2023-10-01T07:55:38.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:38.008+0000 7fd6af89d700 1 --2- 172.21.15.26:0/2356208842 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6a8134260 0x7fd6a809cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:38.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:38.008+0000 7fd6af89d700 1 --2- 172.21.15.26:0/2356208842 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6a8133420 0x7fd6a809c2a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:38.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:38.008+0000 7fd6af89d700 1 --2- 172.21.15.26:0/2356208842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6a8133e30 0x7fd6a809c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:38.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:38.008+0000 7fd6af89d700 1 -- 172.21.15.26:0/2356208842 >> 172.21.15.26:0/2356208842 conn(0x7fd6a80a4210 msgr2=0x7fd6a81302c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:38.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:38.008+0000 7fd6af89d700 1 -- 172.21.15.26:0/2356208842 shutdown_connections 2023-10-01T07:55:38.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:38.008+0000 7fd6af89d700 1 -- 172.21.15.26:0/2356208842 wait complete. 2023-10-01T07:55:38.023 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:38.943 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:38.980 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:38.980 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:39.024 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:39.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.103+0000 7f5e2336e700 1 Processor -- start 2023-10-01T07:55:39.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.103+0000 7f5e2336e700 1 -- start start 2023-10-01T07:55:39.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.104+0000 7f5e2336e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5e1c09d6f0 0x7f5e1c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:39.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.104+0000 7f5e2336e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5e1c09e410 0x7f5e1c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:39.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.104+0000 7f5e2336e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e1c09b120 con 0x7f5e1c09e000 2023-10-01T07:55:39.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.104+0000 7f5e2336e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1c06b460 con 0x7f5e1c09e410 2023-10-01T07:55:39.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.104+0000 7f5e2336e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1c09a7e0 con 0x7f5e1c09d6f0 2023-10-01T07:55:39.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.104+0000 7f5e20909700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5e1c09e000 0x7f5e1c1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52282/0 (socket says 172.21.15.26:52282) 2023-10-01T07:55:39.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.104+0000 7f5e20909700 1 -- 172.21.15.26:0/2676851033 learned_addr learned my addr 172.21.15.26:0/2676851033 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:39.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.104+0000 7f5e2190b700 1 --2- 172.21.15.26:0/2676851033 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5e1c09e410 0x7f5e1c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:39.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.105+0000 7f5e2110a700 1 --2- 172.21.15.26:0/2676851033 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5e1c09d6f0 0x7f5e1c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:39.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.105+0000 7f5e2190b700 1 -- 172.21.15.26:0/2676851033 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5e1c09d6f0 msgr2=0x7f5e1c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:39.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.105+0000 7f5e2190b700 1 --2- 172.21.15.26:0/2676851033 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5e1c09d6f0 0x7f5e1c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:39.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.105+0000 7f5e2190b700 1 -- 172.21.15.26:0/2676851033 >> v1:172.21.15.26:6789/0 conn(0x7f5e1c09e000 legacy=0x7f5e1c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:39.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.105+0000 7f5e2190b700 1 -- 172.21.15.26:0/2676851033 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e1c09a500 con 0x7f5e1c09e410 2023-10-01T07:55:39.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.105+0000 7f5e2190b700 1 --2- 172.21.15.26:0/2676851033 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5e1c09e410 0x7f5e1c134100 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5e14009dc0 tx=0x7f5e1400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dee45b7fc8d8681f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:39.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.105+0000 7f5e13fff700 1 -- 172.21.15.26:0/2676851033 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1400e070 con 0x7f5e1c09e410 2023-10-01T07:55:39.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.105+0000 7f5e13fff700 1 -- 172.21.15.26:0/2676851033 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e1400bad0 con 0x7f5e1c09e410 2023-10-01T07:55:39.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.105+0000 7f5e13fff700 1 -- 172.21.15.26:0/2676851033 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1400be80 con 0x7f5e1c09e410 2023-10-01T07:55:39.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.106+0000 7f5e2336e700 1 -- 172.21.15.26:0/2676851033 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5e1c09e410 msgr2=0x7f5e1c134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:39.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.106+0000 7f5e2336e700 1 --2- 172.21.15.26:0/2676851033 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5e1c09e410 0x7f5e1c134100 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5e14009dc0 tx=0x7f5e1400b330 comp rx=0 tx=0).stop 2023-10-01T07:55:39.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.106+0000 7f5e2336e700 1 -- 172.21.15.26:0/2676851033 shutdown_connections 2023-10-01T07:55:39.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.106+0000 7f5e2336e700 1 --2- 172.21.15.26:0/2676851033 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5e1c09d6f0 0x7f5e1c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:39.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.106+0000 7f5e2336e700 1 --2- 172.21.15.26:0/2676851033 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5e1c09e410 0x7f5e1c134100 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:39.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.106+0000 7f5e2336e700 1 -- 172.21.15.26:0/2676851033 >> 172.21.15.26:0/2676851033 conn(0x7f5e1c066f50 msgr2=0x7f5e1c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:39.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.106+0000 7f5e2336e700 1 -- 172.21.15.26:0/2676851033 shutdown_connections 2023-10-01T07:55:39.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.106+0000 7f5e2336e700 1 -- 172.21.15.26:0/2676851033 wait complete. 2023-10-01T07:55:39.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.108+0000 7f5e2336e700 1 Processor -- start 2023-10-01T07:55:39.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.108+0000 7f5e2336e700 1 -- start start 2023-10-01T07:55:39.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.109+0000 7f5e2336e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5e1c09d6f0 0x7f5e1c1223f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:39.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.109+0000 7f5e2336e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5e1c09e000 0x7f5e1c122930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:39.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.109+0000 7f5e2336e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e1c09e410 0x7f5e1c122e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:39.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.109+0000 7f5e2336e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1c0a1d70 con 0x7f5e1c09e410 2023-10-01T07:55:39.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.109+0000 7f5e2336e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1c124520 con 0x7f5e1c09e000 2023-10-01T07:55:39.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.109+0000 7f5e2336e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1c125240 con 0x7f5e1c09d6f0 2023-10-01T07:55:39.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.109+0000 7f5e2110a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5e1c09d6f0 0x7f5e1c1223f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:39.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.109+0000 7f5e2190b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e1c09e410 0x7f5e1c122e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:39.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.109+0000 7f5e2110a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5e1c09d6f0 0x7f5e1c1223f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35444/0 (socket says 172.21.15.26:35444) 2023-10-01T07:55:39.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.109+0000 7f5e2110a700 1 -- 172.21.15.26:0/2032408551 learned_addr learned my addr 172.21.15.26:0/2032408551 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:39.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.109+0000 7f5e20909700 1 --2- 172.21.15.26:0/2032408551 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5e1c09e000 0x7f5e1c122930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:39.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.109+0000 7f5e2110a700 1 -- 172.21.15.26:0/2032408551 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5e1c09e000 msgr2=0x7f5e1c122930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:39.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.109+0000 7f5e2110a700 1 --2- 172.21.15.26:0/2032408551 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5e1c09e000 0x7f5e1c122930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:39.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.109+0000 7f5e2110a700 1 -- 172.21.15.26:0/2032408551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e1c09e410 msgr2=0x7f5e1c122e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:39.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.109+0000 7f5e2110a700 1 --2- 172.21.15.26:0/2032408551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e1c09e410 0x7f5e1c122e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:39.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.109+0000 7f5e2110a700 1 -- 172.21.15.26:0/2032408551 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e14009a70 con 0x7f5e1c09d6f0 2023-10-01T07:55:39.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.110+0000 7f5e2110a700 1 --2- 172.21.15.26:0/2032408551 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5e1c09d6f0 0x7f5e1c1223f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5e1800e810 tx=0x7f5e1800eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:39.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.110+0000 7f5e11ffb700 1 -- 172.21.15.26:0/2032408551 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1800c070 con 0x7f5e1c09d6f0 2023-10-01T07:55:39.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.110+0000 7f5e2336e700 1 -- 172.21.15.26:0/2032408551 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e1c124e90 con 0x7f5e1c09d6f0 2023-10-01T07:55:39.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.110+0000 7f5e11ffb700 1 -- 172.21.15.26:0/2032408551 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e18013610 con 0x7f5e1c09d6f0 2023-10-01T07:55:39.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.110+0000 7f5e11ffb700 1 -- 172.21.15.26:0/2032408551 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e180139c0 con 0x7f5e1c09d6f0 2023-10-01T07:55:39.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.110+0000 7f5e2336e700 1 -- 172.21.15.26:0/2032408551 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e1c133760 con 0x7f5e1c09d6f0 2023-10-01T07:55:39.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.112+0000 7f5e2336e700 1 -- 172.21.15.26:0/2032408551 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e1c074ea0 con 0x7f5e1c09d6f0 2023-10-01T07:55:39.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.112+0000 7f5e11ffb700 1 -- 172.21.15.26:0/2032408551 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5e18013b20 con 0x7f5e1c09d6f0 2023-10-01T07:55:39.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.113+0000 7f5e11ffb700 1 -- 172.21.15.26:0/2032408551 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5e1803f8e0 con 0x7f5e1c09d6f0 2023-10-01T07:55:39.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.117+0000 7f5e11ffb700 1 -- 172.21.15.26:0/2032408551 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5e1800f040 con 0x7f5e1c09d6f0 2023-10-01T07:55:39.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.147+0000 7f192350c700 1 Processor -- start 2023-10-01T07:55:39.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.147+0000 7f192350c700 1 -- start start 2023-10-01T07:55:39.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.148+0000 7f192350c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f191c09d6f0 0x7f191c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:39.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.148+0000 7f192350c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f191c09e000 0x7f191c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:39.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.148+0000 7f192350c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f191c09b120 con 0x7f191c09e410 2023-10-01T07:55:39.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.148+0000 7f192350c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f191c06b460 con 0x7f191c09d6f0 2023-10-01T07:55:39.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.148+0000 7f192350c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f191c09a7e0 con 0x7f191c09e000 2023-10-01T07:55:39.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.148+0000 7f19212a8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f191c09d6f0 0x7f191c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:39.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.148+0000 7f19212a8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f191c09d6f0 0x7f191c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50358/0 (socket says 172.21.15.26:50358) 2023-10-01T07:55:39.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.148+0000 7f19212a8700 1 -- 172.21.15.26:0/1493725864 learned_addr learned my addr 172.21.15.26:0/1493725864 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:39.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.149+0000 7f19212a8700 1 -- 172.21.15.26:0/1493725864 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f191c09e000 msgr2=0x7f191c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:39.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.149+0000 7f1920aa7700 1 --2- 172.21.15.26:0/1493725864 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f191c09e000 0x7f191c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:39.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.149+0000 7f19212a8700 1 --2- 172.21.15.26:0/1493725864 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f191c09e000 0x7f191c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:39.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.149+0000 7f19212a8700 1 -- 172.21.15.26:0/1493725864 >> v1:172.21.15.26:6789/0 conn(0x7f191c09e410 legacy=0x7f191c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:39.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.149+0000 7f19212a8700 1 -- 172.21.15.26:0/1493725864 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f191c09a500 con 0x7f191c09d6f0 2023-10-01T07:55:39.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.149+0000 7f1920aa7700 1 --2- 172.21.15.26:0/1493725864 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f191c09e000 0x7f191c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:55:39.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.149+0000 7f19212a8700 1 --2- 172.21.15.26:0/1493725864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f191c09d6f0 0x7f191c09dac0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f19180098f0 tx=0x7f1918009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a63e70bc01c4a31 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:39.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.149+0000 7f1913fff700 1 -- 172.21.15.26:0/1493725864 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191800b8a0 con 0x7f191c09d6f0 2023-10-01T07:55:39.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.149+0000 7f1913fff700 1 -- 172.21.15.26:0/1493725864 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191800ba00 con 0x7f191c09d6f0 2023-10-01T07:55:39.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.149+0000 7f1913fff700 1 -- 172.21.15.26:0/1493725864 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191800bd90 con 0x7f191c09d6f0 2023-10-01T07:55:39.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.150+0000 7f192350c700 1 -- 172.21.15.26:0/1493725864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f191c09d6f0 msgr2=0x7f191c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:39.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.150+0000 7f192350c700 1 --2- 172.21.15.26:0/1493725864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f191c09d6f0 0x7f191c09dac0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f19180098f0 tx=0x7f1918009c00 comp rx=0 tx=0).stop 2023-10-01T07:55:39.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.150+0000 7f192350c700 1 -- 172.21.15.26:0/1493725864 shutdown_connections 2023-10-01T07:55:39.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.150+0000 7f192350c700 1 --2- 172.21.15.26:0/1493725864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f191c09d6f0 0x7f191c09dac0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:39.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.150+0000 7f192350c700 1 --2- 172.21.15.26:0/1493725864 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f191c09e000 0x7f191c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:39.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.150+0000 7f192350c700 1 -- 172.21.15.26:0/1493725864 >> 172.21.15.26:0/1493725864 conn(0x7f191c066f50 msgr2=0x7f191c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:39.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.150+0000 7f192350c700 1 -- 172.21.15.26:0/1493725864 shutdown_connections 2023-10-01T07:55:39.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.150+0000 7f192350c700 1 -- 172.21.15.26:0/1493725864 wait complete. 2023-10-01T07:55:39.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.152+0000 7f192350c700 1 Processor -- start 2023-10-01T07:55:39.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.152+0000 7f192350c700 1 -- start start 2023-10-01T07:55:39.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.153+0000 7face1e89700 1 Processor -- start 2023-10-01T07:55:39.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.153+0000 7f192350c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f191c09d6f0 0x7f191c1a5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:39.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.153+0000 7f192350c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f191c09e000 0x7f191c1a6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:39.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.153+0000 7f192350c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f191c09e410 0x7f191c1a6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:39.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.153+0000 7f192350c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191c1a8d90 con 0x7f191c09e410 2023-10-01T07:55:39.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.153+0000 7f192350c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f191c1a7370 con 0x7f191c09d6f0 2023-10-01T07:55:39.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.153+0000 7f192350c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f191c1a97e0 con 0x7f191c09e000 2023-10-01T07:55:39.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.153+0000 7f19212a8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f191c09d6f0 0x7f191c1a5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:39.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.153+0000 7f19212a8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f191c09d6f0 0x7f191c1a5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:54056/0 (socket says 172.21.15.26:54056) 2023-10-01T07:55:39.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.153+0000 7f19212a8700 1 -- 172.21.15.26:0/2539874364 learned_addr learned my addr 172.21.15.26:0/2539874364 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:39.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.153+0000 7face1e89700 1 -- start start 2023-10-01T07:55:39.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.153+0000 7face1e89700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7facdc09d6f0 0x7facdc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:39.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.153+0000 7face1e89700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7facdc09e000 0x7facdc130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:39.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.153+0000 7face1e89700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facdc09f130 con 0x7facdc09e410 2023-10-01T07:55:39.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.153+0000 7face1e89700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facdc09f520 con 0x7facdc09d6f0 2023-10-01T07:55:39.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.153+0000 7face1e89700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facdc09e930 con 0x7facdc09e000 2023-10-01T07:55:39.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.153+0000 7f1920aa7700 1 --2- 172.21.15.26:0/2539874364 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f191c09e000 0x7f191c1a6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:39.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.153+0000 7f1921aa9700 1 --2- 172.21.15.26:0/2539874364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f191c09e410 0x7f191c1a6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:39.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.154+0000 7facdbfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7facdc09e410 0x7facdc130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52294/0 (socket says 172.21.15.26:52294) 2023-10-01T07:55:39.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.154+0000 7facdbfff700 1 -- 172.21.15.26:0/1178426782 learned_addr learned my addr 172.21.15.26:0/1178426782 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:39.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.154+0000 7f19212a8700 1 -- 172.21.15.26:0/2539874364 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f191c09e000 msgr2=0x7f191c1a6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:39.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.154+0000 7f19212a8700 1 --2- 172.21.15.26:0/2539874364 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f191c09e000 0x7f191c1a6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:39.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.154+0000 7f19212a8700 1 -- 172.21.15.26:0/2539874364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f191c09e410 msgr2=0x7f191c1a6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:39.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.154+0000 7f19212a8700 1 --2- 172.21.15.26:0/2539874364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f191c09e410 0x7f191c1a6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:39.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.154+0000 7f19212a8700 1 -- 172.21.15.26:0/2539874364 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1918009550 con 0x7f191c09d6f0 2023-10-01T07:55:39.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.154+0000 7f1920aa7700 1 --2- 172.21.15.26:0/2539874364 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f191c09e000 0x7f191c1a6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:39.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.154+0000 7facdaffd700 1 --2- 172.21.15.26:0/1178426782 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7facdc09e000 0x7facdc130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:39.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.154+0000 7f19212a8700 1 --2- 172.21.15.26:0/2539874364 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f191c09d6f0 0x7f191c1a5ec0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f191800bda0 tx=0x7f1918004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:39.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.154+0000 7f1911ffb700 1 -- 172.21.15.26:0/2539874364 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1918011930 con 0x7f191c09d6f0 2023-10-01T07:55:39.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.154+0000 7f1911ffb700 1 -- 172.21.15.26:0/2539874364 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191801f070 con 0x7f191c09d6f0 2023-10-01T07:55:39.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.154+0000 7f1911ffb700 1 -- 172.21.15.26:0/2539874364 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1918011c90 con 0x7f191c09d6f0 2023-10-01T07:55:39.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.154+0000 7facdb7fe700 1 --2- 172.21.15.26:0/1178426782 >> v2:172.21.15.26:3300/0 conn(0x7facdc09d6f0 0x7facdc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:39.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.154+0000 7facdaffd700 1 -- 172.21.15.26:0/1178426782 >> v2:172.21.15.26:3300/0 conn(0x7facdc09d6f0 msgr2=0x7facdc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:39.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.154+0000 7facdaffd700 1 --2- 172.21.15.26:0/1178426782 >> v2:172.21.15.26:3300/0 conn(0x7facdc09d6f0 0x7facdc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:39.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.154+0000 7facdaffd700 1 -- 172.21.15.26:0/1178426782 >> v1:172.21.15.26:6789/0 conn(0x7facdc09e410 legacy=0x7facdc130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:39.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.154+0000 7facda7fc700 1 -- 172.21.15.26:0/1178426782 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2405688531 0 0) 0x7facdc09f130 con 0x7facdc09e410 2023-10-01T07:55:39.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.154+0000 7facdaffd700 1 -- 172.21.15.26:0/1178426782 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facdc09b2d0 con 0x7facdc09e000 2023-10-01T07:55:39.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.155+0000 7facdb7fe700 1 --2- 172.21.15.26:0/1178426782 >> v2:172.21.15.26:3300/0 conn(0x7facdc09d6f0 0x7facdc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:55:39.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.155+0000 7facdaffd700 1 --2- 172.21.15.26:0/1178426782 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7facdc09e000 0x7facdc130660 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7facd0009840 tx=0x7facd0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f908dd4785f1bbb server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:39.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.155+0000 7facda7fc700 1 -- 172.21.15.26:0/1178426782 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd0011830 con 0x7facdc09e000 2023-10-01T07:55:39.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.155+0000 7facda7fc700 1 -- 172.21.15.26:0/1178426782 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd0011990 con 0x7facdc09e000 2023-10-01T07:55:39.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.155+0000 7facda7fc700 1 -- 172.21.15.26:0/1178426782 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd0011d20 con 0x7facdc09e000 2023-10-01T07:55:39.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.155+0000 7f192350c700 1 -- 172.21.15.26:0/2539874364 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f191c1a88d0 con 0x7f191c09d6f0 2023-10-01T07:55:39.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.156+0000 7face1e89700 1 -- 172.21.15.26:0/1178426782 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7facdc09e000 msgr2=0x7facdc130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:39.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.156+0000 7face1e89700 1 --2- 172.21.15.26:0/1178426782 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7facdc09e000 0x7facdc130660 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7facd0009840 tx=0x7facd0009b50 comp rx=0 tx=0).stop 2023-10-01T07:55:39.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.156+0000 7face1e89700 1 -- 172.21.15.26:0/1178426782 shutdown_connections 2023-10-01T07:55:39.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.156+0000 7face1e89700 1 --2- 172.21.15.26:0/1178426782 >> v2:172.21.15.26:3300/0 conn(0x7facdc09d6f0 0x7facdc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:39.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.156+0000 7face1e89700 1 --2- 172.21.15.26:0/1178426782 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7facdc09e000 0x7facdc130660 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:39.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.156+0000 7face1e89700 1 -- 172.21.15.26:0/1178426782 >> 172.21.15.26:0/1178426782 conn(0x7facdc066f50 msgr2=0x7facdc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:39.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.156+0000 7face1e89700 1 -- 172.21.15.26:0/1178426782 shutdown_connections 2023-10-01T07:55:39.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.156+0000 7face1e89700 1 -- 172.21.15.26:0/1178426782 wait complete. 2023-10-01T07:55:39.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.156+0000 7f192350c700 1 -- 172.21.15.26:0/2539874364 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f191c09c710 con 0x7f191c09d6f0 2023-10-01T07:55:39.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.156+0000 7f1911ffb700 1 -- 172.21.15.26:0/2539874364 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1918026480 con 0x7f191c09d6f0 2023-10-01T07:55:39.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.157+0000 7f1911ffb700 1 -- 172.21.15.26:0/2539874364 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1918021070 con 0x7f191c09d6f0 2023-10-01T07:55:39.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.157+0000 7f192350c700 1 -- 172.21.15.26:0/2539874364 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f191c09d1b0 con 0x7f191c09d6f0 2023-10-01T07:55:39.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.157+0000 7face1e89700 1 Processor -- start 2023-10-01T07:55:39.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.158+0000 7face1e89700 1 -- start start 2023-10-01T07:55:39.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.158+0000 7face1e89700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7facdc09d6f0 0x7facdc1cce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:39.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.158+0000 7face1e89700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facdc09e000 0x7facdc1cd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:39.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.158+0000 7face1e89700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7facdc09e410 0x7facdc1c9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:39.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.158+0000 7face1e89700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facdc129ba0 con 0x7facdc09e000 2023-10-01T07:55:39.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.158+0000 7face1e89700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facdc12a620 con 0x7facdc09e410 2023-10-01T07:55:39.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.158+0000 7face1e89700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facdc12adf0 con 0x7facdc09d6f0 2023-10-01T07:55:39.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.158+0000 7facdbfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7facdc09e410 0x7facdc1c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:39.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.158+0000 7facdbfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7facdc09e410 0x7facdc1c9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:54064/0 (socket says 172.21.15.26:54064) 2023-10-01T07:55:39.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.158+0000 7facdbfff700 1 -- 172.21.15.26:0/3737293630 learned_addr learned my addr 172.21.15.26:0/3737293630 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:39.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.158+0000 7facdaffd700 1 --2- 172.21.15.26:0/3737293630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facdc09e000 0x7facdc1cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:39.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.159+0000 7facdb7fe700 1 --2- 172.21.15.26:0/3737293630 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7facdc09d6f0 0x7facdc1cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:39.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.159+0000 7facdaffd700 1 -- 172.21.15.26:0/3737293630 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7facdc09d6f0 msgr2=0x7facdc1cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:39.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.159+0000 7facdaffd700 1 --2- 172.21.15.26:0/3737293630 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7facdc09d6f0 0x7facdc1cce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:39.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.159+0000 7facdaffd700 1 -- 172.21.15.26:0/3737293630 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7facdc09e410 msgr2=0x7facdc1c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:39.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.159+0000 7facdaffd700 1 --2- 172.21.15.26:0/3737293630 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7facdc09e410 0x7facdc1c9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:39.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.159+0000 7facdaffd700 1 -- 172.21.15.26:0/3737293630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd00094a0 con 0x7facdc09e000 2023-10-01T07:55:39.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.159+0000 7facdb7fe700 1 --2- 172.21.15.26:0/3737293630 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7facdc09d6f0 0x7facdc1cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:39.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.159+0000 7facdbfff700 1 --2- 172.21.15.26:0/3737293630 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7facdc09e410 0x7facdc1c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:39.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.159+0000 7facdaffd700 1 --2- 172.21.15.26:0/3737293630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facdc09e000 0x7facdc1cd390 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7facd0016000 tx=0x7facd0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:39.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.159+0000 7facc3fff700 1 -- 172.21.15.26:0/3737293630 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd00036a0 con 0x7facdc09e000 2023-10-01T07:55:39.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.160+0000 7face1e89700 1 -- 172.21.15.26:0/3737293630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facdc12b0b0 con 0x7facdc09e000 2023-10-01T07:55:39.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.160+0000 7facc3fff700 1 -- 172.21.15.26:0/3737293630 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd001f070 con 0x7facdc09e000 2023-10-01T07:55:39.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.160+0000 7facc3fff700 1 -- 172.21.15.26:0/3737293630 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd0003a60 con 0x7facdc09e000 2023-10-01T07:55:39.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.160+0000 7face1e89700 1 -- 172.21.15.26:0/3737293630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facdc1cc9c0 con 0x7facdc09e000 2023-10-01T07:55:39.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.161+0000 7facc3fff700 1 -- 172.21.15.26:0/3737293630 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7facd0003bc0 con 0x7facdc09e000 2023-10-01T07:55:39.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.161+0000 7facc3fff700 1 -- 172.21.15.26:0/3737293630 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7facd0021070 con 0x7facdc09e000 2023-10-01T07:55:39.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.163+0000 7face1e89700 1 -- 172.21.15.26:0/3737293630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facbc0052e0 con 0x7facdc09e000 2023-10-01T07:55:39.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.163+0000 7f1911ffb700 1 -- 172.21.15.26:0/2539874364 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1918015020 con 0x7f191c09d6f0 2023-10-01T07:55:39.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.168+0000 7facc3fff700 1 -- 172.21.15.26:0/3737293630 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7facd0015080 con 0x7facdc09e000 2023-10-01T07:55:39.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.193+0000 7f6b69b6c700 1 Processor -- start 2023-10-01T07:55:39.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.193+0000 7f6b69b6c700 1 -- start start 2023-10-01T07:55:39.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.193+0000 7f6b69b6c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b6409d6f0 0x7f6b6409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:39.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.193+0000 7f6b69b6c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b6409e000 0x7f6b64130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:39.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.193+0000 7f6b69b6c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b6409f130 con 0x7f6b6409e410 2023-10-01T07:55:39.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.193+0000 7f6b69b6c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6409f520 con 0x7f6b6409e000 2023-10-01T07:55:39.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.193+0000 7f6b69b6c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6409e930 con 0x7f6b6409d6f0 2023-10-01T07:55:39.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.194+0000 7f6b637fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b6409d6f0 0x7f6b6409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:39.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.194+0000 7f6b637fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b6409d6f0 0x7f6b6409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35494/0 (socket says 172.21.15.26:35494) 2023-10-01T07:55:39.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.194+0000 7f6b637fe700 1 -- 172.21.15.26:0/2228425540 learned_addr learned my addr 172.21.15.26:0/2228425540 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:39.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.194+0000 7f6b63fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6b6409e410 0x7f6b64130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52308/0 (socket says 172.21.15.26:52308) 2023-10-01T07:55:39.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.194+0000 7f6b62ffd700 1 --2- 172.21.15.26:0/2228425540 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b6409e000 0x7f6b64130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:39.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.194+0000 7f6b637fe700 1 -- 172.21.15.26:0/2228425540 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b6409e000 msgr2=0x7f6b64130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:39.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.194+0000 7f6b637fe700 1 --2- 172.21.15.26:0/2228425540 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b6409e000 0x7f6b64130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:39.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.194+0000 7f6b637fe700 1 -- 172.21.15.26:0/2228425540 >> v1:172.21.15.26:6789/0 conn(0x7f6b6409e410 legacy=0x7f6b64130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:39.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.194+0000 7f6b637fe700 1 -- 172.21.15.26:0/2228425540 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6409b2d0 con 0x7f6b6409d6f0 2023-10-01T07:55:39.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.194+0000 7f6b627fc700 1 -- 172.21.15.26:0/2228425540 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 137131499 0 0) 0x7f6b6409f130 con 0x7f6b6409e410 2023-10-01T07:55:39.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.194+0000 7f6b637fe700 1 --2- 172.21.15.26:0/2228425540 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b6409d6f0 0x7f6b6409dac0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6b54009950 tx=0x7f6b54009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b529b2f834a5ac5a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:39.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.194+0000 7f6b627fc700 1 -- 172.21.15.26:0/2228425540 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b54009ea0 con 0x7f6b6409d6f0 2023-10-01T07:55:39.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.194+0000 7f6b627fc700 1 -- 172.21.15.26:0/2228425540 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b5400ba20 con 0x7f6b6409d6f0 2023-10-01T07:55:39.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.194+0000 7f6b627fc700 1 -- 172.21.15.26:0/2228425540 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5400bdb0 con 0x7f6b6409d6f0 2023-10-01T07:55:39.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.195+0000 7f6b69b6c700 1 -- 172.21.15.26:0/2228425540 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b6409d6f0 msgr2=0x7f6b6409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:39.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.195+0000 7f6b69b6c700 1 --2- 172.21.15.26:0/2228425540 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b6409d6f0 0x7f6b6409dac0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6b54009950 tx=0x7f6b54009c60 comp rx=0 tx=0).stop 2023-10-01T07:55:39.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.195+0000 7f6b69b6c700 1 -- 172.21.15.26:0/2228425540 shutdown_connections 2023-10-01T07:55:39.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.195+0000 7f6b69b6c700 1 --2- 172.21.15.26:0/2228425540 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b6409d6f0 0x7f6b6409dac0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:39.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.195+0000 7f6b69b6c700 1 --2- 172.21.15.26:0/2228425540 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b6409e000 0x7f6b64130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:39.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.195+0000 7f6b69b6c700 1 -- 172.21.15.26:0/2228425540 >> 172.21.15.26:0/2228425540 conn(0x7f6b64066f50 msgr2=0x7f6b6409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:39.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.195+0000 7f6b69b6c700 1 -- 172.21.15.26:0/2228425540 shutdown_connections 2023-10-01T07:55:39.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.195+0000 7f6b69b6c700 1 -- 172.21.15.26:0/2228425540 wait complete. 2023-10-01T07:55:39.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.197+0000 7f6b69b6c700 1 Processor -- start 2023-10-01T07:55:39.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.197+0000 7f6b69b6c700 1 -- start start 2023-10-01T07:55:39.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.198+0000 7f6b69b6c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b6409d6f0 0x7f6b64122220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:39.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.198+0000 7f6b69b6c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b6409e000 0x7f6b64122760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:39.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.198+0000 7f6b69b6c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b6409e410 0x7f6b64122ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:39.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.198+0000 7f6b69b6c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b640a3b70 con 0x7f6b6409e000 2023-10-01T07:55:39.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.198+0000 7f6b69b6c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b64125e50 con 0x7f6b6409d6f0 2023-10-01T07:55:39.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.198+0000 7f6b69b6c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6409c700 con 0x7f6b6409e410 2023-10-01T07:55:39.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.198+0000 7f6b637fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b6409d6f0 0x7f6b64122220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:39.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.198+0000 7f6b62ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b6409e000 0x7f6b64122760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:39.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.198+0000 7f6b637fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b6409d6f0 0x7f6b64122220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:54084/0 (socket says 172.21.15.26:54084) 2023-10-01T07:55:39.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.198+0000 7f6b637fe700 1 -- 172.21.15.26:0/2254118568 learned_addr learned my addr 172.21.15.26:0/2254118568 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:39.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.198+0000 7f6b63fff700 1 --2- 172.21.15.26:0/2254118568 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b6409e410 0x7f6b64122ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:39.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.198+0000 7f6b637fe700 1 -- 172.21.15.26:0/2254118568 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b6409e410 msgr2=0x7f6b64122ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:39.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.198+0000 7f6b637fe700 1 --2- 172.21.15.26:0/2254118568 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b6409e410 0x7f6b64122ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:39.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.198+0000 7f6b637fe700 1 -- 172.21.15.26:0/2254118568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b6409e000 msgr2=0x7f6b64122760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:39.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.198+0000 7f6b637fe700 1 --2- 172.21.15.26:0/2254118568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b6409e000 0x7f6b64122760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:39.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.198+0000 7f6b637fe700 1 -- 172.21.15.26:0/2254118568 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b54009550 con 0x7f6b6409d6f0 2023-10-01T07:55:39.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.198+0000 7f6b637fe700 1 --2- 172.21.15.26:0/2254118568 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b6409d6f0 0x7f6b64122220 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6b54009ca0 tx=0x7f6b54004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:39.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.199+0000 7f6b4bfff700 1 -- 172.21.15.26:0/2254118568 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5400be90 con 0x7f6b6409d6f0 2023-10-01T07:55:39.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.199+0000 7f6b4bfff700 1 -- 172.21.15.26:0/2254118568 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b5401f070 con 0x7f6b6409d6f0 2023-10-01T07:55:39.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.199+0000 7f6b69b6c700 1 -- 172.21.15.26:0/2254118568 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b641254d0 con 0x7f6b6409d6f0 2023-10-01T07:55:39.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.199+0000 7f6b4bfff700 1 -- 172.21.15.26:0/2254118568 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b540036a0 con 0x7f6b6409d6f0 2023-10-01T07:55:39.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.199+0000 7f6b69b6c700 1 -- 172.21.15.26:0/2254118568 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b641245e0 con 0x7f6b6409d6f0 2023-10-01T07:55:39.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.200+0000 7f6b69b6c700 1 -- 172.21.15.26:0/2254118568 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b6411ac20 con 0x7f6b6409d6f0 2023-10-01T07:55:39.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.200+0000 7f6b4bfff700 1 -- 172.21.15.26:0/2254118568 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6b54021030 con 0x7f6b6409d6f0 2023-10-01T07:55:39.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.201+0000 7f6b4bfff700 1 -- 172.21.15.26:0/2254118568 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6b54040fd0 con 0x7f6b6409d6f0 2023-10-01T07:55:39.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.205+0000 7f6b4bfff700 1 -- 172.21.15.26:0/2254118568 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6b540199a0 con 0x7f6b6409d6f0 2023-10-01T07:55:39.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.412+0000 7f5e2336e700 1 -- 172.21.15.26:0/2032408551 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5e1c124e90 con 0x7f5e1c09d6f0 2023-10-01T07:55:39.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.413+0000 7f5e11ffb700 1 -- 172.21.15.26:0/2032408551 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5e1c124e90 con 0x7f5e1c09d6f0 2023-10-01T07:55:39.414 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:39.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.416+0000 7f5e2336e700 1 -- 172.21.15.26:0/2032408551 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5e1c09d6f0 msgr2=0x7f5e1c1223f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:39.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.416+0000 7f5e2336e700 1 --2- 172.21.15.26:0/2032408551 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5e1c09d6f0 0x7f5e1c1223f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5e1800e810 tx=0x7f5e1800eb20 comp rx=0 tx=0).stop 2023-10-01T07:55:39.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.416+0000 7f5e2336e700 1 -- 172.21.15.26:0/2032408551 shutdown_connections 2023-10-01T07:55:39.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.416+0000 7f5e2336e700 1 --2- 172.21.15.26:0/2032408551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e1c09e410 0x7f5e1c122e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:39.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.416+0000 7f5e2336e700 1 --2- 172.21.15.26:0/2032408551 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5e1c09d6f0 0x7f5e1c1223f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:39.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.416+0000 7f5e2336e700 1 --2- 172.21.15.26:0/2032408551 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5e1c09e000 0x7f5e1c122930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:39.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.416+0000 7f5e2336e700 1 -- 172.21.15.26:0/2032408551 >> 172.21.15.26:0/2032408551 conn(0x7f5e1c066f50 msgr2=0x7f5e1c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:39.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.416+0000 7f5e2336e700 1 -- 172.21.15.26:0/2032408551 shutdown_connections 2023-10-01T07:55:39.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.416+0000 7f5e2336e700 1 -- 172.21.15.26:0/2032408551 wait complete. 2023-10-01T07:55:39.437 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:39.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.444+0000 7f192350c700 1 -- 172.21.15.26:0/2539874364 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f191c074ea0 con 0x7f191c09d6f0 2023-10-01T07:55:39.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.445+0000 7f1911ffb700 1 -- 172.21.15.26:0/2539874364 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f191802f3a0 con 0x7f191c09d6f0 2023-10-01T07:55:39.446 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:39.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.447+0000 7f192350c700 1 -- 172.21.15.26:0/2539874364 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f191c09d6f0 msgr2=0x7f191c1a5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:39.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.447+0000 7f192350c700 1 --2- 172.21.15.26:0/2539874364 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f191c09d6f0 0x7f191c1a5ec0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f191800bda0 tx=0x7f1918004750 comp rx=0 tx=0).stop 2023-10-01T07:55:39.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.447+0000 7f192350c700 1 -- 172.21.15.26:0/2539874364 shutdown_connections 2023-10-01T07:55:39.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.447+0000 7f192350c700 1 --2- 172.21.15.26:0/2539874364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f191c09e410 0x7f191c1a6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:39.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.447+0000 7f192350c700 1 --2- 172.21.15.26:0/2539874364 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f191c09d6f0 0x7f191c1a5ec0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:39.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.447+0000 7f192350c700 1 --2- 172.21.15.26:0/2539874364 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f191c09e000 0x7f191c1a6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:39.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.448+0000 7f192350c700 1 -- 172.21.15.26:0/2539874364 >> 172.21.15.26:0/2539874364 conn(0x7f191c066f50 msgr2=0x7f191c1bac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:39.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.448+0000 7f192350c700 1 -- 172.21.15.26:0/2539874364 shutdown_connections 2023-10-01T07:55:39.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.448+0000 7f192350c700 1 -- 172.21.15.26:0/2539874364 wait complete. 2023-10-01T07:55:39.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.456+0000 7face1e89700 1 -- 172.21.15.26:0/3737293630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7facbc005590 con 0x7facdc09e000 2023-10-01T07:55:39.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.457+0000 7facc3fff700 1 -- 172.21.15.26:0/3737293630 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7facd002b020 con 0x7facdc09e000 2023-10-01T07:55:39.458 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:39.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.460+0000 7face1e89700 1 -- 172.21.15.26:0/3737293630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facdc09e000 msgr2=0x7facdc1cd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:39.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.460+0000 7face1e89700 1 --2- 172.21.15.26:0/3737293630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facdc09e000 0x7facdc1cd390 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7facd0016000 tx=0x7facd0004750 comp rx=0 tx=0).stop 2023-10-01T07:55:39.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.460+0000 7face1e89700 1 -- 172.21.15.26:0/3737293630 shutdown_connections 2023-10-01T07:55:39.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.460+0000 7face1e89700 1 --2- 172.21.15.26:0/3737293630 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7facdc09e410 0x7facdc1c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:39.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.460+0000 7face1e89700 1 --2- 172.21.15.26:0/3737293630 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7facdc09d6f0 0x7facdc1cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:39.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.460+0000 7face1e89700 1 --2- 172.21.15.26:0/3737293630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facdc09e000 0x7facdc1cd390 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:39.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.460+0000 7face1e89700 1 -- 172.21.15.26:0/3737293630 >> 172.21.15.26:0/3737293630 conn(0x7facdc066f50 msgr2=0x7facdc070e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:39.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.460+0000 7face1e89700 1 -- 172.21.15.26:0/3737293630 shutdown_connections 2023-10-01T07:55:39.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.460+0000 7face1e89700 1 -- 172.21.15.26:0/3737293630 wait complete. 2023-10-01T07:55:39.465 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:39.475 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:39.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.486+0000 7f6b69b6c700 1 -- 172.21.15.26:0/2254118568 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6b64074ea0 con 0x7f6b6409d6f0 2023-10-01T07:55:39.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.486+0000 7f6b4bfff700 1 -- 172.21.15.26:0/2254118568 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6b54015030 con 0x7f6b6409d6f0 2023-10-01T07:55:39.487 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:39.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.489+0000 7f6b69b6c700 1 -- 172.21.15.26:0/2254118568 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b6409d6f0 msgr2=0x7f6b64122220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:39.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.489+0000 7f6b69b6c700 1 --2- 172.21.15.26:0/2254118568 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b6409d6f0 0x7f6b64122220 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6b54009ca0 tx=0x7f6b54004750 comp rx=0 tx=0).stop 2023-10-01T07:55:39.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.489+0000 7f6b69b6c700 1 -- 172.21.15.26:0/2254118568 shutdown_connections 2023-10-01T07:55:39.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.489+0000 7f6b69b6c700 1 --2- 172.21.15.26:0/2254118568 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b6409e410 0x7f6b64122ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:39.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.489+0000 7f6b69b6c700 1 --2- 172.21.15.26:0/2254118568 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b6409d6f0 0x7f6b64122220 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:39.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.489+0000 7f6b69b6c700 1 --2- 172.21.15.26:0/2254118568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b6409e000 0x7f6b64122760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:39.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.489+0000 7f6b69b6c700 1 -- 172.21.15.26:0/2254118568 >> 172.21.15.26:0/2254118568 conn(0x7f6b64066f50 msgr2=0x7f6b64130920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:39.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.489+0000 7f6b69b6c700 1 -- 172.21.15.26:0/2254118568 shutdown_connections 2023-10-01T07:55:39.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:39.489+0000 7f6b69b6c700 1 -- 172.21.15.26:0/2254118568 wait complete. 2023-10-01T07:55:39.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:40.438 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:40.465 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:40.476 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:40.504 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:40.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.603+0000 7f80fdb52700 1 Processor -- start 2023-10-01T07:55:40.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.603+0000 7f80fdb52700 1 -- start start 2023-10-01T07:55:40.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.604+0000 7f80fdb52700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f80f8133420 0x7f80f81337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:40.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.604+0000 7f80fdb52700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f80f8134260 0x7f80f81306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:40.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.604+0000 7f80fdb52700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f806b990 con 0x7f80f8133e30 2023-10-01T07:55:40.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.604+0000 7f80fdb52700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f80a0590 con 0x7f80f8134260 2023-10-01T07:55:40.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.604+0000 7f80fdb52700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f809fb80 con 0x7f80f8133420 2023-10-01T07:55:40.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.604+0000 7f80f7fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f80f8134260 0x7f80f81306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:40.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.605+0000 7f80f7fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f80f8134260 0x7f80f81306a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50416/0 (socket says 172.21.15.26:50416) 2023-10-01T07:55:40.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.605+0000 7f80f7fff700 1 -- 172.21.15.26:0/3992615676 learned_addr learned my addr 172.21.15.26:0/3992615676 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:40.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.605+0000 7f80f77fe700 1 --2- 172.21.15.26:0/3992615676 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f80f8133420 0x7f80f81337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:40.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.605+0000 7f80f7fff700 1 -- 172.21.15.26:0/3992615676 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f80f8133420 msgr2=0x7f80f81337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:40.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.605+0000 7f80f7fff700 1 --2- 172.21.15.26:0/3992615676 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f80f8133420 0x7f80f81337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.605+0000 7f80f7fff700 1 -- 172.21.15.26:0/3992615676 >> v1:172.21.15.26:6789/0 conn(0x7f80f8133e30 legacy=0x7f80f812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:40.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.605+0000 7f80f7fff700 1 -- 172.21.15.26:0/3992615676 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f80a0030 con 0x7f80f8134260 2023-10-01T07:55:40.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.605+0000 7f80f7fff700 1 --2- 172.21.15.26:0/3992615676 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80f8134260 0x7f80f81306a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f80f0009e50 tx=0x7f80f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58dd06a1ca4a3294 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:40.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.605+0000 7f80f67fc700 1 -- 172.21.15.26:0/3992615676 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f000e070 con 0x7f80f8134260 2023-10-01T07:55:40.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.606+0000 7f80f67fc700 1 -- 172.21.15.26:0/3992615676 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f000b910 con 0x7f80f8134260 2023-10-01T07:55:40.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.606+0000 7f80f67fc700 1 -- 172.21.15.26:0/3992615676 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f000bcc0 con 0x7f80f8134260 2023-10-01T07:55:40.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.607+0000 7f80fdb52700 1 -- 172.21.15.26:0/3992615676 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80f8134260 msgr2=0x7f80f81306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:40.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.607+0000 7f80fdb52700 1 --2- 172.21.15.26:0/3992615676 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80f8134260 0x7f80f81306a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f80f0009e50 tx=0x7f80f000b330 comp rx=0 tx=0).stop 2023-10-01T07:55:40.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.607+0000 7f80fdb52700 1 -- 172.21.15.26:0/3992615676 shutdown_connections 2023-10-01T07:55:40.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.607+0000 7f80fdb52700 1 --2- 172.21.15.26:0/3992615676 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80f8134260 0x7f80f81306a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.607+0000 7f80fdb52700 1 --2- 172.21.15.26:0/3992615676 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f80f8133420 0x7f80f81337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.607+0000 7f80fdb52700 1 -- 172.21.15.26:0/3992615676 >> 172.21.15.26:0/3992615676 conn(0x7f80f80a4210 msgr2=0x7f80f80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:40.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.607+0000 7f80fdb52700 1 -- 172.21.15.26:0/3992615676 shutdown_connections 2023-10-01T07:55:40.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.607+0000 7f80fdb52700 1 -- 172.21.15.26:0/3992615676 wait complete. 2023-10-01T07:55:40.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.608+0000 7f80fdb52700 1 Processor -- start 2023-10-01T07:55:40.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.609+0000 7f80fdb52700 1 -- start start 2023-10-01T07:55:40.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.609+0000 7f80fdb52700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80f8133420 0x7f80f809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:40.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.609+0000 7f80fdb52700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f80f8133e30 0x7f80f809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:40.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.609+0000 7f80fdb52700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f80f8134260 0x7f80f809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:40.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.609+0000 7f80fdb52700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f811fa90 con 0x7f80f8133420 2023-10-01T07:55:40.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.609+0000 7f80fdb52700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f809de90 con 0x7f80f8134260 2023-10-01T07:55:40.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.609+0000 7f80fdb52700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80f811fcc0 con 0x7f80f8133e30 2023-10-01T07:55:40.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.610+0000 7f80f6ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f80f8133e30 0x7f80f809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:40.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.610+0000 7f80f6ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f80f8133e30 0x7f80f809c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35500/0 (socket says 172.21.15.26:35500) 2023-10-01T07:55:40.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.610+0000 7f80f7fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f80f8134260 0x7f80f809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:40.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.610+0000 7f80f6ffd700 1 -- 172.21.15.26:0/424464171 learned_addr learned my addr 172.21.15.26:0/424464171 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:40.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.610+0000 7f80f7fff700 1 -- 172.21.15.26:0/424464171 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f80f8133e30 msgr2=0x7f80f809c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:40.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.610+0000 7f80f7fff700 1 --2- 172.21.15.26:0/424464171 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f80f8133e30 0x7f80f809c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.610+0000 7f80f7fff700 1 -- 172.21.15.26:0/424464171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80f8133420 msgr2=0x7f80f809c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:40.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.610+0000 7f80f7fff700 1 --2- 172.21.15.26:0/424464171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80f8133420 0x7f80f809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.610+0000 7f80f7fff700 1 -- 172.21.15.26:0/424464171 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f0009b30 con 0x7f80f8134260 2023-10-01T07:55:40.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.610+0000 7f80f6ffd700 1 --2- 172.21.15.26:0/424464171 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f80f8133e30 0x7f80f809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:40.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.610+0000 7f80f7fff700 1 --2- 172.21.15.26:0/424464171 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f80f8134260 0x7f80f809cf00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f80f0015000 tx=0x7f80f0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:40.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.611+0000 7f80dffff700 1 -- 172.21.15.26:0/424464171 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0004620 con 0x7f80f8134260 2023-10-01T07:55:40.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.611+0000 7f80dffff700 1 -- 172.21.15.26:0/424464171 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f00092e0 con 0x7f80f8134260 2023-10-01T07:55:40.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.611+0000 7f80fdb52700 1 -- 172.21.15.26:0/424464171 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f809e330 con 0x7f80f8134260 2023-10-01T07:55:40.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.611+0000 7f80fdb52700 1 -- 172.21.15.26:0/424464171 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f8120030 con 0x7f80f8134260 2023-10-01T07:55:40.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.611+0000 7f80dffff700 1 -- 172.21.15.26:0/424464171 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f001c410 con 0x7f80f8134260 2023-10-01T07:55:40.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.611+0000 7f80dffff700 1 -- 172.21.15.26:0/424464171 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f80f001c570 con 0x7f80f8134260 2023-10-01T07:55:40.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.612+0000 7f80dffff700 1 -- 172.21.15.26:0/424464171 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f80f0041160 con 0x7f80f8134260 2023-10-01T07:55:40.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.616+0000 7f80fdb52700 1 -- 172.21.15.26:0/424464171 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80f8074ea0 con 0x7f80f8134260 2023-10-01T07:55:40.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.624+0000 7f80dffff700 1 -- 172.21.15.26:0/424464171 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f80f001ca00 con 0x7f80f8134260 2023-10-01T07:55:40.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.633+0000 7fc9447ec700 1 Processor -- start 2023-10-01T07:55:40.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.633+0000 7fc9447ec700 1 -- start start 2023-10-01T07:55:40.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.634+0000 7fc9447ec700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc93c09e1d0 0x7fc93c135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:40.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.634+0000 7fc9447ec700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc93c135e50 0x7fc93c138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:40.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.634+0000 7fc9447ec700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc93c09f130 con 0x7fc93c09d6f0 2023-10-01T07:55:40.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.634+0000 7fc9447ec700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc93c09f520 con 0x7fc93c135e50 2023-10-01T07:55:40.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.634+0000 7fc9447ec700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c09e930 con 0x7fc93c09e1d0 2023-10-01T07:55:40.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.634+0000 7fc942d89700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc93c135e50 0x7fc93c138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:40.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.634+0000 7fc942d89700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc93c135e50 0x7fc93c138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50436/0 (socket says 172.21.15.26:50436) 2023-10-01T07:55:40.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.634+0000 7fc942d89700 1 -- 172.21.15.26:0/1530552879 learned_addr learned my addr 172.21.15.26:0/1530552879 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:40.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.634+0000 7fc941d87700 1 --2- 172.21.15.26:0/1530552879 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc93c09e1d0 0x7fc93c135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:40.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.635+0000 7fc941d87700 1 -- 172.21.15.26:0/1530552879 >> v2:172.21.15.26:3300/0 conn(0x7fc93c135e50 msgr2=0x7fc93c138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:40.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.635+0000 7fc941d87700 1 --2- 172.21.15.26:0/1530552879 >> v2:172.21.15.26:3300/0 conn(0x7fc93c135e50 0x7fc93c138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.635+0000 7fc941d87700 1 -- 172.21.15.26:0/1530552879 >> v1:172.21.15.26:6789/0 conn(0x7fc93c09d6f0 legacy=0x7fc93c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:40.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.635+0000 7fc941d87700 1 -- 172.21.15.26:0/1530552879 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc93c09b2d0 con 0x7fc93c09e1d0 2023-10-01T07:55:40.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.635+0000 7fc941d87700 1 --2- 172.21.15.26:0/1530552879 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc93c09e1d0 0x7fc93c135910 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc92c00dc90 tx=0x7fc92c00f050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a2bd012bc249d76 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:40.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.635+0000 7fc941586700 1 -- 172.21.15.26:0/1530552879 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c012070 con 0x7fc93c09e1d0 2023-10-01T07:55:40.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.635+0000 7fc941586700 1 -- 172.21.15.26:0/1530552879 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92c00d2e0 con 0x7fc93c09e1d0 2023-10-01T07:55:40.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.635+0000 7fc941586700 1 -- 172.21.15.26:0/1530552879 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c00f8b0 con 0x7fc93c09e1d0 2023-10-01T07:55:40.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.636+0000 7fc9447ec700 1 -- 172.21.15.26:0/1530552879 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc93c09e1d0 msgr2=0x7fc93c135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:40.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.636+0000 7fc9447ec700 1 --2- 172.21.15.26:0/1530552879 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc93c09e1d0 0x7fc93c135910 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc92c00dc90 tx=0x7fc92c00f050 comp rx=0 tx=0).stop 2023-10-01T07:55:40.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.636+0000 7fc9447ec700 1 -- 172.21.15.26:0/1530552879 shutdown_connections 2023-10-01T07:55:40.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.636+0000 7fc9447ec700 1 --2- 172.21.15.26:0/1530552879 >> v2:172.21.15.26:3300/0 conn(0x7fc93c135e50 0x7fc93c138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.636+0000 7fc9447ec700 1 --2- 172.21.15.26:0/1530552879 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc93c09e1d0 0x7fc93c135910 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.636+0000 7fc9447ec700 1 -- 172.21.15.26:0/1530552879 >> 172.21.15.26:0/1530552879 conn(0x7fc93c066f50 msgr2=0x7fc93c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:40.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.639+0000 7fc9447ec700 1 -- 172.21.15.26:0/1530552879 shutdown_connections 2023-10-01T07:55:40.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.639+0000 7fc9447ec700 1 -- 172.21.15.26:0/1530552879 wait complete. 2023-10-01T07:55:40.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.640+0000 7fc9447ec700 1 Processor -- start 2023-10-01T07:55:40.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.640+0000 7fc9447ec700 1 -- start start 2023-10-01T07:55:40.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.641+0000 7fc9447ec700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc93c09d6f0 0x7fc93c1c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:40.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.641+0000 7fc9447ec700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc93c09e1d0 0x7fc93c1c4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:40.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.641+0000 7fc9447ec700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc93c135e50 0x7fc93c119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:40.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.641+0000 7fc9447ec700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c11b060 con 0x7fc93c135e50 2023-10-01T07:55:40.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.641+0000 7fc9447ec700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c0a1d90 con 0x7fc93c09d6f0 2023-10-01T07:55:40.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.641+0000 7fc9447ec700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c1c4e50 con 0x7fc93c09e1d0 2023-10-01T07:55:40.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.641+0000 7fc942588700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc93c09d6f0 0x7fc93c1c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:40.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.641+0000 7fc942588700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc93c09d6f0 0x7fc93c1c43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:54126/0 (socket says 172.21.15.26:54126) 2023-10-01T07:55:40.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.641+0000 7fc942588700 1 -- 172.21.15.26:0/3784124018 learned_addr learned my addr 172.21.15.26:0/3784124018 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:40.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.641+0000 7fc941d87700 1 --2- 172.21.15.26:0/3784124018 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc93c09e1d0 0x7fc93c1c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:40.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.641+0000 7fc942588700 1 -- 172.21.15.26:0/3784124018 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc93c09e1d0 msgr2=0x7fc93c1c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:40.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.641+0000 7fc942588700 1 --2- 172.21.15.26:0/3784124018 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc93c09e1d0 0x7fc93c1c4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.641+0000 7fc942588700 1 -- 172.21.15.26:0/3784124018 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc93c135e50 msgr2=0x7fc93c119480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:40.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.641+0000 7fc942588700 1 --2- 172.21.15.26:0/3784124018 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc93c135e50 0x7fc93c119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.641+0000 7fc942588700 1 -- 172.21.15.26:0/3784124018 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92c00d940 con 0x7fc93c09d6f0 2023-10-01T07:55:40.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.642+0000 7fc942588700 1 --2- 172.21.15.26:0/3784124018 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc93c09d6f0 0x7fc93c1c43d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc93800c540 tx=0x7fc93800c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:40.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.642+0000 7fc932ffd700 1 -- 172.21.15.26:0/3784124018 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9380052d0 con 0x7fc93c09d6f0 2023-10-01T07:55:40.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.642+0000 7fc932ffd700 1 -- 172.21.15.26:0/3784124018 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc938005430 con 0x7fc93c09d6f0 2023-10-01T07:55:40.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.642+0000 7fc9447ec700 1 -- 172.21.15.26:0/3784124018 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc93c130230 con 0x7fc93c09d6f0 2023-10-01T07:55:40.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.642+0000 7fc932ffd700 1 -- 172.21.15.26:0/3784124018 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9380038c0 con 0x7fc93c09d6f0 2023-10-01T07:55:40.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.642+0000 7fc9447ec700 1 -- 172.21.15.26:0/3784124018 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc93c09c700 con 0x7fc93c09d6f0 2023-10-01T07:55:40.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.643+0000 7fc9447ec700 1 -- 172.21.15.26:0/3784124018 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc93c074ea0 con 0x7fc93c09d6f0 2023-10-01T07:55:40.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.644+0000 7fc932ffd700 1 -- 172.21.15.26:0/3784124018 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc938003a20 con 0x7fc93c09d6f0 2023-10-01T07:55:40.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.644+0000 7fc932ffd700 1 -- 172.21.15.26:0/3784124018 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc93803ef80 con 0x7fc93c09d6f0 2023-10-01T07:55:40.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.645+0000 7fb39d8bf700 1 Processor -- start 2023-10-01T07:55:40.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.646+0000 7fb39d8bf700 1 -- start start 2023-10-01T07:55:40.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.646+0000 7fb39d8bf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb39812cf60 0x7fb39806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:40.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.646+0000 7fb39d8bf700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb39812f8b0 0x7fb39812fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:40.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.646+0000 7fb39d8bf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb398130260 0x7fb398136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:40.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.646+0000 7fb39d8bf700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb39812d330 con 0x7fb39812f8b0 2023-10-01T07:55:40.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.646+0000 7fb39d8bf700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb39812cd90 con 0x7fb398130260 2023-10-01T07:55:40.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.646+0000 7fb39d8bf700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3981306d0 con 0x7fb39812cf60 2023-10-01T07:55:40.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.647+0000 7fb3977fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb398130260 0x7fb398136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:40.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.647+0000 7fb3977fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb398130260 0x7fb398136c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:54134/0 (socket says 172.21.15.26:54134) 2023-10-01T07:55:40.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.647+0000 7fb3977fe700 1 -- 172.21.15.26:0/3265149000 learned_addr learned my addr 172.21.15.26:0/3265149000 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:40.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.647+0000 7fb3977fe700 1 -- 172.21.15.26:0/3265149000 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb39812cf60 msgr2=0x7fb39806f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:40.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.647+0000 7fb3977fe700 1 --2- 172.21.15.26:0/3265149000 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb39812cf60 0x7fb39806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.647+0000 7fb3977fe700 1 -- 172.21.15.26:0/3265149000 >> v2:172.21.15.26:3300/0 conn(0x7fb39812f8b0 msgr2=0x7fb39812fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:40.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.647+0000 7fb3977fe700 1 --2- 172.21.15.26:0/3265149000 >> v2:172.21.15.26:3300/0 conn(0x7fb39812f8b0 0x7fb39812fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.647+0000 7fb3977fe700 1 -- 172.21.15.26:0/3265149000 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb398071780 con 0x7fb398130260 2023-10-01T07:55:40.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.647+0000 7fb3977fe700 1 --2- 172.21.15.26:0/3265149000 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb398130260 0x7fb398136c20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb390009e80 tx=0x7fb39000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=197290db7b3e8db4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:40.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.649+0000 7fb395ffb700 1 -- 172.21.15.26:0/3265149000 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39000e070 con 0x7fb398130260 2023-10-01T07:55:40.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.649+0000 7fb395ffb700 1 -- 172.21.15.26:0/3265149000 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39000b980 con 0x7fb398130260 2023-10-01T07:55:40.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.649+0000 7fb395ffb700 1 -- 172.21.15.26:0/3265149000 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39000bd30 con 0x7fb398130260 2023-10-01T07:55:40.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.649+0000 7fc932ffd700 1 -- 172.21.15.26:0/3784124018 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc938018260 con 0x7fc93c09d6f0 2023-10-01T07:55:40.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.650+0000 7fb39d8bf700 1 -- 172.21.15.26:0/3265149000 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb398130260 msgr2=0x7fb398136c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:40.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.650+0000 7fb39d8bf700 1 --2- 172.21.15.26:0/3265149000 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb398130260 0x7fb398136c20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb390009e80 tx=0x7fb39000b330 comp rx=0 tx=0).stop 2023-10-01T07:55:40.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.650+0000 7fb39d8bf700 1 -- 172.21.15.26:0/3265149000 shutdown_connections 2023-10-01T07:55:40.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.650+0000 7fb39d8bf700 1 --2- 172.21.15.26:0/3265149000 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb398130260 0x7fb398136c20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.650+0000 7fb39d8bf700 1 --2- 172.21.15.26:0/3265149000 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb39812cf60 0x7fb39806f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.650+0000 7fb39d8bf700 1 --2- 172.21.15.26:0/3265149000 >> v2:172.21.15.26:3300/0 conn(0x7fb39812f8b0 0x7fb39812fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.650+0000 7fb39d8bf700 1 -- 172.21.15.26:0/3265149000 >> 172.21.15.26:0/3265149000 conn(0x7fb3980a2aa0 msgr2=0x7fb3980a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:40.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.650+0000 7fb39d8bf700 1 -- 172.21.15.26:0/3265149000 shutdown_connections 2023-10-01T07:55:40.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.650+0000 7fb39d8bf700 1 -- 172.21.15.26:0/3265149000 wait complete. 2023-10-01T07:55:40.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.652+0000 7fb39d8bf700 1 Processor -- start 2023-10-01T07:55:40.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.652+0000 7fb39d8bf700 1 -- start start 2023-10-01T07:55:40.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.653+0000 7fb39d8bf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb39812cf60 0x7fb3981c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:40.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.653+0000 7fb39d8bf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb39812f8b0 0x7fb3981c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:40.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.653+0000 7fb39d8bf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb398130260 0x7fb398138270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:40.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.653+0000 7fb39d8bf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3981361f0 con 0x7fb39812cf60 2023-10-01T07:55:40.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.653+0000 7fb39d8bf700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb398139330 con 0x7fb398130260 2023-10-01T07:55:40.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.653+0000 7fb39d8bf700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb398137cf0 con 0x7fb39812f8b0 2023-10-01T07:55:40.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.653+0000 7fb3977fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb398130260 0x7fb398138270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:40.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.653+0000 7fb3977fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb398130260 0x7fb398138270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:54142/0 (socket says 172.21.15.26:54142) 2023-10-01T07:55:40.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.653+0000 7fb3977fe700 1 -- 172.21.15.26:0/1773200270 learned_addr learned my addr 172.21.15.26:0/1773200270 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:40.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.653+0000 7fb3967fc700 1 --2- 172.21.15.26:0/1773200270 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb39812f8b0 0x7fb3981c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:40.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.653+0000 7fb396ffd700 1 --2- 172.21.15.26:0/1773200270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb39812cf60 0x7fb3981c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:40.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.653+0000 7fb3977fe700 1 -- 172.21.15.26:0/1773200270 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb39812f8b0 msgr2=0x7fb3981c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:40.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.653+0000 7fb3977fe700 1 --2- 172.21.15.26:0/1773200270 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb39812f8b0 0x7fb3981c8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.653+0000 7fb3977fe700 1 -- 172.21.15.26:0/1773200270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb39812cf60 msgr2=0x7fb3981c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:40.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.653+0000 7fb3977fe700 1 --2- 172.21.15.26:0/1773200270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb39812cf60 0x7fb3981c8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.653+0000 7fb3977fe700 1 -- 172.21.15.26:0/1773200270 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb390009b30 con 0x7fb398130260 2023-10-01T07:55:40.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.654+0000 7fb3977fe700 1 --2- 172.21.15.26:0/1773200270 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb398130260 0x7fb398138270 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb398099c40 tx=0x7fb390004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:40.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.654+0000 7fb37ffff700 1 -- 172.21.15.26:0/1773200270 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb390004450 con 0x7fb398130260 2023-10-01T07:55:40.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.654+0000 7fb37ffff700 1 -- 172.21.15.26:0/1773200270 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3900045d0 con 0x7fb398130260 2023-10-01T07:55:40.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.654+0000 7fb37ffff700 1 -- 172.21.15.26:0/1773200270 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb390025460 con 0x7fb398130260 2023-10-01T07:55:40.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.654+0000 7fb39d8bf700 1 -- 172.21.15.26:0/1773200270 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb398071af0 con 0x7fb398130260 2023-10-01T07:55:40.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.654+0000 7fb39d8bf700 1 -- 172.21.15.26:0/1773200270 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3981352b0 con 0x7fb398130260 2023-10-01T07:55:40.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.656+0000 7fb37e7fc700 1 -- 172.21.15.26:0/1773200270 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3700052e0 con 0x7fb398130260 2023-10-01T07:55:40.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.657+0000 7fb37ffff700 1 -- 172.21.15.26:0/1773200270 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb3900255c0 con 0x7fb398130260 2023-10-01T07:55:40.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.657+0000 7fb37ffff700 1 -- 172.21.15.26:0/1773200270 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb390041450 con 0x7fb398130260 2023-10-01T07:55:40.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.662+0000 7fb37ffff700 1 -- 172.21.15.26:0/1773200270 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb39001b990 con 0x7fb398130260 2023-10-01T07:55:40.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.683+0000 7f1875332700 1 Processor -- start 2023-10-01T07:55:40.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.683+0000 7f1875332700 1 -- start start 2023-10-01T07:55:40.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.683+0000 7f1875332700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f187009e930 0x7f187009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:40.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.684+0000 7f1875332700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f187009f240 0x7f18701317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:40.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.684+0000 7f1875332700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1870070940 con 0x7f187009f650 2023-10-01T07:55:40.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.684+0000 7f1875332700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f187006fd60 con 0x7f187009e930 2023-10-01T07:55:40.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.684+0000 7f1875332700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f187006fa80 con 0x7f187009f240 2023-10-01T07:55:40.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.684+0000 7f186e7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f187009f240 0x7f18701317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:40.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.684+0000 7f186e7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f187009f240 0x7f18701317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35538/0 (socket says 172.21.15.26:35538) 2023-10-01T07:55:40.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.684+0000 7f186e7fc700 1 -- 172.21.15.26:0/3617863673 learned_addr learned my addr 172.21.15.26:0/3617863673 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:40.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.684+0000 7f186effd700 1 --2- 172.21.15.26:0/3617863673 >> v2:172.21.15.26:3300/0 conn(0x7f187009e930 0x7f187009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:40.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.684+0000 7f186e7fc700 1 -- 172.21.15.26:0/3617863673 >> v2:172.21.15.26:3300/0 conn(0x7f187009e930 msgr2=0x7f187009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:40.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.684+0000 7f186e7fc700 1 --2- 172.21.15.26:0/3617863673 >> v2:172.21.15.26:3300/0 conn(0x7f187009e930 0x7f187009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.684+0000 7f186e7fc700 1 -- 172.21.15.26:0/3617863673 >> v1:172.21.15.26:6789/0 conn(0x7f187009f650 legacy=0x7f1870131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:40.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.684+0000 7f186e7fc700 1 -- 172.21.15.26:0/3617863673 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f187009fb60 con 0x7f187009f240 2023-10-01T07:55:40.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.685+0000 7f186e7fc700 1 --2- 172.21.15.26:0/3617863673 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f187009f240 0x7f18701317f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f18640098f0 tx=0x7f1864009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a422f313d47ff3b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:40.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.685+0000 7f186dffb700 1 -- 172.21.15.26:0/3617863673 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1864011830 con 0x7f187009f240 2023-10-01T07:55:40.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.685+0000 7f186dffb700 1 -- 172.21.15.26:0/3617863673 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1864011990 con 0x7f187009f240 2023-10-01T07:55:40.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.685+0000 7f186dffb700 1 -- 172.21.15.26:0/3617863673 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1864011d20 con 0x7f187009f240 2023-10-01T07:55:40.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.686+0000 7f1875332700 1 -- 172.21.15.26:0/3617863673 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f187009f240 msgr2=0x7f18701317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:40.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.686+0000 7f1875332700 1 --2- 172.21.15.26:0/3617863673 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f187009f240 0x7f18701317f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f18640098f0 tx=0x7f1864009c00 comp rx=0 tx=0).stop 2023-10-01T07:55:40.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.686+0000 7f1875332700 1 -- 172.21.15.26:0/3617863673 shutdown_connections 2023-10-01T07:55:40.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.686+0000 7f1875332700 1 --2- 172.21.15.26:0/3617863673 >> v2:172.21.15.26:3300/0 conn(0x7f187009e930 0x7f187009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.686+0000 7f1875332700 1 --2- 172.21.15.26:0/3617863673 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f187009f240 0x7f18701317f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.686+0000 7f1875332700 1 -- 172.21.15.26:0/3617863673 >> 172.21.15.26:0/3617863673 conn(0x7f18700a4210 msgr2=0x7f18700a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:40.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.686+0000 7f1875332700 1 -- 172.21.15.26:0/3617863673 shutdown_connections 2023-10-01T07:55:40.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.686+0000 7f1875332700 1 -- 172.21.15.26:0/3617863673 wait complete. 2023-10-01T07:55:40.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.688+0000 7f1875332700 1 Processor -- start 2023-10-01T07:55:40.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.688+0000 7f1875332700 1 -- start start 2023-10-01T07:55:40.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.688+0000 7f1875332700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f187009e930 0x7f18701a3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:40.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.688+0000 7f1875332700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f187009f240 0x7f18701a4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:40.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.688+0000 7f1875332700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f187009f650 0x7f18701a47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:40.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.688+0000 7f1875332700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18701a51d0 con 0x7f187009f650 2023-10-01T07:55:40.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.689+0000 7f1875332700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18701a5930 con 0x7f187009e930 2023-10-01T07:55:40.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.689+0000 7f1875332700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18701a6b80 con 0x7f187009f240 2023-10-01T07:55:40.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.689+0000 7f186e7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f187009f240 0x7f18701a4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:40.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.689+0000 7f186e7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f187009f240 0x7f18701a4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35542/0 (socket says 172.21.15.26:35542) 2023-10-01T07:55:40.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.689+0000 7f186e7fc700 1 -- 172.21.15.26:0/536932679 learned_addr learned my addr 172.21.15.26:0/536932679 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:40.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.689+0000 7f186f7fe700 1 --2- 172.21.15.26:0/536932679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f187009f650 0x7f18701a47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:40.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.689+0000 7f186e7fc700 1 -- 172.21.15.26:0/536932679 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f187009e930 msgr2=0x7f18701a3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:40.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.689+0000 7f186e7fc700 1 --2- 172.21.15.26:0/536932679 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f187009e930 0x7f18701a3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.689+0000 7f186e7fc700 1 -- 172.21.15.26:0/536932679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f187009f650 msgr2=0x7f18701a47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:40.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.689+0000 7f186e7fc700 1 --2- 172.21.15.26:0/536932679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f187009f650 0x7f18701a47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.689+0000 7f186e7fc700 1 -- 172.21.15.26:0/536932679 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1864009550 con 0x7f187009f240 2023-10-01T07:55:40.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.689+0000 7f186e7fc700 1 --2- 172.21.15.26:0/536932679 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f187009f240 0x7f18701a4260 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f187006fbc0 tx=0x7f1864004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:40.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.690+0000 7f18577fe700 1 -- 172.21.15.26:0/536932679 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18640036a0 con 0x7f187009f240 2023-10-01T07:55:40.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.690+0000 7f18577fe700 1 -- 172.21.15.26:0/536932679 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1864003800 con 0x7f187009f240 2023-10-01T07:55:40.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.690+0000 7f18577fe700 1 -- 172.21.15.26:0/536932679 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1864003bb0 con 0x7f187009f240 2023-10-01T07:55:40.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.690+0000 7f1875332700 1 -- 172.21.15.26:0/536932679 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18700a0190 con 0x7f187009f240 2023-10-01T07:55:40.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.690+0000 7f1875332700 1 -- 172.21.15.26:0/536932679 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18701a6fd0 con 0x7f187009f240 2023-10-01T07:55:40.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.691+0000 7f18577fe700 1 -- 172.21.15.26:0/536932679 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1864003d10 con 0x7f187009f240 2023-10-01T07:55:40.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.691+0000 7f18577fe700 1 -- 172.21.15.26:0/536932679 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1864021030 con 0x7f187009f240 2023-10-01T07:55:40.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.691+0000 7f1875332700 1 -- 172.21.15.26:0/536932679 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18700a3620 con 0x7f187009f240 2023-10-01T07:55:40.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.701+0000 7f18577fe700 1 -- 172.21.15.26:0/536932679 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1864015080 con 0x7f187009f240 2023-10-01T07:55:40.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.841+0000 7f80fdb52700 1 -- 172.21.15.26:0/424464171 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f80f8120320 con 0x7f80f8134260 2023-10-01T07:55:40.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.842+0000 7f80dffff700 1 -- 172.21.15.26:0/424464171 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f80f0032090 con 0x7f80f8134260 2023-10-01T07:55:40.842 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:40.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.845+0000 7f80fdb52700 1 -- 172.21.15.26:0/424464171 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f80f8134260 msgr2=0x7f80f809cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:40.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.845+0000 7f80fdb52700 1 --2- 172.21.15.26:0/424464171 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f80f8134260 0x7f80f809cf00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f80f0015000 tx=0x7f80f0004ad0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.845+0000 7f80fdb52700 1 -- 172.21.15.26:0/424464171 shutdown_connections 2023-10-01T07:55:40.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.845+0000 7f80fdb52700 1 --2- 172.21.15.26:0/424464171 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f80f8134260 0x7f80f809cf00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.845+0000 7f80fdb52700 1 --2- 172.21.15.26:0/424464171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80f8133420 0x7f80f809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.845+0000 7f80fdb52700 1 --2- 172.21.15.26:0/424464171 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f80f8133e30 0x7f80f809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.845+0000 7f80fdb52700 1 -- 172.21.15.26:0/424464171 >> 172.21.15.26:0/424464171 conn(0x7f80f80a4210 msgr2=0x7f80f80a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:40.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.846+0000 7f80fdb52700 1 -- 172.21.15.26:0/424464171 shutdown_connections 2023-10-01T07:55:40.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.846+0000 7f80fdb52700 1 -- 172.21.15.26:0/424464171 wait complete. 2023-10-01T07:55:40.860 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:40.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.867+0000 7fc9447ec700 1 -- 172.21.15.26:0/3784124018 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc93c11cd50 con 0x7fc93c09d6f0 2023-10-01T07:55:40.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.868+0000 7fc932ffd700 1 -- 172.21.15.26:0/3784124018 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc938017030 con 0x7fc93c09d6f0 2023-10-01T07:55:40.868 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:40.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.870+0000 7fc9447ec700 1 -- 172.21.15.26:0/3784124018 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc93c09d6f0 msgr2=0x7fc93c1c43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:40.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.870+0000 7fc9447ec700 1 --2- 172.21.15.26:0/3784124018 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc93c09d6f0 0x7fc93c1c43d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc93800c540 tx=0x7fc93800c850 comp rx=0 tx=0).stop 2023-10-01T07:55:40.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.870+0000 7fc9447ec700 1 -- 172.21.15.26:0/3784124018 shutdown_connections 2023-10-01T07:55:40.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.870+0000 7fc9447ec700 1 --2- 172.21.15.26:0/3784124018 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc93c135e50 0x7fc93c119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.870+0000 7fc9447ec700 1 --2- 172.21.15.26:0/3784124018 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc93c09d6f0 0x7fc93c1c43d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.870+0000 7fc9447ec700 1 --2- 172.21.15.26:0/3784124018 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc93c09e1d0 0x7fc93c1c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.870+0000 7fc9447ec700 1 -- 172.21.15.26:0/3784124018 >> 172.21.15.26:0/3784124018 conn(0x7fc93c066f50 msgr2=0x7fc93c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:40.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.870+0000 7fc9447ec700 1 -- 172.21.15.26:0/3784124018 shutdown_connections 2023-10-01T07:55:40.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.870+0000 7fc9447ec700 1 -- 172.21.15.26:0/3784124018 wait complete. 2023-10-01T07:55:40.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.878+0000 7fb37e7fc700 1 -- 172.21.15.26:0/1773200270 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb370005590 con 0x7fb398130260 2023-10-01T07:55:40.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.879+0000 7fb37ffff700 1 -- 172.21.15.26:0/1773200270 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb39001b3a0 con 0x7fb398130260 2023-10-01T07:55:40.879 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:40.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.881+0000 7fb37e7fc700 1 -- 172.21.15.26:0/1773200270 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb398130260 msgr2=0x7fb398138270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:40.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.881+0000 7fb37e7fc700 1 --2- 172.21.15.26:0/1773200270 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb398130260 0x7fb398138270 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb398099c40 tx=0x7fb390004ad0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.881+0000 7fb37e7fc700 1 -- 172.21.15.26:0/1773200270 shutdown_connections 2023-10-01T07:55:40.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.881+0000 7fb37e7fc700 1 --2- 172.21.15.26:0/1773200270 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb398130260 0x7fb398138270 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.881+0000 7fb37e7fc700 1 --2- 172.21.15.26:0/1773200270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb39812cf60 0x7fb3981c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.881+0000 7fb37e7fc700 1 --2- 172.21.15.26:0/1773200270 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb39812f8b0 0x7fb3981c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.881+0000 7fb37e7fc700 1 -- 172.21.15.26:0/1773200270 >> 172.21.15.26:0/1773200270 conn(0x7fb3980a2aa0 msgr2=0x7fb39806e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:40.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.881+0000 7fb37e7fc700 1 -- 172.21.15.26:0/1773200270 shutdown_connections 2023-10-01T07:55:40.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.882+0000 7fb37e7fc700 1 -- 172.21.15.26:0/1773200270 wait complete. 2023-10-01T07:55:40.885 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:40.896 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:40.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.914+0000 7f1875332700 1 -- 172.21.15.26:0/536932679 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f18701a0b30 con 0x7f187009f240 2023-10-01T07:55:40.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.914+0000 7f18577fe700 1 -- 172.21.15.26:0/536932679 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f186402b020 con 0x7f187009f240 2023-10-01T07:55:40.915 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:40.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.916+0000 7f1875332700 1 -- 172.21.15.26:0/536932679 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f187009f240 msgr2=0x7f18701a4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:40.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.916+0000 7f1875332700 1 --2- 172.21.15.26:0/536932679 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f187009f240 0x7f18701a4260 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f187006fbc0 tx=0x7f1864004750 comp rx=0 tx=0).stop 2023-10-01T07:55:40.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.916+0000 7f1875332700 1 -- 172.21.15.26:0/536932679 shutdown_connections 2023-10-01T07:55:40.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.916+0000 7f1875332700 1 --2- 172.21.15.26:0/536932679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f187009f650 0x7f18701a47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.916+0000 7f1875332700 1 --2- 172.21.15.26:0/536932679 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f187009e930 0x7f18701a3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.916+0000 7f1875332700 1 --2- 172.21.15.26:0/536932679 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f187009f240 0x7f18701a4260 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:40.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.916+0000 7f1875332700 1 -- 172.21.15.26:0/536932679 >> 172.21.15.26:0/536932679 conn(0x7f18700a4210 msgr2=0x7f18701b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:40.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.916+0000 7f1875332700 1 -- 172.21.15.26:0/536932679 shutdown_connections 2023-10-01T07:55:40.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:40.916+0000 7f1875332700 1 -- 172.21.15.26:0/536932679 wait complete. 2023-10-01T07:55:40.930 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:41.861 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:41.886 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:41.897 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:41.931 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:42.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.014+0000 7f7512306700 1 Processor -- start 2023-10-01T07:55:42.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.014+0000 7f7512306700 1 -- start start 2023-10-01T07:55:42.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.015+0000 7f7512306700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f750c09eca0 0x7f750c135550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:42.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.015+0000 7f7512306700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f750c135a90 0x7f750c137e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:42.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.015+0000 7f7512306700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f750c070a50 con 0x7f750c130560 2023-10-01T07:55:42.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.015+0000 7f7512306700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f750c0717d0 con 0x7f750c09eca0 2023-10-01T07:55:42.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.015+0000 7f7512306700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f750c130340 con 0x7f750c135a90 2023-10-01T07:55:42.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.016+0000 7f75108a3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f750c135a90 0x7f750c137e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:42.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.016+0000 7f75108a3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f750c135a90 0x7f750c137e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:54156/0 (socket says 172.21.15.26:54156) 2023-10-01T07:55:42.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.016+0000 7f750b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f750c09eca0 0x7f750c135550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:42.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.016+0000 7f75108a3700 1 -- 172.21.15.26:0/311183913 learned_addr learned my addr 172.21.15.26:0/311183913 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:42.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.016+0000 7f75108a3700 1 -- 172.21.15.26:0/311183913 >> v2:172.21.15.26:3300/0 conn(0x7f750c09eca0 msgr2=0x7f750c135550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:42.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.016+0000 7f75108a3700 1 --2- 172.21.15.26:0/311183913 >> v2:172.21.15.26:3300/0 conn(0x7f750c09eca0 0x7f750c135550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.016+0000 7f75108a3700 1 -- 172.21.15.26:0/311183913 >> v1:172.21.15.26:6789/0 conn(0x7f750c130560 legacy=0x7f750c130930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:42.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.016+0000 7f75108a3700 1 -- 172.21.15.26:0/311183913 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750c071060 con 0x7f750c135a90 2023-10-01T07:55:42.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.016+0000 7f75108a3700 1 --2- 172.21.15.26:0/311183913 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f750c135a90 0x7f750c137e70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f750400bef0 tx=0x7f75040093b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aca884a9249b9225 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:42.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.016+0000 7f750affd700 1 -- 172.21.15.26:0/311183913 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750400b4e0 con 0x7f750c135a90 2023-10-01T07:55:42.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.017+0000 7f750affd700 1 -- 172.21.15.26:0/311183913 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750400c950 con 0x7f750c135a90 2023-10-01T07:55:42.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.017+0000 7f750affd700 1 -- 172.21.15.26:0/311183913 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750400cd00 con 0x7f750c135a90 2023-10-01T07:55:42.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.018+0000 7f7512306700 1 -- 172.21.15.26:0/311183913 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f750c135a90 msgr2=0x7f750c137e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:42.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.018+0000 7f7512306700 1 --2- 172.21.15.26:0/311183913 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f750c135a90 0x7f750c137e70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f750400bef0 tx=0x7f75040093b0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.018+0000 7f7512306700 1 -- 172.21.15.26:0/311183913 shutdown_connections 2023-10-01T07:55:42.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.018+0000 7f7512306700 1 --2- 172.21.15.26:0/311183913 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f750c135a90 0x7f750c137e70 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.018+0000 7f7512306700 1 --2- 172.21.15.26:0/311183913 >> v2:172.21.15.26:3300/0 conn(0x7f750c09eca0 0x7f750c135550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.018+0000 7f7512306700 1 -- 172.21.15.26:0/311183913 >> 172.21.15.26:0/311183913 conn(0x7f750c0a2aa0 msgr2=0x7f750c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:42.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.018+0000 7f7512306700 1 -- 172.21.15.26:0/311183913 shutdown_connections 2023-10-01T07:55:42.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.018+0000 7f7512306700 1 -- 172.21.15.26:0/311183913 wait complete. 2023-10-01T07:55:42.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.019+0000 7f7512306700 1 Processor -- start 2023-10-01T07:55:42.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.019+0000 7f7512306700 1 -- start start 2023-10-01T07:55:42.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.020+0000 7f7512306700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f750c09eca0 0x7f750c1c3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:42.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.020+0000 7f7512306700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f750c130560 0x7f750c1c4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:42.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.020+0000 7f7512306700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f750c135a90 0x7f750c1c4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:42.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.020+0000 7f7512306700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750c134480 con 0x7f750c130560 2023-10-01T07:55:42.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.020+0000 7f7512306700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f750c134290 con 0x7f750c09eca0 2023-10-01T07:55:42.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.020+0000 7f7512306700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f750c0a2080 con 0x7f750c135a90 2023-10-01T07:55:42.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.020+0000 7f750bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f750c09eca0 0x7f750c1c3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:42.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.020+0000 7f750b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f750c130560 0x7f750c1c4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:42.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.020+0000 7f750bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f750c09eca0 0x7f750c1c3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:54158/0 (socket says 172.21.15.26:54158) 2023-10-01T07:55:42.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.020+0000 7f750bfff700 1 -- 172.21.15.26:0/94120539 learned_addr learned my addr 172.21.15.26:0/94120539 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:42.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.020+0000 7f75108a3700 1 --2- 172.21.15.26:0/94120539 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f750c135a90 0x7f750c1c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:42.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.020+0000 7f750bfff700 1 -- 172.21.15.26:0/94120539 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f750c135a90 msgr2=0x7f750c1c4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:42.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.020+0000 7f750bfff700 1 --2- 172.21.15.26:0/94120539 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f750c135a90 0x7f750c1c4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.020+0000 7f750bfff700 1 -- 172.21.15.26:0/94120539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f750c130560 msgr2=0x7f750c1c4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:42.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.020+0000 7f750bfff700 1 --2- 172.21.15.26:0/94120539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f750c130560 0x7f750c1c4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.020+0000 7f750bfff700 1 -- 172.21.15.26:0/94120539 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750400bb50 con 0x7f750c09eca0 2023-10-01T07:55:42.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.020+0000 7f75108a3700 1 --2- 172.21.15.26:0/94120539 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f750c135a90 0x7f750c1c4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:55:42.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.020+0000 7f750b7fe700 1 --2- 172.21.15.26:0/94120539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f750c130560 0x7f750c1c4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:42.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.020+0000 7f750bfff700 1 --2- 172.21.15.26:0/94120539 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f750c09eca0 0x7f750c1c3de0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f74fc00c4e0 tx=0x7f74fc00c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:42.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.021+0000 7f7508ff9700 1 -- 172.21.15.26:0/94120539 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc0052d0 con 0x7f750c09eca0 2023-10-01T07:55:42.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.021+0000 7f7508ff9700 1 -- 172.21.15.26:0/94120539 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74fc005430 con 0x7f750c09eca0 2023-10-01T07:55:42.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.021+0000 7f7508ff9700 1 -- 172.21.15.26:0/94120539 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc0038c0 con 0x7f750c09eca0 2023-10-01T07:55:42.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.021+0000 7f7512306700 1 -- 172.21.15.26:0/94120539 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f750c09b400 con 0x7f750c09eca0 2023-10-01T07:55:42.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.021+0000 7f7512306700 1 -- 172.21.15.26:0/94120539 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f750c1348a0 con 0x7f750c09eca0 2023-10-01T07:55:42.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.022+0000 7f7508ff9700 1 -- 172.21.15.26:0/94120539 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f74fc003a20 con 0x7f750c09eca0 2023-10-01T07:55:42.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.022+0000 7f7508ff9700 1 -- 172.21.15.26:0/94120539 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f74fc03e970 con 0x7f750c09eca0 2023-10-01T07:55:42.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.022+0000 7f7512306700 1 -- 172.21.15.26:0/94120539 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f750c1348a0 con 0x7f750c09eca0 2023-10-01T07:55:42.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.031+0000 7f7508ff9700 1 -- 172.21.15.26:0/94120539 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f750c1348a0 con 0x7f750c09eca0 2023-10-01T07:55:42.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.056+0000 7f2dfc435700 1 Processor -- start 2023-10-01T07:55:42.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.057+0000 7f2dfc435700 1 -- start start 2023-10-01T07:55:42.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.057+0000 7f2dfc435700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2df409d6f0 0x7f2df409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:42.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.057+0000 7f2dfc435700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2df409e000 0x7f2df4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:42.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.057+0000 7f2dfc435700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df409f130 con 0x7f2df409e410 2023-10-01T07:55:42.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.057+0000 7f2dfc435700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df409f520 con 0x7f2df409d6f0 2023-10-01T07:55:42.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.057+0000 7f2dfc435700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2df409e930 con 0x7f2df409e000 2023-10-01T07:55:42.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.057+0000 7f2dfa1d1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2df409d6f0 0x7f2df409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:42.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.057+0000 7f2dfa1d1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2df409d6f0 0x7f2df409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50512/0 (socket says 172.21.15.26:50512) 2023-10-01T07:55:42.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.057+0000 7f2dfa1d1700 1 -- 172.21.15.26:0/1961974205 learned_addr learned my addr 172.21.15.26:0/1961974205 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:42.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.058+0000 7f2df99d0700 1 --2- 172.21.15.26:0/1961974205 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2df409e000 0x7f2df4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:42.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.058+0000 7f2dfa1d1700 1 -- 172.21.15.26:0/1961974205 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2df409e000 msgr2=0x7f2df4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:42.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.058+0000 7f2dfa1d1700 1 --2- 172.21.15.26:0/1961974205 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2df409e000 0x7f2df4130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.058+0000 7f2dfa1d1700 1 -- 172.21.15.26:0/1961974205 >> v1:172.21.15.26:6789/0 conn(0x7f2df409e410 legacy=0x7f2df4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:42.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.058+0000 7f2dfa1d1700 1 -- 172.21.15.26:0/1961974205 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df409b2d0 con 0x7f2df409d6f0 2023-10-01T07:55:42.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.058+0000 7f2dfa1d1700 1 --2- 172.21.15.26:0/1961974205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2df409d6f0 0x7f2df409dac0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2df000bb90 tx=0x7f2df000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76b6794eb0d43fda server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:42.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.058+0000 7f2df91cf700 1 -- 172.21.15.26:0/1961974205 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df000dd30 con 0x7f2df409d6f0 2023-10-01T07:55:42.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.058+0000 7f2df91cf700 1 -- 172.21.15.26:0/1961974205 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df000de90 con 0x7f2df409d6f0 2023-10-01T07:55:42.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.058+0000 7f2df91cf700 1 -- 172.21.15.26:0/1961974205 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df0010690 con 0x7f2df409d6f0 2023-10-01T07:55:42.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.059+0000 7f2dfc435700 1 -- 172.21.15.26:0/1961974205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2df409d6f0 msgr2=0x7f2df409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:42.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.059+0000 7f2dfc435700 1 --2- 172.21.15.26:0/1961974205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2df409d6f0 0x7f2df409dac0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2df000bb90 tx=0x7f2df000bea0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.059+0000 7f2dfc435700 1 -- 172.21.15.26:0/1961974205 shutdown_connections 2023-10-01T07:55:42.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.059+0000 7f2dfc435700 1 --2- 172.21.15.26:0/1961974205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2df409d6f0 0x7f2df409dac0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.059+0000 7f2dfc435700 1 --2- 172.21.15.26:0/1961974205 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2df409e000 0x7f2df4130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.059+0000 7f2dfc435700 1 -- 172.21.15.26:0/1961974205 >> 172.21.15.26:0/1961974205 conn(0x7f2df4066f50 msgr2=0x7f2df409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:42.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.059+0000 7f2dfc435700 1 -- 172.21.15.26:0/1961974205 shutdown_connections 2023-10-01T07:55:42.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.060+0000 7f2dfc435700 1 -- 172.21.15.26:0/1961974205 wait complete. 2023-10-01T07:55:42.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.060+0000 7f2dfc435700 1 Processor -- start 2023-10-01T07:55:42.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.061+0000 7f2dfc435700 1 -- start start 2023-10-01T07:55:42.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.061+0000 7f2dfc435700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2df409d6f0 0x7f2df411dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:42.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.061+0000 7f2dfc435700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2df409e000 0x7f2df411e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:42.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.061+0000 7f2dfc435700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2df409e410 0x7f2df411ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:42.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.061+0000 7f2dfc435700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df411f450 con 0x7f2df409e410 2023-10-01T07:55:42.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.061+0000 7f2dfc435700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df4130390 con 0x7f2df409e000 2023-10-01T07:55:42.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.061+0000 7f2dfc435700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2df409c700 con 0x7f2df409d6f0 2023-10-01T07:55:42.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.061+0000 7f2dfa9d2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2df409e410 0x7f2df411ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:42.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.061+0000 7f2dfa9d2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2df409e410 0x7f2df411ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50516/0 (socket says 172.21.15.26:50516) 2023-10-01T07:55:42.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.061+0000 7f2dfa9d2700 1 -- 172.21.15.26:0/2234571004 learned_addr learned my addr 172.21.15.26:0/2234571004 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:42.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.061+0000 7f2df99d0700 1 --2- 172.21.15.26:0/2234571004 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2df409e000 0x7f2df411e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:42.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.062+0000 7f2dfa1d1700 1 --2- 172.21.15.26:0/2234571004 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2df409d6f0 0x7f2df411dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:42.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.062+0000 7f2dfa9d2700 1 -- 172.21.15.26:0/2234571004 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2df409d6f0 msgr2=0x7f2df411dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:42.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.062+0000 7f2dfa9d2700 1 --2- 172.21.15.26:0/2234571004 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2df409d6f0 0x7f2df411dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.062+0000 7f2dfa9d2700 1 -- 172.21.15.26:0/2234571004 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2df409e000 msgr2=0x7f2df411e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:42.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.062+0000 7f2dfa9d2700 1 --2- 172.21.15.26:0/2234571004 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2df409e000 0x7f2df411e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.062+0000 7f2dfa9d2700 1 -- 172.21.15.26:0/2234571004 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df000b7f0 con 0x7f2df409e410 2023-10-01T07:55:42.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.062+0000 7f2df99d0700 1 --2- 172.21.15.26:0/2234571004 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2df409e000 0x7f2df411e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:55:42.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.062+0000 7f2dfa1d1700 1 --2- 172.21.15.26:0/2234571004 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2df409d6f0 0x7f2df411dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:55:42.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.062+0000 7f2dfa9d2700 1 --2- 172.21.15.26:0/2234571004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2df409e410 0x7f2df411ea70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2dec00cc50 tx=0x7f2dec00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:42.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.062+0000 7f2deaffd700 1 -- 172.21.15.26:0/2234571004 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec00ad80 con 0x7f2df409e410 2023-10-01T07:55:42.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.062+0000 7f2deaffd700 1 -- 172.21.15.26:0/2234571004 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dec00ce50 con 0x7f2df409e410 2023-10-01T07:55:42.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.062+0000 7f2dfc435700 1 -- 172.21.15.26:0/2234571004 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df41217f0 con 0x7f2df409e410 2023-10-01T07:55:42.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.062+0000 7f2deaffd700 1 -- 172.21.15.26:0/2234571004 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec003c40 con 0x7f2df409e410 2023-10-01T07:55:42.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.062+0000 7f2dfc435700 1 -- 172.21.15.26:0/2234571004 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df4121260 con 0x7f2df409e410 2023-10-01T07:55:42.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.063+0000 7f2deaffd700 1 -- 172.21.15.26:0/2234571004 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2dec0050d0 con 0x7f2df409e410 2023-10-01T07:55:42.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.063+0000 7efc9f85b700 1 Processor -- start 2023-10-01T07:55:42.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.063+0000 7f2dfc435700 1 -- 172.21.15.26:0/2234571004 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df4074ea0 con 0x7f2df409e410 2023-10-01T07:55:42.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.063+0000 7f2deaffd700 1 -- 172.21.15.26:0/2234571004 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2dec03f8d0 con 0x7f2df409e410 2023-10-01T07:55:42.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.065+0000 7efc9f85b700 1 -- start start 2023-10-01T07:55:42.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.066+0000 7efc9f85b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc980a1510 0x7efc98138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:42.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.066+0000 7efc9f85b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efc98139250 0x7efc9813b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:42.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.066+0000 7efc9f85b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9809edd0 con 0x7efc980a0a30 2023-10-01T07:55:42.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.066+0000 7efc9f85b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc980a18e0 con 0x7efc98139250 2023-10-01T07:55:42.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.066+0000 7efc9f85b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc9809e1f0 con 0x7efc980a1510 2023-10-01T07:55:42.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.066+0000 7efc9ddf8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efc98139250 0x7efc9813b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:42.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.066+0000 7efc9d5f7700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7efc980a0a30 0x7efc980a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52352/0 (socket says 172.21.15.26:52352) 2023-10-01T07:55:42.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.066+0000 7efc9d5f7700 1 -- 172.21.15.26:0/2277424991 learned_addr learned my addr 172.21.15.26:0/2277424991 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:42.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.066+0000 7efc9ddf8700 1 -- 172.21.15.26:0/2277424991 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc980a1510 msgr2=0x7efc98138d10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-01T07:55:42.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.066+0000 7efc9ddf8700 1 --2- 172.21.15.26:0/2277424991 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc980a1510 0x7efc98138d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.066+0000 7efc9ddf8700 1 -- 172.21.15.26:0/2277424991 >> v1:172.21.15.26:6789/0 conn(0x7efc980a0a30 legacy=0x7efc980a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:42.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.066+0000 7efc9ddf8700 1 -- 172.21.15.26:0/2277424991 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9809dc50 con 0x7efc98139250 2023-10-01T07:55:42.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.066+0000 7efc9ddf8700 1 --2- 172.21.15.26:0/2277424991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc98139250 0x7efc9813b630 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7efc90009dc0 tx=0x7efc9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c41905cd7d54ae server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:42.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.070+0000 7f2deaffd700 1 -- 172.21.15.26:0/2234571004 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2dec039020 con 0x7f2df409e410 2023-10-01T07:55:42.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.070+0000 7efc8ffff700 1 -- 172.21.15.26:0/2277424991 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9000e070 con 0x7efc98139250 2023-10-01T07:55:42.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.070+0000 7efc8ffff700 1 -- 172.21.15.26:0/2277424991 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9000bb90 con 0x7efc98139250 2023-10-01T07:55:42.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.070+0000 7efc8ffff700 1 -- 172.21.15.26:0/2277424991 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc90012430 con 0x7efc98139250 2023-10-01T07:55:42.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.070+0000 7efc9f85b700 1 -- 172.21.15.26:0/2277424991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc98139250 msgr2=0x7efc9813b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:42.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.070+0000 7efc9f85b700 1 --2- 172.21.15.26:0/2277424991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc98139250 0x7efc9813b630 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7efc90009dc0 tx=0x7efc9000b330 comp rx=0 tx=0).stop 2023-10-01T07:55:42.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.071+0000 7efc9f85b700 1 -- 172.21.15.26:0/2277424991 shutdown_connections 2023-10-01T07:55:42.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.071+0000 7efc9f85b700 1 --2- 172.21.15.26:0/2277424991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc98139250 0x7efc9813b630 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.071+0000 7efc9f85b700 1 --2- 172.21.15.26:0/2277424991 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc980a1510 0x7efc98138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.071+0000 7efc9f85b700 1 -- 172.21.15.26:0/2277424991 >> 172.21.15.26:0/2277424991 conn(0x7efc980a6550 msgr2=0x7efc980a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:42.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.072+0000 7efc9f85b700 1 -- 172.21.15.26:0/2277424991 shutdown_connections 2023-10-01T07:55:42.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.072+0000 7efc9f85b700 1 -- 172.21.15.26:0/2277424991 wait complete. 2023-10-01T07:55:42.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.073+0000 7efc9f85b700 1 Processor -- start 2023-10-01T07:55:42.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.073+0000 7efc9f85b700 1 -- start start 2023-10-01T07:55:42.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.074+0000 7efc9f85b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efc980a0a30 0x7efc981c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:42.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.074+0000 7efc9f85b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc980a1510 0x7efc981c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:42.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.074+0000 7efc9f85b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc98139250 0x7efc981c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:42.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.074+0000 7efc9f85b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc98138b60 con 0x7efc98139250 2023-10-01T07:55:42.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.074+0000 7efc9f85b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc98123630 con 0x7efc980a0a30 2023-10-01T07:55:42.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.074+0000 7efc9f85b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc98124e90 con 0x7efc980a1510 2023-10-01T07:55:42.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.074+0000 7efc9ddf8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc98139250 0x7efc981c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:42.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.074+0000 7efc9ddf8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc98139250 0x7efc981c8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50538/0 (socket says 172.21.15.26:50538) 2023-10-01T07:55:42.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.074+0000 7efc9ddf8700 1 -- 172.21.15.26:0/3266539827 learned_addr learned my addr 172.21.15.26:0/3266539827 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:42.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.074+0000 7efc9d5f7700 1 --2- 172.21.15.26:0/3266539827 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efc980a0a30 0x7efc981c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:42.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.074+0000 7efc9cdf6700 1 --2- 172.21.15.26:0/3266539827 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc980a1510 0x7efc981c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:42.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.074+0000 7efc9ddf8700 1 -- 172.21.15.26:0/3266539827 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc980a1510 msgr2=0x7efc981c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:42.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.074+0000 7efc9ddf8700 1 --2- 172.21.15.26:0/3266539827 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc980a1510 0x7efc981c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.074+0000 7efc9ddf8700 1 -- 172.21.15.26:0/3266539827 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efc980a0a30 msgr2=0x7efc981c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:42.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.074+0000 7efc9ddf8700 1 --2- 172.21.15.26:0/3266539827 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efc980a0a30 0x7efc981c8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.075+0000 7efc9ddf8700 1 -- 172.21.15.26:0/3266539827 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc90009a70 con 0x7efc98139250 2023-10-01T07:55:42.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.075+0000 7efc9ddf8700 1 --2- 172.21.15.26:0/3266539827 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc98139250 0x7efc981c8ec0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7efc90014040 tx=0x7efc90004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:42.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.075+0000 7efc8dffb700 1 -- 172.21.15.26:0/3266539827 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc90012430 con 0x7efc98139250 2023-10-01T07:55:42.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.075+0000 7efc8dffb700 1 -- 172.21.15.26:0/3266539827 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc90020070 con 0x7efc98139250 2023-10-01T07:55:42.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.075+0000 7efc8dffb700 1 -- 172.21.15.26:0/3266539827 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc90004040 con 0x7efc98139250 2023-10-01T07:55:42.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.075+0000 7efc9f85b700 1 -- 172.21.15.26:0/3266539827 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc98125150 con 0x7efc98139250 2023-10-01T07:55:42.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.075+0000 7efc9f85b700 1 -- 172.21.15.26:0/3266539827 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc98123a70 con 0x7efc98139250 2023-10-01T07:55:42.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.076+0000 7efc8dffb700 1 -- 172.21.15.26:0/3266539827 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efc900041c0 con 0x7efc98139250 2023-10-01T07:55:42.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.076+0000 7efc8dffb700 1 -- 172.21.15.26:0/3266539827 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efc90022070 con 0x7efc98139250 2023-10-01T07:55:42.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.077+0000 7efc9f85b700 1 -- 172.21.15.26:0/3266539827 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc98074ea0 con 0x7efc98139250 2023-10-01T07:55:42.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.082+0000 7efc8dffb700 1 -- 172.21.15.26:0/3266539827 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efc9002c020 con 0x7efc98139250 2023-10-01T07:55:42.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.131+0000 7fc0e8363700 1 Processor -- start 2023-10-01T07:55:42.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.131+0000 7fc0e8363700 1 -- start start 2023-10-01T07:55:42.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.132+0000 7fc0e8363700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0e009d630 0x7fc0e00a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:42.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.132+0000 7fc0e8363700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc0e0138d80 0x7fc0e013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:42.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.132+0000 7fc0e8363700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0e00a2a70 con 0x7fc0e00a0a30 2023-10-01T07:55:42.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.132+0000 7fc0e8363700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0e00a01d0 con 0x7fc0e0138d80 2023-10-01T07:55:42.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.132+0000 7fc0e8363700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e009e2b0 con 0x7fc0e009d630 2023-10-01T07:55:42.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.132+0000 7fc0e60ff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc0e00a0a30 0x7fc0e00a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:52356/0 (socket says 172.21.15.26:52356) 2023-10-01T07:55:42.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.132+0000 7fc0e60ff700 1 -- 172.21.15.26:0/2834585648 learned_addr learned my addr 172.21.15.26:0/2834585648 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:42.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.132+0000 7fc0e58fe700 1 --2- 172.21.15.26:0/2834585648 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0e009d630 0x7fc0e00a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:42.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.132+0000 7fc0e6900700 1 --2- 172.21.15.26:0/2834585648 >> v2:172.21.15.26:3300/0 conn(0x7fc0e0138d80 0x7fc0e013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:42.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.132+0000 7fc0e50fd700 1 -- 172.21.15.26:0/2834585648 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2388166187 0 0) 0x7fc0e00a2a70 con 0x7fc0e00a0a30 2023-10-01T07:55:42.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.132+0000 7fc0e50fd700 1 -- 172.21.15.26:0/2834585648 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0cc0035b0 con 0x7fc0e00a0a30 2023-10-01T07:55:42.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.132+0000 7fc0e58fe700 1 -- 172.21.15.26:0/2834585648 >> v2:172.21.15.26:3300/0 conn(0x7fc0e0138d80 msgr2=0x7fc0e013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:42.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.132+0000 7fc0e58fe700 1 --2- 172.21.15.26:0/2834585648 >> v2:172.21.15.26:3300/0 conn(0x7fc0e0138d80 0x7fc0e013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.132+0000 7fc0e58fe700 1 -- 172.21.15.26:0/2834585648 >> v1:172.21.15.26:6789/0 conn(0x7fc0e00a0a30 legacy=0x7fc0e00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:42.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.133+0000 7fc0e58fe700 1 -- 172.21.15.26:0/2834585648 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e009dc50 con 0x7fc0e009d630 2023-10-01T07:55:42.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.133+0000 7fc0e58fe700 1 --2- 172.21.15.26:0/2834585648 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0e009d630 0x7fc0e00a1510 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0009840 tx=0x7fc0d0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1259c6183e52210f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:42.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.133+0000 7fc0e50fd700 1 -- 172.21.15.26:0/2834585648 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d0011830 con 0x7fc0e009d630 2023-10-01T07:55:42.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.133+0000 7fc0e50fd700 1 -- 172.21.15.26:0/2834585648 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d0011990 con 0x7fc0e009d630 2023-10-01T07:55:42.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.133+0000 7fc0e50fd700 1 -- 172.21.15.26:0/2834585648 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d0011d20 con 0x7fc0e009d630 2023-10-01T07:55:42.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.134+0000 7fc0e8363700 1 -- 172.21.15.26:0/2834585648 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0e009d630 msgr2=0x7fc0e00a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:42.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.134+0000 7fc0e8363700 1 --2- 172.21.15.26:0/2834585648 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0e009d630 0x7fc0e00a1510 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0009840 tx=0x7fc0d0009b50 comp rx=0 tx=0).stop 2023-10-01T07:55:42.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.134+0000 7fc0e8363700 1 -- 172.21.15.26:0/2834585648 shutdown_connections 2023-10-01T07:55:42.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.134+0000 7fc0e8363700 1 --2- 172.21.15.26:0/2834585648 >> v2:172.21.15.26:3300/0 conn(0x7fc0e0138d80 0x7fc0e013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.134+0000 7fc0e8363700 1 --2- 172.21.15.26:0/2834585648 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0e009d630 0x7fc0e00a1510 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.134+0000 7fc0e8363700 1 -- 172.21.15.26:0/2834585648 >> 172.21.15.26:0/2834585648 conn(0x7fc0e00a3050 msgr2=0x7fc0e00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:42.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.134+0000 7fc0e8363700 1 -- 172.21.15.26:0/2834585648 shutdown_connections 2023-10-01T07:55:42.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.134+0000 7fc0e8363700 1 -- 172.21.15.26:0/2834585648 wait complete. 2023-10-01T07:55:42.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.135+0000 7fc0e8363700 1 Processor -- start 2023-10-01T07:55:42.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.135+0000 7fc0e8363700 1 -- start start 2023-10-01T07:55:42.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.135+0000 7fc0e8363700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0e009d630 0x7fc0e01337e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:42.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.135+0000 7fc0e8363700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc0e00a0a30 0x7fc0e0133d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:42.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.135+0000 7fc0e8363700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0e0138d80 0x7fc0e0134260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:42.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.135+0000 7fc0e8363700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e0136580 con 0x7fc0e009d630 2023-10-01T07:55:42.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.135+0000 7fc0e8363700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e0136ef0 con 0x7fc0e0138d80 2023-10-01T07:55:42.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.135+0000 7fc0e8363700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e01361d0 con 0x7fc0e00a0a30 2023-10-01T07:55:42.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.136+0000 7fc0e58fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc0e00a0a30 0x7fc0e0133d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:42.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.136+0000 7fc0e58fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc0e00a0a30 0x7fc0e0133d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35576/0 (socket says 172.21.15.26:35576) 2023-10-01T07:55:42.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.136+0000 7fc0e58fe700 1 -- 172.21.15.26:0/575488107 learned_addr learned my addr 172.21.15.26:0/575488107 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:42.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.136+0000 7fc0e6900700 1 --2- 172.21.15.26:0/575488107 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0e0138d80 0x7fc0e0134260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:42.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.136+0000 7fc0e60ff700 1 --2- 172.21.15.26:0/575488107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0e009d630 0x7fc0e01337e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:42.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.136+0000 7fc0e58fe700 1 -- 172.21.15.26:0/575488107 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0e0138d80 msgr2=0x7fc0e0134260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:42.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.136+0000 7fc0e58fe700 1 --2- 172.21.15.26:0/575488107 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0e0138d80 0x7fc0e0134260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.136+0000 7fc0e58fe700 1 -- 172.21.15.26:0/575488107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0e009d630 msgr2=0x7fc0e01337e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:42.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.136+0000 7fc0e58fe700 1 --2- 172.21.15.26:0/575488107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0e009d630 0x7fc0e01337e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.136+0000 7fc0e58fe700 1 -- 172.21.15.26:0/575488107 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d00094a0 con 0x7fc0e00a0a30 2023-10-01T07:55:42.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.136+0000 7fc0e58fe700 1 --2- 172.21.15.26:0/575488107 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc0e00a0a30 0x7fc0e0133d20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0000c00 tx=0x7fc0d0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:42.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.136+0000 7fc0d6ffd700 1 -- 172.21.15.26:0/575488107 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d0004380 con 0x7fc0e00a0a30 2023-10-01T07:55:42.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.136+0000 7fc0d6ffd700 1 -- 172.21.15.26:0/575488107 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d001f070 con 0x7fc0e00a0a30 2023-10-01T07:55:42.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.136+0000 7fc0d6ffd700 1 -- 172.21.15.26:0/575488107 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d00036a0 con 0x7fc0e00a0a30 2023-10-01T07:55:42.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.137+0000 7fc0e8363700 1 -- 172.21.15.26:0/575488107 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0e013ab90 con 0x7fc0e00a0a30 2023-10-01T07:55:42.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.137+0000 7fc0e8363700 1 -- 172.21.15.26:0/575488107 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0e00a0470 con 0x7fc0e00a0a30 2023-10-01T07:55:42.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.138+0000 7fc0d6ffd700 1 -- 172.21.15.26:0/575488107 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc0d0021030 con 0x7fc0e00a0a30 2023-10-01T07:55:42.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.138+0000 7fc0d6ffd700 1 -- 172.21.15.26:0/575488107 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc0d0040950 con 0x7fc0e00a0a30 2023-10-01T07:55:42.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.139+0000 7fc0d4ff9700 1 -- 172.21.15.26:0/575488107 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0bc0052e0 con 0x7fc0e00a0a30 2023-10-01T07:55:42.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.144+0000 7fc0d6ffd700 1 -- 172.21.15.26:0/575488107 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc0d00199a0 con 0x7fc0e00a0a30 2023-10-01T07:55:42.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.286+0000 7f7512306700 1 -- 172.21.15.26:0/94120539 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f750c1348a0 con 0x7f750c09eca0 2023-10-01T07:55:42.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.286+0000 7f7508ff9700 1 -- 172.21.15.26:0/94120539 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f750c1348a0 con 0x7f750c09eca0 2023-10-01T07:55:42.288 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:42.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.288+0000 7f7512306700 1 -- 172.21.15.26:0/94120539 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f750c09eca0 msgr2=0x7f750c1c3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:42.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.288+0000 7f7512306700 1 --2- 172.21.15.26:0/94120539 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f750c09eca0 0x7f750c1c3de0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f74fc00c4e0 tx=0x7f74fc00c7f0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.288+0000 7f7512306700 1 -- 172.21.15.26:0/94120539 shutdown_connections 2023-10-01T07:55:42.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.288+0000 7f7512306700 1 --2- 172.21.15.26:0/94120539 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f750c135a90 0x7f750c1c4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.288+0000 7f7512306700 1 --2- 172.21.15.26:0/94120539 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f750c09eca0 0x7f750c1c3de0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.288+0000 7f7512306700 1 --2- 172.21.15.26:0/94120539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f750c130560 0x7f750c1c4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.288+0000 7f7512306700 1 -- 172.21.15.26:0/94120539 >> 172.21.15.26:0/94120539 conn(0x7f750c0a2aa0 msgr2=0x7f750c12aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:42.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.289+0000 7f7512306700 1 -- 172.21.15.26:0/94120539 shutdown_connections 2023-10-01T07:55:42.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.289+0000 7f7512306700 1 -- 172.21.15.26:0/94120539 wait complete. 2023-10-01T07:55:42.303 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:42.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.333+0000 7f2dfc435700 1 -- 172.21.15.26:0/2234571004 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2df406c360 con 0x7f2df409e410 2023-10-01T07:55:42.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.334+0000 7f2deaffd700 1 -- 172.21.15.26:0/2234571004 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2dec005380 con 0x7f2df409e410 2023-10-01T07:55:42.334 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:42.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.336+0000 7f2dfc435700 1 -- 172.21.15.26:0/2234571004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2df409e410 msgr2=0x7f2df411ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:42.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.336+0000 7f2dfc435700 1 --2- 172.21.15.26:0/2234571004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2df409e410 0x7f2df411ea70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2dec00cc50 tx=0x7f2dec00a340 comp rx=0 tx=0).stop 2023-10-01T07:55:42.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.336+0000 7f2dfc435700 1 -- 172.21.15.26:0/2234571004 shutdown_connections 2023-10-01T07:55:42.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.336+0000 7f2dfc435700 1 --2- 172.21.15.26:0/2234571004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2df409e410 0x7f2df411ea70 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.336+0000 7f2dfc435700 1 --2- 172.21.15.26:0/2234571004 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2df409d6f0 0x7f2df411dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.336+0000 7f2dfc435700 1 --2- 172.21.15.26:0/2234571004 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2df409e000 0x7f2df411e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.336+0000 7f2dfc435700 1 -- 172.21.15.26:0/2234571004 >> 172.21.15.26:0/2234571004 conn(0x7f2df4066f50 msgr2=0x7f2df406f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:42.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.337+0000 7f2dfc435700 1 -- 172.21.15.26:0/2234571004 shutdown_connections 2023-10-01T07:55:42.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.341+0000 7f2dfc435700 1 -- 172.21.15.26:0/2234571004 wait complete. 2023-10-01T07:55:42.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.347+0000 7efc9f85b700 1 -- 172.21.15.26:0/3266539827 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efc980a0220 con 0x7efc98139250 2023-10-01T07:55:42.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.347+0000 7efc8dffb700 1 -- 172.21.15.26:0/3266539827 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efc90011750 con 0x7efc98139250 2023-10-01T07:55:42.348 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:42.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.350+0000 7efc9f85b700 1 -- 172.21.15.26:0/3266539827 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc98139250 msgr2=0x7efc981c8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:42.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.350+0000 7efc9f85b700 1 --2- 172.21.15.26:0/3266539827 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc98139250 0x7efc981c8ec0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7efc90014040 tx=0x7efc90004ad0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.350+0000 7efc9f85b700 1 -- 172.21.15.26:0/3266539827 shutdown_connections 2023-10-01T07:55:42.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.350+0000 7efc9f85b700 1 --2- 172.21.15.26:0/3266539827 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc98139250 0x7efc981c8ec0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.350+0000 7efc9f85b700 1 --2- 172.21.15.26:0/3266539827 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efc980a0a30 0x7efc981c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.350+0000 7efc9f85b700 1 --2- 172.21.15.26:0/3266539827 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc980a1510 0x7efc981c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.350+0000 7efc9f85b700 1 -- 172.21.15.26:0/3266539827 >> 172.21.15.26:0/3266539827 conn(0x7efc980a6550 msgr2=0x7efc98137b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:42.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.350+0000 7efc9f85b700 1 -- 172.21.15.26:0/3266539827 shutdown_connections 2023-10-01T07:55:42.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.350+0000 7efc9f85b700 1 -- 172.21.15.26:0/3266539827 wait complete. 2023-10-01T07:55:42.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.352+0000 7fc0d4ff9700 1 -- 172.21.15.26:0/575488107 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc0bc005590 con 0x7fc0e00a0a30 2023-10-01T07:55:42.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.353+0000 7fc0d6ffd700 1 -- 172.21.15.26:0/575488107 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc0d0015020 con 0x7fc0e00a0a30 2023-10-01T07:55:42.353 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:42.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.355+0000 7fc0d4ff9700 1 -- 172.21.15.26:0/575488107 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc0e00a0a30 msgr2=0x7fc0e0133d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:42.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.355+0000 7fc0d4ff9700 1 --2- 172.21.15.26:0/575488107 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc0e00a0a30 0x7fc0e0133d20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0000c00 tx=0x7fc0d0004750 comp rx=0 tx=0).stop 2023-10-01T07:55:42.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.355+0000 7fc0d4ff9700 1 -- 172.21.15.26:0/575488107 shutdown_connections 2023-10-01T07:55:42.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.355+0000 7fc0d4ff9700 1 --2- 172.21.15.26:0/575488107 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0e0138d80 0x7fc0e0134260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.355+0000 7fc0d4ff9700 1 --2- 172.21.15.26:0/575488107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0e009d630 0x7fc0e01337e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.355+0000 7fc0d4ff9700 1 --2- 172.21.15.26:0/575488107 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc0e00a0a30 0x7fc0e0133d20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:42.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.355+0000 7fc0d4ff9700 1 -- 172.21.15.26:0/575488107 >> 172.21.15.26:0/575488107 conn(0x7fc0e00a3050 msgr2=0x7fc0e009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:42.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.355+0000 7fc0d4ff9700 1 -- 172.21.15.26:0/575488107 shutdown_connections 2023-10-01T07:55:42.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:42.355+0000 7fc0d4ff9700 1 -- 172.21.15.26:0/575488107 wait complete. 2023-10-01T07:55:42.357 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:42.367 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:42.370 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:43.305 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:43.358 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:43.368 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:43.370 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:43.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.467+0000 7fcb7cf77700 1 Processor -- start 2023-10-01T07:55:43.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.468+0000 7fcb7cf77700 1 -- start start 2023-10-01T07:55:43.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.468+0000 7fcb7cf77700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb7809d6f0 0x7fcb7809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:43.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.468+0000 7fcb7cf77700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb7809e410 0x7fcb78130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:43.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.468+0000 7fcb7cf77700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb7809f130 con 0x7fcb7809e000 2023-10-01T07:55:43.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.468+0000 7fcb7cf77700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7809f520 con 0x7fcb7809e410 2023-10-01T07:55:43.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.468+0000 7fcb7cf77700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7809e930 con 0x7fcb7809d6f0 2023-10-01T07:55:43.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.469+0000 7fcb7659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb7809d6f0 0x7fcb7809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:43.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.469+0000 7fcb7659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb7809d6f0 0x7fcb7809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37904/0 (socket says 172.21.15.26:37904) 2023-10-01T07:55:43.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.469+0000 7fcb7659c700 1 -- 172.21.15.26:0/216933708 learned_addr learned my addr 172.21.15.26:0/216933708 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:43.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.469+0000 7fcb76d9d700 1 --2- 172.21.15.26:0/216933708 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb7809e410 0x7fcb78130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:43.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.469+0000 7fcb75d9b700 1 -- 172.21.15.26:0/216933708 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2141835323 0 0) 0x7fcb7809f130 con 0x7fcb7809e000 2023-10-01T07:55:43.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.469+0000 7fcb75d9b700 1 -- 172.21.15.26:0/216933708 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb640035b0 con 0x7fcb7809e000 2023-10-01T07:55:43.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.469+0000 7fcb76d9d700 1 -- 172.21.15.26:0/216933708 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb7809d6f0 msgr2=0x7fcb7809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:43.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.469+0000 7fcb76d9d700 1 --2- 172.21.15.26:0/216933708 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb7809d6f0 0x7fcb7809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:43.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.469+0000 7fcb76d9d700 1 -- 172.21.15.26:0/216933708 >> v1:172.21.15.26:6789/0 conn(0x7fcb7809e000 legacy=0x7fcb78130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:43.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.469+0000 7fcb76d9d700 1 -- 172.21.15.26:0/216933708 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7809b2d0 con 0x7fcb7809e410 2023-10-01T07:55:43.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.469+0000 7fcb76d9d700 1 --2- 172.21.15.26:0/216933708 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb7809e410 0x7fcb78130d70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcb7000bfd0 tx=0x7fcb7000d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7ba50819310e74b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:43.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.470+0000 7fcb75d9b700 1 -- 172.21.15.26:0/216933708 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb70010070 con 0x7fcb7809e410 2023-10-01T07:55:43.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.470+0000 7fcb75d9b700 1 -- 172.21.15.26:0/216933708 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7000b2e0 con 0x7fcb7809e410 2023-10-01T07:55:43.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.470+0000 7fcb75d9b700 1 -- 172.21.15.26:0/216933708 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7000dc70 con 0x7fcb7809e410 2023-10-01T07:55:43.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.471+0000 7fcb7cf77700 1 -- 172.21.15.26:0/216933708 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb7809e410 msgr2=0x7fcb78130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:43.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.471+0000 7fcb7cf77700 1 --2- 172.21.15.26:0/216933708 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb7809e410 0x7fcb78130d70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcb7000bfd0 tx=0x7fcb7000d330 comp rx=0 tx=0).stop 2023-10-01T07:55:43.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.471+0000 7fcb7cf77700 1 -- 172.21.15.26:0/216933708 shutdown_connections 2023-10-01T07:55:43.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.471+0000 7fcb7cf77700 1 --2- 172.21.15.26:0/216933708 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb7809d6f0 0x7fcb7809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:43.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.471+0000 7fcb7cf77700 1 --2- 172.21.15.26:0/216933708 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb7809e410 0x7fcb78130d70 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:43.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.471+0000 7fcb7cf77700 1 -- 172.21.15.26:0/216933708 >> 172.21.15.26:0/216933708 conn(0x7fcb78066f50 msgr2=0x7fcb7809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:43.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.471+0000 7fcb7cf77700 1 -- 172.21.15.26:0/216933708 shutdown_connections 2023-10-01T07:55:43.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.471+0000 7fcb7cf77700 1 -- 172.21.15.26:0/216933708 wait complete. 2023-10-01T07:55:43.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.472+0000 7fcb7cf77700 1 Processor -- start 2023-10-01T07:55:43.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.472+0000 7fcb7cf77700 1 -- start start 2023-10-01T07:55:43.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.473+0000 7fcb7cf77700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb7809d6f0 0x7fcb7811df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:43.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.473+0000 7fcb7cf77700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb7809e000 0x7fcb7811e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:43.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.473+0000 7fcb7cf77700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb7809e410 0x7fcb7811e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:43.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.473+0000 7fcb7cf77700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7811f3f0 con 0x7fcb7809e410 2023-10-01T07:55:43.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.473+0000 7fcb7cf77700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb78130300 con 0x7fcb7809e000 2023-10-01T07:55:43.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.473+0000 7fcb7cf77700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb78120d80 con 0x7fcb7809d6f0 2023-10-01T07:55:43.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.473+0000 7fcb6ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb7809e000 0x7fcb7811e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:43.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.473+0000 7fcb6ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb7809e000 0x7fcb7811e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44332/0 (socket says 172.21.15.26:44332) 2023-10-01T07:55:43.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.473+0000 7fcb7659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb7809d6f0 0x7fcb7811df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:43.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.473+0000 7fcb6ffff700 1 -- 172.21.15.26:0/3232895047 learned_addr learned my addr 172.21.15.26:0/3232895047 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:43.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.473+0000 7fcb7659c700 1 -- 172.21.15.26:0/3232895047 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb7809e000 msgr2=0x7fcb7811e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:43.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.473+0000 7fcb7659c700 1 --2- 172.21.15.26:0/3232895047 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb7809e000 0x7fcb7811e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:43.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.473+0000 7fcb7659c700 1 -- 172.21.15.26:0/3232895047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb7809e410 msgr2=0x7fcb7811e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:43.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.473+0000 7fcb7659c700 1 --2- 172.21.15.26:0/3232895047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb7809e410 0x7fcb7811e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:43.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.473+0000 7fcb7659c700 1 -- 172.21.15.26:0/3232895047 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7000bc80 con 0x7fcb7809d6f0 2023-10-01T07:55:43.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.474+0000 7fcb6ffff700 1 --2- 172.21.15.26:0/3232895047 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb7809e000 0x7fcb7811e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:43.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.474+0000 7fcb7659c700 1 --2- 172.21.15.26:0/3232895047 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb7809d6f0 0x7fcb7811df20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcb6800e910 tx=0x7fcb6800ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:43.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.474+0000 7fcb6effd700 1 -- 172.21.15.26:0/3232895047 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6800ee60 con 0x7fcb7809d6f0 2023-10-01T07:55:43.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.474+0000 7fcb6effd700 1 -- 172.21.15.26:0/3232895047 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb6800c850 con 0x7fcb7809d6f0 2023-10-01T07:55:43.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.474+0000 7fcb6effd700 1 -- 172.21.15.26:0/3232895047 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6800cbe0 con 0x7fcb7809d6f0 2023-10-01T07:55:43.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.474+0000 7fcb7cf77700 1 -- 172.21.15.26:0/3232895047 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb78121760 con 0x7fcb7809d6f0 2023-10-01T07:55:43.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.474+0000 7fcb7cf77700 1 -- 172.21.15.26:0/3232895047 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb7809a0c0 con 0x7fcb7809d6f0 2023-10-01T07:55:43.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.475+0000 7fcb6effd700 1 -- 172.21.15.26:0/3232895047 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcb6800cd40 con 0x7fcb7809d6f0 2023-10-01T07:55:43.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.475+0000 7fcb7cf77700 1 -- 172.21.15.26:0/3232895047 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb7811ac20 con 0x7fcb7809d6f0 2023-10-01T07:55:43.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.476+0000 7fcb6effd700 1 -- 172.21.15.26:0/3232895047 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcb6803f700 con 0x7fcb7809d6f0 2023-10-01T07:55:43.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.484+0000 7fcb6effd700 1 -- 172.21.15.26:0/3232895047 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcb680232f0 con 0x7fcb7809d6f0 2023-10-01T07:55:43.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.508+0000 7fc73b3d0700 1 Processor -- start 2023-10-01T07:55:43.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.508+0000 7fc73b3d0700 1 -- start start 2023-10-01T07:55:43.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.509+0000 7fc73b3d0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc734133420 0x7fc7341337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:43.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.509+0000 7fc73b3d0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc734133e30 0x7fc73412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:43.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.509+0000 7fc73b3d0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc73406b990 con 0x7fc734134260 2023-10-01T07:55:43.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.509+0000 7fc73b3d0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7340a0590 con 0x7fc734133e30 2023-10-01T07:55:43.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.509+0000 7fc73b3d0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc73409fb80 con 0x7fc734133420 2023-10-01T07:55:43.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.509+0000 7fc73916c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc734133420 0x7fc7341337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:43.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.509+0000 7fc73916c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc734133420 0x7fc7341337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44338/0 (socket says 172.21.15.26:44338) 2023-10-01T07:55:43.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.509+0000 7fc73916c700 1 -- 172.21.15.26:0/3659248686 learned_addr learned my addr 172.21.15.26:0/3659248686 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:43.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.509+0000 7fc73896b700 1 --2- 172.21.15.26:0/3659248686 >> v2:172.21.15.26:3300/0 conn(0x7fc734133e30 0x7fc73412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:43.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.509+0000 7fc73916c700 1 -- 172.21.15.26:0/3659248686 >> v2:172.21.15.26:3300/0 conn(0x7fc734133e30 msgr2=0x7fc73412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:43.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.509+0000 7fc73916c700 1 --2- 172.21.15.26:0/3659248686 >> v2:172.21.15.26:3300/0 conn(0x7fc734133e30 0x7fc73412ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:43.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.510+0000 7fc73916c700 1 -- 172.21.15.26:0/3659248686 >> v1:172.21.15.26:6789/0 conn(0x7fc734134260 legacy=0x7fc7341304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:43.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.510+0000 7fc73916c700 1 -- 172.21.15.26:0/3659248686 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7340a0030 con 0x7fc734133420 2023-10-01T07:55:43.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.510+0000 7fc73916c700 1 --2- 172.21.15.26:0/3659248686 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc734133420 0x7fc7341337f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc7300098f0 tx=0x7fc730009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94c5ba7baf97bffe server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:43.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.510+0000 7fc72bfff700 1 -- 172.21.15.26:0/3659248686 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc730004230 con 0x7fc734133420 2023-10-01T07:55:43.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.510+0000 7fc72bfff700 1 -- 172.21.15.26:0/3659248686 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc730004390 con 0x7fc734133420 2023-10-01T07:55:43.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.510+0000 7fc72bfff700 1 -- 172.21.15.26:0/3659248686 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7300036a0 con 0x7fc734133420 2023-10-01T07:55:43.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.511+0000 7fc73b3d0700 1 -- 172.21.15.26:0/3659248686 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc734133420 msgr2=0x7fc7341337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:43.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.511+0000 7fc73b3d0700 1 --2- 172.21.15.26:0/3659248686 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc734133420 0x7fc7341337f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc7300098f0 tx=0x7fc730009c00 comp rx=0 tx=0).stop 2023-10-01T07:55:43.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.511+0000 7fc73b3d0700 1 -- 172.21.15.26:0/3659248686 shutdown_connections 2023-10-01T07:55:43.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.511+0000 7fc73b3d0700 1 --2- 172.21.15.26:0/3659248686 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc734133420 0x7fc7341337f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:43.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.511+0000 7fc73b3d0700 1 --2- 172.21.15.26:0/3659248686 >> v2:172.21.15.26:3300/0 conn(0x7fc734133e30 0x7fc73412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:43.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.511+0000 7fc73b3d0700 1 -- 172.21.15.26:0/3659248686 >> 172.21.15.26:0/3659248686 conn(0x7fc7340a4210 msgr2=0x7fc7340a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:43.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.511+0000 7fc73b3d0700 1 -- 172.21.15.26:0/3659248686 shutdown_connections 2023-10-01T07:55:43.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.511+0000 7fc73b3d0700 1 -- 172.21.15.26:0/3659248686 wait complete. 2023-10-01T07:55:43.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.512+0000 7fc73b3d0700 1 Processor -- start 2023-10-01T07:55:43.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.512+0000 7fc73b3d0700 1 -- start start 2023-10-01T07:55:43.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.513+0000 7fc73b3d0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc734133420 0x7fc73409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:43.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.513+0000 7fc73b3d0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc734133e30 0x7fc73409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:43.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.513+0000 7fc73b3d0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc734134260 0x7fc73409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:43.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.513+0000 7fc73b3d0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73412dbc0 con 0x7fc734133e30 2023-10-01T07:55:43.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.513+0000 7fc73b3d0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc73409dfb0 con 0x7fc734133420 2023-10-01T07:55:43.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.513+0000 7fc73b3d0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc73411fda0 con 0x7fc734134260 2023-10-01T07:55:43.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.513+0000 7fc73896b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc734133e30 0x7fc73409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:43.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.513+0000 7fc73896b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc734133e30 0x7fc73409c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60140/0 (socket says 172.21.15.26:60140) 2023-10-01T07:55:43.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.513+0000 7fc73896b700 1 -- 172.21.15.26:0/2287335156 learned_addr learned my addr 172.21.15.26:0/2287335156 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:43.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.513+0000 7fc73916c700 1 --2- 172.21.15.26:0/2287335156 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc734133420 0x7fc73409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:43.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.514+0000 7fc73996d700 1 --2- 172.21.15.26:0/2287335156 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc734134260 0x7fc73409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:43.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.514+0000 7fc73916c700 1 -- 172.21.15.26:0/2287335156 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc734134260 msgr2=0x7fc73409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:43.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.514+0000 7fc73916c700 1 --2- 172.21.15.26:0/2287335156 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc734134260 0x7fc73409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:43.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.514+0000 7fc73916c700 1 -- 172.21.15.26:0/2287335156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc734133e30 msgr2=0x7fc73409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:43.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.514+0000 7fc73916c700 1 --2- 172.21.15.26:0/2287335156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc734133e30 0x7fc73409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:43.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.514+0000 7fc73916c700 1 -- 172.21.15.26:0/2287335156 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc730009550 con 0x7fc734133420 2023-10-01T07:55:43.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.514+0000 7fc73916c700 1 --2- 172.21.15.26:0/2287335156 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc734133420 0x7fc73409c480 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc730015000 tx=0x7fc730004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:43.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.514+0000 7fc729ffb700 1 -- 172.21.15.26:0/2287335156 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc730003c10 con 0x7fc734133420 2023-10-01T07:55:43.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.514+0000 7fc729ffb700 1 -- 172.21.15.26:0/2287335156 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73001f070 con 0x7fc734133420 2023-10-01T07:55:43.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.514+0000 7fc73b3d0700 1 -- 172.21.15.26:0/2287335156 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7341319d0 con 0x7fc734133420 2023-10-01T07:55:43.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.514+0000 7fc729ffb700 1 -- 172.21.15.26:0/2287335156 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc730011630 con 0x7fc734133420 2023-10-01T07:55:43.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.515+0000 7fc73b3d0700 1 -- 172.21.15.26:0/2287335156 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc734120340 con 0x7fc734133420 2023-10-01T07:55:43.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.516+0000 7fc73b3d0700 1 -- 172.21.15.26:0/2287335156 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc73411ff60 con 0x7fc734133420 2023-10-01T07:55:43.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.516+0000 7fc729ffb700 1 -- 172.21.15.26:0/2287335156 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc730021030 con 0x7fc734133420 2023-10-01T07:55:43.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.517+0000 7fc729ffb700 1 -- 172.21.15.26:0/2287335156 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc730040f60 con 0x7fc734133420 2023-10-01T07:55:43.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.521+0000 7fc729ffb700 1 -- 172.21.15.26:0/2287335156 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc73006c750 con 0x7fc734133420 2023-10-01T07:55:43.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.554+0000 7f1625425700 1 Processor -- start 2023-10-01T07:55:43.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.554+0000 7f1625425700 1 -- start start 2023-10-01T07:55:43.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.555+0000 7f1625425700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f162009d6f0 0x7f162009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:43.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.555+0000 7f1625425700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f162009e000 0x7f1620130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:43.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.555+0000 7f1625425700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f162009f130 con 0x7f162009e410 2023-10-01T07:55:43.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.555+0000 7f1625425700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f162009f520 con 0x7f162009d6f0 2023-10-01T07:55:43.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.555+0000 7f1625425700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162009e930 con 0x7f162009e000 2023-10-01T07:55:43.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.555+0000 7f161e7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f162009e000 0x7f1620130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:43.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.555+0000 7f161effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f162009d6f0 0x7f162009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:43.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.555+0000 7f161e7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f162009e000 0x7f1620130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44352/0 (socket says 172.21.15.26:44352) 2023-10-01T07:55:43.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.555+0000 7f161e7fc700 1 -- 172.21.15.26:0/2914646214 learned_addr learned my addr 172.21.15.26:0/2914646214 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:43.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.556+0000 7f161e7fc700 1 -- 172.21.15.26:0/2914646214 >> v2:172.21.15.26:3300/0 conn(0x7f162009d6f0 msgr2=0x7f162009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:43.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.556+0000 7f161e7fc700 1 --2- 172.21.15.26:0/2914646214 >> v2:172.21.15.26:3300/0 conn(0x7f162009d6f0 0x7f162009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:43.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.556+0000 7f161e7fc700 1 -- 172.21.15.26:0/2914646214 >> v1:172.21.15.26:6789/0 conn(0x7f162009e410 legacy=0x7f1620130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:43.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.556+0000 7f161e7fc700 1 -- 172.21.15.26:0/2914646214 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162009b2d0 con 0x7f162009e000 2023-10-01T07:55:43.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.556+0000 7f161e7fc700 1 --2- 172.21.15.26:0/2914646214 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f162009e000 0x7f1620130660 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f16140098f0 tx=0x7f1614009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28dda6aabc5c1a00 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:43.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.556+0000 7f161dffb700 1 -- 172.21.15.26:0/2914646214 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1614011830 con 0x7f162009e000 2023-10-01T07:55:43.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.556+0000 7f161dffb700 1 -- 172.21.15.26:0/2914646214 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1614011990 con 0x7f162009e000 2023-10-01T07:55:43.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.556+0000 7f161dffb700 1 -- 172.21.15.26:0/2914646214 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1614011d20 con 0x7f162009e000 2023-10-01T07:55:43.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.557+0000 7f1625425700 1 -- 172.21.15.26:0/2914646214 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f162009e000 msgr2=0x7f1620130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:43.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.557+0000 7f1625425700 1 --2- 172.21.15.26:0/2914646214 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f162009e000 0x7f1620130660 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f16140098f0 tx=0x7f1614009c00 comp rx=0 tx=0).stop 2023-10-01T07:55:43.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.557+0000 7f1625425700 1 -- 172.21.15.26:0/2914646214 shutdown_connections 2023-10-01T07:55:43.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.557+0000 7f1625425700 1 --2- 172.21.15.26:0/2914646214 >> v2:172.21.15.26:3300/0 conn(0x7f162009d6f0 0x7f162009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:43.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.557+0000 7f1625425700 1 --2- 172.21.15.26:0/2914646214 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f162009e000 0x7f1620130660 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:43.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.557+0000 7f1625425700 1 -- 172.21.15.26:0/2914646214 >> 172.21.15.26:0/2914646214 conn(0x7f1620066f50 msgr2=0x7f162009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:43.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.557+0000 7f1625425700 1 -- 172.21.15.26:0/2914646214 shutdown_connections 2023-10-01T07:55:43.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.557+0000 7f1625425700 1 -- 172.21.15.26:0/2914646214 wait complete. 2023-10-01T07:55:43.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.558+0000 7f1625425700 1 Processor -- start 2023-10-01T07:55:43.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.558+0000 7f1625425700 1 -- start start 2023-10-01T07:55:43.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.559+0000 7f1625425700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f162009d6f0 0x7f1620138bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:43.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.559+0000 7f1625425700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f162009e000 0x7f16201390f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:43.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.559+0000 7f1625425700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f162009e410 0x7f1620139940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:43.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.559+0000 7f1625425700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162012b320 con 0x7f162009d6f0 2023-10-01T07:55:43.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.559+0000 7f1625425700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162013b030 con 0x7f162009e410 2023-10-01T07:55:43.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.559+0000 7f1625425700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16201323a0 con 0x7f162009e000 2023-10-01T07:55:43.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.559+0000 7f161e7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f162009e000 0x7f16201390f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:43.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.559+0000 7f161e7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f162009e000 0x7f16201390f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37914/0 (socket says 172.21.15.26:37914) 2023-10-01T07:55:43.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.559+0000 7f161e7fc700 1 -- 172.21.15.26:0/2893063774 learned_addr learned my addr 172.21.15.26:0/2893063774 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:43.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.559+0000 7f161f7fe700 1 --2- 172.21.15.26:0/2893063774 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f162009e410 0x7f1620139940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:43.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.559+0000 7f161effd700 1 --2- 172.21.15.26:0/2893063774 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f162009d6f0 0x7f1620138bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:43.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.560+0000 7f161f7fe700 1 -- 172.21.15.26:0/2893063774 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f162009e000 msgr2=0x7f16201390f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:43.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.560+0000 7f161f7fe700 1 --2- 172.21.15.26:0/2893063774 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f162009e000 0x7f16201390f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:43.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.560+0000 7f161f7fe700 1 -- 172.21.15.26:0/2893063774 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f162009d6f0 msgr2=0x7f1620138bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:43.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.560+0000 7f161f7fe700 1 --2- 172.21.15.26:0/2893063774 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f162009d6f0 0x7f1620138bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:43.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.560+0000 7f161f7fe700 1 -- 172.21.15.26:0/2893063774 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1614009550 con 0x7f162009e410 2023-10-01T07:55:43.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.560+0000 7f161e7fc700 1 --2- 172.21.15.26:0/2893063774 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f162009e000 0x7f16201390f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:43.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.560+0000 7f161f7fe700 1 --2- 172.21.15.26:0/2893063774 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f162009e410 0x7f1620139940 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f161800cb90 tx=0x7f161800cea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:43.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.560+0000 7f16077fe700 1 -- 172.21.15.26:0/2893063774 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1618003c00 con 0x7f162009e410 2023-10-01T07:55:43.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.560+0000 7f16077fe700 1 -- 172.21.15.26:0/2893063774 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1618003d60 con 0x7f162009e410 2023-10-01T07:55:43.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.560+0000 7f1625425700 1 -- 172.21.15.26:0/2893063774 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f162013b760 con 0x7f162009e410 2023-10-01T07:55:43.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.560+0000 7f16077fe700 1 -- 172.21.15.26:0/2893063774 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161800aa80 con 0x7f162009e410 2023-10-01T07:55:43.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.560+0000 7f1625425700 1 -- 172.21.15.26:0/2893063774 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1620132e20 con 0x7f162009e410 2023-10-01T07:55:43.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.561+0000 7f1625425700 1 -- 172.21.15.26:0/2893063774 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1620074ea0 con 0x7f162009e410 2023-10-01T07:55:43.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.561+0000 7f16077fe700 1 -- 172.21.15.26:0/2893063774 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f161800abe0 con 0x7f162009e410 2023-10-01T07:55:43.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.564+0000 7f16077fe700 1 -- 172.21.15.26:0/2893063774 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1618011540 con 0x7f162009e410 2023-10-01T07:55:43.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.571+0000 7f16077fe700 1 -- 172.21.15.26:0/2893063774 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f16180198f0 con 0x7f162009e410 2023-10-01T07:55:43.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.594+0000 7f788405b700 1 Processor -- start 2023-10-01T07:55:43.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.595+0000 7f788405b700 1 -- start start 2023-10-01T07:55:43.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.596+0000 7f788405b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f787c0a0a30 0x7f787c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:43.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.596+0000 7f788405b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f787c138d80 0x7f787c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:43.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.596+0000 7f788405b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f787c0a2a70 con 0x7f787c09d630 2023-10-01T07:55:43.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.596+0000 7f788405b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787c0a01d0 con 0x7f787c138d80 2023-10-01T07:55:43.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.596+0000 7f788405b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f787c09e2b0 con 0x7f787c0a0a30 2023-10-01T07:55:43.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.596+0000 7f7881df7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f787c0a0a30 0x7f787c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:43.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.596+0000 7f7881df7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f787c0a0a30 0x7f787c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37918/0 (socket says 172.21.15.26:37918) 2023-10-01T07:55:43.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.596+0000 7f7881df7700 1 -- 172.21.15.26:0/1365596216 learned_addr learned my addr 172.21.15.26:0/1365596216 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:43.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.596+0000 7f78825f8700 1 --2- 172.21.15.26:0/1365596216 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f787c138d80 0x7f787c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:43.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.596+0000 7f7881df7700 1 -- 172.21.15.26:0/1365596216 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f787c138d80 msgr2=0x7f787c13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:43.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.596+0000 7f7881df7700 1 --2- 172.21.15.26:0/1365596216 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f787c138d80 0x7f787c13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:43.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.596+0000 7f7881df7700 1 -- 172.21.15.26:0/1365596216 >> v1:172.21.15.26:6789/0 conn(0x7f787c09d630 legacy=0x7f787c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:43.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.596+0000 7f7881df7700 1 -- 172.21.15.26:0/1365596216 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787c09dc50 con 0x7f787c0a0a30 2023-10-01T07:55:43.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.597+0000 7f7881df7700 1 --2- 172.21.15.26:0/1365596216 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f787c0a0a30 0x7f787c0a0e00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7878009920 tx=0x7f7878009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6425c444465bfba server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:43.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.597+0000 7f7880df5700 1 -- 172.21.15.26:0/1365596216 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7878011830 con 0x7f787c0a0a30 2023-10-01T07:55:43.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.597+0000 7f7880df5700 1 -- 172.21.15.26:0/1365596216 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7878011990 con 0x7f787c0a0a30 2023-10-01T07:55:43.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.597+0000 7f7880df5700 1 -- 172.21.15.26:0/1365596216 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7878011d20 con 0x7f787c0a0a30 2023-10-01T07:55:43.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.598+0000 7f788405b700 1 -- 172.21.15.26:0/1365596216 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f787c0a0a30 msgr2=0x7f787c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:43.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.598+0000 7f788405b700 1 --2- 172.21.15.26:0/1365596216 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f787c0a0a30 0x7f787c0a0e00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7878009920 tx=0x7f7878009c30 comp rx=0 tx=0).stop 2023-10-01T07:55:43.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.598+0000 7f788405b700 1 -- 172.21.15.26:0/1365596216 shutdown_connections 2023-10-01T07:55:43.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.598+0000 7f788405b700 1 --2- 172.21.15.26:0/1365596216 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f787c0a0a30 0x7f787c0a0e00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:43.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.598+0000 7f788405b700 1 --2- 172.21.15.26:0/1365596216 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f787c138d80 0x7f787c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:43.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.598+0000 7f788405b700 1 -- 172.21.15.26:0/1365596216 >> 172.21.15.26:0/1365596216 conn(0x7f787c0a3050 msgr2=0x7f787c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:43.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.598+0000 7f788405b700 1 -- 172.21.15.26:0/1365596216 shutdown_connections 2023-10-01T07:55:43.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.598+0000 7f788405b700 1 -- 172.21.15.26:0/1365596216 wait complete. 2023-10-01T07:55:43.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.600+0000 7f788405b700 1 Processor -- start 2023-10-01T07:55:43.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.600+0000 7f788405b700 1 -- start start 2023-10-01T07:55:43.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.600+0000 7f788405b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f787c09d630 0x7f787c11d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:43.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.600+0000 7f788405b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f787c0a0a30 0x7f787c11d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:43.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.601+0000 7f788405b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f787c138d80 0x7f787c11de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:43.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.601+0000 7f788405b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787c11fe50 con 0x7f787c0a0a30 2023-10-01T07:55:43.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.601+0000 7f788405b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787c11e790 con 0x7f787c09d630 2023-10-01T07:55:43.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.601+0000 7f788405b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f787c0a4e20 con 0x7f787c138d80 2023-10-01T07:55:43.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.601+0000 7f7881df7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f787c09d630 0x7f787c11d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:43.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.601+0000 7f78815f6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f787c0a0a30 0x7f787c11d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:43.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.601+0000 7f7881df7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f787c09d630 0x7f787c11d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44376/0 (socket says 172.21.15.26:44376) 2023-10-01T07:55:43.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.601+0000 7f78825f8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f787c138d80 0x7f787c11de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:43.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.601+0000 7f7881df7700 1 -- 172.21.15.26:0/195763644 learned_addr learned my addr 172.21.15.26:0/195763644 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:43.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.601+0000 7f7881df7700 1 -- 172.21.15.26:0/195763644 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f787c138d80 msgr2=0x7f787c11de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:43.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.601+0000 7f7881df7700 1 --2- 172.21.15.26:0/195763644 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f787c138d80 0x7f787c11de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:43.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.601+0000 7f7881df7700 1 -- 172.21.15.26:0/195763644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f787c0a0a30 msgr2=0x7f787c11d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:43.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.601+0000 7f7881df7700 1 --2- 172.21.15.26:0/195763644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f787c0a0a30 0x7f787c11d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:43.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.601+0000 7f7881df7700 1 -- 172.21.15.26:0/195763644 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7878009550 con 0x7f787c09d630 2023-10-01T07:55:43.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.601+0000 7f7881df7700 1 --2- 172.21.15.26:0/195763644 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f787c09d630 0x7f787c11d3c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7878000c00 tx=0x7f7878004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:43.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.602+0000 7f78727fc700 1 -- 172.21.15.26:0/195763644 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7878004450 con 0x7f787c09d630 2023-10-01T07:55:43.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.602+0000 7f78727fc700 1 -- 172.21.15.26:0/195763644 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78780045b0 con 0x7f787c09d630 2023-10-01T07:55:43.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.602+0000 7f788405b700 1 -- 172.21.15.26:0/195763644 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f787c0a0410 con 0x7f787c09d630 2023-10-01T07:55:43.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.602+0000 7f78727fc700 1 -- 172.21.15.26:0/195763644 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78780038a0 con 0x7f787c09d630 2023-10-01T07:55:43.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.602+0000 7f788405b700 1 -- 172.21.15.26:0/195763644 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f787c1215e0 con 0x7f787c09d630 2023-10-01T07:55:43.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.603+0000 7f788405b700 1 -- 172.21.15.26:0/195763644 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f787c0747f0 con 0x7f787c09d630 2023-10-01T07:55:43.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.604+0000 7f78727fc700 1 -- 172.21.15.26:0/195763644 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7878021070 con 0x7f787c09d630 2023-10-01T07:55:43.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.604+0000 7f78727fc700 1 -- 172.21.15.26:0/195763644 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7878040d90 con 0x7f787c09d630 2023-10-01T07:55:43.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.613+0000 7f78727fc700 1 -- 172.21.15.26:0/195763644 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7878019770 con 0x7f787c09d630 2023-10-01T07:55:43.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.749+0000 7fcb7cf77700 1 -- 172.21.15.26:0/3232895047 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcb78074ea0 con 0x7fcb7809d6f0 2023-10-01T07:55:43.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.749+0000 7fcb6effd700 1 -- 172.21.15.26:0/3232895047 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcb6803a090 con 0x7fcb7809d6f0 2023-10-01T07:55:43.750 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:43.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.751+0000 7fcb7cf77700 1 -- 172.21.15.26:0/3232895047 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb7809d6f0 msgr2=0x7fcb7811df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:43.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.751+0000 7fcb7cf77700 1 --2- 172.21.15.26:0/3232895047 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb7809d6f0 0x7fcb7811df20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcb6800e910 tx=0x7fcb6800ec20 comp rx=0 tx=0).stop 2023-10-01T07:55:43.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.751+0000 7fcb7cf77700 1 -- 172.21.15.26:0/3232895047 shutdown_connections 2023-10-01T07:55:43.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.751+0000 7fcb7cf77700 1 --2- 172.21.15.26:0/3232895047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb7809e410 0x7fcb7811e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:43.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.751+0000 7fcb7cf77700 1 --2- 172.21.15.26:0/3232895047 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb7809d6f0 0x7fcb7811df20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:43.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.751+0000 7fcb7cf77700 1 --2- 172.21.15.26:0/3232895047 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb7809e000 0x7fcb7811e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:43.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.751+0000 7fcb7cf77700 1 -- 172.21.15.26:0/3232895047 >> 172.21.15.26:0/3232895047 conn(0x7fcb78066f50 msgr2=0x7fcb78130a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:43.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.752+0000 7fcb7cf77700 1 -- 172.21.15.26:0/3232895047 shutdown_connections 2023-10-01T07:55:43.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.752+0000 7fcb7cf77700 1 -- 172.21.15.26:0/3232895047 wait complete. 2023-10-01T07:55:43.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.759+0000 7fc73b3d0700 1 -- 172.21.15.26:0/2287335156 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc734074ea0 con 0x7fc734133420 2023-10-01T07:55:43.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.759+0000 7fc729ffb700 1 -- 172.21.15.26:0/2287335156 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc730023790 con 0x7fc734133420 2023-10-01T07:55:43.760 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:43.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.763+0000 7fc73b3d0700 1 -- 172.21.15.26:0/2287335156 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc734133420 msgr2=0x7fc73409c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:43.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.763+0000 7fc73b3d0700 1 --2- 172.21.15.26:0/2287335156 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc734133420 0x7fc73409c480 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc730015000 tx=0x7fc730004750 comp rx=0 tx=0).stop 2023-10-01T07:55:43.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.764+0000 7fc73b3d0700 1 -- 172.21.15.26:0/2287335156 shutdown_connections 2023-10-01T07:55:43.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.764+0000 7fc73b3d0700 1 --2- 172.21.15.26:0/2287335156 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc734134260 0x7fc73409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:43.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.764+0000 7fc73b3d0700 1 --2- 172.21.15.26:0/2287335156 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc734133420 0x7fc73409c480 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:43.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.764+0000 7fc73b3d0700 1 --2- 172.21.15.26:0/2287335156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc734133e30 0x7fc73409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:43.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.764+0000 7fc73b3d0700 1 -- 172.21.15.26:0/2287335156 >> 172.21.15.26:0/2287335156 conn(0x7fc7340a4210 msgr2=0x7fc7340a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:43.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.765+0000 7fc73b3d0700 1 -- 172.21.15.26:0/2287335156 shutdown_connections 2023-10-01T07:55:43.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.765+0000 7fc73b3d0700 1 -- 172.21.15.26:0/2287335156 wait complete. 2023-10-01T07:55:43.767 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:43.784 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:43.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.785+0000 7f1625425700 1 -- 172.21.15.26:0/2893063774 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f16200725a0 con 0x7f162009e410 2023-10-01T07:55:43.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.785+0000 7f16077fe700 1 -- 172.21.15.26:0/2893063774 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1618011380 con 0x7f162009e410 2023-10-01T07:55:43.786 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:43.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.787+0000 7f1625425700 1 -- 172.21.15.26:0/2893063774 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f162009e410 msgr2=0x7f1620139940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:43.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.787+0000 7f1625425700 1 --2- 172.21.15.26:0/2893063774 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f162009e410 0x7f1620139940 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f161800cb90 tx=0x7f161800cea0 comp rx=0 tx=0).stop 2023-10-01T07:55:43.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.787+0000 7f1625425700 1 -- 172.21.15.26:0/2893063774 shutdown_connections 2023-10-01T07:55:43.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.787+0000 7f1625425700 1 --2- 172.21.15.26:0/2893063774 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f162009e410 0x7f1620139940 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:43.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.787+0000 7f1625425700 1 --2- 172.21.15.26:0/2893063774 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f162009d6f0 0x7f1620138bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:43.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.787+0000 7f1625425700 1 --2- 172.21.15.26:0/2893063774 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f162009e000 0x7f16201390f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:43.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.787+0000 7f1625425700 1 -- 172.21.15.26:0/2893063774 >> 172.21.15.26:0/2893063774 conn(0x7f1620066f50 msgr2=0x7f16200a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:43.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.787+0000 7f1625425700 1 -- 172.21.15.26:0/2893063774 shutdown_connections 2023-10-01T07:55:43.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.787+0000 7f1625425700 1 -- 172.21.15.26:0/2893063774 wait complete. 2023-10-01T07:55:43.802 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:43.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.848+0000 7f788405b700 1 -- 172.21.15.26:0/195763644 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f787c072980 con 0x7f787c09d630 2023-10-01T07:55:43.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.849+0000 7f78727fc700 1 -- 172.21.15.26:0/195763644 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7878029030 con 0x7f787c09d630 2023-10-01T07:55:43.849 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:43.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.851+0000 7f788405b700 1 -- 172.21.15.26:0/195763644 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f787c09d630 msgr2=0x7f787c11d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:43.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.851+0000 7f788405b700 1 --2- 172.21.15.26:0/195763644 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f787c09d630 0x7f787c11d3c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7878000c00 tx=0x7f7878004750 comp rx=0 tx=0).stop 2023-10-01T07:55:43.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.851+0000 7f788405b700 1 -- 172.21.15.26:0/195763644 shutdown_connections 2023-10-01T07:55:43.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.851+0000 7f788405b700 1 --2- 172.21.15.26:0/195763644 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f787c138d80 0x7f787c11de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:43.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.851+0000 7f788405b700 1 --2- 172.21.15.26:0/195763644 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f787c09d630 0x7f787c11d3c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:43.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.851+0000 7f788405b700 1 --2- 172.21.15.26:0/195763644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f787c0a0a30 0x7f787c11d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:43.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.851+0000 7f788405b700 1 -- 172.21.15.26:0/195763644 >> 172.21.15.26:0/195763644 conn(0x7f787c0a3050 msgr2=0x7f787c0a5250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:43.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.851+0000 7f788405b700 1 -- 172.21.15.26:0/195763644 shutdown_connections 2023-10-01T07:55:43.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:43.851+0000 7f788405b700 1 -- 172.21.15.26:0/195763644 wait complete. 2023-10-01T07:55:43.865 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:44.768 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:44.785 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:44.803 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:44.866 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:44.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.926+0000 7f1e6a4f2700 1 Processor -- start 2023-10-01T07:55:44.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.926+0000 7f1e6a4f2700 1 -- start start 2023-10-01T07:55:44.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.926+0000 7f1e6a4f2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e64134630 0x7f1e64136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:44.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.926+0000 7f1e6a4f2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1e64136f50 0x7f1e64139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:44.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.926+0000 7f1e6a4f2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e6409b4f0 con 0x7f1e64131810 2023-10-01T07:55:44.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.926+0000 7f1e6a4f2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e641313c0 con 0x7f1e64136f50 2023-10-01T07:55:44.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.926+0000 7f1e6a4f2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6406e8c0 con 0x7f1e64134630 2023-10-01T07:55:44.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.927+0000 7f1e637fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e64134630 0x7f1e64136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:44.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.927+0000 7f1e68a8f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1e64136f50 0x7f1e64139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:44.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.927+0000 7f1e637fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e64134630 0x7f1e64136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37934/0 (socket says 172.21.15.26:37934) 2023-10-01T07:55:44.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.927+0000 7f1e637fe700 1 -- 172.21.15.26:0/673383221 learned_addr learned my addr 172.21.15.26:0/673383221 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:44.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.927+0000 7f1e637fe700 1 -- 172.21.15.26:0/673383221 >> v2:172.21.15.26:3300/0 conn(0x7f1e64136f50 msgr2=0x7f1e64139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:44.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.927+0000 7f1e637fe700 1 --2- 172.21.15.26:0/673383221 >> v2:172.21.15.26:3300/0 conn(0x7f1e64136f50 0x7f1e64139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:44.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.927+0000 7f1e637fe700 1 -- 172.21.15.26:0/673383221 >> v1:172.21.15.26:6789/0 conn(0x7f1e64131810 legacy=0x7f1e64131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:44.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.927+0000 7f1e637fe700 1 -- 172.21.15.26:0/673383221 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e64071d20 con 0x7f1e64134630 2023-10-01T07:55:44.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.927+0000 7f1e68a8f700 1 --2- 172.21.15.26:0/673383221 >> v2:172.21.15.26:3300/0 conn(0x7f1e64136f50 0x7f1e64139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:44.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.927+0000 7f1e637fe700 1 --2- 172.21.15.26:0/673383221 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e64134630 0x7f1e64136a10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1e580098f0 tx=0x7f1e58009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=519a196af18e743b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:44.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.927+0000 7f1e62ffd700 1 -- 172.21.15.26:0/673383221 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e58004230 con 0x7f1e64134630 2023-10-01T07:55:44.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.928+0000 7f1e62ffd700 1 -- 172.21.15.26:0/673383221 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e58004390 con 0x7f1e64134630 2023-10-01T07:55:44.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.928+0000 7f1e62ffd700 1 -- 172.21.15.26:0/673383221 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e580036a0 con 0x7f1e64134630 2023-10-01T07:55:44.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.928+0000 7f1e6a4f2700 1 -- 172.21.15.26:0/673383221 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e64134630 msgr2=0x7f1e64136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:44.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.928+0000 7f1e6a4f2700 1 --2- 172.21.15.26:0/673383221 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e64134630 0x7f1e64136a10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1e580098f0 tx=0x7f1e58009c00 comp rx=0 tx=0).stop 2023-10-01T07:55:44.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.928+0000 7f1e6a4f2700 1 -- 172.21.15.26:0/673383221 shutdown_connections 2023-10-01T07:55:44.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.928+0000 7f1e6a4f2700 1 --2- 172.21.15.26:0/673383221 >> v2:172.21.15.26:3300/0 conn(0x7f1e64136f50 0x7f1e64139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:44.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.928+0000 7f1e6a4f2700 1 --2- 172.21.15.26:0/673383221 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e64134630 0x7f1e64136a10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:44.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.928+0000 7f1e6a4f2700 1 -- 172.21.15.26:0/673383221 >> 172.21.15.26:0/673383221 conn(0x7f1e640a2aa0 msgr2=0x7f1e640a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:44.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.928+0000 7f1e6a4f2700 1 -- 172.21.15.26:0/673383221 shutdown_connections 2023-10-01T07:55:44.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.928+0000 7f1e6a4f2700 1 -- 172.21.15.26:0/673383221 wait complete. 2023-10-01T07:55:44.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.930+0000 7f1e6a4f2700 1 Processor -- start 2023-10-01T07:55:44.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.930+0000 7f1e6a4f2700 1 -- start start 2023-10-01T07:55:44.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.931+0000 7f1e6a4f2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e64131810 0x7f1e64119b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:44.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.931+0000 7f1e6a4f2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e64134630 0x7f1e6411a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:44.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.931+0000 7f1e6a4f2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e64136f50 0x7f1e641c6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:44.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.931+0000 7f1e6a4f2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6412ed40 con 0x7f1e64131810 2023-10-01T07:55:44.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.931+0000 7f1e6a4f2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6411a5e0 con 0x7f1e64136f50 2023-10-01T07:55:44.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.931+0000 7f1e6a4f2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e64119770 con 0x7f1e64134630 2023-10-01T07:55:44.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.931+0000 7f1e68a8f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e64136f50 0x7f1e641c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:44.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.931+0000 7f1e68a8f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e64136f50 0x7f1e641c6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44380/0 (socket says 172.21.15.26:44380) 2023-10-01T07:55:44.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.931+0000 7f1e68a8f700 1 -- 172.21.15.26:0/1855396592 learned_addr learned my addr 172.21.15.26:0/1855396592 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:44.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.931+0000 7f1e63fff700 1 --2- 172.21.15.26:0/1855396592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e64131810 0x7f1e64119b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:44.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.932+0000 7f1e68a8f700 1 -- 172.21.15.26:0/1855396592 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e64134630 msgr2=0x7f1e6411a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:44.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.932+0000 7f1e68a8f700 1 --2- 172.21.15.26:0/1855396592 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e64134630 0x7f1e6411a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:44.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.932+0000 7f1e68a8f700 1 -- 172.21.15.26:0/1855396592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e64131810 msgr2=0x7f1e64119b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:44.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.932+0000 7f1e68a8f700 1 --2- 172.21.15.26:0/1855396592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e64131810 0x7f1e64119b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:44.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.932+0000 7f1e68a8f700 1 -- 172.21.15.26:0/1855396592 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e5c009a70 con 0x7f1e64136f50 2023-10-01T07:55:44.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.932+0000 7f1e68a8f700 1 --2- 172.21.15.26:0/1855396592 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e64136f50 0x7f1e641c6350 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c009ea0 tx=0x7f1e5c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:44.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.932+0000 7f1e60ff9700 1 -- 172.21.15.26:0/1855396592 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c00cd40 con 0x7f1e64136f50 2023-10-01T07:55:44.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.932+0000 7f1e60ff9700 1 -- 172.21.15.26:0/1855396592 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5c00f040 con 0x7f1e64136f50 2023-10-01T07:55:44.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.932+0000 7f1e60ff9700 1 -- 172.21.15.26:0/1855396592 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c0146c0 con 0x7f1e64136f50 2023-10-01T07:55:44.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.932+0000 7f1e6a4f2700 1 -- 172.21.15.26:0/1855396592 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e58009550 con 0x7f1e64136f50 2023-10-01T07:55:44.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.932+0000 7f1e6a4f2700 1 -- 172.21.15.26:0/1855396592 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e6406eb00 con 0x7f1e64136f50 2023-10-01T07:55:44.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.933+0000 7f1e60ff9700 1 -- 172.21.15.26:0/1855396592 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e5c014820 con 0x7f1e64136f50 2023-10-01T07:55:44.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.933+0000 7f1e6a4f2700 1 -- 172.21.15.26:0/1855396592 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e64066980 con 0x7f1e64136f50 2023-10-01T07:55:44.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.933+0000 7f1e60ff9700 1 -- 172.21.15.26:0/1855396592 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1e5c0404a0 con 0x7f1e64136f50 2023-10-01T07:55:44.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.939+0000 7f1e60ff9700 1 -- 172.21.15.26:0/1855396592 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e5c014e00 con 0x7f1e64136f50 2023-10-01T07:55:44.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.962+0000 7f45b07ac700 1 Processor -- start 2023-10-01T07:55:44.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.962+0000 7f45b07ac700 1 -- start start 2023-10-01T07:55:44.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.962+0000 7f2f6f3b3700 1 Processor -- start 2023-10-01T07:55:44.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.963+0000 7f2f6f3b3700 1 -- start start 2023-10-01T07:55:44.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.963+0000 7f45b07ac700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45a809d6f0 0x7f45a809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:44.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.963+0000 7f45b07ac700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45a809e000 0x7f45a81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:44.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.963+0000 7f45b07ac700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a809b120 con 0x7f45a809e410 2023-10-01T07:55:44.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.963+0000 7f45b07ac700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a806b460 con 0x7f45a809d6f0 2023-10-01T07:55:44.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.963+0000 7f45b07ac700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45a809a7e0 con 0x7f45a809e000 2023-10-01T07:55:44.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.963+0000 7f45aed49700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f45a809e410 0x7f45a8133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49094/0 (socket says 172.21.15.26:49094) 2023-10-01T07:55:44.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.963+0000 7f45aed49700 1 -- 172.21.15.26:0/883381235 learned_addr learned my addr 172.21.15.26:0/883381235 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:44.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.963+0000 7f45ae548700 1 --2- 172.21.15.26:0/883381235 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45a809d6f0 0x7f45a809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:44.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.963+0000 7f45add47700 1 --2- 172.21.15.26:0/883381235 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45a809e000 0x7f45a81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:44.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.964+0000 7f2f6f3b3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2f6806f5d0 0x7f2f6812cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:44.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.964+0000 7f2f6f3b3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f68066410 0x7f2f6812f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:44.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.964+0000 7f2f6f3b3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f68066880 0x7f2f6812fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:44.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.964+0000 7f2f6f3b3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f68071780 con 0x7f2f6806f5d0 2023-10-01T07:55:44.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.964+0000 7f2f6f3b3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6806f9a0 con 0x7f2f68066880 2023-10-01T07:55:44.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.964+0000 7f2f6f3b3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f68071a40 con 0x7f2f68066410 2023-10-01T07:55:44.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.964+0000 7f2f6d14f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2f6806f5d0 0x7f2f6812cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:44.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.964+0000 7f45add47700 1 -- 172.21.15.26:0/883381235 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45a809d6f0 msgr2=0x7f45a809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:44.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.964+0000 7f45add47700 1 --2- 172.21.15.26:0/883381235 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45a809d6f0 0x7f45a809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:44.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.964+0000 7f2f6d14f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2f6806f5d0 0x7f2f6812cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60182/0 (socket says 172.21.15.26:60182) 2023-10-01T07:55:44.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.964+0000 7f2f6d14f700 1 -- 172.21.15.26:0/3680002535 learned_addr learned my addr 172.21.15.26:0/3680002535 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:44.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.964+0000 7f45add47700 1 -- 172.21.15.26:0/883381235 >> v1:172.21.15.26:6789/0 conn(0x7f45a809e410 legacy=0x7f45a8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:44.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.964+0000 7f45add47700 1 -- 172.21.15.26:0/883381235 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a809a500 con 0x7f45a809e000 2023-10-01T07:55:44.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.964+0000 7f2f6c94e700 1 --2- 172.21.15.26:0/3680002535 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f68066410 0x7f2f6812f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:44.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.964+0000 7f2f6d950700 1 --2- 172.21.15.26:0/3680002535 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f68066880 0x7f2f6812fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:44.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.964+0000 7f2f6d14f700 1 -- 172.21.15.26:0/3680002535 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f68066410 msgr2=0x7f2f6812f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:44.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.964+0000 7f2f6d14f700 1 --2- 172.21.15.26:0/3680002535 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f68066410 0x7f2f6812f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:44.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.964+0000 7f2f6d14f700 1 -- 172.21.15.26:0/3680002535 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f68066880 msgr2=0x7f2f6812fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:44.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.964+0000 7f2f6d14f700 1 --2- 172.21.15.26:0/3680002535 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f68066880 0x7f2f6812fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:44.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.964+0000 7f2f6d14f700 1 -- 172.21.15.26:0/3680002535 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f68072220 con 0x7f2f6806f5d0 2023-10-01T07:55:44.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.965+0000 7f2f6c94e700 1 --2- 172.21.15.26:0/3680002535 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f68066410 0x7f2f6812f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:44.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.964+0000 7f45add47700 1 --2- 172.21.15.26:0/883381235 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45a809e000 0x7f45a81339f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f45980098a0 tx=0x7f4598009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fa92dd0395a587e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:44.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.965+0000 7f2f6d14f700 1 --2- 172.21.15.26:0/3680002535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f6806f5d0 0x7f2f6812cd90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2f640098f0 tx=0x7f2f64009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=372797f134333c2f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:44.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.965+0000 7f45ad546700 1 -- 172.21.15.26:0/883381235 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4598011830 con 0x7f45a809e000 2023-10-01T07:55:44.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.965+0000 7f45ad546700 1 -- 172.21.15.26:0/883381235 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4598011990 con 0x7f45a809e000 2023-10-01T07:55:44.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.965+0000 7f45ad546700 1 -- 172.21.15.26:0/883381235 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4598011d20 con 0x7f45a809e000 2023-10-01T07:55:44.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.965+0000 7f2f5ffff700 1 -- 172.21.15.26:0/3680002535 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f64011830 con 0x7f2f6806f5d0 2023-10-01T07:55:44.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.965+0000 7f2f5ffff700 1 -- 172.21.15.26:0/3680002535 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f64011990 con 0x7f2f6806f5d0 2023-10-01T07:55:44.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.965+0000 7f2f5ffff700 1 -- 172.21.15.26:0/3680002535 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f64011d20 con 0x7f2f6806f5d0 2023-10-01T07:55:44.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.966+0000 7f45b07ac700 1 -- 172.21.15.26:0/883381235 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45a809e000 msgr2=0x7f45a81339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:44.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.966+0000 7f45b07ac700 1 --2- 172.21.15.26:0/883381235 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45a809e000 0x7f45a81339f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f45980098a0 tx=0x7f4598009bb0 comp rx=0 tx=0).stop 2023-10-01T07:55:44.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.966+0000 7f2f6f3b3700 1 -- 172.21.15.26:0/3680002535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f6806f5d0 msgr2=0x7f2f6812cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:44.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.966+0000 7f2f6f3b3700 1 --2- 172.21.15.26:0/3680002535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f6806f5d0 0x7f2f6812cd90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2f640098f0 tx=0x7f2f64009c00 comp rx=0 tx=0).stop 2023-10-01T07:55:44.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.966+0000 7f45b07ac700 1 -- 172.21.15.26:0/883381235 shutdown_connections 2023-10-01T07:55:44.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.966+0000 7f2f6f3b3700 1 -- 172.21.15.26:0/3680002535 shutdown_connections 2023-10-01T07:55:44.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.966+0000 7f2f6f3b3700 1 --2- 172.21.15.26:0/3680002535 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f68066880 0x7f2f6812fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:44.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.966+0000 7f2f6f3b3700 1 --2- 172.21.15.26:0/3680002535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f6806f5d0 0x7f2f6812cd90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:44.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.966+0000 7f2f6f3b3700 1 --2- 172.21.15.26:0/3680002535 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f68066410 0x7f2f6812f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:44.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.966+0000 7f45b07ac700 1 --2- 172.21.15.26:0/883381235 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45a809d6f0 0x7f45a809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:44.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.966+0000 7f45b07ac700 1 --2- 172.21.15.26:0/883381235 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45a809e000 0x7f45a81339f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:44.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.966+0000 7f45b07ac700 1 -- 172.21.15.26:0/883381235 >> 172.21.15.26:0/883381235 conn(0x7f45a8066f50 msgr2=0x7f45a809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:44.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.966+0000 7f2f6f3b3700 1 -- 172.21.15.26:0/3680002535 >> 172.21.15.26:0/3680002535 conn(0x7f2f680a2aa0 msgr2=0x7f2f680a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:44.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.966+0000 7f45b07ac700 1 -- 172.21.15.26:0/883381235 shutdown_connections 2023-10-01T07:55:44.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.966+0000 7f45b07ac700 1 -- 172.21.15.26:0/883381235 wait complete. 2023-10-01T07:55:44.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.966+0000 7f2f6f3b3700 1 -- 172.21.15.26:0/3680002535 shutdown_connections 2023-10-01T07:55:44.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.966+0000 7f2f6f3b3700 1 -- 172.21.15.26:0/3680002535 wait complete. 2023-10-01T07:55:44.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.967+0000 7f45b07ac700 1 Processor -- start 2023-10-01T07:55:44.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.967+0000 7f2f6f3b3700 1 Processor -- start 2023-10-01T07:55:44.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.967+0000 7f2f6f3b3700 1 -- start start 2023-10-01T07:55:44.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.968+0000 7f2f6f3b3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f68066410 0x7f2f6809e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:44.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.968+0000 7f2f6f3b3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f68066880 0x7f2f68099d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:44.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.968+0000 7f2f6f3b3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f6806f5d0 0x7f2f6809a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:44.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.968+0000 7f2f6f3b3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6809c2c0 con 0x7f2f68066410 2023-10-01T07:55:44.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.968+0000 7f2f6f3b3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f68135210 con 0x7f2f6806f5d0 2023-10-01T07:55:44.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.968+0000 7f2f6f3b3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6809cea0 con 0x7f2f68066880 2023-10-01T07:55:44.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.968+0000 7f2f6d14f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f68066410 0x7f2f6809e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:44.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.968+0000 7f2f6d14f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f68066410 0x7f2f6809e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60184/0 (socket says 172.21.15.26:60184) 2023-10-01T07:55:44.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.968+0000 7f2f6d14f700 1 -- 172.21.15.26:0/2297700509 learned_addr learned my addr 172.21.15.26:0/2297700509 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:44.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.968+0000 7f2f6c94e700 1 --2- 172.21.15.26:0/2297700509 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f68066880 0x7f2f68099d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:44.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.968+0000 7f2f6d950700 1 --2- 172.21.15.26:0/2297700509 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f6806f5d0 0x7f2f6809a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:44.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.968+0000 7f45b07ac700 1 -- start start 2023-10-01T07:55:44.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.969+0000 7f45b07ac700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45a809d6f0 0x7f45a81cc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:44.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.969+0000 7f45b07ac700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45a809e000 0x7f45a81cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:44.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.969+0000 7f45b07ac700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45a809e410 0x7f45a81194b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:44.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.969+0000 7f45b07ac700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a812ac70 con 0x7f45a809e000 2023-10-01T07:55:44.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.969+0000 7f45b07ac700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a811cfd0 con 0x7f45a809d6f0 2023-10-01T07:55:44.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.969+0000 7f45b07ac700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45a80a2c90 con 0x7f45a809e410 2023-10-01T07:55:44.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.969+0000 7f45ae548700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45a809d6f0 0x7f45a81cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:44.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.969+0000 7f45ae548700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45a809d6f0 0x7f45a81cc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44420/0 (socket says 172.21.15.26:44420) 2023-10-01T07:55:44.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.969+0000 7f45ae548700 1 -- 172.21.15.26:0/342715697 learned_addr learned my addr 172.21.15.26:0/342715697 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:44.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.969+0000 7f45add47700 1 --2- 172.21.15.26:0/342715697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45a809e000 0x7f45a81cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:44.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.969+0000 7f45aed49700 1 --2- 172.21.15.26:0/342715697 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45a809e410 0x7f45a81194b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:44.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.968+0000 7f2f6d14f700 1 -- 172.21.15.26:0/2297700509 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f68066880 msgr2=0x7f2f68099d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:44.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.968+0000 7f2f6d14f700 1 --2- 172.21.15.26:0/2297700509 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f68066880 0x7f2f68099d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:44.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.968+0000 7f2f6d14f700 1 -- 172.21.15.26:0/2297700509 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f6806f5d0 msgr2=0x7f2f6809a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:44.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.968+0000 7f2f6d14f700 1 --2- 172.21.15.26:0/2297700509 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f6806f5d0 0x7f2f6809a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:44.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.968+0000 7f2f6d14f700 1 -- 172.21.15.26:0/2297700509 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f580094a0 con 0x7f2f68066410 2023-10-01T07:55:44.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.968+0000 7f2f6d14f700 1 --2- 172.21.15.26:0/2297700509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f68066410 0x7f2f6809e7f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2f64000c00 tx=0x7f2f64004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:44.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.969+0000 7f2f5dffb700 1 -- 172.21.15.26:0/2297700509 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f64004510 con 0x7f2f68066410 2023-10-01T07:55:44.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.969+0000 7f2f5dffb700 1 -- 172.21.15.26:0/2297700509 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f640036a0 con 0x7f2f68066410 2023-10-01T07:55:44.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.969+0000 7f2f5dffb700 1 -- 172.21.15.26:0/2297700509 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f64003a30 con 0x7f2f68066410 2023-10-01T07:55:44.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.969+0000 7f45add47700 1 -- 172.21.15.26:0/342715697 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45a809e410 msgr2=0x7f45a81194b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:44.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.969+0000 7f45add47700 1 --2- 172.21.15.26:0/342715697 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45a809e410 0x7f45a81194b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:44.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.969+0000 7f45add47700 1 -- 172.21.15.26:0/342715697 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45a809d6f0 msgr2=0x7f45a81cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:44.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.969+0000 7f45add47700 1 --2- 172.21.15.26:0/342715697 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45a809d6f0 0x7f45a81cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:44.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.969+0000 7f45add47700 1 -- 172.21.15.26:0/342715697 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45980094a0 con 0x7f45a809e000 2023-10-01T07:55:44.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.969+0000 7f45aed49700 1 --2- 172.21.15.26:0/342715697 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45a809e410 0x7f45a81194b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:44.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.970+0000 7f45add47700 1 --2- 172.21.15.26:0/342715697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45a809e000 0x7f45a81cced0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4598016000 tx=0x7f4598004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:44.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.970+0000 7f2f6f3b3700 1 -- 172.21.15.26:0/2297700509 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f64009550 con 0x7f2f68066410 2023-10-01T07:55:44.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.970+0000 7f2f6f3b3700 1 -- 172.21.15.26:0/2297700509 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f68129fa0 con 0x7f2f68066410 2023-10-01T07:55:44.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.972+0000 7f2f5dffb700 1 -- 172.21.15.26:0/2297700509 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2f64021070 con 0x7f2f68066410 2023-10-01T07:55:44.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.971+0000 7f459effd700 1 -- 172.21.15.26:0/342715697 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4598004510 con 0x7f45a809e000 2023-10-01T07:55:44.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.971+0000 7f459effd700 1 -- 172.21.15.26:0/342715697 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459801f070 con 0x7f45a809e000 2023-10-01T07:55:44.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.971+0000 7f45b07ac700 1 -- 172.21.15.26:0/342715697 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a809c710 con 0x7f45a809e000 2023-10-01T07:55:44.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.971+0000 7f459effd700 1 -- 172.21.15.26:0/342715697 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45980038e0 con 0x7f45a809e000 2023-10-01T07:55:44.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.971+0000 7f45b07ac700 1 -- 172.21.15.26:0/342715697 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a811ccf0 con 0x7f45a809e000 2023-10-01T07:55:44.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.972+0000 7f2f5dffb700 1 -- 172.21.15.26:0/2297700509 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2f64040b80 con 0x7f2f68066410 2023-10-01T07:55:44.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.972+0000 7f2f6f3b3700 1 -- 172.21.15.26:0/2297700509 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f68074ea0 con 0x7f2f68066410 2023-10-01T07:55:44.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.973+0000 7f45b07ac700 1 -- 172.21.15.26:0/342715697 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a8074ea0 con 0x7f45a809e000 2023-10-01T07:55:44.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.974+0000 7f459effd700 1 -- 172.21.15.26:0/342715697 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4598003a40 con 0x7f45a809e000 2023-10-01T07:55:44.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.974+0000 7f459effd700 1 -- 172.21.15.26:0/342715697 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4598021070 con 0x7f45a809e000 2023-10-01T07:55:44.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.980+0000 7f2f5dffb700 1 -- 172.21.15.26:0/2297700509 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2f64015070 con 0x7f2f68066410 2023-10-01T07:55:44.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:44.982+0000 7f459effd700 1 -- 172.21.15.26:0/342715697 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4598010d10 con 0x7f45a809e000 2023-10-01T07:55:45.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.058+0000 7f47d6a7f700 1 Processor -- start 2023-10-01T07:55:45.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.058+0000 7f47d6a7f700 1 -- start start 2023-10-01T07:55:45.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.059+0000 7f47d6a7f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f47d009d6f0 0x7f47d009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:45.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.059+0000 7f47d6a7f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f47d009e000 0x7f47d01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:45.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.059+0000 7f47d6a7f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f47d009e410 0x7f47d0133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:45.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.059+0000 7f47d6a7f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47d006b460 con 0x7f47d009e000 2023-10-01T07:55:45.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.059+0000 7f47d6a7f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d009b120 con 0x7f47d009d6f0 2023-10-01T07:55:45.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.059+0000 7f47d6a7f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47d009a7e0 con 0x7f47d009e410 2023-10-01T07:55:45.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.059+0000 7f47cffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f47d009e000 0x7f47d01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:45.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.059+0000 7f47d481b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f47d009d6f0 0x7f47d009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:45.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.059+0000 7f47cffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f47d009e000 0x7f47d01339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60212/0 (socket says 172.21.15.26:60212) 2023-10-01T07:55:45.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.059+0000 7f47cffff700 1 -- 172.21.15.26:0/3060465247 learned_addr learned my addr 172.21.15.26:0/3060465247 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:45.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.060+0000 7f47cffff700 1 -- 172.21.15.26:0/3060465247 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f47d009e410 msgr2=0x7f47d0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:45.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.060+0000 7f47cffff700 1 --2- 172.21.15.26:0/3060465247 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f47d009e410 0x7f47d0133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:45.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.060+0000 7f47cffff700 1 -- 172.21.15.26:0/3060465247 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f47d009d6f0 msgr2=0x7f47d009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:45.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.060+0000 7f47cffff700 1 --2- 172.21.15.26:0/3060465247 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f47d009d6f0 0x7f47d009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:45.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.060+0000 7f47cffff700 1 -- 172.21.15.26:0/3060465247 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d009a500 con 0x7f47d009e000 2023-10-01T07:55:45.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.060+0000 7f47d481b700 1 --2- 172.21.15.26:0/3060465247 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f47d009d6f0 0x7f47d009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:45.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.060+0000 7f47cffff700 1 --2- 172.21.15.26:0/3060465247 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47d009e000 0x7f47d01339f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f47bc0098f0 tx=0x7f47bc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec2ba18a984a55ec server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:45.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.060+0000 7f47cf7fe700 1 -- 172.21.15.26:0/3060465247 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc011830 con 0x7f47d009e000 2023-10-01T07:55:45.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.060+0000 7f47cf7fe700 1 -- 172.21.15.26:0/3060465247 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47bc011990 con 0x7f47d009e000 2023-10-01T07:55:45.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.060+0000 7f47cf7fe700 1 -- 172.21.15.26:0/3060465247 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc011d00 con 0x7f47d009e000 2023-10-01T07:55:45.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.061+0000 7f47d6a7f700 1 -- 172.21.15.26:0/3060465247 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47d009e000 msgr2=0x7f47d01339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:45.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.061+0000 7f47d6a7f700 1 --2- 172.21.15.26:0/3060465247 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47d009e000 0x7f47d01339f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f47bc0098f0 tx=0x7f47bc009c00 comp rx=0 tx=0).stop 2023-10-01T07:55:45.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.061+0000 7f47d6a7f700 1 -- 172.21.15.26:0/3060465247 shutdown_connections 2023-10-01T07:55:45.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.061+0000 7f47d6a7f700 1 --2- 172.21.15.26:0/3060465247 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f47d009e410 0x7f47d0133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:45.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.061+0000 7f47d6a7f700 1 --2- 172.21.15.26:0/3060465247 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f47d009d6f0 0x7f47d009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:45.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.061+0000 7f47d6a7f700 1 --2- 172.21.15.26:0/3060465247 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47d009e000 0x7f47d01339f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:45.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.061+0000 7f47d6a7f700 1 -- 172.21.15.26:0/3060465247 >> 172.21.15.26:0/3060465247 conn(0x7f47d0066f50 msgr2=0x7f47d009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:45.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.061+0000 7f47d6a7f700 1 -- 172.21.15.26:0/3060465247 shutdown_connections 2023-10-01T07:55:45.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.061+0000 7f47d6a7f700 1 -- 172.21.15.26:0/3060465247 wait complete. 2023-10-01T07:55:45.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.063+0000 7f47d6a7f700 1 Processor -- start 2023-10-01T07:55:45.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.063+0000 7f47d6a7f700 1 -- start start 2023-10-01T07:55:45.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.064+0000 7f47d6a7f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f47d009d6f0 0x7f47d01a5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:45.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.064+0000 7f47d6a7f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f47d009e000 0x7f47d01a62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:45.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.064+0000 7f47d6a7f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47d009e410 0x7f47d01a6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:45.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.064+0000 7f47d6a7f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d01a8c70 con 0x7f47d009e410 2023-10-01T07:55:45.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.064+0000 7f47d6a7f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d01a96c0 con 0x7f47d009d6f0 2023-10-01T07:55:45.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.064+0000 7f47d6a7f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47d01aa280 con 0x7f47d009e000 2023-10-01T07:55:45.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.064+0000 7f47cffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f47d009e000 0x7f47d01a62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:45.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.064+0000 7f47cffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f47d009e000 0x7f47d01a62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:38004/0 (socket says 172.21.15.26:38004) 2023-10-01T07:55:45.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.064+0000 7f47cffff700 1 -- 172.21.15.26:0/1522723029 learned_addr learned my addr 172.21.15.26:0/1522723029 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:45.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.064+0000 7f47d481b700 1 --2- 172.21.15.26:0/1522723029 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f47d009d6f0 0x7f47d01a5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:45.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.064+0000 7f47d501c700 1 --2- 172.21.15.26:0/1522723029 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47d009e410 0x7f47d01a6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:45.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.064+0000 7f47cffff700 1 -- 172.21.15.26:0/1522723029 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f47d009d6f0 msgr2=0x7f47d01a5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:45.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.064+0000 7f47cffff700 1 --2- 172.21.15.26:0/1522723029 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f47d009d6f0 0x7f47d01a5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:45.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.064+0000 7f47cffff700 1 -- 172.21.15.26:0/1522723029 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47d009e410 msgr2=0x7f47d01a6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:45.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.064+0000 7f47cffff700 1 --2- 172.21.15.26:0/1522723029 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47d009e410 0x7f47d01a6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:45.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.064+0000 7f47cffff700 1 -- 172.21.15.26:0/1522723029 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c40094a0 con 0x7f47d009e000 2023-10-01T07:55:45.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.065+0000 7f47d481b700 1 --2- 172.21.15.26:0/1522723029 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f47d009d6f0 0x7f47d01a5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:45.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.065+0000 7f47d501c700 1 --2- 172.21.15.26:0/1522723029 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47d009e410 0x7f47d01a6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:55:45.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.065+0000 7f47cffff700 1 --2- 172.21.15.26:0/1522723029 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f47d009e000 0x7f47d01a62e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f47bc013000 tx=0x7f47bc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:45.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.065+0000 7f47cd7fa700 1 -- 172.21.15.26:0/1522723029 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc004240 con 0x7f47d009e000 2023-10-01T07:55:45.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.065+0000 7f47cd7fa700 1 -- 172.21.15.26:0/1522723029 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47bc0043a0 con 0x7f47d009e000 2023-10-01T07:55:45.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.065+0000 7f47d6a7f700 1 -- 172.21.15.26:0/1522723029 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47bc009550 con 0x7f47d009e000 2023-10-01T07:55:45.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.065+0000 7f47d6a7f700 1 -- 172.21.15.26:0/1522723029 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47d01a7ab0 con 0x7f47d009e000 2023-10-01T07:55:45.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.065+0000 7f47cd7fa700 1 -- 172.21.15.26:0/1522723029 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc011e50 con 0x7f47d009e000 2023-10-01T07:55:45.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.066+0000 7f47cd7fa700 1 -- 172.21.15.26:0/1522723029 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f47bc0036a0 con 0x7f47d009e000 2023-10-01T07:55:45.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.066+0000 7f47d6a7f700 1 -- 172.21.15.26:0/1522723029 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b00052e0 con 0x7f47d009e000 2023-10-01T07:55:45.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.067+0000 7f47cd7fa700 1 -- 172.21.15.26:0/1522723029 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f47bc048f50 con 0x7f47d009e000 2023-10-01T07:55:45.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.076+0000 7f47cd7fa700 1 -- 172.21.15.26:0/1522723029 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f47bc015080 con 0x7f47d009e000 2023-10-01T07:55:45.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.191+0000 7f2f6f3b3700 1 -- 172.21.15.26:0/2297700509 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2f680713a0 con 0x7f2f68066410 2023-10-01T07:55:45.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.191+0000 7f2f5dffb700 1 -- 172.21.15.26:0/2297700509 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2f6400b9d0 con 0x7f2f68066410 2023-10-01T07:55:45.192 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:45.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.194+0000 7f2f6f3b3700 1 -- 172.21.15.26:0/2297700509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f68066410 msgr2=0x7f2f6809e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:45.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.194+0000 7f2f6f3b3700 1 --2- 172.21.15.26:0/2297700509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f68066410 0x7f2f6809e7f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2f64000c00 tx=0x7f2f64004750 comp rx=0 tx=0).stop 2023-10-01T07:55:45.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.194+0000 7f2f6f3b3700 1 -- 172.21.15.26:0/2297700509 shutdown_connections 2023-10-01T07:55:45.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.194+0000 7f2f6f3b3700 1 --2- 172.21.15.26:0/2297700509 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f6806f5d0 0x7f2f6809a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:45.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.194+0000 7f2f6f3b3700 1 --2- 172.21.15.26:0/2297700509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f68066410 0x7f2f6809e7f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:45.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.194+0000 7f2f6f3b3700 1 --2- 172.21.15.26:0/2297700509 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f68066880 0x7f2f68099d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:45.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.194+0000 7f2f6f3b3700 1 -- 172.21.15.26:0/2297700509 >> 172.21.15.26:0/2297700509 conn(0x7f2f680a2aa0 msgr2=0x7f2f6806eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:45.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.194+0000 7f2f6f3b3700 1 -- 172.21.15.26:0/2297700509 shutdown_connections 2023-10-01T07:55:45.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.194+0000 7f2f6f3b3700 1 -- 172.21.15.26:0/2297700509 wait complete. 2023-10-01T07:55:45.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.196+0000 7f45b07ac700 1 -- 172.21.15.26:0/342715697 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f45a806c360 con 0x7f45a809e000 2023-10-01T07:55:45.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.197+0000 7f459effd700 1 -- 172.21.15.26:0/342715697 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4598015070 con 0x7f45a809e000 2023-10-01T07:55:45.197 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:45.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.199+0000 7f45b07ac700 1 -- 172.21.15.26:0/342715697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45a809e000 msgr2=0x7f45a81cced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:45.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.199+0000 7f45b07ac700 1 --2- 172.21.15.26:0/342715697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45a809e000 0x7f45a81cced0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4598016000 tx=0x7f4598004750 comp rx=0 tx=0).stop 2023-10-01T07:55:45.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.203+0000 7f45b07ac700 1 -- 172.21.15.26:0/342715697 shutdown_connections 2023-10-01T07:55:45.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.203+0000 7f45b07ac700 1 --2- 172.21.15.26:0/342715697 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45a809e410 0x7f45a81194b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:45.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.203+0000 7f45b07ac700 1 --2- 172.21.15.26:0/342715697 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45a809d6f0 0x7f45a81cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:45.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.203+0000 7f45b07ac700 1 --2- 172.21.15.26:0/342715697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45a809e000 0x7f45a81cced0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:45.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.203+0000 7f45b07ac700 1 -- 172.21.15.26:0/342715697 >> 172.21.15.26:0/342715697 conn(0x7f45a8066f50 msgr2=0x7f45a8133f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:45.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.203+0000 7f45b07ac700 1 -- 172.21.15.26:0/342715697 shutdown_connections 2023-10-01T07:55:45.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.203+0000 7f45b07ac700 1 -- 172.21.15.26:0/342715697 wait complete. 2023-10-01T07:55:45.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.205+0000 7f1e6a4f2700 1 -- 172.21.15.26:0/1855396592 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1e640a1cb0 con 0x7f1e64136f50 2023-10-01T07:55:45.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.205+0000 7f1e60ff9700 1 -- 172.21.15.26:0/1855396592 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e5c018020 con 0x7f1e64136f50 2023-10-01T07:55:45.206 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:45.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.207+0000 7f1e6a4f2700 1 -- 172.21.15.26:0/1855396592 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e64136f50 msgr2=0x7f1e641c6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:45.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.207+0000 7f1e6a4f2700 1 --2- 172.21.15.26:0/1855396592 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e64136f50 0x7f1e641c6350 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c009ea0 tx=0x7f1e5c00c3a0 comp rx=0 tx=0).stop 2023-10-01T07:55:45.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.208+0000 7f1e6a4f2700 1 -- 172.21.15.26:0/1855396592 shutdown_connections 2023-10-01T07:55:45.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.208+0000 7f1e6a4f2700 1 --2- 172.21.15.26:0/1855396592 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e64136f50 0x7f1e641c6350 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:45.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.208+0000 7f1e6a4f2700 1 --2- 172.21.15.26:0/1855396592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e64131810 0x7f1e64119b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:45.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.208+0000 7f1e6a4f2700 1 --2- 172.21.15.26:0/1855396592 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e64134630 0x7f1e6411a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:45.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.208+0000 7f1e6a4f2700 1 -- 172.21.15.26:0/1855396592 >> 172.21.15.26:0/1855396592 conn(0x7f1e640a2aa0 msgr2=0x7f1e6409f000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:45.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.208+0000 7f1e6a4f2700 1 -- 172.21.15.26:0/1855396592 shutdown_connections 2023-10-01T07:55:45.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.208+0000 7f1e6a4f2700 1 -- 172.21.15.26:0/1855396592 wait complete. 2023-10-01T07:55:45.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:45.219 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:45.228 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:45.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.292+0000 7f47d6a7f700 1 -- 172.21.15.26:0/1522723029 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f47b0005590 con 0x7f47d009e000 2023-10-01T07:55:45.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.293+0000 7f47cd7fa700 1 -- 172.21.15.26:0/1522723029 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f47bc02c3f0 con 0x7f47d009e000 2023-10-01T07:55:45.293 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:45.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.295+0000 7f47d6a7f700 1 -- 172.21.15.26:0/1522723029 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f47d009e000 msgr2=0x7f47d01a62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:45.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.295+0000 7f47d6a7f700 1 --2- 172.21.15.26:0/1522723029 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f47d009e000 0x7f47d01a62e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f47bc013000 tx=0x7f47bc004750 comp rx=0 tx=0).stop 2023-10-01T07:55:45.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.295+0000 7f47d6a7f700 1 -- 172.21.15.26:0/1522723029 shutdown_connections 2023-10-01T07:55:45.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.295+0000 7f47d6a7f700 1 --2- 172.21.15.26:0/1522723029 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47d009e410 0x7f47d01a6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:45.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.295+0000 7f47d6a7f700 1 --2- 172.21.15.26:0/1522723029 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f47d009d6f0 0x7f47d01a5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:45.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.295+0000 7f47d6a7f700 1 --2- 172.21.15.26:0/1522723029 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f47d009e000 0x7f47d01a62e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:45.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.295+0000 7f47d6a7f700 1 -- 172.21.15.26:0/1522723029 >> 172.21.15.26:0/1522723029 conn(0x7f47d0066f50 msgr2=0x7f47d01bac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:45.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.295+0000 7f47d6a7f700 1 -- 172.21.15.26:0/1522723029 shutdown_connections 2023-10-01T07:55:45.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:45.295+0000 7f47d6a7f700 1 -- 172.21.15.26:0/1522723029 wait complete. 2023-10-01T07:55:45.309 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:46.211 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:46.220 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:46.229 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:46.310 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:46.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.367+0000 7fd20a23b700 1 Processor -- start 2023-10-01T07:55:46.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.367+0000 7fd20a23b700 1 -- start start 2023-10-01T07:55:46.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.368+0000 7fd20a23b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd20409d6f0 0x7fd20409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:46.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.368+0000 7fd20a23b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd20409e410 0x7fd204130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:46.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.368+0000 7fd20a23b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd20409f130 con 0x7fd20409e000 2023-10-01T07:55:46.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.368+0000 7fd20a23b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd20409f520 con 0x7fd20409e410 2023-10-01T07:55:46.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.368+0000 7fd20a23b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd20409e930 con 0x7fd20409d6f0 2023-10-01T07:55:46.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.368+0000 7fd203fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd20409e410 0x7fd204130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:46.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.368+0000 7fd203fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd20409e410 0x7fd204130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60236/0 (socket says 172.21.15.26:60236) 2023-10-01T07:55:46.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.368+0000 7fd203fff700 1 -- 172.21.15.26:0/2784210729 learned_addr learned my addr 172.21.15.26:0/2784210729 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:46.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.368+0000 7fd2037fe700 1 --2- 172.21.15.26:0/2784210729 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd20409d6f0 0x7fd20409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:46.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.369+0000 7fd203fff700 1 -- 172.21.15.26:0/2784210729 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd20409d6f0 msgr2=0x7fd20409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:46.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.369+0000 7fd203fff700 1 --2- 172.21.15.26:0/2784210729 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd20409d6f0 0x7fd20409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:46.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.369+0000 7fd203fff700 1 -- 172.21.15.26:0/2784210729 >> v1:172.21.15.26:6789/0 conn(0x7fd20409e000 legacy=0x7fd204130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:46.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.369+0000 7fd203fff700 1 -- 172.21.15.26:0/2784210729 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20409b2d0 con 0x7fd20409e410 2023-10-01T07:55:46.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.369+0000 7fd2037fe700 1 --2- 172.21.15.26:0/2784210729 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd20409d6f0 0x7fd20409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:55:46.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.369+0000 7fd203fff700 1 --2- 172.21.15.26:0/2784210729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd20409e410 0x7fd204130d70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00d150 tx=0x7fd1fc00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a271b321238a5e5b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:46.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.369+0000 7fd2027fc700 1 -- 172.21.15.26:0/2784210729 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc010070 con 0x7fd20409e410 2023-10-01T07:55:46.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.369+0000 7fd2027fc700 1 -- 172.21.15.26:0/2784210729 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1fc00ddc0 con 0x7fd20409e410 2023-10-01T07:55:46.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.369+0000 7fd2027fc700 1 -- 172.21.15.26:0/2784210729 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc00b310 con 0x7fd20409e410 2023-10-01T07:55:46.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.370+0000 7fd20a23b700 1 -- 172.21.15.26:0/2784210729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd20409e410 msgr2=0x7fd204130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:46.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.370+0000 7fd20a23b700 1 --2- 172.21.15.26:0/2784210729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd20409e410 0x7fd204130d70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00d150 tx=0x7fd1fc00d460 comp rx=0 tx=0).stop 2023-10-01T07:55:46.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.370+0000 7fd20a23b700 1 -- 172.21.15.26:0/2784210729 shutdown_connections 2023-10-01T07:55:46.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.370+0000 7fd20a23b700 1 --2- 172.21.15.26:0/2784210729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd20409e410 0x7fd204130d70 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:46.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.370+0000 7fd20a23b700 1 --2- 172.21.15.26:0/2784210729 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd20409d6f0 0x7fd20409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:46.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.370+0000 7fd20a23b700 1 -- 172.21.15.26:0/2784210729 >> 172.21.15.26:0/2784210729 conn(0x7fd204066f50 msgr2=0x7fd20409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:46.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.370+0000 7fd20a23b700 1 -- 172.21.15.26:0/2784210729 shutdown_connections 2023-10-01T07:55:46.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.370+0000 7fd20a23b700 1 -- 172.21.15.26:0/2784210729 wait complete. 2023-10-01T07:55:46.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.371+0000 7fd20a23b700 1 Processor -- start 2023-10-01T07:55:46.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.372+0000 7fd20a23b700 1 -- start start 2023-10-01T07:55:46.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.372+0000 7fd20a23b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd20409d6f0 0x7fd2041223c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:46.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.372+0000 7fd20a23b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd20409e000 0x7fd204122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:46.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.372+0000 7fd20a23b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd20409e410 0x7fd204122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:46.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.372+0000 7fd20a23b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd204125ee0 con 0x7fd20409e410 2023-10-01T07:55:46.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.372+0000 7fd20a23b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd204123fd0 con 0x7fd20409e000 2023-10-01T07:55:46.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.372+0000 7fd20a23b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2040a1d00 con 0x7fd20409d6f0 2023-10-01T07:55:46.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.372+0000 7fd203fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd20409e410 0x7fd204122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:46.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.372+0000 7fd203fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd20409e410 0x7fd204122e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60252/0 (socket says 172.21.15.26:60252) 2023-10-01T07:55:46.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.372+0000 7fd203fff700 1 -- 172.21.15.26:0/2934405059 learned_addr learned my addr 172.21.15.26:0/2934405059 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:46.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.372+0000 7fd202ffd700 1 --2- 172.21.15.26:0/2934405059 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd20409e000 0x7fd204122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:46.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.373+0000 7fd2037fe700 1 --2- 172.21.15.26:0/2934405059 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd20409d6f0 0x7fd2041223c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:46.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.373+0000 7fd203fff700 1 -- 172.21.15.26:0/2934405059 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd20409d6f0 msgr2=0x7fd2041223c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:46.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.373+0000 7fd203fff700 1 --2- 172.21.15.26:0/2934405059 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd20409d6f0 0x7fd2041223c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:46.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.373+0000 7fd203fff700 1 -- 172.21.15.26:0/2934405059 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd20409e000 msgr2=0x7fd204122900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:46.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.373+0000 7fd203fff700 1 --2- 172.21.15.26:0/2934405059 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd20409e000 0x7fd204122900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:46.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.373+0000 7fd203fff700 1 -- 172.21.15.26:0/2934405059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1fc00bd40 con 0x7fd20409e410 2023-10-01T07:55:46.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.373+0000 7fd203fff700 1 --2- 172.21.15.26:0/2934405059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd20409e410 0x7fd204122e40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc014000 tx=0x7fd1fc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:46.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.373+0000 7fd1ebfff700 1 -- 172.21.15.26:0/2934405059 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc009a10 con 0x7fd20409e410 2023-10-01T07:55:46.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.373+0000 7fd1ebfff700 1 -- 172.21.15.26:0/2934405059 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1fc009b70 con 0x7fd20409e410 2023-10-01T07:55:46.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.373+0000 7fd1ebfff700 1 -- 172.21.15.26:0/2934405059 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc00b4c0 con 0x7fd20409e410 2023-10-01T07:55:46.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.373+0000 7fd20a23b700 1 -- 172.21.15.26:0/2934405059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd20409c700 con 0x7fd20409e410 2023-10-01T07:55:46.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.373+0000 7fd20a23b700 1 -- 172.21.15.26:0/2934405059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd204124780 con 0x7fd20409e410 2023-10-01T07:55:46.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.374+0000 7fd1ebfff700 1 -- 172.21.15.26:0/2934405059 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd1fc004040 con 0x7fd20409e410 2023-10-01T07:55:46.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.375+0000 7fd1ebfff700 1 -- 172.21.15.26:0/2934405059 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd1fc041180 con 0x7fd20409e410 2023-10-01T07:55:46.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.375+0000 7fd20a23b700 1 -- 172.21.15.26:0/2934405059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2041258a0 con 0x7fd20409e410 2023-10-01T07:55:46.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.384+0000 7fd1ebfff700 1 -- 172.21.15.26:0/2934405059 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd2041258a0 con 0x7fd20409e410 2023-10-01T07:55:46.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.405+0000 7f1aaa3ed700 1 Processor -- start 2023-10-01T07:55:46.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.405+0000 7f1aaa3ed700 1 -- start start 2023-10-01T07:55:46.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.406+0000 7f1aaa3ed700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1aa409d6f0 0x7f1aa409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:46.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.406+0000 7f1aaa3ed700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1aa409e410 0x7f1aa4130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:46.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.406+0000 7f1aaa3ed700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa409f130 con 0x7f1aa409e000 2023-10-01T07:55:46.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.406+0000 7f1aaa3ed700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa409f520 con 0x7f1aa409e410 2023-10-01T07:55:46.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.406+0000 7f1aaa3ed700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa409e930 con 0x7f1aa409d6f0 2023-10-01T07:55:46.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.406+0000 7f1aa898a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1aa409e410 0x7f1aa4130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:46.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.406+0000 7f1aa898a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1aa409e410 0x7f1aa4130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44458/0 (socket says 172.21.15.26:44458) 2023-10-01T07:55:46.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.406+0000 7f1aa898a700 1 -- 172.21.15.26:0/1617476023 learned_addr learned my addr 172.21.15.26:0/1617476023 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:46.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.406+0000 7f1aa3fff700 1 --2- 172.21.15.26:0/1617476023 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1aa409d6f0 0x7f1aa409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:46.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.406+0000 7f1aa2ffd700 1 -- 172.21.15.26:0/1617476023 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 968658259 0 0) 0x7f1aa409f130 con 0x7f1aa409e000 2023-10-01T07:55:46.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.407+0000 7f1aa2ffd700 1 -- 172.21.15.26:0/1617476023 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a8c0035b0 con 0x7f1aa409e000 2023-10-01T07:55:46.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.407+0000 7f1aa3fff700 1 -- 172.21.15.26:0/1617476023 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1aa409e410 msgr2=0x7f1aa4130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:46.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.407+0000 7f1aa3fff700 1 --2- 172.21.15.26:0/1617476023 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1aa409e410 0x7f1aa4130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:46.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.407+0000 7f1aa3fff700 1 -- 172.21.15.26:0/1617476023 >> v1:172.21.15.26:6789/0 conn(0x7f1aa409e000 legacy=0x7f1aa4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:46.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.407+0000 7f1aa3fff700 1 -- 172.21.15.26:0/1617476023 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa409b2d0 con 0x7f1aa409d6f0 2023-10-01T07:55:46.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.407+0000 7f1aa898a700 1 --2- 172.21.15.26:0/1617476023 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1aa409e410 0x7f1aa4130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:46.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.407+0000 7f1aa3fff700 1 --2- 172.21.15.26:0/1617476023 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1aa409d6f0 0x7f1aa409dac0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1a94009870 tx=0x7f1a94009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b78c3db3d21fbb7f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:46.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.407+0000 7f1aa2ffd700 1 -- 172.21.15.26:0/1617476023 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a94011830 con 0x7f1aa409d6f0 2023-10-01T07:55:46.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.407+0000 7f1aa2ffd700 1 -- 172.21.15.26:0/1617476023 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a94011990 con 0x7f1aa409d6f0 2023-10-01T07:55:46.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.407+0000 7f1aa2ffd700 1 -- 172.21.15.26:0/1617476023 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a94011d20 con 0x7f1aa409d6f0 2023-10-01T07:55:46.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.408+0000 7fd2a7712700 1 Processor -- start 2023-10-01T07:55:46.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.408+0000 7f1aaa3ed700 1 -- 172.21.15.26:0/1617476023 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1aa409d6f0 msgr2=0x7f1aa409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:46.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.408+0000 7f1aaa3ed700 1 --2- 172.21.15.26:0/1617476023 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1aa409d6f0 0x7f1aa409dac0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1a94009870 tx=0x7f1a94009b80 comp rx=0 tx=0).stop 2023-10-01T07:55:46.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.408+0000 7f1aaa3ed700 1 -- 172.21.15.26:0/1617476023 shutdown_connections 2023-10-01T07:55:46.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.408+0000 7f1aaa3ed700 1 --2- 172.21.15.26:0/1617476023 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1aa409d6f0 0x7f1aa409dac0 secure :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1a94009870 tx=0x7f1a94009b80 comp rx=0 tx=0).stop 2023-10-01T07:55:46.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.408+0000 7f1aaa3ed700 1 --2- 172.21.15.26:0/1617476023 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1aa409e410 0x7f1aa4130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:46.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.408+0000 7f1aaa3ed700 1 -- 172.21.15.26:0/1617476023 >> 172.21.15.26:0/1617476023 conn(0x7f1aa4066f50 msgr2=0x7f1aa409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:46.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.408+0000 7fd2a7712700 1 -- start start 2023-10-01T07:55:46.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.409+0000 7fd2a7712700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2a0136710 0x7fd2a0138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:46.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.409+0000 7fd2a7712700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2a0139030 0x7fd2a013b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:46.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.409+0000 7fd2a7712700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a006ef30 con 0x7fd2a01338a0 2023-10-01T07:55:46.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.409+0000 7fd2a7712700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a006fef0 con 0x7fd2a0139030 2023-10-01T07:55:46.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.409+0000 7fd2a7712700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a01334b0 con 0x7fd2a0136710 2023-10-01T07:55:46.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.409+0000 7fd2a54ae700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd2a01338a0 0x7fd2a0133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49120/0 (socket says 172.21.15.26:49120) 2023-10-01T07:55:46.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.409+0000 7fd2a54ae700 1 -- 172.21.15.26:0/358364648 learned_addr learned my addr 172.21.15.26:0/358364648 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:46.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.409+0000 7fd2a4cad700 1 --2- 172.21.15.26:0/358364648 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2a0136710 0x7fd2a0138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:46.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.409+0000 7fd2a5caf700 1 --2- 172.21.15.26:0/358364648 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2a0139030 0x7fd2a013b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:46.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.409+0000 7fd297fff700 1 -- 172.21.15.26:0/358364648 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2409247954 0 0) 0x7fd2a006ef30 con 0x7fd2a01338a0 2023-10-01T07:55:46.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.409+0000 7fd297fff700 1 -- 172.21.15.26:0/358364648 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd28c0035b0 con 0x7fd2a01338a0 2023-10-01T07:55:46.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.409+0000 7f1aaa3ed700 1 -- 172.21.15.26:0/1617476023 shutdown_connections 2023-10-01T07:55:46.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.409+0000 7f1aaa3ed700 1 -- 172.21.15.26:0/1617476023 wait complete. 2023-10-01T07:55:46.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.409+0000 7fd2a5caf700 1 -- 172.21.15.26:0/358364648 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2a0136710 msgr2=0x7fd2a0138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:46.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.409+0000 7fd2a5caf700 1 --2- 172.21.15.26:0/358364648 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2a0136710 0x7fd2a0138af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:46.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.409+0000 7fd2a5caf700 1 -- 172.21.15.26:0/358364648 >> v1:172.21.15.26:6789/0 conn(0x7fd2a01338a0 legacy=0x7fd2a0133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:46.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.409+0000 7fd2a5caf700 1 -- 172.21.15.26:0/358364648 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a006fc30 con 0x7fd2a0139030 2023-10-01T07:55:46.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.410+0000 7fd2a5caf700 1 --2- 172.21.15.26:0/358364648 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2a0139030 0x7fd2a013b410 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd298009dc0 tx=0x7fd29800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c0b187b88be0dae server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:46.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.410+0000 7fd297fff700 1 -- 172.21.15.26:0/358364648 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29800e070 con 0x7fd2a0139030 2023-10-01T07:55:46.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.410+0000 7fd297fff700 1 -- 172.21.15.26:0/358364648 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29800bb20 con 0x7fd2a0139030 2023-10-01T07:55:46.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.410+0000 7fd297fff700 1 -- 172.21.15.26:0/358364648 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29800be90 con 0x7fd2a0139030 2023-10-01T07:55:46.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.411+0000 7f1aaa3ed700 1 Processor -- start 2023-10-01T07:55:46.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.411+0000 7fd2a7712700 1 -- 172.21.15.26:0/358364648 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2a0139030 msgr2=0x7fd2a013b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:46.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.411+0000 7fd2a7712700 1 --2- 172.21.15.26:0/358364648 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2a0139030 0x7fd2a013b410 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd298009dc0 tx=0x7fd29800b330 comp rx=0 tx=0).stop 2023-10-01T07:55:46.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.411+0000 7fd2a7712700 1 -- 172.21.15.26:0/358364648 shutdown_connections 2023-10-01T07:55:46.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.411+0000 7fd2a7712700 1 --2- 172.21.15.26:0/358364648 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2a0139030 0x7fd2a013b410 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:46.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.411+0000 7fd2a7712700 1 --2- 172.21.15.26:0/358364648 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2a0136710 0x7fd2a0138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:46.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.411+0000 7fd2a7712700 1 -- 172.21.15.26:0/358364648 >> 172.21.15.26:0/358364648 conn(0x7fd2a00a2aa0 msgr2=0x7fd2a00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:46.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.411+0000 7fd2a7712700 1 -- 172.21.15.26:0/358364648 shutdown_connections 2023-10-01T07:55:46.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.411+0000 7fd2a7712700 1 -- 172.21.15.26:0/358364648 wait complete. 2023-10-01T07:55:46.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.411+0000 7f1aaa3ed700 1 -- start start 2023-10-01T07:55:46.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.411+0000 7f1aaa3ed700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1aa409e000 0x7f1aa41c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:46.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.412+0000 7f1aaa3ed700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1aa409e410 0x7f1aa41c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:46.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.412+0000 7f1aaa3ed700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1aa41cc9f0 0x7f1aa41cce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:46.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.412+0000 7f1aaa3ed700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa4122360 con 0x7f1aa409e410 2023-10-01T07:55:46.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.412+0000 7f1aaa3ed700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa4121f60 con 0x7f1aa409e000 2023-10-01T07:55:46.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.412+0000 7f1aaa3ed700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa409c700 con 0x7f1aa41cc9f0 2023-10-01T07:55:46.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.412+0000 7f1aa37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1aa409e410 0x7f1aa41c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:46.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.412+0000 7f1aa3fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1aa409e000 0x7f1aa41c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:46.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.412+0000 7f1aa37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1aa409e410 0x7f1aa41c9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60268/0 (socket says 172.21.15.26:60268) 2023-10-01T07:55:46.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.412+0000 7f1aa37fe700 1 -- 172.21.15.26:0/408016376 learned_addr learned my addr 172.21.15.26:0/408016376 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:46.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.412+0000 7f1aa3fff700 1 -- 172.21.15.26:0/408016376 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1aa41cc9f0 msgr2=0x7f1aa41cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:46.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.412+0000 7f1aa3fff700 1 --2- 172.21.15.26:0/408016376 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1aa41cc9f0 0x7f1aa41cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:46.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.412+0000 7f1aa3fff700 1 -- 172.21.15.26:0/408016376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1aa409e410 msgr2=0x7f1aa41c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:46.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.412+0000 7f1aa3fff700 1 --2- 172.21.15.26:0/408016376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1aa409e410 0x7f1aa41c9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:46.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.412+0000 7f1aa3fff700 1 -- 172.21.15.26:0/408016376 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a9c00bd40 con 0x7f1aa409e000 2023-10-01T07:55:46.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.412+0000 7fd2a7712700 1 Processor -- start 2023-10-01T07:55:46.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.413+0000 7f1aa3fff700 1 --2- 172.21.15.26:0/408016376 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1aa409e000 0x7f1aa41c9760 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1a94016000 tx=0x7f1a94004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:46.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.413+0000 7f1aa0ff9700 1 -- 172.21.15.26:0/408016376 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a94004450 con 0x7f1aa409e000 2023-10-01T07:55:46.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.413+0000 7f1aa0ff9700 1 -- 172.21.15.26:0/408016376 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9401f070 con 0x7f1aa409e000 2023-10-01T07:55:46.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.413+0000 7f1aa0ff9700 1 -- 172.21.15.26:0/408016376 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a940038c0 con 0x7f1aa409e000 2023-10-01T07:55:46.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.413+0000 7f1aaa3ed700 1 -- 172.21.15.26:0/408016376 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a940094a0 con 0x7f1aa409e000 2023-10-01T07:55:46.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.413+0000 7f1aaa3ed700 1 -- 172.21.15.26:0/408016376 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa41218c0 con 0x7f1aa409e000 2023-10-01T07:55:46.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.413+0000 7fd2a7712700 1 -- start start 2023-10-01T07:55:46.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.413+0000 7fd2a7712700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2a01338a0 0x7fd2a0099a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:46.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.413+0000 7fd2a7712700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2a0136710 0x7fd2a0099f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:46.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.413+0000 7fd2a7712700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2a0139030 0x7fd2a009a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:46.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.413+0000 7fd2a7712700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a009b5a0 con 0x7fd2a01338a0 2023-10-01T07:55:46.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.413+0000 7fd2a7712700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a009d240 con 0x7fd2a0136710 2023-10-01T07:55:46.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.413+0000 7fd2a7712700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a009d4b0 con 0x7fd2a0139030 2023-10-01T07:55:46.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.414+0000 7fd2a4cad700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2a0136710 0x7fd2a0099f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:46.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.414+0000 7fd2a4cad700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2a0136710 0x7fd2a0099f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44482/0 (socket says 172.21.15.26:44482) 2023-10-01T07:55:46.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.414+0000 7fd2a4cad700 1 -- 172.21.15.26:0/1726875418 learned_addr learned my addr 172.21.15.26:0/1726875418 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:46.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.414+0000 7f1aa0ff9700 1 -- 172.21.15.26:0/408016376 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1a94003a20 con 0x7f1aa409e000 2023-10-01T07:55:46.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.414+0000 7fd2a5caf700 1 --2- 172.21.15.26:0/1726875418 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2a0139030 0x7fd2a009a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:46.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.414+0000 7fd2a4cad700 1 -- 172.21.15.26:0/1726875418 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2a0139030 msgr2=0x7fd2a009a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:46.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.414+0000 7fd2a4cad700 1 --2- 172.21.15.26:0/1726875418 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2a0139030 0x7fd2a009a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:46.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.414+0000 7fd2a4cad700 1 -- 172.21.15.26:0/1726875418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2a01338a0 msgr2=0x7fd2a0099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:46.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.414+0000 7fd2a4cad700 1 --2- 172.21.15.26:0/1726875418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2a01338a0 0x7fd2a0099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:46.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.414+0000 7fd2a4cad700 1 -- 172.21.15.26:0/1726875418 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd298009a70 con 0x7fd2a0136710 2023-10-01T07:55:46.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.415+0000 7fd2a4cad700 1 --2- 172.21.15.26:0/1726875418 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2a0136710 0x7fd2a0099f80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd29000e810 tx=0x7fd29000ebd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:46.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.415+0000 7fd295ffb700 1 -- 172.21.15.26:0/1726875418 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd290013610 con 0x7fd2a0136710 2023-10-01T07:55:46.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.415+0000 7f1aaa3ed700 1 -- 172.21.15.26:0/408016376 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa4074ea0 con 0x7f1aa409e000 2023-10-01T07:55:46.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.415+0000 7f1aa0ff9700 1 -- 172.21.15.26:0/408016376 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1a94021070 con 0x7f1aa409e000 2023-10-01T07:55:46.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.415+0000 7fd295ffb700 1 -- 172.21.15.26:0/1726875418 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd290013770 con 0x7fd2a0136710 2023-10-01T07:55:46.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.415+0000 7fd2a7712700 1 -- 172.21.15.26:0/1726875418 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a009bb50 con 0x7fd2a0136710 2023-10-01T07:55:46.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.415+0000 7fd295ffb700 1 -- 172.21.15.26:0/1726875418 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd290013b20 con 0x7fd2a0136710 2023-10-01T07:55:46.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.415+0000 7fd2a7712700 1 -- 172.21.15.26:0/1726875418 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a006f640 con 0x7fd2a0136710 2023-10-01T07:55:46.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.417+0000 7fd2a7712700 1 -- 172.21.15.26:0/1726875418 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2a0074ea0 con 0x7fd2a0136710 2023-10-01T07:55:46.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.421+0000 7f1aa0ff9700 1 -- 172.21.15.26:0/408016376 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1a9406e750 con 0x7f1aa409e000 2023-10-01T07:55:46.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.421+0000 7fd295ffb700 1 -- 172.21.15.26:0/1726875418 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd290013c80 con 0x7fd2a0136710 2023-10-01T07:55:46.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.421+0000 7fd295ffb700 1 -- 172.21.15.26:0/1726875418 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd29003f970 con 0x7fd2a0136710 2023-10-01T07:55:46.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.429+0000 7fd295ffb700 1 -- 172.21.15.26:0/1726875418 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd290026480 con 0x7fd2a0136710 2023-10-01T07:55:46.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.464+0000 7fb65b9d5700 1 Processor -- start 2023-10-01T07:55:46.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.464+0000 7fb65b9d5700 1 -- start start 2023-10-01T07:55:46.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.464+0000 7fb65b9d5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb654131810 0x7fb654131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:46.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.464+0000 7fb65b9d5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb65409a580 0x7fb654139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:46.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.464+0000 7fb65b9d5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6541313c0 con 0x7fb654099a40 2023-10-01T07:55:46.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.464+0000 7fb65b9d5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb65406e8c0 con 0x7fb654131810 2023-10-01T07:55:46.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.464+0000 7fb65b9d5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb654071d20 con 0x7fb65409a580 2023-10-01T07:55:46.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.465+0000 7fb659771700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb654131810 0x7fb654131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:46.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.465+0000 7fb659771700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb654131810 0x7fb654131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60282/0 (socket says 172.21.15.26:60282) 2023-10-01T07:55:46.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.465+0000 7fb659771700 1 -- 172.21.15.26:0/2179151776 learned_addr learned my addr 172.21.15.26:0/2179151776 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:46.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.465+0000 7fb659f72700 1 --2- 172.21.15.26:0/2179151776 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb65409a580 0x7fb654139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:46.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.465+0000 7fb659771700 1 -- 172.21.15.26:0/2179151776 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb65409a580 msgr2=0x7fb654139660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:46.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.465+0000 7fb659771700 1 --2- 172.21.15.26:0/2179151776 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb65409a580 0x7fb654139660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:46.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.465+0000 7fb659771700 1 -- 172.21.15.26:0/2179151776 >> v1:172.21.15.26:6789/0 conn(0x7fb654099a40 legacy=0x7fb654099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:46.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.465+0000 7fb64bfff700 1 -- 172.21.15.26:0/2179151776 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 357582933 0 0) 0x7fb6541313c0 con 0x7fb654099a40 2023-10-01T07:55:46.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.465+0000 7fb659771700 1 -- 172.21.15.26:0/2179151776 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6540721a0 con 0x7fb654131810 2023-10-01T07:55:46.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.465+0000 7fb659771700 1 --2- 172.21.15.26:0/2179151776 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb654131810 0x7fb654131be0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb6500098f0 tx=0x7fb650009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af35d07eaf41c0fa server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:46.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.466+0000 7fb64bfff700 1 -- 172.21.15.26:0/2179151776 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65000b8a0 con 0x7fb654131810 2023-10-01T07:55:46.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.466+0000 7fb64bfff700 1 -- 172.21.15.26:0/2179151776 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65000ba00 con 0x7fb654131810 2023-10-01T07:55:46.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.466+0000 7fb64bfff700 1 -- 172.21.15.26:0/2179151776 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65000bd90 con 0x7fb654131810 2023-10-01T07:55:46.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.467+0000 7fb65b9d5700 1 -- 172.21.15.26:0/2179151776 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb654131810 msgr2=0x7fb654131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:46.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.467+0000 7fb65b9d5700 1 --2- 172.21.15.26:0/2179151776 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb654131810 0x7fb654131be0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb6500098f0 tx=0x7fb650009c00 comp rx=0 tx=0).stop 2023-10-01T07:55:46.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.467+0000 7fb65b9d5700 1 -- 172.21.15.26:0/2179151776 shutdown_connections 2023-10-01T07:55:46.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.467+0000 7fb65b9d5700 1 --2- 172.21.15.26:0/2179151776 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb654131810 0x7fb654131be0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:46.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.467+0000 7fb65b9d5700 1 --2- 172.21.15.26:0/2179151776 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb65409a580 0x7fb654139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:46.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.467+0000 7fb65b9d5700 1 -- 172.21.15.26:0/2179151776 >> 172.21.15.26:0/2179151776 conn(0x7fb6540a2aa0 msgr2=0x7fb6540a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:46.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.467+0000 7fb65b9d5700 1 -- 172.21.15.26:0/2179151776 shutdown_connections 2023-10-01T07:55:46.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.467+0000 7fb65b9d5700 1 -- 172.21.15.26:0/2179151776 wait complete. 2023-10-01T07:55:46.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.468+0000 7fb65b9d5700 1 Processor -- start 2023-10-01T07:55:46.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.468+0000 7fb65b9d5700 1 -- start start 2023-10-01T07:55:46.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.469+0000 7fb65b9d5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb654099a40 0x7fb65406f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:46.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.469+0000 7fb65b9d5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb65409a580 0x7fb65406fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:46.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.469+0000 7fb65b9d5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb654131810 0x7fb654070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:46.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.469+0000 7fb65b9d5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb654070ae0 con 0x7fb65409a580 2023-10-01T07:55:46.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.469+0000 7fb65b9d5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb65411e2a0 con 0x7fb654099a40 2023-10-01T07:55:46.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.469+0000 7fb65b9d5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb65411f2e0 con 0x7fb654131810 2023-10-01T07:55:46.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.469+0000 7fb658f70700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb65409a580 0x7fb65406fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:46.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.469+0000 7fb658f70700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb65409a580 0x7fb65406fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60284/0 (socket says 172.21.15.26:60284) 2023-10-01T07:55:46.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.469+0000 7fb658f70700 1 -- 172.21.15.26:0/510852794 learned_addr learned my addr 172.21.15.26:0/510852794 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:46.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.469+0000 7fb659771700 1 --2- 172.21.15.26:0/510852794 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb654099a40 0x7fb65406f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:46.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.470+0000 7fb659f72700 1 --2- 172.21.15.26:0/510852794 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb654131810 0x7fb654070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:46.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.470+0000 7fb658f70700 1 -- 172.21.15.26:0/510852794 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb654131810 msgr2=0x7fb654070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:46.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.470+0000 7fb658f70700 1 --2- 172.21.15.26:0/510852794 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb654131810 0x7fb654070090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:46.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.470+0000 7fb658f70700 1 -- 172.21.15.26:0/510852794 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb654099a40 msgr2=0x7fb65406f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:46.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.470+0000 7fb658f70700 1 --2- 172.21.15.26:0/510852794 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb654099a40 0x7fb65406f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:46.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.470+0000 7fb658f70700 1 -- 172.21.15.26:0/510852794 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb650009550 con 0x7fb65409a580 2023-10-01T07:55:46.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.470+0000 7fb658f70700 1 --2- 172.21.15.26:0/510852794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb65409a580 0x7fb65406fb50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb64400c520 tx=0x7fb64400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:46.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.470+0000 7fb649ffb700 1 -- 172.21.15.26:0/510852794 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6440054e0 con 0x7fb65409a580 2023-10-01T07:55:46.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.470+0000 7fb649ffb700 1 -- 172.21.15.26:0/510852794 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb644003680 con 0x7fb65409a580 2023-10-01T07:55:46.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.470+0000 7fb65b9d5700 1 -- 172.21.15.26:0/510852794 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6540a1af0 con 0x7fb65409a580 2023-10-01T07:55:46.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.470+0000 7fb649ffb700 1 -- 172.21.15.26:0/510852794 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb644003a30 con 0x7fb65409a580 2023-10-01T07:55:46.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.471+0000 7fb65b9d5700 1 -- 172.21.15.26:0/510852794 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb65411ed40 con 0x7fb65409a580 2023-10-01T07:55:46.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.471+0000 7fb649ffb700 1 -- 172.21.15.26:0/510852794 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb644003b90 con 0x7fb65409a580 2023-10-01T07:55:46.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.472+0000 7fb649ffb700 1 -- 172.21.15.26:0/510852794 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb64403ec10 con 0x7fb65409a580 2023-10-01T07:55:46.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.472+0000 7fb65b9d5700 1 -- 172.21.15.26:0/510852794 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb654074ea0 con 0x7fb65409a580 2023-10-01T07:55:46.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.481+0000 7fb649ffb700 1 -- 172.21.15.26:0/510852794 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb644017020 con 0x7fb65409a580 2023-10-01T07:55:46.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.598+0000 7fd20a23b700 1 -- 172.21.15.26:0/2934405059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd2041258a0 con 0x7fd20409e410 2023-10-01T07:55:46.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.598+0000 7fd1ebfff700 1 -- 172.21.15.26:0/2934405059 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd2041258a0 con 0x7fd20409e410 2023-10-01T07:55:46.599 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:46.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.601+0000 7fd20a23b700 1 -- 172.21.15.26:0/2934405059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd20409e410 msgr2=0x7fd204122e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:46.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.601+0000 7fd20a23b700 1 --2- 172.21.15.26:0/2934405059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd20409e410 0x7fd204122e40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc014000 tx=0x7fd1fc004ad0 comp rx=0 tx=0).stop 2023-10-01T07:55:46.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.601+0000 7fd20a23b700 1 -- 172.21.15.26:0/2934405059 shutdown_connections 2023-10-01T07:55:46.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.601+0000 7fd20a23b700 1 --2- 172.21.15.26:0/2934405059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd20409e410 0x7fd204122e40 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:46.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.601+0000 7fd20a23b700 1 --2- 172.21.15.26:0/2934405059 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd20409d6f0 0x7fd2041223c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:46.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.601+0000 7fd20a23b700 1 --2- 172.21.15.26:0/2934405059 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd20409e000 0x7fd204122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:46.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.601+0000 7fd20a23b700 1 -- 172.21.15.26:0/2934405059 >> 172.21.15.26:0/2934405059 conn(0x7fd204066f50 msgr2=0x7fd204071030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:46.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.601+0000 7fd20a23b700 1 -- 172.21.15.26:0/2934405059 shutdown_connections 2023-10-01T07:55:46.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.601+0000 7fd20a23b700 1 -- 172.21.15.26:0/2934405059 wait complete. 2023-10-01T07:55:46.615 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:46.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.640+0000 7f1aaa3ed700 1 -- 172.21.15.26:0/408016376 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1aa411ff50 con 0x7f1aa409e000 2023-10-01T07:55:46.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.640+0000 7f1aa0ff9700 1 -- 172.21.15.26:0/408016376 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1a9402b070 con 0x7f1aa409e000 2023-10-01T07:55:46.641 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:46.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.642+0000 7f1aaa3ed700 1 -- 172.21.15.26:0/408016376 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1aa409e000 msgr2=0x7f1aa41c9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:46.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.642+0000 7f1aaa3ed700 1 --2- 172.21.15.26:0/408016376 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1aa409e000 0x7f1aa41c9760 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1a94016000 tx=0x7f1a94004750 comp rx=0 tx=0).stop 2023-10-01T07:55:46.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.642+0000 7f1aaa3ed700 1 -- 172.21.15.26:0/408016376 shutdown_connections 2023-10-01T07:55:46.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.642+0000 7f1aaa3ed700 1 --2- 172.21.15.26:0/408016376 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1aa41cc9f0 0x7f1aa41cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:46.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.642+0000 7f1aaa3ed700 1 --2- 172.21.15.26:0/408016376 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1aa409e000 0x7f1aa41c9760 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:46.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.642+0000 7f1aaa3ed700 1 --2- 172.21.15.26:0/408016376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1aa409e410 0x7f1aa41c9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:46.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.642+0000 7f1aaa3ed700 1 -- 172.21.15.26:0/408016376 >> 172.21.15.26:0/408016376 conn(0x7f1aa4066f50 msgr2=0x7f1aa4071010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:46.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.642+0000 7f1aaa3ed700 1 -- 172.21.15.26:0/408016376 shutdown_connections 2023-10-01T07:55:46.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.642+0000 7f1aaa3ed700 1 -- 172.21.15.26:0/408016376 wait complete. 2023-10-01T07:55:46.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.643+0000 7fd2a7712700 1 -- 172.21.15.26:0/1726875418 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd2a009ce50 con 0x7fd2a0136710 2023-10-01T07:55:46.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.643+0000 7fd295ffb700 1 -- 172.21.15.26:0/1726875418 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd29002b090 con 0x7fd2a0136710 2023-10-01T07:55:46.645 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:46.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.646+0000 7fd2a7712700 1 -- 172.21.15.26:0/1726875418 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2a0136710 msgr2=0x7fd2a0099f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:46.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.646+0000 7fd2a7712700 1 --2- 172.21.15.26:0/1726875418 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2a0136710 0x7fd2a0099f80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd29000e810 tx=0x7fd29000ebd0 comp rx=0 tx=0).stop 2023-10-01T07:55:46.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.646+0000 7fd2a7712700 1 -- 172.21.15.26:0/1726875418 shutdown_connections 2023-10-01T07:55:46.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.646+0000 7fd2a7712700 1 --2- 172.21.15.26:0/1726875418 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2a0139030 0x7fd2a009a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:46.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.646+0000 7fd2a7712700 1 --2- 172.21.15.26:0/1726875418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2a01338a0 0x7fd2a0099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:46.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.646+0000 7fd2a7712700 1 --2- 172.21.15.26:0/1726875418 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2a0136710 0x7fd2a0099f80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:46.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.646+0000 7fd2a7712700 1 -- 172.21.15.26:0/1726875418 >> 172.21.15.26:0/1726875418 conn(0x7fd2a00a2aa0 msgr2=0x7fd2a0137200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:46.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.646+0000 7fd2a7712700 1 -- 172.21.15.26:0/1726875418 shutdown_connections 2023-10-01T07:55:46.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.646+0000 7fd2a7712700 1 -- 172.21.15.26:0/1726875418 wait complete. 2023-10-01T07:55:46.659 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:46.663 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:46.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.693+0000 7fb65b9d5700 1 -- 172.21.15.26:0/510852794 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb65406b9e0 con 0x7fb65409a580 2023-10-01T07:55:46.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.693+0000 7fb649ffb700 1 -- 172.21.15.26:0/510852794 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb644003e40 con 0x7fb65409a580 2023-10-01T07:55:46.694 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:46.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.696+0000 7fb65b9d5700 1 -- 172.21.15.26:0/510852794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb65409a580 msgr2=0x7fb65406fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:46.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.696+0000 7fb65b9d5700 1 --2- 172.21.15.26:0/510852794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb65409a580 0x7fb65406fb50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb64400c520 tx=0x7fb64400c830 comp rx=0 tx=0).stop 2023-10-01T07:55:46.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.696+0000 7fb65b9d5700 1 -- 172.21.15.26:0/510852794 shutdown_connections 2023-10-01T07:55:46.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.696+0000 7fb65b9d5700 1 --2- 172.21.15.26:0/510852794 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb654131810 0x7fb654070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:46.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.696+0000 7fb65b9d5700 1 --2- 172.21.15.26:0/510852794 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb654099a40 0x7fb65406f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:46.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.696+0000 7fb65b9d5700 1 --2- 172.21.15.26:0/510852794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb65409a580 0x7fb65406fb50 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:46.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.696+0000 7fb65b9d5700 1 -- 172.21.15.26:0/510852794 >> 172.21.15.26:0/510852794 conn(0x7fb6540a2aa0 msgr2=0x7fb65412e680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:46.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.696+0000 7fb65b9d5700 1 -- 172.21.15.26:0/510852794 shutdown_connections 2023-10-01T07:55:46.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:46.696+0000 7fb65b9d5700 1 -- 172.21.15.26:0/510852794 wait complete. 2023-10-01T07:55:46.709 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:47.616 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:47.660 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:47.664 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:47.710 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:47.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.776+0000 7fa88ac09700 1 Processor -- start 2023-10-01T07:55:47.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.776+0000 7fa88ac09700 1 -- start start 2023-10-01T07:55:47.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.776+0000 7fa88ac09700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa88409e930 0x7fa88409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:47.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.777+0000 7fa88ac09700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa88409f650 0x7fa884131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:47.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.777+0000 7fa88ac09700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa884070940 con 0x7fa88409f240 2023-10-01T07:55:47.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.777+0000 7fa88ac09700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa88406fd60 con 0x7fa88409f650 2023-10-01T07:55:47.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.777+0000 7fa88ac09700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa88406fa80 con 0x7fa88409e930 2023-10-01T07:55:47.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.777+0000 7fa883fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa88409f240 0x7fa8841317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49132/0 (socket says 172.21.15.26:49132) 2023-10-01T07:55:47.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.777+0000 7fa883fff700 1 -- 172.21.15.26:0/2720359476 learned_addr learned my addr 172.21.15.26:0/2720359476 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:47.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.777+0000 7fa8891a6700 1 --2- 172.21.15.26:0/2720359476 >> v2:172.21.15.26:3300/0 conn(0x7fa88409f650 0x7fa884131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:47.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.777+0000 7fa8837fe700 1 -- 172.21.15.26:0/2720359476 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1097820206 0 0) 0x7fa884070940 con 0x7fa88409f240 2023-10-01T07:55:47.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.777+0000 7fa8837fe700 1 -- 172.21.15.26:0/2720359476 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8740035b0 con 0x7fa88409f240 2023-10-01T07:55:47.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.777+0000 7fa8891a6700 1 -- 172.21.15.26:0/2720359476 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa88409e930 msgr2=0x7fa88409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:47.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.777+0000 7fa8891a6700 1 --2- 172.21.15.26:0/2720359476 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa88409e930 0x7fa88409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:47.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.777+0000 7fa8891a6700 1 -- 172.21.15.26:0/2720359476 >> v1:172.21.15.26:6789/0 conn(0x7fa88409f240 legacy=0x7fa8841317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:47.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.777+0000 7fa8891a6700 1 -- 172.21.15.26:0/2720359476 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88409fb60 con 0x7fa88409f650 2023-10-01T07:55:47.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.778+0000 7fa8891a6700 1 --2- 172.21.15.26:0/2720359476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa88409f650 0x7fa884131f00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa87c009d90 tx=0x7fa87c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9481903a3a440449 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:47.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.778+0000 7fa8837fe700 1 -- 172.21.15.26:0/2720359476 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c00e070 con 0x7fa88409f650 2023-10-01T07:55:47.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.778+0000 7fa8837fe700 1 -- 172.21.15.26:0/2720359476 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87c00bb20 con 0x7fa88409f650 2023-10-01T07:55:47.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.778+0000 7fa8837fe700 1 -- 172.21.15.26:0/2720359476 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c012430 con 0x7fa88409f650 2023-10-01T07:55:47.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.778+0000 7fa88ac09700 1 -- 172.21.15.26:0/2720359476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa88409f650 msgr2=0x7fa884131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:47.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.778+0000 7fa88ac09700 1 --2- 172.21.15.26:0/2720359476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa88409f650 0x7fa884131f00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa87c009d90 tx=0x7fa87c00b330 comp rx=0 tx=0).stop 2023-10-01T07:55:47.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.779+0000 7fa88ac09700 1 -- 172.21.15.26:0/2720359476 shutdown_connections 2023-10-01T07:55:47.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.779+0000 7fa88ac09700 1 --2- 172.21.15.26:0/2720359476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa88409f650 0x7fa884131f00 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:47.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.779+0000 7fa88ac09700 1 --2- 172.21.15.26:0/2720359476 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa88409e930 0x7fa88409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:47.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.779+0000 7fa88ac09700 1 -- 172.21.15.26:0/2720359476 >> 172.21.15.26:0/2720359476 conn(0x7fa8840a4210 msgr2=0x7fa8840a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:47.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.779+0000 7fa88ac09700 1 -- 172.21.15.26:0/2720359476 shutdown_connections 2023-10-01T07:55:47.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.779+0000 7fa88ac09700 1 -- 172.21.15.26:0/2720359476 wait complete. 2023-10-01T07:55:47.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.780+0000 7fa88ac09700 1 Processor -- start 2023-10-01T07:55:47.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.780+0000 7fa88ac09700 1 -- start start 2023-10-01T07:55:47.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.781+0000 7fa88ac09700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa88409e930 0x7fa8841a39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:47.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.781+0000 7fa88ac09700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa88409f240 0x7fa8841a3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:47.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.781+0000 7fa88ac09700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa88409f650 0x7fa8841a4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:47.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.781+0000 7fa88ac09700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8841a2ae0 con 0x7fa88409f650 2023-10-01T07:55:47.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.781+0000 7fa88ac09700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8841a2dc0 con 0x7fa88409e930 2023-10-01T07:55:47.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.781+0000 7fa88ac09700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8840a31d0 con 0x7fa88409f240 2023-10-01T07:55:47.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.782+0000 7fa8891a6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa88409f650 0x7fa8841a4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:47.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.782+0000 7fa8889a5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa88409e930 0x7fa8841a39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:47.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.782+0000 7fa8891a6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa88409f650 0x7fa8841a4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60302/0 (socket says 172.21.15.26:60302) 2023-10-01T07:55:47.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.782+0000 7fa8891a6700 1 -- 172.21.15.26:0/2704984596 learned_addr learned my addr 172.21.15.26:0/2704984596 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:47.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.782+0000 7fa8889a5700 1 --2- 172.21.15.26:0/2704984596 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa88409e930 0x7fa8841a39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44510/0 (socket says 172.21.15.26:44510) 2023-10-01T07:55:47.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.782+0000 7fa8891a6700 1 -- 172.21.15.26:0/2704984596 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa88409f240 msgr2=0x7fa8841a3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:47.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.782+0000 7fa8891a6700 1 --2- 172.21.15.26:0/2704984596 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa88409f240 0x7fa8841a3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:47.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.782+0000 7fa8891a6700 1 -- 172.21.15.26:0/2704984596 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa88409e930 msgr2=0x7fa8841a39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:47.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.782+0000 7fa8891a6700 1 --2- 172.21.15.26:0/2704984596 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa88409e930 0x7fa8841a39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:47.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.782+0000 7fa8891a6700 1 -- 172.21.15.26:0/2704984596 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87c009a70 con 0x7fa88409f650 2023-10-01T07:55:47.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.782+0000 7fa8889a5700 1 --2- 172.21.15.26:0/2704984596 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa88409e930 0x7fa8841a39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:47.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.782+0000 7fa8891a6700 1 --2- 172.21.15.26:0/2704984596 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa88409f650 0x7fa8841a4420 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa87c00b370 tx=0x7fa87c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:47.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.782+0000 7fa8817fa700 1 -- 172.21.15.26:0/2704984596 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c012430 con 0x7fa88409f650 2023-10-01T07:55:47.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.783+0000 7fa8817fa700 1 -- 172.21.15.26:0/2704984596 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87c020070 con 0x7fa88409f650 2023-10-01T07:55:47.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.783+0000 7fa8817fa700 1 -- 172.21.15.26:0/2704984596 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c004280 con 0x7fa88409f650 2023-10-01T07:55:47.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.783+0000 7fa88ac09700 1 -- 172.21.15.26:0/2704984596 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8840a0190 con 0x7fa88409f650 2023-10-01T07:55:47.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.783+0000 7fa88ac09700 1 -- 172.21.15.26:0/2704984596 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8841a1da0 con 0x7fa88409f650 2023-10-01T07:55:47.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.784+0000 7fa8817fa700 1 -- 172.21.15.26:0/2704984596 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa87c0043e0 con 0x7fa88409f650 2023-10-01T07:55:47.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.784+0000 7fa8817fa700 1 -- 172.21.15.26:0/2704984596 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa87c022070 con 0x7fa88409f650 2023-10-01T07:55:47.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.784+0000 7fa88ac09700 1 -- 172.21.15.26:0/2704984596 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa88406d850 con 0x7fa88409f650 2023-10-01T07:55:47.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.789+0000 7fa8817fa700 1 -- 172.21.15.26:0/2704984596 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa87c046060 con 0x7fa88409f650 2023-10-01T07:55:47.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.807+0000 7f9c5f8e5700 1 Processor -- start 2023-10-01T07:55:47.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.807+0000 7f9c5f8e5700 1 -- start start 2023-10-01T07:55:47.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.808+0000 7f9c5f8e5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c5806e570 0x7f9c5806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:47.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.808+0000 7f9c5f8e5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9c5806ee80 0x7f9c58134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:47.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.808+0000 7f9c5f8e5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c58070ee0 con 0x7f9c5809eca0 2023-10-01T07:55:47.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.808+0000 7f9c5f8e5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c58071480 con 0x7f9c5806ee80 2023-10-01T07:55:47.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.808+0000 7f9c5f8e5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c58071b90 con 0x7f9c5806e570 2023-10-01T07:55:47.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.808+0000 7f9c5de82700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9c5806ee80 0x7f9c58134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:47.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.808+0000 7f9c5de82700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9c5806ee80 0x7f9c58134d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60312/0 (socket says 172.21.15.26:60312) 2023-10-01T07:55:47.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.808+0000 7f9c5de82700 1 -- 172.21.15.26:0/4035222332 learned_addr learned my addr 172.21.15.26:0/4035222332 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:47.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.808+0000 7f9c5d681700 1 --2- 172.21.15.26:0/4035222332 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c5806e570 0x7f9c5806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:47.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.809+0000 7f9c4ffff700 1 -- 172.21.15.26:0/4035222332 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2710144143 0 0) 0x7f9c58070ee0 con 0x7f9c5809eca0 2023-10-01T07:55:47.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.809+0000 7f9c5de82700 1 -- 172.21.15.26:0/4035222332 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c5806e570 msgr2=0x7f9c5806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:47.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.809+0000 7f9c5de82700 1 --2- 172.21.15.26:0/4035222332 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c5806e570 0x7f9c5806e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:47.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.809+0000 7f9c5de82700 1 -- 172.21.15.26:0/4035222332 >> v1:172.21.15.26:6789/0 conn(0x7f9c5809eca0 legacy=0x7f9c58134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:47.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.809+0000 7f9c5de82700 1 -- 172.21.15.26:0/4035222332 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c580711a0 con 0x7f9c5806ee80 2023-10-01T07:55:47.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.809+0000 7f9c5de82700 1 --2- 172.21.15.26:0/4035222332 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c5806ee80 0x7f9c58134d20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9c50009e50 tx=0x7f9c5000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85c2c2fe5416ac2b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:47.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.809+0000 7f9c4ffff700 1 -- 172.21.15.26:0/4035222332 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5000e070 con 0x7f9c5806ee80 2023-10-01T07:55:47.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.809+0000 7f9c4ffff700 1 -- 172.21.15.26:0/4035222332 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5000b910 con 0x7f9c5806ee80 2023-10-01T07:55:47.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.809+0000 7f9c4ffff700 1 -- 172.21.15.26:0/4035222332 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5000bcc0 con 0x7f9c5806ee80 2023-10-01T07:55:47.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.810+0000 7f9c5f8e5700 1 -- 172.21.15.26:0/4035222332 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c5806ee80 msgr2=0x7f9c58134d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:47.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.810+0000 7f9c5f8e5700 1 --2- 172.21.15.26:0/4035222332 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c5806ee80 0x7f9c58134d20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9c50009e50 tx=0x7f9c5000b330 comp rx=0 tx=0).stop 2023-10-01T07:55:47.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.810+0000 7f9c5f8e5700 1 -- 172.21.15.26:0/4035222332 shutdown_connections 2023-10-01T07:55:47.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.810+0000 7f9c5f8e5700 1 --2- 172.21.15.26:0/4035222332 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c5806ee80 0x7f9c58134d20 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:47.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.810+0000 7f9c5f8e5700 1 --2- 172.21.15.26:0/4035222332 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c5806e570 0x7f9c5806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:47.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.810+0000 7f9c5f8e5700 1 -- 172.21.15.26:0/4035222332 >> 172.21.15.26:0/4035222332 conn(0x7f9c580a2aa0 msgr2=0x7f9c580a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:47.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.810+0000 7f9c5f8e5700 1 -- 172.21.15.26:0/4035222332 shutdown_connections 2023-10-01T07:55:47.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.810+0000 7f9c5f8e5700 1 -- 172.21.15.26:0/4035222332 wait complete. 2023-10-01T07:55:47.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.811+0000 7f9c5f8e5700 1 Processor -- start 2023-10-01T07:55:47.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.811+0000 7f9c5f8e5700 1 -- start start 2023-10-01T07:55:47.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.811+0000 7f9c5f8e5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c5806e570 0x7f9c581231a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:47.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.811+0000 7f9c5f8e5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c5806ee80 0x7f9c581236e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:47.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.812+0000 7f9c5f8e5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c58123c20 0x7f9c581d2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:47.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.812+0000 7f9c5f8e5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c58124cc0 con 0x7f9c5806e570 2023-10-01T07:55:47.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.812+0000 7f9c5f8e5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c58126300 con 0x7f9c5806ee80 2023-10-01T07:55:47.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.812+0000 7f9c5f8e5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c581269d0 con 0x7f9c58123c20 2023-10-01T07:55:47.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.812+0000 7f9c5ce80700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c5806ee80 0x7f9c581236e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:47.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.812+0000 7f9c5d681700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c5806e570 0x7f9c581231a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:47.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.812+0000 7f9c5ce80700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c5806ee80 0x7f9c581236e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44526/0 (socket says 172.21.15.26:44526) 2023-10-01T07:55:47.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.812+0000 7f9c5ce80700 1 -- 172.21.15.26:0/546772458 learned_addr learned my addr 172.21.15.26:0/546772458 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:47.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.812+0000 7f9c5de82700 1 --2- 172.21.15.26:0/546772458 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c58123c20 0x7f9c581d2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:47.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.812+0000 7f9c5d681700 1 -- 172.21.15.26:0/546772458 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c58123c20 msgr2=0x7f9c581d2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:47.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.812+0000 7f9c5d681700 1 --2- 172.21.15.26:0/546772458 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c58123c20 0x7f9c581d2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:47.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.812+0000 7f9c5d681700 1 -- 172.21.15.26:0/546772458 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c5806ee80 msgr2=0x7f9c581236e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:47.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.812+0000 7f9c5d681700 1 --2- 172.21.15.26:0/546772458 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c5806ee80 0x7f9c581236e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:47.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.812+0000 7f9c5d681700 1 -- 172.21.15.26:0/546772458 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c50009b30 con 0x7f9c5806e570 2023-10-01T07:55:47.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.812+0000 7f9c5d681700 1 --2- 172.21.15.26:0/546772458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c5806e570 0x7f9c581231a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9c5400e930 tx=0x7f9c5400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:47.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.813+0000 7f9c4dffb700 1 -- 172.21.15.26:0/546772458 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5400ee80 con 0x7f9c5806e570 2023-10-01T07:55:47.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.813+0000 7f9c4dffb700 1 -- 172.21.15.26:0/546772458 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5400c850 con 0x7f9c5806e570 2023-10-01T07:55:47.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.813+0000 7f9c5f8e5700 1 -- 172.21.15.26:0/546772458 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c58126c40 con 0x7f9c5806e570 2023-10-01T07:55:47.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.813+0000 7f9c4dffb700 1 -- 172.21.15.26:0/546772458 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5400cbc0 con 0x7f9c5806e570 2023-10-01T07:55:47.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.813+0000 7f9c5f8e5700 1 -- 172.21.15.26:0/546772458 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c58135780 con 0x7f9c5806e570 2023-10-01T07:55:47.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.814+0000 7f9c5f8e5700 1 -- 172.21.15.26:0/546772458 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c58070670 con 0x7f9c5806e570 2023-10-01T07:55:47.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.815+0000 7f9c4dffb700 1 -- 172.21.15.26:0/546772458 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9c5400cd20 con 0x7f9c5806e570 2023-10-01T07:55:47.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.815+0000 7f9c4dffb700 1 -- 172.21.15.26:0/546772458 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9c5403ffe0 con 0x7f9c5806e570 2023-10-01T07:55:47.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.821+0000 7f9c4dffb700 1 -- 172.21.15.26:0/546772458 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c54011c50 con 0x7f9c5806e570 2023-10-01T07:55:47.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.858+0000 7fcec5466700 1 Processor -- start 2023-10-01T07:55:47.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.858+0000 7fcec5466700 1 -- start start 2023-10-01T07:55:47.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.859+0000 7fcec5466700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcec009d6f0 0x7fcec009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:47.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.859+0000 7fcec5466700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcec009e410 0x7fcec0134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:47.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.859+0000 7fcec5466700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcec009b120 con 0x7fcec009e000 2023-10-01T07:55:47.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.859+0000 7fcec5466700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcec006b460 con 0x7fcec009e410 2023-10-01T07:55:47.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.859+0000 7fcec5466700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcec009a7e0 con 0x7fcec009d6f0 2023-10-01T07:55:47.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.859+0000 7fcebe7fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fcec009e000 0x7fcec01339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49140/0 (socket says 172.21.15.26:49140) 2023-10-01T07:55:47.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.859+0000 7fcebe7fc700 1 -- 172.21.15.26:0/1837659137 learned_addr learned my addr 172.21.15.26:0/1837659137 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:47.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.859+0000 7fcebeffd700 1 --2- 172.21.15.26:0/1837659137 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcec009d6f0 0x7fcec009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:47.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.859+0000 7fcebf7fe700 1 --2- 172.21.15.26:0/1837659137 >> v2:172.21.15.26:3300/0 conn(0x7fcec009e410 0x7fcec0134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:47.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.859+0000 7fcebdffb700 1 -- 172.21.15.26:0/1837659137 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 300489465 0 0) 0x7fcec009b120 con 0x7fcec009e000 2023-10-01T07:55:47.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.859+0000 7fcebdffb700 1 -- 172.21.15.26:0/1837659137 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcea80035b0 con 0x7fcec009e000 2023-10-01T07:55:47.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.859+0000 7fcebeffd700 1 -- 172.21.15.26:0/1837659137 >> v2:172.21.15.26:3300/0 conn(0x7fcec009e410 msgr2=0x7fcec0134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:47.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.859+0000 7fcebeffd700 1 --2- 172.21.15.26:0/1837659137 >> v2:172.21.15.26:3300/0 conn(0x7fcec009e410 0x7fcec0134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:47.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.859+0000 7fcebeffd700 1 -- 172.21.15.26:0/1837659137 >> v1:172.21.15.26:6789/0 conn(0x7fcec009e000 legacy=0x7fcec01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:47.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.859+0000 7fcebeffd700 1 -- 172.21.15.26:0/1837659137 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec009a500 con 0x7fcec009d6f0 2023-10-01T07:55:47.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.859+0000 7fcebf7fe700 1 --2- 172.21.15.26:0/1837659137 >> v2:172.21.15.26:3300/0 conn(0x7fcec009e410 0x7fcec0134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:47.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.860+0000 7fcebeffd700 1 --2- 172.21.15.26:0/1837659137 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcec009d6f0 0x7fcec009dac0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fceb0009870 tx=0x7fceb0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=411ae9d89772ab76 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:47.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.860+0000 7fcebdffb700 1 -- 172.21.15.26:0/1837659137 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb0011830 con 0x7fcec009d6f0 2023-10-01T07:55:47.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.860+0000 7fcebdffb700 1 -- 172.21.15.26:0/1837659137 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb0011990 con 0x7fcec009d6f0 2023-10-01T07:55:47.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.860+0000 7fcebdffb700 1 -- 172.21.15.26:0/1837659137 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb0011d20 con 0x7fcec009d6f0 2023-10-01T07:55:47.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.861+0000 7fcec5466700 1 -- 172.21.15.26:0/1837659137 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcec009d6f0 msgr2=0x7fcec009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:47.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.861+0000 7fcec5466700 1 --2- 172.21.15.26:0/1837659137 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcec009d6f0 0x7fcec009dac0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fceb0009870 tx=0x7fceb0009b80 comp rx=0 tx=0).stop 2023-10-01T07:55:47.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.861+0000 7fcec5466700 1 -- 172.21.15.26:0/1837659137 shutdown_connections 2023-10-01T07:55:47.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.861+0000 7fcec5466700 1 --2- 172.21.15.26:0/1837659137 >> v2:172.21.15.26:3300/0 conn(0x7fcec009e410 0x7fcec0134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:47.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.861+0000 7fcec5466700 1 --2- 172.21.15.26:0/1837659137 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcec009d6f0 0x7fcec009dac0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:47.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.861+0000 7fcec5466700 1 -- 172.21.15.26:0/1837659137 >> 172.21.15.26:0/1837659137 conn(0x7fcec0066f50 msgr2=0x7fcec009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:47.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.861+0000 7fcec5466700 1 -- 172.21.15.26:0/1837659137 shutdown_connections 2023-10-01T07:55:47.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.861+0000 7fcec5466700 1 -- 172.21.15.26:0/1837659137 wait complete. 2023-10-01T07:55:47.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.863+0000 7fcec5466700 1 Processor -- start 2023-10-01T07:55:47.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.863+0000 7fcec5466700 1 -- start start 2023-10-01T07:55:47.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.864+0000 7fcec5466700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcec009d6f0 0x7fcec01c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:47.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.864+0000 7fcec5466700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcec009e000 0x7fcec01c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:47.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.864+0000 7fcec5466700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcec009e410 0x7fcec01a4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:47.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.864+0000 7fcec5466700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec01b91e0 con 0x7fcec009e000 2023-10-01T07:55:47.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.864+0000 7fcec5466700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec01bcfa0 con 0x7fcec009e410 2023-10-01T07:55:47.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.864+0000 7fcec5466700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcec01a8140 con 0x7fcec009d6f0 2023-10-01T07:55:47.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.864+0000 7fcebe7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcec009e000 0x7fcec01c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:47.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.864+0000 7fcebe7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcec009e000 0x7fcec01c88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60336/0 (socket says 172.21.15.26:60336) 2023-10-01T07:55:47.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.864+0000 7fcebe7fc700 1 -- 172.21.15.26:0/1544163575 learned_addr learned my addr 172.21.15.26:0/1544163575 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:47.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.864+0000 7fcebeffd700 1 --2- 172.21.15.26:0/1544163575 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcec009d6f0 0x7fcec01c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:47.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.864+0000 7fcebe7fc700 1 -- 172.21.15.26:0/1544163575 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcec009d6f0 msgr2=0x7fcec01c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:47.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.864+0000 7fcebe7fc700 1 --2- 172.21.15.26:0/1544163575 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcec009d6f0 0x7fcec01c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:47.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.864+0000 7fcebe7fc700 1 -- 172.21.15.26:0/1544163575 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcec009e410 msgr2=0x7fcec01a4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:47.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.864+0000 7fcebe7fc700 1 --2- 172.21.15.26:0/1544163575 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcec009e410 0x7fcec01a4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:47.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.864+0000 7fcebe7fc700 1 -- 172.21.15.26:0/1544163575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb8009a70 con 0x7fcec009e000 2023-10-01T07:55:47.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.864+0000 7fcebe7fc700 1 --2- 172.21.15.26:0/1544163575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcec009e000 0x7fcec01c88d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fceb4005910 tx=0x7fceb400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:47.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.865+0000 7fcea77fe700 1 -- 172.21.15.26:0/1544163575 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb4005d70 con 0x7fcec009e000 2023-10-01T07:55:47.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.865+0000 7fcea77fe700 1 -- 172.21.15.26:0/1544163575 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb40070d0 con 0x7fcec009e000 2023-10-01T07:55:47.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.865+0000 7fcec5466700 1 -- 172.21.15.26:0/1544163575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb00094a0 con 0x7fcec009e000 2023-10-01T07:55:47.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.865+0000 7fcea77fe700 1 -- 172.21.15.26:0/1544163575 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb4007440 con 0x7fcec009e000 2023-10-01T07:55:47.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.865+0000 7fcec5466700 1 -- 172.21.15.26:0/1544163575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcec01a7ba0 con 0x7fcec009e000 2023-10-01T07:55:47.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.866+0000 7fcea77fe700 1 -- 172.21.15.26:0/1544163575 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fceb40075a0 con 0x7fcec009e000 2023-10-01T07:55:47.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.866+0000 7fcea77fe700 1 -- 172.21.15.26:0/1544163575 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fceb403eaf0 con 0x7fcec009e000 2023-10-01T07:55:47.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.866+0000 7fcec5466700 1 -- 172.21.15.26:0/1544163575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcec01c8e70 con 0x7fcec009e000 2023-10-01T07:55:47.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.871+0000 7fcea77fe700 1 -- 172.21.15.26:0/1544163575 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fceb403ce60 con 0x7fcec009e000 2023-10-01T07:55:47.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.926+0000 7f827871c700 1 Processor -- start 2023-10-01T07:55:47.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.926+0000 7f827871c700 1 -- start start 2023-10-01T07:55:47.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.927+0000 7f827871c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f82700a0a30 0x7f82700a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:47.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.927+0000 7f827871c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82700a1340 0x7f8270133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:47.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.927+0000 7f827871c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f827009edd0 con 0x7f8270133fa0 2023-10-01T07:55:47.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.927+0000 7f827871c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f827009e1f0 con 0x7f82700a0a30 2023-10-01T07:55:47.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.927+0000 7f827871c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f827009dc50 con 0x7f82700a1340 2023-10-01T07:55:47.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.927+0000 7f8275cb7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82700a1340 0x7f8270133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:47.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.927+0000 7f82764b8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f82700a0a30 0x7f82700a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:47.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.927+0000 7f8275cb7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82700a1340 0x7f8270133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44546/0 (socket says 172.21.15.26:44546) 2023-10-01T07:55:47.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.927+0000 7f82764b8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f82700a0a30 0x7f82700a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60342/0 (socket says 172.21.15.26:60342) 2023-10-01T07:55:47.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.927+0000 7f8275cb7700 1 -- 172.21.15.26:0/2378012187 learned_addr learned my addr 172.21.15.26:0/2378012187 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:47.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.927+0000 7f8276cb9700 1 --1- 172.21.15.26:0/2378012187 >> v1:172.21.15.26:6789/0 conn(0x7f8270133fa0 0x7f827013ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49152/0 (socket says 172.21.15.26:49152) 2023-10-01T07:55:47.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.927+0000 7f8275cb7700 1 -- 172.21.15.26:0/2378012187 >> v2:172.21.15.26:3300/0 conn(0x7f82700a0a30 msgr2=0x7f82700a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:47.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.927+0000 7f8275cb7700 1 --2- 172.21.15.26:0/2378012187 >> v2:172.21.15.26:3300/0 conn(0x7f82700a0a30 0x7f82700a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:47.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.927+0000 7f8275cb7700 1 -- 172.21.15.26:0/2378012187 >> v1:172.21.15.26:6789/0 conn(0x7f8270133fa0 legacy=0x7f827013ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:47.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.928+0000 7f8275cb7700 1 -- 172.21.15.26:0/2378012187 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82700a1fe0 con 0x7f82700a1340 2023-10-01T07:55:47.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.928+0000 7f82764b8700 1 --2- 172.21.15.26:0/2378012187 >> v2:172.21.15.26:3300/0 conn(0x7f82700a0a30 0x7f82700a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:47.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.928+0000 7f8275cb7700 1 --2- 172.21.15.26:0/2378012187 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82700a1340 0x7f8270133a60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f82600098f0 tx=0x7f8260009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6703a62aa6167 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:47.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.928+0000 7f82754b6700 1 -- 172.21.15.26:0/2378012187 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8260011830 con 0x7f82700a1340 2023-10-01T07:55:47.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.928+0000 7f82754b6700 1 -- 172.21.15.26:0/2378012187 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8260011990 con 0x7f82700a1340 2023-10-01T07:55:47.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.928+0000 7f82754b6700 1 -- 172.21.15.26:0/2378012187 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8260011d20 con 0x7f82700a1340 2023-10-01T07:55:47.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.929+0000 7f827871c700 1 -- 172.21.15.26:0/2378012187 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82700a1340 msgr2=0x7f8270133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:47.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.929+0000 7f827871c700 1 --2- 172.21.15.26:0/2378012187 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82700a1340 0x7f8270133a60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f82600098f0 tx=0x7f8260009c00 comp rx=0 tx=0).stop 2023-10-01T07:55:47.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.929+0000 7f827871c700 1 -- 172.21.15.26:0/2378012187 shutdown_connections 2023-10-01T07:55:47.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.929+0000 7f827871c700 1 --2- 172.21.15.26:0/2378012187 >> v2:172.21.15.26:3300/0 conn(0x7f82700a0a30 0x7f82700a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:47.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.929+0000 7f827871c700 1 --2- 172.21.15.26:0/2378012187 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82700a1340 0x7f8270133a60 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:47.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.929+0000 7f827871c700 1 -- 172.21.15.26:0/2378012187 >> 172.21.15.26:0/2378012187 conn(0x7f82700a6550 msgr2=0x7f82700a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:47.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.929+0000 7f827871c700 1 -- 172.21.15.26:0/2378012187 shutdown_connections 2023-10-01T07:55:47.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.929+0000 7f827871c700 1 -- 172.21.15.26:0/2378012187 wait complete. 2023-10-01T07:55:47.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.930+0000 7f827871c700 1 Processor -- start 2023-10-01T07:55:47.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.930+0000 7f827871c700 1 -- start start 2023-10-01T07:55:47.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.931+0000 7f827871c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82700a0a30 0x7f827011e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:47.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.931+0000 7f827871c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82700a1340 0x7f827011ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:47.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.931+0000 7f827871c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8270133fa0 0x7f827011f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:47.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.931+0000 7f827871c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8270120bd0 con 0x7f82700a0a30 2023-10-01T07:55:47.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.931+0000 7f827871c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8270120480 con 0x7f82700a1340 2023-10-01T07:55:47.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.931+0000 7f827871c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82700a3850 con 0x7f8270133fa0 2023-10-01T07:55:47.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.931+0000 7f82764b8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82700a0a30 0x7f827011e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:47.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.931+0000 7f82764b8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82700a0a30 0x7f827011e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60358/0 (socket says 172.21.15.26:60358) 2023-10-01T07:55:47.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.931+0000 7f82764b8700 1 -- 172.21.15.26:0/2546480499 learned_addr learned my addr 172.21.15.26:0/2546480499 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:47.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.931+0000 7f8275cb7700 1 --2- 172.21.15.26:0/2546480499 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82700a1340 0x7f827011ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:47.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.931+0000 7f82764b8700 1 -- 172.21.15.26:0/2546480499 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8270133fa0 msgr2=0x7f827011f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:47.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.931+0000 7f82764b8700 1 --2- 172.21.15.26:0/2546480499 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8270133fa0 0x7f827011f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:47.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.931+0000 7f82764b8700 1 -- 172.21.15.26:0/2546480499 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82700a1340 msgr2=0x7f827011ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:47.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.931+0000 7f82764b8700 1 --2- 172.21.15.26:0/2546480499 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82700a1340 0x7f827011ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:47.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.931+0000 7f82764b8700 1 -- 172.21.15.26:0/2546480499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f826c0094a0 con 0x7f82700a0a30 2023-10-01T07:55:47.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.932+0000 7f82764b8700 1 --2- 172.21.15.26:0/2546480499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82700a0a30 0x7f827011e7f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f826c00ebe0 tx=0x7f826c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:47.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.932+0000 7f8266ffd700 1 -- 172.21.15.26:0/2546480499 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c009800 con 0x7f82700a0a30 2023-10-01T07:55:47.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.932+0000 7f8266ffd700 1 -- 172.21.15.26:0/2546480499 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826c00c910 con 0x7f82700a0a30 2023-10-01T07:55:47.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.932+0000 7f8266ffd700 1 -- 172.21.15.26:0/2546480499 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c00cc80 con 0x7f82700a0a30 2023-10-01T07:55:47.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.932+0000 7f827871c700 1 -- 172.21.15.26:0/2546480499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8260009550 con 0x7f82700a0a30 2023-10-01T07:55:47.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.932+0000 7f827871c700 1 -- 172.21.15.26:0/2546480499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8270121fa0 con 0x7f82700a0a30 2023-10-01T07:55:47.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.933+0000 7f827871c700 1 -- 172.21.15.26:0/2546480499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8270074ea0 con 0x7f82700a0a30 2023-10-01T07:55:47.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.933+0000 7f8266ffd700 1 -- 172.21.15.26:0/2546480499 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f826c013470 con 0x7f82700a0a30 2023-10-01T07:55:47.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.933+0000 7f8266ffd700 1 -- 172.21.15.26:0/2546480499 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f826c03f960 con 0x7f82700a0a30 2023-10-01T07:55:47.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:47.943+0000 7f8266ffd700 1 -- 172.21.15.26:0/2546480499 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f826c013720 con 0x7f82700a0a30 2023-10-01T07:55:48.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.045+0000 7f9c5f8e5700 1 -- 172.21.15.26:0/546772458 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9c58074ea0 con 0x7f9c5806e570 2023-10-01T07:55:48.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.045+0000 7f9c4dffb700 1 -- 172.21.15.26:0/546772458 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9c54017090 con 0x7f9c5806e570 2023-10-01T07:55:48.046 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:48.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.048+0000 7f9c5f8e5700 1 -- 172.21.15.26:0/546772458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c5806e570 msgr2=0x7f9c581231a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:48.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.048+0000 7f9c5f8e5700 1 --2- 172.21.15.26:0/546772458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c5806e570 0x7f9c581231a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9c5400e930 tx=0x7f9c5400ec40 comp rx=0 tx=0).stop 2023-10-01T07:55:48.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.048+0000 7f9c5f8e5700 1 -- 172.21.15.26:0/546772458 shutdown_connections 2023-10-01T07:55:48.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.048+0000 7f9c5f8e5700 1 --2- 172.21.15.26:0/546772458 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c58123c20 0x7f9c581d2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:48.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.048+0000 7f9c5f8e5700 1 --2- 172.21.15.26:0/546772458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c5806e570 0x7f9c581231a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:48.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.048+0000 7f9c5f8e5700 1 --2- 172.21.15.26:0/546772458 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c5806ee80 0x7f9c581236e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:48.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.048+0000 7f9c5f8e5700 1 -- 172.21.15.26:0/546772458 >> 172.21.15.26:0/546772458 conn(0x7f9c580a2aa0 msgr2=0x7f9c580a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:48.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.048+0000 7f9c5f8e5700 1 -- 172.21.15.26:0/546772458 shutdown_connections 2023-10-01T07:55:48.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.048+0000 7f9c5f8e5700 1 -- 172.21.15.26:0/546772458 wait complete. 2023-10-01T07:55:48.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.057+0000 7fa88ac09700 1 -- 172.21.15.26:0/2704984596 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa884074ea0 con 0x7fa88409f650 2023-10-01T07:55:48.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.057+0000 7fa8817fa700 1 -- 172.21.15.26:0/2704984596 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa87c01a970 con 0x7fa88409f650 2023-10-01T07:55:48.058 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:48.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.061+0000 7fa88ac09700 1 -- 172.21.15.26:0/2704984596 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa88409f650 msgr2=0x7fa8841a4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:48.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.061+0000 7fa88ac09700 1 --2- 172.21.15.26:0/2704984596 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa88409f650 0x7fa8841a4420 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa87c00b370 tx=0x7fa87c004ad0 comp rx=0 tx=0).stop 2023-10-01T07:55:48.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.061+0000 7fa88ac09700 1 -- 172.21.15.26:0/2704984596 shutdown_connections 2023-10-01T07:55:48.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.061+0000 7fa88ac09700 1 --2- 172.21.15.26:0/2704984596 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa88409f650 0x7fa8841a4420 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:48.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.061+0000 7fa88ac09700 1 --2- 172.21.15.26:0/2704984596 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa88409e930 0x7fa8841a39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:48.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.061+0000 7fa88ac09700 1 --2- 172.21.15.26:0/2704984596 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa88409f240 0x7fa8841a3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:48.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.061+0000 7fa88ac09700 1 -- 172.21.15.26:0/2704984596 >> 172.21.15.26:0/2704984596 conn(0x7fa8840a4210 msgr2=0x7fa88409bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:48.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.061+0000 7fa88ac09700 1 -- 172.21.15.26:0/2704984596 shutdown_connections 2023-10-01T07:55:48.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.061+0000 7fa88ac09700 1 -- 172.21.15.26:0/2704984596 wait complete. 2023-10-01T07:55:48.065 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:48.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:48.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.112+0000 7fcec5466700 1 -- 172.21.15.26:0/1544163575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcec0074ea0 con 0x7fcec009e000 2023-10-01T07:55:48.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.113+0000 7fcea77fe700 1 -- 172.21.15.26:0/1544163575 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fceb4017030 con 0x7fcec009e000 2023-10-01T07:55:48.113 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:48.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.115+0000 7fcec5466700 1 -- 172.21.15.26:0/1544163575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcec009e000 msgr2=0x7fcec01c88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:48.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.115+0000 7fcec5466700 1 --2- 172.21.15.26:0/1544163575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcec009e000 0x7fcec01c88d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fceb4005910 tx=0x7fceb400c9e0 comp rx=0 tx=0).stop 2023-10-01T07:55:48.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.115+0000 7fcec5466700 1 -- 172.21.15.26:0/1544163575 shutdown_connections 2023-10-01T07:55:48.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.115+0000 7fcec5466700 1 --2- 172.21.15.26:0/1544163575 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcec009e410 0x7fcec01a4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:48.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.115+0000 7fcec5466700 1 --2- 172.21.15.26:0/1544163575 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcec009d6f0 0x7fcec01c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:48.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.115+0000 7fcec5466700 1 --2- 172.21.15.26:0/1544163575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcec009e000 0x7fcec01c88d0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:48.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.115+0000 7fcec5466700 1 -- 172.21.15.26:0/1544163575 >> 172.21.15.26:0/1544163575 conn(0x7fcec0066f50 msgr2=0x7fcec00a3700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:48.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.115+0000 7fcec5466700 1 -- 172.21.15.26:0/1544163575 shutdown_connections 2023-10-01T07:55:48.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.115+0000 7fcec5466700 1 -- 172.21.15.26:0/1544163575 wait complete. 2023-10-01T07:55:48.129 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:48.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.156+0000 7f827871c700 1 -- 172.21.15.26:0/2546480499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f82700a28e0 con 0x7f82700a0a30 2023-10-01T07:55:48.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.156+0000 7f8266ffd700 1 -- 172.21.15.26:0/2546480499 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f826c021070 con 0x7f82700a0a30 2023-10-01T07:55:48.157 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:48.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.159+0000 7f827871c700 1 -- 172.21.15.26:0/2546480499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82700a0a30 msgr2=0x7f827011e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:48.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.159+0000 7f827871c700 1 --2- 172.21.15.26:0/2546480499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82700a0a30 0x7f827011e7f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f826c00ebe0 tx=0x7f826c00eef0 comp rx=0 tx=0).stop 2023-10-01T07:55:48.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.159+0000 7f827871c700 1 -- 172.21.15.26:0/2546480499 shutdown_connections 2023-10-01T07:55:48.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.159+0000 7f827871c700 1 --2- 172.21.15.26:0/2546480499 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8270133fa0 0x7f827011f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:48.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.159+0000 7f827871c700 1 --2- 172.21.15.26:0/2546480499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82700a0a30 0x7f827011e7f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:48.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.159+0000 7f827871c700 1 --2- 172.21.15.26:0/2546480499 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82700a1340 0x7f827011ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:48.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.159+0000 7f827871c700 1 -- 172.21.15.26:0/2546480499 >> 172.21.15.26:0/2546480499 conn(0x7f82700a6550 msgr2=0x7f827009a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:48.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.159+0000 7f827871c700 1 -- 172.21.15.26:0/2546480499 shutdown_connections 2023-10-01T07:55:48.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:48.159+0000 7f827871c700 1 -- 172.21.15.26:0/2546480499 wait complete. 2023-10-01T07:55:48.173 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:49.066 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:49.080 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:49.130 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:49.173 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:49.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.216+0000 7f059e6b5700 1 Processor -- start 2023-10-01T07:55:49.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.217+0000 7f059e6b5700 1 -- start start 2023-10-01T07:55:49.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.217+0000 7f059e6b5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0598130670 0x7f0598130a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:49.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.217+0000 7f059e6b5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f05980701a0 0x7f0598138540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:49.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.217+0000 7f059e6b5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0598130260 con 0x7f059806f680 2023-10-01T07:55:49.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.217+0000 7f059e6b5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059809a350 con 0x7f05980701a0 2023-10-01T07:55:49.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.217+0000 7f059e6b5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0598071ff0 con 0x7f0598130670 2023-10-01T07:55:49.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.217+0000 7f0597fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0598130670 0x7f0598130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:49.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.217+0000 7f0597fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0598130670 0x7f0598130a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:38116/0 (socket says 172.21.15.26:38116) 2023-10-01T07:55:49.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.217+0000 7f0597fff700 1 -- 172.21.15.26:0/3899966772 learned_addr learned my addr 172.21.15.26:0/3899966772 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:49.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.218+0000 7f059cc52700 1 --2- 172.21.15.26:0/3899966772 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f05980701a0 0x7f0598138540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:49.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.218+0000 7f0597fff700 1 -- 172.21.15.26:0/3899966772 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f05980701a0 msgr2=0x7f0598138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:49.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.218+0000 7f0597fff700 1 --2- 172.21.15.26:0/3899966772 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f05980701a0 0x7f0598138540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.218+0000 7f0597fff700 1 -- 172.21.15.26:0/3899966772 >> v1:172.21.15.26:6789/0 conn(0x7f059806f680 legacy=0x7f059806fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:49.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.218+0000 7f0597fff700 1 -- 172.21.15.26:0/3899966772 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059809ecf0 con 0x7f0598130670 2023-10-01T07:55:49.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.218+0000 7f0597fff700 1 --2- 172.21.15.26:0/3899966772 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0598130670 0x7f0598130a40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0588009950 tx=0x7f0588009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eea02c1670e008e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:49.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.218+0000 7f0596ffd700 1 -- 172.21.15.26:0/3899966772 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0588009ea0 con 0x7f0598130670 2023-10-01T07:55:49.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.218+0000 7f0596ffd700 1 -- 172.21.15.26:0/3899966772 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0588004230 con 0x7f0598130670 2023-10-01T07:55:49.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.218+0000 7f0596ffd700 1 -- 172.21.15.26:0/3899966772 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05880045a0 con 0x7f0598130670 2023-10-01T07:55:49.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.219+0000 7f059e6b5700 1 -- 172.21.15.26:0/3899966772 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0598130670 msgr2=0x7f0598130a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:49.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.219+0000 7f059e6b5700 1 --2- 172.21.15.26:0/3899966772 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0598130670 0x7f0598130a40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0588009950 tx=0x7f0588009c60 comp rx=0 tx=0).stop 2023-10-01T07:55:49.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.219+0000 7f059e6b5700 1 -- 172.21.15.26:0/3899966772 shutdown_connections 2023-10-01T07:55:49.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.219+0000 7f059e6b5700 1 --2- 172.21.15.26:0/3899966772 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0598130670 0x7f0598130a40 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.219+0000 7f059e6b5700 1 --2- 172.21.15.26:0/3899966772 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f05980701a0 0x7f0598138540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.219+0000 7f059e6b5700 1 -- 172.21.15.26:0/3899966772 >> 172.21.15.26:0/3899966772 conn(0x7f05980a2aa0 msgr2=0x7f05980a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:49.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.219+0000 7f059e6b5700 1 -- 172.21.15.26:0/3899966772 shutdown_connections 2023-10-01T07:55:49.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.219+0000 7f059e6b5700 1 -- 172.21.15.26:0/3899966772 wait complete. 2023-10-01T07:55:49.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.221+0000 7f059e6b5700 1 Processor -- start 2023-10-01T07:55:49.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.221+0000 7f059e6b5700 1 -- start start 2023-10-01T07:55:49.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.222+0000 7f059e6b5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f059806f680 0x7f05981c8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:49.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.222+0000 7f059e6b5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f05980701a0 0x7f05981c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:49.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.222+0000 7f059e6b5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0598130670 0x7f059811f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:49.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.222+0000 7f059e6b5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05981c9190 con 0x7f059806f680 2023-10-01T07:55:49.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.222+0000 7f059e6b5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05981225a0 con 0x7f05980701a0 2023-10-01T07:55:49.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.222+0000 7f059e6b5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f059812cfb0 con 0x7f0598130670 2023-10-01T07:55:49.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.222+0000 7f059cc52700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0598130670 0x7f059811f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:49.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.222+0000 7f059cc52700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0598130670 0x7f059811f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:38120/0 (socket says 172.21.15.26:38120) 2023-10-01T07:55:49.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.222+0000 7f059cc52700 1 -- 172.21.15.26:0/2089295124 learned_addr learned my addr 172.21.15.26:0/2089295124 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:49.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.222+0000 7f059cc52700 1 -- 172.21.15.26:0/2089295124 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f05980701a0 msgr2=0x7f05981c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:49.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.222+0000 7f059cc52700 1 --2- 172.21.15.26:0/2089295124 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f05980701a0 0x7f05981c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.222+0000 7f059cc52700 1 -- 172.21.15.26:0/2089295124 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f059806f680 msgr2=0x7f05981c8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:49.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.222+0000 7f0597fff700 1 --2- 172.21.15.26:0/2089295124 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f059806f680 0x7f05981c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:49.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.222+0000 7f059cc52700 1 --2- 172.21.15.26:0/2089295124 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f059806f680 0x7f05981c8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.222+0000 7f059cc52700 1 -- 172.21.15.26:0/2089295124 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0588009550 con 0x7f0598130670 2023-10-01T07:55:49.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.222+0000 7f0597fff700 1 --2- 172.21.15.26:0/2089295124 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f059806f680 0x7f05981c8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:55:49.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.223+0000 7f059cc52700 1 --2- 172.21.15.26:0/2089295124 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0598130670 0x7f059811f0c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0590007e40 tx=0x7f059000e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:49.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.223+0000 7f0594ff9700 1 -- 172.21.15.26:0/2089295124 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059000eea0 con 0x7f0598130670 2023-10-01T07:55:49.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.223+0000 7f0594ff9700 1 -- 172.21.15.26:0/2089295124 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0590014420 con 0x7f0598130670 2023-10-01T07:55:49.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.223+0000 7f0594ff9700 1 -- 172.21.15.26:0/2089295124 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05900147b0 con 0x7f0598130670 2023-10-01T07:55:49.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.223+0000 7f059e6b5700 1 -- 172.21.15.26:0/2089295124 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0598071820 con 0x7f0598130670 2023-10-01T07:55:49.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.223+0000 7f059e6b5700 1 -- 172.21.15.26:0/2089295124 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f059812caf0 con 0x7f0598130670 2023-10-01T07:55:49.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.224+0000 7f0594ff9700 1 -- 172.21.15.26:0/2089295124 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0590014910 con 0x7f0598130670 2023-10-01T07:55:49.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.224+0000 7f0594ff9700 1 -- 172.21.15.26:0/2089295124 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f059003fee0 con 0x7f0598130670 2023-10-01T07:55:49.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.225+0000 7f059e6b5700 1 -- 172.21.15.26:0/2089295124 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0598074ea0 con 0x7f0598130670 2023-10-01T07:55:49.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.230+0000 7f0594ff9700 1 -- 172.21.15.26:0/2089295124 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f059001bb40 con 0x7f0598130670 2023-10-01T07:55:49.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.262+0000 7fa2e5aa4700 1 Processor -- start 2023-10-01T07:55:49.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.262+0000 7fa2e5aa4700 1 -- start start 2023-10-01T07:55:49.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.262+0000 7fa2e5aa4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa2e01338c0 0x7fa2e0133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:49.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.262+0000 7fa2e5aa4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa2e009e560 0x7fa2e013b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:49.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.262+0000 7fa2e5aa4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e006f720 con 0x7fa2e01341d0 2023-10-01T07:55:49.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.262+0000 7fa2e5aa4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e0070c80 con 0x7fa2e009e560 2023-10-01T07:55:49.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.262+0000 7fa2e5aa4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e006fce0 con 0x7fa2e01338c0 2023-10-01T07:55:49.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.262+0000 7fa2dffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa2e009e560 0x7fa2e013b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:49.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.263+0000 7fa2dffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa2e009e560 0x7fa2e013b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44584/0 (socket says 172.21.15.26:44584) 2023-10-01T07:55:49.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.263+0000 7fa2deffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa2e01341d0 0x7fa2e009de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49164/0 (socket says 172.21.15.26:49164) 2023-10-01T07:55:49.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.263+0000 7fa2dffff700 1 -- 172.21.15.26:0/348218639 learned_addr learned my addr 172.21.15.26:0/348218639 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:49.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.263+0000 7fa2df7fe700 1 --2- 172.21.15.26:0/348218639 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa2e01338c0 0x7fa2e0133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:49.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.263+0000 7fa2de7fc700 1 -- 172.21.15.26:0/348218639 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1260391412 0 0) 0x7fa2e006f720 con 0x7fa2e01341d0 2023-10-01T07:55:49.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.263+0000 7fa2dffff700 1 -- 172.21.15.26:0/348218639 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa2e01338c0 msgr2=0x7fa2e0133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:49.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.263+0000 7fa2dffff700 1 --2- 172.21.15.26:0/348218639 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa2e01338c0 0x7fa2e0133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.263+0000 7fa2dffff700 1 -- 172.21.15.26:0/348218639 >> v1:172.21.15.26:6789/0 conn(0x7fa2e01341d0 legacy=0x7fa2e009de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:49.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.263+0000 7fa2dffff700 1 -- 172.21.15.26:0/348218639 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e01336a0 con 0x7fa2e009e560 2023-10-01T07:55:49.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.263+0000 7fa2df7fe700 1 --2- 172.21.15.26:0/348218639 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa2e01338c0 0x7fa2e0133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:55:49.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.263+0000 7fa2dffff700 1 --2- 172.21.15.26:0/348218639 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa2e009e560 0x7fa2e013b860 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa2d8009e80 tx=0x7fa2d800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17ed36a9cd8b2556 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:49.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.263+0000 7fa2de7fc700 1 -- 172.21.15.26:0/348218639 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d800e070 con 0x7fa2e009e560 2023-10-01T07:55:49.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.263+0000 7fa2de7fc700 1 -- 172.21.15.26:0/348218639 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d800b9c0 con 0x7fa2e009e560 2023-10-01T07:55:49.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.263+0000 7fa2de7fc700 1 -- 172.21.15.26:0/348218639 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d800bd70 con 0x7fa2e009e560 2023-10-01T07:55:49.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.264+0000 7fa2e5aa4700 1 -- 172.21.15.26:0/348218639 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa2e009e560 msgr2=0x7fa2e013b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:49.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.264+0000 7fa2e5aa4700 1 --2- 172.21.15.26:0/348218639 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa2e009e560 0x7fa2e013b860 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa2d8009e80 tx=0x7fa2d800b330 comp rx=0 tx=0).stop 2023-10-01T07:55:49.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.264+0000 7fa2e5aa4700 1 -- 172.21.15.26:0/348218639 shutdown_connections 2023-10-01T07:55:49.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.264+0000 7fa2e5aa4700 1 --2- 172.21.15.26:0/348218639 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa2e01338c0 0x7fa2e0133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.264+0000 7fa2e5aa4700 1 --2- 172.21.15.26:0/348218639 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa2e009e560 0x7fa2e013b860 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.264+0000 7fa2e5aa4700 1 -- 172.21.15.26:0/348218639 >> 172.21.15.26:0/348218639 conn(0x7fa2e00a2aa0 msgr2=0x7fa2e00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:49.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.264+0000 7fa2e5aa4700 1 -- 172.21.15.26:0/348218639 shutdown_connections 2023-10-01T07:55:49.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.264+0000 7fa2e5aa4700 1 -- 172.21.15.26:0/348218639 wait complete. 2023-10-01T07:55:49.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.265+0000 7fa2e5aa4700 1 Processor -- start 2023-10-01T07:55:49.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.266+0000 7fa2e5aa4700 1 -- start start 2023-10-01T07:55:49.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.266+0000 7fa2e5aa4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2e009e560 0x7fa2e01c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:49.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.266+0000 7fa2e5aa4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa2e01338c0 0x7fa2e01c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:49.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.266+0000 7fa2e5aa4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa2e01341d0 0x7fa2e01c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:49.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.266+0000 7fa2e5aa4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e011ce70 con 0x7fa2e009e560 2023-10-01T07:55:49.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.266+0000 7fa2e5aa4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e011cc80 con 0x7fa2e01341d0 2023-10-01T07:55:49.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.266+0000 7fa2e5aa4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e011dc00 con 0x7fa2e01338c0 2023-10-01T07:55:49.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.266+0000 7fa2deffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa2e01338c0 0x7fa2e01c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:49.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.266+0000 7fa2df7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2e009e560 0x7fa2e01c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:49.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.267+0000 7fa2deffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa2e01338c0 0x7fa2e01c8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:38132/0 (socket says 172.21.15.26:38132) 2023-10-01T07:55:49.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.267+0000 7fa2deffd700 1 -- 172.21.15.26:0/247955042 learned_addr learned my addr 172.21.15.26:0/247955042 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:49.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.267+0000 7fa2df7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2e009e560 0x7fa2e01c7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60378/0 (socket says 172.21.15.26:60378) 2023-10-01T07:55:49.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.267+0000 7fa2dffff700 1 --2- 172.21.15.26:0/247955042 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa2e01341d0 0x7fa2e01c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:49.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.267+0000 7fa2deffd700 1 -- 172.21.15.26:0/247955042 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa2e01341d0 msgr2=0x7fa2e01c8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:49.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.267+0000 7fa2deffd700 1 --2- 172.21.15.26:0/247955042 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa2e01341d0 0x7fa2e01c8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.267+0000 7fa2deffd700 1 -- 172.21.15.26:0/247955042 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2e009e560 msgr2=0x7fa2e01c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:49.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.267+0000 7fa2deffd700 1 --2- 172.21.15.26:0/247955042 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2e009e560 0x7fa2e01c7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.267+0000 7fa2deffd700 1 -- 172.21.15.26:0/247955042 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d8009b30 con 0x7fa2e01338c0 2023-10-01T07:55:49.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.267+0000 7fa2deffd700 1 --2- 172.21.15.26:0/247955042 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa2e01338c0 0x7fa2e01c8520 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4001eb0 tx=0x7fa2d400c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:49.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.267+0000 7fa2c7fff700 1 -- 172.21.15.26:0/247955042 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4004c80 con 0x7fa2e01338c0 2023-10-01T07:55:49.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.267+0000 7fa2c7fff700 1 -- 172.21.15.26:0/247955042 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d4004de0 con 0x7fa2e01338c0 2023-10-01T07:55:49.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.267+0000 7fa2e5aa4700 1 -- 172.21.15.26:0/247955042 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e011eb90 con 0x7fa2e01338c0 2023-10-01T07:55:49.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.267+0000 7fa2c7fff700 1 -- 172.21.15.26:0/247955042 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d40072f0 con 0x7fa2e01338c0 2023-10-01T07:55:49.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.268+0000 7fa2e5aa4700 1 -- 172.21.15.26:0/247955042 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e011e8b0 con 0x7fa2e01338c0 2023-10-01T07:55:49.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.269+0000 7fa2c7fff700 1 -- 172.21.15.26:0/247955042 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa2d4007450 con 0x7fa2e01338c0 2023-10-01T07:55:49.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.269+0000 7fa2e5aa4700 1 -- 172.21.15.26:0/247955042 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e0074ea0 con 0x7fa2e01338c0 2023-10-01T07:55:49.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.269+0000 7fa2c7fff700 1 -- 172.21.15.26:0/247955042 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa2d403f2e0 con 0x7fa2e01338c0 2023-10-01T07:55:49.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.278+0000 7fa2c7fff700 1 -- 172.21.15.26:0/247955042 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa2d4007700 con 0x7fa2e01338c0 2023-10-01T07:55:49.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.312+0000 7f45d1bca700 1 Processor -- start 2023-10-01T07:55:49.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.312+0000 7f45d1bca700 1 -- start start 2023-10-01T07:55:49.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.313+0000 7f45d1bca700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45cc0a0a30 0x7f45cc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:49.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.313+0000 7f45d1bca700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f45cc0a1340 0x7f45cc133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:49.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.313+0000 7f45d1bca700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45cc133fa0 0x7f45cc134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:49.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.313+0000 7f45d1bca700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45cc09edd0 con 0x7f45cc0a1340 2023-10-01T07:55:49.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.313+0000 7f45d1bca700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc09e1f0 con 0x7f45cc133fa0 2023-10-01T07:55:49.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.313+0000 7f45d1bca700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc09dc50 con 0x7f45cc0a0a30 2023-10-01T07:55:49.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.313+0000 7f45cbfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45cc133fa0 0x7f45cc134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:49.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.313+0000 7f45cb7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45cc0a0a30 0x7f45cc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:49.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.314+0000 7f45cb7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45cc0a0a30 0x7f45cc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:38146/0 (socket says 172.21.15.26:38146) 2023-10-01T07:55:49.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.314+0000 7f45cbfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45cc133fa0 0x7f45cc134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44604/0 (socket says 172.21.15.26:44604) 2023-10-01T07:55:49.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.314+0000 7f45cb7fe700 1 -- 172.21.15.26:0/4095485326 learned_addr learned my addr 172.21.15.26:0/4095485326 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:49.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.314+0000 7f45caffd700 1 --2- 172.21.15.26:0/4095485326 >> v2:172.21.15.26:3300/0 conn(0x7f45cc0a1340 0x7f45cc133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:49.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.314+0000 7f45cbfff700 1 -- 172.21.15.26:0/4095485326 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45cc0a0a30 msgr2=0x7f45cc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:49.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.314+0000 7f45cbfff700 1 --2- 172.21.15.26:0/4095485326 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45cc0a0a30 0x7f45cc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.314+0000 7f45cbfff700 1 -- 172.21.15.26:0/4095485326 >> v2:172.21.15.26:3300/0 conn(0x7f45cc0a1340 msgr2=0x7f45cc133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:49.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.314+0000 7f45cbfff700 1 --2- 172.21.15.26:0/4095485326 >> v2:172.21.15.26:3300/0 conn(0x7f45cc0a1340 0x7f45cc133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.314+0000 7f45cbfff700 1 -- 172.21.15.26:0/4095485326 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45cc0a1fe0 con 0x7f45cc133fa0 2023-10-01T07:55:49.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.314+0000 7f45cbfff700 1 --2- 172.21.15.26:0/4095485326 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45cc133fa0 0x7f45cc134410 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f45c4009dc0 tx=0x7f45c400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69a2540619ed1055 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:49.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.314+0000 7f45ca7fc700 1 -- 172.21.15.26:0/4095485326 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c400e070 con 0x7f45cc133fa0 2023-10-01T07:55:49.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.314+0000 7f45ca7fc700 1 -- 172.21.15.26:0/4095485326 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c400bae0 con 0x7f45cc133fa0 2023-10-01T07:55:49.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.314+0000 7f45ca7fc700 1 -- 172.21.15.26:0/4095485326 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c400be90 con 0x7f45cc133fa0 2023-10-01T07:55:49.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.315+0000 7f45d1bca700 1 -- 172.21.15.26:0/4095485326 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45cc133fa0 msgr2=0x7f45cc134410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:49.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.315+0000 7f45d1bca700 1 --2- 172.21.15.26:0/4095485326 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45cc133fa0 0x7f45cc134410 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f45c4009dc0 tx=0x7f45c400b330 comp rx=0 tx=0).stop 2023-10-01T07:55:49.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.315+0000 7f45d1bca700 1 -- 172.21.15.26:0/4095485326 shutdown_connections 2023-10-01T07:55:49.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.315+0000 7f45d1bca700 1 --2- 172.21.15.26:0/4095485326 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45cc133fa0 0x7f45cc134410 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.315+0000 7f45d1bca700 1 --2- 172.21.15.26:0/4095485326 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45cc0a0a30 0x7f45cc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.315+0000 7f45d1bca700 1 --2- 172.21.15.26:0/4095485326 >> v2:172.21.15.26:3300/0 conn(0x7f45cc0a1340 0x7f45cc133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.315+0000 7f45d1bca700 1 -- 172.21.15.26:0/4095485326 >> 172.21.15.26:0/4095485326 conn(0x7f45cc0a6550 msgr2=0x7f45cc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:49.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.315+0000 7f45d1bca700 1 -- 172.21.15.26:0/4095485326 shutdown_connections 2023-10-01T07:55:49.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.315+0000 7f45d1bca700 1 -- 172.21.15.26:0/4095485326 wait complete. 2023-10-01T07:55:49.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.317+0000 7f45d1bca700 1 Processor -- start 2023-10-01T07:55:49.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.317+0000 7f45d1bca700 1 -- start start 2023-10-01T07:55:49.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.318+0000 7f45d1bca700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45cc0a0a30 0x7f45cc1200e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:49.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.318+0000 7f45d1bca700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45cc0a1340 0x7f45cc120620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:49.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.318+0000 7f45d1bca700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45cc133fa0 0x7f45cc120b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:49.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.318+0000 7f45d1bca700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc124530 con 0x7f45cc0a1340 2023-10-01T07:55:49.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.318+0000 7f45d1bca700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc121d00 con 0x7f45cc133fa0 2023-10-01T07:55:49.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.318+0000 7f45d1bca700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc123890 con 0x7f45cc0a0a30 2023-10-01T07:55:49.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.318+0000 7f45cbfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45cc133fa0 0x7f45cc120b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:49.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.318+0000 7f45cbfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45cc133fa0 0x7f45cc120b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44616/0 (socket says 172.21.15.26:44616) 2023-10-01T07:55:49.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.318+0000 7f45cbfff700 1 -- 172.21.15.26:0/4264048146 learned_addr learned my addr 172.21.15.26:0/4264048146 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:49.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.318+0000 7f45cb7fe700 1 --2- 172.21.15.26:0/4264048146 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45cc0a0a30 0x7f45cc1200e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:49.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.318+0000 7f45caffd700 1 --2- 172.21.15.26:0/4264048146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45cc0a1340 0x7f45cc120620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:49.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.318+0000 7f45cbfff700 1 -- 172.21.15.26:0/4264048146 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45cc0a0a30 msgr2=0x7f45cc1200e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:49.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.318+0000 7f45cbfff700 1 --2- 172.21.15.26:0/4264048146 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45cc0a0a30 0x7f45cc1200e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.318+0000 7f45cbfff700 1 -- 172.21.15.26:0/4264048146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45cc0a1340 msgr2=0x7f45cc120620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:49.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.318+0000 7f45cbfff700 1 --2- 172.21.15.26:0/4264048146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45cc0a1340 0x7f45cc120620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.318+0000 7f45cbfff700 1 -- 172.21.15.26:0/4264048146 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c4009a70 con 0x7f45cc133fa0 2023-10-01T07:55:49.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.319+0000 7f45cbfff700 1 --2- 172.21.15.26:0/4264048146 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45cc133fa0 0x7f45cc120b60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f45cc09e330 tx=0x7f45c4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:49.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.319+0000 7f45b3fff700 1 -- 172.21.15.26:0/4264048146 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c40044d0 con 0x7f45cc133fa0 2023-10-01T07:55:49.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.319+0000 7f45b3fff700 1 -- 172.21.15.26:0/4264048146 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c4020070 con 0x7f45cc133fa0 2023-10-01T07:55:49.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.319+0000 7f45d1bca700 1 -- 172.21.15.26:0/4264048146 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45cc122eb0 con 0x7f45cc133fa0 2023-10-01T07:55:49.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.319+0000 7f45b3fff700 1 -- 172.21.15.26:0/4264048146 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c4004870 con 0x7f45cc133fa0 2023-10-01T07:55:49.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.319+0000 7f45d1bca700 1 -- 172.21.15.26:0/4264048146 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45cc123b70 con 0x7f45cc133fa0 2023-10-01T07:55:49.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.320+0000 7f45d1bca700 1 -- 172.21.15.26:0/4264048146 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45cc074ea0 con 0x7f45cc133fa0 2023-10-01T07:55:49.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.325+0000 7f45b3fff700 1 -- 172.21.15.26:0/4264048146 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f45c4031430 con 0x7f45cc133fa0 2023-10-01T07:55:49.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.325+0000 7f45b3fff700 1 -- 172.21.15.26:0/4264048146 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f45c4022070 con 0x7f45cc133fa0 2023-10-01T07:55:49.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.330+0000 7f45b3fff700 1 -- 172.21.15.26:0/4264048146 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f45c4012430 con 0x7f45cc133fa0 2023-10-01T07:55:49.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.350+0000 7fe3ed0c0700 1 Processor -- start 2023-10-01T07:55:49.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.350+0000 7fe3ed0c0700 1 -- start start 2023-10-01T07:55:49.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.351+0000 7fe3ed0c0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe3e8133420 0x7fe3e81337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:49.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.351+0000 7fe3ed0c0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe3e8134260 0x7fe3e81306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:49.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.351+0000 7fe3ed0c0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3e806b990 con 0x7fe3e8133e30 2023-10-01T07:55:49.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.351+0000 7fe3ed0c0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3e80a0590 con 0x7fe3e8133420 2023-10-01T07:55:49.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.351+0000 7fe3ed0c0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e809fb80 con 0x7fe3e8134260 2023-10-01T07:55:49.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.351+0000 7fe3e6d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe3e8133420 0x7fe3e81337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:49.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.351+0000 7fe3e759e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe3e8134260 0x7fe3e81306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:49.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.351+0000 7fe3e6d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe3e8133420 0x7fe3e81337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60412/0 (socket says 172.21.15.26:60412) 2023-10-01T07:55:49.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.351+0000 7fe3e6d9d700 1 -- 172.21.15.26:0/2021575681 learned_addr learned my addr 172.21.15.26:0/2021575681 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:49.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.351+0000 7fe3e6d9d700 1 -- 172.21.15.26:0/2021575681 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe3e8134260 msgr2=0x7fe3e81306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:49.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.351+0000 7fe3e6d9d700 1 --2- 172.21.15.26:0/2021575681 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe3e8134260 0x7fe3e81306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.351+0000 7fe3e6d9d700 1 -- 172.21.15.26:0/2021575681 >> v1:172.21.15.26:6789/0 conn(0x7fe3e8133e30 legacy=0x7fe3e812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:49.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.351+0000 7fe3e6d9d700 1 -- 172.21.15.26:0/2021575681 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e80a0030 con 0x7fe3e8133420 2023-10-01T07:55:49.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.351+0000 7fe3e759e700 1 --2- 172.21.15.26:0/2021575681 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe3e8134260 0x7fe3e81306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:55:49.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.352+0000 7fe3e6d9d700 1 --2- 172.21.15.26:0/2021575681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e8133420 0x7fe3e81337f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe3d80098f0 tx=0x7fe3d8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d540e8bf5be0b117 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:49.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.352+0000 7fe3e5d9b700 1 -- 172.21.15.26:0/2021575681 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d800b8a0 con 0x7fe3e8133420 2023-10-01T07:55:49.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.352+0000 7fe3e5d9b700 1 -- 172.21.15.26:0/2021575681 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d800ba00 con 0x7fe3e8133420 2023-10-01T07:55:49.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.352+0000 7fe3e5d9b700 1 -- 172.21.15.26:0/2021575681 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d800bd90 con 0x7fe3e8133420 2023-10-01T07:55:49.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.352+0000 7fe3ed0c0700 1 -- 172.21.15.26:0/2021575681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e8133420 msgr2=0x7fe3e81337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:49.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.352+0000 7fe3ed0c0700 1 --2- 172.21.15.26:0/2021575681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e8133420 0x7fe3e81337f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe3d80098f0 tx=0x7fe3d8009c00 comp rx=0 tx=0).stop 2023-10-01T07:55:49.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.352+0000 7fe3ed0c0700 1 -- 172.21.15.26:0/2021575681 shutdown_connections 2023-10-01T07:55:49.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.352+0000 7fe3ed0c0700 1 --2- 172.21.15.26:0/2021575681 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe3e8134260 0x7fe3e81306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.352+0000 7fe3ed0c0700 1 --2- 172.21.15.26:0/2021575681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e8133420 0x7fe3e81337f0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.352+0000 7fe3ed0c0700 1 -- 172.21.15.26:0/2021575681 >> 172.21.15.26:0/2021575681 conn(0x7fe3e80a4210 msgr2=0x7fe3e80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:49.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.352+0000 7fe3ed0c0700 1 -- 172.21.15.26:0/2021575681 shutdown_connections 2023-10-01T07:55:49.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.353+0000 7fe3ed0c0700 1 -- 172.21.15.26:0/2021575681 wait complete. 2023-10-01T07:55:49.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.354+0000 7fe3ed0c0700 1 Processor -- start 2023-10-01T07:55:49.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.354+0000 7fe3ed0c0700 1 -- start start 2023-10-01T07:55:49.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.354+0000 7fe3ed0c0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe3e8133420 0x7fe3e809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:49.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.354+0000 7fe3ed0c0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3e8133e30 0x7fe3e809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:49.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.354+0000 7fe3ed0c0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e8134260 0x7fe3e809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:49.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.354+0000 7fe3ed0c0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e8120340 con 0x7fe3e8134260 2023-10-01T07:55:49.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.354+0000 7fe3ed0c0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e812d3a0 con 0x7fe3e8133e30 2023-10-01T07:55:49.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.354+0000 7fe3ed0c0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e811fb30 con 0x7fe3e8133420 2023-10-01T07:55:49.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.355+0000 7fe3e6d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe3e8133420 0x7fe3e809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:49.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.355+0000 7fe3e6d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe3e8133420 0x7fe3e809c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:38164/0 (socket says 172.21.15.26:38164) 2023-10-01T07:55:49.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.355+0000 7fe3e6d9d700 1 -- 172.21.15.26:0/3209224174 learned_addr learned my addr 172.21.15.26:0/3209224174 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:49.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.355+0000 7fe3e759e700 1 --2- 172.21.15.26:0/3209224174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e8134260 0x7fe3e809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:49.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.355+0000 7fe3e659c700 1 --2- 172.21.15.26:0/3209224174 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3e8133e30 0x7fe3e809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:49.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.355+0000 7fe3e6d9d700 1 -- 172.21.15.26:0/3209224174 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3e8133e30 msgr2=0x7fe3e809c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:49.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.355+0000 7fe3e6d9d700 1 --2- 172.21.15.26:0/3209224174 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3e8133e30 0x7fe3e809c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.355+0000 7fe3e6d9d700 1 -- 172.21.15.26:0/3209224174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e8134260 msgr2=0x7fe3e809cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:49.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.355+0000 7fe3e6d9d700 1 --2- 172.21.15.26:0/3209224174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e8134260 0x7fe3e809cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.355+0000 7fe3e6d9d700 1 -- 172.21.15.26:0/3209224174 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d8009550 con 0x7fe3e8133420 2023-10-01T07:55:49.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.355+0000 7fe3e6d9d700 1 --2- 172.21.15.26:0/3209224174 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe3e8133420 0x7fe3e809c480 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8000c00 tx=0x7fe3d8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:49.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.355+0000 7fe3cf7fe700 1 -- 172.21.15.26:0/3209224174 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d8004590 con 0x7fe3e8133420 2023-10-01T07:55:49.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.356+0000 7fe3cf7fe700 1 -- 172.21.15.26:0/3209224174 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d80036a0 con 0x7fe3e8133420 2023-10-01T07:55:49.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.356+0000 7fe3cf7fe700 1 -- 172.21.15.26:0/3209224174 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d8003a10 con 0x7fe3e8133420 2023-10-01T07:55:49.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.356+0000 7fe3ed0c0700 1 -- 172.21.15.26:0/3209224174 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3e809e070 con 0x7fe3e8133420 2023-10-01T07:55:49.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.356+0000 7fe3ed0c0700 1 -- 172.21.15.26:0/3209224174 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3e8120060 con 0x7fe3e8133420 2023-10-01T07:55:49.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.357+0000 7fe3cf7fe700 1 -- 172.21.15.26:0/3209224174 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe3d8021070 con 0x7fe3e8133420 2023-10-01T07:55:49.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.357+0000 7fe3ed0c0700 1 -- 172.21.15.26:0/3209224174 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3e809ee20 con 0x7fe3e8133420 2023-10-01T07:55:49.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.357+0000 7fe3cf7fe700 1 -- 172.21.15.26:0/3209224174 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe3d8049390 con 0x7fe3e8133420 2023-10-01T07:55:49.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.362+0000 7fe3cf7fe700 1 -- 172.21.15.26:0/3209224174 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe3d8019770 con 0x7fe3e8133420 2023-10-01T07:55:49.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.461+0000 7f059e6b5700 1 -- 172.21.15.26:0/2089295124 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0598072210 con 0x7f0598130670 2023-10-01T07:55:49.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.461+0000 7f0594ff9700 1 -- 172.21.15.26:0/2089295124 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f059001b310 con 0x7f0598130670 2023-10-01T07:55:49.462 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:49.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.464+0000 7f059e6b5700 1 -- 172.21.15.26:0/2089295124 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0598130670 msgr2=0x7f059811f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:49.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.464+0000 7f059e6b5700 1 --2- 172.21.15.26:0/2089295124 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0598130670 0x7f059811f0c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0590007e40 tx=0x7f059000e3c0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.464+0000 7f059e6b5700 1 -- 172.21.15.26:0/2089295124 shutdown_connections 2023-10-01T07:55:49.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.464+0000 7f059e6b5700 1 --2- 172.21.15.26:0/2089295124 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0598130670 0x7f059811f0c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.464+0000 7f059e6b5700 1 --2- 172.21.15.26:0/2089295124 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f059806f680 0x7f05981c8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.464+0000 7f059e6b5700 1 --2- 172.21.15.26:0/2089295124 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f05980701a0 0x7f05981c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.464+0000 7f059e6b5700 1 -- 172.21.15.26:0/2089295124 >> 172.21.15.26:0/2089295124 conn(0x7f05980a2aa0 msgr2=0x7f059806e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:49.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.464+0000 7f059e6b5700 1 -- 172.21.15.26:0/2089295124 shutdown_connections 2023-10-01T07:55:49.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.464+0000 7f059e6b5700 1 -- 172.21.15.26:0/2089295124 wait complete. 2023-10-01T07:55:49.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:49.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.552+0000 7fa2e5aa4700 1 -- 172.21.15.26:0/247955042 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa2e006b9e0 con 0x7fa2e01338c0 2023-10-01T07:55:49.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.553+0000 7fa2c7fff700 1 -- 172.21.15.26:0/247955042 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa2d4011e80 con 0x7fa2e01338c0 2023-10-01T07:55:49.554 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:49.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.555+0000 7fa2e5aa4700 1 -- 172.21.15.26:0/247955042 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa2e01338c0 msgr2=0x7fa2e01c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:49.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.555+0000 7fa2e5aa4700 1 --2- 172.21.15.26:0/247955042 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa2e01338c0 0x7fa2e01c8520 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4001eb0 tx=0x7fa2d400c800 comp rx=0 tx=0).stop 2023-10-01T07:55:49.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.555+0000 7fa2e5aa4700 1 -- 172.21.15.26:0/247955042 shutdown_connections 2023-10-01T07:55:49.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.555+0000 7fa2e5aa4700 1 --2- 172.21.15.26:0/247955042 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa2e01341d0 0x7fa2e01c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.555+0000 7fa2e5aa4700 1 --2- 172.21.15.26:0/247955042 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2e009e560 0x7fa2e01c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.555+0000 7fa2e5aa4700 1 --2- 172.21.15.26:0/247955042 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa2e01338c0 0x7fa2e01c8520 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.555+0000 7fa2e5aa4700 1 -- 172.21.15.26:0/247955042 >> 172.21.15.26:0/247955042 conn(0x7fa2e00a2aa0 msgr2=0x7fa2e012ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:49.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.555+0000 7fa2e5aa4700 1 -- 172.21.15.26:0/247955042 shutdown_connections 2023-10-01T07:55:49.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.555+0000 7fa2e5aa4700 1 -- 172.21.15.26:0/247955042 wait complete. 2023-10-01T07:55:49.569 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:49.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.584+0000 7fe3ed0c0700 1 -- 172.21.15.26:0/3209224174 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe3e8074ea0 con 0x7fe3e8133420 2023-10-01T07:55:49.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.584+0000 7fe3cf7fe700 1 -- 172.21.15.26:0/3209224174 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe3d8015030 con 0x7fe3e8133420 2023-10-01T07:55:49.585 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:49.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.586+0000 7fe3ed0c0700 1 -- 172.21.15.26:0/3209224174 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe3e8133420 msgr2=0x7fe3e809c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:49.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.586+0000 7fe3ed0c0700 1 --2- 172.21.15.26:0/3209224174 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe3e8133420 0x7fe3e809c480 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8000c00 tx=0x7fe3d8004750 comp rx=0 tx=0).stop 2023-10-01T07:55:49.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.586+0000 7fe3ed0c0700 1 -- 172.21.15.26:0/3209224174 shutdown_connections 2023-10-01T07:55:49.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.586+0000 7fe3ed0c0700 1 --2- 172.21.15.26:0/3209224174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e8134260 0x7fe3e809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.586+0000 7fe3ed0c0700 1 --2- 172.21.15.26:0/3209224174 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe3e8133420 0x7fe3e809c480 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.586+0000 7fe3ed0c0700 1 --2- 172.21.15.26:0/3209224174 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3e8133e30 0x7fe3e809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.586+0000 7fe3ed0c0700 1 -- 172.21.15.26:0/3209224174 >> 172.21.15.26:0/3209224174 conn(0x7fe3e80a4210 msgr2=0x7fe3e812e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:49.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.587+0000 7fe3ed0c0700 1 -- 172.21.15.26:0/3209224174 shutdown_connections 2023-10-01T07:55:49.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.587+0000 7fe3ed0c0700 1 -- 172.21.15.26:0/3209224174 wait complete. 2023-10-01T07:55:49.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.587+0000 7f45d1bca700 1 -- 172.21.15.26:0/4264048146 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f45cc0a28e0 con 0x7f45cc133fa0 2023-10-01T07:55:49.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.587+0000 7f45b3fff700 1 -- 172.21.15.26:0/4264048146 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f45c402c020 con 0x7f45cc133fa0 2023-10-01T07:55:49.589 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:49.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.589+0000 7f45d1bca700 1 -- 172.21.15.26:0/4264048146 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45cc133fa0 msgr2=0x7f45cc120b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:49.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.589+0000 7f45d1bca700 1 --2- 172.21.15.26:0/4264048146 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45cc133fa0 0x7f45cc120b60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f45cc09e330 tx=0x7f45c4004ad0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.589+0000 7f45d1bca700 1 -- 172.21.15.26:0/4264048146 shutdown_connections 2023-10-01T07:55:49.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.589+0000 7f45d1bca700 1 --2- 172.21.15.26:0/4264048146 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45cc133fa0 0x7f45cc120b60 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.589+0000 7f45d1bca700 1 --2- 172.21.15.26:0/4264048146 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45cc0a0a30 0x7f45cc1200e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.589+0000 7f45d1bca700 1 --2- 172.21.15.26:0/4264048146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45cc0a1340 0x7f45cc120620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:49.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.589+0000 7f45d1bca700 1 -- 172.21.15.26:0/4264048146 >> 172.21.15.26:0/4264048146 conn(0x7f45cc0a6550 msgr2=0x7f45cc09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:49.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.589+0000 7f45d1bca700 1 -- 172.21.15.26:0/4264048146 shutdown_connections 2023-10-01T07:55:49.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:49.589+0000 7f45d1bca700 1 -- 172.21.15.26:0/4264048146 wait complete. 2023-10-01T07:55:49.602 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:49.604 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:50.479 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:50.571 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:50.603 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:50.605 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:50.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.631+0000 7ff8f25a2700 1 Processor -- start 2023-10-01T07:55:50.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.631+0000 7ff8f25a2700 1 -- start start 2023-10-01T07:55:50.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.632+0000 7ff8f25a2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff8ec1338a0 0x7ff8ec133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:50.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.632+0000 7ff8f25a2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff8ec09de50 0x7ff8ec09e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:50.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.632+0000 7ff8f25a2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8ec06ef30 con 0x7ff8ec09e760 2023-10-01T07:55:50.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.632+0000 7ff8f25a2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8ec06fef0 con 0x7ff8ec09de50 2023-10-01T07:55:50.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.632+0000 7ff8f25a2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec1334b0 con 0x7ff8ec1338a0 2023-10-01T07:55:50.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.632+0000 7ff8ebfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff8ec1338a0 0x7ff8ec133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:50.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.632+0000 7ff8ebfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff8ec1338a0 0x7ff8ec133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44638/0 (socket says 172.21.15.26:44638) 2023-10-01T07:55:50.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.632+0000 7ff8ebfff700 1 -- 172.21.15.26:0/3443036240 learned_addr learned my addr 172.21.15.26:0/3443036240 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:50.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.632+0000 7ff8eb7fe700 1 --2- 172.21.15.26:0/3443036240 >> v2:172.21.15.26:3300/0 conn(0x7ff8ec09de50 0x7ff8ec09e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:50.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.633+0000 7ff8ebfff700 1 -- 172.21.15.26:0/3443036240 >> v2:172.21.15.26:3300/0 conn(0x7ff8ec09de50 msgr2=0x7ff8ec09e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:50.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.633+0000 7ff8ebfff700 1 --2- 172.21.15.26:0/3443036240 >> v2:172.21.15.26:3300/0 conn(0x7ff8ec09de50 0x7ff8ec09e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:50.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.633+0000 7ff8ebfff700 1 -- 172.21.15.26:0/3443036240 >> v1:172.21.15.26:6789/0 conn(0x7ff8ec09e760 legacy=0x7ff8ec13a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:50.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.633+0000 7ff8ebfff700 1 -- 172.21.15.26:0/3443036240 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ec06fc30 con 0x7ff8ec1338a0 2023-10-01T07:55:50.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.633+0000 7ff8ebfff700 1 --2- 172.21.15.26:0/3443036240 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff8ec1338a0 0x7ff8ec133c70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc0098f0 tx=0x7ff8dc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e492027cc987657 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:50.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.633+0000 7ff8eaffd700 1 -- 172.21.15.26:0/3443036240 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc011830 con 0x7ff8ec1338a0 2023-10-01T07:55:50.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.633+0000 7ff8eaffd700 1 -- 172.21.15.26:0/3443036240 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8dc011990 con 0x7ff8ec1338a0 2023-10-01T07:55:50.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.633+0000 7ff8eaffd700 1 -- 172.21.15.26:0/3443036240 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc011d20 con 0x7ff8ec1338a0 2023-10-01T07:55:50.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.634+0000 7ff8f25a2700 1 -- 172.21.15.26:0/3443036240 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff8ec1338a0 msgr2=0x7ff8ec133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:50.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.634+0000 7ff8f25a2700 1 --2- 172.21.15.26:0/3443036240 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff8ec1338a0 0x7ff8ec133c70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc0098f0 tx=0x7ff8dc009c00 comp rx=0 tx=0).stop 2023-10-01T07:55:50.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.634+0000 7ff8f25a2700 1 -- 172.21.15.26:0/3443036240 shutdown_connections 2023-10-01T07:55:50.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.634+0000 7ff8f25a2700 1 --2- 172.21.15.26:0/3443036240 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff8ec1338a0 0x7ff8ec133c70 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:50.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.634+0000 7ff8f25a2700 1 --2- 172.21.15.26:0/3443036240 >> v2:172.21.15.26:3300/0 conn(0x7ff8ec09de50 0x7ff8ec09e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:50.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.634+0000 7ff8f25a2700 1 -- 172.21.15.26:0/3443036240 >> 172.21.15.26:0/3443036240 conn(0x7ff8ec0a2aa0 msgr2=0x7ff8ec0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:50.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.634+0000 7ff8f25a2700 1 -- 172.21.15.26:0/3443036240 shutdown_connections 2023-10-01T07:55:50.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.634+0000 7ff8f25a2700 1 -- 172.21.15.26:0/3443036240 wait complete. 2023-10-01T07:55:50.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.635+0000 7ff8f25a2700 1 Processor -- start 2023-10-01T07:55:50.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.636+0000 7ff8f25a2700 1 -- start start 2023-10-01T07:55:50.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.636+0000 7ff8f25a2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff8ec09de50 0x7ff8ec11d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:50.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.636+0000 7ff8f25a2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8ec09e760 0x7ff8ec11dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:50.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.636+0000 7ff8f25a2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff8ec1338a0 0x7ff8ec11e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:50.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.636+0000 7ff8f25a2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec11eb70 con 0x7ff8ec09e760 2023-10-01T07:55:50.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.636+0000 7ff8f25a2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec11f900 con 0x7ff8ec09de50 2023-10-01T07:55:50.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.636+0000 7ff8f25a2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec1209c0 con 0x7ff8ec1338a0 2023-10-01T07:55:50.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.637+0000 7ff8ebfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff8ec09de50 0x7ff8ec11d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:50.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.637+0000 7ff8ebfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff8ec09de50 0x7ff8ec11d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44642/0 (socket says 172.21.15.26:44642) 2023-10-01T07:55:50.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.637+0000 7ff8ebfff700 1 -- 172.21.15.26:0/355219098 learned_addr learned my addr 172.21.15.26:0/355219098 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:50.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.637+0000 7ff8ebfff700 1 -- 172.21.15.26:0/355219098 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff8ec1338a0 msgr2=0x7ff8ec11e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:50.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.637+0000 7ff8ebfff700 1 --2- 172.21.15.26:0/355219098 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff8ec1338a0 0x7ff8ec11e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:50.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.637+0000 7ff8ebfff700 1 -- 172.21.15.26:0/355219098 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8ec09e760 msgr2=0x7ff8ec11dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:50.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.637+0000 7ff8ebfff700 1 --2- 172.21.15.26:0/355219098 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8ec09e760 0x7ff8ec11dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:50.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.637+0000 7ff8ebfff700 1 -- 172.21.15.26:0/355219098 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8dc009550 con 0x7ff8ec09de50 2023-10-01T07:55:50.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.637+0000 7ff8ebfff700 1 --2- 172.21.15.26:0/355219098 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff8ec09de50 0x7ff8ec11d710 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc000c00 tx=0x7ff8dc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:50.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.637+0000 7ff8e8ff9700 1 -- 172.21.15.26:0/355219098 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc004570 con 0x7ff8ec09de50 2023-10-01T07:55:50.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.637+0000 7ff8e8ff9700 1 -- 172.21.15.26:0/355219098 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8dc01f070 con 0x7ff8ec09de50 2023-10-01T07:55:50.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.637+0000 7ff8e8ff9700 1 -- 172.21.15.26:0/355219098 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc0038c0 con 0x7ff8ec09de50 2023-10-01T07:55:50.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.637+0000 7ff8f25a2700 1 -- 172.21.15.26:0/355219098 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8ec06f640 con 0x7ff8ec09de50 2023-10-01T07:55:50.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.638+0000 7ff8f25a2700 1 -- 172.21.15.26:0/355219098 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8ec11f320 con 0x7ff8ec09de50 2023-10-01T07:55:50.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.639+0000 7ff8e8ff9700 1 -- 172.21.15.26:0/355219098 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff8dc021030 con 0x7ff8ec09de50 2023-10-01T07:55:50.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.639+0000 7ff8f25a2700 1 -- 172.21.15.26:0/355219098 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8ec11a470 con 0x7ff8ec09de50 2023-10-01T07:55:50.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.639+0000 7ff8e8ff9700 1 -- 172.21.15.26:0/355219098 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff8dc040b60 con 0x7ff8ec09de50 2023-10-01T07:55:50.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.647+0000 7ff8e8ff9700 1 -- 172.21.15.26:0/355219098 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff8dc00b3e0 con 0x7ff8ec09de50 2023-10-01T07:55:50.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.717+0000 7faee0764700 1 Processor -- start 2023-10-01T07:55:50.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.718+0000 7faee0764700 1 -- start start 2023-10-01T07:55:50.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.718+0000 7faee0764700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7faed8133420 0x7faed81337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:50.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.718+0000 7faee0764700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faed8134260 0x7faed81306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:50.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.718+0000 7faee0764700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed806b990 con 0x7faed8133e30 2023-10-01T07:55:50.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.718+0000 7faee0764700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed80a0590 con 0x7faed8133420 2023-10-01T07:55:50.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.718+0000 7faee0764700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed809fb80 con 0x7faed8134260 2023-10-01T07:55:50.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.718+0000 7faeded01700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faed8134260 0x7faed81306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:50.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.719+0000 7faeded01700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faed8134260 0x7faed81306a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44646/0 (socket says 172.21.15.26:44646) 2023-10-01T07:55:50.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.719+0000 7faeded01700 1 -- 172.21.15.26:0/3279784609 learned_addr learned my addr 172.21.15.26:0/3279784609 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:50.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.719+0000 7faede500700 1 --2- 172.21.15.26:0/3279784609 >> v2:172.21.15.26:3300/0 conn(0x7faed8133420 0x7faed81337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:50.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.719+0000 7faeded01700 1 -- 172.21.15.26:0/3279784609 >> v2:172.21.15.26:3300/0 conn(0x7faed8133420 msgr2=0x7faed81337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:50.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.719+0000 7faeded01700 1 --2- 172.21.15.26:0/3279784609 >> v2:172.21.15.26:3300/0 conn(0x7faed8133420 0x7faed81337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:50.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.719+0000 7faeded01700 1 -- 172.21.15.26:0/3279784609 >> v1:172.21.15.26:6789/0 conn(0x7faed8133e30 legacy=0x7faed812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:50.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.719+0000 7faeded01700 1 -- 172.21.15.26:0/3279784609 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed80a0030 con 0x7faed8134260 2023-10-01T07:55:50.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.719+0000 7faede500700 1 --2- 172.21.15.26:0/3279784609 >> v2:172.21.15.26:3300/0 conn(0x7faed8133420 0x7faed81337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:55:50.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.719+0000 7faeded01700 1 --2- 172.21.15.26:0/3279784609 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faed8134260 0x7faed81306a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faed0009e50 tx=0x7faed000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=594d7ef5f85ff74f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:50.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.719+0000 7faedd4fe700 1 -- 172.21.15.26:0/3279784609 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed000e070 con 0x7faed8134260 2023-10-01T07:55:50.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.719+0000 7faedd4fe700 1 -- 172.21.15.26:0/3279784609 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed000b9c0 con 0x7faed8134260 2023-10-01T07:55:50.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.719+0000 7faedd4fe700 1 -- 172.21.15.26:0/3279784609 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed000bd70 con 0x7faed8134260 2023-10-01T07:55:50.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.720+0000 7faee0764700 1 -- 172.21.15.26:0/3279784609 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faed8134260 msgr2=0x7faed81306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:50.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.720+0000 7faee0764700 1 --2- 172.21.15.26:0/3279784609 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faed8134260 0x7faed81306a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faed0009e50 tx=0x7faed000b330 comp rx=0 tx=0).stop 2023-10-01T07:55:50.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.720+0000 7faee0764700 1 -- 172.21.15.26:0/3279784609 shutdown_connections 2023-10-01T07:55:50.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.720+0000 7faee0764700 1 --2- 172.21.15.26:0/3279784609 >> v2:172.21.15.26:3300/0 conn(0x7faed8133420 0x7faed81337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:50.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.720+0000 7faee0764700 1 --2- 172.21.15.26:0/3279784609 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faed8134260 0x7faed81306a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:50.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.720+0000 7faee0764700 1 -- 172.21.15.26:0/3279784609 >> 172.21.15.26:0/3279784609 conn(0x7faed80a4210 msgr2=0x7faed80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:50.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.720+0000 7faee0764700 1 -- 172.21.15.26:0/3279784609 shutdown_connections 2023-10-01T07:55:50.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.720+0000 7faee0764700 1 -- 172.21.15.26:0/3279784609 wait complete. 2023-10-01T07:55:50.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.721+0000 7faee0764700 1 Processor -- start 2023-10-01T07:55:50.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.722+0000 7faee0764700 1 -- start start 2023-10-01T07:55:50.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.722+0000 7faee0764700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faed8133420 0x7faed809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:50.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.722+0000 7faee0764700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faed8133e30 0x7faed809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:50.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.722+0000 7faee0764700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faed8134260 0x7faed809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:50.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.722+0000 7faee0764700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed811ff70 con 0x7faed8134260 2023-10-01T07:55:50.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.722+0000 7faee0764700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed812d9c0 con 0x7faed8133420 2023-10-01T07:55:50.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.722+0000 7faee0764700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faed811fbd0 con 0x7faed8133e30 2023-10-01T07:55:50.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.723+0000 7faede500700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faed8133420 0x7faed809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:50.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.723+0000 7faede500700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faed8133420 0x7faed809c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44654/0 (socket says 172.21.15.26:44654) 2023-10-01T07:55:50.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.723+0000 7faede500700 1 -- 172.21.15.26:0/3608039125 learned_addr learned my addr 172.21.15.26:0/3608039125 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:50.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.723+0000 7faeddcff700 1 --2- 172.21.15.26:0/3608039125 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faed8133e30 0x7faed809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:50.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.723+0000 7faeded01700 1 --2- 172.21.15.26:0/3608039125 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faed8134260 0x7faed809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:50.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.723+0000 7faede500700 1 -- 172.21.15.26:0/3608039125 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faed8133e30 msgr2=0x7faed809c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:50.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.723+0000 7faede500700 1 --2- 172.21.15.26:0/3608039125 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faed8133e30 0x7faed809c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:50.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.723+0000 7faede500700 1 -- 172.21.15.26:0/3608039125 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faed8134260 msgr2=0x7faed809cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:50.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.723+0000 7faede500700 1 --2- 172.21.15.26:0/3608039125 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faed8134260 0x7faed809cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:50.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.723+0000 7faede500700 1 -- 172.21.15.26:0/3608039125 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed0009b30 con 0x7faed8133420 2023-10-01T07:55:50.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.723+0000 7faede500700 1 --2- 172.21.15.26:0/3608039125 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faed8133420 0x7faed809c480 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7faed400e810 tx=0x7faed400eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:50.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.724+0000 7faeceffd700 1 -- 172.21.15.26:0/3608039125 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed401f440 con 0x7faed8133420 2023-10-01T07:55:50.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.724+0000 7faeceffd700 1 -- 172.21.15.26:0/3608039125 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed401f5a0 con 0x7faed8133420 2023-10-01T07:55:50.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.724+0000 7faeceffd700 1 -- 172.21.15.26:0/3608039125 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed401f950 con 0x7faed8133420 2023-10-01T07:55:50.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.724+0000 7faee0764700 1 -- 172.21.15.26:0/3608039125 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed811f400 con 0x7faed8133420 2023-10-01T07:55:50.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.724+0000 7faee0764700 1 -- 172.21.15.26:0/3608039125 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed8120900 con 0x7faed8133420 2023-10-01T07:55:50.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.725+0000 7faee0764700 1 -- 172.21.15.26:0/3608039125 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed8074ea0 con 0x7faed8133420 2023-10-01T07:55:50.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.725+0000 7faeceffd700 1 -- 172.21.15.26:0/3608039125 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faed401fab0 con 0x7faed8133420 2023-10-01T07:55:50.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.726+0000 7faeceffd700 1 -- 172.21.15.26:0/3608039125 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faed4047a40 con 0x7faed8133420 2023-10-01T07:55:50.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.734+0000 7faeceffd700 1 -- 172.21.15.26:0/3608039125 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faed401fd60 con 0x7faed8133420 2023-10-01T07:55:50.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.761+0000 7fac18c99700 1 Processor -- start 2023-10-01T07:55:50.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.761+0000 7fac18c99700 1 -- start start 2023-10-01T07:55:50.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.762+0000 7fac18c99700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fac1409ac90 0x7fac1413cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:50.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.762+0000 7fac18c99700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac1413d240 0x7fac1413f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:50.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.762+0000 7fac18c99700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac14134980 con 0x7fac1406c0e0 2023-10-01T07:55:50.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.762+0000 7fac18c99700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac1406c4b0 con 0x7fac1409ac90 2023-10-01T07:55:50.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.762+0000 7fac18c99700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac1409b0e0 con 0x7fac1413d240 2023-10-01T07:55:50.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.762+0000 7fac12d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac1413d240 0x7fac1413f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:50.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.762+0000 7fac12d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac1413d240 0x7fac1413f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44670/0 (socket says 172.21.15.26:44670) 2023-10-01T07:55:50.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.762+0000 7fac12d9d700 1 -- 172.21.15.26:0/2140031451 learned_addr learned my addr 172.21.15.26:0/2140031451 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:50.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.762+0000 7fac11d9b700 1 --2- 172.21.15.26:0/2140031451 >> v2:172.21.15.26:3300/0 conn(0x7fac1409ac90 0x7fac1413cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:50.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.762+0000 7fac11d9b700 1 -- 172.21.15.26:0/2140031451 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac1413d240 msgr2=0x7fac1413f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:50.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.762+0000 7fac11d9b700 1 --2- 172.21.15.26:0/2140031451 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac1413d240 0x7fac1413f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:50.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.762+0000 7fac1159a700 1 -- 172.21.15.26:0/2140031451 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2907426602 0 0) 0x7fac14134980 con 0x7fac1406c0e0 2023-10-01T07:55:50.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.762+0000 7fac11d9b700 1 -- 172.21.15.26:0/2140031451 >> v1:172.21.15.26:6789/0 conn(0x7fac1406c0e0 legacy=0x7fac14134ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:50.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.763+0000 7fac11d9b700 1 -- 172.21.15.26:0/2140031451 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac140a0600 con 0x7fac1409ac90 2023-10-01T07:55:50.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.763+0000 7fac11d9b700 1 --2- 172.21.15.26:0/2140031451 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac1409ac90 0x7fac1413cd00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fac08009840 tx=0x7fac08009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d3c46964b8c4e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:50.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.763+0000 7fac1159a700 1 -- 172.21.15.26:0/2140031451 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac08011830 con 0x7fac1409ac90 2023-10-01T07:55:50.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.763+0000 7fac1159a700 1 -- 172.21.15.26:0/2140031451 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac08011990 con 0x7fac1409ac90 2023-10-01T07:55:50.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.763+0000 7fac1159a700 1 -- 172.21.15.26:0/2140031451 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac08011d20 con 0x7fac1409ac90 2023-10-01T07:55:50.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.764+0000 7fac18c99700 1 -- 172.21.15.26:0/2140031451 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac1409ac90 msgr2=0x7fac1413cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:50.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.764+0000 7fac18c99700 1 --2- 172.21.15.26:0/2140031451 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac1409ac90 0x7fac1413cd00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fac08009840 tx=0x7fac08009b50 comp rx=0 tx=0).stop 2023-10-01T07:55:50.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.764+0000 7fac18c99700 1 -- 172.21.15.26:0/2140031451 shutdown_connections 2023-10-01T07:55:50.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.764+0000 7fac18c99700 1 --2- 172.21.15.26:0/2140031451 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac1413d240 0x7fac1413f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:50.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.764+0000 7fac18c99700 1 --2- 172.21.15.26:0/2140031451 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac1409ac90 0x7fac1413cd00 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:50.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.764+0000 7fac18c99700 1 -- 172.21.15.26:0/2140031451 >> 172.21.15.26:0/2140031451 conn(0x7fac140a4210 msgr2=0x7fac140a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:50.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.764+0000 7fac18c99700 1 -- 172.21.15.26:0/2140031451 shutdown_connections 2023-10-01T07:55:50.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.764+0000 7fac18c99700 1 -- 172.21.15.26:0/2140031451 wait complete. 2023-10-01T07:55:50.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.764+0000 7f3a542f9700 1 Processor -- start 2023-10-01T07:55:50.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.764+0000 7f3a542f9700 1 -- start start 2023-10-01T07:55:50.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.765+0000 7fac18c99700 1 Processor -- start 2023-10-01T07:55:50.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.765+0000 7f3a542f9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3a4c131810 0x7f3a4c131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:50.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.765+0000 7f3a542f9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3a4c099a40 0x7f3a4c099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:50.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.765+0000 7f3a542f9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3a4c09a3b0 0x7f3a4c138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:50.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.765+0000 7f3a542f9700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a4c1313c0 con 0x7f3a4c099a40 2023-10-01T07:55:50.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.765+0000 7f3a542f9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c06e8c0 con 0x7f3a4c09a3b0 2023-10-01T07:55:50.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.765+0000 7f3a542f9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c09a820 con 0x7f3a4c131810 2023-10-01T07:55:50.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.765+0000 7fac18c99700 1 -- start start 2023-10-01T07:55:50.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.766+0000 7fac18c99700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac1406c0e0 0x7fac14132bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:50.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.766+0000 7fac18c99700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac1409ac90 0x7fac14133110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:50.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.766+0000 7fac18c99700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac1413d240 0x7fac14133650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:50.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.766+0000 7fac18c99700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1409e030 con 0x7fac1406c0e0 2023-10-01T07:55:50.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.766+0000 7fac18c99700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac14133df0 con 0x7fac1413d240 2023-10-01T07:55:50.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.766+0000 7fac18c99700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac140a03f0 con 0x7fac1409ac90 2023-10-01T07:55:50.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.767+0000 7fac11d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac1409ac90 0x7fac14133110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:50.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.767+0000 7fac11d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac1409ac90 0x7fac14133110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:38200/0 (socket says 172.21.15.26:38200) 2023-10-01T07:55:50.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.767+0000 7fac11d9b700 1 -- 172.21.15.26:0/991890391 learned_addr learned my addr 172.21.15.26:0/991890391 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:50.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.767+0000 7fac1259c700 1 --2- 172.21.15.26:0/991890391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac1406c0e0 0x7fac14132bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:50.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.767+0000 7fac12d9d700 1 --2- 172.21.15.26:0/991890391 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac1413d240 0x7fac14133650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:50.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.767+0000 7f3a51894700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3a4c099a40 0x7f3a4c099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:50.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.767+0000 7f3a51894700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3a4c099a40 0x7f3a4c099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60476/0 (socket says 172.21.15.26:60476) 2023-10-01T07:55:50.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.767+0000 7f3a51894700 1 -- 172.21.15.26:0/1082779087 learned_addr learned my addr 172.21.15.26:0/1082779087 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:50.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.767+0000 7f3a52896700 1 --2- 172.21.15.26:0/1082779087 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3a4c09a3b0 0x7f3a4c138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:50.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.767+0000 7fac12d9d700 1 -- 172.21.15.26:0/991890391 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac1409ac90 msgr2=0x7fac14133110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:50.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.767+0000 7fac12d9d700 1 --2- 172.21.15.26:0/991890391 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac1409ac90 0x7fac14133110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:50.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.767+0000 7fac12d9d700 1 -- 172.21.15.26:0/991890391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac1406c0e0 msgr2=0x7fac14132bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:50.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.767+0000 7fac12d9d700 1 --2- 172.21.15.26:0/991890391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac1406c0e0 0x7fac14132bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:50.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.767+0000 7fac12d9d700 1 -- 172.21.15.26:0/991890391 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac080094a0 con 0x7fac1413d240 2023-10-01T07:55:50.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.767+0000 7f3a52896700 1 -- 172.21.15.26:0/1082779087 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3a4c131810 msgr2=0x7f3a4c131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:50.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.767+0000 7f3a52896700 1 --2- 172.21.15.26:0/1082779087 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3a4c131810 0x7f3a4c131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:50.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.767+0000 7f3a52896700 1 -- 172.21.15.26:0/1082779087 >> v2:172.21.15.26:3300/0 conn(0x7f3a4c099a40 msgr2=0x7f3a4c099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:50.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.767+0000 7f3a52896700 1 --2- 172.21.15.26:0/1082779087 >> v2:172.21.15.26:3300/0 conn(0x7f3a4c099a40 0x7f3a4c099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:50.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.767+0000 7f3a52896700 1 -- 172.21.15.26:0/1082779087 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4c071d20 con 0x7f3a4c09a3b0 2023-10-01T07:55:50.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.767+0000 7f3a52896700 1 --2- 172.21.15.26:0/1082779087 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3a4c09a3b0 0x7f3a4c138650 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3a4400f370 tx=0x7f3a4400f680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7da937366a2ca265 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:50.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.767+0000 7fac12d9d700 1 --2- 172.21.15.26:0/991890391 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac1413d240 0x7fac14133650 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00ef90 tx=0x7fac0c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:50.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.768+0000 7f3a51093700 1 -- 172.21.15.26:0/1082779087 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a44012070 con 0x7f3a4c09a3b0 2023-10-01T07:55:50.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.768+0000 7fac02ffd700 1 -- 172.21.15.26:0/991890391 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c003c20 con 0x7fac1413d240 2023-10-01T07:55:50.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.768+0000 7fac02ffd700 1 -- 172.21.15.26:0/991890391 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0c00f040 con 0x7fac1413d240 2023-10-01T07:55:50.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.768+0000 7fac02ffd700 1 -- 172.21.15.26:0/991890391 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c009e60 con 0x7fac1413d240 2023-10-01T07:55:50.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.768+0000 7f3a51093700 1 -- 172.21.15.26:0/1082779087 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a4400fe70 con 0x7f3a4c09a3b0 2023-10-01T07:55:50.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.768+0000 7f3a51093700 1 -- 172.21.15.26:0/1082779087 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4400d2f0 con 0x7f3a4c09a3b0 2023-10-01T07:55:50.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.769+0000 7fac18c99700 1 -- 172.21.15.26:0/991890391 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac1413f630 con 0x7fac1413d240 2023-10-01T07:55:50.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.769+0000 7fac18c99700 1 -- 172.21.15.26:0/991890391 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac1409cd30 con 0x7fac1413d240 2023-10-01T07:55:50.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.769+0000 7f3a542f9700 1 -- 172.21.15.26:0/1082779087 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3a4c09a3b0 msgr2=0x7f3a4c138650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:50.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.769+0000 7f3a542f9700 1 --2- 172.21.15.26:0/1082779087 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3a4c09a3b0 0x7f3a4c138650 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3a4400f370 tx=0x7f3a4400f680 comp rx=0 tx=0).stop 2023-10-01T07:55:50.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.769+0000 7f3a542f9700 1 -- 172.21.15.26:0/1082779087 shutdown_connections 2023-10-01T07:55:50.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.769+0000 7f3a542f9700 1 --2- 172.21.15.26:0/1082779087 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3a4c09a3b0 0x7f3a4c138650 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:50.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.769+0000 7f3a542f9700 1 --2- 172.21.15.26:0/1082779087 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3a4c131810 0x7f3a4c131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:50.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.769+0000 7f3a542f9700 1 --2- 172.21.15.26:0/1082779087 >> v2:172.21.15.26:3300/0 conn(0x7f3a4c099a40 0x7f3a4c099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:50.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.769+0000 7f3a542f9700 1 -- 172.21.15.26:0/1082779087 >> 172.21.15.26:0/1082779087 conn(0x7f3a4c0a2aa0 msgr2=0x7f3a4c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:50.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.769+0000 7f3a542f9700 1 -- 172.21.15.26:0/1082779087 shutdown_connections 2023-10-01T07:55:50.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.770+0000 7f3a542f9700 1 -- 172.21.15.26:0/1082779087 wait complete. 2023-10-01T07:55:50.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.770+0000 7fac18c99700 1 -- 172.21.15.26:0/991890391 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac14074ea0 con 0x7fac1413d240 2023-10-01T07:55:50.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.770+0000 7fac02ffd700 1 -- 172.21.15.26:0/991890391 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fac0c00c930 con 0x7fac1413d240 2023-10-01T07:55:50.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.770+0000 7fac02ffd700 1 -- 172.21.15.26:0/991890391 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fac0c03f8f0 con 0x7fac1413d240 2023-10-01T07:55:50.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.771+0000 7f3a542f9700 1 Processor -- start 2023-10-01T07:55:50.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.772+0000 7f3a542f9700 1 -- start start 2023-10-01T07:55:50.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.773+0000 7f3a542f9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a4c099a40 0x7f3a4c11b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:50.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.773+0000 7f3a542f9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3a4c09a3b0 0x7f3a4c11bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:50.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.773+0000 7f3a542f9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3a4c131810 0x7f3a4c11c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:50.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.773+0000 7f3a542f9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c11d320 con 0x7f3a4c099a40 2023-10-01T07:55:50.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.773+0000 7f3a542f9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c06eb00 con 0x7f3a4c09a3b0 2023-10-01T07:55:50.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.773+0000 7f3a542f9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c11ef50 con 0x7f3a4c131810 2023-10-01T07:55:50.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.773+0000 7f3a52095700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a4c099a40 0x7f3a4c11b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:50.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.773+0000 7f3a52896700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3a4c131810 0x7f3a4c11c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:50.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.773+0000 7f3a52095700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a4c099a40 0x7f3a4c11b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60498/0 (socket says 172.21.15.26:60498) 2023-10-01T07:55:50.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.773+0000 7f3a52095700 1 -- 172.21.15.26:0/687633733 learned_addr learned my addr 172.21.15.26:0/687633733 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:50.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.773+0000 7f3a51894700 1 --2- 172.21.15.26:0/687633733 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3a4c09a3b0 0x7f3a4c11bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:50.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.774+0000 7f3a52896700 1 -- 172.21.15.26:0/687633733 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3a4c09a3b0 msgr2=0x7f3a4c11bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:50.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.774+0000 7f3a52896700 1 --2- 172.21.15.26:0/687633733 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3a4c09a3b0 0x7f3a4c11bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:50.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.774+0000 7f3a52896700 1 -- 172.21.15.26:0/687633733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a4c099a40 msgr2=0x7f3a4c11b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:50.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.774+0000 7f3a52896700 1 --2- 172.21.15.26:0/687633733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a4c099a40 0x7f3a4c11b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:50.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.774+0000 7f3a52896700 1 -- 172.21.15.26:0/687633733 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4400f050 con 0x7f3a4c131810 2023-10-01T07:55:50.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.774+0000 7f3a52896700 1 --2- 172.21.15.26:0/687633733 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3a4c131810 0x7f3a4c11c2e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3a44019000 tx=0x7f3a44004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:50.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.774+0000 7f3a42ffd700 1 -- 172.21.15.26:0/687633733 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4400bb50 con 0x7f3a4c131810 2023-10-01T07:55:50.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.774+0000 7f3a52095700 1 --2- 172.21.15.26:0/687633733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a4c099a40 0x7f3a4c11b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:55:50.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.774+0000 7f3a42ffd700 1 -- 172.21.15.26:0/687633733 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a4400bcb0 con 0x7f3a4c131810 2023-10-01T07:55:50.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.774+0000 7f3a42ffd700 1 -- 172.21.15.26:0/687633733 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a44004280 con 0x7f3a4c131810 2023-10-01T07:55:50.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.775+0000 7f3a542f9700 1 -- 172.21.15.26:0/687633733 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a4c0a1cd0 con 0x7f3a4c131810 2023-10-01T07:55:50.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.775+0000 7f3a542f9700 1 -- 172.21.15.26:0/687633733 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a4c11e9c0 con 0x7f3a4c131810 2023-10-01T07:55:50.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.777+0000 7f3a42ffd700 1 -- 172.21.15.26:0/687633733 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3a440043e0 con 0x7f3a4c131810 2023-10-01T07:55:50.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.777+0000 7f3a42ffd700 1 -- 172.21.15.26:0/687633733 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3a44045130 con 0x7f3a4c131810 2023-10-01T07:55:50.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.778+0000 7fac02ffd700 1 -- 172.21.15.26:0/991890391 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fac0c00cbe0 con 0x7fac1413d240 2023-10-01T07:55:50.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.778+0000 7f3a542f9700 1 -- 172.21.15.26:0/687633733 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a4c074ea0 con 0x7f3a4c131810 2023-10-01T07:55:50.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.788+0000 7f3a42ffd700 1 -- 172.21.15.26:0/687633733 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3a44027950 con 0x7f3a4c131810 2023-10-01T07:55:50.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.865+0000 7ff8f25a2700 1 -- 172.21.15.26:0/355219098 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff8ec074ea0 con 0x7ff8ec09de50 2023-10-01T07:55:50.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.865+0000 7ff8e8ff9700 1 -- 172.21.15.26:0/355219098 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff8dc015030 con 0x7ff8ec09de50 2023-10-01T07:55:50.866 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:50.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.868+0000 7ff8f25a2700 1 -- 172.21.15.26:0/355219098 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff8ec09de50 msgr2=0x7ff8ec11d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:50.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.868+0000 7ff8f25a2700 1 --2- 172.21.15.26:0/355219098 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff8ec09de50 0x7ff8ec11d710 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc000c00 tx=0x7ff8dc004750 comp rx=0 tx=0).stop 2023-10-01T07:55:50.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.868+0000 7ff8f25a2700 1 -- 172.21.15.26:0/355219098 shutdown_connections 2023-10-01T07:55:50.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.868+0000 7ff8f25a2700 1 --2- 172.21.15.26:0/355219098 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff8ec1338a0 0x7ff8ec11e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:50.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.868+0000 7ff8f25a2700 1 --2- 172.21.15.26:0/355219098 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff8ec09de50 0x7ff8ec11d710 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:50.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.868+0000 7ff8f25a2700 1 --2- 172.21.15.26:0/355219098 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8ec09e760 0x7ff8ec11dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:50.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.868+0000 7ff8f25a2700 1 -- 172.21.15.26:0/355219098 >> 172.21.15.26:0/355219098 conn(0x7ff8ec0a2aa0 msgr2=0x7ff8ec1bae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:50.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.868+0000 7ff8f25a2700 1 -- 172.21.15.26:0/355219098 shutdown_connections 2023-10-01T07:55:50.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.868+0000 7ff8f25a2700 1 -- 172.21.15.26:0/355219098 wait complete. 2023-10-01T07:55:50.883 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:50.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.950+0000 7faee0764700 1 -- 172.21.15.26:0/3608039125 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faed806b250 con 0x7faed8133420 2023-10-01T07:55:50.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.950+0000 7faeceffd700 1 -- 172.21.15.26:0/3608039125 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faed4024070 con 0x7faed8133420 2023-10-01T07:55:50.951 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:50.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.953+0000 7faee0764700 1 -- 172.21.15.26:0/3608039125 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faed8133420 msgr2=0x7faed809c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:50.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.953+0000 7faee0764700 1 --2- 172.21.15.26:0/3608039125 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faed8133420 0x7faed809c480 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7faed400e810 tx=0x7faed400eb20 comp rx=0 tx=0).stop 2023-10-01T07:55:50.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.953+0000 7faee0764700 1 -- 172.21.15.26:0/3608039125 shutdown_connections 2023-10-01T07:55:50.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.953+0000 7faee0764700 1 --2- 172.21.15.26:0/3608039125 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faed8134260 0x7faed809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:50.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.953+0000 7faee0764700 1 --2- 172.21.15.26:0/3608039125 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faed8133420 0x7faed809c480 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:50.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.953+0000 7faee0764700 1 --2- 172.21.15.26:0/3608039125 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faed8133e30 0x7faed809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:50.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.953+0000 7faee0764700 1 -- 172.21.15.26:0/3608039125 >> 172.21.15.26:0/3608039125 conn(0x7faed80a4210 msgr2=0x7faed80a0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:50.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.953+0000 7faee0764700 1 -- 172.21.15.26:0/3608039125 shutdown_connections 2023-10-01T07:55:50.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.953+0000 7faee0764700 1 -- 172.21.15.26:0/3608039125 wait complete. 2023-10-01T07:55:50.967 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:50.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.987+0000 7fac18c99700 1 -- 172.21.15.26:0/991890391 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fac1409dd80 con 0x7fac1413d240 2023-10-01T07:55:50.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.987+0000 7fac02ffd700 1 -- 172.21.15.26:0/991890391 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fac0c013b90 con 0x7fac1413d240 2023-10-01T07:55:50.988 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:50.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.989+0000 7fac18c99700 1 -- 172.21.15.26:0/991890391 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac1413d240 msgr2=0x7fac14133650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:50.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.989+0000 7fac18c99700 1 --2- 172.21.15.26:0/991890391 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac1413d240 0x7fac14133650 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00ef90 tx=0x7fac0c00c3a0 comp rx=0 tx=0).stop 2023-10-01T07:55:50.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.990+0000 7fac18c99700 1 -- 172.21.15.26:0/991890391 shutdown_connections 2023-10-01T07:55:50.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.990+0000 7fac18c99700 1 --2- 172.21.15.26:0/991890391 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac1413d240 0x7fac14133650 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:50.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.990+0000 7fac18c99700 1 --2- 172.21.15.26:0/991890391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac1406c0e0 0x7fac14132bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:50.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.990+0000 7fac18c99700 1 --2- 172.21.15.26:0/991890391 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac1409ac90 0x7fac14133110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:50.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.990+0000 7fac18c99700 1 -- 172.21.15.26:0/991890391 >> 172.21.15.26:0/991890391 conn(0x7fac140a4210 msgr2=0x7fac140a0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:50.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.990+0000 7fac18c99700 1 -- 172.21.15.26:0/991890391 shutdown_connections 2023-10-01T07:55:50.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:50.990+0000 7fac18c99700 1 -- 172.21.15.26:0/991890391 wait complete. 2023-10-01T07:55:51.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:51.001+0000 7f3a542f9700 1 -- 172.21.15.26:0/687633733 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3a4c06b9e0 con 0x7f3a4c131810 2023-10-01T07:55:51.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:51.001+0000 7f3a42ffd700 1 -- 172.21.15.26:0/687633733 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3a44027360 con 0x7f3a4c131810 2023-10-01T07:55:51.001 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:51.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:51.003+0000 7f3a542f9700 1 -- 172.21.15.26:0/687633733 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3a4c131810 msgr2=0x7f3a4c11c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:51.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:51.003+0000 7f3a542f9700 1 --2- 172.21.15.26:0/687633733 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3a4c131810 0x7f3a4c11c2e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3a44019000 tx=0x7f3a44004ad0 comp rx=0 tx=0).stop 2023-10-01T07:55:51.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:51.003+0000 7f3a542f9700 1 -- 172.21.15.26:0/687633733 shutdown_connections 2023-10-01T07:55:51.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:51.003+0000 7f3a542f9700 1 --2- 172.21.15.26:0/687633733 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3a4c131810 0x7f3a4c11c2e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:51.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:51.003+0000 7f3a542f9700 1 --2- 172.21.15.26:0/687633733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a4c099a40 0x7f3a4c11b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:51.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:51.003+0000 7f3a542f9700 1 --2- 172.21.15.26:0/687633733 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3a4c09a3b0 0x7f3a4c11bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:51.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:51.004+0000 7f3a542f9700 1 -- 172.21.15.26:0/687633733 >> 172.21.15.26:0/687633733 conn(0x7f3a4c0a2aa0 msgr2=0x7f3a4c0a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:51.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:51.004+0000 7f3a542f9700 1 -- 172.21.15.26:0/687633733 shutdown_connections 2023-10-01T07:55:51.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:51.004+0000 7f3a542f9700 1 -- 172.21.15.26:0/687633733 wait complete. 2023-10-01T07:55:51.006 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:51.018 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:51.884 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:51.968 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:52.006 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:52.018 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:52.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.033+0000 7fade592b700 1 Processor -- start 2023-10-01T07:55:52.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.033+0000 7fade592b700 1 -- start start 2023-10-01T07:55:52.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.034+0000 7fade592b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fade012cf60 0x7fade006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:52.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.034+0000 7fade592b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fade012f8b0 0x7fade012fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:52.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.034+0000 7fade592b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fade0130260 0x7fade0136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:52.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.034+0000 7fade592b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fade012d330 con 0x7fade0130260 2023-10-01T07:55:52.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.034+0000 7fade592b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade012cd90 con 0x7fade012cf60 2023-10-01T07:55:52.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.034+0000 7fade592b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fade01306d0 con 0x7fade012f8b0 2023-10-01T07:55:52.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.034+0000 7faddeffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fade012cf60 0x7fade006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:52.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.034+0000 7faddf7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fade0130260 0x7fade0136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:52.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.034+0000 7faddeffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fade012cf60 0x7fade006f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44710/0 (socket says 172.21.15.26:44710) 2023-10-01T07:55:52.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.034+0000 7faddf7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fade0130260 0x7fade0136c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60500/0 (socket says 172.21.15.26:60500) 2023-10-01T07:55:52.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.034+0000 7faddeffd700 1 -- 172.21.15.26:0/1761261539 learned_addr learned my addr 172.21.15.26:0/1761261539 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:52.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.034+0000 7faddf7fe700 1 -- 172.21.15.26:0/1761261539 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fade012f8b0 msgr2=0x7fade012fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:52.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.034+0000 7faddf7fe700 1 --2- 172.21.15.26:0/1761261539 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fade012f8b0 0x7fade012fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.034+0000 7faddf7fe700 1 -- 172.21.15.26:0/1761261539 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fade012cf60 msgr2=0x7fade006f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:52.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.034+0000 7faddf7fe700 1 --2- 172.21.15.26:0/1761261539 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fade012cf60 0x7fade006f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.034+0000 7faddf7fe700 1 -- 172.21.15.26:0/1761261539 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade0071780 con 0x7fade0130260 2023-10-01T07:55:52.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.034+0000 7faddeffd700 1 --2- 172.21.15.26:0/1761261539 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fade012cf60 0x7fade006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:52.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.035+0000 7faddf7fe700 1 --2- 172.21.15.26:0/1761261539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fade0130260 0x7fade0136c20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fadd8009d90 tx=0x7fadd800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c9a598680a5150 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:52.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.035+0000 7fadddffb700 1 -- 172.21.15.26:0/1761261539 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd800e070 con 0x7fade0130260 2023-10-01T07:55:52.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.035+0000 7fadddffb700 1 -- 172.21.15.26:0/1761261539 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd800bb20 con 0x7fade0130260 2023-10-01T07:55:52.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.035+0000 7fadddffb700 1 -- 172.21.15.26:0/1761261539 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd8012430 con 0x7fade0130260 2023-10-01T07:55:52.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.036+0000 7fade592b700 1 -- 172.21.15.26:0/1761261539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fade0130260 msgr2=0x7fade0136c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:52.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.036+0000 7fade592b700 1 --2- 172.21.15.26:0/1761261539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fade0130260 0x7fade0136c20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fadd8009d90 tx=0x7fadd800b330 comp rx=0 tx=0).stop 2023-10-01T07:55:52.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.036+0000 7fade592b700 1 -- 172.21.15.26:0/1761261539 shutdown_connections 2023-10-01T07:55:52.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.036+0000 7fade592b700 1 --2- 172.21.15.26:0/1761261539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fade0130260 0x7fade0136c20 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.036+0000 7fade592b700 1 --2- 172.21.15.26:0/1761261539 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fade012cf60 0x7fade006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.036+0000 7fade592b700 1 --2- 172.21.15.26:0/1761261539 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fade012f8b0 0x7fade012fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.036+0000 7fade592b700 1 -- 172.21.15.26:0/1761261539 >> 172.21.15.26:0/1761261539 conn(0x7fade00a2aa0 msgr2=0x7fade00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:52.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.036+0000 7fade592b700 1 -- 172.21.15.26:0/1761261539 shutdown_connections 2023-10-01T07:55:52.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.036+0000 7fade592b700 1 -- 172.21.15.26:0/1761261539 wait complete. 2023-10-01T07:55:52.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.037+0000 7fade592b700 1 Processor -- start 2023-10-01T07:55:52.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.038+0000 7fade592b700 1 -- start start 2023-10-01T07:55:52.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.038+0000 7fade592b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fade012cf60 0x7fade01c3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:52.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.038+0000 7fade592b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fade012f8b0 0x7fade01c4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:52.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.038+0000 7fade592b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fade0130260 0x7fade01c4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:52.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.038+0000 7fade592b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade0129fa0 con 0x7fade012cf60 2023-10-01T07:55:52.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.038+0000 7fade592b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade009e990 con 0x7fade012f8b0 2023-10-01T07:55:52.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.038+0000 7fade592b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fade009b6d0 con 0x7fade0130260 2023-10-01T07:55:52.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.039+0000 7faddeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fade012cf60 0x7fade01c3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:52.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.039+0000 7faddeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fade012cf60 0x7fade01c3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60510/0 (socket says 172.21.15.26:60510) 2023-10-01T07:55:52.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.039+0000 7faddeffd700 1 -- 172.21.15.26:0/717595709 learned_addr learned my addr 172.21.15.26:0/717595709 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:52.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.039+0000 7fadde7fc700 1 --2- 172.21.15.26:0/717595709 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fade012f8b0 0x7fade01c4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:52.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.039+0000 7fadde7fc700 1 -- 172.21.15.26:0/717595709 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fade0130260 msgr2=0x7fade01c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:52.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.039+0000 7fadde7fc700 1 --2- 172.21.15.26:0/717595709 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fade0130260 0x7fade01c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.039+0000 7fadde7fc700 1 -- 172.21.15.26:0/717595709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fade012cf60 msgr2=0x7fade01c3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:52.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.039+0000 7fadde7fc700 1 --2- 172.21.15.26:0/717595709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fade012cf60 0x7fade01c3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.039+0000 7fadde7fc700 1 -- 172.21.15.26:0/717595709 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd000b7f0 con 0x7fade012f8b0 2023-10-01T07:55:52.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.039+0000 7faddeffd700 1 --2- 172.21.15.26:0/717595709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fade012cf60 0x7fade01c3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:52.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.039+0000 7fadde7fc700 1 --2- 172.21.15.26:0/717595709 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fade012f8b0 0x7fade01c4310 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fade0129f70 tx=0x7fadd400b730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:52.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.040+0000 7fadc7fff700 1 -- 172.21.15.26:0/717595709 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd4011830 con 0x7fade012f8b0 2023-10-01T07:55:52.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.040+0000 7fadc7fff700 1 -- 172.21.15.26:0/717595709 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd4011990 con 0x7fade012f8b0 2023-10-01T07:55:52.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.040+0000 7fadc7fff700 1 -- 172.21.15.26:0/717595709 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd4011d40 con 0x7fade012f8b0 2023-10-01T07:55:52.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.040+0000 7fade592b700 1 -- 172.21.15.26:0/717595709 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd8009a70 con 0x7fade012f8b0 2023-10-01T07:55:52.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.040+0000 7fade592b700 1 -- 172.21.15.26:0/717595709 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fade009d470 con 0x7fade012f8b0 2023-10-01T07:55:52.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.041+0000 7fadc7fff700 1 -- 172.21.15.26:0/717595709 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fadd401a400 con 0x7fade012f8b0 2023-10-01T07:55:52.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.041+0000 7fadc7fff700 1 -- 172.21.15.26:0/717595709 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fadd403f5b0 con 0x7fade012f8b0 2023-10-01T07:55:52.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.041+0000 7fade592b700 1 -- 172.21.15.26:0/717595709 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fade0074ea0 con 0x7fade012f8b0 2023-10-01T07:55:52.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.048+0000 7fadc7fff700 1 -- 172.21.15.26:0/717595709 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fadd4015070 con 0x7fade012f8b0 2023-10-01T07:55:52.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.125+0000 7f96f833f700 1 Processor -- start 2023-10-01T07:55:52.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.125+0000 7f96f833f700 1 -- start start 2023-10-01T07:55:52.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.126+0000 7f96f833f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f96f012cf60 0x7f96f006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:52.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.126+0000 7f96f833f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96f012f8b0 0x7f96f012fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:52.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.126+0000 7f96f833f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96f0130260 0x7f96f0136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:52.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.126+0000 7f96f833f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96f012d330 con 0x7f96f012cf60 2023-10-01T07:55:52.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.126+0000 7f96f833f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f012cd90 con 0x7f96f0130260 2023-10-01T07:55:52.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.126+0000 7f96f833f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96f01306d0 con 0x7f96f012f8b0 2023-10-01T07:55:52.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.126+0000 7f96f58da700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96f012f8b0 0x7f96f012fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:52.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.126+0000 7f96f58da700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96f012f8b0 0x7f96f012fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:38236/0 (socket says 172.21.15.26:38236) 2023-10-01T07:55:52.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.126+0000 7f96f58da700 1 -- 172.21.15.26:0/1594217182 learned_addr learned my addr 172.21.15.26:0/1594217182 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:52.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.126+0000 7f96f68dc700 1 --2- 172.21.15.26:0/1594217182 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96f0130260 0x7f96f0136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:52.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.126+0000 7f96f60db700 1 --2- 172.21.15.26:0/1594217182 >> v2:172.21.15.26:3300/0 conn(0x7f96f012cf60 0x7f96f006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:52.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.127+0000 7f96f58da700 1 -- 172.21.15.26:0/1594217182 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96f0130260 msgr2=0x7f96f0136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:52.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.127+0000 7f96f58da700 1 --2- 172.21.15.26:0/1594217182 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96f0130260 0x7f96f0136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.127+0000 7f96f58da700 1 -- 172.21.15.26:0/1594217182 >> v2:172.21.15.26:3300/0 conn(0x7f96f012cf60 msgr2=0x7f96f006f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:52.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.127+0000 7f96f58da700 1 --2- 172.21.15.26:0/1594217182 >> v2:172.21.15.26:3300/0 conn(0x7f96f012cf60 0x7f96f006f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.127+0000 7f96f58da700 1 -- 172.21.15.26:0/1594217182 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f0071780 con 0x7f96f012f8b0 2023-10-01T07:55:52.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.127+0000 7f96f58da700 1 --2- 172.21.15.26:0/1594217182 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96f012f8b0 0x7f96f012fd20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f96e0009920 tx=0x7f96e0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2651335ea0c3212 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:52.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.127+0000 7f96f50d9700 1 -- 172.21.15.26:0/1594217182 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e000f940 con 0x7f96f012f8b0 2023-10-01T07:55:52.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.127+0000 7f96f50d9700 1 -- 172.21.15.26:0/1594217182 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e000faa0 con 0x7f96f012f8b0 2023-10-01T07:55:52.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.127+0000 7f96f50d9700 1 -- 172.21.15.26:0/1594217182 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e000fe30 con 0x7f96f012f8b0 2023-10-01T07:55:52.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.128+0000 7f96f833f700 1 -- 172.21.15.26:0/1594217182 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96f012f8b0 msgr2=0x7f96f012fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:52.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.128+0000 7f96f833f700 1 --2- 172.21.15.26:0/1594217182 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96f012f8b0 0x7f96f012fd20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f96e0009920 tx=0x7f96e0009c30 comp rx=0 tx=0).stop 2023-10-01T07:55:52.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.128+0000 7f96f833f700 1 -- 172.21.15.26:0/1594217182 shutdown_connections 2023-10-01T07:55:52.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.128+0000 7f96f833f700 1 --2- 172.21.15.26:0/1594217182 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96f0130260 0x7f96f0136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.128+0000 7f96f833f700 1 --2- 172.21.15.26:0/1594217182 >> v2:172.21.15.26:3300/0 conn(0x7f96f012cf60 0x7f96f006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.128+0000 7f96f833f700 1 --2- 172.21.15.26:0/1594217182 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96f012f8b0 0x7f96f012fd20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.128+0000 7f96f833f700 1 -- 172.21.15.26:0/1594217182 >> 172.21.15.26:0/1594217182 conn(0x7f96f00a2aa0 msgr2=0x7f96f00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:52.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.128+0000 7f96f833f700 1 -- 172.21.15.26:0/1594217182 shutdown_connections 2023-10-01T07:55:52.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.128+0000 7f96f833f700 1 -- 172.21.15.26:0/1594217182 wait complete. 2023-10-01T07:55:52.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.130+0000 7f96f833f700 1 Processor -- start 2023-10-01T07:55:52.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.130+0000 7f96f833f700 1 -- start start 2023-10-01T07:55:52.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.131+0000 7f96f833f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96f012cf60 0x7f96f009bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:52.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.131+0000 7f96f833f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96f012f8b0 0x7f96f009c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:52.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.131+0000 7f96f833f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96f0130260 0x7f96f01c4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:52.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.131+0000 7f96f833f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f009edd0 con 0x7f96f012f8b0 2023-10-01T07:55:52.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.131+0000 7f96f833f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f009e930 con 0x7f96f012cf60 2023-10-01T07:55:52.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.131+0000 7f96f833f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96f009da00 con 0x7f96f0130260 2023-10-01T07:55:52.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.131+0000 7f96f60db700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96f012cf60 0x7f96f009bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:52.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.131+0000 7f96f60db700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96f012cf60 0x7f96f009bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44730/0 (socket says 172.21.15.26:44730) 2023-10-01T07:55:52.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.131+0000 7f96f60db700 1 -- 172.21.15.26:0/401905777 learned_addr learned my addr 172.21.15.26:0/401905777 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:52.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.131+0000 7f96f68dc700 1 --2- 172.21.15.26:0/401905777 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96f0130260 0x7f96f01c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:52.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.131+0000 7f96f58da700 1 --2- 172.21.15.26:0/401905777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96f012f8b0 0x7f96f009c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:52.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.131+0000 7f96f60db700 1 -- 172.21.15.26:0/401905777 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96f0130260 msgr2=0x7f96f01c4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:52.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.131+0000 7f96f60db700 1 --2- 172.21.15.26:0/401905777 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96f0130260 0x7f96f01c4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.131+0000 7f96f60db700 1 -- 172.21.15.26:0/401905777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96f012f8b0 msgr2=0x7f96f009c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:52.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.131+0000 7f96f60db700 1 --2- 172.21.15.26:0/401905777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96f012f8b0 0x7f96f009c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.131+0000 7f96f60db700 1 -- 172.21.15.26:0/401905777 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e0009550 con 0x7f96f012cf60 2023-10-01T07:55:52.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.132+0000 7f96f60db700 1 --2- 172.21.15.26:0/401905777 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96f012cf60 0x7f96f009bbf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f96ec00e9b0 tx=0x7f96ec00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:52.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.132+0000 7f96e6ffd700 1 -- 172.21.15.26:0/401905777 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec009710 con 0x7f96f012cf60 2023-10-01T07:55:52.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.132+0000 7f96e6ffd700 1 -- 172.21.15.26:0/401905777 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ec00ee50 con 0x7f96f012cf60 2023-10-01T07:55:52.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.132+0000 7f96f833f700 1 -- 172.21.15.26:0/401905777 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f009e670 con 0x7f96f012cf60 2023-10-01T07:55:52.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.132+0000 7f96e6ffd700 1 -- 172.21.15.26:0/401905777 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec00ca50 con 0x7f96f012cf60 2023-10-01T07:55:52.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.132+0000 7f96f833f700 1 -- 172.21.15.26:0/401905777 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f0119160 con 0x7f96f012cf60 2023-10-01T07:55:52.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.133+0000 7f96e6ffd700 1 -- 172.21.15.26:0/401905777 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f96ec00cbb0 con 0x7f96f012cf60 2023-10-01T07:55:52.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.133+0000 7f96e6ffd700 1 -- 172.21.15.26:0/401905777 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f96ec03f6b0 con 0x7f96f012cf60 2023-10-01T07:55:52.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.134+0000 7f96f833f700 1 -- 172.21.15.26:0/401905777 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96f0067e40 con 0x7f96f012cf60 2023-10-01T07:55:52.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.143+0000 7f96e6ffd700 1 -- 172.21.15.26:0/401905777 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f96ec0232f0 con 0x7f96f012cf60 2023-10-01T07:55:52.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.182+0000 7ff38d563700 1 Processor -- start 2023-10-01T07:55:52.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.182+0000 7ff38d563700 1 -- start start 2023-10-01T07:55:52.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.183+0000 7ff38d563700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff3881337f0 0x7ff388138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:52.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.183+0000 7ff38d563700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff388138dc0 0x7ff38813b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:52.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.183+0000 7ff38d563700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff38806b990 con 0x7ff388133420 2023-10-01T07:55:52.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.183+0000 7ff38d563700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff38809b0e0 con 0x7ff3881337f0 2023-10-01T07:55:52.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.183+0000 7ff38d563700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff388133c20 con 0x7ff388138dc0 2023-10-01T07:55:52.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.183+0000 7ff3877fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff388138dc0 0x7ff38813b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:52.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.183+0000 7ff3877fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff388138dc0 0x7ff38813b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:38256/0 (socket says 172.21.15.26:38256) 2023-10-01T07:55:52.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.183+0000 7ff3877fe700 1 -- 172.21.15.26:0/2106135446 learned_addr learned my addr 172.21.15.26:0/2106135446 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:52.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.183+0000 7ff3877fe700 1 -- 172.21.15.26:0/2106135446 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff3881337f0 msgr2=0x7ff388138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:52.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.183+0000 7ff3877fe700 1 --2- 172.21.15.26:0/2106135446 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff3881337f0 0x7ff388138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.183+0000 7ff3877fe700 1 -- 172.21.15.26:0/2106135446 >> v1:172.21.15.26:6789/0 conn(0x7ff388133420 legacy=0x7ff388133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:52.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.183+0000 7ff3877fe700 1 -- 172.21.15.26:0/2106135446 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3880a0590 con 0x7ff388138dc0 2023-10-01T07:55:52.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.184+0000 7ff3877fe700 1 --2- 172.21.15.26:0/2106135446 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff388138dc0 0x7ff38813b1a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff380009e80 tx=0x7ff38000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=937911cc151cebc8 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:52.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.184+0000 7ff385ffb700 1 -- 172.21.15.26:0/2106135446 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38000e070 con 0x7ff388138dc0 2023-10-01T07:55:52.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.184+0000 7ff385ffb700 1 -- 172.21.15.26:0/2106135446 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff380003a20 con 0x7ff388138dc0 2023-10-01T07:55:52.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.184+0000 7ff385ffb700 1 -- 172.21.15.26:0/2106135446 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff380003dd0 con 0x7ff388138dc0 2023-10-01T07:55:52.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.184+0000 7ff38d563700 1 -- 172.21.15.26:0/2106135446 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff388138dc0 msgr2=0x7ff38813b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:52.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.184+0000 7ff38d563700 1 --2- 172.21.15.26:0/2106135446 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff388138dc0 0x7ff38813b1a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff380009e80 tx=0x7ff38000b330 comp rx=0 tx=0).stop 2023-10-01T07:55:52.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.184+0000 7ff38d563700 1 -- 172.21.15.26:0/2106135446 shutdown_connections 2023-10-01T07:55:52.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.184+0000 7ff38d563700 1 --2- 172.21.15.26:0/2106135446 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff388138dc0 0x7ff38813b1a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.184+0000 7ff38d563700 1 --2- 172.21.15.26:0/2106135446 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff3881337f0 0x7ff388138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.184+0000 7ff38d563700 1 -- 172.21.15.26:0/2106135446 >> 172.21.15.26:0/2106135446 conn(0x7ff3880a4210 msgr2=0x7ff3880a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:52.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.185+0000 7ff38d563700 1 -- 172.21.15.26:0/2106135446 shutdown_connections 2023-10-01T07:55:52.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.185+0000 7ff38d563700 1 -- 172.21.15.26:0/2106135446 wait complete. 2023-10-01T07:55:52.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.186+0000 7ff38d563700 1 Processor -- start 2023-10-01T07:55:52.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.186+0000 7ff38d563700 1 -- start start 2023-10-01T07:55:52.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.187+0000 7fd269341700 1 Processor -- start 2023-10-01T07:55:52.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.187+0000 7ff38d563700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff388133420 0x7ff388137cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:52.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.187+0000 7ff38d563700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff3881337f0 0x7ff388138200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:52.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.187+0000 7fd269341700 1 -- start start 2023-10-01T07:55:52.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.187+0000 7ff38d563700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff388138dc0 0x7ff38809c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:52.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.187+0000 7ff38d563700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38812f6c0 con 0x7ff388138dc0 2023-10-01T07:55:52.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.187+0000 7ff38d563700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3881308d0 con 0x7ff388133420 2023-10-01T07:55:52.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.187+0000 7ff38d563700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff388134760 con 0x7ff3881337f0 2023-10-01T07:55:52.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.187+0000 7ff3867fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff3881337f0 0x7ff388138200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:52.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.187+0000 7ff3877fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff388138dc0 0x7ff38809c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:52.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.187+0000 7ff3877fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff388138dc0 0x7ff38809c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60556/0 (socket says 172.21.15.26:60556) 2023-10-01T07:55:52.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.187+0000 7ff3877fe700 1 -- 172.21.15.26:0/2836455021 learned_addr learned my addr 172.21.15.26:0/2836455021 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:52.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.187+0000 7ff3867fc700 1 --2- 172.21.15.26:0/2836455021 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff3881337f0 0x7ff388138200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:38266/0 (socket says 172.21.15.26:38266) 2023-10-01T07:55:52.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.188+0000 7ff3877fe700 1 -- 172.21.15.26:0/2836455021 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff3881337f0 msgr2=0x7ff388138200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:52.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.188+0000 7ff3877fe700 1 --2- 172.21.15.26:0/2836455021 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff3881337f0 0x7ff388138200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.188+0000 7ff3877fe700 1 -- 172.21.15.26:0/2836455021 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff388133420 msgr2=0x7ff388137cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:52.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.188+0000 7ff3877fe700 1 --2- 172.21.15.26:0/2836455021 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff388133420 0x7ff388137cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.188+0000 7ff3877fe700 1 -- 172.21.15.26:0/2836455021 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff380009b30 con 0x7ff388138dc0 2023-10-01T07:55:52.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.188+0000 7fd269341700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd2640a0a30 0x7fd2640a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:52.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.188+0000 7fd269341700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd26413d820 0x7fd26413fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:52.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.188+0000 7fd269341700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd26409d920 con 0x7fd2640a1340 2023-10-01T07:55:52.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.188+0000 7fd269341700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd26409d020 con 0x7fd2640a0a30 2023-10-01T07:55:52.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.188+0000 7fd269341700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2640a2010 con 0x7fd26413d820 2023-10-01T07:55:52.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.188+0000 7ff3867fc700 1 --2- 172.21.15.26:0/2836455021 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff3881337f0 0x7ff388138200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:52.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.188+0000 7fd2627fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd2640a1340 0x7fd26413c100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49232/0 (socket says 172.21.15.26:49232) 2023-10-01T07:55:52.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.188+0000 7fd2627fc700 1 -- 172.21.15.26:0/1572578489 learned_addr learned my addr 172.21.15.26:0/1572578489 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:52.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.188+0000 7fd262ffd700 1 --2- 172.21.15.26:0/1572578489 >> v2:172.21.15.26:3300/0 conn(0x7fd2640a0a30 0x7fd2640a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:52.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.188+0000 7ff3877fe700 1 --2- 172.21.15.26:0/2836455021 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff388138dc0 0x7ff38809c8c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff380015040 tx=0x7ff380004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:52.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.188+0000 7fd262ffd700 1 -- 172.21.15.26:0/1572578489 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd26413d820 msgr2=0x7fd26413fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:52.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.188+0000 7fd262ffd700 1 --2- 172.21.15.26:0/1572578489 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd26413d820 0x7fd26413fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.188+0000 7fd262ffd700 1 -- 172.21.15.26:0/1572578489 >> v1:172.21.15.26:6789/0 conn(0x7fd2640a1340 legacy=0x7fd26413c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:52.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.188+0000 7fd262ffd700 1 -- 172.21.15.26:0/1572578489 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd26409dbe0 con 0x7fd2640a0a30 2023-10-01T07:55:52.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.189+0000 7ff36f7fe700 1 -- 172.21.15.26:0/2836455021 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff380004240 con 0x7ff388138dc0 2023-10-01T07:55:52.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.189+0000 7ff38d563700 1 -- 172.21.15.26:0/2836455021 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff388138880 con 0x7ff388138dc0 2023-10-01T07:55:52.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.189+0000 7fd262ffd700 1 --2- 172.21.15.26:0/1572578489 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2640a0a30 0x7fd2640a0e00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd254009840 tx=0x7fd254009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14dc313ab4da120 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:52.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.189+0000 7ff38d563700 1 -- 172.21.15.26:0/2836455021 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff388130d00 con 0x7ff388138dc0 2023-10-01T07:55:52.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.189+0000 7ff36f7fe700 1 -- 172.21.15.26:0/2836455021 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3800043a0 con 0x7ff388138dc0 2023-10-01T07:55:52.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.189+0000 7ff36f7fe700 1 -- 172.21.15.26:0/2836455021 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff380004750 con 0x7ff388138dc0 2023-10-01T07:55:52.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.189+0000 7ff36f7fe700 1 -- 172.21.15.26:0/2836455021 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff380012430 con 0x7ff388138dc0 2023-10-01T07:55:52.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.190+0000 7ff36f7fe700 1 -- 172.21.15.26:0/2836455021 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff380040d50 con 0x7ff388138dc0 2023-10-01T07:55:52.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.191+0000 7fd261ffb700 1 -- 172.21.15.26:0/1572578489 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd254004230 con 0x7fd2640a0a30 2023-10-01T07:55:52.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.191+0000 7fd261ffb700 1 -- 172.21.15.26:0/1572578489 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd254004390 con 0x7fd2640a0a30 2023-10-01T07:55:52.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.191+0000 7fd261ffb700 1 -- 172.21.15.26:0/1572578489 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2540036a0 con 0x7fd2640a0a30 2023-10-01T07:55:52.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.191+0000 7ff36d7fa700 1 -- 172.21.15.26:0/2836455021 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3680052e0 con 0x7ff388138dc0 2023-10-01T07:55:52.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.191+0000 7fd269341700 1 -- 172.21.15.26:0/1572578489 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2640a0a30 msgr2=0x7fd2640a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:52.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.191+0000 7fd269341700 1 --2- 172.21.15.26:0/1572578489 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2640a0a30 0x7fd2640a0e00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd254009840 tx=0x7fd254009b50 comp rx=0 tx=0).stop 2023-10-01T07:55:52.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.192+0000 7fd269341700 1 -- 172.21.15.26:0/1572578489 shutdown_connections 2023-10-01T07:55:52.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.192+0000 7fd269341700 1 --2- 172.21.15.26:0/1572578489 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2640a0a30 0x7fd2640a0e00 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.192+0000 7fd269341700 1 --2- 172.21.15.26:0/1572578489 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd26413d820 0x7fd26413fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.192+0000 7fd269341700 1 -- 172.21.15.26:0/1572578489 >> 172.21.15.26:0/1572578489 conn(0x7fd2640a6550 msgr2=0x7fd2640a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:52.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.196+0000 7fd269341700 1 -- 172.21.15.26:0/1572578489 shutdown_connections 2023-10-01T07:55:52.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.196+0000 7fd269341700 1 -- 172.21.15.26:0/1572578489 wait complete. 2023-10-01T07:55:52.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.197+0000 7fd269341700 1 Processor -- start 2023-10-01T07:55:52.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.197+0000 7fd269341700 1 -- start start 2023-10-01T07:55:52.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.198+0000 7fd269341700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2640a0a30 0x7fd26406fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:52.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.198+0000 7fd269341700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2640a1340 0x7fd26406fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:52.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.198+0000 7fd269341700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd26413d820 0x7fd264070530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:52.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.198+0000 7fd269341700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd26409ff90 con 0x7fd26413d820 2023-10-01T07:55:52.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.198+0000 7fd269341700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd264071620 con 0x7fd2640a0a30 2023-10-01T07:55:52.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.198+0000 7fd269341700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd264126400 con 0x7fd2640a1340 2023-10-01T07:55:52.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.198+0000 7fd2627fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2640a1340 0x7fd26406fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:52.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.198+0000 7fd2627fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2640a1340 0x7fd26406fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:38280/0 (socket says 172.21.15.26:38280) 2023-10-01T07:55:52.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.198+0000 7fd2627fc700 1 -- 172.21.15.26:0/219511905 learned_addr learned my addr 172.21.15.26:0/219511905 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:52.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.198+0000 7fd2637fe700 1 --2- 172.21.15.26:0/219511905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd26413d820 0x7fd264070530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:52.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.198+0000 7fd262ffd700 1 --2- 172.21.15.26:0/219511905 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2640a0a30 0x7fd26406fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:52.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.199+0000 7fd262ffd700 1 -- 172.21.15.26:0/219511905 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2640a1340 msgr2=0x7fd26406fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:52.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.199+0000 7fd262ffd700 1 --2- 172.21.15.26:0/219511905 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2640a1340 0x7fd26406fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.199+0000 7fd262ffd700 1 -- 172.21.15.26:0/219511905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd26413d820 msgr2=0x7fd264070530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:52.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.199+0000 7fd262ffd700 1 --2- 172.21.15.26:0/219511905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd26413d820 0x7fd264070530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.199+0000 7fd262ffd700 1 -- 172.21.15.26:0/219511905 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2540094a0 con 0x7fd2640a0a30 2023-10-01T07:55:52.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.199+0000 7fd2627fc700 1 --2- 172.21.15.26:0/219511905 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2640a1340 0x7fd26406fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:52.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.199+0000 7fd2637fe700 1 --2- 172.21.15.26:0/219511905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd26413d820 0x7fd264070530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:52.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.199+0000 7fd262ffd700 1 --2- 172.21.15.26:0/219511905 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2640a0a30 0x7fd26406fab0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd26409cc20 tx=0x7fd254004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:52.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.199+0000 7fd24b7fe700 1 -- 172.21.15.26:0/219511905 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd254003d60 con 0x7fd2640a0a30 2023-10-01T07:55:52.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.199+0000 7fd24b7fe700 1 -- 172.21.15.26:0/219511905 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd254011630 con 0x7fd2640a0a30 2023-10-01T07:55:52.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.199+0000 7fd269341700 1 -- 172.21.15.26:0/219511905 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2640a4b30 con 0x7fd2640a0a30 2023-10-01T07:55:52.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.199+0000 7fd24b7fe700 1 -- 172.21.15.26:0/219511905 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2540119e0 con 0x7fd2640a0a30 2023-10-01T07:55:52.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.199+0000 7fd269341700 1 -- 172.21.15.26:0/219511905 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2641266c0 con 0x7fd2640a0a30 2023-10-01T07:55:52.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.201+0000 7ff36f7fe700 1 -- 172.21.15.26:0/2836455021 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff380017080 con 0x7ff388138dc0 2023-10-01T07:55:52.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.201+0000 7fd269341700 1 -- 172.21.15.26:0/219511905 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd264071e20 con 0x7fd2640a0a30 2023-10-01T07:55:52.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.201+0000 7fd24b7fe700 1 -- 172.21.15.26:0/219511905 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd254022070 con 0x7fd2640a0a30 2023-10-01T07:55:52.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.202+0000 7fd24b7fe700 1 -- 172.21.15.26:0/219511905 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd254041570 con 0x7fd2640a0a30 2023-10-01T07:55:52.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.210+0000 7fd24b7fe700 1 -- 172.21.15.26:0/219511905 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd254011b40 con 0x7fd2640a0a30 2023-10-01T07:55:52.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.323+0000 7fade592b700 1 -- 172.21.15.26:0/717595709 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fade00713a0 con 0x7fade012f8b0 2023-10-01T07:55:52.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.324+0000 7fadc7fff700 1 -- 172.21.15.26:0/717595709 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fadd4028090 con 0x7fade012f8b0 2023-10-01T07:55:52.325 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:52.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.328+0000 7fade592b700 1 -- 172.21.15.26:0/717595709 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fade012f8b0 msgr2=0x7fade01c4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:52.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.328+0000 7fade592b700 1 --2- 172.21.15.26:0/717595709 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fade012f8b0 0x7fade01c4310 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fade0129f70 tx=0x7fadd400b730 comp rx=0 tx=0).stop 2023-10-01T07:55:52.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.328+0000 7fade592b700 1 -- 172.21.15.26:0/717595709 shutdown_connections 2023-10-01T07:55:52.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.328+0000 7fade592b700 1 --2- 172.21.15.26:0/717595709 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fade0130260 0x7fade01c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.328+0000 7fade592b700 1 --2- 172.21.15.26:0/717595709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fade012cf60 0x7fade01c3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.328+0000 7fade592b700 1 --2- 172.21.15.26:0/717595709 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fade012f8b0 0x7fade01c4310 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.328+0000 7fade592b700 1 -- 172.21.15.26:0/717595709 >> 172.21.15.26:0/717595709 conn(0x7fade00a2aa0 msgr2=0x7fade006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:52.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.329+0000 7fade592b700 1 -- 172.21.15.26:0/717595709 shutdown_connections 2023-10-01T07:55:52.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.329+0000 7fade592b700 1 -- 172.21.15.26:0/717595709 wait complete. 2023-10-01T07:55:52.343 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:52.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.358+0000 7f96f833f700 1 -- 172.21.15.26:0/401905777 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f96f0074ea0 con 0x7f96f012cf60 2023-10-01T07:55:52.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.358+0000 7f96e6ffd700 1 -- 172.21.15.26:0/401905777 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f96ec021030 con 0x7f96f012cf60 2023-10-01T07:55:52.359 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:52.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.360+0000 7f96f833f700 1 -- 172.21.15.26:0/401905777 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96f012cf60 msgr2=0x7f96f009bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:52.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.360+0000 7f96f833f700 1 --2- 172.21.15.26:0/401905777 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96f012cf60 0x7f96f009bbf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f96ec00e9b0 tx=0x7f96ec00ecc0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.361+0000 7f96f833f700 1 -- 172.21.15.26:0/401905777 shutdown_connections 2023-10-01T07:55:52.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.361+0000 7f96f833f700 1 --2- 172.21.15.26:0/401905777 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96f0130260 0x7f96f01c4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.361+0000 7f96f833f700 1 --2- 172.21.15.26:0/401905777 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96f012cf60 0x7f96f009bbf0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.361+0000 7f96f833f700 1 --2- 172.21.15.26:0/401905777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96f012f8b0 0x7f96f009c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.361+0000 7f96f833f700 1 -- 172.21.15.26:0/401905777 >> 172.21.15.26:0/401905777 conn(0x7f96f00a2aa0 msgr2=0x7f96f01b7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:52.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.361+0000 7f96f833f700 1 -- 172.21.15.26:0/401905777 shutdown_connections 2023-10-01T07:55:52.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.361+0000 7f96f833f700 1 -- 172.21.15.26:0/401905777 wait complete. 2023-10-01T07:55:52.375 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:52.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.409+0000 7ff36d7fa700 1 -- 172.21.15.26:0/2836455021 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff368005590 con 0x7ff388138dc0 2023-10-01T07:55:52.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.410+0000 7ff36f7fe700 1 -- 172.21.15.26:0/2836455021 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff3800126e0 con 0x7ff388138dc0 2023-10-01T07:55:52.411 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:52.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.412+0000 7ff36d7fa700 1 -- 172.21.15.26:0/2836455021 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff388138dc0 msgr2=0x7ff38809c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:52.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.412+0000 7ff36d7fa700 1 --2- 172.21.15.26:0/2836455021 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff388138dc0 0x7ff38809c8c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff380015040 tx=0x7ff380004ad0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.412+0000 7ff36d7fa700 1 -- 172.21.15.26:0/2836455021 shutdown_connections 2023-10-01T07:55:52.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.412+0000 7ff36d7fa700 1 --2- 172.21.15.26:0/2836455021 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff388138dc0 0x7ff38809c8c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.412+0000 7ff36d7fa700 1 --2- 172.21.15.26:0/2836455021 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff388133420 0x7ff388137cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.412+0000 7ff36d7fa700 1 --2- 172.21.15.26:0/2836455021 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff3881337f0 0x7ff388138200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.412+0000 7ff36d7fa700 1 -- 172.21.15.26:0/2836455021 >> 172.21.15.26:0/2836455021 conn(0x7ff3880a4210 msgr2=0x7ff3880a0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:52.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.412+0000 7ff36d7fa700 1 -- 172.21.15.26:0/2836455021 shutdown_connections 2023-10-01T07:55:52.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.412+0000 7ff36d7fa700 1 -- 172.21.15.26:0/2836455021 wait complete. 2023-10-01T07:55:52.426 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:52.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.444+0000 7fd269341700 1 -- 172.21.15.26:0/219511905 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd264074ea0 con 0x7fd2640a0a30 2023-10-01T07:55:52.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.444+0000 7fd24b7fe700 1 -- 172.21.15.26:0/219511905 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd25401abc0 con 0x7fd2640a0a30 2023-10-01T07:55:52.445 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:52.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.446+0000 7fd269341700 1 -- 172.21.15.26:0/219511905 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2640a0a30 msgr2=0x7fd26406fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:52.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.446+0000 7fd269341700 1 --2- 172.21.15.26:0/219511905 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2640a0a30 0x7fd26406fab0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd26409cc20 tx=0x7fd254004750 comp rx=0 tx=0).stop 2023-10-01T07:55:52.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.446+0000 7fd269341700 1 -- 172.21.15.26:0/219511905 shutdown_connections 2023-10-01T07:55:52.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.446+0000 7fd269341700 1 --2- 172.21.15.26:0/219511905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd26413d820 0x7fd264070530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.446+0000 7fd269341700 1 --2- 172.21.15.26:0/219511905 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2640a0a30 0x7fd26406fab0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.446+0000 7fd269341700 1 --2- 172.21.15.26:0/219511905 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2640a1340 0x7fd26406fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:52.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.446+0000 7fd269341700 1 -- 172.21.15.26:0/219511905 >> 172.21.15.26:0/219511905 conn(0x7fd2640a6550 msgr2=0x7fd2640a2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:52.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.446+0000 7fd269341700 1 -- 172.21.15.26:0/219511905 shutdown_connections 2023-10-01T07:55:52.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:52.447+0000 7fd269341700 1 -- 172.21.15.26:0/219511905 wait complete. 2023-10-01T07:55:52.460 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:53.344 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:53.376 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:53.428 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:53.461 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:53.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.496+0000 7face4a52700 1 Processor -- start 2023-10-01T07:55:53.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.497+0000 7face4a52700 1 -- start start 2023-10-01T07:55:53.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.497+0000 7face4a52700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7face0131810 0x7face0131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:53.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.497+0000 7face4a52700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7face0099a40 0x7face0099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:53.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.497+0000 7face4a52700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face009a850 con 0x7face009a3b0 2023-10-01T07:55:53.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.497+0000 7face4a52700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7face009b580 con 0x7face0099a40 2023-10-01T07:55:53.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.497+0000 7face4a52700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face01313c0 con 0x7face0131810 2023-10-01T07:55:53.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.498+0000 7facde59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7face0131810 0x7face0131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:53.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.498+0000 7facde59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7face0131810 0x7face0131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55112/0 (socket says 172.21.15.26:55112) 2023-10-01T07:55:53.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.498+0000 7facde59c700 1 -- 172.21.15.26:0/3371933810 learned_addr learned my addr 172.21.15.26:0/3371933810 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:53.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.498+0000 7facddd9b700 1 --2- 172.21.15.26:0/3371933810 >> v2:172.21.15.26:3300/0 conn(0x7face0099a40 0x7face0099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:53.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.498+0000 7facddd9b700 1 -- 172.21.15.26:0/3371933810 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7face0131810 msgr2=0x7face0131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:53.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.498+0000 7facddd9b700 1 --2- 172.21.15.26:0/3371933810 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7face0131810 0x7face0131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:53.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.498+0000 7facddd9b700 1 -- 172.21.15.26:0/3371933810 >> v1:172.21.15.26:6789/0 conn(0x7face009a3b0 legacy=0x7face0138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:53.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.498+0000 7facddd9b700 1 -- 172.21.15.26:0/3371933810 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face006e8c0 con 0x7face0099a40 2023-10-01T07:55:53.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.498+0000 7facddd9b700 1 --2- 172.21.15.26:0/3371933810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face0099a40 0x7face0099e70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7facd4009870 tx=0x7facd4009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa82fdb8f1b6d593 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:53.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.499+0000 7facdd59a700 1 -- 172.21.15.26:0/3371933810 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd4011830 con 0x7face0099a40 2023-10-01T07:55:53.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.499+0000 7facdd59a700 1 -- 172.21.15.26:0/3371933810 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd4011990 con 0x7face0099a40 2023-10-01T07:55:53.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.499+0000 7facdd59a700 1 -- 172.21.15.26:0/3371933810 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd4011d20 con 0x7face0099a40 2023-10-01T07:55:53.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.499+0000 7face4a52700 1 -- 172.21.15.26:0/3371933810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face0099a40 msgr2=0x7face0099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:53.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.499+0000 7face4a52700 1 --2- 172.21.15.26:0/3371933810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face0099a40 0x7face0099e70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7facd4009870 tx=0x7facd4009b80 comp rx=0 tx=0).stop 2023-10-01T07:55:53.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.499+0000 7face4a52700 1 -- 172.21.15.26:0/3371933810 shutdown_connections 2023-10-01T07:55:53.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.499+0000 7face4a52700 1 --2- 172.21.15.26:0/3371933810 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7face0131810 0x7face0131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:53.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.499+0000 7face4a52700 1 --2- 172.21.15.26:0/3371933810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face0099a40 0x7face0099e70 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:53.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.500+0000 7face4a52700 1 -- 172.21.15.26:0/3371933810 >> 172.21.15.26:0/3371933810 conn(0x7face00a2aa0 msgr2=0x7face00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:53.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.500+0000 7face4a52700 1 -- 172.21.15.26:0/3371933810 shutdown_connections 2023-10-01T07:55:53.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.500+0000 7face4a52700 1 -- 172.21.15.26:0/3371933810 wait complete. 2023-10-01T07:55:53.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.501+0000 7face4a52700 1 Processor -- start 2023-10-01T07:55:53.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.501+0000 7face4a52700 1 -- start start 2023-10-01T07:55:53.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.501+0000 7face4a52700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7face0099a40 0x7face006f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:53.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.501+0000 7face4a52700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7face009a3b0 0x7face006fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:53.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.501+0000 7face4a52700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face0131810 0x7face0070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:53.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.501+0000 7face4a52700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face011ecb0 con 0x7face0131810 2023-10-01T07:55:53.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.501+0000 7face4a52700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face0070a70 con 0x7face0099a40 2023-10-01T07:55:53.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.501+0000 7face4a52700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7face011f030 con 0x7face009a3b0 2023-10-01T07:55:53.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.502+0000 7facded9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face0131810 0x7face0070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:53.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.502+0000 7facde59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7face0099a40 0x7face006f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:53.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.502+0000 7facde59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7face0099a40 0x7face006f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55124/0 (socket says 172.21.15.26:55124) 2023-10-01T07:55:53.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.502+0000 7facded9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face0131810 0x7face0070090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54130/0 (socket says 172.21.15.26:54130) 2023-10-01T07:55:53.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.502+0000 7facde59c700 1 -- 172.21.15.26:0/1317948110 learned_addr learned my addr 172.21.15.26:0/1317948110 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:53.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.502+0000 7facddd9b700 1 --2- 172.21.15.26:0/1317948110 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7face009a3b0 0x7face006fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:53.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.502+0000 7facded9d700 1 -- 172.21.15.26:0/1317948110 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7face009a3b0 msgr2=0x7face006fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:53.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.502+0000 7facded9d700 1 --2- 172.21.15.26:0/1317948110 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7face009a3b0 0x7face006fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:53.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.502+0000 7facded9d700 1 -- 172.21.15.26:0/1317948110 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7face0099a40 msgr2=0x7face006f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:53.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.502+0000 7facded9d700 1 --2- 172.21.15.26:0/1317948110 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7face0099a40 0x7face006f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:53.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.502+0000 7facded9d700 1 -- 172.21.15.26:0/1317948110 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd40094a0 con 0x7face0131810 2023-10-01T07:55:53.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.502+0000 7facde59c700 1 --2- 172.21.15.26:0/1317948110 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7face0099a40 0x7face006f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:53.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.502+0000 7facded9d700 1 --2- 172.21.15.26:0/1317948110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face0131810 0x7face0070090 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7facd800cb90 tx=0x7facd800cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:53.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.503+0000 7facceffd700 1 -- 172.21.15.26:0/1317948110 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd8003c00 con 0x7face0131810 2023-10-01T07:55:53.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.503+0000 7facceffd700 1 -- 172.21.15.26:0/1317948110 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd8003d60 con 0x7face0131810 2023-10-01T07:55:53.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.503+0000 7face4a52700 1 -- 172.21.15.26:0/1317948110 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face00a1c70 con 0x7face0131810 2023-10-01T07:55:53.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.503+0000 7facceffd700 1 -- 172.21.15.26:0/1317948110 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd800aa80 con 0x7face0131810 2023-10-01T07:55:53.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.503+0000 7face4a52700 1 -- 172.21.15.26:0/1317948110 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face011fd60 con 0x7face0131810 2023-10-01T07:55:53.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.504+0000 7facceffd700 1 -- 172.21.15.26:0/1317948110 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7facd800abe0 con 0x7face0131810 2023-10-01T07:55:53.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.504+0000 7facceffd700 1 -- 172.21.15.26:0/1317948110 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7facd803f610 con 0x7face0131810 2023-10-01T07:55:53.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.504+0000 7face4a52700 1 -- 172.21.15.26:0/1317948110 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7face0074ea0 con 0x7face0131810 2023-10-01T07:55:53.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.510+0000 7facceffd700 1 -- 172.21.15.26:0/1317948110 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7facd80198f0 con 0x7face0131810 2023-10-01T07:55:53.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.537+0000 7ffb07a9b700 1 Processor -- start 2023-10-01T07:55:53.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.537+0000 7ffb07a9b700 1 -- start start 2023-10-01T07:55:53.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.538+0000 7ffb07a9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb0009e1d0 0x7ffb00135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:53.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.538+0000 7ffb07a9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffb00135e50 0x7ffb00138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:53.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.538+0000 7ffb07a9b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb0009f130 con 0x7ffb0009d6f0 2023-10-01T07:55:53.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.538+0000 7ffb07a9b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0009f520 con 0x7ffb0009e1d0 2023-10-01T07:55:53.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.538+0000 7ffb07a9b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0009e930 con 0x7ffb00135e50 2023-10-01T07:55:53.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.538+0000 7ffb05036700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb0009e1d0 0x7ffb00135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:53.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.538+0000 7ffb05036700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb0009e1d0 0x7ffb00135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55132/0 (socket says 172.21.15.26:55132) 2023-10-01T07:55:53.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.538+0000 7ffb05036700 1 -- 172.21.15.26:0/3582218612 learned_addr learned my addr 172.21.15.26:0/3582218612 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:53.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.538+0000 7ffb06038700 1 --2- 172.21.15.26:0/3582218612 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffb00135e50 0x7ffb00138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:53.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.539+0000 7ffb05036700 1 -- 172.21.15.26:0/3582218612 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffb00135e50 msgr2=0x7ffb00138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:53.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.539+0000 7ffb04835700 1 -- 172.21.15.26:0/3582218612 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3118988264 0 0) 0x7ffb0009f130 con 0x7ffb0009d6f0 2023-10-01T07:55:53.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.539+0000 7ffb05036700 1 --2- 172.21.15.26:0/3582218612 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffb00135e50 0x7ffb00138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:53.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.539+0000 7ffb05036700 1 -- 172.21.15.26:0/3582218612 >> v1:172.21.15.26:6789/0 conn(0x7ffb0009d6f0 legacy=0x7ffb0009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:53.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.539+0000 7ffb05036700 1 -- 172.21.15.26:0/3582218612 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0009b2d0 con 0x7ffb0009e1d0 2023-10-01T07:55:53.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.539+0000 7ffb05036700 1 --2- 172.21.15.26:0/3582218612 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb0009e1d0 0x7ffb00135910 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0009920 tx=0x7ffaf0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6d5037c3a5e2e29 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:53.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.539+0000 7ffb04835700 1 -- 172.21.15.26:0/3582218612 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf0011830 con 0x7ffb0009e1d0 2023-10-01T07:55:53.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.539+0000 7ffb04835700 1 -- 172.21.15.26:0/3582218612 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf0011990 con 0x7ffb0009e1d0 2023-10-01T07:55:53.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.539+0000 7ffb04835700 1 -- 172.21.15.26:0/3582218612 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf0011d20 con 0x7ffb0009e1d0 2023-10-01T07:55:53.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.540+0000 7ffb07a9b700 1 -- 172.21.15.26:0/3582218612 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb0009e1d0 msgr2=0x7ffb00135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:53.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.540+0000 7ffb07a9b700 1 --2- 172.21.15.26:0/3582218612 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb0009e1d0 0x7ffb00135910 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0009920 tx=0x7ffaf0009c30 comp rx=0 tx=0).stop 2023-10-01T07:55:53.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.540+0000 7ffb07a9b700 1 -- 172.21.15.26:0/3582218612 shutdown_connections 2023-10-01T07:55:53.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.540+0000 7ffb07a9b700 1 --2- 172.21.15.26:0/3582218612 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffb00135e50 0x7ffb00138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:53.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.540+0000 7ffb07a9b700 1 --2- 172.21.15.26:0/3582218612 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb0009e1d0 0x7ffb00135910 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:53.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.540+0000 7ffb07a9b700 1 -- 172.21.15.26:0/3582218612 >> 172.21.15.26:0/3582218612 conn(0x7ffb00066f50 msgr2=0x7ffb0009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:53.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.540+0000 7ffb07a9b700 1 -- 172.21.15.26:0/3582218612 shutdown_connections 2023-10-01T07:55:53.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.540+0000 7ffb07a9b700 1 -- 172.21.15.26:0/3582218612 wait complete. 2023-10-01T07:55:53.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.541+0000 7ffb07a9b700 1 Processor -- start 2023-10-01T07:55:53.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.541+0000 7ffb07a9b700 1 -- start start 2023-10-01T07:55:53.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.542+0000 7ffb07a9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffb0009d6f0 0x7ffb001c6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:53.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.542+0000 7ffb07a9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb0009e1d0 0x7ffb001c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:53.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.542+0000 7ffb07a9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb00135e50 0x7ffb00131af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:53.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.542+0000 7ffb07a9b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb000a20d0 con 0x7ffb00135e50 2023-10-01T07:55:53.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.542+0000 7ffb07a9b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0009c700 con 0x7ffb0009e1d0 2023-10-01T07:55:53.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.542+0000 7ffb07a9b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb00134d00 con 0x7ffb0009d6f0 2023-10-01T07:55:53.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.542+0000 7ffb05036700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb0009e1d0 0x7ffb001c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:53.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.542+0000 7ffb05036700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb0009e1d0 0x7ffb001c6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55140/0 (socket says 172.21.15.26:55140) 2023-10-01T07:55:53.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.542+0000 7ffb05036700 1 -- 172.21.15.26:0/438231545 learned_addr learned my addr 172.21.15.26:0/438231545 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:53.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.542+0000 7ffb06038700 1 --2- 172.21.15.26:0/438231545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb00135e50 0x7ffb00131af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:53.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.542+0000 7ffb05837700 1 --2- 172.21.15.26:0/438231545 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffb0009d6f0 0x7ffb001c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:53.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.542+0000 7ffb05036700 1 -- 172.21.15.26:0/438231545 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffb0009d6f0 msgr2=0x7ffb001c6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:53.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.542+0000 7ffb05036700 1 --2- 172.21.15.26:0/438231545 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffb0009d6f0 0x7ffb001c6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:53.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.542+0000 7ffb05036700 1 -- 172.21.15.26:0/438231545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb00135e50 msgr2=0x7ffb00131af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:53.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.542+0000 7ffb05036700 1 --2- 172.21.15.26:0/438231545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb00135e50 0x7ffb00131af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:53.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.542+0000 7ffb05036700 1 -- 172.21.15.26:0/438231545 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf0009550 con 0x7ffb0009e1d0 2023-10-01T07:55:53.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.543+0000 7ffb05837700 1 --2- 172.21.15.26:0/438231545 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffb0009d6f0 0x7ffb001c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:55:53.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.543+0000 7ffb05036700 1 --2- 172.21.15.26:0/438231545 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb0009e1d0 0x7ffb001c6eb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0000c00 tx=0x7ffaf0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:53.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.543+0000 7ffaf67fc700 1 -- 172.21.15.26:0/438231545 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf0004510 con 0x7ffb0009e1d0 2023-10-01T07:55:53.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.543+0000 7ffaf67fc700 1 -- 172.21.15.26:0/438231545 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf00036a0 con 0x7ffb0009e1d0 2023-10-01T07:55:53.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.543+0000 7ffaf67fc700 1 -- 172.21.15.26:0/438231545 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf0003a10 con 0x7ffb0009e1d0 2023-10-01T07:55:53.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.543+0000 7ffb07a9b700 1 -- 172.21.15.26:0/438231545 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb00135290 con 0x7ffb0009e1d0 2023-10-01T07:55:53.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.543+0000 7ffb07a9b700 1 -- 172.21.15.26:0/438231545 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb001c73f0 con 0x7ffb0009e1d0 2023-10-01T07:55:53.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.544+0000 7ffaf67fc700 1 -- 172.21.15.26:0/438231545 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffaf0003b70 con 0x7ffb0009e1d0 2023-10-01T07:55:53.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.544+0000 7ffaf67fc700 1 -- 172.21.15.26:0/438231545 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ffaf0021030 con 0x7ffb0009e1d0 2023-10-01T07:55:53.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.544+0000 7ffb07a9b700 1 -- 172.21.15.26:0/438231545 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb001c7580 con 0x7ffb0009e1d0 2023-10-01T07:55:53.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.554+0000 7ffaf67fc700 1 -- 172.21.15.26:0/438231545 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffaf001a430 con 0x7ffb0009e1d0 2023-10-01T07:55:53.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.581+0000 7f13413e5700 1 Processor -- start 2023-10-01T07:55:53.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.581+0000 7f13413e5700 1 -- start start 2023-10-01T07:55:53.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.582+0000 7f13413e5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f133c09d6f0 0x7f133c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:53.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.582+0000 7f13413e5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f133c09e410 0x7f133c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:53.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.582+0000 7f13413e5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f133c09b120 con 0x7f133c09e000 2023-10-01T07:55:53.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.582+0000 7f13413e5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f133c06b460 con 0x7f133c09e410 2023-10-01T07:55:53.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.582+0000 7f13413e5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f133c09a7e0 con 0x7f133c09d6f0 2023-10-01T07:55:53.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.582+0000 7f133affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f133c09d6f0 0x7f133c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:53.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.582+0000 7f133affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f133c09d6f0 0x7f133c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:58160/0 (socket says 172.21.15.26:58160) 2023-10-01T07:55:53.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.582+0000 7f133affd700 1 -- 172.21.15.26:0/95587208 learned_addr learned my addr 172.21.15.26:0/95587208 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:53.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.582+0000 7f133b7fe700 1 --2- 172.21.15.26:0/95587208 >> v2:172.21.15.26:3300/0 conn(0x7f133c09e410 0x7f133c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:53.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.583+0000 7f133affd700 1 -- 172.21.15.26:0/95587208 >> v2:172.21.15.26:3300/0 conn(0x7f133c09e410 msgr2=0x7f133c134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:53.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.583+0000 7f133affd700 1 --2- 172.21.15.26:0/95587208 >> v2:172.21.15.26:3300/0 conn(0x7f133c09e410 0x7f133c134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:53.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.583+0000 7f133affd700 1 -- 172.21.15.26:0/95587208 >> v1:172.21.15.26:6789/0 conn(0x7f133c09e000 legacy=0x7f133c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:53.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.583+0000 7f133affd700 1 -- 172.21.15.26:0/95587208 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f133c09a500 con 0x7f133c09d6f0 2023-10-01T07:55:53.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.583+0000 7f133affd700 1 --2- 172.21.15.26:0/95587208 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f133c09d6f0 0x7f133c09dac0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f132c009920 tx=0x7f132c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe38f2a3a0a3e650 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:53.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.583+0000 7f1339ffb700 1 -- 172.21.15.26:0/95587208 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c00ba20 con 0x7f133c09d6f0 2023-10-01T07:55:53.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.583+0000 7f1339ffb700 1 -- 172.21.15.26:0/95587208 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132c00bb80 con 0x7f133c09d6f0 2023-10-01T07:55:53.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.583+0000 7f1339ffb700 1 -- 172.21.15.26:0/95587208 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c009e70 con 0x7f133c09d6f0 2023-10-01T07:55:53.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.584+0000 7f13413e5700 1 -- 172.21.15.26:0/95587208 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f133c09d6f0 msgr2=0x7f133c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:53.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.584+0000 7f13413e5700 1 --2- 172.21.15.26:0/95587208 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f133c09d6f0 0x7f133c09dac0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f132c009920 tx=0x7f132c009c30 comp rx=0 tx=0).stop 2023-10-01T07:55:53.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.584+0000 7f13413e5700 1 -- 172.21.15.26:0/95587208 shutdown_connections 2023-10-01T07:55:53.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.584+0000 7f13413e5700 1 --2- 172.21.15.26:0/95587208 >> v2:172.21.15.26:3300/0 conn(0x7f133c09e410 0x7f133c134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:53.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.584+0000 7f13413e5700 1 --2- 172.21.15.26:0/95587208 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f133c09d6f0 0x7f133c09dac0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:53.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.584+0000 7f13413e5700 1 -- 172.21.15.26:0/95587208 >> 172.21.15.26:0/95587208 conn(0x7f133c066f50 msgr2=0x7f133c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:53.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.584+0000 7f13413e5700 1 -- 172.21.15.26:0/95587208 shutdown_connections 2023-10-01T07:55:53.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.584+0000 7f13413e5700 1 -- 172.21.15.26:0/95587208 wait complete. 2023-10-01T07:55:53.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.586+0000 7f13413e5700 1 Processor -- start 2023-10-01T07:55:53.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.586+0000 7f13413e5700 1 -- start start 2023-10-01T07:55:53.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.586+0000 7f13413e5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f133c09d6f0 0x7f133c1a5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:53.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.586+0000 7f13413e5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f133c09e000 0x7f133c1a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:53.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.586+0000 7f13413e5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f133c09e410 0x7f133c1a6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:53.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.586+0000 7f13413e5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c1a9330 con 0x7f133c09d6f0 2023-10-01T07:55:53.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.586+0000 7f13413e5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133c1a8c80 con 0x7f133c09e000 2023-10-01T07:55:53.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.586+0000 7f13413e5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f133c09c710 con 0x7f133c09e410 2023-10-01T07:55:53.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.586+0000 7f133affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f133c09d6f0 0x7f133c1a5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:53.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.586+0000 7f133affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f133c09d6f0 0x7f133c1a5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54156/0 (socket says 172.21.15.26:54156) 2023-10-01T07:55:53.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.586+0000 7f133affd700 1 -- 172.21.15.26:0/592049378 learned_addr learned my addr 172.21.15.26:0/592049378 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:53.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.586+0000 7f133a7fc700 1 --2- 172.21.15.26:0/592049378 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f133c09e000 0x7f133c1a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:53.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.586+0000 7f133b7fe700 1 --2- 172.21.15.26:0/592049378 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f133c09e410 0x7f133c1a6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:53.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.587+0000 7f133affd700 1 -- 172.21.15.26:0/592049378 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f133c09e410 msgr2=0x7f133c1a6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:53.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.587+0000 7f133affd700 1 --2- 172.21.15.26:0/592049378 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f133c09e410 0x7f133c1a6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:53.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.587+0000 7f133affd700 1 -- 172.21.15.26:0/592049378 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f133c09e000 msgr2=0x7f133c1a62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:53.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.587+0000 7f133affd700 1 --2- 172.21.15.26:0/592049378 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f133c09e000 0x7f133c1a62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:53.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.587+0000 7f133affd700 1 -- 172.21.15.26:0/592049378 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132c009550 con 0x7f133c09d6f0 2023-10-01T07:55:53.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.587+0000 7f133a7fc700 1 --2- 172.21.15.26:0/592049378 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f133c09e000 0x7f133c1a62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:53.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.587+0000 7f133affd700 1 --2- 172.21.15.26:0/592049378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f133c09d6f0 0x7f133c1a5db0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f132c009870 tx=0x7f132c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:53.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.587+0000 7f13237fe700 1 -- 172.21.15.26:0/592049378 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c004300 con 0x7f133c09d6f0 2023-10-01T07:55:53.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.588+0000 7f13237fe700 1 -- 172.21.15.26:0/592049378 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132c01f070 con 0x7f133c09d6f0 2023-10-01T07:55:53.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.588+0000 7f13237fe700 1 -- 172.21.15.26:0/592049378 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c0036a0 con 0x7f133c09d6f0 2023-10-01T07:55:53.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.588+0000 7f13413e5700 1 -- 172.21.15.26:0/592049378 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f133c1a7ad0 con 0x7f133c09d6f0 2023-10-01T07:55:53.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.588+0000 7f13413e5700 1 -- 172.21.15.26:0/592049378 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f133c1a98d0 con 0x7f133c09d6f0 2023-10-01T07:55:53.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.589+0000 7f13413e5700 1 -- 172.21.15.26:0/592049378 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f133c074ea0 con 0x7f133c09d6f0 2023-10-01T07:55:53.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.589+0000 7f13237fe700 1 -- 172.21.15.26:0/592049378 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f132c021030 con 0x7f133c09d6f0 2023-10-01T07:55:53.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.598+0000 7f13237fe700 1 -- 172.21.15.26:0/592049378 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f132c019770 con 0x7f133c09d6f0 2023-10-01T07:55:53.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.598+0000 7f13237fe700 1 -- 172.21.15.26:0/592049378 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f132c075750 con 0x7f133c09d6f0 2023-10-01T07:55:53.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.630+0000 7fbc66373700 1 Processor -- start 2023-10-01T07:55:53.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.630+0000 7fbc66373700 1 -- start start 2023-10-01T07:55:53.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.630+0000 7fbc66373700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbc600a0a30 0x7fbc600a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:53.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.630+0000 7fbc66373700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc60134170 0x7fbc6013bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:53.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.630+0000 7fbc66373700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc6009edd0 con 0x7fbc600a1340 2023-10-01T07:55:53.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.630+0000 7fbc66373700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc6009e1f0 con 0x7fbc600a0a30 2023-10-01T07:55:53.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.630+0000 7fbc66373700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6009dc50 con 0x7fbc60134170 2023-10-01T07:55:53.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.630+0000 7fbc64910700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc60134170 0x7fbc6013bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:53.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.631+0000 7fbc64910700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc60134170 0x7fbc6013bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55162/0 (socket says 172.21.15.26:55162) 2023-10-01T07:55:53.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.631+0000 7fbc64910700 1 -- 172.21.15.26:0/3718343480 learned_addr learned my addr 172.21.15.26:0/3718343480 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:53.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.631+0000 7fbc5ffff700 1 --2- 172.21.15.26:0/3718343480 >> v2:172.21.15.26:3300/0 conn(0x7fbc600a0a30 0x7fbc600a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:53.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.631+0000 7fbc64910700 1 -- 172.21.15.26:0/3718343480 >> v2:172.21.15.26:3300/0 conn(0x7fbc600a0a30 msgr2=0x7fbc600a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:53.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.631+0000 7fbc64910700 1 --2- 172.21.15.26:0/3718343480 >> v2:172.21.15.26:3300/0 conn(0x7fbc600a0a30 0x7fbc600a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:53.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.631+0000 7fbc64910700 1 -- 172.21.15.26:0/3718343480 >> v1:172.21.15.26:6789/0 conn(0x7fbc600a1340 legacy=0x7fbc60133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:53.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.631+0000 7fbc64910700 1 -- 172.21.15.26:0/3718343480 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc600a1fe0 con 0x7fbc60134170 2023-10-01T07:55:53.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.631+0000 7fbc64910700 1 --2- 172.21.15.26:0/3718343480 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc60134170 0x7fbc6013bd30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbc58009e50 tx=0x7fbc5800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c74b5e732d3d353 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:53.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.631+0000 7fbc5effd700 1 -- 172.21.15.26:0/3718343480 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5800e070 con 0x7fbc60134170 2023-10-01T07:55:53.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.632+0000 7fbc5effd700 1 -- 172.21.15.26:0/3718343480 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5800b910 con 0x7fbc60134170 2023-10-01T07:55:53.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.632+0000 7fbc5effd700 1 -- 172.21.15.26:0/3718343480 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5800bcc0 con 0x7fbc60134170 2023-10-01T07:55:53.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.632+0000 7fbc66373700 1 -- 172.21.15.26:0/3718343480 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc60134170 msgr2=0x7fbc6013bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:53.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.632+0000 7fbc66373700 1 --2- 172.21.15.26:0/3718343480 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc60134170 0x7fbc6013bd30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbc58009e50 tx=0x7fbc5800b330 comp rx=0 tx=0).stop 2023-10-01T07:55:53.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.632+0000 7fbc66373700 1 -- 172.21.15.26:0/3718343480 shutdown_connections 2023-10-01T07:55:53.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.632+0000 7fbc66373700 1 --2- 172.21.15.26:0/3718343480 >> v2:172.21.15.26:3300/0 conn(0x7fbc600a0a30 0x7fbc600a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:53.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.632+0000 7fbc66373700 1 --2- 172.21.15.26:0/3718343480 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc60134170 0x7fbc6013bd30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:53.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.632+0000 7fbc66373700 1 -- 172.21.15.26:0/3718343480 >> 172.21.15.26:0/3718343480 conn(0x7fbc600a6550 msgr2=0x7fbc600a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:53.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.632+0000 7fbc66373700 1 -- 172.21.15.26:0/3718343480 shutdown_connections 2023-10-01T07:55:53.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.632+0000 7fbc66373700 1 -- 172.21.15.26:0/3718343480 wait complete. 2023-10-01T07:55:53.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.633+0000 7fbc66373700 1 Processor -- start 2023-10-01T07:55:53.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.634+0000 7fbc66373700 1 -- start start 2023-10-01T07:55:53.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.634+0000 7fbc66373700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc600a0a30 0x7fbc6011e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:53.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.634+0000 7fbc66373700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc600a1340 0x7fbc6011ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:53.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.634+0000 7fbc66373700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc60134170 0x7fbc6011f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:53.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.634+0000 7fbc66373700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc601221e0 con 0x7fbc60134170 2023-10-01T07:55:53.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.634+0000 7fbc66373700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc601202d0 con 0x7fbc600a1340 2023-10-01T07:55:53.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.634+0000 7fbc66373700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc600a4fb0 con 0x7fbc600a0a30 2023-10-01T07:55:53.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.634+0000 7fbc5ffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc600a0a30 0x7fbc6011e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:53.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.634+0000 7fbc5f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc600a1340 0x7fbc6011ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:53.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.634+0000 7fbc5ffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc600a0a30 0x7fbc6011e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:58180/0 (socket says 172.21.15.26:58180) 2023-10-01T07:55:53.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.634+0000 7fbc5ffff700 1 -- 172.21.15.26:0/1846365282 learned_addr learned my addr 172.21.15.26:0/1846365282 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:53.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.634+0000 7fbc5f7fe700 1 --2- 172.21.15.26:0/1846365282 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc600a1340 0x7fbc6011ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55174/0 (socket says 172.21.15.26:55174) 2023-10-01T07:55:53.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.634+0000 7fbc64910700 1 --2- 172.21.15.26:0/1846365282 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc60134170 0x7fbc6011f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:53.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.635+0000 7fbc5ffff700 1 -- 172.21.15.26:0/1846365282 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc600a1340 msgr2=0x7fbc6011ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:53.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.635+0000 7fbc5ffff700 1 --2- 172.21.15.26:0/1846365282 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc600a1340 0x7fbc6011ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:53.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.635+0000 7fbc5ffff700 1 -- 172.21.15.26:0/1846365282 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc60134170 msgr2=0x7fbc6011f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:53.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.635+0000 7fbc5ffff700 1 --2- 172.21.15.26:0/1846365282 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc60134170 0x7fbc6011f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:53.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.635+0000 7fbc5ffff700 1 -- 172.21.15.26:0/1846365282 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc58009b30 con 0x7fbc600a0a30 2023-10-01T07:55:53.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.635+0000 7fbc5ffff700 1 --2- 172.21.15.26:0/1846365282 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc600a0a30 0x7fbc6011e7a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbc5000e9e0 tx=0x7fbc5000ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:53.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.636+0000 7fbc5cff9700 1 -- 172.21.15.26:0/1846365282 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc50009710 con 0x7fbc600a0a30 2023-10-01T07:55:53.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.636+0000 7fbc5cff9700 1 -- 172.21.15.26:0/1846365282 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5000ee80 con 0x7fbc600a0a30 2023-10-01T07:55:53.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.636+0000 7fbc66373700 1 -- 172.21.15.26:0/1846365282 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc600a25e0 con 0x7fbc600a0a30 2023-10-01T07:55:53.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.636+0000 7fbc66373700 1 -- 172.21.15.26:0/1846365282 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc60121c40 con 0x7fbc600a0a30 2023-10-01T07:55:53.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.636+0000 7fbc5cff9700 1 -- 172.21.15.26:0/1846365282 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5000ca50 con 0x7fbc600a0a30 2023-10-01T07:55:53.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.637+0000 7fbc5cff9700 1 -- 172.21.15.26:0/1846365282 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbc5000cbb0 con 0x7fbc600a0a30 2023-10-01T07:55:53.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.637+0000 7fbc5cff9700 1 -- 172.21.15.26:0/1846365282 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbc5003fb00 con 0x7fbc600a0a30 2023-10-01T07:55:53.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.637+0000 7fbc66373700 1 -- 172.21.15.26:0/1846365282 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc60074ea0 con 0x7fbc600a0a30 2023-10-01T07:55:53.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.642+0000 7fbc5cff9700 1 -- 172.21.15.26:0/1846365282 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbc5001b3b0 con 0x7fbc600a0a30 2023-10-01T07:55:53.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.786+0000 7face4a52700 1 -- 172.21.15.26:0/1317948110 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7face00a1690 con 0x7face0131810 2023-10-01T07:55:53.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.787+0000 7facceffd700 1 -- 172.21.15.26:0/1317948110 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7facd8011380 con 0x7face0131810 2023-10-01T07:55:53.788 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:53.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.789+0000 7face4a52700 1 -- 172.21.15.26:0/1317948110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face0131810 msgr2=0x7face0070090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:53.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.789+0000 7face4a52700 1 --2- 172.21.15.26:0/1317948110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face0131810 0x7face0070090 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7facd800cb90 tx=0x7facd800cea0 comp rx=0 tx=0).stop 2023-10-01T07:55:53.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.789+0000 7face4a52700 1 -- 172.21.15.26:0/1317948110 shutdown_connections 2023-10-01T07:55:53.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.789+0000 7face4a52700 1 --2- 172.21.15.26:0/1317948110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face0131810 0x7face0070090 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:53.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.789+0000 7face4a52700 1 --2- 172.21.15.26:0/1317948110 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7face0099a40 0x7face006f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:53.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.789+0000 7face4a52700 1 --2- 172.21.15.26:0/1317948110 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7face009a3b0 0x7face006fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:53.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.789+0000 7face4a52700 1 -- 172.21.15.26:0/1317948110 >> 172.21.15.26:0/1317948110 conn(0x7face00a2aa0 msgr2=0x7face012e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:53.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.790+0000 7face4a52700 1 -- 172.21.15.26:0/1317948110 shutdown_connections 2023-10-01T07:55:53.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.790+0000 7face4a52700 1 -- 172.21.15.26:0/1317948110 wait complete. 2023-10-01T07:55:53.804 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:53.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.807+0000 7f13413e5700 1 -- 172.21.15.26:0/592049378 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f133c1a9470 con 0x7f133c09d6f0 2023-10-01T07:55:53.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.807+0000 7f13237fe700 1 -- 172.21.15.26:0/592049378 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f132c015070 con 0x7f133c09d6f0 2023-10-01T07:55:53.807 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:53.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.809+0000 7f13413e5700 1 -- 172.21.15.26:0/592049378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f133c09d6f0 msgr2=0x7f133c1a5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:53.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.809+0000 7f13413e5700 1 --2- 172.21.15.26:0/592049378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f133c09d6f0 0x7f133c1a5db0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f132c009870 tx=0x7f132c004750 comp rx=0 tx=0).stop 2023-10-01T07:55:53.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.809+0000 7f13413e5700 1 -- 172.21.15.26:0/592049378 shutdown_connections 2023-10-01T07:55:53.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.809+0000 7f13413e5700 1 --2- 172.21.15.26:0/592049378 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f133c09e410 0x7f133c1a6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:53.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.809+0000 7f13413e5700 1 --2- 172.21.15.26:0/592049378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f133c09d6f0 0x7f133c1a5db0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:53.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.809+0000 7f13413e5700 1 --2- 172.21.15.26:0/592049378 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f133c09e000 0x7f133c1a62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:53.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.809+0000 7f13413e5700 1 -- 172.21.15.26:0/592049378 >> 172.21.15.26:0/592049378 conn(0x7f133c066f50 msgr2=0x7f133c1badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:53.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.809+0000 7f13413e5700 1 -- 172.21.15.26:0/592049378 shutdown_connections 2023-10-01T07:55:53.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.809+0000 7f13413e5700 1 -- 172.21.15.26:0/592049378 wait complete. 2023-10-01T07:55:53.824 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:53.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.824+0000 7ffb07a9b700 1 -- 172.21.15.26:0/438231545 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffb001348b0 con 0x7ffb0009e1d0 2023-10-01T07:55:53.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.824+0000 7ffaf67fc700 1 -- 172.21.15.26:0/438231545 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffaf002b030 con 0x7ffb0009e1d0 2023-10-01T07:55:53.825 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:53.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.826+0000 7ffb07a9b700 1 -- 172.21.15.26:0/438231545 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb0009e1d0 msgr2=0x7ffb001c6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:53.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.826+0000 7ffb07a9b700 1 --2- 172.21.15.26:0/438231545 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb0009e1d0 0x7ffb001c6eb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0000c00 tx=0x7ffaf0004750 comp rx=0 tx=0).stop 2023-10-01T07:55:53.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.826+0000 7ffb07a9b700 1 -- 172.21.15.26:0/438231545 shutdown_connections 2023-10-01T07:55:53.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.826+0000 7ffb07a9b700 1 --2- 172.21.15.26:0/438231545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb00135e50 0x7ffb00131af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:53.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.826+0000 7ffb07a9b700 1 --2- 172.21.15.26:0/438231545 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffb0009d6f0 0x7ffb001c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:53.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.826+0000 7ffb07a9b700 1 --2- 172.21.15.26:0/438231545 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb0009e1d0 0x7ffb001c6eb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:53.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.826+0000 7ffb07a9b700 1 -- 172.21.15.26:0/438231545 >> 172.21.15.26:0/438231545 conn(0x7ffb00066f50 msgr2=0x7ffb0012f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:53.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.826+0000 7ffb07a9b700 1 -- 172.21.15.26:0/438231545 shutdown_connections 2023-10-01T07:55:53.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.826+0000 7ffb07a9b700 1 -- 172.21.15.26:0/438231545 wait complete. 2023-10-01T07:55:53.840 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:53.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.852+0000 7fbc66373700 1 -- 172.21.15.26:0/1846365282 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbc600a28e0 con 0x7fbc600a0a30 2023-10-01T07:55:53.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.852+0000 7fbc5cff9700 1 -- 172.21.15.26:0/1846365282 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbc5001ab10 con 0x7fbc600a0a30 2023-10-01T07:55:53.853 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:53.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.855+0000 7fbc66373700 1 -- 172.21.15.26:0/1846365282 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc600a0a30 msgr2=0x7fbc6011e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:53.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.855+0000 7fbc66373700 1 --2- 172.21.15.26:0/1846365282 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc600a0a30 0x7fbc6011e7a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbc5000e9e0 tx=0x7fbc5000ecf0 comp rx=0 tx=0).stop 2023-10-01T07:55:53.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.855+0000 7fbc66373700 1 -- 172.21.15.26:0/1846365282 shutdown_connections 2023-10-01T07:55:53.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.855+0000 7fbc66373700 1 --2- 172.21.15.26:0/1846365282 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc60134170 0x7fbc6011f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:53.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.855+0000 7fbc66373700 1 --2- 172.21.15.26:0/1846365282 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc600a0a30 0x7fbc6011e7a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:53.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.855+0000 7fbc66373700 1 --2- 172.21.15.26:0/1846365282 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc600a1340 0x7fbc6011ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:53.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.855+0000 7fbc66373700 1 -- 172.21.15.26:0/1846365282 >> 172.21.15.26:0/1846365282 conn(0x7fbc600a6550 msgr2=0x7fbc6009ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:53.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.855+0000 7fbc66373700 1 -- 172.21.15.26:0/1846365282 shutdown_connections 2023-10-01T07:55:53.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:53.855+0000 7fbc66373700 1 -- 172.21.15.26:0/1846365282 wait complete. 2023-10-01T07:55:53.869 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:54.805 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:54.825 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:54.842 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:54.870 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:54.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.965+0000 7ffb7913a700 1 Processor -- start 2023-10-01T07:55:54.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.965+0000 7ffb7913a700 1 -- start start 2023-10-01T07:55:54.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.966+0000 7ffb7913a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb7409eca0 0x7ffb7413cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:54.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.966+0000 7ffb7913a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffb7406f050 0x7ffb7413f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:54.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.966+0000 7ffb7913a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb74070ee0 con 0x7ffb7406e570 2023-10-01T07:55:54.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.966+0000 7ffb7913a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb74071980 con 0x7ffb7406f050 2023-10-01T07:55:54.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.966+0000 7ffb7913a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb74071480 con 0x7ffb7409eca0 2023-10-01T07:55:54.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.966+0000 7ffb7259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb7409eca0 0x7ffb7413cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:54.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.966+0000 7ffb7259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb7409eca0 0x7ffb7413cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55178/0 (socket says 172.21.15.26:55178) 2023-10-01T07:55:54.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.966+0000 7ffb7259c700 1 -- 172.21.15.26:0/1200158515 learned_addr learned my addr 172.21.15.26:0/1200158515 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:54.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.966+0000 7ffb7359e700 1 --2- 172.21.15.26:0/1200158515 >> v2:172.21.15.26:3300/0 conn(0x7ffb7406f050 0x7ffb7413f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:54.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.967+0000 7ffb7359e700 1 -- 172.21.15.26:0/1200158515 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb7409eca0 msgr2=0x7ffb7413cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:54.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.967+0000 7ffb7359e700 1 --2- 172.21.15.26:0/1200158515 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb7409eca0 0x7ffb7413cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:54.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.967+0000 7ffb7359e700 1 -- 172.21.15.26:0/1200158515 >> v1:172.21.15.26:6789/0 conn(0x7ffb7406e570 legacy=0x7ffb7406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:54.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.967+0000 7ffb7359e700 1 -- 172.21.15.26:0/1200158515 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb74071b90 con 0x7ffb7406f050 2023-10-01T07:55:54.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.967+0000 7ffb7359e700 1 --2- 172.21.15.26:0/1200158515 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb7406f050 0x7ffb7413f3f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009d90 tx=0x7ffb6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eee45229e41a8f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:54.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.967+0000 7ffb71d9b700 1 -- 172.21.15.26:0/1200158515 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c00e070 con 0x7ffb7406f050 2023-10-01T07:55:54.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.967+0000 7ffb71d9b700 1 -- 172.21.15.26:0/1200158515 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6c00bb20 con 0x7ffb7406f050 2023-10-01T07:55:54.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.967+0000 7ffb71d9b700 1 -- 172.21.15.26:0/1200158515 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c012430 con 0x7ffb7406f050 2023-10-01T07:55:54.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.968+0000 7ffb7913a700 1 -- 172.21.15.26:0/1200158515 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb7406f050 msgr2=0x7ffb7413f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:54.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.968+0000 7ffb7913a700 1 --2- 172.21.15.26:0/1200158515 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb7406f050 0x7ffb7413f3f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009d90 tx=0x7ffb6c00b330 comp rx=0 tx=0).stop 2023-10-01T07:55:54.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.968+0000 7ffb7913a700 1 -- 172.21.15.26:0/1200158515 shutdown_connections 2023-10-01T07:55:54.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.968+0000 7ffb7913a700 1 --2- 172.21.15.26:0/1200158515 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb7406f050 0x7ffb7413f3f0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:54.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.968+0000 7ffb7913a700 1 --2- 172.21.15.26:0/1200158515 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb7409eca0 0x7ffb7413cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:54.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.968+0000 7ffb7913a700 1 -- 172.21.15.26:0/1200158515 >> 172.21.15.26:0/1200158515 conn(0x7ffb740a2aa0 msgr2=0x7ffb740a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:54.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.968+0000 7ffb7913a700 1 -- 172.21.15.26:0/1200158515 shutdown_connections 2023-10-01T07:55:54.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.968+0000 7ffb7913a700 1 -- 172.21.15.26:0/1200158515 wait complete. 2023-10-01T07:55:54.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.970+0000 7ffb7913a700 1 Processor -- start 2023-10-01T07:55:54.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.970+0000 7ffb7913a700 1 -- start start 2023-10-01T07:55:54.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.970+0000 7ffb7913a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb7406e570 0x7ffb74123370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:54.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.970+0000 7ffb7913a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb7406f050 0x7ffb741238b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:54.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.970+0000 7ffb7913a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffb74123df0 0x7ffb74139c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:54.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.970+0000 7ffb7913a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb74126b60 con 0x7ffb7406f050 2023-10-01T07:55:54.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.970+0000 7ffb7913a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb74125e40 con 0x7ffb7406e570 2023-10-01T07:55:54.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.970+0000 7ffb7913a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7409a370 con 0x7ffb74123df0 2023-10-01T07:55:54.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.970+0000 7ffb7259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb7406f050 0x7ffb741238b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:54.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.970+0000 7ffb72d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb7406e570 0x7ffb74123370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:54.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.971+0000 7ffb7259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb7406f050 0x7ffb741238b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54198/0 (socket says 172.21.15.26:54198) 2023-10-01T07:55:54.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.971+0000 7ffb7259c700 1 -- 172.21.15.26:0/4033093886 learned_addr learned my addr 172.21.15.26:0/4033093886 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:54.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.971+0000 7ffb7359e700 1 --2- 172.21.15.26:0/4033093886 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffb74123df0 0x7ffb74139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:54.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.971+0000 7ffb7259c700 1 -- 172.21.15.26:0/4033093886 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffb74123df0 msgr2=0x7ffb74139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:54.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.971+0000 7ffb7259c700 1 --2- 172.21.15.26:0/4033093886 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffb74123df0 0x7ffb74139c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:54.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.971+0000 7ffb7259c700 1 -- 172.21.15.26:0/4033093886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb7406e570 msgr2=0x7ffb74123370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:54.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.971+0000 7ffb7259c700 1 --2- 172.21.15.26:0/4033093886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb7406e570 0x7ffb74123370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:54.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.971+0000 7ffb7259c700 1 -- 172.21.15.26:0/4033093886 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb6c009a70 con 0x7ffb7406f050 2023-10-01T07:55:54.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.971+0000 7ffb72d9d700 1 --2- 172.21.15.26:0/4033093886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb7406e570 0x7ffb74123370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:54.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.971+0000 7ffb7259c700 1 --2- 172.21.15.26:0/4033093886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb7406f050 0x7ffb741238b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ffb6800e8e0 tx=0x7ffb6800ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:54.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.971+0000 7ffb5b7fe700 1 -- 172.21.15.26:0/4033093886 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb68013680 con 0x7ffb7406f050 2023-10-01T07:55:54.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.971+0000 7ffb5b7fe700 1 -- 172.21.15.26:0/4033093886 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb680137e0 con 0x7ffb7406f050 2023-10-01T07:55:54.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.971+0000 7ffb7913a700 1 -- 172.21.15.26:0/4033093886 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb74070610 con 0x7ffb7406f050 2023-10-01T07:55:54.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.971+0000 7ffb5b7fe700 1 -- 172.21.15.26:0/4033093886 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb68013b50 con 0x7ffb7406f050 2023-10-01T07:55:54.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.972+0000 7ffb7913a700 1 -- 172.21.15.26:0/4033093886 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb741275d0 con 0x7ffb7406f050 2023-10-01T07:55:54.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.973+0000 7ffb7913a700 1 -- 172.21.15.26:0/4033093886 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb74074ea0 con 0x7ffb7406f050 2023-10-01T07:55:54.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.973+0000 7ffb5b7fe700 1 -- 172.21.15.26:0/4033093886 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffb68013cb0 con 0x7ffb7406f050 2023-10-01T07:55:54.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.974+0000 7ffb5b7fe700 1 -- 172.21.15.26:0/4033093886 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ffb6803fe10 con 0x7ffb7406f050 2023-10-01T07:55:54.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:54.982+0000 7ffb5b7fe700 1 -- 172.21.15.26:0/4033093886 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb68011350 con 0x7ffb7406f050 2023-10-01T07:55:55.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.000+0000 7f25dcd2b700 1 Processor -- start 2023-10-01T07:55:55.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.001+0000 7f25dcd2b700 1 -- start start 2023-10-01T07:55:55.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.001+0000 7f25dcd2b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25d806c0e0 0x7f25d809ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:55.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.001+0000 7f25dcd2b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f25d8134ec0 0x7f25d81379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:55.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.001+0000 7f25dcd2b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25d8137f20 0x7f25d81383c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:55.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.001+0000 7f25dcd2b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d806c4b0 con 0x7f25d8134ec0 2023-10-01T07:55:55.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.001+0000 7f25dcd2b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d80a09c0 con 0x7f25d8137f20 2023-10-01T07:55:55.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.001+0000 7f25dcd2b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25d8134980 con 0x7f25d806c0e0 2023-10-01T07:55:55.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.001+0000 7f25d659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25d806c0e0 0x7f25d809ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:55.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.002+0000 7f25d659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25d806c0e0 0x7f25d809ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:58194/0 (socket says 172.21.15.26:58194) 2023-10-01T07:55:55.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.002+0000 7f25d659c700 1 -- 172.21.15.26:0/671501795 learned_addr learned my addr 172.21.15.26:0/671501795 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:55.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.002+0000 7f25d6d9d700 1 --2- 172.21.15.26:0/671501795 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25d8137f20 0x7f25d81383c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:55.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.002+0000 7f25d5d9b700 1 --2- 172.21.15.26:0/671501795 >> v2:172.21.15.26:3300/0 conn(0x7f25d8134ec0 0x7f25d81379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:55.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.002+0000 7f25d659c700 1 -- 172.21.15.26:0/671501795 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25d8137f20 msgr2=0x7f25d81383c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:55.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.002+0000 7f25d659c700 1 --2- 172.21.15.26:0/671501795 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25d8137f20 0x7f25d81383c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:55.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.002+0000 7f25d659c700 1 -- 172.21.15.26:0/671501795 >> v2:172.21.15.26:3300/0 conn(0x7f25d8134ec0 msgr2=0x7f25d81379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:55.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.002+0000 7f25d659c700 1 --2- 172.21.15.26:0/671501795 >> v2:172.21.15.26:3300/0 conn(0x7f25d8134ec0 0x7f25d81379e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:55.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.002+0000 7f25d659c700 1 -- 172.21.15.26:0/671501795 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d80a0600 con 0x7f25d806c0e0 2023-10-01T07:55:55.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.002+0000 7f25d5d9b700 1 --2- 172.21.15.26:0/671501795 >> v2:172.21.15.26:3300/0 conn(0x7f25d8134ec0 0x7f25d81379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:55:55.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.002+0000 7f25d659c700 1 --2- 172.21.15.26:0/671501795 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25d806c0e0 0x7f25d809ac90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f25c80098f0 tx=0x7f25c8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3daecdda47e1622 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:55.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.003+0000 7f25d559a700 1 -- 172.21.15.26:0/671501795 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c8011830 con 0x7f25d806c0e0 2023-10-01T07:55:55.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.003+0000 7f25d559a700 1 -- 172.21.15.26:0/671501795 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c8011990 con 0x7f25d806c0e0 2023-10-01T07:55:55.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.003+0000 7f25d559a700 1 -- 172.21.15.26:0/671501795 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c8011d20 con 0x7f25d806c0e0 2023-10-01T07:55:55.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.003+0000 7f25dcd2b700 1 -- 172.21.15.26:0/671501795 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25d806c0e0 msgr2=0x7f25d809ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:55.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.003+0000 7f25dcd2b700 1 --2- 172.21.15.26:0/671501795 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25d806c0e0 0x7f25d809ac90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f25c80098f0 tx=0x7f25c8009c00 comp rx=0 tx=0).stop 2023-10-01T07:55:55.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.004+0000 7fa00ba95700 1 Processor -- start 2023-10-01T07:55:55.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.004+0000 7f25dcd2b700 1 -- 172.21.15.26:0/671501795 shutdown_connections 2023-10-01T07:55:55.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.004+0000 7f25dcd2b700 1 --2- 172.21.15.26:0/671501795 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25d8137f20 0x7f25d81383c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:55.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.004+0000 7f25dcd2b700 1 --2- 172.21.15.26:0/671501795 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25d806c0e0 0x7f25d809ac90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:55.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.004+0000 7f25dcd2b700 1 --2- 172.21.15.26:0/671501795 >> v2:172.21.15.26:3300/0 conn(0x7f25d8134ec0 0x7f25d81379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:55.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.004+0000 7f25dcd2b700 1 -- 172.21.15.26:0/671501795 >> 172.21.15.26:0/671501795 conn(0x7f25d80a4210 msgr2=0x7f25d80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:55.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.004+0000 7f25dcd2b700 1 -- 172.21.15.26:0/671501795 shutdown_connections 2023-10-01T07:55:55.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.004+0000 7f25dcd2b700 1 -- 172.21.15.26:0/671501795 wait complete. 2023-10-01T07:55:55.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.004+0000 7fa00ba95700 1 -- start start 2023-10-01T07:55:55.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.004+0000 7fa00ba95700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa00409d6f0 0x7fa00409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:55.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.004+0000 7fa00ba95700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa00409e410 0x7fa004130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:55.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.004+0000 7fa00ba95700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa00409f130 con 0x7fa00409e000 2023-10-01T07:55:55.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.004+0000 7fa00ba95700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa00409f520 con 0x7fa00409e410 2023-10-01T07:55:55.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.004+0000 7fa00ba95700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa00409e930 con 0x7fa00409d6f0 2023-10-01T07:55:55.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.005+0000 7fa009831700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa00409d6f0 0x7fa00409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:55.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.005+0000 7fa009831700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa00409d6f0 0x7fa00409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:58196/0 (socket says 172.21.15.26:58196) 2023-10-01T07:55:55.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.005+0000 7fa009831700 1 -- 172.21.15.26:0/112153625 learned_addr learned my addr 172.21.15.26:0/112153625 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:55.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.005+0000 7fa00a032700 1 --2- 172.21.15.26:0/112153625 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa00409e410 0x7fa004130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:55.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.005+0000 7fa00a032700 1 -- 172.21.15.26:0/112153625 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa00409d6f0 msgr2=0x7fa00409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:55.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.005+0000 7fa00a032700 1 --2- 172.21.15.26:0/112153625 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa00409d6f0 0x7fa00409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:55.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.005+0000 7fa00a032700 1 -- 172.21.15.26:0/112153625 >> v1:172.21.15.26:6789/0 conn(0x7fa00409e000 legacy=0x7fa004130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:55.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.005+0000 7fa00a032700 1 -- 172.21.15.26:0/112153625 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa00409b2d0 con 0x7fa00409e410 2023-10-01T07:55:55.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.005+0000 7fa00a032700 1 --2- 172.21.15.26:0/112153625 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa00409e410 0x7fa004130d70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc009dc0 tx=0x7f9ffc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8a73de255064a1b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:55.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.005+0000 7f25dcd2b700 1 Processor -- start 2023-10-01T07:55:55.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.005+0000 7fa00882f700 1 -- 172.21.15.26:0/112153625 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc00e070 con 0x7fa00409e410 2023-10-01T07:55:55.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.006+0000 7fa00882f700 1 -- 172.21.15.26:0/112153625 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ffc00bae0 con 0x7fa00409e410 2023-10-01T07:55:55.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.006+0000 7fa00882f700 1 -- 172.21.15.26:0/112153625 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc00be90 con 0x7fa00409e410 2023-10-01T07:55:55.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.006+0000 7f25dcd2b700 1 -- start start 2023-10-01T07:55:55.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.006+0000 7fa00ba95700 1 -- 172.21.15.26:0/112153625 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa00409e410 msgr2=0x7fa004130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:55.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.006+0000 7fa00ba95700 1 --2- 172.21.15.26:0/112153625 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa00409e410 0x7fa004130d70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc009dc0 tx=0x7f9ffc00b330 comp rx=0 tx=0).stop 2023-10-01T07:55:55.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.006+0000 7f25dcd2b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25d806c0e0 0x7f25d8134020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:55.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.006+0000 7f25dcd2b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25d8134ec0 0x7f25d811a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:55.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.006+0000 7fa00ba95700 1 -- 172.21.15.26:0/112153625 shutdown_connections 2023-10-01T07:55:55.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.006+0000 7fa00ba95700 1 --2- 172.21.15.26:0/112153625 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa00409d6f0 0x7fa00409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:55.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.006+0000 7fa00ba95700 1 --2- 172.21.15.26:0/112153625 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa00409e410 0x7fa004130d70 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:55.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.006+0000 7fa00ba95700 1 -- 172.21.15.26:0/112153625 >> 172.21.15.26:0/112153625 conn(0x7fa004066f50 msgr2=0x7fa00409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:55.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.006+0000 7f25dcd2b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25d8137f20 0x7f25d811ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:55.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.006+0000 7f25dcd2b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d811e250 con 0x7f25d8134ec0 2023-10-01T07:55:55.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.006+0000 7f25dcd2b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d80a1f30 con 0x7f25d8137f20 2023-10-01T07:55:55.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.006+0000 7f25dcd2b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25d811c360 con 0x7f25d806c0e0 2023-10-01T07:55:55.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.007+0000 7fa00ba95700 1 -- 172.21.15.26:0/112153625 shutdown_connections 2023-10-01T07:55:55.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.007+0000 7fa00ba95700 1 -- 172.21.15.26:0/112153625 wait complete. 2023-10-01T07:55:55.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.007+0000 7f25d659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25d806c0e0 0x7f25d8134020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:55.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.007+0000 7f25d659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25d806c0e0 0x7f25d8134020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:58212/0 (socket says 172.21.15.26:58212) 2023-10-01T07:55:55.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.007+0000 7f25d659c700 1 -- 172.21.15.26:0/2961429723 learned_addr learned my addr 172.21.15.26:0/2961429723 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:55.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.007+0000 7f25d5d9b700 1 --2- 172.21.15.26:0/2961429723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25d8134ec0 0x7f25d811a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:55.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.007+0000 7f25d5d9b700 1 -- 172.21.15.26:0/2961429723 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25d806c0e0 msgr2=0x7f25d8134020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:55.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.007+0000 7f25d5d9b700 1 --2- 172.21.15.26:0/2961429723 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25d806c0e0 0x7f25d8134020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:55.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.007+0000 7f25d5d9b700 1 -- 172.21.15.26:0/2961429723 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25d8137f20 msgr2=0x7f25d811ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:55.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.007+0000 7f25d5d9b700 1 --2- 172.21.15.26:0/2961429723 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25d8137f20 0x7f25d811ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:55.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.007+0000 7f25d5d9b700 1 -- 172.21.15.26:0/2961429723 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c8009550 con 0x7f25d8134ec0 2023-10-01T07:55:55.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.007+0000 7f25d5d9b700 1 --2- 172.21.15.26:0/2961429723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25d8134ec0 0x7f25d811a8e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f25cc00e7e0 tx=0x7f25cc00eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:55.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.008+0000 7f25c6ffd700 1 -- 172.21.15.26:0/2961429723 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc00c070 con 0x7f25d8134ec0 2023-10-01T07:55:55.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.008+0000 7f25dcd2b700 1 -- 172.21.15.26:0/2961429723 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d80a03f0 con 0x7f25d8134ec0 2023-10-01T07:55:55.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.008+0000 7f25dcd2b700 1 -- 172.21.15.26:0/2961429723 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d8134560 con 0x7f25d8134ec0 2023-10-01T07:55:55.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.008+0000 7fa00ba95700 1 Processor -- start 2023-10-01T07:55:55.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.008+0000 7fa00ba95700 1 -- start start 2023-10-01T07:55:55.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.008+0000 7fa00ba95700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa00409d6f0 0x7fa00411f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:55.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.008+0000 7fa00ba95700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa00409e000 0x7fa00411f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:55.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.008+0000 7fa00ba95700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa00409e410 0x7fa00411faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:55.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.008+0000 7fa00ba95700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa004122af0 con 0x7fa00409e410 2023-10-01T07:55:55.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.008+0000 7fa00ba95700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa004121a70 con 0x7fa00409e000 2023-10-01T07:55:55.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.008+0000 7fa00ba95700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa004122280 con 0x7fa00409d6f0 2023-10-01T07:55:55.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.009+0000 7fa009030700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa00409e000 0x7fa00411f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:55.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.009+0000 7fa009030700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa00409e000 0x7fa00411f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55234/0 (socket says 172.21.15.26:55234) 2023-10-01T07:55:55.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.009+0000 7fa009030700 1 -- 172.21.15.26:0/2524236733 learned_addr learned my addr 172.21.15.26:0/2524236733 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:55.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.009+0000 7fa009831700 1 --2- 172.21.15.26:0/2524236733 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa00409d6f0 0x7fa00411f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:55.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.009+0000 7fa00a032700 1 --2- 172.21.15.26:0/2524236733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa00409e410 0x7fa00411faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:55.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.009+0000 7f25c6ffd700 1 -- 172.21.15.26:0/2961429723 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25cc013610 con 0x7f25d8134ec0 2023-10-01T07:55:55.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.009+0000 7f25c6ffd700 1 -- 172.21.15.26:0/2961429723 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc013980 con 0x7f25d8134ec0 2023-10-01T07:55:55.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.009+0000 7fa009030700 1 -- 172.21.15.26:0/2524236733 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa00409d6f0 msgr2=0x7fa00411f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:55.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.009+0000 7fa009030700 1 --2- 172.21.15.26:0/2524236733 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa00409d6f0 0x7fa00411f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:55.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.009+0000 7fa009030700 1 -- 172.21.15.26:0/2524236733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa00409e410 msgr2=0x7fa00411faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:55.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.009+0000 7fa009030700 1 --2- 172.21.15.26:0/2524236733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa00409e410 0x7fa00411faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:55.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.009+0000 7fa009030700 1 -- 172.21.15.26:0/2524236733 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ffc009a70 con 0x7fa00409e000 2023-10-01T07:55:55.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.010+0000 7fa009030700 1 --2- 172.21.15.26:0/2524236733 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa00409e000 0x7fa00411f560 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9ff800c4a0 tx=0x7f9ff800c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:55.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.010+0000 7f25c6ffd700 1 -- 172.21.15.26:0/2961429723 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f25cc013ae0 con 0x7f25d8134ec0 2023-10-01T07:55:55.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.010+0000 7f9ff67fc700 1 -- 172.21.15.26:0/2524236733 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff80054e0 con 0x7fa00409e000 2023-10-01T07:55:55.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.010+0000 7f9ff67fc700 1 -- 172.21.15.26:0/2524236733 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff8003680 con 0x7fa00409e000 2023-10-01T07:55:55.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.010+0000 7f9ff67fc700 1 -- 172.21.15.26:0/2524236733 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8003a10 con 0x7fa00409e000 2023-10-01T07:55:55.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.010+0000 7f25c6ffd700 1 -- 172.21.15.26:0/2961429723 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f25cc03f480 con 0x7f25d8134ec0 2023-10-01T07:55:55.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.010+0000 7fa00ba95700 1 -- 172.21.15.26:0/2524236733 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa00409c760 con 0x7fa00409e000 2023-10-01T07:55:55.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.010+0000 7fa00ba95700 1 -- 172.21.15.26:0/2524236733 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa004122550 con 0x7fa00409e000 2023-10-01T07:55:55.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.012+0000 7fa00ba95700 1 -- 172.21.15.26:0/2524236733 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fec0052e0 con 0x7fa00409e000 2023-10-01T07:55:55.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.012+0000 7f25dcd2b700 1 -- 172.21.15.26:0/2961429723 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25bc0052e0 con 0x7f25d8134ec0 2023-10-01T07:55:55.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.012+0000 7f9ff67fc700 1 -- 172.21.15.26:0/2524236733 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9ff8003b70 con 0x7fa00409e000 2023-10-01T07:55:55.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.012+0000 7f9ff67fc700 1 -- 172.21.15.26:0/2524236733 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9ff803e780 con 0x7fa00409e000 2023-10-01T07:55:55.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.017+0000 7f9ff67fc700 1 -- 172.21.15.26:0/2524236733 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9ff8018af0 con 0x7fa00409e000 2023-10-01T07:55:55.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.021+0000 7f25c6ffd700 1 -- 172.21.15.26:0/2961429723 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25cc017020 con 0x7f25d8134ec0 2023-10-01T07:55:55.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.051+0000 7f1e94ae0700 1 Processor -- start 2023-10-01T07:55:55.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.051+0000 7f1e94ae0700 1 -- start start 2023-10-01T07:55:55.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.051+0000 7f1e94ae0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e9006a770 0x7f1e9009d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:55.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.051+0000 7f1e94ae0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1e9013d1f0 0x7f1e9013f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:55.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.051+0000 7f1e94ae0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e9009a810 con 0x7f1e9009dc30 2023-10-01T07:55:55.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.051+0000 7f1e94ae0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e9006ab40 con 0x7f1e9013d1f0 2023-10-01T07:55:55.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.051+0000 7f1e94ae0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9009ebc0 con 0x7f1e9006a770 2023-10-01T07:55:55.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.052+0000 7f1e8dd9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1e9009dc30 0x7f1e9009e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48914/0 (socket says 172.21.15.26:48914) 2023-10-01T07:55:55.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.052+0000 7f1e8dd9b700 1 -- 172.21.15.26:0/1990340672 learned_addr learned my addr 172.21.15.26:0/1990340672 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:55.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.052+0000 7f1e8ed9d700 1 --2- 172.21.15.26:0/1990340672 >> v2:172.21.15.26:3300/0 conn(0x7f1e9013d1f0 0x7f1e9013f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:55.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.052+0000 7f1e8e59c700 1 --2- 172.21.15.26:0/1990340672 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e9006a770 0x7f1e9009d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:55.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.052+0000 7f1e8d59a700 1 -- 172.21.15.26:0/1990340672 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3271905112 0 0) 0x7f1e9009a810 con 0x7f1e9009dc30 2023-10-01T07:55:55.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.052+0000 7f1e8d59a700 1 -- 172.21.15.26:0/1990340672 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e780035b0 con 0x7f1e9009dc30 2023-10-01T07:55:55.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.052+0000 7f1e8ed9d700 1 -- 172.21.15.26:0/1990340672 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e9006a770 msgr2=0x7f1e9009d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:55.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.052+0000 7f1e8ed9d700 1 --2- 172.21.15.26:0/1990340672 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e9006a770 0x7f1e9009d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:55.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.052+0000 7f1e8ed9d700 1 -- 172.21.15.26:0/1990340672 >> v1:172.21.15.26:6789/0 conn(0x7f1e9009dc30 legacy=0x7f1e9009e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:55.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.052+0000 7f1e8ed9d700 1 -- 172.21.15.26:0/1990340672 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9009e920 con 0x7f1e9013d1f0 2023-10-01T07:55:55.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.053+0000 7f1e8ed9d700 1 --2- 172.21.15.26:0/1990340672 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e9013d1f0 0x7f1e9013f5d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1e88009dc0 tx=0x7f1e8800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da141b7653e103f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:55.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.053+0000 7f1e8d59a700 1 -- 172.21.15.26:0/1990340672 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8800e070 con 0x7f1e9013d1f0 2023-10-01T07:55:55.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.053+0000 7f1e8d59a700 1 -- 172.21.15.26:0/1990340672 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8800bae0 con 0x7f1e9013d1f0 2023-10-01T07:55:55.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.053+0000 7f1e8d59a700 1 -- 172.21.15.26:0/1990340672 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8800be90 con 0x7f1e9013d1f0 2023-10-01T07:55:55.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.053+0000 7f1e94ae0700 1 -- 172.21.15.26:0/1990340672 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e9013d1f0 msgr2=0x7f1e9013f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:55.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.053+0000 7f1e94ae0700 1 --2- 172.21.15.26:0/1990340672 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e9013d1f0 0x7f1e9013f5d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1e88009dc0 tx=0x7f1e8800b330 comp rx=0 tx=0).stop 2023-10-01T07:55:55.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.054+0000 7f1e94ae0700 1 -- 172.21.15.26:0/1990340672 shutdown_connections 2023-10-01T07:55:55.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.054+0000 7f1e94ae0700 1 --2- 172.21.15.26:0/1990340672 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e9013d1f0 0x7f1e9013f5d0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:55.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.054+0000 7f1e94ae0700 1 --2- 172.21.15.26:0/1990340672 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e9006a770 0x7f1e9009d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:55.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.054+0000 7f1e94ae0700 1 -- 172.21.15.26:0/1990340672 >> 172.21.15.26:0/1990340672 conn(0x7f1e90066f50 msgr2=0x7f1e9009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:55.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.054+0000 7f1e94ae0700 1 -- 172.21.15.26:0/1990340672 shutdown_connections 2023-10-01T07:55:55.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.054+0000 7f1e94ae0700 1 -- 172.21.15.26:0/1990340672 wait complete. 2023-10-01T07:55:55.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.055+0000 7f1e94ae0700 1 Processor -- start 2023-10-01T07:55:55.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.055+0000 7f1e94ae0700 1 -- start start 2023-10-01T07:55:55.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.055+0000 7f1e94ae0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e9006a770 0x7f1e9012ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:55.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.055+0000 7f1e94ae0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e9009dc30 0x7f1e9012d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:55.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.056+0000 7f1e94ae0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e9013d1f0 0x7f1e9012d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:55.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.056+0000 7f1e94ae0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9011c7f0 con 0x7f1e9009dc30 2023-10-01T07:55:55.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.056+0000 7f1e94ae0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9009f1a0 con 0x7f1e9013d1f0 2023-10-01T07:55:55.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.056+0000 7f1e94ae0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9012f6f0 con 0x7f1e9006a770 2023-10-01T07:55:55.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.056+0000 7f1e8ed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e9013d1f0 0x7f1e9012d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:55.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.056+0000 7f1e8dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e9009dc30 0x7f1e9012d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:55.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.056+0000 7f1e8ed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e9013d1f0 0x7f1e9012d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55262/0 (socket says 172.21.15.26:55262) 2023-10-01T07:55:55.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.056+0000 7f1e8ed9d700 1 -- 172.21.15.26:0/3028723151 learned_addr learned my addr 172.21.15.26:0/3028723151 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:55.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.056+0000 7f1e8e59c700 1 --2- 172.21.15.26:0/3028723151 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e9006a770 0x7f1e9012ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:55.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.056+0000 7f1e8ed9d700 1 -- 172.21.15.26:0/3028723151 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e9006a770 msgr2=0x7f1e9012ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:55.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.056+0000 7f1e8ed9d700 1 --2- 172.21.15.26:0/3028723151 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e9006a770 0x7f1e9012ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:55.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.056+0000 7f1e8ed9d700 1 -- 172.21.15.26:0/3028723151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e9009dc30 msgr2=0x7f1e9012d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:55.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.056+0000 7f1e8ed9d700 1 --2- 172.21.15.26:0/3028723151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e9009dc30 0x7f1e9012d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:55.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.056+0000 7f1e8ed9d700 1 -- 172.21.15.26:0/3028723151 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e88009a70 con 0x7f1e9013d1f0 2023-10-01T07:55:55.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.056+0000 7f1e8ed9d700 1 --2- 172.21.15.26:0/3028723151 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e9013d1f0 0x7f1e9012d8c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1e88014040 tx=0x7f1e88004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:55.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.057+0000 7f1e7effd700 1 -- 172.21.15.26:0/3028723151 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e88004680 con 0x7f1e9013d1f0 2023-10-01T07:55:55.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.057+0000 7f1e7effd700 1 -- 172.21.15.26:0/3028723151 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e88020070 con 0x7f1e9013d1f0 2023-10-01T07:55:55.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.057+0000 7f1e94ae0700 1 -- 172.21.15.26:0/3028723151 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e9012fc70 con 0x7f1e9013d1f0 2023-10-01T07:55:55.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.057+0000 7f1e94ae0700 1 -- 172.21.15.26:0/3028723151 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e9011bda0 con 0x7f1e9013d1f0 2023-10-01T07:55:55.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.057+0000 7f1e7effd700 1 -- 172.21.15.26:0/3028723151 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e88027480 con 0x7f1e9013d1f0 2023-10-01T07:55:55.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.058+0000 7f1e94ae0700 1 -- 172.21.15.26:0/3028723151 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e740052e0 con 0x7f1e9013d1f0 2023-10-01T07:55:55.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.059+0000 7f1e7effd700 1 -- 172.21.15.26:0/3028723151 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e880275e0 con 0x7f1e9013d1f0 2023-10-01T07:55:55.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.059+0000 7f1e7effd700 1 -- 172.21.15.26:0/3028723151 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1e88022070 con 0x7f1e9013d1f0 2023-10-01T07:55:55.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.068+0000 7f1e7effd700 1 -- 172.21.15.26:0/3028723151 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e88011750 con 0x7f1e9013d1f0 2023-10-01T07:55:55.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.201+0000 7ffb7913a700 1 -- 172.21.15.26:0/4033093886 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffb74099df0 con 0x7ffb7406f050 2023-10-01T07:55:55.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.201+0000 7ffb5b7fe700 1 -- 172.21.15.26:0/4033093886 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffb68024b40 con 0x7ffb7406f050 2023-10-01T07:55:55.202 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:55.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.204+0000 7ffb7913a700 1 -- 172.21.15.26:0/4033093886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb7406f050 msgr2=0x7ffb741238b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:55.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.204+0000 7ffb7913a700 1 --2- 172.21.15.26:0/4033093886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb7406f050 0x7ffb741238b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ffb6800e8e0 tx=0x7ffb6800ebf0 comp rx=0 tx=0).stop 2023-10-01T07:55:55.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.204+0000 7ffb7913a700 1 -- 172.21.15.26:0/4033093886 shutdown_connections 2023-10-01T07:55:55.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.204+0000 7ffb7913a700 1 --2- 172.21.15.26:0/4033093886 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffb74123df0 0x7ffb74139c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:55.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.204+0000 7ffb7913a700 1 --2- 172.21.15.26:0/4033093886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb7406e570 0x7ffb74123370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:55.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.204+0000 7ffb7913a700 1 --2- 172.21.15.26:0/4033093886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb7406f050 0x7ffb741238b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:55.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.204+0000 7ffb7913a700 1 -- 172.21.15.26:0/4033093886 >> 172.21.15.26:0/4033093886 conn(0x7ffb740a2aa0 msgr2=0x7ffb740a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:55.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.204+0000 7ffb7913a700 1 -- 172.21.15.26:0/4033093886 shutdown_connections 2023-10-01T07:55:55.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.204+0000 7ffb7913a700 1 -- 172.21.15.26:0/4033093886 wait complete. 2023-10-01T07:55:55.219 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:55.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.229+0000 7fa00ba95700 1 -- 172.21.15.26:0/2524236733 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9fec005590 con 0x7fa00409e000 2023-10-01T07:55:55.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.230+0000 7f9ff67fc700 1 -- 172.21.15.26:0/2524236733 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9ff8017020 con 0x7fa00409e000 2023-10-01T07:55:55.230 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:55.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.232+0000 7fa00ba95700 1 -- 172.21.15.26:0/2524236733 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa00409e000 msgr2=0x7fa00411f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:55.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.232+0000 7fa00ba95700 1 --2- 172.21.15.26:0/2524236733 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa00409e000 0x7fa00411f560 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9ff800c4a0 tx=0x7f9ff800c7b0 comp rx=0 tx=0).stop 2023-10-01T07:55:55.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.232+0000 7fa00ba95700 1 -- 172.21.15.26:0/2524236733 shutdown_connections 2023-10-01T07:55:55.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.232+0000 7fa00ba95700 1 --2- 172.21.15.26:0/2524236733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa00409e410 0x7fa00411faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:55.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.232+0000 7fa00ba95700 1 --2- 172.21.15.26:0/2524236733 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa00409d6f0 0x7fa00411f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:55.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.232+0000 7fa00ba95700 1 --2- 172.21.15.26:0/2524236733 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa00409e000 0x7fa00411f560 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:55.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.232+0000 7fa00ba95700 1 -- 172.21.15.26:0/2524236733 >> 172.21.15.26:0/2524236733 conn(0x7fa004066f50 msgr2=0x7fa0040a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:55.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.232+0000 7fa00ba95700 1 -- 172.21.15.26:0/2524236733 shutdown_connections 2023-10-01T07:55:55.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.232+0000 7fa00ba95700 1 -- 172.21.15.26:0/2524236733 wait complete. 2023-10-01T07:55:55.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.233+0000 7f25dcd2b700 1 -- 172.21.15.26:0/2961429723 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f25bc005590 con 0x7f25d8134ec0 2023-10-01T07:55:55.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.233+0000 7f25c6ffd700 1 -- 172.21.15.26:0/2961429723 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f25cc02b090 con 0x7f25d8134ec0 2023-10-01T07:55:55.235 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:55.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.235+0000 7f25dcd2b700 1 -- 172.21.15.26:0/2961429723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25d8134ec0 msgr2=0x7f25d811a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:55.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.235+0000 7f25dcd2b700 1 --2- 172.21.15.26:0/2961429723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25d8134ec0 0x7f25d811a8e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f25cc00e7e0 tx=0x7f25cc00eaf0 comp rx=0 tx=0).stop 2023-10-01T07:55:55.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.235+0000 7f25dcd2b700 1 -- 172.21.15.26:0/2961429723 shutdown_connections 2023-10-01T07:55:55.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.235+0000 7f25dcd2b700 1 --2- 172.21.15.26:0/2961429723 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25d8137f20 0x7f25d811ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:55.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.235+0000 7f25dcd2b700 1 --2- 172.21.15.26:0/2961429723 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25d806c0e0 0x7f25d8134020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:55.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.235+0000 7f25dcd2b700 1 --2- 172.21.15.26:0/2961429723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25d8134ec0 0x7f25d811a8e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:55.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.235+0000 7f25dcd2b700 1 -- 172.21.15.26:0/2961429723 >> 172.21.15.26:0/2961429723 conn(0x7f25d80a4210 msgr2=0x7f25d8099c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:55.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.236+0000 7f25dcd2b700 1 -- 172.21.15.26:0/2961429723 shutdown_connections 2023-10-01T07:55:55.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.236+0000 7f25dcd2b700 1 -- 172.21.15.26:0/2961429723 wait complete. 2023-10-01T07:55:55.248 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:55.251 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:55.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.281+0000 7f1e94ae0700 1 -- 172.21.15.26:0/3028723151 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1e74005590 con 0x7f1e9013d1f0 2023-10-01T07:55:55.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.281+0000 7f1e7effd700 1 -- 172.21.15.26:0/3028723151 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e880303f0 con 0x7f1e9013d1f0 2023-10-01T07:55:55.282 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:55.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.283+0000 7f1e94ae0700 1 -- 172.21.15.26:0/3028723151 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e9013d1f0 msgr2=0x7f1e9012d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:55.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.283+0000 7f1e94ae0700 1 --2- 172.21.15.26:0/3028723151 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e9013d1f0 0x7f1e9012d8c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1e88014040 tx=0x7f1e88004ad0 comp rx=0 tx=0).stop 2023-10-01T07:55:55.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.283+0000 7f1e94ae0700 1 -- 172.21.15.26:0/3028723151 shutdown_connections 2023-10-01T07:55:55.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.283+0000 7f1e94ae0700 1 --2- 172.21.15.26:0/3028723151 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e9013d1f0 0x7f1e9012d8c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:55.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.283+0000 7f1e94ae0700 1 --2- 172.21.15.26:0/3028723151 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e9006a770 0x7f1e9012ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:55.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.283+0000 7f1e94ae0700 1 --2- 172.21.15.26:0/3028723151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e9009dc30 0x7f1e9012d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:55.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.283+0000 7f1e94ae0700 1 -- 172.21.15.26:0/3028723151 >> 172.21.15.26:0/3028723151 conn(0x7f1e90066f50 msgr2=0x7f1e900a33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:55.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.284+0000 7f1e94ae0700 1 -- 172.21.15.26:0/3028723151 shutdown_connections 2023-10-01T07:55:55.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:55.284+0000 7f1e94ae0700 1 -- 172.21.15.26:0/3028723151 wait complete. 2023-10-01T07:55:55.297 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:56.219 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:56.249 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:56.252 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:56.298 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:56.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.386+0000 7fc8f5097700 1 Processor -- start 2023-10-01T07:55:56.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.386+0000 7fc8f5097700 1 -- start start 2023-10-01T07:55:56.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.387+0000 7fc8f5097700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc8f009d6f0 0x7fc8f009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:56.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.387+0000 7fc8f5097700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc8f009e000 0x7fc8f0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:56.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.387+0000 7fc8f5097700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8f009f130 con 0x7fc8f009e410 2023-10-01T07:55:56.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.387+0000 7fc8f5097700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f009f520 con 0x7fc8f009d6f0 2023-10-01T07:55:56.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.387+0000 7fc8f5097700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f009e930 con 0x7fc8f009e000 2023-10-01T07:55:56.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.387+0000 7fc8ee59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc8f009e000 0x7fc8f0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:56.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.387+0000 7fc8eed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc8f009d6f0 0x7fc8f009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:56.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.387+0000 7fc8ee59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc8f009e000 0x7fc8f0130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:58244/0 (socket says 172.21.15.26:58244) 2023-10-01T07:55:56.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.387+0000 7fc8ee59c700 1 -- 172.21.15.26:0/3507772972 learned_addr learned my addr 172.21.15.26:0/3507772972 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:56.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.387+0000 7fc8eed9d700 1 -- 172.21.15.26:0/3507772972 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc8f009e000 msgr2=0x7fc8f0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:56.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.387+0000 7fc8eed9d700 1 --2- 172.21.15.26:0/3507772972 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc8f009e000 0x7fc8f0130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:56.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.387+0000 7fc8eed9d700 1 -- 172.21.15.26:0/3507772972 >> v1:172.21.15.26:6789/0 conn(0x7fc8f009e410 legacy=0x7fc8f0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:56.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.387+0000 7fc8eed9d700 1 -- 172.21.15.26:0/3507772972 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f009b2d0 con 0x7fc8f009d6f0 2023-10-01T07:55:56.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.387+0000 7fc8ee59c700 1 --2- 172.21.15.26:0/3507772972 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc8f009e000 0x7fc8f0130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:56.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.388+0000 7fc8eed9d700 1 --2- 172.21.15.26:0/3507772972 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc8f009d6f0 0x7fc8f009dac0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0009870 tx=0x7fc8e0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2697dd0dde047949 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:56.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.388+0000 7fc8edd9b700 1 -- 172.21.15.26:0/3507772972 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0011830 con 0x7fc8f009d6f0 2023-10-01T07:55:56.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.388+0000 7fc8edd9b700 1 -- 172.21.15.26:0/3507772972 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e0011990 con 0x7fc8f009d6f0 2023-10-01T07:55:56.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.388+0000 7fc8edd9b700 1 -- 172.21.15.26:0/3507772972 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0011d20 con 0x7fc8f009d6f0 2023-10-01T07:55:56.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.389+0000 7fc8f5097700 1 -- 172.21.15.26:0/3507772972 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc8f009d6f0 msgr2=0x7fc8f009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:56.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.389+0000 7fc8f5097700 1 --2- 172.21.15.26:0/3507772972 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc8f009d6f0 0x7fc8f009dac0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0009870 tx=0x7fc8e0009b80 comp rx=0 tx=0).stop 2023-10-01T07:55:56.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.389+0000 7fc8f5097700 1 -- 172.21.15.26:0/3507772972 shutdown_connections 2023-10-01T07:55:56.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.389+0000 7fc8f5097700 1 --2- 172.21.15.26:0/3507772972 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc8f009d6f0 0x7fc8f009dac0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:56.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.389+0000 7fc8f5097700 1 --2- 172.21.15.26:0/3507772972 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc8f009e000 0x7fc8f0130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:56.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.389+0000 7fc8f5097700 1 -- 172.21.15.26:0/3507772972 >> 172.21.15.26:0/3507772972 conn(0x7fc8f0066f50 msgr2=0x7fc8f009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:56.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.389+0000 7fc8f5097700 1 -- 172.21.15.26:0/3507772972 shutdown_connections 2023-10-01T07:55:56.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.389+0000 7fc8f5097700 1 -- 172.21.15.26:0/3507772972 wait complete. 2023-10-01T07:55:56.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.391+0000 7fc8f5097700 1 Processor -- start 2023-10-01T07:55:56.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.391+0000 7fc8f5097700 1 -- start start 2023-10-01T07:55:56.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.392+0000 7fc8f5097700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc8f009d6f0 0x7fc8f0138a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:56.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.392+0000 7fc8f5097700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc8f009e000 0x7fc8f0138fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:56.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.392+0000 7fc8f5097700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f009e410 0x7fc8f0139970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:56.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.392+0000 7fc8f5097700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f012eb60 con 0x7fc8f009e410 2023-10-01T07:55:56.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.392+0000 7fc8f5097700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f012f7b0 con 0x7fc8f009d6f0 2023-10-01T07:55:56.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.392+0000 7fc8f5097700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f013ad40 con 0x7fc8f009e000 2023-10-01T07:55:56.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.392+0000 7fc8eed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc8f009d6f0 0x7fc8f0138a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:56.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.392+0000 7fc8eed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc8f009d6f0 0x7fc8f0138a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55282/0 (socket says 172.21.15.26:55282) 2023-10-01T07:55:56.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.392+0000 7fc8eed9d700 1 -- 172.21.15.26:0/394876338 learned_addr learned my addr 172.21.15.26:0/394876338 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:56.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.392+0000 7fc8ee59c700 1 --2- 172.21.15.26:0/394876338 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc8f009e000 0x7fc8f0138fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:56.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.392+0000 7fc8ef59e700 1 --2- 172.21.15.26:0/394876338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f009e410 0x7fc8f0139970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:56.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.392+0000 7fc8eed9d700 1 -- 172.21.15.26:0/394876338 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc8f009e000 msgr2=0x7fc8f0138fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:56.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.392+0000 7fc8eed9d700 1 --2- 172.21.15.26:0/394876338 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc8f009e000 0x7fc8f0138fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:56.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.392+0000 7fc8eed9d700 1 -- 172.21.15.26:0/394876338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f009e410 msgr2=0x7fc8f0139970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:56.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.392+0000 7fc8eed9d700 1 --2- 172.21.15.26:0/394876338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f009e410 0x7fc8f0139970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:56.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.392+0000 7fc8eed9d700 1 -- 172.21.15.26:0/394876338 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e4009550 con 0x7fc8f009d6f0 2023-10-01T07:55:56.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.393+0000 7fc8eed9d700 1 --2- 172.21.15.26:0/394876338 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc8f009d6f0 0x7fc8f0138a70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc8e00090b0 tx=0x7fc8e0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:56.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.393+0000 7fc8d77fe700 1 -- 172.21.15.26:0/394876338 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0004590 con 0x7fc8f009d6f0 2023-10-01T07:55:56.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.393+0000 7fc8d77fe700 1 -- 172.21.15.26:0/394876338 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e001f070 con 0x7fc8f009d6f0 2023-10-01T07:55:56.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.393+0000 7fc8f5097700 1 -- 172.21.15.26:0/394876338 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e00094a0 con 0x7fc8f009d6f0 2023-10-01T07:55:56.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.393+0000 7fc8d77fe700 1 -- 172.21.15.26:0/394876338 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e00038c0 con 0x7fc8f009d6f0 2023-10-01T07:55:56.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.393+0000 7fc8f5097700 1 -- 172.21.15.26:0/394876338 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f009c700 con 0x7fc8f009d6f0 2023-10-01T07:55:56.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.394+0000 7fc8d77fe700 1 -- 172.21.15.26:0/394876338 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc8e0003a20 con 0x7fc8f009d6f0 2023-10-01T07:55:56.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.394+0000 7fc8d77fe700 1 -- 172.21.15.26:0/394876338 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc8e0021070 con 0x7fc8f009d6f0 2023-10-01T07:55:56.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.394+0000 7fc8f5097700 1 -- 172.21.15.26:0/394876338 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f0074ea0 con 0x7fc8f009d6f0 2023-10-01T07:55:56.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.399+0000 7fc8d77fe700 1 -- 172.21.15.26:0/394876338 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc8e0015020 con 0x7fc8f009d6f0 2023-10-01T07:55:56.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.413+0000 7f9d6839b700 1 Processor -- start 2023-10-01T07:55:56.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.413+0000 7f9d6839b700 1 -- start start 2023-10-01T07:55:56.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.413+0000 7f9d6839b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d6009d6f0 0x7f9d6009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:56.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.413+0000 7f9d6839b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9d6009e000 0x7f9d601339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:56.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.413+0000 7f9d6839b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d6009b120 con 0x7f9d6009e410 2023-10-01T07:55:56.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.413+0000 7f9d6839b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d6006b460 con 0x7f9d6009e000 2023-10-01T07:55:56.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.413+0000 7f9d6839b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6009a7e0 con 0x7f9d6009d6f0 2023-10-01T07:55:56.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.414+0000 7f9d66938700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9d6009e410 0x7f9d60133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48928/0 (socket says 172.21.15.26:48928) 2023-10-01T07:55:56.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.414+0000 7f9d66938700 1 -- 172.21.15.26:0/1988324460 learned_addr learned my addr 172.21.15.26:0/1988324460 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:56.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.414+0000 7f9d65936700 1 --2- 172.21.15.26:0/1988324460 >> v2:172.21.15.26:3300/0 conn(0x7f9d6009e000 0x7f9d601339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:56.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.414+0000 7f9d66137700 1 --2- 172.21.15.26:0/1988324460 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d6009d6f0 0x7f9d6009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:56.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.414+0000 7f9d65936700 1 -- 172.21.15.26:0/1988324460 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d6009d6f0 msgr2=0x7f9d6009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:56.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.414+0000 7f9d65936700 1 --2- 172.21.15.26:0/1988324460 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d6009d6f0 0x7f9d6009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:56.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.414+0000 7f9d65936700 1 -- 172.21.15.26:0/1988324460 >> v1:172.21.15.26:6789/0 conn(0x7f9d6009e410 legacy=0x7f9d60133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:56.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.414+0000 7f9d65936700 1 -- 172.21.15.26:0/1988324460 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d6009a500 con 0x7f9d6009e000 2023-10-01T07:55:56.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.414+0000 7f9d66137700 1 --2- 172.21.15.26:0/1988324460 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d6009d6f0 0x7f9d6009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:55:56.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.414+0000 7f9d65936700 1 --2- 172.21.15.26:0/1988324460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d6009e000 0x7f9d601339f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9d50009840 tx=0x7f9d50009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37553261976930bd server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:56.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.414+0000 7f9d65135700 1 -- 172.21.15.26:0/1988324460 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d50004230 con 0x7f9d6009e000 2023-10-01T07:55:56.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.415+0000 7f9d65135700 1 -- 172.21.15.26:0/1988324460 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d50004390 con 0x7f9d6009e000 2023-10-01T07:55:56.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.415+0000 7f9d65135700 1 -- 172.21.15.26:0/1988324460 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d500036a0 con 0x7f9d6009e000 2023-10-01T07:55:56.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.416+0000 7f9d6839b700 1 -- 172.21.15.26:0/1988324460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d6009e000 msgr2=0x7f9d601339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:56.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.416+0000 7f9d6839b700 1 --2- 172.21.15.26:0/1988324460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d6009e000 0x7f9d601339f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9d50009840 tx=0x7f9d50009b50 comp rx=0 tx=0).stop 2023-10-01T07:55:56.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.416+0000 7f9d6839b700 1 -- 172.21.15.26:0/1988324460 shutdown_connections 2023-10-01T07:55:56.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.416+0000 7f9d6839b700 1 --2- 172.21.15.26:0/1988324460 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d6009d6f0 0x7f9d6009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:56.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.416+0000 7f9d6839b700 1 --2- 172.21.15.26:0/1988324460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d6009e000 0x7f9d601339f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:56.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.416+0000 7f9d6839b700 1 -- 172.21.15.26:0/1988324460 >> 172.21.15.26:0/1988324460 conn(0x7f9d60066f50 msgr2=0x7f9d6009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:56.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.416+0000 7f9d6839b700 1 -- 172.21.15.26:0/1988324460 shutdown_connections 2023-10-01T07:55:56.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.416+0000 7f9d6839b700 1 -- 172.21.15.26:0/1988324460 wait complete. 2023-10-01T07:55:56.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.417+0000 7f9d6839b700 1 Processor -- start 2023-10-01T07:55:56.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.417+0000 7f9d6839b700 1 -- start start 2023-10-01T07:55:56.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.418+0000 7f9d6839b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d6009d6f0 0x7f9d601b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:56.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.418+0000 7f9d6839b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d6009e000 0x7f9d601b4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:56.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.418+0000 7f9d6839b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d6009e410 0x7f9d60079ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:56.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.418+0000 7f9d6839b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6007d880 con 0x7f9d6009d6f0 2023-10-01T07:55:56.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.418+0000 7f9d6839b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d601b5450 con 0x7f9d6009e000 2023-10-01T07:55:56.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.418+0000 7f9d6839b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6007b450 con 0x7f9d6009e410 2023-10-01T07:55:56.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.418+0000 7f9d65936700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d6009e000 0x7f9d601b4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:56.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.418+0000 7f9d65936700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d6009e000 0x7f9d601b4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55288/0 (socket says 172.21.15.26:55288) 2023-10-01T07:55:56.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.418+0000 7f9d66137700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d6009d6f0 0x7f9d601b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:56.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.418+0000 7f9d65936700 1 -- 172.21.15.26:0/1964747642 learned_addr learned my addr 172.21.15.26:0/1964747642 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:56.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.419+0000 7f9d66137700 1 -- 172.21.15.26:0/1964747642 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d6009e410 msgr2=0x7f9d60079ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:56.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.419+0000 7f9d66137700 1 --2- 172.21.15.26:0/1964747642 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d6009e410 0x7f9d60079ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:56.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.419+0000 7f9d66137700 1 -- 172.21.15.26:0/1964747642 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d6009e000 msgr2=0x7f9d601b4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:56.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.419+0000 7f9d66137700 1 --2- 172.21.15.26:0/1964747642 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d6009e000 0x7f9d601b4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:56.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.419+0000 7f9d66137700 1 -- 172.21.15.26:0/1964747642 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d500094a0 con 0x7f9d6009d6f0 2023-10-01T07:55:56.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.419+0000 7f9d66137700 1 --2- 172.21.15.26:0/1964747642 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d6009d6f0 0x7f9d601b4310 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c00e7e0 tx=0x7f9d5c00eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:56.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.419+0000 7f9d56ffd700 1 -- 172.21.15.26:0/1964747642 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c013610 con 0x7f9d6009d6f0 2023-10-01T07:55:56.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.419+0000 7f9d56ffd700 1 -- 172.21.15.26:0/1964747642 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5c013770 con 0x7f9d6009d6f0 2023-10-01T07:55:56.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.419+0000 7f9d56ffd700 1 -- 172.21.15.26:0/1964747642 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c013ae0 con 0x7f9d6009d6f0 2023-10-01T07:55:56.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.419+0000 7f9d6839b700 1 -- 172.21.15.26:0/1964747642 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d6007dae0 con 0x7f9d6009d6f0 2023-10-01T07:55:56.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.420+0000 7f9d6839b700 1 -- 172.21.15.26:0/1964747642 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d6009c710 con 0x7f9d6009d6f0 2023-10-01T07:55:56.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.421+0000 7f9d56ffd700 1 -- 172.21.15.26:0/1964747642 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d5c013c40 con 0x7f9d6009d6f0 2023-10-01T07:55:56.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.421+0000 7f9d6839b700 1 -- 172.21.15.26:0/1964747642 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d6007d540 con 0x7f9d6009d6f0 2023-10-01T07:55:56.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.421+0000 7f9d56ffd700 1 -- 172.21.15.26:0/1964747642 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9d5c0126f0 con 0x7f9d6009d6f0 2023-10-01T07:55:56.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.426+0000 7f9d56ffd700 1 -- 172.21.15.26:0/1964747642 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d6007d540 con 0x7f9d6009d6f0 2023-10-01T07:55:56.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.427+0000 7f3f15786700 1 Processor -- start 2023-10-01T07:55:56.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.427+0000 7f3f15786700 1 -- start start 2023-10-01T07:55:56.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.428+0000 7f3f15786700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f1009e930 0x7f3f1009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:56.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.428+0000 7f3f15786700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3f1009f240 0x7f3f101317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:56.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.428+0000 7f3f15786700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f10070940 con 0x7f3f1009f650 2023-10-01T07:55:56.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.428+0000 7f3f15786700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f1006fd60 con 0x7f3f1009f240 2023-10-01T07:55:56.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.428+0000 7f3f15786700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1006fa80 con 0x7f3f1009e930 2023-10-01T07:55:56.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.428+0000 7f3f0e7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3f1009f240 0x7f3f101317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:56.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.428+0000 7f3f0e7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3f1009f240 0x7f3f101317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54262/0 (socket says 172.21.15.26:54262) 2023-10-01T07:55:56.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.428+0000 7f3f0f7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3f1009f650 0x7f3f10131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48944/0 (socket says 172.21.15.26:48944) 2023-10-01T07:55:56.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.428+0000 7f3f0e7fc700 1 -- 172.21.15.26:0/2229586356 learned_addr learned my addr 172.21.15.26:0/2229586356 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:56.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.428+0000 7f3f0effd700 1 --2- 172.21.15.26:0/2229586356 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f1009e930 0x7f3f1009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:56.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.429+0000 7f3f0effd700 1 -- 172.21.15.26:0/2229586356 >> v2:172.21.15.26:3300/0 conn(0x7f3f1009f240 msgr2=0x7f3f101317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:56.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.429+0000 7f3f0effd700 1 --2- 172.21.15.26:0/2229586356 >> v2:172.21.15.26:3300/0 conn(0x7f3f1009f240 0x7f3f101317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:56.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.429+0000 7f3f0effd700 1 -- 172.21.15.26:0/2229586356 >> v1:172.21.15.26:6789/0 conn(0x7f3f1009f650 legacy=0x7f3f10131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:56.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.429+0000 7f3f0effd700 1 -- 172.21.15.26:0/2229586356 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f1009fb60 con 0x7f3f1009e930 2023-10-01T07:55:56.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.429+0000 7f3f0effd700 1 --2- 172.21.15.26:0/2229586356 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f1009e930 0x7f3f1009ed00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3f00009840 tx=0x7f3f00009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62a0b997416f980f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:56.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.429+0000 7f3f0dffb700 1 -- 172.21.15.26:0/2229586356 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f00011830 con 0x7f3f1009e930 2023-10-01T07:55:56.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.429+0000 7f3f0dffb700 1 -- 172.21.15.26:0/2229586356 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f00011990 con 0x7f3f1009e930 2023-10-01T07:55:56.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.429+0000 7f3f0dffb700 1 -- 172.21.15.26:0/2229586356 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f00011d20 con 0x7f3f1009e930 2023-10-01T07:55:56.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.430+0000 7f3f15786700 1 -- 172.21.15.26:0/2229586356 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f1009e930 msgr2=0x7f3f1009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:56.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.430+0000 7f3f15786700 1 --2- 172.21.15.26:0/2229586356 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f1009e930 0x7f3f1009ed00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3f00009840 tx=0x7f3f00009b50 comp rx=0 tx=0).stop 2023-10-01T07:55:56.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.430+0000 7f3f15786700 1 -- 172.21.15.26:0/2229586356 shutdown_connections 2023-10-01T07:55:56.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.430+0000 7f3f15786700 1 --2- 172.21.15.26:0/2229586356 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f1009e930 0x7f3f1009ed00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:56.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.430+0000 7f3f15786700 1 --2- 172.21.15.26:0/2229586356 >> v2:172.21.15.26:3300/0 conn(0x7f3f1009f240 0x7f3f101317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:56.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.430+0000 7f3f15786700 1 -- 172.21.15.26:0/2229586356 >> 172.21.15.26:0/2229586356 conn(0x7f3f100a4210 msgr2=0x7f3f100a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:56.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.430+0000 7f3f15786700 1 -- 172.21.15.26:0/2229586356 shutdown_connections 2023-10-01T07:55:56.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.431+0000 7f3f15786700 1 -- 172.21.15.26:0/2229586356 wait complete. 2023-10-01T07:55:56.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.432+0000 7f3f15786700 1 Processor -- start 2023-10-01T07:55:56.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.432+0000 7f3f15786700 1 -- start start 2023-10-01T07:55:56.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.433+0000 7f3f15786700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f1009e930 0x7f3f1006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:56.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.433+0000 7f3f15786700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f1009f240 0x7f3f1006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:56.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.433+0000 7f3f15786700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3f1009f650 0x7f3f1006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:56.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.433+0000 7f3f15786700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f101b72d0 con 0x7f3f1009e930 2023-10-01T07:55:56.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.433+0000 7f3f15786700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f101a9480 con 0x7f3f1009f650 2023-10-01T07:55:56.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.433+0000 7f3f15786700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f101a89a0 con 0x7f3f1009f240 2023-10-01T07:55:56.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.433+0000 7f3f0effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f1009e930 0x7f3f1006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:56.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.433+0000 7f3f0effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f1009e930 0x7f3f1006b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54274/0 (socket says 172.21.15.26:54274) 2023-10-01T07:55:56.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.433+0000 7f3f0effd700 1 -- 172.21.15.26:0/1187451572 learned_addr learned my addr 172.21.15.26:0/1187451572 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:56.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.433+0000 7f3f0e7fc700 1 --2- 172.21.15.26:0/1187451572 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f1009f240 0x7f3f1006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:56.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.434+0000 7f3f0e7fc700 1 -- 172.21.15.26:0/1187451572 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3f1009f650 msgr2=0x7f3f1006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:56.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.434+0000 7f3f0e7fc700 1 --2- 172.21.15.26:0/1187451572 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3f1009f650 0x7f3f1006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:56.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.434+0000 7f3f0e7fc700 1 -- 172.21.15.26:0/1187451572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f1009e930 msgr2=0x7f3f1006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:56.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.434+0000 7f3f0e7fc700 1 --2- 172.21.15.26:0/1187451572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f1009e930 0x7f3f1006b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:56.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.434+0000 7f3f0e7fc700 1 -- 172.21.15.26:0/1187451572 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f000094a0 con 0x7f3f1009f240 2023-10-01T07:55:56.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.434+0000 7f3f0e7fc700 1 --2- 172.21.15.26:0/1187451572 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f1009f240 0x7f3f1006bdf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3f0400e8b0 tx=0x7f3f0400ebc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:56.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.434+0000 7f3ef77fe700 1 -- 172.21.15.26:0/1187451572 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f04013680 con 0x7f3f1009f240 2023-10-01T07:55:56.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.434+0000 7f3f15786700 1 -- 172.21.15.26:0/1187451572 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f100a0190 con 0x7f3f1009f240 2023-10-01T07:55:56.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.434+0000 7f3ef77fe700 1 -- 172.21.15.26:0/1187451572 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f040137e0 con 0x7f3f1009f240 2023-10-01T07:55:56.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.434+0000 7f3ef77fe700 1 -- 172.21.15.26:0/1187451572 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f04013b50 con 0x7f3f1009f240 2023-10-01T07:55:56.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.434+0000 7f3f15786700 1 -- 172.21.15.26:0/1187451572 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f101a9790 con 0x7f3f1009f240 2023-10-01T07:55:56.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.436+0000 7f3f15786700 1 -- 172.21.15.26:0/1187451572 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f101a0b30 con 0x7f3f1009f240 2023-10-01T07:55:56.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.436+0000 7f3ef77fe700 1 -- 172.21.15.26:0/1187451572 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f04013cb0 con 0x7f3f1009f240 2023-10-01T07:55:56.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.437+0000 7f3ef77fe700 1 -- 172.21.15.26:0/1187451572 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3f0403fdf0 con 0x7f3f1009f240 2023-10-01T07:55:56.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.445+0000 7f3ef77fe700 1 -- 172.21.15.26:0/1187451572 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f0400c480 con 0x7f3f1009f240 2023-10-01T07:55:56.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.463+0000 7f79e0bc5700 1 Processor -- start 2023-10-01T07:55:56.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.463+0000 7f79e0bc5700 1 -- start start 2023-10-01T07:55:56.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.464+0000 7f79e0bc5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79dc134630 0x7f79dc136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:56.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.464+0000 7f79e0bc5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f79dc136f50 0x7f79dc139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:56.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.464+0000 7f79e0bc5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79dc071a00 con 0x7f79dc131630 2023-10-01T07:55:56.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.464+0000 7f79e0bc5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79dc131430 con 0x7f79dc136f50 2023-10-01T07:55:56.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.464+0000 7f79e0bc5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc09a510 con 0x7f79dc134630 2023-10-01T07:55:56.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.464+0000 7f79d9d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79dc134630 0x7f79dc136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:56.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.464+0000 7f79d9d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79dc134630 0x7f79dc136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55304/0 (socket says 172.21.15.26:55304) 2023-10-01T07:55:56.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.464+0000 7f79d9d9b700 1 -- 172.21.15.26:0/871340046 learned_addr learned my addr 172.21.15.26:0/871340046 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:56.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.464+0000 7f79dad9d700 1 --2- 172.21.15.26:0/871340046 >> v2:172.21.15.26:3300/0 conn(0x7f79dc136f50 0x7f79dc139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:56.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.465+0000 7f79d9d9b700 1 -- 172.21.15.26:0/871340046 >> v2:172.21.15.26:3300/0 conn(0x7f79dc136f50 msgr2=0x7f79dc139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:56.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.465+0000 7f79d9d9b700 1 --2- 172.21.15.26:0/871340046 >> v2:172.21.15.26:3300/0 conn(0x7f79dc136f50 0x7f79dc139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:56.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.465+0000 7f79d9d9b700 1 -- 172.21.15.26:0/871340046 >> v1:172.21.15.26:6789/0 conn(0x7f79dc131630 legacy=0x7f79dc131a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:56.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.465+0000 7f79d9d9b700 1 -- 172.21.15.26:0/871340046 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc0721c0 con 0x7f79dc134630 2023-10-01T07:55:56.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.465+0000 7f79d9d9b700 1 --2- 172.21.15.26:0/871340046 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79dc134630 0x7f79dc136a10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f79d00098f0 tx=0x7f79d0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1625e00dc89a466b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:56.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.465+0000 7f79d959a700 1 -- 172.21.15.26:0/871340046 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d0011830 con 0x7f79dc134630 2023-10-01T07:55:56.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.465+0000 7f79d959a700 1 -- 172.21.15.26:0/871340046 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d0011990 con 0x7f79dc134630 2023-10-01T07:55:56.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.465+0000 7f79d959a700 1 -- 172.21.15.26:0/871340046 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d0011d20 con 0x7f79dc134630 2023-10-01T07:55:56.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.466+0000 7f79e0bc5700 1 -- 172.21.15.26:0/871340046 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79dc134630 msgr2=0x7f79dc136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:56.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.466+0000 7f79e0bc5700 1 --2- 172.21.15.26:0/871340046 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79dc134630 0x7f79dc136a10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f79d00098f0 tx=0x7f79d0009c00 comp rx=0 tx=0).stop 2023-10-01T07:55:56.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.466+0000 7f79e0bc5700 1 -- 172.21.15.26:0/871340046 shutdown_connections 2023-10-01T07:55:56.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.466+0000 7f79e0bc5700 1 --2- 172.21.15.26:0/871340046 >> v2:172.21.15.26:3300/0 conn(0x7f79dc136f50 0x7f79dc139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:56.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.466+0000 7f79e0bc5700 1 --2- 172.21.15.26:0/871340046 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79dc134630 0x7f79dc136a10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:56.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.466+0000 7f79e0bc5700 1 -- 172.21.15.26:0/871340046 >> 172.21.15.26:0/871340046 conn(0x7f79dc0a2aa0 msgr2=0x7f79dc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:56.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.466+0000 7f79e0bc5700 1 -- 172.21.15.26:0/871340046 shutdown_connections 2023-10-01T07:55:56.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.466+0000 7f79e0bc5700 1 -- 172.21.15.26:0/871340046 wait complete. 2023-10-01T07:55:56.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.468+0000 7f79e0bc5700 1 Processor -- start 2023-10-01T07:55:56.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.468+0000 7f79e0bc5700 1 -- start start 2023-10-01T07:55:56.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.469+0000 7f79e0bc5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79dc131630 0x7f79dc118f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:56.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.469+0000 7f79e0bc5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79dc134630 0x7f79dc119470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:56.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.469+0000 7f79e0bc5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79dc136f50 0x7f79dc1199b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:56.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.469+0000 7f79e0bc5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc136d20 con 0x7f79dc134630 2023-10-01T07:55:56.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.469+0000 7f79e0bc5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc099f20 con 0x7f79dc131630 2023-10-01T07:55:56.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.469+0000 7f79e0bc5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc11a9a0 con 0x7f79dc136f50 2023-10-01T07:55:56.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.469+0000 7f79da59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79dc131630 0x7f79dc118f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:56.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.469+0000 7f79da59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79dc131630 0x7f79dc118f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55310/0 (socket says 172.21.15.26:55310) 2023-10-01T07:55:56.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.469+0000 7f79d9d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79dc134630 0x7f79dc119470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:56.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.469+0000 7f79da59c700 1 -- 172.21.15.26:0/2955787656 learned_addr learned my addr 172.21.15.26:0/2955787656 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:56.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.469+0000 7f79dad9d700 1 --2- 172.21.15.26:0/2955787656 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79dc136f50 0x7f79dc1199b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:56.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.470+0000 7f79d9d9b700 1 -- 172.21.15.26:0/2955787656 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79dc136f50 msgr2=0x7f79dc1199b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:56.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.470+0000 7f79d9d9b700 1 --2- 172.21.15.26:0/2955787656 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79dc136f50 0x7f79dc1199b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:56.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.470+0000 7f79d9d9b700 1 -- 172.21.15.26:0/2955787656 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79dc131630 msgr2=0x7f79dc118f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:56.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.470+0000 7f79d9d9b700 1 --2- 172.21.15.26:0/2955787656 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79dc131630 0x7f79dc118f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:56.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.470+0000 7f79d9d9b700 1 -- 172.21.15.26:0/2955787656 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d0009550 con 0x7f79dc134630 2023-10-01T07:55:56.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.470+0000 7f79da59c700 1 --2- 172.21.15.26:0/2955787656 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79dc131630 0x7f79dc118f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:56.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.470+0000 7f79d9d9b700 1 --2- 172.21.15.26:0/2955787656 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79dc134630 0x7f79dc119470 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f79d0016000 tx=0x7f79d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:56.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.470+0000 7f79caffd700 1 -- 172.21.15.26:0/2955787656 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d0004590 con 0x7f79dc134630 2023-10-01T07:55:56.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.470+0000 7f79caffd700 1 -- 172.21.15.26:0/2955787656 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d00036a0 con 0x7f79dc134630 2023-10-01T07:55:56.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.470+0000 7f79e0bc5700 1 -- 172.21.15.26:0/2955787656 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79dc11c4c0 con 0x7f79dc134630 2023-10-01T07:55:56.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.470+0000 7f79caffd700 1 -- 172.21.15.26:0/2955787656 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d0003a50 con 0x7f79dc134630 2023-10-01T07:55:56.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.470+0000 7f79e0bc5700 1 -- 172.21.15.26:0/2955787656 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79dc11bf10 con 0x7f79dc134630 2023-10-01T07:55:56.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.471+0000 7f79caffd700 1 -- 172.21.15.26:0/2955787656 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f79d0003bb0 con 0x7f79dc134630 2023-10-01T07:55:56.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.472+0000 7f79caffd700 1 -- 172.21.15.26:0/2955787656 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f79d0021030 con 0x7f79dc134630 2023-10-01T07:55:56.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.472+0000 7f79e0bc5700 1 -- 172.21.15.26:0/2955787656 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79dc11c300 con 0x7f79dc134630 2023-10-01T07:55:56.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.482+0000 7f79caffd700 1 -- 172.21.15.26:0/2955787656 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f79d0015080 con 0x7f79dc134630 2023-10-01T07:55:56.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.625+0000 7fc8f5097700 1 -- 172.21.15.26:0/394876338 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc8f0130390 con 0x7fc8f009d6f0 2023-10-01T07:55:56.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.626+0000 7fc8d77fe700 1 -- 172.21.15.26:0/394876338 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc8e0003cd0 con 0x7fc8f009d6f0 2023-10-01T07:55:56.626 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:56.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.629+0000 7fc8f5097700 1 -- 172.21.15.26:0/394876338 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc8f009d6f0 msgr2=0x7fc8f0138a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:56.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.629+0000 7fc8f5097700 1 --2- 172.21.15.26:0/394876338 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc8f009d6f0 0x7fc8f0138a70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc8e00090b0 tx=0x7fc8e0004750 comp rx=0 tx=0).stop 2023-10-01T07:55:56.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.629+0000 7fc8f5097700 1 -- 172.21.15.26:0/394876338 shutdown_connections 2023-10-01T07:55:56.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.629+0000 7fc8f5097700 1 --2- 172.21.15.26:0/394876338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f009e410 0x7fc8f0139970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:56.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.629+0000 7fc8f5097700 1 --2- 172.21.15.26:0/394876338 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc8f009d6f0 0x7fc8f0138a70 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:56.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.629+0000 7fc8f5097700 1 --2- 172.21.15.26:0/394876338 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc8f009e000 0x7fc8f0138fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:56.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.629+0000 7fc8f5097700 1 -- 172.21.15.26:0/394876338 >> 172.21.15.26:0/394876338 conn(0x7fc8f0066f50 msgr2=0x7fc8f00a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:56.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.629+0000 7fc8f5097700 1 -- 172.21.15.26:0/394876338 shutdown_connections 2023-10-01T07:55:56.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.629+0000 7fc8f5097700 1 -- 172.21.15.26:0/394876338 wait complete. 2023-10-01T07:55:56.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.647+0000 7f9d6839b700 1 -- 172.21.15.26:0/1964747642 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9d6007d540 con 0x7f9d6009d6f0 2023-10-01T07:55:56.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.647+0000 7f9d56ffd700 1 -- 172.21.15.26:0/1964747642 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9d6007d540 con 0x7f9d6009d6f0 2023-10-01T07:55:56.648 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:56.649 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:56.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.649+0000 7f9d6839b700 1 -- 172.21.15.26:0/1964747642 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d6009d6f0 msgr2=0x7f9d601b4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:56.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.649+0000 7f9d6839b700 1 --2- 172.21.15.26:0/1964747642 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d6009d6f0 0x7f9d601b4310 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c00e7e0 tx=0x7f9d5c00eaf0 comp rx=0 tx=0).stop 2023-10-01T07:55:56.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.649+0000 7f9d6839b700 1 -- 172.21.15.26:0/1964747642 shutdown_connections 2023-10-01T07:55:56.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.649+0000 7f9d6839b700 1 --2- 172.21.15.26:0/1964747642 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d6009e410 0x7f9d60079ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:56.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.649+0000 7f9d6839b700 1 --2- 172.21.15.26:0/1964747642 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d6009d6f0 0x7f9d601b4310 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:56.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.649+0000 7f9d6839b700 1 --2- 172.21.15.26:0/1964747642 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d6009e000 0x7f9d601b4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:56.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.649+0000 7f9d6839b700 1 -- 172.21.15.26:0/1964747642 >> 172.21.15.26:0/1964747642 conn(0x7f9d60066f50 msgr2=0x7f9d601b9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:56.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.649+0000 7f9d6839b700 1 -- 172.21.15.26:0/1964747642 shutdown_connections 2023-10-01T07:55:56.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.649+0000 7f9d6839b700 1 -- 172.21.15.26:0/1964747642 wait complete. 2023-10-01T07:55:56.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.655+0000 7f3f15786700 1 -- 172.21.15.26:0/1187451572 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3f101a9790 con 0x7f3f1009f240 2023-10-01T07:55:56.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.655+0000 7f3ef77fe700 1 -- 172.21.15.26:0/1187451572 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f101a9790 con 0x7f3f1009f240 2023-10-01T07:55:56.656 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:56.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.657+0000 7f3f15786700 1 -- 172.21.15.26:0/1187451572 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f1009f240 msgr2=0x7f3f1006bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:56.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.657+0000 7f3f15786700 1 --2- 172.21.15.26:0/1187451572 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f1009f240 0x7f3f1006bdf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3f0400e8b0 tx=0x7f3f0400ebc0 comp rx=0 tx=0).stop 2023-10-01T07:55:56.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.657+0000 7f3f15786700 1 -- 172.21.15.26:0/1187451572 shutdown_connections 2023-10-01T07:55:56.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.657+0000 7f3f15786700 1 --2- 172.21.15.26:0/1187451572 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3f1009f650 0x7f3f1006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:56.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.657+0000 7f3f15786700 1 --2- 172.21.15.26:0/1187451572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f1009e930 0x7f3f1006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:56.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.657+0000 7f3f15786700 1 --2- 172.21.15.26:0/1187451572 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f1009f240 0x7f3f1006bdf0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:56.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.657+0000 7f3f15786700 1 -- 172.21.15.26:0/1187451572 >> 172.21.15.26:0/1187451572 conn(0x7f3f100a4210 msgr2=0x7f3f101b8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:56.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.658+0000 7f3f15786700 1 -- 172.21.15.26:0/1187451572 shutdown_connections 2023-10-01T07:55:56.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.658+0000 7f3f15786700 1 -- 172.21.15.26:0/1187451572 wait complete. 2023-10-01T07:55:56.665 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:56.673 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:56.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.701+0000 7f79e0bc5700 1 -- 172.21.15.26:0/2955787656 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f79dc11c100 con 0x7f79dc134630 2023-10-01T07:55:56.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.702+0000 7f79caffd700 1 -- 172.21.15.26:0/2955787656 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f79d002b020 con 0x7f79dc134630 2023-10-01T07:55:56.702 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:56.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.704+0000 7f79e0bc5700 1 -- 172.21.15.26:0/2955787656 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79dc134630 msgr2=0x7f79dc119470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:56.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.704+0000 7f79e0bc5700 1 --2- 172.21.15.26:0/2955787656 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79dc134630 0x7f79dc119470 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f79d0016000 tx=0x7f79d0004750 comp rx=0 tx=0).stop 2023-10-01T07:55:56.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.704+0000 7f79e0bc5700 1 -- 172.21.15.26:0/2955787656 shutdown_connections 2023-10-01T07:55:56.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.704+0000 7f79e0bc5700 1 --2- 172.21.15.26:0/2955787656 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79dc136f50 0x7f79dc1199b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:56.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.704+0000 7f79e0bc5700 1 --2- 172.21.15.26:0/2955787656 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79dc131630 0x7f79dc118f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:56.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.704+0000 7f79e0bc5700 1 --2- 172.21.15.26:0/2955787656 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79dc134630 0x7f79dc119470 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:56.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.704+0000 7f79e0bc5700 1 -- 172.21.15.26:0/2955787656 >> 172.21.15.26:0/2955787656 conn(0x7f79dc0a2aa0 msgr2=0x7f79dc0a0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:56.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.704+0000 7f79e0bc5700 1 -- 172.21.15.26:0/2955787656 shutdown_connections 2023-10-01T07:55:56.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:56.704+0000 7f79e0bc5700 1 -- 172.21.15.26:0/2955787656 wait complete. 2023-10-01T07:55:56.718 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:57.649 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:57.666 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:57.674 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:57.718 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:57.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.805+0000 7f36febc6700 1 Processor -- start 2023-10-01T07:55:57.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.805+0000 7f36febc6700 1 -- start start 2023-10-01T07:55:57.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.806+0000 7f36febc6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36f8134630 0x7f36f8136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:57.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.806+0000 7f36febc6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f36f8136f50 0x7f36f8139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:57.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.806+0000 7f36febc6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f8071a00 con 0x7f36f8131630 2023-10-01T07:55:57.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.806+0000 7f36febc6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f8131430 con 0x7f36f8136f50 2023-10-01T07:55:57.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.806+0000 7f36febc6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f809a510 con 0x7f36f8134630 2023-10-01T07:55:57.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.806+0000 7f36f7fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36f8134630 0x7f36f8136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:57.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.806+0000 7f36fc962700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f36f8131630 0x7f36f8131a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48956/0 (socket says 172.21.15.26:48956) 2023-10-01T07:55:57.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.806+0000 7f36fc962700 1 -- 172.21.15.26:0/3348015819 learned_addr learned my addr 172.21.15.26:0/3348015819 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:57.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.806+0000 7f36f7fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36f8134630 0x7f36f8136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55314/0 (socket says 172.21.15.26:55314) 2023-10-01T07:55:57.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.806+0000 7f36fd163700 1 --2- 172.21.15.26:0/3348015819 >> v2:172.21.15.26:3300/0 conn(0x7f36f8136f50 0x7f36f8139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:57.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.806+0000 7f36f7fff700 1 -- 172.21.15.26:0/3348015819 >> v2:172.21.15.26:3300/0 conn(0x7f36f8136f50 msgr2=0x7f36f8139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:57.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.806+0000 7f36f7fff700 1 --2- 172.21.15.26:0/3348015819 >> v2:172.21.15.26:3300/0 conn(0x7f36f8136f50 0x7f36f8139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:57.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.806+0000 7f36f7fff700 1 -- 172.21.15.26:0/3348015819 >> v1:172.21.15.26:6789/0 conn(0x7f36f8131630 legacy=0x7f36f8131a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:57.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.806+0000 7f36f7fff700 1 -- 172.21.15.26:0/3348015819 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f80721c0 con 0x7f36f8134630 2023-10-01T07:55:57.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.807+0000 7f36f7fff700 1 --2- 172.21.15.26:0/3348015819 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36f8134630 0x7f36f8136a10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f36e4009840 tx=0x7f36e4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=705766d632e4f756 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:57.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.807+0000 7f36f77fe700 1 -- 172.21.15.26:0/3348015819 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e4011830 con 0x7f36f8134630 2023-10-01T07:55:57.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.807+0000 7f36f77fe700 1 -- 172.21.15.26:0/3348015819 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e4011990 con 0x7f36f8134630 2023-10-01T07:55:57.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.807+0000 7f36f77fe700 1 -- 172.21.15.26:0/3348015819 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e4011d20 con 0x7f36f8134630 2023-10-01T07:55:57.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.808+0000 7f36febc6700 1 -- 172.21.15.26:0/3348015819 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36f8134630 msgr2=0x7f36f8136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:57.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.808+0000 7f36febc6700 1 --2- 172.21.15.26:0/3348015819 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36f8134630 0x7f36f8136a10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f36e4009840 tx=0x7f36e4009b50 comp rx=0 tx=0).stop 2023-10-01T07:55:57.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.808+0000 7f36febc6700 1 -- 172.21.15.26:0/3348015819 shutdown_connections 2023-10-01T07:55:57.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.808+0000 7f36febc6700 1 --2- 172.21.15.26:0/3348015819 >> v2:172.21.15.26:3300/0 conn(0x7f36f8136f50 0x7f36f8139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:57.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.808+0000 7f36febc6700 1 --2- 172.21.15.26:0/3348015819 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36f8134630 0x7f36f8136a10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:57.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.808+0000 7f36febc6700 1 -- 172.21.15.26:0/3348015819 >> 172.21.15.26:0/3348015819 conn(0x7f36f80a2aa0 msgr2=0x7f36f80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:57.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.808+0000 7f36febc6700 1 -- 172.21.15.26:0/3348015819 shutdown_connections 2023-10-01T07:55:57.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.808+0000 7f36febc6700 1 -- 172.21.15.26:0/3348015819 wait complete. 2023-10-01T07:55:57.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.809+0000 7f36febc6700 1 Processor -- start 2023-10-01T07:55:57.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.809+0000 7f36febc6700 1 -- start start 2023-10-01T07:55:57.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.810+0000 7f36febc6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36f8131630 0x7f36f81c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:57.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.810+0000 7f36febc6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f36f8134630 0x7f36f81c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:57.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.810+0000 7f36febc6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36f8136f50 0x7f36f8118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:57.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.810+0000 7f36febc6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f811c530 con 0x7f36f8131630 2023-10-01T07:55:57.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.810+0000 7f36febc6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f812eae0 con 0x7f36f8136f50 2023-10-01T07:55:57.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.810+0000 7f36febc6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36f811a820 con 0x7f36f8134630 2023-10-01T07:55:57.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.810+0000 7f36fc962700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36f8131630 0x7f36f81c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:57.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.810+0000 7f36fd163700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36f8136f50 0x7f36f8118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:57.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.810+0000 7f36fc962700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36f8131630 0x7f36f81c62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54324/0 (socket says 172.21.15.26:54324) 2023-10-01T07:55:57.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.810+0000 7f36fc962700 1 -- 172.21.15.26:0/3306862608 learned_addr learned my addr 172.21.15.26:0/3306862608 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:57.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.811+0000 7f36f7fff700 1 --2- 172.21.15.26:0/3306862608 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f36f8134630 0x7f36f81c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:57.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.811+0000 7f36fd163700 1 -- 172.21.15.26:0/3306862608 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f36f8134630 msgr2=0x7f36f81c67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:57.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.811+0000 7f36fd163700 1 --2- 172.21.15.26:0/3306862608 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f36f8134630 0x7f36f81c67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:57.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.811+0000 7f36fd163700 1 -- 172.21.15.26:0/3306862608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36f8131630 msgr2=0x7f36f81c62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:57.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.811+0000 7f36fd163700 1 --2- 172.21.15.26:0/3306862608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36f8131630 0x7f36f81c62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:57.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.811+0000 7f36fd163700 1 -- 172.21.15.26:0/3306862608 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e40094a0 con 0x7f36f8136f50 2023-10-01T07:55:57.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.811+0000 7f36fc962700 1 --2- 172.21.15.26:0/3306862608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36f8131630 0x7f36f81c62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:57.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.811+0000 7f36fd163700 1 --2- 172.21.15.26:0/3306862608 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36f8136f50 0x7f36f8118cd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f36f0010f60 tx=0x7f36f0010f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:57.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.811+0000 7f36f57fa700 1 -- 172.21.15.26:0/3306862608 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f000e070 con 0x7f36f8136f50 2023-10-01T07:55:57.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.811+0000 7f36f57fa700 1 -- 172.21.15.26:0/3306862608 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f00102d0 con 0x7f36f8136f50 2023-10-01T07:55:57.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.811+0000 7f36febc6700 1 -- 172.21.15.26:0/3306862608 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f8136d40 con 0x7f36f8136f50 2023-10-01T07:55:57.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.811+0000 7f36f57fa700 1 -- 172.21.15.26:0/3306862608 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f000be80 con 0x7f36f8136f50 2023-10-01T07:55:57.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.811+0000 7f36febc6700 1 -- 172.21.15.26:0/3306862608 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f811cec0 con 0x7f36f8136f50 2023-10-01T07:55:57.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.813+0000 7f36f57fa700 1 -- 172.21.15.26:0/3306862608 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f36f001b8d0 con 0x7f36f8136f50 2023-10-01T07:55:57.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.813+0000 7f36febc6700 1 -- 172.21.15.26:0/3306862608 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f811c1f0 con 0x7f36f8136f50 2023-10-01T07:55:57.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.813+0000 7f36f57fa700 1 -- 172.21.15.26:0/3306862608 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f36f0047eb0 con 0x7f36f8136f50 2023-10-01T07:55:57.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.818+0000 7f36f57fa700 1 -- 172.21.15.26:0/3306862608 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f36f811c1f0 con 0x7f36f8136f50 2023-10-01T07:55:57.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.843+0000 7f6feb982700 1 Processor -- start 2023-10-01T07:55:57.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.843+0000 7f6feb982700 1 -- start start 2023-10-01T07:55:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.844+0000 7f6feb982700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6fe409d6f0 0x7f6fe409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.844+0000 7f6feb982700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6fe409e000 0x7f6fe41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.844+0000 7f6feb982700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fe409b120 con 0x7f6fe409e410 2023-10-01T07:55:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.844+0000 7f6feb982700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe406b460 con 0x7f6fe409d6f0 2023-10-01T07:55:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.844+0000 7f6feb982700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe409a7e0 con 0x7f6fe409e000 2023-10-01T07:55:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.844+0000 7f6fe8f1d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6fe409e000 0x7f6fe41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.844+0000 7f6fe8f1d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6fe409e000 0x7f6fe41339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:58312/0 (socket says 172.21.15.26:58312) 2023-10-01T07:55:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.844+0000 7f6fe8f1d700 1 -- 172.21.15.26:0/2605556761 learned_addr learned my addr 172.21.15.26:0/2605556761 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:57.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.845+0000 7f6fe8f1d700 1 -- 172.21.15.26:0/2605556761 >> v2:172.21.15.26:3300/0 conn(0x7f6fe409d6f0 msgr2=0x7f6fe409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:57.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.845+0000 7f6fe8f1d700 1 --2- 172.21.15.26:0/2605556761 >> v2:172.21.15.26:3300/0 conn(0x7f6fe409d6f0 0x7f6fe409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:57.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.845+0000 7f6fe8f1d700 1 -- 172.21.15.26:0/2605556761 >> v1:172.21.15.26:6789/0 conn(0x7f6fe409e410 legacy=0x7f6fe4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:57.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.845+0000 7f6fe8f1d700 1 -- 172.21.15.26:0/2605556761 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe409a500 con 0x7f6fe409e000 2023-10-01T07:55:57.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.845+0000 7f6fe8f1d700 1 --2- 172.21.15.26:0/2605556761 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6fe409e000 0x7f6fe41339f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4009920 tx=0x7f6fd4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2a2b2b3c47c3666 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:57.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.845+0000 7f6fdbfff700 1 -- 172.21.15.26:0/2605556761 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd4004230 con 0x7f6fe409e000 2023-10-01T07:55:57.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.845+0000 7f6fdbfff700 1 -- 172.21.15.26:0/2605556761 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd4004390 con 0x7f6fe409e000 2023-10-01T07:55:57.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.845+0000 7f6fdbfff700 1 -- 172.21.15.26:0/2605556761 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd4009e70 con 0x7f6fe409e000 2023-10-01T07:55:57.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.846+0000 7f6feb982700 1 -- 172.21.15.26:0/2605556761 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6fe409e000 msgr2=0x7f6fe41339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:57.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.846+0000 7f6feb982700 1 --2- 172.21.15.26:0/2605556761 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6fe409e000 0x7f6fe41339f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4009920 tx=0x7f6fd4009c30 comp rx=0 tx=0).stop 2023-10-01T07:55:57.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.846+0000 7f6feb982700 1 -- 172.21.15.26:0/2605556761 shutdown_connections 2023-10-01T07:55:57.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.846+0000 7f6feb982700 1 --2- 172.21.15.26:0/2605556761 >> v2:172.21.15.26:3300/0 conn(0x7f6fe409d6f0 0x7f6fe409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:57.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.846+0000 7f6feb982700 1 --2- 172.21.15.26:0/2605556761 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6fe409e000 0x7f6fe41339f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:57.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.846+0000 7f6feb982700 1 -- 172.21.15.26:0/2605556761 >> 172.21.15.26:0/2605556761 conn(0x7f6fe4066f50 msgr2=0x7f6fe409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:57.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.846+0000 7f6feb982700 1 -- 172.21.15.26:0/2605556761 shutdown_connections 2023-10-01T07:55:57.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.846+0000 7f6feb982700 1 -- 172.21.15.26:0/2605556761 wait complete. 2023-10-01T07:55:57.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.848+0000 7f6feb982700 1 Processor -- start 2023-10-01T07:55:57.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.848+0000 7f6feb982700 1 -- start start 2023-10-01T07:55:57.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.848+0000 7f6feb982700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6fe409d6f0 0x7f6fe41a5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:57.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.848+0000 7f6feb982700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6fe409e000 0x7f6fe41a6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:57.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.848+0000 7f6feb982700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fe409e410 0x7f6fe41a69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:57.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.848+0000 7f6feb982700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe41a7b60 con 0x7f6fe409e410 2023-10-01T07:55:57.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.848+0000 7f6feb982700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe41a9a70 con 0x7f6fe409e000 2023-10-01T07:55:57.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.848+0000 7f6feb982700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe41a8e20 con 0x7f6fe409d6f0 2023-10-01T07:55:57.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.849+0000 7f6fe9f1f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fe409e410 0x7f6fe41a69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:57.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.849+0000 7f6fe971e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6fe409d6f0 0x7f6fe41a5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:57.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.849+0000 7f6fe9f1f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fe409e410 0x7f6fe41a69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54344/0 (socket says 172.21.15.26:54344) 2023-10-01T07:55:57.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.849+0000 7f6fe971e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6fe409d6f0 0x7f6fe41a5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:58320/0 (socket says 172.21.15.26:58320) 2023-10-01T07:55:57.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.849+0000 7f6fe9f1f700 1 -- 172.21.15.26:0/1327424177 learned_addr learned my addr 172.21.15.26:0/1327424177 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:57.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.849+0000 7f6fe8f1d700 1 --2- 172.21.15.26:0/1327424177 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6fe409e000 0x7f6fe41a6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:57.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.849+0000 7f6fe9f1f700 1 -- 172.21.15.26:0/1327424177 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6fe409d6f0 msgr2=0x7f6fe41a5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:57.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.849+0000 7f6fe9f1f700 1 --2- 172.21.15.26:0/1327424177 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6fe409d6f0 0x7f6fe41a5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:57.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.849+0000 7f6fe9f1f700 1 -- 172.21.15.26:0/1327424177 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6fe409e000 msgr2=0x7f6fe41a6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:57.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.849+0000 7f6fe9f1f700 1 --2- 172.21.15.26:0/1327424177 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6fe409e000 0x7f6fe41a6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:57.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.849+0000 7f6fe9f1f700 1 -- 172.21.15.26:0/1327424177 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd4009550 con 0x7f6fe409e410 2023-10-01T07:55:57.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.849+0000 7f6fe971e700 1 --2- 172.21.15.26:0/1327424177 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6fe409d6f0 0x7f6fe41a5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:57.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.849+0000 7f6fe9f1f700 1 --2- 172.21.15.26:0/1327424177 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fe409e410 0x7f6fe41a69d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00c7a0 tx=0x7f6fdc00cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:57.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.850+0000 7f6fd9ffb700 1 -- 172.21.15.26:0/1327424177 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc003e10 con 0x7f6fe409e410 2023-10-01T07:55:57.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.850+0000 7f6fd9ffb700 1 -- 172.21.15.26:0/1327424177 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fdc005070 con 0x7f6fe409e410 2023-10-01T07:55:57.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.850+0000 7f6feb982700 1 -- 172.21.15.26:0/1327424177 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fe40a3160 con 0x7f6fe409e410 2023-10-01T07:55:57.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.850+0000 7f6fd9ffb700 1 -- 172.21.15.26:0/1327424177 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc005420 con 0x7f6fe409e410 2023-10-01T07:55:57.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.850+0000 7f6feb982700 1 -- 172.21.15.26:0/1327424177 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fe41a9790 con 0x7f6fe409e410 2023-10-01T07:55:57.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.851+0000 7f6fd9ffb700 1 -- 172.21.15.26:0/1327424177 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6fdc005580 con 0x7f6fe409e410 2023-10-01T07:55:57.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.851+0000 7f6fd9ffb700 1 -- 172.21.15.26:0/1327424177 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6fdc03ea20 con 0x7f6fe409e410 2023-10-01T07:55:57.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.851+0000 7f6feb982700 1 -- 172.21.15.26:0/1327424177 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fe41a9400 con 0x7f6fe409e410 2023-10-01T07:55:57.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.856+0000 7facb1fb3700 1 Processor -- start 2023-10-01T07:55:57.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.856+0000 7facb1fb3700 1 -- start start 2023-10-01T07:55:57.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.857+0000 7f6fd9ffb700 1 -- 172.21.15.26:0/1327424177 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6fdc00eb00 con 0x7f6fe409e410 2023-10-01T07:55:57.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.857+0000 7facb1fb3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7facac12cf60 0x7facac06f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:57.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.857+0000 7facb1fb3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7facac12f8b0 0x7facac12fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:57.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.857+0000 7facb1fb3700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facac12cd90 con 0x7facac130260 2023-10-01T07:55:57.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.857+0000 7facb1fb3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facac12d330 con 0x7facac12cf60 2023-10-01T07:55:57.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.857+0000 7facb1fb3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facac1306d0 con 0x7facac12f8b0 2023-10-01T07:55:57.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.857+0000 7faca3fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7facac12f8b0 0x7facac12fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:57.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.857+0000 7facabfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7facac130260 0x7facac136c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48986/0 (socket says 172.21.15.26:48986) 2023-10-01T07:55:57.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.857+0000 7facabfff700 1 -- 172.21.15.26:0/1488411859 learned_addr learned my addr 172.21.15.26:0/1488411859 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:57.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.858+0000 7facaaffd700 1 -- 172.21.15.26:0/1488411859 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 250672346 0 0) 0x7facac12cd90 con 0x7facac130260 2023-10-01T07:55:57.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.858+0000 7faca3fff700 1 -- 172.21.15.26:0/1488411859 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7facac12cf60 msgr2=0x7facac06f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:57.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.858+0000 7faca3fff700 1 --2- 172.21.15.26:0/1488411859 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7facac12cf60 0x7facac06f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:57.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.858+0000 7faca3fff700 1 -- 172.21.15.26:0/1488411859 >> v1:172.21.15.26:6789/0 conn(0x7facac130260 legacy=0x7facac136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:57.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.858+0000 7faca3fff700 1 -- 172.21.15.26:0/1488411859 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facac071780 con 0x7facac12f8b0 2023-10-01T07:55:57.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.858+0000 7faca3fff700 1 --2- 172.21.15.26:0/1488411859 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7facac12f8b0 0x7facac12fd20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fac9400aa10 tx=0x7fac9400ad20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3540b0837f2fd09 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:57.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.858+0000 7facaaffd700 1 -- 172.21.15.26:0/1488411859 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9400cb70 con 0x7facac12f8b0 2023-10-01T07:55:57.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.858+0000 7facaaffd700 1 -- 172.21.15.26:0/1488411859 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9400ccd0 con 0x7facac12f8b0 2023-10-01T07:55:57.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.858+0000 7facaaffd700 1 -- 172.21.15.26:0/1488411859 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac94018620 con 0x7facac12f8b0 2023-10-01T07:55:57.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.859+0000 7facb1fb3700 1 -- 172.21.15.26:0/1488411859 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7facac12f8b0 msgr2=0x7facac12fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:57.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.859+0000 7facb1fb3700 1 --2- 172.21.15.26:0/1488411859 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7facac12f8b0 0x7facac12fd20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fac9400aa10 tx=0x7fac9400ad20 comp rx=0 tx=0).stop 2023-10-01T07:55:57.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.859+0000 7facb1fb3700 1 -- 172.21.15.26:0/1488411859 shutdown_connections 2023-10-01T07:55:57.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.859+0000 7facb1fb3700 1 --2- 172.21.15.26:0/1488411859 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7facac12cf60 0x7facac06f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:57.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.859+0000 7facb1fb3700 1 --2- 172.21.15.26:0/1488411859 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7facac12f8b0 0x7facac12fd20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:57.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.859+0000 7facb1fb3700 1 -- 172.21.15.26:0/1488411859 >> 172.21.15.26:0/1488411859 conn(0x7facac0a2aa0 msgr2=0x7facac0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:57.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.859+0000 7facb1fb3700 1 -- 172.21.15.26:0/1488411859 shutdown_connections 2023-10-01T07:55:57.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.859+0000 7facb1fb3700 1 -- 172.21.15.26:0/1488411859 wait complete. 2023-10-01T07:55:57.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.860+0000 7facb1fb3700 1 Processor -- start 2023-10-01T07:55:57.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.860+0000 7facb1fb3700 1 -- start start 2023-10-01T07:55:57.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.861+0000 7facb1fb3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facac12cf60 0x7facac11d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:57.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.861+0000 7facb1fb3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7facac12f8b0 0x7facac11d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:57.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.861+0000 7facb1fb3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7facac130260 0x7facac11db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:57.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.861+0000 7facb1fb3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facac12d9b0 con 0x7facac12cf60 2023-10-01T07:55:57.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.861+0000 7facb1fb3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facac09e960 con 0x7facac130260 2023-10-01T07:55:57.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.861+0000 7facb1fb3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facac129fa0 con 0x7facac12f8b0 2023-10-01T07:55:57.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.861+0000 7facab7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facac12cf60 0x7facac11d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.861+0000 7facabfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7facac130260 0x7facac11db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.861+0000 7facab7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facac12cf60 0x7facac11d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54356/0 (socket says 172.21.15.26:54356) 2023-10-01T07:55:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.861+0000 7facab7fe700 1 -- 172.21.15.26:0/978681700 learned_addr learned my addr 172.21.15.26:0/978681700 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.861+0000 7faca3fff700 1 --2- 172.21.15.26:0/978681700 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7facac12f8b0 0x7facac11d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.861+0000 7facab7fe700 1 -- 172.21.15.26:0/978681700 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7facac12f8b0 msgr2=0x7facac11d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.861+0000 7facab7fe700 1 --2- 172.21.15.26:0/978681700 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7facac12f8b0 0x7facac11d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.861+0000 7facab7fe700 1 -- 172.21.15.26:0/978681700 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7facac130260 msgr2=0x7facac11db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.861+0000 7facab7fe700 1 --2- 172.21.15.26:0/978681700 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7facac130260 0x7facac11db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.861+0000 7facab7fe700 1 -- 172.21.15.26:0/978681700 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9400a640 con 0x7facac12cf60 2023-10-01T07:55:57.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.862+0000 7facab7fe700 1 --2- 172.21.15.26:0/978681700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facac12cf60 0x7facac11d0e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fac9c00b530 tx=0x7fac9c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:57.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.862+0000 7faca8ff9700 1 -- 172.21.15.26:0/978681700 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c011830 con 0x7facac12cf60 2023-10-01T07:55:57.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.862+0000 7faca8ff9700 1 -- 172.21.15.26:0/978681700 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9c011990 con 0x7facac12cf60 2023-10-01T07:55:57.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.862+0000 7faca8ff9700 1 -- 172.21.15.26:0/978681700 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c011d40 con 0x7facac12cf60 2023-10-01T07:55:57.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.862+0000 7facb1fb3700 1 -- 172.21.15.26:0/978681700 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facac11f6c0 con 0x7facac12cf60 2023-10-01T07:55:57.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.862+0000 7facb1fb3700 1 -- 172.21.15.26:0/978681700 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facac09e020 con 0x7facac12cf60 2023-10-01T07:55:57.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.863+0000 7facb1fb3700 1 -- 172.21.15.26:0/978681700 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facac12e090 con 0x7facac12cf60 2023-10-01T07:55:57.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.863+0000 7faca8ff9700 1 -- 172.21.15.26:0/978681700 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fac9c01a400 con 0x7facac12cf60 2023-10-01T07:55:57.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.866+0000 7faca8ff9700 1 -- 172.21.15.26:0/978681700 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fac9c00f4a0 con 0x7facac12cf60 2023-10-01T07:55:57.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.868+0000 7faca8ff9700 1 -- 172.21.15.26:0/978681700 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fac9c044060 con 0x7facac12cf60 2023-10-01T07:55:57.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.889+0000 7f8b2e6c7700 1 Processor -- start 2023-10-01T07:55:57.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.889+0000 7f8b2e6c7700 1 -- start start 2023-10-01T07:55:57.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.889+0000 7f8b2e6c7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b2809d6f0 0x7f8b2809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:57.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.889+0000 7f8b2e6c7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8b2809e000 0x7f8b281339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:57.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.889+0000 7f8b2e6c7700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b2809b120 con 0x7f8b2809e410 2023-10-01T07:55:57.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.889+0000 7f8b2e6c7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b2806b460 con 0x7f8b2809e000 2023-10-01T07:55:57.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.889+0000 7f8b2e6c7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2809a7e0 con 0x7f8b2809d6f0 2023-10-01T07:55:57.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.889+0000 7f8b2cc64700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8b2809e410 0x7f8b28133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49002/0 (socket says 172.21.15.26:49002) 2023-10-01T07:55:57.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.889+0000 7f8b2cc64700 1 -- 172.21.15.26:0/1961510806 learned_addr learned my addr 172.21.15.26:0/1961510806 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:57.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.890+0000 7f8b27fff700 1 --2- 172.21.15.26:0/1961510806 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b2809d6f0 0x7f8b2809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:57.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.890+0000 7f8b277fe700 1 --2- 172.21.15.26:0/1961510806 >> v2:172.21.15.26:3300/0 conn(0x7f8b2809e000 0x7f8b281339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:57.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.890+0000 7f8b26ffd700 1 -- 172.21.15.26:0/1961510806 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1237424516 0 0) 0x7f8b2809b120 con 0x7f8b2809e410 2023-10-01T07:55:57.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.890+0000 7f8b27fff700 1 -- 172.21.15.26:0/1961510806 >> v2:172.21.15.26:3300/0 conn(0x7f8b2809e000 msgr2=0x7f8b281339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:57.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.890+0000 7f8b27fff700 1 --2- 172.21.15.26:0/1961510806 >> v2:172.21.15.26:3300/0 conn(0x7f8b2809e000 0x7f8b281339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:57.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.890+0000 7f8b27fff700 1 -- 172.21.15.26:0/1961510806 >> v1:172.21.15.26:6789/0 conn(0x7f8b2809e410 legacy=0x7f8b28133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:57.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.890+0000 7f8b27fff700 1 -- 172.21.15.26:0/1961510806 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2809a500 con 0x7f8b2809d6f0 2023-10-01T07:55:57.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.890+0000 7f8b27fff700 1 --2- 172.21.15.26:0/1961510806 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b2809d6f0 0x7f8b2809dac0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8b18009870 tx=0x7f8b18009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4608ab03ae0587f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:57.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.890+0000 7f8b26ffd700 1 -- 172.21.15.26:0/1961510806 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b18011830 con 0x7f8b2809d6f0 2023-10-01T07:55:57.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.890+0000 7f8b26ffd700 1 -- 172.21.15.26:0/1961510806 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b18011990 con 0x7f8b2809d6f0 2023-10-01T07:55:57.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.890+0000 7f8b26ffd700 1 -- 172.21.15.26:0/1961510806 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b18011d20 con 0x7f8b2809d6f0 2023-10-01T07:55:57.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.891+0000 7f8b2e6c7700 1 -- 172.21.15.26:0/1961510806 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b2809d6f0 msgr2=0x7f8b2809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:57.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.891+0000 7f8b2e6c7700 1 --2- 172.21.15.26:0/1961510806 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b2809d6f0 0x7f8b2809dac0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8b18009870 tx=0x7f8b18009b80 comp rx=0 tx=0).stop 2023-10-01T07:55:57.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.891+0000 7f8b2e6c7700 1 -- 172.21.15.26:0/1961510806 shutdown_connections 2023-10-01T07:55:57.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.891+0000 7f8b2e6c7700 1 --2- 172.21.15.26:0/1961510806 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b2809d6f0 0x7f8b2809dac0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:57.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.891+0000 7f8b2e6c7700 1 --2- 172.21.15.26:0/1961510806 >> v2:172.21.15.26:3300/0 conn(0x7f8b2809e000 0x7f8b281339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:57.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.892+0000 7f8b2e6c7700 1 -- 172.21.15.26:0/1961510806 >> 172.21.15.26:0/1961510806 conn(0x7f8b28066f50 msgr2=0x7f8b2809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:57.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.892+0000 7f8b2e6c7700 1 -- 172.21.15.26:0/1961510806 shutdown_connections 2023-10-01T07:55:57.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.892+0000 7f8b2e6c7700 1 -- 172.21.15.26:0/1961510806 wait complete. 2023-10-01T07:55:57.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.893+0000 7f8b2e6c7700 1 Processor -- start 2023-10-01T07:55:57.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.893+0000 7f8b2e6c7700 1 -- start start 2023-10-01T07:55:57.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.894+0000 7f8b2e6c7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b2809d6f0 0x7f8b281c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:57.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.894+0000 7f8b2e6c7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b2809e000 0x7f8b281c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:57.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.894+0000 7f8b2e6c7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b2809e410 0x7f8b281c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:57.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.894+0000 7f8b2e6c7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b281a65a0 con 0x7f8b2809e410 2023-10-01T07:55:57.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.894+0000 7f8b2e6c7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b281a63b0 con 0x7f8b2809d6f0 2023-10-01T07:55:57.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.894+0000 7f8b2e6c7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b281a82c0 con 0x7f8b2809e000 2023-10-01T07:55:57.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.894+0000 7f8b27fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b2809d6f0 0x7f8b281c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:57.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.894+0000 7f8b277fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b2809e000 0x7f8b281c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:57.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.894+0000 7f8b27fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b2809d6f0 0x7f8b281c8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55344/0 (socket says 172.21.15.26:55344) 2023-10-01T07:55:57.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.894+0000 7f8b27fff700 1 -- 172.21.15.26:0/2769938978 learned_addr learned my addr 172.21.15.26:0/2769938978 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:57.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.894+0000 7f8b277fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b2809e000 0x7f8b281c8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:58370/0 (socket says 172.21.15.26:58370) 2023-10-01T07:55:57.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.894+0000 7f8b2cc64700 1 --2- 172.21.15.26:0/2769938978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b2809e410 0x7f8b281c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:57.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.895+0000 7f8b277fe700 1 -- 172.21.15.26:0/2769938978 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b2809d6f0 msgr2=0x7f8b281c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:57.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.895+0000 7f8b277fe700 1 --2- 172.21.15.26:0/2769938978 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b2809d6f0 0x7f8b281c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:57.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.895+0000 7f8b277fe700 1 -- 172.21.15.26:0/2769938978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b2809e410 msgr2=0x7f8b281c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:57.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.895+0000 7f8b277fe700 1 --2- 172.21.15.26:0/2769938978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b2809e410 0x7f8b281c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:57.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.895+0000 7f8b277fe700 1 -- 172.21.15.26:0/2769938978 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b180094a0 con 0x7f8b2809e000 2023-10-01T07:55:57.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.895+0000 7f8b277fe700 1 --2- 172.21.15.26:0/2769938978 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b2809e000 0x7f8b281c8580 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c00e8d0 tx=0x7f8b1c00ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:57.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.895+0000 7f8b24ff9700 1 -- 172.21.15.26:0/2769938978 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c013680 con 0x7f8b2809e000 2023-10-01T07:55:57.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.895+0000 7f8b24ff9700 1 -- 172.21.15.26:0/2769938978 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1c0137e0 con 0x7f8b2809e000 2023-10-01T07:55:57.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.895+0000 7f8b2e6c7700 1 -- 172.21.15.26:0/2769938978 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b280a2f40 con 0x7f8b2809e000 2023-10-01T07:55:57.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.895+0000 7f8b24ff9700 1 -- 172.21.15.26:0/2769938978 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c013b50 con 0x7f8b2809e000 2023-10-01T07:55:57.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.895+0000 7f8b2e6c7700 1 -- 172.21.15.26:0/2769938978 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b2809c760 con 0x7f8b2809e000 2023-10-01T07:55:57.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.896+0000 7f8b24ff9700 1 -- 172.21.15.26:0/2769938978 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8b1c013cb0 con 0x7f8b2809e000 2023-10-01T07:55:57.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.896+0000 7f8b24ff9700 1 -- 172.21.15.26:0/2769938978 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8b1c03f9d0 con 0x7f8b2809e000 2023-10-01T07:55:57.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.897+0000 7f8b2e6c7700 1 -- 172.21.15.26:0/2769938978 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b281a7c80 con 0x7f8b2809e000 2023-10-01T07:55:57.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:57.906+0000 7f8b24ff9700 1 -- 172.21.15.26:0/2769938978 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8b281a7c80 con 0x7f8b2809e000 2023-10-01T07:55:58.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.044+0000 7f36febc6700 1 -- 172.21.15.26:0/3306862608 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f36f8074ea0 con 0x7f36f8136f50 2023-10-01T07:55:58.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.045+0000 7f36f57fa700 1 -- 172.21.15.26:0/3306862608 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f36f001f030 con 0x7f36f8136f50 2023-10-01T07:55:58.046 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:58.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.048+0000 7f36febc6700 1 -- 172.21.15.26:0/3306862608 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36f8136f50 msgr2=0x7f36f8118cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:58.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.048+0000 7f36febc6700 1 --2- 172.21.15.26:0/3306862608 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36f8136f50 0x7f36f8118cd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f36f0010f60 tx=0x7f36f0010f90 comp rx=0 tx=0).stop 2023-10-01T07:55:58.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.048+0000 7f36febc6700 1 -- 172.21.15.26:0/3306862608 shutdown_connections 2023-10-01T07:55:58.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.048+0000 7f36febc6700 1 --2- 172.21.15.26:0/3306862608 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f36f8136f50 0x7f36f8118cd0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:58.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.048+0000 7f36febc6700 1 --2- 172.21.15.26:0/3306862608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36f8131630 0x7f36f81c62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:58.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.048+0000 7f36febc6700 1 --2- 172.21.15.26:0/3306862608 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f36f8134630 0x7f36f81c67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:58.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.048+0000 7f36febc6700 1 -- 172.21.15.26:0/3306862608 >> 172.21.15.26:0/3306862608 conn(0x7f36f80a2aa0 msgr2=0x7f36f8132410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:58.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.050+0000 7f36febc6700 1 -- 172.21.15.26:0/3306862608 shutdown_connections 2023-10-01T07:55:58.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.050+0000 7f36febc6700 1 -- 172.21.15.26:0/3306862608 wait complete. 2023-10-01T07:55:58.064 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:58.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.075+0000 7f6feb982700 1 -- 172.21.15.26:0/1327424177 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6fe4074ea0 con 0x7f6fe409e410 2023-10-01T07:55:58.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.076+0000 7f6fd9ffb700 1 -- 172.21.15.26:0/1327424177 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6fdc017020 con 0x7f6fe409e410 2023-10-01T07:55:58.076 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:58.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.078+0000 7f6feb982700 1 -- 172.21.15.26:0/1327424177 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fe409e410 msgr2=0x7f6fe41a69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:58.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.078+0000 7f6feb982700 1 --2- 172.21.15.26:0/1327424177 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fe409e410 0x7f6fe41a69d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00c7a0 tx=0x7f6fdc00cab0 comp rx=0 tx=0).stop 2023-10-01T07:55:58.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.078+0000 7f6feb982700 1 -- 172.21.15.26:0/1327424177 shutdown_connections 2023-10-01T07:55:58.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.078+0000 7f6feb982700 1 --2- 172.21.15.26:0/1327424177 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fe409e410 0x7f6fe41a69d0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:58.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.078+0000 7f6feb982700 1 --2- 172.21.15.26:0/1327424177 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6fe409d6f0 0x7f6fe41a5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:58.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.078+0000 7f6feb982700 1 --2- 172.21.15.26:0/1327424177 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6fe409e000 0x7f6fe41a6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:58.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.078+0000 7f6feb982700 1 -- 172.21.15.26:0/1327424177 >> 172.21.15.26:0/1327424177 conn(0x7f6fe4066f50 msgr2=0x7f6fe40a2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:58.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.078+0000 7f6feb982700 1 -- 172.21.15.26:0/1327424177 shutdown_connections 2023-10-01T07:55:58.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.078+0000 7f6feb982700 1 -- 172.21.15.26:0/1327424177 wait complete. 2023-10-01T07:55:58.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.082+0000 7facb1fb3700 1 -- 172.21.15.26:0/978681700 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7facac12fd50 con 0x7facac12cf60 2023-10-01T07:55:58.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.082+0000 7faca8ff9700 1 -- 172.21.15.26:0/978681700 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fac9c015070 con 0x7facac12cf60 2023-10-01T07:55:58.083 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:58.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.085+0000 7facb1fb3700 1 -- 172.21.15.26:0/978681700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facac12cf60 msgr2=0x7facac11d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:58.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.085+0000 7facb1fb3700 1 --2- 172.21.15.26:0/978681700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facac12cf60 0x7facac11d0e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fac9c00b530 tx=0x7fac9c00b840 comp rx=0 tx=0).stop 2023-10-01T07:55:58.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.085+0000 7facb1fb3700 1 -- 172.21.15.26:0/978681700 shutdown_connections 2023-10-01T07:55:58.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.085+0000 7facb1fb3700 1 --2- 172.21.15.26:0/978681700 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7facac130260 0x7facac11db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:58.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.085+0000 7facb1fb3700 1 --2- 172.21.15.26:0/978681700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facac12cf60 0x7facac11d0e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:58.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.085+0000 7facb1fb3700 1 --2- 172.21.15.26:0/978681700 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7facac12f8b0 0x7facac11d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:58.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.085+0000 7facb1fb3700 1 -- 172.21.15.26:0/978681700 >> 172.21.15.26:0/978681700 conn(0x7facac0a2aa0 msgr2=0x7facac1294d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:58.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.085+0000 7facb1fb3700 1 -- 172.21.15.26:0/978681700 shutdown_connections 2023-10-01T07:55:58.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.085+0000 7facb1fb3700 1 -- 172.21.15.26:0/978681700 wait complete. 2023-10-01T07:55:58.093 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:58.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:58.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.115+0000 7f8b2e6c7700 1 -- 172.21.15.26:0/2769938978 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8b281a7c80 con 0x7f8b2809e000 2023-10-01T07:55:58.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.115+0000 7f8b24ff9700 1 -- 172.21.15.26:0/2769938978 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8b281a7c80 con 0x7f8b2809e000 2023-10-01T07:55:58.116 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:58.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.118+0000 7f8b2e6c7700 1 -- 172.21.15.26:0/2769938978 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b2809e000 msgr2=0x7f8b281c8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:58.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.118+0000 7f8b2e6c7700 1 --2- 172.21.15.26:0/2769938978 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b2809e000 0x7f8b281c8580 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c00e8d0 tx=0x7f8b1c00ebe0 comp rx=0 tx=0).stop 2023-10-01T07:55:58.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.118+0000 7f8b2e6c7700 1 -- 172.21.15.26:0/2769938978 shutdown_connections 2023-10-01T07:55:58.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.118+0000 7f8b2e6c7700 1 --2- 172.21.15.26:0/2769938978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b2809e410 0x7f8b281c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:58.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.118+0000 7f8b2e6c7700 1 --2- 172.21.15.26:0/2769938978 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b2809d6f0 0x7f8b281c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:58.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.118+0000 7f8b2e6c7700 1 --2- 172.21.15.26:0/2769938978 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b2809e000 0x7f8b281c8580 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:58.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.118+0000 7f8b2e6c7700 1 -- 172.21.15.26:0/2769938978 >> 172.21.15.26:0/2769938978 conn(0x7f8b28066f50 msgr2=0x7f8b281bbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:58.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.118+0000 7f8b2e6c7700 1 -- 172.21.15.26:0/2769938978 shutdown_connections 2023-10-01T07:55:58.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:58.118+0000 7f8b2e6c7700 1 -- 172.21.15.26:0/2769938978 wait complete. 2023-10-01T07:55:58.132 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:55:59.065 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:55:59.094 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:55:59.101 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:55:59.133 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:55:59.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.225+0000 7f1f5a3db700 1 Processor -- start 2023-10-01T07:55:59.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.225+0000 7f1f5a3db700 1 -- start start 2023-10-01T07:55:59.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.226+0000 7f1f5a3db700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1f5409d6f0 0x7f1f5409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:59.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.226+0000 7f1f5a3db700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1f5409e410 0x7f1f54134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:59.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.226+0000 7f1f5a3db700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f5409b120 con 0x7f1f5409e000 2023-10-01T07:55:59.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.226+0000 7f1f5a3db700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5406b460 con 0x7f1f5409e410 2023-10-01T07:55:59.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.226+0000 7f1f5a3db700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5409a7e0 con 0x7f1f5409d6f0 2023-10-01T07:55:59.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.226+0000 7f1f53fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1f5409d6f0 0x7f1f5409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:59.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.226+0000 7f1f53fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1f5409d6f0 0x7f1f5409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:58380/0 (socket says 172.21.15.26:58380) 2023-10-01T07:55:59.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.226+0000 7f1f53fff700 1 -- 172.21.15.26:0/4002738750 learned_addr learned my addr 172.21.15.26:0/4002738750 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:59.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.226+0000 7f1f53fff700 1 -- 172.21.15.26:0/4002738750 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1f5409e410 msgr2=0x7f1f54134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:59.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.226+0000 7f1f53fff700 1 --2- 172.21.15.26:0/4002738750 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1f5409e410 0x7f1f54134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:59.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.226+0000 7f1f53fff700 1 -- 172.21.15.26:0/4002738750 >> v1:172.21.15.26:6789/0 conn(0x7f1f5409e000 legacy=0x7f1f541339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:59.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.226+0000 7f1f53fff700 1 -- 172.21.15.26:0/4002738750 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5409a500 con 0x7f1f5409d6f0 2023-10-01T07:55:59.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.227+0000 7f1f53fff700 1 --2- 172.21.15.26:0/4002738750 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1f5409d6f0 0x7f1f5409dac0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1f44009950 tx=0x7f1f44009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d0f9785a10c20ab server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:59.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.227+0000 7f1f52ffd700 1 -- 172.21.15.26:0/4002738750 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f44009ea0 con 0x7f1f5409d6f0 2023-10-01T07:55:59.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.227+0000 7f1f52ffd700 1 -- 172.21.15.26:0/4002738750 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f44004230 con 0x7f1f5409d6f0 2023-10-01T07:55:59.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.227+0000 7f1f52ffd700 1 -- 172.21.15.26:0/4002738750 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4400b7e0 con 0x7f1f5409d6f0 2023-10-01T07:55:59.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.228+0000 7f1f5a3db700 1 -- 172.21.15.26:0/4002738750 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1f5409d6f0 msgr2=0x7f1f5409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:59.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.228+0000 7f1f5a3db700 1 --2- 172.21.15.26:0/4002738750 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1f5409d6f0 0x7f1f5409dac0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1f44009950 tx=0x7f1f44009c60 comp rx=0 tx=0).stop 2023-10-01T07:55:59.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.228+0000 7f1f5a3db700 1 -- 172.21.15.26:0/4002738750 shutdown_connections 2023-10-01T07:55:59.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.228+0000 7f1f5a3db700 1 --2- 172.21.15.26:0/4002738750 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1f5409d6f0 0x7f1f5409dac0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:59.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.228+0000 7f1f5a3db700 1 --2- 172.21.15.26:0/4002738750 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1f5409e410 0x7f1f54134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:59.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.228+0000 7f1f5a3db700 1 -- 172.21.15.26:0/4002738750 >> 172.21.15.26:0/4002738750 conn(0x7f1f54066f50 msgr2=0x7f1f5409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:59.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.228+0000 7f1f5a3db700 1 -- 172.21.15.26:0/4002738750 shutdown_connections 2023-10-01T07:55:59.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.228+0000 7f1f5a3db700 1 -- 172.21.15.26:0/4002738750 wait complete. 2023-10-01T07:55:59.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.230+0000 7f1f5a3db700 1 Processor -- start 2023-10-01T07:55:59.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.230+0000 7f1f5a3db700 1 -- start start 2023-10-01T07:55:59.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.231+0000 7f1f5a3db700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1f5409d6f0 0x7f1f541228d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:59.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.231+0000 7f1f5a3db700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f5409e000 0x7f1f54122e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:59.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.231+0000 7f1f5a3db700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1f5409e410 0x7f1f54123350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:59.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.231+0000 7f1f5a3db700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f54126360 con 0x7f1f5409e000 2023-10-01T07:55:59.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.231+0000 7f1f5a3db700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f54133340 con 0x7f1f5409e410 2023-10-01T07:55:59.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.231+0000 7f1f5a3db700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f541244f0 con 0x7f1f5409d6f0 2023-10-01T07:55:59.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.231+0000 7f1f53fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1f5409d6f0 0x7f1f541228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:59.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.231+0000 7f1f53fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1f5409d6f0 0x7f1f541228d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:58390/0 (socket says 172.21.15.26:58390) 2023-10-01T07:55:59.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.231+0000 7f1f53fff700 1 -- 172.21.15.26:0/3890063508 learned_addr learned my addr 172.21.15.26:0/3890063508 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:59.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.231+0000 7f1f53fff700 1 -- 172.21.15.26:0/3890063508 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1f5409e410 msgr2=0x7f1f54123350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:59.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.231+0000 7f1f53fff700 1 --2- 172.21.15.26:0/3890063508 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1f5409e410 0x7f1f54123350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:59.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.231+0000 7f1f53fff700 1 -- 172.21.15.26:0/3890063508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f5409e000 msgr2=0x7f1f54122e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:59.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.231+0000 7f1f53fff700 1 --2- 172.21.15.26:0/3890063508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f5409e000 0x7f1f54122e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:59.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.231+0000 7f1f53fff700 1 -- 172.21.15.26:0/3890063508 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f44009550 con 0x7f1f5409d6f0 2023-10-01T07:55:59.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.232+0000 7f1f53fff700 1 --2- 172.21.15.26:0/3890063508 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1f5409d6f0 0x7f1f541228d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1f44009920 tx=0x7f1f44004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:59.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.232+0000 7f1f50ff9700 1 -- 172.21.15.26:0/3890063508 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f440036a0 con 0x7f1f5409d6f0 2023-10-01T07:55:59.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.232+0000 7f1f50ff9700 1 -- 172.21.15.26:0/3890063508 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4401f070 con 0x7f1f5409d6f0 2023-10-01T07:55:59.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.232+0000 7f1f50ff9700 1 -- 172.21.15.26:0/3890063508 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f44003a60 con 0x7f1f5409d6f0 2023-10-01T07:55:59.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.232+0000 7f1f5a3db700 1 -- 172.21.15.26:0/3890063508 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f540a1d90 con 0x7f1f5409d6f0 2023-10-01T07:55:59.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.232+0000 7f1f5a3db700 1 -- 172.21.15.26:0/3890063508 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f54125dc0 con 0x7f1f5409d6f0 2023-10-01T07:55:59.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.233+0000 7f1f50ff9700 1 -- 172.21.15.26:0/3890063508 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1f44021030 con 0x7f1f5409d6f0 2023-10-01T07:55:59.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.233+0000 7f1f5a3db700 1 -- 172.21.15.26:0/3890063508 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f54125fb0 con 0x7f1f5409d6f0 2023-10-01T07:55:59.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.233+0000 7f1f50ff9700 1 -- 172.21.15.26:0/3890063508 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1f44040e40 con 0x7f1f5409d6f0 2023-10-01T07:55:59.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.242+0000 7f1f50ff9700 1 -- 172.21.15.26:0/3890063508 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f440233d0 con 0x7f1f5409d6f0 2023-10-01T07:55:59.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.261+0000 7fea3a401700 1 Processor -- start 2023-10-01T07:55:59.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.261+0000 7fea3a401700 1 -- start start 2023-10-01T07:55:59.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.262+0000 7fea3a401700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fea3409de00 0x7fea3409e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:59.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.262+0000 7fea3a401700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea3413d1f0 0x7fea3413f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:59.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.262+0000 7fea3a401700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea3409a810 con 0x7fea3406a770 2023-10-01T07:55:59.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.262+0000 7fea3a401700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea3406ab40 con 0x7fea3413d1f0 2023-10-01T07:55:59.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.262+0000 7fea3a401700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea3409ebc0 con 0x7fea3409de00 2023-10-01T07:55:59.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.262+0000 7fea3899e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea3413d1f0 0x7fea3413f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:59.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.262+0000 7fea3899e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea3413d1f0 0x7fea3413f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55374/0 (socket says 172.21.15.26:55374) 2023-10-01T07:55:59.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.262+0000 7fea33fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fea3406a770 0x7fea3409d6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49018/0 (socket says 172.21.15.26:49018) 2023-10-01T07:55:59.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.262+0000 7fea3899e700 1 -- 172.21.15.26:0/872847205 learned_addr learned my addr 172.21.15.26:0/872847205 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:59.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.262+0000 7fea337fe700 1 --2- 172.21.15.26:0/872847205 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fea3409de00 0x7fea3409e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:59.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.262+0000 7fea3899e700 1 -- 172.21.15.26:0/872847205 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fea3409de00 msgr2=0x7fea3409e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:59.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.262+0000 7fea3899e700 1 --2- 172.21.15.26:0/872847205 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fea3409de00 0x7fea3409e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:59.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.262+0000 7fea3899e700 1 -- 172.21.15.26:0/872847205 >> v1:172.21.15.26:6789/0 conn(0x7fea3406a770 legacy=0x7fea3409d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:59.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.262+0000 7fea32ffd700 1 -- 172.21.15.26:0/872847205 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1258525708 0 0) 0x7fea3409a810 con 0x7fea3406a770 2023-10-01T07:55:59.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.263+0000 7fea3899e700 1 -- 172.21.15.26:0/872847205 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea3409e920 con 0x7fea3413d1f0 2023-10-01T07:55:59.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.263+0000 7fea3899e700 1 --2- 172.21.15.26:0/872847205 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea3413d1f0 0x7fea3413f5d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fea2c009e80 tx=0x7fea2c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81601f5b95d73333 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:59.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.263+0000 7fea32ffd700 1 -- 172.21.15.26:0/872847205 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2c00e070 con 0x7fea3413d1f0 2023-10-01T07:55:59.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.263+0000 7fea32ffd700 1 -- 172.21.15.26:0/872847205 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2c00b9c0 con 0x7fea3413d1f0 2023-10-01T07:55:59.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.263+0000 7fea32ffd700 1 -- 172.21.15.26:0/872847205 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2c00bd70 con 0x7fea3413d1f0 2023-10-01T07:55:59.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.264+0000 7fea3a401700 1 -- 172.21.15.26:0/872847205 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea3413d1f0 msgr2=0x7fea3413f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:59.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.264+0000 7fea3a401700 1 --2- 172.21.15.26:0/872847205 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea3413d1f0 0x7fea3413f5d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fea2c009e80 tx=0x7fea2c00b330 comp rx=0 tx=0).stop 2023-10-01T07:55:59.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.264+0000 7fea3a401700 1 -- 172.21.15.26:0/872847205 shutdown_connections 2023-10-01T07:55:59.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.264+0000 7fea3a401700 1 --2- 172.21.15.26:0/872847205 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea3413d1f0 0x7fea3413f5d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:59.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.264+0000 7fea3a401700 1 --2- 172.21.15.26:0/872847205 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fea3409de00 0x7fea3409e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:59.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.264+0000 7fea3a401700 1 -- 172.21.15.26:0/872847205 >> 172.21.15.26:0/872847205 conn(0x7fea34066f50 msgr2=0x7fea3409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:59.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.264+0000 7fea3a401700 1 -- 172.21.15.26:0/872847205 shutdown_connections 2023-10-01T07:55:59.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.264+0000 7fea3a401700 1 -- 172.21.15.26:0/872847205 wait complete. 2023-10-01T07:55:59.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.265+0000 7fea3a401700 1 Processor -- start 2023-10-01T07:55:59.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.265+0000 7fea3a401700 1 -- start start 2023-10-01T07:55:59.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.266+0000 7fea3a401700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea3406a770 0x7fea341260a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:59.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.266+0000 7fea3a401700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea3409de00 0x7fea341265e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:59.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.266+0000 7fea3a401700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fea3413d1f0 0x7fea34126b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:59.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.266+0000 7fea3a401700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea34129000 con 0x7fea3409de00 2023-10-01T07:55:59.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.266+0000 7fea3a401700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea3409f1a0 con 0x7fea3406a770 2023-10-01T07:55:59.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.266+0000 7fea3a401700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea34128390 con 0x7fea3413d1f0 2023-10-01T07:55:59.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.266+0000 7fea337fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea3409de00 0x7fea341265e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:59.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.266+0000 7fea33fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea3406a770 0x7fea341260a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:59.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.266+0000 7fea337fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea3409de00 0x7fea341265e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54386/0 (socket says 172.21.15.26:54386) 2023-10-01T07:55:59.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.266+0000 7fea33fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea3406a770 0x7fea341260a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55378/0 (socket says 172.21.15.26:55378) 2023-10-01T07:55:59.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.266+0000 7fea337fe700 1 -- 172.21.15.26:0/1585251029 learned_addr learned my addr 172.21.15.26:0/1585251029 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:59.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.266+0000 7fea3899e700 1 --2- 172.21.15.26:0/1585251029 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fea3413d1f0 0x7fea34126b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:59.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.267+0000 7fea33fff700 1 -- 172.21.15.26:0/1585251029 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fea3413d1f0 msgr2=0x7fea34126b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:59.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.267+0000 7fea33fff700 1 --2- 172.21.15.26:0/1585251029 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fea3413d1f0 0x7fea34126b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:59.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.267+0000 7fea33fff700 1 -- 172.21.15.26:0/1585251029 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea3409de00 msgr2=0x7fea341265e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:59.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.267+0000 7fea33fff700 1 --2- 172.21.15.26:0/1585251029 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea3409de00 0x7fea341265e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:59.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.267+0000 7fea33fff700 1 -- 172.21.15.26:0/1585251029 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea2c009b30 con 0x7fea3406a770 2023-10-01T07:55:59.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.267+0000 7fea33fff700 1 --2- 172.21.15.26:0/1585251029 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea3406a770 0x7fea341260a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fea2400c4a0 tx=0x7fea2400c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:59.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.267+0000 7fea30ff9700 1 -- 172.21.15.26:0/1585251029 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea24004c80 con 0x7fea3406a770 2023-10-01T07:55:59.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.267+0000 7fea30ff9700 1 -- 172.21.15.26:0/1585251029 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea24004de0 con 0x7fea3406a770 2023-10-01T07:55:59.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.267+0000 7fea30ff9700 1 -- 172.21.15.26:0/1585251029 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea24007310 con 0x7fea3406a770 2023-10-01T07:55:59.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.267+0000 7fea3a401700 1 -- 172.21.15.26:0/1585251029 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea34127940 con 0x7fea3406a770 2023-10-01T07:55:59.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.267+0000 7fea3a401700 1 -- 172.21.15.26:0/1585251029 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea3413cf20 con 0x7fea3406a770 2023-10-01T07:55:59.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.268+0000 7fea30ff9700 1 -- 172.21.15.26:0/1585251029 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fea24007470 con 0x7fea3406a770 2023-10-01T07:55:59.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.268+0000 7fea30ff9700 1 -- 172.21.15.26:0/1585251029 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fea2403f240 con 0x7fea3406a770 2023-10-01T07:55:59.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.269+0000 7fea3a401700 1 -- 172.21.15.26:0/1585251029 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea34071ff0 con 0x7fea3406a770 2023-10-01T07:55:59.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.276+0000 7f110aa14700 1 Processor -- start 2023-10-01T07:55:59.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.276+0000 7f110aa14700 1 -- start start 2023-10-01T07:55:59.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.277+0000 7f110aa14700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f110409d6f0 0x7f110409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:59.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.277+0000 7f110aa14700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f110409e000 0x7f11041339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:59.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.277+0000 7f110aa14700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f110409b120 con 0x7f110409e410 2023-10-01T07:55:59.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.277+0000 7f110aa14700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f110406b460 con 0x7f110409e000 2023-10-01T07:55:59.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.277+0000 7f110aa14700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f110409a7e0 con 0x7f110409d6f0 2023-10-01T07:55:59.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.277+0000 7f1103fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f110409d6f0 0x7f110409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:59.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.277+0000 7f11037fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f110409e000 0x7f11041339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:59.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.277+0000 7f1103fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f110409d6f0 0x7f110409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:58412/0 (socket says 172.21.15.26:58412) 2023-10-01T07:55:59.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.277+0000 7f11037fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f110409e000 0x7f11041339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54390/0 (socket says 172.21.15.26:54390) 2023-10-01T07:55:59.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.277+0000 7f1103fff700 1 -- 172.21.15.26:0/3269997065 learned_addr learned my addr 172.21.15.26:0/3269997065 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:59.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.278+0000 7f11037fe700 1 -- 172.21.15.26:0/3269997065 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f110409d6f0 msgr2=0x7f110409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:59.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.278+0000 7f11037fe700 1 --2- 172.21.15.26:0/3269997065 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f110409d6f0 0x7f110409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:59.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.278+0000 7f11037fe700 1 -- 172.21.15.26:0/3269997065 >> v1:172.21.15.26:6789/0 conn(0x7f110409e410 legacy=0x7f1104133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:59.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.278+0000 7f11037fe700 1 -- 172.21.15.26:0/3269997065 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110409a500 con 0x7f110409e000 2023-10-01T07:55:59.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.278+0000 7f1103fff700 1 --2- 172.21.15.26:0/3269997065 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f110409d6f0 0x7f110409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:59.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.278+0000 7f11037fe700 1 --2- 172.21.15.26:0/3269997065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f110409e000 0x7f11041339f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f10f8009840 tx=0x7f10f8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da70c4b559452d85 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:59.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.278+0000 7f1102ffd700 1 -- 172.21.15.26:0/3269997065 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f8011830 con 0x7f110409e000 2023-10-01T07:55:59.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.278+0000 7f1102ffd700 1 -- 172.21.15.26:0/3269997065 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f8011990 con 0x7f110409e000 2023-10-01T07:55:59.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.278+0000 7f1102ffd700 1 -- 172.21.15.26:0/3269997065 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f8011d20 con 0x7f110409e000 2023-10-01T07:55:59.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.278+0000 7fea30ff9700 1 -- 172.21.15.26:0/1585251029 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fea24007720 con 0x7fea3406a770 2023-10-01T07:55:59.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.279+0000 7f110aa14700 1 -- 172.21.15.26:0/3269997065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f110409e000 msgr2=0x7f11041339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:59.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.279+0000 7f110aa14700 1 --2- 172.21.15.26:0/3269997065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f110409e000 0x7f11041339f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f10f8009840 tx=0x7f10f8009b50 comp rx=0 tx=0).stop 2023-10-01T07:55:59.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.279+0000 7f110aa14700 1 -- 172.21.15.26:0/3269997065 shutdown_connections 2023-10-01T07:55:59.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.279+0000 7f110aa14700 1 --2- 172.21.15.26:0/3269997065 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f110409d6f0 0x7f110409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:59.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.279+0000 7f110aa14700 1 --2- 172.21.15.26:0/3269997065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f110409e000 0x7f11041339f0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:59.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.279+0000 7f110aa14700 1 -- 172.21.15.26:0/3269997065 >> 172.21.15.26:0/3269997065 conn(0x7f1104066f50 msgr2=0x7f110409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:59.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.279+0000 7f110aa14700 1 -- 172.21.15.26:0/3269997065 shutdown_connections 2023-10-01T07:55:59.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.279+0000 7f110aa14700 1 -- 172.21.15.26:0/3269997065 wait complete. 2023-10-01T07:55:59.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.281+0000 7f110aa14700 1 Processor -- start 2023-10-01T07:55:59.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.281+0000 7f110aa14700 1 -- start start 2023-10-01T07:55:59.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.282+0000 7f110aa14700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f110409d6f0 0x7f11041a5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:59.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.282+0000 7f110aa14700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f110409e000 0x7f11041a6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:59.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.282+0000 7f110aa14700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f110409e410 0x7f11041a6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:59.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.282+0000 7f110aa14700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11041a91f0 con 0x7f110409e410 2023-10-01T07:55:59.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.282+0000 7f110aa14700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110409c710 con 0x7f110409e000 2023-10-01T07:55:59.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.282+0000 7f110aa14700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11040a3160 con 0x7f110409d6f0 2023-10-01T07:55:59.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.282+0000 7f11037fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f110409e000 0x7f11041a6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:59.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.282+0000 7f11037fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f110409e000 0x7f11041a6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55384/0 (socket says 172.21.15.26:55384) 2023-10-01T07:55:59.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.282+0000 7f11037fe700 1 -- 172.21.15.26:0/1164061079 learned_addr learned my addr 172.21.15.26:0/1164061079 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:59.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.282+0000 7f11037fe700 1 -- 172.21.15.26:0/1164061079 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f110409d6f0 msgr2=0x7f11041a5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:59.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.282+0000 7f11037fe700 1 --2- 172.21.15.26:0/1164061079 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f110409d6f0 0x7f11041a5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:59.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.282+0000 7f11037fe700 1 -- 172.21.15.26:0/1164061079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f110409e410 msgr2=0x7f11041a6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:59.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.282+0000 7f11037fe700 1 --2- 172.21.15.26:0/1164061079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f110409e410 0x7f11041a6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:59.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.282+0000 7f11037fe700 1 -- 172.21.15.26:0/1164061079 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f4009550 con 0x7f110409e000 2023-10-01T07:55:59.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.283+0000 7f11037fe700 1 --2- 172.21.15.26:0/1164061079 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f110409e000 0x7f11041a6510 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f10f8009fd0 tx=0x7f10f8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:59.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.283+0000 7f1100ff9700 1 -- 172.21.15.26:0/1164061079 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f80038a0 con 0x7f110409e000 2023-10-01T07:55:59.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.283+0000 7f1100ff9700 1 -- 172.21.15.26:0/1164061079 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f801f070 con 0x7f110409e000 2023-10-01T07:55:59.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.283+0000 7f1100ff9700 1 -- 172.21.15.26:0/1164061079 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f8003c40 con 0x7f110409e000 2023-10-01T07:55:59.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.283+0000 7f110aa14700 1 -- 172.21.15.26:0/1164061079 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f80094a0 con 0x7f110409e000 2023-10-01T07:55:59.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.283+0000 7f110aa14700 1 -- 172.21.15.26:0/1164061079 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11041a8da0 con 0x7f110409e000 2023-10-01T07:55:59.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.284+0000 7f110aa14700 1 -- 172.21.15.26:0/1164061079 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11041a9600 con 0x7f110409e000 2023-10-01T07:55:59.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.284+0000 7f1100ff9700 1 -- 172.21.15.26:0/1164061079 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f10f8026480 con 0x7f110409e000 2023-10-01T07:55:59.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.285+0000 7f1100ff9700 1 -- 172.21.15.26:0/1164061079 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f10f8021070 con 0x7f110409e000 2023-10-01T07:55:59.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.289+0000 7f1100ff9700 1 -- 172.21.15.26:0/1164061079 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f10f8010b70 con 0x7f110409e000 2023-10-01T07:55:59.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.312+0000 7f057314b700 1 Processor -- start 2023-10-01T07:55:59.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.313+0000 7f057314b700 1 -- start start 2023-10-01T07:55:59.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.313+0000 7f057314b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f056c136710 0x7f056c138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:59.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.313+0000 7f057314b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f056c139030 0x7f056c13b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:59.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.313+0000 7f057314b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f056c06ef30 con 0x7f056c1338a0 2023-10-01T07:55:59.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.313+0000 7f057314b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f056c06fef0 con 0x7f056c139030 2023-10-01T07:55:59.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.313+0000 7f057314b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f056c1334b0 con 0x7f056c136710 2023-10-01T07:55:59.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.314+0000 7f0570ee7700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f056c1338a0 0x7f056c133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49036/0 (socket says 172.21.15.26:49036) 2023-10-01T07:55:59.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.314+0000 7f0570ee7700 1 -- 172.21.15.26:0/3609463634 learned_addr learned my addr 172.21.15.26:0/3609463634 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:55:59.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.314+0000 7f05716e8700 1 --2- 172.21.15.26:0/3609463634 >> v2:172.21.15.26:3300/0 conn(0x7f056c139030 0x7f056c13b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:59.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.314+0000 7f056bfff700 1 --2- 172.21.15.26:0/3609463634 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f056c136710 0x7f056c138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:59.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.314+0000 7f05716e8700 1 -- 172.21.15.26:0/3609463634 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f056c136710 msgr2=0x7f056c138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:55:59.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.314+0000 7f05716e8700 1 --2- 172.21.15.26:0/3609463634 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f056c136710 0x7f056c138af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:59.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.314+0000 7f05716e8700 1 -- 172.21.15.26:0/3609463634 >> v1:172.21.15.26:6789/0 conn(0x7f056c1338a0 legacy=0x7f056c133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:59.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.314+0000 7f05716e8700 1 -- 172.21.15.26:0/3609463634 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056c06fc30 con 0x7f056c139030 2023-10-01T07:55:59.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.314+0000 7f05716e8700 1 --2- 172.21.15.26:0/3609463634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f056c139030 0x7f056c13b410 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0564009d90 tx=0x7f056400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44cd2bf760cf6791 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:59.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.315+0000 7f056b7fe700 1 -- 172.21.15.26:0/3609463634 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056400e070 con 0x7f056c139030 2023-10-01T07:55:59.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.315+0000 7f056b7fe700 1 -- 172.21.15.26:0/3609463634 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056400bbd0 con 0x7f056c139030 2023-10-01T07:55:59.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.315+0000 7f056b7fe700 1 -- 172.21.15.26:0/3609463634 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0564012430 con 0x7f056c139030 2023-10-01T07:55:59.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.316+0000 7f057314b700 1 -- 172.21.15.26:0/3609463634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f056c139030 msgr2=0x7f056c13b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:59.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.316+0000 7f057314b700 1 --2- 172.21.15.26:0/3609463634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f056c139030 0x7f056c13b410 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0564009d90 tx=0x7f056400b330 comp rx=0 tx=0).stop 2023-10-01T07:55:59.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.316+0000 7f057314b700 1 -- 172.21.15.26:0/3609463634 shutdown_connections 2023-10-01T07:55:59.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.316+0000 7f057314b700 1 --2- 172.21.15.26:0/3609463634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f056c139030 0x7f056c13b410 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:59.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.316+0000 7f057314b700 1 --2- 172.21.15.26:0/3609463634 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f056c136710 0x7f056c138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:59.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.316+0000 7f057314b700 1 -- 172.21.15.26:0/3609463634 >> 172.21.15.26:0/3609463634 conn(0x7f056c0a2aa0 msgr2=0x7f056c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:59.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.316+0000 7f057314b700 1 -- 172.21.15.26:0/3609463634 shutdown_connections 2023-10-01T07:55:59.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.316+0000 7f057314b700 1 -- 172.21.15.26:0/3609463634 wait complete. 2023-10-01T07:55:59.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.317+0000 7f057314b700 1 Processor -- start 2023-10-01T07:55:59.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.317+0000 7f057314b700 1 -- start start 2023-10-01T07:55:59.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.317+0000 7f057314b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f056c1338a0 0x7f056c1c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:59.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.317+0000 7f057314b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f056c136710 0x7f056c1c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:59.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.317+0000 7f057314b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f056c139030 0x7f056c11ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:55:59.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.317+0000 7f057314b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c11e5b0 con 0x7f056c1338a0 2023-10-01T07:55:59.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.318+0000 7f057314b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056c11df20 con 0x7f056c139030 2023-10-01T07:55:59.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.318+0000 7f057314b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f056c11c8a0 con 0x7f056c136710 2023-10-01T07:55:59.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.318+0000 7f0570ee7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f056c1338a0 0x7f056c1c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:59.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.318+0000 7f056bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f056c136710 0x7f056c1c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:55:59.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.318+0000 7f0570ee7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f056c1338a0 0x7f056c1c8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54418/0 (socket says 172.21.15.26:54418) 2023-10-01T07:55:59.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.318+0000 7f056bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f056c136710 0x7f056c1c88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:58434/0 (socket says 172.21.15.26:58434) 2023-10-01T07:55:59.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.318+0000 7f0570ee7700 1 -- 172.21.15.26:0/64725879 learned_addr learned my addr 172.21.15.26:0/64725879 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:55:59.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.318+0000 7f0570ee7700 1 -- 172.21.15.26:0/64725879 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f056c136710 msgr2=0x7f056c1c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:59.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.318+0000 7f0570ee7700 1 --2- 172.21.15.26:0/64725879 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f056c136710 0x7f056c1c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:59.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.318+0000 7f0570ee7700 1 -- 172.21.15.26:0/64725879 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f056c139030 msgr2=0x7f056c11ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:59.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.318+0000 7f0570ee7700 1 --2- 172.21.15.26:0/64725879 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f056c139030 0x7f056c11ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:59.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.318+0000 7f0570ee7700 1 -- 172.21.15.26:0/64725879 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0564009a70 con 0x7f056c1338a0 2023-10-01T07:55:59.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.318+0000 7f056bfff700 1 --2- 172.21.15.26:0/64725879 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f056c136710 0x7f056c1c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:55:59.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.318+0000 7f0570ee7700 1 --2- 172.21.15.26:0/64725879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f056c1338a0 0x7f056c1c8390 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f056000c520 tx=0x7f056000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:55:59.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.319+0000 7f05697fa700 1 -- 172.21.15.26:0/64725879 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0560005d70 con 0x7f056c1338a0 2023-10-01T07:55:59.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.319+0000 7f05697fa700 1 -- 172.21.15.26:0/64725879 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05600070d0 con 0x7f056c1338a0 2023-10-01T07:55:59.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.319+0000 7f057314b700 1 -- 172.21.15.26:0/64725879 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f056c130b60 con 0x7f056c1338a0 2023-10-01T07:55:59.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.319+0000 7f05697fa700 1 -- 172.21.15.26:0/64725879 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0560007440 con 0x7f056c1338a0 2023-10-01T07:55:59.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.319+0000 7f057314b700 1 -- 172.21.15.26:0/64725879 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f056c06f640 con 0x7f056c1338a0 2023-10-01T07:55:59.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.320+0000 7f05697fa700 1 -- 172.21.15.26:0/64725879 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f05600075a0 con 0x7f056c1338a0 2023-10-01T07:55:59.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.320+0000 7f057314b700 1 -- 172.21.15.26:0/64725879 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f056c074ea0 con 0x7f056c1338a0 2023-10-01T07:55:59.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.320+0000 7f05697fa700 1 -- 172.21.15.26:0/64725879 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f056003eaf0 con 0x7f056c1338a0 2023-10-01T07:55:59.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.325+0000 7f05697fa700 1 -- 172.21.15.26:0/64725879 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0560011d70 con 0x7f056c1338a0 2023-10-01T07:55:59.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.472+0000 7f1f5a3db700 1 -- 172.21.15.26:0/3890063508 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1f54125fb0 con 0x7f1f5409d6f0 2023-10-01T07:55:59.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.473+0000 7f1f50ff9700 1 -- 172.21.15.26:0/3890063508 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1f44019bb0 con 0x7f1f5409d6f0 2023-10-01T07:55:59.474 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:55:59.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.476+0000 7f1f5a3db700 1 -- 172.21.15.26:0/3890063508 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1f5409d6f0 msgr2=0x7f1f541228d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:59.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.476+0000 7f1f5a3db700 1 --2- 172.21.15.26:0/3890063508 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1f5409d6f0 0x7f1f541228d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1f44009920 tx=0x7f1f44004750 comp rx=0 tx=0).stop 2023-10-01T07:55:59.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.476+0000 7f1f5a3db700 1 -- 172.21.15.26:0/3890063508 shutdown_connections 2023-10-01T07:55:59.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.476+0000 7f1f5a3db700 1 --2- 172.21.15.26:0/3890063508 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1f5409e410 0x7f1f54123350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:59.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.476+0000 7f1f5a3db700 1 --2- 172.21.15.26:0/3890063508 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1f5409d6f0 0x7f1f541228d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:59.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.476+0000 7f1f5a3db700 1 --2- 172.21.15.26:0/3890063508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f5409e000 0x7f1f54122e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:59.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.476+0000 7f1f5a3db700 1 -- 172.21.15.26:0/3890063508 >> 172.21.15.26:0/3890063508 conn(0x7f1f54066f50 msgr2=0x7f1f5406f330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:59.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.476+0000 7f1f5a3db700 1 -- 172.21.15.26:0/3890063508 shutdown_connections 2023-10-01T07:55:59.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.476+0000 7f1f5a3db700 1 -- 172.21.15.26:0/3890063508 wait complete. 2023-10-01T07:55:59.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.489+0000 7fea3a401700 1 -- 172.21.15.26:0/1585251029 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fea341281d0 con 0x7fea3406a770 2023-10-01T07:55:59.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.489+0000 7fea30ff9700 1 -- 172.21.15.26:0/1585251029 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fea24011e80 con 0x7fea3406a770 2023-10-01T07:55:59.490 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:55:59.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.491+0000 7fea3a401700 1 -- 172.21.15.26:0/1585251029 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea3406a770 msgr2=0x7fea341260a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:59.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.491+0000 7fea3a401700 1 --2- 172.21.15.26:0/1585251029 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea3406a770 0x7fea341260a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fea2400c4a0 tx=0x7fea2400c7b0 comp rx=0 tx=0).stop 2023-10-01T07:55:59.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.492+0000 7fea3a401700 1 -- 172.21.15.26:0/1585251029 shutdown_connections 2023-10-01T07:55:59.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.492+0000 7fea3a401700 1 --2- 172.21.15.26:0/1585251029 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fea3413d1f0 0x7fea34126b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:59.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.492+0000 7fea3a401700 1 --2- 172.21.15.26:0/1585251029 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea3406a770 0x7fea341260a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:59.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.492+0000 7fea3a401700 1 --2- 172.21.15.26:0/1585251029 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea3409de00 0x7fea341265e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:59.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.492+0000 7fea3a401700 1 -- 172.21.15.26:0/1585251029 >> 172.21.15.26:0/1585251029 conn(0x7fea34066f50 msgr2=0x7fea3413f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:59.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.492+0000 7fea3a401700 1 -- 172.21.15.26:0/1585251029 shutdown_connections 2023-10-01T07:55:59.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.492+0000 7fea3a401700 1 -- 172.21.15.26:0/1585251029 wait complete. 2023-10-01T07:55:59.496 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:55:59.507 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:55:59.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.515+0000 7f110aa14700 1 -- 172.21.15.26:0/1164061079 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1104074ea0 con 0x7f110409e000 2023-10-01T07:55:59.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.515+0000 7f1100ff9700 1 -- 172.21.15.26:0/1164061079 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f10f8015070 con 0x7f110409e000 2023-10-01T07:55:59.516 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:55:59.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.518+0000 7f110aa14700 1 -- 172.21.15.26:0/1164061079 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f110409e000 msgr2=0x7f11041a6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:59.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.518+0000 7f110aa14700 1 --2- 172.21.15.26:0/1164061079 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f110409e000 0x7f11041a6510 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f10f8009fd0 tx=0x7f10f8004750 comp rx=0 tx=0).stop 2023-10-01T07:55:59.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.518+0000 7f110aa14700 1 -- 172.21.15.26:0/1164061079 shutdown_connections 2023-10-01T07:55:59.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.518+0000 7f110aa14700 1 --2- 172.21.15.26:0/1164061079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f110409e410 0x7f11041a6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:59.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.518+0000 7f110aa14700 1 --2- 172.21.15.26:0/1164061079 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f110409d6f0 0x7f11041a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:59.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.518+0000 7f110aa14700 1 --2- 172.21.15.26:0/1164061079 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f110409e000 0x7f11041a6510 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:59.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.518+0000 7f110aa14700 1 -- 172.21.15.26:0/1164061079 >> 172.21.15.26:0/1164061079 conn(0x7f1104066f50 msgr2=0x7f11041baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:59.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.518+0000 7f110aa14700 1 -- 172.21.15.26:0/1164061079 shutdown_connections 2023-10-01T07:55:59.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.518+0000 7f110aa14700 1 -- 172.21.15.26:0/1164061079 wait complete. 2023-10-01T07:55:59.532 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:55:59.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.531+0000 7f057314b700 1 -- 172.21.15.26:0/64725879 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f056c06b9e0 con 0x7f056c1338a0 2023-10-01T07:55:59.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.532+0000 7f05697fa700 1 -- 172.21.15.26:0/64725879 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f056003ee60 con 0x7f056c1338a0 2023-10-01T07:55:59.533 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:55:59.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.534+0000 7f057314b700 1 -- 172.21.15.26:0/64725879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f056c1338a0 msgr2=0x7f056c1c8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:55:59.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.534+0000 7f057314b700 1 --2- 172.21.15.26:0/64725879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f056c1338a0 0x7f056c1c8390 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f056000c520 tx=0x7f056000c830 comp rx=0 tx=0).stop 2023-10-01T07:55:59.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.534+0000 7f057314b700 1 -- 172.21.15.26:0/64725879 shutdown_connections 2023-10-01T07:55:59.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.534+0000 7f057314b700 1 --2- 172.21.15.26:0/64725879 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f056c139030 0x7f056c11ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:59.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.534+0000 7f057314b700 1 --2- 172.21.15.26:0/64725879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f056c1338a0 0x7f056c1c8390 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:59.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.534+0000 7f057314b700 1 --2- 172.21.15.26:0/64725879 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f056c136710 0x7f056c1c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:55:59.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.534+0000 7f057314b700 1 -- 172.21.15.26:0/64725879 >> 172.21.15.26:0/64725879 conn(0x7f056c0a2aa0 msgr2=0x7f056c1344f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:55:59.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.534+0000 7f057314b700 1 -- 172.21.15.26:0/64725879 shutdown_connections 2023-10-01T07:55:59.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:55:59.534+0000 7f057314b700 1 -- 172.21.15.26:0/64725879 wait complete. 2023-10-01T07:55:59.548 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:00.498 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:00.508 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:00.532 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:00.549 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:00.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.650+0000 7fb212cca700 1 Processor -- start 2023-10-01T07:56:00.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.650+0000 7fb212cca700 1 -- start start 2023-10-01T07:56:00.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.651+0000 7fb212cca700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb20c131810 0x7fb20c131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:00.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.651+0000 7fb212cca700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb20c099a40 0x7fb20c099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:00.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.651+0000 7fb212cca700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb20c09a3b0 0x7fb20c138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:00.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.651+0000 7fb212cca700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb20c1313c0 con 0x7fb20c131810 2023-10-01T07:56:00.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.651+0000 7fb212cca700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c06e8c0 con 0x7fb20c099a40 2023-10-01T07:56:00.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.651+0000 7fb212cca700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c071d20 con 0x7fb20c09a3b0 2023-10-01T07:56:00.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.651+0000 7fb210a66700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb20c131810 0x7fb20c131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:00.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.651+0000 7fb211267700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb20c09a3b0 0x7fb20c138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:00.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.651+0000 7fb210a66700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb20c131810 0x7fb20c131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54426/0 (socket says 172.21.15.26:54426) 2023-10-01T07:56:00.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.651+0000 7fb211267700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb20c09a3b0 0x7fb20c138650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:58450/0 (socket says 172.21.15.26:58450) 2023-10-01T07:56:00.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.651+0000 7fb210a66700 1 -- 172.21.15.26:0/3793855078 learned_addr learned my addr 172.21.15.26:0/3793855078 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:00.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.651+0000 7fb20bfff700 1 --2- 172.21.15.26:0/3793855078 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb20c099a40 0x7fb20c099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:00.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.651+0000 7fb210a66700 1 -- 172.21.15.26:0/3793855078 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb20c09a3b0 msgr2=0x7fb20c138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:00.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.651+0000 7fb210a66700 1 --2- 172.21.15.26:0/3793855078 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb20c09a3b0 0x7fb20c138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.651+0000 7fb210a66700 1 -- 172.21.15.26:0/3793855078 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb20c099a40 msgr2=0x7fb20c099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:00.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.651+0000 7fb210a66700 1 --2- 172.21.15.26:0/3793855078 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb20c099a40 0x7fb20c099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.651+0000 7fb210a66700 1 -- 172.21.15.26:0/3793855078 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20c0721a0 con 0x7fb20c131810 2023-10-01T07:56:00.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.651+0000 7fb20bfff700 1 --2- 172.21.15.26:0/3793855078 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb20c099a40 0x7fb20c099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:56:00.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.652+0000 7fb210a66700 1 --2- 172.21.15.26:0/3793855078 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb20c131810 0x7fb20c131be0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb2000098f0 tx=0x7fb200009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e3fdbad2c0d2df server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:00.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.652+0000 7fb20b7fe700 1 -- 172.21.15.26:0/3793855078 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb200011830 con 0x7fb20c131810 2023-10-01T07:56:00.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.652+0000 7fb20b7fe700 1 -- 172.21.15.26:0/3793855078 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb200011990 con 0x7fb20c131810 2023-10-01T07:56:00.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.652+0000 7fb20b7fe700 1 -- 172.21.15.26:0/3793855078 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb200011d20 con 0x7fb20c131810 2023-10-01T07:56:00.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.653+0000 7fb212cca700 1 -- 172.21.15.26:0/3793855078 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb20c131810 msgr2=0x7fb20c131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:00.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.653+0000 7fb212cca700 1 --2- 172.21.15.26:0/3793855078 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb20c131810 0x7fb20c131be0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb2000098f0 tx=0x7fb200009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:00.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.653+0000 7fb212cca700 1 -- 172.21.15.26:0/3793855078 shutdown_connections 2023-10-01T07:56:00.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.653+0000 7fb212cca700 1 --2- 172.21.15.26:0/3793855078 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb20c09a3b0 0x7fb20c138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.653+0000 7fb212cca700 1 --2- 172.21.15.26:0/3793855078 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb20c131810 0x7fb20c131be0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.653+0000 7fb212cca700 1 --2- 172.21.15.26:0/3793855078 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb20c099a40 0x7fb20c099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.653+0000 7fb212cca700 1 -- 172.21.15.26:0/3793855078 >> 172.21.15.26:0/3793855078 conn(0x7fb20c0a2aa0 msgr2=0x7fb20c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:00.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.653+0000 7fb212cca700 1 -- 172.21.15.26:0/3793855078 shutdown_connections 2023-10-01T07:56:00.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.653+0000 7fb212cca700 1 -- 172.21.15.26:0/3793855078 wait complete. 2023-10-01T07:56:00.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.654+0000 7fb212cca700 1 Processor -- start 2023-10-01T07:56:00.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.654+0000 7fb212cca700 1 -- start start 2023-10-01T07:56:00.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.655+0000 7fb212cca700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb20c099a40 0x7fb20c11b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:00.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.655+0000 7fb212cca700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb20c09a3b0 0x7fb20c11bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:00.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.655+0000 7fb212cca700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb20c131810 0x7fb20c11c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:00.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.655+0000 7fb212cca700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c06eb70 con 0x7fb20c099a40 2023-10-01T07:56:00.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.655+0000 7fb212cca700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c11da90 con 0x7fb20c131810 2023-10-01T07:56:00.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.655+0000 7fb212cca700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c11e930 con 0x7fb20c09a3b0 2023-10-01T07:56:00.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.655+0000 7fb211267700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb20c131810 0x7fb20c11c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:00.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.655+0000 7fb211267700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb20c131810 0x7fb20c11c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55420/0 (socket says 172.21.15.26:55420) 2023-10-01T07:56:00.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.655+0000 7fb211267700 1 -- 172.21.15.26:0/85514910 learned_addr learned my addr 172.21.15.26:0/85514910 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:00.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.655+0000 7fb210a66700 1 --2- 172.21.15.26:0/85514910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb20c099a40 0x7fb20c11b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:00.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.655+0000 7fb20bfff700 1 --2- 172.21.15.26:0/85514910 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb20c09a3b0 0x7fb20c11bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:00.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.655+0000 7fb211267700 1 -- 172.21.15.26:0/85514910 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb20c09a3b0 msgr2=0x7fb20c11bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:00.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.655+0000 7fb211267700 1 --2- 172.21.15.26:0/85514910 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb20c09a3b0 0x7fb20c11bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.655+0000 7fb211267700 1 -- 172.21.15.26:0/85514910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb20c099a40 msgr2=0x7fb20c11b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:00.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.655+0000 7fb211267700 1 --2- 172.21.15.26:0/85514910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb20c099a40 0x7fb20c11b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.655+0000 7fb211267700 1 -- 172.21.15.26:0/85514910 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb200009550 con 0x7fb20c131810 2023-10-01T07:56:00.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.656+0000 7fb211267700 1 --2- 172.21.15.26:0/85514910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb20c131810 0x7fb20c11c260 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb204009dd0 tx=0x7fb20400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:00.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.656+0000 7fb2097fa700 1 -- 172.21.15.26:0/85514910 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb204009c40 con 0x7fb20c131810 2023-10-01T07:56:00.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.656+0000 7fb2097fa700 1 -- 172.21.15.26:0/85514910 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb20400f040 con 0x7fb20c131810 2023-10-01T07:56:00.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.656+0000 7fb212cca700 1 -- 172.21.15.26:0/85514910 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb20c11e470 con 0x7fb20c131810 2023-10-01T07:56:00.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.656+0000 7fb2097fa700 1 -- 172.21.15.26:0/85514910 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20400ceb0 con 0x7fb20c131810 2023-10-01T07:56:00.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.656+0000 7fb212cca700 1 -- 172.21.15.26:0/85514910 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb20c11f8c0 con 0x7fb20c131810 2023-10-01T07:56:00.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.657+0000 7fb2097fa700 1 -- 172.21.15.26:0/85514910 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb204014480 con 0x7fb20c131810 2023-10-01T07:56:00.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.657+0000 7fb2097fa700 1 -- 172.21.15.26:0/85514910 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb20403fed0 con 0x7fb20c131810 2023-10-01T07:56:00.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.657+0000 7fb212cca700 1 -- 172.21.15.26:0/85514910 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb20c074ea0 con 0x7fb20c131810 2023-10-01T07:56:00.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.667+0000 7fb2097fa700 1 -- 172.21.15.26:0/85514910 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb204018020 con 0x7fb20c131810 2023-10-01T07:56:00.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.692+0000 7fafd665f700 1 Processor -- start 2023-10-01T07:56:00.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.692+0000 7fafd665f700 1 -- start start 2023-10-01T07:56:00.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.693+0000 7fafd665f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fafd00a0a30 0x7fafd00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:00.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.693+0000 7fafd665f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fafd00a1340 0x7fafd0133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:00.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.693+0000 7fafd665f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fafd0133fa0 0x7fafd0134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:00.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.693+0000 7fafd665f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd009edd0 con 0x7fafd0133fa0 2023-10-01T07:56:00.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.693+0000 7fafd665f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd009e1f0 con 0x7fafd00a0a30 2023-10-01T07:56:00.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.693+0000 7fafd665f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fafd009dc50 con 0x7fafd00a1340 2023-10-01T07:56:00.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.693+0000 7fafcf7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fafd00a1340 0x7fafd0133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:00.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.693+0000 7fafcffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fafd00a0a30 0x7fafd00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:00.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.693+0000 7fafcf7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fafd00a1340 0x7fafd0133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:58476/0 (socket says 172.21.15.26:58476) 2023-10-01T07:56:00.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.693+0000 7fafcf7fe700 1 -- 172.21.15.26:0/1281061248 learned_addr learned my addr 172.21.15.26:0/1281061248 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:00.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.693+0000 7fafd4bfc700 1 --2- 172.21.15.26:0/1281061248 >> v2:172.21.15.26:3300/0 conn(0x7fafd0133fa0 0x7fafd0134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:00.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.693+0000 7fafcf7fe700 1 -- 172.21.15.26:0/1281061248 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fafd00a0a30 msgr2=0x7fafd00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:00.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.693+0000 7fafcf7fe700 1 --2- 172.21.15.26:0/1281061248 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fafd00a0a30 0x7fafd00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.693+0000 7fafcf7fe700 1 -- 172.21.15.26:0/1281061248 >> v2:172.21.15.26:3300/0 conn(0x7fafd0133fa0 msgr2=0x7fafd0134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:00.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.693+0000 7fafcf7fe700 1 --2- 172.21.15.26:0/1281061248 >> v2:172.21.15.26:3300/0 conn(0x7fafd0133fa0 0x7fafd0134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.693+0000 7fafcf7fe700 1 -- 172.21.15.26:0/1281061248 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd00a1fe0 con 0x7fafd00a1340 2023-10-01T07:56:00.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.694+0000 7fafcf7fe700 1 --2- 172.21.15.26:0/1281061248 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fafd00a1340 0x7fafd0133a60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fafc40098f0 tx=0x7fafc4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dc370bc7d30625a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:00.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.694+0000 7fafceffd700 1 -- 172.21.15.26:0/1281061248 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc4011830 con 0x7fafd00a1340 2023-10-01T07:56:00.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.694+0000 7fafceffd700 1 -- 172.21.15.26:0/1281061248 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc4011990 con 0x7fafd00a1340 2023-10-01T07:56:00.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.694+0000 7fafceffd700 1 -- 172.21.15.26:0/1281061248 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc4011d20 con 0x7fafd00a1340 2023-10-01T07:56:00.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.695+0000 7fafd665f700 1 -- 172.21.15.26:0/1281061248 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fafd00a1340 msgr2=0x7fafd0133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:00.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.695+0000 7fafd665f700 1 --2- 172.21.15.26:0/1281061248 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fafd00a1340 0x7fafd0133a60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fafc40098f0 tx=0x7fafc4009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:00.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.695+0000 7fafd665f700 1 -- 172.21.15.26:0/1281061248 shutdown_connections 2023-10-01T07:56:00.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.695+0000 7fafd665f700 1 --2- 172.21.15.26:0/1281061248 >> v2:172.21.15.26:3300/0 conn(0x7fafd0133fa0 0x7fafd0134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.695+0000 7fafd665f700 1 --2- 172.21.15.26:0/1281061248 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fafd00a0a30 0x7fafd00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.695+0000 7fafd665f700 1 --2- 172.21.15.26:0/1281061248 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fafd00a1340 0x7fafd0133a60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.695+0000 7fafd665f700 1 -- 172.21.15.26:0/1281061248 >> 172.21.15.26:0/1281061248 conn(0x7fafd00a6550 msgr2=0x7fafd00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:00.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.695+0000 7fafd665f700 1 -- 172.21.15.26:0/1281061248 shutdown_connections 2023-10-01T07:56:00.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.695+0000 7fafd665f700 1 -- 172.21.15.26:0/1281061248 wait complete. 2023-10-01T07:56:00.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.696+0000 7fafd665f700 1 Processor -- start 2023-10-01T07:56:00.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.697+0000 7fafd665f700 1 -- start start 2023-10-01T07:56:00.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.697+0000 7fafd665f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fafd00a0a30 0x7fafd01201f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:00.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.697+0000 7fafd665f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafd00a1340 0x7fafd0120730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:00.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.697+0000 7fafd665f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fafd0133fa0 0x7fafd0120c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:00.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.697+0000 7fafd665f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd01216c0 con 0x7fafd00a1340 2023-10-01T07:56:00.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.697+0000 7fafd665f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd0122450 con 0x7fafd0133fa0 2023-10-01T07:56:00.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.697+0000 7fafd665f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fafd0123d10 con 0x7fafd00a0a30 2023-10-01T07:56:00.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.698+0000 7fafcffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fafd00a0a30 0x7fafd01201f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:00.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.698+0000 7fafd4bfc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fafd0133fa0 0x7fafd0120c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:00.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.698+0000 7fafcffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fafd00a0a30 0x7fafd01201f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:58490/0 (socket says 172.21.15.26:58490) 2023-10-01T07:56:00.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.698+0000 7fafcffff700 1 -- 172.21.15.26:0/1530149816 learned_addr learned my addr 172.21.15.26:0/1530149816 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:00.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.698+0000 7fafcf7fe700 1 --2- 172.21.15.26:0/1530149816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafd00a1340 0x7fafd0120730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:00.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.698+0000 7fafcffff700 1 -- 172.21.15.26:0/1530149816 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fafd0133fa0 msgr2=0x7fafd0120c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:00.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.698+0000 7fafcffff700 1 --2- 172.21.15.26:0/1530149816 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fafd0133fa0 0x7fafd0120c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.698+0000 7fafcffff700 1 -- 172.21.15.26:0/1530149816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafd00a1340 msgr2=0x7fafd0120730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:00.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.698+0000 7fafcffff700 1 --2- 172.21.15.26:0/1530149816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafd00a1340 0x7fafd0120730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.698+0000 7fafcffff700 1 -- 172.21.15.26:0/1530149816 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4009550 con 0x7fafd00a0a30 2023-10-01T07:56:00.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.698+0000 7fafd4bfc700 1 --2- 172.21.15.26:0/1530149816 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fafd0133fa0 0x7fafd0120c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:00.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.698+0000 7fafcf7fe700 1 --2- 172.21.15.26:0/1530149816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafd00a1340 0x7fafd0120730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:00.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.698+0000 7fafcffff700 1 --2- 172.21.15.26:0/1530149816 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fafd00a0a30 0x7fafd01201f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fafc000e9e0 tx=0x7fafc000ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:00.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.699+0000 7fafccff9700 1 -- 172.21.15.26:0/1530149816 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc0009710 con 0x7fafd00a0a30 2023-10-01T07:56:00.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.699+0000 7fafccff9700 1 -- 172.21.15.26:0/1530149816 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc000ee80 con 0x7fafd00a0a30 2023-10-01T07:56:00.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.699+0000 7fafccff9700 1 -- 172.21.15.26:0/1530149816 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc000ca50 con 0x7fafd00a0a30 2023-10-01T07:56:00.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.699+0000 7fafd665f700 1 -- 172.21.15.26:0/1530149816 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd01230e0 con 0x7fafd00a0a30 2023-10-01T07:56:00.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.699+0000 7fafd665f700 1 -- 172.21.15.26:0/1530149816 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd0121e00 con 0x7fafd00a0a30 2023-10-01T07:56:00.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.700+0000 7fafccff9700 1 -- 172.21.15.26:0/1530149816 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fafc000cbb0 con 0x7fafd00a0a30 2023-10-01T07:56:00.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.700+0000 7fafccff9700 1 -- 172.21.15.26:0/1530149816 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fafc003f8d0 con 0x7fafd00a0a30 2023-10-01T07:56:00.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.701+0000 7fafd665f700 1 -- 172.21.15.26:0/1530149816 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd0074ea0 con 0x7fafd00a0a30 2023-10-01T07:56:00.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.703+0000 7f5b435fb700 1 Processor -- start 2023-10-01T07:56:00.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.703+0000 7f5b435fb700 1 -- start start 2023-10-01T07:56:00.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.704+0000 7f5b435fb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5b3c12cf60 0x7f5b3c06f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:00.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.704+0000 7f5b435fb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5b3c130430 0x7f5b3c137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:00.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.704+0000 7f5b435fb700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b3c12cd90 con 0x7f5b3c12f8b0 2023-10-01T07:56:00.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.704+0000 7f5b435fb700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b3c12d330 con 0x7f5b3c12cf60 2023-10-01T07:56:00.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.704+0000 7f5b435fb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c071780 con 0x7f5b3c130430 2023-10-01T07:56:00.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.704+0000 7f5b41397700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5b3c12cf60 0x7f5b3c06f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:00.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.704+0000 7f5b41397700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5b3c12cf60 0x7f5b3c06f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54466/0 (socket says 172.21.15.26:54466) 2023-10-01T07:56:00.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.704+0000 7f5b41397700 1 -- 172.21.15.26:0/70761672 learned_addr learned my addr 172.21.15.26:0/70761672 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:00.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.704+0000 7f5b41b98700 1 --2- 172.21.15.26:0/70761672 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5b3c130430 0x7f5b3c137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:00.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.704+0000 7f5b41397700 1 -- 172.21.15.26:0/70761672 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5b3c130430 msgr2=0x7f5b3c137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:00.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.704+0000 7f5b41397700 1 --2- 172.21.15.26:0/70761672 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5b3c130430 0x7f5b3c137c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.704+0000 7f5b41397700 1 -- 172.21.15.26:0/70761672 >> v1:172.21.15.26:6789/0 conn(0x7f5b3c12f8b0 legacy=0x7f5b3c12fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:00.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.704+0000 7f5b41397700 1 -- 172.21.15.26:0/70761672 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3c071a40 con 0x7f5b3c12cf60 2023-10-01T07:56:00.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.705+0000 7f5b41397700 1 --2- 172.21.15.26:0/70761672 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b3c12cf60 0x7f5b3c06f5d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5b3800bb90 tx=0x7f5b3800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c702fad48d3a9b8d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:00.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.705+0000 7f5b33fff700 1 -- 172.21.15.26:0/70761672 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3800dc20 con 0x7f5b3c12cf60 2023-10-01T07:56:00.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.705+0000 7f5b33fff700 1 -- 172.21.15.26:0/70761672 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3800dd80 con 0x7f5b3c12cf60 2023-10-01T07:56:00.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.705+0000 7f5b33fff700 1 -- 172.21.15.26:0/70761672 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b38017630 con 0x7f5b3c12cf60 2023-10-01T07:56:00.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.706+0000 7f5b435fb700 1 -- 172.21.15.26:0/70761672 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b3c12cf60 msgr2=0x7f5b3c06f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:00.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.706+0000 7f5b435fb700 1 --2- 172.21.15.26:0/70761672 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b3c12cf60 0x7f5b3c06f5d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5b3800bb90 tx=0x7f5b3800bea0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.706+0000 7f5b435fb700 1 -- 172.21.15.26:0/70761672 shutdown_connections 2023-10-01T07:56:00.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.706+0000 7f5b435fb700 1 --2- 172.21.15.26:0/70761672 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b3c12cf60 0x7f5b3c06f5d0 secure :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5b3800bb90 tx=0x7f5b3800bea0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.706+0000 7f5b435fb700 1 --2- 172.21.15.26:0/70761672 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5b3c130430 0x7f5b3c137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.706+0000 7f5b435fb700 1 -- 172.21.15.26:0/70761672 >> 172.21.15.26:0/70761672 conn(0x7f5b3c0a2aa0 msgr2=0x7f5b3c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:00.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.706+0000 7f5b435fb700 1 -- 172.21.15.26:0/70761672 shutdown_connections 2023-10-01T07:56:00.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.706+0000 7f5b435fb700 1 -- 172.21.15.26:0/70761672 wait complete. 2023-10-01T07:56:00.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.707+0000 7f5b435fb700 1 Processor -- start 2023-10-01T07:56:00.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.707+0000 7f5b435fb700 1 -- start start 2023-10-01T07:56:00.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.707+0000 7f5b435fb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5b3c12f8b0 0x7f5b3c09b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:00.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.707+0000 7f5b435fb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5b3c130430 0x7f5b3c09b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:00.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.707+0000 7f5b435fb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b3c119020 0x7f5b3c09bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:00.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.707+0000 7f5b435fb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c09d1d0 con 0x7f5b3c119020 2023-10-01T07:56:00.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.708+0000 7f5b435fb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c12a010 con 0x7f5b3c12f8b0 2023-10-01T07:56:00.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.708+0000 7f5b435fb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c12d7b0 con 0x7f5b3c130430 2023-10-01T07:56:00.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.708+0000 7f5b41397700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5b3c12f8b0 0x7f5b3c09b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:00.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.708+0000 7f5b41397700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5b3c12f8b0 0x7f5b3c09b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55464/0 (socket says 172.21.15.26:55464) 2023-10-01T07:56:00.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.708+0000 7f5b41397700 1 -- 172.21.15.26:0/2464774526 learned_addr learned my addr 172.21.15.26:0/2464774526 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:00.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.708+0000 7f5b40b96700 1 --2- 172.21.15.26:0/2464774526 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5b3c130430 0x7f5b3c09b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:00.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.708+0000 7f5b41b98700 1 --2- 172.21.15.26:0/2464774526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b3c119020 0x7f5b3c09bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:00.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.708+0000 7f5b41397700 1 -- 172.21.15.26:0/2464774526 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5b3c130430 msgr2=0x7f5b3c09b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:00.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.708+0000 7f5b41397700 1 --2- 172.21.15.26:0/2464774526 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5b3c130430 0x7f5b3c09b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.708+0000 7f5b41397700 1 -- 172.21.15.26:0/2464774526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b3c119020 msgr2=0x7f5b3c09bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:00.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.708+0000 7f5b41397700 1 --2- 172.21.15.26:0/2464774526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b3c119020 0x7f5b3c09bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.708+0000 7f5b41397700 1 -- 172.21.15.26:0/2464774526 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3800b7f0 con 0x7f5b3c12f8b0 2023-10-01T07:56:00.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.708+0000 7f5b41b98700 1 --2- 172.21.15.26:0/2464774526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b3c119020 0x7f5b3c09bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:00.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.708+0000 7f5b40b96700 1 --2- 172.21.15.26:0/2464774526 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5b3c130430 0x7f5b3c09b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:00.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.709+0000 7f5b41397700 1 --2- 172.21.15.26:0/2464774526 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5b3c12f8b0 0x7f5b3c09b240 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5b38019040 tx=0x7f5b38004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:00.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.709+0000 7f5b31ffb700 1 -- 172.21.15.26:0/2464774526 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b38017da0 con 0x7f5b3c12f8b0 2023-10-01T07:56:00.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.709+0000 7f5b31ffb700 1 -- 172.21.15.26:0/2464774526 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b38004050 con 0x7f5b3c12f8b0 2023-10-01T07:56:00.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.709+0000 7f5b31ffb700 1 -- 172.21.15.26:0/2464774526 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b38004400 con 0x7f5b3c12f8b0 2023-10-01T07:56:00.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.710+0000 7fafccff9700 1 -- 172.21.15.26:0/1530149816 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fafc0017080 con 0x7fafd00a0a30 2023-10-01T07:56:00.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.709+0000 7f5b435fb700 1 -- 172.21.15.26:0/2464774526 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b3c09ce00 con 0x7f5b3c12f8b0 2023-10-01T07:56:00.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.709+0000 7f5b435fb700 1 -- 172.21.15.26:0/2464774526 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b3c09d5f0 con 0x7f5b3c12f8b0 2023-10-01T07:56:00.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.710+0000 7f5b31ffb700 1 -- 172.21.15.26:0/2464774526 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5b38015070 con 0x7f5b3c12f8b0 2023-10-01T07:56:00.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.710+0000 7f5b31ffb700 1 -- 172.21.15.26:0/2464774526 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5b38040930 con 0x7f5b3c12f8b0 2023-10-01T07:56:00.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.710+0000 7f5b435fb700 1 -- 172.21.15.26:0/2464774526 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b3c074ea0 con 0x7f5b3c12f8b0 2023-10-01T07:56:00.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.717+0000 7f5b31ffb700 1 -- 172.21.15.26:0/2464774526 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5b38029460 con 0x7f5b3c12f8b0 2023-10-01T07:56:00.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.746+0000 7ff4ca7a4700 1 Processor -- start 2023-10-01T07:56:00.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.746+0000 7ff4ca7a4700 1 -- start start 2023-10-01T07:56:00.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.747+0000 7ff4ca7a4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4c409d6f0 0x7ff4c409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:00.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.747+0000 7ff4ca7a4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff4c409e000 0x7ff4c4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:00.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.747+0000 7ff4ca7a4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c409f130 con 0x7ff4c409e410 2023-10-01T07:56:00.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.747+0000 7ff4ca7a4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c409f520 con 0x7ff4c409e000 2023-10-01T07:56:00.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.747+0000 7ff4ca7a4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c409e930 con 0x7ff4c409d6f0 2023-10-01T07:56:00.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.747+0000 7ff4c3fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4c409d6f0 0x7ff4c409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:00.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.747+0000 7ff4c3fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4c409d6f0 0x7ff4c409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:58510/0 (socket says 172.21.15.26:58510) 2023-10-01T07:56:00.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.747+0000 7ff4c3fff700 1 -- 172.21.15.26:0/2336826374 learned_addr learned my addr 172.21.15.26:0/2336826374 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:00.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.747+0000 7ff4c37fe700 1 --2- 172.21.15.26:0/2336826374 >> v2:172.21.15.26:3300/0 conn(0x7ff4c409e000 0x7ff4c4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:00.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.748+0000 7ff4c3fff700 1 -- 172.21.15.26:0/2336826374 >> v2:172.21.15.26:3300/0 conn(0x7ff4c409e000 msgr2=0x7ff4c4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:00.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.748+0000 7ff4c3fff700 1 --2- 172.21.15.26:0/2336826374 >> v2:172.21.15.26:3300/0 conn(0x7ff4c409e000 0x7ff4c4130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.748+0000 7ff4c3fff700 1 -- 172.21.15.26:0/2336826374 >> v1:172.21.15.26:6789/0 conn(0x7ff4c409e410 legacy=0x7ff4c4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:00.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.748+0000 7ff4c2ffd700 1 -- 172.21.15.26:0/2336826374 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3316810974 0 0) 0x7ff4c409f130 con 0x7ff4c409e410 2023-10-01T07:56:00.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.748+0000 7ff4c3fff700 1 -- 172.21.15.26:0/2336826374 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c409b2d0 con 0x7ff4c409d6f0 2023-10-01T07:56:00.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.748+0000 7ff4c3fff700 1 --2- 172.21.15.26:0/2336826374 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4c409d6f0 0x7ff4c409dac0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff4b40098f0 tx=0x7ff4b4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85e5affb3d75697 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:00.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.748+0000 7ff4c2ffd700 1 -- 172.21.15.26:0/2336826374 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4011830 con 0x7ff4c409d6f0 2023-10-01T07:56:00.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.748+0000 7ff4c2ffd700 1 -- 172.21.15.26:0/2336826374 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b4011990 con 0x7ff4c409d6f0 2023-10-01T07:56:00.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.748+0000 7ff4c2ffd700 1 -- 172.21.15.26:0/2336826374 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4011d20 con 0x7ff4c409d6f0 2023-10-01T07:56:00.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.749+0000 7ff4ca7a4700 1 -- 172.21.15.26:0/2336826374 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4c409d6f0 msgr2=0x7ff4c409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:00.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.749+0000 7ff4ca7a4700 1 --2- 172.21.15.26:0/2336826374 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4c409d6f0 0x7ff4c409dac0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff4b40098f0 tx=0x7ff4b4009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:00.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.749+0000 7ff4ca7a4700 1 -- 172.21.15.26:0/2336826374 shutdown_connections 2023-10-01T07:56:00.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.749+0000 7ff4ca7a4700 1 --2- 172.21.15.26:0/2336826374 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4c409d6f0 0x7ff4c409dac0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.749+0000 7ff4ca7a4700 1 --2- 172.21.15.26:0/2336826374 >> v2:172.21.15.26:3300/0 conn(0x7ff4c409e000 0x7ff4c4130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.749+0000 7ff4ca7a4700 1 -- 172.21.15.26:0/2336826374 >> 172.21.15.26:0/2336826374 conn(0x7ff4c4066f50 msgr2=0x7ff4c409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:00.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.749+0000 7ff4ca7a4700 1 -- 172.21.15.26:0/2336826374 shutdown_connections 2023-10-01T07:56:00.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.749+0000 7ff4ca7a4700 1 -- 172.21.15.26:0/2336826374 wait complete. 2023-10-01T07:56:00.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.751+0000 7ff4ca7a4700 1 Processor -- start 2023-10-01T07:56:00.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.751+0000 7ff4ca7a4700 1 -- start start 2023-10-01T07:56:00.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.751+0000 7ff4ca7a4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c409d6f0 0x7ff4c412f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:00.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.751+0000 7ff4ca7a4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4c409e000 0x7ff4c412fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:00.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.751+0000 7ff4ca7a4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4c409e410 0x7ff4c41cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:00.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.751+0000 7ff4ca7a4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c412d190 con 0x7ff4c409d6f0 2023-10-01T07:56:00.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.752+0000 7ff4ca7a4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c40a1b80 con 0x7ff4c409e410 2023-10-01T07:56:00.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.752+0000 7ff4ca7a4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c409c700 con 0x7ff4c409e000 2023-10-01T07:56:00.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.752+0000 7ff4c3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c409d6f0 0x7ff4c412f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:00.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.752+0000 7ff4c3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c409d6f0 0x7ff4c412f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54504/0 (socket says 172.21.15.26:54504) 2023-10-01T07:56:00.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.752+0000 7ff4c3fff700 1 -- 172.21.15.26:0/3712807197 learned_addr learned my addr 172.21.15.26:0/3712807197 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:00.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.752+0000 7ff4c37fe700 1 --2- 172.21.15.26:0/3712807197 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4c409e000 0x7ff4c412fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:00.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.752+0000 7ff4c8d41700 1 --2- 172.21.15.26:0/3712807197 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4c409e410 0x7ff4c41cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:00.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.752+0000 7ff4c37fe700 1 -- 172.21.15.26:0/3712807197 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4c409e410 msgr2=0x7ff4c41cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:00.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.752+0000 7ff4c37fe700 1 --2- 172.21.15.26:0/3712807197 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4c409e410 0x7ff4c41cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.752+0000 7ff4c37fe700 1 -- 172.21.15.26:0/3712807197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c409d6f0 msgr2=0x7ff4c412f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:00.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.752+0000 7ff4c37fe700 1 --2- 172.21.15.26:0/3712807197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c409d6f0 0x7ff4c412f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.752+0000 7ff4c37fe700 1 -- 172.21.15.26:0/3712807197 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b4009550 con 0x7ff4c409e000 2023-10-01T07:56:00.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.752+0000 7ff4c3fff700 1 --2- 172.21.15.26:0/3712807197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c409d6f0 0x7ff4c412f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:00.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.752+0000 7ff4c37fe700 1 --2- 172.21.15.26:0/3712807197 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4c409e000 0x7ff4c412fa90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff4b800e8d0 tx=0x7ff4b800ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:00.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.753+0000 7ff4c0ff9700 1 -- 172.21.15.26:0/3712807197 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b8013680 con 0x7ff4c409e000 2023-10-01T07:56:00.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.753+0000 7ff4c0ff9700 1 -- 172.21.15.26:0/3712807197 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b80137e0 con 0x7ff4c409e000 2023-10-01T07:56:00.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.753+0000 7ff4ca7a4700 1 -- 172.21.15.26:0/3712807197 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c412ffd0 con 0x7ff4c409e000 2023-10-01T07:56:00.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.753+0000 7ff4c0ff9700 1 -- 172.21.15.26:0/3712807197 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b8013b50 con 0x7ff4c409e000 2023-10-01T07:56:00.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.753+0000 7ff4ca7a4700 1 -- 172.21.15.26:0/3712807197 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c4070540 con 0x7ff4c409e000 2023-10-01T07:56:00.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.754+0000 7ff4c0ff9700 1 -- 172.21.15.26:0/3712807197 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff4b8013cb0 con 0x7ff4c409e000 2023-10-01T07:56:00.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.754+0000 7ff4ca7a4700 1 -- 172.21.15.26:0/3712807197 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4a40052e0 con 0x7ff4c409e000 2023-10-01T07:56:00.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.754+0000 7ff4c0ff9700 1 -- 172.21.15.26:0/3712807197 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff4b803f510 con 0x7ff4c409e000 2023-10-01T07:56:00.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.759+0000 7ff4c0ff9700 1 -- 172.21.15.26:0/3712807197 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff4b80123d0 con 0x7ff4c409e000 2023-10-01T07:56:00.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.895+0000 7fb212cca700 1 -- 172.21.15.26:0/85514910 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb20c06b9e0 con 0x7fb20c131810 2023-10-01T07:56:00.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.895+0000 7fb2097fa700 1 -- 172.21.15.26:0/85514910 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb20401a680 con 0x7fb20c131810 2023-10-01T07:56:00.896 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:00.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.899+0000 7fb212cca700 1 -- 172.21.15.26:0/85514910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb20c131810 msgr2=0x7fb20c11c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:00.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.899+0000 7fb212cca700 1 --2- 172.21.15.26:0/85514910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb20c131810 0x7fb20c11c260 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb204009dd0 tx=0x7fb20400c3a0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.899+0000 7fb212cca700 1 -- 172.21.15.26:0/85514910 shutdown_connections 2023-10-01T07:56:00.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.899+0000 7fb212cca700 1 --2- 172.21.15.26:0/85514910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb20c131810 0x7fb20c11c260 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.899+0000 7fb212cca700 1 --2- 172.21.15.26:0/85514910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb20c099a40 0x7fb20c11b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.899+0000 7fb212cca700 1 --2- 172.21.15.26:0/85514910 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb20c09a3b0 0x7fb20c11bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.899+0000 7fb212cca700 1 -- 172.21.15.26:0/85514910 >> 172.21.15.26:0/85514910 conn(0x7fb20c0a2aa0 msgr2=0x7fb20c1b8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:00.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.899+0000 7fb212cca700 1 -- 172.21.15.26:0/85514910 shutdown_connections 2023-10-01T07:56:00.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.899+0000 7fb212cca700 1 -- 172.21.15.26:0/85514910 wait complete. 2023-10-01T07:56:00.914 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:00.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.924+0000 7fafd665f700 1 -- 172.21.15.26:0/1530149816 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fafd00a28e0 con 0x7fafd00a0a30 2023-10-01T07:56:00.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.924+0000 7fafccff9700 1 -- 172.21.15.26:0/1530149816 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fafc001b860 con 0x7fafd00a0a30 2023-10-01T07:56:00.925 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:00.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.927+0000 7fafd665f700 1 -- 172.21.15.26:0/1530149816 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fafd00a0a30 msgr2=0x7fafd01201f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:00.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.927+0000 7fafd665f700 1 --2- 172.21.15.26:0/1530149816 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fafd00a0a30 0x7fafd01201f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fafc000e9e0 tx=0x7fafc000ecf0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.927+0000 7fafd665f700 1 -- 172.21.15.26:0/1530149816 shutdown_connections 2023-10-01T07:56:00.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.927+0000 7fafd665f700 1 --2- 172.21.15.26:0/1530149816 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fafd0133fa0 0x7fafd0120c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.927+0000 7fafd665f700 1 --2- 172.21.15.26:0/1530149816 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fafd00a0a30 0x7fafd01201f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.927+0000 7fafd665f700 1 --2- 172.21.15.26:0/1530149816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafd00a1340 0x7fafd0120730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.927+0000 7fafd665f700 1 -- 172.21.15.26:0/1530149816 >> 172.21.15.26:0/1530149816 conn(0x7fafd00a6550 msgr2=0x7fafd00a4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:00.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.927+0000 7fafd665f700 1 -- 172.21.15.26:0/1530149816 shutdown_connections 2023-10-01T07:56:00.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.927+0000 7fafd665f700 1 -- 172.21.15.26:0/1530149816 wait complete. 2023-10-01T07:56:00.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.929+0000 7f5b435fb700 1 -- 172.21.15.26:0/2464774526 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5b3c074ea0 con 0x7f5b3c12f8b0 2023-10-01T07:56:00.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.929+0000 7f5b31ffb700 1 -- 172.21.15.26:0/2464774526 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5b380163c0 con 0x7f5b3c12f8b0 2023-10-01T07:56:00.930 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:00.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.933+0000 7f5b435fb700 1 -- 172.21.15.26:0/2464774526 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5b3c12f8b0 msgr2=0x7f5b3c09b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:00.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.933+0000 7f5b435fb700 1 --2- 172.21.15.26:0/2464774526 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5b3c12f8b0 0x7f5b3c09b240 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5b38019040 tx=0x7f5b38004750 comp rx=0 tx=0).stop 2023-10-01T07:56:00.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.933+0000 7f5b435fb700 1 -- 172.21.15.26:0/2464774526 shutdown_connections 2023-10-01T07:56:00.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.933+0000 7f5b435fb700 1 --2- 172.21.15.26:0/2464774526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b3c119020 0x7f5b3c09bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.933+0000 7f5b435fb700 1 --2- 172.21.15.26:0/2464774526 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5b3c12f8b0 0x7f5b3c09b240 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.933+0000 7f5b435fb700 1 --2- 172.21.15.26:0/2464774526 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5b3c130430 0x7f5b3c09b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.933+0000 7f5b435fb700 1 -- 172.21.15.26:0/2464774526 >> 172.21.15.26:0/2464774526 conn(0x7f5b3c0a2aa0 msgr2=0x7f5b3c06e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:00.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.933+0000 7f5b435fb700 1 -- 172.21.15.26:0/2464774526 shutdown_connections 2023-10-01T07:56:00.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.933+0000 7f5b435fb700 1 -- 172.21.15.26:0/2464774526 wait complete. 2023-10-01T07:56:00.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:00.954 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:00.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.982+0000 7ff4ca7a4700 1 -- 172.21.15.26:0/3712807197 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff4a4005590 con 0x7ff4c409e000 2023-10-01T07:56:00.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.982+0000 7ff4c0ff9700 1 -- 172.21.15.26:0/3712807197 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff4b8021090 con 0x7ff4c409e000 2023-10-01T07:56:00.983 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:00.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.984+0000 7ff4ca7a4700 1 -- 172.21.15.26:0/3712807197 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4c409e000 msgr2=0x7ff4c412fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:00.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.984+0000 7ff4ca7a4700 1 --2- 172.21.15.26:0/3712807197 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4c409e000 0x7ff4c412fa90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff4b800e8d0 tx=0x7ff4b800ebe0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.984+0000 7ff4ca7a4700 1 -- 172.21.15.26:0/3712807197 shutdown_connections 2023-10-01T07:56:00.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.984+0000 7ff4ca7a4700 1 --2- 172.21.15.26:0/3712807197 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4c409e410 0x7ff4c41cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.984+0000 7ff4ca7a4700 1 --2- 172.21.15.26:0/3712807197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c409d6f0 0x7ff4c412f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.984+0000 7ff4ca7a4700 1 --2- 172.21.15.26:0/3712807197 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4c409e000 0x7ff4c412fa90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:00.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.984+0000 7ff4ca7a4700 1 -- 172.21.15.26:0/3712807197 >> 172.21.15.26:0/3712807197 conn(0x7ff4c4066f50 msgr2=0x7ff4c40710d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:00.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.985+0000 7ff4ca7a4700 1 -- 172.21.15.26:0/3712807197 shutdown_connections 2023-10-01T07:56:00.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:00.985+0000 7ff4ca7a4700 1 -- 172.21.15.26:0/3712807197 wait complete. 2023-10-01T07:56:00.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:01.915 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:01.943 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:01.955 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:02.000 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:02.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.070+0000 7fa58c9a6700 1 Processor -- start 2023-10-01T07:56:02.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.070+0000 7fa58c9a6700 1 -- start start 2023-10-01T07:56:02.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.071+0000 7fa58c9a6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa588133540 0x7fa588135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:02.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.071+0000 7fa58c9a6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa588135e60 0x7fa588138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:02.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.071+0000 7fa58c9a6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5880716a0 con 0x7fa588130540 2023-10-01T07:56:02.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.071+0000 7fa58c9a6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa588071290 con 0x7fa588135e60 2023-10-01T07:56:02.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.071+0000 7fa58c9a6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa588130340 con 0x7fa588133540 2023-10-01T07:56:02.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.071+0000 7fa586d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa588135e60 0x7fa588138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:02.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.071+0000 7fa58659c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa588130540 0x7fa588130910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49074/0 (socket says 172.21.15.26:49074) 2023-10-01T07:56:02.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.071+0000 7fa586d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa588135e60 0x7fa588138240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55486/0 (socket says 172.21.15.26:55486) 2023-10-01T07:56:02.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.071+0000 7fa58659c700 1 -- 172.21.15.26:0/3564996855 learned_addr learned my addr 172.21.15.26:0/3564996855 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:02.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.071+0000 7fa585d9b700 1 --2- 172.21.15.26:0/3564996855 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa588133540 0x7fa588135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:02.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.072+0000 7fa58559a700 1 -- 172.21.15.26:0/3564996855 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 692084960 0 0) 0x7fa5880716a0 con 0x7fa588130540 2023-10-01T07:56:02.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.072+0000 7fa585d9b700 1 -- 172.21.15.26:0/3564996855 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa588135e60 msgr2=0x7fa588138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:02.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.072+0000 7fa585d9b700 1 --2- 172.21.15.26:0/3564996855 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa588135e60 0x7fa588138240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.072+0000 7fa585d9b700 1 -- 172.21.15.26:0/3564996855 >> v1:172.21.15.26:6789/0 conn(0x7fa588130540 legacy=0x7fa588130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:02.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.072+0000 7fa585d9b700 1 -- 172.21.15.26:0/3564996855 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa588070b80 con 0x7fa588133540 2023-10-01T07:56:02.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.072+0000 7fa586d9d700 1 --2- 172.21.15.26:0/3564996855 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa588135e60 0x7fa588138240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:02.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.072+0000 7fa585d9b700 1 --2- 172.21.15.26:0/3564996855 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa588133540 0x7fa588135920 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa57c00ddc0 tx=0x7fa57c00f330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9da19db1449fa41 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:02.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.072+0000 7fa58559a700 1 -- 172.21.15.26:0/3564996855 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c012070 con 0x7fa588133540 2023-10-01T07:56:02.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.072+0000 7fa58559a700 1 -- 172.21.15.26:0/3564996855 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57c00fb20 con 0x7fa588133540 2023-10-01T07:56:02.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.073+0000 7fa58559a700 1 -- 172.21.15.26:0/3564996855 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c016430 con 0x7fa588133540 2023-10-01T07:56:02.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.073+0000 7fa58c9a6700 1 -- 172.21.15.26:0/3564996855 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa588133540 msgr2=0x7fa588135920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:02.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.074+0000 7fa58c9a6700 1 --2- 172.21.15.26:0/3564996855 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa588133540 0x7fa588135920 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa57c00ddc0 tx=0x7fa57c00f330 comp rx=0 tx=0).stop 2023-10-01T07:56:02.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.074+0000 7fa58c9a6700 1 -- 172.21.15.26:0/3564996855 shutdown_connections 2023-10-01T07:56:02.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.074+0000 7fa58c9a6700 1 --2- 172.21.15.26:0/3564996855 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa588135e60 0x7fa588138240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.074+0000 7fa58c9a6700 1 --2- 172.21.15.26:0/3564996855 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa588133540 0x7fa588135920 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.074+0000 7fa58c9a6700 1 -- 172.21.15.26:0/3564996855 >> 172.21.15.26:0/3564996855 conn(0x7fa5880a2aa0 msgr2=0x7fa5880a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:02.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.074+0000 7fa58c9a6700 1 -- 172.21.15.26:0/3564996855 shutdown_connections 2023-10-01T07:56:02.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.074+0000 7fa58c9a6700 1 -- 172.21.15.26:0/3564996855 wait complete. 2023-10-01T07:56:02.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.075+0000 7fa58c9a6700 1 Processor -- start 2023-10-01T07:56:02.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.075+0000 7fa58c9a6700 1 -- start start 2023-10-01T07:56:02.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.076+0000 7fa58c9a6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa588130540 0x7fa58809c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:02.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.076+0000 7fa58c9a6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa588133540 0x7fa58809ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:02.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.076+0000 7fa58c9a6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa588135e60 0x7fa58809cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:02.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.076+0000 7fa58c9a6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58809e240 con 0x7fa588135e60 2023-10-01T07:56:02.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.076+0000 7fa58c9a6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5881359c0 con 0x7fa588133540 2023-10-01T07:56:02.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.076+0000 7fa58c9a6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5880718e0 con 0x7fa588130540 2023-10-01T07:56:02.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.076+0000 7fa585d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa588133540 0x7fa58809ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:02.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.076+0000 7fa585d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa588133540 0x7fa58809ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55494/0 (socket says 172.21.15.26:55494) 2023-10-01T07:56:02.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.076+0000 7fa585d9b700 1 -- 172.21.15.26:0/4155158838 learned_addr learned my addr 172.21.15.26:0/4155158838 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:02.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.076+0000 7fa586d9d700 1 --2- 172.21.15.26:0/4155158838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa588135e60 0x7fa58809cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:02.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.076+0000 7fa58659c700 1 --2- 172.21.15.26:0/4155158838 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa588130540 0x7fa58809c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:02.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.076+0000 7fa586d9d700 1 -- 172.21.15.26:0/4155158838 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa588130540 msgr2=0x7fa58809c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:02.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.076+0000 7fa586d9d700 1 --2- 172.21.15.26:0/4155158838 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa588130540 0x7fa58809c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.076+0000 7fa586d9d700 1 -- 172.21.15.26:0/4155158838 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa588133540 msgr2=0x7fa58809ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:02.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.076+0000 7fa586d9d700 1 --2- 172.21.15.26:0/4155158838 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa588133540 0x7fa58809ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.076+0000 7fa586d9d700 1 -- 172.21.15.26:0/4155158838 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa58000ba90 con 0x7fa588135e60 2023-10-01T07:56:02.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.076+0000 7fa585d9b700 1 --2- 172.21.15.26:0/4155158838 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa588133540 0x7fa58809ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:02.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.076+0000 7fa58659c700 1 --2- 172.21.15.26:0/4155158838 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa588130540 0x7fa58809c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:56:02.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.077+0000 7fa586d9d700 1 --2- 172.21.15.26:0/4155158838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa588135e60 0x7fa58809cfa0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa58000bec0 tx=0x7fa58000f410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:02.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.077+0000 7fa576ffd700 1 -- 172.21.15.26:0/4155158838 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa580010040 con 0x7fa588135e60 2023-10-01T07:56:02.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.077+0000 7fa576ffd700 1 -- 172.21.15.26:0/4155158838 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58000fae0 con 0x7fa588135e60 2023-10-01T07:56:02.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.077+0000 7fa576ffd700 1 -- 172.21.15.26:0/4155158838 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58000fe90 con 0x7fa588135e60 2023-10-01T07:56:02.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.077+0000 7fa58c9a6700 1 -- 172.21.15.26:0/4155158838 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa57c00da70 con 0x7fa588135e60 2023-10-01T07:56:02.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.077+0000 7fa58c9a6700 1 -- 172.21.15.26:0/4155158838 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa58811ae00 con 0x7fa588135e60 2023-10-01T07:56:02.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.078+0000 7fa58c9a6700 1 -- 172.21.15.26:0/4155158838 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa588074ea0 con 0x7fa588135e60 2023-10-01T07:56:02.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.078+0000 7fa576ffd700 1 -- 172.21.15.26:0/4155158838 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa580009540 con 0x7fa588135e60 2023-10-01T07:56:02.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.079+0000 7fa576ffd700 1 -- 172.21.15.26:0/4155158838 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa58003fe20 con 0x7fa588135e60 2023-10-01T07:56:02.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.083+0000 7fa576ffd700 1 -- 172.21.15.26:0/4155158838 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa5800097f0 con 0x7fa588135e60 2023-10-01T07:56:02.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.108+0000 7fd34fed2700 1 Processor -- start 2023-10-01T07:56:02.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.109+0000 7fd34fed2700 1 -- start start 2023-10-01T07:56:02.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.109+0000 7fd34fed2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd3481338a0 0x7fd348133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:02.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.109+0000 7fd34fed2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd34809de50 0x7fd34809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:02.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.109+0000 7fd34fed2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd34806ef30 con 0x7fd34809e760 2023-10-01T07:56:02.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.109+0000 7fd34fed2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd34806fef0 con 0x7fd3481338a0 2023-10-01T07:56:02.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.109+0000 7fd34fed2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3481334b0 con 0x7fd34809de50 2023-10-01T07:56:02.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.110+0000 7fd34dc6e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd3481338a0 0x7fd348133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:02.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.110+0000 7fd34dc6e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd3481338a0 0x7fd348133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54518/0 (socket says 172.21.15.26:54518) 2023-10-01T07:56:02.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.110+0000 7fd34dc6e700 1 -- 172.21.15.26:0/3159295789 learned_addr learned my addr 172.21.15.26:0/3159295789 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:02.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.110+0000 7fd34e46f700 1 --1- 172.21.15.26:0/3159295789 >> v1:172.21.15.26:6789/0 conn(0x7fd34809e760 0x7fd34813a730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49088/0 (socket says 172.21.15.26:49088) 2023-10-01T07:56:02.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.110+0000 7fd34d46d700 1 --2- 172.21.15.26:0/3159295789 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd34809de50 0x7fd34809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:02.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.110+0000 7f9c44fb3700 1 Processor -- start 2023-10-01T07:56:02.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.110+0000 7fd34d46d700 1 -- 172.21.15.26:0/3159295789 >> v2:172.21.15.26:3300/0 conn(0x7fd3481338a0 msgr2=0x7fd348133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:02.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.110+0000 7fd34d46d700 1 --2- 172.21.15.26:0/3159295789 >> v2:172.21.15.26:3300/0 conn(0x7fd3481338a0 0x7fd348133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.110+0000 7fd34d46d700 1 -- 172.21.15.26:0/3159295789 >> v1:172.21.15.26:6789/0 conn(0x7fd34809e760 legacy=0x7fd34813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:02.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.110+0000 7fd34d46d700 1 -- 172.21.15.26:0/3159295789 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34806fc30 con 0x7fd34809de50 2023-10-01T07:56:02.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.110+0000 7fd34cc6c700 1 -- 172.21.15.26:0/3159295789 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2042272498 0 0) 0x7fd34806ef30 con 0x7fd34809e760 2023-10-01T07:56:02.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.110+0000 7f9c44fb3700 1 -- start start 2023-10-01T07:56:02.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.110+0000 7fd34d46d700 1 --2- 172.21.15.26:0/3159295789 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd34809de50 0x7fd34809e220 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd338009840 tx=0x7fd338009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73dd030b967382ea server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:02.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.111+0000 7f9c44fb3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c4012cf60 0x7f9c4006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:02.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.111+0000 7fd34cc6c700 1 -- 172.21.15.26:0/3159295789 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd338011830 con 0x7fd34809de50 2023-10-01T07:56:02.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.111+0000 7fd34cc6c700 1 -- 172.21.15.26:0/3159295789 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd338011990 con 0x7fd34809de50 2023-10-01T07:56:02.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.111+0000 7fd34cc6c700 1 -- 172.21.15.26:0/3159295789 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd338011d20 con 0x7fd34809de50 2023-10-01T07:56:02.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.111+0000 7f9c44fb3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c4012f8b0 0x7f9c4012fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:02.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.111+0000 7f9c44fb3700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c4012cd90 con 0x7f9c40130260 2023-10-01T07:56:02.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.111+0000 7f9c44fb3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4012d330 con 0x7f9c4012cf60 2023-10-01T07:56:02.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.111+0000 7f9c44fb3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c401306d0 con 0x7f9c4012f8b0 2023-10-01T07:56:02.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.111+0000 7f9c3ed9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9c40130260 0x7f9c40136c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49102/0 (socket says 172.21.15.26:49102) 2023-10-01T07:56:02.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.111+0000 7f9c3ed9d700 1 -- 172.21.15.26:0/930177058 learned_addr learned my addr 172.21.15.26:0/930177058 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:02.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.111+0000 7f9c3d59a700 1 -- 172.21.15.26:0/930177058 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717312582 0 0) 0x7f9c4012cd90 con 0x7f9c40130260 2023-10-01T07:56:02.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.111+0000 7f9c3dd9b700 1 --2- 172.21.15.26:0/930177058 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c4012f8b0 0x7f9c4012fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:02.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.111+0000 7f9c3d59a700 1 -- 172.21.15.26:0/930177058 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c280035b0 con 0x7f9c40130260 2023-10-01T07:56:02.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.112+0000 7f9c3e59c700 1 --2- 172.21.15.26:0/930177058 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c4012cf60 0x7f9c4006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:02.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.112+0000 7f9c3d59a700 1 -- 172.21.15.26:0/930177058 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3723760672 0 0) 0x7f9c280035b0 con 0x7f9c40130260 2023-10-01T07:56:02.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.112+0000 7f9c3d59a700 1 -- 172.21.15.26:0/930177058 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c4012f8b0 msgr2=0x7f9c4012fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:02.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.112+0000 7f9c3d59a700 1 --2- 172.21.15.26:0/930177058 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c4012f8b0 0x7f9c4012fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.112+0000 7f9c3d59a700 1 -- 172.21.15.26:0/930177058 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c4012cf60 msgr2=0x7f9c4006f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:02.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.112+0000 7f9c3d59a700 1 --2- 172.21.15.26:0/930177058 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c4012cf60 0x7f9c4006f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.112+0000 7f9c3d59a700 1 -- 172.21.15.26:0/930177058 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c40071780 con 0x7f9c40130260 2023-10-01T07:56:02.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.112+0000 7f9c3d59a700 1 -- 172.21.15.26:0/930177058 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1576910959 0 0) 0x7f9c380019f0 con 0x7f9c40130260 2023-10-01T07:56:02.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.112+0000 7f9c3e59c700 1 --2- 172.21.15.26:0/930177058 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c4012cf60 0x7f9c4006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:56:02.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.112+0000 7f9c3d59a700 1 -- 172.21.15.26:0/930177058 >> v1:172.21.15.26:6789/0 conn(0x7f9c40130260 legacy=0x7f9c40136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:02.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.112+0000 7f9c3d59a700 1 --2- 172.21.15.26:0/930177058 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c28003a00 0x7f9c28003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:02.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.112+0000 7f9c3d59a700 1 --2- 172.21.15.26:0/930177058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c28004430 0x7f9c280048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:02.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.112+0000 7f9c3d59a700 1 --2- 172.21.15.26:0/930177058 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c4012cf60 0x7f9c280051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:02.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.112+0000 7f9c3d59a700 1 -- 172.21.15.26:0/930177058 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4012d330 con 0x7f9c28004430 2023-10-01T07:56:02.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.112+0000 7f9c3d59a700 1 -- 172.21.15.26:0/930177058 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c401306d0 con 0x7f9c4012cf60 2023-10-01T07:56:02.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.112+0000 7f9c3d59a700 1 -- 172.21.15.26:0/930177058 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2800bb70 con 0x7f9c28003a00 2023-10-01T07:56:02.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.112+0000 7fd34fed2700 1 -- 172.21.15.26:0/3159295789 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd34809de50 msgr2=0x7fd34809e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:02.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.112+0000 7fd34fed2700 1 --2- 172.21.15.26:0/3159295789 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd34809de50 0x7fd34809e220 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd338009840 tx=0x7fd338009b50 comp rx=0 tx=0).stop 2023-10-01T07:56:02.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.112+0000 7fd34fed2700 1 -- 172.21.15.26:0/3159295789 shutdown_connections 2023-10-01T07:56:02.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.112+0000 7fd34fed2700 1 --2- 172.21.15.26:0/3159295789 >> v2:172.21.15.26:3300/0 conn(0x7fd3481338a0 0x7fd348133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.112+0000 7fd34fed2700 1 --2- 172.21.15.26:0/3159295789 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd34809de50 0x7fd34809e220 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.112+0000 7fd34fed2700 1 -- 172.21.15.26:0/3159295789 >> 172.21.15.26:0/3159295789 conn(0x7fd3480a2aa0 msgr2=0x7fd3480a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:02.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.112+0000 7fd34fed2700 1 -- 172.21.15.26:0/3159295789 shutdown_connections 2023-10-01T07:56:02.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.112+0000 7f9c3e59c700 1 --2- 172.21.15.26:0/930177058 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c28003a00 0x7f9c28003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:02.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.112+0000 7f9c3ed9d700 1 --2- 172.21.15.26:0/930177058 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c4012cf60 0x7f9c280051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:02.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.112+0000 7fd34fed2700 1 -- 172.21.15.26:0/3159295789 wait complete. 2023-10-01T07:56:02.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.113+0000 7f9c3ed9d700 1 -- 172.21.15.26:0/930177058 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c28003a00 msgr2=0x7f9c28003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:02.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.113+0000 7f9c3ed9d700 1 --2- 172.21.15.26:0/930177058 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c28003a00 0x7f9c28003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.113+0000 7f9c3ed9d700 1 -- 172.21.15.26:0/930177058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c28004430 msgr2=0x7f9c280048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:02.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.113+0000 7f9c3ed9d700 1 --2- 172.21.15.26:0/930177058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c28004430 0x7f9c280048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.113+0000 7f9c3ed9d700 1 -- 172.21.15.26:0/930177058 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c280035b0 con 0x7f9c4012cf60 2023-10-01T07:56:02.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.113+0000 7f9c3ed9d700 1 --2- 172.21.15.26:0/930177058 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c4012cf60 0x7f9c280051e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9c3800a760 tx=0x7f9c28005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47f5ee4d260999ab server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:02.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.113+0000 7f9c3d59a700 1 -- 172.21.15.26:0/930177058 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3800a250 con 0x7f9c4012cf60 2023-10-01T07:56:02.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.113+0000 7f9c3d59a700 1 -- 172.21.15.26:0/930177058 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c380072d0 con 0x7f9c4012cf60 2023-10-01T07:56:02.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.113+0000 7f9c3d59a700 1 -- 172.21.15.26:0/930177058 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c38007680 con 0x7f9c4012cf60 2023-10-01T07:56:02.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.113+0000 7fd34fed2700 1 Processor -- start 2023-10-01T07:56:02.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.114+0000 7fd34fed2700 1 -- start start 2023-10-01T07:56:02.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.114+0000 7fd34fed2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd34809de50 0x7fd348118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:02.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.114+0000 7fd34fed2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd34809e760 0x7fd348119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:02.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.114+0000 7fd34fed2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd3481338a0 0x7fd348119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:02.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.114+0000 7fd34fed2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34811bec0 con 0x7fd34809e760 2023-10-01T07:56:02.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.114+0000 7fd34fed2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd34811a9a0 con 0x7fd34809de50 2023-10-01T07:56:02.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.114+0000 7fd34fed2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd348119d80 con 0x7fd3481338a0 2023-10-01T07:56:02.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.114+0000 7fd34dc6e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd34809de50 0x7fd348118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:02.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.114+0000 7fd34dc6e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd34809de50 0x7fd348118cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55514/0 (socket says 172.21.15.26:55514) 2023-10-01T07:56:02.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.114+0000 7fd34dc6e700 1 -- 172.21.15.26:0/1147476597 learned_addr learned my addr 172.21.15.26:0/1147476597 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:02.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.114+0000 7f9c44fb3700 1 -- 172.21.15.26:0/930177058 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c4012cf60 msgr2=0x7f9c280051e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:02.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.114+0000 7f9c44fb3700 1 --2- 172.21.15.26:0/930177058 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c4012cf60 0x7f9c280051e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9c3800a760 tx=0x7f9c28005880 comp rx=0 tx=0).stop 2023-10-01T07:56:02.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.114+0000 7f9c44fb3700 1 -- 172.21.15.26:0/930177058 shutdown_connections 2023-10-01T07:56:02.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.114+0000 7f9c44fb3700 1 --2- 172.21.15.26:0/930177058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c28004430 0x7f9c280048f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.114+0000 7f9c44fb3700 1 --2- 172.21.15.26:0/930177058 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c28003a00 0x7f9c28003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.114+0000 7f9c44fb3700 1 --2- 172.21.15.26:0/930177058 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c4012cf60 0x7f9c280051e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.114+0000 7f9c44fb3700 1 -- 172.21.15.26:0/930177058 >> 172.21.15.26:0/930177058 conn(0x7f9c400a2aa0 msgr2=0x7f9c400a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:02.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.114+0000 7fd34dc6e700 1 -- 172.21.15.26:0/1147476597 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd3481338a0 msgr2=0x7fd348119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:02.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.114+0000 7fd34dc6e700 1 --2- 172.21.15.26:0/1147476597 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd3481338a0 0x7fd348119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.114+0000 7fd34dc6e700 1 -- 172.21.15.26:0/1147476597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd34809e760 msgr2=0x7fd348119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:02.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.114+0000 7fd34dc6e700 1 --2- 172.21.15.26:0/1147476597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd34809e760 0x7fd348119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.115+0000 7fd34dc6e700 1 -- 172.21.15.26:0/1147476597 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3380094a0 con 0x7fd34809de50 2023-10-01T07:56:02.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.115+0000 7fd34dc6e700 1 --2- 172.21.15.26:0/1147476597 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd34809de50 0x7fd348118cd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd34400e940 tx=0x7fd34400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:02.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.115+0000 7fd33e7fc700 1 -- 172.21.15.26:0/1147476597 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3440096a0 con 0x7fd34809de50 2023-10-01T07:56:02.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.115+0000 7fd33e7fc700 1 -- 172.21.15.26:0/1147476597 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34400c850 con 0x7fd34809de50 2023-10-01T07:56:02.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.115+0000 7fd33e7fc700 1 -- 172.21.15.26:0/1147476597 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34400cc00 con 0x7fd34809de50 2023-10-01T07:56:02.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.115+0000 7f9c44fb3700 1 -- 172.21.15.26:0/930177058 shutdown_connections 2023-10-01T07:56:02.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.115+0000 7f9c44fb3700 1 -- 172.21.15.26:0/930177058 wait complete. 2023-10-01T07:56:02.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.115+0000 7fd34fed2700 1 -- 172.21.15.26:0/1147476597 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3480a0db0 con 0x7fd34809de50 2023-10-01T07:56:02.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.115+0000 7fd34fed2700 1 -- 172.21.15.26:0/1147476597 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd34811a6b0 con 0x7fd34809de50 2023-10-01T07:56:02.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.116+0000 7fd34fed2700 1 -- 172.21.15.26:0/1147476597 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd34811afb0 con 0x7fd34809de50 2023-10-01T07:56:02.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.116+0000 7f9c44fb3700 1 Processor -- start 2023-10-01T07:56:02.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.117+0000 7fd33e7fc700 1 -- 172.21.15.26:0/1147476597 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd34400cd60 con 0x7fd34809de50 2023-10-01T07:56:02.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.118+0000 7fd33e7fc700 1 -- 172.21.15.26:0/1147476597 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd344040090 con 0x7fd34809de50 2023-10-01T07:56:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.121+0000 7f9c44fb3700 1 -- start start 2023-10-01T07:56:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.121+0000 7f9c44fb3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c28003a00 0x7f9c4009b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.121+0000 7f9c44fb3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c28004430 0x7f9c4009bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.121+0000 7f9c44fb3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c4012cf60 0x7f9c401c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.121+0000 7f9c44fb3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4009c2c0 con 0x7f9c28004430 2023-10-01T07:56:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.121+0000 7f9c44fb3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4009e350 con 0x7f9c4012cf60 2023-10-01T07:56:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.121+0000 7f9c44fb3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4009b410 con 0x7f9c28003a00 2023-10-01T07:56:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.122+0000 7f9c3dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c28004430 0x7f9c4009bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:02.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.122+0000 7f9c3e59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c28003a00 0x7f9c4009b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:02.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.122+0000 7f9c3dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c28004430 0x7f9c4009bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54536/0 (socket says 172.21.15.26:54536) 2023-10-01T07:56:02.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.122+0000 7f9c3dd9b700 1 -- 172.21.15.26:0/160816848 learned_addr learned my addr 172.21.15.26:0/160816848 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:02.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.122+0000 7f9c3dd9b700 1 -- 172.21.15.26:0/160816848 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c28003a00 msgr2=0x7f9c4009b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:02.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.122+0000 7f9c3dd9b700 1 --2- 172.21.15.26:0/160816848 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c28003a00 0x7f9c4009b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.122+0000 7f9c3dd9b700 1 -- 172.21.15.26:0/160816848 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c4012cf60 msgr2=0x7f9c401c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:02.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.122+0000 7f9c3dd9b700 1 --2- 172.21.15.26:0/160816848 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c4012cf60 0x7f9c401c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.122+0000 7f9c3dd9b700 1 -- 172.21.15.26:0/160816848 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4009d6c0 con 0x7f9c28004430 2023-10-01T07:56:02.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.122+0000 7fd33e7fc700 1 -- 172.21.15.26:0/1147476597 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd344011350 con 0x7fd34809de50 2023-10-01T07:56:02.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.123+0000 7f9c3dd9b700 1 --2- 172.21.15.26:0/160816848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c28004430 0x7f9c4009bd80 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400e8b0 tx=0x7f9c3400ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:02.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.123+0000 7f9c2effd700 1 -- 172.21.15.26:0/160816848 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c34013680 con 0x7f9c28004430 2023-10-01T07:56:02.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.123+0000 7f9c2effd700 1 -- 172.21.15.26:0/160816848 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c340137e0 con 0x7f9c28004430 2023-10-01T07:56:02.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.123+0000 7f9c2effd700 1 -- 172.21.15.26:0/160816848 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c34013b90 con 0x7f9c28004430 2023-10-01T07:56:02.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.123+0000 7f9c44fb3700 1 -- 172.21.15.26:0/160816848 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c4009e610 con 0x7f9c28004430 2023-10-01T07:56:02.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.123+0000 7f9c44fb3700 1 -- 172.21.15.26:0/160816848 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c4009cbc0 con 0x7f9c28004430 2023-10-01T07:56:02.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.124+0000 7f9c2effd700 1 -- 172.21.15.26:0/160816848 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9c34013cf0 con 0x7f9c28004430 2023-10-01T07:56:02.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.124+0000 7f9c2effd700 1 -- 172.21.15.26:0/160816848 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9c34012940 con 0x7f9c28004430 2023-10-01T07:56:02.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.125+0000 7f9c44fb3700 1 -- 172.21.15.26:0/160816848 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c40074ea0 con 0x7f9c28004430 2023-10-01T07:56:02.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.134+0000 7f9c2effd700 1 -- 172.21.15.26:0/160816848 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c34017070 con 0x7f9c28004430 2023-10-01T07:56:02.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.159+0000 7f9e6a3c5700 1 Processor -- start 2023-10-01T07:56:02.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.159+0000 7f9e6a3c5700 1 -- start start 2023-10-01T07:56:02.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.160+0000 7f9e6a3c5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e6409d6f0 0x7f9e6409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:02.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.160+0000 7f9e6a3c5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9e6409e410 0x7f9e64130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:02.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.160+0000 7f9e6a3c5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e6409f130 con 0x7f9e6409e000 2023-10-01T07:56:02.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.160+0000 7f9e6a3c5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e6409f520 con 0x7f9e6409e410 2023-10-01T07:56:02.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.160+0000 7f9e6a3c5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6409e930 con 0x7f9e6409d6f0 2023-10-01T07:56:02.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.160+0000 7f9e68962700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9e6409e410 0x7f9e64130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:02.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.160+0000 7f9e637fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9e6409e000 0x7f9e64130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49118/0 (socket says 172.21.15.26:49118) 2023-10-01T07:56:02.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.160+0000 7f9e637fe700 1 -- 172.21.15.26:0/3240757117 learned_addr learned my addr 172.21.15.26:0/3240757117 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:02.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.160+0000 7f9e68962700 1 -- 172.21.15.26:0/3240757117 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e6409d6f0 msgr2=0x7f9e6409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:02.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.160+0000 7f9e68962700 1 --2- 172.21.15.26:0/3240757117 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e6409d6f0 0x7f9e6409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.160+0000 7f9e68962700 1 -- 172.21.15.26:0/3240757117 >> v1:172.21.15.26:6789/0 conn(0x7f9e6409e000 legacy=0x7f9e64130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:02.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.160+0000 7f9e68962700 1 -- 172.21.15.26:0/3240757117 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6409b2d0 con 0x7f9e6409e410 2023-10-01T07:56:02.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.160+0000 7f9e68962700 1 --2- 172.21.15.26:0/3240757117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e6409e410 0x7f9e64130d70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c009d90 tx=0x7f9e5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29c889b632709ec4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:02.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.161+0000 7f9e62ffd700 1 -- 172.21.15.26:0/3240757117 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c00e070 con 0x7f9e6409e410 2023-10-01T07:56:02.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.161+0000 7f9e62ffd700 1 -- 172.21.15.26:0/3240757117 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e5c00bad0 con 0x7f9e6409e410 2023-10-01T07:56:02.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.161+0000 7f9e62ffd700 1 -- 172.21.15.26:0/3240757117 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c00be80 con 0x7f9e6409e410 2023-10-01T07:56:02.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.161+0000 7f9e6a3c5700 1 -- 172.21.15.26:0/3240757117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e6409e410 msgr2=0x7f9e64130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:02.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.161+0000 7f9e6a3c5700 1 --2- 172.21.15.26:0/3240757117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e6409e410 0x7f9e64130d70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c009d90 tx=0x7f9e5c00b330 comp rx=0 tx=0).stop 2023-10-01T07:56:02.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.161+0000 7f9e6a3c5700 1 -- 172.21.15.26:0/3240757117 shutdown_connections 2023-10-01T07:56:02.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.161+0000 7f9e6a3c5700 1 --2- 172.21.15.26:0/3240757117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e6409e410 0x7f9e64130d70 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.161+0000 7f9e6a3c5700 1 --2- 172.21.15.26:0/3240757117 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e6409d6f0 0x7f9e6409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.161+0000 7f9e6a3c5700 1 -- 172.21.15.26:0/3240757117 >> 172.21.15.26:0/3240757117 conn(0x7f9e64066f50 msgr2=0x7f9e6409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:02.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.162+0000 7f9e6a3c5700 1 -- 172.21.15.26:0/3240757117 shutdown_connections 2023-10-01T07:56:02.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.162+0000 7f9e6a3c5700 1 -- 172.21.15.26:0/3240757117 wait complete. 2023-10-01T07:56:02.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.163+0000 7f9e6a3c5700 1 Processor -- start 2023-10-01T07:56:02.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.163+0000 7f9e6a3c5700 1 -- start start 2023-10-01T07:56:02.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.164+0000 7f9e6a3c5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e6409d6f0 0x7f9e6411e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:02.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.164+0000 7f9e6a3c5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9e6409e000 0x7f9e6411e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:02.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.164+0000 7f9e6a3c5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e6409e410 0x7f9e6411ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:02.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.164+0000 7f9e6a3c5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e641206f0 con 0x7f9e6409d6f0 2023-10-01T07:56:02.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.164+0000 7f9e6a3c5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6411fe90 con 0x7f9e6409e410 2023-10-01T07:56:02.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.164+0000 7f9e6a3c5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e64121a90 con 0x7f9e6409e000 2023-10-01T07:56:02.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.164+0000 7f9e68962700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e6409e410 0x7f9e6411ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:02.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.164+0000 7f9e63fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e6409d6f0 0x7f9e6411e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:02.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.164+0000 7f9e68962700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e6409e410 0x7f9e6411ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:55530/0 (socket says 172.21.15.26:55530) 2023-10-01T07:56:02.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.164+0000 7f9e68962700 1 -- 172.21.15.26:0/3176918871 learned_addr learned my addr 172.21.15.26:0/3176918871 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:02.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.164+0000 7f9e68962700 1 -- 172.21.15.26:0/3176918871 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9e6409e000 msgr2=0x7f9e6411e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:02.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.164+0000 7f9e68962700 1 --2- 172.21.15.26:0/3176918871 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9e6409e000 0x7f9e6411e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.165+0000 7f9e68962700 1 -- 172.21.15.26:0/3176918871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e6409d6f0 msgr2=0x7f9e6411e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:02.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.165+0000 7f9e68962700 1 --2- 172.21.15.26:0/3176918871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e6409d6f0 0x7f9e6411e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.165+0000 7f9e68962700 1 -- 172.21.15.26:0/3176918871 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e5c009a70 con 0x7f9e6409e410 2023-10-01T07:56:02.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.165+0000 7f9e63fff700 1 --2- 172.21.15.26:0/3176918871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e6409d6f0 0x7f9e6411e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:02.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.165+0000 7f9e68962700 1 --2- 172.21.15.26:0/3176918871 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e6409e410 0x7f9e6411ee30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c004000 tx=0x7f9e5c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:02.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.165+0000 7f9e60ff9700 1 -- 172.21.15.26:0/3176918871 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c012630 con 0x7f9e6409e410 2023-10-01T07:56:02.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.165+0000 7f9e60ff9700 1 -- 172.21.15.26:0/3176918871 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e5c012790 con 0x7f9e6409e410 2023-10-01T07:56:02.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.165+0000 7f9e6a3c5700 1 -- 172.21.15.26:0/3176918871 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e64121530 con 0x7f9e6409e410 2023-10-01T07:56:02.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.165+0000 7f9e60ff9700 1 -- 172.21.15.26:0/3176918871 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c012b40 con 0x7f9e6409e410 2023-10-01T07:56:02.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.165+0000 7f9e6a3c5700 1 -- 172.21.15.26:0/3176918871 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e64130d30 con 0x7f9e6409e410 2023-10-01T07:56:02.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.166+0000 7f9e4a7fc700 1 -- 172.21.15.26:0/3176918871 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e3c0052e0 con 0x7f9e6409e410 2023-10-01T07:56:02.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.167+0000 7f9e60ff9700 1 -- 172.21.15.26:0/3176918871 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9e5c012ca0 con 0x7f9e6409e410 2023-10-01T07:56:02.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.167+0000 7f9e60ff9700 1 -- 172.21.15.26:0/3176918871 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9e5c041c80 con 0x7f9e6409e410 2023-10-01T07:56:02.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.176+0000 7f9e60ff9700 1 -- 172.21.15.26:0/3176918871 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9e5c01d420 con 0x7f9e6409e410 2023-10-01T07:56:02.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.296+0000 7fa58c9a6700 1 -- 172.21.15.26:0/4155158838 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa58806b9e0 con 0x7fa588135e60 2023-10-01T07:56:02.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.297+0000 7fa576ffd700 1 -- 172.21.15.26:0/4155158838 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa5800143d0 con 0x7fa588135e60 2023-10-01T07:56:02.297 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:02.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.299+0000 7fa58c9a6700 1 -- 172.21.15.26:0/4155158838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa588135e60 msgr2=0x7fa58809cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:02.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.299+0000 7fa58c9a6700 1 --2- 172.21.15.26:0/4155158838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa588135e60 0x7fa58809cfa0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa58000bec0 tx=0x7fa58000f410 comp rx=0 tx=0).stop 2023-10-01T07:56:02.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.299+0000 7fa58c9a6700 1 -- 172.21.15.26:0/4155158838 shutdown_connections 2023-10-01T07:56:02.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.299+0000 7fa58c9a6700 1 --2- 172.21.15.26:0/4155158838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa588135e60 0x7fa58809cfa0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.299+0000 7fa58c9a6700 1 --2- 172.21.15.26:0/4155158838 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa588130540 0x7fa58809c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.299+0000 7fa58c9a6700 1 --2- 172.21.15.26:0/4155158838 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa588133540 0x7fa58809ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.299+0000 7fa58c9a6700 1 -- 172.21.15.26:0/4155158838 >> 172.21.15.26:0/4155158838 conn(0x7fa5880a2aa0 msgr2=0x7fa588131320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:02.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.299+0000 7fa58c9a6700 1 -- 172.21.15.26:0/4155158838 shutdown_connections 2023-10-01T07:56:02.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.299+0000 7fa58c9a6700 1 -- 172.21.15.26:0/4155158838 wait complete. 2023-10-01T07:56:02.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:02.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.337+0000 7fd34fed2700 1 -- 172.21.15.26:0/1147476597 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd348074ea0 con 0x7fd34809de50 2023-10-01T07:56:02.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.337+0000 7fd33e7fc700 1 -- 172.21.15.26:0/1147476597 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd344021070 con 0x7fd34809de50 2023-10-01T07:56:02.338 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:02.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.340+0000 7fd34fed2700 1 -- 172.21.15.26:0/1147476597 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd34809de50 msgr2=0x7fd348118cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:02.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.340+0000 7fd34fed2700 1 --2- 172.21.15.26:0/1147476597 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd34809de50 0x7fd348118cd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd34400e940 tx=0x7fd34400ed00 comp rx=0 tx=0).stop 2023-10-01T07:56:02.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.340+0000 7fd34fed2700 1 -- 172.21.15.26:0/1147476597 shutdown_connections 2023-10-01T07:56:02.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.340+0000 7fd34fed2700 1 --2- 172.21.15.26:0/1147476597 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd3481338a0 0x7fd348119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.340+0000 7fd34fed2700 1 --2- 172.21.15.26:0/1147476597 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd34809de50 0x7fd348118cd0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.340+0000 7fd34fed2700 1 --2- 172.21.15.26:0/1147476597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd34809e760 0x7fd348119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.340+0000 7fd34fed2700 1 -- 172.21.15.26:0/1147476597 >> 172.21.15.26:0/1147476597 conn(0x7fd3480a2aa0 msgr2=0x7fd34812f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:02.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.340+0000 7fd34fed2700 1 -- 172.21.15.26:0/1147476597 shutdown_connections 2023-10-01T07:56:02.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.340+0000 7fd34fed2700 1 -- 172.21.15.26:0/1147476597 wait complete. 2023-10-01T07:56:02.355 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:02.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.362+0000 7f9c44fb3700 1 -- 172.21.15.26:0/160816848 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9c400713a0 con 0x7f9c28004430 2023-10-01T07:56:02.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.363+0000 7f9c2effd700 1 -- 172.21.15.26:0/160816848 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9c34017020 con 0x7f9c28004430 2023-10-01T07:56:02.363 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:02.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.365+0000 7f9c44fb3700 1 -- 172.21.15.26:0/160816848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c28004430 msgr2=0x7f9c4009bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:02.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.365+0000 7f9c44fb3700 1 --2- 172.21.15.26:0/160816848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c28004430 0x7f9c4009bd80 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400e8b0 tx=0x7f9c3400ebc0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.365+0000 7f9c44fb3700 1 -- 172.21.15.26:0/160816848 shutdown_connections 2023-10-01T07:56:02.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.365+0000 7f9c44fb3700 1 --2- 172.21.15.26:0/160816848 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c4012cf60 0x7f9c401c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.365+0000 7f9c44fb3700 1 --2- 172.21.15.26:0/160816848 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c28003a00 0x7f9c4009b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.365+0000 7f9c44fb3700 1 --2- 172.21.15.26:0/160816848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c28004430 0x7f9c4009bd80 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.365+0000 7f9c44fb3700 1 -- 172.21.15.26:0/160816848 >> 172.21.15.26:0/160816848 conn(0x7f9c400a2aa0 msgr2=0x7f9c4012a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:02.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.365+0000 7f9c44fb3700 1 -- 172.21.15.26:0/160816848 shutdown_connections 2023-10-01T07:56:02.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.365+0000 7f9c44fb3700 1 -- 172.21.15.26:0/160816848 wait complete. 2023-10-01T07:56:02.379 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:02.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.401+0000 7f9e4a7fc700 1 -- 172.21.15.26:0/3176918871 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9e3c005590 con 0x7f9e6409e410 2023-10-01T07:56:02.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.402+0000 7f9e60ff9700 1 -- 172.21.15.26:0/3176918871 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9e5c011390 con 0x7f9e6409e410 2023-10-01T07:56:02.402 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:02.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.404+0000 7f9e4a7fc700 1 -- 172.21.15.26:0/3176918871 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e6409e410 msgr2=0x7f9e6411ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:02.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.404+0000 7f9e4a7fc700 1 --2- 172.21.15.26:0/3176918871 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e6409e410 0x7f9e6411ee30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c004000 tx=0x7f9e5c004ad0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.404+0000 7f9e4a7fc700 1 -- 172.21.15.26:0/3176918871 shutdown_connections 2023-10-01T07:56:02.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.404+0000 7f9e4a7fc700 1 --2- 172.21.15.26:0/3176918871 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e6409e410 0x7f9e6411ee30 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.404+0000 7f9e4a7fc700 1 --2- 172.21.15.26:0/3176918871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e6409d6f0 0x7f9e6411e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.404+0000 7f9e4a7fc700 1 --2- 172.21.15.26:0/3176918871 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9e6409e000 0x7f9e6411e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:02.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.404+0000 7f9e4a7fc700 1 -- 172.21.15.26:0/3176918871 >> 172.21.15.26:0/3176918871 conn(0x7f9e64066f50 msgr2=0x7f9e6406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:02.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.404+0000 7f9e4a7fc700 1 -- 172.21.15.26:0/3176918871 shutdown_connections 2023-10-01T07:56:02.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:02.404+0000 7f9e4a7fc700 1 -- 172.21.15.26:0/3176918871 wait complete. 2023-10-01T07:56:02.418 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:03.316 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:03.356 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:03.380 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:03.419 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:03.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.469+0000 7f2f4b639700 1 Processor -- start 2023-10-01T07:56:03.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.469+0000 7f2f4b639700 1 -- start start 2023-10-01T07:56:03.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.470+0000 7f2f4b639700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f441338a0 0x7f2f44133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:03.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.470+0000 7f2f4b639700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f4409e930 0x7f2f4413b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:03.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.470+0000 7f2f4b639700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f4406ef30 con 0x7f2f4409de50 2023-10-01T07:56:03.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.470+0000 7f2f4b639700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4406fef0 con 0x7f2f4409e930 2023-10-01T07:56:03.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.470+0000 7f2f4b639700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f441334b0 con 0x7f2f441338a0 2023-10-01T07:56:03.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.470+0000 7f2f49bd6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f4409e930 0x7f2f4413b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:03.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.470+0000 7f2f48bd4700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2f4409de50 0x7f2f4409e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57418/0 (socket says 172.21.15.26:57418) 2023-10-01T07:56:03.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.470+0000 7f2f49bd6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f4409e930 0x7f2f4413b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:40890/0 (socket says 172.21.15.26:40890) 2023-10-01T07:56:03.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.470+0000 7f2f48bd4700 1 -- 172.21.15.26:0/1753231811 learned_addr learned my addr 172.21.15.26:0/1753231811 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:03.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.470+0000 7f2f493d5700 1 --2- 172.21.15.26:0/1753231811 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f441338a0 0x7f2f44133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:03.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.471+0000 7f2f3bfff700 1 -- 172.21.15.26:0/1753231811 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3477437913 0 0) 0x7f2f4406ef30 con 0x7f2f4409de50 2023-10-01T07:56:03.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.471+0000 7f2f3bfff700 1 -- 172.21.15.26:0/1753231811 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f300035b0 con 0x7f2f4409de50 2023-10-01T07:56:03.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.471+0000 7f2f493d5700 1 -- 172.21.15.26:0/1753231811 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f4409e930 msgr2=0x7f2f4413b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:03.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.471+0000 7f2f493d5700 1 --2- 172.21.15.26:0/1753231811 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f4409e930 0x7f2f4413b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.471+0000 7f2f493d5700 1 -- 172.21.15.26:0/1753231811 >> v1:172.21.15.26:6789/0 conn(0x7f2f4409de50 legacy=0x7f2f4409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:03.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.471+0000 7f2f493d5700 1 -- 172.21.15.26:0/1753231811 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f4406fc30 con 0x7f2f441338a0 2023-10-01T07:56:03.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.471+0000 7f2f493d5700 1 --2- 172.21.15.26:0/1753231811 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f441338a0 0x7f2f44133c70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2f40009870 tx=0x7f2f40009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18e3d791c92c6163 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:03.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.471+0000 7f2f3bfff700 1 -- 172.21.15.26:0/1753231811 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f40011830 con 0x7f2f441338a0 2023-10-01T07:56:03.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.471+0000 7f2f3bfff700 1 -- 172.21.15.26:0/1753231811 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f40011990 con 0x7f2f441338a0 2023-10-01T07:56:03.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.471+0000 7f2f3bfff700 1 -- 172.21.15.26:0/1753231811 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f40011d20 con 0x7f2f441338a0 2023-10-01T07:56:03.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.472+0000 7f2f4b639700 1 -- 172.21.15.26:0/1753231811 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f441338a0 msgr2=0x7f2f44133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:03.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.472+0000 7f2f4b639700 1 --2- 172.21.15.26:0/1753231811 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f441338a0 0x7f2f44133c70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2f40009870 tx=0x7f2f40009b80 comp rx=0 tx=0).stop 2023-10-01T07:56:03.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.473+0000 7f2f4b639700 1 -- 172.21.15.26:0/1753231811 shutdown_connections 2023-10-01T07:56:03.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.473+0000 7f2f4b639700 1 --2- 172.21.15.26:0/1753231811 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f441338a0 0x7f2f44133c70 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.473+0000 7f2f4b639700 1 --2- 172.21.15.26:0/1753231811 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f4409e930 0x7f2f4413b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.473+0000 7f2f4b639700 1 -- 172.21.15.26:0/1753231811 >> 172.21.15.26:0/1753231811 conn(0x7f2f440a2aa0 msgr2=0x7f2f440a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:03.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.473+0000 7f2f4b639700 1 -- 172.21.15.26:0/1753231811 shutdown_connections 2023-10-01T07:56:03.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.473+0000 7f2f4b639700 1 -- 172.21.15.26:0/1753231811 wait complete. 2023-10-01T07:56:03.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.474+0000 7f2f4b639700 1 Processor -- start 2023-10-01T07:56:03.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.474+0000 7f2f4b639700 1 -- start start 2023-10-01T07:56:03.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.475+0000 7f2f4b639700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f4409de50 0x7f2f4411d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:03.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.475+0000 7f2f4b639700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f4409e930 0x7f2f4411dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:03.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.475+0000 7f2f4b639700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f441338a0 0x7f2f4411e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:03.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.475+0000 7f2f4b639700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f44120f90 con 0x7f2f4409e930 2023-10-01T07:56:03.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.475+0000 7f2f4b639700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f44121b50 con 0x7f2f441338a0 2023-10-01T07:56:03.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.475+0000 7f2f4b639700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4411f2b0 con 0x7f2f4409de50 2023-10-01T07:56:03.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.475+0000 7f2f493d5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f4409de50 0x7f2f4411d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:03.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.475+0000 7f2f493d5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f4409de50 0x7f2f4411d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49920/0 (socket says 172.21.15.26:49920) 2023-10-01T07:56:03.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.475+0000 7f2f493d5700 1 -- 172.21.15.26:0/309236248 learned_addr learned my addr 172.21.15.26:0/309236248 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:03.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.475+0000 7f2f48bd4700 1 --2- 172.21.15.26:0/309236248 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f4409e930 0x7f2f4411dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:03.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.475+0000 7f2f49bd6700 1 --2- 172.21.15.26:0/309236248 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f441338a0 0x7f2f4411e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:03.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.475+0000 7f2f493d5700 1 -- 172.21.15.26:0/309236248 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f441338a0 msgr2=0x7f2f4411e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:03.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.475+0000 7f2f493d5700 1 --2- 172.21.15.26:0/309236248 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f441338a0 0x7f2f4411e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.475+0000 7f2f493d5700 1 -- 172.21.15.26:0/309236248 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f4409e930 msgr2=0x7f2f4411dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:03.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.475+0000 7f2f493d5700 1 --2- 172.21.15.26:0/309236248 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f4409e930 0x7f2f4411dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.475+0000 7f2f493d5700 1 -- 172.21.15.26:0/309236248 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f400094a0 con 0x7f2f4409de50 2023-10-01T07:56:03.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.476+0000 7f2f493d5700 1 --2- 172.21.15.26:0/309236248 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f4409de50 0x7f2f4411d7b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2f40009bc0 tx=0x7f2f40004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:03.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.476+0000 7f2f39ffb700 1 -- 172.21.15.26:0/309236248 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f40004510 con 0x7f2f4409de50 2023-10-01T07:56:03.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.476+0000 7f2f39ffb700 1 -- 172.21.15.26:0/309236248 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f400036a0 con 0x7f2f4409de50 2023-10-01T07:56:03.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.476+0000 7f2f39ffb700 1 -- 172.21.15.26:0/309236248 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f40003a50 con 0x7f2f4409de50 2023-10-01T07:56:03.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.477+0000 7f2f4b639700 1 -- 172.21.15.26:0/309236248 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f440a0d40 con 0x7f2f4409de50 2023-10-01T07:56:03.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.478+0000 7f2f4b639700 1 -- 172.21.15.26:0/309236248 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f44120010 con 0x7f2f4409de50 2023-10-01T07:56:03.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.479+0000 7f2f39ffb700 1 -- 172.21.15.26:0/309236248 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2f40003bb0 con 0x7f2f4409de50 2023-10-01T07:56:03.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.479+0000 7f2f4b639700 1 -- 172.21.15.26:0/309236248 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f4411a470 con 0x7f2f4409de50 2023-10-01T07:56:03.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.479+0000 7f2f39ffb700 1 -- 172.21.15.26:0/309236248 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2f40040910 con 0x7f2f4409de50 2023-10-01T07:56:03.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.485+0000 7f2f39ffb700 1 -- 172.21.15.26:0/309236248 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2f40015080 con 0x7f2f4409de50 2023-10-01T07:56:03.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.506+0000 7f50e4862700 1 Processor -- start 2023-10-01T07:56:03.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.506+0000 7f50e4862700 1 -- start start 2023-10-01T07:56:03.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.506+0000 7f50e4862700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f50e009e930 0x7f50e009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:03.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.506+0000 7f50e4862700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f50e009f650 0x7f50e0131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:03.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.507+0000 7f50e4862700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e0070940 con 0x7f50e009f240 2023-10-01T07:56:03.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.507+0000 7f50e4862700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50e006fd60 con 0x7f50e009f650 2023-10-01T07:56:03.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.507+0000 7f50e4862700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50e006fa80 con 0x7f50e009e930 2023-10-01T07:56:03.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.507+0000 7f50de59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f50e009e930 0x7f50e009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:03.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.507+0000 7f50de59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f50e009e930 0x7f50e009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49930/0 (socket says 172.21.15.26:49930) 2023-10-01T07:56:03.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.507+0000 7f50de59c700 1 -- 172.21.15.26:0/1260325614 learned_addr learned my addr 172.21.15.26:0/1260325614 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:03.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.507+0000 7f50de59c700 1 -- 172.21.15.26:0/1260325614 >> v2:172.21.15.26:3300/0 conn(0x7f50e009f650 msgr2=0x7f50e0131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:03.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.507+0000 7f50de59c700 1 --2- 172.21.15.26:0/1260325614 >> v2:172.21.15.26:3300/0 conn(0x7f50e009f650 0x7f50e0131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.507+0000 7f50de59c700 1 -- 172.21.15.26:0/1260325614 >> v1:172.21.15.26:6789/0 conn(0x7f50e009f240 legacy=0x7f50e01317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:03.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.507+0000 7f50de59c700 1 -- 172.21.15.26:0/1260325614 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e009fb60 con 0x7f50e009e930 2023-10-01T07:56:03.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.507+0000 7f50de59c700 1 --2- 172.21.15.26:0/1260325614 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f50e009e930 0x7f50e009ed00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f50d00098f0 tx=0x7f50d0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=843c46c191a3cb9e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:03.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.507+0000 7f50dd59a700 1 -- 172.21.15.26:0/1260325614 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d0004230 con 0x7f50e009e930 2023-10-01T07:56:03.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.508+0000 7f50dd59a700 1 -- 172.21.15.26:0/1260325614 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d0004390 con 0x7f50e009e930 2023-10-01T07:56:03.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.508+0000 7f50dd59a700 1 -- 172.21.15.26:0/1260325614 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d00036a0 con 0x7f50e009e930 2023-10-01T07:56:03.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.508+0000 7f50e4862700 1 -- 172.21.15.26:0/1260325614 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f50e009e930 msgr2=0x7f50e009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:03.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.508+0000 7f50e4862700 1 --2- 172.21.15.26:0/1260325614 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f50e009e930 0x7f50e009ed00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f50d00098f0 tx=0x7f50d0009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:03.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.508+0000 7f50e4862700 1 -- 172.21.15.26:0/1260325614 shutdown_connections 2023-10-01T07:56:03.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.508+0000 7f50e4862700 1 --2- 172.21.15.26:0/1260325614 >> v2:172.21.15.26:3300/0 conn(0x7f50e009f650 0x7f50e0131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.508+0000 7f50e4862700 1 --2- 172.21.15.26:0/1260325614 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f50e009e930 0x7f50e009ed00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.508+0000 7f50e4862700 1 -- 172.21.15.26:0/1260325614 >> 172.21.15.26:0/1260325614 conn(0x7f50e00a4210 msgr2=0x7f50e00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:03.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.509+0000 7f50e4862700 1 -- 172.21.15.26:0/1260325614 shutdown_connections 2023-10-01T07:56:03.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.509+0000 7f50e4862700 1 -- 172.21.15.26:0/1260325614 wait complete. 2023-10-01T07:56:03.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.510+0000 7f50e4862700 1 Processor -- start 2023-10-01T07:56:03.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.510+0000 7f50e4862700 1 -- start start 2023-10-01T07:56:03.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.510+0000 7f50e4862700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f50e009e930 0x7f50e01a3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:03.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.510+0000 7f50e4862700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f50e009f240 0x7f50e01a4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:03.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.510+0000 7f50e4862700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50e009f650 0x7f50e01a47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:03.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.510+0000 7f50e4862700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e01a5940 con 0x7f50e009f650 2023-10-01T07:56:03.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.510+0000 7f50e4862700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e01a6b90 con 0x7f50e009e930 2023-10-01T07:56:03.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.510+0000 7f50e4862700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50e01a5f20 con 0x7f50e009f240 2023-10-01T07:56:03.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.511+0000 7f50de59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f50e009e930 0x7f50e01a3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:03.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.511+0000 7f50ddd9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f50e009f240 0x7f50e01a4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:03.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.511+0000 7f50de59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f50e009e930 0x7f50e01a3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:40896/0 (socket says 172.21.15.26:40896) 2023-10-01T07:56:03.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.511+0000 7f50de59c700 1 -- 172.21.15.26:0/174096203 learned_addr learned my addr 172.21.15.26:0/174096203 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:03.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.511+0000 7f50ded9d700 1 --2- 172.21.15.26:0/174096203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50e009f650 0x7f50e01a47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:03.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.511+0000 7f50ddd9b700 1 -- 172.21.15.26:0/174096203 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f50e009e930 msgr2=0x7f50e01a3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:03.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.511+0000 7f50ddd9b700 1 --2- 172.21.15.26:0/174096203 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f50e009e930 0x7f50e01a3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.511+0000 7f50ddd9b700 1 -- 172.21.15.26:0/174096203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50e009f650 msgr2=0x7f50e01a47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:03.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.511+0000 7f50ddd9b700 1 --2- 172.21.15.26:0/174096203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50e009f650 0x7f50e01a47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.511+0000 7f50ddd9b700 1 -- 172.21.15.26:0/174096203 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d0009550 con 0x7f50e009f240 2023-10-01T07:56:03.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.511+0000 7f50ddd9b700 1 --2- 172.21.15.26:0/174096203 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f50e009f240 0x7f50e01a4270 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f50e006e6c0 tx=0x7f50d400c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:03.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.512+0000 7f50ceffd700 1 -- 172.21.15.26:0/174096203 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d40052d0 con 0x7f50e009f240 2023-10-01T07:56:03.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.512+0000 7f50ceffd700 1 -- 172.21.15.26:0/174096203 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d4005430 con 0x7f50e009f240 2023-10-01T07:56:03.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.512+0000 7f50e4862700 1 -- 172.21.15.26:0/174096203 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e00a0190 con 0x7f50e009f240 2023-10-01T07:56:03.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.512+0000 7f50ceffd700 1 -- 172.21.15.26:0/174096203 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d40038c0 con 0x7f50e009f240 2023-10-01T07:56:03.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.512+0000 7f50e4862700 1 -- 172.21.15.26:0/174096203 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e00a3610 con 0x7f50e009f240 2023-10-01T07:56:03.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.513+0000 7f50ceffd700 1 -- 172.21.15.26:0/174096203 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f50d4003c30 con 0x7f50e009f240 2023-10-01T07:56:03.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.513+0000 7f50ceffd700 1 -- 172.21.15.26:0/174096203 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f50d403eb20 con 0x7f50e009f240 2023-10-01T07:56:03.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.513+0000 7f50e4862700 1 -- 172.21.15.26:0/174096203 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e01a0b30 con 0x7f50e009f240 2023-10-01T07:56:03.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.518+0000 7f50ceffd700 1 -- 172.21.15.26:0/174096203 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f50d4017070 con 0x7f50e009f240 2023-10-01T07:56:03.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.551+0000 7f38b2a9c700 1 Processor -- start 2023-10-01T07:56:03.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.551+0000 7f38b2a9c700 1 -- start start 2023-10-01T07:56:03.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.552+0000 7f38b2a9c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f38ac09d6f0 0x7f38ac09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:03.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.552+0000 7f38b2a9c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f38ac09e000 0x7f38ac130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:03.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.552+0000 7f38b2a9c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f38ac09e410 0x7f38ac130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:03.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.552+0000 7f38b2a9c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38ac09f520 con 0x7f38ac09d6f0 2023-10-01T07:56:03.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.552+0000 7f38b2a9c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac09f130 con 0x7f38ac09e410 2023-10-01T07:56:03.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.552+0000 7f38b2a9c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac09e930 con 0x7f38ac09e000 2023-10-01T07:56:03.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.552+0000 7f38abfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f38ac09e000 0x7f38ac130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:03.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.552+0000 7f38abfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f38ac09e000 0x7f38ac130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49950/0 (socket says 172.21.15.26:49950) 2023-10-01T07:56:03.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.552+0000 7f38abfff700 1 -- 172.21.15.26:0/1847800262 learned_addr learned my addr 172.21.15.26:0/1847800262 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:03.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.552+0000 7f38b1039700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f38ac09e410 0x7f38ac130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:03.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.552+0000 7f38b0838700 1 --2- 172.21.15.26:0/1847800262 >> v2:172.21.15.26:3300/0 conn(0x7f38ac09d6f0 0x7f38ac09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:03.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.553+0000 7f38b0838700 1 -- 172.21.15.26:0/1847800262 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f38ac09e000 msgr2=0x7f38ac130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:03.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.553+0000 7f38b0838700 1 --2- 172.21.15.26:0/1847800262 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f38ac09e000 0x7f38ac130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.553+0000 7f38b0838700 1 -- 172.21.15.26:0/1847800262 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f38ac09e410 msgr2=0x7f38ac130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:03.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.553+0000 7f38b0838700 1 --2- 172.21.15.26:0/1847800262 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f38ac09e410 0x7f38ac130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.553+0000 7f38b0838700 1 -- 172.21.15.26:0/1847800262 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ac09b2d0 con 0x7f38ac09d6f0 2023-10-01T07:56:03.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.553+0000 7f38b0838700 1 --2- 172.21.15.26:0/1847800262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38ac09d6f0 0x7f38ac09dac0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f389c009870 tx=0x7f389c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=420e325a5bdfe65e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:03.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.553+0000 7f38ab7fe700 1 -- 172.21.15.26:0/1847800262 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c011830 con 0x7f38ac09d6f0 2023-10-01T07:56:03.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.553+0000 7f38ab7fe700 1 -- 172.21.15.26:0/1847800262 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389c011990 con 0x7f38ac09d6f0 2023-10-01T07:56:03.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.553+0000 7f38ab7fe700 1 -- 172.21.15.26:0/1847800262 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c011d20 con 0x7f38ac09d6f0 2023-10-01T07:56:03.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.554+0000 7f38b2a9c700 1 -- 172.21.15.26:0/1847800262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38ac09d6f0 msgr2=0x7f38ac09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:03.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.554+0000 7f38b2a9c700 1 --2- 172.21.15.26:0/1847800262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38ac09d6f0 0x7f38ac09dac0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f389c009870 tx=0x7f389c009b80 comp rx=0 tx=0).stop 2023-10-01T07:56:03.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.554+0000 7f38b2a9c700 1 -- 172.21.15.26:0/1847800262 shutdown_connections 2023-10-01T07:56:03.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.554+0000 7f38b2a9c700 1 --2- 172.21.15.26:0/1847800262 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f38ac09e410 0x7f38ac130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.554+0000 7f38b2a9c700 1 --2- 172.21.15.26:0/1847800262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38ac09d6f0 0x7f38ac09dac0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.554+0000 7f38b2a9c700 1 --2- 172.21.15.26:0/1847800262 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f38ac09e000 0x7f38ac130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.554+0000 7f38b2a9c700 1 -- 172.21.15.26:0/1847800262 >> 172.21.15.26:0/1847800262 conn(0x7f38ac066f50 msgr2=0x7f38ac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:03.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.554+0000 7f38b2a9c700 1 -- 172.21.15.26:0/1847800262 shutdown_connections 2023-10-01T07:56:03.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.554+0000 7f38b2a9c700 1 -- 172.21.15.26:0/1847800262 wait complete. 2023-10-01T07:56:03.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.555+0000 7f38b2a9c700 1 Processor -- start 2023-10-01T07:56:03.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.555+0000 7f38b2a9c700 1 -- start start 2023-10-01T07:56:03.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.556+0000 7f38b2a9c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38ac09d6f0 0x7f38ac131650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:03.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.556+0000 7f38b2a9c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f38ac09e000 0x7f38ac131b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:03.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.556+0000 7f38b2a9c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f38ac09e410 0x7f38ac1320d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:03.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.556+0000 7f38b2a9c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac130da0 con 0x7f38ac09d6f0 2023-10-01T07:56:03.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.556+0000 7f38b2a9c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac133d20 con 0x7f38ac09e410 2023-10-01T07:56:03.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.556+0000 7f38b2a9c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac132b70 con 0x7f38ac09e000 2023-10-01T07:56:03.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.557+0000 7f38b0838700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38ac09d6f0 0x7f38ac131650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:03.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.557+0000 7f38b0838700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38ac09d6f0 0x7f38ac131650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44662/0 (socket says 172.21.15.26:44662) 2023-10-01T07:56:03.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.557+0000 7f38b0838700 1 -- 172.21.15.26:0/2166635493 learned_addr learned my addr 172.21.15.26:0/2166635493 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:03.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.557+0000 7f38abfff700 1 --2- 172.21.15.26:0/2166635493 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f38ac09e000 0x7f38ac131b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:03.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.557+0000 7f38b1039700 1 --2- 172.21.15.26:0/2166635493 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f38ac09e410 0x7f38ac1320d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:03.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.557+0000 7f38b0838700 1 -- 172.21.15.26:0/2166635493 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f38ac09e000 msgr2=0x7f38ac131b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:03.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.557+0000 7f38b0838700 1 --2- 172.21.15.26:0/2166635493 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f38ac09e000 0x7f38ac131b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.557+0000 7f38b0838700 1 -- 172.21.15.26:0/2166635493 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f38ac09e410 msgr2=0x7f38ac1320d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:03.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.557+0000 7f38b0838700 1 --2- 172.21.15.26:0/2166635493 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f38ac09e410 0x7f38ac1320d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.557+0000 7f38b0838700 1 -- 172.21.15.26:0/2166635493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f389c0094a0 con 0x7f38ac09d6f0 2023-10-01T07:56:03.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.557+0000 7f38abfff700 1 --2- 172.21.15.26:0/2166635493 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f38ac09e000 0x7f38ac131b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:03.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.557+0000 7f38b0838700 1 --2- 172.21.15.26:0/2166635493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38ac09d6f0 0x7f38ac131650 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f389c0090b0 tx=0x7f389c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:03.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.558+0000 7f38a97fa700 1 -- 172.21.15.26:0/2166635493 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c004450 con 0x7f38ac09d6f0 2023-10-01T07:56:03.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.558+0000 7f38a97fa700 1 -- 172.21.15.26:0/2166635493 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389c01f070 con 0x7f38ac09d6f0 2023-10-01T07:56:03.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.558+0000 7f38b2a9c700 1 -- 172.21.15.26:0/2166635493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38ac134700 con 0x7f38ac09d6f0 2023-10-01T07:56:03.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.558+0000 7f38a97fa700 1 -- 172.21.15.26:0/2166635493 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c0038a0 con 0x7f38ac09d6f0 2023-10-01T07:56:03.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.558+0000 7f38b2a9c700 1 -- 172.21.15.26:0/2166635493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38ac09c700 con 0x7f38ac09d6f0 2023-10-01T07:56:03.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.559+0000 7f38a97fa700 1 -- 172.21.15.26:0/2166635493 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f389c003a00 con 0x7f38ac09d6f0 2023-10-01T07:56:03.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.559+0000 7f38b2a9c700 1 -- 172.21.15.26:0/2166635493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38ac131090 con 0x7f38ac09d6f0 2023-10-01T07:56:03.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.559+0000 7f38a97fa700 1 -- 172.21.15.26:0/2166635493 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f389c021070 con 0x7f38ac09d6f0 2023-10-01T07:56:03.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.564+0000 7f38a97fa700 1 -- 172.21.15.26:0/2166635493 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f389c0045b0 con 0x7f38ac09d6f0 2023-10-01T07:56:03.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.602+0000 7fc530137700 1 Processor -- start 2023-10-01T07:56:03.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.602+0000 7fc530137700 1 -- start start 2023-10-01T07:56:03.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.603+0000 7fc530137700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc528130540 0x7fc528130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:03.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.603+0000 7fc530137700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc528130e50 0x7fc52806f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:03.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.603+0000 7fc530137700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5280716a0 con 0x7fc52806fb20 2023-10-01T07:56:03.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.603+0000 7fc530137700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc52809a390 con 0x7fc528130540 2023-10-01T07:56:03.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.603+0000 7fc530137700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc528071290 con 0x7fc528130e50 2023-10-01T07:56:03.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.603+0000 7fc52ded3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc528130540 0x7fc528130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:03.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.603+0000 7fc52ded3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc528130540 0x7fc528130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:40932/0 (socket says 172.21.15.26:40932) 2023-10-01T07:56:03.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.603+0000 7fc52ded3700 1 -- 172.21.15.26:0/311609908 learned_addr learned my addr 172.21.15.26:0/311609908 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:03.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.603+0000 7fc52d6d2700 1 --2- 172.21.15.26:0/311609908 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc528130e50 0x7fc52806f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:03.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.603+0000 7fc52ded3700 1 -- 172.21.15.26:0/311609908 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc528130e50 msgr2=0x7fc52806f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:03.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.603+0000 7fc52ded3700 1 --2- 172.21.15.26:0/311609908 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc528130e50 0x7fc52806f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.603+0000 7fc52ded3700 1 -- 172.21.15.26:0/311609908 >> v1:172.21.15.26:6789/0 conn(0x7fc52806fb20 legacy=0x7fc528137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:03.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.603+0000 7fc52ced1700 1 -- 172.21.15.26:0/311609908 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3545671609 0 0) 0x7fc5280716a0 con 0x7fc52806fb20 2023-10-01T07:56:03.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.603+0000 7fc52ded3700 1 -- 172.21.15.26:0/311609908 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc528130340 con 0x7fc528130540 2023-10-01T07:56:03.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.603+0000 7fc52d6d2700 1 --2- 172.21.15.26:0/311609908 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc528130e50 0x7fc52806f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:03.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.604+0000 7fc52ded3700 1 --2- 172.21.15.26:0/311609908 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc528130540 0x7fc528130910 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc524009950 tx=0x7fc524009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=728676036943a53b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:03.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.604+0000 7fc52ced1700 1 -- 172.21.15.26:0/311609908 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc524011830 con 0x7fc528130540 2023-10-01T07:56:03.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.604+0000 7fc52ced1700 1 -- 172.21.15.26:0/311609908 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc524011990 con 0x7fc528130540 2023-10-01T07:56:03.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.604+0000 7fc52ced1700 1 -- 172.21.15.26:0/311609908 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc524011d40 con 0x7fc528130540 2023-10-01T07:56:03.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.604+0000 7fc530137700 1 -- 172.21.15.26:0/311609908 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc528130540 msgr2=0x7fc528130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:03.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.604+0000 7fc530137700 1 --2- 172.21.15.26:0/311609908 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc528130540 0x7fc528130910 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc524009950 tx=0x7fc524009c60 comp rx=0 tx=0).stop 2023-10-01T07:56:03.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.604+0000 7fc530137700 1 -- 172.21.15.26:0/311609908 shutdown_connections 2023-10-01T07:56:03.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.605+0000 7fc530137700 1 --2- 172.21.15.26:0/311609908 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc528130540 0x7fc528130910 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.605+0000 7fc530137700 1 --2- 172.21.15.26:0/311609908 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc528130e50 0x7fc52806f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.605+0000 7fc530137700 1 -- 172.21.15.26:0/311609908 >> 172.21.15.26:0/311609908 conn(0x7fc5280a2aa0 msgr2=0x7fc5280a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:03.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.605+0000 7fc530137700 1 -- 172.21.15.26:0/311609908 shutdown_connections 2023-10-01T07:56:03.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.605+0000 7fc530137700 1 -- 172.21.15.26:0/311609908 wait complete. 2023-10-01T07:56:03.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.606+0000 7fc530137700 1 Processor -- start 2023-10-01T07:56:03.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.606+0000 7fc530137700 1 -- start start 2023-10-01T07:56:03.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.607+0000 7fc530137700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc52806fb20 0x7fc52812ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:03.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.607+0000 7fc530137700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc528130540 0x7fc52812b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:03.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.607+0000 7fc530137700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc528130e50 0x7fc5281c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:03.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.607+0000 7fc530137700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52812c520 con 0x7fc52806fb20 2023-10-01T07:56:03.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.607+0000 7fc530137700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc52812a930 con 0x7fc528130e50 2023-10-01T07:56:03.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.607+0000 7fc530137700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc52812d7d0 con 0x7fc528130540 2023-10-01T07:56:03.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.607+0000 7fc52d6d2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc528130540 0x7fc52812b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:03.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.607+0000 7fc52d6d2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc528130540 0x7fc52812b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49972/0 (socket says 172.21.15.26:49972) 2023-10-01T07:56:03.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.607+0000 7fc52d6d2700 1 -- 172.21.15.26:0/3237863826 learned_addr learned my addr 172.21.15.26:0/3237863826 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:03.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.607+0000 7fc52e6d4700 1 --2- 172.21.15.26:0/3237863826 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc528130e50 0x7fc5281c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:03.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.607+0000 7fc52ded3700 1 --2- 172.21.15.26:0/3237863826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc52806fb20 0x7fc52812ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:03.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.607+0000 7fc52d6d2700 1 -- 172.21.15.26:0/3237863826 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc528130e50 msgr2=0x7fc5281c5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:03.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.607+0000 7fc52d6d2700 1 --2- 172.21.15.26:0/3237863826 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc528130e50 0x7fc5281c5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.607+0000 7fc52d6d2700 1 -- 172.21.15.26:0/3237863826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc52806fb20 msgr2=0x7fc52812ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:03.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.607+0000 7fc52d6d2700 1 --2- 172.21.15.26:0/3237863826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc52806fb20 0x7fc52812ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.607+0000 7fc52d6d2700 1 -- 172.21.15.26:0/3237863826 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5180094a0 con 0x7fc528130540 2023-10-01T07:56:03.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.608+0000 7fc52d6d2700 1 --2- 172.21.15.26:0/3237863826 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc528130540 0x7fc52812b2c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc51800ebe0 tx=0x7fc51800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:03.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.608+0000 7fc51e7fc700 1 -- 172.21.15.26:0/3237863826 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51800c850 con 0x7fc528130540 2023-10-01T07:56:03.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.608+0000 7fc51e7fc700 1 -- 172.21.15.26:0/3237863826 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51800c9b0 con 0x7fc528130540 2023-10-01T07:56:03.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.608+0000 7fc51e7fc700 1 -- 172.21.15.26:0/3237863826 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51800cd40 con 0x7fc528130540 2023-10-01T07:56:03.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.608+0000 7fc530137700 1 -- 172.21.15.26:0/3237863826 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc524009550 con 0x7fc528130540 2023-10-01T07:56:03.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.608+0000 7fc530137700 1 -- 172.21.15.26:0/3237863826 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc52812b860 con 0x7fc528130540 2023-10-01T07:56:03.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.609+0000 7fc51e7fc700 1 -- 172.21.15.26:0/3237863826 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc518013470 con 0x7fc528130540 2023-10-01T07:56:03.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.609+0000 7fc530137700 1 -- 172.21.15.26:0/3237863826 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc52812de60 con 0x7fc528130540 2023-10-01T07:56:03.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.609+0000 7fc51e7fc700 1 -- 172.21.15.26:0/3237863826 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc51803fc20 con 0x7fc528130540 2023-10-01T07:56:03.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.614+0000 7fc51e7fc700 1 -- 172.21.15.26:0/3237863826 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc518013720 con 0x7fc528130540 2023-10-01T07:56:03.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.786+0000 7f2f4b639700 1 -- 172.21.15.26:0/309236248 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2f441210d0 con 0x7f2f4409de50 2023-10-01T07:56:03.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.786+0000 7f2f39ffb700 1 -- 172.21.15.26:0/309236248 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2f4002e970 con 0x7f2f4409de50 2023-10-01T07:56:03.787 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:03.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.790+0000 7f2f4b639700 1 -- 172.21.15.26:0/309236248 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f4409de50 msgr2=0x7f2f4411d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:03.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.790+0000 7f2f4b639700 1 --2- 172.21.15.26:0/309236248 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f4409de50 0x7f2f4411d7b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2f40009bc0 tx=0x7f2f40004750 comp rx=0 tx=0).stop 2023-10-01T07:56:03.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.790+0000 7f2f4b639700 1 -- 172.21.15.26:0/309236248 shutdown_connections 2023-10-01T07:56:03.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.790+0000 7f2f4b639700 1 --2- 172.21.15.26:0/309236248 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f441338a0 0x7f2f4411e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.790+0000 7f2f4b639700 1 --2- 172.21.15.26:0/309236248 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f4409de50 0x7f2f4411d7b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.790+0000 7f2f4b639700 1 --2- 172.21.15.26:0/309236248 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f4409e930 0x7f2f4411dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.790+0000 7f2f4b639700 1 -- 172.21.15.26:0/309236248 >> 172.21.15.26:0/309236248 conn(0x7f2f440a2aa0 msgr2=0x7f2f441bac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:03.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.790+0000 7f2f4b639700 1 -- 172.21.15.26:0/309236248 shutdown_connections 2023-10-01T07:56:03.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.790+0000 7f2f4b639700 1 -- 172.21.15.26:0/309236248 wait complete. 2023-10-01T07:56:03.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.792+0000 7f38b2a9c700 1 -- 172.21.15.26:0/2166635493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f38ac074ea0 con 0x7f38ac09d6f0 2023-10-01T07:56:03.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.793+0000 7f38a97fa700 1 -- 172.21.15.26:0/2166635493 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f389c015030 con 0x7f38ac09d6f0 2023-10-01T07:56:03.793 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:03.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.795+0000 7f38b2a9c700 1 -- 172.21.15.26:0/2166635493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38ac09d6f0 msgr2=0x7f38ac131650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:03.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.795+0000 7f38b2a9c700 1 --2- 172.21.15.26:0/2166635493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38ac09d6f0 0x7f38ac131650 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f389c0090b0 tx=0x7f389c004750 comp rx=0 tx=0).stop 2023-10-01T07:56:03.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.795+0000 7f38b2a9c700 1 -- 172.21.15.26:0/2166635493 shutdown_connections 2023-10-01T07:56:03.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.795+0000 7f38b2a9c700 1 --2- 172.21.15.26:0/2166635493 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f38ac09e410 0x7f38ac1320d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.795+0000 7f38b2a9c700 1 --2- 172.21.15.26:0/2166635493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38ac09d6f0 0x7f38ac131650 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.795+0000 7f38b2a9c700 1 --2- 172.21.15.26:0/2166635493 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f38ac09e000 0x7f38ac131b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.795+0000 7f38b2a9c700 1 -- 172.21.15.26:0/2166635493 >> 172.21.15.26:0/2166635493 conn(0x7f38ac066f50 msgr2=0x7f38ac070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:03.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.796+0000 7f38b2a9c700 1 -- 172.21.15.26:0/2166635493 shutdown_connections 2023-10-01T07:56:03.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.796+0000 7f38b2a9c700 1 -- 172.21.15.26:0/2166635493 wait complete. 2023-10-01T07:56:03.811 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:03.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.810+0000 7f50e4862700 1 -- 172.21.15.26:0/174096203 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f50e009ffe0 con 0x7f50e009f240 2023-10-01T07:56:03.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.810+0000 7f50ceffd700 1 -- 172.21.15.26:0/174096203 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f50d4011d70 con 0x7f50e009f240 2023-10-01T07:56:03.812 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:03.812 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:03.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.813+0000 7f50e4862700 1 -- 172.21.15.26:0/174096203 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f50e009f240 msgr2=0x7f50e01a4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:03.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.813+0000 7f50e4862700 1 --2- 172.21.15.26:0/174096203 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f50e009f240 0x7f50e01a4270 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f50e006e6c0 tx=0x7f50d400c6e0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.813+0000 7f50e4862700 1 -- 172.21.15.26:0/174096203 shutdown_connections 2023-10-01T07:56:03.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.813+0000 7f50e4862700 1 --2- 172.21.15.26:0/174096203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50e009f650 0x7f50e01a47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.813+0000 7f50e4862700 1 --2- 172.21.15.26:0/174096203 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f50e009e930 0x7f50e01a3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.813+0000 7f50e4862700 1 --2- 172.21.15.26:0/174096203 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f50e009f240 0x7f50e01a4270 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.813+0000 7f50e4862700 1 -- 172.21.15.26:0/174096203 >> 172.21.15.26:0/174096203 conn(0x7f50e00a4210 msgr2=0x7f50e01b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:03.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.813+0000 7f50e4862700 1 -- 172.21.15.26:0/174096203 shutdown_connections 2023-10-01T07:56:03.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.813+0000 7f50e4862700 1 -- 172.21.15.26:0/174096203 wait complete. 2023-10-01T07:56:03.827 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:03.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.846+0000 7fc530137700 1 -- 172.21.15.26:0/3237863826 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc528074ea0 con 0x7fc528130540 2023-10-01T07:56:03.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.847+0000 7fc51e7fc700 1 -- 172.21.15.26:0/3237863826 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc518017070 con 0x7fc528130540 2023-10-01T07:56:03.847 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:03.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.849+0000 7fc530137700 1 -- 172.21.15.26:0/3237863826 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc528130540 msgr2=0x7fc52812b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:03.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.849+0000 7fc530137700 1 --2- 172.21.15.26:0/3237863826 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc528130540 0x7fc52812b2c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc51800ebe0 tx=0x7fc51800eef0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.849+0000 7fc530137700 1 -- 172.21.15.26:0/3237863826 shutdown_connections 2023-10-01T07:56:03.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.849+0000 7fc530137700 1 --2- 172.21.15.26:0/3237863826 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc528130e50 0x7fc5281c5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.849+0000 7fc530137700 1 --2- 172.21.15.26:0/3237863826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc52806fb20 0x7fc52812ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.849+0000 7fc530137700 1 --2- 172.21.15.26:0/3237863826 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc528130540 0x7fc52812b2c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:03.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.849+0000 7fc530137700 1 -- 172.21.15.26:0/3237863826 >> 172.21.15.26:0/3237863826 conn(0x7fc5280a2aa0 msgr2=0x7fc52806e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:03.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.849+0000 7fc530137700 1 -- 172.21.15.26:0/3237863826 shutdown_connections 2023-10-01T07:56:03.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:03.849+0000 7fc530137700 1 -- 172.21.15.26:0/3237863826 wait complete. 2023-10-01T07:56:03.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:04.811 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:04.812 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:04.827 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:04.864 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:04.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.963+0000 7f76a307a700 1 Processor -- start 2023-10-01T07:56:04.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.963+0000 7f76a307a700 1 -- start start 2023-10-01T07:56:04.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.964+0000 7f76a307a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f769c09de00 0x7f769c09e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:04.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.964+0000 7f76a307a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f769c13d1f0 0x7f769c13f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:04.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.964+0000 7f76a307a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f769c09a810 con 0x7f769c06a770 2023-10-01T07:56:04.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.964+0000 7f76a307a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f769c06ab40 con 0x7f769c09de00 2023-10-01T07:56:04.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.964+0000 7f76a307a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f769c09ebc0 con 0x7f769c13d1f0 2023-10-01T07:56:04.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.964+0000 7f76a1617700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f769c13d1f0 0x7f769c13f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:04.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.964+0000 7f76a1617700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f769c13d1f0 0x7f769c13f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49974/0 (socket says 172.21.15.26:49974) 2023-10-01T07:56:04.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.964+0000 7f76a1617700 1 -- 172.21.15.26:0/624178135 learned_addr learned my addr 172.21.15.26:0/624178135 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:04.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.965+0000 7f76a1617700 1 -- 172.21.15.26:0/624178135 >> v2:172.21.15.26:3300/0 conn(0x7f769c09de00 msgr2=0x7f769c09e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:04.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.965+0000 7f76a1617700 1 --2- 172.21.15.26:0/624178135 >> v2:172.21.15.26:3300/0 conn(0x7f769c09de00 0x7f769c09e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:04.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.965+0000 7f76a1617700 1 -- 172.21.15.26:0/624178135 >> v1:172.21.15.26:6789/0 conn(0x7f769c06a770 legacy=0x7f769c09d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:04.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.965+0000 7f76a1617700 1 -- 172.21.15.26:0/624178135 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f769c09e920 con 0x7f769c13d1f0 2023-10-01T07:56:04.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.965+0000 7f76a1617700 1 --2- 172.21.15.26:0/624178135 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f769c13d1f0 0x7f769c13f5d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7694009e50 tx=0x7f769400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6218cec88cfe0c53 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:04.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.965+0000 7f769b7fe700 1 -- 172.21.15.26:0/624178135 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769400e070 con 0x7f769c13d1f0 2023-10-01T07:56:04.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.965+0000 7f769b7fe700 1 -- 172.21.15.26:0/624178135 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7694003a20 con 0x7f769c13d1f0 2023-10-01T07:56:04.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.965+0000 7f769b7fe700 1 -- 172.21.15.26:0/624178135 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7694003dd0 con 0x7f769c13d1f0 2023-10-01T07:56:04.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.966+0000 7f76a307a700 1 -- 172.21.15.26:0/624178135 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f769c13d1f0 msgr2=0x7f769c13f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:04.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.966+0000 7f76a307a700 1 --2- 172.21.15.26:0/624178135 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f769c13d1f0 0x7f769c13f5d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7694009e50 tx=0x7f769400b330 comp rx=0 tx=0).stop 2023-10-01T07:56:04.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.966+0000 7f76a307a700 1 -- 172.21.15.26:0/624178135 shutdown_connections 2023-10-01T07:56:04.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.966+0000 7f76a307a700 1 --2- 172.21.15.26:0/624178135 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f769c13d1f0 0x7f769c13f5d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:04.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.966+0000 7f76a307a700 1 --2- 172.21.15.26:0/624178135 >> v2:172.21.15.26:3300/0 conn(0x7f769c09de00 0x7f769c09e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:04.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.966+0000 7f76a307a700 1 -- 172.21.15.26:0/624178135 >> 172.21.15.26:0/624178135 conn(0x7f769c066f50 msgr2=0x7f769c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:04.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.966+0000 7f76a307a700 1 -- 172.21.15.26:0/624178135 shutdown_connections 2023-10-01T07:56:04.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.966+0000 7f76a307a700 1 -- 172.21.15.26:0/624178135 wait complete. 2023-10-01T07:56:04.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.967+0000 7f76a307a700 1 Processor -- start 2023-10-01T07:56:04.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.967+0000 7f76a307a700 1 -- start start 2023-10-01T07:56:04.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.968+0000 7f76a307a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f769c06a770 0x7f769c1260a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:04.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.968+0000 7f76a307a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f769c09de00 0x7f769c1265e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:04.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.968+0000 7f76a307a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f769c13d1f0 0x7f769c126b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:04.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.968+0000 7f76a307a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769c1286e0 con 0x7f769c13d1f0 2023-10-01T07:56:04.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.968+0000 7f76a307a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f769c1288c0 con 0x7f769c06a770 2023-10-01T07:56:04.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.968+0000 7f76a307a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f769c0a3940 con 0x7f769c09de00 2023-10-01T07:56:04.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.968+0000 7f76a0e16700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f769c06a770 0x7f769c1260a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:04.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.968+0000 7f76a0e16700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f769c06a770 0x7f769c1260a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:40952/0 (socket says 172.21.15.26:40952) 2023-10-01T07:56:04.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.968+0000 7f76a0e16700 1 -- 172.21.15.26:0/2631301921 learned_addr learned my addr 172.21.15.26:0/2631301921 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:04.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.968+0000 7f76a1617700 1 --2- 172.21.15.26:0/2631301921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f769c13d1f0 0x7f769c126b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:04.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.968+0000 7f769bfff700 1 --2- 172.21.15.26:0/2631301921 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f769c09de00 0x7f769c1265e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:04.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.968+0000 7f76a0e16700 1 -- 172.21.15.26:0/2631301921 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f769c09de00 msgr2=0x7f769c1265e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:04.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.969+0000 7f76a0e16700 1 --2- 172.21.15.26:0/2631301921 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f769c09de00 0x7f769c1265e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:04.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.969+0000 7f76a0e16700 1 -- 172.21.15.26:0/2631301921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f769c13d1f0 msgr2=0x7f769c126b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:04.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.969+0000 7f76a0e16700 1 --2- 172.21.15.26:0/2631301921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f769c13d1f0 0x7f769c126b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:04.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.969+0000 7f76a0e16700 1 -- 172.21.15.26:0/2631301921 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7694009b30 con 0x7f769c06a770 2023-10-01T07:56:04.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.969+0000 7f769bfff700 1 --2- 172.21.15.26:0/2631301921 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f769c09de00 0x7f769c1265e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:04.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.969+0000 7f76a0e16700 1 --2- 172.21.15.26:0/2631301921 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f769c06a770 0x7f769c1260a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f769000c4a0 tx=0x7f769000c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:04.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.969+0000 7f76997fa700 1 -- 172.21.15.26:0/2631301921 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76900054e0 con 0x7f769c06a770 2023-10-01T07:56:04.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.969+0000 7f76997fa700 1 -- 172.21.15.26:0/2631301921 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7690003680 con 0x7f769c06a770 2023-10-01T07:56:04.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.969+0000 7f76a307a700 1 -- 172.21.15.26:0/2631301921 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f769c072640 con 0x7f769c06a770 2023-10-01T07:56:04.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.969+0000 7f76997fa700 1 -- 172.21.15.26:0/2631301921 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7690003a30 con 0x7f769c06a770 2023-10-01T07:56:04.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.969+0000 7f76a307a700 1 -- 172.21.15.26:0/2631301921 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f769c071ba0 con 0x7f769c06a770 2023-10-01T07:56:04.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.970+0000 7f76a307a700 1 -- 172.21.15.26:0/2631301921 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f769c074ea0 con 0x7f769c06a770 2023-10-01T07:56:04.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.971+0000 7f76997fa700 1 -- 172.21.15.26:0/2631301921 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7690003b90 con 0x7f769c06a770 2023-10-01T07:56:04.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.971+0000 7f76997fa700 1 -- 172.21.15.26:0/2631301921 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7690010b90 con 0x7f769c06a770 2023-10-01T07:56:04.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.973+0000 7fc4d62b4700 1 Processor -- start 2023-10-01T07:56:04.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.973+0000 7fc4d62b4700 1 -- start start 2023-10-01T07:56:04.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.973+0000 7fc4d62b4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4d01338a0 0x7fc4d0133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:04.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.973+0000 7fc4d62b4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4d009de50 0x7fc4d009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:04.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.973+0000 7fc4d62b4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc4d009e760 0x7fc4d013a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:04.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.973+0000 7fc4d62b4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4d006fef0 con 0x7fc4d009e760 2023-10-01T07:56:04.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.973+0000 7fc4d62b4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d006ef30 con 0x7fc4d01338a0 2023-10-01T07:56:04.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.973+0000 7fc4d62b4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d01334b0 con 0x7fc4d009de50 2023-10-01T07:56:04.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.973+0000 7fc4cffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4d01338a0 0x7fc4d0133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:04.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.973+0000 7fc4cffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4d01338a0 0x7fc4d0133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:40960/0 (socket says 172.21.15.26:40960) 2023-10-01T07:56:04.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.973+0000 7fc4cffff700 1 -- 172.21.15.26:0/1044749976 learned_addr learned my addr 172.21.15.26:0/1044749976 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:04.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.974+0000 7fc4cf7fe700 1 --2- 172.21.15.26:0/1044749976 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4d009de50 0x7fc4d009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:04.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.974+0000 7fc4cffff700 1 -- 172.21.15.26:0/1044749976 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4d009de50 msgr2=0x7fc4d009e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:04.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.974+0000 7fc4cffff700 1 --2- 172.21.15.26:0/1044749976 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4d009de50 0x7fc4d009e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:04.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.974+0000 7fc4cffff700 1 -- 172.21.15.26:0/1044749976 >> v2:172.21.15.26:3300/0 conn(0x7fc4d009e760 msgr2=0x7fc4d013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:04.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.974+0000 7fc4cffff700 1 --2- 172.21.15.26:0/1044749976 >> v2:172.21.15.26:3300/0 conn(0x7fc4d009e760 0x7fc4d013a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:04.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.974+0000 7fc4cffff700 1 -- 172.21.15.26:0/1044749976 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d006fc30 con 0x7fc4d01338a0 2023-10-01T07:56:04.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.974+0000 7fc4cffff700 1 --2- 172.21.15.26:0/1044749976 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4d01338a0 0x7fc4d0133c70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc4c0009920 tx=0x7fc4c0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b61f23bd144cd3a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:04.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.980+0000 7fc4ceffd700 1 -- 172.21.15.26:0/1044749976 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c0011830 con 0x7fc4d01338a0 2023-10-01T07:56:04.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.980+0000 7fc4ceffd700 1 -- 172.21.15.26:0/1044749976 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c0011990 con 0x7fc4d01338a0 2023-10-01T07:56:04.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.980+0000 7fc4ceffd700 1 -- 172.21.15.26:0/1044749976 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c0011d20 con 0x7fc4d01338a0 2023-10-01T07:56:04.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.980+0000 7f76997fa700 1 -- 172.21.15.26:0/2631301921 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7690044060 con 0x7f769c06a770 2023-10-01T07:56:04.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.981+0000 7fc4d62b4700 1 -- 172.21.15.26:0/1044749976 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4d01338a0 msgr2=0x7fc4d0133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:04.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.981+0000 7fc4d62b4700 1 --2- 172.21.15.26:0/1044749976 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4d01338a0 0x7fc4d0133c70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc4c0009920 tx=0x7fc4c0009c30 comp rx=0 tx=0).stop 2023-10-01T07:56:04.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.981+0000 7fc4d62b4700 1 -- 172.21.15.26:0/1044749976 shutdown_connections 2023-10-01T07:56:04.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.981+0000 7fc4d62b4700 1 --2- 172.21.15.26:0/1044749976 >> v2:172.21.15.26:3300/0 conn(0x7fc4d009e760 0x7fc4d013a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:04.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.981+0000 7fc4d62b4700 1 --2- 172.21.15.26:0/1044749976 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4d01338a0 0x7fc4d0133c70 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:04.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.981+0000 7fc4d62b4700 1 --2- 172.21.15.26:0/1044749976 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4d009de50 0x7fc4d009e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:04.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.981+0000 7fc4d62b4700 1 -- 172.21.15.26:0/1044749976 >> 172.21.15.26:0/1044749976 conn(0x7fc4d00a2aa0 msgr2=0x7fc4d00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:04.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.981+0000 7fc4d62b4700 1 -- 172.21.15.26:0/1044749976 shutdown_connections 2023-10-01T07:56:04.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.981+0000 7fc4d62b4700 1 -- 172.21.15.26:0/1044749976 wait complete. 2023-10-01T07:56:04.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.982+0000 7fc4d62b4700 1 Processor -- start 2023-10-01T07:56:04.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.983+0000 7fc4d62b4700 1 -- start start 2023-10-01T07:56:04.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.983+0000 7fc4d62b4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4d009de50 0x7fc4d011d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:04.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.983+0000 7fc4d62b4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4d009e760 0x7fc4d011dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:04.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.983+0000 7fc4d62b4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4d01338a0 0x7fc4d011e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:04.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.983+0000 7fc4d62b4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d011f340 con 0x7fc4d009de50 2023-10-01T07:56:04.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.983+0000 7fc4d62b4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d006f640 con 0x7fc4d009e760 2023-10-01T07:56:04.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.983+0000 7fc4d62b4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d0120f70 con 0x7fc4d01338a0 2023-10-01T07:56:04.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.983+0000 7fc4cf7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4d009e760 0x7fc4d011dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:04.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.983+0000 7fc4cf7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4d009e760 0x7fc4d011dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:40962/0 (socket says 172.21.15.26:40962) 2023-10-01T07:56:04.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.983+0000 7fc4cf7fe700 1 -- 172.21.15.26:0/1921253545 learned_addr learned my addr 172.21.15.26:0/1921253545 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:04.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.983+0000 7fc4cffff700 1 --2- 172.21.15.26:0/1921253545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4d009de50 0x7fc4d011d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:04.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.983+0000 7fc4d4851700 1 --2- 172.21.15.26:0/1921253545 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4d01338a0 0x7fc4d011e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:04.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.984+0000 7fc4cf7fe700 1 -- 172.21.15.26:0/1921253545 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4d01338a0 msgr2=0x7fc4d011e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:04.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.984+0000 7fc4cf7fe700 1 --2- 172.21.15.26:0/1921253545 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4d01338a0 0x7fc4d011e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:04.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.984+0000 7fc4cf7fe700 1 -- 172.21.15.26:0/1921253545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4d009de50 msgr2=0x7fc4d011d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:04.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.984+0000 7fc4cf7fe700 1 --2- 172.21.15.26:0/1921253545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4d009de50 0x7fc4d011d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:04.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.984+0000 7fc4cf7fe700 1 -- 172.21.15.26:0/1921253545 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c0009550 con 0x7fc4d009e760 2023-10-01T07:56:04.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.984+0000 7fc4cffff700 1 --2- 172.21.15.26:0/1921253545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4d009de50 0x7fc4d011d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:04.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.984+0000 7fc4d4851700 1 --2- 172.21.15.26:0/1921253545 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4d01338a0 0x7fc4d011e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:56:04.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.984+0000 7fc4cf7fe700 1 --2- 172.21.15.26:0/1921253545 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4d009e760 0x7fc4d011dcb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc4c400e840 tx=0x7fc4c400eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:04.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.984+0000 7fc4ccff9700 1 -- 172.21.15.26:0/1921253545 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4009590 con 0x7fc4d009e760 2023-10-01T07:56:04.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.984+0000 7fc4ccff9700 1 -- 172.21.15.26:0/1921253545 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c4013680 con 0x7fc4d009e760 2023-10-01T07:56:04.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.984+0000 7fc4d62b4700 1 -- 172.21.15.26:0/1921253545 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4d00a0fd0 con 0x7fc4d009e760 2023-10-01T07:56:04.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.984+0000 7fc4ccff9700 1 -- 172.21.15.26:0/1921253545 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4013a10 con 0x7fc4d009e760 2023-10-01T07:56:04.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.984+0000 7fc4d62b4700 1 -- 172.21.15.26:0/1921253545 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d01209e0 con 0x7fc4d009e760 2023-10-01T07:56:04.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.985+0000 7fc4ccff9700 1 -- 172.21.15.26:0/1921253545 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc4c4013b70 con 0x7fc4d009e760 2023-10-01T07:56:04.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.986+0000 7fc4ccff9700 1 -- 172.21.15.26:0/1921253545 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc4c403f650 con 0x7fc4d009e760 2023-10-01T07:56:04.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.987+0000 7fc4d62b4700 1 -- 172.21.15.26:0/1921253545 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4d011a470 con 0x7fc4d009e760 2023-10-01T07:56:04.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:04.995+0000 7fc4ccff9700 1 -- 172.21.15.26:0/1921253545 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc4c401be10 con 0x7fc4d009e760 2023-10-01T07:56:05.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.022+0000 7f7bddb67700 1 Processor -- start 2023-10-01T07:56:05.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.022+0000 7f7bddb67700 1 -- start start 2023-10-01T07:56:05.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.023+0000 7f7bddb67700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7bd81338a0 0x7f7bd8133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:05.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.023+0000 7f7bddb67700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7bd809de50 0x7f7bd809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:05.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.023+0000 7f7bddb67700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7bd809e760 0x7f7bd813a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:05.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.023+0000 7f7bddb67700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bd806fef0 con 0x7f7bd81338a0 2023-10-01T07:56:05.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.023+0000 7f7bddb67700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd806ef30 con 0x7f7bd809de50 2023-10-01T07:56:05.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.023+0000 7f7bddb67700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd81334b0 con 0x7f7bd809e760 2023-10-01T07:56:05.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.023+0000 7f7bd77fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7bd81338a0 0x7f7bd8133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:05.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.023+0000 7f7bd77fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7bd81338a0 0x7f7bd8133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44708/0 (socket says 172.21.15.26:44708) 2023-10-01T07:56:05.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.023+0000 7f7bd77fe700 1 -- 172.21.15.26:0/517765836 learned_addr learned my addr 172.21.15.26:0/517765836 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:05.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.023+0000 7f7bd6ffd700 1 --2- 172.21.15.26:0/517765836 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7bd809de50 0x7f7bd809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:05.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.024+0000 7f7bd7fff700 1 --2- 172.21.15.26:0/517765836 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7bd809e760 0x7f7bd813a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:05.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.024+0000 7f7bd77fe700 1 -- 172.21.15.26:0/517765836 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7bd809e760 msgr2=0x7f7bd813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:05.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.024+0000 7f7bd77fe700 1 --2- 172.21.15.26:0/517765836 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7bd809e760 0x7f7bd813a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:05.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.024+0000 7f7bd77fe700 1 -- 172.21.15.26:0/517765836 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7bd809de50 msgr2=0x7f7bd809e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:05.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.024+0000 7f7bd77fe700 1 --2- 172.21.15.26:0/517765836 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7bd809de50 0x7f7bd809e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:05.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.024+0000 7f7bd77fe700 1 -- 172.21.15.26:0/517765836 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd806fc30 con 0x7f7bd81338a0 2023-10-01T07:56:05.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.024+0000 7f7bd6ffd700 1 --2- 172.21.15.26:0/517765836 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7bd809de50 0x7f7bd809e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:05.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.024+0000 7f7bd77fe700 1 --2- 172.21.15.26:0/517765836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bd81338a0 0x7f7bd8133c70 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7bc80098f0 tx=0x7f7bc8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39be752d2704e62f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:05.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.024+0000 7f7bd67fc700 1 -- 172.21.15.26:0/517765836 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc8011830 con 0x7f7bd81338a0 2023-10-01T07:56:05.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.024+0000 7f7bd67fc700 1 -- 172.21.15.26:0/517765836 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc8011990 con 0x7f7bd81338a0 2023-10-01T07:56:05.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.024+0000 7f7bd67fc700 1 -- 172.21.15.26:0/517765836 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc8011d20 con 0x7f7bd81338a0 2023-10-01T07:56:05.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.025+0000 7f7bddb67700 1 -- 172.21.15.26:0/517765836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bd81338a0 msgr2=0x7f7bd8133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:05.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.025+0000 7f7bddb67700 1 --2- 172.21.15.26:0/517765836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bd81338a0 0x7f7bd8133c70 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7bc80098f0 tx=0x7f7bc8009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:05.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.025+0000 7f7bddb67700 1 -- 172.21.15.26:0/517765836 shutdown_connections 2023-10-01T07:56:05.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.025+0000 7f7bddb67700 1 --2- 172.21.15.26:0/517765836 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7bd809e760 0x7f7bd813a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:05.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.025+0000 7f7bddb67700 1 --2- 172.21.15.26:0/517765836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bd81338a0 0x7f7bd8133c70 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:05.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.025+0000 7f7bddb67700 1 --2- 172.21.15.26:0/517765836 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7bd809de50 0x7f7bd809e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:05.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.025+0000 7f7bddb67700 1 -- 172.21.15.26:0/517765836 >> 172.21.15.26:0/517765836 conn(0x7f7bd80a2aa0 msgr2=0x7f7bd80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:05.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.025+0000 7f7bddb67700 1 -- 172.21.15.26:0/517765836 shutdown_connections 2023-10-01T07:56:05.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.025+0000 7f7bddb67700 1 -- 172.21.15.26:0/517765836 wait complete. 2023-10-01T07:56:05.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.027+0000 7f7bddb67700 1 Processor -- start 2023-10-01T07:56:05.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.027+0000 7f7bddb67700 1 -- start start 2023-10-01T07:56:05.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.028+0000 7f7bddb67700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7bd809de50 0x7f7bd811b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:05.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.028+0000 7f7bddb67700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bd809e760 0x7f7bd811bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:05.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.028+0000 7f7bddb67700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7bd81338a0 0x7f7bd811c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:05.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.028+0000 7f7bddb67700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd811cbe0 con 0x7f7bd809e760 2023-10-01T07:56:05.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.028+0000 7f7bddb67700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd811d2f0 con 0x7f7bd809de50 2023-10-01T07:56:05.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.028+0000 7f7bddb67700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd811d910 con 0x7f7bd81338a0 2023-10-01T07:56:05.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.028+0000 7f7bd6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bd809e760 0x7f7bd811bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:05.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.028+0000 7f7bd6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bd809e760 0x7f7bd811bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44714/0 (socket says 172.21.15.26:44714) 2023-10-01T07:56:05.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.028+0000 7f7bd6ffd700 1 -- 172.21.15.26:0/1238572828 learned_addr learned my addr 172.21.15.26:0/1238572828 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:05.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.028+0000 7f7bd77fe700 1 --2- 172.21.15.26:0/1238572828 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7bd809de50 0x7f7bd811b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:05.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.028+0000 7f7bd7fff700 1 --2- 172.21.15.26:0/1238572828 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7bd81338a0 0x7f7bd811c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:05.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.029+0000 7f7bd77fe700 1 -- 172.21.15.26:0/1238572828 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7bd81338a0 msgr2=0x7f7bd811c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:05.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.029+0000 7f7bd77fe700 1 --2- 172.21.15.26:0/1238572828 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7bd81338a0 0x7f7bd811c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:05.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.029+0000 7f7bd77fe700 1 -- 172.21.15.26:0/1238572828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bd809e760 msgr2=0x7f7bd811bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:05.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.029+0000 7f7bd77fe700 1 --2- 172.21.15.26:0/1238572828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bd809e760 0x7f7bd811bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:05.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.029+0000 7f7bd77fe700 1 -- 172.21.15.26:0/1238572828 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bcc0094a0 con 0x7f7bd809de50 2023-10-01T07:56:05.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.029+0000 7f7bd77fe700 1 --2- 172.21.15.26:0/1238572828 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7bd809de50 0x7f7bd811b730 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8016000 tx=0x7f7bc8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:05.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.029+0000 7f7bbffff700 1 -- 172.21.15.26:0/1238572828 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc8004380 con 0x7f7bd809de50 2023-10-01T07:56:05.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.029+0000 7f7bbffff700 1 -- 172.21.15.26:0/1238572828 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc801f070 con 0x7f7bd809de50 2023-10-01T07:56:05.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.029+0000 7f7bbffff700 1 -- 172.21.15.26:0/1238572828 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc80036a0 con 0x7f7bd809de50 2023-10-01T07:56:05.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.029+0000 7f7bddb67700 1 -- 172.21.15.26:0/1238572828 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc8009550 con 0x7f7bd809de50 2023-10-01T07:56:05.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.029+0000 7f7bddb67700 1 -- 172.21.15.26:0/1238572828 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd811ef80 con 0x7f7bd809de50 2023-10-01T07:56:05.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.030+0000 7f7bbffff700 1 -- 172.21.15.26:0/1238572828 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7bc8021030 con 0x7f7bd809de50 2023-10-01T07:56:05.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.030+0000 7f7bbffff700 1 -- 172.21.15.26:0/1238572828 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7bc80408a0 con 0x7f7bd809de50 2023-10-01T07:56:05.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.031+0000 7f7bddb67700 1 -- 172.21.15.26:0/1238572828 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bd806f640 con 0x7f7bd809de50 2023-10-01T07:56:05.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.040+0000 7f7bbffff700 1 -- 172.21.15.26:0/1238572828 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7bc8003820 con 0x7f7bd809de50 2023-10-01T07:56:05.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.055+0000 7f258bc30700 1 Processor -- start 2023-10-01T07:56:05.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.055+0000 7f258bc30700 1 -- start start 2023-10-01T07:56:05.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.056+0000 7f258bc30700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f258409d6f0 0x7f258409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:05.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.056+0000 7f258bc30700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f258409e410 0x7f2584134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:05.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.056+0000 7f258bc30700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f258409b120 con 0x7f258409e000 2023-10-01T07:56:05.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.056+0000 7f258bc30700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258406b460 con 0x7f258409e410 2023-10-01T07:56:05.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.056+0000 7f258bc30700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f258409a7e0 con 0x7f258409d6f0 2023-10-01T07:56:05.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.056+0000 7f258a1cd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f258409e410 0x7f2584134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:05.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.056+0000 7f258a1cd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f258409e410 0x7f2584134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:40998/0 (socket says 172.21.15.26:40998) 2023-10-01T07:56:05.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.056+0000 7f258a1cd700 1 -- 172.21.15.26:0/2972905223 learned_addr learned my addr 172.21.15.26:0/2972905223 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:05.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.056+0000 7f25899cc700 1 --2- 172.21.15.26:0/2972905223 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f258409d6f0 0x7f258409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:05.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.056+0000 7f258a1cd700 1 -- 172.21.15.26:0/2972905223 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f258409d6f0 msgr2=0x7f258409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:05.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.056+0000 7f258a1cd700 1 --2- 172.21.15.26:0/2972905223 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f258409d6f0 0x7f258409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:05.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.056+0000 7f258a1cd700 1 -- 172.21.15.26:0/2972905223 >> v1:172.21.15.26:6789/0 conn(0x7f258409e000 legacy=0x7f25841339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:05.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.056+0000 7f258a1cd700 1 -- 172.21.15.26:0/2972905223 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f258409a500 con 0x7f258409e410 2023-10-01T07:56:05.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.056+0000 7f25899cc700 1 --2- 172.21.15.26:0/2972905223 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f258409d6f0 0x7f258409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:05.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.057+0000 7f258a1cd700 1 --2- 172.21.15.26:0/2972905223 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f258409e410 0x7f2584134100 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f257c009e80 tx=0x7f257c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d48a42bd3021adc8 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:05.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.057+0000 7f25889ca700 1 -- 172.21.15.26:0/2972905223 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257c00e070 con 0x7f258409e410 2023-10-01T07:56:05.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.057+0000 7f25889ca700 1 -- 172.21.15.26:0/2972905223 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257c00b910 con 0x7f258409e410 2023-10-01T07:56:05.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.057+0000 7f25889ca700 1 -- 172.21.15.26:0/2972905223 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257c00bcc0 con 0x7f258409e410 2023-10-01T07:56:05.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.058+0000 7f258bc30700 1 -- 172.21.15.26:0/2972905223 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f258409e410 msgr2=0x7f2584134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:05.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.058+0000 7f258bc30700 1 --2- 172.21.15.26:0/2972905223 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f258409e410 0x7f2584134100 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f257c009e80 tx=0x7f257c00b330 comp rx=0 tx=0).stop 2023-10-01T07:56:05.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.058+0000 7f258bc30700 1 -- 172.21.15.26:0/2972905223 shutdown_connections 2023-10-01T07:56:05.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.058+0000 7f258bc30700 1 --2- 172.21.15.26:0/2972905223 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f258409d6f0 0x7f258409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:05.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.058+0000 7f258bc30700 1 --2- 172.21.15.26:0/2972905223 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f258409e410 0x7f2584134100 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:05.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.058+0000 7f258bc30700 1 -- 172.21.15.26:0/2972905223 >> 172.21.15.26:0/2972905223 conn(0x7f2584066f50 msgr2=0x7f258409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:05.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.058+0000 7f258bc30700 1 -- 172.21.15.26:0/2972905223 shutdown_connections 2023-10-01T07:56:05.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.058+0000 7f258bc30700 1 -- 172.21.15.26:0/2972905223 wait complete. 2023-10-01T07:56:05.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.060+0000 7f258bc30700 1 Processor -- start 2023-10-01T07:56:05.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.060+0000 7f258bc30700 1 -- start start 2023-10-01T07:56:05.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.060+0000 7f258bc30700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f258409d6f0 0x7f2584122380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:05.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.060+0000 7f258bc30700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f258409e000 0x7f25841228c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:05.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.060+0000 7f258bc30700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f258409e410 0x7f2584122e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:05.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.060+0000 7f258bc30700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2584125e10 con 0x7f258409e410 2023-10-01T07:56:05.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.060+0000 7f258bc30700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2584125870 con 0x7f258409d6f0 2023-10-01T07:56:05.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.060+0000 7f258bc30700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2584133780 con 0x7f258409e000 2023-10-01T07:56:05.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.061+0000 7f25899cc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f258409d6f0 0x7f2584122380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:05.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.061+0000 7f25899cc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f258409d6f0 0x7f2584122380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:41004/0 (socket says 172.21.15.26:41004) 2023-10-01T07:56:05.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.061+0000 7f25899cc700 1 -- 172.21.15.26:0/647976556 learned_addr learned my addr 172.21.15.26:0/647976556 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:05.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.061+0000 7f258a1cd700 1 --2- 172.21.15.26:0/647976556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f258409e410 0x7f2584122e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:05.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.061+0000 7f25899cc700 1 -- 172.21.15.26:0/647976556 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f258409e000 msgr2=0x7f25841228c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:05.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.061+0000 7f25891cb700 1 --2- 172.21.15.26:0/647976556 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f258409e000 0x7f25841228c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:05.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.061+0000 7f25899cc700 1 --2- 172.21.15.26:0/647976556 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f258409e000 0x7f25841228c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:05.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.061+0000 7f25899cc700 1 -- 172.21.15.26:0/647976556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f258409e410 msgr2=0x7f2584122e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:05.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.061+0000 7f25899cc700 1 --2- 172.21.15.26:0/647976556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f258409e410 0x7f2584122e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:05.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.061+0000 7f25899cc700 1 -- 172.21.15.26:0/647976556 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25800094a0 con 0x7f258409d6f0 2023-10-01T07:56:05.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.061+0000 7f25891cb700 1 --2- 172.21.15.26:0/647976556 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f258409e000 0x7f25841228c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:56:05.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.061+0000 7f25899cc700 1 --2- 172.21.15.26:0/647976556 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f258409d6f0 0x7f2584122380 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f258000ebe0 tx=0x7f258000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:05.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.062+0000 7f257a7fc700 1 -- 172.21.15.26:0/647976556 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2580009800 con 0x7f258409d6f0 2023-10-01T07:56:05.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.062+0000 7f257a7fc700 1 -- 172.21.15.26:0/647976556 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f258000c910 con 0x7f258409d6f0 2023-10-01T07:56:05.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.062+0000 7f258bc30700 1 -- 172.21.15.26:0/647976556 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f257c009b30 con 0x7f258409d6f0 2023-10-01T07:56:05.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.062+0000 7f258bc30700 1 -- 172.21.15.26:0/647976556 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2584123770 con 0x7f258409d6f0 2023-10-01T07:56:05.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.063+0000 7f257a7fc700 1 -- 172.21.15.26:0/647976556 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258000cc80 con 0x7f258409d6f0 2023-10-01T07:56:05.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.063+0000 7f257a7fc700 1 -- 172.21.15.26:0/647976556 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2580013470 con 0x7f258409d6f0 2023-10-01T07:56:05.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.063+0000 7f257a7fc700 1 -- 172.21.15.26:0/647976556 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f258003ff80 con 0x7f258409d6f0 2023-10-01T07:56:05.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.064+0000 7f258bc30700 1 -- 172.21.15.26:0/647976556 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f256c0052e0 con 0x7f258409d6f0 2023-10-01T07:56:05.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.069+0000 7f257a7fc700 1 -- 172.21.15.26:0/647976556 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2580017080 con 0x7f258409d6f0 2023-10-01T07:56:05.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.197+0000 7f76a307a700 1 -- 172.21.15.26:0/2631301921 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f769c09a3d0 con 0x7f769c06a770 2023-10-01T07:56:05.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.197+0000 7f76997fa700 1 -- 172.21.15.26:0/2631301921 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7690017020 con 0x7f769c06a770 2023-10-01T07:56:05.198 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:05.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.200+0000 7f76a307a700 1 -- 172.21.15.26:0/2631301921 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f769c06a770 msgr2=0x7f769c1260a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:05.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.200+0000 7f76a307a700 1 --2- 172.21.15.26:0/2631301921 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f769c06a770 0x7f769c1260a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f769000c4a0 tx=0x7f769000c7b0 comp rx=0 tx=0).stop 2023-10-01T07:56:05.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.200+0000 7f76a307a700 1 -- 172.21.15.26:0/2631301921 shutdown_connections 2023-10-01T07:56:05.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.200+0000 7f76a307a700 1 --2- 172.21.15.26:0/2631301921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f769c13d1f0 0x7f769c126b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:05.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.200+0000 7f76a307a700 1 --2- 172.21.15.26:0/2631301921 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f769c06a770 0x7f769c1260a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:05.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.200+0000 7f76a307a700 1 --2- 172.21.15.26:0/2631301921 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f769c09de00 0x7f769c1265e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:05.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.200+0000 7f76a307a700 1 -- 172.21.15.26:0/2631301921 >> 172.21.15.26:0/2631301921 conn(0x7f769c066f50 msgr2=0x7f769c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:05.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.200+0000 7f76a307a700 1 -- 172.21.15.26:0/2631301921 shutdown_connections 2023-10-01T07:56:05.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.200+0000 7f76a307a700 1 -- 172.21.15.26:0/2631301921 wait complete. 2023-10-01T07:56:05.215 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:05.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.246+0000 7fc4d62b4700 1 -- 172.21.15.26:0/1921253545 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc4d0074ea0 con 0x7fc4d009e760 2023-10-01T07:56:05.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.246+0000 7fc4ccff9700 1 -- 172.21.15.26:0/1921253545 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc4c401b3b0 con 0x7fc4d009e760 2023-10-01T07:56:05.246 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:05.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.248+0000 7fc4d62b4700 1 -- 172.21.15.26:0/1921253545 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4d009e760 msgr2=0x7fc4d011dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:05.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.248+0000 7fc4d62b4700 1 --2- 172.21.15.26:0/1921253545 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4d009e760 0x7fc4d011dcb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc4c400e840 tx=0x7fc4c400eb50 comp rx=0 tx=0).stop 2023-10-01T07:56:05.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.248+0000 7fc4d62b4700 1 -- 172.21.15.26:0/1921253545 shutdown_connections 2023-10-01T07:56:05.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.248+0000 7fc4d62b4700 1 --2- 172.21.15.26:0/1921253545 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4d01338a0 0x7fc4d011e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:05.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.248+0000 7fc4d62b4700 1 --2- 172.21.15.26:0/1921253545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4d009de50 0x7fc4d011d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:05.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.248+0000 7fc4d62b4700 1 --2- 172.21.15.26:0/1921253545 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4d009e760 0x7fc4d011dcb0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:05.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.248+0000 7fc4d62b4700 1 -- 172.21.15.26:0/1921253545 >> 172.21.15.26:0/1921253545 conn(0x7fc4d00a2aa0 msgr2=0x7fc4d01bac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:05.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.248+0000 7fc4d62b4700 1 -- 172.21.15.26:0/1921253545 shutdown_connections 2023-10-01T07:56:05.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.248+0000 7fc4d62b4700 1 -- 172.21.15.26:0/1921253545 wait complete. 2023-10-01T07:56:05.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.257+0000 7f7bddb67700 1 -- 172.21.15.26:0/1238572828 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7bd8074ea0 con 0x7f7bd809de50 2023-10-01T07:56:05.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.258+0000 7f7bbffff700 1 -- 172.21.15.26:0/1238572828 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7bc8015020 con 0x7f7bd809de50 2023-10-01T07:56:05.259 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:05.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.260+0000 7f7bddb67700 1 -- 172.21.15.26:0/1238572828 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7bd809de50 msgr2=0x7f7bd811b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:05.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.260+0000 7f7bddb67700 1 --2- 172.21.15.26:0/1238572828 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7bd809de50 0x7f7bd811b730 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8016000 tx=0x7f7bc8004750 comp rx=0 tx=0).stop 2023-10-01T07:56:05.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.260+0000 7f7bddb67700 1 -- 172.21.15.26:0/1238572828 shutdown_connections 2023-10-01T07:56:05.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.260+0000 7f7bddb67700 1 --2- 172.21.15.26:0/1238572828 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7bd81338a0 0x7f7bd811c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:05.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.260+0000 7f7bddb67700 1 --2- 172.21.15.26:0/1238572828 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7bd809de50 0x7f7bd811b730 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:05.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.260+0000 7f7bddb67700 1 --2- 172.21.15.26:0/1238572828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bd809e760 0x7f7bd811bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:05.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.260+0000 7f7bddb67700 1 -- 172.21.15.26:0/1238572828 >> 172.21.15.26:0/1238572828 conn(0x7f7bd80a2aa0 msgr2=0x7f7bd81306c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:05.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.261+0000 7f7bddb67700 1 -- 172.21.15.26:0/1238572828 shutdown_connections 2023-10-01T07:56:05.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.261+0000 7f7bddb67700 1 -- 172.21.15.26:0/1238572828 wait complete. 2023-10-01T07:56:05.263 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:05.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:05.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.304+0000 7f258bc30700 1 -- 172.21.15.26:0/647976556 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f256c005590 con 0x7f258409d6f0 2023-10-01T07:56:05.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.304+0000 7f257a7fc700 1 -- 172.21.15.26:0/647976556 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f258002b090 con 0x7f258409d6f0 2023-10-01T07:56:05.305 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:05.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.306+0000 7f258bc30700 1 -- 172.21.15.26:0/647976556 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f258409d6f0 msgr2=0x7f2584122380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:05.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.306+0000 7f258bc30700 1 --2- 172.21.15.26:0/647976556 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f258409d6f0 0x7f2584122380 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f258000ebe0 tx=0x7f258000eef0 comp rx=0 tx=0).stop 2023-10-01T07:56:05.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.306+0000 7f258bc30700 1 -- 172.21.15.26:0/647976556 shutdown_connections 2023-10-01T07:56:05.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.306+0000 7f258bc30700 1 --2- 172.21.15.26:0/647976556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f258409e410 0x7f2584122e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:05.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.306+0000 7f258bc30700 1 --2- 172.21.15.26:0/647976556 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f258409d6f0 0x7f2584122380 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:05.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.306+0000 7f258bc30700 1 --2- 172.21.15.26:0/647976556 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f258409e000 0x7f25841228c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:05.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.306+0000 7f258bc30700 1 -- 172.21.15.26:0/647976556 >> 172.21.15.26:0/647976556 conn(0x7f2584066f50 msgr2=0x7f2584133f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:05.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.306+0000 7f258bc30700 1 -- 172.21.15.26:0/647976556 shutdown_connections 2023-10-01T07:56:05.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:05.307+0000 7f258bc30700 1 -- 172.21.15.26:0/647976556 wait complete. 2023-10-01T07:56:05.320 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:06.216 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:06.264 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:06.276 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:06.321 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:06.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.366+0000 7f92cb659700 1 Processor -- start 2023-10-01T07:56:06.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.366+0000 7f92cb659700 1 -- start start 2023-10-01T07:56:06.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.367+0000 7f92cb659700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92c40a0a30 0x7f92c40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:06.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.367+0000 7f92cb659700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f92c4134170 0x7f92c413bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:06.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.367+0000 7f92cb659700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c409edd0 con 0x7f92c40a1340 2023-10-01T07:56:06.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.367+0000 7f92cb659700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c409e1f0 con 0x7f92c4134170 2023-10-01T07:56:06.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.367+0000 7f92cb659700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92c409dc50 con 0x7f92c40a0a30 2023-10-01T07:56:06.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.367+0000 7f92c93f5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92c40a0a30 0x7f92c40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:06.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.367+0000 7f92c9bf6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f92c4134170 0x7f92c413bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:06.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.367+0000 7f92c93f5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92c40a0a30 0x7f92c40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:50032/0 (socket says 172.21.15.26:50032) 2023-10-01T07:56:06.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.367+0000 7f92c93f5700 1 -- 172.21.15.26:0/4079953559 learned_addr learned my addr 172.21.15.26:0/4079953559 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:06.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.367+0000 7f92c9bf6700 1 -- 172.21.15.26:0/4079953559 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92c40a0a30 msgr2=0x7f92c40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:06.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.367+0000 7f92c9bf6700 1 --2- 172.21.15.26:0/4079953559 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92c40a0a30 0x7f92c40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:06.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.367+0000 7f92c9bf6700 1 -- 172.21.15.26:0/4079953559 >> v1:172.21.15.26:6789/0 conn(0x7f92c40a1340 legacy=0x7f92c4133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:06.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.367+0000 7f92c9bf6700 1 -- 172.21.15.26:0/4079953559 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c40a1fe0 con 0x7f92c4134170 2023-10-01T07:56:06.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.367+0000 7f92c93f5700 1 --2- 172.21.15.26:0/4079953559 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92c40a0a30 0x7f92c40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:06.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.368+0000 7f92c9bf6700 1 --2- 172.21.15.26:0/4079953559 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92c4134170 0x7f92c413bd30 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f92bc009d90 tx=0x7f92bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c18c6adccda397 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:06.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.368+0000 7f92bbfff700 1 -- 172.21.15.26:0/4079953559 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc00e070 con 0x7f92c4134170 2023-10-01T07:56:06.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.368+0000 7f92bbfff700 1 -- 172.21.15.26:0/4079953559 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92bc00bb20 con 0x7f92c4134170 2023-10-01T07:56:06.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.368+0000 7f92bbfff700 1 -- 172.21.15.26:0/4079953559 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc012430 con 0x7f92c4134170 2023-10-01T07:56:06.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.369+0000 7f92cb659700 1 -- 172.21.15.26:0/4079953559 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92c4134170 msgr2=0x7f92c413bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:06.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.369+0000 7f92cb659700 1 --2- 172.21.15.26:0/4079953559 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92c4134170 0x7f92c413bd30 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f92bc009d90 tx=0x7f92bc00b330 comp rx=0 tx=0).stop 2023-10-01T07:56:06.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.369+0000 7f92cb659700 1 -- 172.21.15.26:0/4079953559 shutdown_connections 2023-10-01T07:56:06.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.369+0000 7f92cb659700 1 --2- 172.21.15.26:0/4079953559 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92c4134170 0x7f92c413bd30 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:06.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.369+0000 7f92cb659700 1 --2- 172.21.15.26:0/4079953559 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92c40a0a30 0x7f92c40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:06.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.369+0000 7f92cb659700 1 -- 172.21.15.26:0/4079953559 >> 172.21.15.26:0/4079953559 conn(0x7f92c40a6550 msgr2=0x7f92c40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:06.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.369+0000 7f92cb659700 1 -- 172.21.15.26:0/4079953559 shutdown_connections 2023-10-01T07:56:06.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.369+0000 7f92cb659700 1 -- 172.21.15.26:0/4079953559 wait complete. 2023-10-01T07:56:06.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.370+0000 7f92cb659700 1 Processor -- start 2023-10-01T07:56:06.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.370+0000 7f92cb659700 1 -- start start 2023-10-01T07:56:06.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.371+0000 7f92cb659700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92c40a0a30 0x7f92c41c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:06.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.371+0000 7f92cb659700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92c40a1340 0x7f92c41c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:06.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.371+0000 7f92cb659700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92c4134170 0x7f92c4122870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:06.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.371+0000 7f92cb659700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c4125e80 con 0x7f92c40a1340 2023-10-01T07:56:06.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.371+0000 7f92cb659700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c4126f70 con 0x7f92c40a0a30 2023-10-01T07:56:06.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.371+0000 7f92cb659700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92c40a4e40 con 0x7f92c4134170 2023-10-01T07:56:06.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.371+0000 7f92c8bf4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92c40a1340 0x7f92c41c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:06.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.371+0000 7f92c8bf4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92c40a1340 0x7f92c41c8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44754/0 (socket says 172.21.15.26:44754) 2023-10-01T07:56:06.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.371+0000 7f92c8bf4700 1 -- 172.21.15.26:0/905601688 learned_addr learned my addr 172.21.15.26:0/905601688 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:06.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.371+0000 7f92c9bf6700 1 --2- 172.21.15.26:0/905601688 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92c4134170 0x7f92c4122870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:06.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.371+0000 7f92c93f5700 1 --2- 172.21.15.26:0/905601688 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92c40a0a30 0x7f92c41c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:06.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.371+0000 7f92c8bf4700 1 -- 172.21.15.26:0/905601688 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92c4134170 msgr2=0x7f92c4122870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:06.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.371+0000 7f92c8bf4700 1 --2- 172.21.15.26:0/905601688 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92c4134170 0x7f92c4122870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:06.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.371+0000 7f92c8bf4700 1 -- 172.21.15.26:0/905601688 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92c40a0a30 msgr2=0x7f92c41c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:06.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.371+0000 7f92c8bf4700 1 --2- 172.21.15.26:0/905601688 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92c40a0a30 0x7f92c41c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:06.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.371+0000 7f92c8bf4700 1 -- 172.21.15.26:0/905601688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c0009550 con 0x7f92c40a1340 2023-10-01T07:56:06.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.371+0000 7f92c9bf6700 1 --2- 172.21.15.26:0/905601688 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92c4134170 0x7f92c4122870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:06.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.372+0000 7f92c8bf4700 1 --2- 172.21.15.26:0/905601688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92c40a1340 0x7f92c41c8c90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f92b400c510 tx=0x7f92b400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:06.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.372+0000 7f92b9ffb700 1 -- 172.21.15.26:0/905601688 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b40052d0 con 0x7f92c40a1340 2023-10-01T07:56:06.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.372+0000 7f92b9ffb700 1 -- 172.21.15.26:0/905601688 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b4005430 con 0x7f92c40a1340 2023-10-01T07:56:06.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.372+0000 7f92b9ffb700 1 -- 172.21.15.26:0/905601688 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b40038c0 con 0x7f92c40a1340 2023-10-01T07:56:06.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.372+0000 7f92cb659700 1 -- 172.21.15.26:0/905601688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92bc009a70 con 0x7f92c40a1340 2023-10-01T07:56:06.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.372+0000 7f92cb659700 1 -- 172.21.15.26:0/905601688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c4124480 con 0x7f92c40a1340 2023-10-01T07:56:06.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.373+0000 7f92cb659700 1 -- 172.21.15.26:0/905601688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c40a1d00 con 0x7f92c40a1340 2023-10-01T07:56:06.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.374+0000 7f92b9ffb700 1 -- 172.21.15.26:0/905601688 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f92b4003a20 con 0x7f92c40a1340 2023-10-01T07:56:06.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.374+0000 7f92b9ffb700 1 -- 172.21.15.26:0/905601688 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f92b403ea80 con 0x7f92c40a1340 2023-10-01T07:56:06.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.379+0000 7f92b9ffb700 1 -- 172.21.15.26:0/905601688 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f92b4018260 con 0x7f92c40a1340 2023-10-01T07:56:06.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.421+0000 7f1368d47700 1 Processor -- start 2023-10-01T07:56:06.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.422+0000 7f1368d47700 1 -- start start 2023-10-01T07:56:06.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.423+0000 7f1368d47700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1364133420 0x7f13641337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:06.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.423+0000 7f1368d47700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1364133e30 0x7f136412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:06.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.423+0000 7f1368d47700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136406b990 con 0x7f1364134260 2023-10-01T07:56:06.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.423+0000 7f1368d47700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13640a0590 con 0x7f1364133e30 2023-10-01T07:56:06.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.423+0000 7f1368d47700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136409fb80 con 0x7f1364133420 2023-10-01T07:56:06.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.423+0000 7f136259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1364133420 0x7f13641337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:06.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.423+0000 7f136259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1364133420 0x7f13641337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:41024/0 (socket says 172.21.15.26:41024) 2023-10-01T07:56:06.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.423+0000 7f136259c700 1 -- 172.21.15.26:0/2641641252 learned_addr learned my addr 172.21.15.26:0/2641641252 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:06.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.423+0000 7f1361d9b700 1 --2- 172.21.15.26:0/2641641252 >> v2:172.21.15.26:3300/0 conn(0x7f1364133e30 0x7f136412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:06.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.423+0000 7f136259c700 1 -- 172.21.15.26:0/2641641252 >> v2:172.21.15.26:3300/0 conn(0x7f1364133e30 msgr2=0x7f136412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:06.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.423+0000 7f136259c700 1 --2- 172.21.15.26:0/2641641252 >> v2:172.21.15.26:3300/0 conn(0x7f1364133e30 0x7f136412ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:06.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.423+0000 7f136259c700 1 -- 172.21.15.26:0/2641641252 >> v1:172.21.15.26:6789/0 conn(0x7f1364134260 legacy=0x7f13641304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:06.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.423+0000 7f136259c700 1 -- 172.21.15.26:0/2641641252 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13640a0030 con 0x7f1364133420 2023-10-01T07:56:06.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.424+0000 7f136259c700 1 --2- 172.21.15.26:0/2641641252 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1364133420 0x7f13641337f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f13540098f0 tx=0x7f1354009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64eae93761403ea8 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:06.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.424+0000 7f136159a700 1 -- 172.21.15.26:0/2641641252 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1354011830 con 0x7f1364133420 2023-10-01T07:56:06.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.424+0000 7f136159a700 1 -- 172.21.15.26:0/2641641252 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1354011990 con 0x7f1364133420 2023-10-01T07:56:06.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.424+0000 7f136159a700 1 -- 172.21.15.26:0/2641641252 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1354011d20 con 0x7f1364133420 2023-10-01T07:56:06.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.425+0000 7f1368d47700 1 -- 172.21.15.26:0/2641641252 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1364133420 msgr2=0x7f13641337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:06.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.425+0000 7f1368d47700 1 --2- 172.21.15.26:0/2641641252 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1364133420 0x7f13641337f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f13540098f0 tx=0x7f1354009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:06.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.425+0000 7f1368d47700 1 -- 172.21.15.26:0/2641641252 shutdown_connections 2023-10-01T07:56:06.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.425+0000 7f1368d47700 1 --2- 172.21.15.26:0/2641641252 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1364133420 0x7f13641337f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:06.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.425+0000 7f1368d47700 1 --2- 172.21.15.26:0/2641641252 >> v2:172.21.15.26:3300/0 conn(0x7f1364133e30 0x7f136412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:06.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.425+0000 7f1368d47700 1 -- 172.21.15.26:0/2641641252 >> 172.21.15.26:0/2641641252 conn(0x7f13640a4210 msgr2=0x7f13640a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:06.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.425+0000 7f1368d47700 1 -- 172.21.15.26:0/2641641252 shutdown_connections 2023-10-01T07:56:06.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.425+0000 7f1368d47700 1 -- 172.21.15.26:0/2641641252 wait complete. 2023-10-01T07:56:06.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.426+0000 7f1368d47700 1 Processor -- start 2023-10-01T07:56:06.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.426+0000 7f1368d47700 1 -- start start 2023-10-01T07:56:06.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.427+0000 7f1368d47700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1364133420 0x7f136409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:06.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.427+0000 7f1368d47700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1364133e30 0x7f136409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:06.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.427+0000 7f1368d47700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1364134260 0x7f136409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:06.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.427+0000 7f1368d47700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136409dcd0 con 0x7f1364133420 2023-10-01T07:56:06.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.427+0000 7f1368d47700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136411fe90 con 0x7f1364133e30 2023-10-01T07:56:06.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.427+0000 7f1368d47700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f136409df30 con 0x7f1364134260 2023-10-01T07:56:06.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.427+0000 7f136259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1364133420 0x7f136409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:06.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.427+0000 7f136259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1364133420 0x7f136409c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44770/0 (socket says 172.21.15.26:44770) 2023-10-01T07:56:06.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.427+0000 7f136259c700 1 -- 172.21.15.26:0/2299000171 learned_addr learned my addr 172.21.15.26:0/2299000171 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:06.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.427+0000 7f1361d9b700 1 --2- 172.21.15.26:0/2299000171 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1364133e30 0x7f136409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:06.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.427+0000 7f1362d9d700 1 --2- 172.21.15.26:0/2299000171 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1364134260 0x7f136409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:06.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.428+0000 7f136259c700 1 -- 172.21.15.26:0/2299000171 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1364134260 msgr2=0x7f136409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:06.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.428+0000 7f136259c700 1 --2- 172.21.15.26:0/2299000171 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1364134260 0x7f136409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:06.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.428+0000 7f136259c700 1 -- 172.21.15.26:0/2299000171 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1364133e30 msgr2=0x7f136409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:06.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.428+0000 7f136259c700 1 --2- 172.21.15.26:0/2299000171 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1364133e30 0x7f136409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:06.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.428+0000 7f136259c700 1 -- 172.21.15.26:0/2299000171 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1354009550 con 0x7f1364133420 2023-10-01T07:56:06.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.428+0000 7f136259c700 1 --2- 172.21.15.26:0/2299000171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1364133420 0x7f136409c480 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1354009c40 tx=0x7f1354004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:06.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.428+0000 7f1352ffd700 1 -- 172.21.15.26:0/2299000171 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1354004400 con 0x7f1364133420 2023-10-01T07:56:06.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.428+0000 7f1352ffd700 1 -- 172.21.15.26:0/2299000171 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135401f070 con 0x7f1364133420 2023-10-01T07:56:06.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.428+0000 7f1368d47700 1 -- 172.21.15.26:0/2299000171 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1364120100 con 0x7f1364133420 2023-10-01T07:56:06.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.428+0000 7f1352ffd700 1 -- 172.21.15.26:0/2299000171 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13540038e0 con 0x7f1364133420 2023-10-01T07:56:06.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.428+0000 7f1368d47700 1 -- 172.21.15.26:0/2299000171 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f136411f440 con 0x7f1364133420 2023-10-01T07:56:06.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.430+0000 7f1350ff9700 1 -- 172.21.15.26:0/2299000171 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f133c0052e0 con 0x7f1364133420 2023-10-01T07:56:06.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.431+0000 7f1352ffd700 1 -- 172.21.15.26:0/2299000171 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1354021030 con 0x7f1364133420 2023-10-01T07:56:06.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.432+0000 7f1352ffd700 1 -- 172.21.15.26:0/2299000171 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1354040fe0 con 0x7f1364133420 2023-10-01T07:56:06.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.436+0000 7f1352ffd700 1 -- 172.21.15.26:0/2299000171 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f135400b9d0 con 0x7f1364133420 2023-10-01T07:56:06.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.459+0000 7f54c0a75700 1 Processor -- start 2023-10-01T07:56:06.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.459+0000 7f54c0a75700 1 -- start start 2023-10-01T07:56:06.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.460+0000 7f54c0a75700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f54bc133420 0x7f54bc1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:06.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.460+0000 7f54c0a75700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f54bc133e30 0x7f54bc12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:06.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.460+0000 7f54c0a75700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54bc06b990 con 0x7f54bc134260 2023-10-01T07:56:06.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.460+0000 7f54c0a75700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54bc0a0590 con 0x7f54bc133e30 2023-10-01T07:56:06.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.460+0000 7f54c0a75700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc09fb80 con 0x7f54bc133420 2023-10-01T07:56:06.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.460+0000 7f54b9d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f54bc133e30 0x7f54bc12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:06.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.460+0000 7f54b9d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f54bc133e30 0x7f54bc12ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44776/0 (socket says 172.21.15.26:44776) 2023-10-01T07:56:06.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.460+0000 7f54b9d9b700 1 -- 172.21.15.26:0/1472041664 learned_addr learned my addr 172.21.15.26:0/1472041664 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:06.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.461+0000 7f54ba59c700 1 --2- 172.21.15.26:0/1472041664 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f54bc133420 0x7f54bc1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:06.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.461+0000 7f54b9d9b700 1 -- 172.21.15.26:0/1472041664 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f54bc133420 msgr2=0x7f54bc1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:06.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.461+0000 7f54b9d9b700 1 --2- 172.21.15.26:0/1472041664 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f54bc133420 0x7f54bc1337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:06.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.461+0000 7f54b9d9b700 1 -- 172.21.15.26:0/1472041664 >> v1:172.21.15.26:6789/0 conn(0x7f54bc134260 legacy=0x7f54bc1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:06.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.461+0000 7f54b9d9b700 1 -- 172.21.15.26:0/1472041664 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54bc0a0030 con 0x7f54bc133e30 2023-10-01T07:56:06.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.461+0000 7f54ba59c700 1 --2- 172.21.15.26:0/1472041664 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f54bc133420 0x7f54bc1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:56:06.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.461+0000 7f54b9d9b700 1 --2- 172.21.15.26:0/1472041664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54bc133e30 0x7f54bc12ff90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f54b00098f0 tx=0x7f54b0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab3846744a547659 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:06.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.461+0000 7f54b959a700 1 -- 172.21.15.26:0/1472041664 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b000b8a0 con 0x7f54bc133e30 2023-10-01T07:56:06.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.461+0000 7f54b959a700 1 -- 172.21.15.26:0/1472041664 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b000ba00 con 0x7f54bc133e30 2023-10-01T07:56:06.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.461+0000 7f54b959a700 1 -- 172.21.15.26:0/1472041664 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b000bd90 con 0x7f54bc133e30 2023-10-01T07:56:06.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.462+0000 7f54c0a75700 1 -- 172.21.15.26:0/1472041664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54bc133e30 msgr2=0x7f54bc12ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:06.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.462+0000 7f54c0a75700 1 --2- 172.21.15.26:0/1472041664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54bc133e30 0x7f54bc12ff90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f54b00098f0 tx=0x7f54b0009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:06.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.462+0000 7f54c0a75700 1 -- 172.21.15.26:0/1472041664 shutdown_connections 2023-10-01T07:56:06.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.462+0000 7f54c0a75700 1 --2- 172.21.15.26:0/1472041664 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f54bc133420 0x7f54bc1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:06.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.462+0000 7f54c0a75700 1 --2- 172.21.15.26:0/1472041664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54bc133e30 0x7f54bc12ff90 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:06.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.462+0000 7f54c0a75700 1 -- 172.21.15.26:0/1472041664 >> 172.21.15.26:0/1472041664 conn(0x7f54bc0a4210 msgr2=0x7f54bc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:06.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.462+0000 7f54c0a75700 1 -- 172.21.15.26:0/1472041664 shutdown_connections 2023-10-01T07:56:06.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.462+0000 7f54c0a75700 1 -- 172.21.15.26:0/1472041664 wait complete. 2023-10-01T07:56:06.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.464+0000 7f54c0a75700 1 Processor -- start 2023-10-01T07:56:06.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.464+0000 7f54c0a75700 1 -- start start 2023-10-01T07:56:06.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.465+0000 7f54c0a75700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54bc133420 0x7f54bc09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:06.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.465+0000 7f54c0a75700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f54bc133e30 0x7f54bc09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:06.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.465+0000 7f54c0a75700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f54bc134260 0x7f54bc09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:06.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.465+0000 7f54c0a75700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc1201f0 con 0x7f54bc133420 2023-10-01T07:56:06.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.465+0000 7f54c0a75700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc12da70 con 0x7f54bc133e30 2023-10-01T07:56:06.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.465+0000 7f54c0a75700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc11fc50 con 0x7f54bc134260 2023-10-01T07:56:06.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.465+0000 7f54ba59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54bc133420 0x7f54bc09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:06.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.465+0000 7f54ba59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54bc133420 0x7f54bc09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44778/0 (socket says 172.21.15.26:44778) 2023-10-01T07:56:06.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.465+0000 7f54ba59c700 1 -- 172.21.15.26:0/2647328376 learned_addr learned my addr 172.21.15.26:0/2647328376 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:06.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.465+0000 7f54bad9d700 1 --2- 172.21.15.26:0/2647328376 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f54bc134260 0x7f54bc09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:06.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.465+0000 7f54b9d9b700 1 --2- 172.21.15.26:0/2647328376 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f54bc133e30 0x7f54bc09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:06.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.466+0000 7f54ba59c700 1 -- 172.21.15.26:0/2647328376 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f54bc134260 msgr2=0x7f54bc09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:06.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.466+0000 7f54ba59c700 1 --2- 172.21.15.26:0/2647328376 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f54bc134260 0x7f54bc09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:06.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.466+0000 7f54ba59c700 1 -- 172.21.15.26:0/2647328376 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f54bc133e30 msgr2=0x7f54bc09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:06.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.466+0000 7f54ba59c700 1 --2- 172.21.15.26:0/2647328376 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f54bc133e30 0x7f54bc09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:06.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.466+0000 7f54ba59c700 1 -- 172.21.15.26:0/2647328376 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b0009550 con 0x7f54bc133420 2023-10-01T07:56:06.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.466+0000 7f54bad9d700 1 --2- 172.21.15.26:0/2647328376 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f54bc134260 0x7f54bc09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:06.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.466+0000 7f54ba59c700 1 --2- 172.21.15.26:0/2647328376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54bc133420 0x7f54bc09c480 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f54ac00e810 tx=0x7f54ac00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:06.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.466+0000 7f54aaffd700 1 -- 172.21.15.26:0/2647328376 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac013610 con 0x7f54bc133420 2023-10-01T07:56:06.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.466+0000 7f54aaffd700 1 -- 172.21.15.26:0/2647328376 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ac013770 con 0x7f54bc133420 2023-10-01T07:56:06.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.466+0000 7f54c0a75700 1 -- 172.21.15.26:0/2647328376 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54bc1319d0 con 0x7f54bc133420 2023-10-01T07:56:06.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.466+0000 7f54aaffd700 1 -- 172.21.15.26:0/2647328376 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac013b20 con 0x7f54bc133420 2023-10-01T07:56:06.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.466+0000 7f54c0a75700 1 -- 172.21.15.26:0/2647328376 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54bc120980 con 0x7f54bc133420 2023-10-01T07:56:06.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.467+0000 7f54aaffd700 1 -- 172.21.15.26:0/2647328376 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f54ac013c80 con 0x7f54bc133420 2023-10-01T07:56:06.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.468+0000 7f54aaffd700 1 -- 172.21.15.26:0/2647328376 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f54ac03f340 con 0x7f54bc133420 2023-10-01T07:56:06.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.468+0000 7f54c0a75700 1 -- 172.21.15.26:0/2647328376 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54bc074ea0 con 0x7f54bc133420 2023-10-01T07:56:06.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.473+0000 7f54aaffd700 1 -- 172.21.15.26:0/2647328376 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f54ac012370 con 0x7f54bc133420 2023-10-01T07:56:06.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.525+0000 7f6bc5a5b700 1 Processor -- start 2023-10-01T07:56:06.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.525+0000 7f6bc5a5b700 1 -- start start 2023-10-01T07:56:06.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.526+0000 7f6bc5a5b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6bc00a0a30 0x7f6bc00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:06.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.526+0000 7f6bc5a5b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6bc00a1340 0x7f6bc0133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:06.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.526+0000 7f6bc5a5b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc009edd0 con 0x7f6bc0133fa0 2023-10-01T07:56:06.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.526+0000 7f6bc5a5b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc009e1f0 con 0x7f6bc00a1340 2023-10-01T07:56:06.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.526+0000 7f6bc5a5b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc009dc50 con 0x7f6bc00a0a30 2023-10-01T07:56:06.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.526+0000 7f6bbeffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6bc00a0a30 0x7f6bc00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:06.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.526+0000 7f6bbeffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6bc00a0a30 0x7f6bc00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:41052/0 (socket says 172.21.15.26:41052) 2023-10-01T07:56:06.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.526+0000 7f6bbeffd700 1 -- 172.21.15.26:0/235816688 learned_addr learned my addr 172.21.15.26:0/235816688 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:06.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.527+0000 7f6bbe7fc700 1 --2- 172.21.15.26:0/235816688 >> v2:172.21.15.26:3300/0 conn(0x7f6bc00a1340 0x7f6bc0133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:06.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.527+0000 7f6bbeffd700 1 -- 172.21.15.26:0/235816688 >> v2:172.21.15.26:3300/0 conn(0x7f6bc00a1340 msgr2=0x7f6bc0133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:06.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.527+0000 7f6bbeffd700 1 --2- 172.21.15.26:0/235816688 >> v2:172.21.15.26:3300/0 conn(0x7f6bc00a1340 0x7f6bc0133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:06.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.527+0000 7f6bbeffd700 1 -- 172.21.15.26:0/235816688 >> v1:172.21.15.26:6789/0 conn(0x7f6bc0133fa0 legacy=0x7f6bc013ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:06.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.527+0000 7f6bbeffd700 1 -- 172.21.15.26:0/235816688 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc00a1fe0 con 0x7f6bc00a0a30 2023-10-01T07:56:06.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.527+0000 7f6bbe7fc700 1 --2- 172.21.15.26:0/235816688 >> v2:172.21.15.26:3300/0 conn(0x7f6bc00a1340 0x7f6bc0133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:06.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.527+0000 7f6bbeffd700 1 --2- 172.21.15.26:0/235816688 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6bc00a0a30 0x7f6bc00a0e00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6bb00098f0 tx=0x7f6bb0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcb9ca02a016bca5 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:06.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.527+0000 7f6bbdffb700 1 -- 172.21.15.26:0/235816688 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0011830 con 0x7f6bc00a0a30 2023-10-01T07:56:06.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.527+0000 7f6bbdffb700 1 -- 172.21.15.26:0/235816688 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb0011990 con 0x7f6bc00a0a30 2023-10-01T07:56:06.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.527+0000 7f6bbdffb700 1 -- 172.21.15.26:0/235816688 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0011d20 con 0x7f6bc00a0a30 2023-10-01T07:56:06.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.528+0000 7f6bc5a5b700 1 -- 172.21.15.26:0/235816688 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6bc00a0a30 msgr2=0x7f6bc00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:06.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.528+0000 7f6bc5a5b700 1 --2- 172.21.15.26:0/235816688 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6bc00a0a30 0x7f6bc00a0e00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6bb00098f0 tx=0x7f6bb0009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:06.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.528+0000 7f6bc5a5b700 1 -- 172.21.15.26:0/235816688 shutdown_connections 2023-10-01T07:56:06.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.528+0000 7f6bc5a5b700 1 --2- 172.21.15.26:0/235816688 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6bc00a0a30 0x7f6bc00a0e00 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:06.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.528+0000 7f6bc5a5b700 1 --2- 172.21.15.26:0/235816688 >> v2:172.21.15.26:3300/0 conn(0x7f6bc00a1340 0x7f6bc0133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:06.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.528+0000 7f6bc5a5b700 1 -- 172.21.15.26:0/235816688 >> 172.21.15.26:0/235816688 conn(0x7f6bc00a6550 msgr2=0x7f6bc00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:06.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.529+0000 7f6bc5a5b700 1 -- 172.21.15.26:0/235816688 shutdown_connections 2023-10-01T07:56:06.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.529+0000 7f6bc5a5b700 1 -- 172.21.15.26:0/235816688 wait complete. 2023-10-01T07:56:06.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.530+0000 7f6bc5a5b700 1 Processor -- start 2023-10-01T07:56:06.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.530+0000 7f6bc5a5b700 1 -- start start 2023-10-01T07:56:06.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.531+0000 7f6bc5a5b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6bc00a0a30 0x7f6bc01c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:06.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.531+0000 7f6bc5a5b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bc00a1340 0x7f6bc01c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:06.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.531+0000 7f6bc5a5b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6bc0133fa0 0x7f6bc01c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:06.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.531+0000 7f6bc5a5b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc01205e0 con 0x7f6bc00a1340 2023-10-01T07:56:06.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.531+0000 7f6bc5a5b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc0120c30 con 0x7f6bc00a0a30 2023-10-01T07:56:06.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.531+0000 7f6bc5a5b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc009c030 con 0x7f6bc0133fa0 2023-10-01T07:56:06.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.531+0000 7f6bbe7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bc00a1340 0x7f6bc01c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:06.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.531+0000 7f6bbf7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6bc0133fa0 0x7f6bc01c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:06.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.531+0000 7f6bbe7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bc00a1340 0x7f6bc01c8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44792/0 (socket says 172.21.15.26:44792) 2023-10-01T07:56:06.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.531+0000 7f6bbe7fc700 1 -- 172.21.15.26:0/2107913464 learned_addr learned my addr 172.21.15.26:0/2107913464 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:06.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.531+0000 7f6bbeffd700 1 --2- 172.21.15.26:0/2107913464 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6bc00a0a30 0x7f6bc01c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:06.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.532+0000 7f6bbf7fe700 1 -- 172.21.15.26:0/2107913464 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6bc00a0a30 msgr2=0x7f6bc01c85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:06.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.532+0000 7f6bbf7fe700 1 --2- 172.21.15.26:0/2107913464 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6bc00a0a30 0x7f6bc01c85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:06.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.532+0000 7f6bbf7fe700 1 -- 172.21.15.26:0/2107913464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bc00a1340 msgr2=0x7f6bc01c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:06.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.532+0000 7f6bbf7fe700 1 --2- 172.21.15.26:0/2107913464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bc00a1340 0x7f6bc01c8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:06.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.532+0000 7f6bbf7fe700 1 -- 172.21.15.26:0/2107913464 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb40094a0 con 0x7f6bc0133fa0 2023-10-01T07:56:06.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.532+0000 7f6bbe7fc700 1 --2- 172.21.15.26:0/2107913464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bc00a1340 0x7f6bc01c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:06.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.532+0000 7f6bbeffd700 1 --2- 172.21.15.26:0/2107913464 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6bc00a0a30 0x7f6bc01c85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:56:06.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.532+0000 7f6bbf7fe700 1 --2- 172.21.15.26:0/2107913464 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6bc0133fa0 0x7f6bc01c9040 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800cbc0 tx=0x7f6bb800ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:06.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.532+0000 7f6ba7fff700 1 -- 172.21.15.26:0/2107913464 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8003c00 con 0x7f6bc0133fa0 2023-10-01T07:56:06.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.532+0000 7f6bc5a5b700 1 -- 172.21.15.26:0/2107913464 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb0009550 con 0x7f6bc0133fa0 2023-10-01T07:56:06.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.532+0000 7f6ba7fff700 1 -- 172.21.15.26:0/2107913464 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb8003d60 con 0x7f6bc0133fa0 2023-10-01T07:56:06.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.532+0000 7f6ba7fff700 1 -- 172.21.15.26:0/2107913464 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb800aaa0 con 0x7f6bc0133fa0 2023-10-01T07:56:06.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.532+0000 7f6bc5a5b700 1 -- 172.21.15.26:0/2107913464 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc01222c0 con 0x7f6bc0133fa0 2023-10-01T07:56:06.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.533+0000 7f6ba7fff700 1 -- 172.21.15.26:0/2107913464 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6bb800ac00 con 0x7f6bc0133fa0 2023-10-01T07:56:06.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.533+0000 7f6ba7fff700 1 -- 172.21.15.26:0/2107913464 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6bb803f720 con 0x7f6bc0133fa0 2023-10-01T07:56:06.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.534+0000 7f6bc5a5b700 1 -- 172.21.15.26:0/2107913464 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc0122070 con 0x7f6bc0133fa0 2023-10-01T07:56:06.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.543+0000 7f6ba7fff700 1 -- 172.21.15.26:0/2107913464 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6bb80198f0 con 0x7f6bc0133fa0 2023-10-01T07:56:06.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.599+0000 7f92cb659700 1 -- 172.21.15.26:0/905601688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f92c4074ea0 con 0x7f92c40a1340 2023-10-01T07:56:06.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.599+0000 7f92b9ffb700 1 -- 172.21.15.26:0/905601688 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f92b4017070 con 0x7f92c40a1340 2023-10-01T07:56:06.600 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:06.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.602+0000 7f92cb659700 1 -- 172.21.15.26:0/905601688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92c40a1340 msgr2=0x7f92c41c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:06.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.602+0000 7f92cb659700 1 --2- 172.21.15.26:0/905601688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92c40a1340 0x7f92c41c8c90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f92b400c510 tx=0x7f92b400c820 comp rx=0 tx=0).stop 2023-10-01T07:56:06.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.602+0000 7f92cb659700 1 -- 172.21.15.26:0/905601688 shutdown_connections 2023-10-01T07:56:06.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.602+0000 7f92cb659700 1 --2- 172.21.15.26:0/905601688 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92c4134170 0x7f92c4122870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:06.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.602+0000 7f92cb659700 1 --2- 172.21.15.26:0/905601688 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92c40a0a30 0x7f92c41c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:06.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.602+0000 7f92cb659700 1 --2- 172.21.15.26:0/905601688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92c40a1340 0x7f92c41c8c90 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:06.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.602+0000 7f92cb659700 1 -- 172.21.15.26:0/905601688 >> 172.21.15.26:0/905601688 conn(0x7f92c40a6550 msgr2=0x7f92c409ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:06.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.602+0000 7f92cb659700 1 -- 172.21.15.26:0/905601688 shutdown_connections 2023-10-01T07:56:06.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.602+0000 7f92cb659700 1 -- 172.21.15.26:0/905601688 wait complete. 2023-10-01T07:56:06.617 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:06.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.647+0000 7f1350ff9700 1 -- 172.21.15.26:0/2299000171 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f133c005860 con 0x7f1364133420 2023-10-01T07:56:06.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.647+0000 7f1352ffd700 1 -- 172.21.15.26:0/2299000171 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1354015020 con 0x7f1364133420 2023-10-01T07:56:06.648 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:06.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.649+0000 7f1350ff9700 1 -- 172.21.15.26:0/2299000171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1364133420 msgr2=0x7f136409c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:06.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.649+0000 7f1350ff9700 1 --2- 172.21.15.26:0/2299000171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1364133420 0x7f136409c480 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1354009c40 tx=0x7f1354004750 comp rx=0 tx=0).stop 2023-10-01T07:56:06.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.650+0000 7f1350ff9700 1 -- 172.21.15.26:0/2299000171 shutdown_connections 2023-10-01T07:56:06.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.650+0000 7f1350ff9700 1 --2- 172.21.15.26:0/2299000171 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1364134260 0x7f136409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:06.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.650+0000 7f1350ff9700 1 --2- 172.21.15.26:0/2299000171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1364133420 0x7f136409c480 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:06.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.650+0000 7f1350ff9700 1 --2- 172.21.15.26:0/2299000171 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1364133e30 0x7f136409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:06.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.650+0000 7f1350ff9700 1 -- 172.21.15.26:0/2299000171 >> 172.21.15.26:0/2299000171 conn(0x7f13640a4210 msgr2=0x7f13640a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:06.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.650+0000 7f1350ff9700 1 -- 172.21.15.26:0/2299000171 shutdown_connections 2023-10-01T07:56:06.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.650+0000 7f1350ff9700 1 -- 172.21.15.26:0/2299000171 wait complete. 2023-10-01T07:56:06.665 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:06.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.720+0000 7f54c0a75700 1 -- 172.21.15.26:0/2647328376 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f54bc11fe50 con 0x7f54bc133420 2023-10-01T07:56:06.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.720+0000 7f54aaffd700 1 -- 172.21.15.26:0/2647328376 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f54bc11fe50 con 0x7f54bc133420 2023-10-01T07:56:06.721 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:06.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.722+0000 7f54c0a75700 1 -- 172.21.15.26:0/2647328376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54bc133420 msgr2=0x7f54bc09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:06.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.722+0000 7f54c0a75700 1 --2- 172.21.15.26:0/2647328376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54bc133420 0x7f54bc09c480 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f54ac00e810 tx=0x7f54ac00eb20 comp rx=0 tx=0).stop 2023-10-01T07:56:06.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.722+0000 7f54c0a75700 1 -- 172.21.15.26:0/2647328376 shutdown_connections 2023-10-01T07:56:06.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.722+0000 7f54c0a75700 1 --2- 172.21.15.26:0/2647328376 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f54bc134260 0x7f54bc09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:06.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.722+0000 7f54c0a75700 1 --2- 172.21.15.26:0/2647328376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54bc133420 0x7f54bc09c480 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:06.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.722+0000 7f54c0a75700 1 --2- 172.21.15.26:0/2647328376 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f54bc133e30 0x7f54bc09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:06.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.722+0000 7f54c0a75700 1 -- 172.21.15.26:0/2647328376 >> 172.21.15.26:0/2647328376 conn(0x7f54bc0a4210 msgr2=0x7f54bc0a0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:06.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.723+0000 7f54c0a75700 1 -- 172.21.15.26:0/2647328376 shutdown_connections 2023-10-01T07:56:06.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.723+0000 7f54c0a75700 1 -- 172.21.15.26:0/2647328376 wait complete. 2023-10-01T07:56:06.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:06.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.765+0000 7f6bc5a5b700 1 -- 172.21.15.26:0/2107913464 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6bc0074ea0 con 0x7f6bc0133fa0 2023-10-01T07:56:06.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.765+0000 7f6ba7fff700 1 -- 172.21.15.26:0/2107913464 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6bb802a090 con 0x7f6bc0133fa0 2023-10-01T07:56:06.766 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:06.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.767+0000 7f6bc5a5b700 1 -- 172.21.15.26:0/2107913464 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6bc0133fa0 msgr2=0x7f6bc01c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:06.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.767+0000 7f6bc5a5b700 1 --2- 172.21.15.26:0/2107913464 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6bc0133fa0 0x7f6bc01c9040 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800cbc0 tx=0x7f6bb800ced0 comp rx=0 tx=0).stop 2023-10-01T07:56:06.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.767+0000 7f6bc5a5b700 1 -- 172.21.15.26:0/2107913464 shutdown_connections 2023-10-01T07:56:06.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.767+0000 7f6bc5a5b700 1 --2- 172.21.15.26:0/2107913464 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6bc0133fa0 0x7f6bc01c9040 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:06.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.767+0000 7f6bc5a5b700 1 --2- 172.21.15.26:0/2107913464 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6bc00a0a30 0x7f6bc01c85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:06.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.767+0000 7f6bc5a5b700 1 --2- 172.21.15.26:0/2107913464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bc00a1340 0x7f6bc01c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:06.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.767+0000 7f6bc5a5b700 1 -- 172.21.15.26:0/2107913464 >> 172.21.15.26:0/2107913464 conn(0x7f6bc00a6550 msgr2=0x7f6bc01b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:06.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.767+0000 7f6bc5a5b700 1 -- 172.21.15.26:0/2107913464 shutdown_connections 2023-10-01T07:56:06.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:06.767+0000 7f6bc5a5b700 1 -- 172.21.15.26:0/2107913464 wait complete. 2023-10-01T07:56:06.781 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:07.618 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:07.666 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:07.737 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:07.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.769+0000 7f8f0b3b4700 1 Processor -- start 2023-10-01T07:56:07.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.769+0000 7f8f0b3b4700 1 -- start start 2023-10-01T07:56:07.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.769+0000 7f8f0b3b4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f041338a0 0x7f8f04133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:07.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.770+0000 7f8f0b3b4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8f0409de50 0x7f8f0409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:07.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.770+0000 7f8f0b3b4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f0409e760 0x7f8f0413a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:07.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.770+0000 7f8f0b3b4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f0406fef0 con 0x7f8f0409de50 2023-10-01T07:56:07.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.770+0000 7f8f0b3b4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0406ef30 con 0x7f8f0409e760 2023-10-01T07:56:07.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.770+0000 7f8f0b3b4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f041334b0 con 0x7f8f041338a0 2023-10-01T07:56:07.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.770+0000 7f8f0894f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8f0409de50 0x7f8f0409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:07.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.770+0000 7f8f0894f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8f0409de50 0x7f8f0409e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44802/0 (socket says 172.21.15.26:44802) 2023-10-01T07:56:07.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.770+0000 7f8f0894f700 1 -- 172.21.15.26:0/810240234 learned_addr learned my addr 172.21.15.26:0/810240234 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:07.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.770+0000 7f8f09150700 1 --2- 172.21.15.26:0/810240234 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f041338a0 0x7f8f04133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:07.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.770+0000 7f8f09951700 1 --2- 172.21.15.26:0/810240234 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f0409e760 0x7f8f0413a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:07.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.770+0000 7f8f0894f700 1 -- 172.21.15.26:0/810240234 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f041338a0 msgr2=0x7f8f04133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:07.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.770+0000 7f8f0894f700 1 --2- 172.21.15.26:0/810240234 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f041338a0 0x7f8f04133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:07.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.770+0000 7f8f0894f700 1 -- 172.21.15.26:0/810240234 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f0409e760 msgr2=0x7f8f0413a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:07.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.770+0000 7f8f0894f700 1 --2- 172.21.15.26:0/810240234 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f0409e760 0x7f8f0413a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:07.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.770+0000 7f8f0894f700 1 -- 172.21.15.26:0/810240234 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f0406fc30 con 0x7f8f0409de50 2023-10-01T07:56:07.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.770+0000 7f8f09951700 1 --2- 172.21.15.26:0/810240234 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f0409e760 0x7f8f0413a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:07.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.770+0000 7f8f09150700 1 --2- 172.21.15.26:0/810240234 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f041338a0 0x7f8f04133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:07.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.770+0000 7f8f0894f700 1 --2- 172.21.15.26:0/810240234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f0409de50 0x7f8f0409e220 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8ef40098f0 tx=0x7f8ef4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3903c9616b25d877 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:07.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.771+0000 7f8efbfff700 1 -- 172.21.15.26:0/810240234 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4011830 con 0x7f8f0409de50 2023-10-01T07:56:07.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.771+0000 7f8efbfff700 1 -- 172.21.15.26:0/810240234 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef4011990 con 0x7f8f0409de50 2023-10-01T07:56:07.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.771+0000 7f8efbfff700 1 -- 172.21.15.26:0/810240234 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4011d20 con 0x7f8f0409de50 2023-10-01T07:56:07.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.772+0000 7f8f0b3b4700 1 -- 172.21.15.26:0/810240234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f0409de50 msgr2=0x7f8f0409e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:07.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.772+0000 7f8f0b3b4700 1 --2- 172.21.15.26:0/810240234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f0409de50 0x7f8f0409e220 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8ef40098f0 tx=0x7f8ef4009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:07.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.772+0000 7f8f0b3b4700 1 -- 172.21.15.26:0/810240234 shutdown_connections 2023-10-01T07:56:07.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.772+0000 7f8f0b3b4700 1 --2- 172.21.15.26:0/810240234 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f0409e760 0x7f8f0413a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:07.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.772+0000 7f8f0b3b4700 1 --2- 172.21.15.26:0/810240234 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f041338a0 0x7f8f04133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:07.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.772+0000 7f8f0b3b4700 1 --2- 172.21.15.26:0/810240234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f0409de50 0x7f8f0409e220 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:07.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.772+0000 7f8f0b3b4700 1 -- 172.21.15.26:0/810240234 >> 172.21.15.26:0/810240234 conn(0x7f8f040a2aa0 msgr2=0x7f8f040a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:07.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.772+0000 7f8f0b3b4700 1 -- 172.21.15.26:0/810240234 shutdown_connections 2023-10-01T07:56:07.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.772+0000 7f8f0b3b4700 1 -- 172.21.15.26:0/810240234 wait complete. 2023-10-01T07:56:07.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.773+0000 7f8f0b3b4700 1 Processor -- start 2023-10-01T07:56:07.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.773+0000 7f8f0b3b4700 1 -- start start 2023-10-01T07:56:07.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.774+0000 7f8f0b3b4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f0409de50 0x7f8f0411ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:07.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.774+0000 7f8f0b3b4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f0409e760 0x7f8f0411efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:07.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.774+0000 7f8f0b3b4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f041338a0 0x7f8f0411f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:07.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.774+0000 7f8f0b3b4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0406f640 con 0x7f8f0409e760 2023-10-01T07:56:07.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.774+0000 7f8f0b3b4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f04122270 con 0x7f8f041338a0 2023-10-01T07:56:07.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.774+0000 7f8f0b3b4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f040a10a0 con 0x7f8f0409de50 2023-10-01T07:56:07.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.774+0000 7f8f0894f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f0409e760 0x7f8f0411efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:07.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.774+0000 7f8f09150700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f0409de50 0x7f8f0411ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:07.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.774+0000 7f8f09951700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f041338a0 0x7f8f0411f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:07.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.774+0000 7f8f0894f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f0409e760 0x7f8f0411efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44806/0 (socket says 172.21.15.26:44806) 2023-10-01T07:56:07.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.774+0000 7f8f0894f700 1 -- 172.21.15.26:0/1193439281 learned_addr learned my addr 172.21.15.26:0/1193439281 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:07.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.774+0000 7f8f09150700 1 -- 172.21.15.26:0/1193439281 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f041338a0 msgr2=0x7f8f0411f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:07.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.774+0000 7f8f09150700 1 --2- 172.21.15.26:0/1193439281 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f041338a0 0x7f8f0411f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:07.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.774+0000 7f8f09150700 1 -- 172.21.15.26:0/1193439281 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f0409e760 msgr2=0x7f8f0411efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:07.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.774+0000 7f8f09150700 1 --2- 172.21.15.26:0/1193439281 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f0409e760 0x7f8f0411efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:07.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.774+0000 7f8f09150700 1 -- 172.21.15.26:0/1193439281 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc009a70 con 0x7f8f0409de50 2023-10-01T07:56:07.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.774+0000 7f8f09951700 1 --2- 172.21.15.26:0/1193439281 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f041338a0 0x7f8f0411f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:07.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.774+0000 7f8f0894f700 1 --2- 172.21.15.26:0/1193439281 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f0409e760 0x7f8f0411efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:07.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.774+0000 7f8f09150700 1 --2- 172.21.15.26:0/1193439281 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f0409de50 0x7f8f0411ea80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8f0000e9e0 tx=0x7f8f0000ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:07.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.775+0000 7f8ef9ffb700 1 -- 172.21.15.26:0/1193439281 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0000ee70 con 0x7f8f0409de50 2023-10-01T07:56:07.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.775+0000 7f8ef9ffb700 1 -- 172.21.15.26:0/1193439281 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f0000c850 con 0x7f8f0409de50 2023-10-01T07:56:07.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.775+0000 7f8f0b3b4700 1 -- 172.21.15.26:0/1193439281 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f000094a0 con 0x7f8f0409de50 2023-10-01T07:56:07.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.775+0000 7f8ef9ffb700 1 -- 172.21.15.26:0/1193439281 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0000cc00 con 0x7f8f0409de50 2023-10-01T07:56:07.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.775+0000 7f8f0b3b4700 1 -- 172.21.15.26:0/1193439281 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef4009550 con 0x7f8f0409de50 2023-10-01T07:56:07.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.776+0000 7f8ef9ffb700 1 -- 172.21.15.26:0/1193439281 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8f0000cd60 con 0x7f8f0409de50 2023-10-01T07:56:07.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.776+0000 7f8f0b3b4700 1 -- 172.21.15.26:0/1193439281 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f04074ea0 con 0x7f8f0409de50 2023-10-01T07:56:07.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.776+0000 7f8ef9ffb700 1 -- 172.21.15.26:0/1193439281 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8f0003f6a0 con 0x7f8f0409de50 2023-10-01T07:56:07.782 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:07.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.785+0000 7f8ef9ffb700 1 -- 172.21.15.26:0/1193439281 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8f0001bdd0 con 0x7f8f0409de50 2023-10-01T07:56:07.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.821+0000 7f4286331700 1 Processor -- start 2023-10-01T07:56:07.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.821+0000 7f4286331700 1 -- start start 2023-10-01T07:56:07.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.822+0000 7f4286331700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4280130670 0x7f4280130a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:07.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.822+0000 7f4286331700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f428006f680 0x7f428006fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:07.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.822+0000 7f4286331700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4280130260 con 0x7f428006ffd0 2023-10-01T07:56:07.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.822+0000 7f4286331700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4280071ff0 con 0x7f4280130670 2023-10-01T07:56:07.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.822+0000 7f4286331700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f428009ecf0 con 0x7f428006f680 2023-10-01T07:56:07.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.822+0000 7f42848ce700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f428006ffd0 0x7f4280137530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57492/0 (socket says 172.21.15.26:57492) 2023-10-01T07:56:07.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.822+0000 7f427ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4280130670 0x7f4280130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:07.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.822+0000 7f42848ce700 1 -- 172.21.15.26:0/1472865705 learned_addr learned my addr 172.21.15.26:0/1472865705 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:07.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.822+0000 7f427f7fe700 1 --2- 172.21.15.26:0/1472865705 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f428006f680 0x7f428006fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:07.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.823+0000 7f427f7fe700 1 -- 172.21.15.26:0/1472865705 >> v2:172.21.15.26:3300/0 conn(0x7f4280130670 msgr2=0x7f4280130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:07.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.823+0000 7f427f7fe700 1 --2- 172.21.15.26:0/1472865705 >> v2:172.21.15.26:3300/0 conn(0x7f4280130670 0x7f4280130a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:07.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.823+0000 7f427f7fe700 1 -- 172.21.15.26:0/1472865705 >> v1:172.21.15.26:6789/0 conn(0x7f428006ffd0 legacy=0x7f4280137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:07.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.823+0000 7f427f7fe700 1 -- 172.21.15.26:0/1472865705 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4280070e70 con 0x7f428006f680 2023-10-01T07:56:07.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.823+0000 7f427f7fe700 1 --2- 172.21.15.26:0/1472865705 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f428006f680 0x7f428006fa90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4274009840 tx=0x7f4274009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a16b3ee80a3399d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:07.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.823+0000 7f427effd700 1 -- 172.21.15.26:0/1472865705 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4274011830 con 0x7f428006f680 2023-10-01T07:56:07.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.823+0000 7f427effd700 1 -- 172.21.15.26:0/1472865705 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4274011990 con 0x7f428006f680 2023-10-01T07:56:07.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.823+0000 7f427effd700 1 -- 172.21.15.26:0/1472865705 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4274011d20 con 0x7f428006f680 2023-10-01T07:56:07.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.824+0000 7f4286331700 1 -- 172.21.15.26:0/1472865705 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f428006f680 msgr2=0x7f428006fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:07.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.824+0000 7f4286331700 1 --2- 172.21.15.26:0/1472865705 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f428006f680 0x7f428006fa90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4274009840 tx=0x7f4274009b50 comp rx=0 tx=0).stop 2023-10-01T07:56:07.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.824+0000 7f4286331700 1 -- 172.21.15.26:0/1472865705 shutdown_connections 2023-10-01T07:56:07.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.824+0000 7f4286331700 1 --2- 172.21.15.26:0/1472865705 >> v2:172.21.15.26:3300/0 conn(0x7f4280130670 0x7f4280130a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:07.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.824+0000 7f4286331700 1 --2- 172.21.15.26:0/1472865705 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f428006f680 0x7f428006fa90 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:07.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.824+0000 7f4286331700 1 -- 172.21.15.26:0/1472865705 >> 172.21.15.26:0/1472865705 conn(0x7f42800a2aa0 msgr2=0x7f42800a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:07.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.824+0000 7f4286331700 1 -- 172.21.15.26:0/1472865705 shutdown_connections 2023-10-01T07:56:07.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.824+0000 7f4286331700 1 -- 172.21.15.26:0/1472865705 wait complete. 2023-10-01T07:56:07.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.825+0000 7f4286331700 1 Processor -- start 2023-10-01T07:56:07.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.826+0000 7f4286331700 1 -- start start 2023-10-01T07:56:07.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.826+0000 7f4286331700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f428006f680 0x7f4280138e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:07.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.826+0000 7f4286331700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f428006ffd0 0x7f4280133c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:07.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.826+0000 7f4286331700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4280130670 0x7f4280134190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:07.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.826+0000 7f4286331700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428012e500 con 0x7f428006f680 2023-10-01T07:56:07.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.826+0000 7f4286331700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42801371d0 con 0x7f4280130670 2023-10-01T07:56:07.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.826+0000 7f4286331700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4280136f20 con 0x7f428006ffd0 2023-10-01T07:56:07.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.827+0000 7f42848ce700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4280130670 0x7f4280134190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:07.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.827+0000 7f42848ce700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4280130670 0x7f4280134190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:41100/0 (socket says 172.21.15.26:41100) 2023-10-01T07:56:07.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.827+0000 7f42848ce700 1 -- 172.21.15.26:0/140293221 learned_addr learned my addr 172.21.15.26:0/140293221 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:07.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.827+0000 7f427f7fe700 1 --2- 172.21.15.26:0/140293221 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f428006ffd0 0x7f4280133c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:07.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.827+0000 7f427ffff700 1 --2- 172.21.15.26:0/140293221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f428006f680 0x7f4280138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:07.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.827+0000 7f427f7fe700 1 -- 172.21.15.26:0/140293221 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4280130670 msgr2=0x7f4280134190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:07.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.827+0000 7f427f7fe700 1 --2- 172.21.15.26:0/140293221 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4280130670 0x7f4280134190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:07.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.827+0000 7f427f7fe700 1 -- 172.21.15.26:0/140293221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f428006f680 msgr2=0x7f4280138e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:07.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.827+0000 7f427f7fe700 1 --2- 172.21.15.26:0/140293221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f428006f680 0x7f4280138e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:07.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.827+0000 7f427f7fe700 1 -- 172.21.15.26:0/140293221 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42740094a0 con 0x7f428006ffd0 2023-10-01T07:56:07.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.827+0000 7f42848ce700 1 --2- 172.21.15.26:0/140293221 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4280130670 0x7f4280134190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:07.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.827+0000 7f427f7fe700 1 --2- 172.21.15.26:0/140293221 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f428006ffd0 0x7f4280133c50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4274016000 tx=0x7f4274004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:07.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.828+0000 7f427cff9700 1 -- 172.21.15.26:0/140293221 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42740036a0 con 0x7f428006ffd0 2023-10-01T07:56:07.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.828+0000 7f427cff9700 1 -- 172.21.15.26:0/140293221 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427401f070 con 0x7f428006ffd0 2023-10-01T07:56:07.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.828+0000 7f4286331700 1 -- 172.21.15.26:0/140293221 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4280137490 con 0x7f428006ffd0 2023-10-01T07:56:07.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.828+0000 7f427cff9700 1 -- 172.21.15.26:0/140293221 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4274003a60 con 0x7f428006ffd0 2023-10-01T07:56:07.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.828+0000 7f4286331700 1 -- 172.21.15.26:0/140293221 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4280137f00 con 0x7f428006ffd0 2023-10-01T07:56:07.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.829+0000 7f427cff9700 1 -- 172.21.15.26:0/140293221 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4274003bc0 con 0x7f428006ffd0 2023-10-01T07:56:07.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.829+0000 7f427cff9700 1 -- 172.21.15.26:0/140293221 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4274021070 con 0x7f428006ffd0 2023-10-01T07:56:07.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.830+0000 7f4286331700 1 -- 172.21.15.26:0/140293221 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f428009dd00 con 0x7f428006ffd0 2023-10-01T07:56:07.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.840+0000 7f427cff9700 1 -- 172.21.15.26:0/140293221 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4274015070 con 0x7f428006ffd0 2023-10-01T07:56:07.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.905+0000 7feb56222700 1 Processor -- start 2023-10-01T07:56:07.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.905+0000 7feb56222700 1 -- start start 2023-10-01T07:56:07.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.906+0000 7feb56222700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb5009d630 0x7feb500a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:07.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.906+0000 7feb56222700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb50138d80 0x7feb5013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:07.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.906+0000 7feb56222700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb500a2a70 con 0x7feb500a0a30 2023-10-01T07:56:07.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.906+0000 7feb56222700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb500a01d0 con 0x7feb5009d630 2023-10-01T07:56:07.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.906+0000 7feb56222700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb5009e2b0 con 0x7feb50138d80 2023-10-01T07:56:07.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.906+0000 7feb4effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb5009d630 0x7feb500a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:07.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.906+0000 7feb4effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb5009d630 0x7feb500a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:41106/0 (socket says 172.21.15.26:41106) 2023-10-01T07:56:07.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.906+0000 7feb4effd700 1 -- 172.21.15.26:0/4194789676 learned_addr learned my addr 172.21.15.26:0/4194789676 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:07.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.906+0000 7feb4ffff700 1 --2- 172.21.15.26:0/4194789676 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb50138d80 0x7feb5013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:07.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.906+0000 7feb4effd700 1 -- 172.21.15.26:0/4194789676 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb50138d80 msgr2=0x7feb5013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:07.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.906+0000 7feb4effd700 1 --2- 172.21.15.26:0/4194789676 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb50138d80 0x7feb5013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:07.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.906+0000 7feb4effd700 1 -- 172.21.15.26:0/4194789676 >> v1:172.21.15.26:6789/0 conn(0x7feb500a0a30 legacy=0x7feb500a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:07.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.906+0000 7feb4effd700 1 -- 172.21.15.26:0/4194789676 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb5009dc50 con 0x7feb5009d630 2023-10-01T07:56:07.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.907+0000 7feb4ffff700 1 --2- 172.21.15.26:0/4194789676 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb50138d80 0x7feb5013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:07.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.907+0000 7feb4effd700 1 --2- 172.21.15.26:0/4194789676 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb5009d630 0x7feb500a1510 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7feb44009920 tx=0x7feb44009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59eeaba4a0d46f8b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:07.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.907+0000 7feb4e7fc700 1 -- 172.21.15.26:0/4194789676 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb44004230 con 0x7feb5009d630 2023-10-01T07:56:07.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.907+0000 7feb4e7fc700 1 -- 172.21.15.26:0/4194789676 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb44004390 con 0x7feb5009d630 2023-10-01T07:56:07.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.907+0000 7feb4e7fc700 1 -- 172.21.15.26:0/4194789676 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb440036a0 con 0x7feb5009d630 2023-10-01T07:56:07.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.908+0000 7feb56222700 1 -- 172.21.15.26:0/4194789676 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb5009d630 msgr2=0x7feb500a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:07.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.908+0000 7feb56222700 1 --2- 172.21.15.26:0/4194789676 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb5009d630 0x7feb500a1510 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7feb44009920 tx=0x7feb44009c30 comp rx=0 tx=0).stop 2023-10-01T07:56:07.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.908+0000 7feb56222700 1 -- 172.21.15.26:0/4194789676 shutdown_connections 2023-10-01T07:56:07.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.908+0000 7feb56222700 1 --2- 172.21.15.26:0/4194789676 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb50138d80 0x7feb5013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:07.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.908+0000 7feb56222700 1 --2- 172.21.15.26:0/4194789676 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb5009d630 0x7feb500a1510 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:07.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.908+0000 7feb56222700 1 -- 172.21.15.26:0/4194789676 >> 172.21.15.26:0/4194789676 conn(0x7feb500a3050 msgr2=0x7feb500a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:07.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.908+0000 7feb56222700 1 -- 172.21.15.26:0/4194789676 shutdown_connections 2023-10-01T07:56:07.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.908+0000 7feb56222700 1 -- 172.21.15.26:0/4194789676 wait complete. 2023-10-01T07:56:07.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.909+0000 7feb56222700 1 Processor -- start 2023-10-01T07:56:07.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.910+0000 7feb56222700 1 -- start start 2023-10-01T07:56:07.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.910+0000 7feb56222700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb5009d630 0x7feb5011d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:07.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.910+0000 7feb56222700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb500a0a30 0x7feb5011db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:07.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.910+0000 7feb56222700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb50138d80 0x7feb5011e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:07.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.910+0000 7feb56222700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb500a0410 con 0x7feb500a0a30 2023-10-01T07:56:07.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.910+0000 7feb56222700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb50120040 con 0x7feb50138d80 2023-10-01T07:56:07.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.910+0000 7feb56222700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb50120d60 con 0x7feb5009d630 2023-10-01T07:56:07.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.910+0000 7feb4ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb50138d80 0x7feb5011e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:07.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.910+0000 7feb4ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb50138d80 0x7feb5011e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:41110/0 (socket says 172.21.15.26:41110) 2023-10-01T07:56:07.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.910+0000 7feb4f7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb5009d630 0x7feb5011d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:07.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.910+0000 7feb4ffff700 1 -- 172.21.15.26:0/3547552259 learned_addr learned my addr 172.21.15.26:0/3547552259 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:07.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.911+0000 7feb4effd700 1 --2- 172.21.15.26:0/3547552259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb500a0a30 0x7feb5011db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:07.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.911+0000 7feb4ffff700 1 -- 172.21.15.26:0/3547552259 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb5009d630 msgr2=0x7feb5011d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:07.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.911+0000 7feb4ffff700 1 --2- 172.21.15.26:0/3547552259 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb5009d630 0x7feb5011d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:07.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.911+0000 7feb4ffff700 1 -- 172.21.15.26:0/3547552259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb500a0a30 msgr2=0x7feb5011db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:07.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.911+0000 7feb4ffff700 1 --2- 172.21.15.26:0/3547552259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb500a0a30 0x7feb5011db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:07.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.911+0000 7feb4ffff700 1 -- 172.21.15.26:0/3547552259 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb48009a70 con 0x7feb50138d80 2023-10-01T07:56:07.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.911+0000 7feb4f7fe700 1 --2- 172.21.15.26:0/3547552259 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb5009d630 0x7feb5011d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:07.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.911+0000 7feb4ffff700 1 --2- 172.21.15.26:0/3547552259 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb50138d80 0x7feb5011e080 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7feb4800efc0 tx=0x7feb4800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:07.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.911+0000 7feb37fff700 1 -- 172.21.15.26:0/3547552259 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4800ca90 con 0x7feb50138d80 2023-10-01T07:56:07.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.912+0000 7feb56222700 1 -- 172.21.15.26:0/3547552259 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb44009550 con 0x7feb50138d80 2023-10-01T07:56:07.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.912+0000 7feb37fff700 1 -- 172.21.15.26:0/3547552259 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4800f040 con 0x7feb50138d80 2023-10-01T07:56:07.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.912+0000 7feb37fff700 1 -- 172.21.15.26:0/3547552259 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4800ce50 con 0x7feb50138d80 2023-10-01T07:56:07.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.912+0000 7feb56222700 1 -- 172.21.15.26:0/3547552259 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb5011f920 con 0x7feb50138d80 2023-10-01T07:56:07.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.913+0000 7feb37fff700 1 -- 172.21.15.26:0/3547552259 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feb48014480 con 0x7feb50138d80 2023-10-01T07:56:07.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.913+0000 7feb37fff700 1 -- 172.21.15.26:0/3547552259 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7feb4803fe80 con 0x7feb50138d80 2023-10-01T07:56:07.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.913+0000 7feb56222700 1 -- 172.21.15.26:0/3547552259 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb500747f0 con 0x7feb50138d80 2023-10-01T07:56:07.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.918+0000 7feb37fff700 1 -- 172.21.15.26:0/3547552259 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feb48012930 con 0x7feb50138d80 2023-10-01T07:56:07.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.947+0000 7f25f5957700 1 Processor -- start 2023-10-01T07:56:07.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.947+0000 7f25f5957700 1 -- start start 2023-10-01T07:56:07.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.948+0000 7f25f5957700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f0130540 0x7f25f0130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:07.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.948+0000 7f25f5957700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f25f0130e50 0x7f25f006f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:07.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.948+0000 7f25f5957700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25f006fb20 0x7f25f006ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:07.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.948+0000 7f25f5957700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f00704b0 con 0x7f25f0130e50 2023-10-01T07:56:07.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.948+0000 7f25f5957700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f009a390 con 0x7f25f006fb20 2023-10-01T07:56:07.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.948+0000 7f25f5957700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25f00716a0 con 0x7f25f0130540 2023-10-01T07:56:07.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.948+0000 7f25eeffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f0130540 0x7f25f0130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:07.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.948+0000 7f25eeffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f0130540 0x7f25f0130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:50140/0 (socket says 172.21.15.26:50140) 2023-10-01T07:56:07.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.948+0000 7f25eeffd700 1 -- 172.21.15.26:0/2303056693 learned_addr learned my addr 172.21.15.26:0/2303056693 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:07.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.948+0000 7f25ef7fe700 1 --2- 172.21.15.26:0/2303056693 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25f006fb20 0x7f25f006ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:07.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.948+0000 7f25ee7fc700 1 --2- 172.21.15.26:0/2303056693 >> v2:172.21.15.26:3300/0 conn(0x7f25f0130e50 0x7f25f006f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:07.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.948+0000 7f25eeffd700 1 -- 172.21.15.26:0/2303056693 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25f006fb20 msgr2=0x7f25f006ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:07.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.948+0000 7f25eeffd700 1 --2- 172.21.15.26:0/2303056693 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25f006fb20 0x7f25f006ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:07.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.948+0000 7f25eeffd700 1 -- 172.21.15.26:0/2303056693 >> v2:172.21.15.26:3300/0 conn(0x7f25f0130e50 msgr2=0x7f25f006f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:07.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.948+0000 7f25eeffd700 1 --2- 172.21.15.26:0/2303056693 >> v2:172.21.15.26:3300/0 conn(0x7f25f0130e50 0x7f25f006f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:07.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.948+0000 7f25eeffd700 1 -- 172.21.15.26:0/2303056693 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f0071290 con 0x7f25f0130540 2023-10-01T07:56:07.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.949+0000 7f25eeffd700 1 --2- 172.21.15.26:0/2303056693 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f0130540 0x7f25f0130910 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f25e0009920 tx=0x7f25e0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ead51b58eea21bb server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:07.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.949+0000 7f25edffb700 1 -- 172.21.15.26:0/2303056693 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e000f8a0 con 0x7f25f0130540 2023-10-01T07:56:07.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.949+0000 7f25edffb700 1 -- 172.21.15.26:0/2303056693 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e000fa00 con 0x7f25f0130540 2023-10-01T07:56:07.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.949+0000 7f25edffb700 1 -- 172.21.15.26:0/2303056693 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e000fd90 con 0x7f25f0130540 2023-10-01T07:56:07.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.950+0000 7f25f5957700 1 -- 172.21.15.26:0/2303056693 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f0130540 msgr2=0x7f25f0130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:07.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.950+0000 7f25f5957700 1 --2- 172.21.15.26:0/2303056693 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f0130540 0x7f25f0130910 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f25e0009920 tx=0x7f25e0009c30 comp rx=0 tx=0).stop 2023-10-01T07:56:07.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.950+0000 7f25f5957700 1 -- 172.21.15.26:0/2303056693 shutdown_connections 2023-10-01T07:56:07.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.950+0000 7f25f5957700 1 --2- 172.21.15.26:0/2303056693 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25f006fb20 0x7f25f006ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:07.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.950+0000 7f25f5957700 1 --2- 172.21.15.26:0/2303056693 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f0130540 0x7f25f0130910 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:07.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.950+0000 7f25f5957700 1 --2- 172.21.15.26:0/2303056693 >> v2:172.21.15.26:3300/0 conn(0x7f25f0130e50 0x7f25f006f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:07.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.950+0000 7f25f5957700 1 -- 172.21.15.26:0/2303056693 >> 172.21.15.26:0/2303056693 conn(0x7f25f00a2aa0 msgr2=0x7f25f00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:07.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.950+0000 7f25f5957700 1 -- 172.21.15.26:0/2303056693 shutdown_connections 2023-10-01T07:56:07.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.950+0000 7f25f5957700 1 -- 172.21.15.26:0/2303056693 wait complete. 2023-10-01T07:56:07.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.951+0000 7f25f5957700 1 Processor -- start 2023-10-01T07:56:07.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.952+0000 7f25f5957700 1 -- start start 2023-10-01T07:56:07.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.952+0000 7f25f5957700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25f006fb20 0x7f25f009afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:07.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.952+0000 7f25f5957700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f0130540 0x7f25f009b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:07.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.952+0000 7f25f5957700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f0130e50 0x7f25f009ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:07.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.952+0000 7f25f5957700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f0128990 con 0x7f25f0130e50 2023-10-01T07:56:07.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.952+0000 7f25f5957700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f009cc10 con 0x7f25f006fb20 2023-10-01T07:56:07.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.952+0000 7f25f5957700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25f00a0c40 con 0x7f25f0130540 2023-10-01T07:56:07.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.953+0000 7f25ee7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f0130540 0x7f25f009b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:07.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.953+0000 7f25ee7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f0130540 0x7f25f009b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:50148/0 (socket says 172.21.15.26:50148) 2023-10-01T07:56:07.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.953+0000 7f25ee7fc700 1 -- 172.21.15.26:0/156286799 learned_addr learned my addr 172.21.15.26:0/156286799 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:07.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.953+0000 7f25eeffd700 1 --2- 172.21.15.26:0/156286799 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25f006fb20 0x7f25f009afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:07.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.953+0000 7f25ef7fe700 1 --2- 172.21.15.26:0/156286799 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f0130e50 0x7f25f009ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:07.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.953+0000 7f25ee7fc700 1 -- 172.21.15.26:0/156286799 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25f006fb20 msgr2=0x7f25f009afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:07.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.953+0000 7f25ee7fc700 1 --2- 172.21.15.26:0/156286799 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25f006fb20 0x7f25f009afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:07.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.953+0000 7f25ee7fc700 1 -- 172.21.15.26:0/156286799 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f0130e50 msgr2=0x7f25f009ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:07.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.953+0000 7f25ee7fc700 1 --2- 172.21.15.26:0/156286799 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f0130e50 0x7f25f009ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:07.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.953+0000 7f25ee7fc700 1 -- 172.21.15.26:0/156286799 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e0009550 con 0x7f25f0130540 2023-10-01T07:56:07.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.953+0000 7f25ee7fc700 1 --2- 172.21.15.26:0/156286799 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f0130540 0x7f25f009b4e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f25e400e980 tx=0x7f25e400ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:07.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.953+0000 7f25d7fff700 1 -- 172.21.15.26:0/156286799 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e4009710 con 0x7f25f0130540 2023-10-01T07:56:07.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.954+0000 7f25d7fff700 1 -- 172.21.15.26:0/156286799 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e400eed0 con 0x7f25f0130540 2023-10-01T07:56:07.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.954+0000 7f25d7fff700 1 -- 172.21.15.26:0/156286799 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e400ca70 con 0x7f25f0130540 2023-10-01T07:56:07.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.954+0000 7f25f5957700 1 -- 172.21.15.26:0/156286799 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f011d210 con 0x7f25f0130540 2023-10-01T07:56:07.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.954+0000 7f25f5957700 1 -- 172.21.15.26:0/156286799 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f009d0c0 con 0x7f25f0130540 2023-10-01T07:56:07.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.955+0000 7f25f5957700 1 -- 172.21.15.26:0/156286799 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f011dd40 con 0x7f25f0130540 2023-10-01T07:56:07.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.955+0000 7f25d7fff700 1 -- 172.21.15.26:0/156286799 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f25e400cbd0 con 0x7f25f0130540 2023-10-01T07:56:07.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.956+0000 7f25d7fff700 1 -- 172.21.15.26:0/156286799 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f25e403fba0 con 0x7f25f0130540 2023-10-01T07:56:07.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:07.965+0000 7f25d7fff700 1 -- 172.21.15.26:0/156286799 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25e401b3b0 con 0x7f25f0130540 2023-10-01T07:56:08.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.005+0000 7f8f0b3b4700 1 -- 172.21.15.26:0/1193439281 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8f04121f10 con 0x7f8f0409de50 2023-10-01T07:56:08.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.005+0000 7f8ef9ffb700 1 -- 172.21.15.26:0/1193439281 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8f0001b9c0 con 0x7f8f0409de50 2023-10-01T07:56:08.006 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:08.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.007+0000 7f8f0b3b4700 1 -- 172.21.15.26:0/1193439281 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f0409de50 msgr2=0x7f8f0411ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:08.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.007+0000 7f8f0b3b4700 1 --2- 172.21.15.26:0/1193439281 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f0409de50 0x7f8f0411ea80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8f0000e9e0 tx=0x7f8f0000ecf0 comp rx=0 tx=0).stop 2023-10-01T07:56:08.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.007+0000 7f8f0b3b4700 1 -- 172.21.15.26:0/1193439281 shutdown_connections 2023-10-01T07:56:08.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.007+0000 7f8f0b3b4700 1 --2- 172.21.15.26:0/1193439281 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f041338a0 0x7f8f0411f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:08.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.007+0000 7f8f0b3b4700 1 --2- 172.21.15.26:0/1193439281 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f0409de50 0x7f8f0411ea80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:08.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.008+0000 7f8f0b3b4700 1 --2- 172.21.15.26:0/1193439281 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f0409e760 0x7f8f0411efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:08.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.008+0000 7f8f0b3b4700 1 -- 172.21.15.26:0/1193439281 >> 172.21.15.26:0/1193439281 conn(0x7f8f040a2aa0 msgr2=0x7f8f0409ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:08.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.008+0000 7f8f0b3b4700 1 -- 172.21.15.26:0/1193439281 shutdown_connections 2023-10-01T07:56:08.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.008+0000 7f8f0b3b4700 1 -- 172.21.15.26:0/1193439281 wait complete. 2023-10-01T07:56:08.022 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:08.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.079+0000 7f4286331700 1 -- 172.21.15.26:0/140293221 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4280074ea0 con 0x7f428006ffd0 2023-10-01T07:56:08.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.079+0000 7f427cff9700 1 -- 172.21.15.26:0/140293221 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4274026480 con 0x7f428006ffd0 2023-10-01T07:56:08.080 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:08.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.081+0000 7f4286331700 1 -- 172.21.15.26:0/140293221 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f428006ffd0 msgr2=0x7f4280133c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:08.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.081+0000 7f4286331700 1 --2- 172.21.15.26:0/140293221 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f428006ffd0 0x7f4280133c50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4274016000 tx=0x7f4274004750 comp rx=0 tx=0).stop 2023-10-01T07:56:08.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.081+0000 7f4286331700 1 -- 172.21.15.26:0/140293221 shutdown_connections 2023-10-01T07:56:08.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.081+0000 7f4286331700 1 --2- 172.21.15.26:0/140293221 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4280130670 0x7f4280134190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:08.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.081+0000 7f4286331700 1 --2- 172.21.15.26:0/140293221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f428006f680 0x7f4280138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:08.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.081+0000 7f4286331700 1 --2- 172.21.15.26:0/140293221 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f428006ffd0 0x7f4280133c50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:08.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.081+0000 7f4286331700 1 -- 172.21.15.26:0/140293221 >> 172.21.15.26:0/140293221 conn(0x7f42800a2aa0 msgr2=0x7f42800a1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:08.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.082+0000 7f4286331700 1 -- 172.21.15.26:0/140293221 shutdown_connections 2023-10-01T07:56:08.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.082+0000 7f4286331700 1 -- 172.21.15.26:0/140293221 wait complete. 2023-10-01T07:56:08.096 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:08.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.170+0000 7feb56222700 1 -- 172.21.15.26:0/3547552259 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7feb50072980 con 0x7feb50138d80 2023-10-01T07:56:08.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.171+0000 7feb37fff700 1 -- 172.21.15.26:0/3547552259 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feb48012340 con 0x7feb50138d80 2023-10-01T07:56:08.171 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:08.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.173+0000 7feb56222700 1 -- 172.21.15.26:0/3547552259 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb50138d80 msgr2=0x7feb5011e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:08.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.173+0000 7feb56222700 1 --2- 172.21.15.26:0/3547552259 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb50138d80 0x7feb5011e080 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7feb4800efc0 tx=0x7feb4800c3a0 comp rx=0 tx=0).stop 2023-10-01T07:56:08.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.173+0000 7feb56222700 1 -- 172.21.15.26:0/3547552259 shutdown_connections 2023-10-01T07:56:08.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.173+0000 7feb56222700 1 --2- 172.21.15.26:0/3547552259 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb50138d80 0x7feb5011e080 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:08.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.173+0000 7feb56222700 1 --2- 172.21.15.26:0/3547552259 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb5009d630 0x7feb5011d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:08.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.173+0000 7feb56222700 1 --2- 172.21.15.26:0/3547552259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb500a0a30 0x7feb5011db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:08.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.173+0000 7feb56222700 1 -- 172.21.15.26:0/3547552259 >> 172.21.15.26:0/3547552259 conn(0x7feb500a3050 msgr2=0x7feb500a5380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:08.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.173+0000 7feb56222700 1 -- 172.21.15.26:0/3547552259 shutdown_connections 2023-10-01T07:56:08.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.173+0000 7feb56222700 1 -- 172.21.15.26:0/3547552259 wait complete. 2023-10-01T07:56:08.187 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:08.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.206+0000 7f25f5957700 1 -- 172.21.15.26:0/156286799 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f25f0074ea0 con 0x7f25f0130540 2023-10-01T07:56:08.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.206+0000 7f25d7fff700 1 -- 172.21.15.26:0/156286799 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f25e4017020 con 0x7f25f0130540 2023-10-01T07:56:08.207 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:08.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.208+0000 7f25f5957700 1 -- 172.21.15.26:0/156286799 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f0130540 msgr2=0x7f25f009b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:08.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.208+0000 7f25f5957700 1 --2- 172.21.15.26:0/156286799 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f0130540 0x7f25f009b4e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f25e400e980 tx=0x7f25e400ec90 comp rx=0 tx=0).stop 2023-10-01T07:56:08.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.208+0000 7f25f5957700 1 -- 172.21.15.26:0/156286799 shutdown_connections 2023-10-01T07:56:08.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.208+0000 7f25f5957700 1 --2- 172.21.15.26:0/156286799 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f0130e50 0x7f25f009ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:08.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.208+0000 7f25f5957700 1 --2- 172.21.15.26:0/156286799 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25f006fb20 0x7f25f009afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:08.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.208+0000 7f25f5957700 1 --2- 172.21.15.26:0/156286799 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f0130540 0x7f25f009b4e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:08.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.208+0000 7f25f5957700 1 -- 172.21.15.26:0/156286799 >> 172.21.15.26:0/156286799 conn(0x7f25f00a2aa0 msgr2=0x7f25f01b6240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:08.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.208+0000 7f25f5957700 1 -- 172.21.15.26:0/156286799 shutdown_connections 2023-10-01T07:56:08.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:08.209+0000 7f25f5957700 1 -- 172.21.15.26:0/156286799 wait complete. 2023-10-01T07:56:08.222 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:09.023 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:09.097 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:09.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.171+0000 7f29f0e29700 1 Processor -- start 2023-10-01T07:56:09.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.171+0000 7f29f0e29700 1 -- start start 2023-10-01T07:56:09.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.171+0000 7f29f0e29700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29ec0a0a30 0x7f29ec0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:09.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.171+0000 7f29f0e29700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f29ec09d630 0x7f29ec0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:09.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.171+0000 7f29f0e29700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29ec133930 0x7f29ec133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:09.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.171+0000 7f29f0e29700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29ec0a2a70 con 0x7f29ec09d630 2023-10-01T07:56:09.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.171+0000 7f29f0e29700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec0a01d0 con 0x7f29ec0a0a30 2023-10-01T07:56:09.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.171+0000 7f29f0e29700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec09e2b0 con 0x7f29ec133930 2023-10-01T07:56:09.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.171+0000 7f29ea59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29ec0a0a30 0x7f29ec0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:09.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.171+0000 7f29ead9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29ec133930 0x7f29ec133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:09.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.172+0000 7f29ea59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29ec0a0a30 0x7f29ec0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:41134/0 (socket says 172.21.15.26:41134) 2023-10-01T07:56:09.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.172+0000 7f29ead9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29ec133930 0x7f29ec133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:50152/0 (socket says 172.21.15.26:50152) 2023-10-01T07:56:09.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.172+0000 7f29e9d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f29ec09d630 0x7f29ec0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:09.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.172+0000 7f29ea59c700 1 -- 172.21.15.26:0/1910151250 learned_addr learned my addr 172.21.15.26:0/1910151250 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:09.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.172+0000 7f29ea59c700 1 -- 172.21.15.26:0/1910151250 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29ec133930 msgr2=0x7f29ec133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:09.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.172+0000 7f29ea59c700 1 --2- 172.21.15.26:0/1910151250 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29ec133930 0x7f29ec133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.172+0000 7f29ea59c700 1 -- 172.21.15.26:0/1910151250 >> v2:172.21.15.26:3300/0 conn(0x7f29ec09d630 msgr2=0x7f29ec0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:09.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.172+0000 7f29ea59c700 1 --2- 172.21.15.26:0/1910151250 >> v2:172.21.15.26:3300/0 conn(0x7f29ec09d630 0x7f29ec0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.172+0000 7f29ea59c700 1 -- 172.21.15.26:0/1910151250 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ec09dc50 con 0x7f29ec0a0a30 2023-10-01T07:56:09.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.172+0000 7f29ead9d700 1 --2- 172.21.15.26:0/1910151250 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29ec133930 0x7f29ec133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:09.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.172+0000 7f29e9d9b700 1 --2- 172.21.15.26:0/1910151250 >> v2:172.21.15.26:3300/0 conn(0x7f29ec09d630 0x7f29ec0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:09.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.172+0000 7f29ea59c700 1 --2- 172.21.15.26:0/1910151250 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29ec0a0a30 0x7f29ec0a0e00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f29e40098f0 tx=0x7f29e4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b4c1d89371fff07 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:09.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.172+0000 7f29e959a700 1 -- 172.21.15.26:0/1910151250 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e4011830 con 0x7f29ec0a0a30 2023-10-01T07:56:09.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.172+0000 7f29e959a700 1 -- 172.21.15.26:0/1910151250 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e4011990 con 0x7f29ec0a0a30 2023-10-01T07:56:09.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.172+0000 7f29e959a700 1 -- 172.21.15.26:0/1910151250 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e4011d20 con 0x7f29ec0a0a30 2023-10-01T07:56:09.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.173+0000 7f29f0e29700 1 -- 172.21.15.26:0/1910151250 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29ec0a0a30 msgr2=0x7f29ec0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:09.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.173+0000 7f29f0e29700 1 --2- 172.21.15.26:0/1910151250 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29ec0a0a30 0x7f29ec0a0e00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f29e40098f0 tx=0x7f29e4009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:09.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.173+0000 7f29f0e29700 1 -- 172.21.15.26:0/1910151250 shutdown_connections 2023-10-01T07:56:09.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.173+0000 7f29f0e29700 1 --2- 172.21.15.26:0/1910151250 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29ec133930 0x7f29ec133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.173+0000 7f29f0e29700 1 --2- 172.21.15.26:0/1910151250 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29ec0a0a30 0x7f29ec0a0e00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.173+0000 7f29f0e29700 1 --2- 172.21.15.26:0/1910151250 >> v2:172.21.15.26:3300/0 conn(0x7f29ec09d630 0x7f29ec0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.173+0000 7f29f0e29700 1 -- 172.21.15.26:0/1910151250 >> 172.21.15.26:0/1910151250 conn(0x7f29ec0a3050 msgr2=0x7f29ec0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:09.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.173+0000 7f29f0e29700 1 -- 172.21.15.26:0/1910151250 shutdown_connections 2023-10-01T07:56:09.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.173+0000 7f29f0e29700 1 -- 172.21.15.26:0/1910151250 wait complete. 2023-10-01T07:56:09.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.175+0000 7f29f0e29700 1 Processor -- start 2023-10-01T07:56:09.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.175+0000 7f29f0e29700 1 -- start start 2023-10-01T07:56:09.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.176+0000 7f29f0e29700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29ec09d630 0x7f29ec1325c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:09.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.176+0000 7f29f0e29700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29ec0a0a30 0x7f29ec132b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:09.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.176+0000 7f29f0e29700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29ec133930 0x7f29ec11e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:09.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.176+0000 7f29f0e29700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec1205c0 con 0x7f29ec0a0a30 2023-10-01T07:56:09.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.176+0000 7f29f0e29700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec1203d0 con 0x7f29ec09d630 2023-10-01T07:56:09.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.176+0000 7f29f0e29700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec0a41c0 con 0x7f29ec133930 2023-10-01T07:56:09.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.176+0000 7f29ea59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29ec09d630 0x7f29ec1325c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:09.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.176+0000 7f29ea59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29ec09d630 0x7f29ec1325c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:41144/0 (socket says 172.21.15.26:41144) 2023-10-01T07:56:09.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.176+0000 7f29ea59c700 1 -- 172.21.15.26:0/2803106932 learned_addr learned my addr 172.21.15.26:0/2803106932 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:09.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.176+0000 7f29e9d9b700 1 --2- 172.21.15.26:0/2803106932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29ec0a0a30 0x7f29ec132b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:09.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.176+0000 7f29ead9d700 1 --2- 172.21.15.26:0/2803106932 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29ec133930 0x7f29ec11e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:09.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.176+0000 7f29ea59c700 1 -- 172.21.15.26:0/2803106932 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29ec133930 msgr2=0x7f29ec11e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:09.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.176+0000 7f29ea59c700 1 --2- 172.21.15.26:0/2803106932 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29ec133930 0x7f29ec11e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.176+0000 7f29ea59c700 1 -- 172.21.15.26:0/2803106932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29ec0a0a30 msgr2=0x7f29ec132b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:09.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.176+0000 7f29ea59c700 1 --2- 172.21.15.26:0/2803106932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29ec0a0a30 0x7f29ec132b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.176+0000 7f29ea59c700 1 -- 172.21.15.26:0/2803106932 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d40094a0 con 0x7f29ec09d630 2023-10-01T07:56:09.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.176+0000 7f29ea59c700 1 --2- 172.21.15.26:0/2803106932 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29ec09d630 0x7f29ec1325c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f29e4000c00 tx=0x7f29e4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:09.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.176+0000 7f29e2ffd700 1 -- 172.21.15.26:0/2803106932 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e4004450 con 0x7f29ec09d630 2023-10-01T07:56:09.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.176+0000 7f29e2ffd700 1 -- 172.21.15.26:0/2803106932 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e40045b0 con 0x7f29ec09d630 2023-10-01T07:56:09.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.176+0000 7f29f0e29700 1 -- 172.21.15.26:0/2803106932 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29dc009a70 con 0x7f29ec09d630 2023-10-01T07:56:09.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.176+0000 7f29e2ffd700 1 -- 172.21.15.26:0/2803106932 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e40038c0 con 0x7f29ec09d630 2023-10-01T07:56:09.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.177+0000 7f29f0e29700 1 -- 172.21.15.26:0/2803106932 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e4009550 con 0x7f29ec09d630 2023-10-01T07:56:09.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.177+0000 7f29e2ffd700 1 -- 172.21.15.26:0/2803106932 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f29e4021070 con 0x7f29ec09d630 2023-10-01T07:56:09.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.178+0000 7f29e2ffd700 1 -- 172.21.15.26:0/2803106932 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f29e4040920 con 0x7f29ec09d630 2023-10-01T07:56:09.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.178+0000 7f29f0e29700 1 -- 172.21.15.26:0/2803106932 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29ec0747f0 con 0x7f29ec09d630 2023-10-01T07:56:09.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.183+0000 7f29e2ffd700 1 -- 172.21.15.26:0/2803106932 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f29e4015020 con 0x7f29ec09d630 2023-10-01T07:56:09.188 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:09.224 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:09.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.238+0000 7fd9c10ba700 1 Processor -- start 2023-10-01T07:56:09.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.238+0000 7fd9c10ba700 1 -- start start 2023-10-01T07:56:09.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.239+0000 7fd9c10ba700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9bc131810 0x7fd9bc131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:09.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.239+0000 7fd9c10ba700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd9bc099a40 0x7fd9bc099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:09.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.239+0000 7fd9c10ba700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9bc09a850 con 0x7fd9bc09a3b0 2023-10-01T07:56:09.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.239+0000 7fd9c10ba700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9bc09b580 con 0x7fd9bc099a40 2023-10-01T07:56:09.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.239+0000 7fd9c10ba700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc1313c0 con 0x7fd9bc131810 2023-10-01T07:56:09.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.239+0000 7fd9bad9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9bc131810 0x7fd9bc131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:09.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.239+0000 7fd9bad9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9bc131810 0x7fd9bc131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:50156/0 (socket says 172.21.15.26:50156) 2023-10-01T07:56:09.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.239+0000 7fd9bad9d700 1 -- 172.21.15.26:0/1617062278 learned_addr learned my addr 172.21.15.26:0/1617062278 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:09.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.239+0000 7fd9ba59c700 1 --2- 172.21.15.26:0/1617062278 >> v2:172.21.15.26:3300/0 conn(0x7fd9bc099a40 0x7fd9bc099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:09.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.240+0000 7fd9ba59c700 1 -- 172.21.15.26:0/1617062278 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9bc131810 msgr2=0x7fd9bc131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:09.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.240+0000 7fd9ba59c700 1 --2- 172.21.15.26:0/1617062278 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9bc131810 0x7fd9bc131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.240+0000 7fd9ba59c700 1 -- 172.21.15.26:0/1617062278 >> v1:172.21.15.26:6789/0 conn(0x7fd9bc09a3b0 legacy=0x7fd9bc138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:09.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.240+0000 7fd9ba59c700 1 -- 172.21.15.26:0/1617062278 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9bc06e8c0 con 0x7fd9bc099a40 2023-10-01T07:56:09.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.240+0000 7fd9bad9d700 1 --2- 172.21.15.26:0/1617062278 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9bc131810 0x7fd9bc131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:09.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.240+0000 7fd9ba59c700 1 --2- 172.21.15.26:0/1617062278 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9bc099a40 0x7fd9bc099e70 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0009870 tx=0x7fd9b0009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c856c89551bd980e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:09.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.240+0000 7fd9b9d9b700 1 -- 172.21.15.26:0/1617062278 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0004230 con 0x7fd9bc099a40 2023-10-01T07:56:09.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.240+0000 7fd9b9d9b700 1 -- 172.21.15.26:0/1617062278 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b0004390 con 0x7fd9bc099a40 2023-10-01T07:56:09.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.240+0000 7fd9b9d9b700 1 -- 172.21.15.26:0/1617062278 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b00036a0 con 0x7fd9bc099a40 2023-10-01T07:56:09.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.241+0000 7fd9c10ba700 1 -- 172.21.15.26:0/1617062278 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9bc099a40 msgr2=0x7fd9bc099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:09.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.241+0000 7fd9c10ba700 1 --2- 172.21.15.26:0/1617062278 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9bc099a40 0x7fd9bc099e70 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0009870 tx=0x7fd9b0009b80 comp rx=0 tx=0).stop 2023-10-01T07:56:09.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.241+0000 7fd9c10ba700 1 -- 172.21.15.26:0/1617062278 shutdown_connections 2023-10-01T07:56:09.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.241+0000 7fd9c10ba700 1 --2- 172.21.15.26:0/1617062278 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9bc131810 0x7fd9bc131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.241+0000 7fd9c10ba700 1 --2- 172.21.15.26:0/1617062278 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9bc099a40 0x7fd9bc099e70 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.241+0000 7fd9c10ba700 1 -- 172.21.15.26:0/1617062278 >> 172.21.15.26:0/1617062278 conn(0x7fd9bc0a2aa0 msgr2=0x7fd9bc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:09.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.241+0000 7fd9c10ba700 1 -- 172.21.15.26:0/1617062278 shutdown_connections 2023-10-01T07:56:09.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.242+0000 7fd9c10ba700 1 -- 172.21.15.26:0/1617062278 wait complete. 2023-10-01T07:56:09.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.243+0000 7fd9c10ba700 1 Processor -- start 2023-10-01T07:56:09.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.243+0000 7fd9c10ba700 1 -- start start 2023-10-01T07:56:09.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.244+0000 7fd9c10ba700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9bc099a40 0x7fd9bc11b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:09.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.244+0000 7fd9c10ba700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9bc09a3b0 0x7fd9bc11bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:09.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.244+0000 7fd9c10ba700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9bc131810 0x7fd9bc11c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:09.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.244+0000 7fd9c10ba700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc11f090 con 0x7fd9bc099a40 2023-10-01T07:56:09.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.244+0000 7fd9c10ba700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc12eba0 con 0x7fd9bc131810 2023-10-01T07:56:09.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.244+0000 7fd9c10ba700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc11e610 con 0x7fd9bc09a3b0 2023-10-01T07:56:09.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.244+0000 7fd9ba59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9bc09a3b0 0x7fd9bc11bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:09.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.244+0000 7fd9ba59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9bc09a3b0 0x7fd9bc11bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:50172/0 (socket says 172.21.15.26:50172) 2023-10-01T07:56:09.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.244+0000 7fd9ba59c700 1 -- 172.21.15.26:0/1431084233 learned_addr learned my addr 172.21.15.26:0/1431084233 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:09.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.244+0000 7fd9bad9d700 1 --2- 172.21.15.26:0/1431084233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9bc099a40 0x7fd9bc11b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:09.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.245+0000 7fd9ba59c700 1 -- 172.21.15.26:0/1431084233 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9bc131810 msgr2=0x7fd9bc11c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:09.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.245+0000 7fd9bb59e700 1 --2- 172.21.15.26:0/1431084233 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9bc131810 0x7fd9bc11c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:09.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.245+0000 7fd9ba59c700 1 --2- 172.21.15.26:0/1431084233 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9bc131810 0x7fd9bc11c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.245+0000 7fd9ba59c700 1 -- 172.21.15.26:0/1431084233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9bc099a40 msgr2=0x7fd9bc11b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:09.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.245+0000 7fd9ba59c700 1 --2- 172.21.15.26:0/1431084233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9bc099a40 0x7fd9bc11b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.245+0000 7fd9ba59c700 1 -- 172.21.15.26:0/1431084233 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ac009550 con 0x7fd9bc09a3b0 2023-10-01T07:56:09.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.245+0000 7fd9bb59e700 1 --2- 172.21.15.26:0/1431084233 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9bc131810 0x7fd9bc11c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:56:09.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.245+0000 7fd9ba59c700 1 --2- 172.21.15.26:0/1431084233 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9bc09a3b0 0x7fd9bc11bcf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0004000 tx=0x7fd9b0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:09.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.245+0000 7fd9a37fe700 1 -- 172.21.15.26:0/1431084233 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0011630 con 0x7fd9bc09a3b0 2023-10-01T07:56:09.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.245+0000 7fd9c10ba700 1 -- 172.21.15.26:0/1431084233 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b00094a0 con 0x7fd9bc09a3b0 2023-10-01T07:56:09.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.245+0000 7fd9c10ba700 1 -- 172.21.15.26:0/1431084233 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9bc11eab0 con 0x7fd9bc09a3b0 2023-10-01T07:56:09.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.245+0000 7fd9a37fe700 1 -- 172.21.15.26:0/1431084233 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b001e070 con 0x7fd9bc09a3b0 2023-10-01T07:56:09.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.245+0000 7fd9a37fe700 1 -- 172.21.15.26:0/1431084233 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b00119d0 con 0x7fd9bc09a3b0 2023-10-01T07:56:09.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.246+0000 7fd9a37fe700 1 -- 172.21.15.26:0/1431084233 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd9b0011b30 con 0x7fd9bc09a3b0 2023-10-01T07:56:09.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.247+0000 7fd9a37fe700 1 -- 172.21.15.26:0/1431084233 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd9b0040900 con 0x7fd9bc09a3b0 2023-10-01T07:56:09.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.247+0000 7fd9c10ba700 1 -- 172.21.15.26:0/1431084233 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd99c0052e0 con 0x7fd9bc09a3b0 2023-10-01T07:56:09.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.257+0000 7fd9a37fe700 1 -- 172.21.15.26:0/1431084233 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd9b001a430 con 0x7fd9bc09a3b0 2023-10-01T07:56:09.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.331+0000 7fc6b9c68700 1 Processor -- start 2023-10-01T07:56:09.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.332+0000 7fc6b9c68700 1 -- start start 2023-10-01T07:56:09.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.332+0000 7fc6b9c68700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc6b409d6f0 0x7fc6b409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:09.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.332+0000 7fc6b9c68700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc6b409e000 0x7fc6b41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:09.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.332+0000 7fc6b9c68700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6b409b120 con 0x7fc6b409e410 2023-10-01T07:56:09.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.332+0000 7fc6b9c68700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b406b460 con 0x7fc6b409e000 2023-10-01T07:56:09.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.332+0000 7fc6b9c68700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b409a7e0 con 0x7fc6b409d6f0 2023-10-01T07:56:09.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.333+0000 7fc6b2ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc6b409e000 0x7fc6b41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:09.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.333+0000 7fc6b3fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc6b409e410 0x7fc6b4133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57526/0 (socket says 172.21.15.26:57526) 2023-10-01T07:56:09.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.333+0000 7fc6b3fff700 1 -- 172.21.15.26:0/2440612857 learned_addr learned my addr 172.21.15.26:0/2440612857 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:09.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.333+0000 7fc6b37fe700 1 --2- 172.21.15.26:0/2440612857 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc6b409d6f0 0x7fc6b409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:09.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.333+0000 7fc6b2ffd700 1 -- 172.21.15.26:0/2440612857 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc6b409d6f0 msgr2=0x7fc6b409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:09.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.333+0000 7fc6b2ffd700 1 --2- 172.21.15.26:0/2440612857 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc6b409d6f0 0x7fc6b409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.333+0000 7fc6b2ffd700 1 -- 172.21.15.26:0/2440612857 >> v1:172.21.15.26:6789/0 conn(0x7fc6b409e410 legacy=0x7fc6b4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:09.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.333+0000 7fc6b2ffd700 1 -- 172.21.15.26:0/2440612857 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b409a500 con 0x7fc6b409e000 2023-10-01T07:56:09.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.333+0000 7fc6b27fc700 1 -- 172.21.15.26:0/2440612857 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 433297314 0 0) 0x7fc6b409b120 con 0x7fc6b409e410 2023-10-01T07:56:09.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.333+0000 7fc6b2ffd700 1 --2- 172.21.15.26:0/2440612857 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc6b409e000 0x7fc6b41339f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8009870 tx=0x7fc6a8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24f5ad54e6b70122 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:09.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.333+0000 7fc6b27fc700 1 -- 172.21.15.26:0/2440612857 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a8011830 con 0x7fc6b409e000 2023-10-01T07:56:09.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.334+0000 7fc6b27fc700 1 -- 172.21.15.26:0/2440612857 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a8011990 con 0x7fc6b409e000 2023-10-01T07:56:09.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.334+0000 7fc6b27fc700 1 -- 172.21.15.26:0/2440612857 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a8011d20 con 0x7fc6b409e000 2023-10-01T07:56:09.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.334+0000 7fc6b9c68700 1 -- 172.21.15.26:0/2440612857 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc6b409e000 msgr2=0x7fc6b41339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:09.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.334+0000 7fc6b9c68700 1 --2- 172.21.15.26:0/2440612857 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc6b409e000 0x7fc6b41339f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8009870 tx=0x7fc6a8009b80 comp rx=0 tx=0).stop 2023-10-01T07:56:09.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.334+0000 7fc6b9c68700 1 -- 172.21.15.26:0/2440612857 shutdown_connections 2023-10-01T07:56:09.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.334+0000 7fc6b9c68700 1 --2- 172.21.15.26:0/2440612857 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc6b409d6f0 0x7fc6b409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.334+0000 7fc6b9c68700 1 --2- 172.21.15.26:0/2440612857 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc6b409e000 0x7fc6b41339f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.334+0000 7fc6b9c68700 1 -- 172.21.15.26:0/2440612857 >> 172.21.15.26:0/2440612857 conn(0x7fc6b4066f50 msgr2=0x7fc6b409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:09.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.334+0000 7fc6b9c68700 1 -- 172.21.15.26:0/2440612857 shutdown_connections 2023-10-01T07:56:09.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.334+0000 7fc6b9c68700 1 -- 172.21.15.26:0/2440612857 wait complete. 2023-10-01T07:56:09.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.335+0000 7fc6b9c68700 1 Processor -- start 2023-10-01T07:56:09.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.336+0000 7fc6b9c68700 1 -- start start 2023-10-01T07:56:09.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.336+0000 7fc6b9c68700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc6b409d6f0 0x7fc6b4122330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:09.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.336+0000 7fc6b9c68700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc6b409e000 0x7fc6b4122870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:09.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.336+0000 7fc6b9c68700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6b409e410 0x7fc6b4122db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:09.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.336+0000 7fc6b9c68700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b4123800 con 0x7fc6b409e410 2023-10-01T07:56:09.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.336+0000 7fc6b9c68700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b4133700 con 0x7fc6b409e000 2023-10-01T07:56:09.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.336+0000 7fc6b9c68700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b4124dd0 con 0x7fc6b409d6f0 2023-10-01T07:56:09.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.336+0000 7fc6b37fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc6b409d6f0 0x7fc6b4122330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:09.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.336+0000 7fc6b37fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc6b409d6f0 0x7fc6b4122330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:50190/0 (socket says 172.21.15.26:50190) 2023-10-01T07:56:09.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.336+0000 7fc6b37fe700 1 -- 172.21.15.26:0/3623107608 learned_addr learned my addr 172.21.15.26:0/3623107608 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:09.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.337+0000 7fc6b2ffd700 1 --2- 172.21.15.26:0/3623107608 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc6b409e000 0x7fc6b4122870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:09.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.337+0000 7fc6b2ffd700 1 -- 172.21.15.26:0/3623107608 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc6b409d6f0 msgr2=0x7fc6b4122330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:09.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.337+0000 7fc6b2ffd700 1 --2- 172.21.15.26:0/3623107608 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc6b409d6f0 0x7fc6b4122330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.337+0000 7fc6b2ffd700 1 -- 172.21.15.26:0/3623107608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6b409e410 msgr2=0x7fc6b4122db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:09.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.337+0000 7fc6b2ffd700 1 --2- 172.21.15.26:0/3623107608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6b409e410 0x7fc6b4122db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.337+0000 7fc6b2ffd700 1 -- 172.21.15.26:0/3623107608 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a80094a0 con 0x7fc6b409e000 2023-10-01T07:56:09.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.337+0000 7fc6b2ffd700 1 --2- 172.21.15.26:0/3623107608 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc6b409e000 0x7fc6b4122870 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8016000 tx=0x7fc6a8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:09.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.337+0000 7fc69bfff700 1 -- 172.21.15.26:0/3623107608 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a801a8f0 con 0x7fc6b409e000 2023-10-01T07:56:09.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.337+0000 7fc69bfff700 1 -- 172.21.15.26:0/3623107608 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a801aa50 con 0x7fc6b409e000 2023-10-01T07:56:09.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.337+0000 7fc6b9c68700 1 -- 172.21.15.26:0/3623107608 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b41258b0 con 0x7fc6b409e000 2023-10-01T07:56:09.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.337+0000 7fc69bfff700 1 -- 172.21.15.26:0/3623107608 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a801ae00 con 0x7fc6b409e000 2023-10-01T07:56:09.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.338+0000 7fc6b9c68700 1 -- 172.21.15.26:0/3623107608 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b40a1f00 con 0x7fc6b409e000 2023-10-01T07:56:09.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.339+0000 7fc69bfff700 1 -- 172.21.15.26:0/3623107608 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc6a80243f0 con 0x7fc6b409e000 2023-10-01T07:56:09.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.339+0000 7fc6b9c68700 1 -- 172.21.15.26:0/3623107608 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6b411f030 con 0x7fc6b409e000 2023-10-01T07:56:09.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.339+0000 7fc69bfff700 1 -- 172.21.15.26:0/3623107608 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc6a8040a10 con 0x7fc6b409e000 2023-10-01T07:56:09.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.348+0000 7fc69bfff700 1 -- 172.21.15.26:0/3623107608 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc6a800b360 con 0x7fc6b409e000 2023-10-01T07:56:09.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.385+0000 7fef8196a700 1 Processor -- start 2023-10-01T07:56:09.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.385+0000 7fef8196a700 1 -- start start 2023-10-01T07:56:09.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.386+0000 7fef8196a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fef7c133420 0x7fef7c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:09.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.386+0000 7fef8196a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fef7c133e30 0x7fef7c12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:09.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.386+0000 7fef8196a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fef7c134260 0x7fef7c1304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:09.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.386+0000 7fef8196a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef7c06b990 con 0x7fef7c134260 2023-10-01T07:56:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.386+0000 7fef8196a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c0a0590 con 0x7fef7c133420 2023-10-01T07:56:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.386+0000 7fef8196a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c09fb80 con 0x7fef7c133e30 2023-10-01T07:56:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.387+0000 7fef7affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fef7c133420 0x7fef7c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.387+0000 7fef7affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fef7c133420 0x7fef7c1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:41170/0 (socket says 172.21.15.26:41170) 2023-10-01T07:56:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.387+0000 7fef7affd700 1 -- 172.21.15.26:0/3583564393 learned_addr learned my addr 172.21.15.26:0/3583564393 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.387+0000 7fef7a7fc700 1 --2- 172.21.15.26:0/3583564393 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fef7c133e30 0x7fef7c12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.387+0000 7fef7b7fe700 1 --2- 172.21.15.26:0/3583564393 >> v2:172.21.15.26:3300/0 conn(0x7fef7c134260 0x7fef7c1304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:09.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.387+0000 7fef7a7fc700 1 -- 172.21.15.26:0/3583564393 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fef7c133420 msgr2=0x7fef7c1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:09.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.387+0000 7fef7a7fc700 1 --2- 172.21.15.26:0/3583564393 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fef7c133420 0x7fef7c1337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.387+0000 7fef7a7fc700 1 -- 172.21.15.26:0/3583564393 >> v2:172.21.15.26:3300/0 conn(0x7fef7c134260 msgr2=0x7fef7c1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:09.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.387+0000 7fef7a7fc700 1 --2- 172.21.15.26:0/3583564393 >> v2:172.21.15.26:3300/0 conn(0x7fef7c134260 0x7fef7c1304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.387+0000 7fef7a7fc700 1 -- 172.21.15.26:0/3583564393 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef7c0a0030 con 0x7fef7c133e30 2023-10-01T07:56:09.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.387+0000 7fef7b7fe700 1 --2- 172.21.15.26:0/3583564393 >> v2:172.21.15.26:3300/0 conn(0x7fef7c134260 0x7fef7c1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:09.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.387+0000 7fef7a7fc700 1 --2- 172.21.15.26:0/3583564393 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fef7c133e30 0x7fef7c12ff90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fef70009840 tx=0x7fef70009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2959d9d2eeab159 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:09.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.387+0000 7fef79ffb700 1 -- 172.21.15.26:0/3583564393 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef70011830 con 0x7fef7c133e30 2023-10-01T07:56:09.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.388+0000 7fef79ffb700 1 -- 172.21.15.26:0/3583564393 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef70011990 con 0x7fef7c133e30 2023-10-01T07:56:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.388+0000 7fef79ffb700 1 -- 172.21.15.26:0/3583564393 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef70011d20 con 0x7fef7c133e30 2023-10-01T07:56:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.388+0000 7fef8196a700 1 -- 172.21.15.26:0/3583564393 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fef7c133e30 msgr2=0x7fef7c12ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.388+0000 7fef8196a700 1 --2- 172.21.15.26:0/3583564393 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fef7c133e30 0x7fef7c12ff90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fef70009840 tx=0x7fef70009b50 comp rx=0 tx=0).stop 2023-10-01T07:56:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.389+0000 7fef8196a700 1 -- 172.21.15.26:0/3583564393 shutdown_connections 2023-10-01T07:56:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.389+0000 7fef8196a700 1 --2- 172.21.15.26:0/3583564393 >> v2:172.21.15.26:3300/0 conn(0x7fef7c134260 0x7fef7c1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.389+0000 7fef8196a700 1 --2- 172.21.15.26:0/3583564393 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fef7c133420 0x7fef7c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.389+0000 7fef8196a700 1 --2- 172.21.15.26:0/3583564393 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fef7c133e30 0x7fef7c12ff90 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.389+0000 7fef8196a700 1 -- 172.21.15.26:0/3583564393 >> 172.21.15.26:0/3583564393 conn(0x7fef7c0a4210 msgr2=0x7fef7c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.389+0000 7fef8196a700 1 -- 172.21.15.26:0/3583564393 shutdown_connections 2023-10-01T07:56:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.389+0000 7fef8196a700 1 -- 172.21.15.26:0/3583564393 wait complete. 2023-10-01T07:56:09.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.390+0000 7fef8196a700 1 Processor -- start 2023-10-01T07:56:09.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.390+0000 7fef8196a700 1 -- start start 2023-10-01T07:56:09.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.391+0000 7fef8196a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fef7c133420 0x7fef7c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:09.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.391+0000 7fef8196a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef7c133e30 0x7fef7c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:09.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.391+0000 7fef8196a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fef7c134260 0x7fef7c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:09.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.391+0000 7fef8196a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c12d5e0 con 0x7fef7c133e30 2023-10-01T07:56:09.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.391+0000 7fef8196a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c131490 con 0x7fef7c133420 2023-10-01T07:56:09.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.391+0000 7fef8196a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c11fcc0 con 0x7fef7c134260 2023-10-01T07:56:09.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.391+0000 7fef7affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fef7c133420 0x7fef7c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:09.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.391+0000 7fef7affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fef7c133420 0x7fef7c09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:41174/0 (socket says 172.21.15.26:41174) 2023-10-01T07:56:09.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.391+0000 7fef7affd700 1 -- 172.21.15.26:0/431513582 learned_addr learned my addr 172.21.15.26:0/431513582 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:09.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.391+0000 7fef7a7fc700 1 --2- 172.21.15.26:0/431513582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef7c133e30 0x7fef7c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:09.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.391+0000 7fef7b7fe700 1 --2- 172.21.15.26:0/431513582 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fef7c134260 0x7fef7c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:09.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.392+0000 7fef7affd700 1 -- 172.21.15.26:0/431513582 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fef7c134260 msgr2=0x7fef7c09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:09.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.392+0000 7fef7affd700 1 --2- 172.21.15.26:0/431513582 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fef7c134260 0x7fef7c09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.392+0000 7fef7affd700 1 -- 172.21.15.26:0/431513582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef7c133e30 msgr2=0x7fef7c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:09.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.392+0000 7fef7affd700 1 --2- 172.21.15.26:0/431513582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef7c133e30 0x7fef7c09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.392+0000 7fef7affd700 1 -- 172.21.15.26:0/431513582 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef74009a70 con 0x7fef7c133420 2023-10-01T07:56:09.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.392+0000 7fef7affd700 1 --2- 172.21.15.26:0/431513582 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fef7c133420 0x7fef7c09c480 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fef6c00e910 tx=0x7fef6c00ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:09.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.392+0000 7fef63fff700 1 -- 172.21.15.26:0/431513582 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c0096a0 con 0x7fef7c133420 2023-10-01T07:56:09.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.392+0000 7fef63fff700 1 -- 172.21.15.26:0/431513582 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6c00c640 con 0x7fef7c133420 2023-10-01T07:56:09.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.392+0000 7fef8196a700 1 -- 172.21.15.26:0/431513582 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef700094a0 con 0x7fef7c133420 2023-10-01T07:56:09.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.392+0000 7fef63fff700 1 -- 172.21.15.26:0/431513582 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c00c9f0 con 0x7fef7c133420 2023-10-01T07:56:09.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.392+0000 7fef8196a700 1 -- 172.21.15.26:0/431513582 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef7c11f9b0 con 0x7fef7c133420 2023-10-01T07:56:09.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.393+0000 7fef63fff700 1 -- 172.21.15.26:0/431513582 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fef6c00cb50 con 0x7fef7c133420 2023-10-01T07:56:09.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.393+0000 7fef63fff700 1 -- 172.21.15.26:0/431513582 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fef6c03f9f0 con 0x7fef7c133420 2023-10-01T07:56:09.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.394+0000 7fef8196a700 1 -- 172.21.15.26:0/431513582 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef7c074ea0 con 0x7fef7c133420 2023-10-01T07:56:09.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.398+0000 7fef63fff700 1 -- 172.21.15.26:0/431513582 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef6c013470 con 0x7fef7c133420 2023-10-01T07:56:09.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.412+0000 7f29f0e29700 1 -- 172.21.15.26:0/2803106932 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f29ec133270 con 0x7f29ec09d630 2023-10-01T07:56:09.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.413+0000 7f29e2ffd700 1 -- 172.21.15.26:0/2803106932 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f29e400b9d0 con 0x7f29ec09d630 2023-10-01T07:56:09.413 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:09.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.415+0000 7f29f0e29700 1 -- 172.21.15.26:0/2803106932 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29ec09d630 msgr2=0x7f29ec1325c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:09.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.415+0000 7f29f0e29700 1 --2- 172.21.15.26:0/2803106932 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29ec09d630 0x7f29ec1325c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f29e4000c00 tx=0x7f29e4004750 comp rx=0 tx=0).stop 2023-10-01T07:56:09.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.415+0000 7f29f0e29700 1 -- 172.21.15.26:0/2803106932 shutdown_connections 2023-10-01T07:56:09.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.415+0000 7f29f0e29700 1 --2- 172.21.15.26:0/2803106932 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29ec133930 0x7f29ec11e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.415+0000 7f29f0e29700 1 --2- 172.21.15.26:0/2803106932 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29ec09d630 0x7f29ec1325c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.415+0000 7f29f0e29700 1 --2- 172.21.15.26:0/2803106932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29ec0a0a30 0x7f29ec132b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.415+0000 7f29f0e29700 1 -- 172.21.15.26:0/2803106932 >> 172.21.15.26:0/2803106932 conn(0x7f29ec0a3050 msgr2=0x7f29ec1bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:09.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.416+0000 7f29f0e29700 1 -- 172.21.15.26:0/2803106932 shutdown_connections 2023-10-01T07:56:09.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.416+0000 7f29f0e29700 1 -- 172.21.15.26:0/2803106932 wait complete. 2023-10-01T07:56:09.430 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:09.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.510+0000 7fd9c10ba700 1 -- 172.21.15.26:0/1431084233 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd99c005590 con 0x7fd9bc09a3b0 2023-10-01T07:56:09.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.511+0000 7fd9a37fe700 1 -- 172.21.15.26:0/1431084233 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd9b0039090 con 0x7fd9bc09a3b0 2023-10-01T07:56:09.512 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:09.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.513+0000 7fd9c10ba700 1 -- 172.21.15.26:0/1431084233 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9bc09a3b0 msgr2=0x7fd9bc11bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:09.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.513+0000 7fd9c10ba700 1 --2- 172.21.15.26:0/1431084233 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9bc09a3b0 0x7fd9bc11bcf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0004000 tx=0x7fd9b0004750 comp rx=0 tx=0).stop 2023-10-01T07:56:09.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.513+0000 7fd9c10ba700 1 -- 172.21.15.26:0/1431084233 shutdown_connections 2023-10-01T07:56:09.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.513+0000 7fd9c10ba700 1 --2- 172.21.15.26:0/1431084233 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9bc131810 0x7fd9bc11c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.513+0000 7fd9c10ba700 1 --2- 172.21.15.26:0/1431084233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9bc099a40 0x7fd9bc11b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.513+0000 7fd9c10ba700 1 --2- 172.21.15.26:0/1431084233 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9bc09a3b0 0x7fd9bc11bcf0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.513+0000 7fd9c10ba700 1 -- 172.21.15.26:0/1431084233 >> 172.21.15.26:0/1431084233 conn(0x7fd9bc0a2aa0 msgr2=0x7fd9bc09d770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:09.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.513+0000 7fd9c10ba700 1 -- 172.21.15.26:0/1431084233 shutdown_connections 2023-10-01T07:56:09.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.513+0000 7fd9c10ba700 1 -- 172.21.15.26:0/1431084233 wait complete. 2023-10-01T07:56:09.527 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:09.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.557+0000 7fc6b9c68700 1 -- 172.21.15.26:0/3623107608 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc6b409c710 con 0x7fc6b409e000 2023-10-01T07:56:09.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.557+0000 7fc69bfff700 1 -- 172.21.15.26:0/3623107608 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc6a8015030 con 0x7fc6b409e000 2023-10-01T07:56:09.557 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:09.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.559+0000 7fc6b9c68700 1 -- 172.21.15.26:0/3623107608 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc6b409e000 msgr2=0x7fc6b4122870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:09.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.559+0000 7fc6b9c68700 1 --2- 172.21.15.26:0/3623107608 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc6b409e000 0x7fc6b4122870 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8016000 tx=0x7fc6a8004750 comp rx=0 tx=0).stop 2023-10-01T07:56:09.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.559+0000 7fc6b9c68700 1 -- 172.21.15.26:0/3623107608 shutdown_connections 2023-10-01T07:56:09.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.559+0000 7fc6b9c68700 1 --2- 172.21.15.26:0/3623107608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6b409e410 0x7fc6b4122db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.559+0000 7fc6b9c68700 1 --2- 172.21.15.26:0/3623107608 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc6b409d6f0 0x7fc6b4122330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.559+0000 7fc6b9c68700 1 --2- 172.21.15.26:0/3623107608 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc6b409e000 0x7fc6b4122870 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.559+0000 7fc6b9c68700 1 -- 172.21.15.26:0/3623107608 >> 172.21.15.26:0/3623107608 conn(0x7fc6b4066f50 msgr2=0x7fc6b4133f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:09.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.559+0000 7fc6b9c68700 1 -- 172.21.15.26:0/3623107608 shutdown_connections 2023-10-01T07:56:09.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.559+0000 7fc6b9c68700 1 -- 172.21.15.26:0/3623107608 wait complete. 2023-10-01T07:56:09.573 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:09.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.629+0000 7fef8196a700 1 -- 172.21.15.26:0/431513582 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fef7c11fe80 con 0x7fef7c133420 2023-10-01T07:56:09.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.630+0000 7fef63fff700 1 -- 172.21.15.26:0/431513582 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fef6c011350 con 0x7fef7c133420 2023-10-01T07:56:09.630 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:09.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.632+0000 7fef8196a700 1 -- 172.21.15.26:0/431513582 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fef7c133420 msgr2=0x7fef7c09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:09.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.632+0000 7fef8196a700 1 --2- 172.21.15.26:0/431513582 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fef7c133420 0x7fef7c09c480 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fef6c00e910 tx=0x7fef6c00ec20 comp rx=0 tx=0).stop 2023-10-01T07:56:09.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.632+0000 7fef8196a700 1 -- 172.21.15.26:0/431513582 shutdown_connections 2023-10-01T07:56:09.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.632+0000 7fef8196a700 1 --2- 172.21.15.26:0/431513582 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fef7c134260 0x7fef7c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.632+0000 7fef8196a700 1 --2- 172.21.15.26:0/431513582 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fef7c133420 0x7fef7c09c480 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.632+0000 7fef8196a700 1 --2- 172.21.15.26:0/431513582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef7c133e30 0x7fef7c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:09.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.632+0000 7fef8196a700 1 -- 172.21.15.26:0/431513582 >> 172.21.15.26:0/431513582 conn(0x7fef7c0a4210 msgr2=0x7fef7c0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:09.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.632+0000 7fef8196a700 1 -- 172.21.15.26:0/431513582 shutdown_connections 2023-10-01T07:56:09.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:09.632+0000 7fef8196a700 1 -- 172.21.15.26:0/431513582 wait complete. 2023-10-01T07:56:09.646 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:10.431 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:10.528 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:10.574 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:10.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.579+0000 7fddcf014700 1 Processor -- start 2023-10-01T07:56:10.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.579+0000 7fddcf014700 1 -- start start 2023-10-01T07:56:10.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.579+0000 7fddcf014700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc809d6f0 0x7fddc809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:10.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.579+0000 7fddcf014700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fddc809e410 0x7fddc8134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:10.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.579+0000 7fddcf014700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddc809b120 con 0x7fddc809e000 2023-10-01T07:56:10.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.579+0000 7fddcf014700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc806b460 con 0x7fddc809d6f0 2023-10-01T07:56:10.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.579+0000 7fddcf014700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddc809a7e0 con 0x7fddc809e410 2023-10-01T07:56:10.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.580+0000 7fddccdb0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc809d6f0 0x7fddc809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:10.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.580+0000 7fddccdb0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc809d6f0 0x7fddc809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:41188/0 (socket says 172.21.15.26:41188) 2023-10-01T07:56:10.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.580+0000 7fddccdb0700 1 -- 172.21.15.26:0/3444180771 learned_addr learned my addr 172.21.15.26:0/3444180771 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:10.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.580+0000 7fddcd5b1700 1 --2- 172.21.15.26:0/3444180771 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fddc809e410 0x7fddc8134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:10.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.580+0000 7fddccdb0700 1 -- 172.21.15.26:0/3444180771 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fddc809e410 msgr2=0x7fddc8134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:10.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.580+0000 7fddccdb0700 1 --2- 172.21.15.26:0/3444180771 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fddc809e410 0x7fddc8134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:10.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.580+0000 7fddccdb0700 1 -- 172.21.15.26:0/3444180771 >> v1:172.21.15.26:6789/0 conn(0x7fddc809e000 legacy=0x7fddc81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:10.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.580+0000 7fddccdb0700 1 -- 172.21.15.26:0/3444180771 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc809a500 con 0x7fddc809d6f0 2023-10-01T07:56:10.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.580+0000 7fddccdb0700 1 --2- 172.21.15.26:0/3444180771 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc809d6f0 0x7fddc809dac0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fddb8009920 tx=0x7fddb8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8df5cb154ffb11e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:10.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.580+0000 7fddc77fe700 1 -- 172.21.15.26:0/3444180771 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb8011830 con 0x7fddc809d6f0 2023-10-01T07:56:10.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.580+0000 7fddc77fe700 1 -- 172.21.15.26:0/3444180771 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb8011990 con 0x7fddc809d6f0 2023-10-01T07:56:10.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.580+0000 7fddc77fe700 1 -- 172.21.15.26:0/3444180771 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb8011d20 con 0x7fddc809d6f0 2023-10-01T07:56:10.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.581+0000 7fddcf014700 1 -- 172.21.15.26:0/3444180771 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc809d6f0 msgr2=0x7fddc809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:10.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.581+0000 7fddcf014700 1 --2- 172.21.15.26:0/3444180771 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc809d6f0 0x7fddc809dac0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fddb8009920 tx=0x7fddb8009c30 comp rx=0 tx=0).stop 2023-10-01T07:56:10.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.581+0000 7fddcf014700 1 -- 172.21.15.26:0/3444180771 shutdown_connections 2023-10-01T07:56:10.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.581+0000 7fddcf014700 1 --2- 172.21.15.26:0/3444180771 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fddc809e410 0x7fddc8134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:10.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.581+0000 7fddcf014700 1 --2- 172.21.15.26:0/3444180771 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc809d6f0 0x7fddc809dac0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:10.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.581+0000 7fddcf014700 1 -- 172.21.15.26:0/3444180771 >> 172.21.15.26:0/3444180771 conn(0x7fddc8066f50 msgr2=0x7fddc809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:10.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.582+0000 7fddcf014700 1 -- 172.21.15.26:0/3444180771 shutdown_connections 2023-10-01T07:56:10.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.582+0000 7fddcf014700 1 -- 172.21.15.26:0/3444180771 wait complete. 2023-10-01T07:56:10.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.583+0000 7fddcf014700 1 Processor -- start 2023-10-01T07:56:10.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.583+0000 7fddcf014700 1 -- start start 2023-10-01T07:56:10.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.583+0000 7fddcf014700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddc809d6f0 0x7fddc81226e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:10.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.583+0000 7fddcf014700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fddc809e000 0x7fddc8122c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:10.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.583+0000 7fddcf014700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc809e410 0x7fddc8123160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:10.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.583+0000 7fddcf014700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc81335d0 con 0x7fddc809d6f0 2023-10-01T07:56:10.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.583+0000 7fddcf014700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc809c710 con 0x7fddc809e410 2023-10-01T07:56:10.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.583+0000 7fddcf014700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddc81242c0 con 0x7fddc809e000 2023-10-01T07:56:10.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.583+0000 7fddccdb0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddc809d6f0 0x7fddc81226e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:10.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.583+0000 7fddccdb0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddc809d6f0 0x7fddc81226e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44936/0 (socket says 172.21.15.26:44936) 2023-10-01T07:56:10.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.583+0000 7fddccdb0700 1 -- 172.21.15.26:0/2318654849 learned_addr learned my addr 172.21.15.26:0/2318654849 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:10.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.584+0000 7fddcd5b1700 1 --2- 172.21.15.26:0/2318654849 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc809e410 0x7fddc8123160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:10.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.584+0000 7fddc7fff700 1 --2- 172.21.15.26:0/2318654849 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fddc809e000 0x7fddc8122c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:10.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.584+0000 7fddccdb0700 1 -- 172.21.15.26:0/2318654849 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fddc809e000 msgr2=0x7fddc8122c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:10.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.584+0000 7fddccdb0700 1 --2- 172.21.15.26:0/2318654849 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fddc809e000 0x7fddc8122c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:10.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.584+0000 7fddccdb0700 1 -- 172.21.15.26:0/2318654849 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc809e410 msgr2=0x7fddc8123160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:10.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.584+0000 7fddccdb0700 1 --2- 172.21.15.26:0/2318654849 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc809e410 0x7fddc8123160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:10.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.584+0000 7fddccdb0700 1 -- 172.21.15.26:0/2318654849 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb8009550 con 0x7fddc809d6f0 2023-10-01T07:56:10.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.584+0000 7fddccdb0700 1 --2- 172.21.15.26:0/2318654849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddc809d6f0 0x7fddc81226e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fddb8000c00 tx=0x7fddb8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:10.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.584+0000 7fddc57fa700 1 -- 172.21.15.26:0/2318654849 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb8004450 con 0x7fddc809d6f0 2023-10-01T07:56:10.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.584+0000 7fddcf014700 1 -- 172.21.15.26:0/2318654849 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc8125e50 con 0x7fddc809d6f0 2023-10-01T07:56:10.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.584+0000 7fddcf014700 1 -- 172.21.15.26:0/2318654849 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddc8126130 con 0x7fddc809d6f0 2023-10-01T07:56:10.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.585+0000 7fddc57fa700 1 -- 172.21.15.26:0/2318654849 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb80045b0 con 0x7fddc809d6f0 2023-10-01T07:56:10.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.585+0000 7fddc57fa700 1 -- 172.21.15.26:0/2318654849 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb80038a0 con 0x7fddc809d6f0 2023-10-01T07:56:10.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.585+0000 7fddc57fa700 1 -- 172.21.15.26:0/2318654849 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fddb8003a00 con 0x7fddc809d6f0 2023-10-01T07:56:10.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.586+0000 7fddc57fa700 1 -- 172.21.15.26:0/2318654849 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fddb8021030 con 0x7fddc809d6f0 2023-10-01T07:56:10.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.586+0000 7fddcf014700 1 -- 172.21.15.26:0/2318654849 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda80052e0 con 0x7fddc809d6f0 2023-10-01T07:56:10.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.591+0000 7fddc57fa700 1 -- 172.21.15.26:0/2318654849 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fddb802b070 con 0x7fddc809d6f0 2023-10-01T07:56:10.647 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:10.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.676+0000 7f841e3ea700 1 Processor -- start 2023-10-01T07:56:10.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.676+0000 7f841e3ea700 1 -- start start 2023-10-01T07:56:10.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.677+0000 7f841e3ea700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8418136710 0x7f8418138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:10.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.677+0000 7f841e3ea700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8418139030 0x7f841813b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:10.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.677+0000 7f841e3ea700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f841806ef30 con 0x7f84181338a0 2023-10-01T07:56:10.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.677+0000 7f841e3ea700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f841806fef0 con 0x7f8418136710 2023-10-01T07:56:10.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.677+0000 7f841e3ea700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84181334b0 con 0x7f8418139030 2023-10-01T07:56:10.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.677+0000 7f841c987700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8418139030 0x7f841813b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:10.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.677+0000 7f84177fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8418136710 0x7f8418138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:10.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.677+0000 7f841c987700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8418139030 0x7f841813b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:41198/0 (socket says 172.21.15.26:41198) 2023-10-01T07:56:10.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.677+0000 7f841c987700 1 -- 172.21.15.26:0/2347631767 learned_addr learned my addr 172.21.15.26:0/2347631767 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:10.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.677+0000 7f841c987700 1 -- 172.21.15.26:0/2347631767 >> v2:172.21.15.26:3300/0 conn(0x7f8418136710 msgr2=0x7f8418138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:10.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.677+0000 7f841c987700 1 --2- 172.21.15.26:0/2347631767 >> v2:172.21.15.26:3300/0 conn(0x7f8418136710 0x7f8418138af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:10.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.677+0000 7f841c987700 1 -- 172.21.15.26:0/2347631767 >> v1:172.21.15.26:6789/0 conn(0x7f84181338a0 legacy=0x7f8418133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:10.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.677+0000 7f841c987700 1 -- 172.21.15.26:0/2347631767 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f841806fc30 con 0x7f8418139030 2023-10-01T07:56:10.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.677+0000 7f84177fe700 1 --2- 172.21.15.26:0/2347631767 >> v2:172.21.15.26:3300/0 conn(0x7f8418136710 0x7f8418138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:10.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.678+0000 7f841c987700 1 --2- 172.21.15.26:0/2347631767 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8418139030 0x7f841813b410 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8410009e50 tx=0x7f841000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ba53f9b8d525a0d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:10.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.678+0000 7f8416ffd700 1 -- 172.21.15.26:0/2347631767 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841000e070 con 0x7f8418139030 2023-10-01T07:56:10.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.678+0000 7f8416ffd700 1 -- 172.21.15.26:0/2347631767 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841000b910 con 0x7f8418139030 2023-10-01T07:56:10.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.678+0000 7f8416ffd700 1 -- 172.21.15.26:0/2347631767 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841000bcc0 con 0x7f8418139030 2023-10-01T07:56:10.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.679+0000 7f841e3ea700 1 -- 172.21.15.26:0/2347631767 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8418139030 msgr2=0x7f841813b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:10.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.679+0000 7f841e3ea700 1 --2- 172.21.15.26:0/2347631767 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8418139030 0x7f841813b410 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8410009e50 tx=0x7f841000b330 comp rx=0 tx=0).stop 2023-10-01T07:56:10.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.679+0000 7f841e3ea700 1 -- 172.21.15.26:0/2347631767 shutdown_connections 2023-10-01T07:56:10.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.679+0000 7f841e3ea700 1 --2- 172.21.15.26:0/2347631767 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8418139030 0x7f841813b410 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:10.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.679+0000 7f841e3ea700 1 --2- 172.21.15.26:0/2347631767 >> v2:172.21.15.26:3300/0 conn(0x7f8418136710 0x7f8418138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:10.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.679+0000 7f841e3ea700 1 -- 172.21.15.26:0/2347631767 >> 172.21.15.26:0/2347631767 conn(0x7f84180a2aa0 msgr2=0x7f84180a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:10.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.679+0000 7f841e3ea700 1 -- 172.21.15.26:0/2347631767 shutdown_connections 2023-10-01T07:56:10.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.679+0000 7f841e3ea700 1 -- 172.21.15.26:0/2347631767 wait complete. 2023-10-01T07:56:10.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.680+0000 7f841e3ea700 1 Processor -- start 2023-10-01T07:56:10.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.681+0000 7f841e3ea700 1 -- start start 2023-10-01T07:56:10.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.682+0000 7f841e3ea700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84181338a0 0x7f841811ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:10.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.682+0000 7f841e3ea700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8418136710 0x7f841811b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:10.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.682+0000 7f841e3ea700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8418139030 0x7f841811b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:10.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.682+0000 7f841e3ea700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841811ca60 con 0x7f84181338a0 2023-10-01T07:56:10.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.682+0000 7f841e3ea700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f841811e580 con 0x7f8418136710 2023-10-01T07:56:10.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.682+0000 7f841e3ea700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84180a2430 con 0x7f8418139030 2023-10-01T07:56:10.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.682+0000 7f8417fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84181338a0 0x7f841811ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:10.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.682+0000 7f8417fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84181338a0 0x7f841811ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44960/0 (socket says 172.21.15.26:44960) 2023-10-01T07:56:10.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.682+0000 7f8417fff700 1 -- 172.21.15.26:0/225914690 learned_addr learned my addr 172.21.15.26:0/225914690 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:10.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.682+0000 7f84177fe700 1 --2- 172.21.15.26:0/225914690 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8418136710 0x7f841811b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:10.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.682+0000 7f841c987700 1 --2- 172.21.15.26:0/225914690 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8418139030 0x7f841811b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:10.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.682+0000 7f8417fff700 1 -- 172.21.15.26:0/225914690 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8418139030 msgr2=0x7f841811b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:10.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.682+0000 7f8417fff700 1 --2- 172.21.15.26:0/225914690 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8418139030 0x7f841811b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:10.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.682+0000 7f8417fff700 1 -- 172.21.15.26:0/225914690 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8418136710 msgr2=0x7f841811b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:10.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.682+0000 7f8417fff700 1 --2- 172.21.15.26:0/225914690 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8418136710 0x7f841811b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:10.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.682+0000 7f8417fff700 1 -- 172.21.15.26:0/225914690 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840c0094a0 con 0x7f84181338a0 2023-10-01T07:56:10.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.682+0000 7f84177fe700 1 --2- 172.21.15.26:0/225914690 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8418136710 0x7f841811b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:56:10.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.682+0000 7f8417fff700 1 --2- 172.21.15.26:0/225914690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84181338a0 0x7f841811ad40 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f840800c4e0 tx=0x7f840800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:10.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.683+0000 7f8414ff9700 1 -- 172.21.15.26:0/225914690 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84080052d0 con 0x7f84181338a0 2023-10-01T07:56:10.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.683+0000 7f841e3ea700 1 -- 172.21.15.26:0/225914690 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8410009b30 con 0x7f84181338a0 2023-10-01T07:56:10.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.683+0000 7f8414ff9700 1 -- 172.21.15.26:0/225914690 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8408005430 con 0x7f84181338a0 2023-10-01T07:56:10.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.683+0000 7f8414ff9700 1 -- 172.21.15.26:0/225914690 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84080038c0 con 0x7f84181338a0 2023-10-01T07:56:10.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.683+0000 7f841e3ea700 1 -- 172.21.15.26:0/225914690 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f841811d140 con 0x7f84181338a0 2023-10-01T07:56:10.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.684+0000 7f83fe7fc700 1 -- 172.21.15.26:0/225914690 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f841806ea40 con 0x7f84181338a0 2023-10-01T07:56:10.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.685+0000 7f8414ff9700 1 -- 172.21.15.26:0/225914690 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8408003a20 con 0x7f84181338a0 2023-10-01T07:56:10.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.685+0000 7f8414ff9700 1 -- 172.21.15.26:0/225914690 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f840803eba0 con 0x7f84181338a0 2023-10-01T07:56:10.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.690+0000 7f8414ff9700 1 -- 172.21.15.26:0/225914690 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8408018260 con 0x7f84181338a0 2023-10-01T07:56:10.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.734+0000 7f0acc112700 1 Processor -- start 2023-10-01T07:56:10.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.734+0000 7f0acc112700 1 -- start start 2023-10-01T07:56:10.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.735+0000 7f0acc112700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ac4133420 0x7f0ac41337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:10.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.735+0000 7f0acc112700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ac4133e30 0x7f0ac412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:10.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.735+0000 7f0acc112700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0ac4134260 0x7f0ac41304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:10.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.735+0000 7f0acc112700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac406b990 con 0x7f0ac4134260 2023-10-01T07:56:10.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.735+0000 7f0acc112700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac40a0590 con 0x7f0ac4133420 2023-10-01T07:56:10.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.735+0000 7f0acc112700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac409fb80 con 0x7f0ac4133e30 2023-10-01T07:56:10.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.735+0000 7f0ac96ad700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ac4133e30 0x7f0ac412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:10.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.735+0000 7f0ac96ad700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ac4133e30 0x7f0ac412ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:50248/0 (socket says 172.21.15.26:50248) 2023-10-01T07:56:10.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.735+0000 7f0ac96ad700 1 -- 172.21.15.26:0/1895167120 learned_addr learned my addr 172.21.15.26:0/1895167120 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:10.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.735+0000 7f0aca6af700 1 --2- 172.21.15.26:0/1895167120 >> v2:172.21.15.26:3300/0 conn(0x7f0ac4134260 0x7f0ac41304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:10.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.735+0000 7f0ac9eae700 1 --2- 172.21.15.26:0/1895167120 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ac4133420 0x7f0ac41337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:10.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.736+0000 7f0aca6af700 1 -- 172.21.15.26:0/1895167120 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ac4133e30 msgr2=0x7f0ac412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:10.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.736+0000 7f0aca6af700 1 --2- 172.21.15.26:0/1895167120 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ac4133e30 0x7f0ac412ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:10.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.736+0000 7f0aca6af700 1 -- 172.21.15.26:0/1895167120 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ac4133420 msgr2=0x7f0ac41337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:10.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.736+0000 7f0aca6af700 1 --2- 172.21.15.26:0/1895167120 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ac4133420 0x7f0ac41337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:10.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.736+0000 7f0aca6af700 1 -- 172.21.15.26:0/1895167120 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac40a0030 con 0x7f0ac4134260 2023-10-01T07:56:10.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.736+0000 7f0ac9eae700 1 --2- 172.21.15.26:0/1895167120 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ac4133420 0x7f0ac41337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:10.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.736+0000 7f0ac96ad700 1 --2- 172.21.15.26:0/1895167120 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ac4133e30 0x7f0ac412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:10.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.736+0000 7f0aca6af700 1 --2- 172.21.15.26:0/1895167120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ac4134260 0x7f0ac41304d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0abc009d90 tx=0x7f0abc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca13b9a081bca01 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:10.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.736+0000 7f0ac8eac700 1 -- 172.21.15.26:0/1895167120 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc00e070 con 0x7f0ac4134260 2023-10-01T07:56:10.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.736+0000 7f0ac8eac700 1 -- 172.21.15.26:0/1895167120 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0abc00bb20 con 0x7f0ac4134260 2023-10-01T07:56:10.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.736+0000 7f0ac8eac700 1 -- 172.21.15.26:0/1895167120 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc012430 con 0x7f0ac4134260 2023-10-01T07:56:10.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.737+0000 7f0acc112700 1 -- 172.21.15.26:0/1895167120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ac4134260 msgr2=0x7f0ac41304d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:10.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.737+0000 7f0acc112700 1 --2- 172.21.15.26:0/1895167120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ac4134260 0x7f0ac41304d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0abc009d90 tx=0x7f0abc00b330 comp rx=0 tx=0).stop 2023-10-01T07:56:10.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.737+0000 7f0acc112700 1 -- 172.21.15.26:0/1895167120 shutdown_connections 2023-10-01T07:56:10.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.737+0000 7f0acc112700 1 --2- 172.21.15.26:0/1895167120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ac4134260 0x7f0ac41304d0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:10.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.737+0000 7f0acc112700 1 --2- 172.21.15.26:0/1895167120 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ac4133420 0x7f0ac41337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:10.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.737+0000 7f0acc112700 1 --2- 172.21.15.26:0/1895167120 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ac4133e30 0x7f0ac412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:10.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.737+0000 7f0acc112700 1 -- 172.21.15.26:0/1895167120 >> 172.21.15.26:0/1895167120 conn(0x7f0ac40a4210 msgr2=0x7f0ac40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:10.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.737+0000 7f0acc112700 1 -- 172.21.15.26:0/1895167120 shutdown_connections 2023-10-01T07:56:10.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.737+0000 7f0acc112700 1 -- 172.21.15.26:0/1895167120 wait complete. 2023-10-01T07:56:10.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.739+0000 7f0acc112700 1 Processor -- start 2023-10-01T07:56:10.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.739+0000 7f0acc112700 1 -- start start 2023-10-01T07:56:10.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.739+0000 7f0acc112700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ac4133420 0x7f0ac409c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:10.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.739+0000 7f0acc112700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ac4133e30 0x7f0ac409cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:10.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.739+0000 7f0acc112700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ac4134260 0x7f0ac409d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:10.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.739+0000 7f0acc112700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac41210a0 con 0x7f0ac4133e30 2023-10-01T07:56:10.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.739+0000 7f0acc112700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac409dbb0 con 0x7f0ac4134260 2023-10-01T07:56:10.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.739+0000 7f0acc112700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac412db70 con 0x7f0ac4133420 2023-10-01T07:56:10.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.740+0000 7f0ac9eae700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ac4133420 0x7f0ac409c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:10.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.740+0000 7f0ac9eae700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ac4133420 0x7f0ac409c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:50258/0 (socket says 172.21.15.26:50258) 2023-10-01T07:56:10.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.740+0000 7f0ac9eae700 1 -- 172.21.15.26:0/2167615577 learned_addr learned my addr 172.21.15.26:0/2167615577 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:10.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.740+0000 7f0aca6af700 1 --2- 172.21.15.26:0/2167615577 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ac4134260 0x7f0ac409d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:10.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.740+0000 7f0ac96ad700 1 --2- 172.21.15.26:0/2167615577 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ac4133e30 0x7f0ac409cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:10.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.740+0000 7f0ac9eae700 1 -- 172.21.15.26:0/2167615577 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ac4134260 msgr2=0x7f0ac409d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:10.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.740+0000 7f0ac9eae700 1 --2- 172.21.15.26:0/2167615577 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ac4134260 0x7f0ac409d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:10.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.740+0000 7f0ac9eae700 1 -- 172.21.15.26:0/2167615577 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ac4133e30 msgr2=0x7f0ac409cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:10.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.740+0000 7f0ac9eae700 1 --2- 172.21.15.26:0/2167615577 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ac4133e30 0x7f0ac409cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:10.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.740+0000 7f0ac9eae700 1 -- 172.21.15.26:0/2167615577 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac00094a0 con 0x7f0ac4133420 2023-10-01T07:56:10.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.740+0000 7f0ac9eae700 1 --2- 172.21.15.26:0/2167615577 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ac4133420 0x7f0ac409c6e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0ac000ebe0 tx=0x7f0ac000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:10.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.740+0000 7f0aba7fc700 1 -- 172.21.15.26:0/2167615577 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac000c8b0 con 0x7f0ac4133420 2023-10-01T07:56:10.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.741+0000 7f0aba7fc700 1 -- 172.21.15.26:0/2167615577 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac000ca10 con 0x7f0ac4133420 2023-10-01T07:56:10.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.741+0000 7f0aba7fc700 1 -- 172.21.15.26:0/2167615577 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac000cd80 con 0x7f0ac4133420 2023-10-01T07:56:10.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.741+0000 7f0acc112700 1 -- 172.21.15.26:0/2167615577 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab4009550 con 0x7f0ac4133420 2023-10-01T07:56:10.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.741+0000 7f0acc112700 1 -- 172.21.15.26:0/2167615577 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0abc009a70 con 0x7f0ac4133420 2023-10-01T07:56:10.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.742+0000 7f0aba7fc700 1 -- 172.21.15.26:0/2167615577 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0ac0013470 con 0x7f0ac4133420 2023-10-01T07:56:10.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.742+0000 7f0acc112700 1 -- 172.21.15.26:0/2167615577 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac406d280 con 0x7f0ac4133420 2023-10-01T07:56:10.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.742+0000 7f0aba7fc700 1 -- 172.21.15.26:0/2167615577 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0ac001ad40 con 0x7f0ac4133420 2023-10-01T07:56:10.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.747+0000 7f0aba7fc700 1 -- 172.21.15.26:0/2167615577 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0ac0017070 con 0x7f0ac4133420 2023-10-01T07:56:10.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.806+0000 7fddcf014700 1 -- 172.21.15.26:0/2318654849 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdda8005590 con 0x7fddc809d6f0 2023-10-01T07:56:10.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.807+0000 7fddc57fa700 1 -- 172.21.15.26:0/2318654849 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fddb8035090 con 0x7fddc809d6f0 2023-10-01T07:56:10.807 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:10.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.809+0000 7fddcf014700 1 -- 172.21.15.26:0/2318654849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddc809d6f0 msgr2=0x7fddc81226e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:10.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.809+0000 7fddcf014700 1 --2- 172.21.15.26:0/2318654849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddc809d6f0 0x7fddc81226e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fddb8000c00 tx=0x7fddb8004750 comp rx=0 tx=0).stop 2023-10-01T07:56:10.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.810+0000 7fddcf014700 1 -- 172.21.15.26:0/2318654849 shutdown_connections 2023-10-01T07:56:10.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.810+0000 7fddcf014700 1 --2- 172.21.15.26:0/2318654849 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddc809e410 0x7fddc8123160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:10.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.810+0000 7fddcf014700 1 --2- 172.21.15.26:0/2318654849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddc809d6f0 0x7fddc81226e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:10.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.810+0000 7fddcf014700 1 --2- 172.21.15.26:0/2318654849 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fddc809e000 0x7fddc8122c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:10.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.810+0000 7fddcf014700 1 -- 172.21.15.26:0/2318654849 >> 172.21.15.26:0/2318654849 conn(0x7fddc8066f50 msgr2=0x7fddc806f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:10.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.810+0000 7fddcf014700 1 -- 172.21.15.26:0/2318654849 shutdown_connections 2023-10-01T07:56:10.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.810+0000 7fddcf014700 1 -- 172.21.15.26:0/2318654849 wait complete. 2023-10-01T07:56:10.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.816+0000 7f452dad0700 1 Processor -- start 2023-10-01T07:56:10.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.816+0000 7f452dad0700 1 -- start start 2023-10-01T07:56:10.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.817+0000 7f452dad0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f452809e1d0 0x7f4528135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:10.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.817+0000 7f452dad0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4528135e50 0x7f4528138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:10.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.817+0000 7f452dad0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f452809f130 con 0x7f452809d6f0 2023-10-01T07:56:10.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.817+0000 7f452dad0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f452809f520 con 0x7f4528135e50 2023-10-01T07:56:10.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.817+0000 7f452dad0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f452809e930 con 0x7f452809e1d0 2023-10-01T07:56:10.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.817+0000 7f45277fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f452809d6f0 0x7f452809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57562/0 (socket says 172.21.15.26:57562) 2023-10-01T07:56:10.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.817+0000 7f45277fe700 1 -- 172.21.15.26:0/501323773 learned_addr learned my addr 172.21.15.26:0/501323773 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:10.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.817+0000 7f4527fff700 1 --2- 172.21.15.26:0/501323773 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4528135e50 0x7f4528138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:10.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.817+0000 7f4526ffd700 1 --2- 172.21.15.26:0/501323773 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f452809e1d0 0x7f4528135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:10.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.818+0000 7f4527fff700 1 -- 172.21.15.26:0/501323773 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f452809e1d0 msgr2=0x7f4528135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:10.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.818+0000 7f4527fff700 1 --2- 172.21.15.26:0/501323773 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f452809e1d0 0x7f4528135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:10.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.818+0000 7f4527fff700 1 -- 172.21.15.26:0/501323773 >> v1:172.21.15.26:6789/0 conn(0x7f452809d6f0 legacy=0x7f452809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:10.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.818+0000 7f4527fff700 1 -- 172.21.15.26:0/501323773 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f452809b2d0 con 0x7f4528135e50 2023-10-01T07:56:10.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.818+0000 7f4527fff700 1 --2- 172.21.15.26:0/501323773 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4528135e50 0x7f4528138230 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4520009dc0 tx=0x7f452000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=361e712f38b8c10b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:10.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.818+0000 7f45267fc700 1 -- 172.21.15.26:0/501323773 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452000e070 con 0x7f4528135e50 2023-10-01T07:56:10.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.818+0000 7f45267fc700 1 -- 172.21.15.26:0/501323773 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452000bbd0 con 0x7f4528135e50 2023-10-01T07:56:10.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.818+0000 7f45267fc700 1 -- 172.21.15.26:0/501323773 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4520012430 con 0x7f4528135e50 2023-10-01T07:56:10.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.819+0000 7f452dad0700 1 -- 172.21.15.26:0/501323773 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4528135e50 msgr2=0x7f4528138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:10.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.819+0000 7f452dad0700 1 --2- 172.21.15.26:0/501323773 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4528135e50 0x7f4528138230 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4520009dc0 tx=0x7f452000b330 comp rx=0 tx=0).stop 2023-10-01T07:56:10.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.819+0000 7f452dad0700 1 -- 172.21.15.26:0/501323773 shutdown_connections 2023-10-01T07:56:10.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.819+0000 7f452dad0700 1 --2- 172.21.15.26:0/501323773 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4528135e50 0x7f4528138230 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:10.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.819+0000 7f452dad0700 1 --2- 172.21.15.26:0/501323773 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f452809e1d0 0x7f4528135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:10.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.819+0000 7f452dad0700 1 -- 172.21.15.26:0/501323773 >> 172.21.15.26:0/501323773 conn(0x7f4528066f50 msgr2=0x7f452809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:10.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.820+0000 7f452dad0700 1 -- 172.21.15.26:0/501323773 shutdown_connections 2023-10-01T07:56:10.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.820+0000 7f452dad0700 1 -- 172.21.15.26:0/501323773 wait complete. 2023-10-01T07:56:10.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.821+0000 7f452dad0700 1 Processor -- start 2023-10-01T07:56:10.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.821+0000 7f452dad0700 1 -- start start 2023-10-01T07:56:10.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.822+0000 7f452dad0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f452809d6f0 0x7f45281194b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:10.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.822+0000 7f452dad0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f452809e1d0 0x7f45281199f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:10.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.822+0000 7f452dad0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4528135e50 0x7f4528119f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:10.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.822+0000 7f452dad0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452809c700 con 0x7f452809e1d0 2023-10-01T07:56:10.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.822+0000 7f452dad0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f452811b090 con 0x7f4528135e50 2023-10-01T07:56:10.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.822+0000 7f452dad0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f452811cbb0 con 0x7f452809d6f0 2023-10-01T07:56:10.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.822+0000 7f45277fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f452809d6f0 0x7f45281194b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:10.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.822+0000 7f4526ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f452809e1d0 0x7f45281199f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:10.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.822+0000 7f45277fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f452809d6f0 0x7f45281194b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:50266/0 (socket says 172.21.15.26:50266) 2023-10-01T07:56:10.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.822+0000 7f4526ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f452809e1d0 0x7f45281199f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44988/0 (socket says 172.21.15.26:44988) 2023-10-01T07:56:10.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.822+0000 7f45277fe700 1 -- 172.21.15.26:0/475123895 learned_addr learned my addr 172.21.15.26:0/475123895 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:10.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.822+0000 7f4527fff700 1 --2- 172.21.15.26:0/475123895 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4528135e50 0x7f4528119f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:10.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.823+0000 7f4527fff700 1 -- 172.21.15.26:0/475123895 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f452809d6f0 msgr2=0x7f45281194b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:10.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.823+0000 7f4527fff700 1 --2- 172.21.15.26:0/475123895 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f452809d6f0 0x7f45281194b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:10.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.823+0000 7f4527fff700 1 -- 172.21.15.26:0/475123895 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f452809e1d0 msgr2=0x7f45281199f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:10.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.823+0000 7f4527fff700 1 --2- 172.21.15.26:0/475123895 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f452809e1d0 0x7f45281199f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:10.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.823+0000 7f4527fff700 1 -- 172.21.15.26:0/475123895 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4520009a70 con 0x7f4528135e50 2023-10-01T07:56:10.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.823+0000 7f4526ffd700 1 --2- 172.21.15.26:0/475123895 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f452809e1d0 0x7f45281199f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:10.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.823+0000 7f4527fff700 1 --2- 172.21.15.26:0/475123895 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4528135e50 0x7f4528119f30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4520016000 tx=0x7f4520004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:10.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.823+0000 7f450ffff700 1 -- 172.21.15.26:0/475123895 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4520020c20 con 0x7f4528135e50 2023-10-01T07:56:10.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.823+0000 7f450ffff700 1 -- 172.21.15.26:0/475123895 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4520024070 con 0x7f4528135e50 2023-10-01T07:56:10.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.823+0000 7f452dad0700 1 -- 172.21.15.26:0/475123895 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45280a1d00 con 0x7f4528135e50 2023-10-01T07:56:10.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.823+0000 7f450ffff700 1 -- 172.21.15.26:0/475123895 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4520004250 con 0x7f4528135e50 2023-10-01T07:56:10.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.824+0000 7f452dad0700 1 -- 172.21.15.26:0/475123895 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f452811b820 con 0x7f4528135e50 2023-10-01T07:56:10.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.824+0000 7f450ffff700 1 -- 172.21.15.26:0/475123895 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f45200043b0 con 0x7f4528135e50 2023-10-01T07:56:10.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.825+0000 7f452dad0700 1 -- 172.21.15.26:0/475123895 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f452811c830 con 0x7f4528135e50 2023-10-01T07:56:10.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.825+0000 7f450ffff700 1 -- 172.21.15.26:0/475123895 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4520026070 con 0x7f4528135e50 2023-10-01T07:56:10.828 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:10.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.830+0000 7f450ffff700 1 -- 172.21.15.26:0/475123895 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f452811c830 con 0x7f4528135e50 2023-10-01T07:56:10.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.918+0000 7f83fe7fc700 1 -- 172.21.15.26:0/225914690 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f841811e220 con 0x7f84181338a0 2023-10-01T07:56:10.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.919+0000 7f8414ff9700 1 -- 172.21.15.26:0/225914690 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f841811e220 con 0x7f84181338a0 2023-10-01T07:56:10.919 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:10.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.921+0000 7f83fe7fc700 1 -- 172.21.15.26:0/225914690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84181338a0 msgr2=0x7f841811ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:10.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.921+0000 7f83fe7fc700 1 --2- 172.21.15.26:0/225914690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84181338a0 0x7f841811ad40 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f840800c4e0 tx=0x7f840800c7f0 comp rx=0 tx=0).stop 2023-10-01T07:56:10.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.921+0000 7f83fe7fc700 1 -- 172.21.15.26:0/225914690 shutdown_connections 2023-10-01T07:56:10.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.921+0000 7f83fe7fc700 1 --2- 172.21.15.26:0/225914690 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8418139030 0x7f841811b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:10.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.921+0000 7f83fe7fc700 1 --2- 172.21.15.26:0/225914690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84181338a0 0x7f841811ad40 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:10.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.921+0000 7f83fe7fc700 1 --2- 172.21.15.26:0/225914690 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8418136710 0x7f841811b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:10.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.921+0000 7f83fe7fc700 1 -- 172.21.15.26:0/225914690 >> 172.21.15.26:0/225914690 conn(0x7f84180a2aa0 msgr2=0x7f84180a0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:10.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.921+0000 7f83fe7fc700 1 -- 172.21.15.26:0/225914690 shutdown_connections 2023-10-01T07:56:10.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.921+0000 7f83fe7fc700 1 -- 172.21.15.26:0/225914690 wait complete. 2023-10-01T07:56:10.936 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:10.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.990+0000 7f0acc112700 1 -- 172.21.15.26:0/2167615577 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0ac4074ea0 con 0x7f0ac4133420 2023-10-01T07:56:10.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.990+0000 7f0aba7fc700 1 -- 172.21.15.26:0/2167615577 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0ac0017030 con 0x7f0ac4133420 2023-10-01T07:56:10.991 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:10.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.993+0000 7f0acc112700 1 -- 172.21.15.26:0/2167615577 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ac4133420 msgr2=0x7f0ac409c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:10.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.993+0000 7f0acc112700 1 --2- 172.21.15.26:0/2167615577 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ac4133420 0x7f0ac409c6e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0ac000ebe0 tx=0x7f0ac000eef0 comp rx=0 tx=0).stop 2023-10-01T07:56:10.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.993+0000 7f0acc112700 1 -- 172.21.15.26:0/2167615577 shutdown_connections 2023-10-01T07:56:10.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.993+0000 7f0acc112700 1 --2- 172.21.15.26:0/2167615577 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ac4134260 0x7f0ac409d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:10.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.993+0000 7f0acc112700 1 --2- 172.21.15.26:0/2167615577 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ac4133420 0x7f0ac409c6e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:10.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.993+0000 7f0acc112700 1 --2- 172.21.15.26:0/2167615577 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ac4133e30 0x7f0ac409cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:10.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.993+0000 7f0acc112700 1 -- 172.21.15.26:0/2167615577 >> 172.21.15.26:0/2167615577 conn(0x7f0ac40a4210 msgr2=0x7f0ac40a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:10.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.993+0000 7f0acc112700 1 -- 172.21.15.26:0/2167615577 shutdown_connections 2023-10-01T07:56:10.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:10.993+0000 7f0acc112700 1 -- 172.21.15.26:0/2167615577 wait complete. 2023-10-01T07:56:11.008 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:11.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.039+0000 7f452dad0700 1 -- 172.21.15.26:0/475123895 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f452811c830 con 0x7f4528135e50 2023-10-01T07:56:11.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.040+0000 7f450ffff700 1 -- 172.21.15.26:0/475123895 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f452811c830 con 0x7f4528135e50 2023-10-01T07:56:11.040 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:11.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.042+0000 7f452dad0700 1 -- 172.21.15.26:0/475123895 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4528135e50 msgr2=0x7f4528119f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:11.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.042+0000 7f452dad0700 1 --2- 172.21.15.26:0/475123895 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4528135e50 0x7f4528119f30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4520016000 tx=0x7f4520004ad0 comp rx=0 tx=0).stop 2023-10-01T07:56:11.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.042+0000 7f452dad0700 1 -- 172.21.15.26:0/475123895 shutdown_connections 2023-10-01T07:56:11.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.042+0000 7f452dad0700 1 --2- 172.21.15.26:0/475123895 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4528135e50 0x7f4528119f30 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:11.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.042+0000 7f452dad0700 1 --2- 172.21.15.26:0/475123895 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f452809d6f0 0x7f45281194b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:11.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.042+0000 7f452dad0700 1 --2- 172.21.15.26:0/475123895 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f452809e1d0 0x7f45281199f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:11.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.042+0000 7f452dad0700 1 -- 172.21.15.26:0/475123895 >> 172.21.15.26:0/475123895 conn(0x7f4528066f50 msgr2=0x7f4528130800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:11.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.042+0000 7f452dad0700 1 -- 172.21.15.26:0/475123895 shutdown_connections 2023-10-01T07:56:11.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.042+0000 7f452dad0700 1 -- 172.21.15.26:0/475123895 wait complete. 2023-10-01T07:56:11.057 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:11.829 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:11.936 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:11.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.976+0000 7f13b9dc5700 1 Processor -- start 2023-10-01T07:56:11.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.976+0000 7f13b9dc5700 1 -- start start 2023-10-01T07:56:11.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.976+0000 7f13b9dc5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f13b409d6f0 0x7f13b409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:11.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.976+0000 7f13b9dc5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f13b409e000 0x7f13b41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:11.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.976+0000 7f13b9dc5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b409b120 con 0x7f13b409e410 2023-10-01T07:56:11.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.976+0000 7f13b9dc5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13b406b460 con 0x7f13b409d6f0 2023-10-01T07:56:11.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.976+0000 7f13b9dc5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13b409a7e0 con 0x7f13b409e000 2023-10-01T07:56:11.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.977+0000 7f13b2ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f13b409e000 0x7f13b41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:11.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.977+0000 7f13b37fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f13b409d6f0 0x7f13b409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:11.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.977+0000 7f13b2ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f13b409e000 0x7f13b41339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:50268/0 (socket says 172.21.15.26:50268) 2023-10-01T07:56:11.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.977+0000 7f13b2ffd700 1 -- 172.21.15.26:0/934141191 learned_addr learned my addr 172.21.15.26:0/934141191 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:11.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.977+0000 7f13b37fe700 1 --2- 172.21.15.26:0/934141191 >> v2:172.21.15.26:3300/0 conn(0x7f13b409d6f0 0x7f13b409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44994/0 (socket says 172.21.15.26:44994) 2023-10-01T07:56:11.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.977+0000 7f13b37fe700 1 -- 172.21.15.26:0/934141191 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f13b409e000 msgr2=0x7f13b41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:11.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.977+0000 7f13b37fe700 1 --2- 172.21.15.26:0/934141191 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f13b409e000 0x7f13b41339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:11.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.977+0000 7f13b37fe700 1 -- 172.21.15.26:0/934141191 >> v1:172.21.15.26:6789/0 conn(0x7f13b409e410 legacy=0x7f13b4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:11.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.977+0000 7f13b37fe700 1 -- 172.21.15.26:0/934141191 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b409a500 con 0x7f13b409d6f0 2023-10-01T07:56:11.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.977+0000 7f13b2ffd700 1 --2- 172.21.15.26:0/934141191 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f13b409e000 0x7f13b41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:11.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.977+0000 7f13b37fe700 1 --2- 172.21.15.26:0/934141191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13b409d6f0 0x7f13b409dac0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f13a4009840 tx=0x7f13a4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41c151c56ebabbfd server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:11.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.977+0000 7f13b27fc700 1 -- 172.21.15.26:0/934141191 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a4011830 con 0x7f13b409d6f0 2023-10-01T07:56:11.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.977+0000 7f13b27fc700 1 -- 172.21.15.26:0/934141191 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a4011990 con 0x7f13b409d6f0 2023-10-01T07:56:11.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.977+0000 7f13b27fc700 1 -- 172.21.15.26:0/934141191 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a4011d20 con 0x7f13b409d6f0 2023-10-01T07:56:11.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.978+0000 7f13b9dc5700 1 -- 172.21.15.26:0/934141191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13b409d6f0 msgr2=0x7f13b409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:11.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.978+0000 7f13b9dc5700 1 --2- 172.21.15.26:0/934141191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13b409d6f0 0x7f13b409dac0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f13a4009840 tx=0x7f13a4009b50 comp rx=0 tx=0).stop 2023-10-01T07:56:11.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.978+0000 7f13b9dc5700 1 -- 172.21.15.26:0/934141191 shutdown_connections 2023-10-01T07:56:11.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.978+0000 7f13b9dc5700 1 --2- 172.21.15.26:0/934141191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13b409d6f0 0x7f13b409dac0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:11.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.978+0000 7f13b9dc5700 1 --2- 172.21.15.26:0/934141191 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f13b409e000 0x7f13b41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:11.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.978+0000 7f13b9dc5700 1 -- 172.21.15.26:0/934141191 >> 172.21.15.26:0/934141191 conn(0x7f13b4066f50 msgr2=0x7f13b409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:11.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.978+0000 7f13b9dc5700 1 -- 172.21.15.26:0/934141191 shutdown_connections 2023-10-01T07:56:11.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.978+0000 7f13b9dc5700 1 -- 172.21.15.26:0/934141191 wait complete. 2023-10-01T07:56:11.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.979+0000 7f13b9dc5700 1 Processor -- start 2023-10-01T07:56:11.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.979+0000 7f13b9dc5700 1 -- start start 2023-10-01T07:56:11.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.980+0000 7f13b9dc5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f13b409d6f0 0x7f13b41a5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:11.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.980+0000 7f13b9dc5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13b409e000 0x7f13b41a63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:11.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.980+0000 7f13b9dc5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13b409e410 0x7f13b41a6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:11.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.980+0000 7f13b9dc5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b41a7340 con 0x7f13b409e410 2023-10-01T07:56:11.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.980+0000 7f13b9dc5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b41a7ac0 con 0x7f13b409e000 2023-10-01T07:56:11.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.980+0000 7f13b9dc5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13b41a80e0 con 0x7f13b409d6f0 2023-10-01T07:56:11.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.980+0000 7f13b2ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13b409e000 0x7f13b41a63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:11.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.980+0000 7f13b3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13b409e410 0x7f13b41a6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:11.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.980+0000 7f13b37fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f13b409d6f0 0x7f13b41a5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:11.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.980+0000 7f13b2ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13b409e000 0x7f13b41a63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:41246/0 (socket says 172.21.15.26:41246) 2023-10-01T07:56:11.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.980+0000 7f13b2ffd700 1 -- 172.21.15.26:0/145116510 learned_addr learned my addr 172.21.15.26:0/145116510 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:11.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.980+0000 7f13b2ffd700 1 -- 172.21.15.26:0/145116510 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f13b409d6f0 msgr2=0x7f13b41a5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:11.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.980+0000 7f13b2ffd700 1 --2- 172.21.15.26:0/145116510 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f13b409d6f0 0x7f13b41a5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:11.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.980+0000 7f13b2ffd700 1 -- 172.21.15.26:0/145116510 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13b409e410 msgr2=0x7f13b41a6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:11.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.980+0000 7f13b2ffd700 1 --2- 172.21.15.26:0/145116510 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13b409e410 0x7f13b41a6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:11.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.980+0000 7f13b2ffd700 1 -- 172.21.15.26:0/145116510 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a8009550 con 0x7f13b409e000 2023-10-01T07:56:11.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.980+0000 7f13b3fff700 1 --2- 172.21.15.26:0/145116510 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13b409e410 0x7f13b41a6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:11.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.981+0000 7f13b2ffd700 1 --2- 172.21.15.26:0/145116510 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13b409e000 0x7f13b41a63f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f13a800ec40 tx=0x7f13a800ef50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:11.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.981+0000 7f139bfff700 1 -- 172.21.15.26:0/145116510 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a800c850 con 0x7f13b409e000 2023-10-01T07:56:11.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.981+0000 7f139bfff700 1 -- 172.21.15.26:0/145116510 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a800c9b0 con 0x7f13b409e000 2023-10-01T07:56:11.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.981+0000 7f13b9dc5700 1 -- 172.21.15.26:0/145116510 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a40094a0 con 0x7f13b409e000 2023-10-01T07:56:11.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.981+0000 7f139bfff700 1 -- 172.21.15.26:0/145116510 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a800cd20 con 0x7f13b409e000 2023-10-01T07:56:11.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.981+0000 7f13b9dc5700 1 -- 172.21.15.26:0/145116510 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b40a3220 con 0x7f13b409e000 2023-10-01T07:56:11.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.982+0000 7f139bfff700 1 -- 172.21.15.26:0/145116510 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f13a8013470 con 0x7f13b409e000 2023-10-01T07:56:11.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.982+0000 7f139bfff700 1 -- 172.21.15.26:0/145116510 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f13a803f7b0 con 0x7f13b409e000 2023-10-01T07:56:11.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.982+0000 7f13b9dc5700 1 -- 172.21.15.26:0/145116510 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13b409c770 con 0x7f13b409e000 2023-10-01T07:56:11.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:11.987+0000 7f139bfff700 1 -- 172.21.15.26:0/145116510 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f13a8013720 con 0x7f13b409e000 2023-10-01T07:56:12.008 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:12.057 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:12.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.084+0000 7f8adae9f700 1 Processor -- start 2023-10-01T07:56:12.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.084+0000 7f8adae9f700 1 -- start start 2023-10-01T07:56:12.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.085+0000 7f8adae9f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8ad41338c0 0x7f8ad4133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:12.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.085+0000 7f8adae9f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ad41341d0 0x7f8ad409de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:12.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.085+0000 7f8adae9f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8ad409e390 0x7f8ad409e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:12.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.085+0000 7f8adae9f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad4070c80 con 0x7f8ad409e390 2023-10-01T07:56:12.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.085+0000 7f8adae9f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad406f720 con 0x7f8ad41341d0 2023-10-01T07:56:12.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.085+0000 7f8adae9f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad406fce0 con 0x7f8ad41338c0 2023-10-01T07:56:12.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.085+0000 7f8ad3fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ad41341d0 0x7f8ad409de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:12.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.085+0000 7f8ad3fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ad41341d0 0x7f8ad409de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:41262/0 (socket says 172.21.15.26:41262) 2023-10-01T07:56:12.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.085+0000 7f8ad3fff700 1 -- 172.21.15.26:0/2251878506 learned_addr learned my addr 172.21.15.26:0/2251878506 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:12.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.085+0000 7f8ad943c700 1 --2- 172.21.15.26:0/2251878506 >> v2:172.21.15.26:3300/0 conn(0x7f8ad409e390 0x7f8ad409e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:12.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.086+0000 7f8ad8c3b700 1 --2- 172.21.15.26:0/2251878506 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8ad41338c0 0x7f8ad4133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:12.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.086+0000 7f8ad3fff700 1 -- 172.21.15.26:0/2251878506 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8ad41338c0 msgr2=0x7f8ad4133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:12.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.086+0000 7f8ad3fff700 1 --2- 172.21.15.26:0/2251878506 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8ad41338c0 0x7f8ad4133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:12.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.086+0000 7f8ad3fff700 1 -- 172.21.15.26:0/2251878506 >> v2:172.21.15.26:3300/0 conn(0x7f8ad409e390 msgr2=0x7f8ad409e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:12.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.086+0000 7f8ad3fff700 1 --2- 172.21.15.26:0/2251878506 >> v2:172.21.15.26:3300/0 conn(0x7f8ad409e390 0x7f8ad409e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:12.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.086+0000 7f8ad3fff700 1 -- 172.21.15.26:0/2251878506 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad41336a0 con 0x7f8ad41341d0 2023-10-01T07:56:12.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.086+0000 7f8ad3fff700 1 --2- 172.21.15.26:0/2251878506 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ad41341d0 0x7f8ad409de50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8ac00098f0 tx=0x7f8ac0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2580bd84b8323f91 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:12.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.086+0000 7f8ad37fe700 1 -- 172.21.15.26:0/2251878506 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac000b8a0 con 0x7f8ad41341d0 2023-10-01T07:56:12.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.086+0000 7f8ad37fe700 1 -- 172.21.15.26:0/2251878506 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac000ba00 con 0x7f8ad41341d0 2023-10-01T07:56:12.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.086+0000 7f8ad37fe700 1 -- 172.21.15.26:0/2251878506 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac000bd90 con 0x7f8ad41341d0 2023-10-01T07:56:12.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.087+0000 7f8adae9f700 1 -- 172.21.15.26:0/2251878506 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ad41341d0 msgr2=0x7f8ad409de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:12.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.087+0000 7f8adae9f700 1 --2- 172.21.15.26:0/2251878506 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ad41341d0 0x7f8ad409de50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8ac00098f0 tx=0x7f8ac0009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:12.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.087+0000 7f8adae9f700 1 -- 172.21.15.26:0/2251878506 shutdown_connections 2023-10-01T07:56:12.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.087+0000 7f8adae9f700 1 --2- 172.21.15.26:0/2251878506 >> v2:172.21.15.26:3300/0 conn(0x7f8ad409e390 0x7f8ad409e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:12.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.087+0000 7f8adae9f700 1 --2- 172.21.15.26:0/2251878506 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8ad41338c0 0x7f8ad4133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:12.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.087+0000 7f8adae9f700 1 --2- 172.21.15.26:0/2251878506 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ad41341d0 0x7f8ad409de50 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:12.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.087+0000 7f8adae9f700 1 -- 172.21.15.26:0/2251878506 >> 172.21.15.26:0/2251878506 conn(0x7f8ad40a2aa0 msgr2=0x7f8ad40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:12.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.087+0000 7f8adae9f700 1 -- 172.21.15.26:0/2251878506 shutdown_connections 2023-10-01T07:56:12.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.087+0000 7f8adae9f700 1 -- 172.21.15.26:0/2251878506 wait complete. 2023-10-01T07:56:12.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.088+0000 7f8adae9f700 1 Processor -- start 2023-10-01T07:56:12.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.088+0000 7f8adae9f700 1 -- start start 2023-10-01T07:56:12.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.089+0000 7f8adae9f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8ad409e390 0x7f8ad411f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:12.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.089+0000 7f8adae9f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ad41338c0 0x7f8ad411fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:12.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.089+0000 7f8adae9f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ad41341d0 0x7f8ad4120210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:12.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.089+0000 7f8adae9f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad41230b0 con 0x7f8ad41341d0 2023-10-01T07:56:12.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.089+0000 7f8adae9f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad41232b0 con 0x7f8ad41338c0 2023-10-01T07:56:12.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.089+0000 7f8adae9f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad41221a0 con 0x7f8ad409e390 2023-10-01T07:56:12.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.089+0000 7f8ad943c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ad41341d0 0x7f8ad4120210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:12.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.089+0000 7f8ad943c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ad41341d0 0x7f8ad4120210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45024/0 (socket says 172.21.15.26:45024) 2023-10-01T07:56:12.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.089+0000 7f8ad943c700 1 -- 172.21.15.26:0/3077042365 learned_addr learned my addr 172.21.15.26:0/3077042365 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:12.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.089+0000 7f8ad3fff700 1 --2- 172.21.15.26:0/3077042365 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ad41338c0 0x7f8ad411fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:12.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.089+0000 7f8ad8c3b700 1 --2- 172.21.15.26:0/3077042365 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8ad409e390 0x7f8ad411f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:12.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.090+0000 7f8ad943c700 1 -- 172.21.15.26:0/3077042365 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8ad409e390 msgr2=0x7f8ad411f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:12.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.090+0000 7f8ad943c700 1 --2- 172.21.15.26:0/3077042365 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8ad409e390 0x7f8ad411f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:12.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.090+0000 7f8ad943c700 1 -- 172.21.15.26:0/3077042365 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ad41338c0 msgr2=0x7f8ad411fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:12.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.090+0000 7f8ad943c700 1 --2- 172.21.15.26:0/3077042365 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ad41338c0 0x7f8ad411fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:12.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.090+0000 7f8ad943c700 1 -- 172.21.15.26:0/3077042365 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac0009550 con 0x7f8ad41341d0 2023-10-01T07:56:12.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.090+0000 7f8ad943c700 1 --2- 172.21.15.26:0/3077042365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ad41341d0 0x7f8ad4120210 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8acc007e60 tx=0x7f8acc00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:12.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.090+0000 7f8ad17fa700 1 -- 172.21.15.26:0/3077042365 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8acc00ed30 con 0x7f8ad41341d0 2023-10-01T07:56:12.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.090+0000 7f8ad17fa700 1 -- 172.21.15.26:0/3077042365 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8acc014420 con 0x7f8ad41341d0 2023-10-01T07:56:12.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.090+0000 7f8adae9f700 1 -- 172.21.15.26:0/3077042365 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad4130c20 con 0x7f8ad41341d0 2023-10-01T07:56:12.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.090+0000 7f8ad17fa700 1 -- 172.21.15.26:0/3077042365 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8acc0147d0 con 0x7f8ad41341d0 2023-10-01T07:56:12.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.090+0000 7f8adae9f700 1 -- 172.21.15.26:0/3077042365 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad4132130 con 0x7f8ad41341d0 2023-10-01T07:56:12.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.091+0000 7f8ad17fa700 1 -- 172.21.15.26:0/3077042365 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8acc014930 con 0x7f8ad41341d0 2023-10-01T07:56:12.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.092+0000 7f8ad17fa700 1 -- 172.21.15.26:0/3077042365 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8acc03fcb0 con 0x7f8ad41341d0 2023-10-01T07:56:12.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.092+0000 7f8adae9f700 1 -- 172.21.15.26:0/3077042365 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad406f9c0 con 0x7f8ad41341d0 2023-10-01T07:56:12.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.097+0000 7f8ad17fa700 1 -- 172.21.15.26:0/3077042365 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8acc0122e0 con 0x7f8ad41341d0 2023-10-01T07:56:12.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.158+0000 7f7c6b71e700 1 Processor -- start 2023-10-01T07:56:12.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.159+0000 7f7c6b71e700 1 -- start start 2023-10-01T07:56:12.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.159+0000 7f7c6b71e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7c6409e1d0 0x7f7c64138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:12.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.159+0000 7f7c6b71e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7c64139170 0x7f7c6413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:12.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.159+0000 7f7c6b71e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c6409b120 con 0x7f7c6409d6f0 2023-10-01T07:56:12.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.159+0000 7f7c6b71e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c6406b460 con 0x7f7c6409e1d0 2023-10-01T07:56:12.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.159+0000 7f7c6b71e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6409a7e0 con 0x7f7c64139170 2023-10-01T07:56:12.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.160+0000 7f7c68cb9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7c6409e1d0 0x7f7c64138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:12.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.160+0000 7f7c68cb9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7c6409e1d0 0x7f7c64138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45040/0 (socket says 172.21.15.26:45040) 2023-10-01T07:56:12.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.160+0000 7f7c68cb9700 1 -- 172.21.15.26:0/1105992319 learned_addr learned my addr 172.21.15.26:0/1105992319 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:12.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.160+0000 7f7c69cbb700 1 --2- 172.21.15.26:0/1105992319 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7c64139170 0x7f7c6413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:12.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.160+0000 7f7c69cbb700 1 -- 172.21.15.26:0/1105992319 >> v2:172.21.15.26:3300/0 conn(0x7f7c6409e1d0 msgr2=0x7f7c64138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:12.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.160+0000 7f7c69cbb700 1 --2- 172.21.15.26:0/1105992319 >> v2:172.21.15.26:3300/0 conn(0x7f7c6409e1d0 0x7f7c64138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:12.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.160+0000 7f7c69cbb700 1 -- 172.21.15.26:0/1105992319 >> v1:172.21.15.26:6789/0 conn(0x7f7c6409d6f0 legacy=0x7f7c6409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:12.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.160+0000 7f7c69cbb700 1 -- 172.21.15.26:0/1105992319 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6409a500 con 0x7f7c64139170 2023-10-01T07:56:12.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.160+0000 7f7c69cbb700 1 --2- 172.21.15.26:0/1105992319 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7c64139170 0x7f7c6413b550 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c009dc0 tx=0x7f7c5c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46ad068a785e12a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:12.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.160+0000 7f7c5bfff700 1 -- 172.21.15.26:0/1105992319 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c00e070 con 0x7f7c64139170 2023-10-01T07:56:12.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.161+0000 7f7c5bfff700 1 -- 172.21.15.26:0/1105992319 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5c00bae0 con 0x7f7c64139170 2023-10-01T07:56:12.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.161+0000 7f7c5bfff700 1 -- 172.21.15.26:0/1105992319 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c00be90 con 0x7f7c64139170 2023-10-01T07:56:12.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.161+0000 7f7c6b71e700 1 -- 172.21.15.26:0/1105992319 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7c64139170 msgr2=0x7f7c6413b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:12.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.161+0000 7f7c6b71e700 1 --2- 172.21.15.26:0/1105992319 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7c64139170 0x7f7c6413b550 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c009dc0 tx=0x7f7c5c00b330 comp rx=0 tx=0).stop 2023-10-01T07:56:12.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.161+0000 7f7c6b71e700 1 -- 172.21.15.26:0/1105992319 shutdown_connections 2023-10-01T07:56:12.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.161+0000 7f7c6b71e700 1 --2- 172.21.15.26:0/1105992319 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7c64139170 0x7f7c6413b550 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:12.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.161+0000 7f7c6b71e700 1 --2- 172.21.15.26:0/1105992319 >> v2:172.21.15.26:3300/0 conn(0x7f7c6409e1d0 0x7f7c64138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:12.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.161+0000 7f7c6b71e700 1 -- 172.21.15.26:0/1105992319 >> 172.21.15.26:0/1105992319 conn(0x7f7c64066f50 msgr2=0x7f7c6409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:12.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.161+0000 7f7c6b71e700 1 -- 172.21.15.26:0/1105992319 shutdown_connections 2023-10-01T07:56:12.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.161+0000 7f7c6b71e700 1 -- 172.21.15.26:0/1105992319 wait complete. 2023-10-01T07:56:12.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.163+0000 7f7c6b71e700 1 Processor -- start 2023-10-01T07:56:12.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.163+0000 7f7c6b71e700 1 -- start start 2023-10-01T07:56:12.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.164+0000 7f7c6b71e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7c6409d6f0 0x7f7c641c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:12.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.164+0000 7f7c6b71e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c6409e1d0 0x7f7c641c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:12.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.164+0000 7f7c6b71e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c64139170 0x7f7c6411e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:12.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.164+0000 7f7c6b71e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c64122110 con 0x7f7c64139170 2023-10-01T07:56:12.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.164+0000 7f7c6b71e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c64120400 con 0x7f7c6409e1d0 2023-10-01T07:56:12.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.164+0000 7f7c6b71e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c64121d70 con 0x7f7c6409d6f0 2023-10-01T07:56:12.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.164+0000 7f7c68cb9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c6409e1d0 0x7f7c641c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:12.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.164+0000 7f7c68cb9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c6409e1d0 0x7f7c641c8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:41286/0 (socket says 172.21.15.26:41286) 2023-10-01T07:56:12.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.164+0000 7f7c68cb9700 1 -- 172.21.15.26:0/3790738910 learned_addr learned my addr 172.21.15.26:0/3790738910 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:12.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.164+0000 7f7c69cbb700 1 --2- 172.21.15.26:0/3790738910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c64139170 0x7f7c6411e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:12.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.164+0000 7f7c69cbb700 1 -- 172.21.15.26:0/3790738910 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7c6409d6f0 msgr2=0x7f7c641c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:12.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.164+0000 7f7c69cbb700 1 --2- 172.21.15.26:0/3790738910 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7c6409d6f0 0x7f7c641c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:12.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.164+0000 7f7c69cbb700 1 -- 172.21.15.26:0/3790738910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c6409e1d0 msgr2=0x7f7c641c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:12.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.164+0000 7f7c69cbb700 1 --2- 172.21.15.26:0/3790738910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c6409e1d0 0x7f7c641c8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:12.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.164+0000 7f7c69cbb700 1 -- 172.21.15.26:0/3790738910 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5c009a70 con 0x7f7c64139170 2023-10-01T07:56:12.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.164+0000 7f7c68cb9700 1 --2- 172.21.15.26:0/3790738910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c6409e1d0 0x7f7c641c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:12.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.164+0000 7f7c69cbb700 1 --2- 172.21.15.26:0/3790738910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c64139170 0x7f7c6411e7f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c016000 tx=0x7f7c5c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:12.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.165+0000 7f7c59ffb700 1 -- 172.21.15.26:0/3790738910 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c004680 con 0x7f7c64139170 2023-10-01T07:56:12.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.165+0000 7f7c59ffb700 1 -- 172.21.15.26:0/3790738910 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5c020070 con 0x7f7c64139170 2023-10-01T07:56:12.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.165+0000 7f7c6b71e700 1 -- 172.21.15.26:0/3790738910 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c6409c710 con 0x7f7c64139170 2023-10-01T07:56:12.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.165+0000 7f7c59ffb700 1 -- 172.21.15.26:0/3790738910 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c027480 con 0x7f7c64139170 2023-10-01T07:56:12.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.165+0000 7f7c6b71e700 1 -- 172.21.15.26:0/3790738910 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c64122310 con 0x7f7c64139170 2023-10-01T07:56:12.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.166+0000 7f7c6b71e700 1 -- 172.21.15.26:0/3790738910 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c64074ea0 con 0x7f7c64139170 2023-10-01T07:56:12.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.167+0000 7f7c59ffb700 1 -- 172.21.15.26:0/3790738910 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7c5c0275e0 con 0x7f7c64139170 2023-10-01T07:56:12.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.167+0000 7f7c59ffb700 1 -- 172.21.15.26:0/3790738910 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7c5c022070 con 0x7f7c64139170 2023-10-01T07:56:12.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.172+0000 7f7c59ffb700 1 -- 172.21.15.26:0/3790738910 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7c5c02f750 con 0x7f7c64139170 2023-10-01T07:56:12.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.212+0000 7f13b9dc5700 1 -- 172.21.15.26:0/145116510 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f13b4074ea0 con 0x7f13b409e000 2023-10-01T07:56:12.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.212+0000 7f139bfff700 1 -- 172.21.15.26:0/145116510 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f13a802a090 con 0x7f13b409e000 2023-10-01T07:56:12.213 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:12.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.215+0000 7f13b9dc5700 1 -- 172.21.15.26:0/145116510 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13b409e000 msgr2=0x7f13b41a63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:12.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.215+0000 7f13b9dc5700 1 --2- 172.21.15.26:0/145116510 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13b409e000 0x7f13b41a63f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f13a800ec40 tx=0x7f13a800ef50 comp rx=0 tx=0).stop 2023-10-01T07:56:12.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.216+0000 7f13b9dc5700 1 -- 172.21.15.26:0/145116510 shutdown_connections 2023-10-01T07:56:12.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.216+0000 7f13b9dc5700 1 --2- 172.21.15.26:0/145116510 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13b409e410 0x7f13b41a6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:12.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.216+0000 7f13b9dc5700 1 --2- 172.21.15.26:0/145116510 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f13b409d6f0 0x7f13b41a5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:12.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.216+0000 7f13b9dc5700 1 --2- 172.21.15.26:0/145116510 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13b409e000 0x7f13b41a63f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:12.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.216+0000 7f13b9dc5700 1 -- 172.21.15.26:0/145116510 >> 172.21.15.26:0/145116510 conn(0x7f13b4066f50 msgr2=0x7f13b41badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:12.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.216+0000 7f13b9dc5700 1 -- 172.21.15.26:0/145116510 shutdown_connections 2023-10-01T07:56:12.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.216+0000 7f13b9dc5700 1 -- 172.21.15.26:0/145116510 wait complete. 2023-10-01T07:56:12.232 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:12.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.231+0000 7f32c4931700 1 Processor -- start 2023-10-01T07:56:12.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.231+0000 7f32c4931700 1 -- start start 2023-10-01T07:56:12.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.232+0000 7f32c4931700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f32c006b250 0x7f32c0136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:12.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.232+0000 7f32c4931700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f32c0136d80 0x7f32c0139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:12.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.232+0000 7f32c4931700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32c009ece0 con 0x7f32c006a770 2023-10-01T07:56:12.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.232+0000 7f32c4931700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32c006b640 con 0x7f32c0136d80 2023-10-01T07:56:12.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.232+0000 7f32c4931700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c009e760 con 0x7f32c006b250 2023-10-01T07:56:12.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.232+0000 7f32be59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f32c006a770 0x7f32c006ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57588/0 (socket says 172.21.15.26:57588) 2023-10-01T07:56:12.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.232+0000 7f32be59c700 1 -- 172.21.15.26:0/605920270 learned_addr learned my addr 172.21.15.26:0/605920270 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:12.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.232+0000 7f32bed9d700 1 --2- 172.21.15.26:0/605920270 >> v2:172.21.15.26:3300/0 conn(0x7f32c0136d80 0x7f32c0139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:12.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.232+0000 7f32bdd9b700 1 --2- 172.21.15.26:0/605920270 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f32c006b250 0x7f32c0136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:12.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.233+0000 7f32bd59a700 1 -- 172.21.15.26:0/605920270 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 218317792 0 0) 0x7f32c009ece0 con 0x7f32c006a770 2023-10-01T07:56:12.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.233+0000 7f32bd59a700 1 -- 172.21.15.26:0/605920270 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32a80035b0 con 0x7f32c006a770 2023-10-01T07:56:12.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.233+0000 7f32bed9d700 1 -- 172.21.15.26:0/605920270 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f32c006b250 msgr2=0x7f32c0136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:12.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.233+0000 7f32bed9d700 1 --2- 172.21.15.26:0/605920270 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f32c006b250 0x7f32c0136840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:12.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.233+0000 7f32bed9d700 1 -- 172.21.15.26:0/605920270 >> v1:172.21.15.26:6789/0 conn(0x7f32c006a770 legacy=0x7f32c006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:12.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.233+0000 7f32bed9d700 1 -- 172.21.15.26:0/605920270 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c009e040 con 0x7f32c0136d80 2023-10-01T07:56:12.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.233+0000 7f32bdd9b700 1 --2- 172.21.15.26:0/605920270 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f32c006b250 0x7f32c0136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:12.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.233+0000 7f32bed9d700 1 --2- 172.21.15.26:0/605920270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c0136d80 0x7f32c0139160 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f32b8009d90 tx=0x7f32b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14bfe0d12f8287ff server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:12.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.233+0000 7f32bd59a700 1 -- 172.21.15.26:0/605920270 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b800e070 con 0x7f32c0136d80 2023-10-01T07:56:12.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.233+0000 7f32bd59a700 1 -- 172.21.15.26:0/605920270 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b800bb20 con 0x7f32c0136d80 2023-10-01T07:56:12.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.233+0000 7f32bd59a700 1 -- 172.21.15.26:0/605920270 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b800be90 con 0x7f32c0136d80 2023-10-01T07:56:12.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.234+0000 7f32c4931700 1 -- 172.21.15.26:0/605920270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c0136d80 msgr2=0x7f32c0139160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:12.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.234+0000 7f32c4931700 1 --2- 172.21.15.26:0/605920270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c0136d80 0x7f32c0139160 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f32b8009d90 tx=0x7f32b800b330 comp rx=0 tx=0).stop 2023-10-01T07:56:12.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.234+0000 7f32c4931700 1 -- 172.21.15.26:0/605920270 shutdown_connections 2023-10-01T07:56:12.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.234+0000 7f32c4931700 1 --2- 172.21.15.26:0/605920270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c0136d80 0x7f32c0139160 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:12.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.234+0000 7f32c4931700 1 --2- 172.21.15.26:0/605920270 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f32c006b250 0x7f32c0136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:12.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.234+0000 7f32c4931700 1 -- 172.21.15.26:0/605920270 >> 172.21.15.26:0/605920270 conn(0x7f32c0066f50 msgr2=0x7f32c009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:12.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.234+0000 7f32c4931700 1 -- 172.21.15.26:0/605920270 shutdown_connections 2023-10-01T07:56:12.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.234+0000 7f32c4931700 1 -- 172.21.15.26:0/605920270 wait complete. 2023-10-01T07:56:12.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.236+0000 7f32c4931700 1 Processor -- start 2023-10-01T07:56:12.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.236+0000 7f32c4931700 1 -- start start 2023-10-01T07:56:12.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.237+0000 7f32c4931700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c006a770 0x7f32c01c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:12.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.237+0000 7f32c4931700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f32c006b250 0x7f32c01c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:12.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.237+0000 7f32c4931700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f32c0136d80 0x7f32c01c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:12.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.237+0000 7f32c4931700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c009bf30 con 0x7f32c006a770 2023-10-01T07:56:12.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.237+0000 7f32c4931700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c009c120 con 0x7f32c006b250 2023-10-01T07:56:12.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.237+0000 7f32c4931700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32c00711e0 con 0x7f32c0136d80 2023-10-01T07:56:12.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.237+0000 7f32be59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c006a770 0x7f32c01c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:12.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.237+0000 7f32bdd9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f32c006b250 0x7f32c01c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:12.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.237+0000 7f32bdd9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f32c006b250 0x7f32c01c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:41306/0 (socket says 172.21.15.26:41306) 2023-10-01T07:56:12.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.237+0000 7f32bdd9b700 1 -- 172.21.15.26:0/4197717408 learned_addr learned my addr 172.21.15.26:0/4197717408 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:12.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.237+0000 7f32bed9d700 1 --2- 172.21.15.26:0/4197717408 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f32c0136d80 0x7f32c01c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:12.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.237+0000 7f32bdd9b700 1 -- 172.21.15.26:0/4197717408 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f32c0136d80 msgr2=0x7f32c01c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:12.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.237+0000 7f32bdd9b700 1 --2- 172.21.15.26:0/4197717408 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f32c0136d80 0x7f32c01c8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:12.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.237+0000 7f32bdd9b700 1 -- 172.21.15.26:0/4197717408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c006a770 msgr2=0x7f32c01c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:12.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.237+0000 7f32bdd9b700 1 --2- 172.21.15.26:0/4197717408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c006a770 0x7f32c01c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:12.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.237+0000 7f32bdd9b700 1 -- 172.21.15.26:0/4197717408 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b40094a0 con 0x7f32c006b250 2023-10-01T07:56:12.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.237+0000 7f32be59c700 1 --2- 172.21.15.26:0/4197717408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c006a770 0x7f32c01c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:12.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.238+0000 7f32bdd9b700 1 --2- 172.21.15.26:0/4197717408 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f32c006b250 0x7f32c01c84d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f32b400ebe0 tx=0x7f32b400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:12.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.238+0000 7f32aeffd700 1 -- 172.21.15.26:0/4197717408 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b400c850 con 0x7f32c006b250 2023-10-01T07:56:12.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.238+0000 7f32aeffd700 1 -- 172.21.15.26:0/4197717408 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b400c9b0 con 0x7f32c006b250 2023-10-01T07:56:12.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.238+0000 7f32c4931700 1 -- 172.21.15.26:0/4197717408 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b8009a70 con 0x7f32c006b250 2023-10-01T07:56:12.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.238+0000 7f32aeffd700 1 -- 172.21.15.26:0/4197717408 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b400cd40 con 0x7f32c006b250 2023-10-01T07:56:12.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.238+0000 7f32c4931700 1 -- 172.21.15.26:0/4197717408 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c01227a0 con 0x7f32c006b250 2023-10-01T07:56:12.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.239+0000 7f32aeffd700 1 -- 172.21.15.26:0/4197717408 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f32b4013470 con 0x7f32c006b250 2023-10-01T07:56:12.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.239+0000 7f32aeffd700 1 -- 172.21.15.26:0/4197717408 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f32b403f7a0 con 0x7f32c006b250 2023-10-01T07:56:12.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.239+0000 7f32c4931700 1 -- 172.21.15.26:0/4197717408 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c0074ea0 con 0x7f32c006b250 2023-10-01T07:56:12.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.244+0000 7f32aeffd700 1 -- 172.21.15.26:0/4197717408 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f32b4013720 con 0x7f32c006b250 2023-10-01T07:56:12.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.342+0000 7f8adae9f700 1 -- 172.21.15.26:0/3077042365 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8ad4122ef0 con 0x7f8ad41341d0 2023-10-01T07:56:12.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.343+0000 7f8ad17fa700 1 -- 172.21.15.26:0/3077042365 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8acc01bb00 con 0x7f8ad41341d0 2023-10-01T07:56:12.343 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:12.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.345+0000 7f8adae9f700 1 -- 172.21.15.26:0/3077042365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ad41341d0 msgr2=0x7f8ad4120210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:12.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.345+0000 7f8adae9f700 1 --2- 172.21.15.26:0/3077042365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ad41341d0 0x7f8ad4120210 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8acc007e60 tx=0x7f8acc00e3c0 comp rx=0 tx=0).stop 2023-10-01T07:56:12.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.345+0000 7f8adae9f700 1 -- 172.21.15.26:0/3077042365 shutdown_connections 2023-10-01T07:56:12.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.345+0000 7f8adae9f700 1 --2- 172.21.15.26:0/3077042365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ad41341d0 0x7f8ad4120210 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:12.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.345+0000 7f8adae9f700 1 --2- 172.21.15.26:0/3077042365 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8ad409e390 0x7f8ad411f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:12.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.345+0000 7f8adae9f700 1 --2- 172.21.15.26:0/3077042365 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ad41338c0 0x7f8ad411fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:12.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.345+0000 7f8adae9f700 1 -- 172.21.15.26:0/3077042365 >> 172.21.15.26:0/3077042365 conn(0x7f8ad40a2aa0 msgr2=0x7f8ad40a0620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:12.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.345+0000 7f8adae9f700 1 -- 172.21.15.26:0/3077042365 shutdown_connections 2023-10-01T07:56:12.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.345+0000 7f8adae9f700 1 -- 172.21.15.26:0/3077042365 wait complete. 2023-10-01T07:56:12.360 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:12.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.384+0000 7f7c6b71e700 1 -- 172.21.15.26:0/3790738910 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7c6409f420 con 0x7f7c64139170 2023-10-01T07:56:12.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.384+0000 7f7c59ffb700 1 -- 172.21.15.26:0/3790738910 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7c5c02f390 con 0x7f7c64139170 2023-10-01T07:56:12.385 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:12.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.386+0000 7f7c6b71e700 1 -- 172.21.15.26:0/3790738910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c64139170 msgr2=0x7f7c6411e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:12.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.386+0000 7f7c6b71e700 1 --2- 172.21.15.26:0/3790738910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c64139170 0x7f7c6411e7f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c016000 tx=0x7f7c5c004ad0 comp rx=0 tx=0).stop 2023-10-01T07:56:12.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.387+0000 7f7c6b71e700 1 -- 172.21.15.26:0/3790738910 shutdown_connections 2023-10-01T07:56:12.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.387+0000 7f7c6b71e700 1 --2- 172.21.15.26:0/3790738910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c64139170 0x7f7c6411e7f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:12.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.387+0000 7f7c6b71e700 1 --2- 172.21.15.26:0/3790738910 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7c6409d6f0 0x7f7c641c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:12.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.387+0000 7f7c6b71e700 1 --2- 172.21.15.26:0/3790738910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c6409e1d0 0x7f7c641c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:12.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.387+0000 7f7c6b71e700 1 -- 172.21.15.26:0/3790738910 >> 172.21.15.26:0/3790738910 conn(0x7f7c64066f50 msgr2=0x7f7c640a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:12.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.387+0000 7f7c6b71e700 1 -- 172.21.15.26:0/3790738910 shutdown_connections 2023-10-01T07:56:12.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.387+0000 7f7c6b71e700 1 -- 172.21.15.26:0/3790738910 wait complete. 2023-10-01T07:56:12.401 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:12.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.451+0000 7f32c4931700 1 -- 172.21.15.26:0/4197717408 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f32c0071e60 con 0x7f32c006b250 2023-10-01T07:56:12.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.452+0000 7f32aeffd700 1 -- 172.21.15.26:0/4197717408 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f32b401b9c0 con 0x7f32c006b250 2023-10-01T07:56:12.452 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:12.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.454+0000 7f32c4931700 1 -- 172.21.15.26:0/4197717408 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f32c006b250 msgr2=0x7f32c01c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:12.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.454+0000 7f32c4931700 1 --2- 172.21.15.26:0/4197717408 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f32c006b250 0x7f32c01c84d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f32b400ebe0 tx=0x7f32b400eef0 comp rx=0 tx=0).stop 2023-10-01T07:56:12.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.454+0000 7f32c4931700 1 -- 172.21.15.26:0/4197717408 shutdown_connections 2023-10-01T07:56:12.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.454+0000 7f32c4931700 1 --2- 172.21.15.26:0/4197717408 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f32c0136d80 0x7f32c01c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:12.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.454+0000 7f32c4931700 1 --2- 172.21.15.26:0/4197717408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c006a770 0x7f32c01c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:12.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.454+0000 7f32c4931700 1 --2- 172.21.15.26:0/4197717408 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f32c006b250 0x7f32c01c84d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:12.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.454+0000 7f32c4931700 1 -- 172.21.15.26:0/4197717408 >> 172.21.15.26:0/4197717408 conn(0x7f32c0066f50 msgr2=0x7f32c006ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:12.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.454+0000 7f32c4931700 1 -- 172.21.15.26:0/4197717408 shutdown_connections 2023-10-01T07:56:12.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:12.454+0000 7f32c4931700 1 -- 172.21.15.26:0/4197717408 wait complete. 2023-10-01T07:56:12.468 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:13.232 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:13.361 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:13.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.380+0000 7fc0119d6700 1 Processor -- start 2023-10-01T07:56:13.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.380+0000 7fc0119d6700 1 -- start start 2023-10-01T07:56:13.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.381+0000 7fc0119d6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc00c136830 0x7fc00c138c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:13.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.381+0000 7fc0119d6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc00c139150 0x7fc00c13b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:13.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.381+0000 7fc0119d6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc00c06f720 con 0x7fc00c1338c0 2023-10-01T07:56:13.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.381+0000 7fc0119d6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc00c070c80 con 0x7fc00c139150 2023-10-01T07:56:13.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.381+0000 7fc0119d6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c06fce0 con 0x7fc00c136830 2023-10-01T07:56:13.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.381+0000 7fc00affd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc00c1338c0 0x7fc00c133c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57604/0 (socket says 172.21.15.26:57604) 2023-10-01T07:56:13.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.381+0000 7fc00affd700 1 -- 172.21.15.26:0/2265705539 learned_addr learned my addr 172.21.15.26:0/2265705539 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:13.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.381+0000 7fc00a7fc700 1 --2- 172.21.15.26:0/2265705539 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc00c136830 0x7fc00c138c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:13.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.381+0000 7fc00b7fe700 1 --2- 172.21.15.26:0/2265705539 >> v2:172.21.15.26:3300/0 conn(0x7fc00c139150 0x7fc00c13b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:13.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.381+0000 7fc009ffb700 1 -- 172.21.15.26:0/2265705539 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3149684184 0 0) 0x7fc00c06f720 con 0x7fc00c1338c0 2023-10-01T07:56:13.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.381+0000 7fc009ffb700 1 -- 172.21.15.26:0/2265705539 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbff40035b0 con 0x7fc00c1338c0 2023-10-01T07:56:13.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.381+0000 7fc00a7fc700 1 -- 172.21.15.26:0/2265705539 >> v2:172.21.15.26:3300/0 conn(0x7fc00c139150 msgr2=0x7fc00c13b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:13.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.381+0000 7fc00a7fc700 1 --2- 172.21.15.26:0/2265705539 >> v2:172.21.15.26:3300/0 conn(0x7fc00c139150 0x7fc00c13b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:13.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.381+0000 7fc00a7fc700 1 -- 172.21.15.26:0/2265705539 >> v1:172.21.15.26:6789/0 conn(0x7fc00c1338c0 legacy=0x7fc00c133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:13.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.381+0000 7fc00a7fc700 1 -- 172.21.15.26:0/2265705539 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc00c1336a0 con 0x7fc00c136830 2023-10-01T07:56:13.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.381+0000 7fc00b7fe700 1 --2- 172.21.15.26:0/2265705539 >> v2:172.21.15.26:3300/0 conn(0x7fc00c139150 0x7fc00c13b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:13.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.382+0000 7fc00a7fc700 1 --2- 172.21.15.26:0/2265705539 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc00c136830 0x7fc00c138c10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc000009840 tx=0x7fc000009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f058c4ec6671ba89 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:13.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.382+0000 7fc009ffb700 1 -- 172.21.15.26:0/2265705539 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc000011830 con 0x7fc00c136830 2023-10-01T07:56:13.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.382+0000 7fc009ffb700 1 -- 172.21.15.26:0/2265705539 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc000011990 con 0x7fc00c136830 2023-10-01T07:56:13.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.382+0000 7fc009ffb700 1 -- 172.21.15.26:0/2265705539 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc000011d20 con 0x7fc00c136830 2023-10-01T07:56:13.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.382+0000 7fc0119d6700 1 -- 172.21.15.26:0/2265705539 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc00c136830 msgr2=0x7fc00c138c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:13.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.382+0000 7fc0119d6700 1 --2- 172.21.15.26:0/2265705539 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc00c136830 0x7fc00c138c10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc000009840 tx=0x7fc000009b50 comp rx=0 tx=0).stop 2023-10-01T07:56:13.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.382+0000 7fc0119d6700 1 -- 172.21.15.26:0/2265705539 shutdown_connections 2023-10-01T07:56:13.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.383+0000 7fc0119d6700 1 --2- 172.21.15.26:0/2265705539 >> v2:172.21.15.26:3300/0 conn(0x7fc00c139150 0x7fc00c13b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:13.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.383+0000 7fc0119d6700 1 --2- 172.21.15.26:0/2265705539 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc00c136830 0x7fc00c138c10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:13.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.383+0000 7fc0119d6700 1 -- 172.21.15.26:0/2265705539 >> 172.21.15.26:0/2265705539 conn(0x7fc00c0a2aa0 msgr2=0x7fc00c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:13.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.383+0000 7fc0119d6700 1 -- 172.21.15.26:0/2265705539 shutdown_connections 2023-10-01T07:56:13.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.383+0000 7fc0119d6700 1 -- 172.21.15.26:0/2265705539 wait complete. 2023-10-01T07:56:13.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.384+0000 7fc0119d6700 1 Processor -- start 2023-10-01T07:56:13.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.384+0000 7fc0119d6700 1 -- start start 2023-10-01T07:56:13.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.384+0000 7fc0119d6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc00c1338c0 0x7fc00c119c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:13.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.384+0000 7fc0119d6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc00c136830 0x7fc00c11a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:13.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.384+0000 7fc0119d6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc00c139150 0x7fc00c11a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:13.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.384+0000 7fc0119d6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c11d180 con 0x7fc00c1338c0 2023-10-01T07:56:13.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.384+0000 7fc0119d6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c130050 con 0x7fc00c139150 2023-10-01T07:56:13.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.384+0000 7fc0119d6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c12fad0 con 0x7fc00c136830 2023-10-01T07:56:13.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.384+0000 7fc00affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc00c1338c0 0x7fc00c119c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:13.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.384+0000 7fc00affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc00c1338c0 0x7fc00c119c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45082/0 (socket says 172.21.15.26:45082) 2023-10-01T07:56:13.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.384+0000 7fc00affd700 1 -- 172.21.15.26:0/609790390 learned_addr learned my addr 172.21.15.26:0/609790390 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:13.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.384+0000 7fc00b7fe700 1 --2- 172.21.15.26:0/609790390 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc00c139150 0x7fc00c11a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:13.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.384+0000 7fc00a7fc700 1 --2- 172.21.15.26:0/609790390 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc00c136830 0x7fc00c11a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:13.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.385+0000 7fc00affd700 1 -- 172.21.15.26:0/609790390 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc00c136830 msgr2=0x7fc00c11a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:13.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.385+0000 7fc00affd700 1 --2- 172.21.15.26:0/609790390 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc00c136830 0x7fc00c11a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:13.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.385+0000 7fc00affd700 1 -- 172.21.15.26:0/609790390 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc00c139150 msgr2=0x7fc00c11a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:13.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.385+0000 7fc00affd700 1 --2- 172.21.15.26:0/609790390 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc00c139150 0x7fc00c11a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:13.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.385+0000 7fc00affd700 1 -- 172.21.15.26:0/609790390 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbffc009a70 con 0x7fc00c1338c0 2023-10-01T07:56:13.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.385+0000 7fc00b7fe700 1 --2- 172.21.15.26:0/609790390 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc00c139150 0x7fc00c11a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:13.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.385+0000 7fc00a7fc700 1 --2- 172.21.15.26:0/609790390 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc00c136830 0x7fc00c11a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:13.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.385+0000 7fc00affd700 1 --2- 172.21.15.26:0/609790390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc00c1338c0 0x7fc00c119c00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc00400c700 tx=0x7fc00400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:13.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.385+0000 7fbff3fff700 1 -- 172.21.15.26:0/609790390 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc004005d70 con 0x7fc00c1338c0 2023-10-01T07:56:13.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.385+0000 7fbff3fff700 1 -- 172.21.15.26:0/609790390 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0040070d0 con 0x7fc00c1338c0 2023-10-01T07:56:13.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.385+0000 7fc0119d6700 1 -- 172.21.15.26:0/609790390 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0000094a0 con 0x7fc00c1338c0 2023-10-01T07:56:13.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.385+0000 7fbff3fff700 1 -- 172.21.15.26:0/609790390 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc004007460 con 0x7fc00c1338c0 2023-10-01T07:56:13.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.385+0000 7fc0119d6700 1 -- 172.21.15.26:0/609790390 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc00c11deb0 con 0x7fc00c1338c0 2023-10-01T07:56:13.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.386+0000 7fbff3fff700 1 -- 172.21.15.26:0/609790390 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc0040075c0 con 0x7fc00c1338c0 2023-10-01T07:56:13.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.386+0000 7fbff3fff700 1 -- 172.21.15.26:0/609790390 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc00403eb40 con 0x7fc00c1338c0 2023-10-01T07:56:13.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.386+0000 7fc0119d6700 1 -- 172.21.15.26:0/609790390 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc00c074ea0 con 0x7fc00c1338c0 2023-10-01T07:56:13.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.393+0000 7fbff3fff700 1 -- 172.21.15.26:0/609790390 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc004018260 con 0x7fc00c1338c0 2023-10-01T07:56:13.401 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:13.469 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:13.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.512+0000 7f8fd596a700 1 Processor -- start 2023-10-01T07:56:13.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.513+0000 7f8fd596a700 1 -- start start 2023-10-01T07:56:13.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.513+0000 7f8fd596a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fd0136830 0x7f8fd0138c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:13.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.513+0000 7f8fd596a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8fd0139150 0x7f8fd013b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:13.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.513+0000 7f8fd596a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd006f720 con 0x7f8fd01338c0 2023-10-01T07:56:13.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.513+0000 7f8fd596a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd0070c80 con 0x7f8fd0139150 2023-10-01T07:56:13.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.513+0000 7f8fd596a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd006fce0 con 0x7f8fd0136830 2023-10-01T07:56:13.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.514+0000 7f8fce7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fd0136830 0x7f8fd0138c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:13.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.514+0000 7f8fce7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fd0136830 0x7f8fd0138c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:36652/0 (socket says 172.21.15.26:36652) 2023-10-01T07:56:13.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.514+0000 7f8fce7fc700 1 -- 172.21.15.26:0/961349949 learned_addr learned my addr 172.21.15.26:0/961349949 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:13.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.514+0000 7f8fcf7fe700 1 --2- 172.21.15.26:0/961349949 >> v2:172.21.15.26:3300/0 conn(0x7f8fd0139150 0x7f8fd013b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:13.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.514+0000 7f8fce7fc700 1 -- 172.21.15.26:0/961349949 >> v2:172.21.15.26:3300/0 conn(0x7f8fd0139150 msgr2=0x7f8fd013b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:13.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.514+0000 7f8fce7fc700 1 --2- 172.21.15.26:0/961349949 >> v2:172.21.15.26:3300/0 conn(0x7f8fd0139150 0x7f8fd013b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:13.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.514+0000 7f8fce7fc700 1 -- 172.21.15.26:0/961349949 >> v1:172.21.15.26:6789/0 conn(0x7f8fd01338c0 legacy=0x7f8fd0133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:13.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.514+0000 7f8fce7fc700 1 -- 172.21.15.26:0/961349949 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd01336a0 con 0x7f8fd0136830 2023-10-01T07:56:13.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.514+0000 7f8fce7fc700 1 --2- 172.21.15.26:0/961349949 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fd0136830 0x7f8fd0138c10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8fc40098f0 tx=0x7f8fc4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d888913e79d3bba server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:13.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.515+0000 7f8fcdffb700 1 -- 172.21.15.26:0/961349949 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4011830 con 0x7f8fd0136830 2023-10-01T07:56:13.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.515+0000 7f8fcdffb700 1 -- 172.21.15.26:0/961349949 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc4011990 con 0x7f8fd0136830 2023-10-01T07:56:13.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.515+0000 7f8fcdffb700 1 -- 172.21.15.26:0/961349949 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4011d20 con 0x7f8fd0136830 2023-10-01T07:56:13.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.516+0000 7f8fd596a700 1 -- 172.21.15.26:0/961349949 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fd0136830 msgr2=0x7f8fd0138c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:13.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.516+0000 7f8fd596a700 1 --2- 172.21.15.26:0/961349949 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fd0136830 0x7f8fd0138c10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8fc40098f0 tx=0x7f8fc4009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:13.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.516+0000 7f8fd596a700 1 -- 172.21.15.26:0/961349949 shutdown_connections 2023-10-01T07:56:13.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.516+0000 7f8fd596a700 1 --2- 172.21.15.26:0/961349949 >> v2:172.21.15.26:3300/0 conn(0x7f8fd0139150 0x7f8fd013b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:13.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.516+0000 7f8fd596a700 1 --2- 172.21.15.26:0/961349949 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fd0136830 0x7f8fd0138c10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:13.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.516+0000 7f8fd596a700 1 -- 172.21.15.26:0/961349949 >> 172.21.15.26:0/961349949 conn(0x7f8fd00a2aa0 msgr2=0x7f8fd00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:13.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.516+0000 7f8fd596a700 1 -- 172.21.15.26:0/961349949 shutdown_connections 2023-10-01T07:56:13.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.516+0000 7f8fd596a700 1 -- 172.21.15.26:0/961349949 wait complete. 2023-10-01T07:56:13.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.517+0000 7f8fd596a700 1 Processor -- start 2023-10-01T07:56:13.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.518+0000 7f8fd596a700 1 -- start start 2023-10-01T07:56:13.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.518+0000 7f8fd596a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8fd01338c0 0x7f8fd0118f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:13.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.518+0000 7f8fd596a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fd0136830 0x7f8fd0119470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:13.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.518+0000 7f8fd596a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fd0139150 0x7f8fd01199b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:13.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.518+0000 7f8fd596a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd011aef0 con 0x7f8fd01338c0 2023-10-01T07:56:13.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.518+0000 7f8fd596a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd011c530 con 0x7f8fd0136830 2023-10-01T07:56:13.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.518+0000 7f8fd596a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd01361a0 con 0x7f8fd0139150 2023-10-01T07:56:13.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.519+0000 7f8fceffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8fd01338c0 0x7f8fd0118f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:13.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.519+0000 7f8fceffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8fd01338c0 0x7f8fd0118f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60594/0 (socket says 172.21.15.26:60594) 2023-10-01T07:56:13.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.519+0000 7f8fceffd700 1 -- 172.21.15.26:0/2578523214 learned_addr learned my addr 172.21.15.26:0/2578523214 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:13.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.519+0000 7f8fce7fc700 1 --2- 172.21.15.26:0/2578523214 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fd0136830 0x7f8fd0119470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:13.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.519+0000 7f8fcf7fe700 1 --2- 172.21.15.26:0/2578523214 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fd0139150 0x7f8fd01199b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:13.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.519+0000 7f8fcf7fe700 1 -- 172.21.15.26:0/2578523214 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fd0136830 msgr2=0x7f8fd0119470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:13.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.519+0000 7f8fcf7fe700 1 --2- 172.21.15.26:0/2578523214 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fd0136830 0x7f8fd0119470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:13.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.519+0000 7f8fcf7fe700 1 -- 172.21.15.26:0/2578523214 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8fd01338c0 msgr2=0x7f8fd0118f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:13.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.519+0000 7f8fcf7fe700 1 --2- 172.21.15.26:0/2578523214 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8fd01338c0 0x7f8fd0118f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:13.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.519+0000 7f8fcf7fe700 1 -- 172.21.15.26:0/2578523214 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc4009550 con 0x7f8fd0139150 2023-10-01T07:56:13.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.519+0000 7f8fceffd700 1 --2- 172.21.15.26:0/2578523214 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8fd01338c0 0x7f8fd0118f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:13.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.519+0000 7f8fcf7fe700 1 --2- 172.21.15.26:0/2578523214 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fd0139150 0x7f8fd01199b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8fd006eb30 tx=0x7f8fc800ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:13.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.520+0000 7f8fb7fff700 1 -- 172.21.15.26:0/2578523214 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc800cc20 con 0x7f8fd0139150 2023-10-01T07:56:13.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.520+0000 7f8fb7fff700 1 -- 172.21.15.26:0/2578523214 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc800f040 con 0x7f8fd0139150 2023-10-01T07:56:13.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.520+0000 7f8fd596a700 1 -- 172.21.15.26:0/2578523214 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd011aa30 con 0x7f8fd0139150 2023-10-01T07:56:13.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.520+0000 7f8fb7fff700 1 -- 172.21.15.26:0/2578523214 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc8009e60 con 0x7f8fd0139150 2023-10-01T07:56:13.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.520+0000 7f8fd596a700 1 -- 172.21.15.26:0/2578523214 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd012ebe0 con 0x7f8fd0139150 2023-10-01T07:56:13.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.521+0000 7f8fd596a700 1 -- 172.21.15.26:0/2578523214 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd011c370 con 0x7f8fd0139150 2023-10-01T07:56:13.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.521+0000 7f8fb7fff700 1 -- 172.21.15.26:0/2578523214 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8fc8014480 con 0x7f8fd0139150 2023-10-01T07:56:13.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.522+0000 7f8fb7fff700 1 -- 172.21.15.26:0/2578523214 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8fc80401f0 con 0x7f8fd0139150 2023-10-01T07:56:13.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.531+0000 7f8fb7fff700 1 -- 172.21.15.26:0/2578523214 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8fc8007920 con 0x7f8fd0139150 2023-10-01T07:56:13.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.559+0000 7f1bce40b700 1 Processor -- start 2023-10-01T07:56:13.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.559+0000 7f1bce40b700 1 -- start start 2023-10-01T07:56:13.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.560+0000 7f1bce40b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1bc809e930 0x7f1bc809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:13.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.560+0000 7f1bce40b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1bc809f240 0x7f1bc81317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:13.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.560+0000 7f1bce40b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1bc809f650 0x7f1bc8131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:13.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.560+0000 7f1bce40b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc8070940 con 0x7f1bc809e930 2023-10-01T07:56:13.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.560+0000 7f1bce40b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc806fd60 con 0x7f1bc809f240 2023-10-01T07:56:13.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.560+0000 7f1bce40b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc806fa80 con 0x7f1bc809f650 2023-10-01T07:56:13.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.560+0000 7f1bc7fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1bc809e930 0x7f1bc809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:13.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.560+0000 7f1bcc9a8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1bc809f650 0x7f1bc8131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:13.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.560+0000 7f1bc77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1bc809f240 0x7f1bc81317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:13.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.560+0000 7f1bc7fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1bc809e930 0x7f1bc809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60610/0 (socket says 172.21.15.26:60610) 2023-10-01T07:56:13.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.560+0000 7f1bcc9a8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1bc809f650 0x7f1bc8131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:60240/0 (socket says 172.21.15.26:60240) 2023-10-01T07:56:13.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.560+0000 7f1bc7fff700 1 -- 172.21.15.26:0/590146499 learned_addr learned my addr 172.21.15.26:0/590146499 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:13.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.560+0000 7f1bc77fe700 1 -- 172.21.15.26:0/590146499 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1bc809f650 msgr2=0x7f1bc8131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:13.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.560+0000 7f1bc77fe700 1 --2- 172.21.15.26:0/590146499 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1bc809f650 0x7f1bc8131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:13.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.560+0000 7f1bc77fe700 1 -- 172.21.15.26:0/590146499 >> v2:172.21.15.26:3300/0 conn(0x7f1bc809e930 msgr2=0x7f1bc809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:13.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.560+0000 7f1bc77fe700 1 --2- 172.21.15.26:0/590146499 >> v2:172.21.15.26:3300/0 conn(0x7f1bc809e930 0x7f1bc809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:13.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.560+0000 7f1bc77fe700 1 -- 172.21.15.26:0/590146499 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc809fb60 con 0x7f1bc809f240 2023-10-01T07:56:13.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.561+0000 7f1bc77fe700 1 --2- 172.21.15.26:0/590146499 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1bc809f240 0x7f1bc81317f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc013150 tx=0x7f1bbc013460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89ab7e668d4355e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:13.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.561+0000 7f1bc6ffd700 1 -- 172.21.15.26:0/590146499 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc016070 con 0x7f1bc809f240 2023-10-01T07:56:13.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.561+0000 7f1bc6ffd700 1 -- 172.21.15.26:0/590146499 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bbc013d10 con 0x7f1bc809f240 2023-10-01T07:56:13.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.561+0000 7f1bc6ffd700 1 -- 172.21.15.26:0/590146499 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc0112f0 con 0x7f1bc809f240 2023-10-01T07:56:13.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.562+0000 7f1bce40b700 1 -- 172.21.15.26:0/590146499 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1bc809f240 msgr2=0x7f1bc81317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:13.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.562+0000 7f1bce40b700 1 --2- 172.21.15.26:0/590146499 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1bc809f240 0x7f1bc81317f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc013150 tx=0x7f1bbc013460 comp rx=0 tx=0).stop 2023-10-01T07:56:13.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.562+0000 7f1bce40b700 1 -- 172.21.15.26:0/590146499 shutdown_connections 2023-10-01T07:56:13.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.562+0000 7f1bce40b700 1 --2- 172.21.15.26:0/590146499 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1bc809f650 0x7f1bc8131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:13.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.562+0000 7f1bce40b700 1 --2- 172.21.15.26:0/590146499 >> v2:172.21.15.26:3300/0 conn(0x7f1bc809e930 0x7f1bc809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:13.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.562+0000 7f1bce40b700 1 --2- 172.21.15.26:0/590146499 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1bc809f240 0x7f1bc81317f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:13.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.562+0000 7f1bce40b700 1 -- 172.21.15.26:0/590146499 >> 172.21.15.26:0/590146499 conn(0x7f1bc80a4210 msgr2=0x7f1bc80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:13.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.562+0000 7f1bce40b700 1 -- 172.21.15.26:0/590146499 shutdown_connections 2023-10-01T07:56:13.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.562+0000 7f1bce40b700 1 -- 172.21.15.26:0/590146499 wait complete. 2023-10-01T07:56:13.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.563+0000 7f1bce40b700 1 Processor -- start 2023-10-01T07:56:13.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.563+0000 7f1bce40b700 1 -- start start 2023-10-01T07:56:13.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.563+0000 7f1bce40b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1bc809e930 0x7f1bc81c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:13.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.563+0000 7f1bce40b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1bc809f240 0x7f1bc81c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:13.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.563+0000 7f1bce40b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bc809f650 0x7f1bc81c4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:13.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.563+0000 7f1bce40b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc81a46c0 con 0x7f1bc809f650 2023-10-01T07:56:13.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.564+0000 7f1bce40b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc81a4f20 con 0x7f1bc809e930 2023-10-01T07:56:13.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.564+0000 7f1bce40b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc81a3650 con 0x7f1bc809f240 2023-10-01T07:56:13.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.564+0000 7f1bc77fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1bc809f240 0x7f1bc81c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:13.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.564+0000 7f1bc7fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1bc809e930 0x7f1bc81c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:13.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.564+0000 7f1bc77fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1bc809f240 0x7f1bc81c41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:60250/0 (socket says 172.21.15.26:60250) 2023-10-01T07:56:13.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.564+0000 7f1bc77fe700 1 -- 172.21.15.26:0/4263901642 learned_addr learned my addr 172.21.15.26:0/4263901642 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:13.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.564+0000 7f1bc7fff700 1 -- 172.21.15.26:0/4263901642 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1bc809f240 msgr2=0x7f1bc81c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:13.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.564+0000 7f1bc7fff700 1 --2- 172.21.15.26:0/4263901642 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1bc809f240 0x7f1bc81c41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:13.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.564+0000 7f1bc7fff700 1 -- 172.21.15.26:0/4263901642 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bc809f650 msgr2=0x7f1bc81c4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:13.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.564+0000 7f1bc7fff700 1 --2- 172.21.15.26:0/4263901642 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bc809f650 0x7f1bc81c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:13.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.564+0000 7f1bc7fff700 1 -- 172.21.15.26:0/4263901642 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bbc011d40 con 0x7f1bc809e930 2023-10-01T07:56:13.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.564+0000 7f1bc77fe700 1 --2- 172.21.15.26:0/4263901642 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1bc809f240 0x7f1bc81c41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:13.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.564+0000 7f1bc7fff700 1 --2- 172.21.15.26:0/4263901642 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1bc809e930 0x7f1bc81c3cb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80087a0 tx=0x7f1bb8008ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:13.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.565+0000 7f1bc4ff9700 1 -- 172.21.15.26:0/4263901642 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8012670 con 0x7f1bc809e930 2023-10-01T07:56:13.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.565+0000 7f1bc4ff9700 1 -- 172.21.15.26:0/4263901642 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb80127d0 con 0x7f1bc809e930 2023-10-01T07:56:13.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.565+0000 7f1bc4ff9700 1 -- 172.21.15.26:0/4263901642 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8012b80 con 0x7f1bc809e930 2023-10-01T07:56:13.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.565+0000 7f1bce40b700 1 -- 172.21.15.26:0/4263901642 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc80a0190 con 0x7f1bc809e930 2023-10-01T07:56:13.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.565+0000 7f1bce40b700 1 -- 172.21.15.26:0/4263901642 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc81a5c50 con 0x7f1bc809e930 2023-10-01T07:56:13.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.566+0000 7f1bc4ff9700 1 -- 172.21.15.26:0/4263901642 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1bb8012ce0 con 0x7f1bc809e930 2023-10-01T07:56:13.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.566+0000 7f1bce40b700 1 -- 172.21.15.26:0/4263901642 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc8074ea0 con 0x7f1bc809e930 2023-10-01T07:56:13.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.566+0000 7f1bc4ff9700 1 -- 172.21.15.26:0/4263901642 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1bb803ed20 con 0x7f1bc809e930 2023-10-01T07:56:13.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.576+0000 7f1bc4ff9700 1 -- 172.21.15.26:0/4263901642 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1bb801c2c0 con 0x7f1bc809e930 2023-10-01T07:56:13.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.618+0000 7fbd35b7c700 1 Processor -- start 2023-10-01T07:56:13.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.618+0000 7fbd35b7c700 1 -- start start 2023-10-01T07:56:13.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.619+0000 7fbd35b7c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd300a1510 0x7fbd30138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:13.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.619+0000 7fbd35b7c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd30139250 0x7fbd3013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:13.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.619+0000 7fbd35b7c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd3009edd0 con 0x7fbd300a0a30 2023-10-01T07:56:13.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.619+0000 7fbd35b7c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd300a18e0 con 0x7fbd30139250 2023-10-01T07:56:13.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.619+0000 7fbd35b7c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3009e1f0 con 0x7fbd300a1510 2023-10-01T07:56:13.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.619+0000 7fbd2f7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbd300a0a30 0x7fbd300a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54694/0 (socket says 172.21.15.26:54694) 2023-10-01T07:56:13.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.619+0000 7fbd2effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd300a1510 0x7fbd30138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:13.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.619+0000 7fbd2f7fe700 1 -- 172.21.15.26:0/2256353742 learned_addr learned my addr 172.21.15.26:0/2256353742 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:13.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.619+0000 7fbd2ffff700 1 --2- 172.21.15.26:0/2256353742 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd30139250 0x7fbd3013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:13.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.619+0000 7fbd2ffff700 1 -- 172.21.15.26:0/2256353742 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd300a1510 msgr2=0x7fbd30138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:13.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.619+0000 7fbd2ffff700 1 --2- 172.21.15.26:0/2256353742 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd300a1510 0x7fbd30138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:13.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.619+0000 7fbd2ffff700 1 -- 172.21.15.26:0/2256353742 >> v1:172.21.15.26:6789/0 conn(0x7fbd300a0a30 legacy=0x7fbd300a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:13.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.619+0000 7fbd2e7fc700 1 -- 172.21.15.26:0/2256353742 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4096657822 0 0) 0x7fbd3009edd0 con 0x7fbd300a0a30 2023-10-01T07:56:13.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.620+0000 7fbd2ffff700 1 -- 172.21.15.26:0/2256353742 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd3009dc50 con 0x7fbd30139250 2023-10-01T07:56:13.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.620+0000 7fbd2effd700 1 --2- 172.21.15.26:0/2256353742 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd300a1510 0x7fbd30138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:56:13.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.620+0000 7fbd2ffff700 1 --2- 172.21.15.26:0/2256353742 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd30139250 0x7fbd3013b630 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbd28009dc0 tx=0x7fbd2800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af76bcaf7ae31a67 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:13.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.620+0000 7fbd2e7fc700 1 -- 172.21.15.26:0/2256353742 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2800e070 con 0x7fbd30139250 2023-10-01T07:56:13.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.620+0000 7fbd2e7fc700 1 -- 172.21.15.26:0/2256353742 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd2800bbd0 con 0x7fbd30139250 2023-10-01T07:56:13.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.620+0000 7fbd2e7fc700 1 -- 172.21.15.26:0/2256353742 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd28012430 con 0x7fbd30139250 2023-10-01T07:56:13.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.620+0000 7fc0119d6700 1 -- 172.21.15.26:0/609790390 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc00c06b9e0 con 0x7fc00c1338c0 2023-10-01T07:56:13.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.621+0000 7fbff3fff700 1 -- 172.21.15.26:0/609790390 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc004017020 con 0x7fc00c1338c0 2023-10-01T07:56:13.623 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:13.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.621+0000 7fbd35b7c700 1 -- 172.21.15.26:0/2256353742 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd30139250 msgr2=0x7fbd3013b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:13.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.621+0000 7fbd35b7c700 1 --2- 172.21.15.26:0/2256353742 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd30139250 0x7fbd3013b630 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbd28009dc0 tx=0x7fbd2800b330 comp rx=0 tx=0).stop 2023-10-01T07:56:13.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.621+0000 7fbd35b7c700 1 -- 172.21.15.26:0/2256353742 shutdown_connections 2023-10-01T07:56:13.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.621+0000 7fbd35b7c700 1 --2- 172.21.15.26:0/2256353742 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd30139250 0x7fbd3013b630 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:13.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.621+0000 7fbd35b7c700 1 --2- 172.21.15.26:0/2256353742 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd300a1510 0x7fbd30138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:13.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.621+0000 7fbd35b7c700 1 -- 172.21.15.26:0/2256353742 >> 172.21.15.26:0/2256353742 conn(0x7fbd300a6550 msgr2=0x7fbd300a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:13.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.621+0000 7fbd35b7c700 1 -- 172.21.15.26:0/2256353742 shutdown_connections 2023-10-01T07:56:13.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.621+0000 7fbd35b7c700 1 -- 172.21.15.26:0/2256353742 wait complete. 2023-10-01T07:56:13.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.622+0000 7fbd35b7c700 1 Processor -- start 2023-10-01T07:56:13.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.622+0000 7fbd35b7c700 1 -- start start 2023-10-01T07:56:13.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.623+0000 7fbd35b7c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd300a0a30 0x7fbd3011e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:13.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.623+0000 7fbd35b7c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd300a1510 0x7fbd3011eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:13.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.623+0000 7fbd35b7c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd30139250 0x7fbd3011f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:13.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.623+0000 7fbd35b7c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd30122040 con 0x7fbd30139250 2023-10-01T07:56:13.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.623+0000 7fbd35b7c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd301206e0 con 0x7fbd300a0a30 2023-10-01T07:56:13.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.623+0000 7fbd35b7c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd300a0220 con 0x7fbd300a1510 2023-10-01T07:56:13.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.623+0000 7fbd2f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd300a0a30 0x7fbd3011e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:13.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.623+0000 7fbd2f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd300a0a30 0x7fbd3011e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:36694/0 (socket says 172.21.15.26:36694) 2023-10-01T07:56:13.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.623+0000 7fbd2f7fe700 1 -- 172.21.15.26:0/3551563550 learned_addr learned my addr 172.21.15.26:0/3551563550 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:13.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.623+0000 7fbd2ffff700 1 --2- 172.21.15.26:0/3551563550 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd30139250 0x7fbd3011f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:13.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.623+0000 7fbd2effd700 1 --2- 172.21.15.26:0/3551563550 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd300a1510 0x7fbd3011eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:13.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.623+0000 7fc0119d6700 1 -- 172.21.15.26:0/609790390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc00c1338c0 msgr2=0x7fc00c119c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:13.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.623+0000 7fc0119d6700 1 --2- 172.21.15.26:0/609790390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc00c1338c0 0x7fc00c119c00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc00400c700 tx=0x7fc00400ca10 comp rx=0 tx=0).stop 2023-10-01T07:56:13.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.624+0000 7fc0119d6700 1 -- 172.21.15.26:0/609790390 shutdown_connections 2023-10-01T07:56:13.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.624+0000 7fc0119d6700 1 --2- 172.21.15.26:0/609790390 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc00c139150 0x7fc00c11a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:13.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.624+0000 7fc0119d6700 1 --2- 172.21.15.26:0/609790390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc00c1338c0 0x7fc00c119c00 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:13.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.624+0000 7fc0119d6700 1 --2- 172.21.15.26:0/609790390 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc00c136830 0x7fc00c11a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:13.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.624+0000 7fc0119d6700 1 -- 172.21.15.26:0/609790390 >> 172.21.15.26:0/609790390 conn(0x7fc00c0a2aa0 msgr2=0x7fc00c09de50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:13.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.624+0000 7fc0119d6700 1 -- 172.21.15.26:0/609790390 shutdown_connections 2023-10-01T07:56:13.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.624+0000 7fc0119d6700 1 -- 172.21.15.26:0/609790390 wait complete. 2023-10-01T07:56:13.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.623+0000 7fbd2f7fe700 1 -- 172.21.15.26:0/3551563550 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd300a1510 msgr2=0x7fbd3011eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:13.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.623+0000 7fbd2f7fe700 1 --2- 172.21.15.26:0/3551563550 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd300a1510 0x7fbd3011eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:13.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.623+0000 7fbd2f7fe700 1 -- 172.21.15.26:0/3551563550 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd30139250 msgr2=0x7fbd3011f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:13.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.623+0000 7fbd2f7fe700 1 --2- 172.21.15.26:0/3551563550 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd30139250 0x7fbd3011f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:13.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.624+0000 7fbd2f7fe700 1 -- 172.21.15.26:0/3551563550 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd28009a70 con 0x7fbd300a0a30 2023-10-01T07:56:13.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.624+0000 7fbd2f7fe700 1 --2- 172.21.15.26:0/3551563550 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd300a0a30 0x7fbd3011e5a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000c520 tx=0x7fbd2000c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:13.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.624+0000 7fbd17fff700 1 -- 172.21.15.26:0/3551563550 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd20004c80 con 0x7fbd300a0a30 2023-10-01T07:56:13.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.624+0000 7fbd17fff700 1 -- 172.21.15.26:0/3551563550 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd20004e00 con 0x7fbd300a0a30 2023-10-01T07:56:13.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.624+0000 7fbd35b7c700 1 -- 172.21.15.26:0/3551563550 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd3009ca50 con 0x7fbd300a0a30 2023-10-01T07:56:13.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.624+0000 7fbd35b7c700 1 -- 172.21.15.26:0/3551563550 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd301227d0 con 0x7fbd300a0a30 2023-10-01T07:56:13.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.625+0000 7fbd17fff700 1 -- 172.21.15.26:0/3551563550 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd20007310 con 0x7fbd300a0a30 2023-10-01T07:56:13.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.625+0000 7fbd17fff700 1 -- 172.21.15.26:0/3551563550 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbd20007470 con 0x7fbd300a0a30 2023-10-01T07:56:13.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.625+0000 7fbd17fff700 1 -- 172.21.15.26:0/3551563550 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbd2003f450 con 0x7fbd300a0a30 2023-10-01T07:56:13.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.626+0000 7fbd35b7c700 1 -- 172.21.15.26:0/3551563550 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd100052e0 con 0x7fbd300a0a30 2023-10-01T07:56:13.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.635+0000 7fbd17fff700 1 -- 172.21.15.26:0/3551563550 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbd200123b0 con 0x7fbd300a0a30 2023-10-01T07:56:13.640 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:13.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.748+0000 7f8fd596a700 1 -- 172.21.15.26:0/2578523214 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8fd011c1a0 con 0x7f8fd0139150 2023-10-01T07:56:13.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.749+0000 7f8fb7fff700 1 -- 172.21.15.26:0/2578523214 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8fc8007330 con 0x7f8fd0139150 2023-10-01T07:56:13.749 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:13.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.752+0000 7f8fd596a700 1 -- 172.21.15.26:0/2578523214 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fd0139150 msgr2=0x7f8fd01199b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:13.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.752+0000 7f8fd596a700 1 --2- 172.21.15.26:0/2578523214 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fd0139150 0x7f8fd01199b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8fd006eb30 tx=0x7f8fc800ef90 comp rx=0 tx=0).stop 2023-10-01T07:56:13.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.752+0000 7f8fd596a700 1 -- 172.21.15.26:0/2578523214 shutdown_connections 2023-10-01T07:56:13.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.752+0000 7f8fd596a700 1 --2- 172.21.15.26:0/2578523214 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fd0139150 0x7f8fd01199b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:13.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.752+0000 7f8fd596a700 1 --2- 172.21.15.26:0/2578523214 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8fd01338c0 0x7f8fd0118f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:13.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.752+0000 7f8fd596a700 1 --2- 172.21.15.26:0/2578523214 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fd0136830 0x7f8fd0119470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:13.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.752+0000 7f8fd596a700 1 -- 172.21.15.26:0/2578523214 >> 172.21.15.26:0/2578523214 conn(0x7f8fd00a2aa0 msgr2=0x7f8fd012f040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:13.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.752+0000 7f8fd596a700 1 -- 172.21.15.26:0/2578523214 shutdown_connections 2023-10-01T07:56:13.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.752+0000 7f8fd596a700 1 -- 172.21.15.26:0/2578523214 wait complete. 2023-10-01T07:56:13.767 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:13.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.786+0000 7f1bce40b700 1 -- 172.21.15.26:0/4263901642 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1bc809ffe0 con 0x7f1bc809e930 2023-10-01T07:56:13.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.787+0000 7f1bc4ff9700 1 -- 172.21.15.26:0/4263901642 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1bb8014b50 con 0x7f1bc809e930 2023-10-01T07:56:13.787 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:13.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.789+0000 7f1bce40b700 1 -- 172.21.15.26:0/4263901642 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1bc809e930 msgr2=0x7f1bc81c3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:13.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.789+0000 7f1bce40b700 1 --2- 172.21.15.26:0/4263901642 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1bc809e930 0x7f1bc81c3cb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80087a0 tx=0x7f1bb8008ab0 comp rx=0 tx=0).stop 2023-10-01T07:56:13.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.789+0000 7f1bce40b700 1 -- 172.21.15.26:0/4263901642 shutdown_connections 2023-10-01T07:56:13.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.789+0000 7f1bce40b700 1 --2- 172.21.15.26:0/4263901642 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bc809f650 0x7f1bc81c4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:13.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.789+0000 7f1bce40b700 1 --2- 172.21.15.26:0/4263901642 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1bc809e930 0x7f1bc81c3cb0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:13.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.789+0000 7f1bce40b700 1 --2- 172.21.15.26:0/4263901642 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1bc809f240 0x7f1bc81c41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:13.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.789+0000 7f1bce40b700 1 -- 172.21.15.26:0/4263901642 >> 172.21.15.26:0/4263901642 conn(0x7f1bc80a4210 msgr2=0x7f1bc81b6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:13.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.789+0000 7f1bce40b700 1 -- 172.21.15.26:0/4263901642 shutdown_connections 2023-10-01T07:56:13.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.789+0000 7f1bce40b700 1 -- 172.21.15.26:0/4263901642 wait complete. 2023-10-01T07:56:13.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:13.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.843+0000 7fbd35b7c700 1 -- 172.21.15.26:0/3551563550 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbd10005150 con 0x7fbd300a0a30 2023-10-01T07:56:13.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.844+0000 7fbd17fff700 1 -- 172.21.15.26:0/3551563550 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbd200102c0 con 0x7fbd300a0a30 2023-10-01T07:56:13.844 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.846+0000 7fbd35b7c700 1 -- 172.21.15.26:0/3551563550 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd300a0a30 msgr2=0x7fbd3011e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.846+0000 7fbd35b7c700 1 --2- 172.21.15.26:0/3551563550 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd300a0a30 0x7fbd3011e5a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000c520 tx=0x7fbd2000c830 comp rx=0 tx=0).stop 2023-10-01T07:56:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.846+0000 7fbd35b7c700 1 -- 172.21.15.26:0/3551563550 shutdown_connections 2023-10-01T07:56:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.846+0000 7fbd35b7c700 1 --2- 172.21.15.26:0/3551563550 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd30139250 0x7fbd3011f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.846+0000 7fbd35b7c700 1 --2- 172.21.15.26:0/3551563550 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd300a0a30 0x7fbd3011e5a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.846+0000 7fbd35b7c700 1 --2- 172.21.15.26:0/3551563550 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd300a1510 0x7fbd3011eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.846+0000 7fbd35b7c700 1 -- 172.21.15.26:0/3551563550 >> 172.21.15.26:0/3551563550 conn(0x7fbd300a6550 msgr2=0x7fbd300a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.846+0000 7fbd35b7c700 1 -- 172.21.15.26:0/3551563550 shutdown_connections 2023-10-01T07:56:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:13.846+0000 7fbd35b7c700 1 -- 172.21.15.26:0/3551563550 wait complete. 2023-10-01T07:56:13.860 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:14.641 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:14.768 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:14.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.787+0000 7f91f42df700 1 Processor -- start 2023-10-01T07:56:14.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.787+0000 7f91f42df700 1 -- start start 2023-10-01T07:56:14.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.787+0000 7f91f42df700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91ec09e1d0 0x7f91ec135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:14.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.787+0000 7f91f42df700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f91ec135e50 0x7f91ec138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:14.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.787+0000 7f91f42df700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91ec09f130 con 0x7f91ec09d6f0 2023-10-01T07:56:14.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.787+0000 7f91f42df700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91ec09f520 con 0x7f91ec135e50 2023-10-01T07:56:14.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.787+0000 7f91f42df700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec09e930 con 0x7f91ec09e1d0 2023-10-01T07:56:14.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.788+0000 7f91f287c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f91ec135e50 0x7f91ec138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:14.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.788+0000 7f91f187a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91ec09e1d0 0x7f91ec135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:14.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.788+0000 7f91f187a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91ec09e1d0 0x7f91ec135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:36700/0 (socket says 172.21.15.26:36700) 2023-10-01T07:56:14.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.788+0000 7f91f287c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f91ec135e50 0x7f91ec138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60628/0 (socket says 172.21.15.26:60628) 2023-10-01T07:56:14.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.788+0000 7f91f187a700 1 -- 172.21.15.26:0/1661463348 learned_addr learned my addr 172.21.15.26:0/1661463348 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:14.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.788+0000 7f91f187a700 1 -- 172.21.15.26:0/1661463348 >> v2:172.21.15.26:3300/0 conn(0x7f91ec135e50 msgr2=0x7f91ec138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:14.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.788+0000 7f91f187a700 1 --2- 172.21.15.26:0/1661463348 >> v2:172.21.15.26:3300/0 conn(0x7f91ec135e50 0x7f91ec138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:14.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.788+0000 7f91f187a700 1 -- 172.21.15.26:0/1661463348 >> v1:172.21.15.26:6789/0 conn(0x7f91ec09d6f0 legacy=0x7f91ec09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:14.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.788+0000 7f91f187a700 1 -- 172.21.15.26:0/1661463348 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ec09b2d0 con 0x7f91ec09e1d0 2023-10-01T07:56:14.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.788+0000 7f91f287c700 1 --2- 172.21.15.26:0/1661463348 >> v2:172.21.15.26:3300/0 conn(0x7f91ec135e50 0x7f91ec138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:14.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.788+0000 7f91f187a700 1 --2- 172.21.15.26:0/1661463348 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91ec09e1d0 0x7f91ec135910 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f91dc00bbc0 tx=0x7f91dc00bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af58051e3a1295b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:14.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.788+0000 7f91f1079700 1 -- 172.21.15.26:0/1661463348 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc00dcf0 con 0x7f91ec09e1d0 2023-10-01T07:56:14.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.788+0000 7f91f1079700 1 -- 172.21.15.26:0/1661463348 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91dc00de50 con 0x7f91ec09e1d0 2023-10-01T07:56:14.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.788+0000 7f91f1079700 1 -- 172.21.15.26:0/1661463348 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc010690 con 0x7f91ec09e1d0 2023-10-01T07:56:14.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.789+0000 7f91f42df700 1 -- 172.21.15.26:0/1661463348 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91ec09e1d0 msgr2=0x7f91ec135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:14.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.789+0000 7f91f42df700 1 --2- 172.21.15.26:0/1661463348 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91ec09e1d0 0x7f91ec135910 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f91dc00bbc0 tx=0x7f91dc00bed0 comp rx=0 tx=0).stop 2023-10-01T07:56:14.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.789+0000 7f91f42df700 1 -- 172.21.15.26:0/1661463348 shutdown_connections 2023-10-01T07:56:14.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.789+0000 7f91f42df700 1 --2- 172.21.15.26:0/1661463348 >> v2:172.21.15.26:3300/0 conn(0x7f91ec135e50 0x7f91ec138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:14.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.789+0000 7f91f42df700 1 --2- 172.21.15.26:0/1661463348 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91ec09e1d0 0x7f91ec135910 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:14.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.789+0000 7f91f42df700 1 -- 172.21.15.26:0/1661463348 >> 172.21.15.26:0/1661463348 conn(0x7f91ec066f50 msgr2=0x7f91ec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:14.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.789+0000 7f91f42df700 1 -- 172.21.15.26:0/1661463348 shutdown_connections 2023-10-01T07:56:14.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.789+0000 7f91f42df700 1 -- 172.21.15.26:0/1661463348 wait complete. 2023-10-01T07:56:14.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.791+0000 7f91f42df700 1 Processor -- start 2023-10-01T07:56:14.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.791+0000 7f91f42df700 1 -- start start 2023-10-01T07:56:14.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.791+0000 7f91f42df700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91ec09d6f0 0x7f91ec11e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:14.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.791+0000 7f91f42df700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91ec09e1d0 0x7f91ec11e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:14.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.791+0000 7f91f42df700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ec135e50 0x7f91ec1c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:14.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.791+0000 7f91f42df700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec121250 con 0x7f91ec135e50 2023-10-01T07:56:14.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.791+0000 7f91f42df700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec130380 con 0x7f91ec09d6f0 2023-10-01T07:56:14.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.791+0000 7f91f42df700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec0a1d00 con 0x7f91ec09e1d0 2023-10-01T07:56:14.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.791+0000 7f91f207b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91ec09d6f0 0x7f91ec11e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.792+0000 7f91f207b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91ec09d6f0 0x7f91ec11e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:36714/0 (socket says 172.21.15.26:36714) 2023-10-01T07:56:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.792+0000 7f91f207b700 1 -- 172.21.15.26:0/196583578 learned_addr learned my addr 172.21.15.26:0/196583578 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.792+0000 7f91f287c700 1 --2- 172.21.15.26:0/196583578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ec135e50 0x7f91ec1c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.792+0000 7f91f187a700 1 --2- 172.21.15.26:0/196583578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91ec09e1d0 0x7f91ec11e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.792+0000 7f91f207b700 1 -- 172.21.15.26:0/196583578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91ec09e1d0 msgr2=0x7f91ec11e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.792+0000 7f91f207b700 1 --2- 172.21.15.26:0/196583578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91ec09e1d0 0x7f91ec11e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.792+0000 7f91f207b700 1 -- 172.21.15.26:0/196583578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ec135e50 msgr2=0x7f91ec1c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.792+0000 7f91f207b700 1 --2- 172.21.15.26:0/196583578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ec135e50 0x7f91ec1c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:14.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.792+0000 7f91f207b700 1 -- 172.21.15.26:0/196583578 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e4009a70 con 0x7f91ec09d6f0 2023-10-01T07:56:14.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.792+0000 7f91f207b700 1 --2- 172.21.15.26:0/196583578 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91ec09d6f0 0x7f91ec11e410 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f91e800c540 tx=0x7f91e800c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:14.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.792+0000 7f91e2ffd700 1 -- 172.21.15.26:0/196583578 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e80052d0 con 0x7f91ec09d6f0 2023-10-01T07:56:14.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.792+0000 7f91e2ffd700 1 -- 172.21.15.26:0/196583578 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e8005430 con 0x7f91ec09d6f0 2023-10-01T07:56:14.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.792+0000 7f91e2ffd700 1 -- 172.21.15.26:0/196583578 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e80038c0 con 0x7f91ec09d6f0 2023-10-01T07:56:14.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.792+0000 7f91f42df700 1 -- 172.21.15.26:0/196583578 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91dc00b7f0 con 0x7f91ec09d6f0 2023-10-01T07:56:14.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.792+0000 7f91f42df700 1 -- 172.21.15.26:0/196583578 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91ec11ee90 con 0x7f91ec09d6f0 2023-10-01T07:56:14.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.793+0000 7f91e2ffd700 1 -- 172.21.15.26:0/196583578 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f91e8003a20 con 0x7f91ec09d6f0 2023-10-01T07:56:14.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.794+0000 7f91e2ffd700 1 -- 172.21.15.26:0/196583578 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f91e803eae0 con 0x7f91ec09d6f0 2023-10-01T07:56:14.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.794+0000 7f91f42df700 1 -- 172.21.15.26:0/196583578 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91ec121390 con 0x7f91ec09d6f0 2023-10-01T07:56:14.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.799+0000 7f91e2ffd700 1 -- 172.21.15.26:0/196583578 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f91ec121390 con 0x7f91ec09d6f0 2023-10-01T07:56:14.803 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:14.861 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:14.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.916+0000 7f0117e0f700 1 Processor -- start 2023-10-01T07:56:14.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.917+0000 7f0117e0f700 1 -- start start 2023-10-01T07:56:14.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.917+0000 7f0117e0f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0110133540 0x7f0110135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:14.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.917+0000 7f0117e0f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0110135e60 0x7f0110138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:14.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.917+0000 7f0117e0f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01100716a0 con 0x7f0110130540 2023-10-01T07:56:14.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.917+0000 7f0117e0f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0110071290 con 0x7f0110133540 2023-10-01T07:56:14.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.917+0000 7f0117e0f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0110130340 con 0x7f0110135e60 2023-10-01T07:56:14.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.918+0000 7f01153aa700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0110133540 0x7f0110135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:14.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.918+0000 7f01163ac700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0110135e60 0x7f0110138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:14.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.918+0000 7f01153aa700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0110133540 0x7f0110135920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60648/0 (socket says 172.21.15.26:60648) 2023-10-01T07:56:14.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.918+0000 7f01163ac700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0110135e60 0x7f0110138240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:60286/0 (socket says 172.21.15.26:60286) 2023-10-01T07:56:14.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.918+0000 7f01153aa700 1 -- 172.21.15.26:0/3649049536 learned_addr learned my addr 172.21.15.26:0/3649049536 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:14.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.918+0000 7f01163ac700 1 -- 172.21.15.26:0/3649049536 >> v2:172.21.15.26:3300/0 conn(0x7f0110133540 msgr2=0x7f0110135920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:14.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.918+0000 7f01163ac700 1 --2- 172.21.15.26:0/3649049536 >> v2:172.21.15.26:3300/0 conn(0x7f0110133540 0x7f0110135920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:14.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.918+0000 7f01163ac700 1 -- 172.21.15.26:0/3649049536 >> v1:172.21.15.26:6789/0 conn(0x7f0110130540 legacy=0x7f0110130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:14.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.918+0000 7f01163ac700 1 -- 172.21.15.26:0/3649049536 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0110070b80 con 0x7f0110135e60 2023-10-01T07:56:14.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.918+0000 7f01153aa700 1 --2- 172.21.15.26:0/3649049536 >> v2:172.21.15.26:3300/0 conn(0x7f0110133540 0x7f0110135920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:14.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.918+0000 7f01163ac700 1 --2- 172.21.15.26:0/3649049536 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0110135e60 0x7f0110138240 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0108009d90 tx=0x7f010800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d43a6ae73d9ac79a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:14.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.919+0000 7f0114ba9700 1 -- 172.21.15.26:0/3649049536 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010800e070 con 0x7f0110135e60 2023-10-01T07:56:14.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.919+0000 7f0114ba9700 1 -- 172.21.15.26:0/3649049536 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010800bb20 con 0x7f0110135e60 2023-10-01T07:56:14.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.919+0000 7f0114ba9700 1 -- 172.21.15.26:0/3649049536 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0108012430 con 0x7f0110135e60 2023-10-01T07:56:14.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.919+0000 7f0117e0f700 1 -- 172.21.15.26:0/3649049536 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0110135e60 msgr2=0x7f0110138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:14.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.919+0000 7f0117e0f700 1 --2- 172.21.15.26:0/3649049536 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0110135e60 0x7f0110138240 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0108009d90 tx=0x7f010800b330 comp rx=0 tx=0).stop 2023-10-01T07:56:14.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.919+0000 7f0117e0f700 1 -- 172.21.15.26:0/3649049536 shutdown_connections 2023-10-01T07:56:14.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.919+0000 7f0117e0f700 1 --2- 172.21.15.26:0/3649049536 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0110135e60 0x7f0110138240 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:14.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.919+0000 7f0117e0f700 1 --2- 172.21.15.26:0/3649049536 >> v2:172.21.15.26:3300/0 conn(0x7f0110133540 0x7f0110135920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:14.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.919+0000 7f0117e0f700 1 -- 172.21.15.26:0/3649049536 >> 172.21.15.26:0/3649049536 conn(0x7f01100a2aa0 msgr2=0x7f01100a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:14.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.920+0000 7f0117e0f700 1 -- 172.21.15.26:0/3649049536 shutdown_connections 2023-10-01T07:56:14.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.920+0000 7f0117e0f700 1 -- 172.21.15.26:0/3649049536 wait complete. 2023-10-01T07:56:14.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.921+0000 7f0117e0f700 1 Processor -- start 2023-10-01T07:56:14.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.921+0000 7f0117e0f700 1 -- start start 2023-10-01T07:56:14.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.921+0000 7f0117e0f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0110130540 0x7f011009c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:14.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.921+0000 7f0117e0f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0110133540 0x7f011009ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:14.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.921+0000 7f0117e0f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0110135e60 0x7f011009cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:14.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.921+0000 7f0117e0f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011012d4e0 con 0x7f0110133540 2023-10-01T07:56:14.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.921+0000 7f0117e0f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01100718e0 con 0x7f0110130540 2023-10-01T07:56:14.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.921+0000 7f0117e0f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0110132d30 con 0x7f0110135e60 2023-10-01T07:56:14.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.921+0000 7f01153aa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0110133540 0x7f011009ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:14.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.922+0000 7f01153aa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0110133540 0x7f011009ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60662/0 (socket says 172.21.15.26:60662) 2023-10-01T07:56:14.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.922+0000 7f01153aa700 1 -- 172.21.15.26:0/2712485388 learned_addr learned my addr 172.21.15.26:0/2712485388 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:14.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.922+0000 7f01163ac700 1 --2- 172.21.15.26:0/2712485388 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0110135e60 0x7f011009cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:14.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.922+0000 7f0115bab700 1 --2- 172.21.15.26:0/2712485388 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0110130540 0x7f011009c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:14.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.922+0000 7f01163ac700 1 -- 172.21.15.26:0/2712485388 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0110130540 msgr2=0x7f011009c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:14.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.922+0000 7f01163ac700 1 --2- 172.21.15.26:0/2712485388 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0110130540 0x7f011009c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:14.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.922+0000 7f01163ac700 1 -- 172.21.15.26:0/2712485388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0110133540 msgr2=0x7f011009ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:14.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.922+0000 7f01163ac700 1 --2- 172.21.15.26:0/2712485388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0110133540 0x7f011009ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:14.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.922+0000 7f01163ac700 1 -- 172.21.15.26:0/2712485388 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010000da00 con 0x7f0110135e60 2023-10-01T07:56:14.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.922+0000 7f01163ac700 1 --2- 172.21.15.26:0/2712485388 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0110135e60 0x7f011009cf50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0108016000 tx=0x7f0108004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:14.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.923+0000 7f01067fc700 1 -- 172.21.15.26:0/2712485388 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0108012430 con 0x7f0110135e60 2023-10-01T07:56:14.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.923+0000 7f0117e0f700 1 -- 172.21.15.26:0/2712485388 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0108009a70 con 0x7f0110135e60 2023-10-01T07:56:14.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.923+0000 7f01067fc700 1 -- 172.21.15.26:0/2712485388 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0108020070 con 0x7f0110135e60 2023-10-01T07:56:14.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.923+0000 7f01067fc700 1 -- 172.21.15.26:0/2712485388 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0108004280 con 0x7f0110135e60 2023-10-01T07:56:14.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.923+0000 7f0117e0f700 1 -- 172.21.15.26:0/2712485388 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0110119ee0 con 0x7f0110135e60 2023-10-01T07:56:14.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.924+0000 7f01067fc700 1 -- 172.21.15.26:0/2712485388 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f01080043e0 con 0x7f0110135e60 2023-10-01T07:56:14.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.924+0000 7f0117e0f700 1 -- 172.21.15.26:0/2712485388 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0110074ea0 con 0x7f0110135e60 2023-10-01T07:56:14.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.924+0000 7f01067fc700 1 -- 172.21.15.26:0/2712485388 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0108022070 con 0x7f0110135e60 2023-10-01T07:56:14.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.929+0000 7f01067fc700 1 -- 172.21.15.26:0/2712485388 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0108046060 con 0x7f0110135e60 2023-10-01T07:56:14.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.963+0000 7faea974c700 1 Processor -- start 2023-10-01T07:56:14.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.963+0000 7faea974c700 1 -- start start 2023-10-01T07:56:14.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.964+0000 7faea974c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faea409d6f0 0x7faea409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:14.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.964+0000 7faea974c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faea409e410 0x7faea4134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:14.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.964+0000 7faea974c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faea409b120 con 0x7faea409e000 2023-10-01T07:56:14.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.964+0000 7faea974c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea406b460 con 0x7faea409e410 2023-10-01T07:56:14.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.964+0000 7faea974c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faea409a7e0 con 0x7faea409d6f0 2023-10-01T07:56:14.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.964+0000 7faea2ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faea409d6f0 0x7faea409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:14.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.964+0000 7faea27fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7faea409e000 0x7faea41339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54714/0 (socket says 172.21.15.26:54714) 2023-10-01T07:56:14.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.964+0000 7faea27fc700 1 -- 172.21.15.26:0/2516229196 learned_addr learned my addr 172.21.15.26:0/2516229196 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:14.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.964+0000 7faea37fe700 1 --2- 172.21.15.26:0/2516229196 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faea409e410 0x7faea4134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:14.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.964+0000 7faea2ffd700 1 -- 172.21.15.26:0/2516229196 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faea409e410 msgr2=0x7faea4134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:14.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.964+0000 7faea2ffd700 1 --2- 172.21.15.26:0/2516229196 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faea409e410 0x7faea4134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:14.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.964+0000 7faea2ffd700 1 -- 172.21.15.26:0/2516229196 >> v1:172.21.15.26:6789/0 conn(0x7faea409e000 legacy=0x7faea41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:14.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.964+0000 7faea2ffd700 1 -- 172.21.15.26:0/2516229196 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea409a500 con 0x7faea409d6f0 2023-10-01T07:56:14.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.964+0000 7faea1ffb700 1 -- 172.21.15.26:0/2516229196 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1906275470 0 0) 0x7faea409b120 con 0x7faea409e000 2023-10-01T07:56:14.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.964+0000 7faea37fe700 1 --2- 172.21.15.26:0/2516229196 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faea409e410 0x7faea4134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:56:14.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.965+0000 7faea2ffd700 1 --2- 172.21.15.26:0/2516229196 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faea409d6f0 0x7faea409dac0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fae940098a0 tx=0x7fae94009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fab59fbee942bd83 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:14.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.965+0000 7faea1ffb700 1 -- 172.21.15.26:0/2516229196 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae94011830 con 0x7faea409d6f0 2023-10-01T07:56:14.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.965+0000 7faea1ffb700 1 -- 172.21.15.26:0/2516229196 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae94011990 con 0x7faea409d6f0 2023-10-01T07:56:14.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.965+0000 7faea1ffb700 1 -- 172.21.15.26:0/2516229196 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae94011d40 con 0x7faea409d6f0 2023-10-01T07:56:14.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.966+0000 7faea974c700 1 -- 172.21.15.26:0/2516229196 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faea409d6f0 msgr2=0x7faea409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:14.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.966+0000 7faea974c700 1 --2- 172.21.15.26:0/2516229196 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faea409d6f0 0x7faea409dac0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fae940098a0 tx=0x7fae94009bb0 comp rx=0 tx=0).stop 2023-10-01T07:56:14.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.966+0000 7faea974c700 1 -- 172.21.15.26:0/2516229196 shutdown_connections 2023-10-01T07:56:14.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.966+0000 7faea974c700 1 --2- 172.21.15.26:0/2516229196 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faea409d6f0 0x7faea409dac0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:14.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.966+0000 7faea974c700 1 --2- 172.21.15.26:0/2516229196 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faea409e410 0x7faea4134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:14.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.966+0000 7faea974c700 1 -- 172.21.15.26:0/2516229196 >> 172.21.15.26:0/2516229196 conn(0x7faea4066f50 msgr2=0x7faea409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:14.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.966+0000 7faea974c700 1 -- 172.21.15.26:0/2516229196 shutdown_connections 2023-10-01T07:56:14.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.966+0000 7faea974c700 1 -- 172.21.15.26:0/2516229196 wait complete. 2023-10-01T07:56:14.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.967+0000 7faea974c700 1 Processor -- start 2023-10-01T07:56:14.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.967+0000 7faea974c700 1 -- start start 2023-10-01T07:56:14.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.968+0000 7faea974c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faea409d6f0 0x7faea41c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:14.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.968+0000 7faea974c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faea409e000 0x7faea41c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:14.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.968+0000 7faea974c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faea409e410 0x7faea41c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:14.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.968+0000 7faea974c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea41a4cb0 con 0x7faea409e000 2023-10-01T07:56:14.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.968+0000 7faea974c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea41a6520 con 0x7faea409d6f0 2023-10-01T07:56:14.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.968+0000 7faea974c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faea41a6950 con 0x7faea409e410 2023-10-01T07:56:14.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.968+0000 7faea27fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faea409e000 0x7faea41c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:14.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.968+0000 7faea37fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faea409e410 0x7faea41c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:14.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.968+0000 7faea27fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faea409e000 0x7faea41c84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60668/0 (socket says 172.21.15.26:60668) 2023-10-01T07:56:14.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.968+0000 7faea27fc700 1 -- 172.21.15.26:0/2776407621 learned_addr learned my addr 172.21.15.26:0/2776407621 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:14.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.968+0000 7faea2ffd700 1 --2- 172.21.15.26:0/2776407621 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faea409d6f0 0x7faea41c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:14.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.968+0000 7faea2ffd700 1 -- 172.21.15.26:0/2776407621 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faea409e410 msgr2=0x7faea41c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:14.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.968+0000 7faea2ffd700 1 --2- 172.21.15.26:0/2776407621 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faea409e410 0x7faea41c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:14.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.968+0000 7faea2ffd700 1 -- 172.21.15.26:0/2776407621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faea409e000 msgr2=0x7faea41c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:14.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.968+0000 7faea2ffd700 1 --2- 172.21.15.26:0/2776407621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faea409e000 0x7faea41c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:14.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.968+0000 7faea2ffd700 1 -- 172.21.15.26:0/2776407621 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae940094a0 con 0x7faea409d6f0 2023-10-01T07:56:14.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.969+0000 7faea37fe700 1 --2- 172.21.15.26:0/2776407621 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faea409e410 0x7faea41c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:14.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.969+0000 7faea27fc700 1 --2- 172.21.15.26:0/2776407621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faea409e000 0x7faea41c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:14.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.969+0000 7faea2ffd700 1 --2- 172.21.15.26:0/2776407621 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faea409d6f0 0x7faea41c7fb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7faea406e470 tx=0x7fae94004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:14.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.969+0000 7fae8b7fe700 1 -- 172.21.15.26:0/2776407621 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9401a8b0 con 0x7faea409d6f0 2023-10-01T07:56:14.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.969+0000 7fae8b7fe700 1 -- 172.21.15.26:0/2776407621 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9401aa10 con 0x7faea409d6f0 2023-10-01T07:56:14.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.969+0000 7faea974c700 1 -- 172.21.15.26:0/2776407621 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faea409c780 con 0x7faea409d6f0 2023-10-01T07:56:14.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.969+0000 7fae8b7fe700 1 -- 172.21.15.26:0/2776407621 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9401ad80 con 0x7faea409d6f0 2023-10-01T07:56:14.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.969+0000 7faea974c700 1 -- 172.21.15.26:0/2776407621 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faea41a7f60 con 0x7faea409d6f0 2023-10-01T07:56:14.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.970+0000 7fae8b7fe700 1 -- 172.21.15.26:0/2776407621 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fae9402d450 con 0x7faea409d6f0 2023-10-01T07:56:14.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.971+0000 7fae8b7fe700 1 -- 172.21.15.26:0/2776407621 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fae94010380 con 0x7faea409d6f0 2023-10-01T07:56:14.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.971+0000 7faea974c700 1 -- 172.21.15.26:0/2776407621 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faea4074ea0 con 0x7faea409d6f0 2023-10-01T07:56:14.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:14.980+0000 7fae8b7fe700 1 -- 172.21.15.26:0/2776407621 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fae9402c3b0 con 0x7faea409d6f0 2023-10-01T07:56:15.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.008+0000 7f9ae7e27700 1 Processor -- start 2023-10-01T07:56:15.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.009+0000 7f9ae7e27700 1 -- start start 2023-10-01T07:56:15.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.009+0000 7f9ae7e27700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ae009e1d0 0x7f9ae0138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:15.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.009+0000 7f9ae7e27700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ae0139170 0x7f9ae013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:15.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.009+0000 7f9ae7e27700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ae009b120 con 0x7f9ae009d6f0 2023-10-01T07:56:15.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.009+0000 7f9ae7e27700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae006b460 con 0x7f9ae009e1d0 2023-10-01T07:56:15.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.009+0000 7f9ae7e27700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae009a7e0 con 0x7f9ae0139170 2023-10-01T07:56:15.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.009+0000 7f9ae5bc3700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9ae009d6f0 0x7f9ae009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54724/0 (socket says 172.21.15.26:54724) 2023-10-01T07:56:15.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.009+0000 7f9ae5bc3700 1 -- 172.21.15.26:0/1368222966 learned_addr learned my addr 172.21.15.26:0/1368222966 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:15.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.009+0000 7f9ae53c2700 1 --2- 172.21.15.26:0/1368222966 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ae009e1d0 0x7f9ae0138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:15.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.009+0000 7f9ae63c4700 1 --2- 172.21.15.26:0/1368222966 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ae0139170 0x7f9ae013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:15.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.010+0000 7f9ae4bc1700 1 -- 172.21.15.26:0/1368222966 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2382796230 0 0) 0x7f9ae009b120 con 0x7f9ae009d6f0 2023-10-01T07:56:15.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.010+0000 7f9ae4bc1700 1 -- 172.21.15.26:0/1368222966 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9acc0035b0 con 0x7f9ae009d6f0 2023-10-01T07:56:15.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.010+0000 7f9ae63c4700 1 -- 172.21.15.26:0/1368222966 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ae009e1d0 msgr2=0x7f9ae0138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:15.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.010+0000 7f9ae63c4700 1 --2- 172.21.15.26:0/1368222966 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ae009e1d0 0x7f9ae0138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:15.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.010+0000 7f9ae63c4700 1 -- 172.21.15.26:0/1368222966 >> v1:172.21.15.26:6789/0 conn(0x7f9ae009d6f0 legacy=0x7f9ae009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:15.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.010+0000 7f9ae63c4700 1 -- 172.21.15.26:0/1368222966 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae009a500 con 0x7f9ae0139170 2023-10-01T07:56:15.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.010+0000 7f9ae63c4700 1 --2- 172.21.15.26:0/1368222966 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ae0139170 0x7f9ae013b550 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8009df0 tx=0x7f9ad800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44c3d51b96a9f995 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:15.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.010+0000 7f9ae4bc1700 1 -- 172.21.15.26:0/1368222966 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad800e070 con 0x7f9ae0139170 2023-10-01T07:56:15.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.010+0000 7f9ae4bc1700 1 -- 172.21.15.26:0/1368222966 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad800bae0 con 0x7f9ae0139170 2023-10-01T07:56:15.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.010+0000 7f9ae4bc1700 1 -- 172.21.15.26:0/1368222966 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad800be50 con 0x7f9ae0139170 2023-10-01T07:56:15.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.011+0000 7f9ae7e27700 1 -- 172.21.15.26:0/1368222966 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ae0139170 msgr2=0x7f9ae013b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:15.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.011+0000 7f9ae7e27700 1 --2- 172.21.15.26:0/1368222966 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ae0139170 0x7f9ae013b550 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8009df0 tx=0x7f9ad800b330 comp rx=0 tx=0).stop 2023-10-01T07:56:15.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.011+0000 7f9ae7e27700 1 -- 172.21.15.26:0/1368222966 shutdown_connections 2023-10-01T07:56:15.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.011+0000 7f9ae7e27700 1 --2- 172.21.15.26:0/1368222966 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ae0139170 0x7f9ae013b550 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:15.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.011+0000 7f9ae7e27700 1 --2- 172.21.15.26:0/1368222966 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ae009e1d0 0x7f9ae0138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:15.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.012+0000 7f9ae7e27700 1 -- 172.21.15.26:0/1368222966 >> 172.21.15.26:0/1368222966 conn(0x7f9ae0066f50 msgr2=0x7f9ae009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:15.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.012+0000 7f9ae7e27700 1 -- 172.21.15.26:0/1368222966 shutdown_connections 2023-10-01T07:56:15.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.012+0000 7f9ae7e27700 1 -- 172.21.15.26:0/1368222966 wait complete. 2023-10-01T07:56:15.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.013+0000 7f9ae7e27700 1 Processor -- start 2023-10-01T07:56:15.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.013+0000 7f9ae7e27700 1 -- start start 2023-10-01T07:56:15.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.013+0000 7f9ae7e27700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ae009d6f0 0x7f9ae0121700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:15.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.013+0000 7f9ae7e27700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ae009e1d0 0x7f9ae0121c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:15.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.013+0000 7f9ae7e27700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ae0139170 0x7f9ae0122180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:15.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.013+0000 7f9ae7e27700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae0125220 con 0x7f9ae0139170 2023-10-01T07:56:15.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.013+0000 7f9ae7e27700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae0123930 con 0x7f9ae009d6f0 2023-10-01T07:56:15.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.013+0000 7f9ae7e27700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae009c710 con 0x7f9ae009e1d0 2023-10-01T07:56:15.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.013+0000 7f9ae53c2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ae009e1d0 0x7f9ae0121c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:15.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.013+0000 7f9ae53c2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ae009e1d0 0x7f9ae0121c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:60324/0 (socket says 172.21.15.26:60324) 2023-10-01T07:56:15.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.013+0000 7f9ae53c2700 1 -- 172.21.15.26:0/1649687877 learned_addr learned my addr 172.21.15.26:0/1649687877 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:15.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.014+0000 7f9ae5bc3700 1 --2- 172.21.15.26:0/1649687877 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ae009d6f0 0x7f9ae0121700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:15.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.014+0000 7f9ae63c4700 1 --2- 172.21.15.26:0/1649687877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ae0139170 0x7f9ae0122180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:15.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.014+0000 7f9ae5bc3700 1 -- 172.21.15.26:0/1649687877 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ae009e1d0 msgr2=0x7f9ae0121c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:15.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.014+0000 7f9ae5bc3700 1 --2- 172.21.15.26:0/1649687877 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ae009e1d0 0x7f9ae0121c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:15.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.014+0000 7f9ae5bc3700 1 -- 172.21.15.26:0/1649687877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ae0139170 msgr2=0x7f9ae0122180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:15.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.014+0000 7f9ae5bc3700 1 --2- 172.21.15.26:0/1649687877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ae0139170 0x7f9ae0122180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:15.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.014+0000 7f9ae5bc3700 1 -- 172.21.15.26:0/1649687877 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad8009a70 con 0x7f9ae009d6f0 2023-10-01T07:56:15.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.014+0000 7f9ae53c2700 1 --2- 172.21.15.26:0/1649687877 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ae009e1d0 0x7f9ae0121c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:15.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.014+0000 7f9ae63c4700 1 --2- 172.21.15.26:0/1649687877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ae0139170 0x7f9ae0122180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:15.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.014+0000 7f9ae5bc3700 1 --2- 172.21.15.26:0/1649687877 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ae009d6f0 0x7f9ae0121700 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9adc00c4c0 tx=0x7f9adc00c7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:15.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.014+0000 7f9ad67fc700 1 -- 172.21.15.26:0/1649687877 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9adc005d70 con 0x7f9ae009d6f0 2023-10-01T07:56:15.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.015+0000 7f9ad67fc700 1 -- 172.21.15.26:0/1649687877 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9adc0070d0 con 0x7f9ae009d6f0 2023-10-01T07:56:15.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.015+0000 7f9ad67fc700 1 -- 172.21.15.26:0/1649687877 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9adc007440 con 0x7f9ae009d6f0 2023-10-01T07:56:15.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.015+0000 7f9ae7e27700 1 -- 172.21.15.26:0/1649687877 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ae0123310 con 0x7f9ae009d6f0 2023-10-01T07:56:15.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.015+0000 7f9ae7e27700 1 -- 172.21.15.26:0/1649687877 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae0123b00 con 0x7f9ae009d6f0 2023-10-01T07:56:15.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.016+0000 7f9ae7e27700 1 -- 172.21.15.26:0/1649687877 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ae0074ea0 con 0x7f9ae009d6f0 2023-10-01T07:56:15.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.016+0000 7f9ad67fc700 1 -- 172.21.15.26:0/1649687877 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9adc0075a0 con 0x7f9ae009d6f0 2023-10-01T07:56:15.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.016+0000 7f9ad67fc700 1 -- 172.21.15.26:0/1649687877 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9adc03e6e0 con 0x7f9ae009d6f0 2023-10-01T07:56:15.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.025+0000 7f9ad67fc700 1 -- 172.21.15.26:0/1649687877 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9adc018af0 con 0x7f9ae009d6f0 2023-10-01T07:56:15.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.030+0000 7f91f42df700 1 -- 172.21.15.26:0/196583578 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f91ec121390 con 0x7f91ec09d6f0 2023-10-01T07:56:15.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.031+0000 7f91e2ffd700 1 -- 172.21.15.26:0/196583578 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f91ec121390 con 0x7f91ec09d6f0 2023-10-01T07:56:15.031 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:15.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.034+0000 7f91f42df700 1 -- 172.21.15.26:0/196583578 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91ec09d6f0 msgr2=0x7f91ec11e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:15.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.034+0000 7f91f42df700 1 --2- 172.21.15.26:0/196583578 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91ec09d6f0 0x7f91ec11e410 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f91e800c540 tx=0x7f91e800c850 comp rx=0 tx=0).stop 2023-10-01T07:56:15.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.034+0000 7f91f42df700 1 -- 172.21.15.26:0/196583578 shutdown_connections 2023-10-01T07:56:15.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.034+0000 7f91f42df700 1 --2- 172.21.15.26:0/196583578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ec135e50 0x7f91ec1c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:15.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.034+0000 7f91f42df700 1 --2- 172.21.15.26:0/196583578 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91ec09d6f0 0x7f91ec11e410 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:15.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.034+0000 7f91f42df700 1 --2- 172.21.15.26:0/196583578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91ec09e1d0 0x7f91ec11e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:15.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.034+0000 7f91f42df700 1 -- 172.21.15.26:0/196583578 >> 172.21.15.26:0/196583578 conn(0x7f91ec066f50 msgr2=0x7f91ec0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:15.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.034+0000 7f91f42df700 1 -- 172.21.15.26:0/196583578 shutdown_connections 2023-10-01T07:56:15.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.034+0000 7f91f42df700 1 -- 172.21.15.26:0/196583578 wait complete. 2023-10-01T07:56:15.056 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:15.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.164+0000 7f0117e0f700 1 -- 172.21.15.26:0/2712485388 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f011006b9e0 con 0x7f0110135e60 2023-10-01T07:56:15.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.164+0000 7f01067fc700 1 -- 172.21.15.26:0/2712485388 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0108012e60 con 0x7f0110135e60 2023-10-01T07:56:15.166 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:15.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.166+0000 7f0117e0f700 1 -- 172.21.15.26:0/2712485388 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0110135e60 msgr2=0x7f011009cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:15.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.166+0000 7f0117e0f700 1 --2- 172.21.15.26:0/2712485388 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0110135e60 0x7f011009cf50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0108016000 tx=0x7f0108004ad0 comp rx=0 tx=0).stop 2023-10-01T07:56:15.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.167+0000 7f0117e0f700 1 -- 172.21.15.26:0/2712485388 shutdown_connections 2023-10-01T07:56:15.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.167+0000 7f0117e0f700 1 --2- 172.21.15.26:0/2712485388 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0110135e60 0x7f011009cf50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:15.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.167+0000 7f0117e0f700 1 --2- 172.21.15.26:0/2712485388 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0110130540 0x7f011009c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:15.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.167+0000 7f0117e0f700 1 --2- 172.21.15.26:0/2712485388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0110133540 0x7f011009ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:15.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.167+0000 7f0117e0f700 1 -- 172.21.15.26:0/2712485388 >> 172.21.15.26:0/2712485388 conn(0x7f01100a2aa0 msgr2=0x7f01100a0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:15.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.167+0000 7f0117e0f700 1 -- 172.21.15.26:0/2712485388 shutdown_connections 2023-10-01T07:56:15.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.167+0000 7f0117e0f700 1 -- 172.21.15.26:0/2712485388 wait complete. 2023-10-01T07:56:15.182 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:15.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.192+0000 7faea974c700 1 -- 172.21.15.26:0/2776407621 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faea41a7dc0 con 0x7faea409d6f0 2023-10-01T07:56:15.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.192+0000 7fae8b7fe700 1 -- 172.21.15.26:0/2776407621 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faea41a7dc0 con 0x7faea409d6f0 2023-10-01T07:56:15.192 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:15.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.194+0000 7faea974c700 1 -- 172.21.15.26:0/2776407621 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faea409d6f0 msgr2=0x7faea41c7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:15.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.194+0000 7faea974c700 1 --2- 172.21.15.26:0/2776407621 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faea409d6f0 0x7faea41c7fb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7faea406e470 tx=0x7fae94004750 comp rx=0 tx=0).stop 2023-10-01T07:56:15.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.194+0000 7faea974c700 1 -- 172.21.15.26:0/2776407621 shutdown_connections 2023-10-01T07:56:15.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.194+0000 7faea974c700 1 --2- 172.21.15.26:0/2776407621 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faea409e410 0x7faea41c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:15.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.194+0000 7faea974c700 1 --2- 172.21.15.26:0/2776407621 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faea409d6f0 0x7faea41c7fb0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:15.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.194+0000 7faea974c700 1 --2- 172.21.15.26:0/2776407621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faea409e000 0x7faea41c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:15.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.194+0000 7faea974c700 1 -- 172.21.15.26:0/2776407621 >> 172.21.15.26:0/2776407621 conn(0x7faea4066f50 msgr2=0x7faea41bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:15.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.194+0000 7faea974c700 1 -- 172.21.15.26:0/2776407621 shutdown_connections 2023-10-01T07:56:15.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.194+0000 7faea974c700 1 -- 172.21.15.26:0/2776407621 wait complete. 2023-10-01T07:56:15.208 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:15.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.234+0000 7f9ae7e27700 1 -- 172.21.15.26:0/1649687877 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9ae0137680 con 0x7f9ae009d6f0 2023-10-01T07:56:15.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.235+0000 7f9ad67fc700 1 -- 172.21.15.26:0/1649687877 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9adc017020 con 0x7f9ae009d6f0 2023-10-01T07:56:15.235 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:15.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.237+0000 7f9ae7e27700 1 -- 172.21.15.26:0/1649687877 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ae009d6f0 msgr2=0x7f9ae0121700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:15.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.237+0000 7f9ae7e27700 1 --2- 172.21.15.26:0/1649687877 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ae009d6f0 0x7f9ae0121700 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9adc00c4c0 tx=0x7f9adc00c7d0 comp rx=0 tx=0).stop 2023-10-01T07:56:15.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.237+0000 7f9ae7e27700 1 -- 172.21.15.26:0/1649687877 shutdown_connections 2023-10-01T07:56:15.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.237+0000 7f9ae7e27700 1 --2- 172.21.15.26:0/1649687877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ae0139170 0x7f9ae0122180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:15.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.237+0000 7f9ae7e27700 1 --2- 172.21.15.26:0/1649687877 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ae009d6f0 0x7f9ae0121700 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:15.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.237+0000 7f9ae7e27700 1 --2- 172.21.15.26:0/1649687877 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ae009e1d0 0x7f9ae0121c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:15.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.237+0000 7f9ae7e27700 1 -- 172.21.15.26:0/1649687877 >> 172.21.15.26:0/1649687877 conn(0x7f9ae0066f50 msgr2=0x7f9ae009b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:15.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.237+0000 7f9ae7e27700 1 -- 172.21.15.26:0/1649687877 shutdown_connections 2023-10-01T07:56:15.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:15.237+0000 7f9ae7e27700 1 -- 172.21.15.26:0/1649687877 wait complete. 2023-10-01T07:56:15.251 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:16.057 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:16.183 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:16.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.203+0000 7ff368550700 1 Processor -- start 2023-10-01T07:56:16.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.203+0000 7ff368550700 1 -- start start 2023-10-01T07:56:16.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.204+0000 7ff368550700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff36009d6f0 0x7ff36009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:16.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.204+0000 7ff368550700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff36009e410 0x7ff360130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:16.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.204+0000 7ff368550700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff36009f130 con 0x7ff36009e000 2023-10-01T07:56:16.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.204+0000 7ff368550700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff36009f520 con 0x7ff36009e410 2023-10-01T07:56:16.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.204+0000 7ff368550700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff36009e930 con 0x7ff36009d6f0 2023-10-01T07:56:16.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.204+0000 7ff366aed700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff36009e410 0x7ff360130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:16.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.204+0000 7ff3662ec700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff36009d6f0 0x7ff36009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:16.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.205+0000 7ff366aed700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff36009e410 0x7ff360130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:36780/0 (socket says 172.21.15.26:36780) 2023-10-01T07:56:16.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.205+0000 7ff3662ec700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff36009d6f0 0x7ff36009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:60340/0 (socket says 172.21.15.26:60340) 2023-10-01T07:56:16.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.205+0000 7ff366aed700 1 -- 172.21.15.26:0/1024000570 learned_addr learned my addr 172.21.15.26:0/1024000570 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:16.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.205+0000 7ff365aeb700 1 --1- 172.21.15.26:0/1024000570 >> v1:172.21.15.26:6789/0 conn(0x7ff36009e000 0x7ff360130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54730/0 (socket says 172.21.15.26:54730) 2023-10-01T07:56:16.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.205+0000 7ff3662ec700 1 -- 172.21.15.26:0/1024000570 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff36009e410 msgr2=0x7ff360130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:16.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.205+0000 7ff3652ea700 1 -- 172.21.15.26:0/1024000570 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3757108177 0 0) 0x7ff36009f130 con 0x7ff36009e000 2023-10-01T07:56:16.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.205+0000 7ff3662ec700 1 --2- 172.21.15.26:0/1024000570 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff36009e410 0x7ff360130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.205+0000 7ff3662ec700 1 -- 172.21.15.26:0/1024000570 >> v1:172.21.15.26:6789/0 conn(0x7ff36009e000 legacy=0x7ff360130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:16.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.205+0000 7ff3662ec700 1 -- 172.21.15.26:0/1024000570 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36009b2d0 con 0x7ff36009d6f0 2023-10-01T07:56:16.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.205+0000 7ff366aed700 1 --2- 172.21.15.26:0/1024000570 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff36009e410 0x7ff360130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:16.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.205+0000 7ff3662ec700 1 --2- 172.21.15.26:0/1024000570 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff36009d6f0 0x7ff36009dac0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff350009870 tx=0x7ff350009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2270780401ed63c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:16.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.205+0000 7ff3652ea700 1 -- 172.21.15.26:0/1024000570 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff350011830 con 0x7ff36009d6f0 2023-10-01T07:56:16.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.205+0000 7ff3652ea700 1 -- 172.21.15.26:0/1024000570 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff350011990 con 0x7ff36009d6f0 2023-10-01T07:56:16.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.205+0000 7ff3652ea700 1 -- 172.21.15.26:0/1024000570 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff350011d20 con 0x7ff36009d6f0 2023-10-01T07:56:16.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.206+0000 7ff368550700 1 -- 172.21.15.26:0/1024000570 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff36009d6f0 msgr2=0x7ff36009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:16.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.206+0000 7ff368550700 1 --2- 172.21.15.26:0/1024000570 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff36009d6f0 0x7ff36009dac0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff350009870 tx=0x7ff350009b80 comp rx=0 tx=0).stop 2023-10-01T07:56:16.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.206+0000 7ff368550700 1 -- 172.21.15.26:0/1024000570 shutdown_connections 2023-10-01T07:56:16.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.206+0000 7ff368550700 1 --2- 172.21.15.26:0/1024000570 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff36009d6f0 0x7ff36009dac0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.206+0000 7ff368550700 1 --2- 172.21.15.26:0/1024000570 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff36009e410 0x7ff360130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.206+0000 7ff368550700 1 -- 172.21.15.26:0/1024000570 >> 172.21.15.26:0/1024000570 conn(0x7ff360066f50 msgr2=0x7ff36009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:16.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.206+0000 7ff368550700 1 -- 172.21.15.26:0/1024000570 shutdown_connections 2023-10-01T07:56:16.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.206+0000 7ff368550700 1 -- 172.21.15.26:0/1024000570 wait complete. 2023-10-01T07:56:16.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.207+0000 7ff368550700 1 Processor -- start 2023-10-01T07:56:16.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.208+0000 7ff368550700 1 -- start start 2023-10-01T07:56:16.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.208+0000 7ff368550700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff36009d6f0 0x7ff3601c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:16.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.208+0000 7ff368550700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff36009e000 0x7ff3601c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:16.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.208+0000 7ff368550700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff36009e410 0x7ff3601c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:16.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.208+0000 7ff368550700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff360120610 con 0x7ff36009e000 2023-10-01T07:56:16.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.208+0000 7ff368550700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff360125dd0 con 0x7ff36009d6f0 2023-10-01T07:56:16.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.208+0000 7ff368550700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff36009c700 con 0x7ff36009e410 2023-10-01T07:56:16.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.208+0000 7ff3662ec700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff36009d6f0 0x7ff3601c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:16.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.208+0000 7ff366aed700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff36009e410 0x7ff3601c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:16.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.208+0000 7ff3662ec700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff36009d6f0 0x7ff3601c8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:36784/0 (socket says 172.21.15.26:36784) 2023-10-01T07:56:16.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.208+0000 7ff366aed700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff36009e410 0x7ff3601c8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:60354/0 (socket says 172.21.15.26:60354) 2023-10-01T07:56:16.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.208+0000 7ff3662ec700 1 -- 172.21.15.26:0/3865209621 learned_addr learned my addr 172.21.15.26:0/3865209621 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:16.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.208+0000 7ff365aeb700 1 --2- 172.21.15.26:0/3865209621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff36009e000 0x7ff3601c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:16.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.209+0000 7ff366aed700 1 -- 172.21.15.26:0/3865209621 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff36009d6f0 msgr2=0x7ff3601c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:16.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.209+0000 7ff366aed700 1 --2- 172.21.15.26:0/3865209621 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff36009d6f0 0x7ff3601c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.209+0000 7ff366aed700 1 -- 172.21.15.26:0/3865209621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff36009e000 msgr2=0x7ff3601c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:16.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.209+0000 7ff366aed700 1 --2- 172.21.15.26:0/3865209621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff36009e000 0x7ff3601c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.209+0000 7ff366aed700 1 -- 172.21.15.26:0/3865209621 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff358009b30 con 0x7ff36009e410 2023-10-01T07:56:16.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.209+0000 7ff3662ec700 1 --2- 172.21.15.26:0/3865209621 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff36009d6f0 0x7ff3601c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:16.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.209+0000 7ff366aed700 1 --2- 172.21.15.26:0/3865209621 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff36009e410 0x7ff3601c8ef0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff358009e50 tx=0x7ff35800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:16.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.209+0000 7ff35effd700 1 -- 172.21.15.26:0/3865209621 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff358018070 con 0x7ff36009e410 2023-10-01T07:56:16.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.209+0000 7ff35effd700 1 -- 172.21.15.26:0/3865209621 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35800f040 con 0x7ff36009e410 2023-10-01T07:56:16.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.209+0000 7ff368550700 1 -- 172.21.15.26:0/3865209621 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3500094a0 con 0x7ff36009e410 2023-10-01T07:56:16.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.209+0000 7ff35effd700 1 -- 172.21.15.26:0/3865209621 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff358003c40 con 0x7ff36009e410 2023-10-01T07:56:16.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.209+0000 7ff368550700 1 -- 172.21.15.26:0/3865209621 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3601259f0 con 0x7ff36009e410 2023-10-01T07:56:16.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.210+0000 7ff35effd700 1 -- 172.21.15.26:0/3865209621 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff35800c880 con 0x7ff36009e410 2023-10-01T07:56:16.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.210+0000 7ff35effd700 1 -- 172.21.15.26:0/3865209621 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff35803f760 con 0x7ff36009e410 2023-10-01T07:56:16.213 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:16.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.210+0000 7ff368550700 1 -- 172.21.15.26:0/3865209621 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff360125f10 con 0x7ff36009e410 2023-10-01T07:56:16.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.216+0000 7ff35effd700 1 -- 172.21.15.26:0/3865209621 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff360125f10 con 0x7ff36009e410 2023-10-01T07:56:16.251 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:16.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.338+0000 7fb21c7ed700 1 Processor -- start 2023-10-01T07:56:16.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.338+0000 7fb21c7ed700 1 -- start start 2023-10-01T07:56:16.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.339+0000 7fb21c7ed700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb21409d6f0 0x7fb21409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:16.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.339+0000 7fb21c7ed700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb21409e410 0x7fb214134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:16.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.339+0000 7fb21c7ed700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb21409b120 con 0x7fb21409e000 2023-10-01T07:56:16.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.340+0000 7fb21c7ed700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb21406b460 con 0x7fb21409d6f0 2023-10-01T07:56:16.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.340+0000 7fb21c7ed700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb21409a7e0 con 0x7fb21409e410 2023-10-01T07:56:16.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.340+0000 7fb21a589700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb21409d6f0 0x7fb21409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:16.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.340+0000 7fb21a589700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb21409d6f0 0x7fb21409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:36796/0 (socket says 172.21.15.26:36796) 2023-10-01T07:56:16.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.340+0000 7fb21a589700 1 -- 172.21.15.26:0/2000071392 learned_addr learned my addr 172.21.15.26:0/2000071392 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:16.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.340+0000 7fb21ad8a700 1 --2- 172.21.15.26:0/2000071392 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb21409e410 0x7fb214134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:16.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.340+0000 7fb21a589700 1 -- 172.21.15.26:0/2000071392 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb21409e410 msgr2=0x7fb214134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:16.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.340+0000 7fb21a589700 1 --2- 172.21.15.26:0/2000071392 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb21409e410 0x7fb214134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.340+0000 7fb21a589700 1 -- 172.21.15.26:0/2000071392 >> v1:172.21.15.26:6789/0 conn(0x7fb21409e000 legacy=0x7fb2141339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:16.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.340+0000 7fb21a589700 1 -- 172.21.15.26:0/2000071392 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb21409a500 con 0x7fb21409d6f0 2023-10-01T07:56:16.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.340+0000 7fb21a589700 1 --2- 172.21.15.26:0/2000071392 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb21409d6f0 0x7fb21409dac0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb210009920 tx=0x7fb210009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9487b5a96132a365 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:16.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.341+0000 7fb219587700 1 -- 172.21.15.26:0/2000071392 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21000ba60 con 0x7fb21409d6f0 2023-10-01T07:56:16.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.341+0000 7fb219587700 1 -- 172.21.15.26:0/2000071392 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21000bbc0 con 0x7fb21409d6f0 2023-10-01T07:56:16.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.341+0000 7fb219587700 1 -- 172.21.15.26:0/2000071392 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb210009e70 con 0x7fb21409d6f0 2023-10-01T07:56:16.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.341+0000 7fb21c7ed700 1 -- 172.21.15.26:0/2000071392 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb21409d6f0 msgr2=0x7fb21409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:16.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.341+0000 7fb21c7ed700 1 --2- 172.21.15.26:0/2000071392 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb21409d6f0 0x7fb21409dac0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb210009920 tx=0x7fb210009c30 comp rx=0 tx=0).stop 2023-10-01T07:56:16.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.342+0000 7fb21c7ed700 1 -- 172.21.15.26:0/2000071392 shutdown_connections 2023-10-01T07:56:16.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.342+0000 7fb21c7ed700 1 --2- 172.21.15.26:0/2000071392 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb21409e410 0x7fb214134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.342+0000 7fb21c7ed700 1 --2- 172.21.15.26:0/2000071392 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb21409d6f0 0x7fb21409dac0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.342+0000 7fb21c7ed700 1 -- 172.21.15.26:0/2000071392 >> 172.21.15.26:0/2000071392 conn(0x7fb214066f50 msgr2=0x7fb21409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:16.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.342+0000 7fb21c7ed700 1 -- 172.21.15.26:0/2000071392 shutdown_connections 2023-10-01T07:56:16.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.342+0000 7fb21c7ed700 1 -- 172.21.15.26:0/2000071392 wait complete. 2023-10-01T07:56:16.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.343+0000 7fb21c7ed700 1 Processor -- start 2023-10-01T07:56:16.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.343+0000 7fb21c7ed700 1 -- start start 2023-10-01T07:56:16.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.343+0000 7fb21c7ed700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb21409d6f0 0x7fb214122520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:16.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.343+0000 7fb21c7ed700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb21409e000 0x7fb214122a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:16.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.343+0000 7fb21c7ed700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb21409e410 0x7fb214122fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:16.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.343+0000 7fb21c7ed700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb214125410 con 0x7fb21409e000 2023-10-01T07:56:16.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.343+0000 7fb21c7ed700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2140a1e90 con 0x7fb21409d6f0 2023-10-01T07:56:16.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.343+0000 7fb21c7ed700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb21409c710 con 0x7fb21409e410 2023-10-01T07:56:16.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.344+0000 7fb219d88700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb21409e000 0x7fb214122a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:16.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.344+0000 7fb219d88700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb21409e000 0x7fb214122a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60710/0 (socket says 172.21.15.26:60710) 2023-10-01T07:56:16.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.344+0000 7fb219d88700 1 -- 172.21.15.26:0/19703989 learned_addr learned my addr 172.21.15.26:0/19703989 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:16.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.344+0000 7fb21a589700 1 --2- 172.21.15.26:0/19703989 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb21409d6f0 0x7fb214122520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:16.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.344+0000 7fb21ad8a700 1 --2- 172.21.15.26:0/19703989 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb21409e410 0x7fb214122fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:16.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.344+0000 7fb21a589700 1 -- 172.21.15.26:0/19703989 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb21409e410 msgr2=0x7fb214122fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:16.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.344+0000 7fb21a589700 1 --2- 172.21.15.26:0/19703989 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb21409e410 0x7fb214122fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.344+0000 7fb21a589700 1 -- 172.21.15.26:0/19703989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb21409e000 msgr2=0x7fb214122a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:16.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.344+0000 7fb21a589700 1 --2- 172.21.15.26:0/19703989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb21409e000 0x7fb214122a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.344+0000 7fb21a589700 1 -- 172.21.15.26:0/19703989 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb210009550 con 0x7fb21409d6f0 2023-10-01T07:56:16.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.344+0000 7fb219d88700 1 --2- 172.21.15.26:0/19703989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb21409e000 0x7fb214122a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:16.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.344+0000 7fb21a589700 1 --2- 172.21.15.26:0/19703989 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb21409d6f0 0x7fb214122520 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb210009920 tx=0x7fb210004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:16.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.344+0000 7fb20affd700 1 -- 172.21.15.26:0/19703989 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb210004300 con 0x7fb21409d6f0 2023-10-01T07:56:16.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.344+0000 7fb20affd700 1 -- 172.21.15.26:0/19703989 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21001f070 con 0x7fb21409d6f0 2023-10-01T07:56:16.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.344+0000 7fb21c7ed700 1 -- 172.21.15.26:0/19703989 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb214124f50 con 0x7fb21409d6f0 2023-10-01T07:56:16.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.345+0000 7fb20affd700 1 -- 172.21.15.26:0/19703989 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2100036a0 con 0x7fb21409d6f0 2023-10-01T07:56:16.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.345+0000 7fb21c7ed700 1 -- 172.21.15.26:0/19703989 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb214125d60 con 0x7fb21409d6f0 2023-10-01T07:56:16.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.346+0000 7fb20affd700 1 -- 172.21.15.26:0/19703989 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb210021030 con 0x7fb21409d6f0 2023-10-01T07:56:16.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.346+0000 7fb20affd700 1 -- 172.21.15.26:0/19703989 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb210040af0 con 0x7fb21409d6f0 2023-10-01T07:56:16.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.347+0000 7fb21c7ed700 1 -- 172.21.15.26:0/19703989 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb214074ea0 con 0x7fb21409d6f0 2023-10-01T07:56:16.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.352+0000 7fb20affd700 1 -- 172.21.15.26:0/19703989 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb210019970 con 0x7fb21409d6f0 2023-10-01T07:56:16.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.359+0000 7f0d05bd3700 1 Processor -- start 2023-10-01T07:56:16.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.359+0000 7f0d05bd3700 1 -- start start 2023-10-01T07:56:16.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.359+0000 7f0d05bd3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0d000a1510 0x7f0d00138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:16.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.359+0000 7f0d05bd3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d00139250 0x7f0d0013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:16.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.359+0000 7f0d05bd3700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d0009edd0 con 0x7f0d000a0a30 2023-10-01T07:56:16.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.359+0000 7f0d05bd3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d000a18e0 con 0x7f0d000a1510 2023-10-01T07:56:16.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.359+0000 7f0d05bd3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0009e1f0 con 0x7f0d00139250 2023-10-01T07:56:16.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.360+0000 7f0cfeffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0d000a1510 0x7f0d00138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:16.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.360+0000 7f0cfeffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0d000a1510 0x7f0d00138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60712/0 (socket says 172.21.15.26:60712) 2023-10-01T07:56:16.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.360+0000 7f0cfeffd700 1 -- 172.21.15.26:0/104758780 learned_addr learned my addr 172.21.15.26:0/104758780 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:16.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.360+0000 7f0cfffff700 1 --2- 172.21.15.26:0/104758780 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d00139250 0x7f0d0013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:16.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.360+0000 7f0cfffff700 1 -- 172.21.15.26:0/104758780 >> v2:172.21.15.26:3300/0 conn(0x7f0d000a1510 msgr2=0x7f0d00138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:16.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.360+0000 7f0cfffff700 1 --2- 172.21.15.26:0/104758780 >> v2:172.21.15.26:3300/0 conn(0x7f0d000a1510 0x7f0d00138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.360+0000 7f0cfffff700 1 -- 172.21.15.26:0/104758780 >> v1:172.21.15.26:6789/0 conn(0x7f0d000a0a30 legacy=0x7f0d000a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:16.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.360+0000 7f0cfffff700 1 -- 172.21.15.26:0/104758780 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0009dc50 con 0x7f0d00139250 2023-10-01T07:56:16.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.360+0000 7f0cfffff700 1 --2- 172.21.15.26:0/104758780 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d00139250 0x7f0d0013b630 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8009d90 tx=0x7f0cf800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff9c98cf857a7475 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:16.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.360+0000 7f0cfe7fc700 1 -- 172.21.15.26:0/104758780 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf800e070 con 0x7f0d00139250 2023-10-01T07:56:16.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.361+0000 7f0cfe7fc700 1 -- 172.21.15.26:0/104758780 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf800bb20 con 0x7f0d00139250 2023-10-01T07:56:16.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.361+0000 7f0cfe7fc700 1 -- 172.21.15.26:0/104758780 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8012430 con 0x7f0d00139250 2023-10-01T07:56:16.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.361+0000 7f0d05bd3700 1 -- 172.21.15.26:0/104758780 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d00139250 msgr2=0x7f0d0013b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:16.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.361+0000 7f0d05bd3700 1 --2- 172.21.15.26:0/104758780 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d00139250 0x7f0d0013b630 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8009d90 tx=0x7f0cf800b330 comp rx=0 tx=0).stop 2023-10-01T07:56:16.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.361+0000 7f0d05bd3700 1 -- 172.21.15.26:0/104758780 shutdown_connections 2023-10-01T07:56:16.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.361+0000 7f0d05bd3700 1 --2- 172.21.15.26:0/104758780 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d00139250 0x7f0d0013b630 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.361+0000 7f0d05bd3700 1 --2- 172.21.15.26:0/104758780 >> v2:172.21.15.26:3300/0 conn(0x7f0d000a1510 0x7f0d00138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.361+0000 7f0d05bd3700 1 -- 172.21.15.26:0/104758780 >> 172.21.15.26:0/104758780 conn(0x7f0d000a6550 msgr2=0x7f0d000a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:16.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.361+0000 7f0d05bd3700 1 -- 172.21.15.26:0/104758780 shutdown_connections 2023-10-01T07:56:16.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.361+0000 7f0d05bd3700 1 -- 172.21.15.26:0/104758780 wait complete. 2023-10-01T07:56:16.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.362+0000 7f0d05bd3700 1 Processor -- start 2023-10-01T07:56:16.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.363+0000 7f0d05bd3700 1 -- start start 2023-10-01T07:56:16.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.363+0000 7f0d05bd3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d000a0a30 0x7f0d001cc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:16.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.363+0000 7f0d05bd3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d000a1510 0x7f0d001ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:16.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.363+0000 7f0d05bd3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d00139250 0x7f0d001cd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:16.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.363+0000 7f0d05bd3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d00126930 con 0x7f0d000a0a30 2023-10-01T07:56:16.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.363+0000 7f0d05bd3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d00127fa0 con 0x7f0d000a1510 2023-10-01T07:56:16.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.363+0000 7f0d05bd3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d00138c00 con 0x7f0d00139250 2023-10-01T07:56:16.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.363+0000 7f0cfffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d00139250 0x7f0d001cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:16.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.363+0000 7f0cfffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d00139250 0x7f0d001cd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:60394/0 (socket says 172.21.15.26:60394) 2023-10-01T07:56:16.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.363+0000 7f0cfffff700 1 -- 172.21.15.26:0/4158885540 learned_addr learned my addr 172.21.15.26:0/4158885540 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:16.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.363+0000 7f0cff7fe700 1 --2- 172.21.15.26:0/4158885540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d000a0a30 0x7f0d001cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:16.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.363+0000 7f0cfeffd700 1 --2- 172.21.15.26:0/4158885540 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d000a1510 0x7f0d001ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:16.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.364+0000 7f0cfffff700 1 -- 172.21.15.26:0/4158885540 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d000a1510 msgr2=0x7f0d001ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:16.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.364+0000 7f0cfffff700 1 --2- 172.21.15.26:0/4158885540 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d000a1510 0x7f0d001ccc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.364+0000 7f0cfffff700 1 -- 172.21.15.26:0/4158885540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d000a0a30 msgr2=0x7f0d001cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:16.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.364+0000 7f0cfffff700 1 --2- 172.21.15.26:0/4158885540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d000a0a30 0x7f0d001cc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.364+0000 7f0cfffff700 1 -- 172.21.15.26:0/4158885540 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf8009a70 con 0x7f0d00139250 2023-10-01T07:56:16.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.364+0000 7f0cfffff700 1 --2- 172.21.15.26:0/4158885540 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d00139250 0x7f0d001cd180 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8013000 tx=0x7f0cf8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:16.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.364+0000 7f0ce7fff700 1 -- 172.21.15.26:0/4158885540 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8012430 con 0x7f0d00139250 2023-10-01T07:56:16.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.364+0000 7f0ce7fff700 1 -- 172.21.15.26:0/4158885540 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf8020070 con 0x7f0d00139250 2023-10-01T07:56:16.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.364+0000 7f0d05bd3700 1 -- 172.21.15.26:0/4158885540 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d000a0220 con 0x7f0d00139250 2023-10-01T07:56:16.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.364+0000 7f0ce7fff700 1 -- 172.21.15.26:0/4158885540 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8003ea0 con 0x7f0d00139250 2023-10-01T07:56:16.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.364+0000 7f0d05bd3700 1 -- 172.21.15.26:0/4158885540 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d0012a640 con 0x7f0d00139250 2023-10-01T07:56:16.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.366+0000 7f0ce7fff700 1 -- 172.21.15.26:0/4158885540 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0cf8004040 con 0x7f0d00139250 2023-10-01T07:56:16.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.366+0000 7f0d05bd3700 1 -- 172.21.15.26:0/4158885540 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce00052e0 con 0x7f0d00139250 2023-10-01T07:56:16.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.366+0000 7f0ce7fff700 1 -- 172.21.15.26:0/4158885540 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0cf8022070 con 0x7f0d00139250 2023-10-01T07:56:16.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.375+0000 7f0ce7fff700 1 -- 172.21.15.26:0/4158885540 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0cf801a970 con 0x7f0d00139250 2023-10-01T07:56:16.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.434+0000 7ff368550700 1 -- 172.21.15.26:0/3865209621 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff360125f10 con 0x7ff36009e410 2023-10-01T07:56:16.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.434+0000 7ff35effd700 1 -- 172.21.15.26:0/3865209621 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff360125f10 con 0x7ff36009e410 2023-10-01T07:56:16.435 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:16.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.437+0000 7ff368550700 1 -- 172.21.15.26:0/3865209621 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff36009e410 msgr2=0x7ff3601c8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:16.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.437+0000 7ff368550700 1 --2- 172.21.15.26:0/3865209621 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff36009e410 0x7ff3601c8ef0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff358009e50 tx=0x7ff35800c3a0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.437+0000 7ff368550700 1 -- 172.21.15.26:0/3865209621 shutdown_connections 2023-10-01T07:56:16.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.437+0000 7ff368550700 1 --2- 172.21.15.26:0/3865209621 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff36009e410 0x7ff3601c8ef0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.437+0000 7ff368550700 1 --2- 172.21.15.26:0/3865209621 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff36009d6f0 0x7ff3601c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.437+0000 7ff368550700 1 --2- 172.21.15.26:0/3865209621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff36009e000 0x7ff3601c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.437+0000 7ff368550700 1 -- 172.21.15.26:0/3865209621 >> 172.21.15.26:0/3865209621 conn(0x7ff360066f50 msgr2=0x7ff360070130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:16.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.440+0000 7ff368550700 1 -- 172.21.15.26:0/3865209621 shutdown_connections 2023-10-01T07:56:16.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.440+0000 7ff368550700 1 -- 172.21.15.26:0/3865209621 wait complete. 2023-10-01T07:56:16.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.442+0000 7f42ddd4e700 1 Processor -- start 2023-10-01T07:56:16.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.442+0000 7f42ddd4e700 1 -- start start 2023-10-01T07:56:16.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.442+0000 7f42ddd4e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f42d8133420 0x7f42d81337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:16.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.442+0000 7f42ddd4e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f42d8133e30 0x7f42d812ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:16.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.442+0000 7f42ddd4e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f42d8134260 0x7f42d81304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:16.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.442+0000 7f42ddd4e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d806b990 con 0x7f42d8134260 2023-10-01T07:56:16.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.442+0000 7f42ddd4e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d80a0590 con 0x7f42d8133420 2023-10-01T07:56:16.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.442+0000 7f42ddd4e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42d809fb80 con 0x7f42d8133e30 2023-10-01T07:56:16.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.442+0000 7f42d77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f42d8133420 0x7f42d81337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:16.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.442+0000 7f42d77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f42d8133420 0x7f42d81337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:36818/0 (socket says 172.21.15.26:36818) 2023-10-01T07:56:16.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.442+0000 7f42d77fe700 1 -- 172.21.15.26:0/3382836118 learned_addr learned my addr 172.21.15.26:0/3382836118 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:16.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.443+0000 7f42d6ffd700 1 --2- 172.21.15.26:0/3382836118 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f42d8133e30 0x7f42d812ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:16.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.443+0000 7f42d7fff700 1 --2- 172.21.15.26:0/3382836118 >> v2:172.21.15.26:3300/0 conn(0x7f42d8134260 0x7f42d81304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:16.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.443+0000 7f42d77fe700 1 -- 172.21.15.26:0/3382836118 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f42d8133e30 msgr2=0x7f42d812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:16.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.443+0000 7f42d77fe700 1 --2- 172.21.15.26:0/3382836118 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f42d8133e30 0x7f42d812ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.443+0000 7f42d77fe700 1 -- 172.21.15.26:0/3382836118 >> v2:172.21.15.26:3300/0 conn(0x7f42d8134260 msgr2=0x7f42d81304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:16.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.443+0000 7f42d77fe700 1 --2- 172.21.15.26:0/3382836118 >> v2:172.21.15.26:3300/0 conn(0x7f42d8134260 0x7f42d81304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.443+0000 7f42d77fe700 1 -- 172.21.15.26:0/3382836118 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d80a0030 con 0x7f42d8133420 2023-10-01T07:56:16.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.443+0000 7f42d7fff700 1 --2- 172.21.15.26:0/3382836118 >> v2:172.21.15.26:3300/0 conn(0x7f42d8134260 0x7f42d81304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:56:16.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.443+0000 7f42d77fe700 1 --2- 172.21.15.26:0/3382836118 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f42d8133420 0x7f42d81337f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f42c80098f0 tx=0x7f42c8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e3be122e1856460 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:16.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.443+0000 7f42d67fc700 1 -- 172.21.15.26:0/3382836118 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c8011830 con 0x7f42d8133420 2023-10-01T07:56:16.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.443+0000 7f42d67fc700 1 -- 172.21.15.26:0/3382836118 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c8011990 con 0x7f42d8133420 2023-10-01T07:56:16.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.443+0000 7f42d67fc700 1 -- 172.21.15.26:0/3382836118 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c8011d20 con 0x7f42d8133420 2023-10-01T07:56:16.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.444+0000 7f42ddd4e700 1 -- 172.21.15.26:0/3382836118 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f42d8133420 msgr2=0x7f42d81337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:16.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.444+0000 7f42ddd4e700 1 --2- 172.21.15.26:0/3382836118 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f42d8133420 0x7f42d81337f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f42c80098f0 tx=0x7f42c8009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:16.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.444+0000 7f42ddd4e700 1 -- 172.21.15.26:0/3382836118 shutdown_connections 2023-10-01T07:56:16.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.444+0000 7f42ddd4e700 1 --2- 172.21.15.26:0/3382836118 >> v2:172.21.15.26:3300/0 conn(0x7f42d8134260 0x7f42d81304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.444+0000 7f42ddd4e700 1 --2- 172.21.15.26:0/3382836118 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f42d8133420 0x7f42d81337f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.444+0000 7f42ddd4e700 1 --2- 172.21.15.26:0/3382836118 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f42d8133e30 0x7f42d812ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.444+0000 7f42ddd4e700 1 -- 172.21.15.26:0/3382836118 >> 172.21.15.26:0/3382836118 conn(0x7f42d80a4210 msgr2=0x7f42d80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:16.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.444+0000 7f42ddd4e700 1 -- 172.21.15.26:0/3382836118 shutdown_connections 2023-10-01T07:56:16.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.444+0000 7f42ddd4e700 1 -- 172.21.15.26:0/3382836118 wait complete. 2023-10-01T07:56:16.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.445+0000 7f42ddd4e700 1 Processor -- start 2023-10-01T07:56:16.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.446+0000 7f42ddd4e700 1 -- start start 2023-10-01T07:56:16.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.446+0000 7f42ddd4e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f42d8133420 0x7f42d809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:16.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.446+0000 7f42ddd4e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f42d8133e30 0x7f42d809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:16.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.446+0000 7f42ddd4e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42d8134260 0x7f42d809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:16.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.446+0000 7f42ddd4e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d811fd10 con 0x7f42d8134260 2023-10-01T07:56:16.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.446+0000 7f42ddd4e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d811ff10 con 0x7f42d8133e30 2023-10-01T07:56:16.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.447+0000 7f42ddd4e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42d812db80 con 0x7f42d8133420 2023-10-01T07:56:16.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.447+0000 7f42d77fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f42d8133420 0x7f42d809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:16.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.447+0000 7f42d77fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f42d8133420 0x7f42d809c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:60418/0 (socket says 172.21.15.26:60418) 2023-10-01T07:56:16.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.447+0000 7f42d77fe700 1 -- 172.21.15.26:0/1160297461 learned_addr learned my addr 172.21.15.26:0/1160297461 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:16.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.447+0000 7f42d6ffd700 1 --2- 172.21.15.26:0/1160297461 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f42d8133e30 0x7f42d809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:16.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.447+0000 7f42d6ffd700 1 -- 172.21.15.26:0/1160297461 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f42d8133420 msgr2=0x7f42d809c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:16.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.447+0000 7f42d6ffd700 1 --2- 172.21.15.26:0/1160297461 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f42d8133420 0x7f42d809c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.447+0000 7f42d6ffd700 1 -- 172.21.15.26:0/1160297461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42d8134260 msgr2=0x7f42d809cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:16.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.447+0000 7f42d6ffd700 1 --2- 172.21.15.26:0/1160297461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42d8134260 0x7f42d809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.447+0000 7f42d6ffd700 1 -- 172.21.15.26:0/1160297461 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c8009550 con 0x7f42d8133e30 2023-10-01T07:56:16.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.447+0000 7f42d77fe700 1 --2- 172.21.15.26:0/1160297461 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f42d8133420 0x7f42d809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:16.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.447+0000 7f42d6ffd700 1 --2- 172.21.15.26:0/1160297461 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f42d8133e30 0x7f42d809c9c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f42cc00e8d0 tx=0x7f42cc00ebe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:16.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.448+0000 7f42bffff700 1 -- 172.21.15.26:0/1160297461 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc004020 con 0x7f42d8133e30 2023-10-01T07:56:16.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.448+0000 7f42bffff700 1 -- 172.21.15.26:0/1160297461 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42cc004180 con 0x7f42d8133e30 2023-10-01T07:56:16.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.448+0000 7f42ddd4e700 1 -- 172.21.15.26:0/1160297461 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d8120980 con 0x7f42d8133e30 2023-10-01T07:56:16.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.448+0000 7f42bffff700 1 -- 172.21.15.26:0/1160297461 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc004530 con 0x7f42d8133e30 2023-10-01T07:56:16.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.448+0000 7f42ddd4e700 1 -- 172.21.15.26:0/1160297461 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d809de30 con 0x7f42d8133e30 2023-10-01T07:56:16.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.449+0000 7f42ddd4e700 1 -- 172.21.15.26:0/1160297461 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d8074ea0 con 0x7f42d8133e30 2023-10-01T07:56:16.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.450+0000 7f42bffff700 1 -- 172.21.15.26:0/1160297461 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f42cc0036a0 con 0x7f42d8133e30 2023-10-01T07:56:16.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.450+0000 7f42bffff700 1 -- 172.21.15.26:0/1160297461 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f42cc03f3a0 con 0x7f42d8133e30 2023-10-01T07:56:16.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.455+0000 7f42bffff700 1 -- 172.21.15.26:0/1160297461 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f42cc013680 con 0x7f42d8133e30 2023-10-01T07:56:16.458 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:16.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.582+0000 7f0d05bd3700 1 -- 172.21.15.26:0/4158885540 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0ce0005590 con 0x7f0d00139250 2023-10-01T07:56:16.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.582+0000 7f0ce7fff700 1 -- 172.21.15.26:0/4158885540 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0cf8041020 con 0x7f0d00139250 2023-10-01T07:56:16.584 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:16.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.584+0000 7f0d05bd3700 1 -- 172.21.15.26:0/4158885540 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d00139250 msgr2=0x7f0d001cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:16.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.584+0000 7f0d05bd3700 1 --2- 172.21.15.26:0/4158885540 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d00139250 0x7f0d001cd180 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8013000 tx=0x7f0cf8004ad0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.585+0000 7f0d05bd3700 1 -- 172.21.15.26:0/4158885540 shutdown_connections 2023-10-01T07:56:16.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.585+0000 7f0d05bd3700 1 --2- 172.21.15.26:0/4158885540 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d00139250 0x7f0d001cd180 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.585+0000 7f0d05bd3700 1 --2- 172.21.15.26:0/4158885540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d000a0a30 0x7f0d001cc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.585+0000 7f0d05bd3700 1 --2- 172.21.15.26:0/4158885540 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d000a1510 0x7f0d001ccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.585+0000 7f0d05bd3700 1 -- 172.21.15.26:0/4158885540 >> 172.21.15.26:0/4158885540 conn(0x7f0d000a6550 msgr2=0x7f0d000a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:16.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.585+0000 7f0d05bd3700 1 -- 172.21.15.26:0/4158885540 shutdown_connections 2023-10-01T07:56:16.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.585+0000 7f0d05bd3700 1 -- 172.21.15.26:0/4158885540 wait complete. 2023-10-01T07:56:16.599 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:16.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.615+0000 7fb21c7ed700 1 -- 172.21.15.26:0/19703989 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb214126830 con 0x7fb21409d6f0 2023-10-01T07:56:16.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.616+0000 7fb20affd700 1 -- 172.21.15.26:0/19703989 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb210015030 con 0x7fb21409d6f0 2023-10-01T07:56:16.616 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:16.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.618+0000 7fb21c7ed700 1 -- 172.21.15.26:0/19703989 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb21409d6f0 msgr2=0x7fb214122520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:16.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.618+0000 7fb21c7ed700 1 --2- 172.21.15.26:0/19703989 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb21409d6f0 0x7fb214122520 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb210009920 tx=0x7fb210004750 comp rx=0 tx=0).stop 2023-10-01T07:56:16.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.618+0000 7fb21c7ed700 1 -- 172.21.15.26:0/19703989 shutdown_connections 2023-10-01T07:56:16.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.618+0000 7fb21c7ed700 1 --2- 172.21.15.26:0/19703989 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb21409e410 0x7fb214122fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.618+0000 7fb21c7ed700 1 --2- 172.21.15.26:0/19703989 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb21409d6f0 0x7fb214122520 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.618+0000 7fb21c7ed700 1 --2- 172.21.15.26:0/19703989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb21409e000 0x7fb214122a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.618+0000 7fb21c7ed700 1 -- 172.21.15.26:0/19703989 >> 172.21.15.26:0/19703989 conn(0x7fb214066f50 msgr2=0x7fb21406f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:16.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.618+0000 7fb21c7ed700 1 -- 172.21.15.26:0/19703989 shutdown_connections 2023-10-01T07:56:16.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.618+0000 7fb21c7ed700 1 -- 172.21.15.26:0/19703989 wait complete. 2023-10-01T07:56:16.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:16.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.675+0000 7f42ddd4e700 1 -- 172.21.15.26:0/1160297461 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f42d806b250 con 0x7f42d8133e30 2023-10-01T07:56:16.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.675+0000 7f42bffff700 1 -- 172.21.15.26:0/1160297461 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f42cc020070 con 0x7f42d8133e30 2023-10-01T07:56:16.676 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:16.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.678+0000 7f42ddd4e700 1 -- 172.21.15.26:0/1160297461 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f42d8133e30 msgr2=0x7f42d809c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:16.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.678+0000 7f42ddd4e700 1 --2- 172.21.15.26:0/1160297461 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f42d8133e30 0x7f42d809c9c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f42cc00e8d0 tx=0x7f42cc00ebe0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.678+0000 7f42ddd4e700 1 -- 172.21.15.26:0/1160297461 shutdown_connections 2023-10-01T07:56:16.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.678+0000 7f42ddd4e700 1 --2- 172.21.15.26:0/1160297461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42d8134260 0x7f42d809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.678+0000 7f42ddd4e700 1 --2- 172.21.15.26:0/1160297461 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f42d8133420 0x7f42d809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.678+0000 7f42ddd4e700 1 --2- 172.21.15.26:0/1160297461 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f42d8133e30 0x7f42d809c9c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:16.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.678+0000 7f42ddd4e700 1 -- 172.21.15.26:0/1160297461 >> 172.21.15.26:0/1160297461 conn(0x7f42d80a4210 msgr2=0x7f42d80a0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:16.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.678+0000 7f42ddd4e700 1 -- 172.21.15.26:0/1160297461 shutdown_connections 2023-10-01T07:56:16.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:16.678+0000 7f42ddd4e700 1 -- 172.21.15.26:0/1160297461 wait complete. 2023-10-01T07:56:16.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:17.459 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:17.600 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:17.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.605+0000 7f95e706d700 1 Processor -- start 2023-10-01T07:56:17.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.605+0000 7f95e706d700 1 -- start start 2023-10-01T07:56:17.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.606+0000 7f95e706d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f95e009d6f0 0x7f95e009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:17.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.606+0000 7f95e706d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f95e009e440 0x7f95e0134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:17.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.606+0000 7f95e706d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95e009b120 con 0x7f95e009e000 2023-10-01T07:56:17.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.606+0000 7f95e706d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e006b460 con 0x7f95e009d6f0 2023-10-01T07:56:17.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.606+0000 7f95e706d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95e009a7e0 con 0x7f95e009e440 2023-10-01T07:56:17.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.606+0000 7f95e560a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f95e009e440 0x7f95e0134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:17.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.606+0000 7f95e4e09700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f95e009d6f0 0x7f95e009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:17.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.606+0000 7f95e560a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f95e009e440 0x7f95e0134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:60424/0 (socket says 172.21.15.26:60424) 2023-10-01T07:56:17.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.606+0000 7f95e560a700 1 -- 172.21.15.26:0/844495189 learned_addr learned my addr 172.21.15.26:0/844495189 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:17.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.606+0000 7f95e560a700 1 -- 172.21.15.26:0/844495189 >> v2:172.21.15.26:3300/0 conn(0x7f95e009d6f0 msgr2=0x7f95e009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:17.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.606+0000 7f95e560a700 1 --2- 172.21.15.26:0/844495189 >> v2:172.21.15.26:3300/0 conn(0x7f95e009d6f0 0x7f95e009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:17.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.606+0000 7f95e560a700 1 -- 172.21.15.26:0/844495189 >> v1:172.21.15.26:6789/0 conn(0x7f95e009e000 legacy=0x7f95e01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:17.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.606+0000 7f95e560a700 1 -- 172.21.15.26:0/844495189 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e009a500 con 0x7f95e009e440 2023-10-01T07:56:17.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.606+0000 7f95e4e09700 1 --2- 172.21.15.26:0/844495189 >> v2:172.21.15.26:3300/0 conn(0x7f95e009d6f0 0x7f95e009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:17.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.607+0000 7f95e560a700 1 --2- 172.21.15.26:0/844495189 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f95e009e440 0x7f95e0134100 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009920 tx=0x7f95d8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=244a41a2fd0e0aa4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:17.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.607+0000 7f95df7fe700 1 -- 172.21.15.26:0/844495189 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d8011830 con 0x7f95e009e440 2023-10-01T07:56:17.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.607+0000 7f95df7fe700 1 -- 172.21.15.26:0/844495189 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d8011990 con 0x7f95e009e440 2023-10-01T07:56:17.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.607+0000 7f95df7fe700 1 -- 172.21.15.26:0/844495189 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d8011d20 con 0x7f95e009e440 2023-10-01T07:56:17.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.607+0000 7f95e706d700 1 -- 172.21.15.26:0/844495189 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f95e009e440 msgr2=0x7f95e0134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:17.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.608+0000 7f95e706d700 1 --2- 172.21.15.26:0/844495189 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f95e009e440 0x7f95e0134100 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009920 tx=0x7f95d8009c30 comp rx=0 tx=0).stop 2023-10-01T07:56:17.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.608+0000 7f95e706d700 1 -- 172.21.15.26:0/844495189 shutdown_connections 2023-10-01T07:56:17.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.608+0000 7f95e706d700 1 --2- 172.21.15.26:0/844495189 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f95e009e440 0x7f95e0134100 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:17.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.608+0000 7f95e706d700 1 --2- 172.21.15.26:0/844495189 >> v2:172.21.15.26:3300/0 conn(0x7f95e009d6f0 0x7f95e009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:17.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.608+0000 7f95e706d700 1 -- 172.21.15.26:0/844495189 >> 172.21.15.26:0/844495189 conn(0x7f95e0066f50 msgr2=0x7f95e009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:17.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.608+0000 7f95e706d700 1 -- 172.21.15.26:0/844495189 shutdown_connections 2023-10-01T07:56:17.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.608+0000 7f95e706d700 1 -- 172.21.15.26:0/844495189 wait complete. 2023-10-01T07:56:17.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.609+0000 7f95e706d700 1 Processor -- start 2023-10-01T07:56:17.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.609+0000 7f95e706d700 1 -- start start 2023-10-01T07:56:17.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.609+0000 7f95e706d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f95e009d6f0 0x7f95e01a5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:17.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.609+0000 7f95e706d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95e009e000 0x7f95e01a6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:17.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.610+0000 7f95e706d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f95e009e440 0x7f95e01a6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:17.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.610+0000 7f95e706d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e01aa2e0 con 0x7f95e009e000 2023-10-01T07:56:17.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.610+0000 7f95e706d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e01a9920 con 0x7f95e009e440 2023-10-01T07:56:17.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.610+0000 7f95e706d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95e01a8c60 con 0x7f95e009d6f0 2023-10-01T07:56:17.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.610+0000 7f95e4e09700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f95e009d6f0 0x7f95e01a5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:17.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.610+0000 7f95dffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95e009e000 0x7f95e01a6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:17.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.610+0000 7f95e4e09700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f95e009d6f0 0x7f95e01a5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:60436/0 (socket says 172.21.15.26:60436) 2023-10-01T07:56:17.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.610+0000 7f95e4e09700 1 -- 172.21.15.26:0/3384547158 learned_addr learned my addr 172.21.15.26:0/3384547158 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:17.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.610+0000 7f95e560a700 1 --2- 172.21.15.26:0/3384547158 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f95e009e440 0x7f95e01a6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:17.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.610+0000 7f95dffff700 1 -- 172.21.15.26:0/3384547158 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f95e009d6f0 msgr2=0x7f95e01a5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:17.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.610+0000 7f95dffff700 1 --2- 172.21.15.26:0/3384547158 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f95e009d6f0 0x7f95e01a5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:17.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.610+0000 7f95dffff700 1 -- 172.21.15.26:0/3384547158 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f95e009e440 msgr2=0x7f95e01a6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:17.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.610+0000 7f95dffff700 1 --2- 172.21.15.26:0/3384547158 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f95e009e440 0x7f95e01a6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:17.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.610+0000 7f95dffff700 1 -- 172.21.15.26:0/3384547158 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d0009a70 con 0x7f95e009e000 2023-10-01T07:56:17.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.610+0000 7f95e4e09700 1 --2- 172.21.15.26:0/3384547158 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f95e009d6f0 0x7f95e01a5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:17.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.610+0000 7f95dffff700 1 --2- 172.21.15.26:0/3384547158 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95e009e000 0x7f95e01a6340 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f95d4000f60 tx=0x7f95d400c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:17.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.610+0000 7f95dd7fa700 1 -- 172.21.15.26:0/3384547158 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d40052d0 con 0x7f95e009e000 2023-10-01T07:56:17.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.611+0000 7f95dd7fa700 1 -- 172.21.15.26:0/3384547158 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d4005430 con 0x7f95e009e000 2023-10-01T07:56:17.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.611+0000 7f95e706d700 1 -- 172.21.15.26:0/3384547158 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95d8009550 con 0x7f95e009e000 2023-10-01T07:56:17.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.611+0000 7f95dd7fa700 1 -- 172.21.15.26:0/3384547158 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d40038c0 con 0x7f95e009e000 2023-10-01T07:56:17.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.611+0000 7f95e706d700 1 -- 172.21.15.26:0/3384547158 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e01a7a10 con 0x7f95e009e000 2023-10-01T07:56:17.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.611+0000 7f95dd7fa700 1 -- 172.21.15.26:0/3384547158 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f95d4003a20 con 0x7f95e009e000 2023-10-01T07:56:17.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.612+0000 7f95dd7fa700 1 -- 172.21.15.26:0/3384547158 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f95d403e970 con 0x7f95e009e000 2023-10-01T07:56:17.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.612+0000 7f95e706d700 1 -- 172.21.15.26:0/3384547158 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e0074ea0 con 0x7f95e009e000 2023-10-01T07:56:17.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.618+0000 7f95dd7fa700 1 -- 172.21.15.26:0/3384547158 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f95d4011590 con 0x7f95e009e000 2023-10-01T07:56:17.633 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:17.693 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:17.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.753+0000 7f7f4744c700 1 Processor -- start 2023-10-01T07:56:17.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.753+0000 7f7f4744c700 1 -- start start 2023-10-01T07:56:17.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.754+0000 7f7f4744c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f4006e570 0x7f7f4006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:17.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.754+0000 7f7f4744c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7f4009eca0 0x7f7f4006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:17.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.754+0000 7f7f4744c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7f40134610 0x7f7f40134a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:17.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.754+0000 7f7f4744c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f40070ee0 con 0x7f7f4009eca0 2023-10-01T07:56:17.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.754+0000 7f7f4744c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f40071480 con 0x7f7f4006e570 2023-10-01T07:56:17.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.754+0000 7f7f4744c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4006f3c0 con 0x7f7f40134610 2023-10-01T07:56:17.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.754+0000 7f7f451e8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f4006e570 0x7f7f4006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:17.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.754+0000 7f7f451e8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f4006e570 0x7f7f4006e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:36844/0 (socket says 172.21.15.26:36844) 2023-10-01T07:56:17.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.754+0000 7f7f451e8700 1 -- 172.21.15.26:0/2954676893 learned_addr learned my addr 172.21.15.26:0/2954676893 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:17.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.754+0000 7f7f449e7700 1 --2- 172.21.15.26:0/2954676893 >> v2:172.21.15.26:3300/0 conn(0x7f7f4009eca0 0x7f7f4006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:17.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.754+0000 7f7f459e9700 1 --2- 172.21.15.26:0/2954676893 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7f40134610 0x7f7f40134a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:17.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.754+0000 7f7f451e8700 1 -- 172.21.15.26:0/2954676893 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7f40134610 msgr2=0x7f7f40134a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:17.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.755+0000 7f7f451e8700 1 --2- 172.21.15.26:0/2954676893 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7f40134610 0x7f7f40134a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:17.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.755+0000 7f7f451e8700 1 -- 172.21.15.26:0/2954676893 >> v2:172.21.15.26:3300/0 conn(0x7f7f4009eca0 msgr2=0x7f7f4006ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:17.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.755+0000 7f7f451e8700 1 --2- 172.21.15.26:0/2954676893 >> v2:172.21.15.26:3300/0 conn(0x7f7f4009eca0 0x7f7f4006ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:17.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.755+0000 7f7f451e8700 1 -- 172.21.15.26:0/2954676893 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f40071b90 con 0x7f7f4006e570 2023-10-01T07:56:17.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.755+0000 7f7f451e8700 1 --2- 172.21.15.26:0/2954676893 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f4006e570 0x7f7f4006e940 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c0098f0 tx=0x7f7f3c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be68f390befc6b6b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:17.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.755+0000 7f7f37fff700 1 -- 172.21.15.26:0/2954676893 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c011830 con 0x7f7f4006e570 2023-10-01T07:56:17.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.755+0000 7f7f37fff700 1 -- 172.21.15.26:0/2954676893 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3c011990 con 0x7f7f4006e570 2023-10-01T07:56:17.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.755+0000 7f7f37fff700 1 -- 172.21.15.26:0/2954676893 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c011d20 con 0x7f7f4006e570 2023-10-01T07:56:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.756+0000 7f7f4744c700 1 -- 172.21.15.26:0/2954676893 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f4006e570 msgr2=0x7f7f4006e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.756+0000 7f7f4744c700 1 --2- 172.21.15.26:0/2954676893 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f4006e570 0x7f7f4006e940 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c0098f0 tx=0x7f7f3c009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.756+0000 7f7f4744c700 1 -- 172.21.15.26:0/2954676893 shutdown_connections 2023-10-01T07:56:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.756+0000 7f7f4744c700 1 --2- 172.21.15.26:0/2954676893 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7f40134610 0x7f7f40134a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.756+0000 7f7f4744c700 1 --2- 172.21.15.26:0/2954676893 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f4006e570 0x7f7f4006e940 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.756+0000 7f7f4744c700 1 --2- 172.21.15.26:0/2954676893 >> v2:172.21.15.26:3300/0 conn(0x7f7f4009eca0 0x7f7f4006ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.756+0000 7f7f4744c700 1 -- 172.21.15.26:0/2954676893 >> 172.21.15.26:0/2954676893 conn(0x7f7f400a2aa0 msgr2=0x7f7f400a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.756+0000 7f7f4744c700 1 -- 172.21.15.26:0/2954676893 shutdown_connections 2023-10-01T07:56:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.756+0000 7f7f4744c700 1 -- 172.21.15.26:0/2954676893 wait complete. 2023-10-01T07:56:17.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.758+0000 7f7f4744c700 1 Processor -- start 2023-10-01T07:56:17.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.758+0000 7f7f4744c700 1 -- start start 2023-10-01T07:56:17.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.758+0000 7f7f4744c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f4006e570 0x7f7f401214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:17.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.759+0000 7f7f4744c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f40134610 0x7f7f40121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:17.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.759+0000 7f7f4744c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7f40121f60 0x7f7f401d2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:17.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.759+0000 7f7f4744c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f40124940 con 0x7f7f4006e570 2023-10-01T07:56:17.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.759+0000 7f7f4744c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f401252b0 con 0x7f7f40134610 2023-10-01T07:56:17.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.759+0000 7f7f4744c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f40123010 con 0x7f7f40121f60 2023-10-01T07:56:17.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.759+0000 7f7f459e9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7f40121f60 0x7f7f401d2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:17.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.759+0000 7f7f449e7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f40134610 0x7f7f40121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:17.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.759+0000 7f7f459e9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7f40121f60 0x7f7f401d2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:60442/0 (socket says 172.21.15.26:60442) 2023-10-01T07:56:17.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.759+0000 7f7f449e7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f40134610 0x7f7f40121a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:36860/0 (socket says 172.21.15.26:36860) 2023-10-01T07:56:17.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.759+0000 7f7f459e9700 1 -- 172.21.15.26:0/967803783 learned_addr learned my addr 172.21.15.26:0/967803783 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:17.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.759+0000 7f7f451e8700 1 --2- 172.21.15.26:0/967803783 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f4006e570 0x7f7f401214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:17.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.759+0000 7f7f459e9700 1 -- 172.21.15.26:0/967803783 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f40134610 msgr2=0x7f7f40121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:17.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.759+0000 7f7f459e9700 1 --2- 172.21.15.26:0/967803783 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f40134610 0x7f7f40121a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:17.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.759+0000 7f7f459e9700 1 -- 172.21.15.26:0/967803783 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f4006e570 msgr2=0x7f7f401214e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:17.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.759+0000 7f7f459e9700 1 --2- 172.21.15.26:0/967803783 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f4006e570 0x7f7f401214e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:17.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.759+0000 7f7f459e9700 1 -- 172.21.15.26:0/967803783 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3c009550 con 0x7f7f40121f60 2023-10-01T07:56:17.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.759+0000 7f7f451e8700 1 --2- 172.21.15.26:0/967803783 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f4006e570 0x7f7f401214e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:56:17.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.759+0000 7f7f449e7700 1 --2- 172.21.15.26:0/967803783 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f40134610 0x7f7f40121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:17.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.759+0000 7f7f459e9700 1 --2- 172.21.15.26:0/967803783 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7f40121f60 0x7f7f401d2d20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7f3800efc0 tx=0x7f7f3800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:17.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.760+0000 7f7f35ffb700 1 -- 172.21.15.26:0/967803783 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f38009ea0 con 0x7f7f40121f60 2023-10-01T07:56:17.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.760+0000 7f7f35ffb700 1 -- 172.21.15.26:0/967803783 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3800f040 con 0x7f7f40121f60 2023-10-01T07:56:17.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.760+0000 7f7f35ffb700 1 -- 172.21.15.26:0/967803783 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f38014480 con 0x7f7f40121f60 2023-10-01T07:56:17.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.760+0000 7f7f4744c700 1 -- 172.21.15.26:0/967803783 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f401240d0 con 0x7f7f40121f60 2023-10-01T07:56:17.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.760+0000 7f7f4744c700 1 -- 172.21.15.26:0/967803783 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f400a2250 con 0x7f7f40121f60 2023-10-01T07:56:17.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.761+0000 7f7f4744c700 1 -- 172.21.15.26:0/967803783 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f4009b1e0 con 0x7f7f40121f60 2023-10-01T07:56:17.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.761+0000 7f7f35ffb700 1 -- 172.21.15.26:0/967803783 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7f380145e0 con 0x7f7f40121f60 2023-10-01T07:56:17.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.762+0000 7f7f35ffb700 1 -- 172.21.15.26:0/967803783 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7f38040160 con 0x7f7f40121f60 2023-10-01T07:56:17.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.766+0000 7f7f35ffb700 1 -- 172.21.15.26:0/967803783 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7f38007920 con 0x7f7f40121f60 2023-10-01T07:56:17.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.791+0000 7f2737f3d700 1 Processor -- start 2023-10-01T07:56:17.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.791+0000 7f2737f3d700 1 -- start start 2023-10-01T07:56:17.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.792+0000 7f2737f3d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f27301316c0 0x7f2730131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:17.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.792+0000 7f2737f3d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f273009d9f0 0x7f273006a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:17.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.792+0000 7f2737f3d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f273009e130 con 0x7f273006acb0 2023-10-01T07:56:17.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.792+0000 7f2737f3d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27301312b0 con 0x7f273009d9f0 2023-10-01T07:56:17.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.792+0000 7f2737f3d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273009f6e0 con 0x7f27301316c0 2023-10-01T07:56:17.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.792+0000 7f2735cd9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f27301316c0 0x7f2730131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:17.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.792+0000 7f27364da700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f273006acb0 0x7f2730138540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54762/0 (socket says 172.21.15.26:54762) 2023-10-01T07:56:17.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.792+0000 7f27364da700 1 -- 172.21.15.26:0/2913710999 learned_addr learned my addr 172.21.15.26:0/2913710999 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:17.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.792+0000 7f27354d8700 1 --2- 172.21.15.26:0/2913710999 >> v2:172.21.15.26:3300/0 conn(0x7f273009d9f0 0x7f273006a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:17.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.793+0000 7f2734cd7700 1 -- 172.21.15.26:0/2913710999 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3609671879 0 0) 0x7f2728001490 con 0x7f273006acb0 2023-10-01T07:56:17.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.793+0000 7f2735cd9700 1 -- 172.21.15.26:0/2913710999 >> v2:172.21.15.26:3300/0 conn(0x7f273009d9f0 msgr2=0x7f273006a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:17.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.793+0000 7f2735cd9700 1 --2- 172.21.15.26:0/2913710999 >> v2:172.21.15.26:3300/0 conn(0x7f273009d9f0 0x7f273006a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:17.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.793+0000 7f2735cd9700 1 -- 172.21.15.26:0/2913710999 >> v1:172.21.15.26:6789/0 conn(0x7f273006acb0 legacy=0x7f2730138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:17.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.793+0000 7f2735cd9700 1 -- 172.21.15.26:0/2913710999 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273009e760 con 0x7f27301316c0 2023-10-01T07:56:17.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.793+0000 7f27354d8700 1 --2- 172.21.15.26:0/2913710999 >> v2:172.21.15.26:3300/0 conn(0x7f273009d9f0 0x7f273006a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:17.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.793+0000 7f2735cd9700 1 --2- 172.21.15.26:0/2913710999 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f27301316c0 0x7f2730131a90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f272c009840 tx=0x7f272c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59251b89c1d2f5ee server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:17.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.793+0000 7f2734cd7700 1 -- 172.21.15.26:0/2913710999 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c011830 con 0x7f27301316c0 2023-10-01T07:56:17.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.793+0000 7f2734cd7700 1 -- 172.21.15.26:0/2913710999 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272c011990 con 0x7f27301316c0 2023-10-01T07:56:17.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.793+0000 7f2734cd7700 1 -- 172.21.15.26:0/2913710999 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c011d20 con 0x7f27301316c0 2023-10-01T07:56:17.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.794+0000 7f2737f3d700 1 -- 172.21.15.26:0/2913710999 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f27301316c0 msgr2=0x7f2730131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:17.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.794+0000 7f2737f3d700 1 --2- 172.21.15.26:0/2913710999 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f27301316c0 0x7f2730131a90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f272c009840 tx=0x7f272c009b50 comp rx=0 tx=0).stop 2023-10-01T07:56:17.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.794+0000 7f2737f3d700 1 -- 172.21.15.26:0/2913710999 shutdown_connections 2023-10-01T07:56:17.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.794+0000 7f2737f3d700 1 --2- 172.21.15.26:0/2913710999 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f27301316c0 0x7f2730131a90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:17.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.794+0000 7f2737f3d700 1 --2- 172.21.15.26:0/2913710999 >> v2:172.21.15.26:3300/0 conn(0x7f273009d9f0 0x7f273006a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:17.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.794+0000 7f2737f3d700 1 -- 172.21.15.26:0/2913710999 >> 172.21.15.26:0/2913710999 conn(0x7f2730066f50 msgr2=0x7f273009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:17.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.794+0000 7f2737f3d700 1 -- 172.21.15.26:0/2913710999 shutdown_connections 2023-10-01T07:56:17.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.794+0000 7f2737f3d700 1 -- 172.21.15.26:0/2913710999 wait complete. 2023-10-01T07:56:17.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.796+0000 7f2737f3d700 1 Processor -- start 2023-10-01T07:56:17.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.796+0000 7f2737f3d700 1 -- start start 2023-10-01T07:56:17.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.796+0000 7f2737f3d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f273006acb0 0x7f2730070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:17.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.796+0000 7f2737f3d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f273009d9f0 0x7f2730071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:17.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.796+0000 7f2737f3d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27301316c0 0x7f2730071560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:17.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.796+0000 7f2737f3d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2730128580 con 0x7f27301316c0 2023-10-01T07:56:17.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.796+0000 7f2737f3d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273012b900 con 0x7f273009d9f0 2023-10-01T07:56:17.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.796+0000 7f2737f3d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f273011bcd0 con 0x7f273006acb0 2023-10-01T07:56:17.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.797+0000 7f27364da700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27301316c0 0x7f2730071560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:17.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.797+0000 7f27354d8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f273009d9f0 0x7f2730071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:17.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.797+0000 7f27354d8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f273009d9f0 0x7f2730071020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:36878/0 (socket says 172.21.15.26:36878) 2023-10-01T07:56:17.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.797+0000 7f27364da700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27301316c0 0x7f2730071560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60794/0 (socket says 172.21.15.26:60794) 2023-10-01T07:56:17.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.797+0000 7f27354d8700 1 -- 172.21.15.26:0/1918497219 learned_addr learned my addr 172.21.15.26:0/1918497219 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:17.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.797+0000 7f2735cd9700 1 --2- 172.21.15.26:0/1918497219 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f273006acb0 0x7f2730070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:17.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.797+0000 7f27364da700 1 -- 172.21.15.26:0/1918497219 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f273006acb0 msgr2=0x7f2730070ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:17.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.797+0000 7f27364da700 1 --2- 172.21.15.26:0/1918497219 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f273006acb0 0x7f2730070ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:17.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.797+0000 7f27364da700 1 -- 172.21.15.26:0/1918497219 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f273009d9f0 msgr2=0x7f2730071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:17.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.797+0000 7f27364da700 1 --2- 172.21.15.26:0/1918497219 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f273009d9f0 0x7f2730071020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:17.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.797+0000 7f27364da700 1 -- 172.21.15.26:0/1918497219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27200094a0 con 0x7f27301316c0 2023-10-01T07:56:17.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.797+0000 7f27354d8700 1 --2- 172.21.15.26:0/1918497219 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f273009d9f0 0x7f2730071020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:17.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.797+0000 7f27364da700 1 --2- 172.21.15.26:0/1918497219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27301316c0 0x7f2730071560 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f272800cc10 tx=0x7f272800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:17.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.798+0000 7f27267fc700 1 -- 172.21.15.26:0/1918497219 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272800aaa0 con 0x7f27301316c0 2023-10-01T07:56:17.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.798+0000 7f27267fc700 1 -- 172.21.15.26:0/1918497219 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272800ac20 con 0x7f27301316c0 2023-10-01T07:56:17.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.798+0000 7f2737f3d700 1 -- 172.21.15.26:0/1918497219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f272c0094a0 con 0x7f27301316c0 2023-10-01T07:56:17.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.798+0000 7f27267fc700 1 -- 172.21.15.26:0/1918497219 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27280070d0 con 0x7f27301316c0 2023-10-01T07:56:17.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.798+0000 7f2737f3d700 1 -- 172.21.15.26:0/1918497219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f273011ac90 con 0x7f27301316c0 2023-10-01T07:56:17.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.799+0000 7f27267fc700 1 -- 172.21.15.26:0/1918497219 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2728007230 con 0x7f27301316c0 2023-10-01T07:56:17.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.799+0000 7f2737f3d700 1 -- 172.21.15.26:0/1918497219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2730074ea0 con 0x7f27301316c0 2023-10-01T07:56:17.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.799+0000 7f27267fc700 1 -- 172.21.15.26:0/1918497219 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f272803f320 con 0x7f27301316c0 2023-10-01T07:56:17.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.808+0000 7f27267fc700 1 -- 172.21.15.26:0/1918497219 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f272801c3b0 con 0x7f27301316c0 2023-10-01T07:56:17.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.847+0000 7f95e706d700 1 -- 172.21.15.26:0/3384547158 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f95e006c360 con 0x7f95e009e000 2023-10-01T07:56:17.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.848+0000 7f95dd7fa700 1 -- 172.21.15.26:0/3384547158 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f95d4017030 con 0x7f95e009e000 2023-10-01T07:56:17.848 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:17.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.850+0000 7f95e706d700 1 -- 172.21.15.26:0/3384547158 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95e009e000 msgr2=0x7f95e01a6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:17.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.850+0000 7f95e706d700 1 --2- 172.21.15.26:0/3384547158 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95e009e000 0x7f95e01a6340 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f95d4000f60 tx=0x7f95d400c730 comp rx=0 tx=0).stop 2023-10-01T07:56:17.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.850+0000 7f95e706d700 1 -- 172.21.15.26:0/3384547158 shutdown_connections 2023-10-01T07:56:17.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.850+0000 7f95e706d700 1 --2- 172.21.15.26:0/3384547158 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f95e009e440 0x7f95e01a6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:17.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.850+0000 7f95e706d700 1 --2- 172.21.15.26:0/3384547158 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f95e009d6f0 0x7f95e01a5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:17.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.850+0000 7f95e706d700 1 --2- 172.21.15.26:0/3384547158 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95e009e000 0x7f95e01a6340 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:17.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.850+0000 7f95e706d700 1 -- 172.21.15.26:0/3384547158 >> 172.21.15.26:0/3384547158 conn(0x7f95e0066f50 msgr2=0x7f95e01bad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:17.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.850+0000 7f95e706d700 1 -- 172.21.15.26:0/3384547158 shutdown_connections 2023-10-01T07:56:17.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.850+0000 7f95e706d700 1 -- 172.21.15.26:0/3384547158 wait complete. 2023-10-01T07:56:17.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.853+0000 7f5f5cb11700 1 Processor -- start 2023-10-01T07:56:17.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.853+0000 7f5f5cb11700 1 -- start start 2023-10-01T07:56:17.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.854+0000 7f5f5cb11700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5f5812cf60 0x7f5f5806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:17.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.854+0000 7f5f5cb11700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f5812f8b0 0x7f5f5812fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:17.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.854+0000 7f5f5cb11700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f58130260 0x7f5f58136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:17.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.854+0000 7f5f5cb11700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f5812d330 con 0x7f5f5812cf60 2023-10-01T07:56:17.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.854+0000 7f5f5cb11700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5812cd90 con 0x7f5f58130260 2023-10-01T07:56:17.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.854+0000 7f5f5cb11700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f581306d0 con 0x7f5f5812f8b0 2023-10-01T07:56:17.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.854+0000 7f5f56d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f58130260 0x7f5f58136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:17.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.854+0000 7f5f56d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f58130260 0x7f5f58136c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:36886/0 (socket says 172.21.15.26:36886) 2023-10-01T07:56:17.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.854+0000 7f5f56d9d700 1 -- 172.21.15.26:0/2315274382 learned_addr learned my addr 172.21.15.26:0/2315274382 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:17.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.854+0000 7f5f55d9b700 1 --2- 172.21.15.26:0/2315274382 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f5812f8b0 0x7f5f5812fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:17.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.854+0000 7f5f5659c700 1 --2- 172.21.15.26:0/2315274382 >> v2:172.21.15.26:3300/0 conn(0x7f5f5812cf60 0x7f5f5806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:17.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.854+0000 7f5f56d9d700 1 -- 172.21.15.26:0/2315274382 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f5812f8b0 msgr2=0x7f5f5812fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:17.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.854+0000 7f5f56d9d700 1 --2- 172.21.15.26:0/2315274382 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f5812f8b0 0x7f5f5812fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:17.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.854+0000 7f5f56d9d700 1 -- 172.21.15.26:0/2315274382 >> v2:172.21.15.26:3300/0 conn(0x7f5f5812cf60 msgr2=0x7f5f5806f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:17.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.854+0000 7f5f56d9d700 1 --2- 172.21.15.26:0/2315274382 >> v2:172.21.15.26:3300/0 conn(0x7f5f5812cf60 0x7f5f5806f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:17.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.854+0000 7f5f56d9d700 1 -- 172.21.15.26:0/2315274382 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f58071780 con 0x7f5f58130260 2023-10-01T07:56:17.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.855+0000 7f5f56d9d700 1 --2- 172.21.15.26:0/2315274382 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f58130260 0x7f5f58136c20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5f50009d40 tx=0x7f5f5000c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43928443820a11ec server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:17.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.856+0000 7f5f5559a700 1 -- 172.21.15.26:0/2315274382 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f50009e90 con 0x7f5f58130260 2023-10-01T07:56:17.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.856+0000 7f5f5559a700 1 -- 172.21.15.26:0/2315274382 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5000ca20 con 0x7f5f58130260 2023-10-01T07:56:17.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.856+0000 7f5f5559a700 1 -- 172.21.15.26:0/2315274382 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5000cdb0 con 0x7f5f58130260 2023-10-01T07:56:17.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.857+0000 7f5f5cb11700 1 -- 172.21.15.26:0/2315274382 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f58130260 msgr2=0x7f5f58136c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:17.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.857+0000 7f5f5cb11700 1 --2- 172.21.15.26:0/2315274382 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f58130260 0x7f5f58136c20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5f50009d40 tx=0x7f5f5000c440 comp rx=0 tx=0).stop 2023-10-01T07:56:17.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.857+0000 7f5f5cb11700 1 -- 172.21.15.26:0/2315274382 shutdown_connections 2023-10-01T07:56:17.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.857+0000 7f5f5cb11700 1 --2- 172.21.15.26:0/2315274382 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f58130260 0x7f5f58136c20 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:17.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.857+0000 7f5f5cb11700 1 --2- 172.21.15.26:0/2315274382 >> v2:172.21.15.26:3300/0 conn(0x7f5f5812cf60 0x7f5f5806f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:17.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.857+0000 7f5f5cb11700 1 --2- 172.21.15.26:0/2315274382 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f5812f8b0 0x7f5f5812fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:17.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.857+0000 7f5f5cb11700 1 -- 172.21.15.26:0/2315274382 >> 172.21.15.26:0/2315274382 conn(0x7f5f580a2aa0 msgr2=0x7f5f580a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:17.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.857+0000 7f5f5cb11700 1 -- 172.21.15.26:0/2315274382 shutdown_connections 2023-10-01T07:56:17.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.857+0000 7f5f5cb11700 1 -- 172.21.15.26:0/2315274382 wait complete. 2023-10-01T07:56:17.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.859+0000 7f5f5cb11700 1 Processor -- start 2023-10-01T07:56:17.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.859+0000 7f5f5cb11700 1 -- start start 2023-10-01T07:56:17.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.859+0000 7f5f5cb11700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f5812cf60 0x7f5f581c3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:17.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.859+0000 7f5f5cb11700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f5812f8b0 0x7f5f581c4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:17.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.859+0000 7f5f5cb11700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f58130260 0x7f5f581c4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:17.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.859+0000 7f5f5cb11700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5809ead0 con 0x7f5f5812f8b0 2023-10-01T07:56:17.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.859+0000 7f5f5cb11700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5809cdc0 con 0x7f5f5812cf60 2023-10-01T07:56:17.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.859+0000 7f5f5cb11700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5812d9d0 con 0x7f5f58130260 2023-10-01T07:56:17.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.860+0000 7f5f5659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f5812cf60 0x7f5f581c3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:17.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.860+0000 7f5f5659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f5812cf60 0x7f5f581c3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:36898/0 (socket says 172.21.15.26:36898) 2023-10-01T07:56:17.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.860+0000 7f5f5659c700 1 -- 172.21.15.26:0/2344577949 learned_addr learned my addr 172.21.15.26:0/2344577949 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:17.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.860+0000 7f5f56d9d700 1 --2- 172.21.15.26:0/2344577949 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f58130260 0x7f5f581c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:17.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.860+0000 7f5f55d9b700 1 --2- 172.21.15.26:0/2344577949 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f5812f8b0 0x7f5f581c4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:17.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.860+0000 7f5f5659c700 1 -- 172.21.15.26:0/2344577949 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f58130260 msgr2=0x7f5f581c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:17.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.860+0000 7f5f5659c700 1 --2- 172.21.15.26:0/2344577949 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f58130260 0x7f5f581c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:17.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.860+0000 7f5f5659c700 1 -- 172.21.15.26:0/2344577949 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f5812f8b0 msgr2=0x7f5f581c4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:17.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.860+0000 7f5f5659c700 1 --2- 172.21.15.26:0/2344577949 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f5812f8b0 0x7f5f581c4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:17.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.860+0000 7f5f5659c700 1 -- 172.21.15.26:0/2344577949 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5000d040 con 0x7f5f5812cf60 2023-10-01T07:56:17.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.860+0000 7f5f5659c700 1 --2- 172.21.15.26:0/2344577949 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f5812cf60 0x7f5f581c3dd0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5f4800e9e0 tx=0x7f5f4800ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:17.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.860+0000 7f5f46ffd700 1 -- 172.21.15.26:0/2344577949 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4800ee80 con 0x7f5f5812cf60 2023-10-01T07:56:17.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.861+0000 7f5f5cb11700 1 -- 172.21.15.26:0/2344577949 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f5809ecd0 con 0x7f5f5812cf60 2023-10-01T07:56:17.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.861+0000 7f5f46ffd700 1 -- 172.21.15.26:0/2344577949 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4800c850 con 0x7f5f5812cf60 2023-10-01T07:56:17.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.861+0000 7f5f46ffd700 1 -- 172.21.15.26:0/2344577949 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4800cbc0 con 0x7f5f5812cf60 2023-10-01T07:56:17.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.861+0000 7f5f5cb11700 1 -- 172.21.15.26:0/2344577949 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f58119220 con 0x7f5f5812cf60 2023-10-01T07:56:17.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.862+0000 7f5f46ffd700 1 -- 172.21.15.26:0/2344577949 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5f4800cd20 con 0x7f5f5812cf60 2023-10-01T07:56:17.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.862+0000 7f5f5cb11700 1 -- 172.21.15.26:0/2344577949 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f58074ea0 con 0x7f5f5812cf60 2023-10-01T07:56:17.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.862+0000 7f5f46ffd700 1 -- 172.21.15.26:0/2344577949 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5f4803f6e0 con 0x7f5f5812cf60 2023-10-01T07:56:17.869 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:17.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:17.871+0000 7f5f46ffd700 1 -- 172.21.15.26:0/2344577949 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5f48017020 con 0x7f5f5812cf60 2023-10-01T07:56:18.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:18.010+0000 7f7f4744c700 1 -- 172.21.15.26:0/967803783 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7f401244e0 con 0x7f7f40121f60 2023-10-01T07:56:18.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:18.011+0000 7f7f35ffb700 1 -- 172.21.15.26:0/967803783 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7f38018020 con 0x7f7f40121f60 2023-10-01T07:56:18.011 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:18.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:18.013+0000 7f7f4744c700 1 -- 172.21.15.26:0/967803783 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7f40121f60 msgr2=0x7f7f401d2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:18.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:18.013+0000 7f7f4744c700 1 --2- 172.21.15.26:0/967803783 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7f40121f60 0x7f7f401d2d20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7f3800efc0 tx=0x7f7f3800c3a0 comp rx=0 tx=0).stop 2023-10-01T07:56:18.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:18.013+0000 7f7f4744c700 1 -- 172.21.15.26:0/967803783 shutdown_connections 2023-10-01T07:56:18.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:18.013+0000 7f7f4744c700 1 --2- 172.21.15.26:0/967803783 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7f40121f60 0x7f7f401d2d20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:18.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:18.013+0000 7f7f4744c700 1 --2- 172.21.15.26:0/967803783 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f4006e570 0x7f7f401214e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:18.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:18.013+0000 7f7f4744c700 1 --2- 172.21.15.26:0/967803783 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f40134610 0x7f7f40121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:18.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:18.013+0000 7f7f4744c700 1 -- 172.21.15.26:0/967803783 >> 172.21.15.26:0/967803783 conn(0x7f7f400a2aa0 msgr2=0x7f7f401bf080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:18.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:18.014+0000 7f7f4744c700 1 -- 172.21.15.26:0/967803783 shutdown_connections 2023-10-01T07:56:18.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:18.014+0000 7f7f4744c700 1 -- 172.21.15.26:0/967803783 wait complete. 2023-10-01T07:56:18.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:18.020+0000 7f2737f3d700 1 -- 172.21.15.26:0/1918497219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f273009e130 con 0x7f27301316c0 2023-10-01T07:56:18.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:18.021+0000 7f27267fc700 1 -- 172.21.15.26:0/1918497219 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f273009e130 con 0x7f27301316c0 2023-10-01T07:56:18.021 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:18.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:18.023+0000 7f2737f3d700 1 -- 172.21.15.26:0/1918497219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27301316c0 msgr2=0x7f2730071560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:18.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:18.023+0000 7f2737f3d700 1 --2- 172.21.15.26:0/1918497219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27301316c0 0x7f2730071560 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f272800cc10 tx=0x7f272800cf20 comp rx=0 tx=0).stop 2023-10-01T07:56:18.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:18.023+0000 7f2737f3d700 1 -- 172.21.15.26:0/1918497219 shutdown_connections 2023-10-01T07:56:18.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:18.023+0000 7f2737f3d700 1 --2- 172.21.15.26:0/1918497219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27301316c0 0x7f2730071560 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:18.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:18.023+0000 7f2737f3d700 1 --2- 172.21.15.26:0/1918497219 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f273006acb0 0x7f2730070ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:18.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:18.023+0000 7f2737f3d700 1 --2- 172.21.15.26:0/1918497219 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f273009d9f0 0x7f2730071020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:18.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:18.023+0000 7f2737f3d700 1 -- 172.21.15.26:0/1918497219 >> 172.21.15.26:0/1918497219 conn(0x7f2730066f50 msgr2=0x7f27300a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:18.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:18.023+0000 7f2737f3d700 1 -- 172.21.15.26:0/1918497219 shutdown_connections 2023-10-01T07:56:18.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:18.023+0000 7f2737f3d700 1 -- 172.21.15.26:0/1918497219 wait complete. 2023-10-01T07:56:18.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:18.038 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:18.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:18.095+0000 7f5f5cb11700 1 -- 172.21.15.26:0/2344577949 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5f5809e8c0 con 0x7f5f5812cf60 2023-10-01T07:56:18.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:18.096+0000 7f5f46ffd700 1 -- 172.21.15.26:0/2344577949 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f4801ba00 con 0x7f5f5812cf60 2023-10-01T07:56:18.096 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:18.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:18.098+0000 7f5f5cb11700 1 -- 172.21.15.26:0/2344577949 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f5812cf60 msgr2=0x7f5f581c3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:18.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:18.098+0000 7f5f5cb11700 1 --2- 172.21.15.26:0/2344577949 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f5812cf60 0x7f5f581c3dd0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5f4800e9e0 tx=0x7f5f4800ecf0 comp rx=0 tx=0).stop 2023-10-01T07:56:18.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:18.098+0000 7f5f5cb11700 1 -- 172.21.15.26:0/2344577949 shutdown_connections 2023-10-01T07:56:18.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:18.098+0000 7f5f5cb11700 1 --2- 172.21.15.26:0/2344577949 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f58130260 0x7f5f581c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:18.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:18.098+0000 7f5f5cb11700 1 --2- 172.21.15.26:0/2344577949 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f5812cf60 0x7f5f581c3dd0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:18.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:18.098+0000 7f5f5cb11700 1 --2- 172.21.15.26:0/2344577949 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f5812f8b0 0x7f5f581c4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:18.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:18.098+0000 7f5f5cb11700 1 -- 172.21.15.26:0/2344577949 >> 172.21.15.26:0/2344577949 conn(0x7f5f580a2aa0 msgr2=0x7f5f580a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:18.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:18.098+0000 7f5f5cb11700 1 -- 172.21.15.26:0/2344577949 shutdown_connections 2023-10-01T07:56:18.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:18.098+0000 7f5f5cb11700 1 -- 172.21.15.26:0/2344577949 wait complete. 2023-10-01T07:56:18.112 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:18.870 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:19.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.018+0000 7f077c0cc700 1 Processor -- start 2023-10-01T07:56:19.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.018+0000 7f077c0cc700 1 -- start start 2023-10-01T07:56:19.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.018+0000 7f077c0cc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f077406a770 0x7f077406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:19.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.018+0000 7f077c0cc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f077406b080 0x7f0774131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:19.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.018+0000 7f077c0cc700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077409ece0 con 0x7f0774131b40 2023-10-01T07:56:19.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.018+0000 7f077c0cc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077409e760 con 0x7f077406b080 2023-10-01T07:56:19.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.018+0000 7f077c0cc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f077409e040 con 0x7f077406a770 2023-10-01T07:56:19.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.019+0000 7f0779667700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f077406b080 0x7f0774131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:19.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.019+0000 7f0779e68700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f077406a770 0x7f077406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:19.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.019+0000 7f077a669700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0774131b40 0x7f0774138850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54764/0 (socket says 172.21.15.26:54764) 2023-10-01T07:56:19.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.019+0000 7f077a669700 1 -- 172.21.15.26:0/1352805270 learned_addr learned my addr 172.21.15.26:0/1352805270 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:19.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.019+0000 7f0778e66700 1 -- 172.21.15.26:0/1352805270 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2826526700 0 0) 0x7f077409ece0 con 0x7f0774131b40 2023-10-01T07:56:19.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.019+0000 7f0779667700 1 -- 172.21.15.26:0/1352805270 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f077406a770 msgr2=0x7f077406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:19.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.019+0000 7f0779667700 1 --2- 172.21.15.26:0/1352805270 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f077406a770 0x7f077406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.019+0000 7f0779667700 1 -- 172.21.15.26:0/1352805270 >> v1:172.21.15.26:6789/0 conn(0x7f0774131b40 legacy=0x7f0774138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:19.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.019+0000 7f0779667700 1 -- 172.21.15.26:0/1352805270 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077409f630 con 0x7f077406b080 2023-10-01T07:56:19.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.019+0000 7f0779e68700 1 --2- 172.21.15.26:0/1352805270 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f077406a770 0x7f077406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:19.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.019+0000 7f0779667700 1 --2- 172.21.15.26:0/1352805270 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f077406b080 0x7f0774131600 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0770009870 tx=0x7f0770009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8750f045885ad7b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:19.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.019+0000 7f0778e66700 1 -- 172.21.15.26:0/1352805270 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0770011830 con 0x7f077406b080 2023-10-01T07:56:19.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.019+0000 7f0778e66700 1 -- 172.21.15.26:0/1352805270 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0770011990 con 0x7f077406b080 2023-10-01T07:56:19.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.019+0000 7f0778e66700 1 -- 172.21.15.26:0/1352805270 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0770011d20 con 0x7f077406b080 2023-10-01T07:56:19.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.020+0000 7f077c0cc700 1 -- 172.21.15.26:0/1352805270 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f077406b080 msgr2=0x7f0774131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:19.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.020+0000 7f077c0cc700 1 --2- 172.21.15.26:0/1352805270 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f077406b080 0x7f0774131600 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0770009870 tx=0x7f0770009b80 comp rx=0 tx=0).stop 2023-10-01T07:56:19.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.020+0000 7f077c0cc700 1 -- 172.21.15.26:0/1352805270 shutdown_connections 2023-10-01T07:56:19.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.020+0000 7f077c0cc700 1 --2- 172.21.15.26:0/1352805270 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f077406a770 0x7f077406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.020+0000 7f077c0cc700 1 --2- 172.21.15.26:0/1352805270 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f077406b080 0x7f0774131600 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.020+0000 7f077c0cc700 1 -- 172.21.15.26:0/1352805270 >> 172.21.15.26:0/1352805270 conn(0x7f0774066f50 msgr2=0x7f077409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:19.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.020+0000 7f077c0cc700 1 -- 172.21.15.26:0/1352805270 shutdown_connections 2023-10-01T07:56:19.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.020+0000 7f077c0cc700 1 -- 172.21.15.26:0/1352805270 wait complete. 2023-10-01T07:56:19.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.021+0000 7f077c0cc700 1 Processor -- start 2023-10-01T07:56:19.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.021+0000 7f077c0cc700 1 -- start start 2023-10-01T07:56:19.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.021+0000 7f077c0cc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f077406a770 0x7f077411c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:19.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.021+0000 7f077c0cc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f077406b080 0x7f077411c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:19.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.022+0000 7f077c0cc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0774131b40 0x7f077411ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:19.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.022+0000 7f077c0cc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0774131530 con 0x7f0774131b40 2023-10-01T07:56:19.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.022+0000 7f077c0cc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077411f900 con 0x7f077406a770 2023-10-01T07:56:19.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.022+0000 7f077c0cc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f077411ff80 con 0x7f077406b080 2023-10-01T07:56:19.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.022+0000 7f0779e68700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f077406a770 0x7f077411c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:19.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.022+0000 7f0779e68700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f077406a770 0x7f077411c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:36912/0 (socket says 172.21.15.26:36912) 2023-10-01T07:56:19.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.022+0000 7f0779e68700 1 -- 172.21.15.26:0/1323390377 learned_addr learned my addr 172.21.15.26:0/1323390377 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:19.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.022+0000 7f077a669700 1 --2- 172.21.15.26:0/1323390377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0774131b40 0x7f077411ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:19.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.022+0000 7f0779667700 1 --2- 172.21.15.26:0/1323390377 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f077406b080 0x7f077411c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:19.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.022+0000 7f0779e68700 1 -- 172.21.15.26:0/1323390377 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f077406b080 msgr2=0x7f077411c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:19.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.022+0000 7f0779e68700 1 --2- 172.21.15.26:0/1323390377 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f077406b080 0x7f077411c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.022+0000 7f0779e68700 1 -- 172.21.15.26:0/1323390377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0774131b40 msgr2=0x7f077411ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:19.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.022+0000 7f0779e68700 1 --2- 172.21.15.26:0/1323390377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0774131b40 0x7f077411ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.022+0000 7f0779e68700 1 -- 172.21.15.26:0/1323390377 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07640094a0 con 0x7f077406a770 2023-10-01T07:56:19.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.022+0000 7f077a669700 1 --2- 172.21.15.26:0/1323390377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0774131b40 0x7f077411ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:19.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.022+0000 7f0779e68700 1 --2- 172.21.15.26:0/1323390377 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f077406a770 0x7f077411c380 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f076400ebe0 tx=0x7f076400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:19.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.022+0000 7f076a7fc700 1 -- 172.21.15.26:0/1323390377 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076400c850 con 0x7f077406a770 2023-10-01T07:56:19.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.022+0000 7f076a7fc700 1 -- 172.21.15.26:0/1323390377 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076400c9b0 con 0x7f077406a770 2023-10-01T07:56:19.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.022+0000 7f077c0cc700 1 -- 172.21.15.26:0/1323390377 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07700094a0 con 0x7f077406a770 2023-10-01T07:56:19.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.022+0000 7f076a7fc700 1 -- 172.21.15.26:0/1323390377 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076400cd40 con 0x7f077406a770 2023-10-01T07:56:19.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.022+0000 7f077c0cc700 1 -- 172.21.15.26:0/1323390377 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07741312f0 con 0x7f077406a770 2023-10-01T07:56:19.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.023+0000 7f076a7fc700 1 -- 172.21.15.26:0/1323390377 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0764013470 con 0x7f077406a770 2023-10-01T07:56:19.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.023+0000 7f076a7fc700 1 -- 172.21.15.26:0/1323390377 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f076403fb50 con 0x7f077406a770 2023-10-01T07:56:19.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.023+0000 7f077c0cc700 1 -- 172.21.15.26:0/1323390377 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0774074ea0 con 0x7f077406a770 2023-10-01T07:56:19.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.028+0000 7f076a7fc700 1 -- 172.21.15.26:0/1323390377 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0764021080 con 0x7f077406a770 2023-10-01T07:56:19.029 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:19.039 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:19.113 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:19.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.177+0000 7f78ee45f700 1 Processor -- start 2023-10-01T07:56:19.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.177+0000 7f78ee45f700 1 -- start start 2023-10-01T07:56:19.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.178+0000 7f78ee45f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f78e80a0a30 0x7f78e80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:19.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.178+0000 7f78ee45f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f78e80a1340 0x7f78e8133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:19.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.178+0000 7f78ee45f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78e809edd0 con 0x7f78e8133fa0 2023-10-01T07:56:19.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.178+0000 7f78ee45f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78e809e1f0 con 0x7f78e80a0a30 2023-10-01T07:56:19.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.178+0000 7f78ee45f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78e809dc50 con 0x7f78e80a1340 2023-10-01T07:56:19.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.178+0000 7f78e7fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f78e80a0a30 0x7f78e80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:19.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.178+0000 7f78e77fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f78e80a1340 0x7f78e8133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:19.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.178+0000 7f78e77fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f78e80a1340 0x7f78e8133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:60502/0 (socket says 172.21.15.26:60502) 2023-10-01T07:56:19.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.178+0000 7f78e7fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f78e80a0a30 0x7f78e80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60818/0 (socket says 172.21.15.26:60818) 2023-10-01T07:56:19.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.178+0000 7f78e77fe700 1 -- 172.21.15.26:0/2363541972 learned_addr learned my addr 172.21.15.26:0/2363541972 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:19.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.178+0000 7f78e77fe700 1 -- 172.21.15.26:0/2363541972 >> v2:172.21.15.26:3300/0 conn(0x7f78e80a0a30 msgr2=0x7f78e80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:19.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.178+0000 7f78e77fe700 1 --2- 172.21.15.26:0/2363541972 >> v2:172.21.15.26:3300/0 conn(0x7f78e80a0a30 0x7f78e80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.178+0000 7f78e77fe700 1 -- 172.21.15.26:0/2363541972 >> v1:172.21.15.26:6789/0 conn(0x7f78e8133fa0 legacy=0x7f78e813ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:19.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.178+0000 7f78e77fe700 1 -- 172.21.15.26:0/2363541972 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e80a1fe0 con 0x7f78e80a1340 2023-10-01T07:56:19.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.179+0000 7f78e77fe700 1 --2- 172.21.15.26:0/2363541972 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f78e80a1340 0x7f78e8133a60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f78dc0098f0 tx=0x7f78dc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6501730ef04d9f30 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:19.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.179+0000 7f78e6ffd700 1 -- 172.21.15.26:0/2363541972 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc011830 con 0x7f78e80a1340 2023-10-01T07:56:19.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.179+0000 7f78e6ffd700 1 -- 172.21.15.26:0/2363541972 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78dc011990 con 0x7f78e80a1340 2023-10-01T07:56:19.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.179+0000 7f78e6ffd700 1 -- 172.21.15.26:0/2363541972 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc011d20 con 0x7f78e80a1340 2023-10-01T07:56:19.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.180+0000 7f78ee45f700 1 -- 172.21.15.26:0/2363541972 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f78e80a1340 msgr2=0x7f78e8133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:19.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.180+0000 7f78ee45f700 1 --2- 172.21.15.26:0/2363541972 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f78e80a1340 0x7f78e8133a60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f78dc0098f0 tx=0x7f78dc009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:19.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.180+0000 7f78ee45f700 1 -- 172.21.15.26:0/2363541972 shutdown_connections 2023-10-01T07:56:19.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.180+0000 7f78ee45f700 1 --2- 172.21.15.26:0/2363541972 >> v2:172.21.15.26:3300/0 conn(0x7f78e80a0a30 0x7f78e80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.180+0000 7f78ee45f700 1 --2- 172.21.15.26:0/2363541972 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f78e80a1340 0x7f78e8133a60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.180+0000 7f78ee45f700 1 -- 172.21.15.26:0/2363541972 >> 172.21.15.26:0/2363541972 conn(0x7f78e80a6550 msgr2=0x7f78e80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:19.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.180+0000 7f78ee45f700 1 -- 172.21.15.26:0/2363541972 shutdown_connections 2023-10-01T07:56:19.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.180+0000 7f78ee45f700 1 -- 172.21.15.26:0/2363541972 wait complete. 2023-10-01T07:56:19.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.181+0000 7f78ee45f700 1 Processor -- start 2023-10-01T07:56:19.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.181+0000 7f78ee45f700 1 -- start start 2023-10-01T07:56:19.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.182+0000 7f78ee45f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78e80a0a30 0x7f78e811e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:19.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.182+0000 7f78ee45f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f78e80a1340 0x7f78e811ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:19.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.182+0000 7f78ee45f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f78e8133fa0 0x7f78e811f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:19.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.182+0000 7f78ee45f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e81208f0 con 0x7f78e80a0a30 2023-10-01T07:56:19.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.182+0000 7f78ee45f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e80a0220 con 0x7f78e8133fa0 2023-10-01T07:56:19.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.182+0000 7f78ee45f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78e81203b0 con 0x7f78e80a1340 2023-10-01T07:56:19.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.182+0000 7f78e77fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f78e80a1340 0x7f78e811ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:19.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.182+0000 7f78e77fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f78e80a1340 0x7f78e811ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:60512/0 (socket says 172.21.15.26:60512) 2023-10-01T07:56:19.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.182+0000 7f78e77fe700 1 -- 172.21.15.26:0/1494798294 learned_addr learned my addr 172.21.15.26:0/1494798294 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:19.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.182+0000 7f78ec9fc700 1 --2- 172.21.15.26:0/1494798294 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f78e8133fa0 0x7f78e811f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:19.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.182+0000 7f78e7fff700 1 --2- 172.21.15.26:0/1494798294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78e80a0a30 0x7f78e811e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:19.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.183+0000 7f78e77fe700 1 -- 172.21.15.26:0/1494798294 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f78e8133fa0 msgr2=0x7f78e811f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:19.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.183+0000 7f78e77fe700 1 --2- 172.21.15.26:0/1494798294 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f78e8133fa0 0x7f78e811f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.183+0000 7f78e77fe700 1 -- 172.21.15.26:0/1494798294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78e80a0a30 msgr2=0x7f78e811e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:19.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.183+0000 7f78e77fe700 1 --2- 172.21.15.26:0/1494798294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78e80a0a30 0x7f78e811e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.183+0000 7f78e77fe700 1 -- 172.21.15.26:0/1494798294 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78dc009550 con 0x7f78e80a1340 2023-10-01T07:56:19.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.183+0000 7f78ec9fc700 1 --2- 172.21.15.26:0/1494798294 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f78e8133fa0 0x7f78e811f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:19.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.183+0000 7f78e77fe700 1 --2- 172.21.15.26:0/1494798294 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f78e80a1340 0x7f78e811ec60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f78dc009c40 tx=0x7f78dc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:19.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.183+0000 7f78e4ff9700 1 -- 172.21.15.26:0/1494798294 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc004400 con 0x7f78e80a1340 2023-10-01T07:56:19.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.183+0000 7f78e4ff9700 1 -- 172.21.15.26:0/1494798294 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78dc01f070 con 0x7f78e80a1340 2023-10-01T07:56:19.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.183+0000 7f78ee45f700 1 -- 172.21.15.26:0/1494798294 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78e8121ed0 con 0x7f78e80a1340 2023-10-01T07:56:19.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.183+0000 7f78e4ff9700 1 -- 172.21.15.26:0/1494798294 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc0038e0 con 0x7f78e80a1340 2023-10-01T07:56:19.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.183+0000 7f78ee45f700 1 -- 172.21.15.26:0/1494798294 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78e81221b0 con 0x7f78e80a1340 2023-10-01T07:56:19.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.184+0000 7f78e4ff9700 1 -- 172.21.15.26:0/1494798294 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f78dc021030 con 0x7f78e80a1340 2023-10-01T07:56:19.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.184+0000 7f78ce7fc700 1 -- 172.21.15.26:0/1494798294 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78c00052e0 con 0x7f78e80a1340 2023-10-01T07:56:19.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.185+0000 7f78e4ff9700 1 -- 172.21.15.26:0/1494798294 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f78dc040910 con 0x7f78e80a1340 2023-10-01T07:56:19.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.194+0000 7f78e4ff9700 1 -- 172.21.15.26:0/1494798294 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f78dc0199a0 con 0x7f78e80a1340 2023-10-01T07:56:19.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.226+0000 7f34f66e8700 1 Processor -- start 2023-10-01T07:56:19.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.226+0000 7f34f66e8700 1 -- start start 2023-10-01T07:56:19.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.226+0000 7f34f66e8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f34f009d6f0 0x7f34f009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:19.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.226+0000 7f34f66e8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34f009e000 0x7f34f0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:19.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.226+0000 7f34f66e8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34f009f130 con 0x7f34f009e410 2023-10-01T07:56:19.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.226+0000 7f34f66e8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f009f520 con 0x7f34f009d6f0 2023-10-01T07:56:19.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.226+0000 7f34f66e8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34f009e930 con 0x7f34f009e000 2023-10-01T07:56:19.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.226+0000 7f34f4c85700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f34f009e410 0x7f34f0130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54776/0 (socket says 172.21.15.26:54776) 2023-10-01T07:56:19.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.226+0000 7f34f4c85700 1 -- 172.21.15.26:0/3331947322 learned_addr learned my addr 172.21.15.26:0/3331947322 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:19.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.227+0000 7f34eeffd700 1 -- 172.21.15.26:0/3331947322 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4219372124 0 0) 0x7f34f009f130 con 0x7f34f009e410 2023-10-01T07:56:19.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.227+0000 7f34eeffd700 1 -- 172.21.15.26:0/3331947322 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34d80035b0 con 0x7f34f009e410 2023-10-01T07:56:19.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.227+0000 7f34ef7fe700 1 --2- 172.21.15.26:0/3331947322 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34f009e000 0x7f34f0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:19.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.227+0000 7f34eeffd700 1 -- 172.21.15.26:0/3331947322 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4255262725 0 0) 0x7f34d80035b0 con 0x7f34f009e410 2023-10-01T07:56:19.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.227+0000 7f34eeffd700 1 -- 172.21.15.26:0/3331947322 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34f009e000 msgr2=0x7f34f0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:19.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.227+0000 7f34eeffd700 1 --2- 172.21.15.26:0/3331947322 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34f009e000 0x7f34f0130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.227+0000 7f34eeffd700 1 -- 172.21.15.26:0/3331947322 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f34f009d6f0 msgr2=0x7f34f009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:19.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.227+0000 7f34eeffd700 1 --2- 172.21.15.26:0/3331947322 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f34f009d6f0 0x7f34f009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.227+0000 7f34eeffd700 1 -- 172.21.15.26:0/3331947322 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f009b2d0 con 0x7f34f009e410 2023-10-01T07:56:19.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.227+0000 7f34eeffd700 1 -- 172.21.15.26:0/3331947322 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1576910959 0 0) 0x7f34e80019f0 con 0x7f34f009e410 2023-10-01T07:56:19.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.227+0000 7f34eeffd700 1 -- 172.21.15.26:0/3331947322 >> v1:172.21.15.26:6789/0 conn(0x7f34f009e410 legacy=0x7f34f0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:19.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.227+0000 7f34eeffd700 1 --2- 172.21.15.26:0/3331947322 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34d8003a30 0x7f34d8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:19.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.227+0000 7f34eeffd700 1 --2- 172.21.15.26:0/3331947322 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f34d80043c0 0x7f34d8004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:19.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.227+0000 7f34eeffd700 1 --2- 172.21.15.26:0/3331947322 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34f009e000 0x7f34d8005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:19.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.227+0000 7f34eeffd700 1 -- 172.21.15.26:0/3331947322 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f009e930 con 0x7f34d8003a30 2023-10-01T07:56:19.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.227+0000 7f34eeffd700 1 -- 172.21.15.26:0/3331947322 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d800dc70 con 0x7f34d80043c0 2023-10-01T07:56:19.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.227+0000 7f34eeffd700 1 -- 172.21.15.26:0/3331947322 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34d800de30 con 0x7f34f009e000 2023-10-01T07:56:19.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.228+0000 7f34effff700 1 --2- 172.21.15.26:0/3331947322 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34d8003a30 0x7f34d8003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:19.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.228+0000 7f34f4c85700 1 --2- 172.21.15.26:0/3331947322 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34f009e000 0x7f34d8005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:19.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.228+0000 7f34effff700 1 -- 172.21.15.26:0/3331947322 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34f009e000 msgr2=0x7f34d8005170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:19.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.228+0000 7f34effff700 1 --2- 172.21.15.26:0/3331947322 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34f009e000 0x7f34d8005170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.228+0000 7f34effff700 1 -- 172.21.15.26:0/3331947322 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f34d80043c0 msgr2=0x7f34d8004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:19.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.228+0000 7f34effff700 1 --2- 172.21.15.26:0/3331947322 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f34d80043c0 0x7f34d8004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.228+0000 7f34effff700 1 -- 172.21.15.26:0/3331947322 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f009b2d0 con 0x7f34d8003a30 2023-10-01T07:56:19.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.228+0000 7f34f4c85700 1 --2- 172.21.15.26:0/3331947322 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34f009e000 0x7f34d8005170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:19.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.228+0000 7f34effff700 1 --2- 172.21.15.26:0/3331947322 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34d8003a30 0x7f34d8003e40 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f34f00a0670 tx=0x7f34d8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31dc8694429d9adf server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:19.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.228+0000 7f34eeffd700 1 -- 172.21.15.26:0/3331947322 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e0011620 con 0x7f34d8003a30 2023-10-01T07:56:19.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.229+0000 7f34eeffd700 1 -- 172.21.15.26:0/3331947322 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e0011780 con 0x7f34d8003a30 2023-10-01T07:56:19.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.229+0000 7f34eeffd700 1 -- 172.21.15.26:0/3331947322 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e0011b30 con 0x7f34d8003a30 2023-10-01T07:56:19.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.230+0000 7f34f66e8700 1 -- 172.21.15.26:0/3331947322 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34d8003a30 msgr2=0x7f34d8003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:19.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.230+0000 7f34f66e8700 1 --2- 172.21.15.26:0/3331947322 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34d8003a30 0x7f34d8003e40 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f34f00a0670 tx=0x7f34d8005880 comp rx=0 tx=0).stop 2023-10-01T07:56:19.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.230+0000 7f34f66e8700 1 -- 172.21.15.26:0/3331947322 shutdown_connections 2023-10-01T07:56:19.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.230+0000 7f34f66e8700 1 --2- 172.21.15.26:0/3331947322 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34f009e000 0x7f34d8005170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.230+0000 7f34f66e8700 1 --2- 172.21.15.26:0/3331947322 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34d8003a30 0x7f34d8003e40 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.230+0000 7f34f66e8700 1 --2- 172.21.15.26:0/3331947322 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f34d80043c0 0x7f34d8004890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.230+0000 7f34f66e8700 1 -- 172.21.15.26:0/3331947322 >> 172.21.15.26:0/3331947322 conn(0x7f34f0066f50 msgr2=0x7f34f009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:19.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.230+0000 7f34f66e8700 1 -- 172.21.15.26:0/3331947322 shutdown_connections 2023-10-01T07:56:19.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.230+0000 7f34f66e8700 1 -- 172.21.15.26:0/3331947322 wait complete. 2023-10-01T07:56:19.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.231+0000 7f34f66e8700 1 Processor -- start 2023-10-01T07:56:19.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.232+0000 7f34f66e8700 1 -- start start 2023-10-01T07:56:19.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.232+0000 7f34f66e8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34d8003a30 0x7f34f01c09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:19.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.232+0000 7f34f66e8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34d80043c0 0x7f34f01c0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:19.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.232+0000 7f34f66e8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f34f009e000 0x7f34f01c3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:19.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.232+0000 7f34f66e8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f0121860 con 0x7f34d80043c0 2023-10-01T07:56:19.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.232+0000 7f34f66e8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f01214e0 con 0x7f34f009e000 2023-10-01T07:56:19.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.232+0000 7f34f66e8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34f01c1470 con 0x7f34d8003a30 2023-10-01T07:56:19.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.233+0000 7f34effff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34d8003a30 0x7f34f01c09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:19.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.233+0000 7f34effff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34d8003a30 0x7f34f01c09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:60540/0 (socket says 172.21.15.26:60540) 2023-10-01T07:56:19.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.233+0000 7f34effff700 1 -- 172.21.15.26:0/3146127077 learned_addr learned my addr 172.21.15.26:0/3146127077 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:19.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.233+0000 7f34ef7fe700 1 --2- 172.21.15.26:0/3146127077 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34d80043c0 0x7f34f01c0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:19.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.233+0000 7f34f4c85700 1 --2- 172.21.15.26:0/3146127077 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f34f009e000 0x7f34f01c3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:19.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.233+0000 7f34f4c85700 1 -- 172.21.15.26:0/3146127077 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34d8003a30 msgr2=0x7f34f01c09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:19.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.233+0000 7f34f4c85700 1 --2- 172.21.15.26:0/3146127077 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34d8003a30 0x7f34f01c09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.233+0000 7f34f4c85700 1 -- 172.21.15.26:0/3146127077 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34d80043c0 msgr2=0x7f34f01c0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:19.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.233+0000 7f34f4c85700 1 --2- 172.21.15.26:0/3146127077 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34d80043c0 0x7f34f01c0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.233+0000 7f34f4c85700 1 -- 172.21.15.26:0/3146127077 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f011f7d0 con 0x7f34f009e000 2023-10-01T07:56:19.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.233+0000 7f34effff700 1 --2- 172.21.15.26:0/3146127077 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34d8003a30 0x7f34f01c09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:19.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.233+0000 7f34f4c85700 1 --2- 172.21.15.26:0/3146127077 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f34f009e000 0x7f34f01c3a30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f34e80072c0 tx=0x7f34e80075d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:19.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.234+0000 7f34ecff9700 1 -- 172.21.15.26:0/3146127077 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e8013600 con 0x7f34f009e000 2023-10-01T07:56:19.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.234+0000 7f34ecff9700 1 -- 172.21.15.26:0/3146127077 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e8013760 con 0x7f34f009e000 2023-10-01T07:56:19.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.234+0000 7f34ecff9700 1 -- 172.21.15.26:0/3146127077 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e8013b10 con 0x7f34f009e000 2023-10-01T07:56:19.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.234+0000 7f34f66e8700 1 -- 172.21.15.26:0/3146127077 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f009c700 con 0x7f34f009e000 2023-10-01T07:56:19.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.234+0000 7f34f66e8700 1 -- 172.21.15.26:0/3146127077 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f0121be0 con 0x7f34f009e000 2023-10-01T07:56:19.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.235+0000 7f34f66e8700 1 -- 172.21.15.26:0/3146127077 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f0074ea0 con 0x7f34f009e000 2023-10-01T07:56:19.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.235+0000 7f34ecff9700 1 -- 172.21.15.26:0/3146127077 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f34e8013c70 con 0x7f34f009e000 2023-10-01T07:56:19.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.235+0000 7f34ecff9700 1 -- 172.21.15.26:0/3146127077 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f34e8040740 con 0x7f34f009e000 2023-10-01T07:56:19.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.244+0000 7f34ecff9700 1 -- 172.21.15.26:0/3146127077 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f34e8019cd0 con 0x7f34f009e000 2023-10-01T07:56:19.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.260+0000 7f077c0cc700 1 -- 172.21.15.26:0/1323390377 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f077406c360 con 0x7f077406a770 2023-10-01T07:56:19.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.261+0000 7f076a7fc700 1 -- 172.21.15.26:0/1323390377 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0764017020 con 0x7f077406a770 2023-10-01T07:56:19.261 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:19.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.263+0000 7f077c0cc700 1 -- 172.21.15.26:0/1323390377 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f077406a770 msgr2=0x7f077411c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:19.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.263+0000 7f077c0cc700 1 --2- 172.21.15.26:0/1323390377 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f077406a770 0x7f077411c380 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f076400ebe0 tx=0x7f076400eef0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.263+0000 7f077c0cc700 1 -- 172.21.15.26:0/1323390377 shutdown_connections 2023-10-01T07:56:19.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.263+0000 7f077c0cc700 1 --2- 172.21.15.26:0/1323390377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0774131b40 0x7f077411ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.263+0000 7f077c0cc700 1 --2- 172.21.15.26:0/1323390377 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f077406a770 0x7f077411c380 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.263+0000 7f077c0cc700 1 --2- 172.21.15.26:0/1323390377 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f077406b080 0x7f077411c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.263+0000 7f077c0cc700 1 -- 172.21.15.26:0/1323390377 >> 172.21.15.26:0/1323390377 conn(0x7f0774066f50 msgr2=0x7f0774070060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:19.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.264+0000 7f077c0cc700 1 -- 172.21.15.26:0/1323390377 shutdown_connections 2023-10-01T07:56:19.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.264+0000 7f077c0cc700 1 -- 172.21.15.26:0/1323390377 wait complete. 2023-10-01T07:56:19.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.275+0000 7f6147b07700 1 Processor -- start 2023-10-01T07:56:19.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.275+0000 7f6147b07700 1 -- start start 2023-10-01T07:56:19.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.275+0000 7f6147b07700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f61400a1510 0x7f6140138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:19.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.275+0000 7f6147b07700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6140139250 0x7f614013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:19.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.276+0000 7f6147b07700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f614009edd0 con 0x7f61400a0a30 2023-10-01T07:56:19.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.276+0000 7f6147b07700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61400a18e0 con 0x7f6140139250 2023-10-01T07:56:19.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.276+0000 7f6147b07700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f614009e1f0 con 0x7f61400a1510 2023-10-01T07:56:19.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.276+0000 7f61460a4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6140139250 0x7f614013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:19.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.276+0000 7f61460a4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6140139250 0x7f614013b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:36942/0 (socket says 172.21.15.26:36942) 2023-10-01T07:56:19.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.276+0000 7f61460a4700 1 -- 172.21.15.26:0/1943424348 learned_addr learned my addr 172.21.15.26:0/1943424348 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:19.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.276+0000 7f61450a2700 1 --2- 172.21.15.26:0/1943424348 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f61400a1510 0x7f6140138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:19.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.276+0000 7f61460a4700 1 -- 172.21.15.26:0/1943424348 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f61400a1510 msgr2=0x7f6140138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:19.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.276+0000 7f61460a4700 1 --2- 172.21.15.26:0/1943424348 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f61400a1510 0x7f6140138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.276+0000 7f61460a4700 1 -- 172.21.15.26:0/1943424348 >> v1:172.21.15.26:6789/0 conn(0x7f61400a0a30 legacy=0x7f61400a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:19.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.276+0000 7f61460a4700 1 -- 172.21.15.26:0/1943424348 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614009dc50 con 0x7f6140139250 2023-10-01T07:56:19.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.276+0000 7f61448a1700 1 -- 172.21.15.26:0/1943424348 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3502963472 0 0) 0x7f614009edd0 con 0x7f61400a0a30 2023-10-01T07:56:19.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.276+0000 7f61450a2700 1 --2- 172.21.15.26:0/1943424348 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f61400a1510 0x7f6140138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:19.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.277+0000 7f61460a4700 1 --2- 172.21.15.26:0/1943424348 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6140139250 0x7f614013b630 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6138009e80 tx=0x7f613800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b363e3c0786e1c58 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:19.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.277+0000 7f61448a1700 1 -- 172.21.15.26:0/1943424348 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613800e070 con 0x7f6140139250 2023-10-01T07:56:19.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.277+0000 7f61448a1700 1 -- 172.21.15.26:0/1943424348 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613800b910 con 0x7f6140139250 2023-10-01T07:56:19.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.277+0000 7f61448a1700 1 -- 172.21.15.26:0/1943424348 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613800bcc0 con 0x7f6140139250 2023-10-01T07:56:19.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.277+0000 7f6147b07700 1 -- 172.21.15.26:0/1943424348 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6140139250 msgr2=0x7f614013b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:19.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.277+0000 7f6147b07700 1 --2- 172.21.15.26:0/1943424348 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6140139250 0x7f614013b630 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6138009e80 tx=0x7f613800b330 comp rx=0 tx=0).stop 2023-10-01T07:56:19.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.278+0000 7f6147b07700 1 -- 172.21.15.26:0/1943424348 shutdown_connections 2023-10-01T07:56:19.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.278+0000 7f6147b07700 1 --2- 172.21.15.26:0/1943424348 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6140139250 0x7f614013b630 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.278+0000 7f6147b07700 1 --2- 172.21.15.26:0/1943424348 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f61400a1510 0x7f6140138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.278+0000 7f6147b07700 1 -- 172.21.15.26:0/1943424348 >> 172.21.15.26:0/1943424348 conn(0x7f61400a6550 msgr2=0x7f61400a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:19.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.278+0000 7f6147b07700 1 -- 172.21.15.26:0/1943424348 shutdown_connections 2023-10-01T07:56:19.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.278+0000 7f6147b07700 1 -- 172.21.15.26:0/1943424348 wait complete. 2023-10-01T07:56:19.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.279+0000 7f6147b07700 1 Processor -- start 2023-10-01T07:56:19.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.279+0000 7f6147b07700 1 -- start start 2023-10-01T07:56:19.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.279+0000 7f6147b07700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61400a0a30 0x7f614011e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:19.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.279+0000 7f6147b07700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f61400a1510 0x7f614011eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:19.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.279+0000 7f6147b07700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6140139250 0x7f614011f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:19.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.279+0000 7f6147b07700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6140122040 con 0x7f61400a0a30 2023-10-01T07:56:19.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.279+0000 7f6147b07700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61401206e0 con 0x7f6140139250 2023-10-01T07:56:19.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.279+0000 7f6147b07700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61400a0220 con 0x7f61400a1510 2023-10-01T07:56:19.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.279+0000 7f61450a2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f61400a1510 0x7f614011eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:19.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.279+0000 7f61458a3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61400a0a30 0x7f614011e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:19.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.280+0000 7f61450a2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f61400a1510 0x7f614011eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:60554/0 (socket says 172.21.15.26:60554) 2023-10-01T07:56:19.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.280+0000 7f61450a2700 1 -- 172.21.15.26:0/2884017130 learned_addr learned my addr 172.21.15.26:0/2884017130 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:19.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.280+0000 7f61460a4700 1 --2- 172.21.15.26:0/2884017130 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6140139250 0x7f614011f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:19.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.280+0000 7f61450a2700 1 -- 172.21.15.26:0/2884017130 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6140139250 msgr2=0x7f614011f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:19.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.280+0000 7f61450a2700 1 --2- 172.21.15.26:0/2884017130 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6140139250 0x7f614011f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.280+0000 7f61450a2700 1 -- 172.21.15.26:0/2884017130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61400a0a30 msgr2=0x7f614011e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:19.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.280+0000 7f61450a2700 1 --2- 172.21.15.26:0/2884017130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61400a0a30 0x7f614011e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.280+0000 7f61450a2700 1 -- 172.21.15.26:0/2884017130 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61300094a0 con 0x7f61400a1510 2023-10-01T07:56:19.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.280+0000 7f61450a2700 1 --2- 172.21.15.26:0/2884017130 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f61400a1510 0x7f614011eae0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f613000ebe0 tx=0x7f613000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:19.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.280+0000 7f61367fc700 1 -- 172.21.15.26:0/2884017130 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613000c850 con 0x7f61400a1510 2023-10-01T07:56:19.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.280+0000 7f61367fc700 1 -- 172.21.15.26:0/2884017130 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613000c9b0 con 0x7f61400a1510 2023-10-01T07:56:19.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.280+0000 7f61367fc700 1 -- 172.21.15.26:0/2884017130 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613000cd40 con 0x7f61400a1510 2023-10-01T07:56:19.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.280+0000 7f6147b07700 1 -- 172.21.15.26:0/2884017130 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6138009b30 con 0x7f61400a1510 2023-10-01T07:56:19.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.281+0000 7f6147b07700 1 -- 172.21.15.26:0/2884017130 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6140121aa0 con 0x7f61400a1510 2023-10-01T07:56:19.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.281+0000 7f61367fc700 1 -- 172.21.15.26:0/2884017130 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6130013470 con 0x7f61400a1510 2023-10-01T07:56:19.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.282+0000 7f61367fc700 1 -- 172.21.15.26:0/2884017130 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f613003fb50 con 0x7f61400a1510 2023-10-01T07:56:19.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.282+0000 7f6147b07700 1 -- 172.21.15.26:0/2884017130 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6140134070 con 0x7f61400a1510 2023-10-01T07:56:19.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:19.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.291+0000 7f61367fc700 1 -- 172.21.15.26:0/2884017130 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6130013720 con 0x7f61400a1510 2023-10-01T07:56:19.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.414+0000 7f78ce7fc700 1 -- 172.21.15.26:0/1494798294 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f78c0005590 con 0x7f78e80a1340 2023-10-01T07:56:19.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.414+0000 7f78e4ff9700 1 -- 172.21.15.26:0/1494798294 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f78dc015030 con 0x7f78e80a1340 2023-10-01T07:56:19.415 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:19.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.417+0000 7f78ce7fc700 1 -- 172.21.15.26:0/1494798294 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f78e80a1340 msgr2=0x7f78e811ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:19.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.417+0000 7f78ce7fc700 1 --2- 172.21.15.26:0/1494798294 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f78e80a1340 0x7f78e811ec60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f78dc009c40 tx=0x7f78dc004750 comp rx=0 tx=0).stop 2023-10-01T07:56:19.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.417+0000 7f78ce7fc700 1 -- 172.21.15.26:0/1494798294 shutdown_connections 2023-10-01T07:56:19.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.417+0000 7f78ce7fc700 1 --2- 172.21.15.26:0/1494798294 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f78e8133fa0 0x7f78e811f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.417+0000 7f78ce7fc700 1 --2- 172.21.15.26:0/1494798294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78e80a0a30 0x7f78e811e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.417+0000 7f78ce7fc700 1 --2- 172.21.15.26:0/1494798294 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f78e80a1340 0x7f78e811ec60 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.417+0000 7f78ce7fc700 1 -- 172.21.15.26:0/1494798294 >> 172.21.15.26:0/1494798294 conn(0x7f78e80a6550 msgr2=0x7f78e81bc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:19.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.417+0000 7f78ce7fc700 1 -- 172.21.15.26:0/1494798294 shutdown_connections 2023-10-01T07:56:19.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.417+0000 7f78ce7fc700 1 -- 172.21.15.26:0/1494798294 wait complete. 2023-10-01T07:56:19.431 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:19.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.465+0000 7f34f66e8700 1 -- 172.21.15.26:0/3146127077 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f34f0121e90 con 0x7f34f009e000 2023-10-01T07:56:19.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.466+0000 7f34ecff9700 1 -- 172.21.15.26:0/3146127077 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f34e80192c0 con 0x7f34f009e000 2023-10-01T07:56:19.467 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:19.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.468+0000 7f34f66e8700 1 -- 172.21.15.26:0/3146127077 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f34f009e000 msgr2=0x7f34f01c3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:19.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.468+0000 7f34f66e8700 1 --2- 172.21.15.26:0/3146127077 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f34f009e000 0x7f34f01c3a30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f34e80072c0 tx=0x7f34e80075d0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.468+0000 7f34f66e8700 1 -- 172.21.15.26:0/3146127077 shutdown_connections 2023-10-01T07:56:19.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.468+0000 7f34f66e8700 1 --2- 172.21.15.26:0/3146127077 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f34f009e000 0x7f34f01c3a30 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.468+0000 7f34f66e8700 1 --2- 172.21.15.26:0/3146127077 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34d8003a30 0x7f34f01c09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.468+0000 7f34f66e8700 1 --2- 172.21.15.26:0/3146127077 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34d80043c0 0x7f34f01c0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.468+0000 7f34f66e8700 1 -- 172.21.15.26:0/3146127077 >> 172.21.15.26:0/3146127077 conn(0x7f34f0066f50 msgr2=0x7f34f0130800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:19.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.468+0000 7f34f66e8700 1 -- 172.21.15.26:0/3146127077 shutdown_connections 2023-10-01T07:56:19.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.468+0000 7f34f66e8700 1 -- 172.21.15.26:0/3146127077 wait complete. 2023-10-01T07:56:19.482 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:19.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.496+0000 7f6147b07700 1 -- 172.21.15.26:0/2884017130 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f61400a1d10 con 0x7f61400a1510 2023-10-01T07:56:19.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.496+0000 7f61367fc700 1 -- 172.21.15.26:0/2884017130 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6130021030 con 0x7f61400a1510 2023-10-01T07:56:19.499 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:19.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.499+0000 7f6147b07700 1 -- 172.21.15.26:0/2884017130 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f61400a1510 msgr2=0x7f614011eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:19.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.499+0000 7f6147b07700 1 --2- 172.21.15.26:0/2884017130 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f61400a1510 0x7f614011eae0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f613000ebe0 tx=0x7f613000eef0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.499+0000 7f6147b07700 1 -- 172.21.15.26:0/2884017130 shutdown_connections 2023-10-01T07:56:19.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.499+0000 7f6147b07700 1 --2- 172.21.15.26:0/2884017130 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6140139250 0x7f614011f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.499+0000 7f6147b07700 1 --2- 172.21.15.26:0/2884017130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61400a0a30 0x7f614011e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.499+0000 7f6147b07700 1 --2- 172.21.15.26:0/2884017130 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f61400a1510 0x7f614011eae0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:19.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.499+0000 7f6147b07700 1 -- 172.21.15.26:0/2884017130 >> 172.21.15.26:0/2884017130 conn(0x7f61400a6550 msgr2=0x7f61400a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:19.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.499+0000 7f6147b07700 1 -- 172.21.15.26:0/2884017130 shutdown_connections 2023-10-01T07:56:19.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:19.499+0000 7f6147b07700 1 -- 172.21.15.26:0/2884017130 wait complete. 2023-10-01T07:56:19.513 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:20.286 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:20.431 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:20.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.431+0000 7f5bc28b0700 1 Processor -- start 2023-10-01T07:56:20.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.431+0000 7f5bc28b0700 1 -- start start 2023-10-01T07:56:20.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.432+0000 7f5bc28b0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bbc09d6f0 0x7f5bbc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:20.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.432+0000 7f5bc28b0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5bbc09e000 0x7f5bbc1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:20.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.432+0000 7f5bc28b0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bbc09e410 0x7f5bbc133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:20.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.432+0000 7f5bc28b0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bbc06b460 con 0x7f5bbc09e000 2023-10-01T07:56:20.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.432+0000 7f5bc28b0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc09b120 con 0x7f5bbc09d6f0 2023-10-01T07:56:20.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.432+0000 7f5bc28b0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc09a7e0 con 0x7f5bbc09e410 2023-10-01T07:56:20.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.432+0000 7f5bbbfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bbc09d6f0 0x7f5bbc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:20.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.432+0000 7f5bbb7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5bbc09e000 0x7f5bbc1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:20.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.432+0000 7f5bc0e4d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bbc09e410 0x7f5bbc133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:20.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.432+0000 7f5bbbfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bbc09d6f0 0x7f5bbc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:36960/0 (socket says 172.21.15.26:36960) 2023-10-01T07:56:20.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.432+0000 7f5bbb7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5bbc09e000 0x7f5bbc1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60876/0 (socket says 172.21.15.26:60876) 2023-10-01T07:56:20.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.432+0000 7f5bbbfff700 1 -- 172.21.15.26:0/3286940352 learned_addr learned my addr 172.21.15.26:0/3286940352 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:20.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.432+0000 7f5bc0e4d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bbc09e410 0x7f5bbc133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:60562/0 (socket says 172.21.15.26:60562) 2023-10-01T07:56:20.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.432+0000 7f5bbb7fe700 1 -- 172.21.15.26:0/3286940352 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bbc09e410 msgr2=0x7f5bbc133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:20.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.432+0000 7f5bbb7fe700 1 --2- 172.21.15.26:0/3286940352 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bbc09e410 0x7f5bbc133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:20.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.432+0000 7f5bbb7fe700 1 -- 172.21.15.26:0/3286940352 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bbc09d6f0 msgr2=0x7f5bbc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:20.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.432+0000 7f5bbb7fe700 1 --2- 172.21.15.26:0/3286940352 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bbc09d6f0 0x7f5bbc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:20.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.432+0000 7f5bbb7fe700 1 -- 172.21.15.26:0/3286940352 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bbc09a500 con 0x7f5bbc09e000 2023-10-01T07:56:20.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.432+0000 7f5bbbfff700 1 --2- 172.21.15.26:0/3286940352 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bbc09d6f0 0x7f5bbc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:20.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.433+0000 7f5bbb7fe700 1 --2- 172.21.15.26:0/3286940352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bbc09e000 0x7f5bbc1339f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4009840 tx=0x7f5ba4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2deefd6612c123e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:20.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.433+0000 7f5bbaffd700 1 -- 172.21.15.26:0/3286940352 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4011830 con 0x7f5bbc09e000 2023-10-01T07:56:20.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.433+0000 7f5bbaffd700 1 -- 172.21.15.26:0/3286940352 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba4011990 con 0x7f5bbc09e000 2023-10-01T07:56:20.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.433+0000 7f5bbaffd700 1 -- 172.21.15.26:0/3286940352 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4011d20 con 0x7f5bbc09e000 2023-10-01T07:56:20.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.433+0000 7f5bc28b0700 1 -- 172.21.15.26:0/3286940352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bbc09e000 msgr2=0x7f5bbc1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:20.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.433+0000 7f5bc28b0700 1 --2- 172.21.15.26:0/3286940352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bbc09e000 0x7f5bbc1339f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4009840 tx=0x7f5ba4009b50 comp rx=0 tx=0).stop 2023-10-01T07:56:20.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.433+0000 7f5bc28b0700 1 -- 172.21.15.26:0/3286940352 shutdown_connections 2023-10-01T07:56:20.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.433+0000 7f5bc28b0700 1 --2- 172.21.15.26:0/3286940352 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bbc09e410 0x7f5bbc133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:20.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.433+0000 7f5bc28b0700 1 --2- 172.21.15.26:0/3286940352 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bbc09d6f0 0x7f5bbc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:20.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.433+0000 7f5bc28b0700 1 --2- 172.21.15.26:0/3286940352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bbc09e000 0x7f5bbc1339f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:20.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.433+0000 7f5bc28b0700 1 -- 172.21.15.26:0/3286940352 >> 172.21.15.26:0/3286940352 conn(0x7f5bbc066f50 msgr2=0x7f5bbc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:20.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.433+0000 7f5bc28b0700 1 -- 172.21.15.26:0/3286940352 shutdown_connections 2023-10-01T07:56:20.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.433+0000 7f5bc28b0700 1 -- 172.21.15.26:0/3286940352 wait complete. 2023-10-01T07:56:20.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.434+0000 7f5bc28b0700 1 Processor -- start 2023-10-01T07:56:20.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.435+0000 7f5bc28b0700 1 -- start start 2023-10-01T07:56:20.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.435+0000 7f5bc28b0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bbc09d6f0 0x7f5bbc1a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:20.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.435+0000 7f5bc28b0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bbc09e000 0x7f5bbc1a6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:20.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.435+0000 7f5bc28b0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bbc09e410 0x7f5bbc1a6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:20.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.435+0000 7f5bc28b0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc1a9cf0 con 0x7f5bbc09e000 2023-10-01T07:56:20.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.435+0000 7f5bc28b0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc0a1fe0 con 0x7f5bbc09e410 2023-10-01T07:56:20.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.435+0000 7f5bc28b0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc09c710 con 0x7f5bbc09d6f0 2023-10-01T07:56:20.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.435+0000 7f5bbbfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bbc09d6f0 0x7f5bbc1a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:20.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.435+0000 7f5bbb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bbc09e000 0x7f5bbc1a6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:20.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.435+0000 7f5bbbfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bbc09d6f0 0x7f5bbc1a61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:60568/0 (socket says 172.21.15.26:60568) 2023-10-01T07:56:20.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.435+0000 7f5bbbfff700 1 -- 172.21.15.26:0/804739639 learned_addr learned my addr 172.21.15.26:0/804739639 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:20.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.435+0000 7f5bc0e4d700 1 --2- 172.21.15.26:0/804739639 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bbc09e410 0x7f5bbc1a6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:20.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.436+0000 7f5bbb7fe700 1 -- 172.21.15.26:0/804739639 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bbc09d6f0 msgr2=0x7f5bbc1a61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:20.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.436+0000 7f5bbb7fe700 1 --2- 172.21.15.26:0/804739639 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bbc09d6f0 0x7f5bbc1a61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:20.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.436+0000 7f5bbb7fe700 1 -- 172.21.15.26:0/804739639 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bbc09e410 msgr2=0x7f5bbc1a6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:20.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.436+0000 7f5bbb7fe700 1 --2- 172.21.15.26:0/804739639 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bbc09e410 0x7f5bbc1a6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:20.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.436+0000 7f5bbb7fe700 1 -- 172.21.15.26:0/804739639 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bac009550 con 0x7f5bbc09e000 2023-10-01T07:56:20.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.436+0000 7f5bbbfff700 1 --2- 172.21.15.26:0/804739639 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bbc09d6f0 0x7f5bbc1a61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:20.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.436+0000 7f5bbb7fe700 1 --2- 172.21.15.26:0/804739639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bbc09e000 0x7f5bbc1a6710 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc06e510 tx=0x7f5ba4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:20.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.436+0000 7f5bb8ff9700 1 -- 172.21.15.26:0/804739639 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4004450 con 0x7f5bbc09e000 2023-10-01T07:56:20.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.436+0000 7f5bb8ff9700 1 -- 172.21.15.26:0/804739639 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba401f070 con 0x7f5bbc09e000 2023-10-01T07:56:20.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.436+0000 7f5bb8ff9700 1 -- 172.21.15.26:0/804739639 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba40038c0 con 0x7f5bbc09e000 2023-10-01T07:56:20.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.436+0000 7f5bc28b0700 1 -- 172.21.15.26:0/804739639 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ba40094a0 con 0x7f5bbc09e000 2023-10-01T07:56:20.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.436+0000 7f5bc28b0700 1 -- 172.21.15.26:0/804739639 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bbc1a9480 con 0x7f5bbc09e000 2023-10-01T07:56:20.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.437+0000 7f5bb8ff9700 1 -- 172.21.15.26:0/804739639 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5ba4003a20 con 0x7f5bbc09e000 2023-10-01T07:56:20.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.437+0000 7f5bb8ff9700 1 -- 172.21.15.26:0/804739639 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5ba4021070 con 0x7f5bbc09e000 2023-10-01T07:56:20.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.438+0000 7f5bc28b0700 1 -- 172.21.15.26:0/804739639 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bbc1a8390 con 0x7f5bbc09e000 2023-10-01T07:56:20.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.443+0000 7f5bb8ff9700 1 -- 172.21.15.26:0/804739639 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5ba402b080 con 0x7f5bbc09e000 2023-10-01T07:56:20.483 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:20.513 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:20.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.578+0000 7f8f867a0700 1 Processor -- start 2023-10-01T07:56:20.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.578+0000 7f8f867a0700 1 -- start start 2023-10-01T07:56:20.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.578+0000 7f8f867a0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8f801338c0 0x7f8f80133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:20.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.579+0000 7f8f867a0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f801341d0 0x7f8f8009de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:20.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.579+0000 7f8f867a0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f8006f720 con 0x7f8f8009e390 2023-10-01T07:56:20.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.579+0000 7f8f867a0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f80070c80 con 0x7f8f801338c0 2023-10-01T07:56:20.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.579+0000 7f8f867a0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8006fce0 con 0x7f8f801341d0 2023-10-01T07:56:20.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.579+0000 7f8f7f7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f801341d0 0x7f8f8009de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:20.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.579+0000 7f8f7ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8f801338c0 0x7f8f80133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:20.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.579+0000 7f8f7f7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f801341d0 0x7f8f8009de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:60570/0 (socket says 172.21.15.26:60570) 2023-10-01T07:56:20.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.579+0000 7f8f7f7fe700 1 -- 172.21.15.26:0/992567970 learned_addr learned my addr 172.21.15.26:0/992567970 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:20.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.579+0000 7f8f7ffff700 1 -- 172.21.15.26:0/992567970 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f801341d0 msgr2=0x7f8f8009de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:20.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.579+0000 7f8f7ffff700 1 --2- 172.21.15.26:0/992567970 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f801341d0 0x7f8f8009de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:20.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.579+0000 7f8f7ffff700 1 -- 172.21.15.26:0/992567970 >> v1:172.21.15.26:6789/0 conn(0x7f8f8009e390 legacy=0x7f8f8013a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:20.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.579+0000 7f8f7ffff700 1 -- 172.21.15.26:0/992567970 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f801336a0 con 0x7f8f801338c0 2023-10-01T07:56:20.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.579+0000 7f8f7effd700 1 -- 172.21.15.26:0/992567970 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 697060293 0 0) 0x7f8f8006f720 con 0x7f8f8009e390 2023-10-01T07:56:20.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.579+0000 7f8f7f7fe700 1 --2- 172.21.15.26:0/992567970 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f801341d0 0x7f8f8009de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:20.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.580+0000 7f8f7ffff700 1 --2- 172.21.15.26:0/992567970 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f801338c0 0x7f8f80133c90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8f70009840 tx=0x7f8f70009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f4bd58cda348bd server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:20.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.580+0000 7f8f7effd700 1 -- 172.21.15.26:0/992567970 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f70011830 con 0x7f8f801338c0 2023-10-01T07:56:20.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.580+0000 7f8f7effd700 1 -- 172.21.15.26:0/992567970 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f70011990 con 0x7f8f801338c0 2023-10-01T07:56:20.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.580+0000 7f8f7effd700 1 -- 172.21.15.26:0/992567970 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f70011d20 con 0x7f8f801338c0 2023-10-01T07:56:20.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.581+0000 7f8f867a0700 1 -- 172.21.15.26:0/992567970 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f801338c0 msgr2=0x7f8f80133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:20.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.581+0000 7f8f867a0700 1 --2- 172.21.15.26:0/992567970 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f801338c0 0x7f8f80133c90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8f70009840 tx=0x7f8f70009b50 comp rx=0 tx=0).stop 2023-10-01T07:56:20.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.581+0000 7f8f867a0700 1 -- 172.21.15.26:0/992567970 shutdown_connections 2023-10-01T07:56:20.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.581+0000 7f8f867a0700 1 --2- 172.21.15.26:0/992567970 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f801338c0 0x7f8f80133c90 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:20.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.581+0000 7f8f867a0700 1 --2- 172.21.15.26:0/992567970 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f801341d0 0x7f8f8009de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:20.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.581+0000 7f8f867a0700 1 -- 172.21.15.26:0/992567970 >> 172.21.15.26:0/992567970 conn(0x7f8f800a2aa0 msgr2=0x7f8f800a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:20.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.581+0000 7f8f867a0700 1 -- 172.21.15.26:0/992567970 shutdown_connections 2023-10-01T07:56:20.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.581+0000 7f8f867a0700 1 -- 172.21.15.26:0/992567970 wait complete. 2023-10-01T07:56:20.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.582+0000 7f8f867a0700 1 Processor -- start 2023-10-01T07:56:20.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.582+0000 7f8f867a0700 1 -- start start 2023-10-01T07:56:20.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.583+0000 7f8f867a0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f8009e390 0x7f8f8011cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:20.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.583+0000 7f8f867a0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f801338c0 0x7f8f801c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:20.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.583+0000 7f8f867a0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f801341d0 0x7f8f801c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:20.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.583+0000 7f8f867a0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f801308f0 con 0x7f8f8009e390 2023-10-01T07:56:20.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.583+0000 7f8f867a0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8011c610 con 0x7f8f801338c0 2023-10-01T07:56:20.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.583+0000 7f8f867a0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8011dae0 con 0x7f8f801341d0 2023-10-01T07:56:20.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.583+0000 7f8f7ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f8009e390 0x7f8f8011cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:20.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.583+0000 7f8f7ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f8009e390 0x7f8f8011cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60908/0 (socket says 172.21.15.26:60908) 2023-10-01T07:56:20.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.583+0000 7f8f7ffff700 1 -- 172.21.15.26:0/1085561814 learned_addr learned my addr 172.21.15.26:0/1085561814 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:20.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.583+0000 7f8f84d3d700 1 --2- 172.21.15.26:0/1085561814 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f801341d0 0x7f8f801c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:20.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.583+0000 7f8f7ffff700 1 -- 172.21.15.26:0/1085561814 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f801341d0 msgr2=0x7f8f801c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:20.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.583+0000 7f8f7ffff700 1 --2- 172.21.15.26:0/1085561814 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f801341d0 0x7f8f801c8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:20.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.583+0000 7f8f7ffff700 1 -- 172.21.15.26:0/1085561814 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f801338c0 msgr2=0x7f8f801c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:20.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.583+0000 7f8f7ffff700 1 --2- 172.21.15.26:0/1085561814 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f801338c0 0x7f8f801c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:20.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.583+0000 7f8f7ffff700 1 -- 172.21.15.26:0/1085561814 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f74009550 con 0x7f8f8009e390 2023-10-01T07:56:20.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.584+0000 7f8f7ffff700 1 --2- 172.21.15.26:0/1085561814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f8009e390 0x7f8f8011cc40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8f700090b0 tx=0x7f8f70004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:20.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.584+0000 7f8f7cff9700 1 -- 172.21.15.26:0/1085561814 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f700045d0 con 0x7f8f8009e390 2023-10-01T07:56:20.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.584+0000 7f8f7cff9700 1 -- 172.21.15.26:0/1085561814 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7001f070 con 0x7f8f8009e390 2023-10-01T07:56:20.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.584+0000 7f8f867a0700 1 -- 172.21.15.26:0/1085561814 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f700094a0 con 0x7f8f8009e390 2023-10-01T07:56:20.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.584+0000 7f8f7cff9700 1 -- 172.21.15.26:0/1085561814 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f700038e0 con 0x7f8f8009e390 2023-10-01T07:56:20.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.584+0000 7f8f867a0700 1 -- 172.21.15.26:0/1085561814 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f8011f780 con 0x7f8f8009e390 2023-10-01T07:56:20.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.585+0000 7f8f7cff9700 1 -- 172.21.15.26:0/1085561814 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8f70003a40 con 0x7f8f8009e390 2023-10-01T07:56:20.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.585+0000 7f8f867a0700 1 -- 172.21.15.26:0/1085561814 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f80074ea0 con 0x7f8f8009e390 2023-10-01T07:56:20.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.585+0000 7f8f7cff9700 1 -- 172.21.15.26:0/1085561814 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8f70021070 con 0x7f8f8009e390 2023-10-01T07:56:20.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.590+0000 7f8f7cff9700 1 -- 172.21.15.26:0/1085561814 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8f70010380 con 0x7f8f8009e390 2023-10-01T07:56:20.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.627+0000 7fd036327700 1 Processor -- start 2023-10-01T07:56:20.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.627+0000 7fd036327700 1 -- start start 2023-10-01T07:56:20.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.628+0000 7fd036327700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd03009e930 0x7fd03009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:20.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.628+0000 7fd036327700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd03009f240 0x7fd0301317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:20.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.628+0000 7fd036327700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd030070940 con 0x7fd03009f650 2023-10-01T07:56:20.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.628+0000 7fd036327700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd03006fd60 con 0x7fd03009f240 2023-10-01T07:56:20.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.628+0000 7fd036327700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd03006fa80 con 0x7fd03009e930 2023-10-01T07:56:20.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.628+0000 7fd02f7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd03009f240 0x7fd0301317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:20.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.628+0000 7fd0348c4700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd03009f650 0x7fd030131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54806/0 (socket says 172.21.15.26:54806) 2023-10-01T07:56:20.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.628+0000 7fd0348c4700 1 -- 172.21.15.26:0/2463735586 learned_addr learned my addr 172.21.15.26:0/2463735586 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:20.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.628+0000 7fd02ffff700 1 --2- 172.21.15.26:0/2463735586 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd03009e930 0x7fd03009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:20.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.628+0000 7fd02effd700 1 -- 172.21.15.26:0/2463735586 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 83925789 0 0) 0x7fd030070940 con 0x7fd03009f650 2023-10-01T07:56:20.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.628+0000 7fd02effd700 1 -- 172.21.15.26:0/2463735586 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0180035b0 con 0x7fd03009f650 2023-10-01T07:56:20.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.628+0000 7fd02f7fe700 1 -- 172.21.15.26:0/2463735586 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd03009e930 msgr2=0x7fd03009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:20.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.628+0000 7fd02f7fe700 1 --2- 172.21.15.26:0/2463735586 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd03009e930 0x7fd03009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:20.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.628+0000 7fd02f7fe700 1 -- 172.21.15.26:0/2463735586 >> v1:172.21.15.26:6789/0 conn(0x7fd03009f650 legacy=0x7fd030131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:20.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.628+0000 7fd02f7fe700 1 -- 172.21.15.26:0/2463735586 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd03009fb60 con 0x7fd03009f240 2023-10-01T07:56:20.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.629+0000 7fd02ffff700 1 --2- 172.21.15.26:0/2463735586 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd03009e930 0x7fd03009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:20.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.629+0000 7fd02f7fe700 1 --2- 172.21.15.26:0/2463735586 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd03009f240 0x7fd0301317f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd024009840 tx=0x7fd024009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a09d89190ab41e2b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:20.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.629+0000 7fd02effd700 1 -- 172.21.15.26:0/2463735586 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd024004230 con 0x7fd03009f240 2023-10-01T07:56:20.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.629+0000 7fd02effd700 1 -- 172.21.15.26:0/2463735586 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd024004390 con 0x7fd03009f240 2023-10-01T07:56:20.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.629+0000 7fd02effd700 1 -- 172.21.15.26:0/2463735586 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0240036a0 con 0x7fd03009f240 2023-10-01T07:56:20.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.630+0000 7fd036327700 1 -- 172.21.15.26:0/2463735586 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd03009f240 msgr2=0x7fd0301317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:20.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.630+0000 7fd036327700 1 --2- 172.21.15.26:0/2463735586 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd03009f240 0x7fd0301317f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd024009840 tx=0x7fd024009b50 comp rx=0 tx=0).stop 2023-10-01T07:56:20.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.630+0000 7fd036327700 1 -- 172.21.15.26:0/2463735586 shutdown_connections 2023-10-01T07:56:20.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.630+0000 7fd036327700 1 --2- 172.21.15.26:0/2463735586 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd03009e930 0x7fd03009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:20.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.630+0000 7fd036327700 1 --2- 172.21.15.26:0/2463735586 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd03009f240 0x7fd0301317f0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:20.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.630+0000 7fd036327700 1 -- 172.21.15.26:0/2463735586 >> 172.21.15.26:0/2463735586 conn(0x7fd0300a4210 msgr2=0x7fd0300a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:20.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.630+0000 7fd036327700 1 -- 172.21.15.26:0/2463735586 shutdown_connections 2023-10-01T07:56:20.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.630+0000 7fd036327700 1 -- 172.21.15.26:0/2463735586 wait complete. 2023-10-01T07:56:20.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.631+0000 7fd036327700 1 Processor -- start 2023-10-01T07:56:20.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.632+0000 7fd036327700 1 -- start start 2023-10-01T07:56:20.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.632+0000 7fd036327700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd03009e930 0x7fd030120490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:20.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.632+0000 7fd036327700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd03009f240 0x7fd0301209d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:20.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.632+0000 7fd036327700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd03009f650 0x7fd030120f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:20.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.632+0000 7fd036327700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd030123f20 con 0x7fd03009e930 2023-10-01T07:56:20.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.632+0000 7fd036327700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0301218f0 con 0x7fd03009f650 2023-10-01T07:56:20.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.632+0000 7fd036327700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd030122010 con 0x7fd03009f240 2023-10-01T07:56:20.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.632+0000 7fd0348c4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd03009f650 0x7fd030120f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:20.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.632+0000 7fd0348c4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd03009f650 0x7fd030120f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37010/0 (socket says 172.21.15.26:37010) 2023-10-01T07:56:20.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.632+0000 7fd0348c4700 1 -- 172.21.15.26:0/4142107611 learned_addr learned my addr 172.21.15.26:0/4142107611 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:20.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.632+0000 7fd02ffff700 1 --2- 172.21.15.26:0/4142107611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd03009e930 0x7fd030120490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:20.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.633+0000 7fd02f7fe700 1 --2- 172.21.15.26:0/4142107611 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd03009f240 0x7fd0301209d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:20.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.633+0000 7fd02ffff700 1 -- 172.21.15.26:0/4142107611 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd03009f240 msgr2=0x7fd0301209d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:20.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.633+0000 7fd02ffff700 1 --2- 172.21.15.26:0/4142107611 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd03009f240 0x7fd0301209d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:20.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.633+0000 7fd02ffff700 1 -- 172.21.15.26:0/4142107611 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd03009f650 msgr2=0x7fd030120f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:20.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.633+0000 7fd02ffff700 1 --2- 172.21.15.26:0/4142107611 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd03009f650 0x7fd030120f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:20.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.633+0000 7fd02ffff700 1 -- 172.21.15.26:0/4142107611 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0200094a0 con 0x7fd03009e930 2023-10-01T07:56:20.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.633+0000 7fd0348c4700 1 --2- 172.21.15.26:0/4142107611 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd03009f650 0x7fd030120f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:20.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.633+0000 7fd02ffff700 1 --2- 172.21.15.26:0/4142107611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd03009e930 0x7fd030120490 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd02000e9b0 tx=0x7fd02000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:20.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.633+0000 7fd02cff9700 1 -- 172.21.15.26:0/4142107611 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02000ee50 con 0x7fd03009e930 2023-10-01T07:56:20.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.633+0000 7fd02cff9700 1 -- 172.21.15.26:0/4142107611 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd020013860 con 0x7fd03009e930 2023-10-01T07:56:20.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.633+0000 7fd02cff9700 1 -- 172.21.15.26:0/4142107611 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd020013c10 con 0x7fd03009e930 2023-10-01T07:56:20.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.634+0000 7fd036327700 1 -- 172.21.15.26:0/4142107611 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0240094a0 con 0x7fd03009e930 2023-10-01T07:56:20.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.634+0000 7fd036327700 1 -- 172.21.15.26:0/4142107611 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0300a0190 con 0x7fd03009e930 2023-10-01T07:56:20.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.635+0000 7fd02cff9700 1 -- 172.21.15.26:0/4142107611 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd02000c5e0 con 0x7fd03009e930 2023-10-01T07:56:20.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.635+0000 7fd02cff9700 1 -- 172.21.15.26:0/4142107611 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd020043570 con 0x7fd03009e930 2023-10-01T07:56:20.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.635+0000 7fd036327700 1 -- 172.21.15.26:0/4142107611 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0301238c0 con 0x7fd03009e930 2023-10-01T07:56:20.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.640+0000 7fd02cff9700 1 -- 172.21.15.26:0/4142107611 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd0301238c0 con 0x7fd03009e930 2023-10-01T07:56:20.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.665+0000 7f5bc28b0700 1 -- 172.21.15.26:0/804739639 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5bbc074ea0 con 0x7f5bbc09e000 2023-10-01T07:56:20.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.665+0000 7f5bb8ff9700 1 -- 172.21.15.26:0/804739639 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5ba4015020 con 0x7f5bbc09e000 2023-10-01T07:56:20.666 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:20.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.668+0000 7f5bc28b0700 1 -- 172.21.15.26:0/804739639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bbc09e000 msgr2=0x7f5bbc1a6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:20.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.668+0000 7f5bc28b0700 1 --2- 172.21.15.26:0/804739639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bbc09e000 0x7f5bbc1a6710 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc06e510 tx=0x7f5ba4004750 comp rx=0 tx=0).stop 2023-10-01T07:56:20.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.668+0000 7f5bc28b0700 1 -- 172.21.15.26:0/804739639 shutdown_connections 2023-10-01T07:56:20.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.668+0000 7f5bc28b0700 1 --2- 172.21.15.26:0/804739639 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bbc09e410 0x7f5bbc1a6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:20.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.668+0000 7f5bc28b0700 1 --2- 172.21.15.26:0/804739639 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bbc09d6f0 0x7f5bbc1a61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:20.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.668+0000 7f5bc28b0700 1 --2- 172.21.15.26:0/804739639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bbc09e000 0x7f5bbc1a6710 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:20.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.668+0000 7f5bc28b0700 1 -- 172.21.15.26:0/804739639 >> 172.21.15.26:0/804739639 conn(0x7f5bbc066f50 msgr2=0x7f5bbc1bac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:20.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.668+0000 7f5bc28b0700 1 -- 172.21.15.26:0/804739639 shutdown_connections 2023-10-01T07:56:20.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.668+0000 7f5bc28b0700 1 -- 172.21.15.26:0/804739639 wait complete. 2023-10-01T07:56:20.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.674+0000 7ff4f06a9700 1 Processor -- start 2023-10-01T07:56:20.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.674+0000 7ff4f06a9700 1 -- start start 2023-10-01T07:56:20.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.675+0000 7ff4f06a9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff4e809e230 0x7ff4e8131c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:20.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.675+0000 7ff4f06a9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4e806ae80 0x7ff4e8139590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:20.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.675+0000 7ff4f06a9700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4e809dba0 con 0x7ff4e8131830 2023-10-01T07:56:20.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.675+0000 7ff4f06a9700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4e8132140 con 0x7ff4e809e230 2023-10-01T07:56:20.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.675+0000 7ff4f06a9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e81313e0 con 0x7ff4e806ae80 2023-10-01T07:56:20.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.675+0000 7ff4eec46700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4e806ae80 0x7ff4e8139590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:20.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.675+0000 7ff4eec46700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4e806ae80 0x7ff4e8139590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37014/0 (socket says 172.21.15.26:37014) 2023-10-01T07:56:20.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.675+0000 7ff4eec46700 1 -- 172.21.15.26:0/442480880 learned_addr learned my addr 172.21.15.26:0/442480880 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:20.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.675+0000 7ff4edc44700 1 --2- 172.21.15.26:0/442480880 >> v2:172.21.15.26:3300/0 conn(0x7ff4e809e230 0x7ff4e8131c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:20.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.676+0000 7ff4eec46700 1 -- 172.21.15.26:0/442480880 >> v2:172.21.15.26:3300/0 conn(0x7ff4e809e230 msgr2=0x7ff4e8131c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:20.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.676+0000 7ff4eec46700 1 --2- 172.21.15.26:0/442480880 >> v2:172.21.15.26:3300/0 conn(0x7ff4e809e230 0x7ff4e8131c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:20.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.676+0000 7ff4eec46700 1 -- 172.21.15.26:0/442480880 >> v1:172.21.15.26:6789/0 conn(0x7ff4e8131830 legacy=0x7ff4e806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:20.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.676+0000 7ff4eec46700 1 -- 172.21.15.26:0/442480880 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e809d6d0 con 0x7ff4e806ae80 2023-10-01T07:56:20.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.676+0000 7ff4eec46700 1 --2- 172.21.15.26:0/442480880 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4e806ae80 0x7ff4e8139590 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0009e50 tx=0x7ff4e000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71aca0d132332c42 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:20.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.676+0000 7ff4ed443700 1 -- 172.21.15.26:0/442480880 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e000e070 con 0x7ff4e806ae80 2023-10-01T07:56:20.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.676+0000 7ff4ed443700 1 -- 172.21.15.26:0/442480880 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e0003a20 con 0x7ff4e806ae80 2023-10-01T07:56:20.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.676+0000 7ff4ed443700 1 -- 172.21.15.26:0/442480880 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e0003dd0 con 0x7ff4e806ae80 2023-10-01T07:56:20.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.677+0000 7ff4f06a9700 1 -- 172.21.15.26:0/442480880 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4e806ae80 msgr2=0x7ff4e8139590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:20.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.677+0000 7ff4f06a9700 1 --2- 172.21.15.26:0/442480880 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4e806ae80 0x7ff4e8139590 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0009e50 tx=0x7ff4e000b330 comp rx=0 tx=0).stop 2023-10-01T07:56:20.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.677+0000 7ff4f06a9700 1 -- 172.21.15.26:0/442480880 shutdown_connections 2023-10-01T07:56:20.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.677+0000 7ff4f06a9700 1 --2- 172.21.15.26:0/442480880 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4e806ae80 0x7ff4e8139590 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:20.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.677+0000 7ff4f06a9700 1 --2- 172.21.15.26:0/442480880 >> v2:172.21.15.26:3300/0 conn(0x7ff4e809e230 0x7ff4e8131c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:20.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.677+0000 7ff4f06a9700 1 -- 172.21.15.26:0/442480880 >> 172.21.15.26:0/442480880 conn(0x7ff4e8099c20 msgr2=0x7ff4e80a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:20.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.677+0000 7ff4f06a9700 1 -- 172.21.15.26:0/442480880 shutdown_connections 2023-10-01T07:56:20.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.677+0000 7ff4f06a9700 1 -- 172.21.15.26:0/442480880 wait complete. 2023-10-01T07:56:20.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.678+0000 7ff4f06a9700 1 Processor -- start 2023-10-01T07:56:20.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.679+0000 7ff4f06a9700 1 -- start start 2023-10-01T07:56:20.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.679+0000 7ff4f06a9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4e806ae80 0x7ff4e811a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:20.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.679+0000 7ff4f06a9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4e809e230 0x7ff4e811a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:20.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.679+0000 7ff4f06a9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4e8131830 0x7ff4e811af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:20.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.679+0000 7ff4f06a9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e811ddc0 con 0x7ff4e806ae80 2023-10-01T07:56:20.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.679+0000 7ff4f06a9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e811c150 con 0x7ff4e8131830 2023-10-01T07:56:20.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.679+0000 7ff4f06a9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e811dfc0 con 0x7ff4e809e230 2023-10-01T07:56:20.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.680+0000 7ff4ee445700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4e806ae80 0x7ff4e811a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:20.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.680+0000 7ff4ee445700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4e806ae80 0x7ff4e811a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60942/0 (socket says 172.21.15.26:60942) 2023-10-01T07:56:20.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.680+0000 7ff4ee445700 1 -- 172.21.15.26:0/2452289995 learned_addr learned my addr 172.21.15.26:0/2452289995 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:20.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.680+0000 7ff4eec46700 1 --2- 172.21.15.26:0/2452289995 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4e8131830 0x7ff4e811af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:20.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.680+0000 7ff4edc44700 1 --2- 172.21.15.26:0/2452289995 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4e809e230 0x7ff4e811a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:20.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.680+0000 7ff4ee445700 1 -- 172.21.15.26:0/2452289995 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4e809e230 msgr2=0x7ff4e811a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:20.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.680+0000 7ff4ee445700 1 --2- 172.21.15.26:0/2452289995 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4e809e230 0x7ff4e811a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:20.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.680+0000 7ff4ee445700 1 -- 172.21.15.26:0/2452289995 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4e8131830 msgr2=0x7ff4e811af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:20.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.680+0000 7ff4ee445700 1 --2- 172.21.15.26:0/2452289995 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4e8131830 0x7ff4e811af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:20.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.680+0000 7ff4ee445700 1 -- 172.21.15.26:0/2452289995 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e0009b30 con 0x7ff4e806ae80 2023-10-01T07:56:20.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.680+0000 7ff4edc44700 1 --2- 172.21.15.26:0/2452289995 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4e809e230 0x7ff4e811a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:56:20.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.680+0000 7ff4ee445700 1 --2- 172.21.15.26:0/2452289995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4e806ae80 0x7ff4e811a4a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400c500 tx=0x7ff4e400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:20.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.681+0000 7ff4deffd700 1 -- 172.21.15.26:0/2452289995 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4011790 con 0x7ff4e806ae80 2023-10-01T07:56:20.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.681+0000 7ff4deffd700 1 -- 172.21.15.26:0/2452289995 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e40118f0 con 0x7ff4e806ae80 2023-10-01T07:56:20.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.681+0000 7ff4f06a9700 1 -- 172.21.15.26:0/2452289995 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4e80a1700 con 0x7ff4e806ae80 2023-10-01T07:56:20.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.681+0000 7ff4deffd700 1 -- 172.21.15.26:0/2452289995 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4011ca0 con 0x7ff4e806ae80 2023-10-01T07:56:20.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.681+0000 7ff4f06a9700 1 -- 172.21.15.26:0/2452289995 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4e812b010 con 0x7ff4e806ae80 2023-10-01T07:56:20.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.682+0000 7ff4deffd700 1 -- 172.21.15.26:0/2452289995 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff4e401c460 con 0x7ff4e806ae80 2023-10-01T07:56:20.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.682+0000 7ff4f06a9700 1 -- 172.21.15.26:0/2452289995 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4e811dc00 con 0x7ff4e806ae80 2023-10-01T07:56:20.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.682+0000 7ff4deffd700 1 -- 172.21.15.26:0/2452289995 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff4e40104c0 con 0x7ff4e806ae80 2023-10-01T07:56:20.686 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:20.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.692+0000 7ff4deffd700 1 -- 172.21.15.26:0/2452289995 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff4e4044060 con 0x7ff4e806ae80 2023-10-01T07:56:20.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.822+0000 7f8f867a0700 1 -- 172.21.15.26:0/1085561814 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8f8006b9e0 con 0x7f8f8009e390 2023-10-01T07:56:20.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.822+0000 7f8f7cff9700 1 -- 172.21.15.26:0/1085561814 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8f70015030 con 0x7f8f8009e390 2023-10-01T07:56:20.823 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:20.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.824+0000 7f8f867a0700 1 -- 172.21.15.26:0/1085561814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f8009e390 msgr2=0x7f8f8011cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:20.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.824+0000 7f8f867a0700 1 --2- 172.21.15.26:0/1085561814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f8009e390 0x7f8f8011cc40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8f700090b0 tx=0x7f8f70004750 comp rx=0 tx=0).stop 2023-10-01T07:56:20.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.824+0000 7f8f867a0700 1 -- 172.21.15.26:0/1085561814 shutdown_connections 2023-10-01T07:56:20.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.824+0000 7f8f867a0700 1 --2- 172.21.15.26:0/1085561814 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f801341d0 0x7f8f801c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:20.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.824+0000 7f8f867a0700 1 --2- 172.21.15.26:0/1085561814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f8009e390 0x7f8f8011cc40 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:20.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.824+0000 7f8f867a0700 1 --2- 172.21.15.26:0/1085561814 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f801338c0 0x7f8f801c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:20.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.824+0000 7f8f867a0700 1 -- 172.21.15.26:0/1085561814 >> 172.21.15.26:0/1085561814 conn(0x7f8f800a2aa0 msgr2=0x7f8f8009f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:20.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.824+0000 7f8f867a0700 1 -- 172.21.15.26:0/1085561814 shutdown_connections 2023-10-01T07:56:20.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.824+0000 7f8f867a0700 1 -- 172.21.15.26:0/1085561814 wait complete. 2023-10-01T07:56:20.839 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:20.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.863+0000 7fd036327700 1 -- 172.21.15.26:0/4142107611 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd0301238c0 con 0x7fd03009e930 2023-10-01T07:56:20.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.863+0000 7fd02cff9700 1 -- 172.21.15.26:0/4142107611 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd0301238c0 con 0x7fd03009e930 2023-10-01T07:56:20.864 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:20.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.865+0000 7fd036327700 1 -- 172.21.15.26:0/4142107611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd03009e930 msgr2=0x7fd030120490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:20.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.865+0000 7fd036327700 1 --2- 172.21.15.26:0/4142107611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd03009e930 0x7fd030120490 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd02000e9b0 tx=0x7fd02000ecc0 comp rx=0 tx=0).stop 2023-10-01T07:56:20.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.866+0000 7fd036327700 1 -- 172.21.15.26:0/4142107611 shutdown_connections 2023-10-01T07:56:20.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.866+0000 7fd036327700 1 --2- 172.21.15.26:0/4142107611 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd03009f650 0x7fd030120f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:20.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.866+0000 7fd036327700 1 --2- 172.21.15.26:0/4142107611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd03009e930 0x7fd030120490 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:20.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.866+0000 7fd036327700 1 --2- 172.21.15.26:0/4142107611 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd03009f240 0x7fd0301209d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:20.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.866+0000 7fd036327700 1 -- 172.21.15.26:0/4142107611 >> 172.21.15.26:0/4142107611 conn(0x7fd0300a4210 msgr2=0x7fd0300a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:20.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.866+0000 7fd036327700 1 -- 172.21.15.26:0/4142107611 shutdown_connections 2023-10-01T07:56:20.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.866+0000 7fd036327700 1 -- 172.21.15.26:0/4142107611 wait complete. 2023-10-01T07:56:20.880 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:20.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.899+0000 7ff4f06a9700 1 -- 172.21.15.26:0/2452289995 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff4e812b8a0 con 0x7ff4e806ae80 2023-10-01T07:56:20.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.899+0000 7ff4deffd700 1 -- 172.21.15.26:0/2452289995 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff4e40106d0 con 0x7ff4e806ae80 2023-10-01T07:56:20.900 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:20.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.902+0000 7ff4f06a9700 1 -- 172.21.15.26:0/2452289995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4e806ae80 msgr2=0x7ff4e811a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:20.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.902+0000 7ff4f06a9700 1 --2- 172.21.15.26:0/2452289995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4e806ae80 0x7ff4e811a4a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400c500 tx=0x7ff4e400c810 comp rx=0 tx=0).stop 2023-10-01T07:56:20.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.902+0000 7ff4f06a9700 1 -- 172.21.15.26:0/2452289995 shutdown_connections 2023-10-01T07:56:20.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.902+0000 7ff4f06a9700 1 --2- 172.21.15.26:0/2452289995 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4e8131830 0x7ff4e811af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:20.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.902+0000 7ff4f06a9700 1 --2- 172.21.15.26:0/2452289995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4e806ae80 0x7ff4e811a4a0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:20.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.902+0000 7ff4f06a9700 1 --2- 172.21.15.26:0/2452289995 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4e809e230 0x7ff4e811a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:20.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.902+0000 7ff4f06a9700 1 -- 172.21.15.26:0/2452289995 >> 172.21.15.26:0/2452289995 conn(0x7ff4e8099c20 msgr2=0x7ff4e812dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:20.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.902+0000 7ff4f06a9700 1 -- 172.21.15.26:0/2452289995 shutdown_connections 2023-10-01T07:56:20.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:20.902+0000 7ff4f06a9700 1 -- 172.21.15.26:0/2452289995 wait complete. 2023-10-01T07:56:20.916 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:21.687 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:21.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.833+0000 7fd6def7b700 1 Processor -- start 2023-10-01T07:56:21.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.833+0000 7fd6def7b700 1 -- start start 2023-10-01T07:56:21.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.833+0000 7fd6def7b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd6d809d6f0 0x7fd6d809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:21.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.833+0000 7fd6def7b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6d809e000 0x7fd6d8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:21.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.833+0000 7fd6def7b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d809f130 con 0x7fd6d809e410 2023-10-01T07:56:21.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.833+0000 7fd6def7b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d809f520 con 0x7fd6d809d6f0 2023-10-01T07:56:21.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.834+0000 7fd6def7b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d809e930 con 0x7fd6d809e000 2023-10-01T07:56:21.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.834+0000 7fd6dcd17700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd6d809d6f0 0x7fd6d809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:21.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.834+0000 7fd6d7fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6d809e000 0x7fd6d8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:21.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.834+0000 7fd6d7fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6d809e000 0x7fd6d8130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37028/0 (socket says 172.21.15.26:37028) 2023-10-01T07:56:21.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.834+0000 7fd6dcd17700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd6d809d6f0 0x7fd6d809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60944/0 (socket says 172.21.15.26:60944) 2023-10-01T07:56:21.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.834+0000 7fd6dd518700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd6d809e410 0x7fd6d8130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54826/0 (socket says 172.21.15.26:54826) 2023-10-01T07:56:21.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.834+0000 7fd6d7fff700 1 -- 172.21.15.26:0/2700311515 learned_addr learned my addr 172.21.15.26:0/2700311515 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:21.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.834+0000 7fd6dcd17700 1 -- 172.21.15.26:0/2700311515 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6d809e000 msgr2=0x7fd6d8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:21.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.834+0000 7fd6dcd17700 1 --2- 172.21.15.26:0/2700311515 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6d809e000 0x7fd6d8130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:21.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.834+0000 7fd6dcd17700 1 -- 172.21.15.26:0/2700311515 >> v1:172.21.15.26:6789/0 conn(0x7fd6d809e410 legacy=0x7fd6d8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:21.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.834+0000 7fd6dcd17700 1 -- 172.21.15.26:0/2700311515 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d809b2d0 con 0x7fd6d809d6f0 2023-10-01T07:56:21.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.834+0000 7fd6d7fff700 1 --2- 172.21.15.26:0/2700311515 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6d809e000 0x7fd6d8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:21.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.834+0000 7fd6dcd17700 1 --2- 172.21.15.26:0/2700311515 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6d809d6f0 0x7fd6d809dac0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc009840 tx=0x7fd6cc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=152111e807b93c63 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:21.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.834+0000 7fd6d77fe700 1 -- 172.21.15.26:0/2700311515 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc011830 con 0x7fd6d809d6f0 2023-10-01T07:56:21.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.834+0000 7fd6d77fe700 1 -- 172.21.15.26:0/2700311515 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6cc011990 con 0x7fd6d809d6f0 2023-10-01T07:56:21.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.834+0000 7fd6d77fe700 1 -- 172.21.15.26:0/2700311515 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc011d20 con 0x7fd6d809d6f0 2023-10-01T07:56:21.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.835+0000 7fd6def7b700 1 -- 172.21.15.26:0/2700311515 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6d809d6f0 msgr2=0x7fd6d809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:21.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.835+0000 7fd6def7b700 1 --2- 172.21.15.26:0/2700311515 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6d809d6f0 0x7fd6d809dac0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc009840 tx=0x7fd6cc009b50 comp rx=0 tx=0).stop 2023-10-01T07:56:21.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.835+0000 7fd6def7b700 1 -- 172.21.15.26:0/2700311515 shutdown_connections 2023-10-01T07:56:21.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.835+0000 7fd6def7b700 1 --2- 172.21.15.26:0/2700311515 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6d809d6f0 0x7fd6d809dac0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:21.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.835+0000 7fd6def7b700 1 --2- 172.21.15.26:0/2700311515 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6d809e000 0x7fd6d8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:21.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.835+0000 7fd6def7b700 1 -- 172.21.15.26:0/2700311515 >> 172.21.15.26:0/2700311515 conn(0x7fd6d8066f50 msgr2=0x7fd6d809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:21.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.835+0000 7fd6def7b700 1 -- 172.21.15.26:0/2700311515 shutdown_connections 2023-10-01T07:56:21.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.835+0000 7fd6def7b700 1 -- 172.21.15.26:0/2700311515 wait complete. 2023-10-01T07:56:21.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.836+0000 7fd6def7b700 1 Processor -- start 2023-10-01T07:56:21.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.837+0000 7fd6def7b700 1 -- start start 2023-10-01T07:56:21.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.837+0000 7fd6def7b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6d809d6f0 0x7fd6d81222c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:21.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.837+0000 7fd6def7b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6d809e000 0x7fd6d8122800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:21.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.837+0000 7fd6def7b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6d809e410 0x7fd6d8122d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:21.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.837+0000 7fd6def7b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d81254c0 con 0x7fd6d809e410 2023-10-01T07:56:21.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.837+0000 7fd6def7b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d8124770 con 0x7fd6d809d6f0 2023-10-01T07:56:21.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.837+0000 7fd6def7b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d8123ed0 con 0x7fd6d809e000 2023-10-01T07:56:21.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.838+0000 7fd6d7fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6d809e000 0x7fd6d8122800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:21.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.838+0000 7fd6dd518700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6d809e410 0x7fd6d8122d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:21.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.838+0000 7fd6dcd17700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6d809d6f0 0x7fd6d81222c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:21.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.838+0000 7fd6dcd17700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6d809d6f0 0x7fd6d81222c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37030/0 (socket says 172.21.15.26:37030) 2023-10-01T07:56:21.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.838+0000 7fd6d7fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6d809e000 0x7fd6d8122800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:60598/0 (socket says 172.21.15.26:60598) 2023-10-01T07:56:21.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.838+0000 7fd6dd518700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6d809e410 0x7fd6d8122d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60954/0 (socket says 172.21.15.26:60954) 2023-10-01T07:56:21.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.838+0000 7fd6dcd17700 1 -- 172.21.15.26:0/2210396429 learned_addr learned my addr 172.21.15.26:0/2210396429 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:21.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.838+0000 7fd6dcd17700 1 -- 172.21.15.26:0/2210396429 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6d809e000 msgr2=0x7fd6d8122800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:21.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.838+0000 7fd6dcd17700 1 --2- 172.21.15.26:0/2210396429 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6d809e000 0x7fd6d8122800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:21.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.838+0000 7fd6dcd17700 1 -- 172.21.15.26:0/2210396429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6d809e410 msgr2=0x7fd6d8122d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:21.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.838+0000 7fd6dcd17700 1 --2- 172.21.15.26:0/2210396429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6d809e410 0x7fd6d8122d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:21.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.838+0000 7fd6dcd17700 1 -- 172.21.15.26:0/2210396429 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c4009550 con 0x7fd6d809d6f0 2023-10-01T07:56:21.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.838+0000 7fd6dd518700 1 --2- 172.21.15.26:0/2210396429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6d809e410 0x7fd6d8122d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:21.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.838+0000 7fd6dcd17700 1 --2- 172.21.15.26:0/2210396429 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6d809d6f0 0x7fd6d81222c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0090b0 tx=0x7fd6cc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:21.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.838+0000 7fd6d57fa700 1 -- 172.21.15.26:0/2210396429 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc0036a0 con 0x7fd6d809d6f0 2023-10-01T07:56:21.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.838+0000 7fd6d57fa700 1 -- 172.21.15.26:0/2210396429 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6cc01f070 con 0x7fd6d809d6f0 2023-10-01T07:56:21.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.838+0000 7fd6def7b700 1 -- 172.21.15.26:0/2210396429 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6cc0094a0 con 0x7fd6d809d6f0 2023-10-01T07:56:21.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.838+0000 7fd6d57fa700 1 -- 172.21.15.26:0/2210396429 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc003a60 con 0x7fd6d809d6f0 2023-10-01T07:56:21.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.838+0000 7fd6def7b700 1 -- 172.21.15.26:0/2210396429 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d8125840 con 0x7fd6d809d6f0 2023-10-01T07:56:21.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.839+0000 7fd6d57fa700 1 -- 172.21.15.26:0/2210396429 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd6cc003bc0 con 0x7fd6d809d6f0 2023-10-01T07:56:21.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.839+0000 7fd6d57fa700 1 -- 172.21.15.26:0/2210396429 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd6cc021070 con 0x7fd6d809d6f0 2023-10-01T07:56:21.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.839+0000 7fd6def7b700 1 -- 172.21.15.26:0/2210396429 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d8074ea0 con 0x7fd6d809d6f0 2023-10-01T07:56:21.844 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:21.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.844+0000 7fd6d57fa700 1 -- 172.21.15.26:0/2210396429 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd6cc015020 con 0x7fd6d809d6f0 2023-10-01T07:56:21.882 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:21.917 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:21.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.987+0000 7f3988440700 1 Processor -- start 2023-10-01T07:56:21.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.987+0000 7f3988440700 1 -- start start 2023-10-01T07:56:21.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.988+0000 7f3988440700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f398009d6f0 0x7f398009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:21.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.988+0000 7f3988440700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f398009e440 0x7f3980134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:21.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.988+0000 7f3988440700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398009b120 con 0x7f398009e000 2023-10-01T07:56:21.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.988+0000 7f3988440700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f398006b460 con 0x7f398009d6f0 2023-10-01T07:56:21.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.988+0000 7f3988440700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f398009a7e0 con 0x7f398009e440 2023-10-01T07:56:21.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.988+0000 7f39861dc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f398009d6f0 0x7f398009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:21.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.988+0000 7f39869dd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f398009e440 0x7f3980134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:21.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.988+0000 7f39861dc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f398009d6f0 0x7f398009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60970/0 (socket says 172.21.15.26:60970) 2023-10-01T07:56:21.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.988+0000 7f39869dd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f398009e440 0x7f3980134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:60604/0 (socket says 172.21.15.26:60604) 2023-10-01T07:56:21.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.988+0000 7f39861dc700 1 -- 172.21.15.26:0/1252114558 learned_addr learned my addr 172.21.15.26:0/1252114558 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:21.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.989+0000 7f39861dc700 1 -- 172.21.15.26:0/1252114558 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f398009e440 msgr2=0x7f3980134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:21.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.989+0000 7f39861dc700 1 --2- 172.21.15.26:0/1252114558 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f398009e440 0x7f3980134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:21.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.989+0000 7f39861dc700 1 -- 172.21.15.26:0/1252114558 >> v1:172.21.15.26:6789/0 conn(0x7f398009e000 legacy=0x7f39801339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:21.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.989+0000 7f39861dc700 1 -- 172.21.15.26:0/1252114558 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398009a500 con 0x7f398009d6f0 2023-10-01T07:56:21.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.989+0000 7f39869dd700 1 --2- 172.21.15.26:0/1252114558 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f398009e440 0x7f3980134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:21.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.989+0000 7f39861dc700 1 --2- 172.21.15.26:0/1252114558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f398009d6f0 0x7f398009dac0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f397c009920 tx=0x7f397c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab57ec8385746575 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:21.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.989+0000 7f39851da700 1 -- 172.21.15.26:0/1252114558 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c011830 con 0x7f398009d6f0 2023-10-01T07:56:21.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.989+0000 7f39851da700 1 -- 172.21.15.26:0/1252114558 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397c011990 con 0x7f398009d6f0 2023-10-01T07:56:21.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.989+0000 7f39851da700 1 -- 172.21.15.26:0/1252114558 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c011d20 con 0x7f398009d6f0 2023-10-01T07:56:21.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.990+0000 7f3988440700 1 -- 172.21.15.26:0/1252114558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f398009d6f0 msgr2=0x7f398009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:21.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.990+0000 7f3988440700 1 --2- 172.21.15.26:0/1252114558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f398009d6f0 0x7f398009dac0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f397c009920 tx=0x7f397c009c30 comp rx=0 tx=0).stop 2023-10-01T07:56:21.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.990+0000 7f3988440700 1 -- 172.21.15.26:0/1252114558 shutdown_connections 2023-10-01T07:56:21.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.990+0000 7f3988440700 1 --2- 172.21.15.26:0/1252114558 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f398009e440 0x7f3980134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:21.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.990+0000 7f3988440700 1 --2- 172.21.15.26:0/1252114558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f398009d6f0 0x7f398009dac0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:21.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.990+0000 7f3988440700 1 -- 172.21.15.26:0/1252114558 >> 172.21.15.26:0/1252114558 conn(0x7f3980066f50 msgr2=0x7f398009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:21.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.990+0000 7f3988440700 1 -- 172.21.15.26:0/1252114558 shutdown_connections 2023-10-01T07:56:21.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.990+0000 7f3988440700 1 -- 172.21.15.26:0/1252114558 wait complete. 2023-10-01T07:56:21.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.991+0000 7f3988440700 1 Processor -- start 2023-10-01T07:56:21.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.991+0000 7f3988440700 1 -- start start 2023-10-01T07:56:21.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.992+0000 7f3988440700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f398009d6f0 0x7f39801a5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:21.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.992+0000 7f3988440700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f398009e000 0x7f39801a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:21.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.992+0000 7f3988440700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f398009e440 0x7f39801a68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:21.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.992+0000 7f3988440700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39801a96f0 con 0x7f398009e440 2023-10-01T07:56:21.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.992+0000 7f3988440700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39801a9940 con 0x7f398009e000 2023-10-01T07:56:21.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.992+0000 7f3988440700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39801a8830 con 0x7f398009d6f0 2023-10-01T07:56:21.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.992+0000 7f39859db700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f398009e000 0x7f39801a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:21.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.992+0000 7f39859db700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f398009e000 0x7f39801a63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37040/0 (socket says 172.21.15.26:37040) 2023-10-01T07:56:21.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.992+0000 7f39859db700 1 -- 172.21.15.26:0/3770692790 learned_addr learned my addr 172.21.15.26:0/3770692790 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:21.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.992+0000 7f39861dc700 1 --2- 172.21.15.26:0/3770692790 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f398009d6f0 0x7f39801a5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:21.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.992+0000 7f39869dd700 1 --2- 172.21.15.26:0/3770692790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f398009e440 0x7f39801a68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:21.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.993+0000 7f39869dd700 1 -- 172.21.15.26:0/3770692790 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f398009d6f0 msgr2=0x7f39801a5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:21.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.993+0000 7f39869dd700 1 --2- 172.21.15.26:0/3770692790 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f398009d6f0 0x7f39801a5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:21.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.993+0000 7f39869dd700 1 -- 172.21.15.26:0/3770692790 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f398009e000 msgr2=0x7f39801a63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:21.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.993+0000 7f39869dd700 1 --2- 172.21.15.26:0/3770692790 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f398009e000 0x7f39801a63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:21.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.993+0000 7f39869dd700 1 -- 172.21.15.26:0/3770692790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3978009a70 con 0x7f398009e440 2023-10-01T07:56:21.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.993+0000 7f39869dd700 1 --2- 172.21.15.26:0/3770692790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f398009e440 0x7f39801a68e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f397800efc0 tx=0x7f397800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:21.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.993+0000 7f3976ffd700 1 -- 172.21.15.26:0/3770692790 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397800ca90 con 0x7f398009e440 2023-10-01T07:56:21.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.993+0000 7f3976ffd700 1 -- 172.21.15.26:0/3770692790 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397800f040 con 0x7f398009e440 2023-10-01T07:56:21.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.993+0000 7f3988440700 1 -- 172.21.15.26:0/3770692790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f397c009550 con 0x7f398009e440 2023-10-01T07:56:21.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.993+0000 7f3976ffd700 1 -- 172.21.15.26:0/3770692790 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397800ce30 con 0x7f398009e440 2023-10-01T07:56:22.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.993+0000 7f3988440700 1 -- 172.21.15.26:0/3770692790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39801a7ad0 con 0x7f398009e440 2023-10-01T07:56:22.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.994+0000 7f3988440700 1 -- 172.21.15.26:0/3770692790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3980074ea0 con 0x7f398009e440 2023-10-01T07:56:22.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.995+0000 7f3976ffd700 1 -- 172.21.15.26:0/3770692790 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3978003a20 con 0x7f398009e440 2023-10-01T07:56:22.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:21.995+0000 7f3976ffd700 1 -- 172.21.15.26:0/3770692790 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3978040660 con 0x7f398009e440 2023-10-01T07:56:22.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.004+0000 7f3976ffd700 1 -- 172.21.15.26:0/3770692790 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f397801c7a0 con 0x7f398009e440 2023-10-01T07:56:22.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.034+0000 7fe93c08f700 1 Processor -- start 2023-10-01T07:56:22.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.034+0000 7fe93c08f700 1 -- start start 2023-10-01T07:56:22.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.035+0000 7fe93c08f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe934130540 0x7fe934130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:22.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.035+0000 7fe93c08f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe934130e50 0x7fe93406f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:22.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.035+0000 7fe93c08f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe93406fb20 0x7fe93406ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:22.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.035+0000 7fe93c08f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9340704b0 con 0x7fe934130e50 2023-10-01T07:56:22.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.035+0000 7fe93c08f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe93409a390 con 0x7fe934130540 2023-10-01T07:56:22.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.035+0000 7fe93c08f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9340716a0 con 0x7fe93406fb20 2023-10-01T07:56:22.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.035+0000 7fe93962a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe934130e50 0x7fe93406f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:22.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.035+0000 7fe93962a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe934130e50 0x7fe93406f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60996/0 (socket says 172.21.15.26:60996) 2023-10-01T07:56:22.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.035+0000 7fe93a62c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe93406fb20 0x7fe93406ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:22.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.035+0000 7fe93962a700 1 -- 172.21.15.26:0/2727134392 learned_addr learned my addr 172.21.15.26:0/2727134392 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:22.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.035+0000 7fe939e2b700 1 --2- 172.21.15.26:0/2727134392 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe934130540 0x7fe934130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:22.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.036+0000 7fe939e2b700 1 -- 172.21.15.26:0/2727134392 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe93406fb20 msgr2=0x7fe93406ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:22.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.036+0000 7fe939e2b700 1 --2- 172.21.15.26:0/2727134392 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe93406fb20 0x7fe93406ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:22.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.036+0000 7fe939e2b700 1 -- 172.21.15.26:0/2727134392 >> v2:172.21.15.26:3300/0 conn(0x7fe934130e50 msgr2=0x7fe93406f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:22.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.036+0000 7fe939e2b700 1 --2- 172.21.15.26:0/2727134392 >> v2:172.21.15.26:3300/0 conn(0x7fe934130e50 0x7fe93406f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:22.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.036+0000 7fe939e2b700 1 -- 172.21.15.26:0/2727134392 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe934071290 con 0x7fe934130540 2023-10-01T07:56:22.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.036+0000 7fe93a62c700 1 --2- 172.21.15.26:0/2727134392 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe93406fb20 0x7fe93406ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:22.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.036+0000 7fe93962a700 1 --2- 172.21.15.26:0/2727134392 >> v2:172.21.15.26:3300/0 conn(0x7fe934130e50 0x7fe93406f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:22.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.036+0000 7fe939e2b700 1 --2- 172.21.15.26:0/2727134392 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe934130540 0x7fe934130910 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe93000dd90 tx=0x7fe93000f330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec83eab05f3ded43 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:22.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.036+0000 7fe938e29700 1 -- 172.21.15.26:0/2727134392 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe930012070 con 0x7fe934130540 2023-10-01T07:56:22.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.036+0000 7fe938e29700 1 -- 172.21.15.26:0/2727134392 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93000fb20 con 0x7fe934130540 2023-10-01T07:56:22.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.036+0000 7fe938e29700 1 -- 172.21.15.26:0/2727134392 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe930016430 con 0x7fe934130540 2023-10-01T07:56:22.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.037+0000 7fe93c08f700 1 -- 172.21.15.26:0/2727134392 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe934130540 msgr2=0x7fe934130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:22.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.037+0000 7fe93c08f700 1 --2- 172.21.15.26:0/2727134392 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe934130540 0x7fe934130910 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe93000dd90 tx=0x7fe93000f330 comp rx=0 tx=0).stop 2023-10-01T07:56:22.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.037+0000 7fe93c08f700 1 -- 172.21.15.26:0/2727134392 shutdown_connections 2023-10-01T07:56:22.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.037+0000 7fe93c08f700 1 --2- 172.21.15.26:0/2727134392 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe93406fb20 0x7fe93406ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:22.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.037+0000 7fe93c08f700 1 --2- 172.21.15.26:0/2727134392 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe934130540 0x7fe934130910 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:22.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.037+0000 7fe93c08f700 1 --2- 172.21.15.26:0/2727134392 >> v2:172.21.15.26:3300/0 conn(0x7fe934130e50 0x7fe93406f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:22.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.037+0000 7fe93c08f700 1 -- 172.21.15.26:0/2727134392 >> 172.21.15.26:0/2727134392 conn(0x7fe9340a2aa0 msgr2=0x7fe9340a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:22.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.037+0000 7fe93c08f700 1 -- 172.21.15.26:0/2727134392 shutdown_connections 2023-10-01T07:56:22.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.037+0000 7fe93c08f700 1 -- 172.21.15.26:0/2727134392 wait complete. 2023-10-01T07:56:22.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.039+0000 7fe93c08f700 1 Processor -- start 2023-10-01T07:56:22.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.039+0000 7fe93c08f700 1 -- start start 2023-10-01T07:56:22.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.039+0000 7fe93c08f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe93406fb20 0x7fe9341c0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:22.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.039+0000 7fe93c08f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe934130540 0x7fe9341c0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:22.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.039+0000 7fe93c08f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe934130e50 0x7fe934118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:22.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.039+0000 7fe93c08f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93411b8e0 con 0x7fe934130e50 2023-10-01T07:56:22.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.039+0000 7fe93c08f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe93411bba0 con 0x7fe93406fb20 2023-10-01T07:56:22.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.040+0000 7fe93c08f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9341c0560 con 0x7fe934130540 2023-10-01T07:56:22.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.040+0000 7fe939e2b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe93406fb20 0x7fe9341c0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:22.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.040+0000 7fe939e2b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe93406fb20 0x7fe9341c0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37054/0 (socket says 172.21.15.26:37054) 2023-10-01T07:56:22.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.040+0000 7fe939e2b700 1 -- 172.21.15.26:0/3757845969 learned_addr learned my addr 172.21.15.26:0/3757845969 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:22.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.040+0000 7fe93a62c700 1 --2- 172.21.15.26:0/3757845969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe934130e50 0x7fe934118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:22.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.040+0000 7fe93962a700 1 --2- 172.21.15.26:0/3757845969 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe934130540 0x7fe9341c0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:22.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.040+0000 7fe939e2b700 1 -- 172.21.15.26:0/3757845969 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe934130540 msgr2=0x7fe9341c0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:22.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.040+0000 7fe939e2b700 1 --2- 172.21.15.26:0/3757845969 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe934130540 0x7fe9341c0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:22.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.040+0000 7fe939e2b700 1 -- 172.21.15.26:0/3757845969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe934130e50 msgr2=0x7fe934118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:22.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.040+0000 7fe939e2b700 1 --2- 172.21.15.26:0/3757845969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe934130e50 0x7fe934118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:22.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.040+0000 7fe939e2b700 1 -- 172.21.15.26:0/3757845969 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92c009a70 con 0x7fe93406fb20 2023-10-01T07:56:22.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.040+0000 7fe939e2b700 1 --2- 172.21.15.26:0/3757845969 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe93406fb20 0x7fe9341c0870 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe930018040 tx=0x7fe930004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:22.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.041+0000 7fe92a7fc700 1 -- 172.21.15.26:0/3757845969 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9300038a0 con 0x7fe93406fb20 2023-10-01T07:56:22.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.041+0000 7fe92a7fc700 1 -- 172.21.15.26:0/3757845969 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe930024070 con 0x7fe93406fb20 2023-10-01T07:56:22.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.041+0000 7fe92a7fc700 1 -- 172.21.15.26:0/3757845969 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe930003c40 con 0x7fe93406fb20 2023-10-01T07:56:22.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.041+0000 7fe93c08f700 1 -- 172.21.15.26:0/3757845969 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe92400b600 con 0x7fe93406fb20 2023-10-01T07:56:22.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.041+0000 7fe93c08f700 1 -- 172.21.15.26:0/3757845969 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe93000da70 con 0x7fe93406fb20 2023-10-01T07:56:22.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.042+0000 7fe93c08f700 1 -- 172.21.15.26:0/3757845969 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe934074ea0 con 0x7fe93406fb20 2023-10-01T07:56:22.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.043+0000 7fe92a7fc700 1 -- 172.21.15.26:0/3757845969 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe930016630 con 0x7fe93406fb20 2023-10-01T07:56:22.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.047+0000 7fe92a7fc700 1 -- 172.21.15.26:0/3757845969 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe930026070 con 0x7fe93406fb20 2023-10-01T07:56:22.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.047+0000 7fe92a7fc700 1 -- 172.21.15.26:0/3757845969 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe93004a060 con 0x7fe93406fb20 2023-10-01T07:56:22.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.074+0000 7fd6def7b700 1 -- 172.21.15.26:0/2210396429 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd6d806c360 con 0x7fd6d809d6f0 2023-10-01T07:56:22.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.075+0000 7fd6d57fa700 1 -- 172.21.15.26:0/2210396429 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd6cc015020 con 0x7fd6d809d6f0 2023-10-01T07:56:22.076 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:22.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.077+0000 7fd6def7b700 1 -- 172.21.15.26:0/2210396429 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6d809d6f0 msgr2=0x7fd6d81222c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:22.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.077+0000 7fd6def7b700 1 --2- 172.21.15.26:0/2210396429 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6d809d6f0 0x7fd6d81222c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0090b0 tx=0x7fd6cc004750 comp rx=0 tx=0).stop 2023-10-01T07:56:22.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.077+0000 7fd6def7b700 1 -- 172.21.15.26:0/2210396429 shutdown_connections 2023-10-01T07:56:22.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.077+0000 7fd6def7b700 1 --2- 172.21.15.26:0/2210396429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6d809e410 0x7fd6d8122d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:22.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.077+0000 7fd6def7b700 1 --2- 172.21.15.26:0/2210396429 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6d809d6f0 0x7fd6d81222c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:22.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.077+0000 7fd6def7b700 1 --2- 172.21.15.26:0/2210396429 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6d809e000 0x7fd6d8122800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:22.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.077+0000 7fd6def7b700 1 -- 172.21.15.26:0/2210396429 >> 172.21.15.26:0/2210396429 conn(0x7fd6d8066f50 msgr2=0x7fd6d8130b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:22.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.078+0000 7fd6def7b700 1 -- 172.21.15.26:0/2210396429 shutdown_connections 2023-10-01T07:56:22.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.078+0000 7fd6def7b700 1 -- 172.21.15.26:0/2210396429 wait complete. 2023-10-01T07:56:22.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.079+0000 7f9dda0f8700 1 Processor -- start 2023-10-01T07:56:22.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.079+0000 7f9dda0f8700 1 -- start start 2023-10-01T07:56:22.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.079+0000 7f9dda0f8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9dd41338a0 0x7f9dd4133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:22.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.080+0000 7f9dda0f8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9dd409e930 0x7f9dd413b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:22.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.080+0000 7f9dda0f8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dd406ef30 con 0x7f9dd409de50 2023-10-01T07:56:22.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.080+0000 7f9dda0f8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd406fef0 con 0x7f9dd41338a0 2023-10-01T07:56:22.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.080+0000 7f9dda0f8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd41334b0 con 0x7f9dd409e930 2023-10-01T07:56:22.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.080+0000 7f9dd3fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9dd409e930 0x7f9dd413b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:22.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.080+0000 7f9dd37fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9dd41338a0 0x7f9dd4133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:22.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.080+0000 7f9dd3fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9dd409e930 0x7f9dd413b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37064/0 (socket says 172.21.15.26:37064) 2023-10-01T07:56:22.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.080+0000 7f9dd3fff700 1 -- 172.21.15.26:0/3166009394 learned_addr learned my addr 172.21.15.26:0/3166009394 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:22.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.080+0000 7f9dd37fe700 1 -- 172.21.15.26:0/3166009394 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9dd409e930 msgr2=0x7f9dd413b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:22.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.080+0000 7f9dd37fe700 1 --2- 172.21.15.26:0/3166009394 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9dd409e930 0x7f9dd413b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:22.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.080+0000 7f9dd37fe700 1 -- 172.21.15.26:0/3166009394 >> v1:172.21.15.26:6789/0 conn(0x7f9dd409de50 legacy=0x7f9dd409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:22.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.080+0000 7f9dd37fe700 1 -- 172.21.15.26:0/3166009394 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd406fc30 con 0x7f9dd41338a0 2023-10-01T07:56:22.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.080+0000 7f9dd3fff700 1 --2- 172.21.15.26:0/3166009394 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9dd409e930 0x7f9dd413b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:22.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.081+0000 7f9dd37fe700 1 --2- 172.21.15.26:0/3166009394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dd41338a0 0x7f9dd4133c70 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009840 tx=0x7f9dc4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abd0b000f46620b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:22.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.081+0000 7f9dd27fc700 1 -- 172.21.15.26:0/3166009394 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4011830 con 0x7f9dd41338a0 2023-10-01T07:56:22.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.081+0000 7f9dd27fc700 1 -- 172.21.15.26:0/3166009394 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc4011990 con 0x7f9dd41338a0 2023-10-01T07:56:22.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.081+0000 7f9dd27fc700 1 -- 172.21.15.26:0/3166009394 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4011d20 con 0x7f9dd41338a0 2023-10-01T07:56:22.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.082+0000 7f9dda0f8700 1 -- 172.21.15.26:0/3166009394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dd41338a0 msgr2=0x7f9dd4133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:22.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.082+0000 7f9dda0f8700 1 --2- 172.21.15.26:0/3166009394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dd41338a0 0x7f9dd4133c70 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009840 tx=0x7f9dc4009b50 comp rx=0 tx=0).stop 2023-10-01T07:56:22.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.082+0000 7f9dda0f8700 1 -- 172.21.15.26:0/3166009394 shutdown_connections 2023-10-01T07:56:22.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.082+0000 7f9dda0f8700 1 --2- 172.21.15.26:0/3166009394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dd41338a0 0x7f9dd4133c70 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:22.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.082+0000 7f9dda0f8700 1 --2- 172.21.15.26:0/3166009394 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9dd409e930 0x7f9dd413b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:22.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.082+0000 7f9dda0f8700 1 -- 172.21.15.26:0/3166009394 >> 172.21.15.26:0/3166009394 conn(0x7f9dd40a2aa0 msgr2=0x7f9dd40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:22.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.082+0000 7f9dda0f8700 1 -- 172.21.15.26:0/3166009394 shutdown_connections 2023-10-01T07:56:22.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.082+0000 7f9dda0f8700 1 -- 172.21.15.26:0/3166009394 wait complete. 2023-10-01T07:56:22.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.083+0000 7f9dda0f8700 1 Processor -- start 2023-10-01T07:56:22.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.083+0000 7f9dda0f8700 1 -- start start 2023-10-01T07:56:22.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.084+0000 7f9dda0f8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9dd409de50 0x7f9dd411efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:22.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.084+0000 7f9dda0f8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dd409e930 0x7f9dd411f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:22.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.084+0000 7f9dda0f8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9dd41338a0 0x7f9dd411fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:22.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.084+0000 7f9dda0f8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd41210a0 con 0x7f9dd409e930 2023-10-01T07:56:22.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.084+0000 7f9dda0f8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd41226e0 con 0x7f9dd41338a0 2023-10-01T07:56:22.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.084+0000 7f9dda0f8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd41207d0 con 0x7f9dd409de50 2023-10-01T07:56:22.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.084+0000 7f9dd3fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9dd41338a0 0x7f9dd411fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:22.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.084+0000 7f9dd3fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9dd41338a0 0x7f9dd411fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37074/0 (socket says 172.21.15.26:37074) 2023-10-01T07:56:22.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.084+0000 7f9dd3fff700 1 -- 172.21.15.26:0/4062592530 learned_addr learned my addr 172.21.15.26:0/4062592530 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:22.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.084+0000 7f9dd37fe700 1 --2- 172.21.15.26:0/4062592530 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9dd409de50 0x7f9dd411efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:22.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.084+0000 7f9dd2ffd700 1 --2- 172.21.15.26:0/4062592530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dd409e930 0x7f9dd411f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:22.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.084+0000 7f9dd3fff700 1 -- 172.21.15.26:0/4062592530 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9dd409de50 msgr2=0x7f9dd411efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:22.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.084+0000 7f9dd3fff700 1 --2- 172.21.15.26:0/4062592530 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9dd409de50 0x7f9dd411efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:22.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.084+0000 7f9dd3fff700 1 -- 172.21.15.26:0/4062592530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dd409e930 msgr2=0x7f9dd411f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:22.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.084+0000 7f9dd3fff700 1 --2- 172.21.15.26:0/4062592530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dd409e930 0x7f9dd411f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:22.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.084+0000 7f9dd3fff700 1 -- 172.21.15.26:0/4062592530 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dcc009b30 con 0x7f9dd41338a0 2023-10-01T07:56:22.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.084+0000 7f9dd2ffd700 1 --2- 172.21.15.26:0/4062592530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dd409e930 0x7f9dd411f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:56:22.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.085+0000 7f9dd3fff700 1 --2- 172.21.15.26:0/4062592530 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9dd41338a0 0x7f9dd411fa20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc00efc0 tx=0x7f9dcc00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:22.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.085+0000 7f9dbbfff700 1 -- 172.21.15.26:0/4062592530 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc018070 con 0x7f9dd41338a0 2023-10-01T07:56:22.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.085+0000 7f9dbbfff700 1 -- 172.21.15.26:0/4062592530 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dcc00f040 con 0x7f9dd41338a0 2023-10-01T07:56:22.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.085+0000 7f9dbbfff700 1 -- 172.21.15.26:0/4062592530 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc003c20 con 0x7f9dd41338a0 2023-10-01T07:56:22.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.086+0000 7f9dda0f8700 1 -- 172.21.15.26:0/4062592530 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dc40094a0 con 0x7f9dd41338a0 2023-10-01T07:56:22.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.086+0000 7f9dda0f8700 1 -- 172.21.15.26:0/4062592530 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd412fb10 con 0x7f9dd41338a0 2023-10-01T07:56:22.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.087+0000 7f9dda0f8700 1 -- 172.21.15.26:0/4062592530 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dd41220a0 con 0x7f9dd41338a0 2023-10-01T07:56:22.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.087+0000 7f9dbbfff700 1 -- 172.21.15.26:0/4062592530 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9dcc00c930 con 0x7f9dd41338a0 2023-10-01T07:56:22.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.087+0000 7f9dbbfff700 1 -- 172.21.15.26:0/4062592530 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9dcc03f8c0 con 0x7f9dd41338a0 2023-10-01T07:56:22.096 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:22.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.096+0000 7f9dbbfff700 1 -- 172.21.15.26:0/4062592530 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9dd41220a0 con 0x7f9dd41338a0 2023-10-01T07:56:22.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.223+0000 7f3988440700 1 -- 172.21.15.26:0/3770692790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f39801a8cf0 con 0x7f398009e440 2023-10-01T07:56:22.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.223+0000 7f3976ffd700 1 -- 172.21.15.26:0/3770692790 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f397802b090 con 0x7f398009e440 2023-10-01T07:56:22.224 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:22.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.226+0000 7f3988440700 1 -- 172.21.15.26:0/3770692790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f398009e440 msgr2=0x7f39801a68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:22.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.226+0000 7f3988440700 1 --2- 172.21.15.26:0/3770692790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f398009e440 0x7f39801a68e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f397800efc0 tx=0x7f397800c3a0 comp rx=0 tx=0).stop 2023-10-01T07:56:22.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.226+0000 7f3988440700 1 -- 172.21.15.26:0/3770692790 shutdown_connections 2023-10-01T07:56:22.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.226+0000 7f3988440700 1 --2- 172.21.15.26:0/3770692790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f398009e440 0x7f39801a68e0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:22.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.226+0000 7f3988440700 1 --2- 172.21.15.26:0/3770692790 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f398009d6f0 0x7f39801a5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:22.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.226+0000 7f3988440700 1 --2- 172.21.15.26:0/3770692790 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f398009e000 0x7f39801a63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:22.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.226+0000 7f3988440700 1 -- 172.21.15.26:0/3770692790 >> 172.21.15.26:0/3770692790 conn(0x7f3980066f50 msgr2=0x7f39801bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:22.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.226+0000 7f3988440700 1 -- 172.21.15.26:0/3770692790 shutdown_connections 2023-10-01T07:56:22.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.226+0000 7f3988440700 1 -- 172.21.15.26:0/3770692790 wait complete. 2023-10-01T07:56:22.240 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:22.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.261+0000 7fe93c08f700 1 -- 172.21.15.26:0/3757845969 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe93406b9e0 con 0x7fe93406fb20 2023-10-01T07:56:22.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.261+0000 7fe92a7fc700 1 -- 172.21.15.26:0/3757845969 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe93004a090 con 0x7fe93406fb20 2023-10-01T07:56:22.262 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:22.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.264+0000 7fe93c08f700 1 -- 172.21.15.26:0/3757845969 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe93406fb20 msgr2=0x7fe9341c0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:22.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.264+0000 7fe93c08f700 1 --2- 172.21.15.26:0/3757845969 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe93406fb20 0x7fe9341c0870 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe930018040 tx=0x7fe930004750 comp rx=0 tx=0).stop 2023-10-01T07:56:22.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.264+0000 7fe93c08f700 1 -- 172.21.15.26:0/3757845969 shutdown_connections 2023-10-01T07:56:22.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.264+0000 7fe93c08f700 1 --2- 172.21.15.26:0/3757845969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe934130e50 0x7fe934118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:22.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.264+0000 7fe93c08f700 1 --2- 172.21.15.26:0/3757845969 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe93406fb20 0x7fe9341c0870 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:22.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.264+0000 7fe93c08f700 1 --2- 172.21.15.26:0/3757845969 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe934130540 0x7fe9341c0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:22.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.264+0000 7fe93c08f700 1 -- 172.21.15.26:0/3757845969 >> 172.21.15.26:0/3757845969 conn(0x7fe9340a2aa0 msgr2=0x7fe93412d340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:22.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.264+0000 7fe93c08f700 1 -- 172.21.15.26:0/3757845969 shutdown_connections 2023-10-01T07:56:22.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.264+0000 7fe93c08f700 1 -- 172.21.15.26:0/3757845969 wait complete. 2023-10-01T07:56:22.278 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:22.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.304+0000 7f9dda0f8700 1 -- 172.21.15.26:0/4062592530 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9dd41220a0 con 0x7f9dd41338a0 2023-10-01T07:56:22.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.305+0000 7f9dbbfff700 1 -- 172.21.15.26:0/4062592530 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9dd41220a0 con 0x7f9dd41338a0 2023-10-01T07:56:22.305 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:22.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.307+0000 7f9dda0f8700 1 -- 172.21.15.26:0/4062592530 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9dd41338a0 msgr2=0x7f9dd411fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:22.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.307+0000 7f9dda0f8700 1 --2- 172.21.15.26:0/4062592530 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9dd41338a0 0x7f9dd411fa20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc00efc0 tx=0x7f9dcc00c3a0 comp rx=0 tx=0).stop 2023-10-01T07:56:22.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.307+0000 7f9dda0f8700 1 -- 172.21.15.26:0/4062592530 shutdown_connections 2023-10-01T07:56:22.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.307+0000 7f9dda0f8700 1 --2- 172.21.15.26:0/4062592530 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9dd41338a0 0x7f9dd411fa20 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:22.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.307+0000 7f9dda0f8700 1 --2- 172.21.15.26:0/4062592530 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9dd409de50 0x7f9dd411efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:22.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.307+0000 7f9dda0f8700 1 --2- 172.21.15.26:0/4062592530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dd409e930 0x7f9dd411f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:22.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.307+0000 7f9dda0f8700 1 -- 172.21.15.26:0/4062592530 >> 172.21.15.26:0/4062592530 conn(0x7f9dd40a2aa0 msgr2=0x7f9dd409ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:22.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.307+0000 7f9dda0f8700 1 -- 172.21.15.26:0/4062592530 shutdown_connections 2023-10-01T07:56:22.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:22.307+0000 7f9dda0f8700 1 -- 172.21.15.26:0/4062592530 wait complete. 2023-10-01T07:56:22.321 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:23.096 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:23.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.239+0000 7f8e33a1d700 1 Processor -- start 2023-10-01T07:56:23.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.239+0000 7f8e33a1d700 1 -- start start 2023-10-01T07:56:23.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.240+0000 7f8e33a1d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e2c09d6f0 0x7f8e2c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:23.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.240+0000 7f8e33a1d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8e2c09e000 0x7f8e2c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:23.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.240+0000 7f8e33a1d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e2c09f130 con 0x7f8e2c09e410 2023-10-01T07:56:23.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.240+0000 7f8e33a1d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e2c09f520 con 0x7f8e2c09e000 2023-10-01T07:56:23.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.240+0000 7f8e33a1d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c09e930 con 0x7f8e2c09d6f0 2023-10-01T07:56:23.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.240+0000 7f8e317b9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e2c09d6f0 0x7f8e2c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:23.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.240+0000 7f8e30fb8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8e2c09e000 0x7f8e2c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:23.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.240+0000 7f8e317b9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e2c09d6f0 0x7f8e2c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37082/0 (socket says 172.21.15.26:37082) 2023-10-01T07:56:23.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.240+0000 7f8e317b9700 1 -- 172.21.15.26:0/2273401899 learned_addr learned my addr 172.21.15.26:0/2273401899 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:23.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.240+0000 7f8e317b9700 1 -- 172.21.15.26:0/2273401899 >> v2:172.21.15.26:3300/0 conn(0x7f8e2c09e000 msgr2=0x7f8e2c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:23.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.240+0000 7f8e317b9700 1 --2- 172.21.15.26:0/2273401899 >> v2:172.21.15.26:3300/0 conn(0x7f8e2c09e000 0x7f8e2c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:23.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.240+0000 7f8e317b9700 1 -- 172.21.15.26:0/2273401899 >> v1:172.21.15.26:6789/0 conn(0x7f8e2c09e410 legacy=0x7f8e2c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:23.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.240+0000 7f8e317b9700 1 -- 172.21.15.26:0/2273401899 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2c09b2d0 con 0x7f8e2c09d6f0 2023-10-01T07:56:23.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.240+0000 7f8e30fb8700 1 --2- 172.21.15.26:0/2273401899 >> v2:172.21.15.26:3300/0 conn(0x7f8e2c09e000 0x7f8e2c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:23.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.240+0000 7f8e317b9700 1 --2- 172.21.15.26:0/2273401899 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e2c09d6f0 0x7f8e2c09dac0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8e2800bb90 tx=0x7f8e2800bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc7ba517c13bcf77 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:23.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.241+0000 7f8e23fff700 1 -- 172.21.15.26:0/2273401899 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2800dd30 con 0x7f8e2c09d6f0 2023-10-01T07:56:23.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.241+0000 7f8e23fff700 1 -- 172.21.15.26:0/2273401899 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2800de90 con 0x7f8e2c09d6f0 2023-10-01T07:56:23.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.241+0000 7f8e23fff700 1 -- 172.21.15.26:0/2273401899 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e28010690 con 0x7f8e2c09d6f0 2023-10-01T07:56:23.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.241+0000 7f8e33a1d700 1 -- 172.21.15.26:0/2273401899 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e2c09d6f0 msgr2=0x7f8e2c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:23.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.241+0000 7f8e33a1d700 1 --2- 172.21.15.26:0/2273401899 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e2c09d6f0 0x7f8e2c09dac0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8e2800bb90 tx=0x7f8e2800bea0 comp rx=0 tx=0).stop 2023-10-01T07:56:23.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.241+0000 7f8e33a1d700 1 -- 172.21.15.26:0/2273401899 shutdown_connections 2023-10-01T07:56:23.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.241+0000 7f8e33a1d700 1 --2- 172.21.15.26:0/2273401899 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e2c09d6f0 0x7f8e2c09dac0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:23.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.241+0000 7f8e33a1d700 1 --2- 172.21.15.26:0/2273401899 >> v2:172.21.15.26:3300/0 conn(0x7f8e2c09e000 0x7f8e2c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:23.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.241+0000 7f8e33a1d700 1 -- 172.21.15.26:0/2273401899 >> 172.21.15.26:0/2273401899 conn(0x7f8e2c066f50 msgr2=0x7f8e2c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:23.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.241+0000 7f8e33a1d700 1 -- 172.21.15.26:0/2273401899 shutdown_connections 2023-10-01T07:56:23.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.241+0000 7f8e33a1d700 1 -- 172.21.15.26:0/2273401899 wait complete. 2023-10-01T07:56:23.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.242+0000 7f8e33a1d700 1 Processor -- start 2023-10-01T07:56:23.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.242+0000 7f8e33a1d700 1 -- start start 2023-10-01T07:56:23.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.243+0000 7f8e33a1d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e2c09d6f0 0x7f8e2c11e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:23.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.243+0000 7f8e33a1d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e2c09e000 0x7f8e2c11e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:23.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.243+0000 7f8e33a1d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e2c09e410 0x7f8e2c11eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:23.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.243+0000 7f8e33a1d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c11f4d0 con 0x7f8e2c09e410 2023-10-01T07:56:23.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.243+0000 7f8e33a1d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c121af0 con 0x7f8e2c09d6f0 2023-10-01T07:56:23.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.243+0000 7f8e33a1d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c120200 con 0x7f8e2c09e000 2023-10-01T07:56:23.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.243+0000 7f8e317b9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e2c09d6f0 0x7f8e2c11e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:23.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.243+0000 7f8e317b9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e2c09d6f0 0x7f8e2c11e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37090/0 (socket says 172.21.15.26:37090) 2023-10-01T07:56:23.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.243+0000 7f8e317b9700 1 -- 172.21.15.26:0/82926285 learned_addr learned my addr 172.21.15.26:0/82926285 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:23.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.243+0000 7f8e31fba700 1 --2- 172.21.15.26:0/82926285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e2c09e410 0x7f8e2c11eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:23.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.243+0000 7f8e30fb8700 1 --2- 172.21.15.26:0/82926285 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e2c09e000 0x7f8e2c11e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:23.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.243+0000 7f8e317b9700 1 -- 172.21.15.26:0/82926285 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e2c09e000 msgr2=0x7f8e2c11e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:23.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.243+0000 7f8e317b9700 1 --2- 172.21.15.26:0/82926285 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e2c09e000 0x7f8e2c11e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:23.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.243+0000 7f8e317b9700 1 -- 172.21.15.26:0/82926285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e2c09e410 msgr2=0x7f8e2c11eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:23.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.243+0000 7f8e317b9700 1 --2- 172.21.15.26:0/82926285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e2c09e410 0x7f8e2c11eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:23.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.243+0000 7f8e317b9700 1 -- 172.21.15.26:0/82926285 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1c0094a0 con 0x7f8e2c09d6f0 2023-10-01T07:56:23.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.243+0000 7f8e31fba700 1 --2- 172.21.15.26:0/82926285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e2c09e410 0x7f8e2c11eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:23.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.244+0000 7f8e317b9700 1 --2- 172.21.15.26:0/82926285 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e2c09d6f0 0x7f8e2c11e020 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8e28000c00 tx=0x7f8e28004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:23.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.244+0000 7f8e21ffb700 1 -- 172.21.15.26:0/82926285 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2801f070 con 0x7f8e2c09d6f0 2023-10-01T07:56:23.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.244+0000 7f8e21ffb700 1 -- 172.21.15.26:0/82926285 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e28003970 con 0x7f8e2c09d6f0 2023-10-01T07:56:23.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.244+0000 7f8e33a1d700 1 -- 172.21.15.26:0/82926285 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e2800b7f0 con 0x7f8e2c09d6f0 2023-10-01T07:56:23.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.244+0000 7f8e21ffb700 1 -- 172.21.15.26:0/82926285 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e28003d40 con 0x7f8e2c09d6f0 2023-10-01T07:56:23.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.244+0000 7f8e33a1d700 1 -- 172.21.15.26:0/82926285 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e2c0a1d90 con 0x7f8e2c09d6f0 2023-10-01T07:56:23.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.245+0000 7f8e21ffb700 1 -- 172.21.15.26:0/82926285 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e28019400 con 0x7f8e2c09d6f0 2023-10-01T07:56:23.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.245+0000 7f8e33a1d700 1 -- 172.21.15.26:0/82926285 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e2c09c700 con 0x7f8e2c09d6f0 2023-10-01T07:56:23.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.245+0000 7f8e21ffb700 1 -- 172.21.15.26:0/82926285 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8e28042990 con 0x7f8e2c09d6f0 2023-10-01T07:56:23.255 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:23.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.250+0000 7f8e21ffb700 1 -- 172.21.15.26:0/82926285 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e2800f3d0 con 0x7f8e2c09d6f0 2023-10-01T07:56:23.278 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:23.322 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:23.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.409+0000 7f5c61919700 1 Processor -- start 2023-10-01T07:56:23.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.409+0000 7f5c61919700 1 -- start start 2023-10-01T07:56:23.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.410+0000 7f5c61919700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5c5c06f5d0 0x7f5c5c12ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:23.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.410+0000 7f5c61919700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c5c135c20 0x7f5c5c138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:23.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.410+0000 7f5c61919700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c5c06fa40 con 0x7f5c5c12cf60 2023-10-01T07:56:23.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.410+0000 7f5c61919700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c5c12cd90 con 0x7f5c5c06f5d0 2023-10-01T07:56:23.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.410+0000 7f5c61919700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5c071780 con 0x7f5c5c135c20 2023-10-01T07:56:23.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.410+0000 7f5c5b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c5c135c20 0x7f5c5c138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:23.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.410+0000 7f5c5b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c5c135c20 0x7f5c5c138000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:32890/0 (socket says 172.21.15.26:32890) 2023-10-01T07:56:23.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.410+0000 7f5c5b7fe700 1 -- 172.21.15.26:0/3438646960 learned_addr learned my addr 172.21.15.26:0/3438646960 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:23.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.410+0000 7f5c5a7fc700 1 --2- 172.21.15.26:0/3438646960 >> v2:172.21.15.26:3300/0 conn(0x7f5c5c06f5d0 0x7f5c5c12ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:23.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.410+0000 7f5c5b7fe700 1 -- 172.21.15.26:0/3438646960 >> v2:172.21.15.26:3300/0 conn(0x7f5c5c06f5d0 msgr2=0x7f5c5c12ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:23.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.410+0000 7f5c5b7fe700 1 --2- 172.21.15.26:0/3438646960 >> v2:172.21.15.26:3300/0 conn(0x7f5c5c06f5d0 0x7f5c5c12ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:23.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.410+0000 7f5c5b7fe700 1 -- 172.21.15.26:0/3438646960 >> v1:172.21.15.26:6789/0 conn(0x7f5c5c12cf60 legacy=0x7f5c5c12f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:23.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.410+0000 7f5c5b7fe700 1 -- 172.21.15.26:0/3438646960 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c5c071a40 con 0x7f5c5c135c20 2023-10-01T07:56:23.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.411+0000 7f5c5b7fe700 1 --2- 172.21.15.26:0/3438646960 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c5c135c20 0x7f5c5c138000 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5c54009e50 tx=0x7f5c5400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a44b01cadf9bd9bf server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:23.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.411+0000 7f5c59ffb700 1 -- 172.21.15.26:0/3438646960 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5400e070 con 0x7f5c5c135c20 2023-10-01T07:56:23.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.411+0000 7f5c59ffb700 1 -- 172.21.15.26:0/3438646960 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c5400b910 con 0x7f5c5c135c20 2023-10-01T07:56:23.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.411+0000 7f5c59ffb700 1 -- 172.21.15.26:0/3438646960 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5400bcc0 con 0x7f5c5c135c20 2023-10-01T07:56:23.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.412+0000 7f5c61919700 1 -- 172.21.15.26:0/3438646960 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c5c135c20 msgr2=0x7f5c5c138000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:23.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.412+0000 7f5c61919700 1 --2- 172.21.15.26:0/3438646960 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c5c135c20 0x7f5c5c138000 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5c54009e50 tx=0x7f5c5400b330 comp rx=0 tx=0).stop 2023-10-01T07:56:23.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.412+0000 7f5c61919700 1 -- 172.21.15.26:0/3438646960 shutdown_connections 2023-10-01T07:56:23.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.412+0000 7f5c61919700 1 --2- 172.21.15.26:0/3438646960 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c5c135c20 0x7f5c5c138000 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:23.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.412+0000 7f5c61919700 1 --2- 172.21.15.26:0/3438646960 >> v2:172.21.15.26:3300/0 conn(0x7f5c5c06f5d0 0x7f5c5c12ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:23.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.412+0000 7f5c61919700 1 -- 172.21.15.26:0/3438646960 >> 172.21.15.26:0/3438646960 conn(0x7f5c5c0a2aa0 msgr2=0x7f5c5c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:23.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.412+0000 7f5c61919700 1 -- 172.21.15.26:0/3438646960 shutdown_connections 2023-10-01T07:56:23.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.412+0000 7f5c61919700 1 -- 172.21.15.26:0/3438646960 wait complete. 2023-10-01T07:56:23.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.413+0000 7f5c61919700 1 Processor -- start 2023-10-01T07:56:23.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.413+0000 7f5c61919700 1 -- start start 2023-10-01T07:56:23.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.414+0000 7f5c61919700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c5c06f5d0 0x7f5c5c13a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:23.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.414+0000 7f5c61919700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c5c12cf60 0x7f5c5c13aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:23.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.414+0000 7f5c61919700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c5c135c20 0x7f5c5c13b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:23.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.414+0000 7f5c61919700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5c0a0f50 con 0x7f5c5c06f5d0 2023-10-01T07:56:23.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.414+0000 7f5c61919700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5c09a440 con 0x7f5c5c135c20 2023-10-01T07:56:23.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.414+0000 7f5c61919700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5c099f80 con 0x7f5c5c12cf60 2023-10-01T07:56:23.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.414+0000 7f5c5b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c5c135c20 0x7f5c5c13b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:23.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.414+0000 7f5c5b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c5c135c20 0x7f5c5c13b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33350/0 (socket says 172.21.15.26:33350) 2023-10-01T07:56:23.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.414+0000 7f5c5b7fe700 1 -- 172.21.15.26:0/3943927336 learned_addr learned my addr 172.21.15.26:0/3943927336 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:23.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.414+0000 7f5c5affd700 1 --2- 172.21.15.26:0/3943927336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c5c06f5d0 0x7f5c5c13a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:23.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.414+0000 7f5c5a7fc700 1 --2- 172.21.15.26:0/3943927336 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c5c12cf60 0x7f5c5c13aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:23.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.414+0000 7f5c5b7fe700 1 -- 172.21.15.26:0/3943927336 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c5c12cf60 msgr2=0x7f5c5c13aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:23.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.414+0000 7f5c5b7fe700 1 --2- 172.21.15.26:0/3943927336 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c5c12cf60 0x7f5c5c13aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:23.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.414+0000 7f5c5b7fe700 1 -- 172.21.15.26:0/3943927336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c5c06f5d0 msgr2=0x7f5c5c13a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:23.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.414+0000 7f5c5b7fe700 1 --2- 172.21.15.26:0/3943927336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c5c06f5d0 0x7f5c5c13a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:23.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.414+0000 7f5c5b7fe700 1 -- 172.21.15.26:0/3943927336 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c54009b30 con 0x7f5c5c135c20 2023-10-01T07:56:23.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.415+0000 7f5c5b7fe700 1 --2- 172.21.15.26:0/3943927336 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c5c135c20 0x7f5c5c13b0e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5c5400b680 tx=0x7f5c54004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:23.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.415+0000 7f5c43fff700 1 -- 172.21.15.26:0/3943927336 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c540048b0 con 0x7f5c5c135c20 2023-10-01T07:56:23.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.415+0000 7f5c43fff700 1 -- 172.21.15.26:0/3943927336 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c540092e0 con 0x7f5c5c135c20 2023-10-01T07:56:23.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.415+0000 7f5c43fff700 1 -- 172.21.15.26:0/3943927336 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5401c660 con 0x7f5c5c135c20 2023-10-01T07:56:23.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.415+0000 7f5c61919700 1 -- 172.21.15.26:0/3943927336 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c5c13c4d0 con 0x7f5c5c135c20 2023-10-01T07:56:23.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.415+0000 7f5c61919700 1 -- 172.21.15.26:0/3943927336 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c5c134f60 con 0x7f5c5c135c20 2023-10-01T07:56:23.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.416+0000 7f5c43fff700 1 -- 172.21.15.26:0/3943927336 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5c5401c7c0 con 0x7f5c5c135c20 2023-10-01T07:56:23.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.416+0000 7f5c43fff700 1 -- 172.21.15.26:0/3943927336 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5c54041170 con 0x7f5c5c135c20 2023-10-01T07:56:23.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.416+0000 7f5c61919700 1 -- 172.21.15.26:0/3943927336 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c5c074ea0 con 0x7f5c5c135c20 2023-10-01T07:56:23.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.421+0000 7f5c43fff700 1 -- 172.21.15.26:0/3943927336 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5c540257d0 con 0x7f5c5c135c20 2023-10-01T07:56:23.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.450+0000 7f460283a700 1 Processor -- start 2023-10-01T07:56:23.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.450+0000 7f460283a700 1 -- start start 2023-10-01T07:56:23.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.451+0000 7f460283a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45fc09d6f0 0x7f45fc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:23.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.451+0000 7f460283a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45fc09e000 0x7f45fc1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:23.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.451+0000 7f460283a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45fc09b120 con 0x7f45fc09e410 2023-10-01T07:56:23.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.451+0000 7f460283a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc06b460 con 0x7f45fc09e000 2023-10-01T07:56:23.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.451+0000 7f460283a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc09a7e0 con 0x7f45fc09d6f0 2023-10-01T07:56:23.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.451+0000 7f4600dd7700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f45fc09e410 0x7f45fc133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59136/0 (socket says 172.21.15.26:59136) 2023-10-01T07:56:23.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.451+0000 7f4600dd7700 1 -- 172.21.15.26:0/3565882540 learned_addr learned my addr 172.21.15.26:0/3565882540 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:23.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.451+0000 7f45fbfff700 1 --2- 172.21.15.26:0/3565882540 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45fc09d6f0 0x7f45fc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:23.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.451+0000 7f45fb7fe700 1 --2- 172.21.15.26:0/3565882540 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45fc09e000 0x7f45fc1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:23.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.451+0000 7f45faffd700 1 -- 172.21.15.26:0/3565882540 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3698937942 0 0) 0x7f45fc09b120 con 0x7f45fc09e410 2023-10-01T07:56:23.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.451+0000 7f45faffd700 1 -- 172.21.15.26:0/3565882540 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45e40035b0 con 0x7f45fc09e410 2023-10-01T07:56:23.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.451+0000 7f45fb7fe700 1 -- 172.21.15.26:0/3565882540 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45fc09d6f0 msgr2=0x7f45fc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:23.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.451+0000 7f45fb7fe700 1 --2- 172.21.15.26:0/3565882540 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45fc09d6f0 0x7f45fc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:23.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.451+0000 7f45fb7fe700 1 -- 172.21.15.26:0/3565882540 >> v1:172.21.15.26:6789/0 conn(0x7f45fc09e410 legacy=0x7f45fc133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:23.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.451+0000 7f45fb7fe700 1 -- 172.21.15.26:0/3565882540 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45fc09a500 con 0x7f45fc09e000 2023-10-01T07:56:23.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.451+0000 7f45fbfff700 1 --2- 172.21.15.26:0/3565882540 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45fc09d6f0 0x7f45fc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:23.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.452+0000 7f45fb7fe700 1 --2- 172.21.15.26:0/3565882540 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45fc09e000 0x7f45fc1339f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f45f0009870 tx=0x7f45f0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4916b6edc06459e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:23.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.452+0000 7f45faffd700 1 -- 172.21.15.26:0/3565882540 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f0004230 con 0x7f45fc09e000 2023-10-01T07:56:23.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.452+0000 7f45faffd700 1 -- 172.21.15.26:0/3565882540 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f0004390 con 0x7f45fc09e000 2023-10-01T07:56:23.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.452+0000 7f45faffd700 1 -- 172.21.15.26:0/3565882540 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f00036a0 con 0x7f45fc09e000 2023-10-01T07:56:23.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.453+0000 7f460283a700 1 -- 172.21.15.26:0/3565882540 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45fc09e000 msgr2=0x7f45fc1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:23.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.453+0000 7f460283a700 1 --2- 172.21.15.26:0/3565882540 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45fc09e000 0x7f45fc1339f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f45f0009870 tx=0x7f45f0009b80 comp rx=0 tx=0).stop 2023-10-01T07:56:23.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.453+0000 7f460283a700 1 -- 172.21.15.26:0/3565882540 shutdown_connections 2023-10-01T07:56:23.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.453+0000 7f460283a700 1 --2- 172.21.15.26:0/3565882540 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45fc09d6f0 0x7f45fc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:23.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.453+0000 7f460283a700 1 --2- 172.21.15.26:0/3565882540 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45fc09e000 0x7f45fc1339f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:23.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.453+0000 7f460283a700 1 -- 172.21.15.26:0/3565882540 >> 172.21.15.26:0/3565882540 conn(0x7f45fc066f50 msgr2=0x7f45fc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:23.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.453+0000 7f460283a700 1 -- 172.21.15.26:0/3565882540 shutdown_connections 2023-10-01T07:56:23.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.453+0000 7f460283a700 1 -- 172.21.15.26:0/3565882540 wait complete. 2023-10-01T07:56:23.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.455+0000 7f460283a700 1 Processor -- start 2023-10-01T07:56:23.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.455+0000 7f460283a700 1 -- start start 2023-10-01T07:56:23.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.456+0000 7f460283a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45fc09d6f0 0x7f45fc122400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:23.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.456+0000 7f460283a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45fc09e000 0x7f45fc122940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:23.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.456+0000 7f460283a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45fc09e410 0x7f45fc122e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:23.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.456+0000 7f460283a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc133860 con 0x7f45fc09d6f0 2023-10-01T07:56:23.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.456+0000 7f460283a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc124ea0 con 0x7f45fc09e410 2023-10-01T07:56:23.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.456+0000 7f460283a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc125f20 con 0x7f45fc09e000 2023-10-01T07:56:23.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.456+0000 7f45fbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45fc09d6f0 0x7f45fc122400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:23.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.456+0000 7f45fbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45fc09d6f0 0x7f45fc122400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49474/0 (socket says 172.21.15.26:49474) 2023-10-01T07:56:23.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.456+0000 7f45fbfff700 1 -- 172.21.15.26:0/600280725 learned_addr learned my addr 172.21.15.26:0/600280725 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:23.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.456+0000 7f4600dd7700 1 --2- 172.21.15.26:0/600280725 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45fc09e410 0x7f45fc122e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:23.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.456+0000 7f45fb7fe700 1 --2- 172.21.15.26:0/600280725 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45fc09e000 0x7f45fc122940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:23.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.456+0000 7f45fbfff700 1 -- 172.21.15.26:0/600280725 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45fc09e000 msgr2=0x7f45fc122940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:23.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.456+0000 7f45fbfff700 1 --2- 172.21.15.26:0/600280725 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45fc09e000 0x7f45fc122940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:23.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.456+0000 7f45fbfff700 1 -- 172.21.15.26:0/600280725 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45fc09e410 msgr2=0x7f45fc122e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:23.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.456+0000 7f45fbfff700 1 --2- 172.21.15.26:0/600280725 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45fc09e410 0x7f45fc122e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:23.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.456+0000 7f45fbfff700 1 -- 172.21.15.26:0/600280725 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ec0094a0 con 0x7f45fc09d6f0 2023-10-01T07:56:23.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.456+0000 7f45fb7fe700 1 --2- 172.21.15.26:0/600280725 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45fc09e000 0x7f45fc122940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:56:23.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.457+0000 7f45fbfff700 1 --2- 172.21.15.26:0/600280725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45fc09d6f0 0x7f45fc122400 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f45ec00ebe0 tx=0x7f45ec009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:23.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.457+0000 7f45f8ff9700 1 -- 172.21.15.26:0/600280725 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec00c910 con 0x7f45fc09d6f0 2023-10-01T07:56:23.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.457+0000 7f45f8ff9700 1 -- 172.21.15.26:0/600280725 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ec00ca70 con 0x7f45fc09d6f0 2023-10-01T07:56:23.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.457+0000 7f460283a700 1 -- 172.21.15.26:0/600280725 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f00094a0 con 0x7f45fc09d6f0 2023-10-01T07:56:23.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.457+0000 7f45f8ff9700 1 -- 172.21.15.26:0/600280725 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec00cde0 con 0x7f45fc09d6f0 2023-10-01T07:56:23.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.457+0000 7f460283a700 1 -- 172.21.15.26:0/600280725 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45fc125260 con 0x7f45fc09d6f0 2023-10-01T07:56:23.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.459+0000 7f45f8ff9700 1 -- 172.21.15.26:0/600280725 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f45ec013470 con 0x7f45fc09d6f0 2023-10-01T07:56:23.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.459+0000 7f460283a700 1 -- 172.21.15.26:0/600280725 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45fc074ea0 con 0x7f45fc09d6f0 2023-10-01T07:56:23.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.459+0000 7f45f8ff9700 1 -- 172.21.15.26:0/600280725 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f45ec03fa60 con 0x7f45fc09d6f0 2023-10-01T07:56:23.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.468+0000 7f45f8ff9700 1 -- 172.21.15.26:0/600280725 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f45ec0232f0 con 0x7f45fc09d6f0 2023-10-01T07:56:23.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.474+0000 7f8e33a1d700 1 -- 172.21.15.26:0/82926285 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8e2c074ea0 con 0x7f8e2c09d6f0 2023-10-01T07:56:23.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.474+0000 7f8e21ffb700 1 -- 172.21.15.26:0/82926285 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8e2802a310 con 0x7f8e2c09d6f0 2023-10-01T07:56:23.474 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:23.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.476+0000 7f8e33a1d700 1 -- 172.21.15.26:0/82926285 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e2c09d6f0 msgr2=0x7f8e2c11e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:23.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.476+0000 7f8e33a1d700 1 --2- 172.21.15.26:0/82926285 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e2c09d6f0 0x7f8e2c11e020 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8e28000c00 tx=0x7f8e28004750 comp rx=0 tx=0).stop 2023-10-01T07:56:23.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.476+0000 7f8e33a1d700 1 -- 172.21.15.26:0/82926285 shutdown_connections 2023-10-01T07:56:23.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.476+0000 7f8e33a1d700 1 --2- 172.21.15.26:0/82926285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e2c09e410 0x7f8e2c11eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:23.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.476+0000 7f8e33a1d700 1 --2- 172.21.15.26:0/82926285 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e2c09d6f0 0x7f8e2c11e020 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:23.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.476+0000 7f8e33a1d700 1 --2- 172.21.15.26:0/82926285 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e2c09e000 0x7f8e2c11e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:23.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.476+0000 7f8e33a1d700 1 -- 172.21.15.26:0/82926285 >> 172.21.15.26:0/82926285 conn(0x7f8e2c066f50 msgr2=0x7f8e2c0710a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:23.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.477+0000 7f8e33a1d700 1 -- 172.21.15.26:0/82926285 shutdown_connections 2023-10-01T07:56:23.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.477+0000 7f8e33a1d700 1 -- 172.21.15.26:0/82926285 wait complete. 2023-10-01T07:56:23.496 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:23.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.498+0000 7f199f14d700 1 Processor -- start 2023-10-01T07:56:23.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.498+0000 7f199f14d700 1 -- start start 2023-10-01T07:56:23.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.499+0000 7f199f14d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f199809d6f0 0x7f199809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:23.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.499+0000 7f199f14d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f199809e000 0x7f1998130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:23.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.499+0000 7f199f14d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f199809f130 con 0x7f199809e410 2023-10-01T07:56:23.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.499+0000 7f199f14d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199809f520 con 0x7f199809e000 2023-10-01T07:56:23.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.499+0000 7f199f14d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f199809e930 con 0x7f199809d6f0 2023-10-01T07:56:23.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.499+0000 7f199cee9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f199809d6f0 0x7f199809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:23.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.500+0000 7f1997fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f199809e000 0x7f1998130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:23.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.499+0000 7f199cee9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f199809d6f0 0x7f199809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:32934/0 (socket says 172.21.15.26:32934) 2023-10-01T07:56:23.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.500+0000 7f199cee9700 1 -- 172.21.15.26:0/3155950337 learned_addr learned my addr 172.21.15.26:0/3155950337 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:23.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.500+0000 7f199d6ea700 1 --1- 172.21.15.26:0/3155950337 >> v1:172.21.15.26:6789/0 conn(0x7f199809e410 0x7f1998130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59138/0 (socket says 172.21.15.26:59138) 2023-10-01T07:56:23.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.500+0000 7f19977fe700 1 -- 172.21.15.26:0/3155950337 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1665175831 0 0) 0x7f199809f130 con 0x7f199809e410 2023-10-01T07:56:23.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.500+0000 7f1997fff700 1 -- 172.21.15.26:0/3155950337 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f199809d6f0 msgr2=0x7f199809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:23.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.500+0000 7f1997fff700 1 --2- 172.21.15.26:0/3155950337 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f199809d6f0 0x7f199809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:23.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.500+0000 7f1997fff700 1 -- 172.21.15.26:0/3155950337 >> v1:172.21.15.26:6789/0 conn(0x7f199809e410 legacy=0x7f1998130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:23.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.500+0000 7f1997fff700 1 -- 172.21.15.26:0/3155950337 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199809b2d0 con 0x7f199809e000 2023-10-01T07:56:23.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.500+0000 7f199cee9700 1 --2- 172.21.15.26:0/3155950337 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f199809d6f0 0x7f199809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:23.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.500+0000 7f1997fff700 1 --2- 172.21.15.26:0/3155950337 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f199809e000 0x7f1998130660 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1984009870 tx=0x7f1984009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5271bc4188374a99 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:23.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.500+0000 7f19977fe700 1 -- 172.21.15.26:0/3155950337 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1984011830 con 0x7f199809e000 2023-10-01T07:56:23.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.500+0000 7f19977fe700 1 -- 172.21.15.26:0/3155950337 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1984011990 con 0x7f199809e000 2023-10-01T07:56:23.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.500+0000 7f19977fe700 1 -- 172.21.15.26:0/3155950337 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1984011d20 con 0x7f199809e000 2023-10-01T07:56:23.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.501+0000 7f199f14d700 1 -- 172.21.15.26:0/3155950337 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f199809e000 msgr2=0x7f1998130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:23.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.501+0000 7f199f14d700 1 --2- 172.21.15.26:0/3155950337 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f199809e000 0x7f1998130660 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1984009870 tx=0x7f1984009b80 comp rx=0 tx=0).stop 2023-10-01T07:56:23.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.501+0000 7f199f14d700 1 -- 172.21.15.26:0/3155950337 shutdown_connections 2023-10-01T07:56:23.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.501+0000 7f199f14d700 1 --2- 172.21.15.26:0/3155950337 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f199809d6f0 0x7f199809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.501+0000 7f199f14d700 1 --2- 172.21.15.26:0/3155950337 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f199809e000 0x7f1998130660 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.501+0000 7f199f14d700 1 -- 172.21.15.26:0/3155950337 >> 172.21.15.26:0/3155950337 conn(0x7f1998066f50 msgr2=0x7f199809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.502+0000 7f199f14d700 1 -- 172.21.15.26:0/3155950337 shutdown_connections 2023-10-01T07:56:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.502+0000 7f199f14d700 1 -- 172.21.15.26:0/3155950337 wait complete. 2023-10-01T07:56:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.503+0000 7f199f14d700 1 Processor -- start 2023-10-01T07:56:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.503+0000 7f199f14d700 1 -- start start 2023-10-01T07:56:23.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.504+0000 7f199f14d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f199809d6f0 0x7f1998131670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:23.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.504+0000 7f199f14d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f199809e000 0x7f1998131bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:23.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.504+0000 7f199f14d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f199809e410 0x7f19981320f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:23.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.504+0000 7f199f14d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19981339b0 con 0x7f199809e000 2023-10-01T07:56:23.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.504+0000 7f199f14d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19980a3a60 con 0x7f199809e410 2023-10-01T07:56:23.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.504+0000 7f199f14d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1998133540 con 0x7f199809d6f0 2023-10-01T07:56:23.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.504+0000 7f199d6ea700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f199809e410 0x7f19981320f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:23.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.504+0000 7f199d6ea700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f199809e410 0x7f19981320f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33384/0 (socket says 172.21.15.26:33384) 2023-10-01T07:56:23.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.504+0000 7f1997fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f199809e000 0x7f1998131bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:23.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.504+0000 7f199d6ea700 1 -- 172.21.15.26:0/2839887168 learned_addr learned my addr 172.21.15.26:0/2839887168 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:23.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.504+0000 7f199cee9700 1 --2- 172.21.15.26:0/2839887168 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f199809d6f0 0x7f1998131670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:23.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.505+0000 7f199d6ea700 1 -- 172.21.15.26:0/2839887168 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f199809d6f0 msgr2=0x7f1998131670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:23.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.505+0000 7f199d6ea700 1 --2- 172.21.15.26:0/2839887168 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f199809d6f0 0x7f1998131670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:23.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.505+0000 7f199d6ea700 1 -- 172.21.15.26:0/2839887168 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f199809e000 msgr2=0x7f1998131bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:23.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.505+0000 7f199d6ea700 1 --2- 172.21.15.26:0/2839887168 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f199809e000 0x7f1998131bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:23.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.505+0000 7f199d6ea700 1 -- 172.21.15.26:0/2839887168 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198c009550 con 0x7f199809e410 2023-10-01T07:56:23.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.505+0000 7f1997fff700 1 --2- 172.21.15.26:0/2839887168 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f199809e000 0x7f1998131bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:23.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.505+0000 7f199d6ea700 1 --2- 172.21.15.26:0/2839887168 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f199809e410 0x7f19981320f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f199000ccd0 tx=0x7f199000a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:23.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.505+0000 7f19957fa700 1 -- 172.21.15.26:0/2839887168 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199000ab30 con 0x7f199809e410 2023-10-01T07:56:23.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.505+0000 7f19957fa700 1 -- 172.21.15.26:0/2839887168 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199000ac90 con 0x7f199809e410 2023-10-01T07:56:23.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.505+0000 7f199f14d700 1 -- 172.21.15.26:0/2839887168 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19840094a0 con 0x7f199809e410 2023-10-01T07:56:23.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.505+0000 7f19957fa700 1 -- 172.21.15.26:0/2839887168 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19900070d0 con 0x7f199809e410 2023-10-01T07:56:23.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.505+0000 7f199f14d700 1 -- 172.21.15.26:0/2839887168 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19981328c0 con 0x7f199809e410 2023-10-01T07:56:23.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.506+0000 7f19957fa700 1 -- 172.21.15.26:0/2839887168 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1990007230 con 0x7f199809e410 2023-10-01T07:56:23.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.506+0000 7f19957fa700 1 -- 172.21.15.26:0/2839887168 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f199003f1d0 con 0x7f199809e410 2023-10-01T07:56:23.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.507+0000 7f199f14d700 1 -- 172.21.15.26:0/2839887168 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1998132ab0 con 0x7f199809e410 2023-10-01T07:56:23.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.512+0000 7f19957fa700 1 -- 172.21.15.26:0/2839887168 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1990018080 con 0x7f199809e410 2023-10-01T07:56:23.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.658+0000 7f5c61919700 1 -- 172.21.15.26:0/3943927336 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5c5c0713a0 con 0x7f5c5c135c20 2023-10-01T07:56:23.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.659+0000 7f5c43fff700 1 -- 172.21.15.26:0/3943927336 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5c54034090 con 0x7f5c5c135c20 2023-10-01T07:56:23.659 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:23.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.661+0000 7f5c61919700 1 -- 172.21.15.26:0/3943927336 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c5c135c20 msgr2=0x7f5c5c13b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:23.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.661+0000 7f5c61919700 1 --2- 172.21.15.26:0/3943927336 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c5c135c20 0x7f5c5c13b0e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5c5400b680 tx=0x7f5c54004ad0 comp rx=0 tx=0).stop 2023-10-01T07:56:23.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.661+0000 7f5c61919700 1 -- 172.21.15.26:0/3943927336 shutdown_connections 2023-10-01T07:56:23.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.661+0000 7f5c61919700 1 --2- 172.21.15.26:0/3943927336 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c5c135c20 0x7f5c5c13b0e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:23.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.661+0000 7f5c61919700 1 --2- 172.21.15.26:0/3943927336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c5c06f5d0 0x7f5c5c13a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:23.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.661+0000 7f5c61919700 1 --2- 172.21.15.26:0/3943927336 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c5c12cf60 0x7f5c5c13aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:23.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.661+0000 7f5c61919700 1 -- 172.21.15.26:0/3943927336 >> 172.21.15.26:0/3943927336 conn(0x7f5c5c0a2aa0 msgr2=0x7f5c5c06e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:23.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.661+0000 7f5c61919700 1 -- 172.21.15.26:0/3943927336 shutdown_connections 2023-10-01T07:56:23.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.661+0000 7f5c61919700 1 -- 172.21.15.26:0/3943927336 wait complete. 2023-10-01T07:56:23.676 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:23.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.698+0000 7f460283a700 1 -- 172.21.15.26:0/600280725 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f45fc06c360 con 0x7f45fc09d6f0 2023-10-01T07:56:23.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.698+0000 7f45f8ff9700 1 -- 172.21.15.26:0/600280725 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f45ec017090 con 0x7f45fc09d6f0 2023-10-01T07:56:23.699 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:23.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.701+0000 7f460283a700 1 -- 172.21.15.26:0/600280725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45fc09d6f0 msgr2=0x7f45fc122400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:23.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.701+0000 7f460283a700 1 --2- 172.21.15.26:0/600280725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45fc09d6f0 0x7f45fc122400 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f45ec00ebe0 tx=0x7f45ec009ec0 comp rx=0 tx=0).stop 2023-10-01T07:56:23.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.701+0000 7f460283a700 1 -- 172.21.15.26:0/600280725 shutdown_connections 2023-10-01T07:56:23.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.701+0000 7f460283a700 1 --2- 172.21.15.26:0/600280725 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45fc09e410 0x7f45fc122e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:23.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.701+0000 7f460283a700 1 --2- 172.21.15.26:0/600280725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45fc09d6f0 0x7f45fc122400 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:23.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.701+0000 7f460283a700 1 --2- 172.21.15.26:0/600280725 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45fc09e000 0x7f45fc122940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:23.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.701+0000 7f460283a700 1 -- 172.21.15.26:0/600280725 >> 172.21.15.26:0/600280725 conn(0x7f45fc066f50 msgr2=0x7f45fc070ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:23.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.701+0000 7f460283a700 1 -- 172.21.15.26:0/600280725 shutdown_connections 2023-10-01T07:56:23.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.701+0000 7f460283a700 1 -- 172.21.15.26:0/600280725 wait complete. 2023-10-01T07:56:23.715 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:23.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.728+0000 7f199f14d700 1 -- 172.21.15.26:0/2839887168 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1998134430 con 0x7f199809e410 2023-10-01T07:56:23.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.728+0000 7f19957fa700 1 -- 172.21.15.26:0/2839887168 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1990019860 con 0x7f199809e410 2023-10-01T07:56:23.729 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:23.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.730+0000 7f199f14d700 1 -- 172.21.15.26:0/2839887168 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f199809e410 msgr2=0x7f19981320f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:23.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.730+0000 7f199f14d700 1 --2- 172.21.15.26:0/2839887168 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f199809e410 0x7f19981320f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f199000ccd0 tx=0x7f199000a060 comp rx=0 tx=0).stop 2023-10-01T07:56:23.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.730+0000 7f199f14d700 1 -- 172.21.15.26:0/2839887168 shutdown_connections 2023-10-01T07:56:23.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.730+0000 7f199f14d700 1 --2- 172.21.15.26:0/2839887168 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f199809e410 0x7f19981320f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:23.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.730+0000 7f199f14d700 1 --2- 172.21.15.26:0/2839887168 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f199809d6f0 0x7f1998131670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:23.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.730+0000 7f199f14d700 1 --2- 172.21.15.26:0/2839887168 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f199809e000 0x7f1998131bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:23.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.731+0000 7f199f14d700 1 -- 172.21.15.26:0/2839887168 >> 172.21.15.26:0/2839887168 conn(0x7f1998066f50 msgr2=0x7f1998070d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:23.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.731+0000 7f199f14d700 1 -- 172.21.15.26:0/2839887168 shutdown_connections 2023-10-01T07:56:23.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:23.731+0000 7f199f14d700 1 -- 172.21.15.26:0/2839887168 wait complete. 2023-10-01T07:56:23.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:24.497 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:24.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.642+0000 7f090bc6a700 1 Processor -- start 2023-10-01T07:56:24.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.642+0000 7f090bc6a700 1 -- start start 2023-10-01T07:56:24.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.643+0000 7f090bc6a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f090412cc20 0x7f090412f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:24.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.643+0000 7f090bc6a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f090412c2f0 0x7f090412fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:24.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.643+0000 7f090bc6a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f090412cff0 0x7f09041303b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:24.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.643+0000 7f090bc6a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f090409a510 con 0x7f090412cff0 2023-10-01T07:56:24.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.643+0000 7f090bc6a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090412c7d0 con 0x7f090412c2f0 2023-10-01T07:56:24.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.643+0000 7f090bc6a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f090409c190 con 0x7f090412cc20 2023-10-01T07:56:24.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.643+0000 7f0909205700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f090412c2f0 0x7f090412fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:24.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.643+0000 7f0909a06700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f090412cc20 0x7f090412f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:24.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.643+0000 7f090a207700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f090412cff0 0x7f09041303b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:24.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.643+0000 7f0909205700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f090412c2f0 0x7f090412fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33386/0 (socket says 172.21.15.26:33386) 2023-10-01T07:56:24.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.643+0000 7f0909a06700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f090412cc20 0x7f090412f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:32950/0 (socket says 172.21.15.26:32950) 2023-10-01T07:56:24.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.643+0000 7f0909205700 1 -- 172.21.15.26:0/1903603400 learned_addr learned my addr 172.21.15.26:0/1903603400 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:24.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.643+0000 7f090a207700 1 -- 172.21.15.26:0/1903603400 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f090412cc20 msgr2=0x7f090412f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:24.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.643+0000 7f090a207700 1 --2- 172.21.15.26:0/1903603400 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f090412cc20 0x7f090412f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:24.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.643+0000 7f090a207700 1 -- 172.21.15.26:0/1903603400 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f090412c2f0 msgr2=0x7f090412fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:24.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.643+0000 7f090a207700 1 --2- 172.21.15.26:0/1903603400 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f090412c2f0 0x7f090412fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:24.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.643+0000 7f090a207700 1 -- 172.21.15.26:0/1903603400 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090409b540 con 0x7f090412cff0 2023-10-01T07:56:24.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.643+0000 7f0909a06700 1 --2- 172.21.15.26:0/1903603400 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f090412cc20 0x7f090412f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:24.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.643+0000 7f0909205700 1 --2- 172.21.15.26:0/1903603400 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f090412c2f0 0x7f090412fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:24.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.643+0000 7f090a207700 1 --2- 172.21.15.26:0/1903603400 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f090412cff0 0x7f09041303b0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f08fc009d90 tx=0x7f08fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcd40bb9974fa8f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:24.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.644+0000 7f0908a04700 1 -- 172.21.15.26:0/1903603400 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc00e070 con 0x7f090412cff0 2023-10-01T07:56:24.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.644+0000 7f0908a04700 1 -- 172.21.15.26:0/1903603400 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08fc00bb20 con 0x7f090412cff0 2023-10-01T07:56:24.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.644+0000 7f0908a04700 1 -- 172.21.15.26:0/1903603400 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc012430 con 0x7f090412cff0 2023-10-01T07:56:24.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.644+0000 7f090bc6a700 1 -- 172.21.15.26:0/1903603400 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f090412cff0 msgr2=0x7f09041303b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:24.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.644+0000 7f090bc6a700 1 --2- 172.21.15.26:0/1903603400 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f090412cff0 0x7f09041303b0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f08fc009d90 tx=0x7f08fc00b330 comp rx=0 tx=0).stop 2023-10-01T07:56:24.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.644+0000 7f090bc6a700 1 -- 172.21.15.26:0/1903603400 shutdown_connections 2023-10-01T07:56:24.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.644+0000 7f090bc6a700 1 --2- 172.21.15.26:0/1903603400 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f090412cff0 0x7f09041303b0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:24.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.644+0000 7f090bc6a700 1 --2- 172.21.15.26:0/1903603400 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f090412cc20 0x7f090412f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:24.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.644+0000 7f090bc6a700 1 --2- 172.21.15.26:0/1903603400 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f090412c2f0 0x7f090412fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:24.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.644+0000 7f090bc6a700 1 -- 172.21.15.26:0/1903603400 >> 172.21.15.26:0/1903603400 conn(0x7f090409f470 msgr2=0x7f09040a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:24.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.644+0000 7f090bc6a700 1 -- 172.21.15.26:0/1903603400 shutdown_connections 2023-10-01T07:56:24.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.644+0000 7f090bc6a700 1 -- 172.21.15.26:0/1903603400 wait complete. 2023-10-01T07:56:24.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.645+0000 7f090bc6a700 1 Processor -- start 2023-10-01T07:56:24.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.645+0000 7f090bc6a700 1 -- start start 2023-10-01T07:56:24.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.646+0000 7f090bc6a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f090412c2f0 0x7f09041c8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:24.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.646+0000 7f090bc6a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f090412cc20 0x7f09041c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:24.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.646+0000 7f090bc6a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f090412cff0 0x7f09041c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:24.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.646+0000 7f090bc6a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0904135000 con 0x7f090412cff0 2023-10-01T07:56:24.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.646+0000 7f090bc6a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0904129f10 con 0x7f090412cc20 2023-10-01T07:56:24.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.646+0000 7f090bc6a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09041368d0 con 0x7f090412c2f0 2023-10-01T07:56:24.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.646+0000 7f0909a06700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f090412c2f0 0x7f09041c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:24.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.646+0000 7f0909205700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f090412cc20 0x7f09041c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:24.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.646+0000 7f0909a06700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f090412c2f0 0x7f09041c8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:32966/0 (socket says 172.21.15.26:32966) 2023-10-01T07:56:24.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.646+0000 7f0909a06700 1 -- 172.21.15.26:0/4031578583 learned_addr learned my addr 172.21.15.26:0/4031578583 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:24.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.646+0000 7f090a207700 1 --2- 172.21.15.26:0/4031578583 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f090412cff0 0x7f09041c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:24.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.646+0000 7f0909a06700 1 -- 172.21.15.26:0/4031578583 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f090412cc20 msgr2=0x7f09041c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:24.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.646+0000 7f0909a06700 1 --2- 172.21.15.26:0/4031578583 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f090412cc20 0x7f09041c85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:24.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.646+0000 7f0909a06700 1 -- 172.21.15.26:0/4031578583 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f090412cff0 msgr2=0x7f09041c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:24.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.646+0000 7f0909a06700 1 --2- 172.21.15.26:0/4031578583 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f090412cff0 0x7f09041c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:24.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.646+0000 7f0909a06700 1 -- 172.21.15.26:0/4031578583 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0900009550 con 0x7f090412c2f0 2023-10-01T07:56:24.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.646+0000 7f090a207700 1 --2- 172.21.15.26:0/4031578583 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f090412cff0 0x7f09041c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:24.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.646+0000 7f0909205700 1 --2- 172.21.15.26:0/4031578583 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f090412cc20 0x7f09041c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:24.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.646+0000 7f0909a06700 1 --2- 172.21.15.26:0/4031578583 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f090412c2f0 0x7f09041c8060 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f08f400ebe0 tx=0x7f08f400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:24.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.647+0000 7f08fa7fc700 1 -- 172.21.15.26:0/4031578583 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f400c850 con 0x7f090412c2f0 2023-10-01T07:56:24.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.647+0000 7f08fa7fc700 1 -- 172.21.15.26:0/4031578583 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f400c9b0 con 0x7f090412c2f0 2023-10-01T07:56:24.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.647+0000 7f090bc6a700 1 -- 172.21.15.26:0/4031578583 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f40094a0 con 0x7f090412c2f0 2023-10-01T07:56:24.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.647+0000 7f08fa7fc700 1 -- 172.21.15.26:0/4031578583 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f400cd40 con 0x7f090412c2f0 2023-10-01T07:56:24.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.647+0000 7f090bc6a700 1 -- 172.21.15.26:0/4031578583 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08fc009a70 con 0x7f090412c2f0 2023-10-01T07:56:24.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.647+0000 7f08fa7fc700 1 -- 172.21.15.26:0/4031578583 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f08f4013470 con 0x7f090412c2f0 2023-10-01T07:56:24.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.648+0000 7f08fa7fc700 1 -- 172.21.15.26:0/4031578583 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f08f403f7a0 con 0x7f090412c2f0 2023-10-01T07:56:24.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.648+0000 7f090bc6a700 1 -- 172.21.15.26:0/4031578583 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09040747f0 con 0x7f090412c2f0 2023-10-01T07:56:24.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.653+0000 7f08fa7fc700 1 -- 172.21.15.26:0/4031578583 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f08f4013720 con 0x7f090412c2f0 2023-10-01T07:56:24.676 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:24.715 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:24.745 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:24.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.829+0000 7f109853f700 1 Processor -- start 2023-10-01T07:56:24.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.829+0000 7f109853f700 1 -- start start 2023-10-01T07:56:24.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.830+0000 7f109853f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10901338a0 0x7f1090133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:24.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.830+0000 7f109853f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f109009de50 0x7f109009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:24.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.830+0000 7f109853f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f109009e760 0x7f109013a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:24.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.830+0000 7f109853f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f109006fef0 con 0x7f109009de50 2023-10-01T07:56:24.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.830+0000 7f109853f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f109006ef30 con 0x7f10901338a0 2023-10-01T07:56:24.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.830+0000 7f109853f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10901334b0 con 0x7f109009e760 2023-10-01T07:56:24.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.830+0000 7f10962db700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10901338a0 0x7f1090133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:24.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.830+0000 7f1095ada700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f109009de50 0x7f109009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:24.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.830+0000 7f10962db700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10901338a0 0x7f1090133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33410/0 (socket says 172.21.15.26:33410) 2023-10-01T07:56:24.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.830+0000 7f10962db700 1 -- 172.21.15.26:0/2029193164 learned_addr learned my addr 172.21.15.26:0/2029193164 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:24.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.830+0000 7f1096adc700 1 --2- 172.21.15.26:0/2029193164 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f109009e760 0x7f109013a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:24.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.831+0000 7f1095ada700 1 -- 172.21.15.26:0/2029193164 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f109009e760 msgr2=0x7f109013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:24.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.831+0000 7f1095ada700 1 --2- 172.21.15.26:0/2029193164 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f109009e760 0x7f109013a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:24.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.831+0000 7f1095ada700 1 -- 172.21.15.26:0/2029193164 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10901338a0 msgr2=0x7f1090133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:24.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.831+0000 7f1095ada700 1 --2- 172.21.15.26:0/2029193164 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10901338a0 0x7f1090133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:24.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.831+0000 7f1095ada700 1 -- 172.21.15.26:0/2029193164 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109006fc30 con 0x7f109009de50 2023-10-01T07:56:24.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.831+0000 7f1095ada700 1 --2- 172.21.15.26:0/2029193164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f109009de50 0x7f109009e220 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f1080009840 tx=0x7f1080009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49323c6a5d7147f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:24.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.831+0000 7f10952d9700 1 -- 172.21.15.26:0/2029193164 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1080011830 con 0x7f109009de50 2023-10-01T07:56:24.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.831+0000 7f10952d9700 1 -- 172.21.15.26:0/2029193164 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1080011990 con 0x7f109009de50 2023-10-01T07:56:24.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.831+0000 7f10952d9700 1 -- 172.21.15.26:0/2029193164 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1080011d20 con 0x7f109009de50 2023-10-01T07:56:24.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.832+0000 7f109853f700 1 -- 172.21.15.26:0/2029193164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f109009de50 msgr2=0x7f109009e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:24.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.832+0000 7f109853f700 1 --2- 172.21.15.26:0/2029193164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f109009de50 0x7f109009e220 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f1080009840 tx=0x7f1080009b50 comp rx=0 tx=0).stop 2023-10-01T07:56:24.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.832+0000 7f109853f700 1 -- 172.21.15.26:0/2029193164 shutdown_connections 2023-10-01T07:56:24.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.832+0000 7f109853f700 1 --2- 172.21.15.26:0/2029193164 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f109009e760 0x7f109013a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:24.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.832+0000 7f109853f700 1 --2- 172.21.15.26:0/2029193164 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10901338a0 0x7f1090133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:24.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.832+0000 7f109853f700 1 --2- 172.21.15.26:0/2029193164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f109009de50 0x7f109009e220 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:24.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.832+0000 7f109853f700 1 -- 172.21.15.26:0/2029193164 >> 172.21.15.26:0/2029193164 conn(0x7f10900a2aa0 msgr2=0x7f10900a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:24.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.832+0000 7f109853f700 1 -- 172.21.15.26:0/2029193164 shutdown_connections 2023-10-01T07:56:24.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.832+0000 7f109853f700 1 -- 172.21.15.26:0/2029193164 wait complete. 2023-10-01T07:56:24.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.833+0000 7f109853f700 1 Processor -- start 2023-10-01T07:56:24.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.834+0000 7f109853f700 1 -- start start 2023-10-01T07:56:24.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.834+0000 7f109853f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f109009de50 0x7f109011d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:24.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.834+0000 7f109853f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f109009e760 0x7f109011dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:24.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.834+0000 7f109853f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10901338a0 0x7f109011e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:24.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.834+0000 7f109853f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109011eb50 con 0x7f109009de50 2023-10-01T07:56:24.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.834+0000 7f109853f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f109011f2b0 con 0x7f10901338a0 2023-10-01T07:56:24.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.834+0000 7f109853f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f109011f8d0 con 0x7f109009e760 2023-10-01T07:56:24.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.835+0000 7f10962db700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f109009de50 0x7f109011d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:24.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.835+0000 7f1096adc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10901338a0 0x7f109011e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:24.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.835+0000 7f10962db700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f109009de50 0x7f109011d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49514/0 (socket says 172.21.15.26:49514) 2023-10-01T07:56:24.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.835+0000 7f10962db700 1 -- 172.21.15.26:0/2032694133 learned_addr learned my addr 172.21.15.26:0/2032694133 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:24.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.835+0000 7f1095ada700 1 --2- 172.21.15.26:0/2032694133 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f109009e760 0x7f109011dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:24.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.835+0000 7f10962db700 1 -- 172.21.15.26:0/2032694133 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f109009e760 msgr2=0x7f109011dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:24.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.835+0000 7f10962db700 1 --2- 172.21.15.26:0/2032694133 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f109009e760 0x7f109011dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:24.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.835+0000 7f10962db700 1 -- 172.21.15.26:0/2032694133 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10901338a0 msgr2=0x7f109011e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:24.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.835+0000 7f10962db700 1 --2- 172.21.15.26:0/2032694133 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10901338a0 0x7f109011e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:24.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.835+0000 7f10962db700 1 -- 172.21.15.26:0/2032694133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10800094a0 con 0x7f109009de50 2023-10-01T07:56:24.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.835+0000 7f10962db700 1 --2- 172.21.15.26:0/2032694133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f109009de50 0x7f109011d6a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f108c00e910 tx=0x7f108c00ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:24.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.835+0000 7f1086ffd700 1 -- 172.21.15.26:0/2032694133 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c013680 con 0x7f109009de50 2023-10-01T07:56:24.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.835+0000 7f1086ffd700 1 -- 172.21.15.26:0/2032694133 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108c0137e0 con 0x7f109009de50 2023-10-01T07:56:24.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.836+0000 7f1086ffd700 1 -- 172.21.15.26:0/2032694133 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c013b50 con 0x7f109009de50 2023-10-01T07:56:24.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.836+0000 7f109853f700 1 -- 172.21.15.26:0/2032694133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1090120ee0 con 0x7f109009de50 2023-10-01T07:56:24.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.836+0000 7f109853f700 1 -- 172.21.15.26:0/2032694133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10900a0fb0 con 0x7f109009de50 2023-10-01T07:56:24.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.837+0000 7f109853f700 1 -- 172.21.15.26:0/2032694133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1090120590 con 0x7f109009de50 2023-10-01T07:56:24.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.837+0000 7f1086ffd700 1 -- 172.21.15.26:0/2032694133 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f108c013cb0 con 0x7f109009de50 2023-10-01T07:56:24.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.838+0000 7f1086ffd700 1 -- 172.21.15.26:0/2032694133 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f108c03fd80 con 0x7f109009de50 2023-10-01T07:56:24.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.842+0000 7f1086ffd700 1 -- 172.21.15.26:0/2032694133 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f108c011350 con 0x7f109009de50 2023-10-01T07:56:24.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.870+0000 7fdb58114700 1 Processor -- start 2023-10-01T07:56:24.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.870+0000 7fdb58114700 1 -- start start 2023-10-01T07:56:24.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.871+0000 7fdb58114700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdb5009e1d0 0x7fdb50138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:24.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.871+0000 7fdb58114700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb50139170 0x7fdb5013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:24.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.871+0000 7fdb58114700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb5009b120 con 0x7fdb5009d6f0 2023-10-01T07:56:24.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.871+0000 7fdb58114700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb5006b460 con 0x7fdb5009e1d0 2023-10-01T07:56:24.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.871+0000 7fdb58114700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5009a7e0 con 0x7fdb50139170 2023-10-01T07:56:24.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.871+0000 7fdb55eb0700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fdb5009d6f0 0x7fdb5009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59140/0 (socket says 172.21.15.26:59140) 2023-10-01T07:56:24.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.871+0000 7fdb55eb0700 1 -- 172.21.15.26:0/3806360807 learned_addr learned my addr 172.21.15.26:0/3806360807 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:24.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.871+0000 7fdb556af700 1 --2- 172.21.15.26:0/3806360807 >> v2:172.21.15.26:3300/0 conn(0x7fdb5009e1d0 0x7fdb50138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:24.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.871+0000 7fdb566b1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb50139170 0x7fdb5013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:24.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.872+0000 7fdb54eae700 1 -- 172.21.15.26:0/3806360807 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1146787810 0 0) 0x7fdb5009b120 con 0x7fdb5009d6f0 2023-10-01T07:56:24.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.872+0000 7fdb54eae700 1 -- 172.21.15.26:0/3806360807 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb3c0035b0 con 0x7fdb5009d6f0 2023-10-01T07:56:24.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.872+0000 7fdb556af700 1 -- 172.21.15.26:0/3806360807 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb50139170 msgr2=0x7fdb5013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:24.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.872+0000 7fdb556af700 1 --2- 172.21.15.26:0/3806360807 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb50139170 0x7fdb5013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:24.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.872+0000 7fdb556af700 1 -- 172.21.15.26:0/3806360807 >> v1:172.21.15.26:6789/0 conn(0x7fdb5009d6f0 legacy=0x7fdb5009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:24.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.872+0000 7fdb556af700 1 -- 172.21.15.26:0/3806360807 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5009a500 con 0x7fdb5009e1d0 2023-10-01T07:56:24.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.872+0000 7fdb566b1700 1 --2- 172.21.15.26:0/3806360807 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb50139170 0x7fdb5013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:24.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.872+0000 7f090bc6a700 1 -- 172.21.15.26:0/4031578583 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f090406b250 con 0x7f090412c2f0 2023-10-01T07:56:24.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.872+0000 7fdb556af700 1 --2- 172.21.15.26:0/3806360807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb5009e1d0 0x7fdb50138c30 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fdb40009870 tx=0x7fdb40009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89dabf1b490867c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:24.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.873+0000 7fdb54eae700 1 -- 172.21.15.26:0/3806360807 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb40004230 con 0x7fdb5009e1d0 2023-10-01T07:56:24.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.873+0000 7fdb54eae700 1 -- 172.21.15.26:0/3806360807 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb40004390 con 0x7fdb5009e1d0 2023-10-01T07:56:24.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.873+0000 7fdb54eae700 1 -- 172.21.15.26:0/3806360807 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb400036a0 con 0x7fdb5009e1d0 2023-10-01T07:56:24.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.874+0000 7f08fa7fc700 1 -- 172.21.15.26:0/4031578583 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f08f401b9c0 con 0x7f090412c2f0 2023-10-01T07:56:24.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.874+0000 7fdb58114700 1 -- 172.21.15.26:0/3806360807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb5009e1d0 msgr2=0x7fdb50138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:24.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.874+0000 7fdb58114700 1 --2- 172.21.15.26:0/3806360807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb5009e1d0 0x7fdb50138c30 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fdb40009870 tx=0x7fdb40009b80 comp rx=0 tx=0).stop 2023-10-01T07:56:24.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.874+0000 7fdb58114700 1 -- 172.21.15.26:0/3806360807 shutdown_connections 2023-10-01T07:56:24.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.874+0000 7fdb58114700 1 --2- 172.21.15.26:0/3806360807 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb50139170 0x7fdb5013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:24.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.874+0000 7fdb58114700 1 --2- 172.21.15.26:0/3806360807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb5009e1d0 0x7fdb50138c30 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:24.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.874+0000 7fdb58114700 1 -- 172.21.15.26:0/3806360807 >> 172.21.15.26:0/3806360807 conn(0x7fdb50066f50 msgr2=0x7fdb5009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:24.876 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:24.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.874+0000 7fdb58114700 1 -- 172.21.15.26:0/3806360807 shutdown_connections 2023-10-01T07:56:24.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.874+0000 7fdb58114700 1 -- 172.21.15.26:0/3806360807 wait complete. 2023-10-01T07:56:24.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.875+0000 7fdb58114700 1 Processor -- start 2023-10-01T07:56:24.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.875+0000 7fdb58114700 1 -- start start 2023-10-01T07:56:24.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.876+0000 7fdb58114700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb5009d6f0 0x7fdb5011e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:24.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.876+0000 7fdb58114700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb50139170 0x7fdb5011ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:24.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.876+0000 7fdb58114700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb5011f460 0x7fdb501333d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:24.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.876+0000 7fdb58114700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb50121ec0 con 0x7fdb5011f460 2023-10-01T07:56:24.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.876+0000 7fdb58114700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5009c710 con 0x7fdb5009d6f0 2023-10-01T07:56:24.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.876+0000 7fdb58114700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb50072080 con 0x7fdb50139170 2023-10-01T07:56:24.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.876+0000 7f090bc6a700 1 -- 172.21.15.26:0/4031578583 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f090412c2f0 msgr2=0x7f09041c8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:24.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.876+0000 7f090bc6a700 1 --2- 172.21.15.26:0/4031578583 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f090412c2f0 0x7f09041c8060 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f08f400ebe0 tx=0x7f08f400eef0 comp rx=0 tx=0).stop 2023-10-01T07:56:24.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.876+0000 7f090bc6a700 1 -- 172.21.15.26:0/4031578583 shutdown_connections 2023-10-01T07:56:24.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.876+0000 7f090bc6a700 1 --2- 172.21.15.26:0/4031578583 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f090412cff0 0x7f09041c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:24.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.876+0000 7f090bc6a700 1 --2- 172.21.15.26:0/4031578583 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f090412c2f0 0x7f09041c8060 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:24.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.876+0000 7f090bc6a700 1 --2- 172.21.15.26:0/4031578583 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f090412cc20 0x7f09041c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:24.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.876+0000 7f090bc6a700 1 -- 172.21.15.26:0/4031578583 >> 172.21.15.26:0/4031578583 conn(0x7f090409f470 msgr2=0x7f09040982a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:24.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.876+0000 7fdb566b1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb5011f460 0x7fdb501333d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:24.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.876+0000 7fdb566b1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb5011f460 0x7fdb501333d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49536/0 (socket says 172.21.15.26:49536) 2023-10-01T07:56:24.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.876+0000 7fdb566b1700 1 -- 172.21.15.26:0/1448573149 learned_addr learned my addr 172.21.15.26:0/1448573149 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:24.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.876+0000 7fdb556af700 1 --2- 172.21.15.26:0/1448573149 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb50139170 0x7fdb5011ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:24.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.876+0000 7f090bc6a700 1 -- 172.21.15.26:0/4031578583 shutdown_connections 2023-10-01T07:56:24.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.876+0000 7f090bc6a700 1 -- 172.21.15.26:0/4031578583 wait complete. 2023-10-01T07:56:24.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.877+0000 7fdb566b1700 1 -- 172.21.15.26:0/1448573149 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb50139170 msgr2=0x7fdb5011ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:24.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.877+0000 7fdb566b1700 1 --2- 172.21.15.26:0/1448573149 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb50139170 0x7fdb5011ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:24.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.877+0000 7fdb566b1700 1 -- 172.21.15.26:0/1448573149 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb5009d6f0 msgr2=0x7fdb5011e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:24.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.877+0000 7fdb566b1700 1 --2- 172.21.15.26:0/1448573149 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb5009d6f0 0x7fdb5011e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:24.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.877+0000 7fdb566b1700 1 -- 172.21.15.26:0/1448573149 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb48009a70 con 0x7fdb5011f460 2023-10-01T07:56:24.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.877+0000 7fdb566b1700 1 --2- 172.21.15.26:0/1448573149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb5011f460 0x7fdb501333d0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fdb4800ef90 tx=0x7fdb4800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:24.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.877+0000 7fdb467fc700 1 -- 172.21.15.26:0/1448573149 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4800cd40 con 0x7fdb5011f460 2023-10-01T07:56:24.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.877+0000 7fdb467fc700 1 -- 172.21.15.26:0/1448573149 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4800f040 con 0x7fdb5011f460 2023-10-01T07:56:24.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.877+0000 7fdb58114700 1 -- 172.21.15.26:0/1448573149 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb400094a0 con 0x7fdb5011f460 2023-10-01T07:56:24.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.877+0000 7fdb58114700 1 -- 172.21.15.26:0/1448573149 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb501206d0 con 0x7fdb5011f460 2023-10-01T07:56:24.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.878+0000 7fdb58114700 1 -- 172.21.15.26:0/1448573149 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb50074ea0 con 0x7fdb5011f460 2023-10-01T07:56:24.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.879+0000 7fdb467fc700 1 -- 172.21.15.26:0/1448573149 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb480146c0 con 0x7fdb5011f460 2023-10-01T07:56:24.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.879+0000 7fdb467fc700 1 -- 172.21.15.26:0/1448573149 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb48014860 con 0x7fdb5011f460 2023-10-01T07:56:24.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.879+0000 7fdb467fc700 1 -- 172.21.15.26:0/1448573149 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdb480406a0 con 0x7fdb5011f460 2023-10-01T07:56:24.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.888+0000 7fdb467fc700 1 -- 172.21.15.26:0/1448573149 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb48012bc0 con 0x7fdb5011f460 2023-10-01T07:56:24.892 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:24.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.914+0000 7fabce03d700 1 Processor -- start 2023-10-01T07:56:24.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.914+0000 7fabce03d700 1 -- start start 2023-10-01T07:56:24.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.915+0000 7fabce03d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fabc80a0a30 0x7fabc80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:24.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.915+0000 7fabce03d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabc80a1340 0x7fabc8133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:24.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.915+0000 7fabce03d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabc8133fa0 0x7fabc8134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:24.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.915+0000 7fabce03d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabc809edd0 con 0x7fabc80a0a30 2023-10-01T07:56:24.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.915+0000 7fabce03d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc809e1f0 con 0x7fabc80a1340 2023-10-01T07:56:24.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.915+0000 7fabce03d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabc809dc50 con 0x7fabc8133fa0 2023-10-01T07:56:24.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.915+0000 7fabc77fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fabc80a0a30 0x7fabc80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:24.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.915+0000 7fabc77fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fabc80a0a30 0x7fabc80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49548/0 (socket says 172.21.15.26:49548) 2023-10-01T07:56:24.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.915+0000 7fabc77fe700 1 -- 172.21.15.26:0/4109175972 learned_addr learned my addr 172.21.15.26:0/4109175972 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:24.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.915+0000 7fabbeffd700 1 --2- 172.21.15.26:0/4109175972 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabc80a1340 0x7fabc8133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:24.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.915+0000 7fabc7fff700 1 --2- 172.21.15.26:0/4109175972 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabc8133fa0 0x7fabc8134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:24.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.916+0000 7fabbeffd700 1 -- 172.21.15.26:0/4109175972 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabc8133fa0 msgr2=0x7fabc8134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:24.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.916+0000 7fabbeffd700 1 --2- 172.21.15.26:0/4109175972 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabc8133fa0 0x7fabc8134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:24.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.916+0000 7fabbeffd700 1 -- 172.21.15.26:0/4109175972 >> v2:172.21.15.26:3300/0 conn(0x7fabc80a0a30 msgr2=0x7fabc80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:24.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.916+0000 7fabbeffd700 1 --2- 172.21.15.26:0/4109175972 >> v2:172.21.15.26:3300/0 conn(0x7fabc80a0a30 0x7fabc80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:24.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.916+0000 7fabbeffd700 1 -- 172.21.15.26:0/4109175972 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc80a1fe0 con 0x7fabc80a1340 2023-10-01T07:56:24.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.916+0000 7fabc77fe700 1 --2- 172.21.15.26:0/4109175972 >> v2:172.21.15.26:3300/0 conn(0x7fabc80a0a30 0x7fabc80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:24.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.916+0000 7fabc7fff700 1 --2- 172.21.15.26:0/4109175972 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabc8133fa0 0x7fabc8134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:24.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.916+0000 7fabbeffd700 1 --2- 172.21.15.26:0/4109175972 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabc80a1340 0x7fabc8133a60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fabb0009870 tx=0x7fabb0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd3c0196082b9a5e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:24.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.916+0000 7fabc6ffd700 1 -- 172.21.15.26:0/4109175972 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb0011830 con 0x7fabc80a1340 2023-10-01T07:56:24.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.916+0000 7fabc6ffd700 1 -- 172.21.15.26:0/4109175972 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb0011990 con 0x7fabc80a1340 2023-10-01T07:56:24.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.916+0000 7fabc6ffd700 1 -- 172.21.15.26:0/4109175972 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb0011d20 con 0x7fabc80a1340 2023-10-01T07:56:24.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.917+0000 7fabce03d700 1 -- 172.21.15.26:0/4109175972 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabc80a1340 msgr2=0x7fabc8133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:24.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.917+0000 7fabce03d700 1 --2- 172.21.15.26:0/4109175972 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabc80a1340 0x7fabc8133a60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fabb0009870 tx=0x7fabb0009b80 comp rx=0 tx=0).stop 2023-10-01T07:56:24.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.917+0000 7fabce03d700 1 -- 172.21.15.26:0/4109175972 shutdown_connections 2023-10-01T07:56:24.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.917+0000 7fabce03d700 1 --2- 172.21.15.26:0/4109175972 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabc8133fa0 0x7fabc8134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:24.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.917+0000 7fabce03d700 1 --2- 172.21.15.26:0/4109175972 >> v2:172.21.15.26:3300/0 conn(0x7fabc80a0a30 0x7fabc80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:24.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.917+0000 7fabce03d700 1 --2- 172.21.15.26:0/4109175972 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabc80a1340 0x7fabc8133a60 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:24.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.917+0000 7fabce03d700 1 -- 172.21.15.26:0/4109175972 >> 172.21.15.26:0/4109175972 conn(0x7fabc80a6550 msgr2=0x7fabc80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:24.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.917+0000 7fabce03d700 1 -- 172.21.15.26:0/4109175972 shutdown_connections 2023-10-01T07:56:24.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.917+0000 7fabce03d700 1 -- 172.21.15.26:0/4109175972 wait complete. 2023-10-01T07:56:24.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.918+0000 7fabce03d700 1 Processor -- start 2023-10-01T07:56:24.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.919+0000 7fabce03d700 1 -- start start 2023-10-01T07:56:24.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.919+0000 7fabce03d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabc80a0a30 0x7fabc81206a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:24.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.919+0000 7fabce03d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabc80a1340 0x7fabc8120be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:24.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.919+0000 7fabce03d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabc8133fa0 0x7fabc8121120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:24.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.919+0000 7fabce03d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc8121ae0 con 0x7fabc8133fa0 2023-10-01T07:56:24.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.919+0000 7fabce03d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc8122890 con 0x7fabc80a1340 2023-10-01T07:56:24.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.919+0000 7fabce03d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabc8123950 con 0x7fabc80a0a30 2023-10-01T07:56:24.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.919+0000 7fabbeffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabc80a1340 0x7fabc8120be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:24.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.919+0000 7fabbeffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabc80a1340 0x7fabc8120be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33468/0 (socket says 172.21.15.26:33468) 2023-10-01T07:56:24.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.919+0000 7fabbeffd700 1 -- 172.21.15.26:0/4273302583 learned_addr learned my addr 172.21.15.26:0/4273302583 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:24.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.920+0000 7fabc7fff700 1 --2- 172.21.15.26:0/4273302583 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabc8133fa0 0x7fabc8121120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:24.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.920+0000 7fabc77fe700 1 --2- 172.21.15.26:0/4273302583 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabc80a0a30 0x7fabc81206a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:24.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.920+0000 7fabbeffd700 1 -- 172.21.15.26:0/4273302583 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabc80a0a30 msgr2=0x7fabc81206a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:24.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.920+0000 7fabbeffd700 1 --2- 172.21.15.26:0/4273302583 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabc80a0a30 0x7fabc81206a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:24.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.920+0000 7fabbeffd700 1 -- 172.21.15.26:0/4273302583 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabc8133fa0 msgr2=0x7fabc8121120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:24.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.920+0000 7fabbeffd700 1 --2- 172.21.15.26:0/4273302583 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabc8133fa0 0x7fabc8121120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:24.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.920+0000 7fabbeffd700 1 -- 172.21.15.26:0/4273302583 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb8009550 con 0x7fabc80a1340 2023-10-01T07:56:24.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.920+0000 7fabbeffd700 1 --2- 172.21.15.26:0/4273302583 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabc80a1340 0x7fabc8120be0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fabb0000c00 tx=0x7fabb0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:24.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.920+0000 7fabc4ff9700 1 -- 172.21.15.26:0/4273302583 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb0004450 con 0x7fabc80a1340 2023-10-01T07:56:24.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.920+0000 7fabc4ff9700 1 -- 172.21.15.26:0/4273302583 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb001f070 con 0x7fabc80a1340 2023-10-01T07:56:24.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.920+0000 7fabce03d700 1 -- 172.21.15.26:0/4273302583 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc0009a70 con 0x7fabc80a1340 2023-10-01T07:56:24.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.920+0000 7fabc4ff9700 1 -- 172.21.15.26:0/4273302583 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb00038e0 con 0x7fabc80a1340 2023-10-01T07:56:24.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.920+0000 7fabce03d700 1 -- 172.21.15.26:0/4273302583 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb00094a0 con 0x7fabc80a1340 2023-10-01T07:56:24.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.922+0000 7fabce03d700 1 -- 172.21.15.26:0/4273302583 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabc80a3610 con 0x7fabc80a1340 2023-10-01T07:56:24.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.922+0000 7fabc4ff9700 1 -- 172.21.15.26:0/4273302583 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fabb0003a40 con 0x7fabc80a1340 2023-10-01T07:56:24.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.922+0000 7fabc4ff9700 1 -- 172.21.15.26:0/4273302583 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fabb0021070 con 0x7fabc80a1340 2023-10-01T07:56:24.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:24.927+0000 7fabc4ff9700 1 -- 172.21.15.26:0/4273302583 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fabb00045b0 con 0x7fabc80a1340 2023-10-01T07:56:25.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:25.095+0000 7f109853f700 1 -- 172.21.15.26:0/2032694133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f109006f6a0 con 0x7f109009de50 2023-10-01T07:56:25.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:25.095+0000 7f1086ffd700 1 -- 172.21.15.26:0/2032694133 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f108c021020 con 0x7f109009de50 2023-10-01T07:56:25.096 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:25.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:25.097+0000 7f109853f700 1 -- 172.21.15.26:0/2032694133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f109009de50 msgr2=0x7f109011d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:25.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:25.097+0000 7f109853f700 1 --2- 172.21.15.26:0/2032694133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f109009de50 0x7f109011d6a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f108c00e910 tx=0x7f108c00ec20 comp rx=0 tx=0).stop 2023-10-01T07:56:25.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:25.098+0000 7f109853f700 1 -- 172.21.15.26:0/2032694133 shutdown_connections 2023-10-01T07:56:25.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:25.098+0000 7f109853f700 1 --2- 172.21.15.26:0/2032694133 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10901338a0 0x7f109011e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:25.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:25.098+0000 7f109853f700 1 --2- 172.21.15.26:0/2032694133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f109009de50 0x7f109011d6a0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:25.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:25.098+0000 7f109853f700 1 --2- 172.21.15.26:0/2032694133 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f109009e760 0x7f109011dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:25.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:25.098+0000 7f109853f700 1 -- 172.21.15.26:0/2032694133 >> 172.21.15.26:0/2032694133 conn(0x7f10900a2aa0 msgr2=0x7f10901bae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:25.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:25.098+0000 7f109853f700 1 -- 172.21.15.26:0/2032694133 shutdown_connections 2023-10-01T07:56:25.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:25.098+0000 7fdb58114700 1 -- 172.21.15.26:0/1448573149 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdb5009f420 con 0x7fdb5011f460 2023-10-01T07:56:25.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:25.098+0000 7f109853f700 1 -- 172.21.15.26:0/2032694133 wait complete. 2023-10-01T07:56:25.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:25.098+0000 7fdb467fc700 1 -- 172.21.15.26:0/1448573149 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdb480127b0 con 0x7fdb5011f460 2023-10-01T07:56:25.100 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:25.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:25.101+0000 7fdb58114700 1 -- 172.21.15.26:0/1448573149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb5011f460 msgr2=0x7fdb501333d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:25.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:25.101+0000 7fdb58114700 1 --2- 172.21.15.26:0/1448573149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb5011f460 0x7fdb501333d0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fdb4800ef90 tx=0x7fdb4800c3a0 comp rx=0 tx=0).stop 2023-10-01T07:56:25.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:25.101+0000 7fdb58114700 1 -- 172.21.15.26:0/1448573149 shutdown_connections 2023-10-01T07:56:25.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:25.101+0000 7fdb58114700 1 --2- 172.21.15.26:0/1448573149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb5011f460 0x7fdb501333d0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:25.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:25.101+0000 7fdb58114700 1 --2- 172.21.15.26:0/1448573149 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb5009d6f0 0x7fdb5011e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:25.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:25.102+0000 7fdb58114700 1 --2- 172.21.15.26:0/1448573149 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb50139170 0x7fdb5011ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:25.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:25.102+0000 7fdb58114700 1 -- 172.21.15.26:0/1448573149 >> 172.21.15.26:0/1448573149 conn(0x7fdb50066f50 msgr2=0x7fdb50136cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:25.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:25.103+0000 7fdb58114700 1 -- 172.21.15.26:0/1448573149 shutdown_connections 2023-10-01T07:56:25.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:25.103+0000 7fdb58114700 1 -- 172.21.15.26:0/1448573149 wait complete. 2023-10-01T07:56:25.115 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:25.118 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:25.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:25.165+0000 7fabce03d700 1 -- 172.21.15.26:0/4273302583 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fabc8123d60 con 0x7fabc80a1340 2023-10-01T07:56:25.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:25.166+0000 7fabc4ff9700 1 -- 172.21.15.26:0/4273302583 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fabc8123d60 con 0x7fabc80a1340 2023-10-01T07:56:25.167 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:25.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:25.168+0000 7fabce03d700 1 -- 172.21.15.26:0/4273302583 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabc80a1340 msgr2=0x7fabc8120be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:25.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:25.168+0000 7fabce03d700 1 --2- 172.21.15.26:0/4273302583 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabc80a1340 0x7fabc8120be0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fabb0000c00 tx=0x7fabb0004750 comp rx=0 tx=0).stop 2023-10-01T07:56:25.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:25.168+0000 7fabce03d700 1 -- 172.21.15.26:0/4273302583 shutdown_connections 2023-10-01T07:56:25.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:25.168+0000 7fabce03d700 1 --2- 172.21.15.26:0/4273302583 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabc8133fa0 0x7fabc8121120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:25.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:25.168+0000 7fabce03d700 1 --2- 172.21.15.26:0/4273302583 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabc80a0a30 0x7fabc81206a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:25.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:25.168+0000 7fabce03d700 1 --2- 172.21.15.26:0/4273302583 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabc80a1340 0x7fabc8120be0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:25.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:25.168+0000 7fabce03d700 1 -- 172.21.15.26:0/4273302583 >> 172.21.15.26:0/4273302583 conn(0x7fabc80a6550 msgr2=0x7fabc809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:25.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:25.168+0000 7fabce03d700 1 -- 172.21.15.26:0/4273302583 shutdown_connections 2023-10-01T07:56:25.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:25.168+0000 7fabce03d700 1 -- 172.21.15.26:0/4273302583 wait complete. 2023-10-01T07:56:25.182 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:25.892 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:26.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.038+0000 7fd8a933f700 1 Processor -- start 2023-10-01T07:56:26.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.038+0000 7fd8a933f700 1 -- start start 2023-10-01T07:56:26.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.039+0000 7fd8a933f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd8a409e1d0 0x7fd8a4138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:26.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.039+0000 7fd8a933f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd8a4139170 0x7fd8a413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:26.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.039+0000 7fd8a933f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a409d2f0 con 0x7fd8a409d6f0 2023-10-01T07:56:26.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.039+0000 7fd8a933f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a409b0f0 con 0x7fd8a409e1d0 2023-10-01T07:56:26.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.039+0000 7fd8a933f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a409a810 con 0x7fd8a4139170 2023-10-01T07:56:26.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.039+0000 7fd8a27fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd8a409e1d0 0x7fd8a4138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:26.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.039+0000 7fd8a37fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd8a4139170 0x7fd8a413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:26.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.039+0000 7fd8a27fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd8a409e1d0 0x7fd8a4138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49554/0 (socket says 172.21.15.26:49554) 2023-10-01T07:56:26.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.039+0000 7fd8a27fc700 1 -- 172.21.15.26:0/1132816425 learned_addr learned my addr 172.21.15.26:0/1132816425 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:26.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.039+0000 7fd8a27fc700 1 -- 172.21.15.26:0/1132816425 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd8a4139170 msgr2=0x7fd8a413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:26.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.039+0000 7fd8a27fc700 1 --2- 172.21.15.26:0/1132816425 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd8a4139170 0x7fd8a413b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:26.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.039+0000 7fd8a27fc700 1 -- 172.21.15.26:0/1132816425 >> v1:172.21.15.26:6789/0 conn(0x7fd8a409d6f0 legacy=0x7fd8a409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:26.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.039+0000 7fd8a27fc700 1 -- 172.21.15.26:0/1132816425 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a409a470 con 0x7fd8a409e1d0 2023-10-01T07:56:26.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.039+0000 7fd8a37fe700 1 --2- 172.21.15.26:0/1132816425 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd8a4139170 0x7fd8a413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:26.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.040+0000 7fd8a27fc700 1 --2- 172.21.15.26:0/1132816425 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8a409e1d0 0x7fd8a4138c30 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd8980098f0 tx=0x7fd898009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=176e495b356b60a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:26.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.040+0000 7fd8a1ffb700 1 -- 172.21.15.26:0/1132816425 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd898011830 con 0x7fd8a409e1d0 2023-10-01T07:56:26.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.040+0000 7fd8a1ffb700 1 -- 172.21.15.26:0/1132816425 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd898011990 con 0x7fd8a409e1d0 2023-10-01T07:56:26.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.040+0000 7fd8a1ffb700 1 -- 172.21.15.26:0/1132816425 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd898011d20 con 0x7fd8a409e1d0 2023-10-01T07:56:26.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.040+0000 7fd8a933f700 1 -- 172.21.15.26:0/1132816425 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8a409e1d0 msgr2=0x7fd8a4138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:26.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.040+0000 7fd8a933f700 1 --2- 172.21.15.26:0/1132816425 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8a409e1d0 0x7fd8a4138c30 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd8980098f0 tx=0x7fd898009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:26.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.040+0000 7fd8a933f700 1 -- 172.21.15.26:0/1132816425 shutdown_connections 2023-10-01T07:56:26.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.040+0000 7fd8a933f700 1 --2- 172.21.15.26:0/1132816425 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd8a4139170 0x7fd8a413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:26.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.040+0000 7fd8a933f700 1 --2- 172.21.15.26:0/1132816425 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8a409e1d0 0x7fd8a4138c30 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:26.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.040+0000 7fd8a933f700 1 -- 172.21.15.26:0/1132816425 >> 172.21.15.26:0/1132816425 conn(0x7fd8a4066f50 msgr2=0x7fd8a409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:26.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.041+0000 7fd8a933f700 1 -- 172.21.15.26:0/1132816425 shutdown_connections 2023-10-01T07:56:26.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.041+0000 7fd8a933f700 1 -- 172.21.15.26:0/1132816425 wait complete. 2023-10-01T07:56:26.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.042+0000 7fd8a933f700 1 Processor -- start 2023-10-01T07:56:26.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.042+0000 7fd8a933f700 1 -- start start 2023-10-01T07:56:26.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.042+0000 7fd8a933f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8a409d6f0 0x7fd8a41c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:26.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.042+0000 7fd8a933f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd8a409e1d0 0x7fd8a41c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:26.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.042+0000 7fd8a933f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd8a4139170 0x7fd8a411e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:26.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.042+0000 7fd8a933f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a41be250 con 0x7fd8a409d6f0 2023-10-01T07:56:26.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.042+0000 7fd8a933f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a4121fb0 con 0x7fd8a409e1d0 2023-10-01T07:56:26.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.042+0000 7fd8a933f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a409c640 con 0x7fd8a4139170 2023-10-01T07:56:26.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.042+0000 7fd8a2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8a409d6f0 0x7fd8a41c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:26.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.042+0000 7fd8a37fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd8a4139170 0x7fd8a411e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:26.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.042+0000 7fd8a2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8a409d6f0 0x7fd8a41c8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49560/0 (socket says 172.21.15.26:49560) 2023-10-01T07:56:26.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.042+0000 7fd8a37fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd8a4139170 0x7fd8a411e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:33054/0 (socket says 172.21.15.26:33054) 2023-10-01T07:56:26.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.042+0000 7fd8a2ffd700 1 -- 172.21.15.26:0/2719398832 learned_addr learned my addr 172.21.15.26:0/2719398832 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:26.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.042+0000 7fd8a27fc700 1 --2- 172.21.15.26:0/2719398832 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd8a409e1d0 0x7fd8a41c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:26.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.043+0000 7fd8a37fe700 1 -- 172.21.15.26:0/2719398832 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd8a409e1d0 msgr2=0x7fd8a41c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:26.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.043+0000 7fd8a37fe700 1 --2- 172.21.15.26:0/2719398832 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd8a409e1d0 0x7fd8a41c8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:26.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.043+0000 7fd8a37fe700 1 -- 172.21.15.26:0/2719398832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8a409d6f0 msgr2=0x7fd8a41c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:26.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.043+0000 7fd8a37fe700 1 --2- 172.21.15.26:0/2719398832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8a409d6f0 0x7fd8a41c8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:26.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.043+0000 7fd8a37fe700 1 -- 172.21.15.26:0/2719398832 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89c009a70 con 0x7fd8a4139170 2023-10-01T07:56:26.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.043+0000 7fd8a2ffd700 1 --2- 172.21.15.26:0/2719398832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8a409d6f0 0x7fd8a41c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:26.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.043+0000 7fd8a37fe700 1 --2- 172.21.15.26:0/2719398832 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd8a4139170 0x7fd8a411e6e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd89c00efc0 tx=0x7fd89c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:26.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.043+0000 7fd88b7fe700 1 -- 172.21.15.26:0/2719398832 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c00ca90 con 0x7fd8a4139170 2023-10-01T07:56:26.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.043+0000 7fd88b7fe700 1 -- 172.21.15.26:0/2719398832 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89c00f040 con 0x7fd8a4139170 2023-10-01T07:56:26.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.043+0000 7fd8a933f700 1 -- 172.21.15.26:0/2719398832 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd898009550 con 0x7fd8a4139170 2023-10-01T07:56:26.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.043+0000 7fd88b7fe700 1 -- 172.21.15.26:0/2719398832 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c00ce30 con 0x7fd8a4139170 2023-10-01T07:56:26.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.043+0000 7fd8a933f700 1 -- 172.21.15.26:0/2719398832 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8a41345b0 con 0x7fd8a4139170 2023-10-01T07:56:26.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.044+0000 7fd88b7fe700 1 -- 172.21.15.26:0/2719398832 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd89c014480 con 0x7fd8a4139170 2023-10-01T07:56:26.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.044+0000 7fd88b7fe700 1 -- 172.21.15.26:0/2719398832 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd89c03fc20 con 0x7fd8a4139170 2023-10-01T07:56:26.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.044+0000 7fd8a933f700 1 -- 172.21.15.26:0/2719398832 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8a4074ea0 con 0x7fd8a4139170 2023-10-01T07:56:26.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.049+0000 7fd88b7fe700 1 -- 172.21.15.26:0/2719398832 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd89c012930 con 0x7fd8a4139170 2023-10-01T07:56:26.116 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:26.118 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:26.183 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:26.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.259+0000 7f971ff9e700 1 Processor -- start 2023-10-01T07:56:26.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.259+0000 7f971ff9e700 1 -- start start 2023-10-01T07:56:26.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.260+0000 7f971ff9e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f971809d6f0 0x7f971809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:26.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.260+0000 7f971ff9e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f971809e000 0x7f97181339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:26.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.260+0000 7f971ff9e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f971809b120 con 0x7f971809e410 2023-10-01T07:56:26.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.260+0000 7f971ff9e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f971806b460 con 0x7f971809d6f0 2023-10-01T07:56:26.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.260+0000 7f971ff9e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971809a7e0 con 0x7f971809e000 2023-10-01T07:56:26.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.260+0000 7f971d539700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f971809e000 0x7f97181339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:26.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.260+0000 7f971d539700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f971809e000 0x7f97181339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33496/0 (socket says 172.21.15.26:33496) 2023-10-01T07:56:26.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.260+0000 7f971d539700 1 -- 172.21.15.26:0/1352330869 learned_addr learned my addr 172.21.15.26:0/1352330869 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:26.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.260+0000 7f971dd3a700 1 --2- 172.21.15.26:0/1352330869 >> v2:172.21.15.26:3300/0 conn(0x7f971809d6f0 0x7f971809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:26.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.261+0000 7f971d539700 1 -- 172.21.15.26:0/1352330869 >> v2:172.21.15.26:3300/0 conn(0x7f971809d6f0 msgr2=0x7f971809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:26.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.261+0000 7f971d539700 1 --2- 172.21.15.26:0/1352330869 >> v2:172.21.15.26:3300/0 conn(0x7f971809d6f0 0x7f971809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:26.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.261+0000 7f971d539700 1 -- 172.21.15.26:0/1352330869 >> v1:172.21.15.26:6789/0 conn(0x7f971809e410 legacy=0x7f9718133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:26.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.261+0000 7f971d539700 1 -- 172.21.15.26:0/1352330869 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971809a500 con 0x7f971809e000 2023-10-01T07:56:26.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.261+0000 7f971d539700 1 --2- 172.21.15.26:0/1352330869 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f971809e000 0x7f97181339f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9708009920 tx=0x7f9708009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bf4f435edc697f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:26.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.261+0000 7f971cd38700 1 -- 172.21.15.26:0/1352330869 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9708011830 con 0x7f971809e000 2023-10-01T07:56:26.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.261+0000 7f971cd38700 1 -- 172.21.15.26:0/1352330869 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9708011990 con 0x7f971809e000 2023-10-01T07:56:26.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.261+0000 7f971cd38700 1 -- 172.21.15.26:0/1352330869 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9708011d20 con 0x7f971809e000 2023-10-01T07:56:26.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.262+0000 7f971ff9e700 1 -- 172.21.15.26:0/1352330869 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f971809e000 msgr2=0x7f97181339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:26.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.262+0000 7f971ff9e700 1 --2- 172.21.15.26:0/1352330869 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f971809e000 0x7f97181339f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9708009920 tx=0x7f9708009c30 comp rx=0 tx=0).stop 2023-10-01T07:56:26.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.262+0000 7f971ff9e700 1 -- 172.21.15.26:0/1352330869 shutdown_connections 2023-10-01T07:56:26.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.262+0000 7f971ff9e700 1 --2- 172.21.15.26:0/1352330869 >> v2:172.21.15.26:3300/0 conn(0x7f971809d6f0 0x7f971809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:26.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.262+0000 7f971ff9e700 1 --2- 172.21.15.26:0/1352330869 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f971809e000 0x7f97181339f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:26.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.262+0000 7f971ff9e700 1 -- 172.21.15.26:0/1352330869 >> 172.21.15.26:0/1352330869 conn(0x7f9718066f50 msgr2=0x7f971809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:26.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.262+0000 7f971ff9e700 1 -- 172.21.15.26:0/1352330869 shutdown_connections 2023-10-01T07:56:26.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.262+0000 7f971ff9e700 1 -- 172.21.15.26:0/1352330869 wait complete. 2023-10-01T07:56:26.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.263+0000 7f971ff9e700 1 Processor -- start 2023-10-01T07:56:26.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.263+0000 7f971ff9e700 1 -- start start 2023-10-01T07:56:26.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.264+0000 7f971ff9e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f971809d6f0 0x7f9718129f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:26.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.264+0000 7f971ff9e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f971809e000 0x7f971812a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:26.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.264+0000 7f971ff9e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f971809e410 0x7f971812a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:26.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.264+0000 7f971ff9e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971812c0e0 con 0x7f971809d6f0 2023-10-01T07:56:26.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.264+0000 7f971ff9e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9718131470 con 0x7f971809e410 2023-10-01T07:56:26.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.264+0000 7f971ff9e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f971812d4b0 con 0x7f971809e000 2023-10-01T07:56:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.264+0000 7f971e53b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f971809e410 0x7f971812a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.264+0000 7f971dd3a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f971809d6f0 0x7f9718129f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.264+0000 7f971dd3a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f971809d6f0 0x7f9718129f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49580/0 (socket says 172.21.15.26:49580) 2023-10-01T07:56:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.264+0000 7f971e53b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f971809e410 0x7f971812a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33502/0 (socket says 172.21.15.26:33502) 2023-10-01T07:56:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.264+0000 7f971dd3a700 1 -- 172.21.15.26:0/1056313784 learned_addr learned my addr 172.21.15.26:0/1056313784 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.265+0000 7f971dd3a700 1 -- 172.21.15.26:0/1056313784 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f971809e000 msgr2=0x7f971812a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.265+0000 7f971dd3a700 1 --2- 172.21.15.26:0/1056313784 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f971809e000 0x7f971812a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.265+0000 7f971dd3a700 1 -- 172.21.15.26:0/1056313784 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f971809e410 msgr2=0x7f971812a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.265+0000 7f971dd3a700 1 --2- 172.21.15.26:0/1056313784 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f971809e410 0x7f971812a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.265+0000 7f971dd3a700 1 -- 172.21.15.26:0/1056313784 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9708009550 con 0x7f971809d6f0 2023-10-01T07:56:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.265+0000 7f971e53b700 1 --2- 172.21.15.26:0/1056313784 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f971809e410 0x7f971812a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:26.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.265+0000 7f971dd3a700 1 --2- 172.21.15.26:0/1056313784 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f971809d6f0 0x7f9718129f20 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f971400e8a0 tx=0x7f971400ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:26.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.265+0000 7f970e7fc700 1 -- 172.21.15.26:0/1056313784 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9714013680 con 0x7f971809d6f0 2023-10-01T07:56:26.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.265+0000 7f970e7fc700 1 -- 172.21.15.26:0/1056313784 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97140137e0 con 0x7f971809d6f0 2023-10-01T07:56:26.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.265+0000 7f971ff9e700 1 -- 172.21.15.26:0/1056313784 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97180a2460 con 0x7f971809d6f0 2023-10-01T07:56:26.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.265+0000 7f970e7fc700 1 -- 172.21.15.26:0/1056313784 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9714013b50 con 0x7f971809d6f0 2023-10-01T07:56:26.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.265+0000 7f971ff9e700 1 -- 172.21.15.26:0/1056313784 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f971809c710 con 0x7f971809d6f0 2023-10-01T07:56:26.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.266+0000 7f971ff9e700 1 -- 172.21.15.26:0/1056313784 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9718074ea0 con 0x7f971809d6f0 2023-10-01T07:56:26.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.267+0000 7f970e7fc700 1 -- 172.21.15.26:0/1056313784 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9714013cb0 con 0x7f971809d6f0 2023-10-01T07:56:26.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.267+0000 7fcd2af27700 1 Processor -- start 2023-10-01T07:56:26.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.267+0000 7fcd2af27700 1 -- start start 2023-10-01T07:56:26.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.268+0000 7fcd2af27700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd24131810 0x7fcd24131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:26.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.268+0000 7fcd2af27700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcd24099a40 0x7fcd24099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:26.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.268+0000 7fcd2af27700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd2409a850 con 0x7fcd2409a3b0 2023-10-01T07:56:26.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.268+0000 7fcd2af27700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd2409b580 con 0x7fcd24099a40 2023-10-01T07:56:26.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.268+0000 7fcd2af27700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd241313c0 con 0x7fcd24131810 2023-10-01T07:56:26.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.268+0000 7fcd28cc3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd24131810 0x7fcd24131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:26.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.268+0000 7fcd28cc3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd24131810 0x7fcd24131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:33068/0 (socket says 172.21.15.26:33068) 2023-10-01T07:56:26.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.268+0000 7fcd28cc3700 1 -- 172.21.15.26:0/3304313184 learned_addr learned my addr 172.21.15.26:0/3304313184 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:26.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.269+0000 7fcd28cc3700 1 -- 172.21.15.26:0/3304313184 >> v2:172.21.15.26:3300/0 conn(0x7fcd24099a40 msgr2=0x7fcd24099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:26.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.269+0000 7fcd28cc3700 1 --2- 172.21.15.26:0/3304313184 >> v2:172.21.15.26:3300/0 conn(0x7fcd24099a40 0x7fcd24099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:26.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.269+0000 7fcd28cc3700 1 -- 172.21.15.26:0/3304313184 >> v1:172.21.15.26:6789/0 conn(0x7fcd2409a3b0 legacy=0x7fcd24138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:26.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.269+0000 7fcd28cc3700 1 -- 172.21.15.26:0/3304313184 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2406e8c0 con 0x7fcd24131810 2023-10-01T07:56:26.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.269+0000 7fcd28cc3700 1 --2- 172.21.15.26:0/3304313184 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd24131810 0x7fcd24131be0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcd18009920 tx=0x7fcd18009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13bb23da7771828d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:26.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.269+0000 7fcd237fe700 1 -- 172.21.15.26:0/3304313184 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1800ba20 con 0x7fcd24131810 2023-10-01T07:56:26.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.269+0000 7fcd237fe700 1 -- 172.21.15.26:0/3304313184 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1800bb80 con 0x7fcd24131810 2023-10-01T07:56:26.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.269+0000 7fcd237fe700 1 -- 172.21.15.26:0/3304313184 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd18009e70 con 0x7fcd24131810 2023-10-01T07:56:26.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.270+0000 7f970e7fc700 1 -- 172.21.15.26:0/1056313784 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9714024d20 con 0x7f971809d6f0 2023-10-01T07:56:26.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.270+0000 7fcd2af27700 1 -- 172.21.15.26:0/3304313184 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd24131810 msgr2=0x7fcd24131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:26.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.270+0000 7fcd2af27700 1 --2- 172.21.15.26:0/3304313184 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd24131810 0x7fcd24131be0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcd18009920 tx=0x7fcd18009c30 comp rx=0 tx=0).stop 2023-10-01T07:56:26.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.270+0000 7fcd2af27700 1 -- 172.21.15.26:0/3304313184 shutdown_connections 2023-10-01T07:56:26.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.270+0000 7fcd2af27700 1 --2- 172.21.15.26:0/3304313184 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd24131810 0x7fcd24131be0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:26.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.270+0000 7fcd2af27700 1 --2- 172.21.15.26:0/3304313184 >> v2:172.21.15.26:3300/0 conn(0x7fcd24099a40 0x7fcd24099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:26.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.270+0000 7fcd2af27700 1 -- 172.21.15.26:0/3304313184 >> 172.21.15.26:0/3304313184 conn(0x7fcd240a2aa0 msgr2=0x7fcd240a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:26.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.270+0000 7fcd2af27700 1 -- 172.21.15.26:0/3304313184 shutdown_connections 2023-10-01T07:56:26.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.270+0000 7fcd2af27700 1 -- 172.21.15.26:0/3304313184 wait complete. 2023-10-01T07:56:26.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.271+0000 7fd8a933f700 1 -- 172.21.15.26:0/2719398832 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd8a41c9090 con 0x7fd8a4139170 2023-10-01T07:56:26.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.271+0000 7fd88b7fe700 1 -- 172.21.15.26:0/2719398832 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd89c012340 con 0x7fd8a4139170 2023-10-01T07:56:26.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.271+0000 7fcd2af27700 1 Processor -- start 2023-10-01T07:56:26.274 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:26.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.271+0000 7fcd2af27700 1 -- start start 2023-10-01T07:56:26.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.272+0000 7fcd2af27700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd24099a40 0x7fcd24118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:26.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.272+0000 7fcd2af27700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcd2409a3b0 0x7fcd24119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:26.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.272+0000 7fcd2af27700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd24131810 0x7fcd24119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:26.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.272+0000 7fcd2af27700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2411c070 con 0x7fcd24099a40 2023-10-01T07:56:26.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.272+0000 7fcd2af27700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2411b160 con 0x7fcd2409a3b0 2023-10-01T07:56:26.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.272+0000 7fcd2af27700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd240a1b80 con 0x7fcd24131810 2023-10-01T07:56:26.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.272+0000 7fcd23fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcd2409a3b0 0x7fcd24119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:26.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.272+0000 7fcd23fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcd2409a3b0 0x7fcd24119210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33506/0 (socket says 172.21.15.26:33506) 2023-10-01T07:56:26.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.272+0000 7fcd23fff700 1 -- 172.21.15.26:0/1638100840 learned_addr learned my addr 172.21.15.26:0/1638100840 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:26.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.272+0000 7fcd294c4700 1 --2- 172.21.15.26:0/1638100840 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd24131810 0x7fcd24119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:26.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.273+0000 7fcd28cc3700 1 --2- 172.21.15.26:0/1638100840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd24099a40 0x7fcd24118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:26.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.273+0000 7fcd294c4700 1 -- 172.21.15.26:0/1638100840 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcd2409a3b0 msgr2=0x7fcd24119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:26.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.273+0000 7fcd294c4700 1 --2- 172.21.15.26:0/1638100840 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcd2409a3b0 0x7fcd24119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:26.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.273+0000 7fcd294c4700 1 -- 172.21.15.26:0/1638100840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd24099a40 msgr2=0x7fcd24118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:26.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.273+0000 7fcd294c4700 1 --2- 172.21.15.26:0/1638100840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd24099a40 0x7fcd24118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:26.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.273+0000 7fcd294c4700 1 -- 172.21.15.26:0/1638100840 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd18009550 con 0x7fcd24131810 2023-10-01T07:56:26.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.273+0000 7f970e7fc700 1 -- 172.21.15.26:0/1056313784 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9714011350 con 0x7f971809d6f0 2023-10-01T07:56:26.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.274+0000 7fcd294c4700 1 --2- 172.21.15.26:0/1638100840 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd24131810 0x7fcd24119750 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c002200 tx=0x7fcd1c00ce70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:26.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.274+0000 7fcd217fa700 1 -- 172.21.15.26:0/1638100840 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c003c00 con 0x7fcd24131810 2023-10-01T07:56:26.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.274+0000 7fcd217fa700 1 -- 172.21.15.26:0/1638100840 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1c003d60 con 0x7fcd24131810 2023-10-01T07:56:26.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.274+0000 7fcd2af27700 1 -- 172.21.15.26:0/1638100840 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd2406eb00 con 0x7fcd24131810 2023-10-01T07:56:26.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.274+0000 7fcd2af27700 1 -- 172.21.15.26:0/1638100840 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd2411b620 con 0x7fcd24131810 2023-10-01T07:56:26.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.274+0000 7fd8a933f700 1 -- 172.21.15.26:0/2719398832 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd8a4139170 msgr2=0x7fd8a411e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:26.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.274+0000 7fd8a933f700 1 --2- 172.21.15.26:0/2719398832 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd8a4139170 0x7fd8a411e6e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd89c00efc0 tx=0x7fd89c00c3a0 comp rx=0 tx=0).stop 2023-10-01T07:56:26.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.274+0000 7fd8a933f700 1 -- 172.21.15.26:0/2719398832 shutdown_connections 2023-10-01T07:56:26.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.274+0000 7fd8a933f700 1 --2- 172.21.15.26:0/2719398832 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd8a4139170 0x7fd8a411e6e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:26.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.274+0000 7fd8a933f700 1 --2- 172.21.15.26:0/2719398832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8a409d6f0 0x7fd8a41c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:26.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.274+0000 7fd8a933f700 1 --2- 172.21.15.26:0/2719398832 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd8a409e1d0 0x7fd8a41c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:26.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.274+0000 7fd8a933f700 1 -- 172.21.15.26:0/2719398832 >> 172.21.15.26:0/2719398832 conn(0x7fd8a4066f50 msgr2=0x7fd8a4136b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:26.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.275+0000 7fcd217fa700 1 -- 172.21.15.26:0/1638100840 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c00a9f0 con 0x7fcd24131810 2023-10-01T07:56:26.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.275+0000 7fd8a933f700 1 -- 172.21.15.26:0/2719398832 shutdown_connections 2023-10-01T07:56:26.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.275+0000 7fcd217fa700 1 -- 172.21.15.26:0/1638100840 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcd1c00ab90 con 0x7fcd24131810 2023-10-01T07:56:26.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.275+0000 7fcd217fa700 1 -- 172.21.15.26:0/1638100840 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcd1c043410 con 0x7fcd24131810 2023-10-01T07:56:26.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.275+0000 7fcd2af27700 1 -- 172.21.15.26:0/1638100840 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd040052e0 con 0x7fcd24131810 2023-10-01T07:56:26.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.279+0000 7fd8a933f700 1 -- 172.21.15.26:0/2719398832 wait complete. 2023-10-01T07:56:26.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.280+0000 7fcd217fa700 1 -- 172.21.15.26:0/1638100840 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcd1c011560 con 0x7fcd24131810 2023-10-01T07:56:26.294 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:26.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.359+0000 7efe618dc700 1 Processor -- start 2023-10-01T07:56:26.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.359+0000 7efe618dc700 1 -- start start 2023-10-01T07:56:26.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.360+0000 7efe618dc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efe5c09e930 0x7efe5c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:26.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.360+0000 7efe618dc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe5c09f650 0x7efe5c131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:26.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.360+0000 7efe618dc700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe5c070940 con 0x7efe5c09f240 2023-10-01T07:56:26.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.360+0000 7efe618dc700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe5c06fd60 con 0x7efe5c09e930 2023-10-01T07:56:26.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.360+0000 7efe618dc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c06fa80 con 0x7efe5c09f650 2023-10-01T07:56:26.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.360+0000 7efe5b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe5c09f650 0x7efe5c131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:26.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.360+0000 7efe5a7fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7efe5c09f240 0x7efe5c1317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59166/0 (socket says 172.21.15.26:59166) 2023-10-01T07:56:26.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.360+0000 7efe5a7fc700 1 -- 172.21.15.26:0/2544757065 learned_addr learned my addr 172.21.15.26:0/2544757065 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:26.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.360+0000 7efe5affd700 1 --2- 172.21.15.26:0/2544757065 >> v2:172.21.15.26:3300/0 conn(0x7efe5c09e930 0x7efe5c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:26.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.361+0000 7efe5b7fe700 1 -- 172.21.15.26:0/2544757065 >> v2:172.21.15.26:3300/0 conn(0x7efe5c09e930 msgr2=0x7efe5c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:26.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.361+0000 7efe5b7fe700 1 --2- 172.21.15.26:0/2544757065 >> v2:172.21.15.26:3300/0 conn(0x7efe5c09e930 0x7efe5c09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:26.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.361+0000 7efe5b7fe700 1 -- 172.21.15.26:0/2544757065 >> v1:172.21.15.26:6789/0 conn(0x7efe5c09f240 legacy=0x7efe5c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:26.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.361+0000 7efe59ffb700 1 -- 172.21.15.26:0/2544757065 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3016806602 0 0) 0x7efe5c070940 con 0x7efe5c09f240 2023-10-01T07:56:26.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.361+0000 7efe5b7fe700 1 -- 172.21.15.26:0/2544757065 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe5c09fb60 con 0x7efe5c09f650 2023-10-01T07:56:26.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.361+0000 7efe5b7fe700 1 --2- 172.21.15.26:0/2544757065 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe5c09f650 0x7efe5c131f00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efe54009d90 tx=0x7efe5400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abb574ba7d31eabb server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:26.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.361+0000 7efe59ffb700 1 -- 172.21.15.26:0/2544757065 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5400e070 con 0x7efe5c09f650 2023-10-01T07:56:26.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.361+0000 7efe59ffb700 1 -- 172.21.15.26:0/2544757065 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe5400bb20 con 0x7efe5c09f650 2023-10-01T07:56:26.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.361+0000 7efe59ffb700 1 -- 172.21.15.26:0/2544757065 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe54012430 con 0x7efe5c09f650 2023-10-01T07:56:26.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.362+0000 7efe618dc700 1 -- 172.21.15.26:0/2544757065 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe5c09f650 msgr2=0x7efe5c131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:26.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.362+0000 7efe618dc700 1 --2- 172.21.15.26:0/2544757065 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe5c09f650 0x7efe5c131f00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efe54009d90 tx=0x7efe5400b330 comp rx=0 tx=0).stop 2023-10-01T07:56:26.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.362+0000 7efe618dc700 1 -- 172.21.15.26:0/2544757065 shutdown_connections 2023-10-01T07:56:26.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.362+0000 7efe618dc700 1 --2- 172.21.15.26:0/2544757065 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe5c09f650 0x7efe5c131f00 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:26.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.362+0000 7efe618dc700 1 --2- 172.21.15.26:0/2544757065 >> v2:172.21.15.26:3300/0 conn(0x7efe5c09e930 0x7efe5c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:26.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.362+0000 7efe618dc700 1 -- 172.21.15.26:0/2544757065 >> 172.21.15.26:0/2544757065 conn(0x7efe5c0a4210 msgr2=0x7efe5c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:26.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.362+0000 7efe618dc700 1 -- 172.21.15.26:0/2544757065 shutdown_connections 2023-10-01T07:56:26.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.362+0000 7efe618dc700 1 -- 172.21.15.26:0/2544757065 wait complete. 2023-10-01T07:56:26.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.363+0000 7efe618dc700 1 Processor -- start 2023-10-01T07:56:26.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.364+0000 7efe618dc700 1 -- start start 2023-10-01T07:56:26.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.364+0000 7efe618dc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe5c09e930 0x7efe5c1a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:26.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.364+0000 7efe618dc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe5c09f240 0x7efe5c1a4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:26.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.364+0000 7efe618dc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe5c09f650 0x7efe5c1c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:26.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.364+0000 7efe618dc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c1a7250 con 0x7efe5c09e930 2023-10-01T07:56:26.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.364+0000 7efe618dc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c1a6730 con 0x7efe5c09f240 2023-10-01T07:56:26.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.364+0000 7efe618dc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c1a6f90 con 0x7efe5c09f650 2023-10-01T07:56:26.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.365+0000 7efe5affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe5c09e930 0x7efe5c1a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:26.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.365+0000 7efe5affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe5c09e930 0x7efe5c1a43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49624/0 (socket says 172.21.15.26:49624) 2023-10-01T07:56:26.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.365+0000 7efe5affd700 1 -- 172.21.15.26:0/1590418123 learned_addr learned my addr 172.21.15.26:0/1590418123 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:26.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.365+0000 7efe5a7fc700 1 --2- 172.21.15.26:0/1590418123 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe5c09f240 0x7efe5c1a4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:26.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.365+0000 7efe5b7fe700 1 --2- 172.21.15.26:0/1590418123 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe5c09f650 0x7efe5c1c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:26.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.365+0000 7efe5affd700 1 -- 172.21.15.26:0/1590418123 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe5c09f650 msgr2=0x7efe5c1c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:26.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.365+0000 7efe5affd700 1 --2- 172.21.15.26:0/1590418123 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe5c09f650 0x7efe5c1c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:26.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.365+0000 7efe5affd700 1 -- 172.21.15.26:0/1590418123 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe5c09f240 msgr2=0x7efe5c1a4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:26.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.365+0000 7efe5affd700 1 --2- 172.21.15.26:0/1590418123 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe5c09f240 0x7efe5c1a4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:26.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.365+0000 7efe5affd700 1 -- 172.21.15.26:0/1590418123 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe54009a70 con 0x7efe5c09e930 2023-10-01T07:56:26.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.365+0000 7efe5affd700 1 --2- 172.21.15.26:0/1590418123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe5c09e930 0x7efe5c1a43d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00e9b0 tx=0x7efe4c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:26.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.365+0000 7efe43fff700 1 -- 172.21.15.26:0/1590418123 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4c009710 con 0x7efe5c09e930 2023-10-01T07:56:26.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.365+0000 7efe43fff700 1 -- 172.21.15.26:0/1590418123 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4c00ee50 con 0x7efe5c09e930 2023-10-01T07:56:26.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.365+0000 7efe618dc700 1 -- 172.21.15.26:0/1590418123 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe5c0a0190 con 0x7efe5c09e930 2023-10-01T07:56:26.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.365+0000 7efe43fff700 1 -- 172.21.15.26:0/1590418123 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4c00ca50 con 0x7efe5c09e930 2023-10-01T07:56:26.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.366+0000 7efe618dc700 1 -- 172.21.15.26:0/1590418123 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe5c1a6290 con 0x7efe5c09e930 2023-10-01T07:56:26.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.366+0000 7efe43fff700 1 -- 172.21.15.26:0/1590418123 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efe4c00cbb0 con 0x7efe5c09e930 2023-10-01T07:56:26.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.367+0000 7efe43fff700 1 -- 172.21.15.26:0/1590418123 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efe4c03f710 con 0x7efe5c09e930 2023-10-01T07:56:26.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.367+0000 7efe618dc700 1 -- 172.21.15.26:0/1590418123 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe5c1a6ca0 con 0x7efe5c09e930 2023-10-01T07:56:26.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.372+0000 7efe43fff700 1 -- 172.21.15.26:0/1590418123 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efe4c021080 con 0x7efe5c09e930 2023-10-01T07:56:26.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.490+0000 7fcd2af27700 1 -- 172.21.15.26:0/1638100840 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcd04005590 con 0x7fcd24131810 2023-10-01T07:56:26.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.491+0000 7fcd217fa700 1 -- 172.21.15.26:0/1638100840 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcd1c017340 con 0x7fcd24131810 2023-10-01T07:56:26.491 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:26.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.493+0000 7fcd2af27700 1 -- 172.21.15.26:0/1638100840 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd24131810 msgr2=0x7fcd24119750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.493+0000 7fcd2af27700 1 --2- 172.21.15.26:0/1638100840 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd24131810 0x7fcd24119750 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c002200 tx=0x7fcd1c00ce70 comp rx=0 tx=0).stop 2023-10-01T07:56:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.493+0000 7fcd2af27700 1 -- 172.21.15.26:0/1638100840 shutdown_connections 2023-10-01T07:56:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.493+0000 7fcd2af27700 1 --2- 172.21.15.26:0/1638100840 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd24131810 0x7fcd24119750 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.493+0000 7fcd2af27700 1 --2- 172.21.15.26:0/1638100840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd24099a40 0x7fcd24118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.493+0000 7fcd2af27700 1 --2- 172.21.15.26:0/1638100840 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcd2409a3b0 0x7fcd24119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.493+0000 7fcd2af27700 1 -- 172.21.15.26:0/1638100840 >> 172.21.15.26:0/1638100840 conn(0x7fcd240a2aa0 msgr2=0x7fcd2412e760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.493+0000 7fcd2af27700 1 -- 172.21.15.26:0/1638100840 shutdown_connections 2023-10-01T07:56:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.493+0000 7fcd2af27700 1 -- 172.21.15.26:0/1638100840 wait complete. 2023-10-01T07:56:26.507 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:26.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.511+0000 7f971ff9e700 1 -- 172.21.15.26:0/1056313784 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f97180724d0 con 0x7f971809d6f0 2023-10-01T07:56:26.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.511+0000 7f970e7fc700 1 -- 172.21.15.26:0/1056313784 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9714021030 con 0x7f971809d6f0 2023-10-01T07:56:26.512 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:26.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.514+0000 7f971ff9e700 1 -- 172.21.15.26:0/1056313784 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f971809d6f0 msgr2=0x7f9718129f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:26.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.514+0000 7f971ff9e700 1 --2- 172.21.15.26:0/1056313784 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f971809d6f0 0x7f9718129f20 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f971400e8a0 tx=0x7f971400ebb0 comp rx=0 tx=0).stop 2023-10-01T07:56:26.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.514+0000 7f971ff9e700 1 -- 172.21.15.26:0/1056313784 shutdown_connections 2023-10-01T07:56:26.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.514+0000 7f971ff9e700 1 --2- 172.21.15.26:0/1056313784 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f971809e410 0x7f971812a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:26.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.514+0000 7f971ff9e700 1 --2- 172.21.15.26:0/1056313784 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f971809d6f0 0x7f9718129f20 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:26.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.514+0000 7f971ff9e700 1 --2- 172.21.15.26:0/1056313784 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f971809e000 0x7f971812a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:26.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.514+0000 7f971ff9e700 1 -- 172.21.15.26:0/1056313784 >> 172.21.15.26:0/1056313784 conn(0x7f9718066f50 msgr2=0x7f97181276d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:26.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.514+0000 7f971ff9e700 1 -- 172.21.15.26:0/1056313784 shutdown_connections 2023-10-01T07:56:26.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.514+0000 7f971ff9e700 1 -- 172.21.15.26:0/1056313784 wait complete. 2023-10-01T07:56:26.528 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:26.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.579+0000 7efe618dc700 1 -- 172.21.15.26:0/1590418123 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efe5c074ea0 con 0x7efe5c09e930 2023-10-01T07:56:26.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.579+0000 7efe43fff700 1 -- 172.21.15.26:0/1590418123 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efe4c017020 con 0x7efe5c09e930 2023-10-01T07:56:26.580 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:26.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.582+0000 7efe618dc700 1 -- 172.21.15.26:0/1590418123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe5c09e930 msgr2=0x7efe5c1a43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:26.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.582+0000 7efe618dc700 1 --2- 172.21.15.26:0/1590418123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe5c09e930 0x7efe5c1a43d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00e9b0 tx=0x7efe4c00ecc0 comp rx=0 tx=0).stop 2023-10-01T07:56:26.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.582+0000 7efe618dc700 1 -- 172.21.15.26:0/1590418123 shutdown_connections 2023-10-01T07:56:26.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.582+0000 7efe618dc700 1 --2- 172.21.15.26:0/1590418123 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe5c09f650 0x7efe5c1c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:26.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.582+0000 7efe618dc700 1 --2- 172.21.15.26:0/1590418123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe5c09e930 0x7efe5c1a43d0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:26.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.582+0000 7efe618dc700 1 --2- 172.21.15.26:0/1590418123 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe5c09f240 0x7efe5c1a4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:26.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.582+0000 7efe618dc700 1 -- 172.21.15.26:0/1590418123 >> 172.21.15.26:0/1590418123 conn(0x7efe5c0a4210 msgr2=0x7efe5c1b8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:26.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.582+0000 7efe618dc700 1 -- 172.21.15.26:0/1590418123 shutdown_connections 2023-10-01T07:56:26.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:26.582+0000 7efe618dc700 1 -- 172.21.15.26:0/1590418123 wait complete. 2023-10-01T07:56:26.596 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:27.295 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:27.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.440+0000 7faa40856700 1 Processor -- start 2023-10-01T07:56:27.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.440+0000 7faa40856700 1 -- start start 2023-10-01T07:56:27.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.441+0000 7faa40856700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa3c09d6f0 0x7faa3c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:27.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.441+0000 7faa40856700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa3c09e410 0x7faa3c130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:27.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.441+0000 7faa40856700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa3c09f130 con 0x7faa3c09e000 2023-10-01T07:56:27.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.441+0000 7faa40856700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa3c09f520 con 0x7faa3c09d6f0 2023-10-01T07:56:27.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.441+0000 7faa40856700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa3c09e930 con 0x7faa3c09e410 2023-10-01T07:56:27.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.441+0000 7faa3a59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa3c09d6f0 0x7faa3c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:27.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.441+0000 7faa3ad9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa3c09e410 0x7faa3c130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:27.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.441+0000 7faa39d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7faa3c09e000 0x7faa3c130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59172/0 (socket says 172.21.15.26:59172) 2023-10-01T07:56:27.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.441+0000 7faa3ad9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa3c09e410 0x7faa3c130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:33112/0 (socket says 172.21.15.26:33112) 2023-10-01T07:56:27.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.441+0000 7faa3a59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa3c09d6f0 0x7faa3c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33522/0 (socket says 172.21.15.26:33522) 2023-10-01T07:56:27.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.441+0000 7faa3ad9d700 1 -- 172.21.15.26:0/3022245669 learned_addr learned my addr 172.21.15.26:0/3022245669 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:27.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.442+0000 7faa3ad9d700 1 -- 172.21.15.26:0/3022245669 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa3c09d6f0 msgr2=0x7faa3c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:27.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.442+0000 7faa3ad9d700 1 --2- 172.21.15.26:0/3022245669 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa3c09d6f0 0x7faa3c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.442+0000 7faa3ad9d700 1 -- 172.21.15.26:0/3022245669 >> v1:172.21.15.26:6789/0 conn(0x7faa3c09e000 legacy=0x7faa3c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:27.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.442+0000 7faa3ad9d700 1 -- 172.21.15.26:0/3022245669 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa3c09b2d0 con 0x7faa3c09e410 2023-10-01T07:56:27.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.442+0000 7faa3959a700 1 -- 172.21.15.26:0/3022245669 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1991128770 0 0) 0x7faa3c09f130 con 0x7faa3c09e000 2023-10-01T07:56:27.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.442+0000 7faa3a59c700 1 --2- 172.21.15.26:0/3022245669 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa3c09d6f0 0x7faa3c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:27.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.442+0000 7faa3ad9d700 1 --2- 172.21.15.26:0/3022245669 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa3c09e410 0x7faa3c130d70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7faa34009e80 tx=0x7faa3400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bd888de9aa26e26 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:27.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.442+0000 7faa3959a700 1 -- 172.21.15.26:0/3022245669 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3400e070 con 0x7faa3c09e410 2023-10-01T07:56:27.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.442+0000 7faa3959a700 1 -- 172.21.15.26:0/3022245669 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3400b910 con 0x7faa3c09e410 2023-10-01T07:56:27.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.442+0000 7faa3959a700 1 -- 172.21.15.26:0/3022245669 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3400bcc0 con 0x7faa3c09e410 2023-10-01T07:56:27.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.443+0000 7faa40856700 1 -- 172.21.15.26:0/3022245669 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa3c09e410 msgr2=0x7faa3c130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:27.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.443+0000 7faa40856700 1 --2- 172.21.15.26:0/3022245669 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa3c09e410 0x7faa3c130d70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7faa34009e80 tx=0x7faa3400b330 comp rx=0 tx=0).stop 2023-10-01T07:56:27.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.443+0000 7faa40856700 1 -- 172.21.15.26:0/3022245669 shutdown_connections 2023-10-01T07:56:27.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.443+0000 7faa40856700 1 --2- 172.21.15.26:0/3022245669 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa3c09e410 0x7faa3c130d70 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.443+0000 7faa40856700 1 --2- 172.21.15.26:0/3022245669 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa3c09d6f0 0x7faa3c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.443+0000 7faa40856700 1 -- 172.21.15.26:0/3022245669 >> 172.21.15.26:0/3022245669 conn(0x7faa3c066f50 msgr2=0x7faa3c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:27.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.443+0000 7faa40856700 1 -- 172.21.15.26:0/3022245669 shutdown_connections 2023-10-01T07:56:27.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.443+0000 7faa40856700 1 -- 172.21.15.26:0/3022245669 wait complete. 2023-10-01T07:56:27.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.444+0000 7faa40856700 1 Processor -- start 2023-10-01T07:56:27.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.444+0000 7faa40856700 1 -- start start 2023-10-01T07:56:27.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.444+0000 7faa40856700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa3c09d6f0 0x7faa3c06e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:27.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.444+0000 7faa40856700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa3c09e000 0x7faa3c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:27.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.444+0000 7faa40856700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa3c09e410 0x7faa3c06f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:27.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.444+0000 7faa40856700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa3c125c90 con 0x7faa3c09d6f0 2023-10-01T07:56:27.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.444+0000 7faa40856700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa3c124fc0 con 0x7faa3c09e410 2023-10-01T07:56:27.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.444+0000 7faa40856700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa3c0a1b80 con 0x7faa3c09e000 2023-10-01T07:56:27.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.444+0000 7faa3a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa3c09d6f0 0x7faa3c06e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:27.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.445+0000 7faa39d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa3c09e000 0x7faa3c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:27.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.445+0000 7faa3a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa3c09d6f0 0x7faa3c06e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49628/0 (socket says 172.21.15.26:49628) 2023-10-01T07:56:27.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.445+0000 7faa3a59c700 1 -- 172.21.15.26:0/4281188156 learned_addr learned my addr 172.21.15.26:0/4281188156 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:27.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.445+0000 7faa3ad9d700 1 --2- 172.21.15.26:0/4281188156 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa3c09e410 0x7faa3c06f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:27.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.445+0000 7faa3a59c700 1 -- 172.21.15.26:0/4281188156 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa3c09e000 msgr2=0x7faa3c06edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:27.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.445+0000 7faa3a59c700 1 --2- 172.21.15.26:0/4281188156 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa3c09e000 0x7faa3c06edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.445+0000 7faa3a59c700 1 -- 172.21.15.26:0/4281188156 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa3c09e410 msgr2=0x7faa3c06f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:27.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.445+0000 7faa3a59c700 1 --2- 172.21.15.26:0/4281188156 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa3c09e410 0x7faa3c06f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.445+0000 7faa3a59c700 1 -- 172.21.15.26:0/4281188156 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa2c0094a0 con 0x7faa3c09d6f0 2023-10-01T07:56:27.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.445+0000 7faa3ad9d700 1 --2- 172.21.15.26:0/4281188156 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa3c09e410 0x7faa3c06f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:27.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.445+0000 7faa39d9b700 1 --2- 172.21.15.26:0/4281188156 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa3c09e000 0x7faa3c06edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:27.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.445+0000 7faa3a59c700 1 --2- 172.21.15.26:0/4281188156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa3c09d6f0 0x7faa3c06e870 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7faa2c00ebe0 tx=0x7faa2c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:27.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.445+0000 7faa2affd700 1 -- 172.21.15.26:0/4281188156 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2c00c850 con 0x7faa3c09d6f0 2023-10-01T07:56:27.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.445+0000 7faa2affd700 1 -- 172.21.15.26:0/4281188156 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2c00c9b0 con 0x7faa3c09d6f0 2023-10-01T07:56:27.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.445+0000 7faa40856700 1 -- 172.21.15.26:0/4281188156 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa34009b30 con 0x7faa3c09d6f0 2023-10-01T07:56:27.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.445+0000 7faa2affd700 1 -- 172.21.15.26:0/4281188156 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2c00cd40 con 0x7faa3c09d6f0 2023-10-01T07:56:27.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.445+0000 7faa40856700 1 -- 172.21.15.26:0/4281188156 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa3c1244d0 con 0x7faa3c09d6f0 2023-10-01T07:56:27.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.446+0000 7faa2affd700 1 -- 172.21.15.26:0/4281188156 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faa2c013470 con 0x7faa3c09d6f0 2023-10-01T07:56:27.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.446+0000 7faa2affd700 1 -- 172.21.15.26:0/4281188156 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faa2c03f7a0 con 0x7faa3c09d6f0 2023-10-01T07:56:27.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.446+0000 7faa40856700 1 -- 172.21.15.26:0/4281188156 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa3c074ea0 con 0x7faa3c09d6f0 2023-10-01T07:56:27.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.451+0000 7faa2affd700 1 -- 172.21.15.26:0/4281188156 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faa2c013720 con 0x7faa3c09d6f0 2023-10-01T07:56:27.508 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:27.530 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:27.597 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:27.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.650+0000 7f12748a1700 1 Processor -- start 2023-10-01T07:56:27.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.650+0000 7f12748a1700 1 -- start start 2023-10-01T07:56:27.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.651+0000 7f12748a1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f127009e1d0 0x7f1270138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:27.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.651+0000 7f12748a1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1270139170 0x7f127013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:27.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.651+0000 7f12748a1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f127009b120 con 0x7f127009d6f0 2023-10-01T07:56:27.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.651+0000 7f12748a1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f127006b460 con 0x7f1270139170 2023-10-01T07:56:27.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.651+0000 7f12748a1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f127009a7e0 con 0x7f127009e1d0 2023-10-01T07:56:27.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.652+0000 7f126dd9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f127009e1d0 0x7f1270138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:27.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.652+0000 7f126dd9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f127009e1d0 0x7f1270138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:33120/0 (socket says 172.21.15.26:33120) 2023-10-01T07:56:27.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.652+0000 7f126dd9b700 1 -- 172.21.15.26:0/2319615977 learned_addr learned my addr 172.21.15.26:0/2319615977 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:27.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.652+0000 7f126ed9d700 1 --2- 172.21.15.26:0/2319615977 >> v2:172.21.15.26:3300/0 conn(0x7f1270139170 0x7f127013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:27.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.652+0000 7f126dd9b700 1 -- 172.21.15.26:0/2319615977 >> v2:172.21.15.26:3300/0 conn(0x7f1270139170 msgr2=0x7f127013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:27.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.652+0000 7f126dd9b700 1 --2- 172.21.15.26:0/2319615977 >> v2:172.21.15.26:3300/0 conn(0x7f1270139170 0x7f127013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.652+0000 7f126dd9b700 1 -- 172.21.15.26:0/2319615977 >> v1:172.21.15.26:6789/0 conn(0x7f127009d6f0 legacy=0x7f127009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:27.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.652+0000 7f126dd9b700 1 -- 172.21.15.26:0/2319615977 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f127009a500 con 0x7f127009e1d0 2023-10-01T07:56:27.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.652+0000 7f126dd9b700 1 --2- 172.21.15.26:0/2319615977 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f127009e1d0 0x7f1270138c30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1264009920 tx=0x7f1264009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b51126789da78f40 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:27.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.652+0000 7f126d59a700 1 -- 172.21.15.26:0/2319615977 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1264011830 con 0x7f127009e1d0 2023-10-01T07:56:27.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.653+0000 7f126d59a700 1 -- 172.21.15.26:0/2319615977 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1264011990 con 0x7f127009e1d0 2023-10-01T07:56:27.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.653+0000 7f126d59a700 1 -- 172.21.15.26:0/2319615977 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1264011d20 con 0x7f127009e1d0 2023-10-01T07:56:27.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.653+0000 7f12748a1700 1 -- 172.21.15.26:0/2319615977 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f127009e1d0 msgr2=0x7f1270138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:27.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.653+0000 7f12748a1700 1 --2- 172.21.15.26:0/2319615977 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f127009e1d0 0x7f1270138c30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1264009920 tx=0x7f1264009c30 comp rx=0 tx=0).stop 2023-10-01T07:56:27.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.653+0000 7f12748a1700 1 -- 172.21.15.26:0/2319615977 shutdown_connections 2023-10-01T07:56:27.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.653+0000 7f12748a1700 1 --2- 172.21.15.26:0/2319615977 >> v2:172.21.15.26:3300/0 conn(0x7f1270139170 0x7f127013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.653+0000 7f12748a1700 1 --2- 172.21.15.26:0/2319615977 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f127009e1d0 0x7f1270138c30 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.653+0000 7f12748a1700 1 -- 172.21.15.26:0/2319615977 >> 172.21.15.26:0/2319615977 conn(0x7f1270066f50 msgr2=0x7f127009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:27.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.654+0000 7f12748a1700 1 -- 172.21.15.26:0/2319615977 shutdown_connections 2023-10-01T07:56:27.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.654+0000 7f12748a1700 1 -- 172.21.15.26:0/2319615977 wait complete. 2023-10-01T07:56:27.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.655+0000 7f12748a1700 1 Processor -- start 2023-10-01T07:56:27.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.655+0000 7f12748a1700 1 -- start start 2023-10-01T07:56:27.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.655+0000 7f12748a1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f127009d6f0 0x7f12701c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:27.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.655+0000 7f12748a1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f127009e1d0 0x7f12701c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:27.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.655+0000 7f12748a1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1270139170 0x7f12701c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:27.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.655+0000 7f12748a1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1270122650 con 0x7f127009e1d0 2023-10-01T07:56:27.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.655+0000 7f12748a1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1270120830 con 0x7f1270139170 2023-10-01T07:56:27.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.655+0000 7f12748a1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1270072690 con 0x7f127009d6f0 2023-10-01T07:56:27.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.656+0000 7f126ed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1270139170 0x7f12701c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:27.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.656+0000 7f126ed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1270139170 0x7f12701c8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33538/0 (socket says 172.21.15.26:33538) 2023-10-01T07:56:27.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.656+0000 7f126ed9d700 1 -- 172.21.15.26:0/196188259 learned_addr learned my addr 172.21.15.26:0/196188259 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:27.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.656+0000 7f126dd9b700 1 --2- 172.21.15.26:0/196188259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f127009e1d0 0x7f12701c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:27.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.656+0000 7f126e59c700 1 --2- 172.21.15.26:0/196188259 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f127009d6f0 0x7f12701c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:27.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.656+0000 7f126ed9d700 1 -- 172.21.15.26:0/196188259 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f127009d6f0 msgr2=0x7f12701c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:27.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.656+0000 7f126ed9d700 1 --2- 172.21.15.26:0/196188259 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f127009d6f0 0x7f12701c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.656+0000 7f126ed9d700 1 -- 172.21.15.26:0/196188259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f127009e1d0 msgr2=0x7f12701c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:27.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.656+0000 7f126ed9d700 1 --2- 172.21.15.26:0/196188259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f127009e1d0 0x7f12701c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.656+0000 7f126ed9d700 1 -- 172.21.15.26:0/196188259 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1264009550 con 0x7f1270139170 2023-10-01T07:56:27.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.656+0000 7f126ed9d700 1 --2- 172.21.15.26:0/196188259 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1270139170 0x7f12701c8ee0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f126800efc0 tx=0x7f126800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:27.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.657+0000 7f125effd700 1 -- 172.21.15.26:0/196188259 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1268009ea0 con 0x7f1270139170 2023-10-01T07:56:27.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.657+0000 7f125effd700 1 -- 172.21.15.26:0/196188259 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126800f040 con 0x7f1270139170 2023-10-01T07:56:27.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.657+0000 7f125effd700 1 -- 172.21.15.26:0/196188259 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1268014480 con 0x7f1270139170 2023-10-01T07:56:27.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.657+0000 7f12748a1700 1 -- 172.21.15.26:0/196188259 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f127009c710 con 0x7f1270139170 2023-10-01T07:56:27.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.657+0000 7f12748a1700 1 -- 172.21.15.26:0/196188259 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1270122080 con 0x7f1270139170 2023-10-01T07:56:27.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.658+0000 7f12748a1700 1 -- 172.21.15.26:0/196188259 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1270072290 con 0x7f1270139170 2023-10-01T07:56:27.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.659+0000 7f125effd700 1 -- 172.21.15.26:0/196188259 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f12680145e0 con 0x7f1270139170 2023-10-01T07:56:27.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.659+0000 7f125effd700 1 -- 172.21.15.26:0/196188259 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1268014890 con 0x7f1270139170 2023-10-01T07:56:27.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.664+0000 7faa40856700 1 -- 172.21.15.26:0/4281188156 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7faa3c125970 con 0x7faa3c09d6f0 2023-10-01T07:56:27.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.664+0000 7faa2affd700 1 -- 172.21.15.26:0/4281188156 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faa2c021030 con 0x7faa3c09d6f0 2023-10-01T07:56:27.665 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:27.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.666+0000 7f125effd700 1 -- 172.21.15.26:0/196188259 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1268045060 con 0x7f1270139170 2023-10-01T07:56:27.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.668+0000 7faa40856700 1 -- 172.21.15.26:0/4281188156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa3c09d6f0 msgr2=0x7faa3c06e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:27.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.668+0000 7faa40856700 1 --2- 172.21.15.26:0/4281188156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa3c09d6f0 0x7faa3c06e870 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7faa2c00ebe0 tx=0x7faa2c00eef0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.668+0000 7faa40856700 1 -- 172.21.15.26:0/4281188156 shutdown_connections 2023-10-01T07:56:27.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.668+0000 7faa40856700 1 --2- 172.21.15.26:0/4281188156 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa3c09e410 0x7faa3c06f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.668+0000 7faa40856700 1 --2- 172.21.15.26:0/4281188156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa3c09d6f0 0x7faa3c06e870 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.668+0000 7faa40856700 1 --2- 172.21.15.26:0/4281188156 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa3c09e000 0x7faa3c06edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.668+0000 7faa40856700 1 -- 172.21.15.26:0/4281188156 >> 172.21.15.26:0/4281188156 conn(0x7faa3c066f50 msgr2=0x7faa3c071000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:27.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.668+0000 7faa40856700 1 -- 172.21.15.26:0/4281188156 shutdown_connections 2023-10-01T07:56:27.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.668+0000 7faa40856700 1 -- 172.21.15.26:0/4281188156 wait complete. 2023-10-01T07:56:27.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:27.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.706+0000 7faa2cb1e700 1 Processor -- start 2023-10-01T07:56:27.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.706+0000 7faa2cb1e700 1 -- start start 2023-10-01T07:56:27.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.706+0000 7faa2cb1e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa280a0a30 0x7faa280a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:27.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.707+0000 7faa2cb1e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa2809d630 0x7faa280a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:27.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.707+0000 7faa2cb1e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7faa28133930 0x7faa28133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:27.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.707+0000 7faa2cb1e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa280a2a70 con 0x7faa28133930 2023-10-01T07:56:27.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.707+0000 7faa2cb1e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa280a01d0 con 0x7faa2809d630 2023-10-01T07:56:27.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.707+0000 7faa2cb1e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa2809e2b0 con 0x7faa280a0a30 2023-10-01T07:56:27.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.707+0000 7faa25d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa2809d630 0x7faa280a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:27.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.707+0000 7faa25d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa2809d630 0x7faa280a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33548/0 (socket says 172.21.15.26:33548) 2023-10-01T07:56:27.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.707+0000 7faa25d9b700 1 -- 172.21.15.26:0/2943467277 learned_addr learned my addr 172.21.15.26:0/2943467277 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:27.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.707+0000 7faa26d9d700 1 --2- 172.21.15.26:0/2943467277 >> v2:172.21.15.26:3300/0 conn(0x7faa28133930 0x7faa28133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:27.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.707+0000 7faa2659c700 1 --2- 172.21.15.26:0/2943467277 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa280a0a30 0x7faa280a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:27.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.707+0000 7faa25d9b700 1 -- 172.21.15.26:0/2943467277 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa280a0a30 msgr2=0x7faa280a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:27.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.707+0000 7faa25d9b700 1 --2- 172.21.15.26:0/2943467277 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa280a0a30 0x7faa280a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.707+0000 7faa25d9b700 1 -- 172.21.15.26:0/2943467277 >> v2:172.21.15.26:3300/0 conn(0x7faa28133930 msgr2=0x7faa28133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:27.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.707+0000 7faa25d9b700 1 --2- 172.21.15.26:0/2943467277 >> v2:172.21.15.26:3300/0 conn(0x7faa28133930 0x7faa28133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.707+0000 7faa25d9b700 1 -- 172.21.15.26:0/2943467277 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa2809dc50 con 0x7faa2809d630 2023-10-01T07:56:27.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.707+0000 7faa26d9d700 1 --2- 172.21.15.26:0/2943467277 >> v2:172.21.15.26:3300/0 conn(0x7faa28133930 0x7faa28133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:27.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.707+0000 7faa25d9b700 1 --2- 172.21.15.26:0/2943467277 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa2809d630 0x7faa280a1340 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7faa1c0098f0 tx=0x7faa1c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e2e52f40dd78933 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:27.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.708+0000 7faa2559a700 1 -- 172.21.15.26:0/2943467277 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1c011830 con 0x7faa2809d630 2023-10-01T07:56:27.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.708+0000 7faa2559a700 1 -- 172.21.15.26:0/2943467277 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa1c011990 con 0x7faa2809d630 2023-10-01T07:56:27.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.708+0000 7faa2559a700 1 -- 172.21.15.26:0/2943467277 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1c011d20 con 0x7faa2809d630 2023-10-01T07:56:27.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.708+0000 7faa2cb1e700 1 -- 172.21.15.26:0/2943467277 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa2809d630 msgr2=0x7faa280a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:27.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.708+0000 7faa2cb1e700 1 --2- 172.21.15.26:0/2943467277 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa2809d630 0x7faa280a1340 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7faa1c0098f0 tx=0x7faa1c009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:27.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.708+0000 7faa2cb1e700 1 -- 172.21.15.26:0/2943467277 shutdown_connections 2023-10-01T07:56:27.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.708+0000 7faa2cb1e700 1 --2- 172.21.15.26:0/2943467277 >> v2:172.21.15.26:3300/0 conn(0x7faa28133930 0x7faa28133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.708+0000 7faa2cb1e700 1 --2- 172.21.15.26:0/2943467277 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa280a0a30 0x7faa280a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.708+0000 7faa2cb1e700 1 --2- 172.21.15.26:0/2943467277 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa2809d630 0x7faa280a1340 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.709+0000 7faa2cb1e700 1 -- 172.21.15.26:0/2943467277 >> 172.21.15.26:0/2943467277 conn(0x7faa280a3050 msgr2=0x7faa280a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:27.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.709+0000 7faa2cb1e700 1 -- 172.21.15.26:0/2943467277 shutdown_connections 2023-10-01T07:56:27.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.709+0000 7faa2cb1e700 1 -- 172.21.15.26:0/2943467277 wait complete. 2023-10-01T07:56:27.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.710+0000 7faa2cb1e700 1 Processor -- start 2023-10-01T07:56:27.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.710+0000 7faa2cb1e700 1 -- start start 2023-10-01T07:56:27.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.710+0000 7faa2cb1e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa2809d630 0x7faa2811f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:27.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.710+0000 7faa2cb1e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa280a0a30 0x7faa2811fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:27.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.710+0000 7faa2cb1e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa28133930 0x7faa281c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:27.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.710+0000 7faa2cb1e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa280a0410 con 0x7faa28133930 2023-10-01T07:56:27.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.710+0000 7faa2cb1e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa28122640 con 0x7faa280a0a30 2023-10-01T07:56:27.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.710+0000 7faa2cb1e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa2811ef20 con 0x7faa2809d630 2023-10-01T07:56:27.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.711+0000 7faa2659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa2809d630 0x7faa2811f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:27.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.711+0000 7faa26d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa28133930 0x7faa281c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:27.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.711+0000 7faa2659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa2809d630 0x7faa2811f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:33140/0 (socket says 172.21.15.26:33140) 2023-10-01T07:56:27.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.711+0000 7faa26d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa28133930 0x7faa281c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49654/0 (socket says 172.21.15.26:49654) 2023-10-01T07:56:27.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.711+0000 7faa2659c700 1 -- 172.21.15.26:0/4024475160 learned_addr learned my addr 172.21.15.26:0/4024475160 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:27.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.711+0000 7faa25d9b700 1 --2- 172.21.15.26:0/4024475160 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa280a0a30 0x7faa2811fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:27.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.711+0000 7faa25d9b700 1 -- 172.21.15.26:0/4024475160 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa2809d630 msgr2=0x7faa2811f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:27.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.711+0000 7faa25d9b700 1 --2- 172.21.15.26:0/4024475160 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa2809d630 0x7faa2811f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.711+0000 7faa25d9b700 1 -- 172.21.15.26:0/4024475160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa28133930 msgr2=0x7faa281c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:27.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.711+0000 7faa25d9b700 1 --2- 172.21.15.26:0/4024475160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa28133930 0x7faa281c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.711+0000 7faa25d9b700 1 -- 172.21.15.26:0/4024475160 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa20009a70 con 0x7faa280a0a30 2023-10-01T07:56:27.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.711+0000 7faa26d9d700 1 --2- 172.21.15.26:0/4024475160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa28133930 0x7faa281c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:27.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.711+0000 7faa2659c700 1 --2- 172.21.15.26:0/4024475160 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa2809d630 0x7faa2811f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:27.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.711+0000 7faa25d9b700 1 --2- 172.21.15.26:0/4024475160 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa280a0a30 0x7faa2811fa00 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7faa1c016000 tx=0x7faa1c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:27.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.711+0000 7faa16ffd700 1 -- 172.21.15.26:0/4024475160 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1c004240 con 0x7faa280a0a30 2023-10-01T07:56:27.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.712+0000 7faa16ffd700 1 -- 172.21.15.26:0/4024475160 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa1c01f070 con 0x7faa280a0a30 2023-10-01T07:56:27.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.712+0000 7faa2cb1e700 1 -- 172.21.15.26:0/4024475160 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa1c009550 con 0x7faa280a0a30 2023-10-01T07:56:27.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.712+0000 7faa16ffd700 1 -- 172.21.15.26:0/4024475160 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1c0036a0 con 0x7faa280a0a30 2023-10-01T07:56:27.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.712+0000 7faa2cb1e700 1 -- 172.21.15.26:0/4024475160 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa28121fa0 con 0x7faa280a0a30 2023-10-01T07:56:27.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.713+0000 7faa16ffd700 1 -- 172.21.15.26:0/4024475160 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faa1c021030 con 0x7faa280a0a30 2023-10-01T07:56:27.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.713+0000 7faa16ffd700 1 -- 172.21.15.26:0/4024475160 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faa1c040840 con 0x7faa280a0a30 2023-10-01T07:56:27.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.713+0000 7faa2cb1e700 1 -- 172.21.15.26:0/4024475160 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa281206f0 con 0x7faa280a0a30 2023-10-01T07:56:27.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.718+0000 7faa16ffd700 1 -- 172.21.15.26:0/4024475160 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faa1c003800 con 0x7faa280a0a30 2023-10-01T07:56:27.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.744+0000 7f5c0745c700 1 Processor -- start 2023-10-01T07:56:27.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.744+0000 7f5c0745c700 1 -- start start 2023-10-01T07:56:27.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.745+0000 7f5c0745c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c000a1510 0x7f5c00138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:27.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.745+0000 7f5c0745c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c00139250 0x7f5c0013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:27.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.745+0000 7f5c0745c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c0009edd0 con 0x7f5c000a0a30 2023-10-01T07:56:27.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.745+0000 7f5c0745c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c000a18e0 con 0x7f5c000a1510 2023-10-01T07:56:27.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.745+0000 7f5c0745c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0009e1f0 con 0x7f5c00139250 2023-10-01T07:56:27.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.745+0000 7f5c051f8700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5c000a0a30 0x7f5c000a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59182/0 (socket says 172.21.15.26:59182) 2023-10-01T07:56:27.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.745+0000 7f5c051f8700 1 -- 172.21.15.26:0/1523832841 learned_addr learned my addr 172.21.15.26:0/1523832841 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:27.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.745+0000 7f5c049f7700 1 --2- 172.21.15.26:0/1523832841 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c000a1510 0x7f5c00138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:27.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.745+0000 7f5c059f9700 1 --2- 172.21.15.26:0/1523832841 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c00139250 0x7f5c0013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:27.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.745+0000 7f5c049f7700 1 -- 172.21.15.26:0/1523832841 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c00139250 msgr2=0x7f5c0013b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:27.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.745+0000 7f5c049f7700 1 --2- 172.21.15.26:0/1523832841 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c00139250 0x7f5c0013b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.745+0000 7f5c049f7700 1 -- 172.21.15.26:0/1523832841 >> v1:172.21.15.26:6789/0 conn(0x7f5c000a0a30 legacy=0x7f5c000a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:27.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.745+0000 7f5c049f7700 1 -- 172.21.15.26:0/1523832841 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c0009dc50 con 0x7f5c000a1510 2023-10-01T07:56:27.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.745+0000 7f5c059f9700 1 --2- 172.21.15.26:0/1523832841 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c00139250 0x7f5c0013b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:27.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.745+0000 7f5c049f7700 1 --2- 172.21.15.26:0/1523832841 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c000a1510 0x7f5c00138d10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0009870 tx=0x7f5bf0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94333b7d8e42ce56 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:27.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.746+0000 7f5bf7fff700 1 -- 172.21.15.26:0/1523832841 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0011830 con 0x7f5c000a1510 2023-10-01T07:56:27.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.746+0000 7f5bf7fff700 1 -- 172.21.15.26:0/1523832841 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf0011990 con 0x7f5c000a1510 2023-10-01T07:56:27.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.746+0000 7f5bf7fff700 1 -- 172.21.15.26:0/1523832841 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0011d20 con 0x7f5c000a1510 2023-10-01T07:56:27.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.746+0000 7f5c0745c700 1 -- 172.21.15.26:0/1523832841 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c000a1510 msgr2=0x7f5c00138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:27.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.746+0000 7f5c0745c700 1 --2- 172.21.15.26:0/1523832841 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c000a1510 0x7f5c00138d10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0009870 tx=0x7f5bf0009b80 comp rx=0 tx=0).stop 2023-10-01T07:56:27.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.746+0000 7f5c0745c700 1 -- 172.21.15.26:0/1523832841 shutdown_connections 2023-10-01T07:56:27.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.746+0000 7f5c0745c700 1 --2- 172.21.15.26:0/1523832841 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c00139250 0x7f5c0013b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.746+0000 7f5c0745c700 1 --2- 172.21.15.26:0/1523832841 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c000a1510 0x7f5c00138d10 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.746+0000 7f5c0745c700 1 -- 172.21.15.26:0/1523832841 >> 172.21.15.26:0/1523832841 conn(0x7f5c000a6550 msgr2=0x7f5c000a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:27.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.747+0000 7f5c0745c700 1 -- 172.21.15.26:0/1523832841 shutdown_connections 2023-10-01T07:56:27.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.747+0000 7f5c0745c700 1 -- 172.21.15.26:0/1523832841 wait complete. 2023-10-01T07:56:27.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.748+0000 7f5c0745c700 1 Processor -- start 2023-10-01T07:56:27.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.748+0000 7f5c0745c700 1 -- start start 2023-10-01T07:56:27.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.748+0000 7f5c0745c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c000a0a30 0x7f5c001223e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:27.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.748+0000 7f5c0745c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c000a1510 0x7f5c00122920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:27.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.748+0000 7f5c0745c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c00139250 0x7f5c001c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:27.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.748+0000 7f5c0745c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c00138e80 con 0x7f5c000a0a30 2023-10-01T07:56:27.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.748+0000 7f5c0745c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c00121f90 con 0x7f5c000a1510 2023-10-01T07:56:27.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.748+0000 7f5c0745c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c00125190 con 0x7f5c00139250 2023-10-01T07:56:27.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.749+0000 7f5c051f8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c000a0a30 0x7f5c001223e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:27.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.749+0000 7f5c049f7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c000a1510 0x7f5c00122920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:27.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.749+0000 7f5c049f7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c000a1510 0x7f5c00122920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33568/0 (socket says 172.21.15.26:33568) 2023-10-01T07:56:27.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.749+0000 7f5c051f8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c000a0a30 0x7f5c001223e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49662/0 (socket says 172.21.15.26:49662) 2023-10-01T07:56:27.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.749+0000 7f5c049f7700 1 -- 172.21.15.26:0/465366855 learned_addr learned my addr 172.21.15.26:0/465366855 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:27.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.749+0000 7f5c059f9700 1 --2- 172.21.15.26:0/465366855 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c00139250 0x7f5c001c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:27.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.749+0000 7f5c049f7700 1 -- 172.21.15.26:0/465366855 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c00139250 msgr2=0x7f5c001c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:27.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.749+0000 7f5c049f7700 1 --2- 172.21.15.26:0/465366855 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c00139250 0x7f5c001c84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.749+0000 7f5c049f7700 1 -- 172.21.15.26:0/465366855 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c000a0a30 msgr2=0x7f5c001223e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:27.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.749+0000 7f5c049f7700 1 --2- 172.21.15.26:0/465366855 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c000a0a30 0x7f5c001223e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.749+0000 7f5c049f7700 1 -- 172.21.15.26:0/465366855 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf8009a70 con 0x7f5c000a1510 2023-10-01T07:56:27.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.749+0000 7f5c051f8700 1 --2- 172.21.15.26:0/465366855 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c000a0a30 0x7f5c001223e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:27.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.749+0000 7f5c049f7700 1 --2- 172.21.15.26:0/465366855 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c000a1510 0x7f5c00122920 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0009840 tx=0x7f5bf0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:27.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.749+0000 7f5bf5ffb700 1 -- 172.21.15.26:0/465366855 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0004450 con 0x7f5c000a1510 2023-10-01T07:56:27.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.749+0000 7f5bf5ffb700 1 -- 172.21.15.26:0/465366855 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf001f070 con 0x7f5c000a1510 2023-10-01T07:56:27.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.749+0000 7f5c0745c700 1 -- 172.21.15.26:0/465366855 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf00094a0 con 0x7f5c000a1510 2023-10-01T07:56:27.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.750+0000 7f5bf5ffb700 1 -- 172.21.15.26:0/465366855 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf00038e0 con 0x7f5c000a1510 2023-10-01T07:56:27.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.750+0000 7f5c0745c700 1 -- 172.21.15.26:0/465366855 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c00124230 con 0x7f5c000a1510 2023-10-01T07:56:27.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.750+0000 7f5bf5ffb700 1 -- 172.21.15.26:0/465366855 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5bf0003a40 con 0x7f5c000a1510 2023-10-01T07:56:27.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.751+0000 7f5bf5ffb700 1 -- 172.21.15.26:0/465366855 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5bf0021070 con 0x7f5c000a1510 2023-10-01T07:56:27.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.751+0000 7f5c0745c700 1 -- 172.21.15.26:0/465366855 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c00124ff0 con 0x7f5c000a1510 2023-10-01T07:56:27.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.756+0000 7f5bf5ffb700 1 -- 172.21.15.26:0/465366855 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5c00124ff0 con 0x7f5c000a1510 2023-10-01T07:56:27.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.892+0000 7f12748a1700 1 -- 172.21.15.26:0/196188259 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1270074ea0 con 0x7f1270139170 2023-10-01T07:56:27.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.892+0000 7f125effd700 1 -- 172.21.15.26:0/196188259 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1268045020 con 0x7f1270139170 2023-10-01T07:56:27.893 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:27.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.895+0000 7f12748a1700 1 -- 172.21.15.26:0/196188259 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1270139170 msgr2=0x7f12701c8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:27.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.895+0000 7f12748a1700 1 --2- 172.21.15.26:0/196188259 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1270139170 0x7f12701c8ee0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f126800efc0 tx=0x7f126800c3a0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.895+0000 7f12748a1700 1 -- 172.21.15.26:0/196188259 shutdown_connections 2023-10-01T07:56:27.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.895+0000 7f12748a1700 1 --2- 172.21.15.26:0/196188259 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1270139170 0x7f12701c8ee0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.895+0000 7f12748a1700 1 --2- 172.21.15.26:0/196188259 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f127009d6f0 0x7f12701c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.895+0000 7f12748a1700 1 --2- 172.21.15.26:0/196188259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f127009e1d0 0x7f12701c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.895+0000 7f12748a1700 1 -- 172.21.15.26:0/196188259 >> 172.21.15.26:0/196188259 conn(0x7f1270066f50 msgr2=0x7f12700a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:27.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.895+0000 7f12748a1700 1 -- 172.21.15.26:0/196188259 shutdown_connections 2023-10-01T07:56:27.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.895+0000 7f12748a1700 1 -- 172.21.15.26:0/196188259 wait complete. 2023-10-01T07:56:27.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:27.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.926+0000 7faa2cb1e700 1 -- 172.21.15.26:0/4024475160 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faa280747f0 con 0x7faa280a0a30 2023-10-01T07:56:27.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.926+0000 7faa16ffd700 1 -- 172.21.15.26:0/4024475160 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faa1c015020 con 0x7faa280a0a30 2023-10-01T07:56:27.927 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:27.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.929+0000 7faa2cb1e700 1 -- 172.21.15.26:0/4024475160 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa280a0a30 msgr2=0x7faa2811fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:27.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.929+0000 7faa2cb1e700 1 --2- 172.21.15.26:0/4024475160 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa280a0a30 0x7faa2811fa00 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7faa1c016000 tx=0x7faa1c004750 comp rx=0 tx=0).stop 2023-10-01T07:56:27.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.929+0000 7faa2cb1e700 1 -- 172.21.15.26:0/4024475160 shutdown_connections 2023-10-01T07:56:27.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.929+0000 7faa2cb1e700 1 --2- 172.21.15.26:0/4024475160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa28133930 0x7faa281c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.929+0000 7faa2cb1e700 1 --2- 172.21.15.26:0/4024475160 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa2809d630 0x7faa2811f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.929+0000 7faa2cb1e700 1 --2- 172.21.15.26:0/4024475160 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa280a0a30 0x7faa2811fa00 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.929+0000 7faa2cb1e700 1 -- 172.21.15.26:0/4024475160 >> 172.21.15.26:0/4024475160 conn(0x7faa280a3050 msgr2=0x7faa2809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:27.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.929+0000 7faa2cb1e700 1 -- 172.21.15.26:0/4024475160 shutdown_connections 2023-10-01T07:56:27.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.929+0000 7faa2cb1e700 1 -- 172.21.15.26:0/4024475160 wait complete. 2023-10-01T07:56:27.943 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:27.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.977+0000 7f5c0745c700 1 -- 172.21.15.26:0/465366855 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5c00124ff0 con 0x7f5c000a1510 2023-10-01T07:56:27.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.977+0000 7f5bf5ffb700 1 -- 172.21.15.26:0/465366855 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5c00124ff0 con 0x7f5c000a1510 2023-10-01T07:56:27.978 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:27.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.979+0000 7f5c0745c700 1 -- 172.21.15.26:0/465366855 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c000a1510 msgr2=0x7f5c00122920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:27.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.979+0000 7f5c0745c700 1 --2- 172.21.15.26:0/465366855 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c000a1510 0x7f5c00122920 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0009840 tx=0x7f5bf0004750 comp rx=0 tx=0).stop 2023-10-01T07:56:27.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.979+0000 7f5c0745c700 1 -- 172.21.15.26:0/465366855 shutdown_connections 2023-10-01T07:56:27.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.979+0000 7f5c0745c700 1 --2- 172.21.15.26:0/465366855 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c00139250 0x7f5c001c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.980+0000 7f5c0745c700 1 --2- 172.21.15.26:0/465366855 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c000a0a30 0x7f5c001223e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.980+0000 7f5c0745c700 1 --2- 172.21.15.26:0/465366855 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c000a1510 0x7f5c00122920 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:27.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.980+0000 7f5c0745c700 1 -- 172.21.15.26:0/465366855 >> 172.21.15.26:0/465366855 conn(0x7f5c000a6550 msgr2=0x7f5c00137b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:27.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.980+0000 7f5c0745c700 1 -- 172.21.15.26:0/465366855 shutdown_connections 2023-10-01T07:56:27.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:27.980+0000 7f5c0745c700 1 -- 172.21.15.26:0/465366855 wait complete. 2023-10-01T07:56:27.994 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:28.690 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:28.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.835+0000 7fa2b56d9700 1 Processor -- start 2023-10-01T07:56:28.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.835+0000 7fa2b56d9700 1 -- start start 2023-10-01T07:56:28.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.836+0000 7fa2b56d9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa2b009d6f0 0x7fa2b009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:28.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.836+0000 7fa2b56d9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa2b009e440 0x7fa2b0134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:28.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.836+0000 7fa2b56d9700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2b009b120 con 0x7fa2b009e000 2023-10-01T07:56:28.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.836+0000 7fa2b56d9700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2b006b460 con 0x7fa2b009d6f0 2023-10-01T07:56:28.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.836+0000 7fa2b56d9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b009a7e0 con 0x7fa2b009e440 2023-10-01T07:56:28.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.836+0000 7fa2aeffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa2b009d6f0 0x7fa2b009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:28.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.836+0000 7fa2af7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa2b009e440 0x7fa2b0134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:28.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.836+0000 7fa2aeffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa2b009d6f0 0x7fa2b009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49678/0 (socket says 172.21.15.26:49678) 2023-10-01T07:56:28.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.836+0000 7fa2aeffd700 1 -- 172.21.15.26:0/3762336374 learned_addr learned my addr 172.21.15.26:0/3762336374 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:28.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.836+0000 7fa2aeffd700 1 -- 172.21.15.26:0/3762336374 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa2b009e440 msgr2=0x7fa2b0134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:28.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.836+0000 7fa2aeffd700 1 --2- 172.21.15.26:0/3762336374 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa2b009e440 0x7fa2b0134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:28.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.836+0000 7fa2aeffd700 1 -- 172.21.15.26:0/3762336374 >> v1:172.21.15.26:6789/0 conn(0x7fa2b009e000 legacy=0x7fa2b01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:28.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.836+0000 7fa2aeffd700 1 -- 172.21.15.26:0/3762336374 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b009a500 con 0x7fa2b009d6f0 2023-10-01T07:56:28.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.836+0000 7fa2af7fe700 1 --2- 172.21.15.26:0/3762336374 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa2b009e440 0x7fa2b0134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:28.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.837+0000 7fa2aeffd700 1 --2- 172.21.15.26:0/3762336374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2b009d6f0 0x7fa2b009dac0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4009920 tx=0x7fa2a4009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e15b2d6eccb7050 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:28.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.837+0000 7fa2adffb700 1 -- 172.21.15.26:0/3762336374 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a4011830 con 0x7fa2b009d6f0 2023-10-01T07:56:28.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.837+0000 7fa2adffb700 1 -- 172.21.15.26:0/3762336374 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a4011990 con 0x7fa2b009d6f0 2023-10-01T07:56:28.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.837+0000 7fa2adffb700 1 -- 172.21.15.26:0/3762336374 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a4011d20 con 0x7fa2b009d6f0 2023-10-01T07:56:28.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.837+0000 7fa2b56d9700 1 -- 172.21.15.26:0/3762336374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2b009d6f0 msgr2=0x7fa2b009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:28.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.837+0000 7fa2b56d9700 1 --2- 172.21.15.26:0/3762336374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2b009d6f0 0x7fa2b009dac0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4009920 tx=0x7fa2a4009c30 comp rx=0 tx=0).stop 2023-10-01T07:56:28.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.837+0000 7fa2b56d9700 1 -- 172.21.15.26:0/3762336374 shutdown_connections 2023-10-01T07:56:28.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.837+0000 7fa2b56d9700 1 --2- 172.21.15.26:0/3762336374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2b009d6f0 0x7fa2b009dac0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:28.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.837+0000 7fa2b56d9700 1 --2- 172.21.15.26:0/3762336374 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa2b009e440 0x7fa2b0134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:28.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.837+0000 7fa2b56d9700 1 -- 172.21.15.26:0/3762336374 >> 172.21.15.26:0/3762336374 conn(0x7fa2b0066f50 msgr2=0x7fa2b009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:28.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.837+0000 7fa2b56d9700 1 -- 172.21.15.26:0/3762336374 shutdown_connections 2023-10-01T07:56:28.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.837+0000 7fa2b56d9700 1 -- 172.21.15.26:0/3762336374 wait complete. 2023-10-01T07:56:28.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.839+0000 7fa2b56d9700 1 Processor -- start 2023-10-01T07:56:28.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.839+0000 7fa2b56d9700 1 -- start start 2023-10-01T07:56:28.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.840+0000 7fa2b56d9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa2b009d6f0 0x7fa2b01c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:28.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.840+0000 7fa2b56d9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2b009e000 0x7fa2b01c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:28.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.840+0000 7fa2b56d9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa2b009e440 0x7fa2b01c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:28.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.840+0000 7fa2b56d9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b01a7170 con 0x7fa2b009e000 2023-10-01T07:56:28.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.840+0000 7fa2b56d9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b01a8bd0 con 0x7fa2b009d6f0 2023-10-01T07:56:28.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.840+0000 7fa2b56d9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b01a9280 con 0x7fa2b009e440 2023-10-01T07:56:28.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.840+0000 7fa2aeffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa2b009d6f0 0x7fa2b01c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:28.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.840+0000 7fa2aeffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa2b009d6f0 0x7fa2b01c85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33574/0 (socket says 172.21.15.26:33574) 2023-10-01T07:56:28.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.840+0000 7fa2aeffd700 1 -- 172.21.15.26:0/1751373991 learned_addr learned my addr 172.21.15.26:0/1751373991 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:28.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.840+0000 7fa2ae7fc700 1 --2- 172.21.15.26:0/1751373991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2b009e000 0x7fa2b01c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:28.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.840+0000 7fa2af7fe700 1 --2- 172.21.15.26:0/1751373991 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa2b009e440 0x7fa2b01c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:28.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.840+0000 7fa2aeffd700 1 -- 172.21.15.26:0/1751373991 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa2b009e440 msgr2=0x7fa2b01c4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:28.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.840+0000 7fa2aeffd700 1 --2- 172.21.15.26:0/1751373991 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa2b009e440 0x7fa2b01c4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:28.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.840+0000 7fa2aeffd700 1 -- 172.21.15.26:0/1751373991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2b009e000 msgr2=0x7fa2b01c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:28.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.840+0000 7fa2aeffd700 1 --2- 172.21.15.26:0/1751373991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2b009e000 0x7fa2b01c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:28.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.840+0000 7fa2aeffd700 1 -- 172.21.15.26:0/1751373991 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a8009a70 con 0x7fa2b009d6f0 2023-10-01T07:56:28.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.840+0000 7fa2aeffd700 1 --2- 172.21.15.26:0/1751373991 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa2b009d6f0 0x7fa2b01c85f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4000c00 tx=0x7fa2a4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:28.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.841+0000 7fa2977fe700 1 -- 172.21.15.26:0/1751373991 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a40042c0 con 0x7fa2b009d6f0 2023-10-01T07:56:28.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.841+0000 7fa2977fe700 1 -- 172.21.15.26:0/1751373991 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a401f070 con 0x7fa2b009d6f0 2023-10-01T07:56:28.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.841+0000 7fa2b56d9700 1 -- 172.21.15.26:0/1751373991 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a4009550 con 0x7fa2b009d6f0 2023-10-01T07:56:28.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.841+0000 7fa2977fe700 1 -- 172.21.15.26:0/1751373991 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a40036a0 con 0x7fa2b009d6f0 2023-10-01T07:56:28.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.841+0000 7fa2b56d9700 1 -- 172.21.15.26:0/1751373991 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2b01a95f0 con 0x7fa2b009d6f0 2023-10-01T07:56:28.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.842+0000 7fa2977fe700 1 -- 172.21.15.26:0/1751373991 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa2a4021030 con 0x7fa2b009d6f0 2023-10-01T07:56:28.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.842+0000 7fa2977fe700 1 -- 172.21.15.26:0/1751373991 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa2a4040880 con 0x7fa2b009d6f0 2023-10-01T07:56:28.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.842+0000 7fa2b56d9700 1 -- 172.21.15.26:0/1751373991 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2b0074ea0 con 0x7fa2b009d6f0 2023-10-01T07:56:28.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:28.847+0000 7fa2977fe700 1 -- 172.21.15.26:0/1751373991 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa2a4015080 con 0x7fa2b009d6f0 2023-10-01T07:56:28.910 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:28.944 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:28.994 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:29.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.066+0000 7f41170b1700 1 Processor -- start 2023-10-01T07:56:29.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.066+0000 7f41170b1700 1 -- start start 2023-10-01T07:56:29.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.066+0000 7f41170b1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4110133420 0x7f41101337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:29.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.067+0000 7f41170b1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4110134260 0x7f41101306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:29.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.067+0000 7f41170b1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f411006b990 con 0x7f4110133e30 2023-10-01T07:56:29.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.067+0000 7f41170b1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41100a0590 con 0x7f4110133420 2023-10-01T07:56:29.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.067+0000 7f41170b1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f411009fb80 con 0x7f4110134260 2023-10-01T07:56:29.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.067+0000 7f4114e4d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4110133420 0x7f41101337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:29.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.067+0000 7f410ffff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4110133e30 0x7f411012ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59198/0 (socket says 172.21.15.26:59198) 2023-10-01T07:56:29.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.067+0000 7f410ffff700 1 -- 172.21.15.26:0/1319119041 learned_addr learned my addr 172.21.15.26:0/1319119041 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:29.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.067+0000 7f411564e700 1 --2- 172.21.15.26:0/1319119041 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4110134260 0x7f41101306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:29.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.067+0000 7f410f7fe700 1 -- 172.21.15.26:0/1319119041 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 439859125 0 0) 0x7f411006b990 con 0x7f4110133e30 2023-10-01T07:56:29.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.067+0000 7f410f7fe700 1 -- 172.21.15.26:0/1319119041 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41000035b0 con 0x7f4110133e30 2023-10-01T07:56:29.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.067+0000 7f4114e4d700 1 -- 172.21.15.26:0/1319119041 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4110134260 msgr2=0x7f41101306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:29.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.067+0000 7f4114e4d700 1 --2- 172.21.15.26:0/1319119041 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4110134260 0x7f41101306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:29.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.067+0000 7f4114e4d700 1 -- 172.21.15.26:0/1319119041 >> v1:172.21.15.26:6789/0 conn(0x7f4110133e30 legacy=0x7f411012ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:29.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.067+0000 7f4114e4d700 1 -- 172.21.15.26:0/1319119041 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41100a0030 con 0x7f4110133420 2023-10-01T07:56:29.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.068+0000 7f4114e4d700 1 --2- 172.21.15.26:0/1319119041 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4110133420 0x7f41101337f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4104009870 tx=0x7f4104009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eeca181470c13a80 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:29.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.068+0000 7f410f7fe700 1 -- 172.21.15.26:0/1319119041 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4104011830 con 0x7f4110133420 2023-10-01T07:56:29.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.068+0000 7f410f7fe700 1 -- 172.21.15.26:0/1319119041 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4104011990 con 0x7f4110133420 2023-10-01T07:56:29.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.068+0000 7f410f7fe700 1 -- 172.21.15.26:0/1319119041 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4104011d20 con 0x7f4110133420 2023-10-01T07:56:29.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.069+0000 7f41170b1700 1 -- 172.21.15.26:0/1319119041 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4110133420 msgr2=0x7f41101337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:29.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.069+0000 7f41170b1700 1 --2- 172.21.15.26:0/1319119041 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4110133420 0x7f41101337f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4104009870 tx=0x7f4104009b80 comp rx=0 tx=0).stop 2023-10-01T07:56:29.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.069+0000 7f41170b1700 1 -- 172.21.15.26:0/1319119041 shutdown_connections 2023-10-01T07:56:29.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.069+0000 7f41170b1700 1 --2- 172.21.15.26:0/1319119041 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4110134260 0x7f41101306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:29.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.069+0000 7f41170b1700 1 --2- 172.21.15.26:0/1319119041 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4110133420 0x7f41101337f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:29.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.069+0000 7f41170b1700 1 -- 172.21.15.26:0/1319119041 >> 172.21.15.26:0/1319119041 conn(0x7f41100a4210 msgr2=0x7f41100a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:29.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.069+0000 7f41170b1700 1 -- 172.21.15.26:0/1319119041 shutdown_connections 2023-10-01T07:56:29.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.069+0000 7f41170b1700 1 -- 172.21.15.26:0/1319119041 wait complete. 2023-10-01T07:56:29.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.070+0000 7f41170b1700 1 Processor -- start 2023-10-01T07:56:29.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.070+0000 7f41170b1700 1 -- start start 2023-10-01T07:56:29.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.071+0000 7f41170b1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4110133420 0x7f41100709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:29.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.071+0000 7f41170b1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4110133e30 0x7f4110070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:29.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.071+0000 7f41170b1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4110134260 0x7f4110071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:29.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.071+0000 7f41170b1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411012dcc0 con 0x7f4110133420 2023-10-01T07:56:29.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.071+0000 7f41170b1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411012da90 con 0x7f4110134260 2023-10-01T07:56:29.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.071+0000 7f41170b1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f411012d750 con 0x7f4110133e30 2023-10-01T07:56:29.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.071+0000 7f411564e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4110134260 0x7f4110071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:29.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.071+0000 7f411564e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4110134260 0x7f4110071420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33598/0 (socket says 172.21.15.26:33598) 2023-10-01T07:56:29.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.071+0000 7f410ffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4110133e30 0x7f4110070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:29.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.071+0000 7f411564e700 1 -- 172.21.15.26:0/403641779 learned_addr learned my addr 172.21.15.26:0/403641779 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:29.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.072+0000 7f4114e4d700 1 --2- 172.21.15.26:0/403641779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4110133420 0x7f41100709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:29.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.072+0000 7f4114e4d700 1 -- 172.21.15.26:0/403641779 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4110133e30 msgr2=0x7f4110070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:29.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.072+0000 7f4114e4d700 1 --2- 172.21.15.26:0/403641779 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4110133e30 0x7f4110070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:29.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.072+0000 7f4114e4d700 1 -- 172.21.15.26:0/403641779 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4110134260 msgr2=0x7f4110071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:29.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.072+0000 7f4114e4d700 1 --2- 172.21.15.26:0/403641779 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4110134260 0x7f4110071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:29.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.072+0000 7f4114e4d700 1 -- 172.21.15.26:0/403641779 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41040094a0 con 0x7f4110133420 2023-10-01T07:56:29.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.072+0000 7f4114e4d700 1 --2- 172.21.15.26:0/403641779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4110133420 0x7f41100709a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f411006e650 tx=0x7f4104004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:29.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.072+0000 7f410d7fa700 1 -- 172.21.15.26:0/403641779 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4104004240 con 0x7f4110133420 2023-10-01T07:56:29.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.072+0000 7f410d7fa700 1 -- 172.21.15.26:0/403641779 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f410401f070 con 0x7f4110133420 2023-10-01T07:56:29.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.072+0000 7f410d7fa700 1 -- 172.21.15.26:0/403641779 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41040036a0 con 0x7f4110133420 2023-10-01T07:56:29.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.073+0000 7f41170b1700 1 -- 172.21.15.26:0/403641779 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f411011ffb0 con 0x7f4110133420 2023-10-01T07:56:29.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.073+0000 7f41170b1700 1 -- 172.21.15.26:0/403641779 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4110120290 con 0x7f4110133420 2023-10-01T07:56:29.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.073+0000 7fa2b56d9700 1 -- 172.21.15.26:0/1751373991 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa2b006c360 con 0x7fa2b009d6f0 2023-10-01T07:56:29.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.074+0000 7fa2977fe700 1 -- 172.21.15.26:0/1751373991 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa2a40239c0 con 0x7fa2b009d6f0 2023-10-01T07:56:29.081 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:29.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.074+0000 7f41170b1700 1 -- 172.21.15.26:0/403641779 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f411012f060 con 0x7f4110133420 2023-10-01T07:56:29.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.074+0000 7f410d7fa700 1 -- 172.21.15.26:0/403641779 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4104021030 con 0x7f4110133420 2023-10-01T07:56:29.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.074+0000 7f410d7fa700 1 -- 172.21.15.26:0/403641779 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4104040ae0 con 0x7f4110133420 2023-10-01T07:56:29.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.076+0000 7fa2b56d9700 1 -- 172.21.15.26:0/1751373991 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa2b009d6f0 msgr2=0x7fa2b01c85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:29.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.076+0000 7fa2b56d9700 1 --2- 172.21.15.26:0/1751373991 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa2b009d6f0 0x7fa2b01c85f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4000c00 tx=0x7fa2a4004750 comp rx=0 tx=0).stop 2023-10-01T07:56:29.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.076+0000 7fa2b56d9700 1 -- 172.21.15.26:0/1751373991 shutdown_connections 2023-10-01T07:56:29.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.076+0000 7fa2b56d9700 1 --2- 172.21.15.26:0/1751373991 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa2b009e440 0x7fa2b01c4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:29.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.076+0000 7fa2b56d9700 1 --2- 172.21.15.26:0/1751373991 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa2b009d6f0 0x7fa2b01c85f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:29.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.076+0000 7fa2b56d9700 1 --2- 172.21.15.26:0/1751373991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2b009e000 0x7fa2b01c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:29.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.076+0000 7fa2b56d9700 1 -- 172.21.15.26:0/1751373991 >> 172.21.15.26:0/1751373991 conn(0x7fa2b0066f50 msgr2=0x7fa2b01bac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:29.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.076+0000 7fa2b56d9700 1 -- 172.21.15.26:0/1751373991 shutdown_connections 2023-10-01T07:56:29.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.076+0000 7fa2b56d9700 1 -- 172.21.15.26:0/1751373991 wait complete. 2023-10-01T07:56:29.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.083+0000 7f410d7fa700 1 -- 172.21.15.26:0/403641779 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f41040239c0 con 0x7f4110133420 2023-10-01T07:56:29.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:29.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.108+0000 7fabfd4f9700 1 Processor -- start 2023-10-01T07:56:29.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.108+0000 7fabfd4f9700 1 -- start start 2023-10-01T07:56:29.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.108+0000 7fabfd4f9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fabf80a0a30 0x7fabf80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:29.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.108+0000 7fabfd4f9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabf809d630 0x7fabf80a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:29.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.108+0000 7fabfd4f9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabf8133930 0x7fabf8133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:29.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.108+0000 7fabfd4f9700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf80a2a70 con 0x7fabf80a0a30 2023-10-01T07:56:29.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.108+0000 7fabfd4f9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf80a01d0 con 0x7fabf8133930 2023-10-01T07:56:29.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.108+0000 7fabfd4f9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabf809e2b0 con 0x7fabf809d630 2023-10-01T07:56:29.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.109+0000 7fabf77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabf8133930 0x7fabf8133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:29.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.109+0000 7fabf77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabf8133930 0x7fabf8133db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33602/0 (socket says 172.21.15.26:33602) 2023-10-01T07:56:29.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.109+0000 7fabf77fe700 1 -- 172.21.15.26:0/3738793957 learned_addr learned my addr 172.21.15.26:0/3738793957 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:29.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.109+0000 7fabf6ffd700 1 --2- 172.21.15.26:0/3738793957 >> v2:172.21.15.26:3300/0 conn(0x7fabf80a0a30 0x7fabf80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:29.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.109+0000 7fabf67fc700 1 --2- 172.21.15.26:0/3738793957 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabf809d630 0x7fabf80a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:29.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.109+0000 7fabf77fe700 1 -- 172.21.15.26:0/3738793957 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabf809d630 msgr2=0x7fabf80a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:29.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.109+0000 7fabf77fe700 1 --2- 172.21.15.26:0/3738793957 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabf809d630 0x7fabf80a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:29.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.109+0000 7fabf77fe700 1 -- 172.21.15.26:0/3738793957 >> v2:172.21.15.26:3300/0 conn(0x7fabf80a0a30 msgr2=0x7fabf80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:29.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.109+0000 7fabf77fe700 1 --2- 172.21.15.26:0/3738793957 >> v2:172.21.15.26:3300/0 conn(0x7fabf80a0a30 0x7fabf80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:29.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.109+0000 7fabf77fe700 1 -- 172.21.15.26:0/3738793957 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf809dc50 con 0x7fabf8133930 2023-10-01T07:56:29.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.109+0000 7fabf67fc700 1 --2- 172.21.15.26:0/3738793957 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabf809d630 0x7fabf80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:29.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.109+0000 7fabf6ffd700 1 --2- 172.21.15.26:0/3738793957 >> v2:172.21.15.26:3300/0 conn(0x7fabf80a0a30 0x7fabf80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:56:29.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.109+0000 7fabf77fe700 1 --2- 172.21.15.26:0/3738793957 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabf8133930 0x7fabf8133db0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fabf0009e50 tx=0x7fabf000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f26fc495460e821 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:29.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.109+0000 7fabf5ffb700 1 -- 172.21.15.26:0/3738793957 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf000e070 con 0x7fabf8133930 2023-10-01T07:56:29.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.109+0000 7fabf5ffb700 1 -- 172.21.15.26:0/3738793957 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf000b910 con 0x7fabf8133930 2023-10-01T07:56:29.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.110+0000 7fabf5ffb700 1 -- 172.21.15.26:0/3738793957 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf000bcc0 con 0x7fabf8133930 2023-10-01T07:56:29.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.110+0000 7fabfd4f9700 1 -- 172.21.15.26:0/3738793957 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabf8133930 msgr2=0x7fabf8133db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:29.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.110+0000 7fabfd4f9700 1 --2- 172.21.15.26:0/3738793957 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabf8133930 0x7fabf8133db0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fabf0009e50 tx=0x7fabf000b330 comp rx=0 tx=0).stop 2023-10-01T07:56:29.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.110+0000 7fabfd4f9700 1 -- 172.21.15.26:0/3738793957 shutdown_connections 2023-10-01T07:56:29.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.110+0000 7fabfd4f9700 1 --2- 172.21.15.26:0/3738793957 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabf8133930 0x7fabf8133db0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:29.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.110+0000 7fabfd4f9700 1 --2- 172.21.15.26:0/3738793957 >> v2:172.21.15.26:3300/0 conn(0x7fabf80a0a30 0x7fabf80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:29.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.110+0000 7fabfd4f9700 1 --2- 172.21.15.26:0/3738793957 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabf809d630 0x7fabf80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:29.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.110+0000 7fabfd4f9700 1 -- 172.21.15.26:0/3738793957 >> 172.21.15.26:0/3738793957 conn(0x7fabf80a3050 msgr2=0x7fabf80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:29.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.110+0000 7fabfd4f9700 1 -- 172.21.15.26:0/3738793957 shutdown_connections 2023-10-01T07:56:29.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.110+0000 7fabfd4f9700 1 -- 172.21.15.26:0/3738793957 wait complete. 2023-10-01T07:56:29.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.111+0000 7fabfd4f9700 1 Processor -- start 2023-10-01T07:56:29.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.112+0000 7fabfd4f9700 1 -- start start 2023-10-01T07:56:29.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.112+0000 7fabfd4f9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabf809d630 0x7fabf81c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:29.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.112+0000 7fabfd4f9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabf80a0a30 0x7fabf81c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:29.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.112+0000 7fabfd4f9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabf8133930 0x7fabf81c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:29.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.112+0000 7fabfd4f9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf81221b0 con 0x7fabf8133930 2023-10-01T07:56:29.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.112+0000 7fabfd4f9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf8133520 con 0x7fabf809d630 2023-10-01T07:56:29.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.112+0000 7fabfd4f9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabf8120700 con 0x7fabf80a0a30 2023-10-01T07:56:29.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.112+0000 7fabf6ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabf809d630 0x7fabf81c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:29.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.112+0000 7fabf6ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabf809d630 0x7fabf81c7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33610/0 (socket says 172.21.15.26:33610) 2023-10-01T07:56:29.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.112+0000 7fabf6ffd700 1 -- 172.21.15.26:0/2647873626 learned_addr learned my addr 172.21.15.26:0/2647873626 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:29.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.112+0000 7fabf77fe700 1 --2- 172.21.15.26:0/2647873626 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabf8133930 0x7fabf81c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:29.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.112+0000 7fabf67fc700 1 --2- 172.21.15.26:0/2647873626 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabf80a0a30 0x7fabf81c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:29.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.113+0000 7fabf67fc700 1 -- 172.21.15.26:0/2647873626 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabf809d630 msgr2=0x7fabf81c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:29.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.113+0000 7fabf67fc700 1 --2- 172.21.15.26:0/2647873626 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabf809d630 0x7fabf81c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:29.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.113+0000 7fabf67fc700 1 -- 172.21.15.26:0/2647873626 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabf8133930 msgr2=0x7fabf81c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:29.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.113+0000 7fabf67fc700 1 --2- 172.21.15.26:0/2647873626 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabf8133930 0x7fabf81c8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:29.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.113+0000 7fabf67fc700 1 -- 172.21.15.26:0/2647873626 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabec0094a0 con 0x7fabf80a0a30 2023-10-01T07:56:29.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.113+0000 7fabf67fc700 1 --2- 172.21.15.26:0/2647873626 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabf80a0a30 0x7fabf81c83c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fabec00e9b0 tx=0x7fabec00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:29.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.113+0000 7fabdf7fe700 1 -- 172.21.15.26:0/2647873626 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec00ee50 con 0x7fabf80a0a30 2023-10-01T07:56:29.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.113+0000 7fabdf7fe700 1 -- 172.21.15.26:0/2647873626 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabec00c850 con 0x7fabf80a0a30 2023-10-01T07:56:29.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.113+0000 7fabfd4f9700 1 -- 172.21.15.26:0/2647873626 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf0009b30 con 0x7fabf80a0a30 2023-10-01T07:56:29.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.113+0000 7fabdf7fe700 1 -- 172.21.15.26:0/2647873626 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec00cc00 con 0x7fabf80a0a30 2023-10-01T07:56:29.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.113+0000 7fabfd4f9700 1 -- 172.21.15.26:0/2647873626 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf80a0460 con 0x7fabf80a0a30 2023-10-01T07:56:29.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.114+0000 7fabdf7fe700 1 -- 172.21.15.26:0/2647873626 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fabec013470 con 0x7fabf80a0a30 2023-10-01T07:56:29.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.114+0000 7fabdf7fe700 1 -- 172.21.15.26:0/2647873626 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fabec03fa90 con 0x7fabf80a0a30 2023-10-01T07:56:29.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.114+0000 7fabfd4f9700 1 -- 172.21.15.26:0/2647873626 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf80747f0 con 0x7fabf80a0a30 2023-10-01T07:56:29.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.124+0000 7fabdf7fe700 1 -- 172.21.15.26:0/2647873626 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fabec021080 con 0x7fabf80a0a30 2023-10-01T07:56:29.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.146+0000 7f9a90875700 1 Processor -- start 2023-10-01T07:56:29.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.146+0000 7f9a90875700 1 -- start start 2023-10-01T07:56:29.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.147+0000 7f9a90875700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9a8c130750 0x7f9a8c130b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:29.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.147+0000 7f9a90875700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a8c09d6f0 0x7f9a8c09db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:29.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.147+0000 7f9a90875700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a8c09c190 con 0x7f9a8c09e080 2023-10-01T07:56:29.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.147+0000 7f9a90875700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a8c09b090 con 0x7f9a8c130750 2023-10-01T07:56:29.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.147+0000 7f9a90875700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8c09a6c0 con 0x7f9a8c09d6f0 2023-10-01T07:56:29.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.147+0000 7f9a8ad9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9a8c09e080 0x7f9a8c1374b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59202/0 (socket says 172.21.15.26:59202) 2023-10-01T07:56:29.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.147+0000 7f9a8ad9d700 1 -- 172.21.15.26:0/138992542 learned_addr learned my addr 172.21.15.26:0/138992542 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:29.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.147+0000 7f9a89d9b700 1 --2- 172.21.15.26:0/138992542 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a8c09d6f0 0x7f9a8c09db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:29.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.147+0000 7f9a8a59c700 1 --2- 172.21.15.26:0/138992542 >> v2:172.21.15.26:3300/0 conn(0x7f9a8c130750 0x7f9a8c130b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:29.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.147+0000 7f9a8959a700 1 -- 172.21.15.26:0/138992542 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3113426802 0 0) 0x7f9a8c09c190 con 0x7f9a8c09e080 2023-10-01T07:56:29.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.147+0000 7f9a89d9b700 1 -- 172.21.15.26:0/138992542 >> v2:172.21.15.26:3300/0 conn(0x7f9a8c130750 msgr2=0x7f9a8c130b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:29.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.147+0000 7f9a89d9b700 1 --2- 172.21.15.26:0/138992542 >> v2:172.21.15.26:3300/0 conn(0x7f9a8c130750 0x7f9a8c130b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:29.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.147+0000 7f9a89d9b700 1 -- 172.21.15.26:0/138992542 >> v1:172.21.15.26:6789/0 conn(0x7f9a8c09e080 legacy=0x7f9a8c1374b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:29.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.147+0000 7f9a89d9b700 1 -- 172.21.15.26:0/138992542 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a8c09e500 con 0x7f9a8c09d6f0 2023-10-01T07:56:29.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.147+0000 7f9a89d9b700 1 --2- 172.21.15.26:0/138992542 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a8c09d6f0 0x7f9a8c09db40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9a80009840 tx=0x7f9a80009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41a72196808102f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:29.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.148+0000 7f9a8959a700 1 -- 172.21.15.26:0/138992542 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a80011830 con 0x7f9a8c09d6f0 2023-10-01T07:56:29.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.148+0000 7f9a8959a700 1 -- 172.21.15.26:0/138992542 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a80011990 con 0x7f9a8c09d6f0 2023-10-01T07:56:29.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.148+0000 7f9a8959a700 1 -- 172.21.15.26:0/138992542 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a80011d20 con 0x7f9a8c09d6f0 2023-10-01T07:56:29.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.148+0000 7f9a90875700 1 -- 172.21.15.26:0/138992542 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a8c09d6f0 msgr2=0x7f9a8c09db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:29.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.148+0000 7f9a90875700 1 --2- 172.21.15.26:0/138992542 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a8c09d6f0 0x7f9a8c09db40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9a80009840 tx=0x7f9a80009b50 comp rx=0 tx=0).stop 2023-10-01T07:56:29.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.148+0000 7f9a90875700 1 -- 172.21.15.26:0/138992542 shutdown_connections 2023-10-01T07:56:29.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.148+0000 7f9a90875700 1 --2- 172.21.15.26:0/138992542 >> v2:172.21.15.26:3300/0 conn(0x7f9a8c130750 0x7f9a8c130b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:29.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.148+0000 7f9a90875700 1 --2- 172.21.15.26:0/138992542 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a8c09d6f0 0x7f9a8c09db40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:29.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.148+0000 7f9a90875700 1 -- 172.21.15.26:0/138992542 >> 172.21.15.26:0/138992542 conn(0x7f9a8c09f470 msgr2=0x7f9a8c0a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:29.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.149+0000 7f9a90875700 1 -- 172.21.15.26:0/138992542 shutdown_connections 2023-10-01T07:56:29.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.149+0000 7f9a90875700 1 -- 172.21.15.26:0/138992542 wait complete. 2023-10-01T07:56:29.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.150+0000 7f9a90875700 1 Processor -- start 2023-10-01T07:56:29.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.150+0000 7f9a90875700 1 -- start start 2023-10-01T07:56:29.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.150+0000 7f9a90875700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a8c09d6f0 0x7f9a8c08afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:29.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.150+0000 7f9a90875700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a8c09e080 0x7f9a8c08b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:29.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.150+0000 7f9a90875700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a8c130750 0x7f9a8c08ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:29.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.150+0000 7f9a90875700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8c08e770 con 0x7f9a8c09d6f0 2023-10-01T07:56:29.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.150+0000 7f9a90875700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8c08e3d0 con 0x7f9a8c130750 2023-10-01T07:56:29.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.150+0000 7f9a90875700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8c08e970 con 0x7f9a8c09e080 2023-10-01T07:56:29.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.150+0000 7f9a89d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a8c09e080 0x7f9a8c08b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:29.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.150+0000 7f9a8ad9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a8c130750 0x7f9a8c08ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:29.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.150+0000 7f9a89d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a8c09e080 0x7f9a8c08b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:33212/0 (socket says 172.21.15.26:33212) 2023-10-01T07:56:29.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.150+0000 7f9a89d9b700 1 -- 172.21.15.26:0/3783426579 learned_addr learned my addr 172.21.15.26:0/3783426579 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:29.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.151+0000 7f9a8a59c700 1 --2- 172.21.15.26:0/3783426579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a8c09d6f0 0x7f9a8c08afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:29.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.151+0000 7f9a89d9b700 1 -- 172.21.15.26:0/3783426579 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a8c130750 msgr2=0x7f9a8c08ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:29.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.151+0000 7f9a89d9b700 1 --2- 172.21.15.26:0/3783426579 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a8c130750 0x7f9a8c08ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:29.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.151+0000 7f9a89d9b700 1 -- 172.21.15.26:0/3783426579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a8c09d6f0 msgr2=0x7f9a8c08afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:29.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.151+0000 7f9a89d9b700 1 --2- 172.21.15.26:0/3783426579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a8c09d6f0 0x7f9a8c08afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:29.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.151+0000 7f9a89d9b700 1 -- 172.21.15.26:0/3783426579 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a800094a0 con 0x7f9a8c09e080 2023-10-01T07:56:29.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.151+0000 7f9a89d9b700 1 --2- 172.21.15.26:0/3783426579 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a8c09e080 0x7f9a8c08b510 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9a80009fd0 tx=0x7f9a80004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:29.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.151+0000 7f9a7affd700 1 -- 172.21.15.26:0/3783426579 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a80004550 con 0x7f9a8c09e080 2023-10-01T07:56:29.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.151+0000 7f9a7affd700 1 -- 172.21.15.26:0/3783426579 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8001f070 con 0x7f9a8c09e080 2023-10-01T07:56:29.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.151+0000 7f9a90875700 1 -- 172.21.15.26:0/3783426579 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a8c08e030 con 0x7f9a8c09e080 2023-10-01T07:56:29.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.151+0000 7f9a7affd700 1 -- 172.21.15.26:0/3783426579 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a800038e0 con 0x7f9a8c09e080 2023-10-01T07:56:29.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.151+0000 7f9a90875700 1 -- 172.21.15.26:0/3783426579 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a8c08c9f0 con 0x7f9a8c09e080 2023-10-01T07:56:29.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.153+0000 7f9a90875700 1 -- 172.21.15.26:0/3783426579 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a8c0747f0 con 0x7f9a8c09e080 2023-10-01T07:56:29.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.153+0000 7f9a7affd700 1 -- 172.21.15.26:0/3783426579 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9a80003a40 con 0x7f9a8c09e080 2023-10-01T07:56:29.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.153+0000 7f9a7affd700 1 -- 172.21.15.26:0/3783426579 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9a80021070 con 0x7f9a8c09e080 2023-10-01T07:56:29.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.158+0000 7f9a7affd700 1 -- 172.21.15.26:0/3783426579 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9a80010380 con 0x7f9a8c09e080 2023-10-01T07:56:29.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.301+0000 7f41170b1700 1 -- 172.21.15.26:0/403641779 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4110074ea0 con 0x7f4110133420 2023-10-01T07:56:29.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.302+0000 7f410d7fa700 1 -- 172.21.15.26:0/403641779 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f410401b430 con 0x7f4110133420 2023-10-01T07:56:29.303 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:29.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.304+0000 7f41170b1700 1 -- 172.21.15.26:0/403641779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4110133420 msgr2=0x7f41100709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:29.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.304+0000 7f41170b1700 1 --2- 172.21.15.26:0/403641779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4110133420 0x7f41100709a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f411006e650 tx=0x7f4104004750 comp rx=0 tx=0).stop 2023-10-01T07:56:29.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.304+0000 7f41170b1700 1 -- 172.21.15.26:0/403641779 shutdown_connections 2023-10-01T07:56:29.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.304+0000 7f41170b1700 1 --2- 172.21.15.26:0/403641779 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4110134260 0x7f4110071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:29.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.304+0000 7f41170b1700 1 --2- 172.21.15.26:0/403641779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4110133420 0x7f41100709a0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:29.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.304+0000 7f41170b1700 1 --2- 172.21.15.26:0/403641779 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4110133e30 0x7f4110070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:29.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.304+0000 7f41170b1700 1 -- 172.21.15.26:0/403641779 >> 172.21.15.26:0/403641779 conn(0x7f41100a4210 msgr2=0x7f41100a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:29.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.304+0000 7f41170b1700 1 -- 172.21.15.26:0/403641779 shutdown_connections 2023-10-01T07:56:29.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.304+0000 7f41170b1700 1 -- 172.21.15.26:0/403641779 wait complete. 2023-10-01T07:56:29.318 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:29.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.360+0000 7fabfd4f9700 1 -- 172.21.15.26:0/2647873626 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fabf8072980 con 0x7fabf80a0a30 2023-10-01T07:56:29.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.360+0000 7fabdf7fe700 1 -- 172.21.15.26:0/2647873626 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fabec017020 con 0x7fabf80a0a30 2023-10-01T07:56:29.361 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:29.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.363+0000 7fabfd4f9700 1 -- 172.21.15.26:0/2647873626 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabf80a0a30 msgr2=0x7fabf81c83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:29.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.363+0000 7fabfd4f9700 1 --2- 172.21.15.26:0/2647873626 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabf80a0a30 0x7fabf81c83c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fabec00e9b0 tx=0x7fabec00ecc0 comp rx=0 tx=0).stop 2023-10-01T07:56:29.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.363+0000 7fabfd4f9700 1 -- 172.21.15.26:0/2647873626 shutdown_connections 2023-10-01T07:56:29.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.363+0000 7fabfd4f9700 1 --2- 172.21.15.26:0/2647873626 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabf8133930 0x7fabf81c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:29.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.363+0000 7fabfd4f9700 1 --2- 172.21.15.26:0/2647873626 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabf809d630 0x7fabf81c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:29.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.363+0000 7fabfd4f9700 1 --2- 172.21.15.26:0/2647873626 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabf80a0a30 0x7fabf81c83c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:29.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.363+0000 7fabfd4f9700 1 -- 172.21.15.26:0/2647873626 >> 172.21.15.26:0/2647873626 conn(0x7fabf80a3050 msgr2=0x7fabf80a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:29.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.363+0000 7fabfd4f9700 1 -- 172.21.15.26:0/2647873626 shutdown_connections 2023-10-01T07:56:29.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.363+0000 7fabfd4f9700 1 -- 172.21.15.26:0/2647873626 wait complete. 2023-10-01T07:56:29.377 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:29.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.390+0000 7f9a90875700 1 -- 172.21.15.26:0/3783426579 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9a8c06b250 con 0x7f9a8c09e080 2023-10-01T07:56:29.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.391+0000 7f9a7affd700 1 -- 172.21.15.26:0/3783426579 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9a80015020 con 0x7f9a8c09e080 2023-10-01T07:56:29.391 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:29.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.393+0000 7f9a90875700 1 -- 172.21.15.26:0/3783426579 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a8c09e080 msgr2=0x7f9a8c08b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:29.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.393+0000 7f9a90875700 1 --2- 172.21.15.26:0/3783426579 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a8c09e080 0x7f9a8c08b510 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9a80009fd0 tx=0x7f9a80004750 comp rx=0 tx=0).stop 2023-10-01T07:56:29.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.393+0000 7f9a90875700 1 -- 172.21.15.26:0/3783426579 shutdown_connections 2023-10-01T07:56:29.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.393+0000 7f9a90875700 1 --2- 172.21.15.26:0/3783426579 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a8c130750 0x7f9a8c08ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:29.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.393+0000 7f9a90875700 1 --2- 172.21.15.26:0/3783426579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a8c09d6f0 0x7f9a8c08afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:29.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.393+0000 7f9a90875700 1 --2- 172.21.15.26:0/3783426579 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a8c09e080 0x7f9a8c08b510 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:29.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.393+0000 7f9a90875700 1 -- 172.21.15.26:0/3783426579 >> 172.21.15.26:0/3783426579 conn(0x7f9a8c09f470 msgr2=0x7f9a8c0992c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:29.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.393+0000 7f9a90875700 1 -- 172.21.15.26:0/3783426579 shutdown_connections 2023-10-01T07:56:29.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:29.393+0000 7f9a90875700 1 -- 172.21.15.26:0/3783426579 wait complete. 2023-10-01T07:56:29.407 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:30.096 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:30.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.242+0000 7f8e28761700 1 Processor -- start 2023-10-01T07:56:30.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.242+0000 7f8e28761700 1 -- start start 2023-10-01T07:56:30.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.243+0000 7f8e28761700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8e20133420 0x7f8e201337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:30.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.243+0000 7f8e28761700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e20134260 0x7f8e201306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:30.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.243+0000 7f8e28761700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e2006b990 con 0x7f8e20133e30 2023-10-01T07:56:30.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.243+0000 7f8e28761700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e200a0590 con 0x7f8e20133420 2023-10-01T07:56:30.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.243+0000 7f8e28761700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2009fb80 con 0x7f8e20134260 2023-10-01T07:56:30.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.243+0000 7f8e264fd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8e20133420 0x7f8e201337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:30.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.243+0000 7f8e26cfe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e20134260 0x7f8e201306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:30.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.243+0000 7f8e264fd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8e20133420 0x7f8e201337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49750/0 (socket says 172.21.15.26:49750) 2023-10-01T07:56:30.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.243+0000 7f8e26cfe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e20134260 0x7f8e201306a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33628/0 (socket says 172.21.15.26:33628) 2023-10-01T07:56:30.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.243+0000 7f8e264fd700 1 -- 172.21.15.26:0/579752523 learned_addr learned my addr 172.21.15.26:0/579752523 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:30.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.243+0000 7f8e26cfe700 1 -- 172.21.15.26:0/579752523 >> v2:172.21.15.26:3300/0 conn(0x7f8e20133420 msgr2=0x7f8e201337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:30.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.243+0000 7f8e26cfe700 1 --2- 172.21.15.26:0/579752523 >> v2:172.21.15.26:3300/0 conn(0x7f8e20133420 0x7f8e201337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:30.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.243+0000 7f8e26cfe700 1 -- 172.21.15.26:0/579752523 >> v1:172.21.15.26:6789/0 conn(0x7f8e20133e30 legacy=0x7f8e2012ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:30.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.243+0000 7f8e26cfe700 1 -- 172.21.15.26:0/579752523 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e200a0030 con 0x7f8e20134260 2023-10-01T07:56:30.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.243+0000 7f8e264fd700 1 --2- 172.21.15.26:0/579752523 >> v2:172.21.15.26:3300/0 conn(0x7f8e20133420 0x7f8e201337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:30.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.244+0000 7f8e26cfe700 1 --2- 172.21.15.26:0/579752523 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e20134260 0x7f8e201306a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8e18009d90 tx=0x7f8e1800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb8db2edb98956f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:30.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.244+0000 7f8e254fb700 1 -- 172.21.15.26:0/579752523 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1800e070 con 0x7f8e20134260 2023-10-01T07:56:30.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.244+0000 7f8e254fb700 1 -- 172.21.15.26:0/579752523 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1800bb20 con 0x7f8e20134260 2023-10-01T07:56:30.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.244+0000 7f8e254fb700 1 -- 172.21.15.26:0/579752523 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e18012430 con 0x7f8e20134260 2023-10-01T07:56:30.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.244+0000 7f8e28761700 1 -- 172.21.15.26:0/579752523 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e20134260 msgr2=0x7f8e201306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:30.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.244+0000 7f8e28761700 1 --2- 172.21.15.26:0/579752523 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e20134260 0x7f8e201306a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8e18009d90 tx=0x7f8e1800b330 comp rx=0 tx=0).stop 2023-10-01T07:56:30.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.244+0000 7f8e28761700 1 -- 172.21.15.26:0/579752523 shutdown_connections 2023-10-01T07:56:30.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.244+0000 7f8e28761700 1 --2- 172.21.15.26:0/579752523 >> v2:172.21.15.26:3300/0 conn(0x7f8e20133420 0x7f8e201337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:30.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.244+0000 7f8e28761700 1 --2- 172.21.15.26:0/579752523 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e20134260 0x7f8e201306a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:30.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.244+0000 7f8e28761700 1 -- 172.21.15.26:0/579752523 >> 172.21.15.26:0/579752523 conn(0x7f8e200a4210 msgr2=0x7f8e200a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:30.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.245+0000 7f8e28761700 1 -- 172.21.15.26:0/579752523 shutdown_connections 2023-10-01T07:56:30.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.245+0000 7f8e28761700 1 -- 172.21.15.26:0/579752523 wait complete. 2023-10-01T07:56:30.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.245+0000 7f8e28761700 1 Processor -- start 2023-10-01T07:56:30.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.246+0000 7f8e28761700 1 -- start start 2023-10-01T07:56:30.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.246+0000 7f8e28761700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e20133420 0x7f8e2009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:30.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.246+0000 7f8e28761700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e20133e30 0x7f8e2009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:30.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.246+0000 7f8e28761700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e20134260 0x7f8e2009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:30.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.246+0000 7f8e28761700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2011ec40 con 0x7f8e20133420 2023-10-01T07:56:30.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.246+0000 7f8e28761700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e20120e70 con 0x7f8e20133e30 2023-10-01T07:56:30.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.246+0000 7f8e28761700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2011f9e0 con 0x7f8e20134260 2023-10-01T07:56:30.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.246+0000 7f8e264fd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e20133420 0x7f8e2009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:30.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.246+0000 7f8e264fd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e20133420 0x7f8e2009c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49760/0 (socket says 172.21.15.26:49760) 2023-10-01T07:56:30.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.246+0000 7f8e264fd700 1 -- 172.21.15.26:0/384814231 learned_addr learned my addr 172.21.15.26:0/384814231 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:30.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.246+0000 7f8e26cfe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e20134260 0x7f8e2009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:30.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.246+0000 7f8e25cfc700 1 --2- 172.21.15.26:0/384814231 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e20133e30 0x7f8e2009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:30.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.246+0000 7f8e264fd700 1 -- 172.21.15.26:0/384814231 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e20134260 msgr2=0x7f8e2009cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:30.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.247+0000 7f8e264fd700 1 --2- 172.21.15.26:0/384814231 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e20134260 0x7f8e2009cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:30.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.247+0000 7f8e264fd700 1 -- 172.21.15.26:0/384814231 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e20133e30 msgr2=0x7f8e2009c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:30.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.247+0000 7f8e264fd700 1 --2- 172.21.15.26:0/384814231 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e20133e30 0x7f8e2009c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:30.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.247+0000 7f8e264fd700 1 -- 172.21.15.26:0/384814231 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1c009550 con 0x7f8e20133420 2023-10-01T07:56:30.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.247+0000 7f8e25cfc700 1 --2- 172.21.15.26:0/384814231 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e20133e30 0x7f8e2009c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:30.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.247+0000 7f8e26cfe700 1 --2- 172.21.15.26:0/384814231 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e20134260 0x7f8e2009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:30.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.247+0000 7f8e264fd700 1 --2- 172.21.15.26:0/384814231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e20133420 0x7f8e2009c480 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c00ec10 tx=0x7f8e1c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:30.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.247+0000 7f8e16ffd700 1 -- 172.21.15.26:0/384814231 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c00c850 con 0x7f8e20133420 2023-10-01T07:56:30.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.247+0000 7f8e16ffd700 1 -- 172.21.15.26:0/384814231 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1c00c9b0 con 0x7f8e20133420 2023-10-01T07:56:30.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.247+0000 7f8e28761700 1 -- 172.21.15.26:0/384814231 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e18009a70 con 0x7f8e20133420 2023-10-01T07:56:30.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.247+0000 7f8e16ffd700 1 -- 172.21.15.26:0/384814231 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c00cd40 con 0x7f8e20133420 2023-10-01T07:56:30.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.247+0000 7f8e28761700 1 -- 172.21.15.26:0/384814231 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e20120a20 con 0x7f8e20133420 2023-10-01T07:56:30.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.248+0000 7f8e16ffd700 1 -- 172.21.15.26:0/384814231 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e1c013470 con 0x7f8e20133420 2023-10-01T07:56:30.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.248+0000 7f8e16ffd700 1 -- 172.21.15.26:0/384814231 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8e1c03fc40 con 0x7f8e20133420 2023-10-01T07:56:30.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.248+0000 7f8e28761700 1 -- 172.21.15.26:0/384814231 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e2011ea90 con 0x7f8e20133420 2023-10-01T07:56:30.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.253+0000 7f8e16ffd700 1 -- 172.21.15.26:0/384814231 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e1c021070 con 0x7f8e20133420 2023-10-01T07:56:30.319 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:30.377 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:30.408 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:30.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.462+0000 7f8e28761700 1 -- 172.21.15.26:0/384814231 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8e20074ea0 con 0x7f8e20133420 2023-10-01T07:56:30.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.462+0000 7f8e16ffd700 1 -- 172.21.15.26:0/384814231 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8e1c02a090 con 0x7f8e20133420 2023-10-01T07:56:30.463 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:30.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.463+0000 7f722cbcc700 1 Processor -- start 2023-10-01T07:56:30.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.463+0000 7f722cbcc700 1 -- start start 2023-10-01T07:56:30.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.463+0000 7f722cbcc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f722809d6f0 0x7f722809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:30.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.463+0000 7f722cbcc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f722809e000 0x7f7228130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:30.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.463+0000 7f722cbcc700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f722809f130 con 0x7f722809e410 2023-10-01T07:56:30.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.463+0000 7f722cbcc700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f722809f520 con 0x7f722809d6f0 2023-10-01T07:56:30.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.463+0000 7f722cbcc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f722809e930 con 0x7f722809e000 2023-10-01T07:56:30.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.464+0000 7f7226d9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f722809e410 0x7f7228130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59224/0 (socket says 172.21.15.26:59224) 2023-10-01T07:56:30.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.464+0000 7f7226d9d700 1 -- 172.21.15.26:0/1365555639 learned_addr learned my addr 172.21.15.26:0/1365555639 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:30.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.464+0000 7f722659c700 1 --2- 172.21.15.26:0/1365555639 >> v2:172.21.15.26:3300/0 conn(0x7f722809d6f0 0x7f722809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:30.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.464+0000 7f722659c700 1 -- 172.21.15.26:0/1365555639 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f722809e000 msgr2=0x7f7228130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:30.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.464+0000 7f722659c700 1 --2- 172.21.15.26:0/1365555639 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f722809e000 0x7f7228130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:30.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.464+0000 7f722659c700 1 -- 172.21.15.26:0/1365555639 >> v1:172.21.15.26:6789/0 conn(0x7f722809e410 legacy=0x7f7228130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:30.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.464+0000 7f722559a700 1 -- 172.21.15.26:0/1365555639 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 713431998 0 0) 0x7f722809f130 con 0x7f722809e410 2023-10-01T07:56:30.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.464+0000 7f722659c700 1 -- 172.21.15.26:0/1365555639 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f722809b2d0 con 0x7f722809d6f0 2023-10-01T07:56:30.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.464+0000 7f722659c700 1 --2- 172.21.15.26:0/1365555639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f722809d6f0 0x7f722809dac0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7218009840 tx=0x7f7218009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e8d3e77bbcbe817 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:30.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.464+0000 7f722559a700 1 -- 172.21.15.26:0/1365555639 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721800f8a0 con 0x7f722809d6f0 2023-10-01T07:56:30.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.464+0000 7f722559a700 1 -- 172.21.15.26:0/1365555639 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721800fa00 con 0x7f722809d6f0 2023-10-01T07:56:30.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.464+0000 7f722559a700 1 -- 172.21.15.26:0/1365555639 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721800fd90 con 0x7f722809d6f0 2023-10-01T07:56:30.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.465+0000 7f722cbcc700 1 -- 172.21.15.26:0/1365555639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f722809d6f0 msgr2=0x7f722809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:30.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.465+0000 7f722cbcc700 1 --2- 172.21.15.26:0/1365555639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f722809d6f0 0x7f722809dac0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7218009840 tx=0x7f7218009b50 comp rx=0 tx=0).stop 2023-10-01T07:56:30.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.465+0000 7f722cbcc700 1 -- 172.21.15.26:0/1365555639 shutdown_connections 2023-10-01T07:56:30.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.465+0000 7f722cbcc700 1 --2- 172.21.15.26:0/1365555639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f722809d6f0 0x7f722809dac0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:30.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.465+0000 7f722cbcc700 1 --2- 172.21.15.26:0/1365555639 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f722809e000 0x7f7228130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:30.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.465+0000 7f722cbcc700 1 -- 172.21.15.26:0/1365555639 >> 172.21.15.26:0/1365555639 conn(0x7f7228066f50 msgr2=0x7f722809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:30.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.465+0000 7f722cbcc700 1 -- 172.21.15.26:0/1365555639 shutdown_connections 2023-10-01T07:56:30.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.465+0000 7f722cbcc700 1 -- 172.21.15.26:0/1365555639 wait complete. 2023-10-01T07:56:30.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.466+0000 7f8e28761700 1 -- 172.21.15.26:0/384814231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e20133420 msgr2=0x7f8e2009c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:30.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.466+0000 7f8e28761700 1 --2- 172.21.15.26:0/384814231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e20133420 0x7f8e2009c480 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c00ec10 tx=0x7f8e1c00ef20 comp rx=0 tx=0).stop 2023-10-01T07:56:30.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.466+0000 7f8e28761700 1 -- 172.21.15.26:0/384814231 shutdown_connections 2023-10-01T07:56:30.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.466+0000 7f8e28761700 1 --2- 172.21.15.26:0/384814231 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e20134260 0x7f8e2009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:30.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.466+0000 7f8e28761700 1 --2- 172.21.15.26:0/384814231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e20133420 0x7f8e2009c480 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:30.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.466+0000 7f8e28761700 1 --2- 172.21.15.26:0/384814231 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e20133e30 0x7f8e2009c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:30.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.466+0000 7f8e28761700 1 -- 172.21.15.26:0/384814231 >> 172.21.15.26:0/384814231 conn(0x7f8e200a4210 msgr2=0x7f8e200a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:30.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.466+0000 7f8e28761700 1 -- 172.21.15.26:0/384814231 shutdown_connections 2023-10-01T07:56:30.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.467+0000 7f8e28761700 1 -- 172.21.15.26:0/384814231 wait complete. 2023-10-01T07:56:30.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.467+0000 7f722cbcc700 1 Processor -- start 2023-10-01T07:56:30.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.467+0000 7f722cbcc700 1 -- start start 2023-10-01T07:56:30.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.468+0000 7f722cbcc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f722809d6f0 0x7f7228122420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:30.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.468+0000 7f722cbcc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f722809e000 0x7f7228122960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:30.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.468+0000 7f722cbcc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f722809e410 0x7f7228122ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:30.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.468+0000 7f722cbcc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7228125f40 con 0x7f722809d6f0 2023-10-01T07:56:30.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.468+0000 7f722cbcc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7228124030 con 0x7f722809e000 2023-10-01T07:56:30.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.468+0000 7f722cbcc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7228072130 con 0x7f722809e410 2023-10-01T07:56:30.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.468+0000 7f722659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f722809d6f0 0x7f7228122420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:30.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.468+0000 7f722659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f722809d6f0 0x7f7228122420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49784/0 (socket says 172.21.15.26:49784) 2023-10-01T07:56:30.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.468+0000 7f722659c700 1 -- 172.21.15.26:0/3873658656 learned_addr learned my addr 172.21.15.26:0/3873658656 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:30.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.468+0000 7f7226d9d700 1 --2- 172.21.15.26:0/3873658656 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f722809e410 0x7f7228122ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:30.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.468+0000 7f7225d9b700 1 --2- 172.21.15.26:0/3873658656 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f722809e000 0x7f7228122960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:30.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.469+0000 7f722659c700 1 -- 172.21.15.26:0/3873658656 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f722809e410 msgr2=0x7f7228122ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:30.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.469+0000 7f722659c700 1 --2- 172.21.15.26:0/3873658656 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f722809e410 0x7f7228122ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:30.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.469+0000 7f722659c700 1 -- 172.21.15.26:0/3873658656 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f722809e000 msgr2=0x7f7228122960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:30.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.469+0000 7f722659c700 1 --2- 172.21.15.26:0/3873658656 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f722809e000 0x7f7228122960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:30.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.469+0000 7f722659c700 1 -- 172.21.15.26:0/3873658656 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72180094a0 con 0x7f722809d6f0 2023-10-01T07:56:30.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.469+0000 7f722659c700 1 --2- 172.21.15.26:0/3873658656 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f722809d6f0 0x7f7228122420 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f72180090b0 tx=0x7f7218004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:30.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.469+0000 7f7216ffd700 1 -- 172.21.15.26:0/3873658656 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72180038a0 con 0x7f722809d6f0 2023-10-01T07:56:30.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.469+0000 7f7216ffd700 1 -- 172.21.15.26:0/3873658656 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7218003a20 con 0x7f722809d6f0 2023-10-01T07:56:30.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.469+0000 7f7216ffd700 1 -- 172.21.15.26:0/3873658656 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7218003dd0 con 0x7f722809d6f0 2023-10-01T07:56:30.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.469+0000 7f722cbcc700 1 -- 172.21.15.26:0/3873658656 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f722809c760 con 0x7f722809d6f0 2023-10-01T07:56:30.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.469+0000 7f722cbcc700 1 -- 172.21.15.26:0/3873658656 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7228126440 con 0x7f722809d6f0 2023-10-01T07:56:30.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.470+0000 7f7216ffd700 1 -- 172.21.15.26:0/3873658656 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7218019400 con 0x7f722809d6f0 2023-10-01T07:56:30.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.470+0000 7f7216ffd700 1 -- 172.21.15.26:0/3873658656 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7218040dc0 con 0x7f722809d6f0 2023-10-01T07:56:30.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.474+0000 7f722cbcc700 1 -- 172.21.15.26:0/3873658656 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7228125900 con 0x7f722809d6f0 2023-10-01T07:56:30.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.479+0000 7f7216ffd700 1 -- 172.21.15.26:0/3873658656 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7228125900 con 0x7f722809d6f0 2023-10-01T07:56:30.485 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:30.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.526+0000 7fd6cb96c700 1 Processor -- start 2023-10-01T07:56:30.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.526+0000 7fd6cb96c700 1 -- start start 2023-10-01T07:56:30.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.527+0000 7fd6cb96c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd6c409d6f0 0x7fd6c409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:30.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.527+0000 7fd6cb96c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6c409e000 0x7fd6c4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:30.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.527+0000 7fd6cb96c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c409f130 con 0x7fd6c409e410 2023-10-01T07:56:30.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.527+0000 7fd6cb96c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c409f520 con 0x7fd6c409d6f0 2023-10-01T07:56:30.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.527+0000 7fd6cb96c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c409e930 con 0x7fd6c409e000 2023-10-01T07:56:30.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.527+0000 7fd6c9708700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd6c409d6f0 0x7fd6c409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:30.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.527+0000 7fd6c9f09700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd6c409e410 0x7fd6c4130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59234/0 (socket says 172.21.15.26:59234) 2023-10-01T07:56:30.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.527+0000 7fd6c9708700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd6c409d6f0 0x7fd6c409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49794/0 (socket says 172.21.15.26:49794) 2023-10-01T07:56:30.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.527+0000 7fd6c9f09700 1 -- 172.21.15.26:0/2230906689 learned_addr learned my addr 172.21.15.26:0/2230906689 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:30.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.527+0000 7fd6c8f07700 1 --2- 172.21.15.26:0/2230906689 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6c409e000 0x7fd6c4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:30.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.527+0000 7fd6c9708700 1 -- 172.21.15.26:0/2230906689 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6c409e000 msgr2=0x7fd6c4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:30.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.527+0000 7fd6c9708700 1 --2- 172.21.15.26:0/2230906689 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6c409e000 0x7fd6c4130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:30.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.527+0000 7fd6c9708700 1 -- 172.21.15.26:0/2230906689 >> v1:172.21.15.26:6789/0 conn(0x7fd6c409e410 legacy=0x7fd6c4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:30.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.527+0000 7fd6bbfff700 1 -- 172.21.15.26:0/2230906689 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 893092082 0 0) 0x7fd6c409f130 con 0x7fd6c409e410 2023-10-01T07:56:30.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.527+0000 7fd6c9708700 1 -- 172.21.15.26:0/2230906689 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c409b2d0 con 0x7fd6c409d6f0 2023-10-01T07:56:30.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.528+0000 7fd6c9708700 1 --2- 172.21.15.26:0/2230906689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6c409d6f0 0x7fd6c409dac0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd6c000dd90 tx=0x7fd6c000f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14e2223dc0e3f6ff server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:30.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.528+0000 7fd6bbfff700 1 -- 172.21.15.26:0/2230906689 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c0012070 con 0x7fd6c409d6f0 2023-10-01T07:56:30.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.528+0000 7fd6bbfff700 1 -- 172.21.15.26:0/2230906689 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c000fb20 con 0x7fd6c409d6f0 2023-10-01T07:56:30.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.528+0000 7fd6bbfff700 1 -- 172.21.15.26:0/2230906689 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c0016430 con 0x7fd6c409d6f0 2023-10-01T07:56:30.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.528+0000 7fd6cb96c700 1 -- 172.21.15.26:0/2230906689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6c409d6f0 msgr2=0x7fd6c409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:30.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.528+0000 7fd6cb96c700 1 --2- 172.21.15.26:0/2230906689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6c409d6f0 0x7fd6c409dac0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd6c000dd90 tx=0x7fd6c000f330 comp rx=0 tx=0).stop 2023-10-01T07:56:30.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.529+0000 7fd6cb96c700 1 -- 172.21.15.26:0/2230906689 shutdown_connections 2023-10-01T07:56:30.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.529+0000 7fd6cb96c700 1 --2- 172.21.15.26:0/2230906689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6c409d6f0 0x7fd6c409dac0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:30.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.529+0000 7fd6cb96c700 1 --2- 172.21.15.26:0/2230906689 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6c409e000 0x7fd6c4130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:30.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.529+0000 7fd6cb96c700 1 -- 172.21.15.26:0/2230906689 >> 172.21.15.26:0/2230906689 conn(0x7fd6c4066f50 msgr2=0x7fd6c409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:30.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.529+0000 7fd6cb96c700 1 -- 172.21.15.26:0/2230906689 shutdown_connections 2023-10-01T07:56:30.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.529+0000 7fd6cb96c700 1 -- 172.21.15.26:0/2230906689 wait complete. 2023-10-01T07:56:30.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.530+0000 7fd6cb96c700 1 Processor -- start 2023-10-01T07:56:30.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.530+0000 7fd6cb96c700 1 -- start start 2023-10-01T07:56:30.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.531+0000 7fd6cb96c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6c409d6f0 0x7fd6c411de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:30.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.531+0000 7fd6cb96c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6c409e000 0x7fd6c411e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:30.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.531+0000 7fd6cb96c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6c409e410 0x7fd6c411e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:30.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.531+0000 7fd6cb96c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c411f300 con 0x7fd6c409e410 2023-10-01T07:56:30.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.531+0000 7fd6cb96c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c411fa60 con 0x7fd6c409e000 2023-10-01T07:56:30.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.531+0000 7fd6cb96c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c4120cb0 con 0x7fd6c409d6f0 2023-10-01T07:56:30.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.531+0000 7fd6c8f07700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6c409e000 0x7fd6c411e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:30.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.531+0000 7fd6c9f09700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6c409e410 0x7fd6c411e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:30.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.531+0000 7fd6c8f07700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6c409e000 0x7fd6c411e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33684/0 (socket says 172.21.15.26:33684) 2023-10-01T07:56:30.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.531+0000 7fd6c8f07700 1 -- 172.21.15.26:0/37987158 learned_addr learned my addr 172.21.15.26:0/37987158 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:30.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.531+0000 7fd6c9708700 1 --2- 172.21.15.26:0/37987158 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6c409d6f0 0x7fd6c411de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:30.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.532+0000 7fd6c8f07700 1 -- 172.21.15.26:0/37987158 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6c409d6f0 msgr2=0x7fd6c411de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:30.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.532+0000 7fd6c8f07700 1 --2- 172.21.15.26:0/37987158 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6c409d6f0 0x7fd6c411de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:30.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.532+0000 7fd6c8f07700 1 -- 172.21.15.26:0/37987158 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6c409e410 msgr2=0x7fd6c411e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:30.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.532+0000 7fd6c8f07700 1 --2- 172.21.15.26:0/37987158 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6c409e410 0x7fd6c411e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:30.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.532+0000 7fd6c8f07700 1 -- 172.21.15.26:0/37987158 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c000da70 con 0x7fd6c409e000 2023-10-01T07:56:30.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.532+0000 7fd6c9f09700 1 --2- 172.21.15.26:0/37987158 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6c409e410 0x7fd6c411e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:30.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.532+0000 7fd6c8f07700 1 --2- 172.21.15.26:0/37987158 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6c409e000 0x7fd6c411e390 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd6b400e9b0 tx=0x7fd6b400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:30.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.532+0000 7fd6b9ffb700 1 -- 172.21.15.26:0/37987158 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b4009710 con 0x7fd6c409e000 2023-10-01T07:56:30.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.532+0000 7fd6b9ffb700 1 -- 172.21.15.26:0/37987158 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b400ee50 con 0x7fd6c409e000 2023-10-01T07:56:30.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.532+0000 7fd6b9ffb700 1 -- 172.21.15.26:0/37987158 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b400ca50 con 0x7fd6c409e000 2023-10-01T07:56:30.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.532+0000 7fd6cb96c700 1 -- 172.21.15.26:0/37987158 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c4121690 con 0x7fd6c409e000 2023-10-01T07:56:30.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.532+0000 7fd6cb96c700 1 -- 172.21.15.26:0/37987158 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c40a2090 con 0x7fd6c409e000 2023-10-01T07:56:30.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.533+0000 7fd6cb96c700 1 -- 172.21.15.26:0/37987158 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6c411ac20 con 0x7fd6c409e000 2023-10-01T07:56:30.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.534+0000 7fd6b9ffb700 1 -- 172.21.15.26:0/37987158 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd6b400cbb0 con 0x7fd6c409e000 2023-10-01T07:56:30.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.534+0000 7fd6b9ffb700 1 -- 172.21.15.26:0/37987158 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd6b403f6f0 con 0x7fd6c409e000 2023-10-01T07:56:30.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.539+0000 7fd6b9ffb700 1 -- 172.21.15.26:0/37987158 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd6b4013470 con 0x7fd6c409e000 2023-10-01T07:56:30.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.576+0000 7fd6a56d1700 1 Processor -- start 2023-10-01T07:56:30.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.576+0000 7fd6a56d1700 1 -- start start 2023-10-01T07:56:30.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.577+0000 7fd6a56d1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd6a00a0a30 0x7fd6a00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:30.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.577+0000 7fd6a56d1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6a0138d80 0x7fd6a013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:30.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.577+0000 7fd6a56d1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6a00a2a70 con 0x7fd6a009d630 2023-10-01T07:56:30.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.577+0000 7fd6a56d1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6a00a01d0 con 0x7fd6a00a0a30 2023-10-01T07:56:30.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.577+0000 7fd6a56d1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a009e2b0 con 0x7fd6a0138d80 2023-10-01T07:56:30.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.577+0000 7fd69effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd6a00a0a30 0x7fd6a00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:30.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.577+0000 7fd69f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6a0138d80 0x7fd6a013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:30.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.577+0000 7fd69effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd6a00a0a30 0x7fd6a00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49814/0 (socket says 172.21.15.26:49814) 2023-10-01T07:56:30.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.577+0000 7fd69effd700 1 -- 172.21.15.26:0/3270542165 learned_addr learned my addr 172.21.15.26:0/3270542165 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:30.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.577+0000 7fd69effd700 1 -- 172.21.15.26:0/3270542165 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6a0138d80 msgr2=0x7fd6a013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:30.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.577+0000 7fd69effd700 1 --2- 172.21.15.26:0/3270542165 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6a0138d80 0x7fd6a013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:30.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.577+0000 7fd69effd700 1 -- 172.21.15.26:0/3270542165 >> v1:172.21.15.26:6789/0 conn(0x7fd6a009d630 legacy=0x7fd6a00a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:30.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.577+0000 7fd69effd700 1 -- 172.21.15.26:0/3270542165 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a009dc50 con 0x7fd6a00a0a30 2023-10-01T07:56:30.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.577+0000 7fd69f7fe700 1 --2- 172.21.15.26:0/3270542165 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6a0138d80 0x7fd6a013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:30.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.578+0000 7fd69effd700 1 --2- 172.21.15.26:0/3270542165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6a00a0a30 0x7fd6a00a0e00 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd6900098f0 tx=0x7fd690009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54f4ee12e4a1e83c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:30.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.578+0000 7fd69e7fc700 1 -- 172.21.15.26:0/3270542165 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd690011830 con 0x7fd6a00a0a30 2023-10-01T07:56:30.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.578+0000 7fd69e7fc700 1 -- 172.21.15.26:0/3270542165 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd690011990 con 0x7fd6a00a0a30 2023-10-01T07:56:30.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.578+0000 7fd69e7fc700 1 -- 172.21.15.26:0/3270542165 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd690011d20 con 0x7fd6a00a0a30 2023-10-01T07:56:30.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.578+0000 7fd6a56d1700 1 -- 172.21.15.26:0/3270542165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6a00a0a30 msgr2=0x7fd6a00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:30.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.578+0000 7fd6a56d1700 1 --2- 172.21.15.26:0/3270542165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6a00a0a30 0x7fd6a00a0e00 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd6900098f0 tx=0x7fd690009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:30.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.578+0000 7fd6a56d1700 1 -- 172.21.15.26:0/3270542165 shutdown_connections 2023-10-01T07:56:30.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.578+0000 7fd6a56d1700 1 --2- 172.21.15.26:0/3270542165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6a00a0a30 0x7fd6a00a0e00 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:30.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.579+0000 7fd6a56d1700 1 --2- 172.21.15.26:0/3270542165 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6a0138d80 0x7fd6a013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:30.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.579+0000 7fd6a56d1700 1 -- 172.21.15.26:0/3270542165 >> 172.21.15.26:0/3270542165 conn(0x7fd6a00a3050 msgr2=0x7fd6a00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:30.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.579+0000 7fd6a56d1700 1 -- 172.21.15.26:0/3270542165 shutdown_connections 2023-10-01T07:56:30.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.579+0000 7fd6a56d1700 1 -- 172.21.15.26:0/3270542165 wait complete. 2023-10-01T07:56:30.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.580+0000 7fd6a56d1700 1 Processor -- start 2023-10-01T07:56:30.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.580+0000 7fd6a56d1700 1 -- start start 2023-10-01T07:56:30.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.580+0000 7fd6a56d1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6a009d630 0x7fd6a0133910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:30.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.580+0000 7fd6a56d1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6a00a0a30 0x7fd6a0133e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:30.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.580+0000 7fd6a56d1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6a0138d80 0x7fd6a0134390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:30.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.580+0000 7fd6a56d1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a00a4e60 con 0x7fd6a009d630 2023-10-01T07:56:30.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.580+0000 7fd6a56d1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a0138120 con 0x7fd6a0138d80 2023-10-01T07:56:30.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.580+0000 7fd6a56d1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a0137150 con 0x7fd6a00a0a30 2023-10-01T07:56:30.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.580+0000 7fd69effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6a009d630 0x7fd6a0133910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:30.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.580+0000 7fd69effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6a009d630 0x7fd6a0133910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49820/0 (socket says 172.21.15.26:49820) 2023-10-01T07:56:30.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.581+0000 7fd69effd700 1 -- 172.21.15.26:0/1773941505 learned_addr learned my addr 172.21.15.26:0/1773941505 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:30.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.581+0000 7fd6967fc700 1 --2- 172.21.15.26:0/1773941505 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6a00a0a30 0x7fd6a0133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:30.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.581+0000 7fd69f7fe700 1 --2- 172.21.15.26:0/1773941505 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6a0138d80 0x7fd6a0134390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:30.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.581+0000 7fd69effd700 1 -- 172.21.15.26:0/1773941505 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6a00a0a30 msgr2=0x7fd6a0133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:30.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.581+0000 7fd69effd700 1 --2- 172.21.15.26:0/1773941505 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6a00a0a30 0x7fd6a0133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:30.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.581+0000 7fd69effd700 1 -- 172.21.15.26:0/1773941505 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6a0138d80 msgr2=0x7fd6a0134390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:30.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.581+0000 7fd69effd700 1 --2- 172.21.15.26:0/1773941505 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6a0138d80 0x7fd6a0134390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:30.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.581+0000 7fd69effd700 1 -- 172.21.15.26:0/1773941505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd698009a70 con 0x7fd6a009d630 2023-10-01T07:56:30.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.581+0000 7fd69effd700 1 --2- 172.21.15.26:0/1773941505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6a009d630 0x7fd6a0133910 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd690009c40 tx=0x7fd690004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:30.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.581+0000 7fd697fff700 1 -- 172.21.15.26:0/1773941505 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd690004550 con 0x7fd6a009d630 2023-10-01T07:56:30.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.581+0000 7fd697fff700 1 -- 172.21.15.26:0/1773941505 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6900036a0 con 0x7fd6a009d630 2023-10-01T07:56:30.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.581+0000 7fd697fff700 1 -- 172.21.15.26:0/1773941505 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd690003a30 con 0x7fd6a009d630 2023-10-01T07:56:30.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.581+0000 7fd6a56d1700 1 -- 172.21.15.26:0/1773941505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd690009550 con 0x7fd6a009d630 2023-10-01T07:56:30.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.581+0000 7fd6a56d1700 1 -- 172.21.15.26:0/1773941505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6a0135a70 con 0x7fd6a009d630 2023-10-01T07:56:30.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.582+0000 7fd697fff700 1 -- 172.21.15.26:0/1773941505 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd690021070 con 0x7fd6a009d630 2023-10-01T07:56:30.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.582+0000 7fd697fff700 1 -- 172.21.15.26:0/1773941505 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd690040a20 con 0x7fd6a009d630 2023-10-01T07:56:30.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.583+0000 7fd6a56d1700 1 -- 172.21.15.26:0/1773941505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6a00747f0 con 0x7fd6a009d630 2023-10-01T07:56:30.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.588+0000 7fd697fff700 1 -- 172.21.15.26:0/1773941505 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd690015080 con 0x7fd6a009d630 2023-10-01T07:56:30.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.702+0000 7f722cbcc700 1 -- 172.21.15.26:0/3873658656 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7228125900 con 0x7f722809d6f0 2023-10-01T07:56:30.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.702+0000 7f7216ffd700 1 -- 172.21.15.26:0/3873658656 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7228125900 con 0x7f722809d6f0 2023-10-01T07:56:30.703 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:30.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.704+0000 7f722cbcc700 1 -- 172.21.15.26:0/3873658656 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f722809d6f0 msgr2=0x7f7228122420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:30.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.704+0000 7f722cbcc700 1 --2- 172.21.15.26:0/3873658656 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f722809d6f0 0x7f7228122420 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f72180090b0 tx=0x7f7218004750 comp rx=0 tx=0).stop 2023-10-01T07:56:30.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.704+0000 7f722cbcc700 1 -- 172.21.15.26:0/3873658656 shutdown_connections 2023-10-01T07:56:30.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.704+0000 7f722cbcc700 1 --2- 172.21.15.26:0/3873658656 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f722809e410 0x7f7228122ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:30.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.704+0000 7f722cbcc700 1 --2- 172.21.15.26:0/3873658656 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f722809d6f0 0x7f7228122420 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:30.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.704+0000 7f722cbcc700 1 --2- 172.21.15.26:0/3873658656 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f722809e000 0x7f7228122960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:30.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.704+0000 7f722cbcc700 1 -- 172.21.15.26:0/3873658656 >> 172.21.15.26:0/3873658656 conn(0x7f7228066f50 msgr2=0x7f7228130ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:30.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.704+0000 7f722cbcc700 1 -- 172.21.15.26:0/3873658656 shutdown_connections 2023-10-01T07:56:30.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.705+0000 7f722cbcc700 1 -- 172.21.15.26:0/3873658656 wait complete. 2023-10-01T07:56:30.719 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:30.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.748+0000 7fd6cb96c700 1 -- 172.21.15.26:0/37987158 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd6c4074ea0 con 0x7fd6c409e000 2023-10-01T07:56:30.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.749+0000 7fd6b9ffb700 1 -- 172.21.15.26:0/37987158 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd6b4017070 con 0x7fd6c409e000 2023-10-01T07:56:30.749 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:30.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.752+0000 7fd6cb96c700 1 -- 172.21.15.26:0/37987158 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6c409e000 msgr2=0x7fd6c411e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:30.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.752+0000 7fd6cb96c700 1 --2- 172.21.15.26:0/37987158 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6c409e000 0x7fd6c411e390 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd6b400e9b0 tx=0x7fd6b400ecc0 comp rx=0 tx=0).stop 2023-10-01T07:56:30.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.752+0000 7fd6cb96c700 1 -- 172.21.15.26:0/37987158 shutdown_connections 2023-10-01T07:56:30.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.752+0000 7fd6cb96c700 1 --2- 172.21.15.26:0/37987158 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6c409e410 0x7fd6c411e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:30.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.752+0000 7fd6cb96c700 1 --2- 172.21.15.26:0/37987158 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6c409d6f0 0x7fd6c411de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:30.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.752+0000 7fd6cb96c700 1 --2- 172.21.15.26:0/37987158 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6c409e000 0x7fd6c411e390 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:30.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.752+0000 7fd6cb96c700 1 -- 172.21.15.26:0/37987158 >> 172.21.15.26:0/37987158 conn(0x7fd6c4066f50 msgr2=0x7fd6c41308e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:30.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.752+0000 7fd6cb96c700 1 -- 172.21.15.26:0/37987158 shutdown_connections 2023-10-01T07:56:30.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.752+0000 7fd6cb96c700 1 -- 172.21.15.26:0/37987158 wait complete. 2023-10-01T07:56:30.773 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:30.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.806+0000 7fd6a56d1700 1 -- 172.21.15.26:0/1773941505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd6a0072980 con 0x7fd6a009d630 2023-10-01T07:56:30.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.807+0000 7fd697fff700 1 -- 172.21.15.26:0/1773941505 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd690029020 con 0x7fd6a009d630 2023-10-01T07:56:30.807 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:30.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.809+0000 7fd6a56d1700 1 -- 172.21.15.26:0/1773941505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6a009d630 msgr2=0x7fd6a0133910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:30.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.809+0000 7fd6a56d1700 1 --2- 172.21.15.26:0/1773941505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6a009d630 0x7fd6a0133910 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd690009c40 tx=0x7fd690004750 comp rx=0 tx=0).stop 2023-10-01T07:56:30.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.809+0000 7fd6a56d1700 1 -- 172.21.15.26:0/1773941505 shutdown_connections 2023-10-01T07:56:30.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.809+0000 7fd6a56d1700 1 --2- 172.21.15.26:0/1773941505 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6a0138d80 0x7fd6a0134390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:30.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.809+0000 7fd6a56d1700 1 --2- 172.21.15.26:0/1773941505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6a009d630 0x7fd6a0133910 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:30.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.809+0000 7fd6a56d1700 1 --2- 172.21.15.26:0/1773941505 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6a00a0a30 0x7fd6a0133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:30.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.809+0000 7fd6a56d1700 1 -- 172.21.15.26:0/1773941505 >> 172.21.15.26:0/1773941505 conn(0x7fd6a00a3050 msgr2=0x7fd6a009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:30.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.809+0000 7fd6a56d1700 1 -- 172.21.15.26:0/1773941505 shutdown_connections 2023-10-01T07:56:30.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:30.809+0000 7fd6a56d1700 1 -- 172.21.15.26:0/1773941505 wait complete. 2023-10-01T07:56:30.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:31.486 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:31.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.631+0000 7f75053f2700 1 Processor -- start 2023-10-01T07:56:31.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.631+0000 7f75053f2700 1 -- start start 2023-10-01T07:56:31.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.631+0000 7f75053f2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7500133870 0x7f7500133c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:31.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.632+0000 7f75053f2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7500134180 0x7f750009de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:31.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.632+0000 7f75053f2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f750009e390 0x7f750009e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:31.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.632+0000 7f75053f2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75001334b0 con 0x7f750009e390 2023-10-01T07:56:31.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.632+0000 7f75053f2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f750006fb20 con 0x7f7500134180 2023-10-01T07:56:31.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.632+0000 7f75053f2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f750009fa40 con 0x7f7500133870 2023-10-01T07:56:31.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.632+0000 7f74feffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7500133870 0x7f7500133c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:31.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.632+0000 7f74fe7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7500134180 0x7f750009de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:31.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.632+0000 7f74ff7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f750009e390 0x7f750009e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:31.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.632+0000 7f74feffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7500133870 0x7f7500133c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:33278/0 (socket says 172.21.15.26:33278) 2023-10-01T07:56:31.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.632+0000 7f74feffd700 1 -- 172.21.15.26:0/1037737101 learned_addr learned my addr 172.21.15.26:0/1037737101 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:31.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.632+0000 7f74feffd700 1 -- 172.21.15.26:0/1037737101 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7500134180 msgr2=0x7f750009de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:31.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.632+0000 7f74feffd700 1 --2- 172.21.15.26:0/1037737101 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7500134180 0x7f750009de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:31.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.632+0000 7f74feffd700 1 -- 172.21.15.26:0/1037737101 >> v2:172.21.15.26:3300/0 conn(0x7f750009e390 msgr2=0x7f750009e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:31.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.632+0000 7f74feffd700 1 --2- 172.21.15.26:0/1037737101 >> v2:172.21.15.26:3300/0 conn(0x7f750009e390 0x7f750009e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:31.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.632+0000 7f74feffd700 1 -- 172.21.15.26:0/1037737101 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750006f250 con 0x7f7500133870 2023-10-01T07:56:31.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.632+0000 7f74ff7fe700 1 --2- 172.21.15.26:0/1037737101 >> v2:172.21.15.26:3300/0 conn(0x7f750009e390 0x7f750009e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:31.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.632+0000 7f74fe7fc700 1 --2- 172.21.15.26:0/1037737101 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7500134180 0x7f750009de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:31.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.632+0000 7f74feffd700 1 --2- 172.21.15.26:0/1037737101 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7500133870 0x7f7500133c40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f74e80098f0 tx=0x7f74e8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b4ce4ff1d6a028c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:31.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.632+0000 7f74fdffb700 1 -- 172.21.15.26:0/1037737101 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e8011830 con 0x7f7500133870 2023-10-01T07:56:31.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.633+0000 7f74fdffb700 1 -- 172.21.15.26:0/1037737101 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e8011990 con 0x7f7500133870 2023-10-01T07:56:31.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.633+0000 7f74fdffb700 1 -- 172.21.15.26:0/1037737101 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e8011d20 con 0x7f7500133870 2023-10-01T07:56:31.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.633+0000 7f75053f2700 1 -- 172.21.15.26:0/1037737101 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7500133870 msgr2=0x7f7500133c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:31.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.633+0000 7f75053f2700 1 --2- 172.21.15.26:0/1037737101 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7500133870 0x7f7500133c40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f74e80098f0 tx=0x7f74e8009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:31.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.633+0000 7f75053f2700 1 -- 172.21.15.26:0/1037737101 shutdown_connections 2023-10-01T07:56:31.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.633+0000 7f75053f2700 1 --2- 172.21.15.26:0/1037737101 >> v2:172.21.15.26:3300/0 conn(0x7f750009e390 0x7f750009e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:31.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.633+0000 7f75053f2700 1 --2- 172.21.15.26:0/1037737101 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7500133870 0x7f7500133c40 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:31.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.633+0000 7f75053f2700 1 --2- 172.21.15.26:0/1037737101 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7500134180 0x7f750009de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:31.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.633+0000 7f75053f2700 1 -- 172.21.15.26:0/1037737101 >> 172.21.15.26:0/1037737101 conn(0x7f75000a2610 msgr2=0x7f75000a2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:31.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.633+0000 7f75053f2700 1 -- 172.21.15.26:0/1037737101 shutdown_connections 2023-10-01T07:56:31.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.633+0000 7f75053f2700 1 -- 172.21.15.26:0/1037737101 wait complete. 2023-10-01T07:56:31.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.635+0000 7f75053f2700 1 Processor -- start 2023-10-01T07:56:31.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.635+0000 7f75053f2700 1 -- start start 2023-10-01T07:56:31.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.635+0000 7f75053f2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f750009e390 0x7f750011f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:31.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.635+0000 7f75053f2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7500133870 0x7f750011ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:31.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.635+0000 7f75053f2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7500134180 0x7f7500120450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:31.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.636+0000 7f75053f2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750006f490 con 0x7f750009e390 2023-10-01T07:56:31.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.636+0000 7f75053f2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7500123210 con 0x7f7500134180 2023-10-01T07:56:31.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.636+0000 7f75053f2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f750006ec70 con 0x7f7500133870 2023-10-01T07:56:31.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.636+0000 7f74feffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f750009e390 0x7f750011f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:31.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.636+0000 7f74fe7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7500133870 0x7f750011ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:31.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.636+0000 7f74feffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f750009e390 0x7f750011f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49834/0 (socket says 172.21.15.26:49834) 2023-10-01T07:56:31.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.636+0000 7f74feffd700 1 -- 172.21.15.26:0/283920659 learned_addr learned my addr 172.21.15.26:0/283920659 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:31.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.636+0000 7f74ff7fe700 1 --2- 172.21.15.26:0/283920659 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7500134180 0x7f7500120450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:31.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.636+0000 7f74fe7fc700 1 -- 172.21.15.26:0/283920659 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7500134180 msgr2=0x7f7500120450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:31.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.636+0000 7f74fe7fc700 1 --2- 172.21.15.26:0/283920659 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7500134180 0x7f7500120450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:31.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.636+0000 7f74fe7fc700 1 -- 172.21.15.26:0/283920659 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f750009e390 msgr2=0x7f750011f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:31.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.636+0000 7f74fe7fc700 1 --2- 172.21.15.26:0/283920659 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f750009e390 0x7f750011f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:31.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.636+0000 7f74fe7fc700 1 -- 172.21.15.26:0/283920659 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f8009a70 con 0x7f7500133870 2023-10-01T07:56:31.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.636+0000 7f74feffd700 1 --2- 172.21.15.26:0/283920659 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f750009e390 0x7f750011f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:31.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.636+0000 7f74fe7fc700 1 --2- 172.21.15.26:0/283920659 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7500133870 0x7f750011ff10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7500133410 tx=0x7f74f000ec60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:31.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.636+0000 7f74f77fe700 1 -- 172.21.15.26:0/283920659 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f000c610 con 0x7f7500133870 2023-10-01T07:56:31.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.636+0000 7f74f77fe700 1 -- 172.21.15.26:0/283920659 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f000c770 con 0x7f7500133870 2023-10-01T07:56:31.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.636+0000 7f75053f2700 1 -- 172.21.15.26:0/283920659 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74f00094a0 con 0x7f7500133870 2023-10-01T07:56:31.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.636+0000 7f74f77fe700 1 -- 172.21.15.26:0/283920659 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f000cb00 con 0x7f7500133870 2023-10-01T07:56:31.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.636+0000 7f75053f2700 1 -- 172.21.15.26:0/283920659 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e8009550 con 0x7f7500133870 2023-10-01T07:56:31.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.637+0000 7f74f77fe700 1 -- 172.21.15.26:0/283920659 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f74f000cc60 con 0x7f7500133870 2023-10-01T07:56:31.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.637+0000 7f74f77fe700 1 -- 172.21.15.26:0/283920659 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f74f003f590 con 0x7f7500133870 2023-10-01T07:56:31.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.637+0000 7f75053f2700 1 -- 172.21.15.26:0/283920659 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75000747f0 con 0x7f7500133870 2023-10-01T07:56:31.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.642+0000 7f74f77fe700 1 -- 172.21.15.26:0/283920659 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f74f0017020 con 0x7f7500133870 2023-10-01T07:56:31.720 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:31.774 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:31.825 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:31.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.853+0000 7f75053f2700 1 -- 172.21.15.26:0/283920659 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7500123050 con 0x7f7500133870 2023-10-01T07:56:31.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.854+0000 7f74f77fe700 1 -- 172.21.15.26:0/283920659 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f74f00232f0 con 0x7f7500133870 2023-10-01T07:56:31.854 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:31.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.857+0000 7f75053f2700 1 -- 172.21.15.26:0/283920659 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7500133870 msgr2=0x7f750011ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:31.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.857+0000 7f75053f2700 1 --2- 172.21.15.26:0/283920659 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7500133870 0x7f750011ff10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7500133410 tx=0x7f74f000ec60 comp rx=0 tx=0).stop 2023-10-01T07:56:31.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.858+0000 7f75053f2700 1 -- 172.21.15.26:0/283920659 shutdown_connections 2023-10-01T07:56:31.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.858+0000 7f75053f2700 1 --2- 172.21.15.26:0/283920659 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7500134180 0x7f7500120450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:31.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.858+0000 7f75053f2700 1 --2- 172.21.15.26:0/283920659 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f750009e390 0x7f750011f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:31.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.858+0000 7f75053f2700 1 --2- 172.21.15.26:0/283920659 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7500133870 0x7f750011ff10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:31.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.858+0000 7f75053f2700 1 -- 172.21.15.26:0/283920659 >> 172.21.15.26:0/283920659 conn(0x7f75000a2610 msgr2=0x7f75000a0690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:31.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.860+0000 7f75053f2700 1 -- 172.21.15.26:0/283920659 shutdown_connections 2023-10-01T07:56:31.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.860+0000 7f75053f2700 1 -- 172.21.15.26:0/283920659 wait complete. 2023-10-01T07:56:31.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.863+0000 7f91ef5eb700 1 Processor -- start 2023-10-01T07:56:31.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.863+0000 7f91ef5eb700 1 -- start start 2023-10-01T07:56:31.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.864+0000 7f91ef5eb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91e81338c0 0x7f91e8133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:31.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.864+0000 7f91ef5eb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91e809e560 0x7f91e813b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:31.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.864+0000 7f91ef5eb700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e806f720 con 0x7f91e81341d0 2023-10-01T07:56:31.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.864+0000 7f91ef5eb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e8070c80 con 0x7f91e809e560 2023-10-01T07:56:31.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.864+0000 7f91ef5eb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91e806fce0 con 0x7f91e81338c0 2023-10-01T07:56:31.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.864+0000 7f91ed387700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91e81338c0 0x7f91e8133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:31.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.864+0000 7f91ed387700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91e81338c0 0x7f91e8133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:33294/0 (socket says 172.21.15.26:33294) 2023-10-01T07:56:31.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.864+0000 7f91ed387700 1 -- 172.21.15.26:0/2655804049 learned_addr learned my addr 172.21.15.26:0/2655804049 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:31.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.864+0000 7f91edb88700 1 --2- 172.21.15.26:0/2655804049 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91e809e560 0x7f91e813b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:31.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.865+0000 7f91ed387700 1 -- 172.21.15.26:0/2655804049 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91e809e560 msgr2=0x7f91e813b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:31.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.865+0000 7f91ed387700 1 --2- 172.21.15.26:0/2655804049 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91e809e560 0x7f91e813b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:31.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.865+0000 7f91ed387700 1 -- 172.21.15.26:0/2655804049 >> v1:172.21.15.26:6789/0 conn(0x7f91e81341d0 legacy=0x7f91e809de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:31.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.865+0000 7f91ed387700 1 -- 172.21.15.26:0/2655804049 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e81336a0 con 0x7f91e81338c0 2023-10-01T07:56:31.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.865+0000 7f91ed387700 1 --2- 172.21.15.26:0/2655804049 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91e81338c0 0x7f91e8133c90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f91e4009920 tx=0x7f91e4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e82200808019a6e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:31.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.865+0000 7f91dffff700 1 -- 172.21.15.26:0/2655804049 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e4004230 con 0x7f91e81338c0 2023-10-01T07:56:31.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.865+0000 7f91dffff700 1 -- 172.21.15.26:0/2655804049 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e4004390 con 0x7f91e81338c0 2023-10-01T07:56:31.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.865+0000 7f91dffff700 1 -- 172.21.15.26:0/2655804049 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e40036a0 con 0x7f91e81338c0 2023-10-01T07:56:31.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.866+0000 7f91ef5eb700 1 -- 172.21.15.26:0/2655804049 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91e81338c0 msgr2=0x7f91e8133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:31.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.866+0000 7f91ef5eb700 1 --2- 172.21.15.26:0/2655804049 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91e81338c0 0x7f91e8133c90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f91e4009920 tx=0x7f91e4009c30 comp rx=0 tx=0).stop 2023-10-01T07:56:31.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.866+0000 7f91ef5eb700 1 -- 172.21.15.26:0/2655804049 shutdown_connections 2023-10-01T07:56:31.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.866+0000 7f91ef5eb700 1 --2- 172.21.15.26:0/2655804049 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91e81338c0 0x7f91e8133c90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:31.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.866+0000 7f91ef5eb700 1 --2- 172.21.15.26:0/2655804049 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91e809e560 0x7f91e813b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:31.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.866+0000 7f91ef5eb700 1 -- 172.21.15.26:0/2655804049 >> 172.21.15.26:0/2655804049 conn(0x7f91e80a2aa0 msgr2=0x7f91e80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:31.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.866+0000 7f91ef5eb700 1 -- 172.21.15.26:0/2655804049 shutdown_connections 2023-10-01T07:56:31.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.866+0000 7f91ef5eb700 1 -- 172.21.15.26:0/2655804049 wait complete. 2023-10-01T07:56:31.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.867+0000 7f91ef5eb700 1 Processor -- start 2023-10-01T07:56:31.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.867+0000 7f91ef5eb700 1 -- start start 2023-10-01T07:56:31.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.868+0000 7f91ef5eb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91e809e560 0x7f91e811f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:31.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.868+0000 7f91ef5eb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91e81338c0 0x7f91e811fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:31.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.868+0000 7f91ef5eb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91e81341d0 0x7f91e8120370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:31.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.868+0000 7f91ef5eb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e8122770 con 0x7f91e81338c0 2023-10-01T07:56:31.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.868+0000 7f91ef5eb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e81214b0 con 0x7f91e809e560 2023-10-01T07:56:31.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.868+0000 7f91ef5eb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91e81234a0 con 0x7f91e81341d0 2023-10-01T07:56:31.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.868+0000 7f91ed387700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91e809e560 0x7f91e811f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:31.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.868+0000 7f91edb88700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91e81341d0 0x7f91e8120370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:31.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.868+0000 7f91ed387700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91e809e560 0x7f91e811f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33744/0 (socket says 172.21.15.26:33744) 2023-10-01T07:56:31.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.868+0000 7f91ed387700 1 -- 172.21.15.26:0/490160617 learned_addr learned my addr 172.21.15.26:0/490160617 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:31.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.868+0000 7f91edb88700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91e81341d0 0x7f91e8120370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:33306/0 (socket says 172.21.15.26:33306) 2023-10-01T07:56:31.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.868+0000 7f91ecb86700 1 --2- 172.21.15.26:0/490160617 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91e81338c0 0x7f91e811fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:31.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.868+0000 7f91edb88700 1 -- 172.21.15.26:0/490160617 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91e809e560 msgr2=0x7f91e811f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:31.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.868+0000 7f91edb88700 1 --2- 172.21.15.26:0/490160617 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91e809e560 0x7f91e811f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:31.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.868+0000 7f91edb88700 1 -- 172.21.15.26:0/490160617 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91e81338c0 msgr2=0x7f91e811fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:31.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.868+0000 7f91edb88700 1 --2- 172.21.15.26:0/490160617 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91e81338c0 0x7f91e811fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:31.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.868+0000 7f91edb88700 1 -- 172.21.15.26:0/490160617 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e4009550 con 0x7f91e81341d0 2023-10-01T07:56:31.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.869+0000 7f91edb88700 1 --2- 172.21.15.26:0/490160617 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91e81341d0 0x7f91e8120370 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f91e000efc0 tx=0x7f91e000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:31.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.869+0000 7f91ddffb700 1 -- 172.21.15.26:0/490160617 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e000cc90 con 0x7f91e81341d0 2023-10-01T07:56:31.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.869+0000 7f91ddffb700 1 -- 172.21.15.26:0/490160617 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e000f040 con 0x7f91e81341d0 2023-10-01T07:56:31.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.869+0000 7f91ddffb700 1 -- 172.21.15.26:0/490160617 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e0009e60 con 0x7f91e81341d0 2023-10-01T07:56:31.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.869+0000 7f91ef5eb700 1 -- 172.21.15.26:0/490160617 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e806f960 con 0x7f91e81341d0 2023-10-01T07:56:31.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.869+0000 7f91ef5eb700 1 -- 172.21.15.26:0/490160617 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e81222b0 con 0x7f91e81341d0 2023-10-01T07:56:31.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.870+0000 7f91ef5eb700 1 -- 172.21.15.26:0/490160617 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e8074ea0 con 0x7f91e81341d0 2023-10-01T07:56:31.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.871+0000 7f91ddffb700 1 -- 172.21.15.26:0/490160617 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f91e0014480 con 0x7f91e81341d0 2023-10-01T07:56:31.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.871+0000 7f91ddffb700 1 -- 172.21.15.26:0/490160617 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f91e0040210 con 0x7f91e81341d0 2023-10-01T07:56:31.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.879+0000 7f91ddffb700 1 -- 172.21.15.26:0/490160617 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f91e0007920 con 0x7f91e81341d0 2023-10-01T07:56:31.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:31.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.919+0000 7f10e9f71700 1 Processor -- start 2023-10-01T07:56:31.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.919+0000 7f10e9f71700 1 -- start start 2023-10-01T07:56:31.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.919+0000 7f10e9f71700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f10e40a0a30 0x7f10e40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:31.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.919+0000 7f10e9f71700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10e409d630 0x7f10e40a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:31.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.919+0000 7f10e9f71700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e40a2a70 con 0x7f10e4133930 2023-10-01T07:56:31.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.919+0000 7f10e9f71700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e40a01d0 con 0x7f10e40a0a30 2023-10-01T07:56:31.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.919+0000 7f10e9f71700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e409e2b0 con 0x7f10e409d630 2023-10-01T07:56:31.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.919+0000 7f10e2ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10e409d630 0x7f10e40a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:31.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.919+0000 7f10e37fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f10e40a0a30 0x7f10e40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:31.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.919+0000 7f10e2ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10e409d630 0x7f10e40a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33748/0 (socket says 172.21.15.26:33748) 2023-10-01T07:56:31.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.919+0000 7f10e2ffd700 1 -- 172.21.15.26:0/3128526610 learned_addr learned my addr 172.21.15.26:0/3128526610 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:31.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.920+0000 7f10e2ffd700 1 -- 172.21.15.26:0/3128526610 >> v2:172.21.15.26:3300/0 conn(0x7f10e40a0a30 msgr2=0x7f10e40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:31.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.920+0000 7f10e2ffd700 1 --2- 172.21.15.26:0/3128526610 >> v2:172.21.15.26:3300/0 conn(0x7f10e40a0a30 0x7f10e40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:31.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.920+0000 7f10e2ffd700 1 -- 172.21.15.26:0/3128526610 >> v1:172.21.15.26:6789/0 conn(0x7f10e4133930 legacy=0x7f10e4133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:31.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.920+0000 7f10e2ffd700 1 -- 172.21.15.26:0/3128526610 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e409dc50 con 0x7f10e409d630 2023-10-01T07:56:31.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.920+0000 7f10e2ffd700 1 --2- 172.21.15.26:0/3128526610 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10e409d630 0x7f10e40a1340 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f10d80098f0 tx=0x7f10d8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56322c7c1745aedb server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:31.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.920+0000 7f10e27fc700 1 -- 172.21.15.26:0/3128526610 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d8011830 con 0x7f10e409d630 2023-10-01T07:56:31.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.920+0000 7f10e27fc700 1 -- 172.21.15.26:0/3128526610 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d8011990 con 0x7f10e409d630 2023-10-01T07:56:31.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.920+0000 7f10e27fc700 1 -- 172.21.15.26:0/3128526610 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d8011d20 con 0x7f10e409d630 2023-10-01T07:56:31.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.921+0000 7f10e9f71700 1 -- 172.21.15.26:0/3128526610 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10e409d630 msgr2=0x7f10e40a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:31.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.921+0000 7f10e9f71700 1 --2- 172.21.15.26:0/3128526610 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10e409d630 0x7f10e40a1340 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f10d80098f0 tx=0x7f10d8009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:31.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.921+0000 7f10e9f71700 1 -- 172.21.15.26:0/3128526610 shutdown_connections 2023-10-01T07:56:31.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.921+0000 7f10e9f71700 1 --2- 172.21.15.26:0/3128526610 >> v2:172.21.15.26:3300/0 conn(0x7f10e40a0a30 0x7f10e40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:31.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.921+0000 7f10e9f71700 1 --2- 172.21.15.26:0/3128526610 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10e409d630 0x7f10e40a1340 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:31.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.921+0000 7f10e9f71700 1 -- 172.21.15.26:0/3128526610 >> 172.21.15.26:0/3128526610 conn(0x7f10e40a3050 msgr2=0x7f10e40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:31.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.921+0000 7f10e9f71700 1 -- 172.21.15.26:0/3128526610 shutdown_connections 2023-10-01T07:56:31.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.921+0000 7f10e9f71700 1 -- 172.21.15.26:0/3128526610 wait complete. 2023-10-01T07:56:31.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.922+0000 7f10e9f71700 1 Processor -- start 2023-10-01T07:56:31.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.922+0000 7f10e9f71700 1 -- start start 2023-10-01T07:56:31.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.923+0000 7f10e9f71700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f10e409d630 0x7f10e4121100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:31.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.923+0000 7f10e9f71700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10e40a0a30 0x7f10e4121640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:31.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.923+0000 7f10e9f71700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10e4133930 0x7f10e4121b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:31.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.923+0000 7f10e9f71700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e41225b0 con 0x7f10e40a0a30 2023-10-01T07:56:31.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.923+0000 7f10e9f71700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e4124bd0 con 0x7f10e4133930 2023-10-01T07:56:31.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.923+0000 7f10e9f71700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10e4124630 con 0x7f10e409d630 2023-10-01T07:56:31.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.923+0000 7f10e3fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10e4133930 0x7f10e4121b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:31.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.923+0000 7f10e2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10e40a0a30 0x7f10e4121640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:31.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.923+0000 7f10e3fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10e4133930 0x7f10e4121b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33756/0 (socket says 172.21.15.26:33756) 2023-10-01T07:56:31.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.923+0000 7f10e3fff700 1 -- 172.21.15.26:0/3984758576 learned_addr learned my addr 172.21.15.26:0/3984758576 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:31.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.923+0000 7f10e37fe700 1 --2- 172.21.15.26:0/3984758576 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f10e409d630 0x7f10e4121100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:31.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.923+0000 7f10e2ffd700 1 -- 172.21.15.26:0/3984758576 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f10e409d630 msgr2=0x7f10e4121100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:31.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.923+0000 7f10e2ffd700 1 --2- 172.21.15.26:0/3984758576 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f10e409d630 0x7f10e4121100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:31.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.923+0000 7f10e2ffd700 1 -- 172.21.15.26:0/3984758576 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10e4133930 msgr2=0x7f10e4121b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:31.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.923+0000 7f10e2ffd700 1 --2- 172.21.15.26:0/3984758576 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10e4133930 0x7f10e4121b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:31.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.923+0000 7f10e2ffd700 1 -- 172.21.15.26:0/3984758576 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d8009550 con 0x7f10e40a0a30 2023-10-01T07:56:31.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.923+0000 7f10e3fff700 1 --2- 172.21.15.26:0/3984758576 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10e4133930 0x7f10e4121b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:31.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.924+0000 7f10e2ffd700 1 --2- 172.21.15.26:0/3984758576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10e40a0a30 0x7f10e4121640 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f10d8016000 tx=0x7f10d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:31.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.924+0000 7f10cbfff700 1 -- 172.21.15.26:0/3984758576 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d80036a0 con 0x7f10e40a0a30 2023-10-01T07:56:31.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.924+0000 7f10cbfff700 1 -- 172.21.15.26:0/3984758576 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d8003800 con 0x7f10e40a0a30 2023-10-01T07:56:31.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.924+0000 7f10e9f71700 1 -- 172.21.15.26:0/3984758576 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e4122dc0 con 0x7f10e40a0a30 2023-10-01T07:56:31.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.924+0000 7f10cbfff700 1 -- 172.21.15.26:0/3984758576 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d8003b90 con 0x7f10e40a0a30 2023-10-01T07:56:31.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.924+0000 7f10e9f71700 1 -- 172.21.15.26:0/3984758576 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e4123ac0 con 0x7f10e40a0a30 2023-10-01T07:56:31.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.925+0000 7f10cbfff700 1 -- 172.21.15.26:0/3984758576 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f10d8021070 con 0x7f10e40a0a30 2023-10-01T07:56:31.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.925+0000 7f10cbfff700 1 -- 172.21.15.26:0/3984758576 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f10d8040890 con 0x7f10e40a0a30 2023-10-01T07:56:31.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.925+0000 7f10e9f71700 1 -- 172.21.15.26:0/3984758576 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e4124850 con 0x7f10e40a0a30 2023-10-01T07:56:31.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.930+0000 7f10cbfff700 1 -- 172.21.15.26:0/3984758576 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f10e4124850 con 0x7f10e40a0a30 2023-10-01T07:56:31.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.974+0000 7f392e0fb700 1 Processor -- start 2023-10-01T07:56:31.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.975+0000 7f392e0fb700 1 -- start start 2023-10-01T07:56:31.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.975+0000 7f392e0fb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f392809e930 0x7f392809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:31.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.975+0000 7f392e0fb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f392809f650 0x7f3928131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:31.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.975+0000 7f392e0fb700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3928070940 con 0x7f392809f240 2023-10-01T07:56:31.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.975+0000 7f392e0fb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f392806fd60 con 0x7f392809e930 2023-10-01T07:56:31.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.975+0000 7f392e0fb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f392806fa80 con 0x7f392809f650 2023-10-01T07:56:31.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.976+0000 7f39277fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f392809e930 0x7f392809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:31.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.976+0000 7f3927fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f392809f650 0x7f3928131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:31.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.976+0000 7f3926ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f392809f240 0x7f39281317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59256/0 (socket says 172.21.15.26:59256) 2023-10-01T07:56:31.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.976+0000 7f39277fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f392809e930 0x7f392809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33758/0 (socket says 172.21.15.26:33758) 2023-10-01T07:56:31.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.976+0000 7f3926ffd700 1 -- 172.21.15.26:0/447962626 learned_addr learned my addr 172.21.15.26:0/447962626 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:31.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.976+0000 7f3927fff700 1 -- 172.21.15.26:0/447962626 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f392809e930 msgr2=0x7f392809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:31.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.976+0000 7f3927fff700 1 --2- 172.21.15.26:0/447962626 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f392809e930 0x7f392809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:31.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.976+0000 7f3927fff700 1 -- 172.21.15.26:0/447962626 >> v1:172.21.15.26:6789/0 conn(0x7f392809f240 legacy=0x7f39281317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:31.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.976+0000 7f3927fff700 1 -- 172.21.15.26:0/447962626 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392809fb60 con 0x7f392809f650 2023-10-01T07:56:31.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.976+0000 7f39267fc700 1 -- 172.21.15.26:0/447962626 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 559207184 0 0) 0x7f3928070940 con 0x7f392809f240 2023-10-01T07:56:31.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.976+0000 7f39277fe700 1 --2- 172.21.15.26:0/447962626 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f392809e930 0x7f392809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:31.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.976+0000 7f3927fff700 1 --2- 172.21.15.26:0/447962626 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f392809f650 0x7f3928131f00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3920009dc0 tx=0x7f392000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38dfe0df80ca1cbe server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:31.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.976+0000 7f39267fc700 1 -- 172.21.15.26:0/447962626 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392000e070 con 0x7f392809f650 2023-10-01T07:56:31.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.976+0000 7f39267fc700 1 -- 172.21.15.26:0/447962626 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392000bb20 con 0x7f392809f650 2023-10-01T07:56:31.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.976+0000 7f39267fc700 1 -- 172.21.15.26:0/447962626 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920012430 con 0x7f392809f650 2023-10-01T07:56:31.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.977+0000 7f392e0fb700 1 -- 172.21.15.26:0/447962626 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f392809f650 msgr2=0x7f3928131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:31.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.977+0000 7f392e0fb700 1 --2- 172.21.15.26:0/447962626 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f392809f650 0x7f3928131f00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3920009dc0 tx=0x7f392000b330 comp rx=0 tx=0).stop 2023-10-01T07:56:31.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.977+0000 7f392e0fb700 1 -- 172.21.15.26:0/447962626 shutdown_connections 2023-10-01T07:56:31.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.977+0000 7f392e0fb700 1 --2- 172.21.15.26:0/447962626 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f392809f650 0x7f3928131f00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:31.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.977+0000 7f392e0fb700 1 --2- 172.21.15.26:0/447962626 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f392809e930 0x7f392809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:31.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.977+0000 7f392e0fb700 1 -- 172.21.15.26:0/447962626 >> 172.21.15.26:0/447962626 conn(0x7f39280a4210 msgr2=0x7f39280a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:31.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.977+0000 7f392e0fb700 1 -- 172.21.15.26:0/447962626 shutdown_connections 2023-10-01T07:56:31.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.977+0000 7f392e0fb700 1 -- 172.21.15.26:0/447962626 wait complete. 2023-10-01T07:56:31.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.979+0000 7f392e0fb700 1 Processor -- start 2023-10-01T07:56:31.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.979+0000 7f392e0fb700 1 -- start start 2023-10-01T07:56:31.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.980+0000 7f392e0fb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f392809e930 0x7f39281a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:31.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.980+0000 7f392e0fb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f392809f240 0x7f39281a3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:31.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.980+0000 7f392e0fb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f392809f650 0x7f39281a4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:31.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.980+0000 7f392e0fb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39281a6cf0 con 0x7f392809e930 2023-10-01T07:56:31.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.980+0000 7f392e0fb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39281a53b0 con 0x7f392809f240 2023-10-01T07:56:31.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.980+0000 7f392e0fb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39281a6f40 con 0x7f392809f650 2023-10-01T07:56:31.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.980+0000 7f3926ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f392809f240 0x7f39281a3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:31.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.980+0000 7f3926ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f392809f240 0x7f39281a3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33760/0 (socket says 172.21.15.26:33760) 2023-10-01T07:56:31.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.980+0000 7f3926ffd700 1 -- 172.21.15.26:0/3267004132 learned_addr learned my addr 172.21.15.26:0/3267004132 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:31.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.980+0000 7f39277fe700 1 --2- 172.21.15.26:0/3267004132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f392809e930 0x7f39281a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:31.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.980+0000 7f3927fff700 1 --2- 172.21.15.26:0/3267004132 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f392809f650 0x7f39281a4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:31.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.981+0000 7f3926ffd700 1 -- 172.21.15.26:0/3267004132 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f392809f650 msgr2=0x7f39281a4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:31.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.981+0000 7f3926ffd700 1 --2- 172.21.15.26:0/3267004132 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f392809f650 0x7f39281a4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:31.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.981+0000 7f3926ffd700 1 -- 172.21.15.26:0/3267004132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f392809e930 msgr2=0x7f39281a37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:31.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.981+0000 7f3926ffd700 1 --2- 172.21.15.26:0/3267004132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f392809e930 0x7f39281a37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:31.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.981+0000 7f3926ffd700 1 -- 172.21.15.26:0/3267004132 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39180094a0 con 0x7f392809f240 2023-10-01T07:56:31.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.981+0000 7f3926ffd700 1 --2- 172.21.15.26:0/3267004132 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f392809f240 0x7f39281a3ce0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f391c001eb0 tx=0x7f391c00c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:31.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.981+0000 7f390ffff700 1 -- 172.21.15.26:0/3267004132 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c004c80 con 0x7f392809f240 2023-10-01T07:56:31.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.981+0000 7f390ffff700 1 -- 172.21.15.26:0/3267004132 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391c004de0 con 0x7f392809f240 2023-10-01T07:56:31.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.981+0000 7f390ffff700 1 -- 172.21.15.26:0/3267004132 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c0072d0 con 0x7f392809f240 2023-10-01T07:56:31.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.981+0000 7f392e0fb700 1 -- 172.21.15.26:0/3267004132 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3920009a70 con 0x7f392809f240 2023-10-01T07:56:31.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.981+0000 7f392e0fb700 1 -- 172.21.15.26:0/3267004132 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39280a0190 con 0x7f392809f240 2023-10-01T07:56:31.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.982+0000 7f392e0fb700 1 -- 172.21.15.26:0/3267004132 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3928074ea0 con 0x7f392809f240 2023-10-01T07:56:31.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.982+0000 7f390ffff700 1 -- 172.21.15.26:0/3267004132 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f391c007430 con 0x7f392809f240 2023-10-01T07:56:31.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.982+0000 7f390ffff700 1 -- 172.21.15.26:0/3267004132 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f391c03f2d0 con 0x7f392809f240 2023-10-01T07:56:31.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:31.992+0000 7f390ffff700 1 -- 172.21.15.26:0/3267004132 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f391c0076e0 con 0x7f392809f240 2023-10-01T07:56:32.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:32.091+0000 7f91ef5eb700 1 -- 172.21.15.26:0/490160617 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f91e806b9e0 con 0x7f91e81341d0 2023-10-01T07:56:32.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:32.092+0000 7f91ddffb700 1 -- 172.21.15.26:0/490160617 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f91e0018030 con 0x7f91e81341d0 2023-10-01T07:56:32.092 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:32.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:32.094+0000 7f91ef5eb700 1 -- 172.21.15.26:0/490160617 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91e81341d0 msgr2=0x7f91e8120370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:32.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:32.094+0000 7f91ef5eb700 1 --2- 172.21.15.26:0/490160617 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91e81341d0 0x7f91e8120370 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f91e000efc0 tx=0x7f91e000c3a0 comp rx=0 tx=0).stop 2023-10-01T07:56:32.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:32.094+0000 7f91ef5eb700 1 -- 172.21.15.26:0/490160617 shutdown_connections 2023-10-01T07:56:32.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:32.094+0000 7f91ef5eb700 1 --2- 172.21.15.26:0/490160617 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91e81341d0 0x7f91e8120370 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:32.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:32.094+0000 7f91ef5eb700 1 --2- 172.21.15.26:0/490160617 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91e809e560 0x7f91e811f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:32.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:32.094+0000 7f91ef5eb700 1 --2- 172.21.15.26:0/490160617 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91e81338c0 0x7f91e811fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:32.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:32.094+0000 7f91ef5eb700 1 -- 172.21.15.26:0/490160617 >> 172.21.15.26:0/490160617 conn(0x7f91e80a2aa0 msgr2=0x7f91e809f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:32.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:32.094+0000 7f91ef5eb700 1 -- 172.21.15.26:0/490160617 shutdown_connections 2023-10-01T07:56:32.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:32.094+0000 7f91ef5eb700 1 -- 172.21.15.26:0/490160617 wait complete. 2023-10-01T07:56:32.109 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:32.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:32.148+0000 7f10e9f71700 1 -- 172.21.15.26:0/3984758576 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f10e4124850 con 0x7f10e40a0a30 2023-10-01T07:56:32.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:32.148+0000 7f10cbfff700 1 -- 172.21.15.26:0/3984758576 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f10e4124850 con 0x7f10e40a0a30 2023-10-01T07:56:32.149 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:32.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:32.151+0000 7f10e9f71700 1 -- 172.21.15.26:0/3984758576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10e40a0a30 msgr2=0x7f10e4121640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:32.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:32.151+0000 7f10e9f71700 1 --2- 172.21.15.26:0/3984758576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10e40a0a30 0x7f10e4121640 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f10d8016000 tx=0x7f10d8004750 comp rx=0 tx=0).stop 2023-10-01T07:56:32.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:32.151+0000 7f10e9f71700 1 -- 172.21.15.26:0/3984758576 shutdown_connections 2023-10-01T07:56:32.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:32.151+0000 7f10e9f71700 1 --2- 172.21.15.26:0/3984758576 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10e4133930 0x7f10e4121b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:32.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:32.151+0000 7f10e9f71700 1 --2- 172.21.15.26:0/3984758576 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f10e409d630 0x7f10e4121100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:32.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:32.151+0000 7f10e9f71700 1 --2- 172.21.15.26:0/3984758576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10e40a0a30 0x7f10e4121640 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:32.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:32.151+0000 7f10e9f71700 1 -- 172.21.15.26:0/3984758576 >> 172.21.15.26:0/3984758576 conn(0x7f10e40a3050 msgr2=0x7f10e4133210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:32.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:32.151+0000 7f10e9f71700 1 -- 172.21.15.26:0/3984758576 shutdown_connections 2023-10-01T07:56:32.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:32.151+0000 7f10e9f71700 1 -- 172.21.15.26:0/3984758576 wait complete. 2023-10-01T07:56:32.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:32.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:32.202+0000 7f392e0fb700 1 -- 172.21.15.26:0/3267004132 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f39281a5b00 con 0x7f392809f240 2023-10-01T07:56:32.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:32.203+0000 7f390ffff700 1 -- 172.21.15.26:0/3267004132 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f391c011360 con 0x7f392809f240 2023-10-01T07:56:32.206 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:32.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:32.205+0000 7f392e0fb700 1 -- 172.21.15.26:0/3267004132 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f392809f240 msgr2=0x7f39281a3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:32.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:32.205+0000 7f392e0fb700 1 --2- 172.21.15.26:0/3267004132 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f392809f240 0x7f39281a3ce0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f391c001eb0 tx=0x7f391c00c800 comp rx=0 tx=0).stop 2023-10-01T07:56:32.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:32.205+0000 7f392e0fb700 1 -- 172.21.15.26:0/3267004132 shutdown_connections 2023-10-01T07:56:32.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:32.205+0000 7f392e0fb700 1 --2- 172.21.15.26:0/3267004132 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f392809f650 0x7f39281a4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:32.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:32.205+0000 7f392e0fb700 1 --2- 172.21.15.26:0/3267004132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f392809e930 0x7f39281a37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:32.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:32.205+0000 7f392e0fb700 1 --2- 172.21.15.26:0/3267004132 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f392809f240 0x7f39281a3ce0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:32.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:32.205+0000 7f392e0fb700 1 -- 172.21.15.26:0/3267004132 >> 172.21.15.26:0/3267004132 conn(0x7f39280a4210 msgr2=0x7f39281bbed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:32.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:32.205+0000 7f392e0fb700 1 -- 172.21.15.26:0/3267004132 shutdown_connections 2023-10-01T07:56:32.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:32.205+0000 7f392e0fb700 1 -- 172.21.15.26:0/3267004132 wait complete. 2023-10-01T07:56:32.219 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:32.882 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:33.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.029+0000 7f9352c0f700 1 Processor -- start 2023-10-01T07:56:33.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.029+0000 7f9352c0f700 1 -- start start 2023-10-01T07:56:33.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.030+0000 7f9352c0f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f934c1316c0 0x7f934c131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:33.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.030+0000 7f9352c0f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f934c06ae80 0x7f934c139550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:33.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.030+0000 7f9352c0f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f934c09e130 con 0x7f934c09d9f0 2023-10-01T07:56:33.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.030+0000 7f9352c0f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934c1312b0 con 0x7f934c06ae80 2023-10-01T07:56:33.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.030+0000 7f9352c0f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f934c09f6e0 con 0x7f934c1316c0 2023-10-01T07:56:33.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.030+0000 7f93509ab700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f934c1316c0 0x7f934c131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:33.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.030+0000 7f934bfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f934c09d9f0 0x7f934c06a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59260/0 (socket says 172.21.15.26:59260) 2023-10-01T07:56:33.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.030+0000 7f934bfff700 1 -- 172.21.15.26:0/837594482 learned_addr learned my addr 172.21.15.26:0/837594482 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:33.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.030+0000 7f93511ac700 1 --2- 172.21.15.26:0/837594482 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f934c06ae80 0x7f934c139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:33.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.030+0000 7f93511ac700 1 -- 172.21.15.26:0/837594482 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f934c1316c0 msgr2=0x7f934c131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:33.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.030+0000 7f93511ac700 1 --2- 172.21.15.26:0/837594482 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f934c1316c0 0x7f934c131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:33.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.030+0000 7f93511ac700 1 -- 172.21.15.26:0/837594482 >> v1:172.21.15.26:6789/0 conn(0x7f934c09d9f0 legacy=0x7f934c06a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:33.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.030+0000 7f93511ac700 1 -- 172.21.15.26:0/837594482 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c09e760 con 0x7f934c06ae80 2023-10-01T07:56:33.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.030+0000 7f934b7fe700 1 -- 172.21.15.26:0/837594482 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1334881663 0 0) 0x7f9340001110 con 0x7f934c09d9f0 2023-10-01T07:56:33.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.030+0000 7f93509ab700 1 --2- 172.21.15.26:0/837594482 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f934c1316c0 0x7f934c131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:33.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.030+0000 7f93511ac700 1 --2- 172.21.15.26:0/837594482 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f934c06ae80 0x7f934c139550 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9344009dc0 tx=0x7f934400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77b18bac73cd6862 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:33.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.031+0000 7f934b7fe700 1 -- 172.21.15.26:0/837594482 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934400e070 con 0x7f934c06ae80 2023-10-01T07:56:33.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.031+0000 7f934b7fe700 1 -- 172.21.15.26:0/837594482 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934400bb20 con 0x7f934c06ae80 2023-10-01T07:56:33.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.031+0000 7f934b7fe700 1 -- 172.21.15.26:0/837594482 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9344012430 con 0x7f934c06ae80 2023-10-01T07:56:33.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.031+0000 7f9352c0f700 1 -- 172.21.15.26:0/837594482 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f934c06ae80 msgr2=0x7f934c139550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:33.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.031+0000 7f9352c0f700 1 --2- 172.21.15.26:0/837594482 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f934c06ae80 0x7f934c139550 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9344009dc0 tx=0x7f934400b330 comp rx=0 tx=0).stop 2023-10-01T07:56:33.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.031+0000 7f9352c0f700 1 -- 172.21.15.26:0/837594482 shutdown_connections 2023-10-01T07:56:33.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.031+0000 7f9352c0f700 1 --2- 172.21.15.26:0/837594482 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f934c1316c0 0x7f934c131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:33.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.031+0000 7f9352c0f700 1 --2- 172.21.15.26:0/837594482 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f934c06ae80 0x7f934c139550 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:33.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.031+0000 7f9352c0f700 1 -- 172.21.15.26:0/837594482 >> 172.21.15.26:0/837594482 conn(0x7f934c066f50 msgr2=0x7f934c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:33.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.031+0000 7f9352c0f700 1 -- 172.21.15.26:0/837594482 shutdown_connections 2023-10-01T07:56:33.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.031+0000 7f9352c0f700 1 -- 172.21.15.26:0/837594482 wait complete. 2023-10-01T07:56:33.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.032+0000 7f9352c0f700 1 Processor -- start 2023-10-01T07:56:33.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.032+0000 7f9352c0f700 1 -- start start 2023-10-01T07:56:33.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.033+0000 7f9352c0f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f934c06ae80 0x7f934c11a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:33.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.033+0000 7f9352c0f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f934c09d9f0 0x7f934c11a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:33.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.033+0000 7f9352c0f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f934c1316c0 0x7f934c11ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:33.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.033+0000 7f9352c0f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934c11df00 con 0x7f934c06ae80 2023-10-01T07:56:33.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.033+0000 7f9352c0f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934c11c090 con 0x7f934c1316c0 2023-10-01T07:56:33.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.033+0000 7f9352c0f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f934c0a3760 con 0x7f934c09d9f0 2023-10-01T07:56:33.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.033+0000 7f93511ac700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f934c1316c0 0x7f934c11ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:33.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.033+0000 7f934bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f934c09d9f0 0x7f934c11a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:33.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.033+0000 7f93511ac700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f934c1316c0 0x7f934c11ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33776/0 (socket says 172.21.15.26:33776) 2023-10-01T07:56:33.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.033+0000 7f93511ac700 1 -- 172.21.15.26:0/1532955925 learned_addr learned my addr 172.21.15.26:0/1532955925 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:33.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.033+0000 7f93509ab700 1 --2- 172.21.15.26:0/1532955925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f934c06ae80 0x7f934c11a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:33.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.033+0000 7f934bfff700 1 -- 172.21.15.26:0/1532955925 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f934c1316c0 msgr2=0x7f934c11ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:33.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.033+0000 7f934bfff700 1 --2- 172.21.15.26:0/1532955925 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f934c1316c0 0x7f934c11ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:33.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.033+0000 7f934bfff700 1 -- 172.21.15.26:0/1532955925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f934c06ae80 msgr2=0x7f934c11a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:33.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.033+0000 7f934bfff700 1 --2- 172.21.15.26:0/1532955925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f934c06ae80 0x7f934c11a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:33.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.033+0000 7f934bfff700 1 -- 172.21.15.26:0/1532955925 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f933c0094a0 con 0x7f934c09d9f0 2023-10-01T07:56:33.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.033+0000 7f93511ac700 1 --2- 172.21.15.26:0/1532955925 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f934c1316c0 0x7f934c11ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:33.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.034+0000 7f934bfff700 1 --2- 172.21.15.26:0/1532955925 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f934c09d9f0 0x7f934c11a920 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9340000c00 tx=0x7f934000ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:33.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.034+0000 7f93497fa700 1 -- 172.21.15.26:0/1532955925 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9340004c80 con 0x7f934c09d9f0 2023-10-01T07:56:33.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.034+0000 7f93497fa700 1 -- 172.21.15.26:0/1532955925 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9340004de0 con 0x7f934c09d9f0 2023-10-01T07:56:33.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.034+0000 7f9352c0f700 1 -- 172.21.15.26:0/1532955925 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9344009a70 con 0x7f934c09d9f0 2023-10-01T07:56:33.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.034+0000 7f93497fa700 1 -- 172.21.15.26:0/1532955925 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9340007310 con 0x7f934c09d9f0 2023-10-01T07:56:33.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.034+0000 7f9352c0f700 1 -- 172.21.15.26:0/1532955925 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f934c11e690 con 0x7f934c09d9f0 2023-10-01T07:56:33.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.035+0000 7f9352c0f700 1 -- 172.21.15.26:0/1532955925 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f934c074ea0 con 0x7f934c09d9f0 2023-10-01T07:56:33.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.035+0000 7f93497fa700 1 -- 172.21.15.26:0/1532955925 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9340007470 con 0x7f934c09d9f0 2023-10-01T07:56:33.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.035+0000 7f93497fa700 1 -- 172.21.15.26:0/1532955925 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f934003f7a0 con 0x7f934c09d9f0 2023-10-01T07:56:33.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.040+0000 7f93497fa700 1 -- 172.21.15.26:0/1532955925 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f934001b930 con 0x7f934c09d9f0 2023-10-01T07:56:33.109 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:33.166 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:33.220 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:33.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.251+0000 7fa9d8696700 1 Processor -- start 2023-10-01T07:56:33.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.251+0000 7fa9d8696700 1 -- start start 2023-10-01T07:56:33.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.252+0000 7fa9d8696700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa9d0066410 0x7fa9d0135d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:33.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.252+0000 7fa9d8696700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9d0066880 0x7fa9d0138270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:33.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.252+0000 7fa9d8696700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d006f9a0 con 0x7fa9d006f5d0 2023-10-01T07:56:33.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.252+0000 7fa9d8696700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9d0071840 con 0x7fa9d0066410 2023-10-01T07:56:33.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.252+0000 7fa9d8696700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d0071a40 con 0x7fa9d0066880 2023-10-01T07:56:33.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.252+0000 7fa9d5c31700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa9d0066410 0x7fa9d0135d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:33.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.252+0000 7fa9d5c31700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa9d0066410 0x7fa9d0135d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49902/0 (socket says 172.21.15.26:49902) 2023-10-01T07:56:33.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.252+0000 7fa9d5c31700 1 -- 172.21.15.26:0/1032502477 learned_addr learned my addr 172.21.15.26:0/1032502477 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:33.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.253+0000 7fa9d6c33700 1 --2- 172.21.15.26:0/1032502477 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9d0066880 0x7fa9d0138270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:33.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.253+0000 7fa9d5c31700 1 -- 172.21.15.26:0/1032502477 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9d0066880 msgr2=0x7fa9d0138270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:33.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.253+0000 7fa9d5c31700 1 --2- 172.21.15.26:0/1032502477 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9d0066880 0x7fa9d0138270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:33.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.253+0000 7fa9d5c31700 1 -- 172.21.15.26:0/1032502477 >> v1:172.21.15.26:6789/0 conn(0x7fa9d006f5d0 legacy=0x7fa9d012cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:33.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.253+0000 7fa9d5c31700 1 -- 172.21.15.26:0/1032502477 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d0072220 con 0x7fa9d0066410 2023-10-01T07:56:33.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.253+0000 7fa9d5c31700 1 --2- 172.21.15.26:0/1032502477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9d0066410 0x7fa9d0135d20 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa9c00098f0 tx=0x7fa9c0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f87501bfb1d36bd server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:33.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.254+0000 7fa9d5430700 1 -- 172.21.15.26:0/1032502477 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c0004230 con 0x7fa9d0066410 2023-10-01T07:56:33.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.254+0000 7fa9d5430700 1 -- 172.21.15.26:0/1032502477 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c0004390 con 0x7fa9d0066410 2023-10-01T07:56:33.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.254+0000 7fa9d5430700 1 -- 172.21.15.26:0/1032502477 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c00036a0 con 0x7fa9d0066410 2023-10-01T07:56:33.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.255+0000 7fa9d8696700 1 -- 172.21.15.26:0/1032502477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9d0066410 msgr2=0x7fa9d0135d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:33.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.255+0000 7fa9d8696700 1 --2- 172.21.15.26:0/1032502477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9d0066410 0x7fa9d0135d20 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa9c00098f0 tx=0x7fa9c0009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:33.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.255+0000 7fa9d8696700 1 -- 172.21.15.26:0/1032502477 shutdown_connections 2023-10-01T07:56:33.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.255+0000 7fa9d8696700 1 --2- 172.21.15.26:0/1032502477 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9d0066880 0x7fa9d0138270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:33.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.255+0000 7fa9d8696700 1 --2- 172.21.15.26:0/1032502477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9d0066410 0x7fa9d0135d20 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:33.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.255+0000 7fa9d8696700 1 -- 172.21.15.26:0/1032502477 >> 172.21.15.26:0/1032502477 conn(0x7fa9d00a2aa0 msgr2=0x7fa9d00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:33.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.255+0000 7f9352c0f700 1 -- 172.21.15.26:0/1532955925 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f934c09e130 con 0x7f934c09d9f0 2023-10-01T07:56:33.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.255+0000 7fa9d8696700 1 -- 172.21.15.26:0/1032502477 shutdown_connections 2023-10-01T07:56:33.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.255+0000 7fa9d8696700 1 -- 172.21.15.26:0/1032502477 wait complete. 2023-10-01T07:56:33.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.256+0000 7f93497fa700 1 -- 172.21.15.26:0/1532955925 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f934c09e130 con 0x7f934c09d9f0 2023-10-01T07:56:33.257 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:33.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.257+0000 7fa9d8696700 1 Processor -- start 2023-10-01T07:56:33.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.257+0000 7fa9d8696700 1 -- start start 2023-10-01T07:56:33.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.257+0000 7fa9d8696700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa9d0066410 0x7fa9d01214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:33.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.257+0000 7fa9d8696700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9d0066880 0x7fa9d0121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:33.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.257+0000 7fa9d8696700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9d006f5d0 0x7fa9d0121f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:33.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.257+0000 7fa9d8696700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d01235b0 con 0x7fa9d006f5d0 2023-10-01T07:56:33.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.257+0000 7fa9d8696700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d0124670 con 0x7fa9d0066880 2023-10-01T07:56:33.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.257+0000 7fa9d8696700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d0123b60 con 0x7fa9d0066410 2023-10-01T07:56:33.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.258+0000 7fa9d6432700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa9d0066410 0x7fa9d01214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:33.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.258+0000 7fa9d6432700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa9d0066410 0x7fa9d01214e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:33342/0 (socket says 172.21.15.26:33342) 2023-10-01T07:56:33.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.258+0000 7fa9d6432700 1 -- 172.21.15.26:0/525492824 learned_addr learned my addr 172.21.15.26:0/525492824 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:33.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.258+0000 7fa9d6c33700 1 --2- 172.21.15.26:0/525492824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9d006f5d0 0x7fa9d0121f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:33.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.258+0000 7fa9d6432700 1 -- 172.21.15.26:0/525492824 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9d0066880 msgr2=0x7fa9d0121a20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:56:33.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.258+0000 7fa9d6432700 1 --2- 172.21.15.26:0/525492824 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9d0066880 0x7fa9d0121a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:33.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.258+0000 7fa9d6432700 1 -- 172.21.15.26:0/525492824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9d006f5d0 msgr2=0x7fa9d0121f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:33.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.258+0000 7fa9d6432700 1 --2- 172.21.15.26:0/525492824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9d006f5d0 0x7fa9d0121f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:33.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.258+0000 7fa9d6432700 1 -- 172.21.15.26:0/525492824 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c0009550 con 0x7fa9d0066410 2023-10-01T07:56:33.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.258+0000 7fa9d6c33700 1 --2- 172.21.15.26:0/525492824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9d006f5d0 0x7fa9d0121f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:33.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.258+0000 7fa9d6432700 1 --2- 172.21.15.26:0/525492824 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa9d0066410 0x7fa9d01214e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc00c4d0 tx=0x7fa9cc00c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:33.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.259+0000 7fa9c6ffd700 1 -- 172.21.15.26:0/525492824 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc011790 con 0x7fa9d0066410 2023-10-01T07:56:33.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.259+0000 7fa9c6ffd700 1 -- 172.21.15.26:0/525492824 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9cc0118f0 con 0x7fa9d0066410 2023-10-01T07:56:33.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.259+0000 7fa9c6ffd700 1 -- 172.21.15.26:0/525492824 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc011ca0 con 0x7fa9d0066410 2023-10-01T07:56:33.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.259+0000 7fa9d8696700 1 -- 172.21.15.26:0/525492824 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d0124340 con 0x7fa9d0066410 2023-10-01T07:56:33.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.259+0000 7fa9d8696700 1 -- 172.21.15.26:0/525492824 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d0123e40 con 0x7fa9d0066410 2023-10-01T07:56:33.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.260+0000 7fa9c6ffd700 1 -- 172.21.15.26:0/525492824 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa9cc01c460 con 0x7fa9d0066410 2023-10-01T07:56:33.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.260+0000 7fa9d8696700 1 -- 172.21.15.26:0/525492824 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d0074ea0 con 0x7fa9d0066410 2023-10-01T07:56:33.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.260+0000 7f9352c0f700 1 -- 172.21.15.26:0/1532955925 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f934c09d9f0 msgr2=0x7f934c11a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:33.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.260+0000 7f9352c0f700 1 --2- 172.21.15.26:0/1532955925 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f934c09d9f0 0x7f934c11a920 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9340000c00 tx=0x7f934000ca30 comp rx=0 tx=0).stop 2023-10-01T07:56:33.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.260+0000 7fa9c6ffd700 1 -- 172.21.15.26:0/525492824 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa9cc03f450 con 0x7fa9d0066410 2023-10-01T07:56:33.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.261+0000 7f9352c0f700 1 -- 172.21.15.26:0/1532955925 shutdown_connections 2023-10-01T07:56:33.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.261+0000 7f9352c0f700 1 --2- 172.21.15.26:0/1532955925 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f934c1316c0 0x7f934c11ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:33.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.261+0000 7f9352c0f700 1 --2- 172.21.15.26:0/1532955925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f934c06ae80 0x7f934c11a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:33.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.261+0000 7f9352c0f700 1 --2- 172.21.15.26:0/1532955925 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f934c09d9f0 0x7f934c11a920 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:33.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.261+0000 7f9352c0f700 1 -- 172.21.15.26:0/1532955925 >> 172.21.15.26:0/1532955925 conn(0x7f934c066f50 msgr2=0x7f934c0a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:33.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.261+0000 7f9352c0f700 1 -- 172.21.15.26:0/1532955925 shutdown_connections 2023-10-01T07:56:33.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.261+0000 7f9352c0f700 1 -- 172.21.15.26:0/1532955925 wait complete. 2023-10-01T07:56:33.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.268+0000 7fa9c6ffd700 1 -- 172.21.15.26:0/525492824 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa9cc0108d0 con 0x7fa9d0066410 2023-10-01T07:56:33.279 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:33.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.311+0000 7ff69e48b700 1 Processor -- start 2023-10-01T07:56:33.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.311+0000 7ff69e48b700 1 -- start start 2023-10-01T07:56:33.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.312+0000 7ff69e48b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff69809c650 0x7ff69809ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:33.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.312+0000 7ff69e48b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff6980a0090 0x7ff69809cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:33.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.312+0000 7ff69e48b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff698131970 0x7ff698131e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:33.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.312+0000 7ff69e48b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff69809ba70 con 0x7ff698131970 2023-10-01T07:56:33.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.312+0000 7ff69e48b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff69809d4a0 con 0x7ff69809c650 2023-10-01T07:56:33.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.312+0000 7ff69e48b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff69809e8f0 con 0x7ff6980a0090 2023-10-01T07:56:33.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.312+0000 7ff6977fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff6980a0090 0x7ff69809cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:33.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.312+0000 7ff69ca28700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff698131970 0x7ff698131e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:33.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.312+0000 7ff6977fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff6980a0090 0x7ff69809cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:33346/0 (socket says 172.21.15.26:33346) 2023-10-01T07:56:33.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.312+0000 7ff697fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff69809c650 0x7ff69809ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:33.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.312+0000 7ff6977fe700 1 -- 172.21.15.26:0/4229987886 learned_addr learned my addr 172.21.15.26:0/4229987886 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:33.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.312+0000 7ff6977fe700 1 -- 172.21.15.26:0/4229987886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff69809c650 msgr2=0x7ff69809ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:33.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.312+0000 7ff6977fe700 1 --2- 172.21.15.26:0/4229987886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff69809c650 0x7ff69809ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:33.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.312+0000 7ff6977fe700 1 -- 172.21.15.26:0/4229987886 >> v2:172.21.15.26:3300/0 conn(0x7ff698131970 msgr2=0x7ff698131e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:33.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.312+0000 7ff6977fe700 1 --2- 172.21.15.26:0/4229987886 >> v2:172.21.15.26:3300/0 conn(0x7ff698131970 0x7ff698131e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:33.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.312+0000 7ff6977fe700 1 -- 172.21.15.26:0/4229987886 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6980a0760 con 0x7ff6980a0090 2023-10-01T07:56:33.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.312+0000 7ff697fff700 1 --2- 172.21.15.26:0/4229987886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff69809c650 0x7ff69809ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:33.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.313+0000 7ff6977fe700 1 --2- 172.21.15.26:0/4229987886 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff6980a0090 0x7ff69809cf60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff68c009920 tx=0x7ff68c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84bd02a817011043 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:33.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.313+0000 7ff696ffd700 1 -- 172.21.15.26:0/4229987886 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c011830 con 0x7ff6980a0090 2023-10-01T07:56:33.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.313+0000 7ff696ffd700 1 -- 172.21.15.26:0/4229987886 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68c011990 con 0x7ff6980a0090 2023-10-01T07:56:33.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.313+0000 7ff696ffd700 1 -- 172.21.15.26:0/4229987886 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c011d20 con 0x7ff6980a0090 2023-10-01T07:56:33.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.314+0000 7ff69e48b700 1 -- 172.21.15.26:0/4229987886 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff6980a0090 msgr2=0x7ff69809cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:33.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.314+0000 7ff69e48b700 1 --2- 172.21.15.26:0/4229987886 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff6980a0090 0x7ff69809cf60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff68c009920 tx=0x7ff68c009c30 comp rx=0 tx=0).stop 2023-10-01T07:56:33.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.314+0000 7ff69e48b700 1 -- 172.21.15.26:0/4229987886 shutdown_connections 2023-10-01T07:56:33.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.314+0000 7ff69e48b700 1 --2- 172.21.15.26:0/4229987886 >> v2:172.21.15.26:3300/0 conn(0x7ff698131970 0x7ff698131e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:33.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.314+0000 7ff69e48b700 1 --2- 172.21.15.26:0/4229987886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff69809c650 0x7ff69809ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:33.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.314+0000 7ff69e48b700 1 --2- 172.21.15.26:0/4229987886 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff6980a0090 0x7ff69809cf60 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:33.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.314+0000 7ff69e48b700 1 -- 172.21.15.26:0/4229987886 >> 172.21.15.26:0/4229987886 conn(0x7ff6980a3f70 msgr2=0x7ff6980a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:33.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.314+0000 7ff69e48b700 1 -- 172.21.15.26:0/4229987886 shutdown_connections 2023-10-01T07:56:33.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.314+0000 7ff69e48b700 1 -- 172.21.15.26:0/4229987886 wait complete. 2023-10-01T07:56:33.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.315+0000 7ff69e48b700 1 Processor -- start 2023-10-01T07:56:33.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.315+0000 7ff69e48b700 1 -- start start 2023-10-01T07:56:33.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.316+0000 7ff69e48b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff69809c650 0x7ff69811a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:33.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.316+0000 7ff69e48b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff6980a0090 0x7ff69811ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:33.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.316+0000 7ff69e48b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff698131970 0x7ff69811b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:33.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.316+0000 7ff69e48b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69811e3c0 con 0x7ff69809c650 2023-10-01T07:56:33.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.316+0000 7ff69e48b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff69811baf0 con 0x7ff698131970 2023-10-01T07:56:33.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.316+0000 7ff69e48b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff69811c110 con 0x7ff6980a0090 2023-10-01T07:56:33.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.316+0000 7ff697fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff69809c650 0x7ff69811a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:33.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.316+0000 7ff6977fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff6980a0090 0x7ff69811ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:33.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.316+0000 7ff697fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff69809c650 0x7ff69811a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49914/0 (socket says 172.21.15.26:49914) 2023-10-01T07:56:33.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.316+0000 7ff697fff700 1 -- 172.21.15.26:0/939040710 learned_addr learned my addr 172.21.15.26:0/939040710 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:33.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.317+0000 7ff69ca28700 1 --2- 172.21.15.26:0/939040710 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff698131970 0x7ff69811b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:33.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.317+0000 7ff6977fe700 1 -- 172.21.15.26:0/939040710 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff698131970 msgr2=0x7ff69811b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:33.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.317+0000 7ff6977fe700 1 --2- 172.21.15.26:0/939040710 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff698131970 0x7ff69811b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:33.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.317+0000 7ff6977fe700 1 -- 172.21.15.26:0/939040710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff69809c650 msgr2=0x7ff69811a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:33.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.317+0000 7ff6977fe700 1 --2- 172.21.15.26:0/939040710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff69809c650 0x7ff69811a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:33.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.317+0000 7ff6977fe700 1 -- 172.21.15.26:0/939040710 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6880094a0 con 0x7ff6980a0090 2023-10-01T07:56:33.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.317+0000 7ff697fff700 1 --2- 172.21.15.26:0/939040710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff69809c650 0x7ff69811a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:33.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.317+0000 7ff6977fe700 1 --2- 172.21.15.26:0/939040710 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff6980a0090 0x7ff69811ab60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff68c0098f0 tx=0x7ff68c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:33.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.317+0000 7ff694ff9700 1 -- 172.21.15.26:0/939040710 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c004240 con 0x7ff6980a0090 2023-10-01T07:56:33.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.317+0000 7ff694ff9700 1 -- 172.21.15.26:0/939040710 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68c01f070 con 0x7ff6980a0090 2023-10-01T07:56:33.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.317+0000 7ff69e48b700 1 -- 172.21.15.26:0/939040710 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff68c009550 con 0x7ff6980a0090 2023-10-01T07:56:33.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.317+0000 7ff694ff9700 1 -- 172.21.15.26:0/939040710 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c0036a0 con 0x7ff6980a0090 2023-10-01T07:56:33.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.317+0000 7ff69e48b700 1 -- 172.21.15.26:0/939040710 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff69811d770 con 0x7ff6980a0090 2023-10-01T07:56:33.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.318+0000 7ff694ff9700 1 -- 172.21.15.26:0/939040710 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff68c021030 con 0x7ff6980a0090 2023-10-01T07:56:33.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.318+0000 7ff694ff9700 1 -- 172.21.15.26:0/939040710 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff68c0405a0 con 0x7ff6980a0090 2023-10-01T07:56:33.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.318+0000 7ff69e48b700 1 -- 172.21.15.26:0/939040710 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff69811d770 con 0x7ff6980a0090 2023-10-01T07:56:33.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.323+0000 7ff694ff9700 1 -- 172.21.15.26:0/939040710 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff69811d770 con 0x7ff6980a0090 2023-10-01T07:56:33.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.368+0000 7ff9424e7700 1 Processor -- start 2023-10-01T07:56:33.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.368+0000 7ff9424e7700 1 -- start start 2023-10-01T07:56:33.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.369+0000 7ff9424e7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff93c0a0a30 0x7ff93c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:33.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.369+0000 7ff9424e7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff93c134170 0x7ff93c13bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:33.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.369+0000 7ff9424e7700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff93c09edd0 con 0x7ff93c0a1340 2023-10-01T07:56:33.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.369+0000 7ff9424e7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff93c09e1f0 con 0x7ff93c0a0a30 2023-10-01T07:56:33.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.369+0000 7ff9424e7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c09dc50 con 0x7ff93c134170 2023-10-01T07:56:33.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.369+0000 7ff93bfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff93c0a0a30 0x7ff93c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:33.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.369+0000 7ff940a84700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff93c134170 0x7ff93c13bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:33.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.369+0000 7ff93bfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff93c0a0a30 0x7ff93c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49924/0 (socket says 172.21.15.26:49924) 2023-10-01T07:56:33.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.369+0000 7ff93bfff700 1 -- 172.21.15.26:0/4084029732 learned_addr learned my addr 172.21.15.26:0/4084029732 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:33.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.369+0000 7ff93bfff700 1 -- 172.21.15.26:0/4084029732 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff93c134170 msgr2=0x7ff93c13bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:33.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.369+0000 7ff93bfff700 1 --2- 172.21.15.26:0/4084029732 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff93c134170 0x7ff93c13bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:33.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.369+0000 7ff93bfff700 1 -- 172.21.15.26:0/4084029732 >> v1:172.21.15.26:6789/0 conn(0x7ff93c0a1340 legacy=0x7ff93c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:33.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.369+0000 7ff93bfff700 1 -- 172.21.15.26:0/4084029732 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93c0a1fe0 con 0x7ff93c0a0a30 2023-10-01T07:56:33.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.369+0000 7ff940a84700 1 --2- 172.21.15.26:0/4084029732 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff93c134170 0x7ff93c13bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:33.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.369+0000 7ff93bfff700 1 --2- 172.21.15.26:0/4084029732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff93c0a0a30 0x7ff93c0a0e00 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ff92c0098f0 tx=0x7ff92c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee59b9b1cff98a14 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:33.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.370+0000 7ff93affd700 1 -- 172.21.15.26:0/4084029732 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c011830 con 0x7ff93c0a0a30 2023-10-01T07:56:33.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.370+0000 7ff93affd700 1 -- 172.21.15.26:0/4084029732 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92c011990 con 0x7ff93c0a0a30 2023-10-01T07:56:33.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.370+0000 7ff93affd700 1 -- 172.21.15.26:0/4084029732 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c011d20 con 0x7ff93c0a0a30 2023-10-01T07:56:33.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.370+0000 7ff9424e7700 1 -- 172.21.15.26:0/4084029732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff93c0a0a30 msgr2=0x7ff93c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:33.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.370+0000 7ff9424e7700 1 --2- 172.21.15.26:0/4084029732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff93c0a0a30 0x7ff93c0a0e00 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ff92c0098f0 tx=0x7ff92c009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:33.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.370+0000 7ff9424e7700 1 -- 172.21.15.26:0/4084029732 shutdown_connections 2023-10-01T07:56:33.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.370+0000 7ff9424e7700 1 --2- 172.21.15.26:0/4084029732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff93c0a0a30 0x7ff93c0a0e00 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:33.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.370+0000 7ff9424e7700 1 --2- 172.21.15.26:0/4084029732 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff93c134170 0x7ff93c13bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:33.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.370+0000 7ff9424e7700 1 -- 172.21.15.26:0/4084029732 >> 172.21.15.26:0/4084029732 conn(0x7ff93c0a6550 msgr2=0x7ff93c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:33.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.370+0000 7ff9424e7700 1 -- 172.21.15.26:0/4084029732 shutdown_connections 2023-10-01T07:56:33.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.370+0000 7ff9424e7700 1 -- 172.21.15.26:0/4084029732 wait complete. 2023-10-01T07:56:33.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.371+0000 7ff9424e7700 1 Processor -- start 2023-10-01T07:56:33.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.372+0000 7ff9424e7700 1 -- start start 2023-10-01T07:56:33.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.372+0000 7ff9424e7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff93c0a0a30 0x7ff93c1c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:33.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.372+0000 7ff9424e7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff93c0a1340 0x7ff93c1c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:33.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.372+0000 7ff9424e7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff93c134170 0x7ff93c1c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:33.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.372+0000 7ff9424e7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c1246b0 con 0x7ff93c0a1340 2023-10-01T07:56:33.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.372+0000 7ff9424e7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c0a0220 con 0x7ff93c134170 2023-10-01T07:56:33.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.372+0000 7ff9424e7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c126190 con 0x7ff93c0a0a30 2023-10-01T07:56:33.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.372+0000 7ff93bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff93c0a0a30 0x7ff93c1c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:33.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.372+0000 7ff93bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff93c0a0a30 0x7ff93c1c8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:33362/0 (socket says 172.21.15.26:33362) 2023-10-01T07:56:33.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.372+0000 7ff93bfff700 1 -- 172.21.15.26:0/3078621792 learned_addr learned my addr 172.21.15.26:0/3078621792 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:33.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.372+0000 7ff93b7fe700 1 --2- 172.21.15.26:0/3078621792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff93c0a1340 0x7ff93c1c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:33.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.372+0000 7ff940a84700 1 --2- 172.21.15.26:0/3078621792 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff93c134170 0x7ff93c1c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:33.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.373+0000 7ff93bfff700 1 -- 172.21.15.26:0/3078621792 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff93c134170 msgr2=0x7ff93c1c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:33.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.373+0000 7ff93bfff700 1 --2- 172.21.15.26:0/3078621792 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff93c134170 0x7ff93c1c8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.373+0000 7ff93bfff700 1 -- 172.21.15.26:0/3078621792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff93c0a1340 msgr2=0x7ff93c1c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.373+0000 7ff93bfff700 1 --2- 172.21.15.26:0/3078621792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff93c0a1340 0x7ff93c1c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.373+0000 7ff93bfff700 1 -- 172.21.15.26:0/3078621792 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff934009a70 con 0x7ff93c0a0a30 2023-10-01T07:56:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.373+0000 7ff93bfff700 1 --2- 172.21.15.26:0/3078621792 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff93c0a0a30 0x7ff93c1c8480 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff92c009c40 tx=0x7ff92c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.373+0000 7ff938ff9700 1 -- 172.21.15.26:0/3078621792 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c0043c0 con 0x7ff93c0a0a30 2023-10-01T07:56:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.373+0000 7ff938ff9700 1 -- 172.21.15.26:0/3078621792 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92c01f070 con 0x7ff93c0a0a30 2023-10-01T07:56:33.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.373+0000 7ff938ff9700 1 -- 172.21.15.26:0/3078621792 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c0036a0 con 0x7ff93c0a0a30 2023-10-01T07:56:33.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.373+0000 7ff9424e7700 1 -- 172.21.15.26:0/3078621792 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff92c009550 con 0x7ff93c0a0a30 2023-10-01T07:56:33.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.373+0000 7ff9424e7700 1 -- 172.21.15.26:0/3078621792 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff93c0a25e0 con 0x7ff93c0a0a30 2023-10-01T07:56:33.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.374+0000 7ff938ff9700 1 -- 172.21.15.26:0/3078621792 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff92c021030 con 0x7ff93c0a0a30 2023-10-01T07:56:33.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.374+0000 7ff938ff9700 1 -- 172.21.15.26:0/3078621792 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff92c0408d0 con 0x7ff93c0a0a30 2023-10-01T07:56:33.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.375+0000 7ff9424e7700 1 -- 172.21.15.26:0/3078621792 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff93c074ea0 con 0x7ff93c0a0a30 2023-10-01T07:56:33.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.380+0000 7ff938ff9700 1 -- 172.21.15.26:0/3078621792 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff92c015080 con 0x7ff93c0a0a30 2023-10-01T07:56:33.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.483+0000 7fa9d8696700 1 -- 172.21.15.26:0/525492824 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa9d012c6a0 con 0x7fa9d0066410 2023-10-01T07:56:33.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.483+0000 7fa9c6ffd700 1 -- 172.21.15.26:0/525492824 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa9cc0102e0 con 0x7fa9d0066410 2023-10-01T07:56:33.484 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:33.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.485+0000 7fa9d8696700 1 -- 172.21.15.26:0/525492824 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa9d0066410 msgr2=0x7fa9d01214e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:33.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.485+0000 7fa9d8696700 1 --2- 172.21.15.26:0/525492824 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa9d0066410 0x7fa9d01214e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc00c4d0 tx=0x7fa9cc00c7e0 comp rx=0 tx=0).stop 2023-10-01T07:56:33.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.485+0000 7fa9d8696700 1 -- 172.21.15.26:0/525492824 shutdown_connections 2023-10-01T07:56:33.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.485+0000 7fa9d8696700 1 --2- 172.21.15.26:0/525492824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9d006f5d0 0x7fa9d0121f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:33.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.485+0000 7fa9d8696700 1 --2- 172.21.15.26:0/525492824 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa9d0066410 0x7fa9d01214e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:33.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.485+0000 7fa9d8696700 1 --2- 172.21.15.26:0/525492824 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9d0066880 0x7fa9d0121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:33.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.485+0000 7fa9d8696700 1 -- 172.21.15.26:0/525492824 >> 172.21.15.26:0/525492824 conn(0x7fa9d00a2aa0 msgr2=0x7fa9d006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:33.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.485+0000 7fa9d8696700 1 -- 172.21.15.26:0/525492824 shutdown_connections 2023-10-01T07:56:33.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.486+0000 7fa9d8696700 1 -- 172.21.15.26:0/525492824 wait complete. 2023-10-01T07:56:33.500 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:33.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.536+0000 7ff69e48b700 1 -- 172.21.15.26:0/939040710 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff69811d770 con 0x7ff6980a0090 2023-10-01T07:56:33.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.536+0000 7ff694ff9700 1 -- 172.21.15.26:0/939040710 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff69811d770 con 0x7ff6980a0090 2023-10-01T07:56:33.537 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:33.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.538+0000 7ff69e48b700 1 -- 172.21.15.26:0/939040710 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff6980a0090 msgr2=0x7ff69811ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:33.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.538+0000 7ff69e48b700 1 --2- 172.21.15.26:0/939040710 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff6980a0090 0x7ff69811ab60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff68c0098f0 tx=0x7ff68c004750 comp rx=0 tx=0).stop 2023-10-01T07:56:33.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.538+0000 7ff69e48b700 1 -- 172.21.15.26:0/939040710 shutdown_connections 2023-10-01T07:56:33.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.538+0000 7ff69e48b700 1 --2- 172.21.15.26:0/939040710 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff698131970 0x7ff69811b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:33.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.538+0000 7ff69e48b700 1 --2- 172.21.15.26:0/939040710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff69809c650 0x7ff69811a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:33.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.538+0000 7ff69e48b700 1 --2- 172.21.15.26:0/939040710 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff6980a0090 0x7ff69811ab60 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:33.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.539+0000 7ff69e48b700 1 -- 172.21.15.26:0/939040710 >> 172.21.15.26:0/939040710 conn(0x7ff6980a3f70 msgr2=0x7ff69812ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:33.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.539+0000 7ff69e48b700 1 -- 172.21.15.26:0/939040710 shutdown_connections 2023-10-01T07:56:33.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.539+0000 7ff69e48b700 1 -- 172.21.15.26:0/939040710 wait complete. 2023-10-01T07:56:33.553 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:33.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.587+0000 7ff9424e7700 1 -- 172.21.15.26:0/3078621792 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff93c125f80 con 0x7ff93c0a0a30 2023-10-01T07:56:33.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.588+0000 7ff938ff9700 1 -- 172.21.15.26:0/3078621792 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff92c019980 con 0x7ff93c0a0a30 2023-10-01T07:56:33.588 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:33.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.590+0000 7ff9424e7700 1 -- 172.21.15.26:0/3078621792 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff93c0a0a30 msgr2=0x7ff93c1c8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:33.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.590+0000 7ff9424e7700 1 --2- 172.21.15.26:0/3078621792 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff93c0a0a30 0x7ff93c1c8480 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff92c009c40 tx=0x7ff92c004750 comp rx=0 tx=0).stop 2023-10-01T07:56:33.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.590+0000 7ff9424e7700 1 -- 172.21.15.26:0/3078621792 shutdown_connections 2023-10-01T07:56:33.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.590+0000 7ff9424e7700 1 --2- 172.21.15.26:0/3078621792 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff93c134170 0x7ff93c1c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:33.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.590+0000 7ff9424e7700 1 --2- 172.21.15.26:0/3078621792 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff93c0a0a30 0x7ff93c1c8480 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:33.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.590+0000 7ff9424e7700 1 --2- 172.21.15.26:0/3078621792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff93c0a1340 0x7ff93c1c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:33.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.590+0000 7ff9424e7700 1 -- 172.21.15.26:0/3078621792 >> 172.21.15.26:0/3078621792 conn(0x7ff93c0a6550 msgr2=0x7ff93c11c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:33.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.590+0000 7ff9424e7700 1 -- 172.21.15.26:0/3078621792 shutdown_connections 2023-10-01T07:56:33.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:33.590+0000 7ff9424e7700 1 -- 172.21.15.26:0/3078621792 wait complete. 2023-10-01T07:56:33.604 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:34.280 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:34.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.426+0000 7f37aacbe700 1 Processor -- start 2023-10-01T07:56:34.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.426+0000 7f37aacbe700 1 -- start start 2023-10-01T07:56:34.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.426+0000 7f37aacbe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f37a409e1d0 0x7f37a4138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:34.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.426+0000 7f37aacbe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f37a4139170 0x7f37a413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:34.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.426+0000 7f37aacbe700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37a409b120 con 0x7f37a409d6f0 2023-10-01T07:56:34.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.426+0000 7f37aacbe700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a406b460 con 0x7f37a4139170 2023-10-01T07:56:34.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.426+0000 7f37aacbe700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37a409a7e0 con 0x7f37a409e1d0 2023-10-01T07:56:34.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.427+0000 7f37a3fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f37a409e1d0 0x7f37a4138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:34.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.427+0000 7f37a8a5a700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f37a409d6f0 0x7f37a409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49916/0 (socket says 172.21.15.26:49916) 2023-10-01T07:56:34.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.427+0000 7f37a3fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f37a409e1d0 0x7f37a4138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35106/0 (socket says 172.21.15.26:35106) 2023-10-01T07:56:34.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.427+0000 7f37a8a5a700 1 -- 172.21.15.26:0/1451115398 learned_addr learned my addr 172.21.15.26:0/1451115398 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:34.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.427+0000 7f37a925b700 1 --2- 172.21.15.26:0/1451115398 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f37a4139170 0x7f37a413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:34.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.427+0000 7f37a3fff700 1 -- 172.21.15.26:0/1451115398 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f37a4139170 msgr2=0x7f37a413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:34.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.427+0000 7f37a3fff700 1 --2- 172.21.15.26:0/1451115398 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f37a4139170 0x7f37a413b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:34.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.427+0000 7f37a3fff700 1 -- 172.21.15.26:0/1451115398 >> v1:172.21.15.26:6789/0 conn(0x7f37a409d6f0 legacy=0x7f37a409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:34.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.427+0000 7f37a37fe700 1 -- 172.21.15.26:0/1451115398 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 392025749 0 0) 0x7f37a409b120 con 0x7f37a409d6f0 2023-10-01T07:56:34.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.427+0000 7f37a3fff700 1 -- 172.21.15.26:0/1451115398 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a409a500 con 0x7f37a409e1d0 2023-10-01T07:56:34.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.427+0000 7f37a925b700 1 --2- 172.21.15.26:0/1451115398 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f37a4139170 0x7f37a413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:34.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.427+0000 7f37a3fff700 1 --2- 172.21.15.26:0/1451115398 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f37a409e1d0 0x7f37a4138c30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f37900098a0 tx=0x7f3790009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64d8b2bc8a1bcfad server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:34.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.427+0000 7f37a37fe700 1 -- 172.21.15.26:0/1451115398 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3790011830 con 0x7f37a409e1d0 2023-10-01T07:56:34.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.427+0000 7f37a37fe700 1 -- 172.21.15.26:0/1451115398 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3790011990 con 0x7f37a409e1d0 2023-10-01T07:56:34.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.427+0000 7f37a37fe700 1 -- 172.21.15.26:0/1451115398 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3790011d20 con 0x7f37a409e1d0 2023-10-01T07:56:34.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.428+0000 7f37aacbe700 1 -- 172.21.15.26:0/1451115398 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f37a409e1d0 msgr2=0x7f37a4138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:34.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.428+0000 7f37aacbe700 1 --2- 172.21.15.26:0/1451115398 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f37a409e1d0 0x7f37a4138c30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f37900098a0 tx=0x7f3790009bb0 comp rx=0 tx=0).stop 2023-10-01T07:56:34.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.428+0000 7f37aacbe700 1 -- 172.21.15.26:0/1451115398 shutdown_connections 2023-10-01T07:56:34.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.428+0000 7f37aacbe700 1 --2- 172.21.15.26:0/1451115398 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f37a4139170 0x7f37a413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:34.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.428+0000 7f37aacbe700 1 --2- 172.21.15.26:0/1451115398 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f37a409e1d0 0x7f37a4138c30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:34.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.428+0000 7f37aacbe700 1 -- 172.21.15.26:0/1451115398 >> 172.21.15.26:0/1451115398 conn(0x7f37a4066f50 msgr2=0x7f37a409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:34.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.428+0000 7f37aacbe700 1 -- 172.21.15.26:0/1451115398 shutdown_connections 2023-10-01T07:56:34.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.428+0000 7f37aacbe700 1 -- 172.21.15.26:0/1451115398 wait complete. 2023-10-01T07:56:34.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.429+0000 7f37aacbe700 1 Processor -- start 2023-10-01T07:56:34.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.429+0000 7f37aacbe700 1 -- start start 2023-10-01T07:56:34.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.430+0000 7f37aacbe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37a409d6f0 0x7f37a41c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:34.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.430+0000 7f37aacbe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f37a409e1d0 0x7f37a41c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:34.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.430+0000 7f37aacbe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f37a4139170 0x7f37a41c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:34.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.430+0000 7f37aacbe700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a4072210 con 0x7f37a409d6f0 2023-10-01T07:56:34.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.430+0000 7f37aacbe700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a4120680 con 0x7f37a4139170 2023-10-01T07:56:34.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.430+0000 7f37aacbe700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37a4121d20 con 0x7f37a409e1d0 2023-10-01T07:56:34.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.430+0000 7f37a8a5a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37a409d6f0 0x7f37a41c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:34.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.430+0000 7f37a925b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f37a4139170 0x7f37a41c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:34.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.430+0000 7f37a8a5a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37a409d6f0 0x7f37a41c8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56698/0 (socket says 172.21.15.26:56698) 2023-10-01T07:56:34.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.430+0000 7f37a8a5a700 1 -- 172.21.15.26:0/3251041231 learned_addr learned my addr 172.21.15.26:0/3251041231 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:34.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.430+0000 7f37a3fff700 1 --2- 172.21.15.26:0/3251041231 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f37a409e1d0 0x7f37a41c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:34.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.430+0000 7f37a925b700 1 -- 172.21.15.26:0/3251041231 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f37a409e1d0 msgr2=0x7f37a41c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:34.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.430+0000 7f37a925b700 1 --2- 172.21.15.26:0/3251041231 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f37a409e1d0 0x7f37a41c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:34.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.430+0000 7f37a925b700 1 -- 172.21.15.26:0/3251041231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37a409d6f0 msgr2=0x7f37a41c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:34.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.430+0000 7f37a925b700 1 --2- 172.21.15.26:0/3251041231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37a409d6f0 0x7f37a41c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:34.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.430+0000 7f37a925b700 1 -- 172.21.15.26:0/3251041231 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f379c009a70 con 0x7f37a4139170 2023-10-01T07:56:34.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.430+0000 7f37a3fff700 1 --2- 172.21.15.26:0/3251041231 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f37a409e1d0 0x7f37a41c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:34.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.430+0000 7f37a8a5a700 1 --2- 172.21.15.26:0/3251041231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37a409d6f0 0x7f37a41c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:34.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.430+0000 7f37a925b700 1 --2- 172.21.15.26:0/3251041231 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f37a4139170 0x7f37a41c8ee0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f379c00efc0 tx=0x7f379c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:34.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.430+0000 7f37a17fa700 1 -- 172.21.15.26:0/3251041231 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379c00ca90 con 0x7f37a4139170 2023-10-01T07:56:34.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.430+0000 7f37a17fa700 1 -- 172.21.15.26:0/3251041231 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379c00f040 con 0x7f37a4139170 2023-10-01T07:56:34.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.431+0000 7f37aacbe700 1 -- 172.21.15.26:0/3251041231 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37900094a0 con 0x7f37a4139170 2023-10-01T07:56:34.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.431+0000 7f37a17fa700 1 -- 172.21.15.26:0/3251041231 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379c00ce30 con 0x7f37a4139170 2023-10-01T07:56:34.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.431+0000 7f37aacbe700 1 -- 172.21.15.26:0/3251041231 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a41222b0 con 0x7f37a4139170 2023-10-01T07:56:34.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.431+0000 7f37a17fa700 1 -- 172.21.15.26:0/3251041231 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f379c014480 con 0x7f37a4139170 2023-10-01T07:56:34.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.431+0000 7f37aacbe700 1 -- 172.21.15.26:0/3251041231 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37a40a1dd0 con 0x7f37a4139170 2023-10-01T07:56:34.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.432+0000 7f37a17fa700 1 -- 172.21.15.26:0/3251041231 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f379c03fd00 con 0x7f37a4139170 2023-10-01T07:56:34.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.437+0000 7f37a17fa700 1 -- 172.21.15.26:0/3251041231 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f379c012910 con 0x7f37a4139170 2023-10-01T07:56:34.501 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:34.554 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:34.605 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:34.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.643+0000 7f057ffe9700 1 Processor -- start 2023-10-01T07:56:34.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.644+0000 7f057ffe9700 1 -- start start 2023-10-01T07:56:34.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.644+0000 7f057ffe9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f057809d6f0 0x7f057809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:34.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.644+0000 7f057ffe9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f057809e410 0x7f0578134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:34.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.644+0000 7f057ffe9700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f057809b120 con 0x7f057809e000 2023-10-01T07:56:34.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.644+0000 7f057ffe9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057806b460 con 0x7f057809d6f0 2023-10-01T07:56:34.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.644+0000 7f057ffe9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f057809a7e0 con 0x7f057809e410 2023-10-01T07:56:34.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.645+0000 7f057dd85700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f057809d6f0 0x7f057809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:34.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.645+0000 7f057d584700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f057809e000 0x7f05781339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49926/0 (socket says 172.21.15.26:49926) 2023-10-01T07:56:34.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.645+0000 7f057d584700 1 -- 172.21.15.26:0/3239050305 learned_addr learned my addr 172.21.15.26:0/3239050305 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:34.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.645+0000 7f057e586700 1 --2- 172.21.15.26:0/3239050305 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f057809e410 0x7f0578134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:34.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.645+0000 7f057e586700 1 -- 172.21.15.26:0/3239050305 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f057809d6f0 msgr2=0x7f057809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:34.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.645+0000 7f057e586700 1 --2- 172.21.15.26:0/3239050305 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f057809d6f0 0x7f057809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:34.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.645+0000 7f057e586700 1 -- 172.21.15.26:0/3239050305 >> v1:172.21.15.26:6789/0 conn(0x7f057809e000 legacy=0x7f05781339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:34.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.645+0000 7f057e586700 1 -- 172.21.15.26:0/3239050305 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f057809a500 con 0x7f057809e410 2023-10-01T07:56:34.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.645+0000 7f057dd85700 1 --2- 172.21.15.26:0/3239050305 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f057809d6f0 0x7f057809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:34.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.645+0000 7f057e586700 1 --2- 172.21.15.26:0/3239050305 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f057809e410 0x7f0578134100 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0570009df0 tx=0x7f057000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5254a0ef1b0e2ee server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:34.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.646+0000 7f057cd83700 1 -- 172.21.15.26:0/3239050305 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057000e070 con 0x7f057809e410 2023-10-01T07:56:34.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.646+0000 7f057cd83700 1 -- 172.21.15.26:0/3239050305 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057000bae0 con 0x7f057809e410 2023-10-01T07:56:34.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.646+0000 7f057cd83700 1 -- 172.21.15.26:0/3239050305 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057000be90 con 0x7f057809e410 2023-10-01T07:56:34.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.646+0000 7f057ffe9700 1 -- 172.21.15.26:0/3239050305 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f057809e410 msgr2=0x7f0578134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:34.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.646+0000 7f057ffe9700 1 --2- 172.21.15.26:0/3239050305 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f057809e410 0x7f0578134100 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0570009df0 tx=0x7f057000b330 comp rx=0 tx=0).stop 2023-10-01T07:56:34.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.646+0000 7f057ffe9700 1 -- 172.21.15.26:0/3239050305 shutdown_connections 2023-10-01T07:56:34.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.646+0000 7f057ffe9700 1 --2- 172.21.15.26:0/3239050305 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f057809e410 0x7f0578134100 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:34.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.646+0000 7f057ffe9700 1 --2- 172.21.15.26:0/3239050305 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f057809d6f0 0x7f057809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:34.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.646+0000 7f057ffe9700 1 -- 172.21.15.26:0/3239050305 >> 172.21.15.26:0/3239050305 conn(0x7f0578066f50 msgr2=0x7f057809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:34.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.646+0000 7f37aacbe700 1 -- 172.21.15.26:0/3251041231 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f37a40a0720 con 0x7f37a4139170 2023-10-01T07:56:34.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.647+0000 7f057ffe9700 1 -- 172.21.15.26:0/3239050305 shutdown_connections 2023-10-01T07:56:34.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.647+0000 7f057ffe9700 1 -- 172.21.15.26:0/3239050305 wait complete. 2023-10-01T07:56:34.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.647+0000 7f37a17fa700 1 -- 172.21.15.26:0/3251041231 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f379c012340 con 0x7f37a4139170 2023-10-01T07:56:34.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.648+0000 7f057ffe9700 1 Processor -- start 2023-10-01T07:56:34.650 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:34.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.650+0000 7f057ffe9700 1 -- start start 2023-10-01T07:56:34.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.650+0000 7f37aacbe700 1 -- 172.21.15.26:0/3251041231 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f37a4139170 msgr2=0x7f37a41c8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:34.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.650+0000 7f37aacbe700 1 --2- 172.21.15.26:0/3251041231 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f37a4139170 0x7f37a41c8ee0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f379c00efc0 tx=0x7f379c00c3a0 comp rx=0 tx=0).stop 2023-10-01T07:56:34.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.650+0000 7f37aacbe700 1 -- 172.21.15.26:0/3251041231 shutdown_connections 2023-10-01T07:56:34.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.650+0000 7f37aacbe700 1 --2- 172.21.15.26:0/3251041231 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f37a4139170 0x7f37a41c8ee0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:34.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.650+0000 7f37aacbe700 1 --2- 172.21.15.26:0/3251041231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37a409d6f0 0x7f37a41c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:34.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.650+0000 7f37aacbe700 1 --2- 172.21.15.26:0/3251041231 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f37a409e1d0 0x7f37a41c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:34.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.650+0000 7f37aacbe700 1 -- 172.21.15.26:0/3251041231 >> 172.21.15.26:0/3251041231 conn(0x7f37a4066f50 msgr2=0x7f37a4136b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:34.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.651+0000 7f37aacbe700 1 -- 172.21.15.26:0/3251041231 shutdown_connections 2023-10-01T07:56:34.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.651+0000 7f057ffe9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f057809d6f0 0x7f0578122490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:34.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.651+0000 7f057ffe9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f057809e000 0x7f05781229d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:34.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.651+0000 7f057ffe9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f057809e410 0x7f0578122f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:34.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.651+0000 7f057ffe9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0578124940 con 0x7f057809d6f0 2023-10-01T07:56:34.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.651+0000 7f057ffe9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05780726c0 con 0x7f057809e000 2023-10-01T07:56:34.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.651+0000 7f057ffe9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0578125fb0 con 0x7f057809e410 2023-10-01T07:56:34.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.651+0000 7f057d584700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f057809e000 0x7f05781229d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:34.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.651+0000 7f057d584700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f057809e000 0x7f05781229d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44304/0 (socket says 172.21.15.26:44304) 2023-10-01T07:56:34.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.651+0000 7f057d584700 1 -- 172.21.15.26:0/1678932166 learned_addr learned my addr 172.21.15.26:0/1678932166 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:34.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.651+0000 7f057e586700 1 --2- 172.21.15.26:0/1678932166 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f057809e410 0x7f0578122f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:34.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.651+0000 7f057dd85700 1 --2- 172.21.15.26:0/1678932166 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f057809d6f0 0x7f0578122490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:34.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.651+0000 7f057d584700 1 -- 172.21.15.26:0/1678932166 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f057809e410 msgr2=0x7f0578122f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:34.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.651+0000 7f057d584700 1 --2- 172.21.15.26:0/1678932166 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f057809e410 0x7f0578122f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:34.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.651+0000 7f057d584700 1 -- 172.21.15.26:0/1678932166 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f057809d6f0 msgr2=0x7f0578122490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:34.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.651+0000 7f057d584700 1 --2- 172.21.15.26:0/1678932166 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f057809d6f0 0x7f0578122490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:34.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.651+0000 7f057d584700 1 -- 172.21.15.26:0/1678932166 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05740094a0 con 0x7f057809e000 2023-10-01T07:56:34.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.652+0000 7f37aacbe700 1 -- 172.21.15.26:0/3251041231 wait complete. 2023-10-01T07:56:34.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.652+0000 7f057d584700 1 --2- 172.21.15.26:0/1678932166 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f057809e000 0x7f05781229d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f056800c500 tx=0x7f056800c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:34.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.652+0000 7f056e7fc700 1 -- 172.21.15.26:0/1678932166 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0568005d70 con 0x7f057809e000 2023-10-01T07:56:34.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.652+0000 7f056e7fc700 1 -- 172.21.15.26:0/1678932166 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05680070d0 con 0x7f057809e000 2023-10-01T07:56:34.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.652+0000 7f057ffe9700 1 -- 172.21.15.26:0/1678932166 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0570009a70 con 0x7f057809e000 2023-10-01T07:56:34.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.652+0000 7f056e7fc700 1 -- 172.21.15.26:0/1678932166 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0568007440 con 0x7f057809e000 2023-10-01T07:56:34.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.652+0000 7f057ffe9700 1 -- 172.21.15.26:0/1678932166 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0578124ec0 con 0x7f057809e000 2023-10-01T07:56:34.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.653+0000 7f057ffe9700 1 -- 172.21.15.26:0/1678932166 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0578074ea0 con 0x7f057809e000 2023-10-01T07:56:34.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.653+0000 7f056e7fc700 1 -- 172.21.15.26:0/1678932166 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f05680075a0 con 0x7f057809e000 2023-10-01T07:56:34.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.654+0000 7f056e7fc700 1 -- 172.21.15.26:0/1678932166 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f056803ea00 con 0x7f057809e000 2023-10-01T07:56:34.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.662+0000 7f056e7fc700 1 -- 172.21.15.26:0/1678932166 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0568019b40 con 0x7f057809e000 2023-10-01T07:56:34.671 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:34.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.698+0000 7fbd71b94700 1 Processor -- start 2023-10-01T07:56:34.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.698+0000 7fbd71b94700 1 -- start start 2023-10-01T07:56:34.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.699+0000 7fbd71b94700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbd6c09d630 0x7fbd6c0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:34.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.699+0000 7fbd71b94700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd6c138d80 0x7fbd6c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:34.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.699+0000 7fbd71b94700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd6c0a2a70 con 0x7fbd6c0a0a30 2023-10-01T07:56:34.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.699+0000 7fbd71b94700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd6c0a01d0 con 0x7fbd6c09d630 2023-10-01T07:56:34.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.699+0000 7fbd71b94700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c09e2b0 con 0x7fbd6c138d80 2023-10-01T07:56:34.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.699+0000 7fbd62ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbd6c09d630 0x7fbd6c0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:34.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.699+0000 7fbd62ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbd6c09d630 0x7fbd6c0a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56712/0 (socket says 172.21.15.26:56712) 2023-10-01T07:56:34.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.699+0000 7fbd62ffd700 1 -- 172.21.15.26:0/1790234585 learned_addr learned my addr 172.21.15.26:0/1790234585 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:34.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.699+0000 7fbd6bfff700 1 --2- 172.21.15.26:0/1790234585 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd6c138d80 0x7fbd6c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:34.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.699+0000 7fbd62ffd700 1 -- 172.21.15.26:0/1790234585 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd6c138d80 msgr2=0x7fbd6c13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:34.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.699+0000 7fbd62ffd700 1 --2- 172.21.15.26:0/1790234585 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd6c138d80 0x7fbd6c13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:34.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.699+0000 7fbd62ffd700 1 -- 172.21.15.26:0/1790234585 >> v1:172.21.15.26:6789/0 conn(0x7fbd6c0a0a30 legacy=0x7fbd6c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:34.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.699+0000 7fbd6affd700 1 -- 172.21.15.26:0/1790234585 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1341945100 0 0) 0x7fbd6c0a2a70 con 0x7fbd6c0a0a30 2023-10-01T07:56:34.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.699+0000 7fbd62ffd700 1 -- 172.21.15.26:0/1790234585 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6c09dc50 con 0x7fbd6c09d630 2023-10-01T07:56:34.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.700+0000 7fbd62ffd700 1 --2- 172.21.15.26:0/1790234585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd6c09d630 0x7fbd6c0a1510 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fbd540098f0 tx=0x7fbd54009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6be3745294859d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:34.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.700+0000 7fbd6affd700 1 -- 172.21.15.26:0/1790234585 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd54011830 con 0x7fbd6c09d630 2023-10-01T07:56:34.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.700+0000 7fbd6affd700 1 -- 172.21.15.26:0/1790234585 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd54011990 con 0x7fbd6c09d630 2023-10-01T07:56:34.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.700+0000 7fbd6affd700 1 -- 172.21.15.26:0/1790234585 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd54011d20 con 0x7fbd6c09d630 2023-10-01T07:56:34.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.700+0000 7fbd71b94700 1 -- 172.21.15.26:0/1790234585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd6c09d630 msgr2=0x7fbd6c0a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:34.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.700+0000 7fbd71b94700 1 --2- 172.21.15.26:0/1790234585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd6c09d630 0x7fbd6c0a1510 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fbd540098f0 tx=0x7fbd54009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:34.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.700+0000 7fbd71b94700 1 -- 172.21.15.26:0/1790234585 shutdown_connections 2023-10-01T07:56:34.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.700+0000 7fbd71b94700 1 --2- 172.21.15.26:0/1790234585 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd6c138d80 0x7fbd6c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:34.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.700+0000 7fbd71b94700 1 --2- 172.21.15.26:0/1790234585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd6c09d630 0x7fbd6c0a1510 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:34.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.700+0000 7fbd71b94700 1 -- 172.21.15.26:0/1790234585 >> 172.21.15.26:0/1790234585 conn(0x7fbd6c0a3050 msgr2=0x7fbd6c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:34.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.701+0000 7fbd71b94700 1 -- 172.21.15.26:0/1790234585 shutdown_connections 2023-10-01T07:56:34.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.701+0000 7fbd71b94700 1 -- 172.21.15.26:0/1790234585 wait complete. 2023-10-01T07:56:34.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.701+0000 7fbd71b94700 1 Processor -- start 2023-10-01T07:56:34.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.702+0000 7fbd71b94700 1 -- start start 2023-10-01T07:56:34.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.702+0000 7fbd71b94700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd6c09d630 0x7fbd6c1337a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:34.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.702+0000 7fbd71b94700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd6c0a0a30 0x7fbd6c133ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:34.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.702+0000 7fbd71b94700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd6c138d80 0x7fbd6c134220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:34.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.702+0000 7fbd71b94700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c136270 con 0x7fbd6c138d80 2023-10-01T07:56:34.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.702+0000 7fbd71b94700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c136f90 con 0x7fbd6c0a0a30 2023-10-01T07:56:34.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.702+0000 7fbd71b94700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c0a4b10 con 0x7fbd6c09d630 2023-10-01T07:56:34.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.702+0000 7fbd6bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd6c138d80 0x7fbd6c134220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:34.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.702+0000 7fbd6bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd6c138d80 0x7fbd6c134220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56718/0 (socket says 172.21.15.26:56718) 2023-10-01T07:56:34.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.702+0000 7fbd6b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd6c09d630 0x7fbd6c1337a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:34.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.702+0000 7fbd6bfff700 1 -- 172.21.15.26:0/1916427208 learned_addr learned my addr 172.21.15.26:0/1916427208 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:34.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.703+0000 7fbd62ffd700 1 --2- 172.21.15.26:0/1916427208 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd6c0a0a30 0x7fbd6c133ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:34.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.703+0000 7fbd6b7fe700 1 -- 172.21.15.26:0/1916427208 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd6c0a0a30 msgr2=0x7fbd6c133ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:34.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.703+0000 7fbd6b7fe700 1 --2- 172.21.15.26:0/1916427208 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd6c0a0a30 0x7fbd6c133ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:34.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.703+0000 7fbd6b7fe700 1 -- 172.21.15.26:0/1916427208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd6c138d80 msgr2=0x7fbd6c134220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:34.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.703+0000 7fbd6b7fe700 1 --2- 172.21.15.26:0/1916427208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd6c138d80 0x7fbd6c134220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:34.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.703+0000 7fbd6b7fe700 1 -- 172.21.15.26:0/1916427208 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd54009550 con 0x7fbd6c09d630 2023-10-01T07:56:34.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.703+0000 7fbd6bfff700 1 --2- 172.21.15.26:0/1916427208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd6c138d80 0x7fbd6c134220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:34.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.703+0000 7fbd6b7fe700 1 --2- 172.21.15.26:0/1916427208 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd6c09d630 0x7fbd6c1337a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00c430 tx=0x7fbd5c00c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:34.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.703+0000 7fbd68ff9700 1 -- 172.21.15.26:0/1916427208 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c0054e0 con 0x7fbd6c09d630 2023-10-01T07:56:34.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.703+0000 7fbd68ff9700 1 -- 172.21.15.26:0/1916427208 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5c00ce40 con 0x7fbd6c09d630 2023-10-01T07:56:34.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.703+0000 7fbd71b94700 1 -- 172.21.15.26:0/1916427208 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd6c0a0410 con 0x7fbd6c09d630 2023-10-01T07:56:34.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.703+0000 7fbd68ff9700 1 -- 172.21.15.26:0/1916427208 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c0038c0 con 0x7fbd6c09d630 2023-10-01T07:56:34.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.703+0000 7fbd71b94700 1 -- 172.21.15.26:0/1916427208 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd6c137270 con 0x7fbd6c09d630 2023-10-01T07:56:34.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.704+0000 7fbd68ff9700 1 -- 172.21.15.26:0/1916427208 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbd5c003a20 con 0x7fbd6c09d630 2023-10-01T07:56:34.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.704+0000 7fbd68ff9700 1 -- 172.21.15.26:0/1916427208 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbd5c03ea10 con 0x7fbd6c09d630 2023-10-01T07:56:34.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.705+0000 7fbd71b94700 1 -- 172.21.15.26:0/1916427208 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd6c136dd0 con 0x7fbd6c09d630 2023-10-01T07:56:34.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.714+0000 7fbd68ff9700 1 -- 172.21.15.26:0/1916427208 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbd5c017070 con 0x7fbd6c09d630 2023-10-01T07:56:34.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.753+0000 7f590ec2d700 1 Processor -- start 2023-10-01T07:56:34.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.753+0000 7f590ec2d700 1 -- start start 2023-10-01T07:56:34.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.754+0000 7f590ec2d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f59080a0a30 0x7f59080a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:34.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.754+0000 7f590ec2d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5908138d80 0x7f590813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:34.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.754+0000 7f590ec2d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59080a2a70 con 0x7f590809d630 2023-10-01T07:56:34.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.754+0000 7f590ec2d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59080a01d0 con 0x7f5908138d80 2023-10-01T07:56:34.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.754+0000 7f590ec2d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f590809e2b0 con 0x7f59080a0a30 2023-10-01T07:56:34.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.754+0000 7f590c9c9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f59080a0a30 0x7f59080a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:34.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.754+0000 7f590c9c9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f59080a0a30 0x7f59080a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35166/0 (socket says 172.21.15.26:35166) 2023-10-01T07:56:34.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.754+0000 7f590c9c9700 1 -- 172.21.15.26:0/3435952327 learned_addr learned my addr 172.21.15.26:0/3435952327 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:34.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.754+0000 7f5907fff700 1 --1- 172.21.15.26:0/3435952327 >> v1:172.21.15.26:6789/0 conn(0x7f590809d630 0x7f59080a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49944/0 (socket says 172.21.15.26:49944) 2023-10-01T07:56:34.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.754+0000 7f590d1ca700 1 --2- 172.21.15.26:0/3435952327 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5908138d80 0x7f590813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:34.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.754+0000 7f59077fe700 1 -- 172.21.15.26:0/3435952327 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2226125038 0 0) 0x7f59080a2a70 con 0x7f590809d630 2023-10-01T07:56:34.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.754+0000 7f59077fe700 1 -- 172.21.15.26:0/3435952327 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58f80035b0 con 0x7f590809d630 2023-10-01T07:56:34.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.755+0000 7f590d1ca700 1 -- 172.21.15.26:0/3435952327 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f59080a0a30 msgr2=0x7f59080a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:34.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.755+0000 7f590d1ca700 1 --2- 172.21.15.26:0/3435952327 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f59080a0a30 0x7f59080a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:34.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.755+0000 7f590d1ca700 1 -- 172.21.15.26:0/3435952327 >> v1:172.21.15.26:6789/0 conn(0x7f590809d630 legacy=0x7f59080a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:34.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.755+0000 7f590d1ca700 1 -- 172.21.15.26:0/3435952327 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f590809dc50 con 0x7f5908138d80 2023-10-01T07:56:34.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.755+0000 7f590c9c9700 1 --2- 172.21.15.26:0/3435952327 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f59080a0a30 0x7f59080a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:34.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.755+0000 7f590d1ca700 1 --2- 172.21.15.26:0/3435952327 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5908138d80 0x7f590813b160 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5900009dc0 tx=0x7f590000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3a75913d0f7e22 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:34.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.755+0000 7f59077fe700 1 -- 172.21.15.26:0/3435952327 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590000e070 con 0x7f5908138d80 2023-10-01T07:56:34.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.755+0000 7f59077fe700 1 -- 172.21.15.26:0/3435952327 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590000bb20 con 0x7f5908138d80 2023-10-01T07:56:34.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.755+0000 7f59077fe700 1 -- 172.21.15.26:0/3435952327 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5900012430 con 0x7f5908138d80 2023-10-01T07:56:34.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.756+0000 7f590ec2d700 1 -- 172.21.15.26:0/3435952327 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5908138d80 msgr2=0x7f590813b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:34.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.756+0000 7f590ec2d700 1 --2- 172.21.15.26:0/3435952327 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5908138d80 0x7f590813b160 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5900009dc0 tx=0x7f590000b330 comp rx=0 tx=0).stop 2023-10-01T07:56:34.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.756+0000 7f590ec2d700 1 -- 172.21.15.26:0/3435952327 shutdown_connections 2023-10-01T07:56:34.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.756+0000 7f590ec2d700 1 --2- 172.21.15.26:0/3435952327 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f59080a0a30 0x7f59080a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:34.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.756+0000 7f590ec2d700 1 --2- 172.21.15.26:0/3435952327 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5908138d80 0x7f590813b160 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:34.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.756+0000 7f590ec2d700 1 -- 172.21.15.26:0/3435952327 >> 172.21.15.26:0/3435952327 conn(0x7f59080a3050 msgr2=0x7f59080a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:34.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.756+0000 7f590ec2d700 1 -- 172.21.15.26:0/3435952327 shutdown_connections 2023-10-01T07:56:34.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.756+0000 7f590ec2d700 1 -- 172.21.15.26:0/3435952327 wait complete. 2023-10-01T07:56:34.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.757+0000 7f590ec2d700 1 Processor -- start 2023-10-01T07:56:34.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.757+0000 7f590ec2d700 1 -- start start 2023-10-01T07:56:34.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.758+0000 7f590ec2d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f590809d630 0x7f590811c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:34.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.758+0000 7f590ec2d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f59080a0a30 0x7f590811cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:34.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.758+0000 7f590ec2d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5908138d80 0x7f590811d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:34.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.758+0000 7f590ec2d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590811f1f0 con 0x7f5908138d80 2023-10-01T07:56:34.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.758+0000 7f590ec2d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f590811e790 con 0x7f590809d630 2023-10-01T07:56:34.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.758+0000 7f590ec2d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f590809d320 con 0x7f59080a0a30 2023-10-01T07:56:34.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.758+0000 7f590c9c9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f590809d630 0x7f590811c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:34.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.758+0000 7f590d1ca700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5908138d80 0x7f590811d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:34.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.758+0000 7f590c9c9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f590809d630 0x7f590811c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44320/0 (socket says 172.21.15.26:44320) 2023-10-01T07:56:34.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.758+0000 7f590c9c9700 1 -- 172.21.15.26:0/144284875 learned_addr learned my addr 172.21.15.26:0/144284875 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:34.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.758+0000 7f5907fff700 1 --2- 172.21.15.26:0/144284875 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f59080a0a30 0x7f590811cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:34.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.759+0000 7f590c9c9700 1 -- 172.21.15.26:0/144284875 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f59080a0a30 msgr2=0x7f590811cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:34.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.759+0000 7f590c9c9700 1 --2- 172.21.15.26:0/144284875 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f59080a0a30 0x7f590811cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:34.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.759+0000 7f590c9c9700 1 -- 172.21.15.26:0/144284875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5908138d80 msgr2=0x7f590811d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:34.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.759+0000 7f590c9c9700 1 --2- 172.21.15.26:0/144284875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5908138d80 0x7f590811d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:34.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.759+0000 7f590c9c9700 1 -- 172.21.15.26:0/144284875 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58fc009550 con 0x7f590809d630 2023-10-01T07:56:34.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.759+0000 7f590c9c9700 1 --2- 172.21.15.26:0/144284875 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f590809d630 0x7f590811c7c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f58fc00ebe0 tx=0x7f58fc00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:34.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.759+0000 7f59057fa700 1 -- 172.21.15.26:0/144284875 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58fc00c850 con 0x7f590809d630 2023-10-01T07:56:34.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.759+0000 7f59057fa700 1 -- 172.21.15.26:0/144284875 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58fc00c9b0 con 0x7f590809d630 2023-10-01T07:56:34.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.759+0000 7f590ec2d700 1 -- 172.21.15.26:0/144284875 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5900009a70 con 0x7f590809d630 2023-10-01T07:56:34.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.759+0000 7f59057fa700 1 -- 172.21.15.26:0/144284875 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58fc00cd40 con 0x7f590809d630 2023-10-01T07:56:34.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.759+0000 7f590ec2d700 1 -- 172.21.15.26:0/144284875 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f590811fee0 con 0x7f590809d630 2023-10-01T07:56:34.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.760+0000 7f590ec2d700 1 -- 172.21.15.26:0/144284875 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59080747f0 con 0x7f590809d630 2023-10-01T07:56:34.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.761+0000 7f59057fa700 1 -- 172.21.15.26:0/144284875 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f58fc013470 con 0x7f590809d630 2023-10-01T07:56:34.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.761+0000 7f59057fa700 1 -- 172.21.15.26:0/144284875 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f58fc0402c0 con 0x7f590809d630 2023-10-01T07:56:34.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.769+0000 7f59057fa700 1 -- 172.21.15.26:0/144284875 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f58fc024760 con 0x7f590809d630 2023-10-01T07:56:34.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.885+0000 7f057ffe9700 1 -- 172.21.15.26:0/1678932166 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f057806c360 con 0x7f057809e000 2023-10-01T07:56:34.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.886+0000 7f056e7fc700 1 -- 172.21.15.26:0/1678932166 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0568017030 con 0x7f057809e000 2023-10-01T07:56:34.886 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:34.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.888+0000 7f057ffe9700 1 -- 172.21.15.26:0/1678932166 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f057809e000 msgr2=0x7f05781229d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:34.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.888+0000 7f057ffe9700 1 --2- 172.21.15.26:0/1678932166 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f057809e000 0x7f05781229d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f056800c500 tx=0x7f056800c810 comp rx=0 tx=0).stop 2023-10-01T07:56:34.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.888+0000 7f057ffe9700 1 -- 172.21.15.26:0/1678932166 shutdown_connections 2023-10-01T07:56:34.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.888+0000 7f057ffe9700 1 --2- 172.21.15.26:0/1678932166 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f057809e410 0x7f0578122f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:34.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.888+0000 7f057ffe9700 1 --2- 172.21.15.26:0/1678932166 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f057809d6f0 0x7f0578122490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:34.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.888+0000 7f057ffe9700 1 --2- 172.21.15.26:0/1678932166 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f057809e000 0x7f05781229d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:34.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.888+0000 7f057ffe9700 1 -- 172.21.15.26:0/1678932166 >> 172.21.15.26:0/1678932166 conn(0x7f0578066f50 msgr2=0x7f05780a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:34.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.888+0000 7f057ffe9700 1 -- 172.21.15.26:0/1678932166 shutdown_connections 2023-10-01T07:56:34.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.888+0000 7f057ffe9700 1 -- 172.21.15.26:0/1678932166 wait complete. 2023-10-01T07:56:34.902 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:34.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.927+0000 7fbd71b94700 1 -- 172.21.15.26:0/1916427208 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbd6c0747f0 con 0x7fbd6c09d630 2023-10-01T07:56:34.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.927+0000 7fbd68ff9700 1 -- 172.21.15.26:0/1916427208 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbd5c019b20 con 0x7fbd6c09d630 2023-10-01T07:56:34.928 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:34.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.930+0000 7fbd71b94700 1 -- 172.21.15.26:0/1916427208 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd6c09d630 msgr2=0x7fbd6c1337a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:34.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.930+0000 7fbd71b94700 1 --2- 172.21.15.26:0/1916427208 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd6c09d630 0x7fbd6c1337a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00c430 tx=0x7fbd5c00c740 comp rx=0 tx=0).stop 2023-10-01T07:56:34.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.930+0000 7fbd71b94700 1 -- 172.21.15.26:0/1916427208 shutdown_connections 2023-10-01T07:56:34.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.930+0000 7fbd71b94700 1 --2- 172.21.15.26:0/1916427208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd6c138d80 0x7fbd6c134220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:34.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.930+0000 7fbd71b94700 1 --2- 172.21.15.26:0/1916427208 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd6c09d630 0x7fbd6c1337a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:34.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.930+0000 7fbd71b94700 1 --2- 172.21.15.26:0/1916427208 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd6c0a0a30 0x7fbd6c133ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:34.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.930+0000 7fbd71b94700 1 -- 172.21.15.26:0/1916427208 >> 172.21.15.26:0/1916427208 conn(0x7fbd6c0a3050 msgr2=0x7fbd6c09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:34.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.930+0000 7fbd71b94700 1 -- 172.21.15.26:0/1916427208 shutdown_connections 2023-10-01T07:56:34.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.930+0000 7fbd71b94700 1 -- 172.21.15.26:0/1916427208 wait complete. 2023-10-01T07:56:34.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:34.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.978+0000 7f590ec2d700 1 -- 172.21.15.26:0/144284875 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f590813afd0 con 0x7f590809d630 2023-10-01T07:56:34.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.978+0000 7f59057fa700 1 -- 172.21.15.26:0/144284875 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f58fc021020 con 0x7f590809d630 2023-10-01T07:56:34.979 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:34.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.980+0000 7f590ec2d700 1 -- 172.21.15.26:0/144284875 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f590809d630 msgr2=0x7f590811c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:34.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.980+0000 7f590ec2d700 1 --2- 172.21.15.26:0/144284875 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f590809d630 0x7f590811c7c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f58fc00ebe0 tx=0x7f58fc00eef0 comp rx=0 tx=0).stop 2023-10-01T07:56:34.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.980+0000 7f590ec2d700 1 -- 172.21.15.26:0/144284875 shutdown_connections 2023-10-01T07:56:34.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.980+0000 7f590ec2d700 1 --2- 172.21.15.26:0/144284875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5908138d80 0x7f590811d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:34.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.980+0000 7f590ec2d700 1 --2- 172.21.15.26:0/144284875 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f590809d630 0x7f590811c7c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:34.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.980+0000 7f590ec2d700 1 --2- 172.21.15.26:0/144284875 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f59080a0a30 0x7f590811cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:34.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.980+0000 7f590ec2d700 1 -- 172.21.15.26:0/144284875 >> 172.21.15.26:0/144284875 conn(0x7f59080a3050 msgr2=0x7f590809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:34.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.980+0000 7f590ec2d700 1 -- 172.21.15.26:0/144284875 shutdown_connections 2023-10-01T07:56:34.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:34.981+0000 7f590ec2d700 1 -- 172.21.15.26:0/144284875 wait complete. 2023-10-01T07:56:34.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:35.673 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:35.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.817+0000 7f2889594700 1 Processor -- start 2023-10-01T07:56:35.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.817+0000 7f2889594700 1 -- start start 2023-10-01T07:56:35.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.818+0000 7f2889594700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2884130750 0x7f2884130b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:35.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.818+0000 7f2889594700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f288409e250 0x7f28841384c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:35.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.818+0000 7f2889594700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f288409c190 con 0x7f288409d6f0 2023-10-01T07:56:35.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.818+0000 7f2889594700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f288409b090 con 0x7f2884130750 2023-10-01T07:56:35.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.818+0000 7f2889594700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f288409a6c0 con 0x7f288409e250 2023-10-01T07:56:35.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.818+0000 7f2882ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2884130750 0x7f2884130b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:35.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.818+0000 7f28837fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f288409e250 0x7f28841384c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:35.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.818+0000 7f2882ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2884130750 0x7f2884130b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56730/0 (socket says 172.21.15.26:56730) 2023-10-01T07:56:35.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.818+0000 7f2882ffd700 1 -- 172.21.15.26:0/2672690766 learned_addr learned my addr 172.21.15.26:0/2672690766 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:35.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.818+0000 7f2882ffd700 1 -- 172.21.15.26:0/2672690766 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f288409e250 msgr2=0x7f28841384c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:35.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.818+0000 7f2882ffd700 1 --2- 172.21.15.26:0/2672690766 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f288409e250 0x7f28841384c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:35.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.818+0000 7f2882ffd700 1 -- 172.21.15.26:0/2672690766 >> v1:172.21.15.26:6789/0 conn(0x7f288409d6f0 legacy=0x7f288409db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:35.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.818+0000 7f2882ffd700 1 -- 172.21.15.26:0/2672690766 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2884131060 con 0x7f2884130750 2023-10-01T07:56:35.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.819+0000 7f2882ffd700 1 --2- 172.21.15.26:0/2672690766 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2884130750 0x7f2884130b20 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f28740098f0 tx=0x7f2874009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b3c6762885e0a08 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:35.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.819+0000 7f2881ffb700 1 -- 172.21.15.26:0/2672690766 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2874011830 con 0x7f2884130750 2023-10-01T07:56:35.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.819+0000 7f2881ffb700 1 -- 172.21.15.26:0/2672690766 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2874011990 con 0x7f2884130750 2023-10-01T07:56:35.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.819+0000 7f2881ffb700 1 -- 172.21.15.26:0/2672690766 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2874011d20 con 0x7f2884130750 2023-10-01T07:56:35.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.819+0000 7f2889594700 1 -- 172.21.15.26:0/2672690766 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2884130750 msgr2=0x7f2884130b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:35.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.819+0000 7f2889594700 1 --2- 172.21.15.26:0/2672690766 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2884130750 0x7f2884130b20 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f28740098f0 tx=0x7f2874009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:35.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.819+0000 7f2889594700 1 -- 172.21.15.26:0/2672690766 shutdown_connections 2023-10-01T07:56:35.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.819+0000 7f2889594700 1 --2- 172.21.15.26:0/2672690766 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f288409e250 0x7f28841384c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:35.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.819+0000 7f2889594700 1 --2- 172.21.15.26:0/2672690766 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2884130750 0x7f2884130b20 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:35.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.819+0000 7f2889594700 1 -- 172.21.15.26:0/2672690766 >> 172.21.15.26:0/2672690766 conn(0x7f288409f470 msgr2=0x7f28840a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:35.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.819+0000 7f2889594700 1 -- 172.21.15.26:0/2672690766 shutdown_connections 2023-10-01T07:56:35.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.819+0000 7f2889594700 1 -- 172.21.15.26:0/2672690766 wait complete. 2023-10-01T07:56:35.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.821+0000 7f2889594700 1 Processor -- start 2023-10-01T07:56:35.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.821+0000 7f2889594700 1 -- start start 2023-10-01T07:56:35.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.821+0000 7f2889594700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f288409d6f0 0x7f28841c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:35.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.821+0000 7f2889594700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f288409e250 0x7f28841c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:35.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.821+0000 7f2889594700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2884130750 0x7f288406df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:35.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.821+0000 7f2889594700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288412f110 con 0x7f2884130750 2023-10-01T07:56:35.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.821+0000 7f2889594700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288412f2f0 con 0x7f288409e250 2023-10-01T07:56:35.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.821+0000 7f2889594700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f288406fb50 con 0x7f288409d6f0 2023-10-01T07:56:35.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.821+0000 7f2882ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f288409d6f0 0x7f28841c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:35.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.821+0000 7f28837fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2884130750 0x7f288406df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:35.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.821+0000 7f28827fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f288409e250 0x7f28841c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:35.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.821+0000 7f2882ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f288409d6f0 0x7f28841c8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35196/0 (socket says 172.21.15.26:35196) 2023-10-01T07:56:35.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.821+0000 7f2882ffd700 1 -- 172.21.15.26:0/2425504943 learned_addr learned my addr 172.21.15.26:0/2425504943 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:35.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.822+0000 7f2882ffd700 1 -- 172.21.15.26:0/2425504943 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f288409e250 msgr2=0x7f28841c8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:35.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.822+0000 7f2882ffd700 1 --2- 172.21.15.26:0/2425504943 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f288409e250 0x7f28841c8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:35.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.822+0000 7f2882ffd700 1 -- 172.21.15.26:0/2425504943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2884130750 msgr2=0x7f288406df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:35.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.822+0000 7f2882ffd700 1 --2- 172.21.15.26:0/2425504943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2884130750 0x7f288406df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:35.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.822+0000 7f2882ffd700 1 -- 172.21.15.26:0/2425504943 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2874009550 con 0x7f288409d6f0 2023-10-01T07:56:35.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.822+0000 7f28837fe700 1 --2- 172.21.15.26:0/2425504943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2884130750 0x7f288406df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:35.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.822+0000 7f2882ffd700 1 --2- 172.21.15.26:0/2425504943 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f288409d6f0 0x7f28841c8520 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2874009c40 tx=0x7f2874004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:35.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.822+0000 7f287b7fe700 1 -- 172.21.15.26:0/2425504943 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2874004240 con 0x7f288409d6f0 2023-10-01T07:56:35.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.822+0000 7f287b7fe700 1 -- 172.21.15.26:0/2425504943 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287401f070 con 0x7f288409d6f0 2023-10-01T07:56:35.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.822+0000 7f2889594700 1 -- 172.21.15.26:0/2425504943 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28840a0ce0 con 0x7f288409d6f0 2023-10-01T07:56:35.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.822+0000 7f287b7fe700 1 -- 172.21.15.26:0/2425504943 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28740045e0 con 0x7f288409d6f0 2023-10-01T07:56:35.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.822+0000 7f2889594700 1 -- 172.21.15.26:0/2425504943 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f288412df60 con 0x7f288409d6f0 2023-10-01T07:56:35.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.823+0000 7f287b7fe700 1 -- 172.21.15.26:0/2425504943 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2874021030 con 0x7f288409d6f0 2023-10-01T07:56:35.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.823+0000 7f287b7fe700 1 -- 172.21.15.26:0/2425504943 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f28740407f0 con 0x7f288409d6f0 2023-10-01T07:56:35.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.823+0000 7f2889594700 1 -- 172.21.15.26:0/2425504943 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f288412f430 con 0x7f288409d6f0 2023-10-01T07:56:35.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:35.828+0000 7f287b7fe700 1 -- 172.21.15.26:0/2425504943 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f288412f430 con 0x7f288409d6f0 2023-10-01T07:56:35.904 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:35.945 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:35.996 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:36.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.039+0000 7f2889594700 1 -- 172.21.15.26:0/2425504943 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f288412ef70 con 0x7f288409d6f0 2023-10-01T07:56:36.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.039+0000 7f287b7fe700 1 -- 172.21.15.26:0/2425504943 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f288412ef70 con 0x7f288409d6f0 2023-10-01T07:56:36.040 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:36.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.041+0000 7f2889594700 1 -- 172.21.15.26:0/2425504943 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f288409d6f0 msgr2=0x7f28841c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:36.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.041+0000 7f2889594700 1 --2- 172.21.15.26:0/2425504943 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f288409d6f0 0x7f28841c8520 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2874009c40 tx=0x7f2874004750 comp rx=0 tx=0).stop 2023-10-01T07:56:36.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.041+0000 7f2889594700 1 -- 172.21.15.26:0/2425504943 shutdown_connections 2023-10-01T07:56:36.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.041+0000 7f2889594700 1 --2- 172.21.15.26:0/2425504943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2884130750 0x7f288406df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:36.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.041+0000 7f2889594700 1 --2- 172.21.15.26:0/2425504943 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f288409d6f0 0x7f28841c8520 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:36.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.041+0000 7f2889594700 1 --2- 172.21.15.26:0/2425504943 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f288409e250 0x7f28841c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:36.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.041+0000 7f2889594700 1 -- 172.21.15.26:0/2425504943 >> 172.21.15.26:0/2425504943 conn(0x7f288409f470 msgr2=0x7f28840992c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:36.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.041+0000 7f2889594700 1 -- 172.21.15.26:0/2425504943 shutdown_connections 2023-10-01T07:56:36.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.042+0000 7f2889594700 1 -- 172.21.15.26:0/2425504943 wait complete. 2023-10-01T07:56:36.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.056+0000 7f33586a7700 1 Processor -- start 2023-10-01T07:56:36.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.056+0000 7f33586a7700 1 -- start start 2023-10-01T07:56:36.058 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:36.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.057+0000 7f33586a7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f335006c0e0 0x7f335009ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:36.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.057+0000 7f33586a7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3350134ec0 0x7f33501379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:36.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.057+0000 7f33586a7700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3350134980 con 0x7f3350137f20 2023-10-01T07:56:36.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.057+0000 7f33586a7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f335006c4b0 con 0x7f3350134ec0 2023-10-01T07:56:36.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.057+0000 7f33586a7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33500a09c0 con 0x7f335006c0e0 2023-10-01T07:56:36.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.057+0000 7f3356443700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f335006c0e0 0x7f335009ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:36.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.057+0000 7f3356443700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f335006c0e0 0x7f335009ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44344/0 (socket says 172.21.15.26:44344) 2023-10-01T07:56:36.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.057+0000 7f3356443700 1 -- 172.21.15.26:0/4270129930 learned_addr learned my addr 172.21.15.26:0/4270129930 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:36.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.057+0000 7f3355c42700 1 --2- 172.21.15.26:0/4270129930 >> v2:172.21.15.26:3300/0 conn(0x7f3350134ec0 0x7f33501379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:36.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.057+0000 7f3356443700 1 -- 172.21.15.26:0/4270129930 >> v2:172.21.15.26:3300/0 conn(0x7f3350134ec0 msgr2=0x7f33501379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:36.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.057+0000 7f3356443700 1 --2- 172.21.15.26:0/4270129930 >> v2:172.21.15.26:3300/0 conn(0x7f3350134ec0 0x7f33501379e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:36.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.057+0000 7f3356443700 1 -- 172.21.15.26:0/4270129930 >> v1:172.21.15.26:6789/0 conn(0x7f3350137f20 legacy=0x7f335013ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:36.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.057+0000 7f3356443700 1 -- 172.21.15.26:0/4270129930 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33500a0600 con 0x7f335006c0e0 2023-10-01T07:56:36.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.058+0000 7f3355c42700 1 --2- 172.21.15.26:0/4270129930 >> v2:172.21.15.26:3300/0 conn(0x7f3350134ec0 0x7f33501379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:56:36.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.058+0000 7f3356443700 1 --2- 172.21.15.26:0/4270129930 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f335006c0e0 0x7f335009ac90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3348009e50 tx=0x7f334800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4dcea8bf3e4cae4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:36.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.058+0000 7f3355441700 1 -- 172.21.15.26:0/4270129930 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334800e070 con 0x7f335006c0e0 2023-10-01T07:56:36.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.058+0000 7f3355441700 1 -- 172.21.15.26:0/4270129930 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3348003a20 con 0x7f335006c0e0 2023-10-01T07:56:36.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.058+0000 7f3355441700 1 -- 172.21.15.26:0/4270129930 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3348003dd0 con 0x7f335006c0e0 2023-10-01T07:56:36.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.059+0000 7f33586a7700 1 -- 172.21.15.26:0/4270129930 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f335006c0e0 msgr2=0x7f335009ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:36.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.059+0000 7f33586a7700 1 --2- 172.21.15.26:0/4270129930 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f335006c0e0 0x7f335009ac90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3348009e50 tx=0x7f334800b330 comp rx=0 tx=0).stop 2023-10-01T07:56:36.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.059+0000 7f33586a7700 1 -- 172.21.15.26:0/4270129930 shutdown_connections 2023-10-01T07:56:36.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.059+0000 7f33586a7700 1 --2- 172.21.15.26:0/4270129930 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f335006c0e0 0x7f335009ac90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:36.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.059+0000 7f33586a7700 1 --2- 172.21.15.26:0/4270129930 >> v2:172.21.15.26:3300/0 conn(0x7f3350134ec0 0x7f33501379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:36.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.059+0000 7f33586a7700 1 -- 172.21.15.26:0/4270129930 >> 172.21.15.26:0/4270129930 conn(0x7f33500a4210 msgr2=0x7f33500a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:36.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.059+0000 7f33586a7700 1 -- 172.21.15.26:0/4270129930 shutdown_connections 2023-10-01T07:56:36.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.059+0000 7f33586a7700 1 -- 172.21.15.26:0/4270129930 wait complete. 2023-10-01T07:56:36.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.060+0000 7f33586a7700 1 Processor -- start 2023-10-01T07:56:36.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.061+0000 7f33586a7700 1 -- start start 2023-10-01T07:56:36.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.061+0000 7f33586a7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f335006c0e0 0x7f33501ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:36.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.061+0000 7f33586a7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3350134ec0 0x7f33501cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:36.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.061+0000 7f33586a7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3350137f20 0x7f335011a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:36.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.061+0000 7f33586a7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33500a3e10 con 0x7f3350134ec0 2023-10-01T07:56:36.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.061+0000 7f33586a7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f335011d8d0 con 0x7f3350137f20 2023-10-01T07:56:36.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.061+0000 7f33586a7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33500a03f0 con 0x7f335006c0e0 2023-10-01T07:56:36.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.061+0000 7f3356c44700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3350137f20 0x7f335011a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:36.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.061+0000 7f3355c42700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3350134ec0 0x7f33501cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:36.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.061+0000 7f3356c44700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3350137f20 0x7f335011a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44356/0 (socket says 172.21.15.26:44356) 2023-10-01T07:56:36.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.061+0000 7f3355c42700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3350134ec0 0x7f33501cd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56750/0 (socket says 172.21.15.26:56750) 2023-10-01T07:56:36.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.061+0000 7f3356c44700 1 -- 172.21.15.26:0/2803515679 learned_addr learned my addr 172.21.15.26:0/2803515679 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:36.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.061+0000 7f3356443700 1 --2- 172.21.15.26:0/2803515679 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f335006c0e0 0x7f33501ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:36.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.062+0000 7f3356c44700 1 -- 172.21.15.26:0/2803515679 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f335006c0e0 msgr2=0x7f33501ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:36.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.062+0000 7f3356c44700 1 --2- 172.21.15.26:0/2803515679 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f335006c0e0 0x7f33501ccd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:36.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.062+0000 7f3356c44700 1 -- 172.21.15.26:0/2803515679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3350134ec0 msgr2=0x7f33501cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:36.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.062+0000 7f3356c44700 1 --2- 172.21.15.26:0/2803515679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3350134ec0 0x7f33501cd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:36.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.062+0000 7f3356c44700 1 -- 172.21.15.26:0/2803515679 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3348009b30 con 0x7f3350137f20 2023-10-01T07:56:36.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.062+0000 7f3355c42700 1 --2- 172.21.15.26:0/2803515679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3350134ec0 0x7f33501cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:36.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.062+0000 7f3356c44700 1 --2- 172.21.15.26:0/2803515679 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3350137f20 0x7f335011a680 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f334000c450 tx=0x7f334000c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:36.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.063+0000 7f3346ffd700 1 -- 172.21.15.26:0/2803515679 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3340011790 con 0x7f3350137f20 2023-10-01T07:56:36.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.063+0000 7f3346ffd700 1 -- 172.21.15.26:0/2803515679 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3340011910 con 0x7f3350137f20 2023-10-01T07:56:36.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.063+0000 7f3346ffd700 1 -- 172.21.15.26:0/2803515679 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3340011cc0 con 0x7f3350137f20 2023-10-01T07:56:36.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.064+0000 7f33586a7700 1 -- 172.21.15.26:0/2803515679 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f335011db40 con 0x7f3350137f20 2023-10-01T07:56:36.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.064+0000 7f33586a7700 1 -- 172.21.15.26:0/2803515679 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f335011e0e0 con 0x7f3350137f20 2023-10-01T07:56:36.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.065+0000 7f3346ffd700 1 -- 172.21.15.26:0/2803515679 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f334001c460 con 0x7f3350137f20 2023-10-01T07:56:36.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.065+0000 7f33586a7700 1 -- 172.21.15.26:0/2803515679 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3350074ea0 con 0x7f3350137f20 2023-10-01T07:56:36.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.065+0000 7f3346ffd700 1 -- 172.21.15.26:0/2803515679 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f334003f380 con 0x7f3350137f20 2023-10-01T07:56:36.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.071+0000 7f3346ffd700 1 -- 172.21.15.26:0/2803515679 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f334000ce60 con 0x7f3350137f20 2023-10-01T07:56:36.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.100+0000 7f955546f700 1 Processor -- start 2023-10-01T07:56:36.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.101+0000 7f955546f700 1 -- start start 2023-10-01T07:56:36.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.101+0000 7f955546f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f955012cf60 0x7f955006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:36.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.101+0000 7f955546f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f955012f8b0 0x7f955012fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:36.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.101+0000 7f955546f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9550130260 0x7f9550136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:36.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.101+0000 7f955546f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f955012d330 con 0x7f9550130260 2023-10-01T07:56:36.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.101+0000 7f955546f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f955012cd90 con 0x7f955012f8b0 2023-10-01T07:56:36.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.101+0000 7f955546f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95501306d0 con 0x7f955012cf60 2023-10-01T07:56:36.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.102+0000 7f954e7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f955012f8b0 0x7f955012fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:36.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.102+0000 7f954effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f955012cf60 0x7f955006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:36.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.102+0000 7f954e7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f955012f8b0 0x7f955012fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44358/0 (socket says 172.21.15.26:44358) 2023-10-01T07:56:36.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.102+0000 7f954e7fc700 1 -- 172.21.15.26:0/951358021 learned_addr learned my addr 172.21.15.26:0/951358021 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:36.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.102+0000 7f954f7fe700 1 --2- 172.21.15.26:0/951358021 >> v2:172.21.15.26:3300/0 conn(0x7f9550130260 0x7f9550136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:36.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.102+0000 7f954f7fe700 1 -- 172.21.15.26:0/951358021 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f955012cf60 msgr2=0x7f955006f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:36.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.102+0000 7f954f7fe700 1 --2- 172.21.15.26:0/951358021 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f955012cf60 0x7f955006f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:36.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.102+0000 7f954f7fe700 1 -- 172.21.15.26:0/951358021 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f955012f8b0 msgr2=0x7f955012fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:36.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.102+0000 7f954f7fe700 1 --2- 172.21.15.26:0/951358021 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f955012f8b0 0x7f955012fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:36.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.102+0000 7f954f7fe700 1 -- 172.21.15.26:0/951358021 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9550071780 con 0x7f9550130260 2023-10-01T07:56:36.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.102+0000 7f954effd700 1 --2- 172.21.15.26:0/951358021 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f955012cf60 0x7f955006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:36.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.102+0000 7f954e7fc700 1 --2- 172.21.15.26:0/951358021 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f955012f8b0 0x7f955012fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:36.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.102+0000 7f954f7fe700 1 --2- 172.21.15.26:0/951358021 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9550130260 0x7f9550136c20 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9548009d90 tx=0x7f954800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b2367293607d50d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:36.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.102+0000 7f954dffb700 1 -- 172.21.15.26:0/951358021 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954800e070 con 0x7f9550130260 2023-10-01T07:56:36.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.102+0000 7f954dffb700 1 -- 172.21.15.26:0/951358021 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954800bb20 con 0x7f9550130260 2023-10-01T07:56:36.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.102+0000 7f954dffb700 1 -- 172.21.15.26:0/951358021 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9548012430 con 0x7f9550130260 2023-10-01T07:56:36.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.103+0000 7f955546f700 1 -- 172.21.15.26:0/951358021 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9550130260 msgr2=0x7f9550136c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:36.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.103+0000 7f955546f700 1 --2- 172.21.15.26:0/951358021 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9550130260 0x7f9550136c20 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9548009d90 tx=0x7f954800b330 comp rx=0 tx=0).stop 2023-10-01T07:56:36.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.104+0000 7f955546f700 1 -- 172.21.15.26:0/951358021 shutdown_connections 2023-10-01T07:56:36.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.104+0000 7f955546f700 1 --2- 172.21.15.26:0/951358021 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9550130260 0x7f9550136c20 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:36.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.104+0000 7f955546f700 1 --2- 172.21.15.26:0/951358021 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f955012cf60 0x7f955006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:36.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.104+0000 7f955546f700 1 --2- 172.21.15.26:0/951358021 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f955012f8b0 0x7f955012fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:36.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.104+0000 7f955546f700 1 -- 172.21.15.26:0/951358021 >> 172.21.15.26:0/951358021 conn(0x7f95500a2aa0 msgr2=0x7f95500a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:36.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.104+0000 7f955546f700 1 -- 172.21.15.26:0/951358021 shutdown_connections 2023-10-01T07:56:36.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.104+0000 7f955546f700 1 -- 172.21.15.26:0/951358021 wait complete. 2023-10-01T07:56:36.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.105+0000 7f955546f700 1 Processor -- start 2023-10-01T07:56:36.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.105+0000 7f955546f700 1 -- start start 2023-10-01T07:56:36.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.106+0000 7f955546f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f955012cf60 0x7f95501309e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:36.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.106+0000 7f955546f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f955012f8b0 0x7f9550130f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:36.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.106+0000 7f955546f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9550130260 0x7f9550131460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:36.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.106+0000 7f955546f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9550132eb0 con 0x7f955012f8b0 2023-10-01T07:56:36.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.106+0000 7f955546f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95501330b0 con 0x7f955012cf60 2023-10-01T07:56:36.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.106+0000 7f955546f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f955012d9d0 con 0x7f9550130260 2023-10-01T07:56:36.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.106+0000 7f954effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f955012cf60 0x7f95501309e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:36.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.106+0000 7f954effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f955012cf60 0x7f95501309e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44374/0 (socket says 172.21.15.26:44374) 2023-10-01T07:56:36.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.106+0000 7f954effd700 1 -- 172.21.15.26:0/3155348284 learned_addr learned my addr 172.21.15.26:0/3155348284 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:36.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.106+0000 7f954e7fc700 1 --2- 172.21.15.26:0/3155348284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f955012f8b0 0x7f9550130f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:36.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.106+0000 7f954f7fe700 1 --2- 172.21.15.26:0/3155348284 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9550130260 0x7f9550131460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:36.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.107+0000 7f954e7fc700 1 -- 172.21.15.26:0/3155348284 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9550130260 msgr2=0x7f9550131460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:36.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.107+0000 7f954e7fc700 1 --2- 172.21.15.26:0/3155348284 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9550130260 0x7f9550131460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:36.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.107+0000 7f954e7fc700 1 -- 172.21.15.26:0/3155348284 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f955012cf60 msgr2=0x7f95501309e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:36.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.107+0000 7f954e7fc700 1 --2- 172.21.15.26:0/3155348284 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f955012cf60 0x7f95501309e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:36.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.107+0000 7f954e7fc700 1 -- 172.21.15.26:0/3155348284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95400094a0 con 0x7f955012f8b0 2023-10-01T07:56:36.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.107+0000 7f954e7fc700 1 --2- 172.21.15.26:0/3155348284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f955012f8b0 0x7f9550130f20 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f9550129f70 tx=0x7f954400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:36.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.107+0000 7f95377fe700 1 -- 172.21.15.26:0/3155348284 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9544004240 con 0x7f955012f8b0 2023-10-01T07:56:36.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.107+0000 7f95377fe700 1 -- 172.21.15.26:0/3155348284 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95440043a0 con 0x7f955012f8b0 2023-10-01T07:56:36.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.107+0000 7f955546f700 1 -- 172.21.15.26:0/3155348284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9544009550 con 0x7f955012f8b0 2023-10-01T07:56:36.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.107+0000 7f95377fe700 1 -- 172.21.15.26:0/3155348284 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95440036a0 con 0x7f955012f8b0 2023-10-01T07:56:36.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.107+0000 7f955546f700 1 -- 172.21.15.26:0/3155348284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9548009a70 con 0x7f955012f8b0 2023-10-01T07:56:36.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.108+0000 7f955546f700 1 -- 172.21.15.26:0/3155348284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9550074ea0 con 0x7f955012f8b0 2023-10-01T07:56:36.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.109+0000 7f95377fe700 1 -- 172.21.15.26:0/3155348284 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9544003800 con 0x7f955012f8b0 2023-10-01T07:56:36.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.109+0000 7f95377fe700 1 -- 172.21.15.26:0/3155348284 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f954403f8a0 con 0x7f955012f8b0 2023-10-01T07:56:36.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.114+0000 7f95377fe700 1 -- 172.21.15.26:0/3155348284 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9544011350 con 0x7f955012f8b0 2023-10-01T07:56:36.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.154+0000 7fb522cea700 1 Processor -- start 2023-10-01T07:56:36.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.154+0000 7fb522cea700 1 -- start start 2023-10-01T07:56:36.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.155+0000 7fb522cea700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb51c09d6f0 0x7fb51c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:36.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.155+0000 7fb522cea700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb51c09e000 0x7fb51c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:36.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.155+0000 7fb522cea700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb51c09b120 con 0x7fb51c09e410 2023-10-01T07:56:36.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.155+0000 7fb522cea700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb51c06b460 con 0x7fb51c09d6f0 2023-10-01T07:56:36.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.155+0000 7fb522cea700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb51c09a7e0 con 0x7fb51c09e000 2023-10-01T07:56:36.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.155+0000 7fb51bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb51c09e000 0x7fb51c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:36.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.155+0000 7fb51bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb51c09e000 0x7fb51c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35238/0 (socket says 172.21.15.26:35238) 2023-10-01T07:56:36.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.155+0000 7fb520a86700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb51c09d6f0 0x7fb51c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:36.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.155+0000 7fb51bfff700 1 -- 172.21.15.26:0/1654975538 learned_addr learned my addr 172.21.15.26:0/1654975538 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:36.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.155+0000 7fb521287700 1 --1- 172.21.15.26:0/1654975538 >> v1:172.21.15.26:6789/0 conn(0x7fb51c09e410 0x7fb51c133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49968/0 (socket says 172.21.15.26:49968) 2023-10-01T07:56:36.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.155+0000 7fb51bfff700 1 -- 172.21.15.26:0/1654975538 >> v2:172.21.15.26:3300/0 conn(0x7fb51c09d6f0 msgr2=0x7fb51c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:36.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.155+0000 7fb51bfff700 1 --2- 172.21.15.26:0/1654975538 >> v2:172.21.15.26:3300/0 conn(0x7fb51c09d6f0 0x7fb51c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:36.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.155+0000 7fb51bfff700 1 -- 172.21.15.26:0/1654975538 >> v1:172.21.15.26:6789/0 conn(0x7fb51c09e410 legacy=0x7fb51c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:36.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.155+0000 7fb51bfff700 1 -- 172.21.15.26:0/1654975538 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb51c09a500 con 0x7fb51c09e000 2023-10-01T07:56:36.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.155+0000 7fb51b7fe700 1 -- 172.21.15.26:0/1654975538 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4114108094 0 0) 0x7fb51c09b120 con 0x7fb51c09e410 2023-10-01T07:56:36.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.156+0000 7fb51bfff700 1 --2- 172.21.15.26:0/1654975538 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb51c09e000 0x7fb51c1339f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb508009920 tx=0x7fb508009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffd0136b6c19781c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:36.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.156+0000 7fb51b7fe700 1 -- 172.21.15.26:0/1654975538 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb508011830 con 0x7fb51c09e000 2023-10-01T07:56:36.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.156+0000 7fb51b7fe700 1 -- 172.21.15.26:0/1654975538 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb508011990 con 0x7fb51c09e000 2023-10-01T07:56:36.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.156+0000 7fb51b7fe700 1 -- 172.21.15.26:0/1654975538 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb508011d20 con 0x7fb51c09e000 2023-10-01T07:56:36.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.156+0000 7fb522cea700 1 -- 172.21.15.26:0/1654975538 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb51c09e000 msgr2=0x7fb51c1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:36.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.156+0000 7fb522cea700 1 --2- 172.21.15.26:0/1654975538 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb51c09e000 0x7fb51c1339f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb508009920 tx=0x7fb508009c30 comp rx=0 tx=0).stop 2023-10-01T07:56:36.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.157+0000 7fb522cea700 1 -- 172.21.15.26:0/1654975538 shutdown_connections 2023-10-01T07:56:36.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.157+0000 7fb522cea700 1 --2- 172.21.15.26:0/1654975538 >> v2:172.21.15.26:3300/0 conn(0x7fb51c09d6f0 0x7fb51c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:36.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.157+0000 7fb522cea700 1 --2- 172.21.15.26:0/1654975538 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb51c09e000 0x7fb51c1339f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:36.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.157+0000 7fb522cea700 1 -- 172.21.15.26:0/1654975538 >> 172.21.15.26:0/1654975538 conn(0x7fb51c066f50 msgr2=0x7fb51c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:36.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.157+0000 7fb522cea700 1 -- 172.21.15.26:0/1654975538 shutdown_connections 2023-10-01T07:56:36.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.157+0000 7fb522cea700 1 -- 172.21.15.26:0/1654975538 wait complete. 2023-10-01T07:56:36.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.158+0000 7fb522cea700 1 Processor -- start 2023-10-01T07:56:36.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.158+0000 7fb522cea700 1 -- start start 2023-10-01T07:56:36.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.159+0000 7fb522cea700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb51c09d6f0 0x7fb51c1c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:36.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.159+0000 7fb522cea700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb51c09e000 0x7fb51c1c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:36.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.159+0000 7fb522cea700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb51c09e410 0x7fb51c1c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:36.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.159+0000 7fb522cea700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51c1a8350 con 0x7fb51c09e410 2023-10-01T07:56:36.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.159+0000 7fb522cea700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb51c1a65e0 con 0x7fb51c09d6f0 2023-10-01T07:56:36.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.159+0000 7fb522cea700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb51c1a63b0 con 0x7fb51c09e000 2023-10-01T07:56:36.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.159+0000 7fb520a86700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb51c09d6f0 0x7fb51c1c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:36.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.159+0000 7fb51bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb51c09e000 0x7fb51c1c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:36.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.159+0000 7fb520a86700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb51c09d6f0 0x7fb51c1c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44384/0 (socket says 172.21.15.26:44384) 2023-10-01T07:56:36.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.159+0000 7fb520a86700 1 -- 172.21.15.26:0/127421454 learned_addr learned my addr 172.21.15.26:0/127421454 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:36.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.159+0000 7fb521287700 1 --2- 172.21.15.26:0/127421454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb51c09e410 0x7fb51c1c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:36.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.159+0000 7fb51bfff700 1 -- 172.21.15.26:0/127421454 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb51c09d6f0 msgr2=0x7fb51c1c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:36.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.159+0000 7fb51bfff700 1 --2- 172.21.15.26:0/127421454 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb51c09d6f0 0x7fb51c1c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:36.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.159+0000 7fb51bfff700 1 -- 172.21.15.26:0/127421454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb51c09e410 msgr2=0x7fb51c1c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:36.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.159+0000 7fb51bfff700 1 --2- 172.21.15.26:0/127421454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb51c09e410 0x7fb51c1c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:36.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.159+0000 7fb51bfff700 1 -- 172.21.15.26:0/127421454 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb508009550 con 0x7fb51c09e000 2023-10-01T07:56:36.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.159+0000 7fb521287700 1 --2- 172.21.15.26:0/127421454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb51c09e410 0x7fb51c1c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:56:36.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.159+0000 7fb51bfff700 1 --2- 172.21.15.26:0/127421454 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb51c09e000 0x7fb51c1c8560 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb508016000 tx=0x7fb508004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:36.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.160+0000 7fb5197fa700 1 -- 172.21.15.26:0/127421454 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5080045d0 con 0x7fb51c09e000 2023-10-01T07:56:36.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.160+0000 7fb5197fa700 1 -- 172.21.15.26:0/127421454 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50801f070 con 0x7fb51c09e000 2023-10-01T07:56:36.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.160+0000 7fb5197fa700 1 -- 172.21.15.26:0/127421454 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5080038a0 con 0x7fb51c09e000 2023-10-01T07:56:36.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.160+0000 7fb522cea700 1 -- 172.21.15.26:0/127421454 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb51c0a2d00 con 0x7fb51c09e000 2023-10-01T07:56:36.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.160+0000 7fb522cea700 1 -- 172.21.15.26:0/127421454 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb51c1a7020 con 0x7fb51c09e000 2023-10-01T07:56:36.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.161+0000 7fb5197fa700 1 -- 172.21.15.26:0/127421454 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb508003a00 con 0x7fb51c09e000 2023-10-01T07:56:36.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.161+0000 7fb5197fa700 1 -- 172.21.15.26:0/127421454 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb508021070 con 0x7fb51c09e000 2023-10-01T07:56:36.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.161+0000 7fb522cea700 1 -- 172.21.15.26:0/127421454 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb51c1a7e20 con 0x7fb51c09e000 2023-10-01T07:56:36.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.166+0000 7fb5197fa700 1 -- 172.21.15.26:0/127421454 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb50802b080 con 0x7fb51c09e000 2023-10-01T07:56:36.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.284+0000 7f33586a7700 1 -- 172.21.15.26:0/2803515679 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f335011dcd0 con 0x7f3350137f20 2023-10-01T07:56:36.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.285+0000 7f3346ffd700 1 -- 172.21.15.26:0/2803515679 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f335011dcd0 con 0x7f3350137f20 2023-10-01T07:56:36.286 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:36.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.287+0000 7f33586a7700 1 -- 172.21.15.26:0/2803515679 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3350137f20 msgr2=0x7f335011a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:36.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.287+0000 7f33586a7700 1 --2- 172.21.15.26:0/2803515679 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3350137f20 0x7f335011a680 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f334000c450 tx=0x7f334000c760 comp rx=0 tx=0).stop 2023-10-01T07:56:36.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.287+0000 7f33586a7700 1 -- 172.21.15.26:0/2803515679 shutdown_connections 2023-10-01T07:56:36.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.287+0000 7f33586a7700 1 --2- 172.21.15.26:0/2803515679 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3350137f20 0x7f335011a680 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:36.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.287+0000 7f33586a7700 1 --2- 172.21.15.26:0/2803515679 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f335006c0e0 0x7f33501ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:36.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.287+0000 7f33586a7700 1 --2- 172.21.15.26:0/2803515679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3350134ec0 0x7f33501cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:36.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.287+0000 7f33586a7700 1 -- 172.21.15.26:0/2803515679 >> 172.21.15.26:0/2803515679 conn(0x7f33500a4210 msgr2=0x7f335006c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:36.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.287+0000 7f33586a7700 1 -- 172.21.15.26:0/2803515679 shutdown_connections 2023-10-01T07:56:36.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.287+0000 7f33586a7700 1 -- 172.21.15.26:0/2803515679 wait complete. 2023-10-01T07:56:36.302 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:36.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.323+0000 7f955546f700 1 -- 172.21.15.26:0/3155348284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f95500713a0 con 0x7f955012f8b0 2023-10-01T07:56:36.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.323+0000 7f95377fe700 1 -- 172.21.15.26:0/3155348284 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f954401bb60 con 0x7f955012f8b0 2023-10-01T07:56:36.324 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:36.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.325+0000 7f955546f700 1 -- 172.21.15.26:0/3155348284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f955012f8b0 msgr2=0x7f9550130f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:36.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.325+0000 7f955546f700 1 --2- 172.21.15.26:0/3155348284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f955012f8b0 0x7f9550130f20 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f9550129f70 tx=0x7f954400ec80 comp rx=0 tx=0).stop 2023-10-01T07:56:36.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.325+0000 7f955546f700 1 -- 172.21.15.26:0/3155348284 shutdown_connections 2023-10-01T07:56:36.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.325+0000 7f955546f700 1 --2- 172.21.15.26:0/3155348284 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9550130260 0x7f9550131460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:36.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.325+0000 7f955546f700 1 --2- 172.21.15.26:0/3155348284 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f955012cf60 0x7f95501309e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:36.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.325+0000 7f955546f700 1 --2- 172.21.15.26:0/3155348284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f955012f8b0 0x7f9550130f20 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:36.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.325+0000 7f955546f700 1 -- 172.21.15.26:0/3155348284 >> 172.21.15.26:0/3155348284 conn(0x7f95500a2aa0 msgr2=0x7f955012a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:36.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.326+0000 7f955546f700 1 -- 172.21.15.26:0/3155348284 shutdown_connections 2023-10-01T07:56:36.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.326+0000 7f955546f700 1 -- 172.21.15.26:0/3155348284 wait complete. 2023-10-01T07:56:36.340 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:36.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.372+0000 7fb522cea700 1 -- 172.21.15.26:0/127421454 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb51c1a8190 con 0x7fb51c09e000 2023-10-01T07:56:36.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.373+0000 7fb5197fa700 1 -- 172.21.15.26:0/127421454 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb51c1a8190 con 0x7fb51c09e000 2023-10-01T07:56:36.373 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:36.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.375+0000 7fb522cea700 1 -- 172.21.15.26:0/127421454 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb51c09e000 msgr2=0x7fb51c1c8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:36.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.375+0000 7fb522cea700 1 --2- 172.21.15.26:0/127421454 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb51c09e000 0x7fb51c1c8560 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb508016000 tx=0x7fb508004750 comp rx=0 tx=0).stop 2023-10-01T07:56:36.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.375+0000 7fb522cea700 1 -- 172.21.15.26:0/127421454 shutdown_connections 2023-10-01T07:56:36.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.375+0000 7fb522cea700 1 --2- 172.21.15.26:0/127421454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb51c09e410 0x7fb51c1c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:36.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.375+0000 7fb522cea700 1 --2- 172.21.15.26:0/127421454 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb51c09d6f0 0x7fb51c1c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:36.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.375+0000 7fb522cea700 1 --2- 172.21.15.26:0/127421454 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb51c09e000 0x7fb51c1c8560 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:36.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.375+0000 7fb522cea700 1 -- 172.21.15.26:0/127421454 >> 172.21.15.26:0/127421454 conn(0x7fb51c066f50 msgr2=0x7fb51c1bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:36.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.375+0000 7fb522cea700 1 -- 172.21.15.26:0/127421454 shutdown_connections 2023-10-01T07:56:36.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:36.375+0000 7fb522cea700 1 -- 172.21.15.26:0/127421454 wait complete. 2023-10-01T07:56:36.390 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:37.059 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:37.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.206+0000 7f9d04aac700 1 Processor -- start 2023-10-01T07:56:37.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.206+0000 7f9d04aac700 1 -- start start 2023-10-01T07:56:37.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.207+0000 7f9d04aac700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9d0012c2f0 0x7f9d0009d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:37.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.207+0000 7f9d04aac700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d0012d030 0x7f9d00130040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:37.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.207+0000 7f9d04aac700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d0009a510 con 0x7f9d0012cc20 2023-10-01T07:56:37.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.207+0000 7f9d04aac700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d0012c7d0 con 0x7f9d0012c2f0 2023-10-01T07:56:37.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.207+0000 7f9d04aac700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0009c190 con 0x7f9d0012d030 2023-10-01T07:56:37.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.207+0000 7f9cfe59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9d0012c2f0 0x7f9d0009d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:37.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.207+0000 7f9cfed9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d0012d030 0x7f9d00130040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:37.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.207+0000 7f9cfe59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9d0012c2f0 0x7f9d0009d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56804/0 (socket says 172.21.15.26:56804) 2023-10-01T07:56:37.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.207+0000 7f9cfe59c700 1 -- 172.21.15.26:0/4056543808 learned_addr learned my addr 172.21.15.26:0/4056543808 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:37.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.208+0000 7f9cfe59c700 1 -- 172.21.15.26:0/4056543808 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d0012d030 msgr2=0x7f9d00130040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:37.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.208+0000 7f9cfe59c700 1 --2- 172.21.15.26:0/4056543808 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d0012d030 0x7f9d00130040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:37.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.208+0000 7f9cfe59c700 1 -- 172.21.15.26:0/4056543808 >> v1:172.21.15.26:6789/0 conn(0x7f9d0012cc20 legacy=0x7f9d0012f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:37.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.208+0000 7f9cfe59c700 1 -- 172.21.15.26:0/4056543808 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0009b540 con 0x7f9d0012c2f0 2023-10-01T07:56:37.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.208+0000 7f9cfed9d700 1 --2- 172.21.15.26:0/4056543808 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d0012d030 0x7f9d00130040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:37.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.208+0000 7f9cfe59c700 1 --2- 172.21.15.26:0/4056543808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d0012c2f0 0x7f9d0009d6f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00098f0 tx=0x7f9cf0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=913878025fbe58ba server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:37.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.208+0000 7f9cfd59a700 1 -- 172.21.15.26:0/4056543808 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf0011830 con 0x7f9d0012c2f0 2023-10-01T07:56:37.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.208+0000 7f9cfd59a700 1 -- 172.21.15.26:0/4056543808 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf0011990 con 0x7f9d0012c2f0 2023-10-01T07:56:37.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.208+0000 7f9cfd59a700 1 -- 172.21.15.26:0/4056543808 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf0011d20 con 0x7f9d0012c2f0 2023-10-01T07:56:37.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.208+0000 7f9d04aac700 1 -- 172.21.15.26:0/4056543808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d0012c2f0 msgr2=0x7f9d0009d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:37.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.209+0000 7f9d04aac700 1 --2- 172.21.15.26:0/4056543808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d0012c2f0 0x7f9d0009d6f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00098f0 tx=0x7f9cf0009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:37.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.209+0000 7f9d04aac700 1 -- 172.21.15.26:0/4056543808 shutdown_connections 2023-10-01T07:56:37.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.209+0000 7f9d04aac700 1 --2- 172.21.15.26:0/4056543808 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d0012d030 0x7f9d00130040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:37.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.209+0000 7f9d04aac700 1 --2- 172.21.15.26:0/4056543808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d0012c2f0 0x7f9d0009d6f0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:37.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.209+0000 7f9d04aac700 1 -- 172.21.15.26:0/4056543808 >> 172.21.15.26:0/4056543808 conn(0x7f9d0009f470 msgr2=0x7f9d000a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:37.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.209+0000 7f9d04aac700 1 -- 172.21.15.26:0/4056543808 shutdown_connections 2023-10-01T07:56:37.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.209+0000 7f9d04aac700 1 -- 172.21.15.26:0/4056543808 wait complete. 2023-10-01T07:56:37.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.210+0000 7f9d04aac700 1 Processor -- start 2023-10-01T07:56:37.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.210+0000 7f9d04aac700 1 -- start start 2023-10-01T07:56:37.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.210+0000 7f9d04aac700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d0012c2f0 0x7f9d0012ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:37.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.210+0000 7f9d04aac700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d0012cc20 0x7f9d0012f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:37.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.210+0000 7f9d04aac700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d0012d030 0x7f9d0012f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:37.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.210+0000 7f9d04aac700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0006ff90 con 0x7f9d0012d030 2023-10-01T07:56:37.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.210+0000 7f9d04aac700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0006ed70 con 0x7f9d0012c2f0 2023-10-01T07:56:37.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.210+0000 7f9d04aac700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0006f030 con 0x7f9d0012cc20 2023-10-01T07:56:37.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.211+0000 7f9cfe59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d0012c2f0 0x7f9d0012ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:37.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.211+0000 7f9cfdd9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d0012cc20 0x7f9d0012f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:37.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.211+0000 7f9cfed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d0012d030 0x7f9d0012f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:37.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.211+0000 7f9cfe59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d0012c2f0 0x7f9d0012ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44398/0 (socket says 172.21.15.26:44398) 2023-10-01T07:56:37.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.211+0000 7f9cfed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d0012d030 0x7f9d0012f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56808/0 (socket says 172.21.15.26:56808) 2023-10-01T07:56:37.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.211+0000 7f9cfe59c700 1 -- 172.21.15.26:0/1520476790 learned_addr learned my addr 172.21.15.26:0/1520476790 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:37.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.211+0000 7f9cfdd9b700 1 --2- 172.21.15.26:0/1520476790 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d0012cc20 0x7f9d0012f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35260/0 (socket says 172.21.15.26:35260) 2023-10-01T07:56:37.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.211+0000 7f9cfdd9b700 1 -- 172.21.15.26:0/1520476790 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d0012c2f0 msgr2=0x7f9d0012ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:37.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.211+0000 7f9cfdd9b700 1 --2- 172.21.15.26:0/1520476790 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d0012c2f0 0x7f9d0012ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:37.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.211+0000 7f9cfdd9b700 1 -- 172.21.15.26:0/1520476790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d0012d030 msgr2=0x7f9d0012f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:37.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.211+0000 7f9cfdd9b700 1 --2- 172.21.15.26:0/1520476790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d0012d030 0x7f9d0012f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:37.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.211+0000 7f9cfdd9b700 1 -- 172.21.15.26:0/1520476790 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf8009a70 con 0x7f9d0012cc20 2023-10-01T07:56:37.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.211+0000 7f9cfe59c700 1 --2- 172.21.15.26:0/1520476790 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d0012c2f0 0x7f9d0012ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:37.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.211+0000 7f9cfdd9b700 1 --2- 172.21.15.26:0/1520476790 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d0012cc20 0x7f9d0012f200 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4000f60 tx=0x7f9cf400c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:37.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.211+0000 7f9ceeffd700 1 -- 172.21.15.26:0/1520476790 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf40052d0 con 0x7f9d0012cc20 2023-10-01T07:56:37.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.211+0000 7f9ceeffd700 1 -- 172.21.15.26:0/1520476790 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf4005430 con 0x7f9d0012cc20 2023-10-01T07:56:37.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.211+0000 7f9d04aac700 1 -- 172.21.15.26:0/1520476790 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf0009550 con 0x7f9d0012cc20 2023-10-01T07:56:37.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.211+0000 7f9ceeffd700 1 -- 172.21.15.26:0/1520476790 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf40038c0 con 0x7f9d0012cc20 2023-10-01T07:56:37.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.211+0000 7f9d04aac700 1 -- 172.21.15.26:0/1520476790 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d0006faa0 con 0x7f9d0012cc20 2023-10-01T07:56:37.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.212+0000 7f9ceeffd700 1 -- 172.21.15.26:0/1520476790 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9cf4003a20 con 0x7f9d0012cc20 2023-10-01T07:56:37.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.212+0000 7f9ceeffd700 1 -- 172.21.15.26:0/1520476790 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9cf403e9b0 con 0x7f9d0012cc20 2023-10-01T07:56:37.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.212+0000 7f9d04aac700 1 -- 172.21.15.26:0/1520476790 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d000747f0 con 0x7f9d0012cc20 2023-10-01T07:56:37.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.217+0000 7f9ceeffd700 1 -- 172.21.15.26:0/1520476790 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9cf4017070 con 0x7f9d0012cc20 2023-10-01T07:56:37.302 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:37.342 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:37.391 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:37.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.425+0000 7f9d04aac700 1 -- 172.21.15.26:0/1520476790 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9d0006f1a0 con 0x7f9d0012cc20 2023-10-01T07:56:37.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.426+0000 7f9ceeffd700 1 -- 172.21.15.26:0/1520476790 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9cf4011590 con 0x7f9d0012cc20 2023-10-01T07:56:37.427 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:37.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.430+0000 7f9d04aac700 1 -- 172.21.15.26:0/1520476790 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d0012cc20 msgr2=0x7f9d0012f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:37.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.430+0000 7f9d04aac700 1 --2- 172.21.15.26:0/1520476790 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d0012cc20 0x7f9d0012f200 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4000f60 tx=0x7f9cf400c730 comp rx=0 tx=0).stop 2023-10-01T07:56:37.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.430+0000 7f9d04aac700 1 -- 172.21.15.26:0/1520476790 shutdown_connections 2023-10-01T07:56:37.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.430+0000 7f9d04aac700 1 --2- 172.21.15.26:0/1520476790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d0012d030 0x7f9d0012f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:37.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.430+0000 7f9d04aac700 1 --2- 172.21.15.26:0/1520476790 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d0012c2f0 0x7f9d0012ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:37.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.430+0000 7f9d04aac700 1 --2- 172.21.15.26:0/1520476790 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d0012cc20 0x7f9d0012f200 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:37.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.430+0000 7f9d04aac700 1 -- 172.21.15.26:0/1520476790 >> 172.21.15.26:0/1520476790 conn(0x7f9d0009f470 msgr2=0x7f9d001b6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:37.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.430+0000 7f9d04aac700 1 -- 172.21.15.26:0/1520476790 shutdown_connections 2023-10-01T07:56:37.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.430+0000 7f9d04aac700 1 -- 172.21.15.26:0/1520476790 wait complete. 2023-10-01T07:56:37.447 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:37.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.454+0000 7f1393af8700 1 Processor -- start 2023-10-01T07:56:37.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.455+0000 7f1393af8700 1 -- start start 2023-10-01T07:56:37.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.455+0000 7f1393af8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f138c130540 0x7f138c130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:37.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.455+0000 7f1393af8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f138c130e50 0x7f138c06f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:37.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.455+0000 7f1393af8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f138c0716a0 con 0x7f138c06fb20 2023-10-01T07:56:37.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.455+0000 7f1393af8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138c09a390 con 0x7f138c130e50 2023-10-01T07:56:37.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.455+0000 7f1393af8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138c071290 con 0x7f138c130540 2023-10-01T07:56:37.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.456+0000 7f1391894700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f138c130540 0x7f138c130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:37.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.456+0000 7f1391093700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f138c130e50 0x7f138c06f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:37.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.456+0000 7f1391093700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f138c130e50 0x7f138c06f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56818/0 (socket says 172.21.15.26:56818) 2023-10-01T07:56:37.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.456+0000 7f1391093700 1 -- 172.21.15.26:0/3583170541 learned_addr learned my addr 172.21.15.26:0/3583170541 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:37.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.456+0000 7f1391894700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f138c130540 0x7f138c130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44410/0 (socket says 172.21.15.26:44410) 2023-10-01T07:56:37.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.456+0000 7f1392095700 1 --1- 172.21.15.26:0/3583170541 >> v1:172.21.15.26:6789/0 conn(0x7f138c06fb20 0x7f138c137560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49976/0 (socket says 172.21.15.26:49976) 2023-10-01T07:56:37.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.456+0000 7f1391093700 1 -- 172.21.15.26:0/3583170541 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f138c130540 msgr2=0x7f138c130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:37.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.456+0000 7f1391093700 1 --2- 172.21.15.26:0/3583170541 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f138c130540 0x7f138c130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:37.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.456+0000 7f1391093700 1 -- 172.21.15.26:0/3583170541 >> v1:172.21.15.26:6789/0 conn(0x7f138c06fb20 legacy=0x7f138c137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:37.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.456+0000 7f1391093700 1 -- 172.21.15.26:0/3583170541 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f138c130340 con 0x7f138c130e50 2023-10-01T07:56:37.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.456+0000 7f1391894700 1 --2- 172.21.15.26:0/3583170541 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f138c130540 0x7f138c130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:37.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.456+0000 7f1391093700 1 --2- 172.21.15.26:0/3583170541 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f138c130e50 0x7f138c06f5e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f137c0098f0 tx=0x7f137c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f78d7c48f58a04b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:37.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.456+0000 7f1390892700 1 -- 172.21.15.26:0/3583170541 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137c011830 con 0x7f138c130e50 2023-10-01T07:56:37.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.456+0000 7f1390892700 1 -- 172.21.15.26:0/3583170541 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137c011990 con 0x7f138c130e50 2023-10-01T07:56:37.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.456+0000 7f1390892700 1 -- 172.21.15.26:0/3583170541 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137c011d20 con 0x7f138c130e50 2023-10-01T07:56:37.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.457+0000 7f1393af8700 1 -- 172.21.15.26:0/3583170541 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f138c130e50 msgr2=0x7f138c06f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:37.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.457+0000 7f1393af8700 1 --2- 172.21.15.26:0/3583170541 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f138c130e50 0x7f138c06f5e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f137c0098f0 tx=0x7f137c009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:37.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.457+0000 7f1393af8700 1 -- 172.21.15.26:0/3583170541 shutdown_connections 2023-10-01T07:56:37.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.457+0000 7f1393af8700 1 --2- 172.21.15.26:0/3583170541 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f138c130540 0x7f138c130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:37.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.457+0000 7f1393af8700 1 --2- 172.21.15.26:0/3583170541 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f138c130e50 0x7f138c06f5e0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:37.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.457+0000 7f1393af8700 1 -- 172.21.15.26:0/3583170541 >> 172.21.15.26:0/3583170541 conn(0x7f138c0a2aa0 msgr2=0x7f138c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:37.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.457+0000 7f1393af8700 1 -- 172.21.15.26:0/3583170541 shutdown_connections 2023-10-01T07:56:37.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.457+0000 7f1393af8700 1 -- 172.21.15.26:0/3583170541 wait complete. 2023-10-01T07:56:37.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.458+0000 7f1393af8700 1 Processor -- start 2023-10-01T07:56:37.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.458+0000 7f1393af8700 1 -- start start 2023-10-01T07:56:37.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.459+0000 7f1393af8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f138c06fb20 0x7f138c119700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:37.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.459+0000 7f1393af8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f138c130540 0x7f138c119c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:37.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.459+0000 7f1393af8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f138c130e50 0x7f138c11a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:37.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.459+0000 7f1393af8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138c11b370 con 0x7f138c130e50 2023-10-01T07:56:37.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.459+0000 7f1393af8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138c0718e0 con 0x7f138c130540 2023-10-01T07:56:37.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.459+0000 7f1393af8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f138c11c4b0 con 0x7f138c06fb20 2023-10-01T07:56:37.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.459+0000 7f1391093700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f138c130540 0x7f138c119c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:37.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.459+0000 7f1391093700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f138c130540 0x7f138c119c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44416/0 (socket says 172.21.15.26:44416) 2023-10-01T07:56:37.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.459+0000 7f1391093700 1 -- 172.21.15.26:0/609334711 learned_addr learned my addr 172.21.15.26:0/609334711 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:37.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.459+0000 7f1391894700 1 --2- 172.21.15.26:0/609334711 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f138c06fb20 0x7f138c119700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:37.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.459+0000 7f1392095700 1 --2- 172.21.15.26:0/609334711 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f138c130e50 0x7f138c11a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:37.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.459+0000 7f1391093700 1 -- 172.21.15.26:0/609334711 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f138c06fb20 msgr2=0x7f138c119700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:37.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.459+0000 7f1391093700 1 --2- 172.21.15.26:0/609334711 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f138c06fb20 0x7f138c119700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:37.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.460+0000 7f1391093700 1 -- 172.21.15.26:0/609334711 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f138c130e50 msgr2=0x7f138c11a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:37.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.460+0000 7f1391093700 1 --2- 172.21.15.26:0/609334711 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f138c130e50 0x7f138c11a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:37.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.460+0000 7f1391093700 1 -- 172.21.15.26:0/609334711 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13880094a0 con 0x7f138c130540 2023-10-01T07:56:37.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.460+0000 7f1392095700 1 --2- 172.21.15.26:0/609334711 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f138c130e50 0x7f138c11a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:56:37.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.460+0000 7f1391093700 1 --2- 172.21.15.26:0/609334711 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f138c130540 0x7f138c119c40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f137c013000 tx=0x7f137c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:37.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.460+0000 7f13827fc700 1 -- 172.21.15.26:0/609334711 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137c004510 con 0x7f138c130540 2023-10-01T07:56:37.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.460+0000 7f13827fc700 1 -- 172.21.15.26:0/609334711 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137c0036a0 con 0x7f138c130540 2023-10-01T07:56:37.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.460+0000 7f13827fc700 1 -- 172.21.15.26:0/609334711 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137c003a30 con 0x7f138c130540 2023-10-01T07:56:37.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.460+0000 7f1393af8700 1 -- 172.21.15.26:0/609334711 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f137c009550 con 0x7f138c130540 2023-10-01T07:56:37.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.460+0000 7f1393af8700 1 -- 172.21.15.26:0/609334711 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f138c11d890 con 0x7f138c130540 2023-10-01T07:56:37.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.461+0000 7f13827fc700 1 -- 172.21.15.26:0/609334711 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f137c003b90 con 0x7f138c130540 2023-10-01T07:56:37.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.461+0000 7f13827fc700 1 -- 172.21.15.26:0/609334711 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f137c040ab0 con 0x7f138c130540 2023-10-01T07:56:37.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.461+0000 7f1393af8700 1 -- 172.21.15.26:0/609334711 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f138c09bd30 con 0x7f138c130540 2023-10-01T07:56:37.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.466+0000 7f13827fc700 1 -- 172.21.15.26:0/609334711 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f137c015020 con 0x7f138c130540 2023-10-01T07:56:37.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.494+0000 7fb0f8038700 1 Processor -- start 2023-10-01T07:56:37.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.495+0000 7fb0f8038700 1 -- start start 2023-10-01T07:56:37.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.495+0000 7fb0f8038700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb0f01338a0 0x7fb0f0133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:37.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.495+0000 7fb0f8038700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb0f009e930 0x7fb0f013b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:37.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.495+0000 7fb0f8038700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0f006ef30 con 0x7fb0f009de50 2023-10-01T07:56:37.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.495+0000 7fb0f8038700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f006fef0 con 0x7fb0f009e930 2023-10-01T07:56:37.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.495+0000 7fb0f8038700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f01334b0 con 0x7fb0f01338a0 2023-10-01T07:56:37.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.495+0000 7fb0f5dd4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb0f01338a0 0x7fb0f0133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:37.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.495+0000 7fb0f65d5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb0f009e930 0x7fb0f013b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:37.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.495+0000 7fb0f65d5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb0f009e930 0x7fb0f013b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56840/0 (socket says 172.21.15.26:56840) 2023-10-01T07:56:37.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.495+0000 7fb0f5dd4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb0f01338a0 0x7fb0f0133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35282/0 (socket says 172.21.15.26:35282) 2023-10-01T07:56:37.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.495+0000 7fb0f65d5700 1 -- 172.21.15.26:0/3824898942 learned_addr learned my addr 172.21.15.26:0/3824898942 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:37.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.496+0000 7fb0f5dd4700 1 -- 172.21.15.26:0/3824898942 >> v2:172.21.15.26:3300/0 conn(0x7fb0f009e930 msgr2=0x7fb0f013b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:37.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.496+0000 7fb0f5dd4700 1 --2- 172.21.15.26:0/3824898942 >> v2:172.21.15.26:3300/0 conn(0x7fb0f009e930 0x7fb0f013b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:37.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.496+0000 7fb0f5dd4700 1 -- 172.21.15.26:0/3824898942 >> v1:172.21.15.26:6789/0 conn(0x7fb0f009de50 legacy=0x7fb0f009e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:37.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.496+0000 7fb0f5dd4700 1 -- 172.21.15.26:0/3824898942 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f006fc30 con 0x7fb0f01338a0 2023-10-01T07:56:37.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.496+0000 7fb0f65d5700 1 --2- 172.21.15.26:0/3824898942 >> v2:172.21.15.26:3300/0 conn(0x7fb0f009e930 0x7fb0f013b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:37.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.496+0000 7fb0f5dd4700 1 --2- 172.21.15.26:0/3824898942 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb0f01338a0 0x7fb0f0133c70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec009840 tx=0x7fb0ec009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5198b4eebabbf462 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:37.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.496+0000 7fb0f4dd2700 1 -- 172.21.15.26:0/3824898942 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec011830 con 0x7fb0f01338a0 2023-10-01T07:56:37.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.496+0000 7fb0f4dd2700 1 -- 172.21.15.26:0/3824898942 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0ec011990 con 0x7fb0f01338a0 2023-10-01T07:56:37.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.496+0000 7fb0f4dd2700 1 -- 172.21.15.26:0/3824898942 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec011d20 con 0x7fb0f01338a0 2023-10-01T07:56:37.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.497+0000 7fb0f8038700 1 -- 172.21.15.26:0/3824898942 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb0f01338a0 msgr2=0x7fb0f0133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:37.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.497+0000 7fb0f8038700 1 --2- 172.21.15.26:0/3824898942 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb0f01338a0 0x7fb0f0133c70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec009840 tx=0x7fb0ec009b50 comp rx=0 tx=0).stop 2023-10-01T07:56:37.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.497+0000 7fb0f8038700 1 -- 172.21.15.26:0/3824898942 shutdown_connections 2023-10-01T07:56:37.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.497+0000 7fb0f8038700 1 --2- 172.21.15.26:0/3824898942 >> v2:172.21.15.26:3300/0 conn(0x7fb0f009e930 0x7fb0f013b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:37.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.497+0000 7fb0f8038700 1 --2- 172.21.15.26:0/3824898942 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb0f01338a0 0x7fb0f0133c70 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:37.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.497+0000 7fb0f8038700 1 -- 172.21.15.26:0/3824898942 >> 172.21.15.26:0/3824898942 conn(0x7fb0f00a2aa0 msgr2=0x7fb0f00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:37.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.497+0000 7fb0f8038700 1 -- 172.21.15.26:0/3824898942 shutdown_connections 2023-10-01T07:56:37.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.497+0000 7fb0f8038700 1 -- 172.21.15.26:0/3824898942 wait complete. 2023-10-01T07:56:37.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.498+0000 7fb0f8038700 1 Processor -- start 2023-10-01T07:56:37.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.498+0000 7fb0f8038700 1 -- start start 2023-10-01T07:56:37.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.499+0000 7fb0f8038700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0f009de50 0x7fb0f011d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:37.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.499+0000 7fb0f8038700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb0f009e930 0x7fb0f011dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:37.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.499+0000 7fb0f8038700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb0f01338a0 0x7fb0f011e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:37.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.499+0000 7fb0f8038700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f011f350 con 0x7fb0f009de50 2023-10-01T07:56:37.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.499+0000 7fb0f8038700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f006f640 con 0x7fb0f009e930 2023-10-01T07:56:37.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.499+0000 7fb0f8038700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f0120f80 con 0x7fb0f01338a0 2023-10-01T07:56:37.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.499+0000 7fb0f5dd4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0f009de50 0x7fb0f011d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:37.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.499+0000 7fb0f65d5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb0f01338a0 0x7fb0f011e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:37.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.499+0000 7fb0f5dd4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0f009de50 0x7fb0f011d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56848/0 (socket says 172.21.15.26:56848) 2023-10-01T07:56:37.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.499+0000 7fb0f5dd4700 1 -- 172.21.15.26:0/261334082 learned_addr learned my addr 172.21.15.26:0/261334082 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:37.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.499+0000 7fb0f55d3700 1 --2- 172.21.15.26:0/261334082 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb0f009e930 0x7fb0f011dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:37.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.499+0000 7fb0f65d5700 1 -- 172.21.15.26:0/261334082 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb0f009e930 msgr2=0x7fb0f011dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:37.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.499+0000 7fb0f65d5700 1 --2- 172.21.15.26:0/261334082 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb0f009e930 0x7fb0f011dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:37.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.499+0000 7fb0f65d5700 1 -- 172.21.15.26:0/261334082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0f009de50 msgr2=0x7fb0f011d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:37.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.499+0000 7fb0f65d5700 1 --2- 172.21.15.26:0/261334082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0f009de50 0x7fb0f011d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:37.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.499+0000 7fb0f65d5700 1 -- 172.21.15.26:0/261334082 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e8009b30 con 0x7fb0f01338a0 2023-10-01T07:56:37.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.499+0000 7fb0f5dd4700 1 --2- 172.21.15.26:0/261334082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0f009de50 0x7fb0f011d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:37.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.499+0000 7fb0f65d5700 1 --2- 172.21.15.26:0/261334082 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb0f01338a0 0x7fb0f011e2a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb0e800efc0 tx=0x7fb0e800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:37.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.500+0000 7fb0e67fc700 1 -- 172.21.15.26:0/261334082 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e8018070 con 0x7fb0f01338a0 2023-10-01T07:56:37.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.500+0000 7fb0e67fc700 1 -- 172.21.15.26:0/261334082 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e800f040 con 0x7fb0f01338a0 2023-10-01T07:56:37.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.500+0000 7fb0e67fc700 1 -- 172.21.15.26:0/261334082 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e8003c60 con 0x7fb0f01338a0 2023-10-01T07:56:37.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.500+0000 7fb0f8038700 1 -- 172.21.15.26:0/261334082 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0ec0094a0 con 0x7fb0f01338a0 2023-10-01T07:56:37.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.500+0000 7fb0f8038700 1 -- 172.21.15.26:0/261334082 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f01205a0 con 0x7fb0f01338a0 2023-10-01T07:56:37.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.501+0000 7fb0e67fc700 1 -- 172.21.15.26:0/261334082 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb0e800c930 con 0x7fb0f01338a0 2023-10-01T07:56:37.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.501+0000 7fb0e67fc700 1 -- 172.21.15.26:0/261334082 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb0e803f820 con 0x7fb0f01338a0 2023-10-01T07:56:37.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.501+0000 7fb0f8038700 1 -- 172.21.15.26:0/261334082 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f011a470 con 0x7fb0f01338a0 2023-10-01T07:56:37.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.510+0000 7fb0e67fc700 1 -- 172.21.15.26:0/261334082 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb0e8003dc0 con 0x7fb0f01338a0 2023-10-01T07:56:37.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.545+0000 7f3fadb99700 1 Processor -- start 2023-10-01T07:56:37.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.545+0000 7f3fadb99700 1 -- start start 2023-10-01T07:56:37.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.545+0000 7f3fadb99700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fa809e1d0 0x7f3fa8135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:37.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.545+0000 7f3fadb99700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3fa8135e50 0x7f3fa8138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:37.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.545+0000 7f3fadb99700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fa809f130 con 0x7f3fa809d6f0 2023-10-01T07:56:37.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.545+0000 7f3fadb99700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa809f520 con 0x7f3fa8135e50 2023-10-01T07:56:37.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.545+0000 7f3fadb99700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa809e930 con 0x7f3fa809e1d0 2023-10-01T07:56:37.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.546+0000 7f3fa6ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fa809e1d0 0x7f3fa8135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:37.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.546+0000 7f3fa7fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3fa8135e50 0x7f3fa8138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:37.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.546+0000 7f3fa6ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fa809e1d0 0x7f3fa8135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44438/0 (socket says 172.21.15.26:44438) 2023-10-01T07:56:37.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.546+0000 7f3fa6ffd700 1 -- 172.21.15.26:0/996349505 learned_addr learned my addr 172.21.15.26:0/996349505 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.546+0000 7f3fa6ffd700 1 -- 172.21.15.26:0/996349505 >> v2:172.21.15.26:3300/0 conn(0x7f3fa8135e50 msgr2=0x7f3fa8138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.546+0000 7f3fa6ffd700 1 --2- 172.21.15.26:0/996349505 >> v2:172.21.15.26:3300/0 conn(0x7f3fa8135e50 0x7f3fa8138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.546+0000 7f3fa6ffd700 1 -- 172.21.15.26:0/996349505 >> v1:172.21.15.26:6789/0 conn(0x7f3fa809d6f0 legacy=0x7f3fa809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.546+0000 7f3fa6ffd700 1 -- 172.21.15.26:0/996349505 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa809b2d0 con 0x7f3fa809e1d0 2023-10-01T07:56:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.546+0000 7f3fa6ffd700 1 --2- 172.21.15.26:0/996349505 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fa809e1d0 0x7f3fa8135910 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c009920 tx=0x7f3f9c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e783198b81fb846f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.546+0000 7f3fa67fc700 1 -- 172.21.15.26:0/996349505 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c011830 con 0x7f3fa809e1d0 2023-10-01T07:56:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.547+0000 7f3fa67fc700 1 -- 172.21.15.26:0/996349505 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9c011990 con 0x7f3fa809e1d0 2023-10-01T07:56:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.547+0000 7f3fa67fc700 1 -- 172.21.15.26:0/996349505 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c011d20 con 0x7f3fa809e1d0 2023-10-01T07:56:37.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.547+0000 7f3fadb99700 1 -- 172.21.15.26:0/996349505 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fa809e1d0 msgr2=0x7f3fa8135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:37.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.547+0000 7f3fadb99700 1 --2- 172.21.15.26:0/996349505 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fa809e1d0 0x7f3fa8135910 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c009920 tx=0x7f3f9c009c30 comp rx=0 tx=0).stop 2023-10-01T07:56:37.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.547+0000 7f3fadb99700 1 -- 172.21.15.26:0/996349505 shutdown_connections 2023-10-01T07:56:37.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.547+0000 7f3fadb99700 1 --2- 172.21.15.26:0/996349505 >> v2:172.21.15.26:3300/0 conn(0x7f3fa8135e50 0x7f3fa8138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:37.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.547+0000 7f3fadb99700 1 --2- 172.21.15.26:0/996349505 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fa809e1d0 0x7f3fa8135910 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:37.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.547+0000 7f3fadb99700 1 -- 172.21.15.26:0/996349505 >> 172.21.15.26:0/996349505 conn(0x7f3fa8066f50 msgr2=0x7f3fa809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:37.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.547+0000 7f3fadb99700 1 -- 172.21.15.26:0/996349505 shutdown_connections 2023-10-01T07:56:37.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.547+0000 7f3fadb99700 1 -- 172.21.15.26:0/996349505 wait complete. 2023-10-01T07:56:37.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.548+0000 7f3fadb99700 1 Processor -- start 2023-10-01T07:56:37.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.549+0000 7f3fadb99700 1 -- start start 2023-10-01T07:56:37.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.549+0000 7f3fadb99700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3fa809d6f0 0x7f3fa8134db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:37.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.549+0000 7f3fadb99700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fa809e1d0 0x7f3fa81352f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:37.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.549+0000 7f3fadb99700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fa8135e50 0x7f3fa8135830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:37.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.549+0000 7f3fadb99700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa8132890 con 0x7f3fa8135e50 2023-10-01T07:56:37.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.549+0000 7f3fadb99700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa8133f60 con 0x7f3fa809e1d0 2023-10-01T07:56:37.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.549+0000 7f3fadb99700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa81341d0 con 0x7f3fa809d6f0 2023-10-01T07:56:37.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.549+0000 7f3fa77fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3fa809d6f0 0x7f3fa8134db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:37.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.549+0000 7f3fa7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fa8135e50 0x7f3fa8135830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:37.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.549+0000 7f3fa7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fa8135e50 0x7f3fa8135830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56868/0 (socket says 172.21.15.26:56868) 2023-10-01T07:56:37.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.549+0000 7f3fa7fff700 1 -- 172.21.15.26:0/1978944165 learned_addr learned my addr 172.21.15.26:0/1978944165 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:37.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.549+0000 7f3fa77fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3fa809d6f0 0x7f3fa8134db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35300/0 (socket says 172.21.15.26:35300) 2023-10-01T07:56:37.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.549+0000 7f3fa6ffd700 1 --2- 172.21.15.26:0/1978944165 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fa809e1d0 0x7f3fa81352f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:37.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.550+0000 7f3fa6ffd700 1 -- 172.21.15.26:0/1978944165 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3fa809d6f0 msgr2=0x7f3fa8134db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:37.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.550+0000 7f3fa6ffd700 1 --2- 172.21.15.26:0/1978944165 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3fa809d6f0 0x7f3fa8134db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:37.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.550+0000 7f3fa6ffd700 1 -- 172.21.15.26:0/1978944165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fa8135e50 msgr2=0x7f3fa8135830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:37.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.550+0000 7f3fa6ffd700 1 --2- 172.21.15.26:0/1978944165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fa8135e50 0x7f3fa8135830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:37.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.550+0000 7f3fa6ffd700 1 -- 172.21.15.26:0/1978944165 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9c009550 con 0x7f3fa809e1d0 2023-10-01T07:56:37.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.550+0000 7f3fa77fe700 1 --2- 172.21.15.26:0/1978944165 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3fa809d6f0 0x7f3fa8134db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:37.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.550+0000 7f3fa7fff700 1 --2- 172.21.15.26:0/1978944165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fa8135e50 0x7f3fa8135830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:37.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.550+0000 7f3fa6ffd700 1 --2- 172.21.15.26:0/1978944165 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fa809e1d0 0x7f3fa81352f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c009920 tx=0x7f3f9c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:37.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.550+0000 7f3f8ffff700 1 -- 172.21.15.26:0/1978944165 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c004300 con 0x7f3fa809e1d0 2023-10-01T07:56:37.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.550+0000 7f3f8ffff700 1 -- 172.21.15.26:0/1978944165 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9c01f070 con 0x7f3fa809e1d0 2023-10-01T07:56:37.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.550+0000 7f3fadb99700 1 -- 172.21.15.26:0/1978944165 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa8133510 con 0x7f3fa809e1d0 2023-10-01T07:56:37.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.550+0000 7f3f8ffff700 1 -- 172.21.15.26:0/1978944165 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c0036a0 con 0x7f3fa809e1d0 2023-10-01T07:56:37.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.550+0000 7f3fadb99700 1 -- 172.21.15.26:0/1978944165 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa809c700 con 0x7f3fa809e1d0 2023-10-01T07:56:37.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.551+0000 7f3f8ffff700 1 -- 172.21.15.26:0/1978944165 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f9c021030 con 0x7f3fa809e1d0 2023-10-01T07:56:37.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.551+0000 7f3f8ffff700 1 -- 172.21.15.26:0/1978944165 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3f9c040900 con 0x7f3fa809e1d0 2023-10-01T07:56:37.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.551+0000 7f3fadb99700 1 -- 172.21.15.26:0/1978944165 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa8074ea0 con 0x7f3fa809e1d0 2023-10-01T07:56:37.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.556+0000 7f3f8ffff700 1 -- 172.21.15.26:0/1978944165 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f9c015070 con 0x7f3fa809e1d0 2023-10-01T07:56:37.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.677+0000 7f1393af8700 1 -- 172.21.15.26:0/609334711 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f138c074ea0 con 0x7f138c130540 2023-10-01T07:56:37.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.677+0000 7f13827fc700 1 -- 172.21.15.26:0/609334711 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f137c003e40 con 0x7f138c130540 2023-10-01T07:56:37.678 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:37.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.681+0000 7f1393af8700 1 -- 172.21.15.26:0/609334711 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f138c130540 msgr2=0x7f138c119c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:37.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.681+0000 7f1393af8700 1 --2- 172.21.15.26:0/609334711 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f138c130540 0x7f138c119c40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f137c013000 tx=0x7f137c004750 comp rx=0 tx=0).stop 2023-10-01T07:56:37.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.681+0000 7f1393af8700 1 -- 172.21.15.26:0/609334711 shutdown_connections 2023-10-01T07:56:37.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.681+0000 7f1393af8700 1 --2- 172.21.15.26:0/609334711 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f138c130e50 0x7f138c11a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:37.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.681+0000 7f1393af8700 1 --2- 172.21.15.26:0/609334711 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f138c06fb20 0x7f138c119700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:37.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.681+0000 7f1393af8700 1 --2- 172.21.15.26:0/609334711 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f138c130540 0x7f138c119c40 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:37.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.681+0000 7f1393af8700 1 -- 172.21.15.26:0/609334711 >> 172.21.15.26:0/609334711 conn(0x7f138c0a2aa0 msgr2=0x7f138c12d700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:37.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.681+0000 7f1393af8700 1 -- 172.21.15.26:0/609334711 shutdown_connections 2023-10-01T07:56:37.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.681+0000 7f1393af8700 1 -- 172.21.15.26:0/609334711 wait complete. 2023-10-01T07:56:37.695 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:37.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.719+0000 7fb0f8038700 1 -- 172.21.15.26:0/261334082 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb0f0074ea0 con 0x7fb0f01338a0 2023-10-01T07:56:37.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.719+0000 7fb0e67fc700 1 -- 172.21.15.26:0/261334082 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb0e801cbb0 con 0x7fb0f01338a0 2023-10-01T07:56:37.720 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:37.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.721+0000 7fb0f8038700 1 -- 172.21.15.26:0/261334082 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb0f01338a0 msgr2=0x7fb0f011e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:37.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.721+0000 7fb0f8038700 1 --2- 172.21.15.26:0/261334082 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb0f01338a0 0x7fb0f011e2a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb0e800efc0 tx=0x7fb0e800c3a0 comp rx=0 tx=0).stop 2023-10-01T07:56:37.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.721+0000 7fb0f8038700 1 -- 172.21.15.26:0/261334082 shutdown_connections 2023-10-01T07:56:37.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.721+0000 7fb0f8038700 1 --2- 172.21.15.26:0/261334082 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb0f01338a0 0x7fb0f011e2a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:37.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.721+0000 7fb0f8038700 1 --2- 172.21.15.26:0/261334082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0f009de50 0x7fb0f011d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:37.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.721+0000 7fb0f8038700 1 --2- 172.21.15.26:0/261334082 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb0f009e930 0x7fb0f011dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:37.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.721+0000 7fb0f8038700 1 -- 172.21.15.26:0/261334082 >> 172.21.15.26:0/261334082 conn(0x7fb0f00a2aa0 msgr2=0x7fb0f01badd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:37.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.722+0000 7fb0f8038700 1 -- 172.21.15.26:0/261334082 shutdown_connections 2023-10-01T07:56:37.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.722+0000 7fb0f8038700 1 -- 172.21.15.26:0/261334082 wait complete. 2023-10-01T07:56:37.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:37.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.765+0000 7f3fadb99700 1 -- 172.21.15.26:0/1978944165 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3fa806c360 con 0x7f3fa809e1d0 2023-10-01T07:56:37.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.765+0000 7f3f8ffff700 1 -- 172.21.15.26:0/1978944165 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f9c019770 con 0x7f3fa809e1d0 2023-10-01T07:56:37.766 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:37.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.768+0000 7f3fadb99700 1 -- 172.21.15.26:0/1978944165 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fa809e1d0 msgr2=0x7f3fa81352f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:37.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.768+0000 7f3fadb99700 1 --2- 172.21.15.26:0/1978944165 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fa809e1d0 0x7f3fa81352f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c009920 tx=0x7f3f9c004750 comp rx=0 tx=0).stop 2023-10-01T07:56:37.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.768+0000 7f3fadb99700 1 -- 172.21.15.26:0/1978944165 shutdown_connections 2023-10-01T07:56:37.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.768+0000 7f3fadb99700 1 --2- 172.21.15.26:0/1978944165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fa8135e50 0x7f3fa8135830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:37.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.768+0000 7f3fadb99700 1 --2- 172.21.15.26:0/1978944165 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3fa809d6f0 0x7f3fa8134db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:37.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.768+0000 7f3fadb99700 1 --2- 172.21.15.26:0/1978944165 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fa809e1d0 0x7f3fa81352f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:37.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.768+0000 7f3fadb99700 1 -- 172.21.15.26:0/1978944165 >> 172.21.15.26:0/1978944165 conn(0x7f3fa8066f50 msgr2=0x7f3fa80a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:37.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.768+0000 7f3fadb99700 1 -- 172.21.15.26:0/1978944165 shutdown_connections 2023-10-01T07:56:37.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:37.768+0000 7f3fadb99700 1 -- 172.21.15.26:0/1978944165 wait complete. 2023-10-01T07:56:37.782 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:38.448 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:38.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.594+0000 7f403b29e700 1 Processor -- start 2023-10-01T07:56:38.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.594+0000 7f403b29e700 1 -- start start 2023-10-01T07:56:38.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.595+0000 7f403b29e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f403409f410 0x7f4034136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:38.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.595+0000 7f403b29e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4034136fe0 0x7f40341393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:38.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.595+0000 7f403b29e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4034070940 con 0x7f403409e930 2023-10-01T07:56:38.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.595+0000 7f403b29e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f403406fd60 con 0x7f403409f410 2023-10-01T07:56:38.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.595+0000 7f403b29e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f403406fa80 con 0x7f4034136fe0 2023-10-01T07:56:38.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.595+0000 7f4038839700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f403409f410 0x7f4034136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:38.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.595+0000 7f403983b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4034136fe0 0x7f40341393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:38.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.595+0000 7f4038839700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f403409f410 0x7f4034136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56874/0 (socket says 172.21.15.26:56874) 2023-10-01T07:56:38.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.595+0000 7f4038839700 1 -- 172.21.15.26:0/1561298932 learned_addr learned my addr 172.21.15.26:0/1561298932 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:38.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.595+0000 7f403983b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4034136fe0 0x7f40341393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44466/0 (socket says 172.21.15.26:44466) 2023-10-01T07:56:38.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.595+0000 7f4038839700 1 -- 172.21.15.26:0/1561298932 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4034136fe0 msgr2=0x7f40341393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:38.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.595+0000 7f4038839700 1 --2- 172.21.15.26:0/1561298932 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4034136fe0 0x7f40341393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:38.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.595+0000 7f4038839700 1 -- 172.21.15.26:0/1561298932 >> v1:172.21.15.26:6789/0 conn(0x7f403409e930 legacy=0x7f403409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:38.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.595+0000 7f4038839700 1 -- 172.21.15.26:0/1561298932 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f403409fb60 con 0x7f403409f410 2023-10-01T07:56:38.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.595+0000 7f403983b700 1 --2- 172.21.15.26:0/1561298932 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4034136fe0 0x7f40341393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:38.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.595+0000 7f4038839700 1 --2- 172.21.15.26:0/1561298932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f403409f410 0x7f4034136aa0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f40280098f0 tx=0x7f4028009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b60f1f765d8ebf6 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:38.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.596+0000 7f4027fff700 1 -- 172.21.15.26:0/1561298932 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4028011830 con 0x7f403409f410 2023-10-01T07:56:38.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.596+0000 7f4027fff700 1 -- 172.21.15.26:0/1561298932 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4028011990 con 0x7f403409f410 2023-10-01T07:56:38.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.596+0000 7f4027fff700 1 -- 172.21.15.26:0/1561298932 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4028011d20 con 0x7f403409f410 2023-10-01T07:56:38.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.596+0000 7f403b29e700 1 -- 172.21.15.26:0/1561298932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f403409f410 msgr2=0x7f4034136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:38.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.596+0000 7f403b29e700 1 --2- 172.21.15.26:0/1561298932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f403409f410 0x7f4034136aa0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f40280098f0 tx=0x7f4028009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:38.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.596+0000 7f403b29e700 1 -- 172.21.15.26:0/1561298932 shutdown_connections 2023-10-01T07:56:38.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.596+0000 7f403b29e700 1 --2- 172.21.15.26:0/1561298932 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4034136fe0 0x7f40341393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:38.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.596+0000 7f403b29e700 1 --2- 172.21.15.26:0/1561298932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f403409f410 0x7f4034136aa0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:38.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.596+0000 7f403b29e700 1 -- 172.21.15.26:0/1561298932 >> 172.21.15.26:0/1561298932 conn(0x7f40340a4210 msgr2=0x7f40340a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:38.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.596+0000 7f403b29e700 1 -- 172.21.15.26:0/1561298932 shutdown_connections 2023-10-01T07:56:38.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.596+0000 7f403b29e700 1 -- 172.21.15.26:0/1561298932 wait complete. 2023-10-01T07:56:38.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.598+0000 7f403b29e700 1 Processor -- start 2023-10-01T07:56:38.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.598+0000 7f403b29e700 1 -- start start 2023-10-01T07:56:38.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.598+0000 7f403b29e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f403409e930 0x7f403406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:38.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.599+0000 7f403b29e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f403409f410 0x7f403406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:38.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.599+0000 7f403b29e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4034136fe0 0x7f403406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:38.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.599+0000 7f403b29e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40341226a0 con 0x7f4034136fe0 2023-10-01T07:56:38.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.599+0000 7f403b29e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40341325f0 con 0x7f403409f410 2023-10-01T07:56:38.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.599+0000 7f403b29e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40340a2f40 con 0x7f403409e930 2023-10-01T07:56:38.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.599+0000 7f4038839700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f403409f410 0x7f403406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:38.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.599+0000 7f403903a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f403409e930 0x7f403406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:38.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.599+0000 7f4038839700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f403409f410 0x7f403406bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44472/0 (socket says 172.21.15.26:44472) 2023-10-01T07:56:38.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.599+0000 7f403903a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f403409e930 0x7f403406b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35308/0 (socket says 172.21.15.26:35308) 2023-10-01T07:56:38.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.599+0000 7f4038839700 1 -- 172.21.15.26:0/1219886 learned_addr learned my addr 172.21.15.26:0/1219886 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:38.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.599+0000 7f403983b700 1 --2- 172.21.15.26:0/1219886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4034136fe0 0x7f403406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:38.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.599+0000 7f4038839700 1 -- 172.21.15.26:0/1219886 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f403409e930 msgr2=0x7f403406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:38.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.599+0000 7f4038839700 1 --2- 172.21.15.26:0/1219886 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f403409e930 0x7f403406b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:38.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.599+0000 7f4038839700 1 -- 172.21.15.26:0/1219886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4034136fe0 msgr2=0x7f403406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:38.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.599+0000 7f4038839700 1 --2- 172.21.15.26:0/1219886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4034136fe0 0x7f403406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:38.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.599+0000 7f4038839700 1 -- 172.21.15.26:0/1219886 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f402c009a70 con 0x7f403409f410 2023-10-01T07:56:38.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.599+0000 7f4038839700 1 --2- 172.21.15.26:0/1219886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f403409f410 0x7f403406bdf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4028000c00 tx=0x7f4028004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:38.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.599+0000 7f4025ffb700 1 -- 172.21.15.26:0/1219886 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40280043c0 con 0x7f403409f410 2023-10-01T07:56:38.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.599+0000 7f4025ffb700 1 -- 172.21.15.26:0/1219886 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f402801f070 con 0x7f403409f410 2023-10-01T07:56:38.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.599+0000 7f4025ffb700 1 -- 172.21.15.26:0/1219886 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40280038c0 con 0x7f403409f410 2023-10-01T07:56:38.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.599+0000 7f403b29e700 1 -- 172.21.15.26:0/1219886 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4028009550 con 0x7f403409f410 2023-10-01T07:56:38.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.600+0000 7f403b29e700 1 -- 172.21.15.26:0/1219886 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f403406cca0 con 0x7f403409f410 2023-10-01T07:56:38.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.600+0000 7f4025ffb700 1 -- 172.21.15.26:0/1219886 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4028021030 con 0x7f403409f410 2023-10-01T07:56:38.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.601+0000 7f4025ffb700 1 -- 172.21.15.26:0/1219886 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4028040900 con 0x7f403409f410 2023-10-01T07:56:38.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.601+0000 7f403b29e700 1 -- 172.21.15.26:0/1219886 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f403409e190 con 0x7f403409f410 2023-10-01T07:56:38.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.606+0000 7f4025ffb700 1 -- 172.21.15.26:0/1219886 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4028015080 con 0x7f403409f410 2023-10-01T07:56:38.696 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:38.738 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:38.783 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:38.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.815+0000 7f403b29e700 1 -- 172.21.15.26:0/1219886 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f40340a3de0 con 0x7f403409f410 2023-10-01T07:56:38.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.815+0000 7f4025ffb700 1 -- 172.21.15.26:0/1219886 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4028004560 con 0x7f403409f410 2023-10-01T07:56:38.816 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:38.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.818+0000 7f403b29e700 1 -- 172.21.15.26:0/1219886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f403409f410 msgr2=0x7f403406bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:38.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.818+0000 7f403b29e700 1 --2- 172.21.15.26:0/1219886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f403409f410 0x7f403406bdf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4028000c00 tx=0x7f4028004750 comp rx=0 tx=0).stop 2023-10-01T07:56:38.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.818+0000 7f403b29e700 1 -- 172.21.15.26:0/1219886 shutdown_connections 2023-10-01T07:56:38.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.818+0000 7f403b29e700 1 --2- 172.21.15.26:0/1219886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4034136fe0 0x7f403406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:38.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.818+0000 7f403b29e700 1 --2- 172.21.15.26:0/1219886 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f403409e930 0x7f403406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:38.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.818+0000 7f403b29e700 1 --2- 172.21.15.26:0/1219886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f403409f410 0x7f403406bdf0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:38.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.818+0000 7f403b29e700 1 -- 172.21.15.26:0/1219886 >> 172.21.15.26:0/1219886 conn(0x7f40340a4210 msgr2=0x7f4034134b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:38.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.819+0000 7f403b29e700 1 -- 172.21.15.26:0/1219886 shutdown_connections 2023-10-01T07:56:38.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.820+0000 7f403b29e700 1 -- 172.21.15.26:0/1219886 wait complete. 2023-10-01T07:56:38.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:38.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.844+0000 7efea05be700 1 Processor -- start 2023-10-01T07:56:38.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.844+0000 7efea05be700 1 -- start start 2023-10-01T07:56:38.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.845+0000 7efea05be700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe9809f410 0x7efe98136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:38.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.845+0000 7efea05be700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe98136fe0 0x7efe981393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:38.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.845+0000 7efea05be700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe98070940 con 0x7efe9809e930 2023-10-01T07:56:38.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.845+0000 7efea05be700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe9806fd60 con 0x7efe9809f410 2023-10-01T07:56:38.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.845+0000 7efea05be700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe9806fa80 con 0x7efe98136fe0 2023-10-01T07:56:38.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.845+0000 7efe9db59700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe9809f410 0x7efe98136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:38.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.845+0000 7efe9e35a700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7efe9809e930 0x7efe9809ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:50016/0 (socket says 172.21.15.26:50016) 2023-10-01T07:56:38.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.845+0000 7efe9e35a700 1 -- 172.21.15.26:0/2579098250 learned_addr learned my addr 172.21.15.26:0/2579098250 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:38.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.845+0000 7efe9eb5b700 1 --2- 172.21.15.26:0/2579098250 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe98136fe0 0x7efe981393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:38.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.845+0000 7efe9db59700 1 -- 172.21.15.26:0/2579098250 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe98136fe0 msgr2=0x7efe981393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:38.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.845+0000 7efe9db59700 1 --2- 172.21.15.26:0/2579098250 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe98136fe0 0x7efe981393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:38.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.845+0000 7efe9db59700 1 -- 172.21.15.26:0/2579098250 >> v1:172.21.15.26:6789/0 conn(0x7efe9809e930 legacy=0x7efe9809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:38.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.845+0000 7efe9db59700 1 -- 172.21.15.26:0/2579098250 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9809fb60 con 0x7efe9809f410 2023-10-01T07:56:38.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.845+0000 7efe9db59700 1 --2- 172.21.15.26:0/2579098250 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe9809f410 0x7efe98136aa0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efe88009870 tx=0x7efe88009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee062d25f6e74546 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:38.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.846+0000 7efe9d358700 1 -- 172.21.15.26:0/2579098250 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe88011830 con 0x7efe9809f410 2023-10-01T07:56:38.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.846+0000 7efe9d358700 1 -- 172.21.15.26:0/2579098250 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe88011990 con 0x7efe9809f410 2023-10-01T07:56:38.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.846+0000 7efe9d358700 1 -- 172.21.15.26:0/2579098250 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe88011d20 con 0x7efe9809f410 2023-10-01T07:56:38.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.846+0000 7efea05be700 1 -- 172.21.15.26:0/2579098250 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe9809f410 msgr2=0x7efe98136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:38.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.846+0000 7efea05be700 1 --2- 172.21.15.26:0/2579098250 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe9809f410 0x7efe98136aa0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efe88009870 tx=0x7efe88009b80 comp rx=0 tx=0).stop 2023-10-01T07:56:38.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.847+0000 7efea05be700 1 -- 172.21.15.26:0/2579098250 shutdown_connections 2023-10-01T07:56:38.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.847+0000 7efea05be700 1 --2- 172.21.15.26:0/2579098250 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe98136fe0 0x7efe981393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:38.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.847+0000 7efea05be700 1 --2- 172.21.15.26:0/2579098250 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe9809f410 0x7efe98136aa0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:38.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.847+0000 7efea05be700 1 -- 172.21.15.26:0/2579098250 >> 172.21.15.26:0/2579098250 conn(0x7efe980a4210 msgr2=0x7efe980a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:38.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.847+0000 7efea05be700 1 -- 172.21.15.26:0/2579098250 shutdown_connections 2023-10-01T07:56:38.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.847+0000 7efea05be700 1 -- 172.21.15.26:0/2579098250 wait complete. 2023-10-01T07:56:38.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.848+0000 7efea05be700 1 Processor -- start 2023-10-01T07:56:38.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.848+0000 7efea05be700 1 -- start start 2023-10-01T07:56:38.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.848+0000 7efea05be700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe9809e930 0x7efe9806c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:38.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.848+0000 7efea05be700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe9809f410 0x7efe9806c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:38.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.848+0000 7efea05be700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe98136fe0 0x7efe981c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:38.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.848+0000 7efea05be700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe98132220 con 0x7efe9809f410 2023-10-01T07:56:38.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.848+0000 7efea05be700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe98122170 con 0x7efe9809e930 2023-10-01T07:56:38.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.848+0000 7efea05be700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe9806bd70 con 0x7efe98136fe0 2023-10-01T07:56:38.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.848+0000 7efe9db59700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe9809f410 0x7efe9806c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:38.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.848+0000 7efe9db59700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe9809f410 0x7efe9806c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56886/0 (socket says 172.21.15.26:56886) 2023-10-01T07:56:38.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.848+0000 7efe9db59700 1 -- 172.21.15.26:0/2355000339 learned_addr learned my addr 172.21.15.26:0/2355000339 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:38.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.848+0000 7efe9e35a700 1 --2- 172.21.15.26:0/2355000339 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe9809e930 0x7efe9806c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:38.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.848+0000 7efe9eb5b700 1 --2- 172.21.15.26:0/2355000339 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe98136fe0 0x7efe981c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:38.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.849+0000 7efe9db59700 1 -- 172.21.15.26:0/2355000339 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe98136fe0 msgr2=0x7efe981c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:38.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.849+0000 7efe9db59700 1 --2- 172.21.15.26:0/2355000339 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe98136fe0 0x7efe981c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:38.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.849+0000 7efe9db59700 1 -- 172.21.15.26:0/2355000339 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe9809e930 msgr2=0x7efe9806c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:38.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.849+0000 7efe9db59700 1 --2- 172.21.15.26:0/2355000339 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe9809e930 0x7efe9806c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:38.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.849+0000 7efe9db59700 1 -- 172.21.15.26:0/2355000339 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe880094a0 con 0x7efe9809f410 2023-10-01T07:56:38.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.849+0000 7efe9db59700 1 --2- 172.21.15.26:0/2355000339 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe9809f410 0x7efe9806c850 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7efe88000c00 tx=0x7efe88004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:38.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.849+0000 7efe8effd700 1 -- 172.21.15.26:0/2355000339 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe88004450 con 0x7efe9809f410 2023-10-01T07:56:38.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.849+0000 7efe8effd700 1 -- 172.21.15.26:0/2355000339 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8801f070 con 0x7efe9809f410 2023-10-01T07:56:38.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.849+0000 7efea05be700 1 -- 172.21.15.26:0/2355000339 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe9806d4c0 con 0x7efe9809f410 2023-10-01T07:56:38.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.849+0000 7efe8effd700 1 -- 172.21.15.26:0/2355000339 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe880038e0 con 0x7efe9809f410 2023-10-01T07:56:38.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.849+0000 7efea05be700 1 -- 172.21.15.26:0/2355000339 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe980a3120 con 0x7efe9809f410 2023-10-01T07:56:38.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.851+0000 7efea05be700 1 -- 172.21.15.26:0/2355000339 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe9806cd90 con 0x7efe9809f410 2023-10-01T07:56:38.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.851+0000 7efe8effd700 1 -- 172.21.15.26:0/2355000339 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efe88003a40 con 0x7efe9809f410 2023-10-01T07:56:38.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.851+0000 7efe8effd700 1 -- 172.21.15.26:0/2355000339 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efe88021070 con 0x7efe9809f410 2023-10-01T07:56:38.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.856+0000 7efe8effd700 1 -- 172.21.15.26:0/2355000339 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efe880253e0 con 0x7efe9809f410 2023-10-01T07:56:38.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.884+0000 7f3112f14700 1 Processor -- start 2023-10-01T07:56:38.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.884+0000 7f3112f14700 1 -- start start 2023-10-01T07:56:38.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.884+0000 7f3112f14700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f310c0984f0 0x7f310c0988c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:38.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.884+0000 7f3112f14700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f310c09d6f0 0x7f310c09db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:38.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.884+0000 7f3112f14700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f310c09e040 0x7f310c1385c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:38.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.884+0000 7f3112f14700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f310c099620 con 0x7f310c0984f0 2023-10-01T07:56:38.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.884+0000 7f3112f14700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f310c09aca0 con 0x7f310c09e040 2023-10-01T07:56:38.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.884+0000 7f3112f14700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f310c09a9e0 con 0x7f310c09d6f0 2023-10-01T07:56:38.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.884+0000 7f3110cb0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f310c0984f0 0x7f310c0988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:38.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.884+0000 7f3110cb0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f310c0984f0 0x7f310c0988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56890/0 (socket says 172.21.15.26:56890) 2023-10-01T07:56:38.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.884+0000 7f3110cb0700 1 -- 172.21.15.26:0/3948756723 learned_addr learned my addr 172.21.15.26:0/3948756723 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:38.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.884+0000 7f310bfff700 1 --2- 172.21.15.26:0/3948756723 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f310c09d6f0 0x7f310c09db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:38.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.884+0000 7f31114b1700 1 --2- 172.21.15.26:0/3948756723 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f310c09e040 0x7f310c1385c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:38.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.885+0000 7f3110cb0700 1 -- 172.21.15.26:0/3948756723 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f310c09d6f0 msgr2=0x7f310c09db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:38.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.885+0000 7f3110cb0700 1 --2- 172.21.15.26:0/3948756723 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f310c09d6f0 0x7f310c09db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:38.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.885+0000 7f3110cb0700 1 -- 172.21.15.26:0/3948756723 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f310c09e040 msgr2=0x7f310c1385c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:38.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.885+0000 7f3110cb0700 1 --2- 172.21.15.26:0/3948756723 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f310c09e040 0x7f310c1385c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:38.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.885+0000 7f3110cb0700 1 -- 172.21.15.26:0/3948756723 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f310c09bce0 con 0x7f310c0984f0 2023-10-01T07:56:38.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.885+0000 7f310bfff700 1 --2- 172.21.15.26:0/3948756723 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f310c09d6f0 0x7f310c09db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:38.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.885+0000 7f31114b1700 1 --2- 172.21.15.26:0/3948756723 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f310c09e040 0x7f310c1385c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:38.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.885+0000 7f3110cb0700 1 --2- 172.21.15.26:0/3948756723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f310c0984f0 0x7f310c0988c0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f30fc0098f0 tx=0x7f30fc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75792d36772bb5ff server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:38.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.885+0000 7f310b7fe700 1 -- 172.21.15.26:0/3948756723 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30fc011830 con 0x7f310c0984f0 2023-10-01T07:56:38.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.885+0000 7f310b7fe700 1 -- 172.21.15.26:0/3948756723 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30fc011990 con 0x7f310c0984f0 2023-10-01T07:56:38.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.885+0000 7f310b7fe700 1 -- 172.21.15.26:0/3948756723 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30fc011d20 con 0x7f310c0984f0 2023-10-01T07:56:38.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.886+0000 7f3112f14700 1 -- 172.21.15.26:0/3948756723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f310c0984f0 msgr2=0x7f310c0988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:38.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.886+0000 7f3112f14700 1 --2- 172.21.15.26:0/3948756723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f310c0984f0 0x7f310c0988c0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f30fc0098f0 tx=0x7f30fc009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:38.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.886+0000 7f3112f14700 1 -- 172.21.15.26:0/3948756723 shutdown_connections 2023-10-01T07:56:38.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.886+0000 7f3112f14700 1 --2- 172.21.15.26:0/3948756723 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f310c09e040 0x7f310c1385c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:38.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.886+0000 7f3112f14700 1 --2- 172.21.15.26:0/3948756723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f310c0984f0 0x7f310c0988c0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:38.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.886+0000 7f3112f14700 1 --2- 172.21.15.26:0/3948756723 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f310c09d6f0 0x7f310c09db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:38.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.886+0000 7f3112f14700 1 -- 172.21.15.26:0/3948756723 >> 172.21.15.26:0/3948756723 conn(0x7f310c09f470 msgr2=0x7f310c0a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:38.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.886+0000 7f3112f14700 1 -- 172.21.15.26:0/3948756723 shutdown_connections 2023-10-01T07:56:38.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.886+0000 7f3112f14700 1 -- 172.21.15.26:0/3948756723 wait complete. 2023-10-01T07:56:38.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.887+0000 7f3112f14700 1 Processor -- start 2023-10-01T07:56:38.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.888+0000 7f3112f14700 1 -- start start 2023-10-01T07:56:38.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.888+0000 7f3112f14700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f310c0984f0 0x7f310c1c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:38.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.888+0000 7f3112f14700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f310c09d6f0 0x7f310c1c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:38.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.888+0000 7f3112f14700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f310c09e040 0x7f310c12d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:38.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.888+0000 7f3112f14700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310c0a1bc0 con 0x7f310c09e040 2023-10-01T07:56:38.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.888+0000 7f3112f14700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f310c06dca0 con 0x7f310c09d6f0 2023-10-01T07:56:38.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.888+0000 7f3112f14700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f310c12edc0 con 0x7f310c0984f0 2023-10-01T07:56:38.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.889+0000 7f310bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f310c09d6f0 0x7f310c1c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:38.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.889+0000 7f310bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f310c09d6f0 0x7f310c1c8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44504/0 (socket says 172.21.15.26:44504) 2023-10-01T07:56:38.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.889+0000 7f310bfff700 1 -- 172.21.15.26:0/2149984474 learned_addr learned my addr 172.21.15.26:0/2149984474 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:38.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.889+0000 7f3110cb0700 1 --2- 172.21.15.26:0/2149984474 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f310c0984f0 0x7f310c1c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:38.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.889+0000 7f31114b1700 1 --2- 172.21.15.26:0/2149984474 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f310c09e040 0x7f310c12d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:38.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.889+0000 7f3110cb0700 1 -- 172.21.15.26:0/2149984474 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f310c09d6f0 msgr2=0x7f310c1c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:38.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.889+0000 7f3110cb0700 1 --2- 172.21.15.26:0/2149984474 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f310c09d6f0 0x7f310c1c8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:38.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.889+0000 7f3110cb0700 1 -- 172.21.15.26:0/2149984474 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f310c09e040 msgr2=0x7f310c12d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:38.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.889+0000 7f3110cb0700 1 --2- 172.21.15.26:0/2149984474 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f310c09e040 0x7f310c12d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:38.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.889+0000 7f3110cb0700 1 -- 172.21.15.26:0/2149984474 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31000094a0 con 0x7f310c0984f0 2023-10-01T07:56:38.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.889+0000 7f310bfff700 1 --2- 172.21.15.26:0/2149984474 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f310c09d6f0 0x7f310c1c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:38.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.889+0000 7f3110cb0700 1 --2- 172.21.15.26:0/2149984474 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f310c0984f0 0x7f310c1c8830 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f30fc016000 tx=0x7f30fc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:38.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.889+0000 7f31097fa700 1 -- 172.21.15.26:0/2149984474 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30fc004450 con 0x7f310c0984f0 2023-10-01T07:56:38.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.890+0000 7f31097fa700 1 -- 172.21.15.26:0/2149984474 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30fc0045b0 con 0x7f310c0984f0 2023-10-01T07:56:38.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.890+0000 7f31097fa700 1 -- 172.21.15.26:0/2149984474 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30fc0038a0 con 0x7f310c0984f0 2023-10-01T07:56:38.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.892+0000 7f3112f14700 1 -- 172.21.15.26:0/2149984474 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3104009a70 con 0x7f310c0984f0 2023-10-01T07:56:38.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.892+0000 7f3112f14700 1 -- 172.21.15.26:0/2149984474 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30fc009550 con 0x7f310c0984f0 2023-10-01T07:56:38.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.893+0000 7f3112f14700 1 -- 172.21.15.26:0/2149984474 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f310c0747f0 con 0x7f310c0984f0 2023-10-01T07:56:38.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.893+0000 7f31097fa700 1 -- 172.21.15.26:0/2149984474 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f30fc021070 con 0x7f310c0984f0 2023-10-01T07:56:38.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.893+0000 7f31097fa700 1 -- 172.21.15.26:0/2149984474 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f30fc0404f0 con 0x7f310c0984f0 2023-10-01T07:56:38.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.902+0000 7f31097fa700 1 -- 172.21.15.26:0/2149984474 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f30fc022960 con 0x7f310c0984f0 2023-10-01T07:56:38.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.943+0000 7f62fa266700 1 Processor -- start 2023-10-01T07:56:38.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.943+0000 7f62fa266700 1 -- start start 2023-10-01T07:56:38.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.943+0000 7f62fa266700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62f4133a80 0x7f62f4133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:38.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.944+0000 7f62fa266700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f62f412ff20 0x7f62f4130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:38.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.944+0000 7f62fa266700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62f4130870 0x7f62f413a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:38.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.944+0000 7f62fa266700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f406c570 con 0x7f62f412ff20 2023-10-01T07:56:38.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.944+0000 7f62fa266700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f406bc00 con 0x7f62f4130870 2023-10-01T07:56:38.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.944+0000 7f62fa266700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62f40a0040 con 0x7f62f4133a80 2023-10-01T07:56:38.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.944+0000 7f62f3fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62f4133a80 0x7f62f4133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:38.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.944+0000 7f62f37fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f62f412ff20 0x7f62f4130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:38.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.944+0000 7f62f3fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62f4133a80 0x7f62f4133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35366/0 (socket says 172.21.15.26:35366) 2023-10-01T07:56:38.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.944+0000 7f62f3fff700 1 -- 172.21.15.26:0/4087679491 learned_addr learned my addr 172.21.15.26:0/4087679491 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:38.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.944+0000 7f62f8803700 1 --2- 172.21.15.26:0/4087679491 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62f4130870 0x7f62f413a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:38.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.944+0000 7f62f37fe700 1 -- 172.21.15.26:0/4087679491 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62f4133a80 msgr2=0x7f62f4133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:38.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.944+0000 7f62f37fe700 1 --2- 172.21.15.26:0/4087679491 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62f4133a80 0x7f62f4133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:38.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.944+0000 7f62f37fe700 1 -- 172.21.15.26:0/4087679491 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62f4130870 msgr2=0x7f62f413a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:38.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.944+0000 7f62f37fe700 1 --2- 172.21.15.26:0/4087679491 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62f4130870 0x7f62f413a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:38.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.944+0000 7f62f37fe700 1 -- 172.21.15.26:0/4087679491 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f4133860 con 0x7f62f412ff20 2023-10-01T07:56:38.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.944+0000 7f62f37fe700 1 --2- 172.21.15.26:0/4087679491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62f412ff20 0x7f62f4130330 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f62e8009840 tx=0x7f62e8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7749a0cd2893669 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:38.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.945+0000 7f62f2ffd700 1 -- 172.21.15.26:0/4087679491 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e8011830 con 0x7f62f412ff20 2023-10-01T07:56:38.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.945+0000 7f62f2ffd700 1 -- 172.21.15.26:0/4087679491 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e8011990 con 0x7f62f412ff20 2023-10-01T07:56:38.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.945+0000 7f62f2ffd700 1 -- 172.21.15.26:0/4087679491 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e8011d20 con 0x7f62f412ff20 2023-10-01T07:56:38.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.945+0000 7f62fa266700 1 -- 172.21.15.26:0/4087679491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62f412ff20 msgr2=0x7f62f4130330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:38.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.945+0000 7f62fa266700 1 --2- 172.21.15.26:0/4087679491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62f412ff20 0x7f62f4130330 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f62e8009840 tx=0x7f62e8009b50 comp rx=0 tx=0).stop 2023-10-01T07:56:38.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.945+0000 7f62fa266700 1 -- 172.21.15.26:0/4087679491 shutdown_connections 2023-10-01T07:56:38.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.945+0000 7f62fa266700 1 --2- 172.21.15.26:0/4087679491 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62f4130870 0x7f62f413a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:38.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.945+0000 7f62fa266700 1 --2- 172.21.15.26:0/4087679491 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62f4133a80 0x7f62f4133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:38.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.945+0000 7f62fa266700 1 --2- 172.21.15.26:0/4087679491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62f412ff20 0x7f62f4130330 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:38.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.945+0000 7f62fa266700 1 -- 172.21.15.26:0/4087679491 >> 172.21.15.26:0/4087679491 conn(0x7f62f40a4210 msgr2=0x7f62f40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:38.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.945+0000 7f62fa266700 1 -- 172.21.15.26:0/4087679491 shutdown_connections 2023-10-01T07:56:38.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.946+0000 7f62fa266700 1 -- 172.21.15.26:0/4087679491 wait complete. 2023-10-01T07:56:38.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.947+0000 7f62fa266700 1 Processor -- start 2023-10-01T07:56:38.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.947+0000 7f62fa266700 1 -- start start 2023-10-01T07:56:38.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.947+0000 7f62fa266700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62f412ff20 0x7f62f409c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:38.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.947+0000 7f62fa266700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62f4130870 0x7f62f409ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:38.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.947+0000 7f62fa266700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62f4133a80 0x7f62f409d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:38.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.947+0000 7f62fa266700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f412dc20 con 0x7f62f412ff20 2023-10-01T07:56:38.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.947+0000 7f62fa266700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f411fe10 con 0x7f62f4130870 2023-10-01T07:56:38.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.947+0000 7f62fa266700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62f409e1f0 con 0x7f62f4133a80 2023-10-01T07:56:38.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.947+0000 7f62f3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62f412ff20 0x7f62f409c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:38.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.947+0000 7f62f3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62f412ff20 0x7f62f409c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56918/0 (socket says 172.21.15.26:56918) 2023-10-01T07:56:38.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.947+0000 7f62f3fff700 1 -- 172.21.15.26:0/3827335226 learned_addr learned my addr 172.21.15.26:0/3827335226 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:38.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.947+0000 7f62f37fe700 1 --2- 172.21.15.26:0/3827335226 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62f4130870 0x7f62f409ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:38.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.948+0000 7f62f8803700 1 --2- 172.21.15.26:0/3827335226 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62f4133a80 0x7f62f409d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:38.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.948+0000 7f62f3fff700 1 -- 172.21.15.26:0/3827335226 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62f4133a80 msgr2=0x7f62f409d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:38.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.948+0000 7f62f3fff700 1 --2- 172.21.15.26:0/3827335226 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62f4133a80 0x7f62f409d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:38.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.948+0000 7f62f3fff700 1 -- 172.21.15.26:0/3827335226 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62f4130870 msgr2=0x7f62f409ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:38.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.948+0000 7f62f3fff700 1 --2- 172.21.15.26:0/3827335226 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62f4130870 0x7f62f409ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:38.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.948+0000 7f62f3fff700 1 -- 172.21.15.26:0/3827335226 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e80094a0 con 0x7f62f412ff20 2023-10-01T07:56:38.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.948+0000 7f62f8803700 1 --2- 172.21.15.26:0/3827335226 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62f4133a80 0x7f62f409d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:38.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.948+0000 7f62f37fe700 1 --2- 172.21.15.26:0/3827335226 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62f4130870 0x7f62f409ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:38.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.948+0000 7f62f3fff700 1 --2- 172.21.15.26:0/3827335226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62f412ff20 0x7f62f409c8c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f62e400e940 tx=0x7f62e400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:38.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.948+0000 7f62f0ff9700 1 -- 172.21.15.26:0/3827335226 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e40096a0 con 0x7f62f412ff20 2023-10-01T07:56:38.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.948+0000 7f62f0ff9700 1 -- 172.21.15.26:0/3827335226 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e4013680 con 0x7f62f412ff20 2023-10-01T07:56:38.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.948+0000 7f62fa266700 1 -- 172.21.15.26:0/3827335226 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f412d7e0 con 0x7f62f412ff20 2023-10-01T07:56:38.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.948+0000 7f62f0ff9700 1 -- 172.21.15.26:0/3827335226 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e4013a30 con 0x7f62f412ff20 2023-10-01T07:56:38.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.948+0000 7f62fa266700 1 -- 172.21.15.26:0/3827335226 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f411fa00 con 0x7f62f412ff20 2023-10-01T07:56:38.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.949+0000 7f62fa266700 1 -- 172.21.15.26:0/3827335226 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f4120460 con 0x7f62f412ff20 2023-10-01T07:56:38.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.949+0000 7f62f0ff9700 1 -- 172.21.15.26:0/3827335226 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f62e4013b90 con 0x7f62f412ff20 2023-10-01T07:56:38.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.950+0000 7f62f0ff9700 1 -- 172.21.15.26:0/3827335226 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f62e403f5d0 con 0x7f62f412ff20 2023-10-01T07:56:38.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:38.959+0000 7f62f0ff9700 1 -- 172.21.15.26:0/3827335226 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f62e400c450 con 0x7f62f412ff20 2023-10-01T07:56:39.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.090+0000 7efea05be700 1 -- 172.21.15.26:0/2355000339 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efe98121fb0 con 0x7efe9809f410 2023-10-01T07:56:39.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.091+0000 7efe8effd700 1 -- 172.21.15.26:0/2355000339 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efe98121fb0 con 0x7efe9809f410 2023-10-01T07:56:39.091 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:39.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.094+0000 7efea05be700 1 -- 172.21.15.26:0/2355000339 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe9809f410 msgr2=0x7efe9806c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:39.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.094+0000 7efea05be700 1 --2- 172.21.15.26:0/2355000339 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe9809f410 0x7efe9806c850 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7efe88000c00 tx=0x7efe88004750 comp rx=0 tx=0).stop 2023-10-01T07:56:39.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.095+0000 7efea05be700 1 -- 172.21.15.26:0/2355000339 shutdown_connections 2023-10-01T07:56:39.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.095+0000 7efea05be700 1 --2- 172.21.15.26:0/2355000339 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe98136fe0 0x7efe981c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:39.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.095+0000 7efea05be700 1 --2- 172.21.15.26:0/2355000339 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe9809e930 0x7efe9806c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:39.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.095+0000 7efea05be700 1 --2- 172.21.15.26:0/2355000339 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe9809f410 0x7efe9806c850 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:39.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.095+0000 7efea05be700 1 -- 172.21.15.26:0/2355000339 >> 172.21.15.26:0/2355000339 conn(0x7efe980a4210 msgr2=0x7efe98134ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:39.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.095+0000 7efea05be700 1 -- 172.21.15.26:0/2355000339 shutdown_connections 2023-10-01T07:56:39.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.095+0000 7efea05be700 1 -- 172.21.15.26:0/2355000339 wait complete. 2023-10-01T07:56:39.110 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:39.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.118+0000 7f3112f14700 1 -- 172.21.15.26:0/2149984474 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f310c06e0f0 con 0x7f310c0984f0 2023-10-01T07:56:39.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.119+0000 7f31097fa700 1 -- 172.21.15.26:0/2149984474 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f30fc029070 con 0x7f310c0984f0 2023-10-01T07:56:39.119 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:39.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.121+0000 7f3112f14700 1 -- 172.21.15.26:0/2149984474 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f310c0984f0 msgr2=0x7f310c1c8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:39.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.121+0000 7f3112f14700 1 --2- 172.21.15.26:0/2149984474 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f310c0984f0 0x7f310c1c8830 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f30fc016000 tx=0x7f30fc004750 comp rx=0 tx=0).stop 2023-10-01T07:56:39.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.121+0000 7f3112f14700 1 -- 172.21.15.26:0/2149984474 shutdown_connections 2023-10-01T07:56:39.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.121+0000 7f3112f14700 1 --2- 172.21.15.26:0/2149984474 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f310c09e040 0x7f310c12d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:39.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.121+0000 7f3112f14700 1 --2- 172.21.15.26:0/2149984474 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f310c0984f0 0x7f310c1c8830 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:39.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.121+0000 7f3112f14700 1 --2- 172.21.15.26:0/2149984474 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f310c09d6f0 0x7f310c1c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:39.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.121+0000 7f3112f14700 1 -- 172.21.15.26:0/2149984474 >> 172.21.15.26:0/2149984474 conn(0x7f310c09f470 msgr2=0x7f310c1b8a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:39.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.121+0000 7f3112f14700 1 -- 172.21.15.26:0/2149984474 shutdown_connections 2023-10-01T07:56:39.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.121+0000 7f3112f14700 1 -- 172.21.15.26:0/2149984474 wait complete. 2023-10-01T07:56:39.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:39.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.171+0000 7f62fa266700 1 -- 172.21.15.26:0/3827335226 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f62f4074ea0 con 0x7f62f412ff20 2023-10-01T07:56:39.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.171+0000 7f62f0ff9700 1 -- 172.21.15.26:0/3827335226 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f62e4021020 con 0x7f62f412ff20 2023-10-01T07:56:39.172 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:39.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.173+0000 7f62fa266700 1 -- 172.21.15.26:0/3827335226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62f412ff20 msgr2=0x7f62f409c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:39.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.173+0000 7f62fa266700 1 --2- 172.21.15.26:0/3827335226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62f412ff20 0x7f62f409c8c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f62e400e940 tx=0x7f62e400ec50 comp rx=0 tx=0).stop 2023-10-01T07:56:39.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.173+0000 7f62fa266700 1 -- 172.21.15.26:0/3827335226 shutdown_connections 2023-10-01T07:56:39.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.173+0000 7f62fa266700 1 --2- 172.21.15.26:0/3827335226 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62f4133a80 0x7f62f409d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:39.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.173+0000 7f62fa266700 1 --2- 172.21.15.26:0/3827335226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62f412ff20 0x7f62f409c8c0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:39.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.173+0000 7f62fa266700 1 --2- 172.21.15.26:0/3827335226 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62f4130870 0x7f62f409ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:39.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.173+0000 7f62fa266700 1 -- 172.21.15.26:0/3827335226 >> 172.21.15.26:0/3827335226 conn(0x7f62f40a4210 msgr2=0x7f62f409e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:39.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.173+0000 7f62fa266700 1 -- 172.21.15.26:0/3827335226 shutdown_connections 2023-10-01T07:56:39.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.173+0000 7f62fa266700 1 -- 172.21.15.26:0/3827335226 wait complete. 2023-10-01T07:56:39.187 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:39.838 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:39.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.983+0000 7ff9604b4700 1 Processor -- start 2023-10-01T07:56:39.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.984+0000 7ff9604b4700 1 -- start start 2023-10-01T07:56:39.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.984+0000 7ff9604b4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff95809e930 0x7ff95809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:39.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.984+0000 7ff9604b4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff95809f240 0x7ff9581317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:39.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.984+0000 7ff9604b4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff95809f650 0x7ff958131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:39.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.984+0000 7ff9604b4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff958070940 con 0x7ff95809f240 2023-10-01T07:56:39.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.984+0000 7ff9604b4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff95806fd60 con 0x7ff95809f650 2023-10-01T07:56:39.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.984+0000 7ff9604b4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff95806fa80 con 0x7ff95809e930 2023-10-01T07:56:39.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.984+0000 7ff95da4f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff95809f240 0x7ff9581317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:39.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.984+0000 7ff95ea51700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff95809f650 0x7ff958131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:39.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.984+0000 7ff95e250700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff95809e930 0x7ff95809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:39.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.984+0000 7ff95da4f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff95809f240 0x7ff9581317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56924/0 (socket says 172.21.15.26:56924) 2023-10-01T07:56:39.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.984+0000 7ff95e250700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff95809e930 0x7ff95809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35382/0 (socket says 172.21.15.26:35382) 2023-10-01T07:56:39.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.984+0000 7ff95ea51700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff95809f650 0x7ff958131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44526/0 (socket says 172.21.15.26:44526) 2023-10-01T07:56:39.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.984+0000 7ff95da4f700 1 -- 172.21.15.26:0/1858634425 learned_addr learned my addr 172.21.15.26:0/1858634425 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:39.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.985+0000 7ff95da4f700 1 -- 172.21.15.26:0/1858634425 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff95809e930 msgr2=0x7ff95809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:39.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.985+0000 7ff95da4f700 1 --2- 172.21.15.26:0/1858634425 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff95809e930 0x7ff95809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:39.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.985+0000 7ff95da4f700 1 -- 172.21.15.26:0/1858634425 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff95809f650 msgr2=0x7ff958131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:39.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.985+0000 7ff95da4f700 1 --2- 172.21.15.26:0/1858634425 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff95809f650 0x7ff958131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:39.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.985+0000 7ff95da4f700 1 -- 172.21.15.26:0/1858634425 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95809fb60 con 0x7ff95809f240 2023-10-01T07:56:39.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.985+0000 7ff95ea51700 1 --2- 172.21.15.26:0/1858634425 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff95809f650 0x7ff958131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:39.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.985+0000 7ff95da4f700 1 --2- 172.21.15.26:0/1858634425 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff95809f240 0x7ff9581317f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7ff9480098f0 tx=0x7ff948009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3498a3ef502f84e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:39.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.985+0000 7ff95d24e700 1 -- 172.21.15.26:0/1858634425 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff948011830 con 0x7ff95809f240 2023-10-01T07:56:39.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.985+0000 7ff95d24e700 1 -- 172.21.15.26:0/1858634425 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff948011990 con 0x7ff95809f240 2023-10-01T07:56:39.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.985+0000 7ff95d24e700 1 -- 172.21.15.26:0/1858634425 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff948011d20 con 0x7ff95809f240 2023-10-01T07:56:39.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.986+0000 7ff9604b4700 1 -- 172.21.15.26:0/1858634425 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff95809f240 msgr2=0x7ff9581317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:39.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.986+0000 7ff9604b4700 1 --2- 172.21.15.26:0/1858634425 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff95809f240 0x7ff9581317f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7ff9480098f0 tx=0x7ff948009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:39.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.986+0000 7ff9604b4700 1 -- 172.21.15.26:0/1858634425 shutdown_connections 2023-10-01T07:56:39.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.986+0000 7ff9604b4700 1 --2- 172.21.15.26:0/1858634425 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff95809f650 0x7ff958131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:39.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.986+0000 7ff9604b4700 1 --2- 172.21.15.26:0/1858634425 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff95809e930 0x7ff95809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:39.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.986+0000 7ff9604b4700 1 --2- 172.21.15.26:0/1858634425 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff95809f240 0x7ff9581317f0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:39.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.986+0000 7ff9604b4700 1 -- 172.21.15.26:0/1858634425 >> 172.21.15.26:0/1858634425 conn(0x7ff9580a4210 msgr2=0x7ff9580a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:39.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.986+0000 7ff9604b4700 1 -- 172.21.15.26:0/1858634425 shutdown_connections 2023-10-01T07:56:39.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.986+0000 7ff9604b4700 1 -- 172.21.15.26:0/1858634425 wait complete. 2023-10-01T07:56:39.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.987+0000 7ff9604b4700 1 Processor -- start 2023-10-01T07:56:39.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.987+0000 7ff9604b4700 1 -- start start 2023-10-01T07:56:39.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.987+0000 7ff9604b4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff95809e930 0x7ff9581c4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:39.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.987+0000 7ff9604b4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff95809f240 0x7ff9581c4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:39.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.987+0000 7ff9604b4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff95809f650 0x7ff9581c07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:39.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.988+0000 7ff9604b4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9581a5050 con 0x7ff95809f650 2023-10-01T07:56:39.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.988+0000 7ff9604b4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9580a3660 con 0x7ff95809f240 2023-10-01T07:56:39.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.988+0000 7ff9604b4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9581c4cd0 con 0x7ff95809e930 2023-10-01T07:56:39.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.988+0000 7ff95e250700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff95809e930 0x7ff9581c4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:39.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.988+0000 7ff95da4f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff95809f240 0x7ff9581c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:39.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.988+0000 7ff95ea51700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff95809f650 0x7ff9581c07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:39.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.988+0000 7ff95e250700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff95809e930 0x7ff9581c4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35396/0 (socket says 172.21.15.26:35396) 2023-10-01T07:56:39.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.988+0000 7ff95e250700 1 -- 172.21.15.26:0/2219842414 learned_addr learned my addr 172.21.15.26:0/2219842414 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:39.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.988+0000 7ff95da4f700 1 --2- 172.21.15.26:0/2219842414 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff95809f240 0x7ff9581c4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44530/0 (socket says 172.21.15.26:44530) 2023-10-01T07:56:39.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.988+0000 7ff95ea51700 1 --2- 172.21.15.26:0/2219842414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff95809f650 0x7ff9581c07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56934/0 (socket says 172.21.15.26:56934) 2023-10-01T07:56:39.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.988+0000 7ff95da4f700 1 -- 172.21.15.26:0/2219842414 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff95809e930 msgr2=0x7ff9581c4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:39.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.988+0000 7ff95da4f700 1 --2- 172.21.15.26:0/2219842414 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff95809e930 0x7ff9581c4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:39.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.988+0000 7ff95da4f700 1 -- 172.21.15.26:0/2219842414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff95809f650 msgr2=0x7ff9581c07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:39.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.988+0000 7ff95da4f700 1 --2- 172.21.15.26:0/2219842414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff95809f650 0x7ff9581c07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:39.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.988+0000 7ff95da4f700 1 -- 172.21.15.26:0/2219842414 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95000f050 con 0x7ff95809f240 2023-10-01T07:56:39.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.988+0000 7ff95ea51700 1 --2- 172.21.15.26:0/2219842414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff95809f650 0x7ff9581c07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:39.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.988+0000 7ff95da4f700 1 --2- 172.21.15.26:0/2219842414 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff95809f240 0x7ff9581c4790 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff948016000 tx=0x7ff948004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:39.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.988+0000 7ff94effd700 1 -- 172.21.15.26:0/2219842414 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff948004240 con 0x7ff95809f240 2023-10-01T07:56:39.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.988+0000 7ff94effd700 1 -- 172.21.15.26:0/2219842414 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94801f070 con 0x7ff95809f240 2023-10-01T07:56:39.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.988+0000 7ff9604b4700 1 -- 172.21.15.26:0/2219842414 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff948009550 con 0x7ff95809f240 2023-10-01T07:56:39.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.988+0000 7ff94effd700 1 -- 172.21.15.26:0/2219842414 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9480036a0 con 0x7ff95809f240 2023-10-01T07:56:39.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.988+0000 7ff9604b4700 1 -- 172.21.15.26:0/2219842414 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9580a0190 con 0x7ff95809f240 2023-10-01T07:56:39.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.989+0000 7ff94effd700 1 -- 172.21.15.26:0/2219842414 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff948021030 con 0x7ff95809f240 2023-10-01T07:56:39.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.989+0000 7ff9604b4700 1 -- 172.21.15.26:0/2219842414 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff958074ea0 con 0x7ff95809f240 2023-10-01T07:56:39.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.989+0000 7ff94effd700 1 -- 172.21.15.26:0/2219842414 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff9480408c0 con 0x7ff95809f240 2023-10-01T07:56:39.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:39.994+0000 7ff94effd700 1 -- 172.21.15.26:0/2219842414 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff9480239c0 con 0x7ff95809f240 2023-10-01T07:56:40.113 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:40.137 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:40.188 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:40.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.208+0000 7ff9604b4700 1 -- 172.21.15.26:0/2219842414 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff95806b250 con 0x7ff95809f240 2023-10-01T07:56:40.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.209+0000 7ff94effd700 1 -- 172.21.15.26:0/2219842414 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff948015070 con 0x7ff95809f240 2023-10-01T07:56:40.209 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:40.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.212+0000 7ff9604b4700 1 -- 172.21.15.26:0/2219842414 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff95809f240 msgr2=0x7ff9581c4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:40.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.212+0000 7ff9604b4700 1 --2- 172.21.15.26:0/2219842414 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff95809f240 0x7ff9581c4790 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff948016000 tx=0x7ff948004750 comp rx=0 tx=0).stop 2023-10-01T07:56:40.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.213+0000 7ff9604b4700 1 -- 172.21.15.26:0/2219842414 shutdown_connections 2023-10-01T07:56:40.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.213+0000 7ff9604b4700 1 --2- 172.21.15.26:0/2219842414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff95809f650 0x7ff9581c07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:40.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.213+0000 7ff9604b4700 1 --2- 172.21.15.26:0/2219842414 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff95809e930 0x7ff9581c4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:40.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.213+0000 7ff9604b4700 1 --2- 172.21.15.26:0/2219842414 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff95809f240 0x7ff9581c4790 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:40.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.213+0000 7ff9604b4700 1 -- 172.21.15.26:0/2219842414 >> 172.21.15.26:0/2219842414 conn(0x7ff9580a4210 msgr2=0x7ff9581b6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:40.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.213+0000 7ff9604b4700 1 -- 172.21.15.26:0/2219842414 shutdown_connections 2023-10-01T07:56:40.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.213+0000 7ff9604b4700 1 -- 172.21.15.26:0/2219842414 wait complete. 2023-10-01T07:56:40.229 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:40.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.259+0000 7f658f6f4700 1 Processor -- start 2023-10-01T07:56:40.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.259+0000 7f658f6f4700 1 -- start start 2023-10-01T07:56:40.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.260+0000 7f658f6f4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f658809e1d0 0x7f6588138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:40.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.260+0000 7f658f6f4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6588139170 0x7f658813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:40.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.260+0000 7f658f6f4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f658809b120 con 0x7f658809d6f0 2023-10-01T07:56:40.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.260+0000 7f658f6f4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f658806b460 con 0x7f658809e1d0 2023-10-01T07:56:40.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.260+0000 7f658f6f4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f658809a7e0 con 0x7f6588139170 2023-10-01T07:56:40.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.260+0000 7f658dc91700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6588139170 0x7f658813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:40.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.260+0000 7f658cc8f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f658809e1d0 0x7f6588138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:40.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.260+0000 7f658dc91700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6588139170 0x7f658813b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44534/0 (socket says 172.21.15.26:44534) 2023-10-01T07:56:40.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.260+0000 7f658dc91700 1 -- 172.21.15.26:0/1507183794 learned_addr learned my addr 172.21.15.26:0/1507183794 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:40.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.260+0000 7f658cc8f700 1 -- 172.21.15.26:0/1507183794 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6588139170 msgr2=0x7f658813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:40.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.260+0000 7f658cc8f700 1 --2- 172.21.15.26:0/1507183794 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6588139170 0x7f658813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:40.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.260+0000 7f658cc8f700 1 -- 172.21.15.26:0/1507183794 >> v1:172.21.15.26:6789/0 conn(0x7f658809d6f0 legacy=0x7f658809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:40.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.260+0000 7f658cc8f700 1 -- 172.21.15.26:0/1507183794 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658809a500 con 0x7f658809e1d0 2023-10-01T07:56:40.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.260+0000 7f658cc8f700 1 --2- 172.21.15.26:0/1507183794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f658809e1d0 0x7f6588138c30 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6578009870 tx=0x7f6578009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b81552981f93523 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:40.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.261+0000 7f657ffff700 1 -- 172.21.15.26:0/1507183794 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6578011830 con 0x7f658809e1d0 2023-10-01T07:56:40.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.261+0000 7f657ffff700 1 -- 172.21.15.26:0/1507183794 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6578011990 con 0x7f658809e1d0 2023-10-01T07:56:40.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.261+0000 7f657ffff700 1 -- 172.21.15.26:0/1507183794 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6578011d20 con 0x7f658809e1d0 2023-10-01T07:56:40.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.261+0000 7f658f6f4700 1 -- 172.21.15.26:0/1507183794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f658809e1d0 msgr2=0x7f6588138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:40.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.261+0000 7f658f6f4700 1 --2- 172.21.15.26:0/1507183794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f658809e1d0 0x7f6588138c30 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6578009870 tx=0x7f6578009b80 comp rx=0 tx=0).stop 2023-10-01T07:56:40.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.261+0000 7f658f6f4700 1 -- 172.21.15.26:0/1507183794 shutdown_connections 2023-10-01T07:56:40.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.261+0000 7f658f6f4700 1 --2- 172.21.15.26:0/1507183794 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6588139170 0x7f658813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:40.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.261+0000 7f658f6f4700 1 --2- 172.21.15.26:0/1507183794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f658809e1d0 0x7f6588138c30 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:40.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.261+0000 7f658f6f4700 1 -- 172.21.15.26:0/1507183794 >> 172.21.15.26:0/1507183794 conn(0x7f6588066f50 msgr2=0x7f658809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:40.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.261+0000 7f658f6f4700 1 -- 172.21.15.26:0/1507183794 shutdown_connections 2023-10-01T07:56:40.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.261+0000 7f658f6f4700 1 -- 172.21.15.26:0/1507183794 wait complete. 2023-10-01T07:56:40.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.262+0000 7f658f6f4700 1 Processor -- start 2023-10-01T07:56:40.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.263+0000 7f658f6f4700 1 -- start start 2023-10-01T07:56:40.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.263+0000 7f658f6f4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f658809d6f0 0x7f65881c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:40.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.263+0000 7f658f6f4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f658809e1d0 0x7f65881c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:40.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.263+0000 7f658f6f4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6588139170 0x7f658811eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:40.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.263+0000 7f658f6f4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6588121bb0 con 0x7f658809d6f0 2023-10-01T07:56:40.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.263+0000 7f658f6f4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65881be2f0 con 0x7f658809e1d0 2023-10-01T07:56:40.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.263+0000 7f658f6f4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65881c9150 con 0x7f6588139170 2023-10-01T07:56:40.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.263+0000 7f658d490700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f658809d6f0 0x7f65881c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:40.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.263+0000 7f658d490700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f658809d6f0 0x7f65881c86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56962/0 (socket says 172.21.15.26:56962) 2023-10-01T07:56:40.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.263+0000 7f658d490700 1 -- 172.21.15.26:0/4210880528 learned_addr learned my addr 172.21.15.26:0/4210880528 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:40.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.263+0000 7f658cc8f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f658809e1d0 0x7f65881c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:40.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.263+0000 7f658dc91700 1 --2- 172.21.15.26:0/4210880528 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6588139170 0x7f658811eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:40.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.263+0000 7f658d490700 1 -- 172.21.15.26:0/4210880528 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6588139170 msgr2=0x7f658811eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:40.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.264+0000 7f658d490700 1 --2- 172.21.15.26:0/4210880528 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6588139170 0x7f658811eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:40.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.264+0000 7f658d490700 1 -- 172.21.15.26:0/4210880528 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f658809e1d0 msgr2=0x7f65881c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:40.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.264+0000 7f658d490700 1 --2- 172.21.15.26:0/4210880528 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f658809e1d0 0x7f65881c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:40.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.264+0000 7f658d490700 1 -- 172.21.15.26:0/4210880528 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65780094a0 con 0x7f658809d6f0 2023-10-01T07:56:40.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.264+0000 7f658cc8f700 1 --2- 172.21.15.26:0/4210880528 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f658809e1d0 0x7f65881c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:40.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.264+0000 7f658d490700 1 --2- 172.21.15.26:0/4210880528 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f658809d6f0 0x7f65881c86d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f658400c510 tx=0x7f658400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:40.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.264+0000 7f657dffb700 1 -- 172.21.15.26:0/4210880528 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65840052d0 con 0x7f658809d6f0 2023-10-01T07:56:40.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.264+0000 7f657dffb700 1 -- 172.21.15.26:0/4210880528 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6584005430 con 0x7f658809d6f0 2023-10-01T07:56:40.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.264+0000 7f657dffb700 1 -- 172.21.15.26:0/4210880528 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65840038c0 con 0x7f658809d6f0 2023-10-01T07:56:40.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.264+0000 7f658f6f4700 1 -- 172.21.15.26:0/4210880528 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6588122420 con 0x7f658809d6f0 2023-10-01T07:56:40.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.264+0000 7f658f6f4700 1 -- 172.21.15.26:0/4210880528 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6588121e80 con 0x7f658809d6f0 2023-10-01T07:56:40.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.265+0000 7f657dffb700 1 -- 172.21.15.26:0/4210880528 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6584003a20 con 0x7f658809d6f0 2023-10-01T07:56:40.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.265+0000 7f657dffb700 1 -- 172.21.15.26:0/4210880528 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f658403ea80 con 0x7f658809d6f0 2023-10-01T07:56:40.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.265+0000 7f658f6f4700 1 -- 172.21.15.26:0/4210880528 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f658809c710 con 0x7f658809d6f0 2023-10-01T07:56:40.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.271+0000 7f657dffb700 1 -- 172.21.15.26:0/4210880528 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6584018260 con 0x7f658809d6f0 2023-10-01T07:56:40.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.304+0000 7f60a4b74700 1 Processor -- start 2023-10-01T07:56:40.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.304+0000 7f60a4b74700 1 -- start start 2023-10-01T07:56:40.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.305+0000 7f60a4b74700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f60a009fa10 0x7f60a0136950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:40.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.305+0000 7f60a4b74700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60a009f2c0 0x7f60a0138ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:40.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.305+0000 7f60a4b74700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a009b610 con 0x7f60a009e7e0 2023-10-01T07:56:40.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.305+0000 7f60a4b74700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a009bbb0 con 0x7f60a009fa10 2023-10-01T07:56:40.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.305+0000 7f60a4b74700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a00a0010 con 0x7f60a009f2c0 2023-10-01T07:56:40.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.305+0000 7f609dd9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f60a009fa10 0x7f60a0136950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:40.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.305+0000 7f609e59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f60a009e7e0 0x7f60a009ebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:50030/0 (socket says 172.21.15.26:50030) 2023-10-01T07:56:40.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.305+0000 7f609e59c700 1 -- 172.21.15.26:0/1091305449 learned_addr learned my addr 172.21.15.26:0/1091305449 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:40.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.305+0000 7f609ed9d700 1 --2- 172.21.15.26:0/1091305449 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60a009f2c0 0x7f60a0138ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:40.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.306+0000 7f609dd9b700 1 -- 172.21.15.26:0/1091305449 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60a009f2c0 msgr2=0x7f60a0138ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:40.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.306+0000 7f609dd9b700 1 --2- 172.21.15.26:0/1091305449 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60a009f2c0 0x7f60a0138ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:40.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.306+0000 7f609dd9b700 1 -- 172.21.15.26:0/1091305449 >> v1:172.21.15.26:6789/0 conn(0x7f60a009e7e0 legacy=0x7f60a009ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:40.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.306+0000 7f609dd9b700 1 -- 172.21.15.26:0/1091305449 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a009b8d0 con 0x7f60a009fa10 2023-10-01T07:56:40.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.306+0000 7f609dd9b700 1 --2- 172.21.15.26:0/1091305449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60a009fa10 0x7f60a0136950 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f6094009840 tx=0x7f6094009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2a577430fdf2aed server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:40.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.306+0000 7f609d59a700 1 -- 172.21.15.26:0/1091305449 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6094011830 con 0x7f60a009fa10 2023-10-01T07:56:40.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.306+0000 7f609d59a700 1 -- 172.21.15.26:0/1091305449 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6094011990 con 0x7f60a009fa10 2023-10-01T07:56:40.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.306+0000 7f609d59a700 1 -- 172.21.15.26:0/1091305449 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6094011d20 con 0x7f60a009fa10 2023-10-01T07:56:40.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.307+0000 7f60a4b74700 1 -- 172.21.15.26:0/1091305449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60a009fa10 msgr2=0x7f60a0136950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:40.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.307+0000 7f60a4b74700 1 --2- 172.21.15.26:0/1091305449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60a009fa10 0x7f60a0136950 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f6094009840 tx=0x7f6094009b50 comp rx=0 tx=0).stop 2023-10-01T07:56:40.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.307+0000 7f60a4b74700 1 -- 172.21.15.26:0/1091305449 shutdown_connections 2023-10-01T07:56:40.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.307+0000 7f60a4b74700 1 --2- 172.21.15.26:0/1091305449 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60a009f2c0 0x7f60a0138ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:40.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.307+0000 7f60a4b74700 1 --2- 172.21.15.26:0/1091305449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60a009fa10 0x7f60a0136950 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:40.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.307+0000 7f60a4b74700 1 -- 172.21.15.26:0/1091305449 >> 172.21.15.26:0/1091305449 conn(0x7f60a00a4300 msgr2=0x7f60a00a4700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:40.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.307+0000 7f60a4b74700 1 -- 172.21.15.26:0/1091305449 shutdown_connections 2023-10-01T07:56:40.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.307+0000 7f60a4b74700 1 -- 172.21.15.26:0/1091305449 wait complete. 2023-10-01T07:56:40.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.308+0000 7f60a4b74700 1 Processor -- start 2023-10-01T07:56:40.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.308+0000 7f60a4b74700 1 -- start start 2023-10-01T07:56:40.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.309+0000 7f60a4b74700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f60a009e7e0 0x7f60a011a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:40.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.309+0000 7f60a4b74700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60a009f2c0 0x7f60a011aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:40.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.309+0000 7f60a4b74700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60a009fa10 0x7f60a011afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:40.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.309+0000 7f60a4b74700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a011d040 con 0x7f60a009f2c0 2023-10-01T07:56:40.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.309+0000 7f60a4b74700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a009d9c0 con 0x7f60a009fa10 2023-10-01T07:56:40.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.309+0000 7f60a4b74700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60a011c650 con 0x7f60a009e7e0 2023-10-01T07:56:40.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.309+0000 7f609dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60a009f2c0 0x7f60a011aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:40.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.309+0000 7f609dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60a009f2c0 0x7f60a011aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56976/0 (socket says 172.21.15.26:56976) 2023-10-01T07:56:40.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.309+0000 7f609dd9b700 1 -- 172.21.15.26:0/3817872905 learned_addr learned my addr 172.21.15.26:0/3817872905 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:40.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.309+0000 7f609e59c700 1 --2- 172.21.15.26:0/3817872905 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f60a009e7e0 0x7f60a011a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:40.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.309+0000 7f609ed9d700 1 --2- 172.21.15.26:0/3817872905 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60a009fa10 0x7f60a011afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:40.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.310+0000 7f609dd9b700 1 -- 172.21.15.26:0/3817872905 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f60a009e7e0 msgr2=0x7f60a011a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:40.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.310+0000 7f609dd9b700 1 --2- 172.21.15.26:0/3817872905 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f60a009e7e0 0x7f60a011a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:40.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.310+0000 7f609dd9b700 1 -- 172.21.15.26:0/3817872905 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60a009fa10 msgr2=0x7f60a011afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:40.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.310+0000 7f609dd9b700 1 --2- 172.21.15.26:0/3817872905 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60a009fa10 0x7f60a011afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:40.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.310+0000 7f609dd9b700 1 -- 172.21.15.26:0/3817872905 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60940094a0 con 0x7f60a009f2c0 2023-10-01T07:56:40.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.310+0000 7f609dd9b700 1 --2- 172.21.15.26:0/3817872905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60a009f2c0 0x7f60a011aa70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f60940090b0 tx=0x7f6094004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:40.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.310+0000 7f608effd700 1 -- 172.21.15.26:0/3817872905 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60940036a0 con 0x7f60a009f2c0 2023-10-01T07:56:40.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.310+0000 7f608effd700 1 -- 172.21.15.26:0/3817872905 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609401f070 con 0x7f60a009f2c0 2023-10-01T07:56:40.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.310+0000 7f608effd700 1 -- 172.21.15.26:0/3817872905 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6094003a60 con 0x7f60a009f2c0 2023-10-01T07:56:40.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.310+0000 7f60a4b74700 1 -- 172.21.15.26:0/3817872905 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a011c3b0 con 0x7f60a009f2c0 2023-10-01T07:56:40.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.310+0000 7f60a4b74700 1 -- 172.21.15.26:0/3817872905 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a011d490 con 0x7f60a009f2c0 2023-10-01T07:56:40.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.311+0000 7f608effd700 1 -- 172.21.15.26:0/3817872905 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6094003bc0 con 0x7f60a009f2c0 2023-10-01T07:56:40.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.311+0000 7f608effd700 1 -- 172.21.15.26:0/3817872905 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6094021070 con 0x7f60a009f2c0 2023-10-01T07:56:40.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.311+0000 7f60a4b74700 1 -- 172.21.15.26:0/3817872905 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a004f2a0 con 0x7f60a009f2c0 2023-10-01T07:56:40.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.320+0000 7f608effd700 1 -- 172.21.15.26:0/3817872905 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f609402b020 con 0x7f60a009f2c0 2023-10-01T07:56:40.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.348+0000 7f2447e61700 1 Processor -- start 2023-10-01T07:56:40.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.349+0000 7f2447e61700 1 -- start start 2023-10-01T07:56:40.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.349+0000 7f2447e61700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2440130750 0x7f2440130b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:40.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.349+0000 7f2447e61700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f244009d6f0 0x7f244009db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:40.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.349+0000 7f2447e61700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f244009e080 0x7f24401374b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:40.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.349+0000 7f2447e61700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f244009c190 con 0x7f244009e080 2023-10-01T07:56:40.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.349+0000 7f2447e61700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f244009b090 con 0x7f2440130750 2023-10-01T07:56:40.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.349+0000 7f2447e61700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f244009a6c0 con 0x7f244009d6f0 2023-10-01T07:56:40.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.349+0000 7f24463fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f244009e080 0x7f24401374b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:40.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.349+0000 7f24453fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f244009d6f0 0x7f244009db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:40.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.349+0000 7f24463fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f244009e080 0x7f24401374b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56978/0 (socket says 172.21.15.26:56978) 2023-10-01T07:56:40.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.349+0000 7f24463fe700 1 -- 172.21.15.26:0/2572616576 learned_addr learned my addr 172.21.15.26:0/2572616576 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:40.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.349+0000 7f2445bfd700 1 --2- 172.21.15.26:0/2572616576 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2440130750 0x7f2440130b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:40.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.350+0000 7f24463fe700 1 -- 172.21.15.26:0/2572616576 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f244009d6f0 msgr2=0x7f244009db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:40.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.350+0000 7f24463fe700 1 --2- 172.21.15.26:0/2572616576 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f244009d6f0 0x7f244009db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:40.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.350+0000 7f24463fe700 1 -- 172.21.15.26:0/2572616576 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2440130750 msgr2=0x7f2440130b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:40.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.350+0000 7f24463fe700 1 --2- 172.21.15.26:0/2572616576 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2440130750 0x7f2440130b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:40.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.350+0000 7f24463fe700 1 -- 172.21.15.26:0/2572616576 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2440131060 con 0x7f244009e080 2023-10-01T07:56:40.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.350+0000 7f24453fc700 1 --2- 172.21.15.26:0/2572616576 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f244009d6f0 0x7f244009db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:40.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.350+0000 7f2445bfd700 1 --2- 172.21.15.26:0/2572616576 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2440130750 0x7f2440130b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:40.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.350+0000 7f24463fe700 1 --2- 172.21.15.26:0/2572616576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f244009e080 0x7f24401374b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f24380098f0 tx=0x7f2438009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=971abfd4dde7d91c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:40.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.350+0000 7f2444bfb700 1 -- 172.21.15.26:0/2572616576 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2438011830 con 0x7f244009e080 2023-10-01T07:56:40.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.350+0000 7f2444bfb700 1 -- 172.21.15.26:0/2572616576 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2438011990 con 0x7f244009e080 2023-10-01T07:56:40.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.350+0000 7f2444bfb700 1 -- 172.21.15.26:0/2572616576 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2438011d20 con 0x7f244009e080 2023-10-01T07:56:40.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.351+0000 7f2447e61700 1 -- 172.21.15.26:0/2572616576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f244009e080 msgr2=0x7f24401374b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:40.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.351+0000 7f2447e61700 1 --2- 172.21.15.26:0/2572616576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f244009e080 0x7f24401374b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f24380098f0 tx=0x7f2438009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:40.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.351+0000 7f2447e61700 1 -- 172.21.15.26:0/2572616576 shutdown_connections 2023-10-01T07:56:40.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.351+0000 7f2447e61700 1 --2- 172.21.15.26:0/2572616576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f244009e080 0x7f24401374b0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:40.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.351+0000 7f2447e61700 1 --2- 172.21.15.26:0/2572616576 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2440130750 0x7f2440130b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:40.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.351+0000 7f2447e61700 1 --2- 172.21.15.26:0/2572616576 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f244009d6f0 0x7f244009db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:40.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.351+0000 7f2447e61700 1 -- 172.21.15.26:0/2572616576 >> 172.21.15.26:0/2572616576 conn(0x7f244009f470 msgr2=0x7f24400a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:40.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.351+0000 7f2447e61700 1 -- 172.21.15.26:0/2572616576 shutdown_connections 2023-10-01T07:56:40.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.351+0000 7f2447e61700 1 -- 172.21.15.26:0/2572616576 wait complete. 2023-10-01T07:56:40.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.352+0000 7f2447e61700 1 Processor -- start 2023-10-01T07:56:40.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.353+0000 7f2447e61700 1 -- start start 2023-10-01T07:56:40.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.353+0000 7f2447e61700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f244009d6f0 0x7f24401c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:40.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.353+0000 7f2447e61700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f244009e080 0x7f24401c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:40.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.353+0000 7f2447e61700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2440130750 0x7f244006df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:40.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.353+0000 7f2447e61700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2440070790 con 0x7f2440130750 2023-10-01T07:56:40.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.353+0000 7f2447e61700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f244009b2b0 con 0x7f244009d6f0 2023-10-01T07:56:40.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.353+0000 7f2447e61700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f244006faf0 con 0x7f244009e080 2023-10-01T07:56:40.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.353+0000 7f24453fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f244009e080 0x7f24401c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:40.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.353+0000 7f24453fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f244009e080 0x7f24401c8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35422/0 (socket says 172.21.15.26:35422) 2023-10-01T07:56:40.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.353+0000 7f24453fc700 1 -- 172.21.15.26:0/2655814436 learned_addr learned my addr 172.21.15.26:0/2655814436 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:40.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.353+0000 7f24463fe700 1 --2- 172.21.15.26:0/2655814436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2440130750 0x7f244006df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:40.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.353+0000 7f2445bfd700 1 --2- 172.21.15.26:0/2655814436 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f244009d6f0 0x7f24401c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:40.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.354+0000 7f24453fc700 1 -- 172.21.15.26:0/2655814436 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f244009d6f0 msgr2=0x7f24401c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:40.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.354+0000 7f24453fc700 1 --2- 172.21.15.26:0/2655814436 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f244009d6f0 0x7f24401c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:40.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.354+0000 7f24453fc700 1 -- 172.21.15.26:0/2655814436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2440130750 msgr2=0x7f244006df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:40.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.354+0000 7f24453fc700 1 --2- 172.21.15.26:0/2655814436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2440130750 0x7f244006df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:40.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.354+0000 7f24453fc700 1 -- 172.21.15.26:0/2655814436 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24300094a0 con 0x7f244009e080 2023-10-01T07:56:40.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.354+0000 7f2445bfd700 1 --2- 172.21.15.26:0/2655814436 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f244009d6f0 0x7f24401c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:56:40.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.354+0000 7f24463fe700 1 --2- 172.21.15.26:0/2655814436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2440130750 0x7f244006df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:56:40.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.354+0000 7f24453fc700 1 --2- 172.21.15.26:0/2655814436 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f244009e080 0x7f24401c8a60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f243000ebb0 tx=0x7f243000ef70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:40.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.354+0000 7f24367fc700 1 -- 172.21.15.26:0/2655814436 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243000c850 con 0x7f244009e080 2023-10-01T07:56:40.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.354+0000 7f24367fc700 1 -- 172.21.15.26:0/2655814436 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243000c9b0 con 0x7f244009e080 2023-10-01T07:56:40.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.354+0000 7f2447e61700 1 -- 172.21.15.26:0/2655814436 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f243c009a70 con 0x7f244009e080 2023-10-01T07:56:40.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.354+0000 7f24367fc700 1 -- 172.21.15.26:0/2655814436 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243000cd40 con 0x7f244009e080 2023-10-01T07:56:40.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.354+0000 7f2447e61700 1 -- 172.21.15.26:0/2655814436 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2438009550 con 0x7f244009e080 2023-10-01T07:56:40.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.355+0000 7f24367fc700 1 -- 172.21.15.26:0/2655814436 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2430013470 con 0x7f244009e080 2023-10-01T07:56:40.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.355+0000 7f2447e61700 1 -- 172.21.15.26:0/2655814436 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24400747f0 con 0x7f244009e080 2023-10-01T07:56:40.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.355+0000 7f24367fc700 1 -- 172.21.15.26:0/2655814436 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f243003fc20 con 0x7f244009e080 2023-10-01T07:56:40.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.360+0000 7f24367fc700 1 -- 172.21.15.26:0/2655814436 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f243001b3b0 con 0x7f244009e080 2023-10-01T07:56:40.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.483+0000 7f658f6f4700 1 -- 172.21.15.26:0/4210880528 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6588074ea0 con 0x7f658809d6f0 2023-10-01T07:56:40.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.483+0000 7f657dffb700 1 -- 172.21.15.26:0/4210880528 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6584017020 con 0x7f658809d6f0 2023-10-01T07:56:40.484 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:40.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.486+0000 7f658f6f4700 1 -- 172.21.15.26:0/4210880528 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f658809d6f0 msgr2=0x7f65881c86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:40.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.486+0000 7f658f6f4700 1 --2- 172.21.15.26:0/4210880528 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f658809d6f0 0x7f65881c86d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f658400c510 tx=0x7f658400c820 comp rx=0 tx=0).stop 2023-10-01T07:56:40.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.486+0000 7f658f6f4700 1 -- 172.21.15.26:0/4210880528 shutdown_connections 2023-10-01T07:56:40.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.486+0000 7f658f6f4700 1 --2- 172.21.15.26:0/4210880528 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6588139170 0x7f658811eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:40.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.486+0000 7f658f6f4700 1 --2- 172.21.15.26:0/4210880528 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f658809d6f0 0x7f65881c86d0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:40.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.486+0000 7f658f6f4700 1 --2- 172.21.15.26:0/4210880528 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f658809e1d0 0x7f65881c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:40.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.486+0000 7f658f6f4700 1 -- 172.21.15.26:0/4210880528 >> 172.21.15.26:0/4210880528 conn(0x7f6588066f50 msgr2=0x7f65880a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:40.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.486+0000 7f658f6f4700 1 -- 172.21.15.26:0/4210880528 shutdown_connections 2023-10-01T07:56:40.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.486+0000 7f658f6f4700 1 -- 172.21.15.26:0/4210880528 wait complete. 2023-10-01T07:56:40.500 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:40.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.528+0000 7f60a4b74700 1 -- 172.21.15.26:0/3817872905 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f60a011dae0 con 0x7f60a009f2c0 2023-10-01T07:56:40.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.529+0000 7f608effd700 1 -- 172.21.15.26:0/3817872905 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6094010380 con 0x7f60a009f2c0 2023-10-01T07:56:40.529 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:40.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.531+0000 7f60a4b74700 1 -- 172.21.15.26:0/3817872905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60a009f2c0 msgr2=0x7f60a011aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:40.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.531+0000 7f60a4b74700 1 --2- 172.21.15.26:0/3817872905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60a009f2c0 0x7f60a011aa70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f60940090b0 tx=0x7f6094004750 comp rx=0 tx=0).stop 2023-10-01T07:56:40.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.531+0000 7f60a4b74700 1 -- 172.21.15.26:0/3817872905 shutdown_connections 2023-10-01T07:56:40.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.531+0000 7f60a4b74700 1 --2- 172.21.15.26:0/3817872905 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60a009fa10 0x7f60a011afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:40.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.531+0000 7f60a4b74700 1 --2- 172.21.15.26:0/3817872905 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f60a009e7e0 0x7f60a011a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:40.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.531+0000 7f60a4b74700 1 --2- 172.21.15.26:0/3817872905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60a009f2c0 0x7f60a011aa70 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:40.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.531+0000 7f60a4b74700 1 -- 172.21.15.26:0/3817872905 >> 172.21.15.26:0/3817872905 conn(0x7f60a00a4300 msgr2=0x7f60a01349e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:40.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.531+0000 7f60a4b74700 1 -- 172.21.15.26:0/3817872905 shutdown_connections 2023-10-01T07:56:40.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.531+0000 7f60a4b74700 1 -- 172.21.15.26:0/3817872905 wait complete. 2023-10-01T07:56:40.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:40.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.567+0000 7f2447e61700 1 -- 172.21.15.26:0/2655814436 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f244012ee90 con 0x7f244009e080 2023-10-01T07:56:40.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.567+0000 7f24367fc700 1 -- 172.21.15.26:0/2655814436 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2430024350 con 0x7f244009e080 2023-10-01T07:56:40.568 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:40.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.570+0000 7f2447e61700 1 -- 172.21.15.26:0/2655814436 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f244009e080 msgr2=0x7f24401c8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:40.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.570+0000 7f2447e61700 1 --2- 172.21.15.26:0/2655814436 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f244009e080 0x7f24401c8a60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f243000ebb0 tx=0x7f243000ef70 comp rx=0 tx=0).stop 2023-10-01T07:56:40.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.570+0000 7f2447e61700 1 -- 172.21.15.26:0/2655814436 shutdown_connections 2023-10-01T07:56:40.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.570+0000 7f2447e61700 1 --2- 172.21.15.26:0/2655814436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2440130750 0x7f244006df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:40.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.570+0000 7f2447e61700 1 --2- 172.21.15.26:0/2655814436 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f244009d6f0 0x7f24401c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:40.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.570+0000 7f2447e61700 1 --2- 172.21.15.26:0/2655814436 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f244009e080 0x7f24401c8a60 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:40.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.570+0000 7f2447e61700 1 -- 172.21.15.26:0/2655814436 >> 172.21.15.26:0/2655814436 conn(0x7f244009f470 msgr2=0x7f24400992c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:40.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.570+0000 7f2447e61700 1 -- 172.21.15.26:0/2655814436 shutdown_connections 2023-10-01T07:56:40.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:40.570+0000 7f2447e61700 1 -- 172.21.15.26:0/2655814436 wait complete. 2023-10-01T07:56:40.584 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:41.231 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:41.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.376+0000 7f9ede241700 1 Processor -- start 2023-10-01T07:56:41.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.376+0000 7f9ede241700 1 -- start start 2023-10-01T07:56:41.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.377+0000 7f9ede241700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ed809e930 0x7f9ed809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:41.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.377+0000 7f9ede241700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9ed809f240 0x7f9ed81317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:41.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.377+0000 7f9ede241700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ed809f650 0x7f9ed8131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:41.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.377+0000 7f9ede241700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed8070940 con 0x7f9ed809f240 2023-10-01T07:56:41.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.377+0000 7f9ede241700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed806fd60 con 0x7f9ed809e930 2023-10-01T07:56:41.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.377+0000 7f9ede241700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed806fa80 con 0x7f9ed809f650 2023-10-01T07:56:41.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.377+0000 7f9ed77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ed809e930 0x7f9ed809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:41.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.377+0000 7f9eceffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9ed809f240 0x7f9ed81317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:41.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.377+0000 7f9ed7fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ed809f650 0x7f9ed8131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:41.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.377+0000 7f9ed77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ed809e930 0x7f9ed809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44586/0 (socket says 172.21.15.26:44586) 2023-10-01T07:56:41.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.377+0000 7f9eceffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9ed809f240 0x7f9ed81317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56992/0 (socket says 172.21.15.26:56992) 2023-10-01T07:56:41.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.377+0000 7f9ed77fe700 1 -- 172.21.15.26:0/1785429892 learned_addr learned my addr 172.21.15.26:0/1785429892 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:41.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.377+0000 7f9eceffd700 1 -- 172.21.15.26:0/1785429892 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ed809f650 msgr2=0x7f9ed8131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:41.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.377+0000 7f9eceffd700 1 --2- 172.21.15.26:0/1785429892 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ed809f650 0x7f9ed8131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.377+0000 7f9eceffd700 1 -- 172.21.15.26:0/1785429892 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ed809e930 msgr2=0x7f9ed809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:41.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.377+0000 7f9eceffd700 1 --2- 172.21.15.26:0/1785429892 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ed809e930 0x7f9ed809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.377+0000 7f9eceffd700 1 -- 172.21.15.26:0/1785429892 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed809fb60 con 0x7f9ed809f240 2023-10-01T07:56:41.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.377+0000 7f9ed77fe700 1 --2- 172.21.15.26:0/1785429892 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ed809e930 0x7f9ed809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:41.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.378+0000 7f9eceffd700 1 --2- 172.21.15.26:0/1785429892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ed809f240 0x7f9ed81317f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0009840 tx=0x7f9ec0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3fa4396d6f13893 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:41.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.378+0000 7f9ed6ffd700 1 -- 172.21.15.26:0/1785429892 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec0011830 con 0x7f9ed809f240 2023-10-01T07:56:41.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.378+0000 7f9ed6ffd700 1 -- 172.21.15.26:0/1785429892 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec0011990 con 0x7f9ed809f240 2023-10-01T07:56:41.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.378+0000 7f9ed6ffd700 1 -- 172.21.15.26:0/1785429892 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec0011d20 con 0x7f9ed809f240 2023-10-01T07:56:41.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.378+0000 7f9ede241700 1 -- 172.21.15.26:0/1785429892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ed809f240 msgr2=0x7f9ed81317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:41.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.378+0000 7f9ede241700 1 --2- 172.21.15.26:0/1785429892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ed809f240 0x7f9ed81317f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0009840 tx=0x7f9ec0009b50 comp rx=0 tx=0).stop 2023-10-01T07:56:41.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.378+0000 7f9ede241700 1 -- 172.21.15.26:0/1785429892 shutdown_connections 2023-10-01T07:56:41.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.378+0000 7f9ede241700 1 --2- 172.21.15.26:0/1785429892 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ed809f650 0x7f9ed8131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.378+0000 7f9ede241700 1 --2- 172.21.15.26:0/1785429892 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ed809e930 0x7f9ed809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.378+0000 7f9ede241700 1 --2- 172.21.15.26:0/1785429892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ed809f240 0x7f9ed81317f0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.378+0000 7f9ede241700 1 -- 172.21.15.26:0/1785429892 >> 172.21.15.26:0/1785429892 conn(0x7f9ed80a4210 msgr2=0x7f9ed80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:41.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.379+0000 7f9ede241700 1 -- 172.21.15.26:0/1785429892 shutdown_connections 2023-10-01T07:56:41.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.379+0000 7f9ede241700 1 -- 172.21.15.26:0/1785429892 wait complete. 2023-10-01T07:56:41.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.380+0000 7f9ede241700 1 Processor -- start 2023-10-01T07:56:41.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.380+0000 7f9ede241700 1 -- start start 2023-10-01T07:56:41.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.380+0000 7f9ede241700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ed809e930 0x7f9ed81a3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:41.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.380+0000 7f9ede241700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ed809f240 0x7f9ed81a4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:41.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.380+0000 7f9ede241700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ed809f650 0x7f9ed81a47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:41.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.380+0000 7f9ede241700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed81a51e0 con 0x7f9ed809f650 2023-10-01T07:56:41.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.380+0000 7f9ede241700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed81a5940 con 0x7f9ed809e930 2023-10-01T07:56:41.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.380+0000 7f9ede241700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed81a5f60 con 0x7f9ed809f240 2023-10-01T07:56:41.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.380+0000 7f9ed77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ed809e930 0x7f9ed81a3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:41.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.380+0000 7f9ed77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ed809e930 0x7f9ed81a3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44596/0 (socket says 172.21.15.26:44596) 2023-10-01T07:56:41.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.380+0000 7f9ed77fe700 1 -- 172.21.15.26:0/3385648105 learned_addr learned my addr 172.21.15.26:0/3385648105 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:41.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.380+0000 7f9ed7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ed809f650 0x7f9ed81a47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:41.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.380+0000 7f9eceffd700 1 --2- 172.21.15.26:0/3385648105 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ed809f240 0x7f9ed81a4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:41.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.381+0000 7f9ed7fff700 1 -- 172.21.15.26:0/3385648105 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ed809f240 msgr2=0x7f9ed81a4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:41.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.381+0000 7f9ed7fff700 1 --2- 172.21.15.26:0/3385648105 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ed809f240 0x7f9ed81a4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.381+0000 7f9ed7fff700 1 -- 172.21.15.26:0/3385648105 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ed809e930 msgr2=0x7f9ed81a3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:41.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.381+0000 7f9ed7fff700 1 --2- 172.21.15.26:0/3385648105 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ed809e930 0x7f9ed81a3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.381+0000 7f9ed7fff700 1 -- 172.21.15.26:0/3385648105 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec8009550 con 0x7f9ed809f650 2023-10-01T07:56:41.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.381+0000 7f9ed77fe700 1 --2- 172.21.15.26:0/3385648105 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ed809e930 0x7f9ed81a3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:41.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.381+0000 7f9ed7fff700 1 --2- 172.21.15.26:0/3385648105 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ed809f650 0x7f9ed81a47b0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9ed000efc0 tx=0x7f9ed000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:41.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.381+0000 7f9ed4ff9700 1 -- 172.21.15.26:0/3385648105 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed000cc90 con 0x7f9ed809f650 2023-10-01T07:56:41.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.381+0000 7f9ed4ff9700 1 -- 172.21.15.26:0/3385648105 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed000f040 con 0x7f9ed809f650 2023-10-01T07:56:41.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.381+0000 7f9ede241700 1 -- 172.21.15.26:0/3385648105 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec00094a0 con 0x7f9ed809f650 2023-10-01T07:56:41.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.381+0000 7f9ed4ff9700 1 -- 172.21.15.26:0/3385648105 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed0009e60 con 0x7f9ed809f650 2023-10-01T07:56:41.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.381+0000 7f9ede241700 1 -- 172.21.15.26:0/3385648105 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed80a0190 con 0x7f9ed809f650 2023-10-01T07:56:41.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.382+0000 7f9ed4ff9700 1 -- 172.21.15.26:0/3385648105 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9ed0014480 con 0x7f9ed809f650 2023-10-01T07:56:41.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.382+0000 7f9ede241700 1 -- 172.21.15.26:0/3385648105 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ed81a0b30 con 0x7f9ed809f650 2023-10-01T07:56:41.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.382+0000 7f9ed4ff9700 1 -- 172.21.15.26:0/3385648105 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9ed003fe20 con 0x7f9ed809f650 2023-10-01T07:56:41.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.387+0000 7f9ed4ff9700 1 -- 172.21.15.26:0/3385648105 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9ed0018070 con 0x7f9ed809f650 2023-10-01T07:56:41.502 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:41.546 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:41.585 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:41.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.603+0000 7f9ede241700 1 -- 172.21.15.26:0/3385648105 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9ed80a3630 con 0x7f9ed809f650 2023-10-01T07:56:41.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.603+0000 7f9ed4ff9700 1 -- 172.21.15.26:0/3385648105 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9ed00118b0 con 0x7f9ed809f650 2023-10-01T07:56:41.604 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:41.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.606+0000 7f9ede241700 1 -- 172.21.15.26:0/3385648105 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ed809f650 msgr2=0x7f9ed81a47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:41.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.606+0000 7f9ede241700 1 --2- 172.21.15.26:0/3385648105 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ed809f650 0x7f9ed81a47b0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9ed000efc0 tx=0x7f9ed000c3a0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.606+0000 7f9ede241700 1 -- 172.21.15.26:0/3385648105 shutdown_connections 2023-10-01T07:56:41.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.606+0000 7f9ede241700 1 --2- 172.21.15.26:0/3385648105 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ed809f650 0x7f9ed81a47b0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.606+0000 7f9ede241700 1 --2- 172.21.15.26:0/3385648105 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ed809e930 0x7f9ed81a3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.606+0000 7f9ede241700 1 --2- 172.21.15.26:0/3385648105 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ed809f240 0x7f9ed81a4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.606+0000 7f9ede241700 1 -- 172.21.15.26:0/3385648105 >> 172.21.15.26:0/3385648105 conn(0x7f9ed80a4210 msgr2=0x7f9ed81b8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:41.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.606+0000 7f9ede241700 1 -- 172.21.15.26:0/3385648105 shutdown_connections 2023-10-01T07:56:41.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.606+0000 7f9ede241700 1 -- 172.21.15.26:0/3385648105 wait complete. 2023-10-01T07:56:41.623 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:41.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.646+0000 7f0f5c980700 1 Processor -- start 2023-10-01T07:56:41.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.646+0000 7f0f5c980700 1 -- start start 2023-10-01T07:56:41.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.647+0000 7f0f5c980700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0f580a0a30 0x7f0f580a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:41.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.647+0000 7f0f5c980700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f580a1340 0x7f0f58133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:41.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.647+0000 7f0f5c980700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f5809edd0 con 0x7f0f58133fa0 2023-10-01T07:56:41.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.647+0000 7f0f5c980700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f5809e1f0 con 0x7f0f580a0a30 2023-10-01T07:56:41.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.647+0000 7f0f5c980700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5809dc50 con 0x7f0f580a1340 2023-10-01T07:56:41.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.647+0000 7f0f55d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f580a1340 0x7f0f58133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:41.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.647+0000 7f0f55d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f580a1340 0x7f0f58133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44602/0 (socket says 172.21.15.26:44602) 2023-10-01T07:56:41.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.647+0000 7f0f55d9b700 1 -- 172.21.15.26:0/1333835657 learned_addr learned my addr 172.21.15.26:0/1333835657 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:41.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.647+0000 7f0f5659c700 1 --2- 172.21.15.26:0/1333835657 >> v2:172.21.15.26:3300/0 conn(0x7f0f580a0a30 0x7f0f580a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:41.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.647+0000 7f0f55d9b700 1 -- 172.21.15.26:0/1333835657 >> v2:172.21.15.26:3300/0 conn(0x7f0f580a0a30 msgr2=0x7f0f580a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:41.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.647+0000 7f0f55d9b700 1 --2- 172.21.15.26:0/1333835657 >> v2:172.21.15.26:3300/0 conn(0x7f0f580a0a30 0x7f0f580a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.647+0000 7f0f55d9b700 1 -- 172.21.15.26:0/1333835657 >> v1:172.21.15.26:6789/0 conn(0x7f0f58133fa0 legacy=0x7f0f5813ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:41.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.647+0000 7f0f55d9b700 1 -- 172.21.15.26:0/1333835657 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f580a1fe0 con 0x7f0f580a1340 2023-10-01T07:56:41.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.647+0000 7f0f55d9b700 1 --2- 172.21.15.26:0/1333835657 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f580a1340 0x7f0f58133a60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c0098f0 tx=0x7f0f4c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a3bd65cb3fff7a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:41.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.648+0000 7f0f5559a700 1 -- 172.21.15.26:0/1333835657 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c011830 con 0x7f0f580a1340 2023-10-01T07:56:41.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.648+0000 7f0f5559a700 1 -- 172.21.15.26:0/1333835657 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4c011990 con 0x7f0f580a1340 2023-10-01T07:56:41.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.648+0000 7f0f5559a700 1 -- 172.21.15.26:0/1333835657 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c011d20 con 0x7f0f580a1340 2023-10-01T07:56:41.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.648+0000 7f0f5c980700 1 -- 172.21.15.26:0/1333835657 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f580a1340 msgr2=0x7f0f58133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:41.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.648+0000 7f0f5c980700 1 --2- 172.21.15.26:0/1333835657 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f580a1340 0x7f0f58133a60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c0098f0 tx=0x7f0f4c009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:41.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.649+0000 7f0f5c980700 1 -- 172.21.15.26:0/1333835657 shutdown_connections 2023-10-01T07:56:41.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.649+0000 7f0f5c980700 1 --2- 172.21.15.26:0/1333835657 >> v2:172.21.15.26:3300/0 conn(0x7f0f580a0a30 0x7f0f580a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.649+0000 7f0f5c980700 1 --2- 172.21.15.26:0/1333835657 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f580a1340 0x7f0f58133a60 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.649+0000 7f0f5c980700 1 -- 172.21.15.26:0/1333835657 >> 172.21.15.26:0/1333835657 conn(0x7f0f580a6550 msgr2=0x7f0f580a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:41.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.649+0000 7f0f5c980700 1 -- 172.21.15.26:0/1333835657 shutdown_connections 2023-10-01T07:56:41.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.649+0000 7f0f5c980700 1 -- 172.21.15.26:0/1333835657 wait complete. 2023-10-01T07:56:41.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.650+0000 7f0f5c980700 1 Processor -- start 2023-10-01T07:56:41.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.650+0000 7f0f5c980700 1 -- start start 2023-10-01T07:56:41.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.650+0000 7f0f5c980700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f580a0a30 0x7f0f5811e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:41.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.650+0000 7f0f5c980700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f580a1340 0x7f0f5811ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:41.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.650+0000 7f0f5c980700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f58133fa0 0x7f0f5811f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:41.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.650+0000 7f0f5c980700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f58120b70 con 0x7f0f580a0a30 2023-10-01T07:56:41.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.650+0000 7f0f5c980700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f58120420 con 0x7f0f580a1340 2023-10-01T07:56:41.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.650+0000 7f0f5c980700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f580a3850 con 0x7f0f58133fa0 2023-10-01T07:56:41.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.651+0000 7f0f55d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f580a1340 0x7f0f5811ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:41.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.651+0000 7f0f5659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f580a0a30 0x7f0f5811e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:41.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.651+0000 7f0f55d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f580a1340 0x7f0f5811ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44618/0 (socket says 172.21.15.26:44618) 2023-10-01T07:56:41.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.651+0000 7f0f5659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f580a0a30 0x7f0f5811e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57022/0 (socket says 172.21.15.26:57022) 2023-10-01T07:56:41.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.651+0000 7f0f55d9b700 1 -- 172.21.15.26:0/3879763379 learned_addr learned my addr 172.21.15.26:0/3879763379 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:41.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.651+0000 7f0f56d9d700 1 --2- 172.21.15.26:0/3879763379 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f58133fa0 0x7f0f5811f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:41.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.651+0000 7f0f55d9b700 1 -- 172.21.15.26:0/3879763379 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f58133fa0 msgr2=0x7f0f5811f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:41.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.651+0000 7f0f55d9b700 1 --2- 172.21.15.26:0/3879763379 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f58133fa0 0x7f0f5811f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.651+0000 7f0f55d9b700 1 -- 172.21.15.26:0/3879763379 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f580a0a30 msgr2=0x7f0f5811e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:41.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.651+0000 7f0f55d9b700 1 --2- 172.21.15.26:0/3879763379 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f580a0a30 0x7f0f5811e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.651+0000 7f0f55d9b700 1 -- 172.21.15.26:0/3879763379 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4c009550 con 0x7f0f580a1340 2023-10-01T07:56:41.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.651+0000 7f0f5659c700 1 --2- 172.21.15.26:0/3879763379 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f580a0a30 0x7f0f5811e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:41.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.651+0000 7f0f55d9b700 1 --2- 172.21.15.26:0/3879763379 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f580a1340 0x7f0f5811ed20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c000c00 tx=0x7f0f4c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:41.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.651+0000 7f0f46ffd700 1 -- 172.21.15.26:0/3879763379 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c004400 con 0x7f0f580a1340 2023-10-01T07:56:41.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.652+0000 7f0f46ffd700 1 -- 172.21.15.26:0/3879763379 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4c01f070 con 0x7f0f580a1340 2023-10-01T07:56:41.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.652+0000 7f0f5c980700 1 -- 172.21.15.26:0/3879763379 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f580a0220 con 0x7f0f580a1340 2023-10-01T07:56:41.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.652+0000 7f0f46ffd700 1 -- 172.21.15.26:0/3879763379 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c0038e0 con 0x7f0f580a1340 2023-10-01T07:56:41.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.652+0000 7f0f5c980700 1 -- 172.21.15.26:0/3879763379 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f581331b0 con 0x7f0f580a1340 2023-10-01T07:56:41.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.653+0000 7f0f46ffd700 1 -- 172.21.15.26:0/3879763379 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f4c021030 con 0x7f0f580a1340 2023-10-01T07:56:41.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.653+0000 7f0f5c980700 1 -- 172.21.15.26:0/3879763379 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f58074ea0 con 0x7f0f580a1340 2023-10-01T07:56:41.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.653+0000 7f0f46ffd700 1 -- 172.21.15.26:0/3879763379 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0f4c0408c0 con 0x7f0f580a1340 2023-10-01T07:56:41.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.658+0000 7f0f46ffd700 1 -- 172.21.15.26:0/3879763379 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f4c015080 con 0x7f0f580a1340 2023-10-01T07:56:41.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.693+0000 7f1b15f43700 1 Processor -- start 2023-10-01T07:56:41.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.693+0000 7f1b15f43700 1 -- start start 2023-10-01T07:56:41.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.694+0000 7f1b15f43700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b1009d630 0x7f1b100a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:41.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.694+0000 7f1b15f43700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b10138d80 0x7f1b1013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:41.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.694+0000 7f1b15f43700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b100a2a70 con 0x7f1b100a0a30 2023-10-01T07:56:41.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.694+0000 7f1b15f43700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b100a01d0 con 0x7f1b1009d630 2023-10-01T07:56:41.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.694+0000 7f1b15f43700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1009e2b0 con 0x7f1b10138d80 2023-10-01T07:56:41.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.694+0000 7f1b0effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b1009d630 0x7f1b100a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:41.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.694+0000 7f1b0effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b1009d630 0x7f1b100a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44628/0 (socket says 172.21.15.26:44628) 2023-10-01T07:56:41.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.694+0000 7f1b0effd700 1 -- 172.21.15.26:0/3020798274 learned_addr learned my addr 172.21.15.26:0/3020798274 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:41.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.694+0000 7f1b0ffff700 1 --2- 172.21.15.26:0/3020798274 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b10138d80 0x7f1b1013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:41.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.694+0000 7f1b0ffff700 1 -- 172.21.15.26:0/3020798274 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b1009d630 msgr2=0x7f1b100a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:41.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.694+0000 7f1b0ffff700 1 --2- 172.21.15.26:0/3020798274 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b1009d630 0x7f1b100a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.694+0000 7f1b0ffff700 1 -- 172.21.15.26:0/3020798274 >> v1:172.21.15.26:6789/0 conn(0x7f1b100a0a30 legacy=0x7f1b100a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:41.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.694+0000 7f1b0ffff700 1 -- 172.21.15.26:0/3020798274 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b1009dc50 con 0x7f1b10138d80 2023-10-01T07:56:41.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.694+0000 7f1b0e7fc700 1 -- 172.21.15.26:0/3020798274 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4238740711 0 0) 0x7f1b100a2a70 con 0x7f1b100a0a30 2023-10-01T07:56:41.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.694+0000 7f1b0effd700 1 --2- 172.21.15.26:0/3020798274 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b1009d630 0x7f1b100a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:41.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.695+0000 7f1b0ffff700 1 --2- 172.21.15.26:0/3020798274 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b10138d80 0x7f1b1013b160 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1b08009dc0 tx=0x7f1b0800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ca8f2dafd1e0c6b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:41.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.695+0000 7f1b0e7fc700 1 -- 172.21.15.26:0/3020798274 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0800e070 con 0x7f1b10138d80 2023-10-01T07:56:41.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.695+0000 7f1b0e7fc700 1 -- 172.21.15.26:0/3020798274 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0800bb20 con 0x7f1b10138d80 2023-10-01T07:56:41.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.695+0000 7f1b0e7fc700 1 -- 172.21.15.26:0/3020798274 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b08012430 con 0x7f1b10138d80 2023-10-01T07:56:41.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.696+0000 7f1b15f43700 1 -- 172.21.15.26:0/3020798274 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b10138d80 msgr2=0x7f1b1013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:41.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.696+0000 7f1b15f43700 1 --2- 172.21.15.26:0/3020798274 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b10138d80 0x7f1b1013b160 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1b08009dc0 tx=0x7f1b0800b330 comp rx=0 tx=0).stop 2023-10-01T07:56:41.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.696+0000 7f1b15f43700 1 -- 172.21.15.26:0/3020798274 shutdown_connections 2023-10-01T07:56:41.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.696+0000 7f1b15f43700 1 --2- 172.21.15.26:0/3020798274 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b10138d80 0x7f1b1013b160 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.696+0000 7f1b15f43700 1 --2- 172.21.15.26:0/3020798274 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b1009d630 0x7f1b100a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.696+0000 7f1b15f43700 1 -- 172.21.15.26:0/3020798274 >> 172.21.15.26:0/3020798274 conn(0x7f1b100a3050 msgr2=0x7f1b100a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:41.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.696+0000 7f1b15f43700 1 -- 172.21.15.26:0/3020798274 shutdown_connections 2023-10-01T07:56:41.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.696+0000 7f1b15f43700 1 -- 172.21.15.26:0/3020798274 wait complete. 2023-10-01T07:56:41.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.697+0000 7f1b15f43700 1 Processor -- start 2023-10-01T07:56:41.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.697+0000 7f1b15f43700 1 -- start start 2023-10-01T07:56:41.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.697+0000 7f1b15f43700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b1009d630 0x7f1b10133770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:41.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.697+0000 7f1b15f43700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b100a0a30 0x7f1b10133cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:41.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.697+0000 7f1b15f43700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b10138d80 0x7f1b101341f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:41.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.697+0000 7f1b15f43700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b10134c40 con 0x7f1b100a0a30 2023-10-01T07:56:41.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.697+0000 7f1b15f43700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b101361b0 con 0x7f1b1009d630 2023-10-01T07:56:41.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.697+0000 7f1b15f43700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b10136ed0 con 0x7f1b10138d80 2023-10-01T07:56:41.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.698+0000 7f1b0effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b100a0a30 0x7f1b10133cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:41.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.698+0000 7f1b0effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b100a0a30 0x7f1b10133cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57026/0 (socket says 172.21.15.26:57026) 2023-10-01T07:56:41.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.698+0000 7f1b0effd700 1 -- 172.21.15.26:0/3962438692 learned_addr learned my addr 172.21.15.26:0/3962438692 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:41.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.698+0000 7f1b0ffff700 1 --2- 172.21.15.26:0/3962438692 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b10138d80 0x7f1b101341f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:41.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.698+0000 7f1b0f7fe700 1 --2- 172.21.15.26:0/3962438692 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b1009d630 0x7f1b10133770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:41.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.698+0000 7f1b0effd700 1 -- 172.21.15.26:0/3962438692 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b10138d80 msgr2=0x7f1b101341f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:41.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.698+0000 7f1b0effd700 1 --2- 172.21.15.26:0/3962438692 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b10138d80 0x7f1b101341f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.698+0000 7f1b0effd700 1 -- 172.21.15.26:0/3962438692 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b1009d630 msgr2=0x7f1b10133770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:41.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.698+0000 7f1b0effd700 1 --2- 172.21.15.26:0/3962438692 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b1009d630 0x7f1b10133770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.698+0000 7f1b0effd700 1 -- 172.21.15.26:0/3962438692 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b04009550 con 0x7f1b100a0a30 2023-10-01T07:56:41.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.698+0000 7f1b0ffff700 1 --2- 172.21.15.26:0/3962438692 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b10138d80 0x7f1b101341f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:41.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.698+0000 7f1b0f7fe700 1 --2- 172.21.15.26:0/3962438692 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b1009d630 0x7f1b10133770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:41.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.698+0000 7f1b0effd700 1 --2- 172.21.15.26:0/3962438692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b100a0a30 0x7f1b10133cb0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400ebe0 tx=0x7f1b0400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:41.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.699+0000 7f1af7fff700 1 -- 172.21.15.26:0/3962438692 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0400c7f0 con 0x7f1b100a0a30 2023-10-01T07:56:41.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.699+0000 7f1af7fff700 1 -- 172.21.15.26:0/3962438692 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0400c950 con 0x7f1b100a0a30 2023-10-01T07:56:41.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.699+0000 7f1b15f43700 1 -- 172.21.15.26:0/3962438692 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b08009a70 con 0x7f1b100a0a30 2023-10-01T07:56:41.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.699+0000 7f1af7fff700 1 -- 172.21.15.26:0/3962438692 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0400cce0 con 0x7f1b100a0a30 2023-10-01T07:56:41.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.699+0000 7f1b15f43700 1 -- 172.21.15.26:0/3962438692 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b100a0410 con 0x7f1b100a0a30 2023-10-01T07:56:41.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.700+0000 7f1af7fff700 1 -- 172.21.15.26:0/3962438692 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1b04013470 con 0x7f1b100a0a30 2023-10-01T07:56:41.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.700+0000 7f1af7fff700 1 -- 172.21.15.26:0/3962438692 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1b0403fc30 con 0x7f1b100a0a30 2023-10-01T07:56:41.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.700+0000 7f1b15f43700 1 -- 172.21.15.26:0/3962438692 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b100747f0 con 0x7f1b100a0a30 2023-10-01T07:56:41.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.710+0000 7f1af7fff700 1 -- 172.21.15.26:0/3962438692 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1b04013720 con 0x7f1b100a0a30 2023-10-01T07:56:41.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.736+0000 7f034d37e700 1 Processor -- start 2023-10-01T07:56:41.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.736+0000 7f034d37e700 1 -- start start 2023-10-01T07:56:41.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.737+0000 7f034d37e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f034809d630 0x7f03480a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:41.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.737+0000 7f034d37e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0348138d80 0x7f034813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:41.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.737+0000 7f034d37e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03480a2a70 con 0x7f03480a0a30 2023-10-01T07:56:41.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.737+0000 7f034d37e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03480a01d0 con 0x7f0348138d80 2023-10-01T07:56:41.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.737+0000 7f034d37e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f034809e2b0 con 0x7f034809d630 2023-10-01T07:56:41.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.737+0000 7f0346ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f03480a0a30 0x7f03480a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:50062/0 (socket says 172.21.15.26:50062) 2023-10-01T07:56:41.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.737+0000 7f0346ffd700 1 -- 172.21.15.26:0/242946257 learned_addr learned my addr 172.21.15.26:0/242946257 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:41.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.737+0000 7f03477fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0348138d80 0x7f034813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:41.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.737+0000 7f033ffff700 1 --2- 172.21.15.26:0/242946257 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f034809d630 0x7f03480a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:41.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.738+0000 7f03477fe700 1 -- 172.21.15.26:0/242946257 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f034809d630 msgr2=0x7f03480a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:41.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.738+0000 7f03477fe700 1 --2- 172.21.15.26:0/242946257 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f034809d630 0x7f03480a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.738+0000 7f03477fe700 1 -- 172.21.15.26:0/242946257 >> v1:172.21.15.26:6789/0 conn(0x7f03480a0a30 legacy=0x7f03480a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:41.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.738+0000 7f03477fe700 1 -- 172.21.15.26:0/242946257 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f034809dc50 con 0x7f0348138d80 2023-10-01T07:56:41.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.738+0000 7f033ffff700 1 --2- 172.21.15.26:0/242946257 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f034809d630 0x7f03480a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:41.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.738+0000 7f03467fc700 1 -- 172.21.15.26:0/242946257 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1868229479 0 0) 0x7f03480a2a70 con 0x7f03480a0a30 2023-10-01T07:56:41.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.738+0000 7f03477fe700 1 --2- 172.21.15.26:0/242946257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0348138d80 0x7f034813b160 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f0340009d90 tx=0x7f034000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa7e8eed0bbb5395 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:41.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.738+0000 7f03467fc700 1 -- 172.21.15.26:0/242946257 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034000e070 con 0x7f0348138d80 2023-10-01T07:56:41.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.738+0000 7f03467fc700 1 -- 172.21.15.26:0/242946257 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034000bb20 con 0x7f0348138d80 2023-10-01T07:56:41.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.738+0000 7f03467fc700 1 -- 172.21.15.26:0/242946257 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0340012430 con 0x7f0348138d80 2023-10-01T07:56:41.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.739+0000 7f034d37e700 1 -- 172.21.15.26:0/242946257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0348138d80 msgr2=0x7f034813b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:41.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.739+0000 7f034d37e700 1 --2- 172.21.15.26:0/242946257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0348138d80 0x7f034813b160 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f0340009d90 tx=0x7f034000b330 comp rx=0 tx=0).stop 2023-10-01T07:56:41.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.739+0000 7f034d37e700 1 -- 172.21.15.26:0/242946257 shutdown_connections 2023-10-01T07:56:41.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.739+0000 7f034d37e700 1 --2- 172.21.15.26:0/242946257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0348138d80 0x7f034813b160 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.739+0000 7f034d37e700 1 --2- 172.21.15.26:0/242946257 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f034809d630 0x7f03480a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.739+0000 7f034d37e700 1 -- 172.21.15.26:0/242946257 >> 172.21.15.26:0/242946257 conn(0x7f03480a3050 msgr2=0x7f03480a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:41.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.739+0000 7f034d37e700 1 -- 172.21.15.26:0/242946257 shutdown_connections 2023-10-01T07:56:41.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.739+0000 7f034d37e700 1 -- 172.21.15.26:0/242946257 wait complete. 2023-10-01T07:56:41.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.741+0000 7f034d37e700 1 Processor -- start 2023-10-01T07:56:41.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.741+0000 7f034d37e700 1 -- start start 2023-10-01T07:56:41.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.741+0000 7f034d37e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f034809d630 0x7f034812c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:41.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.741+0000 7f034d37e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03480a0a30 0x7f034812cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:41.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.741+0000 7f034d37e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0348138d80 0x7f034812cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:41.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.741+0000 7f034d37e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0348130190 con 0x7f034809d630 2023-10-01T07:56:41.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.741+0000 7f034d37e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f034812fc10 con 0x7f0348138d80 2023-10-01T07:56:41.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.741+0000 7f034d37e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03480a0410 con 0x7f03480a0a30 2023-10-01T07:56:41.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.742+0000 7f0346ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f034809d630 0x7f034812c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:41.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.742+0000 7f0346ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f034809d630 0x7f034812c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57054/0 (socket says 172.21.15.26:57054) 2023-10-01T07:56:41.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.742+0000 7f0346ffd700 1 -- 172.21.15.26:0/612788124 learned_addr learned my addr 172.21.15.26:0/612788124 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:41.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.742+0000 7f03477fe700 1 --2- 172.21.15.26:0/612788124 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0348138d80 0x7f034812cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:41.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.742+0000 7f033ffff700 1 --2- 172.21.15.26:0/612788124 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03480a0a30 0x7f034812cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:41.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.742+0000 7f0346ffd700 1 -- 172.21.15.26:0/612788124 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03480a0a30 msgr2=0x7f034812cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:41.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.742+0000 7f0346ffd700 1 --2- 172.21.15.26:0/612788124 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03480a0a30 0x7f034812cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.742+0000 7f0346ffd700 1 -- 172.21.15.26:0/612788124 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0348138d80 msgr2=0x7f034812cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:41.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.742+0000 7f0346ffd700 1 --2- 172.21.15.26:0/612788124 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0348138d80 0x7f034812cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.742+0000 7f0346ffd700 1 -- 172.21.15.26:0/612788124 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03300094a0 con 0x7f034809d630 2023-10-01T07:56:41.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.742+0000 7f0346ffd700 1 --2- 172.21.15.26:0/612788124 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f034809d630 0x7f034812c570 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f033800c520 tx=0x7f033800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:41.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.742+0000 7f033f7fe700 1 -- 172.21.15.26:0/612788124 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0338004c80 con 0x7f034809d630 2023-10-01T07:56:41.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.742+0000 7f033f7fe700 1 -- 172.21.15.26:0/612788124 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0338004de0 con 0x7f034809d630 2023-10-01T07:56:41.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.742+0000 7f034d37e700 1 -- 172.21.15.26:0/612788124 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0340009a70 con 0x7f034809d630 2023-10-01T07:56:41.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.742+0000 7f033f7fe700 1 -- 172.21.15.26:0/612788124 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0338007310 con 0x7f034809d630 2023-10-01T07:56:41.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.742+0000 7f034d37e700 1 -- 172.21.15.26:0/612788124 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f034812e5a0 con 0x7f034809d630 2023-10-01T07:56:41.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.743+0000 7f033f7fe700 1 -- 172.21.15.26:0/612788124 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0338007470 con 0x7f034809d630 2023-10-01T07:56:41.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.743+0000 7f033f7fe700 1 -- 172.21.15.26:0/612788124 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f033803f3b0 con 0x7f034809d630 2023-10-01T07:56:41.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.744+0000 7f034d37e700 1 -- 172.21.15.26:0/612788124 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03480a4a70 con 0x7f034809d630 2023-10-01T07:56:41.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.749+0000 7f033f7fe700 1 -- 172.21.15.26:0/612788124 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f03380123b0 con 0x7f034809d630 2023-10-01T07:56:41.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.892+0000 7f0f5c980700 1 -- 172.21.15.26:0/3879763379 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0f580a28e0 con 0x7f0f580a1340 2023-10-01T07:56:41.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.893+0000 7f0f46ffd700 1 -- 172.21.15.26:0/3879763379 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0f4c0199a0 con 0x7f0f580a1340 2023-10-01T07:56:41.893 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:41.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.895+0000 7f0f5c980700 1 -- 172.21.15.26:0/3879763379 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f580a1340 msgr2=0x7f0f5811ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:41.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.895+0000 7f0f5c980700 1 --2- 172.21.15.26:0/3879763379 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f580a1340 0x7f0f5811ed20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c000c00 tx=0x7f0f4c004750 comp rx=0 tx=0).stop 2023-10-01T07:56:41.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.895+0000 7f0f5c980700 1 -- 172.21.15.26:0/3879763379 shutdown_connections 2023-10-01T07:56:41.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.895+0000 7f0f5c980700 1 --2- 172.21.15.26:0/3879763379 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f58133fa0 0x7f0f5811f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.895+0000 7f0f5c980700 1 --2- 172.21.15.26:0/3879763379 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f580a0a30 0x7f0f5811e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.895+0000 7f0f5c980700 1 --2- 172.21.15.26:0/3879763379 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f580a1340 0x7f0f5811ed20 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.895+0000 7f0f5c980700 1 -- 172.21.15.26:0/3879763379 >> 172.21.15.26:0/3879763379 conn(0x7f0f580a6550 msgr2=0x7f0f580a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:41.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.895+0000 7f0f5c980700 1 -- 172.21.15.26:0/3879763379 shutdown_connections 2023-10-01T07:56:41.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.895+0000 7f0f5c980700 1 -- 172.21.15.26:0/3879763379 wait complete. 2023-10-01T07:56:41.910 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:41.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.922+0000 7f1b15f43700 1 -- 172.21.15.26:0/3962438692 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1b10136b70 con 0x7f1b100a0a30 2023-10-01T07:56:41.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.922+0000 7f1af7fff700 1 -- 172.21.15.26:0/3962438692 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1b04011960 con 0x7f1b100a0a30 2023-10-01T07:56:41.923 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:41.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.925+0000 7f1b15f43700 1 -- 172.21.15.26:0/3962438692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b100a0a30 msgr2=0x7f1b10133cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:41.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.925+0000 7f1b15f43700 1 --2- 172.21.15.26:0/3962438692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b100a0a30 0x7f1b10133cb0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400ebe0 tx=0x7f1b0400eef0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.925+0000 7f1b15f43700 1 -- 172.21.15.26:0/3962438692 shutdown_connections 2023-10-01T07:56:41.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.925+0000 7f1b15f43700 1 --2- 172.21.15.26:0/3962438692 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b10138d80 0x7f1b101341f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.925+0000 7f1b15f43700 1 --2- 172.21.15.26:0/3962438692 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b1009d630 0x7f1b10133770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.925+0000 7f1b15f43700 1 --2- 172.21.15.26:0/3962438692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b100a0a30 0x7f1b10133cb0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.925+0000 7f1b15f43700 1 -- 172.21.15.26:0/3962438692 >> 172.21.15.26:0/3962438692 conn(0x7f1b100a3050 msgr2=0x7f1b100a4180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:41.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.925+0000 7f1b15f43700 1 -- 172.21.15.26:0/3962438692 shutdown_connections 2023-10-01T07:56:41.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.925+0000 7f1b15f43700 1 -- 172.21.15.26:0/3962438692 wait complete. 2023-10-01T07:56:41.939 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:41.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.973+0000 7f034d37e700 1 -- 172.21.15.26:0/612788124 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f03480747f0 con 0x7f034809d630 2023-10-01T07:56:41.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.973+0000 7f033f7fe700 1 -- 172.21.15.26:0/612788124 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0338008040 con 0x7f034809d630 2023-10-01T07:56:41.974 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:41.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.975+0000 7f034d37e700 1 -- 172.21.15.26:0/612788124 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f034809d630 msgr2=0x7f034812c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:41.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.975+0000 7f034d37e700 1 --2- 172.21.15.26:0/612788124 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f034809d630 0x7f034812c570 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f033800c520 tx=0x7f033800c830 comp rx=0 tx=0).stop 2023-10-01T07:56:41.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.975+0000 7f034d37e700 1 -- 172.21.15.26:0/612788124 shutdown_connections 2023-10-01T07:56:41.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.975+0000 7f034d37e700 1 --2- 172.21.15.26:0/612788124 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0348138d80 0x7f034812cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.975+0000 7f034d37e700 1 --2- 172.21.15.26:0/612788124 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f034809d630 0x7f034812c570 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.975+0000 7f034d37e700 1 --2- 172.21.15.26:0/612788124 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03480a0a30 0x7f034812cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:41.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.975+0000 7f034d37e700 1 -- 172.21.15.26:0/612788124 >> 172.21.15.26:0/612788124 conn(0x7f03480a3050 msgr2=0x7f034809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:41.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.976+0000 7f034d37e700 1 -- 172.21.15.26:0/612788124 shutdown_connections 2023-10-01T07:56:41.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:41.976+0000 7f034d37e700 1 -- 172.21.15.26:0/612788124 wait complete. 2023-10-01T07:56:41.990 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:42.623 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:42.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.768+0000 7f815c87b700 1 Processor -- start 2023-10-01T07:56:42.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.768+0000 7f815c87b700 1 -- start start 2023-10-01T07:56:42.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.769+0000 7f815c87b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f81581338c0 0x7f8158133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:42.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.769+0000 7f815c87b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f815809e560 0x7f815813b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:42.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.769+0000 7f815c87b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f815806f720 con 0x7f81581341d0 2023-10-01T07:56:42.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.769+0000 7f815c87b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8158070c80 con 0x7f81581338c0 2023-10-01T07:56:42.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.769+0000 7f815c87b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f815806fce0 con 0x7f815809e560 2023-10-01T07:56:42.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.769+0000 7f8156d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f815809e560 0x7f815813b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:42.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.769+0000 7f815659c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f81581338c0 0x7f8158133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:42.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.769+0000 7f815659c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f81581338c0 0x7f8158133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57056/0 (socket says 172.21.15.26:57056) 2023-10-01T07:56:42.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.769+0000 7f8156d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f815809e560 0x7f815813b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35500/0 (socket says 172.21.15.26:35500) 2023-10-01T07:56:42.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.769+0000 7f815659c700 1 -- 172.21.15.26:0/3537750223 learned_addr learned my addr 172.21.15.26:0/3537750223 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:42.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.769+0000 7f8156d9d700 1 -- 172.21.15.26:0/3537750223 >> v2:172.21.15.26:3300/0 conn(0x7f81581338c0 msgr2=0x7f8158133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:42.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.769+0000 7f8156d9d700 1 --2- 172.21.15.26:0/3537750223 >> v2:172.21.15.26:3300/0 conn(0x7f81581338c0 0x7f8158133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:42.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.769+0000 7f8156d9d700 1 -- 172.21.15.26:0/3537750223 >> v1:172.21.15.26:6789/0 conn(0x7f81581341d0 legacy=0x7f815809de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:42.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.769+0000 7f8156d9d700 1 -- 172.21.15.26:0/3537750223 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81581336a0 con 0x7f815809e560 2023-10-01T07:56:42.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.769+0000 7f815659c700 1 --2- 172.21.15.26:0/3537750223 >> v2:172.21.15.26:3300/0 conn(0x7f81581338c0 0x7f8158133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:42.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.769+0000 7f8156d9d700 1 --2- 172.21.15.26:0/3537750223 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f815809e560 0x7f815813b860 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8150009d90 tx=0x7f815000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4b3a43428f6d993 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:42.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.770+0000 7f815559a700 1 -- 172.21.15.26:0/3537750223 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815000e070 con 0x7f815809e560 2023-10-01T07:56:42.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.770+0000 7f815559a700 1 -- 172.21.15.26:0/3537750223 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f815000bb20 con 0x7f815809e560 2023-10-01T07:56:42.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.770+0000 7f815559a700 1 -- 172.21.15.26:0/3537750223 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8150012430 con 0x7f815809e560 2023-10-01T07:56:42.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.770+0000 7f815c87b700 1 -- 172.21.15.26:0/3537750223 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f815809e560 msgr2=0x7f815813b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:42.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.770+0000 7f815c87b700 1 --2- 172.21.15.26:0/3537750223 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f815809e560 0x7f815813b860 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8150009d90 tx=0x7f815000b330 comp rx=0 tx=0).stop 2023-10-01T07:56:42.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.770+0000 7f815c87b700 1 -- 172.21.15.26:0/3537750223 shutdown_connections 2023-10-01T07:56:42.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.770+0000 7f815c87b700 1 --2- 172.21.15.26:0/3537750223 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f815809e560 0x7f815813b860 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:42.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.770+0000 7f815c87b700 1 --2- 172.21.15.26:0/3537750223 >> v2:172.21.15.26:3300/0 conn(0x7f81581338c0 0x7f8158133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:42.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.770+0000 7f815c87b700 1 -- 172.21.15.26:0/3537750223 >> 172.21.15.26:0/3537750223 conn(0x7f81580a2aa0 msgr2=0x7f81580a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:42.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.770+0000 7f815c87b700 1 -- 172.21.15.26:0/3537750223 shutdown_connections 2023-10-01T07:56:42.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.770+0000 7f815c87b700 1 -- 172.21.15.26:0/3537750223 wait complete. 2023-10-01T07:56:42.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.771+0000 7f815c87b700 1 Processor -- start 2023-10-01T07:56:42.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.772+0000 7f815c87b700 1 -- start start 2023-10-01T07:56:42.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.772+0000 7f815c87b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f815809e560 0x7f815811c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:42.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.772+0000 7f815c87b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81581338c0 0x7f815811ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:42.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.772+0000 7f815c87b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81581341d0 0x7f815811d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:42.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.772+0000 7f815c87b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815812ddb0 con 0x7f81581341d0 2023-10-01T07:56:42.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.772+0000 7f815c87b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8158120110 con 0x7f81581338c0 2023-10-01T07:56:42.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.772+0000 7f815c87b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f815806f960 con 0x7f815809e560 2023-10-01T07:56:42.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.772+0000 7f8156d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81581341d0 0x7f815811d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:42.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.772+0000 7f8155d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81581338c0 0x7f815811ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:42.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.772+0000 7f815659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f815809e560 0x7f815811c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:42.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.772+0000 7f8156d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81581341d0 0x7f815811d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57066/0 (socket says 172.21.15.26:57066) 2023-10-01T07:56:42.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.772+0000 7f8156d9d700 1 -- 172.21.15.26:0/2084105055 learned_addr learned my addr 172.21.15.26:0/2084105055 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:42.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.772+0000 7f8155d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81581338c0 0x7f815811ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44650/0 (socket says 172.21.15.26:44650) 2023-10-01T07:56:42.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.772+0000 7f8156d9d700 1 -- 172.21.15.26:0/2084105055 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f815809e560 msgr2=0x7f815811c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:42.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.772+0000 7f8156d9d700 1 --2- 172.21.15.26:0/2084105055 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f815809e560 0x7f815811c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:42.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.772+0000 7f8156d9d700 1 -- 172.21.15.26:0/2084105055 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81581338c0 msgr2=0x7f815811ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:42.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.772+0000 7f8156d9d700 1 --2- 172.21.15.26:0/2084105055 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81581338c0 0x7f815811ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:42.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.772+0000 7f8156d9d700 1 -- 172.21.15.26:0/2084105055 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8148009550 con 0x7f81581341d0 2023-10-01T07:56:42.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.772+0000 7f8155d9b700 1 --2- 172.21.15.26:0/2084105055 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81581338c0 0x7f815811ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:42.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.773+0000 7f8156d9d700 1 --2- 172.21.15.26:0/2084105055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81581341d0 0x7f815811d350 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f815806fe20 tx=0x7f8150004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:42.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.773+0000 7f814effd700 1 -- 172.21.15.26:0/2084105055 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8150012430 con 0x7f81581341d0 2023-10-01T07:56:42.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.773+0000 7f814effd700 1 -- 172.21.15.26:0/2084105055 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8150020070 con 0x7f81581341d0 2023-10-01T07:56:42.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.773+0000 7f815c87b700 1 -- 172.21.15.26:0/2084105055 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8150009a70 con 0x7f81581341d0 2023-10-01T07:56:42.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.773+0000 7f814effd700 1 -- 172.21.15.26:0/2084105055 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8150003ea0 con 0x7f81581341d0 2023-10-01T07:56:42.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.773+0000 7f815c87b700 1 -- 172.21.15.26:0/2084105055 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8158120b80 con 0x7f81581341d0 2023-10-01T07:56:42.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.774+0000 7f814effd700 1 -- 172.21.15.26:0/2084105055 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8150004040 con 0x7f81581341d0 2023-10-01T07:56:42.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.774+0000 7f814effd700 1 -- 172.21.15.26:0/2084105055 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8150022070 con 0x7f81581341d0 2023-10-01T07:56:42.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.774+0000 7f815c87b700 1 -- 172.21.15.26:0/2084105055 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8158074ea0 con 0x7f81581341d0 2023-10-01T07:56:42.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.779+0000 7f814effd700 1 -- 172.21.15.26:0/2084105055 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f81500044d0 con 0x7f81581341d0 2023-10-01T07:56:42.911 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:42.940 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:42.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.982+0000 7f815c87b700 1 -- 172.21.15.26:0/2084105055 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f815806b9e0 con 0x7f81581341d0 2023-10-01T07:56:42.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.982+0000 7f814effd700 1 -- 172.21.15.26:0/2084105055 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8150011390 con 0x7f81581341d0 2023-10-01T07:56:42.983 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:42.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.985+0000 7f815c87b700 1 -- 172.21.15.26:0/2084105055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81581341d0 msgr2=0x7f815811d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:42.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.985+0000 7f815c87b700 1 --2- 172.21.15.26:0/2084105055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81581341d0 0x7f815811d350 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f815806fe20 tx=0x7f8150004ad0 comp rx=0 tx=0).stop 2023-10-01T07:56:42.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.985+0000 7f815c87b700 1 -- 172.21.15.26:0/2084105055 shutdown_connections 2023-10-01T07:56:42.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.985+0000 7f815c87b700 1 --2- 172.21.15.26:0/2084105055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81581341d0 0x7f815811d350 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:42.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.985+0000 7f815c87b700 1 --2- 172.21.15.26:0/2084105055 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f815809e560 0x7f815811c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:42.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.985+0000 7f815c87b700 1 --2- 172.21.15.26:0/2084105055 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81581338c0 0x7f815811ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:42.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.985+0000 7f815c87b700 1 -- 172.21.15.26:0/2084105055 >> 172.21.15.26:0/2084105055 conn(0x7f81580a2aa0 msgr2=0x7f815809f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:42.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.985+0000 7f815c87b700 1 -- 172.21.15.26:0/2084105055 shutdown_connections 2023-10-01T07:56:42.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:42.985+0000 7f815c87b700 1 -- 172.21.15.26:0/2084105055 wait complete. 2023-10-01T07:56:42.990 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:43.000 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:43.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.058+0000 7f1fdd995700 1 Processor -- start 2023-10-01T07:56:43.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.058+0000 7f1fdd995700 1 -- start start 2023-10-01T07:56:43.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.059+0000 7f1fdd995700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1fd8130670 0x7f1fd8130a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:43.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.059+0000 7f1fdd995700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1fd806f680 0x7f1fd806fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:43.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.059+0000 7f1fdd995700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fd806ffd0 0x7f1fd8137530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:43.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.059+0000 7f1fdd995700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fd809a350 con 0x7f1fd806f680 2023-10-01T07:56:43.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.059+0000 7f1fdd995700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd8130260 con 0x7f1fd806ffd0 2023-10-01T07:56:43.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.059+0000 7f1fdd995700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd8071ff0 con 0x7f1fd8130670 2023-10-01T07:56:43.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.059+0000 7f1fd77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fd806ffd0 0x7f1fd8137530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:43.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.059+0000 7f1fd77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fd806ffd0 0x7f1fd8137530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44666/0 (socket says 172.21.15.26:44666) 2023-10-01T07:56:43.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.059+0000 7f1fd77fe700 1 -- 172.21.15.26:0/1861696815 learned_addr learned my addr 172.21.15.26:0/1861696815 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:43.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.059+0000 7f1fd77fe700 1 -- 172.21.15.26:0/1861696815 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1fd8130670 msgr2=0x7f1fd8130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:43.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.059+0000 7f1fd77fe700 1 --2- 172.21.15.26:0/1861696815 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1fd8130670 0x7f1fd8130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:43.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.059+0000 7f1fd77fe700 1 -- 172.21.15.26:0/1861696815 >> v2:172.21.15.26:3300/0 conn(0x7f1fd806f680 msgr2=0x7f1fd806fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:43.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.059+0000 7f1fd77fe700 1 --2- 172.21.15.26:0/1861696815 >> v2:172.21.15.26:3300/0 conn(0x7f1fd806f680 0x7f1fd806fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:43.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.059+0000 7f1fd77fe700 1 -- 172.21.15.26:0/1861696815 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd8070470 con 0x7f1fd806ffd0 2023-10-01T07:56:43.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.060+0000 7f1fd77fe700 1 --2- 172.21.15.26:0/1861696815 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fd806ffd0 0x7f1fd8137530 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc009920 tx=0x7f1fcc009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8db71a7fa9b417e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:43.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.060+0000 7f1fd5ffb700 1 -- 172.21.15.26:0/1861696815 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc00ba20 con 0x7f1fd806ffd0 2023-10-01T07:56:43.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.060+0000 7f1fd5ffb700 1 -- 172.21.15.26:0/1861696815 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fcc00bb80 con 0x7f1fd806ffd0 2023-10-01T07:56:43.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.060+0000 7f1fd5ffb700 1 -- 172.21.15.26:0/1861696815 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc009e70 con 0x7f1fd806ffd0 2023-10-01T07:56:43.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.061+0000 7f1fdd995700 1 -- 172.21.15.26:0/1861696815 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fd806ffd0 msgr2=0x7f1fd8137530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:43.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.061+0000 7f1fdd995700 1 --2- 172.21.15.26:0/1861696815 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fd806ffd0 0x7f1fd8137530 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc009920 tx=0x7f1fcc009c30 comp rx=0 tx=0).stop 2023-10-01T07:56:43.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.061+0000 7f1fdd995700 1 -- 172.21.15.26:0/1861696815 shutdown_connections 2023-10-01T07:56:43.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.061+0000 7f1fdd995700 1 --2- 172.21.15.26:0/1861696815 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fd806ffd0 0x7f1fd8137530 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:43.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.061+0000 7f1fdd995700 1 --2- 172.21.15.26:0/1861696815 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1fd8130670 0x7f1fd8130a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:43.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.061+0000 7f1fdd995700 1 --2- 172.21.15.26:0/1861696815 >> v2:172.21.15.26:3300/0 conn(0x7f1fd806f680 0x7f1fd806fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:43.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.061+0000 7f1fdd995700 1 -- 172.21.15.26:0/1861696815 >> 172.21.15.26:0/1861696815 conn(0x7f1fd80a2aa0 msgr2=0x7f1fd80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:43.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.061+0000 7f1fdd995700 1 -- 172.21.15.26:0/1861696815 shutdown_connections 2023-10-01T07:56:43.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.061+0000 7f1fdd995700 1 -- 172.21.15.26:0/1861696815 wait complete. 2023-10-01T07:56:43.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.062+0000 7f1fdd995700 1 Processor -- start 2023-10-01T07:56:43.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.062+0000 7f1fdd995700 1 -- start start 2023-10-01T07:56:43.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.063+0000 7f1fdd995700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fd806f680 0x7f1fd8136030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:43.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.063+0000 7f1fdd995700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1fd806ffd0 0x7f1fd8136570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:43.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.063+0000 7f1fdd995700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fd8130670 0x7f1fd8136ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:43.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.063+0000 7f1fdd995700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd8136ff0 con 0x7f1fd8130670 2023-10-01T07:56:43.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.063+0000 7f1fdd995700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd8134650 con 0x7f1fd806f680 2023-10-01T07:56:43.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.063+0000 7f1fdd995700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd8135550 con 0x7f1fd806ffd0 2023-10-01T07:56:43.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.063+0000 7f1fd6ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fd806f680 0x7f1fd8136030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:43.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.063+0000 7f1fd6ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fd806f680 0x7f1fd8136030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44672/0 (socket says 172.21.15.26:44672) 2023-10-01T07:56:43.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.063+0000 7f1fd6ffd700 1 -- 172.21.15.26:0/941252634 learned_addr learned my addr 172.21.15.26:0/941252634 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:43.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.063+0000 7f1fd67fc700 1 --2- 172.21.15.26:0/941252634 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1fd806ffd0 0x7f1fd8136570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:43.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.063+0000 7f1fd6ffd700 1 -- 172.21.15.26:0/941252634 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1fd806ffd0 msgr2=0x7f1fd8136570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:43.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.063+0000 7f1fd6ffd700 1 --2- 172.21.15.26:0/941252634 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1fd806ffd0 0x7f1fd8136570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:43.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.063+0000 7f1fd6ffd700 1 -- 172.21.15.26:0/941252634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fd8130670 msgr2=0x7f1fd8136ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:43.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.063+0000 7f1fd6ffd700 1 --2- 172.21.15.26:0/941252634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fd8130670 0x7f1fd8136ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:43.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.063+0000 7f1fd6ffd700 1 -- 172.21.15.26:0/941252634 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fcc009550 con 0x7f1fd806f680 2023-10-01T07:56:43.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.064+0000 7f1fd6ffd700 1 --2- 172.21.15.26:0/941252634 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fd806f680 0x7f1fd8136030 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1fd000ba50 tx=0x7f1fd000bd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:43.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.064+0000 7f1fbffff700 1 -- 172.21.15.26:0/941252634 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd000c9b0 con 0x7f1fd806f680 2023-10-01T07:56:43.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.064+0000 7f1fbffff700 1 -- 172.21.15.26:0/941252634 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd000cb30 con 0x7f1fd806f680 2023-10-01T07:56:43.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.064+0000 7f1fbffff700 1 -- 172.21.15.26:0/941252634 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd0014440 con 0x7f1fd806f680 2023-10-01T07:56:43.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.064+0000 7f1fdd995700 1 -- 172.21.15.26:0/941252634 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd8134eb0 con 0x7f1fd806f680 2023-10-01T07:56:43.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.064+0000 7f1fdd995700 1 -- 172.21.15.26:0/941252634 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd81341b0 con 0x7f1fd806f680 2023-10-01T07:56:43.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.065+0000 7f1fbffff700 1 -- 172.21.15.26:0/941252634 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1fd0007370 con 0x7f1fd806f680 2023-10-01T07:56:43.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.065+0000 7f1fbffff700 1 -- 172.21.15.26:0/941252634 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1fd0006e40 con 0x7f1fd806f680 2023-10-01T07:56:43.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.065+0000 7f1fdd995700 1 -- 172.21.15.26:0/941252634 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fd8074ea0 con 0x7f1fd806f680 2023-10-01T07:56:43.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.071+0000 7f1fbffff700 1 -- 172.21.15.26:0/941252634 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1fd0019080 con 0x7f1fd806f680 2023-10-01T07:56:43.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.113+0000 7fed831ca700 1 Processor -- start 2023-10-01T07:56:43.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.113+0000 7fed831ca700 1 -- start start 2023-10-01T07:56:43.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.114+0000 7fed831ca700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fed7c130670 0x7fed7c130a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:43.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.114+0000 7fed831ca700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fed7c06f680 0x7fed7c06fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:43.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.114+0000 7fed831ca700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed7c130260 con 0x7fed7c06ffd0 2023-10-01T07:56:43.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.114+0000 7fed831ca700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed7c071ff0 con 0x7fed7c130670 2023-10-01T07:56:43.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.114+0000 7fed831ca700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c09ecf0 con 0x7fed7c06f680 2023-10-01T07:56:43.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.115+0000 7fed80f66700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fed7c130670 0x7fed7c130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:43.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.115+0000 7fed7bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fed7c06f680 0x7fed7c06fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:43.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.115+0000 7fed80f66700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fed7c130670 0x7fed7c130a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57090/0 (socket says 172.21.15.26:57090) 2023-10-01T07:56:43.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.115+0000 7fed7bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fed7c06f680 0x7fed7c06fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:35520/0 (socket says 172.21.15.26:35520) 2023-10-01T07:56:43.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.115+0000 7fed80f66700 1 -- 172.21.15.26:0/261353842 learned_addr learned my addr 172.21.15.26:0/261353842 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:43.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.115+0000 7fed80f66700 1 -- 172.21.15.26:0/261353842 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fed7c06f680 msgr2=0x7fed7c06fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:43.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.115+0000 7fed80f66700 1 --2- 172.21.15.26:0/261353842 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fed7c06f680 0x7fed7c06fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:43.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.115+0000 7fed80f66700 1 -- 172.21.15.26:0/261353842 >> v1:172.21.15.26:6789/0 conn(0x7fed7c06ffd0 legacy=0x7fed7c137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:43.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.115+0000 7fed80f66700 1 -- 172.21.15.26:0/261353842 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed7c070e70 con 0x7fed7c130670 2023-10-01T07:56:43.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.115+0000 7fed7b7fe700 1 -- 172.21.15.26:0/261353842 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2763065789 0 0) 0x7fed7c130260 con 0x7fed7c06ffd0 2023-10-01T07:56:43.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.115+0000 7fed7bfff700 1 --2- 172.21.15.26:0/261353842 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fed7c06f680 0x7fed7c06fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:43.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.115+0000 7fed80f66700 1 --2- 172.21.15.26:0/261353842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed7c130670 0x7fed7c130a40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fed700098f0 tx=0x7fed70009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6044e2fc14123bd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:43.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.115+0000 7fed7b7fe700 1 -- 172.21.15.26:0/261353842 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed70011830 con 0x7fed7c130670 2023-10-01T07:56:43.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.115+0000 7fed7b7fe700 1 -- 172.21.15.26:0/261353842 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed70011990 con 0x7fed7c130670 2023-10-01T07:56:43.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.115+0000 7fed7b7fe700 1 -- 172.21.15.26:0/261353842 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed70011d20 con 0x7fed7c130670 2023-10-01T07:56:43.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.116+0000 7fed831ca700 1 -- 172.21.15.26:0/261353842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed7c130670 msgr2=0x7fed7c130a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:43.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.116+0000 7fed831ca700 1 --2- 172.21.15.26:0/261353842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed7c130670 0x7fed7c130a40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fed700098f0 tx=0x7fed70009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:43.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.116+0000 7fed831ca700 1 -- 172.21.15.26:0/261353842 shutdown_connections 2023-10-01T07:56:43.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.116+0000 7fed831ca700 1 --2- 172.21.15.26:0/261353842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed7c130670 0x7fed7c130a40 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:43.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.116+0000 7fed831ca700 1 --2- 172.21.15.26:0/261353842 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fed7c06f680 0x7fed7c06fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:43.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.116+0000 7fed831ca700 1 -- 172.21.15.26:0/261353842 >> 172.21.15.26:0/261353842 conn(0x7fed7c0a2aa0 msgr2=0x7fed7c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:43.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.116+0000 7fed831ca700 1 -- 172.21.15.26:0/261353842 shutdown_connections 2023-10-01T07:56:43.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.116+0000 7fed831ca700 1 -- 172.21.15.26:0/261353842 wait complete. 2023-10-01T07:56:43.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.118+0000 7fed831ca700 1 Processor -- start 2023-10-01T07:56:43.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.118+0000 7fed831ca700 1 -- start start 2023-10-01T07:56:43.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.119+0000 7fed831ca700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fed7c06f680 0x7fed7c1c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:43.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.119+0000 7fed831ca700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fed7c06ffd0 0x7fed7c1c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:43.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.119+0000 7fed831ca700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed7c130670 0x7fed7c1c6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:43.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.119+0000 7fed831ca700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c12ca90 con 0x7fed7c130670 2023-10-01T07:56:43.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.119+0000 7fed831ca700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c12a7e0 con 0x7fed7c06f680 2023-10-01T07:56:43.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.119+0000 7fed831ca700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c12dc20 con 0x7fed7c06ffd0 2023-10-01T07:56:43.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.119+0000 7fed81767700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed7c130670 0x7fed7c1c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:43.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.119+0000 7fed81767700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed7c130670 0x7fed7c1c6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57098/0 (socket says 172.21.15.26:57098) 2023-10-01T07:56:43.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.119+0000 7fed80f66700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fed7c06f680 0x7fed7c1c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:43.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.119+0000 7fed81767700 1 -- 172.21.15.26:0/361744962 learned_addr learned my addr 172.21.15.26:0/361744962 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:43.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.119+0000 7fed7bfff700 1 --2- 172.21.15.26:0/361744962 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fed7c06ffd0 0x7fed7c1c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:43.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.119+0000 7fed80f66700 1 -- 172.21.15.26:0/361744962 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fed7c06ffd0 msgr2=0x7fed7c1c62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:43.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.119+0000 7fed80f66700 1 --2- 172.21.15.26:0/361744962 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fed7c06ffd0 0x7fed7c1c62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:43.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.119+0000 7fed80f66700 1 -- 172.21.15.26:0/361744962 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed7c130670 msgr2=0x7fed7c1c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:43.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.119+0000 7fed80f66700 1 --2- 172.21.15.26:0/361744962 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed7c130670 0x7fed7c1c6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:43.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.119+0000 7fed80f66700 1 -- 172.21.15.26:0/361744962 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed680094a0 con 0x7fed7c06f680 2023-10-01T07:56:43.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.120+0000 7fed80f66700 1 --2- 172.21.15.26:0/361744962 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fed7c06f680 0x7fed7c1c5db0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fed70016000 tx=0x7fed70004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:43.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.120+0000 7fed797fa700 1 -- 172.21.15.26:0/361744962 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed70004510 con 0x7fed7c06f680 2023-10-01T07:56:43.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.120+0000 7fed797fa700 1 -- 172.21.15.26:0/361744962 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed700036a0 con 0x7fed7c06f680 2023-10-01T07:56:43.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.120+0000 7fed797fa700 1 -- 172.21.15.26:0/361744962 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed70003a30 con 0x7fed7c06f680 2023-10-01T07:56:43.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.120+0000 7fed831ca700 1 -- 172.21.15.26:0/361744962 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed70009550 con 0x7fed7c06f680 2023-10-01T07:56:43.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.120+0000 7fed831ca700 1 -- 172.21.15.26:0/361744962 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed7c12c760 con 0x7fed7c06f680 2023-10-01T07:56:43.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.121+0000 7fed797fa700 1 -- 172.21.15.26:0/361744962 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fed70021070 con 0x7fed7c06f680 2023-10-01T07:56:43.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.121+0000 7fed797fa700 1 -- 172.21.15.26:0/361744962 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fed70040aa0 con 0x7fed7c06f680 2023-10-01T07:56:43.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.121+0000 7fed831ca700 1 -- 172.21.15.26:0/361744962 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed7c12c8f0 con 0x7fed7c06f680 2023-10-01T07:56:43.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.126+0000 7fed797fa700 1 -- 172.21.15.26:0/361744962 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fed7c12c8f0 con 0x7fed7c06f680 2023-10-01T07:56:43.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.142+0000 7f8f2932c700 1 Processor -- start 2023-10-01T07:56:43.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.143+0000 7f8f2932c700 1 -- start start 2023-10-01T07:56:43.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.143+0000 7f8f2932c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f2409e1d0 0x7f8f24135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:43.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.143+0000 7f8f2932c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f24135e50 0x7f8f24138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:43.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.143+0000 7f8f2932c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f2409f130 con 0x7f8f2409d6f0 2023-10-01T07:56:43.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.143+0000 7f8f2932c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2409f520 con 0x7f8f2409e1d0 2023-10-01T07:56:43.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.143+0000 7f8f2932c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2409e930 con 0x7f8f24135e50 2023-10-01T07:56:43.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.143+0000 7f8f227fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f2409e1d0 0x7f8f24135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:43.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.143+0000 7f8f227fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f2409e1d0 0x7f8f24135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44686/0 (socket says 172.21.15.26:44686) 2023-10-01T07:56:43.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.143+0000 7f8f237fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f24135e50 0x7f8f24138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:43.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.143+0000 7f8f227fc700 1 -- 172.21.15.26:0/2862911101 learned_addr learned my addr 172.21.15.26:0/2862911101 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:43.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.144+0000 7f8f237fe700 1 -- 172.21.15.26:0/2862911101 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f2409e1d0 msgr2=0x7f8f24135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:43.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.144+0000 7f8f237fe700 1 --2- 172.21.15.26:0/2862911101 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f2409e1d0 0x7f8f24135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:43.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.144+0000 7f8f237fe700 1 -- 172.21.15.26:0/2862911101 >> v1:172.21.15.26:6789/0 conn(0x7f8f2409d6f0 legacy=0x7f8f2409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:43.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.144+0000 7f8f21ffb700 1 -- 172.21.15.26:0/2862911101 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3358614448 0 0) 0x7f8f2409f130 con 0x7f8f2409d6f0 2023-10-01T07:56:43.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.144+0000 7f8f237fe700 1 -- 172.21.15.26:0/2862911101 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2409b2d0 con 0x7f8f24135e50 2023-10-01T07:56:43.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.144+0000 7f8f227fc700 1 --2- 172.21.15.26:0/2862911101 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f2409e1d0 0x7f8f24135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:43.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.144+0000 7f8f237fe700 1 --2- 172.21.15.26:0/2862911101 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f24135e50 0x7f8f24138230 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c00f3a0 tx=0x7f8f1c00f6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d76341b00d64745 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:43.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.144+0000 7f8f21ffb700 1 -- 172.21.15.26:0/2862911101 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c012070 con 0x7f8f24135e50 2023-10-01T07:56:43.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.144+0000 7f8f21ffb700 1 -- 172.21.15.26:0/2862911101 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f1c00d0d0 con 0x7f8f24135e50 2023-10-01T07:56:43.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.144+0000 7f8f21ffb700 1 -- 172.21.15.26:0/2862911101 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c00fea0 con 0x7f8f24135e50 2023-10-01T07:56:43.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.145+0000 7f8f2932c700 1 -- 172.21.15.26:0/2862911101 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f24135e50 msgr2=0x7f8f24138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:43.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.145+0000 7f8f2932c700 1 --2- 172.21.15.26:0/2862911101 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f24135e50 0x7f8f24138230 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c00f3a0 tx=0x7f8f1c00f6b0 comp rx=0 tx=0).stop 2023-10-01T07:56:43.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.145+0000 7f8f2932c700 1 -- 172.21.15.26:0/2862911101 shutdown_connections 2023-10-01T07:56:43.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.145+0000 7f8f2932c700 1 --2- 172.21.15.26:0/2862911101 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f24135e50 0x7f8f24138230 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:43.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.145+0000 7f8f2932c700 1 --2- 172.21.15.26:0/2862911101 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f2409e1d0 0x7f8f24135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:43.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.145+0000 7f8f2932c700 1 -- 172.21.15.26:0/2862911101 >> 172.21.15.26:0/2862911101 conn(0x7f8f24066f50 msgr2=0x7f8f2409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:43.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.145+0000 7f8f2932c700 1 -- 172.21.15.26:0/2862911101 shutdown_connections 2023-10-01T07:56:43.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.145+0000 7f8f2932c700 1 -- 172.21.15.26:0/2862911101 wait complete. 2023-10-01T07:56:43.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.147+0000 7f8f2932c700 1 Processor -- start 2023-10-01T07:56:43.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.147+0000 7f8f2932c700 1 -- start start 2023-10-01T07:56:43.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.147+0000 7f8f2932c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f2409d6f0 0x7f8f24119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:43.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.147+0000 7f8f2932c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f2409e1d0 0x7f8f241199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:43.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.147+0000 7f8f2932c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f24135e50 0x7f8f24119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:43.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.147+0000 7f8f2932c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2411c8f0 con 0x7f8f24135e50 2023-10-01T07:56:43.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.147+0000 7f8f2932c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2412fb40 con 0x7f8f2409d6f0 2023-10-01T07:56:43.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.147+0000 7f8f2932c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f240a2020 con 0x7f8f2409e1d0 2023-10-01T07:56:43.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.148+0000 7f8f22ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f2409d6f0 0x7f8f24119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:43.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.148+0000 7f8f22ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f2409d6f0 0x7f8f24119480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44694/0 (socket says 172.21.15.26:44694) 2023-10-01T07:56:43.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.148+0000 7f8f22ffd700 1 -- 172.21.15.26:0/806662867 learned_addr learned my addr 172.21.15.26:0/806662867 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:43.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.148+0000 7f8f237fe700 1 --2- 172.21.15.26:0/806662867 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f24135e50 0x7f8f24119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:43.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.148+0000 7f8f227fc700 1 --2- 172.21.15.26:0/806662867 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f2409e1d0 0x7f8f241199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:43.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.148+0000 7f8f227fc700 1 -- 172.21.15.26:0/806662867 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f2409d6f0 msgr2=0x7f8f24119480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:43.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.148+0000 7f8f227fc700 1 --2- 172.21.15.26:0/806662867 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f2409d6f0 0x7f8f24119480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:43.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.148+0000 7f8f227fc700 1 -- 172.21.15.26:0/806662867 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f24135e50 msgr2=0x7f8f24119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:43.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.148+0000 7f8f227fc700 1 --2- 172.21.15.26:0/806662867 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f24135e50 0x7f8f24119f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:43.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.148+0000 7f8f227fc700 1 -- 172.21.15.26:0/806662867 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f1800b600 con 0x7f8f2409e1d0 2023-10-01T07:56:43.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.148+0000 7f8f22ffd700 1 --2- 172.21.15.26:0/806662867 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f2409d6f0 0x7f8f24119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:43.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.148+0000 7f8f237fe700 1 --2- 172.21.15.26:0/806662867 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f24135e50 0x7f8f24119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:43.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.148+0000 7f8f227fc700 1 --2- 172.21.15.26:0/806662867 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f2409e1d0 0x7f8f241199c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8f1800fde0 tx=0x7f8f1800d630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:43.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.148+0000 7f8f0b7fe700 1 -- 172.21.15.26:0/806662867 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1800dd90 con 0x7f8f2409e1d0 2023-10-01T07:56:43.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.148+0000 7f8f0b7fe700 1 -- 172.21.15.26:0/806662867 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f18004030 con 0x7f8f2409e1d0 2023-10-01T07:56:43.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.149+0000 7f8f0b7fe700 1 -- 172.21.15.26:0/806662867 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f180043c0 con 0x7f8f2409e1d0 2023-10-01T07:56:43.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.149+0000 7f8f2932c700 1 -- 172.21.15.26:0/806662867 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f1c00f050 con 0x7f8f2409e1d0 2023-10-01T07:56:43.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.149+0000 7f8f2932c700 1 -- 172.21.15.26:0/806662867 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f2411cad0 con 0x7f8f2409e1d0 2023-10-01T07:56:43.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.150+0000 7f8f0b7fe700 1 -- 172.21.15.26:0/806662867 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8f180036a0 con 0x7f8f2409e1d0 2023-10-01T07:56:43.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.150+0000 7f8f0b7fe700 1 -- 172.21.15.26:0/806662867 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8f1803fd20 con 0x7f8f2409e1d0 2023-10-01T07:56:43.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.150+0000 7f8f2932c700 1 -- 172.21.15.26:0/806662867 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f2411c720 con 0x7f8f2409e1d0 2023-10-01T07:56:43.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.159+0000 7f8f0b7fe700 1 -- 172.21.15.26:0/806662867 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8f1801f900 con 0x7f8f2409e1d0 2023-10-01T07:56:43.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.298+0000 7f1fdd995700 1 -- 172.21.15.26:0/941252634 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1fd81350d0 con 0x7f1fd806f680 2023-10-01T07:56:43.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.298+0000 7f1fbffff700 1 -- 172.21.15.26:0/941252634 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1fd001c360 con 0x7f1fd806f680 2023-10-01T07:56:43.299 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:43.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.300+0000 7f1fdd995700 1 -- 172.21.15.26:0/941252634 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fd806f680 msgr2=0x7f1fd8136030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:43.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.300+0000 7f1fdd995700 1 --2- 172.21.15.26:0/941252634 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fd806f680 0x7f1fd8136030 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1fd000ba50 tx=0x7f1fd000bd60 comp rx=0 tx=0).stop 2023-10-01T07:56:43.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.301+0000 7f1fdd995700 1 -- 172.21.15.26:0/941252634 shutdown_connections 2023-10-01T07:56:43.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.301+0000 7f1fdd995700 1 --2- 172.21.15.26:0/941252634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fd8130670 0x7f1fd8136ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:43.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.301+0000 7f1fdd995700 1 --2- 172.21.15.26:0/941252634 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fd806f680 0x7f1fd8136030 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:43.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.301+0000 7f1fdd995700 1 --2- 172.21.15.26:0/941252634 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1fd806ffd0 0x7f1fd8136570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:43.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.301+0000 7f1fdd995700 1 -- 172.21.15.26:0/941252634 >> 172.21.15.26:0/941252634 conn(0x7f1fd80a2aa0 msgr2=0x7f1fd80a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:43.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.301+0000 7f1fdd995700 1 -- 172.21.15.26:0/941252634 shutdown_connections 2023-10-01T07:56:43.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.301+0000 7f1fdd995700 1 -- 172.21.15.26:0/941252634 wait complete. 2023-10-01T07:56:43.315 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:43.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.342+0000 7fed831ca700 1 -- 172.21.15.26:0/361744962 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fed7c12c8f0 con 0x7fed7c06f680 2023-10-01T07:56:43.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.343+0000 7fed797fa700 1 -- 172.21.15.26:0/361744962 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fed7c12c8f0 con 0x7fed7c06f680 2023-10-01T07:56:43.343 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:43.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.345+0000 7fed831ca700 1 -- 172.21.15.26:0/361744962 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fed7c06f680 msgr2=0x7fed7c1c5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:43.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.345+0000 7fed831ca700 1 --2- 172.21.15.26:0/361744962 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fed7c06f680 0x7fed7c1c5db0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fed70016000 tx=0x7fed70004750 comp rx=0 tx=0).stop 2023-10-01T07:56:43.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.345+0000 7fed831ca700 1 -- 172.21.15.26:0/361744962 shutdown_connections 2023-10-01T07:56:43.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.345+0000 7fed831ca700 1 --2- 172.21.15.26:0/361744962 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed7c130670 0x7fed7c1c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:43.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.345+0000 7fed831ca700 1 --2- 172.21.15.26:0/361744962 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fed7c06f680 0x7fed7c1c5db0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:43.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.345+0000 7fed831ca700 1 --2- 172.21.15.26:0/361744962 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fed7c06ffd0 0x7fed7c1c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:43.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.345+0000 7fed831ca700 1 -- 172.21.15.26:0/361744962 >> 172.21.15.26:0/361744962 conn(0x7fed7c0a2aa0 msgr2=0x7fed7c06e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:43.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.345+0000 7fed831ca700 1 -- 172.21.15.26:0/361744962 shutdown_connections 2023-10-01T07:56:43.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.345+0000 7fed831ca700 1 -- 172.21.15.26:0/361744962 wait complete. 2023-10-01T07:56:43.365 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:43.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.373+0000 7f8f2932c700 1 -- 172.21.15.26:0/806662867 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8f24074ea0 con 0x7f8f2409e1d0 2023-10-01T07:56:43.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.374+0000 7f8f0b7fe700 1 -- 172.21.15.26:0/806662867 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8f180173e0 con 0x7f8f2409e1d0 2023-10-01T07:56:43.374 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:43.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.376+0000 7f8f2932c700 1 -- 172.21.15.26:0/806662867 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f2409e1d0 msgr2=0x7f8f241199c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:43.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.376+0000 7f8f2932c700 1 --2- 172.21.15.26:0/806662867 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f2409e1d0 0x7f8f241199c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8f1800fde0 tx=0x7f8f1800d630 comp rx=0 tx=0).stop 2023-10-01T07:56:43.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.376+0000 7f8f2932c700 1 -- 172.21.15.26:0/806662867 shutdown_connections 2023-10-01T07:56:43.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.376+0000 7f8f2932c700 1 --2- 172.21.15.26:0/806662867 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f24135e50 0x7f8f24119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:43.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.376+0000 7f8f2932c700 1 --2- 172.21.15.26:0/806662867 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f2409d6f0 0x7f8f24119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:43.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.376+0000 7f8f2932c700 1 --2- 172.21.15.26:0/806662867 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f2409e1d0 0x7f8f241199c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:43.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.376+0000 7f8f2932c700 1 -- 172.21.15.26:0/806662867 >> 172.21.15.26:0/806662867 conn(0x7f8f24066f50 msgr2=0x7f8f241329b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:43.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.376+0000 7f8f2932c700 1 -- 172.21.15.26:0/806662867 shutdown_connections 2023-10-01T07:56:43.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:43.376+0000 7f8f2932c700 1 -- 172.21.15.26:0/806662867 wait complete. 2023-10-01T07:56:43.390 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:44.001 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:44.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.147+0000 7fc87cc72700 1 Processor -- start 2023-10-01T07:56:44.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.147+0000 7fc87cc72700 1 -- start start 2023-10-01T07:56:44.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.147+0000 7fc87cc72700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc87809d6f0 0x7fc87809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:44.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.147+0000 7fc87cc72700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc87809e410 0x7fc878134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:44.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.147+0000 7fc87cc72700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc87809b120 con 0x7fc87809e000 2023-10-01T07:56:44.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.147+0000 7fc87cc72700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc87806b460 con 0x7fc87809e410 2023-10-01T07:56:44.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.147+0000 7fc87cc72700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc87809a7e0 con 0x7fc87809d6f0 2023-10-01T07:56:44.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.147+0000 7fc875d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc87809e000 0x7fc8781339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54608/0 (socket says 172.21.15.26:54608) 2023-10-01T07:56:44.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.147+0000 7fc87659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc87809d6f0 0x7fc87809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:44.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.148+0000 7fc875d9b700 1 -- 172.21.15.26:0/2286977240 learned_addr learned my addr 172.21.15.26:0/2286977240 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:44.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.148+0000 7fc876d9d700 1 --2- 172.21.15.26:0/2286977240 >> v2:172.21.15.26:3300/0 conn(0x7fc87809e410 0x7fc878134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:44.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.148+0000 7fc876d9d700 1 -- 172.21.15.26:0/2286977240 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc87809d6f0 msgr2=0x7fc87809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:44.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.148+0000 7fc876d9d700 1 --2- 172.21.15.26:0/2286977240 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc87809d6f0 0x7fc87809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.148+0000 7fc876d9d700 1 -- 172.21.15.26:0/2286977240 >> v1:172.21.15.26:6789/0 conn(0x7fc87809e000 legacy=0x7fc8781339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:44.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.148+0000 7fc876d9d700 1 -- 172.21.15.26:0/2286977240 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc87809a500 con 0x7fc87809e410 2023-10-01T07:56:44.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.148+0000 7fc87559a700 1 -- 172.21.15.26:0/2286977240 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494434640 0 0) 0x7fc87809b120 con 0x7fc87809e000 2023-10-01T07:56:44.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.148+0000 7fc87659c700 1 --2- 172.21.15.26:0/2286977240 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc87809d6f0 0x7fc87809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:44.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.148+0000 7fc876d9d700 1 --2- 172.21.15.26:0/2286977240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc87809e410 0x7fc878134100 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc870009d90 tx=0x7fc87000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32342b86355add87 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:44.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.148+0000 7fc87559a700 1 -- 172.21.15.26:0/2286977240 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87000e070 con 0x7fc87809e410 2023-10-01T07:56:44.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.148+0000 7fc87559a700 1 -- 172.21.15.26:0/2286977240 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87000bb20 con 0x7fc87809e410 2023-10-01T07:56:44.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.148+0000 7fc87559a700 1 -- 172.21.15.26:0/2286977240 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc870012430 con 0x7fc87809e410 2023-10-01T07:56:44.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.149+0000 7fc87cc72700 1 -- 172.21.15.26:0/2286977240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc87809e410 msgr2=0x7fc878134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:44.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.149+0000 7fc87cc72700 1 --2- 172.21.15.26:0/2286977240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc87809e410 0x7fc878134100 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc870009d90 tx=0x7fc87000b330 comp rx=0 tx=0).stop 2023-10-01T07:56:44.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.149+0000 7fc87cc72700 1 -- 172.21.15.26:0/2286977240 shutdown_connections 2023-10-01T07:56:44.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.149+0000 7fc87cc72700 1 --2- 172.21.15.26:0/2286977240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc87809e410 0x7fc878134100 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.149+0000 7fc87cc72700 1 --2- 172.21.15.26:0/2286977240 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc87809d6f0 0x7fc87809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.149+0000 7fc87cc72700 1 -- 172.21.15.26:0/2286977240 >> 172.21.15.26:0/2286977240 conn(0x7fc878066f50 msgr2=0x7fc87809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:44.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.149+0000 7fc87cc72700 1 -- 172.21.15.26:0/2286977240 shutdown_connections 2023-10-01T07:56:44.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.149+0000 7fc87cc72700 1 -- 172.21.15.26:0/2286977240 wait complete. 2023-10-01T07:56:44.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.150+0000 7fc87cc72700 1 Processor -- start 2023-10-01T07:56:44.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.150+0000 7fc87cc72700 1 -- start start 2023-10-01T07:56:44.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.151+0000 7fc87cc72700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc87809d6f0 0x7fc8781c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:44.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.151+0000 7fc87cc72700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc87809e000 0x7fc8781c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:44.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.151+0000 7fc87cc72700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc87809e410 0x7fc8781c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:44.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.151+0000 7fc87cc72700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8781a8a30 con 0x7fc87809e410 2023-10-01T07:56:44.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.151+0000 7fc87cc72700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8781a9780 con 0x7fc87809d6f0 2023-10-01T07:56:44.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.151+0000 7fc87cc72700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8781c8e80 con 0x7fc87809e000 2023-10-01T07:56:44.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.151+0000 7fc87659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc87809d6f0 0x7fc8781c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:44.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.151+0000 7fc876d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc87809e410 0x7fc8781c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:44.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.151+0000 7fc87659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc87809d6f0 0x7fc8781c8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33558/0 (socket says 172.21.15.26:33558) 2023-10-01T07:56:44.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.151+0000 7fc87659c700 1 -- 172.21.15.26:0/4233225612 learned_addr learned my addr 172.21.15.26:0/4233225612 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:44.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.151+0000 7fc875d9b700 1 --2- 172.21.15.26:0/4233225612 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc87809e000 0x7fc8781c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:44.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.151+0000 7fc876d9d700 1 -- 172.21.15.26:0/4233225612 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc87809e000 msgr2=0x7fc8781c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:44.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.151+0000 7fc876d9d700 1 --2- 172.21.15.26:0/4233225612 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc87809e000 0x7fc8781c8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.151+0000 7fc876d9d700 1 -- 172.21.15.26:0/4233225612 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc87809d6f0 msgr2=0x7fc8781c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:44.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.151+0000 7fc876d9d700 1 --2- 172.21.15.26:0/4233225612 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc87809d6f0 0x7fc8781c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.151+0000 7fc876d9d700 1 -- 172.21.15.26:0/4233225612 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8680094a0 con 0x7fc87809e410 2023-10-01T07:56:44.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.151+0000 7fc87659c700 1 --2- 172.21.15.26:0/4233225612 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc87809d6f0 0x7fc8781c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:44.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.151+0000 7fc876d9d700 1 --2- 172.21.15.26:0/4233225612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc87809e410 0x7fc8781c49d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc870009d90 tx=0x7fc870004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:44.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.152+0000 7fc866ffd700 1 -- 172.21.15.26:0/4233225612 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc870012430 con 0x7fc87809e410 2023-10-01T07:56:44.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.152+0000 7fc866ffd700 1 -- 172.21.15.26:0/4233225612 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc870020070 con 0x7fc87809e410 2023-10-01T07:56:44.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.152+0000 7fc87cc72700 1 -- 172.21.15.26:0/4233225612 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc870009a70 con 0x7fc87809e410 2023-10-01T07:56:44.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.152+0000 7fc866ffd700 1 -- 172.21.15.26:0/4233225612 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87001ba30 con 0x7fc87809e410 2023-10-01T07:56:44.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.152+0000 7fc87cc72700 1 -- 172.21.15.26:0/4233225612 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8781a85e0 con 0x7fc87809e410 2023-10-01T07:56:44.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.152+0000 7fc866ffd700 1 -- 172.21.15.26:0/4233225612 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc87001bb90 con 0x7fc87809e410 2023-10-01T07:56:44.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.153+0000 7fc866ffd700 1 -- 172.21.15.26:0/4233225612 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc870022070 con 0x7fc87809e410 2023-10-01T07:56:44.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.153+0000 7fc87cc72700 1 -- 172.21.15.26:0/4233225612 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc878074ea0 con 0x7fc87809e410 2023-10-01T07:56:44.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.158+0000 7fc866ffd700 1 -- 172.21.15.26:0/4233225612 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc87002c020 con 0x7fc87809e410 2023-10-01T07:56:44.316 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:44.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.361+0000 7fc87cc72700 1 -- 172.21.15.26:0/4233225612 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc8781a7870 con 0x7fc87809e410 2023-10-01T07:56:44.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.361+0000 7fc866ffd700 1 -- 172.21.15.26:0/4233225612 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc87001be40 con 0x7fc87809e410 2023-10-01T07:56:44.363 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:44.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.363+0000 7fc87cc72700 1 -- 172.21.15.26:0/4233225612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc87809e410 msgr2=0x7fc8781c49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:44.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.363+0000 7fc87cc72700 1 --2- 172.21.15.26:0/4233225612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc87809e410 0x7fc8781c49d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc870009d90 tx=0x7fc870004ad0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.363+0000 7fc87cc72700 1 -- 172.21.15.26:0/4233225612 shutdown_connections 2023-10-01T07:56:44.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.363+0000 7fc87cc72700 1 --2- 172.21.15.26:0/4233225612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc87809e410 0x7fc8781c49d0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.363+0000 7fc87cc72700 1 --2- 172.21.15.26:0/4233225612 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc87809d6f0 0x7fc8781c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.364+0000 7fc87cc72700 1 --2- 172.21.15.26:0/4233225612 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc87809e000 0x7fc8781c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.364+0000 7fc87cc72700 1 -- 172.21.15.26:0/4233225612 >> 172.21.15.26:0/4233225612 conn(0x7fc878066f50 msgr2=0x7fc8781bacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:44.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.364+0000 7fc87cc72700 1 -- 172.21.15.26:0/4233225612 shutdown_connections 2023-10-01T07:56:44.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.364+0000 7fc87cc72700 1 -- 172.21.15.26:0/4233225612 wait complete. 2023-10-01T07:56:44.366 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:44.380 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:44.391 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:44.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.456+0000 7fb8330da700 1 Processor -- start 2023-10-01T07:56:44.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.457+0000 7fb8330da700 1 -- start start 2023-10-01T07:56:44.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.457+0000 7fb8330da700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb82c133540 0x7fb82c135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:44.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.457+0000 7fb8330da700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb82c135e60 0x7fb82c138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:44.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.457+0000 7fb8330da700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb82c0716a0 con 0x7fb82c130540 2023-10-01T07:56:44.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.457+0000 7fb8330da700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c071290 con 0x7fb82c135e60 2023-10-01T07:56:44.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.457+0000 7fb8330da700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c130340 con 0x7fb82c133540 2023-10-01T07:56:44.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.457+0000 7fb82bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb82c133540 0x7fb82c135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:44.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.457+0000 7fb831677700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb82c135e60 0x7fb82c138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:44.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.457+0000 7fb82bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb82c133540 0x7fb82c135920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:48384/0 (socket says 172.21.15.26:48384) 2023-10-01T07:56:44.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.457+0000 7fb82bfff700 1 -- 172.21.15.26:0/2198147493 learned_addr learned my addr 172.21.15.26:0/2198147493 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:44.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.458+0000 7fb831677700 1 -- 172.21.15.26:0/2198147493 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb82c133540 msgr2=0x7fb82c135920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:44.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.458+0000 7fb831677700 1 --2- 172.21.15.26:0/2198147493 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb82c133540 0x7fb82c135920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.458+0000 7fb831677700 1 -- 172.21.15.26:0/2198147493 >> v1:172.21.15.26:6789/0 conn(0x7fb82c130540 legacy=0x7fb82c130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:44.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.458+0000 7fb831677700 1 -- 172.21.15.26:0/2198147493 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82c070b80 con 0x7fb82c135e60 2023-10-01T07:56:44.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.458+0000 7fb831677700 1 --2- 172.21.15.26:0/2198147493 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb82c135e60 0x7fb82c138240 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb824009dc0 tx=0x7fb82400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b057f06df9768bdf server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:44.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.458+0000 7fb82b7fe700 1 -- 172.21.15.26:0/2198147493 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82400e070 con 0x7fb82c135e60 2023-10-01T07:56:44.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.458+0000 7fb82b7fe700 1 -- 172.21.15.26:0/2198147493 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82400bb20 con 0x7fb82c135e60 2023-10-01T07:56:44.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.458+0000 7fb82b7fe700 1 -- 172.21.15.26:0/2198147493 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb824012430 con 0x7fb82c135e60 2023-10-01T07:56:44.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.459+0000 7fb8330da700 1 -- 172.21.15.26:0/2198147493 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb82c135e60 msgr2=0x7fb82c138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:44.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.459+0000 7fb8330da700 1 --2- 172.21.15.26:0/2198147493 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb82c135e60 0x7fb82c138240 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb824009dc0 tx=0x7fb82400b330 comp rx=0 tx=0).stop 2023-10-01T07:56:44.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.459+0000 7fb8330da700 1 -- 172.21.15.26:0/2198147493 shutdown_connections 2023-10-01T07:56:44.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.459+0000 7fb8330da700 1 --2- 172.21.15.26:0/2198147493 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb82c135e60 0x7fb82c138240 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.459+0000 7fb8330da700 1 --2- 172.21.15.26:0/2198147493 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb82c133540 0x7fb82c135920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.459+0000 7fb8330da700 1 -- 172.21.15.26:0/2198147493 >> 172.21.15.26:0/2198147493 conn(0x7fb82c0a2aa0 msgr2=0x7fb82c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:44.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.459+0000 7fb8330da700 1 -- 172.21.15.26:0/2198147493 shutdown_connections 2023-10-01T07:56:44.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.459+0000 7fb8330da700 1 -- 172.21.15.26:0/2198147493 wait complete. 2023-10-01T07:56:44.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.460+0000 7fb8330da700 1 Processor -- start 2023-10-01T07:56:44.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.460+0000 7fb8330da700 1 -- start start 2023-10-01T07:56:44.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.461+0000 7fb8330da700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb82c130540 0x7fb82c12d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:44.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.461+0000 7fb8330da700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb82c133540 0x7fb82c12d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:44.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.461+0000 7fb8330da700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb82c135e60 0x7fb82c139790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:44.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.461+0000 7fb8330da700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c09a960 con 0x7fb82c133540 2023-10-01T07:56:44.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.461+0000 7fb8330da700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c0a22f0 con 0x7fb82c135e60 2023-10-01T07:56:44.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.461+0000 7fb8330da700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c0718e0 con 0x7fb82c130540 2023-10-01T07:56:44.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.461+0000 7fb831677700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb82c135e60 0x7fb82c139790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:44.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.461+0000 7fb82bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb82c133540 0x7fb82c12d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:44.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.461+0000 7fb831677700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb82c135e60 0x7fb82c139790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33576/0 (socket says 172.21.15.26:33576) 2023-10-01T07:56:44.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.461+0000 7fb831677700 1 -- 172.21.15.26:0/2414665681 learned_addr learned my addr 172.21.15.26:0/2414665681 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:44.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.461+0000 7fb830e76700 1 --2- 172.21.15.26:0/2414665681 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb82c130540 0x7fb82c12d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:44.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.461+0000 7fb831677700 1 -- 172.21.15.26:0/2414665681 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb82c130540 msgr2=0x7fb82c12d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:44.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.461+0000 7fb831677700 1 --2- 172.21.15.26:0/2414665681 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb82c130540 0x7fb82c12d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.461+0000 7fb831677700 1 -- 172.21.15.26:0/2414665681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb82c133540 msgr2=0x7fb82c12d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:44.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.461+0000 7fb831677700 1 --2- 172.21.15.26:0/2414665681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb82c133540 0x7fb82c12d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.461+0000 7fb831677700 1 -- 172.21.15.26:0/2414665681 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb824009a70 con 0x7fb82c135e60 2023-10-01T07:56:44.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.461+0000 7fb82bfff700 1 --2- 172.21.15.26:0/2414665681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb82c133540 0x7fb82c12d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:44.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.462+0000 7fb831677700 1 --2- 172.21.15.26:0/2414665681 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb82c135e60 0x7fb82c139790 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb824014040 tx=0x7fb824004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:44.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.462+0000 7fb8297fa700 1 -- 172.21.15.26:0/2414665681 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb824012430 con 0x7fb82c135e60 2023-10-01T07:56:44.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.462+0000 7fb8297fa700 1 -- 172.21.15.26:0/2414665681 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb824020070 con 0x7fb82c135e60 2023-10-01T07:56:44.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.462+0000 7fb8330da700 1 -- 172.21.15.26:0/2414665681 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb82c13a930 con 0x7fb82c135e60 2023-10-01T07:56:44.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.462+0000 7fb8297fa700 1 -- 172.21.15.26:0/2414665681 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb824004280 con 0x7fb82c135e60 2023-10-01T07:56:44.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.462+0000 7fb8330da700 1 -- 172.21.15.26:0/2414665681 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb82c09ac40 con 0x7fb82c135e60 2023-10-01T07:56:44.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.463+0000 7fb8297fa700 1 -- 172.21.15.26:0/2414665681 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb8240043e0 con 0x7fb82c135e60 2023-10-01T07:56:44.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.463+0000 7fb8297fa700 1 -- 172.21.15.26:0/2414665681 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb824022070 con 0x7fb82c135e60 2023-10-01T07:56:44.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.463+0000 7fb8330da700 1 -- 172.21.15.26:0/2414665681 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb82c09a7a0 con 0x7fb82c135e60 2023-10-01T07:56:44.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.472+0000 7fb8297fa700 1 -- 172.21.15.26:0/2414665681 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb824012e10 con 0x7fb82c135e60 2023-10-01T07:56:44.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.507+0000 7ff4f9e59700 1 Processor -- start 2023-10-01T07:56:44.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.507+0000 7ff4f9e59700 1 -- start start 2023-10-01T07:56:44.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.508+0000 7ff4f9e59700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4f40a0a30 0x7ff4f40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:44.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.508+0000 7ff4f9e59700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4f40a1340 0x7ff4f4133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:44.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.508+0000 7ff4f9e59700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff4f4133fa0 0x7ff4f4134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:44.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.508+0000 7ff4f9e59700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f409edd0 con 0x7ff4f4133fa0 2023-10-01T07:56:44.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.508+0000 7ff4f9e59700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f409e1f0 con 0x7ff4f40a1340 2023-10-01T07:56:44.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.508+0000 7ff4f9e59700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f409dc50 con 0x7ff4f40a0a30 2023-10-01T07:56:44.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.508+0000 7ff4f37fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4f40a0a30 0x7ff4f40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:44.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.508+0000 7ff4f2ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4f40a1340 0x7ff4f4133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:44.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.508+0000 7ff4f37fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4f40a0a30 0x7ff4f40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:48402/0 (socket says 172.21.15.26:48402) 2023-10-01T07:56:44.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.508+0000 7ff4f37fe700 1 -- 172.21.15.26:0/3317599221 learned_addr learned my addr 172.21.15.26:0/3317599221 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:44.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.508+0000 7ff4f3fff700 1 --2- 172.21.15.26:0/3317599221 >> v2:172.21.15.26:3300/0 conn(0x7ff4f4133fa0 0x7ff4f4134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:44.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.509+0000 7ff4f3fff700 1 -- 172.21.15.26:0/3317599221 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4f40a0a30 msgr2=0x7ff4f40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:44.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.509+0000 7ff4f3fff700 1 --2- 172.21.15.26:0/3317599221 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4f40a0a30 0x7ff4f40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.509+0000 7ff4f3fff700 1 -- 172.21.15.26:0/3317599221 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4f40a1340 msgr2=0x7ff4f4133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:44.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.509+0000 7ff4f3fff700 1 --2- 172.21.15.26:0/3317599221 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4f40a1340 0x7ff4f4133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.509+0000 7ff4f3fff700 1 -- 172.21.15.26:0/3317599221 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f40a1fe0 con 0x7ff4f4133fa0 2023-10-01T07:56:44.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.509+0000 7ff4f2ffd700 1 --2- 172.21.15.26:0/3317599221 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4f40a1340 0x7ff4f4133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:44.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.509+0000 7ff4f37fe700 1 --2- 172.21.15.26:0/3317599221 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4f40a0a30 0x7ff4f40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:44.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.509+0000 7ff4f3fff700 1 --2- 172.21.15.26:0/3317599221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4f4133fa0 0x7ff4f4134410 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec009d90 tx=0x7ff4ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4bc2728c670b78e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:44.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.509+0000 7ff4f27fc700 1 -- 172.21.15.26:0/3317599221 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec00e070 con 0x7ff4f4133fa0 2023-10-01T07:56:44.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.509+0000 7ff4f27fc700 1 -- 172.21.15.26:0/3317599221 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ec00bb20 con 0x7ff4f4133fa0 2023-10-01T07:56:44.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.509+0000 7ff4f27fc700 1 -- 172.21.15.26:0/3317599221 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec012430 con 0x7ff4f4133fa0 2023-10-01T07:56:44.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.510+0000 7ff4f9e59700 1 -- 172.21.15.26:0/3317599221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4f4133fa0 msgr2=0x7ff4f4134410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:44.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.510+0000 7ff4f9e59700 1 --2- 172.21.15.26:0/3317599221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4f4133fa0 0x7ff4f4134410 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec009d90 tx=0x7ff4ec00b330 comp rx=0 tx=0).stop 2023-10-01T07:56:44.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.510+0000 7ff4f9e59700 1 -- 172.21.15.26:0/3317599221 shutdown_connections 2023-10-01T07:56:44.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.510+0000 7ff4f9e59700 1 --2- 172.21.15.26:0/3317599221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4f4133fa0 0x7ff4f4134410 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.510+0000 7ff4f9e59700 1 --2- 172.21.15.26:0/3317599221 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4f40a0a30 0x7ff4f40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.510+0000 7ff4f9e59700 1 --2- 172.21.15.26:0/3317599221 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4f40a1340 0x7ff4f4133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.510+0000 7ff4f9e59700 1 -- 172.21.15.26:0/3317599221 >> 172.21.15.26:0/3317599221 conn(0x7ff4f40a6550 msgr2=0x7ff4f40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:44.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.510+0000 7ff4f9e59700 1 -- 172.21.15.26:0/3317599221 shutdown_connections 2023-10-01T07:56:44.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.510+0000 7ff4f9e59700 1 -- 172.21.15.26:0/3317599221 wait complete. 2023-10-01T07:56:44.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.511+0000 7ff4f9e59700 1 Processor -- start 2023-10-01T07:56:44.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.512+0000 7ff4f9e59700 1 -- start start 2023-10-01T07:56:44.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.512+0000 7ff4f9e59700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4f40a0a30 0x7ff4f41200b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:44.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.512+0000 7ff4f9e59700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4f40a1340 0x7ff4f41205f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:44.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.512+0000 7ff4f9e59700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4f4133fa0 0x7ff4f4120b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:44.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.512+0000 7ff4f9e59700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f41238f0 con 0x7ff4f40a0a30 2023-10-01T07:56:44.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.513+0000 7ff4f9e59700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f4123af0 con 0x7ff4f40a1340 2023-10-01T07:56:44.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.513+0000 7ff4f9e59700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f41229e0 con 0x7ff4f4133fa0 2023-10-01T07:56:44.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.513+0000 7ff4f2ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4f40a1340 0x7ff4f41205f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:44.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.513+0000 7ff4f37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4f40a0a30 0x7ff4f41200b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:44.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.513+0000 7ff4f2ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4f40a1340 0x7ff4f41205f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33592/0 (socket says 172.21.15.26:33592) 2023-10-01T07:56:44.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.513+0000 7ff4f2ffd700 1 -- 172.21.15.26:0/494849778 learned_addr learned my addr 172.21.15.26:0/494849778 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:44.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.513+0000 7ff4f37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4f40a0a30 0x7ff4f41200b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53542/0 (socket says 172.21.15.26:53542) 2023-10-01T07:56:44.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.513+0000 7ff4f3fff700 1 --2- 172.21.15.26:0/494849778 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4f4133fa0 0x7ff4f4120b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:44.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.513+0000 7ff4f2ffd700 1 -- 172.21.15.26:0/494849778 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4f4133fa0 msgr2=0x7ff4f4120b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:44.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.513+0000 7ff4f2ffd700 1 --2- 172.21.15.26:0/494849778 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4f4133fa0 0x7ff4f4120b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.513+0000 7ff4f2ffd700 1 -- 172.21.15.26:0/494849778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4f40a0a30 msgr2=0x7ff4f41200b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:44.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.513+0000 7ff4f2ffd700 1 --2- 172.21.15.26:0/494849778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4f40a0a30 0x7ff4f41200b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.513+0000 7ff4f2ffd700 1 -- 172.21.15.26:0/494849778 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e4009550 con 0x7ff4f40a1340 2023-10-01T07:56:44.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.513+0000 7ff4f37fe700 1 --2- 172.21.15.26:0/494849778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4f40a0a30 0x7ff4f41200b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:44.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.513+0000 7ff4f2ffd700 1 --2- 172.21.15.26:0/494849778 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4f40a1340 0x7ff4f41205f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff4e800ec10 tx=0x7ff4e800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:44.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.514+0000 7ff4dbfff700 1 -- 172.21.15.26:0/494849778 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e800c850 con 0x7ff4f40a1340 2023-10-01T07:56:44.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.514+0000 7ff4dbfff700 1 -- 172.21.15.26:0/494849778 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e800c9b0 con 0x7ff4f40a1340 2023-10-01T07:56:44.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.514+0000 7ff4dbfff700 1 -- 172.21.15.26:0/494849778 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e800cd20 con 0x7ff4f40a1340 2023-10-01T07:56:44.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.514+0000 7ff4f9e59700 1 -- 172.21.15.26:0/494849778 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4e80094a0 con 0x7ff4f40a1340 2023-10-01T07:56:44.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.514+0000 7ff4f9e59700 1 -- 172.21.15.26:0/494849778 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4ec009a70 con 0x7ff4f40a1340 2023-10-01T07:56:44.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.515+0000 7ff4dbfff700 1 -- 172.21.15.26:0/494849778 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff4e8013470 con 0x7ff4f40a1340 2023-10-01T07:56:44.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.515+0000 7ff4f9e59700 1 -- 172.21.15.26:0/494849778 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f40a34a0 con 0x7ff4f40a1340 2023-10-01T07:56:44.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.515+0000 7ff4dbfff700 1 -- 172.21.15.26:0/494849778 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff4e803fac0 con 0x7ff4f40a1340 2023-10-01T07:56:44.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.524+0000 7ff4dbfff700 1 -- 172.21.15.26:0/494849778 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff4e8013720 con 0x7ff4f40a1340 2023-10-01T07:56:44.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.565+0000 7f1435bb8700 1 Processor -- start 2023-10-01T07:56:44.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.566+0000 7f1435bb8700 1 -- start start 2023-10-01T07:56:44.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.566+0000 7f1435bb8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f14300a0a30 0x7f14300a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:44.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.566+0000 7f1435bb8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f14300a1340 0x7f1430133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:44.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.566+0000 7f1435bb8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f143009edd0 con 0x7f1430133fa0 2023-10-01T07:56:44.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.566+0000 7f1435bb8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f143009e1f0 con 0x7f14300a1340 2023-10-01T07:56:44.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.566+0000 7f1435bb8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f143009dc50 con 0x7f14300a0a30 2023-10-01T07:56:44.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.566+0000 7f142f7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f14300a0a30 0x7f14300a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:44.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.566+0000 7f142effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f14300a1340 0x7f1430133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:44.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.566+0000 7f142f7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f14300a0a30 0x7f14300a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:48412/0 (socket says 172.21.15.26:48412) 2023-10-01T07:56:44.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.566+0000 7f142f7fe700 1 -- 172.21.15.26:0/2107734001 learned_addr learned my addr 172.21.15.26:0/2107734001 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:44.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.567+0000 7f142effd700 1 -- 172.21.15.26:0/2107734001 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f14300a0a30 msgr2=0x7f14300a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:44.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.567+0000 7f142effd700 1 --2- 172.21.15.26:0/2107734001 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f14300a0a30 0x7f14300a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.567+0000 7f142effd700 1 -- 172.21.15.26:0/2107734001 >> v1:172.21.15.26:6789/0 conn(0x7f1430133fa0 legacy=0x7f143013ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:44.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.567+0000 7f142effd700 1 -- 172.21.15.26:0/2107734001 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14300a1fe0 con 0x7f14300a1340 2023-10-01T07:56:44.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.567+0000 7f142f7fe700 1 --2- 172.21.15.26:0/2107734001 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f14300a0a30 0x7f14300a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:44.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.567+0000 7f142effd700 1 --2- 172.21.15.26:0/2107734001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14300a1340 0x7f1430133a60 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1424009840 tx=0x7f1424009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e39775a5caff6ded server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:44.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.567+0000 7f142e7fc700 1 -- 172.21.15.26:0/2107734001 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1424011830 con 0x7f14300a1340 2023-10-01T07:56:44.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.567+0000 7f142e7fc700 1 -- 172.21.15.26:0/2107734001 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1424011990 con 0x7f14300a1340 2023-10-01T07:56:44.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.567+0000 7f142e7fc700 1 -- 172.21.15.26:0/2107734001 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1424011d20 con 0x7f14300a1340 2023-10-01T07:56:44.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.568+0000 7f1435bb8700 1 -- 172.21.15.26:0/2107734001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14300a1340 msgr2=0x7f1430133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:44.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.568+0000 7f1435bb8700 1 --2- 172.21.15.26:0/2107734001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14300a1340 0x7f1430133a60 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1424009840 tx=0x7f1424009b50 comp rx=0 tx=0).stop 2023-10-01T07:56:44.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.568+0000 7f1435bb8700 1 -- 172.21.15.26:0/2107734001 shutdown_connections 2023-10-01T07:56:44.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.568+0000 7f1435bb8700 1 --2- 172.21.15.26:0/2107734001 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f14300a0a30 0x7f14300a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.568+0000 7f1435bb8700 1 --2- 172.21.15.26:0/2107734001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14300a1340 0x7f1430133a60 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.568+0000 7f1435bb8700 1 -- 172.21.15.26:0/2107734001 >> 172.21.15.26:0/2107734001 conn(0x7f14300a6550 msgr2=0x7f14300a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:44.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.568+0000 7f1435bb8700 1 -- 172.21.15.26:0/2107734001 shutdown_connections 2023-10-01T07:56:44.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.568+0000 7f1435bb8700 1 -- 172.21.15.26:0/2107734001 wait complete. 2023-10-01T07:56:44.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.569+0000 7f1435bb8700 1 Processor -- start 2023-10-01T07:56:44.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.570+0000 7f1435bb8700 1 -- start start 2023-10-01T07:56:44.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.570+0000 7f1435bb8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f14300a0a30 0x7f14301c4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:44.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.570+0000 7f1435bb8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f14300a1340 0x7f14301c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:44.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.570+0000 7f1435bb8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1430133fa0 0x7f14301c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:44.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.570+0000 7f1435bb8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1430120700 con 0x7f1430133fa0 2023-10-01T07:56:44.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.570+0000 7f1435bb8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1430120510 con 0x7f14300a0a30 2023-10-01T07:56:44.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.570+0000 7f1435bb8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1430122420 con 0x7f14300a1340 2023-10-01T07:56:44.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.570+0000 7f142effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f14300a1340 0x7f14301c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:44.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.570+0000 7f142effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f14300a1340 0x7f14301c47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:48428/0 (socket says 172.21.15.26:48428) 2023-10-01T07:56:44.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.570+0000 7f142effd700 1 -- 172.21.15.26:0/3517136344 learned_addr learned my addr 172.21.15.26:0/3517136344 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:44.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.570+0000 7f142ffff700 1 --2- 172.21.15.26:0/3517136344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1430133fa0 0x7f14301c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:44.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.571+0000 7f142effd700 1 -- 172.21.15.26:0/3517136344 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f14300a0a30 msgr2=0x7f14301c4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:44.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.571+0000 7f142effd700 1 --2- 172.21.15.26:0/3517136344 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f14300a0a30 0x7f14301c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.571+0000 7f142effd700 1 -- 172.21.15.26:0/3517136344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1430133fa0 msgr2=0x7f14301c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:44.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.571+0000 7f142effd700 1 --2- 172.21.15.26:0/3517136344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1430133fa0 0x7f14301c4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.571+0000 7f142effd700 1 -- 172.21.15.26:0/3517136344 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1420013a10 con 0x7f14300a1340 2023-10-01T07:56:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.571+0000 7f142effd700 1 --2- 172.21.15.26:0/3517136344 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f14300a1340 0x7f14301c47b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1424009fd0 tx=0x7f1424004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.571+0000 7f1417fff700 1 -- 172.21.15.26:0/3517136344 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14240036a0 con 0x7f14300a1340 2023-10-01T07:56:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.571+0000 7f1417fff700 1 -- 172.21.15.26:0/3517136344 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142401f070 con 0x7f14300a1340 2023-10-01T07:56:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.571+0000 7f1435bb8700 1 -- 172.21.15.26:0/3517136344 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14240094a0 con 0x7f14300a1340 2023-10-01T07:56:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.571+0000 7f1417fff700 1 -- 172.21.15.26:0/3517136344 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1424003a60 con 0x7f14300a1340 2023-10-01T07:56:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.571+0000 7f1435bb8700 1 -- 172.21.15.26:0/3517136344 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1430122140 con 0x7f14300a1340 2023-10-01T07:56:44.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.572+0000 7f1435bb8700 1 -- 172.21.15.26:0/3517136344 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1430121de0 con 0x7f14300a1340 2023-10-01T07:56:44.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.573+0000 7f1417fff700 1 -- 172.21.15.26:0/3517136344 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1424003bc0 con 0x7f14300a1340 2023-10-01T07:56:44.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.573+0000 7f1417fff700 1 -- 172.21.15.26:0/3517136344 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1424021070 con 0x7f14300a1340 2023-10-01T07:56:44.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.577+0000 7f1417fff700 1 -- 172.21.15.26:0/3517136344 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1424025a30 con 0x7f14300a1340 2023-10-01T07:56:44.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.689+0000 7fb8330da700 1 -- 172.21.15.26:0/2414665681 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb82c074ea0 con 0x7fb82c135e60 2023-10-01T07:56:44.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.689+0000 7fb8297fa700 1 -- 172.21.15.26:0/2414665681 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb82402c020 con 0x7fb82c135e60 2023-10-01T07:56:44.691 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:44.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.691+0000 7fb8330da700 1 -- 172.21.15.26:0/2414665681 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb82c135e60 msgr2=0x7fb82c139790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:44.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.691+0000 7fb8330da700 1 --2- 172.21.15.26:0/2414665681 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb82c135e60 0x7fb82c139790 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb824014040 tx=0x7fb824004ad0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.691+0000 7fb8330da700 1 -- 172.21.15.26:0/2414665681 shutdown_connections 2023-10-01T07:56:44.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.691+0000 7fb8330da700 1 --2- 172.21.15.26:0/2414665681 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb82c135e60 0x7fb82c139790 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.691+0000 7fb8330da700 1 --2- 172.21.15.26:0/2414665681 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb82c130540 0x7fb82c12d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.691+0000 7fb8330da700 1 --2- 172.21.15.26:0/2414665681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb82c133540 0x7fb82c12d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.691+0000 7fb8330da700 1 -- 172.21.15.26:0/2414665681 >> 172.21.15.26:0/2414665681 conn(0x7fb82c0a2aa0 msgr2=0x7fb82c131320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:44.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.692+0000 7fb8330da700 1 -- 172.21.15.26:0/2414665681 shutdown_connections 2023-10-01T07:56:44.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.692+0000 7fb8330da700 1 -- 172.21.15.26:0/2414665681 wait complete. 2023-10-01T07:56:44.707 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:44.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.736+0000 7ff4f9e59700 1 -- 172.21.15.26:0/494849778 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff4f40a0220 con 0x7ff4f40a1340 2023-10-01T07:56:44.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.736+0000 7ff4dbfff700 1 -- 172.21.15.26:0/494849778 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff4e802a090 con 0x7ff4f40a1340 2023-10-01T07:56:44.738 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:44.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.739+0000 7ff4f9e59700 1 -- 172.21.15.26:0/494849778 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4f40a1340 msgr2=0x7ff4f41205f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:44.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.739+0000 7ff4f9e59700 1 --2- 172.21.15.26:0/494849778 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4f40a1340 0x7ff4f41205f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff4e800ec10 tx=0x7ff4e800ef20 comp rx=0 tx=0).stop 2023-10-01T07:56:44.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.739+0000 7ff4f9e59700 1 -- 172.21.15.26:0/494849778 shutdown_connections 2023-10-01T07:56:44.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.739+0000 7ff4f9e59700 1 --2- 172.21.15.26:0/494849778 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4f4133fa0 0x7ff4f4120b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.739+0000 7ff4f9e59700 1 --2- 172.21.15.26:0/494849778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4f40a0a30 0x7ff4f41200b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.739+0000 7ff4f9e59700 1 --2- 172.21.15.26:0/494849778 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4f40a1340 0x7ff4f41205f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.739+0000 7ff4f9e59700 1 -- 172.21.15.26:0/494849778 >> 172.21.15.26:0/494849778 conn(0x7ff4f40a6550 msgr2=0x7ff4f409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:44.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.739+0000 7ff4f9e59700 1 -- 172.21.15.26:0/494849778 shutdown_connections 2023-10-01T07:56:44.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.739+0000 7ff4f9e59700 1 -- 172.21.15.26:0/494849778 wait complete. 2023-10-01T07:56:44.754 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:44.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.788+0000 7f1435bb8700 1 -- 172.21.15.26:0/3517136344 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1430121de0 con 0x7f14300a1340 2023-10-01T07:56:44.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.789+0000 7f1417fff700 1 -- 172.21.15.26:0/3517136344 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1424015030 con 0x7f14300a1340 2023-10-01T07:56:44.790 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:44.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.791+0000 7f1435bb8700 1 -- 172.21.15.26:0/3517136344 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f14300a1340 msgr2=0x7f14301c47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:44.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.791+0000 7f1435bb8700 1 --2- 172.21.15.26:0/3517136344 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f14300a1340 0x7f14301c47b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1424009fd0 tx=0x7f1424004750 comp rx=0 tx=0).stop 2023-10-01T07:56:44.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.791+0000 7f1435bb8700 1 -- 172.21.15.26:0/3517136344 shutdown_connections 2023-10-01T07:56:44.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.791+0000 7f1435bb8700 1 --2- 172.21.15.26:0/3517136344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1430133fa0 0x7f14301c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.791+0000 7f1435bb8700 1 --2- 172.21.15.26:0/3517136344 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f14300a0a30 0x7f14301c4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.791+0000 7f1435bb8700 1 --2- 172.21.15.26:0/3517136344 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f14300a1340 0x7f14301c47b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:44.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.791+0000 7f1435bb8700 1 -- 172.21.15.26:0/3517136344 >> 172.21.15.26:0/3517136344 conn(0x7f14300a6550 msgr2=0x7f143006da90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:44.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.791+0000 7f1435bb8700 1 -- 172.21.15.26:0/3517136344 shutdown_connections 2023-10-01T07:56:44.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:44.791+0000 7f1435bb8700 1 -- 172.21.15.26:0/3517136344 wait complete. 2023-10-01T07:56:44.806 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:45.380 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:45.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.526+0000 7f415341c700 1 Processor -- start 2023-10-01T07:56:45.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.526+0000 7f415341c700 1 -- start start 2023-10-01T07:56:45.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.526+0000 7f415341c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f414c06a770 0x7f414c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:45.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.526+0000 7f415341c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f414c06b080 0x7f414c131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:45.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.526+0000 7f415341c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f414c09ece0 con 0x7f414c131b40 2023-10-01T07:56:45.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.526+0000 7f415341c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414c09e760 con 0x7f414c06b080 2023-10-01T07:56:45.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.526+0000 7f415341c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f414c09e040 con 0x7f414c06a770 2023-10-01T07:56:45.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.527+0000 7f41511b8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f414c06a770 0x7f414c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:45.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.527+0000 7f41519b9700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f414c131b40 0x7f414c138850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54638/0 (socket says 172.21.15.26:54638) 2023-10-01T07:56:45.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.527+0000 7f41519b9700 1 -- 172.21.15.26:0/3077512109 learned_addr learned my addr 172.21.15.26:0/3077512109 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:45.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.527+0000 7f41509b7700 1 --2- 172.21.15.26:0/3077512109 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f414c06b080 0x7f414c131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:45.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.527+0000 7f4143fff700 1 -- 172.21.15.26:0/3077512109 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2610755792 0 0) 0x7f414c09ece0 con 0x7f414c131b40 2023-10-01T07:56:45.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.527+0000 7f41509b7700 1 -- 172.21.15.26:0/3077512109 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f414c06a770 msgr2=0x7f414c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:45.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.527+0000 7f41509b7700 1 --2- 172.21.15.26:0/3077512109 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f414c06a770 0x7f414c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:45.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.527+0000 7f41509b7700 1 -- 172.21.15.26:0/3077512109 >> v1:172.21.15.26:6789/0 conn(0x7f414c131b40 legacy=0x7f414c138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:45.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.527+0000 7f41509b7700 1 -- 172.21.15.26:0/3077512109 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414c09f630 con 0x7f414c06b080 2023-10-01T07:56:45.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.527+0000 7f41511b8700 1 --2- 172.21.15.26:0/3077512109 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f414c06a770 0x7f414c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:45.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.527+0000 7f41509b7700 1 --2- 172.21.15.26:0/3077512109 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f414c06b080 0x7f414c131600 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f413c009870 tx=0x7f413c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=110aeea78549060d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:45.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.527+0000 7f4143fff700 1 -- 172.21.15.26:0/3077512109 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c011830 con 0x7f414c06b080 2023-10-01T07:56:45.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.527+0000 7f4143fff700 1 -- 172.21.15.26:0/3077512109 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413c011990 con 0x7f414c06b080 2023-10-01T07:56:45.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.527+0000 7f4143fff700 1 -- 172.21.15.26:0/3077512109 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c011d20 con 0x7f414c06b080 2023-10-01T07:56:45.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.528+0000 7f415341c700 1 -- 172.21.15.26:0/3077512109 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f414c06b080 msgr2=0x7f414c131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:45.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.528+0000 7f415341c700 1 --2- 172.21.15.26:0/3077512109 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f414c06b080 0x7f414c131600 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f413c009870 tx=0x7f413c009b80 comp rx=0 tx=0).stop 2023-10-01T07:56:45.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.528+0000 7f415341c700 1 -- 172.21.15.26:0/3077512109 shutdown_connections 2023-10-01T07:56:45.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.528+0000 7f415341c700 1 --2- 172.21.15.26:0/3077512109 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f414c06a770 0x7f414c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:45.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.528+0000 7f415341c700 1 --2- 172.21.15.26:0/3077512109 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f414c06b080 0x7f414c131600 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:45.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.528+0000 7f415341c700 1 -- 172.21.15.26:0/3077512109 >> 172.21.15.26:0/3077512109 conn(0x7f414c066f50 msgr2=0x7f414c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:45.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.528+0000 7f415341c700 1 -- 172.21.15.26:0/3077512109 shutdown_connections 2023-10-01T07:56:45.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.528+0000 7f415341c700 1 -- 172.21.15.26:0/3077512109 wait complete. 2023-10-01T07:56:45.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.529+0000 7f415341c700 1 Processor -- start 2023-10-01T07:56:45.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.529+0000 7f415341c700 1 -- start start 2023-10-01T07:56:45.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.530+0000 7f415341c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f414c06a770 0x7f414c11d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:45.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.530+0000 7f415341c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f414c06b080 0x7f414c1c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:45.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.530+0000 7f415341c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f414c131b40 0x7f414c1c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:45.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.530+0000 7f415341c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414c11cba0 con 0x7f414c06b080 2023-10-01T07:56:45.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.530+0000 7f415341c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414c1202f0 con 0x7f414c131b40 2023-10-01T07:56:45.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.530+0000 7f415341c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f414c11e2e0 con 0x7f414c06a770 2023-10-01T07:56:45.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.530+0000 7f41511b8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f414c06a770 0x7f414c11d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:45.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.530+0000 7f41509b7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f414c06b080 0x7f414c1c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:45.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.530+0000 7f41511b8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f414c06a770 0x7f414c11d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:48452/0 (socket says 172.21.15.26:48452) 2023-10-01T07:56:45.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.530+0000 7f41511b8700 1 -- 172.21.15.26:0/2755993873 learned_addr learned my addr 172.21.15.26:0/2755993873 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:45.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.530+0000 7f41519b9700 1 --2- 172.21.15.26:0/2755993873 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f414c131b40 0x7f414c1c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:45.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.530+0000 7f41509b7700 1 -- 172.21.15.26:0/2755993873 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f414c06a770 msgr2=0x7f414c11d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:45.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.530+0000 7f41509b7700 1 --2- 172.21.15.26:0/2755993873 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f414c06a770 0x7f414c11d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:45.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.530+0000 7f41509b7700 1 -- 172.21.15.26:0/2755993873 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f414c131b40 msgr2=0x7f414c1c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:45.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.530+0000 7f41509b7700 1 --2- 172.21.15.26:0/2755993873 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f414c131b40 0x7f414c1c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:45.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.530+0000 7f41509b7700 1 -- 172.21.15.26:0/2755993873 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41480094a0 con 0x7f414c06b080 2023-10-01T07:56:45.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.530+0000 7f41519b9700 1 --2- 172.21.15.26:0/2755993873 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f414c131b40 0x7f414c1c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:45.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.530+0000 7f41509b7700 1 --2- 172.21.15.26:0/2755993873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f414c06b080 0x7f414c1c61d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f413c016000 tx=0x7f413c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:45.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.530+0000 7f4141ffb700 1 -- 172.21.15.26:0/2755993873 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c004510 con 0x7f414c06b080 2023-10-01T07:56:45.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.531+0000 7f4141ffb700 1 -- 172.21.15.26:0/2755993873 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413c01f070 con 0x7f414c06b080 2023-10-01T07:56:45.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.531+0000 7f415341c700 1 -- 172.21.15.26:0/2755993873 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f413c0094a0 con 0x7f414c06b080 2023-10-01T07:56:45.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.531+0000 7f4141ffb700 1 -- 172.21.15.26:0/2755993873 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c0038e0 con 0x7f414c06b080 2023-10-01T07:56:45.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.531+0000 7f415341c700 1 -- 172.21.15.26:0/2755993873 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f414c071e60 con 0x7f414c06b080 2023-10-01T07:56:45.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.531+0000 7f4141ffb700 1 -- 172.21.15.26:0/2755993873 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f413c003a40 con 0x7f414c06b080 2023-10-01T07:56:45.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.532+0000 7f4141ffb700 1 -- 172.21.15.26:0/2755993873 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f413c021070 con 0x7f414c06b080 2023-10-01T07:56:45.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.532+0000 7f415341c700 1 -- 172.21.15.26:0/2755993873 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f414c09dce0 con 0x7f414c06b080 2023-10-01T07:56:45.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.537+0000 7f4141ffb700 1 -- 172.21.15.26:0/2755993873 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f413c015080 con 0x7f414c06b080 2023-10-01T07:56:45.708 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:45.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.746+0000 7f415341c700 1 -- 172.21.15.26:0/2755993873 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f414c074ea0 con 0x7f414c06b080 2023-10-01T07:56:45.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.746+0000 7f4141ffb700 1 -- 172.21.15.26:0/2755993873 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f413c003cf0 con 0x7f414c06b080 2023-10-01T07:56:45.748 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:45.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.748+0000 7f415341c700 1 -- 172.21.15.26:0/2755993873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f414c06b080 msgr2=0x7f414c1c61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:45.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.748+0000 7f415341c700 1 --2- 172.21.15.26:0/2755993873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f414c06b080 0x7f414c1c61d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f413c016000 tx=0x7f413c004750 comp rx=0 tx=0).stop 2023-10-01T07:56:45.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.748+0000 7f415341c700 1 -- 172.21.15.26:0/2755993873 shutdown_connections 2023-10-01T07:56:45.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.748+0000 7f415341c700 1 --2- 172.21.15.26:0/2755993873 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f414c131b40 0x7f414c1c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:45.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.748+0000 7f415341c700 1 --2- 172.21.15.26:0/2755993873 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f414c06a770 0x7f414c11d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:45.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.748+0000 7f415341c700 1 --2- 172.21.15.26:0/2755993873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f414c06b080 0x7f414c1c61d0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:45.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.748+0000 7f415341c700 1 -- 172.21.15.26:0/2755993873 >> 172.21.15.26:0/2755993873 conn(0x7f414c066f50 msgr2=0x7f414c070030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:45.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.748+0000 7f415341c700 1 -- 172.21.15.26:0/2755993873 shutdown_connections 2023-10-01T07:56:45.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.749+0000 7f415341c700 1 -- 172.21.15.26:0/2755993873 wait complete. 2023-10-01T07:56:45.755 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:45.764 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:45.807 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:45.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.854+0000 7f6e041c9700 1 Processor -- start 2023-10-01T07:56:45.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.854+0000 7f6e041c9700 1 -- start start 2023-10-01T07:56:45.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.855+0000 7f6e041c9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6dfc09e930 0x7f6dfc09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:45.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.855+0000 7f6e041c9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6dfc09f240 0x7f6dfc1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:45.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.855+0000 7f6e041c9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6dfc09f650 0x7f6dfc131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:45.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.855+0000 7f6e041c9700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dfc070940 con 0x7f6dfc09f240 2023-10-01T07:56:45.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.855+0000 7f6e041c9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc06fd60 con 0x7f6dfc09f650 2023-10-01T07:56:45.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.855+0000 7f6e041c9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc06fa80 con 0x7f6dfc09e930 2023-10-01T07:56:45.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.855+0000 7f6e02766700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6dfc09f650 0x7f6dfc131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:45.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.855+0000 7f6e01764700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6dfc09f240 0x7f6dfc1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:45.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.855+0000 7f6e02766700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6dfc09f650 0x7f6dfc131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33650/0 (socket says 172.21.15.26:33650) 2023-10-01T07:56:45.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.855+0000 7f6e01764700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6dfc09f240 0x7f6dfc1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53584/0 (socket says 172.21.15.26:53584) 2023-10-01T07:56:45.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.855+0000 7f6e02766700 1 -- 172.21.15.26:0/191941445 learned_addr learned my addr 172.21.15.26:0/191941445 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:45.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.855+0000 7f6e01f65700 1 --2- 172.21.15.26:0/191941445 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6dfc09e930 0x7f6dfc09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:45.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.855+0000 7f6e02766700 1 -- 172.21.15.26:0/191941445 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6dfc09e930 msgr2=0x7f6dfc09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:45.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.855+0000 7f6e02766700 1 --2- 172.21.15.26:0/191941445 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6dfc09e930 0x7f6dfc09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:45.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.855+0000 7f6e02766700 1 -- 172.21.15.26:0/191941445 >> v2:172.21.15.26:3300/0 conn(0x7f6dfc09f240 msgr2=0x7f6dfc1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:45.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.855+0000 7f6e02766700 1 --2- 172.21.15.26:0/191941445 >> v2:172.21.15.26:3300/0 conn(0x7f6dfc09f240 0x7f6dfc1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:45.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.855+0000 7f6e02766700 1 -- 172.21.15.26:0/191941445 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dfc09fb60 con 0x7f6dfc09f650 2023-10-01T07:56:45.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.855+0000 7f6e01f65700 1 --2- 172.21.15.26:0/191941445 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6dfc09e930 0x7f6dfc09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:45.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.855+0000 7f6e01764700 1 --2- 172.21.15.26:0/191941445 >> v2:172.21.15.26:3300/0 conn(0x7f6dfc09f240 0x7f6dfc1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:45.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.856+0000 7f6e02766700 1 --2- 172.21.15.26:0/191941445 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6dfc09f650 0x7f6dfc131d30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6df400f370 tx=0x7f6df400f680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d585ac3f1fd4ae1 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:45.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.856+0000 7f6e00f63700 1 -- 172.21.15.26:0/191941445 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df4012070 con 0x7f6dfc09f650 2023-10-01T07:56:45.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.856+0000 7f6e00f63700 1 -- 172.21.15.26:0/191941445 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df400d0d0 con 0x7f6dfc09f650 2023-10-01T07:56:45.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.856+0000 7f6e00f63700 1 -- 172.21.15.26:0/191941445 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df400d480 con 0x7f6dfc09f650 2023-10-01T07:56:45.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.857+0000 7f6e041c9700 1 -- 172.21.15.26:0/191941445 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6dfc09f650 msgr2=0x7f6dfc131d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:45.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.857+0000 7f6e041c9700 1 --2- 172.21.15.26:0/191941445 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6dfc09f650 0x7f6dfc131d30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6df400f370 tx=0x7f6df400f680 comp rx=0 tx=0).stop 2023-10-01T07:56:45.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.857+0000 7f6e041c9700 1 -- 172.21.15.26:0/191941445 shutdown_connections 2023-10-01T07:56:45.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.857+0000 7f6e041c9700 1 --2- 172.21.15.26:0/191941445 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6dfc09f650 0x7f6dfc131d30 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:45.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.857+0000 7f6e041c9700 1 --2- 172.21.15.26:0/191941445 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6dfc09e930 0x7f6dfc09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:45.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.857+0000 7f6e041c9700 1 --2- 172.21.15.26:0/191941445 >> v2:172.21.15.26:3300/0 conn(0x7f6dfc09f240 0x7f6dfc1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:45.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.857+0000 7f6e041c9700 1 -- 172.21.15.26:0/191941445 >> 172.21.15.26:0/191941445 conn(0x7f6dfc0a4210 msgr2=0x7f6dfc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:45.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.857+0000 7f6e041c9700 1 -- 172.21.15.26:0/191941445 shutdown_connections 2023-10-01T07:56:45.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.857+0000 7f6e041c9700 1 -- 172.21.15.26:0/191941445 wait complete. 2023-10-01T07:56:45.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.858+0000 7f6e041c9700 1 Processor -- start 2023-10-01T07:56:45.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.858+0000 7f6e041c9700 1 -- start start 2023-10-01T07:56:45.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.858+0000 7f6e041c9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6dfc09e930 0x7f6dfc1a2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:45.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.858+0000 7f6e041c9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6dfc09f240 0x7f6dfc1a2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:45.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.858+0000 7f6e041c9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6dfc09f650 0x7f6dfc1c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:45.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.858+0000 7f6e041c9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc1a5230 con 0x7f6dfc09f650 2023-10-01T07:56:45.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.858+0000 7f6e041c9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc1a4710 con 0x7f6dfc09f240 2023-10-01T07:56:45.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.858+0000 7f6e041c9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc1a4f70 con 0x7f6dfc09e930 2023-10-01T07:56:45.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.859+0000 7f6e01f65700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6dfc09e930 0x7f6dfc1a2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:45.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.859+0000 7f6e01f65700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6dfc09e930 0x7f6dfc1a2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:48466/0 (socket says 172.21.15.26:48466) 2023-10-01T07:56:45.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.859+0000 7f6e01f65700 1 -- 172.21.15.26:0/1746614463 learned_addr learned my addr 172.21.15.26:0/1746614463 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:45.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.859+0000 7f6e02766700 1 --2- 172.21.15.26:0/1746614463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6dfc09f650 0x7f6dfc1c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:45.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.859+0000 7f6e01764700 1 --2- 172.21.15.26:0/1746614463 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6dfc09f240 0x7f6dfc1a2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:45.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.859+0000 7f6e01f65700 1 -- 172.21.15.26:0/1746614463 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6dfc09f240 msgr2=0x7f6dfc1a2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:45.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.859+0000 7f6e01f65700 1 --2- 172.21.15.26:0/1746614463 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6dfc09f240 0x7f6dfc1a2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:45.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.859+0000 7f6e01f65700 1 -- 172.21.15.26:0/1746614463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6dfc09f650 msgr2=0x7f6dfc1c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:45.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.859+0000 7f6e01f65700 1 --2- 172.21.15.26:0/1746614463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6dfc09f650 0x7f6dfc1c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:45.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.859+0000 7f6e01f65700 1 -- 172.21.15.26:0/1746614463 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df80094a0 con 0x7f6dfc09e930 2023-10-01T07:56:45.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.859+0000 7f6e01f65700 1 --2- 172.21.15.26:0/1746614463 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6dfc09e930 0x7f6dfc1a2310 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6df800ebe0 tx=0x7f6df800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:45.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.859+0000 7f6df27fc700 1 -- 172.21.15.26:0/1746614463 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df8009780 con 0x7f6dfc09e930 2023-10-01T07:56:45.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.859+0000 7f6df27fc700 1 -- 172.21.15.26:0/1746614463 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df800c850 con 0x7f6dfc09e930 2023-10-01T07:56:45.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.859+0000 7f6e041c9700 1 -- 172.21.15.26:0/1746614463 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dec0094a0 con 0x7f6dfc09e930 2023-10-01T07:56:45.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.859+0000 7f6df27fc700 1 -- 172.21.15.26:0/1746614463 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df800cbe0 con 0x7f6dfc09e930 2023-10-01T07:56:45.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.859+0000 7f6e041c9700 1 -- 172.21.15.26:0/1746614463 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6df400f050 con 0x7f6dfc09e930 2023-10-01T07:56:45.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.860+0000 7f6df27fc700 1 -- 172.21.15.26:0/1746614463 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6df800cd40 con 0x7f6dfc09e930 2023-10-01T07:56:45.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.860+0000 7f6df27fc700 1 -- 172.21.15.26:0/1746614463 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6df803f730 con 0x7f6dfc09e930 2023-10-01T07:56:45.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.861+0000 7f6e041c9700 1 -- 172.21.15.26:0/1746614463 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dfc1a4c80 con 0x7f6dfc09e930 2023-10-01T07:56:45.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.866+0000 7f6df27fc700 1 -- 172.21.15.26:0/1746614463 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6df80232f0 con 0x7f6dfc09e930 2023-10-01T07:56:45.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.895+0000 7f0f4e7f7700 1 Processor -- start 2023-10-01T07:56:45.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.895+0000 7f0f4e7f7700 1 -- start start 2023-10-01T07:56:45.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.896+0000 7f0f4e7f7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f4806a770 0x7f0f4806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:45.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.896+0000 7f0f4e7f7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0f48131d10 0x7f0f48139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:45.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.896+0000 7f0f4e7f7700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f4809ece0 con 0x7f0f4806b080 2023-10-01T07:56:45.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.896+0000 7f0f4e7f7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f4809e760 con 0x7f0f48131d10 2023-10-01T07:56:45.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.896+0000 7f0f4e7f7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4809e040 con 0x7f0f4806a770 2023-10-01T07:56:45.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.896+0000 7f0f47fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f4806a770 0x7f0f4806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:45.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.896+0000 7f0f47fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f4806a770 0x7f0f4806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33664/0 (socket says 172.21.15.26:33664) 2023-10-01T07:56:45.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.896+0000 7f0f47fff700 1 -- 172.21.15.26:0/2675131658 learned_addr learned my addr 172.21.15.26:0/2675131658 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:45.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.896+0000 7f0f4cd94700 1 --2- 172.21.15.26:0/2675131658 >> v2:172.21.15.26:3300/0 conn(0x7f0f48131d10 0x7f0f48139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:45.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.897+0000 7f0f47fff700 1 -- 172.21.15.26:0/2675131658 >> v2:172.21.15.26:3300/0 conn(0x7f0f48131d10 msgr2=0x7f0f48139860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:45.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.897+0000 7f0f47fff700 1 --2- 172.21.15.26:0/2675131658 >> v2:172.21.15.26:3300/0 conn(0x7f0f48131d10 0x7f0f48139860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:45.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.897+0000 7f0f47fff700 1 -- 172.21.15.26:0/2675131658 >> v1:172.21.15.26:6789/0 conn(0x7f0f4806b080 legacy=0x7f0f48131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:45.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.897+0000 7f0f47fff700 1 -- 172.21.15.26:0/2675131658 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4809f630 con 0x7f0f4806a770 2023-10-01T07:56:45.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.897+0000 7f0f47fff700 1 --2- 172.21.15.26:0/2675131658 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f4806a770 0x7f0f4806ab40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0f380098f0 tx=0x7f0f38009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=849e7189e9e881d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:45.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.897+0000 7f0f46ffd700 1 -- 172.21.15.26:0/2675131658 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f38011830 con 0x7f0f4806a770 2023-10-01T07:56:45.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.897+0000 7f0f46ffd700 1 -- 172.21.15.26:0/2675131658 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f38011990 con 0x7f0f4806a770 2023-10-01T07:56:45.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.897+0000 7f0f46ffd700 1 -- 172.21.15.26:0/2675131658 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f38011d20 con 0x7f0f4806a770 2023-10-01T07:56:45.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.898+0000 7f0f4e7f7700 1 -- 172.21.15.26:0/2675131658 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f4806a770 msgr2=0x7f0f4806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:45.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.898+0000 7f0f4e7f7700 1 --2- 172.21.15.26:0/2675131658 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f4806a770 0x7f0f4806ab40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0f380098f0 tx=0x7f0f38009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:45.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.898+0000 7f0f4e7f7700 1 -- 172.21.15.26:0/2675131658 shutdown_connections 2023-10-01T07:56:45.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.898+0000 7f0f4e7f7700 1 --2- 172.21.15.26:0/2675131658 >> v2:172.21.15.26:3300/0 conn(0x7f0f48131d10 0x7f0f48139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:45.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.898+0000 7f0f4e7f7700 1 --2- 172.21.15.26:0/2675131658 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f4806a770 0x7f0f4806ab40 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:45.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.898+0000 7f0f4e7f7700 1 -- 172.21.15.26:0/2675131658 >> 172.21.15.26:0/2675131658 conn(0x7f0f48066f50 msgr2=0x7f0f4809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:45.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.898+0000 7f0f4e7f7700 1 -- 172.21.15.26:0/2675131658 shutdown_connections 2023-10-01T07:56:45.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.898+0000 7f0f4e7f7700 1 -- 172.21.15.26:0/2675131658 wait complete. 2023-10-01T07:56:45.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.899+0000 7f0f4e7f7700 1 Processor -- start 2023-10-01T07:56:45.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.899+0000 7f0f4e7f7700 1 -- start start 2023-10-01T07:56:45.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.900+0000 7f0f4e7f7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f4806a770 0x7f0f481c4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:45.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.900+0000 7f0f4e7f7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f4806b080 0x7f0f481c4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:45.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.900+0000 7f0f4e7f7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f48131d10 0x7f0f481c4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:45.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.900+0000 7f0f4e7f7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f48122310 con 0x7f0f4806a770 2023-10-01T07:56:45.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.900+0000 7f0f4e7f7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f48121f30 con 0x7f0f48131d10 2023-10-01T07:56:45.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.900+0000 7f0f4e7f7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f48120270 con 0x7f0f4806b080 2023-10-01T07:56:45.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.900+0000 7f0f47fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f4806a770 0x7f0f481c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:45.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.900+0000 7f0f477fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f4806b080 0x7f0f481c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:45.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.900+0000 7f0f47fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f4806a770 0x7f0f481c4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53608/0 (socket says 172.21.15.26:53608) 2023-10-01T07:56:45.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.900+0000 7f0f47fff700 1 -- 172.21.15.26:0/49700516 learned_addr learned my addr 172.21.15.26:0/49700516 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:45.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.900+0000 7f0f4cd94700 1 --2- 172.21.15.26:0/49700516 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f48131d10 0x7f0f481c4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:45.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.900+0000 7f0f47fff700 1 -- 172.21.15.26:0/49700516 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f4806b080 msgr2=0x7f0f481c4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:45.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.900+0000 7f0f47fff700 1 --2- 172.21.15.26:0/49700516 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f4806b080 0x7f0f481c4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:45.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.900+0000 7f0f47fff700 1 -- 172.21.15.26:0/49700516 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f48131d10 msgr2=0x7f0f481c4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:45.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.900+0000 7f0f47fff700 1 --2- 172.21.15.26:0/49700516 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f48131d10 0x7f0f481c4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:45.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.900+0000 7f0f47fff700 1 -- 172.21.15.26:0/49700516 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f38009550 con 0x7f0f4806a770 2023-10-01T07:56:45.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.900+0000 7f0f47fff700 1 --2- 172.21.15.26:0/49700516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f4806a770 0x7f0f481c4000 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f0f38009c40 tx=0x7f0f38004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:45.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.901+0000 7f0f44ff9700 1 -- 172.21.15.26:0/49700516 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f38004400 con 0x7f0f4806a770 2023-10-01T07:56:45.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.901+0000 7f0f44ff9700 1 -- 172.21.15.26:0/49700516 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f3801f070 con 0x7f0f4806a770 2023-10-01T07:56:45.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.901+0000 7f0f4e7f7700 1 -- 172.21.15.26:0/49700516 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f48120820 con 0x7f0f4806a770 2023-10-01T07:56:45.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.901+0000 7f0f44ff9700 1 -- 172.21.15.26:0/49700516 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f380038c0 con 0x7f0f4806a770 2023-10-01T07:56:45.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.901+0000 7f0f4e7f7700 1 -- 172.21.15.26:0/49700516 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f48120ee0 con 0x7f0f4806a770 2023-10-01T07:56:45.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.902+0000 7f0f44ff9700 1 -- 172.21.15.26:0/49700516 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f38021030 con 0x7f0f4806a770 2023-10-01T07:56:45.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.902+0000 7f0f4e7f7700 1 -- 172.21.15.26:0/49700516 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f4809b610 con 0x7f0f4806a770 2023-10-01T07:56:45.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.902+0000 7f0f44ff9700 1 -- 172.21.15.26:0/49700516 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0f38040ae0 con 0x7f0f4806a770 2023-10-01T07:56:45.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.907+0000 7f0f44ff9700 1 -- 172.21.15.26:0/49700516 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f3800b9d0 con 0x7f0f4806a770 2023-10-01T07:56:45.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.954+0000 7fa3fc5bb700 1 Processor -- start 2023-10-01T07:56:45.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.954+0000 7fa3fc5bb700 1 -- start start 2023-10-01T07:56:45.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.954+0000 7fa3fc5bb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3f406a770 0x7fa3f406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:45.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.954+0000 7fa3fc5bb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa3f406b080 0x7fa3f4131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:45.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.954+0000 7fa3fc5bb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa3f4131b40 0x7fa3f4131fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:45.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.954+0000 7fa3fc5bb700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f409ece0 con 0x7fa3f4131b40 2023-10-01T07:56:45.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.954+0000 7fa3fc5bb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f409e760 con 0x7fa3f406a770 2023-10-01T07:56:45.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.954+0000 7fa3fc5bb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f409e040 con 0x7fa3f406b080 2023-10-01T07:56:45.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.955+0000 7fa3fa357700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3f406a770 0x7fa3f406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:45.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.955+0000 7fa3fa357700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3f406a770 0x7fa3f406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33694/0 (socket says 172.21.15.26:33694) 2023-10-01T07:56:45.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.955+0000 7fa3fa357700 1 -- 172.21.15.26:0/3281089416 learned_addr learned my addr 172.21.15.26:0/3281089416 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:45.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.955+0000 7fa3f9b56700 1 --2- 172.21.15.26:0/3281089416 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa3f406b080 0x7fa3f4131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:45.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.955+0000 7fa3fab58700 1 --2- 172.21.15.26:0/3281089416 >> v2:172.21.15.26:3300/0 conn(0x7fa3f4131b40 0x7fa3f4131fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:45.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.955+0000 7fa3fa357700 1 -- 172.21.15.26:0/3281089416 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa3f406b080 msgr2=0x7fa3f4131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:45.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.955+0000 7fa3fa357700 1 --2- 172.21.15.26:0/3281089416 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa3f406b080 0x7fa3f4131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:45.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.955+0000 7fa3fa357700 1 -- 172.21.15.26:0/3281089416 >> v2:172.21.15.26:3300/0 conn(0x7fa3f4131b40 msgr2=0x7fa3f4131fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:45.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.955+0000 7fa3fa357700 1 --2- 172.21.15.26:0/3281089416 >> v2:172.21.15.26:3300/0 conn(0x7fa3f4131b40 0x7fa3f4131fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:45.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.955+0000 7fa3fa357700 1 -- 172.21.15.26:0/3281089416 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f409f630 con 0x7fa3f406a770 2023-10-01T07:56:45.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.955+0000 7fa3f9b56700 1 --2- 172.21.15.26:0/3281089416 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa3f406b080 0x7fa3f4131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:45.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.955+0000 7fa3fa357700 1 --2- 172.21.15.26:0/3281089416 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3f406a770 0x7fa3f406ab40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa3f00098f0 tx=0x7fa3f0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b24b8eca33eb6877 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:45.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.955+0000 7fa3f9355700 1 -- 172.21.15.26:0/3281089416 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0011830 con 0x7fa3f406a770 2023-10-01T07:56:45.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.955+0000 7fa3f9355700 1 -- 172.21.15.26:0/3281089416 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f0011990 con 0x7fa3f406a770 2023-10-01T07:56:45.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.955+0000 7fa3f9355700 1 -- 172.21.15.26:0/3281089416 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0011d20 con 0x7fa3f406a770 2023-10-01T07:56:45.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.956+0000 7fa3fc5bb700 1 -- 172.21.15.26:0/3281089416 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3f406a770 msgr2=0x7fa3f406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:45.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.956+0000 7fa3fc5bb700 1 --2- 172.21.15.26:0/3281089416 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3f406a770 0x7fa3f406ab40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa3f00098f0 tx=0x7fa3f0009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:45.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.956+0000 7fa3fc5bb700 1 -- 172.21.15.26:0/3281089416 shutdown_connections 2023-10-01T07:56:45.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.956+0000 7fa3fc5bb700 1 --2- 172.21.15.26:0/3281089416 >> v2:172.21.15.26:3300/0 conn(0x7fa3f4131b40 0x7fa3f4131fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:45.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.956+0000 7fa3fc5bb700 1 --2- 172.21.15.26:0/3281089416 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3f406a770 0x7fa3f406ab40 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:45.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.956+0000 7fa3fc5bb700 1 --2- 172.21.15.26:0/3281089416 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa3f406b080 0x7fa3f4131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:45.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.956+0000 7fa3fc5bb700 1 -- 172.21.15.26:0/3281089416 >> 172.21.15.26:0/3281089416 conn(0x7fa3f4066f50 msgr2=0x7fa3f409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:45.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.956+0000 7fa3fc5bb700 1 -- 172.21.15.26:0/3281089416 shutdown_connections 2023-10-01T07:56:45.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.956+0000 7fa3fc5bb700 1 -- 172.21.15.26:0/3281089416 wait complete. 2023-10-01T07:56:45.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.957+0000 7fa3fc5bb700 1 Processor -- start 2023-10-01T07:56:45.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.957+0000 7fa3fc5bb700 1 -- start start 2023-10-01T07:56:45.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.958+0000 7fa3fc5bb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa3f406a770 0x7fa3f4120010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:45.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.958+0000 7fa3fc5bb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3f406b080 0x7fa3f4120550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:45.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.958+0000 7fa3fc5bb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f4131b40 0x7fa3f4120a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:45.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.958+0000 7fa3fc5bb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f4071e60 con 0x7fa3f4131b40 2023-10-01T07:56:45.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.958+0000 7fa3fc5bb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f4123850 con 0x7fa3f406b080 2023-10-01T07:56:45.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.958+0000 7fa3fc5bb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f40a38f0 con 0x7fa3f406a770 2023-10-01T07:56:45.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.958+0000 7fa3fa357700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa3f406a770 0x7fa3f4120010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:45.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.958+0000 7fa3f9b56700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3f406b080 0x7fa3f4120550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:45.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.958+0000 7fa3fa357700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa3f406a770 0x7fa3f4120010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:48496/0 (socket says 172.21.15.26:48496) 2023-10-01T07:56:45.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.958+0000 7fa3fa357700 1 -- 172.21.15.26:0/3900222799 learned_addr learned my addr 172.21.15.26:0/3900222799 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:45.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.958+0000 7fa3f9b56700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3f406b080 0x7fa3f4120550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33706/0 (socket says 172.21.15.26:33706) 2023-10-01T07:56:45.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.958+0000 7fa3fab58700 1 --2- 172.21.15.26:0/3900222799 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f4131b40 0x7fa3f4120a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:45.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.958+0000 7fa3fa357700 1 -- 172.21.15.26:0/3900222799 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3f406b080 msgr2=0x7fa3f4120550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:45.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.958+0000 7fa3fa357700 1 --2- 172.21.15.26:0/3900222799 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3f406b080 0x7fa3f4120550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:45.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.958+0000 7fa3fa357700 1 -- 172.21.15.26:0/3900222799 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f4131b40 msgr2=0x7fa3f4120a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:45.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.958+0000 7fa3fa357700 1 --2- 172.21.15.26:0/3900222799 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f4131b40 0x7fa3f4120a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:45.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.958+0000 7fa3fa357700 1 -- 172.21.15.26:0/3900222799 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e40094a0 con 0x7fa3f406a770 2023-10-01T07:56:45.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.958+0000 7fa3fab58700 1 --2- 172.21.15.26:0/3900222799 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f4131b40 0x7fa3f4120a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:56:45.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.958+0000 7fa3fa357700 1 --2- 172.21.15.26:0/3900222799 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa3f406a770 0x7fa3f4120010 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0000c00 tx=0x7fa3f0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:45.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.959+0000 7fa3eaffd700 1 -- 172.21.15.26:0/3900222799 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0004240 con 0x7fa3f406a770 2023-10-01T07:56:45.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.959+0000 7fa3eaffd700 1 -- 172.21.15.26:0/3900222799 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f001f070 con 0x7fa3f406a770 2023-10-01T07:56:45.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.959+0000 7fa3eaffd700 1 -- 172.21.15.26:0/3900222799 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f00045c0 con 0x7fa3f406a770 2023-10-01T07:56:45.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.959+0000 7fa3fc5bb700 1 -- 172.21.15.26:0/3900222799 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f0009550 con 0x7fa3f406a770 2023-10-01T07:56:45.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.959+0000 7fa3fc5bb700 1 -- 172.21.15.26:0/3900222799 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f4122410 con 0x7fa3f406a770 2023-10-01T07:56:45.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.960+0000 7fa3eaffd700 1 -- 172.21.15.26:0/3900222799 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa3f0021030 con 0x7fa3f406a770 2023-10-01T07:56:45.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.960+0000 7fa3eaffd700 1 -- 172.21.15.26:0/3900222799 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa3f0040890 con 0x7fa3f406a770 2023-10-01T07:56:45.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.960+0000 7fa3fc5bb700 1 -- 172.21.15.26:0/3900222799 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f4074ea0 con 0x7fa3f406a770 2023-10-01T07:56:45.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:45.969+0000 7fa3eaffd700 1 -- 172.21.15.26:0/3900222799 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa3f0015020 con 0x7fa3f406a770 2023-10-01T07:56:46.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.075+0000 7f6e041c9700 1 -- 172.21.15.26:0/1746614463 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6dfc074ea0 con 0x7f6dfc09e930 2023-10-01T07:56:46.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.075+0000 7f6df27fc700 1 -- 172.21.15.26:0/1746614463 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6df8021020 con 0x7f6dfc09e930 2023-10-01T07:56:46.077 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:46.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.078+0000 7f6e041c9700 1 -- 172.21.15.26:0/1746614463 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6dfc09e930 msgr2=0x7f6dfc1a2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:46.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.078+0000 7f6e041c9700 1 --2- 172.21.15.26:0/1746614463 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6dfc09e930 0x7f6dfc1a2310 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6df800ebe0 tx=0x7f6df800eef0 comp rx=0 tx=0).stop 2023-10-01T07:56:46.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.078+0000 7f6e041c9700 1 -- 172.21.15.26:0/1746614463 shutdown_connections 2023-10-01T07:56:46.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.078+0000 7f6e041c9700 1 --2- 172.21.15.26:0/1746614463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6dfc09f650 0x7f6dfc1c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:46.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.078+0000 7f6e041c9700 1 --2- 172.21.15.26:0/1746614463 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6dfc09e930 0x7f6dfc1a2310 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:46.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.078+0000 7f6e041c9700 1 --2- 172.21.15.26:0/1746614463 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6dfc09f240 0x7f6dfc1a2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:46.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.078+0000 7f6e041c9700 1 -- 172.21.15.26:0/1746614463 >> 172.21.15.26:0/1746614463 conn(0x7f6dfc0a4210 msgr2=0x7f6dfc1b6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:46.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.078+0000 7f6e041c9700 1 -- 172.21.15.26:0/1746614463 shutdown_connections 2023-10-01T07:56:46.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.078+0000 7f6e041c9700 1 -- 172.21.15.26:0/1746614463 wait complete. 2023-10-01T07:56:46.093 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:46.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.123+0000 7f0f4e7f7700 1 -- 172.21.15.26:0/49700516 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0f48074ea0 con 0x7f0f4806a770 2023-10-01T07:56:46.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.123+0000 7f0f44ff9700 1 -- 172.21.15.26:0/49700516 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0f38015070 con 0x7f0f4806a770 2023-10-01T07:56:46.125 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:46.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.126+0000 7f0f4e7f7700 1 -- 172.21.15.26:0/49700516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f4806a770 msgr2=0x7f0f481c4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:46.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.126+0000 7f0f4e7f7700 1 --2- 172.21.15.26:0/49700516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f4806a770 0x7f0f481c4000 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f0f38009c40 tx=0x7f0f38004750 comp rx=0 tx=0).stop 2023-10-01T07:56:46.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.126+0000 7f0f4e7f7700 1 -- 172.21.15.26:0/49700516 shutdown_connections 2023-10-01T07:56:46.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.126+0000 7f0f4e7f7700 1 --2- 172.21.15.26:0/49700516 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f48131d10 0x7f0f481c4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:46.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.126+0000 7f0f4e7f7700 1 --2- 172.21.15.26:0/49700516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f4806a770 0x7f0f481c4000 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:46.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.126+0000 7f0f4e7f7700 1 --2- 172.21.15.26:0/49700516 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f4806b080 0x7f0f481c4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:46.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.126+0000 7f0f4e7f7700 1 -- 172.21.15.26:0/49700516 >> 172.21.15.26:0/49700516 conn(0x7f0f48066f50 msgr2=0x7f0f480a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:46.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.126+0000 7f0f4e7f7700 1 -- 172.21.15.26:0/49700516 shutdown_connections 2023-10-01T07:56:46.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.126+0000 7f0f4e7f7700 1 -- 172.21.15.26:0/49700516 wait complete. 2023-10-01T07:56:46.141 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:46.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.178+0000 7fa3fc5bb700 1 -- 172.21.15.26:0/3900222799 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa3f406c360 con 0x7fa3f406a770 2023-10-01T07:56:46.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.178+0000 7fa3eaffd700 1 -- 172.21.15.26:0/3900222799 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa3f001a450 con 0x7fa3f406a770 2023-10-01T07:56:46.180 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:46.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.180+0000 7fa3fc5bb700 1 -- 172.21.15.26:0/3900222799 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa3f406a770 msgr2=0x7fa3f4120010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:46.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.180+0000 7fa3fc5bb700 1 --2- 172.21.15.26:0/3900222799 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa3f406a770 0x7fa3f4120010 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0000c00 tx=0x7fa3f0004750 comp rx=0 tx=0).stop 2023-10-01T07:56:46.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.180+0000 7fa3fc5bb700 1 -- 172.21.15.26:0/3900222799 shutdown_connections 2023-10-01T07:56:46.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.180+0000 7fa3fc5bb700 1 --2- 172.21.15.26:0/3900222799 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f4131b40 0x7fa3f4120a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:46.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.180+0000 7fa3fc5bb700 1 --2- 172.21.15.26:0/3900222799 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa3f406a770 0x7fa3f4120010 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:46.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.180+0000 7fa3fc5bb700 1 --2- 172.21.15.26:0/3900222799 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3f406b080 0x7fa3f4120550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:46.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.180+0000 7fa3fc5bb700 1 -- 172.21.15.26:0/3900222799 >> 172.21.15.26:0/3900222799 conn(0x7fa3f4066f50 msgr2=0x7fa3f4071520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:46.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.181+0000 7fa3fc5bb700 1 -- 172.21.15.26:0/3900222799 shutdown_connections 2023-10-01T07:56:46.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.181+0000 7fa3fc5bb700 1 -- 172.21.15.26:0/3900222799 wait complete. 2023-10-01T07:56:46.195 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:46.765 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:46.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.911+0000 7feb8f497700 1 Processor -- start 2023-10-01T07:56:46.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.911+0000 7feb8f497700 1 -- start start 2023-10-01T07:56:46.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.911+0000 7feb8f497700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb881337f0 0x7feb88138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:46.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.911+0000 7feb8f497700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feb88138dc0 0x7feb8813b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:46.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.911+0000 7feb8f497700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb8806b990 con 0x7feb88133420 2023-10-01T07:56:46.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.911+0000 7feb8f497700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb8809b0e0 con 0x7feb88138dc0 2023-10-01T07:56:46.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.911+0000 7feb8f497700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb88133c20 con 0x7feb881337f0 2023-10-01T07:56:46.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.911+0000 7feb8da34700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feb88138dc0 0x7feb8813b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:46.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.911+0000 7feb8ca32700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb881337f0 0x7feb88138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:46.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.911+0000 7feb8da34700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feb88138dc0 0x7feb8813b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53640/0 (socket says 172.21.15.26:53640) 2023-10-01T07:56:46.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.911+0000 7feb8ca32700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb881337f0 0x7feb88138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33722/0 (socket says 172.21.15.26:33722) 2023-10-01T07:56:46.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.911+0000 7feb8da34700 1 -- 172.21.15.26:0/2184259254 learned_addr learned my addr 172.21.15.26:0/2184259254 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:46.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.911+0000 7feb8da34700 1 -- 172.21.15.26:0/2184259254 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb881337f0 msgr2=0x7feb88138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:46.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.911+0000 7feb8da34700 1 --2- 172.21.15.26:0/2184259254 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb881337f0 0x7feb88138880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:46.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.911+0000 7feb8da34700 1 -- 172.21.15.26:0/2184259254 >> v1:172.21.15.26:6789/0 conn(0x7feb88133420 legacy=0x7feb88133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:46.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.911+0000 7feb8da34700 1 -- 172.21.15.26:0/2184259254 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb880a0590 con 0x7feb88138dc0 2023-10-01T07:56:46.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.911+0000 7feb8ca32700 1 --2- 172.21.15.26:0/2184259254 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb881337f0 0x7feb88138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:46.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.911+0000 7feb8da34700 1 --2- 172.21.15.26:0/2184259254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb88138dc0 0x7feb8813b1a0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7feb80009e50 tx=0x7feb8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e483d62184d41d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:46.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.911+0000 7feb7ffff700 1 -- 172.21.15.26:0/2184259254 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8000e070 con 0x7feb88138dc0 2023-10-01T07:56:46.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.911+0000 7feb7ffff700 1 -- 172.21.15.26:0/2184259254 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8000b910 con 0x7feb88138dc0 2023-10-01T07:56:46.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.911+0000 7feb7ffff700 1 -- 172.21.15.26:0/2184259254 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8000bcc0 con 0x7feb88138dc0 2023-10-01T07:56:46.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.912+0000 7feb8f497700 1 -- 172.21.15.26:0/2184259254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb88138dc0 msgr2=0x7feb8813b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:46.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.912+0000 7feb8f497700 1 --2- 172.21.15.26:0/2184259254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb88138dc0 0x7feb8813b1a0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7feb80009e50 tx=0x7feb8000b330 comp rx=0 tx=0).stop 2023-10-01T07:56:46.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.912+0000 7feb8f497700 1 -- 172.21.15.26:0/2184259254 shutdown_connections 2023-10-01T07:56:46.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.912+0000 7feb8f497700 1 --2- 172.21.15.26:0/2184259254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb88138dc0 0x7feb8813b1a0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:46.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.912+0000 7feb8f497700 1 --2- 172.21.15.26:0/2184259254 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb881337f0 0x7feb88138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:46.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.912+0000 7feb8f497700 1 -- 172.21.15.26:0/2184259254 >> 172.21.15.26:0/2184259254 conn(0x7feb880a4210 msgr2=0x7feb880a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:46.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.912+0000 7feb8f497700 1 -- 172.21.15.26:0/2184259254 shutdown_connections 2023-10-01T07:56:46.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.912+0000 7feb8f497700 1 -- 172.21.15.26:0/2184259254 wait complete. 2023-10-01T07:56:46.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.913+0000 7feb8f497700 1 Processor -- start 2023-10-01T07:56:46.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.913+0000 7feb8f497700 1 -- start start 2023-10-01T07:56:46.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.914+0000 7feb8f497700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb88133420 0x7feb8812f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:46.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.914+0000 7feb8f497700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb881337f0 0x7feb8812f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:46.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.914+0000 7feb8f497700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb88138dc0 0x7feb8812fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:46.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.914+0000 7feb8f497700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb881388a0 con 0x7feb88133420 2023-10-01T07:56:46.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.914+0000 7feb8f497700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8809dc90 con 0x7feb881337f0 2023-10-01T07:56:46.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.914+0000 7feb8f497700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb8809ca70 con 0x7feb88138dc0 2023-10-01T07:56:46.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.914+0000 7feb8ca32700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb881337f0 0x7feb8812f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:46.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.914+0000 7feb8d233700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb88133420 0x7feb8812f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:46.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.914+0000 7feb8ca32700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb881337f0 0x7feb8812f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33724/0 (socket says 172.21.15.26:33724) 2023-10-01T07:56:46.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.914+0000 7feb8d233700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb88133420 0x7feb8812f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53650/0 (socket says 172.21.15.26:53650) 2023-10-01T07:56:46.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.914+0000 7feb8ca32700 1 -- 172.21.15.26:0/1857449406 learned_addr learned my addr 172.21.15.26:0/1857449406 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:46.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.914+0000 7feb8da34700 1 --2- 172.21.15.26:0/1857449406 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb88138dc0 0x7feb8812fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:46.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.914+0000 7feb8d233700 1 -- 172.21.15.26:0/1857449406 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb88138dc0 msgr2=0x7feb8812fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:46.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.914+0000 7feb8d233700 1 --2- 172.21.15.26:0/1857449406 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb88138dc0 0x7feb8812fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:46.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.914+0000 7feb8d233700 1 -- 172.21.15.26:0/1857449406 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb881337f0 msgr2=0x7feb8812f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:46.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.914+0000 7feb8d233700 1 --2- 172.21.15.26:0/1857449406 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb881337f0 0x7feb8812f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:46.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.914+0000 7feb8d233700 1 -- 172.21.15.26:0/1857449406 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb780094a0 con 0x7feb88133420 2023-10-01T07:56:46.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.914+0000 7feb8ca32700 1 --2- 172.21.15.26:0/1857449406 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb881337f0 0x7feb8812f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:46.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.914+0000 7feb8d233700 1 --2- 172.21.15.26:0/1857449406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb88133420 0x7feb8812f130 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7feb84000f60 tx=0x7feb8400c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:46.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.914+0000 7feb7dffb700 1 -- 172.21.15.26:0/1857449406 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb840052d0 con 0x7feb88133420 2023-10-01T07:56:46.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.914+0000 7feb7dffb700 1 -- 172.21.15.26:0/1857449406 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb84005430 con 0x7feb88133420 2023-10-01T07:56:46.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.914+0000 7feb8f497700 1 -- 172.21.15.26:0/1857449406 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb80009b30 con 0x7feb88133420 2023-10-01T07:56:46.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.915+0000 7feb7dffb700 1 -- 172.21.15.26:0/1857449406 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb840038c0 con 0x7feb88133420 2023-10-01T07:56:46.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.915+0000 7feb8f497700 1 -- 172.21.15.26:0/1857449406 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb8809d510 con 0x7feb88133420 2023-10-01T07:56:46.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.915+0000 7feb7dffb700 1 -- 172.21.15.26:0/1857449406 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feb84003a20 con 0x7feb88133420 2023-10-01T07:56:46.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.915+0000 7feb7dffb700 1 -- 172.21.15.26:0/1857449406 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7feb8403e9c0 con 0x7feb88133420 2023-10-01T07:56:46.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.916+0000 7feb8f497700 1 -- 172.21.15.26:0/1857449406 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb8809f130 con 0x7feb88133420 2023-10-01T07:56:46.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:46.921+0000 7feb7dffb700 1 -- 172.21.15.26:0/1857449406 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feb84011590 con 0x7feb88133420 2023-10-01T07:56:47.094 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:47.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.125+0000 7feb8f497700 1 -- 172.21.15.26:0/1857449406 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7feb8813b660 con 0x7feb88133420 2023-10-01T07:56:47.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.125+0000 7feb7dffb700 1 -- 172.21.15.26:0/1857449406 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feb84017020 con 0x7feb88133420 2023-10-01T07:56:47.127 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:47.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.129+0000 7feb8f497700 1 -- 172.21.15.26:0/1857449406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb88133420 msgr2=0x7feb8812f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:47.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.129+0000 7feb8f497700 1 --2- 172.21.15.26:0/1857449406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb88133420 0x7feb8812f130 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7feb84000f60 tx=0x7feb8400c730 comp rx=0 tx=0).stop 2023-10-01T07:56:47.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.129+0000 7feb8f497700 1 -- 172.21.15.26:0/1857449406 shutdown_connections 2023-10-01T07:56:47.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.129+0000 7feb8f497700 1 --2- 172.21.15.26:0/1857449406 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb88138dc0 0x7feb8812fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:47.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.129+0000 7feb8f497700 1 --2- 172.21.15.26:0/1857449406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb88133420 0x7feb8812f130 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:47.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.129+0000 7feb8f497700 1 --2- 172.21.15.26:0/1857449406 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb881337f0 0x7feb8812f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:47.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.129+0000 7feb8f497700 1 -- 172.21.15.26:0/1857449406 >> 172.21.15.26:0/1857449406 conn(0x7feb880a4210 msgr2=0x7feb880a0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:47.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.129+0000 7feb8f497700 1 -- 172.21.15.26:0/1857449406 shutdown_connections 2023-10-01T07:56:47.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.129+0000 7feb8f497700 1 -- 172.21.15.26:0/1857449406 wait complete. 2023-10-01T07:56:47.142 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:47.148 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:47.196 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:47.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.246+0000 7f5243efb700 1 Processor -- start 2023-10-01T07:56:47.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.246+0000 7f5243efb700 1 -- start start 2023-10-01T07:56:47.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.247+0000 7f5243efb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f523c1338c0 0x7f523c133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:47.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.247+0000 7f5243efb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f523c1341d0 0x7f523c09de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:47.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.247+0000 7f5243efb700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f523c06f720 con 0x7f523c09e390 2023-10-01T07:56:47.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.247+0000 7f5243efb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523c070c80 con 0x7f523c1341d0 2023-10-01T07:56:47.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.247+0000 7f5243efb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f523c06fce0 con 0x7f523c1338c0 2023-10-01T07:56:47.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.247+0000 7f5241c97700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f523c1338c0 0x7f523c133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:47.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.247+0000 7f5241496700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f523c1341d0 0x7f523c09de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:47.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.247+0000 7f5242498700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f523c09e390 0x7f523c13a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54660/0 (socket says 172.21.15.26:54660) 2023-10-01T07:56:47.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.248+0000 7f5242498700 1 -- 172.21.15.26:0/2093613576 learned_addr learned my addr 172.21.15.26:0/2093613576 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:47.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.248+0000 7f5241c97700 1 -- 172.21.15.26:0/2093613576 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f523c1341d0 msgr2=0x7f523c09de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:47.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.248+0000 7f5241c97700 1 --2- 172.21.15.26:0/2093613576 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f523c1341d0 0x7f523c09de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:47.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.248+0000 7f5241c97700 1 -- 172.21.15.26:0/2093613576 >> v1:172.21.15.26:6789/0 conn(0x7f523c09e390 legacy=0x7f523c13a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:47.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.248+0000 7f5240c95700 1 -- 172.21.15.26:0/2093613576 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 446083545 0 0) 0x7f523c06f720 con 0x7f523c09e390 2023-10-01T07:56:47.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.248+0000 7f5241c97700 1 -- 172.21.15.26:0/2093613576 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523c1336a0 con 0x7f523c1338c0 2023-10-01T07:56:47.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.248+0000 7f5241c97700 1 --2- 172.21.15.26:0/2093613576 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f523c1338c0 0x7f523c133c90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5238009870 tx=0x7f5238009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=827523aa271e9e80 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:47.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.248+0000 7f5240c95700 1 -- 172.21.15.26:0/2093613576 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5238011830 con 0x7f523c1338c0 2023-10-01T07:56:47.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.248+0000 7f5240c95700 1 -- 172.21.15.26:0/2093613576 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5238011990 con 0x7f523c1338c0 2023-10-01T07:56:47.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.248+0000 7f5240c95700 1 -- 172.21.15.26:0/2093613576 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5238011d20 con 0x7f523c1338c0 2023-10-01T07:56:47.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.249+0000 7f5243efb700 1 -- 172.21.15.26:0/2093613576 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f523c1338c0 msgr2=0x7f523c133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:47.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.249+0000 7f5243efb700 1 --2- 172.21.15.26:0/2093613576 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f523c1338c0 0x7f523c133c90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5238009870 tx=0x7f5238009b80 comp rx=0 tx=0).stop 2023-10-01T07:56:47.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.249+0000 7f5243efb700 1 -- 172.21.15.26:0/2093613576 shutdown_connections 2023-10-01T07:56:47.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.249+0000 7f5243efb700 1 --2- 172.21.15.26:0/2093613576 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f523c1338c0 0x7f523c133c90 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:47.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.249+0000 7f5243efb700 1 --2- 172.21.15.26:0/2093613576 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f523c1341d0 0x7f523c09de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:47.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.249+0000 7f5243efb700 1 -- 172.21.15.26:0/2093613576 >> 172.21.15.26:0/2093613576 conn(0x7f523c0a2aa0 msgr2=0x7f523c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:47.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.249+0000 7f5243efb700 1 -- 172.21.15.26:0/2093613576 shutdown_connections 2023-10-01T07:56:47.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.249+0000 7f5243efb700 1 -- 172.21.15.26:0/2093613576 wait complete. 2023-10-01T07:56:47.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.250+0000 7f5243efb700 1 Processor -- start 2023-10-01T07:56:47.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.250+0000 7f5243efb700 1 -- start start 2023-10-01T07:56:47.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.251+0000 7f5243efb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f523c09e390 0x7f523c11eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:47.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.251+0000 7f5243efb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f523c1338c0 0x7f523c11f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:47.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.251+0000 7f5243efb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f523c1341d0 0x7f523c11f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:47.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.251+0000 7f5243efb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523c121880 con 0x7f523c1338c0 2023-10-01T07:56:47.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.251+0000 7f5243efb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523c072660 con 0x7f523c09e390 2023-10-01T07:56:47.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.251+0000 7f5243efb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f523c120af0 con 0x7f523c1341d0 2023-10-01T07:56:47.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.251+0000 7f5241c97700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f523c09e390 0x7f523c11eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:47.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.251+0000 7f5241c97700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f523c09e390 0x7f523c11eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33744/0 (socket says 172.21.15.26:33744) 2023-10-01T07:56:47.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.251+0000 7f5241c97700 1 -- 172.21.15.26:0/92822909 learned_addr learned my addr 172.21.15.26:0/92822909 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:47.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.251+0000 7f5242498700 1 --2- 172.21.15.26:0/92822909 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f523c1341d0 0x7f523c11f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:47.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.251+0000 7f5241c97700 1 -- 172.21.15.26:0/92822909 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f523c1341d0 msgr2=0x7f523c11f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:47.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.251+0000 7f5241c97700 1 --2- 172.21.15.26:0/92822909 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f523c1341d0 0x7f523c11f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:47.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.251+0000 7f5241496700 1 --2- 172.21.15.26:0/92822909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f523c1338c0 0x7f523c11f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:47.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.251+0000 7f5241c97700 1 -- 172.21.15.26:0/92822909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f523c1338c0 msgr2=0x7f523c11f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:47.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.251+0000 7f5241c97700 1 --2- 172.21.15.26:0/92822909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f523c1338c0 0x7f523c11f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:47.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.251+0000 7f5241c97700 1 -- 172.21.15.26:0/92822909 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52380094a0 con 0x7f523c09e390 2023-10-01T07:56:47.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.251+0000 7f5241496700 1 --2- 172.21.15.26:0/92822909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f523c1338c0 0x7f523c11f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:56:47.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.252+0000 7f5241c97700 1 --2- 172.21.15.26:0/92822909 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f523c09e390 0x7f523c11eae0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f52380090b0 tx=0x7f5238004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:47.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.252+0000 7f52327fc700 1 -- 172.21.15.26:0/92822909 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52380045d0 con 0x7f523c09e390 2023-10-01T07:56:47.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.252+0000 7f52327fc700 1 -- 172.21.15.26:0/92822909 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523801f070 con 0x7f523c09e390 2023-10-01T07:56:47.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.252+0000 7f52327fc700 1 -- 172.21.15.26:0/92822909 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52380038e0 con 0x7f523c09e390 2023-10-01T07:56:47.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.252+0000 7f5243efb700 1 -- 172.21.15.26:0/92822909 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f523c06f960 con 0x7f523c09e390 2023-10-01T07:56:47.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.252+0000 7f5243efb700 1 -- 172.21.15.26:0/92822909 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f523c121bf0 con 0x7f523c09e390 2023-10-01T07:56:47.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.253+0000 7f52327fc700 1 -- 172.21.15.26:0/92822909 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5238003a40 con 0x7f523c09e390 2023-10-01T07:56:47.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.253+0000 7f52327fc700 1 -- 172.21.15.26:0/92822909 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5238021070 con 0x7f523c09e390 2023-10-01T07:56:47.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.253+0000 7f5243efb700 1 -- 172.21.15.26:0/92822909 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f523c074ea0 con 0x7f523c09e390 2023-10-01T07:56:47.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.258+0000 7f52327fc700 1 -- 172.21.15.26:0/92822909 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f523801a430 con 0x7f523c09e390 2023-10-01T07:56:47.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.286+0000 7f482dd41700 1 Processor -- start 2023-10-01T07:56:47.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.286+0000 7f482dd41700 1 -- start start 2023-10-01T07:56:47.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.287+0000 7f482dd41700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48280a0a30 0x7f48280a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:47.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.287+0000 7f482dd41700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f48280a1340 0x7f4828133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:47.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.287+0000 7f482dd41700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f482809edd0 con 0x7f4828133fa0 2023-10-01T07:56:47.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.287+0000 7f482dd41700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f482809e1f0 con 0x7f48280a1340 2023-10-01T07:56:47.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.287+0000 7f482dd41700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f482809dc50 con 0x7f48280a0a30 2023-10-01T07:56:47.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.287+0000 7f481effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f48280a1340 0x7f4828133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:47.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.287+0000 7f481effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f48280a1340 0x7f4828133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53654/0 (socket says 172.21.15.26:53654) 2023-10-01T07:56:47.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.287+0000 7f481effd700 1 -- 172.21.15.26:0/2944908581 learned_addr learned my addr 172.21.15.26:0/2944908581 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:47.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.287+0000 7f48277fe700 1 --2- 172.21.15.26:0/2944908581 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48280a0a30 0x7f48280a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:47.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.288+0000 7f48277fe700 1 -- 172.21.15.26:0/2944908581 >> v2:172.21.15.26:3300/0 conn(0x7f48280a1340 msgr2=0x7f4828133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:47.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.288+0000 7f48277fe700 1 --2- 172.21.15.26:0/2944908581 >> v2:172.21.15.26:3300/0 conn(0x7f48280a1340 0x7f4828133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:47.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.288+0000 7f48277fe700 1 -- 172.21.15.26:0/2944908581 >> v1:172.21.15.26:6789/0 conn(0x7f4828133fa0 legacy=0x7f482813ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:47.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.288+0000 7f4826ffd700 1 -- 172.21.15.26:0/2944908581 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3217546913 0 0) 0x7f482809edd0 con 0x7f4828133fa0 2023-10-01T07:56:47.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.288+0000 7f48277fe700 1 -- 172.21.15.26:0/2944908581 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48280a1fe0 con 0x7f48280a0a30 2023-10-01T07:56:47.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.288+0000 7f481effd700 1 --2- 172.21.15.26:0/2944908581 >> v2:172.21.15.26:3300/0 conn(0x7f48280a1340 0x7f4828133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:47.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.288+0000 7f48277fe700 1 --2- 172.21.15.26:0/2944908581 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48280a0a30 0x7f48280a0e00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4818009840 tx=0x7f4818009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef84935e93bfbca3 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:47.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.288+0000 7f4826ffd700 1 -- 172.21.15.26:0/2944908581 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4818011830 con 0x7f48280a0a30 2023-10-01T07:56:47.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.288+0000 7f4826ffd700 1 -- 172.21.15.26:0/2944908581 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4818011990 con 0x7f48280a0a30 2023-10-01T07:56:47.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.288+0000 7f4826ffd700 1 -- 172.21.15.26:0/2944908581 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4818011d20 con 0x7f48280a0a30 2023-10-01T07:56:47.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.289+0000 7f482dd41700 1 -- 172.21.15.26:0/2944908581 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48280a0a30 msgr2=0x7f48280a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:47.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.289+0000 7f482dd41700 1 --2- 172.21.15.26:0/2944908581 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48280a0a30 0x7f48280a0e00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4818009840 tx=0x7f4818009b50 comp rx=0 tx=0).stop 2023-10-01T07:56:47.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.289+0000 7f482dd41700 1 -- 172.21.15.26:0/2944908581 shutdown_connections 2023-10-01T07:56:47.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.289+0000 7f482dd41700 1 --2- 172.21.15.26:0/2944908581 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48280a0a30 0x7f48280a0e00 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:47.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.289+0000 7f482dd41700 1 --2- 172.21.15.26:0/2944908581 >> v2:172.21.15.26:3300/0 conn(0x7f48280a1340 0x7f4828133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:47.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.289+0000 7f482dd41700 1 -- 172.21.15.26:0/2944908581 >> 172.21.15.26:0/2944908581 conn(0x7f48280a6550 msgr2=0x7f48280a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:47.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.289+0000 7f482dd41700 1 -- 172.21.15.26:0/2944908581 shutdown_connections 2023-10-01T07:56:47.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.289+0000 7f482dd41700 1 -- 172.21.15.26:0/2944908581 wait complete. 2023-10-01T07:56:47.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.290+0000 7f482dd41700 1 Processor -- start 2023-10-01T07:56:47.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.290+0000 7f482dd41700 1 -- start start 2023-10-01T07:56:47.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.291+0000 7f482dd41700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48280a0a30 0x7f48281c5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:47.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.291+0000 7f482dd41700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48280a1340 0x7f48281c5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:47.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.291+0000 7f482dd41700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4828133fa0 0x7f48281c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:47.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.291+0000 7f482dd41700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48281c60e0 con 0x7f48280a1340 2023-10-01T07:56:47.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.291+0000 7f482dd41700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4828126330 con 0x7f48280a0a30 2023-10-01T07:56:47.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.291+0000 7f482dd41700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4828124670 con 0x7f4828133fa0 2023-10-01T07:56:47.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.291+0000 7f481effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48280a1340 0x7f48281c5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:47.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.291+0000 7f48277fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48280a0a30 0x7f48281c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:47.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.291+0000 7f481effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48280a1340 0x7f48281c5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53660/0 (socket says 172.21.15.26:53660) 2023-10-01T07:56:47.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.291+0000 7f48277fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48280a0a30 0x7f48281c5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33762/0 (socket says 172.21.15.26:33762) 2023-10-01T07:56:47.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.291+0000 7f481effd700 1 -- 172.21.15.26:0/2392638763 learned_addr learned my addr 172.21.15.26:0/2392638763 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:47.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.291+0000 7f4827fff700 1 --2- 172.21.15.26:0/2392638763 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4828133fa0 0x7f48281c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:47.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.291+0000 7f481effd700 1 -- 172.21.15.26:0/2392638763 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4828133fa0 msgr2=0x7f48281c83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:47.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.291+0000 7f481effd700 1 --2- 172.21.15.26:0/2392638763 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4828133fa0 0x7f48281c83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:47.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.291+0000 7f481effd700 1 -- 172.21.15.26:0/2392638763 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48280a0a30 msgr2=0x7f48281c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:47.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.291+0000 7f481effd700 1 --2- 172.21.15.26:0/2392638763 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48280a0a30 0x7f48281c5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:47.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.291+0000 7f481effd700 1 -- 172.21.15.26:0/2392638763 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4810009550 con 0x7f48280a1340 2023-10-01T07:56:47.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.291+0000 7f48277fe700 1 --2- 172.21.15.26:0/2392638763 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48280a0a30 0x7f48281c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:47.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.292+0000 7f481effd700 1 --2- 172.21.15.26:0/2392638763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48280a1340 0x7f48281c5ba0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f481000ebe0 tx=0x7f481000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:47.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.292+0000 7f4824ff9700 1 -- 172.21.15.26:0/2392638763 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481000c850 con 0x7f48280a1340 2023-10-01T07:56:47.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.292+0000 7f4824ff9700 1 -- 172.21.15.26:0/2392638763 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481000c9b0 con 0x7f48280a1340 2023-10-01T07:56:47.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.292+0000 7f4824ff9700 1 -- 172.21.15.26:0/2392638763 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481000cd40 con 0x7f48280a1340 2023-10-01T07:56:47.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.292+0000 7f482dd41700 1 -- 172.21.15.26:0/2392638763 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48180094a0 con 0x7f48280a1340 2023-10-01T07:56:47.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.292+0000 7f482dd41700 1 -- 172.21.15.26:0/2392638763 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48280a0220 con 0x7f48280a1340 2023-10-01T07:56:47.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.293+0000 7f4824ff9700 1 -- 172.21.15.26:0/2392638763 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4810013470 con 0x7f48280a1340 2023-10-01T07:56:47.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.293+0000 7f4824ff9700 1 -- 172.21.15.26:0/2392638763 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f481003fc00 con 0x7f48280a1340 2023-10-01T07:56:47.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.293+0000 7f482dd41700 1 -- 172.21.15.26:0/2392638763 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4828126170 con 0x7f48280a1340 2023-10-01T07:56:47.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.302+0000 7f4824ff9700 1 -- 172.21.15.26:0/2392638763 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4828126170 con 0x7f48280a1340 2023-10-01T07:56:47.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.342+0000 7f6e26ced700 1 Processor -- start 2023-10-01T07:56:47.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.342+0000 7f6e26ced700 1 -- start start 2023-10-01T07:56:47.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.343+0000 7f6e26ced700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e20133420 0x7f6e201337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:47.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.343+0000 7f6e26ced700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e20133e30 0x7f6e2012ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:47.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.343+0000 7f6e26ced700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e20134260 0x7f6e201304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:47.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.343+0000 7f6e26ced700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e2006b990 con 0x7f6e20133420 2023-10-01T07:56:47.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.343+0000 7f6e26ced700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e200a0590 con 0x7f6e20134260 2023-10-01T07:56:47.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.343+0000 7f6e26ced700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2009fb80 con 0x7f6e20133e30 2023-10-01T07:56:47.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.343+0000 7f6e2528a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e20134260 0x7f6e201304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:47.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.343+0000 7f6e1ffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e20133e30 0x7f6e2012ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:47.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.343+0000 7f6e2528a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e20134260 0x7f6e201304d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33770/0 (socket says 172.21.15.26:33770) 2023-10-01T07:56:47.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.343+0000 7f6e2528a700 1 -- 172.21.15.26:0/618981230 learned_addr learned my addr 172.21.15.26:0/618981230 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:47.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.343+0000 7f6e24a89700 1 --2- 172.21.15.26:0/618981230 >> v2:172.21.15.26:3300/0 conn(0x7f6e20133420 0x7f6e201337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:47.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.344+0000 7f6e2528a700 1 -- 172.21.15.26:0/618981230 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e20133e30 msgr2=0x7f6e2012ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:47.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.344+0000 7f6e2528a700 1 --2- 172.21.15.26:0/618981230 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e20133e30 0x7f6e2012ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:47.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.344+0000 7f6e2528a700 1 -- 172.21.15.26:0/618981230 >> v2:172.21.15.26:3300/0 conn(0x7f6e20133420 msgr2=0x7f6e201337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:47.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.344+0000 7f6e2528a700 1 --2- 172.21.15.26:0/618981230 >> v2:172.21.15.26:3300/0 conn(0x7f6e20133420 0x7f6e201337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:47.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.344+0000 7f6e2528a700 1 -- 172.21.15.26:0/618981230 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e200a0030 con 0x7f6e20134260 2023-10-01T07:56:47.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.344+0000 7f6e1ffff700 1 --2- 172.21.15.26:0/618981230 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e20133e30 0x7f6e2012ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:47.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.344+0000 7f6e2528a700 1 --2- 172.21.15.26:0/618981230 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e20134260 0x7f6e201304d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6e18009e50 tx=0x7f6e1800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e35d0273d1278b3d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:47.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.344+0000 7f6e1f7fe700 1 -- 172.21.15.26:0/618981230 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1800e070 con 0x7f6e20134260 2023-10-01T07:56:47.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.344+0000 7f6e1f7fe700 1 -- 172.21.15.26:0/618981230 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1800b910 con 0x7f6e20134260 2023-10-01T07:56:47.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.344+0000 7f6e1f7fe700 1 -- 172.21.15.26:0/618981230 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1800bcc0 con 0x7f6e20134260 2023-10-01T07:56:47.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.345+0000 7f6e26ced700 1 -- 172.21.15.26:0/618981230 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e20134260 msgr2=0x7f6e201304d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:47.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.345+0000 7f6e26ced700 1 --2- 172.21.15.26:0/618981230 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e20134260 0x7f6e201304d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6e18009e50 tx=0x7f6e1800b330 comp rx=0 tx=0).stop 2023-10-01T07:56:47.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.345+0000 7f6e26ced700 1 -- 172.21.15.26:0/618981230 shutdown_connections 2023-10-01T07:56:47.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.345+0000 7f6e26ced700 1 --2- 172.21.15.26:0/618981230 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e20134260 0x7f6e201304d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:47.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.345+0000 7f6e26ced700 1 --2- 172.21.15.26:0/618981230 >> v2:172.21.15.26:3300/0 conn(0x7f6e20133420 0x7f6e201337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:47.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.345+0000 7f6e26ced700 1 --2- 172.21.15.26:0/618981230 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e20133e30 0x7f6e2012ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:47.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.345+0000 7f6e26ced700 1 -- 172.21.15.26:0/618981230 >> 172.21.15.26:0/618981230 conn(0x7f6e200a4210 msgr2=0x7f6e200a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:47.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.345+0000 7f6e26ced700 1 -- 172.21.15.26:0/618981230 shutdown_connections 2023-10-01T07:56:47.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.345+0000 7f6e26ced700 1 -- 172.21.15.26:0/618981230 wait complete. 2023-10-01T07:56:47.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.346+0000 7f6e26ced700 1 Processor -- start 2023-10-01T07:56:47.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.346+0000 7f6e26ced700 1 -- start start 2023-10-01T07:56:47.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.347+0000 7f6e26ced700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e20133420 0x7f6e2009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:47.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.347+0000 7f6e26ced700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e20133e30 0x7f6e2009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:47.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.347+0000 7f6e26ced700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e20134260 0x7f6e2009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:47.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.347+0000 7f6e26ced700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2009d950 con 0x7f6e20133e30 2023-10-01T07:56:47.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.347+0000 7f6e26ced700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2011f4d0 con 0x7f6e20134260 2023-10-01T07:56:47.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.347+0000 7f6e26ced700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e20133100 con 0x7f6e20133420 2023-10-01T07:56:47.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.347+0000 7f6e24a89700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e20133420 0x7f6e2009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:47.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.347+0000 7f6e24a89700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e20133420 0x7f6e2009c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:48550/0 (socket says 172.21.15.26:48550) 2023-10-01T07:56:47.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.347+0000 7f6e24a89700 1 -- 172.21.15.26:0/4185019058 learned_addr learned my addr 172.21.15.26:0/4185019058 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:47.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.347+0000 7f6e1ffff700 1 --2- 172.21.15.26:0/4185019058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e20133e30 0x7f6e2009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:47.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.348+0000 7f6e2528a700 1 --2- 172.21.15.26:0/4185019058 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e20134260 0x7f6e2009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:47.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.348+0000 7f6e24a89700 1 -- 172.21.15.26:0/4185019058 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e20134260 msgr2=0x7f6e2009cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:47.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.348+0000 7f6e24a89700 1 --2- 172.21.15.26:0/4185019058 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e20134260 0x7f6e2009cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:47.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.348+0000 7f6e24a89700 1 -- 172.21.15.26:0/4185019058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e20133e30 msgr2=0x7f6e2009c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:47.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.348+0000 7f6e24a89700 1 --2- 172.21.15.26:0/4185019058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e20133e30 0x7f6e2009c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:47.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.348+0000 7f6e24a89700 1 -- 172.21.15.26:0/4185019058 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0c0094a0 con 0x7f6e20133420 2023-10-01T07:56:47.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.348+0000 7f6e24a89700 1 --2- 172.21.15.26:0/4185019058 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e20133420 0x7f6e2009c480 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6e1400e9b0 tx=0x7f6e1400ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:47.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.348+0000 7f6e1d7fa700 1 -- 172.21.15.26:0/4185019058 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e14009710 con 0x7f6e20133420 2023-10-01T07:56:47.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.348+0000 7f6e1d7fa700 1 -- 172.21.15.26:0/4185019058 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1400c850 con 0x7f6e20133420 2023-10-01T07:56:47.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.348+0000 7f6e1d7fa700 1 -- 172.21.15.26:0/4185019058 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1400cbc0 con 0x7f6e20133420 2023-10-01T07:56:47.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.348+0000 7f6e26ced700 1 -- 172.21.15.26:0/4185019058 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e18009b30 con 0x7f6e20133420 2023-10-01T07:56:47.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.348+0000 7f6e26ced700 1 -- 172.21.15.26:0/4185019058 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e20120590 con 0x7f6e20133420 2023-10-01T07:56:47.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.349+0000 7f6e1d7fa700 1 -- 172.21.15.26:0/4185019058 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6e1400cd20 con 0x7f6e20133420 2023-10-01T07:56:47.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.349+0000 7f6e26ced700 1 -- 172.21.15.26:0/4185019058 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e20074ea0 con 0x7f6e20133420 2023-10-01T07:56:47.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.349+0000 7f6e1d7fa700 1 -- 172.21.15.26:0/4185019058 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6e1403f7f0 con 0x7f6e20133420 2023-10-01T07:56:47.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.359+0000 7f6e1d7fa700 1 -- 172.21.15.26:0/4185019058 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6e1401bd40 con 0x7f6e20133420 2023-10-01T07:56:47.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.477+0000 7f5243efb700 1 -- 172.21.15.26:0/92822909 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f523c131100 con 0x7f523c09e390 2023-10-01T07:56:47.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.478+0000 7f52327fc700 1 -- 172.21.15.26:0/92822909 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5238015020 con 0x7f523c09e390 2023-10-01T07:56:47.479 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:47.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.480+0000 7f5243efb700 1 -- 172.21.15.26:0/92822909 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f523c09e390 msgr2=0x7f523c11eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:47.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.480+0000 7f5243efb700 1 --2- 172.21.15.26:0/92822909 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f523c09e390 0x7f523c11eae0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f52380090b0 tx=0x7f5238004750 comp rx=0 tx=0).stop 2023-10-01T07:56:47.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.480+0000 7f5243efb700 1 -- 172.21.15.26:0/92822909 shutdown_connections 2023-10-01T07:56:47.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.480+0000 7f5243efb700 1 --2- 172.21.15.26:0/92822909 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f523c1341d0 0x7f523c11f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:47.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.480+0000 7f5243efb700 1 --2- 172.21.15.26:0/92822909 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f523c09e390 0x7f523c11eae0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:47.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.480+0000 7f5243efb700 1 --2- 172.21.15.26:0/92822909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f523c1338c0 0x7f523c11f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:47.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.480+0000 7f5243efb700 1 -- 172.21.15.26:0/92822909 >> 172.21.15.26:0/92822909 conn(0x7f523c0a2aa0 msgr2=0x7f523c09f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:47.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.480+0000 7f5243efb700 1 -- 172.21.15.26:0/92822909 shutdown_connections 2023-10-01T07:56:47.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.480+0000 7f5243efb700 1 -- 172.21.15.26:0/92822909 wait complete. 2023-10-01T07:56:47.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:47.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.513+0000 7f482dd41700 1 -- 172.21.15.26:0/2392638763 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4828126170 con 0x7f48280a1340 2023-10-01T07:56:47.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.514+0000 7f4824ff9700 1 -- 172.21.15.26:0/2392638763 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4828126170 con 0x7f48280a1340 2023-10-01T07:56:47.514 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:47.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.516+0000 7f482dd41700 1 -- 172.21.15.26:0/2392638763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48280a1340 msgr2=0x7f48281c5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:47.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.516+0000 7f482dd41700 1 --2- 172.21.15.26:0/2392638763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48280a1340 0x7f48281c5ba0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f481000ebe0 tx=0x7f481000eef0 comp rx=0 tx=0).stop 2023-10-01T07:56:47.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.516+0000 7f482dd41700 1 -- 172.21.15.26:0/2392638763 shutdown_connections 2023-10-01T07:56:47.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.516+0000 7f482dd41700 1 --2- 172.21.15.26:0/2392638763 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4828133fa0 0x7f48281c83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:47.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.516+0000 7f482dd41700 1 --2- 172.21.15.26:0/2392638763 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48280a0a30 0x7f48281c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:47.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.516+0000 7f482dd41700 1 --2- 172.21.15.26:0/2392638763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48280a1340 0x7f48281c5ba0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:47.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.516+0000 7f482dd41700 1 -- 172.21.15.26:0/2392638763 >> 172.21.15.26:0/2392638763 conn(0x7f48280a6550 msgr2=0x7f482811c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:47.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.516+0000 7f482dd41700 1 -- 172.21.15.26:0/2392638763 shutdown_connections 2023-10-01T07:56:47.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.516+0000 7f482dd41700 1 -- 172.21.15.26:0/2392638763 wait complete. 2023-10-01T07:56:47.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:47.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.571+0000 7f6e26ced700 1 -- 172.21.15.26:0/4185019058 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6e201201b0 con 0x7f6e20133420 2023-10-01T07:56:47.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.571+0000 7f6e1d7fa700 1 -- 172.21.15.26:0/4185019058 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6e1401ae80 con 0x7f6e20133420 2023-10-01T07:56:47.572 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:47.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.574+0000 7f6e26ced700 1 -- 172.21.15.26:0/4185019058 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e20133420 msgr2=0x7f6e2009c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:47.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.574+0000 7f6e26ced700 1 --2- 172.21.15.26:0/4185019058 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e20133420 0x7f6e2009c480 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6e1400e9b0 tx=0x7f6e1400ecc0 comp rx=0 tx=0).stop 2023-10-01T07:56:47.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.574+0000 7f6e26ced700 1 -- 172.21.15.26:0/4185019058 shutdown_connections 2023-10-01T07:56:47.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.574+0000 7f6e26ced700 1 --2- 172.21.15.26:0/4185019058 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e20134260 0x7f6e2009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:47.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.574+0000 7f6e26ced700 1 --2- 172.21.15.26:0/4185019058 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e20133420 0x7f6e2009c480 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:47.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.574+0000 7f6e26ced700 1 --2- 172.21.15.26:0/4185019058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e20133e30 0x7f6e2009c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:47.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.574+0000 7f6e26ced700 1 -- 172.21.15.26:0/4185019058 >> 172.21.15.26:0/4185019058 conn(0x7f6e200a4210 msgr2=0x7f6e20130230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:47.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.574+0000 7f6e26ced700 1 -- 172.21.15.26:0/4185019058 shutdown_connections 2023-10-01T07:56:47.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:47.574+0000 7f6e26ced700 1 -- 172.21.15.26:0/4185019058 wait complete. 2023-10-01T07:56:47.588 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:48.150 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:48.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.294+0000 7f54314c3700 1 Processor -- start 2023-10-01T07:56:48.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.294+0000 7f54314c3700 1 -- start start 2023-10-01T07:56:48.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.294+0000 7f54314c3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f542c133490 0x7f542c135870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:48.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.294+0000 7f54314c3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f542c135db0 0x7f542c138190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:48.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.294+0000 7f54314c3700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f542c09c190 con 0x7f542c130750 2023-10-01T07:56:48.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.294+0000 7f54314c3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f542c09b090 con 0x7f542c135db0 2023-10-01T07:56:48.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.294+0000 7f54314c3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f542c09a6c0 con 0x7f542c133490 2023-10-01T07:56:48.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.294+0000 7f542b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f542c135db0 0x7f542c138190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:48.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.294+0000 7f542a7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f542c133490 0x7f542c135870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:48.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.294+0000 7f542a7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f542c133490 0x7f542c135870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:48556/0 (socket says 172.21.15.26:48556) 2023-10-01T07:56:48.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.295+0000 7f542a7fc700 1 -- 172.21.15.26:0/1601825508 learned_addr learned my addr 172.21.15.26:0/1601825508 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:48.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.295+0000 7f542affd700 1 --1- 172.21.15.26:0/1601825508 >> v1:172.21.15.26:6789/0 conn(0x7f542c130750 0x7f542c130b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54672/0 (socket says 172.21.15.26:54672) 2023-10-01T07:56:48.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.294+0000 7f542b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f542c135db0 0x7f542c138190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53682/0 (socket says 172.21.15.26:53682) 2023-10-01T07:56:48.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.295+0000 7f542b7fe700 1 -- 172.21.15.26:0/1601825508 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f542c133490 msgr2=0x7f542c135870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:48.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.295+0000 7f542b7fe700 1 --2- 172.21.15.26:0/1601825508 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f542c133490 0x7f542c135870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.295+0000 7f542b7fe700 1 -- 172.21.15.26:0/1601825508 >> v1:172.21.15.26:6789/0 conn(0x7f542c130750 legacy=0x7f542c130b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:48.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.295+0000 7f542b7fe700 1 -- 172.21.15.26:0/1601825508 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542c130300 con 0x7f542c135db0 2023-10-01T07:56:48.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.295+0000 7f542a7fc700 1 --2- 172.21.15.26:0/1601825508 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f542c133490 0x7f542c135870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:48.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.295+0000 7f542b7fe700 1 --2- 172.21.15.26:0/1601825508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f542c135db0 0x7f542c138190 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f5424009d90 tx=0x7f542400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c05cc418932c8e63 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:48.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.295+0000 7f5429ffb700 1 -- 172.21.15.26:0/1601825508 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542400e070 con 0x7f542c135db0 2023-10-01T07:56:48.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.295+0000 7f5429ffb700 1 -- 172.21.15.26:0/1601825508 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542400bb20 con 0x7f542c135db0 2023-10-01T07:56:48.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.295+0000 7f5429ffb700 1 -- 172.21.15.26:0/1601825508 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5424012430 con 0x7f542c135db0 2023-10-01T07:56:48.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.296+0000 7f54314c3700 1 -- 172.21.15.26:0/1601825508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f542c135db0 msgr2=0x7f542c138190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:48.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.296+0000 7f54314c3700 1 --2- 172.21.15.26:0/1601825508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f542c135db0 0x7f542c138190 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f5424009d90 tx=0x7f542400b330 comp rx=0 tx=0).stop 2023-10-01T07:56:48.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.296+0000 7f54314c3700 1 -- 172.21.15.26:0/1601825508 shutdown_connections 2023-10-01T07:56:48.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.296+0000 7f54314c3700 1 --2- 172.21.15.26:0/1601825508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f542c135db0 0x7f542c138190 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.296+0000 7f54314c3700 1 --2- 172.21.15.26:0/1601825508 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f542c133490 0x7f542c135870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.296+0000 7f54314c3700 1 -- 172.21.15.26:0/1601825508 >> 172.21.15.26:0/1601825508 conn(0x7f542c09f470 msgr2=0x7f542c0a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:48.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.296+0000 7f54314c3700 1 -- 172.21.15.26:0/1601825508 shutdown_connections 2023-10-01T07:56:48.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.296+0000 7f54314c3700 1 -- 172.21.15.26:0/1601825508 wait complete. 2023-10-01T07:56:48.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.297+0000 7f54314c3700 1 Processor -- start 2023-10-01T07:56:48.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.297+0000 7f54314c3700 1 -- start start 2023-10-01T07:56:48.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.298+0000 7f54314c3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f542c130750 0x7f542c1c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:48.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.298+0000 7f54314c3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f542c133490 0x7f542c1c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:48.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.298+0000 7f54314c3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f542c135db0 0x7f542c1c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:48.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.298+0000 7f54314c3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542c0a1c00 con 0x7f542c135db0 2023-10-01T07:56:48.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.298+0000 7f54314c3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542c09b2b0 con 0x7f542c130750 2023-10-01T07:56:48.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.298+0000 7f54314c3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f542c12fb00 con 0x7f542c133490 2023-10-01T07:56:48.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.298+0000 7f542affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f542c130750 0x7f542c1c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:48.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.298+0000 7f542a7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f542c133490 0x7f542c1c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:48.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.298+0000 7f542affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f542c130750 0x7f542c1c8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33792/0 (socket says 172.21.15.26:33792) 2023-10-01T07:56:48.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.298+0000 7f542a7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f542c133490 0x7f542c1c8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:48558/0 (socket says 172.21.15.26:48558) 2023-10-01T07:56:48.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.298+0000 7f542affd700 1 -- 172.21.15.26:0/3733363703 learned_addr learned my addr 172.21.15.26:0/3733363703 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:48.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.298+0000 7f542b7fe700 1 --2- 172.21.15.26:0/3733363703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f542c135db0 0x7f542c1c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:48.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.298+0000 7f542affd700 1 -- 172.21.15.26:0/3733363703 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f542c133490 msgr2=0x7f542c1c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:48.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.298+0000 7f542affd700 1 --2- 172.21.15.26:0/3733363703 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f542c133490 0x7f542c1c8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.298+0000 7f542affd700 1 -- 172.21.15.26:0/3733363703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f542c135db0 msgr2=0x7f542c1c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:48.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.298+0000 7f542affd700 1 --2- 172.21.15.26:0/3733363703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f542c135db0 0x7f542c1c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.298+0000 7f542affd700 1 -- 172.21.15.26:0/3733363703 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5420009550 con 0x7f542c130750 2023-10-01T07:56:48.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.298+0000 7f542affd700 1 --2- 172.21.15.26:0/3733363703 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f542c130750 0x7f542c1c8250 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f541c00c520 tx=0x7f541c00c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:48.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.298+0000 7f54137fe700 1 -- 172.21.15.26:0/3733363703 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c005cb0 con 0x7f542c130750 2023-10-01T07:56:48.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.298+0000 7f54137fe700 1 -- 172.21.15.26:0/3733363703 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541c005e10 con 0x7f542c130750 2023-10-01T07:56:48.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.299+0000 7f54314c3700 1 -- 172.21.15.26:0/3733363703 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5424009a70 con 0x7f542c130750 2023-10-01T07:56:48.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.299+0000 7f54137fe700 1 -- 172.21.15.26:0/3733363703 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c0072d0 con 0x7f542c130750 2023-10-01T07:56:48.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.299+0000 7f54314c3700 1 -- 172.21.15.26:0/3733363703 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f542c12d0b0 con 0x7f542c130750 2023-10-01T07:56:48.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.299+0000 7f54137fe700 1 -- 172.21.15.26:0/3733363703 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f541c007430 con 0x7f542c130750 2023-10-01T07:56:48.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.300+0000 7f54137fe700 1 -- 172.21.15.26:0/3733363703 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f541c03eb10 con 0x7f542c130750 2023-10-01T07:56:48.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.300+0000 7f54314c3700 1 -- 172.21.15.26:0/3733363703 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f542c0747f0 con 0x7f542c130750 2023-10-01T07:56:48.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.304+0000 7f54137fe700 1 -- 172.21.15.26:0/3733363703 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f541c017070 con 0x7f542c130750 2023-10-01T07:56:48.495 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:48.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.510+0000 7f54314c3700 1 -- 172.21.15.26:0/3733363703 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f542c12ed00 con 0x7f542c130750 2023-10-01T07:56:48.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.510+0000 7f54137fe700 1 -- 172.21.15.26:0/3733363703 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f541c0119b0 con 0x7f542c130750 2023-10-01T07:56:48.511 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:48.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.513+0000 7f54314c3700 1 -- 172.21.15.26:0/3733363703 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f542c130750 msgr2=0x7f542c1c8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:48.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.513+0000 7f54314c3700 1 --2- 172.21.15.26:0/3733363703 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f542c130750 0x7f542c1c8250 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f541c00c520 tx=0x7f541c00c830 comp rx=0 tx=0).stop 2023-10-01T07:56:48.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.513+0000 7f54314c3700 1 -- 172.21.15.26:0/3733363703 shutdown_connections 2023-10-01T07:56:48.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.513+0000 7f54314c3700 1 --2- 172.21.15.26:0/3733363703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f542c135db0 0x7f542c1c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.513+0000 7f54314c3700 1 --2- 172.21.15.26:0/3733363703 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f542c130750 0x7f542c1c8250 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.513+0000 7f54314c3700 1 --2- 172.21.15.26:0/3733363703 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f542c133490 0x7f542c1c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.513+0000 7f54314c3700 1 -- 172.21.15.26:0/3733363703 >> 172.21.15.26:0/3733363703 conn(0x7f542c09f470 msgr2=0x7f542c0a0540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:48.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.513+0000 7f54314c3700 1 -- 172.21.15.26:0/3733363703 shutdown_connections 2023-10-01T07:56:48.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.513+0000 7f54314c3700 1 -- 172.21.15.26:0/3733363703 wait complete. 2023-10-01T07:56:48.528 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:48.532 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:48.589 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:48.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.638+0000 7f9a8119c700 1 Processor -- start 2023-10-01T07:56:48.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.638+0000 7f9a8119c700 1 -- start start 2023-10-01T07:56:48.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.638+0000 7f9a8119c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a7c1338a0 0x7f9a7c133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:48.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.638+0000 7f9a8119c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a7c09de50 0x7f9a7c09e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:48.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.638+0000 7f9a8119c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a7c06ef30 con 0x7f9a7c09e760 2023-10-01T07:56:48.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.638+0000 7f9a8119c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c06fef0 con 0x7f9a7c1338a0 2023-10-01T07:56:48.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.639+0000 7f9a8119c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c1334b0 con 0x7f9a7c09de50 2023-10-01T07:56:48.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.639+0000 7f9a7ad9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a7c1338a0 0x7f9a7c133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:48.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.639+0000 7f9a7ad9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a7c1338a0 0x7f9a7c133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33808/0 (socket says 172.21.15.26:33808) 2023-10-01T07:56:48.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.639+0000 7f9a7ad9d700 1 -- 172.21.15.26:0/3011473786 learned_addr learned my addr 172.21.15.26:0/3011473786 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:48.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.639+0000 7f9a7a59c700 1 --2- 172.21.15.26:0/3011473786 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a7c09de50 0x7f9a7c09e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:48.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.639+0000 7f9a7ad9d700 1 -- 172.21.15.26:0/3011473786 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a7c09de50 msgr2=0x7f9a7c09e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:48.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.639+0000 7f9a7ad9d700 1 --2- 172.21.15.26:0/3011473786 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a7c09de50 0x7f9a7c09e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.639+0000 7f9a7ad9d700 1 -- 172.21.15.26:0/3011473786 >> v1:172.21.15.26:6789/0 conn(0x7f9a7c09e760 legacy=0x7f9a7c13a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:48.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.639+0000 7f9a7ad9d700 1 -- 172.21.15.26:0/3011473786 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a7c06fc30 con 0x7f9a7c1338a0 2023-10-01T07:56:48.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.639+0000 7f9a7ad9d700 1 --2- 172.21.15.26:0/3011473786 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a7c1338a0 0x7f9a7c133c70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c009920 tx=0x7f9a6c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b7a252d72566c15 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:48.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.639+0000 7f9a79d9b700 1 -- 172.21.15.26:0/3011473786 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c00ba60 con 0x7f9a7c1338a0 2023-10-01T07:56:48.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.640+0000 7f9a79d9b700 1 -- 172.21.15.26:0/3011473786 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6c00bbc0 con 0x7f9a7c1338a0 2023-10-01T07:56:48.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.640+0000 7f9a79d9b700 1 -- 172.21.15.26:0/3011473786 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c009e70 con 0x7f9a7c1338a0 2023-10-01T07:56:48.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.640+0000 7f9a8119c700 1 -- 172.21.15.26:0/3011473786 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a7c1338a0 msgr2=0x7f9a7c133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:48.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.640+0000 7f9a8119c700 1 --2- 172.21.15.26:0/3011473786 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a7c1338a0 0x7f9a7c133c70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c009920 tx=0x7f9a6c009c30 comp rx=0 tx=0).stop 2023-10-01T07:56:48.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.641+0000 7f9a8119c700 1 -- 172.21.15.26:0/3011473786 shutdown_connections 2023-10-01T07:56:48.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.641+0000 7f9a8119c700 1 --2- 172.21.15.26:0/3011473786 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a7c1338a0 0x7f9a7c133c70 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.641+0000 7f9a8119c700 1 --2- 172.21.15.26:0/3011473786 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a7c09de50 0x7f9a7c09e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.641+0000 7f9a8119c700 1 -- 172.21.15.26:0/3011473786 >> 172.21.15.26:0/3011473786 conn(0x7f9a7c0a2aa0 msgr2=0x7f9a7c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:48.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.641+0000 7f9a8119c700 1 -- 172.21.15.26:0/3011473786 shutdown_connections 2023-10-01T07:56:48.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.641+0000 7f9a8119c700 1 -- 172.21.15.26:0/3011473786 wait complete. 2023-10-01T07:56:48.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.642+0000 7f9a8119c700 1 Processor -- start 2023-10-01T07:56:48.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.642+0000 7f9a8119c700 1 -- start start 2023-10-01T07:56:48.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.643+0000 7f9a8119c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a7c09de50 0x7f9a7c11eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:48.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.643+0000 7f9a8119c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a7c09e760 0x7f9a7c11f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:48.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.643+0000 7f9a8119c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a7c1338a0 0x7f9a7c11f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:48.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.643+0000 7f9a8119c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c0a10a0 con 0x7f9a7c09e760 2023-10-01T07:56:48.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.643+0000 7f9a8119c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c1224e0 con 0x7f9a7c1338a0 2023-10-01T07:56:48.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.643+0000 7f9a8119c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c12fbf0 con 0x7f9a7c09de50 2023-10-01T07:56:48.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.643+0000 7f9a7ad9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a7c09de50 0x7f9a7c11eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:48.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.643+0000 7f9a7a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a7c09e760 0x7f9a7c11f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:48.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.643+0000 7f9a7ad9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a7c09de50 0x7f9a7c11eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:48578/0 (socket says 172.21.15.26:48578) 2023-10-01T07:56:48.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.643+0000 7f9a7ad9d700 1 -- 172.21.15.26:0/3953981044 learned_addr learned my addr 172.21.15.26:0/3953981044 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:48.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.643+0000 7f9a7b59e700 1 --2- 172.21.15.26:0/3953981044 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a7c1338a0 0x7f9a7c11f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:48.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.644+0000 7f9a7ad9d700 1 -- 172.21.15.26:0/3953981044 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a7c1338a0 msgr2=0x7f9a7c11f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:48.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.644+0000 7f9a7ad9d700 1 --2- 172.21.15.26:0/3953981044 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a7c1338a0 0x7f9a7c11f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.644+0000 7f9a7ad9d700 1 -- 172.21.15.26:0/3953981044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a7c09e760 msgr2=0x7f9a7c11f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:48.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.644+0000 7f9a7ad9d700 1 --2- 172.21.15.26:0/3953981044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a7c09e760 0x7f9a7c11f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.644+0000 7f9a7ad9d700 1 -- 172.21.15.26:0/3953981044 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a6c009550 con 0x7f9a7c09de50 2023-10-01T07:56:48.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.644+0000 7f9a7a59c700 1 --2- 172.21.15.26:0/3953981044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a7c09e760 0x7f9a7c11f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:48.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.644+0000 7f9a7ad9d700 1 --2- 172.21.15.26:0/3953981044 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a7c09de50 0x7f9a7c11eca0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c009130 tx=0x7f9a6c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:48.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.644+0000 7f9a637fe700 1 -- 172.21.15.26:0/3953981044 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c004510 con 0x7f9a7c09de50 2023-10-01T07:56:48.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.644+0000 7f9a637fe700 1 -- 172.21.15.26:0/3953981044 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6c0036a0 con 0x7f9a7c09de50 2023-10-01T07:56:48.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.644+0000 7f9a8119c700 1 -- 172.21.15.26:0/3953981044 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a7c12f7c0 con 0x7f9a7c09de50 2023-10-01T07:56:48.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.644+0000 7f9a637fe700 1 -- 172.21.15.26:0/3953981044 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c003a30 con 0x7f9a7c09de50 2023-10-01T07:56:48.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.644+0000 7f9a8119c700 1 -- 172.21.15.26:0/3953981044 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a7c1210a0 con 0x7f9a7c09de50 2023-10-01T07:56:48.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.645+0000 7f9a637fe700 1 -- 172.21.15.26:0/3953981044 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9a6c003b90 con 0x7f9a7c09de50 2023-10-01T07:56:48.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.645+0000 7f9a637fe700 1 -- 172.21.15.26:0/3953981044 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9a6c040d80 con 0x7f9a7c09de50 2023-10-01T07:56:48.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.645+0000 7f9a8119c700 1 -- 172.21.15.26:0/3953981044 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a7c074ea0 con 0x7f9a7c09de50 2023-10-01T07:56:48.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.651+0000 7f9a637fe700 1 -- 172.21.15.26:0/3953981044 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9a6c015020 con 0x7f9a7c09de50 2023-10-01T07:56:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.710+0000 7fd2f8741700 1 Processor -- start 2023-10-01T07:56:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.710+0000 7fd2f8741700 1 -- start start 2023-10-01T07:56:48.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.710+0000 7fd2f8741700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2f009d6f0 0x7fd2f009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:48.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.710+0000 7fd2f8741700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2f009e000 0x7fd2f01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:48.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.710+0000 7fd2f8741700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd2f009e410 0x7fd2f0133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:48.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.710+0000 7fd2f8741700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2f006b460 con 0x7fd2f009e410 2023-10-01T07:56:48.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.710+0000 7fd2f8741700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f009b120 con 0x7fd2f009d6f0 2023-10-01T07:56:48.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.710+0000 7fd2f8741700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f009a7e0 con 0x7fd2f009e000 2023-10-01T07:56:48.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.711+0000 7fd2f5cdc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2f009e000 0x7fd2f01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:48.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.711+0000 7fd2f6cde700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd2f009e410 0x7fd2f0133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:48.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.711+0000 7fd2f5cdc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2f009e000 0x7fd2f01339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:48586/0 (socket says 172.21.15.26:48586) 2023-10-01T07:56:48.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.711+0000 7fd2f6cde700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd2f009e410 0x7fd2f0133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53710/0 (socket says 172.21.15.26:53710) 2023-10-01T07:56:48.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.711+0000 7fd2f5cdc700 1 -- 172.21.15.26:0/2398471989 learned_addr learned my addr 172.21.15.26:0/2398471989 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:48.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.711+0000 7fd2f64dd700 1 --2- 172.21.15.26:0/2398471989 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2f009d6f0 0x7fd2f009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:48.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.711+0000 7fd2f5cdc700 1 -- 172.21.15.26:0/2398471989 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2f009d6f0 msgr2=0x7fd2f009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:48.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.711+0000 7fd2f5cdc700 1 --2- 172.21.15.26:0/2398471989 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2f009d6f0 0x7fd2f009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.711+0000 7fd2f5cdc700 1 -- 172.21.15.26:0/2398471989 >> v2:172.21.15.26:3300/0 conn(0x7fd2f009e410 msgr2=0x7fd2f0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:48.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.711+0000 7fd2f5cdc700 1 --2- 172.21.15.26:0/2398471989 >> v2:172.21.15.26:3300/0 conn(0x7fd2f009e410 0x7fd2f0133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.711+0000 7fd2f5cdc700 1 -- 172.21.15.26:0/2398471989 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f009a500 con 0x7fd2f009e000 2023-10-01T07:56:48.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.711+0000 7fd2f6cde700 1 --2- 172.21.15.26:0/2398471989 >> v2:172.21.15.26:3300/0 conn(0x7fd2f009e410 0x7fd2f0133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:48.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.711+0000 7fd2f5cdc700 1 --2- 172.21.15.26:0/2398471989 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2f009e000 0x7fd2f01339f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0009920 tx=0x7fd2e0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7749f89fd59d80db server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:48.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.711+0000 7fd2f54db700 1 -- 172.21.15.26:0/2398471989 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0011830 con 0x7fd2f009e000 2023-10-01T07:56:48.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.712+0000 7fd2f54db700 1 -- 172.21.15.26:0/2398471989 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e0011990 con 0x7fd2f009e000 2023-10-01T07:56:48.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.712+0000 7fd2f54db700 1 -- 172.21.15.26:0/2398471989 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0011d20 con 0x7fd2f009e000 2023-10-01T07:56:48.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.712+0000 7fd2f8741700 1 -- 172.21.15.26:0/2398471989 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2f009e000 msgr2=0x7fd2f01339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:48.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.712+0000 7fd2f8741700 1 --2- 172.21.15.26:0/2398471989 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2f009e000 0x7fd2f01339f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0009920 tx=0x7fd2e0009c30 comp rx=0 tx=0).stop 2023-10-01T07:56:48.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.712+0000 7fd2f8741700 1 -- 172.21.15.26:0/2398471989 shutdown_connections 2023-10-01T07:56:48.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.712+0000 7fd2f8741700 1 --2- 172.21.15.26:0/2398471989 >> v2:172.21.15.26:3300/0 conn(0x7fd2f009e410 0x7fd2f0133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.712+0000 7fd2f8741700 1 --2- 172.21.15.26:0/2398471989 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2f009d6f0 0x7fd2f009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.712+0000 7fd2f8741700 1 --2- 172.21.15.26:0/2398471989 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2f009e000 0x7fd2f01339f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.712+0000 7fd2f8741700 1 -- 172.21.15.26:0/2398471989 >> 172.21.15.26:0/2398471989 conn(0x7fd2f0066f50 msgr2=0x7fd2f009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:48.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.712+0000 7fd2f8741700 1 -- 172.21.15.26:0/2398471989 shutdown_connections 2023-10-01T07:56:48.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.713+0000 7fd2f8741700 1 -- 172.21.15.26:0/2398471989 wait complete. 2023-10-01T07:56:48.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.714+0000 7fd2f8741700 1 Processor -- start 2023-10-01T07:56:48.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.714+0000 7fd2f8741700 1 -- start start 2023-10-01T07:56:48.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.714+0000 7fd2f8741700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2f009d6f0 0x7fd2f01b91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:48.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.714+0000 7fd2f8741700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2f009e000 0x7fd2f01a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:48.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.714+0000 7fd2f8741700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2f009e410 0x7fd2f01a6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:48.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.714+0000 7fd2f8741700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f01aa2c0 con 0x7fd2f009e410 2023-10-01T07:56:48.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.714+0000 7fd2f8741700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f01a9900 con 0x7fd2f009e000 2023-10-01T07:56:48.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.714+0000 7fd2f8741700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f01a9090 con 0x7fd2f009d6f0 2023-10-01T07:56:48.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.714+0000 7fd2f64dd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2f009d6f0 0x7fd2f01b91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:48.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.714+0000 7fd2f5cdc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2f009e000 0x7fd2f01a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:48.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.714+0000 7fd2f64dd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2f009d6f0 0x7fd2f01b91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:48588/0 (socket says 172.21.15.26:48588) 2023-10-01T07:56:48.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.714+0000 7fd2f64dd700 1 -- 172.21.15.26:0/3152621892 learned_addr learned my addr 172.21.15.26:0/3152621892 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:48.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.714+0000 7fd2f6cde700 1 --2- 172.21.15.26:0/3152621892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2f009e410 0x7fd2f01a6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:48.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.715+0000 7fd2f64dd700 1 -- 172.21.15.26:0/3152621892 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2f009e000 msgr2=0x7fd2f01a5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:48.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.715+0000 7fd2f64dd700 1 --2- 172.21.15.26:0/3152621892 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2f009e000 0x7fd2f01a5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.715+0000 7fd2f64dd700 1 -- 172.21.15.26:0/3152621892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2f009e410 msgr2=0x7fd2f01a6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:48.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.715+0000 7fd2f64dd700 1 --2- 172.21.15.26:0/3152621892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2f009e410 0x7fd2f01a6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.715+0000 7fd2f64dd700 1 -- 172.21.15.26:0/3152621892 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e8009a70 con 0x7fd2f009d6f0 2023-10-01T07:56:48.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.715+0000 7fd2f5cdc700 1 --2- 172.21.15.26:0/3152621892 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2f009e000 0x7fd2f01a5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:48.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.715+0000 7fd2f6cde700 1 --2- 172.21.15.26:0/3152621892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2f009e410 0x7fd2f01a6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:48.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.715+0000 7fd2f64dd700 1 --2- 172.21.15.26:0/3152621892 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2f009d6f0 0x7fd2f01b91d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec00e9e0 tx=0x7fd2ec00ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:48.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.715+0000 7fd2e6ffd700 1 -- 172.21.15.26:0/3152621892 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec009710 con 0x7fd2f009d6f0 2023-10-01T07:56:48.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.715+0000 7fd2e6ffd700 1 -- 172.21.15.26:0/3152621892 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ec00ee80 con 0x7fd2f009d6f0 2023-10-01T07:56:48.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.715+0000 7fd2f8741700 1 -- 172.21.15.26:0/3152621892 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e0009550 con 0x7fd2f009d6f0 2023-10-01T07:56:48.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.715+0000 7fd2e6ffd700 1 -- 172.21.15.26:0/3152621892 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec00ca50 con 0x7fd2f009d6f0 2023-10-01T07:56:48.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.715+0000 7fd2f8741700 1 -- 172.21.15.26:0/3152621892 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2f009c710 con 0x7fd2f009d6f0 2023-10-01T07:56:48.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.717+0000 7fd2f8741700 1 -- 172.21.15.26:0/3152621892 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2f01a7a50 con 0x7fd2f009d6f0 2023-10-01T07:56:48.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.717+0000 7fd2e6ffd700 1 -- 172.21.15.26:0/3152621892 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd2ec00cbb0 con 0x7fd2f009d6f0 2023-10-01T07:56:48.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.717+0000 7fd2e6ffd700 1 -- 172.21.15.26:0/3152621892 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd2ec03fff0 con 0x7fd2f009d6f0 2023-10-01T07:56:48.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.722+0000 7fd2e6ffd700 1 -- 172.21.15.26:0/3152621892 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd2ec011350 con 0x7fd2f009d6f0 2023-10-01T07:56:48.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.755+0000 7f5c8256e700 1 Processor -- start 2023-10-01T07:56:48.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.755+0000 7f5c8256e700 1 -- start start 2023-10-01T07:56:48.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.755+0000 7f5c8256e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c7c09e1d0 0x7f5c7c138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:48.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.755+0000 7f5c8256e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c7c139170 0x7f5c7c13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:48.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.755+0000 7f5c8256e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c7c09b120 con 0x7f5c7c09d6f0 2023-10-01T07:56:48.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.755+0000 7f5c8256e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c06b460 con 0x7f5c7c09e1d0 2023-10-01T07:56:48.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.755+0000 7f5c8256e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c09a7e0 con 0x7f5c7c139170 2023-10-01T07:56:48.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.756+0000 7f5c80b0b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c7c139170 0x7f5c7c13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:48.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.756+0000 7f5c80b0b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c7c139170 0x7f5c7c13b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:48602/0 (socket says 172.21.15.26:48602) 2023-10-01T07:56:48.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.756+0000 7f5c80b0b700 1 -- 172.21.15.26:0/564605348 learned_addr learned my addr 172.21.15.26:0/564605348 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:48.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.756+0000 7f5c7b7fe700 1 --2- 172.21.15.26:0/564605348 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c7c09e1d0 0x7f5c7c138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:48.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.756+0000 7f5c80b0b700 1 -- 172.21.15.26:0/564605348 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c7c09e1d0 msgr2=0x7f5c7c138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:48.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.756+0000 7f5c80b0b700 1 --2- 172.21.15.26:0/564605348 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c7c09e1d0 0x7f5c7c138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.756+0000 7f5c80b0b700 1 -- 172.21.15.26:0/564605348 >> v1:172.21.15.26:6789/0 conn(0x7f5c7c09d6f0 legacy=0x7f5c7c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:48.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.756+0000 7f5c7affd700 1 -- 172.21.15.26:0/564605348 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2742274430 0 0) 0x7f5c7c09b120 con 0x7f5c7c09d6f0 2023-10-01T07:56:48.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.756+0000 7f5c80b0b700 1 -- 172.21.15.26:0/564605348 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7c09a500 con 0x7f5c7c139170 2023-10-01T07:56:48.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.756+0000 7f5c7b7fe700 1 --2- 172.21.15.26:0/564605348 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c7c09e1d0 0x7f5c7c138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:48.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.756+0000 7f5c80b0b700 1 --2- 172.21.15.26:0/564605348 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c7c139170 0x7f5c7c13b550 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5c74009eb0 tx=0x7f5c7400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=659f832080373961 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:48.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.756+0000 7f5c7affd700 1 -- 172.21.15.26:0/564605348 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7400e070 con 0x7f5c7c139170 2023-10-01T07:56:48.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.756+0000 7f5c7affd700 1 -- 172.21.15.26:0/564605348 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7400b8d0 con 0x7f5c7c139170 2023-10-01T07:56:48.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.757+0000 7f5c7affd700 1 -- 172.21.15.26:0/564605348 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7400bc80 con 0x7f5c7c139170 2023-10-01T07:56:48.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.757+0000 7f5c8256e700 1 -- 172.21.15.26:0/564605348 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c7c139170 msgr2=0x7f5c7c13b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:48.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.757+0000 7f5c8256e700 1 --2- 172.21.15.26:0/564605348 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c7c139170 0x7f5c7c13b550 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5c74009eb0 tx=0x7f5c7400b330 comp rx=0 tx=0).stop 2023-10-01T07:56:48.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.757+0000 7f5c8256e700 1 -- 172.21.15.26:0/564605348 shutdown_connections 2023-10-01T07:56:48.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.757+0000 7f5c8256e700 1 --2- 172.21.15.26:0/564605348 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c7c139170 0x7f5c7c13b550 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.757+0000 7f5c8256e700 1 --2- 172.21.15.26:0/564605348 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c7c09e1d0 0x7f5c7c138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.757+0000 7f5c8256e700 1 -- 172.21.15.26:0/564605348 >> 172.21.15.26:0/564605348 conn(0x7f5c7c066f50 msgr2=0x7f5c7c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:48.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.757+0000 7f5c8256e700 1 -- 172.21.15.26:0/564605348 shutdown_connections 2023-10-01T07:56:48.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.757+0000 7f5c8256e700 1 -- 172.21.15.26:0/564605348 wait complete. 2023-10-01T07:56:48.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.758+0000 7f5c8256e700 1 Processor -- start 2023-10-01T07:56:48.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.758+0000 7f5c8256e700 1 -- start start 2023-10-01T07:56:48.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.759+0000 7f5c8256e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c7c09d6f0 0x7f5c7c1215e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:48.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.759+0000 7f5c8256e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c7c09e1d0 0x7f5c7c121b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:48.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.759+0000 7f5c8256e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c7c139170 0x7f5c7c122060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:48.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.759+0000 7f5c8256e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c0a3b40 con 0x7f5c7c09e1d0 2023-10-01T07:56:48.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.759+0000 7f5c8256e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c124e90 con 0x7f5c7c09d6f0 2023-10-01T07:56:48.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.759+0000 7f5c8256e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c125100 con 0x7f5c7c139170 2023-10-01T07:56:48.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.759+0000 7f5c7bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c7c09d6f0 0x7f5c7c1215e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:48.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.759+0000 7f5c7b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c7c09e1d0 0x7f5c7c121b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:48.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.759+0000 7f5c7bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c7c09d6f0 0x7f5c7c1215e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33850/0 (socket says 172.21.15.26:33850) 2023-10-01T07:56:48.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.759+0000 7f5c7bfff700 1 -- 172.21.15.26:0/894559985 learned_addr learned my addr 172.21.15.26:0/894559985 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:48.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.759+0000 7f5c7b7fe700 1 -- 172.21.15.26:0/894559985 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c7c139170 msgr2=0x7f5c7c122060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:48.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.759+0000 7f5c7b7fe700 1 --2- 172.21.15.26:0/894559985 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c7c139170 0x7f5c7c122060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.759+0000 7f5c7b7fe700 1 -- 172.21.15.26:0/894559985 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c7c09d6f0 msgr2=0x7f5c7c1215e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:48.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.759+0000 7f5c7b7fe700 1 --2- 172.21.15.26:0/894559985 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c7c09d6f0 0x7f5c7c1215e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.759+0000 7f5c7b7fe700 1 -- 172.21.15.26:0/894559985 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c700094a0 con 0x7f5c7c09e1d0 2023-10-01T07:56:48.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.759+0000 7f5c7bfff700 1 --2- 172.21.15.26:0/894559985 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c7c09d6f0 0x7f5c7c1215e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:48.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.760+0000 7f5c7b7fe700 1 --2- 172.21.15.26:0/894559985 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c7c09e1d0 0x7f5c7c121b20 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f5c7000e9b0 tx=0x7f5c7000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:48.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.760+0000 7f5c78ff9700 1 -- 172.21.15.26:0/894559985 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7000c850 con 0x7f5c7c09e1d0 2023-10-01T07:56:48.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.760+0000 7f5c78ff9700 1 -- 172.21.15.26:0/894559985 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7000c9b0 con 0x7f5c7c09e1d0 2023-10-01T07:56:48.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.760+0000 7f5c8256e700 1 -- 172.21.15.26:0/894559985 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c74009b30 con 0x7f5c7c09e1d0 2023-10-01T07:56:48.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.760+0000 7f5c78ff9700 1 -- 172.21.15.26:0/894559985 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7000cd60 con 0x7f5c7c09e1d0 2023-10-01T07:56:48.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.760+0000 7f5c8256e700 1 -- 172.21.15.26:0/894559985 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c7c09c710 con 0x7f5c7c09e1d0 2023-10-01T07:56:48.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.761+0000 7f5c78ff9700 1 -- 172.21.15.26:0/894559985 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5c70013470 con 0x7f5c7c09e1d0 2023-10-01T07:56:48.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.761+0000 7f5c78ff9700 1 -- 172.21.15.26:0/894559985 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5c7003f8c0 con 0x7f5c7c09e1d0 2023-10-01T07:56:48.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.761+0000 7f5c8256e700 1 -- 172.21.15.26:0/894559985 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c7c124bd0 con 0x7f5c7c09e1d0 2023-10-01T07:56:48.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.770+0000 7f5c78ff9700 1 -- 172.21.15.26:0/894559985 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5c70017080 con 0x7f5c7c09e1d0 2023-10-01T07:56:48.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.862+0000 7f9a8119c700 1 -- 172.21.15.26:0/3953981044 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9a7c0a0b20 con 0x7f9a7c09de50 2023-10-01T07:56:48.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.862+0000 7f9a637fe700 1 -- 172.21.15.26:0/3953981044 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9a6c003e40 con 0x7f9a7c09de50 2023-10-01T07:56:48.863 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:48.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.865+0000 7f9a8119c700 1 -- 172.21.15.26:0/3953981044 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a7c09de50 msgr2=0x7f9a7c11eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:48.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.865+0000 7f9a8119c700 1 --2- 172.21.15.26:0/3953981044 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a7c09de50 0x7f9a7c11eca0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c009130 tx=0x7f9a6c004750 comp rx=0 tx=0).stop 2023-10-01T07:56:48.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.865+0000 7f9a8119c700 1 -- 172.21.15.26:0/3953981044 shutdown_connections 2023-10-01T07:56:48.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.865+0000 7f9a8119c700 1 --2- 172.21.15.26:0/3953981044 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a7c1338a0 0x7f9a7c11f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.865+0000 7f9a8119c700 1 --2- 172.21.15.26:0/3953981044 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a7c09de50 0x7f9a7c11eca0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.865+0000 7f9a8119c700 1 --2- 172.21.15.26:0/3953981044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a7c09e760 0x7f9a7c11f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.865+0000 7f9a8119c700 1 -- 172.21.15.26:0/3953981044 >> 172.21.15.26:0/3953981044 conn(0x7f9a7c0a2aa0 msgr2=0x7f9a7c09ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:48.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.865+0000 7f9a8119c700 1 -- 172.21.15.26:0/3953981044 shutdown_connections 2023-10-01T07:56:48.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.865+0000 7f9a8119c700 1 -- 172.21.15.26:0/3953981044 wait complete. 2023-10-01T07:56:48.880 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:48.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.933+0000 7fd2f8741700 1 -- 172.21.15.26:0/3152621892 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd2f0074ea0 con 0x7fd2f009d6f0 2023-10-01T07:56:48.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.934+0000 7fd2e6ffd700 1 -- 172.21.15.26:0/3152621892 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd2ec024ca0 con 0x7fd2f009d6f0 2023-10-01T07:56:48.935 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:48.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.936+0000 7fd2f8741700 1 -- 172.21.15.26:0/3152621892 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2f009d6f0 msgr2=0x7fd2f01b91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:48.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.936+0000 7fd2f8741700 1 --2- 172.21.15.26:0/3152621892 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2f009d6f0 0x7fd2f01b91d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec00e9e0 tx=0x7fd2ec00ecf0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.936+0000 7fd2f8741700 1 -- 172.21.15.26:0/3152621892 shutdown_connections 2023-10-01T07:56:48.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.936+0000 7fd2f8741700 1 --2- 172.21.15.26:0/3152621892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2f009e410 0x7fd2f01a6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.936+0000 7fd2f8741700 1 --2- 172.21.15.26:0/3152621892 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2f009d6f0 0x7fd2f01b91d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.936+0000 7fd2f8741700 1 --2- 172.21.15.26:0/3152621892 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2f009e000 0x7fd2f01a5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.936+0000 7fd2f8741700 1 -- 172.21.15.26:0/3152621892 >> 172.21.15.26:0/3152621892 conn(0x7fd2f0066f50 msgr2=0x7fd2f01badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:48.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.936+0000 7fd2f8741700 1 -- 172.21.15.26:0/3152621892 shutdown_connections 2023-10-01T07:56:48.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.936+0000 7fd2f8741700 1 -- 172.21.15.26:0/3152621892 wait complete. 2023-10-01T07:56:48.950 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:48.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.976+0000 7f5c8256e700 1 -- 172.21.15.26:0/894559985 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5c7c074ea0 con 0x7f5c7c09e1d0 2023-10-01T07:56:48.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.976+0000 7f5c78ff9700 1 -- 172.21.15.26:0/894559985 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5c70021020 con 0x7f5c7c09e1d0 2023-10-01T07:56:48.977 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:48.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.978+0000 7f5c8256e700 1 -- 172.21.15.26:0/894559985 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c7c09e1d0 msgr2=0x7f5c7c121b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:48.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.978+0000 7f5c8256e700 1 --2- 172.21.15.26:0/894559985 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c7c09e1d0 0x7f5c7c121b20 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f5c7000e9b0 tx=0x7f5c7000ecc0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.978+0000 7f5c8256e700 1 -- 172.21.15.26:0/894559985 shutdown_connections 2023-10-01T07:56:48.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.978+0000 7f5c8256e700 1 --2- 172.21.15.26:0/894559985 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c7c139170 0x7f5c7c122060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.978+0000 7f5c8256e700 1 --2- 172.21.15.26:0/894559985 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c7c09d6f0 0x7f5c7c1215e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.978+0000 7f5c8256e700 1 --2- 172.21.15.26:0/894559985 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c7c09e1d0 0x7f5c7c121b20 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:48.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.978+0000 7f5c8256e700 1 -- 172.21.15.26:0/894559985 >> 172.21.15.26:0/894559985 conn(0x7f5c7c066f50 msgr2=0x7f5c7c070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:48.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.978+0000 7f5c8256e700 1 -- 172.21.15.26:0/894559985 shutdown_connections 2023-10-01T07:56:48.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:48.978+0000 7f5c8256e700 1 -- 172.21.15.26:0/894559985 wait complete. 2023-10-01T07:56:48.992 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:49.530 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:49.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.675+0000 7f8db35da700 1 Processor -- start 2023-10-01T07:56:49.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.675+0000 7f8db35da700 1 -- start start 2023-10-01T07:56:49.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.676+0000 7f8db35da700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8dac09d6f0 0x7f8dac09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:49.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.676+0000 7f8db35da700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8dac09e000 0x7f8dac130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:49.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.676+0000 7f8db35da700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8dac09e410 0x7f8dac130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:49.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.676+0000 7f8db35da700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dac09f520 con 0x7f8dac09d6f0 2023-10-01T07:56:49.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.676+0000 7f8db35da700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac09f130 con 0x7f8dac09e410 2023-10-01T07:56:49.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.676+0000 7f8db35da700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac09e930 con 0x7f8dac09e000 2023-10-01T07:56:49.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.676+0000 7f8db0b75700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8dac09e000 0x7f8dac130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:49.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.676+0000 7f8db1376700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8dac09d6f0 0x7f8dac09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:49.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.676+0000 7f8db1b77700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8dac09e410 0x7f8dac130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:49.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.676+0000 7f8db1376700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8dac09d6f0 0x7f8dac09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53736/0 (socket says 172.21.15.26:53736) 2023-10-01T07:56:49.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.676+0000 7f8db0b75700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8dac09e000 0x7f8dac130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:48628/0 (socket says 172.21.15.26:48628) 2023-10-01T07:56:49.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.676+0000 7f8db1b77700 1 --2- 172.21.15.26:0/2109321575 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8dac09e410 0x7f8dac130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33852/0 (socket says 172.21.15.26:33852) 2023-10-01T07:56:49.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.676+0000 7f8db1376700 1 -- 172.21.15.26:0/2109321575 learned_addr learned my addr 172.21.15.26:0/2109321575 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:49.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.676+0000 7f8db1376700 1 -- 172.21.15.26:0/2109321575 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8dac09e000 msgr2=0x7f8dac130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:49.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.676+0000 7f8db1376700 1 --2- 172.21.15.26:0/2109321575 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8dac09e000 0x7f8dac130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:49.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.676+0000 7f8db1376700 1 -- 172.21.15.26:0/2109321575 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8dac09e410 msgr2=0x7f8dac130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:49.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.676+0000 7f8db1376700 1 --2- 172.21.15.26:0/2109321575 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8dac09e410 0x7f8dac130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:49.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.676+0000 7f8db1376700 1 -- 172.21.15.26:0/2109321575 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dac09b2d0 con 0x7f8dac09d6f0 2023-10-01T07:56:49.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.676+0000 7f8db0b75700 1 --2- 172.21.15.26:0/2109321575 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8dac09e000 0x7f8dac130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:49.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.676+0000 7f8db1b77700 1 --2- 172.21.15.26:0/2109321575 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8dac09e410 0x7f8dac130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:49.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.677+0000 7f8db1376700 1 --2- 172.21.15.26:0/2109321575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8dac09d6f0 0x7f8dac09dac0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f8da8009920 tx=0x7f8da8009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cbe4ec63152b804 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:49.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.677+0000 7f8d9ffff700 1 -- 172.21.15.26:0/2109321575 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da8011830 con 0x7f8dac09d6f0 2023-10-01T07:56:49.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.677+0000 7f8d9ffff700 1 -- 172.21.15.26:0/2109321575 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da8011990 con 0x7f8dac09d6f0 2023-10-01T07:56:49.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.677+0000 7f8d9ffff700 1 -- 172.21.15.26:0/2109321575 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da8011d20 con 0x7f8dac09d6f0 2023-10-01T07:56:49.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.677+0000 7f8db35da700 1 -- 172.21.15.26:0/2109321575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8dac09d6f0 msgr2=0x7f8dac09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:49.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.677+0000 7f8db35da700 1 --2- 172.21.15.26:0/2109321575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8dac09d6f0 0x7f8dac09dac0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f8da8009920 tx=0x7f8da8009c30 comp rx=0 tx=0).stop 2023-10-01T07:56:49.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.677+0000 7f8db35da700 1 -- 172.21.15.26:0/2109321575 shutdown_connections 2023-10-01T07:56:49.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.677+0000 7f8db35da700 1 --2- 172.21.15.26:0/2109321575 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8dac09e410 0x7f8dac130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:49.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.677+0000 7f8db35da700 1 --2- 172.21.15.26:0/2109321575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8dac09d6f0 0x7f8dac09dac0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:49.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.677+0000 7f8db35da700 1 --2- 172.21.15.26:0/2109321575 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8dac09e000 0x7f8dac130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:49.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.677+0000 7f8db35da700 1 -- 172.21.15.26:0/2109321575 >> 172.21.15.26:0/2109321575 conn(0x7f8dac066f50 msgr2=0x7f8dac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:49.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.677+0000 7f8db35da700 1 -- 172.21.15.26:0/2109321575 shutdown_connections 2023-10-01T07:56:49.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.678+0000 7f8db35da700 1 -- 172.21.15.26:0/2109321575 wait complete. 2023-10-01T07:56:49.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.678+0000 7f8db35da700 1 Processor -- start 2023-10-01T07:56:49.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.679+0000 7f8db35da700 1 -- start start 2023-10-01T07:56:49.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.679+0000 7f8db35da700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8dac09d6f0 0x7f8dac11de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:49.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.679+0000 7f8db35da700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8dac09e000 0x7f8dac11e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:49.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.679+0000 7f8db35da700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8dac09e410 0x7f8dac11e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:49.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.679+0000 7f8db35da700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac11f350 con 0x7f8dac09e000 2023-10-01T07:56:49.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.679+0000 7f8db35da700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac1219a0 con 0x7f8dac09e410 2023-10-01T07:56:49.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.679+0000 7f8db35da700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac1200b0 con 0x7f8dac09d6f0 2023-10-01T07:56:49.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.679+0000 7f8db1376700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8dac09d6f0 0x7f8dac11de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:49.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.679+0000 7f8db0b75700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8dac09e000 0x7f8dac11e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:49.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.679+0000 7f8db0b75700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8dac09e000 0x7f8dac11e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53750/0 (socket says 172.21.15.26:53750) 2023-10-01T07:56:49.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.679+0000 7f8db1b77700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8dac09e410 0x7f8dac11e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:49.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.679+0000 7f8db1376700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8dac09d6f0 0x7f8dac11de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:48630/0 (socket says 172.21.15.26:48630) 2023-10-01T07:56:49.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.679+0000 7f8db0b75700 1 -- 172.21.15.26:0/3377333 learned_addr learned my addr 172.21.15.26:0/3377333 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:49.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.679+0000 7f8db0b75700 1 -- 172.21.15.26:0/3377333 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8dac09d6f0 msgr2=0x7f8dac11de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.679+0000 7f8db0b75700 1 --2- 172.21.15.26:0/3377333 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8dac09d6f0 0x7f8dac11de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.679+0000 7f8db0b75700 1 -- 172.21.15.26:0/3377333 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8dac09e410 msgr2=0x7f8dac11e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.679+0000 7f8db0b75700 1 --2- 172.21.15.26:0/3377333 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8dac09e410 0x7f8dac11e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.679+0000 7f8db0b75700 1 -- 172.21.15.26:0/3377333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da000b740 con 0x7f8dac09e000 2023-10-01T07:56:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.679+0000 7f8db1b77700 1 --2- 172.21.15.26:0/3377333 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8dac09e410 0x7f8dac11e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.680+0000 7f8db0b75700 1 --2- 172.21.15.26:0/3377333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8dac09e000 0x7f8dac11e3c0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8da0010f40 tx=0x7f8da000e640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.680+0000 7f8d9dffb700 1 -- 172.21.15.26:0/3377333 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da000ba20 con 0x7f8dac09e000 2023-10-01T07:56:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.680+0000 7f8d9dffb700 1 -- 172.21.15.26:0/3377333 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da0011650 con 0x7f8dac09e000 2023-10-01T07:56:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.680+0000 7f8db35da700 1 -- 172.21.15.26:0/3377333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8da4009a70 con 0x7f8dac09e000 2023-10-01T07:56:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.680+0000 7f8d9dffb700 1 -- 172.21.15.26:0/3377333 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da00119e0 con 0x7f8dac09e000 2023-10-01T07:56:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.680+0000 7f8db35da700 1 -- 172.21.15.26:0/3377333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8da8009550 con 0x7f8dac09e000 2023-10-01T07:56:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.681+0000 7f8d9dffb700 1 -- 172.21.15.26:0/3377333 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8da0011b40 con 0x7f8dac09e000 2023-10-01T07:56:49.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.681+0000 7f8db35da700 1 -- 172.21.15.26:0/3377333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dac09c700 con 0x7f8dac09e000 2023-10-01T07:56:49.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.681+0000 7f8d9dffb700 1 -- 172.21.15.26:0/3377333 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8da0042370 con 0x7f8dac09e000 2023-10-01T07:56:49.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.686+0000 7f8d9dffb700 1 -- 172.21.15.26:0/3377333 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8da0017930 con 0x7f8dac09e000 2023-10-01T07:56:49.881 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:49.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.891+0000 7f8db35da700 1 -- 172.21.15.26:0/3377333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8dac074ea0 con 0x7f8dac09e000 2023-10-01T07:56:49.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.891+0000 7f8d9dffb700 1 -- 172.21.15.26:0/3377333 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8da001e030 con 0x7f8dac09e000 2023-10-01T07:56:49.892 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:49.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.893+0000 7f8db35da700 1 -- 172.21.15.26:0/3377333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8dac09e000 msgr2=0x7f8dac11e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:49.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.893+0000 7f8db35da700 1 --2- 172.21.15.26:0/3377333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8dac09e000 0x7f8dac11e3c0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8da0010f40 tx=0x7f8da000e640 comp rx=0 tx=0).stop 2023-10-01T07:56:49.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.893+0000 7f8db35da700 1 -- 172.21.15.26:0/3377333 shutdown_connections 2023-10-01T07:56:49.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.893+0000 7f8db35da700 1 --2- 172.21.15.26:0/3377333 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8dac09e410 0x7f8dac11e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:49.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.893+0000 7f8db35da700 1 --2- 172.21.15.26:0/3377333 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8dac09d6f0 0x7f8dac11de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:49.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.893+0000 7f8db35da700 1 --2- 172.21.15.26:0/3377333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8dac09e000 0x7f8dac11e3c0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:49.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.893+0000 7f8db35da700 1 -- 172.21.15.26:0/3377333 >> 172.21.15.26:0/3377333 conn(0x7f8dac066f50 msgr2=0x7f8dac06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:49.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.894+0000 7f8db35da700 1 -- 172.21.15.26:0/3377333 shutdown_connections 2023-10-01T07:56:49.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:49.894+0000 7f8db35da700 1 -- 172.21.15.26:0/3377333 wait complete. 2023-10-01T07:56:49.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:49.951 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:49.993 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:50.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.022+0000 7f493c76e700 1 Processor -- start 2023-10-01T07:56:50.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.022+0000 7f493c76e700 1 -- start start 2023-10-01T07:56:50.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.022+0000 7f493c76e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f493412cf60 0x7f493406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:50.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.022+0000 7f493c76e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4934130430 0x7f4934137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:50.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.022+0000 7f493c76e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f493412cd90 con 0x7f493412f8b0 2023-10-01T07:56:50.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.022+0000 7f493c76e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493412d330 con 0x7f493412cf60 2023-10-01T07:56:50.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.022+0000 7f493c76e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4934071780 con 0x7f4934130430 2023-10-01T07:56:50.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.023+0000 7f493ad0b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4934130430 0x7f4934137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:50.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.023+0000 7f4939d09700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f493412f8b0 0x7f493412fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54690/0 (socket says 172.21.15.26:54690) 2023-10-01T07:56:50.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.023+0000 7f4939d09700 1 -- 172.21.15.26:0/1390913099 learned_addr learned my addr 172.21.15.26:0/1390913099 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:50.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.023+0000 7f493ad0b700 1 -- 172.21.15.26:0/1390913099 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f493412cf60 msgr2=0x7f493406f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:50.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.023+0000 7f493ad0b700 1 --2- 172.21.15.26:0/1390913099 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f493412cf60 0x7f493406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:50.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.023+0000 7f493ad0b700 1 -- 172.21.15.26:0/1390913099 >> v1:172.21.15.26:6789/0 conn(0x7f493412f8b0 legacy=0x7f493412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:50.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.023+0000 7f493ad0b700 1 -- 172.21.15.26:0/1390913099 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4934071a40 con 0x7f4934130430 2023-10-01T07:56:50.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.023+0000 7f493ad0b700 1 --2- 172.21.15.26:0/1390913099 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4934130430 0x7f4934137c30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f492c009dc0 tx=0x7f492c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd4afb6db6591938 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:50.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.024+0000 7f4939508700 1 -- 172.21.15.26:0/1390913099 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c00e070 con 0x7f4934130430 2023-10-01T07:56:50.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.024+0000 7f4939508700 1 -- 172.21.15.26:0/1390913099 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492c00bbd0 con 0x7f4934130430 2023-10-01T07:56:50.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.024+0000 7f4939508700 1 -- 172.21.15.26:0/1390913099 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c012430 con 0x7f4934130430 2023-10-01T07:56:50.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.025+0000 7f493c76e700 1 -- 172.21.15.26:0/1390913099 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4934130430 msgr2=0x7f4934137c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:50.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.025+0000 7f493c76e700 1 --2- 172.21.15.26:0/1390913099 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4934130430 0x7f4934137c30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f492c009dc0 tx=0x7f492c00b330 comp rx=0 tx=0).stop 2023-10-01T07:56:50.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.025+0000 7f493c76e700 1 -- 172.21.15.26:0/1390913099 shutdown_connections 2023-10-01T07:56:50.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.025+0000 7f493c76e700 1 --2- 172.21.15.26:0/1390913099 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4934130430 0x7f4934137c30 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:50.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.025+0000 7f493c76e700 1 --2- 172.21.15.26:0/1390913099 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f493412cf60 0x7f493406f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:50.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.025+0000 7f493c76e700 1 -- 172.21.15.26:0/1390913099 >> 172.21.15.26:0/1390913099 conn(0x7f49340a2aa0 msgr2=0x7f49340a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:50.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.025+0000 7f493c76e700 1 -- 172.21.15.26:0/1390913099 shutdown_connections 2023-10-01T07:56:50.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.025+0000 7f493c76e700 1 -- 172.21.15.26:0/1390913099 wait complete. 2023-10-01T07:56:50.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.026+0000 7f493c76e700 1 Processor -- start 2023-10-01T07:56:50.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.026+0000 7f493c76e700 1 -- start start 2023-10-01T07:56:50.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.026+0000 7f493c76e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f493412cf60 0x7f49341c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:50.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.026+0000 7f493c76e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f493412f8b0 0x7f49341c67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:50.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.026+0000 7f493c76e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4934130430 0x7f49341c6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:50.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.027+0000 7f493c76e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4934138c70 con 0x7f493412cf60 2023-10-01T07:56:50.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.027+0000 7f493c76e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4934129fa0 con 0x7f4934130430 2023-10-01T07:56:50.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.027+0000 7f493c76e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f493409d840 con 0x7f493412f8b0 2023-10-01T07:56:50.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.027+0000 7f4939d09700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f493412f8b0 0x7f49341c67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:50.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.027+0000 7f493ad0b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4934130430 0x7f49341c6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:50.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.027+0000 7f4939d09700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f493412f8b0 0x7f49341c67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:48642/0 (socket says 172.21.15.26:48642) 2023-10-01T07:56:50.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.027+0000 7f493ad0b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4934130430 0x7f49341c6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33882/0 (socket says 172.21.15.26:33882) 2023-10-01T07:56:50.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.027+0000 7f4939d09700 1 -- 172.21.15.26:0/2155061277 learned_addr learned my addr 172.21.15.26:0/2155061277 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:50.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.027+0000 7f493ad0b700 1 -- 172.21.15.26:0/2155061277 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f493412f8b0 msgr2=0x7f49341c67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:50.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.027+0000 7f493ad0b700 1 --2- 172.21.15.26:0/2155061277 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f493412f8b0 0x7f49341c67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:50.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.027+0000 7f493ad0b700 1 -- 172.21.15.26:0/2155061277 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f493412cf60 msgr2=0x7f49341c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:50.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.027+0000 7f493ad0b700 1 --2- 172.21.15.26:0/2155061277 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f493412cf60 0x7f49341c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:50.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.027+0000 7f493ad0b700 1 -- 172.21.15.26:0/2155061277 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492c009a70 con 0x7f4934130430 2023-10-01T07:56:50.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.027+0000 7f4939d09700 1 --2- 172.21.15.26:0/2155061277 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f493412f8b0 0x7f49341c67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:50.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.027+0000 7f493ad0b700 1 --2- 172.21.15.26:0/2155061277 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4934130430 0x7f49341c6cf0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f492c016000 tx=0x7f492c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:50.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.028+0000 7f492affd700 1 -- 172.21.15.26:0/2155061277 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c012c90 con 0x7f4934130430 2023-10-01T07:56:50.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.028+0000 7f492affd700 1 -- 172.21.15.26:0/2155061277 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492c020070 con 0x7f4934130430 2023-10-01T07:56:50.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.028+0000 7f492affd700 1 -- 172.21.15.26:0/2155061277 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c004280 con 0x7f4934130430 2023-10-01T07:56:50.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.028+0000 7f493c76e700 1 -- 172.21.15.26:0/2155061277 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f493409c540 con 0x7f4934130430 2023-10-01T07:56:50.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.028+0000 7f493c76e700 1 -- 172.21.15.26:0/2155061277 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f493409b8f0 con 0x7f4934130430 2023-10-01T07:56:50.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.029+0000 7f492affd700 1 -- 172.21.15.26:0/2155061277 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f492c0043e0 con 0x7f4934130430 2023-10-01T07:56:50.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.029+0000 7f492affd700 1 -- 172.21.15.26:0/2155061277 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f492c022070 con 0x7f4934130430 2023-10-01T07:56:50.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.029+0000 7f493c76e700 1 -- 172.21.15.26:0/2155061277 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4934074ea0 con 0x7f4934130430 2023-10-01T07:56:50.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.034+0000 7f492affd700 1 -- 172.21.15.26:0/2155061277 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f492c012e10 con 0x7f4934130430 2023-10-01T07:56:50.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.103+0000 7fccdd347700 1 Processor -- start 2023-10-01T07:56:50.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.103+0000 7fccdd347700 1 -- start start 2023-10-01T07:56:50.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.103+0000 7fccdd347700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fccd809d6f0 0x7fccd809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:50.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.103+0000 7fccdd347700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fccd809e000 0x7fccd81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:50.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.103+0000 7fccdd347700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccd809b120 con 0x7fccd809e410 2023-10-01T07:56:50.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.103+0000 7fccdd347700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd806b460 con 0x7fccd809d6f0 2023-10-01T07:56:50.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.103+0000 7fccdd347700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fccd809a7e0 con 0x7fccd809e000 2023-10-01T07:56:50.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.103+0000 7fccd6ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fccd809d6f0 0x7fccd809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:50.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.103+0000 7fccd6ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fccd809d6f0 0x7fccd809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33888/0 (socket says 172.21.15.26:33888) 2023-10-01T07:56:50.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.103+0000 7fccd77fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fccd809e410 0x7fccd8133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54698/0 (socket says 172.21.15.26:54698) 2023-10-01T07:56:50.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.103+0000 7fccd6ffd700 1 -- 172.21.15.26:0/2959978856 learned_addr learned my addr 172.21.15.26:0/2959978856 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:50.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.103+0000 7fccd67fc700 1 --2- 172.21.15.26:0/2959978856 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fccd809e000 0x7fccd81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:50.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.104+0000 7fccd6ffd700 1 -- 172.21.15.26:0/2959978856 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fccd809e000 msgr2=0x7fccd81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:50.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.104+0000 7fccd6ffd700 1 --2- 172.21.15.26:0/2959978856 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fccd809e000 0x7fccd81339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:50.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.104+0000 7fccd6ffd700 1 -- 172.21.15.26:0/2959978856 >> v1:172.21.15.26:6789/0 conn(0x7fccd809e410 legacy=0x7fccd8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:50.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.104+0000 7fccd6ffd700 1 -- 172.21.15.26:0/2959978856 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd809a500 con 0x7fccd809d6f0 2023-10-01T07:56:50.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.104+0000 7fccd6ffd700 1 --2- 172.21.15.26:0/2959978856 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fccd809d6f0 0x7fccd809dac0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fccc8009920 tx=0x7fccc8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=277ae6a8cd8f9200 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:50.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.104+0000 7fccd5ffb700 1 -- 172.21.15.26:0/2959978856 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc8011830 con 0x7fccd809d6f0 2023-10-01T07:56:50.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.104+0000 7fccd5ffb700 1 -- 172.21.15.26:0/2959978856 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc8011990 con 0x7fccd809d6f0 2023-10-01T07:56:50.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.104+0000 7fccd5ffb700 1 -- 172.21.15.26:0/2959978856 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc8011d20 con 0x7fccd809d6f0 2023-10-01T07:56:50.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.105+0000 7fccdd347700 1 -- 172.21.15.26:0/2959978856 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fccd809d6f0 msgr2=0x7fccd809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:50.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.105+0000 7fccdd347700 1 --2- 172.21.15.26:0/2959978856 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fccd809d6f0 0x7fccd809dac0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fccc8009920 tx=0x7fccc8009c30 comp rx=0 tx=0).stop 2023-10-01T07:56:50.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.105+0000 7fccdd347700 1 -- 172.21.15.26:0/2959978856 shutdown_connections 2023-10-01T07:56:50.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.105+0000 7fccdd347700 1 --2- 172.21.15.26:0/2959978856 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fccd809d6f0 0x7fccd809dac0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:50.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.105+0000 7fccdd347700 1 --2- 172.21.15.26:0/2959978856 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fccd809e000 0x7fccd81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:50.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.105+0000 7fccdd347700 1 -- 172.21.15.26:0/2959978856 >> 172.21.15.26:0/2959978856 conn(0x7fccd8066f50 msgr2=0x7fccd809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:50.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.105+0000 7fccdd347700 1 -- 172.21.15.26:0/2959978856 shutdown_connections 2023-10-01T07:56:50.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.106+0000 7fccdd347700 1 -- 172.21.15.26:0/2959978856 wait complete. 2023-10-01T07:56:50.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.107+0000 7fccdd347700 1 Processor -- start 2023-10-01T07:56:50.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.107+0000 7fccdd347700 1 -- start start 2023-10-01T07:56:50.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.108+0000 7fccdd347700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fccd809d6f0 0x7fccd81cc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:50.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.108+0000 7fccdd347700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccd809e000 0x7fccd81cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:50.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.108+0000 7fccdd347700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fccd809e410 0x7fccd81194b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:50.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.108+0000 7fccdd347700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd811b0c0 con 0x7fccd809e000 2023-10-01T07:56:50.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.108+0000 7fccdd347700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd811b610 con 0x7fccd809e410 2023-10-01T07:56:50.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.108+0000 7fccdd347700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fccd811ccf0 con 0x7fccd809d6f0 2023-10-01T07:56:50.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.108+0000 7fccd67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccd809e000 0x7fccd81cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:50.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.108+0000 7fccd77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fccd809e410 0x7fccd81194b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:50.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.108+0000 7fccd67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccd809e000 0x7fccd81cced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53768/0 (socket says 172.21.15.26:53768) 2023-10-01T07:56:50.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.108+0000 7fccd6ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fccd809d6f0 0x7fccd81cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:50.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.108+0000 7fccd67fc700 1 -- 172.21.15.26:0/1957538506 learned_addr learned my addr 172.21.15.26:0/1957538506 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:50.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.108+0000 7fccd77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fccd809e410 0x7fccd81194b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33900/0 (socket says 172.21.15.26:33900) 2023-10-01T07:56:50.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.109+0000 7fccd77fe700 1 -- 172.21.15.26:0/1957538506 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fccd809d6f0 msgr2=0x7fccd81cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:50.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.109+0000 7fccd77fe700 1 --2- 172.21.15.26:0/1957538506 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fccd809d6f0 0x7fccd81cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:50.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.109+0000 7fccd77fe700 1 -- 172.21.15.26:0/1957538506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccd809e000 msgr2=0x7fccd81cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:50.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.109+0000 7fccd77fe700 1 --2- 172.21.15.26:0/1957538506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccd809e000 0x7fccd81cced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:50.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.109+0000 7fccd77fe700 1 -- 172.21.15.26:0/1957538506 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc8009550 con 0x7fccd809e410 2023-10-01T07:56:50.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.109+0000 7fccd67fc700 1 --2- 172.21.15.26:0/1957538506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccd809e000 0x7fccd81cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:50.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.109+0000 7fccd6ffd700 1 --2- 172.21.15.26:0/1957538506 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fccd809d6f0 0x7fccd81cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:50.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.109+0000 7fccd77fe700 1 --2- 172.21.15.26:0/1957538506 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fccd809e410 0x7fccd81194b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fccd000cae0 tx=0x7fccd000cdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:50.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.109+0000 7fccbf7fe700 1 -- 172.21.15.26:0/1957538506 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd000a9e0 con 0x7fccd809e410 2023-10-01T07:56:50.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.109+0000 7fccbf7fe700 1 -- 172.21.15.26:0/1957538506 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd000ab40 con 0x7fccd809e410 2023-10-01T07:56:50.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.109+0000 7fccbf7fe700 1 -- 172.21.15.26:0/1957538506 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd0007070 con 0x7fccd809e410 2023-10-01T07:56:50.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.109+0000 7fccdd347700 1 -- 172.21.15.26:0/1957538506 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd81333c0 con 0x7fccd809e410 2023-10-01T07:56:50.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.109+0000 7fccdd347700 1 -- 172.21.15.26:0/1957538506 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd80a2df0 con 0x7fccd809e410 2023-10-01T07:56:50.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.110+0000 7fccbf7fe700 1 -- 172.21.15.26:0/1957538506 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fccd00071d0 con 0x7fccd809e410 2023-10-01T07:56:50.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.110+0000 7fccbf7fe700 1 -- 172.21.15.26:0/1957538506 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fccd003f2e0 con 0x7fccd809e410 2023-10-01T07:56:50.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.111+0000 7fccdd347700 1 -- 172.21.15.26:0/1957538506 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd81cd530 con 0x7fccd809e410 2023-10-01T07:56:50.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.116+0000 7fccbf7fe700 1 -- 172.21.15.26:0/1957538506 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fccd0017080 con 0x7fccd809e410 2023-10-01T07:56:50.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.153+0000 7f1c57f17700 1 Processor -- start 2023-10-01T07:56:50.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.154+0000 7f1c57f17700 1 -- start start 2023-10-01T07:56:50.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.154+0000 7f1c57f17700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1c500a0a30 0x7f1c500a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:50.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.154+0000 7f1c57f17700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c50134170 0x7f1c5013bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:50.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.154+0000 7f1c57f17700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c5009edd0 con 0x7f1c500a1340 2023-10-01T07:56:50.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.154+0000 7f1c57f17700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c5009e1f0 con 0x7f1c500a0a30 2023-10-01T07:56:50.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.154+0000 7f1c57f17700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5009dc50 con 0x7f1c50134170 2023-10-01T07:56:50.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.154+0000 7f1c564b4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c50134170 0x7f1c5013bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:50.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.155+0000 7f1c564b4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c50134170 0x7f1c5013bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:48662/0 (socket says 172.21.15.26:48662) 2023-10-01T07:56:50.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.155+0000 7f1c55cb3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1c500a0a30 0x7f1c500a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:50.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.155+0000 7f1c564b4700 1 -- 172.21.15.26:0/4231290130 learned_addr learned my addr 172.21.15.26:0/4231290130 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:50.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.155+0000 7f1c55cb3700 1 -- 172.21.15.26:0/4231290130 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c50134170 msgr2=0x7f1c5013bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:50.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.155+0000 7f1c55cb3700 1 --2- 172.21.15.26:0/4231290130 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c50134170 0x7f1c5013bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:50.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.155+0000 7f1c55cb3700 1 -- 172.21.15.26:0/4231290130 >> v1:172.21.15.26:6789/0 conn(0x7f1c500a1340 legacy=0x7f1c50133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:50.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.155+0000 7f1c55cb3700 1 -- 172.21.15.26:0/4231290130 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c500a1fe0 con 0x7f1c500a0a30 2023-10-01T07:56:50.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.155+0000 7f1c564b4700 1 --2- 172.21.15.26:0/4231290130 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c50134170 0x7f1c5013bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:50.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.155+0000 7f1c55cb3700 1 --2- 172.21.15.26:0/4231290130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c500a0a30 0x7f1c500a0e00 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c009840 tx=0x7f1c4c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb7f6135c1943da9 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:50.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.155+0000 7f1c54cb1700 1 -- 172.21.15.26:0/4231290130 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c011830 con 0x7f1c500a0a30 2023-10-01T07:56:50.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.155+0000 7f1c54cb1700 1 -- 172.21.15.26:0/4231290130 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4c011990 con 0x7f1c500a0a30 2023-10-01T07:56:50.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.155+0000 7f1c54cb1700 1 -- 172.21.15.26:0/4231290130 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c011d20 con 0x7f1c500a0a30 2023-10-01T07:56:50.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.156+0000 7f1c57f17700 1 -- 172.21.15.26:0/4231290130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c500a0a30 msgr2=0x7f1c500a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:50.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.156+0000 7f1c57f17700 1 --2- 172.21.15.26:0/4231290130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c500a0a30 0x7f1c500a0e00 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c009840 tx=0x7f1c4c009b50 comp rx=0 tx=0).stop 2023-10-01T07:56:50.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.156+0000 7f1c57f17700 1 -- 172.21.15.26:0/4231290130 shutdown_connections 2023-10-01T07:56:50.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.156+0000 7f1c57f17700 1 --2- 172.21.15.26:0/4231290130 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c50134170 0x7f1c5013bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:50.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.156+0000 7f1c57f17700 1 --2- 172.21.15.26:0/4231290130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c500a0a30 0x7f1c500a0e00 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:50.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.156+0000 7f1c57f17700 1 -- 172.21.15.26:0/4231290130 >> 172.21.15.26:0/4231290130 conn(0x7f1c500a6550 msgr2=0x7f1c500a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:50.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.156+0000 7f1c57f17700 1 -- 172.21.15.26:0/4231290130 shutdown_connections 2023-10-01T07:56:50.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.156+0000 7f1c57f17700 1 -- 172.21.15.26:0/4231290130 wait complete. 2023-10-01T07:56:50.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.157+0000 7f1c57f17700 1 Processor -- start 2023-10-01T07:56:50.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.157+0000 7f1c57f17700 1 -- start start 2023-10-01T07:56:50.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.158+0000 7f1c57f17700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c500a0a30 0x7f1c501c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:50.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.158+0000 7f1c57f17700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c500a1340 0x7f1c501c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:50.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.158+0000 7f1c57f17700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c50134170 0x7f1c501c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:50.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.158+0000 7f1c57f17700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c501246b0 con 0x7f1c500a1340 2023-10-01T07:56:50.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.158+0000 7f1c57f17700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c500a0220 con 0x7f1c50134170 2023-10-01T07:56:50.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.158+0000 7f1c57f17700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c50126190 con 0x7f1c500a0a30 2023-10-01T07:56:50.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.158+0000 7f1c554b2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c500a1340 0x7f1c501c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:50.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.158+0000 7f1c554b2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c500a1340 0x7f1c501c89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53788/0 (socket says 172.21.15.26:53788) 2023-10-01T07:56:50.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.158+0000 7f1c554b2700 1 -- 172.21.15.26:0/1385629898 learned_addr learned my addr 172.21.15.26:0/1385629898 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:50.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.158+0000 7f1c564b4700 1 --2- 172.21.15.26:0/1385629898 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c50134170 0x7f1c501c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:50.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.158+0000 7f1c55cb3700 1 --2- 172.21.15.26:0/1385629898 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c500a0a30 0x7f1c501c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:50.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.158+0000 7f1c554b2700 1 -- 172.21.15.26:0/1385629898 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c500a0a30 msgr2=0x7f1c501c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:50.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.158+0000 7f1c554b2700 1 --2- 172.21.15.26:0/1385629898 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c500a0a30 0x7f1c501c8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:50.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.158+0000 7f1c554b2700 1 -- 172.21.15.26:0/1385629898 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c50134170 msgr2=0x7f1c501c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:50.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.158+0000 7f1c554b2700 1 --2- 172.21.15.26:0/1385629898 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c50134170 0x7f1c501c8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:50.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.158+0000 7f1c554b2700 1 -- 172.21.15.26:0/1385629898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c48009b30 con 0x7f1c500a1340 2023-10-01T07:56:50.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.158+0000 7f1c554b2700 1 --2- 172.21.15.26:0/1385629898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c500a1340 0x7f1c501c89c0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1c4000c510 tx=0x7f1c4000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:50.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.159+0000 7f1c467fc700 1 -- 172.21.15.26:0/1385629898 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c400052d0 con 0x7f1c500a1340 2023-10-01T07:56:50.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.159+0000 7f1c467fc700 1 -- 172.21.15.26:0/1385629898 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c40005430 con 0x7f1c500a1340 2023-10-01T07:56:50.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.159+0000 7f1c57f17700 1 -- 172.21.15.26:0/1385629898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c4c0094a0 con 0x7f1c500a1340 2023-10-01T07:56:50.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.159+0000 7f1c467fc700 1 -- 172.21.15.26:0/1385629898 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c400038c0 con 0x7f1c500a1340 2023-10-01T07:56:50.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.159+0000 7f1c57f17700 1 -- 172.21.15.26:0/1385629898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c500a25e0 con 0x7f1c500a1340 2023-10-01T07:56:50.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.160+0000 7f1c57f17700 1 -- 172.21.15.26:0/1385629898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c50124cd0 con 0x7f1c500a1340 2023-10-01T07:56:50.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.160+0000 7f1c467fc700 1 -- 172.21.15.26:0/1385629898 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1c40003a20 con 0x7f1c500a1340 2023-10-01T07:56:50.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.160+0000 7f1c467fc700 1 -- 172.21.15.26:0/1385629898 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1c4003ea60 con 0x7f1c500a1340 2023-10-01T07:56:50.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.169+0000 7f1c467fc700 1 -- 172.21.15.26:0/1385629898 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1c40018260 con 0x7f1c500a1340 2023-10-01T07:56:50.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.248+0000 7f493c76e700 1 -- 172.21.15.26:0/2155061277 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4934071380 con 0x7f4934130430 2023-10-01T07:56:50.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.248+0000 7f492affd700 1 -- 172.21.15.26:0/2155061277 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f492c02c030 con 0x7f4934130430 2023-10-01T07:56:50.249 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:50.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.250+0000 7f493c76e700 1 -- 172.21.15.26:0/2155061277 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4934130430 msgr2=0x7f49341c6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:50.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.250+0000 7f493c76e700 1 --2- 172.21.15.26:0/2155061277 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4934130430 0x7f49341c6cf0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f492c016000 tx=0x7f492c004ad0 comp rx=0 tx=0).stop 2023-10-01T07:56:50.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.250+0000 7f493c76e700 1 -- 172.21.15.26:0/2155061277 shutdown_connections 2023-10-01T07:56:50.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.250+0000 7f493c76e700 1 --2- 172.21.15.26:0/2155061277 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4934130430 0x7f49341c6cf0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:50.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.250+0000 7f493c76e700 1 --2- 172.21.15.26:0/2155061277 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f493412cf60 0x7f49341c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:50.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.250+0000 7f493c76e700 1 --2- 172.21.15.26:0/2155061277 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f493412f8b0 0x7f49341c67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:50.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.250+0000 7f493c76e700 1 -- 172.21.15.26:0/2155061277 >> 172.21.15.26:0/2155061277 conn(0x7f49340a2aa0 msgr2=0x7f493406e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:50.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.250+0000 7f493c76e700 1 -- 172.21.15.26:0/2155061277 shutdown_connections 2023-10-01T07:56:50.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.250+0000 7f493c76e700 1 -- 172.21.15.26:0/2155061277 wait complete. 2023-10-01T07:56:50.265 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:50.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.338+0000 7fccdd347700 1 -- 172.21.15.26:0/1957538506 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fccd8074ea0 con 0x7fccd809e410 2023-10-01T07:56:50.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.338+0000 7fccbf7fe700 1 -- 172.21.15.26:0/1957538506 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fccd001b3b0 con 0x7fccd809e410 2023-10-01T07:56:50.339 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:50.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.340+0000 7fccdd347700 1 -- 172.21.15.26:0/1957538506 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fccd809e410 msgr2=0x7fccd81194b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:50.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.341+0000 7fccdd347700 1 --2- 172.21.15.26:0/1957538506 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fccd809e410 0x7fccd81194b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fccd000cae0 tx=0x7fccd000cdf0 comp rx=0 tx=0).stop 2023-10-01T07:56:50.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.341+0000 7fccdd347700 1 -- 172.21.15.26:0/1957538506 shutdown_connections 2023-10-01T07:56:50.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.341+0000 7fccdd347700 1 --2- 172.21.15.26:0/1957538506 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fccd809e410 0x7fccd81194b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:50.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.341+0000 7fccdd347700 1 --2- 172.21.15.26:0/1957538506 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fccd809d6f0 0x7fccd81cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:50.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.341+0000 7fccdd347700 1 --2- 172.21.15.26:0/1957538506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccd809e000 0x7fccd81cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:50.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.341+0000 7fccdd347700 1 -- 172.21.15.26:0/1957538506 >> 172.21.15.26:0/1957538506 conn(0x7fccd8066f50 msgr2=0x7fccd80a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:50.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.341+0000 7fccdd347700 1 -- 172.21.15.26:0/1957538506 shutdown_connections 2023-10-01T07:56:50.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.341+0000 7fccdd347700 1 -- 172.21.15.26:0/1957538506 wait complete. 2023-10-01T07:56:50.355 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:50.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.378+0000 7f1c57f17700 1 -- 172.21.15.26:0/1385629898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1c50074ea0 con 0x7f1c500a1340 2023-10-01T07:56:50.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.379+0000 7f1c467fc700 1 -- 172.21.15.26:0/1385629898 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1c40017030 con 0x7f1c500a1340 2023-10-01T07:56:50.379 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:50.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.381+0000 7f1c57f17700 1 -- 172.21.15.26:0/1385629898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c500a1340 msgr2=0x7f1c501c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:50.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.381+0000 7f1c57f17700 1 --2- 172.21.15.26:0/1385629898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c500a1340 0x7f1c501c89c0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1c4000c510 tx=0x7f1c4000c820 comp rx=0 tx=0).stop 2023-10-01T07:56:50.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.381+0000 7f1c57f17700 1 -- 172.21.15.26:0/1385629898 shutdown_connections 2023-10-01T07:56:50.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.381+0000 7f1c57f17700 1 --2- 172.21.15.26:0/1385629898 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c50134170 0x7f1c501c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:50.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.381+0000 7f1c57f17700 1 --2- 172.21.15.26:0/1385629898 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c500a0a30 0x7f1c501c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:50.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.381+0000 7f1c57f17700 1 --2- 172.21.15.26:0/1385629898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c500a1340 0x7f1c501c89c0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:50.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.381+0000 7f1c57f17700 1 -- 172.21.15.26:0/1385629898 >> 172.21.15.26:0/1385629898 conn(0x7f1c500a6550 msgr2=0x7f1c5011c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:50.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.381+0000 7f1c57f17700 1 -- 172.21.15.26:0/1385629898 shutdown_connections 2023-10-01T07:56:50.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:50.381+0000 7f1c57f17700 1 -- 172.21.15.26:0/1385629898 wait complete. 2023-10-01T07:56:50.395 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:50.910 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:51.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.056+0000 7fbc1bc6e700 1 Processor -- start 2023-10-01T07:56:51.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.056+0000 7fbc1bc6e700 1 -- start start 2023-10-01T07:56:51.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.057+0000 7fbc1bc6e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbc1409d6f0 0x7fbc1409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:51.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.057+0000 7fbc1bc6e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc1409e000 0x7fbc14130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:51.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.057+0000 7fbc1bc6e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc1409f130 con 0x7fbc1409e410 2023-10-01T07:56:51.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.057+0000 7fbc1bc6e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc1409f520 con 0x7fbc1409d6f0 2023-10-01T07:56:51.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.057+0000 7fbc1bc6e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1409e930 con 0x7fbc1409e000 2023-10-01T07:56:51.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.057+0000 7fbc19a0a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbc1409d6f0 0x7fbc1409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:51.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.057+0000 7fbc19a0a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbc1409d6f0 0x7fbc1409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53798/0 (socket says 172.21.15.26:53798) 2023-10-01T07:56:51.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.057+0000 7fbc19a0a700 1 -- 172.21.15.26:0/2787455906 learned_addr learned my addr 172.21.15.26:0/2787455906 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:51.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.057+0000 7fbc19209700 1 --2- 172.21.15.26:0/2787455906 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc1409e000 0x7fbc14130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:51.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.057+0000 7fbc19a0a700 1 -- 172.21.15.26:0/2787455906 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc1409e000 msgr2=0x7fbc14130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:51.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.057+0000 7fbc19a0a700 1 --2- 172.21.15.26:0/2787455906 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc1409e000 0x7fbc14130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.057+0000 7fbc19a0a700 1 -- 172.21.15.26:0/2787455906 >> v1:172.21.15.26:6789/0 conn(0x7fbc1409e410 legacy=0x7fbc14130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:51.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.057+0000 7fbc19a0a700 1 -- 172.21.15.26:0/2787455906 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc1409b2d0 con 0x7fbc1409d6f0 2023-10-01T07:56:51.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.057+0000 7fbc19a0a700 1 --2- 172.21.15.26:0/2787455906 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc1409d6f0 0x7fbc1409dac0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fbc040098f0 tx=0x7fbc04009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c22f791c6df42e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:51.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.058+0000 7fbc18a08700 1 -- 172.21.15.26:0/2787455906 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc04011830 con 0x7fbc1409d6f0 2023-10-01T07:56:51.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.058+0000 7fbc18a08700 1 -- 172.21.15.26:0/2787455906 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc04011990 con 0x7fbc1409d6f0 2023-10-01T07:56:51.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.058+0000 7fbc18a08700 1 -- 172.21.15.26:0/2787455906 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc04011d20 con 0x7fbc1409d6f0 2023-10-01T07:56:51.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.058+0000 7fbc1bc6e700 1 -- 172.21.15.26:0/2787455906 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc1409d6f0 msgr2=0x7fbc1409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:51.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.058+0000 7fbc1bc6e700 1 --2- 172.21.15.26:0/2787455906 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc1409d6f0 0x7fbc1409dac0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fbc040098f0 tx=0x7fbc04009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:51.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.058+0000 7fbc1bc6e700 1 -- 172.21.15.26:0/2787455906 shutdown_connections 2023-10-01T07:56:51.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.058+0000 7fbc1bc6e700 1 --2- 172.21.15.26:0/2787455906 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc1409d6f0 0x7fbc1409dac0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.058+0000 7fbc1bc6e700 1 --2- 172.21.15.26:0/2787455906 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc1409e000 0x7fbc14130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.058+0000 7fbc1bc6e700 1 -- 172.21.15.26:0/2787455906 >> 172.21.15.26:0/2787455906 conn(0x7fbc14066f50 msgr2=0x7fbc1409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:51.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.058+0000 7fbc1bc6e700 1 -- 172.21.15.26:0/2787455906 shutdown_connections 2023-10-01T07:56:51.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.058+0000 7fbc1bc6e700 1 -- 172.21.15.26:0/2787455906 wait complete. 2023-10-01T07:56:51.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.060+0000 7fbc1bc6e700 1 Processor -- start 2023-10-01T07:56:51.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.060+0000 7fbc1bc6e700 1 -- start start 2023-10-01T07:56:51.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.060+0000 7fbc1bc6e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc1409d6f0 0x7fbc141222c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:51.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.060+0000 7fbc1bc6e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc1409e000 0x7fbc14122800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:51.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.060+0000 7fbc1bc6e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc1409e410 0x7fbc14122d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:51.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.060+0000 7fbc1bc6e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc141254c0 con 0x7fbc1409e410 2023-10-01T07:56:51.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.060+0000 7fbc1bc6e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc14124770 con 0x7fbc1409e000 2023-10-01T07:56:51.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.060+0000 7fbc1bc6e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc14123ed0 con 0x7fbc1409d6f0 2023-10-01T07:56:51.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.060+0000 7fbc19a0a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc1409d6f0 0x7fbc141222c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:51.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.060+0000 7fbc19209700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc1409e000 0x7fbc14122800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:51.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.060+0000 7fbc19a0a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc1409d6f0 0x7fbc141222c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:48678/0 (socket says 172.21.15.26:48678) 2023-10-01T07:56:51.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.060+0000 7fbc19a0a700 1 -- 172.21.15.26:0/539559196 learned_addr learned my addr 172.21.15.26:0/539559196 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:51.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.060+0000 7fbc1a20b700 1 --2- 172.21.15.26:0/539559196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc1409e410 0x7fbc14122d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:51.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.061+0000 7fbc19a0a700 1 -- 172.21.15.26:0/539559196 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc1409e000 msgr2=0x7fbc14122800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:51.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.061+0000 7fbc19a0a700 1 --2- 172.21.15.26:0/539559196 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc1409e000 0x7fbc14122800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.061+0000 7fbc19a0a700 1 -- 172.21.15.26:0/539559196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc1409e410 msgr2=0x7fbc14122d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:51.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.061+0000 7fbc19a0a700 1 --2- 172.21.15.26:0/539559196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc1409e410 0x7fbc14122d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.061+0000 7fbc19a0a700 1 -- 172.21.15.26:0/539559196 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc04009550 con 0x7fbc1409d6f0 2023-10-01T07:56:51.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.061+0000 7fbc19209700 1 --2- 172.21.15.26:0/539559196 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc1409e000 0x7fbc14122800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:51.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.061+0000 7fbc1a20b700 1 --2- 172.21.15.26:0/539559196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc1409e410 0x7fbc14122d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:51.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.061+0000 7fbc19a0a700 1 --2- 172.21.15.26:0/539559196 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc1409d6f0 0x7fbc141222c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbc04009c40 tx=0x7fbc04004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:51.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.061+0000 7fbc0a7fc700 1 -- 172.21.15.26:0/539559196 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc04004400 con 0x7fbc1409d6f0 2023-10-01T07:56:51.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.061+0000 7fbc0a7fc700 1 -- 172.21.15.26:0/539559196 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0401f070 con 0x7fbc1409d6f0 2023-10-01T07:56:51.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.061+0000 7fbc1bc6e700 1 -- 172.21.15.26:0/539559196 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc14125de0 con 0x7fbc1409d6f0 2023-10-01T07:56:51.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.061+0000 7fbc0a7fc700 1 -- 172.21.15.26:0/539559196 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc040038e0 con 0x7fbc1409d6f0 2023-10-01T07:56:51.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.061+0000 7fbc1bc6e700 1 -- 172.21.15.26:0/539559196 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc14125b00 con 0x7fbc1409d6f0 2023-10-01T07:56:51.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.062+0000 7fbc0a7fc700 1 -- 172.21.15.26:0/539559196 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbc04021030 con 0x7fbc1409d6f0 2023-10-01T07:56:51.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.062+0000 7fbc0a7fc700 1 -- 172.21.15.26:0/539559196 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbc04040b20 con 0x7fbc1409d6f0 2023-10-01T07:56:51.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.062+0000 7fbc1bc6e700 1 -- 172.21.15.26:0/539559196 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc14074ea0 con 0x7fbc1409d6f0 2023-10-01T07:56:51.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.068+0000 7fbc0a7fc700 1 -- 172.21.15.26:0/539559196 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbc04004560 con 0x7fbc1409d6f0 2023-10-01T07:56:51.266 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:51.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.274+0000 7fbc1bc6e700 1 -- 172.21.15.26:0/539559196 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbc1406c360 con 0x7fbc1409d6f0 2023-10-01T07:56:51.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.274+0000 7fbc0a7fc700 1 -- 172.21.15.26:0/539559196 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbc04015020 con 0x7fbc1409d6f0 2023-10-01T07:56:51.275 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:51.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.277+0000 7fbc1bc6e700 1 -- 172.21.15.26:0/539559196 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc1409d6f0 msgr2=0x7fbc141222c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:51.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.277+0000 7fbc1bc6e700 1 --2- 172.21.15.26:0/539559196 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc1409d6f0 0x7fbc141222c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbc04009c40 tx=0x7fbc04004750 comp rx=0 tx=0).stop 2023-10-01T07:56:51.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.277+0000 7fbc1bc6e700 1 -- 172.21.15.26:0/539559196 shutdown_connections 2023-10-01T07:56:51.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.277+0000 7fbc1bc6e700 1 --2- 172.21.15.26:0/539559196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc1409e410 0x7fbc14122d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.277+0000 7fbc1bc6e700 1 --2- 172.21.15.26:0/539559196 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc1409d6f0 0x7fbc141222c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.277+0000 7fbc1bc6e700 1 --2- 172.21.15.26:0/539559196 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc1409e000 0x7fbc14122800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.277+0000 7fbc1bc6e700 1 -- 172.21.15.26:0/539559196 >> 172.21.15.26:0/539559196 conn(0x7fbc14066f50 msgr2=0x7fbc14130b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:51.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.277+0000 7fbc1bc6e700 1 -- 172.21.15.26:0/539559196 shutdown_connections 2023-10-01T07:56:51.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.277+0000 7fbc1bc6e700 1 -- 172.21.15.26:0/539559196 wait complete. 2023-10-01T07:56:51.292 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:51.356 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:51.396 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:51.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.407+0000 7fdf9ea48700 1 Processor -- start 2023-10-01T07:56:51.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.407+0000 7fdf9ea48700 1 -- start start 2023-10-01T07:56:51.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.408+0000 7fdf9ea48700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdf98133420 0x7fdf981337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:51.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.408+0000 7fdf9ea48700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdf98133e30 0x7fdf9812ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:51.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.408+0000 7fdf9ea48700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf98134260 0x7fdf981304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:51.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.408+0000 7fdf9ea48700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf9806b990 con 0x7fdf98133420 2023-10-01T07:56:51.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.408+0000 7fdf9ea48700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf980a0590 con 0x7fdf98134260 2023-10-01T07:56:51.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.408+0000 7fdf9ea48700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9809fb80 con 0x7fdf98133e30 2023-10-01T07:56:51.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.408+0000 7fdf97fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdf98133420 0x7fdf981337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:51.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.408+0000 7fdf977fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdf98133e30 0x7fdf9812ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:51.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.408+0000 7fdf97fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdf98133420 0x7fdf981337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53826/0 (socket says 172.21.15.26:53826) 2023-10-01T07:56:51.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.408+0000 7fdf97fff700 1 -- 172.21.15.26:0/3615074704 learned_addr learned my addr 172.21.15.26:0/3615074704 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:51.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.408+0000 7fdf9cfe5700 1 --2- 172.21.15.26:0/3615074704 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf98134260 0x7fdf981304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:51.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.409+0000 7fdf977fe700 1 -- 172.21.15.26:0/3615074704 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf98134260 msgr2=0x7fdf981304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:51.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.409+0000 7fdf977fe700 1 --2- 172.21.15.26:0/3615074704 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf98134260 0x7fdf981304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.409+0000 7fdf977fe700 1 -- 172.21.15.26:0/3615074704 >> v2:172.21.15.26:3300/0 conn(0x7fdf98133420 msgr2=0x7fdf981337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:51.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.409+0000 7fdf977fe700 1 --2- 172.21.15.26:0/3615074704 >> v2:172.21.15.26:3300/0 conn(0x7fdf98133420 0x7fdf981337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.409+0000 7fdf977fe700 1 -- 172.21.15.26:0/3615074704 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf980a0030 con 0x7fdf98133e30 2023-10-01T07:56:51.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.409+0000 7fdf97fff700 1 --2- 172.21.15.26:0/3615074704 >> v2:172.21.15.26:3300/0 conn(0x7fdf98133420 0x7fdf981337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:51.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.409+0000 7fdf977fe700 1 --2- 172.21.15.26:0/3615074704 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdf98133e30 0x7fdf9812ff90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c009840 tx=0x7fdf8c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=192c56bef7352baf server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:51.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.409+0000 7fdf96ffd700 1 -- 172.21.15.26:0/3615074704 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c011830 con 0x7fdf98133e30 2023-10-01T07:56:51.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.409+0000 7fdf96ffd700 1 -- 172.21.15.26:0/3615074704 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8c011990 con 0x7fdf98133e30 2023-10-01T07:56:51.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.409+0000 7fdf96ffd700 1 -- 172.21.15.26:0/3615074704 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c011d20 con 0x7fdf98133e30 2023-10-01T07:56:51.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.410+0000 7fdf9ea48700 1 -- 172.21.15.26:0/3615074704 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdf98133e30 msgr2=0x7fdf9812ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:51.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.410+0000 7fdf9ea48700 1 --2- 172.21.15.26:0/3615074704 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdf98133e30 0x7fdf9812ff90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c009840 tx=0x7fdf8c009b50 comp rx=0 tx=0).stop 2023-10-01T07:56:51.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.410+0000 7fdf9ea48700 1 -- 172.21.15.26:0/3615074704 shutdown_connections 2023-10-01T07:56:51.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.410+0000 7fdf9ea48700 1 --2- 172.21.15.26:0/3615074704 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf98134260 0x7fdf981304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.410+0000 7fdf9ea48700 1 --2- 172.21.15.26:0/3615074704 >> v2:172.21.15.26:3300/0 conn(0x7fdf98133420 0x7fdf981337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.410+0000 7fdf9ea48700 1 --2- 172.21.15.26:0/3615074704 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdf98133e30 0x7fdf9812ff90 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.410+0000 7fdf9ea48700 1 -- 172.21.15.26:0/3615074704 >> 172.21.15.26:0/3615074704 conn(0x7fdf980a4210 msgr2=0x7fdf980a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:51.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.410+0000 7fdf9ea48700 1 -- 172.21.15.26:0/3615074704 shutdown_connections 2023-10-01T07:56:51.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.410+0000 7fdf9ea48700 1 -- 172.21.15.26:0/3615074704 wait complete. 2023-10-01T07:56:51.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.412+0000 7fdf9ea48700 1 Processor -- start 2023-10-01T07:56:51.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.412+0000 7fdf9ea48700 1 -- start start 2023-10-01T07:56:51.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.413+0000 7fdf9ea48700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf98133420 0x7fdf9809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:51.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.413+0000 7fdf9ea48700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf98133e30 0x7fdf9809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:51.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.413+0000 7fdf9ea48700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdf98134260 0x7fdf9809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:51.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.413+0000 7fdf9ea48700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9812d950 con 0x7fdf98133e30 2023-10-01T07:56:51.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.413+0000 7fdf9ea48700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9811fb90 con 0x7fdf98133420 2023-10-01T07:56:51.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.413+0000 7fdf9ea48700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9811f450 con 0x7fdf98134260 2023-10-01T07:56:51.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.413+0000 7fdf97fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf98133420 0x7fdf9809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:51.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.413+0000 7fdf97fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf98133420 0x7fdf9809c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33938/0 (socket says 172.21.15.26:33938) 2023-10-01T07:56:51.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.413+0000 7fdf9cfe5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdf98134260 0x7fdf9809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:51.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.413+0000 7fdf97fff700 1 -- 172.21.15.26:0/4072831306 learned_addr learned my addr 172.21.15.26:0/4072831306 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:51.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.413+0000 7fdf977fe700 1 --2- 172.21.15.26:0/4072831306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf98133e30 0x7fdf9809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:51.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.414+0000 7fdf9cfe5700 1 -- 172.21.15.26:0/4072831306 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf98133420 msgr2=0x7fdf9809c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:51.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.414+0000 7fdf9cfe5700 1 --2- 172.21.15.26:0/4072831306 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf98133420 0x7fdf9809c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.414+0000 7fdf9cfe5700 1 -- 172.21.15.26:0/4072831306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf98133e30 msgr2=0x7fdf9809c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:51.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.414+0000 7fdf9cfe5700 1 --2- 172.21.15.26:0/4072831306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf98133e30 0x7fdf9809c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.414+0000 7fdf9cfe5700 1 -- 172.21.15.26:0/4072831306 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf88009550 con 0x7fdf98134260 2023-10-01T07:56:51.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.414+0000 7fdf97fff700 1 --2- 172.21.15.26:0/4072831306 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf98133420 0x7fdf9809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:51.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.414+0000 7fdf9cfe5700 1 --2- 172.21.15.26:0/4072831306 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdf98134260 0x7fdf9809cf00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdf90007d60 tx=0x7fdf9000e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:51.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.414+0000 7fdf94ff9700 1 -- 172.21.15.26:0/4072831306 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf90018070 con 0x7fdf98134260 2023-10-01T07:56:51.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.414+0000 7fdf94ff9700 1 -- 172.21.15.26:0/4072831306 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf9000eb30 con 0x7fdf98134260 2023-10-01T07:56:51.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.414+0000 7fdf9ea48700 1 -- 172.21.15.26:0/4072831306 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf8c0094a0 con 0x7fdf98134260 2023-10-01T07:56:51.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.414+0000 7fdf94ff9700 1 -- 172.21.15.26:0/4072831306 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf90003a20 con 0x7fdf98134260 2023-10-01T07:56:51.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.414+0000 7fdf9ea48700 1 -- 172.21.15.26:0/4072831306 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf9811ef70 con 0x7fdf98134260 2023-10-01T07:56:51.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.415+0000 7fdf94ff9700 1 -- 172.21.15.26:0/4072831306 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdf90014420 con 0x7fdf98134260 2023-10-01T07:56:51.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.415+0000 7fdf94ff9700 1 -- 172.21.15.26:0/4072831306 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdf9003f5a0 con 0x7fdf98134260 2023-10-01T07:56:51.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.416+0000 7fdf9ea48700 1 -- 172.21.15.26:0/4072831306 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf98074ea0 con 0x7fdf98134260 2023-10-01T07:56:51.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.421+0000 7fdf94ff9700 1 -- 172.21.15.26:0/4072831306 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdf900148b0 con 0x7fdf98134260 2023-10-01T07:56:51.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.527+0000 7faa953f2700 1 Processor -- start 2023-10-01T07:56:51.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.527+0000 7faa953f2700 1 -- start start 2023-10-01T07:56:51.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.527+0000 7faa953f2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa9009d630 0x7faa900a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:51.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.527+0000 7faa953f2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa90138d80 0x7faa9013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:51.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.527+0000 7faa953f2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa900a2a70 con 0x7faa900a0a30 2023-10-01T07:56:51.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.527+0000 7faa953f2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa900a01d0 con 0x7faa9009d630 2023-10-01T07:56:51.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.527+0000 7faa953f2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa9009e2b0 con 0x7faa90138d80 2023-10-01T07:56:51.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.528+0000 7faa87fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa9009d630 0x7faa900a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:51.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.528+0000 7faa8effd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7faa900a0a30 0x7faa900a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54716/0 (socket says 172.21.15.26:54716) 2023-10-01T07:56:51.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.528+0000 7faa8effd700 1 -- 172.21.15.26:0/3423043263 learned_addr learned my addr 172.21.15.26:0/3423043263 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:51.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.528+0000 7faa8f7fe700 1 --2- 172.21.15.26:0/3423043263 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa90138d80 0x7faa9013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:51.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.528+0000 7faa87fff700 1 -- 172.21.15.26:0/3423043263 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa90138d80 msgr2=0x7faa9013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:51.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.528+0000 7faa87fff700 1 --2- 172.21.15.26:0/3423043263 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa90138d80 0x7faa9013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.528+0000 7faa87fff700 1 -- 172.21.15.26:0/3423043263 >> v1:172.21.15.26:6789/0 conn(0x7faa900a0a30 legacy=0x7faa900a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:51.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.528+0000 7faa8e7fc700 1 -- 172.21.15.26:0/3423043263 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3417473127 0 0) 0x7faa900a2a70 con 0x7faa900a0a30 2023-10-01T07:56:51.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.528+0000 7faa87fff700 1 -- 172.21.15.26:0/3423043263 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa9009dc50 con 0x7faa9009d630 2023-10-01T07:56:51.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.528+0000 7faa87fff700 1 --2- 172.21.15.26:0/3423043263 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa9009d630 0x7faa900a1510 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7faa78009870 tx=0x7faa78009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4d7749586f400ff server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:51.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.528+0000 7faa8e7fc700 1 -- 172.21.15.26:0/3423043263 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa78011830 con 0x7faa9009d630 2023-10-01T07:56:51.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.529+0000 7faa8e7fc700 1 -- 172.21.15.26:0/3423043263 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa78011990 con 0x7faa9009d630 2023-10-01T07:56:51.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.529+0000 7faa8e7fc700 1 -- 172.21.15.26:0/3423043263 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa78011d20 con 0x7faa9009d630 2023-10-01T07:56:51.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.529+0000 7faa953f2700 1 -- 172.21.15.26:0/3423043263 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa9009d630 msgr2=0x7faa900a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:51.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.529+0000 7faa953f2700 1 --2- 172.21.15.26:0/3423043263 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa9009d630 0x7faa900a1510 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7faa78009870 tx=0x7faa78009b80 comp rx=0 tx=0).stop 2023-10-01T07:56:51.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.529+0000 7faa953f2700 1 -- 172.21.15.26:0/3423043263 shutdown_connections 2023-10-01T07:56:51.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.529+0000 7faa953f2700 1 --2- 172.21.15.26:0/3423043263 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa90138d80 0x7faa9013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.529+0000 7faa953f2700 1 --2- 172.21.15.26:0/3423043263 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa9009d630 0x7faa900a1510 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.529+0000 7faa953f2700 1 -- 172.21.15.26:0/3423043263 >> 172.21.15.26:0/3423043263 conn(0x7faa900a3050 msgr2=0x7faa900a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:51.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.529+0000 7faa953f2700 1 -- 172.21.15.26:0/3423043263 shutdown_connections 2023-10-01T07:56:51.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.529+0000 7faa953f2700 1 -- 172.21.15.26:0/3423043263 wait complete. 2023-10-01T07:56:51.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.530+0000 7faa953f2700 1 Processor -- start 2023-10-01T07:56:51.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.530+0000 7faa953f2700 1 -- start start 2023-10-01T07:56:51.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.531+0000 7faa953f2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa9009d630 0x7faa90133850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:51.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.531+0000 7faa953f2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa900a0a30 0x7faa90133d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:51.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.531+0000 7faa953f2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa90138d80 0x7faa901342d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:51.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.531+0000 7faa953f2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa900a0480 con 0x7faa900a0a30 2023-10-01T07:56:51.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.531+0000 7faa953f2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa90136a20 con 0x7faa90138d80 2023-10-01T07:56:51.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.531+0000 7faa953f2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa90138a80 con 0x7faa9009d630 2023-10-01T07:56:51.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.531+0000 7faa8effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa9009d630 0x7faa90133850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:51.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.531+0000 7faa87fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa900a0a30 0x7faa90133d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:51.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.531+0000 7faa8effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa9009d630 0x7faa90133850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:48720/0 (socket says 172.21.15.26:48720) 2023-10-01T07:56:51.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.531+0000 7faa8effd700 1 -- 172.21.15.26:0/2920227495 learned_addr learned my addr 172.21.15.26:0/2920227495 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:51.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.531+0000 7faa8f7fe700 1 --2- 172.21.15.26:0/2920227495 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa90138d80 0x7faa901342d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:51.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.531+0000 7faa8effd700 1 -- 172.21.15.26:0/2920227495 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa90138d80 msgr2=0x7faa901342d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:51.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.531+0000 7faa8effd700 1 --2- 172.21.15.26:0/2920227495 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa90138d80 0x7faa901342d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.531+0000 7faa8effd700 1 -- 172.21.15.26:0/2920227495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa900a0a30 msgr2=0x7faa90133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:51.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.531+0000 7faa8effd700 1 --2- 172.21.15.26:0/2920227495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa900a0a30 0x7faa90133d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.531+0000 7faa8effd700 1 -- 172.21.15.26:0/2920227495 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa780094a0 con 0x7faa9009d630 2023-10-01T07:56:51.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.531+0000 7faa8f7fe700 1 --2- 172.21.15.26:0/2920227495 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa90138d80 0x7faa901342d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:51.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.531+0000 7faa87fff700 1 --2- 172.21.15.26:0/2920227495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa900a0a30 0x7faa90133d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:56:51.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.532+0000 7faa8effd700 1 --2- 172.21.15.26:0/2920227495 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa9009d630 0x7faa90133850 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7faa8000c520 tx=0x7faa8000c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:51.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.532+0000 7faa877fe700 1 -- 172.21.15.26:0/2920227495 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa80004c80 con 0x7faa9009d630 2023-10-01T07:56:51.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.532+0000 7faa877fe700 1 -- 172.21.15.26:0/2920227495 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa80004de0 con 0x7faa9009d630 2023-10-01T07:56:51.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.532+0000 7faa953f2700 1 -- 172.21.15.26:0/2920227495 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa90136d50 con 0x7faa9009d630 2023-10-01T07:56:51.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.532+0000 7faa877fe700 1 -- 172.21.15.26:0/2920227495 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa80007310 con 0x7faa9009d630 2023-10-01T07:56:51.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.532+0000 7faa953f2700 1 -- 172.21.15.26:0/2920227495 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa90137e70 con 0x7faa9009d630 2023-10-01T07:56:51.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.533+0000 7faa877fe700 1 -- 172.21.15.26:0/2920227495 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faa80007470 con 0x7faa9009d630 2023-10-01T07:56:51.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.533+0000 7faa877fe700 1 -- 172.21.15.26:0/2920227495 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faa8003f3c0 con 0x7faa9009d630 2023-10-01T07:56:51.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.533+0000 7faa953f2700 1 -- 172.21.15.26:0/2920227495 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa90135c20 con 0x7faa9009d630 2023-10-01T07:56:51.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.538+0000 7faa877fe700 1 -- 172.21.15.26:0/2920227495 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faa800123b0 con 0x7faa9009d630 2023-10-01T07:56:51.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.542+0000 7fa1c62f8700 1 Processor -- start 2023-10-01T07:56:51.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.543+0000 7fa1c62f8700 1 -- start start 2023-10-01T07:56:51.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.543+0000 7fa1c62f8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa1c01338c0 0x7fa1c0133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:51.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.543+0000 7fa1c62f8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa1c01341d0 0x7fa1c009de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:51.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.543+0000 7fa1c62f8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa1c009e390 0x7fa1c009e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:51.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.543+0000 7fa1c62f8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1c0070c80 con 0x7fa1c01341d0 2023-10-01T07:56:51.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.543+0000 7fa1c62f8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c009ed20 con 0x7fa1c009e390 2023-10-01T07:56:51.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.543+0000 7fa1c62f8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c006f720 con 0x7fa1c01338c0 2023-10-01T07:56:51.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.543+0000 7fa1c4895700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa1c009e390 0x7fa1c009e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:51.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.543+0000 7fa1bffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa1c01338c0 0x7fa1c0133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:51.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.543+0000 7fa1c4895700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa1c009e390 0x7fa1c009e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33962/0 (socket says 172.21.15.26:33962) 2023-10-01T07:56:51.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.543+0000 7fa1bffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa1c01338c0 0x7fa1c0133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:48724/0 (socket says 172.21.15.26:48724) 2023-10-01T07:56:51.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.543+0000 7fa1c4895700 1 -- 172.21.15.26:0/2812288701 learned_addr learned my addr 172.21.15.26:0/2812288701 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:51.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.543+0000 7fa1bf7fe700 1 --2- 172.21.15.26:0/2812288701 >> v2:172.21.15.26:3300/0 conn(0x7fa1c01341d0 0x7fa1c009de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:51.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.544+0000 7fa1bffff700 1 -- 172.21.15.26:0/2812288701 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa1c009e390 msgr2=0x7fa1c009e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:51.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.544+0000 7fa1bffff700 1 --2- 172.21.15.26:0/2812288701 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa1c009e390 0x7fa1c009e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.544+0000 7fa1bffff700 1 -- 172.21.15.26:0/2812288701 >> v2:172.21.15.26:3300/0 conn(0x7fa1c01341d0 msgr2=0x7fa1c009de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:51.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.544+0000 7fa1bffff700 1 --2- 172.21.15.26:0/2812288701 >> v2:172.21.15.26:3300/0 conn(0x7fa1c01341d0 0x7fa1c009de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.544+0000 7fa1bffff700 1 -- 172.21.15.26:0/2812288701 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c006fce0 con 0x7fa1c01338c0 2023-10-01T07:56:51.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.544+0000 7fa1bf7fe700 1 --2- 172.21.15.26:0/2812288701 >> v2:172.21.15.26:3300/0 conn(0x7fa1c01341d0 0x7fa1c009de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:51.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.544+0000 7fa1bffff700 1 --2- 172.21.15.26:0/2812288701 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa1c01338c0 0x7fa1c0133c90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0009870 tx=0x7fa1b0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=740f63a8ec740925 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:51.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.544+0000 7fa1beffd700 1 -- 172.21.15.26:0/2812288701 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0011830 con 0x7fa1c01338c0 2023-10-01T07:56:51.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.544+0000 7fa1beffd700 1 -- 172.21.15.26:0/2812288701 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b0011990 con 0x7fa1c01338c0 2023-10-01T07:56:51.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.544+0000 7fa1beffd700 1 -- 172.21.15.26:0/2812288701 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0011d20 con 0x7fa1c01338c0 2023-10-01T07:56:51.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.545+0000 7fa1c62f8700 1 -- 172.21.15.26:0/2812288701 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa1c01338c0 msgr2=0x7fa1c0133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:51.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.545+0000 7fa1c62f8700 1 --2- 172.21.15.26:0/2812288701 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa1c01338c0 0x7fa1c0133c90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0009870 tx=0x7fa1b0009b80 comp rx=0 tx=0).stop 2023-10-01T07:56:51.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.545+0000 7fa1c62f8700 1 -- 172.21.15.26:0/2812288701 shutdown_connections 2023-10-01T07:56:51.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.545+0000 7fa1c62f8700 1 --2- 172.21.15.26:0/2812288701 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa1c009e390 0x7fa1c009e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.545+0000 7fa1c62f8700 1 --2- 172.21.15.26:0/2812288701 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa1c01338c0 0x7fa1c0133c90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.545+0000 7fa1c62f8700 1 --2- 172.21.15.26:0/2812288701 >> v2:172.21.15.26:3300/0 conn(0x7fa1c01341d0 0x7fa1c009de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.545+0000 7fa1c62f8700 1 -- 172.21.15.26:0/2812288701 >> 172.21.15.26:0/2812288701 conn(0x7fa1c00a2aa0 msgr2=0x7fa1c00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:51.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.545+0000 7fa1c62f8700 1 -- 172.21.15.26:0/2812288701 shutdown_connections 2023-10-01T07:56:51.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.545+0000 7fa1c62f8700 1 -- 172.21.15.26:0/2812288701 wait complete. 2023-10-01T07:56:51.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.546+0000 7fa1c62f8700 1 Processor -- start 2023-10-01T07:56:51.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.546+0000 7fa1c62f8700 1 -- start start 2023-10-01T07:56:51.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.547+0000 7fa1c62f8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa1c009e390 0x7fa1c011a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:51.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.547+0000 7fa1c62f8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa1c01338c0 0x7fa1c011ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:51.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.547+0000 7fa1c62f8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1c01341d0 0x7fa1c011b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:51.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.547+0000 7fa1c62f8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c011e460 con 0x7fa1c01341d0 2023-10-01T07:56:51.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.547+0000 7fa1c62f8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c0130ca0 con 0x7fa1c009e390 2023-10-01T07:56:51.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.547+0000 7fa1c62f8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c006f960 con 0x7fa1c01338c0 2023-10-01T07:56:51.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.547+0000 7fa1bffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa1c009e390 0x7fa1c011a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:51.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.547+0000 7fa1bffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa1c009e390 0x7fa1c011a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33976/0 (socket says 172.21.15.26:33976) 2023-10-01T07:56:51.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.547+0000 7fa1bffff700 1 -- 172.21.15.26:0/3090070638 learned_addr learned my addr 172.21.15.26:0/3090070638 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:51.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.547+0000 7fa1c4895700 1 --2- 172.21.15.26:0/3090070638 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1c01341d0 0x7fa1c011b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:51.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.547+0000 7fa1bf7fe700 1 --2- 172.21.15.26:0/3090070638 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa1c01338c0 0x7fa1c011ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:51.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.547+0000 7fa1c4895700 1 -- 172.21.15.26:0/3090070638 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa1c01338c0 msgr2=0x7fa1c011ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:51.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.547+0000 7fa1c4895700 1 --2- 172.21.15.26:0/3090070638 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa1c01338c0 0x7fa1c011ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.547+0000 7fa1c4895700 1 -- 172.21.15.26:0/3090070638 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa1c009e390 msgr2=0x7fa1c011a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:51.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.547+0000 7fa1c4895700 1 --2- 172.21.15.26:0/3090070638 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa1c009e390 0x7fa1c011a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.547+0000 7fa1c4895700 1 -- 172.21.15.26:0/3090070638 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b40094a0 con 0x7fa1c01341d0 2023-10-01T07:56:51.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.547+0000 7fa1bf7fe700 1 --2- 172.21.15.26:0/3090070638 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa1c01338c0 0x7fa1c011ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:51.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.548+0000 7fa1c4895700 1 --2- 172.21.15.26:0/3090070638 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1c01341d0 0x7fa1c011b3c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fa1b800eba0 tx=0x7fa1b800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:51.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.548+0000 7fa1bcff9700 1 -- 172.21.15.26:0/3090070638 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8003c20 con 0x7fa1c01341d0 2023-10-01T07:56:51.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.548+0000 7fa1bcff9700 1 -- 172.21.15.26:0/3090070638 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b800f040 con 0x7fa1c01341d0 2023-10-01T07:56:51.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.548+0000 7fa1c62f8700 1 -- 172.21.15.26:0/3090070638 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b00094a0 con 0x7fa1c01341d0 2023-10-01T07:56:51.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.548+0000 7fa1bcff9700 1 -- 172.21.15.26:0/3090070638 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b800c5f0 con 0x7fa1c01341d0 2023-10-01T07:56:51.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.548+0000 7fa1c62f8700 1 -- 172.21.15.26:0/3090070638 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1c011dbf0 con 0x7fa1c01341d0 2023-10-01T07:56:51.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.549+0000 7fa1bcff9700 1 -- 172.21.15.26:0/3090070638 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa1b800c750 con 0x7fa1c01341d0 2023-10-01T07:56:51.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.549+0000 7fa1c62f8700 1 -- 172.21.15.26:0/3090070638 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1c011cb00 con 0x7fa1c01341d0 2023-10-01T07:56:51.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.549+0000 7fa1bcff9700 1 -- 172.21.15.26:0/3090070638 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa1b803f750 con 0x7fa1c01341d0 2023-10-01T07:56:51.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.554+0000 7fa1bcff9700 1 -- 172.21.15.26:0/3090070638 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa1b801c360 con 0x7fa1c01341d0 2023-10-01T07:56:51.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.665+0000 7fdf9ea48700 1 -- 172.21.15.26:0/4072831306 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdf9806b250 con 0x7fdf98134260 2023-10-01T07:56:51.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.665+0000 7fdf94ff9700 1 -- 172.21.15.26:0/4072831306 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdf900122e0 con 0x7fdf98134260 2023-10-01T07:56:51.666 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:51.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.667+0000 7fdf9ea48700 1 -- 172.21.15.26:0/4072831306 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdf98134260 msgr2=0x7fdf9809cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:51.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.667+0000 7fdf9ea48700 1 --2- 172.21.15.26:0/4072831306 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdf98134260 0x7fdf9809cf00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdf90007d60 tx=0x7fdf9000e3c0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.667+0000 7fdf9ea48700 1 -- 172.21.15.26:0/4072831306 shutdown_connections 2023-10-01T07:56:51.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.667+0000 7fdf9ea48700 1 --2- 172.21.15.26:0/4072831306 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdf98134260 0x7fdf9809cf00 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.667+0000 7fdf9ea48700 1 --2- 172.21.15.26:0/4072831306 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf98133420 0x7fdf9809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.667+0000 7fdf9ea48700 1 --2- 172.21.15.26:0/4072831306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf98133e30 0x7fdf9809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.667+0000 7fdf9ea48700 1 -- 172.21.15.26:0/4072831306 >> 172.21.15.26:0/4072831306 conn(0x7fdf980a4210 msgr2=0x7fdf981302c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:51.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.668+0000 7fdf9ea48700 1 -- 172.21.15.26:0/4072831306 shutdown_connections 2023-10-01T07:56:51.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.668+0000 7fdf9ea48700 1 -- 172.21.15.26:0/4072831306 wait complete. 2023-10-01T07:56:51.682 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:51.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.744+0000 7faa953f2700 1 -- 172.21.15.26:0/2920227495 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faa90136660 con 0x7faa9009d630 2023-10-01T07:56:51.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.744+0000 7faa877fe700 1 -- 172.21.15.26:0/2920227495 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faa80011360 con 0x7faa9009d630 2023-10-01T07:56:51.745 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:51.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.746+0000 7faa953f2700 1 -- 172.21.15.26:0/2920227495 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa9009d630 msgr2=0x7faa90133850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:51.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.746+0000 7faa953f2700 1 --2- 172.21.15.26:0/2920227495 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa9009d630 0x7faa90133850 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7faa8000c520 tx=0x7faa8000c830 comp rx=0 tx=0).stop 2023-10-01T07:56:51.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.746+0000 7faa953f2700 1 -- 172.21.15.26:0/2920227495 shutdown_connections 2023-10-01T07:56:51.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.746+0000 7faa953f2700 1 --2- 172.21.15.26:0/2920227495 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa90138d80 0x7faa901342d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.746+0000 7faa953f2700 1 --2- 172.21.15.26:0/2920227495 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa9009d630 0x7faa90133850 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.746+0000 7faa953f2700 1 --2- 172.21.15.26:0/2920227495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa900a0a30 0x7faa90133d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.746+0000 7faa953f2700 1 -- 172.21.15.26:0/2920227495 >> 172.21.15.26:0/2920227495 conn(0x7faa900a3050 msgr2=0x7faa9009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:51.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.747+0000 7faa953f2700 1 -- 172.21.15.26:0/2920227495 shutdown_connections 2023-10-01T07:56:51.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.747+0000 7faa953f2700 1 -- 172.21.15.26:0/2920227495 wait complete. 2023-10-01T07:56:51.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.760+0000 7fa1c62f8700 1 -- 172.21.15.26:0/3090070638 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa1c0074ea0 con 0x7fa1c01341d0 2023-10-01T07:56:51.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.760+0000 7fa1bcff9700 1 -- 172.21.15.26:0/3090070638 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa1b8013bd0 con 0x7fa1c01341d0 2023-10-01T07:56:51.761 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:51.761 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:51.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.763+0000 7fa1c62f8700 1 -- 172.21.15.26:0/3090070638 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1c01341d0 msgr2=0x7fa1c011b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:51.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.763+0000 7fa1c62f8700 1 --2- 172.21.15.26:0/3090070638 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1c01341d0 0x7fa1c011b3c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fa1b800eba0 tx=0x7fa1b800eeb0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.763+0000 7fa1c62f8700 1 -- 172.21.15.26:0/3090070638 shutdown_connections 2023-10-01T07:56:51.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.763+0000 7fa1c62f8700 1 --2- 172.21.15.26:0/3090070638 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1c01341d0 0x7fa1c011b3c0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.763+0000 7fa1c62f8700 1 --2- 172.21.15.26:0/3090070638 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa1c009e390 0x7fa1c011a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.763+0000 7fa1c62f8700 1 --2- 172.21.15.26:0/3090070638 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa1c01338c0 0x7fa1c011ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:51.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.763+0000 7fa1c62f8700 1 -- 172.21.15.26:0/3090070638 >> 172.21.15.26:0/3090070638 conn(0x7fa1c00a2aa0 msgr2=0x7fa1c012f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:51.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.763+0000 7fa1c62f8700 1 -- 172.21.15.26:0/3090070638 shutdown_connections 2023-10-01T07:56:51.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:51.763+0000 7fa1c62f8700 1 -- 172.21.15.26:0/3090070638 wait complete. 2023-10-01T07:56:51.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:52.293 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:52.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.438+0000 7fd608d5e700 1 Processor -- start 2023-10-01T07:56:52.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.438+0000 7fd608d5e700 1 -- start start 2023-10-01T07:56:52.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.439+0000 7fd608d5e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd604133a80 0x7fd604133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:52.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.439+0000 7fd608d5e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd604130a40 0x7fd60413b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:52.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.439+0000 7fd608d5e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd60406bc00 con 0x7fd60412ff20 2023-10-01T07:56:52.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.439+0000 7fd608d5e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd60406c570 con 0x7fd604130a40 2023-10-01T07:56:52.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.439+0000 7fd608d5e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6040a0040 con 0x7fd604133a80 2023-10-01T07:56:52.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.439+0000 7fd602d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd604130a40 0x7fd60413b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:52.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.439+0000 7fd602d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd604130a40 0x7fd60413b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53868/0 (socket says 172.21.15.26:53868) 2023-10-01T07:56:52.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.439+0000 7fd60259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd604133a80 0x7fd604133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:52.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.439+0000 7fd602d9d700 1 -- 172.21.15.26:0/1916299573 learned_addr learned my addr 172.21.15.26:0/1916299573 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:52.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.440+0000 7fd60259c700 1 -- 172.21.15.26:0/1916299573 >> v2:172.21.15.26:3300/0 conn(0x7fd604130a40 msgr2=0x7fd60413b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:52.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.440+0000 7fd60259c700 1 --2- 172.21.15.26:0/1916299573 >> v2:172.21.15.26:3300/0 conn(0x7fd604130a40 0x7fd60413b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:52.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.440+0000 7fd60259c700 1 -- 172.21.15.26:0/1916299573 >> v1:172.21.15.26:6789/0 conn(0x7fd60412ff20 legacy=0x7fd604130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:52.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.440+0000 7fd60259c700 1 -- 172.21.15.26:0/1916299573 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd604133860 con 0x7fd604133a80 2023-10-01T07:56:52.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.440+0000 7fd602d9d700 1 --2- 172.21.15.26:0/1916299573 >> v2:172.21.15.26:3300/0 conn(0x7fd604130a40 0x7fd60413b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:52.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.440+0000 7fd60259c700 1 --2- 172.21.15.26:0/1916299573 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd604133a80 0x7fd604133e50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4009840 tx=0x7fd5f4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a158ac1103b1229b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:52.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.440+0000 7fd60159a700 1 -- 172.21.15.26:0/1916299573 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4011830 con 0x7fd604133a80 2023-10-01T07:56:52.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.440+0000 7fd60159a700 1 -- 172.21.15.26:0/1916299573 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f4011990 con 0x7fd604133a80 2023-10-01T07:56:52.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.440+0000 7fd60159a700 1 -- 172.21.15.26:0/1916299573 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4011d20 con 0x7fd604133a80 2023-10-01T07:56:52.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.440+0000 7fd608d5e700 1 -- 172.21.15.26:0/1916299573 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd604133a80 msgr2=0x7fd604133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:52.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.440+0000 7fd608d5e700 1 --2- 172.21.15.26:0/1916299573 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd604133a80 0x7fd604133e50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4009840 tx=0x7fd5f4009b50 comp rx=0 tx=0).stop 2023-10-01T07:56:52.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.441+0000 7fd608d5e700 1 -- 172.21.15.26:0/1916299573 shutdown_connections 2023-10-01T07:56:52.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.441+0000 7fd608d5e700 1 --2- 172.21.15.26:0/1916299573 >> v2:172.21.15.26:3300/0 conn(0x7fd604130a40 0x7fd60413b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:52.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.441+0000 7fd608d5e700 1 --2- 172.21.15.26:0/1916299573 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd604133a80 0x7fd604133e50 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:52.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.441+0000 7fd608d5e700 1 -- 172.21.15.26:0/1916299573 >> 172.21.15.26:0/1916299573 conn(0x7fd6040a4210 msgr2=0x7fd6040a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:52.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.441+0000 7fd608d5e700 1 -- 172.21.15.26:0/1916299573 shutdown_connections 2023-10-01T07:56:52.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.441+0000 7fd608d5e700 1 -- 172.21.15.26:0/1916299573 wait complete. 2023-10-01T07:56:52.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.442+0000 7fd608d5e700 1 Processor -- start 2023-10-01T07:56:52.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.442+0000 7fd608d5e700 1 -- start start 2023-10-01T07:56:52.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.442+0000 7fd608d5e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd60412ff20 0x7fd6040709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:52.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.442+0000 7fd608d5e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd604130a40 0x7fd604070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:52.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.442+0000 7fd608d5e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd604133a80 0x7fd604071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:52.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.442+0000 7fd608d5e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd604071d70 con 0x7fd60412ff20 2023-10-01T07:56:52.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.442+0000 7fd608d5e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6041203d0 con 0x7fd604133a80 2023-10-01T07:56:52.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.442+0000 7fd608d5e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd60412d770 con 0x7fd604130a40 2023-10-01T07:56:52.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.442+0000 7fd60259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd60412ff20 0x7fd6040709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:52.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.442+0000 7fd60259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd60412ff20 0x7fd6040709a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53882/0 (socket says 172.21.15.26:53882) 2023-10-01T07:56:52.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.443+0000 7fd60259c700 1 -- 172.21.15.26:0/25884977 learned_addr learned my addr 172.21.15.26:0/25884977 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:52.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.443+0000 7fd601d9b700 1 --2- 172.21.15.26:0/25884977 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd604130a40 0x7fd604070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:52.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.443+0000 7fd602d9d700 1 --2- 172.21.15.26:0/25884977 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd604133a80 0x7fd604071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:52.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.443+0000 7fd60259c700 1 -- 172.21.15.26:0/25884977 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd604130a40 msgr2=0x7fd604070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:52.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.443+0000 7fd60259c700 1 --2- 172.21.15.26:0/25884977 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd604130a40 0x7fd604070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:52.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.443+0000 7fd60259c700 1 -- 172.21.15.26:0/25884977 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd604133a80 msgr2=0x7fd604071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:52.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.443+0000 7fd60259c700 1 --2- 172.21.15.26:0/25884977 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd604133a80 0x7fd604071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:52.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.443+0000 7fd60259c700 1 -- 172.21.15.26:0/25884977 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5fc009b30 con 0x7fd60412ff20 2023-10-01T07:56:52.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.443+0000 7fd601d9b700 1 --2- 172.21.15.26:0/25884977 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd604130a40 0x7fd604070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:52.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.443+0000 7fd60259c700 1 --2- 172.21.15.26:0/25884977 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd60412ff20 0x7fd6040709a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fd5f40090b0 tx=0x7fd5f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:52.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.443+0000 7fd5f2ffd700 1 -- 172.21.15.26:0/25884977 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f40036a0 con 0x7fd60412ff20 2023-10-01T07:56:52.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.443+0000 7fd5f2ffd700 1 -- 172.21.15.26:0/25884977 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f401f070 con 0x7fd60412ff20 2023-10-01T07:56:52.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.443+0000 7fd608d5e700 1 -- 172.21.15.26:0/25884977 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f40094a0 con 0x7fd60412ff20 2023-10-01T07:56:52.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.443+0000 7fd5f2ffd700 1 -- 172.21.15.26:0/25884977 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4003a60 con 0x7fd60412ff20 2023-10-01T07:56:52.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.443+0000 7fd608d5e700 1 -- 172.21.15.26:0/25884977 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd60411fda0 con 0x7fd60412ff20 2023-10-01T07:56:52.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.444+0000 7fd5f2ffd700 1 -- 172.21.15.26:0/25884977 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd5f4003bc0 con 0x7fd60412ff20 2023-10-01T07:56:52.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.444+0000 7fd5f2ffd700 1 -- 172.21.15.26:0/25884977 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd5f4021070 con 0x7fd60412ff20 2023-10-01T07:56:52.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.444+0000 7fd608d5e700 1 -- 172.21.15.26:0/25884977 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd604074ea0 con 0x7fd60412ff20 2023-10-01T07:56:52.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.449+0000 7fd5f2ffd700 1 -- 172.21.15.26:0/25884977 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd5f4015080 con 0x7fd60412ff20 2023-10-01T07:56:52.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.655+0000 7fd608d5e700 1 -- 172.21.15.26:0/25884977 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd604120b30 con 0x7fd60412ff20 2023-10-01T07:56:52.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.655+0000 7fd5f2ffd700 1 -- 172.21.15.26:0/25884977 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd5f4035090 con 0x7fd60412ff20 2023-10-01T07:56:52.656 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:52.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.658+0000 7fd608d5e700 1 -- 172.21.15.26:0/25884977 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd60412ff20 msgr2=0x7fd6040709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:52.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.658+0000 7fd608d5e700 1 --2- 172.21.15.26:0/25884977 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd60412ff20 0x7fd6040709a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fd5f40090b0 tx=0x7fd5f4004750 comp rx=0 tx=0).stop 2023-10-01T07:56:52.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.658+0000 7fd608d5e700 1 -- 172.21.15.26:0/25884977 shutdown_connections 2023-10-01T07:56:52.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.658+0000 7fd608d5e700 1 --2- 172.21.15.26:0/25884977 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd604133a80 0x7fd604071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:52.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.658+0000 7fd608d5e700 1 --2- 172.21.15.26:0/25884977 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd60412ff20 0x7fd6040709a0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:52.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.658+0000 7fd608d5e700 1 --2- 172.21.15.26:0/25884977 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd604130a40 0x7fd604070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:52.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.658+0000 7fd608d5e700 1 -- 172.21.15.26:0/25884977 >> 172.21.15.26:0/25884977 conn(0x7fd6040a4210 msgr2=0x7fd60409e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:52.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.658+0000 7fd608d5e700 1 -- 172.21.15.26:0/25884977 shutdown_connections 2023-10-01T07:56:52.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.658+0000 7fd608d5e700 1 -- 172.21.15.26:0/25884977 wait complete. 2023-10-01T07:56:52.672 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:52.683 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:52.762 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:52.777 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:52.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.824+0000 7fea799b2700 1 Processor -- start 2023-10-01T07:56:52.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.824+0000 7fea799b2700 1 -- start start 2023-10-01T07:56:52.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.824+0000 7fea799b2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea74133ee0 0x7fea7409e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:52.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.824+0000 7fea799b2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fea741397e0 0x7fea7413bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:52.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.825+0000 7fea799b2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea741334b0 con 0x7fea74133b10 2023-10-01T07:56:52.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.825+0000 7fea799b2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea74070bc0 con 0x7fea741397e0 2023-10-01T07:56:52.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.825+0000 7fea799b2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea74070350 con 0x7fea74133ee0 2023-10-01T07:56:52.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.825+0000 7fea727fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea74133ee0 0x7fea7409e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:52.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.825+0000 7fea72ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fea74133b10 0x7fea7409de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54728/0 (socket says 172.21.15.26:54728) 2023-10-01T07:56:52.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.825+0000 7fea72ffd700 1 -- 172.21.15.26:0/1405441511 learned_addr learned my addr 172.21.15.26:0/1405441511 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:52.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.825+0000 7fea737fe700 1 --2- 172.21.15.26:0/1405441511 >> v2:172.21.15.26:3300/0 conn(0x7fea741397e0 0x7fea7413bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:52.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.825+0000 7fea727fc700 1 -- 172.21.15.26:0/1405441511 >> v2:172.21.15.26:3300/0 conn(0x7fea741397e0 msgr2=0x7fea7413bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:52.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.825+0000 7fea727fc700 1 --2- 172.21.15.26:0/1405441511 >> v2:172.21.15.26:3300/0 conn(0x7fea741397e0 0x7fea7413bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:52.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.825+0000 7fea727fc700 1 -- 172.21.15.26:0/1405441511 >> v1:172.21.15.26:6789/0 conn(0x7fea74133b10 legacy=0x7fea7409de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:52.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.825+0000 7fea727fc700 1 -- 172.21.15.26:0/1405441511 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea741336e0 con 0x7fea74133ee0 2023-10-01T07:56:52.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.825+0000 7fea727fc700 1 --2- 172.21.15.26:0/1405441511 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea74133ee0 0x7fea7409e560 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fea68009840 tx=0x7fea68009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4885fb79866d7d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:52.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.825+0000 7fea71ffb700 1 -- 172.21.15.26:0/1405441511 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea68011830 con 0x7fea74133ee0 2023-10-01T07:56:52.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.825+0000 7fea71ffb700 1 -- 172.21.15.26:0/1405441511 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea68011990 con 0x7fea74133ee0 2023-10-01T07:56:52.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.826+0000 7fea71ffb700 1 -- 172.21.15.26:0/1405441511 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea68011d20 con 0x7fea74133ee0 2023-10-01T07:56:52.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.826+0000 7fea799b2700 1 -- 172.21.15.26:0/1405441511 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea74133ee0 msgr2=0x7fea7409e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:52.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.826+0000 7fea799b2700 1 --2- 172.21.15.26:0/1405441511 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea74133ee0 0x7fea7409e560 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fea68009840 tx=0x7fea68009b50 comp rx=0 tx=0).stop 2023-10-01T07:56:52.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.826+0000 7fea799b2700 1 -- 172.21.15.26:0/1405441511 shutdown_connections 2023-10-01T07:56:52.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.826+0000 7fea799b2700 1 --2- 172.21.15.26:0/1405441511 >> v2:172.21.15.26:3300/0 conn(0x7fea741397e0 0x7fea7413bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:52.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.826+0000 7fea799b2700 1 --2- 172.21.15.26:0/1405441511 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea74133ee0 0x7fea7409e560 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:52.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.826+0000 7fea799b2700 1 -- 172.21.15.26:0/1405441511 >> 172.21.15.26:0/1405441511 conn(0x7fea740a2aa0 msgr2=0x7fea740a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:52.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.826+0000 7fea799b2700 1 -- 172.21.15.26:0/1405441511 shutdown_connections 2023-10-01T07:56:52.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.826+0000 7fea799b2700 1 -- 172.21.15.26:0/1405441511 wait complete. 2023-10-01T07:56:52.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.827+0000 7fea799b2700 1 Processor -- start 2023-10-01T07:56:52.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.828+0000 7fea799b2700 1 -- start start 2023-10-01T07:56:52.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.828+0000 7fea799b2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea74133b10 0x7fea7411aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:52.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.828+0000 7fea799b2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fea74133ee0 0x7fea7411afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:52.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.828+0000 7fea799b2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea741397e0 0x7fea7411b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:52.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.828+0000 7fea799b2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7411e5b0 con 0x7fea741397e0 2023-10-01T07:56:52.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.828+0000 7fea799b2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea7411dd40 con 0x7fea74133b10 2023-10-01T07:56:52.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.828+0000 7fea799b2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea7406f910 con 0x7fea74133ee0 2023-10-01T07:56:52.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.828+0000 7fea72ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea74133b10 0x7fea7411aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:52.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.828+0000 7fea72ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea74133b10 0x7fea7411aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34010/0 (socket says 172.21.15.26:34010) 2023-10-01T07:56:52.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.828+0000 7fea72ffd700 1 -- 172.21.15.26:0/3078999339 learned_addr learned my addr 172.21.15.26:0/3078999339 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:52.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.828+0000 7fea727fc700 1 --2- 172.21.15.26:0/3078999339 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fea74133ee0 0x7fea7411afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:52.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.828+0000 7fea737fe700 1 --2- 172.21.15.26:0/3078999339 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea741397e0 0x7fea7411b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:52.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.829+0000 7fea72ffd700 1 -- 172.21.15.26:0/3078999339 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fea74133ee0 msgr2=0x7fea7411afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:52.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.829+0000 7fea72ffd700 1 --2- 172.21.15.26:0/3078999339 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fea74133ee0 0x7fea7411afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:52.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.829+0000 7fea72ffd700 1 -- 172.21.15.26:0/3078999339 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea741397e0 msgr2=0x7fea7411b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:52.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.829+0000 7fea72ffd700 1 --2- 172.21.15.26:0/3078999339 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea741397e0 0x7fea7411b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:52.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.829+0000 7fea72ffd700 1 -- 172.21.15.26:0/3078999339 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea680094a0 con 0x7fea74133b10 2023-10-01T07:56:52.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.829+0000 7fea727fc700 1 --2- 172.21.15.26:0/3078999339 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fea74133ee0 0x7fea7411afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:52.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.829+0000 7fea72ffd700 1 --2- 172.21.15.26:0/3078999339 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea74133b10 0x7fea7411aa90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fea6400c480 tx=0x7fea6400c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:52.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.829+0000 7fea5bfff700 1 -- 172.21.15.26:0/3078999339 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea64005d70 con 0x7fea74133b10 2023-10-01T07:56:52.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.829+0000 7fea5bfff700 1 -- 172.21.15.26:0/3078999339 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6400ce90 con 0x7fea74133b10 2023-10-01T07:56:52.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.829+0000 7fea799b2700 1 -- 172.21.15.26:0/3078999339 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea740a1020 con 0x7fea74133b10 2023-10-01T07:56:52.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.829+0000 7fea5bfff700 1 -- 172.21.15.26:0/3078999339 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea640072d0 con 0x7fea74133b10 2023-10-01T07:56:52.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.829+0000 7fea799b2700 1 -- 172.21.15.26:0/3078999339 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea7411ceb0 con 0x7fea74133b10 2023-10-01T07:56:52.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.830+0000 7fea5bfff700 1 -- 172.21.15.26:0/3078999339 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fea64007430 con 0x7fea74133b10 2023-10-01T07:56:52.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.830+0000 7fea5bfff700 1 -- 172.21.15.26:0/3078999339 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fea6403ea00 con 0x7fea74133b10 2023-10-01T07:56:52.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.831+0000 7fea799b2700 1 -- 172.21.15.26:0/3078999339 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea7411e150 con 0x7fea74133b10 2023-10-01T07:56:52.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.836+0000 7fea5bfff700 1 -- 172.21.15.26:0/3078999339 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fea6401b3b0 con 0x7fea74133b10 2023-10-01T07:56:52.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.912+0000 7f76a8685700 1 Processor -- start 2023-10-01T07:56:52.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.912+0000 7f76a8685700 1 -- start start 2023-10-01T07:56:52.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.913+0000 7f76a8685700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f76a00a0a30 0x7f76a00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:52.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.913+0000 7f76a8685700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f76a0138d80 0x7f76a013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:52.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.913+0000 7f76a8685700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a00a2a70 con 0x7f76a009d630 2023-10-01T07:56:52.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.913+0000 7f76a8685700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a00a01d0 con 0x7f76a0138d80 2023-10-01T07:56:52.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.913+0000 7f76a8685700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76a009e2b0 con 0x7f76a00a0a30 2023-10-01T07:56:52.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.913+0000 7f76a5c20700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f76a009d630 0x7f76a00a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54742/0 (socket says 172.21.15.26:54742) 2023-10-01T07:56:52.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.913+0000 7f76a5c20700 1 -- 172.21.15.26:0/2640606329 learned_addr learned my addr 172.21.15.26:0/2640606329 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:52.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.913+0000 7f76a6421700 1 --2- 172.21.15.26:0/2640606329 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f76a00a0a30 0x7f76a00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:52.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.913+0000 7f76a6c22700 1 --2- 172.21.15.26:0/2640606329 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f76a0138d80 0x7f76a013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:52.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.914+0000 7f76a541f700 1 -- 172.21.15.26:0/2640606329 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431308316 0 0) 0x7f76a00a2a70 con 0x7f76a009d630 2023-10-01T07:56:52.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.914+0000 7f76a541f700 1 -- 172.21.15.26:0/2640606329 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f768c0035b0 con 0x7f76a009d630 2023-10-01T07:56:52.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.914+0000 7f76a6c22700 1 -- 172.21.15.26:0/2640606329 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f76a00a0a30 msgr2=0x7f76a00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:52.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.914+0000 7f76a6c22700 1 --2- 172.21.15.26:0/2640606329 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f76a00a0a30 0x7f76a00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:52.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.914+0000 7f76a6c22700 1 -- 172.21.15.26:0/2640606329 >> v1:172.21.15.26:6789/0 conn(0x7f76a009d630 legacy=0x7f76a00a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:52.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.914+0000 7f76a6c22700 1 -- 172.21.15.26:0/2640606329 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a009dc50 con 0x7f76a0138d80 2023-10-01T07:56:52.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.914+0000 7f76a6c22700 1 --2- 172.21.15.26:0/2640606329 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f76a0138d80 0x7f76a013b160 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7698009dc0 tx=0x7f769800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a12e32ad3b61ed5 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:52.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.914+0000 7f76a541f700 1 -- 172.21.15.26:0/2640606329 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769800e070 con 0x7f76a0138d80 2023-10-01T07:56:52.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.914+0000 7f76a541f700 1 -- 172.21.15.26:0/2640606329 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769800bb20 con 0x7f76a0138d80 2023-10-01T07:56:52.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.914+0000 7f76a541f700 1 -- 172.21.15.26:0/2640606329 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769800be90 con 0x7f76a0138d80 2023-10-01T07:56:52.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.915+0000 7f76a8685700 1 -- 172.21.15.26:0/2640606329 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f76a0138d80 msgr2=0x7f76a013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:52.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.915+0000 7f76a8685700 1 --2- 172.21.15.26:0/2640606329 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f76a0138d80 0x7f76a013b160 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7698009dc0 tx=0x7f769800b330 comp rx=0 tx=0).stop 2023-10-01T07:56:52.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.915+0000 7f76a8685700 1 -- 172.21.15.26:0/2640606329 shutdown_connections 2023-10-01T07:56:52.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.915+0000 7f76a8685700 1 --2- 172.21.15.26:0/2640606329 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f76a00a0a30 0x7f76a00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:52.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.915+0000 7f76a8685700 1 --2- 172.21.15.26:0/2640606329 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f76a0138d80 0x7f76a013b160 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:52.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.915+0000 7f76a8685700 1 -- 172.21.15.26:0/2640606329 >> 172.21.15.26:0/2640606329 conn(0x7f76a00a3050 msgr2=0x7f76a00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:52.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.915+0000 7f76a8685700 1 -- 172.21.15.26:0/2640606329 shutdown_connections 2023-10-01T07:56:52.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.915+0000 7f76a8685700 1 -- 172.21.15.26:0/2640606329 wait complete. 2023-10-01T07:56:52.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.916+0000 7f76a8685700 1 Processor -- start 2023-10-01T07:56:52.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.917+0000 7f76a8685700 1 -- start start 2023-10-01T07:56:52.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.917+0000 7f76a8685700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76a009d630 0x7f76a0120680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:52.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.917+0000 7f76a8685700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f76a00a0a30 0x7f76a0120bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:52.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.917+0000 7f76a8685700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f76a0138d80 0x7f76a0121100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:52.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.917+0000 7f76a8685700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a0123e90 con 0x7f76a009d630 2023-10-01T07:56:52.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.917+0000 7f76a8685700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a01221b0 con 0x7f76a0138d80 2023-10-01T07:56:52.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.917+0000 7f76a8685700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76a00a0410 con 0x7f76a00a0a30 2023-10-01T07:56:52.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.917+0000 7f76a6421700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76a009d630 0x7f76a0120680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:52.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.917+0000 7f76a6421700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76a009d630 0x7f76a0120680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53922/0 (socket says 172.21.15.26:53922) 2023-10-01T07:56:52.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.917+0000 7f76a6421700 1 -- 172.21.15.26:0/3656370883 learned_addr learned my addr 172.21.15.26:0/3656370883 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:52.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.918+0000 7f76a5c20700 1 --2- 172.21.15.26:0/3656370883 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f76a00a0a30 0x7f76a0120bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:52.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.918+0000 7f76a6c22700 1 --2- 172.21.15.26:0/3656370883 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f76a0138d80 0x7f76a0121100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:52.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.918+0000 7f76a6421700 1 -- 172.21.15.26:0/3656370883 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f76a00a0a30 msgr2=0x7f76a0120bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:52.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.918+0000 7f76a6421700 1 --2- 172.21.15.26:0/3656370883 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f76a00a0a30 0x7f76a0120bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:52.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.918+0000 7f76a6421700 1 -- 172.21.15.26:0/3656370883 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f76a0138d80 msgr2=0x7f76a0121100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:52.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.918+0000 7f76a6421700 1 --2- 172.21.15.26:0/3656370883 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f76a0138d80 0x7f76a0121100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:52.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.918+0000 7f76a6421700 1 -- 172.21.15.26:0/3656370883 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7698009a70 con 0x7f76a009d630 2023-10-01T07:56:52.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.918+0000 7f76a6421700 1 --2- 172.21.15.26:0/3656370883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76a009d630 0x7f76a0120680 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f769c00e9b0 tx=0x7f769c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:52.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.918+0000 7f7696ffd700 1 -- 172.21.15.26:0/3656370883 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c009710 con 0x7f76a009d630 2023-10-01T07:56:52.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.918+0000 7f7696ffd700 1 -- 172.21.15.26:0/3656370883 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769c00ee50 con 0x7f76a009d630 2023-10-01T07:56:52.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.918+0000 7f76a8685700 1 -- 172.21.15.26:0/3656370883 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a0124090 con 0x7f76a009d630 2023-10-01T07:56:52.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.918+0000 7f7696ffd700 1 -- 172.21.15.26:0/3656370883 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c00ca50 con 0x7f76a009d630 2023-10-01T07:56:52.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.918+0000 7f76a8685700 1 -- 172.21.15.26:0/3656370883 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a0122f10 con 0x7f76a009d630 2023-10-01T07:56:52.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.919+0000 7f76a8685700 1 -- 172.21.15.26:0/3656370883 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a00747f0 con 0x7f76a009d630 2023-10-01T07:56:52.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.920+0000 7f7696ffd700 1 -- 172.21.15.26:0/3656370883 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f769c00cbb0 con 0x7f76a009d630 2023-10-01T07:56:52.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.920+0000 7f7696ffd700 1 -- 172.21.15.26:0/3656370883 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f769c03fee0 con 0x7f76a009d630 2023-10-01T07:56:52.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.928+0000 7f7696ffd700 1 -- 172.21.15.26:0/3656370883 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f769c011350 con 0x7f76a009d630 2023-10-01T07:56:52.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.957+0000 7fddfe445700 1 Processor -- start 2023-10-01T07:56:52.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.957+0000 7fddfe445700 1 -- start start 2023-10-01T07:56:52.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.958+0000 7fddfe445700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fddf809e1d0 0x7fddf8138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:52.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.958+0000 7fddfe445700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddf8139170 0x7fddf813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:52.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.958+0000 7fddfe445700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf809b120 con 0x7fddf809d6f0 2023-10-01T07:56:52.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.958+0000 7fddfe445700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf806b460 con 0x7fddf809e1d0 2023-10-01T07:56:52.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.958+0000 7fddfe445700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf809a7e0 con 0x7fddf8139170 2023-10-01T07:56:52.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.958+0000 7fddf7fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fddf809d6f0 0x7fddf809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54758/0 (socket says 172.21.15.26:54758) 2023-10-01T07:56:52.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.958+0000 7fddfc9e2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddf8139170 0x7fddf813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:52.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.958+0000 7fddf7fff700 1 -- 172.21.15.26:0/3822861046 learned_addr learned my addr 172.21.15.26:0/3822861046 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:52.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.958+0000 7fddf77fe700 1 --2- 172.21.15.26:0/3822861046 >> v2:172.21.15.26:3300/0 conn(0x7fddf809e1d0 0x7fddf8138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:52.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.958+0000 7fddf6ffd700 1 -- 172.21.15.26:0/3822861046 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4009989256 0 0) 0x7fddf809b120 con 0x7fddf809d6f0 2023-10-01T07:56:52.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.958+0000 7fddf6ffd700 1 -- 172.21.15.26:0/3822861046 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdde00035b0 con 0x7fddf809d6f0 2023-10-01T07:56:52.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.959+0000 7fddfc9e2700 1 -- 172.21.15.26:0/3822861046 >> v2:172.21.15.26:3300/0 conn(0x7fddf809e1d0 msgr2=0x7fddf8138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:52.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.959+0000 7fddfc9e2700 1 --2- 172.21.15.26:0/3822861046 >> v2:172.21.15.26:3300/0 conn(0x7fddf809e1d0 0x7fddf8138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:52.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.959+0000 7fddfc9e2700 1 -- 172.21.15.26:0/3822861046 >> v1:172.21.15.26:6789/0 conn(0x7fddf809d6f0 legacy=0x7fddf809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:52.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.959+0000 7fddfc9e2700 1 -- 172.21.15.26:0/3822861046 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf809a500 con 0x7fddf8139170 2023-10-01T07:56:52.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.959+0000 7fddfc9e2700 1 --2- 172.21.15.26:0/3822861046 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddf8139170 0x7fddf813b550 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fddf0009dc0 tx=0x7fddf000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfec7a539cf77c67 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:52.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.959+0000 7fddf6ffd700 1 -- 172.21.15.26:0/3822861046 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf000e070 con 0x7fddf8139170 2023-10-01T07:56:52.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.959+0000 7fddf6ffd700 1 -- 172.21.15.26:0/3822861046 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf000bae0 con 0x7fddf8139170 2023-10-01T07:56:52.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.959+0000 7fddf6ffd700 1 -- 172.21.15.26:0/3822861046 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf000be90 con 0x7fddf8139170 2023-10-01T07:56:52.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.960+0000 7fddfe445700 1 -- 172.21.15.26:0/3822861046 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddf8139170 msgr2=0x7fddf813b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:52.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.960+0000 7fddfe445700 1 --2- 172.21.15.26:0/3822861046 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddf8139170 0x7fddf813b550 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fddf0009dc0 tx=0x7fddf000b330 comp rx=0 tx=0).stop 2023-10-01T07:56:52.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.960+0000 7fddfe445700 1 -- 172.21.15.26:0/3822861046 shutdown_connections 2023-10-01T07:56:52.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.960+0000 7fddfe445700 1 --2- 172.21.15.26:0/3822861046 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddf8139170 0x7fddf813b550 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:52.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.960+0000 7fddfe445700 1 --2- 172.21.15.26:0/3822861046 >> v2:172.21.15.26:3300/0 conn(0x7fddf809e1d0 0x7fddf8138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:52.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.960+0000 7fddfe445700 1 -- 172.21.15.26:0/3822861046 >> 172.21.15.26:0/3822861046 conn(0x7fddf8066f50 msgr2=0x7fddf809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:52.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.960+0000 7fddfe445700 1 -- 172.21.15.26:0/3822861046 shutdown_connections 2023-10-01T07:56:52.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.960+0000 7fddfe445700 1 -- 172.21.15.26:0/3822861046 wait complete. 2023-10-01T07:56:52.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.961+0000 7fddfe445700 1 Processor -- start 2023-10-01T07:56:52.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.961+0000 7fddfe445700 1 -- start start 2023-10-01T07:56:52.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.961+0000 7fddfe445700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddf809d6f0 0x7fddf81c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:52.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.961+0000 7fddfe445700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddf809e1d0 0x7fddf81c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:52.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.961+0000 7fddfe445700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fddf8139170 0x7fddf81217b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:52.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.961+0000 7fddfe445700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf81250d0 con 0x7fddf809d6f0 2023-10-01T07:56:52.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.961+0000 7fddfe445700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf8137680 con 0x7fddf809e1d0 2023-10-01T07:56:52.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.961+0000 7fddfe445700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddf81233c0 con 0x7fddf8139170 2023-10-01T07:56:52.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.962+0000 7fddf7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddf809d6f0 0x7fddf81c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:52.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.962+0000 7fddf77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddf809e1d0 0x7fddf81c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:52.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.962+0000 7fddf77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddf809e1d0 0x7fddf81c89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34054/0 (socket says 172.21.15.26:34054) 2023-10-01T07:56:52.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.962+0000 7fddf7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddf809d6f0 0x7fddf81c8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53938/0 (socket says 172.21.15.26:53938) 2023-10-01T07:56:52.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.962+0000 7fddf77fe700 1 -- 172.21.15.26:0/172731740 learned_addr learned my addr 172.21.15.26:0/172731740 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:52.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.962+0000 7fddfc9e2700 1 --2- 172.21.15.26:0/172731740 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fddf8139170 0x7fddf81217b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:52.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.962+0000 7fddf77fe700 1 -- 172.21.15.26:0/172731740 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fddf8139170 msgr2=0x7fddf81217b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:52.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.962+0000 7fddf77fe700 1 --2- 172.21.15.26:0/172731740 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fddf8139170 0x7fddf81217b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:52.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.962+0000 7fddf77fe700 1 -- 172.21.15.26:0/172731740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddf809d6f0 msgr2=0x7fddf81c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:52.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.962+0000 7fddf77fe700 1 --2- 172.21.15.26:0/172731740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddf809d6f0 0x7fddf81c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:52.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.962+0000 7fddf77fe700 1 -- 172.21.15.26:0/172731740 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf0009a70 con 0x7fddf809e1d0 2023-10-01T07:56:52.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.962+0000 7fddf77fe700 1 --2- 172.21.15.26:0/172731740 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddf809e1d0 0x7fddf81c89a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fddec00e9b0 tx=0x7fddec00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:52.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.962+0000 7fddf4ff9700 1 -- 172.21.15.26:0/172731740 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec009710 con 0x7fddf809e1d0 2023-10-01T07:56:52.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.962+0000 7fddf4ff9700 1 -- 172.21.15.26:0/172731740 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddec00ee50 con 0x7fddf809e1d0 2023-10-01T07:56:52.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.962+0000 7fddfe445700 1 -- 172.21.15.26:0/172731740 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf8071f00 con 0x7fddf809e1d0 2023-10-01T07:56:52.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.963+0000 7fddf4ff9700 1 -- 172.21.15.26:0/172731740 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec00ca50 con 0x7fddf809e1d0 2023-10-01T07:56:52.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.963+0000 7fddfe445700 1 -- 172.21.15.26:0/172731740 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf809c760 con 0x7fddf809e1d0 2023-10-01T07:56:52.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.963+0000 7fddfe445700 1 -- 172.21.15.26:0/172731740 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf8074ea0 con 0x7fddf809e1d0 2023-10-01T07:56:52.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.964+0000 7fddf4ff9700 1 -- 172.21.15.26:0/172731740 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fddec00cbb0 con 0x7fddf809e1d0 2023-10-01T07:56:52.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.964+0000 7fddf4ff9700 1 -- 172.21.15.26:0/172731740 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fddec03f6b0 con 0x7fddf809e1d0 2023-10-01T07:56:52.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:52.973+0000 7fddf4ff9700 1 -- 172.21.15.26:0/172731740 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fddec0232f0 con 0x7fddf809e1d0 2023-10-01T07:56:53.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.058+0000 7fea799b2700 1 -- 172.21.15.26:0/3078999339 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fea74074ea0 con 0x7fea74133b10 2023-10-01T07:56:53.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.059+0000 7fea5bfff700 1 -- 172.21.15.26:0/3078999339 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fea64017020 con 0x7fea74133b10 2023-10-01T07:56:53.060 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:53.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.061+0000 7fea799b2700 1 -- 172.21.15.26:0/3078999339 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea74133b10 msgr2=0x7fea7411aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:53.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.061+0000 7fea799b2700 1 --2- 172.21.15.26:0/3078999339 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea74133b10 0x7fea7411aa90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fea6400c480 tx=0x7fea6400c790 comp rx=0 tx=0).stop 2023-10-01T07:56:53.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.061+0000 7fea799b2700 1 -- 172.21.15.26:0/3078999339 shutdown_connections 2023-10-01T07:56:53.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.061+0000 7fea799b2700 1 --2- 172.21.15.26:0/3078999339 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea741397e0 0x7fea7411b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:53.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.061+0000 7fea799b2700 1 --2- 172.21.15.26:0/3078999339 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea74133b10 0x7fea7411aa90 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:53.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.061+0000 7fea799b2700 1 --2- 172.21.15.26:0/3078999339 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fea74133ee0 0x7fea7411afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:53.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.061+0000 7fea799b2700 1 -- 172.21.15.26:0/3078999339 >> 172.21.15.26:0/3078999339 conn(0x7fea740a2aa0 msgr2=0x7fea7409de50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:53.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.061+0000 7fea799b2700 1 -- 172.21.15.26:0/3078999339 shutdown_connections 2023-10-01T07:56:53.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.061+0000 7fea799b2700 1 -- 172.21.15.26:0/3078999339 wait complete. 2023-10-01T07:56:53.075 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:53.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.149+0000 7f76a8685700 1 -- 172.21.15.26:0/3656370883 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f76a0124880 con 0x7f76a009d630 2023-10-01T07:56:53.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.150+0000 7f7696ffd700 1 -- 172.21.15.26:0/3656370883 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f769c024b00 con 0x7f76a009d630 2023-10-01T07:56:53.150 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:53.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.152+0000 7f76a8685700 1 -- 172.21.15.26:0/3656370883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76a009d630 msgr2=0x7f76a0120680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:53.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.152+0000 7f76a8685700 1 --2- 172.21.15.26:0/3656370883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76a009d630 0x7f76a0120680 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f769c00e9b0 tx=0x7f769c00ecc0 comp rx=0 tx=0).stop 2023-10-01T07:56:53.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.152+0000 7f76a8685700 1 -- 172.21.15.26:0/3656370883 shutdown_connections 2023-10-01T07:56:53.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.152+0000 7f76a8685700 1 --2- 172.21.15.26:0/3656370883 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f76a0138d80 0x7f76a0121100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:53.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.152+0000 7f76a8685700 1 --2- 172.21.15.26:0/3656370883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76a009d630 0x7f76a0120680 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:53.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.152+0000 7f76a8685700 1 --2- 172.21.15.26:0/3656370883 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f76a00a0a30 0x7f76a0120bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:53.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.152+0000 7f76a8685700 1 -- 172.21.15.26:0/3656370883 >> 172.21.15.26:0/3656370883 conn(0x7f76a00a3050 msgr2=0x7f76a009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:53.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.152+0000 7f76a8685700 1 -- 172.21.15.26:0/3656370883 shutdown_connections 2023-10-01T07:56:53.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.152+0000 7f76a8685700 1 -- 172.21.15.26:0/3656370883 wait complete. 2023-10-01T07:56:53.166 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:53.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.180+0000 7fddfe445700 1 -- 172.21.15.26:0/172731740 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fddf809eb10 con 0x7fddf809e1d0 2023-10-01T07:56:53.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.180+0000 7fddf4ff9700 1 -- 172.21.15.26:0/172731740 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fddec021020 con 0x7fddf809e1d0 2023-10-01T07:56:53.180 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:53.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.182+0000 7fddfe445700 1 -- 172.21.15.26:0/172731740 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddf809e1d0 msgr2=0x7fddf81c89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:53.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.182+0000 7fddfe445700 1 --2- 172.21.15.26:0/172731740 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddf809e1d0 0x7fddf81c89a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fddec00e9b0 tx=0x7fddec00ecc0 comp rx=0 tx=0).stop 2023-10-01T07:56:53.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.182+0000 7fddfe445700 1 -- 172.21.15.26:0/172731740 shutdown_connections 2023-10-01T07:56:53.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.182+0000 7fddfe445700 1 --2- 172.21.15.26:0/172731740 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fddf8139170 0x7fddf81217b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:53.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.182+0000 7fddfe445700 1 --2- 172.21.15.26:0/172731740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddf809d6f0 0x7fddf81c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:53.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.182+0000 7fddfe445700 1 --2- 172.21.15.26:0/172731740 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddf809e1d0 0x7fddf81c89a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:53.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.182+0000 7fddfe445700 1 -- 172.21.15.26:0/172731740 >> 172.21.15.26:0/172731740 conn(0x7fddf8066f50 msgr2=0x7fddf8070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:53.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.182+0000 7fddfe445700 1 -- 172.21.15.26:0/172731740 shutdown_connections 2023-10-01T07:56:53.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.182+0000 7fddfe445700 1 -- 172.21.15.26:0/172731740 wait complete. 2023-10-01T07:56:53.196 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:53.673 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:53.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.818+0000 7f06507fd700 1 Processor -- start 2023-10-01T07:56:53.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.819+0000 7f06507fd700 1 -- start start 2023-10-01T07:56:53.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.819+0000 7f06507fd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f064809e930 0x7f064809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:53.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.819+0000 7f06507fd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f064809f240 0x7f06481317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:53.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.819+0000 7f06507fd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f064809f650 0x7f0648131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:53.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.819+0000 7f06507fd700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0648070940 con 0x7f064809e930 2023-10-01T07:56:53.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.819+0000 7f06507fd700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064806fd60 con 0x7f064809f650 2023-10-01T07:56:53.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.819+0000 7f06507fd700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f064806fa80 con 0x7f064809f240 2023-10-01T07:56:53.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.819+0000 7f064e599700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f064809e930 0x7f064809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:53.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.819+0000 7f064dd98700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f064809f240 0x7f06481317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:53.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.819+0000 7f064ed9a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f064809f650 0x7f0648131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:53.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.819+0000 7f064dd98700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f064809f240 0x7f06481317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57102/0 (socket says 172.21.15.26:57102) 2023-10-01T07:56:53.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.819+0000 7f064e599700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f064809e930 0x7f064809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42582/0 (socket says 172.21.15.26:42582) 2023-10-01T07:56:53.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.819+0000 7f064dd98700 1 -- 172.21.15.26:0/1297843026 learned_addr learned my addr 172.21.15.26:0/1297843026 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:53.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.819+0000 7f064ed9a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f064809f650 0x7f0648131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42546/0 (socket says 172.21.15.26:42546) 2023-10-01T07:56:53.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.820+0000 7f064e599700 1 -- 172.21.15.26:0/1297843026 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f064809f240 msgr2=0x7f06481317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:53.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.820+0000 7f064e599700 1 --2- 172.21.15.26:0/1297843026 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f064809f240 0x7f06481317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:53.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.820+0000 7f064e599700 1 -- 172.21.15.26:0/1297843026 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f064809f650 msgr2=0x7f0648131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:53.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.820+0000 7f064e599700 1 --2- 172.21.15.26:0/1297843026 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f064809f650 0x7f0648131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:53.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.820+0000 7f064e599700 1 -- 172.21.15.26:0/1297843026 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064809fb60 con 0x7f064809e930 2023-10-01T07:56:53.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.820+0000 7f064dd98700 1 --2- 172.21.15.26:0/1297843026 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f064809f240 0x7f06481317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:53.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.820+0000 7f064ed9a700 1 --2- 172.21.15.26:0/1297843026 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f064809f650 0x7f0648131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:53.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.820+0000 7f064e599700 1 --2- 172.21.15.26:0/1297843026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f064809e930 0x7f064809ed00 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0644009840 tx=0x7f0644009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88c529ca6d630bdf server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:53.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.820+0000 7f064d597700 1 -- 172.21.15.26:0/1297843026 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0644011830 con 0x7f064809e930 2023-10-01T07:56:53.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.820+0000 7f064d597700 1 -- 172.21.15.26:0/1297843026 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0644011990 con 0x7f064809e930 2023-10-01T07:56:53.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.820+0000 7f064d597700 1 -- 172.21.15.26:0/1297843026 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0644011d20 con 0x7f064809e930 2023-10-01T07:56:53.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.821+0000 7f06507fd700 1 -- 172.21.15.26:0/1297843026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f064809e930 msgr2=0x7f064809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:53.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.821+0000 7f06507fd700 1 --2- 172.21.15.26:0/1297843026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f064809e930 0x7f064809ed00 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0644009840 tx=0x7f0644009b50 comp rx=0 tx=0).stop 2023-10-01T07:56:53.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.821+0000 7f06507fd700 1 -- 172.21.15.26:0/1297843026 shutdown_connections 2023-10-01T07:56:53.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.821+0000 7f06507fd700 1 --2- 172.21.15.26:0/1297843026 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f064809f650 0x7f0648131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:53.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.821+0000 7f06507fd700 1 --2- 172.21.15.26:0/1297843026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f064809e930 0x7f064809ed00 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:53.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.821+0000 7f06507fd700 1 --2- 172.21.15.26:0/1297843026 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f064809f240 0x7f06481317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:53.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.821+0000 7f06507fd700 1 -- 172.21.15.26:0/1297843026 >> 172.21.15.26:0/1297843026 conn(0x7f06480a4210 msgr2=0x7f06480a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:53.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.821+0000 7f06507fd700 1 -- 172.21.15.26:0/1297843026 shutdown_connections 2023-10-01T07:56:53.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.821+0000 7f06507fd700 1 -- 172.21.15.26:0/1297843026 wait complete. 2023-10-01T07:56:53.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.822+0000 7f06507fd700 1 Processor -- start 2023-10-01T07:56:53.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.822+0000 7f06507fd700 1 -- start start 2023-10-01T07:56:53.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.822+0000 7f06507fd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f064809e930 0x7f064806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:53.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.822+0000 7f06507fd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f064809f240 0x7f064806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:53.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.822+0000 7f06507fd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f064809f650 0x7f064806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:53.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.822+0000 7f06507fd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06481b72f0 con 0x7f064809f650 2023-10-01T07:56:53.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.822+0000 7f06507fd700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06481a94a0 con 0x7f064809e930 2023-10-01T07:56:53.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.822+0000 7f06507fd700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06481a9800 con 0x7f064809f240 2023-10-01T07:56:53.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.823+0000 7f064e599700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f064809e930 0x7f064806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:53.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.823+0000 7f064e599700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f064809e930 0x7f064806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42560/0 (socket says 172.21.15.26:42560) 2023-10-01T07:56:53.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.823+0000 7f064e599700 1 -- 172.21.15.26:0/2284281715 learned_addr learned my addr 172.21.15.26:0/2284281715 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:53.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.823+0000 7f064ed9a700 1 --2- 172.21.15.26:0/2284281715 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f064809f650 0x7f064806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:53.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.823+0000 7f064dd98700 1 --2- 172.21.15.26:0/2284281715 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f064809f240 0x7f064806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:53.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.823+0000 7f064e599700 1 -- 172.21.15.26:0/2284281715 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f064809f240 msgr2=0x7f064806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:53.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.823+0000 7f064e599700 1 --2- 172.21.15.26:0/2284281715 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f064809f240 0x7f064806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:53.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.823+0000 7f064e599700 1 -- 172.21.15.26:0/2284281715 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f064809f650 msgr2=0x7f064806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:53.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.823+0000 7f064e599700 1 --2- 172.21.15.26:0/2284281715 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f064809f650 0x7f064806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:53.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.823+0000 7f064e599700 1 -- 172.21.15.26:0/2284281715 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c009550 con 0x7f064809e930 2023-10-01T07:56:53.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.823+0000 7f064ed9a700 1 --2- 172.21.15.26:0/2284281715 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f064809f650 0x7f064806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:53.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.823+0000 7f064e599700 1 --2- 172.21.15.26:0/2284281715 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f064809e930 0x7f064806b8b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f06440090b0 tx=0x7f0644004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:53.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.823+0000 7f063affd700 1 -- 172.21.15.26:0/2284281715 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06440044d0 con 0x7f064809e930 2023-10-01T07:56:53.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.823+0000 7f063affd700 1 -- 172.21.15.26:0/2284281715 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064401f070 con 0x7f064809e930 2023-10-01T07:56:53.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.823+0000 7f06507fd700 1 -- 172.21.15.26:0/2284281715 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0640009a70 con 0x7f064809e930 2023-10-01T07:56:53.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.823+0000 7f063affd700 1 -- 172.21.15.26:0/2284281715 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06440038e0 con 0x7f064809e930 2023-10-01T07:56:53.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.823+0000 7f06507fd700 1 -- 172.21.15.26:0/2284281715 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06440094a0 con 0x7f064809e930 2023-10-01T07:56:53.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.824+0000 7f063affd700 1 -- 172.21.15.26:0/2284281715 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0644003a40 con 0x7f064809e930 2023-10-01T07:56:53.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.824+0000 7f063affd700 1 -- 172.21.15.26:0/2284281715 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0644021070 con 0x7f064809e930 2023-10-01T07:56:53.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.824+0000 7f06507fd700 1 -- 172.21.15.26:0/2284281715 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06481a0b30 con 0x7f064809e930 2023-10-01T07:56:53.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:53.829+0000 7f063affd700 1 -- 172.21.15.26:0/2284281715 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f064401a430 con 0x7f064809e930 2023-10-01T07:56:54.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.034+0000 7f06507fd700 1 -- 172.21.15.26:0/2284281715 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0648071d20 con 0x7f064809e930 2023-10-01T07:56:54.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.034+0000 7f063affd700 1 -- 172.21.15.26:0/2284281715 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f064402b020 con 0x7f064809e930 2023-10-01T07:56:54.035 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:54.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.037+0000 7f06507fd700 1 -- 172.21.15.26:0/2284281715 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f064809e930 msgr2=0x7f064806b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:54.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.037+0000 7f06507fd700 1 --2- 172.21.15.26:0/2284281715 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f064809e930 0x7f064806b8b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f06440090b0 tx=0x7f0644004750 comp rx=0 tx=0).stop 2023-10-01T07:56:54.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.037+0000 7f06507fd700 1 -- 172.21.15.26:0/2284281715 shutdown_connections 2023-10-01T07:56:54.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.037+0000 7f06507fd700 1 --2- 172.21.15.26:0/2284281715 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f064809f650 0x7f064806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:54.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.037+0000 7f06507fd700 1 --2- 172.21.15.26:0/2284281715 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f064809e930 0x7f064806b8b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:54.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.037+0000 7f06507fd700 1 --2- 172.21.15.26:0/2284281715 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f064809f240 0x7f064806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:54.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.037+0000 7f06507fd700 1 -- 172.21.15.26:0/2284281715 >> 172.21.15.26:0/2284281715 conn(0x7f06480a4210 msgr2=0x7f06481b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:54.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.037+0000 7f06507fd700 1 -- 172.21.15.26:0/2284281715 shutdown_connections 2023-10-01T07:56:54.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.037+0000 7f06507fd700 1 -- 172.21.15.26:0/2284281715 wait complete. 2023-10-01T07:56:54.051 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:54.076 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:54.167 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:54.197 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:54.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.220+0000 7f8541fa5700 1 Processor -- start 2023-10-01T07:56:54.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.220+0000 7f8541fa5700 1 -- start start 2023-10-01T07:56:54.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.221+0000 7f8541fa5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f853c1338c0 0x7f853c133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:54.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.221+0000 7f8541fa5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f853c1341d0 0x7f853c09de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:54.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.221+0000 7f8541fa5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f853c06f720 con 0x7f853c09e390 2023-10-01T07:56:54.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.221+0000 7f8541fa5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f853c070c80 con 0x7f853c1341d0 2023-10-01T07:56:54.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.221+0000 7f8541fa5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f853c06fce0 con 0x7f853c1338c0 2023-10-01T07:56:54.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.221+0000 7f853b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f853c1338c0 0x7f853c133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:54.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.221+0000 7f853b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f853c1338c0 0x7f853c133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42570/0 (socket says 172.21.15.26:42570) 2023-10-01T07:56:54.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.221+0000 7f853b7fe700 1 -- 172.21.15.26:0/1132814900 learned_addr learned my addr 172.21.15.26:0/1132814900 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:54.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.221+0000 7f853affd700 1 --2- 172.21.15.26:0/1132814900 >> v2:172.21.15.26:3300/0 conn(0x7f853c1341d0 0x7f853c09de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:54.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.221+0000 7f853b7fe700 1 -- 172.21.15.26:0/1132814900 >> v2:172.21.15.26:3300/0 conn(0x7f853c1341d0 msgr2=0x7f853c09de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:54.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.221+0000 7f853b7fe700 1 --2- 172.21.15.26:0/1132814900 >> v2:172.21.15.26:3300/0 conn(0x7f853c1341d0 0x7f853c09de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:54.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.222+0000 7f853b7fe700 1 -- 172.21.15.26:0/1132814900 >> v1:172.21.15.26:6789/0 conn(0x7f853c09e390 legacy=0x7f853c13a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:54.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.222+0000 7f853b7fe700 1 -- 172.21.15.26:0/1132814900 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853c1336a0 con 0x7f853c1338c0 2023-10-01T07:56:54.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.222+0000 7f853b7fe700 1 --2- 172.21.15.26:0/1132814900 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f853c1338c0 0x7f853c133c90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f852c0098f0 tx=0x7f852c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a252582f0f03385 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:54.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.222+0000 7f853a7fc700 1 -- 172.21.15.26:0/1132814900 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852c011830 con 0x7f853c1338c0 2023-10-01T07:56:54.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.222+0000 7f853a7fc700 1 -- 172.21.15.26:0/1132814900 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852c011990 con 0x7f853c1338c0 2023-10-01T07:56:54.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.222+0000 7f853a7fc700 1 -- 172.21.15.26:0/1132814900 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852c011d20 con 0x7f853c1338c0 2023-10-01T07:56:54.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.223+0000 7f8541fa5700 1 -- 172.21.15.26:0/1132814900 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f853c1338c0 msgr2=0x7f853c133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:54.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.223+0000 7f8541fa5700 1 --2- 172.21.15.26:0/1132814900 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f853c1338c0 0x7f853c133c90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f852c0098f0 tx=0x7f852c009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:54.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.223+0000 7f8541fa5700 1 -- 172.21.15.26:0/1132814900 shutdown_connections 2023-10-01T07:56:54.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.223+0000 7f8541fa5700 1 --2- 172.21.15.26:0/1132814900 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f853c1338c0 0x7f853c133c90 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:54.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.223+0000 7f8541fa5700 1 --2- 172.21.15.26:0/1132814900 >> v2:172.21.15.26:3300/0 conn(0x7f853c1341d0 0x7f853c09de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:54.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.223+0000 7f8541fa5700 1 -- 172.21.15.26:0/1132814900 >> 172.21.15.26:0/1132814900 conn(0x7f853c0a2aa0 msgr2=0x7f853c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:54.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.223+0000 7f8541fa5700 1 -- 172.21.15.26:0/1132814900 shutdown_connections 2023-10-01T07:56:54.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.223+0000 7f8541fa5700 1 -- 172.21.15.26:0/1132814900 wait complete. 2023-10-01T07:56:54.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.224+0000 7f8541fa5700 1 Processor -- start 2023-10-01T07:56:54.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.224+0000 7f8541fa5700 1 -- start start 2023-10-01T07:56:54.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.225+0000 7f8541fa5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f853c09e390 0x7f853c11f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:54.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.225+0000 7f8541fa5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f853c1338c0 0x7f853c11fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:54.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.225+0000 7f8541fa5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f853c1341d0 0x7f853c120300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:54.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.225+0000 7f8541fa5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853c1230c0 con 0x7f853c1341d0 2023-10-01T07:56:54.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.225+0000 7f8541fa5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f853c0a12e0 con 0x7f853c09e390 2023-10-01T07:56:54.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.225+0000 7f8541fa5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f853c06f960 con 0x7f853c1338c0 2023-10-01T07:56:54.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.225+0000 7f853b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f853c09e390 0x7f853c11f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:54.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.225+0000 7f853affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f853c1338c0 0x7f853c11fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:54.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.225+0000 7f853b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f853c09e390 0x7f853c11f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42574/0 (socket says 172.21.15.26:42574) 2023-10-01T07:56:54.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.225+0000 7f853affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f853c1338c0 0x7f853c11fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57126/0 (socket says 172.21.15.26:57126) 2023-10-01T07:56:54.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.225+0000 7f853bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f853c1341d0 0x7f853c120300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:54.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.225+0000 7f853b7fe700 1 -- 172.21.15.26:0/3653699581 learned_addr learned my addr 172.21.15.26:0/3653699581 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:54.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.226+0000 7f853affd700 1 -- 172.21.15.26:0/3653699581 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f853c09e390 msgr2=0x7f853c11f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:54.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.226+0000 7f853affd700 1 --2- 172.21.15.26:0/3653699581 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f853c09e390 0x7f853c11f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:54.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.226+0000 7f853affd700 1 -- 172.21.15.26:0/3653699581 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f853c1341d0 msgr2=0x7f853c120300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:54.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.226+0000 7f853affd700 1 --2- 172.21.15.26:0/3653699581 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f853c1341d0 0x7f853c120300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:54.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.226+0000 7f853affd700 1 -- 172.21.15.26:0/3653699581 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f852c009550 con 0x7f853c1338c0 2023-10-01T07:56:54.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.226+0000 7f853affd700 1 --2- 172.21.15.26:0/3653699581 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f853c1338c0 0x7f853c11fdc0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f853000e8d0 tx=0x7f853000ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:54.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.226+0000 7f8523fff700 1 -- 172.21.15.26:0/3653699581 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8530013680 con 0x7f853c1338c0 2023-10-01T07:56:54.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.226+0000 7f8523fff700 1 -- 172.21.15.26:0/3653699581 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85300137e0 con 0x7f853c1338c0 2023-10-01T07:56:54.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.226+0000 7f8541fa5700 1 -- 172.21.15.26:0/3653699581 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f853c121c80 con 0x7f853c1338c0 2023-10-01T07:56:54.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.226+0000 7f8523fff700 1 -- 172.21.15.26:0/3653699581 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8530013b50 con 0x7f853c1338c0 2023-10-01T07:56:54.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.226+0000 7f8541fa5700 1 -- 172.21.15.26:0/3653699581 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f853c1233a0 con 0x7f853c1338c0 2023-10-01T07:56:54.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.227+0000 7f8523fff700 1 -- 172.21.15.26:0/3653699581 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8530013cb0 con 0x7f853c1338c0 2023-10-01T07:56:54.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.227+0000 7f8523fff700 1 -- 172.21.15.26:0/3653699581 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f853003f6a0 con 0x7f853c1338c0 2023-10-01T07:56:54.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.228+0000 7f8541fa5700 1 -- 172.21.15.26:0/3653699581 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f853c074ea0 con 0x7f853c1338c0 2023-10-01T07:56:54.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.237+0000 7f8523fff700 1 -- 172.21.15.26:0/3653699581 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f853001be10 con 0x7f853c1338c0 2023-10-01T07:56:54.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.324+0000 7fa6075bf700 1 Processor -- start 2023-10-01T07:56:54.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.324+0000 7fa6075bf700 1 -- start start 2023-10-01T07:56:54.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.325+0000 7fa6075bf700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa60009e850 0x7fa60009ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:54.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.325+0000 7fa6075bf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa60009f160 0x7fa600133bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:54.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.325+0000 7fa6075bf700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa60009f960 con 0x7fa600134130 2023-10-01T07:56:54.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.325+0000 7fa6075bf700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa60009ae60 con 0x7fa60009e850 2023-10-01T07:56:54.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.325+0000 7fa6075bf700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60006cb10 con 0x7fa60009f160 2023-10-01T07:56:54.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.325+0000 7fa604b5a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa60009f160 0x7fa600133bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:54.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.325+0000 7fa604b5a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa60009f160 0x7fa600133bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42590/0 (socket says 172.21.15.26:42590) 2023-10-01T07:56:54.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.325+0000 7fa604b5a700 1 -- 172.21.15.26:0/460018224 learned_addr learned my addr 172.21.15.26:0/460018224 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:54.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.325+0000 7fa60535b700 1 --2- 172.21.15.26:0/460018224 >> v2:172.21.15.26:3300/0 conn(0x7fa60009e850 0x7fa60009ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:54.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.325+0000 7fa604b5a700 1 -- 172.21.15.26:0/460018224 >> v2:172.21.15.26:3300/0 conn(0x7fa60009e850 msgr2=0x7fa60009ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:54.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.325+0000 7fa604b5a700 1 --2- 172.21.15.26:0/460018224 >> v2:172.21.15.26:3300/0 conn(0x7fa60009e850 0x7fa60009ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:54.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.325+0000 7fa604b5a700 1 -- 172.21.15.26:0/460018224 >> v1:172.21.15.26:6789/0 conn(0x7fa600134130 legacy=0x7fa60013aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:54.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.325+0000 7fa604b5a700 1 -- 172.21.15.26:0/460018224 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60006b990 con 0x7fa60009f160 2023-10-01T07:56:54.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.325+0000 7fa60535b700 1 --2- 172.21.15.26:0/460018224 >> v2:172.21.15.26:3300/0 conn(0x7fa60009e850 0x7fa60009ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:54.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.326+0000 7fa604b5a700 1 --2- 172.21.15.26:0/460018224 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa60009f160 0x7fa600133bf0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00098f0 tx=0x7fa5f0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4f9b1fb9644f29e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:54.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.326+0000 7fa5f7fff700 1 -- 172.21.15.26:0/460018224 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0011830 con 0x7fa60009f160 2023-10-01T07:56:54.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.326+0000 7fa5f7fff700 1 -- 172.21.15.26:0/460018224 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f0011990 con 0x7fa60009f160 2023-10-01T07:56:54.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.326+0000 7fa5f7fff700 1 -- 172.21.15.26:0/460018224 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0011d20 con 0x7fa60009f160 2023-10-01T07:56:54.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.327+0000 7fa6075bf700 1 -- 172.21.15.26:0/460018224 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa60009f160 msgr2=0x7fa600133bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:54.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.327+0000 7fa6075bf700 1 --2- 172.21.15.26:0/460018224 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa60009f160 0x7fa600133bf0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00098f0 tx=0x7fa5f0009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:54.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.327+0000 7fa6075bf700 1 -- 172.21.15.26:0/460018224 shutdown_connections 2023-10-01T07:56:54.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.327+0000 7fa6075bf700 1 --2- 172.21.15.26:0/460018224 >> v2:172.21.15.26:3300/0 conn(0x7fa60009e850 0x7fa60009ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:54.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.327+0000 7fa6075bf700 1 --2- 172.21.15.26:0/460018224 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa60009f160 0x7fa600133bf0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:54.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.327+0000 7fa6075bf700 1 -- 172.21.15.26:0/460018224 >> 172.21.15.26:0/460018224 conn(0x7fa6000a3f70 msgr2=0x7fa6000a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:54.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.327+0000 7fa6075bf700 1 -- 172.21.15.26:0/460018224 shutdown_connections 2023-10-01T07:56:54.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.327+0000 7fa6075bf700 1 -- 172.21.15.26:0/460018224 wait complete. 2023-10-01T07:56:54.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.328+0000 7fa6075bf700 1 Processor -- start 2023-10-01T07:56:54.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.328+0000 7fa6075bf700 1 -- start start 2023-10-01T07:56:54.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.329+0000 7fa6075bf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa60009e850 0x7fa6001c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:54.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.329+0000 7fa6075bf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa60009f160 0x7fa6001c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:54.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.329+0000 7fa6075bf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa600134130 0x7fa60011ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:54.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.329+0000 7fa6075bf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa600122340 con 0x7fa600134130 2023-10-01T07:56:54.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.329+0000 7fa6075bf700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6001c9530 con 0x7fa60009f160 2023-10-01T07:56:54.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.329+0000 7fa6075bf700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa60006cda0 con 0x7fa60009e850 2023-10-01T07:56:54.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.329+0000 7fa604b5a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa60009f160 0x7fa6001c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:54.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.329+0000 7fa604b5a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa60009f160 0x7fa6001c8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42594/0 (socket says 172.21.15.26:42594) 2023-10-01T07:56:54.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.329+0000 7fa604b5a700 1 -- 172.21.15.26:0/1728839754 learned_addr learned my addr 172.21.15.26:0/1728839754 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:54.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.329+0000 7fa60535b700 1 --2- 172.21.15.26:0/1728839754 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa60009e850 0x7fa6001c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:54.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.329+0000 7fa605b5c700 1 --2- 172.21.15.26:0/1728839754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa600134130 0x7fa60011ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:54.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.329+0000 7fa60535b700 1 -- 172.21.15.26:0/1728839754 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa60009f160 msgr2=0x7fa6001c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:54.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.329+0000 7fa60535b700 1 --2- 172.21.15.26:0/1728839754 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa60009f160 0x7fa6001c8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:54.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.329+0000 7fa60535b700 1 -- 172.21.15.26:0/1728839754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa600134130 msgr2=0x7fa60011ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:54.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.329+0000 7fa60535b700 1 --2- 172.21.15.26:0/1728839754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa600134130 0x7fa60011ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:54.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.329+0000 7fa60535b700 1 -- 172.21.15.26:0/1728839754 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5fc0094a0 con 0x7fa60009e850 2023-10-01T07:56:54.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.329+0000 7fa604b5a700 1 --2- 172.21.15.26:0/1728839754 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa60009f160 0x7fa6001c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:54.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.330+0000 7fa60535b700 1 --2- 172.21.15.26:0/1728839754 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa60009e850 0x7fa6001c8ab0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc00e9e0 tx=0x7fa5fc00ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:54.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.330+0000 7fa5f5ffb700 1 -- 172.21.15.26:0/1728839754 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc00ee80 con 0x7fa60009e850 2023-10-01T07:56:54.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.330+0000 7fa5f5ffb700 1 -- 172.21.15.26:0/1728839754 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5fc017c60 con 0x7fa60009e850 2023-10-01T07:56:54.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.330+0000 7fa6075bf700 1 -- 172.21.15.26:0/1728839754 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f0009550 con 0x7fa60009e850 2023-10-01T07:56:54.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.330+0000 7fa5f5ffb700 1 -- 172.21.15.26:0/1728839754 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc00c640 con 0x7fa60009e850 2023-10-01T07:56:54.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.330+0000 7fa6075bf700 1 -- 172.21.15.26:0/1728839754 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6001336c0 con 0x7fa60009e850 2023-10-01T07:56:54.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.331+0000 7fa5f5ffb700 1 -- 172.21.15.26:0/1728839754 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa5fc00c7a0 con 0x7fa60009e850 2023-10-01T07:56:54.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.331+0000 7fa5f5ffb700 1 -- 172.21.15.26:0/1728839754 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa5fc047950 con 0x7fa60009e850 2023-10-01T07:56:54.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.331+0000 7fa6075bf700 1 -- 172.21.15.26:0/1728839754 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6000747f0 con 0x7fa60009e850 2023-10-01T07:56:54.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.336+0000 7fa5f5ffb700 1 -- 172.21.15.26:0/1728839754 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa5fc01e990 con 0x7fa60009e850 2023-10-01T07:56:54.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.352+0000 7ff0470bd700 1 Processor -- start 2023-10-01T07:56:54.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.353+0000 7ff0470bd700 1 -- start start 2023-10-01T07:56:54.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.353+0000 7ff0470bd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0400a0a30 0x7ff0400a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:54.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.353+0000 7ff0470bd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff040134170 0x7ff04013bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:54.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.353+0000 7ff0470bd700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff04009edd0 con 0x7ff0400a1340 2023-10-01T07:56:54.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.353+0000 7ff0470bd700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04009e1f0 con 0x7ff0400a0a30 2023-10-01T07:56:54.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.353+0000 7ff0470bd700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff04009dc50 con 0x7ff040134170 2023-10-01T07:56:54.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.353+0000 7ff03ffff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff0400a1340 0x7ff040133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36958/0 (socket says 172.21.15.26:36958) 2023-10-01T07:56:54.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.353+0000 7ff03ffff700 1 -- 172.21.15.26:0/2920684652 learned_addr learned my addr 172.21.15.26:0/2920684652 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:54.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.353+0000 7ff044e59700 1 --2- 172.21.15.26:0/2920684652 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0400a0a30 0x7ff0400a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:54.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.353+0000 7ff04565a700 1 --2- 172.21.15.26:0/2920684652 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff040134170 0x7ff04013bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:54.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.354+0000 7ff03f7fe700 1 -- 172.21.15.26:0/2920684652 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 324199550 0 0) 0x7ff04009edd0 con 0x7ff0400a1340 2023-10-01T07:56:54.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.354+0000 7ff03f7fe700 1 -- 172.21.15.26:0/2920684652 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0280035b0 con 0x7ff0400a1340 2023-10-01T07:56:54.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.354+0000 7ff044e59700 1 -- 172.21.15.26:0/2920684652 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff040134170 msgr2=0x7ff04013bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:54.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.354+0000 7ff044e59700 1 --2- 172.21.15.26:0/2920684652 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff040134170 0x7ff04013bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:54.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.354+0000 7ff044e59700 1 -- 172.21.15.26:0/2920684652 >> v1:172.21.15.26:6789/0 conn(0x7ff0400a1340 legacy=0x7ff040133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:54.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.354+0000 7ff044e59700 1 -- 172.21.15.26:0/2920684652 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0400a1fe0 con 0x7ff0400a0a30 2023-10-01T07:56:54.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.354+0000 7ff04565a700 1 --2- 172.21.15.26:0/2920684652 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff040134170 0x7ff04013bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:54.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.354+0000 7ff044e59700 1 --2- 172.21.15.26:0/2920684652 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0400a0a30 0x7ff0400a0e00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff030009dc0 tx=0x7ff03000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbfcd62a78b119ed server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:54.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.354+0000 7ff03f7fe700 1 -- 172.21.15.26:0/2920684652 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03000e070 con 0x7ff0400a0a30 2023-10-01T07:56:54.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.354+0000 7ff03f7fe700 1 -- 172.21.15.26:0/2920684652 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03000bb20 con 0x7ff0400a0a30 2023-10-01T07:56:54.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.354+0000 7ff03f7fe700 1 -- 172.21.15.26:0/2920684652 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff030012430 con 0x7ff0400a0a30 2023-10-01T07:56:54.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.355+0000 7ff0470bd700 1 -- 172.21.15.26:0/2920684652 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0400a0a30 msgr2=0x7ff0400a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:54.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.355+0000 7ff0470bd700 1 --2- 172.21.15.26:0/2920684652 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0400a0a30 0x7ff0400a0e00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff030009dc0 tx=0x7ff03000b330 comp rx=0 tx=0).stop 2023-10-01T07:56:54.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.355+0000 7ff0470bd700 1 -- 172.21.15.26:0/2920684652 shutdown_connections 2023-10-01T07:56:54.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.355+0000 7ff0470bd700 1 --2- 172.21.15.26:0/2920684652 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff040134170 0x7ff04013bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:54.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.355+0000 7ff0470bd700 1 --2- 172.21.15.26:0/2920684652 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0400a0a30 0x7ff0400a0e00 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:54.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.355+0000 7ff0470bd700 1 -- 172.21.15.26:0/2920684652 >> 172.21.15.26:0/2920684652 conn(0x7ff0400a6550 msgr2=0x7ff0400a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:54.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.355+0000 7ff0470bd700 1 -- 172.21.15.26:0/2920684652 shutdown_connections 2023-10-01T07:56:54.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.355+0000 7ff0470bd700 1 -- 172.21.15.26:0/2920684652 wait complete. 2023-10-01T07:56:54.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.356+0000 7ff0470bd700 1 Processor -- start 2023-10-01T07:56:54.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.356+0000 7ff0470bd700 1 -- start start 2023-10-01T07:56:54.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.357+0000 7ff0470bd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0400a0a30 0x7ff0401228b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:54.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.357+0000 7ff0470bd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0400a1340 0x7ff040122df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:54.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.357+0000 7ff0470bd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff040134170 0x7ff040123330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:54.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.357+0000 7ff0470bd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0401245b0 con 0x7ff0400a1340 2023-10-01T07:56:54.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.357+0000 7ff0470bd700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0401333b0 con 0x7ff040134170 2023-10-01T07:56:54.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.357+0000 7ff0470bd700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff04009bd90 con 0x7ff0400a0a30 2023-10-01T07:56:54.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.357+0000 7ff03ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0400a1340 0x7ff040122df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:54.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.357+0000 7ff03ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0400a1340 0x7ff040122df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42644/0 (socket says 172.21.15.26:42644) 2023-10-01T07:56:54.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.357+0000 7ff03ffff700 1 -- 172.21.15.26:0/3086545257 learned_addr learned my addr 172.21.15.26:0/3086545257 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:54.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.357+0000 7ff044e59700 1 --2- 172.21.15.26:0/3086545257 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0400a0a30 0x7ff0401228b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:54.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.357+0000 7ff04565a700 1 --2- 172.21.15.26:0/3086545257 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff040134170 0x7ff040123330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:54.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.357+0000 7ff03ffff700 1 -- 172.21.15.26:0/3086545257 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0400a0a30 msgr2=0x7ff0401228b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:54.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.357+0000 7ff03ffff700 1 --2- 172.21.15.26:0/3086545257 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0400a0a30 0x7ff0401228b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:54.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.357+0000 7ff03ffff700 1 -- 172.21.15.26:0/3086545257 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff040134170 msgr2=0x7ff040123330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:54.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.357+0000 7ff03ffff700 1 --2- 172.21.15.26:0/3086545257 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff040134170 0x7ff040123330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:54.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.357+0000 7ff03ffff700 1 -- 172.21.15.26:0/3086545257 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0380094a0 con 0x7ff0400a1340 2023-10-01T07:56:54.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.358+0000 7ff03ffff700 1 --2- 172.21.15.26:0/3086545257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0400a1340 0x7ff040122df0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ff03400c700 tx=0x7ff03400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:54.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.358+0000 7ff03d7fa700 1 -- 172.21.15.26:0/3086545257 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff034005d70 con 0x7ff0400a1340 2023-10-01T07:56:54.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.358+0000 7ff03d7fa700 1 -- 172.21.15.26:0/3086545257 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0340070d0 con 0x7ff0400a1340 2023-10-01T07:56:54.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.358+0000 7ff0470bd700 1 -- 172.21.15.26:0/3086545257 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff030009a70 con 0x7ff0400a1340 2023-10-01T07:56:54.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.358+0000 7ff03d7fa700 1 -- 172.21.15.26:0/3086545257 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff034007460 con 0x7ff0400a1340 2023-10-01T07:56:54.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.358+0000 7ff0470bd700 1 -- 172.21.15.26:0/3086545257 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0400a25e0 con 0x7ff0400a1340 2023-10-01T07:56:54.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.359+0000 7ff03d7fa700 1 -- 172.21.15.26:0/3086545257 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff0340075c0 con 0x7ff0400a1340 2023-10-01T07:56:54.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.359+0000 7ff03d7fa700 1 -- 172.21.15.26:0/3086545257 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff03403ebc0 con 0x7ff0400a1340 2023-10-01T07:56:54.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.359+0000 7ff0470bd700 1 -- 172.21.15.26:0/3086545257 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0400a0220 con 0x7ff0400a1340 2023-10-01T07:56:54.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.364+0000 7ff03d7fa700 1 -- 172.21.15.26:0/3086545257 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff034017020 con 0x7ff0400a1340 2023-10-01T07:56:54.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.460+0000 7f8541fa5700 1 -- 172.21.15.26:0/3653699581 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f853c06b9e0 con 0x7f853c1338c0 2023-10-01T07:56:54.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.461+0000 7f8523fff700 1 -- 172.21.15.26:0/3653699581 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f853001b3b0 con 0x7f853c1338c0 2023-10-01T07:56:54.462 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:54.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.463+0000 7f8541fa5700 1 -- 172.21.15.26:0/3653699581 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f853c1338c0 msgr2=0x7f853c11fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:54.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.463+0000 7f8541fa5700 1 --2- 172.21.15.26:0/3653699581 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f853c1338c0 0x7f853c11fdc0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f853000e8d0 tx=0x7f853000ebe0 comp rx=0 tx=0).stop 2023-10-01T07:56:54.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.463+0000 7f8541fa5700 1 -- 172.21.15.26:0/3653699581 shutdown_connections 2023-10-01T07:56:54.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.463+0000 7f8541fa5700 1 --2- 172.21.15.26:0/3653699581 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f853c1341d0 0x7f853c120300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:54.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.463+0000 7f8541fa5700 1 --2- 172.21.15.26:0/3653699581 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f853c09e390 0x7f853c11f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:54.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.463+0000 7f8541fa5700 1 --2- 172.21.15.26:0/3653699581 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f853c1338c0 0x7f853c11fdc0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:54.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.463+0000 7f8541fa5700 1 -- 172.21.15.26:0/3653699581 >> 172.21.15.26:0/3653699581 conn(0x7f853c0a2aa0 msgr2=0x7f853c09f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:54.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.464+0000 7f8541fa5700 1 -- 172.21.15.26:0/3653699581 shutdown_connections 2023-10-01T07:56:54.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.464+0000 7f8541fa5700 1 -- 172.21.15.26:0/3653699581 wait complete. 2023-10-01T07:56:54.478 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:54.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.548+0000 7fa6075bf700 1 -- 172.21.15.26:0/1728839754 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa60006bbb0 con 0x7fa60009e850 2023-10-01T07:56:54.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.549+0000 7fa5f5ffb700 1 -- 172.21.15.26:0/1728839754 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa5fc024020 con 0x7fa60009e850 2023-10-01T07:56:54.549 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:54.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.551+0000 7fa6075bf700 1 -- 172.21.15.26:0/1728839754 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa60009e850 msgr2=0x7fa6001c8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:54.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.551+0000 7fa6075bf700 1 --2- 172.21.15.26:0/1728839754 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa60009e850 0x7fa6001c8ab0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc00e9e0 tx=0x7fa5fc00ecf0 comp rx=0 tx=0).stop 2023-10-01T07:56:54.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.551+0000 7fa6075bf700 1 -- 172.21.15.26:0/1728839754 shutdown_connections 2023-10-01T07:56:54.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.551+0000 7fa6075bf700 1 --2- 172.21.15.26:0/1728839754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa600134130 0x7fa60011ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:54.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.551+0000 7fa6075bf700 1 --2- 172.21.15.26:0/1728839754 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa60009e850 0x7fa6001c8ab0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:54.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.551+0000 7fa6075bf700 1 --2- 172.21.15.26:0/1728839754 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa60009f160 0x7fa6001c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:54.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.551+0000 7fa6075bf700 1 -- 172.21.15.26:0/1728839754 >> 172.21.15.26:0/1728839754 conn(0x7fa6000a3f70 msgr2=0x7fa6000a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:54.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.551+0000 7fa6075bf700 1 -- 172.21.15.26:0/1728839754 shutdown_connections 2023-10-01T07:56:54.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.551+0000 7fa6075bf700 1 -- 172.21.15.26:0/1728839754 wait complete. 2023-10-01T07:56:54.565 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:54.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.572+0000 7ff0470bd700 1 -- 172.21.15.26:0/3086545257 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff040074ea0 con 0x7ff0400a1340 2023-10-01T07:56:54.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.572+0000 7ff03d7fa700 1 -- 172.21.15.26:0/3086545257 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff03400f260 con 0x7ff0400a1340 2023-10-01T07:56:54.573 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:54.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.574+0000 7ff0470bd700 1 -- 172.21.15.26:0/3086545257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0400a1340 msgr2=0x7ff040122df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:54.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.574+0000 7ff0470bd700 1 --2- 172.21.15.26:0/3086545257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0400a1340 0x7ff040122df0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ff03400c700 tx=0x7ff03400ca10 comp rx=0 tx=0).stop 2023-10-01T07:56:54.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.574+0000 7ff0470bd700 1 -- 172.21.15.26:0/3086545257 shutdown_connections 2023-10-01T07:56:54.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.574+0000 7ff0470bd700 1 --2- 172.21.15.26:0/3086545257 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff040134170 0x7ff040123330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:54.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.574+0000 7ff0470bd700 1 --2- 172.21.15.26:0/3086545257 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0400a0a30 0x7ff0401228b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:54.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.574+0000 7ff0470bd700 1 --2- 172.21.15.26:0/3086545257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0400a1340 0x7ff040122df0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:54.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.574+0000 7ff0470bd700 1 -- 172.21.15.26:0/3086545257 >> 172.21.15.26:0/3086545257 conn(0x7ff0400a6550 msgr2=0x7ff04009edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:54.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.574+0000 7ff0470bd700 1 -- 172.21.15.26:0/3086545257 shutdown_connections 2023-10-01T07:56:54.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:54.574+0000 7ff0470bd700 1 -- 172.21.15.26:0/3086545257 wait complete. 2023-10-01T07:56:54.588 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:55.052 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:55.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.199+0000 7f090106e700 1 Processor -- start 2023-10-01T07:56:55.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.199+0000 7f090106e700 1 -- start start 2023-10-01T07:56:55.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.199+0000 7f090106e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f08fc09d6f0 0x7f08fc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:55.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.199+0000 7f090106e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08fc09e000 0x7f08fc130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:55.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.199+0000 7f090106e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08fc09e410 0x7f08fc130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:55.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.199+0000 7f090106e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08fc09f520 con 0x7f08fc09d6f0 2023-10-01T07:56:55.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.199+0000 7f090106e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc09f130 con 0x7f08fc09e000 2023-10-01T07:56:55.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.199+0000 7f090106e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc09e930 con 0x7f08fc09e410 2023-10-01T07:56:55.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.200+0000 7f08fad9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f08fc09d6f0 0x7f08fc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:55.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.200+0000 7f08fb59e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08fc09e410 0x7f08fc130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:55.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.200+0000 7f08fa59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08fc09e000 0x7f08fc130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:55.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.200+0000 7f08fb59e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08fc09e410 0x7f08fc130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57154/0 (socket says 172.21.15.26:57154) 2023-10-01T07:56:55.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.200+0000 7f08fad9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f08fc09d6f0 0x7f08fc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42648/0 (socket says 172.21.15.26:42648) 2023-10-01T07:56:55.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.200+0000 7f08fb59e700 1 -- 172.21.15.26:0/2461633585 learned_addr learned my addr 172.21.15.26:0/2461633585 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:55.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.200+0000 7f08fa59c700 1 -- 172.21.15.26:0/2461633585 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08fc09e410 msgr2=0x7f08fc130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:55.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.200+0000 7f08fa59c700 1 --2- 172.21.15.26:0/2461633585 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08fc09e410 0x7f08fc130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:55.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.200+0000 7f08fa59c700 1 -- 172.21.15.26:0/2461633585 >> v2:172.21.15.26:3300/0 conn(0x7f08fc09d6f0 msgr2=0x7f08fc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:55.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.200+0000 7f08fa59c700 1 --2- 172.21.15.26:0/2461633585 >> v2:172.21.15.26:3300/0 conn(0x7f08fc09d6f0 0x7f08fc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:55.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.200+0000 7f08fa59c700 1 -- 172.21.15.26:0/2461633585 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc09b2d0 con 0x7f08fc09e000 2023-10-01T07:56:55.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.200+0000 7f08fad9d700 1 --2- 172.21.15.26:0/2461633585 >> v2:172.21.15.26:3300/0 conn(0x7f08fc09d6f0 0x7f08fc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:55.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.200+0000 7f08fa59c700 1 --2- 172.21.15.26:0/2461633585 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08fc09e000 0x7f08fc130660 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009840 tx=0x7f08f0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df2a757fbc69ec67 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:55.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.200+0000 7f08f9d9b700 1 -- 172.21.15.26:0/2461633585 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f0011830 con 0x7f08fc09e000 2023-10-01T07:56:55.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.200+0000 7f08f9d9b700 1 -- 172.21.15.26:0/2461633585 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f0011990 con 0x7f08fc09e000 2023-10-01T07:56:55.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.200+0000 7f08f9d9b700 1 -- 172.21.15.26:0/2461633585 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f0011d20 con 0x7f08fc09e000 2023-10-01T07:56:55.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.201+0000 7f090106e700 1 -- 172.21.15.26:0/2461633585 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08fc09e000 msgr2=0x7f08fc130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:55.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.201+0000 7f090106e700 1 --2- 172.21.15.26:0/2461633585 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08fc09e000 0x7f08fc130660 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009840 tx=0x7f08f0009b50 comp rx=0 tx=0).stop 2023-10-01T07:56:55.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.201+0000 7f090106e700 1 -- 172.21.15.26:0/2461633585 shutdown_connections 2023-10-01T07:56:55.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.201+0000 7f090106e700 1 --2- 172.21.15.26:0/2461633585 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08fc09e410 0x7f08fc130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:55.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.201+0000 7f090106e700 1 --2- 172.21.15.26:0/2461633585 >> v2:172.21.15.26:3300/0 conn(0x7f08fc09d6f0 0x7f08fc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:55.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.201+0000 7f090106e700 1 --2- 172.21.15.26:0/2461633585 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08fc09e000 0x7f08fc130660 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:55.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.201+0000 7f090106e700 1 -- 172.21.15.26:0/2461633585 >> 172.21.15.26:0/2461633585 conn(0x7f08fc066f50 msgr2=0x7f08fc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:55.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.201+0000 7f090106e700 1 -- 172.21.15.26:0/2461633585 shutdown_connections 2023-10-01T07:56:55.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.201+0000 7f090106e700 1 -- 172.21.15.26:0/2461633585 wait complete. 2023-10-01T07:56:55.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.202+0000 7f090106e700 1 Processor -- start 2023-10-01T07:56:55.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.202+0000 7f090106e700 1 -- start start 2023-10-01T07:56:55.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.203+0000 7f090106e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08fc09d6f0 0x7f08fc122230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:55.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.203+0000 7f090106e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08fc09e000 0x7f08fc122770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:55.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.203+0000 7f090106e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08fc09e410 0x7f08fc122cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:55.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.203+0000 7f090106e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc125a70 con 0x7f08fc09e410 2023-10-01T07:56:55.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.203+0000 7f090106e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc123690 con 0x7f08fc09e000 2023-10-01T07:56:55.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.203+0000 7f090106e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc0a16a0 con 0x7f08fc09d6f0 2023-10-01T07:56:55.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.203+0000 7f08fad9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08fc09d6f0 0x7f08fc122230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:55.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.203+0000 7f08fa59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08fc09e000 0x7f08fc122770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:55.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.203+0000 7f08fb59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08fc09e410 0x7f08fc122cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:55.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.203+0000 7f08fad9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08fc09d6f0 0x7f08fc122230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57156/0 (socket says 172.21.15.26:57156) 2023-10-01T07:56:55.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.203+0000 7f08fad9d700 1 -- 172.21.15.26:0/1259301123 learned_addr learned my addr 172.21.15.26:0/1259301123 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:55.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.203+0000 7f08fad9d700 1 -- 172.21.15.26:0/1259301123 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08fc09e000 msgr2=0x7f08fc122770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:55.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.203+0000 7f08fad9d700 1 --2- 172.21.15.26:0/1259301123 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08fc09e000 0x7f08fc122770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:55.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.203+0000 7f08fad9d700 1 -- 172.21.15.26:0/1259301123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08fc09e410 msgr2=0x7f08fc122cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:55.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.203+0000 7f08fad9d700 1 --2- 172.21.15.26:0/1259301123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08fc09e410 0x7f08fc122cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:55.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.203+0000 7f08fad9d700 1 -- 172.21.15.26:0/1259301123 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ec0094a0 con 0x7f08fc09d6f0 2023-10-01T07:56:55.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.204+0000 7f08fad9d700 1 --2- 172.21.15.26:0/1259301123 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08fc09d6f0 0x7f08fc122230 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f08ec00ec10 tx=0x7f08ec00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:55.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.204+0000 7f08e37fe700 1 -- 172.21.15.26:0/1259301123 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec009780 con 0x7f08fc09d6f0 2023-10-01T07:56:55.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.204+0000 7f08e37fe700 1 -- 172.21.15.26:0/1259301123 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ec00c850 con 0x7f08fc09d6f0 2023-10-01T07:56:55.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.204+0000 7f090106e700 1 -- 172.21.15.26:0/1259301123 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f00094a0 con 0x7f08fc09d6f0 2023-10-01T07:56:55.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.204+0000 7f08e37fe700 1 -- 172.21.15.26:0/1259301123 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec00cbe0 con 0x7f08fc09d6f0 2023-10-01T07:56:55.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.204+0000 7f090106e700 1 -- 172.21.15.26:0/1259301123 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08fc09c750 con 0x7f08fc09d6f0 2023-10-01T07:56:55.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.204+0000 7f08e37fe700 1 -- 172.21.15.26:0/1259301123 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f08ec00cd40 con 0x7f08fc09d6f0 2023-10-01T07:56:55.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.205+0000 7f08e37fe700 1 -- 172.21.15.26:0/1259301123 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f08ec03fc00 con 0x7f08fc09d6f0 2023-10-01T07:56:55.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.205+0000 7f090106e700 1 -- 172.21.15.26:0/1259301123 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08fc1265a0 con 0x7f08fc09d6f0 2023-10-01T07:56:55.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.210+0000 7f08e37fe700 1 -- 172.21.15.26:0/1259301123 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f08ec021080 con 0x7f08fc09d6f0 2023-10-01T07:56:55.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.416+0000 7f090106e700 1 -- 172.21.15.26:0/1259301123 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f08fc123f50 con 0x7f08fc09d6f0 2023-10-01T07:56:55.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.416+0000 7f08e37fe700 1 -- 172.21.15.26:0/1259301123 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f08ec01b3b0 con 0x7f08fc09d6f0 2023-10-01T07:56:55.417 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:55.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.418+0000 7f090106e700 1 -- 172.21.15.26:0/1259301123 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08fc09d6f0 msgr2=0x7f08fc122230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:55.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.418+0000 7f090106e700 1 --2- 172.21.15.26:0/1259301123 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08fc09d6f0 0x7f08fc122230 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f08ec00ec10 tx=0x7f08ec00ef20 comp rx=0 tx=0).stop 2023-10-01T07:56:55.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.419+0000 7f090106e700 1 -- 172.21.15.26:0/1259301123 shutdown_connections 2023-10-01T07:56:55.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.419+0000 7f090106e700 1 --2- 172.21.15.26:0/1259301123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08fc09e410 0x7f08fc122cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:55.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.419+0000 7f090106e700 1 --2- 172.21.15.26:0/1259301123 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f08fc09d6f0 0x7f08fc122230 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:55.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.419+0000 7f090106e700 1 --2- 172.21.15.26:0/1259301123 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08fc09e000 0x7f08fc122770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:55.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.419+0000 7f090106e700 1 -- 172.21.15.26:0/1259301123 >> 172.21.15.26:0/1259301123 conn(0x7f08fc066f50 msgr2=0x7f08fc06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:55.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.419+0000 7f090106e700 1 -- 172.21.15.26:0/1259301123 shutdown_connections 2023-10-01T07:56:55.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.419+0000 7f090106e700 1 -- 172.21.15.26:0/1259301123 wait complete. 2023-10-01T07:56:55.433 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:55.480 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:55.567 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:55.589 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:55.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.620+0000 7f504bc9f700 1 Processor -- start 2023-10-01T07:56:55.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.620+0000 7f504bc9f700 1 -- start start 2023-10-01T07:56:55.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.621+0000 7f504bc9f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f504406f5d0 0x7f504412ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:55.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.621+0000 7f504bc9f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5044135c20 0x7f5044138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:55.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.621+0000 7f504bc9f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f504406fa40 con 0x7f504412cf60 2023-10-01T07:56:55.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.621+0000 7f504bc9f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f504412cd90 con 0x7f5044135c20 2023-10-01T07:56:55.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.621+0000 7f504bc9f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5044071780 con 0x7f504406f5d0 2023-10-01T07:56:55.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.621+0000 7f504a23c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5044135c20 0x7f5044138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:55.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.621+0000 7f504a23c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5044135c20 0x7f5044138000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42668/0 (socket says 172.21.15.26:42668) 2023-10-01T07:56:55.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.621+0000 7f504a23c700 1 -- 172.21.15.26:0/606918589 learned_addr learned my addr 172.21.15.26:0/606918589 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:55.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.621+0000 7f504923a700 1 --2- 172.21.15.26:0/606918589 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f504406f5d0 0x7f504412ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:55.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.621+0000 7f504a23c700 1 -- 172.21.15.26:0/606918589 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f504406f5d0 msgr2=0x7f504412ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:55.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.621+0000 7f504a23c700 1 --2- 172.21.15.26:0/606918589 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f504406f5d0 0x7f504412ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:55.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.621+0000 7f504a23c700 1 -- 172.21.15.26:0/606918589 >> v1:172.21.15.26:6789/0 conn(0x7f504412cf60 legacy=0x7f504412f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:55.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.621+0000 7f504a23c700 1 -- 172.21.15.26:0/606918589 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5044071a40 con 0x7f5044135c20 2023-10-01T07:56:55.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.622+0000 7f504a23c700 1 --2- 172.21.15.26:0/606918589 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5044135c20 0x7f5044138000 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f503c009e50 tx=0x7f503c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e95dadf0651a1a88 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:55.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.622+0000 7f5048a39700 1 -- 172.21.15.26:0/606918589 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c00e070 con 0x7f5044135c20 2023-10-01T07:56:55.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.622+0000 7f5048a39700 1 -- 172.21.15.26:0/606918589 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503c00b910 con 0x7f5044135c20 2023-10-01T07:56:55.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.622+0000 7f5048a39700 1 -- 172.21.15.26:0/606918589 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c00bcc0 con 0x7f5044135c20 2023-10-01T07:56:55.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.623+0000 7f504bc9f700 1 -- 172.21.15.26:0/606918589 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5044135c20 msgr2=0x7f5044138000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:55.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.623+0000 7f504bc9f700 1 --2- 172.21.15.26:0/606918589 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5044135c20 0x7f5044138000 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f503c009e50 tx=0x7f503c00b330 comp rx=0 tx=0).stop 2023-10-01T07:56:55.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.623+0000 7f504bc9f700 1 -- 172.21.15.26:0/606918589 shutdown_connections 2023-10-01T07:56:55.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.623+0000 7f504bc9f700 1 --2- 172.21.15.26:0/606918589 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5044135c20 0x7f5044138000 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:55.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.623+0000 7f504bc9f700 1 --2- 172.21.15.26:0/606918589 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f504406f5d0 0x7f504412ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:55.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.623+0000 7f504bc9f700 1 -- 172.21.15.26:0/606918589 >> 172.21.15.26:0/606918589 conn(0x7f50440a2aa0 msgr2=0x7f50440a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:55.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.623+0000 7f504bc9f700 1 -- 172.21.15.26:0/606918589 shutdown_connections 2023-10-01T07:56:55.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.623+0000 7f504bc9f700 1 -- 172.21.15.26:0/606918589 wait complete. 2023-10-01T07:56:55.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.624+0000 7f504bc9f700 1 Processor -- start 2023-10-01T07:56:55.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.624+0000 7f504bc9f700 1 -- start start 2023-10-01T07:56:55.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.624+0000 7f504bc9f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f504406f5d0 0x7f504409cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:55.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.624+0000 7f504bc9f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f504412cf60 0x7f50441c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:55.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.625+0000 7f504bc9f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5044135c20 0x7f50441c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:55.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.625+0000 7f504bc9f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504412a1e0 con 0x7f504412cf60 2023-10-01T07:56:55.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.625+0000 7f504bc9f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504409ec50 con 0x7f5044135c20 2023-10-01T07:56:55.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.625+0000 7f504bc9f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5044128be0 con 0x7f504406f5d0 2023-10-01T07:56:55.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.625+0000 7f504923a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f504412cf60 0x7f50441c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:55.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.625+0000 7f504923a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f504412cf60 0x7f50441c8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42676/0 (socket says 172.21.15.26:42676) 2023-10-01T07:56:55.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.625+0000 7f504923a700 1 -- 172.21.15.26:0/1638931949 learned_addr learned my addr 172.21.15.26:0/1638931949 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:55.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.625+0000 7f504a23c700 1 --2- 172.21.15.26:0/1638931949 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5044135c20 0x7f50441c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:55.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.625+0000 7f5049a3b700 1 --2- 172.21.15.26:0/1638931949 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f504406f5d0 0x7f504409cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:55.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.625+0000 7f504923a700 1 -- 172.21.15.26:0/1638931949 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f504406f5d0 msgr2=0x7f504409cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:55.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.625+0000 7f504923a700 1 --2- 172.21.15.26:0/1638931949 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f504406f5d0 0x7f504409cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:55.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.625+0000 7f504923a700 1 -- 172.21.15.26:0/1638931949 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5044135c20 msgr2=0x7f50441c8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:55.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.625+0000 7f504923a700 1 --2- 172.21.15.26:0/1638931949 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5044135c20 0x7f50441c8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:55.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.625+0000 7f504923a700 1 -- 172.21.15.26:0/1638931949 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f503c009b30 con 0x7f504412cf60 2023-10-01T07:56:55.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.625+0000 7f504a23c700 1 --2- 172.21.15.26:0/1638931949 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5044135c20 0x7f50441c8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:55.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.625+0000 7f504923a700 1 --2- 172.21.15.26:0/1638931949 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f504412cf60 0x7f50441c8230 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f503400e940 tx=0x7f503400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:55.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.626+0000 7f503a7fc700 1 -- 172.21.15.26:0/1638931949 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503400c900 con 0x7f504412cf60 2023-10-01T07:56:55.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.626+0000 7f503a7fc700 1 -- 172.21.15.26:0/1638931949 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503400ca60 con 0x7f504412cf60 2023-10-01T07:56:55.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.626+0000 7f504bc9f700 1 -- 172.21.15.26:0/1638931949 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f504409c9d0 con 0x7f504412cf60 2023-10-01T07:56:55.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.626+0000 7f503a7fc700 1 -- 172.21.15.26:0/1638931949 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503400cdf0 con 0x7f504412cf60 2023-10-01T07:56:55.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.626+0000 7f504bc9f700 1 -- 172.21.15.26:0/1638931949 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f504411a520 con 0x7f504412cf60 2023-10-01T07:56:55.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.627+0000 7f504bc9f700 1 -- 172.21.15.26:0/1638931949 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5044074ea0 con 0x7f504412cf60 2023-10-01T07:56:55.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.627+0000 7f503a7fc700 1 -- 172.21.15.26:0/1638931949 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f50340113f0 con 0x7f504412cf60 2023-10-01T07:56:55.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.627+0000 7f503a7fc700 1 -- 172.21.15.26:0/1638931949 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f503403f370 con 0x7f504412cf60 2023-10-01T07:56:55.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.636+0000 7f503a7fc700 1 -- 172.21.15.26:0/1638931949 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f50340116a0 con 0x7f504412cf60 2023-10-01T07:56:55.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.712+0000 7f0efda64700 1 Processor -- start 2023-10-01T07:56:55.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.712+0000 7f0efda64700 1 -- start start 2023-10-01T07:56:55.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.712+0000 7f0efda64700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ef80a0a30 0x7f0ef80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:55.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.712+0000 7f0efda64700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0ef8134170 0x7f0ef813bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:55.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.712+0000 7f0efda64700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef809edd0 con 0x7f0ef80a1340 2023-10-01T07:56:55.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.712+0000 7f0efda64700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef809e1f0 con 0x7f0ef8134170 2023-10-01T07:56:55.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.712+0000 7f0efda64700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef809dc50 con 0x7f0ef80a0a30 2023-10-01T07:56:55.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.713+0000 7f0ef7fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0ef8134170 0x7f0ef813bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:55.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.713+0000 7f0eeeffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0ef80a1340 0x7f0ef8133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36978/0 (socket says 172.21.15.26:36978) 2023-10-01T07:56:55.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.713+0000 7f0eeeffd700 1 -- 172.21.15.26:0/3862123117 learned_addr learned my addr 172.21.15.26:0/3862123117 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:55.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.713+0000 7f0ef77fe700 1 --2- 172.21.15.26:0/3862123117 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ef80a0a30 0x7f0ef80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:55.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.713+0000 7f0ef7fff700 1 -- 172.21.15.26:0/3862123117 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ef80a0a30 msgr2=0x7f0ef80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:55.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.713+0000 7f0ef7fff700 1 --2- 172.21.15.26:0/3862123117 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ef80a0a30 0x7f0ef80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:55.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.713+0000 7f0ef7fff700 1 -- 172.21.15.26:0/3862123117 >> v1:172.21.15.26:6789/0 conn(0x7f0ef80a1340 legacy=0x7f0ef8133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:55.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.713+0000 7f0ef7fff700 1 -- 172.21.15.26:0/3862123117 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef80a1fe0 con 0x7f0ef8134170 2023-10-01T07:56:55.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.713+0000 7f0ef77fe700 1 --2- 172.21.15.26:0/3862123117 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ef80a0a30 0x7f0ef80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:55.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.713+0000 7f0ef7fff700 1 --2- 172.21.15.26:0/3862123117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ef8134170 0x7f0ef813bd30 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0009d90 tx=0x7f0ef000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d00dc4053314ef server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:55.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.713+0000 7f0ef6ffd700 1 -- 172.21.15.26:0/3862123117 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef000e070 con 0x7f0ef8134170 2023-10-01T07:56:55.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.713+0000 7f0ef6ffd700 1 -- 172.21.15.26:0/3862123117 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef000bb20 con 0x7f0ef8134170 2023-10-01T07:56:55.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.713+0000 7f0ef6ffd700 1 -- 172.21.15.26:0/3862123117 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0012430 con 0x7f0ef8134170 2023-10-01T07:56:55.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.714+0000 7f0efda64700 1 -- 172.21.15.26:0/3862123117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ef8134170 msgr2=0x7f0ef813bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:55.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.714+0000 7f0efda64700 1 --2- 172.21.15.26:0/3862123117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ef8134170 0x7f0ef813bd30 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0009d90 tx=0x7f0ef000b330 comp rx=0 tx=0).stop 2023-10-01T07:56:55.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.715+0000 7f0efda64700 1 -- 172.21.15.26:0/3862123117 shutdown_connections 2023-10-01T07:56:55.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.715+0000 7f0efda64700 1 --2- 172.21.15.26:0/3862123117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ef8134170 0x7f0ef813bd30 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:55.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.715+0000 7f0efda64700 1 --2- 172.21.15.26:0/3862123117 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ef80a0a30 0x7f0ef80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:55.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.715+0000 7f0efda64700 1 -- 172.21.15.26:0/3862123117 >> 172.21.15.26:0/3862123117 conn(0x7f0ef80a6550 msgr2=0x7f0ef80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:55.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.715+0000 7f0efda64700 1 -- 172.21.15.26:0/3862123117 shutdown_connections 2023-10-01T07:56:55.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.715+0000 7f0efda64700 1 -- 172.21.15.26:0/3862123117 wait complete. 2023-10-01T07:56:55.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.716+0000 7f0efda64700 1 Processor -- start 2023-10-01T07:56:55.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.716+0000 7f0efda64700 1 -- start start 2023-10-01T07:56:55.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.717+0000 7f0efda64700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ef80a0a30 0x7f0ef81228a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:55.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.717+0000 7f0efda64700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ef80a1340 0x7f0ef8122de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:55.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.717+0000 7f0efda64700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ef8134170 0x7f0ef8123320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:55.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.717+0000 7f0efda64700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef8124650 con 0x7f0ef80a1340 2023-10-01T07:56:55.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.717+0000 7f0efda64700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef8124420 con 0x7f0ef8134170 2023-10-01T07:56:55.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.717+0000 7f0efda64700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef8125d90 con 0x7f0ef80a0a30 2023-10-01T07:56:55.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.717+0000 7f0eeeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ef80a1340 0x7f0ef8122de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:55.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.717+0000 7f0eeeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ef80a1340 0x7f0ef8122de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42694/0 (socket says 172.21.15.26:42694) 2023-10-01T07:56:55.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.717+0000 7f0ef7fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ef8134170 0x7f0ef8123320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:55.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.717+0000 7f0eeeffd700 1 -- 172.21.15.26:0/2336431840 learned_addr learned my addr 172.21.15.26:0/2336431840 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:55.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.718+0000 7f0ef77fe700 1 --2- 172.21.15.26:0/2336431840 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ef80a0a30 0x7f0ef81228a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:55.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.718+0000 7f0eeeffd700 1 -- 172.21.15.26:0/2336431840 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ef80a0a30 msgr2=0x7f0ef81228a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:55.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.718+0000 7f0eeeffd700 1 --2- 172.21.15.26:0/2336431840 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ef80a0a30 0x7f0ef81228a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:55.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.718+0000 7f0eeeffd700 1 -- 172.21.15.26:0/2336431840 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ef8134170 msgr2=0x7f0ef8123320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:55.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.718+0000 7f0eeeffd700 1 --2- 172.21.15.26:0/2336431840 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ef8134170 0x7f0ef8123320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:55.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.718+0000 7f0eeeffd700 1 -- 172.21.15.26:0/2336431840 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee80094a0 con 0x7f0ef80a1340 2023-10-01T07:56:55.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.718+0000 7f0ef77fe700 1 --2- 172.21.15.26:0/2336431840 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ef80a0a30 0x7f0ef81228a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:56:55.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.718+0000 7f0ef7fff700 1 --2- 172.21.15.26:0/2336431840 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ef8134170 0x7f0ef8123320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:55.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.718+0000 7f0eeeffd700 1 --2- 172.21.15.26:0/2336431840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ef80a1340 0x7f0ef8122de0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0ee000c550 tx=0x7f0ee000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:55.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.718+0000 7f0ef4ff9700 1 -- 172.21.15.26:0/2336431840 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee0005d70 con 0x7f0ef80a1340 2023-10-01T07:56:55.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.718+0000 7f0ef4ff9700 1 -- 172.21.15.26:0/2336431840 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee00070d0 con 0x7f0ef80a1340 2023-10-01T07:56:55.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.718+0000 7f0ef4ff9700 1 -- 172.21.15.26:0/2336431840 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee0007440 con 0x7f0ef80a1340 2023-10-01T07:56:55.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.718+0000 7f0efda64700 1 -- 172.21.15.26:0/2336431840 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef0009a70 con 0x7f0ef80a1340 2023-10-01T07:56:55.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.718+0000 7f0efda64700 1 -- 172.21.15.26:0/2336431840 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef8126470 con 0x7f0ef80a1340 2023-10-01T07:56:55.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.719+0000 7f0ef4ff9700 1 -- 172.21.15.26:0/2336431840 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0ee00075a0 con 0x7f0ef80a1340 2023-10-01T07:56:55.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.719+0000 7f0ef4ff9700 1 -- 172.21.15.26:0/2336431840 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0ee003e980 con 0x7f0ef80a1340 2023-10-01T07:56:55.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.719+0000 7f0efda64700 1 -- 172.21.15.26:0/2336431840 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef80a1d00 con 0x7f0ef80a1340 2023-10-01T07:56:55.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.724+0000 7f0ef4ff9700 1 -- 172.21.15.26:0/2336431840 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0ee0017020 con 0x7f0ef80a1340 2023-10-01T07:56:55.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.752+0000 7f8d038c4700 1 Processor -- start 2023-10-01T07:56:55.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.752+0000 7f8d038c4700 1 -- start start 2023-10-01T07:56:55.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.752+0000 7f8d038c4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8cfc09d630 0x7f8cfc0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:55.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.752+0000 7f8d038c4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8cfc138d80 0x7f8cfc13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:55.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.752+0000 7f8d038c4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cfc0a2a70 con 0x7f8cfc0a0a30 2023-10-01T07:56:55.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.752+0000 7f8d038c4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc0a01d0 con 0x7f8cfc138d80 2023-10-01T07:56:55.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.752+0000 7f8d038c4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc09e2b0 con 0x7f8cfc09d630 2023-10-01T07:56:55.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.753+0000 7f8d01660700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8cfc0a0a30 0x7f8cfc0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36980/0 (socket says 172.21.15.26:36980) 2023-10-01T07:56:55.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.753+0000 7f8d01e61700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8cfc138d80 0x7f8cfc13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:55.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.753+0000 7f8d01660700 1 -- 172.21.15.26:0/438691243 learned_addr learned my addr 172.21.15.26:0/438691243 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:55.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.753+0000 7f8d00e5f700 1 --2- 172.21.15.26:0/438691243 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8cfc09d630 0x7f8cfc0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:55.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.753+0000 7f8cf3fff700 1 -- 172.21.15.26:0/438691243 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3083776575 0 0) 0x7f8cfc0a2a70 con 0x7f8cfc0a0a30 2023-10-01T07:56:55.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.753+0000 7f8cf3fff700 1 -- 172.21.15.26:0/438691243 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ce80035b0 con 0x7f8cfc0a0a30 2023-10-01T07:56:55.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.753+0000 7f8d01e61700 1 -- 172.21.15.26:0/438691243 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8cfc09d630 msgr2=0x7f8cfc0a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:55.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.753+0000 7f8d01e61700 1 --2- 172.21.15.26:0/438691243 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8cfc09d630 0x7f8cfc0a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:55.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.753+0000 7f8d01e61700 1 -- 172.21.15.26:0/438691243 >> v1:172.21.15.26:6789/0 conn(0x7f8cfc0a0a30 legacy=0x7f8cfc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:55.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.753+0000 7f8d01e61700 1 -- 172.21.15.26:0/438691243 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cfc09dc50 con 0x7f8cfc138d80 2023-10-01T07:56:55.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.753+0000 7f8d00e5f700 1 --2- 172.21.15.26:0/438691243 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8cfc09d630 0x7f8cfc0a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:55.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.753+0000 7f8d01e61700 1 --2- 172.21.15.26:0/438691243 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8cfc138d80 0x7f8cfc13b160 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4009dc0 tx=0x7f8cf400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c55459db3474ea server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:55.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.753+0000 7f8cf3fff700 1 -- 172.21.15.26:0/438691243 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf400e070 con 0x7f8cfc138d80 2023-10-01T07:56:55.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.754+0000 7f8cf3fff700 1 -- 172.21.15.26:0/438691243 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf400bb20 con 0x7f8cfc138d80 2023-10-01T07:56:55.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.754+0000 7f8cf3fff700 1 -- 172.21.15.26:0/438691243 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4012430 con 0x7f8cfc138d80 2023-10-01T07:56:55.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.754+0000 7f8d038c4700 1 -- 172.21.15.26:0/438691243 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8cfc138d80 msgr2=0x7f8cfc13b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:55.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.754+0000 7f8d038c4700 1 --2- 172.21.15.26:0/438691243 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8cfc138d80 0x7f8cfc13b160 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4009dc0 tx=0x7f8cf400b330 comp rx=0 tx=0).stop 2023-10-01T07:56:55.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.754+0000 7f8d038c4700 1 -- 172.21.15.26:0/438691243 shutdown_connections 2023-10-01T07:56:55.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.754+0000 7f8d038c4700 1 --2- 172.21.15.26:0/438691243 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8cfc138d80 0x7f8cfc13b160 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:55.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.754+0000 7f8d038c4700 1 --2- 172.21.15.26:0/438691243 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8cfc09d630 0x7f8cfc0a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:55.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.754+0000 7f8d038c4700 1 -- 172.21.15.26:0/438691243 >> 172.21.15.26:0/438691243 conn(0x7f8cfc0a3050 msgr2=0x7f8cfc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:55.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.754+0000 7f8d038c4700 1 -- 172.21.15.26:0/438691243 shutdown_connections 2023-10-01T07:56:55.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.754+0000 7f8d038c4700 1 -- 172.21.15.26:0/438691243 wait complete. 2023-10-01T07:56:55.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.755+0000 7f8d038c4700 1 Processor -- start 2023-10-01T07:56:55.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.755+0000 7f8d038c4700 1 -- start start 2023-10-01T07:56:55.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.756+0000 7f8d038c4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cfc09d630 0x7f8cfc133680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:55.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.756+0000 7f8d038c4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8cfc0a0a30 0x7f8cfc133bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:55.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.756+0000 7f8d038c4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8cfc138d80 0x7f8cfc134100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:55.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.756+0000 7f8d038c4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc137110 con 0x7f8cfc09d630 2023-10-01T07:56:55.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.756+0000 7f8d038c4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc0a0410 con 0x7f8cfc0a0a30 2023-10-01T07:56:55.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.756+0000 7f8d038c4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc13ab40 con 0x7f8cfc138d80 2023-10-01T07:56:55.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.756+0000 7f8d00e5f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8cfc0a0a30 0x7f8cfc133bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:55.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.756+0000 7f8d00e5f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8cfc0a0a30 0x7f8cfc133bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42666/0 (socket says 172.21.15.26:42666) 2023-10-01T07:56:55.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.756+0000 7f8d00e5f700 1 -- 172.21.15.26:0/2696271576 learned_addr learned my addr 172.21.15.26:0/2696271576 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:55.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.756+0000 7f8d00e5f700 1 -- 172.21.15.26:0/2696271576 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8cfc138d80 msgr2=0x7f8cfc134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:55.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.756+0000 7f8d00e5f700 1 --2- 172.21.15.26:0/2696271576 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8cfc138d80 0x7f8cfc134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:55.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.756+0000 7f8d00e5f700 1 -- 172.21.15.26:0/2696271576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cfc09d630 msgr2=0x7f8cfc133680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:55.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.756+0000 7f8d01660700 1 --2- 172.21.15.26:0/2696271576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cfc09d630 0x7f8cfc133680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:55.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.756+0000 7f8d00e5f700 1 --2- 172.21.15.26:0/2696271576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cfc09d630 0x7f8cfc133680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:55.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.756+0000 7f8d00e5f700 1 -- 172.21.15.26:0/2696271576 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cec0094a0 con 0x7f8cfc0a0a30 2023-10-01T07:56:55.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.756+0000 7f8d01660700 1 --2- 172.21.15.26:0/2696271576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cfc09d630 0x7f8cfc133680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:56:55.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.757+0000 7f8d00e5f700 1 --2- 172.21.15.26:0/2696271576 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8cfc0a0a30 0x7f8cfc133bc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8cec00ebe0 tx=0x7f8cec009ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:55.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.757+0000 7f8cf1ffb700 1 -- 172.21.15.26:0/2696271576 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cec00c910 con 0x7f8cfc0a0a30 2023-10-01T07:56:55.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.757+0000 7f8cf1ffb700 1 -- 172.21.15.26:0/2696271576 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cec00ca70 con 0x7f8cfc0a0a30 2023-10-01T07:56:55.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.757+0000 7f8d038c4700 1 -- 172.21.15.26:0/2696271576 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cf4009a70 con 0x7f8cfc0a0a30 2023-10-01T07:56:55.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.757+0000 7f8cf1ffb700 1 -- 172.21.15.26:0/2696271576 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cec00cde0 con 0x7f8cfc0a0a30 2023-10-01T07:56:55.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.757+0000 7f8d038c4700 1 -- 172.21.15.26:0/2696271576 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cfc136bc0 con 0x7f8cfc0a0a30 2023-10-01T07:56:55.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.758+0000 7f8cf1ffb700 1 -- 172.21.15.26:0/2696271576 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8cec013470 con 0x7f8cfc0a0a30 2023-10-01T07:56:55.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.758+0000 7f8cf1ffb700 1 -- 172.21.15.26:0/2696271576 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8cec03f930 con 0x7f8cfc0a0a30 2023-10-01T07:56:55.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.758+0000 7f8d038c4700 1 -- 172.21.15.26:0/2696271576 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cfc0747f0 con 0x7f8cfc0a0a30 2023-10-01T07:56:55.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.763+0000 7f8cf1ffb700 1 -- 172.21.15.26:0/2696271576 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8cec017080 con 0x7f8cfc0a0a30 2023-10-01T07:56:55.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.851+0000 7f504bc9f700 1 -- 172.21.15.26:0/1638931949 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f50440713a0 con 0x7f504412cf60 2023-10-01T07:56:55.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.851+0000 7f503a7fc700 1 -- 172.21.15.26:0/1638931949 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5034016070 con 0x7f504412cf60 2023-10-01T07:56:55.852 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:55.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.853+0000 7f504bc9f700 1 -- 172.21.15.26:0/1638931949 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f504412cf60 msgr2=0x7f50441c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:55.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.853+0000 7f504bc9f700 1 --2- 172.21.15.26:0/1638931949 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f504412cf60 0x7f50441c8230 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f503400e940 tx=0x7f503400ec50 comp rx=0 tx=0).stop 2023-10-01T07:56:55.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.853+0000 7f504bc9f700 1 -- 172.21.15.26:0/1638931949 shutdown_connections 2023-10-01T07:56:55.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.853+0000 7f504bc9f700 1 --2- 172.21.15.26:0/1638931949 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5044135c20 0x7f50441c8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:55.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.853+0000 7f504bc9f700 1 --2- 172.21.15.26:0/1638931949 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f504406f5d0 0x7f504409cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:55.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.853+0000 7f504bc9f700 1 --2- 172.21.15.26:0/1638931949 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f504412cf60 0x7f50441c8230 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:55.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.853+0000 7f504bc9f700 1 -- 172.21.15.26:0/1638931949 >> 172.21.15.26:0/1638931949 conn(0x7f50440a2aa0 msgr2=0x7f5044129300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:55.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.854+0000 7f504bc9f700 1 -- 172.21.15.26:0/1638931949 shutdown_connections 2023-10-01T07:56:55.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.854+0000 7f504bc9f700 1 -- 172.21.15.26:0/1638931949 wait complete. 2023-10-01T07:56:55.868 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:55.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.935+0000 7f0efda64700 1 -- 172.21.15.26:0/2336431840 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0ef8074ea0 con 0x7f0ef80a1340 2023-10-01T07:56:55.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.935+0000 7f0ef4ff9700 1 -- 172.21.15.26:0/2336431840 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0ee001b3b0 con 0x7f0ef80a1340 2023-10-01T07:56:55.936 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:55.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.937+0000 7f0efda64700 1 -- 172.21.15.26:0/2336431840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ef80a1340 msgr2=0x7f0ef8122de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:55.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.937+0000 7f0efda64700 1 --2- 172.21.15.26:0/2336431840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ef80a1340 0x7f0ef8122de0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0ee000c550 tx=0x7f0ee000c860 comp rx=0 tx=0).stop 2023-10-01T07:56:55.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.938+0000 7f0efda64700 1 -- 172.21.15.26:0/2336431840 shutdown_connections 2023-10-01T07:56:55.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.938+0000 7f0efda64700 1 --2- 172.21.15.26:0/2336431840 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ef8134170 0x7f0ef8123320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:55.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.938+0000 7f0efda64700 1 --2- 172.21.15.26:0/2336431840 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ef80a0a30 0x7f0ef81228a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:55.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.938+0000 7f0efda64700 1 --2- 172.21.15.26:0/2336431840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ef80a1340 0x7f0ef8122de0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:55.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.938+0000 7f0efda64700 1 -- 172.21.15.26:0/2336431840 >> 172.21.15.26:0/2336431840 conn(0x7f0ef80a6550 msgr2=0x7f0ef809ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:55.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.938+0000 7f0efda64700 1 -- 172.21.15.26:0/2336431840 shutdown_connections 2023-10-01T07:56:55.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.938+0000 7f0efda64700 1 -- 172.21.15.26:0/2336431840 wait complete. 2023-10-01T07:56:55.952 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:55.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.972+0000 7f8d038c4700 1 -- 172.21.15.26:0/2696271576 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8cfc072980 con 0x7f8cfc0a0a30 2023-10-01T07:56:55.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.972+0000 7f8cf1ffb700 1 -- 172.21.15.26:0/2696271576 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8cec021020 con 0x7f8cfc0a0a30 2023-10-01T07:56:55.973 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:55.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.975+0000 7f8d038c4700 1 -- 172.21.15.26:0/2696271576 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8cfc0a0a30 msgr2=0x7f8cfc133bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:55.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.975+0000 7f8d038c4700 1 --2- 172.21.15.26:0/2696271576 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8cfc0a0a30 0x7f8cfc133bc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8cec00ebe0 tx=0x7f8cec009ec0 comp rx=0 tx=0).stop 2023-10-01T07:56:55.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.975+0000 7f8d038c4700 1 -- 172.21.15.26:0/2696271576 shutdown_connections 2023-10-01T07:56:55.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.975+0000 7f8d038c4700 1 --2- 172.21.15.26:0/2696271576 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8cfc138d80 0x7f8cfc134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:55.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.975+0000 7f8d038c4700 1 --2- 172.21.15.26:0/2696271576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cfc09d630 0x7f8cfc133680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:55.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.975+0000 7f8d038c4700 1 --2- 172.21.15.26:0/2696271576 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8cfc0a0a30 0x7f8cfc133bc0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:55.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.975+0000 7f8d038c4700 1 -- 172.21.15.26:0/2696271576 >> 172.21.15.26:0/2696271576 conn(0x7f8cfc0a3050 msgr2=0x7f8cfc0a69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:55.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.975+0000 7f8d038c4700 1 -- 172.21.15.26:0/2696271576 shutdown_connections 2023-10-01T07:56:55.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:55.975+0000 7f8d038c4700 1 -- 172.21.15.26:0/2696271576 wait complete. 2023-10-01T07:56:55.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:56.434 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:56.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.580+0000 7fbf8f866700 1 Processor -- start 2023-10-01T07:56:56.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.580+0000 7fbf8f866700 1 -- start start 2023-10-01T07:56:56.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.580+0000 7fbf8f866700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbf8809d6f0 0x7fbf8809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:56.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.580+0000 7fbf8f866700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf8809e410 0x7fbf88130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:56.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.580+0000 7fbf8f866700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf8809f130 con 0x7fbf8809e000 2023-10-01T07:56:56.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.580+0000 7fbf8f866700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf8809f520 con 0x7fbf8809d6f0 2023-10-01T07:56:56.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.580+0000 7fbf8f866700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8809e930 con 0x7fbf8809e410 2023-10-01T07:56:56.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.581+0000 7fbf8ce01700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbf8809e000 0x7fbf88130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36990/0 (socket says 172.21.15.26:36990) 2023-10-01T07:56:56.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.581+0000 7fbf8ce01700 1 -- 172.21.15.26:0/1429417812 learned_addr learned my addr 172.21.15.26:0/1429417812 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:56.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.581+0000 7fbf8d602700 1 --2- 172.21.15.26:0/1429417812 >> v2:172.21.15.26:3300/0 conn(0x7fbf8809d6f0 0x7fbf8809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:56.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.581+0000 7fbf8de03700 1 --2- 172.21.15.26:0/1429417812 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf8809e410 0x7fbf88130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:56.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.581+0000 7fbf7ffff700 1 -- 172.21.15.26:0/1429417812 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1348060666 0 0) 0x7fbf8809f130 con 0x7fbf8809e000 2023-10-01T07:56:56.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.581+0000 7fbf7ffff700 1 -- 172.21.15.26:0/1429417812 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf740035b0 con 0x7fbf8809e000 2023-10-01T07:56:56.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.581+0000 7fbf8de03700 1 -- 172.21.15.26:0/1429417812 >> v2:172.21.15.26:3300/0 conn(0x7fbf8809d6f0 msgr2=0x7fbf8809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:56.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.581+0000 7fbf8de03700 1 --2- 172.21.15.26:0/1429417812 >> v2:172.21.15.26:3300/0 conn(0x7fbf8809d6f0 0x7fbf8809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:56.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.581+0000 7fbf8de03700 1 -- 172.21.15.26:0/1429417812 >> v1:172.21.15.26:6789/0 conn(0x7fbf8809e000 legacy=0x7fbf88130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:56.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.581+0000 7fbf8de03700 1 -- 172.21.15.26:0/1429417812 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8809b2d0 con 0x7fbf8809e410 2023-10-01T07:56:56.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.581+0000 7fbf8d602700 1 --2- 172.21.15.26:0/1429417812 >> v2:172.21.15.26:3300/0 conn(0x7fbf8809d6f0 0x7fbf8809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:56.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.581+0000 7fbf8de03700 1 --2- 172.21.15.26:0/1429417812 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf8809e410 0x7fbf88130d70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fbf80009840 tx=0x7fbf80009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c267b806c529dd47 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:56.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.582+0000 7fbf7ffff700 1 -- 172.21.15.26:0/1429417812 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf80011830 con 0x7fbf8809e410 2023-10-01T07:56:56.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.582+0000 7fbf7ffff700 1 -- 172.21.15.26:0/1429417812 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf80011990 con 0x7fbf8809e410 2023-10-01T07:56:56.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.582+0000 7fbf7ffff700 1 -- 172.21.15.26:0/1429417812 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf80011d20 con 0x7fbf8809e410 2023-10-01T07:56:56.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.582+0000 7fbf8f866700 1 -- 172.21.15.26:0/1429417812 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf8809e410 msgr2=0x7fbf88130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:56.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.582+0000 7fbf8f866700 1 --2- 172.21.15.26:0/1429417812 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf8809e410 0x7fbf88130d70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fbf80009840 tx=0x7fbf80009b50 comp rx=0 tx=0).stop 2023-10-01T07:56:56.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.582+0000 7fbf8f866700 1 -- 172.21.15.26:0/1429417812 shutdown_connections 2023-10-01T07:56:56.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.582+0000 7fbf8f866700 1 --2- 172.21.15.26:0/1429417812 >> v2:172.21.15.26:3300/0 conn(0x7fbf8809d6f0 0x7fbf8809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:56.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.582+0000 7fbf8f866700 1 --2- 172.21.15.26:0/1429417812 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf8809e410 0x7fbf88130d70 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:56.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.582+0000 7fbf8f866700 1 -- 172.21.15.26:0/1429417812 >> 172.21.15.26:0/1429417812 conn(0x7fbf88066f50 msgr2=0x7fbf8809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:56.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.582+0000 7fbf8f866700 1 -- 172.21.15.26:0/1429417812 shutdown_connections 2023-10-01T07:56:56.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.583+0000 7fbf8f866700 1 -- 172.21.15.26:0/1429417812 wait complete. 2023-10-01T07:56:56.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.583+0000 7fbf8f866700 1 Processor -- start 2023-10-01T07:56:56.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.584+0000 7fbf8f866700 1 -- start start 2023-10-01T07:56:56.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.584+0000 7fbf8f866700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf8809d6f0 0x7fbf8811dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:56.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.584+0000 7fbf8f866700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf8809e000 0x7fbf8811e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:56.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.584+0000 7fbf8f866700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf8809e410 0x7fbf8811e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:56.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.584+0000 7fbf8f866700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf88122190 con 0x7fbf8809e410 2023-10-01T07:56:56.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.584+0000 7fbf8f866700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8811f8c0 con 0x7fbf8809d6f0 2023-10-01T07:56:56.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.584+0000 7fbf8f866700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf88120b10 con 0x7fbf8809e000 2023-10-01T07:56:56.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.584+0000 7fbf8d602700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf8809d6f0 0x7fbf8811dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:56.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.584+0000 7fbf8d602700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf8809d6f0 0x7fbf8811dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42686/0 (socket says 172.21.15.26:42686) 2023-10-01T07:56:56.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.584+0000 7fbf8de03700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf8809e410 0x7fbf8811e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:56.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.584+0000 7fbf8d602700 1 -- 172.21.15.26:0/3981321942 learned_addr learned my addr 172.21.15.26:0/3981321942 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:56.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.584+0000 7fbf8ce01700 1 --2- 172.21.15.26:0/3981321942 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf8809e000 0x7fbf8811e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:56.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.584+0000 7fbf8d602700 1 -- 172.21.15.26:0/3981321942 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf8809e000 msgr2=0x7fbf8811e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:56.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.584+0000 7fbf8d602700 1 --2- 172.21.15.26:0/3981321942 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf8809e000 0x7fbf8811e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:56.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.584+0000 7fbf8d602700 1 -- 172.21.15.26:0/3981321942 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf8809e410 msgr2=0x7fbf8811e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:56.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.584+0000 7fbf8d602700 1 --2- 172.21.15.26:0/3981321942 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf8809e410 0x7fbf8811e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:56.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.584+0000 7fbf8d602700 1 -- 172.21.15.26:0/3981321942 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf84009a70 con 0x7fbf8809d6f0 2023-10-01T07:56:56.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.584+0000 7fbf8de03700 1 --2- 172.21.15.26:0/3981321942 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf8809e410 0x7fbf8811e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:56.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.585+0000 7fbf8d602700 1 --2- 172.21.15.26:0/3981321942 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf8809d6f0 0x7fbf8811dcb0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbf84009f60 tx=0x7fbf84009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:56.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.585+0000 7fbf7dffb700 1 -- 172.21.15.26:0/3981321942 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8400cdc0 con 0x7fbf8809d6f0 2023-10-01T07:56:56.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.585+0000 7fbf7dffb700 1 -- 172.21.15.26:0/3981321942 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8400f040 con 0x7fbf8809d6f0 2023-10-01T07:56:56.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.585+0000 7fbf8f866700 1 -- 172.21.15.26:0/3981321942 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf800094a0 con 0x7fbf8809d6f0 2023-10-01T07:56:56.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.585+0000 7fbf7dffb700 1 -- 172.21.15.26:0/3981321942 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf840146a0 con 0x7fbf8809d6f0 2023-10-01T07:56:56.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.585+0000 7fbf8f866700 1 -- 172.21.15.26:0/3981321942 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf880a3c70 con 0x7fbf8809d6f0 2023-10-01T07:56:56.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.586+0000 7fbf7dffb700 1 -- 172.21.15.26:0/3981321942 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbf84014800 con 0x7fbf8809d6f0 2023-10-01T07:56:56.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.586+0000 7fbf7dffb700 1 -- 172.21.15.26:0/3981321942 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbf840403a0 con 0x7fbf8809d6f0 2023-10-01T07:56:56.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.586+0000 7fbf8f866700 1 -- 172.21.15.26:0/3981321942 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf8809c760 con 0x7fbf8809d6f0 2023-10-01T07:56:56.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.591+0000 7fbf7dffb700 1 -- 172.21.15.26:0/3981321942 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbf8401d400 con 0x7fbf8809d6f0 2023-10-01T07:56:56.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.791+0000 7fbf8f866700 1 -- 172.21.15.26:0/3981321942 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbf8811ac20 con 0x7fbf8809d6f0 2023-10-01T07:56:56.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.791+0000 7fbf7dffb700 1 -- 172.21.15.26:0/3981321942 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbf8402b090 con 0x7fbf8809d6f0 2023-10-01T07:56:56.792 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:56.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.794+0000 7fbf8f866700 1 -- 172.21.15.26:0/3981321942 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf8809d6f0 msgr2=0x7fbf8811dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:56.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.794+0000 7fbf8f866700 1 --2- 172.21.15.26:0/3981321942 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf8809d6f0 0x7fbf8811dcb0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbf84009f60 tx=0x7fbf84009f90 comp rx=0 tx=0).stop 2023-10-01T07:56:56.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.794+0000 7fbf8f866700 1 -- 172.21.15.26:0/3981321942 shutdown_connections 2023-10-01T07:56:56.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.794+0000 7fbf8f866700 1 --2- 172.21.15.26:0/3981321942 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf8809e410 0x7fbf8811e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:56.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.794+0000 7fbf8f866700 1 --2- 172.21.15.26:0/3981321942 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf8809d6f0 0x7fbf8811dcb0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:56.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.794+0000 7fbf8f866700 1 --2- 172.21.15.26:0/3981321942 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf8809e000 0x7fbf8811e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:56.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.794+0000 7fbf8f866700 1 -- 172.21.15.26:0/3981321942 >> 172.21.15.26:0/3981321942 conn(0x7fbf88066f50 msgr2=0x7fbf88130b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:56.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.794+0000 7fbf8f866700 1 -- 172.21.15.26:0/3981321942 shutdown_connections 2023-10-01T07:56:56.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:56.794+0000 7fbf8f866700 1 -- 172.21.15.26:0/3981321942 wait complete. 2023-10-01T07:56:56.808 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:56.869 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:56.953 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:56.990 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:57.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.010+0000 7f8b34df4700 1 Processor -- start 2023-10-01T07:56:57.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.010+0000 7f8b34df4700 1 -- start start 2023-10-01T07:56:57.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.011+0000 7f8b34df4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b30134630 0x7f8b30136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:57.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.011+0000 7f8b34df4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b30136f50 0x7f8b30139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:57.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.011+0000 7f8b34df4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b3009b4f0 con 0x7f8b30131810 2023-10-01T07:56:57.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.011+0000 7f8b34df4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b301313c0 con 0x7f8b30136f50 2023-10-01T07:56:57.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.011+0000 7f8b34df4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3006e8c0 con 0x7f8b30134630 2023-10-01T07:56:57.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.011+0000 7f8b2dd9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b30134630 0x7f8b30136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:57.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.011+0000 7f8b2e59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8b30131810 0x7f8b30131be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37004/0 (socket says 172.21.15.26:37004) 2023-10-01T07:56:57.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.011+0000 7f8b2e59c700 1 -- 172.21.15.26:0/3864905697 learned_addr learned my addr 172.21.15.26:0/3864905697 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:57.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.011+0000 7f8b2dd9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b30134630 0x7f8b30136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57238/0 (socket says 172.21.15.26:57238) 2023-10-01T07:56:57.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.012+0000 7f8b2ed9d700 1 --2- 172.21.15.26:0/3864905697 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b30136f50 0x7f8b30139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:57.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.012+0000 7f8b2d59a700 1 -- 172.21.15.26:0/3864905697 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3605374859 0 0) 0x7f8b3009b4f0 con 0x7f8b30131810 2023-10-01T07:56:57.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.012+0000 7f8b2dd9b700 1 -- 172.21.15.26:0/3864905697 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b30136f50 msgr2=0x7f8b30139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:57.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.012+0000 7f8b2dd9b700 1 --2- 172.21.15.26:0/3864905697 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b30136f50 0x7f8b30139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:57.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.012+0000 7f8b2dd9b700 1 -- 172.21.15.26:0/3864905697 >> v1:172.21.15.26:6789/0 conn(0x7f8b30131810 legacy=0x7f8b30131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:57.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.012+0000 7f8b2dd9b700 1 -- 172.21.15.26:0/3864905697 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b30071d20 con 0x7f8b30134630 2023-10-01T07:56:57.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.012+0000 7f8b2ed9d700 1 --2- 172.21.15.26:0/3864905697 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b30136f50 0x7f8b30139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:57.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.012+0000 7f8b2dd9b700 1 --2- 172.21.15.26:0/3864905697 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b30134630 0x7f8b30136a10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8b24009870 tx=0x7f8b24009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c7236308abfd088 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:57.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.012+0000 7f8b2d59a700 1 -- 172.21.15.26:0/3864905697 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b24011830 con 0x7f8b30134630 2023-10-01T07:56:57.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.012+0000 7f8b2d59a700 1 -- 172.21.15.26:0/3864905697 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b24011990 con 0x7f8b30134630 2023-10-01T07:56:57.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.012+0000 7f8b2d59a700 1 -- 172.21.15.26:0/3864905697 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b24011d20 con 0x7f8b30134630 2023-10-01T07:56:57.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.013+0000 7f8b34df4700 1 -- 172.21.15.26:0/3864905697 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b30134630 msgr2=0x7f8b30136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:57.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.013+0000 7f8b34df4700 1 --2- 172.21.15.26:0/3864905697 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b30134630 0x7f8b30136a10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8b24009870 tx=0x7f8b24009b80 comp rx=0 tx=0).stop 2023-10-01T07:56:57.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.013+0000 7f8b34df4700 1 -- 172.21.15.26:0/3864905697 shutdown_connections 2023-10-01T07:56:57.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.013+0000 7f8b34df4700 1 --2- 172.21.15.26:0/3864905697 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b30136f50 0x7f8b30139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:57.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.013+0000 7f8b34df4700 1 --2- 172.21.15.26:0/3864905697 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b30134630 0x7f8b30136a10 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:57.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.013+0000 7f8b34df4700 1 -- 172.21.15.26:0/3864905697 >> 172.21.15.26:0/3864905697 conn(0x7f8b300a2aa0 msgr2=0x7f8b300a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:57.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.013+0000 7f8b34df4700 1 -- 172.21.15.26:0/3864905697 shutdown_connections 2023-10-01T07:56:57.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.013+0000 7f8b34df4700 1 -- 172.21.15.26:0/3864905697 wait complete. 2023-10-01T07:56:57.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.015+0000 7f8b34df4700 1 Processor -- start 2023-10-01T07:56:57.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.015+0000 7f8b34df4700 1 -- start start 2023-10-01T07:56:57.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.015+0000 7f8b34df4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b30131810 0x7f8b3006feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:57.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.015+0000 7f8b34df4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b30134630 0x7f8b300703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:57.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.015+0000 7f8b34df4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b30136f50 0x7f8b301c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:57.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.015+0000 7f8b34df4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3011e720 con 0x7f8b30134630 2023-10-01T07:56:57.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.015+0000 7f8b34df4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3011e170 con 0x7f8b30136f50 2023-10-01T07:56:57.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.015+0000 7f8b34df4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3011e900 con 0x7f8b30131810 2023-10-01T07:56:57.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.015+0000 7f8b2dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b30134630 0x7f8b300703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:57.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.015+0000 7f8b2ed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b30136f50 0x7f8b301c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:57.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.015+0000 7f8b2dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b30134630 0x7f8b300703f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42742/0 (socket says 172.21.15.26:42742) 2023-10-01T07:56:57.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.016+0000 7f8b2dd9b700 1 -- 172.21.15.26:0/2508880453 learned_addr learned my addr 172.21.15.26:0/2508880453 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:57.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.016+0000 7f8b2e59c700 1 --2- 172.21.15.26:0/2508880453 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b30131810 0x7f8b3006feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:57.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.016+0000 7f8b2ed9d700 1 -- 172.21.15.26:0/2508880453 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b30131810 msgr2=0x7f8b3006feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:57.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.016+0000 7f8b2ed9d700 1 --2- 172.21.15.26:0/2508880453 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b30131810 0x7f8b3006feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:57.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.016+0000 7f8b2ed9d700 1 -- 172.21.15.26:0/2508880453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b30134630 msgr2=0x7f8b300703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:57.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.016+0000 7f8b2ed9d700 1 --2- 172.21.15.26:0/2508880453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b30134630 0x7f8b300703f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:57.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.016+0000 7f8b2ed9d700 1 -- 172.21.15.26:0/2508880453 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b28009a70 con 0x7f8b30136f50 2023-10-01T07:56:57.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.016+0000 7f8b2dd9b700 1 --2- 172.21.15.26:0/2508880453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b30134630 0x7f8b300703f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:57.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.016+0000 7f8b2ed9d700 1 --2- 172.21.15.26:0/2508880453 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b30136f50 0x7f8b301c8160 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8b2800efc0 tx=0x7f8b2800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:57.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.016+0000 7f8b1effd700 1 -- 172.21.15.26:0/2508880453 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2800ca90 con 0x7f8b30136f50 2023-10-01T07:56:57.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.016+0000 7f8b1effd700 1 -- 172.21.15.26:0/2508880453 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2800f040 con 0x7f8b30136f50 2023-10-01T07:56:57.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.016+0000 7f8b34df4700 1 -- 172.21.15.26:0/2508880453 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b240094a0 con 0x7f8b30136f50 2023-10-01T07:56:57.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.016+0000 7f8b1effd700 1 -- 172.21.15.26:0/2508880453 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2800ce30 con 0x7f8b30136f50 2023-10-01T07:56:57.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.016+0000 7f8b34df4700 1 -- 172.21.15.26:0/2508880453 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b30130c40 con 0x7f8b30136f50 2023-10-01T07:56:57.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.017+0000 7f8b1effd700 1 -- 172.21.15.26:0/2508880453 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8b28014480 con 0x7f8b30136f50 2023-10-01T07:56:57.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.018+0000 7f8b1effd700 1 -- 172.21.15.26:0/2508880453 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8b2803fd20 con 0x7f8b30136f50 2023-10-01T07:56:57.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.018+0000 7f8b34df4700 1 -- 172.21.15.26:0/2508880453 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b3011ea40 con 0x7f8b30136f50 2023-10-01T07:56:57.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.023+0000 7f8b1effd700 1 -- 172.21.15.26:0/2508880453 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8b3011ea40 con 0x7f8b30136f50 2023-10-01T07:56:57.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.095+0000 7f96c88e8700 1 Processor -- start 2023-10-01T07:56:57.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.095+0000 7f96c88e8700 1 -- start start 2023-10-01T07:56:57.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.096+0000 7f96c88e8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96c406a770 0x7f96c406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:57.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.096+0000 7f96c88e8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96c406b080 0x7f96c4131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:57.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.096+0000 7f96c88e8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96c409ece0 con 0x7f96c4131b40 2023-10-01T07:56:57.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.096+0000 7f96c88e8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c409e760 con 0x7f96c406b080 2023-10-01T07:56:57.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.096+0000 7f96c88e8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96c409e040 con 0x7f96c406a770 2023-10-01T07:56:57.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.096+0000 7f96c1d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96c406b080 0x7f96c4131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:57.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.096+0000 7f96c259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96c406a770 0x7f96c406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:57.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.096+0000 7f96c2d9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f96c4131b40 0x7f96c4138850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37006/0 (socket says 172.21.15.26:37006) 2023-10-01T07:56:57.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.096+0000 7f96c2d9d700 1 -- 172.21.15.26:0/467172333 learned_addr learned my addr 172.21.15.26:0/467172333 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:57.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.097+0000 7f96c1d9b700 1 -- 172.21.15.26:0/467172333 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96c406a770 msgr2=0x7f96c406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:57.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.097+0000 7f96c1d9b700 1 --2- 172.21.15.26:0/467172333 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96c406a770 0x7f96c406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:57.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.097+0000 7f96c1d9b700 1 -- 172.21.15.26:0/467172333 >> v1:172.21.15.26:6789/0 conn(0x7f96c4131b40 legacy=0x7f96c4138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:57.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.097+0000 7f96c1d9b700 1 -- 172.21.15.26:0/467172333 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c409f630 con 0x7f96c406b080 2023-10-01T07:56:57.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.097+0000 7f96c259c700 1 --2- 172.21.15.26:0/467172333 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96c406a770 0x7f96c406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:57.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.097+0000 7f96c1d9b700 1 --2- 172.21.15.26:0/467172333 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96c406b080 0x7f96c4131600 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f96b8009870 tx=0x7f96b8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5403c3da36798f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:57.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.097+0000 7f96c159a700 1 -- 172.21.15.26:0/467172333 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b8011830 con 0x7f96c406b080 2023-10-01T07:56:57.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.097+0000 7f96c159a700 1 -- 172.21.15.26:0/467172333 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b8011990 con 0x7f96c406b080 2023-10-01T07:56:57.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.097+0000 7f96c159a700 1 -- 172.21.15.26:0/467172333 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b8011d20 con 0x7f96c406b080 2023-10-01T07:56:57.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.098+0000 7f96c88e8700 1 -- 172.21.15.26:0/467172333 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96c406b080 msgr2=0x7f96c4131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:57.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.098+0000 7f96c88e8700 1 --2- 172.21.15.26:0/467172333 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96c406b080 0x7f96c4131600 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f96b8009870 tx=0x7f96b8009b80 comp rx=0 tx=0).stop 2023-10-01T07:56:57.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.098+0000 7f96c88e8700 1 -- 172.21.15.26:0/467172333 shutdown_connections 2023-10-01T07:56:57.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.098+0000 7f96c88e8700 1 --2- 172.21.15.26:0/467172333 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96c406a770 0x7f96c406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:57.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.098+0000 7f96c88e8700 1 --2- 172.21.15.26:0/467172333 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96c406b080 0x7f96c4131600 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:57.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.098+0000 7f96c88e8700 1 -- 172.21.15.26:0/467172333 >> 172.21.15.26:0/467172333 conn(0x7f96c4066f50 msgr2=0x7f96c409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:57.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.098+0000 7f96c88e8700 1 -- 172.21.15.26:0/467172333 shutdown_connections 2023-10-01T07:56:57.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.098+0000 7f96c88e8700 1 -- 172.21.15.26:0/467172333 wait complete. 2023-10-01T07:56:57.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.099+0000 7f96c88e8700 1 Processor -- start 2023-10-01T07:56:57.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.099+0000 7f96c88e8700 1 -- start start 2023-10-01T07:56:57.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.100+0000 7f96c88e8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96c406a770 0x7f96c41c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:57.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.100+0000 7f96c88e8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96c406b080 0x7f96c41c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:57.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.100+0000 7f96c88e8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96c4131b40 0x7f96c41c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:57.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.100+0000 7f96c88e8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c411ed50 con 0x7f96c406b080 2023-10-01T07:56:57.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.100+0000 7f96c88e8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c4071e60 con 0x7f96c4131b40 2023-10-01T07:56:57.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.100+0000 7f96c88e8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96c411e600 con 0x7f96c406a770 2023-10-01T07:56:57.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.100+0000 7f96c259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96c406a770 0x7f96c41c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:57.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.100+0000 7f96c259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96c406a770 0x7f96c41c6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57266/0 (socket says 172.21.15.26:57266) 2023-10-01T07:56:57.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.100+0000 7f96c259c700 1 -- 172.21.15.26:0/1424723169 learned_addr learned my addr 172.21.15.26:0/1424723169 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:57.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.100+0000 7f96c1d9b700 1 --2- 172.21.15.26:0/1424723169 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96c406b080 0x7f96c41c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:57.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.100+0000 7f96c2d9d700 1 --2- 172.21.15.26:0/1424723169 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96c4131b40 0x7f96c41c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:57.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.100+0000 7f96c259c700 1 -- 172.21.15.26:0/1424723169 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96c4131b40 msgr2=0x7f96c41c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:57.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.100+0000 7f96c259c700 1 --2- 172.21.15.26:0/1424723169 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96c4131b40 0x7f96c41c6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:57.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.100+0000 7f96c259c700 1 -- 172.21.15.26:0/1424723169 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96c406b080 msgr2=0x7f96c41c68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:57.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.100+0000 7f96c259c700 1 --2- 172.21.15.26:0/1424723169 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96c406b080 0x7f96c41c68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:57.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.100+0000 7f96c259c700 1 -- 172.21.15.26:0/1424723169 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b40094a0 con 0x7f96c406a770 2023-10-01T07:56:57.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.100+0000 7f96c1d9b700 1 --2- 172.21.15.26:0/1424723169 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96c406b080 0x7f96c41c68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:57.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.101+0000 7f96c259c700 1 --2- 172.21.15.26:0/1424723169 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96c406a770 0x7f96c41c6370 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f96b400ec10 tx=0x7f96b400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:57.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.101+0000 7f96b2ffd700 1 -- 172.21.15.26:0/1424723169 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b400c850 con 0x7f96c406a770 2023-10-01T07:56:57.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.101+0000 7f96b2ffd700 1 -- 172.21.15.26:0/1424723169 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b400c9b0 con 0x7f96c406a770 2023-10-01T07:56:57.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.101+0000 7f96c88e8700 1 -- 172.21.15.26:0/1424723169 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b80094a0 con 0x7f96c406a770 2023-10-01T07:56:57.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.101+0000 7f96b2ffd700 1 -- 172.21.15.26:0/1424723169 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b400cd20 con 0x7f96c406a770 2023-10-01T07:56:57.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.101+0000 7f96c88e8700 1 -- 172.21.15.26:0/1424723169 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96c41315d0 con 0x7f96c406a770 2023-10-01T07:56:57.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.102+0000 7f96c88e8700 1 -- 172.21.15.26:0/1424723169 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96c4120140 con 0x7f96c406a770 2023-10-01T07:56:57.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.102+0000 7f96b2ffd700 1 -- 172.21.15.26:0/1424723169 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f96b4013470 con 0x7f96c406a770 2023-10-01T07:56:57.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.103+0000 7f96b2ffd700 1 -- 172.21.15.26:0/1424723169 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f96b403fb10 con 0x7f96c406a770 2023-10-01T07:56:57.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.108+0000 7f96b2ffd700 1 -- 172.21.15.26:0/1424723169 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f96b4013720 con 0x7f96c406a770 2023-10-01T07:56:57.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.140+0000 7feeeb641700 1 Processor -- start 2023-10-01T07:56:57.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.141+0000 7feeeb641700 1 -- start start 2023-10-01T07:56:57.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.141+0000 7feeeb641700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feee40a0a30 0x7feee40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:57.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.141+0000 7feeeb641700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feee409d630 0x7feee40a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:57.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.141+0000 7feeeb641700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee40a2a70 con 0x7feee4133930 2023-10-01T07:56:57.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.141+0000 7feeeb641700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feee40a01d0 con 0x7feee409d630 2023-10-01T07:56:57.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.141+0000 7feeeb641700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee409e2b0 con 0x7feee40a0a30 2023-10-01T07:56:57.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.141+0000 7feee93dd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feee40a0a30 0x7feee40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:57.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.141+0000 7feee93dd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feee40a0a30 0x7feee40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42732/0 (socket says 172.21.15.26:42732) 2023-10-01T07:56:57.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.141+0000 7feee93dd700 1 -- 172.21.15.26:0/102934453 learned_addr learned my addr 172.21.15.26:0/102934453 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:57.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.141+0000 7feee8bdc700 1 --2- 172.21.15.26:0/102934453 >> v2:172.21.15.26:3300/0 conn(0x7feee409d630 0x7feee40a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:57.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.142+0000 7feee93dd700 1 -- 172.21.15.26:0/102934453 >> v2:172.21.15.26:3300/0 conn(0x7feee409d630 msgr2=0x7feee40a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:57.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.142+0000 7feee93dd700 1 --2- 172.21.15.26:0/102934453 >> v2:172.21.15.26:3300/0 conn(0x7feee409d630 0x7feee40a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:57.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.142+0000 7feee93dd700 1 -- 172.21.15.26:0/102934453 >> v1:172.21.15.26:6789/0 conn(0x7feee4133930 legacy=0x7feee4133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:57.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.142+0000 7feee93dd700 1 -- 172.21.15.26:0/102934453 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee409dc50 con 0x7feee40a0a30 2023-10-01T07:56:57.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.142+0000 7feee93dd700 1 --2- 172.21.15.26:0/102934453 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feee40a0a30 0x7feee40a0e00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7feee00098f0 tx=0x7feee0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61c960b050b1af6c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:57.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.142+0000 7feedbfff700 1 -- 172.21.15.26:0/102934453 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee0011830 con 0x7feee40a0a30 2023-10-01T07:56:57.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.142+0000 7feedbfff700 1 -- 172.21.15.26:0/102934453 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee0011990 con 0x7feee40a0a30 2023-10-01T07:56:57.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.142+0000 7feedbfff700 1 -- 172.21.15.26:0/102934453 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee0011d20 con 0x7feee40a0a30 2023-10-01T07:56:57.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.143+0000 7feeeb641700 1 -- 172.21.15.26:0/102934453 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feee40a0a30 msgr2=0x7feee40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:57.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.143+0000 7feeeb641700 1 --2- 172.21.15.26:0/102934453 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feee40a0a30 0x7feee40a0e00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7feee00098f0 tx=0x7feee0009c00 comp rx=0 tx=0).stop 2023-10-01T07:56:57.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.143+0000 7feeeb641700 1 -- 172.21.15.26:0/102934453 shutdown_connections 2023-10-01T07:56:57.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.143+0000 7feeeb641700 1 --2- 172.21.15.26:0/102934453 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feee40a0a30 0x7feee40a0e00 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:57.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.143+0000 7feeeb641700 1 --2- 172.21.15.26:0/102934453 >> v2:172.21.15.26:3300/0 conn(0x7feee409d630 0x7feee40a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:57.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.143+0000 7feeeb641700 1 -- 172.21.15.26:0/102934453 >> 172.21.15.26:0/102934453 conn(0x7feee40a3050 msgr2=0x7feee40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:57.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.143+0000 7feeeb641700 1 -- 172.21.15.26:0/102934453 shutdown_connections 2023-10-01T07:56:57.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.143+0000 7feeeb641700 1 -- 172.21.15.26:0/102934453 wait complete. 2023-10-01T07:56:57.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.144+0000 7feeeb641700 1 Processor -- start 2023-10-01T07:56:57.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.144+0000 7feeeb641700 1 -- start start 2023-10-01T07:56:57.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.145+0000 7feeeb641700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feee409d630 0x7feee4121290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:57.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.145+0000 7feeeb641700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feee40a0a30 0x7feee41217d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:57.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.145+0000 7feeeb641700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feee4133930 0x7feee4121d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:57.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.145+0000 7feeeb641700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee4122dc0 con 0x7feee409d630 2023-10-01T07:56:57.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.145+0000 7feeeb641700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee4123c50 con 0x7feee40a0a30 2023-10-01T07:56:57.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.145+0000 7feeeb641700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feee4124730 con 0x7feee4133930 2023-10-01T07:56:57.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.145+0000 7feee8bdc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feee40a0a30 0x7feee41217d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:57.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.145+0000 7feee8bdc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feee40a0a30 0x7feee41217d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42736/0 (socket says 172.21.15.26:42736) 2023-10-01T07:56:57.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.145+0000 7feee93dd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feee409d630 0x7feee4121290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:57.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.145+0000 7feee8bdc700 1 -- 172.21.15.26:0/4226207637 learned_addr learned my addr 172.21.15.26:0/4226207637 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:57.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.145+0000 7feee93dd700 1 -- 172.21.15.26:0/4226207637 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feee4133930 msgr2=0x7feee4121d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:57.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.145+0000 7feee93dd700 1 --2- 172.21.15.26:0/4226207637 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feee4133930 0x7feee4121d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:57.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.145+0000 7feee93dd700 1 -- 172.21.15.26:0/4226207637 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feee40a0a30 msgr2=0x7feee41217d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:57.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.145+0000 7feee93dd700 1 --2- 172.21.15.26:0/4226207637 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feee40a0a30 0x7feee41217d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:57.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.145+0000 7feee93dd700 1 -- 172.21.15.26:0/4226207637 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee0009550 con 0x7feee409d630 2023-10-01T07:56:57.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.145+0000 7feee8bdc700 1 --2- 172.21.15.26:0/4226207637 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feee40a0a30 0x7feee41217d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:57.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.145+0000 7feee93dd700 1 --2- 172.21.15.26:0/4226207637 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feee409d630 0x7feee4121290 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7feee0016000 tx=0x7feee0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:57.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.146+0000 7feed9ffb700 1 -- 172.21.15.26:0/4226207637 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee0004480 con 0x7feee409d630 2023-10-01T07:56:57.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.146+0000 7feed9ffb700 1 -- 172.21.15.26:0/4226207637 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee001f070 con 0x7feee409d630 2023-10-01T07:56:57.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.146+0000 7feeeb641700 1 -- 172.21.15.26:0/4226207637 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee41249f0 con 0x7feee409d630 2023-10-01T07:56:57.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.146+0000 7feed9ffb700 1 -- 172.21.15.26:0/4226207637 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee00038e0 con 0x7feee409d630 2023-10-01T07:56:57.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.146+0000 7feeeb641700 1 -- 172.21.15.26:0/4226207637 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee4124460 con 0x7feee409d630 2023-10-01T07:56:57.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.147+0000 7feeeb641700 1 -- 172.21.15.26:0/4226207637 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee411df60 con 0x7feee409d630 2023-10-01T07:56:57.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.148+0000 7feed9ffb700 1 -- 172.21.15.26:0/4226207637 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feee0021030 con 0x7feee409d630 2023-10-01T07:56:57.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.148+0000 7feed9ffb700 1 -- 172.21.15.26:0/4226207637 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7feee0040e10 con 0x7feee409d630 2023-10-01T07:56:57.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.152+0000 7feed9ffb700 1 -- 172.21.15.26:0/4226207637 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feee00239c0 con 0x7feee409d630 2023-10-01T07:56:57.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.235+0000 7f8b34df4700 1 -- 172.21.15.26:0/2508880453 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8b3011ea40 con 0x7f8b30136f50 2023-10-01T07:56:57.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.235+0000 7f8b1effd700 1 -- 172.21.15.26:0/2508880453 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8b3011ea40 con 0x7f8b30136f50 2023-10-01T07:56:57.236 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:57.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.237+0000 7f8b34df4700 1 -- 172.21.15.26:0/2508880453 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b30136f50 msgr2=0x7f8b301c8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:57.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.237+0000 7f8b34df4700 1 --2- 172.21.15.26:0/2508880453 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b30136f50 0x7f8b301c8160 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8b2800efc0 tx=0x7f8b2800c3a0 comp rx=0 tx=0).stop 2023-10-01T07:56:57.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.237+0000 7f8b34df4700 1 -- 172.21.15.26:0/2508880453 shutdown_connections 2023-10-01T07:56:57.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.237+0000 7f8b34df4700 1 --2- 172.21.15.26:0/2508880453 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b30136f50 0x7f8b301c8160 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:57.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.237+0000 7f8b34df4700 1 --2- 172.21.15.26:0/2508880453 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b30131810 0x7f8b3006feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:57.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.237+0000 7f8b34df4700 1 --2- 172.21.15.26:0/2508880453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b30134630 0x7f8b300703f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:57.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.237+0000 7f8b34df4700 1 -- 172.21.15.26:0/2508880453 >> 172.21.15.26:0/2508880453 conn(0x7f8b300a2aa0 msgr2=0x7f8b301330f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:57.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.237+0000 7f8b34df4700 1 -- 172.21.15.26:0/2508880453 shutdown_connections 2023-10-01T07:56:57.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.237+0000 7f8b34df4700 1 -- 172.21.15.26:0/2508880453 wait complete. 2023-10-01T07:56:57.252 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:57.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.317+0000 7f96c88e8700 1 -- 172.21.15.26:0/1424723169 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f96c41313e0 con 0x7f96c406a770 2023-10-01T07:56:57.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.318+0000 7f96b2ffd700 1 -- 172.21.15.26:0/1424723169 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f96c41313e0 con 0x7f96c406a770 2023-10-01T07:56:57.319 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:57.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.320+0000 7f96c88e8700 1 -- 172.21.15.26:0/1424723169 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96c406a770 msgr2=0x7f96c41c6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:57.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.320+0000 7f96c88e8700 1 --2- 172.21.15.26:0/1424723169 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96c406a770 0x7f96c41c6370 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f96b400ec10 tx=0x7f96b400ef20 comp rx=0 tx=0).stop 2023-10-01T07:56:57.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.320+0000 7f96c88e8700 1 -- 172.21.15.26:0/1424723169 shutdown_connections 2023-10-01T07:56:57.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.320+0000 7f96c88e8700 1 --2- 172.21.15.26:0/1424723169 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96c4131b40 0x7f96c41c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:57.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.320+0000 7f96c88e8700 1 --2- 172.21.15.26:0/1424723169 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96c406a770 0x7f96c41c6370 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:57.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.320+0000 7f96c88e8700 1 --2- 172.21.15.26:0/1424723169 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96c406b080 0x7f96c41c68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:57.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.320+0000 7f96c88e8700 1 -- 172.21.15.26:0/1424723169 >> 172.21.15.26:0/1424723169 conn(0x7f96c4066f50 msgr2=0x7f96c40a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:57.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.320+0000 7f96c88e8700 1 -- 172.21.15.26:0/1424723169 shutdown_connections 2023-10-01T07:56:57.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.320+0000 7f96c88e8700 1 -- 172.21.15.26:0/1424723169 wait complete. 2023-10-01T07:56:57.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:57.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.359+0000 7feeeb641700 1 -- 172.21.15.26:0/4226207637 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7feee4124010 con 0x7feee409d630 2023-10-01T07:56:57.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.360+0000 7feed9ffb700 1 -- 172.21.15.26:0/4226207637 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feee001b430 con 0x7feee409d630 2023-10-01T07:56:57.361 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:57.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.362+0000 7feeeb641700 1 -- 172.21.15.26:0/4226207637 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feee409d630 msgr2=0x7feee4121290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:57.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.362+0000 7feeeb641700 1 --2- 172.21.15.26:0/4226207637 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feee409d630 0x7feee4121290 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7feee0016000 tx=0x7feee0004750 comp rx=0 tx=0).stop 2023-10-01T07:56:57.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.362+0000 7feeeb641700 1 -- 172.21.15.26:0/4226207637 shutdown_connections 2023-10-01T07:56:57.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.362+0000 7feeeb641700 1 --2- 172.21.15.26:0/4226207637 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feee4133930 0x7feee4121d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:57.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.362+0000 7feeeb641700 1 --2- 172.21.15.26:0/4226207637 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feee409d630 0x7feee4121290 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:57.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.362+0000 7feeeb641700 1 --2- 172.21.15.26:0/4226207637 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feee40a0a30 0x7feee41217d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:57.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.362+0000 7feeeb641700 1 -- 172.21.15.26:0/4226207637 >> 172.21.15.26:0/4226207637 conn(0x7feee40a3050 msgr2=0x7feee41331a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:57.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.362+0000 7feeeb641700 1 -- 172.21.15.26:0/4226207637 shutdown_connections 2023-10-01T07:56:57.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.362+0000 7feeeb641700 1 -- 172.21.15.26:0/4226207637 wait complete. 2023-10-01T07:56:57.377 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:57.809 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:57.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.955+0000 7f8f931d9700 1 Processor -- start 2023-10-01T07:56:57.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.955+0000 7f8f931d9700 1 -- start start 2023-10-01T07:56:57.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.955+0000 7f8f931d9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8f8c09e1d0 0x7f8f8c135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:57.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.955+0000 7f8f931d9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f8c135e50 0x7f8f8c138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:57.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.955+0000 7f8f931d9700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f8c09f130 con 0x7f8f8c09d6f0 2023-10-01T07:56:57.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.955+0000 7f8f931d9700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f8c09f520 con 0x7f8f8c09e1d0 2023-10-01T07:56:57.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.955+0000 7f8f931d9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8c09e930 con 0x7f8f8c135e50 2023-10-01T07:56:57.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.955+0000 7f8f91776700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f8c135e50 0x7f8f8c138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:57.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.955+0000 7f8f91776700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f8c135e50 0x7f8f8c138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57294/0 (socket says 172.21.15.26:57294) 2023-10-01T07:56:57.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.955+0000 7f8f8bfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8f8c09e1d0 0x7f8f8c135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:57.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.955+0000 7f8f91776700 1 -- 172.21.15.26:0/161902546 learned_addr learned my addr 172.21.15.26:0/161902546 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:57.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.956+0000 7f8f91776700 1 -- 172.21.15.26:0/161902546 >> v2:172.21.15.26:3300/0 conn(0x7f8f8c09e1d0 msgr2=0x7f8f8c135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:57.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.956+0000 7f8f91776700 1 --2- 172.21.15.26:0/161902546 >> v2:172.21.15.26:3300/0 conn(0x7f8f8c09e1d0 0x7f8f8c135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:57.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.956+0000 7f8f91776700 1 -- 172.21.15.26:0/161902546 >> v1:172.21.15.26:6789/0 conn(0x7f8f8c09d6f0 legacy=0x7f8f8c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:57.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.956+0000 7f8f91776700 1 -- 172.21.15.26:0/161902546 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f8c09b2d0 con 0x7f8f8c135e50 2023-10-01T07:56:57.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.956+0000 7f8f91776700 1 --2- 172.21.15.26:0/161902546 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f8c135e50 0x7f8f8c138230 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8f84009e50 tx=0x7f8f8400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1586d42e37b4f69 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:57.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.956+0000 7f8f8b7fe700 1 -- 172.21.15.26:0/161902546 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8400e070 con 0x7f8f8c135e50 2023-10-01T07:56:57.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.956+0000 7f8f8b7fe700 1 -- 172.21.15.26:0/161902546 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8400b910 con 0x7f8f8c135e50 2023-10-01T07:56:57.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.956+0000 7f8f8b7fe700 1 -- 172.21.15.26:0/161902546 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8400bcc0 con 0x7f8f8c135e50 2023-10-01T07:56:57.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.957+0000 7f8f931d9700 1 -- 172.21.15.26:0/161902546 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f8c135e50 msgr2=0x7f8f8c138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:57.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.957+0000 7f8f931d9700 1 --2- 172.21.15.26:0/161902546 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f8c135e50 0x7f8f8c138230 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8f84009e50 tx=0x7f8f8400b330 comp rx=0 tx=0).stop 2023-10-01T07:56:57.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.957+0000 7f8f931d9700 1 -- 172.21.15.26:0/161902546 shutdown_connections 2023-10-01T07:56:57.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.957+0000 7f8f931d9700 1 --2- 172.21.15.26:0/161902546 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f8c135e50 0x7f8f8c138230 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:57.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.957+0000 7f8f931d9700 1 --2- 172.21.15.26:0/161902546 >> v2:172.21.15.26:3300/0 conn(0x7f8f8c09e1d0 0x7f8f8c135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:57.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.957+0000 7f8f931d9700 1 -- 172.21.15.26:0/161902546 >> 172.21.15.26:0/161902546 conn(0x7f8f8c066f50 msgr2=0x7f8f8c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:57.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.957+0000 7f8f931d9700 1 -- 172.21.15.26:0/161902546 shutdown_connections 2023-10-01T07:56:57.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.957+0000 7f8f931d9700 1 -- 172.21.15.26:0/161902546 wait complete. 2023-10-01T07:56:57.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.958+0000 7f8f931d9700 1 Processor -- start 2023-10-01T07:56:57.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.958+0000 7f8f931d9700 1 -- start start 2023-10-01T07:56:57.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.958+0000 7f8f931d9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f8c09d6f0 0x7f8f8c11bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:57.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.958+0000 7f8f931d9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f8c09e1d0 0x7f8f8c11c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:57.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.958+0000 7f8f931d9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f8c135e50 0x7f8f8c11ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:57.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.958+0000 7f8f931d9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8c1333b0 con 0x7f8f8c09d6f0 2023-10-01T07:56:57.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.958+0000 7f8f931d9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8c11ede0 con 0x7f8f8c09e1d0 2023-10-01T07:56:57.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.958+0000 7f8f931d9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8c11f7c0 con 0x7f8f8c135e50 2023-10-01T07:56:57.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.958+0000 7f8f91776700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f8c135e50 0x7f8f8c11ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:57.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.958+0000 7f8f8bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f8c09e1d0 0x7f8f8c11c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:57.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.958+0000 7f8f91776700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f8c135e50 0x7f8f8c11ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57296/0 (socket says 172.21.15.26:57296) 2023-10-01T07:56:57.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.959+0000 7f8f91776700 1 -- 172.21.15.26:0/3605455116 learned_addr learned my addr 172.21.15.26:0/3605455116 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:57.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.959+0000 7f8f90f75700 1 --2- 172.21.15.26:0/3605455116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f8c09d6f0 0x7f8f8c11bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:57.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.959+0000 7f8f8bfff700 1 -- 172.21.15.26:0/3605455116 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f8c135e50 msgr2=0x7f8f8c11ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:57.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.959+0000 7f8f8bfff700 1 --2- 172.21.15.26:0/3605455116 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f8c135e50 0x7f8f8c11ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:57.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.959+0000 7f8f8bfff700 1 -- 172.21.15.26:0/3605455116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f8c09d6f0 msgr2=0x7f8f8c11bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:57.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.959+0000 7f8f8bfff700 1 --2- 172.21.15.26:0/3605455116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f8c09d6f0 0x7f8f8c11bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:57.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.959+0000 7f8f8bfff700 1 -- 172.21.15.26:0/3605455116 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f84009b30 con 0x7f8f8c09e1d0 2023-10-01T07:56:57.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.959+0000 7f8f91776700 1 --2- 172.21.15.26:0/3605455116 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f8c135e50 0x7f8f8c11ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:57.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.959+0000 7f8f8bfff700 1 --2- 172.21.15.26:0/3605455116 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f8c09e1d0 0x7f8f8c11c4c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000e870 tx=0x7f8f8000eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:57.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.959+0000 7f8f897fa700 1 -- 172.21.15.26:0/3605455116 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f80013680 con 0x7f8f8c09e1d0 2023-10-01T07:56:57.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.959+0000 7f8f897fa700 1 -- 172.21.15.26:0/3605455116 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f800137e0 con 0x7f8f8c09e1d0 2023-10-01T07:56:57.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.959+0000 7f8f931d9700 1 -- 172.21.15.26:0/3605455116 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f8c0a1df0 con 0x7f8f8c09e1d0 2023-10-01T07:56:57.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.959+0000 7f8f897fa700 1 -- 172.21.15.26:0/3605455116 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f80013b90 con 0x7f8f8c09e1d0 2023-10-01T07:56:57.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.959+0000 7f8f931d9700 1 -- 172.21.15.26:0/3605455116 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f8c11e390 con 0x7f8f8c09e1d0 2023-10-01T07:56:57.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.960+0000 7f8f897fa700 1 -- 172.21.15.26:0/3605455116 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8f80013cf0 con 0x7f8f8c09e1d0 2023-10-01T07:56:57.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.960+0000 7f8f897fa700 1 -- 172.21.15.26:0/3605455116 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8f8003f870 con 0x7f8f8c09e1d0 2023-10-01T07:56:57.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.960+0000 7f8f931d9700 1 -- 172.21.15.26:0/3605455116 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f8c071b20 con 0x7f8f8c09e1d0 2023-10-01T07:56:57.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:57.965+0000 7f8f897fa700 1 -- 172.21.15.26:0/3605455116 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8f80011b80 con 0x7f8f8c09e1d0 2023-10-01T07:56:58.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.170+0000 7f8f931d9700 1 -- 172.21.15.26:0/3605455116 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8f8c074ea0 con 0x7f8f8c09e1d0 2023-10-01T07:56:58.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.170+0000 7f8f897fa700 1 -- 172.21.15.26:0/3605455116 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8f80021030 con 0x7f8f8c09e1d0 2023-10-01T07:56:58.171 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:58.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.173+0000 7f8f931d9700 1 -- 172.21.15.26:0/3605455116 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f8c09e1d0 msgr2=0x7f8f8c11c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:58.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.173+0000 7f8f931d9700 1 --2- 172.21.15.26:0/3605455116 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f8c09e1d0 0x7f8f8c11c4c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000e870 tx=0x7f8f8000eb80 comp rx=0 tx=0).stop 2023-10-01T07:56:58.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.173+0000 7f8f931d9700 1 -- 172.21.15.26:0/3605455116 shutdown_connections 2023-10-01T07:56:58.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.173+0000 7f8f931d9700 1 --2- 172.21.15.26:0/3605455116 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f8c135e50 0x7f8f8c11ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:58.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.173+0000 7f8f931d9700 1 --2- 172.21.15.26:0/3605455116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f8c09d6f0 0x7f8f8c11bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:58.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.173+0000 7f8f931d9700 1 --2- 172.21.15.26:0/3605455116 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f8c09e1d0 0x7f8f8c11c4c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:58.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.173+0000 7f8f931d9700 1 -- 172.21.15.26:0/3605455116 >> 172.21.15.26:0/3605455116 conn(0x7f8f8c066f50 msgr2=0x7f8f8c06ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:58.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.173+0000 7f8f931d9700 1 -- 172.21.15.26:0/3605455116 shutdown_connections 2023-10-01T07:56:58.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.173+0000 7f8f931d9700 1 -- 172.21.15.26:0/3605455116 wait complete. 2023-10-01T07:56:58.187 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:58.253 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:58.335 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:58.378 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:56:58.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.397+0000 7f4e51457700 1 Processor -- start 2023-10-01T07:56:58.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.397+0000 7f4e51457700 1 -- start start 2023-10-01T07:56:58.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.398+0000 7f4e51457700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4e4c0a1510 0x7f4e4c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:58.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.398+0000 7f4e51457700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4e4c139250 0x7f4e4c13b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:58.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.398+0000 7f4e51457700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e4c09edd0 con 0x7f4e4c0a0a30 2023-10-01T07:56:58.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.398+0000 7f4e51457700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c0a18e0 con 0x7f4e4c139250 2023-10-01T07:56:58.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.398+0000 7f4e51457700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c09e1f0 con 0x7f4e4c0a1510 2023-10-01T07:56:58.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.398+0000 7f4e4b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4e4c139250 0x7f4e4c13b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:58.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.398+0000 7f4e4affd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4e4c0a0a30 0x7f4e4c0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37032/0 (socket says 172.21.15.26:37032) 2023-10-01T07:56:58.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.398+0000 7f4e4b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4e4c139250 0x7f4e4c13b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42760/0 (socket says 172.21.15.26:42760) 2023-10-01T07:56:58.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.398+0000 7f4e4affd700 1 -- 172.21.15.26:0/1244169279 learned_addr learned my addr 172.21.15.26:0/1244169279 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:58.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.398+0000 7f4e4a7fc700 1 --2- 172.21.15.26:0/1244169279 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4e4c0a1510 0x7f4e4c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:58.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.398+0000 7f4e4a7fc700 1 -- 172.21.15.26:0/1244169279 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4e4c139250 msgr2=0x7f4e4c13b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:58.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.398+0000 7f4e4a7fc700 1 --2- 172.21.15.26:0/1244169279 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4e4c139250 0x7f4e4c13b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:58.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.398+0000 7f4e4a7fc700 1 -- 172.21.15.26:0/1244169279 >> v1:172.21.15.26:6789/0 conn(0x7f4e4c0a0a30 legacy=0x7f4e4c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:58.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.398+0000 7f4e4a7fc700 1 -- 172.21.15.26:0/1244169279 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4c09dc50 con 0x7f4e4c0a1510 2023-10-01T07:56:58.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.398+0000 7f4e49ffb700 1 -- 172.21.15.26:0/1244169279 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1495929680 0 0) 0x7f4e4c09edd0 con 0x7f4e4c0a0a30 2023-10-01T07:56:58.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.399+0000 7f4e4a7fc700 1 --2- 172.21.15.26:0/1244169279 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4e4c0a1510 0x7f4e4c138d10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4e40009870 tx=0x7f4e40009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea68c241ddb3afa9 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:58.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.399+0000 7f4e49ffb700 1 -- 172.21.15.26:0/1244169279 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e40011830 con 0x7f4e4c0a1510 2023-10-01T07:56:58.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.399+0000 7f4e49ffb700 1 -- 172.21.15.26:0/1244169279 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e40011990 con 0x7f4e4c0a1510 2023-10-01T07:56:58.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.399+0000 7f4e49ffb700 1 -- 172.21.15.26:0/1244169279 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e40011d20 con 0x7f4e4c0a1510 2023-10-01T07:56:58.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.399+0000 7f4e51457700 1 -- 172.21.15.26:0/1244169279 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4e4c0a1510 msgr2=0x7f4e4c138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:58.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.399+0000 7f4e51457700 1 --2- 172.21.15.26:0/1244169279 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4e4c0a1510 0x7f4e4c138d10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4e40009870 tx=0x7f4e40009b80 comp rx=0 tx=0).stop 2023-10-01T07:56:58.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.400+0000 7f4e51457700 1 -- 172.21.15.26:0/1244169279 shutdown_connections 2023-10-01T07:56:58.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.400+0000 7f4e51457700 1 --2- 172.21.15.26:0/1244169279 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4e4c139250 0x7f4e4c13b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:58.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.400+0000 7f4e51457700 1 --2- 172.21.15.26:0/1244169279 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4e4c0a1510 0x7f4e4c138d10 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:58.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.400+0000 7f4e51457700 1 -- 172.21.15.26:0/1244169279 >> 172.21.15.26:0/1244169279 conn(0x7f4e4c0a6550 msgr2=0x7f4e4c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:58.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.400+0000 7f4e51457700 1 -- 172.21.15.26:0/1244169279 shutdown_connections 2023-10-01T07:56:58.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.400+0000 7f4e51457700 1 -- 172.21.15.26:0/1244169279 wait complete. 2023-10-01T07:56:58.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.401+0000 7f4e51457700 1 Processor -- start 2023-10-01T07:56:58.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.401+0000 7f4e51457700 1 -- start start 2023-10-01T07:56:58.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.401+0000 7f4e51457700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4e4c0a0a30 0x7f4e4c1227c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:58.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.401+0000 7f4e51457700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4e4c0a1510 0x7f4e4c122d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:58.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.401+0000 7f4e51457700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e4c139250 0x7f4e4c123240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:58.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.401+0000 7f4e51457700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c1389f0 con 0x7f4e4c139250 2023-10-01T07:56:58.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.401+0000 7f4e51457700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c1243d0 con 0x7f4e4c0a1510 2023-10-01T07:56:58.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.401+0000 7f4e51457700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c138740 con 0x7f4e4c0a0a30 2023-10-01T07:56:58.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.402+0000 7f4e4a7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4e4c0a1510 0x7f4e4c122d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:58.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.402+0000 7f4e4a7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4e4c0a1510 0x7f4e4c122d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42770/0 (socket says 172.21.15.26:42770) 2023-10-01T07:56:58.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.402+0000 7f4e4a7fc700 1 -- 172.21.15.26:0/313383529 learned_addr learned my addr 172.21.15.26:0/313383529 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:58.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.402+0000 7f4e4b7fe700 1 --2- 172.21.15.26:0/313383529 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e4c139250 0x7f4e4c123240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:58.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.402+0000 7f4e4affd700 1 --2- 172.21.15.26:0/313383529 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4e4c0a0a30 0x7f4e4c1227c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:58.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.402+0000 7f4e4a7fc700 1 -- 172.21.15.26:0/313383529 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4e4c0a0a30 msgr2=0x7f4e4c1227c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:58.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.402+0000 7f4e4a7fc700 1 --2- 172.21.15.26:0/313383529 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4e4c0a0a30 0x7f4e4c1227c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:58.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.402+0000 7f4e4a7fc700 1 -- 172.21.15.26:0/313383529 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e4c139250 msgr2=0x7f4e4c123240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:58.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.402+0000 7f4e4a7fc700 1 --2- 172.21.15.26:0/313383529 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e4c139250 0x7f4e4c123240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:58.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.402+0000 7f4e4a7fc700 1 -- 172.21.15.26:0/313383529 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e400094a0 con 0x7f4e4c0a1510 2023-10-01T07:56:58.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.402+0000 7f4e4b7fe700 1 --2- 172.21.15.26:0/313383529 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e4c139250 0x7f4e4c123240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:58.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.402+0000 7f4e4affd700 1 --2- 172.21.15.26:0/313383529 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4e4c0a0a30 0x7f4e4c1227c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:58.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.402+0000 7f4e4a7fc700 1 --2- 172.21.15.26:0/313383529 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4e4c0a1510 0x7f4e4c122d00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4e40000c00 tx=0x7f4e40004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:58.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.402+0000 7f4e337fe700 1 -- 172.21.15.26:0/313383529 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e40004510 con 0x7f4e4c0a1510 2023-10-01T07:56:58.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.402+0000 7f4e337fe700 1 -- 172.21.15.26:0/313383529 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4001f070 con 0x7f4e4c0a1510 2023-10-01T07:56:58.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.402+0000 7f4e51457700 1 -- 172.21.15.26:0/313383529 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e4c1262e0 con 0x7f4e4c0a1510 2023-10-01T07:56:58.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.403+0000 7f4e337fe700 1 -- 172.21.15.26:0/313383529 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e400038e0 con 0x7f4e4c0a1510 2023-10-01T07:56:58.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.403+0000 7f4e51457700 1 -- 172.21.15.26:0/313383529 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e4c0a0270 con 0x7f4e4c0a1510 2023-10-01T07:56:58.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.403+0000 7f4e337fe700 1 -- 172.21.15.26:0/313383529 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4e40003a40 con 0x7f4e4c0a1510 2023-10-01T07:56:58.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.404+0000 7f4e337fe700 1 -- 172.21.15.26:0/313383529 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4e40021070 con 0x7f4e4c0a1510 2023-10-01T07:56:58.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.404+0000 7f4e51457700 1 -- 172.21.15.26:0/313383529 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e4c125c20 con 0x7f4e4c0a1510 2023-10-01T07:56:58.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.411+0000 7f4e337fe700 1 -- 172.21.15.26:0/313383529 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4e40003cf0 con 0x7f4e4c0a1510 2023-10-01T07:56:58.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.486+0000 7f1d47b9b700 1 Processor -- start 2023-10-01T07:56:58.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.487+0000 7f1d47b9b700 1 -- start start 2023-10-01T07:56:58.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.487+0000 7f1d47b9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d40131810 0x7f1d40131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:58.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.487+0000 7f1d47b9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1d40099a40 0x7f1d40099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:58.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.487+0000 7f1d47b9b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d4009a850 con 0x7f1d4009a3b0 2023-10-01T07:56:58.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.487+0000 7f1d47b9b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d4009b580 con 0x7f1d40099a40 2023-10-01T07:56:58.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.487+0000 7f1d47b9b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d401313c0 con 0x7f1d40131810 2023-10-01T07:56:58.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.487+0000 7f1d45136700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1d40099a40 0x7f1d40099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:58.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.487+0000 7f1d45136700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1d40099a40 0x7f1d40099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42804/0 (socket says 172.21.15.26:42804) 2023-10-01T07:56:58.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.487+0000 7f1d45136700 1 -- 172.21.15.26:0/255951431 learned_addr learned my addr 172.21.15.26:0/255951431 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:58.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.487+0000 7f1d45937700 1 --2- 172.21.15.26:0/255951431 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d40131810 0x7f1d40131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:58.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.488+0000 7f1d45937700 1 -- 172.21.15.26:0/255951431 >> v2:172.21.15.26:3300/0 conn(0x7f1d40099a40 msgr2=0x7f1d40099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:58.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.488+0000 7f1d45937700 1 --2- 172.21.15.26:0/255951431 >> v2:172.21.15.26:3300/0 conn(0x7f1d40099a40 0x7f1d40099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:58.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.488+0000 7f1d45937700 1 -- 172.21.15.26:0/255951431 >> v1:172.21.15.26:6789/0 conn(0x7f1d4009a3b0 legacy=0x7f1d40138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:58.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.488+0000 7f1d45937700 1 -- 172.21.15.26:0/255951431 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4006e8c0 con 0x7f1d40131810 2023-10-01T07:56:58.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.488+0000 7f1d45136700 1 --2- 172.21.15.26:0/255951431 >> v2:172.21.15.26:3300/0 conn(0x7f1d40099a40 0x7f1d40099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:58.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.488+0000 7f1d45937700 1 --2- 172.21.15.26:0/255951431 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d40131810 0x7f1d40131be0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009870 tx=0x7f1d3c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f65fb63631f492e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:58.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.488+0000 7f1d44935700 1 -- 172.21.15.26:0/255951431 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c011830 con 0x7f1d40131810 2023-10-01T07:56:58.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.488+0000 7f1d44935700 1 -- 172.21.15.26:0/255951431 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3c011990 con 0x7f1d40131810 2023-10-01T07:56:58.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.488+0000 7f1d44935700 1 -- 172.21.15.26:0/255951431 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c011d20 con 0x7f1d40131810 2023-10-01T07:56:58.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.489+0000 7f1d47b9b700 1 -- 172.21.15.26:0/255951431 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d40131810 msgr2=0x7f1d40131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:58.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.489+0000 7f1d47b9b700 1 --2- 172.21.15.26:0/255951431 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d40131810 0x7f1d40131be0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009870 tx=0x7f1d3c009b80 comp rx=0 tx=0).stop 2023-10-01T07:56:58.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.489+0000 7f1d47b9b700 1 -- 172.21.15.26:0/255951431 shutdown_connections 2023-10-01T07:56:58.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.489+0000 7f1d47b9b700 1 --2- 172.21.15.26:0/255951431 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d40131810 0x7f1d40131be0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:58.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.489+0000 7f1d47b9b700 1 --2- 172.21.15.26:0/255951431 >> v2:172.21.15.26:3300/0 conn(0x7f1d40099a40 0x7f1d40099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:58.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.489+0000 7f1d47b9b700 1 -- 172.21.15.26:0/255951431 >> 172.21.15.26:0/255951431 conn(0x7f1d400a2aa0 msgr2=0x7f1d400a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:58.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.489+0000 7f1d47b9b700 1 -- 172.21.15.26:0/255951431 shutdown_connections 2023-10-01T07:56:58.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.489+0000 7f1d47b9b700 1 -- 172.21.15.26:0/255951431 wait complete. 2023-10-01T07:56:58.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.490+0000 7f1d47b9b700 1 Processor -- start 2023-10-01T07:56:58.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.490+0000 7f1d47b9b700 1 -- start start 2023-10-01T07:56:58.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.491+0000 7f1d47b9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d40099a40 0x7f1d4011edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:58.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.491+0000 7f1d47b9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1d4009a3b0 0x7f1d4011f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:58.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.491+0000 7f1d47b9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d40131810 0x7f1d4011f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:58.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.491+0000 7f1d47b9b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d40122690 con 0x7f1d40099a40 2023-10-01T07:56:58.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.491+0000 7f1d47b9b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d40122890 con 0x7f1d40131810 2023-10-01T07:56:58.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.491+0000 7f1d47b9b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d40120180 con 0x7f1d4009a3b0 2023-10-01T07:56:58.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.491+0000 7f1d45136700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1d4009a3b0 0x7f1d4011f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:58.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.491+0000 7f1d45136700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1d4009a3b0 0x7f1d4011f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57322/0 (socket says 172.21.15.26:57322) 2023-10-01T07:56:58.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.491+0000 7f1d45136700 1 -- 172.21.15.26:0/3173742623 learned_addr learned my addr 172.21.15.26:0/3173742623 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:58.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.491+0000 7f1d46138700 1 --2- 172.21.15.26:0/3173742623 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d40131810 0x7f1d4011f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:58.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.491+0000 7f1d45937700 1 --2- 172.21.15.26:0/3173742623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d40099a40 0x7f1d4011edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:58.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.491+0000 7f1d45136700 1 -- 172.21.15.26:0/3173742623 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d40131810 msgr2=0x7f1d4011f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:58.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.491+0000 7f1d45136700 1 --2- 172.21.15.26:0/3173742623 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d40131810 0x7f1d4011f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:58.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.491+0000 7f1d45136700 1 -- 172.21.15.26:0/3173742623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d40099a40 msgr2=0x7f1d4011edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:58.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.491+0000 7f1d45136700 1 --2- 172.21.15.26:0/3173742623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d40099a40 0x7f1d4011edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:58.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.491+0000 7f1d45136700 1 -- 172.21.15.26:0/3173742623 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d30009550 con 0x7f1d4009a3b0 2023-10-01T07:56:58.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.491+0000 7f1d46138700 1 --2- 172.21.15.26:0/3173742623 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d40131810 0x7f1d4011f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:58.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.491+0000 7f1d45136700 1 --2- 172.21.15.26:0/3173742623 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1d4009a3b0 0x7f1d4011f2f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1d3000ec10 tx=0x7f1d3000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:58.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.492+0000 7f1d367fc700 1 -- 172.21.15.26:0/3173742623 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3000c850 con 0x7f1d4009a3b0 2023-10-01T07:56:58.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.492+0000 7f1d367fc700 1 -- 172.21.15.26:0/3173742623 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3000c9b0 con 0x7f1d4009a3b0 2023-10-01T07:56:58.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.492+0000 7f1d47b9b700 1 -- 172.21.15.26:0/3173742623 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d3c0094a0 con 0x7f1d4009a3b0 2023-10-01T07:56:58.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.492+0000 7f1d367fc700 1 -- 172.21.15.26:0/3173742623 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3000cd60 con 0x7f1d4009a3b0 2023-10-01T07:56:58.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.492+0000 7f1d47b9b700 1 -- 172.21.15.26:0/3173742623 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d400a1c90 con 0x7f1d4009a3b0 2023-10-01T07:56:58.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.493+0000 7f1d367fc700 1 -- 172.21.15.26:0/3173742623 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1d30013470 con 0x7f1d4009a3b0 2023-10-01T07:56:58.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.493+0000 7f1d367fc700 1 -- 172.21.15.26:0/3173742623 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1d3003fcf0 con 0x7f1d4009a3b0 2023-10-01T07:56:58.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.493+0000 7f1d47b9b700 1 -- 172.21.15.26:0/3173742623 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d40074ea0 con 0x7f1d4009a3b0 2023-10-01T07:56:58.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.498+0000 7f1d367fc700 1 -- 172.21.15.26:0/3173742623 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1d30021080 con 0x7f1d4009a3b0 2023-10-01T07:56:58.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.522+0000 7f1c57c9b700 1 Processor -- start 2023-10-01T07:56:58.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.522+0000 7f1c57c9b700 1 -- start start 2023-10-01T07:56:58.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.523+0000 7f1c57c9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1c500a1510 0x7f1c50138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:58.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.523+0000 7f1c57c9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c50139250 0x7f1c5013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:58.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.523+0000 7f1c57c9b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c5009edd0 con 0x7f1c500a0a30 2023-10-01T07:56:58.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.523+0000 7f1c57c9b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c500a18e0 con 0x7f1c500a1510 2023-10-01T07:56:58.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.523+0000 7f1c57c9b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5009e1f0 con 0x7f1c50139250 2023-10-01T07:56:58.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.523+0000 7f1c55a37700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1c500a0a30 0x7f1c500a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37056/0 (socket says 172.21.15.26:37056) 2023-10-01T07:56:58.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.523+0000 7f1c55a37700 1 -- 172.21.15.26:0/939443303 learned_addr learned my addr 172.21.15.26:0/939443303 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:56:58.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.523+0000 7f1c56238700 1 --2- 172.21.15.26:0/939443303 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c50139250 0x7f1c5013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:58.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.523+0000 7f1c55236700 1 --2- 172.21.15.26:0/939443303 >> v2:172.21.15.26:3300/0 conn(0x7f1c500a1510 0x7f1c50138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:58.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.524+0000 7f1c55236700 1 -- 172.21.15.26:0/939443303 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c50139250 msgr2=0x7f1c5013b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:58.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.524+0000 7f1c55236700 1 --2- 172.21.15.26:0/939443303 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c50139250 0x7f1c5013b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:58.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.524+0000 7f1c55236700 1 -- 172.21.15.26:0/939443303 >> v1:172.21.15.26:6789/0 conn(0x7f1c500a0a30 legacy=0x7f1c500a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:58.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.524+0000 7f1c55236700 1 -- 172.21.15.26:0/939443303 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5009dc50 con 0x7f1c500a1510 2023-10-01T07:56:58.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.524+0000 7f1c54a35700 1 -- 172.21.15.26:0/939443303 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 627022496 0 0) 0x7f1c5009edd0 con 0x7f1c500a0a30 2023-10-01T07:56:58.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.524+0000 7f1c55236700 1 --2- 172.21.15.26:0/939443303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c500a1510 0x7f1c50138d10 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f1c40009840 tx=0x7f1c40009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c2cd34815138b03 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:58.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.524+0000 7f1c54a35700 1 -- 172.21.15.26:0/939443303 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c40011830 con 0x7f1c500a1510 2023-10-01T07:56:58.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.524+0000 7f1c54a35700 1 -- 172.21.15.26:0/939443303 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c40011990 con 0x7f1c500a1510 2023-10-01T07:56:58.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.524+0000 7f1c54a35700 1 -- 172.21.15.26:0/939443303 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c40011d20 con 0x7f1c500a1510 2023-10-01T07:56:58.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.525+0000 7f1c57c9b700 1 -- 172.21.15.26:0/939443303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c500a1510 msgr2=0x7f1c50138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:58.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.525+0000 7f1c57c9b700 1 --2- 172.21.15.26:0/939443303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c500a1510 0x7f1c50138d10 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f1c40009840 tx=0x7f1c40009b50 comp rx=0 tx=0).stop 2023-10-01T07:56:58.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.525+0000 7f1c57c9b700 1 -- 172.21.15.26:0/939443303 shutdown_connections 2023-10-01T07:56:58.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.525+0000 7f1c57c9b700 1 --2- 172.21.15.26:0/939443303 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c50139250 0x7f1c5013b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:58.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.525+0000 7f1c57c9b700 1 --2- 172.21.15.26:0/939443303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c500a1510 0x7f1c50138d10 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:58.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.525+0000 7f1c57c9b700 1 -- 172.21.15.26:0/939443303 >> 172.21.15.26:0/939443303 conn(0x7f1c500a6550 msgr2=0x7f1c500a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:58.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.525+0000 7f1c57c9b700 1 -- 172.21.15.26:0/939443303 shutdown_connections 2023-10-01T07:56:58.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.525+0000 7f1c57c9b700 1 -- 172.21.15.26:0/939443303 wait complete. 2023-10-01T07:56:58.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.526+0000 7f1c57c9b700 1 Processor -- start 2023-10-01T07:56:58.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.526+0000 7f1c57c9b700 1 -- start start 2023-10-01T07:56:58.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.526+0000 7f1c57c9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c500a0a30 0x7f1c50122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:58.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.526+0000 7f1c57c9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c500a1510 0x7f1c50122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:58.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.527+0000 7f1c57c9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c50139250 0x7f1c501232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:58.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.527+0000 7f1c57c9b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c501243e0 con 0x7f1c50139250 2023-10-01T07:56:58.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.527+0000 7f1c57c9b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c50124a40 con 0x7f1c500a1510 2023-10-01T07:56:58.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.527+0000 7f1c57c9b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c501386c0 con 0x7f1c500a0a30 2023-10-01T07:56:58.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.527+0000 7f1c55236700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c500a1510 0x7f1c50122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:58.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.527+0000 7f1c55236700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c500a1510 0x7f1c50122da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42800/0 (socket says 172.21.15.26:42800) 2023-10-01T07:56:58.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.527+0000 7f1c55236700 1 -- 172.21.15.26:0/2916377224 learned_addr learned my addr 172.21.15.26:0/2916377224 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:58.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.527+0000 7f1c56238700 1 --2- 172.21.15.26:0/2916377224 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c50139250 0x7f1c501232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:58.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.527+0000 7f1c55236700 1 -- 172.21.15.26:0/2916377224 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c500a0a30 msgr2=0x7f1c50122860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:58.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.527+0000 7f1c55236700 1 --2- 172.21.15.26:0/2916377224 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c500a0a30 0x7f1c50122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:58.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.527+0000 7f1c55236700 1 -- 172.21.15.26:0/2916377224 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c50139250 msgr2=0x7f1c501232e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:58.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.527+0000 7f1c55236700 1 --2- 172.21.15.26:0/2916377224 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c50139250 0x7f1c501232e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:58.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.527+0000 7f1c55236700 1 -- 172.21.15.26:0/2916377224 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c400094a0 con 0x7f1c500a1510 2023-10-01T07:56:58.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.527+0000 7f1c55236700 1 --2- 172.21.15.26:0/2916377224 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c500a1510 0x7f1c50122da0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1c40009fd0 tx=0x7f1c40004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:58.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.527+0000 7f1c467fc700 1 -- 172.21.15.26:0/2916377224 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c400036a0 con 0x7f1c500a1510 2023-10-01T07:56:58.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.527+0000 7f1c467fc700 1 -- 172.21.15.26:0/2916377224 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4001f070 con 0x7f1c500a1510 2023-10-01T07:56:58.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.527+0000 7f1c57c9b700 1 -- 172.21.15.26:0/2916377224 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c501262f0 con 0x7f1c500a1510 2023-10-01T07:56:58.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.527+0000 7f1c467fc700 1 -- 172.21.15.26:0/2916377224 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c40003a20 con 0x7f1c500a1510 2023-10-01T07:56:58.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.528+0000 7f1c57c9b700 1 -- 172.21.15.26:0/2916377224 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c50124bd0 con 0x7f1c500a1510 2023-10-01T07:56:58.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.529+0000 7f1c33fff700 1 -- 172.21.15.26:0/2916377224 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c50074ea0 con 0x7f1c500a1510 2023-10-01T07:56:58.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.529+0000 7f1c467fc700 1 -- 172.21.15.26:0/2916377224 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1c40003b80 con 0x7f1c500a1510 2023-10-01T07:56:58.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.529+0000 7f1c467fc700 1 -- 172.21.15.26:0/2916377224 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1c40021070 con 0x7f1c500a1510 2023-10-01T07:56:58.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.534+0000 7f1c467fc700 1 -- 172.21.15.26:0/2916377224 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1c40003e30 con 0x7f1c500a1510 2023-10-01T07:56:58.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.633+0000 7f4e51457700 1 -- 172.21.15.26:0/313383529 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4e4c074ea0 con 0x7f4e4c0a1510 2023-10-01T07:56:58.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.633+0000 7f4e337fe700 1 -- 172.21.15.26:0/313383529 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4e40010b70 con 0x7f4e4c0a1510 2023-10-01T07:56:58.634 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:56:58.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.637+0000 7f4e51457700 1 -- 172.21.15.26:0/313383529 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4e4c0a1510 msgr2=0x7f4e4c122d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:58.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.637+0000 7f4e51457700 1 --2- 172.21.15.26:0/313383529 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4e4c0a1510 0x7f4e4c122d00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4e40000c00 tx=0x7f4e40004750 comp rx=0 tx=0).stop 2023-10-01T07:56:58.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.637+0000 7f4e51457700 1 -- 172.21.15.26:0/313383529 shutdown_connections 2023-10-01T07:56:58.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.637+0000 7f4e51457700 1 --2- 172.21.15.26:0/313383529 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e4c139250 0x7f4e4c123240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:58.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.637+0000 7f4e51457700 1 --2- 172.21.15.26:0/313383529 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4e4c0a0a30 0x7f4e4c1227c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:58.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.637+0000 7f4e51457700 1 --2- 172.21.15.26:0/313383529 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4e4c0a1510 0x7f4e4c122d00 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:58.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.637+0000 7f4e51457700 1 -- 172.21.15.26:0/313383529 >> 172.21.15.26:0/313383529 conn(0x7f4e4c0a6550 msgr2=0x7f4e4c0a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:58.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.637+0000 7f4e51457700 1 -- 172.21.15.26:0/313383529 shutdown_connections 2023-10-01T07:56:58.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.637+0000 7f4e51457700 1 -- 172.21.15.26:0/313383529 wait complete. 2023-10-01T07:56:58.656 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:56:58.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.707+0000 7f1d47b9b700 1 -- 172.21.15.26:0/3173742623 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1d40071db0 con 0x7f1d4009a3b0 2023-10-01T07:56:58.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.707+0000 7f1d367fc700 1 -- 172.21.15.26:0/3173742623 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1d30017020 con 0x7f1d4009a3b0 2023-10-01T07:56:58.708 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:56:58.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.709+0000 7f1d47b9b700 1 -- 172.21.15.26:0/3173742623 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1d4009a3b0 msgr2=0x7f1d4011f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:58.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.709+0000 7f1d47b9b700 1 --2- 172.21.15.26:0/3173742623 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1d4009a3b0 0x7f1d4011f2f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1d3000ec10 tx=0x7f1d3000ef20 comp rx=0 tx=0).stop 2023-10-01T07:56:58.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.710+0000 7f1d47b9b700 1 -- 172.21.15.26:0/3173742623 shutdown_connections 2023-10-01T07:56:58.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.710+0000 7f1d47b9b700 1 --2- 172.21.15.26:0/3173742623 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d40131810 0x7f1d4011f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:58.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.710+0000 7f1d47b9b700 1 --2- 172.21.15.26:0/3173742623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d40099a40 0x7f1d4011edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:58.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.710+0000 7f1d47b9b700 1 --2- 172.21.15.26:0/3173742623 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1d4009a3b0 0x7f1d4011f2f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:58.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.710+0000 7f1d47b9b700 1 -- 172.21.15.26:0/3173742623 >> 172.21.15.26:0/3173742623 conn(0x7f1d400a2aa0 msgr2=0x7f1d40130160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:58.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.710+0000 7f1d47b9b700 1 -- 172.21.15.26:0/3173742623 shutdown_connections 2023-10-01T07:56:58.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.710+0000 7f1d47b9b700 1 -- 172.21.15.26:0/3173742623 wait complete. 2023-10-01T07:56:58.724 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:56:58.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.751+0000 7f1c33fff700 1 -- 172.21.15.26:0/2916377224 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1c500a28e0 con 0x7f1c500a1510 2023-10-01T07:56:58.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.752+0000 7f1c467fc700 1 -- 172.21.15.26:0/2916377224 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1c40015070 con 0x7f1c500a1510 2023-10-01T07:56:58.752 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:56:58.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.754+0000 7f1c33fff700 1 -- 172.21.15.26:0/2916377224 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c500a1510 msgr2=0x7f1c50122da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:58.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.754+0000 7f1c33fff700 1 --2- 172.21.15.26:0/2916377224 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c500a1510 0x7f1c50122da0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1c40009fd0 tx=0x7f1c40004750 comp rx=0 tx=0).stop 2023-10-01T07:56:58.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.754+0000 7f1c33fff700 1 -- 172.21.15.26:0/2916377224 shutdown_connections 2023-10-01T07:56:58.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.754+0000 7f1c33fff700 1 --2- 172.21.15.26:0/2916377224 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c50139250 0x7f1c501232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:58.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.754+0000 7f1c33fff700 1 --2- 172.21.15.26:0/2916377224 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c500a0a30 0x7f1c50122860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:58.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.754+0000 7f1c33fff700 1 --2- 172.21.15.26:0/2916377224 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c500a1510 0x7f1c50122da0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:58.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.754+0000 7f1c33fff700 1 -- 172.21.15.26:0/2916377224 >> 172.21.15.26:0/2916377224 conn(0x7f1c500a6550 msgr2=0x7f1c500a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:58.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.754+0000 7f1c33fff700 1 -- 172.21.15.26:0/2916377224 shutdown_connections 2023-10-01T07:56:58.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:58.754+0000 7f1c33fff700 1 -- 172.21.15.26:0/2916377224 wait complete. 2023-10-01T07:56:58.768 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:56:59.188 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:56:59.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.333+0000 7f3f6093d700 1 Processor -- start 2023-10-01T07:56:59.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.333+0000 7f3f6093d700 1 -- start start 2023-10-01T07:56:59.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.334+0000 7f3f6093d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f5c09e930 0x7f3f5c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:59.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.334+0000 7f3f6093d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3f5c09f240 0x7f3f5c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:59.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.334+0000 7f3f6093d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3f5c09f650 0x7f3f5c131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:59.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.334+0000 7f3f6093d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f5c070940 con 0x7f3f5c09f650 2023-10-01T07:56:59.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.334+0000 7f3f6093d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c06fd60 con 0x7f3f5c09f240 2023-10-01T07:56:59.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.334+0000 7f3f6093d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c06fa80 con 0x7f3f5c09e930 2023-10-01T07:56:59.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.334+0000 7f3f5a59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f5c09e930 0x7f3f5c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:59.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.334+0000 7f3f59d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3f5c09f240 0x7f3f5c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:59.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.334+0000 7f3f5ad9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3f5c09f650 0x7f3f5c131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:59.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.334+0000 7f3f59d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3f5c09f240 0x7f3f5c1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42804/0 (socket says 172.21.15.26:42804) 2023-10-01T07:56:59.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.334+0000 7f3f59d9b700 1 -- 172.21.15.26:0/3803378787 learned_addr learned my addr 172.21.15.26:0/3803378787 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:59.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.334+0000 7f3f5ad9d700 1 -- 172.21.15.26:0/3803378787 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f5c09e930 msgr2=0x7f3f5c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:59.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.334+0000 7f3f5ad9d700 1 --2- 172.21.15.26:0/3803378787 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f5c09e930 0x7f3f5c09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:59.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.334+0000 7f3f5ad9d700 1 -- 172.21.15.26:0/3803378787 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3f5c09f240 msgr2=0x7f3f5c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:56:59.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.334+0000 7f3f5ad9d700 1 --2- 172.21.15.26:0/3803378787 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3f5c09f240 0x7f3f5c1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:59.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.334+0000 7f3f5ad9d700 1 -- 172.21.15.26:0/3803378787 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5c09fb60 con 0x7f3f5c09f650 2023-10-01T07:56:59.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.334+0000 7f3f59d9b700 1 --2- 172.21.15.26:0/3803378787 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3f5c09f240 0x7f3f5c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:59.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.334+0000 7f3f5a59c700 1 --2- 172.21.15.26:0/3803378787 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f5c09e930 0x7f3f5c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:59.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.335+0000 7f3f5ad9d700 1 --2- 172.21.15.26:0/3803378787 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f5c09f650 0x7f3f5c131d30 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f3f54009d90 tx=0x7f3f5400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee321c167ee8a3d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:59.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.335+0000 7f3f5959a700 1 -- 172.21.15.26:0/3803378787 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5400e070 con 0x7f3f5c09f650 2023-10-01T07:56:59.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.335+0000 7f3f5959a700 1 -- 172.21.15.26:0/3803378787 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5400bb20 con 0x7f3f5c09f650 2023-10-01T07:56:59.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.335+0000 7f3f5959a700 1 -- 172.21.15.26:0/3803378787 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f54012430 con 0x7f3f5c09f650 2023-10-01T07:56:59.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.335+0000 7f3f6093d700 1 -- 172.21.15.26:0/3803378787 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f5c09f650 msgr2=0x7f3f5c131d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:59.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.335+0000 7f3f6093d700 1 --2- 172.21.15.26:0/3803378787 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f5c09f650 0x7f3f5c131d30 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f3f54009d90 tx=0x7f3f5400b330 comp rx=0 tx=0).stop 2023-10-01T07:56:59.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.336+0000 7f3f6093d700 1 -- 172.21.15.26:0/3803378787 shutdown_connections 2023-10-01T07:56:59.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.336+0000 7f3f6093d700 1 --2- 172.21.15.26:0/3803378787 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f5c09f650 0x7f3f5c131d30 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:59.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.336+0000 7f3f6093d700 1 --2- 172.21.15.26:0/3803378787 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f5c09e930 0x7f3f5c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:59.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.336+0000 7f3f6093d700 1 --2- 172.21.15.26:0/3803378787 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3f5c09f240 0x7f3f5c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:59.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.336+0000 7f3f6093d700 1 -- 172.21.15.26:0/3803378787 >> 172.21.15.26:0/3803378787 conn(0x7f3f5c0a4210 msgr2=0x7f3f5c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:59.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.336+0000 7f3f6093d700 1 -- 172.21.15.26:0/3803378787 shutdown_connections 2023-10-01T07:56:59.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.336+0000 7f3f6093d700 1 -- 172.21.15.26:0/3803378787 wait complete. 2023-10-01T07:56:59.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.337+0000 7f3f6093d700 1 Processor -- start 2023-10-01T07:56:59.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.337+0000 7f3f6093d700 1 -- start start 2023-10-01T07:56:59.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.337+0000 7f3f6093d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f5c09e930 0x7f3f5c1a3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:59.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.337+0000 7f3f6093d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3f5c09f240 0x7f3f5c1a4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:59.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.337+0000 7f3f6093d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f5c09f650 0x7f3f5c1a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:56:59.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.337+0000 7f3f6093d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c1a7830 con 0x7f3f5c09e930 2023-10-01T07:56:59.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.337+0000 7f3f6093d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c1a8070 con 0x7f3f5c09f240 2023-10-01T07:56:59.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.337+0000 7f3f6093d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c1a57a0 con 0x7f3f5c09f650 2023-10-01T07:56:59.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.337+0000 7f3f59d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3f5c09f240 0x7f3f5c1a4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:59.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.337+0000 7f3f5a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f5c09e930 0x7f3f5c1a3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:59.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.337+0000 7f3f5ad9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f5c09f650 0x7f3f5c1a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:56:59.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.337+0000 7f3f59d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3f5c09f240 0x7f3f5c1a4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42808/0 (socket says 172.21.15.26:42808) 2023-10-01T07:56:59.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.337+0000 7f3f5a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f5c09e930 0x7f3f5c1a3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42840/0 (socket says 172.21.15.26:42840) 2023-10-01T07:56:59.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.337+0000 7f3f59d9b700 1 -- 172.21.15.26:0/972093972 learned_addr learned my addr 172.21.15.26:0/972093972 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:56:59.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.338+0000 7f3f5a59c700 1 -- 172.21.15.26:0/972093972 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f5c09f650 msgr2=0x7f3f5c1a46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:59.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.338+0000 7f3f5a59c700 1 --2- 172.21.15.26:0/972093972 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f5c09f650 0x7f3f5c1a46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:59.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.338+0000 7f3f5a59c700 1 -- 172.21.15.26:0/972093972 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3f5c09f240 msgr2=0x7f3f5c1a4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:59.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.338+0000 7f3f5a59c700 1 --2- 172.21.15.26:0/972093972 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3f5c09f240 0x7f3f5c1a4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:59.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.338+0000 7f3f5a59c700 1 -- 172.21.15.26:0/972093972 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4c0094a0 con 0x7f3f5c09e930 2023-10-01T07:56:59.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.338+0000 7f3f59d9b700 1 --2- 172.21.15.26:0/972093972 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3f5c09f240 0x7f3f5c1a4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:56:59.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.338+0000 7f3f5a59c700 1 --2- 172.21.15.26:0/972093972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f5c09e930 0x7f3f5c1a3c30 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c00e9b0 tx=0x7f3f4c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:56:59.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.338+0000 7f3f52ffd700 1 -- 172.21.15.26:0/972093972 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c00ee50 con 0x7f3f5c09e930 2023-10-01T07:56:59.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.338+0000 7f3f52ffd700 1 -- 172.21.15.26:0/972093972 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4c004030 con 0x7f3f5c09e930 2023-10-01T07:56:59.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.338+0000 7f3f6093d700 1 -- 172.21.15.26:0/972093972 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f44009550 con 0x7f3f5c09e930 2023-10-01T07:56:59.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.338+0000 7f3f52ffd700 1 -- 172.21.15.26:0/972093972 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c0043c0 con 0x7f3f5c09e930 2023-10-01T07:56:59.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.338+0000 7f3f6093d700 1 -- 172.21.15.26:0/972093972 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f54009a70 con 0x7f3f5c09e930 2023-10-01T07:56:59.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.339+0000 7f3f52ffd700 1 -- 172.21.15.26:0/972093972 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f4c00c7f0 con 0x7f3f5c09e930 2023-10-01T07:56:59.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.339+0000 7f3f52ffd700 1 -- 172.21.15.26:0/972093972 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3f4c03f850 con 0x7f3f5c09e930 2023-10-01T07:56:59.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.339+0000 7f3f6093d700 1 -- 172.21.15.26:0/972093972 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f5c074ea0 con 0x7f3f5c09e930 2023-10-01T07:56:59.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.344+0000 7f3f52ffd700 1 -- 172.21.15.26:0/972093972 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f4c011db0 con 0x7f3f5c09e930 2023-10-01T07:56:59.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.550+0000 7f3f6093d700 1 -- 172.21.15.26:0/972093972 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3f5c06b250 con 0x7f3f5c09e930 2023-10-01T07:56:59.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.550+0000 7f3f52ffd700 1 -- 172.21.15.26:0/972093972 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f4c02a090 con 0x7f3f5c09e930 2023-10-01T07:56:59.676 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:56:59.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.552+0000 7f3f6093d700 1 -- 172.21.15.26:0/972093972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f5c09e930 msgr2=0x7f3f5c1a3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:56:59.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.552+0000 7f3f6093d700 1 --2- 172.21.15.26:0/972093972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f5c09e930 0x7f3f5c1a3c30 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c00e9b0 tx=0x7f3f4c00ecc0 comp rx=0 tx=0).stop 2023-10-01T07:56:59.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.552+0000 7f3f6093d700 1 -- 172.21.15.26:0/972093972 shutdown_connections 2023-10-01T07:56:59.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.552+0000 7f3f6093d700 1 --2- 172.21.15.26:0/972093972 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f5c09f650 0x7f3f5c1a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:59.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.552+0000 7f3f6093d700 1 --2- 172.21.15.26:0/972093972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f5c09e930 0x7f3f5c1a3c30 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:59.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.552+0000 7f3f6093d700 1 --2- 172.21.15.26:0/972093972 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3f5c09f240 0x7f3f5c1a4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:56:59.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.552+0000 7f3f6093d700 1 -- 172.21.15.26:0/972093972 >> 172.21.15.26:0/972093972 conn(0x7f3f5c0a4210 msgr2=0x7f3f5c1b8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:56:59.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.553+0000 7f3f6093d700 1 -- 172.21.15.26:0/972093972 shutdown_connections 2023-10-01T07:56:59.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:56:59.553+0000 7f3f6093d700 1 -- 172.21.15.26:0/972093972 wait complete. 2023-10-01T07:56:59.887 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:56:59.888 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:56:59.888 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:56:59.889 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:00.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.038+0000 7f705b466700 1 Processor -- start 2023-10-01T07:57:00.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.038+0000 7f705b466700 1 -- start start 2023-10-01T07:57:00.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.039+0000 7f705b466700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f705409e930 0x7f705409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:00.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.039+0000 7f705b466700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f705409f240 0x7f70541317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:00.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.039+0000 7f705b466700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f705409f650 0x7f7054131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:00.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.039+0000 7f705b466700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7054070940 con 0x7f705409e930 2023-10-01T07:57:00.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.039+0000 7f705b466700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705406fd60 con 0x7f705409f240 2023-10-01T07:57:00.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.039+0000 7f705b466700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f705406fa80 con 0x7f705409f650 2023-10-01T07:57:00.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.039+0000 7f7059202700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f705409e930 0x7f705409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:00.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.039+0000 7f7059202700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f705409e930 0x7f705409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42852/0 (socket says 172.21.15.26:42852) 2023-10-01T07:57:00.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.039+0000 7f7059202700 1 -- 172.21.15.26:0/2741102579 learned_addr learned my addr 172.21.15.26:0/2741102579 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:00.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.039+0000 7f7059a03700 1 --2- 172.21.15.26:0/2741102579 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f705409f650 0x7f7054131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:00.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.039+0000 7f7058a01700 1 --2- 172.21.15.26:0/2741102579 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f705409f240 0x7f70541317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:00.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.040+0000 7f7059202700 1 -- 172.21.15.26:0/2741102579 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f705409f650 msgr2=0x7f7054131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:00.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.040+0000 7f7059202700 1 --2- 172.21.15.26:0/2741102579 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f705409f650 0x7f7054131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:00.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.040+0000 7f7059202700 1 -- 172.21.15.26:0/2741102579 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f705409f240 msgr2=0x7f70541317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:00.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.040+0000 7f7059202700 1 --2- 172.21.15.26:0/2741102579 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f705409f240 0x7f70541317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:00.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.040+0000 7f7059202700 1 -- 172.21.15.26:0/2741102579 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705409fb60 con 0x7f705409e930 2023-10-01T07:57:00.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.040+0000 7f7059202700 1 --2- 172.21.15.26:0/2741102579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f705409e930 0x7f705409ed00 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f70500098f0 tx=0x7f7050009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b80dc136bddbc8e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:00.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.040+0000 7f704bfff700 1 -- 172.21.15.26:0/2741102579 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7050010a90 con 0x7f705409e930 2023-10-01T07:57:00.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.040+0000 7f704bfff700 1 -- 172.21.15.26:0/2741102579 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7050010bf0 con 0x7f705409e930 2023-10-01T07:57:00.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.040+0000 7f704bfff700 1 -- 172.21.15.26:0/2741102579 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7050018440 con 0x7f705409e930 2023-10-01T07:57:00.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.041+0000 7f705b466700 1 -- 172.21.15.26:0/2741102579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f705409e930 msgr2=0x7f705409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:00.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.041+0000 7f705b466700 1 --2- 172.21.15.26:0/2741102579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f705409e930 0x7f705409ed00 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f70500098f0 tx=0x7f7050009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:00.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.041+0000 7f705b466700 1 -- 172.21.15.26:0/2741102579 shutdown_connections 2023-10-01T07:57:00.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.041+0000 7f705b466700 1 --2- 172.21.15.26:0/2741102579 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f705409f650 0x7f7054131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:00.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.041+0000 7f705b466700 1 --2- 172.21.15.26:0/2741102579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f705409e930 0x7f705409ed00 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:00.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.041+0000 7f705b466700 1 --2- 172.21.15.26:0/2741102579 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f705409f240 0x7f70541317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:00.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.041+0000 7f705b466700 1 -- 172.21.15.26:0/2741102579 >> 172.21.15.26:0/2741102579 conn(0x7f70540a4210 msgr2=0x7f70540a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:00.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.041+0000 7f705b466700 1 -- 172.21.15.26:0/2741102579 shutdown_connections 2023-10-01T07:57:00.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.041+0000 7f705b466700 1 -- 172.21.15.26:0/2741102579 wait complete. 2023-10-01T07:57:00.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.042+0000 7f705b466700 1 Processor -- start 2023-10-01T07:57:00.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.043+0000 7f705b466700 1 -- start start 2023-10-01T07:57:00.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.043+0000 7f705b466700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f705409e930 0x7f705411d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:00.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.043+0000 7f705b466700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f705409f240 0x7f705411d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:00.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.043+0000 7f705b466700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f705409f650 0x7f705411dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:00.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.043+0000 7f705b466700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7054120e00 con 0x7f705409f650 2023-10-01T07:57:00.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.043+0000 7f705b466700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705411f410 con 0x7f705409f240 2023-10-01T07:57:00.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.043+0000 7f705b466700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70540a2f40 con 0x7f705409e930 2023-10-01T07:57:00.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.043+0000 7f7059202700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f705409e930 0x7f705411d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:00.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.043+0000 7f7059202700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f705409e930 0x7f705411d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57358/0 (socket says 172.21.15.26:57358) 2023-10-01T07:57:00.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.043+0000 7f7059202700 1 -- 172.21.15.26:0/4193877819 learned_addr learned my addr 172.21.15.26:0/4193877819 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:00.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.043+0000 7f7059a03700 1 --2- 172.21.15.26:0/4193877819 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f705409f650 0x7f705411dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:00.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.043+0000 7f7058a01700 1 --2- 172.21.15.26:0/4193877819 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f705409f240 0x7f705411d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:00.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.044+0000 7f7059202700 1 -- 172.21.15.26:0/4193877819 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f705409f240 msgr2=0x7f705411d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:00.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.044+0000 7f7059202700 1 --2- 172.21.15.26:0/4193877819 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f705409f240 0x7f705411d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:00.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.044+0000 7f7059202700 1 -- 172.21.15.26:0/4193877819 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f705409f650 msgr2=0x7f705411dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:00.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.044+0000 7f7059202700 1 --2- 172.21.15.26:0/4193877819 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f705409f650 0x7f705411dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:00.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.044+0000 7f7059202700 1 -- 172.21.15.26:0/4193877819 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7050009550 con 0x7f705409e930 2023-10-01T07:57:00.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.044+0000 7f7059a03700 1 --2- 172.21.15.26:0/4193877819 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f705409f650 0x7f705411dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:00.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.044+0000 7f7059202700 1 --2- 172.21.15.26:0/4193877819 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f705409e930 0x7f705411d280 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7050009c40 tx=0x7f7050004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:00.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.044+0000 7f7049ffb700 1 -- 172.21.15.26:0/4193877819 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7050003ab0 con 0x7f705409e930 2023-10-01T07:57:00.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.044+0000 7f7049ffb700 1 -- 172.21.15.26:0/4193877819 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7050003c30 con 0x7f705409e930 2023-10-01T07:57:00.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.044+0000 7f705b466700 1 -- 172.21.15.26:0/4193877819 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70540a0190 con 0x7f705409e930 2023-10-01T07:57:00.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.044+0000 7f7049ffb700 1 -- 172.21.15.26:0/4193877819 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7050010a10 con 0x7f705409e930 2023-10-01T07:57:00.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.045+0000 7f705b466700 1 -- 172.21.15.26:0/4193877819 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7054120a80 con 0x7f705409e930 2023-10-01T07:57:00.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.045+0000 7f7049ffb700 1 -- 172.21.15.26:0/4193877819 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f705001f070 con 0x7f705409e930 2023-10-01T07:57:00.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.045+0000 7f705b466700 1 -- 172.21.15.26:0/4193877819 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70541206d0 con 0x7f705409e930 2023-10-01T07:57:00.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.046+0000 7f7049ffb700 1 -- 172.21.15.26:0/4193877819 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7050044e70 con 0x7f705409e930 2023-10-01T07:57:00.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.048+0000 7f6b1386f700 1 Processor -- start 2023-10-01T07:57:00.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.049+0000 7f6b1386f700 1 -- start start 2023-10-01T07:57:00.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.049+0000 7f79c2944700 1 Processor -- start 2023-10-01T07:57:00.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.049+0000 7f79c2944700 1 -- start start 2023-10-01T07:57:00.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.050+0000 7f6b1386f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6b0c1316c0 0x7f6b0c131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:00.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.050+0000 7f6b1386f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b0c09d9f0 0x7f6b0c06a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:00.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.050+0000 7f6b1386f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b0c09e130 con 0x7f6b0c06acb0 2023-10-01T07:57:00.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.050+0000 7f6b1386f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b0c1312b0 con 0x7f6b0c1316c0 2023-10-01T07:57:00.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.050+0000 7f6b1386f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0c09f6e0 con 0x7f6b0c09d9f0 2023-10-01T07:57:00.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.050+0000 7f6b10e0a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b0c09d9f0 0x7f6b0c06a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:00.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.050+0000 7f6b10e0a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b0c09d9f0 0x7f6b0c06a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57372/0 (socket says 172.21.15.26:57372) 2023-10-01T07:57:00.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.050+0000 7f6b10e0a700 1 -- 172.21.15.26:0/379288355 learned_addr learned my addr 172.21.15.26:0/379288355 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:00.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.050+0000 7f6b1160b700 1 --2- 172.21.15.26:0/379288355 >> v2:172.21.15.26:3300/0 conn(0x7f6b0c1316c0 0x7f6b0c131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:00.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.050+0000 7f79c2944700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f79bc134630 0x7f79bc136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:00.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.050+0000 7f79c2944700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79bc136f50 0x7f79bc139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:00.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.050+0000 7f79c2944700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79bc09b4f0 con 0x7f79bc131810 2023-10-01T07:57:00.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.050+0000 7f79c2944700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79bc1313c0 con 0x7f79bc134630 2023-10-01T07:57:00.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.050+0000 7f79c2944700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc06e8c0 con 0x7f79bc136f50 2023-10-01T07:57:00.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.050+0000 7f6b10e0a700 1 -- 172.21.15.26:0/379288355 >> v2:172.21.15.26:3300/0 conn(0x7f6b0c1316c0 msgr2=0x7f6b0c131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:00.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.050+0000 7f6b10e0a700 1 --2- 172.21.15.26:0/379288355 >> v2:172.21.15.26:3300/0 conn(0x7f6b0c1316c0 0x7f6b0c131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:00.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.050+0000 7f6b10e0a700 1 -- 172.21.15.26:0/379288355 >> v1:172.21.15.26:6789/0 conn(0x7f6b0c06acb0 legacy=0x7f6b0c138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:00.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.050+0000 7f6b10e0a700 1 -- 172.21.15.26:0/379288355 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b0c09e760 con 0x7f6b0c09d9f0 2023-10-01T07:57:00.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.050+0000 7f79bb7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f79bc134630 0x7f79bc136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:00.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.050+0000 7f79c0ee1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79bc136f50 0x7f79bc139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:00.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.050+0000 7f79bbfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f79bc131810 0x7f79bc131be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37074/0 (socket says 172.21.15.26:37074) 2023-10-01T07:57:00.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.050+0000 7f79bbfff700 1 -- 172.21.15.26:0/4000587036 learned_addr learned my addr 172.21.15.26:0/4000587036 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:00.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.050+0000 7f6b1160b700 1 --2- 172.21.15.26:0/379288355 >> v2:172.21.15.26:3300/0 conn(0x7f6b0c1316c0 0x7f6b0c131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:00.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.051+0000 7f6b10e0a700 1 --2- 172.21.15.26:0/379288355 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b0c09d9f0 0x7f6b0c06a770 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6afc0098f0 tx=0x7f6afc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b0eec7ab5540c6f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:00.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.051+0000 7f79c0ee1700 1 -- 172.21.15.26:0/4000587036 >> v2:172.21.15.26:3300/0 conn(0x7f79bc134630 msgr2=0x7f79bc136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:00.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.051+0000 7f79c0ee1700 1 --2- 172.21.15.26:0/4000587036 >> v2:172.21.15.26:3300/0 conn(0x7f79bc134630 0x7f79bc136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:00.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.051+0000 7f79c0ee1700 1 -- 172.21.15.26:0/4000587036 >> v1:172.21.15.26:6789/0 conn(0x7f79bc131810 legacy=0x7f79bc131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:00.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.051+0000 7f79c0ee1700 1 -- 172.21.15.26:0/4000587036 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79bc071d20 con 0x7f79bc136f50 2023-10-01T07:57:00.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.051+0000 7f6b03fff700 1 -- 172.21.15.26:0/379288355 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc004230 con 0x7f6b0c09d9f0 2023-10-01T07:57:00.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.051+0000 7f6b03fff700 1 -- 172.21.15.26:0/379288355 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6afc004390 con 0x7f6b0c09d9f0 2023-10-01T07:57:00.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.051+0000 7f6b03fff700 1 -- 172.21.15.26:0/379288355 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc0036a0 con 0x7f6b0c09d9f0 2023-10-01T07:57:00.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.051+0000 7f79c0ee1700 1 --2- 172.21.15.26:0/4000587036 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79bc136f50 0x7f79bc139330 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f79b4009d90 tx=0x7f79b400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=485f3ad626a3d4b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:00.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.051+0000 7f79baffd700 1 -- 172.21.15.26:0/4000587036 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b400e070 con 0x7f79bc136f50 2023-10-01T07:57:00.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.051+0000 7f79baffd700 1 -- 172.21.15.26:0/4000587036 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b400bb20 con 0x7f79bc136f50 2023-10-01T07:57:00.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.051+0000 7f79baffd700 1 -- 172.21.15.26:0/4000587036 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b4012430 con 0x7f79bc136f50 2023-10-01T07:57:00.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.051+0000 7f7049ffb700 1 -- 172.21.15.26:0/4193877819 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7050020380 con 0x7f705409e930 2023-10-01T07:57:00.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.052+0000 7f6b1386f700 1 -- 172.21.15.26:0/379288355 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b0c09d9f0 msgr2=0x7f6b0c06a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:00.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.052+0000 7f6b1386f700 1 --2- 172.21.15.26:0/379288355 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b0c09d9f0 0x7f6b0c06a770 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6afc0098f0 tx=0x7f6afc009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:00.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.052+0000 7f6b1386f700 1 -- 172.21.15.26:0/379288355 shutdown_connections 2023-10-01T07:57:00.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.052+0000 7f6b1386f700 1 --2- 172.21.15.26:0/379288355 >> v2:172.21.15.26:3300/0 conn(0x7f6b0c1316c0 0x7f6b0c131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:00.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.052+0000 7f6b1386f700 1 --2- 172.21.15.26:0/379288355 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b0c09d9f0 0x7f6b0c06a770 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:00.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.052+0000 7f6b1386f700 1 -- 172.21.15.26:0/379288355 >> 172.21.15.26:0/379288355 conn(0x7f6b0c066f50 msgr2=0x7f6b0c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:00.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.052+0000 7f6b1386f700 1 -- 172.21.15.26:0/379288355 shutdown_connections 2023-10-01T07:57:00.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.052+0000 7f6b1386f700 1 -- 172.21.15.26:0/379288355 wait complete. 2023-10-01T07:57:00.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.052+0000 7f79c2944700 1 -- 172.21.15.26:0/4000587036 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79bc136f50 msgr2=0x7f79bc139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:00.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.052+0000 7f79c2944700 1 --2- 172.21.15.26:0/4000587036 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79bc136f50 0x7f79bc139330 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f79b4009d90 tx=0x7f79b400b330 comp rx=0 tx=0).stop 2023-10-01T07:57:00.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.052+0000 7f79c2944700 1 -- 172.21.15.26:0/4000587036 shutdown_connections 2023-10-01T07:57:00.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.052+0000 7f79c2944700 1 --2- 172.21.15.26:0/4000587036 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79bc136f50 0x7f79bc139330 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:00.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.052+0000 7f79c2944700 1 --2- 172.21.15.26:0/4000587036 >> v2:172.21.15.26:3300/0 conn(0x7f79bc134630 0x7f79bc136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:00.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.052+0000 7f79c2944700 1 -- 172.21.15.26:0/4000587036 >> 172.21.15.26:0/4000587036 conn(0x7f79bc0a2aa0 msgr2=0x7f79bc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:00.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.052+0000 7f79c2944700 1 -- 172.21.15.26:0/4000587036 shutdown_connections 2023-10-01T07:57:00.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.052+0000 7f79c2944700 1 -- 172.21.15.26:0/4000587036 wait complete. 2023-10-01T07:57:00.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.053+0000 7f6b1386f700 1 Processor -- start 2023-10-01T07:57:00.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.054+0000 7f6b1386f700 1 -- start start 2023-10-01T07:57:00.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.054+0000 7f79c2944700 1 Processor -- start 2023-10-01T07:57:00.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.054+0000 7f79c2944700 1 -- start start 2023-10-01T07:57:00.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.054+0000 7f6b1386f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b0c06acb0 0x7f6b0c11a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:00.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.054+0000 7f6b1386f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b0c09d9f0 0x7f6b0c11aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:00.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.054+0000 7f6b1386f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b0c1316c0 0x7f6b0c11afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:00.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.054+0000 7f6b1386f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0c11df60 con 0x7f6b0c06acb0 2023-10-01T07:57:00.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.054+0000 7f6b1386f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0c12af40 con 0x7f6b0c09d9f0 2023-10-01T07:57:00.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.054+0000 7f6b1386f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0c11c0f0 con 0x7f6b0c1316c0 2023-10-01T07:57:00.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.055+0000 7f6b1160b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b0c06acb0 0x7f6b0c11a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:00.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.055+0000 7f6b1160b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b0c06acb0 0x7f6b0c11a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42898/0 (socket says 172.21.15.26:42898) 2023-10-01T07:57:00.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.055+0000 7f6b1160b700 1 -- 172.21.15.26:0/2423533922 learned_addr learned my addr 172.21.15.26:0/2423533922 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:00.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.055+0000 7f6b10e0a700 1 --2- 172.21.15.26:0/2423533922 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b0c09d9f0 0x7f6b0c11aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:00.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.055+0000 7f79c2944700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79bc131810 0x7f79bc09cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:00.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.055+0000 7f79c2944700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79bc134630 0x7f79bc12ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:00.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.055+0000 7f79c2944700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79bc136f50 0x7f79bc12d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:00.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.055+0000 7f79c2944700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc09e490 con 0x7f79bc134630 2023-10-01T07:57:00.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.055+0000 7f79c2944700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc09d9d0 con 0x7f79bc131810 2023-10-01T07:57:00.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.055+0000 7f79c2944700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc12ebc0 con 0x7f79bc136f50 2023-10-01T07:57:00.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.055+0000 7f79c0ee1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79bc136f50 0x7f79bc12d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:00.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.055+0000 7f79bb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79bc134630 0x7f79bc12ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:00.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.055+0000 7f79c0ee1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79bc136f50 0x7f79bc12d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57386/0 (socket says 172.21.15.26:57386) 2023-10-01T07:57:00.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.055+0000 7f79c0ee1700 1 -- 172.21.15.26:0/36111526 learned_addr learned my addr 172.21.15.26:0/36111526 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:00.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.055+0000 7f6b1160b700 1 -- 172.21.15.26:0/2423533922 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b0c1316c0 msgr2=0x7f6b0c11afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:00.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.055+0000 7f6b1160b700 1 --2- 172.21.15.26:0/2423533922 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b0c1316c0 0x7f6b0c11afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:00.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.055+0000 7f6b1160b700 1 -- 172.21.15.26:0/2423533922 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b0c09d9f0 msgr2=0x7f6b0c11aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:00.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.055+0000 7f6b1160b700 1 --2- 172.21.15.26:0/2423533922 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b0c09d9f0 0x7f6b0c11aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:00.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.055+0000 7f6b1160b700 1 -- 172.21.15.26:0/2423533922 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b080094a0 con 0x7f6b0c06acb0 2023-10-01T07:57:00.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.055+0000 7f6b10e0a700 1 --2- 172.21.15.26:0/2423533922 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b0c09d9f0 0x7f6b0c11aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:00.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.055+0000 7f79bbfff700 1 --2- 172.21.15.26:0/36111526 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79bc131810 0x7f79bc09cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:00.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.056+0000 7f79bb7fe700 1 -- 172.21.15.26:0/36111526 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79bc136f50 msgr2=0x7f79bc12d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:00.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.056+0000 7f79bb7fe700 1 --2- 172.21.15.26:0/36111526 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79bc136f50 0x7f79bc12d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:00.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.056+0000 7f79bb7fe700 1 -- 172.21.15.26:0/36111526 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79bc131810 msgr2=0x7f79bc09cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:00.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.056+0000 7f79bb7fe700 1 --2- 172.21.15.26:0/36111526 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79bc131810 0x7f79bc09cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:00.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.056+0000 7f79bb7fe700 1 -- 172.21.15.26:0/36111526 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b4009a70 con 0x7f79bc134630 2023-10-01T07:57:00.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.056+0000 7f79c0ee1700 1 --2- 172.21.15.26:0/36111526 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79bc136f50 0x7f79bc12d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:00.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.056+0000 7f79bbfff700 1 --2- 172.21.15.26:0/36111526 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79bc131810 0x7f79bc09cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:00.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.056+0000 7f6b1160b700 1 --2- 172.21.15.26:0/2423533922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b0c06acb0 0x7f6b0c11a520 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6b0800ebe0 tx=0x7f6b0800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:00.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.056+0000 7f79bb7fe700 1 --2- 172.21.15.26:0/36111526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79bc134630 0x7f79bc12ce10 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f79b000e8d0 tx=0x7f79b000ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:00.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.056+0000 7f6b01ffb700 1 -- 172.21.15.26:0/2423533922 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b08009800 con 0x7f6b0c06acb0 2023-10-01T07:57:00.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.056+0000 7f6b1386f700 1 -- 172.21.15.26:0/2423533922 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6afc009550 con 0x7f6b0c06acb0 2023-10-01T07:57:00.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.056+0000 7f6b01ffb700 1 -- 172.21.15.26:0/2423533922 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0800c910 con 0x7f6b0c06acb0 2023-10-01T07:57:00.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.056+0000 7f6b01ffb700 1 -- 172.21.15.26:0/2423533922 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0800cc80 con 0x7f6b0c06acb0 2023-10-01T07:57:00.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.056+0000 7f79b8ff9700 1 -- 172.21.15.26:0/36111526 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b0013680 con 0x7f79bc134630 2023-10-01T07:57:00.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.056+0000 7f79b8ff9700 1 -- 172.21.15.26:0/36111526 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b00137e0 con 0x7f79bc134630 2023-10-01T07:57:00.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.056+0000 7f79b8ff9700 1 -- 172.21.15.26:0/36111526 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b0013b50 con 0x7f79bc134630 2023-10-01T07:57:00.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.056+0000 7f6b1386f700 1 -- 172.21.15.26:0/2423533922 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b0c09ead0 con 0x7f6b0c06acb0 2023-10-01T07:57:00.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.058+0000 7f6b01ffb700 1 -- 172.21.15.26:0/2423533922 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6b08013470 con 0x7f6b0c06acb0 2023-10-01T07:57:00.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.056+0000 7f79c2944700 1 -- 172.21.15.26:0/36111526 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79bc136cd0 con 0x7f79bc134630 2023-10-01T07:57:00.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.056+0000 7f79c2944700 1 -- 172.21.15.26:0/36111526 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79bc1376e0 con 0x7f79bc134630 2023-10-01T07:57:00.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.058+0000 7f79c2944700 1 -- 172.21.15.26:0/36111526 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79bc137e30 con 0x7f79bc134630 2023-10-01T07:57:00.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.058+0000 7f79b8ff9700 1 -- 172.21.15.26:0/36111526 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f79b0013cb0 con 0x7f79bc134630 2023-10-01T07:57:00.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.059+0000 7f6b1386f700 1 -- 172.21.15.26:0/2423533922 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b0c12b400 con 0x7f6b0c06acb0 2023-10-01T07:57:00.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.059+0000 7f6b01ffb700 1 -- 172.21.15.26:0/2423533922 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6b0803fc20 con 0x7f6b0c06acb0 2023-10-01T07:57:00.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.061+0000 7f79b8ff9700 1 -- 172.21.15.26:0/36111526 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f79b001ac60 con 0x7f79bc134630 2023-10-01T07:57:00.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.065+0000 7f79b8ff9700 1 -- 172.21.15.26:0/36111526 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f79bc137e30 con 0x7f79bc134630 2023-10-01T07:57:00.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.070+0000 7f6b01ffb700 1 -- 172.21.15.26:0/2423533922 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6b08013720 con 0x7f6b0c06acb0 2023-10-01T07:57:00.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.279+0000 7f6b1386f700 1 -- 172.21.15.26:0/2423533922 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6b0c12b900 con 0x7f6b0c06acb0 2023-10-01T07:57:00.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.280+0000 7f6b01ffb700 1 -- 172.21.15.26:0/2423533922 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6b08017030 con 0x7f6b0c06acb0 2023-10-01T07:57:00.281 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:00.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.282+0000 7f6b1386f700 1 -- 172.21.15.26:0/2423533922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b0c06acb0 msgr2=0x7f6b0c11a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:00.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.282+0000 7f6b1386f700 1 --2- 172.21.15.26:0/2423533922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b0c06acb0 0x7f6b0c11a520 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6b0800ebe0 tx=0x7f6b0800eef0 comp rx=0 tx=0).stop 2023-10-01T07:57:00.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.282+0000 7f6b1386f700 1 -- 172.21.15.26:0/2423533922 shutdown_connections 2023-10-01T07:57:00.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.282+0000 7f6b1386f700 1 --2- 172.21.15.26:0/2423533922 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b0c1316c0 0x7f6b0c11afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:00.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.282+0000 7f6b1386f700 1 --2- 172.21.15.26:0/2423533922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b0c06acb0 0x7f6b0c11a520 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:00.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.282+0000 7f6b1386f700 1 --2- 172.21.15.26:0/2423533922 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b0c09d9f0 0x7f6b0c11aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:00.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.282+0000 7f6b1386f700 1 -- 172.21.15.26:0/2423533922 >> 172.21.15.26:0/2423533922 conn(0x7f6b0c066f50 msgr2=0x7f6b0c0a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:00.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.282+0000 7f6b1386f700 1 -- 172.21.15.26:0/2423533922 shutdown_connections 2023-10-01T07:57:00.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.282+0000 7f6b1386f700 1 -- 172.21.15.26:0/2423533922 wait complete. 2023-10-01T07:57:00.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.283+0000 7f705b466700 1 -- 172.21.15.26:0/4193877819 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f70541215b0 con 0x7f705409e930 2023-10-01T07:57:00.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.284+0000 7f7049ffb700 1 -- 172.21.15.26:0/4193877819 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7050027020 con 0x7f705409e930 2023-10-01T07:57:00.287 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:00.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.286+0000 7f705b466700 1 -- 172.21.15.26:0/4193877819 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f705409e930 msgr2=0x7f705411d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:00.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.286+0000 7f705b466700 1 --2- 172.21.15.26:0/4193877819 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f705409e930 0x7f705411d280 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7050009c40 tx=0x7f7050004750 comp rx=0 tx=0).stop 2023-10-01T07:57:00.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.286+0000 7f705b466700 1 -- 172.21.15.26:0/4193877819 shutdown_connections 2023-10-01T07:57:00.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.286+0000 7f705b466700 1 --2- 172.21.15.26:0/4193877819 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f705409f650 0x7f705411dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:00.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.286+0000 7f705b466700 1 --2- 172.21.15.26:0/4193877819 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f705409e930 0x7f705411d280 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:00.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.286+0000 7f705b466700 1 --2- 172.21.15.26:0/4193877819 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f705409f240 0x7f705411d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:00.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.286+0000 7f705b466700 1 -- 172.21.15.26:0/4193877819 >> 172.21.15.26:0/4193877819 conn(0x7f70540a4210 msgr2=0x7f70541308e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:00.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.286+0000 7f705b466700 1 -- 172.21.15.26:0/4193877819 shutdown_connections 2023-10-01T07:57:00.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.286+0000 7f705b466700 1 -- 172.21.15.26:0/4193877819 wait complete. 2023-10-01T07:57:00.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.297+0000 7f79c2944700 1 -- 172.21.15.26:0/36111526 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f79bc137e30 con 0x7f79bc134630 2023-10-01T07:57:00.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.298+0000 7f79b8ff9700 1 -- 172.21.15.26:0/36111526 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f79bc137e30 con 0x7f79bc134630 2023-10-01T07:57:00.299 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:00.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.300+0000 7f79c2944700 1 -- 172.21.15.26:0/36111526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79bc134630 msgr2=0x7f79bc12ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:00.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.300+0000 7f79c2944700 1 --2- 172.21.15.26:0/36111526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79bc134630 0x7f79bc12ce10 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f79b000e8d0 tx=0x7f79b000ebe0 comp rx=0 tx=0).stop 2023-10-01T07:57:00.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.300+0000 7f79c2944700 1 -- 172.21.15.26:0/36111526 shutdown_connections 2023-10-01T07:57:00.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.300+0000 7f79c2944700 1 --2- 172.21.15.26:0/36111526 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79bc136f50 0x7f79bc12d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:00.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.300+0000 7f79c2944700 1 --2- 172.21.15.26:0/36111526 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79bc131810 0x7f79bc09cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:00.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.300+0000 7f79c2944700 1 --2- 172.21.15.26:0/36111526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79bc134630 0x7f79bc12ce10 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:00.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.300+0000 7f79c2944700 1 -- 172.21.15.26:0/36111526 >> 172.21.15.26:0/36111526 conn(0x7f79bc0a2aa0 msgr2=0x7f79bc135bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:00.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.300+0000 7f79c2944700 1 -- 172.21.15.26:0/36111526 shutdown_connections 2023-10-01T07:57:00.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:00.301+0000 7f79c2944700 1 -- 172.21.15.26:0/36111526 wait complete. 2023-10-01T07:57:00.303 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:00.306 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:00.315 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:00.889 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:01.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.034+0000 7fc12074c700 1 Processor -- start 2023-10-01T07:57:01.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.034+0000 7fc12074c700 1 -- start start 2023-10-01T07:57:01.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.035+0000 7fc12074c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc11809e930 0x7fc11809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:01.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.035+0000 7fc12074c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc11809f240 0x7fc1181317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:01.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.035+0000 7fc12074c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc118070940 con 0x7fc11809f650 2023-10-01T07:57:01.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.035+0000 7fc12074c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc11806fd60 con 0x7fc11809e930 2023-10-01T07:57:01.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.035+0000 7fc12074c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc11806fa80 con 0x7fc11809f240 2023-10-01T07:57:01.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.035+0000 7fc11e4e8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc11809e930 0x7fc11809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:01.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.035+0000 7fc11dce7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc11809f240 0x7fc1181317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:01.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.035+0000 7fc11dce7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc11809f240 0x7fc1181317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57392/0 (socket says 172.21.15.26:57392) 2023-10-01T07:57:01.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.035+0000 7fc11e4e8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc11809e930 0x7fc11809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42912/0 (socket says 172.21.15.26:42912) 2023-10-01T07:57:01.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.035+0000 7fc11dce7700 1 -- 172.21.15.26:0/701183119 learned_addr learned my addr 172.21.15.26:0/701183119 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:01.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.036+0000 7fc11dce7700 1 -- 172.21.15.26:0/701183119 >> v2:172.21.15.26:3300/0 conn(0x7fc11809e930 msgr2=0x7fc11809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:01.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.036+0000 7fc11dce7700 1 --2- 172.21.15.26:0/701183119 >> v2:172.21.15.26:3300/0 conn(0x7fc11809e930 0x7fc11809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.036+0000 7fc11dce7700 1 -- 172.21.15.26:0/701183119 >> v1:172.21.15.26:6789/0 conn(0x7fc11809f650 legacy=0x7fc118131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:01.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.036+0000 7fc11dce7700 1 -- 172.21.15.26:0/701183119 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11809fb60 con 0x7fc11809f240 2023-10-01T07:57:01.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.036+0000 7fc11e4e8700 1 --2- 172.21.15.26:0/701183119 >> v2:172.21.15.26:3300/0 conn(0x7fc11809e930 0x7fc11809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:01.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.036+0000 7fc11dce7700 1 --2- 172.21.15.26:0/701183119 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc11809f240 0x7fc1181317f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc1080098f0 tx=0x7fc108009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b61cbf9b5a5ebd71 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:01.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.036+0000 7fc11d4e6700 1 -- 172.21.15.26:0/701183119 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc108011830 con 0x7fc11809f240 2023-10-01T07:57:01.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.036+0000 7fc11d4e6700 1 -- 172.21.15.26:0/701183119 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc108011990 con 0x7fc11809f240 2023-10-01T07:57:01.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.036+0000 7fc11d4e6700 1 -- 172.21.15.26:0/701183119 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc108011d20 con 0x7fc11809f240 2023-10-01T07:57:01.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.037+0000 7fc12074c700 1 -- 172.21.15.26:0/701183119 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc11809f240 msgr2=0x7fc1181317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:01.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.037+0000 7fc12074c700 1 --2- 172.21.15.26:0/701183119 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc11809f240 0x7fc1181317f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc1080098f0 tx=0x7fc108009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:01.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.037+0000 7fc12074c700 1 -- 172.21.15.26:0/701183119 shutdown_connections 2023-10-01T07:57:01.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.037+0000 7fc12074c700 1 --2- 172.21.15.26:0/701183119 >> v2:172.21.15.26:3300/0 conn(0x7fc11809e930 0x7fc11809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.037+0000 7fc12074c700 1 --2- 172.21.15.26:0/701183119 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc11809f240 0x7fc1181317f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.037+0000 7fc12074c700 1 -- 172.21.15.26:0/701183119 >> 172.21.15.26:0/701183119 conn(0x7fc1180a4210 msgr2=0x7fc1180a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:01.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.037+0000 7fc12074c700 1 -- 172.21.15.26:0/701183119 shutdown_connections 2023-10-01T07:57:01.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.037+0000 7fc12074c700 1 -- 172.21.15.26:0/701183119 wait complete. 2023-10-01T07:57:01.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.038+0000 7fc12074c700 1 Processor -- start 2023-10-01T07:57:01.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.038+0000 7fc12074c700 1 -- start start 2023-10-01T07:57:01.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.038+0000 7fc12074c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc11809e930 0x7fc1181a5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:01.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.038+0000 7fc12074c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc11809f240 0x7fc1181a6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:01.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.038+0000 7fc12074c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc11809f650 0x7fc1181a6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:01.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.038+0000 7fc12074c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1181a71a0 con 0x7fc11809e930 2023-10-01T07:57:01.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.038+0000 7fc12074c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1181a78b0 con 0x7fc11809f240 2023-10-01T07:57:01.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.038+0000 7fc12074c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1181a7ed0 con 0x7fc11809f650 2023-10-01T07:57:01.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.038+0000 7fc11dce7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc11809f240 0x7fc1181a6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:01.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.038+0000 7fc11dce7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc11809f240 0x7fc1181a6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42864/0 (socket says 172.21.15.26:42864) 2023-10-01T07:57:01.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.038+0000 7fc11ece9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc11809f650 0x7fc1181a6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:01.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.038+0000 7fc11dce7700 1 -- 172.21.15.26:0/2085719476 learned_addr learned my addr 172.21.15.26:0/2085719476 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:01.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.038+0000 7fc11e4e8700 1 --2- 172.21.15.26:0/2085719476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc11809e930 0x7fc1181a5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:01.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.039+0000 7fc11dce7700 1 -- 172.21.15.26:0/2085719476 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc11809f650 msgr2=0x7fc1181a6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:01.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.039+0000 7fc11dce7700 1 --2- 172.21.15.26:0/2085719476 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc11809f650 0x7fc1181a6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.039+0000 7fc11dce7700 1 -- 172.21.15.26:0/2085719476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc11809e930 msgr2=0x7fc1181a5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:01.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.039+0000 7fc11dce7700 1 --2- 172.21.15.26:0/2085719476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc11809e930 0x7fc1181a5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.039+0000 7fc11dce7700 1 -- 172.21.15.26:0/2085719476 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1140094a0 con 0x7fc11809f240 2023-10-01T07:57:01.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.039+0000 7fc11dce7700 1 --2- 172.21.15.26:0/2085719476 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc11809f240 0x7fc1181a6230 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc108000c00 tx=0x7fc108004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:01.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.039+0000 7fc10effd700 1 -- 172.21.15.26:0/2085719476 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1080036a0 con 0x7fc11809f240 2023-10-01T07:57:01.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.039+0000 7fc10effd700 1 -- 172.21.15.26:0/2085719476 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc108003800 con 0x7fc11809f240 2023-10-01T07:57:01.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.039+0000 7fc12074c700 1 -- 172.21.15.26:0/2085719476 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc108009550 con 0x7fc11809f240 2023-10-01T07:57:01.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.039+0000 7fc10effd700 1 -- 172.21.15.26:0/2085719476 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc108003bb0 con 0x7fc11809f240 2023-10-01T07:57:01.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.039+0000 7fc12074c700 1 -- 172.21.15.26:0/2085719476 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1180a0190 con 0x7fc11809f240 2023-10-01T07:57:01.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.040+0000 7fc10effd700 1 -- 172.21.15.26:0/2085719476 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc108021070 con 0x7fc11809f240 2023-10-01T07:57:01.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.040+0000 7fc10effd700 1 -- 172.21.15.26:0/2085719476 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc108040cb0 con 0x7fc11809f240 2023-10-01T07:57:01.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.040+0000 7fc12074c700 1 -- 172.21.15.26:0/2085719476 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1181a2b40 con 0x7fc11809f240 2023-10-01T07:57:01.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.045+0000 7fc10effd700 1 -- 172.21.15.26:0/2085719476 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc108029020 con 0x7fc11809f240 2023-10-01T07:57:01.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.252+0000 7fc12074c700 1 -- 172.21.15.26:0/2085719476 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc1180a34f0 con 0x7fc11809f240 2023-10-01T07:57:01.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.253+0000 7fc10effd700 1 -- 172.21.15.26:0/2085719476 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc108015070 con 0x7fc11809f240 2023-10-01T07:57:01.253 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:01.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.255+0000 7fc12074c700 1 -- 172.21.15.26:0/2085719476 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc11809f240 msgr2=0x7fc1181a6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:01.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.255+0000 7fc12074c700 1 --2- 172.21.15.26:0/2085719476 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc11809f240 0x7fc1181a6230 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc108000c00 tx=0x7fc108004750 comp rx=0 tx=0).stop 2023-10-01T07:57:01.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.255+0000 7fc12074c700 1 -- 172.21.15.26:0/2085719476 shutdown_connections 2023-10-01T07:57:01.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.255+0000 7fc12074c700 1 --2- 172.21.15.26:0/2085719476 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc11809f650 0x7fc1181a6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.255+0000 7fc12074c700 1 --2- 172.21.15.26:0/2085719476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc11809e930 0x7fc1181a5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.255+0000 7fc12074c700 1 --2- 172.21.15.26:0/2085719476 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc11809f240 0x7fc1181a6230 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.255+0000 7fc12074c700 1 -- 172.21.15.26:0/2085719476 >> 172.21.15.26:0/2085719476 conn(0x7fc1180a4210 msgr2=0x7fc11809dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:01.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.255+0000 7fc12074c700 1 -- 172.21.15.26:0/2085719476 shutdown_connections 2023-10-01T07:57:01.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.255+0000 7fc12074c700 1 -- 172.21.15.26:0/2085719476 wait complete. 2023-10-01T07:57:01.269 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:01.304 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:01.307 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:01.317 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:01.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.455+0000 7fbdb0d7b700 1 Processor -- start 2023-10-01T07:57:01.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.456+0000 7fbdb0d7b700 1 -- start start 2023-10-01T07:57:01.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.457+0000 7fbdb0d7b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdac1337f0 0x7fbdac138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:01.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.457+0000 7fbdb0d7b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbdac138dc0 0x7fbdac13b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:01.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.457+0000 7fbdb0d7b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdac06b990 con 0x7fbdac133420 2023-10-01T07:57:01.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.457+0000 7fbdb0d7b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdac09b0e0 con 0x7fbdac138dc0 2023-10-01T07:57:01.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.457+0000 7fbdb0d7b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac133c20 con 0x7fbdac1337f0 2023-10-01T07:57:01.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.457+0000 7fbda9d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdac1337f0 0x7fbdac138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:01.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.457+0000 7fbdaa59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbdac133420 0x7fbdac133e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37088/0 (socket says 172.21.15.26:37088) 2023-10-01T07:57:01.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.457+0000 7fbda9d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdac1337f0 0x7fbdac138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57418/0 (socket says 172.21.15.26:57418) 2023-10-01T07:57:01.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.457+0000 7fbdaa59c700 1 -- 172.21.15.26:0/3221656701 learned_addr learned my addr 172.21.15.26:0/3221656701 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:01.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.457+0000 7fbdaad9d700 1 --2- 172.21.15.26:0/3221656701 >> v2:172.21.15.26:3300/0 conn(0x7fbdac138dc0 0x7fbdac13b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:01.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.457+0000 7fbdaad9d700 1 -- 172.21.15.26:0/3221656701 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdac1337f0 msgr2=0x7fbdac138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:01.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.457+0000 7fbdaad9d700 1 --2- 172.21.15.26:0/3221656701 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdac1337f0 0x7fbdac138880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.457+0000 7fbdaad9d700 1 -- 172.21.15.26:0/3221656701 >> v1:172.21.15.26:6789/0 conn(0x7fbdac133420 legacy=0x7fbdac133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:01.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.457+0000 7fbdaad9d700 1 -- 172.21.15.26:0/3221656701 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdac0a0590 con 0x7fbdac138dc0 2023-10-01T07:57:01.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.457+0000 7fbda959a700 1 -- 172.21.15.26:0/3221656701 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 195636802 0 0) 0x7fbdac06b990 con 0x7fbdac133420 2023-10-01T07:57:01.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.457+0000 7fbda9d9b700 1 --2- 172.21.15.26:0/3221656701 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdac1337f0 0x7fbdac138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:01.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.458+0000 7fbdaad9d700 1 --2- 172.21.15.26:0/3221656701 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdac138dc0 0x7fbdac13b1a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fbda4009d90 tx=0x7fbda400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e195ea9aec6bbab server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:01.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.458+0000 7fbda959a700 1 -- 172.21.15.26:0/3221656701 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda400e070 con 0x7fbdac138dc0 2023-10-01T07:57:01.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.458+0000 7fbda959a700 1 -- 172.21.15.26:0/3221656701 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda400bb20 con 0x7fbdac138dc0 2023-10-01T07:57:01.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.458+0000 7fbda959a700 1 -- 172.21.15.26:0/3221656701 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda4012430 con 0x7fbdac138dc0 2023-10-01T07:57:01.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.458+0000 7fbdb0d7b700 1 -- 172.21.15.26:0/3221656701 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdac138dc0 msgr2=0x7fbdac13b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:01.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.458+0000 7fbdb0d7b700 1 --2- 172.21.15.26:0/3221656701 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdac138dc0 0x7fbdac13b1a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fbda4009d90 tx=0x7fbda400b330 comp rx=0 tx=0).stop 2023-10-01T07:57:01.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.459+0000 7fbdb0d7b700 1 -- 172.21.15.26:0/3221656701 shutdown_connections 2023-10-01T07:57:01.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.459+0000 7fbdb0d7b700 1 --2- 172.21.15.26:0/3221656701 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdac138dc0 0x7fbdac13b1a0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.459+0000 7fbdb0d7b700 1 --2- 172.21.15.26:0/3221656701 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdac1337f0 0x7fbdac138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.459+0000 7fbdb0d7b700 1 -- 172.21.15.26:0/3221656701 >> 172.21.15.26:0/3221656701 conn(0x7fbdac0a4210 msgr2=0x7fbdac0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:01.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.459+0000 7fbdb0d7b700 1 -- 172.21.15.26:0/3221656701 shutdown_connections 2023-10-01T07:57:01.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.459+0000 7fbdb0d7b700 1 -- 172.21.15.26:0/3221656701 wait complete. 2023-10-01T07:57:01.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.460+0000 7fbdb0d7b700 1 Processor -- start 2023-10-01T07:57:01.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.460+0000 7fbdb0d7b700 1 -- start start 2023-10-01T07:57:01.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.460+0000 7fbdb0d7b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdac133420 0x7fbdac09c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:01.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.460+0000 7fbdb0d7b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdac1337f0 0x7fbdac09cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:01.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.460+0000 7fbdb0d7b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbdac138dc0 0x7fbdac09d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:01.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.460+0000 7fbdb0d7b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac09e030 con 0x7fbdac133420 2023-10-01T07:57:01.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.460+0000 7fbdb0d7b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac09e2d0 con 0x7fbdac138dc0 2023-10-01T07:57:01.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.460+0000 7fbdb0d7b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac12f380 con 0x7fbdac1337f0 2023-10-01T07:57:01.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.461+0000 7fbda9d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdac1337f0 0x7fbdac09cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:01.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.461+0000 7fbda9d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdac1337f0 0x7fbdac09cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57434/0 (socket says 172.21.15.26:57434) 2023-10-01T07:57:01.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.461+0000 7fbda9d9b700 1 -- 172.21.15.26:0/10392978 learned_addr learned my addr 172.21.15.26:0/10392978 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:01.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.461+0000 7fbdaad9d700 1 --2- 172.21.15.26:0/10392978 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbdac138dc0 0x7fbdac09d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:01.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.461+0000 7fbdaa59c700 1 --2- 172.21.15.26:0/10392978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdac133420 0x7fbdac09c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:01.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.461+0000 7fbda9d9b700 1 -- 172.21.15.26:0/10392978 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbdac138dc0 msgr2=0x7fbdac09d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:01.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.461+0000 7fbda9d9b700 1 --2- 172.21.15.26:0/10392978 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbdac138dc0 0x7fbdac09d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.461+0000 7fbda9d9b700 1 -- 172.21.15.26:0/10392978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdac133420 msgr2=0x7fbdac09c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:01.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.461+0000 7fbda9d9b700 1 --2- 172.21.15.26:0/10392978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdac133420 0x7fbdac09c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.461+0000 7fbda9d9b700 1 -- 172.21.15.26:0/10392978 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda00094a0 con 0x7fbdac1337f0 2023-10-01T07:57:01.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.461+0000 7fbdaa59c700 1 --2- 172.21.15.26:0/10392978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdac133420 0x7fbdac09c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:01.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.461+0000 7fbda9d9b700 1 --2- 172.21.15.26:0/10392978 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdac1337f0 0x7fbdac09cc20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbda000ebe0 tx=0x7fbda000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:01.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.461+0000 7fbd9affd700 1 -- 172.21.15.26:0/10392978 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda000c850 con 0x7fbdac1337f0 2023-10-01T07:57:01.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.462+0000 7fbd9affd700 1 -- 172.21.15.26:0/10392978 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda000c9b0 con 0x7fbdac1337f0 2023-10-01T07:57:01.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.462+0000 7fbdb0d7b700 1 -- 172.21.15.26:0/10392978 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda4009a70 con 0x7fbdac1337f0 2023-10-01T07:57:01.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.462+0000 7fbd9affd700 1 -- 172.21.15.26:0/10392978 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda000cd40 con 0x7fbdac1337f0 2023-10-01T07:57:01.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.462+0000 7fbdb0d7b700 1 -- 172.21.15.26:0/10392978 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdac130d70 con 0x7fbdac1337f0 2023-10-01T07:57:01.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.463+0000 7fbd9affd700 1 -- 172.21.15.26:0/10392978 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbda0013470 con 0x7fbdac1337f0 2023-10-01T07:57:01.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.463+0000 7fbd9affd700 1 -- 172.21.15.26:0/10392978 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbda003f7e0 con 0x7fbdac1337f0 2023-10-01T07:57:01.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.463+0000 7fbdb0d7b700 1 -- 172.21.15.26:0/10392978 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdac074ea0 con 0x7fbdac1337f0 2023-10-01T07:57:01.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.472+0000 7fbd9affd700 1 -- 172.21.15.26:0/10392978 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbda0021080 con 0x7fbdac1337f0 2023-10-01T07:57:01.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.493+0000 7f0dbced5700 1 Processor -- start 2023-10-01T07:57:01.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.493+0000 7f0dbced5700 1 -- start start 2023-10-01T07:57:01.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.494+0000 7f0dbced5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0db809e7e0 0x7f0db809ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:01.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.494+0000 7f0dbced5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0db809fa10 0x7f0db809f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:01.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.494+0000 7f0dbced5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0db81316a0 0x7f0db8131b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:01.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.494+0000 7f0dbced5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db809b610 con 0x7f0db809fa10 2023-10-01T07:57:01.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.494+0000 7f0dbced5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db809f630 con 0x7f0db81316a0 2023-10-01T07:57:01.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.494+0000 7f0dbced5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0db809bbb0 con 0x7f0db809e7e0 2023-10-01T07:57:01.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.494+0000 7f0db659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0db809e7e0 0x7f0db809ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:01.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.494+0000 7f0db659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0db809e7e0 0x7f0db809ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57444/0 (socket says 172.21.15.26:57444) 2023-10-01T07:57:01.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.494+0000 7f0db659c700 1 -- 172.21.15.26:0/2536206268 learned_addr learned my addr 172.21.15.26:0/2536206268 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:01.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.494+0000 7f0db5d9b700 1 --2- 172.21.15.26:0/2536206268 >> v2:172.21.15.26:3300/0 conn(0x7f0db809fa10 0x7f0db809f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:01.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.494+0000 7f0db6d9d700 1 --2- 172.21.15.26:0/2536206268 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0db81316a0 0x7f0db8131b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:01.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.494+0000 7f0db6d9d700 1 -- 172.21.15.26:0/2536206268 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0db809e7e0 msgr2=0x7f0db809ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:01.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.494+0000 7f0db6d9d700 1 --2- 172.21.15.26:0/2536206268 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0db809e7e0 0x7f0db809ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.494+0000 7f0db6d9d700 1 -- 172.21.15.26:0/2536206268 >> v2:172.21.15.26:3300/0 conn(0x7f0db809fa10 msgr2=0x7f0db809f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:01.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.494+0000 7f0db6d9d700 1 --2- 172.21.15.26:0/2536206268 >> v2:172.21.15.26:3300/0 conn(0x7f0db809fa10 0x7f0db809f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.494+0000 7f0db6d9d700 1 -- 172.21.15.26:0/2536206268 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db80a0010 con 0x7f0db81316a0 2023-10-01T07:57:01.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.494+0000 7f0db659c700 1 --2- 172.21.15.26:0/2536206268 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0db809e7e0 0x7f0db809ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:01.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.494+0000 7f0db6d9d700 1 --2- 172.21.15.26:0/2536206268 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0db81316a0 0x7f0db8131b40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0db0009d90 tx=0x7f0db000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a11c48080b1e138 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:01.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.495+0000 7f0db559a700 1 -- 172.21.15.26:0/2536206268 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db000e070 con 0x7f0db81316a0 2023-10-01T07:57:01.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.495+0000 7f0db559a700 1 -- 172.21.15.26:0/2536206268 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db000bb20 con 0x7f0db81316a0 2023-10-01T07:57:01.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.495+0000 7f0db559a700 1 -- 172.21.15.26:0/2536206268 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db0012430 con 0x7f0db81316a0 2023-10-01T07:57:01.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.495+0000 7f0dbced5700 1 -- 172.21.15.26:0/2536206268 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0db81316a0 msgr2=0x7f0db8131b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:01.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.495+0000 7f0dbced5700 1 --2- 172.21.15.26:0/2536206268 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0db81316a0 0x7f0db8131b40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0db0009d90 tx=0x7f0db000b330 comp rx=0 tx=0).stop 2023-10-01T07:57:01.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.495+0000 7f0dbced5700 1 -- 172.21.15.26:0/2536206268 shutdown_connections 2023-10-01T07:57:01.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.495+0000 7f0dbced5700 1 --2- 172.21.15.26:0/2536206268 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0db81316a0 0x7f0db8131b40 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.495+0000 7f0dbced5700 1 --2- 172.21.15.26:0/2536206268 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0db809e7e0 0x7f0db809ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.495+0000 7f0dbced5700 1 --2- 172.21.15.26:0/2536206268 >> v2:172.21.15.26:3300/0 conn(0x7f0db809fa10 0x7f0db809f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.495+0000 7f0dbced5700 1 -- 172.21.15.26:0/2536206268 >> 172.21.15.26:0/2536206268 conn(0x7f0db80a4300 msgr2=0x7f0db80a4700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:01.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.495+0000 7f0dbced5700 1 -- 172.21.15.26:0/2536206268 shutdown_connections 2023-10-01T07:57:01.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.495+0000 7f0dbced5700 1 -- 172.21.15.26:0/2536206268 wait complete. 2023-10-01T07:57:01.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.497+0000 7f0dbced5700 1 Processor -- start 2023-10-01T07:57:01.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.497+0000 7f0dbced5700 1 -- start start 2023-10-01T07:57:01.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.497+0000 7f0dbced5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0db809e7e0 0x7f0db811bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:01.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.497+0000 7f0dbced5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0db809fa10 0x7f0db811c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:01.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.497+0000 7f0dbced5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0db81316a0 0x7f0db811c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:01.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.497+0000 7f0dbced5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db81201b0 con 0x7f0db81316a0 2023-10-01T07:57:01.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.497+0000 7f0dbced5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db811eff0 con 0x7f0db809fa10 2023-10-01T07:57:01.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.497+0000 7f0dbced5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0db80a1f70 con 0x7f0db809e7e0 2023-10-01T07:57:01.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.497+0000 7f0db5d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0db809fa10 0x7f0db811c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:01.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.497+0000 7f0db6d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0db81316a0 0x7f0db811c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:01.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.497+0000 7f0db5d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0db809fa10 0x7f0db811c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42892/0 (socket says 172.21.15.26:42892) 2023-10-01T07:57:01.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.497+0000 7f0db5d9b700 1 -- 172.21.15.26:0/2042521008 learned_addr learned my addr 172.21.15.26:0/2042521008 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:01.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.497+0000 7f0db659c700 1 --2- 172.21.15.26:0/2042521008 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0db809e7e0 0x7f0db811bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:01.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.498+0000 7f0db6d9d700 1 -- 172.21.15.26:0/2042521008 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0db809e7e0 msgr2=0x7f0db811bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:01.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.498+0000 7f0db6d9d700 1 --2- 172.21.15.26:0/2042521008 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0db809e7e0 0x7f0db811bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.498+0000 7f0db6d9d700 1 -- 172.21.15.26:0/2042521008 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0db809fa10 msgr2=0x7f0db811c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:01.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.498+0000 7f0db6d9d700 1 --2- 172.21.15.26:0/2042521008 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0db809fa10 0x7f0db811c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.498+0000 7f0db6d9d700 1 -- 172.21.15.26:0/2042521008 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da8009550 con 0x7f0db81316a0 2023-10-01T07:57:01.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.498+0000 7f0db6d9d700 1 --2- 172.21.15.26:0/2042521008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0db81316a0 0x7f0db811c830 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0db0016000 tx=0x7f0db0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:01.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.498+0000 7f0da6ffd700 1 -- 172.21.15.26:0/2042521008 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db0004800 con 0x7f0db81316a0 2023-10-01T07:57:01.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.498+0000 7f0da6ffd700 1 -- 172.21.15.26:0/2042521008 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db0020070 con 0x7f0db81316a0 2023-10-01T07:57:01.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.498+0000 7f0dbced5700 1 -- 172.21.15.26:0/2042521008 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db0009a70 con 0x7f0db81316a0 2023-10-01T07:57:01.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.498+0000 7f0da6ffd700 1 -- 172.21.15.26:0/2042521008 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db00276c0 con 0x7f0db81316a0 2023-10-01T07:57:01.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.498+0000 7f0dbced5700 1 -- 172.21.15.26:0/2042521008 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db811f510 con 0x7f0db81316a0 2023-10-01T07:57:01.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.500+0000 7f0da6ffd700 1 -- 172.21.15.26:0/2042521008 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0db0012430 con 0x7f0db81316a0 2023-10-01T07:57:01.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.500+0000 7f0dbced5700 1 -- 172.21.15.26:0/2042521008 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db8070f50 con 0x7f0db81316a0 2023-10-01T07:57:01.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.500+0000 7f0da6ffd700 1 -- 172.21.15.26:0/2042521008 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0db0022070 con 0x7f0db81316a0 2023-10-01T07:57:01.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.505+0000 7f0da6ffd700 1 -- 172.21.15.26:0/2042521008 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0db0003e30 con 0x7f0db81316a0 2023-10-01T07:57:01.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.508+0000 7fe2256bc700 1 Processor -- start 2023-10-01T07:57:01.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.509+0000 7fe2256bc700 1 -- start start 2023-10-01T07:57:01.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.509+0000 7fe2256bc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe22009d6f0 0x7fe22009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:01.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.509+0000 7fe2256bc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe22009e000 0x7fe220130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:01.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.509+0000 7fe2256bc700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe22009f130 con 0x7fe22009e410 2023-10-01T07:57:01.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.509+0000 7fe2256bc700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe22009f520 con 0x7fe22009d6f0 2023-10-01T07:57:01.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.509+0000 7fe2256bc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22009e930 con 0x7fe22009e000 2023-10-01T07:57:01.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.510+0000 7fe217fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe22009e000 0x7fe220130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:01.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.510+0000 7fe217fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe22009e000 0x7fe220130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42896/0 (socket says 172.21.15.26:42896) 2023-10-01T07:57:01.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.510+0000 7fe217fff700 1 -- 172.21.15.26:0/1329385553 learned_addr learned my addr 172.21.15.26:0/1329385553 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:01.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.510+0000 7fe21effd700 1 --2- 172.21.15.26:0/1329385553 >> v2:172.21.15.26:3300/0 conn(0x7fe22009d6f0 0x7fe22009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:01.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.510+0000 7fe217fff700 1 -- 172.21.15.26:0/1329385553 >> v2:172.21.15.26:3300/0 conn(0x7fe22009d6f0 msgr2=0x7fe22009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:01.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.510+0000 7fe217fff700 1 --2- 172.21.15.26:0/1329385553 >> v2:172.21.15.26:3300/0 conn(0x7fe22009d6f0 0x7fe22009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.510+0000 7fe217fff700 1 -- 172.21.15.26:0/1329385553 >> v1:172.21.15.26:6789/0 conn(0x7fe22009e410 legacy=0x7fe220130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:01.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.510+0000 7fe217fff700 1 -- 172.21.15.26:0/1329385553 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe22009b2d0 con 0x7fe22009e000 2023-10-01T07:57:01.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.510+0000 7fe217fff700 1 --2- 172.21.15.26:0/1329385553 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe22009e000 0x7fe220130660 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe2080098f0 tx=0x7fe208009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df19cbc930c07a15 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:01.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.510+0000 7fe21e7fc700 1 -- 172.21.15.26:0/1329385553 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe208011830 con 0x7fe22009e000 2023-10-01T07:57:01.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.510+0000 7fe21e7fc700 1 -- 172.21.15.26:0/1329385553 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe208011990 con 0x7fe22009e000 2023-10-01T07:57:01.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.510+0000 7fe21e7fc700 1 -- 172.21.15.26:0/1329385553 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe208011d20 con 0x7fe22009e000 2023-10-01T07:57:01.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.511+0000 7fe2256bc700 1 -- 172.21.15.26:0/1329385553 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe22009e000 msgr2=0x7fe220130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:01.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.511+0000 7fe2256bc700 1 --2- 172.21.15.26:0/1329385553 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe22009e000 0x7fe220130660 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe2080098f0 tx=0x7fe208009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:01.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.511+0000 7fe2256bc700 1 -- 172.21.15.26:0/1329385553 shutdown_connections 2023-10-01T07:57:01.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.511+0000 7fe2256bc700 1 --2- 172.21.15.26:0/1329385553 >> v2:172.21.15.26:3300/0 conn(0x7fe22009d6f0 0x7fe22009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.511+0000 7fe2256bc700 1 --2- 172.21.15.26:0/1329385553 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe22009e000 0x7fe220130660 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.512+0000 7fe2256bc700 1 -- 172.21.15.26:0/1329385553 >> 172.21.15.26:0/1329385553 conn(0x7fe220066f50 msgr2=0x7fe22009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:01.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.512+0000 7fe2256bc700 1 -- 172.21.15.26:0/1329385553 shutdown_connections 2023-10-01T07:57:01.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.512+0000 7fe2256bc700 1 -- 172.21.15.26:0/1329385553 wait complete. 2023-10-01T07:57:01.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.513+0000 7fe2256bc700 1 Processor -- start 2023-10-01T07:57:01.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.513+0000 7fe2256bc700 1 -- start start 2023-10-01T07:57:01.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.514+0000 7fe2256bc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe22009d6f0 0x7fe220131630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:01.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.514+0000 7fe2256bc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe22009e000 0x7fe220131b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:01.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.514+0000 7fe2256bc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe22009e410 0x7fe2201320b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:01.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.514+0000 7fe2256bc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe220134390 con 0x7fe22009e410 2023-10-01T07:57:01.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.514+0000 7fe2256bc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe220133530 con 0x7fe22009d6f0 2023-10-01T07:57:01.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.514+0000 7fe2256bc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe220132de0 con 0x7fe22009e000 2023-10-01T07:57:01.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.514+0000 7fe217fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe22009e000 0x7fe220131b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:01.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.514+0000 7fe217fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe22009e000 0x7fe220131b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57462/0 (socket says 172.21.15.26:57462) 2023-10-01T07:57:01.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.514+0000 7fe217fff700 1 -- 172.21.15.26:0/3355132863 learned_addr learned my addr 172.21.15.26:0/3355132863 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:01.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.514+0000 7fe21f7fe700 1 --2- 172.21.15.26:0/3355132863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe22009e410 0x7fe2201320b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:01.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.514+0000 7fe21effd700 1 --2- 172.21.15.26:0/3355132863 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe22009d6f0 0x7fe220131630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:01.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.514+0000 7fe217fff700 1 -- 172.21.15.26:0/3355132863 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe22009d6f0 msgr2=0x7fe220131630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:01.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.514+0000 7fe217fff700 1 --2- 172.21.15.26:0/3355132863 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe22009d6f0 0x7fe220131630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.514+0000 7fe217fff700 1 -- 172.21.15.26:0/3355132863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe22009e410 msgr2=0x7fe2201320b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:01.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.514+0000 7fe217fff700 1 --2- 172.21.15.26:0/3355132863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe22009e410 0x7fe2201320b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.514+0000 7fe217fff700 1 -- 172.21.15.26:0/3355132863 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe208009550 con 0x7fe22009e000 2023-10-01T07:57:01.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.515+0000 7fe217fff700 1 --2- 172.21.15.26:0/3355132863 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe22009e000 0x7fe220131b70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe208000c00 tx=0x7fe208004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:01.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.515+0000 7fe2177fe700 1 -- 172.21.15.26:0/3355132863 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2080036a0 con 0x7fe22009e000 2023-10-01T07:57:01.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.515+0000 7fe2177fe700 1 -- 172.21.15.26:0/3355132863 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe208003800 con 0x7fe22009e000 2023-10-01T07:57:01.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.515+0000 7fe2177fe700 1 -- 172.21.15.26:0/3355132863 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe208003bb0 con 0x7fe22009e000 2023-10-01T07:57:01.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.515+0000 7fe2256bc700 1 -- 172.21.15.26:0/3355132863 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe22009c700 con 0x7fe22009e000 2023-10-01T07:57:01.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.515+0000 7fe2256bc700 1 -- 172.21.15.26:0/3355132863 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe220134be0 con 0x7fe22009e000 2023-10-01T07:57:01.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.516+0000 7fe2177fe700 1 -- 172.21.15.26:0/3355132863 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe208021070 con 0x7fe22009e000 2023-10-01T07:57:01.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.516+0000 7fe2177fe700 1 -- 172.21.15.26:0/3355132863 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe208040cb0 con 0x7fe22009e000 2023-10-01T07:57:01.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.516+0000 7fe2157fa700 1 -- 172.21.15.26:0/3355132863 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f80052e0 con 0x7fe22009e000 2023-10-01T07:57:01.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.521+0000 7fe2177fe700 1 -- 172.21.15.26:0/3355132863 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe208029020 con 0x7fe22009e000 2023-10-01T07:57:01.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.693+0000 7fbdb0d7b700 1 -- 172.21.15.26:0/10392978 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbdac06b250 con 0x7fbdac1337f0 2023-10-01T07:57:01.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.694+0000 7fbd9affd700 1 -- 172.21.15.26:0/10392978 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbda000cea0 con 0x7fbdac1337f0 2023-10-01T07:57:01.695 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:01.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.696+0000 7fbdb0d7b700 1 -- 172.21.15.26:0/10392978 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdac1337f0 msgr2=0x7fbdac09cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:01.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.696+0000 7fbdb0d7b700 1 --2- 172.21.15.26:0/10392978 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdac1337f0 0x7fbdac09cc20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbda000ebe0 tx=0x7fbda000eef0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.696+0000 7fbdb0d7b700 1 -- 172.21.15.26:0/10392978 shutdown_connections 2023-10-01T07:57:01.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.696+0000 7fbdb0d7b700 1 --2- 172.21.15.26:0/10392978 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbdac138dc0 0x7fbdac09d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.696+0000 7fbdb0d7b700 1 --2- 172.21.15.26:0/10392978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdac133420 0x7fbdac09c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.696+0000 7fbdb0d7b700 1 --2- 172.21.15.26:0/10392978 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdac1337f0 0x7fbdac09cc20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.696+0000 7fbdb0d7b700 1 -- 172.21.15.26:0/10392978 >> 172.21.15.26:0/10392978 conn(0x7fbdac0a4210 msgr2=0x7fbdac0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:01.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.696+0000 7fbdb0d7b700 1 -- 172.21.15.26:0/10392978 shutdown_connections 2023-10-01T07:57:01.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.696+0000 7fbdb0d7b700 1 -- 172.21.15.26:0/10392978 wait complete. 2023-10-01T07:57:01.711 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:01.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.715+0000 7f0dbced5700 1 -- 172.21.15.26:0/2042521008 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0db804f2a0 con 0x7f0db81316a0 2023-10-01T07:57:01.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.715+0000 7f0da6ffd700 1 -- 172.21.15.26:0/2042521008 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0db0025380 con 0x7f0db81316a0 2023-10-01T07:57:01.716 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:01.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.717+0000 7f0dbced5700 1 -- 172.21.15.26:0/2042521008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0db81316a0 msgr2=0x7f0db811c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:01.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.717+0000 7f0dbced5700 1 --2- 172.21.15.26:0/2042521008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0db81316a0 0x7f0db811c830 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0db0016000 tx=0x7f0db0004ad0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.717+0000 7f0dbced5700 1 -- 172.21.15.26:0/2042521008 shutdown_connections 2023-10-01T07:57:01.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.717+0000 7f0dbced5700 1 --2- 172.21.15.26:0/2042521008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0db81316a0 0x7f0db811c830 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.717+0000 7f0dbced5700 1 --2- 172.21.15.26:0/2042521008 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0db809e7e0 0x7f0db811bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.717+0000 7f0dbced5700 1 --2- 172.21.15.26:0/2042521008 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0db809fa10 0x7f0db811c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.717+0000 7f0dbced5700 1 -- 172.21.15.26:0/2042521008 >> 172.21.15.26:0/2042521008 conn(0x7f0db80a4300 msgr2=0x7f0db8130cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:01.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.717+0000 7f0dbced5700 1 -- 172.21.15.26:0/2042521008 shutdown_connections 2023-10-01T07:57:01.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.717+0000 7f0dbced5700 1 -- 172.21.15.26:0/2042521008 wait complete. 2023-10-01T07:57:01.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.728+0000 7fe2157fa700 1 -- 172.21.15.26:0/3355132863 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe1f8005590 con 0x7fe22009e000 2023-10-01T07:57:01.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.729+0000 7fe2177fe700 1 -- 172.21.15.26:0/3355132863 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe208029020 con 0x7fe22009e000 2023-10-01T07:57:01.730 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:01.732 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:01.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.731+0000 7fe2157fa700 1 -- 172.21.15.26:0/3355132863 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe22009e000 msgr2=0x7fe220131b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:01.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.731+0000 7fe2157fa700 1 --2- 172.21.15.26:0/3355132863 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe22009e000 0x7fe220131b70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe208000c00 tx=0x7fe208004750 comp rx=0 tx=0).stop 2023-10-01T07:57:01.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.731+0000 7fe2157fa700 1 -- 172.21.15.26:0/3355132863 shutdown_connections 2023-10-01T07:57:01.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.731+0000 7fe2157fa700 1 --2- 172.21.15.26:0/3355132863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe22009e410 0x7fe2201320b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.731+0000 7fe2157fa700 1 --2- 172.21.15.26:0/3355132863 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe22009d6f0 0x7fe220131630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.731+0000 7fe2157fa700 1 --2- 172.21.15.26:0/3355132863 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe22009e000 0x7fe220131b70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:01.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.731+0000 7fe2157fa700 1 -- 172.21.15.26:0/3355132863 >> 172.21.15.26:0/3355132863 conn(0x7fe220066f50 msgr2=0x7fe2200a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:01.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.731+0000 7fe2157fa700 1 -- 172.21.15.26:0/3355132863 shutdown_connections 2023-10-01T07:57:01.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:01.731+0000 7fe2157fa700 1 -- 172.21.15.26:0/3355132863 wait complete. 2023-10-01T07:57:01.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:02.270 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:02.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.415+0000 7f09b5942700 1 Processor -- start 2023-10-01T07:57:02.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.416+0000 7f09b5942700 1 -- start start 2023-10-01T07:57:02.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.416+0000 7f09b5942700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f09b009e850 0x7f09b009ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:02.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.416+0000 7f09b5942700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f09b009ffb0 0x7f09b009f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:02.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.416+0000 7f09b5942700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b00a06b0 con 0x7f09b0133b80 2023-10-01T07:57:02.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.416+0000 7f09b5942700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b006b920 con 0x7f09b009e850 2023-10-01T07:57:02.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.416+0000 7f09b5942700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09b009aa30 con 0x7f09b009ffb0 2023-10-01T07:57:02.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.416+0000 7f09ae7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f09b009ffb0 0x7f09b009f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:02.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.416+0000 7f09af7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f09b0133b80 0x7f09b0133fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37100/0 (socket says 172.21.15.26:37100) 2023-10-01T07:57:02.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.416+0000 7f09af7fe700 1 -- 172.21.15.26:0/3752188330 learned_addr learned my addr 172.21.15.26:0/3752188330 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:02.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.416+0000 7f09aeffd700 1 --2- 172.21.15.26:0/3752188330 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f09b009e850 0x7f09b009ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:02.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.417+0000 7f09adffb700 1 -- 172.21.15.26:0/3752188330 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2040833444 0 0) 0x7f09b00a06b0 con 0x7f09b0133b80 2023-10-01T07:57:02.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.417+0000 7f09adffb700 1 -- 172.21.15.26:0/3752188330 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09980035b0 con 0x7f09b0133b80 2023-10-01T07:57:02.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.417+0000 7f09aeffd700 1 -- 172.21.15.26:0/3752188330 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f09b009ffb0 msgr2=0x7f09b009f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:02.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.417+0000 7f09aeffd700 1 --2- 172.21.15.26:0/3752188330 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f09b009ffb0 0x7f09b009f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:02.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.417+0000 7f09aeffd700 1 -- 172.21.15.26:0/3752188330 >> v1:172.21.15.26:6789/0 conn(0x7f09b0133b80 legacy=0x7f09b0133fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:02.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.417+0000 7f09aeffd700 1 -- 172.21.15.26:0/3752188330 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b006caa0 con 0x7f09b009e850 2023-10-01T07:57:02.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.417+0000 7f09ae7fc700 1 --2- 172.21.15.26:0/3752188330 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f09b009ffb0 0x7f09b009f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:02.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.417+0000 7f09aeffd700 1 --2- 172.21.15.26:0/3752188330 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f09b009e850 0x7f09b009ec20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f09a0009870 tx=0x7f09a0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72ca0e7993d2199c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:02.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.417+0000 7f09adffb700 1 -- 172.21.15.26:0/3752188330 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a0011830 con 0x7f09b009e850 2023-10-01T07:57:02.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.417+0000 7f09adffb700 1 -- 172.21.15.26:0/3752188330 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a0011990 con 0x7f09b009e850 2023-10-01T07:57:02.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.417+0000 7f09adffb700 1 -- 172.21.15.26:0/3752188330 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a0011d20 con 0x7f09b009e850 2023-10-01T07:57:02.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.418+0000 7f09b5942700 1 -- 172.21.15.26:0/3752188330 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f09b009e850 msgr2=0x7f09b009ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:02.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.418+0000 7f09b5942700 1 --2- 172.21.15.26:0/3752188330 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f09b009e850 0x7f09b009ec20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f09a0009870 tx=0x7f09a0009b80 comp rx=0 tx=0).stop 2023-10-01T07:57:02.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.418+0000 7f09b5942700 1 -- 172.21.15.26:0/3752188330 shutdown_connections 2023-10-01T07:57:02.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.418+0000 7f09b5942700 1 --2- 172.21.15.26:0/3752188330 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f09b009e850 0x7f09b009ec20 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:02.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.418+0000 7f09b5942700 1 --2- 172.21.15.26:0/3752188330 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f09b009ffb0 0x7f09b009f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:02.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.418+0000 7f09b5942700 1 -- 172.21.15.26:0/3752188330 >> 172.21.15.26:0/3752188330 conn(0x7f09b00a3f70 msgr2=0x7f09b00a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:02.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.418+0000 7f09b5942700 1 -- 172.21.15.26:0/3752188330 shutdown_connections 2023-10-01T07:57:02.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.418+0000 7f09b5942700 1 -- 172.21.15.26:0/3752188330 wait complete. 2023-10-01T07:57:02.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.419+0000 7f09b5942700 1 Processor -- start 2023-10-01T07:57:02.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.419+0000 7f09b5942700 1 -- start start 2023-10-01T07:57:02.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.419+0000 7f09b5942700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09b009e850 0x7f09b0120450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:02.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.419+0000 7f09b5942700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f09b009ffb0 0x7f09b0120990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:02.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.419+0000 7f09b5942700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f09b0133b80 0x7f09b0120ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:02.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.419+0000 7f09b5942700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b0123f70 con 0x7f09b009e850 2023-10-01T07:57:02.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.419+0000 7f09b5942700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b0122640 con 0x7f09b0133b80 2023-10-01T07:57:02.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.419+0000 7f09b5942700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09b0123700 con 0x7f09b009ffb0 2023-10-01T07:57:02.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.420+0000 7f09aeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09b009e850 0x7f09b0120450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:02.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.420+0000 7f09ae7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f09b009ffb0 0x7f09b0120990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:02.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.420+0000 7f09aeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09b009e850 0x7f09b0120450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42976/0 (socket says 172.21.15.26:42976) 2023-10-01T07:57:02.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.420+0000 7f09ae7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f09b009ffb0 0x7f09b0120990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57484/0 (socket says 172.21.15.26:57484) 2023-10-01T07:57:02.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.420+0000 7f09aeffd700 1 -- 172.21.15.26:0/961254814 learned_addr learned my addr 172.21.15.26:0/961254814 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:02.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.420+0000 7f09af7fe700 1 --2- 172.21.15.26:0/961254814 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f09b0133b80 0x7f09b0120ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:02.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.420+0000 7f09aeffd700 1 -- 172.21.15.26:0/961254814 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f09b009ffb0 msgr2=0x7f09b0120990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:02.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.420+0000 7f09aeffd700 1 --2- 172.21.15.26:0/961254814 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f09b009ffb0 0x7f09b0120990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:02.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.420+0000 7f09aeffd700 1 -- 172.21.15.26:0/961254814 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f09b0133b80 msgr2=0x7f09b0120ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:02.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.420+0000 7f09aeffd700 1 --2- 172.21.15.26:0/961254814 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f09b0133b80 0x7f09b0120ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:02.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.420+0000 7f09aeffd700 1 -- 172.21.15.26:0/961254814 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a40094a0 con 0x7f09b009e850 2023-10-01T07:57:02.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.420+0000 7f09af7fe700 1 --2- 172.21.15.26:0/961254814 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f09b0133b80 0x7f09b0120ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:02.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.420+0000 7f09ae7fc700 1 --2- 172.21.15.26:0/961254814 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f09b009ffb0 0x7f09b0120990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:02.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.420+0000 7f09aeffd700 1 --2- 172.21.15.26:0/961254814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09b009e850 0x7f09b0120450 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f09a00090b0 tx=0x7f09a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:02.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.420+0000 7f0997fff700 1 -- 172.21.15.26:0/961254814 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a0004450 con 0x7f09b009e850 2023-10-01T07:57:02.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.420+0000 7f0997fff700 1 -- 172.21.15.26:0/961254814 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a001f070 con 0x7f09b009e850 2023-10-01T07:57:02.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.420+0000 7f09b5942700 1 -- 172.21.15.26:0/961254814 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a00094a0 con 0x7f09b009e850 2023-10-01T07:57:02.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.420+0000 7f0997fff700 1 -- 172.21.15.26:0/961254814 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a00038e0 con 0x7f09b009e850 2023-10-01T07:57:02.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.420+0000 7f09b5942700 1 -- 172.21.15.26:0/961254814 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b00a3670 con 0x7f09b009e850 2023-10-01T07:57:02.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.421+0000 7f0997fff700 1 -- 172.21.15.26:0/961254814 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f09a0003a40 con 0x7f09b009e850 2023-10-01T07:57:02.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.421+0000 7f0997fff700 1 -- 172.21.15.26:0/961254814 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f09a0021070 con 0x7f09b009e850 2023-10-01T07:57:02.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.421+0000 7f09b5942700 1 -- 172.21.15.26:0/961254814 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09b009cbf0 con 0x7f09b009e850 2023-10-01T07:57:02.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.426+0000 7f0997fff700 1 -- 172.21.15.26:0/961254814 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f09a002b080 con 0x7f09b009e850 2023-10-01T07:57:02.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.630+0000 7f09b5942700 1 -- 172.21.15.26:0/961254814 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f09b0123af0 con 0x7f09b009e850 2023-10-01T07:57:02.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.631+0000 7f0997fff700 1 -- 172.21.15.26:0/961254814 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f09b0123af0 con 0x7f09b009e850 2023-10-01T07:57:02.631 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:02.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.633+0000 7f09b5942700 1 -- 172.21.15.26:0/961254814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09b009e850 msgr2=0x7f09b0120450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:02.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.633+0000 7f09b5942700 1 --2- 172.21.15.26:0/961254814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09b009e850 0x7f09b0120450 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f09a00090b0 tx=0x7f09a0004750 comp rx=0 tx=0).stop 2023-10-01T07:57:02.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.633+0000 7f09b5942700 1 -- 172.21.15.26:0/961254814 shutdown_connections 2023-10-01T07:57:02.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.633+0000 7f09b5942700 1 --2- 172.21.15.26:0/961254814 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f09b0133b80 0x7f09b0120ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:02.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.633+0000 7f09b5942700 1 --2- 172.21.15.26:0/961254814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09b009e850 0x7f09b0120450 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:02.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.633+0000 7f09b5942700 1 --2- 172.21.15.26:0/961254814 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f09b009ffb0 0x7f09b0120990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:02.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.633+0000 7f09b5942700 1 -- 172.21.15.26:0/961254814 >> 172.21.15.26:0/961254814 conn(0x7f09b00a3f70 msgr2=0x7f09b00a2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:02.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.633+0000 7f09b5942700 1 -- 172.21.15.26:0/961254814 shutdown_connections 2023-10-01T07:57:02.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.633+0000 7f09b5942700 1 -- 172.21.15.26:0/961254814 wait complete. 2023-10-01T07:57:02.647 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:02.712 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:02.733 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:02.746 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:02.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.858+0000 7f1200b82700 1 Processor -- start 2023-10-01T07:57:02.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.858+0000 7f1200b82700 1 -- start start 2023-10-01T07:57:02.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.859+0000 7f1200b82700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f11fc09e930 0x7f11fc09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:02.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.859+0000 7f1200b82700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f11fc09f650 0x7f11fc131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:02.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.859+0000 7f1200b82700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11fc070940 con 0x7f11fc09f240 2023-10-01T07:57:02.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.859+0000 7f1200b82700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11fc06fd60 con 0x7f11fc09f650 2023-10-01T07:57:02.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.859+0000 7f1200b82700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc06fa80 con 0x7f11fc09e930 2023-10-01T07:57:02.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.859+0000 7f11fad9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f11fc09f650 0x7f11fc131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:02.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.859+0000 7f11fa59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f11fc09e930 0x7f11fc09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:02.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.859+0000 7f11fa59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f11fc09e930 0x7f11fc09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42940/0 (socket says 172.21.15.26:42940) 2023-10-01T07:57:02.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.859+0000 7f11fad9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f11fc09f650 0x7f11fc131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42980/0 (socket says 172.21.15.26:42980) 2023-10-01T07:57:02.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.859+0000 7f11fa59c700 1 -- 172.21.15.26:0/2131502550 learned_addr learned my addr 172.21.15.26:0/2131502550 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:02.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.860+0000 7f11fa59c700 1 -- 172.21.15.26:0/2131502550 >> v2:172.21.15.26:3300/0 conn(0x7f11fc09f650 msgr2=0x7f11fc131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:02.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.860+0000 7f11fa59c700 1 --2- 172.21.15.26:0/2131502550 >> v2:172.21.15.26:3300/0 conn(0x7f11fc09f650 0x7f11fc131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:02.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.860+0000 7f11fa59c700 1 -- 172.21.15.26:0/2131502550 >> v1:172.21.15.26:6789/0 conn(0x7f11fc09f240 legacy=0x7f11fc1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:02.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.860+0000 7f11fa59c700 1 -- 172.21.15.26:0/2131502550 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11fc09fb60 con 0x7f11fc09e930 2023-10-01T07:57:02.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.860+0000 7f11fa59c700 1 --2- 172.21.15.26:0/2131502550 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f11fc09e930 0x7f11fc09ed00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f11ec0098f0 tx=0x7f11ec009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d86dc914bdaf8f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:02.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.860+0000 7f11f959a700 1 -- 172.21.15.26:0/2131502550 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ec011830 con 0x7f11fc09e930 2023-10-01T07:57:02.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.860+0000 7f11f959a700 1 -- 172.21.15.26:0/2131502550 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ec011990 con 0x7f11fc09e930 2023-10-01T07:57:02.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.860+0000 7f11f959a700 1 -- 172.21.15.26:0/2131502550 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ec011d20 con 0x7f11fc09e930 2023-10-01T07:57:02.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.861+0000 7f1200b82700 1 -- 172.21.15.26:0/2131502550 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f11fc09e930 msgr2=0x7f11fc09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:02.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.861+0000 7f1200b82700 1 --2- 172.21.15.26:0/2131502550 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f11fc09e930 0x7f11fc09ed00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f11ec0098f0 tx=0x7f11ec009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:02.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.861+0000 7f1200b82700 1 -- 172.21.15.26:0/2131502550 shutdown_connections 2023-10-01T07:57:02.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.861+0000 7f1200b82700 1 --2- 172.21.15.26:0/2131502550 >> v2:172.21.15.26:3300/0 conn(0x7f11fc09f650 0x7f11fc131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:02.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.861+0000 7f1200b82700 1 --2- 172.21.15.26:0/2131502550 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f11fc09e930 0x7f11fc09ed00 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:02.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.861+0000 7f1200b82700 1 -- 172.21.15.26:0/2131502550 >> 172.21.15.26:0/2131502550 conn(0x7f11fc0a4210 msgr2=0x7f11fc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:02.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.861+0000 7f1200b82700 1 -- 172.21.15.26:0/2131502550 shutdown_connections 2023-10-01T07:57:02.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.861+0000 7f1200b82700 1 -- 172.21.15.26:0/2131502550 wait complete. 2023-10-01T07:57:02.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.863+0000 7f1200b82700 1 Processor -- start 2023-10-01T07:57:02.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.863+0000 7f1200b82700 1 -- start start 2023-10-01T07:57:02.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.863+0000 7f1200b82700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f11fc09e930 0x7f11fc1a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:02.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.863+0000 7f1200b82700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11fc09f240 0x7f11fc1a20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:02.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.863+0000 7f1200b82700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f11fc09f650 0x7f11fc1a2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:02.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.863+0000 7f1200b82700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc1a6090 con 0x7f11fc09f240 2023-10-01T07:57:02.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.863+0000 7f1200b82700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc1a56d0 con 0x7f11fc09f650 2023-10-01T07:57:02.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.863+0000 7f1200b82700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc0a3460 con 0x7f11fc09e930 2023-10-01T07:57:02.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.864+0000 7f11fa59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f11fc09e930 0x7f11fc1a1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:02.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.864+0000 7f11fa59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f11fc09e930 0x7f11fc1a1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57494/0 (socket says 172.21.15.26:57494) 2023-10-01T07:57:02.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.864+0000 7f11fa59c700 1 -- 172.21.15.26:0/3164983758 learned_addr learned my addr 172.21.15.26:0/3164983758 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:02.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.864+0000 7f11fad9d700 1 --2- 172.21.15.26:0/3164983758 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f11fc09f650 0x7f11fc1a2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:02.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.864+0000 7f11f9d9b700 1 --2- 172.21.15.26:0/3164983758 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11fc09f240 0x7f11fc1a20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:02.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.864+0000 7f11fad9d700 1 -- 172.21.15.26:0/3164983758 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f11fc09e930 msgr2=0x7f11fc1a1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:02.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.864+0000 7f11fad9d700 1 --2- 172.21.15.26:0/3164983758 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f11fc09e930 0x7f11fc1a1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:02.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.864+0000 7f11fad9d700 1 -- 172.21.15.26:0/3164983758 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11fc09f240 msgr2=0x7f11fc1a20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:02.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.864+0000 7f11fad9d700 1 --2- 172.21.15.26:0/3164983758 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11fc09f240 0x7f11fc1a20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:02.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.864+0000 7f11fad9d700 1 -- 172.21.15.26:0/3164983758 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ec009550 con 0x7f11fc09f650 2023-10-01T07:57:02.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.864+0000 7f11fa59c700 1 --2- 172.21.15.26:0/3164983758 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f11fc09e930 0x7f11fc1a1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:02.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.864+0000 7f11fad9d700 1 --2- 172.21.15.26:0/3164983758 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f11fc09f650 0x7f11fc1a2630 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f11f4012420 tx=0x7f11f4012730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:02.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.864+0000 7f11eaffd700 1 -- 172.21.15.26:0/3164983758 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f400d0d0 con 0x7f11fc09f650 2023-10-01T07:57:02.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.865+0000 7f11eaffd700 1 -- 172.21.15.26:0/3164983758 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f4013040 con 0x7f11fc09f650 2023-10-01T07:57:02.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.865+0000 7f1200b82700 1 -- 172.21.15.26:0/3164983758 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11fc0a0190 con 0x7f11fc09f650 2023-10-01T07:57:02.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.865+0000 7f11eaffd700 1 -- 172.21.15.26:0/3164983758 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f400d470 con 0x7f11fc09f650 2023-10-01T07:57:02.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.865+0000 7f1200b82700 1 -- 172.21.15.26:0/3164983758 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11fc1a37c0 con 0x7f11fc09f650 2023-10-01T07:57:02.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.866+0000 7f11eaffd700 1 -- 172.21.15.26:0/3164983758 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f11f400b740 con 0x7f11fc09f650 2023-10-01T07:57:02.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.866+0000 7f1200b82700 1 -- 172.21.15.26:0/3164983758 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11fc074ea0 con 0x7f11fc09f650 2023-10-01T07:57:02.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.866+0000 7f11eaffd700 1 -- 172.21.15.26:0/3164983758 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f11f4044120 con 0x7f11fc09f650 2023-10-01T07:57:02.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.875+0000 7f11eaffd700 1 -- 172.21.15.26:0/3164983758 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f11f4020b90 con 0x7f11fc09f650 2023-10-01T07:57:02.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.902+0000 7f6e60280700 1 Processor -- start 2023-10-01T07:57:02.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.902+0000 7f6e60280700 1 -- start start 2023-10-01T07:57:02.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.902+0000 7f6e60280700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e580a0a30 0x7f6e580a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:02.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.902+0000 7f6e60280700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e580a1340 0x7f6e58133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:02.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.902+0000 7f6e60280700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e58133fa0 0x7f6e58134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:02.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.902+0000 7f6e60280700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e5809edd0 con 0x7f6e580a0a30 2023-10-01T07:57:02.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.903+0000 7f6e60280700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5809e1f0 con 0x7f6e580a1340 2023-10-01T07:57:02.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.903+0000 7f6e60280700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5809dc50 con 0x7f6e58133fa0 2023-10-01T07:57:02.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.903+0000 7f6e5d81b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e580a1340 0x7f6e58133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:02.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.903+0000 7f6e5d81b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e580a1340 0x7f6e58133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42962/0 (socket says 172.21.15.26:42962) 2023-10-01T07:57:02.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.903+0000 7f6e5d81b700 1 -- 172.21.15.26:0/3121173023 learned_addr learned my addr 172.21.15.26:0/3121173023 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:02.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.903+0000 7f6e5e81d700 1 --2- 172.21.15.26:0/3121173023 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e58133fa0 0x7f6e58134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:02.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.903+0000 7f6e5e01c700 1 --2- 172.21.15.26:0/3121173023 >> v2:172.21.15.26:3300/0 conn(0x7f6e580a0a30 0x7f6e580a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:02.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.903+0000 7f6e5d81b700 1 -- 172.21.15.26:0/3121173023 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e58133fa0 msgr2=0x7f6e58134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:02.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.903+0000 7f6e5d81b700 1 --2- 172.21.15.26:0/3121173023 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e58133fa0 0x7f6e58134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:02.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.903+0000 7f6e5d81b700 1 -- 172.21.15.26:0/3121173023 >> v2:172.21.15.26:3300/0 conn(0x7f6e580a0a30 msgr2=0x7f6e580a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:02.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.903+0000 7f6e5d81b700 1 --2- 172.21.15.26:0/3121173023 >> v2:172.21.15.26:3300/0 conn(0x7f6e580a0a30 0x7f6e580a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:02.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.903+0000 7f6e5d81b700 1 -- 172.21.15.26:0/3121173023 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e580a1fe0 con 0x7f6e580a1340 2023-10-01T07:57:02.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.903+0000 7f6e5d81b700 1 --2- 172.21.15.26:0/3121173023 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e580a1340 0x7f6e58133a60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6e48009920 tx=0x7f6e48009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0aee55291eb4a5d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:02.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.903+0000 7f6e5d01a700 1 -- 172.21.15.26:0/3121173023 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e48011830 con 0x7f6e580a1340 2023-10-01T07:57:02.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.904+0000 7f6e5d01a700 1 -- 172.21.15.26:0/3121173023 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e48011990 con 0x7f6e580a1340 2023-10-01T07:57:02.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.904+0000 7f6e5d01a700 1 -- 172.21.15.26:0/3121173023 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e48011d20 con 0x7f6e580a1340 2023-10-01T07:57:02.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.904+0000 7f6e60280700 1 -- 172.21.15.26:0/3121173023 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e580a1340 msgr2=0x7f6e58133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:02.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.904+0000 7f6e60280700 1 --2- 172.21.15.26:0/3121173023 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e580a1340 0x7f6e58133a60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6e48009920 tx=0x7f6e48009c30 comp rx=0 tx=0).stop 2023-10-01T07:57:02.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.904+0000 7f6e60280700 1 -- 172.21.15.26:0/3121173023 shutdown_connections 2023-10-01T07:57:02.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.904+0000 7f6e60280700 1 --2- 172.21.15.26:0/3121173023 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e58133fa0 0x7f6e58134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:02.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.904+0000 7f6e60280700 1 --2- 172.21.15.26:0/3121173023 >> v2:172.21.15.26:3300/0 conn(0x7f6e580a0a30 0x7f6e580a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:02.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.904+0000 7f6e60280700 1 --2- 172.21.15.26:0/3121173023 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e580a1340 0x7f6e58133a60 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:02.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.904+0000 7f6e60280700 1 -- 172.21.15.26:0/3121173023 >> 172.21.15.26:0/3121173023 conn(0x7f6e580a6550 msgr2=0x7f6e580a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:02.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.904+0000 7f6e60280700 1 -- 172.21.15.26:0/3121173023 shutdown_connections 2023-10-01T07:57:02.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.904+0000 7f6e60280700 1 -- 172.21.15.26:0/3121173023 wait complete. 2023-10-01T07:57:02.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.905+0000 7fc0ccfe5700 1 Processor -- start 2023-10-01T07:57:02.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.905+0000 7fc0ccfe5700 1 -- start start 2023-10-01T07:57:02.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.906+0000 7f6e60280700 1 Processor -- start 2023-10-01T07:57:02.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.906+0000 7fc0ccfe5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc0c809d6f0 0x7fc0c809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:02.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.906+0000 7fc0ccfe5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc0c809e410 0x7fc0c8134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:02.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.906+0000 7f6e60280700 1 -- start start 2023-10-01T07:57:02.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.906+0000 7fc0ccfe5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0c809b120 con 0x7fc0c809e000 2023-10-01T07:57:02.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.906+0000 7fc0ccfe5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0c806b460 con 0x7fc0c809e410 2023-10-01T07:57:02.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.906+0000 7fc0ccfe5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c809a7e0 con 0x7fc0c809d6f0 2023-10-01T07:57:02.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.907+0000 7f6e60280700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e580a0a30 0x7f6e58120160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:02.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.907+0000 7f6e60280700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e580a1340 0x7f6e581206a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:02.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.907+0000 7f6e60280700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e58133fa0 0x7f6e58120be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:02.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.907+0000 7f6e60280700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e58123c80 con 0x7f6e58133fa0 2023-10-01T07:57:02.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.907+0000 7f6e60280700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e580a3630 con 0x7f6e580a1340 2023-10-01T07:57:02.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.907+0000 7f6e60280700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e58123410 con 0x7f6e580a0a30 2023-10-01T07:57:02.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.907+0000 7f6e5d81b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e580a1340 0x7f6e581206a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:02.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.907+0000 7f6e5d81b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e580a1340 0x7f6e581206a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42966/0 (socket says 172.21.15.26:42966) 2023-10-01T07:57:02.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.907+0000 7f6e5d81b700 1 -- 172.21.15.26:0/3394475220 learned_addr learned my addr 172.21.15.26:0/3394475220 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:02.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.907+0000 7fc0c659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc0c809d6f0 0x7fc0c809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:02.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.907+0000 7fc0c659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc0c809d6f0 0x7fc0c809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57522/0 (socket says 172.21.15.26:57522) 2023-10-01T07:57:02.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.907+0000 7fc0c659c700 1 -- 172.21.15.26:0/849101317 learned_addr learned my addr 172.21.15.26:0/849101317 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:02.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.907+0000 7fc0c659c700 1 -- 172.21.15.26:0/849101317 >> v2:172.21.15.26:3300/0 conn(0x7fc0c809e410 msgr2=0x7fc0c8134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:02.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.907+0000 7fc0c659c700 1 --2- 172.21.15.26:0/849101317 >> v2:172.21.15.26:3300/0 conn(0x7fc0c809e410 0x7fc0c8134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:02.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.907+0000 7fc0c659c700 1 -- 172.21.15.26:0/849101317 >> v1:172.21.15.26:6789/0 conn(0x7fc0c809e000 legacy=0x7fc0c81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:02.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.907+0000 7fc0c659c700 1 -- 172.21.15.26:0/849101317 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c809a500 con 0x7fc0c809d6f0 2023-10-01T07:57:02.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.907+0000 7f6e5d81b700 1 -- 172.21.15.26:0/3394475220 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e580a0a30 msgr2=0x7f6e58120160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:02.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.907+0000 7f6e5d81b700 1 --2- 172.21.15.26:0/3394475220 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e580a0a30 0x7f6e58120160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:02.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.907+0000 7f6e5d81b700 1 -- 172.21.15.26:0/3394475220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e58133fa0 msgr2=0x7f6e58120be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:02.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.907+0000 7f6e5d81b700 1 --2- 172.21.15.26:0/3394475220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e58133fa0 0x7f6e58120be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:02.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.907+0000 7f6e5d81b700 1 -- 172.21.15.26:0/3394475220 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e48009550 con 0x7f6e580a1340 2023-10-01T07:57:02.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.907+0000 7fc0c659c700 1 --2- 172.21.15.26:0/849101317 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc0c809d6f0 0x7fc0c809dac0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8009920 tx=0x7fc0b8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3c8620ee21f4b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:02.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.907+0000 7f6e5d81b700 1 --2- 172.21.15.26:0/3394475220 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e580a1340 0x7f6e581206a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6e480098f0 tx=0x7f6e48004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:02.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.908+0000 7f6e4effd700 1 -- 172.21.15.26:0/3394475220 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e48004300 con 0x7f6e580a1340 2023-10-01T07:57:02.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.908+0000 7f6e4effd700 1 -- 172.21.15.26:0/3394475220 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4801f070 con 0x7f6e580a1340 2023-10-01T07:57:02.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.909+0000 7fc0c559a700 1 -- 172.21.15.26:0/849101317 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8004230 con 0x7fc0c809d6f0 2023-10-01T07:57:02.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.909+0000 7fc0c559a700 1 -- 172.21.15.26:0/849101317 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b8004390 con 0x7fc0c809d6f0 2023-10-01T07:57:02.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.909+0000 7fc0c559a700 1 -- 172.21.15.26:0/849101317 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8009e70 con 0x7fc0c809d6f0 2023-10-01T07:57:02.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.908+0000 7f6e4effd700 1 -- 172.21.15.26:0/3394475220 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e480036a0 con 0x7f6e580a1340 2023-10-01T07:57:02.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.908+0000 7f6e60280700 1 -- 172.21.15.26:0/3394475220 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e580a0220 con 0x7f6e580a1340 2023-10-01T07:57:02.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.908+0000 7f6e60280700 1 -- 172.21.15.26:0/3394475220 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e58122fc0 con 0x7f6e580a1340 2023-10-01T07:57:02.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.909+0000 7f6e60280700 1 -- 172.21.15.26:0/3394475220 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e58074ea0 con 0x7f6e580a1340 2023-10-01T07:57:02.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.909+0000 7fc0ccfe5700 1 -- 172.21.15.26:0/849101317 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc0c809d6f0 msgr2=0x7fc0c809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:02.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.909+0000 7fc0ccfe5700 1 --2- 172.21.15.26:0/849101317 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc0c809d6f0 0x7fc0c809dac0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8009920 tx=0x7fc0b8009c30 comp rx=0 tx=0).stop 2023-10-01T07:57:02.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.909+0000 7f6e4effd700 1 -- 172.21.15.26:0/3394475220 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6e48021030 con 0x7f6e580a1340 2023-10-01T07:57:02.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.909+0000 7f6e4effd700 1 -- 172.21.15.26:0/3394475220 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6e48040860 con 0x7f6e580a1340 2023-10-01T07:57:02.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.913+0000 7fc0ccfe5700 1 -- 172.21.15.26:0/849101317 shutdown_connections 2023-10-01T07:57:02.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.913+0000 7fc0ccfe5700 1 --2- 172.21.15.26:0/849101317 >> v2:172.21.15.26:3300/0 conn(0x7fc0c809e410 0x7fc0c8134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:02.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.913+0000 7fc0ccfe5700 1 --2- 172.21.15.26:0/849101317 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc0c809d6f0 0x7fc0c809dac0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:02.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.913+0000 7fc0ccfe5700 1 -- 172.21.15.26:0/849101317 >> 172.21.15.26:0/849101317 conn(0x7fc0c8066f50 msgr2=0x7fc0c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:02.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.913+0000 7fc0ccfe5700 1 -- 172.21.15.26:0/849101317 shutdown_connections 2023-10-01T07:57:02.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.913+0000 7fc0ccfe5700 1 -- 172.21.15.26:0/849101317 wait complete. 2023-10-01T07:57:02.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.914+0000 7fc0ccfe5700 1 Processor -- start 2023-10-01T07:57:02.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.914+0000 7fc0ccfe5700 1 -- start start 2023-10-01T07:57:02.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.914+0000 7f6e4effd700 1 -- 172.21.15.26:0/3394475220 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6e480239c0 con 0x7f6e580a1340 2023-10-01T07:57:02.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.915+0000 7fc0ccfe5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0c809d6f0 0x7fc0c81225f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:02.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.915+0000 7fc0ccfe5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc0c809e000 0x7fc0c8122b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:02.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.915+0000 7fc0ccfe5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0c809e410 0x7fc0c8123070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:02.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.915+0000 7fc0ccfe5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c8123ac0 con 0x7fc0c809d6f0 2023-10-01T07:57:02.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.915+0000 7fc0ccfe5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c8124170 con 0x7fc0c809e410 2023-10-01T07:57:02.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.915+0000 7fc0ccfe5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c809c780 con 0x7fc0c809e000 2023-10-01T07:57:02.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.915+0000 7fc0c659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0c809d6f0 0x7fc0c81225f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:02.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.915+0000 7fc0c659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0c809d6f0 0x7fc0c81225f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43030/0 (socket says 172.21.15.26:43030) 2023-10-01T07:57:02.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.915+0000 7fc0c659c700 1 -- 172.21.15.26:0/3499405216 learned_addr learned my addr 172.21.15.26:0/3499405216 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:02.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.915+0000 7fc0c6d9d700 1 --2- 172.21.15.26:0/3499405216 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0c809e410 0x7fc0c8123070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:02.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.915+0000 7fc0c5d9b700 1 --2- 172.21.15.26:0/3499405216 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc0c809e000 0x7fc0c8122b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:02.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.915+0000 7fc0c659c700 1 -- 172.21.15.26:0/3499405216 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc0c809e000 msgr2=0x7fc0c8122b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:02.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.915+0000 7fc0c659c700 1 --2- 172.21.15.26:0/3499405216 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc0c809e000 0x7fc0c8122b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:02.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.915+0000 7fc0c659c700 1 -- 172.21.15.26:0/3499405216 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0c809e410 msgr2=0x7fc0c8123070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:02.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.915+0000 7fc0c659c700 1 --2- 172.21.15.26:0/3499405216 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0c809e410 0x7fc0c8123070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:02.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.915+0000 7fc0c659c700 1 -- 172.21.15.26:0/3499405216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b8009550 con 0x7fc0c809d6f0 2023-10-01T07:57:02.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.916+0000 7fc0c659c700 1 --2- 172.21.15.26:0/3499405216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0c809d6f0 0x7fc0c81225f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fc0c809a920 tx=0x7fc0b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:02.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.916+0000 7fc0b6ffd700 1 -- 172.21.15.26:0/3499405216 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b800be20 con 0x7fc0c809d6f0 2023-10-01T07:57:02.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.916+0000 7fc0b6ffd700 1 -- 172.21.15.26:0/3499405216 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b80036a0 con 0x7fc0c809d6f0 2023-10-01T07:57:02.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.916+0000 7fc0b6ffd700 1 -- 172.21.15.26:0/3499405216 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8003a30 con 0x7fc0c809d6f0 2023-10-01T07:57:02.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.916+0000 7fc0ccfe5700 1 -- 172.21.15.26:0/3499405216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0c8125e00 con 0x7fc0c809d6f0 2023-10-01T07:57:02.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.916+0000 7fc0ccfe5700 1 -- 172.21.15.26:0/3499405216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0c81334b0 con 0x7fc0c809d6f0 2023-10-01T07:57:02.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.917+0000 7fc0b6ffd700 1 -- 172.21.15.26:0/3499405216 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc0b8022070 con 0x7fc0c809d6f0 2023-10-01T07:57:02.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.917+0000 7fc0ccfe5700 1 -- 172.21.15.26:0/3499405216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0c8074ea0 con 0x7fc0c809d6f0 2023-10-01T07:57:02.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.917+0000 7fc0b6ffd700 1 -- 172.21.15.26:0/3499405216 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc0b8041250 con 0x7fc0c809d6f0 2023-10-01T07:57:02.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:02.926+0000 7fc0b6ffd700 1 -- 172.21.15.26:0/3499405216 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc0b801b450 con 0x7fc0c809d6f0 2023-10-01T07:57:03.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.092+0000 7f1200b82700 1 -- 172.21.15.26:0/3164983758 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f11fc06b250 con 0x7f11fc09f650 2023-10-01T07:57:03.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.092+0000 7f11eaffd700 1 -- 172.21.15.26:0/3164983758 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f11f4020360 con 0x7f11fc09f650 2023-10-01T07:57:03.094 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:03.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.095+0000 7f1200b82700 1 -- 172.21.15.26:0/3164983758 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f11fc09f650 msgr2=0x7f11fc1a2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:03.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.095+0000 7f1200b82700 1 --2- 172.21.15.26:0/3164983758 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f11fc09f650 0x7f11fc1a2630 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f11f4012420 tx=0x7f11f4012730 comp rx=0 tx=0).stop 2023-10-01T07:57:03.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.095+0000 7f1200b82700 1 -- 172.21.15.26:0/3164983758 shutdown_connections 2023-10-01T07:57:03.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.095+0000 7f1200b82700 1 --2- 172.21.15.26:0/3164983758 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f11fc09f650 0x7f11fc1a2630 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:03.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.095+0000 7f1200b82700 1 --2- 172.21.15.26:0/3164983758 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f11fc09e930 0x7f11fc1a1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:03.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.095+0000 7f1200b82700 1 --2- 172.21.15.26:0/3164983758 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11fc09f240 0x7f11fc1a20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:03.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.095+0000 7f1200b82700 1 -- 172.21.15.26:0/3164983758 >> 172.21.15.26:0/3164983758 conn(0x7f11fc0a4210 msgr2=0x7f11fc1b6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:03.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.095+0000 7f1200b82700 1 -- 172.21.15.26:0/3164983758 shutdown_connections 2023-10-01T07:57:03.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.095+0000 7f1200b82700 1 -- 172.21.15.26:0/3164983758 wait complete. 2023-10-01T07:57:03.109 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:03.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.122+0000 7f6e60280700 1 -- 172.21.15.26:0/3394475220 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6e580a28e0 con 0x7f6e580a1340 2023-10-01T07:57:03.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.122+0000 7f6e4effd700 1 -- 172.21.15.26:0/3394475220 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6e48015030 con 0x7f6e580a1340 2023-10-01T07:57:03.123 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:03.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.125+0000 7f6e60280700 1 -- 172.21.15.26:0/3394475220 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e580a1340 msgr2=0x7f6e581206a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:03.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.125+0000 7f6e60280700 1 --2- 172.21.15.26:0/3394475220 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e580a1340 0x7f6e581206a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6e480098f0 tx=0x7f6e48004750 comp rx=0 tx=0).stop 2023-10-01T07:57:03.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.125+0000 7f6e60280700 1 -- 172.21.15.26:0/3394475220 shutdown_connections 2023-10-01T07:57:03.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.125+0000 7f6e60280700 1 --2- 172.21.15.26:0/3394475220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e58133fa0 0x7f6e58120be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:03.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.125+0000 7f6e60280700 1 --2- 172.21.15.26:0/3394475220 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e580a0a30 0x7f6e58120160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:03.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.125+0000 7f6e60280700 1 --2- 172.21.15.26:0/3394475220 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e580a1340 0x7f6e581206a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:03.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.125+0000 7f6e60280700 1 -- 172.21.15.26:0/3394475220 >> 172.21.15.26:0/3394475220 conn(0x7f6e580a6550 msgr2=0x7f6e5809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:03.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.125+0000 7f6e60280700 1 -- 172.21.15.26:0/3394475220 shutdown_connections 2023-10-01T07:57:03.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.125+0000 7f6e60280700 1 -- 172.21.15.26:0/3394475220 wait complete. 2023-10-01T07:57:03.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.134+0000 7fc0ccfe5700 1 -- 172.21.15.26:0/3499405216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc0c8133080 con 0x7fc0c809d6f0 2023-10-01T07:57:03.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.135+0000 7fc0b6ffd700 1 -- 172.21.15.26:0/3499405216 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc0b802a020 con 0x7fc0c809d6f0 2023-10-01T07:57:03.135 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:03.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.137+0000 7fc0ccfe5700 1 -- 172.21.15.26:0/3499405216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0c809d6f0 msgr2=0x7fc0c81225f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:03.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.137+0000 7fc0ccfe5700 1 --2- 172.21.15.26:0/3499405216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0c809d6f0 0x7fc0c81225f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fc0c809a920 tx=0x7fc0b8004750 comp rx=0 tx=0).stop 2023-10-01T07:57:03.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.137+0000 7fc0ccfe5700 1 -- 172.21.15.26:0/3499405216 shutdown_connections 2023-10-01T07:57:03.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.137+0000 7fc0ccfe5700 1 --2- 172.21.15.26:0/3499405216 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0c809e410 0x7fc0c8123070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:03.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.137+0000 7fc0ccfe5700 1 --2- 172.21.15.26:0/3499405216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0c809d6f0 0x7fc0c81225f0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:03.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.137+0000 7fc0ccfe5700 1 --2- 172.21.15.26:0/3499405216 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc0c809e000 0x7fc0c8122b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:03.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.138+0000 7fc0ccfe5700 1 -- 172.21.15.26:0/3499405216 >> 172.21.15.26:0/3499405216 conn(0x7fc0c8066f50 msgr2=0x7fc0c80a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:03.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.138+0000 7fc0ccfe5700 1 -- 172.21.15.26:0/3499405216 shutdown_connections 2023-10-01T07:57:03.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.138+0000 7fc0ccfe5700 1 -- 172.21.15.26:0/3499405216 wait complete. 2023-10-01T07:57:03.140 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:03.152 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:03.649 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:03.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.794+0000 7f089e550700 1 Processor -- start 2023-10-01T07:57:03.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.794+0000 7f089e550700 1 -- start start 2023-10-01T07:57:03.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.794+0000 7f089e550700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f089809d6f0 0x7f089809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:03.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.794+0000 7f089e550700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f089809e000 0x7f08981339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:03.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.795+0000 7f089e550700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f089809e410 0x7f0898133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:03.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.795+0000 7f089e550700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f089806b460 con 0x7f089809e000 2023-10-01T07:57:03.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.795+0000 7f089e550700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f089809b120 con 0x7f089809d6f0 2023-10-01T07:57:03.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.795+0000 7f089e550700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f089809a7e0 con 0x7f089809e410 2023-10-01T07:57:03.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.795+0000 7f08977fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f089809e000 0x7f08981339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:03.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.795+0000 7f089caed700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f089809e410 0x7f0898133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:03.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.795+0000 7f089caed700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f089809e410 0x7f0898133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:43744/0 (socket says 172.21.15.26:43744) 2023-10-01T07:57:03.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.795+0000 7f08977fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f089809e000 0x7f08981339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56916/0 (socket says 172.21.15.26:56916) 2023-10-01T07:57:03.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.795+0000 7f089caed700 1 -- 172.21.15.26:0/1194616690 learned_addr learned my addr 172.21.15.26:0/1194616690 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:03.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.795+0000 7f0897fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f089809d6f0 0x7f089809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:03.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.795+0000 7f08977fe700 1 -- 172.21.15.26:0/1194616690 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f089809e410 msgr2=0x7f0898133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:03.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.795+0000 7f08977fe700 1 --2- 172.21.15.26:0/1194616690 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f089809e410 0x7f0898133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:03.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.795+0000 7f08977fe700 1 -- 172.21.15.26:0/1194616690 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f089809d6f0 msgr2=0x7f089809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:03.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.795+0000 7f08977fe700 1 --2- 172.21.15.26:0/1194616690 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f089809d6f0 0x7f089809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:03.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.795+0000 7f08977fe700 1 -- 172.21.15.26:0/1194616690 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f089809a500 con 0x7f089809e000 2023-10-01T07:57:03.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.795+0000 7f089caed700 1 --2- 172.21.15.26:0/1194616690 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f089809e410 0x7f0898133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:03.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.795+0000 7f0897fff700 1 --2- 172.21.15.26:0/1194616690 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f089809d6f0 0x7f089809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:03.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.795+0000 7f08977fe700 1 --2- 172.21.15.26:0/1194616690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f089809e000 0x7f08981339f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f0888009840 tx=0x7f0888009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad1d886b275aeeb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:03.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.795+0000 7f0896ffd700 1 -- 172.21.15.26:0/1194616690 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0888011830 con 0x7f089809e000 2023-10-01T07:57:03.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.795+0000 7f0896ffd700 1 -- 172.21.15.26:0/1194616690 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0888011990 con 0x7f089809e000 2023-10-01T07:57:03.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.795+0000 7f0896ffd700 1 -- 172.21.15.26:0/1194616690 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0888011d20 con 0x7f089809e000 2023-10-01T07:57:03.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.796+0000 7f089e550700 1 -- 172.21.15.26:0/1194616690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f089809e000 msgr2=0x7f08981339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:03.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.796+0000 7f089e550700 1 --2- 172.21.15.26:0/1194616690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f089809e000 0x7f08981339f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f0888009840 tx=0x7f0888009b50 comp rx=0 tx=0).stop 2023-10-01T07:57:03.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.796+0000 7f089e550700 1 -- 172.21.15.26:0/1194616690 shutdown_connections 2023-10-01T07:57:03.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.796+0000 7f089e550700 1 --2- 172.21.15.26:0/1194616690 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f089809e410 0x7f0898133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:03.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.796+0000 7f089e550700 1 --2- 172.21.15.26:0/1194616690 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f089809d6f0 0x7f089809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:03.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.796+0000 7f089e550700 1 --2- 172.21.15.26:0/1194616690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f089809e000 0x7f08981339f0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:03.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.796+0000 7f089e550700 1 -- 172.21.15.26:0/1194616690 >> 172.21.15.26:0/1194616690 conn(0x7f0898066f50 msgr2=0x7f089809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:03.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.796+0000 7f089e550700 1 -- 172.21.15.26:0/1194616690 shutdown_connections 2023-10-01T07:57:03.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.796+0000 7f089e550700 1 -- 172.21.15.26:0/1194616690 wait complete. 2023-10-01T07:57:03.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.797+0000 7f089e550700 1 Processor -- start 2023-10-01T07:57:03.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.797+0000 7f089e550700 1 -- start start 2023-10-01T07:57:03.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.798+0000 7f089e550700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f089809d6f0 0x7f08981c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:03.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.798+0000 7f089e550700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f089809e000 0x7f08981c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:03.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.798+0000 7f089e550700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f089809e410 0x7f08981c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:03.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.798+0000 7f089e550700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f089809c7a0 con 0x7f089809e000 2023-10-01T07:57:03.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.798+0000 7f089e550700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08981a9520 con 0x7f089809d6f0 2023-10-01T07:57:03.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.798+0000 7f089e550700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08981a9260 con 0x7f089809e410 2023-10-01T07:57:03.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.798+0000 7f0897fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f089809d6f0 0x7f08981c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:03.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.798+0000 7f0897fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f089809d6f0 0x7f08981c84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:39102/0 (socket says 172.21.15.26:39102) 2023-10-01T07:57:03.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.798+0000 7f0897fff700 1 -- 172.21.15.26:0/3608198091 learned_addr learned my addr 172.21.15.26:0/3608198091 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:03.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.798+0000 7f089caed700 1 --2- 172.21.15.26:0/3608198091 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f089809e410 0x7f08981c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:03.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.798+0000 7f08977fe700 1 --2- 172.21.15.26:0/3608198091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f089809e000 0x7f08981c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:03.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.798+0000 7f0897fff700 1 -- 172.21.15.26:0/3608198091 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f089809e410 msgr2=0x7f08981c49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:03.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.798+0000 7f0897fff700 1 --2- 172.21.15.26:0/3608198091 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f089809e410 0x7f08981c49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:03.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.798+0000 7f0897fff700 1 -- 172.21.15.26:0/3608198091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f089809e000 msgr2=0x7f08981c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:03.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.798+0000 7f0897fff700 1 --2- 172.21.15.26:0/3608198091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f089809e000 0x7f08981c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:03.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.798+0000 7f0897fff700 1 -- 172.21.15.26:0/3608198091 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08800094a0 con 0x7f089809d6f0 2023-10-01T07:57:03.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.799+0000 7f0897fff700 1 --2- 172.21.15.26:0/3608198091 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f089809d6f0 0x7f08981c84f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f088000ec10 tx=0x7f088000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:03.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.799+0000 7f0894ff9700 1 -- 172.21.15.26:0/3608198091 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088000c850 con 0x7f089809d6f0 2023-10-01T07:57:03.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.799+0000 7f0894ff9700 1 -- 172.21.15.26:0/3608198091 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088000c9b0 con 0x7f089809d6f0 2023-10-01T07:57:03.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.799+0000 7f089e550700 1 -- 172.21.15.26:0/3608198091 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0890009b30 con 0x7f089809d6f0 2023-10-01T07:57:03.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.799+0000 7f0894ff9700 1 -- 172.21.15.26:0/3608198091 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088000cd20 con 0x7f089809d6f0 2023-10-01T07:57:03.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.799+0000 7f089e550700 1 -- 172.21.15.26:0/3608198091 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08880094a0 con 0x7f089809d6f0 2023-10-01T07:57:03.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.800+0000 7f0894ff9700 1 -- 172.21.15.26:0/3608198091 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0880013470 con 0x7f089809d6f0 2023-10-01T07:57:03.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.800+0000 7f0894ff9700 1 -- 172.21.15.26:0/3608198091 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f088003f810 con 0x7f089809d6f0 2023-10-01T07:57:03.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.800+0000 7f089e550700 1 -- 172.21.15.26:0/3608198091 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0898074ea0 con 0x7f089809d6f0 2023-10-01T07:57:03.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:03.805+0000 7f0894ff9700 1 -- 172.21.15.26:0/3608198091 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0880021020 con 0x7f089809d6f0 2023-10-01T07:57:04.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.011+0000 7f089e550700 1 -- 172.21.15.26:0/3608198091 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f089806c360 con 0x7f089809d6f0 2023-10-01T07:57:04.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.011+0000 7f0894ff9700 1 -- 172.21.15.26:0/3608198091 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0880013720 con 0x7f089809d6f0 2023-10-01T07:57:04.012 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:04.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.014+0000 7f089e550700 1 -- 172.21.15.26:0/3608198091 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f089809d6f0 msgr2=0x7f08981c84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:04.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.014+0000 7f089e550700 1 --2- 172.21.15.26:0/3608198091 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f089809d6f0 0x7f08981c84f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f088000ec10 tx=0x7f088000ef20 comp rx=0 tx=0).stop 2023-10-01T07:57:04.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.014+0000 7f089e550700 1 -- 172.21.15.26:0/3608198091 shutdown_connections 2023-10-01T07:57:04.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.014+0000 7f089e550700 1 --2- 172.21.15.26:0/3608198091 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f089809e410 0x7f08981c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:04.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.014+0000 7f089e550700 1 --2- 172.21.15.26:0/3608198091 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f089809d6f0 0x7f08981c84f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:04.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.014+0000 7f089e550700 1 --2- 172.21.15.26:0/3608198091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f089809e000 0x7f08981c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:04.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.014+0000 7f089e550700 1 -- 172.21.15.26:0/3608198091 >> 172.21.15.26:0/3608198091 conn(0x7f0898066f50 msgr2=0x7f08981bac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:04.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.014+0000 7f089e550700 1 -- 172.21.15.26:0/3608198091 shutdown_connections 2023-10-01T07:57:04.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.014+0000 7f089e550700 1 -- 172.21.15.26:0/3608198091 wait complete. 2023-10-01T07:57:04.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:04.110 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:04.140 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:04.152 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:04.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.258+0000 7f2fd7c22700 1 Processor -- start 2023-10-01T07:57:04.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.258+0000 7f2fd7c22700 1 -- start start 2023-10-01T07:57:04.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.259+0000 7f2fd7c22700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2fd00a1510 0x7f2fd0138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:04.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.259+0000 7f2fd7c22700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2fd0139250 0x7f2fd013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:04.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.259+0000 7f2fd7c22700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd009edd0 con 0x7f2fd00a0a30 2023-10-01T07:57:04.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.259+0000 7f2fd7c22700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd00a18e0 con 0x7f2fd00a1510 2023-10-01T07:57:04.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.259+0000 7f2fd7c22700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd009e1f0 con 0x7f2fd0139250 2023-10-01T07:57:04.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.259+0000 7f2fd51bd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2fd00a1510 0x7f2fd0138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:04.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.259+0000 7f2fd51bd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2fd00a1510 0x7f2fd0138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56928/0 (socket says 172.21.15.26:56928) 2023-10-01T07:57:04.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.259+0000 7f2fd51bd700 1 -- 172.21.15.26:0/1855463149 learned_addr learned my addr 172.21.15.26:0/1855463149 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:04.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.259+0000 7f2fd61bf700 1 --2- 172.21.15.26:0/1855463149 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2fd0139250 0x7f2fd013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:04.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.259+0000 7f2fd51bd700 1 -- 172.21.15.26:0/1855463149 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2fd0139250 msgr2=0x7f2fd013b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:04.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.259+0000 7f2fd51bd700 1 --2- 172.21.15.26:0/1855463149 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2fd0139250 0x7f2fd013b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:04.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.259+0000 7f2fd51bd700 1 -- 172.21.15.26:0/1855463149 >> v1:172.21.15.26:6789/0 conn(0x7f2fd00a0a30 legacy=0x7f2fd00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:04.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.259+0000 7f2fd51bd700 1 -- 172.21.15.26:0/1855463149 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd009dc50 con 0x7f2fd00a1510 2023-10-01T07:57:04.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.259+0000 7f2fd61bf700 1 --2- 172.21.15.26:0/1855463149 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2fd0139250 0x7f2fd013b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:04.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.260+0000 7f2fd51bd700 1 --2- 172.21.15.26:0/1855463149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fd00a1510 0x7f2fd0138d10 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f2fc00098f0 tx=0x7f2fc0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a5b2f88e7af8759 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:04.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.260+0000 7f2fd49bc700 1 -- 172.21.15.26:0/1855463149 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0011830 con 0x7f2fd00a1510 2023-10-01T07:57:04.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.260+0000 7f2fd49bc700 1 -- 172.21.15.26:0/1855463149 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc0011990 con 0x7f2fd00a1510 2023-10-01T07:57:04.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.260+0000 7f2fd49bc700 1 -- 172.21.15.26:0/1855463149 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0011d20 con 0x7f2fd00a1510 2023-10-01T07:57:04.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.261+0000 7f2fd7c22700 1 -- 172.21.15.26:0/1855463149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fd00a1510 msgr2=0x7f2fd0138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:04.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.261+0000 7f2fd7c22700 1 --2- 172.21.15.26:0/1855463149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fd00a1510 0x7f2fd0138d10 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f2fc00098f0 tx=0x7f2fc0009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:04.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.261+0000 7f2fd7c22700 1 -- 172.21.15.26:0/1855463149 shutdown_connections 2023-10-01T07:57:04.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.261+0000 7f2fd7c22700 1 --2- 172.21.15.26:0/1855463149 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2fd0139250 0x7f2fd013b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:04.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.261+0000 7f2fd7c22700 1 --2- 172.21.15.26:0/1855463149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fd00a1510 0x7f2fd0138d10 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:04.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.261+0000 7f2fd7c22700 1 -- 172.21.15.26:0/1855463149 >> 172.21.15.26:0/1855463149 conn(0x7f2fd00a6550 msgr2=0x7f2fd00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:04.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.261+0000 7f2fd7c22700 1 -- 172.21.15.26:0/1855463149 shutdown_connections 2023-10-01T07:57:04.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.261+0000 7f2fd7c22700 1 -- 172.21.15.26:0/1855463149 wait complete. 2023-10-01T07:57:04.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.262+0000 7f2fd7c22700 1 Processor -- start 2023-10-01T07:57:04.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.262+0000 7f2fd7c22700 1 -- start start 2023-10-01T07:57:04.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.262+0000 7f2fd7c22700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2fd00a0a30 0x7f2fd01218c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:04.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.262+0000 7f2fd7c22700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2fd00a1510 0x7f2fd0121e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:04.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.262+0000 7f2fd7c22700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fd0139250 0x7f2fd0122340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:04.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.262+0000 7f2fd7c22700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd01236c0 con 0x7f2fd0139250 2023-10-01T07:57:04.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.262+0000 7f2fd7c22700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd01234d0 con 0x7f2fd00a1510 2023-10-01T07:57:04.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.262+0000 7f2fd7c22700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd01253e0 con 0x7f2fd00a0a30 2023-10-01T07:57:04.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.262+0000 7f2fd59be700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2fd00a0a30 0x7f2fd01218c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:04.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.263+0000 7f2fd59be700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2fd00a0a30 0x7f2fd01218c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:43768/0 (socket says 172.21.15.26:43768) 2023-10-01T07:57:04.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.263+0000 7f2fd59be700 1 -- 172.21.15.26:0/2120691678 learned_addr learned my addr 172.21.15.26:0/2120691678 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:04.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.263+0000 7f2fd51bd700 1 --2- 172.21.15.26:0/2120691678 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2fd00a1510 0x7f2fd0121e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:04.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.263+0000 7f2fd61bf700 1 --2- 172.21.15.26:0/2120691678 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fd0139250 0x7f2fd0122340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:04.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.263+0000 7f2fd59be700 1 -- 172.21.15.26:0/2120691678 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2fd00a1510 msgr2=0x7f2fd0121e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:04.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.263+0000 7f2fd59be700 1 --2- 172.21.15.26:0/2120691678 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2fd00a1510 0x7f2fd0121e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:04.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.263+0000 7f2fd59be700 1 -- 172.21.15.26:0/2120691678 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fd0139250 msgr2=0x7f2fd0122340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:04.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.263+0000 7f2fd59be700 1 --2- 172.21.15.26:0/2120691678 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fd0139250 0x7f2fd0122340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:04.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.263+0000 7f2fd59be700 1 -- 172.21.15.26:0/2120691678 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc80094a0 con 0x7f2fd00a0a30 2023-10-01T07:57:04.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.263+0000 7f2fd61bf700 1 --2- 172.21.15.26:0/2120691678 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fd0139250 0x7f2fd0122340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:57:04.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.263+0000 7f2fd59be700 1 --2- 172.21.15.26:0/2120691678 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2fd00a0a30 0x7f2fd01218c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc001ed0 tx=0x7f2fcc0021e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:04.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.263+0000 7f2fc67fc700 1 -- 172.21.15.26:0/2120691678 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc003c00 con 0x7f2fd00a0a30 2023-10-01T07:57:04.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.263+0000 7f2fc67fc700 1 -- 172.21.15.26:0/2120691678 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fcc003d60 con 0x7f2fd00a0a30 2023-10-01T07:57:04.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.263+0000 7f2fd7c22700 1 -- 172.21.15.26:0/2120691678 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc0009550 con 0x7f2fd00a0a30 2023-10-01T07:57:04.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.263+0000 7f2fc67fc700 1 -- 172.21.15.26:0/2120691678 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc00abf0 con 0x7f2fd00a0a30 2023-10-01T07:57:04.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.263+0000 7f2fd7c22700 1 -- 172.21.15.26:0/2120691678 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd0125100 con 0x7f2fd00a0a30 2023-10-01T07:57:04.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.264+0000 7f2fc67fc700 1 -- 172.21.15.26:0/2120691678 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2fcc00ad50 con 0x7f2fd00a0a30 2023-10-01T07:57:04.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.265+0000 7f2fc67fc700 1 -- 172.21.15.26:0/2120691678 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2fcc03f750 con 0x7f2fd00a0a30 2023-10-01T07:57:04.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.265+0000 7f2fd7c22700 1 -- 172.21.15.26:0/2120691678 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd0123d20 con 0x7f2fd00a0a30 2023-10-01T07:57:04.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.270+0000 7f2fc67fc700 1 -- 172.21.15.26:0/2120691678 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2fcc0198f0 con 0x7f2fd00a0a30 2023-10-01T07:57:04.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.299+0000 7f859ff6b700 1 Processor -- start 2023-10-01T07:57:04.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.299+0000 7f12473b7700 1 Processor -- start 2023-10-01T07:57:04.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.299+0000 7f12473b7700 1 -- start start 2023-10-01T07:57:04.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.299+0000 7f859ff6b700 1 -- start start 2023-10-01T07:57:04.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.300+0000 7f12473b7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f124009d6f0 0x7f124009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:04.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.300+0000 7f12473b7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f124009e440 0x7f1240134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:04.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.300+0000 7f12473b7700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f124009b120 con 0x7f124009e000 2023-10-01T07:57:04.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.300+0000 7f12473b7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f124006b460 con 0x7f124009d6f0 2023-10-01T07:57:04.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.300+0000 7f12473b7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f124009a7e0 con 0x7f124009e440 2023-10-01T07:57:04.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.300+0000 7f1245954700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f124009e440 0x7f1240134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:04.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.300+0000 7f1245954700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f124009e440 0x7f1240134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:39114/0 (socket says 172.21.15.26:39114) 2023-10-01T07:57:04.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.300+0000 7f1245954700 1 -- 172.21.15.26:0/354779966 learned_addr learned my addr 172.21.15.26:0/354779966 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:04.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.300+0000 7f1245153700 1 --2- 172.21.15.26:0/354779966 >> v2:172.21.15.26:3300/0 conn(0x7f124009d6f0 0x7f124009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:04.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.300+0000 7f859ff6b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f859809e1d0 0x7f8598138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:04.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.300+0000 7f859ff6b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8598139170 0x7f859813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:04.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.300+0000 7f859ff6b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f859809b120 con 0x7f859809d6f0 2023-10-01T07:57:04.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.300+0000 7f859ff6b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f859806b460 con 0x7f859809e1d0 2023-10-01T07:57:04.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.300+0000 7f859ff6b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f859809a7e0 con 0x7f8598139170 2023-10-01T07:57:04.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.300+0000 7f859d506700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f859809e1d0 0x7f8598138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:04.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.300+0000 7f859d506700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f859809e1d0 0x7f8598138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56966/0 (socket says 172.21.15.26:56966) 2023-10-01T07:57:04.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.300+0000 7f859d506700 1 -- 172.21.15.26:0/220214342 learned_addr learned my addr 172.21.15.26:0/220214342 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:04.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.300+0000 7f859e508700 1 --2- 172.21.15.26:0/220214342 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8598139170 0x7f859813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:04.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.300+0000 7f859d506700 1 -- 172.21.15.26:0/220214342 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8598139170 msgr2=0x7f859813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:04.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.300+0000 7f859d506700 1 --2- 172.21.15.26:0/220214342 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8598139170 0x7f859813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:04.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.300+0000 7f859d506700 1 -- 172.21.15.26:0/220214342 >> v1:172.21.15.26:6789/0 conn(0x7f859809d6f0 legacy=0x7f859809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:04.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.300+0000 7f859d506700 1 -- 172.21.15.26:0/220214342 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f859809a500 con 0x7f859809e1d0 2023-10-01T07:57:04.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.300+0000 7f1245153700 1 -- 172.21.15.26:0/354779966 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f124009e440 msgr2=0x7f1240134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:04.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.300+0000 7f1245153700 1 --2- 172.21.15.26:0/354779966 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f124009e440 0x7f1240134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:04.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.300+0000 7f1245153700 1 -- 172.21.15.26:0/354779966 >> v1:172.21.15.26:6789/0 conn(0x7f124009e000 legacy=0x7f12401339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:04.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.301+0000 7f1245153700 1 -- 172.21.15.26:0/354779966 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f124009a500 con 0x7f124009d6f0 2023-10-01T07:57:04.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.301+0000 7f859d506700 1 --2- 172.21.15.26:0/220214342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f859809e1d0 0x7f8598138c30 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f8588009920 tx=0x7f8588009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c7c41a7118951a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:04.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.301+0000 7f1245153700 1 --2- 172.21.15.26:0/354779966 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f124009d6f0 0x7f124009dac0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f123c009870 tx=0x7f123c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea41e4c36f1fed70 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:04.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.301+0000 7f859cd05700 1 -- 172.21.15.26:0/220214342 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8588011830 con 0x7f859809e1d0 2023-10-01T07:57:04.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.301+0000 7f1237fff700 1 -- 172.21.15.26:0/354779966 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c011830 con 0x7f124009d6f0 2023-10-01T07:57:04.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.301+0000 7f859cd05700 1 -- 172.21.15.26:0/220214342 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8588011990 con 0x7f859809e1d0 2023-10-01T07:57:04.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.301+0000 7f859cd05700 1 -- 172.21.15.26:0/220214342 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8588011d20 con 0x7f859809e1d0 2023-10-01T07:57:04.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.301+0000 7f1237fff700 1 -- 172.21.15.26:0/354779966 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123c011990 con 0x7f124009d6f0 2023-10-01T07:57:04.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.301+0000 7f1237fff700 1 -- 172.21.15.26:0/354779966 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c011d20 con 0x7f124009d6f0 2023-10-01T07:57:04.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.302+0000 7f859ff6b700 1 -- 172.21.15.26:0/220214342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f859809e1d0 msgr2=0x7f8598138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:04.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.302+0000 7f859ff6b700 1 --2- 172.21.15.26:0/220214342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f859809e1d0 0x7f8598138c30 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f8588009920 tx=0x7f8588009c30 comp rx=0 tx=0).stop 2023-10-01T07:57:04.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.302+0000 7f12473b7700 1 -- 172.21.15.26:0/354779966 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f124009d6f0 msgr2=0x7f124009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:04.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.302+0000 7f12473b7700 1 --2- 172.21.15.26:0/354779966 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f124009d6f0 0x7f124009dac0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f123c009870 tx=0x7f123c009b80 comp rx=0 tx=0).stop 2023-10-01T07:57:04.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.302+0000 7f859ff6b700 1 -- 172.21.15.26:0/220214342 shutdown_connections 2023-10-01T07:57:04.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.302+0000 7f859ff6b700 1 --2- 172.21.15.26:0/220214342 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8598139170 0x7f859813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:04.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.302+0000 7f859ff6b700 1 --2- 172.21.15.26:0/220214342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f859809e1d0 0x7f8598138c30 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:04.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.302+0000 7f859ff6b700 1 -- 172.21.15.26:0/220214342 >> 172.21.15.26:0/220214342 conn(0x7f8598066f50 msgr2=0x7f859809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:04.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.302+0000 7f12473b7700 1 -- 172.21.15.26:0/354779966 shutdown_connections 2023-10-01T07:57:04.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.302+0000 7f12473b7700 1 --2- 172.21.15.26:0/354779966 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f124009d6f0 0x7f124009dac0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:04.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.302+0000 7f12473b7700 1 --2- 172.21.15.26:0/354779966 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f124009e440 0x7f1240134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:04.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.302+0000 7f12473b7700 1 -- 172.21.15.26:0/354779966 >> 172.21.15.26:0/354779966 conn(0x7f1240066f50 msgr2=0x7f124009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:04.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.302+0000 7f859ff6b700 1 -- 172.21.15.26:0/220214342 shutdown_connections 2023-10-01T07:57:04.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.303+0000 7f12473b7700 1 -- 172.21.15.26:0/354779966 shutdown_connections 2023-10-01T07:57:04.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.303+0000 7f12473b7700 1 -- 172.21.15.26:0/354779966 wait complete. 2023-10-01T07:57:04.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.303+0000 7f859ff6b700 1 -- 172.21.15.26:0/220214342 wait complete. 2023-10-01T07:57:04.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.304+0000 7f12473b7700 1 Processor -- start 2023-10-01T07:57:04.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.304+0000 7f12473b7700 1 -- start start 2023-10-01T07:57:04.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.304+0000 7f859ff6b700 1 Processor -- start 2023-10-01T07:57:04.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.304+0000 7f859ff6b700 1 -- start start 2023-10-01T07:57:04.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.304+0000 7f12473b7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f124009d6f0 0x7f12401a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:04.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.304+0000 7f12473b7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f124009e000 0x7f12401a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:04.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.304+0000 7f12473b7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f124009e440 0x7f12401a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:04.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.304+0000 7f12473b7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12400a2240 con 0x7f124009e000 2023-10-01T07:57:04.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.304+0000 7f12473b7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12401a8c00 con 0x7f124009d6f0 2023-10-01T07:57:04.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.304+0000 7f12473b7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12401a87b0 con 0x7f124009e440 2023-10-01T07:57:04.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.304+0000 7f1245153700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f124009d6f0 0x7f12401a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:04.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.304+0000 7f1245153700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f124009d6f0 0x7f12401a51c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:39136/0 (socket says 172.21.15.26:39136) 2023-10-01T07:57:04.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.304+0000 7f1245153700 1 -- 172.21.15.26:0/3687927439 learned_addr learned my addr 172.21.15.26:0/3687927439 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:04.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.304+0000 7f1245954700 1 --2- 172.21.15.26:0/3687927439 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f124009e440 0x7f12401a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:04.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.305+0000 7f1245153700 1 -- 172.21.15.26:0/3687927439 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f124009e440 msgr2=0x7f12401a5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:04.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.305+0000 7f1245153700 1 --2- 172.21.15.26:0/3687927439 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f124009e440 0x7f12401a5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:04.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.305+0000 7f1245153700 1 -- 172.21.15.26:0/3687927439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f124009e000 msgr2=0x7f12401a5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:04.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.305+0000 7f1245153700 1 --2- 172.21.15.26:0/3687927439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f124009e000 0x7f12401a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:04.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.305+0000 7f1245153700 1 -- 172.21.15.26:0/3687927439 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123c0094a0 con 0x7f124009d6f0 2023-10-01T07:57:04.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.305+0000 7f859ff6b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f859809d6f0 0x7f859811e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:04.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.305+0000 7f859ff6b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f859809e1d0 0x7f859811eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:04.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.305+0000 7f859ff6b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8598139170 0x7f859811f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:04.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.305+0000 7f859ff6b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8598120630 con 0x7f8598139170 2023-10-01T07:57:04.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.305+0000 7f859ff6b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8598120a90 con 0x7f859809e1d0 2023-10-01T07:57:04.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.305+0000 7f859ff6b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f859809c710 con 0x7f859809d6f0 2023-10-01T07:57:04.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.305+0000 7f1245153700 1 --2- 172.21.15.26:0/3687927439 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f124009d6f0 0x7f12401a51c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f123c000c00 tx=0x7f123c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:04.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.305+0000 7f859d506700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f859809e1d0 0x7f859811eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:04.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.305+0000 7f859d506700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f859809e1d0 0x7f859811eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:39150/0 (socket says 172.21.15.26:39150) 2023-10-01T07:57:04.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.305+0000 7f859d506700 1 -- 172.21.15.26:0/1180342884 learned_addr learned my addr 172.21.15.26:0/1180342884 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:04.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.305+0000 7f859e508700 1 --2- 172.21.15.26:0/1180342884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8598139170 0x7f859811f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:04.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.305+0000 7f859dd07700 1 --2- 172.21.15.26:0/1180342884 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f859809d6f0 0x7f859811e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:04.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.305+0000 7f1235ffb700 1 -- 172.21.15.26:0/3687927439 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c0036a0 con 0x7f124009d6f0 2023-10-01T07:57:04.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.305+0000 7f1235ffb700 1 -- 172.21.15.26:0/3687927439 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123c01f070 con 0x7f124009d6f0 2023-10-01T07:57:04.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.305+0000 7f12473b7700 1 -- 172.21.15.26:0/3687927439 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12401a84f0 con 0x7f124009d6f0 2023-10-01T07:57:04.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.306+0000 7f859dd07700 1 -- 172.21.15.26:0/1180342884 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f859809e1d0 msgr2=0x7f859811eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:04.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.306+0000 7f859dd07700 1 --2- 172.21.15.26:0/1180342884 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f859809e1d0 0x7f859811eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:04.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.306+0000 7f859dd07700 1 -- 172.21.15.26:0/1180342884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8598139170 msgr2=0x7f859811f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:04.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.306+0000 7f859dd07700 1 --2- 172.21.15.26:0/1180342884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8598139170 0x7f859811f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:04.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.306+0000 7f859dd07700 1 -- 172.21.15.26:0/1180342884 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8588009550 con 0x7f859809d6f0 2023-10-01T07:57:04.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.306+0000 7f12473b7700 1 -- 172.21.15.26:0/3687927439 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12401a7910 con 0x7f124009d6f0 2023-10-01T07:57:04.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.306+0000 7f859dd07700 1 --2- 172.21.15.26:0/1180342884 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f859809d6f0 0x7f859811e980 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f859400c450 tx=0x7f859400c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:04.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.306+0000 7f858e7fc700 1 -- 172.21.15.26:0/1180342884 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85940052d0 con 0x7f859809d6f0 2023-10-01T07:57:04.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.306+0000 7f858e7fc700 1 -- 172.21.15.26:0/1180342884 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8594005430 con 0x7f859809d6f0 2023-10-01T07:57:04.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.306+0000 7f858e7fc700 1 -- 172.21.15.26:0/1180342884 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85940038c0 con 0x7f859809d6f0 2023-10-01T07:57:04.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.307+0000 7f859ff6b700 1 -- 172.21.15.26:0/1180342884 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85981220e0 con 0x7f859809d6f0 2023-10-01T07:57:04.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.306+0000 7f1235ffb700 1 -- 172.21.15.26:0/3687927439 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c003a40 con 0x7f124009d6f0 2023-10-01T07:57:04.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.307+0000 7f122b7fe700 1 -- 172.21.15.26:0/3687927439 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12401a89f0 con 0x7f124009d6f0 2023-10-01T07:57:04.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.308+0000 7f1235ffb700 1 -- 172.21.15.26:0/3687927439 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f123c003ba0 con 0x7f124009d6f0 2023-10-01T07:57:04.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.307+0000 7f859ff6b700 1 -- 172.21.15.26:0/1180342884 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85980720d0 con 0x7f859809d6f0 2023-10-01T07:57:04.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.308+0000 7f859ff6b700 1 -- 172.21.15.26:0/1180342884 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8598074ea0 con 0x7f859809d6f0 2023-10-01T07:57:04.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.308+0000 7f1235ffb700 1 -- 172.21.15.26:0/3687927439 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f123c021070 con 0x7f124009d6f0 2023-10-01T07:57:04.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.308+0000 7f858e7fc700 1 -- 172.21.15.26:0/1180342884 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8594003a20 con 0x7f859809d6f0 2023-10-01T07:57:04.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.309+0000 7f858e7fc700 1 -- 172.21.15.26:0/1180342884 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f859403ee80 con 0x7f859809d6f0 2023-10-01T07:57:04.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.313+0000 7f858e7fc700 1 -- 172.21.15.26:0/1180342884 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8594011590 con 0x7f859809d6f0 2023-10-01T07:57:04.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.313+0000 7f1235ffb700 1 -- 172.21.15.26:0/3687927439 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f123c024d50 con 0x7f124009d6f0 2023-10-01T07:57:04.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.479+0000 7f2fd7c22700 1 -- 172.21.15.26:0/2120691678 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2fd0074ea0 con 0x7f2fd00a0a30 2023-10-01T07:57:04.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.479+0000 7f2fc67fc700 1 -- 172.21.15.26:0/2120691678 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2fcc029090 con 0x7f2fd00a0a30 2023-10-01T07:57:04.480 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:04.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.481+0000 7f2fd7c22700 1 -- 172.21.15.26:0/2120691678 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2fd00a0a30 msgr2=0x7f2fd01218c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:04.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.481+0000 7f2fd7c22700 1 --2- 172.21.15.26:0/2120691678 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2fd00a0a30 0x7f2fd01218c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc001ed0 tx=0x7f2fcc0021e0 comp rx=0 tx=0).stop 2023-10-01T07:57:04.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.481+0000 7f2fd7c22700 1 -- 172.21.15.26:0/2120691678 shutdown_connections 2023-10-01T07:57:04.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.481+0000 7f2fd7c22700 1 --2- 172.21.15.26:0/2120691678 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fd0139250 0x7f2fd0122340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:04.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.481+0000 7f2fd7c22700 1 --2- 172.21.15.26:0/2120691678 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2fd00a0a30 0x7f2fd01218c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:04.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.481+0000 7f2fd7c22700 1 --2- 172.21.15.26:0/2120691678 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2fd00a1510 0x7f2fd0121e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:04.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.481+0000 7f2fd7c22700 1 -- 172.21.15.26:0/2120691678 >> 172.21.15.26:0/2120691678 conn(0x7f2fd00a6550 msgr2=0x7f2fd0137b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:04.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.481+0000 7f2fd7c22700 1 -- 172.21.15.26:0/2120691678 shutdown_connections 2023-10-01T07:57:04.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.481+0000 7f2fd7c22700 1 -- 172.21.15.26:0/2120691678 wait complete. 2023-10-01T07:57:04.496 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:04.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.536+0000 7f122b7fe700 1 -- 172.21.15.26:0/3687927439 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f124009f420 con 0x7f124009d6f0 2023-10-01T07:57:04.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.536+0000 7f1235ffb700 1 -- 172.21.15.26:0/3687927439 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f123c034020 con 0x7f124009d6f0 2023-10-01T07:57:04.537 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:04.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.537+0000 7f859ff6b700 1 -- 172.21.15.26:0/1180342884 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f859809f420 con 0x7f859809d6f0 2023-10-01T07:57:04.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.537+0000 7f858e7fc700 1 -- 172.21.15.26:0/1180342884 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8594017030 con 0x7f859809d6f0 2023-10-01T07:57:04.538 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:04.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.539+0000 7f122b7fe700 1 -- 172.21.15.26:0/3687927439 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f124009d6f0 msgr2=0x7f12401a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:04.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.539+0000 7f122b7fe700 1 --2- 172.21.15.26:0/3687927439 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f124009d6f0 0x7f12401a51c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f123c000c00 tx=0x7f123c004750 comp rx=0 tx=0).stop 2023-10-01T07:57:04.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.539+0000 7f122b7fe700 1 -- 172.21.15.26:0/3687927439 shutdown_connections 2023-10-01T07:57:04.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.539+0000 7f122b7fe700 1 --2- 172.21.15.26:0/3687927439 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f124009e440 0x7f12401a5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:04.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.539+0000 7f122b7fe700 1 --2- 172.21.15.26:0/3687927439 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f124009d6f0 0x7f12401a51c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:04.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.539+0000 7f122b7fe700 1 --2- 172.21.15.26:0/3687927439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f124009e000 0x7f12401a5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:04.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.539+0000 7f122b7fe700 1 -- 172.21.15.26:0/3687927439 >> 172.21.15.26:0/3687927439 conn(0x7f1240066f50 msgr2=0x7f12401b9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:04.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.539+0000 7f122b7fe700 1 -- 172.21.15.26:0/3687927439 shutdown_connections 2023-10-01T07:57:04.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.539+0000 7f122b7fe700 1 -- 172.21.15.26:0/3687927439 wait complete. 2023-10-01T07:57:04.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.540+0000 7f859ff6b700 1 -- 172.21.15.26:0/1180342884 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f859809d6f0 msgr2=0x7f859811e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:04.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.540+0000 7f859ff6b700 1 --2- 172.21.15.26:0/1180342884 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f859809d6f0 0x7f859811e980 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f859400c450 tx=0x7f859400c760 comp rx=0 tx=0).stop 2023-10-01T07:57:04.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.540+0000 7f859ff6b700 1 -- 172.21.15.26:0/1180342884 shutdown_connections 2023-10-01T07:57:04.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.540+0000 7f859ff6b700 1 --2- 172.21.15.26:0/1180342884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8598139170 0x7f859811f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:04.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.540+0000 7f859ff6b700 1 --2- 172.21.15.26:0/1180342884 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f859809d6f0 0x7f859811e980 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:04.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.540+0000 7f859ff6b700 1 --2- 172.21.15.26:0/1180342884 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f859809e1d0 0x7f859811eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:04.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.540+0000 7f859ff6b700 1 -- 172.21.15.26:0/1180342884 >> 172.21.15.26:0/1180342884 conn(0x7f8598066f50 msgr2=0x7f8598138100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:04.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.540+0000 7f859ff6b700 1 -- 172.21.15.26:0/1180342884 shutdown_connections 2023-10-01T07:57:04.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:04.540+0000 7f859ff6b700 1 -- 172.21.15.26:0/1180342884 wait complete. 2023-10-01T07:57:04.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:04.556 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:05.028 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:05.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.175+0000 7fbb0c759700 1 Processor -- start 2023-10-01T07:57:05.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.175+0000 7fbb0c759700 1 -- start start 2023-10-01T07:57:05.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.175+0000 7fbb0c759700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbb04130540 0x7fbb04130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:05.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.175+0000 7fbb0c759700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbb0406fcf0 0x7fbb04138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:05.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.175+0000 7fbb0c759700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb040716a0 con 0x7fbb04130e50 2023-10-01T07:57:05.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.175+0000 7fbb0c759700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb0409a390 con 0x7fbb0406fcf0 2023-10-01T07:57:05.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.175+0000 7fbb0c759700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb04071290 con 0x7fbb04130540 2023-10-01T07:57:05.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.175+0000 7fbb0a4f5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbb04130540 0x7fbb04130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:05.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.175+0000 7fbb0acf6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbb0406fcf0 0x7fbb04138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:05.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.175+0000 7fbb0a4f5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbb04130540 0x7fbb04130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:39152/0 (socket says 172.21.15.26:39152) 2023-10-01T07:57:05.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.175+0000 7fbb0a4f5700 1 -- 172.21.15.26:0/3999103971 learned_addr learned my addr 172.21.15.26:0/3999103971 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:05.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.175+0000 7fbb0acf6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbb0406fcf0 0x7fbb04138570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56994/0 (socket says 172.21.15.26:56994) 2023-10-01T07:57:05.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.176+0000 7fbb0a4f5700 1 -- 172.21.15.26:0/3999103971 >> v2:172.21.15.26:3300/0 conn(0x7fbb0406fcf0 msgr2=0x7fbb04138570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:05.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.176+0000 7fbb0a4f5700 1 --2- 172.21.15.26:0/3999103971 >> v2:172.21.15.26:3300/0 conn(0x7fbb0406fcf0 0x7fbb04138570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:05.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.176+0000 7fbb0a4f5700 1 -- 172.21.15.26:0/3999103971 >> v1:172.21.15.26:6789/0 conn(0x7fbb04130e50 legacy=0x7fbb0406f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:05.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.176+0000 7fbb0a4f5700 1 -- 172.21.15.26:0/3999103971 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb04130340 con 0x7fbb04130540 2023-10-01T07:57:05.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.176+0000 7fbb0a4f5700 1 --2- 172.21.15.26:0/3999103971 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbb04130540 0x7fbb04130910 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbb00009920 tx=0x7fbb00009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e81432af6bdd2f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:05.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.176+0000 7fbb094f3700 1 -- 172.21.15.26:0/3999103971 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb00011830 con 0x7fbb04130540 2023-10-01T07:57:05.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.176+0000 7fbb094f3700 1 -- 172.21.15.26:0/3999103971 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb00011990 con 0x7fbb04130540 2023-10-01T07:57:05.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.176+0000 7fbb094f3700 1 -- 172.21.15.26:0/3999103971 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb00011d20 con 0x7fbb04130540 2023-10-01T07:57:05.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.177+0000 7fbb0c759700 1 -- 172.21.15.26:0/3999103971 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbb04130540 msgr2=0x7fbb04130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:05.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.177+0000 7fbb0c759700 1 --2- 172.21.15.26:0/3999103971 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbb04130540 0x7fbb04130910 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbb00009920 tx=0x7fbb00009c30 comp rx=0 tx=0).stop 2023-10-01T07:57:05.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.177+0000 7fbb0c759700 1 -- 172.21.15.26:0/3999103971 shutdown_connections 2023-10-01T07:57:05.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.177+0000 7fbb0c759700 1 --2- 172.21.15.26:0/3999103971 >> v2:172.21.15.26:3300/0 conn(0x7fbb0406fcf0 0x7fbb04138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:05.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.177+0000 7fbb0c759700 1 --2- 172.21.15.26:0/3999103971 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbb04130540 0x7fbb04130910 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:05.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.177+0000 7fbb0c759700 1 -- 172.21.15.26:0/3999103971 >> 172.21.15.26:0/3999103971 conn(0x7fbb040a2aa0 msgr2=0x7fbb040a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:05.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.177+0000 7fbb0c759700 1 -- 172.21.15.26:0/3999103971 shutdown_connections 2023-10-01T07:57:05.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.177+0000 7fbb0c759700 1 -- 172.21.15.26:0/3999103971 wait complete. 2023-10-01T07:57:05.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.178+0000 7fbb0c759700 1 Processor -- start 2023-10-01T07:57:05.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.178+0000 7fbb0c759700 1 -- start start 2023-10-01T07:57:05.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.178+0000 7fbb0c759700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbb0406fcf0 0x7fbb041c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:05.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.178+0000 7fbb0c759700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb04130540 0x7fbb041c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:05.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.178+0000 7fbb0c759700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbb04130e50 0x7fbb041c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:05.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.178+0000 7fbb0c759700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb040718e0 con 0x7fbb04130540 2023-10-01T07:57:05.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.178+0000 7fbb0c759700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb04123910 con 0x7fbb04130e50 2023-10-01T07:57:05.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.178+0000 7fbb0c759700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0409c1d0 con 0x7fbb0406fcf0 2023-10-01T07:57:05.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.179+0000 7fbb0a4f5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbb0406fcf0 0x7fbb041c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:05.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.179+0000 7fbb0acf6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbb04130e50 0x7fbb041c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:05.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.179+0000 7fbb09cf4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb04130540 0x7fbb041c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:05.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.179+0000 7fbb0a4f5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbb0406fcf0 0x7fbb041c8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:43802/0 (socket says 172.21.15.26:43802) 2023-10-01T07:57:05.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.179+0000 7fbb09cf4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb04130540 0x7fbb041c8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57000/0 (socket says 172.21.15.26:57000) 2023-10-01T07:57:05.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.179+0000 7fbb0acf6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbb04130e50 0x7fbb041c8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:39158/0 (socket says 172.21.15.26:39158) 2023-10-01T07:57:05.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.179+0000 7fbb0a4f5700 1 -- 172.21.15.26:0/975063314 learned_addr learned my addr 172.21.15.26:0/975063314 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:05.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.179+0000 7fbb09cf4700 1 -- 172.21.15.26:0/975063314 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbb0406fcf0 msgr2=0x7fbb041c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:05.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.179+0000 7fbb09cf4700 1 --2- 172.21.15.26:0/975063314 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbb0406fcf0 0x7fbb041c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:05.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.179+0000 7fbb09cf4700 1 -- 172.21.15.26:0/975063314 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbb04130e50 msgr2=0x7fbb041c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:05.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.179+0000 7fbb09cf4700 1 --2- 172.21.15.26:0/975063314 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbb04130e50 0x7fbb041c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:05.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.179+0000 7fbb09cf4700 1 -- 172.21.15.26:0/975063314 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb00009550 con 0x7fbb04130540 2023-10-01T07:57:05.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.179+0000 7fbb0a4f5700 1 --2- 172.21.15.26:0/975063314 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbb0406fcf0 0x7fbb041c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:05.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.179+0000 7fbb0acf6700 1 --2- 172.21.15.26:0/975063314 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbb04130e50 0x7fbb041c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:05.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.179+0000 7fbb09cf4700 1 --2- 172.21.15.26:0/975063314 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb04130540 0x7fbb041c8a80 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4000f60 tx=0x7fbaf400c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:05.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.179+0000 7fbafaffd700 1 -- 172.21.15.26:0/975063314 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf40050d0 con 0x7fbb04130540 2023-10-01T07:57:05.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.179+0000 7fbafaffd700 1 -- 172.21.15.26:0/975063314 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf4005230 con 0x7fbb04130540 2023-10-01T07:57:05.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.179+0000 7fbb0c759700 1 -- 172.21.15.26:0/975063314 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb0409cfa0 con 0x7fbb04130540 2023-10-01T07:57:05.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.179+0000 7fbafaffd700 1 -- 172.21.15.26:0/975063314 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4003680 con 0x7fbb04130540 2023-10-01T07:57:05.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.179+0000 7fbb0c759700 1 -- 172.21.15.26:0/975063314 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb041242a0 con 0x7fbb04130540 2023-10-01T07:57:05.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.180+0000 7fbb0c759700 1 -- 172.21.15.26:0/975063314 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb04067ee0 con 0x7fbb04130540 2023-10-01T07:57:05.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.181+0000 7fbafaffd700 1 -- 172.21.15.26:0/975063314 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbaf40037e0 con 0x7fbb04130540 2023-10-01T07:57:05.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.181+0000 7fbafaffd700 1 -- 172.21.15.26:0/975063314 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbaf403ec10 con 0x7fbb04130540 2023-10-01T07:57:05.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.186+0000 7fbafaffd700 1 -- 172.21.15.26:0/975063314 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbaf4003a90 con 0x7fbb04130540 2023-10-01T07:57:05.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.388+0000 7fbb0c759700 1 -- 172.21.15.26:0/975063314 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbb04074ea0 con 0x7fbb04130540 2023-10-01T07:57:05.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.389+0000 7fbafaffd700 1 -- 172.21.15.26:0/975063314 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbaf4017020 con 0x7fbb04130540 2023-10-01T07:57:05.389 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:05.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.391+0000 7fbb0c759700 1 -- 172.21.15.26:0/975063314 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb04130540 msgr2=0x7fbb041c8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:05.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.391+0000 7fbb0c759700 1 --2- 172.21.15.26:0/975063314 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb04130540 0x7fbb041c8a80 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4000f60 tx=0x7fbaf400c730 comp rx=0 tx=0).stop 2023-10-01T07:57:05.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.391+0000 7fbb0c759700 1 -- 172.21.15.26:0/975063314 shutdown_connections 2023-10-01T07:57:05.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.391+0000 7fbb0c759700 1 --2- 172.21.15.26:0/975063314 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbb04130e50 0x7fbb041c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:05.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.391+0000 7fbb0c759700 1 --2- 172.21.15.26:0/975063314 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbb0406fcf0 0x7fbb041c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:05.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.391+0000 7fbb0c759700 1 --2- 172.21.15.26:0/975063314 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb04130540 0x7fbb041c8a80 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:05.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.391+0000 7fbb0c759700 1 -- 172.21.15.26:0/975063314 >> 172.21.15.26:0/975063314 conn(0x7fbb040a2aa0 msgr2=0x7fbb0406e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:05.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.391+0000 7fbb0c759700 1 -- 172.21.15.26:0/975063314 shutdown_connections 2023-10-01T07:57:05.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.391+0000 7fbb0c759700 1 -- 172.21.15.26:0/975063314 wait complete. 2023-10-01T07:57:05.405 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:05.497 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:05.556 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:05.556 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:05.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.641+0000 7f665f579700 1 Processor -- start 2023-10-01T07:57:05.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.641+0000 7f665f579700 1 -- start start 2023-10-01T07:57:05.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.641+0000 7f665f579700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f665809e850 0x7f665809ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:05.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.642+0000 7f665f579700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f665809f160 0x7f6658133b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:05.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.642+0000 7f665f579700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f66581340c0 0x7f6658134540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:05.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.642+0000 7f665f579700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f665809ae60 con 0x7f66581340c0 2023-10-01T07:57:05.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.642+0000 7f665f579700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665806b990 con 0x7f665809f160 2023-10-01T07:57:05.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.642+0000 7f665f579700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f665806bc50 con 0x7f665809e850 2023-10-01T07:57:05.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.642+0000 7f665d315700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f665809e850 0x7f665809ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:05.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.642+0000 7f665d315700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f665809e850 0x7f665809ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:43804/0 (socket says 172.21.15.26:43804) 2023-10-01T07:57:05.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.642+0000 7f665d315700 1 -- 172.21.15.26:0/3183008509 learned_addr learned my addr 172.21.15.26:0/3183008509 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:05.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.642+0000 7f665db16700 1 --2- 172.21.15.26:0/3183008509 >> v2:172.21.15.26:3300/0 conn(0x7f66581340c0 0x7f6658134540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:05.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.642+0000 7f665cb14700 1 --2- 172.21.15.26:0/3183008509 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f665809f160 0x7f6658133b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:05.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.642+0000 7f665db16700 1 -- 172.21.15.26:0/3183008509 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f665809e850 msgr2=0x7f665809ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:05.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.642+0000 7f665db16700 1 --2- 172.21.15.26:0/3183008509 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f665809e850 0x7f665809ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:05.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.642+0000 7f665db16700 1 -- 172.21.15.26:0/3183008509 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f665809f160 msgr2=0x7f6658133b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:05.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.642+0000 7f665db16700 1 --2- 172.21.15.26:0/3183008509 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f665809f160 0x7f6658133b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:05.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.642+0000 7f665db16700 1 -- 172.21.15.26:0/3183008509 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f665806cb10 con 0x7f66581340c0 2023-10-01T07:57:05.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.642+0000 7f665d315700 1 --2- 172.21.15.26:0/3183008509 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f665809e850 0x7f665809ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:05.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.642+0000 7f665cb14700 1 --2- 172.21.15.26:0/3183008509 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f665809f160 0x7f6658133b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:05.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.642+0000 7f665db16700 1 --2- 172.21.15.26:0/3183008509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66581340c0 0x7f6658134540 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f6650009dc0 tx=0x7f665000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53594bf049ad611d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:05.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.643+0000 7f664ffff700 1 -- 172.21.15.26:0/3183008509 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665000e070 con 0x7f66581340c0 2023-10-01T07:57:05.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.643+0000 7f664ffff700 1 -- 172.21.15.26:0/3183008509 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f665000bae0 con 0x7f66581340c0 2023-10-01T07:57:05.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.643+0000 7f664ffff700 1 -- 172.21.15.26:0/3183008509 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665000be90 con 0x7f66581340c0 2023-10-01T07:57:05.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.643+0000 7f665f579700 1 -- 172.21.15.26:0/3183008509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66581340c0 msgr2=0x7f6658134540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:05.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.643+0000 7f665f579700 1 --2- 172.21.15.26:0/3183008509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66581340c0 0x7f6658134540 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f6650009dc0 tx=0x7f665000b330 comp rx=0 tx=0).stop 2023-10-01T07:57:05.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.643+0000 7f665f579700 1 -- 172.21.15.26:0/3183008509 shutdown_connections 2023-10-01T07:57:05.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.643+0000 7f665f579700 1 --2- 172.21.15.26:0/3183008509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66581340c0 0x7f6658134540 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:05.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.643+0000 7f665f579700 1 --2- 172.21.15.26:0/3183008509 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f665809e850 0x7f665809ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:05.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.643+0000 7f665f579700 1 --2- 172.21.15.26:0/3183008509 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f665809f160 0x7f6658133b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:05.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.643+0000 7f665f579700 1 -- 172.21.15.26:0/3183008509 >> 172.21.15.26:0/3183008509 conn(0x7f66580a3f70 msgr2=0x7f66580a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:05.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.643+0000 7f665f579700 1 -- 172.21.15.26:0/3183008509 shutdown_connections 2023-10-01T07:57:05.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.644+0000 7f665f579700 1 -- 172.21.15.26:0/3183008509 wait complete. 2023-10-01T07:57:05.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.644+0000 7f665f579700 1 Processor -- start 2023-10-01T07:57:05.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.645+0000 7f665f579700 1 -- start start 2023-10-01T07:57:05.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.645+0000 7f665f579700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f665809e850 0x7f66581225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:05.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.645+0000 7f665f579700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f665809f160 0x7f6658122ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:05.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.645+0000 7f665f579700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66581340c0 0x7f6658123020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:05.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.645+0000 7f665f579700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6658125de0 con 0x7f665809e850 2023-10-01T07:57:05.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.645+0000 7f665f579700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6658125040 con 0x7f665809f160 2023-10-01T07:57:05.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.645+0000 7f665f579700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f665806cd30 con 0x7f66581340c0 2023-10-01T07:57:05.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.645+0000 7f665cb14700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f665809f160 0x7f6658122ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:05.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.645+0000 7f665db16700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66581340c0 0x7f6658123020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:05.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.645+0000 7f665db16700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66581340c0 0x7f6658123020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:43808/0 (socket says 172.21.15.26:43808) 2023-10-01T07:57:05.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.645+0000 7f665cb14700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f665809f160 0x7f6658122ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:39182/0 (socket says 172.21.15.26:39182) 2023-10-01T07:57:05.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.645+0000 7f665db16700 1 -- 172.21.15.26:0/3657680197 learned_addr learned my addr 172.21.15.26:0/3657680197 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:05.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.645+0000 7f665d315700 1 --2- 172.21.15.26:0/3657680197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f665809e850 0x7f66581225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:05.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.646+0000 7f665cb14700 1 -- 172.21.15.26:0/3657680197 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66581340c0 msgr2=0x7f6658123020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:05.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.646+0000 7f665cb14700 1 --2- 172.21.15.26:0/3657680197 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66581340c0 0x7f6658123020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:05.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.646+0000 7f665cb14700 1 -- 172.21.15.26:0/3657680197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f665809e850 msgr2=0x7f66581225a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:05.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.646+0000 7f665cb14700 1 --2- 172.21.15.26:0/3657680197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f665809e850 0x7f66581225a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:05.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.646+0000 7f665cb14700 1 -- 172.21.15.26:0/3657680197 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6654009550 con 0x7f665809f160 2023-10-01T07:57:05.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.646+0000 7f665d315700 1 --2- 172.21.15.26:0/3657680197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f665809e850 0x7f66581225a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:57:05.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.646+0000 7f665cb14700 1 --2- 172.21.15.26:0/3657680197 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f665809f160 0x7f6658122ae0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f664800ea10 tx=0x7f664800ed20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:05.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.646+0000 7f664dffb700 1 -- 172.21.15.26:0/3657680197 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664800c850 con 0x7f665809f160 2023-10-01T07:57:05.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.646+0000 7f664dffb700 1 -- 172.21.15.26:0/3657680197 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664800c9b0 con 0x7f665809f160 2023-10-01T07:57:05.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.646+0000 7f665f579700 1 -- 172.21.15.26:0/3657680197 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66480094a0 con 0x7f665809f160 2023-10-01T07:57:05.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.646+0000 7f664dffb700 1 -- 172.21.15.26:0/3657680197 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664800cd60 con 0x7f665809f160 2023-10-01T07:57:05.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.646+0000 7f665f579700 1 -- 172.21.15.26:0/3657680197 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6650009a70 con 0x7f665809f160 2023-10-01T07:57:05.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.647+0000 7f664dffb700 1 -- 172.21.15.26:0/3657680197 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6648013470 con 0x7f665809f160 2023-10-01T07:57:05.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.647+0000 7f664dffb700 1 -- 172.21.15.26:0/3657680197 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f664803fba0 con 0x7f665809f160 2023-10-01T07:57:05.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.648+0000 7f665f579700 1 -- 172.21.15.26:0/3657680197 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66580747f0 con 0x7f665809f160 2023-10-01T07:57:05.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.653+0000 7f664dffb700 1 -- 172.21.15.26:0/3657680197 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6648017080 con 0x7f665809f160 2023-10-01T07:57:05.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.699+0000 7f387c8cc700 1 Processor -- start 2023-10-01T07:57:05.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.699+0000 7f387c8cc700 1 -- start start 2023-10-01T07:57:05.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.700+0000 7f5496126700 1 Processor -- start 2023-10-01T07:57:05.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.700+0000 7f5496126700 1 -- start start 2023-10-01T07:57:05.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.700+0000 7f387c8cc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f387809d6f0 0x7f387809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:05.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.700+0000 7f387c8cc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f387809e410 0x7f3878130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:05.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.700+0000 7f387c8cc700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f387809f130 con 0x7f387809e000 2023-10-01T07:57:05.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.700+0000 7f387c8cc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387809f520 con 0x7f387809d6f0 2023-10-01T07:57:05.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.700+0000 7f387c8cc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f387809e930 con 0x7f387809e410 2023-10-01T07:57:05.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.700+0000 7f5496126700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f549009e1d0 0x7f5490138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:05.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.700+0000 7f5496126700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5490139170 0x7f549013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:05.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.700+0000 7f5496126700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f549009b120 con 0x7f549009d6f0 2023-10-01T07:57:05.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.700+0000 7f5496126700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f549006b460 con 0x7f5490139170 2023-10-01T07:57:05.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.700+0000 7f5496126700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f549009a7e0 con 0x7f549009e1d0 2023-10-01T07:57:05.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.700+0000 7f387659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f387809d6f0 0x7f387809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:05.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.700+0000 7f3876d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f387809e410 0x7f3878130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:05.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.700+0000 7f3876d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f387809e410 0x7f3878130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:43810/0 (socket says 172.21.15.26:43810) 2023-10-01T07:57:05.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.700+0000 7f387659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f387809d6f0 0x7f387809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:39184/0 (socket says 172.21.15.26:39184) 2023-10-01T07:57:05.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.700+0000 7f3876d9d700 1 -- 172.21.15.26:0/144928224 learned_addr learned my addr 172.21.15.26:0/144928224 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:05.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.701+0000 7f548f7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f549009d6f0 0x7f549009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43866/0 (socket says 172.21.15.26:43866) 2023-10-01T07:57:05.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.701+0000 7f548f7fe700 1 -- 172.21.15.26:0/2433033365 learned_addr learned my addr 172.21.15.26:0/2433033365 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:05.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.701+0000 7f548ffff700 1 --2- 172.21.15.26:0/2433033365 >> v2:172.21.15.26:3300/0 conn(0x7f5490139170 0x7f549013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:05.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.701+0000 7f548effd700 1 --2- 172.21.15.26:0/2433033365 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f549009e1d0 0x7f5490138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:05.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.701+0000 7f548e7fc700 1 -- 172.21.15.26:0/2433033365 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2931400519 0 0) 0x7f549009b120 con 0x7f549009d6f0 2023-10-01T07:57:05.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.701+0000 7f548e7fc700 1 -- 172.21.15.26:0/2433033365 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54780035b0 con 0x7f549009d6f0 2023-10-01T07:57:05.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.701+0000 7f548ffff700 1 -- 172.21.15.26:0/2433033365 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f549009e1d0 msgr2=0x7f5490138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:05.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.701+0000 7f548ffff700 1 --2- 172.21.15.26:0/2433033365 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f549009e1d0 0x7f5490138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:05.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.701+0000 7f548ffff700 1 -- 172.21.15.26:0/2433033365 >> v1:172.21.15.26:6789/0 conn(0x7f549009d6f0 legacy=0x7f549009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:05.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.701+0000 7f548ffff700 1 -- 172.21.15.26:0/2433033365 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549009a500 con 0x7f5490139170 2023-10-01T07:57:05.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.701+0000 7f387659c700 1 -- 172.21.15.26:0/144928224 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f387809e410 msgr2=0x7f3878130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:05.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.701+0000 7f387659c700 1 --2- 172.21.15.26:0/144928224 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f387809e410 0x7f3878130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:05.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.701+0000 7f387659c700 1 -- 172.21.15.26:0/144928224 >> v1:172.21.15.26:6789/0 conn(0x7f387809e000 legacy=0x7f3878130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:05.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.701+0000 7f387659c700 1 -- 172.21.15.26:0/144928224 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387809b2d0 con 0x7f387809d6f0 2023-10-01T07:57:05.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.701+0000 7f387659c700 1 --2- 172.21.15.26:0/144928224 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f387809d6f0 0x7f387809dac0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3868009870 tx=0x7f3868009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5fe45cf593c766a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:05.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.701+0000 7f548ffff700 1 --2- 172.21.15.26:0/2433033365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5490139170 0x7f549013b550 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f5488009d90 tx=0x7f548800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e7d0e6aaeaba69 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:05.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.701+0000 7f387559a700 1 -- 172.21.15.26:0/144928224 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3868004230 con 0x7f387809d6f0 2023-10-01T07:57:05.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.702+0000 7f387559a700 1 -- 172.21.15.26:0/144928224 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3868004390 con 0x7f387809d6f0 2023-10-01T07:57:05.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.702+0000 7f387559a700 1 -- 172.21.15.26:0/144928224 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38680036a0 con 0x7f387809d6f0 2023-10-01T07:57:05.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.702+0000 7f548e7fc700 1 -- 172.21.15.26:0/2433033365 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548800e070 con 0x7f5490139170 2023-10-01T07:57:05.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.702+0000 7f548e7fc700 1 -- 172.21.15.26:0/2433033365 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548800bb20 con 0x7f5490139170 2023-10-01T07:57:05.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.702+0000 7f548e7fc700 1 -- 172.21.15.26:0/2433033365 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548800be90 con 0x7f5490139170 2023-10-01T07:57:05.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.702+0000 7f5496126700 1 -- 172.21.15.26:0/2433033365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5490139170 msgr2=0x7f549013b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:05.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.702+0000 7f5496126700 1 --2- 172.21.15.26:0/2433033365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5490139170 0x7f549013b550 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f5488009d90 tx=0x7f548800b330 comp rx=0 tx=0).stop 2023-10-01T07:57:05.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.702+0000 7f5496126700 1 -- 172.21.15.26:0/2433033365 shutdown_connections 2023-10-01T07:57:05.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.702+0000 7f5496126700 1 --2- 172.21.15.26:0/2433033365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5490139170 0x7f549013b550 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:05.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.702+0000 7f5496126700 1 --2- 172.21.15.26:0/2433033365 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f549009e1d0 0x7f5490138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:05.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.702+0000 7f5496126700 1 -- 172.21.15.26:0/2433033365 >> 172.21.15.26:0/2433033365 conn(0x7f5490066f50 msgr2=0x7f549009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:05.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.703+0000 7f5496126700 1 -- 172.21.15.26:0/2433033365 shutdown_connections 2023-10-01T07:57:05.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.703+0000 7f5496126700 1 -- 172.21.15.26:0/2433033365 wait complete. 2023-10-01T07:57:05.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.703+0000 7f387c8cc700 1 -- 172.21.15.26:0/144928224 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f387809d6f0 msgr2=0x7f387809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:05.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.703+0000 7f387c8cc700 1 --2- 172.21.15.26:0/144928224 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f387809d6f0 0x7f387809dac0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3868009870 tx=0x7f3868009b80 comp rx=0 tx=0).stop 2023-10-01T07:57:05.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.703+0000 7f387c8cc700 1 -- 172.21.15.26:0/144928224 shutdown_connections 2023-10-01T07:57:05.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.703+0000 7f387c8cc700 1 --2- 172.21.15.26:0/144928224 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f387809e410 0x7f3878130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:05.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.703+0000 7f387c8cc700 1 --2- 172.21.15.26:0/144928224 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f387809d6f0 0x7f387809dac0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:05.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.703+0000 7f387c8cc700 1 -- 172.21.15.26:0/144928224 >> 172.21.15.26:0/144928224 conn(0x7f3878066f50 msgr2=0x7f387809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:05.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.703+0000 7f387c8cc700 1 -- 172.21.15.26:0/144928224 shutdown_connections 2023-10-01T07:57:05.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.703+0000 7f387c8cc700 1 -- 172.21.15.26:0/144928224 wait complete. 2023-10-01T07:57:05.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.704+0000 7f5496126700 1 Processor -- start 2023-10-01T07:57:05.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.704+0000 7f5496126700 1 -- start start 2023-10-01T07:57:05.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.704+0000 7f387c8cc700 1 Processor -- start 2023-10-01T07:57:05.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.705+0000 7f387c8cc700 1 -- start start 2023-10-01T07:57:05.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.705+0000 7f5496126700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f549009d6f0 0x7f5490121610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:05.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.705+0000 7f5496126700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f549009e1d0 0x7f5490121b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:05.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.705+0000 7f5496126700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5490139170 0x7f5490122090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:05.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.705+0000 7f5496126700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5490123220 con 0x7f549009d6f0 2023-10-01T07:57:05.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.705+0000 7f5496126700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5490123840 con 0x7f549009e1d0 2023-10-01T07:57:05.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.705+0000 7f5496126700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f549009c780 con 0x7f5490139170 2023-10-01T07:57:05.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.705+0000 7f548effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f549009e1d0 0x7f5490121b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:05.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.705+0000 7f548effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f549009e1d0 0x7f5490121b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:39196/0 (socket says 172.21.15.26:39196) 2023-10-01T07:57:05.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.705+0000 7f548effd700 1 -- 172.21.15.26:0/2444821975 learned_addr learned my addr 172.21.15.26:0/2444821975 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:05.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.705+0000 7f548ffff700 1 --2- 172.21.15.26:0/2444821975 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5490139170 0x7f5490122090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:05.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.705+0000 7f387c8cc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f387809d6f0 0x7f3878122380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:05.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.705+0000 7f387c8cc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f387809e000 0x7f38781228c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:05.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.705+0000 7f387c8cc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f387809e410 0x7f3878122e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:05.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.705+0000 7f387c8cc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3878125900 con 0x7f387809e000 2023-10-01T07:57:05.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.705+0000 7f387c8cc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387809c700 con 0x7f387809d6f0 2023-10-01T07:57:05.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.705+0000 7f387c8cc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3878125610 con 0x7f387809e410 2023-10-01T07:57:05.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.706+0000 7f548effd700 1 -- 172.21.15.26:0/2444821975 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5490139170 msgr2=0x7f5490122090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:05.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.706+0000 7f548effd700 1 --2- 172.21.15.26:0/2444821975 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5490139170 0x7f5490122090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:05.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.706+0000 7f548effd700 1 -- 172.21.15.26:0/2444821975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f549009d6f0 msgr2=0x7f5490121610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:05.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.706+0000 7f3876d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f387809e410 0x7f3878122e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:05.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.706+0000 7f548effd700 1 --2- 172.21.15.26:0/2444821975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f549009d6f0 0x7f5490121610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:05.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.706+0000 7f548effd700 1 -- 172.21.15.26:0/2444821975 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5488009a70 con 0x7f549009e1d0 2023-10-01T07:57:05.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.706+0000 7f548ffff700 1 --2- 172.21.15.26:0/2444821975 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5490139170 0x7f5490122090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:57:05.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.706+0000 7f3876d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f387809e410 0x7f3878122e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:43838/0 (socket says 172.21.15.26:43838) 2023-10-01T07:57:05.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.706+0000 7f3876d9d700 1 -- 172.21.15.26:0/3414984444 learned_addr learned my addr 172.21.15.26:0/3414984444 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:05.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.706+0000 7f387659c700 1 --2- 172.21.15.26:0/3414984444 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f387809d6f0 0x7f3878122380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:05.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.706+0000 7f548effd700 1 --2- 172.21.15.26:0/2444821975 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f549009e1d0 0x7f5490121b50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f548400e840 tx=0x7f548400ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:05.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.706+0000 7f3876d9d700 1 -- 172.21.15.26:0/3414984444 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f387809d6f0 msgr2=0x7f3878122380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:05.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.706+0000 7f3876d9d700 1 --2- 172.21.15.26:0/3414984444 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f387809d6f0 0x7f3878122380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:05.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.706+0000 7f3876d9d700 1 -- 172.21.15.26:0/3414984444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f387809e000 msgr2=0x7f38781228c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:05.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.706+0000 7f3876d9d700 1 --2- 172.21.15.26:0/3414984444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f387809e000 0x7f38781228c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:05.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.706+0000 7f3876d9d700 1 -- 172.21.15.26:0/3414984444 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38680094a0 con 0x7f387809e410 2023-10-01T07:57:05.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.706+0000 7f5477fff700 1 -- 172.21.15.26:0/2444821975 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5484013610 con 0x7f549009e1d0 2023-10-01T07:57:05.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.706+0000 7f5477fff700 1 -- 172.21.15.26:0/2444821975 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5484013770 con 0x7f549009e1d0 2023-10-01T07:57:05.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.706+0000 7f5496126700 1 -- 172.21.15.26:0/2444821975 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5490124e50 con 0x7f549009e1d0 2023-10-01T07:57:05.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.706+0000 7f5477fff700 1 -- 172.21.15.26:0/2444821975 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5484013b20 con 0x7f549009e1d0 2023-10-01T07:57:05.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.706+0000 7f3876d9d700 1 --2- 172.21.15.26:0/3414984444 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f387809e410 0x7f3878122e00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f38700093b0 tx=0x7f387000e3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:05.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.706+0000 7f5496126700 1 -- 172.21.15.26:0/2444821975 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5490071e90 con 0x7f549009e1d0 2023-10-01T07:57:05.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.707+0000 7f3866ffd700 1 -- 172.21.15.26:0/3414984444 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3870010040 con 0x7f387809e410 2023-10-01T07:57:05.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.707+0000 7f3866ffd700 1 -- 172.21.15.26:0/3414984444 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3870003a20 con 0x7f387809e410 2023-10-01T07:57:05.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.707+0000 7f5496126700 1 -- 172.21.15.26:0/2444821975 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5490074ea0 con 0x7f549009e1d0 2023-10-01T07:57:05.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.707+0000 7f387c8cc700 1 -- 172.21.15.26:0/3414984444 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38780a1d00 con 0x7f387809e410 2023-10-01T07:57:05.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.707+0000 7f3866ffd700 1 -- 172.21.15.26:0/3414984444 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3870003dd0 con 0x7f387809e410 2023-10-01T07:57:05.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.707+0000 7f387c8cc700 1 -- 172.21.15.26:0/3414984444 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3878125ea0 con 0x7f387809e410 2023-10-01T07:57:05.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.708+0000 7f5477fff700 1 -- 172.21.15.26:0/2444821975 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5484013c80 con 0x7f549009e1d0 2023-10-01T07:57:05.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.708+0000 7f5477fff700 1 -- 172.21.15.26:0/2444821975 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f54840424e0 con 0x7f549009e1d0 2023-10-01T07:57:05.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.708+0000 7f387c8cc700 1 -- 172.21.15.26:0/3414984444 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3878074ea0 con 0x7f387809e410 2023-10-01T07:57:05.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.709+0000 7f3866ffd700 1 -- 172.21.15.26:0/3414984444 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3870009050 con 0x7f387809e410 2023-10-01T07:57:05.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.709+0000 7f3866ffd700 1 -- 172.21.15.26:0/3414984444 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f387003ffe0 con 0x7f387809e410 2023-10-01T07:57:05.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.713+0000 7f5477fff700 1 -- 172.21.15.26:0/2444821975 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5484012370 con 0x7f549009e1d0 2023-10-01T07:57:05.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.713+0000 7f3866ffd700 1 -- 172.21.15.26:0/3414984444 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3870013340 con 0x7f387809e410 2023-10-01T07:57:05.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.862+0000 7f665f579700 1 -- 172.21.15.26:0/3657680197 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6658125400 con 0x7f665809f160 2023-10-01T07:57:05.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.863+0000 7f664dffb700 1 -- 172.21.15.26:0/3657680197 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f664801b3b0 con 0x7f665809f160 2023-10-01T07:57:05.863 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:05.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.865+0000 7f665f579700 1 -- 172.21.15.26:0/3657680197 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f665809f160 msgr2=0x7f6658122ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:05.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.865+0000 7f665f579700 1 --2- 172.21.15.26:0/3657680197 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f665809f160 0x7f6658122ae0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f664800ea10 tx=0x7f664800ed20 comp rx=0 tx=0).stop 2023-10-01T07:57:05.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.865+0000 7f665f579700 1 -- 172.21.15.26:0/3657680197 shutdown_connections 2023-10-01T07:57:05.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.865+0000 7f665f579700 1 --2- 172.21.15.26:0/3657680197 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66581340c0 0x7f6658123020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:05.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.865+0000 7f665f579700 1 --2- 172.21.15.26:0/3657680197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f665809e850 0x7f66581225a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:05.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.865+0000 7f665f579700 1 --2- 172.21.15.26:0/3657680197 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f665809f160 0x7f6658122ae0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:05.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.865+0000 7f665f579700 1 -- 172.21.15.26:0/3657680197 >> 172.21.15.26:0/3657680197 conn(0x7f66580a3f70 msgr2=0x7f665809d360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:05.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.865+0000 7f665f579700 1 -- 172.21.15.26:0/3657680197 shutdown_connections 2023-10-01T07:57:05.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.865+0000 7f665f579700 1 -- 172.21.15.26:0/3657680197 wait complete. 2023-10-01T07:57:05.879 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:05.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.932+0000 7f387c8cc700 1 -- 172.21.15.26:0/3414984444 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f387806c360 con 0x7f387809e410 2023-10-01T07:57:05.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.933+0000 7f3866ffd700 1 -- 172.21.15.26:0/3414984444 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f387001db00 con 0x7f387809e410 2023-10-01T07:57:05.934 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:05.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.934+0000 7f5496126700 1 -- 172.21.15.26:0/2444821975 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f549006c360 con 0x7f549009e1d0 2023-10-01T07:57:05.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.934+0000 7f5477fff700 1 -- 172.21.15.26:0/2444821975 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5484021070 con 0x7f549009e1d0 2023-10-01T07:57:05.935 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:05.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.935+0000 7f387c8cc700 1 -- 172.21.15.26:0/3414984444 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f387809e410 msgr2=0x7f3878122e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:05.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.935+0000 7f387c8cc700 1 --2- 172.21.15.26:0/3414984444 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f387809e410 0x7f3878122e00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f38700093b0 tx=0x7f387000e3a0 comp rx=0 tx=0).stop 2023-10-01T07:57:05.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.935+0000 7f387c8cc700 1 -- 172.21.15.26:0/3414984444 shutdown_connections 2023-10-01T07:57:05.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.936+0000 7f387c8cc700 1 --2- 172.21.15.26:0/3414984444 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f387809e410 0x7f3878122e00 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:05.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.936+0000 7f387c8cc700 1 --2- 172.21.15.26:0/3414984444 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f387809d6f0 0x7f3878122380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:05.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.936+0000 7f387c8cc700 1 --2- 172.21.15.26:0/3414984444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f387809e000 0x7f38781228c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:05.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.936+0000 7f387c8cc700 1 -- 172.21.15.26:0/3414984444 >> 172.21.15.26:0/3414984444 conn(0x7f3878066f50 msgr2=0x7f387806f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:05.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.936+0000 7f387c8cc700 1 -- 172.21.15.26:0/3414984444 shutdown_connections 2023-10-01T07:57:05.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.936+0000 7f387c8cc700 1 -- 172.21.15.26:0/3414984444 wait complete. 2023-10-01T07:57:05.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.937+0000 7f5496126700 1 -- 172.21.15.26:0/2444821975 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f549009e1d0 msgr2=0x7f5490121b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:05.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.937+0000 7f5496126700 1 --2- 172.21.15.26:0/2444821975 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f549009e1d0 0x7f5490121b50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f548400e840 tx=0x7f548400ec00 comp rx=0 tx=0).stop 2023-10-01T07:57:05.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.937+0000 7f5496126700 1 -- 172.21.15.26:0/2444821975 shutdown_connections 2023-10-01T07:57:05.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.937+0000 7f5496126700 1 --2- 172.21.15.26:0/2444821975 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5490139170 0x7f5490122090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:05.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.937+0000 7f5496126700 1 --2- 172.21.15.26:0/2444821975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f549009d6f0 0x7f5490121610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:05.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.937+0000 7f5496126700 1 --2- 172.21.15.26:0/2444821975 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f549009e1d0 0x7f5490121b50 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:05.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.937+0000 7f5496126700 1 -- 172.21.15.26:0/2444821975 >> 172.21.15.26:0/2444821975 conn(0x7f5490066f50 msgr2=0x7f54900a2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:05.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.937+0000 7f5496126700 1 -- 172.21.15.26:0/2444821975 shutdown_connections 2023-10-01T07:57:05.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:05.937+0000 7f5496126700 1 -- 172.21.15.26:0/2444821975 wait complete. 2023-10-01T07:57:05.951 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:05.953 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:06.406 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:06.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.552+0000 7f2ccf055700 1 Processor -- start 2023-10-01T07:57:06.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.552+0000 7f2ccf055700 1 -- start start 2023-10-01T07:57:06.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.552+0000 7f2ccf055700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2cc8133570 0x7f2cc8135950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:06.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.553+0000 7f2ccf055700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2cc8135e90 0x7f2cc8138270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:06.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.553+0000 7f2ccf055700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc809c280 con 0x7f2cc80954c0 2023-10-01T07:57:06.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.553+0000 7f2ccf055700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc809aaf0 con 0x7f2cc8135e90 2023-10-01T07:57:06.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.553+0000 7f2ccf055700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc809b960 con 0x7f2cc8133570 2023-10-01T07:57:06.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.553+0000 7f2ccd5f2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2cc8135e90 0x7f2cc8138270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:06.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.553+0000 7f2cc7fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2cc8133570 0x7f2cc8135950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:06.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.553+0000 7f2cccdf1700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2cc80954c0 0x7f2cc8095890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43878/0 (socket says 172.21.15.26:43878) 2023-10-01T07:57:06.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.553+0000 7f2cccdf1700 1 -- 172.21.15.26:0/804552219 learned_addr learned my addr 172.21.15.26:0/804552219 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:06.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.553+0000 7f2cc7fff700 1 -- 172.21.15.26:0/804552219 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2cc8135e90 msgr2=0x7f2cc8138270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:06.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.553+0000 7f2cc77fe700 1 -- 172.21.15.26:0/804552219 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 507424416 0 0) 0x7f2cc809c280 con 0x7f2cc80954c0 2023-10-01T07:57:06.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.553+0000 7f2cc7fff700 1 --2- 172.21.15.26:0/804552219 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2cc8135e90 0x7f2cc8138270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:06.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.553+0000 7f2cc7fff700 1 -- 172.21.15.26:0/804552219 >> v1:172.21.15.26:6789/0 conn(0x7f2cc80954c0 legacy=0x7f2cc8095890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:06.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.553+0000 7f2cc7fff700 1 -- 172.21.15.26:0/804552219 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc809a7b0 con 0x7f2cc8133570 2023-10-01T07:57:06.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.553+0000 7f2ccd5f2700 1 --2- 172.21.15.26:0/804552219 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2cc8135e90 0x7f2cc8138270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:06.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.553+0000 7f2cc7fff700 1 --2- 172.21.15.26:0/804552219 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2cc8133570 0x7f2cc8135950 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4009870 tx=0x7f2cb4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2d228d09ba63891 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:06.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.553+0000 7f2cc77fe700 1 -- 172.21.15.26:0/804552219 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb4011830 con 0x7f2cc8133570 2023-10-01T07:57:06.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.553+0000 7f2cc77fe700 1 -- 172.21.15.26:0/804552219 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb4011990 con 0x7f2cc8133570 2023-10-01T07:57:06.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.553+0000 7f2cc77fe700 1 -- 172.21.15.26:0/804552219 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb4011d20 con 0x7f2cc8133570 2023-10-01T07:57:06.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.554+0000 7f2ccf055700 1 -- 172.21.15.26:0/804552219 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2cc8133570 msgr2=0x7f2cc8135950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:06.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.554+0000 7f2ccf055700 1 --2- 172.21.15.26:0/804552219 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2cc8133570 0x7f2cc8135950 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4009870 tx=0x7f2cb4009b80 comp rx=0 tx=0).stop 2023-10-01T07:57:06.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.554+0000 7f2ccf055700 1 -- 172.21.15.26:0/804552219 shutdown_connections 2023-10-01T07:57:06.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.554+0000 7f2ccf055700 1 --2- 172.21.15.26:0/804552219 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2cc8135e90 0x7f2cc8138270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:06.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.554+0000 7f2ccf055700 1 --2- 172.21.15.26:0/804552219 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2cc8133570 0x7f2cc8135950 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:06.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.554+0000 7f2ccf055700 1 -- 172.21.15.26:0/804552219 >> 172.21.15.26:0/804552219 conn(0x7f2cc80a2360 msgr2=0x7f2cc80a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:06.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.554+0000 7f2ccf055700 1 -- 172.21.15.26:0/804552219 shutdown_connections 2023-10-01T07:57:06.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.554+0000 7f2ccf055700 1 -- 172.21.15.26:0/804552219 wait complete. 2023-10-01T07:57:06.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.555+0000 7f2ccf055700 1 Processor -- start 2023-10-01T07:57:06.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.555+0000 7f2ccf055700 1 -- start start 2023-10-01T07:57:06.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.556+0000 7f2ccf055700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cc80954c0 0x7f2cc8071870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:06.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.556+0000 7f2ccf055700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2cc8133570 0x7f2cc8071db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:06.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.556+0000 7f2ccf055700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2cc8135e90 0x7f2cc81c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:06.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.556+0000 7f2ccf055700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc8091010 con 0x7f2cc80954c0 2023-10-01T07:57:06.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.556+0000 7f2ccf055700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc80714b0 con 0x7f2cc8135e90 2023-10-01T07:57:06.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.556+0000 7f2ccf055700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc8135a80 con 0x7f2cc8133570 2023-10-01T07:57:06.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.556+0000 7f2cccdf1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cc80954c0 0x7f2cc8071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:06.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.556+0000 7f2cccdf1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cc80954c0 0x7f2cc8071870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57042/0 (socket says 172.21.15.26:57042) 2023-10-01T07:57:06.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.556+0000 7f2cc7fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2cc8133570 0x7f2cc8071db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:06.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.556+0000 7f2cccdf1700 1 -- 172.21.15.26:0/2419337901 learned_addr learned my addr 172.21.15.26:0/2419337901 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:06.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.556+0000 7f2ccd5f2700 1 --2- 172.21.15.26:0/2419337901 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2cc8135e90 0x7f2cc81c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:06.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.556+0000 7f2cc7fff700 1 -- 172.21.15.26:0/2419337901 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2cc8135e90 msgr2=0x7f2cc81c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:06.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.556+0000 7f2cc7fff700 1 --2- 172.21.15.26:0/2419337901 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2cc8135e90 0x7f2cc81c84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:06.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.556+0000 7f2cc7fff700 1 -- 172.21.15.26:0/2419337901 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cc80954c0 msgr2=0x7f2cc8071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:06.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.556+0000 7f2cc7fff700 1 --2- 172.21.15.26:0/2419337901 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cc80954c0 0x7f2cc8071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:06.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.556+0000 7f2cc7fff700 1 -- 172.21.15.26:0/2419337901 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc0009a70 con 0x7f2cc8133570 2023-10-01T07:57:06.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.556+0000 7f2cccdf1700 1 --2- 172.21.15.26:0/2419337901 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cc80954c0 0x7f2cc8071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:06.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.557+0000 7f2cc7fff700 1 --2- 172.21.15.26:0/2419337901 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2cc8133570 0x7f2cc8071db0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2cc809d3b0 tx=0x7f2cb4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:06.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.557+0000 7f2cc57fa700 1 -- 172.21.15.26:0/2419337901 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb4004450 con 0x7f2cc8133570 2023-10-01T07:57:06.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.557+0000 7f2cc57fa700 1 -- 172.21.15.26:0/2419337901 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb401f070 con 0x7f2cc8133570 2023-10-01T07:57:06.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.557+0000 7f2ccf055700 1 -- 172.21.15.26:0/2419337901 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb40094a0 con 0x7f2cc8133570 2023-10-01T07:57:06.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.557+0000 7f2cc57fa700 1 -- 172.21.15.26:0/2419337901 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb40038e0 con 0x7f2cc8133570 2023-10-01T07:57:06.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.557+0000 7f2ccf055700 1 -- 172.21.15.26:0/2419337901 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc808f3e0 con 0x7f2cc8133570 2023-10-01T07:57:06.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.558+0000 7f2cc57fa700 1 -- 172.21.15.26:0/2419337901 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2cb4003a40 con 0x7f2cc8133570 2023-10-01T07:57:06.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.558+0000 7f2cc57fa700 1 -- 172.21.15.26:0/2419337901 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2cb4021070 con 0x7f2cc8133570 2023-10-01T07:57:06.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.558+0000 7f2ccf055700 1 -- 172.21.15.26:0/2419337901 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cc8091150 con 0x7f2cc8133570 2023-10-01T07:57:06.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.563+0000 7f2cc57fa700 1 -- 172.21.15.26:0/2419337901 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2cc8091150 con 0x7f2cc8133570 2023-10-01T07:57:06.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.766+0000 7f2ccf055700 1 -- 172.21.15.26:0/2419337901 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2cc8091150 con 0x7f2cc8133570 2023-10-01T07:57:06.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.766+0000 7f2cc57fa700 1 -- 172.21.15.26:0/2419337901 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2cc8091150 con 0x7f2cc8133570 2023-10-01T07:57:06.767 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:06.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.768+0000 7f2ccf055700 1 -- 172.21.15.26:0/2419337901 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2cc8133570 msgr2=0x7f2cc8071db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:06.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.768+0000 7f2ccf055700 1 --2- 172.21.15.26:0/2419337901 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2cc8133570 0x7f2cc8071db0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2cc809d3b0 tx=0x7f2cb4004750 comp rx=0 tx=0).stop 2023-10-01T07:57:06.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.769+0000 7f2ccf055700 1 -- 172.21.15.26:0/2419337901 shutdown_connections 2023-10-01T07:57:06.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.769+0000 7f2ccf055700 1 --2- 172.21.15.26:0/2419337901 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2cc8135e90 0x7f2cc81c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:06.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.769+0000 7f2ccf055700 1 --2- 172.21.15.26:0/2419337901 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cc80954c0 0x7f2cc8071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:06.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.769+0000 7f2ccf055700 1 --2- 172.21.15.26:0/2419337901 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2cc8133570 0x7f2cc8071db0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:06.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.769+0000 7f2ccf055700 1 -- 172.21.15.26:0/2419337901 >> 172.21.15.26:0/2419337901 conn(0x7f2cc80a2360 msgr2=0x7f2cc80a0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:06.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.769+0000 7f2ccf055700 1 -- 172.21.15.26:0/2419337901 shutdown_connections 2023-10-01T07:57:06.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:06.769+0000 7f2ccf055700 1 -- 172.21.15.26:0/2419337901 wait complete. 2023-10-01T07:57:06.783 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:06.881 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:06.952 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:06.953 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:07.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.028+0000 7f5f2623c700 1 Processor -- start 2023-10-01T07:57:07.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.028+0000 7f5f2623c700 1 -- start start 2023-10-01T07:57:07.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.029+0000 7f5f2623c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5f2009e1d0 0x7f5f20135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:07.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.029+0000 7f5f2623c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f20135e50 0x7f5f20138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:07.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.029+0000 7f5f2623c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f2009f130 con 0x7f5f2009d6f0 2023-10-01T07:57:07.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.029+0000 7f5f2623c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f2009f520 con 0x7f5f2009e1d0 2023-10-01T07:57:07.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.029+0000 7f5f2623c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2009e930 con 0x7f5f20135e50 2023-10-01T07:57:07.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.029+0000 7f5f1effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5f2009e1d0 0x7f5f20135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:07.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.029+0000 7f5f1effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5f2009e1d0 0x7f5f20135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57046/0 (socket says 172.21.15.26:57046) 2023-10-01T07:57:07.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.029+0000 7f5f1effd700 1 -- 172.21.15.26:0/2390514612 learned_addr learned my addr 172.21.15.26:0/2390514612 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:07.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.029+0000 7f5f1ffff700 1 --2- 172.21.15.26:0/2390514612 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f20135e50 0x7f5f20138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:07.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.029+0000 7f5f1effd700 1 -- 172.21.15.26:0/2390514612 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f20135e50 msgr2=0x7f5f20138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:07.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.029+0000 7f5f1effd700 1 --2- 172.21.15.26:0/2390514612 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f20135e50 0x7f5f20138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:07.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.029+0000 7f5f1effd700 1 -- 172.21.15.26:0/2390514612 >> v1:172.21.15.26:6789/0 conn(0x7f5f2009d6f0 legacy=0x7f5f2009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:07.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.029+0000 7f5f1effd700 1 -- 172.21.15.26:0/2390514612 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2009b2d0 con 0x7f5f2009e1d0 2023-10-01T07:57:07.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.029+0000 7f5f1effd700 1 --2- 172.21.15.26:0/2390514612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f2009e1d0 0x7f5f20135910 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f5f140098f0 tx=0x7f5f14009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3a7ff0566135428 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:07.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.030+0000 7f5f1e7fc700 1 -- 172.21.15.26:0/2390514612 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f14011830 con 0x7f5f2009e1d0 2023-10-01T07:57:07.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.030+0000 7f5f1e7fc700 1 -- 172.21.15.26:0/2390514612 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f14011990 con 0x7f5f2009e1d0 2023-10-01T07:57:07.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.030+0000 7f5f1e7fc700 1 -- 172.21.15.26:0/2390514612 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f14011d20 con 0x7f5f2009e1d0 2023-10-01T07:57:07.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.031+0000 7f5f2623c700 1 -- 172.21.15.26:0/2390514612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f2009e1d0 msgr2=0x7f5f20135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:07.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.031+0000 7f5f2623c700 1 --2- 172.21.15.26:0/2390514612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f2009e1d0 0x7f5f20135910 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f5f140098f0 tx=0x7f5f14009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:07.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.031+0000 7f5f2623c700 1 -- 172.21.15.26:0/2390514612 shutdown_connections 2023-10-01T07:57:07.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.031+0000 7f5f2623c700 1 --2- 172.21.15.26:0/2390514612 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f20135e50 0x7f5f20138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:07.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.031+0000 7f5f2623c700 1 --2- 172.21.15.26:0/2390514612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f2009e1d0 0x7f5f20135910 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:07.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.031+0000 7f5f2623c700 1 -- 172.21.15.26:0/2390514612 >> 172.21.15.26:0/2390514612 conn(0x7f5f20066f50 msgr2=0x7f5f2009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:07.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.031+0000 7f5f2623c700 1 -- 172.21.15.26:0/2390514612 shutdown_connections 2023-10-01T07:57:07.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.031+0000 7f5f2623c700 1 -- 172.21.15.26:0/2390514612 wait complete. 2023-10-01T07:57:07.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.032+0000 7f5f2623c700 1 Processor -- start 2023-10-01T07:57:07.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.033+0000 7f5f2623c700 1 -- start start 2023-10-01T07:57:07.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.033+0000 7f5f2623c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f2009d6f0 0x7f5f20132860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:07.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.033+0000 7f5f2623c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f2009e1d0 0x7f5f20132da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:07.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.033+0000 7f5f2623c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f20135e50 0x7f5f201332e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:07.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.033+0000 7f5f2623c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f201199b0 con 0x7f5f2009d6f0 2023-10-01T07:57:07.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.033+0000 7f5f2623c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f20134a90 con 0x7f5f20135e50 2023-10-01T07:57:07.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.033+0000 7f5f2623c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f20135b10 con 0x7f5f2009e1d0 2023-10-01T07:57:07.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.033+0000 7f5f1f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f2009d6f0 0x7f5f20132860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:07.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.034+0000 7f5f1ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f20135e50 0x7f5f201332e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:07.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.034+0000 7f5f1f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f2009d6f0 0x7f5f20132860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57056/0 (socket says 172.21.15.26:57056) 2023-10-01T07:57:07.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.034+0000 7f5f1f7fe700 1 -- 172.21.15.26:0/645396797 learned_addr learned my addr 172.21.15.26:0/645396797 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:07.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.034+0000 7f5f1effd700 1 --2- 172.21.15.26:0/645396797 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f2009e1d0 0x7f5f20132da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:07.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.034+0000 7f5f1f7fe700 1 -- 172.21.15.26:0/645396797 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f2009e1d0 msgr2=0x7f5f20132da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:07.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.034+0000 7f5f1f7fe700 1 --2- 172.21.15.26:0/645396797 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f2009e1d0 0x7f5f20132da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:07.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.034+0000 7f5f1f7fe700 1 -- 172.21.15.26:0/645396797 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f20135e50 msgr2=0x7f5f201332e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:07.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.034+0000 7f5f1f7fe700 1 --2- 172.21.15.26:0/645396797 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f20135e50 0x7f5f201332e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:07.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.034+0000 7f5f1f7fe700 1 -- 172.21.15.26:0/645396797 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f14009550 con 0x7f5f2009d6f0 2023-10-01T07:57:07.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.034+0000 7f5f1effd700 1 --2- 172.21.15.26:0/645396797 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f2009e1d0 0x7f5f20132da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:07.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.034+0000 7f5f1f7fe700 1 --2- 172.21.15.26:0/645396797 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f2009d6f0 0x7f5f20132860 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f5f1000c450 tx=0x7f5f1000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:07.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.034+0000 7f5f07fff700 1 -- 172.21.15.26:0/645396797 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f100052d0 con 0x7f5f2009d6f0 2023-10-01T07:57:07.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.034+0000 7f5f07fff700 1 -- 172.21.15.26:0/645396797 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f10005430 con 0x7f5f2009d6f0 2023-10-01T07:57:07.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.034+0000 7f5f2623c700 1 -- 172.21.15.26:0/645396797 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f2009c700 con 0x7f5f2009d6f0 2023-10-01T07:57:07.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.034+0000 7f5f07fff700 1 -- 172.21.15.26:0/645396797 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f100038c0 con 0x7f5f2009d6f0 2023-10-01T07:57:07.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.034+0000 7f5f2623c700 1 -- 172.21.15.26:0/645396797 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f200a22b0 con 0x7f5f2009d6f0 2023-10-01T07:57:07.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.036+0000 7f5f07fff700 1 -- 172.21.15.26:0/645396797 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5f10003a20 con 0x7f5f2009d6f0 2023-10-01T07:57:07.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.036+0000 7f5f2623c700 1 -- 172.21.15.26:0/645396797 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f20071700 con 0x7f5f2009d6f0 2023-10-01T07:57:07.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.036+0000 7f5f07fff700 1 -- 172.21.15.26:0/645396797 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5f1003e980 con 0x7f5f2009d6f0 2023-10-01T07:57:07.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.045+0000 7f5f07fff700 1 -- 172.21.15.26:0/645396797 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5f10019b40 con 0x7f5f2009d6f0 2023-10-01T07:57:07.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.097+0000 7f82a1b6e700 1 Processor -- start 2023-10-01T07:57:07.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.097+0000 7f82a1b6e700 1 -- start start 2023-10-01T07:57:07.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.097+0000 7f82a1b6e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f829c09d6f0 0x7f829c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:07.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.097+0000 7f82a1b6e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f829c09e000 0x7f829c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:07.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.098+0000 7f82a1b6e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f829c09e410 0x7f829c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:07.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.098+0000 7f82a1b6e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f829c09f520 con 0x7f829c09e410 2023-10-01T07:57:07.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.098+0000 7f82a1b6e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829c09f130 con 0x7f829c09e000 2023-10-01T07:57:07.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.098+0000 7f82a1b6e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f829c09e930 con 0x7f829c09d6f0 2023-10-01T07:57:07.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.098+0000 7f829affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f829c09e000 0x7f829c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:07.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.098+0000 7f829b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f829c09d6f0 0x7f829c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:07.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.098+0000 7f829affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f829c09e000 0x7f829c130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:39232/0 (socket says 172.21.15.26:39232) 2023-10-01T07:57:07.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.098+0000 7f829b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f829c09d6f0 0x7f829c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:43880/0 (socket says 172.21.15.26:43880) 2023-10-01T07:57:07.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.098+0000 7f829affd700 1 -- 172.21.15.26:0/2954357398 learned_addr learned my addr 172.21.15.26:0/2954357398 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:07.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.098+0000 7f829bfff700 1 --2- 172.21.15.26:0/2954357398 >> v2:172.21.15.26:3300/0 conn(0x7f829c09e410 0x7f829c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:07.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.098+0000 7f829affd700 1 -- 172.21.15.26:0/2954357398 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f829c09d6f0 msgr2=0x7f829c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:07.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.098+0000 7f829affd700 1 --2- 172.21.15.26:0/2954357398 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f829c09d6f0 0x7f829c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:07.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.098+0000 7f829affd700 1 -- 172.21.15.26:0/2954357398 >> v2:172.21.15.26:3300/0 conn(0x7f829c09e410 msgr2=0x7f829c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:07.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.098+0000 7f829affd700 1 --2- 172.21.15.26:0/2954357398 >> v2:172.21.15.26:3300/0 conn(0x7f829c09e410 0x7f829c130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:07.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.098+0000 7f829affd700 1 -- 172.21.15.26:0/2954357398 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829c09b2d0 con 0x7f829c09e000 2023-10-01T07:57:07.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.098+0000 7f829affd700 1 --2- 172.21.15.26:0/2954357398 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f829c09e000 0x7f829c130660 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8290009920 tx=0x7f8290009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9498e77f32ab8d53 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:07.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.099+0000 7f829a7fc700 1 -- 172.21.15.26:0/2954357398 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8290011830 con 0x7f829c09e000 2023-10-01T07:57:07.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.099+0000 7f829a7fc700 1 -- 172.21.15.26:0/2954357398 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8290011990 con 0x7f829c09e000 2023-10-01T07:57:07.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.099+0000 7f829a7fc700 1 -- 172.21.15.26:0/2954357398 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8290011d20 con 0x7f829c09e000 2023-10-01T07:57:07.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.099+0000 7f82a1b6e700 1 -- 172.21.15.26:0/2954357398 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f829c09e000 msgr2=0x7f829c130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:07.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.099+0000 7f82a1b6e700 1 --2- 172.21.15.26:0/2954357398 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f829c09e000 0x7f829c130660 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8290009920 tx=0x7f8290009c30 comp rx=0 tx=0).stop 2023-10-01T07:57:07.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.099+0000 7f82a1b6e700 1 -- 172.21.15.26:0/2954357398 shutdown_connections 2023-10-01T07:57:07.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.099+0000 7f82a1b6e700 1 --2- 172.21.15.26:0/2954357398 >> v2:172.21.15.26:3300/0 conn(0x7f829c09e410 0x7f829c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:07.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.099+0000 7f82a1b6e700 1 --2- 172.21.15.26:0/2954357398 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f829c09d6f0 0x7f829c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:07.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.099+0000 7f82a1b6e700 1 --2- 172.21.15.26:0/2954357398 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f829c09e000 0x7f829c130660 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:07.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.099+0000 7f82a1b6e700 1 -- 172.21.15.26:0/2954357398 >> 172.21.15.26:0/2954357398 conn(0x7f829c066f50 msgr2=0x7f829c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:07.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.099+0000 7f82a1b6e700 1 -- 172.21.15.26:0/2954357398 shutdown_connections 2023-10-01T07:57:07.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.099+0000 7f82a1b6e700 1 -- 172.21.15.26:0/2954357398 wait complete. 2023-10-01T07:57:07.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.100+0000 7f82a1b6e700 1 Processor -- start 2023-10-01T07:57:07.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.101+0000 7f82a1b6e700 1 -- start start 2023-10-01T07:57:07.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.101+0000 7f82a1b6e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f829c09d6f0 0x7f829c11df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:07.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.101+0000 7f82a1b6e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f829c09e000 0x7f829c11e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:07.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.101+0000 7f82a1b6e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f829c09e410 0x7f829c11e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:07.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.101+0000 7f82a1b6e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829c1217b0 con 0x7f829c09e000 2023-10-01T07:57:07.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.101+0000 7f82a1b6e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829c1302b0 con 0x7f829c09d6f0 2023-10-01T07:57:07.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.101+0000 7f82a1b6e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f829c120d30 con 0x7f829c09e410 2023-10-01T07:57:07.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.101+0000 7f829affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f829c09e000 0x7f829c11e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:07.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.101+0000 7f829bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f829c09e410 0x7f829c11e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:07.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.101+0000 7f829affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f829c09e000 0x7f829c11e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57082/0 (socket says 172.21.15.26:57082) 2023-10-01T07:57:07.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.101+0000 7f829affd700 1 -- 172.21.15.26:0/3869600595 learned_addr learned my addr 172.21.15.26:0/3869600595 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:07.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.102+0000 7f829b7fe700 1 --2- 172.21.15.26:0/3869600595 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f829c09d6f0 0x7f829c11df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:07.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.102+0000 7f829affd700 1 -- 172.21.15.26:0/3869600595 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f829c09e410 msgr2=0x7f829c11e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:07.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.102+0000 7f829affd700 1 --2- 172.21.15.26:0/3869600595 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f829c09e410 0x7f829c11e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:07.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.102+0000 7f829affd700 1 -- 172.21.15.26:0/3869600595 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f829c09d6f0 msgr2=0x7f829c11df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:07.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.102+0000 7f829affd700 1 --2- 172.21.15.26:0/3869600595 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f829c09d6f0 0x7f829c11df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:07.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.102+0000 7f829affd700 1 -- 172.21.15.26:0/3869600595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8290009550 con 0x7f829c09e000 2023-10-01T07:57:07.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.102+0000 7f829bfff700 1 --2- 172.21.15.26:0/3869600595 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f829c09e410 0x7f829c11e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:07.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.102+0000 7f829affd700 1 --2- 172.21.15.26:0/3869600595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f829c09e000 0x7f829c11e460 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f8290009c70 tx=0x7f8290004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:07.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.102+0000 7f602ed63700 1 Processor -- start 2023-10-01T07:57:07.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.102+0000 7f8283fff700 1 -- 172.21.15.26:0/3869600595 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8290004240 con 0x7f829c09e000 2023-10-01T07:57:07.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.102+0000 7f602ed63700 1 -- start start 2023-10-01T07:57:07.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.102+0000 7f8283fff700 1 -- 172.21.15.26:0/3869600595 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f829001f070 con 0x7f829c09e000 2023-10-01T07:57:07.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.102+0000 7f82a1b6e700 1 -- 172.21.15.26:0/3869600595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f829c121180 con 0x7f829c09e000 2023-10-01T07:57:07.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.102+0000 7f8283fff700 1 -- 172.21.15.26:0/3869600595 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82900036a0 con 0x7f829c09e000 2023-10-01T07:57:07.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.102+0000 7f82a1b6e700 1 -- 172.21.15.26:0/3869600595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f829c0a39f0 con 0x7f829c09e000 2023-10-01T07:57:07.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.103+0000 7f602ed63700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f602809d6f0 0x7f602809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:07.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.103+0000 7f602ed63700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f602809e410 0x7f6028130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:07.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.103+0000 7f602ed63700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f602809f130 con 0x7f602809e000 2023-10-01T07:57:07.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.103+0000 7f602ed63700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f602809f520 con 0x7f602809e410 2023-10-01T07:57:07.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.103+0000 7f602ed63700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602809e930 con 0x7f602809d6f0 2023-10-01T07:57:07.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.103+0000 7f8283fff700 1 -- 172.21.15.26:0/3869600595 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8290021030 con 0x7f829c09e000 2023-10-01T07:57:07.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.103+0000 7f6027fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f602809e000 0x7f6028130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43888/0 (socket says 172.21.15.26:43888) 2023-10-01T07:57:07.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.103+0000 7f602d300700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f602809e410 0x7f6028130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:07.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.103+0000 7f6027fff700 1 -- 172.21.15.26:0/144603397 learned_addr learned my addr 172.21.15.26:0/144603397 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:07.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.104+0000 7f602caff700 1 --2- 172.21.15.26:0/144603397 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f602809d6f0 0x7f602809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:07.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.104+0000 7f8283fff700 1 -- 172.21.15.26:0/3869600595 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8290040870 con 0x7f829c09e000 2023-10-01T07:57:07.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.104+0000 7f60277fe700 1 -- 172.21.15.26:0/144603397 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1267665048 0 0) 0x7f602809f130 con 0x7f602809e000 2023-10-01T07:57:07.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.104+0000 7f602caff700 1 -- 172.21.15.26:0/144603397 >> v2:172.21.15.26:3300/0 conn(0x7f602809e410 msgr2=0x7f6028130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:07.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.104+0000 7f602caff700 1 --2- 172.21.15.26:0/144603397 >> v2:172.21.15.26:3300/0 conn(0x7f602809e410 0x7f6028130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:07.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.104+0000 7f602caff700 1 -- 172.21.15.26:0/144603397 >> v1:172.21.15.26:6789/0 conn(0x7f602809e000 legacy=0x7f6028130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:07.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.104+0000 7f82a1b6e700 1 -- 172.21.15.26:0/3869600595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f829c074ea0 con 0x7f829c09e000 2023-10-01T07:57:07.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.104+0000 7f602caff700 1 -- 172.21.15.26:0/144603397 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602809b2d0 con 0x7f602809d6f0 2023-10-01T07:57:07.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.104+0000 7f602caff700 1 --2- 172.21.15.26:0/144603397 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f602809d6f0 0x7f602809dac0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6018009840 tx=0x7f6018009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c48da167ca8bf885 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:07.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.104+0000 7f60277fe700 1 -- 172.21.15.26:0/144603397 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6018011830 con 0x7f602809d6f0 2023-10-01T07:57:07.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.104+0000 7f60277fe700 1 -- 172.21.15.26:0/144603397 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6018011990 con 0x7f602809d6f0 2023-10-01T07:57:07.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.104+0000 7f60277fe700 1 -- 172.21.15.26:0/144603397 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6018011d20 con 0x7f602809d6f0 2023-10-01T07:57:07.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.105+0000 7f602ed63700 1 -- 172.21.15.26:0/144603397 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f602809d6f0 msgr2=0x7f602809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:07.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.105+0000 7f602ed63700 1 --2- 172.21.15.26:0/144603397 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f602809d6f0 0x7f602809dac0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6018009840 tx=0x7f6018009b50 comp rx=0 tx=0).stop 2023-10-01T07:57:07.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.105+0000 7f602ed63700 1 -- 172.21.15.26:0/144603397 shutdown_connections 2023-10-01T07:57:07.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.105+0000 7f602ed63700 1 --2- 172.21.15.26:0/144603397 >> v2:172.21.15.26:3300/0 conn(0x7f602809e410 0x7f6028130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:07.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.105+0000 7f602ed63700 1 --2- 172.21.15.26:0/144603397 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f602809d6f0 0x7f602809dac0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:07.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.105+0000 7f602ed63700 1 -- 172.21.15.26:0/144603397 >> 172.21.15.26:0/144603397 conn(0x7f6028066f50 msgr2=0x7f602809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:07.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.105+0000 7f602ed63700 1 -- 172.21.15.26:0/144603397 shutdown_connections 2023-10-01T07:57:07.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.105+0000 7f602ed63700 1 -- 172.21.15.26:0/144603397 wait complete. 2023-10-01T07:57:07.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.106+0000 7f602ed63700 1 Processor -- start 2023-10-01T07:57:07.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.106+0000 7f602ed63700 1 -- start start 2023-10-01T07:57:07.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.107+0000 7f602ed63700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f602809d6f0 0x7f602811f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:07.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.107+0000 7f602ed63700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f602809e000 0x7f602811f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:07.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.107+0000 7f602ed63700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f602809e410 0x7f602811fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:07.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.107+0000 7f602ed63700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6028130420 con 0x7f602809d6f0 2023-10-01T07:57:07.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.107+0000 7f602ed63700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6028126920 con 0x7f602809e000 2023-10-01T07:57:07.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.107+0000 7f602ed63700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6028125c60 con 0x7f602809e410 2023-10-01T07:57:07.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.107+0000 7f6027fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f602809e000 0x7f602811f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:07.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.107+0000 7f602d300700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f602809e410 0x7f602811fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:07.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.107+0000 7f6027fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f602809e000 0x7f602811f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:39244/0 (socket says 172.21.15.26:39244) 2023-10-01T07:57:07.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.107+0000 7f6027fff700 1 -- 172.21.15.26:0/1867174030 learned_addr learned my addr 172.21.15.26:0/1867174030 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:07.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.107+0000 7f602caff700 1 --2- 172.21.15.26:0/1867174030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f602809d6f0 0x7f602811f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:07.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.107+0000 7f602d300700 1 -- 172.21.15.26:0/1867174030 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f602809e000 msgr2=0x7f602811f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:07.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.107+0000 7f602d300700 1 --2- 172.21.15.26:0/1867174030 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f602809e000 0x7f602811f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:07.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.107+0000 7f602d300700 1 -- 172.21.15.26:0/1867174030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f602809d6f0 msgr2=0x7f602811f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:07.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.107+0000 7f602d300700 1 --2- 172.21.15.26:0/1867174030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f602809d6f0 0x7f602811f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:07.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.107+0000 7f602d300700 1 -- 172.21.15.26:0/1867174030 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60180094a0 con 0x7f602809e410 2023-10-01T07:57:07.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.107+0000 7f6027fff700 1 --2- 172.21.15.26:0/1867174030 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f602809e000 0x7f602811f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:07.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.108+0000 7f602d300700 1 --2- 172.21.15.26:0/1867174030 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f602809e410 0x7f602811fc70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f602000efc0 tx=0x7f602000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:07.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.108+0000 7f60257fa700 1 -- 172.21.15.26:0/1867174030 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602000cc90 con 0x7f602809e410 2023-10-01T07:57:07.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.108+0000 7f60257fa700 1 -- 172.21.15.26:0/1867174030 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602000f040 con 0x7f602809e410 2023-10-01T07:57:07.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.108+0000 7f60257fa700 1 -- 172.21.15.26:0/1867174030 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6020009e60 con 0x7f602809e410 2023-10-01T07:57:07.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.108+0000 7f602ed63700 1 -- 172.21.15.26:0/1867174030 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f602806b2f0 con 0x7f602809e410 2023-10-01T07:57:07.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.108+0000 7f602ed63700 1 -- 172.21.15.26:0/1867174030 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6028125f40 con 0x7f602809e410 2023-10-01T07:57:07.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.109+0000 7f60257fa700 1 -- 172.21.15.26:0/1867174030 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6020014480 con 0x7f602809e410 2023-10-01T07:57:07.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.109+0000 7f60257fa700 1 -- 172.21.15.26:0/1867174030 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f602003fe20 con 0x7f602809e410 2023-10-01T07:57:07.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.109+0000 7f602ed63700 1 -- 172.21.15.26:0/1867174030 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6028125da0 con 0x7f602809e410 2023-10-01T07:57:07.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.111+0000 7f8283fff700 1 -- 172.21.15.26:0/3869600595 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8290015080 con 0x7f829c09e000 2023-10-01T07:57:07.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.118+0000 7f60257fa700 1 -- 172.21.15.26:0/1867174030 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6028125da0 con 0x7f602809e410 2023-10-01T07:57:07.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.261+0000 7f5f2623c700 1 -- 172.21.15.26:0/645396797 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5f20074ea0 con 0x7f5f2009d6f0 2023-10-01T07:57:07.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.261+0000 7f5f07fff700 1 -- 172.21.15.26:0/645396797 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f10017070 con 0x7f5f2009d6f0 2023-10-01T07:57:07.262 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:07.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.263+0000 7f5f2623c700 1 -- 172.21.15.26:0/645396797 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f2009d6f0 msgr2=0x7f5f20132860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:07.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.263+0000 7f5f2623c700 1 --2- 172.21.15.26:0/645396797 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f2009d6f0 0x7f5f20132860 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f5f1000c450 tx=0x7f5f1000c760 comp rx=0 tx=0).stop 2023-10-01T07:57:07.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.263+0000 7f5f2623c700 1 -- 172.21.15.26:0/645396797 shutdown_connections 2023-10-01T07:57:07.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.263+0000 7f5f2623c700 1 --2- 172.21.15.26:0/645396797 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f20135e50 0x7f5f201332e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:07.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.263+0000 7f5f2623c700 1 --2- 172.21.15.26:0/645396797 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f2009d6f0 0x7f5f20132860 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:07.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.263+0000 7f5f2623c700 1 --2- 172.21.15.26:0/645396797 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f2009e1d0 0x7f5f20132da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:07.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.264+0000 7f5f2623c700 1 -- 172.21.15.26:0/645396797 >> 172.21.15.26:0/645396797 conn(0x7f5f20066f50 msgr2=0x7f5f2006e840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:07.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.264+0000 7f5f2623c700 1 -- 172.21.15.26:0/645396797 shutdown_connections 2023-10-01T07:57:07.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.264+0000 7f5f2623c700 1 -- 172.21.15.26:0/645396797 wait complete. 2023-10-01T07:57:07.279 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:07.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.352+0000 7f82a1b6e700 1 -- 172.21.15.26:0/3869600595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f829c06c360 con 0x7f829c09e000 2023-10-01T07:57:07.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.353+0000 7f8283fff700 1 -- 172.21.15.26:0/3869600595 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f82900239c0 con 0x7f829c09e000 2023-10-01T07:57:07.354 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:07.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.355+0000 7f82a1b6e700 1 -- 172.21.15.26:0/3869600595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f829c09e000 msgr2=0x7f829c11e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:07.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.355+0000 7f82a1b6e700 1 --2- 172.21.15.26:0/3869600595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f829c09e000 0x7f829c11e460 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f8290009c70 tx=0x7f8290004750 comp rx=0 tx=0).stop 2023-10-01T07:57:07.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.355+0000 7f82a1b6e700 1 -- 172.21.15.26:0/3869600595 shutdown_connections 2023-10-01T07:57:07.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.355+0000 7f82a1b6e700 1 --2- 172.21.15.26:0/3869600595 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f829c09e410 0x7f829c11e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:07.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.355+0000 7f82a1b6e700 1 --2- 172.21.15.26:0/3869600595 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f829c09d6f0 0x7f829c11df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:07.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.355+0000 7f82a1b6e700 1 --2- 172.21.15.26:0/3869600595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f829c09e000 0x7f829c11e460 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:07.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.355+0000 7f82a1b6e700 1 -- 172.21.15.26:0/3869600595 >> 172.21.15.26:0/3869600595 conn(0x7f829c066f50 msgr2=0x7f829c070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:07.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.355+0000 7f82a1b6e700 1 -- 172.21.15.26:0/3869600595 shutdown_connections 2023-10-01T07:57:07.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.355+0000 7f82a1b6e700 1 -- 172.21.15.26:0/3869600595 wait complete. 2023-10-01T07:57:07.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.355+0000 7f602ed63700 1 -- 172.21.15.26:0/1867174030 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6028125da0 con 0x7f602809e410 2023-10-01T07:57:07.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.356+0000 7f60257fa700 1 -- 172.21.15.26:0/1867174030 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6028125da0 con 0x7f602809e410 2023-10-01T07:57:07.357 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:07.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.358+0000 7f602ed63700 1 -- 172.21.15.26:0/1867174030 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f602809e410 msgr2=0x7f602811fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:07.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.358+0000 7f602ed63700 1 --2- 172.21.15.26:0/1867174030 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f602809e410 0x7f602811fc70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f602000efc0 tx=0x7f602000c3a0 comp rx=0 tx=0).stop 2023-10-01T07:57:07.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.358+0000 7f602ed63700 1 -- 172.21.15.26:0/1867174030 shutdown_connections 2023-10-01T07:57:07.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.358+0000 7f602ed63700 1 --2- 172.21.15.26:0/1867174030 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f602809e410 0x7f602811fc70 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:07.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.358+0000 7f602ed63700 1 --2- 172.21.15.26:0/1867174030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f602809d6f0 0x7f602811f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:07.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.358+0000 7f602ed63700 1 --2- 172.21.15.26:0/1867174030 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f602809e000 0x7f602811f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:07.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.358+0000 7f602ed63700 1 -- 172.21.15.26:0/1867174030 >> 172.21.15.26:0/1867174030 conn(0x7f6028066f50 msgr2=0x7f6028070130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:07.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.358+0000 7f602ed63700 1 -- 172.21.15.26:0/1867174030 shutdown_connections 2023-10-01T07:57:07.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.358+0000 7f602ed63700 1 -- 172.21.15.26:0/1867174030 wait complete. 2023-10-01T07:57:07.371 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:07.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:07.784 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:07.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.929+0000 7f96adb0f700 1 Processor -- start 2023-10-01T07:57:07.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.929+0000 7f96adb0f700 1 -- start start 2023-10-01T07:57:07.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.929+0000 7f96adb0f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96a806a770 0x7f96a806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:07.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.929+0000 7f96adb0f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f96a806b080 0x7f96a8131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:07.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.929+0000 7f96adb0f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a809ece0 con 0x7f96a8131b40 2023-10-01T07:57:07.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.929+0000 7f96adb0f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a809e760 con 0x7f96a806b080 2023-10-01T07:57:07.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.929+0000 7f96adb0f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a809e040 con 0x7f96a806a770 2023-10-01T07:57:07.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.929+0000 7f96a77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96a806a770 0x7f96a806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:07.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.929+0000 7f96a6ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f96a806b080 0x7f96a8131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:07.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.929+0000 7f96a77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96a806a770 0x7f96a806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:39260/0 (socket says 172.21.15.26:39260) 2023-10-01T07:57:07.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.929+0000 7f96a6ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f96a806b080 0x7f96a8131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57118/0 (socket says 172.21.15.26:57118) 2023-10-01T07:57:07.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.929+0000 7f96a77fe700 1 -- 172.21.15.26:0/2438399285 learned_addr learned my addr 172.21.15.26:0/2438399285 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:07.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.930+0000 7f96a6ffd700 1 -- 172.21.15.26:0/2438399285 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96a806a770 msgr2=0x7f96a806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:07.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.930+0000 7f96a6ffd700 1 --2- 172.21.15.26:0/2438399285 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96a806a770 0x7f96a806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:07.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.930+0000 7f96a6ffd700 1 -- 172.21.15.26:0/2438399285 >> v1:172.21.15.26:6789/0 conn(0x7f96a8131b40 legacy=0x7f96a8138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:07.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.930+0000 7f96a6ffd700 1 -- 172.21.15.26:0/2438399285 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a809f630 con 0x7f96a806b080 2023-10-01T07:57:07.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.930+0000 7f96a77fe700 1 --2- 172.21.15.26:0/2438399285 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96a806a770 0x7f96a806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:07.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.930+0000 7f96a6ffd700 1 --2- 172.21.15.26:0/2438399285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96a806b080 0x7f96a8131600 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f9698009840 tx=0x7f9698009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2934e2df7962a0ac server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:07.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.930+0000 7f96a67fc700 1 -- 172.21.15.26:0/2438399285 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9698011830 con 0x7f96a806b080 2023-10-01T07:57:07.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.930+0000 7f96a67fc700 1 -- 172.21.15.26:0/2438399285 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9698011990 con 0x7f96a806b080 2023-10-01T07:57:07.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.930+0000 7f96a67fc700 1 -- 172.21.15.26:0/2438399285 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9698011d20 con 0x7f96a806b080 2023-10-01T07:57:07.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.931+0000 7f96adb0f700 1 -- 172.21.15.26:0/2438399285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96a806b080 msgr2=0x7f96a8131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:07.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.931+0000 7f96adb0f700 1 --2- 172.21.15.26:0/2438399285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96a806b080 0x7f96a8131600 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f9698009840 tx=0x7f9698009b50 comp rx=0 tx=0).stop 2023-10-01T07:57:07.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.931+0000 7f96adb0f700 1 -- 172.21.15.26:0/2438399285 shutdown_connections 2023-10-01T07:57:07.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.931+0000 7f96adb0f700 1 --2- 172.21.15.26:0/2438399285 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96a806a770 0x7f96a806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:07.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.931+0000 7f96adb0f700 1 --2- 172.21.15.26:0/2438399285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96a806b080 0x7f96a8131600 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:07.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.931+0000 7f96adb0f700 1 -- 172.21.15.26:0/2438399285 >> 172.21.15.26:0/2438399285 conn(0x7f96a8066f50 msgr2=0x7f96a809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:07.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.931+0000 7f96adb0f700 1 -- 172.21.15.26:0/2438399285 shutdown_connections 2023-10-01T07:57:07.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.931+0000 7f96adb0f700 1 -- 172.21.15.26:0/2438399285 wait complete. 2023-10-01T07:57:07.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.932+0000 7f96adb0f700 1 Processor -- start 2023-10-01T07:57:07.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.932+0000 7f96adb0f700 1 -- start start 2023-10-01T07:57:07.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.933+0000 7f96adb0f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96a806a770 0x7f96a81c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:07.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.933+0000 7f96adb0f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96a806b080 0x7f96a81c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:07.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.933+0000 7f96adb0f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96a8131b40 0x7f96a81c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:07.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.933+0000 7f96adb0f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a809c200 con 0x7f96a8131b40 2023-10-01T07:57:07.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.933+0000 7f96adb0f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a809c010 con 0x7f96a806b080 2023-10-01T07:57:07.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.933+0000 7f96adb0f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96a81313c0 con 0x7f96a806a770 2023-10-01T07:57:07.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.933+0000 7f96a77fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96a806a770 0x7f96a81c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:07.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.933+0000 7f96a6ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96a806b080 0x7f96a81c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:07.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.933+0000 7f96a7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96a8131b40 0x7f96a81c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:07.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.933+0000 7f96a7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96a8131b40 0x7f96a81c8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57128/0 (socket says 172.21.15.26:57128) 2023-10-01T07:57:07.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.933+0000 7f96a77fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96a806a770 0x7f96a81c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:43914/0 (socket says 172.21.15.26:43914) 2023-10-01T07:57:07.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.933+0000 7f96a7fff700 1 -- 172.21.15.26:0/2396049923 learned_addr learned my addr 172.21.15.26:0/2396049923 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:07.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.933+0000 7f96a7fff700 1 -- 172.21.15.26:0/2396049923 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96a806a770 msgr2=0x7f96a81c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:07.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.933+0000 7f96a7fff700 1 --2- 172.21.15.26:0/2396049923 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96a806a770 0x7f96a81c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:07.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.933+0000 7f96a7fff700 1 -- 172.21.15.26:0/2396049923 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96a806b080 msgr2=0x7f96a81c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:07.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.933+0000 7f96a7fff700 1 --2- 172.21.15.26:0/2396049923 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96a806b080 0x7f96a81c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:07.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.933+0000 7f96a7fff700 1 -- 172.21.15.26:0/2396049923 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969c009550 con 0x7f96a8131b40 2023-10-01T07:57:07.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.933+0000 7f96a6ffd700 1 --2- 172.21.15.26:0/2396049923 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96a806b080 0x7f96a81c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:07.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.933+0000 7f96a7fff700 1 --2- 172.21.15.26:0/2396049923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96a8131b40 0x7f96a81c8ca0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f96a000cc80 tx=0x7f96a000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:07.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.933+0000 7f968ffff700 1 -- 172.21.15.26:0/2396049923 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a0003c00 con 0x7f96a8131b40 2023-10-01T07:57:07.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.933+0000 7f968ffff700 1 -- 172.21.15.26:0/2396049923 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a0003d60 con 0x7f96a8131b40 2023-10-01T07:57:07.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.933+0000 7f96adb0f700 1 -- 172.21.15.26:0/2396049923 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96980094a0 con 0x7f96a8131b40 2023-10-01T07:57:07.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.933+0000 7f968ffff700 1 -- 172.21.15.26:0/2396049923 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a000aaa0 con 0x7f96a8131b40 2023-10-01T07:57:07.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.934+0000 7f96adb0f700 1 -- 172.21.15.26:0/2396049923 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a8121d70 con 0x7f96a8131b40 2023-10-01T07:57:07.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.934+0000 7f968ffff700 1 -- 172.21.15.26:0/2396049923 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f96a000ac00 con 0x7f96a8131b40 2023-10-01T07:57:07.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.934+0000 7f968ffff700 1 -- 172.21.15.26:0/2396049923 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f96a003f620 con 0x7f96a8131b40 2023-10-01T07:57:07.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.935+0000 7f96adb0f700 1 -- 172.21.15.26:0/2396049923 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a8071e60 con 0x7f96a8131b40 2023-10-01T07:57:07.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:07.939+0000 7f968ffff700 1 -- 172.21.15.26:0/2396049923 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f96a00198f0 con 0x7f96a8131b40 2023-10-01T07:57:08.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.150+0000 7f96adb0f700 1 -- 172.21.15.26:0/2396049923 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f96a8131630 con 0x7f96a8131b40 2023-10-01T07:57:08.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.150+0000 7f968ffff700 1 -- 172.21.15.26:0/2396049923 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f96a0019300 con 0x7f96a8131b40 2023-10-01T07:57:08.151 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:08.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.152+0000 7f96adb0f700 1 -- 172.21.15.26:0/2396049923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96a8131b40 msgr2=0x7f96a81c8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:08.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.152+0000 7f96adb0f700 1 --2- 172.21.15.26:0/2396049923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96a8131b40 0x7f96a81c8ca0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f96a000cc80 tx=0x7f96a000cf90 comp rx=0 tx=0).stop 2023-10-01T07:57:08.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.152+0000 7f96adb0f700 1 -- 172.21.15.26:0/2396049923 shutdown_connections 2023-10-01T07:57:08.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.152+0000 7f96adb0f700 1 --2- 172.21.15.26:0/2396049923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96a8131b40 0x7f96a81c8ca0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:08.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.152+0000 7f96adb0f700 1 --2- 172.21.15.26:0/2396049923 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96a806a770 0x7f96a81c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:08.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.152+0000 7f96adb0f700 1 --2- 172.21.15.26:0/2396049923 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96a806b080 0x7f96a81c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:08.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.152+0000 7f96adb0f700 1 -- 172.21.15.26:0/2396049923 >> 172.21.15.26:0/2396049923 conn(0x7f96a8066f50 msgr2=0x7f96a80a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:08.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.152+0000 7f96adb0f700 1 -- 172.21.15.26:0/2396049923 shutdown_connections 2023-10-01T07:57:08.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.153+0000 7f96adb0f700 1 -- 172.21.15.26:0/2396049923 wait complete. 2023-10-01T07:57:08.167 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:08.280 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:08.371 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:08.374 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:08.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.424+0000 7f5590f93700 1 Processor -- start 2023-10-01T07:57:08.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.424+0000 7f5590f93700 1 -- start start 2023-10-01T07:57:08.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.425+0000 7f5590f93700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f558c09d6f0 0x7f558c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:08.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.425+0000 7f5590f93700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f558c09e000 0x7f558c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:08.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.425+0000 7f5590f93700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f558c09e410 0x7f558c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:08.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.425+0000 7f5590f93700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f558c09f520 con 0x7f558c09e000 2023-10-01T07:57:08.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.425+0000 7f5590f93700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f558c09f130 con 0x7f558c09d6f0 2023-10-01T07:57:08.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.425+0000 7f5590f93700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f558c09e930 con 0x7f558c09e410 2023-10-01T07:57:08.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.425+0000 7f558a59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f558c09d6f0 0x7f558c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:08.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.425+0000 7f558ad9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f558c09e410 0x7f558c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:08.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.425+0000 7f558a59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f558c09d6f0 0x7f558c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:39276/0 (socket says 172.21.15.26:39276) 2023-10-01T07:57:08.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.425+0000 7f558ad9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f558c09e410 0x7f558c130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:43918/0 (socket says 172.21.15.26:43918) 2023-10-01T07:57:08.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.425+0000 7f558a59c700 1 -- 172.21.15.26:0/706389286 learned_addr learned my addr 172.21.15.26:0/706389286 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:08.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.425+0000 7f5589d9b700 1 --2- 172.21.15.26:0/706389286 >> v2:172.21.15.26:3300/0 conn(0x7f558c09e000 0x7f558c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:08.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.426+0000 7f558ad9d700 1 -- 172.21.15.26:0/706389286 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f558c09d6f0 msgr2=0x7f558c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:08.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.426+0000 7f558ad9d700 1 --2- 172.21.15.26:0/706389286 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f558c09d6f0 0x7f558c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:08.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.426+0000 7f558ad9d700 1 -- 172.21.15.26:0/706389286 >> v2:172.21.15.26:3300/0 conn(0x7f558c09e000 msgr2=0x7f558c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:08.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.426+0000 7f558ad9d700 1 --2- 172.21.15.26:0/706389286 >> v2:172.21.15.26:3300/0 conn(0x7f558c09e000 0x7f558c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:08.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.426+0000 7f558ad9d700 1 -- 172.21.15.26:0/706389286 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f558c09b2d0 con 0x7f558c09e410 2023-10-01T07:57:08.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.426+0000 7f558a59c700 1 --2- 172.21.15.26:0/706389286 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f558c09d6f0 0x7f558c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:08.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.426+0000 7f5589d9b700 1 --2- 172.21.15.26:0/706389286 >> v2:172.21.15.26:3300/0 conn(0x7f558c09e000 0x7f558c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:08.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.426+0000 7f558ad9d700 1 --2- 172.21.15.26:0/706389286 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f558c09e410 0x7f558c130ba0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5584009dc0 tx=0x7f558400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fa3f1afca11b174 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:08.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.426+0000 7f558959a700 1 -- 172.21.15.26:0/706389286 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558400e070 con 0x7f558c09e410 2023-10-01T07:57:08.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.426+0000 7f558959a700 1 -- 172.21.15.26:0/706389286 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558400bae0 con 0x7f558c09e410 2023-10-01T07:57:08.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.426+0000 7f558959a700 1 -- 172.21.15.26:0/706389286 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558400be90 con 0x7f558c09e410 2023-10-01T07:57:08.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.427+0000 7f5590f93700 1 -- 172.21.15.26:0/706389286 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f558c09e410 msgr2=0x7f558c130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:08.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.427+0000 7f5590f93700 1 --2- 172.21.15.26:0/706389286 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f558c09e410 0x7f558c130ba0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5584009dc0 tx=0x7f558400b330 comp rx=0 tx=0).stop 2023-10-01T07:57:08.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.427+0000 7f5590f93700 1 -- 172.21.15.26:0/706389286 shutdown_connections 2023-10-01T07:57:08.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.427+0000 7f5590f93700 1 --2- 172.21.15.26:0/706389286 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f558c09e410 0x7f558c130ba0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:08.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.427+0000 7f5590f93700 1 --2- 172.21.15.26:0/706389286 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f558c09d6f0 0x7f558c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:08.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.427+0000 7f5590f93700 1 --2- 172.21.15.26:0/706389286 >> v2:172.21.15.26:3300/0 conn(0x7f558c09e000 0x7f558c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:08.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.427+0000 7f5590f93700 1 -- 172.21.15.26:0/706389286 >> 172.21.15.26:0/706389286 conn(0x7f558c066f50 msgr2=0x7f558c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:08.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.427+0000 7f5590f93700 1 -- 172.21.15.26:0/706389286 shutdown_connections 2023-10-01T07:57:08.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.427+0000 7f5590f93700 1 -- 172.21.15.26:0/706389286 wait complete. 2023-10-01T07:57:08.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.428+0000 7f5590f93700 1 Processor -- start 2023-10-01T07:57:08.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.428+0000 7f5590f93700 1 -- start start 2023-10-01T07:57:08.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.429+0000 7f5590f93700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f558c09d6f0 0x7f558c1221b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:08.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.429+0000 7f5590f93700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f558c09e000 0x7f558c1226f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:08.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.429+0000 7f5590f93700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f558c09e410 0x7f558c122c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:08.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.429+0000 7f5590f93700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558c1243e0 con 0x7f558c09e000 2023-10-01T07:57:08.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.429+0000 7f5590f93700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f558c09c770 con 0x7f558c09d6f0 2023-10-01T07:57:08.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.429+0000 7f5590f93700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f558c1235f0 con 0x7f558c09e410 2023-10-01T07:57:08.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.429+0000 7f558a59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f558c09d6f0 0x7f558c1221b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:08.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.429+0000 7f5589d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f558c09e000 0x7f558c1226f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:08.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.429+0000 7f558a59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f558c09d6f0 0x7f558c1221b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:39282/0 (socket says 172.21.15.26:39282) 2023-10-01T07:57:08.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.429+0000 7f558a59c700 1 -- 172.21.15.26:0/2620531964 learned_addr learned my addr 172.21.15.26:0/2620531964 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:08.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.429+0000 7f558ad9d700 1 --2- 172.21.15.26:0/2620531964 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f558c09e410 0x7f558c122c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:08.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.430+0000 7f5589d9b700 1 -- 172.21.15.26:0/2620531964 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f558c09e410 msgr2=0x7f558c122c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:08.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.430+0000 7f5589d9b700 1 --2- 172.21.15.26:0/2620531964 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f558c09e410 0x7f558c122c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:08.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.430+0000 7f5589d9b700 1 -- 172.21.15.26:0/2620531964 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f558c09d6f0 msgr2=0x7f558c1221b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:08.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.430+0000 7f5589d9b700 1 --2- 172.21.15.26:0/2620531964 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f558c09d6f0 0x7f558c1221b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:08.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.430+0000 7f5589d9b700 1 -- 172.21.15.26:0/2620531964 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f557c009550 con 0x7f558c09e000 2023-10-01T07:57:08.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.430+0000 7f558a59c700 1 --2- 172.21.15.26:0/2620531964 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f558c09d6f0 0x7f558c1221b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:08.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.430+0000 7f5589d9b700 1 --2- 172.21.15.26:0/2620531964 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f558c09e000 0x7f558c1226f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f558000e9b0 tx=0x7f558000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:08.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.430+0000 7f557affd700 1 -- 172.21.15.26:0/2620531964 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558000ee50 con 0x7f558c09e000 2023-10-01T07:57:08.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.430+0000 7f557affd700 1 -- 172.21.15.26:0/2620531964 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558000c7f0 con 0x7f558c09e000 2023-10-01T07:57:08.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.430+0000 7f5590f93700 1 -- 172.21.15.26:0/2620531964 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55800094a0 con 0x7f558c09e000 2023-10-01T07:57:08.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.430+0000 7f557affd700 1 -- 172.21.15.26:0/2620531964 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558000cb80 con 0x7f558c09e000 2023-10-01T07:57:08.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.430+0000 7f5590f93700 1 -- 172.21.15.26:0/2620531964 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5584009a70 con 0x7f558c09e000 2023-10-01T07:57:08.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.431+0000 7f557affd700 1 -- 172.21.15.26:0/2620531964 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f558000cce0 con 0x7f558c09e000 2023-10-01T07:57:08.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.431+0000 7f557affd700 1 -- 172.21.15.26:0/2620531964 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f558003fa30 con 0x7f558c09e000 2023-10-01T07:57:08.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.432+0000 7f5590f93700 1 -- 172.21.15.26:0/2620531964 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f558c074ea0 con 0x7f558c09e000 2023-10-01T07:57:08.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.437+0000 7f557affd700 1 -- 172.21.15.26:0/2620531964 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5580011d60 con 0x7f558c09e000 2023-10-01T07:57:08.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.515+0000 7f1dee5e8700 1 Processor -- start 2023-10-01T07:57:08.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.515+0000 7f1dee5e8700 1 -- start start 2023-10-01T07:57:08.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.516+0000 7f1dee5e8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1de809e1d0 0x7f1de8135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:08.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.516+0000 7f1dee5e8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1de8135e50 0x7f1de8138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:08.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.516+0000 7f1dee5e8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de809f130 con 0x7f1de809d6f0 2023-10-01T07:57:08.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.516+0000 7f1dee5e8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de809f520 con 0x7f1de809e1d0 2023-10-01T07:57:08.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.516+0000 7f1dee5e8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1de809e930 con 0x7f1de8135e50 2023-10-01T07:57:08.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.516+0000 7f1de7fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1de809d6f0 0x7f1de809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43904/0 (socket says 172.21.15.26:43904) 2023-10-01T07:57:08.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.516+0000 7f1de7fff700 1 -- 172.21.15.26:0/3524457376 learned_addr learned my addr 172.21.15.26:0/3524457376 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:08.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.516+0000 7f1de77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1de809e1d0 0x7f1de8135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:08.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.516+0000 7f1decb85700 1 --2- 172.21.15.26:0/3524457376 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1de8135e50 0x7f1de8138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:08.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.516+0000 7f1de6ffd700 1 -- 172.21.15.26:0/3524457376 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1741301210 0 0) 0x7f1de809f130 con 0x7f1de809d6f0 2023-10-01T07:57:08.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.516+0000 7f1de77fe700 1 -- 172.21.15.26:0/3524457376 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1de8135e50 msgr2=0x7f1de8138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:08.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.516+0000 7f1de77fe700 1 --2- 172.21.15.26:0/3524457376 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1de8135e50 0x7f1de8138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:08.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.516+0000 7f1de77fe700 1 -- 172.21.15.26:0/3524457376 >> v1:172.21.15.26:6789/0 conn(0x7f1de809d6f0 legacy=0x7f1de809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:08.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.516+0000 7f1de77fe700 1 -- 172.21.15.26:0/3524457376 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de809b2d0 con 0x7f1de809e1d0 2023-10-01T07:57:08.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.516+0000 7f1decb85700 1 --2- 172.21.15.26:0/3524457376 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1de8135e50 0x7f1de8138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:08.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.517+0000 7f1de77fe700 1 --2- 172.21.15.26:0/3524457376 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1de809e1d0 0x7f1de8135910 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc009870 tx=0x7f1ddc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1490018fa294335 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:08.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.517+0000 7f1de6ffd700 1 -- 172.21.15.26:0/3524457376 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc011830 con 0x7f1de809e1d0 2023-10-01T07:57:08.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.517+0000 7f1de6ffd700 1 -- 172.21.15.26:0/3524457376 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ddc011990 con 0x7f1de809e1d0 2023-10-01T07:57:08.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.517+0000 7f1de6ffd700 1 -- 172.21.15.26:0/3524457376 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc011d20 con 0x7f1de809e1d0 2023-10-01T07:57:08.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.517+0000 7f1dee5e8700 1 -- 172.21.15.26:0/3524457376 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1de809e1d0 msgr2=0x7f1de8135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:08.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.517+0000 7f1dee5e8700 1 --2- 172.21.15.26:0/3524457376 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1de809e1d0 0x7f1de8135910 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc009870 tx=0x7f1ddc009b80 comp rx=0 tx=0).stop 2023-10-01T07:57:08.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.518+0000 7f1dee5e8700 1 -- 172.21.15.26:0/3524457376 shutdown_connections 2023-10-01T07:57:08.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.518+0000 7f1dee5e8700 1 --2- 172.21.15.26:0/3524457376 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1de8135e50 0x7f1de8138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:08.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.518+0000 7f1dee5e8700 1 --2- 172.21.15.26:0/3524457376 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1de809e1d0 0x7f1de8135910 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:08.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.518+0000 7f1dee5e8700 1 -- 172.21.15.26:0/3524457376 >> 172.21.15.26:0/3524457376 conn(0x7f1de8066f50 msgr2=0x7f1de809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:08.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.518+0000 7f1dee5e8700 1 -- 172.21.15.26:0/3524457376 shutdown_connections 2023-10-01T07:57:08.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.518+0000 7f1dee5e8700 1 -- 172.21.15.26:0/3524457376 wait complete. 2023-10-01T07:57:08.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.519+0000 7f1dee5e8700 1 Processor -- start 2023-10-01T07:57:08.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.519+0000 7f1dee5e8700 1 -- start start 2023-10-01T07:57:08.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.519+0000 7f1dee5e8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1de809d6f0 0x7f1de81c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:08.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.519+0000 7f1dee5e8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1de809e1d0 0x7f1de81c4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:08.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.519+0000 7f1dee5e8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1de8135e50 0x7f1de811b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:08.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.519+0000 7f1dee5e8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de811d310 con 0x7f1de809d6f0 2023-10-01T07:57:08.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.519+0000 7f1dee5e8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de811d120 con 0x7f1de8135e50 2023-10-01T07:57:08.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.519+0000 7f1dee5e8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1de811e850 con 0x7f1de809e1d0 2023-10-01T07:57:08.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.519+0000 7f1de7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1de809d6f0 0x7f1de81c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:08.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.520+0000 7f1de7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1de809d6f0 0x7f1de81c43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57162/0 (socket says 172.21.15.26:57162) 2023-10-01T07:57:08.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.520+0000 7f1de7fff700 1 -- 172.21.15.26:0/236864851 learned_addr learned my addr 172.21.15.26:0/236864851 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:08.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.520+0000 7f1decb85700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1de8135e50 0x7f1de811b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:08.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.520+0000 7f1de77fe700 1 --2- 172.21.15.26:0/236864851 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1de809e1d0 0x7f1de81c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:08.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.520+0000 7f1de7fff700 1 -- 172.21.15.26:0/236864851 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1de809e1d0 msgr2=0x7f1de81c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:08.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.520+0000 7f1de7fff700 1 --2- 172.21.15.26:0/236864851 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1de809e1d0 0x7f1de81c4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:08.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.520+0000 7f1de7fff700 1 -- 172.21.15.26:0/236864851 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1de8135e50 msgr2=0x7f1de811b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:08.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.520+0000 7f1de7fff700 1 --2- 172.21.15.26:0/236864851 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1de8135e50 0x7f1de811b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:08.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.520+0000 7f1de7fff700 1 -- 172.21.15.26:0/236864851 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de0009a70 con 0x7f1de809d6f0 2023-10-01T07:57:08.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.520+0000 7f1decb85700 1 --2- 172.21.15.26:0/236864851 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1de8135e50 0x7f1de811b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:08.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.520+0000 7f1de77fe700 1 --2- 172.21.15.26:0/236864851 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1de809e1d0 0x7f1de81c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:08.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.520+0000 7f1de7fff700 1 --2- 172.21.15.26:0/236864851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1de809d6f0 0x7f1de81c43d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f1dd800c550 tx=0x7f1dd800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:08.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.520+0000 7f1de4ff9700 1 -- 172.21.15.26:0/236864851 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8004c80 con 0x7f1de809d6f0 2023-10-01T07:57:08.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.520+0000 7f1de4ff9700 1 -- 172.21.15.26:0/236864851 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd8004de0 con 0x7f1de809d6f0 2023-10-01T07:57:08.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.520+0000 7f1dee5e8700 1 -- 172.21.15.26:0/236864851 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ddc0094a0 con 0x7f1de809d6f0 2023-10-01T07:57:08.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.520+0000 7f1de4ff9700 1 -- 172.21.15.26:0/236864851 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8007310 con 0x7f1de809d6f0 2023-10-01T07:57:08.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.520+0000 7f1dee5e8700 1 -- 172.21.15.26:0/236864851 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de80a2190 con 0x7f1de809d6f0 2023-10-01T07:57:08.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.521+0000 7f1de4ff9700 1 -- 172.21.15.26:0/236864851 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1dd8007470 con 0x7f1de809d6f0 2023-10-01T07:57:08.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.521+0000 7f1dee5e8700 1 -- 172.21.15.26:0/236864851 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de8074ea0 con 0x7f1de809d6f0 2023-10-01T07:57:08.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.522+0000 7f1de4ff9700 1 -- 172.21.15.26:0/236864851 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1dd803f1f0 con 0x7f1de809d6f0 2023-10-01T07:57:08.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.531+0000 7f1de4ff9700 1 -- 172.21.15.26:0/236864851 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1dd80133c0 con 0x7f1de809d6f0 2023-10-01T07:57:08.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.558+0000 7f6332bb5700 1 Processor -- start 2023-10-01T07:57:08.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.558+0000 7f6332bb5700 1 -- start start 2023-10-01T07:57:08.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.559+0000 7f6332bb5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f632c09e930 0x7f632c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:08.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.559+0000 7f6332bb5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f632c09f240 0x7f632c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:08.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.559+0000 7f6332bb5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f632c09f650 0x7f632c131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:08.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.559+0000 7f6332bb5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f632c070940 con 0x7f632c09f650 2023-10-01T07:57:08.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.559+0000 7f6332bb5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f632c06fd60 con 0x7f632c09f240 2023-10-01T07:57:08.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.559+0000 7f6332bb5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f632c06fa80 con 0x7f632c09e930 2023-10-01T07:57:08.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.559+0000 7f6330951700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f632c09e930 0x7f632c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:08.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.559+0000 7f6331152700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f632c09f650 0x7f632c131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:08.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.559+0000 7f6330951700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f632c09e930 0x7f632c09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:43970/0 (socket says 172.21.15.26:43970) 2023-10-01T07:57:08.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.559+0000 7f6330951700 1 -- 172.21.15.26:0/2365781210 learned_addr learned my addr 172.21.15.26:0/2365781210 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:08.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.559+0000 7f632bfff700 1 --2- 172.21.15.26:0/2365781210 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f632c09f240 0x7f632c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:08.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.560+0000 7f6330951700 1 -- 172.21.15.26:0/2365781210 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f632c09f240 msgr2=0x7f632c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:08.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.560+0000 7f6330951700 1 --2- 172.21.15.26:0/2365781210 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f632c09f240 0x7f632c1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:08.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.560+0000 7f6330951700 1 -- 172.21.15.26:0/2365781210 >> v2:172.21.15.26:3300/0 conn(0x7f632c09f650 msgr2=0x7f632c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:08.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.560+0000 7f6330951700 1 --2- 172.21.15.26:0/2365781210 >> v2:172.21.15.26:3300/0 conn(0x7f632c09f650 0x7f632c131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:08.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.560+0000 7f6330951700 1 -- 172.21.15.26:0/2365781210 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632c09fb60 con 0x7f632c09e930 2023-10-01T07:57:08.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.560+0000 7f6331152700 1 --2- 172.21.15.26:0/2365781210 >> v2:172.21.15.26:3300/0 conn(0x7f632c09f650 0x7f632c131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:08.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.560+0000 7f6330951700 1 --2- 172.21.15.26:0/2365781210 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f632c09e930 0x7f632c09ed00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f63200098f0 tx=0x7f6320009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=120f3fb086000eb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:08.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.560+0000 7f632b7fe700 1 -- 172.21.15.26:0/2365781210 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6320011830 con 0x7f632c09e930 2023-10-01T07:57:08.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.560+0000 7f632b7fe700 1 -- 172.21.15.26:0/2365781210 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6320011990 con 0x7f632c09e930 2023-10-01T07:57:08.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.560+0000 7f632b7fe700 1 -- 172.21.15.26:0/2365781210 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6320011d20 con 0x7f632c09e930 2023-10-01T07:57:08.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.561+0000 7f6332bb5700 1 -- 172.21.15.26:0/2365781210 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f632c09e930 msgr2=0x7f632c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:08.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.561+0000 7f6332bb5700 1 --2- 172.21.15.26:0/2365781210 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f632c09e930 0x7f632c09ed00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f63200098f0 tx=0x7f6320009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:08.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.561+0000 7f6332bb5700 1 -- 172.21.15.26:0/2365781210 shutdown_connections 2023-10-01T07:57:08.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.561+0000 7f6332bb5700 1 --2- 172.21.15.26:0/2365781210 >> v2:172.21.15.26:3300/0 conn(0x7f632c09f650 0x7f632c131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:08.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.561+0000 7f6332bb5700 1 --2- 172.21.15.26:0/2365781210 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f632c09e930 0x7f632c09ed00 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:08.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.561+0000 7f6332bb5700 1 --2- 172.21.15.26:0/2365781210 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f632c09f240 0x7f632c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:08.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.561+0000 7f6332bb5700 1 -- 172.21.15.26:0/2365781210 >> 172.21.15.26:0/2365781210 conn(0x7f632c0a4210 msgr2=0x7f632c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:08.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.561+0000 7f6332bb5700 1 -- 172.21.15.26:0/2365781210 shutdown_connections 2023-10-01T07:57:08.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.561+0000 7f6332bb5700 1 -- 172.21.15.26:0/2365781210 wait complete. 2023-10-01T07:57:08.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.562+0000 7f6332bb5700 1 Processor -- start 2023-10-01T07:57:08.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.562+0000 7f6332bb5700 1 -- start start 2023-10-01T07:57:08.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.563+0000 7f6332bb5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f632c09e930 0x7f632c1a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:08.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.563+0000 7f6332bb5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f632c09f240 0x7f632c1a4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:08.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.563+0000 7f6332bb5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f632c09f650 0x7f632c1a4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:08.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.563+0000 7f6332bb5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632c1a80e0 con 0x7f632c09f240 2023-10-01T07:57:08.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.563+0000 7f6332bb5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f632c1a7720 con 0x7f632c09f650 2023-10-01T07:57:08.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.563+0000 7f6332bb5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f632c1a6a60 con 0x7f632c09e930 2023-10-01T07:57:08.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.563+0000 7f6330951700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f632c09e930 0x7f632c1a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:08.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.563+0000 7f632bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f632c09f240 0x7f632c1a4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:08.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.564+0000 7f6331152700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f632c09f650 0x7f632c1a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:08.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.564+0000 7f632bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f632c09f240 0x7f632c1a4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57184/0 (socket says 172.21.15.26:57184) 2023-10-01T07:57:08.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.564+0000 7f6330951700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f632c09e930 0x7f632c1a3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:43986/0 (socket says 172.21.15.26:43986) 2023-10-01T07:57:08.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.564+0000 7f632bfff700 1 -- 172.21.15.26:0/291560233 learned_addr learned my addr 172.21.15.26:0/291560233 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:08.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.564+0000 7f6331152700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f632c09f650 0x7f632c1a4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:39316/0 (socket says 172.21.15.26:39316) 2023-10-01T07:57:08.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.564+0000 7f6331152700 1 -- 172.21.15.26:0/291560233 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f632c09e930 msgr2=0x7f632c1a3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:08.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.564+0000 7f6331152700 1 --2- 172.21.15.26:0/291560233 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f632c09e930 0x7f632c1a3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:08.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.564+0000 7f6331152700 1 -- 172.21.15.26:0/291560233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f632c09f240 msgr2=0x7f632c1a4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:08.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.564+0000 7f6331152700 1 --2- 172.21.15.26:0/291560233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f632c09f240 0x7f632c1a4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:08.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.564+0000 7f6331152700 1 -- 172.21.15.26:0/291560233 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6324009a70 con 0x7f632c09f650 2023-10-01T07:57:08.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.564+0000 7f632bfff700 1 --2- 172.21.15.26:0/291560233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f632c09f240 0x7f632c1a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:08.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.564+0000 7f6331152700 1 --2- 172.21.15.26:0/291560233 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f632c09f650 0x7f632c1a4680 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f632400efc0 tx=0x7f632400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:08.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.564+0000 7f63297fa700 1 -- 172.21.15.26:0/291560233 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632400cc90 con 0x7f632c09f650 2023-10-01T07:57:08.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.564+0000 7f63297fa700 1 -- 172.21.15.26:0/291560233 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632400f040 con 0x7f632c09f650 2023-10-01T07:57:08.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.564+0000 7f63297fa700 1 -- 172.21.15.26:0/291560233 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6324014480 con 0x7f632c09f650 2023-10-01T07:57:08.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.564+0000 7f6332bb5700 1 -- 172.21.15.26:0/291560233 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6320009550 con 0x7f632c09f650 2023-10-01T07:57:08.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.564+0000 7f6332bb5700 1 -- 172.21.15.26:0/291560233 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f632c0a0190 con 0x7f632c09f650 2023-10-01T07:57:08.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.565+0000 7f63297fa700 1 -- 172.21.15.26:0/291560233 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6324014600 con 0x7f632c09f650 2023-10-01T07:57:08.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.566+0000 7f6332bb5700 1 -- 172.21.15.26:0/291560233 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f632c1a0b30 con 0x7f632c09f650 2023-10-01T07:57:08.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.566+0000 7f63297fa700 1 -- 172.21.15.26:0/291560233 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6324040080 con 0x7f632c09f650 2023-10-01T07:57:08.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.570+0000 7f63297fa700 1 -- 172.21.15.26:0/291560233 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f63240248f0 con 0x7f632c09f650 2023-10-01T07:57:08.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.655+0000 7f5590f93700 1 -- 172.21.15.26:0/2620531964 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f558c1245b0 con 0x7f558c09e000 2023-10-01T07:57:08.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.655+0000 7f557affd700 1 -- 172.21.15.26:0/2620531964 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5580021030 con 0x7f558c09e000 2023-10-01T07:57:08.656 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:08.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.658+0000 7f5590f93700 1 -- 172.21.15.26:0/2620531964 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f558c09e000 msgr2=0x7f558c1226f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:08.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.658+0000 7f5590f93700 1 --2- 172.21.15.26:0/2620531964 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f558c09e000 0x7f558c1226f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f558000e9b0 tx=0x7f558000ecc0 comp rx=0 tx=0).stop 2023-10-01T07:57:08.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.658+0000 7f5590f93700 1 -- 172.21.15.26:0/2620531964 shutdown_connections 2023-10-01T07:57:08.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.658+0000 7f5590f93700 1 --2- 172.21.15.26:0/2620531964 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f558c09e410 0x7f558c122c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:08.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.658+0000 7f5590f93700 1 --2- 172.21.15.26:0/2620531964 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f558c09d6f0 0x7f558c1221b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:08.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.658+0000 7f5590f93700 1 --2- 172.21.15.26:0/2620531964 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f558c09e000 0x7f558c1226f0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:08.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.658+0000 7f5590f93700 1 -- 172.21.15.26:0/2620531964 >> 172.21.15.26:0/2620531964 conn(0x7f558c066f50 msgr2=0x7f558c130990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:08.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.658+0000 7f5590f93700 1 -- 172.21.15.26:0/2620531964 shutdown_connections 2023-10-01T07:57:08.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.658+0000 7f5590f93700 1 -- 172.21.15.26:0/2620531964 wait complete. 2023-10-01T07:57:08.672 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:08.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.737+0000 7f1dee5e8700 1 -- 172.21.15.26:0/236864851 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1de8071f30 con 0x7f1de809d6f0 2023-10-01T07:57:08.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.738+0000 7f1de4ff9700 1 -- 172.21.15.26:0/236864851 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1dd8011360 con 0x7f1de809d6f0 2023-10-01T07:57:08.739 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:08.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.740+0000 7f1dee5e8700 1 -- 172.21.15.26:0/236864851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1de809d6f0 msgr2=0x7f1de81c43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:08.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.740+0000 7f1dee5e8700 1 --2- 172.21.15.26:0/236864851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1de809d6f0 0x7f1de81c43d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f1dd800c550 tx=0x7f1dd800c860 comp rx=0 tx=0).stop 2023-10-01T07:57:08.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.740+0000 7f1dee5e8700 1 -- 172.21.15.26:0/236864851 shutdown_connections 2023-10-01T07:57:08.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.740+0000 7f1dee5e8700 1 --2- 172.21.15.26:0/236864851 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1de8135e50 0x7f1de811b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:08.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.740+0000 7f1dee5e8700 1 --2- 172.21.15.26:0/236864851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1de809d6f0 0x7f1de81c43d0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:08.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.740+0000 7f1dee5e8700 1 --2- 172.21.15.26:0/236864851 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1de809e1d0 0x7f1de81c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:08.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.740+0000 7f1dee5e8700 1 -- 172.21.15.26:0/236864851 >> 172.21.15.26:0/236864851 conn(0x7f1de8066f50 msgr2=0x7f1de8132710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:08.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.740+0000 7f1dee5e8700 1 -- 172.21.15.26:0/236864851 shutdown_connections 2023-10-01T07:57:08.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.740+0000 7f1dee5e8700 1 -- 172.21.15.26:0/236864851 wait complete. 2023-10-01T07:57:08.755 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:08.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.775+0000 7f6332bb5700 1 -- 172.21.15.26:0/291560233 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f632c1a72c0 con 0x7f632c09f650 2023-10-01T07:57:08.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.776+0000 7f63297fa700 1 -- 172.21.15.26:0/291560233 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6324024300 con 0x7f632c09f650 2023-10-01T07:57:08.776 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:08.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.778+0000 7f6332bb5700 1 -- 172.21.15.26:0/291560233 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f632c09f650 msgr2=0x7f632c1a4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:08.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.778+0000 7f6332bb5700 1 --2- 172.21.15.26:0/291560233 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f632c09f650 0x7f632c1a4680 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f632400efc0 tx=0x7f632400c3a0 comp rx=0 tx=0).stop 2023-10-01T07:57:08.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.778+0000 7f6332bb5700 1 -- 172.21.15.26:0/291560233 shutdown_connections 2023-10-01T07:57:08.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.778+0000 7f6332bb5700 1 --2- 172.21.15.26:0/291560233 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f632c09f650 0x7f632c1a4680 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:08.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.778+0000 7f6332bb5700 1 --2- 172.21.15.26:0/291560233 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f632c09e930 0x7f632c1a3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:08.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.778+0000 7f6332bb5700 1 --2- 172.21.15.26:0/291560233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f632c09f240 0x7f632c1a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:08.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.778+0000 7f6332bb5700 1 -- 172.21.15.26:0/291560233 >> 172.21.15.26:0/291560233 conn(0x7f632c0a4210 msgr2=0x7f632c1b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:08.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.778+0000 7f6332bb5700 1 -- 172.21.15.26:0/291560233 shutdown_connections 2023-10-01T07:57:08.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:08.778+0000 7f6332bb5700 1 -- 172.21.15.26:0/291560233 wait complete. 2023-10-01T07:57:08.792 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:09.168 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:09.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.314+0000 7f0a06c1b700 1 Processor -- start 2023-10-01T07:57:09.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.314+0000 7f0a06c1b700 1 -- start start 2023-10-01T07:57:09.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.315+0000 7f0a06c1b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0a001316c0 0x7f0a00131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:09.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.315+0000 7f0a06c1b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0a0006ae80 0x7f0a00139550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:09.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.315+0000 7f0a06c1b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a0009e130 con 0x7f0a0009d9f0 2023-10-01T07:57:09.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.315+0000 7f0a06c1b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a001312b0 con 0x7f0a0006ae80 2023-10-01T07:57:09.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.315+0000 7f0a06c1b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0009f6e0 con 0x7f0a001316c0 2023-10-01T07:57:09.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.315+0000 7f0a049b7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0a001316c0 0x7f0a00131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:09.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.315+0000 7f0a049b7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0a001316c0 0x7f0a00131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:39326/0 (socket says 172.21.15.26:39326) 2023-10-01T07:57:09.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.315+0000 7f0a049b7700 1 -- 172.21.15.26:0/2874583245 learned_addr learned my addr 172.21.15.26:0/2874583245 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:09.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.315+0000 7f0a051b8700 1 --2- 172.21.15.26:0/2874583245 >> v2:172.21.15.26:3300/0 conn(0x7f0a0006ae80 0x7f0a00139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:09.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.316+0000 7f0a051b8700 1 -- 172.21.15.26:0/2874583245 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0a001316c0 msgr2=0x7f0a00131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:09.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.316+0000 7f0a051b8700 1 --2- 172.21.15.26:0/2874583245 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0a001316c0 0x7f0a00131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:09.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.316+0000 7f0a051b8700 1 -- 172.21.15.26:0/2874583245 >> v1:172.21.15.26:6789/0 conn(0x7f0a0009d9f0 legacy=0x7f0a0006a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:09.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.316+0000 7f0a051b8700 1 -- 172.21.15.26:0/2874583245 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0009e760 con 0x7f0a0006ae80 2023-10-01T07:57:09.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.316+0000 7f0a049b7700 1 --2- 172.21.15.26:0/2874583245 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0a001316c0 0x7f0a00131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:09.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.316+0000 7f0a051b8700 1 --2- 172.21.15.26:0/2874583245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a0006ae80 0x7f0a00139550 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f09f8009d90 tx=0x7f09f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=593c6e4d37eaed09 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:09.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.316+0000 7f09ff7fe700 1 -- 172.21.15.26:0/2874583245 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f800e070 con 0x7f0a0006ae80 2023-10-01T07:57:09.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.316+0000 7f09ff7fe700 1 -- 172.21.15.26:0/2874583245 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f800bb20 con 0x7f0a0006ae80 2023-10-01T07:57:09.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.316+0000 7f09ff7fe700 1 -- 172.21.15.26:0/2874583245 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f8012430 con 0x7f0a0006ae80 2023-10-01T07:57:09.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.317+0000 7f0a06c1b700 1 -- 172.21.15.26:0/2874583245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a0006ae80 msgr2=0x7f0a00139550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:09.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.317+0000 7f0a06c1b700 1 --2- 172.21.15.26:0/2874583245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a0006ae80 0x7f0a00139550 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f09f8009d90 tx=0x7f09f800b330 comp rx=0 tx=0).stop 2023-10-01T07:57:09.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.317+0000 7f0a06c1b700 1 -- 172.21.15.26:0/2874583245 shutdown_connections 2023-10-01T07:57:09.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.317+0000 7f0a06c1b700 1 --2- 172.21.15.26:0/2874583245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a0006ae80 0x7f0a00139550 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:09.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.317+0000 7f0a06c1b700 1 --2- 172.21.15.26:0/2874583245 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0a001316c0 0x7f0a00131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:09.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.317+0000 7f0a06c1b700 1 -- 172.21.15.26:0/2874583245 >> 172.21.15.26:0/2874583245 conn(0x7f0a00066f50 msgr2=0x7f0a0009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:09.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.317+0000 7f0a06c1b700 1 -- 172.21.15.26:0/2874583245 shutdown_connections 2023-10-01T07:57:09.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.317+0000 7f0a06c1b700 1 -- 172.21.15.26:0/2874583245 wait complete. 2023-10-01T07:57:09.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.318+0000 7f0a06c1b700 1 Processor -- start 2023-10-01T07:57:09.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.318+0000 7f0a06c1b700 1 -- start start 2023-10-01T07:57:09.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.318+0000 7f0a06c1b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a0006ae80 0x7f0a0006e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:09.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.318+0000 7f0a06c1b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0a0009d9f0 0x7f0a0006ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:09.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.318+0000 7f0a06c1b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0a001316c0 0x7f0a0006f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:09.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.318+0000 7f0a06c1b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a00071470 con 0x7f0a0006ae80 2023-10-01T07:57:09.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.319+0000 7f0a06c1b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a00071dc0 con 0x7f0a0009d9f0 2023-10-01T07:57:09.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.319+0000 7f0a06c1b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0012b5c0 con 0x7f0a001316c0 2023-10-01T07:57:09.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.319+0000 7f0a049b7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a0006ae80 0x7f0a0006e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:09.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.319+0000 7f09fffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0a0009d9f0 0x7f0a0006ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:09.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.319+0000 7f0a049b7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a0006ae80 0x7f0a0006e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57206/0 (socket says 172.21.15.26:57206) 2023-10-01T07:57:09.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.319+0000 7f0a049b7700 1 -- 172.21.15.26:0/1484378234 learned_addr learned my addr 172.21.15.26:0/1484378234 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:09.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.319+0000 7f0a051b8700 1 --2- 172.21.15.26:0/1484378234 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0a001316c0 0x7f0a0006f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:09.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.319+0000 7f0a049b7700 1 -- 172.21.15.26:0/1484378234 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0a001316c0 msgr2=0x7f0a0006f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:09.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.319+0000 7f0a049b7700 1 --2- 172.21.15.26:0/1484378234 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0a001316c0 0x7f0a0006f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:09.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.319+0000 7f0a049b7700 1 -- 172.21.15.26:0/1484378234 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0a0009d9f0 msgr2=0x7f0a0006ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:09.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.319+0000 7f0a049b7700 1 --2- 172.21.15.26:0/1484378234 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0a0009d9f0 0x7f0a0006ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:09.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.319+0000 7f0a049b7700 1 -- 172.21.15.26:0/1484378234 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f0009550 con 0x7f0a0006ae80 2023-10-01T07:57:09.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.319+0000 7f09fffff700 1 --2- 172.21.15.26:0/1484378234 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0a0009d9f0 0x7f0a0006ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:09.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.319+0000 7f0a049b7700 1 --2- 172.21.15.26:0/1484378234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a0006ae80 0x7f0a0006e8e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f09f000ec10 tx=0x7f09f000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:09.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.319+0000 7f09fd7fa700 1 -- 172.21.15.26:0/1484378234 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f000c850 con 0x7f0a0006ae80 2023-10-01T07:57:09.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.319+0000 7f09fd7fa700 1 -- 172.21.15.26:0/1484378234 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f000c9b0 con 0x7f0a0006ae80 2023-10-01T07:57:09.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.319+0000 7f0a06c1b700 1 -- 172.21.15.26:0/1484378234 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f8009a70 con 0x7f0a0006ae80 2023-10-01T07:57:09.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.319+0000 7f09fd7fa700 1 -- 172.21.15.26:0/1484378234 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f000cd40 con 0x7f0a0006ae80 2023-10-01T07:57:09.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.319+0000 7f0a06c1b700 1 -- 172.21.15.26:0/1484378234 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a00072680 con 0x7f0a0006ae80 2023-10-01T07:57:09.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.320+0000 7f0a06c1b700 1 -- 172.21.15.26:0/1484378234 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a000712b0 con 0x7f0a0006ae80 2023-10-01T07:57:09.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.321+0000 7f09fd7fa700 1 -- 172.21.15.26:0/1484378234 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f09f0013470 con 0x7f0a0006ae80 2023-10-01T07:57:09.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.321+0000 7f09fd7fa700 1 -- 172.21.15.26:0/1484378234 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f09f003fe90 con 0x7f0a0006ae80 2023-10-01T07:57:09.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.326+0000 7f09fd7fa700 1 -- 172.21.15.26:0/1484378234 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f09f001abe0 con 0x7f0a0006ae80 2023-10-01T07:57:09.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.529+0000 7f0a06c1b700 1 -- 172.21.15.26:0/1484378234 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0a000712b0 con 0x7f0a0006ae80 2023-10-01T07:57:09.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.529+0000 7f09fd7fa700 1 -- 172.21.15.26:0/1484378234 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0a000712b0 con 0x7f0a0006ae80 2023-10-01T07:57:09.530 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:09.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.531+0000 7f0a06c1b700 1 -- 172.21.15.26:0/1484378234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a0006ae80 msgr2=0x7f0a0006e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:09.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.531+0000 7f0a06c1b700 1 --2- 172.21.15.26:0/1484378234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a0006ae80 0x7f0a0006e8e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f09f000ec10 tx=0x7f09f000ef20 comp rx=0 tx=0).stop 2023-10-01T07:57:09.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.531+0000 7f0a06c1b700 1 -- 172.21.15.26:0/1484378234 shutdown_connections 2023-10-01T07:57:09.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.531+0000 7f0a06c1b700 1 --2- 172.21.15.26:0/1484378234 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0a001316c0 0x7f0a0006f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:09.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.531+0000 7f0a06c1b700 1 --2- 172.21.15.26:0/1484378234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a0006ae80 0x7f0a0006e8e0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:09.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.531+0000 7f0a06c1b700 1 --2- 172.21.15.26:0/1484378234 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0a0009d9f0 0x7f0a0006ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:09.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.531+0000 7f0a06c1b700 1 -- 172.21.15.26:0/1484378234 >> 172.21.15.26:0/1484378234 conn(0x7f0a00066f50 msgr2=0x7f0a000a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:09.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.531+0000 7f0a06c1b700 1 -- 172.21.15.26:0/1484378234 shutdown_connections 2023-10-01T07:57:09.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.531+0000 7f0a06c1b700 1 -- 172.21.15.26:0/1484378234 wait complete. 2023-10-01T07:57:09.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:09.673 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:09.756 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:09.793 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:09.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.816+0000 7fa84bfd4700 1 Processor -- start 2023-10-01T07:57:09.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.817+0000 7fa84bfd4700 1 -- start start 2023-10-01T07:57:09.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.817+0000 7fa84bfd4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa84409d6f0 0x7fa84409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:09.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.817+0000 7fa84bfd4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa84409e000 0x7fa844130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:09.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.817+0000 7fa84bfd4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa84409f130 con 0x7fa84409e410 2023-10-01T07:57:09.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.817+0000 7fa84bfd4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa84409f520 con 0x7fa84409e000 2023-10-01T07:57:09.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.817+0000 7fa84bfd4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84409e930 con 0x7fa84409d6f0 2023-10-01T07:57:09.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.817+0000 7fa849d70700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa84409d6f0 0x7fa84409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:09.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.817+0000 7fa849d70700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa84409d6f0 0x7fa84409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:39346/0 (socket says 172.21.15.26:39346) 2023-10-01T07:57:09.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.817+0000 7fa849d70700 1 -- 172.21.15.26:0/3094715738 learned_addr learned my addr 172.21.15.26:0/3094715738 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:09.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.818+0000 7fa84956f700 1 --2- 172.21.15.26:0/3094715738 >> v2:172.21.15.26:3300/0 conn(0x7fa84409e000 0x7fa844130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:09.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.818+0000 7fa849d70700 1 -- 172.21.15.26:0/3094715738 >> v2:172.21.15.26:3300/0 conn(0x7fa84409e000 msgr2=0x7fa844130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:09.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.818+0000 7fa849d70700 1 --2- 172.21.15.26:0/3094715738 >> v2:172.21.15.26:3300/0 conn(0x7fa84409e000 0x7fa844130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:09.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.818+0000 7fa849d70700 1 -- 172.21.15.26:0/3094715738 >> v1:172.21.15.26:6789/0 conn(0x7fa84409e410 legacy=0x7fa844130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:09.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.818+0000 7fa849d70700 1 -- 172.21.15.26:0/3094715738 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa84409b2d0 con 0x7fa84409d6f0 2023-10-01T07:57:09.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.818+0000 7fa84956f700 1 --2- 172.21.15.26:0/3094715738 >> v2:172.21.15.26:3300/0 conn(0x7fa84409e000 0x7fa844130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:57:09.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.818+0000 7fa849d70700 1 --2- 172.21.15.26:0/3094715738 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa84409d6f0 0x7fa84409dac0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa84000bb90 tx=0x7fa84000bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d03e093bf0abc570 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:09.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.818+0000 7fa848d6e700 1 -- 172.21.15.26:0/3094715738 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84000dd10 con 0x7fa84409d6f0 2023-10-01T07:57:09.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.818+0000 7fa848d6e700 1 -- 172.21.15.26:0/3094715738 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa84000de70 con 0x7fa84409d6f0 2023-10-01T07:57:09.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.818+0000 7fa848d6e700 1 -- 172.21.15.26:0/3094715738 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa840004230 con 0x7fa84409d6f0 2023-10-01T07:57:09.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.819+0000 7fa84bfd4700 1 -- 172.21.15.26:0/3094715738 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa84409d6f0 msgr2=0x7fa84409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:09.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.819+0000 7fa84bfd4700 1 --2- 172.21.15.26:0/3094715738 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa84409d6f0 0x7fa84409dac0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa84000bb90 tx=0x7fa84000bea0 comp rx=0 tx=0).stop 2023-10-01T07:57:09.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.819+0000 7fa84bfd4700 1 -- 172.21.15.26:0/3094715738 shutdown_connections 2023-10-01T07:57:09.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.819+0000 7fa84bfd4700 1 --2- 172.21.15.26:0/3094715738 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa84409d6f0 0x7fa84409dac0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:09.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.819+0000 7fa84bfd4700 1 --2- 172.21.15.26:0/3094715738 >> v2:172.21.15.26:3300/0 conn(0x7fa84409e000 0x7fa844130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:09.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.819+0000 7fa84bfd4700 1 -- 172.21.15.26:0/3094715738 >> 172.21.15.26:0/3094715738 conn(0x7fa844066f50 msgr2=0x7fa84409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:09.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.819+0000 7fa84bfd4700 1 -- 172.21.15.26:0/3094715738 shutdown_connections 2023-10-01T07:57:09.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.819+0000 7fa84bfd4700 1 -- 172.21.15.26:0/3094715738 wait complete. 2023-10-01T07:57:09.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.820+0000 7fa84bfd4700 1 Processor -- start 2023-10-01T07:57:09.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.820+0000 7fa84bfd4700 1 -- start start 2023-10-01T07:57:09.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.820+0000 7fa84bfd4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa84409d6f0 0x7fa844122800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:09.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.820+0000 7fa84bfd4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa84409e000 0x7fa844122d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:09.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.820+0000 7fa84bfd4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa84409e410 0x7fa844123280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:09.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.821+0000 7fa84bfd4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8441260a0 con 0x7fa84409e410 2023-10-01T07:57:09.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.821+0000 7fa84bfd4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa844126e80 con 0x7fa84409e000 2023-10-01T07:57:09.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.821+0000 7fa84bfd4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa844124320 con 0x7fa84409d6f0 2023-10-01T07:57:09.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.821+0000 7fa849d70700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa84409d6f0 0x7fa844122800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:09.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.821+0000 7fa84956f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa84409e000 0x7fa844122d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:09.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.821+0000 7fa849d70700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa84409d6f0 0x7fa844122800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44004/0 (socket says 172.21.15.26:44004) 2023-10-01T07:57:09.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.821+0000 7fa849d70700 1 -- 172.21.15.26:0/1247369795 learned_addr learned my addr 172.21.15.26:0/1247369795 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:09.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.821+0000 7fa84a571700 1 --2- 172.21.15.26:0/1247369795 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa84409e410 0x7fa844123280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:09.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.821+0000 7fa849d70700 1 -- 172.21.15.26:0/1247369795 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa84409e000 msgr2=0x7fa844122d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:09.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.821+0000 7fa849d70700 1 --2- 172.21.15.26:0/1247369795 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa84409e000 0x7fa844122d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:09.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.821+0000 7fa849d70700 1 -- 172.21.15.26:0/1247369795 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa84409e410 msgr2=0x7fa844123280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:09.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.821+0000 7fa849d70700 1 --2- 172.21.15.26:0/1247369795 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa84409e410 0x7fa844123280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:09.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.821+0000 7fa849d70700 1 -- 172.21.15.26:0/1247369795 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa84000b7f0 con 0x7fa84409d6f0 2023-10-01T07:57:09.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.821+0000 7fa849d70700 1 --2- 172.21.15.26:0/1247369795 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa84409d6f0 0x7fa844122800 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa84409ea70 tx=0x7fa840004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:09.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.821+0000 7fa83a7fc700 1 -- 172.21.15.26:0/1247369795 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa840003e60 con 0x7fa84409d6f0 2023-10-01T07:57:09.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.822+0000 7fa83a7fc700 1 -- 172.21.15.26:0/1247369795 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa84000dcc0 con 0x7fa84409d6f0 2023-10-01T07:57:09.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.822+0000 7fa84bfd4700 1 -- 172.21.15.26:0/1247369795 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa844130dd0 con 0x7fa84409d6f0 2023-10-01T07:57:09.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.822+0000 7fa83a7fc700 1 -- 172.21.15.26:0/1247369795 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8400106b0 con 0x7fa84409d6f0 2023-10-01T07:57:09.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.822+0000 7fa84bfd4700 1 -- 172.21.15.26:0/1247369795 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa844126a30 con 0x7fa84409d6f0 2023-10-01T07:57:09.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.822+0000 7fa83a7fc700 1 -- 172.21.15.26:0/1247369795 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa8400193f0 con 0x7fa84409d6f0 2023-10-01T07:57:09.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.823+0000 7fa83a7fc700 1 -- 172.21.15.26:0/1247369795 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa840041590 con 0x7fa84409d6f0 2023-10-01T07:57:09.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.823+0000 7fa84bfd4700 1 -- 172.21.15.26:0/1247369795 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa844074ea0 con 0x7fa84409d6f0 2023-10-01T07:57:09.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.829+0000 7fa83a7fc700 1 -- 172.21.15.26:0/1247369795 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa840018990 con 0x7fa84409d6f0 2023-10-01T07:57:09.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.897+0000 7f160cedb700 1 Processor -- start 2023-10-01T07:57:09.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.897+0000 7f160cedb700 1 -- start start 2023-10-01T07:57:09.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.898+0000 7f160cedb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f16080a0a30 0x7f16080a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:09.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.898+0000 7f160cedb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1608134170 0x7f160813bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:09.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.898+0000 7f160cedb700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f160809edd0 con 0x7f16080a1340 2023-10-01T07:57:09.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.898+0000 7f160cedb700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f160809e1f0 con 0x7f1608134170 2023-10-01T07:57:09.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.898+0000 7f160cedb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f160809dc50 con 0x7f16080a0a30 2023-10-01T07:57:09.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.898+0000 7f160659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f16080a0a30 0x7f16080a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:09.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.898+0000 7f160659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f16080a0a30 0x7f16080a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44012/0 (socket says 172.21.15.26:44012) 2023-10-01T07:57:09.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.898+0000 7f1605d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f16080a1340 0x7f1608133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43918/0 (socket says 172.21.15.26:43918) 2023-10-01T07:57:09.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.898+0000 7f160659c700 1 -- 172.21.15.26:0/1501727561 learned_addr learned my addr 172.21.15.26:0/1501727561 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:09.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.898+0000 7f1606d9d700 1 --2- 172.21.15.26:0/1501727561 >> v2:172.21.15.26:3300/0 conn(0x7f1608134170 0x7f160813bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:09.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.899+0000 7f160659c700 1 -- 172.21.15.26:0/1501727561 >> v2:172.21.15.26:3300/0 conn(0x7f1608134170 msgr2=0x7f160813bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:09.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.899+0000 7f160659c700 1 --2- 172.21.15.26:0/1501727561 >> v2:172.21.15.26:3300/0 conn(0x7f1608134170 0x7f160813bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:09.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.899+0000 7f160659c700 1 -- 172.21.15.26:0/1501727561 >> v1:172.21.15.26:6789/0 conn(0x7f16080a1340 legacy=0x7f1608133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:09.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.899+0000 7f160659c700 1 -- 172.21.15.26:0/1501727561 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16080a1fe0 con 0x7f16080a0a30 2023-10-01T07:57:09.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.899+0000 7f1606d9d700 1 --2- 172.21.15.26:0/1501727561 >> v2:172.21.15.26:3300/0 conn(0x7f1608134170 0x7f160813bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:57:09.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.899+0000 7f160659c700 1 --2- 172.21.15.26:0/1501727561 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f16080a0a30 0x7f16080a0e00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f15f80098f0 tx=0x7f15f8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aea2476785755abd server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:09.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.899+0000 7f160559a700 1 -- 172.21.15.26:0/1501727561 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f800b8a0 con 0x7f16080a0a30 2023-10-01T07:57:09.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.899+0000 7f160559a700 1 -- 172.21.15.26:0/1501727561 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f800ba00 con 0x7f16080a0a30 2023-10-01T07:57:09.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.899+0000 7f160559a700 1 -- 172.21.15.26:0/1501727561 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f800bd90 con 0x7f16080a0a30 2023-10-01T07:57:09.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.900+0000 7f160cedb700 1 -- 172.21.15.26:0/1501727561 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f16080a0a30 msgr2=0x7f16080a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:09.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.900+0000 7f160cedb700 1 --2- 172.21.15.26:0/1501727561 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f16080a0a30 0x7f16080a0e00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f15f80098f0 tx=0x7f15f8009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:09.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.900+0000 7f160cedb700 1 -- 172.21.15.26:0/1501727561 shutdown_connections 2023-10-01T07:57:09.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.900+0000 7f160cedb700 1 --2- 172.21.15.26:0/1501727561 >> v2:172.21.15.26:3300/0 conn(0x7f1608134170 0x7f160813bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:09.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.900+0000 7f160cedb700 1 --2- 172.21.15.26:0/1501727561 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f16080a0a30 0x7f16080a0e00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:09.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.900+0000 7f160cedb700 1 -- 172.21.15.26:0/1501727561 >> 172.21.15.26:0/1501727561 conn(0x7f16080a6550 msgr2=0x7f16080a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:09.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.900+0000 7f160cedb700 1 -- 172.21.15.26:0/1501727561 shutdown_connections 2023-10-01T07:57:09.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.900+0000 7f160cedb700 1 -- 172.21.15.26:0/1501727561 wait complete. 2023-10-01T07:57:09.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.901+0000 7f160cedb700 1 Processor -- start 2023-10-01T07:57:09.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.901+0000 7f160cedb700 1 -- start start 2023-10-01T07:57:09.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.902+0000 7f160cedb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16080a0a30 0x7f1608122810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:09.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.902+0000 7f160cedb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f16080a1340 0x7f1608122d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:09.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.902+0000 7f160cedb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1608134170 0x7f1608123290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:09.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.902+0000 7f160cedb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1608125fb0 con 0x7f16080a0a30 2023-10-01T07:57:09.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.902+0000 7f160cedb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1608133290 con 0x7f1608134170 2023-10-01T07:57:09.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.902+0000 7f160cedb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16080a4f40 con 0x7f16080a1340 2023-10-01T07:57:09.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.902+0000 7f1605d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f16080a1340 0x7f1608122d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:09.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.902+0000 7f1605d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f16080a1340 0x7f1608122d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44024/0 (socket says 172.21.15.26:44024) 2023-10-01T07:57:09.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.902+0000 7f1605d9b700 1 -- 172.21.15.26:0/3590317942 learned_addr learned my addr 172.21.15.26:0/3590317942 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:09.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.902+0000 7f160659c700 1 --2- 172.21.15.26:0/3590317942 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16080a0a30 0x7f1608122810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:09.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.902+0000 7f1606d9d700 1 --2- 172.21.15.26:0/3590317942 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1608134170 0x7f1608123290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:09.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.902+0000 7f160659c700 1 -- 172.21.15.26:0/3590317942 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f16080a1340 msgr2=0x7f1608122d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:09.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.902+0000 7f160659c700 1 --2- 172.21.15.26:0/3590317942 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f16080a1340 0x7f1608122d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:09.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.902+0000 7f160659c700 1 -- 172.21.15.26:0/3590317942 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1608134170 msgr2=0x7f1608123290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:09.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.902+0000 7f160659c700 1 --2- 172.21.15.26:0/3590317942 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1608134170 0x7f1608123290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:09.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.902+0000 7f160659c700 1 -- 172.21.15.26:0/3590317942 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f8009550 con 0x7f16080a0a30 2023-10-01T07:57:09.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.902+0000 7f1606d9d700 1 --2- 172.21.15.26:0/3590317942 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1608134170 0x7f1608123290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:09.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.902+0000 7f1605d9b700 1 --2- 172.21.15.26:0/3590317942 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f16080a1340 0x7f1608122d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:09.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.903+0000 7f160659c700 1 --2- 172.21.15.26:0/3590317942 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16080a0a30 0x7f1608122810 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f15f8016000 tx=0x7f15f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:09.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.903+0000 7f15f6ffd700 1 -- 172.21.15.26:0/3590317942 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f8004510 con 0x7f16080a0a30 2023-10-01T07:57:09.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.903+0000 7f15f6ffd700 1 -- 172.21.15.26:0/3590317942 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f80036a0 con 0x7f16080a0a30 2023-10-01T07:57:09.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.903+0000 7f160cedb700 1 -- 172.21.15.26:0/3590317942 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1608124420 con 0x7f16080a0a30 2023-10-01T07:57:09.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.903+0000 7f15f6ffd700 1 -- 172.21.15.26:0/3590317942 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f8003a10 con 0x7f16080a0a30 2023-10-01T07:57:09.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.903+0000 7f160cedb700 1 -- 172.21.15.26:0/3590317942 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1608124b30 con 0x7f16080a0a30 2023-10-01T07:57:09.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.904+0000 7f15f6ffd700 1 -- 172.21.15.26:0/3590317942 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f15f8021070 con 0x7f16080a0a30 2023-10-01T07:57:09.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.904+0000 7f15f6ffd700 1 -- 172.21.15.26:0/3590317942 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f15f8040990 con 0x7f16080a0a30 2023-10-01T07:57:09.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.904+0000 7f160cedb700 1 -- 172.21.15.26:0/3590317942 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16080a1d40 con 0x7f16080a0a30 2023-10-01T07:57:09.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.914+0000 7f15f6ffd700 1 -- 172.21.15.26:0/3590317942 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f15f8015080 con 0x7f16080a0a30 2023-10-01T07:57:09.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.940+0000 7fc0d9408700 1 Processor -- start 2023-10-01T07:57:09.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.940+0000 7fc0d9408700 1 -- start start 2023-10-01T07:57:09.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.941+0000 7fc0d9408700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0d409e930 0x7fc0d409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:09.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.941+0000 7fc0d9408700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc0d409f240 0x7fc0d41317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:09.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.941+0000 7fc0d9408700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0d4070940 con 0x7fc0d409f650 2023-10-01T07:57:09.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.941+0000 7fc0d9408700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0d406fd60 con 0x7fc0d409f240 2023-10-01T07:57:09.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.941+0000 7fc0d9408700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d406fa80 con 0x7fc0d409e930 2023-10-01T07:57:09.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.941+0000 7fc0d2ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0d409e930 0x7fc0d409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:09.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.941+0000 7fc0d2ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0d409e930 0x7fc0d409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:39368/0 (socket says 172.21.15.26:39368) 2023-10-01T07:57:09.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.941+0000 7fc0d2ffd700 1 -- 172.21.15.26:0/1285650829 learned_addr learned my addr 172.21.15.26:0/1285650829 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:09.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.941+0000 7fc0d27fc700 1 --2- 172.21.15.26:0/1285650829 >> v2:172.21.15.26:3300/0 conn(0x7fc0d409f240 0x7fc0d41317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:09.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.941+0000 7fc0d2ffd700 1 -- 172.21.15.26:0/1285650829 >> v2:172.21.15.26:3300/0 conn(0x7fc0d409f240 msgr2=0x7fc0d41317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:09.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.941+0000 7fc0d2ffd700 1 --2- 172.21.15.26:0/1285650829 >> v2:172.21.15.26:3300/0 conn(0x7fc0d409f240 0x7fc0d41317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:09.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.941+0000 7fc0d2ffd700 1 -- 172.21.15.26:0/1285650829 >> v1:172.21.15.26:6789/0 conn(0x7fc0d409f650 legacy=0x7fc0d4131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:09.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.941+0000 7fc0d2ffd700 1 -- 172.21.15.26:0/1285650829 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d409fb60 con 0x7fc0d409e930 2023-10-01T07:57:09.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.942+0000 7fc0d2ffd700 1 --2- 172.21.15.26:0/1285650829 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0d409e930 0x7fc0d409ed00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4009e50 tx=0x7fc0c400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df77a524521adfc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:09.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.942+0000 7fc0d1ffb700 1 -- 172.21.15.26:0/1285650829 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c400e070 con 0x7fc0d409e930 2023-10-01T07:57:09.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.942+0000 7fc0d1ffb700 1 -- 172.21.15.26:0/1285650829 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c400b910 con 0x7fc0d409e930 2023-10-01T07:57:09.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.942+0000 7fc0d1ffb700 1 -- 172.21.15.26:0/1285650829 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c400bcc0 con 0x7fc0d409e930 2023-10-01T07:57:09.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.942+0000 7fc0d9408700 1 -- 172.21.15.26:0/1285650829 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0d409e930 msgr2=0x7fc0d409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:09.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.942+0000 7fc0d9408700 1 --2- 172.21.15.26:0/1285650829 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0d409e930 0x7fc0d409ed00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4009e50 tx=0x7fc0c400b330 comp rx=0 tx=0).stop 2023-10-01T07:57:09.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.942+0000 7fc0d9408700 1 -- 172.21.15.26:0/1285650829 shutdown_connections 2023-10-01T07:57:09.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.942+0000 7fc0d9408700 1 --2- 172.21.15.26:0/1285650829 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0d409e930 0x7fc0d409ed00 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:09.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.942+0000 7fc0d9408700 1 --2- 172.21.15.26:0/1285650829 >> v2:172.21.15.26:3300/0 conn(0x7fc0d409f240 0x7fc0d41317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:09.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.942+0000 7fc0d9408700 1 -- 172.21.15.26:0/1285650829 >> 172.21.15.26:0/1285650829 conn(0x7fc0d40a4210 msgr2=0x7fc0d40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:09.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.943+0000 7fc0d9408700 1 -- 172.21.15.26:0/1285650829 shutdown_connections 2023-10-01T07:57:09.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.943+0000 7fc0d9408700 1 -- 172.21.15.26:0/1285650829 wait complete. 2023-10-01T07:57:09.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.944+0000 7fc0d9408700 1 Processor -- start 2023-10-01T07:57:09.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.944+0000 7fc0d9408700 1 -- start start 2023-10-01T07:57:09.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.944+0000 7fc0d9408700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0d409e930 0x7fc0d41a3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:09.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.944+0000 7fc0d9408700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc0d409f240 0x7fc0d41a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:09.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.944+0000 7fc0d9408700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0d409f650 0x7fc0d41a4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:09.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.944+0000 7fc0d9408700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d41a51b0 con 0x7fc0d409e930 2023-10-01T07:57:09.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.944+0000 7fc0d9408700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d41a5910 con 0x7fc0d409f650 2023-10-01T07:57:09.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.944+0000 7fc0d9408700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d41a6b60 con 0x7fc0d409f240 2023-10-01T07:57:09.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.944+0000 7fc0d2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0d409e930 0x7fc0d41a3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:09.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.944+0000 7fc0d37fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0d409f650 0x7fc0d41a4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:09.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.944+0000 7fc0d2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0d409e930 0x7fc0d41a3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57250/0 (socket says 172.21.15.26:57250) 2023-10-01T07:57:09.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.944+0000 7fc0d37fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0d409f650 0x7fc0d41a4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:39380/0 (socket says 172.21.15.26:39380) 2023-10-01T07:57:09.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.944+0000 7fc0d2ffd700 1 -- 172.21.15.26:0/3398512192 learned_addr learned my addr 172.21.15.26:0/3398512192 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:09.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.945+0000 7fc0d2ffd700 1 -- 172.21.15.26:0/3398512192 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc0d409f240 msgr2=0x7fc0d41a4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:09.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.945+0000 7fc0d2ffd700 1 --2- 172.21.15.26:0/3398512192 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc0d409f240 0x7fc0d41a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:09.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.945+0000 7fc0d2ffd700 1 -- 172.21.15.26:0/3398512192 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0d409f650 msgr2=0x7fc0d41a4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:09.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.945+0000 7fc0d2ffd700 1 --2- 172.21.15.26:0/3398512192 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0d409f650 0x7fc0d41a4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:09.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.945+0000 7fc0d2ffd700 1 -- 172.21.15.26:0/3398512192 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c4009b30 con 0x7fc0d409e930 2023-10-01T07:57:09.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.945+0000 7fc0d37fe700 1 --2- 172.21.15.26:0/3398512192 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0d409f650 0x7fc0d41a4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:09.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.945+0000 7fc0d2ffd700 1 --2- 172.21.15.26:0/3398512192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0d409e930 0x7fc0d41a3d00 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fc0d406fbc0 tx=0x7fc0c4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:09.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.945+0000 7fc0bb7fe700 1 -- 172.21.15.26:0/3398512192 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c40048b0 con 0x7fc0d409e930 2023-10-01T07:57:09.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.945+0000 7fc0bb7fe700 1 -- 172.21.15.26:0/3398512192 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c40092e0 con 0x7fc0d409e930 2023-10-01T07:57:09.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.945+0000 7fc0d9408700 1 -- 172.21.15.26:0/3398512192 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0d40a0190 con 0x7fc0d409e930 2023-10-01T07:57:09.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.945+0000 7fc0bb7fe700 1 -- 172.21.15.26:0/3398512192 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c401c680 con 0x7fc0d409e930 2023-10-01T07:57:09.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.945+0000 7fc0d9408700 1 -- 172.21.15.26:0/3398512192 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0d40a34c0 con 0x7fc0d409e930 2023-10-01T07:57:09.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.946+0000 7fc0bb7fe700 1 -- 172.21.15.26:0/3398512192 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc0c401c7e0 con 0x7fc0d409e930 2023-10-01T07:57:09.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.946+0000 7fc0bb7fe700 1 -- 172.21.15.26:0/3398512192 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc0c4041360 con 0x7fc0d409e930 2023-10-01T07:57:09.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.947+0000 7fc0d9408700 1 -- 172.21.15.26:0/3398512192 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0d41a0b30 con 0x7fc0d409e930 2023-10-01T07:57:09.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:09.952+0000 7fc0bb7fe700 1 -- 172.21.15.26:0/3398512192 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc0c40257d0 con 0x7fc0d409e930 2023-10-01T07:57:10.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.045+0000 7fa84bfd4700 1 -- 172.21.15.26:0/1247369795 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa84406c360 con 0x7fa84409d6f0 2023-10-01T07:57:10.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.046+0000 7fa83a7fc700 1 -- 172.21.15.26:0/1247369795 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa840031090 con 0x7fa84409d6f0 2023-10-01T07:57:10.046 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:10.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.048+0000 7fa84bfd4700 1 -- 172.21.15.26:0/1247369795 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa84409d6f0 msgr2=0x7fa844122800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:10.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.048+0000 7fa84bfd4700 1 --2- 172.21.15.26:0/1247369795 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa84409d6f0 0x7fa844122800 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa84409ea70 tx=0x7fa840004750 comp rx=0 tx=0).stop 2023-10-01T07:57:10.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.048+0000 7fa84bfd4700 1 -- 172.21.15.26:0/1247369795 shutdown_connections 2023-10-01T07:57:10.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.048+0000 7fa84bfd4700 1 --2- 172.21.15.26:0/1247369795 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa84409e410 0x7fa844123280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:10.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.048+0000 7fa84bfd4700 1 --2- 172.21.15.26:0/1247369795 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa84409d6f0 0x7fa844122800 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:10.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.048+0000 7fa84bfd4700 1 --2- 172.21.15.26:0/1247369795 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa84409e000 0x7fa844122d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:10.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.048+0000 7fa84bfd4700 1 -- 172.21.15.26:0/1247369795 >> 172.21.15.26:0/1247369795 conn(0x7fa844066f50 msgr2=0x7fa8440a1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:10.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.048+0000 7fa84bfd4700 1 -- 172.21.15.26:0/1247369795 shutdown_connections 2023-10-01T07:57:10.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.048+0000 7fa84bfd4700 1 -- 172.21.15.26:0/1247369795 wait complete. 2023-10-01T07:57:10.062 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:10.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.121+0000 7f160cedb700 1 -- 172.21.15.26:0/3590317942 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1608074ea0 con 0x7f16080a0a30 2023-10-01T07:57:10.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.121+0000 7f15f6ffd700 1 -- 172.21.15.26:0/3590317942 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f15f8029020 con 0x7f16080a0a30 2023-10-01T07:57:10.122 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:10.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.123+0000 7f160cedb700 1 -- 172.21.15.26:0/3590317942 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16080a0a30 msgr2=0x7f1608122810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:10.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.123+0000 7f160cedb700 1 --2- 172.21.15.26:0/3590317942 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16080a0a30 0x7f1608122810 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f15f8016000 tx=0x7f15f8004750 comp rx=0 tx=0).stop 2023-10-01T07:57:10.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.123+0000 7f160cedb700 1 -- 172.21.15.26:0/3590317942 shutdown_connections 2023-10-01T07:57:10.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.123+0000 7f160cedb700 1 --2- 172.21.15.26:0/3590317942 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1608134170 0x7f1608123290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:10.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.123+0000 7f160cedb700 1 --2- 172.21.15.26:0/3590317942 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16080a0a30 0x7f1608122810 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:10.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.123+0000 7f160cedb700 1 --2- 172.21.15.26:0/3590317942 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f16080a1340 0x7f1608122d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:10.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.123+0000 7f160cedb700 1 -- 172.21.15.26:0/3590317942 >> 172.21.15.26:0/3590317942 conn(0x7f16080a6550 msgr2=0x7f160809ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:10.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.123+0000 7f160cedb700 1 -- 172.21.15.26:0/3590317942 shutdown_connections 2023-10-01T07:57:10.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.123+0000 7f160cedb700 1 -- 172.21.15.26:0/3590317942 wait complete. 2023-10-01T07:57:10.139 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:10.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.160+0000 7fc0d9408700 1 -- 172.21.15.26:0/3398512192 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc0d4074ea0 con 0x7fc0d409e930 2023-10-01T07:57:10.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.160+0000 7fc0bb7fe700 1 -- 172.21.15.26:0/3398512192 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc0c4034090 con 0x7fc0d409e930 2023-10-01T07:57:10.161 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:10.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.163+0000 7fc0d9408700 1 -- 172.21.15.26:0/3398512192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0d409e930 msgr2=0x7fc0d41a3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:10.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.163+0000 7fc0d9408700 1 --2- 172.21.15.26:0/3398512192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0d409e930 0x7fc0d41a3d00 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fc0d406fbc0 tx=0x7fc0c4004ad0 comp rx=0 tx=0).stop 2023-10-01T07:57:10.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.163+0000 7fc0d9408700 1 -- 172.21.15.26:0/3398512192 shutdown_connections 2023-10-01T07:57:10.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.163+0000 7fc0d9408700 1 --2- 172.21.15.26:0/3398512192 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0d409f650 0x7fc0d41a4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:10.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.163+0000 7fc0d9408700 1 --2- 172.21.15.26:0/3398512192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0d409e930 0x7fc0d41a3d00 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:10.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.163+0000 7fc0d9408700 1 --2- 172.21.15.26:0/3398512192 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc0d409f240 0x7fc0d41a4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:10.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.163+0000 7fc0d9408700 1 -- 172.21.15.26:0/3398512192 >> 172.21.15.26:0/3398512192 conn(0x7fc0d40a4210 msgr2=0x7fc0d41b8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:10.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.163+0000 7fc0d9408700 1 -- 172.21.15.26:0/3398512192 shutdown_connections 2023-10-01T07:57:10.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.163+0000 7fc0d9408700 1 -- 172.21.15.26:0/3398512192 wait complete. 2023-10-01T07:57:10.177 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:10.546 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:10.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.692+0000 7f73c06fd700 1 Processor -- start 2023-10-01T07:57:10.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.692+0000 7f73c06fd700 1 -- start start 2023-10-01T07:57:10.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.693+0000 7f73c06fd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f73b81316c0 0x7f73b8131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:10.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.693+0000 7f73c06fd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f73b809d9f0 0x7f73b806a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:10.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.693+0000 7f73c06fd700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73b809e130 con 0x7f73b806acb0 2023-10-01T07:57:10.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.693+0000 7f73c06fd700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b81312b0 con 0x7f73b81316c0 2023-10-01T07:57:10.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.693+0000 7f73c06fd700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73b809f6e0 con 0x7f73b809d9f0 2023-10-01T07:57:10.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.693+0000 7f73be499700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f73b81316c0 0x7f73b8131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:10.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.694+0000 7f73be499700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f73b81316c0 0x7f73b8131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:39388/0 (socket says 172.21.15.26:39388) 2023-10-01T07:57:10.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.694+0000 7f73be499700 1 -- 172.21.15.26:0/4189557042 learned_addr learned my addr 172.21.15.26:0/4189557042 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:10.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.694+0000 7f73bec9a700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f73b806acb0 0x7f73b8138540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43924/0 (socket says 172.21.15.26:43924) 2023-10-01T07:57:10.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.694+0000 7f73bdc98700 1 --2- 172.21.15.26:0/4189557042 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f73b809d9f0 0x7f73b806a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:10.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.694+0000 7f73bdc98700 1 -- 172.21.15.26:0/4189557042 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f73b81316c0 msgr2=0x7f73b8131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:10.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.694+0000 7f73bd497700 1 -- 172.21.15.26:0/4189557042 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 10184742 0 0) 0x7f73b0001490 con 0x7f73b806acb0 2023-10-01T07:57:10.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.694+0000 7f73bdc98700 1 --2- 172.21.15.26:0/4189557042 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f73b81316c0 0x7f73b8131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:10.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.694+0000 7f73bdc98700 1 -- 172.21.15.26:0/4189557042 >> v1:172.21.15.26:6789/0 conn(0x7f73b806acb0 legacy=0x7f73b8138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:10.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.694+0000 7f73bdc98700 1 -- 172.21.15.26:0/4189557042 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b809e760 con 0x7f73b809d9f0 2023-10-01T07:57:10.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.694+0000 7f73be499700 1 --2- 172.21.15.26:0/4189557042 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f73b81316c0 0x7f73b8131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:10.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.694+0000 7f73bdc98700 1 --2- 172.21.15.26:0/4189557042 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f73b809d9f0 0x7f73b806a770 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f73a8009870 tx=0x7f73a8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7b6f053f7dfe20a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:10.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.694+0000 7f73bd497700 1 -- 172.21.15.26:0/4189557042 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a8011830 con 0x7f73b809d9f0 2023-10-01T07:57:10.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.694+0000 7f73bd497700 1 -- 172.21.15.26:0/4189557042 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a8011990 con 0x7f73b809d9f0 2023-10-01T07:57:10.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.694+0000 7f73bd497700 1 -- 172.21.15.26:0/4189557042 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a8011d20 con 0x7f73b809d9f0 2023-10-01T07:57:10.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.695+0000 7f73c06fd700 1 -- 172.21.15.26:0/4189557042 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f73b809d9f0 msgr2=0x7f73b806a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:10.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.695+0000 7f73c06fd700 1 --2- 172.21.15.26:0/4189557042 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f73b809d9f0 0x7f73b806a770 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f73a8009870 tx=0x7f73a8009b80 comp rx=0 tx=0).stop 2023-10-01T07:57:10.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.695+0000 7f73c06fd700 1 -- 172.21.15.26:0/4189557042 shutdown_connections 2023-10-01T07:57:10.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.695+0000 7f73c06fd700 1 --2- 172.21.15.26:0/4189557042 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f73b81316c0 0x7f73b8131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:10.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.695+0000 7f73c06fd700 1 --2- 172.21.15.26:0/4189557042 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f73b809d9f0 0x7f73b806a770 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:10.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.695+0000 7f73c06fd700 1 -- 172.21.15.26:0/4189557042 >> 172.21.15.26:0/4189557042 conn(0x7f73b8066f50 msgr2=0x7f73b809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:10.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.695+0000 7f73c06fd700 1 -- 172.21.15.26:0/4189557042 shutdown_connections 2023-10-01T07:57:10.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.695+0000 7f73c06fd700 1 -- 172.21.15.26:0/4189557042 wait complete. 2023-10-01T07:57:10.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.696+0000 7f73c06fd700 1 Processor -- start 2023-10-01T07:57:10.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.696+0000 7f73c06fd700 1 -- start start 2023-10-01T07:57:10.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.696+0000 7f73c06fd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f73b806acb0 0x7f73b806e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:10.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.696+0000 7f73c06fd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f73b809d9f0 0x7f73b806ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:10.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.696+0000 7f73c06fd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73b81316c0 0x7f73b806f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:10.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.696+0000 7f73c06fd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b80710b0 con 0x7f73b81316c0 2023-10-01T07:57:10.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.696+0000 7f73c06fd700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b8071290 con 0x7f73b806acb0 2023-10-01T07:57:10.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.697+0000 7f73c06fd700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73b812b270 con 0x7f73b809d9f0 2023-10-01T07:57:10.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.697+0000 7f73be499700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f73b806acb0 0x7f73b806e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:10.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.697+0000 7f73be499700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f73b806acb0 0x7f73b806e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:39392/0 (socket says 172.21.15.26:39392) 2023-10-01T07:57:10.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.697+0000 7f73bec9a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73b81316c0 0x7f73b806f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:10.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.697+0000 7f73be499700 1 -- 172.21.15.26:0/2664598835 learned_addr learned my addr 172.21.15.26:0/2664598835 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:10.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.697+0000 7f73bdc98700 1 --2- 172.21.15.26:0/2664598835 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f73b809d9f0 0x7f73b806ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:10.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.697+0000 7f73be499700 1 -- 172.21.15.26:0/2664598835 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f73b809d9f0 msgr2=0x7f73b806ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:10.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.697+0000 7f73be499700 1 --2- 172.21.15.26:0/2664598835 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f73b809d9f0 0x7f73b806ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:10.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.697+0000 7f73be499700 1 -- 172.21.15.26:0/2664598835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73b81316c0 msgr2=0x7f73b806f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:10.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.697+0000 7f73be499700 1 --2- 172.21.15.26:0/2664598835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73b81316c0 0x7f73b806f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:10.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.697+0000 7f73be499700 1 -- 172.21.15.26:0/2664598835 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b4009550 con 0x7f73b806acb0 2023-10-01T07:57:10.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.697+0000 7f73bdc98700 1 --2- 172.21.15.26:0/2664598835 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f73b809d9f0 0x7f73b806ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:10.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.697+0000 7f73be499700 1 --2- 172.21.15.26:0/2664598835 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f73b806acb0 0x7f73b806e8e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f73b400ebe0 tx=0x7f73b400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:10.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.697+0000 7f73aeffd700 1 -- 172.21.15.26:0/2664598835 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b400c850 con 0x7f73b806acb0 2023-10-01T07:57:10.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.697+0000 7f73aeffd700 1 -- 172.21.15.26:0/2664598835 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b400c9b0 con 0x7f73b806acb0 2023-10-01T07:57:10.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.697+0000 7f73c06fd700 1 -- 172.21.15.26:0/2664598835 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a80094a0 con 0x7f73b806acb0 2023-10-01T07:57:10.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.697+0000 7f73aeffd700 1 -- 172.21.15.26:0/2664598835 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b400cd40 con 0x7f73b806acb0 2023-10-01T07:57:10.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.697+0000 7f73c06fd700 1 -- 172.21.15.26:0/2664598835 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73b8070cf0 con 0x7f73b806acb0 2023-10-01T07:57:10.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.698+0000 7f73aeffd700 1 -- 172.21.15.26:0/2664598835 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f73b4013470 con 0x7f73b806acb0 2023-10-01T07:57:10.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.698+0000 7f73c06fd700 1 -- 172.21.15.26:0/2664598835 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73b8070ee0 con 0x7f73b806acb0 2023-10-01T07:57:10.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.698+0000 7f73aeffd700 1 -- 172.21.15.26:0/2664598835 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f73b403f880 con 0x7f73b806acb0 2023-10-01T07:57:10.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.703+0000 7f73aeffd700 1 -- 172.21.15.26:0/2664598835 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f73b40232f0 con 0x7f73b806acb0 2023-10-01T07:57:10.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.905+0000 7f73c06fd700 1 -- 172.21.15.26:0/2664598835 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f73b8071ed0 con 0x7f73b806acb0 2023-10-01T07:57:10.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.906+0000 7f73aeffd700 1 -- 172.21.15.26:0/2664598835 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f73b4021070 con 0x7f73b806acb0 2023-10-01T07:57:10.906 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:10.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.908+0000 7f73c06fd700 1 -- 172.21.15.26:0/2664598835 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f73b806acb0 msgr2=0x7f73b806e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:10.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.908+0000 7f73c06fd700 1 --2- 172.21.15.26:0/2664598835 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f73b806acb0 0x7f73b806e8e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f73b400ebe0 tx=0x7f73b400eef0 comp rx=0 tx=0).stop 2023-10-01T07:57:10.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.908+0000 7f73c06fd700 1 -- 172.21.15.26:0/2664598835 shutdown_connections 2023-10-01T07:57:10.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.908+0000 7f73c06fd700 1 --2- 172.21.15.26:0/2664598835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73b81316c0 0x7f73b806f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:10.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.908+0000 7f73c06fd700 1 --2- 172.21.15.26:0/2664598835 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f73b806acb0 0x7f73b806e8e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:10.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.908+0000 7f73c06fd700 1 --2- 172.21.15.26:0/2664598835 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f73b809d9f0 0x7f73b806ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:10.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.908+0000 7f73c06fd700 1 -- 172.21.15.26:0/2664598835 >> 172.21.15.26:0/2664598835 conn(0x7f73b8066f50 msgr2=0x7f73b809a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:10.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.908+0000 7f73c06fd700 1 -- 172.21.15.26:0/2664598835 shutdown_connections 2023-10-01T07:57:10.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:10.908+0000 7f73c06fd700 1 -- 172.21.15.26:0/2664598835 wait complete. 2023-10-01T07:57:10.922 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:11.063 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:11.140 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:11.178 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:11.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.210+0000 7f316dec0700 1 Processor -- start 2023-10-01T07:57:11.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.210+0000 7f316dec0700 1 -- start start 2023-10-01T07:57:11.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.210+0000 7f316dec0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f316809e1d0 0x7f3168135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:11.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.210+0000 7f316dec0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3168135e50 0x7f3168138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:11.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.210+0000 7f316dec0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f316809f130 con 0x7f316809d6f0 2023-10-01T07:57:11.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.210+0000 7f316dec0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f316809f520 con 0x7f316809e1d0 2023-10-01T07:57:11.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.210+0000 7f316dec0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f316809e930 con 0x7f3168135e50 2023-10-01T07:57:11.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.210+0000 7f31677fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f316809d6f0 0x7f316809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43926/0 (socket says 172.21.15.26:43926) 2023-10-01T07:57:11.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.211+0000 7f31677fe700 1 -- 172.21.15.26:0/3779262754 learned_addr learned my addr 172.21.15.26:0/3779262754 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:11.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.211+0000 7f3166ffd700 1 --2- 172.21.15.26:0/3779262754 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f316809e1d0 0x7f3168135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:11.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.211+0000 7f3167fff700 1 --2- 172.21.15.26:0/3779262754 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3168135e50 0x7f3168138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:11.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.211+0000 7f31667fc700 1 -- 172.21.15.26:0/3779262754 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3789557632 0 0) 0x7f316809f130 con 0x7f316809d6f0 2023-10-01T07:57:11.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.211+0000 7f31667fc700 1 -- 172.21.15.26:0/3779262754 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31500035b0 con 0x7f316809d6f0 2023-10-01T07:57:11.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.211+0000 7f3166ffd700 1 -- 172.21.15.26:0/3779262754 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3168135e50 msgr2=0x7f3168138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:11.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.211+0000 7f3166ffd700 1 --2- 172.21.15.26:0/3779262754 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3168135e50 0x7f3168138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:11.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.211+0000 7f3166ffd700 1 -- 172.21.15.26:0/3779262754 >> v1:172.21.15.26:6789/0 conn(0x7f316809d6f0 legacy=0x7f316809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:11.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.211+0000 7f3166ffd700 1 -- 172.21.15.26:0/3779262754 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316809b2d0 con 0x7f316809e1d0 2023-10-01T07:57:11.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.211+0000 7f3166ffd700 1 --2- 172.21.15.26:0/3779262754 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f316809e1d0 0x7f3168135910 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f315c0098a0 tx=0x7f315c009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fce8b5c4304beddc server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:11.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.212+0000 7f31667fc700 1 -- 172.21.15.26:0/3779262754 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c011830 con 0x7f316809e1d0 2023-10-01T07:57:11.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.212+0000 7f31667fc700 1 -- 172.21.15.26:0/3779262754 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315c011990 con 0x7f316809e1d0 2023-10-01T07:57:11.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.212+0000 7f31667fc700 1 -- 172.21.15.26:0/3779262754 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c011d20 con 0x7f316809e1d0 2023-10-01T07:57:11.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.213+0000 7f316dec0700 1 -- 172.21.15.26:0/3779262754 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f316809e1d0 msgr2=0x7f3168135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:11.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.213+0000 7f316dec0700 1 --2- 172.21.15.26:0/3779262754 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f316809e1d0 0x7f3168135910 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f315c0098a0 tx=0x7f315c009bb0 comp rx=0 tx=0).stop 2023-10-01T07:57:11.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.213+0000 7f316dec0700 1 -- 172.21.15.26:0/3779262754 shutdown_connections 2023-10-01T07:57:11.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.213+0000 7f316dec0700 1 --2- 172.21.15.26:0/3779262754 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3168135e50 0x7f3168138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:11.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.213+0000 7f316dec0700 1 --2- 172.21.15.26:0/3779262754 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f316809e1d0 0x7f3168135910 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:11.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.213+0000 7f316dec0700 1 -- 172.21.15.26:0/3779262754 >> 172.21.15.26:0/3779262754 conn(0x7f3168066f50 msgr2=0x7f316809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:11.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.213+0000 7f316dec0700 1 -- 172.21.15.26:0/3779262754 shutdown_connections 2023-10-01T07:57:11.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.213+0000 7f316dec0700 1 -- 172.21.15.26:0/3779262754 wait complete. 2023-10-01T07:57:11.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.214+0000 7f316dec0700 1 Processor -- start 2023-10-01T07:57:11.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.215+0000 7f316dec0700 1 -- start start 2023-10-01T07:57:11.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.215+0000 7f316dec0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f316809d6f0 0x7f316811b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:11.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.215+0000 7f316dec0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f316809e1d0 0x7f316811b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:11.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.216+0000 7f316dec0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3168135e50 0x7f316811bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:11.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.216+0000 7f316dec0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316811f910 con 0x7f316809d6f0 2023-10-01T07:57:11.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.216+0000 7f316dec0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f316811d040 con 0x7f3168135e50 2023-10-01T07:57:11.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.216+0000 7f316dec0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f316811e290 con 0x7f316809e1d0 2023-10-01T07:57:11.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.216+0000 7f31677fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f316809d6f0 0x7f316811b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:11.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.216+0000 7f3166ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f316809e1d0 0x7f316811b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:11.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.216+0000 7f31677fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f316809d6f0 0x7f316811b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57274/0 (socket says 172.21.15.26:57274) 2023-10-01T07:57:11.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.216+0000 7f31677fe700 1 -- 172.21.15.26:0/1875692351 learned_addr learned my addr 172.21.15.26:0/1875692351 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:11.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.216+0000 7f3167fff700 1 --2- 172.21.15.26:0/1875692351 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3168135e50 0x7f316811bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:11.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.216+0000 7f3166ffd700 1 -- 172.21.15.26:0/1875692351 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3168135e50 msgr2=0x7f316811bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:11.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.216+0000 7f3166ffd700 1 --2- 172.21.15.26:0/1875692351 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3168135e50 0x7f316811bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:11.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.216+0000 7f3166ffd700 1 -- 172.21.15.26:0/1875692351 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f316809d6f0 msgr2=0x7f316811b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:11.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.216+0000 7f3166ffd700 1 --2- 172.21.15.26:0/1875692351 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f316809d6f0 0x7f316811b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:11.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.216+0000 7f3166ffd700 1 -- 172.21.15.26:0/1875692351 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315c0094a0 con 0x7f316809e1d0 2023-10-01T07:57:11.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.216+0000 7f31677fe700 1 --2- 172.21.15.26:0/1875692351 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f316809d6f0 0x7f316811b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:11.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.216+0000 7f3166ffd700 1 --2- 172.21.15.26:0/1875692351 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f316809e1d0 0x7f316811b9c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f316809f6f0 tx=0x7f315c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:11.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.217+0000 7f314ffff700 1 -- 172.21.15.26:0/1875692351 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c004450 con 0x7f316809e1d0 2023-10-01T07:57:11.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.217+0000 7f314ffff700 1 -- 172.21.15.26:0/1875692351 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315c01f070 con 0x7f316809e1d0 2023-10-01T07:57:11.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.217+0000 7f316dec0700 1 -- 172.21.15.26:0/1875692351 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f316811ec70 con 0x7f316809e1d0 2023-10-01T07:57:11.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.217+0000 7f314ffff700 1 -- 172.21.15.26:0/1875692351 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c0038e0 con 0x7f316809e1d0 2023-10-01T07:57:11.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.217+0000 7f316dec0700 1 -- 172.21.15.26:0/1875692351 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f316809c700 con 0x7f316809e1d0 2023-10-01T07:57:11.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.218+0000 7f314ffff700 1 -- 172.21.15.26:0/1875692351 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f315c003a40 con 0x7f316809e1d0 2023-10-01T07:57:11.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.218+0000 7f314ffff700 1 -- 172.21.15.26:0/1875692351 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f315c021070 con 0x7f316809e1d0 2023-10-01T07:57:11.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.219+0000 7f316dec0700 1 -- 172.21.15.26:0/1875692351 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3168071700 con 0x7f316809e1d0 2023-10-01T07:57:11.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.228+0000 7f314ffff700 1 -- 172.21.15.26:0/1875692351 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f315c02b080 con 0x7f316809e1d0 2023-10-01T07:57:11.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.284+0000 7f89ba550700 1 Processor -- start 2023-10-01T07:57:11.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.284+0000 7f89ba550700 1 -- start start 2023-10-01T07:57:11.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.285+0000 7f89ba550700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89b409f410 0x7f89b4136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:11.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.285+0000 7f89ba550700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89b4136fe0 0x7f89b41393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:11.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.285+0000 7f89ba550700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89b4070940 con 0x7f89b409e930 2023-10-01T07:57:11.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.285+0000 7f89ba550700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b406fd60 con 0x7f89b409f410 2023-10-01T07:57:11.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.285+0000 7f89ba550700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89b406fa80 con 0x7f89b4136fe0 2023-10-01T07:57:11.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.285+0000 7f89b3fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f89b409e930 0x7f89b409ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43942/0 (socket says 172.21.15.26:43942) 2023-10-01T07:57:11.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.285+0000 7f89b3fff700 1 -- 172.21.15.26:0/209571278 learned_addr learned my addr 172.21.15.26:0/209571278 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:11.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.285+0000 7f89b37fe700 1 --2- 172.21.15.26:0/209571278 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89b409f410 0x7f89b4136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:11.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.285+0000 7f89b8aed700 1 --2- 172.21.15.26:0/209571278 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89b4136fe0 0x7f89b41393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:11.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.286+0000 7f89b2ffd700 1 -- 172.21.15.26:0/209571278 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2287489181 0 0) 0x7f89b4070940 con 0x7f89b409e930 2023-10-01T07:57:11.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.286+0000 7f89b2ffd700 1 -- 172.21.15.26:0/209571278 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f899c0035b0 con 0x7f89b409e930 2023-10-01T07:57:11.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.286+0000 7f89b37fe700 1 -- 172.21.15.26:0/209571278 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89b4136fe0 msgr2=0x7f89b41393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:11.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.286+0000 7f89b37fe700 1 --2- 172.21.15.26:0/209571278 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89b4136fe0 0x7f89b41393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:11.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.286+0000 7f89b37fe700 1 -- 172.21.15.26:0/209571278 >> v1:172.21.15.26:6789/0 conn(0x7f89b409e930 legacy=0x7f89b409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:11.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.286+0000 7f89b37fe700 1 -- 172.21.15.26:0/209571278 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b409fb60 con 0x7f89b409f410 2023-10-01T07:57:11.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.286+0000 7f89b37fe700 1 --2- 172.21.15.26:0/209571278 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89b409f410 0x7f89b4136aa0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f89a8009870 tx=0x7f89a8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2c2cba5da87948a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:11.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.286+0000 7f89b2ffd700 1 -- 172.21.15.26:0/209571278 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a8011830 con 0x7f89b409f410 2023-10-01T07:57:11.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.286+0000 7f89b2ffd700 1 -- 172.21.15.26:0/209571278 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a8011990 con 0x7f89b409f410 2023-10-01T07:57:11.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.286+0000 7f89b2ffd700 1 -- 172.21.15.26:0/209571278 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a8011d00 con 0x7f89b409f410 2023-10-01T07:57:11.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.287+0000 7f89ba550700 1 -- 172.21.15.26:0/209571278 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89b409f410 msgr2=0x7f89b4136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:11.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.287+0000 7f89ba550700 1 --2- 172.21.15.26:0/209571278 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89b409f410 0x7f89b4136aa0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f89a8009870 tx=0x7f89a8009b80 comp rx=0 tx=0).stop 2023-10-01T07:57:11.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.287+0000 7f89ba550700 1 -- 172.21.15.26:0/209571278 shutdown_connections 2023-10-01T07:57:11.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.287+0000 7f89ba550700 1 --2- 172.21.15.26:0/209571278 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89b4136fe0 0x7f89b41393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:11.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.287+0000 7f89ba550700 1 --2- 172.21.15.26:0/209571278 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89b409f410 0x7f89b4136aa0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:11.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.287+0000 7f89ba550700 1 -- 172.21.15.26:0/209571278 >> 172.21.15.26:0/209571278 conn(0x7f89b40a4210 msgr2=0x7f89b40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:11.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.287+0000 7f89ba550700 1 -- 172.21.15.26:0/209571278 shutdown_connections 2023-10-01T07:57:11.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.287+0000 7f89ba550700 1 -- 172.21.15.26:0/209571278 wait complete. 2023-10-01T07:57:11.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.288+0000 7f89ba550700 1 Processor -- start 2023-10-01T07:57:11.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.289+0000 7f89ba550700 1 -- start start 2023-10-01T07:57:11.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.289+0000 7f89ba550700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89b409e930 0x7f89b411a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:11.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.289+0000 7f89ba550700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89b409f410 0x7f89b411abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:11.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.289+0000 7f89ba550700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89b4136fe0 0x7f89b411b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:11.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.289+0000 7f89ba550700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b411d150 con 0x7f89b409e930 2023-10-01T07:57:11.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.289+0000 7f89ba550700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b4071d20 con 0x7f89b409f410 2023-10-01T07:57:11.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.289+0000 7f89ba550700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89b411c760 con 0x7f89b4136fe0 2023-10-01T07:57:11.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.289+0000 7f89b37fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89b409f410 0x7f89b411abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:11.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.289+0000 7f89b3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89b409e930 0x7f89b411a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:11.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.289+0000 7f89b37fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89b409f410 0x7f89b411abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:39430/0 (socket says 172.21.15.26:39430) 2023-10-01T07:57:11.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.289+0000 7f89b37fe700 1 -- 172.21.15.26:0/3178193466 learned_addr learned my addr 172.21.15.26:0/3178193466 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:11.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.290+0000 7f89b8aed700 1 --2- 172.21.15.26:0/3178193466 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89b4136fe0 0x7f89b411b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:11.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.290+0000 7f89b3fff700 1 -- 172.21.15.26:0/3178193466 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89b4136fe0 msgr2=0x7f89b411b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:11.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.290+0000 7f89b3fff700 1 --2- 172.21.15.26:0/3178193466 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89b4136fe0 0x7f89b411b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:11.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.290+0000 7f89b3fff700 1 -- 172.21.15.26:0/3178193466 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89b409f410 msgr2=0x7f89b411abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:11.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.290+0000 7f89b3fff700 1 --2- 172.21.15.26:0/3178193466 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89b409f410 0x7f89b411abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:11.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.290+0000 7f89b3fff700 1 -- 172.21.15.26:0/3178193466 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a80094a0 con 0x7f89b409e930 2023-10-01T07:57:11.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.290+0000 7f89b37fe700 1 --2- 172.21.15.26:0/3178193466 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89b409f410 0x7f89b411abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:11.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.290+0000 7f89b3fff700 1 --2- 172.21.15.26:0/3178193466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89b409e930 0x7f89b411a680 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f89a400c460 tx=0x7f89a400c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:11.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.290+0000 7f89b0ff9700 1 -- 172.21.15.26:0/3178193466 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a4005d70 con 0x7f89b409e930 2023-10-01T07:57:11.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.290+0000 7f89b0ff9700 1 -- 172.21.15.26:0/3178193466 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a40070d0 con 0x7f89b409e930 2023-10-01T07:57:11.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.290+0000 7f89b0ff9700 1 -- 172.21.15.26:0/3178193466 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a4007460 con 0x7f89b409e930 2023-10-01T07:57:11.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.290+0000 7f89ba550700 1 -- 172.21.15.26:0/3178193466 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b411c4c0 con 0x7f89b409e930 2023-10-01T07:57:11.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.290+0000 7f89ba550700 1 -- 172.21.15.26:0/3178193466 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b411d5a0 con 0x7f89b409e930 2023-10-01T07:57:11.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.291+0000 7f89b0ff9700 1 -- 172.21.15.26:0/3178193466 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f89a40075c0 con 0x7f89b409e930 2023-10-01T07:57:11.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.291+0000 7f89b0ff9700 1 -- 172.21.15.26:0/3178193466 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f89a403e710 con 0x7f89b409e930 2023-10-01T07:57:11.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.293+0000 7f89ba550700 1 -- 172.21.15.26:0/3178193466 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89b4074ea0 con 0x7f89b409e930 2023-10-01T07:57:11.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.298+0000 7f89b0ff9700 1 -- 172.21.15.26:0/3178193466 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f89a4017020 con 0x7f89b409e930 2023-10-01T07:57:11.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.328+0000 7f688a2e6700 1 Processor -- start 2023-10-01T07:57:11.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.328+0000 7f688a2e6700 1 -- start start 2023-10-01T07:57:11.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.329+0000 7f688a2e6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f68840a0a30 0x7f68840a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:11.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.329+0000 7f688a2e6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f688409d630 0x7f68840a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:11.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.329+0000 7f688a2e6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6884133930 0x7f6884133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:11.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.329+0000 7f688a2e6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68840a2a70 con 0x7f68840a0a30 2023-10-01T07:57:11.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.329+0000 7f688a2e6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68840a01d0 con 0x7f688409d630 2023-10-01T07:57:11.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.329+0000 7f688a2e6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f688409e2b0 con 0x7f6884133930 2023-10-01T07:57:11.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.329+0000 7f6883fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f68840a0a30 0x7f68840a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:11.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.329+0000 7f68837fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f688409d630 0x7f68840a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:11.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.329+0000 7f6883fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f68840a0a30 0x7f68840a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57282/0 (socket says 172.21.15.26:57282) 2023-10-01T07:57:11.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.329+0000 7f6883fff700 1 -- 172.21.15.26:0/1923121032 learned_addr learned my addr 172.21.15.26:0/1923121032 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:11.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.329+0000 7f6888883700 1 --2- 172.21.15.26:0/1923121032 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6884133930 0x7f6884133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:11.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.330+0000 7f6883fff700 1 -- 172.21.15.26:0/1923121032 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6884133930 msgr2=0x7f6884133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:11.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.330+0000 7f6883fff700 1 --2- 172.21.15.26:0/1923121032 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6884133930 0x7f6884133db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:11.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.330+0000 7f6883fff700 1 -- 172.21.15.26:0/1923121032 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f688409d630 msgr2=0x7f68840a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:11.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.330+0000 7f6883fff700 1 --2- 172.21.15.26:0/1923121032 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f688409d630 0x7f68840a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:11.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.330+0000 7f6883fff700 1 -- 172.21.15.26:0/1923121032 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f688409dc50 con 0x7f68840a0a30 2023-10-01T07:57:11.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.330+0000 7f6883fff700 1 --2- 172.21.15.26:0/1923121032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68840a0a30 0x7f68840a0e00 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f68740098f0 tx=0x7f6874009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de30b110a4b25651 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:11.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.330+0000 7f6882ffd700 1 -- 172.21.15.26:0/1923121032 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6874011830 con 0x7f68840a0a30 2023-10-01T07:57:11.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.330+0000 7f6882ffd700 1 -- 172.21.15.26:0/1923121032 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6874011990 con 0x7f68840a0a30 2023-10-01T07:57:11.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.330+0000 7f6882ffd700 1 -- 172.21.15.26:0/1923121032 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6874011d20 con 0x7f68840a0a30 2023-10-01T07:57:11.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.331+0000 7f688a2e6700 1 -- 172.21.15.26:0/1923121032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68840a0a30 msgr2=0x7f68840a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:11.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.331+0000 7f688a2e6700 1 --2- 172.21.15.26:0/1923121032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68840a0a30 0x7f68840a0e00 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f68740098f0 tx=0x7f6874009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:11.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.331+0000 7f688a2e6700 1 -- 172.21.15.26:0/1923121032 shutdown_connections 2023-10-01T07:57:11.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.331+0000 7f688a2e6700 1 --2- 172.21.15.26:0/1923121032 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6884133930 0x7f6884133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:11.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.331+0000 7f688a2e6700 1 --2- 172.21.15.26:0/1923121032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68840a0a30 0x7f68840a0e00 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:11.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.331+0000 7f688a2e6700 1 --2- 172.21.15.26:0/1923121032 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f688409d630 0x7f68840a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:11.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.331+0000 7f688a2e6700 1 -- 172.21.15.26:0/1923121032 >> 172.21.15.26:0/1923121032 conn(0x7f68840a3050 msgr2=0x7f68840a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:11.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.331+0000 7f688a2e6700 1 -- 172.21.15.26:0/1923121032 shutdown_connections 2023-10-01T07:57:11.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.331+0000 7f688a2e6700 1 -- 172.21.15.26:0/1923121032 wait complete. 2023-10-01T07:57:11.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.332+0000 7f688a2e6700 1 Processor -- start 2023-10-01T07:57:11.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.332+0000 7f688a2e6700 1 -- start start 2023-10-01T07:57:11.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.332+0000 7f688a2e6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f688409d630 0x7f688411f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:11.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.332+0000 7f688a2e6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f68840a0a30 0x7f688411f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:11.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.333+0000 7f688a2e6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6884133930 0x7f68841c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:11.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.333+0000 7f688a2e6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688411edd0 con 0x7f688409d630 2023-10-01T07:57:11.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.333+0000 7f688a2e6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f688411fd40 con 0x7f6884133930 2023-10-01T07:57:11.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.333+0000 7f688a2e6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6884121de0 con 0x7f68840a0a30 2023-10-01T07:57:11.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.333+0000 7f6883fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f688409d630 0x7f688411f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:11.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.333+0000 7f6883fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f688409d630 0x7f688411f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57296/0 (socket says 172.21.15.26:57296) 2023-10-01T07:57:11.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.333+0000 7f6883fff700 1 -- 172.21.15.26:0/914678356 learned_addr learned my addr 172.21.15.26:0/914678356 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:11.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.333+0000 7f68837fe700 1 --2- 172.21.15.26:0/914678356 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f68840a0a30 0x7f688411f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:11.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.333+0000 7f6888883700 1 --2- 172.21.15.26:0/914678356 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6884133930 0x7f68841c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:11.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.333+0000 7f6883fff700 1 -- 172.21.15.26:0/914678356 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f68840a0a30 msgr2=0x7f688411f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:11.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.333+0000 7f6883fff700 1 --2- 172.21.15.26:0/914678356 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f68840a0a30 0x7f688411f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:11.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.333+0000 7f6883fff700 1 -- 172.21.15.26:0/914678356 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6884133930 msgr2=0x7f68841c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:11.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.333+0000 7f6883fff700 1 --2- 172.21.15.26:0/914678356 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6884133930 0x7f68841c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:11.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.333+0000 7f6883fff700 1 -- 172.21.15.26:0/914678356 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6874009550 con 0x7f688409d630 2023-10-01T07:57:11.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.333+0000 7f6883fff700 1 --2- 172.21.15.26:0/914678356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f688409d630 0x7f688411f2c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f6874000c00 tx=0x7f6874004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:11.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.333+0000 7f6880ff9700 1 -- 172.21.15.26:0/914678356 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6874004450 con 0x7f688409d630 2023-10-01T07:57:11.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.333+0000 7f6880ff9700 1 -- 172.21.15.26:0/914678356 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68740045b0 con 0x7f688409d630 2023-10-01T07:57:11.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.333+0000 7f688a2e6700 1 -- 172.21.15.26:0/914678356 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6884122480 con 0x7f688409d630 2023-10-01T07:57:11.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.334+0000 7f6880ff9700 1 -- 172.21.15.26:0/914678356 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68740038e0 con 0x7f688409d630 2023-10-01T07:57:11.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.334+0000 7f688a2e6700 1 -- 172.21.15.26:0/914678356 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68840a42b0 con 0x7f688409d630 2023-10-01T07:57:11.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.334+0000 7f6880ff9700 1 -- 172.21.15.26:0/914678356 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6874021070 con 0x7f688409d630 2023-10-01T07:57:11.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.334+0000 7f6880ff9700 1 -- 172.21.15.26:0/914678356 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6874040a20 con 0x7f688409d630 2023-10-01T07:57:11.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.335+0000 7f688a2e6700 1 -- 172.21.15.26:0/914678356 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68841222c0 con 0x7f688409d630 2023-10-01T07:57:11.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.340+0000 7f6880ff9700 1 -- 172.21.15.26:0/914678356 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f68841222c0 con 0x7f688409d630 2023-10-01T07:57:11.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.475+0000 7f316dec0700 1 -- 172.21.15.26:0/1875692351 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3168074ea0 con 0x7f316809e1d0 2023-10-01T07:57:11.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.476+0000 7f314ffff700 1 -- 172.21.15.26:0/1875692351 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f315c015020 con 0x7f316809e1d0 2023-10-01T07:57:11.476 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:11.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.478+0000 7f316dec0700 1 -- 172.21.15.26:0/1875692351 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f316809e1d0 msgr2=0x7f316811b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:11.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.478+0000 7f316dec0700 1 --2- 172.21.15.26:0/1875692351 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f316809e1d0 0x7f316811b9c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f316809f6f0 tx=0x7f315c004750 comp rx=0 tx=0).stop 2023-10-01T07:57:11.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.478+0000 7f316dec0700 1 -- 172.21.15.26:0/1875692351 shutdown_connections 2023-10-01T07:57:11.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.478+0000 7f316dec0700 1 --2- 172.21.15.26:0/1875692351 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3168135e50 0x7f316811bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:11.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.478+0000 7f316dec0700 1 --2- 172.21.15.26:0/1875692351 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f316809d6f0 0x7f316811b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:11.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.478+0000 7f316dec0700 1 --2- 172.21.15.26:0/1875692351 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f316809e1d0 0x7f316811b9c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:11.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.478+0000 7f316dec0700 1 -- 172.21.15.26:0/1875692351 >> 172.21.15.26:0/1875692351 conn(0x7f3168066f50 msgr2=0x7f316806e840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:11.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.478+0000 7f316dec0700 1 -- 172.21.15.26:0/1875692351 shutdown_connections 2023-10-01T07:57:11.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.478+0000 7f316dec0700 1 -- 172.21.15.26:0/1875692351 wait complete. 2023-10-01T07:57:11.493 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:11.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.538+0000 7f89ba550700 1 -- 172.21.15.26:0/3178193466 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f89b411d790 con 0x7f89b409e930 2023-10-01T07:57:11.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.538+0000 7f89b0ff9700 1 -- 172.21.15.26:0/3178193466 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f89a401ab10 con 0x7f89b409e930 2023-10-01T07:57:11.539 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:11.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.541+0000 7f89ba550700 1 -- 172.21.15.26:0/3178193466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89b409e930 msgr2=0x7f89b411a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:11.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.541+0000 7f89ba550700 1 --2- 172.21.15.26:0/3178193466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89b409e930 0x7f89b411a680 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f89a400c460 tx=0x7f89a400c770 comp rx=0 tx=0).stop 2023-10-01T07:57:11.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.541+0000 7f89ba550700 1 -- 172.21.15.26:0/3178193466 shutdown_connections 2023-10-01T07:57:11.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.541+0000 7f89ba550700 1 --2- 172.21.15.26:0/3178193466 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89b4136fe0 0x7f89b411b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:11.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.541+0000 7f89ba550700 1 --2- 172.21.15.26:0/3178193466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89b409e930 0x7f89b411a680 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:11.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.541+0000 7f89ba550700 1 --2- 172.21.15.26:0/3178193466 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89b409f410 0x7f89b411abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:11.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.541+0000 7f89ba550700 1 -- 172.21.15.26:0/3178193466 >> 172.21.15.26:0/3178193466 conn(0x7f89b40a4210 msgr2=0x7f89b4132870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:11.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.541+0000 7f89ba550700 1 -- 172.21.15.26:0/3178193466 shutdown_connections 2023-10-01T07:57:11.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.541+0000 7f89ba550700 1 -- 172.21.15.26:0/3178193466 wait complete. 2023-10-01T07:57:11.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.548+0000 7f688a2e6700 1 -- 172.21.15.26:0/914678356 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f68841222c0 con 0x7f688409d630 2023-10-01T07:57:11.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.548+0000 7f6880ff9700 1 -- 172.21.15.26:0/914678356 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f68841222c0 con 0x7f688409d630 2023-10-01T07:57:11.549 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:11.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.552+0000 7f688a2e6700 1 -- 172.21.15.26:0/914678356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f688409d630 msgr2=0x7f688411f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:11.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.552+0000 7f688a2e6700 1 --2- 172.21.15.26:0/914678356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f688409d630 0x7f688411f2c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f6874000c00 tx=0x7f6874004750 comp rx=0 tx=0).stop 2023-10-01T07:57:11.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.552+0000 7f688a2e6700 1 -- 172.21.15.26:0/914678356 shutdown_connections 2023-10-01T07:57:11.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.552+0000 7f688a2e6700 1 --2- 172.21.15.26:0/914678356 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6884133930 0x7f68841c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:11.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.552+0000 7f688a2e6700 1 --2- 172.21.15.26:0/914678356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f688409d630 0x7f688411f2c0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:11.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.552+0000 7f688a2e6700 1 --2- 172.21.15.26:0/914678356 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f68840a0a30 0x7f688411f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:11.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.552+0000 7f688a2e6700 1 -- 172.21.15.26:0/914678356 >> 172.21.15.26:0/914678356 conn(0x7f68840a3050 msgr2=0x7f68841bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:11.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.552+0000 7f688a2e6700 1 -- 172.21.15.26:0/914678356 shutdown_connections 2023-10-01T07:57:11.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:11.552+0000 7f688a2e6700 1 -- 172.21.15.26:0/914678356 wait complete. 2023-10-01T07:57:11.560 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:11.569 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:11.924 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:12.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.069+0000 7fce277f7700 1 Processor -- start 2023-10-01T07:57:12.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.069+0000 7fce277f7700 1 -- start start 2023-10-01T07:57:12.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.070+0000 7fce277f7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fce20133420 0x7fce201337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:12.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.070+0000 7fce277f7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fce20133e30 0x7fce2012ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:12.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.070+0000 7fce277f7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fce20134260 0x7fce201304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:12.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.070+0000 7fce277f7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce2006b990 con 0x7fce20133420 2023-10-01T07:57:12.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.070+0000 7fce277f7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce200a0590 con 0x7fce20134260 2023-10-01T07:57:12.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.070+0000 7fce277f7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce2009fb80 con 0x7fce20133e30 2023-10-01T07:57:12.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.070+0000 7fce25593700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fce20133420 0x7fce201337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:12.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.070+0000 7fce25d94700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fce20134260 0x7fce201304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:12.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.070+0000 7fce24d92700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fce20133e30 0x7fce2012ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:12.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.070+0000 7fce25593700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fce20133420 0x7fce201337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57308/0 (socket says 172.21.15.26:57308) 2023-10-01T07:57:12.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.070+0000 7fce25d94700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fce20134260 0x7fce201304d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:39446/0 (socket says 172.21.15.26:39446) 2023-10-01T07:57:12.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.070+0000 7fce24d92700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fce20133e30 0x7fce2012ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44128/0 (socket says 172.21.15.26:44128) 2023-10-01T07:57:12.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.070+0000 7fce25593700 1 -- 172.21.15.26:0/3154028012 learned_addr learned my addr 172.21.15.26:0/3154028012 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:12.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.070+0000 7fce25d94700 1 -- 172.21.15.26:0/3154028012 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fce20133e30 msgr2=0x7fce2012ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:12.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.070+0000 7fce25d94700 1 --2- 172.21.15.26:0/3154028012 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fce20133e30 0x7fce2012ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.070+0000 7fce25d94700 1 -- 172.21.15.26:0/3154028012 >> v2:172.21.15.26:3300/0 conn(0x7fce20133420 msgr2=0x7fce201337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:12.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.070+0000 7fce25d94700 1 --2- 172.21.15.26:0/3154028012 >> v2:172.21.15.26:3300/0 conn(0x7fce20133420 0x7fce201337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.070+0000 7fce25d94700 1 -- 172.21.15.26:0/3154028012 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce200a0030 con 0x7fce20134260 2023-10-01T07:57:12.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.070+0000 7fce25593700 1 --2- 172.21.15.26:0/3154028012 >> v2:172.21.15.26:3300/0 conn(0x7fce20133420 0x7fce201337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:12.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.070+0000 7fce24d92700 1 --2- 172.21.15.26:0/3154028012 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fce20133e30 0x7fce2012ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:12.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.071+0000 7fce25d94700 1 --2- 172.21.15.26:0/3154028012 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fce20134260 0x7fce201304d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fce18009d90 tx=0x7fce1800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=723ec84da6a74c55 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:12.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.071+0000 7fce17fff700 1 -- 172.21.15.26:0/3154028012 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1800e070 con 0x7fce20134260 2023-10-01T07:57:12.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.071+0000 7fce17fff700 1 -- 172.21.15.26:0/3154028012 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce1800bb20 con 0x7fce20134260 2023-10-01T07:57:12.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.071+0000 7fce17fff700 1 -- 172.21.15.26:0/3154028012 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce18012430 con 0x7fce20134260 2023-10-01T07:57:12.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.071+0000 7fce277f7700 1 -- 172.21.15.26:0/3154028012 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fce20134260 msgr2=0x7fce201304d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:12.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.071+0000 7fce277f7700 1 --2- 172.21.15.26:0/3154028012 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fce20134260 0x7fce201304d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fce18009d90 tx=0x7fce1800b330 comp rx=0 tx=0).stop 2023-10-01T07:57:12.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.071+0000 7fce277f7700 1 -- 172.21.15.26:0/3154028012 shutdown_connections 2023-10-01T07:57:12.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.071+0000 7fce277f7700 1 --2- 172.21.15.26:0/3154028012 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fce20134260 0x7fce201304d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.071+0000 7fce277f7700 1 --2- 172.21.15.26:0/3154028012 >> v2:172.21.15.26:3300/0 conn(0x7fce20133420 0x7fce201337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.071+0000 7fce277f7700 1 --2- 172.21.15.26:0/3154028012 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fce20133e30 0x7fce2012ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.071+0000 7fce277f7700 1 -- 172.21.15.26:0/3154028012 >> 172.21.15.26:0/3154028012 conn(0x7fce200a4210 msgr2=0x7fce200a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:12.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.072+0000 7fce277f7700 1 -- 172.21.15.26:0/3154028012 shutdown_connections 2023-10-01T07:57:12.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.072+0000 7fce277f7700 1 -- 172.21.15.26:0/3154028012 wait complete. 2023-10-01T07:57:12.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.072+0000 7fce277f7700 1 Processor -- start 2023-10-01T07:57:12.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.073+0000 7fce277f7700 1 -- start start 2023-10-01T07:57:12.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.073+0000 7fce277f7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce20133420 0x7fce2009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:12.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.073+0000 7fce277f7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fce20133e30 0x7fce2009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:12.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.073+0000 7fce277f7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fce20134260 0x7fce2009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:12.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.073+0000 7fce277f7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2009de50 con 0x7fce20133420 2023-10-01T07:57:12.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.073+0000 7fce277f7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce2009dc60 con 0x7fce20134260 2023-10-01T07:57:12.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.073+0000 7fce277f7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce2011f0a0 con 0x7fce20133e30 2023-10-01T07:57:12.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.073+0000 7fce25593700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce20133420 0x7fce2009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:12.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.073+0000 7fce24d92700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fce20133e30 0x7fce2009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:12.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.073+0000 7fce25593700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce20133420 0x7fce2009c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57310/0 (socket says 172.21.15.26:57310) 2023-10-01T07:57:12.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.073+0000 7fce25593700 1 -- 172.21.15.26:0/278603737 learned_addr learned my addr 172.21.15.26:0/278603737 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:12.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.073+0000 7fce25d94700 1 --2- 172.21.15.26:0/278603737 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fce20134260 0x7fce2009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:12.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.073+0000 7fce24d92700 1 -- 172.21.15.26:0/278603737 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fce20134260 msgr2=0x7fce2009cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:12.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.073+0000 7fce24d92700 1 --2- 172.21.15.26:0/278603737 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fce20134260 0x7fce2009cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.073+0000 7fce24d92700 1 -- 172.21.15.26:0/278603737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce20133420 msgr2=0x7fce2009c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:12.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.073+0000 7fce24d92700 1 --2- 172.21.15.26:0/278603737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce20133420 0x7fce2009c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.074+0000 7fce24d92700 1 -- 172.21.15.26:0/278603737 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce1c009550 con 0x7fce20133e30 2023-10-01T07:57:12.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.074+0000 7fce25593700 1 --2- 172.21.15.26:0/278603737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce20133420 0x7fce2009c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:12.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.074+0000 7fce24d92700 1 --2- 172.21.15.26:0/278603737 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fce20133e30 0x7fce2009c9c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fce1000e9b0 tx=0x7fce1000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:12.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.074+0000 7fce15ffb700 1 -- 172.21.15.26:0/278603737 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1000ee50 con 0x7fce20133e30 2023-10-01T07:57:12.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.074+0000 7fce15ffb700 1 -- 172.21.15.26:0/278603737 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce1000c7f0 con 0x7fce20133e30 2023-10-01T07:57:12.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.074+0000 7fce277f7700 1 -- 172.21.15.26:0/278603737 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce100094a0 con 0x7fce20133e30 2023-10-01T07:57:12.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.074+0000 7fce15ffb700 1 -- 172.21.15.26:0/278603737 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1000cba0 con 0x7fce20133e30 2023-10-01T07:57:12.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.074+0000 7fce277f7700 1 -- 172.21.15.26:0/278603737 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce18009a70 con 0x7fce20133e30 2023-10-01T07:57:12.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.075+0000 7fce277f7700 1 -- 172.21.15.26:0/278603737 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce20074ea0 con 0x7fce20133e30 2023-10-01T07:57:12.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.076+0000 7fce15ffb700 1 -- 172.21.15.26:0/278603737 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fce1000cd00 con 0x7fce20133e30 2023-10-01T07:57:12.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.076+0000 7fce15ffb700 1 -- 172.21.15.26:0/278603737 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fce1003ff60 con 0x7fce20133e30 2023-10-01T07:57:12.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.080+0000 7fce15ffb700 1 -- 172.21.15.26:0/278603737 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fce10024350 con 0x7fce20133e30 2023-10-01T07:57:12.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.286+0000 7fce277f7700 1 -- 172.21.15.26:0/278603737 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fce2006b250 con 0x7fce20133e30 2023-10-01T07:57:12.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.286+0000 7fce15ffb700 1 -- 172.21.15.26:0/278603737 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fce1001ab10 con 0x7fce20133e30 2023-10-01T07:57:12.287 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:12.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.288+0000 7fce277f7700 1 -- 172.21.15.26:0/278603737 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fce20133e30 msgr2=0x7fce2009c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:12.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.288+0000 7fce277f7700 1 --2- 172.21.15.26:0/278603737 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fce20133e30 0x7fce2009c9c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fce1000e9b0 tx=0x7fce1000ecc0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.289+0000 7fce277f7700 1 -- 172.21.15.26:0/278603737 shutdown_connections 2023-10-01T07:57:12.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.289+0000 7fce277f7700 1 --2- 172.21.15.26:0/278603737 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fce20134260 0x7fce2009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.289+0000 7fce277f7700 1 --2- 172.21.15.26:0/278603737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce20133420 0x7fce2009c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.289+0000 7fce277f7700 1 --2- 172.21.15.26:0/278603737 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fce20133e30 0x7fce2009c9c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.289+0000 7fce277f7700 1 -- 172.21.15.26:0/278603737 >> 172.21.15.26:0/278603737 conn(0x7fce200a4210 msgr2=0x7fce20130230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:12.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.289+0000 7fce277f7700 1 -- 172.21.15.26:0/278603737 shutdown_connections 2023-10-01T07:57:12.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.289+0000 7fce277f7700 1 -- 172.21.15.26:0/278603737 wait complete. 2023-10-01T07:57:12.303 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:12.494 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:12.561 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:12.570 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:12.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.643+0000 7f822c583700 1 Processor -- start 2023-10-01T07:57:12.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.643+0000 7f822c583700 1 -- start start 2023-10-01T07:57:12.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.643+0000 7f822c583700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8224133420 0x7f82241337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:12.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.643+0000 7f822c583700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8224133e30 0x7f822412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:12.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.643+0000 7f822c583700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f822406b990 con 0x7f8224134260 2023-10-01T07:57:12.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.643+0000 7f822c583700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82240a0590 con 0x7f8224133420 2023-10-01T07:57:12.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.643+0000 7f822c583700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f822409fb80 con 0x7f8224133e30 2023-10-01T07:57:12.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.644+0000 7f822a31f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8224133420 0x7f82241337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:12.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.644+0000 7f8229b1e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8224133e30 0x7f822412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:12.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.644+0000 7f822ab20700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8224134260 0x7f82241304d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43956/0 (socket says 172.21.15.26:43956) 2023-10-01T07:57:12.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.644+0000 7f822ab20700 1 -- 172.21.15.26:0/2706894398 learned_addr learned my addr 172.21.15.26:0/2706894398 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:12.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.644+0000 7f822931d700 1 -- 172.21.15.26:0/2706894398 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3749652730 0 0) 0x7f822406b990 con 0x7f8224134260 2023-10-01T07:57:12.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.644+0000 7f822931d700 1 -- 172.21.15.26:0/2706894398 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82100035b0 con 0x7f8224134260 2023-10-01T07:57:12.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.644+0000 7f822a31f700 1 -- 172.21.15.26:0/2706894398 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8224133e30 msgr2=0x7f822412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:12.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.644+0000 7f822a31f700 1 --2- 172.21.15.26:0/2706894398 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8224133e30 0x7f822412ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.644+0000 7f822a31f700 1 -- 172.21.15.26:0/2706894398 >> v1:172.21.15.26:6789/0 conn(0x7f8224134260 legacy=0x7f82241304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:12.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.644+0000 7f822a31f700 1 -- 172.21.15.26:0/2706894398 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82240a0030 con 0x7f8224133420 2023-10-01T07:57:12.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.645+0000 7f822a31f700 1 --2- 172.21.15.26:0/2706894398 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8224133420 0x7f82241337f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8220009870 tx=0x7f8220009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99752a1c506d2ab1 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:12.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.645+0000 7f822931d700 1 -- 172.21.15.26:0/2706894398 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8220011830 con 0x7f8224133420 2023-10-01T07:57:12.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.645+0000 7f822931d700 1 -- 172.21.15.26:0/2706894398 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8220011990 con 0x7f8224133420 2023-10-01T07:57:12.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.645+0000 7f822931d700 1 -- 172.21.15.26:0/2706894398 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8220011d20 con 0x7f8224133420 2023-10-01T07:57:12.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.645+0000 7f822c583700 1 -- 172.21.15.26:0/2706894398 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8224133420 msgr2=0x7f82241337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:12.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.645+0000 7f822c583700 1 --2- 172.21.15.26:0/2706894398 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8224133420 0x7f82241337f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8220009870 tx=0x7f8220009b80 comp rx=0 tx=0).stop 2023-10-01T07:57:12.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.646+0000 7f822c583700 1 -- 172.21.15.26:0/2706894398 shutdown_connections 2023-10-01T07:57:12.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.646+0000 7f822c583700 1 --2- 172.21.15.26:0/2706894398 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8224133420 0x7f82241337f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.646+0000 7f822c583700 1 --2- 172.21.15.26:0/2706894398 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8224133e30 0x7f822412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.646+0000 7f822c583700 1 -- 172.21.15.26:0/2706894398 >> 172.21.15.26:0/2706894398 conn(0x7f82240a4210 msgr2=0x7f82240a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:12.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.646+0000 7f822c583700 1 -- 172.21.15.26:0/2706894398 shutdown_connections 2023-10-01T07:57:12.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.646+0000 7f822c583700 1 -- 172.21.15.26:0/2706894398 wait complete. 2023-10-01T07:57:12.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.647+0000 7f822c583700 1 Processor -- start 2023-10-01T07:57:12.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.647+0000 7f822c583700 1 -- start start 2023-10-01T07:57:12.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.647+0000 7f822c583700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8224133420 0x7f822409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:12.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.647+0000 7f822c583700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8224133e30 0x7f822409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:12.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.647+0000 7f822c583700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8224134260 0x7f822409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:12.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.647+0000 7f822c583700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822409e010 con 0x7f8224134260 2023-10-01T07:57:12.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.647+0000 7f822c583700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f822411ec20 con 0x7f8224133e30 2023-10-01T07:57:12.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.647+0000 7f822c583700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f822411fe10 con 0x7f8224133420 2023-10-01T07:57:12.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.647+0000 7f822a31f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8224133420 0x7f822409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:12.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.647+0000 7f822a31f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8224133420 0x7f822409c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44150/0 (socket says 172.21.15.26:44150) 2023-10-01T07:57:12.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.647+0000 7f822a31f700 1 -- 172.21.15.26:0/3037917723 learned_addr learned my addr 172.21.15.26:0/3037917723 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:12.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.647+0000 7f8229b1e700 1 --2- 172.21.15.26:0/3037917723 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8224133e30 0x7f822409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:12.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.648+0000 7f822ab20700 1 --2- 172.21.15.26:0/3037917723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8224134260 0x7f822409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:12.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.648+0000 7f822a31f700 1 -- 172.21.15.26:0/3037917723 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8224133e30 msgr2=0x7f822409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:12.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.648+0000 7f822a31f700 1 --2- 172.21.15.26:0/3037917723 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8224133e30 0x7f822409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.648+0000 7f822a31f700 1 -- 172.21.15.26:0/3037917723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8224134260 msgr2=0x7f822409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:12.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.648+0000 7f822a31f700 1 --2- 172.21.15.26:0/3037917723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8224134260 0x7f822409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.648+0000 7f822a31f700 1 -- 172.21.15.26:0/3037917723 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82200094a0 con 0x7f8224133420 2023-10-01T07:57:12.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.648+0000 7f8229b1e700 1 --2- 172.21.15.26:0/3037917723 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8224133e30 0x7f822409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:12.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.648+0000 7f822a31f700 1 --2- 172.21.15.26:0/3037917723 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8224133420 0x7f822409c480 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8220009bc0 tx=0x7f8220004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:12.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.648+0000 7f821affd700 1 -- 172.21.15.26:0/3037917723 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8220004300 con 0x7f8224133420 2023-10-01T07:57:12.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.648+0000 7f821affd700 1 -- 172.21.15.26:0/3037917723 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822001f070 con 0x7f8224133420 2023-10-01T07:57:12.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.648+0000 7f822c583700 1 -- 172.21.15.26:0/3037917723 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f822412db30 con 0x7f8224133420 2023-10-01T07:57:12.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.648+0000 7f821affd700 1 -- 172.21.15.26:0/3037917723 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82200036a0 con 0x7f8224133420 2023-10-01T07:57:12.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.648+0000 7f822c583700 1 -- 172.21.15.26:0/3037917723 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8224120710 con 0x7f8224133420 2023-10-01T07:57:12.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.649+0000 7f821affd700 1 -- 172.21.15.26:0/3037917723 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8220021030 con 0x7f8224133420 2023-10-01T07:57:12.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.649+0000 7f821affd700 1 -- 172.21.15.26:0/3037917723 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8220040760 con 0x7f8224133420 2023-10-01T07:57:12.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.650+0000 7f822c583700 1 -- 172.21.15.26:0/3037917723 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f822411ed60 con 0x7f8224133420 2023-10-01T07:57:12.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.655+0000 7f821affd700 1 -- 172.21.15.26:0/3037917723 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f82200199a0 con 0x7f8224133420 2023-10-01T07:57:12.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.705+0000 7f6b5b448700 1 Processor -- start 2023-10-01T07:57:12.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.706+0000 7f6b5b448700 1 -- start start 2023-10-01T07:57:12.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.706+0000 7f6b5b448700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6b5409e1d0 0x7f6b54138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:12.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.706+0000 7f6b5b448700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b54139170 0x7f6b5413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:12.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.706+0000 7f6b5b448700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b5409b120 con 0x7f6b5409d6f0 2023-10-01T07:57:12.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.706+0000 7f6b5b448700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b5406b460 con 0x7f6b5409e1d0 2023-10-01T07:57:12.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.706+0000 7f6b5b448700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5409a7e0 con 0x7f6b54139170 2023-10-01T07:57:12.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.706+0000 7f6b599e5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b54139170 0x7f6b5413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:12.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.706+0000 7f6b589e3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6b5409e1d0 0x7f6b54138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:12.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.707+0000 7f6b599e5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b54139170 0x7f6b5413b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44152/0 (socket says 172.21.15.26:44152) 2023-10-01T07:57:12.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.707+0000 7f6b589e3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6b5409e1d0 0x7f6b54138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57314/0 (socket says 172.21.15.26:57314) 2023-10-01T07:57:12.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.707+0000 7f6b599e5700 1 -- 172.21.15.26:0/1359415993 learned_addr learned my addr 172.21.15.26:0/1359415993 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:12.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.707+0000 7f6b591e4700 1 --1- 172.21.15.26:0/1359415993 >> v1:172.21.15.26:6789/0 conn(0x7f6b5409d6f0 0x7f6b5409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43972/0 (socket says 172.21.15.26:43972) 2023-10-01T07:57:12.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.707+0000 7f6b599e5700 1 -- 172.21.15.26:0/1359415993 >> v2:172.21.15.26:3300/0 conn(0x7f6b5409e1d0 msgr2=0x7f6b54138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:12.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.707+0000 7f6b599e5700 1 --2- 172.21.15.26:0/1359415993 >> v2:172.21.15.26:3300/0 conn(0x7f6b5409e1d0 0x7f6b54138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.707+0000 7f6b599e5700 1 -- 172.21.15.26:0/1359415993 >> v1:172.21.15.26:6789/0 conn(0x7f6b5409d6f0 legacy=0x7f6b5409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:12.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.707+0000 7f6b599e5700 1 -- 172.21.15.26:0/1359415993 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b5409a500 con 0x7f6b54139170 2023-10-01T07:57:12.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.707+0000 7f6b599e5700 1 --2- 172.21.15.26:0/1359415993 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b54139170 0x7f6b5413b550 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c009e80 tx=0x7f6b4c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4e0ce9ff2baf4b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:12.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.707+0000 7f6b4bfff700 1 -- 172.21.15.26:0/1359415993 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c00e070 con 0x7f6b54139170 2023-10-01T07:57:12.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.707+0000 7f6b4bfff700 1 -- 172.21.15.26:0/1359415993 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b4c00b8d0 con 0x7f6b54139170 2023-10-01T07:57:12.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.707+0000 7f6b4bfff700 1 -- 172.21.15.26:0/1359415993 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c00bc80 con 0x7f6b54139170 2023-10-01T07:57:12.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.708+0000 7f6b5b448700 1 -- 172.21.15.26:0/1359415993 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b54139170 msgr2=0x7f6b5413b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:12.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.708+0000 7f6b5b448700 1 --2- 172.21.15.26:0/1359415993 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b54139170 0x7f6b5413b550 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c009e80 tx=0x7f6b4c00b330 comp rx=0 tx=0).stop 2023-10-01T07:57:12.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.708+0000 7f6b5b448700 1 -- 172.21.15.26:0/1359415993 shutdown_connections 2023-10-01T07:57:12.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.708+0000 7f6b5b448700 1 --2- 172.21.15.26:0/1359415993 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b54139170 0x7f6b5413b550 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.708+0000 7f6b5b448700 1 --2- 172.21.15.26:0/1359415993 >> v2:172.21.15.26:3300/0 conn(0x7f6b5409e1d0 0x7f6b54138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.708+0000 7f6b5b448700 1 -- 172.21.15.26:0/1359415993 >> 172.21.15.26:0/1359415993 conn(0x7f6b54066f50 msgr2=0x7f6b5409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:12.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.708+0000 7f6b5b448700 1 -- 172.21.15.26:0/1359415993 shutdown_connections 2023-10-01T07:57:12.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.708+0000 7f6b5b448700 1 -- 172.21.15.26:0/1359415993 wait complete. 2023-10-01T07:57:12.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.709+0000 7f6b5b448700 1 Processor -- start 2023-10-01T07:57:12.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.709+0000 7f6b5b448700 1 -- start start 2023-10-01T07:57:12.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.710+0000 7f6b5b448700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b5409d6f0 0x7f6b5411e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:12.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.710+0000 7f6b5b448700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b5409e1d0 0x7f6b5411ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:12.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.710+0000 7f6b5b448700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b54139170 0x7f6b5411f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:12.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.710+0000 7f6b5b448700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b54134370 con 0x7f6b5409d6f0 2023-10-01T07:57:12.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.710+0000 7f6b5b448700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b54121dc0 con 0x7f6b54139170 2023-10-01T07:57:12.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.710+0000 7f6b5b448700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b54072070 con 0x7f6b5409e1d0 2023-10-01T07:57:12.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.710+0000 7f6b591e4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b5409d6f0 0x7f6b5411e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:12.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.710+0000 7f6b591e4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b5409d6f0 0x7f6b5411e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57320/0 (socket says 172.21.15.26:57320) 2023-10-01T07:57:12.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.710+0000 7f6b591e4700 1 -- 172.21.15.26:0/2188277886 learned_addr learned my addr 172.21.15.26:0/2188277886 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:12.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.710+0000 7f6b589e3700 1 --2- 172.21.15.26:0/2188277886 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b5409e1d0 0x7f6b5411ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:12.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.710+0000 7f6b599e5700 1 --2- 172.21.15.26:0/2188277886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b54139170 0x7f6b5411f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:12.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.710+0000 7f6b591e4700 1 -- 172.21.15.26:0/2188277886 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b5409e1d0 msgr2=0x7f6b5411ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:12.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.710+0000 7f6b591e4700 1 --2- 172.21.15.26:0/2188277886 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b5409e1d0 0x7f6b5411ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.710+0000 7f6b591e4700 1 -- 172.21.15.26:0/2188277886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b54139170 msgr2=0x7f6b5411f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:12.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.710+0000 7f6b591e4700 1 --2- 172.21.15.26:0/2188277886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b54139170 0x7f6b5411f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.710+0000 7f6b591e4700 1 -- 172.21.15.26:0/2188277886 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4c009b30 con 0x7f6b5409d6f0 2023-10-01T07:57:12.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.710+0000 7f6b589e3700 1 --2- 172.21.15.26:0/2188277886 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b5409e1d0 0x7f6b5411ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:12.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.711+0000 7f6b591e4700 1 --2- 172.21.15.26:0/2188277886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b5409d6f0 0x7f6b5411e8e0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f6b5000c520 tx=0x7f6b5000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:12.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.711+0000 7f6b49ffb700 1 -- 172.21.15.26:0/2188277886 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b50005cb0 con 0x7f6b5409d6f0 2023-10-01T07:57:12.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.711+0000 7f6b49ffb700 1 -- 172.21.15.26:0/2188277886 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b50005e10 con 0x7f6b5409d6f0 2023-10-01T07:57:12.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.711+0000 7f6b49ffb700 1 -- 172.21.15.26:0/2188277886 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b500072d0 con 0x7f6b5409d6f0 2023-10-01T07:57:12.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.711+0000 7f6b5b448700 1 -- 172.21.15.26:0/2188277886 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b5409c710 con 0x7f6b5409d6f0 2023-10-01T07:57:12.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.711+0000 7f6b5b448700 1 -- 172.21.15.26:0/2188277886 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b54120550 con 0x7f6b5409d6f0 2023-10-01T07:57:12.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.712+0000 7f6b49ffb700 1 -- 172.21.15.26:0/2188277886 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6b50007430 con 0x7f6b5409d6f0 2023-10-01T07:57:12.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.712+0000 7f6b49ffb700 1 -- 172.21.15.26:0/2188277886 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6b5003e8e0 con 0x7f6b5409d6f0 2023-10-01T07:57:12.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.712+0000 7f6b5b448700 1 -- 172.21.15.26:0/2188277886 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b541204f0 con 0x7f6b5409d6f0 2023-10-01T07:57:12.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.722+0000 7f6b49ffb700 1 -- 172.21.15.26:0/2188277886 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6b50017020 con 0x7f6b5409d6f0 2023-10-01T07:57:12.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.748+0000 7fa7a89fe700 1 Processor -- start 2023-10-01T07:57:12.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.748+0000 7fa7a89fe700 1 -- start start 2023-10-01T07:57:12.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.749+0000 7fa7a89fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa7a409d8d0 0x7fa7a409dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:12.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.749+0000 7fa7a89fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7a409e1e0 0x7fa7a4130460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:12.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.749+0000 7fa7a89fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7a409e610 0x7fa7a41309a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:12.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.749+0000 7fa7a89fe700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7a409b6e0 con 0x7fa7a409d8d0 2023-10-01T07:57:12.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.749+0000 7fa7a89fe700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a409b470 con 0x7fa7a409e1e0 2023-10-01T07:57:12.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.749+0000 7fa7a89fe700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a409eb80 con 0x7fa7a409e610 2023-10-01T07:57:12.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.749+0000 7fa7a359e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7a409e610 0x7fa7a41309a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:12.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.749+0000 7fa7a259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7a409e1e0 0x7fa7a4130460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:12.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.749+0000 7fa7a259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7a409e1e0 0x7fa7a4130460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:39476/0 (socket says 172.21.15.26:39476) 2023-10-01T07:57:12.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.749+0000 7fa7a359e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7a409e610 0x7fa7a41309a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44184/0 (socket says 172.21.15.26:44184) 2023-10-01T07:57:12.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.749+0000 7fa7a259c700 1 -- 172.21.15.26:0/3276565968 learned_addr learned my addr 172.21.15.26:0/3276565968 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:12.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.749+0000 7fa7a2d9d700 1 --2- 172.21.15.26:0/3276565968 >> v2:172.21.15.26:3300/0 conn(0x7fa7a409d8d0 0x7fa7a409dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:12.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.750+0000 7fa7a259c700 1 -- 172.21.15.26:0/3276565968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7a409e610 msgr2=0x7fa7a41309a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:12.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.750+0000 7fa7a259c700 1 --2- 172.21.15.26:0/3276565968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7a409e610 0x7fa7a41309a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.750+0000 7fa7a259c700 1 -- 172.21.15.26:0/3276565968 >> v2:172.21.15.26:3300/0 conn(0x7fa7a409d8d0 msgr2=0x7fa7a409dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:12.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.750+0000 7fa7a259c700 1 --2- 172.21.15.26:0/3276565968 >> v2:172.21.15.26:3300/0 conn(0x7fa7a409d8d0 0x7fa7a409dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.750+0000 7fa7a259c700 1 -- 172.21.15.26:0/3276565968 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a409ae00 con 0x7fa7a409e1e0 2023-10-01T07:57:12.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.750+0000 7fa7a359e700 1 --2- 172.21.15.26:0/3276565968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7a409e610 0x7fa7a41309a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:12.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.750+0000 7fa7a259c700 1 --2- 172.21.15.26:0/3276565968 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7a409e1e0 0x7fa7a4130460 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa798006fd0 tx=0x7fa798009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=670c588d9ae3b359 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:12.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.750+0000 7fa7a1d9b700 1 -- 172.21.15.26:0/3276565968 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa798005e30 con 0x7fa7a409e1e0 2023-10-01T07:57:12.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.750+0000 7fa7a1d9b700 1 -- 172.21.15.26:0/3276565968 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa798004030 con 0x7fa7a409e1e0 2023-10-01T07:57:12.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.750+0000 7fa7a1d9b700 1 -- 172.21.15.26:0/3276565968 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7980043e0 con 0x7fa7a409e1e0 2023-10-01T07:57:12.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.751+0000 7fa7a89fe700 1 -- 172.21.15.26:0/3276565968 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7a409e1e0 msgr2=0x7fa7a4130460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:12.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.751+0000 7fa7a89fe700 1 --2- 172.21.15.26:0/3276565968 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7a409e1e0 0x7fa7a4130460 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa798006fd0 tx=0x7fa798009bd0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.751+0000 7fa7a89fe700 1 -- 172.21.15.26:0/3276565968 shutdown_connections 2023-10-01T07:57:12.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.751+0000 7fa7a89fe700 1 --2- 172.21.15.26:0/3276565968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7a409e610 0x7fa7a41309a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.751+0000 7fa7a89fe700 1 --2- 172.21.15.26:0/3276565968 >> v2:172.21.15.26:3300/0 conn(0x7fa7a409d8d0 0x7fa7a409dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.751+0000 7fa7a89fe700 1 --2- 172.21.15.26:0/3276565968 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7a409e1e0 0x7fa7a4130460 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.751+0000 7fa7a89fe700 1 -- 172.21.15.26:0/3276565968 >> 172.21.15.26:0/3276565968 conn(0x7fa7a40a2e20 msgr2=0x7fa7a40a3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:12.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.751+0000 7fa7a89fe700 1 -- 172.21.15.26:0/3276565968 shutdown_connections 2023-10-01T07:57:12.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.751+0000 7fa7a89fe700 1 -- 172.21.15.26:0/3276565968 wait complete. 2023-10-01T07:57:12.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.752+0000 7fa7a89fe700 1 Processor -- start 2023-10-01T07:57:12.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.752+0000 7fa7a89fe700 1 -- start start 2023-10-01T07:57:12.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.753+0000 7fa7a89fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7a409d8d0 0x7fa7a406e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:12.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.753+0000 7fa7a89fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7a409e1e0 0x7fa7a406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:12.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.753+0000 7fa7a89fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7a409e610 0x7fa7a406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:12.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.753+0000 7fa7a89fe700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a4070160 con 0x7fa7a409e610 2023-10-01T07:57:12.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.753+0000 7fa7a89fe700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a4125aa0 con 0x7fa7a409e1e0 2023-10-01T07:57:12.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.753+0000 7fa7a89fe700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a4130610 con 0x7fa7a409d8d0 2023-10-01T07:57:12.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.753+0000 7fa7a2d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7a409d8d0 0x7fa7a406e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:12.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.753+0000 7fa7a2d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7a409d8d0 0x7fa7a406e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44196/0 (socket says 172.21.15.26:44196) 2023-10-01T07:57:12.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.753+0000 7fa7a2d9d700 1 -- 172.21.15.26:0/3457107435 learned_addr learned my addr 172.21.15.26:0/3457107435 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:12.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.753+0000 7fa7a259c700 1 --2- 172.21.15.26:0/3457107435 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7a409e1e0 0x7fa7a406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:12.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.753+0000 7fa7a359e700 1 --2- 172.21.15.26:0/3457107435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7a409e610 0x7fa7a406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:12.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.753+0000 7fa7a2d9d700 1 -- 172.21.15.26:0/3457107435 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7a409e1e0 msgr2=0x7fa7a406ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:12.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.753+0000 7fa7a2d9d700 1 --2- 172.21.15.26:0/3457107435 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7a409e1e0 0x7fa7a406ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.753+0000 7fa7a2d9d700 1 -- 172.21.15.26:0/3457107435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7a409e610 msgr2=0x7fa7a406ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:12.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.753+0000 7fa7a2d9d700 1 --2- 172.21.15.26:0/3457107435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7a409e610 0x7fa7a406ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.753+0000 7fa7a2d9d700 1 -- 172.21.15.26:0/3457107435 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79c009a70 con 0x7fa7a409d8d0 2023-10-01T07:57:12.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.753+0000 7fa7a259c700 1 --2- 172.21.15.26:0/3457107435 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7a409e1e0 0x7fa7a406ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:12.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.754+0000 7fa7a2d9d700 1 --2- 172.21.15.26:0/3457107435 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7a409d8d0 0x7fa7a406e4e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa79400e9b0 tx=0x7fa79400ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:12.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.754+0000 7fa78b7fe700 1 -- 172.21.15.26:0/3457107435 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa794009710 con 0x7fa7a409d8d0 2023-10-01T07:57:12.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.754+0000 7fa78b7fe700 1 -- 172.21.15.26:0/3457107435 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79400c850 con 0x7fa7a409d8d0 2023-10-01T07:57:12.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.754+0000 7fa78b7fe700 1 -- 172.21.15.26:0/3457107435 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79400cbc0 con 0x7fa7a409d8d0 2023-10-01T07:57:12.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.754+0000 7fa7a89fe700 1 -- 172.21.15.26:0/3457107435 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa798009500 con 0x7fa7a409d8d0 2023-10-01T07:57:12.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.754+0000 7fa7a89fe700 1 -- 172.21.15.26:0/3457107435 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a4124820 con 0x7fa7a409d8d0 2023-10-01T07:57:12.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.755+0000 7fa78b7fe700 1 -- 172.21.15.26:0/3457107435 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa79400cd20 con 0x7fa7a409d8d0 2023-10-01T07:57:12.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.755+0000 7fa78b7fe700 1 -- 172.21.15.26:0/3457107435 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa79403fc70 con 0x7fa7a409d8d0 2023-10-01T07:57:12.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.755+0000 7fa7a89fe700 1 -- 172.21.15.26:0/3457107435 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a404f2a0 con 0x7fa7a409d8d0 2023-10-01T07:57:12.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.760+0000 7fa78b7fe700 1 -- 172.21.15.26:0/3457107435 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa794021080 con 0x7fa7a409d8d0 2023-10-01T07:57:12.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.869+0000 7f822c583700 1 -- 172.21.15.26:0/3037917723 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8224074ea0 con 0x7f8224133420 2023-10-01T07:57:12.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.869+0000 7f821affd700 1 -- 172.21.15.26:0/3037917723 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f82200193b0 con 0x7f8224133420 2023-10-01T07:57:12.870 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:12.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.871+0000 7f822c583700 1 -- 172.21.15.26:0/3037917723 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8224133420 msgr2=0x7f822409c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:12.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.871+0000 7f822c583700 1 --2- 172.21.15.26:0/3037917723 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8224133420 0x7f822409c480 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8220009bc0 tx=0x7f8220004750 comp rx=0 tx=0).stop 2023-10-01T07:57:12.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.871+0000 7f822c583700 1 -- 172.21.15.26:0/3037917723 shutdown_connections 2023-10-01T07:57:12.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.871+0000 7f822c583700 1 --2- 172.21.15.26:0/3037917723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8224134260 0x7f822409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.871+0000 7f822c583700 1 --2- 172.21.15.26:0/3037917723 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8224133420 0x7f822409c480 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.871+0000 7f822c583700 1 --2- 172.21.15.26:0/3037917723 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8224133e30 0x7f822409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.871+0000 7f822c583700 1 -- 172.21.15.26:0/3037917723 >> 172.21.15.26:0/3037917723 conn(0x7f82240a4210 msgr2=0x7f82240a2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:12.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.871+0000 7f822c583700 1 -- 172.21.15.26:0/3037917723 shutdown_connections 2023-10-01T07:57:12.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.871+0000 7f822c583700 1 -- 172.21.15.26:0/3037917723 wait complete. 2023-10-01T07:57:12.886 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:12.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.933+0000 7f6b5b448700 1 -- 172.21.15.26:0/2188277886 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6b5409f420 con 0x7f6b5409d6f0 2023-10-01T07:57:12.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.934+0000 7f6b49ffb700 1 -- 172.21.15.26:0/2188277886 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6b500076e0 con 0x7f6b5409d6f0 2023-10-01T07:57:12.935 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:12.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.936+0000 7f6b5b448700 1 -- 172.21.15.26:0/2188277886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b5409d6f0 msgr2=0x7f6b5411e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:12.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.936+0000 7f6b5b448700 1 --2- 172.21.15.26:0/2188277886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b5409d6f0 0x7f6b5411e8e0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f6b5000c520 tx=0x7f6b5000c830 comp rx=0 tx=0).stop 2023-10-01T07:57:12.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.936+0000 7f6b5b448700 1 -- 172.21.15.26:0/2188277886 shutdown_connections 2023-10-01T07:57:12.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.936+0000 7f6b5b448700 1 --2- 172.21.15.26:0/2188277886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b54139170 0x7f6b5411f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.936+0000 7f6b5b448700 1 --2- 172.21.15.26:0/2188277886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b5409d6f0 0x7f6b5411e8e0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.936+0000 7f6b5b448700 1 --2- 172.21.15.26:0/2188277886 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b5409e1d0 0x7f6b5411ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.936+0000 7f6b5b448700 1 -- 172.21.15.26:0/2188277886 >> 172.21.15.26:0/2188277886 conn(0x7f6b54066f50 msgr2=0x7f6b54136cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:12.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.936+0000 7f6b5b448700 1 -- 172.21.15.26:0/2188277886 shutdown_connections 2023-10-01T07:57:12.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.936+0000 7f6b5b448700 1 -- 172.21.15.26:0/2188277886 wait complete. 2023-10-01T07:57:12.950 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:12.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.968+0000 7fa7a89fe700 1 -- 172.21.15.26:0/3457107435 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa7a406c0a0 con 0x7fa7a409d8d0 2023-10-01T07:57:12.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.969+0000 7fa78b7fe700 1 -- 172.21.15.26:0/3457107435 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa794017020 con 0x7fa7a409d8d0 2023-10-01T07:57:12.970 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:12.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.971+0000 7fa7a89fe700 1 -- 172.21.15.26:0/3457107435 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7a409d8d0 msgr2=0x7fa7a406e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:12.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.971+0000 7fa7a89fe700 1 --2- 172.21.15.26:0/3457107435 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7a409d8d0 0x7fa7a406e4e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa79400e9b0 tx=0x7fa79400ecc0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.971+0000 7fa7a89fe700 1 -- 172.21.15.26:0/3457107435 shutdown_connections 2023-10-01T07:57:12.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.971+0000 7fa7a89fe700 1 --2- 172.21.15.26:0/3457107435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7a409e610 0x7fa7a406ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.971+0000 7fa7a89fe700 1 --2- 172.21.15.26:0/3457107435 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7a409d8d0 0x7fa7a406e4e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.971+0000 7fa7a89fe700 1 --2- 172.21.15.26:0/3457107435 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7a409e1e0 0x7fa7a406ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:12.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.971+0000 7fa7a89fe700 1 -- 172.21.15.26:0/3457107435 >> 172.21.15.26:0/3457107435 conn(0x7fa7a40a2e20 msgr2=0x7fa7a40a1340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:12.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.971+0000 7fa7a89fe700 1 -- 172.21.15.26:0/3457107435 shutdown_connections 2023-10-01T07:57:12.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:12.971+0000 7fa7a89fe700 1 -- 172.21.15.26:0/3457107435 wait complete. 2023-10-01T07:57:12.985 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:13.304 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:13.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.449+0000 7fa0ed785700 1 Processor -- start 2023-10-01T07:57:13.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.449+0000 7fa0ed785700 1 -- start start 2023-10-01T07:57:13.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.450+0000 7fa0ed785700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa0e80a0a30 0x7fa0e80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:13.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.450+0000 7fa0ed785700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa0e809d630 0x7fa0e80a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:13.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.450+0000 7fa0ed785700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0e80a2a70 con 0x7fa0e8133930 2023-10-01T07:57:13.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.450+0000 7fa0ed785700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0e80a01d0 con 0x7fa0e809d630 2023-10-01T07:57:13.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.450+0000 7fa0ed785700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e809e2b0 con 0x7fa0e80a0a30 2023-10-01T07:57:13.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.450+0000 7fa0e6ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa0e80a0a30 0x7fa0e80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:13.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.450+0000 7fa0e67fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa0e809d630 0x7fa0e80a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:13.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.450+0000 7fa0e67fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa0e809d630 0x7fa0e80a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55058/0 (socket says 172.21.15.26:55058) 2023-10-01T07:57:13.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.450+0000 7fa0e6ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa0e80a0a30 0x7fa0e80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49404/0 (socket says 172.21.15.26:49404) 2023-10-01T07:57:13.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.450+0000 7fa0e67fc700 1 -- 172.21.15.26:0/986586928 learned_addr learned my addr 172.21.15.26:0/986586928 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:13.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.450+0000 7fa0e67fc700 1 -- 172.21.15.26:0/986586928 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa0e80a0a30 msgr2=0x7fa0e80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:13.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.450+0000 7fa0e67fc700 1 --2- 172.21.15.26:0/986586928 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa0e80a0a30 0x7fa0e80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:13.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.450+0000 7fa0e67fc700 1 -- 172.21.15.26:0/986586928 >> v1:172.21.15.26:6789/0 conn(0x7fa0e8133930 legacy=0x7fa0e8133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:13.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.450+0000 7fa0e67fc700 1 -- 172.21.15.26:0/986586928 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e809dc50 con 0x7fa0e809d630 2023-10-01T07:57:13.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.450+0000 7fa0e6ffd700 1 --2- 172.21.15.26:0/986586928 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa0e80a0a30 0x7fa0e80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:13.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.450+0000 7fa0e5ffb700 1 -- 172.21.15.26:0/986586928 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2850029642 0 0) 0x7fa0e80a2a70 con 0x7fa0e8133930 2023-10-01T07:57:13.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.450+0000 7fa0e67fc700 1 --2- 172.21.15.26:0/986586928 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0e809d630 0x7fa0e80a1340 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc0098f0 tx=0x7fa0dc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af4c9279db198645 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:13.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.451+0000 7fa0e5ffb700 1 -- 172.21.15.26:0/986586928 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc011830 con 0x7fa0e809d630 2023-10-01T07:57:13.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.451+0000 7fa0e5ffb700 1 -- 172.21.15.26:0/986586928 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0dc011990 con 0x7fa0e809d630 2023-10-01T07:57:13.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.451+0000 7fa0e5ffb700 1 -- 172.21.15.26:0/986586928 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc011d20 con 0x7fa0e809d630 2023-10-01T07:57:13.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.451+0000 7fa0ed785700 1 -- 172.21.15.26:0/986586928 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0e809d630 msgr2=0x7fa0e80a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:13.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.451+0000 7fa0ed785700 1 --2- 172.21.15.26:0/986586928 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0e809d630 0x7fa0e80a1340 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc0098f0 tx=0x7fa0dc009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:13.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.451+0000 7fa0ed785700 1 -- 172.21.15.26:0/986586928 shutdown_connections 2023-10-01T07:57:13.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.451+0000 7fa0ed785700 1 --2- 172.21.15.26:0/986586928 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa0e80a0a30 0x7fa0e80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:13.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.451+0000 7fa0ed785700 1 --2- 172.21.15.26:0/986586928 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0e809d630 0x7fa0e80a1340 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:13.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.451+0000 7fa0ed785700 1 -- 172.21.15.26:0/986586928 >> 172.21.15.26:0/986586928 conn(0x7fa0e80a3050 msgr2=0x7fa0e80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:13.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.451+0000 7fa0ed785700 1 -- 172.21.15.26:0/986586928 shutdown_connections 2023-10-01T07:57:13.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.451+0000 7fa0ed785700 1 -- 172.21.15.26:0/986586928 wait complete. 2023-10-01T07:57:13.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.452+0000 7fa0ed785700 1 Processor -- start 2023-10-01T07:57:13.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.453+0000 7fa0ed785700 1 -- start start 2023-10-01T07:57:13.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.453+0000 7fa0ed785700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa0e809d630 0x7fa0e81c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:13.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.453+0000 7fa0ed785700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0e80a0a30 0x7fa0e81c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:13.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.453+0000 7fa0ed785700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa0e8133930 0x7fa0e81c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:13.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.453+0000 7fa0ed785700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e81210e0 con 0x7fa0e80a0a30 2023-10-01T07:57:13.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.453+0000 7fa0ed785700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e81207f0 con 0x7fa0e8133930 2023-10-01T07:57:13.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.453+0000 7fa0ed785700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e81209e0 con 0x7fa0e809d630 2023-10-01T07:57:13.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.453+0000 7fa0e67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0e80a0a30 0x7fa0e81c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:13.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.453+0000 7fa0e6ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa0e809d630 0x7fa0e81c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:13.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.453+0000 7fa0e77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa0e8133930 0x7fa0e81c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:13.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.453+0000 7fa0e67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0e80a0a30 0x7fa0e81c86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55062/0 (socket says 172.21.15.26:55062) 2023-10-01T07:57:13.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.453+0000 7fa0e67fc700 1 -- 172.21.15.26:0/56636743 learned_addr learned my addr 172.21.15.26:0/56636743 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:13.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.453+0000 7fa0e67fc700 1 -- 172.21.15.26:0/56636743 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa0e809d630 msgr2=0x7fa0e81c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:13.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.453+0000 7fa0e67fc700 1 --2- 172.21.15.26:0/56636743 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa0e809d630 0x7fa0e81c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:13.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.454+0000 7fa0e67fc700 1 -- 172.21.15.26:0/56636743 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa0e8133930 msgr2=0x7fa0e81c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:13.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.454+0000 7fa0e67fc700 1 --2- 172.21.15.26:0/56636743 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa0e8133930 0x7fa0e81c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:13.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.454+0000 7fa0e67fc700 1 -- 172.21.15.26:0/56636743 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d80094a0 con 0x7fa0e80a0a30 2023-10-01T07:57:13.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.454+0000 7fa0e6ffd700 1 --2- 172.21.15.26:0/56636743 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa0e809d630 0x7fa0e81c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:13.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.454+0000 7fa0e77fe700 1 --2- 172.21.15.26:0/56636743 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa0e8133930 0x7fa0e81c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:13.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.454+0000 7fa0e67fc700 1 --2- 172.21.15.26:0/56636743 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0e80a0a30 0x7fa0e81c86d0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc013000 tx=0x7fa0dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:13.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.454+0000 7fa0cf7fe700 1 -- 172.21.15.26:0/56636743 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc004300 con 0x7fa0e80a0a30 2023-10-01T07:57:13.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.454+0000 7fa0cf7fe700 1 -- 172.21.15.26:0/56636743 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0dc01f070 con 0x7fa0e80a0a30 2023-10-01T07:57:13.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.454+0000 7fa0cf7fe700 1 -- 172.21.15.26:0/56636743 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc0036a0 con 0x7fa0e80a0a30 2023-10-01T07:57:13.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.454+0000 7fa0ed785700 1 -- 172.21.15.26:0/56636743 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0dc009550 con 0x7fa0e80a0a30 2023-10-01T07:57:13.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.454+0000 7fa0ed785700 1 -- 172.21.15.26:0/56636743 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0e80a0410 con 0x7fa0e80a0a30 2023-10-01T07:57:13.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.455+0000 7fa0cf7fe700 1 -- 172.21.15.26:0/56636743 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa0dc021030 con 0x7fa0e80a0a30 2023-10-01T07:57:13.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.455+0000 7fa0cf7fe700 1 -- 172.21.15.26:0/56636743 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa0dc040920 con 0x7fa0e80a0a30 2023-10-01T07:57:13.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.455+0000 7fa0ed785700 1 -- 172.21.15.26:0/56636743 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0e8122380 con 0x7fa0e80a0a30 2023-10-01T07:57:13.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.460+0000 7fa0cf7fe700 1 -- 172.21.15.26:0/56636743 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa0dc015080 con 0x7fa0e80a0a30 2023-10-01T07:57:13.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.667+0000 7fa0ed785700 1 -- 172.21.15.26:0/56636743 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa0e80a5780 con 0x7fa0e80a0a30 2023-10-01T07:57:13.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.668+0000 7fa0cf7fe700 1 -- 172.21.15.26:0/56636743 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa0dc019770 con 0x7fa0e80a0a30 2023-10-01T07:57:13.668 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:13.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.670+0000 7fa0ed785700 1 -- 172.21.15.26:0/56636743 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0e80a0a30 msgr2=0x7fa0e81c86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:13.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.670+0000 7fa0ed785700 1 --2- 172.21.15.26:0/56636743 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0e80a0a30 0x7fa0e81c86d0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc013000 tx=0x7fa0dc004750 comp rx=0 tx=0).stop 2023-10-01T07:57:13.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.670+0000 7fa0ed785700 1 -- 172.21.15.26:0/56636743 shutdown_connections 2023-10-01T07:57:13.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.670+0000 7fa0ed785700 1 --2- 172.21.15.26:0/56636743 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa0e8133930 0x7fa0e81c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:13.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.670+0000 7fa0ed785700 1 --2- 172.21.15.26:0/56636743 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa0e809d630 0x7fa0e81c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:13.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.670+0000 7fa0ed785700 1 --2- 172.21.15.26:0/56636743 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0e80a0a30 0x7fa0e81c86d0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:13.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.670+0000 7fa0ed785700 1 -- 172.21.15.26:0/56636743 >> 172.21.15.26:0/56636743 conn(0x7fa0e80a3050 msgr2=0x7fa0e81bba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:13.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.670+0000 7fa0ed785700 1 -- 172.21.15.26:0/56636743 shutdown_connections 2023-10-01T07:57:13.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:13.670+0000 7fa0ed785700 1 -- 172.21.15.26:0/56636743 wait complete. 2023-10-01T07:57:13.684 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:13.888 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:13.952 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:13.986 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:14.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.040+0000 7f9538208700 1 Processor -- start 2023-10-01T07:57:14.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.040+0000 7f9538208700 1 -- start start 2023-10-01T07:57:14.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.041+0000 7f9538208700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f953009d6f0 0x7f953009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:14.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.041+0000 7f9538208700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f953009e410 0x7f9530134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:14.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.041+0000 7f9538208700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f953009b120 con 0x7f953009e000 2023-10-01T07:57:14.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.041+0000 7f9538208700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f953006b460 con 0x7f953009e410 2023-10-01T07:57:14.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.041+0000 7f9538208700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f953009a7e0 con 0x7f953009d6f0 2023-10-01T07:57:14.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.041+0000 7f95357a3700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f953009e000 0x7f95301339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56104/0 (socket says 172.21.15.26:56104) 2023-10-01T07:57:14.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.041+0000 7f95357a3700 1 -- 172.21.15.26:0/2242916316 learned_addr learned my addr 172.21.15.26:0/2242916316 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:14.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.041+0000 7f95367a5700 1 --2- 172.21.15.26:0/2242916316 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f953009e410 0x7f9530134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:14.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.041+0000 7f9535fa4700 1 --2- 172.21.15.26:0/2242916316 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f953009d6f0 0x7f953009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:14.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.041+0000 7f9534fa2700 1 -- 172.21.15.26:0/2242916316 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3148534659 0 0) 0x7f953009b120 con 0x7f953009e000 2023-10-01T07:57:14.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.041+0000 7f95367a5700 1 -- 172.21.15.26:0/2242916316 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f953009d6f0 msgr2=0x7f953009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:14.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.041+0000 7f95367a5700 1 --2- 172.21.15.26:0/2242916316 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f953009d6f0 0x7f953009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:14.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.041+0000 7f95367a5700 1 -- 172.21.15.26:0/2242916316 >> v1:172.21.15.26:6789/0 conn(0x7f953009e000 legacy=0x7f95301339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:14.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.041+0000 7f95367a5700 1 -- 172.21.15.26:0/2242916316 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f953009a500 con 0x7f953009e410 2023-10-01T07:57:14.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.042+0000 7f95367a5700 1 --2- 172.21.15.26:0/2242916316 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f953009e410 0x7f9530134100 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9528009dc0 tx=0x7f952800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1387b1949518a81c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:14.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.042+0000 7f9534fa2700 1 -- 172.21.15.26:0/2242916316 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952800e070 con 0x7f953009e410 2023-10-01T07:57:14.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.042+0000 7f9534fa2700 1 -- 172.21.15.26:0/2242916316 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952800bb20 con 0x7f953009e410 2023-10-01T07:57:14.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.042+0000 7f9534fa2700 1 -- 172.21.15.26:0/2242916316 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9528012430 con 0x7f953009e410 2023-10-01T07:57:14.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.042+0000 7f9538208700 1 -- 172.21.15.26:0/2242916316 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f953009e410 msgr2=0x7f9530134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:14.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.042+0000 7f9538208700 1 --2- 172.21.15.26:0/2242916316 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f953009e410 0x7f9530134100 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9528009dc0 tx=0x7f952800b330 comp rx=0 tx=0).stop 2023-10-01T07:57:14.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.042+0000 7f9538208700 1 -- 172.21.15.26:0/2242916316 shutdown_connections 2023-10-01T07:57:14.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.042+0000 7f9538208700 1 --2- 172.21.15.26:0/2242916316 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f953009d6f0 0x7f953009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:14.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.042+0000 7f9538208700 1 --2- 172.21.15.26:0/2242916316 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f953009e410 0x7f9530134100 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:14.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.043+0000 7f9538208700 1 -- 172.21.15.26:0/2242916316 >> 172.21.15.26:0/2242916316 conn(0x7f9530066f50 msgr2=0x7f953009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:14.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.043+0000 7f9538208700 1 -- 172.21.15.26:0/2242916316 shutdown_connections 2023-10-01T07:57:14.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.043+0000 7f9538208700 1 -- 172.21.15.26:0/2242916316 wait complete. 2023-10-01T07:57:14.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.044+0000 7f9538208700 1 Processor -- start 2023-10-01T07:57:14.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.044+0000 7f9538208700 1 -- start start 2023-10-01T07:57:14.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.044+0000 7f9538208700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f953009d6f0 0x7f95301223c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:14.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.044+0000 7f9538208700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f953009e000 0x7f9530122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:14.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.044+0000 7f9538208700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f953009e410 0x7f9530122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:14.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.044+0000 7f9538208700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9530123890 con 0x7f953009d6f0 2023-10-01T07:57:14.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.044+0000 7f9538208700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9530133700 con 0x7f953009e000 2023-10-01T07:57:14.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.044+0000 7f9538208700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9530124dd0 con 0x7f953009e410 2023-10-01T07:57:14.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.044+0000 7f9535fa4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f953009d6f0 0x7f95301223c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:14.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.044+0000 7f95367a5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f953009e410 0x7f9530122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:14.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.044+0000 7f95357a3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f953009e000 0x7f9530122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:14.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.044+0000 7f9535fa4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f953009d6f0 0x7f95301223c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55066/0 (socket says 172.21.15.26:55066) 2023-10-01T07:57:14.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.044+0000 7f9535fa4700 1 -- 172.21.15.26:0/731993421 learned_addr learned my addr 172.21.15.26:0/731993421 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:14.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.045+0000 7f9535fa4700 1 -- 172.21.15.26:0/731993421 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f953009e410 msgr2=0x7f9530122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:14.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.045+0000 7f9535fa4700 1 --2- 172.21.15.26:0/731993421 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f953009e410 0x7f9530122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:14.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.045+0000 7f9535fa4700 1 -- 172.21.15.26:0/731993421 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f953009e000 msgr2=0x7f9530122900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:14.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.045+0000 7f9535fa4700 1 --2- 172.21.15.26:0/731993421 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f953009e000 0x7f9530122900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:14.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.045+0000 7f9535fa4700 1 -- 172.21.15.26:0/731993421 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9528009a70 con 0x7f953009d6f0 2023-10-01T07:57:14.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.045+0000 7f9535fa4700 1 --2- 172.21.15.26:0/731993421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f953009d6f0 0x7f95301223c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f952c00e9e0 tx=0x7f952c00ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:14.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.045+0000 7f95267fc700 1 -- 172.21.15.26:0/731993421 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952c009710 con 0x7f953009d6f0 2023-10-01T07:57:14.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.045+0000 7f95267fc700 1 -- 172.21.15.26:0/731993421 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952c00ee80 con 0x7f953009d6f0 2023-10-01T07:57:14.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.045+0000 7f9538208700 1 -- 172.21.15.26:0/731993421 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95301258b0 con 0x7f953009d6f0 2023-10-01T07:57:14.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.045+0000 7f95267fc700 1 -- 172.21.15.26:0/731993421 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952c00ca50 con 0x7f953009d6f0 2023-10-01T07:57:14.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.045+0000 7f9538208700 1 -- 172.21.15.26:0/731993421 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9530072040 con 0x7f953009d6f0 2023-10-01T07:57:14.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.046+0000 7f95267fc700 1 -- 172.21.15.26:0/731993421 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f952c00cbb0 con 0x7f953009d6f0 2023-10-01T07:57:14.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.046+0000 7f95267fc700 1 -- 172.21.15.26:0/731993421 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f952c03f720 con 0x7f953009d6f0 2023-10-01T07:57:14.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.046+0000 7f9538208700 1 -- 172.21.15.26:0/731993421 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9530074ea0 con 0x7f953009d6f0 2023-10-01T07:57:14.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.052+0000 7f95267fc700 1 -- 172.21.15.26:0/731993421 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f952c0232f0 con 0x7f953009d6f0 2023-10-01T07:57:14.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.100+0000 7f653116a700 1 Processor -- start 2023-10-01T07:57:14.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.100+0000 7f653116a700 1 -- start start 2023-10-01T07:57:14.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.101+0000 7f653116a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f652c0a0a30 0x7f652c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:14.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.101+0000 7f653116a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f652c09d630 0x7f652c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:14.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.101+0000 7f653116a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f652c0a2a70 con 0x7f652c133930 2023-10-01T07:57:14.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.101+0000 7f653116a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f652c0a01d0 con 0x7f652c0a0a30 2023-10-01T07:57:14.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.101+0000 7f653116a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f652c09e2b0 con 0x7f652c09d630 2023-10-01T07:57:14.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.101+0000 7f652ad9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f652c0a0a30 0x7f652c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:14.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.101+0000 7f652b59e700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f652c133930 0x7f652c133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56118/0 (socket says 172.21.15.26:56118) 2023-10-01T07:57:14.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.101+0000 7f652b59e700 1 -- 172.21.15.26:0/197842073 learned_addr learned my addr 172.21.15.26:0/197842073 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:14.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.101+0000 7f6523fff700 1 --2- 172.21.15.26:0/197842073 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f652c09d630 0x7f652c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:14.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.102+0000 7f652ad9d700 1 -- 172.21.15.26:0/197842073 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f652c09d630 msgr2=0x7f652c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:14.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.102+0000 7f652ad9d700 1 --2- 172.21.15.26:0/197842073 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f652c09d630 0x7f652c0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:14.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.102+0000 7f652ad9d700 1 -- 172.21.15.26:0/197842073 >> v1:172.21.15.26:6789/0 conn(0x7f652c133930 legacy=0x7f652c133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:14.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.102+0000 7f652a59c700 1 -- 172.21.15.26:0/197842073 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1642313003 0 0) 0x7f652c0a2a70 con 0x7f652c133930 2023-10-01T07:57:14.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.102+0000 7f652ad9d700 1 -- 172.21.15.26:0/197842073 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f652c09dc50 con 0x7f652c0a0a30 2023-10-01T07:57:14.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.102+0000 7f6523fff700 1 --2- 172.21.15.26:0/197842073 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f652c09d630 0x7f652c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:14.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.102+0000 7f652ad9d700 1 --2- 172.21.15.26:0/197842073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f652c0a0a30 0x7f652c0a0e00 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f651c009840 tx=0x7f651c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eefeacfe6828045a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:14.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.102+0000 7f652a59c700 1 -- 172.21.15.26:0/197842073 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651c011830 con 0x7f652c0a0a30 2023-10-01T07:57:14.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.102+0000 7f652a59c700 1 -- 172.21.15.26:0/197842073 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f651c011990 con 0x7f652c0a0a30 2023-10-01T07:57:14.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.102+0000 7f652a59c700 1 -- 172.21.15.26:0/197842073 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651c011d20 con 0x7f652c0a0a30 2023-10-01T07:57:14.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.103+0000 7f653116a700 1 -- 172.21.15.26:0/197842073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f652c0a0a30 msgr2=0x7f652c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:14.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.103+0000 7f653116a700 1 --2- 172.21.15.26:0/197842073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f652c0a0a30 0x7f652c0a0e00 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f651c009840 tx=0x7f651c009b50 comp rx=0 tx=0).stop 2023-10-01T07:57:14.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.103+0000 7f653116a700 1 -- 172.21.15.26:0/197842073 shutdown_connections 2023-10-01T07:57:14.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.103+0000 7f653116a700 1 --2- 172.21.15.26:0/197842073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f652c0a0a30 0x7f652c0a0e00 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:14.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.103+0000 7f653116a700 1 --2- 172.21.15.26:0/197842073 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f652c09d630 0x7f652c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:14.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.103+0000 7f653116a700 1 -- 172.21.15.26:0/197842073 >> 172.21.15.26:0/197842073 conn(0x7f652c0a3050 msgr2=0x7f652c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:14.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.103+0000 7f653116a700 1 -- 172.21.15.26:0/197842073 shutdown_connections 2023-10-01T07:57:14.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.103+0000 7f653116a700 1 -- 172.21.15.26:0/197842073 wait complete. 2023-10-01T07:57:14.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.105+0000 7f653116a700 1 Processor -- start 2023-10-01T07:57:14.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.105+0000 7f653116a700 1 -- start start 2023-10-01T07:57:14.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.105+0000 7f653116a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f652c09d630 0x7f652c1c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:14.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.105+0000 7f653116a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f652c0a0a30 0x7f652c1c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:14.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.105+0000 7f653116a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f652c133930 0x7f652c1c8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:14.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.105+0000 7f653116a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652c1207f0 con 0x7f652c133930 2023-10-01T07:57:14.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.105+0000 7f653116a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f652c120600 con 0x7f652c0a0a30 2023-10-01T07:57:14.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.105+0000 7f653116a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f652c0a42e0 con 0x7f652c09d630 2023-10-01T07:57:14.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.106+0000 7f6523fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f652c0a0a30 0x7f652c1c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:14.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.106+0000 7f6523fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f652c0a0a30 0x7f652c1c8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45782/0 (socket says 172.21.15.26:45782) 2023-10-01T07:57:14.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.106+0000 7f6523fff700 1 -- 172.21.15.26:0/1892365988 learned_addr learned my addr 172.21.15.26:0/1892365988 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:14.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.106+0000 7f652ad9d700 1 --2- 172.21.15.26:0/1892365988 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f652c09d630 0x7f652c1c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:14.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.106+0000 7f652b59e700 1 --2- 172.21.15.26:0/1892365988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f652c133930 0x7f652c1c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:14.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.106+0000 7f6523fff700 1 -- 172.21.15.26:0/1892365988 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f652c09d630 msgr2=0x7f652c1c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:14.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.106+0000 7f6523fff700 1 --2- 172.21.15.26:0/1892365988 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f652c09d630 0x7f652c1c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:14.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.106+0000 7f6523fff700 1 -- 172.21.15.26:0/1892365988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f652c133930 msgr2=0x7f652c1c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:14.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.106+0000 7f6523fff700 1 --2- 172.21.15.26:0/1892365988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f652c133930 0x7f652c1c8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:14.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.106+0000 7f6523fff700 1 -- 172.21.15.26:0/1892365988 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65140094a0 con 0x7f652c0a0a30 2023-10-01T07:57:14.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.106+0000 7f652ad9d700 1 --2- 172.21.15.26:0/1892365988 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f652c09d630 0x7f652c1c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:57:14.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.106+0000 7f6523fff700 1 --2- 172.21.15.26:0/1892365988 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f652c0a0a30 0x7f652c1c8450 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f651400ebe0 tx=0x7f651400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:14.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.106+0000 7f65237fe700 1 -- 172.21.15.26:0/1892365988 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6514009800 con 0x7f652c0a0a30 2023-10-01T07:57:14.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.106+0000 7f65237fe700 1 -- 172.21.15.26:0/1892365988 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f651400c910 con 0x7f652c0a0a30 2023-10-01T07:57:14.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.106+0000 7f653116a700 1 -- 172.21.15.26:0/1892365988 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f651c0094a0 con 0x7f652c0a0a30 2023-10-01T07:57:14.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.106+0000 7f65237fe700 1 -- 172.21.15.26:0/1892365988 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651400cc80 con 0x7f652c0a0a30 2023-10-01T07:57:14.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.107+0000 7f653116a700 1 -- 172.21.15.26:0/1892365988 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f652c120df0 con 0x7f652c0a0a30 2023-10-01T07:57:14.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.107+0000 7f65237fe700 1 -- 172.21.15.26:0/1892365988 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6514013470 con 0x7f652c0a0a30 2023-10-01T07:57:14.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.108+0000 7f653116a700 1 -- 172.21.15.26:0/1892365988 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f652c122000 con 0x7f652c0a0a30 2023-10-01T07:57:14.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.108+0000 7f65237fe700 1 -- 172.21.15.26:0/1892365988 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f651403f8a0 con 0x7f652c0a0a30 2023-10-01T07:57:14.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.117+0000 7f65237fe700 1 -- 172.21.15.26:0/1892365988 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6514013720 con 0x7f652c0a0a30 2023-10-01T07:57:14.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.143+0000 7fb5616d5700 1 Processor -- start 2023-10-01T07:57:14.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.143+0000 7fb5616d5700 1 -- start start 2023-10-01T07:57:14.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.144+0000 7fb5616d5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb55c0a0a30 0x7fb55c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:14.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.144+0000 7fb5616d5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb55c0a1340 0x7fb55c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:14.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.144+0000 7fb5616d5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb55c09edd0 con 0x7fb55c133fa0 2023-10-01T07:57:14.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.144+0000 7fb5616d5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c09e1f0 con 0x7fb55c0a1340 2023-10-01T07:57:14.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.144+0000 7fb5616d5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c09dc50 con 0x7fb55c0a0a30 2023-10-01T07:57:14.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.144+0000 7fb55affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb55c0a0a30 0x7fb55c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:14.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.144+0000 7fb55affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb55c0a0a30 0x7fb55c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49452/0 (socket says 172.21.15.26:49452) 2023-10-01T07:57:14.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.144+0000 7fb55affd700 1 -- 172.21.15.26:0/845102996 learned_addr learned my addr 172.21.15.26:0/845102996 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:14.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.144+0000 7fb55a7fc700 1 --2- 172.21.15.26:0/845102996 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb55c0a1340 0x7fb55c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:14.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.145+0000 7fb55affd700 1 -- 172.21.15.26:0/845102996 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb55c0a1340 msgr2=0x7fb55c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:14.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.145+0000 7fb559ffb700 1 -- 172.21.15.26:0/845102996 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 662542530 0 0) 0x7fb55c09edd0 con 0x7fb55c133fa0 2023-10-01T07:57:14.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.145+0000 7fb55affd700 1 --2- 172.21.15.26:0/845102996 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb55c0a1340 0x7fb55c133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:14.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.145+0000 7fb55affd700 1 -- 172.21.15.26:0/845102996 >> v1:172.21.15.26:6789/0 conn(0x7fb55c133fa0 legacy=0x7fb55c13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:14.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.145+0000 7fb55affd700 1 -- 172.21.15.26:0/845102996 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c0a1fe0 con 0x7fb55c0a0a30 2023-10-01T07:57:14.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.145+0000 7fb55affd700 1 --2- 172.21.15.26:0/845102996 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb55c0a0a30 0x7fb55c0a0e00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb54c009e80 tx=0x7fb54c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31fdee3be45047ec server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:14.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.145+0000 7fb559ffb700 1 -- 172.21.15.26:0/845102996 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c00e070 con 0x7fb55c0a0a30 2023-10-01T07:57:14.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.145+0000 7fb559ffb700 1 -- 172.21.15.26:0/845102996 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54c00b910 con 0x7fb55c0a0a30 2023-10-01T07:57:14.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.145+0000 7fb559ffb700 1 -- 172.21.15.26:0/845102996 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c00bcc0 con 0x7fb55c0a0a30 2023-10-01T07:57:14.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.146+0000 7fb5616d5700 1 -- 172.21.15.26:0/845102996 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb55c0a0a30 msgr2=0x7fb55c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:14.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.146+0000 7fb5616d5700 1 --2- 172.21.15.26:0/845102996 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb55c0a0a30 0x7fb55c0a0e00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb54c009e80 tx=0x7fb54c00b330 comp rx=0 tx=0).stop 2023-10-01T07:57:14.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.146+0000 7fb5616d5700 1 -- 172.21.15.26:0/845102996 shutdown_connections 2023-10-01T07:57:14.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.146+0000 7fb5616d5700 1 --2- 172.21.15.26:0/845102996 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb55c0a0a30 0x7fb55c0a0e00 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:14.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.146+0000 7fb5616d5700 1 --2- 172.21.15.26:0/845102996 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb55c0a1340 0x7fb55c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:14.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.146+0000 7fb5616d5700 1 -- 172.21.15.26:0/845102996 >> 172.21.15.26:0/845102996 conn(0x7fb55c0a6550 msgr2=0x7fb55c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:14.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.146+0000 7fb5616d5700 1 -- 172.21.15.26:0/845102996 shutdown_connections 2023-10-01T07:57:14.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.146+0000 7fb5616d5700 1 -- 172.21.15.26:0/845102996 wait complete. 2023-10-01T07:57:14.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.147+0000 7fb5616d5700 1 Processor -- start 2023-10-01T07:57:14.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.147+0000 7fb5616d5700 1 -- start start 2023-10-01T07:57:14.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.147+0000 7fb5616d5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb55c0a0a30 0x7fb55c11e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:14.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.147+0000 7fb5616d5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb55c0a1340 0x7fb55c11ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:14.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.147+0000 7fb5616d5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb55c133fa0 0x7fb55c11f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:14.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.147+0000 7fb5616d5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c122250 con 0x7fb55c0a1340 2023-10-01T07:57:14.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.147+0000 7fb5616d5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c0a36c0 con 0x7fb55c0a0a30 2023-10-01T07:57:14.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.147+0000 7fb5616d5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c120340 con 0x7fb55c133fa0 2023-10-01T07:57:14.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.148+0000 7fb55a7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb55c0a1340 0x7fb55c11ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:14.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.148+0000 7fb55affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb55c0a0a30 0x7fb55c11e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:14.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.148+0000 7fb55a7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb55c0a1340 0x7fb55c11ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55096/0 (socket says 172.21.15.26:55096) 2023-10-01T07:57:14.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.148+0000 7fb55a7fc700 1 -- 172.21.15.26:0/577478399 learned_addr learned my addr 172.21.15.26:0/577478399 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:14.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.148+0000 7fb55b7fe700 1 --2- 172.21.15.26:0/577478399 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb55c133fa0 0x7fb55c11f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:14.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.148+0000 7fb55a7fc700 1 -- 172.21.15.26:0/577478399 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb55c133fa0 msgr2=0x7fb55c11f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:14.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.148+0000 7fb55a7fc700 1 --2- 172.21.15.26:0/577478399 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb55c133fa0 0x7fb55c11f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:14.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.148+0000 7fb55a7fc700 1 -- 172.21.15.26:0/577478399 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb55c0a0a30 msgr2=0x7fb55c11e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:14.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.148+0000 7fb55a7fc700 1 --2- 172.21.15.26:0/577478399 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb55c0a0a30 0x7fb55c11e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:14.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.148+0000 7fb55a7fc700 1 -- 172.21.15.26:0/577478399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54c009b30 con 0x7fb55c0a1340 2023-10-01T07:57:14.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.148+0000 7fb55affd700 1 --2- 172.21.15.26:0/577478399 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb55c0a0a30 0x7fb55c11e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:14.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.148+0000 7fb55a7fc700 1 --2- 172.21.15.26:0/577478399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb55c0a1340 0x7fb55c11ed00 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb55000e9b0 tx=0x7fb55000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:14.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.148+0000 7fb5437fe700 1 -- 172.21.15.26:0/577478399 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb550009710 con 0x7fb55c0a1340 2023-10-01T07:57:14.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.148+0000 7fb5437fe700 1 -- 172.21.15.26:0/577478399 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55000c850 con 0x7fb55c0a1340 2023-10-01T07:57:14.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.148+0000 7fb5437fe700 1 -- 172.21.15.26:0/577478399 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55000cbc0 con 0x7fb55c0a1340 2023-10-01T07:57:14.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.148+0000 7fb5616d5700 1 -- 172.21.15.26:0/577478399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb55c0a25e0 con 0x7fb55c0a1340 2023-10-01T07:57:14.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.149+0000 7fb5616d5700 1 -- 172.21.15.26:0/577478399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb55c121cb0 con 0x7fb55c0a1340 2023-10-01T07:57:14.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.149+0000 7fb5437fe700 1 -- 172.21.15.26:0/577478399 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb55000cd20 con 0x7fb55c0a1340 2023-10-01T07:57:14.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.149+0000 7fb5437fe700 1 -- 172.21.15.26:0/577478399 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb55003f860 con 0x7fb55c0a1340 2023-10-01T07:57:14.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.150+0000 7fb5616d5700 1 -- 172.21.15.26:0/577478399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb55c074ea0 con 0x7fb55c0a1340 2023-10-01T07:57:14.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.155+0000 7fb5437fe700 1 -- 172.21.15.26:0/577478399 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb55001be10 con 0x7fb55c0a1340 2023-10-01T07:57:14.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.265+0000 7f9538208700 1 -- 172.21.15.26:0/731993421 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f953006c360 con 0x7f953009d6f0 2023-10-01T07:57:14.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.265+0000 7f95267fc700 1 -- 172.21.15.26:0/731993421 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f952c01ae80 con 0x7f953009d6f0 2023-10-01T07:57:14.266 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:14.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.267+0000 7f9538208700 1 -- 172.21.15.26:0/731993421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f953009d6f0 msgr2=0x7f95301223c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:14.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.267+0000 7f9538208700 1 --2- 172.21.15.26:0/731993421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f953009d6f0 0x7f95301223c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f952c00e9e0 tx=0x7f952c00ecf0 comp rx=0 tx=0).stop 2023-10-01T07:57:14.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.267+0000 7f9538208700 1 -- 172.21.15.26:0/731993421 shutdown_connections 2023-10-01T07:57:14.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.268+0000 7f9538208700 1 --2- 172.21.15.26:0/731993421 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f953009e410 0x7f9530122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:14.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.268+0000 7f9538208700 1 --2- 172.21.15.26:0/731993421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f953009d6f0 0x7f95301223c0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:14.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.268+0000 7f9538208700 1 --2- 172.21.15.26:0/731993421 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f953009e000 0x7f9530122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:14.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.268+0000 7f9538208700 1 -- 172.21.15.26:0/731993421 >> 172.21.15.26:0/731993421 conn(0x7f9530066f50 msgr2=0x7f9530070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:14.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.268+0000 7f9538208700 1 -- 172.21.15.26:0/731993421 shutdown_connections 2023-10-01T07:57:14.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.268+0000 7f9538208700 1 -- 172.21.15.26:0/731993421 wait complete. 2023-10-01T07:57:14.282 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:14.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.331+0000 7f653116a700 1 -- 172.21.15.26:0/1892365988 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f652c122d00 con 0x7f652c0a0a30 2023-10-01T07:57:14.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.331+0000 7f65237fe700 1 -- 172.21.15.26:0/1892365988 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f651401b3b0 con 0x7f652c0a0a30 2023-10-01T07:57:14.332 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:14.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.333+0000 7f653116a700 1 -- 172.21.15.26:0/1892365988 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f652c0a0a30 msgr2=0x7f652c1c8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:14.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.333+0000 7f653116a700 1 --2- 172.21.15.26:0/1892365988 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f652c0a0a30 0x7f652c1c8450 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f651400ebe0 tx=0x7f651400eef0 comp rx=0 tx=0).stop 2023-10-01T07:57:14.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.333+0000 7f653116a700 1 -- 172.21.15.26:0/1892365988 shutdown_connections 2023-10-01T07:57:14.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.333+0000 7f653116a700 1 --2- 172.21.15.26:0/1892365988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f652c133930 0x7f652c1c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:14.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.333+0000 7f653116a700 1 --2- 172.21.15.26:0/1892365988 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f652c09d630 0x7f652c1c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:14.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.333+0000 7f653116a700 1 --2- 172.21.15.26:0/1892365988 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f652c0a0a30 0x7f652c1c8450 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:14.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.333+0000 7f653116a700 1 -- 172.21.15.26:0/1892365988 >> 172.21.15.26:0/1892365988 conn(0x7f652c0a3050 msgr2=0x7f652c1bb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:14.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.333+0000 7f653116a700 1 -- 172.21.15.26:0/1892365988 shutdown_connections 2023-10-01T07:57:14.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.333+0000 7f653116a700 1 -- 172.21.15.26:0/1892365988 wait complete. 2023-10-01T07:57:14.348 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:14.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.361+0000 7fb5616d5700 1 -- 172.21.15.26:0/577478399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb55c0a28e0 con 0x7fb55c0a1340 2023-10-01T07:57:14.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.362+0000 7fb5437fe700 1 -- 172.21.15.26:0/577478399 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb55002a090 con 0x7fb55c0a1340 2023-10-01T07:57:14.363 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:14.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.364+0000 7fb5616d5700 1 -- 172.21.15.26:0/577478399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb55c0a1340 msgr2=0x7fb55c11ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:14.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.364+0000 7fb5616d5700 1 --2- 172.21.15.26:0/577478399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb55c0a1340 0x7fb55c11ed00 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb55000e9b0 tx=0x7fb55000ecc0 comp rx=0 tx=0).stop 2023-10-01T07:57:14.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.364+0000 7fb5616d5700 1 -- 172.21.15.26:0/577478399 shutdown_connections 2023-10-01T07:57:14.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.364+0000 7fb5616d5700 1 --2- 172.21.15.26:0/577478399 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb55c133fa0 0x7fb55c11f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:14.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.364+0000 7fb5616d5700 1 --2- 172.21.15.26:0/577478399 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb55c0a0a30 0x7fb55c11e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:14.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.364+0000 7fb5616d5700 1 --2- 172.21.15.26:0/577478399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb55c0a1340 0x7fb55c11ed00 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:14.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.364+0000 7fb5616d5700 1 -- 172.21.15.26:0/577478399 >> 172.21.15.26:0/577478399 conn(0x7fb55c0a6550 msgr2=0x7fb55c1b9120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:14.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.364+0000 7fb5616d5700 1 -- 172.21.15.26:0/577478399 shutdown_connections 2023-10-01T07:57:14.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.364+0000 7fb5616d5700 1 -- 172.21.15.26:0/577478399 wait complete. 2023-10-01T07:57:14.378 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:14.685 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:14.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.832+0000 7f30ddb7f700 1 Processor -- start 2023-10-01T07:57:14.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.832+0000 7f30ddb7f700 1 -- start start 2023-10-01T07:57:14.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.832+0000 7f30ddb7f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f30d809e930 0x7f30d809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:14.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.832+0000 7f30ddb7f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f30d809f650 0x7f30d8131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:14.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.832+0000 7f30ddb7f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30d8070940 con 0x7f30d809f240 2023-10-01T07:57:14.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.832+0000 7f30ddb7f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30d806fd60 con 0x7f30d809e930 2023-10-01T07:57:14.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.832+0000 7f30ddb7f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30d806fa80 con 0x7f30d809f650 2023-10-01T07:57:14.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.832+0000 7f30d7fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f30d809f650 0x7f30d8131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:14.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.832+0000 7f30d6ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f30d809f240 0x7f30d81317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56130/0 (socket says 172.21.15.26:56130) 2023-10-01T07:57:14.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.832+0000 7f30d6ffd700 1 -- 172.21.15.26:0/3471353565 learned_addr learned my addr 172.21.15.26:0/3471353565 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:14.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.832+0000 7f30d77fe700 1 --2- 172.21.15.26:0/3471353565 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f30d809e930 0x7f30d809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:14.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.833+0000 7f30d67fc700 1 -- 172.21.15.26:0/3471353565 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3300048765 0 0) 0x7f30d8070940 con 0x7f30d809f240 2023-10-01T07:57:14.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.833+0000 7f30d7fff700 1 -- 172.21.15.26:0/3471353565 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f30d809e930 msgr2=0x7f30d809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:14.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.833+0000 7f30d7fff700 1 --2- 172.21.15.26:0/3471353565 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f30d809e930 0x7f30d809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:14.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.833+0000 7f30d7fff700 1 -- 172.21.15.26:0/3471353565 >> v1:172.21.15.26:6789/0 conn(0x7f30d809f240 legacy=0x7f30d81317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:14.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.833+0000 7f30d7fff700 1 -- 172.21.15.26:0/3471353565 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d809fb60 con 0x7f30d809f650 2023-10-01T07:57:14.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.833+0000 7f30d77fe700 1 --2- 172.21.15.26:0/3471353565 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f30d809e930 0x7f30d809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:14.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.833+0000 7f30d7fff700 1 --2- 172.21.15.26:0/3471353565 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f30d809f650 0x7f30d8131f00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f30d0009dc0 tx=0x7f30d000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c584fe7126a8bac2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:14.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.833+0000 7f30d67fc700 1 -- 172.21.15.26:0/3471353565 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d000e070 con 0x7f30d809f650 2023-10-01T07:57:14.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.833+0000 7f30d67fc700 1 -- 172.21.15.26:0/3471353565 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d000bb20 con 0x7f30d809f650 2023-10-01T07:57:14.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.833+0000 7f30d67fc700 1 -- 172.21.15.26:0/3471353565 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d0012430 con 0x7f30d809f650 2023-10-01T07:57:14.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.834+0000 7f30ddb7f700 1 -- 172.21.15.26:0/3471353565 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f30d809f650 msgr2=0x7f30d8131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:14.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.834+0000 7f30ddb7f700 1 --2- 172.21.15.26:0/3471353565 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f30d809f650 0x7f30d8131f00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f30d0009dc0 tx=0x7f30d000b330 comp rx=0 tx=0).stop 2023-10-01T07:57:14.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.834+0000 7f30ddb7f700 1 -- 172.21.15.26:0/3471353565 shutdown_connections 2023-10-01T07:57:14.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.834+0000 7f30ddb7f700 1 --2- 172.21.15.26:0/3471353565 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f30d809f650 0x7f30d8131f00 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:14.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.834+0000 7f30ddb7f700 1 --2- 172.21.15.26:0/3471353565 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f30d809e930 0x7f30d809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:14.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.834+0000 7f30ddb7f700 1 -- 172.21.15.26:0/3471353565 >> 172.21.15.26:0/3471353565 conn(0x7f30d80a4210 msgr2=0x7f30d80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:14.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.834+0000 7f30ddb7f700 1 -- 172.21.15.26:0/3471353565 shutdown_connections 2023-10-01T07:57:14.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.834+0000 7f30ddb7f700 1 -- 172.21.15.26:0/3471353565 wait complete. 2023-10-01T07:57:14.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.835+0000 7f30ddb7f700 1 Processor -- start 2023-10-01T07:57:14.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.835+0000 7f30ddb7f700 1 -- start start 2023-10-01T07:57:14.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.835+0000 7f30ddb7f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f30d809e930 0x7f30d81a3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:14.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.835+0000 7f30ddb7f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f30d809f240 0x7f30d81a4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:14.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.835+0000 7f30ddb7f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30d809f650 0x7f30d81a4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:14.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.836+0000 7f30ddb7f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d81a7680 con 0x7f30d809f650 2023-10-01T07:57:14.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.836+0000 7f30ddb7f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30d80a32d0 con 0x7f30d809f240 2023-10-01T07:57:14.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.836+0000 7f30ddb7f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30d81a6e10 con 0x7f30d809e930 2023-10-01T07:57:14.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.836+0000 7f30d6ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f30d809f240 0x7f30d81a4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:14.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.836+0000 7f30d77fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f30d809e930 0x7f30d81a3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:14.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.836+0000 7f30d7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30d809f650 0x7f30d81a4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:14.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.836+0000 7f30d6ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f30d809f240 0x7f30d81a4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45820/0 (socket says 172.21.15.26:45820) 2023-10-01T07:57:14.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.836+0000 7f30d77fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f30d809e930 0x7f30d81a3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49486/0 (socket says 172.21.15.26:49486) 2023-10-01T07:57:14.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.836+0000 7f30d6ffd700 1 -- 172.21.15.26:0/3581758454 learned_addr learned my addr 172.21.15.26:0/3581758454 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:14.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.836+0000 7f30d77fe700 1 -- 172.21.15.26:0/3581758454 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f30d809f240 msgr2=0x7f30d81a4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:14.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.836+0000 7f30d77fe700 1 --2- 172.21.15.26:0/3581758454 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f30d809f240 0x7f30d81a4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:14.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.836+0000 7f30d77fe700 1 -- 172.21.15.26:0/3581758454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30d809f650 msgr2=0x7f30d81a4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:14.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.836+0000 7f30d77fe700 1 --2- 172.21.15.26:0/3581758454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30d809f650 0x7f30d81a4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:14.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.836+0000 7f30d77fe700 1 -- 172.21.15.26:0/3581758454 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c80094a0 con 0x7f30d809e930 2023-10-01T07:57:14.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.836+0000 7f30d77fe700 1 --2- 172.21.15.26:0/3581758454 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f30d809e930 0x7f30d81a3bf0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f30c800e9b0 tx=0x7f30c800ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:14.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.836+0000 7f30bffff700 1 -- 172.21.15.26:0/3581758454 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c800ee50 con 0x7f30d809e930 2023-10-01T07:57:14.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.836+0000 7f30bffff700 1 -- 172.21.15.26:0/3581758454 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c800c850 con 0x7f30d809e930 2023-10-01T07:57:14.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.836+0000 7f30ddb7f700 1 -- 172.21.15.26:0/3581758454 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30d0009a70 con 0x7f30d809e930 2023-10-01T07:57:14.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.836+0000 7f30bffff700 1 -- 172.21.15.26:0/3581758454 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c800cc00 con 0x7f30d809e930 2023-10-01T07:57:14.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.837+0000 7f30ddb7f700 1 -- 172.21.15.26:0/3581758454 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30d80a0190 con 0x7f30d809e930 2023-10-01T07:57:14.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.837+0000 7f30bffff700 1 -- 172.21.15.26:0/3581758454 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f30c8013470 con 0x7f30d809e930 2023-10-01T07:57:14.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.837+0000 7f30bffff700 1 -- 172.21.15.26:0/3581758454 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f30c803f710 con 0x7f30d809e930 2023-10-01T07:57:14.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.837+0000 7f30ddb7f700 1 -- 172.21.15.26:0/3581758454 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30d8074ea0 con 0x7f30d809e930 2023-10-01T07:57:14.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:14.842+0000 7f30bffff700 1 -- 172.21.15.26:0/3581758454 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f30c8021020 con 0x7f30d809e930 2023-10-01T07:57:15.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.048+0000 7f30ddb7f700 1 -- 172.21.15.26:0/3581758454 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f30d81a69c0 con 0x7f30d809e930 2023-10-01T07:57:15.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.049+0000 7f30bffff700 1 -- 172.21.15.26:0/3581758454 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f30c8013720 con 0x7f30d809e930 2023-10-01T07:57:15.049 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:15.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.051+0000 7f30ddb7f700 1 -- 172.21.15.26:0/3581758454 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f30d809e930 msgr2=0x7f30d81a3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:15.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.051+0000 7f30ddb7f700 1 --2- 172.21.15.26:0/3581758454 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f30d809e930 0x7f30d81a3bf0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f30c800e9b0 tx=0x7f30c800ecc0 comp rx=0 tx=0).stop 2023-10-01T07:57:15.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.051+0000 7f30ddb7f700 1 -- 172.21.15.26:0/3581758454 shutdown_connections 2023-10-01T07:57:15.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.051+0000 7f30ddb7f700 1 --2- 172.21.15.26:0/3581758454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30d809f650 0x7f30d81a4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:15.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.051+0000 7f30ddb7f700 1 --2- 172.21.15.26:0/3581758454 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f30d809e930 0x7f30d81a3bf0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:15.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.051+0000 7f30ddb7f700 1 --2- 172.21.15.26:0/3581758454 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f30d809f240 0x7f30d81a4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:15.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.051+0000 7f30ddb7f700 1 -- 172.21.15.26:0/3581758454 >> 172.21.15.26:0/3581758454 conn(0x7f30d80a4210 msgr2=0x7f30d81b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:15.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.051+0000 7f30ddb7f700 1 -- 172.21.15.26:0/3581758454 shutdown_connections 2023-10-01T07:57:15.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.051+0000 7f30ddb7f700 1 -- 172.21.15.26:0/3581758454 wait complete. 2023-10-01T07:57:15.066 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:15.283 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:15.348 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:15.379 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:15.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.432+0000 7fcb13116700 1 Processor -- start 2023-10-01T07:57:15.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.432+0000 7fcb13116700 1 -- start start 2023-10-01T07:57:15.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.433+0000 7fcb13116700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb0c133420 0x7fcb0c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:15.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.433+0000 7fcb13116700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb0c134260 0x7fcb0c1306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:15.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.433+0000 7fcb13116700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb0c06b990 con 0x7fcb0c133e30 2023-10-01T07:57:15.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.433+0000 7fcb13116700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c0a0590 con 0x7fcb0c133420 2023-10-01T07:57:15.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.433+0000 7fcb13116700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c09fb80 con 0x7fcb0c134260 2023-10-01T07:57:15.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.433+0000 7fcb10eb2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb0c133420 0x7fcb0c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:15.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.433+0000 7fcb0bfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fcb0c133e30 0x7fcb0c12ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56146/0 (socket says 172.21.15.26:56146) 2023-10-01T07:57:15.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.433+0000 7fcb0bfff700 1 -- 172.21.15.26:0/3114160337 learned_addr learned my addr 172.21.15.26:0/3114160337 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:15.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.433+0000 7fcb116b3700 1 --2- 172.21.15.26:0/3114160337 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb0c134260 0x7fcb0c1306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:15.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.433+0000 7fcb0b7fe700 1 -- 172.21.15.26:0/3114160337 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2618397089 0 0) 0x7fcb0c06b990 con 0x7fcb0c133e30 2023-10-01T07:57:15.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.433+0000 7fcb116b3700 1 -- 172.21.15.26:0/3114160337 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb0c133420 msgr2=0x7fcb0c1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:15.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.433+0000 7fcb116b3700 1 --2- 172.21.15.26:0/3114160337 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb0c133420 0x7fcb0c1337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:15.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.433+0000 7fcb116b3700 1 -- 172.21.15.26:0/3114160337 >> v1:172.21.15.26:6789/0 conn(0x7fcb0c133e30 legacy=0x7fcb0c12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:15.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.433+0000 7fcb116b3700 1 -- 172.21.15.26:0/3114160337 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0c0a0030 con 0x7fcb0c134260 2023-10-01T07:57:15.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.434+0000 7fcb116b3700 1 --2- 172.21.15.26:0/3114160337 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb0c134260 0x7fcb0c1306a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcb04009dc0 tx=0x7fcb0400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf112797023a87d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:15.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.434+0000 7fcb0b7fe700 1 -- 172.21.15.26:0/3114160337 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0400e070 con 0x7fcb0c134260 2023-10-01T07:57:15.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.434+0000 7fcb0b7fe700 1 -- 172.21.15.26:0/3114160337 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb0400bb20 con 0x7fcb0c134260 2023-10-01T07:57:15.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.434+0000 7fcb0b7fe700 1 -- 172.21.15.26:0/3114160337 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb04012430 con 0x7fcb0c134260 2023-10-01T07:57:15.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.435+0000 7fcb13116700 1 -- 172.21.15.26:0/3114160337 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb0c134260 msgr2=0x7fcb0c1306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:15.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.435+0000 7fcb13116700 1 --2- 172.21.15.26:0/3114160337 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb0c134260 0x7fcb0c1306a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcb04009dc0 tx=0x7fcb0400b330 comp rx=0 tx=0).stop 2023-10-01T07:57:15.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.435+0000 7fcb13116700 1 -- 172.21.15.26:0/3114160337 shutdown_connections 2023-10-01T07:57:15.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.435+0000 7fcb13116700 1 --2- 172.21.15.26:0/3114160337 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb0c134260 0x7fcb0c1306a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:15.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.435+0000 7fcb13116700 1 --2- 172.21.15.26:0/3114160337 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb0c133420 0x7fcb0c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:15.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.435+0000 7fcb13116700 1 -- 172.21.15.26:0/3114160337 >> 172.21.15.26:0/3114160337 conn(0x7fcb0c0a4210 msgr2=0x7fcb0c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:15.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.435+0000 7fcb13116700 1 -- 172.21.15.26:0/3114160337 shutdown_connections 2023-10-01T07:57:15.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.435+0000 7fcb13116700 1 -- 172.21.15.26:0/3114160337 wait complete. 2023-10-01T07:57:15.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.436+0000 7fcb13116700 1 Processor -- start 2023-10-01T07:57:15.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.436+0000 7fcb13116700 1 -- start start 2023-10-01T07:57:15.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.436+0000 7fcb13116700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb0c133420 0x7fcb0c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:15.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.436+0000 7fcb13116700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb0c133e30 0x7fcb0c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:15.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.436+0000 7fcb13116700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb0c134260 0x7fcb0c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:15.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.436+0000 7fcb13116700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c09de30 con 0x7fcb0c133e30 2023-10-01T07:57:15.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.436+0000 7fcb13116700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c11edf0 con 0x7fcb0c133420 2023-10-01T07:57:15.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.436+0000 7fcb13116700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c11faf0 con 0x7fcb0c134260 2023-10-01T07:57:15.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.437+0000 7fcb10eb2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb0c133420 0x7fcb0c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:15.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.437+0000 7fcb116b3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb0c134260 0x7fcb0c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:15.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.437+0000 7fcb116b3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb0c134260 0x7fcb0c09cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49502/0 (socket says 172.21.15.26:49502) 2023-10-01T07:57:15.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.437+0000 7fcb10eb2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb0c133420 0x7fcb0c09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45834/0 (socket says 172.21.15.26:45834) 2023-10-01T07:57:15.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.437+0000 7fcb116b3700 1 -- 172.21.15.26:0/2732128177 learned_addr learned my addr 172.21.15.26:0/2732128177 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:15.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.437+0000 7fcb0bfff700 1 --2- 172.21.15.26:0/2732128177 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb0c133e30 0x7fcb0c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:15.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.437+0000 7fcb10eb2700 1 -- 172.21.15.26:0/2732128177 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb0c134260 msgr2=0x7fcb0c09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:15.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.437+0000 7fcb10eb2700 1 --2- 172.21.15.26:0/2732128177 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb0c134260 0x7fcb0c09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:15.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.437+0000 7fcb10eb2700 1 -- 172.21.15.26:0/2732128177 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb0c133e30 msgr2=0x7fcb0c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:15.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.437+0000 7fcb10eb2700 1 --2- 172.21.15.26:0/2732128177 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb0c133e30 0x7fcb0c09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:15.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.437+0000 7fcb10eb2700 1 -- 172.21.15.26:0/2732128177 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb04009a70 con 0x7fcb0c133420 2023-10-01T07:57:15.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.437+0000 7fcb116b3700 1 --2- 172.21.15.26:0/2732128177 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb0c134260 0x7fcb0c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:15.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.437+0000 7fcb0bfff700 1 --2- 172.21.15.26:0/2732128177 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb0c133e30 0x7fcb0c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:15.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.437+0000 7fcb10eb2700 1 --2- 172.21.15.26:0/2732128177 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb0c133420 0x7fcb0c09c480 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fcafc00e900 tx=0x7fcafc00ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:15.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.438+0000 7fcb097fa700 1 -- 172.21.15.26:0/2732128177 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc013680 con 0x7fcb0c133420 2023-10-01T07:57:15.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.438+0000 7fcb097fa700 1 -- 172.21.15.26:0/2732128177 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcafc0137e0 con 0x7fcb0c133420 2023-10-01T07:57:15.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.438+0000 7fcb097fa700 1 -- 172.21.15.26:0/2732128177 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc013b50 con 0x7fcb0c133420 2023-10-01T07:57:15.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.438+0000 7fcb13116700 1 -- 172.21.15.26:0/2732128177 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb0c131620 con 0x7fcb0c133420 2023-10-01T07:57:15.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.438+0000 7fcb13116700 1 -- 172.21.15.26:0/2732128177 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb0c120820 con 0x7fcb0c133420 2023-10-01T07:57:15.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.438+0000 7fcb097fa700 1 -- 172.21.15.26:0/2732128177 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcafc013cb0 con 0x7fcb0c133420 2023-10-01T07:57:15.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.439+0000 7fcb097fa700 1 -- 172.21.15.26:0/2732128177 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcafc03f670 con 0x7fcb0c133420 2023-10-01T07:57:15.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.439+0000 7fcb13116700 1 -- 172.21.15.26:0/2732128177 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb0c074ea0 con 0x7fcb0c133420 2023-10-01T07:57:15.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.448+0000 7fcb097fa700 1 -- 172.21.15.26:0/2732128177 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcafc01be10 con 0x7fcb0c133420 2023-10-01T07:57:15.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.494+0000 7f9df2f50700 1 Processor -- start 2023-10-01T07:57:15.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.494+0000 7f9df2f50700 1 -- start start 2023-10-01T07:57:15.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.494+0000 7f9df2f50700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9dec0a0a30 0x7f9dec0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:15.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.494+0000 7f9df2f50700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9dec09d630 0x7f9dec0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:15.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.494+0000 7f9df2f50700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dec0a2a70 con 0x7f9dec133930 2023-10-01T07:57:15.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.494+0000 7f9df2f50700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dec0a01d0 con 0x7f9dec0a0a30 2023-10-01T07:57:15.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.494+0000 7f9df2f50700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec09e2b0 con 0x7f9dec09d630 2023-10-01T07:57:15.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.494+0000 7f9df0cec700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9dec0a0a30 0x7f9dec0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:15.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.494+0000 7f9debfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9dec09d630 0x7f9dec0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:15.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.494+0000 7f9df0cec700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9dec0a0a30 0x7f9dec0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55116/0 (socket says 172.21.15.26:55116) 2023-10-01T07:57:15.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.494+0000 7f9df0cec700 1 -- 172.21.15.26:0/1471532512 learned_addr learned my addr 172.21.15.26:0/1471532512 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:15.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.495+0000 7f9df0cec700 1 -- 172.21.15.26:0/1471532512 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9dec09d630 msgr2=0x7f9dec0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:15.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.495+0000 7f9df0cec700 1 --2- 172.21.15.26:0/1471532512 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9dec09d630 0x7f9dec0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:15.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.495+0000 7f9df0cec700 1 -- 172.21.15.26:0/1471532512 >> v1:172.21.15.26:6789/0 conn(0x7f9dec133930 legacy=0x7f9dec133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:15.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.495+0000 7f9df0cec700 1 -- 172.21.15.26:0/1471532512 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dec09dc50 con 0x7f9dec0a0a30 2023-10-01T07:57:15.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.495+0000 7f9df0cec700 1 --2- 172.21.15.26:0/1471532512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dec0a0a30 0x7f9dec0a0e00 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f9de00098f0 tx=0x7f9de0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f7fc3697beddaf5 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:15.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.495+0000 7f9deb7fe700 1 -- 172.21.15.26:0/1471532512 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de0011830 con 0x7f9dec0a0a30 2023-10-01T07:57:15.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.495+0000 7f9deb7fe700 1 -- 172.21.15.26:0/1471532512 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de0011990 con 0x7f9dec0a0a30 2023-10-01T07:57:15.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.495+0000 7f9deb7fe700 1 -- 172.21.15.26:0/1471532512 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de0011d20 con 0x7f9dec0a0a30 2023-10-01T07:57:15.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.496+0000 7f9df2f50700 1 -- 172.21.15.26:0/1471532512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dec0a0a30 msgr2=0x7f9dec0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:15.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.496+0000 7f9df2f50700 1 --2- 172.21.15.26:0/1471532512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dec0a0a30 0x7f9dec0a0e00 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f9de00098f0 tx=0x7f9de0009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:15.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.496+0000 7f9df2f50700 1 -- 172.21.15.26:0/1471532512 shutdown_connections 2023-10-01T07:57:15.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.496+0000 7f9df2f50700 1 --2- 172.21.15.26:0/1471532512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dec0a0a30 0x7f9dec0a0e00 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:15.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.496+0000 7f9df2f50700 1 --2- 172.21.15.26:0/1471532512 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9dec09d630 0x7f9dec0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:15.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.496+0000 7f9df2f50700 1 -- 172.21.15.26:0/1471532512 >> 172.21.15.26:0/1471532512 conn(0x7f9dec0a3050 msgr2=0x7f9dec0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:15.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.496+0000 7f9df2f50700 1 -- 172.21.15.26:0/1471532512 shutdown_connections 2023-10-01T07:57:15.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.496+0000 7f9df2f50700 1 -- 172.21.15.26:0/1471532512 wait complete. 2023-10-01T07:57:15.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.498+0000 7f9df2f50700 1 Processor -- start 2023-10-01T07:57:15.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.498+0000 7f9df2f50700 1 -- start start 2023-10-01T07:57:15.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.499+0000 7f9df2f50700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dec09d630 0x7f9dec11f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:15.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.499+0000 7f9df2f50700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9dec0a0a30 0x7f9dec1c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:15.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.499+0000 7f9df2f50700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9dec133930 0x7f9dec1c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:15.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.499+0000 7f9df2f50700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec11f100 con 0x7f9dec09d630 2023-10-01T07:57:15.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.499+0000 7f9df2f50700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec0a0410 con 0x7f9dec0a0a30 2023-10-01T07:57:15.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.499+0000 7f9df2f50700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec121fa0 con 0x7f9dec133930 2023-10-01T07:57:15.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.499+0000 7f9df0cec700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dec09d630 0x7f9dec11f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:15.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.499+0000 7f9df0cec700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dec09d630 0x7f9dec11f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55124/0 (socket says 172.21.15.26:55124) 2023-10-01T07:57:15.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.499+0000 7f9df0cec700 1 -- 172.21.15.26:0/1108416753 learned_addr learned my addr 172.21.15.26:0/1108416753 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:15.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.499+0000 7f9df14ed700 1 --2- 172.21.15.26:0/1108416753 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9dec133930 0x7f9dec1c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:15.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.499+0000 7f9df0cec700 1 -- 172.21.15.26:0/1108416753 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9dec133930 msgr2=0x7f9dec1c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:15.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.499+0000 7f9df0cec700 1 --2- 172.21.15.26:0/1108416753 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9dec133930 0x7f9dec1c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:15.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.499+0000 7f9df0cec700 1 -- 172.21.15.26:0/1108416753 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9dec0a0a30 msgr2=0x7f9dec1c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:15.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.499+0000 7f9df0cec700 1 --2- 172.21.15.26:0/1108416753 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9dec0a0a30 0x7f9dec1c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:15.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.499+0000 7f9df0cec700 1 -- 172.21.15.26:0/1108416753 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de0009550 con 0x7f9dec09d630 2023-10-01T07:57:15.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.499+0000 7f9df0cec700 1 --2- 172.21.15.26:0/1108416753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dec09d630 0x7f9dec11f6d0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f9de0009c40 tx=0x7f9de0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:15.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.500+0000 7f9de97fa700 1 -- 172.21.15.26:0/1108416753 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de00045d0 con 0x7f9dec09d630 2023-10-01T07:57:15.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.500+0000 7f9de97fa700 1 -- 172.21.15.26:0/1108416753 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de00036a0 con 0x7f9dec09d630 2023-10-01T07:57:15.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.500+0000 7f9df2f50700 1 -- 172.21.15.26:0/1108416753 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dec122260 con 0x7f9dec09d630 2023-10-01T07:57:15.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.500+0000 7f9de97fa700 1 -- 172.21.15.26:0/1108416753 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de0003a30 con 0x7f9dec09d630 2023-10-01T07:57:15.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.500+0000 7f9df2f50700 1 -- 172.21.15.26:0/1108416753 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dec1205c0 con 0x7f9dec09d630 2023-10-01T07:57:15.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.501+0000 7f9de97fa700 1 -- 172.21.15.26:0/1108416753 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9de0021070 con 0x7f9dec09d630 2023-10-01T07:57:15.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.501+0000 7f9de97fa700 1 -- 172.21.15.26:0/1108416753 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9de0040d50 con 0x7f9dec09d630 2023-10-01T07:57:15.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.501+0000 7f9df2f50700 1 -- 172.21.15.26:0/1108416753 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dec0747f0 con 0x7f9dec09d630 2023-10-01T07:57:15.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.506+0000 7f9de97fa700 1 -- 172.21.15.26:0/1108416753 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9de0015030 con 0x7f9dec09d630 2023-10-01T07:57:15.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.538+0000 7f63f315b700 1 Processor -- start 2023-10-01T07:57:15.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.538+0000 7f63f315b700 1 -- start start 2023-10-01T07:57:15.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.539+0000 7f63f315b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f63ec06a770 0x7f63ec06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:15.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.539+0000 7f63f315b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f63ec131d10 0x7f63ec139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:15.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.539+0000 7f63f315b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63ec09ece0 con 0x7f63ec06b080 2023-10-01T07:57:15.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.539+0000 7f63f315b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63ec09e760 con 0x7f63ec131d10 2023-10-01T07:57:15.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.539+0000 7f63f315b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec09e040 con 0x7f63ec06a770 2023-10-01T07:57:15.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.539+0000 7f63f0ef7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f63ec06a770 0x7f63ec06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:15.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.539+0000 7f63f16f8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f63ec131d10 0x7f63ec139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:15.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.539+0000 7f63f0ef7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f63ec06a770 0x7f63ec06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49522/0 (socket says 172.21.15.26:49522) 2023-10-01T07:57:15.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.539+0000 7f63f0ef7700 1 -- 172.21.15.26:0/1451947796 learned_addr learned my addr 172.21.15.26:0/1451947796 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:15.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.539+0000 7f63f0ef7700 1 -- 172.21.15.26:0/1451947796 >> v2:172.21.15.26:3300/0 conn(0x7f63ec131d10 msgr2=0x7f63ec139860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:15.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.539+0000 7f63f0ef7700 1 --2- 172.21.15.26:0/1451947796 >> v2:172.21.15.26:3300/0 conn(0x7f63ec131d10 0x7f63ec139860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:15.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.539+0000 7f63f0ef7700 1 -- 172.21.15.26:0/1451947796 >> v1:172.21.15.26:6789/0 conn(0x7f63ec06b080 legacy=0x7f63ec131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:15.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.539+0000 7f63f0ef7700 1 -- 172.21.15.26:0/1451947796 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ec09f630 con 0x7f63ec06a770 2023-10-01T07:57:15.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.539+0000 7f63f16f8700 1 --2- 172.21.15.26:0/1451947796 >> v2:172.21.15.26:3300/0 conn(0x7f63ec131d10 0x7f63ec139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:15.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.539+0000 7f63f0ef7700 1 --2- 172.21.15.26:0/1451947796 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f63ec06a770 0x7f63ec06ab40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f63e00098f0 tx=0x7f63e0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8096a2a64102fef server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:15.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.540+0000 7f63eb7fe700 1 -- 172.21.15.26:0/1451947796 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e0011830 con 0x7f63ec06a770 2023-10-01T07:57:15.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.540+0000 7f63eb7fe700 1 -- 172.21.15.26:0/1451947796 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e0011990 con 0x7f63ec06a770 2023-10-01T07:57:15.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.540+0000 7f63eb7fe700 1 -- 172.21.15.26:0/1451947796 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e0011d20 con 0x7f63ec06a770 2023-10-01T07:57:15.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.540+0000 7f63f315b700 1 -- 172.21.15.26:0/1451947796 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f63ec06a770 msgr2=0x7f63ec06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:15.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.540+0000 7f63f315b700 1 --2- 172.21.15.26:0/1451947796 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f63ec06a770 0x7f63ec06ab40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f63e00098f0 tx=0x7f63e0009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:15.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.540+0000 7f63f315b700 1 -- 172.21.15.26:0/1451947796 shutdown_connections 2023-10-01T07:57:15.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.540+0000 7f63f315b700 1 --2- 172.21.15.26:0/1451947796 >> v2:172.21.15.26:3300/0 conn(0x7f63ec131d10 0x7f63ec139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:15.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.540+0000 7f63f315b700 1 --2- 172.21.15.26:0/1451947796 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f63ec06a770 0x7f63ec06ab40 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:15.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.540+0000 7f63f315b700 1 -- 172.21.15.26:0/1451947796 >> 172.21.15.26:0/1451947796 conn(0x7f63ec066f50 msgr2=0x7f63ec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:15.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.540+0000 7f63f315b700 1 -- 172.21.15.26:0/1451947796 shutdown_connections 2023-10-01T07:57:15.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.540+0000 7f63f315b700 1 -- 172.21.15.26:0/1451947796 wait complete. 2023-10-01T07:57:15.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.542+0000 7f63f315b700 1 Processor -- start 2023-10-01T07:57:15.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.542+0000 7f63f315b700 1 -- start start 2023-10-01T07:57:15.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.543+0000 7f63f315b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f63ec06a770 0x7f63ec120fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:15.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.543+0000 7f63f315b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63ec06b080 0x7f63ec121500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:15.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.543+0000 7f63f315b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f63ec131d10 0x7f63ec1c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:15.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.543+0000 7f63f315b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec124030 con 0x7f63ec06b080 2023-10-01T07:57:15.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.543+0000 7f63f315b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec122bd0 con 0x7f63ec06a770 2023-10-01T07:57:15.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.543+0000 7f63f315b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec124210 con 0x7f63ec131d10 2023-10-01T07:57:15.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.543+0000 7f63f0ef7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f63ec06a770 0x7f63ec120fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:15.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.543+0000 7f63ebfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63ec06b080 0x7f63ec121500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:15.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.543+0000 7f63f0ef7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f63ec06a770 0x7f63ec120fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45862/0 (socket says 172.21.15.26:45862) 2023-10-01T07:57:15.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.543+0000 7f63f0ef7700 1 -- 172.21.15.26:0/885272607 learned_addr learned my addr 172.21.15.26:0/885272607 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:15.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.543+0000 7f63f16f8700 1 --2- 172.21.15.26:0/885272607 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f63ec131d10 0x7f63ec1c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:15.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.543+0000 7f63ebfff700 1 -- 172.21.15.26:0/885272607 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f63ec131d10 msgr2=0x7f63ec1c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:15.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.543+0000 7f63ebfff700 1 --2- 172.21.15.26:0/885272607 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f63ec131d10 0x7f63ec1c60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:15.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.543+0000 7f63ebfff700 1 -- 172.21.15.26:0/885272607 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f63ec06a770 msgr2=0x7f63ec120fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:15.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.543+0000 7f63ebfff700 1 --2- 172.21.15.26:0/885272607 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f63ec06a770 0x7f63ec120fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:15.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.543+0000 7f63ebfff700 1 -- 172.21.15.26:0/885272607 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e4009a70 con 0x7f63ec06b080 2023-10-01T07:57:15.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.543+0000 7f63f0ef7700 1 --2- 172.21.15.26:0/885272607 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f63ec06a770 0x7f63ec120fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:15.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.544+0000 7f63ebfff700 1 --2- 172.21.15.26:0/885272607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63ec06b080 0x7f63ec121500 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f63d8000f60 tx=0x7f63d800c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:15.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.544+0000 7f63e97fa700 1 -- 172.21.15.26:0/885272607 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d80052d0 con 0x7f63ec06b080 2023-10-01T07:57:15.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.544+0000 7f63e97fa700 1 -- 172.21.15.26:0/885272607 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d8005430 con 0x7f63ec06b080 2023-10-01T07:57:15.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.544+0000 7f63f315b700 1 -- 172.21.15.26:0/885272607 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e0009550 con 0x7f63ec06b080 2023-10-01T07:57:15.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.544+0000 7f63e97fa700 1 -- 172.21.15.26:0/885272607 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d80038c0 con 0x7f63ec06b080 2023-10-01T07:57:15.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.544+0000 7f63f315b700 1 -- 172.21.15.26:0/885272607 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63ec131650 con 0x7f63ec06b080 2023-10-01T07:57:15.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.545+0000 7f63e97fa700 1 -- 172.21.15.26:0/885272607 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f63d8003a20 con 0x7f63ec06b080 2023-10-01T07:57:15.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.545+0000 7f63e97fa700 1 -- 172.21.15.26:0/885272607 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f63d803ea50 con 0x7f63ec06b080 2023-10-01T07:57:15.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.545+0000 7f63f315b700 1 -- 172.21.15.26:0/885272607 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63ec074ea0 con 0x7f63ec06b080 2023-10-01T07:57:15.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.550+0000 7f63e97fa700 1 -- 172.21.15.26:0/885272607 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f63d8017080 con 0x7f63ec06b080 2023-10-01T07:57:15.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.658+0000 7fcb13116700 1 -- 172.21.15.26:0/2732128177 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcb0c06b250 con 0x7fcb0c133420 2023-10-01T07:57:15.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.658+0000 7fcb097fa700 1 -- 172.21.15.26:0/2732128177 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcafc021020 con 0x7fcb0c133420 2023-10-01T07:57:15.659 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:15.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.662+0000 7fcb13116700 1 -- 172.21.15.26:0/2732128177 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb0c133420 msgr2=0x7fcb0c09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:15.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.662+0000 7fcb13116700 1 --2- 172.21.15.26:0/2732128177 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb0c133420 0x7fcb0c09c480 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fcafc00e900 tx=0x7fcafc00ec10 comp rx=0 tx=0).stop 2023-10-01T07:57:15.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.662+0000 7fcb13116700 1 -- 172.21.15.26:0/2732128177 shutdown_connections 2023-10-01T07:57:15.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.662+0000 7fcb13116700 1 --2- 172.21.15.26:0/2732128177 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb0c134260 0x7fcb0c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:15.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.662+0000 7fcb13116700 1 --2- 172.21.15.26:0/2732128177 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb0c133420 0x7fcb0c09c480 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:15.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.662+0000 7fcb13116700 1 --2- 172.21.15.26:0/2732128177 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb0c133e30 0x7fcb0c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:15.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.662+0000 7fcb13116700 1 -- 172.21.15.26:0/2732128177 >> 172.21.15.26:0/2732128177 conn(0x7fcb0c0a4210 msgr2=0x7fcb0c0a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:15.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.662+0000 7fcb13116700 1 -- 172.21.15.26:0/2732128177 shutdown_connections 2023-10-01T07:57:15.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.662+0000 7fcb13116700 1 -- 172.21.15.26:0/2732128177 wait complete. 2023-10-01T07:57:15.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:15.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.718+0000 7f9df2f50700 1 -- 172.21.15.26:0/1108416753 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9dec072980 con 0x7f9dec09d630 2023-10-01T07:57:15.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.718+0000 7f9de97fa700 1 -- 172.21.15.26:0/1108416753 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9de0024470 con 0x7f9dec09d630 2023-10-01T07:57:15.719 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:15.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.721+0000 7f9df2f50700 1 -- 172.21.15.26:0/1108416753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dec09d630 msgr2=0x7f9dec11f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:15.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.721+0000 7f9df2f50700 1 --2- 172.21.15.26:0/1108416753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dec09d630 0x7f9dec11f6d0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f9de0009c40 tx=0x7f9de0004750 comp rx=0 tx=0).stop 2023-10-01T07:57:15.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.721+0000 7f9df2f50700 1 -- 172.21.15.26:0/1108416753 shutdown_connections 2023-10-01T07:57:15.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.721+0000 7f9df2f50700 1 --2- 172.21.15.26:0/1108416753 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9dec133930 0x7f9dec1c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:15.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.721+0000 7f9df2f50700 1 --2- 172.21.15.26:0/1108416753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dec09d630 0x7f9dec11f6d0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:15.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.721+0000 7f9df2f50700 1 --2- 172.21.15.26:0/1108416753 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9dec0a0a30 0x7f9dec1c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:15.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.721+0000 7f9df2f50700 1 -- 172.21.15.26:0/1108416753 >> 172.21.15.26:0/1108416753 conn(0x7f9dec0a3050 msgr2=0x7f9dec1bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:15.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.721+0000 7f9df2f50700 1 -- 172.21.15.26:0/1108416753 shutdown_connections 2023-10-01T07:57:15.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.721+0000 7f9df2f50700 1 -- 172.21.15.26:0/1108416753 wait complete. 2023-10-01T07:57:15.735 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:15.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.768+0000 7f63f315b700 1 -- 172.21.15.26:0/885272607 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f63ec122830 con 0x7f63ec06b080 2023-10-01T07:57:15.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.768+0000 7f63e97fa700 1 -- 172.21.15.26:0/885272607 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f63d8019b40 con 0x7f63ec06b080 2023-10-01T07:57:15.769 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:15.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.770+0000 7f63f315b700 1 -- 172.21.15.26:0/885272607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63ec06b080 msgr2=0x7f63ec121500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:15.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.770+0000 7f63f315b700 1 --2- 172.21.15.26:0/885272607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63ec06b080 0x7f63ec121500 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f63d8000f60 tx=0x7f63d800c730 comp rx=0 tx=0).stop 2023-10-01T07:57:15.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.771+0000 7f63f315b700 1 -- 172.21.15.26:0/885272607 shutdown_connections 2023-10-01T07:57:15.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.771+0000 7f63f315b700 1 --2- 172.21.15.26:0/885272607 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f63ec131d10 0x7f63ec1c60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:15.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.771+0000 7f63f315b700 1 --2- 172.21.15.26:0/885272607 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f63ec06a770 0x7f63ec120fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:15.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.771+0000 7f63f315b700 1 --2- 172.21.15.26:0/885272607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63ec06b080 0x7f63ec121500 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:15.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.771+0000 7f63f315b700 1 -- 172.21.15.26:0/885272607 >> 172.21.15.26:0/885272607 conn(0x7f63ec066f50 msgr2=0x7f63ec0a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:15.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.771+0000 7f63f315b700 1 -- 172.21.15.26:0/885272607 shutdown_connections 2023-10-01T07:57:15.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:15.771+0000 7f63f315b700 1 -- 172.21.15.26:0/885272607 wait complete. 2023-10-01T07:57:15.784 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:16.067 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:16.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.213+0000 7f5d3ae55700 1 Processor -- start 2023-10-01T07:57:16.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.214+0000 7f5d3ae55700 1 -- start start 2023-10-01T07:57:16.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.214+0000 7f5d3ae55700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5d3412c9a0 0x7f5d3412cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:16.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.214+0000 7f5d3ae55700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5d3412f880 0x7f5d3412fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:16.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.214+0000 7f5d3ae55700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5d341301b0 0x7f5d34136c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:16.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.214+0000 7f5d3ae55700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d3409a420 con 0x7f5d3412f880 2023-10-01T07:57:16.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.214+0000 7f5d3ae55700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3409a870 con 0x7f5d341301b0 2023-10-01T07:57:16.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.214+0000 7f5d3ae55700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3409b890 con 0x7f5d3412c9a0 2023-10-01T07:57:16.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.214+0000 7f5d38bf1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5d3412c9a0 0x7f5d3412cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:16.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.215+0000 7f5d393f2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5d341301b0 0x7f5d34136c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:16.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.214+0000 7f5d33fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5d3412f880 0x7f5d3412fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:16.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.215+0000 7f5d38bf1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5d3412c9a0 0x7f5d3412cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49550/0 (socket says 172.21.15.26:49550) 2023-10-01T07:57:16.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.215+0000 7f5d38bf1700 1 -- 172.21.15.26:0/3001560641 learned_addr learned my addr 172.21.15.26:0/3001560641 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:16.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.215+0000 7f5d38bf1700 1 -- 172.21.15.26:0/3001560641 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5d341301b0 msgr2=0x7f5d34136c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:16.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.215+0000 7f5d38bf1700 1 --2- 172.21.15.26:0/3001560641 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5d341301b0 0x7f5d34136c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:16.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.215+0000 7f5d38bf1700 1 -- 172.21.15.26:0/3001560641 >> v2:172.21.15.26:3300/0 conn(0x7f5d3412f880 msgr2=0x7f5d3412fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:16.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.215+0000 7f5d38bf1700 1 --2- 172.21.15.26:0/3001560641 >> v2:172.21.15.26:3300/0 conn(0x7f5d3412f880 0x7f5d3412fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:16.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.215+0000 7f5d38bf1700 1 -- 172.21.15.26:0/3001560641 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d3409b2f0 con 0x7f5d3412c9a0 2023-10-01T07:57:16.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.215+0000 7f5d33fff700 1 --2- 172.21.15.26:0/3001560641 >> v2:172.21.15.26:3300/0 conn(0x7f5d3412f880 0x7f5d3412fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:16.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.215+0000 7f5d393f2700 1 --2- 172.21.15.26:0/3001560641 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5d341301b0 0x7f5d34136c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:16.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.215+0000 7f5d38bf1700 1 --2- 172.21.15.26:0/3001560641 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5d3412c9a0 0x7f5d3412cd70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5d240098f0 tx=0x7f5d24009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ad1383dd0425915 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:16.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.215+0000 7f5d337fe700 1 -- 172.21.15.26:0/3001560641 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d24011830 con 0x7f5d3412c9a0 2023-10-01T07:57:16.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.215+0000 7f5d337fe700 1 -- 172.21.15.26:0/3001560641 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d24011990 con 0x7f5d3412c9a0 2023-10-01T07:57:16.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.215+0000 7f5d337fe700 1 -- 172.21.15.26:0/3001560641 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d24011d20 con 0x7f5d3412c9a0 2023-10-01T07:57:16.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.216+0000 7f5d3ae55700 1 -- 172.21.15.26:0/3001560641 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5d3412c9a0 msgr2=0x7f5d3412cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:16.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.216+0000 7f5d3ae55700 1 --2- 172.21.15.26:0/3001560641 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5d3412c9a0 0x7f5d3412cd70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5d240098f0 tx=0x7f5d24009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:16.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.216+0000 7f5d3ae55700 1 -- 172.21.15.26:0/3001560641 shutdown_connections 2023-10-01T07:57:16.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.216+0000 7f5d3ae55700 1 --2- 172.21.15.26:0/3001560641 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5d341301b0 0x7f5d34136c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:16.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.216+0000 7f5d3ae55700 1 --2- 172.21.15.26:0/3001560641 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5d3412c9a0 0x7f5d3412cd70 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:16.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.216+0000 7f5d3ae55700 1 --2- 172.21.15.26:0/3001560641 >> v2:172.21.15.26:3300/0 conn(0x7f5d3412f880 0x7f5d3412fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:16.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.216+0000 7f5d3ae55700 1 -- 172.21.15.26:0/3001560641 >> 172.21.15.26:0/3001560641 conn(0x7f5d340a2360 msgr2=0x7f5d340a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:16.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.216+0000 7f5d3ae55700 1 -- 172.21.15.26:0/3001560641 shutdown_connections 2023-10-01T07:57:16.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.216+0000 7f5d3ae55700 1 -- 172.21.15.26:0/3001560641 wait complete. 2023-10-01T07:57:16.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.217+0000 7f5d3ae55700 1 Processor -- start 2023-10-01T07:57:16.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.217+0000 7f5d3ae55700 1 -- start start 2023-10-01T07:57:16.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.218+0000 7f5d3ae55700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5d3412c9a0 0x7f5d341c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:16.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.218+0000 7f5d3ae55700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d3412f880 0x7f5d341c6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:16.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.218+0000 7f5d3ae55700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5d341301b0 0x7f5d341c6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:16.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.218+0000 7f5d3ae55700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3408b200 con 0x7f5d3412f880 2023-10-01T07:57:16.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.218+0000 7f5d3ae55700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3409ad80 con 0x7f5d3412c9a0 2023-10-01T07:57:16.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.218+0000 7f5d3ae55700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3408c380 con 0x7f5d341301b0 2023-10-01T07:57:16.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.218+0000 7f5d38bf1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5d3412c9a0 0x7f5d341c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:16.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.218+0000 7f5d38bf1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5d3412c9a0 0x7f5d341c5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45884/0 (socket says 172.21.15.26:45884) 2023-10-01T07:57:16.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.218+0000 7f5d38bf1700 1 -- 172.21.15.26:0/1654056806 learned_addr learned my addr 172.21.15.26:0/1654056806 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:16.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.218+0000 7f5d33fff700 1 --2- 172.21.15.26:0/1654056806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d3412f880 0x7f5d341c6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:16.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.219+0000 7f5d393f2700 1 --2- 172.21.15.26:0/1654056806 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5d341301b0 0x7f5d341c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:16.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.219+0000 7f5d38bf1700 1 -- 172.21.15.26:0/1654056806 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5d341301b0 msgr2=0x7f5d341c6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:16.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.219+0000 7f5d38bf1700 1 --2- 172.21.15.26:0/1654056806 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5d341301b0 0x7f5d341c6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:16.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.219+0000 7f5d38bf1700 1 -- 172.21.15.26:0/1654056806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d3412f880 msgr2=0x7f5d341c6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:16.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.219+0000 7f5d38bf1700 1 --2- 172.21.15.26:0/1654056806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d3412f880 0x7f5d341c6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:16.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.219+0000 7f5d38bf1700 1 -- 172.21.15.26:0/1654056806 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d2800a5b0 con 0x7f5d3412c9a0 2023-10-01T07:57:16.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.219+0000 7f5d38bf1700 1 --2- 172.21.15.26:0/1654056806 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5d3412c9a0 0x7f5d341c5ec0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5d24000c00 tx=0x7f5d24004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:16.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.219+0000 7f5d317fa700 1 -- 172.21.15.26:0/1654056806 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d24004240 con 0x7f5d3412c9a0 2023-10-01T07:57:16.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.219+0000 7f5d317fa700 1 -- 172.21.15.26:0/1654056806 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2401f070 con 0x7f5d3412c9a0 2023-10-01T07:57:16.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.219+0000 7f5d3ae55700 1 -- 172.21.15.26:0/1654056806 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d2c009a70 con 0x7f5d3412c9a0 2023-10-01T07:57:16.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.219+0000 7f5d317fa700 1 -- 172.21.15.26:0/1654056806 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d240045c0 con 0x7f5d3412c9a0 2023-10-01T07:57:16.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.219+0000 7f5d3ae55700 1 -- 172.21.15.26:0/1654056806 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d24009550 con 0x7f5d3412c9a0 2023-10-01T07:57:16.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.220+0000 7f5d317fa700 1 -- 172.21.15.26:0/1654056806 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5d24021030 con 0x7f5d3412c9a0 2023-10-01T07:57:16.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.220+0000 7f5d317fa700 1 -- 172.21.15.26:0/1654056806 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5d240406d0 con 0x7f5d3412c9a0 2023-10-01T07:57:16.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.220+0000 7f5d3ae55700 1 -- 172.21.15.26:0/1654056806 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d3412aec0 con 0x7f5d3412c9a0 2023-10-01T07:57:16.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.225+0000 7f5d317fa700 1 -- 172.21.15.26:0/1654056806 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5d3412aec0 con 0x7f5d3412c9a0 2023-10-01T07:57:16.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.431+0000 7f5d3ae55700 1 -- 172.21.15.26:0/1654056806 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5d3412aec0 con 0x7f5d3412c9a0 2023-10-01T07:57:16.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.431+0000 7f5d317fa700 1 -- 172.21.15.26:0/1654056806 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5d3412aec0 con 0x7f5d3412c9a0 2023-10-01T07:57:16.432 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:16.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.433+0000 7f5d3ae55700 1 -- 172.21.15.26:0/1654056806 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5d3412c9a0 msgr2=0x7f5d341c5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:16.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.433+0000 7f5d3ae55700 1 --2- 172.21.15.26:0/1654056806 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5d3412c9a0 0x7f5d341c5ec0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5d24000c00 tx=0x7f5d24004750 comp rx=0 tx=0).stop 2023-10-01T07:57:16.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.434+0000 7f5d3ae55700 1 -- 172.21.15.26:0/1654056806 shutdown_connections 2023-10-01T07:57:16.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.434+0000 7f5d3ae55700 1 --2- 172.21.15.26:0/1654056806 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5d341301b0 0x7f5d341c6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:16.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.434+0000 7f5d3ae55700 1 --2- 172.21.15.26:0/1654056806 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5d3412c9a0 0x7f5d341c5ec0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:16.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.434+0000 7f5d3ae55700 1 --2- 172.21.15.26:0/1654056806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d3412f880 0x7f5d341c6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:16.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.434+0000 7f5d3ae55700 1 -- 172.21.15.26:0/1654056806 >> 172.21.15.26:0/1654056806 conn(0x7f5d340a2360 msgr2=0x7f5d34072190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:16.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.434+0000 7f5d3ae55700 1 -- 172.21.15.26:0/1654056806 shutdown_connections 2023-10-01T07:57:16.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.434+0000 7f5d3ae55700 1 -- 172.21.15.26:0/1654056806 wait complete. 2023-10-01T07:57:16.448 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:16.682 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:16.736 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:16.786 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:16.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.832+0000 7f39435b8700 1 Processor -- start 2023-10-01T07:57:16.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.832+0000 7f39435b8700 1 -- start start 2023-10-01T07:57:16.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.833+0000 7f39435b8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f393c133420 0x7f393c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:16.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.833+0000 7f39435b8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f393c134260 0x7f393c1306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:16.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.833+0000 7f39435b8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f393c06b990 con 0x7f393c133e30 2023-10-01T07:57:16.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.833+0000 7f39435b8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f393c0a0590 con 0x7f393c134260 2023-10-01T07:57:16.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.833+0000 7f39435b8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f393c09fb80 con 0x7f393c133420 2023-10-01T07:57:16.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.833+0000 7f3941354700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f393c133420 0x7f393c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:16.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.833+0000 7f3941354700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f393c133420 0x7f393c1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49572/0 (socket says 172.21.15.26:49572) 2023-10-01T07:57:16.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.833+0000 7f3941b55700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f393c134260 0x7f393c1306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:16.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.833+0000 7f3941354700 1 -- 172.21.15.26:0/3837255502 learned_addr learned my addr 172.21.15.26:0/3837255502 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:16.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.833+0000 7f3941b55700 1 -- 172.21.15.26:0/3837255502 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f393c133420 msgr2=0x7f393c1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:16.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.833+0000 7f3941b55700 1 --2- 172.21.15.26:0/3837255502 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f393c133420 0x7f393c1337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:16.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.833+0000 7f3941b55700 1 -- 172.21.15.26:0/3837255502 >> v1:172.21.15.26:6789/0 conn(0x7f393c133e30 legacy=0x7f393c12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:16.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.833+0000 7f3941b55700 1 -- 172.21.15.26:0/3837255502 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f393c0a0030 con 0x7f393c134260 2023-10-01T07:57:16.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.833+0000 7f3941354700 1 --2- 172.21.15.26:0/3837255502 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f393c133420 0x7f393c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:16.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.834+0000 7f3941b55700 1 --2- 172.21.15.26:0/3837255502 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f393c134260 0x7f393c1306a0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f3934009d90 tx=0x7f393400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc5ac6ede60c1931 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:16.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.834+0000 7f3933fff700 1 -- 172.21.15.26:0/3837255502 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393400e070 con 0x7f393c134260 2023-10-01T07:57:16.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.834+0000 7f3933fff700 1 -- 172.21.15.26:0/3837255502 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393400bb20 con 0x7f393c134260 2023-10-01T07:57:16.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.834+0000 7f3933fff700 1 -- 172.21.15.26:0/3837255502 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3934012430 con 0x7f393c134260 2023-10-01T07:57:16.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.835+0000 7f39435b8700 1 -- 172.21.15.26:0/3837255502 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f393c134260 msgr2=0x7f393c1306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:16.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.835+0000 7f39435b8700 1 --2- 172.21.15.26:0/3837255502 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f393c134260 0x7f393c1306a0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f3934009d90 tx=0x7f393400b330 comp rx=0 tx=0).stop 2023-10-01T07:57:16.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.835+0000 7f39435b8700 1 -- 172.21.15.26:0/3837255502 shutdown_connections 2023-10-01T07:57:16.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.835+0000 7f39435b8700 1 --2- 172.21.15.26:0/3837255502 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f393c134260 0x7f393c1306a0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:16.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.835+0000 7f39435b8700 1 --2- 172.21.15.26:0/3837255502 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f393c133420 0x7f393c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:16.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.835+0000 7f39435b8700 1 -- 172.21.15.26:0/3837255502 >> 172.21.15.26:0/3837255502 conn(0x7f393c0a4210 msgr2=0x7f393c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:16.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.835+0000 7f39435b8700 1 -- 172.21.15.26:0/3837255502 shutdown_connections 2023-10-01T07:57:16.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.835+0000 7f39435b8700 1 -- 172.21.15.26:0/3837255502 wait complete. 2023-10-01T07:57:16.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.836+0000 7f39435b8700 1 Processor -- start 2023-10-01T07:57:16.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.836+0000 7f39435b8700 1 -- start start 2023-10-01T07:57:16.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.837+0000 7f39435b8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f393c133420 0x7f393c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:16.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.837+0000 7f39435b8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f393c133e30 0x7f393c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:16.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.837+0000 7f39435b8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f393c134260 0x7f393c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:16.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.837+0000 7f39435b8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393c1202f0 con 0x7f393c133420 2023-10-01T07:57:16.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.837+0000 7f39435b8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393c12da20 con 0x7f393c134260 2023-10-01T07:57:16.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.837+0000 7f39435b8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f393c11ff20 con 0x7f393c133e30 2023-10-01T07:57:16.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.837+0000 7f3941354700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f393c133420 0x7f393c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:16.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.837+0000 7f3941354700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f393c133420 0x7f393c09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55204/0 (socket says 172.21.15.26:55204) 2023-10-01T07:57:16.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.837+0000 7f3941354700 1 -- 172.21.15.26:0/1963052685 learned_addr learned my addr 172.21.15.26:0/1963052685 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:16.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.837+0000 7f3940b53700 1 --2- 172.21.15.26:0/1963052685 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f393c133e30 0x7f393c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:16.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.837+0000 7f3941354700 1 -- 172.21.15.26:0/1963052685 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f393c133e30 msgr2=0x7f393c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:16.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.837+0000 7f3941354700 1 --2- 172.21.15.26:0/1963052685 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f393c133e30 0x7f393c09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:16.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.837+0000 7f3941354700 1 -- 172.21.15.26:0/1963052685 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f393c134260 msgr2=0x7f393c09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:16.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.837+0000 7f3941354700 1 --2- 172.21.15.26:0/1963052685 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f393c134260 0x7f393c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:16.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.837+0000 7f3941354700 1 -- 172.21.15.26:0/1963052685 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3938009550 con 0x7f393c133420 2023-10-01T07:57:16.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.837+0000 7f3940b53700 1 --2- 172.21.15.26:0/1963052685 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f393c133e30 0x7f393c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:16.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.837+0000 7f3941354700 1 --2- 172.21.15.26:0/1963052685 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f393c133420 0x7f393c09c480 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f393800ec10 tx=0x7f393800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:16.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.837+0000 7f3931ffb700 1 -- 172.21.15.26:0/1963052685 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393800c850 con 0x7f393c133420 2023-10-01T07:57:16.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.837+0000 7f3931ffb700 1 -- 172.21.15.26:0/1963052685 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393800c9b0 con 0x7f393c133420 2023-10-01T07:57:16.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.837+0000 7f39435b8700 1 -- 172.21.15.26:0/1963052685 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3934009a70 con 0x7f393c133420 2023-10-01T07:57:16.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.838+0000 7f3931ffb700 1 -- 172.21.15.26:0/1963052685 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393800cd20 con 0x7f393c133420 2023-10-01T07:57:16.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.838+0000 7f39435b8700 1 -- 172.21.15.26:0/1963052685 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f393c09ddb0 con 0x7f393c133420 2023-10-01T07:57:16.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.839+0000 7f39435b8700 1 -- 172.21.15.26:0/1963052685 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f393c074ea0 con 0x7f393c133420 2023-10-01T07:57:16.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.839+0000 7f3931ffb700 1 -- 172.21.15.26:0/1963052685 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3938013470 con 0x7f393c133420 2023-10-01T07:57:16.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.839+0000 7f3931ffb700 1 -- 172.21.15.26:0/1963052685 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f393803f6a0 con 0x7f393c133420 2023-10-01T07:57:16.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.844+0000 7f3931ffb700 1 -- 172.21.15.26:0/1963052685 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f393800ce80 con 0x7f393c133420 2023-10-01T07:57:16.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.884+0000 7fec62755700 1 Processor -- start 2023-10-01T07:57:16.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.884+0000 7fec62755700 1 -- start start 2023-10-01T07:57:16.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.885+0000 7fec62755700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fec5c0a0a30 0x7fec5c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:16.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.885+0000 7fec62755700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fec5c09d630 0x7fec5c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:16.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.885+0000 7fec62755700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fec5c133930 0x7fec5c133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:16.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.885+0000 7fec62755700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec5c0a2a70 con 0x7fec5c09d630 2023-10-01T07:57:16.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.885+0000 7fec62755700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c0a01d0 con 0x7fec5c0a0a30 2023-10-01T07:57:16.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.885+0000 7fec62755700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c09e2b0 con 0x7fec5c133930 2023-10-01T07:57:16.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.885+0000 7fec5b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fec5c09d630 0x7fec5c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:16.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.885+0000 7fec5bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fec5c0a0a30 0x7fec5c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:16.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.885+0000 7fec5bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fec5c0a0a30 0x7fec5c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45888/0 (socket says 172.21.15.26:45888) 2023-10-01T07:57:16.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.885+0000 7fec5b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fec5c09d630 0x7fec5c0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55208/0 (socket says 172.21.15.26:55208) 2023-10-01T07:57:16.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.885+0000 7fec5bfff700 1 -- 172.21.15.26:0/3588375140 learned_addr learned my addr 172.21.15.26:0/3588375140 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:16.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.885+0000 7fec60cf2700 1 --2- 172.21.15.26:0/3588375140 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fec5c133930 0x7fec5c133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:16.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.885+0000 7fec5b7fe700 1 -- 172.21.15.26:0/3588375140 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fec5c133930 msgr2=0x7fec5c133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:16.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.885+0000 7fec5b7fe700 1 --2- 172.21.15.26:0/3588375140 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fec5c133930 0x7fec5c133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:16.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.885+0000 7fec5b7fe700 1 -- 172.21.15.26:0/3588375140 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fec5c0a0a30 msgr2=0x7fec5c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:16.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.885+0000 7fec5b7fe700 1 --2- 172.21.15.26:0/3588375140 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fec5c0a0a30 0x7fec5c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:16.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.885+0000 7fec5b7fe700 1 -- 172.21.15.26:0/3588375140 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5c09dc50 con 0x7fec5c09d630 2023-10-01T07:57:16.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.885+0000 7fec5bfff700 1 --2- 172.21.15.26:0/3588375140 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fec5c0a0a30 0x7fec5c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:16.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.886+0000 7fec5b7fe700 1 --2- 172.21.15.26:0/3588375140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec5c09d630 0x7fec5c0a1340 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fec50009840 tx=0x7fec50009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60caaabaaff474f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:16.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.886+0000 7fec5affd700 1 -- 172.21.15.26:0/3588375140 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec50011830 con 0x7fec5c09d630 2023-10-01T07:57:16.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.886+0000 7fec5affd700 1 -- 172.21.15.26:0/3588375140 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec50011990 con 0x7fec5c09d630 2023-10-01T07:57:16.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.886+0000 7fec5affd700 1 -- 172.21.15.26:0/3588375140 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec50011d20 con 0x7fec5c09d630 2023-10-01T07:57:16.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.887+0000 7fec62755700 1 -- 172.21.15.26:0/3588375140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec5c09d630 msgr2=0x7fec5c0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:16.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.887+0000 7fec62755700 1 --2- 172.21.15.26:0/3588375140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec5c09d630 0x7fec5c0a1340 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fec50009840 tx=0x7fec50009b50 comp rx=0 tx=0).stop 2023-10-01T07:57:16.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.887+0000 7fec62755700 1 -- 172.21.15.26:0/3588375140 shutdown_connections 2023-10-01T07:57:16.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.887+0000 7fec62755700 1 --2- 172.21.15.26:0/3588375140 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fec5c133930 0x7fec5c133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:16.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.887+0000 7fec62755700 1 --2- 172.21.15.26:0/3588375140 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fec5c0a0a30 0x7fec5c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:16.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.887+0000 7fec62755700 1 --2- 172.21.15.26:0/3588375140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec5c09d630 0x7fec5c0a1340 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:16.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.887+0000 7fec62755700 1 -- 172.21.15.26:0/3588375140 >> 172.21.15.26:0/3588375140 conn(0x7fec5c0a3050 msgr2=0x7fec5c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:16.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.887+0000 7fec62755700 1 -- 172.21.15.26:0/3588375140 shutdown_connections 2023-10-01T07:57:16.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.887+0000 7fec62755700 1 -- 172.21.15.26:0/3588375140 wait complete. 2023-10-01T07:57:16.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.888+0000 7fec62755700 1 Processor -- start 2023-10-01T07:57:16.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.888+0000 7fec62755700 1 -- start start 2023-10-01T07:57:16.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.889+0000 7fec62755700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec5c09d630 0x7fec5c1210d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:16.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.889+0000 7fec62755700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fec5c0a0a30 0x7fec5c121610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:16.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.889+0000 7fec62755700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fec5c133930 0x7fec5c121b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:16.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.889+0000 7fec62755700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c124410 con 0x7fec5c09d630 2023-10-01T07:57:16.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.889+0000 7fec62755700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c125560 con 0x7fec5c0a0a30 2023-10-01T07:57:16.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.889+0000 7fec62755700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c122d30 con 0x7fec5c133930 2023-10-01T07:57:16.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.889+0000 7fec5bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec5c09d630 0x7fec5c1210d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:16.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.889+0000 7fec5b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fec5c0a0a30 0x7fec5c121610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:16.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.889+0000 7fec5bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec5c09d630 0x7fec5c1210d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55216/0 (socket says 172.21.15.26:55216) 2023-10-01T07:57:16.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.889+0000 7fec5bfff700 1 -- 172.21.15.26:0/1736527413 learned_addr learned my addr 172.21.15.26:0/1736527413 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:16.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.889+0000 7fec60cf2700 1 --2- 172.21.15.26:0/1736527413 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fec5c133930 0x7fec5c121b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:16.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.890+0000 7fec5bfff700 1 -- 172.21.15.26:0/1736527413 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fec5c133930 msgr2=0x7fec5c121b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:16.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.890+0000 7fec5bfff700 1 --2- 172.21.15.26:0/1736527413 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fec5c133930 0x7fec5c121b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:16.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.890+0000 7fec5bfff700 1 -- 172.21.15.26:0/1736527413 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fec5c0a0a30 msgr2=0x7fec5c121610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:16.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.890+0000 7fec5bfff700 1 --2- 172.21.15.26:0/1736527413 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fec5c0a0a30 0x7fec5c121610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:16.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.890+0000 7fec5bfff700 1 -- 172.21.15.26:0/1736527413 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4c009550 con 0x7fec5c09d630 2023-10-01T07:57:16.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.890+0000 7fec60cf2700 1 --2- 172.21.15.26:0/1736527413 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fec5c133930 0x7fec5c121b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:57:16.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.890+0000 7fec5b7fe700 1 --2- 172.21.15.26:0/1736527413 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fec5c0a0a30 0x7fec5c121610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:16.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.890+0000 7fec5bfff700 1 --2- 172.21.15.26:0/1736527413 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec5c09d630 0x7fec5c1210d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fec4c00ec10 tx=0x7fec4c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:16.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.890+0000 7fec58ff9700 1 -- 172.21.15.26:0/1736527413 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c00c850 con 0x7fec5c09d630 2023-10-01T07:57:16.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.890+0000 7fec58ff9700 1 -- 172.21.15.26:0/1736527413 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4c00c9b0 con 0x7fec5c09d630 2023-10-01T07:57:16.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.890+0000 7fec62755700 1 -- 172.21.15.26:0/1736527413 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec500094a0 con 0x7fec5c09d630 2023-10-01T07:57:16.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.890+0000 7fec58ff9700 1 -- 172.21.15.26:0/1736527413 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c00cd20 con 0x7fec5c09d630 2023-10-01T07:57:16.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.890+0000 7fec62755700 1 -- 172.21.15.26:0/1736527413 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec5c124920 con 0x7fec5c09d630 2023-10-01T07:57:16.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.891+0000 7fec58ff9700 1 -- 172.21.15.26:0/1736527413 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fec4c013470 con 0x7fec5c09d630 2023-10-01T07:57:16.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.891+0000 7fec58ff9700 1 -- 172.21.15.26:0/1736527413 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fec4c03f810 con 0x7fec5c09d630 2023-10-01T07:57:16.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.892+0000 7fec62755700 1 -- 172.21.15.26:0/1736527413 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec5c0747f0 con 0x7fec5c09d630 2023-10-01T07:57:16.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.897+0000 7fec58ff9700 1 -- 172.21.15.26:0/1736527413 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fec4c013720 con 0x7fec5c09d630 2023-10-01T07:57:16.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.940+0000 7f28c8071700 1 Processor -- start 2023-10-01T07:57:16.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.941+0000 7f28c8071700 1 -- start start 2023-10-01T07:57:16.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.941+0000 7f28c8071700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f28c0133420 0x7f28c01337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:16.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.941+0000 7f28c8071700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f28c0134260 0x7f28c01306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:16.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.941+0000 7f28c8071700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c006b990 con 0x7f28c0133e30 2023-10-01T07:57:16.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.941+0000 7f28c8071700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c00a0590 con 0x7f28c0133420 2023-10-01T07:57:16.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.941+0000 7f28c8071700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28c009fb80 con 0x7f28c0134260 2023-10-01T07:57:16.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.942+0000 7f28c660e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f28c0134260 0x7f28c01306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:16.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.942+0000 7f28c5e0d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f28c0133420 0x7f28c01337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:16.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.942+0000 7f28c660e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f28c0134260 0x7f28c01306a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49596/0 (socket says 172.21.15.26:49596) 2023-10-01T07:57:16.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.942+0000 7f28c5e0d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f28c0133420 0x7f28c01337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45916/0 (socket says 172.21.15.26:45916) 2023-10-01T07:57:16.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.942+0000 7f28c660e700 1 -- 172.21.15.26:0/2084093504 learned_addr learned my addr 172.21.15.26:0/2084093504 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:16.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.942+0000 7f28c5e0d700 1 -- 172.21.15.26:0/2084093504 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f28c0134260 msgr2=0x7f28c01306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:16.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.942+0000 7f28c5e0d700 1 --2- 172.21.15.26:0/2084093504 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f28c0134260 0x7f28c01306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:16.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.942+0000 7f28c5e0d700 1 -- 172.21.15.26:0/2084093504 >> v1:172.21.15.26:6789/0 conn(0x7f28c0133e30 legacy=0x7f28c012ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:16.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.942+0000 7f28c4e0b700 1 -- 172.21.15.26:0/2084093504 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2974440020 0 0) 0x7f28c006b990 con 0x7f28c0133e30 2023-10-01T07:57:16.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.942+0000 7f28c5e0d700 1 -- 172.21.15.26:0/2084093504 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c00a0030 con 0x7f28c0133420 2023-10-01T07:57:16.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.942+0000 7f28c660e700 1 --2- 172.21.15.26:0/2084093504 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f28c0134260 0x7f28c01306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:16.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.942+0000 7f28c5e0d700 1 --2- 172.21.15.26:0/2084093504 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f28c0133420 0x7f28c01337f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f28bc009870 tx=0x7f28bc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f05627620f1250fd server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:16.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.942+0000 7f28c4e0b700 1 -- 172.21.15.26:0/2084093504 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc011830 con 0x7f28c0133420 2023-10-01T07:57:16.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.942+0000 7f28c4e0b700 1 -- 172.21.15.26:0/2084093504 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28bc011990 con 0x7f28c0133420 2023-10-01T07:57:16.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.942+0000 7f28c4e0b700 1 -- 172.21.15.26:0/2084093504 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc011d20 con 0x7f28c0133420 2023-10-01T07:57:16.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.943+0000 7f28c8071700 1 -- 172.21.15.26:0/2084093504 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f28c0133420 msgr2=0x7f28c01337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:16.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.943+0000 7f28c8071700 1 --2- 172.21.15.26:0/2084093504 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f28c0133420 0x7f28c01337f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f28bc009870 tx=0x7f28bc009b80 comp rx=0 tx=0).stop 2023-10-01T07:57:16.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.943+0000 7f28c8071700 1 -- 172.21.15.26:0/2084093504 shutdown_connections 2023-10-01T07:57:16.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.943+0000 7f28c8071700 1 --2- 172.21.15.26:0/2084093504 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f28c0134260 0x7f28c01306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:16.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.943+0000 7f28c8071700 1 --2- 172.21.15.26:0/2084093504 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f28c0133420 0x7f28c01337f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:16.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.943+0000 7f28c8071700 1 -- 172.21.15.26:0/2084093504 >> 172.21.15.26:0/2084093504 conn(0x7f28c00a4210 msgr2=0x7f28c00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:16.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.943+0000 7f28c8071700 1 -- 172.21.15.26:0/2084093504 shutdown_connections 2023-10-01T07:57:16.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.943+0000 7f28c8071700 1 -- 172.21.15.26:0/2084093504 wait complete. 2023-10-01T07:57:16.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.944+0000 7f28c8071700 1 Processor -- start 2023-10-01T07:57:16.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.944+0000 7f28c8071700 1 -- start start 2023-10-01T07:57:16.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.945+0000 7f28c8071700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28c0133420 0x7f28c009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:16.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.945+0000 7f28c8071700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f28c0133e30 0x7f28c009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:16.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.945+0000 7f28c8071700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f28c0134260 0x7f28c009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:16.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.945+0000 7f28c8071700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c009deb0 con 0x7f28c0133420 2023-10-01T07:57:16.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.945+0000 7f28c8071700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c009dcc0 con 0x7f28c0134260 2023-10-01T07:57:16.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.945+0000 7f28c8071700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28c0131860 con 0x7f28c0133e30 2023-10-01T07:57:16.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.945+0000 7f28c5e0d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28c0133420 0x7f28c009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:16.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.945+0000 7f28c560c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f28c0133e30 0x7f28c009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:16.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.945+0000 7f28c5e0d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28c0133420 0x7f28c009c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55218/0 (socket says 172.21.15.26:55218) 2023-10-01T07:57:16.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.945+0000 7f28c5e0d700 1 -- 172.21.15.26:0/1936315275 learned_addr learned my addr 172.21.15.26:0/1936315275 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:16.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.945+0000 7f28c660e700 1 --2- 172.21.15.26:0/1936315275 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f28c0134260 0x7f28c009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:16.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.945+0000 7f28c560c700 1 -- 172.21.15.26:0/1936315275 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f28c0134260 msgr2=0x7f28c009cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:16.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.945+0000 7f28c560c700 1 --2- 172.21.15.26:0/1936315275 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f28c0134260 0x7f28c009cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:16.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.945+0000 7f28c560c700 1 -- 172.21.15.26:0/1936315275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28c0133420 msgr2=0x7f28c009c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:16.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.945+0000 7f28c560c700 1 --2- 172.21.15.26:0/1936315275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28c0133420 0x7f28c009c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:16.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.945+0000 7f28c560c700 1 -- 172.21.15.26:0/1936315275 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b8009b30 con 0x7f28c0133e30 2023-10-01T07:57:16.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.945+0000 7f28c560c700 1 --2- 172.21.15.26:0/1936315275 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f28c0133e30 0x7f28c009c9c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f28b000c430 tx=0x7f28b000c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:16.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.946+0000 7f28b67fc700 1 -- 172.21.15.26:0/1936315275 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b00052e0 con 0x7f28c0133e30 2023-10-01T07:57:16.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.946+0000 7f28b67fc700 1 -- 172.21.15.26:0/1936315275 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b0005460 con 0x7f28c0133e30 2023-10-01T07:57:16.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.946+0000 7f28b67fc700 1 -- 172.21.15.26:0/1936315275 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b00038c0 con 0x7f28c0133e30 2023-10-01T07:57:16.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.946+0000 7f28c8071700 1 -- 172.21.15.26:0/1936315275 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28bc0094a0 con 0x7f28c0133e30 2023-10-01T07:57:16.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.946+0000 7f28c8071700 1 -- 172.21.15.26:0/1936315275 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c011fe20 con 0x7f28c0133e30 2023-10-01T07:57:16.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.947+0000 7f28b67fc700 1 -- 172.21.15.26:0/1936315275 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f28b0003a20 con 0x7f28c0133e30 2023-10-01T07:57:16.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.947+0000 7f28c8071700 1 -- 172.21.15.26:0/1936315275 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c0074ea0 con 0x7f28c0133e30 2023-10-01T07:57:16.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.947+0000 7f28b67fc700 1 -- 172.21.15.26:0/1936315275 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f28b003e9b0 con 0x7f28c0133e30 2023-10-01T07:57:16.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:16.952+0000 7f28b67fc700 1 -- 172.21.15.26:0/1936315275 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f28b0017080 con 0x7f28c0133e30 2023-10-01T07:57:17.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.054+0000 7f39435b8700 1 -- 172.21.15.26:0/1963052685 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f393c09dd50 con 0x7f393c133420 2023-10-01T07:57:17.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.055+0000 7f3931ffb700 1 -- 172.21.15.26:0/1963052685 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f393801b3b0 con 0x7f393c133420 2023-10-01T07:57:17.099 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:17.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.057+0000 7f39435b8700 1 -- 172.21.15.26:0/1963052685 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f393c133420 msgr2=0x7f393c09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:17.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.057+0000 7f39435b8700 1 --2- 172.21.15.26:0/1963052685 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f393c133420 0x7f393c09c480 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f393800ec10 tx=0x7f393800ef20 comp rx=0 tx=0).stop 2023-10-01T07:57:17.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.057+0000 7f39435b8700 1 -- 172.21.15.26:0/1963052685 shutdown_connections 2023-10-01T07:57:17.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.057+0000 7f39435b8700 1 --2- 172.21.15.26:0/1963052685 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f393c134260 0x7f393c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:17.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.057+0000 7f39435b8700 1 --2- 172.21.15.26:0/1963052685 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f393c133420 0x7f393c09c480 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:17.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.057+0000 7f39435b8700 1 --2- 172.21.15.26:0/1963052685 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f393c133e30 0x7f393c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:17.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.057+0000 7f39435b8700 1 -- 172.21.15.26:0/1963052685 >> 172.21.15.26:0/1963052685 conn(0x7f393c0a4210 msgr2=0x7f393c0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:17.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.057+0000 7f39435b8700 1 -- 172.21.15.26:0/1963052685 shutdown_connections 2023-10-01T07:57:17.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.057+0000 7f39435b8700 1 -- 172.21.15.26:0/1963052685 wait complete. 2023-10-01T07:57:17.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:17.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.118+0000 7fec62755700 1 -- 172.21.15.26:0/1736527413 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fec5c072980 con 0x7fec5c09d630 2023-10-01T07:57:17.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.118+0000 7fec58ff9700 1 -- 172.21.15.26:0/1736527413 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fec4c021030 con 0x7fec5c09d630 2023-10-01T07:57:17.119 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:17.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.120+0000 7fec62755700 1 -- 172.21.15.26:0/1736527413 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec5c09d630 msgr2=0x7fec5c1210d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:17.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.120+0000 7fec62755700 1 --2- 172.21.15.26:0/1736527413 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec5c09d630 0x7fec5c1210d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fec4c00ec10 tx=0x7fec4c00ef20 comp rx=0 tx=0).stop 2023-10-01T07:57:17.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.120+0000 7fec62755700 1 -- 172.21.15.26:0/1736527413 shutdown_connections 2023-10-01T07:57:17.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.120+0000 7fec62755700 1 --2- 172.21.15.26:0/1736527413 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fec5c133930 0x7fec5c121b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:17.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.120+0000 7fec62755700 1 --2- 172.21.15.26:0/1736527413 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec5c09d630 0x7fec5c1210d0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:17.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.120+0000 7fec62755700 1 --2- 172.21.15.26:0/1736527413 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fec5c0a0a30 0x7fec5c121610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:17.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.120+0000 7fec62755700 1 -- 172.21.15.26:0/1736527413 >> 172.21.15.26:0/1736527413 conn(0x7fec5c0a3050 msgr2=0x7fec5c09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:17.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.120+0000 7fec62755700 1 -- 172.21.15.26:0/1736527413 shutdown_connections 2023-10-01T07:57:17.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.120+0000 7fec62755700 1 -- 172.21.15.26:0/1736527413 wait complete. 2023-10-01T07:57:17.135 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:17.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.158+0000 7f28c8071700 1 -- 172.21.15.26:0/1936315275 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f28c011fac0 con 0x7f28c0133e30 2023-10-01T07:57:17.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.159+0000 7f28b67fc700 1 -- 172.21.15.26:0/1936315275 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f28b0019b20 con 0x7f28c0133e30 2023-10-01T07:57:17.159 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:17.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.161+0000 7f28c8071700 1 -- 172.21.15.26:0/1936315275 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f28c0133e30 msgr2=0x7f28c009c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:17.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.161+0000 7f28c8071700 1 --2- 172.21.15.26:0/1936315275 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f28c0133e30 0x7f28c009c9c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f28b000c430 tx=0x7f28b000c740 comp rx=0 tx=0).stop 2023-10-01T07:57:17.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.161+0000 7f28c8071700 1 -- 172.21.15.26:0/1936315275 shutdown_connections 2023-10-01T07:57:17.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.161+0000 7f28c8071700 1 --2- 172.21.15.26:0/1936315275 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f28c0134260 0x7f28c009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:17.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.161+0000 7f28c8071700 1 --2- 172.21.15.26:0/1936315275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28c0133420 0x7f28c009c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:17.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.161+0000 7f28c8071700 1 --2- 172.21.15.26:0/1936315275 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f28c0133e30 0x7f28c009c9c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:17.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.161+0000 7f28c8071700 1 -- 172.21.15.26:0/1936315275 >> 172.21.15.26:0/1936315275 conn(0x7f28c00a4210 msgr2=0x7f28c00a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:17.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.161+0000 7f28c8071700 1 -- 172.21.15.26:0/1936315275 shutdown_connections 2023-10-01T07:57:17.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.161+0000 7f28c8071700 1 -- 172.21.15.26:0/1936315275 wait complete. 2023-10-01T07:57:17.175 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:17.449 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:17.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.594+0000 7f1d1a15b700 1 Processor -- start 2023-10-01T07:57:17.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.595+0000 7f1d1a15b700 1 -- start start 2023-10-01T07:57:17.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.595+0000 7f1d1a15b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1d141338a0 0x7f1d14133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:17.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.595+0000 7f1d1a15b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d1409de50 0x7f1d1409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:17.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.595+0000 7f1d1a15b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d1406ef30 con 0x7f1d1409e760 2023-10-01T07:57:17.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.595+0000 7f1d1a15b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d1406fef0 con 0x7f1d141338a0 2023-10-01T07:57:17.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.595+0000 7f1d1a15b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d141334b0 con 0x7f1d1409de50 2023-10-01T07:57:17.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.595+0000 7f1d137fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1d141338a0 0x7f1d14133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:17.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.595+0000 7f1d0affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d1409de50 0x7f1d1409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:17.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.595+0000 7f1d137fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1d141338a0 0x7f1d14133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55220/0 (socket says 172.21.15.26:55220) 2023-10-01T07:57:17.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.595+0000 7f1d0affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d1409de50 0x7f1d1409e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45934/0 (socket says 172.21.15.26:45934) 2023-10-01T07:57:17.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.595+0000 7f1d137fe700 1 -- 172.21.15.26:0/2201683664 learned_addr learned my addr 172.21.15.26:0/2201683664 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:17.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.596+0000 7f1d137fe700 1 -- 172.21.15.26:0/2201683664 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d1409de50 msgr2=0x7f1d1409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:17.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.596+0000 7f1d137fe700 1 --2- 172.21.15.26:0/2201683664 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d1409de50 0x7f1d1409e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:17.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.596+0000 7f1d137fe700 1 -- 172.21.15.26:0/2201683664 >> v1:172.21.15.26:6789/0 conn(0x7f1d1409e760 legacy=0x7f1d1413a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:17.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.596+0000 7f1d137fe700 1 -- 172.21.15.26:0/2201683664 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1406fc30 con 0x7f1d141338a0 2023-10-01T07:57:17.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.596+0000 7f1d12ffd700 1 -- 172.21.15.26:0/2201683664 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3430425827 0 0) 0x7f1d1406ef30 con 0x7f1d1409e760 2023-10-01T07:57:17.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.596+0000 7f1d0affd700 1 --2- 172.21.15.26:0/2201683664 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d1409de50 0x7f1d1409e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:17.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.596+0000 7f1d137fe700 1 --2- 172.21.15.26:0/2201683664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d141338a0 0x7f1d14133c70 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f1d040098f0 tx=0x7f1d04009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ba33c6e456e51 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:17.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.596+0000 7f1d12ffd700 1 -- 172.21.15.26:0/2201683664 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d04011830 con 0x7f1d141338a0 2023-10-01T07:57:17.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.596+0000 7f1d12ffd700 1 -- 172.21.15.26:0/2201683664 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d04011990 con 0x7f1d141338a0 2023-10-01T07:57:17.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.596+0000 7f1d12ffd700 1 -- 172.21.15.26:0/2201683664 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d04011d20 con 0x7f1d141338a0 2023-10-01T07:57:17.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.597+0000 7f1d1a15b700 1 -- 172.21.15.26:0/2201683664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d141338a0 msgr2=0x7f1d14133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:17.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.597+0000 7f1d1a15b700 1 --2- 172.21.15.26:0/2201683664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d141338a0 0x7f1d14133c70 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f1d040098f0 tx=0x7f1d04009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:17.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.597+0000 7f1d1a15b700 1 -- 172.21.15.26:0/2201683664 shutdown_connections 2023-10-01T07:57:17.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.597+0000 7f1d1a15b700 1 --2- 172.21.15.26:0/2201683664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d141338a0 0x7f1d14133c70 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:17.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.597+0000 7f1d1a15b700 1 --2- 172.21.15.26:0/2201683664 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d1409de50 0x7f1d1409e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:17.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.597+0000 7f1d1a15b700 1 -- 172.21.15.26:0/2201683664 >> 172.21.15.26:0/2201683664 conn(0x7f1d140a2aa0 msgr2=0x7f1d140a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:17.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.597+0000 7f1d1a15b700 1 -- 172.21.15.26:0/2201683664 shutdown_connections 2023-10-01T07:57:17.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.597+0000 7f1d1a15b700 1 -- 172.21.15.26:0/2201683664 wait complete. 2023-10-01T07:57:17.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.598+0000 7f1d1a15b700 1 Processor -- start 2023-10-01T07:57:17.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.598+0000 7f1d1a15b700 1 -- start start 2023-10-01T07:57:17.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.598+0000 7f1d1a15b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1d1409de50 0x7f1d1411d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:17.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.598+0000 7f1d1a15b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d1409e760 0x7f1d1411dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:17.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.598+0000 7f1d1a15b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d141338a0 0x7f1d1411e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:17.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.598+0000 7f1d1a15b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1411f2f0 con 0x7f1d1409e760 2023-10-01T07:57:17.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.598+0000 7f1d1a15b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d14120540 con 0x7f1d141338a0 2023-10-01T07:57:17.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.598+0000 7f1d1a15b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1411f8d0 con 0x7f1d1409de50 2023-10-01T07:57:17.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.598+0000 7f1d0affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d1409e760 0x7f1d1411dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:17.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.599+0000 7f1d13fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d141338a0 0x7f1d1411e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:17.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.599+0000 7f1d0affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d1409e760 0x7f1d1411dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55234/0 (socket says 172.21.15.26:55234) 2023-10-01T07:57:17.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.599+0000 7f1d0affd700 1 -- 172.21.15.26:0/4007293153 learned_addr learned my addr 172.21.15.26:0/4007293153 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:17.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.599+0000 7f1d137fe700 1 --2- 172.21.15.26:0/4007293153 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1d1409de50 0x7f1d1411d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:17.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.599+0000 7f1d0affd700 1 -- 172.21.15.26:0/4007293153 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1d1409de50 msgr2=0x7f1d1411d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:17.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.599+0000 7f1d0affd700 1 --2- 172.21.15.26:0/4007293153 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1d1409de50 0x7f1d1411d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:17.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.599+0000 7f1d0affd700 1 -- 172.21.15.26:0/4007293153 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d141338a0 msgr2=0x7f1d1411e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:17.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.599+0000 7f1d0affd700 1 --2- 172.21.15.26:0/4007293153 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d141338a0 0x7f1d1411e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:17.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.599+0000 7f1d0affd700 1 -- 172.21.15.26:0/4007293153 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cfc0094a0 con 0x7f1d1409e760 2023-10-01T07:57:17.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.599+0000 7f1d13fff700 1 --2- 172.21.15.26:0/4007293153 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d141338a0 0x7f1d1411e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:17.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.599+0000 7f1d0affd700 1 --2- 172.21.15.26:0/4007293153 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d1409e760 0x7f1d1411dcb0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc00ec10 tx=0x7f1cfc00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:17.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.599+0000 7f1d10ff9700 1 -- 172.21.15.26:0/4007293153 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc009760 con 0x7f1d1409e760 2023-10-01T07:57:17.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.599+0000 7f1d10ff9700 1 -- 172.21.15.26:0/4007293153 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cfc00c850 con 0x7f1d1409e760 2023-10-01T07:57:17.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.599+0000 7f1d1a15b700 1 -- 172.21.15.26:0/4007293153 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d04009550 con 0x7f1d1409e760 2023-10-01T07:57:17.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.599+0000 7f1d10ff9700 1 -- 172.21.15.26:0/4007293153 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc00cbe0 con 0x7f1d1409e760 2023-10-01T07:57:17.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.599+0000 7f1d1a15b700 1 -- 172.21.15.26:0/4007293153 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d140a0cb0 con 0x7f1d1409e760 2023-10-01T07:57:17.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.600+0000 7f1d10ff9700 1 -- 172.21.15.26:0/4007293153 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1cfc00cd40 con 0x7f1d1409e760 2023-10-01T07:57:17.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.600+0000 7f1d10ff9700 1 -- 172.21.15.26:0/4007293153 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1cfc03f710 con 0x7f1d1409e760 2023-10-01T07:57:17.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.600+0000 7f1d1a15b700 1 -- 172.21.15.26:0/4007293153 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d1411a470 con 0x7f1d1409e760 2023-10-01T07:57:17.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.605+0000 7f1d10ff9700 1 -- 172.21.15.26:0/4007293153 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1cfc0232f0 con 0x7f1d1409e760 2023-10-01T07:57:17.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.814+0000 7f1d1a15b700 1 -- 172.21.15.26:0/4007293153 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1d14074ea0 con 0x7f1d1409e760 2023-10-01T07:57:17.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.814+0000 7f1d10ff9700 1 -- 172.21.15.26:0/4007293153 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1cfc01bb50 con 0x7f1d1409e760 2023-10-01T07:57:17.815 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:17.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.816+0000 7f1d1a15b700 1 -- 172.21.15.26:0/4007293153 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d1409e760 msgr2=0x7f1d1411dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:17.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.816+0000 7f1d1a15b700 1 --2- 172.21.15.26:0/4007293153 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d1409e760 0x7f1d1411dcb0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc00ec10 tx=0x7f1cfc00ef20 comp rx=0 tx=0).stop 2023-10-01T07:57:17.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.816+0000 7f1d1a15b700 1 -- 172.21.15.26:0/4007293153 shutdown_connections 2023-10-01T07:57:17.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.816+0000 7f1d1a15b700 1 --2- 172.21.15.26:0/4007293153 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d141338a0 0x7f1d1411e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:17.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.816+0000 7f1d1a15b700 1 --2- 172.21.15.26:0/4007293153 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1d1409de50 0x7f1d1411d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:17.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.816+0000 7f1d1a15b700 1 --2- 172.21.15.26:0/4007293153 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d1409e760 0x7f1d1411dcb0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:17.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.817+0000 7f1d1a15b700 1 -- 172.21.15.26:0/4007293153 >> 172.21.15.26:0/4007293153 conn(0x7f1d140a2aa0 msgr2=0x7f1d141bac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:17.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.817+0000 7f1d1a15b700 1 -- 172.21.15.26:0/4007293153 shutdown_connections 2023-10-01T07:57:17.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:17.817+0000 7f1d1a15b700 1 -- 172.21.15.26:0/4007293153 wait complete. 2023-10-01T07:57:17.831 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:18.102 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:18.136 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:18.176 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:18.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.254+0000 7f9a67a86700 1 Processor -- start 2023-10-01T07:57:18.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.254+0000 7f9a67a86700 1 -- start start 2023-10-01T07:57:18.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.255+0000 7f9a67a86700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a6009e1d0 0x7f9a60138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:18.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.255+0000 7f9a67a86700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a60139170 0x7f9a6013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:18.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.255+0000 7f9a67a86700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a6009b120 con 0x7f9a6009d6f0 2023-10-01T07:57:18.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.255+0000 7f9a67a86700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6006b460 con 0x7f9a6009e1d0 2023-10-01T07:57:18.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.255+0000 7f9a67a86700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6009a7e0 con 0x7f9a60139170 2023-10-01T07:57:18.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.255+0000 7f9a65822700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9a6009d6f0 0x7f9a6009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56200/0 (socket says 172.21.15.26:56200) 2023-10-01T07:57:18.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.255+0000 7f9a65822700 1 -- 172.21.15.26:0/162669444 learned_addr learned my addr 172.21.15.26:0/162669444 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:18.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.255+0000 7f9a65021700 1 --2- 172.21.15.26:0/162669444 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a6009e1d0 0x7f9a60138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:18.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.255+0000 7f9a66023700 1 --2- 172.21.15.26:0/162669444 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a60139170 0x7f9a6013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:18.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.256+0000 7f9a65021700 1 -- 172.21.15.26:0/162669444 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a60139170 msgr2=0x7f9a6013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:18.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.256+0000 7f9a64820700 1 -- 172.21.15.26:0/162669444 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3537341202 0 0) 0x7f9a6009b120 con 0x7f9a6009d6f0 2023-10-01T07:57:18.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.256+0000 7f9a65021700 1 --2- 172.21.15.26:0/162669444 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a60139170 0x7f9a6013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:18.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.256+0000 7f9a65021700 1 -- 172.21.15.26:0/162669444 >> v1:172.21.15.26:6789/0 conn(0x7f9a6009d6f0 legacy=0x7f9a6009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:18.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.256+0000 7f9a65021700 1 -- 172.21.15.26:0/162669444 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a6009a500 con 0x7f9a6009e1d0 2023-10-01T07:57:18.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.256+0000 7f9a66023700 1 --2- 172.21.15.26:0/162669444 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a60139170 0x7f9a6013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:18.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.256+0000 7f9a65021700 1 --2- 172.21.15.26:0/162669444 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a6009e1d0 0x7f9a60138c30 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9a50009870 tx=0x7f9a50009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c09a78a53866a4bf server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:18.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.256+0000 7f9a64820700 1 -- 172.21.15.26:0/162669444 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a50011830 con 0x7f9a6009e1d0 2023-10-01T07:57:18.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.256+0000 7f9a64820700 1 -- 172.21.15.26:0/162669444 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a50011990 con 0x7f9a6009e1d0 2023-10-01T07:57:18.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.256+0000 7f9a64820700 1 -- 172.21.15.26:0/162669444 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a50011d20 con 0x7f9a6009e1d0 2023-10-01T07:57:18.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.257+0000 7f9a67a86700 1 -- 172.21.15.26:0/162669444 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a6009e1d0 msgr2=0x7f9a60138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:18.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.257+0000 7f9a67a86700 1 --2- 172.21.15.26:0/162669444 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a6009e1d0 0x7f9a60138c30 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9a50009870 tx=0x7f9a50009b80 comp rx=0 tx=0).stop 2023-10-01T07:57:18.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.257+0000 7f9a67a86700 1 -- 172.21.15.26:0/162669444 shutdown_connections 2023-10-01T07:57:18.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.257+0000 7f9a67a86700 1 --2- 172.21.15.26:0/162669444 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a60139170 0x7f9a6013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:18.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.257+0000 7f9a67a86700 1 --2- 172.21.15.26:0/162669444 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a6009e1d0 0x7f9a60138c30 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:18.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.257+0000 7f9a67a86700 1 -- 172.21.15.26:0/162669444 >> 172.21.15.26:0/162669444 conn(0x7f9a60066f50 msgr2=0x7f9a6009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:18.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.257+0000 7f9a67a86700 1 -- 172.21.15.26:0/162669444 shutdown_connections 2023-10-01T07:57:18.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.257+0000 7f9a67a86700 1 -- 172.21.15.26:0/162669444 wait complete. 2023-10-01T07:57:18.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.259+0000 7f9a67a86700 1 Processor -- start 2023-10-01T07:57:18.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.259+0000 7f9a67a86700 1 -- start start 2023-10-01T07:57:18.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.259+0000 7f9a67a86700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a6009d6f0 0x7f9a601c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:18.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.259+0000 7f9a67a86700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a6009e1d0 0x7f9a601c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:18.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.259+0000 7f9a67a86700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a60139170 0x7f9a601208c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:18.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.260+0000 7f9a67a86700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a60124100 con 0x7f9a6009e1d0 2023-10-01T07:57:18.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.260+0000 7f9a67a86700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a601be250 con 0x7f9a60139170 2023-10-01T07:57:18.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.260+0000 7f9a67a86700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a600a20d0 con 0x7f9a6009d6f0 2023-10-01T07:57:18.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.260+0000 7f9a65021700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a6009e1d0 0x7f9a601c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:18.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.260+0000 7f9a65822700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a6009d6f0 0x7f9a601c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:18.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.260+0000 7f9a65021700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a6009e1d0 0x7f9a601c8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55244/0 (socket says 172.21.15.26:55244) 2023-10-01T07:57:18.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.260+0000 7f9a65021700 1 -- 172.21.15.26:0/1909760629 learned_addr learned my addr 172.21.15.26:0/1909760629 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:18.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.260+0000 7f9a66023700 1 --2- 172.21.15.26:0/1909760629 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a60139170 0x7f9a601208c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:18.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.260+0000 7f9a65822700 1 -- 172.21.15.26:0/1909760629 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a60139170 msgr2=0x7f9a601208c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:18.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.260+0000 7f9a65822700 1 --2- 172.21.15.26:0/1909760629 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a60139170 0x7f9a601208c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:18.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.260+0000 7f9a65822700 1 -- 172.21.15.26:0/1909760629 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a6009e1d0 msgr2=0x7f9a601c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:18.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.260+0000 7f9a65822700 1 --2- 172.21.15.26:0/1909760629 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a6009e1d0 0x7f9a601c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:18.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.260+0000 7f9a65822700 1 -- 172.21.15.26:0/1909760629 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a58009a70 con 0x7f9a6009d6f0 2023-10-01T07:57:18.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.260+0000 7f9a65822700 1 --2- 172.21.15.26:0/1909760629 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a6009d6f0 0x7f9a601c8580 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00c470 tx=0x7f9a5c00c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:18.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.260+0000 7f9a567fc700 1 -- 172.21.15.26:0/1909760629 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c004c80 con 0x7f9a6009d6f0 2023-10-01T07:57:18.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.261+0000 7f9a567fc700 1 -- 172.21.15.26:0/1909760629 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5c004de0 con 0x7f9a6009d6f0 2023-10-01T07:57:18.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.261+0000 7f9a67a86700 1 -- 172.21.15.26:0/1909760629 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a500094a0 con 0x7f9a6009d6f0 2023-10-01T07:57:18.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.261+0000 7f9a567fc700 1 -- 172.21.15.26:0/1909760629 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c007310 con 0x7f9a6009d6f0 2023-10-01T07:57:18.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.261+0000 7f9a67a86700 1 -- 172.21.15.26:0/1909760629 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a601224d0 con 0x7f9a6009d6f0 2023-10-01T07:57:18.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.261+0000 7f9a567fc700 1 -- 172.21.15.26:0/1909760629 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9a5c007470 con 0x7f9a6009d6f0 2023-10-01T07:57:18.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.262+0000 7f9a567fc700 1 -- 172.21.15.26:0/1909760629 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9a5c03f360 con 0x7f9a6009d6f0 2023-10-01T07:57:18.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.262+0000 7f9a67a86700 1 -- 172.21.15.26:0/1909760629 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a60124240 con 0x7f9a6009d6f0 2023-10-01T07:57:18.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.267+0000 7f9a567fc700 1 -- 172.21.15.26:0/1909760629 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9a60124240 con 0x7f9a6009d6f0 2023-10-01T07:57:18.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.292+0000 7fe926e12700 1 Processor -- start 2023-10-01T07:57:18.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.292+0000 7fe926e12700 1 -- start start 2023-10-01T07:57:18.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.292+0000 7fe926e12700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe92009d6f0 0x7fe92009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:18.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.292+0000 7fe926e12700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe92009e410 0x7fe920134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:18.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.292+0000 7fe926e12700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe92009b120 con 0x7fe92009e000 2023-10-01T07:57:18.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.292+0000 7fe926e12700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe92006b460 con 0x7fe92009d6f0 2023-10-01T07:57:18.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.292+0000 7fe926e12700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe92009a7e0 con 0x7fe92009e410 2023-10-01T07:57:18.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.292+0000 7fe924bae700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe92009d6f0 0x7fe92009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:18.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.293+0000 7fe91ffff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe92009e000 0x7fe9201339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56204/0 (socket says 172.21.15.26:56204) 2023-10-01T07:57:18.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.293+0000 7fe91ffff700 1 -- 172.21.15.26:0/1722140365 learned_addr learned my addr 172.21.15.26:0/1722140365 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:18.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.293+0000 7fe924bae700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe92009d6f0 0x7fe92009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45970/0 (socket says 172.21.15.26:45970) 2023-10-01T07:57:18.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.293+0000 7fe9253af700 1 --2- 172.21.15.26:0/1722140365 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe92009e410 0x7fe920134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:18.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.293+0000 7fe91f7fe700 1 -- 172.21.15.26:0/1722140365 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 429332069 0 0) 0x7fe92009b120 con 0x7fe92009e000 2023-10-01T07:57:18.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.293+0000 7fe924bae700 1 -- 172.21.15.26:0/1722140365 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe92009e410 msgr2=0x7fe920134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:18.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.293+0000 7fe924bae700 1 --2- 172.21.15.26:0/1722140365 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe92009e410 0x7fe920134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:18.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.293+0000 7fe924bae700 1 -- 172.21.15.26:0/1722140365 >> v1:172.21.15.26:6789/0 conn(0x7fe92009e000 legacy=0x7fe9201339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:18.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.293+0000 7fe924bae700 1 -- 172.21.15.26:0/1722140365 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92009a500 con 0x7fe92009d6f0 2023-10-01T07:57:18.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.293+0000 7fe9253af700 1 --2- 172.21.15.26:0/1722140365 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe92009e410 0x7fe920134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:18.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.293+0000 7fe924bae700 1 --2- 172.21.15.26:0/1722140365 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe92009d6f0 0x7fe92009dac0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe914009870 tx=0x7fe914009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=387238af4406ee6e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:18.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.293+0000 7fe91f7fe700 1 -- 172.21.15.26:0/1722140365 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe914011830 con 0x7fe92009d6f0 2023-10-01T07:57:18.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.293+0000 7fe91f7fe700 1 -- 172.21.15.26:0/1722140365 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe914011990 con 0x7fe92009d6f0 2023-10-01T07:57:18.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.294+0000 7fe91f7fe700 1 -- 172.21.15.26:0/1722140365 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe914011d20 con 0x7fe92009d6f0 2023-10-01T07:57:18.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.294+0000 7fe926e12700 1 -- 172.21.15.26:0/1722140365 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe92009d6f0 msgr2=0x7fe92009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:18.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.294+0000 7fe926e12700 1 --2- 172.21.15.26:0/1722140365 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe92009d6f0 0x7fe92009dac0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe914009870 tx=0x7fe914009b80 comp rx=0 tx=0).stop 2023-10-01T07:57:18.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.294+0000 7fe926e12700 1 -- 172.21.15.26:0/1722140365 shutdown_connections 2023-10-01T07:57:18.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.294+0000 7fe926e12700 1 --2- 172.21.15.26:0/1722140365 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe92009e410 0x7fe920134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:18.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.294+0000 7fe926e12700 1 --2- 172.21.15.26:0/1722140365 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe92009d6f0 0x7fe92009dac0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:18.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.294+0000 7fe926e12700 1 -- 172.21.15.26:0/1722140365 >> 172.21.15.26:0/1722140365 conn(0x7fe920066f50 msgr2=0x7fe92009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:18.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.294+0000 7fe926e12700 1 -- 172.21.15.26:0/1722140365 shutdown_connections 2023-10-01T07:57:18.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.294+0000 7fe926e12700 1 -- 172.21.15.26:0/1722140365 wait complete. 2023-10-01T07:57:18.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.296+0000 7fe926e12700 1 Processor -- start 2023-10-01T07:57:18.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.296+0000 7fe926e12700 1 -- start start 2023-10-01T07:57:18.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.297+0000 7fe926e12700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe92009d6f0 0x7fe9201223b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:18.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.297+0000 7fe926e12700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe92009e000 0x7fe9201228f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:18.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.297+0000 7fe926e12700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe92009e410 0x7fe920122e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:18.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.297+0000 7fe926e12700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9201336f0 con 0x7fe92009e410 2023-10-01T07:57:18.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.297+0000 7fe926e12700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe920123810 con 0x7fe92009e000 2023-10-01T07:57:18.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.297+0000 7fe926e12700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe920124dc0 con 0x7fe92009d6f0 2023-10-01T07:57:18.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.297+0000 7fe924bae700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe92009d6f0 0x7fe9201223b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:18.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.297+0000 7fe9253af700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe92009e410 0x7fe920122e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:18.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.297+0000 7fe924bae700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe92009d6f0 0x7fe9201223b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49656/0 (socket says 172.21.15.26:49656) 2023-10-01T07:57:18.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.297+0000 7fe924bae700 1 -- 172.21.15.26:0/153888408 learned_addr learned my addr 172.21.15.26:0/153888408 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:18.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.297+0000 7fe91ffff700 1 --2- 172.21.15.26:0/153888408 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe92009e000 0x7fe9201228f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:18.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.297+0000 7fe924bae700 1 -- 172.21.15.26:0/153888408 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe92009e000 msgr2=0x7fe9201228f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:18.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.297+0000 7fe924bae700 1 --2- 172.21.15.26:0/153888408 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe92009e000 0x7fe9201228f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:18.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.297+0000 7fe924bae700 1 -- 172.21.15.26:0/153888408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe92009e410 msgr2=0x7fe920122e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:18.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.297+0000 7fe924bae700 1 --2- 172.21.15.26:0/153888408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe92009e410 0x7fe920122e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:18.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.297+0000 7fe924bae700 1 -- 172.21.15.26:0/153888408 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe918009a70 con 0x7fe92009d6f0 2023-10-01T07:57:18.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.298+0000 7fe9253af700 1 --2- 172.21.15.26:0/153888408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe92009e410 0x7fe920122e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:18.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.298+0000 7fe924bae700 1 --2- 172.21.15.26:0/153888408 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe92009d6f0 0x7fe9201223b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe9140090b0 tx=0x7fe914004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:18.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.298+0000 7fe91d7fa700 1 -- 172.21.15.26:0/153888408 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe914024620 con 0x7fe92009d6f0 2023-10-01T07:57:18.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.298+0000 7fe91d7fa700 1 -- 172.21.15.26:0/153888408 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe914024780 con 0x7fe92009d6f0 2023-10-01T07:57:18.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.298+0000 7fe91d7fa700 1 -- 172.21.15.26:0/153888408 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe914024af0 con 0x7fe92009d6f0 2023-10-01T07:57:18.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.298+0000 7fe926e12700 1 -- 172.21.15.26:0/153888408 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9140094a0 con 0x7fe92009d6f0 2023-10-01T07:57:18.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.298+0000 7fe926e12700 1 -- 172.21.15.26:0/153888408 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9200a1aa0 con 0x7fe92009d6f0 2023-10-01T07:57:18.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.299+0000 7fe91d7fa700 1 -- 172.21.15.26:0/153888408 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe914022070 con 0x7fe92009d6f0 2023-10-01T07:57:18.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.299+0000 7fe926e12700 1 -- 172.21.15.26:0/153888408 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe92009c770 con 0x7fe92009d6f0 2023-10-01T07:57:18.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.299+0000 7fe91d7fa700 1 -- 172.21.15.26:0/153888408 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe914040550 con 0x7fe92009d6f0 2023-10-01T07:57:18.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.309+0000 7fe91d7fa700 1 -- 172.21.15.26:0/153888408 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe914024c50 con 0x7fe92009d6f0 2023-10-01T07:57:18.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.333+0000 7ff221d0d700 1 Processor -- start 2023-10-01T07:57:18.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.333+0000 7ff221d0d700 1 -- start start 2023-10-01T07:57:18.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.333+0000 7ff221d0d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff21c09e930 0x7ff21c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:18.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.333+0000 7ff221d0d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff21c09f240 0x7ff21c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:18.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.333+0000 7ff221d0d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff21c09f650 0x7ff21c131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:18.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.333+0000 7ff221d0d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff21c070940 con 0x7ff21c09f240 2023-10-01T07:57:18.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.333+0000 7ff221d0d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c06fd60 con 0x7ff21c09e930 2023-10-01T07:57:18.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.333+0000 7ff221d0d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c06fa80 con 0x7ff21c09f650 2023-10-01T07:57:18.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.334+0000 7ff21b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff21c09e930 0x7ff21c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:18.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.334+0000 7ff21b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff21c09e930 0x7ff21c09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45980/0 (socket says 172.21.15.26:45980) 2023-10-01T07:57:18.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.334+0000 7ff21b7fe700 1 -- 172.21.15.26:0/2679269566 learned_addr learned my addr 172.21.15.26:0/2679269566 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:18.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.334+0000 7ff21bfff700 1 --2- 172.21.15.26:0/2679269566 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff21c09f650 0x7ff21c131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:18.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.334+0000 7ff21affd700 1 --2- 172.21.15.26:0/2679269566 >> v2:172.21.15.26:3300/0 conn(0x7ff21c09f240 0x7ff21c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:18.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.334+0000 7ff21b7fe700 1 -- 172.21.15.26:0/2679269566 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff21c09f650 msgr2=0x7ff21c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:18.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.334+0000 7ff21b7fe700 1 --2- 172.21.15.26:0/2679269566 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff21c09f650 0x7ff21c131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:18.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.334+0000 7ff21b7fe700 1 -- 172.21.15.26:0/2679269566 >> v2:172.21.15.26:3300/0 conn(0x7ff21c09f240 msgr2=0x7ff21c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:18.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.334+0000 7ff21b7fe700 1 --2- 172.21.15.26:0/2679269566 >> v2:172.21.15.26:3300/0 conn(0x7ff21c09f240 0x7ff21c1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:18.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.334+0000 7ff21b7fe700 1 -- 172.21.15.26:0/2679269566 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21c09fb60 con 0x7ff21c09e930 2023-10-01T07:57:18.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.334+0000 7ff21b7fe700 1 --2- 172.21.15.26:0/2679269566 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff21c09e930 0x7ff21c09ed00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff20c0098f0 tx=0x7ff20c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26f49ad26def239b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:18.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.334+0000 7ff21a7fc700 1 -- 172.21.15.26:0/2679269566 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c011830 con 0x7ff21c09e930 2023-10-01T07:57:18.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.335+0000 7ff21a7fc700 1 -- 172.21.15.26:0/2679269566 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20c011990 con 0x7ff21c09e930 2023-10-01T07:57:18.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.335+0000 7ff21a7fc700 1 -- 172.21.15.26:0/2679269566 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c011d20 con 0x7ff21c09e930 2023-10-01T07:57:18.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.335+0000 7ff221d0d700 1 -- 172.21.15.26:0/2679269566 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff21c09e930 msgr2=0x7ff21c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:18.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.335+0000 7ff221d0d700 1 --2- 172.21.15.26:0/2679269566 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff21c09e930 0x7ff21c09ed00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff20c0098f0 tx=0x7ff20c009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:18.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.335+0000 7ff221d0d700 1 -- 172.21.15.26:0/2679269566 shutdown_connections 2023-10-01T07:57:18.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.335+0000 7ff221d0d700 1 --2- 172.21.15.26:0/2679269566 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff21c09f650 0x7ff21c131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:18.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.335+0000 7ff221d0d700 1 --2- 172.21.15.26:0/2679269566 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff21c09e930 0x7ff21c09ed00 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:18.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.335+0000 7ff221d0d700 1 --2- 172.21.15.26:0/2679269566 >> v2:172.21.15.26:3300/0 conn(0x7ff21c09f240 0x7ff21c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:18.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.335+0000 7ff221d0d700 1 -- 172.21.15.26:0/2679269566 >> 172.21.15.26:0/2679269566 conn(0x7ff21c0a4210 msgr2=0x7ff21c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:18.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.335+0000 7ff221d0d700 1 -- 172.21.15.26:0/2679269566 shutdown_connections 2023-10-01T07:57:18.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.335+0000 7ff221d0d700 1 -- 172.21.15.26:0/2679269566 wait complete. 2023-10-01T07:57:18.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.337+0000 7ff221d0d700 1 Processor -- start 2023-10-01T07:57:18.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.337+0000 7ff221d0d700 1 -- start start 2023-10-01T07:57:18.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.337+0000 7ff221d0d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff21c09e930 0x7ff21c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:18.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.337+0000 7ff221d0d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff21c09f240 0x7ff21c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:18.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.337+0000 7ff221d0d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff21c09f650 0x7ff21c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:18.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.337+0000 7ff221d0d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c06cd80 con 0x7ff21c09f240 2023-10-01T07:57:18.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.337+0000 7ff221d0d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c1b71c0 con 0x7ff21c09f650 2023-10-01T07:57:18.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.337+0000 7ff221d0d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c1a9370 con 0x7ff21c09e930 2023-10-01T07:57:18.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.337+0000 7ff21affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff21c09f240 0x7ff21c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:18.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.337+0000 7ff21affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff21c09f240 0x7ff21c06bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55266/0 (socket says 172.21.15.26:55266) 2023-10-01T07:57:18.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.337+0000 7ff21affd700 1 -- 172.21.15.26:0/806465126 learned_addr learned my addr 172.21.15.26:0/806465126 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:18.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.338+0000 7ff21bfff700 1 --2- 172.21.15.26:0/806465126 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff21c09f650 0x7ff21c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:18.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.338+0000 7ff21b7fe700 1 --2- 172.21.15.26:0/806465126 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff21c09e930 0x7ff21c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:18.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.338+0000 7ff21affd700 1 -- 172.21.15.26:0/806465126 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff21c09e930 msgr2=0x7ff21c06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:18.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.338+0000 7ff21affd700 1 --2- 172.21.15.26:0/806465126 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff21c09e930 0x7ff21c06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:18.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.338+0000 7ff21affd700 1 -- 172.21.15.26:0/806465126 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff21c09f650 msgr2=0x7ff21c06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:18.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.338+0000 7ff21affd700 1 --2- 172.21.15.26:0/806465126 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff21c09f650 0x7ff21c06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:18.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.338+0000 7ff21affd700 1 -- 172.21.15.26:0/806465126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20c009550 con 0x7ff21c09f240 2023-10-01T07:57:18.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.338+0000 7ff21bfff700 1 --2- 172.21.15.26:0/806465126 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff21c09f650 0x7ff21c06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:18.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.338+0000 7ff21affd700 1 --2- 172.21.15.26:0/806465126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff21c09f240 0x7ff21c06bdf0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ff21000e930 tx=0x7ff21000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:18.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.338+0000 7ff203fff700 1 -- 172.21.15.26:0/806465126 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff210013680 con 0x7ff21c09f240 2023-10-01T07:57:18.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.338+0000 7ff203fff700 1 -- 172.21.15.26:0/806465126 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2100137e0 con 0x7ff21c09f240 2023-10-01T07:57:18.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.338+0000 7ff221d0d700 1 -- 172.21.15.26:0/806465126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff21c0a0190 con 0x7ff21c09f240 2023-10-01T07:57:18.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.338+0000 7ff203fff700 1 -- 172.21.15.26:0/806465126 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff210013b70 con 0x7ff21c09f240 2023-10-01T07:57:18.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.338+0000 7ff221d0d700 1 -- 172.21.15.26:0/806465126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff21c1a90a0 con 0x7ff21c09f240 2023-10-01T07:57:18.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.339+0000 7ff203fff700 1 -- 172.21.15.26:0/806465126 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff210013cd0 con 0x7ff21c09f240 2023-10-01T07:57:18.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.340+0000 7ff203fff700 1 -- 172.21.15.26:0/806465126 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff21003f7d0 con 0x7ff21c09f240 2023-10-01T07:57:18.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.340+0000 7ff221d0d700 1 -- 172.21.15.26:0/806465126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff21c0a35b0 con 0x7ff21c09f240 2023-10-01T07:57:18.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.345+0000 7ff203fff700 1 -- 172.21.15.26:0/806465126 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff21001be10 con 0x7ff21c09f240 2023-10-01T07:57:18.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.482+0000 7f9a67a86700 1 -- 172.21.15.26:0/1909760629 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9a60124240 con 0x7f9a6009d6f0 2023-10-01T07:57:18.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.483+0000 7f9a567fc700 1 -- 172.21.15.26:0/1909760629 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9a60124240 con 0x7f9a6009d6f0 2023-10-01T07:57:18.484 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:18.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.485+0000 7f9a67a86700 1 -- 172.21.15.26:0/1909760629 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a6009d6f0 msgr2=0x7f9a601c8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:18.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.485+0000 7f9a67a86700 1 --2- 172.21.15.26:0/1909760629 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a6009d6f0 0x7f9a601c8580 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00c470 tx=0x7f9a5c00c780 comp rx=0 tx=0).stop 2023-10-01T07:57:18.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.485+0000 7f9a67a86700 1 -- 172.21.15.26:0/1909760629 shutdown_connections 2023-10-01T07:57:18.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.485+0000 7f9a67a86700 1 --2- 172.21.15.26:0/1909760629 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a60139170 0x7f9a601208c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:18.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.485+0000 7f9a67a86700 1 --2- 172.21.15.26:0/1909760629 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a6009d6f0 0x7f9a601c8580 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:18.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.485+0000 7f9a67a86700 1 --2- 172.21.15.26:0/1909760629 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a6009e1d0 0x7f9a601c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:18.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.485+0000 7f9a67a86700 1 -- 172.21.15.26:0/1909760629 >> 172.21.15.26:0/1909760629 conn(0x7f9a60066f50 msgr2=0x7f9a60070f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:18.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.486+0000 7f9a67a86700 1 -- 172.21.15.26:0/1909760629 shutdown_connections 2023-10-01T07:57:18.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.486+0000 7f9a67a86700 1 -- 172.21.15.26:0/1909760629 wait complete. 2023-10-01T07:57:18.500 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:18.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.518+0000 7fe926e12700 1 -- 172.21.15.26:0/153888408 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe92011f030 con 0x7fe92009d6f0 2023-10-01T07:57:18.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.518+0000 7fe91d7fa700 1 -- 172.21.15.26:0/153888408 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe914029030 con 0x7fe92009d6f0 2023-10-01T07:57:18.519 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:18.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.520+0000 7fe926e12700 1 -- 172.21.15.26:0/153888408 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe92009d6f0 msgr2=0x7fe9201223b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:18.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.520+0000 7fe926e12700 1 --2- 172.21.15.26:0/153888408 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe92009d6f0 0x7fe9201223b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe9140090b0 tx=0x7fe914004750 comp rx=0 tx=0).stop 2023-10-01T07:57:18.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.521+0000 7fe926e12700 1 -- 172.21.15.26:0/153888408 shutdown_connections 2023-10-01T07:57:18.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.521+0000 7fe926e12700 1 --2- 172.21.15.26:0/153888408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe92009e410 0x7fe920122e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:18.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.521+0000 7fe926e12700 1 --2- 172.21.15.26:0/153888408 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe92009d6f0 0x7fe9201223b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:18.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.521+0000 7fe926e12700 1 --2- 172.21.15.26:0/153888408 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe92009e000 0x7fe9201228f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:18.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.521+0000 7fe926e12700 1 -- 172.21.15.26:0/153888408 >> 172.21.15.26:0/153888408 conn(0x7fe920066f50 msgr2=0x7fe920133f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:18.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.521+0000 7fe926e12700 1 -- 172.21.15.26:0/153888408 shutdown_connections 2023-10-01T07:57:18.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.521+0000 7fe926e12700 1 -- 172.21.15.26:0/153888408 wait complete. 2023-10-01T07:57:18.535 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:18.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.549+0000 7ff221d0d700 1 -- 172.21.15.26:0/806465126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff21c1a0b30 con 0x7ff21c09f240 2023-10-01T07:57:18.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.550+0000 7ff203fff700 1 -- 172.21.15.26:0/806465126 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff21001b3b0 con 0x7ff21c09f240 2023-10-01T07:57:18.550 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:18.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.552+0000 7ff221d0d700 1 -- 172.21.15.26:0/806465126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff21c09f240 msgr2=0x7ff21c06bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:18.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.552+0000 7ff221d0d700 1 --2- 172.21.15.26:0/806465126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff21c09f240 0x7ff21c06bdf0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ff21000e930 tx=0x7ff21000ec40 comp rx=0 tx=0).stop 2023-10-01T07:57:18.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.552+0000 7ff221d0d700 1 -- 172.21.15.26:0/806465126 shutdown_connections 2023-10-01T07:57:18.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.552+0000 7ff221d0d700 1 --2- 172.21.15.26:0/806465126 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff21c09f650 0x7ff21c06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:18.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.552+0000 7ff221d0d700 1 --2- 172.21.15.26:0/806465126 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff21c09e930 0x7ff21c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:18.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.552+0000 7ff221d0d700 1 --2- 172.21.15.26:0/806465126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff21c09f240 0x7ff21c06bdf0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:18.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.552+0000 7ff221d0d700 1 -- 172.21.15.26:0/806465126 >> 172.21.15.26:0/806465126 conn(0x7ff21c0a4210 msgr2=0x7ff21c1b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:18.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.552+0000 7ff221d0d700 1 -- 172.21.15.26:0/806465126 shutdown_connections 2023-10-01T07:57:18.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.552+0000 7ff221d0d700 1 -- 172.21.15.26:0/806465126 wait complete. 2023-10-01T07:57:18.567 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:18.832 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:18.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.978+0000 7f1cf3b17700 1 Processor -- start 2023-10-01T07:57:19.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.978+0000 7f1cf3b17700 1 -- start start 2023-10-01T07:57:19.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.979+0000 7f1cf3b17700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1cec133420 0x7f1cec1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:19.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.979+0000 7f1cf3b17700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1cec133e30 0x7f1cec12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:19.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.979+0000 7f1cf3b17700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1cec134260 0x7f1cec1304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:19.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.979+0000 7f1cf3b17700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cec06b990 con 0x7f1cec134260 2023-10-01T07:57:19.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.979+0000 7f1cf3b17700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec0a0590 con 0x7f1cec133e30 2023-10-01T07:57:19.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.979+0000 7f1cf3b17700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec09fb80 con 0x7f1cec133420 2023-10-01T07:57:19.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.979+0000 7f1cf18b3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1cec133420 0x7f1cec1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:19.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.979+0000 7f1cf10b2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1cec133e30 0x7f1cec12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:19.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.979+0000 7f1cf20b4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1cec134260 0x7f1cec1304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:19.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.979+0000 7f1cf18b3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1cec133420 0x7f1cec1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49690/0 (socket says 172.21.15.26:49690) 2023-10-01T07:57:19.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.979+0000 7f1cf10b2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1cec133e30 0x7f1cec12ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46012/0 (socket says 172.21.15.26:46012) 2023-10-01T07:57:19.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.979+0000 7f1cf18b3700 1 -- 172.21.15.26:0/3701972273 learned_addr learned my addr 172.21.15.26:0/3701972273 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:19.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.979+0000 7f1cf18b3700 1 -- 172.21.15.26:0/3701972273 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1cec133e30 msgr2=0x7f1cec12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:19.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.979+0000 7f1cf18b3700 1 --2- 172.21.15.26:0/3701972273 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1cec133e30 0x7f1cec12ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:19.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.979+0000 7f1cf18b3700 1 -- 172.21.15.26:0/3701972273 >> v2:172.21.15.26:3300/0 conn(0x7f1cec134260 msgr2=0x7f1cec1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:19.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.979+0000 7f1cf18b3700 1 --2- 172.21.15.26:0/3701972273 >> v2:172.21.15.26:3300/0 conn(0x7f1cec134260 0x7f1cec1304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:19.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.979+0000 7f1cf18b3700 1 -- 172.21.15.26:0/3701972273 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cec0a0030 con 0x7f1cec133420 2023-10-01T07:57:19.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.979+0000 7f1cf20b4700 1 --2- 172.21.15.26:0/3701972273 >> v2:172.21.15.26:3300/0 conn(0x7f1cec134260 0x7f1cec1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:19.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.980+0000 7f1cf18b3700 1 --2- 172.21.15.26:0/3701972273 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1cec133420 0x7f1cec1337f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1ce80098f0 tx=0x7f1ce8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ebae546655bb7d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:19.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.980+0000 7f1cf08b1700 1 -- 172.21.15.26:0/3701972273 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce8011830 con 0x7f1cec133420 2023-10-01T07:57:19.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.980+0000 7f1cf08b1700 1 -- 172.21.15.26:0/3701972273 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce8011990 con 0x7f1cec133420 2023-10-01T07:57:19.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.980+0000 7f1cf08b1700 1 -- 172.21.15.26:0/3701972273 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce8011d20 con 0x7f1cec133420 2023-10-01T07:57:19.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.980+0000 7f1cf3b17700 1 -- 172.21.15.26:0/3701972273 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1cec133420 msgr2=0x7f1cec1337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:19.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.980+0000 7f1cf3b17700 1 --2- 172.21.15.26:0/3701972273 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1cec133420 0x7f1cec1337f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1ce80098f0 tx=0x7f1ce8009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:19.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.980+0000 7f1cf3b17700 1 -- 172.21.15.26:0/3701972273 shutdown_connections 2023-10-01T07:57:19.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.980+0000 7f1cf3b17700 1 --2- 172.21.15.26:0/3701972273 >> v2:172.21.15.26:3300/0 conn(0x7f1cec134260 0x7f1cec1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:19.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.980+0000 7f1cf3b17700 1 --2- 172.21.15.26:0/3701972273 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1cec133420 0x7f1cec1337f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:19.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.980+0000 7f1cf3b17700 1 --2- 172.21.15.26:0/3701972273 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1cec133e30 0x7f1cec12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:19.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.980+0000 7f1cf3b17700 1 -- 172.21.15.26:0/3701972273 >> 172.21.15.26:0/3701972273 conn(0x7f1cec0a4210 msgr2=0x7f1cec0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:19.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.980+0000 7f1cf3b17700 1 -- 172.21.15.26:0/3701972273 shutdown_connections 2023-10-01T07:57:19.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.981+0000 7f1cf3b17700 1 -- 172.21.15.26:0/3701972273 wait complete. 2023-10-01T07:57:19.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.981+0000 7f1cf3b17700 1 Processor -- start 2023-10-01T07:57:19.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.982+0000 7f1cf3b17700 1 -- start start 2023-10-01T07:57:19.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.982+0000 7f1cf3b17700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1cec133420 0x7f1cec09c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:19.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.982+0000 7f1cf3b17700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cec133e30 0x7f1cec09c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:19.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.982+0000 7f1cf3b17700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1cec134260 0x7f1cec09cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:19.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.982+0000 7f1cf3b17700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec1202e0 con 0x7f1cec133e30 2023-10-01T07:57:19.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.982+0000 7f1cf3b17700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec09dd90 con 0x7f1cec134260 2023-10-01T07:57:19.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.982+0000 7f1cf3b17700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec11fc40 con 0x7f1cec133420 2023-10-01T07:57:19.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.982+0000 7f1cf20b4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1cec134260 0x7f1cec09cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:19.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.982+0000 7f1cf10b2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cec133e30 0x7f1cec09c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:19.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.982+0000 7f1cf18b3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1cec133420 0x7f1cec09c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:19.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.982+0000 7f1cf20b4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1cec134260 0x7f1cec09cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46028/0 (socket says 172.21.15.26:46028) 2023-10-01T07:57:19.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.982+0000 7f1cf10b2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cec133e30 0x7f1cec09c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55274/0 (socket says 172.21.15.26:55274) 2023-10-01T07:57:19.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.982+0000 7f1cf18b3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1cec133420 0x7f1cec09c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49696/0 (socket says 172.21.15.26:49696) 2023-10-01T07:57:19.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.982+0000 7f1cf20b4700 1 -- 172.21.15.26:0/3834516668 learned_addr learned my addr 172.21.15.26:0/3834516668 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:19.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.982+0000 7f1cf18b3700 1 -- 172.21.15.26:0/3834516668 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1cec134260 msgr2=0x7f1cec09cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:19.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.982+0000 7f1cf18b3700 1 --2- 172.21.15.26:0/3834516668 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1cec134260 0x7f1cec09cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:19.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.982+0000 7f1cf18b3700 1 -- 172.21.15.26:0/3834516668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cec133e30 msgr2=0x7f1cec09c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:19.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.983+0000 7f1cf18b3700 1 --2- 172.21.15.26:0/3834516668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cec133e30 0x7f1cec09c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:19.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.983+0000 7f1cf18b3700 1 -- 172.21.15.26:0/3834516668 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce4009a70 con 0x7f1cec133420 2023-10-01T07:57:19.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.983+0000 7f1cf20b4700 1 --2- 172.21.15.26:0/3834516668 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1cec134260 0x7f1cec09cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:19.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.983+0000 7f1cf10b2700 1 --2- 172.21.15.26:0/3834516668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cec133e30 0x7f1cec09c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:19.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.983+0000 7f1cf18b3700 1 --2- 172.21.15.26:0/3834516668 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1cec133420 0x7f1cec09c300 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8016000 tx=0x7f1ce8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:19.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.983+0000 7f1cde7fc700 1 -- 172.21.15.26:0/3834516668 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce8004450 con 0x7f1cec133420 2023-10-01T07:57:19.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.983+0000 7f1cde7fc700 1 -- 172.21.15.26:0/3834516668 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce80045b0 con 0x7f1cec133420 2023-10-01T07:57:19.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.983+0000 7f1cde7fc700 1 -- 172.21.15.26:0/3834516668 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce80038c0 con 0x7f1cec133420 2023-10-01T07:57:19.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.983+0000 7f1cf3b17700 1 -- 172.21.15.26:0/3834516668 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce8009550 con 0x7f1cec133420 2023-10-01T07:57:19.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.983+0000 7f1cf3b17700 1 -- 172.21.15.26:0/3834516668 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cec11f950 con 0x7f1cec133420 2023-10-01T07:57:19.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.984+0000 7f1cde7fc700 1 -- 172.21.15.26:0/3834516668 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1ce8021070 con 0x7f1cec133420 2023-10-01T07:57:19.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.984+0000 7f1cde7fc700 1 -- 172.21.15.26:0/3834516668 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1ce8040b40 con 0x7f1cec133420 2023-10-01T07:57:19.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.984+0000 7f1cf3b17700 1 -- 172.21.15.26:0/3834516668 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cec074ea0 con 0x7f1cec133420 2023-10-01T07:57:19.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:18.989+0000 7f1cde7fc700 1 -- 172.21.15.26:0/3834516668 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1ce8015080 con 0x7f1cec133420 2023-10-01T07:57:19.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.194+0000 7f1cf3b17700 1 -- 172.21.15.26:0/3834516668 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1cec12daf0 con 0x7f1cec133420 2023-10-01T07:57:19.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.194+0000 7f1cde7fc700 1 -- 172.21.15.26:0/3834516668 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1ce8029020 con 0x7f1cec133420 2023-10-01T07:57:19.195 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:19.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.197+0000 7f1cf3b17700 1 -- 172.21.15.26:0/3834516668 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1cec133420 msgr2=0x7f1cec09c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:19.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.197+0000 7f1cf3b17700 1 --2- 172.21.15.26:0/3834516668 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1cec133420 0x7f1cec09c300 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8016000 tx=0x7f1ce8004750 comp rx=0 tx=0).stop 2023-10-01T07:57:19.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.197+0000 7f1cf3b17700 1 -- 172.21.15.26:0/3834516668 shutdown_connections 2023-10-01T07:57:19.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.197+0000 7f1cf3b17700 1 --2- 172.21.15.26:0/3834516668 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1cec134260 0x7f1cec09cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:19.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.197+0000 7f1cf3b17700 1 --2- 172.21.15.26:0/3834516668 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1cec133420 0x7f1cec09c300 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:19.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.197+0000 7f1cf3b17700 1 --2- 172.21.15.26:0/3834516668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cec133e30 0x7f1cec09c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:19.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.197+0000 7f1cf3b17700 1 -- 172.21.15.26:0/3834516668 >> 172.21.15.26:0/3834516668 conn(0x7f1cec0a4210 msgr2=0x7f1cec0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:19.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.197+0000 7f1cf3b17700 1 -- 172.21.15.26:0/3834516668 shutdown_connections 2023-10-01T07:57:19.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.197+0000 7f1cf3b17700 1 -- 172.21.15.26:0/3834516668 wait complete. 2023-10-01T07:57:19.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:19.501 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:19.536 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:19.568 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:19.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.652+0000 7f8834a5f700 1 Processor -- start 2023-10-01T07:57:19.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.653+0000 7f8834a5f700 1 -- start start 2023-10-01T07:57:19.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.653+0000 7f8834a5f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8830130540 0x7f8830130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:19.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.653+0000 7f8834a5f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f883006fcf0 0x7f8830138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:19.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.653+0000 7f8834a5f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88300716a0 con 0x7f8830130e50 2023-10-01T07:57:19.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.653+0000 7f8834a5f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f883009a390 con 0x7f8830130540 2023-10-01T07:57:19.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.653+0000 7f8834a5f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8830071290 con 0x7f883006fcf0 2023-10-01T07:57:19.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.654+0000 7f882ed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f883006fcf0 0x7f8830138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:19.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.654+0000 7f882e59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8830130540 0x7f8830130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:19.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.654+0000 7f882ed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f883006fcf0 0x7f8830138570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46042/0 (socket says 172.21.15.26:46042) 2023-10-01T07:57:19.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.654+0000 7f882ed9d700 1 -- 172.21.15.26:0/3701370409 learned_addr learned my addr 172.21.15.26:0/3701370409 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:19.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.654+0000 7f882e59c700 1 -- 172.21.15.26:0/3701370409 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f883006fcf0 msgr2=0x7f8830138570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:19.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.654+0000 7f882e59c700 1 --2- 172.21.15.26:0/3701370409 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f883006fcf0 0x7f8830138570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:19.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.654+0000 7f882e59c700 1 -- 172.21.15.26:0/3701370409 >> v1:172.21.15.26:6789/0 conn(0x7f8830130e50 legacy=0x7f883006f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:19.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.654+0000 7f882e59c700 1 -- 172.21.15.26:0/3701370409 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8830130340 con 0x7f8830130540 2023-10-01T07:57:19.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.654+0000 7f882ed9d700 1 --2- 172.21.15.26:0/3701370409 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f883006fcf0 0x7f8830138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:19.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.654+0000 7f882e59c700 1 --2- 172.21.15.26:0/3701370409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8830130540 0x7f8830130910 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f8820009840 tx=0x7f8820009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7987a004881853b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:19.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.654+0000 7f882d59a700 1 -- 172.21.15.26:0/3701370409 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8820011830 con 0x7f8830130540 2023-10-01T07:57:19.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.654+0000 7f882d59a700 1 -- 172.21.15.26:0/3701370409 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8820011990 con 0x7f8830130540 2023-10-01T07:57:19.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.654+0000 7f882d59a700 1 -- 172.21.15.26:0/3701370409 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8820011d20 con 0x7f8830130540 2023-10-01T07:57:19.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.655+0000 7f8834a5f700 1 -- 172.21.15.26:0/3701370409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8830130540 msgr2=0x7f8830130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:19.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.655+0000 7f8834a5f700 1 --2- 172.21.15.26:0/3701370409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8830130540 0x7f8830130910 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f8820009840 tx=0x7f8820009b50 comp rx=0 tx=0).stop 2023-10-01T07:57:19.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.656+0000 7f8834a5f700 1 -- 172.21.15.26:0/3701370409 shutdown_connections 2023-10-01T07:57:19.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.656+0000 7f8834a5f700 1 --2- 172.21.15.26:0/3701370409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8830130540 0x7f8830130910 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:19.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.656+0000 7f8834a5f700 1 --2- 172.21.15.26:0/3701370409 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f883006fcf0 0x7f8830138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:19.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.656+0000 7f8834a5f700 1 -- 172.21.15.26:0/3701370409 >> 172.21.15.26:0/3701370409 conn(0x7f88300a2aa0 msgr2=0x7f88300a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:19.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.656+0000 7f8834a5f700 1 -- 172.21.15.26:0/3701370409 shutdown_connections 2023-10-01T07:57:19.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.656+0000 7f8834a5f700 1 -- 172.21.15.26:0/3701370409 wait complete. 2023-10-01T07:57:19.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.657+0000 7f8834a5f700 1 Processor -- start 2023-10-01T07:57:19.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.657+0000 7f8834a5f700 1 -- start start 2023-10-01T07:57:19.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.658+0000 7f8834a5f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f883006fcf0 0x7f883009cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:19.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.658+0000 7f8834a5f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8830130540 0x7f883009d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:19.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.658+0000 7f8834a5f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8830130e50 0x7f883009da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:19.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.658+0000 7f8834a5f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883009e430 con 0x7f8830130e50 2023-10-01T07:57:19.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.658+0000 7f8834a5f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883011b0a0 con 0x7f8830130540 2023-10-01T07:57:19.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.658+0000 7f8834a5f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f883011a450 con 0x7f883006fcf0 2023-10-01T07:57:19.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.658+0000 7f882dd9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8830130540 0x7f883009d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:19.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.658+0000 7f882e59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f883006fcf0 0x7f883009cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:19.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.658+0000 7f882dd9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8830130540 0x7f883009d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46050/0 (socket says 172.21.15.26:46050) 2023-10-01T07:57:19.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.658+0000 7f882dd9b700 1 -- 172.21.15.26:0/2981444006 learned_addr learned my addr 172.21.15.26:0/2981444006 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:19.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.659+0000 7f882e59c700 1 -- 172.21.15.26:0/2981444006 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8830130540 msgr2=0x7f883009d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:19.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.659+0000 7f882e59c700 1 --2- 172.21.15.26:0/2981444006 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8830130540 0x7f883009d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:19.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.659+0000 7f882e59c700 1 -- 172.21.15.26:0/2981444006 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8830130e50 msgr2=0x7f883009da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:19.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.659+0000 7f882e59c700 1 --2- 172.21.15.26:0/2981444006 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8830130e50 0x7f883009da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:19.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.659+0000 7f882e59c700 1 -- 172.21.15.26:0/2981444006 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8828009b30 con 0x7f883006fcf0 2023-10-01T07:57:19.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.659+0000 7f882dd9b700 1 --2- 172.21.15.26:0/2981444006 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8830130540 0x7f883009d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:19.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.659+0000 7f882e59c700 1 --2- 172.21.15.26:0/2981444006 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f883006fcf0 0x7f883009cf80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8820009840 tx=0x7f8820004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:19.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.659+0000 7f881effd700 1 -- 172.21.15.26:0/2981444006 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88200036a0 con 0x7f883006fcf0 2023-10-01T07:57:19.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.659+0000 7f881effd700 1 -- 172.21.15.26:0/2981444006 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882001f070 con 0x7f883006fcf0 2023-10-01T07:57:19.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.659+0000 7f8834a5f700 1 -- 172.21.15.26:0/2981444006 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88200094a0 con 0x7f883006fcf0 2023-10-01T07:57:19.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.659+0000 7f881effd700 1 -- 172.21.15.26:0/2981444006 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8820003a20 con 0x7f883006fcf0 2023-10-01T07:57:19.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.659+0000 7f8834a5f700 1 -- 172.21.15.26:0/2981444006 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88300a1ca0 con 0x7f883006fcf0 2023-10-01T07:57:19.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.660+0000 7f881effd700 1 -- 172.21.15.26:0/2981444006 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8820003b80 con 0x7f883006fcf0 2023-10-01T07:57:19.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.660+0000 7f881effd700 1 -- 172.21.15.26:0/2981444006 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8820021070 con 0x7f883006fcf0 2023-10-01T07:57:19.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.661+0000 7f8834a5f700 1 -- 172.21.15.26:0/2981444006 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88301192f0 con 0x7f883006fcf0 2023-10-01T07:57:19.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.666+0000 7f881effd700 1 -- 172.21.15.26:0/2981444006 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8820003e30 con 0x7f883006fcf0 2023-10-01T07:57:19.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.691+0000 7ff7900d2700 1 Processor -- start 2023-10-01T07:57:19.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.691+0000 7ff7900d2700 1 -- start start 2023-10-01T07:57:19.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.692+0000 7ff7900d2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff7880a0a30 0x7ff7880a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:19.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.692+0000 7ff7900d2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff78809d630 0x7ff7880a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:19.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.692+0000 7ff7900d2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7880a2a70 con 0x7ff788133930 2023-10-01T07:57:19.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.692+0000 7ff7900d2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7880a01d0 con 0x7ff7880a0a30 2023-10-01T07:57:19.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.692+0000 7ff7900d2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff78809e2b0 con 0x7ff78809d630 2023-10-01T07:57:19.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.692+0000 7ff78de6e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff7880a0a30 0x7ff7880a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:19.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.692+0000 7ff78e66f700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff788133930 0x7ff788133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56222/0 (socket says 172.21.15.26:56222) 2023-10-01T07:57:19.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.692+0000 7ff78e66f700 1 -- 172.21.15.26:0/3239563040 learned_addr learned my addr 172.21.15.26:0/3239563040 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:19.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.692+0000 7ff78d66d700 1 --2- 172.21.15.26:0/3239563040 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff78809d630 0x7ff7880a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:19.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.692+0000 7ff78de6e700 1 -- 172.21.15.26:0/3239563040 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff78809d630 msgr2=0x7ff7880a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:19.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.693+0000 7ff78ce6c700 1 -- 172.21.15.26:0/3239563040 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2085147920 0 0) 0x7ff7880a2a70 con 0x7ff788133930 2023-10-01T07:57:19.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.693+0000 7ff78de6e700 1 --2- 172.21.15.26:0/3239563040 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff78809d630 0x7ff7880a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:19.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.693+0000 7ff78de6e700 1 -- 172.21.15.26:0/3239563040 >> v1:172.21.15.26:6789/0 conn(0x7ff788133930 legacy=0x7ff788133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:19.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.693+0000 7ff78de6e700 1 -- 172.21.15.26:0/3239563040 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78809dc50 con 0x7ff7880a0a30 2023-10-01T07:57:19.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.693+0000 7ff78d66d700 1 --2- 172.21.15.26:0/3239563040 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff78809d630 0x7ff7880a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:19.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.693+0000 7ff78de6e700 1 --2- 172.21.15.26:0/3239563040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7880a0a30 0x7ff7880a0e00 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7ff778009d90 tx=0x7ff77800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a29091f6f880dae server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:19.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.693+0000 7ff78ce6c700 1 -- 172.21.15.26:0/3239563040 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77800e070 con 0x7ff7880a0a30 2023-10-01T07:57:19.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.693+0000 7ff78ce6c700 1 -- 172.21.15.26:0/3239563040 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77800bb20 con 0x7ff7880a0a30 2023-10-01T07:57:19.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.693+0000 7ff78ce6c700 1 -- 172.21.15.26:0/3239563040 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff778012430 con 0x7ff7880a0a30 2023-10-01T07:57:19.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.694+0000 7ff7900d2700 1 -- 172.21.15.26:0/3239563040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7880a0a30 msgr2=0x7ff7880a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:19.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.694+0000 7ff7900d2700 1 --2- 172.21.15.26:0/3239563040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7880a0a30 0x7ff7880a0e00 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7ff778009d90 tx=0x7ff77800b330 comp rx=0 tx=0).stop 2023-10-01T07:57:19.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.694+0000 7ff7900d2700 1 -- 172.21.15.26:0/3239563040 shutdown_connections 2023-10-01T07:57:19.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.694+0000 7ff7900d2700 1 --2- 172.21.15.26:0/3239563040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7880a0a30 0x7ff7880a0e00 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:19.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.694+0000 7ff7900d2700 1 --2- 172.21.15.26:0/3239563040 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff78809d630 0x7ff7880a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:19.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.694+0000 7ff7900d2700 1 -- 172.21.15.26:0/3239563040 >> 172.21.15.26:0/3239563040 conn(0x7ff7880a3050 msgr2=0x7ff7880a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:19.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.694+0000 7ff7900d2700 1 -- 172.21.15.26:0/3239563040 shutdown_connections 2023-10-01T07:57:19.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.694+0000 7ff7900d2700 1 -- 172.21.15.26:0/3239563040 wait complete. 2023-10-01T07:57:19.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.695+0000 7ff7900d2700 1 Processor -- start 2023-10-01T07:57:19.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.695+0000 7ff7900d2700 1 -- start start 2023-10-01T07:57:19.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.696+0000 7ff7900d2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff78809d630 0x7ff78811e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:19.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.696+0000 7ff7900d2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff7880a0a30 0x7ff78811ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:19.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.696+0000 7ff7900d2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff788133930 0x7ff78811f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:19.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.696+0000 7ff7900d2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff788133460 con 0x7ff78809d630 2023-10-01T07:57:19.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.696+0000 7ff7900d2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff788120460 con 0x7ff788133930 2023-10-01T07:57:19.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.696+0000 7ff7900d2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7880a4350 con 0x7ff7880a0a30 2023-10-01T07:57:19.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.696+0000 7ff78de6e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff78809d630 0x7ff78811e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:19.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.696+0000 7ff78de6e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff78809d630 0x7ff78811e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55312/0 (socket says 172.21.15.26:55312) 2023-10-01T07:57:19.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.696+0000 7ff78de6e700 1 -- 172.21.15.26:0/1214356346 learned_addr learned my addr 172.21.15.26:0/1214356346 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:19.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.696+0000 7ff78e66f700 1 --2- 172.21.15.26:0/1214356346 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff788133930 0x7ff78811f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:19.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.696+0000 7ff78d66d700 1 --2- 172.21.15.26:0/1214356346 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff7880a0a30 0x7ff78811ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:19.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.696+0000 7ff78de6e700 1 -- 172.21.15.26:0/1214356346 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff7880a0a30 msgr2=0x7ff78811ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:19.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.696+0000 7ff78de6e700 1 --2- 172.21.15.26:0/1214356346 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff7880a0a30 0x7ff78811ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:19.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.696+0000 7ff78de6e700 1 -- 172.21.15.26:0/1214356346 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff788133930 msgr2=0x7ff78811f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:19.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.696+0000 7ff78de6e700 1 --2- 172.21.15.26:0/1214356346 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff788133930 0x7ff78811f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:19.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.696+0000 7ff78de6e700 1 -- 172.21.15.26:0/1214356346 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77c0094a0 con 0x7ff78809d630 2023-10-01T07:57:19.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.697+0000 7ff78de6e700 1 --2- 172.21.15.26:0/1214356346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff78809d630 0x7ff78811e850 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7ff778014040 tx=0x7ff778004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:19.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.697+0000 7ff7867fc700 1 -- 172.21.15.26:0/1214356346 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff778012430 con 0x7ff78809d630 2023-10-01T07:57:19.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.697+0000 7ff7867fc700 1 -- 172.21.15.26:0/1214356346 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff778020070 con 0x7ff78809d630 2023-10-01T07:57:19.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.697+0000 7ff7867fc700 1 -- 172.21.15.26:0/1214356346 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff778004280 con 0x7ff78809d630 2023-10-01T07:57:19.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.697+0000 7ff7900d2700 1 -- 172.21.15.26:0/1214356346 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff778009a70 con 0x7ff78809d630 2023-10-01T07:57:19.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.697+0000 7ff7900d2700 1 -- 172.21.15.26:0/1214356346 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7881209f0 con 0x7ff78809d630 2023-10-01T07:57:19.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.698+0000 7ff7867fc700 1 -- 172.21.15.26:0/1214356346 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff7780043e0 con 0x7ff78809d630 2023-10-01T07:57:19.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.698+0000 7ff7867fc700 1 -- 172.21.15.26:0/1214356346 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff778022070 con 0x7ff78809d630 2023-10-01T07:57:19.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.698+0000 7ff76ffff700 1 -- 172.21.15.26:0/1214356346 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff788121fb0 con 0x7ff78809d630 2023-10-01T07:57:19.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.703+0000 7ff7867fc700 1 -- 172.21.15.26:0/1214356346 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff788121fb0 con 0x7ff78809d630 2023-10-01T07:57:19.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.735+0000 7f5f329c2700 1 Processor -- start 2023-10-01T07:57:19.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.735+0000 7f5f329c2700 1 -- start start 2023-10-01T07:57:19.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.736+0000 7f5f329c2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f2c0a1510 0x7f5f2c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:19.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.736+0000 7f5f329c2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f2c139250 0x7f5f2c13b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:19.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.736+0000 7f5f329c2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f2c09edd0 con 0x7f5f2c0a0a30 2023-10-01T07:57:19.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.736+0000 7f5f329c2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c0a18e0 con 0x7f5f2c139250 2023-10-01T07:57:19.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.736+0000 7f5f329c2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c09e1f0 con 0x7f5f2c0a1510 2023-10-01T07:57:19.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.736+0000 7f5f30f5f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f2c139250 0x7f5f2c13b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:19.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.736+0000 7f5f2bfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5f2c0a0a30 0x7f5f2c0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56238/0 (socket says 172.21.15.26:56238) 2023-10-01T07:57:19.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.736+0000 7f5f2bfff700 1 -- 172.21.15.26:0/3416400189 learned_addr learned my addr 172.21.15.26:0/3416400189 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:19.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.736+0000 7f5f2b7fe700 1 --2- 172.21.15.26:0/3416400189 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f2c0a1510 0x7f5f2c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:19.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.737+0000 7f5f2b7fe700 1 -- 172.21.15.26:0/3416400189 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f2c139250 msgr2=0x7f5f2c13b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:19.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.737+0000 7f5f2b7fe700 1 --2- 172.21.15.26:0/3416400189 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f2c139250 0x7f5f2c13b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:19.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.737+0000 7f5f2b7fe700 1 -- 172.21.15.26:0/3416400189 >> v1:172.21.15.26:6789/0 conn(0x7f5f2c0a0a30 legacy=0x7f5f2c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:19.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.737+0000 7f5f2b7fe700 1 -- 172.21.15.26:0/3416400189 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2c09dc50 con 0x7f5f2c0a1510 2023-10-01T07:57:19.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.737+0000 7f5f2affd700 1 -- 172.21.15.26:0/3416400189 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3892555088 0 0) 0x7f5f2c09edd0 con 0x7f5f2c0a0a30 2023-10-01T07:57:19.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.737+0000 7f5f30f5f700 1 --2- 172.21.15.26:0/3416400189 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f2c139250 0x7f5f2c13b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:19.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.737+0000 7f5f2b7fe700 1 --2- 172.21.15.26:0/3416400189 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f2c0a1510 0x7f5f2c138d10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5f20009870 tx=0x7f5f20009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d916e69d78a7836 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:19.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.737+0000 7f5f2affd700 1 -- 172.21.15.26:0/3416400189 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f20011830 con 0x7f5f2c0a1510 2023-10-01T07:57:19.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.737+0000 7f5f2affd700 1 -- 172.21.15.26:0/3416400189 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f20011990 con 0x7f5f2c0a1510 2023-10-01T07:57:19.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.737+0000 7f5f2affd700 1 -- 172.21.15.26:0/3416400189 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f20011d20 con 0x7f5f2c0a1510 2023-10-01T07:57:19.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.738+0000 7f5f329c2700 1 -- 172.21.15.26:0/3416400189 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f2c0a1510 msgr2=0x7f5f2c138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:19.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.738+0000 7f5f329c2700 1 --2- 172.21.15.26:0/3416400189 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f2c0a1510 0x7f5f2c138d10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5f20009870 tx=0x7f5f20009b80 comp rx=0 tx=0).stop 2023-10-01T07:57:19.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.738+0000 7f5f329c2700 1 -- 172.21.15.26:0/3416400189 shutdown_connections 2023-10-01T07:57:19.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.738+0000 7f5f329c2700 1 --2- 172.21.15.26:0/3416400189 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f2c139250 0x7f5f2c13b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:19.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.738+0000 7f5f329c2700 1 --2- 172.21.15.26:0/3416400189 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f2c0a1510 0x7f5f2c138d10 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:19.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.738+0000 7f5f329c2700 1 -- 172.21.15.26:0/3416400189 >> 172.21.15.26:0/3416400189 conn(0x7f5f2c0a6550 msgr2=0x7f5f2c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:19.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.738+0000 7f5f329c2700 1 -- 172.21.15.26:0/3416400189 shutdown_connections 2023-10-01T07:57:19.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.738+0000 7f5f329c2700 1 -- 172.21.15.26:0/3416400189 wait complete. 2023-10-01T07:57:19.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.739+0000 7f5f329c2700 1 Processor -- start 2023-10-01T07:57:19.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.739+0000 7f5f329c2700 1 -- start start 2023-10-01T07:57:19.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.740+0000 7f5f329c2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f2c0a0a30 0x7f5f2c122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:19.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.740+0000 7f5f329c2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f2c0a1510 0x7f5f2c122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:19.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.740+0000 7f5f329c2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f2c139250 0x7f5f2c123380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:19.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.740+0000 7f5f329c2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c125c00 con 0x7f5f2c0a1510 2023-10-01T07:57:19.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.740+0000 7f5f329c2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c138180 con 0x7f5f2c0a0a30 2023-10-01T07:57:19.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.740+0000 7f5f329c2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c1389a0 con 0x7f5f2c139250 2023-10-01T07:57:19.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.740+0000 7f5f2b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f2c0a1510 0x7f5f2c122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:19.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.740+0000 7f5f30f5f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f2c139250 0x7f5f2c123380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:19.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.740+0000 7f5f2b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f2c0a1510 0x7f5f2c122e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55326/0 (socket says 172.21.15.26:55326) 2023-10-01T07:57:19.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.740+0000 7f5f30f5f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f2c139250 0x7f5f2c123380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49750/0 (socket says 172.21.15.26:49750) 2023-10-01T07:57:19.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.740+0000 7f5f2b7fe700 1 -- 172.21.15.26:0/2601556412 learned_addr learned my addr 172.21.15.26:0/2601556412 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:19.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.740+0000 7f5f2bfff700 1 --2- 172.21.15.26:0/2601556412 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f2c0a0a30 0x7f5f2c122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:19.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.740+0000 7f5f2b7fe700 1 -- 172.21.15.26:0/2601556412 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f2c139250 msgr2=0x7f5f2c123380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:19.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.740+0000 7f5f2b7fe700 1 --2- 172.21.15.26:0/2601556412 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f2c139250 0x7f5f2c123380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:19.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.740+0000 7f5f2b7fe700 1 -- 172.21.15.26:0/2601556412 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f2c0a0a30 msgr2=0x7f5f2c122900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:19.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.740+0000 7f5f2b7fe700 1 --2- 172.21.15.26:0/2601556412 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f2c0a0a30 0x7f5f2c122900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:19.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.740+0000 7f5f2b7fe700 1 -- 172.21.15.26:0/2601556412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f24009a70 con 0x7f5f2c0a1510 2023-10-01T07:57:19.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.740+0000 7f5f2bfff700 1 --2- 172.21.15.26:0/2601556412 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f2c0a0a30 0x7f5f2c122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:19.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.740+0000 7f5f30f5f700 1 --2- 172.21.15.26:0/2601556412 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f2c139250 0x7f5f2c123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:19.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.740+0000 7f5f2b7fe700 1 --2- 172.21.15.26:0/2601556412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f2c0a1510 0x7f5f2c122e40 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f5f20009840 tx=0x7f5f20004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:19.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.741+0000 7f5f28ff9700 1 -- 172.21.15.26:0/2601556412 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f200044d0 con 0x7f5f2c0a1510 2023-10-01T07:57:19.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.741+0000 7f5f28ff9700 1 -- 172.21.15.26:0/2601556412 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2001f070 con 0x7f5f2c0a1510 2023-10-01T07:57:19.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.741+0000 7f5f329c2700 1 -- 172.21.15.26:0/2601556412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f200094a0 con 0x7f5f2c0a1510 2023-10-01T07:57:19.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.741+0000 7f5f28ff9700 1 -- 172.21.15.26:0/2601556412 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f200038e0 con 0x7f5f2c0a1510 2023-10-01T07:57:19.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.741+0000 7f5f329c2700 1 -- 172.21.15.26:0/2601556412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f2c138760 con 0x7f5f2c0a1510 2023-10-01T07:57:19.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.742+0000 7f5f28ff9700 1 -- 172.21.15.26:0/2601556412 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5f20003a40 con 0x7f5f2c0a1510 2023-10-01T07:57:19.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.742+0000 7f5f28ff9700 1 -- 172.21.15.26:0/2601556412 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5f20021070 con 0x7f5f2c0a1510 2023-10-01T07:57:19.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.742+0000 7f5f329c2700 1 -- 172.21.15.26:0/2601556412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f2c0a1d00 con 0x7f5f2c0a1510 2023-10-01T07:57:19.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.747+0000 7f5f28ff9700 1 -- 172.21.15.26:0/2601556412 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5f2002b070 con 0x7f5f2c0a1510 2023-10-01T07:57:19.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.887+0000 7f8834a5f700 1 -- 172.21.15.26:0/2981444006 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f883011a050 con 0x7f883006fcf0 2023-10-01T07:57:19.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.887+0000 7f881effd700 1 -- 172.21.15.26:0/2981444006 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f882002eb90 con 0x7f883006fcf0 2023-10-01T07:57:19.888 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:19.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.890+0000 7f8834a5f700 1 -- 172.21.15.26:0/2981444006 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f883006fcf0 msgr2=0x7f883009cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:19.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.890+0000 7f8834a5f700 1 --2- 172.21.15.26:0/2981444006 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f883006fcf0 0x7f883009cf80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8820009840 tx=0x7f8820004750 comp rx=0 tx=0).stop 2023-10-01T07:57:19.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.891+0000 7f8834a5f700 1 -- 172.21.15.26:0/2981444006 shutdown_connections 2023-10-01T07:57:19.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.891+0000 7f8834a5f700 1 --2- 172.21.15.26:0/2981444006 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8830130e50 0x7f883009da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:19.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.891+0000 7f8834a5f700 1 --2- 172.21.15.26:0/2981444006 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f883006fcf0 0x7f883009cf80 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:19.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.891+0000 7f8834a5f700 1 --2- 172.21.15.26:0/2981444006 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8830130540 0x7f883009d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:19.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.891+0000 7f8834a5f700 1 -- 172.21.15.26:0/2981444006 >> 172.21.15.26:0/2981444006 conn(0x7f88300a2aa0 msgr2=0x7f883012d700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:19.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.891+0000 7f8834a5f700 1 -- 172.21.15.26:0/2981444006 shutdown_connections 2023-10-01T07:57:19.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.891+0000 7f8834a5f700 1 -- 172.21.15.26:0/2981444006 wait complete. 2023-10-01T07:57:19.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:19.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.911+0000 7ff76ffff700 1 -- 172.21.15.26:0/1214356346 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff7880a0410 con 0x7ff78809d630 2023-10-01T07:57:19.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.912+0000 7ff7867fc700 1 -- 172.21.15.26:0/1214356346 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff778035090 con 0x7ff78809d630 2023-10-01T07:57:19.912 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:19.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.914+0000 7ff76ffff700 1 -- 172.21.15.26:0/1214356346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff78809d630 msgr2=0x7ff78811e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:19.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.914+0000 7ff76ffff700 1 --2- 172.21.15.26:0/1214356346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff78809d630 0x7ff78811e850 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7ff778014040 tx=0x7ff778004ad0 comp rx=0 tx=0).stop 2023-10-01T07:57:19.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.914+0000 7ff76ffff700 1 -- 172.21.15.26:0/1214356346 shutdown_connections 2023-10-01T07:57:19.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.914+0000 7ff76ffff700 1 --2- 172.21.15.26:0/1214356346 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff788133930 0x7ff78811f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:19.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.914+0000 7ff76ffff700 1 --2- 172.21.15.26:0/1214356346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff78809d630 0x7ff78811e850 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:19.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.914+0000 7ff76ffff700 1 --2- 172.21.15.26:0/1214356346 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff7880a0a30 0x7ff78811ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:19.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.914+0000 7ff76ffff700 1 -- 172.21.15.26:0/1214356346 >> 172.21.15.26:0/1214356346 conn(0x7ff7880a3050 msgr2=0x7ff7881bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:19.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.914+0000 7ff76ffff700 1 -- 172.21.15.26:0/1214356346 shutdown_connections 2023-10-01T07:57:19.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.914+0000 7ff76ffff700 1 -- 172.21.15.26:0/1214356346 wait complete. 2023-10-01T07:57:19.929 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:19.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.964+0000 7f5f329c2700 1 -- 172.21.15.26:0/2601556412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5f2c124cd0 con 0x7f5f2c0a1510 2023-10-01T07:57:19.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.964+0000 7f5f28ff9700 1 -- 172.21.15.26:0/2601556412 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f20015030 con 0x7f5f2c0a1510 2023-10-01T07:57:19.965 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:19.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.967+0000 7f5f329c2700 1 -- 172.21.15.26:0/2601556412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f2c0a1510 msgr2=0x7f5f2c122e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:19.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.967+0000 7f5f329c2700 1 --2- 172.21.15.26:0/2601556412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f2c0a1510 0x7f5f2c122e40 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f5f20009840 tx=0x7f5f20004750 comp rx=0 tx=0).stop 2023-10-01T07:57:19.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.967+0000 7f5f329c2700 1 -- 172.21.15.26:0/2601556412 shutdown_connections 2023-10-01T07:57:19.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.967+0000 7f5f329c2700 1 --2- 172.21.15.26:0/2601556412 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5f2c139250 0x7f5f2c123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:19.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.967+0000 7f5f329c2700 1 --2- 172.21.15.26:0/2601556412 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f2c0a0a30 0x7f5f2c122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:19.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.967+0000 7f5f329c2700 1 --2- 172.21.15.26:0/2601556412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f2c0a1510 0x7f5f2c122e40 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:19.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.967+0000 7f5f329c2700 1 -- 172.21.15.26:0/2601556412 >> 172.21.15.26:0/2601556412 conn(0x7f5f2c0a6550 msgr2=0x7f5f2c09ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:19.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.967+0000 7f5f329c2700 1 -- 172.21.15.26:0/2601556412 shutdown_connections 2023-10-01T07:57:19.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:19.967+0000 7f5f329c2700 1 -- 172.21.15.26:0/2601556412 wait complete. 2023-10-01T07:57:19.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:20.212 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:20.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.357+0000 7f2a06683700 1 Processor -- start 2023-10-01T07:57:20.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.357+0000 7f2a06683700 1 -- start start 2023-10-01T07:57:20.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.357+0000 7f2a06683700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a000a0a30 0x7f2a000a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:20.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.357+0000 7f2a06683700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a00134170 0x7f2a0013bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:20.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.357+0000 7f2a06683700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a0009edd0 con 0x7f2a000a1340 2023-10-01T07:57:20.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.357+0000 7f2a06683700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0009e1f0 con 0x7f2a000a0a30 2023-10-01T07:57:20.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.357+0000 7f2a06683700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0009dc50 con 0x7f2a00134170 2023-10-01T07:57:20.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.357+0000 7f29fffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a000a0a30 0x7f2a000a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:20.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.357+0000 7f2a04c20700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a00134170 0x7f2a0013bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:20.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.357+0000 7f29ff7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2a000a1340 0x7f2a00133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56252/0 (socket says 172.21.15.26:56252) 2023-10-01T07:57:20.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.357+0000 7f29ff7fe700 1 -- 172.21.15.26:0/1339660594 learned_addr learned my addr 172.21.15.26:0/1339660594 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:20.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.358+0000 7f29feffd700 1 -- 172.21.15.26:0/1339660594 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638063419 0 0) 0x7f2a0009edd0 con 0x7f2a000a1340 2023-10-01T07:57:20.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.358+0000 7f29fffff700 1 -- 172.21.15.26:0/1339660594 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a00134170 msgr2=0x7f2a0013bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:20.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.358+0000 7f29fffff700 1 --2- 172.21.15.26:0/1339660594 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a00134170 0x7f2a0013bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:20.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.358+0000 7f29fffff700 1 -- 172.21.15.26:0/1339660594 >> v1:172.21.15.26:6789/0 conn(0x7f2a000a1340 legacy=0x7f2a00133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:20.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.358+0000 7f29fffff700 1 -- 172.21.15.26:0/1339660594 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a000a1fe0 con 0x7f2a000a0a30 2023-10-01T07:57:20.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.358+0000 7f2a04c20700 1 --2- 172.21.15.26:0/1339660594 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a00134170 0x7f2a0013bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:20.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.358+0000 7f29fffff700 1 --2- 172.21.15.26:0/1339660594 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a000a0a30 0x7f2a000a0e00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f29f0009870 tx=0x7f29f0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b7b965aafab6bbe server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:20.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.358+0000 7f29feffd700 1 -- 172.21.15.26:0/1339660594 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f0011830 con 0x7f2a000a0a30 2023-10-01T07:57:20.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.358+0000 7f29feffd700 1 -- 172.21.15.26:0/1339660594 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f0011990 con 0x7f2a000a0a30 2023-10-01T07:57:20.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.358+0000 7f29feffd700 1 -- 172.21.15.26:0/1339660594 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f0011d20 con 0x7f2a000a0a30 2023-10-01T07:57:20.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.359+0000 7f2a06683700 1 -- 172.21.15.26:0/1339660594 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a000a0a30 msgr2=0x7f2a000a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:20.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.359+0000 7f2a06683700 1 --2- 172.21.15.26:0/1339660594 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a000a0a30 0x7f2a000a0e00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f29f0009870 tx=0x7f29f0009b80 comp rx=0 tx=0).stop 2023-10-01T07:57:20.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.359+0000 7f2a06683700 1 -- 172.21.15.26:0/1339660594 shutdown_connections 2023-10-01T07:57:20.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.359+0000 7f2a06683700 1 --2- 172.21.15.26:0/1339660594 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a00134170 0x7f2a0013bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:20.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.359+0000 7f2a06683700 1 --2- 172.21.15.26:0/1339660594 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a000a0a30 0x7f2a000a0e00 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:20.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.359+0000 7f2a06683700 1 -- 172.21.15.26:0/1339660594 >> 172.21.15.26:0/1339660594 conn(0x7f2a000a6550 msgr2=0x7f2a000a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:20.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.359+0000 7f2a06683700 1 -- 172.21.15.26:0/1339660594 shutdown_connections 2023-10-01T07:57:20.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.359+0000 7f2a06683700 1 -- 172.21.15.26:0/1339660594 wait complete. 2023-10-01T07:57:20.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.360+0000 7f2a06683700 1 Processor -- start 2023-10-01T07:57:20.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.360+0000 7f2a06683700 1 -- start start 2023-10-01T07:57:20.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.360+0000 7f2a06683700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a000a0a30 0x7f2a001c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:20.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.360+0000 7f2a06683700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a000a1340 0x7f2a001c8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:20.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.360+0000 7f2a06683700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a00134170 0x7f2a001c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:20.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.360+0000 7f2a06683700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a00126440 con 0x7f2a000a0a30 2023-10-01T07:57:20.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.360+0000 7f2a06683700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a001246d0 con 0x7f2a000a1340 2023-10-01T07:57:20.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.360+0000 7f2a06683700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a001244a0 con 0x7f2a00134170 2023-10-01T07:57:20.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.361+0000 7f29fffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a000a0a30 0x7f2a001c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:20.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.361+0000 7f29ff7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a000a1340 0x7f2a001c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:20.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.361+0000 7f29fffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a000a0a30 0x7f2a001c8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55328/0 (socket says 172.21.15.26:55328) 2023-10-01T07:57:20.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.361+0000 7f29fffff700 1 -- 172.21.15.26:0/3161358671 learned_addr learned my addr 172.21.15.26:0/3161358671 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:20.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.361+0000 7f2a04c20700 1 --2- 172.21.15.26:0/3161358671 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a00134170 0x7f2a001c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:20.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.361+0000 7f29ff7fe700 1 -- 172.21.15.26:0/3161358671 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a00134170 msgr2=0x7f2a001c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:20.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.361+0000 7f29ff7fe700 1 --2- 172.21.15.26:0/3161358671 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a00134170 0x7f2a001c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:20.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.361+0000 7f29ff7fe700 1 -- 172.21.15.26:0/3161358671 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a000a0a30 msgr2=0x7f2a001c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:20.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.361+0000 7f29ff7fe700 1 --2- 172.21.15.26:0/3161358671 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a000a0a30 0x7f2a001c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:20.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.361+0000 7f29ff7fe700 1 -- 172.21.15.26:0/3161358671 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f8009a70 con 0x7f2a000a1340 2023-10-01T07:57:20.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.361+0000 7f29ff7fe700 1 --2- 172.21.15.26:0/3161358671 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a000a1340 0x7f2a001c8990 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f29f400c470 tx=0x7f29f400c780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:20.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.361+0000 7f29fcff9700 1 -- 172.21.15.26:0/3161358671 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f4004c80 con 0x7f2a000a1340 2023-10-01T07:57:20.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.361+0000 7f29fcff9700 1 -- 172.21.15.26:0/3161358671 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f4004de0 con 0x7f2a000a1340 2023-10-01T07:57:20.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.361+0000 7f29fcff9700 1 -- 172.21.15.26:0/3161358671 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f4007310 con 0x7f2a000a1340 2023-10-01T07:57:20.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.361+0000 7f2a06683700 1 -- 172.21.15.26:0/3161358671 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f00094a0 con 0x7f2a000a1340 2023-10-01T07:57:20.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.361+0000 7f2a06683700 1 -- 172.21.15.26:0/3161358671 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a000a25e0 con 0x7f2a000a1340 2023-10-01T07:57:20.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.362+0000 7f29fcff9700 1 -- 172.21.15.26:0/3161358671 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f29f4007470 con 0x7f2a000a1340 2023-10-01T07:57:20.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.362+0000 7f29fcff9700 1 -- 172.21.15.26:0/3161358671 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f29f403f2d0 con 0x7f2a000a1340 2023-10-01T07:57:20.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.363+0000 7f2a06683700 1 -- 172.21.15.26:0/3161358671 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a00126260 con 0x7f2a000a1340 2023-10-01T07:57:20.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.368+0000 7f29fcff9700 1 -- 172.21.15.26:0/3161358671 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f29f4007720 con 0x7f2a000a1340 2023-10-01T07:57:20.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.572+0000 7f2a06683700 1 -- 172.21.15.26:0/3161358671 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2a0009c7e0 con 0x7f2a000a1340 2023-10-01T07:57:20.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.572+0000 7f29fcff9700 1 -- 172.21.15.26:0/3161358671 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f29f4011360 con 0x7f2a000a1340 2023-10-01T07:57:20.573 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:20.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.574+0000 7f2a06683700 1 -- 172.21.15.26:0/3161358671 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a000a1340 msgr2=0x7f2a001c8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:20.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.574+0000 7f2a06683700 1 --2- 172.21.15.26:0/3161358671 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a000a1340 0x7f2a001c8990 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f29f400c470 tx=0x7f29f400c780 comp rx=0 tx=0).stop 2023-10-01T07:57:20.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.574+0000 7f2a06683700 1 -- 172.21.15.26:0/3161358671 shutdown_connections 2023-10-01T07:57:20.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.574+0000 7f2a06683700 1 --2- 172.21.15.26:0/3161358671 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a00134170 0x7f2a001c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:20.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.574+0000 7f2a06683700 1 --2- 172.21.15.26:0/3161358671 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a000a0a30 0x7f2a001c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:20.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.574+0000 7f2a06683700 1 --2- 172.21.15.26:0/3161358671 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a000a1340 0x7f2a001c8990 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:20.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.574+0000 7f2a06683700 1 -- 172.21.15.26:0/3161358671 >> 172.21.15.26:0/3161358671 conn(0x7f2a000a6550 msgr2=0x7f2a0009edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:20.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.574+0000 7f2a06683700 1 -- 172.21.15.26:0/3161358671 shutdown_connections 2023-10-01T07:57:20.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:20.574+0000 7f2a06683700 1 -- 172.21.15.26:0/3161358671 wait complete. 2023-10-01T07:57:20.589 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:20.910 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:20.930 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:20.981 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:21.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.060+0000 7f714ba72700 1 Processor -- start 2023-10-01T07:57:21.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.060+0000 7f714ba72700 1 -- start start 2023-10-01T07:57:21.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.061+0000 7f714ba72700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f714406a770 0x7f714406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:21.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.061+0000 7f714ba72700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f714406b080 0x7f7144131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:21.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.061+0000 7f714ba72700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7144131b40 0x7f7144131fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:21.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.061+0000 7f714ba72700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f714409ece0 con 0x7f714406a770 2023-10-01T07:57:21.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.061+0000 7f714ba72700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f714409e760 con 0x7f7144131b40 2023-10-01T07:57:21.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.061+0000 7f714ba72700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f714409e040 con 0x7f714406b080 2023-10-01T07:57:21.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.061+0000 7f714900d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f714406b080 0x7f7144131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:21.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.061+0000 7f714980e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f714406a770 0x7f714406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:21.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.061+0000 7f714900d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f714406b080 0x7f7144131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49760/0 (socket says 172.21.15.26:49760) 2023-10-01T07:57:21.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.061+0000 7f714900d700 1 -- 172.21.15.26:0/2289500707 learned_addr learned my addr 172.21.15.26:0/2289500707 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:21.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.061+0000 7f714a00f700 1 --2- 172.21.15.26:0/2289500707 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7144131b40 0x7f7144131fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:21.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.061+0000 7f714980e700 1 -- 172.21.15.26:0/2289500707 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f714406b080 msgr2=0x7f7144131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:21.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.061+0000 7f714980e700 1 --2- 172.21.15.26:0/2289500707 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f714406b080 0x7f7144131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.061+0000 7f714980e700 1 -- 172.21.15.26:0/2289500707 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7144131b40 msgr2=0x7f7144131fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:21.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.061+0000 7f714980e700 1 --2- 172.21.15.26:0/2289500707 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7144131b40 0x7f7144131fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.061+0000 7f714980e700 1 -- 172.21.15.26:0/2289500707 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714409f630 con 0x7f714406a770 2023-10-01T07:57:21.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.062+0000 7f714980e700 1 --2- 172.21.15.26:0/2289500707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f714406a770 0x7f714406ab40 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f7140009840 tx=0x7f7140009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1bb71218b4d624 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:21.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.062+0000 7f714880c700 1 -- 172.21.15.26:0/2289500707 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7140011830 con 0x7f714406a770 2023-10-01T07:57:21.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.062+0000 7f714880c700 1 -- 172.21.15.26:0/2289500707 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7140011990 con 0x7f714406a770 2023-10-01T07:57:21.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.062+0000 7f714880c700 1 -- 172.21.15.26:0/2289500707 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7140011d20 con 0x7f714406a770 2023-10-01T07:57:21.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.063+0000 7f714ba72700 1 -- 172.21.15.26:0/2289500707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f714406a770 msgr2=0x7f714406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:21.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.063+0000 7f714ba72700 1 --2- 172.21.15.26:0/2289500707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f714406a770 0x7f714406ab40 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f7140009840 tx=0x7f7140009b50 comp rx=0 tx=0).stop 2023-10-01T07:57:21.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.063+0000 7f714ba72700 1 -- 172.21.15.26:0/2289500707 shutdown_connections 2023-10-01T07:57:21.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.063+0000 7f714ba72700 1 --2- 172.21.15.26:0/2289500707 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7144131b40 0x7f7144131fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.063+0000 7f714ba72700 1 --2- 172.21.15.26:0/2289500707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f714406a770 0x7f714406ab40 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.063+0000 7f714ba72700 1 --2- 172.21.15.26:0/2289500707 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f714406b080 0x7f7144131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.063+0000 7f714ba72700 1 -- 172.21.15.26:0/2289500707 >> 172.21.15.26:0/2289500707 conn(0x7f7144066f50 msgr2=0x7f714409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:21.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.063+0000 7f714ba72700 1 -- 172.21.15.26:0/2289500707 shutdown_connections 2023-10-01T07:57:21.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.063+0000 7f714ba72700 1 -- 172.21.15.26:0/2289500707 wait complete. 2023-10-01T07:57:21.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.064+0000 7f714ba72700 1 Processor -- start 2023-10-01T07:57:21.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.064+0000 7f714ba72700 1 -- start start 2023-10-01T07:57:21.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.065+0000 7f714ba72700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f714406a770 0x7f71441c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:21.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.065+0000 7f714ba72700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f714406b080 0x7f71441c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:21.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.065+0000 7f714ba72700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7144131b40 0x7f71441c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:21.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.065+0000 7f714ba72700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7144124e00 con 0x7f714406a770 2023-10-01T07:57:21.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.065+0000 7f714ba72700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f714409c200 con 0x7f7144131b40 2023-10-01T07:57:21.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.065+0000 7f714ba72700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7144126440 con 0x7f714406b080 2023-10-01T07:57:21.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.065+0000 7f714980e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f714406a770 0x7f71441c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:21.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.065+0000 7f714900d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f714406b080 0x7f71441c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:21.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.065+0000 7f714980e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f714406a770 0x7f71441c8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55348/0 (socket says 172.21.15.26:55348) 2023-10-01T07:57:21.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.065+0000 7f714980e700 1 -- 172.21.15.26:0/2291006048 learned_addr learned my addr 172.21.15.26:0/2291006048 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:21.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.066+0000 7f714a00f700 1 --2- 172.21.15.26:0/2291006048 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7144131b40 0x7f71441c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:21.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.066+0000 7f714900d700 1 -- 172.21.15.26:0/2291006048 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7144131b40 msgr2=0x7f71441c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:21.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.066+0000 7f714900d700 1 --2- 172.21.15.26:0/2291006048 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7144131b40 0x7f71441c8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.066+0000 7f714900d700 1 -- 172.21.15.26:0/2291006048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f714406a770 msgr2=0x7f71441c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:21.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.066+0000 7f714900d700 1 --2- 172.21.15.26:0/2291006048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f714406a770 0x7f71441c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.066+0000 7f714900d700 1 -- 172.21.15.26:0/2291006048 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71400094a0 con 0x7f714406b080 2023-10-01T07:57:21.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.066+0000 7f714980e700 1 --2- 172.21.15.26:0/2291006048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f714406a770 0x7f71441c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:21.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.066+0000 7f714900d700 1 --2- 172.21.15.26:0/2291006048 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f714406b080 0x7f71441c8680 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f713400e910 tx=0x7f713400ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:21.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.066+0000 7f713a7fc700 1 -- 172.21.15.26:0/2291006048 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7134013680 con 0x7f714406b080 2023-10-01T07:57:21.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.066+0000 7f713a7fc700 1 -- 172.21.15.26:0/2291006048 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71340137e0 con 0x7f714406b080 2023-10-01T07:57:21.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.066+0000 7f713a7fc700 1 -- 172.21.15.26:0/2291006048 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7134013b70 con 0x7f714406b080 2023-10-01T07:57:21.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.066+0000 7f714ba72700 1 -- 172.21.15.26:0/2291006048 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71441254b0 con 0x7f714406b080 2023-10-01T07:57:21.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.066+0000 7f714ba72700 1 -- 172.21.15.26:0/2291006048 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f714406ede0 con 0x7f714406b080 2023-10-01T07:57:21.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.067+0000 7f713a7fc700 1 -- 172.21.15.26:0/2291006048 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7134013cd0 con 0x7f714406b080 2023-10-01T07:57:21.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.068+0000 7f713a7fc700 1 -- 172.21.15.26:0/2291006048 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f713403fb00 con 0x7f714406b080 2023-10-01T07:57:21.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.068+0000 7f714ba72700 1 -- 172.21.15.26:0/2291006048 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7144126280 con 0x7f714406b080 2023-10-01T07:57:21.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.077+0000 7f713a7fc700 1 -- 172.21.15.26:0/2291006048 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7134021020 con 0x7f714406b080 2023-10-01T07:57:21.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.100+0000 7f7152275700 1 Processor -- start 2023-10-01T07:57:21.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.100+0000 7f7152275700 1 -- start start 2023-10-01T07:57:21.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.101+0000 7f7152275700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f714c1338c0 0x7f714c133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:21.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.101+0000 7f7152275700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f714c1341d0 0x7f714c09de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:21.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.101+0000 7f7152275700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f714c09e390 0x7f714c09e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:21.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.101+0000 7f7152275700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f714c070c80 con 0x7f714c1338c0 2023-10-01T07:57:21.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.101+0000 7f7152275700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f714c09ed20 con 0x7f714c1341d0 2023-10-01T07:57:21.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.101+0000 7f7152275700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f714c06f720 con 0x7f714c09e390 2023-10-01T07:57:21.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.101+0000 7f714bfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f714c1338c0 0x7f714c133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:21.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.101+0000 7f714b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f714c1341d0 0x7f714c09de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:21.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.102+0000 7f714bfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f714c1338c0 0x7f714c133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55364/0 (socket says 172.21.15.26:55364) 2023-10-01T07:57:21.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.102+0000 7f714bfff700 1 -- 172.21.15.26:0/1208118684 learned_addr learned my addr 172.21.15.26:0/1208118684 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:21.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.102+0000 7f7150812700 1 --2- 172.21.15.26:0/1208118684 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f714c09e390 0x7f714c09e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:21.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.102+0000 7f714b7fe700 1 -- 172.21.15.26:0/1208118684 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f714c09e390 msgr2=0x7f714c09e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:21.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.102+0000 7f714b7fe700 1 --2- 172.21.15.26:0/1208118684 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f714c09e390 0x7f714c09e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.102+0000 7f714b7fe700 1 -- 172.21.15.26:0/1208118684 >> v2:172.21.15.26:3300/0 conn(0x7f714c1338c0 msgr2=0x7f714c133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:21.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.102+0000 7f714b7fe700 1 --2- 172.21.15.26:0/1208118684 >> v2:172.21.15.26:3300/0 conn(0x7f714c1338c0 0x7f714c133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.102+0000 7f714b7fe700 1 -- 172.21.15.26:0/1208118684 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714c06fce0 con 0x7f714c1341d0 2023-10-01T07:57:21.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.102+0000 7f714b7fe700 1 --2- 172.21.15.26:0/1208118684 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f714c1341d0 0x7f714c09de50 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7140009870 tx=0x7f7140009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bd93c3c769f1fad server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:21.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.102+0000 7f714affd700 1 -- 172.21.15.26:0/1208118684 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7140011830 con 0x7f714c1341d0 2023-10-01T07:57:21.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.102+0000 7f714affd700 1 -- 172.21.15.26:0/1208118684 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7140011990 con 0x7f714c1341d0 2023-10-01T07:57:21.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.102+0000 7f714affd700 1 -- 172.21.15.26:0/1208118684 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7140011d20 con 0x7f714c1341d0 2023-10-01T07:57:21.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.103+0000 7f7152275700 1 -- 172.21.15.26:0/1208118684 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f714c1341d0 msgr2=0x7f714c09de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:21.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.103+0000 7f7152275700 1 --2- 172.21.15.26:0/1208118684 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f714c1341d0 0x7f714c09de50 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7140009870 tx=0x7f7140009b80 comp rx=0 tx=0).stop 2023-10-01T07:57:21.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.103+0000 7f7152275700 1 -- 172.21.15.26:0/1208118684 shutdown_connections 2023-10-01T07:57:21.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.103+0000 7f7152275700 1 --2- 172.21.15.26:0/1208118684 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f714c09e390 0x7f714c09e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.103+0000 7f7152275700 1 --2- 172.21.15.26:0/1208118684 >> v2:172.21.15.26:3300/0 conn(0x7f714c1338c0 0x7f714c133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.103+0000 7f7152275700 1 --2- 172.21.15.26:0/1208118684 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f714c1341d0 0x7f714c09de50 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.103+0000 7f7152275700 1 -- 172.21.15.26:0/1208118684 >> 172.21.15.26:0/1208118684 conn(0x7f714c0a2aa0 msgr2=0x7f714c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:21.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.103+0000 7f7152275700 1 -- 172.21.15.26:0/1208118684 shutdown_connections 2023-10-01T07:57:21.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.103+0000 7f7152275700 1 -- 172.21.15.26:0/1208118684 wait complete. 2023-10-01T07:57:21.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.104+0000 7f7152275700 1 Processor -- start 2023-10-01T07:57:21.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.104+0000 7f7152275700 1 -- start start 2023-10-01T07:57:21.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.105+0000 7f7152275700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f714c09e390 0x7f714c119780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:21.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.105+0000 7f7152275700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f714c1338c0 0x7f714c119cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:21.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.105+0000 7f7152275700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f714c1341d0 0x7f714c11a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:21.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.105+0000 7f7152275700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c11bb30 con 0x7f714c1338c0 2023-10-01T07:57:21.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.105+0000 7f7152275700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f714c11b3e0 con 0x7f714c1341d0 2023-10-01T07:57:21.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.105+0000 7f7152275700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f714c06f960 con 0x7f714c09e390 2023-10-01T07:57:21.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.105+0000 7f7150812700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f714c1341d0 0x7f714c11a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:21.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.105+0000 7f714b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f714c1338c0 0x7f714c119cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:21.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.105+0000 7f7150812700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f714c1341d0 0x7f714c11a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46148/0 (socket says 172.21.15.26:46148) 2023-10-01T07:57:21.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.105+0000 7f714b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f714c1338c0 0x7f714c119cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55370/0 (socket says 172.21.15.26:55370) 2023-10-01T07:57:21.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.105+0000 7f7150812700 1 -- 172.21.15.26:0/347894490 learned_addr learned my addr 172.21.15.26:0/347894490 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:21.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.105+0000 7f714bfff700 1 --2- 172.21.15.26:0/347894490 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f714c09e390 0x7f714c119780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:21.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.106+0000 7f7150812700 1 -- 172.21.15.26:0/347894490 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f714c09e390 msgr2=0x7f714c119780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:21.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.106+0000 7f7150812700 1 --2- 172.21.15.26:0/347894490 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f714c09e390 0x7f714c119780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.106+0000 7f7150812700 1 -- 172.21.15.26:0/347894490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f714c1338c0 msgr2=0x7f714c119cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:21.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.106+0000 7f7150812700 1 --2- 172.21.15.26:0/347894490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f714c1338c0 0x7f714c119cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.106+0000 7f7150812700 1 -- 172.21.15.26:0/347894490 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71400094a0 con 0x7f714c1341d0 2023-10-01T07:57:21.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.106+0000 7f714b7fe700 1 --2- 172.21.15.26:0/347894490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f714c1338c0 0x7f714c119cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:21.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.106+0000 7f714bfff700 1 --2- 172.21.15.26:0/347894490 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f714c09e390 0x7f714c119780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:21.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.106+0000 7f7150812700 1 --2- 172.21.15.26:0/347894490 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f714c1341d0 0x7f714c11a200 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7144009d30 tx=0x7f714400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:21.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.106+0000 7f7148ff9700 1 -- 172.21.15.26:0/347894490 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714400cc90 con 0x7f714c1341d0 2023-10-01T07:57:21.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.106+0000 7f7148ff9700 1 -- 172.21.15.26:0/347894490 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714400f040 con 0x7f714c1341d0 2023-10-01T07:57:21.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.106+0000 7f7152275700 1 -- 172.21.15.26:0/347894490 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f714c130c30 con 0x7f714c1341d0 2023-10-01T07:57:21.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.106+0000 7f7148ff9700 1 -- 172.21.15.26:0/347894490 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7144009e80 con 0x7f714c1341d0 2023-10-01T07:57:21.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.106+0000 7f7152275700 1 -- 172.21.15.26:0/347894490 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f714c11d1e0 con 0x7f714c1341d0 2023-10-01T07:57:21.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.107+0000 7f7148ff9700 1 -- 172.21.15.26:0/347894490 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7144014480 con 0x7f714c1341d0 2023-10-01T07:57:21.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.107+0000 7f7148ff9700 1 -- 172.21.15.26:0/347894490 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f714403fea0 con 0x7f714c1341d0 2023-10-01T07:57:21.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.108+0000 7f7152275700 1 -- 172.21.15.26:0/347894490 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f714c074ea0 con 0x7f714c1341d0 2023-10-01T07:57:21.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.113+0000 7f7148ff9700 1 -- 172.21.15.26:0/347894490 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7144018020 con 0x7f714c1341d0 2023-10-01T07:57:21.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.145+0000 7fdb36543700 1 Processor -- start 2023-10-01T07:57:21.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.145+0000 7fdb36543700 1 -- start start 2023-10-01T07:57:21.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.146+0000 7fdb36543700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb300a0a30 0x7fdb300a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:21.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.146+0000 7fdb36543700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdb30138d80 0x7fdb3013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:21.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.146+0000 7fdb36543700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb300a2a70 con 0x7fdb3009d630 2023-10-01T07:57:21.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.146+0000 7fdb36543700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb300a01d0 con 0x7fdb30138d80 2023-10-01T07:57:21.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.146+0000 7fdb36543700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3009e2b0 con 0x7fdb300a0a30 2023-10-01T07:57:21.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.146+0000 7fdb34ae0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdb30138d80 0x7fdb3013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:21.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.146+0000 7fdb2ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb300a0a30 0x7fdb300a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:21.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.146+0000 7fdb34ae0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdb30138d80 0x7fdb3013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55374/0 (socket says 172.21.15.26:55374) 2023-10-01T07:57:21.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.146+0000 7fdb34ae0700 1 -- 172.21.15.26:0/2528428103 learned_addr learned my addr 172.21.15.26:0/2528428103 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:21.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.146+0000 7fdb2ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb300a0a30 0x7fdb300a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46160/0 (socket says 172.21.15.26:46160) 2023-10-01T07:57:21.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.147+0000 7fdb34ae0700 1 -- 172.21.15.26:0/2528428103 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb300a0a30 msgr2=0x7fdb300a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:21.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.147+0000 7fdb34ae0700 1 --2- 172.21.15.26:0/2528428103 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb300a0a30 0x7fdb300a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.147+0000 7fdb34ae0700 1 -- 172.21.15.26:0/2528428103 >> v1:172.21.15.26:6789/0 conn(0x7fdb3009d630 legacy=0x7fdb300a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:21.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.147+0000 7fdb34ae0700 1 -- 172.21.15.26:0/2528428103 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb3009dc50 con 0x7fdb30138d80 2023-10-01T07:57:21.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.147+0000 7fdb34ae0700 1 --2- 172.21.15.26:0/2528428103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb30138d80 0x7fdb3013b160 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fdb28009e50 tx=0x7fdb2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ae0860aa97ebd67 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:21.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.147+0000 7fdb2effd700 1 -- 172.21.15.26:0/2528428103 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2800e070 con 0x7fdb30138d80 2023-10-01T07:57:21.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.147+0000 7fdb2effd700 1 -- 172.21.15.26:0/2528428103 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2800b910 con 0x7fdb30138d80 2023-10-01T07:57:21.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.147+0000 7fdb2effd700 1 -- 172.21.15.26:0/2528428103 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2800bcc0 con 0x7fdb30138d80 2023-10-01T07:57:21.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.148+0000 7fdb36543700 1 -- 172.21.15.26:0/2528428103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb30138d80 msgr2=0x7fdb3013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:21.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.148+0000 7fdb36543700 1 --2- 172.21.15.26:0/2528428103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb30138d80 0x7fdb3013b160 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fdb28009e50 tx=0x7fdb2800b330 comp rx=0 tx=0).stop 2023-10-01T07:57:21.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.148+0000 7fdb36543700 1 -- 172.21.15.26:0/2528428103 shutdown_connections 2023-10-01T07:57:21.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.148+0000 7fdb36543700 1 --2- 172.21.15.26:0/2528428103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb30138d80 0x7fdb3013b160 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.148+0000 7fdb36543700 1 --2- 172.21.15.26:0/2528428103 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb300a0a30 0x7fdb300a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.148+0000 7fdb36543700 1 -- 172.21.15.26:0/2528428103 >> 172.21.15.26:0/2528428103 conn(0x7fdb300a3050 msgr2=0x7fdb300a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:21.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.148+0000 7fdb36543700 1 -- 172.21.15.26:0/2528428103 shutdown_connections 2023-10-01T07:57:21.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.148+0000 7fdb36543700 1 -- 172.21.15.26:0/2528428103 wait complete. 2023-10-01T07:57:21.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.149+0000 7fdb36543700 1 Processor -- start 2023-10-01T07:57:21.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.149+0000 7fdb36543700 1 -- start start 2023-10-01T07:57:21.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.150+0000 7fdb36543700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb3009d630 0x7fdb301339e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:21.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.150+0000 7fdb36543700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb300a0a30 0x7fdb30133f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:21.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.150+0000 7fdb36543700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb30138d80 0x7fdb30134460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:21.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.150+0000 7fdb36543700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb30137220 con 0x7fdb3009d630 2023-10-01T07:57:21.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.150+0000 7fdb36543700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb301381f0 con 0x7fdb30138d80 2023-10-01T07:57:21.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.150+0000 7fdb36543700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb300a0410 con 0x7fdb300a0a30 2023-10-01T07:57:21.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.150+0000 7fdb2ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb3009d630 0x7fdb301339e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:21.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.150+0000 7fdb2ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb3009d630 0x7fdb301339e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55388/0 (socket says 172.21.15.26:55388) 2023-10-01T07:57:21.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.150+0000 7fdb2ffff700 1 -- 172.21.15.26:0/2416035943 learned_addr learned my addr 172.21.15.26:0/2416035943 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:21.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.150+0000 7fdb34ae0700 1 --2- 172.21.15.26:0/2416035943 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb30138d80 0x7fdb30134460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:21.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.150+0000 7fdb2f7fe700 1 --2- 172.21.15.26:0/2416035943 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb300a0a30 0x7fdb30133f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:21.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.150+0000 7fdb34ae0700 1 -- 172.21.15.26:0/2416035943 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb300a0a30 msgr2=0x7fdb30133f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:21.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.150+0000 7fdb34ae0700 1 --2- 172.21.15.26:0/2416035943 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb300a0a30 0x7fdb30133f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.150+0000 7fdb34ae0700 1 -- 172.21.15.26:0/2416035943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb3009d630 msgr2=0x7fdb301339e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:21.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.150+0000 7fdb34ae0700 1 --2- 172.21.15.26:0/2416035943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb3009d630 0x7fdb301339e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.151+0000 7fdb34ae0700 1 -- 172.21.15.26:0/2416035943 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb28009b30 con 0x7fdb30138d80 2023-10-01T07:57:21.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.151+0000 7fdb2ffff700 1 --2- 172.21.15.26:0/2416035943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb3009d630 0x7fdb301339e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:21.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.151+0000 7fdb34ae0700 1 --2- 172.21.15.26:0/2416035943 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb30138d80 0x7fdb30134460 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fdb300672b0 tx=0x7fdb28004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:21.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.151+0000 7fdb2cff9700 1 -- 172.21.15.26:0/2416035943 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb28004780 con 0x7fdb30138d80 2023-10-01T07:57:21.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.151+0000 7fdb2cff9700 1 -- 172.21.15.26:0/2416035943 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb280092e0 con 0x7fdb30138d80 2023-10-01T07:57:21.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.151+0000 7fdb2cff9700 1 -- 172.21.15.26:0/2416035943 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2801c680 con 0x7fdb30138d80 2023-10-01T07:57:21.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.151+0000 7fdb36543700 1 -- 172.21.15.26:0/2416035943 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb300a4da0 con 0x7fdb30138d80 2023-10-01T07:57:21.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.151+0000 7fdb36543700 1 -- 172.21.15.26:0/2416035943 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb30135e90 con 0x7fdb30138d80 2023-10-01T07:57:21.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.152+0000 7fdb36543700 1 -- 172.21.15.26:0/2416035943 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb300747f0 con 0x7fdb30138d80 2023-10-01T07:57:21.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.153+0000 7fdb2cff9700 1 -- 172.21.15.26:0/2416035943 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb2801c7e0 con 0x7fdb30138d80 2023-10-01T07:57:21.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.153+0000 7fdb2cff9700 1 -- 172.21.15.26:0/2416035943 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdb28040e00 con 0x7fdb30138d80 2023-10-01T07:57:21.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.157+0000 7fdb2cff9700 1 -- 172.21.15.26:0/2416035943 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb2801ca90 con 0x7fdb30138d80 2023-10-01T07:57:21.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.291+0000 7f714ba72700 1 -- 172.21.15.26:0/2291006048 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7144074ea0 con 0x7f714406b080 2023-10-01T07:57:21.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.291+0000 7f713a7fc700 1 -- 172.21.15.26:0/2291006048 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7134017070 con 0x7f714406b080 2023-10-01T07:57:21.292 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:21.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.293+0000 7f714ba72700 1 -- 172.21.15.26:0/2291006048 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f714406b080 msgr2=0x7f71441c8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:21.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.293+0000 7f714ba72700 1 --2- 172.21.15.26:0/2291006048 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f714406b080 0x7f71441c8680 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f713400e910 tx=0x7f713400ec20 comp rx=0 tx=0).stop 2023-10-01T07:57:21.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.293+0000 7f714ba72700 1 -- 172.21.15.26:0/2291006048 shutdown_connections 2023-10-01T07:57:21.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.293+0000 7f714ba72700 1 --2- 172.21.15.26:0/2291006048 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7144131b40 0x7f71441c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.293+0000 7f714ba72700 1 --2- 172.21.15.26:0/2291006048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f714406a770 0x7f71441c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.293+0000 7f714ba72700 1 --2- 172.21.15.26:0/2291006048 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f714406b080 0x7f71441c8680 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.293+0000 7f714ba72700 1 -- 172.21.15.26:0/2291006048 >> 172.21.15.26:0/2291006048 conn(0x7f7144066f50 msgr2=0x7f7144070110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:21.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.293+0000 7f714ba72700 1 -- 172.21.15.26:0/2291006048 shutdown_connections 2023-10-01T07:57:21.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.293+0000 7f714ba72700 1 -- 172.21.15.26:0/2291006048 wait complete. 2023-10-01T07:57:21.308 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:21.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.326+0000 7f7152275700 1 -- 172.21.15.26:0/347894490 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f714c06b9e0 con 0x7f714c1341d0 2023-10-01T07:57:21.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.326+0000 7f7148ff9700 1 -- 172.21.15.26:0/347894490 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f714401a4a0 con 0x7f714c1341d0 2023-10-01T07:57:21.327 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:21.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.328+0000 7f7152275700 1 -- 172.21.15.26:0/347894490 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f714c1341d0 msgr2=0x7f714c11a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:21.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.328+0000 7f7152275700 1 --2- 172.21.15.26:0/347894490 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f714c1341d0 0x7f714c11a200 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7144009d30 tx=0x7f714400c3a0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.328+0000 7f7152275700 1 -- 172.21.15.26:0/347894490 shutdown_connections 2023-10-01T07:57:21.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.328+0000 7f7152275700 1 --2- 172.21.15.26:0/347894490 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f714c1341d0 0x7f714c11a200 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.328+0000 7f7152275700 1 --2- 172.21.15.26:0/347894490 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f714c09e390 0x7f714c119780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.328+0000 7f7152275700 1 --2- 172.21.15.26:0/347894490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f714c1338c0 0x7f714c119cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.328+0000 7f7152275700 1 -- 172.21.15.26:0/347894490 >> 172.21.15.26:0/347894490 conn(0x7f714c0a2aa0 msgr2=0x7f714c12e370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:21.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.329+0000 7f7152275700 1 -- 172.21.15.26:0/347894490 shutdown_connections 2023-10-01T07:57:21.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.329+0000 7f7152275700 1 -- 172.21.15.26:0/347894490 wait complete. 2023-10-01T07:57:21.343 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:21.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.368+0000 7fdb36543700 1 -- 172.21.15.26:0/2416035943 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdb30072980 con 0x7fdb30138d80 2023-10-01T07:57:21.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.369+0000 7fdb2cff9700 1 -- 172.21.15.26:0/2416035943 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdb280243b0 con 0x7fdb30138d80 2023-10-01T07:57:21.369 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:21.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.371+0000 7fdb36543700 1 -- 172.21.15.26:0/2416035943 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb30138d80 msgr2=0x7fdb30134460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:21.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.371+0000 7fdb36543700 1 --2- 172.21.15.26:0/2416035943 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb30138d80 0x7fdb30134460 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fdb300672b0 tx=0x7fdb28004ad0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.371+0000 7fdb36543700 1 -- 172.21.15.26:0/2416035943 shutdown_connections 2023-10-01T07:57:21.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.371+0000 7fdb36543700 1 --2- 172.21.15.26:0/2416035943 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb30138d80 0x7fdb30134460 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.371+0000 7fdb36543700 1 --2- 172.21.15.26:0/2416035943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb3009d630 0x7fdb301339e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.371+0000 7fdb36543700 1 --2- 172.21.15.26:0/2416035943 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb300a0a30 0x7fdb30133f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.371+0000 7fdb36543700 1 -- 172.21.15.26:0/2416035943 >> 172.21.15.26:0/2416035943 conn(0x7fdb300a3050 msgr2=0x7fdb3009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:21.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.371+0000 7fdb36543700 1 -- 172.21.15.26:0/2416035943 shutdown_connections 2023-10-01T07:57:21.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.371+0000 7fdb36543700 1 -- 172.21.15.26:0/2416035943 wait complete. 2023-10-01T07:57:21.385 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:21.589 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:21.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.736+0000 7fdbd7030700 1 Processor -- start 2023-10-01T07:57:21.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.736+0000 7fdbd7030700 1 -- start start 2023-10-01T07:57:21.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.737+0000 7fdbd7030700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbd00a0a30 0x7fdbd00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:21.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.737+0000 7fdbd7030700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdbd0134170 0x7fdbd013bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:21.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.737+0000 7fdbd7030700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd009edd0 con 0x7fdbd00a1340 2023-10-01T07:57:21.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.737+0000 7fdbd7030700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd009e1f0 con 0x7fdbd00a0a30 2023-10-01T07:57:21.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.737+0000 7fdbd7030700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd009dc50 con 0x7fdbd0134170 2023-10-01T07:57:21.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.737+0000 7fdbd4dcc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbd00a0a30 0x7fdbd00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:21.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.737+0000 7fdbd55cd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdbd0134170 0x7fdbd013bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:21.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.737+0000 7fdbd55cd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdbd0134170 0x7fdbd013bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49792/0 (socket says 172.21.15.26:49792) 2023-10-01T07:57:21.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.737+0000 7fdbcffff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fdbd00a1340 0x7fdbd0133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56262/0 (socket says 172.21.15.26:56262) 2023-10-01T07:57:21.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.737+0000 7fdbd55cd700 1 -- 172.21.15.26:0/3534446873 learned_addr learned my addr 172.21.15.26:0/3534446873 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:21.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.737+0000 7fdbd4dcc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbd00a0a30 0x7fdbd00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46180/0 (socket says 172.21.15.26:46180) 2023-10-01T07:57:21.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.737+0000 7fdbd55cd700 1 -- 172.21.15.26:0/3534446873 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbd00a0a30 msgr2=0x7fdbd00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:21.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.737+0000 7fdbd55cd700 1 --2- 172.21.15.26:0/3534446873 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbd00a0a30 0x7fdbd00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.737+0000 7fdbd55cd700 1 -- 172.21.15.26:0/3534446873 >> v1:172.21.15.26:6789/0 conn(0x7fdbd00a1340 legacy=0x7fdbd0133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:21.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.737+0000 7fdbcf7fe700 1 -- 172.21.15.26:0/3534446873 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1842670133 0 0) 0x7fdbd009edd0 con 0x7fdbd00a1340 2023-10-01T07:57:21.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.738+0000 7fdbd55cd700 1 -- 172.21.15.26:0/3534446873 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd00a1fe0 con 0x7fdbd0134170 2023-10-01T07:57:21.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.738+0000 7fdbd55cd700 1 --2- 172.21.15.26:0/3534446873 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdbd0134170 0x7fdbd013bd30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8009e80 tx=0x7fdbc800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=788962472502c30e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:21.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.738+0000 7fdbcf7fe700 1 -- 172.21.15.26:0/3534446873 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc800e070 con 0x7fdbd0134170 2023-10-01T07:57:21.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.738+0000 7fdbcf7fe700 1 -- 172.21.15.26:0/3534446873 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc800b910 con 0x7fdbd0134170 2023-10-01T07:57:21.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.738+0000 7fdbcf7fe700 1 -- 172.21.15.26:0/3534446873 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc800bcc0 con 0x7fdbd0134170 2023-10-01T07:57:21.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.738+0000 7fdbd7030700 1 -- 172.21.15.26:0/3534446873 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdbd0134170 msgr2=0x7fdbd013bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:21.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.738+0000 7fdbd7030700 1 --2- 172.21.15.26:0/3534446873 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdbd0134170 0x7fdbd013bd30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8009e80 tx=0x7fdbc800b330 comp rx=0 tx=0).stop 2023-10-01T07:57:21.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.738+0000 7fdbd7030700 1 -- 172.21.15.26:0/3534446873 shutdown_connections 2023-10-01T07:57:21.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.738+0000 7fdbd7030700 1 --2- 172.21.15.26:0/3534446873 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdbd0134170 0x7fdbd013bd30 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.738+0000 7fdbd7030700 1 --2- 172.21.15.26:0/3534446873 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbd00a0a30 0x7fdbd00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.738+0000 7fdbd7030700 1 -- 172.21.15.26:0/3534446873 >> 172.21.15.26:0/3534446873 conn(0x7fdbd00a6550 msgr2=0x7fdbd00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:21.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.739+0000 7fdbd7030700 1 -- 172.21.15.26:0/3534446873 shutdown_connections 2023-10-01T07:57:21.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.739+0000 7fdbd7030700 1 -- 172.21.15.26:0/3534446873 wait complete. 2023-10-01T07:57:21.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.740+0000 7fdbd7030700 1 Processor -- start 2023-10-01T07:57:21.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.740+0000 7fdbd7030700 1 -- start start 2023-10-01T07:57:21.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.741+0000 7fdbd7030700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdbd00a0a30 0x7fdbd0122780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:21.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.741+0000 7fdbd7030700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbd00a1340 0x7fdbd0122cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:21.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.741+0000 7fdbd7030700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbd0134170 0x7fdbd0123200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:21.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.741+0000 7fdbd7030700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd00a4ec0 con 0x7fdbd0134170 2023-10-01T07:57:21.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.741+0000 7fdbd7030700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd01336b0 con 0x7fdbd00a1340 2023-10-01T07:57:21.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.741+0000 7fdbd7030700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd0124410 con 0x7fdbd00a0a30 2023-10-01T07:57:21.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.741+0000 7fdbd4dcc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdbd00a0a30 0x7fdbd0122780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:21.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.741+0000 7fdbd4dcc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdbd00a0a30 0x7fdbd0122780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49802/0 (socket says 172.21.15.26:49802) 2023-10-01T07:57:21.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.741+0000 7fdbd4dcc700 1 -- 172.21.15.26:0/2072655511 learned_addr learned my addr 172.21.15.26:0/2072655511 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:21.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.741+0000 7fdbcffff700 1 --2- 172.21.15.26:0/2072655511 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbd00a1340 0x7fdbd0122cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:21.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.741+0000 7fdbd55cd700 1 --2- 172.21.15.26:0/2072655511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbd0134170 0x7fdbd0123200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:21.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.741+0000 7fdbd4dcc700 1 -- 172.21.15.26:0/2072655511 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbd00a1340 msgr2=0x7fdbd0122cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:21.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.741+0000 7fdbd4dcc700 1 --2- 172.21.15.26:0/2072655511 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbd00a1340 0x7fdbd0122cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.741+0000 7fdbd4dcc700 1 -- 172.21.15.26:0/2072655511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbd0134170 msgr2=0x7fdbd0123200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:21.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.741+0000 7fdbd4dcc700 1 --2- 172.21.15.26:0/2072655511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbd0134170 0x7fdbd0123200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.741+0000 7fdbd4dcc700 1 -- 172.21.15.26:0/2072655511 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc8009b30 con 0x7fdbd00a0a30 2023-10-01T07:57:21.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.741+0000 7fdbcffff700 1 --2- 172.21.15.26:0/2072655511 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbd00a1340 0x7fdbd0122cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:21.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.742+0000 7fdbd4dcc700 1 --2- 172.21.15.26:0/2072655511 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdbd00a0a30 0x7fdbd0122780 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fdbc000ea00 tx=0x7fdbc000ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:21.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.742+0000 7fdbcd7fa700 1 -- 172.21.15.26:0/2072655511 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc0009730 con 0x7fdbd00a0a30 2023-10-01T07:57:21.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.742+0000 7fdbcd7fa700 1 -- 172.21.15.26:0/2072655511 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc000eea0 con 0x7fdbd00a0a30 2023-10-01T07:57:21.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.742+0000 7fdbcd7fa700 1 -- 172.21.15.26:0/2072655511 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc000ca70 con 0x7fdbd00a0a30 2023-10-01T07:57:21.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.742+0000 7fdbd7030700 1 -- 172.21.15.26:0/2072655511 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd00a25e0 con 0x7fdbd00a0a30 2023-10-01T07:57:21.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.742+0000 7fdbd7030700 1 -- 172.21.15.26:0/2072655511 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd01331f0 con 0x7fdbd00a0a30 2023-10-01T07:57:21.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.743+0000 7fdbcd7fa700 1 -- 172.21.15.26:0/2072655511 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdbc000cbf0 con 0x7fdbd00a0a30 2023-10-01T07:57:21.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.743+0000 7fdbd7030700 1 -- 172.21.15.26:0/2072655511 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbd0074ea0 con 0x7fdbd00a0a30 2023-10-01T07:57:21.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.743+0000 7fdbcd7fa700 1 -- 172.21.15.26:0/2072655511 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdbc003f7a0 con 0x7fdbd00a0a30 2023-10-01T07:57:21.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.748+0000 7fdbcd7fa700 1 -- 172.21.15.26:0/2072655511 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdbc00232f0 con 0x7fdbd00a0a30 2023-10-01T07:57:21.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.952+0000 7fdbd7030700 1 -- 172.21.15.26:0/2072655511 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdbd00a28e0 con 0x7fdbd00a0a30 2023-10-01T07:57:21.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.953+0000 7fdbcd7fa700 1 -- 172.21.15.26:0/2072655511 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdbc0021020 con 0x7fdbd00a0a30 2023-10-01T07:57:21.954 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:21.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.955+0000 7fdbd7030700 1 -- 172.21.15.26:0/2072655511 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdbd00a0a30 msgr2=0x7fdbd0122780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:21.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.955+0000 7fdbd7030700 1 --2- 172.21.15.26:0/2072655511 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdbd00a0a30 0x7fdbd0122780 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fdbc000ea00 tx=0x7fdbc000ed10 comp rx=0 tx=0).stop 2023-10-01T07:57:21.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.955+0000 7fdbd7030700 1 -- 172.21.15.26:0/2072655511 shutdown_connections 2023-10-01T07:57:21.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.955+0000 7fdbd7030700 1 --2- 172.21.15.26:0/2072655511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbd0134170 0x7fdbd0123200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.955+0000 7fdbd7030700 1 --2- 172.21.15.26:0/2072655511 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdbd00a0a30 0x7fdbd0122780 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.955+0000 7fdbd7030700 1 --2- 172.21.15.26:0/2072655511 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbd00a1340 0x7fdbd0122cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:21.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.955+0000 7fdbd7030700 1 -- 172.21.15.26:0/2072655511 >> 172.21.15.26:0/2072655511 conn(0x7fdbd00a6550 msgr2=0x7fdbd009edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:21.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.955+0000 7fdbd7030700 1 -- 172.21.15.26:0/2072655511 shutdown_connections 2023-10-01T07:57:21.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:21.955+0000 7fdbd7030700 1 -- 172.21.15.26:0/2072655511 wait complete. 2023-10-01T07:57:21.970 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:22.309 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:22.343 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:22.386 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:22.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.462+0000 7f22365d8700 1 Processor -- start 2023-10-01T07:57:22.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.462+0000 7f22365d8700 1 -- start start 2023-10-01T07:57:22.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.462+0000 7f22365d8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f223009e1d0 0x7f2230138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:22.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.462+0000 7f22365d8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2230139170 0x7f223013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:22.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.462+0000 7f22365d8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f223009b120 con 0x7f223009d6f0 2023-10-01T07:57:22.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.462+0000 7f22365d8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f223006b460 con 0x7f2230139170 2023-10-01T07:57:22.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.462+0000 7f22365d8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f223009a7e0 con 0x7f223009e1d0 2023-10-01T07:57:22.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.462+0000 7f222ffff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f223009d6f0 0x7f223009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56276/0 (socket says 172.21.15.26:56276) 2023-10-01T07:57:22.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.462+0000 7f222ffff700 1 -- 172.21.15.26:0/1984315308 learned_addr learned my addr 172.21.15.26:0/1984315308 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:22.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.462+0000 7f222f7fe700 1 --2- 172.21.15.26:0/1984315308 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f223009e1d0 0x7f2230138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:22.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.463+0000 7f2234b75700 1 --2- 172.21.15.26:0/1984315308 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2230139170 0x7f223013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:22.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.463+0000 7f222effd700 1 -- 172.21.15.26:0/1984315308 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3159768498 0 0) 0x7f223009b120 con 0x7f223009d6f0 2023-10-01T07:57:22.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.463+0000 7f222effd700 1 -- 172.21.15.26:0/1984315308 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22180035b0 con 0x7f223009d6f0 2023-10-01T07:57:22.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.463+0000 7f222f7fe700 1 -- 172.21.15.26:0/1984315308 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2230139170 msgr2=0x7f223013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:22.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.463+0000 7f222f7fe700 1 --2- 172.21.15.26:0/1984315308 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2230139170 0x7f223013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:22.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.463+0000 7f222f7fe700 1 -- 172.21.15.26:0/1984315308 >> v1:172.21.15.26:6789/0 conn(0x7f223009d6f0 legacy=0x7f223009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:22.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.463+0000 7f222f7fe700 1 -- 172.21.15.26:0/1984315308 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223009a500 con 0x7f223009e1d0 2023-10-01T07:57:22.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.463+0000 7f2234b75700 1 --2- 172.21.15.26:0/1984315308 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2230139170 0x7f223013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:22.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.463+0000 7f222f7fe700 1 --2- 172.21.15.26:0/1984315308 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f223009e1d0 0x7f2230138c30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f22240098a0 tx=0x7f2224009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a77f9512b433346 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:22.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.463+0000 7f222effd700 1 -- 172.21.15.26:0/1984315308 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2224011830 con 0x7f223009e1d0 2023-10-01T07:57:22.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.463+0000 7f222effd700 1 -- 172.21.15.26:0/1984315308 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2224011990 con 0x7f223009e1d0 2023-10-01T07:57:22.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.463+0000 7f222effd700 1 -- 172.21.15.26:0/1984315308 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2224011d20 con 0x7f223009e1d0 2023-10-01T07:57:22.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.464+0000 7f22365d8700 1 -- 172.21.15.26:0/1984315308 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f223009e1d0 msgr2=0x7f2230138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:22.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.464+0000 7f22365d8700 1 --2- 172.21.15.26:0/1984315308 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f223009e1d0 0x7f2230138c30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f22240098a0 tx=0x7f2224009bb0 comp rx=0 tx=0).stop 2023-10-01T07:57:22.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.464+0000 7f22365d8700 1 -- 172.21.15.26:0/1984315308 shutdown_connections 2023-10-01T07:57:22.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.464+0000 7f22365d8700 1 --2- 172.21.15.26:0/1984315308 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2230139170 0x7f223013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:22.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.464+0000 7f22365d8700 1 --2- 172.21.15.26:0/1984315308 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f223009e1d0 0x7f2230138c30 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:22.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.464+0000 7f22365d8700 1 -- 172.21.15.26:0/1984315308 >> 172.21.15.26:0/1984315308 conn(0x7f2230066f50 msgr2=0x7f223009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:22.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.464+0000 7f22365d8700 1 -- 172.21.15.26:0/1984315308 shutdown_connections 2023-10-01T07:57:22.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.464+0000 7f22365d8700 1 -- 172.21.15.26:0/1984315308 wait complete. 2023-10-01T07:57:22.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.465+0000 7f22365d8700 1 Processor -- start 2023-10-01T07:57:22.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.466+0000 7f22365d8700 1 -- start start 2023-10-01T07:57:22.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.466+0000 7f22365d8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f223009d6f0 0x7f2230121690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:22.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.466+0000 7f22365d8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f223009e1d0 0x7f2230121bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:22.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.466+0000 7f22365d8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2230139170 0x7f2230122110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:22.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.466+0000 7f22365d8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22301248a0 con 0x7f223009e1d0 2023-10-01T07:57:22.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.466+0000 7f22365d8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22301232a0 con 0x7f2230139170 2023-10-01T07:57:22.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.466+0000 7f22365d8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2230137610 con 0x7f223009d6f0 2023-10-01T07:57:22.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.466+0000 7f222ffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f223009d6f0 0x7f2230121690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:22.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.466+0000 7f222ffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f223009d6f0 0x7f2230121690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49832/0 (socket says 172.21.15.26:49832) 2023-10-01T07:57:22.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.466+0000 7f222ffff700 1 -- 172.21.15.26:0/175714368 learned_addr learned my addr 172.21.15.26:0/175714368 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:22.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.466+0000 7f222f7fe700 1 --2- 172.21.15.26:0/175714368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f223009e1d0 0x7f2230121bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:22.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.466+0000 7f2234b75700 1 --2- 172.21.15.26:0/175714368 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2230139170 0x7f2230122110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:22.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.467+0000 7f222ffff700 1 -- 172.21.15.26:0/175714368 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2230139170 msgr2=0x7f2230122110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:22.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.467+0000 7f222ffff700 1 --2- 172.21.15.26:0/175714368 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2230139170 0x7f2230122110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:22.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.467+0000 7f222ffff700 1 -- 172.21.15.26:0/175714368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f223009e1d0 msgr2=0x7f2230121bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:22.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.467+0000 7f222ffff700 1 --2- 172.21.15.26:0/175714368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f223009e1d0 0x7f2230121bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:22.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.467+0000 7f222ffff700 1 -- 172.21.15.26:0/175714368 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2228009a70 con 0x7f223009d6f0 2023-10-01T07:57:22.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.467+0000 7f2234b75700 1 --2- 172.21.15.26:0/175714368 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2230139170 0x7f2230122110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:22.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.467+0000 7f222ffff700 1 --2- 172.21.15.26:0/175714368 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f223009d6f0 0x7f2230121690 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f222000c730 tx=0x7f222000ca40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:22.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.467+0000 7f222cff9700 1 -- 172.21.15.26:0/175714368 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2220005d70 con 0x7f223009d6f0 2023-10-01T07:57:22.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.467+0000 7f222cff9700 1 -- 172.21.15.26:0/175714368 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22200070d0 con 0x7f223009d6f0 2023-10-01T07:57:22.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.467+0000 7f222cff9700 1 -- 172.21.15.26:0/175714368 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2220007460 con 0x7f223009d6f0 2023-10-01T07:57:22.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.467+0000 7f22365d8700 1 -- 172.21.15.26:0/175714368 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22240094a0 con 0x7f223009d6f0 2023-10-01T07:57:22.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.467+0000 7f22365d8700 1 -- 172.21.15.26:0/175714368 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2230123ac0 con 0x7f223009d6f0 2023-10-01T07:57:22.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.468+0000 7f222cff9700 1 -- 172.21.15.26:0/175714368 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f22200075c0 con 0x7f223009d6f0 2023-10-01T07:57:22.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.468+0000 7f222cff9700 1 -- 172.21.15.26:0/175714368 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f222003eaf0 con 0x7f223009d6f0 2023-10-01T07:57:22.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.468+0000 7f22365d8700 1 -- 172.21.15.26:0/175714368 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22300a17f0 con 0x7f223009d6f0 2023-10-01T07:57:22.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.473+0000 7f222cff9700 1 -- 172.21.15.26:0/175714368 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2220017070 con 0x7f223009d6f0 2023-10-01T07:57:22.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.497+0000 7facaef79700 1 Processor -- start 2023-10-01T07:57:22.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.497+0000 7facaef79700 1 -- start start 2023-10-01T07:57:22.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.498+0000 7facaef79700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7faca80a0a30 0x7faca80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:22.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.498+0000 7facaef79700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faca8138d80 0x7faca813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:22.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.498+0000 7facaef79700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faca80a2a70 con 0x7faca809d630 2023-10-01T07:57:22.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.498+0000 7facaef79700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faca80a01d0 con 0x7faca80a0a30 2023-10-01T07:57:22.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.498+0000 7facaef79700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faca809e2b0 con 0x7faca8138d80 2023-10-01T07:57:22.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.498+0000 7facacd15700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7faca80a0a30 0x7faca80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:22.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.498+0000 7facad516700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faca8138d80 0x7faca813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:22.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.498+0000 7facacd15700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7faca80a0a30 0x7faca80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55428/0 (socket says 172.21.15.26:55428) 2023-10-01T07:57:22.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.498+0000 7facacd15700 1 -- 172.21.15.26:0/600618583 learned_addr learned my addr 172.21.15.26:0/600618583 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:22.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.499+0000 7facacd15700 1 -- 172.21.15.26:0/600618583 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faca8138d80 msgr2=0x7faca813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:22.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.499+0000 7facacd15700 1 --2- 172.21.15.26:0/600618583 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faca8138d80 0x7faca813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:22.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.499+0000 7facacd15700 1 -- 172.21.15.26:0/600618583 >> v1:172.21.15.26:6789/0 conn(0x7faca809d630 legacy=0x7faca80a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:22.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.499+0000 7facacd15700 1 -- 172.21.15.26:0/600618583 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca809dc50 con 0x7faca80a0a30 2023-10-01T07:57:22.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.499+0000 7facad516700 1 --2- 172.21.15.26:0/600618583 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faca8138d80 0x7faca813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:22.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.499+0000 7facacd15700 1 --2- 172.21.15.26:0/600618583 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faca80a0a30 0x7faca80a0e00 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fac980098f0 tx=0x7fac98009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0fbd059046b8e0d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:22.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.499+0000 7faca77fe700 1 -- 172.21.15.26:0/600618583 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac98011830 con 0x7faca80a0a30 2023-10-01T07:57:22.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.499+0000 7faca77fe700 1 -- 172.21.15.26:0/600618583 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac98011990 con 0x7faca80a0a30 2023-10-01T07:57:22.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.499+0000 7faca77fe700 1 -- 172.21.15.26:0/600618583 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac98011d20 con 0x7faca80a0a30 2023-10-01T07:57:22.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.500+0000 7facaef79700 1 -- 172.21.15.26:0/600618583 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faca80a0a30 msgr2=0x7faca80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:22.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.500+0000 7facaef79700 1 --2- 172.21.15.26:0/600618583 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faca80a0a30 0x7faca80a0e00 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fac980098f0 tx=0x7fac98009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:22.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.500+0000 7facaef79700 1 -- 172.21.15.26:0/600618583 shutdown_connections 2023-10-01T07:57:22.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.500+0000 7facaef79700 1 --2- 172.21.15.26:0/600618583 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faca8138d80 0x7faca813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:22.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.500+0000 7facaef79700 1 --2- 172.21.15.26:0/600618583 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faca80a0a30 0x7faca80a0e00 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:22.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.500+0000 7facaef79700 1 -- 172.21.15.26:0/600618583 >> 172.21.15.26:0/600618583 conn(0x7faca80a3050 msgr2=0x7faca80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:22.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.500+0000 7facaef79700 1 -- 172.21.15.26:0/600618583 shutdown_connections 2023-10-01T07:57:22.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.500+0000 7facaef79700 1 -- 172.21.15.26:0/600618583 wait complete. 2023-10-01T07:57:22.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.501+0000 7facaef79700 1 Processor -- start 2023-10-01T07:57:22.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.501+0000 7facaef79700 1 -- start start 2023-10-01T07:57:22.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.502+0000 7facaef79700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faca809d630 0x7faca81207c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:22.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.502+0000 7facaef79700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faca80a0a30 0x7faca8120d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:22.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.502+0000 7facaef79700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faca8138d80 0x7faca8121240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:22.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.502+0000 7facaef79700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca81223d0 con 0x7faca8138d80 2023-10-01T07:57:22.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.502+0000 7facaef79700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca8122c30 con 0x7faca80a0a30 2023-10-01T07:57:22.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.502+0000 7facaef79700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faca8124000 con 0x7faca809d630 2023-10-01T07:57:22.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.502+0000 7facacd15700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faca809d630 0x7faca81207c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:22.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.502+0000 7facacd15700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faca809d630 0x7faca81207c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49848/0 (socket says 172.21.15.26:49848) 2023-10-01T07:57:22.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.502+0000 7facacd15700 1 -- 172.21.15.26:0/2937727749 learned_addr learned my addr 172.21.15.26:0/2937727749 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:22.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.502+0000 7faca7fff700 1 --2- 172.21.15.26:0/2937727749 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faca80a0a30 0x7faca8120d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:22.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.502+0000 7facad516700 1 --2- 172.21.15.26:0/2937727749 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faca8138d80 0x7faca8121240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:22.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.502+0000 7facacd15700 1 -- 172.21.15.26:0/2937727749 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faca80a0a30 msgr2=0x7faca8120d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:22.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.502+0000 7facacd15700 1 --2- 172.21.15.26:0/2937727749 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faca80a0a30 0x7faca8120d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:22.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.502+0000 7facacd15700 1 -- 172.21.15.26:0/2937727749 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faca8138d80 msgr2=0x7faca8121240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:22.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.502+0000 7facacd15700 1 --2- 172.21.15.26:0/2937727749 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faca8138d80 0x7faca8121240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:22.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.502+0000 7facacd15700 1 -- 172.21.15.26:0/2937727749 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca0009a70 con 0x7faca809d630 2023-10-01T07:57:22.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.502+0000 7facad516700 1 --2- 172.21.15.26:0/2937727749 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faca8138d80 0x7faca8121240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:22.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.502+0000 7faca7fff700 1 --2- 172.21.15.26:0/2937727749 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faca80a0a30 0x7faca8120d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:22.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.503+0000 7facacd15700 1 --2- 172.21.15.26:0/2937727749 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faca809d630 0x7faca81207c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fac98009c40 tx=0x7fac98004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:22.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.503+0000 7faca57fa700 1 -- 172.21.15.26:0/2937727749 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac98004400 con 0x7faca809d630 2023-10-01T07:57:22.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.503+0000 7faca57fa700 1 -- 172.21.15.26:0/2937727749 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9801f070 con 0x7faca809d630 2023-10-01T07:57:22.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.503+0000 7facaef79700 1 -- 172.21.15.26:0/2937727749 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac98009550 con 0x7faca809d630 2023-10-01T07:57:22.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.503+0000 7faca57fa700 1 -- 172.21.15.26:0/2937727749 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac980038e0 con 0x7faca809d630 2023-10-01T07:57:22.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.503+0000 7facaef79700 1 -- 172.21.15.26:0/2937727749 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faca8123ac0 con 0x7faca809d630 2023-10-01T07:57:22.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.504+0000 7facaef79700 1 -- 172.21.15.26:0/2937727749 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faca80a0470 con 0x7faca809d630 2023-10-01T07:57:22.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.505+0000 7faca57fa700 1 -- 172.21.15.26:0/2937727749 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fac98021030 con 0x7faca809d630 2023-10-01T07:57:22.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.505+0000 7faca57fa700 1 -- 172.21.15.26:0/2937727749 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fac98040b80 con 0x7faca809d630 2023-10-01T07:57:22.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.510+0000 7faca57fa700 1 -- 172.21.15.26:0/2937727749 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fac98042e60 con 0x7faca809d630 2023-10-01T07:57:22.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.541+0000 7f0eb1dd8700 1 Processor -- start 2023-10-01T07:57:22.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.541+0000 7f0eb1dd8700 1 -- start start 2023-10-01T07:57:22.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.542+0000 7f0eb1dd8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0eac0a0a30 0x7f0eac0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:22.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.542+0000 7f0eb1dd8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0eac0a1340 0x7f0eac133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:22.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.542+0000 7f0eb1dd8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eac09edd0 con 0x7f0eac133fa0 2023-10-01T07:57:22.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.542+0000 7f0eb1dd8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eac09e1f0 con 0x7f0eac0a0a30 2023-10-01T07:57:22.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.542+0000 7f0eb1dd8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac09dc50 con 0x7f0eac0a1340 2023-10-01T07:57:22.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.542+0000 7f0eaaffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0eac0a1340 0x7f0eac133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:22.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.542+0000 7f0eab7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0eac0a0a30 0x7f0eac0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:22.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.542+0000 7f0eab7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0eac0a0a30 0x7f0eac0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55450/0 (socket says 172.21.15.26:55450) 2023-10-01T07:57:22.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.542+0000 7f0eaaffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0eac0a1340 0x7f0eac133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46210/0 (socket says 172.21.15.26:46210) 2023-10-01T07:57:22.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.542+0000 7f0eab7fe700 1 -- 172.21.15.26:0/2594299754 learned_addr learned my addr 172.21.15.26:0/2594299754 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:22.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.542+0000 7f0eab7fe700 1 -- 172.21.15.26:0/2594299754 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0eac0a1340 msgr2=0x7f0eac133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:22.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.542+0000 7f0eab7fe700 1 --2- 172.21.15.26:0/2594299754 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0eac0a1340 0x7f0eac133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:22.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.542+0000 7f0eab7fe700 1 -- 172.21.15.26:0/2594299754 >> v1:172.21.15.26:6789/0 conn(0x7f0eac133fa0 legacy=0x7f0eac13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:22.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.542+0000 7f0eab7fe700 1 -- 172.21.15.26:0/2594299754 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eac0a1fe0 con 0x7f0eac0a0a30 2023-10-01T07:57:22.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.542+0000 7f0eaaffd700 1 --2- 172.21.15.26:0/2594299754 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0eac0a1340 0x7f0eac133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:22.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.542+0000 7f0eab7fe700 1 --2- 172.21.15.26:0/2594299754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0eac0a0a30 0x7f0eac0a0e00 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c009e50 tx=0x7f0e9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d92de12f418acf3 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:22.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.543+0000 7f0eaa7fc700 1 -- 172.21.15.26:0/2594299754 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c00e070 con 0x7f0eac0a0a30 2023-10-01T07:57:22.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.543+0000 7f0eaa7fc700 1 -- 172.21.15.26:0/2594299754 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9c00b910 con 0x7f0eac0a0a30 2023-10-01T07:57:22.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.543+0000 7f0eaa7fc700 1 -- 172.21.15.26:0/2594299754 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c00bcc0 con 0x7f0eac0a0a30 2023-10-01T07:57:22.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.543+0000 7f0eb1dd8700 1 -- 172.21.15.26:0/2594299754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0eac0a0a30 msgr2=0x7f0eac0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:22.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.543+0000 7f0eb1dd8700 1 --2- 172.21.15.26:0/2594299754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0eac0a0a30 0x7f0eac0a0e00 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c009e50 tx=0x7f0e9c00b330 comp rx=0 tx=0).stop 2023-10-01T07:57:22.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.543+0000 7f0eb1dd8700 1 -- 172.21.15.26:0/2594299754 shutdown_connections 2023-10-01T07:57:22.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.543+0000 7f0eb1dd8700 1 --2- 172.21.15.26:0/2594299754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0eac0a0a30 0x7f0eac0a0e00 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:22.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.543+0000 7f0eb1dd8700 1 --2- 172.21.15.26:0/2594299754 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0eac0a1340 0x7f0eac133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:22.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.543+0000 7f0eb1dd8700 1 -- 172.21.15.26:0/2594299754 >> 172.21.15.26:0/2594299754 conn(0x7f0eac0a6550 msgr2=0x7f0eac0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:22.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.543+0000 7f0eb1dd8700 1 -- 172.21.15.26:0/2594299754 shutdown_connections 2023-10-01T07:57:22.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.543+0000 7f0eb1dd8700 1 -- 172.21.15.26:0/2594299754 wait complete. 2023-10-01T07:57:22.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.544+0000 7f0eb1dd8700 1 Processor -- start 2023-10-01T07:57:22.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.545+0000 7f0eb1dd8700 1 -- start start 2023-10-01T07:57:22.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.545+0000 7f0eb1dd8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0eac0a0a30 0x7f0eac11e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:22.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.545+0000 7f0eb1dd8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0eac0a1340 0x7f0eac11ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:22.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.545+0000 7f0eb1dd8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0eac133fa0 0x7f0eac11f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:22.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.545+0000 7f0eb1dd8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac121f50 con 0x7f0eac0a0a30 2023-10-01T07:57:22.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.545+0000 7f0eb1dd8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac120430 con 0x7f0eac0a1340 2023-10-01T07:57:22.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.545+0000 7f0eb1dd8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac0a37e0 con 0x7f0eac133fa0 2023-10-01T07:57:22.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.545+0000 7f0eaaffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0eac0a1340 0x7f0eac11ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:22.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.545+0000 7f0eaaffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0eac0a1340 0x7f0eac11ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46226/0 (socket says 172.21.15.26:46226) 2023-10-01T07:57:22.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.545+0000 7f0eab7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0eac0a0a30 0x7f0eac11e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:22.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.545+0000 7f0eaaffd700 1 -- 172.21.15.26:0/1961062600 learned_addr learned my addr 172.21.15.26:0/1961062600 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:22.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.545+0000 7f0eabfff700 1 --2- 172.21.15.26:0/1961062600 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0eac133fa0 0x7f0eac11f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:22.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.546+0000 7f0eaaffd700 1 -- 172.21.15.26:0/1961062600 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0eac133fa0 msgr2=0x7f0eac11f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:22.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.546+0000 7f0eaaffd700 1 --2- 172.21.15.26:0/1961062600 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0eac133fa0 0x7f0eac11f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:22.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.546+0000 7f0eaaffd700 1 -- 172.21.15.26:0/1961062600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0eac0a0a30 msgr2=0x7f0eac11e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:22.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.546+0000 7f0eaaffd700 1 --2- 172.21.15.26:0/1961062600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0eac0a0a30 0x7f0eac11e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:22.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.546+0000 7f0eaaffd700 1 -- 172.21.15.26:0/1961062600 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e940094a0 con 0x7f0eac0a1340 2023-10-01T07:57:22.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.546+0000 7f0eab7fe700 1 --2- 172.21.15.26:0/1961062600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0eac0a0a30 0x7f0eac11e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:22.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.546+0000 7f0eaaffd700 1 --2- 172.21.15.26:0/1961062600 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0eac0a1340 0x7f0eac11ece0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0e9400ec10 tx=0x7f0e9400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:22.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.546+0000 7f0ea3fff700 1 -- 172.21.15.26:0/1961062600 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9400c850 con 0x7f0eac0a1340 2023-10-01T07:57:22.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.546+0000 7f0ea3fff700 1 -- 172.21.15.26:0/1961062600 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9400c9b0 con 0x7f0eac0a1340 2023-10-01T07:57:22.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.546+0000 7f0eb1dd8700 1 -- 172.21.15.26:0/1961062600 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e9c009b30 con 0x7f0eac0a1340 2023-10-01T07:57:22.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.546+0000 7f0ea3fff700 1 -- 172.21.15.26:0/1961062600 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9400cd20 con 0x7f0eac0a1340 2023-10-01T07:57:22.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.546+0000 7f0eb1dd8700 1 -- 172.21.15.26:0/1961062600 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eac0a0270 con 0x7f0eac0a1340 2023-10-01T07:57:22.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.547+0000 7f0ea3fff700 1 -- 172.21.15.26:0/1961062600 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0e94013470 con 0x7f0eac0a1340 2023-10-01T07:57:22.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.547+0000 7f0ea3fff700 1 -- 172.21.15.26:0/1961062600 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0e9403fb30 con 0x7f0eac0a1340 2023-10-01T07:57:22.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.547+0000 7f0eb1dd8700 1 -- 172.21.15.26:0/1961062600 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eac122a80 con 0x7f0eac0a1340 2023-10-01T07:57:22.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.552+0000 7f0ea3fff700 1 -- 172.21.15.26:0/1961062600 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0e94013720 con 0x7f0eac0a1340 2023-10-01T07:57:22.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.712+0000 7f22365d8700 1 -- 172.21.15.26:0/175714368 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2230074ea0 con 0x7f223009d6f0 2023-10-01T07:57:22.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.712+0000 7f222cff9700 1 -- 172.21.15.26:0/175714368 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f222000f260 con 0x7f223009d6f0 2023-10-01T07:57:22.713 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:22.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.715+0000 7f22365d8700 1 -- 172.21.15.26:0/175714368 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f223009d6f0 msgr2=0x7f2230121690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:22.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.715+0000 7f22365d8700 1 --2- 172.21.15.26:0/175714368 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f223009d6f0 0x7f2230121690 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f222000c730 tx=0x7f222000ca40 comp rx=0 tx=0).stop 2023-10-01T07:57:22.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.716+0000 7f22365d8700 1 -- 172.21.15.26:0/175714368 shutdown_connections 2023-10-01T07:57:22.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.716+0000 7f22365d8700 1 --2- 172.21.15.26:0/175714368 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2230139170 0x7f2230122110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:22.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.716+0000 7f22365d8700 1 --2- 172.21.15.26:0/175714368 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f223009d6f0 0x7f2230121690 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:22.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.716+0000 7f22365d8700 1 --2- 172.21.15.26:0/175714368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f223009e1d0 0x7f2230121bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:22.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.716+0000 7f22365d8700 1 -- 172.21.15.26:0/175714368 >> 172.21.15.26:0/175714368 conn(0x7f2230066f50 msgr2=0x7f223009b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:22.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.716+0000 7f22365d8700 1 -- 172.21.15.26:0/175714368 shutdown_connections 2023-10-01T07:57:22.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.716+0000 7f22365d8700 1 -- 172.21.15.26:0/175714368 wait complete. 2023-10-01T07:57:22.735 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:22.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.756+0000 7facaef79700 1 -- 172.21.15.26:0/2937727749 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faca80747f0 con 0x7faca809d630 2023-10-01T07:57:22.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.756+0000 7faca57fa700 1 -- 172.21.15.26:0/2937727749 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fac98015070 con 0x7faca809d630 2023-10-01T07:57:22.757 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:22.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.758+0000 7f0eb1dd8700 1 -- 172.21.15.26:0/1961062600 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0eac074ea0 con 0x7f0eac0a1340 2023-10-01T07:57:22.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.758+0000 7facaef79700 1 -- 172.21.15.26:0/2937727749 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faca809d630 msgr2=0x7faca81207c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:22.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.758+0000 7facaef79700 1 --2- 172.21.15.26:0/2937727749 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faca809d630 0x7faca81207c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fac98009c40 tx=0x7fac98004750 comp rx=0 tx=0).stop 2023-10-01T07:57:22.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.758+0000 7f0ea3fff700 1 -- 172.21.15.26:0/1961062600 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0e94011eb0 con 0x7f0eac0a1340 2023-10-01T07:57:22.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.758+0000 7facaef79700 1 -- 172.21.15.26:0/2937727749 shutdown_connections 2023-10-01T07:57:22.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.758+0000 7facaef79700 1 --2- 172.21.15.26:0/2937727749 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faca8138d80 0x7faca8121240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:22.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.758+0000 7facaef79700 1 --2- 172.21.15.26:0/2937727749 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faca809d630 0x7faca81207c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:22.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.758+0000 7facaef79700 1 --2- 172.21.15.26:0/2937727749 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faca80a0a30 0x7faca8120d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:22.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.758+0000 7facaef79700 1 -- 172.21.15.26:0/2937727749 >> 172.21.15.26:0/2937727749 conn(0x7faca80a3050 msgr2=0x7faca809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:22.760 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:22.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.758+0000 7facaef79700 1 -- 172.21.15.26:0/2937727749 shutdown_connections 2023-10-01T07:57:22.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.758+0000 7facaef79700 1 -- 172.21.15.26:0/2937727749 wait complete. 2023-10-01T07:57:22.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.760+0000 7f0eb1dd8700 1 -- 172.21.15.26:0/1961062600 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0eac0a1340 msgr2=0x7f0eac11ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:22.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.760+0000 7f0eb1dd8700 1 --2- 172.21.15.26:0/1961062600 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0eac0a1340 0x7f0eac11ece0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0e9400ec10 tx=0x7f0e9400ef20 comp rx=0 tx=0).stop 2023-10-01T07:57:22.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.761+0000 7f0eb1dd8700 1 -- 172.21.15.26:0/1961062600 shutdown_connections 2023-10-01T07:57:22.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.761+0000 7f0eb1dd8700 1 --2- 172.21.15.26:0/1961062600 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0eac133fa0 0x7f0eac11f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:22.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.761+0000 7f0eb1dd8700 1 --2- 172.21.15.26:0/1961062600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0eac0a0a30 0x7f0eac11e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:22.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.761+0000 7f0eb1dd8700 1 --2- 172.21.15.26:0/1961062600 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0eac0a1340 0x7f0eac11ece0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:22.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.761+0000 7f0eb1dd8700 1 -- 172.21.15.26:0/1961062600 >> 172.21.15.26:0/1961062600 conn(0x7f0eac0a6550 msgr2=0x7f0eac1b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:22.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.761+0000 7f0eb1dd8700 1 -- 172.21.15.26:0/1961062600 shutdown_connections 2023-10-01T07:57:22.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:22.761+0000 7f0eb1dd8700 1 -- 172.21.15.26:0/1961062600 wait complete. 2023-10-01T07:57:22.774 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:22.775 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:22.970 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:23.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.118+0000 7f89f86a0700 1 Processor -- start 2023-10-01T07:57:23.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.118+0000 7f89f86a0700 1 -- start start 2023-10-01T07:57:23.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.118+0000 7f89f86a0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89f009e930 0x7f89f009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:23.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.118+0000 7f89f86a0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89f009f240 0x7f89f01317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:23.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.118+0000 7f89f86a0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f89f009f650 0x7f89f0131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:23.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.118+0000 7f89f86a0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f0070940 con 0x7f89f009f650 2023-10-01T07:57:23.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.118+0000 7f89f86a0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f006fd60 con 0x7f89f009f240 2023-10-01T07:57:23.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.118+0000 7f89f86a0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89f006fa80 con 0x7f89f009e930 2023-10-01T07:57:23.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.119+0000 7f89f643c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89f009e930 0x7f89f009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:23.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.119+0000 7f89f5c3b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89f009f240 0x7f89f01317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:23.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.119+0000 7f89f6c3d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f89f009f650 0x7f89f0131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:23.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.119+0000 7f89f5c3b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89f009f240 0x7f89f01317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46238/0 (socket says 172.21.15.26:46238) 2023-10-01T07:57:23.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.119+0000 7f89f643c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89f009e930 0x7f89f009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49874/0 (socket says 172.21.15.26:49874) 2023-10-01T07:57:23.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.119+0000 7f89f6c3d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f89f009f650 0x7f89f0131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55470/0 (socket says 172.21.15.26:55470) 2023-10-01T07:57:23.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.119+0000 7f89f5c3b700 1 -- 172.21.15.26:0/2500600175 learned_addr learned my addr 172.21.15.26:0/2500600175 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:23.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.119+0000 7f89f643c700 1 -- 172.21.15.26:0/2500600175 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89f009f240 msgr2=0x7f89f01317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:23.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.119+0000 7f89f643c700 1 --2- 172.21.15.26:0/2500600175 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89f009f240 0x7f89f01317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:23.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.119+0000 7f89f643c700 1 -- 172.21.15.26:0/2500600175 >> v2:172.21.15.26:3300/0 conn(0x7f89f009f650 msgr2=0x7f89f0131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:23.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.119+0000 7f89f643c700 1 --2- 172.21.15.26:0/2500600175 >> v2:172.21.15.26:3300/0 conn(0x7f89f009f650 0x7f89f0131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:23.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.119+0000 7f89f643c700 1 -- 172.21.15.26:0/2500600175 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f009fb60 con 0x7f89f009e930 2023-10-01T07:57:23.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.119+0000 7f89f5c3b700 1 --2- 172.21.15.26:0/2500600175 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89f009f240 0x7f89f01317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:23.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.119+0000 7f89f643c700 1 --2- 172.21.15.26:0/2500600175 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89f009e930 0x7f89f009ed00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f89ec009840 tx=0x7f89ec009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6dcd895feab78ea0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:23.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.119+0000 7f89f543a700 1 -- 172.21.15.26:0/2500600175 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec011830 con 0x7f89f009e930 2023-10-01T07:57:23.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.119+0000 7f89f543a700 1 -- 172.21.15.26:0/2500600175 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89ec011990 con 0x7f89f009e930 2023-10-01T07:57:23.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.119+0000 7f89f543a700 1 -- 172.21.15.26:0/2500600175 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec011d20 con 0x7f89f009e930 2023-10-01T07:57:23.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.120+0000 7f89f86a0700 1 -- 172.21.15.26:0/2500600175 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89f009e930 msgr2=0x7f89f009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:23.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.120+0000 7f89f86a0700 1 --2- 172.21.15.26:0/2500600175 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89f009e930 0x7f89f009ed00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f89ec009840 tx=0x7f89ec009b50 comp rx=0 tx=0).stop 2023-10-01T07:57:23.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.120+0000 7f89f86a0700 1 -- 172.21.15.26:0/2500600175 shutdown_connections 2023-10-01T07:57:23.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.120+0000 7f89f86a0700 1 --2- 172.21.15.26:0/2500600175 >> v2:172.21.15.26:3300/0 conn(0x7f89f009f650 0x7f89f0131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:23.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.120+0000 7f89f86a0700 1 --2- 172.21.15.26:0/2500600175 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89f009e930 0x7f89f009ed00 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:23.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.120+0000 7f89f86a0700 1 --2- 172.21.15.26:0/2500600175 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89f009f240 0x7f89f01317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:23.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.120+0000 7f89f86a0700 1 -- 172.21.15.26:0/2500600175 >> 172.21.15.26:0/2500600175 conn(0x7f89f00a4210 msgr2=0x7f89f00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:23.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.120+0000 7f89f86a0700 1 -- 172.21.15.26:0/2500600175 shutdown_connections 2023-10-01T07:57:23.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.120+0000 7f89f86a0700 1 -- 172.21.15.26:0/2500600175 wait complete. 2023-10-01T07:57:23.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.121+0000 7f89f86a0700 1 Processor -- start 2023-10-01T07:57:23.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.121+0000 7f89f86a0700 1 -- start start 2023-10-01T07:57:23.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.122+0000 7f89f86a0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89f009e930 0x7f89f01a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:23.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.122+0000 7f89f86a0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89f009f240 0x7f89f01a4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:23.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.122+0000 7f89f86a0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89f009f650 0x7f89f01a4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:23.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.122+0000 7f89f86a0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f01a80e0 con 0x7f89f009e930 2023-10-01T07:57:23.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.122+0000 7f89f86a0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f01a7720 con 0x7f89f009f650 2023-10-01T07:57:23.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.122+0000 7f89f86a0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89f01a6a60 con 0x7f89f009f240 2023-10-01T07:57:23.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.122+0000 7f89f5c3b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89f009f240 0x7f89f01a4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:23.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.122+0000 7f89f643c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89f009e930 0x7f89f01a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:23.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.122+0000 7f89f643c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89f009e930 0x7f89f01a3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55484/0 (socket says 172.21.15.26:55484) 2023-10-01T07:57:23.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.122+0000 7f89f6c3d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89f009f650 0x7f89f01a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:23.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.122+0000 7f89f5c3b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89f009f240 0x7f89f01a4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49876/0 (socket says 172.21.15.26:49876) 2023-10-01T07:57:23.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.122+0000 7f89f643c700 1 -- 172.21.15.26:0/1288861563 learned_addr learned my addr 172.21.15.26:0/1288861563 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:23.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.122+0000 7f89f643c700 1 -- 172.21.15.26:0/1288861563 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89f009f240 msgr2=0x7f89f01a4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:23.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.122+0000 7f89f643c700 1 --2- 172.21.15.26:0/1288861563 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89f009f240 0x7f89f01a4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:23.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.122+0000 7f89f643c700 1 -- 172.21.15.26:0/1288861563 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89f009f650 msgr2=0x7f89f01a4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:23.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.122+0000 7f89f643c700 1 --2- 172.21.15.26:0/1288861563 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89f009f650 0x7f89f01a4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:23.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.122+0000 7f89f643c700 1 -- 172.21.15.26:0/1288861563 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e0009550 con 0x7f89f009e930 2023-10-01T07:57:23.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.122+0000 7f89f5c3b700 1 --2- 172.21.15.26:0/1288861563 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89f009f240 0x7f89f01a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:23.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.122+0000 7f89f643c700 1 --2- 172.21.15.26:0/1288861563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89f009e930 0x7f89f01a3c00 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f89ec0090b0 tx=0x7f89ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:23.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.122+0000 7f89e6ffd700 1 -- 172.21.15.26:0/1288861563 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec004450 con 0x7f89f009e930 2023-10-01T07:57:23.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.122+0000 7f89e6ffd700 1 -- 172.21.15.26:0/1288861563 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89ec01f070 con 0x7f89f009e930 2023-10-01T07:57:23.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.122+0000 7f89f86a0700 1 -- 172.21.15.26:0/1288861563 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89ec0094a0 con 0x7f89f009e930 2023-10-01T07:57:23.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.122+0000 7f89e6ffd700 1 -- 172.21.15.26:0/1288861563 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec0038e0 con 0x7f89f009e930 2023-10-01T07:57:23.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.123+0000 7f89f86a0700 1 -- 172.21.15.26:0/1288861563 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f00a0190 con 0x7f89f009e930 2023-10-01T07:57:23.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.123+0000 7f89e6ffd700 1 -- 172.21.15.26:0/1288861563 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f89ec003a40 con 0x7f89f009e930 2023-10-01T07:57:23.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.123+0000 7f89e6ffd700 1 -- 172.21.15.26:0/1288861563 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f89ec021070 con 0x7f89f009e930 2023-10-01T07:57:23.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.124+0000 7f89f86a0700 1 -- 172.21.15.26:0/1288861563 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f01a0b30 con 0x7f89f009e930 2023-10-01T07:57:23.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.129+0000 7f89e6ffd700 1 -- 172.21.15.26:0/1288861563 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f89ec01a430 con 0x7f89f009e930 2023-10-01T07:57:23.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.331+0000 7f89f86a0700 1 -- 172.21.15.26:0/1288861563 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f89f01a5870 con 0x7f89f009e930 2023-10-01T07:57:23.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.331+0000 7f89e6ffd700 1 -- 172.21.15.26:0/1288861563 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f89ec015020 con 0x7f89f009e930 2023-10-01T07:57:23.332 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:23.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.333+0000 7f89f86a0700 1 -- 172.21.15.26:0/1288861563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89f009e930 msgr2=0x7f89f01a3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:23.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.333+0000 7f89f86a0700 1 --2- 172.21.15.26:0/1288861563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89f009e930 0x7f89f01a3c00 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f89ec0090b0 tx=0x7f89ec004750 comp rx=0 tx=0).stop 2023-10-01T07:57:23.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.333+0000 7f89f86a0700 1 -- 172.21.15.26:0/1288861563 shutdown_connections 2023-10-01T07:57:23.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.333+0000 7f89f86a0700 1 --2- 172.21.15.26:0/1288861563 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89f009f650 0x7f89f01a4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:23.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.333+0000 7f89f86a0700 1 --2- 172.21.15.26:0/1288861563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89f009e930 0x7f89f01a3c00 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:23.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.333+0000 7f89f86a0700 1 --2- 172.21.15.26:0/1288861563 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89f009f240 0x7f89f01a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:23.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.333+0000 7f89f86a0700 1 -- 172.21.15.26:0/1288861563 >> 172.21.15.26:0/1288861563 conn(0x7f89f00a4210 msgr2=0x7f89f01b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:23.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.334+0000 7f89f86a0700 1 -- 172.21.15.26:0/1288861563 shutdown_connections 2023-10-01T07:57:23.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.334+0000 7f89f86a0700 1 -- 172.21.15.26:0/1288861563 wait complete. 2023-10-01T07:57:23.348 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:23.736 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:23.775 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:23.777 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:23.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.887+0000 7f4312e48700 1 Processor -- start 2023-10-01T07:57:23.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.888+0000 7f4312e48700 1 -- start start 2023-10-01T07:57:23.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.888+0000 7f4312e48700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f430c09d6f0 0x7f430c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:23.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.888+0000 7f4312e48700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f430c09e410 0x7f430c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:23.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.888+0000 7f4312e48700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f430c09b120 con 0x7f430c09e000 2023-10-01T07:57:23.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.888+0000 7f4312e48700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f430c06b460 con 0x7f430c09e410 2023-10-01T07:57:23.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.888+0000 7f4312e48700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f430c09a7e0 con 0x7f430c09d6f0 2023-10-01T07:57:23.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.888+0000 7f43113e5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f430c09e410 0x7f430c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:23.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.888+0000 7f43113e5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f430c09e410 0x7f430c134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33934/0 (socket says 172.21.15.26:33934) 2023-10-01T07:57:23.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.888+0000 7f43113e5700 1 -- 172.21.15.26:0/1830550809 learned_addr learned my addr 172.21.15.26:0/1830550809 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:23.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.888+0000 7f430bfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f430c09e000 0x7f430c1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48324/0 (socket says 172.21.15.26:48324) 2023-10-01T07:57:23.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.888+0000 7f4310be4700 1 --2- 172.21.15.26:0/1830550809 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f430c09d6f0 0x7f430c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:23.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.889+0000 7f43113e5700 1 -- 172.21.15.26:0/1830550809 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f430c09d6f0 msgr2=0x7f430c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:23.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.889+0000 7f43113e5700 1 --2- 172.21.15.26:0/1830550809 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f430c09d6f0 0x7f430c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:23.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.889+0000 7f43113e5700 1 -- 172.21.15.26:0/1830550809 >> v1:172.21.15.26:6789/0 conn(0x7f430c09e000 legacy=0x7f430c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:23.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.889+0000 7f43113e5700 1 -- 172.21.15.26:0/1830550809 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f430c09a500 con 0x7f430c09e410 2023-10-01T07:57:23.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.889+0000 7f43113e5700 1 --2- 172.21.15.26:0/1830550809 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f430c09e410 0x7f430c134100 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4304009e80 tx=0x7f430400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c01e7e3f2390f10 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:23.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.889+0000 7f430b7fe700 1 -- 172.21.15.26:0/1830550809 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430400e070 con 0x7f430c09e410 2023-10-01T07:57:23.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.889+0000 7f430b7fe700 1 -- 172.21.15.26:0/1830550809 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f430400b910 con 0x7f430c09e410 2023-10-01T07:57:23.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.889+0000 7f430b7fe700 1 -- 172.21.15.26:0/1830550809 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430400bcc0 con 0x7f430c09e410 2023-10-01T07:57:23.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.890+0000 7f4312e48700 1 -- 172.21.15.26:0/1830550809 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f430c09e410 msgr2=0x7f430c134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:23.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.890+0000 7f4312e48700 1 --2- 172.21.15.26:0/1830550809 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f430c09e410 0x7f430c134100 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4304009e80 tx=0x7f430400b330 comp rx=0 tx=0).stop 2023-10-01T07:57:23.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.890+0000 7f4312e48700 1 -- 172.21.15.26:0/1830550809 shutdown_connections 2023-10-01T07:57:23.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.890+0000 7f4312e48700 1 --2- 172.21.15.26:0/1830550809 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f430c09d6f0 0x7f430c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:23.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.890+0000 7f4312e48700 1 --2- 172.21.15.26:0/1830550809 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f430c09e410 0x7f430c134100 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:23.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.890+0000 7f4312e48700 1 -- 172.21.15.26:0/1830550809 >> 172.21.15.26:0/1830550809 conn(0x7f430c066f50 msgr2=0x7f430c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:23.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.890+0000 7f4312e48700 1 -- 172.21.15.26:0/1830550809 shutdown_connections 2023-10-01T07:57:23.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.890+0000 7f4312e48700 1 -- 172.21.15.26:0/1830550809 wait complete. 2023-10-01T07:57:23.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.892+0000 7f4312e48700 1 Processor -- start 2023-10-01T07:57:23.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.892+0000 7f4312e48700 1 -- start start 2023-10-01T07:57:23.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.893+0000 7f4312e48700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f430c09d6f0 0x7f430c122470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:23.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.893+0000 7f4312e48700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f430c09e000 0x7f430c1229b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:23.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.893+0000 7f4312e48700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f430c09e410 0x7f430c122ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:23.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.893+0000 7f4312e48700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430c124f00 con 0x7f430c09e410 2023-10-01T07:57:23.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.893+0000 7f4312e48700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f430c1337d0 con 0x7f430c09e000 2023-10-01T07:57:23.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.893+0000 7f4312e48700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f430c125c20 con 0x7f430c09d6f0 2023-10-01T07:57:23.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.893+0000 7f430bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f430c09e000 0x7f430c1229b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:23.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.893+0000 7f4310be4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f430c09d6f0 0x7f430c122470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:23.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.893+0000 7f430bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f430c09e000 0x7f430c1229b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33948/0 (socket says 172.21.15.26:33948) 2023-10-01T07:57:23.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.893+0000 7f4310be4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f430c09d6f0 0x7f430c122470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39438/0 (socket says 172.21.15.26:39438) 2023-10-01T07:57:23.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.893+0000 7f430bfff700 1 -- 172.21.15.26:0/1273676474 learned_addr learned my addr 172.21.15.26:0/1273676474 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:23.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.893+0000 7f43113e5700 1 --2- 172.21.15.26:0/1273676474 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f430c09e410 0x7f430c122ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:23.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.893+0000 7f430bfff700 1 -- 172.21.15.26:0/1273676474 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f430c09d6f0 msgr2=0x7f430c122470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:23.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.893+0000 7f430bfff700 1 --2- 172.21.15.26:0/1273676474 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f430c09d6f0 0x7f430c122470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:23.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.893+0000 7f430bfff700 1 -- 172.21.15.26:0/1273676474 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f430c09e410 msgr2=0x7f430c122ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:23.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.893+0000 7f430bfff700 1 --2- 172.21.15.26:0/1273676474 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f430c09e410 0x7f430c122ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:23.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.893+0000 7f430bfff700 1 -- 172.21.15.26:0/1273676474 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4304009b30 con 0x7f430c09e000 2023-10-01T07:57:23.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.893+0000 7f4310be4700 1 --2- 172.21.15.26:0/1273676474 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f430c09d6f0 0x7f430c122470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:23.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.893+0000 7f430bfff700 1 --2- 172.21.15.26:0/1273676474 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f430c09e000 0x7f430c1229b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f42f800c4f0 tx=0x7f42f800c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:23.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.894+0000 7f43097fa700 1 -- 172.21.15.26:0/1273676474 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f8005cb0 con 0x7f430c09e000 2023-10-01T07:57:23.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.894+0000 7f43097fa700 1 -- 172.21.15.26:0/1273676474 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f8005e10 con 0x7f430c09e000 2023-10-01T07:57:23.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.894+0000 7f43097fa700 1 -- 172.21.15.26:0/1273676474 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f80072d0 con 0x7f430c09e000 2023-10-01T07:57:23.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.894+0000 7f4312e48700 1 -- 172.21.15.26:0/1273676474 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f430c0a2160 con 0x7f430c09e000 2023-10-01T07:57:23.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.894+0000 7f4312e48700 1 -- 172.21.15.26:0/1273676474 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f430c125f00 con 0x7f430c09e000 2023-10-01T07:57:23.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.895+0000 7f4312e48700 1 -- 172.21.15.26:0/1273676474 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f430c074ea0 con 0x7f430c09e000 2023-10-01T07:57:23.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.895+0000 7f43097fa700 1 -- 172.21.15.26:0/1273676474 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f42f8007430 con 0x7f430c09e000 2023-10-01T07:57:23.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.895+0000 7f43097fa700 1 -- 172.21.15.26:0/1273676474 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f42f803eb00 con 0x7f430c09e000 2023-10-01T07:57:23.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.900+0000 7f43097fa700 1 -- 172.21.15.26:0/1273676474 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f42f801b3b0 con 0x7f430c09e000 2023-10-01T07:57:23.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.926+0000 7faede5d1700 1 Processor -- start 2023-10-01T07:57:23.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.926+0000 7faede5d1700 1 -- start start 2023-10-01T07:57:23.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.927+0000 7f29f005a700 1 Processor -- start 2023-10-01T07:57:23.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.927+0000 7faede5d1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faed809f410 0x7faed8136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:23.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.927+0000 7faede5d1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faed8136fe0 0x7faed81393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:23.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.927+0000 7faede5d1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed8070940 con 0x7faed809e930 2023-10-01T07:57:23.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.927+0000 7faede5d1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed806fd60 con 0x7faed8136fe0 2023-10-01T07:57:23.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.927+0000 7faede5d1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faed806fa80 con 0x7faed809f410 2023-10-01T07:57:23.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.927+0000 7faedcb6e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faed8136fe0 0x7faed81393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:23.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.927+0000 7f29f005a700 1 -- start start 2023-10-01T07:57:23.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.927+0000 7faedcb6e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faed8136fe0 0x7faed81393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33950/0 (socket says 172.21.15.26:33950) 2023-10-01T07:57:23.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.927+0000 7faedcb6e700 1 -- 172.21.15.26:0/1868878827 learned_addr learned my addr 172.21.15.26:0/1868878827 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:23.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.927+0000 7faed77fe700 1 --2- 172.21.15.26:0/1868878827 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faed809f410 0x7faed8136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:23.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.927+0000 7faedcb6e700 1 -- 172.21.15.26:0/1868878827 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faed809f410 msgr2=0x7faed8136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:23.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.927+0000 7faedcb6e700 1 --2- 172.21.15.26:0/1868878827 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faed809f410 0x7faed8136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:23.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.927+0000 7faedcb6e700 1 -- 172.21.15.26:0/1868878827 >> v1:172.21.15.26:6789/0 conn(0x7faed809e930 legacy=0x7faed809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:23.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.927+0000 7faedcb6e700 1 -- 172.21.15.26:0/1868878827 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed809fb60 con 0x7faed8136fe0 2023-10-01T07:57:23.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.927+0000 7f29f005a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29e80a0a30 0x7f29e80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:23.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.928+0000 7f29f005a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29e80a1340 0x7f29e8133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:23.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.928+0000 7f29f005a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29e809edd0 con 0x7f29e8133fa0 2023-10-01T07:57:23.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.928+0000 7f29f005a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e809e1f0 con 0x7f29e80a1340 2023-10-01T07:57:23.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.928+0000 7f29f005a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29e809dc50 con 0x7f29e80a0a30 2023-10-01T07:57:23.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.928+0000 7f29eddf6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29e80a0a30 0x7f29e80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:23.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.928+0000 7f29eddf6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29e80a0a30 0x7f29e80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39466/0 (socket says 172.21.15.26:39466) 2023-10-01T07:57:23.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.928+0000 7f29eddf6700 1 -- 172.21.15.26:0/185255404 learned_addr learned my addr 172.21.15.26:0/185255404 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:23.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.928+0000 7faedcb6e700 1 --2- 172.21.15.26:0/1868878827 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faed8136fe0 0x7faed81393c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7faed0009e80 tx=0x7faed000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e1f55be3df1b24e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:23.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.928+0000 7f29ed5f5700 1 --2- 172.21.15.26:0/185255404 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29e80a1340 0x7f29e8133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:23.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.928+0000 7f29eddf6700 1 -- 172.21.15.26:0/185255404 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29e80a1340 msgr2=0x7f29e8133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:23.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.928+0000 7f29eddf6700 1 --2- 172.21.15.26:0/185255404 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29e80a1340 0x7f29e8133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:23.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.928+0000 7f29eddf6700 1 -- 172.21.15.26:0/185255404 >> v1:172.21.15.26:6789/0 conn(0x7f29e8133fa0 legacy=0x7f29e813ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:23.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.928+0000 7f29ecdf4700 1 -- 172.21.15.26:0/185255404 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 329916402 0 0) 0x7f29e809edd0 con 0x7f29e8133fa0 2023-10-01T07:57:23.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.928+0000 7f29eddf6700 1 -- 172.21.15.26:0/185255404 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e80a1fe0 con 0x7f29e80a0a30 2023-10-01T07:57:23.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.928+0000 7faed6ffd700 1 -- 172.21.15.26:0/1868878827 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed000e070 con 0x7faed8136fe0 2023-10-01T07:57:23.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.928+0000 7faed6ffd700 1 -- 172.21.15.26:0/1868878827 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed000b910 con 0x7faed8136fe0 2023-10-01T07:57:23.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.928+0000 7faed6ffd700 1 -- 172.21.15.26:0/1868878827 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed000bcc0 con 0x7faed8136fe0 2023-10-01T07:57:23.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.928+0000 7f29eddf6700 1 --2- 172.21.15.26:0/185255404 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29e80a0a30 0x7f29e80a0e00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f29e4009920 tx=0x7f29e4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0c969220b08828a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:23.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.929+0000 7f29ecdf4700 1 -- 172.21.15.26:0/185255404 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e4011830 con 0x7f29e80a0a30 2023-10-01T07:57:23.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.929+0000 7f29ecdf4700 1 -- 172.21.15.26:0/185255404 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e4011990 con 0x7f29e80a0a30 2023-10-01T07:57:23.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.929+0000 7f29ecdf4700 1 -- 172.21.15.26:0/185255404 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e4011d20 con 0x7f29e80a0a30 2023-10-01T07:57:23.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.929+0000 7faede5d1700 1 -- 172.21.15.26:0/1868878827 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faed8136fe0 msgr2=0x7faed81393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:23.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.929+0000 7faede5d1700 1 --2- 172.21.15.26:0/1868878827 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faed8136fe0 0x7faed81393c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7faed0009e80 tx=0x7faed000b330 comp rx=0 tx=0).stop 2023-10-01T07:57:23.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.929+0000 7faede5d1700 1 -- 172.21.15.26:0/1868878827 shutdown_connections 2023-10-01T07:57:23.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.929+0000 7faede5d1700 1 --2- 172.21.15.26:0/1868878827 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faed8136fe0 0x7faed81393c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:23.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.929+0000 7faede5d1700 1 --2- 172.21.15.26:0/1868878827 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faed809f410 0x7faed8136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:23.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.929+0000 7faede5d1700 1 -- 172.21.15.26:0/1868878827 >> 172.21.15.26:0/1868878827 conn(0x7faed80a4210 msgr2=0x7faed80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:23.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.929+0000 7faede5d1700 1 -- 172.21.15.26:0/1868878827 shutdown_connections 2023-10-01T07:57:23.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.929+0000 7faede5d1700 1 -- 172.21.15.26:0/1868878827 wait complete. 2023-10-01T07:57:23.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.929+0000 7f29f005a700 1 -- 172.21.15.26:0/185255404 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29e80a0a30 msgr2=0x7f29e80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:23.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.929+0000 7f29f005a700 1 --2- 172.21.15.26:0/185255404 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29e80a0a30 0x7f29e80a0e00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f29e4009920 tx=0x7f29e4009c30 comp rx=0 tx=0).stop 2023-10-01T07:57:23.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.930+0000 7f29f005a700 1 -- 172.21.15.26:0/185255404 shutdown_connections 2023-10-01T07:57:23.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.930+0000 7f29f005a700 1 --2- 172.21.15.26:0/185255404 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29e80a0a30 0x7f29e80a0e00 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:23.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.930+0000 7f29f005a700 1 --2- 172.21.15.26:0/185255404 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29e80a1340 0x7f29e8133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:23.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.930+0000 7f29f005a700 1 -- 172.21.15.26:0/185255404 >> 172.21.15.26:0/185255404 conn(0x7f29e80a6550 msgr2=0x7f29e80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:23.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.930+0000 7f29f005a700 1 -- 172.21.15.26:0/185255404 shutdown_connections 2023-10-01T07:57:23.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.930+0000 7f29f005a700 1 -- 172.21.15.26:0/185255404 wait complete. 2023-10-01T07:57:23.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.930+0000 7faede5d1700 1 Processor -- start 2023-10-01T07:57:23.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.931+0000 7faede5d1700 1 -- start start 2023-10-01T07:57:23.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.931+0000 7f29f005a700 1 Processor -- start 2023-10-01T07:57:23.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.931+0000 7f29f005a700 1 -- start start 2023-10-01T07:57:23.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.931+0000 7f29f005a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29e80a0a30 0x7f29e811e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:23.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.931+0000 7f29f005a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29e80a1340 0x7f29e811eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:23.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.931+0000 7f29f005a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29e8133fa0 0x7f29e811f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:23.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.931+0000 7f29f005a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e8120480 con 0x7f29e80a1340 2023-10-01T07:57:23.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.931+0000 7f29f005a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e8121fa0 con 0x7f29e8133fa0 2023-10-01T07:57:23.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.931+0000 7f29f005a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29e80a3750 con 0x7f29e80a0a30 2023-10-01T07:57:23.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.931+0000 7f29ed5f5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29e80a1340 0x7f29e811eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:23.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.931+0000 7f29ed5f5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29e80a1340 0x7f29e811eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59522/0 (socket says 172.21.15.26:59522) 2023-10-01T07:57:23.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.931+0000 7f29ed5f5700 1 -- 172.21.15.26:0/3065196083 learned_addr learned my addr 172.21.15.26:0/3065196083 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:23.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.932+0000 7f29ee5f7700 1 --2- 172.21.15.26:0/3065196083 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29e8133fa0 0x7f29e811f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:23.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.931+0000 7faede5d1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faed809e930 0x7faed806c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:23.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.931+0000 7faede5d1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faed809f410 0x7faed806c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:23.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.931+0000 7faede5d1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faed8136fe0 0x7faed81c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:23.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.931+0000 7faede5d1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed806bd90 con 0x7faed809f410 2023-10-01T07:57:23.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.931+0000 7faede5d1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed8120ec0 con 0x7faed809e930 2023-10-01T07:57:23.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.931+0000 7faede5d1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faed8121d90 con 0x7faed8136fe0 2023-10-01T07:57:23.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.932+0000 7faedcb6e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faed8136fe0 0x7faed81c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:23.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.932+0000 7faedcb6e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faed8136fe0 0x7faed81c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39482/0 (socket says 172.21.15.26:39482) 2023-10-01T07:57:23.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.932+0000 7faedcb6e700 1 -- 172.21.15.26:0/3522595285 learned_addr learned my addr 172.21.15.26:0/3522595285 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:23.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.932+0000 7faed7fff700 1 --2- 172.21.15.26:0/3522595285 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faed809e930 0x7faed806c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:23.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.932+0000 7faed77fe700 1 --2- 172.21.15.26:0/3522595285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faed809f410 0x7faed806c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:23.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.932+0000 7f29eddf6700 1 --2- 172.21.15.26:0/3065196083 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29e80a0a30 0x7f29e811e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:23.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.932+0000 7f29ed5f5700 1 -- 172.21.15.26:0/3065196083 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29e80a0a30 msgr2=0x7f29e811e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:23.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.932+0000 7f29ed5f5700 1 --2- 172.21.15.26:0/3065196083 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29e80a0a30 0x7f29e811e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:23.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.932+0000 7f29ed5f5700 1 -- 172.21.15.26:0/3065196083 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29e8133fa0 msgr2=0x7f29e811f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:23.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.932+0000 7f29ed5f5700 1 --2- 172.21.15.26:0/3065196083 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29e8133fa0 0x7f29e811f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:23.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.932+0000 7f29ed5f5700 1 -- 172.21.15.26:0/3065196083 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e4009550 con 0x7f29e80a1340 2023-10-01T07:57:23.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.932+0000 7faedcb6e700 1 -- 172.21.15.26:0/3522595285 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faed809e930 msgr2=0x7faed806c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:23.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.932+0000 7faedcb6e700 1 --2- 172.21.15.26:0/3522595285 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faed809e930 0x7faed806c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:23.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.932+0000 7faedcb6e700 1 -- 172.21.15.26:0/3522595285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faed809f410 msgr2=0x7faed806c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:23.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.932+0000 7faedcb6e700 1 --2- 172.21.15.26:0/3522595285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faed809f410 0x7faed806c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:23.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.932+0000 7faedcb6e700 1 -- 172.21.15.26:0/3522595285 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed0009b30 con 0x7faed8136fe0 2023-10-01T07:57:23.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.932+0000 7faed7fff700 1 --2- 172.21.15.26:0/3522595285 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faed809e930 0x7faed806c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:57:23.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.932+0000 7f29eddf6700 1 --2- 172.21.15.26:0/3065196083 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29e80a0a30 0x7f29e811e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:57:23.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.932+0000 7f29ed5f5700 1 --2- 172.21.15.26:0/3065196083 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29e80a1340 0x7f29e811eca0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f29d800e9b0 tx=0x7f29d800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:23.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.932+0000 7faedcb6e700 1 --2- 172.21.15.26:0/3522595285 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faed8136fe0 0x7faed81c8260 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7faed0012000 tx=0x7faed0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:23.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.933+0000 7f29de7fc700 1 -- 172.21.15.26:0/3065196083 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d8009710 con 0x7f29e80a1340 2023-10-01T07:57:23.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.933+0000 7faed4ff9700 1 -- 172.21.15.26:0/3522595285 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0004450 con 0x7faed8136fe0 2023-10-01T07:57:23.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.933+0000 7f29de7fc700 1 -- 172.21.15.26:0/3065196083 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d800c850 con 0x7f29e80a1340 2023-10-01T07:57:23.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.933+0000 7f29de7fc700 1 -- 172.21.15.26:0/3065196083 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d800cbc0 con 0x7f29e80a1340 2023-10-01T07:57:23.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.933+0000 7f29f005a700 1 -- 172.21.15.26:0/3065196083 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29e80a25e0 con 0x7f29e80a1340 2023-10-01T07:57:23.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.933+0000 7faed4ff9700 1 -- 172.21.15.26:0/3522595285 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed00045b0 con 0x7faed8136fe0 2023-10-01T07:57:23.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.933+0000 7faede5d1700 1 -- 172.21.15.26:0/3522595285 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed80a2f40 con 0x7faed8136fe0 2023-10-01T07:57:23.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.933+0000 7f29f005a700 1 -- 172.21.15.26:0/3065196083 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e80a0270 con 0x7f29e80a1340 2023-10-01T07:57:23.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.933+0000 7faed4ff9700 1 -- 172.21.15.26:0/3522595285 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0004960 con 0x7faed8136fe0 2023-10-01T07:57:23.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.934+0000 7faede5d1700 1 -- 172.21.15.26:0/3522595285 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed8121090 con 0x7faed8136fe0 2023-10-01T07:57:23.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.934+0000 7f29de7fc700 1 -- 172.21.15.26:0/3065196083 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f29d800cd20 con 0x7f29e80a1340 2023-10-01T07:57:23.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.934+0000 7faed4ff9700 1 -- 172.21.15.26:0/3522595285 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faed001c410 con 0x7faed8136fe0 2023-10-01T07:57:23.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.934+0000 7f29f005a700 1 -- 172.21.15.26:0/3065196083 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29e81223a0 con 0x7f29e80a1340 2023-10-01T07:57:23.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.934+0000 7faed4ff9700 1 -- 172.21.15.26:0/3522595285 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faed0042af0 con 0x7faed8136fe0 2023-10-01T07:57:23.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.934+0000 7f29de7fc700 1 -- 172.21.15.26:0/3065196083 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f29d803fc70 con 0x7f29e80a1340 2023-10-01T07:57:23.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.935+0000 7faede5d1700 1 -- 172.21.15.26:0/3522595285 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed8074ea0 con 0x7faed8136fe0 2023-10-01T07:57:23.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.943+0000 7f29de7fc700 1 -- 172.21.15.26:0/3065196083 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f29d801b3b0 con 0x7f29e80a1340 2023-10-01T07:57:23.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:23.943+0000 7faed4ff9700 1 -- 172.21.15.26:0/3522595285 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faed0046060 con 0x7faed8136fe0 2023-10-01T07:57:24.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.114+0000 7f4312e48700 1 -- 172.21.15.26:0/1273676474 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f430c06c360 con 0x7f430c09e000 2023-10-01T07:57:24.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.115+0000 7f43097fa700 1 -- 172.21.15.26:0/1273676474 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f42f8017020 con 0x7f430c09e000 2023-10-01T07:57:24.116 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:24.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.117+0000 7f4312e48700 1 -- 172.21.15.26:0/1273676474 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f430c09e000 msgr2=0x7f430c1229b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:24.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.117+0000 7f4312e48700 1 --2- 172.21.15.26:0/1273676474 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f430c09e000 0x7f430c1229b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f42f800c4f0 tx=0x7f42f800c800 comp rx=0 tx=0).stop 2023-10-01T07:57:24.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.117+0000 7f4312e48700 1 -- 172.21.15.26:0/1273676474 shutdown_connections 2023-10-01T07:57:24.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.117+0000 7f4312e48700 1 --2- 172.21.15.26:0/1273676474 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f430c09e410 0x7f430c122ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:24.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.117+0000 7f4312e48700 1 --2- 172.21.15.26:0/1273676474 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f430c09d6f0 0x7f430c122470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:24.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.117+0000 7f4312e48700 1 --2- 172.21.15.26:0/1273676474 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f430c09e000 0x7f430c1229b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:24.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.117+0000 7f4312e48700 1 -- 172.21.15.26:0/1273676474 >> 172.21.15.26:0/1273676474 conn(0x7f430c066f50 msgr2=0x7f430c070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:24.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.117+0000 7f4312e48700 1 -- 172.21.15.26:0/1273676474 shutdown_connections 2023-10-01T07:57:24.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.117+0000 7f4312e48700 1 -- 172.21.15.26:0/1273676474 wait complete. 2023-10-01T07:57:24.132 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:24.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.155+0000 7f29f005a700 1 -- 172.21.15.26:0/3065196083 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f29e8074ea0 con 0x7f29e80a1340 2023-10-01T07:57:24.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.156+0000 7f29de7fc700 1 -- 172.21.15.26:0/3065196083 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f29d8017070 con 0x7f29e80a1340 2023-10-01T07:57:24.156 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:24.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.158+0000 7f29f005a700 1 -- 172.21.15.26:0/3065196083 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29e80a1340 msgr2=0x7f29e811eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:24.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.158+0000 7f29f005a700 1 --2- 172.21.15.26:0/3065196083 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29e80a1340 0x7f29e811eca0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f29d800e9b0 tx=0x7f29d800ecc0 comp rx=0 tx=0).stop 2023-10-01T07:57:24.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.158+0000 7f29f005a700 1 -- 172.21.15.26:0/3065196083 shutdown_connections 2023-10-01T07:57:24.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.158+0000 7f29f005a700 1 --2- 172.21.15.26:0/3065196083 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29e8133fa0 0x7f29e811f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:24.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.158+0000 7f29f005a700 1 --2- 172.21.15.26:0/3065196083 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29e80a0a30 0x7f29e811e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:24.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.158+0000 7f29f005a700 1 --2- 172.21.15.26:0/3065196083 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29e80a1340 0x7f29e811eca0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:24.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.158+0000 7f29f005a700 1 -- 172.21.15.26:0/3065196083 >> 172.21.15.26:0/3065196083 conn(0x7f29e80a6550 msgr2=0x7f29e809c460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:24.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.158+0000 7f29f005a700 1 -- 172.21.15.26:0/3065196083 shutdown_connections 2023-10-01T07:57:24.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.158+0000 7f29f005a700 1 -- 172.21.15.26:0/3065196083 wait complete. 2023-10-01T07:57:24.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.158+0000 7faede5d1700 1 -- 172.21.15.26:0/3522595285 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faed806d420 con 0x7faed8136fe0 2023-10-01T07:57:24.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.158+0000 7faed4ff9700 1 -- 172.21.15.26:0/3522595285 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faed00123f0 con 0x7faed8136fe0 2023-10-01T07:57:24.160 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:24.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.161+0000 7faede5d1700 1 -- 172.21.15.26:0/3522595285 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faed8136fe0 msgr2=0x7faed81c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:24.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.161+0000 7faede5d1700 1 --2- 172.21.15.26:0/3522595285 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faed8136fe0 0x7faed81c8260 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7faed0012000 tx=0x7faed0004ad0 comp rx=0 tx=0).stop 2023-10-01T07:57:24.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.161+0000 7faede5d1700 1 -- 172.21.15.26:0/3522595285 shutdown_connections 2023-10-01T07:57:24.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.161+0000 7faede5d1700 1 --2- 172.21.15.26:0/3522595285 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faed8136fe0 0x7faed81c8260 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:24.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.161+0000 7faede5d1700 1 --2- 172.21.15.26:0/3522595285 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faed809e930 0x7faed806c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:24.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.161+0000 7faede5d1700 1 --2- 172.21.15.26:0/3522595285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faed809f410 0x7faed806c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:24.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.161+0000 7faede5d1700 1 -- 172.21.15.26:0/3522595285 >> 172.21.15.26:0/3522595285 conn(0x7faed80a4210 msgr2=0x7faed80a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:24.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.161+0000 7faede5d1700 1 -- 172.21.15.26:0/3522595285 shutdown_connections 2023-10-01T07:57:24.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.161+0000 7faede5d1700 1 -- 172.21.15.26:0/3522595285 wait complete. 2023-10-01T07:57:24.173 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:24.176 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:24.348 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:24.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.493+0000 7ff007637700 1 Processor -- start 2023-10-01T07:57:24.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.493+0000 7ff007637700 1 -- start start 2023-10-01T07:57:24.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.493+0000 7ff007637700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0001337f0 0x7ff000138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:24.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.493+0000 7ff007637700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff000138dc0 0x7ff00013b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:24.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.494+0000 7ff007637700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff00006b990 con 0x7ff000133420 2023-10-01T07:57:24.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.494+0000 7ff007637700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff00009b0e0 con 0x7ff0001337f0 2023-10-01T07:57:24.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.494+0000 7ff007637700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff000133c20 con 0x7ff000138dc0 2023-10-01T07:57:24.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.494+0000 7ff004bd2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0001337f0 0x7ff000138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:24.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.494+0000 7ff005bd4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff000138dc0 0x7ff00013b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:24.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.494+0000 7ff004bd2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0001337f0 0x7ff000138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33990/0 (socket says 172.21.15.26:33990) 2023-10-01T07:57:24.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.494+0000 7ff004bd2700 1 -- 172.21.15.26:0/3096023102 learned_addr learned my addr 172.21.15.26:0/3096023102 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:24.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.494+0000 7feff7fff700 1 -- 172.21.15.26:0/3096023102 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 867824591 0 0) 0x7ff00006b990 con 0x7ff000133420 2023-10-01T07:57:24.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.494+0000 7ff004bd2700 1 -- 172.21.15.26:0/3096023102 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff000138dc0 msgr2=0x7ff00013b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:24.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.494+0000 7ff004bd2700 1 --2- 172.21.15.26:0/3096023102 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff000138dc0 0x7ff00013b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:24.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.494+0000 7ff004bd2700 1 -- 172.21.15.26:0/3096023102 >> v1:172.21.15.26:6789/0 conn(0x7ff000133420 legacy=0x7ff000133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:24.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.494+0000 7ff004bd2700 1 -- 172.21.15.26:0/3096023102 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0000a0590 con 0x7ff0001337f0 2023-10-01T07:57:24.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.494+0000 7ff005bd4700 1 --2- 172.21.15.26:0/3096023102 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff000138dc0 0x7ff00013b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:24.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.494+0000 7ff004bd2700 1 --2- 172.21.15.26:0/3096023102 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0001337f0 0x7ff000138880 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7feffc009920 tx=0x7feffc009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a231078ef90d0fe5 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:24.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.494+0000 7feff7fff700 1 -- 172.21.15.26:0/3096023102 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc011830 con 0x7ff0001337f0 2023-10-01T07:57:24.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.494+0000 7feff7fff700 1 -- 172.21.15.26:0/3096023102 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feffc011990 con 0x7ff0001337f0 2023-10-01T07:57:24.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.494+0000 7feff7fff700 1 -- 172.21.15.26:0/3096023102 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc011d20 con 0x7ff0001337f0 2023-10-01T07:57:24.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.495+0000 7ff007637700 1 -- 172.21.15.26:0/3096023102 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0001337f0 msgr2=0x7ff000138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:24.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.495+0000 7ff007637700 1 --2- 172.21.15.26:0/3096023102 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0001337f0 0x7ff000138880 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7feffc009920 tx=0x7feffc009c30 comp rx=0 tx=0).stop 2023-10-01T07:57:24.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.495+0000 7ff007637700 1 -- 172.21.15.26:0/3096023102 shutdown_connections 2023-10-01T07:57:24.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.495+0000 7ff007637700 1 --2- 172.21.15.26:0/3096023102 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff000138dc0 0x7ff00013b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:24.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.495+0000 7ff007637700 1 --2- 172.21.15.26:0/3096023102 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0001337f0 0x7ff000138880 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:24.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.495+0000 7ff007637700 1 -- 172.21.15.26:0/3096023102 >> 172.21.15.26:0/3096023102 conn(0x7ff0000a4210 msgr2=0x7ff0000a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:24.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.495+0000 7ff007637700 1 -- 172.21.15.26:0/3096023102 shutdown_connections 2023-10-01T07:57:24.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.495+0000 7ff007637700 1 -- 172.21.15.26:0/3096023102 wait complete. 2023-10-01T07:57:24.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.496+0000 7ff007637700 1 Processor -- start 2023-10-01T07:57:24.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.496+0000 7ff007637700 1 -- start start 2023-10-01T07:57:24.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.497+0000 7ff007637700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff000133420 0x7ff00012f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:24.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.497+0000 7ff007637700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0001337f0 0x7ff00012f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:24.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.497+0000 7ff007637700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff000138dc0 0x7ff00012fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:24.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.497+0000 7ff007637700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00009b220 con 0x7ff000138dc0 2023-10-01T07:57:24.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.497+0000 7ff007637700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff00009dbb0 con 0x7ff000133420 2023-10-01T07:57:24.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.497+0000 7ff007637700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff00009ca30 con 0x7ff0001337f0 2023-10-01T07:57:24.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.497+0000 7ff0053d3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff000133420 0x7ff00012f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:24.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.497+0000 7ff005bd4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff000138dc0 0x7ff00012fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:24.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.497+0000 7ff004bd2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0001337f0 0x7ff00012f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:24.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.497+0000 7ff0053d3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff000133420 0x7ff00012f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33992/0 (socket says 172.21.15.26:33992) 2023-10-01T07:57:24.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.497+0000 7ff0053d3700 1 -- 172.21.15.26:0/3627362380 learned_addr learned my addr 172.21.15.26:0/3627362380 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:24.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.497+0000 7ff005bd4700 1 -- 172.21.15.26:0/3627362380 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0001337f0 msgr2=0x7ff00012f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:24.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.497+0000 7ff005bd4700 1 --2- 172.21.15.26:0/3627362380 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0001337f0 0x7ff00012f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:24.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.497+0000 7ff005bd4700 1 -- 172.21.15.26:0/3627362380 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff000133420 msgr2=0x7ff00012f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:24.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.497+0000 7ff005bd4700 1 --2- 172.21.15.26:0/3627362380 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff000133420 0x7ff00012f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:24.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.497+0000 7ff005bd4700 1 -- 172.21.15.26:0/3627362380 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff8009a70 con 0x7ff000138dc0 2023-10-01T07:57:24.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.497+0000 7ff0053d3700 1 --2- 172.21.15.26:0/3627362380 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff000133420 0x7ff00012f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:24.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.497+0000 7ff004bd2700 1 --2- 172.21.15.26:0/3627362380 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0001337f0 0x7ff00012f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:24.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.497+0000 7ff005bd4700 1 --2- 172.21.15.26:0/3627362380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff000138dc0 0x7ff00012fb10 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7feff800ef90 tx=0x7feff800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:24.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.497+0000 7feff5ffb700 1 -- 172.21.15.26:0/3627362380 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff800ca90 con 0x7ff000138dc0 2023-10-01T07:57:24.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.498+0000 7feff5ffb700 1 -- 172.21.15.26:0/3627362380 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff800f040 con 0x7ff000138dc0 2023-10-01T07:57:24.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.498+0000 7feff5ffb700 1 -- 172.21.15.26:0/3627362380 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff800ce30 con 0x7ff000138dc0 2023-10-01T07:57:24.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.498+0000 7ff007637700 1 -- 172.21.15.26:0/3627362380 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feffc009550 con 0x7ff000138dc0 2023-10-01T07:57:24.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.498+0000 7ff007637700 1 -- 172.21.15.26:0/3627362380 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff00009d760 con 0x7ff000138dc0 2023-10-01T07:57:24.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.498+0000 7feff5ffb700 1 -- 172.21.15.26:0/3627362380 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feff8014480 con 0x7ff000138dc0 2023-10-01T07:57:24.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.498+0000 7feff5ffb700 1 -- 172.21.15.26:0/3627362380 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7feff803fbf0 con 0x7ff000138dc0 2023-10-01T07:57:24.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.499+0000 7ff007637700 1 -- 172.21.15.26:0/3627362380 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff000074ea0 con 0x7ff000138dc0 2023-10-01T07:57:24.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.504+0000 7feff5ffb700 1 -- 172.21.15.26:0/3627362380 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feff8012930 con 0x7ff000138dc0 2023-10-01T07:57:24.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.706+0000 7ff007637700 1 -- 172.21.15.26:0/3627362380 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff00009c770 con 0x7ff000138dc0 2023-10-01T07:57:24.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.706+0000 7feff5ffb700 1 -- 172.21.15.26:0/3627362380 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feff8012340 con 0x7ff000138dc0 2023-10-01T07:57:24.707 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:24.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.709+0000 7ff007637700 1 -- 172.21.15.26:0/3627362380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff000138dc0 msgr2=0x7ff00012fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:24.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.709+0000 7ff007637700 1 --2- 172.21.15.26:0/3627362380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff000138dc0 0x7ff00012fb10 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7feff800ef90 tx=0x7feff800c3a0 comp rx=0 tx=0).stop 2023-10-01T07:57:24.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.709+0000 7ff007637700 1 -- 172.21.15.26:0/3627362380 shutdown_connections 2023-10-01T07:57:24.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.709+0000 7ff007637700 1 --2- 172.21.15.26:0/3627362380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff000138dc0 0x7ff00012fb10 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:24.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.709+0000 7ff007637700 1 --2- 172.21.15.26:0/3627362380 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff000133420 0x7ff00012f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:24.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.709+0000 7ff007637700 1 --2- 172.21.15.26:0/3627362380 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0001337f0 0x7ff00012f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:24.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.709+0000 7ff007637700 1 -- 172.21.15.26:0/3627362380 >> 172.21.15.26:0/3627362380 conn(0x7ff0000a4210 msgr2=0x7ff0000a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:24.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.709+0000 7ff007637700 1 -- 172.21.15.26:0/3627362380 shutdown_connections 2023-10-01T07:57:24.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:24.709+0000 7ff007637700 1 -- 172.21.15.26:0/3627362380 wait complete. 2023-10-01T07:57:24.723 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:25.132 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:25.174 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:25.176 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:25.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.283+0000 7f97aeac9700 1 Processor -- start 2023-10-01T07:57:25.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.283+0000 7f97aeac9700 1 -- start start 2023-10-01T07:57:25.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.284+0000 7f97aeac9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f97a8133420 0x7f97a81337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:25.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.284+0000 7f97aeac9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97a8134260 0x7f97a81306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:25.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.284+0000 7f97aeac9700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a806b990 con 0x7f97a8133e30 2023-10-01T07:57:25.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.284+0000 7f97aeac9700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97a80a0590 con 0x7f97a8133420 2023-10-01T07:57:25.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.284+0000 7f97aeac9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a809fb80 con 0x7f97a8134260 2023-10-01T07:57:25.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.284+0000 7f97ac865700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f97a8133420 0x7f97a81337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:25.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.284+0000 7f97ad066700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97a8134260 0x7f97a81306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:25.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.284+0000 7f97ac865700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f97a8133420 0x7f97a81337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59546/0 (socket says 172.21.15.26:59546) 2023-10-01T07:57:25.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.284+0000 7f97ac865700 1 -- 172.21.15.26:0/227368071 learned_addr learned my addr 172.21.15.26:0/227368071 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:25.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.284+0000 7f97ad066700 1 -- 172.21.15.26:0/227368071 >> v2:172.21.15.26:3300/0 conn(0x7f97a8133420 msgr2=0x7f97a81337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:25.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.284+0000 7f97ad066700 1 --2- 172.21.15.26:0/227368071 >> v2:172.21.15.26:3300/0 conn(0x7f97a8133420 0x7f97a81337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:25.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.284+0000 7f97ad066700 1 -- 172.21.15.26:0/227368071 >> v1:172.21.15.26:6789/0 conn(0x7f97a8133e30 legacy=0x7f97a812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:25.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.284+0000 7f97a77fe700 1 -- 172.21.15.26:0/227368071 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1410982226 0 0) 0x7f97a806b990 con 0x7f97a8133e30 2023-10-01T07:57:25.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.284+0000 7f97ad066700 1 -- 172.21.15.26:0/227368071 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a80a0030 con 0x7f97a8134260 2023-10-01T07:57:25.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.284+0000 7f97ac865700 1 --2- 172.21.15.26:0/227368071 >> v2:172.21.15.26:3300/0 conn(0x7f97a8133420 0x7f97a81337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:25.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.285+0000 7f97ad066700 1 --2- 172.21.15.26:0/227368071 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97a8134260 0x7f97a81306a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f97a0009840 tx=0x7f97a0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72c96f3c4227dafa server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:25.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.285+0000 7f97a77fe700 1 -- 172.21.15.26:0/227368071 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a0011830 con 0x7f97a8134260 2023-10-01T07:57:25.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.285+0000 7f97a77fe700 1 -- 172.21.15.26:0/227368071 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a0011990 con 0x7f97a8134260 2023-10-01T07:57:25.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.285+0000 7f97a77fe700 1 -- 172.21.15.26:0/227368071 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a0011d20 con 0x7f97a8134260 2023-10-01T07:57:25.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.286+0000 7f97aeac9700 1 -- 172.21.15.26:0/227368071 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97a8134260 msgr2=0x7f97a81306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:25.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.286+0000 7f97aeac9700 1 --2- 172.21.15.26:0/227368071 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97a8134260 0x7f97a81306a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f97a0009840 tx=0x7f97a0009b50 comp rx=0 tx=0).stop 2023-10-01T07:57:25.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.286+0000 7f97aeac9700 1 -- 172.21.15.26:0/227368071 shutdown_connections 2023-10-01T07:57:25.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.286+0000 7f97aeac9700 1 --2- 172.21.15.26:0/227368071 >> v2:172.21.15.26:3300/0 conn(0x7f97a8133420 0x7f97a81337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:25.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.286+0000 7f97aeac9700 1 --2- 172.21.15.26:0/227368071 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97a8134260 0x7f97a81306a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:25.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.286+0000 7f97aeac9700 1 -- 172.21.15.26:0/227368071 >> 172.21.15.26:0/227368071 conn(0x7f97a80a4210 msgr2=0x7f97a80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:25.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.286+0000 7f97aeac9700 1 -- 172.21.15.26:0/227368071 shutdown_connections 2023-10-01T07:57:25.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.286+0000 7f97aeac9700 1 -- 172.21.15.26:0/227368071 wait complete. 2023-10-01T07:57:25.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.287+0000 7f97aeac9700 1 Processor -- start 2023-10-01T07:57:25.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.287+0000 7f97aeac9700 1 -- start start 2023-10-01T07:57:25.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.287+0000 7f97aeac9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97a8133420 0x7f97a8120520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:25.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.287+0000 7f97aeac9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97a8133e30 0x7f97a809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:25.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.287+0000 7f97aeac9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97a8134260 0x7f97a809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:25.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.287+0000 7f97aeac9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a811f2b0 con 0x7f97a8134260 2023-10-01T07:57:25.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.287+0000 7f97aeac9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a809dc10 con 0x7f97a8133420 2023-10-01T07:57:25.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.287+0000 7f97aeac9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97a811fa80 con 0x7f97a8133e30 2023-10-01T07:57:25.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.288+0000 7f97ac865700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97a8133420 0x7f97a8120520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:25.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.288+0000 7f97ac865700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97a8133420 0x7f97a8120520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34014/0 (socket says 172.21.15.26:34014) 2023-10-01T07:57:25.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.288+0000 7f97ac865700 1 -- 172.21.15.26:0/3746006689 learned_addr learned my addr 172.21.15.26:0/3746006689 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:25.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.288+0000 7f97ad066700 1 --2- 172.21.15.26:0/3746006689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97a8134260 0x7f97a809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:25.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.288+0000 7f97ac865700 1 -- 172.21.15.26:0/3746006689 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97a8133e30 msgr2=0x7f97a809c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:25.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.288+0000 7f97ac865700 1 --2- 172.21.15.26:0/3746006689 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97a8133e30 0x7f97a809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:25.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.288+0000 7f97ac865700 1 -- 172.21.15.26:0/3746006689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97a8134260 msgr2=0x7f97a809c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:25.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.288+0000 7f97ac865700 1 --2- 172.21.15.26:0/3746006689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97a8134260 0x7f97a809c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:25.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.288+0000 7f97ac865700 1 -- 172.21.15.26:0/3746006689 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9798009b30 con 0x7f97a8133420 2023-10-01T07:57:25.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.288+0000 7f97ad066700 1 --2- 172.21.15.26:0/3746006689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97a8134260 0x7f97a809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:25.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.288+0000 7f97ac865700 1 --2- 172.21.15.26:0/3746006689 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97a8133420 0x7f97a8120520 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f979800efc0 tx=0x7f979800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:25.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.288+0000 7f97a57fa700 1 -- 172.21.15.26:0/3746006689 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979800cbb0 con 0x7f97a8133420 2023-10-01T07:57:25.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.288+0000 7f97a57fa700 1 -- 172.21.15.26:0/3746006689 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979800f040 con 0x7f97a8133420 2023-10-01T07:57:25.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.288+0000 7f97aeac9700 1 -- 172.21.15.26:0/3746006689 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97a00094a0 con 0x7f97a8133420 2023-10-01T07:57:25.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.289+0000 7f97a57fa700 1 -- 172.21.15.26:0/3746006689 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9798014480 con 0x7f97a8133420 2023-10-01T07:57:25.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.289+0000 7f97aeac9700 1 -- 172.21.15.26:0/3746006689 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a809cf00 con 0x7f97a8133420 2023-10-01T07:57:25.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.290+0000 7f97a57fa700 1 -- 172.21.15.26:0/3746006689 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f97980145e0 con 0x7f97a8133420 2023-10-01T07:57:25.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.290+0000 7f97a57fa700 1 -- 172.21.15.26:0/3746006689 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f979803fd50 con 0x7f97a8133420 2023-10-01T07:57:25.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.290+0000 7f97aeac9700 1 -- 172.21.15.26:0/3746006689 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97a8074ea0 con 0x7f97a8133420 2023-10-01T07:57:25.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.295+0000 7f97a57fa700 1 -- 172.21.15.26:0/3746006689 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9798012700 con 0x7f97a8133420 2023-10-01T07:57:25.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.322+0000 7fbe9adfa700 1 Processor -- start 2023-10-01T07:57:25.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.322+0000 7f849747f700 1 Processor -- start 2023-10-01T07:57:25.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.322+0000 7fbe9adfa700 1 -- start start 2023-10-01T07:57:25.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.322+0000 7f849747f700 1 -- start start 2023-10-01T07:57:25.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.323+0000 7fbe9adfa700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe9409e930 0x7fbe9409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:25.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.323+0000 7fbe9adfa700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe9409f240 0x7fbe941317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:25.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.323+0000 7fbe9adfa700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbe9409f650 0x7fbe94131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:25.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.323+0000 7fbe9adfa700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe94070940 con 0x7fbe9409f650 2023-10-01T07:57:25.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.323+0000 7fbe9adfa700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9406fd60 con 0x7fbe9409f240 2023-10-01T07:57:25.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.323+0000 7fbe9adfa700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9406fa80 con 0x7fbe9409e930 2023-10-01T07:57:25.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.323+0000 7fbe98b96700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe9409e930 0x7fbe9409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:25.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.323+0000 7fbe98b96700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe9409e930 0x7fbe9409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39500/0 (socket says 172.21.15.26:39500) 2023-10-01T07:57:25.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.323+0000 7fbe98b96700 1 -- 172.21.15.26:0/1920377967 learned_addr learned my addr 172.21.15.26:0/1920377967 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:25.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.323+0000 7fbe93fff700 1 --2- 172.21.15.26:0/1920377967 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe9409f240 0x7fbe941317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:25.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.323+0000 7f849747f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f849012cf60 0x7f849006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:25.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.323+0000 7f849747f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8490130430 0x7f8490137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:25.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.323+0000 7f849747f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f849012cd90 con 0x7f849012f8b0 2023-10-01T07:57:25.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.323+0000 7f849747f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f849012d330 con 0x7f849012cf60 2023-10-01T07:57:25.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.323+0000 7f849747f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8490071780 con 0x7f8490130430 2023-10-01T07:57:25.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.324+0000 7fbe98b96700 1 -- 172.21.15.26:0/1920377967 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe9409f240 msgr2=0x7fbe941317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:25.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.324+0000 7f8494a1a700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f849012f8b0 0x7f849012fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48366/0 (socket says 172.21.15.26:48366) 2023-10-01T07:57:25.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.324+0000 7f8494a1a700 1 -- 172.21.15.26:0/3927964412 learned_addr learned my addr 172.21.15.26:0/3927964412 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:25.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.324+0000 7fbe98b96700 1 --2- 172.21.15.26:0/1920377967 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe9409f240 0x7fbe941317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:25.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.324+0000 7fbe98b96700 1 -- 172.21.15.26:0/1920377967 >> v2:172.21.15.26:3300/0 conn(0x7fbe9409f650 msgr2=0x7fbe94131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:25.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.324+0000 7fbe98b96700 1 --2- 172.21.15.26:0/1920377967 >> v2:172.21.15.26:3300/0 conn(0x7fbe9409f650 0x7fbe94131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:25.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.324+0000 7fbe98b96700 1 -- 172.21.15.26:0/1920377967 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9409fb60 con 0x7fbe9409e930 2023-10-01T07:57:25.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.324+0000 7f8495a1c700 1 --2- 172.21.15.26:0/3927964412 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8490130430 0x7f8490137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:25.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.324+0000 7f8495a1c700 1 -- 172.21.15.26:0/3927964412 >> v2:172.21.15.26:3300/0 conn(0x7f849012cf60 msgr2=0x7f849006f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:25.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.324+0000 7f8495a1c700 1 --2- 172.21.15.26:0/3927964412 >> v2:172.21.15.26:3300/0 conn(0x7f849012cf60 0x7f849006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:25.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.324+0000 7f8495a1c700 1 -- 172.21.15.26:0/3927964412 >> v1:172.21.15.26:6789/0 conn(0x7f849012f8b0 legacy=0x7f849012fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:25.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.324+0000 7f8495a1c700 1 -- 172.21.15.26:0/3927964412 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8490071a40 con 0x7f8490130430 2023-10-01T07:57:25.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.324+0000 7fbe98b96700 1 --2- 172.21.15.26:0/1920377967 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe9409e930 0x7fbe9409ed00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbe880098f0 tx=0x7fbe88009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bb7a7d47df9a59a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:25.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.324+0000 7f8495a1c700 1 --2- 172.21.15.26:0/3927964412 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8490130430 0x7f8490137c30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8488009d90 tx=0x7f848800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40c2c406629d04c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:25.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.324+0000 7fbe937fe700 1 -- 172.21.15.26:0/1920377967 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe88011830 con 0x7fbe9409e930 2023-10-01T07:57:25.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.324+0000 7fbe937fe700 1 -- 172.21.15.26:0/1920377967 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe88011990 con 0x7fbe9409e930 2023-10-01T07:57:25.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.324+0000 7fbe937fe700 1 -- 172.21.15.26:0/1920377967 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe88011d20 con 0x7fbe9409e930 2023-10-01T07:57:25.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.324+0000 7f8483fff700 1 -- 172.21.15.26:0/3927964412 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848800e070 con 0x7f8490130430 2023-10-01T07:57:25.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.325+0000 7f8483fff700 1 -- 172.21.15.26:0/3927964412 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848800bbd0 con 0x7f8490130430 2023-10-01T07:57:25.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.325+0000 7f8483fff700 1 -- 172.21.15.26:0/3927964412 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488012430 con 0x7f8490130430 2023-10-01T07:57:25.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.325+0000 7fbe9adfa700 1 -- 172.21.15.26:0/1920377967 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe9409e930 msgr2=0x7fbe9409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:25.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.325+0000 7fbe9adfa700 1 --2- 172.21.15.26:0/1920377967 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe9409e930 0x7fbe9409ed00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbe880098f0 tx=0x7fbe88009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:25.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.325+0000 7fbe9adfa700 1 -- 172.21.15.26:0/1920377967 shutdown_connections 2023-10-01T07:57:25.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.325+0000 7fbe9adfa700 1 --2- 172.21.15.26:0/1920377967 >> v2:172.21.15.26:3300/0 conn(0x7fbe9409f650 0x7fbe94131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:25.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.325+0000 7fbe9adfa700 1 --2- 172.21.15.26:0/1920377967 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe9409e930 0x7fbe9409ed00 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:25.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.325+0000 7fbe9adfa700 1 --2- 172.21.15.26:0/1920377967 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe9409f240 0x7fbe941317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:25.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.325+0000 7fbe9adfa700 1 -- 172.21.15.26:0/1920377967 >> 172.21.15.26:0/1920377967 conn(0x7fbe940a4210 msgr2=0x7fbe940a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:25.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.325+0000 7fbe9adfa700 1 -- 172.21.15.26:0/1920377967 shutdown_connections 2023-10-01T07:57:25.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.325+0000 7f849747f700 1 -- 172.21.15.26:0/3927964412 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8490130430 msgr2=0x7f8490137c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:25.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.325+0000 7f849747f700 1 --2- 172.21.15.26:0/3927964412 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8490130430 0x7f8490137c30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8488009d90 tx=0x7f848800b330 comp rx=0 tx=0).stop 2023-10-01T07:57:25.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.325+0000 7fbe9adfa700 1 -- 172.21.15.26:0/1920377967 wait complete. 2023-10-01T07:57:25.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.325+0000 7f849747f700 1 -- 172.21.15.26:0/3927964412 shutdown_connections 2023-10-01T07:57:25.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.325+0000 7f849747f700 1 --2- 172.21.15.26:0/3927964412 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8490130430 0x7f8490137c30 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:25.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.325+0000 7f849747f700 1 --2- 172.21.15.26:0/3927964412 >> v2:172.21.15.26:3300/0 conn(0x7f849012cf60 0x7f849006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:25.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.325+0000 7f849747f700 1 -- 172.21.15.26:0/3927964412 >> 172.21.15.26:0/3927964412 conn(0x7f84900a2aa0 msgr2=0x7f84900a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:25.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.326+0000 7fbe9adfa700 1 Processor -- start 2023-10-01T07:57:25.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.326+0000 7fbe9adfa700 1 -- start start 2023-10-01T07:57:25.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.326+0000 7f849747f700 1 -- 172.21.15.26:0/3927964412 shutdown_connections 2023-10-01T07:57:25.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.326+0000 7f849747f700 1 -- 172.21.15.26:0/3927964412 wait complete. 2023-10-01T07:57:25.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.327+0000 7fbe9adfa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe9409e930 0x7fbe941a1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:25.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.327+0000 7fbe9adfa700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe9409f240 0x7fbe941a2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:25.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.327+0000 7fbe9adfa700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe9409f650 0x7fbe941a26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:25.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.327+0000 7fbe9adfa700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe941a30e0 con 0x7fbe9409e930 2023-10-01T07:57:25.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.327+0000 7fbe9adfa700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe941a3840 con 0x7fbe9409f240 2023-10-01T07:57:25.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.327+0000 7fbe9adfa700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe941a4a90 con 0x7fbe9409f650 2023-10-01T07:57:25.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.327+0000 7fbe99397700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe9409f650 0x7fbe941a26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:25.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.327+0000 7fbe93fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe9409f240 0x7fbe941a2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:25.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.328+0000 7fbe93fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe9409f240 0x7fbe941a2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34032/0 (socket says 172.21.15.26:34032) 2023-10-01T07:57:25.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.328+0000 7fbe93fff700 1 -- 172.21.15.26:0/4204012679 learned_addr learned my addr 172.21.15.26:0/4204012679 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:25.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.328+0000 7fbe99397700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe9409f650 0x7fbe941a26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39522/0 (socket says 172.21.15.26:39522) 2023-10-01T07:57:25.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.328+0000 7f849747f700 1 Processor -- start 2023-10-01T07:57:25.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.328+0000 7fbe98b96700 1 --2- 172.21.15.26:0/4204012679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe9409e930 0x7fbe941a1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:25.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.328+0000 7fbe93fff700 1 -- 172.21.15.26:0/4204012679 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe9409f650 msgr2=0x7fbe941a26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:25.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.328+0000 7fbe93fff700 1 --2- 172.21.15.26:0/4204012679 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe9409f650 0x7fbe941a26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:25.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.328+0000 7fbe93fff700 1 -- 172.21.15.26:0/4204012679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe9409e930 msgr2=0x7fbe941a1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:25.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.328+0000 7fbe93fff700 1 --2- 172.21.15.26:0/4204012679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe9409e930 0x7fbe941a1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:25.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.328+0000 7fbe93fff700 1 -- 172.21.15.26:0/4204012679 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe88009550 con 0x7fbe9409f240 2023-10-01T07:57:25.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.328+0000 7fbe98b96700 1 --2- 172.21.15.26:0/4204012679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe9409e930 0x7fbe941a1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:57:25.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.328+0000 7fbe93fff700 1 --2- 172.21.15.26:0/4204012679 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe9409f240 0x7fbe941a2170 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbe80012f90 tx=0x7fbe800100c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:25.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.328+0000 7fbe917fa700 1 -- 172.21.15.26:0/4204012679 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8000dbb0 con 0x7fbe9409f240 2023-10-01T07:57:25.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.328+0000 7fbe917fa700 1 -- 172.21.15.26:0/4204012679 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe80013040 con 0x7fbe9409f240 2023-10-01T07:57:25.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.328+0000 7fbe917fa700 1 -- 172.21.15.26:0/4204012679 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe80010c10 con 0x7fbe9409f240 2023-10-01T07:57:25.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.328+0000 7fbe9adfa700 1 -- 172.21.15.26:0/4204012679 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe940a0190 con 0x7fbe9409f240 2023-10-01T07:57:25.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.328+0000 7f849747f700 1 -- start start 2023-10-01T07:57:25.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.328+0000 7f849747f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f849012cf60 0x7f849009b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:25.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.329+0000 7f849747f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f849012f8b0 0x7f849009b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:25.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.329+0000 7f849747f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8490130430 0x7f849009be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:25.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.329+0000 7f849747f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849009e720 con 0x7f849012f8b0 2023-10-01T07:57:25.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.329+0000 7f849747f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849012f4f0 con 0x7f8490130430 2023-10-01T07:57:25.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.329+0000 7f849747f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8490129fa0 con 0x7f849012cf60 2023-10-01T07:57:25.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.329+0000 7f849521b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f849012cf60 0x7f849009b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:25.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.329+0000 7f8494a1a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f849012f8b0 0x7f849009b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:25.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.329+0000 7f849521b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f849012cf60 0x7f849009b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39538/0 (socket says 172.21.15.26:39538) 2023-10-01T07:57:25.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.329+0000 7f849521b700 1 -- 172.21.15.26:0/3840185453 learned_addr learned my addr 172.21.15.26:0/3840185453 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:25.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.329+0000 7f8495a1c700 1 --2- 172.21.15.26:0/3840185453 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8490130430 0x7f849009be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:25.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.329+0000 7fbe9adfa700 1 -- 172.21.15.26:0/4204012679 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe941a54c0 con 0x7fbe9409f240 2023-10-01T07:57:25.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.329+0000 7f8495a1c700 1 -- 172.21.15.26:0/3840185453 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f849012cf60 msgr2=0x7f849009b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:25.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.329+0000 7f8495a1c700 1 --2- 172.21.15.26:0/3840185453 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f849012cf60 0x7f849009b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:25.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.329+0000 7f8495a1c700 1 -- 172.21.15.26:0/3840185453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f849012f8b0 msgr2=0x7f849009b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:25.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.329+0000 7f8495a1c700 1 --2- 172.21.15.26:0/3840185453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f849012f8b0 0x7f849009b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:25.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.329+0000 7f8495a1c700 1 -- 172.21.15.26:0/3840185453 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8488009a70 con 0x7f8490130430 2023-10-01T07:57:25.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.330+0000 7f8495a1c700 1 --2- 172.21.15.26:0/3840185453 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8490130430 0x7f849009be90 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8488016000 tx=0x7f8488004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:25.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.330+0000 7fbe917fa700 1 -- 172.21.15.26:0/4204012679 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbe80018480 con 0x7fbe9409f240 2023-10-01T07:57:25.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.330+0000 7f8481ffb700 1 -- 172.21.15.26:0/3840185453 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488012430 con 0x7f8490130430 2023-10-01T07:57:25.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.330+0000 7fbe9adfa700 1 -- 172.21.15.26:0/4204012679 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe94071d20 con 0x7fbe9409f240 2023-10-01T07:57:25.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.330+0000 7f8481ffb700 1 -- 172.21.15.26:0/3840185453 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8488020070 con 0x7f8490130430 2023-10-01T07:57:25.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.330+0000 7f849747f700 1 -- 172.21.15.26:0/3840185453 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f849009e990 con 0x7f8490130430 2023-10-01T07:57:25.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.330+0000 7fbe917fa700 1 -- 172.21.15.26:0/4204012679 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbe80043540 con 0x7fbe9409f240 2023-10-01T07:57:25.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.330+0000 7f849747f700 1 -- 172.21.15.26:0/3840185453 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f849009ec50 con 0x7f8490130430 2023-10-01T07:57:25.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.330+0000 7f8481ffb700 1 -- 172.21.15.26:0/3840185453 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488004280 con 0x7f8490130430 2023-10-01T07:57:25.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.331+0000 7f849747f700 1 -- 172.21.15.26:0/3840185453 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84700052e0 con 0x7f8490130430 2023-10-01T07:57:25.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.339+0000 7fbe917fa700 1 -- 172.21.15.26:0/4204012679 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe80016750 con 0x7fbe9409f240 2023-10-01T07:57:25.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.340+0000 7f8481ffb700 1 -- 172.21.15.26:0/3840185453 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f84880043e0 con 0x7f8490130430 2023-10-01T07:57:25.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.340+0000 7f8481ffb700 1 -- 172.21.15.26:0/3840185453 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8488022070 con 0x7f8490130430 2023-10-01T07:57:25.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.349+0000 7f8481ffb700 1 -- 172.21.15.26:0/3840185453 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8488011d60 con 0x7f8490130430 2023-10-01T07:57:25.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.512+0000 7f97aeac9700 1 -- 172.21.15.26:0/3746006689 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f97a806b250 con 0x7f97a8133420 2023-10-01T07:57:25.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.513+0000 7f97a57fa700 1 -- 172.21.15.26:0/3746006689 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9798012340 con 0x7f97a8133420 2023-10-01T07:57:25.514 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:25.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.515+0000 7f97aeac9700 1 -- 172.21.15.26:0/3746006689 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97a8133420 msgr2=0x7f97a8120520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:25.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.515+0000 7f97aeac9700 1 --2- 172.21.15.26:0/3746006689 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97a8133420 0x7f97a8120520 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f979800efc0 tx=0x7f979800c3a0 comp rx=0 tx=0).stop 2023-10-01T07:57:25.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.515+0000 7f97aeac9700 1 -- 172.21.15.26:0/3746006689 shutdown_connections 2023-10-01T07:57:25.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.515+0000 7f97aeac9700 1 --2- 172.21.15.26:0/3746006689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97a8134260 0x7f97a809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:25.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.515+0000 7f97aeac9700 1 --2- 172.21.15.26:0/3746006689 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97a8133420 0x7f97a8120520 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:25.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.515+0000 7f97aeac9700 1 --2- 172.21.15.26:0/3746006689 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97a8133e30 0x7f97a809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:25.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.515+0000 7f97aeac9700 1 -- 172.21.15.26:0/3746006689 >> 172.21.15.26:0/3746006689 conn(0x7f97a80a4210 msgr2=0x7f97a80a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:25.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.515+0000 7f97aeac9700 1 -- 172.21.15.26:0/3746006689 shutdown_connections 2023-10-01T07:57:25.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.515+0000 7f97aeac9700 1 -- 172.21.15.26:0/3746006689 wait complete. 2023-10-01T07:57:25.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:25.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.546+0000 7fbe9adfa700 1 -- 172.21.15.26:0/4204012679 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbe941a54c0 con 0x7fbe9409f240 2023-10-01T07:57:25.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.547+0000 7fbe917fa700 1 -- 172.21.15.26:0/4204012679 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbe941a54c0 con 0x7fbe9409f240 2023-10-01T07:57:25.547 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:25.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.549+0000 7fbe9adfa700 1 -- 172.21.15.26:0/4204012679 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe9409f240 msgr2=0x7fbe941a2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:25.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.549+0000 7fbe9adfa700 1 --2- 172.21.15.26:0/4204012679 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe9409f240 0x7fbe941a2170 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbe80012f90 tx=0x7fbe800100c0 comp rx=0 tx=0).stop 2023-10-01T07:57:25.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.549+0000 7fbe9adfa700 1 -- 172.21.15.26:0/4204012679 shutdown_connections 2023-10-01T07:57:25.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.549+0000 7fbe9adfa700 1 --2- 172.21.15.26:0/4204012679 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe9409f650 0x7fbe941a26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:25.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.549+0000 7fbe9adfa700 1 --2- 172.21.15.26:0/4204012679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe9409e930 0x7fbe941a1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:25.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.549+0000 7fbe9adfa700 1 --2- 172.21.15.26:0/4204012679 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe9409f240 0x7fbe941a2170 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:25.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.549+0000 7fbe9adfa700 1 -- 172.21.15.26:0/4204012679 >> 172.21.15.26:0/4204012679 conn(0x7fbe940a4210 msgr2=0x7fbe941b6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:25.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.549+0000 7fbe9adfa700 1 -- 172.21.15.26:0/4204012679 shutdown_connections 2023-10-01T07:57:25.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.549+0000 7fbe9adfa700 1 -- 172.21.15.26:0/4204012679 wait complete. 2023-10-01T07:57:25.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.555+0000 7f849747f700 1 -- 172.21.15.26:0/3840185453 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8470005150 con 0x7f8490130430 2023-10-01T07:57:25.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.555+0000 7f8481ffb700 1 -- 172.21.15.26:0/3840185453 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8488011b80 con 0x7f8490130430 2023-10-01T07:57:25.556 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:25.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.557+0000 7f849747f700 1 -- 172.21.15.26:0/3840185453 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8490130430 msgr2=0x7f849009be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:25.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.557+0000 7f849747f700 1 --2- 172.21.15.26:0/3840185453 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8490130430 0x7f849009be90 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8488016000 tx=0x7f8488004ad0 comp rx=0 tx=0).stop 2023-10-01T07:57:25.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.557+0000 7f849747f700 1 -- 172.21.15.26:0/3840185453 shutdown_connections 2023-10-01T07:57:25.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.557+0000 7f849747f700 1 --2- 172.21.15.26:0/3840185453 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8490130430 0x7f849009be90 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:25.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.557+0000 7f849747f700 1 --2- 172.21.15.26:0/3840185453 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f849012cf60 0x7f849009b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:25.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.557+0000 7f849747f700 1 --2- 172.21.15.26:0/3840185453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f849012f8b0 0x7f849009b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:25.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.558+0000 7f849747f700 1 -- 172.21.15.26:0/3840185453 >> 172.21.15.26:0/3840185453 conn(0x7f84900a2aa0 msgr2=0x7f849006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:25.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.558+0000 7f849747f700 1 -- 172.21.15.26:0/3840185453 shutdown_connections 2023-10-01T07:57:25.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.558+0000 7f849747f700 1 -- 172.21.15.26:0/3840185453 wait complete. 2023-10-01T07:57:25.564 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:25.572 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:25.724 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:25.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.866+0000 7fb6d4399700 1 Processor -- start 2023-10-01T07:57:25.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.866+0000 7fb6d4399700 1 -- start start 2023-10-01T07:57:25.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.867+0000 7fb6d4399700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb6cc09e930 0x7fb6cc09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:25.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.867+0000 7fb6d4399700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb6cc09f240 0x7fb6cc1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:25.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.868+0000 7fb6d4399700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6cc070940 con 0x7fb6cc09f650 2023-10-01T07:57:25.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.868+0000 7fb6d4399700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6cc06fd60 con 0x7fb6cc09e930 2023-10-01T07:57:25.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.868+0000 7fb6d4399700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc06fa80 con 0x7fb6cc09f240 2023-10-01T07:57:25.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.868+0000 7fb6d2135700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb6cc09e930 0x7fb6cc09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:25.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.868+0000 7fb6d1934700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb6cc09f240 0x7fb6cc1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:25.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.868+0000 7fb6d2135700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb6cc09e930 0x7fb6cc09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59608/0 (socket says 172.21.15.26:59608) 2023-10-01T07:57:25.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.868+0000 7fb6d2135700 1 -- 172.21.15.26:0/4177208649 learned_addr learned my addr 172.21.15.26:0/4177208649 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:25.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.868+0000 7fb6d2936700 1 --1- 172.21.15.26:0/4177208649 >> v1:172.21.15.26:6789/0 conn(0x7fb6cc09f650 0x7fb6cc131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48376/0 (socket says 172.21.15.26:48376) 2023-10-01T07:57:25.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.868+0000 7fb6d2135700 1 -- 172.21.15.26:0/4177208649 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb6cc09f240 msgr2=0x7fb6cc1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:25.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.868+0000 7fb6d2135700 1 --2- 172.21.15.26:0/4177208649 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb6cc09f240 0x7fb6cc1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:25.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.868+0000 7fb6d2135700 1 -- 172.21.15.26:0/4177208649 >> v1:172.21.15.26:6789/0 conn(0x7fb6cc09f650 legacy=0x7fb6cc131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:25.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.868+0000 7fb6d2135700 1 -- 172.21.15.26:0/4177208649 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6cc09fb60 con 0x7fb6cc09e930 2023-10-01T07:57:25.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.868+0000 7fb6d1934700 1 --2- 172.21.15.26:0/4177208649 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb6cc09f240 0x7fb6cc1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:25.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.868+0000 7fb6d2135700 1 --2- 172.21.15.26:0/4177208649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6cc09e930 0x7fb6cc09ed00 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb6c80098f0 tx=0x7fb6c8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2415f1e72921ca16 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:25.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.868+0000 7fb6d1133700 1 -- 172.21.15.26:0/4177208649 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c8011830 con 0x7fb6cc09e930 2023-10-01T07:57:25.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.868+0000 7fb6d1133700 1 -- 172.21.15.26:0/4177208649 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c8011990 con 0x7fb6cc09e930 2023-10-01T07:57:25.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.868+0000 7fb6d1133700 1 -- 172.21.15.26:0/4177208649 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c8011d20 con 0x7fb6cc09e930 2023-10-01T07:57:25.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.869+0000 7fb6d4399700 1 -- 172.21.15.26:0/4177208649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6cc09e930 msgr2=0x7fb6cc09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:25.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.869+0000 7fb6d4399700 1 --2- 172.21.15.26:0/4177208649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6cc09e930 0x7fb6cc09ed00 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb6c80098f0 tx=0x7fb6c8009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:25.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.869+0000 7fb6d4399700 1 -- 172.21.15.26:0/4177208649 shutdown_connections 2023-10-01T07:57:25.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.869+0000 7fb6d4399700 1 --2- 172.21.15.26:0/4177208649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6cc09e930 0x7fb6cc09ed00 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:25.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.869+0000 7fb6d4399700 1 --2- 172.21.15.26:0/4177208649 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb6cc09f240 0x7fb6cc1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:25.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.869+0000 7fb6d4399700 1 -- 172.21.15.26:0/4177208649 >> 172.21.15.26:0/4177208649 conn(0x7fb6cc0a4210 msgr2=0x7fb6cc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:25.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.869+0000 7fb6d4399700 1 -- 172.21.15.26:0/4177208649 shutdown_connections 2023-10-01T07:57:25.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.869+0000 7fb6d4399700 1 -- 172.21.15.26:0/4177208649 wait complete. 2023-10-01T07:57:25.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.870+0000 7fb6d4399700 1 Processor -- start 2023-10-01T07:57:25.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.870+0000 7fb6d4399700 1 -- start start 2023-10-01T07:57:25.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.871+0000 7fb6d4399700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb6cc09e930 0x7fb6cc1a3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:25.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.871+0000 7fb6d4399700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6cc09f240 0x7fb6cc1a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:25.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.871+0000 7fb6d4399700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb6cc09f650 0x7fb6cc1a4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:25.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.871+0000 7fb6d4399700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc1a8260 con 0x7fb6cc09f240 2023-10-01T07:57:25.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.871+0000 7fb6d4399700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc1a78a0 con 0x7fb6cc09e930 2023-10-01T07:57:25.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.871+0000 7fb6d4399700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc1a6be0 con 0x7fb6cc09f650 2023-10-01T07:57:25.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.871+0000 7fb6d2135700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb6cc09e930 0x7fb6cc1a3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:25.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.871+0000 7fb6d2936700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb6cc09f650 0x7fb6cc1a4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:25.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.871+0000 7fb6d2135700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb6cc09e930 0x7fb6cc1a3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34052/0 (socket says 172.21.15.26:34052) 2023-10-01T07:57:25.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.871+0000 7fb6d2135700 1 -- 172.21.15.26:0/77869048 learned_addr learned my addr 172.21.15.26:0/77869048 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:25.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.871+0000 7fb6d1934700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6cc09f240 0x7fb6cc1a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:25.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.871+0000 7fb6d2135700 1 -- 172.21.15.26:0/77869048 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb6cc09f650 msgr2=0x7fb6cc1a4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:25.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.871+0000 7fb6d2135700 1 --2- 172.21.15.26:0/77869048 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb6cc09f650 0x7fb6cc1a4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:25.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.871+0000 7fb6d2135700 1 -- 172.21.15.26:0/77869048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6cc09f240 msgr2=0x7fb6cc1a42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:25.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.871+0000 7fb6d2135700 1 --2- 172.21.15.26:0/77869048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6cc09f240 0x7fb6cc1a42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:25.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.871+0000 7fb6d2135700 1 -- 172.21.15.26:0/77869048 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6bc0094a0 con 0x7fb6cc09e930 2023-10-01T07:57:25.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.871+0000 7fb6d1934700 1 --2- 172.21.15.26:0/77869048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6cc09f240 0x7fb6cc1a42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:25.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.871+0000 7fb6d2135700 1 --2- 172.21.15.26:0/77869048 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb6cc09e930 0x7fb6cc1a3d80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8009c40 tx=0x7fb6c8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:25.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.871+0000 7fb6c2ffd700 1 -- 172.21.15.26:0/77869048 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c8004400 con 0x7fb6cc09e930 2023-10-01T07:57:25.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.871+0000 7fb6c2ffd700 1 -- 172.21.15.26:0/77869048 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c801f070 con 0x7fb6cc09e930 2023-10-01T07:57:25.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.871+0000 7fb6d4399700 1 -- 172.21.15.26:0/77869048 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6c8009550 con 0x7fb6cc09e930 2023-10-01T07:57:25.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.871+0000 7fb6c2ffd700 1 -- 172.21.15.26:0/77869048 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c80038e0 con 0x7fb6cc09e930 2023-10-01T07:57:25.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.872+0000 7fb6d4399700 1 -- 172.21.15.26:0/77869048 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6cc0a0190 con 0x7fb6cc09e930 2023-10-01T07:57:25.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.872+0000 7fb6c2ffd700 1 -- 172.21.15.26:0/77869048 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb6c8021030 con 0x7fb6cc09e930 2023-10-01T07:57:25.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.873+0000 7fb6d4399700 1 -- 172.21.15.26:0/77869048 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6cc1a59f0 con 0x7fb6cc09e930 2023-10-01T07:57:25.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.873+0000 7fb6c2ffd700 1 -- 172.21.15.26:0/77869048 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb6c8040ac0 con 0x7fb6cc09e930 2023-10-01T07:57:25.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:25.877+0000 7fb6c2ffd700 1 -- 172.21.15.26:0/77869048 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb6c8015020 con 0x7fb6cc09e930 2023-10-01T07:57:26.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.083+0000 7fb6d4399700 1 -- 172.21.15.26:0/77869048 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb6cc074ea0 con 0x7fb6cc09e930 2023-10-01T07:57:26.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.083+0000 7fb6c2ffd700 1 -- 172.21.15.26:0/77869048 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb6c800b9d0 con 0x7fb6cc09e930 2023-10-01T07:57:26.084 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:26.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.085+0000 7fb6d4399700 1 -- 172.21.15.26:0/77869048 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb6cc09e930 msgr2=0x7fb6cc1a3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:26.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.085+0000 7fb6d4399700 1 --2- 172.21.15.26:0/77869048 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb6cc09e930 0x7fb6cc1a3d80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8009c40 tx=0x7fb6c8004750 comp rx=0 tx=0).stop 2023-10-01T07:57:26.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.085+0000 7fb6d4399700 1 -- 172.21.15.26:0/77869048 shutdown_connections 2023-10-01T07:57:26.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.085+0000 7fb6d4399700 1 --2- 172.21.15.26:0/77869048 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb6cc09f650 0x7fb6cc1a4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:26.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.085+0000 7fb6d4399700 1 --2- 172.21.15.26:0/77869048 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb6cc09e930 0x7fb6cc1a3d80 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:26.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.085+0000 7fb6d4399700 1 --2- 172.21.15.26:0/77869048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6cc09f240 0x7fb6cc1a42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:26.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.085+0000 7fb6d4399700 1 -- 172.21.15.26:0/77869048 >> 172.21.15.26:0/77869048 conn(0x7fb6cc0a4210 msgr2=0x7fb6cc1b8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:26.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.085+0000 7fb6d4399700 1 -- 172.21.15.26:0/77869048 shutdown_connections 2023-10-01T07:57:26.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.085+0000 7fb6d4399700 1 -- 172.21.15.26:0/77869048 wait complete. 2023-10-01T07:57:26.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:26.531 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:26.565 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:26.573 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:26.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.682+0000 7f460ea72700 1 Processor -- start 2023-10-01T07:57:26.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.682+0000 7f460ea72700 1 -- start start 2023-10-01T07:57:26.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.682+0000 7f460ea72700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4608133a80 0x7f4608133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:26.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.682+0000 7f460ea72700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f460812ff20 0x7f4608130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:26.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.683+0000 7f460ea72700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4608130870 0x7f460813a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:26.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.683+0000 7f460ea72700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f460806c570 con 0x7f4608133a80 2023-10-01T07:57:26.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.683+0000 7f460ea72700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f460806bc00 con 0x7f4608130870 2023-10-01T07:57:26.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.683+0000 7f460ea72700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46080a0040 con 0x7f460812ff20 2023-10-01T07:57:26.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.683+0000 7f460c80e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4608133a80 0x7f4608133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:26.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.683+0000 7f4607fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f460812ff20 0x7f4608130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:26.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.683+0000 7f460c80e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4608133a80 0x7f4608133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59616/0 (socket says 172.21.15.26:59616) 2023-10-01T07:57:26.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.683+0000 7f460c80e700 1 -- 172.21.15.26:0/2704760282 learned_addr learned my addr 172.21.15.26:0/2704760282 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:26.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.683+0000 7f460d00f700 1 --2- 172.21.15.26:0/2704760282 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4608130870 0x7f460813a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:26.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.683+0000 7f4607fff700 1 -- 172.21.15.26:0/2704760282 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4608130870 msgr2=0x7f460813a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:26.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.683+0000 7f4607fff700 1 --2- 172.21.15.26:0/2704760282 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4608130870 0x7f460813a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:26.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.683+0000 7f4607fff700 1 -- 172.21.15.26:0/2704760282 >> v2:172.21.15.26:3300/0 conn(0x7f4608133a80 msgr2=0x7f4608133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:26.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.683+0000 7f4607fff700 1 --2- 172.21.15.26:0/2704760282 >> v2:172.21.15.26:3300/0 conn(0x7f4608133a80 0x7f4608133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:26.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.683+0000 7f4607fff700 1 -- 172.21.15.26:0/2704760282 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4608133860 con 0x7f460812ff20 2023-10-01T07:57:26.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.683+0000 7f460c80e700 1 --2- 172.21.15.26:0/2704760282 >> v2:172.21.15.26:3300/0 conn(0x7f4608133a80 0x7f4608133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:26.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.683+0000 7f460d00f700 1 --2- 172.21.15.26:0/2704760282 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4608130870 0x7f460813a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:57:26.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.683+0000 7f4607fff700 1 --2- 172.21.15.26:0/2704760282 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f460812ff20 0x7f4608130330 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f45f4009840 tx=0x7f45f4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=793c95918c0e7529 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:26.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.684+0000 7f46077fe700 1 -- 172.21.15.26:0/2704760282 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f4011830 con 0x7f460812ff20 2023-10-01T07:57:26.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.684+0000 7f46077fe700 1 -- 172.21.15.26:0/2704760282 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f4011990 con 0x7f460812ff20 2023-10-01T07:57:26.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.684+0000 7f46077fe700 1 -- 172.21.15.26:0/2704760282 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f4011d20 con 0x7f460812ff20 2023-10-01T07:57:26.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.684+0000 7f460ea72700 1 -- 172.21.15.26:0/2704760282 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f460812ff20 msgr2=0x7f4608130330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:26.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.684+0000 7f460ea72700 1 --2- 172.21.15.26:0/2704760282 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f460812ff20 0x7f4608130330 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f45f4009840 tx=0x7f45f4009b50 comp rx=0 tx=0).stop 2023-10-01T07:57:26.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.684+0000 7f460ea72700 1 -- 172.21.15.26:0/2704760282 shutdown_connections 2023-10-01T07:57:26.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.684+0000 7f460ea72700 1 --2- 172.21.15.26:0/2704760282 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4608130870 0x7f460813a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:26.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.684+0000 7f460ea72700 1 --2- 172.21.15.26:0/2704760282 >> v2:172.21.15.26:3300/0 conn(0x7f4608133a80 0x7f4608133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:26.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.684+0000 7f460ea72700 1 --2- 172.21.15.26:0/2704760282 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f460812ff20 0x7f4608130330 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:26.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.684+0000 7f460ea72700 1 -- 172.21.15.26:0/2704760282 >> 172.21.15.26:0/2704760282 conn(0x7f46080a4210 msgr2=0x7f46080a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:26.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.685+0000 7f460ea72700 1 -- 172.21.15.26:0/2704760282 shutdown_connections 2023-10-01T07:57:26.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.685+0000 7f460ea72700 1 -- 172.21.15.26:0/2704760282 wait complete. 2023-10-01T07:57:26.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.686+0000 7f460ea72700 1 Processor -- start 2023-10-01T07:57:26.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.686+0000 7f460ea72700 1 -- start start 2023-10-01T07:57:26.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.687+0000 7f460ea72700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f460812ff20 0x7f460809c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:26.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.687+0000 7f460ea72700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4608130870 0x7f460809c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:26.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.687+0000 7f460ea72700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4608133a80 0x7f460809cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:26.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.687+0000 7f460ea72700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460811b980 con 0x7f4608133a80 2023-10-01T07:57:26.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.687+0000 7f460ea72700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f460812d560 con 0x7f4608130870 2023-10-01T07:57:26.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.687+0000 7f460ea72700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f460811bbd0 con 0x7f460812ff20 2023-10-01T07:57:26.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.687+0000 7f460c80e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f460812ff20 0x7f460809c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:26.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.687+0000 7f460c80e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f460812ff20 0x7f460809c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39580/0 (socket says 172.21.15.26:39580) 2023-10-01T07:57:26.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.687+0000 7f460c80e700 1 -- 172.21.15.26:0/587712735 learned_addr learned my addr 172.21.15.26:0/587712735 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:26.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.687+0000 7f4607fff700 1 --2- 172.21.15.26:0/587712735 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4608130870 0x7f460809c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:26.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.687+0000 7f460d00f700 1 --2- 172.21.15.26:0/587712735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4608133a80 0x7f460809cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:26.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.688+0000 7f460c80e700 1 -- 172.21.15.26:0/587712735 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4608130870 msgr2=0x7f460809c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:26.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.688+0000 7f460c80e700 1 --2- 172.21.15.26:0/587712735 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4608130870 0x7f460809c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:26.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.688+0000 7f460c80e700 1 -- 172.21.15.26:0/587712735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4608133a80 msgr2=0x7f460809cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:26.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.688+0000 7f460c80e700 1 --2- 172.21.15.26:0/587712735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4608133a80 0x7f460809cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:26.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.688+0000 7f460c80e700 1 -- 172.21.15.26:0/587712735 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45fc009550 con 0x7f460812ff20 2023-10-01T07:57:26.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.688+0000 7f4607fff700 1 --2- 172.21.15.26:0/587712735 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4608130870 0x7f460809c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:26.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.688+0000 7f460c80e700 1 --2- 172.21.15.26:0/587712735 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f460812ff20 0x7f460809c0e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f45fc00ec10 tx=0x7f45fc00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:26.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.688+0000 7f46057fa700 1 -- 172.21.15.26:0/587712735 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc00c850 con 0x7f460812ff20 2023-10-01T07:57:26.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.688+0000 7f46057fa700 1 -- 172.21.15.26:0/587712735 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45fc00c9b0 con 0x7f460812ff20 2023-10-01T07:57:26.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.688+0000 7f46057fa700 1 -- 172.21.15.26:0/587712735 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc00cd40 con 0x7f460812ff20 2023-10-01T07:57:26.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.688+0000 7f460ea72700 1 -- 172.21.15.26:0/587712735 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f40094a0 con 0x7f460812ff20 2023-10-01T07:57:26.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.688+0000 7f460ea72700 1 -- 172.21.15.26:0/587712735 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f460811af10 con 0x7f460812ff20 2023-10-01T07:57:26.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.689+0000 7f46057fa700 1 -- 172.21.15.26:0/587712735 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f45fc013470 con 0x7f460812ff20 2023-10-01T07:57:26.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.689+0000 7f460ea72700 1 -- 172.21.15.26:0/587712735 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f460811a740 con 0x7f460812ff20 2023-10-01T07:57:26.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.689+0000 7f46057fa700 1 -- 172.21.15.26:0/587712735 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f45fc03fca0 con 0x7f460812ff20 2023-10-01T07:57:26.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.694+0000 7f46057fa700 1 -- 172.21.15.26:0/587712735 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f45fc013720 con 0x7f460812ff20 2023-10-01T07:57:26.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.729+0000 7f1e44de6700 1 Processor -- start 2023-10-01T07:57:26.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.729+0000 7f561fd9b700 1 Processor -- start 2023-10-01T07:57:26.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.730+0000 7f1e44de6700 1 -- start start 2023-10-01T07:57:26.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.730+0000 7f561fd9b700 1 -- start start 2023-10-01T07:57:26.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.730+0000 7f1e44de6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e400a0a30 0x7f1e400a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:26.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.730+0000 7f1e44de6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1e40138d80 0x7f1e4013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:26.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.730+0000 7f1e44de6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e400a2a70 con 0x7f1e4009d630 2023-10-01T07:57:26.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.730+0000 7f1e44de6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e400a01d0 con 0x7f1e40138d80 2023-10-01T07:57:26.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.730+0000 7f1e44de6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4009e2b0 con 0x7f1e400a0a30 2023-10-01T07:57:26.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.730+0000 7f561fd9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f56180a0a30 0x7f56180a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:26.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.730+0000 7f561fd9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f561809d630 0x7f56180a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:26.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.730+0000 7f1e3e59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e400a0a30 0x7f1e400a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:26.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.730+0000 7f1e35d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1e4009d630 0x7f1e400a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48392/0 (socket says 172.21.15.26:48392) 2023-10-01T07:57:26.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.730+0000 7f1e35d9b700 1 -- 172.21.15.26:0/2390921187 learned_addr learned my addr 172.21.15.26:0/2390921187 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:26.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.730+0000 7f561fd9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5618133930 0x7f5618133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:26.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.730+0000 7f561fd9b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56180a2a70 con 0x7f56180a0a30 2023-10-01T07:57:26.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.730+0000 7f561fd9b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56180a01d0 con 0x7f561809d630 2023-10-01T07:57:26.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.730+0000 7f561fd9b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f561809e2b0 con 0x7f5618133930 2023-10-01T07:57:26.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.731+0000 7f561d336700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f561809d630 0x7f56180a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:26.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.731+0000 7f561d336700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f561809d630 0x7f56180a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34086/0 (socket says 172.21.15.26:34086) 2023-10-01T07:57:26.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.731+0000 7f561d336700 1 -- 172.21.15.26:0/689188220 learned_addr learned my addr 172.21.15.26:0/689188220 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:26.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.731+0000 7f561db37700 1 --2- 172.21.15.26:0/689188220 >> v2:172.21.15.26:3300/0 conn(0x7f56180a0a30 0x7f56180a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:26.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.731+0000 7f561e338700 1 --2- 172.21.15.26:0/689188220 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5618133930 0x7f5618133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:26.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.731+0000 7f1e3ed9d700 1 --2- 172.21.15.26:0/2390921187 >> v2:172.21.15.26:3300/0 conn(0x7f1e40138d80 0x7f1e4013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:26.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.731+0000 7f1e3e59c700 1 -- 172.21.15.26:0/2390921187 >> v2:172.21.15.26:3300/0 conn(0x7f1e40138d80 msgr2=0x7f1e4013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:26.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.731+0000 7f1e3e59c700 1 --2- 172.21.15.26:0/2390921187 >> v2:172.21.15.26:3300/0 conn(0x7f1e40138d80 0x7f1e4013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:26.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.731+0000 7f1e3e59c700 1 -- 172.21.15.26:0/2390921187 >> v1:172.21.15.26:6789/0 conn(0x7f1e4009d630 legacy=0x7f1e400a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:26.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.731+0000 7f1e3e59c700 1 -- 172.21.15.26:0/2390921187 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e4009dc50 con 0x7f1e400a0a30 2023-10-01T07:57:26.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.731+0000 7f561e338700 1 -- 172.21.15.26:0/689188220 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f561809d630 msgr2=0x7f56180a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:26.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.731+0000 7f561e338700 1 --2- 172.21.15.26:0/689188220 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f561809d630 0x7f56180a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:26.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.731+0000 7f561e338700 1 -- 172.21.15.26:0/689188220 >> v2:172.21.15.26:3300/0 conn(0x7f56180a0a30 msgr2=0x7f56180a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:26.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.731+0000 7f561e338700 1 --2- 172.21.15.26:0/689188220 >> v2:172.21.15.26:3300/0 conn(0x7f56180a0a30 0x7f56180a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:26.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.731+0000 7f561e338700 1 -- 172.21.15.26:0/689188220 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f561809dc50 con 0x7f5618133930 2023-10-01T07:57:26.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.731+0000 7f1e3ed9d700 1 --2- 172.21.15.26:0/2390921187 >> v2:172.21.15.26:3300/0 conn(0x7f1e40138d80 0x7f1e4013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:57:26.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.731+0000 7f561db37700 1 --2- 172.21.15.26:0/689188220 >> v2:172.21.15.26:3300/0 conn(0x7f56180a0a30 0x7f56180a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:57:26.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.731+0000 7f1e3e59c700 1 --2- 172.21.15.26:0/2390921187 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e400a0a30 0x7f1e400a0e00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1e30009840 tx=0x7f1e30009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44e17e5bccd8a633 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:26.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.731+0000 7f561e338700 1 --2- 172.21.15.26:0/689188220 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5618133930 0x7f5618133db0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5610009d90 tx=0x7f561000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72b1acad92ba708b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:26.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.731+0000 7f1e3dd9b700 1 -- 172.21.15.26:0/2390921187 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e30011830 con 0x7f1e400a0a30 2023-10-01T07:57:26.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.732+0000 7f1e3dd9b700 1 -- 172.21.15.26:0/2390921187 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e30011990 con 0x7f1e400a0a30 2023-10-01T07:57:26.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.732+0000 7f1e3dd9b700 1 -- 172.21.15.26:0/2390921187 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e30011d20 con 0x7f1e400a0a30 2023-10-01T07:57:26.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.732+0000 7f561cb35700 1 -- 172.21.15.26:0/689188220 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561000e070 con 0x7f5618133930 2023-10-01T07:57:26.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.732+0000 7f561cb35700 1 -- 172.21.15.26:0/689188220 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f561000bb20 con 0x7f5618133930 2023-10-01T07:57:26.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.732+0000 7f561cb35700 1 -- 172.21.15.26:0/689188220 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5610012430 con 0x7f5618133930 2023-10-01T07:57:26.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.732+0000 7f1e44de6700 1 -- 172.21.15.26:0/2390921187 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e400a0a30 msgr2=0x7f1e400a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:26.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.732+0000 7f1e44de6700 1 --2- 172.21.15.26:0/2390921187 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e400a0a30 0x7f1e400a0e00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1e30009840 tx=0x7f1e30009b50 comp rx=0 tx=0).stop 2023-10-01T07:57:26.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.732+0000 7f561fd9b700 1 -- 172.21.15.26:0/689188220 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5618133930 msgr2=0x7f5618133db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:26.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.732+0000 7f561fd9b700 1 --2- 172.21.15.26:0/689188220 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5618133930 0x7f5618133db0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5610009d90 tx=0x7f561000b330 comp rx=0 tx=0).stop 2023-10-01T07:57:26.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.732+0000 7f1e44de6700 1 -- 172.21.15.26:0/2390921187 shutdown_connections 2023-10-01T07:57:26.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.732+0000 7f1e44de6700 1 --2- 172.21.15.26:0/2390921187 >> v2:172.21.15.26:3300/0 conn(0x7f1e40138d80 0x7f1e4013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:26.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.732+0000 7f1e44de6700 1 --2- 172.21.15.26:0/2390921187 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e400a0a30 0x7f1e400a0e00 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:26.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.732+0000 7f1e44de6700 1 -- 172.21.15.26:0/2390921187 >> 172.21.15.26:0/2390921187 conn(0x7f1e400a3050 msgr2=0x7f1e400a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:26.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.732+0000 7f561fd9b700 1 -- 172.21.15.26:0/689188220 shutdown_connections 2023-10-01T07:57:26.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.732+0000 7f561fd9b700 1 --2- 172.21.15.26:0/689188220 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5618133930 0x7f5618133db0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:26.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.732+0000 7f561fd9b700 1 --2- 172.21.15.26:0/689188220 >> v2:172.21.15.26:3300/0 conn(0x7f56180a0a30 0x7f56180a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:26.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.732+0000 7f561fd9b700 1 --2- 172.21.15.26:0/689188220 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f561809d630 0x7f56180a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:26.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.732+0000 7f561fd9b700 1 -- 172.21.15.26:0/689188220 >> 172.21.15.26:0/689188220 conn(0x7f56180a3050 msgr2=0x7f56180a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:26.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.732+0000 7f1e44de6700 1 -- 172.21.15.26:0/2390921187 shutdown_connections 2023-10-01T07:57:26.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.732+0000 7f1e44de6700 1 -- 172.21.15.26:0/2390921187 wait complete. 2023-10-01T07:57:26.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.733+0000 7f561fd9b700 1 -- 172.21.15.26:0/689188220 shutdown_connections 2023-10-01T07:57:26.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.733+0000 7f561fd9b700 1 -- 172.21.15.26:0/689188220 wait complete. 2023-10-01T07:57:26.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.734+0000 7f561fd9b700 1 Processor -- start 2023-10-01T07:57:26.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.734+0000 7f561fd9b700 1 -- start start 2023-10-01T07:57:26.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.734+0000 7f1e44de6700 1 Processor -- start 2023-10-01T07:57:26.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.734+0000 7f1e44de6700 1 -- start start 2023-10-01T07:57:26.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.734+0000 7f561fd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f561809d630 0x7f56181c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:26.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.734+0000 7f561fd9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f56180a0a30 0x7f56181c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:26.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.734+0000 7f561fd9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5618133930 0x7f56181c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:26.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.734+0000 7f561fd9b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5618120b00 con 0x7f561809d630 2023-10-01T07:57:26.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.734+0000 7f561fd9b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56181206a0 con 0x7f5618133930 2023-10-01T07:57:26.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.734+0000 7f561fd9b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56181223c0 con 0x7f56180a0a30 2023-10-01T07:57:26.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.734+0000 7f561d336700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f56180a0a30 0x7f56181c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:26.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.734+0000 7f561d336700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f56180a0a30 0x7f56181c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39590/0 (socket says 172.21.15.26:39590) 2023-10-01T07:57:26.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.734+0000 7f561d336700 1 -- 172.21.15.26:0/2680263252 learned_addr learned my addr 172.21.15.26:0/2680263252 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:26.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.734+0000 7f561db37700 1 --2- 172.21.15.26:0/2680263252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f561809d630 0x7f56181c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:26.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.735+0000 7f1e44de6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e4009d630 0x7f1e40120820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:26.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.735+0000 7f561db37700 1 -- 172.21.15.26:0/2680263252 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f56180a0a30 msgr2=0x7f56181c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:26.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.735+0000 7f561db37700 1 --2- 172.21.15.26:0/2680263252 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f56180a0a30 0x7f56181c84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:26.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.735+0000 7f561db37700 1 -- 172.21.15.26:0/2680263252 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5618133930 msgr2=0x7f56181c8a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:57:26.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.735+0000 7f561db37700 1 --2- 172.21.15.26:0/2680263252 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5618133930 0x7f56181c8a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:26.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.735+0000 7f561db37700 1 -- 172.21.15.26:0/2680263252 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5610009a70 con 0x7f561809d630 2023-10-01T07:57:26.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.735+0000 7f1e44de6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e400a0a30 0x7f1e40120d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:26.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.735+0000 7f1e44de6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e40138d80 0x7f1e401212a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:26.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.735+0000 7f1e44de6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e401223e0 con 0x7f1e40138d80 2023-10-01T07:57:26.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.735+0000 7f1e44de6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e40122e80 con 0x7f1e4009d630 2023-10-01T07:57:26.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.735+0000 7f1e44de6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e40123630 con 0x7f1e400a0a30 2023-10-01T07:57:26.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.735+0000 7f1e35d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e400a0a30 0x7f1e40120d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:26.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.735+0000 7f1e35d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e400a0a30 0x7f1e40120d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39606/0 (socket says 172.21.15.26:39606) 2023-10-01T07:57:26.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.735+0000 7f1e35d9b700 1 -- 172.21.15.26:0/2770281981 learned_addr learned my addr 172.21.15.26:0/2770281981 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:26.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.735+0000 7f561d336700 1 --2- 172.21.15.26:0/2680263252 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f56180a0a30 0x7f56181c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:26.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.735+0000 7f1e3ed9d700 1 --2- 172.21.15.26:0/2770281981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e40138d80 0x7f1e401212a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:26.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.735+0000 7f561db37700 1 --2- 172.21.15.26:0/2680263252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f561809d630 0x7f56181c7f90 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f561400e810 tx=0x7f561400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:26.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.735+0000 7f1e3e59c700 1 --2- 172.21.15.26:0/2770281981 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e4009d630 0x7f1e40120820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:26.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.735+0000 7f1e35d9b700 1 -- 172.21.15.26:0/2770281981 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e4009d630 msgr2=0x7f1e40120820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:26.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.735+0000 7f1e35d9b700 1 --2- 172.21.15.26:0/2770281981 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e4009d630 0x7f1e40120820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:26.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.735+0000 7f1e35d9b700 1 -- 172.21.15.26:0/2770281981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e40138d80 msgr2=0x7f1e401212a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:26.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.735+0000 7f1e35d9b700 1 --2- 172.21.15.26:0/2770281981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e40138d80 0x7f1e401212a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:26.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.735+0000 7f1e35d9b700 1 -- 172.21.15.26:0/2770281981 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e300094a0 con 0x7f1e400a0a30 2023-10-01T07:57:26.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.735+0000 7f1e35d9b700 1 --2- 172.21.15.26:0/2770281981 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e400a0a30 0x7f1e40120d60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1e2800c530 tx=0x7f1e2800c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:26.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.736+0000 7f560e7fc700 1 -- 172.21.15.26:0/2680263252 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5614013610 con 0x7f561809d630 2023-10-01T07:57:26.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.736+0000 7f560e7fc700 1 -- 172.21.15.26:0/2680263252 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5614013770 con 0x7f561809d630 2023-10-01T07:57:26.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.736+0000 7f560e7fc700 1 -- 172.21.15.26:0/2680263252 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5614013ae0 con 0x7f561809d630 2023-10-01T07:57:26.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.736+0000 7f1e377fe700 1 -- 172.21.15.26:0/2770281981 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e28005d70 con 0x7f1e400a0a30 2023-10-01T07:57:26.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.736+0000 7f1e377fe700 1 -- 172.21.15.26:0/2770281981 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e280070d0 con 0x7f1e400a0a30 2023-10-01T07:57:26.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.736+0000 7f1e377fe700 1 -- 172.21.15.26:0/2770281981 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e28007440 con 0x7f1e400a0a30 2023-10-01T07:57:26.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.736+0000 7f1e44de6700 1 -- 172.21.15.26:0/2770281981 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e4013b010 con 0x7f1e400a0a30 2023-10-01T07:57:26.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.736+0000 7f1e44de6700 1 -- 172.21.15.26:0/2770281981 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e400a0410 con 0x7f1e400a0a30 2023-10-01T07:57:26.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.736+0000 7f561fd9b700 1 -- 172.21.15.26:0/2680263252 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56180a40c0 con 0x7f561809d630 2023-10-01T07:57:26.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.736+0000 7f561fd9b700 1 -- 172.21.15.26:0/2680263252 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56181220e0 con 0x7f561809d630 2023-10-01T07:57:26.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.737+0000 7f561fd9b700 1 -- 172.21.15.26:0/2680263252 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56180747f0 con 0x7f561809d630 2023-10-01T07:57:26.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.737+0000 7f560e7fc700 1 -- 172.21.15.26:0/2680263252 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5614013c40 con 0x7f561809d630 2023-10-01T07:57:26.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.737+0000 7f1e377fe700 1 -- 172.21.15.26:0/2770281981 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e280075a0 con 0x7f1e400a0a30 2023-10-01T07:57:26.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.737+0000 7f560e7fc700 1 -- 172.21.15.26:0/2680263252 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f56140126f0 con 0x7f561809d630 2023-10-01T07:57:26.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.737+0000 7f1e44de6700 1 -- 172.21.15.26:0/2770281981 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e400747f0 con 0x7f1e400a0a30 2023-10-01T07:57:26.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.738+0000 7f1e377fe700 1 -- 172.21.15.26:0/2770281981 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1e2803ebf0 con 0x7f1e400a0a30 2023-10-01T07:57:26.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.742+0000 7f560e7fc700 1 -- 172.21.15.26:0/2680263252 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5614044060 con 0x7f561809d630 2023-10-01T07:57:26.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.743+0000 7f1e377fe700 1 -- 172.21.15.26:0/2770281981 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e28011d70 con 0x7f1e400a0a30 2023-10-01T07:57:26.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.902+0000 7f460ea72700 1 -- 172.21.15.26:0/587712735 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4608074ea0 con 0x7f460812ff20 2023-10-01T07:57:26.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.903+0000 7f46057fa700 1 -- 172.21.15.26:0/587712735 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f45fc021020 con 0x7f460812ff20 2023-10-01T07:57:26.903 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:26.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.905+0000 7f460ea72700 1 -- 172.21.15.26:0/587712735 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f460812ff20 msgr2=0x7f460809c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:26.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.905+0000 7f460ea72700 1 --2- 172.21.15.26:0/587712735 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f460812ff20 0x7f460809c0e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f45fc00ec10 tx=0x7f45fc00ef20 comp rx=0 tx=0).stop 2023-10-01T07:57:26.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.905+0000 7f460ea72700 1 -- 172.21.15.26:0/587712735 shutdown_connections 2023-10-01T07:57:26.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.905+0000 7f460ea72700 1 --2- 172.21.15.26:0/587712735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4608133a80 0x7f460809cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:26.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.905+0000 7f460ea72700 1 --2- 172.21.15.26:0/587712735 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f460812ff20 0x7f460809c0e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:26.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.905+0000 7f460ea72700 1 --2- 172.21.15.26:0/587712735 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4608130870 0x7f460809c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:26.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.905+0000 7f460ea72700 1 -- 172.21.15.26:0/587712735 >> 172.21.15.26:0/587712735 conn(0x7f46080a4210 msgr2=0x7f4608132c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:26.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.905+0000 7f460ea72700 1 -- 172.21.15.26:0/587712735 shutdown_connections 2023-10-01T07:57:26.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.905+0000 7f460ea72700 1 -- 172.21.15.26:0/587712735 wait complete. 2023-10-01T07:57:26.919 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:26.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.947+0000 7f561fd9b700 1 -- 172.21.15.26:0/2680263252 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5618072980 con 0x7f561809d630 2023-10-01T07:57:26.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.948+0000 7f560e7fc700 1 -- 172.21.15.26:0/2680263252 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5614044020 con 0x7f561809d630 2023-10-01T07:57:26.948 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:26.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.950+0000 7f561fd9b700 1 -- 172.21.15.26:0/2680263252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f561809d630 msgr2=0x7f56181c7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:26.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.950+0000 7f561fd9b700 1 --2- 172.21.15.26:0/2680263252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f561809d630 0x7f56181c7f90 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f561400e810 tx=0x7f561400eb20 comp rx=0 tx=0).stop 2023-10-01T07:57:26.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.950+0000 7f561fd9b700 1 -- 172.21.15.26:0/2680263252 shutdown_connections 2023-10-01T07:57:26.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.950+0000 7f561fd9b700 1 --2- 172.21.15.26:0/2680263252 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5618133930 0x7f56181c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:26.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.950+0000 7f561fd9b700 1 --2- 172.21.15.26:0/2680263252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f561809d630 0x7f56181c7f90 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:26.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.950+0000 7f561fd9b700 1 --2- 172.21.15.26:0/2680263252 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f56180a0a30 0x7f56181c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:26.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.950+0000 7f561fd9b700 1 -- 172.21.15.26:0/2680263252 >> 172.21.15.26:0/2680263252 conn(0x7f56180a3050 msgr2=0x7f56181bbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:26.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.950+0000 7f561fd9b700 1 -- 172.21.15.26:0/2680263252 shutdown_connections 2023-10-01T07:57:26.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.950+0000 7f561fd9b700 1 -- 172.21.15.26:0/2680263252 wait complete. 2023-10-01T07:57:26.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.955+0000 7f1e44de6700 1 -- 172.21.15.26:0/2770281981 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1e40072980 con 0x7f1e400a0a30 2023-10-01T07:57:26.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.955+0000 7f1e377fe700 1 -- 172.21.15.26:0/2770281981 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e28017030 con 0x7f1e400a0a30 2023-10-01T07:57:26.956 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:26.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.958+0000 7f1e44de6700 1 -- 172.21.15.26:0/2770281981 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e400a0a30 msgr2=0x7f1e40120d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:26.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.958+0000 7f1e44de6700 1 --2- 172.21.15.26:0/2770281981 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e400a0a30 0x7f1e40120d60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1e2800c530 tx=0x7f1e2800c840 comp rx=0 tx=0).stop 2023-10-01T07:57:26.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.958+0000 7f1e44de6700 1 -- 172.21.15.26:0/2770281981 shutdown_connections 2023-10-01T07:57:26.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.958+0000 7f1e44de6700 1 --2- 172.21.15.26:0/2770281981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e40138d80 0x7f1e401212a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:26.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.958+0000 7f1e44de6700 1 --2- 172.21.15.26:0/2770281981 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e4009d630 0x7f1e40120820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:26.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.958+0000 7f1e44de6700 1 --2- 172.21.15.26:0/2770281981 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e400a0a30 0x7f1e40120d60 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:26.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.958+0000 7f1e44de6700 1 -- 172.21.15.26:0/2770281981 >> 172.21.15.26:0/2770281981 conn(0x7f1e400a3050 msgr2=0x7f1e4009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:26.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.958+0000 7f1e44de6700 1 -- 172.21.15.26:0/2770281981 shutdown_connections 2023-10-01T07:57:26.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:26.958+0000 7f1e44de6700 1 -- 172.21.15.26:0/2770281981 wait complete. 2023-10-01T07:57:26.965 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:26.972 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:27.100 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:27.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.244+0000 7f4d1d7a6700 1 Processor -- start 2023-10-01T07:57:27.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.244+0000 7f4d1d7a6700 1 -- start start 2023-10-01T07:57:27.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.244+0000 7f4d1d7a6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4d180a0a30 0x7f4d180a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:27.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.244+0000 7f4d1d7a6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d18138d80 0x7f4d1813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:27.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.244+0000 7f4d1d7a6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d180a2a70 con 0x7f4d1809d630 2023-10-01T07:57:27.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.244+0000 7f4d1d7a6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d180a01d0 con 0x7f4d180a0a30 2023-10-01T07:57:27.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.244+0000 7f4d1d7a6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1809e2b0 con 0x7f4d18138d80 2023-10-01T07:57:27.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.244+0000 7f4d177fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d18138d80 0x7f4d1813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:27.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.244+0000 7f4d16ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4d180a0a30 0x7f4d180a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:27.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.244+0000 7f4d177fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d18138d80 0x7f4d1813b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34104/0 (socket says 172.21.15.26:34104) 2023-10-01T07:57:27.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.244+0000 7f4d16ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4d180a0a30 0x7f4d180a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59664/0 (socket says 172.21.15.26:59664) 2023-10-01T07:57:27.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.244+0000 7f4d177fe700 1 -- 172.21.15.26:0/2226004953 learned_addr learned my addr 172.21.15.26:0/2226004953 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:27.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.245+0000 7f4d177fe700 1 -- 172.21.15.26:0/2226004953 >> v2:172.21.15.26:3300/0 conn(0x7f4d180a0a30 msgr2=0x7f4d180a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:27.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.245+0000 7f4d177fe700 1 --2- 172.21.15.26:0/2226004953 >> v2:172.21.15.26:3300/0 conn(0x7f4d180a0a30 0x7f4d180a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:27.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.245+0000 7f4d177fe700 1 -- 172.21.15.26:0/2226004953 >> v1:172.21.15.26:6789/0 conn(0x7f4d1809d630 legacy=0x7f4d180a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:27.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.245+0000 7f4d177fe700 1 -- 172.21.15.26:0/2226004953 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1809dc50 con 0x7f4d18138d80 2023-10-01T07:57:27.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.245+0000 7f4d15ffb700 1 -- 172.21.15.26:0/2226004953 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 389607454 0 0) 0x7f4d180a2a70 con 0x7f4d1809d630 2023-10-01T07:57:27.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.245+0000 7f4d16ffd700 1 --2- 172.21.15.26:0/2226004953 >> v2:172.21.15.26:3300/0 conn(0x7f4d180a0a30 0x7f4d180a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:27.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.245+0000 7f4d177fe700 1 --2- 172.21.15.26:0/2226004953 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d18138d80 0x7f4d1813b160 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4d10009e50 tx=0x7f4d1000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11c98d77c7a7a096 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:27.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.245+0000 7f4d15ffb700 1 -- 172.21.15.26:0/2226004953 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1000e070 con 0x7f4d18138d80 2023-10-01T07:57:27.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.245+0000 7f4d15ffb700 1 -- 172.21.15.26:0/2226004953 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1000b910 con 0x7f4d18138d80 2023-10-01T07:57:27.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.245+0000 7f4d15ffb700 1 -- 172.21.15.26:0/2226004953 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1000bcc0 con 0x7f4d18138d80 2023-10-01T07:57:27.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.246+0000 7f4d1d7a6700 1 -- 172.21.15.26:0/2226004953 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d18138d80 msgr2=0x7f4d1813b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:27.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.246+0000 7f4d1d7a6700 1 --2- 172.21.15.26:0/2226004953 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d18138d80 0x7f4d1813b160 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4d10009e50 tx=0x7f4d1000b330 comp rx=0 tx=0).stop 2023-10-01T07:57:27.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.246+0000 7f4d1d7a6700 1 -- 172.21.15.26:0/2226004953 shutdown_connections 2023-10-01T07:57:27.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.246+0000 7f4d1d7a6700 1 --2- 172.21.15.26:0/2226004953 >> v2:172.21.15.26:3300/0 conn(0x7f4d180a0a30 0x7f4d180a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:27.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.246+0000 7f4d1d7a6700 1 --2- 172.21.15.26:0/2226004953 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d18138d80 0x7f4d1813b160 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:27.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.246+0000 7f4d1d7a6700 1 -- 172.21.15.26:0/2226004953 >> 172.21.15.26:0/2226004953 conn(0x7f4d180a3050 msgr2=0x7f4d180a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:27.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.246+0000 7f4d1d7a6700 1 -- 172.21.15.26:0/2226004953 shutdown_connections 2023-10-01T07:57:27.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.246+0000 7f4d1d7a6700 1 -- 172.21.15.26:0/2226004953 wait complete. 2023-10-01T07:57:27.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.247+0000 7f4d1d7a6700 1 Processor -- start 2023-10-01T07:57:27.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.247+0000 7f4d1d7a6700 1 -- start start 2023-10-01T07:57:27.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.247+0000 7f4d1d7a6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d1809d630 0x7f4d1812d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:27.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.247+0000 7f4d1d7a6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4d180a0a30 0x7f4d1812df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:27.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.247+0000 7f4d1d7a6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d18138d80 0x7f4d1812e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:27.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.247+0000 7f4d1d7a6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1809b320 con 0x7f4d1809d630 2023-10-01T07:57:27.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.247+0000 7f4d1d7a6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1809c460 con 0x7f4d18138d80 2023-10-01T07:57:27.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.247+0000 7f4d1d7a6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d180a0480 con 0x7f4d180a0a30 2023-10-01T07:57:27.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.248+0000 7f4d177fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d18138d80 0x7f4d1812e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:27.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.248+0000 7f4d167fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4d180a0a30 0x7f4d1812df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:27.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.248+0000 7f4d177fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d18138d80 0x7f4d1812e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34106/0 (socket says 172.21.15.26:34106) 2023-10-01T07:57:27.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.248+0000 7f4d177fe700 1 -- 172.21.15.26:0/2498063738 learned_addr learned my addr 172.21.15.26:0/2498063738 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:27.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.248+0000 7f4d16ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d1809d630 0x7f4d1812d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:27.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.248+0000 7f4d177fe700 1 -- 172.21.15.26:0/2498063738 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4d180a0a30 msgr2=0x7f4d1812df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:27.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.248+0000 7f4d177fe700 1 --2- 172.21.15.26:0/2498063738 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4d180a0a30 0x7f4d1812df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:27.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.248+0000 7f4d177fe700 1 -- 172.21.15.26:0/2498063738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d1809d630 msgr2=0x7f4d1812d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:27.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.248+0000 7f4d177fe700 1 --2- 172.21.15.26:0/2498063738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d1809d630 0x7f4d1812d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:27.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.248+0000 7f4d177fe700 1 -- 172.21.15.26:0/2498063738 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d080094a0 con 0x7f4d18138d80 2023-10-01T07:57:27.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.248+0000 7f4d167fc700 1 --2- 172.21.15.26:0/2498063738 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4d180a0a30 0x7f4d1812df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:27.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.248+0000 7f4d16ffd700 1 --2- 172.21.15.26:0/2498063738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d1809d630 0x7f4d1812d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:27.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.248+0000 7f4d177fe700 1 --2- 172.21.15.26:0/2498063738 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d18138d80 0x7f4d1812e470 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4d1809e3f0 tx=0x7f4d10004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:27.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.248+0000 7f4cff7fe700 1 -- 172.21.15.26:0/2498063738 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d10003ea0 con 0x7f4d18138d80 2023-10-01T07:57:27.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.248+0000 7f4cff7fe700 1 -- 172.21.15.26:0/2498063738 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d100048a0 con 0x7f4d18138d80 2023-10-01T07:57:27.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.248+0000 7f4d1d7a6700 1 -- 172.21.15.26:0/2498063738 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d10009b30 con 0x7f4d18138d80 2023-10-01T07:57:27.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.248+0000 7f4cff7fe700 1 -- 172.21.15.26:0/2498063738 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1001c650 con 0x7f4d18138d80 2023-10-01T07:57:27.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.248+0000 7f4d1d7a6700 1 -- 172.21.15.26:0/2498063738 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d1809b870 con 0x7f4d18138d80 2023-10-01T07:57:27.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.249+0000 7f4cff7fe700 1 -- 172.21.15.26:0/2498063738 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4d1001c7b0 con 0x7f4d18138d80 2023-10-01T07:57:27.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.249+0000 7f4cff7fe700 1 -- 172.21.15.26:0/2498063738 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4d10040e10 con 0x7f4d18138d80 2023-10-01T07:57:27.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.249+0000 7f4d1d7a6700 1 -- 172.21.15.26:0/2498063738 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d1812cc80 con 0x7f4d18138d80 2023-10-01T07:57:27.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.254+0000 7f4cff7fe700 1 -- 172.21.15.26:0/2498063738 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4d100123f0 con 0x7f4d18138d80 2023-10-01T07:57:27.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.457+0000 7f4d1d7a6700 1 -- 172.21.15.26:0/2498063738 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4d180747d0 con 0x7f4d18138d80 2023-10-01T07:57:27.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.457+0000 7f4cff7fe700 1 -- 172.21.15.26:0/2498063738 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4d1002c350 con 0x7f4d18138d80 2023-10-01T07:57:27.458 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:27.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.459+0000 7f4d1d7a6700 1 -- 172.21.15.26:0/2498063738 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d18138d80 msgr2=0x7f4d1812e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:27.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.459+0000 7f4d1d7a6700 1 --2- 172.21.15.26:0/2498063738 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d18138d80 0x7f4d1812e470 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4d1809e3f0 tx=0x7f4d10004ad0 comp rx=0 tx=0).stop 2023-10-01T07:57:27.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.459+0000 7f4d1d7a6700 1 -- 172.21.15.26:0/2498063738 shutdown_connections 2023-10-01T07:57:27.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.459+0000 7f4d1d7a6700 1 --2- 172.21.15.26:0/2498063738 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d18138d80 0x7f4d1812e470 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:27.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.459+0000 7f4d1d7a6700 1 --2- 172.21.15.26:0/2498063738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d1809d630 0x7f4d1812d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:27.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.459+0000 7f4d1d7a6700 1 --2- 172.21.15.26:0/2498063738 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4d180a0a30 0x7f4d1812df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:27.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.460+0000 7f4d1d7a6700 1 -- 172.21.15.26:0/2498063738 >> 172.21.15.26:0/2498063738 conn(0x7f4d180a3050 msgr2=0x7f4d180a4cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:27.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.460+0000 7f4d1d7a6700 1 -- 172.21.15.26:0/2498063738 shutdown_connections 2023-10-01T07:57:27.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:27.460+0000 7f4d1d7a6700 1 -- 172.21.15.26:0/2498063738 wait complete. 2023-10-01T07:57:27.474 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:27.921 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:27.967 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:27.974 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:28.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.076+0000 7fb8cf3d3700 1 Processor -- start 2023-10-01T07:57:28.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.077+0000 7fb8cf3d3700 1 -- start start 2023-10-01T07:57:28.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.077+0000 7fb8cf3d3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb8c809d6f0 0x7fb8c809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:28.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.077+0000 7fb8cf3d3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb8c809e000 0x7fb8c81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:28.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.077+0000 7fb8cf3d3700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c809b120 con 0x7fb8c809e410 2023-10-01T07:57:28.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.077+0000 7fb8cf3d3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8c806b460 con 0x7fb8c809d6f0 2023-10-01T07:57:28.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.077+0000 7fb8cf3d3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c809a7e0 con 0x7fb8c809e000 2023-10-01T07:57:28.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.077+0000 7fb8cc96e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb8c809e000 0x7fb8c81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:28.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.077+0000 7fb8cd16f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb8c809d6f0 0x7fb8c809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:28.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.077+0000 7fb8cc96e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb8c809e000 0x7fb8c81339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39618/0 (socket says 172.21.15.26:39618) 2023-10-01T07:57:28.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.077+0000 7fb8cd16f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb8c809d6f0 0x7fb8c809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59684/0 (socket says 172.21.15.26:59684) 2023-10-01T07:57:28.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.077+0000 7fb8cc96e700 1 -- 172.21.15.26:0/869581704 learned_addr learned my addr 172.21.15.26:0/869581704 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:28.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.078+0000 7fb8cc96e700 1 -- 172.21.15.26:0/869581704 >> v2:172.21.15.26:3300/0 conn(0x7fb8c809d6f0 msgr2=0x7fb8c809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:28.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.078+0000 7fb8cc96e700 1 --2- 172.21.15.26:0/869581704 >> v2:172.21.15.26:3300/0 conn(0x7fb8c809d6f0 0x7fb8c809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:28.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.078+0000 7fb8cc96e700 1 -- 172.21.15.26:0/869581704 >> v1:172.21.15.26:6789/0 conn(0x7fb8c809e410 legacy=0x7fb8c8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:28.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.078+0000 7fb8cc96e700 1 -- 172.21.15.26:0/869581704 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c809a500 con 0x7fb8c809e000 2023-10-01T07:57:28.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.078+0000 7fb8cd16f700 1 --2- 172.21.15.26:0/869581704 >> v2:172.21.15.26:3300/0 conn(0x7fb8c809d6f0 0x7fb8c809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:28.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.078+0000 7fb8cc96e700 1 --2- 172.21.15.26:0/869581704 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb8c809e000 0x7fb8c81339f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8009920 tx=0x7fb8b8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b62e052ab5f5477e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:28.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.078+0000 7fb8bffff700 1 -- 172.21.15.26:0/869581704 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8011830 con 0x7fb8c809e000 2023-10-01T07:57:28.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.078+0000 7fb8bffff700 1 -- 172.21.15.26:0/869581704 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b8011990 con 0x7fb8c809e000 2023-10-01T07:57:28.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.078+0000 7fb8bffff700 1 -- 172.21.15.26:0/869581704 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8011d20 con 0x7fb8c809e000 2023-10-01T07:57:28.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.079+0000 7fb8cf3d3700 1 -- 172.21.15.26:0/869581704 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb8c809e000 msgr2=0x7fb8c81339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:28.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.079+0000 7fb8cf3d3700 1 --2- 172.21.15.26:0/869581704 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb8c809e000 0x7fb8c81339f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8009920 tx=0x7fb8b8009c30 comp rx=0 tx=0).stop 2023-10-01T07:57:28.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.079+0000 7fb8cf3d3700 1 -- 172.21.15.26:0/869581704 shutdown_connections 2023-10-01T07:57:28.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.079+0000 7fb8cf3d3700 1 --2- 172.21.15.26:0/869581704 >> v2:172.21.15.26:3300/0 conn(0x7fb8c809d6f0 0x7fb8c809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:28.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.079+0000 7fb8cf3d3700 1 --2- 172.21.15.26:0/869581704 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb8c809e000 0x7fb8c81339f0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:28.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.079+0000 7fb8cf3d3700 1 -- 172.21.15.26:0/869581704 >> 172.21.15.26:0/869581704 conn(0x7fb8c8066f50 msgr2=0x7fb8c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:28.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.079+0000 7fb8cf3d3700 1 -- 172.21.15.26:0/869581704 shutdown_connections 2023-10-01T07:57:28.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.079+0000 7fb8cf3d3700 1 -- 172.21.15.26:0/869581704 wait complete. 2023-10-01T07:57:28.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.080+0000 7fb8cf3d3700 1 Processor -- start 2023-10-01T07:57:28.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.080+0000 7fb8cf3d3700 1 -- start start 2023-10-01T07:57:28.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.081+0000 7fb8cf3d3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb8c809d6f0 0x7fb8c81a6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:28.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.081+0000 7fb8cf3d3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb8c809e410 0x7fb8c81a65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:28.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.081+0000 7fb8cf3d3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8c81a6b00 0x7fb8c81ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:28.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.081+0000 7fb8cf3d3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c81a7550 con 0x7fb8c81a6b00 2023-10-01T07:57:28.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.081+0000 7fb8cf3d3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c81b9470 con 0x7fb8c809d6f0 2023-10-01T07:57:28.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.081+0000 7fb8cf3d3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c81a8ee0 con 0x7fb8c809e410 2023-10-01T07:57:28.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.081+0000 7fb8cc96e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb8c809e410 0x7fb8c81a65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:28.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.081+0000 7fb8cc96e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb8c809e410 0x7fb8c81a65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39632/0 (socket says 172.21.15.26:39632) 2023-10-01T07:57:28.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.081+0000 7fb8cc96e700 1 -- 172.21.15.26:0/2217702777 learned_addr learned my addr 172.21.15.26:0/2217702777 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:28.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.081+0000 7fb8cd16f700 1 --2- 172.21.15.26:0/2217702777 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb8c809d6f0 0x7fb8c81a6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:28.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.081+0000 7fb8cd970700 1 --2- 172.21.15.26:0/2217702777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8c81a6b00 0x7fb8c81ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:28.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.081+0000 7fb8cc96e700 1 -- 172.21.15.26:0/2217702777 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb8c809d6f0 msgr2=0x7fb8c81a6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:28.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.081+0000 7fb8cc96e700 1 --2- 172.21.15.26:0/2217702777 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb8c809d6f0 0x7fb8c81a6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:28.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.081+0000 7fb8cc96e700 1 -- 172.21.15.26:0/2217702777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8c81a6b00 msgr2=0x7fb8c81ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:28.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.081+0000 7fb8cc96e700 1 --2- 172.21.15.26:0/2217702777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8c81a6b00 0x7fb8c81ceab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:28.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.081+0000 7fb8cc96e700 1 -- 172.21.15.26:0/2217702777 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c40094a0 con 0x7fb8c809e410 2023-10-01T07:57:28.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.082+0000 7fb8cc96e700 1 --2- 172.21.15.26:0/2217702777 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb8c809e410 0x7fb8c81a65c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8000c00 tx=0x7fb8b8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:28.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.082+0000 7fb8bdffb700 1 -- 172.21.15.26:0/2217702777 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8004240 con 0x7fb8c809e410 2023-10-01T07:57:28.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.082+0000 7fb8bdffb700 1 -- 172.21.15.26:0/2217702777 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b801f070 con 0x7fb8c809e410 2023-10-01T07:57:28.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.082+0000 7fb8cf3d3700 1 -- 172.21.15.26:0/2217702777 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b8009550 con 0x7fb8c809e410 2023-10-01T07:57:28.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.082+0000 7fb8bdffb700 1 -- 172.21.15.26:0/2217702777 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b80036a0 con 0x7fb8c809e410 2023-10-01T07:57:28.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.082+0000 7fb8cf3d3700 1 -- 172.21.15.26:0/2217702777 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c81a9330 con 0x7fb8c809e410 2023-10-01T07:57:28.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.083+0000 7fb8bdffb700 1 -- 172.21.15.26:0/2217702777 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb8b8021030 con 0x7fb8c809e410 2023-10-01T07:57:28.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.083+0000 7fb8bdffb700 1 -- 172.21.15.26:0/2217702777 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb8b8040700 con 0x7fb8c809e410 2023-10-01T07:57:28.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.084+0000 7fb8cf3d3700 1 -- 172.21.15.26:0/2217702777 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c80a3380 con 0x7fb8c809e410 2023-10-01T07:57:28.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.089+0000 7fb8bdffb700 1 -- 172.21.15.26:0/2217702777 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb8b8003800 con 0x7fb8c809e410 2023-10-01T07:57:28.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.126+0000 7f767df25700 1 Processor -- start 2023-10-01T07:57:28.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.126+0000 7f767df25700 1 -- start start 2023-10-01T07:57:28.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.127+0000 7f767df25700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7678136830 0x7f7678138c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:28.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.127+0000 7f767df25700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7678139150 0x7f767813b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:28.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.127+0000 7f767df25700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f767806f720 con 0x7f76781338c0 2023-10-01T07:57:28.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.127+0000 7f767df25700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7678070c80 con 0x7f7678136830 2023-10-01T07:57:28.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.127+0000 7f767df25700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767806fce0 con 0x7f7678139150 2023-10-01T07:57:28.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.127+0000 7f766effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7678136830 0x7f7678138c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:28.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.127+0000 7f7677fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7678139150 0x7f767813b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:28.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.127+0000 7f766effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7678136830 0x7f7678138c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59696/0 (socket says 172.21.15.26:59696) 2023-10-01T07:57:28.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.127+0000 7f766effd700 1 -- 172.21.15.26:0/2206628750 learned_addr learned my addr 172.21.15.26:0/2206628750 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:28.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.128+0000 7f766effd700 1 -- 172.21.15.26:0/2206628750 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7678139150 msgr2=0x7f767813b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:28.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.128+0000 7f766effd700 1 --2- 172.21.15.26:0/2206628750 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7678139150 0x7f767813b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:28.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.128+0000 7f766effd700 1 -- 172.21.15.26:0/2206628750 >> v1:172.21.15.26:6789/0 conn(0x7f76781338c0 legacy=0x7f7678133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:28.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.128+0000 7f766effd700 1 -- 172.21.15.26:0/2206628750 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76781336a0 con 0x7f7678136830 2023-10-01T07:57:28.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.128+0000 7f7677fff700 1 --2- 172.21.15.26:0/2206628750 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7678139150 0x7f767813b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:28.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.128+0000 7f766effd700 1 --2- 172.21.15.26:0/2206628750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7678136830 0x7f7678138c10 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f76600098f0 tx=0x7f7660009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a36a90e2c81768 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:28.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.128+0000 7f7676ffd700 1 -- 172.21.15.26:0/2206628750 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7660011830 con 0x7f7678136830 2023-10-01T07:57:28.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.128+0000 7f7676ffd700 1 -- 172.21.15.26:0/2206628750 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7660011990 con 0x7f7678136830 2023-10-01T07:57:28.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.128+0000 7f7676ffd700 1 -- 172.21.15.26:0/2206628750 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7660011d20 con 0x7f7678136830 2023-10-01T07:57:28.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.129+0000 7f767df25700 1 -- 172.21.15.26:0/2206628750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7678136830 msgr2=0x7f7678138c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:28.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.129+0000 7f767df25700 1 --2- 172.21.15.26:0/2206628750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7678136830 0x7f7678138c10 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f76600098f0 tx=0x7f7660009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:28.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.129+0000 7f767df25700 1 -- 172.21.15.26:0/2206628750 shutdown_connections 2023-10-01T07:57:28.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.129+0000 7f767df25700 1 --2- 172.21.15.26:0/2206628750 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7678139150 0x7f767813b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:28.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.129+0000 7f767df25700 1 --2- 172.21.15.26:0/2206628750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7678136830 0x7f7678138c10 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:28.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.129+0000 7f767df25700 1 -- 172.21.15.26:0/2206628750 >> 172.21.15.26:0/2206628750 conn(0x7f76780a2aa0 msgr2=0x7f76780a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:28.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.129+0000 7f767df25700 1 -- 172.21.15.26:0/2206628750 shutdown_connections 2023-10-01T07:57:28.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.129+0000 7f767df25700 1 -- 172.21.15.26:0/2206628750 wait complete. 2023-10-01T07:57:28.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.130+0000 7f767df25700 1 Processor -- start 2023-10-01T07:57:28.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.131+0000 7f767df25700 1 -- start start 2023-10-01T07:57:28.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.131+0000 7f767df25700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f76781338c0 0x7f7678119ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:28.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.131+0000 7f767df25700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7678136830 0x7f767811a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:28.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.131+0000 7f767df25700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7678139150 0x7f767811a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:28.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.131+0000 7f767df25700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76781360d0 con 0x7f7678136830 2023-10-01T07:57:28.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.131+0000 7f767df25700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767811bb80 con 0x7f76781338c0 2023-10-01T07:57:28.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.131+0000 7f767df25700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f767811d3e0 con 0x7f7678139150 2023-10-01T07:57:28.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.131+0000 7f766effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7678136830 0x7f767811a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:28.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.131+0000 7f766effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7678136830 0x7f767811a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59698/0 (socket says 172.21.15.26:59698) 2023-10-01T07:57:28.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.131+0000 7f766effd700 1 -- 172.21.15.26:0/160935640 learned_addr learned my addr 172.21.15.26:0/160935640 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:28.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.132+0000 7f76777fe700 1 --2- 172.21.15.26:0/160935640 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f76781338c0 0x7f7678119ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:28.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.132+0000 7f7677fff700 1 --2- 172.21.15.26:0/160935640 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7678139150 0x7f767811a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:28.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.132+0000 7f766effd700 1 -- 172.21.15.26:0/160935640 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7678139150 msgr2=0x7f767811a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:28.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.132+0000 7f766effd700 1 --2- 172.21.15.26:0/160935640 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7678139150 0x7f767811a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:28.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.132+0000 7f766effd700 1 -- 172.21.15.26:0/160935640 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f76781338c0 msgr2=0x7f7678119ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:28.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.132+0000 7f766effd700 1 --2- 172.21.15.26:0/160935640 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f76781338c0 0x7f7678119ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:28.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.132+0000 7f766effd700 1 -- 172.21.15.26:0/160935640 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7670009a70 con 0x7f7678136830 2023-10-01T07:57:28.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.132+0000 7f766effd700 1 --2- 172.21.15.26:0/160935640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7678136830 0x7f767811a430 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f7660000c00 tx=0x7f7660004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:28.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.132+0000 7f7674ff9700 1 -- 172.21.15.26:0/160935640 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7660004400 con 0x7f7678136830 2023-10-01T07:57:28.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.132+0000 7f7674ff9700 1 -- 172.21.15.26:0/160935640 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766001f070 con 0x7f7678136830 2023-10-01T07:57:28.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.132+0000 7f7674ff9700 1 -- 172.21.15.26:0/160935640 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76600038e0 con 0x7f7678136830 2023-10-01T07:57:28.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.132+0000 7f767df25700 1 -- 172.21.15.26:0/160935640 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7660009550 con 0x7f7678136830 2023-10-01T07:57:28.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.133+0000 7f767df25700 1 -- 172.21.15.26:0/160935640 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f767811d6a0 con 0x7f7678136830 2023-10-01T07:57:28.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.134+0000 7f767df25700 1 -- 172.21.15.26:0/160935640 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7678074ea0 con 0x7f7678136830 2023-10-01T07:57:28.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.134+0000 7f7674ff9700 1 -- 172.21.15.26:0/160935640 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7660021030 con 0x7f7678136830 2023-10-01T07:57:28.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.134+0000 7f7674ff9700 1 -- 172.21.15.26:0/160935640 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f76600409f0 con 0x7f7678136830 2023-10-01T07:57:28.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.139+0000 7f7674ff9700 1 -- 172.21.15.26:0/160935640 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7660042e60 con 0x7f7678136830 2023-10-01T07:57:28.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.164+0000 7f91e3091700 1 Processor -- start 2023-10-01T07:57:28.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.164+0000 7f91e3091700 1 -- start start 2023-10-01T07:57:28.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.164+0000 7f91e3091700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91dc0a0a30 0x7f91dc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:28.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.164+0000 7f91e3091700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f91dc09d630 0x7f91dc0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:28.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.164+0000 7f91e3091700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91dc0a2a70 con 0x7f91dc133930 2023-10-01T07:57:28.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.164+0000 7f91e3091700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91dc0a01d0 con 0x7f91dc09d630 2023-10-01T07:57:28.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.164+0000 7f91e3091700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc09e2b0 con 0x7f91dc0a0a30 2023-10-01T07:57:28.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.164+0000 7f91e0e2d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91dc0a0a30 0x7f91dc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:28.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.165+0000 7f91e0e2d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91dc0a0a30 0x7f91dc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39636/0 (socket says 172.21.15.26:39636) 2023-10-01T07:57:28.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.165+0000 7f91e0e2d700 1 -- 172.21.15.26:0/1267515330 learned_addr learned my addr 172.21.15.26:0/1267515330 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:28.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.165+0000 7f91dbfff700 1 --2- 172.21.15.26:0/1267515330 >> v2:172.21.15.26:3300/0 conn(0x7f91dc09d630 0x7f91dc0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:28.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.165+0000 7f91e0e2d700 1 -- 172.21.15.26:0/1267515330 >> v2:172.21.15.26:3300/0 conn(0x7f91dc09d630 msgr2=0x7f91dc0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:28.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.165+0000 7f91e0e2d700 1 --2- 172.21.15.26:0/1267515330 >> v2:172.21.15.26:3300/0 conn(0x7f91dc09d630 0x7f91dc0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:28.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.165+0000 7f91e0e2d700 1 -- 172.21.15.26:0/1267515330 >> v1:172.21.15.26:6789/0 conn(0x7f91dc133930 legacy=0x7f91dc133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:28.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.165+0000 7f91e0e2d700 1 -- 172.21.15.26:0/1267515330 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91dc09dc50 con 0x7f91dc0a0a30 2023-10-01T07:57:28.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.165+0000 7f91e0e2d700 1 --2- 172.21.15.26:0/1267515330 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91dc0a0a30 0x7f91dc0a0e00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f91cc0098f0 tx=0x7f91cc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2020eafca1c3c6be server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:28.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.165+0000 7f91db7fe700 1 -- 172.21.15.26:0/1267515330 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91cc011830 con 0x7f91dc0a0a30 2023-10-01T07:57:28.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.165+0000 7f91db7fe700 1 -- 172.21.15.26:0/1267515330 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91cc011990 con 0x7f91dc0a0a30 2023-10-01T07:57:28.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.165+0000 7f91db7fe700 1 -- 172.21.15.26:0/1267515330 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91cc011d20 con 0x7f91dc0a0a30 2023-10-01T07:57:28.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.166+0000 7f91e3091700 1 -- 172.21.15.26:0/1267515330 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91dc0a0a30 msgr2=0x7f91dc0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:28.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.166+0000 7f91e3091700 1 --2- 172.21.15.26:0/1267515330 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91dc0a0a30 0x7f91dc0a0e00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f91cc0098f0 tx=0x7f91cc009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:28.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.166+0000 7f91e3091700 1 -- 172.21.15.26:0/1267515330 shutdown_connections 2023-10-01T07:57:28.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.166+0000 7f91e3091700 1 --2- 172.21.15.26:0/1267515330 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91dc0a0a30 0x7f91dc0a0e00 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:28.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.166+0000 7f91e3091700 1 --2- 172.21.15.26:0/1267515330 >> v2:172.21.15.26:3300/0 conn(0x7f91dc09d630 0x7f91dc0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:28.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.166+0000 7f91e3091700 1 -- 172.21.15.26:0/1267515330 >> 172.21.15.26:0/1267515330 conn(0x7f91dc0a3050 msgr2=0x7f91dc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:28.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.166+0000 7f91e3091700 1 -- 172.21.15.26:0/1267515330 shutdown_connections 2023-10-01T07:57:28.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.166+0000 7f91e3091700 1 -- 172.21.15.26:0/1267515330 wait complete. 2023-10-01T07:57:28.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.167+0000 7f91e3091700 1 Processor -- start 2023-10-01T07:57:28.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.167+0000 7f91e3091700 1 -- start start 2023-10-01T07:57:28.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.168+0000 7f91e3091700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91dc09d630 0x7f91dc121290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:28.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.168+0000 7f91e3091700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91dc0a0a30 0x7f91dc1217d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:28.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.168+0000 7f91e3091700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91dc133930 0x7f91dc121d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:28.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.168+0000 7f91e3091700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc122dc0 con 0x7f91dc133930 2023-10-01T07:57:28.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.168+0000 7f91e3091700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc123c50 con 0x7f91dc0a0a30 2023-10-01T07:57:28.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.168+0000 7f91e3091700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc124730 con 0x7f91dc09d630 2023-10-01T07:57:28.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.168+0000 7f91e162e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91dc133930 0x7f91dc121d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:28.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.168+0000 7f91e162e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91dc133930 0x7f91dc121d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59716/0 (socket says 172.21.15.26:59716) 2023-10-01T07:57:28.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.168+0000 7f91e162e700 1 -- 172.21.15.26:0/1671090026 learned_addr learned my addr 172.21.15.26:0/1671090026 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:28.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.168+0000 7f91dbfff700 1 --2- 172.21.15.26:0/1671090026 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91dc0a0a30 0x7f91dc1217d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:28.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.168+0000 7f91e0e2d700 1 --2- 172.21.15.26:0/1671090026 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91dc09d630 0x7f91dc121290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:28.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.168+0000 7f91e162e700 1 -- 172.21.15.26:0/1671090026 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91dc09d630 msgr2=0x7f91dc121290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:28.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.168+0000 7f91e162e700 1 --2- 172.21.15.26:0/1671090026 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91dc09d630 0x7f91dc121290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:28.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.168+0000 7f91e162e700 1 -- 172.21.15.26:0/1671090026 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91dc0a0a30 msgr2=0x7f91dc1217d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:28.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.168+0000 7f91e162e700 1 --2- 172.21.15.26:0/1671090026 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91dc0a0a30 0x7f91dc1217d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:28.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.168+0000 7f91e162e700 1 -- 172.21.15.26:0/1671090026 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91cc009550 con 0x7f91dc133930 2023-10-01T07:57:28.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.169+0000 7f91e162e700 1 --2- 172.21.15.26:0/1671090026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91dc133930 0x7f91dc121d10 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f91d400cc80 tx=0x7f91d400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:28.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.169+0000 7f91d97fa700 1 -- 172.21.15.26:0/1671090026 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d4003c00 con 0x7f91dc133930 2023-10-01T07:57:28.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.169+0000 7f91d97fa700 1 -- 172.21.15.26:0/1671090026 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d4003d60 con 0x7f91dc133930 2023-10-01T07:57:28.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.169+0000 7f91e3091700 1 -- 172.21.15.26:0/1671090026 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91dc1249f0 con 0x7f91dc133930 2023-10-01T07:57:28.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.169+0000 7f91d97fa700 1 -- 172.21.15.26:0/1671090026 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d400aaa0 con 0x7f91dc133930 2023-10-01T07:57:28.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.169+0000 7f91e3091700 1 -- 172.21.15.26:0/1671090026 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91dc124460 con 0x7f91dc133930 2023-10-01T07:57:28.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.170+0000 7f91d97fa700 1 -- 172.21.15.26:0/1671090026 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f91d400ac00 con 0x7f91dc133930 2023-10-01T07:57:28.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.170+0000 7f91d97fa700 1 -- 172.21.15.26:0/1671090026 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f91d403f680 con 0x7f91dc133930 2023-10-01T07:57:28.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.170+0000 7f91e3091700 1 -- 172.21.15.26:0/1671090026 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91dc11df60 con 0x7f91dc133930 2023-10-01T07:57:28.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.180+0000 7f91d97fa700 1 -- 172.21.15.26:0/1671090026 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f91d40198f0 con 0x7f91dc133930 2023-10-01T07:57:28.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.303+0000 7fb8cf3d3700 1 -- 172.21.15.26:0/2217702777 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb8c809c710 con 0x7fb8c809e410 2023-10-01T07:57:28.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.304+0000 7fb8bdffb700 1 -- 172.21.15.26:0/2217702777 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb8b8015030 con 0x7fb8c809e410 2023-10-01T07:57:28.304 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:28.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.306+0000 7fb8cf3d3700 1 -- 172.21.15.26:0/2217702777 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb8c809e410 msgr2=0x7fb8c81a65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:28.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.306+0000 7fb8cf3d3700 1 --2- 172.21.15.26:0/2217702777 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb8c809e410 0x7fb8c81a65c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8000c00 tx=0x7fb8b8004750 comp rx=0 tx=0).stop 2023-10-01T07:57:28.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.306+0000 7fb8cf3d3700 1 -- 172.21.15.26:0/2217702777 shutdown_connections 2023-10-01T07:57:28.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.306+0000 7fb8cf3d3700 1 --2- 172.21.15.26:0/2217702777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8c81a6b00 0x7fb8c81ceab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:28.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.306+0000 7fb8cf3d3700 1 --2- 172.21.15.26:0/2217702777 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb8c809d6f0 0x7fb8c81a6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:28.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.306+0000 7fb8cf3d3700 1 --2- 172.21.15.26:0/2217702777 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb8c809e410 0x7fb8c81a65c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:28.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.306+0000 7fb8cf3d3700 1 -- 172.21.15.26:0/2217702777 >> 172.21.15.26:0/2217702777 conn(0x7fb8c8066f50 msgr2=0x7fb8c81baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:28.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.306+0000 7fb8cf3d3700 1 -- 172.21.15.26:0/2217702777 shutdown_connections 2023-10-01T07:57:28.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.306+0000 7fb8cf3d3700 1 -- 172.21.15.26:0/2217702777 wait complete. 2023-10-01T07:57:28.321 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:28.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.356+0000 7f767df25700 1 -- 172.21.15.26:0/160935640 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f767811c260 con 0x7f7678136830 2023-10-01T07:57:28.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.356+0000 7f7674ff9700 1 -- 172.21.15.26:0/160935640 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f76600239c0 con 0x7f7678136830 2023-10-01T07:57:28.357 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:28.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.358+0000 7f767df25700 1 -- 172.21.15.26:0/160935640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7678136830 msgr2=0x7f767811a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:28.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.358+0000 7f767df25700 1 --2- 172.21.15.26:0/160935640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7678136830 0x7f767811a430 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f7660000c00 tx=0x7f7660004750 comp rx=0 tx=0).stop 2023-10-01T07:57:28.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.358+0000 7f767df25700 1 -- 172.21.15.26:0/160935640 shutdown_connections 2023-10-01T07:57:28.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.358+0000 7f767df25700 1 --2- 172.21.15.26:0/160935640 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7678139150 0x7f767811a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:28.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.358+0000 7f767df25700 1 --2- 172.21.15.26:0/160935640 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f76781338c0 0x7f7678119ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:28.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.358+0000 7f767df25700 1 --2- 172.21.15.26:0/160935640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7678136830 0x7f767811a430 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:28.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.359+0000 7f767df25700 1 -- 172.21.15.26:0/160935640 >> 172.21.15.26:0/160935640 conn(0x7f76780a2aa0 msgr2=0x7f767812ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:28.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.359+0000 7f767df25700 1 -- 172.21.15.26:0/160935640 shutdown_connections 2023-10-01T07:57:28.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.359+0000 7f767df25700 1 -- 172.21.15.26:0/160935640 wait complete. 2023-10-01T07:57:28.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:28.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.387+0000 7f91e3091700 1 -- 172.21.15.26:0/1671090026 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f91dc0747f0 con 0x7f91dc133930 2023-10-01T07:57:28.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.387+0000 7f91d97fa700 1 -- 172.21.15.26:0/1671090026 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f91d4019300 con 0x7f91dc133930 2023-10-01T07:57:28.388 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:28.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.389+0000 7f91e3091700 1 -- 172.21.15.26:0/1671090026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91dc133930 msgr2=0x7f91dc121d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:28.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.389+0000 7f91e3091700 1 --2- 172.21.15.26:0/1671090026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91dc133930 0x7f91dc121d10 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f91d400cc80 tx=0x7f91d400cf90 comp rx=0 tx=0).stop 2023-10-01T07:57:28.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.389+0000 7f91e3091700 1 -- 172.21.15.26:0/1671090026 shutdown_connections 2023-10-01T07:57:28.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.389+0000 7f91e3091700 1 --2- 172.21.15.26:0/1671090026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91dc133930 0x7f91dc121d10 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:28.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.389+0000 7f91e3091700 1 --2- 172.21.15.26:0/1671090026 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f91dc09d630 0x7f91dc121290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:28.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.389+0000 7f91e3091700 1 --2- 172.21.15.26:0/1671090026 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91dc0a0a30 0x7f91dc1217d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:28.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.389+0000 7f91e3091700 1 -- 172.21.15.26:0/1671090026 >> 172.21.15.26:0/1671090026 conn(0x7f91dc0a3050 msgr2=0x7f91dc1331a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:28.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.389+0000 7f91e3091700 1 -- 172.21.15.26:0/1671090026 shutdown_connections 2023-10-01T07:57:28.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.389+0000 7f91e3091700 1 -- 172.21.15.26:0/1671090026 wait complete. 2023-10-01T07:57:28.403 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:28.475 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:28.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.616+0000 7fc036e3d700 1 Processor -- start 2023-10-01T07:57:28.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.616+0000 7fc036e3d700 1 -- start start 2023-10-01T07:57:28.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.617+0000 7fc036e3d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc03009d6f0 0x7fc03009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:28.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.617+0000 7fc036e3d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc03009e000 0x7fc0301339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:28.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.617+0000 7fc036e3d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc03009b120 con 0x7fc03009e410 2023-10-01T07:57:28.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.617+0000 7fc036e3d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc03006b460 con 0x7fc03009e000 2023-10-01T07:57:28.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.617+0000 7fc036e3d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc03009a7e0 con 0x7fc03009d6f0 2023-10-01T07:57:28.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.617+0000 7fc034bd9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc03009d6f0 0x7fc03009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:28.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.617+0000 7fc02ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc03009e000 0x7fc0301339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:28.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.617+0000 7fc034bd9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc03009d6f0 0x7fc03009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39650/0 (socket says 172.21.15.26:39650) 2023-10-01T07:57:28.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.617+0000 7fc034bd9700 1 -- 172.21.15.26:0/2898316044 learned_addr learned my addr 172.21.15.26:0/2898316044 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:28.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.617+0000 7fc034bd9700 1 -- 172.21.15.26:0/2898316044 >> v2:172.21.15.26:3300/0 conn(0x7fc03009e000 msgr2=0x7fc0301339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:28.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.617+0000 7fc034bd9700 1 --2- 172.21.15.26:0/2898316044 >> v2:172.21.15.26:3300/0 conn(0x7fc03009e000 0x7fc0301339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:28.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.617+0000 7fc034bd9700 1 -- 172.21.15.26:0/2898316044 >> v1:172.21.15.26:6789/0 conn(0x7fc03009e410 legacy=0x7fc030133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:28.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.617+0000 7fc034bd9700 1 -- 172.21.15.26:0/2898316044 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc03009a500 con 0x7fc03009d6f0 2023-10-01T07:57:28.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.617+0000 7fc02ffff700 1 --2- 172.21.15.26:0/2898316044 >> v2:172.21.15.26:3300/0 conn(0x7fc03009e000 0x7fc0301339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:28.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.617+0000 7fc034bd9700 1 --2- 172.21.15.26:0/2898316044 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc03009d6f0 0x7fc03009dac0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc024009920 tx=0x7fc024009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0284bd04a7501c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:28.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.617+0000 7fc02f7fe700 1 -- 172.21.15.26:0/2898316044 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc024011830 con 0x7fc03009d6f0 2023-10-01T07:57:28.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.618+0000 7fc02f7fe700 1 -- 172.21.15.26:0/2898316044 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc024011990 con 0x7fc03009d6f0 2023-10-01T07:57:28.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.618+0000 7fc02f7fe700 1 -- 172.21.15.26:0/2898316044 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc024011d20 con 0x7fc03009d6f0 2023-10-01T07:57:28.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.618+0000 7fc036e3d700 1 -- 172.21.15.26:0/2898316044 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc03009d6f0 msgr2=0x7fc03009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:28.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.618+0000 7fc036e3d700 1 --2- 172.21.15.26:0/2898316044 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc03009d6f0 0x7fc03009dac0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc024009920 tx=0x7fc024009c30 comp rx=0 tx=0).stop 2023-10-01T07:57:28.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.618+0000 7fc036e3d700 1 -- 172.21.15.26:0/2898316044 shutdown_connections 2023-10-01T07:57:28.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.618+0000 7fc036e3d700 1 --2- 172.21.15.26:0/2898316044 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc03009d6f0 0x7fc03009dac0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:28.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.618+0000 7fc036e3d700 1 --2- 172.21.15.26:0/2898316044 >> v2:172.21.15.26:3300/0 conn(0x7fc03009e000 0x7fc0301339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:28.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.618+0000 7fc036e3d700 1 -- 172.21.15.26:0/2898316044 >> 172.21.15.26:0/2898316044 conn(0x7fc030066f50 msgr2=0x7fc03009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:28.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.618+0000 7fc036e3d700 1 -- 172.21.15.26:0/2898316044 shutdown_connections 2023-10-01T07:57:28.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.618+0000 7fc036e3d700 1 -- 172.21.15.26:0/2898316044 wait complete. 2023-10-01T07:57:28.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.619+0000 7fc036e3d700 1 Processor -- start 2023-10-01T07:57:28.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.619+0000 7fc036e3d700 1 -- start start 2023-10-01T07:57:28.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.620+0000 7fc036e3d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc03009d6f0 0x7fc0301a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:28.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.620+0000 7fc036e3d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc03009e000 0x7fc0301a6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:28.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.620+0000 7fc036e3d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc03009e410 0x7fc0301a6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:28.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.620+0000 7fc036e3d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0301a7cb0 con 0x7fc03009e410 2023-10-01T07:57:28.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.620+0000 7fc036e3d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0301a9820 con 0x7fc03009d6f0 2023-10-01T07:57:28.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.620+0000 7fc036e3d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0300a3380 con 0x7fc03009e000 2023-10-01T07:57:28.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.620+0000 7fc02ffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc03009e000 0x7fc0301a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:28.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.620+0000 7fc034bd9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc03009d6f0 0x7fc0301a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:28.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.620+0000 7fc02ffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc03009e000 0x7fc0301a6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39660/0 (socket says 172.21.15.26:39660) 2023-10-01T07:57:28.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.620+0000 7fc02ffff700 1 -- 172.21.15.26:0/1248922208 learned_addr learned my addr 172.21.15.26:0/1248922208 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:28.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.620+0000 7fc034bd9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc03009d6f0 0x7fc0301a60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34158/0 (socket says 172.21.15.26:34158) 2023-10-01T07:57:28.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.620+0000 7fc0353da700 1 --2- 172.21.15.26:0/1248922208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc03009e410 0x7fc0301a6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:28.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.620+0000 7fc02ffff700 1 -- 172.21.15.26:0/1248922208 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc03009d6f0 msgr2=0x7fc0301a60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:28.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.620+0000 7fc02ffff700 1 --2- 172.21.15.26:0/1248922208 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc03009d6f0 0x7fc0301a60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:28.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.620+0000 7fc02ffff700 1 -- 172.21.15.26:0/1248922208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc03009e410 msgr2=0x7fc0301a6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:28.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.620+0000 7fc02ffff700 1 --2- 172.21.15.26:0/1248922208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc03009e410 0x7fc0301a6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:28.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.620+0000 7fc02ffff700 1 -- 172.21.15.26:0/1248922208 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01c0094a0 con 0x7fc03009e000 2023-10-01T07:57:28.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.620+0000 7fc0353da700 1 --2- 172.21.15.26:0/1248922208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc03009e410 0x7fc0301a6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:28.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.620+0000 7fc034bd9700 1 --2- 172.21.15.26:0/1248922208 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc03009d6f0 0x7fc0301a60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:28.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.621+0000 7fc02ffff700 1 --2- 172.21.15.26:0/1248922208 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc03009e000 0x7fc0301a6630 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc01c00ebe0 tx=0x7fc01c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:28.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.621+0000 7fc02d7fa700 1 -- 172.21.15.26:0/1248922208 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c00c850 con 0x7fc03009e000 2023-10-01T07:57:28.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.621+0000 7fc02d7fa700 1 -- 172.21.15.26:0/1248922208 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01c00c9b0 con 0x7fc03009e000 2023-10-01T07:57:28.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.621+0000 7fc036e3d700 1 -- 172.21.15.26:0/1248922208 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc024009550 con 0x7fc03009e000 2023-10-01T07:57:28.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.621+0000 7fc02d7fa700 1 -- 172.21.15.26:0/1248922208 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c00cd40 con 0x7fc03009e000 2023-10-01T07:57:28.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.621+0000 7fc036e3d700 1 -- 172.21.15.26:0/1248922208 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc03009c760 con 0x7fc03009e000 2023-10-01T07:57:28.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.622+0000 7fc02d7fa700 1 -- 172.21.15.26:0/1248922208 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc01c013470 con 0x7fc03009e000 2023-10-01T07:57:28.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.622+0000 7fc02d7fa700 1 -- 172.21.15.26:0/1248922208 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc01c03fb90 con 0x7fc03009e000 2023-10-01T07:57:28.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.622+0000 7fc036e3d700 1 -- 172.21.15.26:0/1248922208 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc030074ea0 con 0x7fc03009e000 2023-10-01T07:57:28.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.627+0000 7fc02d7fa700 1 -- 172.21.15.26:0/1248922208 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc01c013720 con 0x7fc03009e000 2023-10-01T07:57:28.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.830+0000 7fc036e3d700 1 -- 172.21.15.26:0/1248922208 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc0301a9bc0 con 0x7fc03009e000 2023-10-01T07:57:28.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.830+0000 7fc02d7fa700 1 -- 172.21.15.26:0/1248922208 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc01c017020 con 0x7fc03009e000 2023-10-01T07:57:28.831 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:28.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.833+0000 7fc036e3d700 1 -- 172.21.15.26:0/1248922208 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc03009e000 msgr2=0x7fc0301a6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:28.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.833+0000 7fc036e3d700 1 --2- 172.21.15.26:0/1248922208 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc03009e000 0x7fc0301a6630 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc01c00ebe0 tx=0x7fc01c00eef0 comp rx=0 tx=0).stop 2023-10-01T07:57:28.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.833+0000 7fc036e3d700 1 -- 172.21.15.26:0/1248922208 shutdown_connections 2023-10-01T07:57:28.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.833+0000 7fc036e3d700 1 --2- 172.21.15.26:0/1248922208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc03009e410 0x7fc0301a6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:28.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.833+0000 7fc036e3d700 1 --2- 172.21.15.26:0/1248922208 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc03009d6f0 0x7fc0301a60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:28.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.833+0000 7fc036e3d700 1 --2- 172.21.15.26:0/1248922208 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc03009e000 0x7fc0301a6630 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:28.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.833+0000 7fc036e3d700 1 -- 172.21.15.26:0/1248922208 >> 172.21.15.26:0/1248922208 conn(0x7fc030066f50 msgr2=0x7fc0301baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:28.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.833+0000 7fc036e3d700 1 -- 172.21.15.26:0/1248922208 shutdown_connections 2023-10-01T07:57:28.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:28.833+0000 7fc036e3d700 1 -- 172.21.15.26:0/1248922208 wait complete. 2023-10-01T07:57:28.847 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:29.322 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:29.374 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:29.404 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:29.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.476+0000 7f1471204700 1 Processor -- start 2023-10-01T07:57:29.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.476+0000 7f1471204700 1 -- start start 2023-10-01T07:57:29.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.476+0000 7f1471204700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f146c06a770 0x7f146c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:29.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.476+0000 7f1471204700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f146c06b080 0x7f146c131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:29.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.476+0000 7f1471204700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f146c131b40 0x7f146c131fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:29.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.476+0000 7f1471204700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f146c09ece0 con 0x7f146c06a770 2023-10-01T07:57:29.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.476+0000 7f1471204700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f146c09e760 con 0x7f146c131b40 2023-10-01T07:57:29.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.476+0000 7f1471204700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f146c09e040 con 0x7f146c06b080 2023-10-01T07:57:29.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.477+0000 7f146b59e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f146c131b40 0x7f146c131fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:29.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.477+0000 7f146b59e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f146c131b40 0x7f146c131fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34170/0 (socket says 172.21.15.26:34170) 2023-10-01T07:57:29.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.477+0000 7f146b59e700 1 -- 172.21.15.26:0/2318260038 learned_addr learned my addr 172.21.15.26:0/2318260038 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:29.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.477+0000 7f146ad9d700 1 --2- 172.21.15.26:0/2318260038 >> v2:172.21.15.26:3300/0 conn(0x7f146c06a770 0x7f146c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:29.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.477+0000 7f146a59c700 1 --2- 172.21.15.26:0/2318260038 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f146c06b080 0x7f146c131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:29.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.477+0000 7f146ad9d700 1 -- 172.21.15.26:0/2318260038 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f146c06b080 msgr2=0x7f146c131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:29.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.477+0000 7f146ad9d700 1 --2- 172.21.15.26:0/2318260038 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f146c06b080 0x7f146c131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.477+0000 7f146ad9d700 1 -- 172.21.15.26:0/2318260038 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f146c131b40 msgr2=0x7f146c131fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:29.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.477+0000 7f146ad9d700 1 --2- 172.21.15.26:0/2318260038 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f146c131b40 0x7f146c131fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.477+0000 7f146ad9d700 1 -- 172.21.15.26:0/2318260038 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f146c09f630 con 0x7f146c06a770 2023-10-01T07:57:29.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.477+0000 7f146a59c700 1 --2- 172.21.15.26:0/2318260038 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f146c06b080 0x7f146c131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:29.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.477+0000 7f146b59e700 1 --2- 172.21.15.26:0/2318260038 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f146c131b40 0x7f146c131fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:29.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.477+0000 7f146ad9d700 1 --2- 172.21.15.26:0/2318260038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f146c06a770 0x7f146c06ab40 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f145c009840 tx=0x7f145c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a1a4ff422ad669 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:29.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.478+0000 7f1469d9b700 1 -- 172.21.15.26:0/2318260038 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145c011830 con 0x7f146c06a770 2023-10-01T07:57:29.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.478+0000 7f1469d9b700 1 -- 172.21.15.26:0/2318260038 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f145c011990 con 0x7f146c06a770 2023-10-01T07:57:29.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.478+0000 7f1469d9b700 1 -- 172.21.15.26:0/2318260038 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145c011d20 con 0x7f146c06a770 2023-10-01T07:57:29.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.478+0000 7f1471204700 1 -- 172.21.15.26:0/2318260038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f146c06a770 msgr2=0x7f146c06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:29.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.478+0000 7f1471204700 1 --2- 172.21.15.26:0/2318260038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f146c06a770 0x7f146c06ab40 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f145c009840 tx=0x7f145c009b50 comp rx=0 tx=0).stop 2023-10-01T07:57:29.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.478+0000 7f1471204700 1 -- 172.21.15.26:0/2318260038 shutdown_connections 2023-10-01T07:57:29.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.478+0000 7f1471204700 1 --2- 172.21.15.26:0/2318260038 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f146c131b40 0x7f146c131fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.478+0000 7f1471204700 1 --2- 172.21.15.26:0/2318260038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f146c06a770 0x7f146c06ab40 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.478+0000 7f1471204700 1 --2- 172.21.15.26:0/2318260038 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f146c06b080 0x7f146c131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.478+0000 7f1471204700 1 -- 172.21.15.26:0/2318260038 >> 172.21.15.26:0/2318260038 conn(0x7f146c066f50 msgr2=0x7f146c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:29.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.478+0000 7f1471204700 1 -- 172.21.15.26:0/2318260038 shutdown_connections 2023-10-01T07:57:29.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.478+0000 7f1471204700 1 -- 172.21.15.26:0/2318260038 wait complete. 2023-10-01T07:57:29.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.480+0000 7f1471204700 1 Processor -- start 2023-10-01T07:57:29.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.480+0000 7f1471204700 1 -- start start 2023-10-01T07:57:29.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.481+0000 7f1471204700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f146c06a770 0x7f146c119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:29.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.481+0000 7f1471204700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f146c06b080 0x7f146c1199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:29.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.481+0000 7f1471204700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f146c131b40 0x7f146c119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:29.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.481+0000 7f1471204700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146c11bb90 con 0x7f146c131b40 2023-10-01T07:57:29.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.481+0000 7f1471204700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f146c137a00 con 0x7f146c06a770 2023-10-01T07:57:29.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.481+0000 7f1471204700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f146c11b830 con 0x7f146c06b080 2023-10-01T07:57:29.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.481+0000 7f146ad9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f146c06a770 0x7f146c119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:29.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.481+0000 7f146ad9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f146c06a770 0x7f146c119480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34186/0 (socket says 172.21.15.26:34186) 2023-10-01T07:57:29.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.481+0000 7f146ad9d700 1 -- 172.21.15.26:0/1456088430 learned_addr learned my addr 172.21.15.26:0/1456088430 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:29.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.481+0000 7f146b59e700 1 --2- 172.21.15.26:0/1456088430 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f146c131b40 0x7f146c119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:29.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.482+0000 7f146a59c700 1 --2- 172.21.15.26:0/1456088430 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f146c06b080 0x7f146c1199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:29.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.482+0000 7f146ad9d700 1 -- 172.21.15.26:0/1456088430 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f146c06b080 msgr2=0x7f146c1199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:29.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.482+0000 7f146ad9d700 1 --2- 172.21.15.26:0/1456088430 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f146c06b080 0x7f146c1199c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.482+0000 7f146ad9d700 1 -- 172.21.15.26:0/1456088430 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f146c131b40 msgr2=0x7f146c119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:29.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.482+0000 7f146ad9d700 1 --2- 172.21.15.26:0/1456088430 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f146c131b40 0x7f146c119f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.482+0000 7f146ad9d700 1 -- 172.21.15.26:0/1456088430 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14600094a0 con 0x7f146c06a770 2023-10-01T07:57:29.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.482+0000 7f146ad9d700 1 --2- 172.21.15.26:0/1456088430 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f146c06a770 0x7f146c119480 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f145c0090b0 tx=0x7f145c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:29.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.482+0000 7f14537fe700 1 -- 172.21.15.26:0/1456088430 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145c004450 con 0x7f146c06a770 2023-10-01T07:57:29.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.482+0000 7f14537fe700 1 -- 172.21.15.26:0/1456088430 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f145c01f070 con 0x7f146c06a770 2023-10-01T07:57:29.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.482+0000 7f1471204700 1 -- 172.21.15.26:0/1456088430 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1464009b30 con 0x7f146c06a770 2023-10-01T07:57:29.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.482+0000 7f14537fe700 1 -- 172.21.15.26:0/1456088430 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145c0038a0 con 0x7f146c06a770 2023-10-01T07:57:29.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.482+0000 7f1471204700 1 -- 172.21.15.26:0/1456088430 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f145c0094a0 con 0x7f146c06a770 2023-10-01T07:57:29.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.483+0000 7f14537fe700 1 -- 172.21.15.26:0/1456088430 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f145c003a00 con 0x7f146c06a770 2023-10-01T07:57:29.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.484+0000 7f1471204700 1 -- 172.21.15.26:0/1456088430 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f146c074ea0 con 0x7f146c06a770 2023-10-01T07:57:29.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.484+0000 7f14537fe700 1 -- 172.21.15.26:0/1456088430 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f145c021070 con 0x7f146c06a770 2023-10-01T07:57:29.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.489+0000 7f14537fe700 1 -- 172.21.15.26:0/1456088430 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f145c003cb0 con 0x7f146c06a770 2023-10-01T07:57:29.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.520+0000 7fcd92a5e700 1 Processor -- start 2023-10-01T07:57:29.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.520+0000 7fcd92a5e700 1 -- start start 2023-10-01T07:57:29.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.521+0000 7fcd92a5e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcd8c0a0a30 0x7fcd8c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:29.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.521+0000 7fcd92a5e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcd8c0a1340 0x7fcd8c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:29.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.521+0000 7fcd92a5e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd8c133fa0 0x7fcd8c134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:29.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.521+0000 7fcd92a5e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd8c09edd0 con 0x7fcd8c0a1340 2023-10-01T07:57:29.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.521+0000 7fcd92a5e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c09e1f0 con 0x7fcd8c0a0a30 2023-10-01T07:57:29.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.521+0000 7fcd92a5e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c09dc50 con 0x7fcd8c133fa0 2023-10-01T07:57:29.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.521+0000 7fcd8bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcd8c0a0a30 0x7fcd8c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:29.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.521+0000 7fcd8bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcd8c0a0a30 0x7fcd8c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34190/0 (socket says 172.21.15.26:34190) 2023-10-01T07:57:29.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.521+0000 7fcd8bfff700 1 -- 172.21.15.26:0/2144588114 learned_addr learned my addr 172.21.15.26:0/2144588114 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:29.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.521+0000 7fcd90ffb700 1 --2- 172.21.15.26:0/2144588114 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd8c133fa0 0x7fcd8c134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:29.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.521+0000 7fcd8b7fe700 1 --2- 172.21.15.26:0/2144588114 >> v2:172.21.15.26:3300/0 conn(0x7fcd8c0a1340 0x7fcd8c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:29.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.521+0000 7fcd8bfff700 1 -- 172.21.15.26:0/2144588114 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd8c133fa0 msgr2=0x7fcd8c134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:29.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.521+0000 7fcd8bfff700 1 --2- 172.21.15.26:0/2144588114 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd8c133fa0 0x7fcd8c134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.521+0000 7fcd8bfff700 1 -- 172.21.15.26:0/2144588114 >> v2:172.21.15.26:3300/0 conn(0x7fcd8c0a1340 msgr2=0x7fcd8c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:29.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.521+0000 7fcd8bfff700 1 --2- 172.21.15.26:0/2144588114 >> v2:172.21.15.26:3300/0 conn(0x7fcd8c0a1340 0x7fcd8c133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.521+0000 7fcd8bfff700 1 -- 172.21.15.26:0/2144588114 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8c0a1fe0 con 0x7fcd8c0a0a30 2023-10-01T07:57:29.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.521+0000 7fcd8b7fe700 1 --2- 172.21.15.26:0/2144588114 >> v2:172.21.15.26:3300/0 conn(0x7fcd8c0a1340 0x7fcd8c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:29.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.521+0000 7fcd90ffb700 1 --2- 172.21.15.26:0/2144588114 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd8c133fa0 0x7fcd8c134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:29.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.522+0000 7fcd8bfff700 1 --2- 172.21.15.26:0/2144588114 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcd8c0a0a30 0x7fcd8c0a0e00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c009920 tx=0x7fcd7c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4e40352d79ee3ac server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:29.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.522+0000 7fcd8affd700 1 -- 172.21.15.26:0/2144588114 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c011830 con 0x7fcd8c0a0a30 2023-10-01T07:57:29.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.522+0000 7fcd8affd700 1 -- 172.21.15.26:0/2144588114 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7c011990 con 0x7fcd8c0a0a30 2023-10-01T07:57:29.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.522+0000 7fcd8affd700 1 -- 172.21.15.26:0/2144588114 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c011d20 con 0x7fcd8c0a0a30 2023-10-01T07:57:29.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.522+0000 7fcd92a5e700 1 -- 172.21.15.26:0/2144588114 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcd8c0a0a30 msgr2=0x7fcd8c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:29.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.522+0000 7fcd92a5e700 1 --2- 172.21.15.26:0/2144588114 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcd8c0a0a30 0x7fcd8c0a0e00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c009920 tx=0x7fcd7c009c30 comp rx=0 tx=0).stop 2023-10-01T07:57:29.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.523+0000 7fcd92a5e700 1 -- 172.21.15.26:0/2144588114 shutdown_connections 2023-10-01T07:57:29.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.523+0000 7fcd92a5e700 1 --2- 172.21.15.26:0/2144588114 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd8c133fa0 0x7fcd8c134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.523+0000 7fcd92a5e700 1 --2- 172.21.15.26:0/2144588114 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcd8c0a0a30 0x7fcd8c0a0e00 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.523+0000 7fcd92a5e700 1 --2- 172.21.15.26:0/2144588114 >> v2:172.21.15.26:3300/0 conn(0x7fcd8c0a1340 0x7fcd8c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.523+0000 7fcd92a5e700 1 -- 172.21.15.26:0/2144588114 >> 172.21.15.26:0/2144588114 conn(0x7fcd8c0a6550 msgr2=0x7fcd8c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:29.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.523+0000 7fcd92a5e700 1 -- 172.21.15.26:0/2144588114 shutdown_connections 2023-10-01T07:57:29.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.523+0000 7fcd92a5e700 1 -- 172.21.15.26:0/2144588114 wait complete. 2023-10-01T07:57:29.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.524+0000 7fcd92a5e700 1 Processor -- start 2023-10-01T07:57:29.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.524+0000 7fcd92a5e700 1 -- start start 2023-10-01T07:57:29.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.524+0000 7fcd92a5e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcd8c0a0a30 0x7fcd8c120340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:29.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.524+0000 7fcd92a5e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd8c0a1340 0x7fcd8c120880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:29.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.524+0000 7fcd92a5e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd8c133fa0 0x7fcd8c120dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:29.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.524+0000 7fcd92a5e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c133730 con 0x7fcd8c133fa0 2023-10-01T07:57:29.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.524+0000 7fcd92a5e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c122570 con 0x7fcd8c0a0a30 2023-10-01T07:57:29.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.524+0000 7fcd92a5e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c1231a0 con 0x7fcd8c0a1340 2023-10-01T07:57:29.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.525+0000 7fcd8bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcd8c0a0a30 0x7fcd8c120340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:29.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.525+0000 7fcd8bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcd8c0a0a30 0x7fcd8c120340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34192/0 (socket says 172.21.15.26:34192) 2023-10-01T07:57:29.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.525+0000 7fcd8bfff700 1 -- 172.21.15.26:0/2367931422 learned_addr learned my addr 172.21.15.26:0/2367931422 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:29.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.525+0000 7fcd90ffb700 1 --2- 172.21.15.26:0/2367931422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd8c133fa0 0x7fcd8c120dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:29.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.525+0000 7fcd8b7fe700 1 --2- 172.21.15.26:0/2367931422 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd8c0a1340 0x7fcd8c120880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:29.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.525+0000 7fcd8bfff700 1 -- 172.21.15.26:0/2367931422 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd8c0a1340 msgr2=0x7fcd8c120880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:29.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.525+0000 7fcd8bfff700 1 --2- 172.21.15.26:0/2367931422 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd8c0a1340 0x7fcd8c120880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.525+0000 7fcd8bfff700 1 -- 172.21.15.26:0/2367931422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd8c133fa0 msgr2=0x7fcd8c120dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:29.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.525+0000 7fcd8bfff700 1 --2- 172.21.15.26:0/2367931422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd8c133fa0 0x7fcd8c120dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.525+0000 7fcd8bfff700 1 -- 172.21.15.26:0/2367931422 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd800094a0 con 0x7fcd8c0a0a30 2023-10-01T07:57:29.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.525+0000 7fcd90ffb700 1 --2- 172.21.15.26:0/2367931422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd8c133fa0 0x7fcd8c120dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:29.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.525+0000 7fcd8bfff700 1 --2- 172.21.15.26:0/2367931422 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcd8c0a0a30 0x7fcd8c120340 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c0098f0 tx=0x7fcd7c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:29.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.526+0000 7fcd88ff9700 1 -- 172.21.15.26:0/2367931422 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c004240 con 0x7fcd8c0a0a30 2023-10-01T07:57:29.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.526+0000 7fcd88ff9700 1 -- 172.21.15.26:0/2367931422 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7c01f070 con 0x7fcd8c0a0a30 2023-10-01T07:57:29.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.526+0000 7fcd92a5e700 1 -- 172.21.15.26:0/2367931422 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd84009a70 con 0x7fcd8c0a0a30 2023-10-01T07:57:29.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.526+0000 7fcd88ff9700 1 -- 172.21.15.26:0/2367931422 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c0036a0 con 0x7fcd8c0a0a30 2023-10-01T07:57:29.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.526+0000 7fcd92a5e700 1 -- 172.21.15.26:0/2367931422 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd7c009550 con 0x7fcd8c0a0a30 2023-10-01T07:57:29.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.526+0000 7fcd88ff9700 1 -- 172.21.15.26:0/2367931422 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcd7c021030 con 0x7fcd8c0a0a30 2023-10-01T07:57:29.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.527+0000 7fcd88ff9700 1 -- 172.21.15.26:0/2367931422 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcd7c040870 con 0x7fcd8c0a0a30 2023-10-01T07:57:29.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.527+0000 7fcd92a5e700 1 -- 172.21.15.26:0/2367931422 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd8c09e8f0 con 0x7fcd8c0a0a30 2023-10-01T07:57:29.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.532+0000 7fcd88ff9700 1 -- 172.21.15.26:0/2367931422 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcd7c015080 con 0x7fcd8c0a0a30 2023-10-01T07:57:29.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.562+0000 7f6b94ab2700 1 Processor -- start 2023-10-01T07:57:29.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.562+0000 7f6b94ab2700 1 -- start start 2023-10-01T07:57:29.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.563+0000 7f6b94ab2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b9012cc20 0x7f6b9012f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:29.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.563+0000 7f6b94ab2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6b9012c2f0 0x7f6b9012fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:29.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.563+0000 7f6b94ab2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b9012cff0 0x7f6b901303b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:29.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.563+0000 7f6b94ab2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b9009a510 con 0x7f6b9012c2f0 2023-10-01T07:57:29.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.563+0000 7f6b94ab2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9012c7d0 con 0x7f6b9012cff0 2023-10-01T07:57:29.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.563+0000 7f6b94ab2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9009c190 con 0x7f6b9012cc20 2023-10-01T07:57:29.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.563+0000 7f6b8dd9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6b9012c2f0 0x7f6b9012fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:29.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.563+0000 7f6b8ed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b9012cff0 0x7f6b901303b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:29.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.563+0000 7f6b8ed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b9012cff0 0x7f6b901303b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34204/0 (socket says 172.21.15.26:34204) 2023-10-01T07:57:29.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.563+0000 7f6b8dd9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6b9012c2f0 0x7f6b9012fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59772/0 (socket says 172.21.15.26:59772) 2023-10-01T07:57:29.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.563+0000 7f6b8ed9d700 1 -- 172.21.15.26:0/2305784122 learned_addr learned my addr 172.21.15.26:0/2305784122 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:29.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.563+0000 7f6b8e59c700 1 --2- 172.21.15.26:0/2305784122 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b9012cc20 0x7f6b9012f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:29.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.564+0000 7f6b8dd9b700 1 -- 172.21.15.26:0/2305784122 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b9012cc20 msgr2=0x7f6b9012f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:29.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.564+0000 7f6b8dd9b700 1 --2- 172.21.15.26:0/2305784122 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b9012cc20 0x7f6b9012f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.564+0000 7f6b8dd9b700 1 -- 172.21.15.26:0/2305784122 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b9012cff0 msgr2=0x7f6b901303b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:29.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.564+0000 7f6b8dd9b700 1 --2- 172.21.15.26:0/2305784122 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b9012cff0 0x7f6b901303b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.564+0000 7f6b8dd9b700 1 -- 172.21.15.26:0/2305784122 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9009b540 con 0x7f6b9012c2f0 2023-10-01T07:57:29.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.564+0000 7f6b8ed9d700 1 --2- 172.21.15.26:0/2305784122 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b9012cff0 0x7f6b901303b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:29.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.564+0000 7f6b8e59c700 1 --2- 172.21.15.26:0/2305784122 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b9012cc20 0x7f6b9012f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:29.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.564+0000 7f6b8dd9b700 1 --2- 172.21.15.26:0/2305784122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b9012c2f0 0x7f6b9012fe70 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6b84009840 tx=0x7f6b84009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e038489b9d704794 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:29.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.564+0000 7f6b8d59a700 1 -- 172.21.15.26:0/2305784122 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b84011830 con 0x7f6b9012c2f0 2023-10-01T07:57:29.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.564+0000 7f6b8d59a700 1 -- 172.21.15.26:0/2305784122 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b84011990 con 0x7f6b9012c2f0 2023-10-01T07:57:29.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.564+0000 7f6b8d59a700 1 -- 172.21.15.26:0/2305784122 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b84011d20 con 0x7f6b9012c2f0 2023-10-01T07:57:29.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.565+0000 7f6b94ab2700 1 -- 172.21.15.26:0/2305784122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b9012c2f0 msgr2=0x7f6b9012fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:29.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.565+0000 7f6b94ab2700 1 --2- 172.21.15.26:0/2305784122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b9012c2f0 0x7f6b9012fe70 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6b84009840 tx=0x7f6b84009b50 comp rx=0 tx=0).stop 2023-10-01T07:57:29.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.565+0000 7f6b94ab2700 1 -- 172.21.15.26:0/2305784122 shutdown_connections 2023-10-01T07:57:29.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.565+0000 7f6b94ab2700 1 --2- 172.21.15.26:0/2305784122 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b9012cff0 0x7f6b901303b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.565+0000 7f6b94ab2700 1 --2- 172.21.15.26:0/2305784122 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b9012cc20 0x7f6b9012f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.565+0000 7f6b94ab2700 1 --2- 172.21.15.26:0/2305784122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b9012c2f0 0x7f6b9012fe70 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.565+0000 7f6b94ab2700 1 -- 172.21.15.26:0/2305784122 >> 172.21.15.26:0/2305784122 conn(0x7f6b9009f470 msgr2=0x7f6b900a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:29.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.565+0000 7f6b94ab2700 1 -- 172.21.15.26:0/2305784122 shutdown_connections 2023-10-01T07:57:29.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.565+0000 7f6b94ab2700 1 -- 172.21.15.26:0/2305784122 wait complete. 2023-10-01T07:57:29.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.567+0000 7f6b94ab2700 1 Processor -- start 2023-10-01T07:57:29.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.567+0000 7f6b94ab2700 1 -- start start 2023-10-01T07:57:29.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.568+0000 7f6b94ab2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b9012c2f0 0x7f6b901280b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:29.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.568+0000 7f6b94ab2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b9012cc20 0x7f6b901285f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:29.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.568+0000 7f6b94ab2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b9012cff0 0x7f6b90128b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:29.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.568+0000 7f6b94ab2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b90129f80 con 0x7f6b9012c2f0 2023-10-01T07:57:29.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.568+0000 7f6b94ab2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9006fb10 con 0x7f6b9012cc20 2023-10-01T07:57:29.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.568+0000 7f6b94ab2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9006ec30 con 0x7f6b9012cff0 2023-10-01T07:57:29.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.568+0000 7f6b8e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b9012c2f0 0x7f6b901280b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:29.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.568+0000 7f6b8e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b9012c2f0 0x7f6b901280b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59782/0 (socket says 172.21.15.26:59782) 2023-10-01T07:57:29.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.568+0000 7f6b8e59c700 1 -- 172.21.15.26:0/2467857796 learned_addr learned my addr 172.21.15.26:0/2467857796 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:29.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.568+0000 7f6b8ed9d700 1 --2- 172.21.15.26:0/2467857796 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b9012cff0 0x7f6b90128b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:29.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.568+0000 7f6b8dd9b700 1 --2- 172.21.15.26:0/2467857796 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b9012cc20 0x7f6b901285f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:29.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.568+0000 7f6b8e59c700 1 -- 172.21.15.26:0/2467857796 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b9012cff0 msgr2=0x7f6b90128b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:29.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.568+0000 7f6b8e59c700 1 --2- 172.21.15.26:0/2467857796 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b9012cff0 0x7f6b90128b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.568+0000 7f6b8e59c700 1 -- 172.21.15.26:0/2467857796 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b9012cc20 msgr2=0x7f6b901285f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:29.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.568+0000 7f6b8e59c700 1 --2- 172.21.15.26:0/2467857796 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b9012cc20 0x7f6b901285f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.568+0000 7f6b8e59c700 1 -- 172.21.15.26:0/2467857796 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b800094a0 con 0x7f6b9012c2f0 2023-10-01T07:57:29.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.568+0000 7f6b8e59c700 1 --2- 172.21.15.26:0/2467857796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b9012c2f0 0x7f6b901280b0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f6b8000ebe0 tx=0x7f6b8000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:29.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.569+0000 7f6b7effd700 1 -- 172.21.15.26:0/2467857796 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8000c850 con 0x7f6b9012c2f0 2023-10-01T07:57:29.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.569+0000 7f6b7effd700 1 -- 172.21.15.26:0/2467857796 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b8000c9b0 con 0x7f6b9012c2f0 2023-10-01T07:57:29.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.569+0000 7f6b94ab2700 1 -- 172.21.15.26:0/2467857796 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b8800bd40 con 0x7f6b9012c2f0 2023-10-01T07:57:29.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.569+0000 7f6b7effd700 1 -- 172.21.15.26:0/2467857796 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8000cd40 con 0x7f6b9012c2f0 2023-10-01T07:57:29.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.569+0000 7f6b94ab2700 1 -- 172.21.15.26:0/2467857796 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b840094a0 con 0x7f6b9012c2f0 2023-10-01T07:57:29.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.570+0000 7f6b7effd700 1 -- 172.21.15.26:0/2467857796 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6b80013470 con 0x7f6b9012c2f0 2023-10-01T07:57:29.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.570+0000 7f6b94ab2700 1 -- 172.21.15.26:0/2467857796 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b900747f0 con 0x7f6b9012c2f0 2023-10-01T07:57:29.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.570+0000 7f6b7effd700 1 -- 172.21.15.26:0/2467857796 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6b8003fb30 con 0x7f6b9012c2f0 2023-10-01T07:57:29.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.575+0000 7f6b7effd700 1 -- 172.21.15.26:0/2467857796 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6b80013720 con 0x7f6b9012c2f0 2023-10-01T07:57:29.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.700+0000 7f1471204700 1 -- 172.21.15.26:0/1456088430 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f146c11a740 con 0x7f146c06a770 2023-10-01T07:57:29.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.701+0000 7f14537fe700 1 -- 172.21.15.26:0/1456088430 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f145c015030 con 0x7f146c06a770 2023-10-01T07:57:29.701 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:29.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.703+0000 7f1471204700 1 -- 172.21.15.26:0/1456088430 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f146c06a770 msgr2=0x7f146c119480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:29.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.703+0000 7f1471204700 1 --2- 172.21.15.26:0/1456088430 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f146c06a770 0x7f146c119480 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f145c0090b0 tx=0x7f145c004750 comp rx=0 tx=0).stop 2023-10-01T07:57:29.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.703+0000 7f1471204700 1 -- 172.21.15.26:0/1456088430 shutdown_connections 2023-10-01T07:57:29.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.703+0000 7f1471204700 1 --2- 172.21.15.26:0/1456088430 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f146c131b40 0x7f146c119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.703+0000 7f1471204700 1 --2- 172.21.15.26:0/1456088430 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f146c06a770 0x7f146c119480 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.703+0000 7f1471204700 1 --2- 172.21.15.26:0/1456088430 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f146c06b080 0x7f146c1199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.703+0000 7f1471204700 1 -- 172.21.15.26:0/1456088430 >> 172.21.15.26:0/1456088430 conn(0x7f146c066f50 msgr2=0x7f146c0708f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:29.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.703+0000 7f1471204700 1 -- 172.21.15.26:0/1456088430 shutdown_connections 2023-10-01T07:57:29.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.703+0000 7f1471204700 1 -- 172.21.15.26:0/1456088430 wait complete. 2023-10-01T07:57:29.718 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:29.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.739+0000 7fcd92a5e700 1 -- 172.21.15.26:0/2367931422 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcd8c0a0220 con 0x7fcd8c0a0a30 2023-10-01T07:57:29.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.740+0000 7fcd88ff9700 1 -- 172.21.15.26:0/2367931422 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcd7c0239c0 con 0x7fcd8c0a0a30 2023-10-01T07:57:29.740 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:29.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.742+0000 7fcd92a5e700 1 -- 172.21.15.26:0/2367931422 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcd8c0a0a30 msgr2=0x7fcd8c120340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:29.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.742+0000 7fcd92a5e700 1 --2- 172.21.15.26:0/2367931422 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcd8c0a0a30 0x7fcd8c120340 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c0098f0 tx=0x7fcd7c004750 comp rx=0 tx=0).stop 2023-10-01T07:57:29.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.742+0000 7fcd92a5e700 1 -- 172.21.15.26:0/2367931422 shutdown_connections 2023-10-01T07:57:29.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.742+0000 7fcd92a5e700 1 --2- 172.21.15.26:0/2367931422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd8c133fa0 0x7fcd8c120dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.742+0000 7fcd92a5e700 1 --2- 172.21.15.26:0/2367931422 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcd8c0a0a30 0x7fcd8c120340 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.742+0000 7fcd92a5e700 1 --2- 172.21.15.26:0/2367931422 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd8c0a1340 0x7fcd8c120880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.742+0000 7fcd92a5e700 1 -- 172.21.15.26:0/2367931422 >> 172.21.15.26:0/2367931422 conn(0x7fcd8c0a6550 msgr2=0x7fcd8c09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:29.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.742+0000 7fcd92a5e700 1 -- 172.21.15.26:0/2367931422 shutdown_connections 2023-10-01T07:57:29.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.742+0000 7fcd92a5e700 1 -- 172.21.15.26:0/2367931422 wait complete. 2023-10-01T07:57:29.757 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:29.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.781+0000 7f6b94ab2700 1 -- 172.21.15.26:0/2467857796 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6b9006b250 con 0x7f6b9012c2f0 2023-10-01T07:57:29.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.781+0000 7f6b7effd700 1 -- 172.21.15.26:0/2467857796 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6b80021070 con 0x7f6b9012c2f0 2023-10-01T07:57:29.782 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:29.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.783+0000 7f6b94ab2700 1 -- 172.21.15.26:0/2467857796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b9012c2f0 msgr2=0x7f6b901280b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:29.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.783+0000 7f6b94ab2700 1 --2- 172.21.15.26:0/2467857796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b9012c2f0 0x7f6b901280b0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f6b8000ebe0 tx=0x7f6b8000eef0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.784+0000 7f6b94ab2700 1 -- 172.21.15.26:0/2467857796 shutdown_connections 2023-10-01T07:57:29.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.784+0000 7f6b94ab2700 1 --2- 172.21.15.26:0/2467857796 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b9012cff0 0x7f6b90128b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.784+0000 7f6b94ab2700 1 --2- 172.21.15.26:0/2467857796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b9012c2f0 0x7f6b901280b0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.784+0000 7f6b94ab2700 1 --2- 172.21.15.26:0/2467857796 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b9012cc20 0x7f6b901285f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.784+0000 7f6b94ab2700 1 -- 172.21.15.26:0/2467857796 >> 172.21.15.26:0/2467857796 conn(0x7f6b9009f470 msgr2=0x7f6b901b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:29.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.784+0000 7f6b94ab2700 1 -- 172.21.15.26:0/2467857796 shutdown_connections 2023-10-01T07:57:29.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.784+0000 7f6b94ab2700 1 -- 172.21.15.26:0/2467857796 wait complete. 2023-10-01T07:57:29.797 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:29.848 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:29.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.987+0000 7fad39012700 1 Processor -- start 2023-10-01T07:57:29.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.987+0000 7fad39012700 1 -- start start 2023-10-01T07:57:29.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.988+0000 7fad39012700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fad34136820 0x7fad34138c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:29.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.988+0000 7fad39012700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fad34139140 0x7fad3413b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:29.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.988+0000 7fad39012700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad3406bc00 con 0x7fad34133a80 2023-10-01T07:57:29.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.988+0000 7fad39012700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad3406c570 con 0x7fad34139140 2023-10-01T07:57:29.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.988+0000 7fad39012700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad340a0040 con 0x7fad34136820 2023-10-01T07:57:29.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.988+0000 7fad3259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fad34136820 0x7fad34138c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:29.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.988+0000 7fad3359e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fad34139140 0x7fad3413b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:29.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.988+0000 7fad3259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fad34136820 0x7fad34138c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39746/0 (socket says 172.21.15.26:39746) 2023-10-01T07:57:29.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.988+0000 7fad3259c700 1 -- 172.21.15.26:0/1005485813 learned_addr learned my addr 172.21.15.26:0/1005485813 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:29.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.988+0000 7fad3259c700 1 -- 172.21.15.26:0/1005485813 >> v2:172.21.15.26:3300/0 conn(0x7fad34139140 msgr2=0x7fad3413b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:29.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.988+0000 7fad3259c700 1 --2- 172.21.15.26:0/1005485813 >> v2:172.21.15.26:3300/0 conn(0x7fad34139140 0x7fad3413b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.988+0000 7fad3259c700 1 -- 172.21.15.26:0/1005485813 >> v1:172.21.15.26:6789/0 conn(0x7fad34133a80 legacy=0x7fad34133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:29.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.988+0000 7fad3259c700 1 -- 172.21.15.26:0/1005485813 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad34133860 con 0x7fad34136820 2023-10-01T07:57:29.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.988+0000 7fad3359e700 1 --2- 172.21.15.26:0/1005485813 >> v2:172.21.15.26:3300/0 conn(0x7fad34139140 0x7fad3413b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:29.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.989+0000 7fad3259c700 1 --2- 172.21.15.26:0/1005485813 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fad34136820 0x7fad34138c00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fad1c0098f0 tx=0x7fad1c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a16d73dbac15b86 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:29.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.989+0000 7fad31d9b700 1 -- 172.21.15.26:0/1005485813 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c011830 con 0x7fad34136820 2023-10-01T07:57:29.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.989+0000 7fad31d9b700 1 -- 172.21.15.26:0/1005485813 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1c011990 con 0x7fad34136820 2023-10-01T07:57:29.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.989+0000 7fad31d9b700 1 -- 172.21.15.26:0/1005485813 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c011d20 con 0x7fad34136820 2023-10-01T07:57:29.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.989+0000 7fad39012700 1 -- 172.21.15.26:0/1005485813 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fad34136820 msgr2=0x7fad34138c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:29.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.989+0000 7fad39012700 1 --2- 172.21.15.26:0/1005485813 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fad34136820 0x7fad34138c00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fad1c0098f0 tx=0x7fad1c009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:29.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.989+0000 7fad39012700 1 -- 172.21.15.26:0/1005485813 shutdown_connections 2023-10-01T07:57:29.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.989+0000 7fad39012700 1 --2- 172.21.15.26:0/1005485813 >> v2:172.21.15.26:3300/0 conn(0x7fad34139140 0x7fad3413b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.989+0000 7fad39012700 1 --2- 172.21.15.26:0/1005485813 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fad34136820 0x7fad34138c00 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.989+0000 7fad39012700 1 -- 172.21.15.26:0/1005485813 >> 172.21.15.26:0/1005485813 conn(0x7fad340a4210 msgr2=0x7fad340a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:29.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.989+0000 7fad39012700 1 -- 172.21.15.26:0/1005485813 shutdown_connections 2023-10-01T07:57:29.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.989+0000 7fad39012700 1 -- 172.21.15.26:0/1005485813 wait complete. 2023-10-01T07:57:29.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.991+0000 7fad39012700 1 Processor -- start 2023-10-01T07:57:29.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.991+0000 7fad39012700 1 -- start start 2023-10-01T07:57:29.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.991+0000 7fad39012700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad34133a80 0x7fad3406f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:29.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.991+0000 7fad39012700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fad34136820 0x7fad3406fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:29.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.991+0000 7fad39012700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fad34139140 0x7fad340703d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:29.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.991+0000 7fad39012700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad340709f0 con 0x7fad34133a80 2023-10-01T07:57:29.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.991+0000 7fad39012700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3409b930 con 0x7fad34136820 2023-10-01T07:57:29.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.991+0000 7fad39012700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad3409e400 con 0x7fad34139140 2023-10-01T07:57:29.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.991+0000 7fad3259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fad34136820 0x7fad3406fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:29.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.991+0000 7fad32d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad34133a80 0x7fad3406f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:29.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.991+0000 7fad3259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fad34136820 0x7fad3406fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34210/0 (socket says 172.21.15.26:34210) 2023-10-01T07:57:29.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.991+0000 7fad3259c700 1 -- 172.21.15.26:0/2396431598 learned_addr learned my addr 172.21.15.26:0/2396431598 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:29.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.991+0000 7fad3359e700 1 --2- 172.21.15.26:0/2396431598 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fad34139140 0x7fad340703d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:29.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.992+0000 7fad3259c700 1 -- 172.21.15.26:0/2396431598 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fad34139140 msgr2=0x7fad340703d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:29.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.992+0000 7fad3259c700 1 --2- 172.21.15.26:0/2396431598 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fad34139140 0x7fad340703d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.992+0000 7fad3259c700 1 -- 172.21.15.26:0/2396431598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad34133a80 msgr2=0x7fad3406f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:29.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.992+0000 7fad3259c700 1 --2- 172.21.15.26:0/2396431598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad34133a80 0x7fad3406f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:29.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.992+0000 7fad3259c700 1 -- 172.21.15.26:0/2396431598 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad2c009a70 con 0x7fad34136820 2023-10-01T07:57:29.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.992+0000 7fad3359e700 1 --2- 172.21.15.26:0/2396431598 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fad34139140 0x7fad340703d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:29.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.992+0000 7fad32d9d700 1 --2- 172.21.15.26:0/2396431598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad34133a80 0x7fad3406f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:29.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.992+0000 7fad3259c700 1 --2- 172.21.15.26:0/2396431598 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fad34136820 0x7fad3406fe90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fad1c000c00 tx=0x7fad1c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:29.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.992+0000 7fad2b7fe700 1 -- 172.21.15.26:0/2396431598 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c0043c0 con 0x7fad34136820 2023-10-01T07:57:29.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.992+0000 7fad2b7fe700 1 -- 172.21.15.26:0/2396431598 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1c01f070 con 0x7fad34136820 2023-10-01T07:57:29.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.992+0000 7fad39012700 1 -- 172.21.15.26:0/2396431598 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad1c009550 con 0x7fad34136820 2023-10-01T07:57:29.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.992+0000 7fad2b7fe700 1 -- 172.21.15.26:0/2396431598 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c0038c0 con 0x7fad34136820 2023-10-01T07:57:29.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.992+0000 7fad39012700 1 -- 172.21.15.26:0/2396431598 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad3409b4c0 con 0x7fad34136820 2023-10-01T07:57:29.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.993+0000 7fad2b7fe700 1 -- 172.21.15.26:0/2396431598 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fad1c021030 con 0x7fad34136820 2023-10-01T07:57:29.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.993+0000 7fad2b7fe700 1 -- 172.21.15.26:0/2396431598 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fad1c040aa0 con 0x7fad34136820 2023-10-01T07:57:29.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.993+0000 7fad39012700 1 -- 172.21.15.26:0/2396431598 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad34074ea0 con 0x7fad34136820 2023-10-01T07:57:29.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:29.998+0000 7fad2b7fe700 1 -- 172.21.15.26:0/2396431598 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fad1c015020 con 0x7fad34136820 2023-10-01T07:57:30.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.207+0000 7fad39012700 1 -- 172.21.15.26:0/2396431598 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fad34136280 con 0x7fad34136820 2023-10-01T07:57:30.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.207+0000 7fad2b7fe700 1 -- 172.21.15.26:0/2396431598 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fad1c004560 con 0x7fad34136820 2023-10-01T07:57:30.208 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:30.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.209+0000 7fad39012700 1 -- 172.21.15.26:0/2396431598 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fad34136820 msgr2=0x7fad3406fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:30.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.209+0000 7fad39012700 1 --2- 172.21.15.26:0/2396431598 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fad34136820 0x7fad3406fe90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fad1c000c00 tx=0x7fad1c004750 comp rx=0 tx=0).stop 2023-10-01T07:57:30.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.210+0000 7fad39012700 1 -- 172.21.15.26:0/2396431598 shutdown_connections 2023-10-01T07:57:30.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.210+0000 7fad39012700 1 --2- 172.21.15.26:0/2396431598 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fad34139140 0x7fad340703d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:30.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.210+0000 7fad39012700 1 --2- 172.21.15.26:0/2396431598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad34133a80 0x7fad3406f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:30.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.210+0000 7fad39012700 1 --2- 172.21.15.26:0/2396431598 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fad34136820 0x7fad3406fe90 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:30.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.210+0000 7fad39012700 1 -- 172.21.15.26:0/2396431598 >> 172.21.15.26:0/2396431598 conn(0x7fad340a4210 msgr2=0x7fad340a0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:30.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.210+0000 7fad39012700 1 -- 172.21.15.26:0/2396431598 shutdown_connections 2023-10-01T07:57:30.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.210+0000 7fad39012700 1 -- 172.21.15.26:0/2396431598 wait complete. 2023-10-01T07:57:30.224 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:30.719 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:30.757 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:30.798 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:30.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.869+0000 7f6fd3022700 1 Processor -- start 2023-10-01T07:57:30.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.869+0000 7f6fd3022700 1 -- start start 2023-10-01T07:57:30.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.869+0000 7f6fd3022700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6fcc0a0a30 0x7f6fcc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:30.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.869+0000 7f6fd3022700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6fcc134170 0x7f6fcc13bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:30.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.870+0000 7f6fd3022700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fcc09edd0 con 0x7f6fcc0a1340 2023-10-01T07:57:30.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.870+0000 7f6fd3022700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fcc09e1f0 con 0x7f6fcc134170 2023-10-01T07:57:30.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.870+0000 7f6fd3022700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc09dc50 con 0x7f6fcc0a0a30 2023-10-01T07:57:30.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.870+0000 7f6fd0dbe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6fcc0a0a30 0x7f6fcc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:30.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.870+0000 7f6fd0dbe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6fcc0a0a30 0x7f6fcc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34224/0 (socket says 172.21.15.26:34224) 2023-10-01T07:57:30.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.870+0000 7f6fd0dbe700 1 -- 172.21.15.26:0/1876673962 learned_addr learned my addr 172.21.15.26:0/1876673962 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:30.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.870+0000 7f6fd15bf700 1 --2- 172.21.15.26:0/1876673962 >> v2:172.21.15.26:3300/0 conn(0x7f6fcc134170 0x7f6fcc13bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:30.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.870+0000 7f6fd0dbe700 1 -- 172.21.15.26:0/1876673962 >> v2:172.21.15.26:3300/0 conn(0x7f6fcc134170 msgr2=0x7f6fcc13bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:30.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.870+0000 7f6fd0dbe700 1 --2- 172.21.15.26:0/1876673962 >> v2:172.21.15.26:3300/0 conn(0x7f6fcc134170 0x7f6fcc13bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:30.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.870+0000 7f6fd0dbe700 1 -- 172.21.15.26:0/1876673962 >> v1:172.21.15.26:6789/0 conn(0x7f6fcc0a1340 legacy=0x7f6fcc133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:30.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.870+0000 7f6fd0dbe700 1 -- 172.21.15.26:0/1876673962 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fcc0a1fe0 con 0x7f6fcc0a0a30 2023-10-01T07:57:30.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.870+0000 7f6fd15bf700 1 --2- 172.21.15.26:0/1876673962 >> v2:172.21.15.26:3300/0 conn(0x7f6fcc134170 0x7f6fcc13bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:30.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.870+0000 7f6fd0dbe700 1 --2- 172.21.15.26:0/1876673962 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6fcc0a0a30 0x7f6fcc0a0e00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6fc00098f0 tx=0x7f6fc0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a634ea571f3c90f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:30.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.871+0000 7f6fcb7fe700 1 -- 172.21.15.26:0/1876673962 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc0011830 con 0x7f6fcc0a0a30 2023-10-01T07:57:30.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.871+0000 7f6fcb7fe700 1 -- 172.21.15.26:0/1876673962 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc0011990 con 0x7f6fcc0a0a30 2023-10-01T07:57:30.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.871+0000 7f6fcb7fe700 1 -- 172.21.15.26:0/1876673962 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc0011d20 con 0x7f6fcc0a0a30 2023-10-01T07:57:30.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.871+0000 7f6fd3022700 1 -- 172.21.15.26:0/1876673962 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6fcc0a0a30 msgr2=0x7f6fcc0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:30.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.871+0000 7f6fd3022700 1 --2- 172.21.15.26:0/1876673962 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6fcc0a0a30 0x7f6fcc0a0e00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6fc00098f0 tx=0x7f6fc0009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:30.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.871+0000 7f6fd3022700 1 -- 172.21.15.26:0/1876673962 shutdown_connections 2023-10-01T07:57:30.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.871+0000 7f6fd3022700 1 --2- 172.21.15.26:0/1876673962 >> v2:172.21.15.26:3300/0 conn(0x7f6fcc134170 0x7f6fcc13bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:30.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.871+0000 7f6fd3022700 1 --2- 172.21.15.26:0/1876673962 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6fcc0a0a30 0x7f6fcc0a0e00 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:30.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.871+0000 7f6fd3022700 1 -- 172.21.15.26:0/1876673962 >> 172.21.15.26:0/1876673962 conn(0x7f6fcc0a6550 msgr2=0x7f6fcc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:30.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.871+0000 7f6fd3022700 1 -- 172.21.15.26:0/1876673962 shutdown_connections 2023-10-01T07:57:30.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.871+0000 7f6fd3022700 1 -- 172.21.15.26:0/1876673962 wait complete. 2023-10-01T07:57:30.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.872+0000 7f6fd3022700 1 Processor -- start 2023-10-01T07:57:30.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.873+0000 7f6fd3022700 1 -- start start 2023-10-01T07:57:30.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.873+0000 7f6fd3022700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6fcc0a0a30 0x7f6fcc122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:30.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.873+0000 7f6fd3022700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6fcc0a1340 0x7f6fcc122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:30.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.873+0000 7f6fd3022700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fcc134170 0x7f6fcc123380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:30.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.873+0000 7f6fd3022700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc124690 con 0x7f6fcc134170 2023-10-01T07:57:30.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.873+0000 7f6fd3022700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc0a4f40 con 0x7f6fcc0a0a30 2023-10-01T07:57:30.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.873+0000 7f6fd3022700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc126420 con 0x7f6fcc0a1340 2023-10-01T07:57:30.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.873+0000 7f6fd0dbe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6fcc0a0a30 0x7f6fcc122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:30.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.873+0000 7f6fd15bf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fcc134170 0x7f6fcc123380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:30.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.873+0000 7f6fd0dbe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6fcc0a0a30 0x7f6fcc122900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34238/0 (socket says 172.21.15.26:34238) 2023-10-01T07:57:30.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.873+0000 7f6fd0dbe700 1 -- 172.21.15.26:0/2959145951 learned_addr learned my addr 172.21.15.26:0/2959145951 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:30.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.873+0000 7f6fd15bf700 1 --2- 172.21.15.26:0/2959145951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fcc134170 0x7f6fcc123380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59810/0 (socket says 172.21.15.26:59810) 2023-10-01T07:57:30.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.873+0000 7f6fcbfff700 1 --2- 172.21.15.26:0/2959145951 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6fcc0a1340 0x7f6fcc122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:30.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.874+0000 7f6fd15bf700 1 -- 172.21.15.26:0/2959145951 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6fcc0a1340 msgr2=0x7f6fcc122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:30.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.874+0000 7f6fd15bf700 1 --2- 172.21.15.26:0/2959145951 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6fcc0a1340 0x7f6fcc122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:30.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.874+0000 7f6fd15bf700 1 -- 172.21.15.26:0/2959145951 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6fcc0a0a30 msgr2=0x7f6fcc122900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:30.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.874+0000 7f6fd15bf700 1 --2- 172.21.15.26:0/2959145951 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6fcc0a0a30 0x7f6fcc122900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:30.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.874+0000 7f6fd15bf700 1 -- 172.21.15.26:0/2959145951 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc4009a70 con 0x7f6fcc134170 2023-10-01T07:57:30.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.874+0000 7f6fd0dbe700 1 --2- 172.21.15.26:0/2959145951 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6fcc0a0a30 0x7f6fcc122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:30.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.874+0000 7f6fd15bf700 1 --2- 172.21.15.26:0/2959145951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fcc134170 0x7f6fcc123380 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f6fc400efc0 tx=0x7f6fc400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:30.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.874+0000 7f6fc97fa700 1 -- 172.21.15.26:0/2959145951 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc400ca90 con 0x7f6fcc134170 2023-10-01T07:57:30.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.874+0000 7f6fc97fa700 1 -- 172.21.15.26:0/2959145951 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc400f040 con 0x7f6fcc134170 2023-10-01T07:57:30.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.874+0000 7f6fd3022700 1 -- 172.21.15.26:0/2959145951 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc0009550 con 0x7f6fcc134170 2023-10-01T07:57:30.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.874+0000 7f6fc97fa700 1 -- 172.21.15.26:0/2959145951 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc400ce30 con 0x7f6fcc134170 2023-10-01T07:57:30.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.874+0000 7f6fd3022700 1 -- 172.21.15.26:0/2959145951 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fcc133420 con 0x7f6fcc134170 2023-10-01T07:57:30.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.875+0000 7f6fc97fa700 1 -- 172.21.15.26:0/2959145951 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6fc4014480 con 0x7f6fcc134170 2023-10-01T07:57:30.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.876+0000 7f6fc97fa700 1 -- 172.21.15.26:0/2959145951 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6fc403fc80 con 0x7f6fcc134170 2023-10-01T07:57:30.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.876+0000 7f6fd3022700 1 -- 172.21.15.26:0/2959145951 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fcc0a1d40 con 0x7f6fcc134170 2023-10-01T07:57:30.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.881+0000 7f6fc97fa700 1 -- 172.21.15.26:0/2959145951 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6fc4012930 con 0x7f6fcc134170 2023-10-01T07:57:30.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.909+0000 7ff13bb2c700 1 Processor -- start 2023-10-01T07:57:30.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.910+0000 7ff13bb2c700 1 -- start start 2023-10-01T07:57:30.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.910+0000 7ff13bb2c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff1340a0a30 0x7ff1340a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:30.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.910+0000 7ff13bb2c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff13409d630 0x7ff1340a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:30.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.910+0000 7ff13bb2c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1340a2a70 con 0x7ff134133930 2023-10-01T07:57:30.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.910+0000 7ff13bb2c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1340a01d0 con 0x7ff1340a0a30 2023-10-01T07:57:30.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.910+0000 7ff13bb2c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff13409e2b0 con 0x7ff13409d630 2023-10-01T07:57:30.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.910+0000 7ff1398c8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff1340a0a30 0x7ff1340a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:30.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.910+0000 7ff13a0c9700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff134133930 0x7ff134133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48452/0 (socket says 172.21.15.26:48452) 2023-10-01T07:57:30.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.910+0000 7ff13a0c9700 1 -- 172.21.15.26:0/1938823804 learned_addr learned my addr 172.21.15.26:0/1938823804 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:30.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.910+0000 7ff1390c7700 1 --2- 172.21.15.26:0/1938823804 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff13409d630 0x7ff1340a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:30.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.911+0000 7ff1398c8700 1 -- 172.21.15.26:0/1938823804 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff13409d630 msgr2=0x7ff1340a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:30.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.911+0000 7ff1398c8700 1 --2- 172.21.15.26:0/1938823804 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff13409d630 0x7ff1340a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:30.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.911+0000 7ff1398c8700 1 -- 172.21.15.26:0/1938823804 >> v1:172.21.15.26:6789/0 conn(0x7ff134133930 legacy=0x7ff134133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:30.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.911+0000 7ff1398c8700 1 -- 172.21.15.26:0/1938823804 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13409dc50 con 0x7ff1340a0a30 2023-10-01T07:57:30.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.911+0000 7ff1388c6700 1 -- 172.21.15.26:0/1938823804 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2416039809 0 0) 0x7ff1340a2a70 con 0x7ff134133930 2023-10-01T07:57:30.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.911+0000 7ff1390c7700 1 --2- 172.21.15.26:0/1938823804 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff13409d630 0x7ff1340a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:30.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.911+0000 7ff1398c8700 1 --2- 172.21.15.26:0/1938823804 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1340a0a30 0x7ff1340a0e00 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7ff130009840 tx=0x7ff130009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8a7e2c5e9b481 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:30.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.911+0000 7ff1388c6700 1 -- 172.21.15.26:0/1938823804 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff130011830 con 0x7ff1340a0a30 2023-10-01T07:57:30.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.911+0000 7ff1388c6700 1 -- 172.21.15.26:0/1938823804 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff130011990 con 0x7ff1340a0a30 2023-10-01T07:57:30.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.911+0000 7ff1388c6700 1 -- 172.21.15.26:0/1938823804 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff130011d20 con 0x7ff1340a0a30 2023-10-01T07:57:30.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.912+0000 7ff13bb2c700 1 -- 172.21.15.26:0/1938823804 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1340a0a30 msgr2=0x7ff1340a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:30.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.912+0000 7ff13bb2c700 1 --2- 172.21.15.26:0/1938823804 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1340a0a30 0x7ff1340a0e00 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7ff130009840 tx=0x7ff130009b50 comp rx=0 tx=0).stop 2023-10-01T07:57:30.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.912+0000 7ff13bb2c700 1 -- 172.21.15.26:0/1938823804 shutdown_connections 2023-10-01T07:57:30.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.912+0000 7ff13bb2c700 1 --2- 172.21.15.26:0/1938823804 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1340a0a30 0x7ff1340a0e00 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:30.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.912+0000 7ff13bb2c700 1 --2- 172.21.15.26:0/1938823804 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff13409d630 0x7ff1340a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:30.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.912+0000 7ff13bb2c700 1 -- 172.21.15.26:0/1938823804 >> 172.21.15.26:0/1938823804 conn(0x7ff1340a3050 msgr2=0x7ff1340a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:30.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.912+0000 7ff13bb2c700 1 -- 172.21.15.26:0/1938823804 shutdown_connections 2023-10-01T07:57:30.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.912+0000 7ff13bb2c700 1 -- 172.21.15.26:0/1938823804 wait complete. 2023-10-01T07:57:30.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.913+0000 7ff13bb2c700 1 Processor -- start 2023-10-01T07:57:30.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.913+0000 7ff13bb2c700 1 -- start start 2023-10-01T07:57:30.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.914+0000 7ff13bb2c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff13409d630 0x7ff1341c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:30.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.914+0000 7ff13bb2c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1340a0a30 0x7ff1341c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:30.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.914+0000 7ff13bb2c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff134133930 0x7ff1341c8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:30.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.914+0000 7ff13bb2c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff134121f10 con 0x7ff134133930 2023-10-01T07:57:30.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.914+0000 7ff13bb2c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff134133540 con 0x7ff13409d630 2023-10-01T07:57:30.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.914+0000 7ff13bb2c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff134120720 con 0x7ff1340a0a30 2023-10-01T07:57:30.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.914+0000 7ff1390c7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1340a0a30 0x7ff1341c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:30.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.914+0000 7ff1390c7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1340a0a30 0x7ff1341c8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39770/0 (socket says 172.21.15.26:39770) 2023-10-01T07:57:30.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.914+0000 7ff1390c7700 1 -- 172.21.15.26:0/3842194871 learned_addr learned my addr 172.21.15.26:0/3842194871 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:30.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.914+0000 7ff1398c8700 1 --2- 172.21.15.26:0/3842194871 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff13409d630 0x7ff1341c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:30.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.914+0000 7ff1390c7700 1 -- 172.21.15.26:0/3842194871 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff13409d630 msgr2=0x7ff1341c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:30.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.914+0000 7ff1390c7700 1 --2- 172.21.15.26:0/3842194871 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff13409d630 0x7ff1341c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:30.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.914+0000 7ff13a0c9700 1 --2- 172.21.15.26:0/3842194871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff134133930 0x7ff1341c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:30.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.914+0000 7ff1390c7700 1 -- 172.21.15.26:0/3842194871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff134133930 msgr2=0x7ff1341c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:30.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.914+0000 7ff1390c7700 1 --2- 172.21.15.26:0/3842194871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff134133930 0x7ff1341c8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:30.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.915+0000 7ff1390c7700 1 -- 172.21.15.26:0/3842194871 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1240094a0 con 0x7ff1340a0a30 2023-10-01T07:57:30.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.915+0000 7ff13a0c9700 1 --2- 172.21.15.26:0/3842194871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff134133930 0x7ff1341c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:57:30.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.915+0000 7ff1390c7700 1 --2- 172.21.15.26:0/3842194871 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1340a0a30 0x7ff1341c8450 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff12400ec10 tx=0x7ff12400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:30.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.915+0000 7ff12a7fc700 1 -- 172.21.15.26:0/3842194871 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12400c910 con 0x7ff1340a0a30 2023-10-01T07:57:30.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.915+0000 7ff12a7fc700 1 -- 172.21.15.26:0/3842194871 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12400ca70 con 0x7ff1340a0a30 2023-10-01T07:57:30.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.915+0000 7ff13bb2c700 1 -- 172.21.15.26:0/3842194871 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1300094a0 con 0x7ff1340a0a30 2023-10-01T07:57:30.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.915+0000 7ff12a7fc700 1 -- 172.21.15.26:0/3842194871 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12400cde0 con 0x7ff1340a0a30 2023-10-01T07:57:30.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.915+0000 7ff13bb2c700 1 -- 172.21.15.26:0/3842194871 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1340a42a0 con 0x7ff1340a0a30 2023-10-01T07:57:30.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.916+0000 7ff12a7fc700 1 -- 172.21.15.26:0/3842194871 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff124013470 con 0x7ff1340a0a30 2023-10-01T07:57:30.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.916+0000 7ff12a7fc700 1 -- 172.21.15.26:0/3842194871 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff12403fc50 con 0x7ff1340a0a30 2023-10-01T07:57:30.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.916+0000 7ff13bb2c700 1 -- 172.21.15.26:0/3842194871 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1340747f0 con 0x7ff1340a0a30 2023-10-01T07:57:30.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.921+0000 7ff12a7fc700 1 -- 172.21.15.26:0/3842194871 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff12401b3b0 con 0x7ff1340a0a30 2023-10-01T07:57:30.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.951+0000 7f0aedc27700 1 Processor -- start 2023-10-01T07:57:30.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.951+0000 7f0aedc27700 1 -- start start 2023-10-01T07:57:30.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.952+0000 7f0aedc27700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ae806a770 0x7f0ae806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:30.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.952+0000 7f0aedc27700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ae806b080 0x7f0ae8131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:30.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.952+0000 7f0aedc27700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0ae8131b40 0x7f0ae8131fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:30.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.952+0000 7f0aedc27700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae809ece0 con 0x7f0ae8131b40 2023-10-01T07:57:30.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.952+0000 7f0aedc27700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae809e760 con 0x7f0ae806b080 2023-10-01T07:57:30.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.952+0000 7f0aedc27700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae809e040 con 0x7f0ae806a770 2023-10-01T07:57:30.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.952+0000 7f0ae77fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ae806a770 0x7f0ae806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:30.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.952+0000 7f0ae77fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ae806a770 0x7f0ae806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39782/0 (socket says 172.21.15.26:39782) 2023-10-01T07:57:30.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.952+0000 7f0ae77fe700 1 -- 172.21.15.26:0/2074945880 learned_addr learned my addr 172.21.15.26:0/2074945880 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:30.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.952+0000 7f0ae6ffd700 1 --2- 172.21.15.26:0/2074945880 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ae806b080 0x7f0ae8131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:30.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.952+0000 7f0ae7fff700 1 --2- 172.21.15.26:0/2074945880 >> v2:172.21.15.26:3300/0 conn(0x7f0ae8131b40 0x7f0ae8131fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:30.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.953+0000 7f0ae6ffd700 1 -- 172.21.15.26:0/2074945880 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ae806a770 msgr2=0x7f0ae806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:30.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.953+0000 7f0ae6ffd700 1 --2- 172.21.15.26:0/2074945880 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ae806a770 0x7f0ae806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:30.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.953+0000 7f0ae6ffd700 1 -- 172.21.15.26:0/2074945880 >> v2:172.21.15.26:3300/0 conn(0x7f0ae8131b40 msgr2=0x7f0ae8131fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:30.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.953+0000 7f0ae6ffd700 1 --2- 172.21.15.26:0/2074945880 >> v2:172.21.15.26:3300/0 conn(0x7f0ae8131b40 0x7f0ae8131fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:30.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.953+0000 7f0ae6ffd700 1 -- 172.21.15.26:0/2074945880 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae809f630 con 0x7f0ae806b080 2023-10-01T07:57:30.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.953+0000 7f0ae77fe700 1 --2- 172.21.15.26:0/2074945880 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ae806a770 0x7f0ae806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:30.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.953+0000 7f0ae6ffd700 1 --2- 172.21.15.26:0/2074945880 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ae806b080 0x7f0ae8131600 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0adc009840 tx=0x7f0adc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49133d4977eda54d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:30.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.953+0000 7f0ae67fc700 1 -- 172.21.15.26:0/2074945880 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc011830 con 0x7f0ae806b080 2023-10-01T07:57:30.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.953+0000 7f0ae67fc700 1 -- 172.21.15.26:0/2074945880 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0adc011990 con 0x7f0ae806b080 2023-10-01T07:57:30.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.953+0000 7f0ae67fc700 1 -- 172.21.15.26:0/2074945880 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc011d20 con 0x7f0ae806b080 2023-10-01T07:57:30.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.954+0000 7f0aedc27700 1 -- 172.21.15.26:0/2074945880 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ae806b080 msgr2=0x7f0ae8131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:30.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.954+0000 7f0aedc27700 1 --2- 172.21.15.26:0/2074945880 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ae806b080 0x7f0ae8131600 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0adc009840 tx=0x7f0adc009b50 comp rx=0 tx=0).stop 2023-10-01T07:57:30.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.954+0000 7f0aedc27700 1 -- 172.21.15.26:0/2074945880 shutdown_connections 2023-10-01T07:57:30.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.954+0000 7f0aedc27700 1 --2- 172.21.15.26:0/2074945880 >> v2:172.21.15.26:3300/0 conn(0x7f0ae8131b40 0x7f0ae8131fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:30.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.954+0000 7f0aedc27700 1 --2- 172.21.15.26:0/2074945880 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ae806a770 0x7f0ae806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:30.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.954+0000 7f0aedc27700 1 --2- 172.21.15.26:0/2074945880 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ae806b080 0x7f0ae8131600 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:30.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.954+0000 7f0aedc27700 1 -- 172.21.15.26:0/2074945880 >> 172.21.15.26:0/2074945880 conn(0x7f0ae8066f50 msgr2=0x7f0ae809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:30.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.954+0000 7f0aedc27700 1 -- 172.21.15.26:0/2074945880 shutdown_connections 2023-10-01T07:57:30.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.954+0000 7f0aedc27700 1 -- 172.21.15.26:0/2074945880 wait complete. 2023-10-01T07:57:30.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.955+0000 7f0aedc27700 1 Processor -- start 2023-10-01T07:57:30.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.956+0000 7f0aedc27700 1 -- start start 2023-10-01T07:57:30.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.956+0000 7f0aedc27700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ae806a770 0x7f0ae809a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:30.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.956+0000 7f0aedc27700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ae806b080 0x7f0ae809a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:30.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.956+0000 7f0aedc27700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ae8131b40 0x7f0ae809ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:30.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.956+0000 7f0aedc27700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae809bfc0 con 0x7f0ae806b080 2023-10-01T07:57:30.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.956+0000 7f0aedc27700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae80a38f0 con 0x7f0ae806a770 2023-10-01T07:57:30.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.956+0000 7f0aedc27700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae8071e60 con 0x7f0ae8131b40 2023-10-01T07:57:30.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.957+0000 7f0ae6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ae806b080 0x7f0ae809a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:30.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.957+0000 7f0ae6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ae806b080 0x7f0ae809a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59822/0 (socket says 172.21.15.26:59822) 2023-10-01T07:57:30.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.957+0000 7f0ae6ffd700 1 -- 172.21.15.26:0/1848074864 learned_addr learned my addr 172.21.15.26:0/1848074864 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:30.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.957+0000 7f0ae77fe700 1 --2- 172.21.15.26:0/1848074864 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ae806a770 0x7f0ae809a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:30.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.957+0000 7f0ae7fff700 1 --2- 172.21.15.26:0/1848074864 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ae8131b40 0x7f0ae809ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:30.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.957+0000 7f0ae6ffd700 1 -- 172.21.15.26:0/1848074864 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ae8131b40 msgr2=0x7f0ae809ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:30.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.957+0000 7f0ae6ffd700 1 --2- 172.21.15.26:0/1848074864 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ae8131b40 0x7f0ae809ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:30.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.957+0000 7f0ae6ffd700 1 -- 172.21.15.26:0/1848074864 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ae806a770 msgr2=0x7f0ae809a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:30.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.957+0000 7f0ae6ffd700 1 --2- 172.21.15.26:0/1848074864 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ae806a770 0x7f0ae809a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:30.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.957+0000 7f0ae6ffd700 1 -- 172.21.15.26:0/1848074864 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad8009550 con 0x7f0ae806b080 2023-10-01T07:57:30.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.957+0000 7f0ae77fe700 1 --2- 172.21.15.26:0/1848074864 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ae806a770 0x7f0ae809a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:30.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.957+0000 7f0ae6ffd700 1 --2- 172.21.15.26:0/1848074864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ae806b080 0x7f0ae809a940 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f0adc0090b0 tx=0x7f0adc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:30.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.957+0000 7f0acffff700 1 -- 172.21.15.26:0/1848074864 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc004450 con 0x7f0ae806b080 2023-10-01T07:57:30.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.957+0000 7f0acffff700 1 -- 172.21.15.26:0/1848074864 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0adc01f070 con 0x7f0ae806b080 2023-10-01T07:57:30.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.957+0000 7f0aedc27700 1 -- 172.21.15.26:0/1848074864 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0adc0094a0 con 0x7f0ae806b080 2023-10-01T07:57:30.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.957+0000 7f0acffff700 1 -- 172.21.15.26:0/1848074864 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc0038e0 con 0x7f0ae806b080 2023-10-01T07:57:30.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.957+0000 7f0aedc27700 1 -- 172.21.15.26:0/1848074864 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae81257a0 con 0x7f0ae806b080 2023-10-01T07:57:30.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.958+0000 7f0acffff700 1 -- 172.21.15.26:0/1848074864 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0adc003a40 con 0x7f0ae806b080 2023-10-01T07:57:30.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.959+0000 7f0acffff700 1 -- 172.21.15.26:0/1848074864 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0adc021070 con 0x7f0ae806b080 2023-10-01T07:57:30.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.959+0000 7f0aedc27700 1 -- 172.21.15.26:0/1848074864 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae81311e0 con 0x7f0ae806b080 2023-10-01T07:57:30.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:30.964+0000 7f0acffff700 1 -- 172.21.15.26:0/1848074864 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0adc015070 con 0x7f0ae806b080 2023-10-01T07:57:31.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.097+0000 7f6fd3022700 1 -- 172.21.15.26:0/2959145951 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6fcc074ea0 con 0x7f6fcc134170 2023-10-01T07:57:31.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.098+0000 7f6fc97fa700 1 -- 172.21.15.26:0/2959145951 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6fc4012340 con 0x7f6fcc134170 2023-10-01T07:57:31.098 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:31.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.100+0000 7f6fd3022700 1 -- 172.21.15.26:0/2959145951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fcc134170 msgr2=0x7f6fcc123380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:31.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.100+0000 7f6fd3022700 1 --2- 172.21.15.26:0/2959145951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fcc134170 0x7f6fcc123380 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f6fc400efc0 tx=0x7f6fc400c3a0 comp rx=0 tx=0).stop 2023-10-01T07:57:31.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.100+0000 7f6fd3022700 1 -- 172.21.15.26:0/2959145951 shutdown_connections 2023-10-01T07:57:31.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.100+0000 7f6fd3022700 1 --2- 172.21.15.26:0/2959145951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fcc134170 0x7f6fcc123380 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:31.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.100+0000 7f6fd3022700 1 --2- 172.21.15.26:0/2959145951 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6fcc0a0a30 0x7f6fcc122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:31.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.100+0000 7f6fd3022700 1 --2- 172.21.15.26:0/2959145951 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6fcc0a1340 0x7f6fcc122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:31.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.100+0000 7f6fd3022700 1 -- 172.21.15.26:0/2959145951 >> 172.21.15.26:0/2959145951 conn(0x7f6fcc0a6550 msgr2=0x7f6fcc09ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:31.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.100+0000 7f6fd3022700 1 -- 172.21.15.26:0/2959145951 shutdown_connections 2023-10-01T07:57:31.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.100+0000 7f6fd3022700 1 -- 172.21.15.26:0/2959145951 wait complete. 2023-10-01T07:57:31.114 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:31.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.131+0000 7ff13bb2c700 1 -- 172.21.15.26:0/3842194871 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff134072980 con 0x7ff1340a0a30 2023-10-01T07:57:31.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.132+0000 7ff12a7fc700 1 -- 172.21.15.26:0/3842194871 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff124021020 con 0x7ff1340a0a30 2023-10-01T07:57:31.133 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:31.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.134+0000 7ff13bb2c700 1 -- 172.21.15.26:0/3842194871 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1340a0a30 msgr2=0x7ff1341c8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:31.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.134+0000 7ff13bb2c700 1 --2- 172.21.15.26:0/3842194871 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1340a0a30 0x7ff1341c8450 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff12400ec10 tx=0x7ff12400ef20 comp rx=0 tx=0).stop 2023-10-01T07:57:31.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.134+0000 7ff13bb2c700 1 -- 172.21.15.26:0/3842194871 shutdown_connections 2023-10-01T07:57:31.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.134+0000 7ff13bb2c700 1 --2- 172.21.15.26:0/3842194871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff134133930 0x7ff1341c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:31.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.134+0000 7ff13bb2c700 1 --2- 172.21.15.26:0/3842194871 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff13409d630 0x7ff1341c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:31.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.134+0000 7ff13bb2c700 1 --2- 172.21.15.26:0/3842194871 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1340a0a30 0x7ff1341c8450 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:31.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.134+0000 7ff13bb2c700 1 -- 172.21.15.26:0/3842194871 >> 172.21.15.26:0/3842194871 conn(0x7ff1340a3050 msgr2=0x7ff1341bb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:31.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.134+0000 7ff13bb2c700 1 -- 172.21.15.26:0/3842194871 shutdown_connections 2023-10-01T07:57:31.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.134+0000 7ff13bb2c700 1 -- 172.21.15.26:0/3842194871 wait complete. 2023-10-01T07:57:31.149 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:31.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.175+0000 7f0aedc27700 1 -- 172.21.15.26:0/1848074864 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0ae8074ea0 con 0x7f0ae806b080 2023-10-01T07:57:31.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.175+0000 7f0acffff700 1 -- 172.21.15.26:0/1848074864 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0adc01a950 con 0x7f0ae806b080 2023-10-01T07:57:31.176 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:31.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.177+0000 7f0aedc27700 1 -- 172.21.15.26:0/1848074864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ae806b080 msgr2=0x7f0ae809a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:31.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.177+0000 7f0aedc27700 1 --2- 172.21.15.26:0/1848074864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ae806b080 0x7f0ae809a940 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f0adc0090b0 tx=0x7f0adc004750 comp rx=0 tx=0).stop 2023-10-01T07:57:31.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.177+0000 7f0aedc27700 1 -- 172.21.15.26:0/1848074864 shutdown_connections 2023-10-01T07:57:31.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.177+0000 7f0aedc27700 1 --2- 172.21.15.26:0/1848074864 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ae8131b40 0x7f0ae809ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:31.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.177+0000 7f0aedc27700 1 --2- 172.21.15.26:0/1848074864 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ae806a770 0x7f0ae809a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:31.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.177+0000 7f0aedc27700 1 --2- 172.21.15.26:0/1848074864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ae806b080 0x7f0ae809a940 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:31.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.178+0000 7f0aedc27700 1 -- 172.21.15.26:0/1848074864 >> 172.21.15.26:0/1848074864 conn(0x7f0ae8066f50 msgr2=0x7f0ae806fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:31.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.178+0000 7f0aedc27700 1 -- 172.21.15.26:0/1848074864 shutdown_connections 2023-10-01T07:57:31.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.178+0000 7f0aedc27700 1 -- 172.21.15.26:0/1848074864 wait complete. 2023-10-01T07:57:31.191 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:31.225 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:31.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.370+0000 7fe9923f6700 1 Processor -- start 2023-10-01T07:57:31.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.370+0000 7fe9923f6700 1 -- start start 2023-10-01T07:57:31.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.370+0000 7fe9923f6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe98c09d6f0 0x7fe98c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:31.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.371+0000 7fe9923f6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe98c09e410 0x7fe98c130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:31.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.371+0000 7fe9923f6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe98c09f130 con 0x7fe98c09e000 2023-10-01T07:57:31.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.371+0000 7fe9923f6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe98c09f520 con 0x7fe98c09e410 2023-10-01T07:57:31.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.371+0000 7fe9923f6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c09e930 con 0x7fe98c09d6f0 2023-10-01T07:57:31.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.371+0000 7fe990993700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe98c09e410 0x7fe98c130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:31.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.371+0000 7fe98bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe98c09d6f0 0x7fe98c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:31.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.371+0000 7fe990993700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe98c09e410 0x7fe98c130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59830/0 (socket says 172.21.15.26:59830) 2023-10-01T07:57:31.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.371+0000 7fe98bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe98c09d6f0 0x7fe98c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39800/0 (socket says 172.21.15.26:39800) 2023-10-01T07:57:31.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.371+0000 7fe990993700 1 -- 172.21.15.26:0/1813367745 learned_addr learned my addr 172.21.15.26:0/1813367745 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:31.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.371+0000 7fe98bfff700 1 -- 172.21.15.26:0/1813367745 >> v2:172.21.15.26:3300/0 conn(0x7fe98c09e410 msgr2=0x7fe98c130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:31.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.371+0000 7fe98bfff700 1 --2- 172.21.15.26:0/1813367745 >> v2:172.21.15.26:3300/0 conn(0x7fe98c09e410 0x7fe98c130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:31.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.371+0000 7fe98bfff700 1 -- 172.21.15.26:0/1813367745 >> v1:172.21.15.26:6789/0 conn(0x7fe98c09e000 legacy=0x7fe98c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:31.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.371+0000 7fe98bfff700 1 -- 172.21.15.26:0/1813367745 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98c09b2d0 con 0x7fe98c09d6f0 2023-10-01T07:57:31.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.371+0000 7fe990993700 1 --2- 172.21.15.26:0/1813367745 >> v2:172.21.15.26:3300/0 conn(0x7fe98c09e410 0x7fe98c130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:31.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.371+0000 7fe98bfff700 1 --2- 172.21.15.26:0/1813367745 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe98c09d6f0 0x7fe98c09dac0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe974009840 tx=0x7fe974009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77197bca77b82a72 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:31.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.371+0000 7fe98affd700 1 -- 172.21.15.26:0/1813367745 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe974011830 con 0x7fe98c09d6f0 2023-10-01T07:57:31.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.371+0000 7fe98affd700 1 -- 172.21.15.26:0/1813367745 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe974011990 con 0x7fe98c09d6f0 2023-10-01T07:57:31.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.372+0000 7fe98affd700 1 -- 172.21.15.26:0/1813367745 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe974011d20 con 0x7fe98c09d6f0 2023-10-01T07:57:31.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.372+0000 7fe9923f6700 1 -- 172.21.15.26:0/1813367745 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe98c09d6f0 msgr2=0x7fe98c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:31.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.372+0000 7fe9923f6700 1 --2- 172.21.15.26:0/1813367745 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe98c09d6f0 0x7fe98c09dac0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe974009840 tx=0x7fe974009b50 comp rx=0 tx=0).stop 2023-10-01T07:57:31.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.372+0000 7fe9923f6700 1 -- 172.21.15.26:0/1813367745 shutdown_connections 2023-10-01T07:57:31.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.372+0000 7fe9923f6700 1 --2- 172.21.15.26:0/1813367745 >> v2:172.21.15.26:3300/0 conn(0x7fe98c09e410 0x7fe98c130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:31.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.372+0000 7fe9923f6700 1 --2- 172.21.15.26:0/1813367745 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe98c09d6f0 0x7fe98c09dac0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:31.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.372+0000 7fe9923f6700 1 -- 172.21.15.26:0/1813367745 >> 172.21.15.26:0/1813367745 conn(0x7fe98c066f50 msgr2=0x7fe98c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:31.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.372+0000 7fe9923f6700 1 -- 172.21.15.26:0/1813367745 shutdown_connections 2023-10-01T07:57:31.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.372+0000 7fe9923f6700 1 -- 172.21.15.26:0/1813367745 wait complete. 2023-10-01T07:57:31.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.373+0000 7fe9923f6700 1 Processor -- start 2023-10-01T07:57:31.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.373+0000 7fe9923f6700 1 -- start start 2023-10-01T07:57:31.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.374+0000 7fe9923f6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe98c09d6f0 0x7fe98c11e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:31.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.374+0000 7fe9923f6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe98c09e000 0x7fe98c11e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:31.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.374+0000 7fe9923f6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe98c09e410 0x7fe98c11eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:31.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.374+0000 7fe9923f6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c121b40 con 0x7fe98c09e000 2023-10-01T07:57:31.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.374+0000 7fe9923f6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c09c770 con 0x7fe98c09e410 2023-10-01T07:57:31.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.374+0000 7fe9923f6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c0a1e90 con 0x7fe98c09d6f0 2023-10-01T07:57:31.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.374+0000 7fe98bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe98c09d6f0 0x7fe98c11e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:31.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.374+0000 7fe98b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe98c09e000 0x7fe98c11e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:31.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.374+0000 7fe990993700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe98c09e410 0x7fe98c11eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:31.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.374+0000 7fe98b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe98c09e000 0x7fe98c11e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59838/0 (socket says 172.21.15.26:59838) 2023-10-01T07:57:31.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.374+0000 7fe98bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe98c09d6f0 0x7fe98c11e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39816/0 (socket says 172.21.15.26:39816) 2023-10-01T07:57:31.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.374+0000 7fe98b7fe700 1 -- 172.21.15.26:0/3618883447 learned_addr learned my addr 172.21.15.26:0/3618883447 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:31.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.374+0000 7fe98b7fe700 1 -- 172.21.15.26:0/3618883447 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe98c09d6f0 msgr2=0x7fe98c11e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:31.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.374+0000 7fe98b7fe700 1 --2- 172.21.15.26:0/3618883447 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe98c09d6f0 0x7fe98c11e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:31.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.374+0000 7fe98b7fe700 1 -- 172.21.15.26:0/3618883447 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe98c09e410 msgr2=0x7fe98c11eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:31.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.374+0000 7fe98b7fe700 1 --2- 172.21.15.26:0/3618883447 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe98c09e410 0x7fe98c11eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:31.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.374+0000 7fe98b7fe700 1 -- 172.21.15.26:0/3618883447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98400bd40 con 0x7fe98c09e000 2023-10-01T07:57:31.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.375+0000 7fe98b7fe700 1 --2- 172.21.15.26:0/3618883447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe98c09e000 0x7fe98c11e5f0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fe97c00c4b0 tx=0x7fe97c00c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:31.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.375+0000 7fe988ff9700 1 -- 172.21.15.26:0/3618883447 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97c0052d0 con 0x7fe98c09e000 2023-10-01T07:57:31.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.375+0000 7fe988ff9700 1 -- 172.21.15.26:0/3618883447 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97c005430 con 0x7fe98c09e000 2023-10-01T07:57:31.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.375+0000 7fe9923f6700 1 -- 172.21.15.26:0/3618883447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9740094a0 con 0x7fe98c09e000 2023-10-01T07:57:31.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.375+0000 7fe988ff9700 1 -- 172.21.15.26:0/3618883447 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97c0038c0 con 0x7fe98c09e000 2023-10-01T07:57:31.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.375+0000 7fe9923f6700 1 -- 172.21.15.26:0/3618883447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe98c1215a0 con 0x7fe98c09e000 2023-10-01T07:57:31.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.375+0000 7fe988ff9700 1 -- 172.21.15.26:0/3618883447 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe97c003a20 con 0x7fe98c09e000 2023-10-01T07:57:31.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.376+0000 7fe988ff9700 1 -- 172.21.15.26:0/3618883447 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe97c03ea20 con 0x7fe98c09e000 2023-10-01T07:57:31.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.376+0000 7fe9923f6700 1 -- 172.21.15.26:0/3618883447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe98c074ea0 con 0x7fe98c09e000 2023-10-01T07:57:31.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.381+0000 7fe988ff9700 1 -- 172.21.15.26:0/3618883447 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe97c017080 con 0x7fe98c09e000 2023-10-01T07:57:31.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.582+0000 7fe9923f6700 1 -- 172.21.15.26:0/3618883447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe98c06c360 con 0x7fe98c09e000 2023-10-01T07:57:31.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.583+0000 7fe988ff9700 1 -- 172.21.15.26:0/3618883447 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe97c011590 con 0x7fe98c09e000 2023-10-01T07:57:31.584 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:31.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.585+0000 7fe9923f6700 1 -- 172.21.15.26:0/3618883447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe98c09e000 msgr2=0x7fe98c11e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:31.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.585+0000 7fe9923f6700 1 --2- 172.21.15.26:0/3618883447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe98c09e000 0x7fe98c11e5f0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fe97c00c4b0 tx=0x7fe97c00c7c0 comp rx=0 tx=0).stop 2023-10-01T07:57:31.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.585+0000 7fe9923f6700 1 -- 172.21.15.26:0/3618883447 shutdown_connections 2023-10-01T07:57:31.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.585+0000 7fe9923f6700 1 --2- 172.21.15.26:0/3618883447 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe98c09e410 0x7fe98c11eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:31.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.585+0000 7fe9923f6700 1 --2- 172.21.15.26:0/3618883447 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe98c09d6f0 0x7fe98c11e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:31.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.585+0000 7fe9923f6700 1 --2- 172.21.15.26:0/3618883447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe98c09e000 0x7fe98c11e5f0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:31.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.585+0000 7fe9923f6700 1 -- 172.21.15.26:0/3618883447 >> 172.21.15.26:0/3618883447 conn(0x7fe98c066f50 msgr2=0x7fe98c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:31.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.585+0000 7fe9923f6700 1 -- 172.21.15.26:0/3618883447 shutdown_connections 2023-10-01T07:57:31.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:31.585+0000 7fe9923f6700 1 -- 172.21.15.26:0/3618883447 wait complete. 2023-10-01T07:57:31.599 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:32.115 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:32.150 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:32.192 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:32.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.269+0000 7f1e38333700 1 Processor -- start 2023-10-01T07:57:32.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.269+0000 7f1e38333700 1 -- start start 2023-10-01T07:57:32.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.270+0000 7f1e38333700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1e3009d6f0 0x7f1e3009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:32.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.271+0000 7f1e38333700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e3009e000 0x7f1e301339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:32.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.271+0000 7f1e38333700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e3009b120 con 0x7f1e3009e410 2023-10-01T07:57:32.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.271+0000 7f1e38333700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e3006b460 con 0x7f1e3009d6f0 2023-10-01T07:57:32.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.271+0000 7f1e38333700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3009a7e0 con 0x7f1e3009e000 2023-10-01T07:57:32.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.271+0000 7f1e358ce700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e3009e000 0x7f1e301339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:32.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.271+0000 7f1e360cf700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1e3009d6f0 0x7f1e3009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:32.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.271+0000 7f1e358ce700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e3009e000 0x7f1e301339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34282/0 (socket says 172.21.15.26:34282) 2023-10-01T07:57:32.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.271+0000 7f1e360cf700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1e3009d6f0 0x7f1e3009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59852/0 (socket says 172.21.15.26:59852) 2023-10-01T07:57:32.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.271+0000 7f1e358ce700 1 -- 172.21.15.26:0/2615421864 learned_addr learned my addr 172.21.15.26:0/2615421864 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:32.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.271+0000 7f1e358ce700 1 -- 172.21.15.26:0/2615421864 >> v2:172.21.15.26:3300/0 conn(0x7f1e3009d6f0 msgr2=0x7f1e3009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:32.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.271+0000 7f1e358ce700 1 --2- 172.21.15.26:0/2615421864 >> v2:172.21.15.26:3300/0 conn(0x7f1e3009d6f0 0x7f1e3009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.271+0000 7f1e358ce700 1 -- 172.21.15.26:0/2615421864 >> v1:172.21.15.26:6789/0 conn(0x7f1e3009e410 legacy=0x7f1e30133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:32.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.271+0000 7f1e358ce700 1 -- 172.21.15.26:0/2615421864 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3009a500 con 0x7f1e3009e000 2023-10-01T07:57:32.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.271+0000 7f1e360cf700 1 --2- 172.21.15.26:0/2615421864 >> v2:172.21.15.26:3300/0 conn(0x7f1e3009d6f0 0x7f1e3009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:32.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.271+0000 7f1e358ce700 1 --2- 172.21.15.26:0/2615421864 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e3009e000 0x7f1e301339f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1e20009920 tx=0x7f1e20009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26eac73763cf661d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:32.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.272+0000 7f1e350cd700 1 -- 172.21.15.26:0/2615421864 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e20011830 con 0x7f1e3009e000 2023-10-01T07:57:32.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.272+0000 7f1e350cd700 1 -- 172.21.15.26:0/2615421864 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e20011990 con 0x7f1e3009e000 2023-10-01T07:57:32.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.272+0000 7f1e350cd700 1 -- 172.21.15.26:0/2615421864 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e20011d20 con 0x7f1e3009e000 2023-10-01T07:57:32.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.272+0000 7f1e38333700 1 -- 172.21.15.26:0/2615421864 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e3009e000 msgr2=0x7f1e301339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:32.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.272+0000 7f1e38333700 1 --2- 172.21.15.26:0/2615421864 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e3009e000 0x7f1e301339f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1e20009920 tx=0x7f1e20009c30 comp rx=0 tx=0).stop 2023-10-01T07:57:32.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.272+0000 7f1e38333700 1 -- 172.21.15.26:0/2615421864 shutdown_connections 2023-10-01T07:57:32.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.272+0000 7f1e38333700 1 --2- 172.21.15.26:0/2615421864 >> v2:172.21.15.26:3300/0 conn(0x7f1e3009d6f0 0x7f1e3009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.272+0000 7f1e38333700 1 --2- 172.21.15.26:0/2615421864 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e3009e000 0x7f1e301339f0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.272+0000 7f1e38333700 1 -- 172.21.15.26:0/2615421864 >> 172.21.15.26:0/2615421864 conn(0x7f1e30066f50 msgr2=0x7f1e3009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:32.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.273+0000 7f1e38333700 1 -- 172.21.15.26:0/2615421864 shutdown_connections 2023-10-01T07:57:32.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.273+0000 7f1e38333700 1 -- 172.21.15.26:0/2615421864 wait complete. 2023-10-01T07:57:32.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.274+0000 7f1e38333700 1 Processor -- start 2023-10-01T07:57:32.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.274+0000 7f1e38333700 1 -- start start 2023-10-01T07:57:32.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.275+0000 7f1e38333700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e3009d6f0 0x7f1e301a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:32.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.275+0000 7f1e38333700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e3009e000 0x7f1e301a5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:32.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.275+0000 7f1e38333700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e3009e410 0x7f1e301a57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:32.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.275+0000 7f1e38333700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e301a8600 con 0x7f1e3009e410 2023-10-01T07:57:32.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.275+0000 7f1e38333700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e301a9230 con 0x7f1e3009d6f0 2023-10-01T07:57:32.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.275+0000 7f1e38333700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e301a7bb0 con 0x7f1e3009e000 2023-10-01T07:57:32.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.275+0000 7f1e358ce700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e3009e000 0x7f1e301a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:32.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.275+0000 7f1e358ce700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e3009e000 0x7f1e301a5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39818/0 (socket says 172.21.15.26:39818) 2023-10-01T07:57:32.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.275+0000 7f1e358ce700 1 -- 172.21.15.26:0/182818909 learned_addr learned my addr 172.21.15.26:0/182818909 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:32.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.275+0000 7f1e360cf700 1 --2- 172.21.15.26:0/182818909 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e3009d6f0 0x7f1e301a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:32.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.275+0000 7f1e368d0700 1 --2- 172.21.15.26:0/182818909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e3009e410 0x7f1e301a57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:32.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.275+0000 7f1e360cf700 1 -- 172.21.15.26:0/182818909 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e3009e000 msgr2=0x7f1e301a5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:32.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.275+0000 7f1e360cf700 1 --2- 172.21.15.26:0/182818909 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e3009e000 0x7f1e301a5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.275+0000 7f1e360cf700 1 -- 172.21.15.26:0/182818909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e3009e410 msgr2=0x7f1e301a57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:32.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.275+0000 7f1e360cf700 1 --2- 172.21.15.26:0/182818909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e3009e410 0x7f1e301a57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.275+0000 7f1e360cf700 1 -- 172.21.15.26:0/182818909 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e2c0094a0 con 0x7f1e3009d6f0 2023-10-01T07:57:32.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.275+0000 7f1e368d0700 1 --2- 172.21.15.26:0/182818909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e3009e410 0x7f1e301a57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:32.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.276+0000 7f1e360cf700 1 --2- 172.21.15.26:0/182818909 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e3009d6f0 0x7f1e301a4d50 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c00e900 tx=0x7f1e2c00ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:32.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.276+0000 7f1e26ffd700 1 -- 172.21.15.26:0/182818909 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c013680 con 0x7f1e3009d6f0 2023-10-01T07:57:32.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.276+0000 7f1e26ffd700 1 -- 172.21.15.26:0/182818909 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2c0137e0 con 0x7f1e3009d6f0 2023-10-01T07:57:32.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.276+0000 7f1e38333700 1 -- 172.21.15.26:0/182818909 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e20009550 con 0x7f1e3009d6f0 2023-10-01T07:57:32.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.276+0000 7f1e26ffd700 1 -- 172.21.15.26:0/182818909 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c013b70 con 0x7f1e3009d6f0 2023-10-01T07:57:32.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.276+0000 7f1e38333700 1 -- 172.21.15.26:0/182818909 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e3009c710 con 0x7f1e3009d6f0 2023-10-01T07:57:32.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.277+0000 7f1e26ffd700 1 -- 172.21.15.26:0/182818909 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e2c013cd0 con 0x7f1e3009d6f0 2023-10-01T07:57:32.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.277+0000 7f1e26ffd700 1 -- 172.21.15.26:0/182818909 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1e2c03f5e0 con 0x7f1e3009d6f0 2023-10-01T07:57:32.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.277+0000 7f1e38333700 1 -- 172.21.15.26:0/182818909 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e300a24c0 con 0x7f1e3009d6f0 2023-10-01T07:57:32.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.282+0000 7f1e26ffd700 1 -- 172.21.15.26:0/182818909 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e2c021020 con 0x7f1e3009d6f0 2023-10-01T07:57:32.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.305+0000 7f8a0d133700 1 Processor -- start 2023-10-01T07:57:32.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.305+0000 7f8a0d133700 1 -- start start 2023-10-01T07:57:32.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.305+0000 7f8a0d133700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8a080a0a30 0x7f8a080a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:32.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.305+0000 7f8a0d133700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8a0809d630 0x7f8a080a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:32.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.305+0000 7f8a0d133700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8a08133930 0x7f8a08133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:32.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.305+0000 7f8a0d133700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a080a2a70 con 0x7f8a08133930 2023-10-01T07:57:32.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.305+0000 7f8a0d133700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a080a01d0 con 0x7f8a080a0a30 2023-10-01T07:57:32.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.305+0000 7f8a0d133700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0809e2b0 con 0x7f8a0809d630 2023-10-01T07:57:32.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.306+0000 7f8a06d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8a080a0a30 0x7f8a080a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:32.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.306+0000 7f8a0659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8a0809d630 0x7f8a080a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:32.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.306+0000 7f8a06d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8a080a0a30 0x7f8a080a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34304/0 (socket says 172.21.15.26:34304) 2023-10-01T07:57:32.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.306+0000 7f8a0659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8a0809d630 0x7f8a080a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39824/0 (socket says 172.21.15.26:39824) 2023-10-01T07:57:32.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.306+0000 7f8a06d9d700 1 -- 172.21.15.26:0/3504363844 learned_addr learned my addr 172.21.15.26:0/3504363844 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:32.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.306+0000 7f8a0759e700 1 --2- 172.21.15.26:0/3504363844 >> v2:172.21.15.26:3300/0 conn(0x7f8a08133930 0x7f8a08133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:32.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.306+0000 7f8a06d9d700 1 -- 172.21.15.26:0/3504363844 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8a0809d630 msgr2=0x7f8a080a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:32.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.306+0000 7f8a06d9d700 1 --2- 172.21.15.26:0/3504363844 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8a0809d630 0x7f8a080a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.306+0000 7f8a06d9d700 1 -- 172.21.15.26:0/3504363844 >> v2:172.21.15.26:3300/0 conn(0x7f8a08133930 msgr2=0x7f8a08133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:32.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.306+0000 7f8a06d9d700 1 --2- 172.21.15.26:0/3504363844 >> v2:172.21.15.26:3300/0 conn(0x7f8a08133930 0x7f8a08133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.306+0000 7f8a06d9d700 1 -- 172.21.15.26:0/3504363844 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0809dc50 con 0x7f8a080a0a30 2023-10-01T07:57:32.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.306+0000 7f8a0659c700 1 --2- 172.21.15.26:0/3504363844 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8a0809d630 0x7f8a080a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:32.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.306+0000 7f8a06d9d700 1 --2- 172.21.15.26:0/3504363844 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8a080a0a30 0x7f8a080a0e00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f89f80098f0 tx=0x7f89f8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6f50478c41ffed6 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:32.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.306+0000 7f8a05d9b700 1 -- 172.21.15.26:0/3504363844 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f8011830 con 0x7f8a080a0a30 2023-10-01T07:57:32.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.306+0000 7f8a05d9b700 1 -- 172.21.15.26:0/3504363844 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f8011990 con 0x7f8a080a0a30 2023-10-01T07:57:32.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.306+0000 7f8a05d9b700 1 -- 172.21.15.26:0/3504363844 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f8011d20 con 0x7f8a080a0a30 2023-10-01T07:57:32.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.307+0000 7f8a0d133700 1 -- 172.21.15.26:0/3504363844 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8a080a0a30 msgr2=0x7f8a080a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:32.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.307+0000 7f8a0d133700 1 --2- 172.21.15.26:0/3504363844 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8a080a0a30 0x7f8a080a0e00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f89f80098f0 tx=0x7f89f8009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:32.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.307+0000 7f8a0d133700 1 -- 172.21.15.26:0/3504363844 shutdown_connections 2023-10-01T07:57:32.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.307+0000 7f8a0d133700 1 --2- 172.21.15.26:0/3504363844 >> v2:172.21.15.26:3300/0 conn(0x7f8a08133930 0x7f8a08133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.307+0000 7f8a0d133700 1 --2- 172.21.15.26:0/3504363844 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8a080a0a30 0x7f8a080a0e00 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.307+0000 7f8a0d133700 1 --2- 172.21.15.26:0/3504363844 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8a0809d630 0x7f8a080a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.307+0000 7f8a0d133700 1 -- 172.21.15.26:0/3504363844 >> 172.21.15.26:0/3504363844 conn(0x7f8a080a3050 msgr2=0x7f8a080a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:32.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.307+0000 7f8a0d133700 1 -- 172.21.15.26:0/3504363844 shutdown_connections 2023-10-01T07:57:32.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.307+0000 7f8a0d133700 1 -- 172.21.15.26:0/3504363844 wait complete. 2023-10-01T07:57:32.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.309+0000 7f8a0d133700 1 Processor -- start 2023-10-01T07:57:32.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.309+0000 7f8a0d133700 1 -- start start 2023-10-01T07:57:32.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.309+0000 7f8a0d133700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8a0809d630 0x7f8a08121090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:32.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.309+0000 7f8a0d133700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a080a0a30 0x7f8a081215d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:32.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.309+0000 7f8a0d133700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8a08133930 0x7f8a08121b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:32.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.309+0000 7f8a0d133700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a08122560 con 0x7f8a080a0a30 2023-10-01T07:57:32.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.309+0000 7f8a0d133700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a08124b20 con 0x7f8a0809d630 2023-10-01T07:57:32.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.309+0000 7f8a0d133700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a08124580 con 0x7f8a08133930 2023-10-01T07:57:32.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.309+0000 7f8a06d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8a0809d630 0x7f8a08121090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:32.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.309+0000 7f8a06d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8a0809d630 0x7f8a08121090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34312/0 (socket says 172.21.15.26:34312) 2023-10-01T07:57:32.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.309+0000 7f8a06d9d700 1 -- 172.21.15.26:0/836235686 learned_addr learned my addr 172.21.15.26:0/836235686 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:32.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.309+0000 7f8a0759e700 1 --2- 172.21.15.26:0/836235686 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8a08133930 0x7f8a08121b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:32.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.310+0000 7f8a0659c700 1 --2- 172.21.15.26:0/836235686 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a080a0a30 0x7f8a081215d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:32.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.310+0000 7f8a0759e700 1 -- 172.21.15.26:0/836235686 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8a0809d630 msgr2=0x7f8a08121090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:32.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.310+0000 7f8a0759e700 1 --2- 172.21.15.26:0/836235686 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8a0809d630 0x7f8a08121090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.310+0000 7f8a0759e700 1 -- 172.21.15.26:0/836235686 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a080a0a30 msgr2=0x7f8a081215d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:32.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.310+0000 7f8a0759e700 1 --2- 172.21.15.26:0/836235686 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a080a0a30 0x7f8a081215d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.310+0000 7f8a0759e700 1 -- 172.21.15.26:0/836235686 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89fc0094a0 con 0x7f8a08133930 2023-10-01T07:57:32.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.310+0000 7f8a0759e700 1 --2- 172.21.15.26:0/836235686 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8a08133930 0x7f8a08121b10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8a0000efc0 tx=0x7f8a0000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:32.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.310+0000 7f89ef7fe700 1 -- 172.21.15.26:0/836235686 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0000cc90 con 0x7f8a08133930 2023-10-01T07:57:32.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.310+0000 7f89ef7fe700 1 -- 172.21.15.26:0/836235686 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0000f040 con 0x7f8a08133930 2023-10-01T07:57:32.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.310+0000 7f89ef7fe700 1 -- 172.21.15.26:0/836235686 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a00009e60 con 0x7f8a08133930 2023-10-01T07:57:32.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.310+0000 7f8a0d133700 1 -- 172.21.15.26:0/836235686 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f8009550 con 0x7f8a08133930 2023-10-01T07:57:32.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.310+0000 7f8a0d133700 1 -- 172.21.15.26:0/836235686 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a080a0410 con 0x7f8a08133930 2023-10-01T07:57:32.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.311+0000 7f89ef7fe700 1 -- 172.21.15.26:0/836235686 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8a00014480 con 0x7f8a08133930 2023-10-01T07:57:32.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.311+0000 7f8a0d133700 1 -- 172.21.15.26:0/836235686 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a081247a0 con 0x7f8a08133930 2023-10-01T07:57:32.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.312+0000 7f89ef7fe700 1 -- 172.21.15.26:0/836235686 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8a00040180 con 0x7f8a08133930 2023-10-01T07:57:32.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.321+0000 7f89ef7fe700 1 -- 172.21.15.26:0/836235686 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8a081247a0 con 0x7f8a08133930 2023-10-01T07:57:32.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.347+0000 7f2c73c99700 1 Processor -- start 2023-10-01T07:57:32.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.347+0000 7f2c73c99700 1 -- start start 2023-10-01T07:57:32.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.348+0000 7f2c73c99700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c6c06a770 0x7f2c6c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:32.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.348+0000 7f2c73c99700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c6c06b080 0x7f2c6c131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:32.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.348+0000 7f2c73c99700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2c6c131b40 0x7f2c6c131fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:32.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.348+0000 7f2c73c99700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c6c09ece0 con 0x7f2c6c131b40 2023-10-01T07:57:32.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.348+0000 7f2c73c99700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c09e760 con 0x7f2c6c06a770 2023-10-01T07:57:32.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.348+0000 7f2c73c99700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c09e040 con 0x7f2c6c06b080 2023-10-01T07:57:32.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.348+0000 7f2c71a35700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c6c06a770 0x7f2c6c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:32.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.348+0000 7f2c71a35700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c6c06a770 0x7f2c6c06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34326/0 (socket says 172.21.15.26:34326) 2023-10-01T07:57:32.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.348+0000 7f2c71a35700 1 -- 172.21.15.26:0/672426282 learned_addr learned my addr 172.21.15.26:0/672426282 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:32.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.348+0000 7f2c71234700 1 --2- 172.21.15.26:0/672426282 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c6c06b080 0x7f2c6c131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:32.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.348+0000 7f2c72236700 1 --2- 172.21.15.26:0/672426282 >> v2:172.21.15.26:3300/0 conn(0x7f2c6c131b40 0x7f2c6c131fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:32.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.348+0000 7f2c71a35700 1 -- 172.21.15.26:0/672426282 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c6c06b080 msgr2=0x7f2c6c131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:32.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.348+0000 7f2c71a35700 1 --2- 172.21.15.26:0/672426282 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c6c06b080 0x7f2c6c131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.348+0000 7f2c71a35700 1 -- 172.21.15.26:0/672426282 >> v2:172.21.15.26:3300/0 conn(0x7f2c6c131b40 msgr2=0x7f2c6c131fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:32.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.348+0000 7f2c71a35700 1 --2- 172.21.15.26:0/672426282 >> v2:172.21.15.26:3300/0 conn(0x7f2c6c131b40 0x7f2c6c131fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.348+0000 7f2c71a35700 1 -- 172.21.15.26:0/672426282 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6c09f630 con 0x7f2c6c06a770 2023-10-01T07:57:32.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.348+0000 7f2c71234700 1 --2- 172.21.15.26:0/672426282 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c6c06b080 0x7f2c6c131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:32.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.348+0000 7f2c72236700 1 --2- 172.21.15.26:0/672426282 >> v2:172.21.15.26:3300/0 conn(0x7f2c6c131b40 0x7f2c6c131fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:32.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.349+0000 7f2c71a35700 1 --2- 172.21.15.26:0/672426282 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c6c06a770 0x7f2c6c06ab40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2c680098f0 tx=0x7f2c68009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34b02bc26151e711 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:32.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.349+0000 7f2c70a33700 1 -- 172.21.15.26:0/672426282 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c68011830 con 0x7f2c6c06a770 2023-10-01T07:57:32.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.349+0000 7f2c70a33700 1 -- 172.21.15.26:0/672426282 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c68011990 con 0x7f2c6c06a770 2023-10-01T07:57:32.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.349+0000 7f2c70a33700 1 -- 172.21.15.26:0/672426282 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c68011d20 con 0x7f2c6c06a770 2023-10-01T07:57:32.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.350+0000 7f2c73c99700 1 -- 172.21.15.26:0/672426282 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c6c06a770 msgr2=0x7f2c6c06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:32.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.350+0000 7f2c73c99700 1 --2- 172.21.15.26:0/672426282 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c6c06a770 0x7f2c6c06ab40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2c680098f0 tx=0x7f2c68009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:32.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.350+0000 7f2c73c99700 1 -- 172.21.15.26:0/672426282 shutdown_connections 2023-10-01T07:57:32.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.350+0000 7f2c73c99700 1 --2- 172.21.15.26:0/672426282 >> v2:172.21.15.26:3300/0 conn(0x7f2c6c131b40 0x7f2c6c131fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.350+0000 7f2c73c99700 1 --2- 172.21.15.26:0/672426282 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c6c06a770 0x7f2c6c06ab40 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.350+0000 7f2c73c99700 1 --2- 172.21.15.26:0/672426282 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c6c06b080 0x7f2c6c131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.350+0000 7f2c73c99700 1 -- 172.21.15.26:0/672426282 >> 172.21.15.26:0/672426282 conn(0x7f2c6c066f50 msgr2=0x7f2c6c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:32.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.350+0000 7f2c73c99700 1 -- 172.21.15.26:0/672426282 shutdown_connections 2023-10-01T07:57:32.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.350+0000 7f2c73c99700 1 -- 172.21.15.26:0/672426282 wait complete. 2023-10-01T07:57:32.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.351+0000 7f2c73c99700 1 Processor -- start 2023-10-01T07:57:32.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.351+0000 7f2c73c99700 1 -- start start 2023-10-01T07:57:32.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.352+0000 7f2c73c99700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c6c06a770 0x7f2c6c120110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:32.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.352+0000 7f2c73c99700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c6c06b080 0x7f2c6c120650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:32.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.352+0000 7f2c73c99700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c6c131b40 0x7f2c6c120b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:32.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.352+0000 7f2c73c99700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c1233c0 con 0x7f2c6c06b080 2023-10-01T07:57:32.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.352+0000 7f2c73c99700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c0a38b0 con 0x7f2c6c06a770 2023-10-01T07:57:32.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.352+0000 7f2c73c99700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c122b40 con 0x7f2c6c131b40 2023-10-01T07:57:32.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.352+0000 7f2c71a35700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c6c06a770 0x7f2c6c120110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:32.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.352+0000 7f2c71a35700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c6c06a770 0x7f2c6c120110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34340/0 (socket says 172.21.15.26:34340) 2023-10-01T07:57:32.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.352+0000 7f2c71a35700 1 -- 172.21.15.26:0/1422859045 learned_addr learned my addr 172.21.15.26:0/1422859045 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:32.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.352+0000 7f2c71234700 1 --2- 172.21.15.26:0/1422859045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c6c06b080 0x7f2c6c120650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:32.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.352+0000 7f2c72236700 1 --2- 172.21.15.26:0/1422859045 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c6c131b40 0x7f2c6c120b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:32.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.352+0000 7f2c71a35700 1 -- 172.21.15.26:0/1422859045 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c6c131b40 msgr2=0x7f2c6c120b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:32.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.352+0000 7f2c71a35700 1 --2- 172.21.15.26:0/1422859045 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c6c131b40 0x7f2c6c120b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.352+0000 7f2c71a35700 1 -- 172.21.15.26:0/1422859045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c6c06b080 msgr2=0x7f2c6c120650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:32.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.352+0000 7f2c71a35700 1 --2- 172.21.15.26:0/1422859045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c6c06b080 0x7f2c6c120650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.352+0000 7f2c71a35700 1 -- 172.21.15.26:0/1422859045 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c5c0094a0 con 0x7f2c6c06a770 2023-10-01T07:57:32.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.353+0000 7f2c71a35700 1 --2- 172.21.15.26:0/1422859045 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c6c06a770 0x7f2c6c120110 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2c68000c00 tx=0x7f2c68004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:32.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.353+0000 7f2c627fc700 1 -- 172.21.15.26:0/1422859045 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c68004240 con 0x7f2c6c06a770 2023-10-01T07:57:32.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.353+0000 7f2c627fc700 1 -- 172.21.15.26:0/1422859045 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6801f070 con 0x7f2c6c06a770 2023-10-01T07:57:32.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.353+0000 7f2c73c99700 1 -- 172.21.15.26:0/1422859045 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c64009a70 con 0x7f2c6c06a770 2023-10-01T07:57:32.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.353+0000 7f2c627fc700 1 -- 172.21.15.26:0/1422859045 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c680045c0 con 0x7f2c6c06a770 2023-10-01T07:57:32.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.353+0000 7f2c73c99700 1 -- 172.21.15.26:0/1422859045 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c68009550 con 0x7f2c6c06a770 2023-10-01T07:57:32.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.354+0000 7f2c627fc700 1 -- 172.21.15.26:0/1422859045 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2c68021030 con 0x7f2c6c06a770 2023-10-01T07:57:32.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.354+0000 7f2c627fc700 1 -- 172.21.15.26:0/1422859045 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2c68040840 con 0x7f2c6c06a770 2023-10-01T07:57:32.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.354+0000 7f2c73c99700 1 -- 172.21.15.26:0/1422859045 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c6c074ea0 con 0x7f2c6c06a770 2023-10-01T07:57:32.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.359+0000 7f2c627fc700 1 -- 172.21.15.26:0/1422859045 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2c6801a450 con 0x7f2c6c06a770 2023-10-01T07:57:32.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.501+0000 7f1e38333700 1 -- 172.21.15.26:0/182818909 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1e301a87b0 con 0x7f1e3009d6f0 2023-10-01T07:57:32.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.501+0000 7f1e26ffd700 1 -- 172.21.15.26:0/182818909 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e2c01ba00 con 0x7f1e3009d6f0 2023-10-01T07:57:32.502 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:32.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.503+0000 7f1e38333700 1 -- 172.21.15.26:0/182818909 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e3009d6f0 msgr2=0x7f1e301a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:32.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.503+0000 7f1e38333700 1 --2- 172.21.15.26:0/182818909 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e3009d6f0 0x7f1e301a4d50 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c00e900 tx=0x7f1e2c00ec10 comp rx=0 tx=0).stop 2023-10-01T07:57:32.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.504+0000 7f1e38333700 1 -- 172.21.15.26:0/182818909 shutdown_connections 2023-10-01T07:57:32.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.504+0000 7f1e38333700 1 --2- 172.21.15.26:0/182818909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e3009e410 0x7f1e301a57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.504+0000 7f1e38333700 1 --2- 172.21.15.26:0/182818909 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e3009d6f0 0x7f1e301a4d50 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.504+0000 7f1e38333700 1 --2- 172.21.15.26:0/182818909 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e3009e000 0x7f1e301a5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.504+0000 7f1e38333700 1 -- 172.21.15.26:0/182818909 >> 172.21.15.26:0/182818909 conn(0x7f1e30066f50 msgr2=0x7f1e301b9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:32.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.504+0000 7f1e38333700 1 -- 172.21.15.26:0/182818909 shutdown_connections 2023-10-01T07:57:32.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.504+0000 7f1e38333700 1 -- 172.21.15.26:0/182818909 wait complete. 2023-10-01T07:57:32.518 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:32.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.529+0000 7f8a0d133700 1 -- 172.21.15.26:0/836235686 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8a081247a0 con 0x7f8a08133930 2023-10-01T07:57:32.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.529+0000 7f89ef7fe700 1 -- 172.21.15.26:0/836235686 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8a081247a0 con 0x7f8a08133930 2023-10-01T07:57:32.530 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:32.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.532+0000 7f8a0d133700 1 -- 172.21.15.26:0/836235686 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8a08133930 msgr2=0x7f8a08121b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:32.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.532+0000 7f8a0d133700 1 --2- 172.21.15.26:0/836235686 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8a08133930 0x7f8a08121b10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8a0000efc0 tx=0x7f8a0000c3a0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.532+0000 7f8a0d133700 1 -- 172.21.15.26:0/836235686 shutdown_connections 2023-10-01T07:57:32.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.532+0000 7f8a0d133700 1 --2- 172.21.15.26:0/836235686 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8a08133930 0x7f8a08121b10 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.532+0000 7f8a0d133700 1 --2- 172.21.15.26:0/836235686 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8a0809d630 0x7f8a08121090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.532+0000 7f8a0d133700 1 --2- 172.21.15.26:0/836235686 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a080a0a30 0x7f8a081215d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.532+0000 7f8a0d133700 1 -- 172.21.15.26:0/836235686 >> 172.21.15.26:0/836235686 conn(0x7f8a080a3050 msgr2=0x7f8a0809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:32.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.532+0000 7f8a0d133700 1 -- 172.21.15.26:0/836235686 shutdown_connections 2023-10-01T07:57:32.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.532+0000 7f8a0d133700 1 -- 172.21.15.26:0/836235686 wait complete. 2023-10-01T07:57:32.546 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:32.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.565+0000 7f2c73c99700 1 -- 172.21.15.26:0/1422859045 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2c6c071e60 con 0x7f2c6c06a770 2023-10-01T07:57:32.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.566+0000 7f2c627fc700 1 -- 172.21.15.26:0/1422859045 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2c680233d0 con 0x7f2c6c06a770 2023-10-01T07:57:32.567 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:32.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.568+0000 7f2c73c99700 1 -- 172.21.15.26:0/1422859045 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c6c06a770 msgr2=0x7f2c6c120110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:32.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.568+0000 7f2c73c99700 1 --2- 172.21.15.26:0/1422859045 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c6c06a770 0x7f2c6c120110 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2c68000c00 tx=0x7f2c68004750 comp rx=0 tx=0).stop 2023-10-01T07:57:32.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.568+0000 7f2c73c99700 1 -- 172.21.15.26:0/1422859045 shutdown_connections 2023-10-01T07:57:32.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.568+0000 7f2c73c99700 1 --2- 172.21.15.26:0/1422859045 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c6c131b40 0x7f2c6c120b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.568+0000 7f2c73c99700 1 --2- 172.21.15.26:0/1422859045 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c6c06a770 0x7f2c6c120110 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.568+0000 7f2c73c99700 1 --2- 172.21.15.26:0/1422859045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c6c06b080 0x7f2c6c120650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.568+0000 7f2c73c99700 1 -- 172.21.15.26:0/1422859045 >> 172.21.15.26:0/1422859045 conn(0x7f2c6c066f50 msgr2=0x7f2c6c06fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:32.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.568+0000 7f2c73c99700 1 -- 172.21.15.26:0/1422859045 shutdown_connections 2023-10-01T07:57:32.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.568+0000 7f2c73c99700 1 -- 172.21.15.26:0/1422859045 wait complete. 2023-10-01T07:57:32.582 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:32.601 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:32.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.761+0000 7f33b3b1c700 1 Processor -- start 2023-10-01T07:57:32.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.761+0000 7f33b3b1c700 1 -- start start 2023-10-01T07:57:32.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.761+0000 7f33b3b1c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33ac09d6f0 0x7f33ac09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:32.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.761+0000 7f33b3b1c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f33ac09e000 0x7f33ac130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:32.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.762+0000 7f33b3b1c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33ac09e410 0x7f33ac130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:32.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.762+0000 7f33b3b1c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33ac09f520 con 0x7f33ac09e000 2023-10-01T07:57:32.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.762+0000 7f33b3b1c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac09f130 con 0x7f33ac09d6f0 2023-10-01T07:57:32.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.762+0000 7f33b3b1c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac09e930 con 0x7f33ac09e410 2023-10-01T07:57:32.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.762+0000 7f33b10b7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f33ac09e000 0x7f33ac130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:32.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.762+0000 7f33b18b8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33ac09d6f0 0x7f33ac09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:32.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.762+0000 7f33b20b9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33ac09e410 0x7f33ac130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:32.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.762+0000 7f33b10b7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f33ac09e000 0x7f33ac130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59894/0 (socket says 172.21.15.26:59894) 2023-10-01T07:57:32.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.762+0000 7f33b10b7700 1 -- 172.21.15.26:0/1298480597 learned_addr learned my addr 172.21.15.26:0/1298480597 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:32.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.762+0000 7f33b20b9700 1 -- 172.21.15.26:0/1298480597 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33ac09d6f0 msgr2=0x7f33ac09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:32.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.762+0000 7f33b20b9700 1 --2- 172.21.15.26:0/1298480597 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33ac09d6f0 0x7f33ac09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.762+0000 7f33b20b9700 1 -- 172.21.15.26:0/1298480597 >> v2:172.21.15.26:3300/0 conn(0x7f33ac09e000 msgr2=0x7f33ac130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:32.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.762+0000 7f33b20b9700 1 --2- 172.21.15.26:0/1298480597 >> v2:172.21.15.26:3300/0 conn(0x7f33ac09e000 0x7f33ac130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.762+0000 7f33b20b9700 1 -- 172.21.15.26:0/1298480597 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ac09b2d0 con 0x7f33ac09e410 2023-10-01T07:57:32.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.762+0000 7f33b10b7700 1 --2- 172.21.15.26:0/1298480597 >> v2:172.21.15.26:3300/0 conn(0x7f33ac09e000 0x7f33ac130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:32.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.762+0000 7f33b18b8700 1 --2- 172.21.15.26:0/1298480597 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33ac09d6f0 0x7f33ac09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:32.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.762+0000 7f33b20b9700 1 --2- 172.21.15.26:0/1298480597 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33ac09e410 0x7f33ac130ba0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f33a400bfd0 tx=0x7f33a400d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94993cee5e7c0c69 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:32.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.762+0000 7f33b08b6700 1 -- 172.21.15.26:0/1298480597 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a4010070 con 0x7f33ac09e410 2023-10-01T07:57:32.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.762+0000 7f33b08b6700 1 -- 172.21.15.26:0/1298480597 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a400b2e0 con 0x7f33ac09e410 2023-10-01T07:57:32.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.762+0000 7f33b08b6700 1 -- 172.21.15.26:0/1298480597 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a400dc30 con 0x7f33ac09e410 2023-10-01T07:57:32.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.763+0000 7f33b3b1c700 1 -- 172.21.15.26:0/1298480597 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33ac09e410 msgr2=0x7f33ac130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:32.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.763+0000 7f33b3b1c700 1 --2- 172.21.15.26:0/1298480597 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33ac09e410 0x7f33ac130ba0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f33a400bfd0 tx=0x7f33a400d330 comp rx=0 tx=0).stop 2023-10-01T07:57:32.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.763+0000 7f33b3b1c700 1 -- 172.21.15.26:0/1298480597 shutdown_connections 2023-10-01T07:57:32.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.763+0000 7f33b3b1c700 1 --2- 172.21.15.26:0/1298480597 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33ac09e410 0x7f33ac130ba0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.763+0000 7f33b3b1c700 1 --2- 172.21.15.26:0/1298480597 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33ac09d6f0 0x7f33ac09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.763+0000 7f33b3b1c700 1 --2- 172.21.15.26:0/1298480597 >> v2:172.21.15.26:3300/0 conn(0x7f33ac09e000 0x7f33ac130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.763+0000 7f33b3b1c700 1 -- 172.21.15.26:0/1298480597 >> 172.21.15.26:0/1298480597 conn(0x7f33ac066f50 msgr2=0x7f33ac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:32.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.763+0000 7f33b3b1c700 1 -- 172.21.15.26:0/1298480597 shutdown_connections 2023-10-01T07:57:32.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.763+0000 7f33b3b1c700 1 -- 172.21.15.26:0/1298480597 wait complete. 2023-10-01T07:57:32.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.764+0000 7f33b3b1c700 1 Processor -- start 2023-10-01T07:57:32.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.764+0000 7f33b3b1c700 1 -- start start 2023-10-01T07:57:32.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.765+0000 7f33b3b1c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33ac09d6f0 0x7f33ac1221b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:32.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.765+0000 7f33b3b1c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33ac09e000 0x7f33ac1226f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:32.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.765+0000 7f33b3b1c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33ac09e410 0x7f33ac122c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:32.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.765+0000 7f33b3b1c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac1243e0 con 0x7f33ac09e410 2023-10-01T07:57:32.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.765+0000 7f33b3b1c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac09c770 con 0x7f33ac09e000 2023-10-01T07:57:32.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.765+0000 7f33b3b1c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac1235f0 con 0x7f33ac09d6f0 2023-10-01T07:57:32.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.765+0000 7f33b10b7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33ac09e000 0x7f33ac1226f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:32.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.765+0000 7f33b18b8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33ac09d6f0 0x7f33ac1221b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:32.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.765+0000 7f33b10b7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33ac09e000 0x7f33ac1226f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34366/0 (socket says 172.21.15.26:34366) 2023-10-01T07:57:32.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.765+0000 7f33b10b7700 1 -- 172.21.15.26:0/2275766165 learned_addr learned my addr 172.21.15.26:0/2275766165 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:32.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.765+0000 7f33b20b9700 1 --2- 172.21.15.26:0/2275766165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33ac09e410 0x7f33ac122c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:32.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.765+0000 7f33b10b7700 1 -- 172.21.15.26:0/2275766165 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33ac09d6f0 msgr2=0x7f33ac1221b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:32.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.765+0000 7f33b10b7700 1 --2- 172.21.15.26:0/2275766165 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33ac09d6f0 0x7f33ac1221b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.765+0000 7f33b10b7700 1 -- 172.21.15.26:0/2275766165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33ac09e410 msgr2=0x7f33ac122c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:32.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.765+0000 7f33b10b7700 1 --2- 172.21.15.26:0/2275766165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33ac09e410 0x7f33ac122c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.765+0000 7f33b10b7700 1 -- 172.21.15.26:0/2275766165 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a00094a0 con 0x7f33ac09e000 2023-10-01T07:57:32.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.765+0000 7f33b18b8700 1 --2- 172.21.15.26:0/2275766165 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33ac09d6f0 0x7f33ac1221b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:32.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.765+0000 7f33b10b7700 1 --2- 172.21.15.26:0/2275766165 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33ac09e000 0x7f33ac1226f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f33a800ec10 tx=0x7f33a800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:32.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.766+0000 7f339e7fc700 1 -- 172.21.15.26:0/2275766165 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a800c850 con 0x7f33ac09e000 2023-10-01T07:57:32.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.766+0000 7f339e7fc700 1 -- 172.21.15.26:0/2275766165 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a800c9b0 con 0x7f33ac09e000 2023-10-01T07:57:32.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.766+0000 7f339e7fc700 1 -- 172.21.15.26:0/2275766165 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a800cd60 con 0x7f33ac09e000 2023-10-01T07:57:32.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.766+0000 7f33b3b1c700 1 -- 172.21.15.26:0/2275766165 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a8009550 con 0x7f33ac09e000 2023-10-01T07:57:32.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.766+0000 7f33b3b1c700 1 -- 172.21.15.26:0/2275766165 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a400bc80 con 0x7f33ac09e000 2023-10-01T07:57:32.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.767+0000 7f33b3b1c700 1 -- 172.21.15.26:0/2275766165 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33ac074ea0 con 0x7f33ac09e000 2023-10-01T07:57:32.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.767+0000 7f339e7fc700 1 -- 172.21.15.26:0/2275766165 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f33a8026480 con 0x7f33ac09e000 2023-10-01T07:57:32.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.767+0000 7f339e7fc700 1 -- 172.21.15.26:0/2275766165 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f33a803ff70 con 0x7f33ac09e000 2023-10-01T07:57:32.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.771+0000 7f339e7fc700 1 -- 172.21.15.26:0/2275766165 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f33a8024350 con 0x7f33ac09e000 2023-10-01T07:57:32.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.979+0000 7f33b3b1c700 1 -- 172.21.15.26:0/2275766165 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f33ac1245b0 con 0x7f33ac09e000 2023-10-01T07:57:32.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.979+0000 7f339e7fc700 1 -- 172.21.15.26:0/2275766165 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f33a802b090 con 0x7f33ac09e000 2023-10-01T07:57:32.980 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:32.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.981+0000 7f33b3b1c700 1 -- 172.21.15.26:0/2275766165 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33ac09e000 msgr2=0x7f33ac1226f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:32.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.981+0000 7f33b3b1c700 1 --2- 172.21.15.26:0/2275766165 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33ac09e000 0x7f33ac1226f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f33a800ec10 tx=0x7f33a800ef20 comp rx=0 tx=0).stop 2023-10-01T07:57:32.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.982+0000 7f33b3b1c700 1 -- 172.21.15.26:0/2275766165 shutdown_connections 2023-10-01T07:57:32.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.982+0000 7f33b3b1c700 1 --2- 172.21.15.26:0/2275766165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33ac09e410 0x7f33ac122c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.982+0000 7f33b3b1c700 1 --2- 172.21.15.26:0/2275766165 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33ac09d6f0 0x7f33ac1221b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.982+0000 7f33b3b1c700 1 --2- 172.21.15.26:0/2275766165 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33ac09e000 0x7f33ac1226f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:32.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.982+0000 7f33b3b1c700 1 -- 172.21.15.26:0/2275766165 >> 172.21.15.26:0/2275766165 conn(0x7f33ac066f50 msgr2=0x7f33ac130990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:32.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.982+0000 7f33b3b1c700 1 -- 172.21.15.26:0/2275766165 shutdown_connections 2023-10-01T07:57:32.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:32.982+0000 7f33b3b1c700 1 -- 172.21.15.26:0/2275766165 wait complete. 2023-10-01T07:57:32.996 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:33.519 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:33.547 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:33.583 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:33.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.681+0000 7f2668688700 1 Processor -- start 2023-10-01T07:57:33.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.681+0000 7f2668688700 1 -- start start 2023-10-01T07:57:33.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.682+0000 7f2668688700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2660131810 0x7f2660131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:33.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.682+0000 7f2668688700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2660099a40 0x7f2660099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:33.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.682+0000 7f2668688700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f266009a850 con 0x7f266009a3b0 2023-10-01T07:57:33.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.682+0000 7f2668688700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f266009b580 con 0x7f2660099a40 2023-10-01T07:57:33.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.682+0000 7f2668688700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26601313c0 con 0x7f2660131810 2023-10-01T07:57:33.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.682+0000 7f2665c23700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2660099a40 0x7f2660099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:33.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.682+0000 7f2666424700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2660131810 0x7f2660131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:33.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.682+0000 7f2665c23700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2660099a40 0x7f2660099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56474/0 (socket says 172.21.15.26:56474) 2023-10-01T07:57:33.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.682+0000 7f2666424700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2660131810 0x7f2660131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47280/0 (socket says 172.21.15.26:47280) 2023-10-01T07:57:33.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.682+0000 7f2665c23700 1 -- 172.21.15.26:0/2484510630 learned_addr learned my addr 172.21.15.26:0/2484510630 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:33.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.682+0000 7f2665c23700 1 -- 172.21.15.26:0/2484510630 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2660131810 msgr2=0x7f2660131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:33.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.682+0000 7f2665c23700 1 --2- 172.21.15.26:0/2484510630 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2660131810 0x7f2660131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:33.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.682+0000 7f2665c23700 1 -- 172.21.15.26:0/2484510630 >> v1:172.21.15.26:6789/0 conn(0x7f266009a3b0 legacy=0x7f2660138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:33.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.682+0000 7f2665c23700 1 -- 172.21.15.26:0/2484510630 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266006e8c0 con 0x7f2660099a40 2023-10-01T07:57:33.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.682+0000 7f2666424700 1 --2- 172.21.15.26:0/2484510630 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2660131810 0x7f2660131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:33.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.683+0000 7f2665c23700 1 --2- 172.21.15.26:0/2484510630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2660099a40 0x7f2660099e70 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f2650009920 tx=0x7f2650009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=512496202d671f14 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:33.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.683+0000 7f2665422700 1 -- 172.21.15.26:0/2484510630 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2650011830 con 0x7f2660099a40 2023-10-01T07:57:33.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.683+0000 7f2665422700 1 -- 172.21.15.26:0/2484510630 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2650011990 con 0x7f2660099a40 2023-10-01T07:57:33.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.683+0000 7f2665422700 1 -- 172.21.15.26:0/2484510630 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2650011d20 con 0x7f2660099a40 2023-10-01T07:57:33.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.683+0000 7f2668688700 1 -- 172.21.15.26:0/2484510630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2660099a40 msgr2=0x7f2660099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:33.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.683+0000 7f2668688700 1 --2- 172.21.15.26:0/2484510630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2660099a40 0x7f2660099e70 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f2650009920 tx=0x7f2650009c30 comp rx=0 tx=0).stop 2023-10-01T07:57:33.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.684+0000 7f2668688700 1 -- 172.21.15.26:0/2484510630 shutdown_connections 2023-10-01T07:57:33.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.684+0000 7f2668688700 1 --2- 172.21.15.26:0/2484510630 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2660131810 0x7f2660131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:33.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.684+0000 7f2668688700 1 --2- 172.21.15.26:0/2484510630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2660099a40 0x7f2660099e70 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:33.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.684+0000 7f2668688700 1 -- 172.21.15.26:0/2484510630 >> 172.21.15.26:0/2484510630 conn(0x7f26600a2aa0 msgr2=0x7f26600a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:33.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.684+0000 7f2668688700 1 -- 172.21.15.26:0/2484510630 shutdown_connections 2023-10-01T07:57:33.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.684+0000 7f2668688700 1 -- 172.21.15.26:0/2484510630 wait complete. 2023-10-01T07:57:33.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.685+0000 7f2668688700 1 Processor -- start 2023-10-01T07:57:33.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.685+0000 7f2668688700 1 -- start start 2023-10-01T07:57:33.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.686+0000 7f2668688700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2660099a40 0x7f266011b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:33.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.686+0000 7f2668688700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f266009a3b0 0x7f266011bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:33.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.686+0000 7f2668688700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2660131810 0x7f266011c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:33.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.686+0000 7f2668688700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266011cc20 con 0x7f2660131810 2023-10-01T07:57:33.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.686+0000 7f2668688700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f266011d9b0 con 0x7f2660099a40 2023-10-01T07:57:33.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.686+0000 7f2668688700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f266011f270 con 0x7f266009a3b0 2023-10-01T07:57:33.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.686+0000 7f2665c23700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f266009a3b0 0x7f266011bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:33.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.686+0000 7f2666424700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2660099a40 0x7f266011b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:33.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.686+0000 7f2665c23700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f266009a3b0 0x7f266011bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55318/0 (socket says 172.21.15.26:55318) 2023-10-01T07:57:33.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.686+0000 7f2665c23700 1 -- 172.21.15.26:0/3745329936 learned_addr learned my addr 172.21.15.26:0/3745329936 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:33.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.686+0000 7f2666c25700 1 --2- 172.21.15.26:0/3745329936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2660131810 0x7f266011c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:33.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.687+0000 7f2665c23700 1 -- 172.21.15.26:0/3745329936 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2660099a40 msgr2=0x7f266011b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:33.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.687+0000 7f2665c23700 1 --2- 172.21.15.26:0/3745329936 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2660099a40 0x7f266011b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:33.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.687+0000 7f2665c23700 1 -- 172.21.15.26:0/3745329936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2660131810 msgr2=0x7f266011c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:33.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.687+0000 7f2665c23700 1 --2- 172.21.15.26:0/3745329936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2660131810 0x7f266011c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:33.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.687+0000 7f2665c23700 1 -- 172.21.15.26:0/3745329936 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f265c00d940 con 0x7f266009a3b0 2023-10-01T07:57:33.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.687+0000 7f2665c23700 1 --2- 172.21.15.26:0/3745329936 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f266009a3b0 0x7f266011bc90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2650009c70 tx=0x7f2650004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:33.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.687+0000 7f2656ffd700 1 -- 172.21.15.26:0/3745329936 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2650004300 con 0x7f266009a3b0 2023-10-01T07:57:33.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.687+0000 7f2656ffd700 1 -- 172.21.15.26:0/3745329936 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265001f070 con 0x7f266009a3b0 2023-10-01T07:57:33.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.687+0000 7f2656ffd700 1 -- 172.21.15.26:0/3745329936 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26500036a0 con 0x7f266009a3b0 2023-10-01T07:57:33.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.687+0000 7f2668688700 1 -- 172.21.15.26:0/3745329936 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2650009550 con 0x7f266009a3b0 2023-10-01T07:57:33.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.687+0000 7f2668688700 1 -- 172.21.15.26:0/3745329936 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f266006eb00 con 0x7f266009a3b0 2023-10-01T07:57:33.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.688+0000 7f2656ffd700 1 -- 172.21.15.26:0/3745329936 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2650021030 con 0x7f266009a3b0 2023-10-01T07:57:33.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.688+0000 7f2668688700 1 -- 172.21.15.26:0/3745329936 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2660074ea0 con 0x7f266009a3b0 2023-10-01T07:57:33.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.688+0000 7f2656ffd700 1 -- 172.21.15.26:0/3745329936 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f26500408c0 con 0x7f266009a3b0 2023-10-01T07:57:33.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.693+0000 7f2656ffd700 1 -- 172.21.15.26:0/3745329936 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f26500239c0 con 0x7f266009a3b0 2023-10-01T07:57:33.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.717+0000 7fdd138f4700 1 Processor -- start 2023-10-01T07:57:33.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.717+0000 7fdd138f4700 1 -- start start 2023-10-01T07:57:33.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.718+0000 7fdd138f4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd0c09e1d0 0x7fdd0c138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:33.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.718+0000 7fdd138f4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdd0c139170 0x7fdd0c13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:33.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.718+0000 7fdd138f4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd0c09b120 con 0x7fdd0c09d6f0 2023-10-01T07:57:33.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.718+0000 7fdd138f4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd0c06b460 con 0x7fdd0c139170 2023-10-01T07:57:33.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.718+0000 7fdd138f4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c09a7e0 con 0x7fdd0c09e1d0 2023-10-01T07:57:33.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.718+0000 7fdd11e91700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdd0c139170 0x7fdd0c13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:33.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.718+0000 7fdd10e8f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd0c09e1d0 0x7fdd0c138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:33.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.718+0000 7fdd11e91700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdd0c139170 0x7fdd0c13b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56482/0 (socket says 172.21.15.26:56482) 2023-10-01T07:57:33.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.718+0000 7fdd11e91700 1 -- 172.21.15.26:0/4084084591 learned_addr learned my addr 172.21.15.26:0/4084084591 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:33.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.718+0000 7fdd11e91700 1 -- 172.21.15.26:0/4084084591 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd0c09e1d0 msgr2=0x7fdd0c138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:33.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.718+0000 7fdd11e91700 1 --2- 172.21.15.26:0/4084084591 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd0c09e1d0 0x7fdd0c138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:33.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.718+0000 7fdd11e91700 1 -- 172.21.15.26:0/4084084591 >> v1:172.21.15.26:6789/0 conn(0x7fdd0c09d6f0 legacy=0x7fdd0c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:33.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.718+0000 7fdd11e91700 1 -- 172.21.15.26:0/4084084591 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0c09a500 con 0x7fdd0c139170 2023-10-01T07:57:33.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.718+0000 7fdd03fff700 1 -- 172.21.15.26:0/4084084591 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3537906339 0 0) 0x7fdd0c09b120 con 0x7fdd0c09d6f0 2023-10-01T07:57:33.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.718+0000 7fdd10e8f700 1 --2- 172.21.15.26:0/4084084591 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd0c09e1d0 0x7fdd0c138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:33.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.719+0000 7fdd11e91700 1 --2- 172.21.15.26:0/4084084591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd0c139170 0x7fdd0c13b550 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fdd04009e50 tx=0x7fdd0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4943cdcae27fd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:33.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.719+0000 7fdd03fff700 1 -- 172.21.15.26:0/4084084591 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0400e070 con 0x7fdd0c139170 2023-10-01T07:57:33.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.719+0000 7fdd03fff700 1 -- 172.21.15.26:0/4084084591 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0400b910 con 0x7fdd0c139170 2023-10-01T07:57:33.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.719+0000 7fdd03fff700 1 -- 172.21.15.26:0/4084084591 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0400bcc0 con 0x7fdd0c139170 2023-10-01T07:57:33.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.720+0000 7fdd138f4700 1 -- 172.21.15.26:0/4084084591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd0c139170 msgr2=0x7fdd0c13b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:33.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.720+0000 7fdd138f4700 1 --2- 172.21.15.26:0/4084084591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd0c139170 0x7fdd0c13b550 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fdd04009e50 tx=0x7fdd0400b330 comp rx=0 tx=0).stop 2023-10-01T07:57:33.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.720+0000 7fdd138f4700 1 -- 172.21.15.26:0/4084084591 shutdown_connections 2023-10-01T07:57:33.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.720+0000 7fdd138f4700 1 --2- 172.21.15.26:0/4084084591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd0c139170 0x7fdd0c13b550 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:33.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.720+0000 7fdd138f4700 1 --2- 172.21.15.26:0/4084084591 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd0c09e1d0 0x7fdd0c138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:33.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.720+0000 7fdd138f4700 1 -- 172.21.15.26:0/4084084591 >> 172.21.15.26:0/4084084591 conn(0x7fdd0c066f50 msgr2=0x7fdd0c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:33.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.720+0000 7fdd138f4700 1 -- 172.21.15.26:0/4084084591 shutdown_connections 2023-10-01T07:57:33.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.720+0000 7fdd138f4700 1 -- 172.21.15.26:0/4084084591 wait complete. 2023-10-01T07:57:33.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.721+0000 7fdd138f4700 1 Processor -- start 2023-10-01T07:57:33.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.721+0000 7fdd138f4700 1 -- start start 2023-10-01T07:57:33.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.721+0000 7fdd138f4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd0c09d6f0 0x7fdd0c1207a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:33.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.721+0000 7fdd138f4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd0c09e1d0 0x7fdd0c120ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:33.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.721+0000 7fdd138f4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd0c139170 0x7fdd0c121220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:33.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.721+0000 7fdd138f4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c1229e0 con 0x7fdd0c09d6f0 2023-10-01T07:57:33.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.721+0000 7fdd138f4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c1224c0 con 0x7fdd0c09e1d0 2023-10-01T07:57:33.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.721+0000 7fdd138f4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c123fe0 con 0x7fdd0c139170 2023-10-01T07:57:33.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.721+0000 7fdd10e8f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd0c09e1d0 0x7fdd0c120ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:33.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.721+0000 7fdd11690700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd0c09d6f0 0x7fdd0c1207a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:33.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.721+0000 7fdd10e8f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd0c09e1d0 0x7fdd0c120ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47298/0 (socket says 172.21.15.26:47298) 2023-10-01T07:57:33.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.721+0000 7fdd10e8f700 1 -- 172.21.15.26:0/401711800 learned_addr learned my addr 172.21.15.26:0/401711800 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:33.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.721+0000 7fdd11e91700 1 --2- 172.21.15.26:0/401711800 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd0c139170 0x7fdd0c121220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:33.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.722+0000 7fdd11690700 1 -- 172.21.15.26:0/401711800 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd0c139170 msgr2=0x7fdd0c121220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:33.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.722+0000 7fdd11690700 1 --2- 172.21.15.26:0/401711800 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd0c139170 0x7fdd0c121220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:33.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.722+0000 7fdd11690700 1 -- 172.21.15.26:0/401711800 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd0c09e1d0 msgr2=0x7fdd0c120ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:33.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.722+0000 7fdd11690700 1 --2- 172.21.15.26:0/401711800 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd0c09e1d0 0x7fdd0c120ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:33.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.722+0000 7fdd11690700 1 -- 172.21.15.26:0/401711800 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcfc0094a0 con 0x7fdd0c09d6f0 2023-10-01T07:57:33.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.722+0000 7fdd11e91700 1 --2- 172.21.15.26:0/401711800 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd0c139170 0x7fdd0c121220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:33.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.722+0000 7fdd10e8f700 1 --2- 172.21.15.26:0/401711800 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd0c09e1d0 0x7fdd0c120ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:33.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.722+0000 7fdd11690700 1 --2- 172.21.15.26:0/401711800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd0c09d6f0 0x7fdd0c1207a0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fdd0800c430 tx=0x7fdd0800c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:33.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.722+0000 7fdd01ffb700 1 -- 172.21.15.26:0/401711800 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd080054e0 con 0x7fdd0c09d6f0 2023-10-01T07:57:33.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.722+0000 7fdd01ffb700 1 -- 172.21.15.26:0/401711800 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0800ce40 con 0x7fdd0c09d6f0 2023-10-01T07:57:33.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.722+0000 7fdd01ffb700 1 -- 172.21.15.26:0/401711800 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd080038c0 con 0x7fdd0c09d6f0 2023-10-01T07:57:33.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.722+0000 7fdd138f4700 1 -- 172.21.15.26:0/401711800 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd04009b30 con 0x7fdd0c09d6f0 2023-10-01T07:57:33.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.723+0000 7fdd138f4700 1 -- 172.21.15.26:0/401711800 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd0c122ba0 con 0x7fdd0c09d6f0 2023-10-01T07:57:33.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.723+0000 7fdd01ffb700 1 -- 172.21.15.26:0/401711800 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdd08003a20 con 0x7fdd0c09d6f0 2023-10-01T07:57:33.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.723+0000 7fdd01ffb700 1 -- 172.21.15.26:0/401711800 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdd0803e9c0 con 0x7fdd0c09d6f0 2023-10-01T07:57:33.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.724+0000 7fdd138f4700 1 -- 172.21.15.26:0/401711800 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd0c123c00 con 0x7fdd0c09d6f0 2023-10-01T07:57:33.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.733+0000 7fdd01ffb700 1 -- 172.21.15.26:0/401711800 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdd08017080 con 0x7fdd0c09d6f0 2023-10-01T07:57:33.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.753+0000 7ff6e257e700 1 Processor -- start 2023-10-01T07:57:33.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.753+0000 7ff6e257e700 1 -- start start 2023-10-01T07:57:33.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.753+0000 7ff6e257e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff6dc09f330 0x7ff6dc138ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:33.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.753+0000 7ff6e257e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff6dc1393e0 0x7ff6dc13b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:33.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.753+0000 7ff6e257e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6dc06bf30 con 0x7ff6dc09e850 2023-10-01T07:57:33.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.753+0000 7ff6e257e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6dc09ffb0 con 0x7ff6dc1393e0 2023-10-01T07:57:33.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.753+0000 7ff6e257e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc06cb10 con 0x7ff6dc09f330 2023-10-01T07:57:33.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.754+0000 7ff6db7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff6dc09f330 0x7ff6dc138ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:33.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.754+0000 7ff6e0b1b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff6dc1393e0 0x7ff6dc13b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:33.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.754+0000 7ff6e0b1b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff6dc1393e0 0x7ff6dc13b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56492/0 (socket says 172.21.15.26:56492) 2023-10-01T07:57:33.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.754+0000 7ff6db7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff6dc09f330 0x7ff6dc138ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47300/0 (socket says 172.21.15.26:47300) 2023-10-01T07:57:33.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.754+0000 7ff6dbfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff6dc09e850 0x7ff6dc09ec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35260/0 (socket says 172.21.15.26:35260) 2023-10-01T07:57:33.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.754+0000 7ff6e0b1b700 1 -- 172.21.15.26:0/2998581519 learned_addr learned my addr 172.21.15.26:0/2998581519 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:33.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.754+0000 7ff6daffd700 1 -- 172.21.15.26:0/2998581519 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 984582843 0 0) 0x7ff6dc06bf30 con 0x7ff6dc09e850 2023-10-01T07:57:33.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.754+0000 7ff6db7fe700 1 -- 172.21.15.26:0/2998581519 >> v2:172.21.15.26:3300/0 conn(0x7ff6dc1393e0 msgr2=0x7ff6dc13b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:33.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.754+0000 7ff6db7fe700 1 --2- 172.21.15.26:0/2998581519 >> v2:172.21.15.26:3300/0 conn(0x7ff6dc1393e0 0x7ff6dc13b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:33.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.754+0000 7ff6db7fe700 1 -- 172.21.15.26:0/2998581519 >> v1:172.21.15.26:6789/0 conn(0x7ff6dc09e850 legacy=0x7ff6dc09ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:33.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.754+0000 7ff6db7fe700 1 -- 172.21.15.26:0/2998581519 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6dc0a0270 con 0x7ff6dc09f330 2023-10-01T07:57:33.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.754+0000 7ff6e0b1b700 1 --2- 172.21.15.26:0/2998581519 >> v2:172.21.15.26:3300/0 conn(0x7ff6dc1393e0 0x7ff6dc13b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:33.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.754+0000 7ff6db7fe700 1 --2- 172.21.15.26:0/2998581519 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff6dc09f330 0x7ff6dc138ea0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0009840 tx=0x7ff6d0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4360bcf5fadb096 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:33.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.755+0000 7ff6daffd700 1 -- 172.21.15.26:0/2998581519 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0011830 con 0x7ff6dc09f330 2023-10-01T07:57:33.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.755+0000 7ff6daffd700 1 -- 172.21.15.26:0/2998581519 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d0011990 con 0x7ff6dc09f330 2023-10-01T07:57:33.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.755+0000 7ff6daffd700 1 -- 172.21.15.26:0/2998581519 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0011d20 con 0x7ff6dc09f330 2023-10-01T07:57:33.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.755+0000 7ff6e257e700 1 -- 172.21.15.26:0/2998581519 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff6dc09f330 msgr2=0x7ff6dc138ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:33.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.755+0000 7ff6e257e700 1 --2- 172.21.15.26:0/2998581519 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff6dc09f330 0x7ff6dc138ea0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0009840 tx=0x7ff6d0009b50 comp rx=0 tx=0).stop 2023-10-01T07:57:33.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.755+0000 7ff6e257e700 1 -- 172.21.15.26:0/2998581519 shutdown_connections 2023-10-01T07:57:33.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.755+0000 7ff6e257e700 1 --2- 172.21.15.26:0/2998581519 >> v2:172.21.15.26:3300/0 conn(0x7ff6dc1393e0 0x7ff6dc13b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:33.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.755+0000 7ff6e257e700 1 --2- 172.21.15.26:0/2998581519 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff6dc09f330 0x7ff6dc138ea0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:33.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.755+0000 7ff6e257e700 1 -- 172.21.15.26:0/2998581519 >> 172.21.15.26:0/2998581519 conn(0x7ff6dc0a3f70 msgr2=0x7ff6dc0a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:33.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.755+0000 7ff6e257e700 1 -- 172.21.15.26:0/2998581519 shutdown_connections 2023-10-01T07:57:33.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.755+0000 7ff6e257e700 1 -- 172.21.15.26:0/2998581519 wait complete. 2023-10-01T07:57:33.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.756+0000 7ff6e257e700 1 Processor -- start 2023-10-01T07:57:33.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.757+0000 7ff6e257e700 1 -- start start 2023-10-01T07:57:33.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.757+0000 7ff6e257e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff6dc09e850 0x7ff6dc1c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:33.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.757+0000 7ff6e257e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6dc09f330 0x7ff6dc1c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:33.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.757+0000 7ff6e257e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff6dc1393e0 0x7ff6dc1219c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:33.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.757+0000 7ff6e257e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc1237c0 con 0x7ff6dc09f330 2023-10-01T07:57:33.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.757+0000 7ff6e257e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc1235d0 con 0x7ff6dc09e850 2023-10-01T07:57:33.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.757+0000 7ff6e257e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc122e80 con 0x7ff6dc1393e0 2023-10-01T07:57:33.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.757+0000 7ff6dbfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff6dc09e850 0x7ff6dc1c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:33.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.757+0000 7ff6db7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6dc09f330 0x7ff6dc1c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:33.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.757+0000 7ff6dbfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff6dc09e850 0x7ff6dc1c8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47304/0 (socket says 172.21.15.26:47304) 2023-10-01T07:57:33.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.757+0000 7ff6db7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6dc09f330 0x7ff6dc1c8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56496/0 (socket says 172.21.15.26:56496) 2023-10-01T07:57:33.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.757+0000 7ff6dbfff700 1 -- 172.21.15.26:0/3661768089 learned_addr learned my addr 172.21.15.26:0/3661768089 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:33.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.757+0000 7ff6e0b1b700 1 --2- 172.21.15.26:0/3661768089 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff6dc1393e0 0x7ff6dc1219c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:33.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.758+0000 7ff6db7fe700 1 -- 172.21.15.26:0/3661768089 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff6dc1393e0 msgr2=0x7ff6dc1219c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:33.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.758+0000 7ff6db7fe700 1 --2- 172.21.15.26:0/3661768089 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff6dc1393e0 0x7ff6dc1219c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:33.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.758+0000 7ff6db7fe700 1 -- 172.21.15.26:0/3661768089 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff6dc09e850 msgr2=0x7ff6dc1c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:33.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.758+0000 7ff6db7fe700 1 --2- 172.21.15.26:0/3661768089 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff6dc09e850 0x7ff6dc1c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:33.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.758+0000 7ff6db7fe700 1 -- 172.21.15.26:0/3661768089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d4009b30 con 0x7ff6dc09f330 2023-10-01T07:57:33.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.758+0000 7ff6dbfff700 1 --2- 172.21.15.26:0/3661768089 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff6dc09e850 0x7ff6dc1c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:33.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.758+0000 7ff6e0b1b700 1 --2- 172.21.15.26:0/3661768089 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff6dc1393e0 0x7ff6dc1219c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:33.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.758+0000 7ff6db7fe700 1 --2- 172.21.15.26:0/3661768089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6dc09f330 0x7ff6dc1c8db0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0016000 tx=0x7ff6d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:33.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.758+0000 7ff6d8ff9700 1 -- 172.21.15.26:0/3661768089 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d00036a0 con 0x7ff6dc09f330 2023-10-01T07:57:33.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.758+0000 7ff6d8ff9700 1 -- 172.21.15.26:0/3661768089 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d001f070 con 0x7ff6dc09f330 2023-10-01T07:57:33.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.758+0000 7ff6e257e700 1 -- 172.21.15.26:0/3661768089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d00094a0 con 0x7ff6dc09f330 2023-10-01T07:57:33.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.758+0000 7ff6d8ff9700 1 -- 172.21.15.26:0/3661768089 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0003a60 con 0x7ff6dc09f330 2023-10-01T07:57:33.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.758+0000 7ff6e257e700 1 -- 172.21.15.26:0/3661768089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6dc137890 con 0x7ff6dc09f330 2023-10-01T07:57:33.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.759+0000 7ff6e257e700 1 -- 172.21.15.26:0/3661768089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6dc124ea0 con 0x7ff6dc09f330 2023-10-01T07:57:33.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.760+0000 7ff6d8ff9700 1 -- 172.21.15.26:0/3661768089 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff6d0003bc0 con 0x7ff6dc09f330 2023-10-01T07:57:33.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.760+0000 7ff6d8ff9700 1 -- 172.21.15.26:0/3661768089 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff6d0021070 con 0x7ff6dc09f330 2023-10-01T07:57:33.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.765+0000 7ff6d8ff9700 1 -- 172.21.15.26:0/3661768089 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff6dc124ea0 con 0x7ff6dc09f330 2023-10-01T07:57:33.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.909+0000 7f2668688700 1 -- 172.21.15.26:0/3745329936 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f266012eb40 con 0x7f266009a3b0 2023-10-01T07:57:33.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.909+0000 7f2656ffd700 1 -- 172.21.15.26:0/3745329936 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2650015070 con 0x7f266009a3b0 2023-10-01T07:57:33.910 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:33.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.912+0000 7f2668688700 1 -- 172.21.15.26:0/3745329936 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f266009a3b0 msgr2=0x7f266011bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:33.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.912+0000 7f2668688700 1 --2- 172.21.15.26:0/3745329936 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f266009a3b0 0x7f266011bc90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2650009c70 tx=0x7f2650004750 comp rx=0 tx=0).stop 2023-10-01T07:57:33.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.912+0000 7f2668688700 1 -- 172.21.15.26:0/3745329936 shutdown_connections 2023-10-01T07:57:33.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.912+0000 7f2668688700 1 --2- 172.21.15.26:0/3745329936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2660131810 0x7f266011c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:33.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.912+0000 7f2668688700 1 --2- 172.21.15.26:0/3745329936 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2660099a40 0x7f266011b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:33.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.912+0000 7f2668688700 1 --2- 172.21.15.26:0/3745329936 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f266009a3b0 0x7f266011bc90 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:33.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.912+0000 7f2668688700 1 -- 172.21.15.26:0/3745329936 >> 172.21.15.26:0/3745329936 conn(0x7f26600a2aa0 msgr2=0x7f2660071050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:33.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.912+0000 7f2668688700 1 -- 172.21.15.26:0/3745329936 shutdown_connections 2023-10-01T07:57:33.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.912+0000 7f2668688700 1 -- 172.21.15.26:0/3745329936 wait complete. 2023-10-01T07:57:33.926 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:33.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.940+0000 7fdd138f4700 1 -- 172.21.15.26:0/401711800 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdd0c074ea0 con 0x7fdd0c09d6f0 2023-10-01T07:57:33.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.941+0000 7fdd01ffb700 1 -- 172.21.15.26:0/401711800 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdd08003cd0 con 0x7fdd0c09d6f0 2023-10-01T07:57:33.941 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:33.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.944+0000 7fdd138f4700 1 -- 172.21.15.26:0/401711800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd0c09d6f0 msgr2=0x7fdd0c1207a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:33.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.944+0000 7fdd138f4700 1 --2- 172.21.15.26:0/401711800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd0c09d6f0 0x7fdd0c1207a0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fdd0800c430 tx=0x7fdd0800c740 comp rx=0 tx=0).stop 2023-10-01T07:57:33.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.944+0000 7fdd138f4700 1 -- 172.21.15.26:0/401711800 shutdown_connections 2023-10-01T07:57:33.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.944+0000 7fdd138f4700 1 --2- 172.21.15.26:0/401711800 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd0c139170 0x7fdd0c121220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:33.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.944+0000 7fdd138f4700 1 --2- 172.21.15.26:0/401711800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd0c09d6f0 0x7fdd0c1207a0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:33.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.944+0000 7fdd138f4700 1 --2- 172.21.15.26:0/401711800 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd0c09e1d0 0x7fdd0c120ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:33.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.944+0000 7fdd138f4700 1 -- 172.21.15.26:0/401711800 >> 172.21.15.26:0/401711800 conn(0x7fdd0c066f50 msgr2=0x7fdd0c136a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:33.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.944+0000 7fdd138f4700 1 -- 172.21.15.26:0/401711800 shutdown_connections 2023-10-01T07:57:33.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.944+0000 7fdd138f4700 1 -- 172.21.15.26:0/401711800 wait complete. 2023-10-01T07:57:33.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:33.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.983+0000 7ff6e257e700 1 -- 172.21.15.26:0/3661768089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff6dc124e50 con 0x7ff6dc09f330 2023-10-01T07:57:33.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.983+0000 7ff6d8ff9700 1 -- 172.21.15.26:0/3661768089 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff6d002b030 con 0x7ff6dc09f330 2023-10-01T07:57:33.984 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:33.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.985+0000 7ff6e257e700 1 -- 172.21.15.26:0/3661768089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6dc09f330 msgr2=0x7ff6dc1c8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:33.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.985+0000 7ff6e257e700 1 --2- 172.21.15.26:0/3661768089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6dc09f330 0x7ff6dc1c8db0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0016000 tx=0x7ff6d0004750 comp rx=0 tx=0).stop 2023-10-01T07:57:33.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.986+0000 7ff6e257e700 1 -- 172.21.15.26:0/3661768089 shutdown_connections 2023-10-01T07:57:33.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.986+0000 7ff6e257e700 1 --2- 172.21.15.26:0/3661768089 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff6dc1393e0 0x7ff6dc1219c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:33.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.986+0000 7ff6e257e700 1 --2- 172.21.15.26:0/3661768089 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff6dc09e850 0x7ff6dc1c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:33.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.986+0000 7ff6e257e700 1 --2- 172.21.15.26:0/3661768089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6dc09f330 0x7ff6dc1c8db0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:33.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.986+0000 7ff6e257e700 1 -- 172.21.15.26:0/3661768089 >> 172.21.15.26:0/3661768089 conn(0x7ff6dc0a3f70 msgr2=0x7ff6dc070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:33.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.986+0000 7ff6e257e700 1 -- 172.21.15.26:0/3661768089 shutdown_connections 2023-10-01T07:57:33.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:33.986+0000 7ff6e257e700 1 -- 172.21.15.26:0/3661768089 wait complete. 2023-10-01T07:57:33.996 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:33.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:34.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.133+0000 7f1ea9fb1700 1 Processor -- start 2023-10-01T07:57:34.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.134+0000 7f1ea9fb1700 1 -- start start 2023-10-01T07:57:34.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.134+0000 7f1ea9fb1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ea4133420 0x7f1ea41337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:34.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.134+0000 7f1ea9fb1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1ea4133e30 0x7f1ea412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:34.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.134+0000 7f1ea9fb1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ea406b990 con 0x7f1ea4134260 2023-10-01T07:57:34.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.134+0000 7f1ea9fb1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ea40a0590 con 0x7f1ea4133e30 2023-10-01T07:57:34.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.134+0000 7f1ea9fb1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea409fb80 con 0x7f1ea4133420 2023-10-01T07:57:34.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.134+0000 7f1ea37fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ea4133420 0x7f1ea41337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:34.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.134+0000 7f1ea2ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1ea4133e30 0x7f1ea412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:34.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.134+0000 7f1ea37fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ea4133420 0x7f1ea41337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55344/0 (socket says 172.21.15.26:55344) 2023-10-01T07:57:34.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.134+0000 7f1ea37fe700 1 -- 172.21.15.26:0/2044491882 learned_addr learned my addr 172.21.15.26:0/2044491882 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:34.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.135+0000 7f1ea2ffd700 1 -- 172.21.15.26:0/2044491882 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ea4133420 msgr2=0x7f1ea41337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:34.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.135+0000 7f1ea2ffd700 1 --2- 172.21.15.26:0/2044491882 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ea4133420 0x7f1ea41337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:34.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.135+0000 7f1ea2ffd700 1 -- 172.21.15.26:0/2044491882 >> v1:172.21.15.26:6789/0 conn(0x7f1ea4134260 legacy=0x7f1ea41304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:34.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.135+0000 7f1ea2ffd700 1 -- 172.21.15.26:0/2044491882 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea40a0030 con 0x7f1ea4133e30 2023-10-01T07:57:34.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.135+0000 7f1ea37fe700 1 --2- 172.21.15.26:0/2044491882 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ea4133420 0x7f1ea41337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:34.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.135+0000 7f1ea2ffd700 1 --2- 172.21.15.26:0/2044491882 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ea4133e30 0x7f1ea412ff90 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c009840 tx=0x7f1e8c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1d5997e35605b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:34.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.135+0000 7f1ea27fc700 1 -- 172.21.15.26:0/2044491882 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c011830 con 0x7f1ea4133e30 2023-10-01T07:57:34.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.135+0000 7f1ea27fc700 1 -- 172.21.15.26:0/2044491882 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8c011990 con 0x7f1ea4133e30 2023-10-01T07:57:34.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.135+0000 7f1ea27fc700 1 -- 172.21.15.26:0/2044491882 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c011d20 con 0x7f1ea4133e30 2023-10-01T07:57:34.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.135+0000 7f1ea9fb1700 1 -- 172.21.15.26:0/2044491882 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ea4133e30 msgr2=0x7f1ea412ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:34.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.135+0000 7f1ea9fb1700 1 --2- 172.21.15.26:0/2044491882 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ea4133e30 0x7f1ea412ff90 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c009840 tx=0x7f1e8c009b50 comp rx=0 tx=0).stop 2023-10-01T07:57:34.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.136+0000 7f1ea9fb1700 1 -- 172.21.15.26:0/2044491882 shutdown_connections 2023-10-01T07:57:34.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.136+0000 7f1ea9fb1700 1 --2- 172.21.15.26:0/2044491882 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ea4133420 0x7f1ea41337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:34.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.136+0000 7f1ea9fb1700 1 --2- 172.21.15.26:0/2044491882 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ea4133e30 0x7f1ea412ff90 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:34.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.136+0000 7f1ea9fb1700 1 -- 172.21.15.26:0/2044491882 >> 172.21.15.26:0/2044491882 conn(0x7f1ea40a4210 msgr2=0x7f1ea40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:34.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.136+0000 7f1ea9fb1700 1 -- 172.21.15.26:0/2044491882 shutdown_connections 2023-10-01T07:57:34.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.136+0000 7f1ea9fb1700 1 -- 172.21.15.26:0/2044491882 wait complete. 2023-10-01T07:57:34.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.137+0000 7f1ea9fb1700 1 Processor -- start 2023-10-01T07:57:34.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.137+0000 7f1ea9fb1700 1 -- start start 2023-10-01T07:57:34.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.137+0000 7f1ea9fb1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ea4133420 0x7f1ea409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:34.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.137+0000 7f1ea9fb1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ea4133e30 0x7f1ea409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:34.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.137+0000 7f1ea9fb1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ea4134260 0x7f1ea409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:34.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.137+0000 7f1ea9fb1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea4120010 con 0x7f1ea4133e30 2023-10-01T07:57:34.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.137+0000 7f1ea9fb1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea41201f0 con 0x7f1ea4134260 2023-10-01T07:57:34.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.137+0000 7f1ea9fb1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea412da70 con 0x7f1ea4133420 2023-10-01T07:57:34.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.137+0000 7f1ea2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ea4133e30 0x7f1ea409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:34.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.137+0000 7f1ea3fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ea4134260 0x7f1ea409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:34.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.137+0000 7f1ea2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ea4133e30 0x7f1ea409c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56512/0 (socket says 172.21.15.26:56512) 2023-10-01T07:57:34.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.137+0000 7f1ea2ffd700 1 -- 172.21.15.26:0/2006829063 learned_addr learned my addr 172.21.15.26:0/2006829063 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:34.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.138+0000 7f1ea37fe700 1 --2- 172.21.15.26:0/2006829063 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ea4133420 0x7f1ea409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:34.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.138+0000 7f1ea37fe700 1 -- 172.21.15.26:0/2006829063 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ea4134260 msgr2=0x7f1ea409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:34.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.138+0000 7f1ea37fe700 1 --2- 172.21.15.26:0/2006829063 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ea4134260 0x7f1ea409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:34.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.138+0000 7f1ea37fe700 1 -- 172.21.15.26:0/2006829063 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ea4133e30 msgr2=0x7f1ea409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:34.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.138+0000 7f1ea37fe700 1 --2- 172.21.15.26:0/2006829063 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ea4133e30 0x7f1ea409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:34.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.138+0000 7f1ea37fe700 1 -- 172.21.15.26:0/2006829063 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e94009550 con 0x7f1ea4133420 2023-10-01T07:57:34.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.138+0000 7f1ea3fff700 1 --2- 172.21.15.26:0/2006829063 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ea4134260 0x7f1ea409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:34.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.138+0000 7f1ea2ffd700 1 --2- 172.21.15.26:0/2006829063 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ea4133e30 0x7f1ea409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:34.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.138+0000 7f1ea37fe700 1 --2- 172.21.15.26:0/2006829063 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ea4133420 0x7f1ea409c480 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1e9400e9d0 tx=0x7f1e9400ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:34.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.138+0000 7f1e9bfff700 1 -- 172.21.15.26:0/2006829063 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9400ee70 con 0x7f1ea4133420 2023-10-01T07:57:34.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.138+0000 7f1e9bfff700 1 -- 172.21.15.26:0/2006829063 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e94004030 con 0x7f1ea4133420 2023-10-01T07:57:34.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.138+0000 7f1ea9fb1700 1 -- 172.21.15.26:0/2006829063 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e8c0094a0 con 0x7f1ea4133420 2023-10-01T07:57:34.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.138+0000 7f1e9bfff700 1 -- 172.21.15.26:0/2006829063 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e940043c0 con 0x7f1ea4133420 2023-10-01T07:57:34.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.138+0000 7f1ea9fb1700 1 -- 172.21.15.26:0/2006829063 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ea412d620 con 0x7f1ea4133420 2023-10-01T07:57:34.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.139+0000 7f1e9bfff700 1 -- 172.21.15.26:0/2006829063 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e9400c850 con 0x7f1ea4133420 2023-10-01T07:57:34.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.139+0000 7f1e9bfff700 1 -- 172.21.15.26:0/2006829063 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1e9403f590 con 0x7f1ea4133420 2023-10-01T07:57:34.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.139+0000 7f1ea9fb1700 1 -- 172.21.15.26:0/2006829063 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ea409e330 con 0x7f1ea4133420 2023-10-01T07:57:34.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.144+0000 7f1e9bfff700 1 -- 172.21.15.26:0/2006829063 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e94019d40 con 0x7f1ea4133420 2023-10-01T07:57:34.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.351+0000 7f1ea9fb1700 1 -- 172.21.15.26:0/2006829063 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1ea411fe50 con 0x7f1ea4133420 2023-10-01T07:57:34.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.351+0000 7f1e9bfff700 1 -- 172.21.15.26:0/2006829063 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1ea411fe50 con 0x7f1ea4133420 2023-10-01T07:57:34.352 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:34.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.353+0000 7f1ea9fb1700 1 -- 172.21.15.26:0/2006829063 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ea4133420 msgr2=0x7f1ea409c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:34.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.353+0000 7f1ea9fb1700 1 --2- 172.21.15.26:0/2006829063 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ea4133420 0x7f1ea409c480 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1e9400e9d0 tx=0x7f1e9400ece0 comp rx=0 tx=0).stop 2023-10-01T07:57:34.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.353+0000 7f1ea9fb1700 1 -- 172.21.15.26:0/2006829063 shutdown_connections 2023-10-01T07:57:34.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.353+0000 7f1ea9fb1700 1 --2- 172.21.15.26:0/2006829063 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ea4134260 0x7f1ea409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:34.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.353+0000 7f1ea9fb1700 1 --2- 172.21.15.26:0/2006829063 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ea4133420 0x7f1ea409c480 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:34.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.353+0000 7f1ea9fb1700 1 --2- 172.21.15.26:0/2006829063 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ea4133e30 0x7f1ea409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:34.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.353+0000 7f1ea9fb1700 1 -- 172.21.15.26:0/2006829063 >> 172.21.15.26:0/2006829063 conn(0x7f1ea40a4210 msgr2=0x7f1ea40a0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:34.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.354+0000 7f1ea9fb1700 1 -- 172.21.15.26:0/2006829063 shutdown_connections 2023-10-01T07:57:34.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:34.354+0000 7f1ea9fb1700 1 -- 172.21.15.26:0/2006829063 wait complete. 2023-10-01T07:57:34.368 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:34.928 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:34.965 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:35.001 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:35.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.078+0000 7f7742b52700 1 Processor -- start 2023-10-01T07:57:35.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.078+0000 7f7742b52700 1 -- start start 2023-10-01T07:57:35.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.079+0000 7f7742b52700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f773c1316c0 0x7f773c131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:35.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.079+0000 7f7742b52700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f773c06ae80 0x7f773c139550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:35.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.079+0000 7f7742b52700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f773c09e130 con 0x7f773c09d9f0 2023-10-01T07:57:35.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.079+0000 7f7742b52700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f773c1312b0 con 0x7f773c06ae80 2023-10-01T07:57:35.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.079+0000 7f7742b52700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773c09f6e0 con 0x7f773c1316c0 2023-10-01T07:57:35.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.079+0000 7f77408ee700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f773c1316c0 0x7f773c131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:35.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.079+0000 7f773bfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f773c09d9f0 0x7f773c06a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35284/0 (socket says 172.21.15.26:35284) 2023-10-01T07:57:35.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.079+0000 7f77408ee700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f773c1316c0 0x7f773c131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47322/0 (socket says 172.21.15.26:47322) 2023-10-01T07:57:35.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.079+0000 7f773bfff700 1 -- 172.21.15.26:0/2614087971 learned_addr learned my addr 172.21.15.26:0/2614087971 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:35.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.079+0000 7f77410ef700 1 --2- 172.21.15.26:0/2614087971 >> v2:172.21.15.26:3300/0 conn(0x7f773c06ae80 0x7f773c139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:35.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.080+0000 7f773b7fe700 1 -- 172.21.15.26:0/2614087971 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3244553766 0 0) 0x7f7728001110 con 0x7f773c09d9f0 2023-10-01T07:57:35.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.080+0000 7f77408ee700 1 -- 172.21.15.26:0/2614087971 >> v2:172.21.15.26:3300/0 conn(0x7f773c06ae80 msgr2=0x7f773c139550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:35.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.080+0000 7f77408ee700 1 --2- 172.21.15.26:0/2614087971 >> v2:172.21.15.26:3300/0 conn(0x7f773c06ae80 0x7f773c139550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:35.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.080+0000 7f77408ee700 1 -- 172.21.15.26:0/2614087971 >> v1:172.21.15.26:6789/0 conn(0x7f773c09d9f0 legacy=0x7f773c06a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:35.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.080+0000 7f77408ee700 1 -- 172.21.15.26:0/2614087971 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f773c09e760 con 0x7f773c1316c0 2023-10-01T07:57:35.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.080+0000 7f77408ee700 1 --2- 172.21.15.26:0/2614087971 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f773c1316c0 0x7f773c131a90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7730009840 tx=0x7f7730009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57d447d3041f1cae server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:35.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.080+0000 7f773b7fe700 1 -- 172.21.15.26:0/2614087971 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730011830 con 0x7f773c1316c0 2023-10-01T07:57:35.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.080+0000 7f773b7fe700 1 -- 172.21.15.26:0/2614087971 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7730011990 con 0x7f773c1316c0 2023-10-01T07:57:35.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.080+0000 7f773b7fe700 1 -- 172.21.15.26:0/2614087971 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730011d20 con 0x7f773c1316c0 2023-10-01T07:57:35.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.081+0000 7f7742b52700 1 -- 172.21.15.26:0/2614087971 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f773c1316c0 msgr2=0x7f773c131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:35.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.081+0000 7f7742b52700 1 --2- 172.21.15.26:0/2614087971 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f773c1316c0 0x7f773c131a90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7730009840 tx=0x7f7730009b50 comp rx=0 tx=0).stop 2023-10-01T07:57:35.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.081+0000 7f7742b52700 1 -- 172.21.15.26:0/2614087971 shutdown_connections 2023-10-01T07:57:35.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.081+0000 7f7742b52700 1 --2- 172.21.15.26:0/2614087971 >> v2:172.21.15.26:3300/0 conn(0x7f773c06ae80 0x7f773c139550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:35.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.081+0000 7f7742b52700 1 --2- 172.21.15.26:0/2614087971 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f773c1316c0 0x7f773c131a90 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:35.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.081+0000 7f7742b52700 1 -- 172.21.15.26:0/2614087971 >> 172.21.15.26:0/2614087971 conn(0x7f773c066f50 msgr2=0x7f773c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:35.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.081+0000 7f7742b52700 1 -- 172.21.15.26:0/2614087971 shutdown_connections 2023-10-01T07:57:35.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.081+0000 7f7742b52700 1 -- 172.21.15.26:0/2614087971 wait complete. 2023-10-01T07:57:35.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.082+0000 7f7742b52700 1 Processor -- start 2023-10-01T07:57:35.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.082+0000 7f7742b52700 1 -- start start 2023-10-01T07:57:35.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.083+0000 7f7742b52700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f773c06ae80 0x7f773c1c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:35.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.083+0000 7f7742b52700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f773c09d9f0 0x7f773c1c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:35.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.083+0000 7f7742b52700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f773c1316c0 0x7f773c1c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:35.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.083+0000 7f7742b52700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773c09b7b0 con 0x7f773c1316c0 2023-10-01T07:57:35.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.083+0000 7f7742b52700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773c09bfd0 con 0x7f773c06ae80 2023-10-01T07:57:35.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.083+0000 7f7742b52700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f773c12b900 con 0x7f773c09d9f0 2023-10-01T07:57:35.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.084+0000 7f77408ee700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f773c06ae80 0x7f773c1c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:35.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.084+0000 7f773bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f773c09d9f0 0x7f773c1c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:35.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.084+0000 7f77408ee700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f773c06ae80 0x7f773c1c8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47336/0 (socket says 172.21.15.26:47336) 2023-10-01T07:57:35.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.084+0000 7f77408ee700 1 -- 172.21.15.26:0/658847364 learned_addr learned my addr 172.21.15.26:0/658847364 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:35.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.084+0000 7f77410ef700 1 --2- 172.21.15.26:0/658847364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f773c1316c0 0x7f773c1c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:35.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.084+0000 7f77410ef700 1 -- 172.21.15.26:0/658847364 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f773c09d9f0 msgr2=0x7f773c1c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:35.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.084+0000 7f77410ef700 1 --2- 172.21.15.26:0/658847364 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f773c09d9f0 0x7f773c1c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:35.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.084+0000 7f77410ef700 1 -- 172.21.15.26:0/658847364 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f773c06ae80 msgr2=0x7f773c1c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:35.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.084+0000 7f77410ef700 1 --2- 172.21.15.26:0/658847364 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f773c06ae80 0x7f773c1c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:35.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.084+0000 7f77410ef700 1 -- 172.21.15.26:0/658847364 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77300094a0 con 0x7f773c1316c0 2023-10-01T07:57:35.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.084+0000 7f77408ee700 1 --2- 172.21.15.26:0/658847364 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f773c06ae80 0x7f773c1c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:35.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.084+0000 7f77410ef700 1 --2- 172.21.15.26:0/658847364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f773c1316c0 0x7f773c1c8db0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f7734009d90 tx=0x7f773400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:35.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.084+0000 7f77397fa700 1 -- 172.21.15.26:0/658847364 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7734009c00 con 0x7f773c1316c0 2023-10-01T07:57:35.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.084+0000 7f77397fa700 1 -- 172.21.15.26:0/658847364 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773400f040 con 0x7f773c1316c0 2023-10-01T07:57:35.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.084+0000 7f77397fa700 1 -- 172.21.15.26:0/658847364 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7734014480 con 0x7f773c1316c0 2023-10-01T07:57:35.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.084+0000 7f7742b52700 1 -- 172.21.15.26:0/658847364 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f773c09b990 con 0x7f773c1316c0 2023-10-01T07:57:35.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.084+0000 7f7742b52700 1 -- 172.21.15.26:0/658847364 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f773c09a810 con 0x7f773c1316c0 2023-10-01T07:57:35.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.085+0000 7f7742b52700 1 -- 172.21.15.26:0/658847364 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f773c074ea0 con 0x7f773c1316c0 2023-10-01T07:57:35.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.086+0000 7f77397fa700 1 -- 172.21.15.26:0/658847364 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f77340145e0 con 0x7f773c1316c0 2023-10-01T07:57:35.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.086+0000 7f77397fa700 1 -- 172.21.15.26:0/658847364 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7734040300 con 0x7f773c1316c0 2023-10-01T07:57:35.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.095+0000 7f77397fa700 1 -- 172.21.15.26:0/658847364 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7734007920 con 0x7f773c1316c0 2023-10-01T07:57:35.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.120+0000 7fbf949cb700 1 Processor -- start 2023-10-01T07:57:35.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.120+0000 7fbf949cb700 1 -- start start 2023-10-01T07:57:35.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.121+0000 7fbf949cb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf900a0a30 0x7fbf900a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:35.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.121+0000 7fbf949cb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbf90134170 0x7fbf9013bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:35.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.121+0000 7fbf949cb700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf9009edd0 con 0x7fbf900a1340 2023-10-01T07:57:35.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.121+0000 7fbf949cb700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf9009e1f0 con 0x7fbf90134170 2023-10-01T07:57:35.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.121+0000 7fbf949cb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9009dc50 con 0x7fbf900a0a30 2023-10-01T07:57:35.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.121+0000 7fbf8dd9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbf900a1340 0x7fbf90133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35288/0 (socket says 172.21.15.26:35288) 2023-10-01T07:57:35.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.121+0000 7fbf8dd9b700 1 -- 172.21.15.26:0/3549485542 learned_addr learned my addr 172.21.15.26:0/3549485542 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:35.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.121+0000 7fbf8e59c700 1 --2- 172.21.15.26:0/3549485542 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf900a0a30 0x7fbf900a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:35.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.122+0000 7fbf8ed9d700 1 --2- 172.21.15.26:0/3549485542 >> v2:172.21.15.26:3300/0 conn(0x7fbf90134170 0x7fbf9013bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:35.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.122+0000 7fbf8d59a700 1 -- 172.21.15.26:0/3549485542 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 384543952 0 0) 0x7fbf9009edd0 con 0x7fbf900a1340 2023-10-01T07:57:35.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.122+0000 7fbf8e59c700 1 -- 172.21.15.26:0/3549485542 >> v2:172.21.15.26:3300/0 conn(0x7fbf90134170 msgr2=0x7fbf9013bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:35.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.122+0000 7fbf8e59c700 1 --2- 172.21.15.26:0/3549485542 >> v2:172.21.15.26:3300/0 conn(0x7fbf90134170 0x7fbf9013bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:35.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.122+0000 7fbf8e59c700 1 -- 172.21.15.26:0/3549485542 >> v1:172.21.15.26:6789/0 conn(0x7fbf900a1340 legacy=0x7fbf90133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:35.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.122+0000 7fbf8e59c700 1 -- 172.21.15.26:0/3549485542 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf900a1fe0 con 0x7fbf900a0a30 2023-10-01T07:57:35.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.122+0000 7fbf8e59c700 1 --2- 172.21.15.26:0/3549485542 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf900a0a30 0x7fbf900a0e00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbf80009d90 tx=0x7fbf8000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9910ac7bc717b865 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:35.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.122+0000 7fbf8d59a700 1 -- 172.21.15.26:0/3549485542 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8000e070 con 0x7fbf900a0a30 2023-10-01T07:57:35.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.122+0000 7fbf8d59a700 1 -- 172.21.15.26:0/3549485542 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8000bbd0 con 0x7fbf900a0a30 2023-10-01T07:57:35.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.122+0000 7fbf8d59a700 1 -- 172.21.15.26:0/3549485542 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf80012430 con 0x7fbf900a0a30 2023-10-01T07:57:35.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.123+0000 7fbf949cb700 1 -- 172.21.15.26:0/3549485542 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf900a0a30 msgr2=0x7fbf900a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:35.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.123+0000 7fbf949cb700 1 --2- 172.21.15.26:0/3549485542 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf900a0a30 0x7fbf900a0e00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbf80009d90 tx=0x7fbf8000b330 comp rx=0 tx=0).stop 2023-10-01T07:57:35.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.123+0000 7fbf949cb700 1 -- 172.21.15.26:0/3549485542 shutdown_connections 2023-10-01T07:57:35.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.123+0000 7fbf949cb700 1 --2- 172.21.15.26:0/3549485542 >> v2:172.21.15.26:3300/0 conn(0x7fbf90134170 0x7fbf9013bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:35.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.123+0000 7fbf949cb700 1 --2- 172.21.15.26:0/3549485542 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf900a0a30 0x7fbf900a0e00 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:35.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.123+0000 7fbf949cb700 1 -- 172.21.15.26:0/3549485542 >> 172.21.15.26:0/3549485542 conn(0x7fbf900a6550 msgr2=0x7fbf900a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:35.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.123+0000 7fbf949cb700 1 -- 172.21.15.26:0/3549485542 shutdown_connections 2023-10-01T07:57:35.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.123+0000 7fbf949cb700 1 -- 172.21.15.26:0/3549485542 wait complete. 2023-10-01T07:57:35.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.124+0000 7fbf949cb700 1 Processor -- start 2023-10-01T07:57:35.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.124+0000 7fbf949cb700 1 -- start start 2023-10-01T07:57:35.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.125+0000 7fbf949cb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf900a0a30 0x7fbf90121710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:35.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.125+0000 7fbf949cb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf900a1340 0x7fbf90121c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:35.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.125+0000 7fbf949cb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf90134170 0x7fbf90122190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:35.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.125+0000 7fbf949cb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf90124f90 con 0x7fbf900a1340 2023-10-01T07:57:35.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.125+0000 7fbf949cb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf90132850 con 0x7fbf90134170 2023-10-01T07:57:35.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.125+0000 7fbf949cb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf901232d0 con 0x7fbf900a0a30 2023-10-01T07:57:35.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.125+0000 7fbf8dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf900a1340 0x7fbf90121c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:35.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.125+0000 7fbf8dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf900a1340 0x7fbf90121c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56538/0 (socket says 172.21.15.26:56538) 2023-10-01T07:57:35.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.125+0000 7fbf8dd9b700 1 -- 172.21.15.26:0/2744191198 learned_addr learned my addr 172.21.15.26:0/2744191198 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:35.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.125+0000 7fbf8ed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf90134170 0x7fbf90122190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:35.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.125+0000 7fbf8e59c700 1 --2- 172.21.15.26:0/2744191198 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf900a0a30 0x7fbf90121710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:35.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.125+0000 7fbf8dd9b700 1 -- 172.21.15.26:0/2744191198 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf900a0a30 msgr2=0x7fbf90121710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:35.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.125+0000 7fbf8dd9b700 1 --2- 172.21.15.26:0/2744191198 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf900a0a30 0x7fbf90121710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:35.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.125+0000 7fbf8dd9b700 1 -- 172.21.15.26:0/2744191198 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf90134170 msgr2=0x7fbf90122190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:35.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.125+0000 7fbf8dd9b700 1 --2- 172.21.15.26:0/2744191198 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf90134170 0x7fbf90122190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:35.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.125+0000 7fbf8dd9b700 1 -- 172.21.15.26:0/2744191198 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf80009a70 con 0x7fbf900a1340 2023-10-01T07:57:35.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.126+0000 7fbf8dd9b700 1 --2- 172.21.15.26:0/2744191198 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf900a1340 0x7fbf90121c50 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fbf8400c520 tx=0x7fbf8400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:35.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.126+0000 7fbf7effd700 1 -- 172.21.15.26:0/2744191198 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf84004c80 con 0x7fbf900a1340 2023-10-01T07:57:35.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.126+0000 7fbf7effd700 1 -- 172.21.15.26:0/2744191198 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf84004e00 con 0x7fbf900a1340 2023-10-01T07:57:35.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.126+0000 7fbf949cb700 1 -- 172.21.15.26:0/2744191198 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf900a0220 con 0x7fbf900a1340 2023-10-01T07:57:35.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.126+0000 7fbf7effd700 1 -- 172.21.15.26:0/2744191198 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf84007310 con 0x7fbf900a1340 2023-10-01T07:57:35.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.126+0000 7fbf949cb700 1 -- 172.21.15.26:0/2744191198 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf901256e0 con 0x7fbf900a1340 2023-10-01T07:57:35.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.127+0000 7fbf949cb700 1 -- 172.21.15.26:0/2744191198 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf900a1d40 con 0x7fbf900a1340 2023-10-01T07:57:35.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.127+0000 7fbf7effd700 1 -- 172.21.15.26:0/2744191198 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbf84007470 con 0x7fbf900a1340 2023-10-01T07:57:35.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.128+0000 7fbf7effd700 1 -- 172.21.15.26:0/2744191198 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbf8403f9d0 con 0x7fbf900a1340 2023-10-01T07:57:35.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.132+0000 7fbf7effd700 1 -- 172.21.15.26:0/2744191198 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbf840133c0 con 0x7fbf900a1340 2023-10-01T07:57:35.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.160+0000 7fb3d51aa700 1 Processor -- start 2023-10-01T07:57:35.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.160+0000 7fb3d51aa700 1 -- start start 2023-10-01T07:57:35.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.160+0000 7fb3d51aa700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb3d00a0a30 0x7fb3d00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:35.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.160+0000 7fb3d51aa700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3d00a1340 0x7fb3d0133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:35.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.160+0000 7fb3d51aa700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3d009edd0 con 0x7fb3d0133fa0 2023-10-01T07:57:35.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.160+0000 7fb3d51aa700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d009e1f0 con 0x7fb3d00a0a30 2023-10-01T07:57:35.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.160+0000 7fb3d51aa700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d009dc50 con 0x7fb3d00a1340 2023-10-01T07:57:35.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.161+0000 7fb3ced9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb3d00a0a30 0x7fb3d00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:35.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.161+0000 7fb3cf59e700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb3d0133fa0 0x7fb3d013ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35292/0 (socket says 172.21.15.26:35292) 2023-10-01T07:57:35.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.161+0000 7fb3ced9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb3d00a0a30 0x7fb3d00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56544/0 (socket says 172.21.15.26:56544) 2023-10-01T07:57:35.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.161+0000 7fb3cf59e700 1 -- 172.21.15.26:0/3257614149 learned_addr learned my addr 172.21.15.26:0/3257614149 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:35.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.161+0000 7fb3ce59c700 1 --2- 172.21.15.26:0/3257614149 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3d00a1340 0x7fb3d0133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:35.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.161+0000 7fb3ce59c700 1 -- 172.21.15.26:0/3257614149 >> v2:172.21.15.26:3300/0 conn(0x7fb3d00a0a30 msgr2=0x7fb3d00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:35.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.161+0000 7fb3ce59c700 1 --2- 172.21.15.26:0/3257614149 >> v2:172.21.15.26:3300/0 conn(0x7fb3d00a0a30 0x7fb3d00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:35.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.161+0000 7fb3ce59c700 1 -- 172.21.15.26:0/3257614149 >> v1:172.21.15.26:6789/0 conn(0x7fb3d0133fa0 legacy=0x7fb3d013ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:35.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.161+0000 7fb3ce59c700 1 -- 172.21.15.26:0/3257614149 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d00a1fe0 con 0x7fb3d00a1340 2023-10-01T07:57:35.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.161+0000 7fb3ced9d700 1 --2- 172.21.15.26:0/3257614149 >> v2:172.21.15.26:3300/0 conn(0x7fb3d00a0a30 0x7fb3d00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:35.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.161+0000 7fb3ce59c700 1 --2- 172.21.15.26:0/3257614149 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3d00a1340 0x7fb3d0133a60 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4009840 tx=0x7fb3c4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=734c24f14aec00d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:35.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.161+0000 7fb3cdd9b700 1 -- 172.21.15.26:0/3257614149 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c4011830 con 0x7fb3d00a1340 2023-10-01T07:57:35.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.161+0000 7fb3cdd9b700 1 -- 172.21.15.26:0/3257614149 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c4011990 con 0x7fb3d00a1340 2023-10-01T07:57:35.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.161+0000 7fb3cdd9b700 1 -- 172.21.15.26:0/3257614149 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c4011d20 con 0x7fb3d00a1340 2023-10-01T07:57:35.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.162+0000 7fb3d51aa700 1 -- 172.21.15.26:0/3257614149 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3d00a1340 msgr2=0x7fb3d0133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:35.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.162+0000 7fb3d51aa700 1 --2- 172.21.15.26:0/3257614149 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3d00a1340 0x7fb3d0133a60 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4009840 tx=0x7fb3c4009b50 comp rx=0 tx=0).stop 2023-10-01T07:57:35.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.162+0000 7fb3d51aa700 1 -- 172.21.15.26:0/3257614149 shutdown_connections 2023-10-01T07:57:35.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.162+0000 7fb3d51aa700 1 --2- 172.21.15.26:0/3257614149 >> v2:172.21.15.26:3300/0 conn(0x7fb3d00a0a30 0x7fb3d00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:35.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.162+0000 7fb3d51aa700 1 --2- 172.21.15.26:0/3257614149 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3d00a1340 0x7fb3d0133a60 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:35.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.162+0000 7fb3d51aa700 1 -- 172.21.15.26:0/3257614149 >> 172.21.15.26:0/3257614149 conn(0x7fb3d00a6550 msgr2=0x7fb3d00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:35.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.163+0000 7fb3d51aa700 1 -- 172.21.15.26:0/3257614149 shutdown_connections 2023-10-01T07:57:35.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.163+0000 7fb3d51aa700 1 -- 172.21.15.26:0/3257614149 wait complete. 2023-10-01T07:57:35.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.164+0000 7fb3d51aa700 1 Processor -- start 2023-10-01T07:57:35.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.164+0000 7fb3d51aa700 1 -- start start 2023-10-01T07:57:35.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.164+0000 7fb3d51aa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3d00a0a30 0x7fb3d011e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:35.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.164+0000 7fb3d51aa700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3d00a1340 0x7fb3d011ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:35.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.164+0000 7fb3d51aa700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb3d0133fa0 0x7fb3d011f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:35.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.164+0000 7fb3d51aa700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d0120bc0 con 0x7fb3d00a0a30 2023-10-01T07:57:35.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.164+0000 7fb3d51aa700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d00a3760 con 0x7fb3d00a1340 2023-10-01T07:57:35.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.164+0000 7fb3d51aa700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d00a0220 con 0x7fb3d0133fa0 2023-10-01T07:57:35.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.165+0000 7fb3ced9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3d00a0a30 0x7fb3d011e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:35.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.165+0000 7fb3ce59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3d00a1340 0x7fb3d011ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:35.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.165+0000 7fb3ced9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3d00a0a30 0x7fb3d011e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56550/0 (socket says 172.21.15.26:56550) 2023-10-01T07:57:35.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.165+0000 7fb3ced9d700 1 -- 172.21.15.26:0/709926816 learned_addr learned my addr 172.21.15.26:0/709926816 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:35.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.165+0000 7fb3cf59e700 1 --2- 172.21.15.26:0/709926816 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb3d0133fa0 0x7fb3d011f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:35.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.165+0000 7fb3ced9d700 1 -- 172.21.15.26:0/709926816 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb3d0133fa0 msgr2=0x7fb3d011f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:35.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.165+0000 7fb3ced9d700 1 --2- 172.21.15.26:0/709926816 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb3d0133fa0 0x7fb3d011f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:35.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.165+0000 7fb3ced9d700 1 -- 172.21.15.26:0/709926816 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3d00a1340 msgr2=0x7fb3d011ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:35.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.165+0000 7fb3ced9d700 1 --2- 172.21.15.26:0/709926816 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3d00a1340 0x7fb3d011ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:35.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.165+0000 7fb3ced9d700 1 -- 172.21.15.26:0/709926816 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c00094a0 con 0x7fb3d00a0a30 2023-10-01T07:57:35.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.165+0000 7fb3ced9d700 1 --2- 172.21.15.26:0/709926816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3d00a0a30 0x7fb3d011e750 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fb3c000ebe0 tx=0x7fb3c000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:35.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.165+0000 7fb3b77fe700 1 -- 172.21.15.26:0/709926816 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c000c850 con 0x7fb3d00a0a30 2023-10-01T07:57:35.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.165+0000 7fb3b77fe700 1 -- 172.21.15.26:0/709926816 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c000c9b0 con 0x7fb3d00a0a30 2023-10-01T07:57:35.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.165+0000 7fb3b77fe700 1 -- 172.21.15.26:0/709926816 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c000cd40 con 0x7fb3d00a0a30 2023-10-01T07:57:35.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.165+0000 7fb3d51aa700 1 -- 172.21.15.26:0/709926816 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c40094a0 con 0x7fb3d00a0a30 2023-10-01T07:57:35.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.166+0000 7fb3d51aa700 1 -- 172.21.15.26:0/709926816 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d0122a00 con 0x7fb3d00a0a30 2023-10-01T07:57:35.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.167+0000 7fb3b77fe700 1 -- 172.21.15.26:0/709926816 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb3c0013470 con 0x7fb3d00a0a30 2023-10-01T07:57:35.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.167+0000 7fb3b77fe700 1 -- 172.21.15.26:0/709926816 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb3c003f790 con 0x7fb3d00a0a30 2023-10-01T07:57:35.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.167+0000 7fb3d51aa700 1 -- 172.21.15.26:0/709926816 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d0074ea0 con 0x7fb3d00a0a30 2023-10-01T07:57:35.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.176+0000 7fb3b77fe700 1 -- 172.21.15.26:0/709926816 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb3c0021020 con 0x7fb3d00a0a30 2023-10-01T07:57:35.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.307+0000 7f7742b52700 1 -- 172.21.15.26:0/658847364 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f773c06c360 con 0x7f773c1316c0 2023-10-01T07:57:35.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.308+0000 7f77397fa700 1 -- 172.21.15.26:0/658847364 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7734007330 con 0x7f773c1316c0 2023-10-01T07:57:35.308 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:35.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.310+0000 7f7742b52700 1 -- 172.21.15.26:0/658847364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f773c1316c0 msgr2=0x7f773c1c8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:35.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.310+0000 7f7742b52700 1 --2- 172.21.15.26:0/658847364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f773c1316c0 0x7f773c1c8db0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f7734009d90 tx=0x7f773400c3a0 comp rx=0 tx=0).stop 2023-10-01T07:57:35.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.310+0000 7f7742b52700 1 -- 172.21.15.26:0/658847364 shutdown_connections 2023-10-01T07:57:35.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.310+0000 7f7742b52700 1 --2- 172.21.15.26:0/658847364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f773c1316c0 0x7f773c1c8db0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:35.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.310+0000 7f7742b52700 1 --2- 172.21.15.26:0/658847364 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f773c06ae80 0x7f773c1c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:35.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.310+0000 7f7742b52700 1 --2- 172.21.15.26:0/658847364 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f773c09d9f0 0x7f773c1c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:35.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.310+0000 7f7742b52700 1 -- 172.21.15.26:0/658847364 >> 172.21.15.26:0/658847364 conn(0x7f773c066f50 msgr2=0x7f773c1301b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:35.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.310+0000 7f7742b52700 1 -- 172.21.15.26:0/658847364 shutdown_connections 2023-10-01T07:57:35.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.310+0000 7f7742b52700 1 -- 172.21.15.26:0/658847364 wait complete. 2023-10-01T07:57:35.325 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:35.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.344+0000 7fbf949cb700 1 -- 172.21.15.26:0/2744191198 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbf90074ea0 con 0x7fbf900a1340 2023-10-01T07:57:35.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.344+0000 7fbf7effd700 1 -- 172.21.15.26:0/2744191198 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbf84011360 con 0x7fbf900a1340 2023-10-01T07:57:35.345 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:35.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.347+0000 7fbf949cb700 1 -- 172.21.15.26:0/2744191198 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf900a1340 msgr2=0x7fbf90121c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:35.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.347+0000 7fbf949cb700 1 --2- 172.21.15.26:0/2744191198 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf900a1340 0x7fbf90121c50 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fbf8400c520 tx=0x7fbf8400c830 comp rx=0 tx=0).stop 2023-10-01T07:57:35.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.347+0000 7fbf949cb700 1 -- 172.21.15.26:0/2744191198 shutdown_connections 2023-10-01T07:57:35.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.347+0000 7fbf949cb700 1 --2- 172.21.15.26:0/2744191198 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf90134170 0x7fbf90122190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:35.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.347+0000 7fbf949cb700 1 --2- 172.21.15.26:0/2744191198 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf900a0a30 0x7fbf90121710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:35.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.347+0000 7fbf949cb700 1 --2- 172.21.15.26:0/2744191198 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf900a1340 0x7fbf90121c50 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:35.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.347+0000 7fbf949cb700 1 -- 172.21.15.26:0/2744191198 >> 172.21.15.26:0/2744191198 conn(0x7fbf900a6550 msgr2=0x7fbf9009edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:35.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.347+0000 7fbf949cb700 1 -- 172.21.15.26:0/2744191198 shutdown_connections 2023-10-01T07:57:35.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.347+0000 7fbf949cb700 1 -- 172.21.15.26:0/2744191198 wait complete. 2023-10-01T07:57:35.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:35.369 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:35.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.382+0000 7fb3d51aa700 1 -- 172.21.15.26:0/709926816 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb3d00a28e0 con 0x7fb3d00a0a30 2023-10-01T07:57:35.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.383+0000 7fb3b77fe700 1 -- 172.21.15.26:0/709926816 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb3c000cea0 con 0x7fb3d00a0a30 2023-10-01T07:57:35.384 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:35.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.385+0000 7fb3d51aa700 1 -- 172.21.15.26:0/709926816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3d00a0a30 msgr2=0x7fb3d011e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:35.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.385+0000 7fb3d51aa700 1 --2- 172.21.15.26:0/709926816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3d00a0a30 0x7fb3d011e750 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fb3c000ebe0 tx=0x7fb3c000eef0 comp rx=0 tx=0).stop 2023-10-01T07:57:35.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.385+0000 7fb3d51aa700 1 -- 172.21.15.26:0/709926816 shutdown_connections 2023-10-01T07:57:35.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.385+0000 7fb3d51aa700 1 --2- 172.21.15.26:0/709926816 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb3d0133fa0 0x7fb3d011f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:35.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.385+0000 7fb3d51aa700 1 --2- 172.21.15.26:0/709926816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3d00a0a30 0x7fb3d011e750 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:35.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.385+0000 7fb3d51aa700 1 --2- 172.21.15.26:0/709926816 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3d00a1340 0x7fb3d011ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:35.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.385+0000 7fb3d51aa700 1 -- 172.21.15.26:0/709926816 >> 172.21.15.26:0/709926816 conn(0x7fb3d00a6550 msgr2=0x7fb3d00a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:35.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.385+0000 7fb3d51aa700 1 -- 172.21.15.26:0/709926816 shutdown_connections 2023-10-01T07:57:35.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.385+0000 7fb3d51aa700 1 -- 172.21.15.26:0/709926816 wait complete. 2023-10-01T07:57:35.400 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:35.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.518+0000 7fb64b500700 1 Processor -- start 2023-10-01T07:57:35.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.518+0000 7fb64b500700 1 -- start start 2023-10-01T07:57:35.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.518+0000 7fb64b500700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb64409e930 0x7fb64409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:35.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.518+0000 7fb64b500700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb64409f240 0x7fb6441317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:35.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.518+0000 7fb64b500700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb644070940 con 0x7fb64409f650 2023-10-01T07:57:35.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.518+0000 7fb64b500700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb64406fd60 con 0x7fb64409f240 2023-10-01T07:57:35.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.519+0000 7fb64b500700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb64406fa80 con 0x7fb64409e930 2023-10-01T07:57:35.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.519+0000 7fb648a9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb64409f240 0x7fb6441317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:35.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.519+0000 7fb64929c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb64409e930 0x7fb64409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:35.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.519+0000 7fb648a9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb64409f240 0x7fb6441317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56560/0 (socket says 172.21.15.26:56560) 2023-10-01T07:57:35.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.519+0000 7fb64929c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb64409e930 0x7fb64409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47364/0 (socket says 172.21.15.26:47364) 2023-10-01T07:57:35.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.519+0000 7fb648a9b700 1 -- 172.21.15.26:0/3257491275 learned_addr learned my addr 172.21.15.26:0/3257491275 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:35.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.519+0000 7fb64929c700 1 -- 172.21.15.26:0/3257491275 >> v2:172.21.15.26:3300/0 conn(0x7fb64409f240 msgr2=0x7fb6441317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:35.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.519+0000 7fb64929c700 1 --2- 172.21.15.26:0/3257491275 >> v2:172.21.15.26:3300/0 conn(0x7fb64409f240 0x7fb6441317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:35.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.519+0000 7fb64929c700 1 -- 172.21.15.26:0/3257491275 >> v1:172.21.15.26:6789/0 conn(0x7fb64409f650 legacy=0x7fb644131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:35.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.519+0000 7fb64929c700 1 -- 172.21.15.26:0/3257491275 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb64409fb60 con 0x7fb64409e930 2023-10-01T07:57:35.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.519+0000 7fb648a9b700 1 --2- 172.21.15.26:0/3257491275 >> v2:172.21.15.26:3300/0 conn(0x7fb64409f240 0x7fb6441317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:35.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.519+0000 7fb64929c700 1 --2- 172.21.15.26:0/3257491275 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb64409e930 0x7fb64409ed00 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb640009840 tx=0x7fb640009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f42329779065ef9a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:35.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.519+0000 7fb63bfff700 1 -- 172.21.15.26:0/3257491275 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb640011830 con 0x7fb64409e930 2023-10-01T07:57:35.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.519+0000 7fb63bfff700 1 -- 172.21.15.26:0/3257491275 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb640011990 con 0x7fb64409e930 2023-10-01T07:57:35.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.519+0000 7fb63bfff700 1 -- 172.21.15.26:0/3257491275 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb640011d20 con 0x7fb64409e930 2023-10-01T07:57:35.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.520+0000 7fb64b500700 1 -- 172.21.15.26:0/3257491275 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb64409e930 msgr2=0x7fb64409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:35.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.520+0000 7fb64b500700 1 --2- 172.21.15.26:0/3257491275 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb64409e930 0x7fb64409ed00 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb640009840 tx=0x7fb640009b50 comp rx=0 tx=0).stop 2023-10-01T07:57:35.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.520+0000 7fb64b500700 1 -- 172.21.15.26:0/3257491275 shutdown_connections 2023-10-01T07:57:35.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.520+0000 7fb64b500700 1 --2- 172.21.15.26:0/3257491275 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb64409e930 0x7fb64409ed00 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:35.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.520+0000 7fb64b500700 1 --2- 172.21.15.26:0/3257491275 >> v2:172.21.15.26:3300/0 conn(0x7fb64409f240 0x7fb6441317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:35.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.520+0000 7fb64b500700 1 -- 172.21.15.26:0/3257491275 >> 172.21.15.26:0/3257491275 conn(0x7fb6440a4210 msgr2=0x7fb6440a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:35.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.520+0000 7fb64b500700 1 -- 172.21.15.26:0/3257491275 shutdown_connections 2023-10-01T07:57:35.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.520+0000 7fb64b500700 1 -- 172.21.15.26:0/3257491275 wait complete. 2023-10-01T07:57:35.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.521+0000 7fb64b500700 1 Processor -- start 2023-10-01T07:57:35.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.521+0000 7fb64b500700 1 -- start start 2023-10-01T07:57:35.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.522+0000 7fb64b500700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb64409e930 0x7fb64406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:35.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.522+0000 7fb64b500700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb64409f240 0x7fb64406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:35.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.522+0000 7fb64b500700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb64409f650 0x7fb64406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:35.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.522+0000 7fb64b500700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6441b72d0 con 0x7fb64409e930 2023-10-01T07:57:35.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.522+0000 7fb64b500700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6441a9480 con 0x7fb64409f240 2023-10-01T07:57:35.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.522+0000 7fb64b500700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6441a89a0 con 0x7fb64409f650 2023-10-01T07:57:35.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.522+0000 7fb64929c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb64409e930 0x7fb64406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:35.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.522+0000 7fb64929c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb64409e930 0x7fb64406b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56562/0 (socket says 172.21.15.26:56562) 2023-10-01T07:57:35.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.522+0000 7fb64929c700 1 -- 172.21.15.26:0/1799229167 learned_addr learned my addr 172.21.15.26:0/1799229167 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:35.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.522+0000 7fb648a9b700 1 --2- 172.21.15.26:0/1799229167 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb64409f240 0x7fb64406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:35.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.522+0000 7fb649a9d700 1 --2- 172.21.15.26:0/1799229167 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb64409f650 0x7fb64406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:35.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.522+0000 7fb64929c700 1 -- 172.21.15.26:0/1799229167 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb64409f650 msgr2=0x7fb64406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:35.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.522+0000 7fb64929c700 1 --2- 172.21.15.26:0/1799229167 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb64409f650 0x7fb64406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:35.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.522+0000 7fb64929c700 1 -- 172.21.15.26:0/1799229167 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb64409f240 msgr2=0x7fb64406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:35.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.522+0000 7fb64929c700 1 --2- 172.21.15.26:0/1799229167 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb64409f240 0x7fb64406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:35.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.522+0000 7fb64929c700 1 -- 172.21.15.26:0/1799229167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb634009550 con 0x7fb64409e930 2023-10-01T07:57:35.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.522+0000 7fb649a9d700 1 --2- 172.21.15.26:0/1799229167 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb64409f650 0x7fb64406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:35.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.522+0000 7fb648a9b700 1 --2- 172.21.15.26:0/1799229167 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb64409f240 0x7fb64406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:35.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.522+0000 7fb64929c700 1 --2- 172.21.15.26:0/1799229167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb64409e930 0x7fb64406b8b0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fb6400090b0 tx=0x7fb640004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:35.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.523+0000 7fb639ffb700 1 -- 172.21.15.26:0/1799229167 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6400036a0 con 0x7fb64409e930 2023-10-01T07:57:35.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.523+0000 7fb639ffb700 1 -- 172.21.15.26:0/1799229167 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb64001f070 con 0x7fb64409e930 2023-10-01T07:57:35.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.523+0000 7fb64b500700 1 -- 172.21.15.26:0/1799229167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6400094a0 con 0x7fb64409e930 2023-10-01T07:57:35.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.523+0000 7fb639ffb700 1 -- 172.21.15.26:0/1799229167 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb640003a60 con 0x7fb64409e930 2023-10-01T07:57:35.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.523+0000 7fb64b500700 1 -- 172.21.15.26:0/1799229167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6440a0190 con 0x7fb64409e930 2023-10-01T07:57:35.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.524+0000 7fb639ffb700 1 -- 172.21.15.26:0/1799229167 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb640003bc0 con 0x7fb64409e930 2023-10-01T07:57:35.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.524+0000 7fb639ffb700 1 -- 172.21.15.26:0/1799229167 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb640021070 con 0x7fb64409e930 2023-10-01T07:57:35.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.524+0000 7fb64b500700 1 -- 172.21.15.26:0/1799229167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6441a0b30 con 0x7fb64409e930 2023-10-01T07:57:35.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.529+0000 7fb639ffb700 1 -- 172.21.15.26:0/1799229167 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb640015020 con 0x7fb64409e930 2023-10-01T07:57:35.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.731+0000 7fb64b500700 1 -- 172.21.15.26:0/1799229167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb6440a34c0 con 0x7fb64409e930 2023-10-01T07:57:35.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.732+0000 7fb639ffb700 1 -- 172.21.15.26:0/1799229167 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb6400253e0 con 0x7fb64409e930 2023-10-01T07:57:35.733 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:35.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.734+0000 7fb64b500700 1 -- 172.21.15.26:0/1799229167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb64409e930 msgr2=0x7fb64406b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:35.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.734+0000 7fb64b500700 1 --2- 172.21.15.26:0/1799229167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb64409e930 0x7fb64406b8b0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fb6400090b0 tx=0x7fb640004750 comp rx=0 tx=0).stop 2023-10-01T07:57:35.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.734+0000 7fb64b500700 1 -- 172.21.15.26:0/1799229167 shutdown_connections 2023-10-01T07:57:35.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.734+0000 7fb64b500700 1 --2- 172.21.15.26:0/1799229167 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb64409f650 0x7fb64406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:35.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.734+0000 7fb64b500700 1 --2- 172.21.15.26:0/1799229167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb64409e930 0x7fb64406b8b0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:35.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.734+0000 7fb64b500700 1 --2- 172.21.15.26:0/1799229167 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb64409f240 0x7fb64406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:35.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.734+0000 7fb64b500700 1 -- 172.21.15.26:0/1799229167 >> 172.21.15.26:0/1799229167 conn(0x7fb6440a4210 msgr2=0x7fb6441b8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:35.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.734+0000 7fb64b500700 1 -- 172.21.15.26:0/1799229167 shutdown_connections 2023-10-01T07:57:35.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:35.734+0000 7fb64b500700 1 -- 172.21.15.26:0/1799229167 wait complete. 2023-10-01T07:57:35.748 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:36.325 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:36.363 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:36.400 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:36.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.480+0000 7f7278659700 1 Processor -- start 2023-10-01T07:57:36.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.480+0000 7f7278659700 1 -- start start 2023-10-01T07:57:36.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.480+0000 7f7278659700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f72700a0a30 0x7f72700a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:36.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.480+0000 7f7278659700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f72700a1340 0x7f7270133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:36.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.480+0000 7f7278659700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7270133fa0 0x7f7270134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:36.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.480+0000 7f7278659700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f727009edd0 con 0x7f7270133fa0 2023-10-01T07:57:36.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.480+0000 7f7278659700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727009e1f0 con 0x7f72700a0a30 2023-10-01T07:57:36.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.480+0000 7f7278659700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f727009dc50 con 0x7f72700a1340 2023-10-01T07:57:36.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.481+0000 7f72763f5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f72700a0a30 0x7f72700a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:36.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.481+0000 7f7275bf4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f72700a1340 0x7f7270133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:36.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.481+0000 7f72763f5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f72700a0a30 0x7f72700a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47382/0 (socket says 172.21.15.26:47382) 2023-10-01T07:57:36.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.481+0000 7f72763f5700 1 -- 172.21.15.26:0/3583518105 learned_addr learned my addr 172.21.15.26:0/3583518105 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:36.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.481+0000 7f7276bf6700 1 --2- 172.21.15.26:0/3583518105 >> v2:172.21.15.26:3300/0 conn(0x7f7270133fa0 0x7f7270134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:36.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.481+0000 7f7275bf4700 1 -- 172.21.15.26:0/3583518105 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f72700a0a30 msgr2=0x7f72700a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:36.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.481+0000 7f7275bf4700 1 --2- 172.21.15.26:0/3583518105 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f72700a0a30 0x7f72700a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:36.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.481+0000 7f7275bf4700 1 -- 172.21.15.26:0/3583518105 >> v2:172.21.15.26:3300/0 conn(0x7f7270133fa0 msgr2=0x7f7270134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:36.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.481+0000 7f7275bf4700 1 --2- 172.21.15.26:0/3583518105 >> v2:172.21.15.26:3300/0 conn(0x7f7270133fa0 0x7f7270134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:36.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.481+0000 7f7275bf4700 1 -- 172.21.15.26:0/3583518105 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72700a1fe0 con 0x7f72700a1340 2023-10-01T07:57:36.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.481+0000 7f7276bf6700 1 --2- 172.21.15.26:0/3583518105 >> v2:172.21.15.26:3300/0 conn(0x7f7270133fa0 0x7f7270134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:36.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.481+0000 7f7275bf4700 1 --2- 172.21.15.26:0/3583518105 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f72700a1340 0x7f7270133a60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7260009840 tx=0x7f7260009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa5a25d15f6bdefd server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:36.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.481+0000 7f72753f3700 1 -- 172.21.15.26:0/3583518105 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7260011830 con 0x7f72700a1340 2023-10-01T07:57:36.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.482+0000 7f72753f3700 1 -- 172.21.15.26:0/3583518105 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7260011990 con 0x7f72700a1340 2023-10-01T07:57:36.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.482+0000 7f72753f3700 1 -- 172.21.15.26:0/3583518105 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7260011d20 con 0x7f72700a1340 2023-10-01T07:57:36.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.482+0000 7f7278659700 1 -- 172.21.15.26:0/3583518105 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f72700a1340 msgr2=0x7f7270133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:36.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.482+0000 7f7278659700 1 --2- 172.21.15.26:0/3583518105 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f72700a1340 0x7f7270133a60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7260009840 tx=0x7f7260009b50 comp rx=0 tx=0).stop 2023-10-01T07:57:36.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.482+0000 7f7278659700 1 -- 172.21.15.26:0/3583518105 shutdown_connections 2023-10-01T07:57:36.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.482+0000 7f7278659700 1 --2- 172.21.15.26:0/3583518105 >> v2:172.21.15.26:3300/0 conn(0x7f7270133fa0 0x7f7270134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:36.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.482+0000 7f7278659700 1 --2- 172.21.15.26:0/3583518105 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f72700a0a30 0x7f72700a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:36.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.482+0000 7f7278659700 1 --2- 172.21.15.26:0/3583518105 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f72700a1340 0x7f7270133a60 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:36.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.482+0000 7f7278659700 1 -- 172.21.15.26:0/3583518105 >> 172.21.15.26:0/3583518105 conn(0x7f72700a6550 msgr2=0x7f72700a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:36.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.483+0000 7f7278659700 1 -- 172.21.15.26:0/3583518105 shutdown_connections 2023-10-01T07:57:36.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.483+0000 7f7278659700 1 -- 172.21.15.26:0/3583518105 wait complete. 2023-10-01T07:57:36.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.483+0000 7f7278659700 1 Processor -- start 2023-10-01T07:57:36.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.484+0000 7f7278659700 1 -- start start 2023-10-01T07:57:36.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.484+0000 7f7278659700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72700a0a30 0x7f7270120130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:36.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.484+0000 7f7278659700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f72700a1340 0x7f7270120670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:36.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.484+0000 7f7278659700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7270133fa0 0x7f7270120bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:36.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.484+0000 7f7278659700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7270123c50 con 0x7f72700a0a30 2023-10-01T07:57:36.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.484+0000 7f7278659700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72700a3530 con 0x7f72700a1340 2023-10-01T07:57:36.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.484+0000 7f7278659700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72701233e0 con 0x7f7270133fa0 2023-10-01T07:57:36.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.484+0000 7f7276bf6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7270133fa0 0x7f7270120bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:36.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.484+0000 7f7275bf4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f72700a1340 0x7f7270120670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:36.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.484+0000 7f7276bf6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7270133fa0 0x7f7270120bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55428/0 (socket says 172.21.15.26:55428) 2023-10-01T07:57:36.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.484+0000 7f7276bf6700 1 -- 172.21.15.26:0/620113767 learned_addr learned my addr 172.21.15.26:0/620113767 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:36.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.484+0000 7f72763f5700 1 --2- 172.21.15.26:0/620113767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72700a0a30 0x7f7270120130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:36.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.485+0000 7f7276bf6700 1 -- 172.21.15.26:0/620113767 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f72700a1340 msgr2=0x7f7270120670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:36.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.485+0000 7f7276bf6700 1 --2- 172.21.15.26:0/620113767 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f72700a1340 0x7f7270120670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:36.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.485+0000 7f7276bf6700 1 -- 172.21.15.26:0/620113767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72700a0a30 msgr2=0x7f7270120130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:36.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.485+0000 7f7276bf6700 1 --2- 172.21.15.26:0/620113767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72700a0a30 0x7f7270120130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:36.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.485+0000 7f7276bf6700 1 -- 172.21.15.26:0/620113767 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7268009a70 con 0x7f7270133fa0 2023-10-01T07:57:36.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.485+0000 7f7276bf6700 1 --2- 172.21.15.26:0/620113767 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7270133fa0 0x7f7270120bb0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f726800efc0 tx=0x7f726800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:36.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.485+0000 7f7266ffd700 1 -- 172.21.15.26:0/620113767 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726800ca90 con 0x7f7270133fa0 2023-10-01T07:57:36.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.485+0000 7f7266ffd700 1 -- 172.21.15.26:0/620113767 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726800f040 con 0x7f7270133fa0 2023-10-01T07:57:36.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.485+0000 7f7278659700 1 -- 172.21.15.26:0/620113767 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72600094a0 con 0x7f7270133fa0 2023-10-01T07:57:36.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.485+0000 7f7266ffd700 1 -- 172.21.15.26:0/620113767 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726800ce10 con 0x7f7270133fa0 2023-10-01T07:57:36.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.485+0000 7f7278659700 1 -- 172.21.15.26:0/620113767 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7270121d40 con 0x7f7270133fa0 2023-10-01T07:57:36.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.486+0000 7f7278659700 1 -- 172.21.15.26:0/620113767 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7270074ea0 con 0x7f7270133fa0 2023-10-01T07:57:36.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.487+0000 7f7266ffd700 1 -- 172.21.15.26:0/620113767 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7268003a20 con 0x7f7270133fa0 2023-10-01T07:57:36.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.487+0000 7f7266ffd700 1 -- 172.21.15.26:0/620113767 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7268040840 con 0x7f7270133fa0 2023-10-01T07:57:36.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.491+0000 7f7266ffd700 1 -- 172.21.15.26:0/620113767 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f726801c3b0 con 0x7f7270133fa0 2023-10-01T07:57:36.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.516+0000 7fc073aa0700 1 Processor -- start 2023-10-01T07:57:36.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.517+0000 7fc073aa0700 1 -- start start 2023-10-01T07:57:36.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.517+0000 7fc073aa0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc06c09d630 0x7fc06c0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:36.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.517+0000 7fc073aa0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc06c138d80 0x7fc06c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:36.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.517+0000 7fc073aa0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc06c0a2a70 con 0x7fc06c0a0a30 2023-10-01T07:57:36.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.517+0000 7fc073aa0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc06c0a01d0 con 0x7fc06c09d630 2023-10-01T07:57:36.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.517+0000 7fc073aa0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c09e2b0 con 0x7fc06c138d80 2023-10-01T07:57:36.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.517+0000 7fc07203d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc06c138d80 0x7fc06c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:36.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.517+0000 7fc07103b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc06c09d630 0x7fc06c0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:36.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.517+0000 7fc07203d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc06c138d80 0x7fc06c13b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47392/0 (socket says 172.21.15.26:47392) 2023-10-01T07:57:36.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.517+0000 7fc07203d700 1 -- 172.21.15.26:0/784733137 learned_addr learned my addr 172.21.15.26:0/784733137 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:36.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.518+0000 7fc07103b700 1 -- 172.21.15.26:0/784733137 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc06c138d80 msgr2=0x7fc06c13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:36.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.518+0000 7fc07103b700 1 --2- 172.21.15.26:0/784733137 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc06c138d80 0x7fc06c13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:36.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.518+0000 7fc07103b700 1 -- 172.21.15.26:0/784733137 >> v1:172.21.15.26:6789/0 conn(0x7fc06c0a0a30 legacy=0x7fc06c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:36.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.518+0000 7fc07103b700 1 -- 172.21.15.26:0/784733137 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc06c09dc50 con 0x7fc06c09d630 2023-10-01T07:57:36.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.518+0000 7fc07203d700 1 --2- 172.21.15.26:0/784733137 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc06c138d80 0x7fc06c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:36.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.518+0000 7fc07103b700 1 --2- 172.21.15.26:0/784733137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc06c09d630 0x7fc06c0a1510 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fc05c009840 tx=0x7fc05c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c8731414d5dd58 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:36.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.518+0000 7fc07083a700 1 -- 172.21.15.26:0/784733137 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c011830 con 0x7fc06c09d630 2023-10-01T07:57:36.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.518+0000 7fc07083a700 1 -- 172.21.15.26:0/784733137 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05c011990 con 0x7fc06c09d630 2023-10-01T07:57:36.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.518+0000 7fc07083a700 1 -- 172.21.15.26:0/784733137 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c011d20 con 0x7fc06c09d630 2023-10-01T07:57:36.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.519+0000 7fc073aa0700 1 -- 172.21.15.26:0/784733137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc06c09d630 msgr2=0x7fc06c0a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:36.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.519+0000 7fc073aa0700 1 --2- 172.21.15.26:0/784733137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc06c09d630 0x7fc06c0a1510 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fc05c009840 tx=0x7fc05c009b50 comp rx=0 tx=0).stop 2023-10-01T07:57:36.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.519+0000 7fc073aa0700 1 -- 172.21.15.26:0/784733137 shutdown_connections 2023-10-01T07:57:36.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.519+0000 7fc073aa0700 1 --2- 172.21.15.26:0/784733137 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc06c138d80 0x7fc06c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:36.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.519+0000 7fc073aa0700 1 --2- 172.21.15.26:0/784733137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc06c09d630 0x7fc06c0a1510 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:36.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.519+0000 7fc073aa0700 1 -- 172.21.15.26:0/784733137 >> 172.21.15.26:0/784733137 conn(0x7fc06c0a3050 msgr2=0x7fc06c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:36.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.519+0000 7fc073aa0700 1 -- 172.21.15.26:0/784733137 shutdown_connections 2023-10-01T07:57:36.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.519+0000 7fc073aa0700 1 -- 172.21.15.26:0/784733137 wait complete. 2023-10-01T07:57:36.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.520+0000 7fc073aa0700 1 Processor -- start 2023-10-01T07:57:36.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.520+0000 7fc073aa0700 1 -- start start 2023-10-01T07:57:36.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.520+0000 7fc073aa0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc06c09d630 0x7fc06c1338d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:36.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.520+0000 7fc073aa0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc06c0a0a30 0x7fc06c133e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:36.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.520+0000 7fc073aa0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc06c138d80 0x7fc06c134350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:36.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.520+0000 7fc073aa0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c1363f0 con 0x7fc06c138d80 2023-10-01T07:57:36.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.520+0000 7fc073aa0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c137110 con 0x7fc06c09d630 2023-10-01T07:57:36.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.520+0000 7fc073aa0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c0a4d00 con 0x7fc06c0a0a30 2023-10-01T07:57:36.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.521+0000 7fc07103b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc06c0a0a30 0x7fc06c133e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:36.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.521+0000 7fc07103b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc06c0a0a30 0x7fc06c133e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55444/0 (socket says 172.21.15.26:55444) 2023-10-01T07:57:36.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.521+0000 7fc07103b700 1 -- 172.21.15.26:0/2141331031 learned_addr learned my addr 172.21.15.26:0/2141331031 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:36.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.521+0000 7fc07183c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc06c09d630 0x7fc06c1338d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:36.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.521+0000 7fc07103b700 1 -- 172.21.15.26:0/2141331031 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc06c09d630 msgr2=0x7fc06c1338d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:36.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.521+0000 7fc07103b700 1 --2- 172.21.15.26:0/2141331031 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc06c09d630 0x7fc06c1338d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:36.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.521+0000 7fc07103b700 1 -- 172.21.15.26:0/2141331031 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc06c138d80 msgr2=0x7fc06c134350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:36.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.521+0000 7fc07103b700 1 --2- 172.21.15.26:0/2141331031 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc06c138d80 0x7fc06c134350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:36.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.521+0000 7fc07103b700 1 -- 172.21.15.26:0/2141331031 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc064009b30 con 0x7fc06c0a0a30 2023-10-01T07:57:36.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.521+0000 7fc07103b700 1 --2- 172.21.15.26:0/2141331031 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc06c0a0a30 0x7fc06c133e10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc05c009fd0 tx=0x7fc05c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:36.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.521+0000 7fc0627fc700 1 -- 172.21.15.26:0/2141331031 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c004480 con 0x7fc06c0a0a30 2023-10-01T07:57:36.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.521+0000 7fc0627fc700 1 -- 172.21.15.26:0/2141331031 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05c01f070 con 0x7fc06c0a0a30 2023-10-01T07:57:36.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.521+0000 7fc073aa0700 1 -- 172.21.15.26:0/2141331031 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc05c0094a0 con 0x7fc06c0a0a30 2023-10-01T07:57:36.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.521+0000 7fc0627fc700 1 -- 172.21.15.26:0/2141331031 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c0038a0 con 0x7fc06c0a0a30 2023-10-01T07:57:36.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.522+0000 7fc073aa0700 1 -- 172.21.15.26:0/2141331031 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc06c137b80 con 0x7fc06c0a0a30 2023-10-01T07:57:36.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.523+0000 7fc073aa0700 1 -- 172.21.15.26:0/2141331031 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc06c136f50 con 0x7fc06c0a0a30 2023-10-01T07:57:36.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.523+0000 7fc0627fc700 1 -- 172.21.15.26:0/2141331031 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc05c021030 con 0x7fc06c0a0a30 2023-10-01T07:57:36.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.523+0000 7fc0627fc700 1 -- 172.21.15.26:0/2141331031 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc05c040800 con 0x7fc06c0a0a30 2023-10-01T07:57:36.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.528+0000 7fc0627fc700 1 -- 172.21.15.26:0/2141331031 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc05c0239c0 con 0x7fc06c0a0a30 2023-10-01T07:57:36.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.559+0000 7fe116358700 1 Processor -- start 2023-10-01T07:57:36.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.559+0000 7fe116358700 1 -- start start 2023-10-01T07:57:36.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.560+0000 7fe116358700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe1100a0a30 0x7fe1100a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:36.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.560+0000 7fe116358700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe1100a1340 0x7fe110133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:36.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.560+0000 7fe116358700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe110133fa0 0x7fe110134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:36.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.560+0000 7fe116358700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe11009edd0 con 0x7fe1100a1340 2023-10-01T07:57:36.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.560+0000 7fe116358700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11009e1f0 con 0x7fe1100a0a30 2023-10-01T07:57:36.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.560+0000 7fe116358700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe11009dc50 con 0x7fe110133fa0 2023-10-01T07:57:36.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.560+0000 7fe1148f5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe110133fa0 0x7fe110134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:36.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.560+0000 7fe10ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe1100a0a30 0x7fe1100a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:36.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.560+0000 7fe10ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe1100a0a30 0x7fe1100a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47404/0 (socket says 172.21.15.26:47404) 2023-10-01T07:57:36.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.560+0000 7fe1148f5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe110133fa0 0x7fe110134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55452/0 (socket says 172.21.15.26:55452) 2023-10-01T07:57:36.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.560+0000 7fe10f7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe1100a1340 0x7fe110133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:36.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.560+0000 7fe10ffff700 1 -- 172.21.15.26:0/4154239577 learned_addr learned my addr 172.21.15.26:0/4154239577 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:36.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.561+0000 7fe10ffff700 1 -- 172.21.15.26:0/4154239577 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe110133fa0 msgr2=0x7fe110134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:36.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.561+0000 7fe10ffff700 1 --2- 172.21.15.26:0/4154239577 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe110133fa0 0x7fe110134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:36.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.561+0000 7fe10ffff700 1 -- 172.21.15.26:0/4154239577 >> v2:172.21.15.26:3300/0 conn(0x7fe1100a1340 msgr2=0x7fe110133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:36.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.561+0000 7fe10ffff700 1 --2- 172.21.15.26:0/4154239577 >> v2:172.21.15.26:3300/0 conn(0x7fe1100a1340 0x7fe110133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:36.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.561+0000 7fe10ffff700 1 -- 172.21.15.26:0/4154239577 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1100a1fe0 con 0x7fe1100a0a30 2023-10-01T07:57:36.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.561+0000 7fe1148f5700 1 --2- 172.21.15.26:0/4154239577 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe110133fa0 0x7fe110134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:36.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.561+0000 7fe10ffff700 1 --2- 172.21.15.26:0/4154239577 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe1100a0a30 0x7fe1100a0e00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe100009920 tx=0x7fe100009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2708f20a5c71c03a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:36.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.561+0000 7fe10effd700 1 -- 172.21.15.26:0/4154239577 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe100011830 con 0x7fe1100a0a30 2023-10-01T07:57:36.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.561+0000 7fe10effd700 1 -- 172.21.15.26:0/4154239577 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe100011990 con 0x7fe1100a0a30 2023-10-01T07:57:36.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.561+0000 7fe10effd700 1 -- 172.21.15.26:0/4154239577 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe100011d20 con 0x7fe1100a0a30 2023-10-01T07:57:36.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.562+0000 7fe116358700 1 -- 172.21.15.26:0/4154239577 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe1100a0a30 msgr2=0x7fe1100a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:36.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.562+0000 7fe116358700 1 --2- 172.21.15.26:0/4154239577 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe1100a0a30 0x7fe1100a0e00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe100009920 tx=0x7fe100009c30 comp rx=0 tx=0).stop 2023-10-01T07:57:36.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.562+0000 7fe116358700 1 -- 172.21.15.26:0/4154239577 shutdown_connections 2023-10-01T07:57:36.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.562+0000 7fe116358700 1 --2- 172.21.15.26:0/4154239577 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe110133fa0 0x7fe110134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:36.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.562+0000 7fe116358700 1 --2- 172.21.15.26:0/4154239577 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe1100a0a30 0x7fe1100a0e00 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:36.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.562+0000 7fe116358700 1 --2- 172.21.15.26:0/4154239577 >> v2:172.21.15.26:3300/0 conn(0x7fe1100a1340 0x7fe110133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:36.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.562+0000 7fe116358700 1 -- 172.21.15.26:0/4154239577 >> 172.21.15.26:0/4154239577 conn(0x7fe1100a6550 msgr2=0x7fe1100a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:36.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.562+0000 7fe116358700 1 -- 172.21.15.26:0/4154239577 shutdown_connections 2023-10-01T07:57:36.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.562+0000 7fe116358700 1 -- 172.21.15.26:0/4154239577 wait complete. 2023-10-01T07:57:36.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.563+0000 7fe116358700 1 Processor -- start 2023-10-01T07:57:36.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.563+0000 7fe116358700 1 -- start start 2023-10-01T07:57:36.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.563+0000 7fe116358700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1100a0a30 0x7fe110120340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:36.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.564+0000 7fe116358700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe1100a1340 0x7fe110120880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:36.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.564+0000 7fe116358700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe110133fa0 0x7fe110120dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:36.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.564+0000 7fe116358700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe110133730 con 0x7fe1100a0a30 2023-10-01T07:57:36.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.564+0000 7fe116358700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe110122570 con 0x7fe110133fa0 2023-10-01T07:57:36.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.564+0000 7fe116358700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1101231a0 con 0x7fe1100a1340 2023-10-01T07:57:36.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.564+0000 7fe10f7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe1100a1340 0x7fe110120880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:36.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.564+0000 7fe10f7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe1100a1340 0x7fe110120880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55468/0 (socket says 172.21.15.26:55468) 2023-10-01T07:57:36.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.564+0000 7fe10f7fe700 1 -- 172.21.15.26:0/20617922 learned_addr learned my addr 172.21.15.26:0/20617922 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:36.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.564+0000 7fe10ffff700 1 --2- 172.21.15.26:0/20617922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1100a0a30 0x7fe110120340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:36.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.564+0000 7fe1148f5700 1 --2- 172.21.15.26:0/20617922 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe110133fa0 0x7fe110120dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:36.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.564+0000 7fe10ffff700 1 -- 172.21.15.26:0/20617922 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe1100a1340 msgr2=0x7fe110120880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:36.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.564+0000 7fe10ffff700 1 --2- 172.21.15.26:0/20617922 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe1100a1340 0x7fe110120880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:36.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.564+0000 7fe10ffff700 1 -- 172.21.15.26:0/20617922 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe110133fa0 msgr2=0x7fe110120dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:36.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.564+0000 7fe10ffff700 1 --2- 172.21.15.26:0/20617922 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe110133fa0 0x7fe110120dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:36.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.564+0000 7fe10ffff700 1 -- 172.21.15.26:0/20617922 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe108009a70 con 0x7fe1100a0a30 2023-10-01T07:57:36.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.564+0000 7fe10f7fe700 1 --2- 172.21.15.26:0/20617922 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe1100a1340 0x7fe110120880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:36.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.564+0000 7fe1148f5700 1 --2- 172.21.15.26:0/20617922 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe110133fa0 0x7fe110120dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:36.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.564+0000 7fe10ffff700 1 --2- 172.21.15.26:0/20617922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1100a0a30 0x7fe110120340 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fe100016000 tx=0x7fe100004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:36.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.565+0000 7fe10cff9700 1 -- 172.21.15.26:0/20617922 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe100004450 con 0x7fe1100a0a30 2023-10-01T07:57:36.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.565+0000 7fe10cff9700 1 -- 172.21.15.26:0/20617922 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1000036a0 con 0x7fe1100a0a30 2023-10-01T07:57:36.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.565+0000 7fe116358700 1 -- 172.21.15.26:0/20617922 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe100009550 con 0x7fe1100a0a30 2023-10-01T07:57:36.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.565+0000 7fe10cff9700 1 -- 172.21.15.26:0/20617922 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1000045f0 con 0x7fe1100a0a30 2023-10-01T07:57:36.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.565+0000 7fe116358700 1 -- 172.21.15.26:0/20617922 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1100a0220 con 0x7fe1100a0a30 2023-10-01T07:57:36.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.566+0000 7fe10cff9700 1 -- 172.21.15.26:0/20617922 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe100003a50 con 0x7fe1100a0a30 2023-10-01T07:57:36.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.566+0000 7fe10cff9700 1 -- 172.21.15.26:0/20617922 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe100021030 con 0x7fe1100a0a30 2023-10-01T07:57:36.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.566+0000 7fe116358700 1 -- 172.21.15.26:0/20617922 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe11009e8f0 con 0x7fe1100a0a30 2023-10-01T07:57:36.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.571+0000 7fe10cff9700 1 -- 172.21.15.26:0/20617922 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe100015070 con 0x7fe1100a0a30 2023-10-01T07:57:36.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.716+0000 7f7278659700 1 -- 172.21.15.26:0/620113767 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7270122f90 con 0x7f7270133fa0 2023-10-01T07:57:36.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.716+0000 7f7266ffd700 1 -- 172.21.15.26:0/620113767 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f726802b090 con 0x7f7270133fa0 2023-10-01T07:57:36.717 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:36.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.720+0000 7f7278659700 1 -- 172.21.15.26:0/620113767 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7270133fa0 msgr2=0x7f7270120bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:36.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.720+0000 7f7278659700 1 --2- 172.21.15.26:0/620113767 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7270133fa0 0x7f7270120bb0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f726800efc0 tx=0x7f726800c3a0 comp rx=0 tx=0).stop 2023-10-01T07:57:36.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.720+0000 7f7278659700 1 -- 172.21.15.26:0/620113767 shutdown_connections 2023-10-01T07:57:36.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.720+0000 7f7278659700 1 --2- 172.21.15.26:0/620113767 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7270133fa0 0x7f7270120bb0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:36.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.720+0000 7f7278659700 1 --2- 172.21.15.26:0/620113767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72700a0a30 0x7f7270120130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:36.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.720+0000 7f7278659700 1 --2- 172.21.15.26:0/620113767 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f72700a1340 0x7f7270120670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:36.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.720+0000 7f7278659700 1 -- 172.21.15.26:0/620113767 >> 172.21.15.26:0/620113767 conn(0x7f72700a6550 msgr2=0x7f72701bb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:36.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.720+0000 7f7278659700 1 -- 172.21.15.26:0/620113767 shutdown_connections 2023-10-01T07:57:36.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.720+0000 7f7278659700 1 -- 172.21.15.26:0/620113767 wait complete. 2023-10-01T07:57:36.735 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:36.749 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:36.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.752+0000 7fc073aa0700 1 -- 172.21.15.26:0/2141331031 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc06c136db0 con 0x7fc06c0a0a30 2023-10-01T07:57:36.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.753+0000 7fc0627fc700 1 -- 172.21.15.26:0/2141331031 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc06c136db0 con 0x7fc06c0a0a30 2023-10-01T07:57:36.753 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:36.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.755+0000 7fc073aa0700 1 -- 172.21.15.26:0/2141331031 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc06c0a0a30 msgr2=0x7fc06c133e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:36.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.755+0000 7fc073aa0700 1 --2- 172.21.15.26:0/2141331031 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc06c0a0a30 0x7fc06c133e10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc05c009fd0 tx=0x7fc05c004750 comp rx=0 tx=0).stop 2023-10-01T07:57:36.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.755+0000 7fc073aa0700 1 -- 172.21.15.26:0/2141331031 shutdown_connections 2023-10-01T07:57:36.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.755+0000 7fc073aa0700 1 --2- 172.21.15.26:0/2141331031 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc06c138d80 0x7fc06c134350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:36.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.755+0000 7fc073aa0700 1 --2- 172.21.15.26:0/2141331031 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc06c09d630 0x7fc06c1338d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:36.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.755+0000 7fc073aa0700 1 --2- 172.21.15.26:0/2141331031 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc06c0a0a30 0x7fc06c133e10 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:36.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.755+0000 7fc073aa0700 1 -- 172.21.15.26:0/2141331031 >> 172.21.15.26:0/2141331031 conn(0x7fc06c0a3050 msgr2=0x7fc06c09f620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:36.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.755+0000 7fc073aa0700 1 -- 172.21.15.26:0/2141331031 shutdown_connections 2023-10-01T07:57:36.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.755+0000 7fc073aa0700 1 -- 172.21.15.26:0/2141331031 wait complete. 2023-10-01T07:57:36.772 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:36.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.779+0000 7fe116358700 1 -- 172.21.15.26:0/20617922 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe110074ea0 con 0x7fe1100a0a30 2023-10-01T07:57:36.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.780+0000 7fe10cff9700 1 -- 172.21.15.26:0/20617922 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe100035090 con 0x7fe1100a0a30 2023-10-01T07:57:36.781 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:36.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.782+0000 7fe116358700 1 -- 172.21.15.26:0/20617922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1100a0a30 msgr2=0x7fe110120340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:36.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.782+0000 7fe116358700 1 --2- 172.21.15.26:0/20617922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1100a0a30 0x7fe110120340 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fe100016000 tx=0x7fe100004750 comp rx=0 tx=0).stop 2023-10-01T07:57:36.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.782+0000 7fe116358700 1 -- 172.21.15.26:0/20617922 shutdown_connections 2023-10-01T07:57:36.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.782+0000 7fe116358700 1 --2- 172.21.15.26:0/20617922 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe110133fa0 0x7fe110120dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:36.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.782+0000 7fe116358700 1 --2- 172.21.15.26:0/20617922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1100a0a30 0x7fe110120340 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:36.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.782+0000 7fe116358700 1 --2- 172.21.15.26:0/20617922 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe1100a1340 0x7fe110120880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:36.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.782+0000 7fe116358700 1 -- 172.21.15.26:0/20617922 >> 172.21.15.26:0/20617922 conn(0x7fe1100a6550 msgr2=0x7fe11009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:36.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.782+0000 7fe116358700 1 -- 172.21.15.26:0/20617922 shutdown_connections 2023-10-01T07:57:36.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.782+0000 7fe116358700 1 -- 172.21.15.26:0/20617922 wait complete. 2023-10-01T07:57:36.797 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:36.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.888+0000 7fb7fdcc2700 1 Processor -- start 2023-10-01T07:57:36.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.888+0000 7fb7fdcc2700 1 -- start start 2023-10-01T07:57:36.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.889+0000 7fb7fdcc2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7f809e230 0x7fb7f8131c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:36.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.889+0000 7fb7fdcc2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7f806ae80 0x7fb7f8139590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:36.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.889+0000 7fb7fdcc2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f809dba0 con 0x7fb7f8131830 2023-10-01T07:57:36.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.889+0000 7fb7fdcc2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f8132140 con 0x7fb7f809e230 2023-10-01T07:57:36.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.889+0000 7fb7fdcc2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f81313e0 con 0x7fb7f806ae80 2023-10-01T07:57:36.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.889+0000 7fb7f7fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7f806ae80 0x7fb7f8139590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:36.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.889+0000 7fb7f6ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7f809e230 0x7fb7f8131c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:36.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.889+0000 7fb7f77fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb7f8131830 0x7fb7f806a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35320/0 (socket says 172.21.15.26:35320) 2023-10-01T07:57:36.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.889+0000 7fb7f6ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7f809e230 0x7fb7f8131c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47416/0 (socket says 172.21.15.26:47416) 2023-10-01T07:57:36.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.889+0000 7fb7f7fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7f806ae80 0x7fb7f8139590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55470/0 (socket says 172.21.15.26:55470) 2023-10-01T07:57:36.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.889+0000 7fb7f77fe700 1 -- 172.21.15.26:0/1846962810 learned_addr learned my addr 172.21.15.26:0/1846962810 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:36.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.889+0000 7fb7f67fc700 1 -- 172.21.15.26:0/1846962810 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 173182538 0 0) 0x7fb7f809dba0 con 0x7fb7f8131830 2023-10-01T07:57:36.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.889+0000 7fb7f7fff700 1 -- 172.21.15.26:0/1846962810 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7f809e230 msgr2=0x7fb7f8131c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:36.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.889+0000 7fb7f7fff700 1 --2- 172.21.15.26:0/1846962810 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7f809e230 0x7fb7f8131c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:36.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.889+0000 7fb7f7fff700 1 -- 172.21.15.26:0/1846962810 >> v1:172.21.15.26:6789/0 conn(0x7fb7f8131830 legacy=0x7fb7f806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:36.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.889+0000 7fb7f7fff700 1 -- 172.21.15.26:0/1846962810 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f809d6d0 con 0x7fb7f806ae80 2023-10-01T07:57:36.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.889+0000 7fb7f6ffd700 1 --2- 172.21.15.26:0/1846962810 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7f809e230 0x7fb7f8131c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:36.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.890+0000 7fb7f7fff700 1 --2- 172.21.15.26:0/1846962810 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7f806ae80 0x7fb7f8139590 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0009dc0 tx=0x7fb7f000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf1e46e5dd0b956d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:36.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.890+0000 7fb7f67fc700 1 -- 172.21.15.26:0/1846962810 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f000e070 con 0x7fb7f806ae80 2023-10-01T07:57:36.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.890+0000 7fb7f67fc700 1 -- 172.21.15.26:0/1846962810 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f000bb20 con 0x7fb7f806ae80 2023-10-01T07:57:36.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.890+0000 7fb7f67fc700 1 -- 172.21.15.26:0/1846962810 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f0012430 con 0x7fb7f806ae80 2023-10-01T07:57:36.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.890+0000 7fb7fdcc2700 1 -- 172.21.15.26:0/1846962810 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7f806ae80 msgr2=0x7fb7f8139590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:36.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.890+0000 7fb7fdcc2700 1 --2- 172.21.15.26:0/1846962810 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7f806ae80 0x7fb7f8139590 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0009dc0 tx=0x7fb7f000b330 comp rx=0 tx=0).stop 2023-10-01T07:57:36.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.890+0000 7fb7fdcc2700 1 -- 172.21.15.26:0/1846962810 shutdown_connections 2023-10-01T07:57:36.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.890+0000 7fb7fdcc2700 1 --2- 172.21.15.26:0/1846962810 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7f806ae80 0x7fb7f8139590 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:36.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.890+0000 7fb7fdcc2700 1 --2- 172.21.15.26:0/1846962810 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7f809e230 0x7fb7f8131c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:36.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.890+0000 7fb7fdcc2700 1 -- 172.21.15.26:0/1846962810 >> 172.21.15.26:0/1846962810 conn(0x7fb7f8099c20 msgr2=0x7fb7f80a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:36.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.890+0000 7fb7fdcc2700 1 -- 172.21.15.26:0/1846962810 shutdown_connections 2023-10-01T07:57:36.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.890+0000 7fb7fdcc2700 1 -- 172.21.15.26:0/1846962810 wait complete. 2023-10-01T07:57:36.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.892+0000 7fb7fdcc2700 1 Processor -- start 2023-10-01T07:57:36.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.892+0000 7fb7fdcc2700 1 -- start start 2023-10-01T07:57:36.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.893+0000 7fb7fdcc2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7f806ae80 0x7fb7f811a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:36.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.893+0000 7fb7fdcc2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7f809e230 0x7fb7f811a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:36.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.893+0000 7fb7fdcc2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7f8131830 0x7fb7f811ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:36.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.893+0000 7fb7fdcc2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f811c080 con 0x7fb7f809e230 2023-10-01T07:57:36.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.893+0000 7fb7fdcc2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f811cd90 con 0x7fb7f806ae80 2023-10-01T07:57:36.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.893+0000 7fb7fdcc2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f811d150 con 0x7fb7f8131830 2023-10-01T07:57:36.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.893+0000 7fb7f77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7f806ae80 0x7fb7f811a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:36.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.893+0000 7fb7f6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7f809e230 0x7fb7f811a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:36.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.893+0000 7fb7f77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7f806ae80 0x7fb7f811a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47428/0 (socket says 172.21.15.26:47428) 2023-10-01T07:57:36.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.893+0000 7fb7f77fe700 1 -- 172.21.15.26:0/3481249873 learned_addr learned my addr 172.21.15.26:0/3481249873 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:36.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.893+0000 7fb7f7fff700 1 --2- 172.21.15.26:0/3481249873 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7f8131830 0x7fb7f811ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:36.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.893+0000 7fb7f7fff700 1 -- 172.21.15.26:0/3481249873 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7f806ae80 msgr2=0x7fb7f811a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:36.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.893+0000 7fb7f7fff700 1 --2- 172.21.15.26:0/3481249873 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7f806ae80 0x7fb7f811a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:36.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.893+0000 7fb7f7fff700 1 -- 172.21.15.26:0/3481249873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7f809e230 msgr2=0x7fb7f811a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:36.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.893+0000 7fb7f7fff700 1 --2- 172.21.15.26:0/3481249873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7f809e230 0x7fb7f811a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:36.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.893+0000 7fb7f7fff700 1 -- 172.21.15.26:0/3481249873 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ec0094a0 con 0x7fb7f8131830 2023-10-01T07:57:36.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.893+0000 7fb7f6ffd700 1 --2- 172.21.15.26:0/3481249873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7f809e230 0x7fb7f811a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:36.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.893+0000 7fb7f77fe700 1 --2- 172.21.15.26:0/3481249873 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7f806ae80 0x7fb7f811a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:36.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.893+0000 7fb7f7fff700 1 --2- 172.21.15.26:0/3481249873 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7f8131830 0x7fb7f811ae00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0016000 tx=0x7fb7f0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:36.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.894+0000 7fb7dffff700 1 -- 172.21.15.26:0/3481249873 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f0022070 con 0x7fb7f8131830 2023-10-01T07:57:36.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.894+0000 7fb7dffff700 1 -- 172.21.15.26:0/3481249873 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f00098f0 con 0x7fb7f8131830 2023-10-01T07:57:36.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.894+0000 7fb7fdcc2700 1 -- 172.21.15.26:0/3481249873 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7f0009a70 con 0x7fb7f8131830 2023-10-01T07:57:36.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.894+0000 7fb7dffff700 1 -- 172.21.15.26:0/3481249873 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f001dd10 con 0x7fb7f8131830 2023-10-01T07:57:36.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.894+0000 7fb7fdcc2700 1 -- 172.21.15.26:0/3481249873 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f811d870 con 0x7fb7f8131830 2023-10-01T07:57:36.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.894+0000 7fb7dffff700 1 -- 172.21.15.26:0/3481249873 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb7f0026070 con 0x7fb7f8131830 2023-10-01T07:57:36.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.895+0000 7fb7dffff700 1 -- 172.21.15.26:0/3481249873 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb7f0044930 con 0x7fb7f8131830 2023-10-01T07:57:36.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.895+0000 7fb7fdcc2700 1 -- 172.21.15.26:0/3481249873 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f804f2a0 con 0x7fb7f8131830 2023-10-01T07:57:36.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:36.900+0000 7fb7dffff700 1 -- 172.21.15.26:0/3481249873 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb7f0012430 con 0x7fb7f8131830 2023-10-01T07:57:37.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.103+0000 7fb7fdcc2700 1 -- 172.21.15.26:0/3481249873 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb7f806c230 con 0x7fb7f8131830 2023-10-01T07:57:37.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.103+0000 7fb7dffff700 1 -- 172.21.15.26:0/3481249873 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb7f002d030 con 0x7fb7f8131830 2023-10-01T07:57:37.104 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:37.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.105+0000 7fb7fdcc2700 1 -- 172.21.15.26:0/3481249873 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7f8131830 msgr2=0x7fb7f811ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:37.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.105+0000 7fb7fdcc2700 1 --2- 172.21.15.26:0/3481249873 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7f8131830 0x7fb7f811ae00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0016000 tx=0x7fb7f0004ad0 comp rx=0 tx=0).stop 2023-10-01T07:57:37.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.105+0000 7fb7fdcc2700 1 -- 172.21.15.26:0/3481249873 shutdown_connections 2023-10-01T07:57:37.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.105+0000 7fb7fdcc2700 1 --2- 172.21.15.26:0/3481249873 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7f8131830 0x7fb7f811ae00 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:37.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.105+0000 7fb7fdcc2700 1 --2- 172.21.15.26:0/3481249873 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7f806ae80 0x7fb7f811a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:37.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.105+0000 7fb7fdcc2700 1 --2- 172.21.15.26:0/3481249873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7f809e230 0x7fb7f811a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:37.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.105+0000 7fb7fdcc2700 1 -- 172.21.15.26:0/3481249873 >> 172.21.15.26:0/3481249873 conn(0x7fb7f8099c20 msgr2=0x7fb7f812f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:37.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.105+0000 7fb7fdcc2700 1 -- 172.21.15.26:0/3481249873 shutdown_connections 2023-10-01T07:57:37.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.105+0000 7fb7fdcc2700 1 -- 172.21.15.26:0/3481249873 wait complete. 2023-10-01T07:57:37.120 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:37.735 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:37.772 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:37.798 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:37.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.887+0000 7f4cd7339700 1 Processor -- start 2023-10-01T07:57:37.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.888+0000 7f4cd7339700 1 -- start start 2023-10-01T07:57:37.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.888+0000 7f4cd7339700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4cd00a0a30 0x7f4cd00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:37.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.888+0000 7f4cd7339700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4cd00a1340 0x7f4cd0133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:37.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.888+0000 7f4cd7339700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4cd0133fa0 0x7f4cd0134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:37.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.888+0000 7f4cd7339700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cd009edd0 con 0x7f4cd00a1340 2023-10-01T07:57:37.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.888+0000 7f4cd7339700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd009e1f0 con 0x7f4cd00a0a30 2023-10-01T07:57:37.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.888+0000 7f4cd7339700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd009dc50 con 0x7f4cd0133fa0 2023-10-01T07:57:37.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.888+0000 7f4cd50d5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4cd00a0a30 0x7f4cd00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:37.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.888+0000 7f4cd58d6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4cd0133fa0 0x7f4cd0134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:37.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.888+0000 7f4cd50d5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4cd00a0a30 0x7f4cd00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47430/0 (socket says 172.21.15.26:47430) 2023-10-01T07:57:37.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.888+0000 7f4cd50d5700 1 -- 172.21.15.26:0/1792482772 learned_addr learned my addr 172.21.15.26:0/1792482772 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:37.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.888+0000 7f4cd48d4700 1 --2- 172.21.15.26:0/1792482772 >> v2:172.21.15.26:3300/0 conn(0x7f4cd00a1340 0x7f4cd0133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:37.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.889+0000 7f4cd50d5700 1 -- 172.21.15.26:0/1792482772 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4cd0133fa0 msgr2=0x7f4cd0134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:37.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.889+0000 7f4cd50d5700 1 --2- 172.21.15.26:0/1792482772 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4cd0133fa0 0x7f4cd0134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:37.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.889+0000 7f4cd50d5700 1 -- 172.21.15.26:0/1792482772 >> v2:172.21.15.26:3300/0 conn(0x7f4cd00a1340 msgr2=0x7f4cd0133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:37.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.889+0000 7f4cd50d5700 1 --2- 172.21.15.26:0/1792482772 >> v2:172.21.15.26:3300/0 conn(0x7f4cd00a1340 0x7f4cd0133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:37.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.889+0000 7f4cd50d5700 1 -- 172.21.15.26:0/1792482772 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd00a1fe0 con 0x7f4cd00a0a30 2023-10-01T07:57:37.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.889+0000 7f4cd58d6700 1 --2- 172.21.15.26:0/1792482772 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4cd0133fa0 0x7f4cd0134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:37.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.889+0000 7f4cd48d4700 1 --2- 172.21.15.26:0/1792482772 >> v2:172.21.15.26:3300/0 conn(0x7f4cd00a1340 0x7f4cd0133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:37.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.889+0000 7f4cd50d5700 1 --2- 172.21.15.26:0/1792482772 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4cd00a0a30 0x7f4cd00a0e00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc009920 tx=0x7f4ccc009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1edbccb96587f9e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:37.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.889+0000 7f4cc7fff700 1 -- 172.21.15.26:0/1792482772 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc011830 con 0x7f4cd00a0a30 2023-10-01T07:57:37.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.889+0000 7f4cc7fff700 1 -- 172.21.15.26:0/1792482772 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ccc011990 con 0x7f4cd00a0a30 2023-10-01T07:57:37.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.889+0000 7f4cc7fff700 1 -- 172.21.15.26:0/1792482772 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc011d20 con 0x7f4cd00a0a30 2023-10-01T07:57:37.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.890+0000 7f4cd7339700 1 -- 172.21.15.26:0/1792482772 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4cd00a0a30 msgr2=0x7f4cd00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:37.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.890+0000 7f4cd7339700 1 --2- 172.21.15.26:0/1792482772 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4cd00a0a30 0x7f4cd00a0e00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc009920 tx=0x7f4ccc009c30 comp rx=0 tx=0).stop 2023-10-01T07:57:37.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.890+0000 7f4cd7339700 1 -- 172.21.15.26:0/1792482772 shutdown_connections 2023-10-01T07:57:37.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.890+0000 7f4cd7339700 1 --2- 172.21.15.26:0/1792482772 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4cd0133fa0 0x7f4cd0134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:37.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.890+0000 7f4cd7339700 1 --2- 172.21.15.26:0/1792482772 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4cd00a0a30 0x7f4cd00a0e00 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:37.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.890+0000 7f4cd7339700 1 --2- 172.21.15.26:0/1792482772 >> v2:172.21.15.26:3300/0 conn(0x7f4cd00a1340 0x7f4cd0133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:37.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.890+0000 7f4cd7339700 1 -- 172.21.15.26:0/1792482772 >> 172.21.15.26:0/1792482772 conn(0x7f4cd00a6550 msgr2=0x7f4cd00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:37.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.890+0000 7f4cd7339700 1 -- 172.21.15.26:0/1792482772 shutdown_connections 2023-10-01T07:57:37.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.890+0000 7f4cd7339700 1 -- 172.21.15.26:0/1792482772 wait complete. 2023-10-01T07:57:37.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.891+0000 7f4cd7339700 1 Processor -- start 2023-10-01T07:57:37.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.891+0000 7f4cd7339700 1 -- start start 2023-10-01T07:57:37.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.892+0000 7f4cd7339700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cd00a0a30 0x7f4cd0120230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:37.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.892+0000 7f4cd7339700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4cd00a1340 0x7f4cd0120770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:37.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.892+0000 7f4cd7339700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4cd0133fa0 0x7f4cd0120cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:37.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.892+0000 7f4cd7339700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd0121d10 con 0x7f4cd00a0a30 2023-10-01T07:57:37.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.892+0000 7f4cd7339700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd0122f60 con 0x7f4cd0133fa0 2023-10-01T07:57:37.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.892+0000 7f4cd7339700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd0122300 con 0x7f4cd00a1340 2023-10-01T07:57:37.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.892+0000 7f4cd50d5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cd00a0a30 0x7f4cd0120230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:37.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.892+0000 7f4cd58d6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4cd0133fa0 0x7f4cd0120cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:37.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.892+0000 7f4cd50d5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cd00a0a30 0x7f4cd0120230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56630/0 (socket says 172.21.15.26:56630) 2023-10-01T07:57:37.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.892+0000 7f4cd50d5700 1 -- 172.21.15.26:0/1756591225 learned_addr learned my addr 172.21.15.26:0/1756591225 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:37.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.892+0000 7f4cd48d4700 1 --2- 172.21.15.26:0/1756591225 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4cd00a1340 0x7f4cd0120770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:37.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.893+0000 7f4cd58d6700 1 -- 172.21.15.26:0/1756591225 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4cd00a1340 msgr2=0x7f4cd0120770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:37.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.893+0000 7f4cd58d6700 1 --2- 172.21.15.26:0/1756591225 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4cd00a1340 0x7f4cd0120770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:37.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.893+0000 7f4cd58d6700 1 -- 172.21.15.26:0/1756591225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cd00a0a30 msgr2=0x7f4cd0120230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:37.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.893+0000 7f4cd58d6700 1 --2- 172.21.15.26:0/1756591225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cd00a0a30 0x7f4cd0120230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:37.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.893+0000 7f4cd58d6700 1 -- 172.21.15.26:0/1756591225 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc00094a0 con 0x7f4cd0133fa0 2023-10-01T07:57:37.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.893+0000 7f4cd50d5700 1 --2- 172.21.15.26:0/1756591225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cd00a0a30 0x7f4cd0120230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:37.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.893+0000 7f4cd58d6700 1 --2- 172.21.15.26:0/1756591225 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4cd0133fa0 0x7f4cd0120cb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8009e50 tx=0x7f4cc800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:37.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.893+0000 7f4cc5ffb700 1 -- 172.21.15.26:0/1756591225 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc800ca90 con 0x7f4cd0133fa0 2023-10-01T07:57:37.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.893+0000 7f4cc5ffb700 1 -- 172.21.15.26:0/1756591225 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc800f040 con 0x7f4cd0133fa0 2023-10-01T07:57:37.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.893+0000 7f4cd7339700 1 -- 172.21.15.26:0/1756591225 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cc8009a70 con 0x7f4cd0133fa0 2023-10-01T07:57:37.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.893+0000 7f4cc5ffb700 1 -- 172.21.15.26:0/1756591225 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc800ce50 con 0x7f4cd0133fa0 2023-10-01T07:57:37.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.893+0000 7f4cd7339700 1 -- 172.21.15.26:0/1756591225 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ccc009550 con 0x7f4cd0133fa0 2023-10-01T07:57:37.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.894+0000 7f4cc5ffb700 1 -- 172.21.15.26:0/1756591225 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4cc8014480 con 0x7f4cd0133fa0 2023-10-01T07:57:37.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.894+0000 7f4cc5ffb700 1 -- 172.21.15.26:0/1756591225 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4cc803fbf0 con 0x7f4cd0133fa0 2023-10-01T07:57:37.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.895+0000 7f4cd7339700 1 -- 172.21.15.26:0/1756591225 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cd00a0220 con 0x7f4cd0133fa0 2023-10-01T07:57:37.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.900+0000 7f4cc5ffb700 1 -- 172.21.15.26:0/1756591225 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4cc8012930 con 0x7f4cd0133fa0 2023-10-01T07:57:37.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.918+0000 7f559727a700 1 Processor -- start 2023-10-01T07:57:37.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.918+0000 7f559727a700 1 -- start start 2023-10-01T07:57:37.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.919+0000 7f559727a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f55900a0a30 0x7f55900a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:37.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.919+0000 7f559727a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5590134170 0x7f559013bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:37.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.919+0000 7f559727a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f559009edd0 con 0x7f55900a1340 2023-10-01T07:57:37.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.919+0000 7f559727a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559009e1f0 con 0x7f5590134170 2023-10-01T07:57:37.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.919+0000 7f559727a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f559009dc50 con 0x7f55900a0a30 2023-10-01T07:57:37.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.919+0000 7f5595016700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f55900a0a30 0x7f55900a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:37.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.919+0000 7f5595016700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f55900a0a30 0x7f55900a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55512/0 (socket says 172.21.15.26:55512) 2023-10-01T07:57:37.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.919+0000 7f5595016700 1 -- 172.21.15.26:0/603778454 learned_addr learned my addr 172.21.15.26:0/603778454 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:37.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.919+0000 7f5595817700 1 --2- 172.21.15.26:0/603778454 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5590134170 0x7f559013bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.919+0000 7f5595016700 1 -- 172.21.15.26:0/603778454 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5590134170 msgr2=0x7f559013bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.919+0000 7f5595016700 1 --2- 172.21.15.26:0/603778454 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5590134170 0x7f559013bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.919+0000 7f5595016700 1 -- 172.21.15.26:0/603778454 >> v1:172.21.15.26:6789/0 conn(0x7f55900a1340 legacy=0x7f5590133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.919+0000 7f5595016700 1 -- 172.21.15.26:0/603778454 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55900a1fe0 con 0x7f55900a0a30 2023-10-01T07:57:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.919+0000 7f5587fff700 1 -- 172.21.15.26:0/603778454 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 109579963 0 0) 0x7f559009edd0 con 0x7f55900a1340 2023-10-01T07:57:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.919+0000 7f5595817700 1 --2- 172.21.15.26:0/603778454 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5590134170 0x7f559013bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.920+0000 7f5595016700 1 --2- 172.21.15.26:0/603778454 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f55900a0a30 0x7f55900a0e00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f558c009920 tx=0x7f558c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f991eb90cfbd1d0c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.920+0000 7f5587fff700 1 -- 172.21.15.26:0/603778454 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558c011830 con 0x7f55900a0a30 2023-10-01T07:57:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.920+0000 7f5587fff700 1 -- 172.21.15.26:0/603778454 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558c011990 con 0x7f55900a0a30 2023-10-01T07:57:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.920+0000 7f5587fff700 1 -- 172.21.15.26:0/603778454 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558c011d20 con 0x7f55900a0a30 2023-10-01T07:57:37.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.921+0000 7f559727a700 1 -- 172.21.15.26:0/603778454 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f55900a0a30 msgr2=0x7f55900a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:37.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.921+0000 7f559727a700 1 --2- 172.21.15.26:0/603778454 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f55900a0a30 0x7f55900a0e00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f558c009920 tx=0x7f558c009c30 comp rx=0 tx=0).stop 2023-10-01T07:57:37.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.921+0000 7f559727a700 1 -- 172.21.15.26:0/603778454 shutdown_connections 2023-10-01T07:57:37.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.921+0000 7f559727a700 1 --2- 172.21.15.26:0/603778454 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f55900a0a30 0x7f55900a0e00 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:37.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.921+0000 7f559727a700 1 --2- 172.21.15.26:0/603778454 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5590134170 0x7f559013bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:37.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.921+0000 7f559727a700 1 -- 172.21.15.26:0/603778454 >> 172.21.15.26:0/603778454 conn(0x7f55900a6550 msgr2=0x7f55900a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:37.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.921+0000 7f559727a700 1 -- 172.21.15.26:0/603778454 shutdown_connections 2023-10-01T07:57:37.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.921+0000 7f559727a700 1 -- 172.21.15.26:0/603778454 wait complete. 2023-10-01T07:57:37.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.922+0000 7f559727a700 1 Processor -- start 2023-10-01T07:57:37.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.922+0000 7f559727a700 1 -- start start 2023-10-01T07:57:37.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.922+0000 7f559727a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f55900a0a30 0x7f55901233f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:37.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.922+0000 7f559727a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f55900a1340 0x7f5590123930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:37.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.922+0000 7f559727a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5590134170 0x7f55901c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:37.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.922+0000 7f559727a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5590123060 con 0x7f5590134170 2023-10-01T07:57:37.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.922+0000 7f559727a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5590125ee0 con 0x7f55900a0a30 2023-10-01T07:57:37.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.922+0000 7f559727a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55901261a0 con 0x7f55900a1340 2023-10-01T07:57:37.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.922+0000 7f5594815700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f55900a1340 0x7f5590123930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:37.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.923+0000 7f5594815700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f55900a1340 0x7f5590123930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55528/0 (socket says 172.21.15.26:55528) 2023-10-01T07:57:37.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.923+0000 7f5594815700 1 -- 172.21.15.26:0/1054548565 learned_addr learned my addr 172.21.15.26:0/1054548565 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:37.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.923+0000 7f5595817700 1 --2- 172.21.15.26:0/1054548565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5590134170 0x7f55901c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:37.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.923+0000 7f5595016700 1 --2- 172.21.15.26:0/1054548565 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f55900a0a30 0x7f55901233f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:37.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.923+0000 7f5595817700 1 -- 172.21.15.26:0/1054548565 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f55900a1340 msgr2=0x7f5590123930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:37.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.923+0000 7f5595817700 1 --2- 172.21.15.26:0/1054548565 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f55900a1340 0x7f5590123930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:37.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.923+0000 7f5595817700 1 -- 172.21.15.26:0/1054548565 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f55900a0a30 msgr2=0x7f55901233f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:37.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.923+0000 7f5595817700 1 --2- 172.21.15.26:0/1054548565 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f55900a0a30 0x7f55901233f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:37.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.923+0000 7f5595817700 1 -- 172.21.15.26:0/1054548565 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5588009a70 con 0x7f5590134170 2023-10-01T07:57:37.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.923+0000 7f5594815700 1 --2- 172.21.15.26:0/1054548565 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f55900a1340 0x7f5590123930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:37.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.923+0000 7f5595016700 1 --2- 172.21.15.26:0/1054548565 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f55900a0a30 0x7f55901233f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:57:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.923+0000 7f5595817700 1 --2- 172.21.15.26:0/1054548565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5590134170 0x7f55901c84c0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f558800efc0 tx=0x7f558800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.923+0000 7f5585ffb700 1 -- 172.21.15.26:0/1054548565 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558800cb40 con 0x7f5590134170 2023-10-01T07:57:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.923+0000 7f5585ffb700 1 -- 172.21.15.26:0/1054548565 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558800f040 con 0x7f5590134170 2023-10-01T07:57:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.923+0000 7f5585ffb700 1 -- 172.21.15.26:0/1054548565 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5588003a20 con 0x7f5590134170 2023-10-01T07:57:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.923+0000 7f559727a700 1 -- 172.21.15.26:0/1054548565 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f558c009550 con 0x7f5590134170 2023-10-01T07:57:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.924+0000 7f559727a700 1 -- 172.21.15.26:0/1054548565 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55900a25e0 con 0x7f5590134170 2023-10-01T07:57:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.924+0000 7f5585ffb700 1 -- 172.21.15.26:0/1054548565 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5588014480 con 0x7f5590134170 2023-10-01T07:57:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.925+0000 7f559727a700 1 -- 172.21.15.26:0/1054548565 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f559009e7e0 con 0x7f5590134170 2023-10-01T07:57:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.925+0000 7f5585ffb700 1 -- 172.21.15.26:0/1054548565 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5588041530 con 0x7f5590134170 2023-10-01T07:57:37.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.934+0000 7f5585ffb700 1 -- 172.21.15.26:0/1054548565 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f558801d410 con 0x7f5590134170 2023-10-01T07:57:37.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.967+0000 7f67a796c700 1 Processor -- start 2023-10-01T07:57:37.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.967+0000 7f67a796c700 1 -- start start 2023-10-01T07:57:37.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.967+0000 7f67a796c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f67a009e1d0 0x7f67a0138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:37.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.967+0000 7f67a796c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f67a0139170 0x7f67a013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:37.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.968+0000 7f67a796c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67a009b120 con 0x7f67a009d6f0 2023-10-01T07:57:37.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.968+0000 7f67a796c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67a006b460 con 0x7f67a0139170 2023-10-01T07:57:37.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.968+0000 7f67a796c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67a009a7e0 con 0x7f67a009e1d0 2023-10-01T07:57:37.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.968+0000 7f67a4f07700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f67a009e1d0 0x7f67a0138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:37.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.968+0000 7f67a4f07700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f67a009e1d0 0x7f67a0138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55530/0 (socket says 172.21.15.26:55530) 2023-10-01T07:57:37.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.968+0000 7f67a4f07700 1 -- 172.21.15.26:0/1894487385 learned_addr learned my addr 172.21.15.26:0/1894487385 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:37.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.968+0000 7f67a5f09700 1 --2- 172.21.15.26:0/1894487385 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f67a0139170 0x7f67a013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:37.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.968+0000 7f67a4f07700 1 -- 172.21.15.26:0/1894487385 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f67a0139170 msgr2=0x7f67a013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:37.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.968+0000 7f67a4f07700 1 --2- 172.21.15.26:0/1894487385 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f67a0139170 0x7f67a013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:37.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.968+0000 7f6797fff700 1 -- 172.21.15.26:0/1894487385 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1685967178 0 0) 0x7f67a009b120 con 0x7f67a009d6f0 2023-10-01T07:57:37.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.968+0000 7f67a4f07700 1 -- 172.21.15.26:0/1894487385 >> v1:172.21.15.26:6789/0 conn(0x7f67a009d6f0 legacy=0x7f67a009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:37.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.968+0000 7f67a4f07700 1 -- 172.21.15.26:0/1894487385 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a009a500 con 0x7f67a009e1d0 2023-10-01T07:57:37.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.968+0000 7f67a4f07700 1 --2- 172.21.15.26:0/1894487385 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f67a009e1d0 0x7f67a0138c30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6790009950 tx=0x7f6790009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f38d94a2da002c14 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:37.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.968+0000 7f6797fff700 1 -- 172.21.15.26:0/1894487385 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6790011830 con 0x7f67a009e1d0 2023-10-01T07:57:37.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.969+0000 7f6797fff700 1 -- 172.21.15.26:0/1894487385 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6790011990 con 0x7f67a009e1d0 2023-10-01T07:57:37.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.969+0000 7f6797fff700 1 -- 172.21.15.26:0/1894487385 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6790011d40 con 0x7f67a009e1d0 2023-10-01T07:57:37.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.969+0000 7f67a796c700 1 -- 172.21.15.26:0/1894487385 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f67a009e1d0 msgr2=0x7f67a0138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:37.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.969+0000 7f67a796c700 1 --2- 172.21.15.26:0/1894487385 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f67a009e1d0 0x7f67a0138c30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6790009950 tx=0x7f6790009c60 comp rx=0 tx=0).stop 2023-10-01T07:57:37.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.969+0000 7f67a796c700 1 -- 172.21.15.26:0/1894487385 shutdown_connections 2023-10-01T07:57:37.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.969+0000 7f67a796c700 1 --2- 172.21.15.26:0/1894487385 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f67a0139170 0x7f67a013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:37.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.969+0000 7f67a796c700 1 --2- 172.21.15.26:0/1894487385 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f67a009e1d0 0x7f67a0138c30 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:37.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.969+0000 7f67a796c700 1 -- 172.21.15.26:0/1894487385 >> 172.21.15.26:0/1894487385 conn(0x7f67a0066f50 msgr2=0x7f67a009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:37.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.969+0000 7f67a796c700 1 -- 172.21.15.26:0/1894487385 shutdown_connections 2023-10-01T07:57:37.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.969+0000 7f67a796c700 1 -- 172.21.15.26:0/1894487385 wait complete. 2023-10-01T07:57:37.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.970+0000 7f67a796c700 1 Processor -- start 2023-10-01T07:57:37.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.970+0000 7f67a796c700 1 -- start start 2023-10-01T07:57:37.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.971+0000 7f67a796c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f67a009d6f0 0x7f67a0121750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:37.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.971+0000 7f67a796c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67a009e1d0 0x7f67a0121c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:37.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.971+0000 7f67a796c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f67a0139170 0x7f67a01221d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:37.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.971+0000 7f67a796c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a0124910 con 0x7f67a009e1d0 2023-10-01T07:57:37.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.971+0000 7f67a796c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67a0123310 con 0x7f67a0139170 2023-10-01T07:57:37.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.971+0000 7f67a796c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67a0137680 con 0x7f67a009d6f0 2023-10-01T07:57:37.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.971+0000 7f67a4f07700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67a009e1d0 0x7f67a0121c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:37.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.971+0000 7f67a4f07700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67a009e1d0 0x7f67a0121c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56656/0 (socket says 172.21.15.26:56656) 2023-10-01T07:57:37.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.971+0000 7f67a4f07700 1 -- 172.21.15.26:0/2905803422 learned_addr learned my addr 172.21.15.26:0/2905803422 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:37.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.971+0000 7f67a5f09700 1 --2- 172.21.15.26:0/2905803422 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f67a0139170 0x7f67a01221d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:37.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.971+0000 7f67a5f09700 1 -- 172.21.15.26:0/2905803422 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f67a009d6f0 msgr2=0x7f67a0121750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:37.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.971+0000 7f67a5f09700 1 --2- 172.21.15.26:0/2905803422 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f67a009d6f0 0x7f67a0121750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:37.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.971+0000 7f67a5f09700 1 -- 172.21.15.26:0/2905803422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67a009e1d0 msgr2=0x7f67a0121c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:37.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.971+0000 7f67a5f09700 1 --2- 172.21.15.26:0/2905803422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67a009e1d0 0x7f67a0121c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:37.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.971+0000 7f67a5f09700 1 -- 172.21.15.26:0/2905803422 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6790009550 con 0x7f67a0139170 2023-10-01T07:57:37.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.971+0000 7f67a4f07700 1 --2- 172.21.15.26:0/2905803422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67a009e1d0 0x7f67a0121c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:37.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.972+0000 7f67a5f09700 1 --2- 172.21.15.26:0/2905803422 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f67a0139170 0x7f67a01221d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6798009d90 tx=0x7f679800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:37.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.972+0000 7f6795ffb700 1 -- 172.21.15.26:0/2905803422 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6798009c00 con 0x7f67a0139170 2023-10-01T07:57:37.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.972+0000 7f6795ffb700 1 -- 172.21.15.26:0/2905803422 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f679800f040 con 0x7f67a0139170 2023-10-01T07:57:37.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.972+0000 7f67a796c700 1 -- 172.21.15.26:0/2905803422 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67a009c710 con 0x7f67a0139170 2023-10-01T07:57:37.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.972+0000 7f6795ffb700 1 -- 172.21.15.26:0/2905803422 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6798014480 con 0x7f67a0139170 2023-10-01T07:57:37.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.972+0000 7f67a796c700 1 -- 172.21.15.26:0/2905803422 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67a00a3b60 con 0x7f67a0139170 2023-10-01T07:57:37.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.973+0000 7f6795ffb700 1 -- 172.21.15.26:0/2905803422 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f67980145e0 con 0x7f67a0139170 2023-10-01T07:57:37.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.973+0000 7f67a796c700 1 -- 172.21.15.26:0/2905803422 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67a0074ea0 con 0x7f67a0139170 2023-10-01T07:57:37.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.973+0000 7f6795ffb700 1 -- 172.21.15.26:0/2905803422 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f67980402c0 con 0x7f67a0139170 2023-10-01T07:57:37.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:37.982+0000 7f6795ffb700 1 -- 172.21.15.26:0/2905803422 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6798007900 con 0x7f67a0139170 2023-10-01T07:57:38.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.117+0000 7f4cd7339700 1 -- 172.21.15.26:0/1756591225 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4cd0074ea0 con 0x7f4cd0133fa0 2023-10-01T07:57:38.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.118+0000 7f4cc5ffb700 1 -- 172.21.15.26:0/1756591225 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4cc8012340 con 0x7f4cd0133fa0 2023-10-01T07:57:38.119 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:38.120 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:38.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.120+0000 7f4cd7339700 1 -- 172.21.15.26:0/1756591225 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4cd0133fa0 msgr2=0x7f4cd0120cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:38.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.120+0000 7f4cd7339700 1 --2- 172.21.15.26:0/1756591225 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4cd0133fa0 0x7f4cd0120cb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8009e50 tx=0x7f4cc800c3a0 comp rx=0 tx=0).stop 2023-10-01T07:57:38.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.120+0000 7f4cd7339700 1 -- 172.21.15.26:0/1756591225 shutdown_connections 2023-10-01T07:57:38.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.120+0000 7f4cd7339700 1 --2- 172.21.15.26:0/1756591225 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4cd0133fa0 0x7f4cd0120cb0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:38.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.120+0000 7f4cd7339700 1 --2- 172.21.15.26:0/1756591225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cd00a0a30 0x7f4cd0120230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:38.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.120+0000 7f4cd7339700 1 --2- 172.21.15.26:0/1756591225 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4cd00a1340 0x7f4cd0120770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:38.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.120+0000 7f4cd7339700 1 -- 172.21.15.26:0/1756591225 >> 172.21.15.26:0/1756591225 conn(0x7f4cd00a6550 msgr2=0x7f4cd009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:38.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.120+0000 7f4cd7339700 1 -- 172.21.15.26:0/1756591225 shutdown_connections 2023-10-01T07:57:38.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.120+0000 7f4cd7339700 1 -- 172.21.15.26:0/1756591225 wait complete. 2023-10-01T07:57:38.137 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:38.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.146+0000 7f559727a700 1 -- 172.21.15.26:0/1054548565 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5590074ea0 con 0x7f5590134170 2023-10-01T07:57:38.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.147+0000 7f5585ffb700 1 -- 172.21.15.26:0/1054548565 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5588018020 con 0x7f5590134170 2023-10-01T07:57:38.147 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:38.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.149+0000 7f559727a700 1 -- 172.21.15.26:0/1054548565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5590134170 msgr2=0x7f55901c84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:38.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.149+0000 7f559727a700 1 --2- 172.21.15.26:0/1054548565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5590134170 0x7f55901c84c0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f558800efc0 tx=0x7f558800c3a0 comp rx=0 tx=0).stop 2023-10-01T07:57:38.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.149+0000 7f559727a700 1 -- 172.21.15.26:0/1054548565 shutdown_connections 2023-10-01T07:57:38.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.149+0000 7f559727a700 1 --2- 172.21.15.26:0/1054548565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5590134170 0x7f55901c84c0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:38.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.149+0000 7f559727a700 1 --2- 172.21.15.26:0/1054548565 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f55900a0a30 0x7f55901233f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:38.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.149+0000 7f559727a700 1 --2- 172.21.15.26:0/1054548565 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f55900a1340 0x7f5590123930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:38.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.149+0000 7f559727a700 1 -- 172.21.15.26:0/1054548565 >> 172.21.15.26:0/1054548565 conn(0x7f55900a6550 msgr2=0x7f559009edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:38.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.150+0000 7f559727a700 1 -- 172.21.15.26:0/1054548565 shutdown_connections 2023-10-01T07:57:38.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.150+0000 7f559727a700 1 -- 172.21.15.26:0/1054548565 wait complete. 2023-10-01T07:57:38.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:38.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.195+0000 7f67a796c700 1 -- 172.21.15.26:0/2905803422 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f67a006c360 con 0x7f67a0139170 2023-10-01T07:57:38.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.195+0000 7f6795ffb700 1 -- 172.21.15.26:0/2905803422 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6798007330 con 0x7f67a0139170 2023-10-01T07:57:38.196 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:38.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.197+0000 7f67a796c700 1 -- 172.21.15.26:0/2905803422 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f67a0139170 msgr2=0x7f67a01221d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.197+0000 7f67a796c700 1 --2- 172.21.15.26:0/2905803422 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f67a0139170 0x7f67a01221d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6798009d90 tx=0x7f679800c3a0 comp rx=0 tx=0).stop 2023-10-01T07:57:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.198+0000 7f67a796c700 1 -- 172.21.15.26:0/2905803422 shutdown_connections 2023-10-01T07:57:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.198+0000 7f67a796c700 1 --2- 172.21.15.26:0/2905803422 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f67a0139170 0x7f67a01221d0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.198+0000 7f67a796c700 1 --2- 172.21.15.26:0/2905803422 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f67a009d6f0 0x7f67a0121750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.198+0000 7f67a796c700 1 --2- 172.21.15.26:0/2905803422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67a009e1d0 0x7f67a0121c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.198+0000 7f67a796c700 1 -- 172.21.15.26:0/2905803422 >> 172.21.15.26:0/2905803422 conn(0x7f67a0066f50 msgr2=0x7f67a0070d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.198+0000 7f67a796c700 1 -- 172.21.15.26:0/2905803422 shutdown_connections 2023-10-01T07:57:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.198+0000 7f67a796c700 1 -- 172.21.15.26:0/2905803422 wait complete. 2023-10-01T07:57:38.212 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:38.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.264+0000 7f57c6690700 1 Processor -- start 2023-10-01T07:57:38.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.264+0000 7f57c6690700 1 -- start start 2023-10-01T07:57:38.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.265+0000 7f57c6690700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57c009e1d0 0x7f57c0138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:38.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.265+0000 7f57c6690700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f57c0139170 0x7f57c013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:38.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.265+0000 7f57c6690700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c009b120 con 0x7f57c009d6f0 2023-10-01T07:57:38.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.265+0000 7f57c6690700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c006b460 con 0x7f57c009e1d0 2023-10-01T07:57:38.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.265+0000 7f57c6690700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f57c009a7e0 con 0x7f57c0139170 2023-10-01T07:57:38.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.265+0000 7f57bf7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57c009e1d0 0x7f57c0138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:38.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.265+0000 7f57c4c2d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f57c0139170 0x7f57c013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:38.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.265+0000 7f57bffff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f57c009d6f0 0x7f57c009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35344/0 (socket says 172.21.15.26:35344) 2023-10-01T07:57:38.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.265+0000 7f57bffff700 1 -- 172.21.15.26:0/3657090623 learned_addr learned my addr 172.21.15.26:0/3657090623 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:38.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.265+0000 7f57bf7fe700 1 -- 172.21.15.26:0/3657090623 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f57c0139170 msgr2=0x7f57c013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:38.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.265+0000 7f57bf7fe700 1 --2- 172.21.15.26:0/3657090623 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f57c0139170 0x7f57c013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:38.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.265+0000 7f57bf7fe700 1 -- 172.21.15.26:0/3657090623 >> v1:172.21.15.26:6789/0 conn(0x7f57c009d6f0 legacy=0x7f57c009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:38.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.265+0000 7f57bf7fe700 1 -- 172.21.15.26:0/3657090623 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c009a500 con 0x7f57c009e1d0 2023-10-01T07:57:38.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.265+0000 7f57beffd700 1 -- 172.21.15.26:0/3657090623 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 689827316 0 0) 0x7f57c009b120 con 0x7f57c009d6f0 2023-10-01T07:57:38.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.265+0000 7f57c4c2d700 1 --2- 172.21.15.26:0/3657090623 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f57c0139170 0x7f57c013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:38.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.265+0000 7f57bf7fe700 1 --2- 172.21.15.26:0/3657090623 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57c009e1d0 0x7f57c0138c30 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f57b4009870 tx=0x7f57b4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69f1cc955b9758b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:38.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.266+0000 7f57beffd700 1 -- 172.21.15.26:0/3657090623 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b4011830 con 0x7f57c009e1d0 2023-10-01T07:57:38.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.266+0000 7f57beffd700 1 -- 172.21.15.26:0/3657090623 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b4011990 con 0x7f57c009e1d0 2023-10-01T07:57:38.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.266+0000 7f57beffd700 1 -- 172.21.15.26:0/3657090623 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b4011d20 con 0x7f57c009e1d0 2023-10-01T07:57:38.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.266+0000 7f57c6690700 1 -- 172.21.15.26:0/3657090623 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57c009e1d0 msgr2=0x7f57c0138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:38.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.266+0000 7f57c6690700 1 --2- 172.21.15.26:0/3657090623 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57c009e1d0 0x7f57c0138c30 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f57b4009870 tx=0x7f57b4009b80 comp rx=0 tx=0).stop 2023-10-01T07:57:38.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.266+0000 7f57c6690700 1 -- 172.21.15.26:0/3657090623 shutdown_connections 2023-10-01T07:57:38.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.266+0000 7f57c6690700 1 --2- 172.21.15.26:0/3657090623 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f57c0139170 0x7f57c013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:38.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.266+0000 7f57c6690700 1 --2- 172.21.15.26:0/3657090623 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57c009e1d0 0x7f57c0138c30 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:38.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.266+0000 7f57c6690700 1 -- 172.21.15.26:0/3657090623 >> 172.21.15.26:0/3657090623 conn(0x7f57c0066f50 msgr2=0x7f57c009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:38.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.266+0000 7f57c6690700 1 -- 172.21.15.26:0/3657090623 shutdown_connections 2023-10-01T07:57:38.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.266+0000 7f57c6690700 1 -- 172.21.15.26:0/3657090623 wait complete. 2023-10-01T07:57:38.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.267+0000 7f57c6690700 1 Processor -- start 2023-10-01T07:57:38.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.268+0000 7f57c6690700 1 -- start start 2023-10-01T07:57:38.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.268+0000 7f57c6690700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57c009d6f0 0x7f57c0120770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:38.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.268+0000 7f57c6690700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57c009e1d0 0x7f57c0120cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:38.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.268+0000 7f57c6690700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f57c0139170 0x7f57c01211f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:38.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.268+0000 7f57c6690700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c0122ba0 con 0x7f57c009d6f0 2023-10-01T07:57:38.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.268+0000 7f57c6690700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c0136610 con 0x7f57c009e1d0 2023-10-01T07:57:38.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.268+0000 7f57c6690700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f57c009c710 con 0x7f57c0139170 2023-10-01T07:57:38.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.268+0000 7f57bffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57c009d6f0 0x7f57c0120770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:38.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.268+0000 7f57bf7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57c009e1d0 0x7f57c0120cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:38.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.268+0000 7f57bffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57c009d6f0 0x7f57c0120770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56662/0 (socket says 172.21.15.26:56662) 2023-10-01T07:57:38.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.268+0000 7f57bf7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57c009e1d0 0x7f57c0120cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47476/0 (socket says 172.21.15.26:47476) 2023-10-01T07:57:38.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.268+0000 7f57bffff700 1 -- 172.21.15.26:0/4101425942 learned_addr learned my addr 172.21.15.26:0/4101425942 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:38.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.268+0000 7f57c4c2d700 1 --2- 172.21.15.26:0/4101425942 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f57c0139170 0x7f57c01211f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:38.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.268+0000 7f57bf7fe700 1 -- 172.21.15.26:0/4101425942 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f57c0139170 msgr2=0x7f57c01211f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:38.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.268+0000 7f57bf7fe700 1 --2- 172.21.15.26:0/4101425942 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f57c0139170 0x7f57c01211f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:38.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.269+0000 7f57bf7fe700 1 -- 172.21.15.26:0/4101425942 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57c009d6f0 msgr2=0x7f57c0120770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:38.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.269+0000 7f57bf7fe700 1 --2- 172.21.15.26:0/4101425942 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57c009d6f0 0x7f57c0120770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:38.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.269+0000 7f57bf7fe700 1 -- 172.21.15.26:0/4101425942 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b8009a70 con 0x7f57c009e1d0 2023-10-01T07:57:38.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.269+0000 7f57bffff700 1 --2- 172.21.15.26:0/4101425942 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57c009d6f0 0x7f57c0120770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:38.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.269+0000 7f57bf7fe700 1 --2- 172.21.15.26:0/4101425942 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57c009e1d0 0x7f57c0120cb0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f57b4009870 tx=0x7f57b4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:38.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.269+0000 7f57bcff9700 1 -- 172.21.15.26:0/4101425942 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b4024620 con 0x7f57c009e1d0 2023-10-01T07:57:38.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.269+0000 7f57bcff9700 1 -- 172.21.15.26:0/4101425942 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b40247a0 con 0x7f57c009e1d0 2023-10-01T07:57:38.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.269+0000 7f57c6690700 1 -- 172.21.15.26:0/4101425942 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b40094a0 con 0x7f57c009e1d0 2023-10-01T07:57:38.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.269+0000 7f57bcff9700 1 -- 172.21.15.26:0/4101425942 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b4024b50 con 0x7f57c009e1d0 2023-10-01T07:57:38.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.269+0000 7f57c6690700 1 -- 172.21.15.26:0/4101425942 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c0072150 con 0x7f57c009e1d0 2023-10-01T07:57:38.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.270+0000 7f57bcff9700 1 -- 172.21.15.26:0/4101425942 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f57b4022070 con 0x7f57c009e1d0 2023-10-01T07:57:38.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.270+0000 7f57bcff9700 1 -- 172.21.15.26:0/4101425942 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f57b4040820 con 0x7f57c009e1d0 2023-10-01T07:57:38.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.270+0000 7f57c6690700 1 -- 172.21.15.26:0/4101425942 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c0074ea0 con 0x7f57c009e1d0 2023-10-01T07:57:38.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.275+0000 7f57bcff9700 1 -- 172.21.15.26:0/4101425942 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f57b4022320 con 0x7f57c009e1d0 2023-10-01T07:57:38.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.478+0000 7f57c6690700 1 -- 172.21.15.26:0/4101425942 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f57c006c360 con 0x7f57c009e1d0 2023-10-01T07:57:38.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.479+0000 7f57bcff9700 1 -- 172.21.15.26:0/4101425942 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f57b4015030 con 0x7f57c009e1d0 2023-10-01T07:57:38.479 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:38.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.481+0000 7f57c6690700 1 -- 172.21.15.26:0/4101425942 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57c009e1d0 msgr2=0x7f57c0120cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:38.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.481+0000 7f57c6690700 1 --2- 172.21.15.26:0/4101425942 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57c009e1d0 0x7f57c0120cb0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f57b4009870 tx=0x7f57b4004750 comp rx=0 tx=0).stop 2023-10-01T07:57:38.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.481+0000 7f57c6690700 1 -- 172.21.15.26:0/4101425942 shutdown_connections 2023-10-01T07:57:38.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.481+0000 7f57c6690700 1 --2- 172.21.15.26:0/4101425942 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f57c0139170 0x7f57c01211f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:38.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.481+0000 7f57c6690700 1 --2- 172.21.15.26:0/4101425942 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57c009d6f0 0x7f57c0120770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:38.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.481+0000 7f57c6690700 1 --2- 172.21.15.26:0/4101425942 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57c009e1d0 0x7f57c0120cb0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:38.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.481+0000 7f57c6690700 1 -- 172.21.15.26:0/4101425942 >> 172.21.15.26:0/4101425942 conn(0x7f57c0066f50 msgr2=0x7f57c0136b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:38.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.481+0000 7f57c6690700 1 -- 172.21.15.26:0/4101425942 shutdown_connections 2023-10-01T07:57:38.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:38.481+0000 7f57c6690700 1 -- 172.21.15.26:0/4101425942 wait complete. 2023-10-01T07:57:38.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:39.138 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:39.168 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:39.212 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:39.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.288+0000 7feaee817700 1 Processor -- start 2023-10-01T07:57:39.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.288+0000 7feaee817700 1 -- start start 2023-10-01T07:57:39.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.289+0000 7feaee817700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feae809d6f0 0x7feae809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:39.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.289+0000 7feaee817700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feae809e000 0x7feae81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:39.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.289+0000 7feaee817700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae809b120 con 0x7feae809e410 2023-10-01T07:57:39.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.289+0000 7feaee817700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae806b460 con 0x7feae809e000 2023-10-01T07:57:39.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.289+0000 7feaee817700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feae809a7e0 con 0x7feae809d6f0 2023-10-01T07:57:39.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.289+0000 7feaecdb4700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7feae809e410 0x7feae8133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35354/0 (socket says 172.21.15.26:35354) 2023-10-01T07:57:39.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.289+0000 7feaecdb4700 1 -- 172.21.15.26:0/4094240073 learned_addr learned my addr 172.21.15.26:0/4094240073 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:39.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.289+0000 7feae77fe700 1 --2- 172.21.15.26:0/4094240073 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feae809e000 0x7feae81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:39.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.289+0000 7feae7fff700 1 --2- 172.21.15.26:0/4094240073 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feae809d6f0 0x7feae809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:39.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.289+0000 7feae7fff700 1 -- 172.21.15.26:0/4094240073 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feae809e000 msgr2=0x7feae81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:39.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.289+0000 7feae7fff700 1 --2- 172.21.15.26:0/4094240073 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feae809e000 0x7feae81339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.289+0000 7feae7fff700 1 -- 172.21.15.26:0/4094240073 >> v1:172.21.15.26:6789/0 conn(0x7feae809e410 legacy=0x7feae8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:39.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.289+0000 7feae6ffd700 1 -- 172.21.15.26:0/4094240073 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 281143316 0 0) 0x7feae809b120 con 0x7feae809e410 2023-10-01T07:57:39.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.289+0000 7feae7fff700 1 -- 172.21.15.26:0/4094240073 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae809a500 con 0x7feae809d6f0 2023-10-01T07:57:39.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.290+0000 7feae7fff700 1 --2- 172.21.15.26:0/4094240073 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feae809d6f0 0x7feae809dac0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fead80098a0 tx=0x7fead8009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2dc394004f7a4de server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:39.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.290+0000 7feae6ffd700 1 -- 172.21.15.26:0/4094240073 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead8011830 con 0x7feae809d6f0 2023-10-01T07:57:39.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.290+0000 7feae6ffd700 1 -- 172.21.15.26:0/4094240073 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead8011990 con 0x7feae809d6f0 2023-10-01T07:57:39.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.290+0000 7feae6ffd700 1 -- 172.21.15.26:0/4094240073 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead8011d20 con 0x7feae809d6f0 2023-10-01T07:57:39.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.290+0000 7feaee817700 1 -- 172.21.15.26:0/4094240073 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feae809d6f0 msgr2=0x7feae809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:39.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.290+0000 7feaee817700 1 --2- 172.21.15.26:0/4094240073 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feae809d6f0 0x7feae809dac0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fead80098a0 tx=0x7fead8009bb0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.291+0000 7feaee817700 1 -- 172.21.15.26:0/4094240073 shutdown_connections 2023-10-01T07:57:39.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.291+0000 7feaee817700 1 --2- 172.21.15.26:0/4094240073 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feae809d6f0 0x7feae809dac0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.291+0000 7feaee817700 1 --2- 172.21.15.26:0/4094240073 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feae809e000 0x7feae81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.291+0000 7feaee817700 1 -- 172.21.15.26:0/4094240073 >> 172.21.15.26:0/4094240073 conn(0x7feae8066f50 msgr2=0x7feae809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:39.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.291+0000 7feaee817700 1 -- 172.21.15.26:0/4094240073 shutdown_connections 2023-10-01T07:57:39.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.291+0000 7feaee817700 1 -- 172.21.15.26:0/4094240073 wait complete. 2023-10-01T07:57:39.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.292+0000 7feaee817700 1 Processor -- start 2023-10-01T07:57:39.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.292+0000 7feaee817700 1 -- start start 2023-10-01T07:57:39.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.293+0000 7feaee817700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feae809d6f0 0x7feae81c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:39.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.293+0000 7feaee817700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feae809e000 0x7feae81c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:39.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.293+0000 7feaee817700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feae809e410 0x7feae81c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:39.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.293+0000 7feaee817700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae81a7020 con 0x7feae809e000 2023-10-01T07:57:39.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.293+0000 7feaee817700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae81a64a0 con 0x7feae809d6f0 2023-10-01T07:57:39.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.293+0000 7feaee817700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feae81a7c90 con 0x7feae809e410 2023-10-01T07:57:39.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.293+0000 7feae7fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feae809d6f0 0x7feae81c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:39.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.293+0000 7feae77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feae809e000 0x7feae81c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:39.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.293+0000 7feae7fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feae809d6f0 0x7feae81c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47496/0 (socket says 172.21.15.26:47496) 2023-10-01T07:57:39.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.293+0000 7feae7fff700 1 -- 172.21.15.26:0/2435178673 learned_addr learned my addr 172.21.15.26:0/2435178673 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:39.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.293+0000 7feaecdb4700 1 --2- 172.21.15.26:0/2435178673 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feae809e410 0x7feae81c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:39.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.294+0000 7feae7fff700 1 -- 172.21.15.26:0/2435178673 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feae809e410 msgr2=0x7feae81c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:39.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.294+0000 7feae7fff700 1 --2- 172.21.15.26:0/2435178673 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feae809e410 0x7feae81c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.294+0000 7feae7fff700 1 -- 172.21.15.26:0/2435178673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feae809e000 msgr2=0x7feae81c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:39.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.294+0000 7feae7fff700 1 --2- 172.21.15.26:0/2435178673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feae809e000 0x7feae81c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.294+0000 7feae7fff700 1 -- 172.21.15.26:0/2435178673 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead80094a0 con 0x7feae809d6f0 2023-10-01T07:57:39.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.294+0000 7feae7fff700 1 --2- 172.21.15.26:0/2435178673 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feae809d6f0 0x7feae81c8020 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fead8000c00 tx=0x7fead8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:39.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.294+0000 7feae4ff9700 1 -- 172.21.15.26:0/2435178673 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead8004450 con 0x7feae809d6f0 2023-10-01T07:57:39.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.294+0000 7feae4ff9700 1 -- 172.21.15.26:0/2435178673 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead801f070 con 0x7feae809d6f0 2023-10-01T07:57:39.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.294+0000 7feaee817700 1 -- 172.21.15.26:0/2435178673 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae80a1e90 con 0x7feae809d6f0 2023-10-01T07:57:39.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.294+0000 7feae4ff9700 1 -- 172.21.15.26:0/2435178673 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead80038e0 con 0x7feae809d6f0 2023-10-01T07:57:39.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.294+0000 7feaee817700 1 -- 172.21.15.26:0/2435178673 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae81b91c0 con 0x7feae809d6f0 2023-10-01T07:57:39.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.295+0000 7feae4ff9700 1 -- 172.21.15.26:0/2435178673 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fead8003a40 con 0x7feae809d6f0 2023-10-01T07:57:39.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.295+0000 7feae4ff9700 1 -- 172.21.15.26:0/2435178673 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fead8021070 con 0x7feae809d6f0 2023-10-01T07:57:39.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.296+0000 7feaee817700 1 -- 172.21.15.26:0/2435178673 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae81a7eb0 con 0x7feae809d6f0 2023-10-01T07:57:39.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.301+0000 7feae4ff9700 1 -- 172.21.15.26:0/2435178673 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fead802b020 con 0x7feae809d6f0 2023-10-01T07:57:39.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.336+0000 7f62f5ac7700 1 Processor -- start 2023-10-01T07:57:39.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.336+0000 7f62f5ac7700 1 -- start start 2023-10-01T07:57:39.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.337+0000 7f62f5ac7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f62f009e1d0 0x7f62f0135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:39.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.337+0000 7f62f5ac7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62f0135e50 0x7f62f0138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:39.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.337+0000 7f62f5ac7700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f009f130 con 0x7f62f009d6f0 2023-10-01T07:57:39.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.337+0000 7f62f5ac7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f009f520 con 0x7f62f009e1d0 2023-10-01T07:57:39.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.337+0000 7f62f5ac7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62f009e930 con 0x7f62f0135e50 2023-10-01T07:57:39.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.337+0000 7f62eeffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f62f009e1d0 0x7f62f0135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:39.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.337+0000 7f62eeffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f62f009e1d0 0x7f62f0135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56692/0 (socket says 172.21.15.26:56692) 2023-10-01T07:57:39.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.337+0000 7f62eeffd700 1 -- 172.21.15.26:0/332479437 learned_addr learned my addr 172.21.15.26:0/332479437 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:39.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.337+0000 7f62effff700 1 --2- 172.21.15.26:0/332479437 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62f0135e50 0x7f62f0138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:39.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.337+0000 7f62eeffd700 1 -- 172.21.15.26:0/332479437 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62f0135e50 msgr2=0x7f62f0138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:39.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.337+0000 7f62eeffd700 1 --2- 172.21.15.26:0/332479437 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62f0135e50 0x7f62f0138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.338+0000 7f62eeffd700 1 -- 172.21.15.26:0/332479437 >> v1:172.21.15.26:6789/0 conn(0x7f62f009d6f0 legacy=0x7f62f009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:39.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.338+0000 7f62eeffd700 1 -- 172.21.15.26:0/332479437 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f009b2d0 con 0x7f62f009e1d0 2023-10-01T07:57:39.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.338+0000 7f62ee7fc700 1 -- 172.21.15.26:0/332479437 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4165964910 0 0) 0x7f62f009f130 con 0x7f62f009d6f0 2023-10-01T07:57:39.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.338+0000 7f62eeffd700 1 --2- 172.21.15.26:0/332479437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62f009e1d0 0x7f62f0135910 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f62e40098f0 tx=0x7f62e4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea6d3bb1a9442ec server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:39.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.338+0000 7f62ee7fc700 1 -- 172.21.15.26:0/332479437 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e4011830 con 0x7f62f009e1d0 2023-10-01T07:57:39.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.338+0000 7f62ee7fc700 1 -- 172.21.15.26:0/332479437 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e4011990 con 0x7f62f009e1d0 2023-10-01T07:57:39.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.338+0000 7f62ee7fc700 1 -- 172.21.15.26:0/332479437 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e4011d20 con 0x7f62f009e1d0 2023-10-01T07:57:39.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.339+0000 7f62f5ac7700 1 -- 172.21.15.26:0/332479437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62f009e1d0 msgr2=0x7f62f0135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:39.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.339+0000 7f62f5ac7700 1 --2- 172.21.15.26:0/332479437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62f009e1d0 0x7f62f0135910 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f62e40098f0 tx=0x7f62e4009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:39.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.339+0000 7f62f5ac7700 1 -- 172.21.15.26:0/332479437 shutdown_connections 2023-10-01T07:57:39.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.339+0000 7f62f5ac7700 1 --2- 172.21.15.26:0/332479437 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62f0135e50 0x7f62f0138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.339+0000 7f62f5ac7700 1 --2- 172.21.15.26:0/332479437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62f009e1d0 0x7f62f0135910 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.339+0000 7f62f5ac7700 1 -- 172.21.15.26:0/332479437 >> 172.21.15.26:0/332479437 conn(0x7f62f0066f50 msgr2=0x7f62f009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:39.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.339+0000 7f62f5ac7700 1 -- 172.21.15.26:0/332479437 shutdown_connections 2023-10-01T07:57:39.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.339+0000 7f62f5ac7700 1 -- 172.21.15.26:0/332479437 wait complete. 2023-10-01T07:57:39.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.340+0000 7f62f5ac7700 1 Processor -- start 2023-10-01T07:57:39.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.340+0000 7f62f5ac7700 1 -- start start 2023-10-01T07:57:39.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.341+0000 7f62f5ac7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62f009d6f0 0x7f62f011d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:39.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.341+0000 7f62f5ac7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62f009e1d0 0x7f62f011d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.341+0000 7f62f5ac7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62f0135e50 0x7f62f011de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.341+0000 7f62f5ac7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f011f0e0 con 0x7f62f009d6f0 2023-10-01T07:57:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.341+0000 7f62f5ac7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f0120c00 con 0x7f62f009e1d0 2023-10-01T07:57:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.341+0000 7f62f5ac7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62f00a1b80 con 0x7f62f0135e50 2023-10-01T07:57:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.341+0000 7f62ef7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62f009d6f0 0x7f62f011d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.341+0000 7f62eeffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62f009e1d0 0x7f62f011d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.341+0000 7f62ef7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62f009d6f0 0x7f62f011d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56704/0 (socket says 172.21.15.26:56704) 2023-10-01T07:57:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.341+0000 7f62ef7fe700 1 -- 172.21.15.26:0/632947324 learned_addr learned my addr 172.21.15.26:0/632947324 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.341+0000 7f62effff700 1 --2- 172.21.15.26:0/632947324 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62f0135e50 0x7f62f011de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.342+0000 7f62eeffd700 1 -- 172.21.15.26:0/632947324 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62f0135e50 msgr2=0x7f62f011de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.342+0000 7f62eeffd700 1 --2- 172.21.15.26:0/632947324 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62f0135e50 0x7f62f011de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.342+0000 7f62eeffd700 1 -- 172.21.15.26:0/632947324 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62f009d6f0 msgr2=0x7f62f011d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:39.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.342+0000 7f62eeffd700 1 --2- 172.21.15.26:0/632947324 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62f009d6f0 0x7f62f011d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.342+0000 7f62eeffd700 1 -- 172.21.15.26:0/632947324 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e4009550 con 0x7f62f009e1d0 2023-10-01T07:57:39.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.342+0000 7f62ef7fe700 1 --2- 172.21.15.26:0/632947324 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62f009d6f0 0x7f62f011d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:39.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.342+0000 7f62eeffd700 1 --2- 172.21.15.26:0/632947324 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62f009e1d0 0x7f62f011d900 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f62e4016000 tx=0x7f62e4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:39.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.342+0000 7f62d7fff700 1 -- 172.21.15.26:0/632947324 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e4004380 con 0x7f62f009e1d0 2023-10-01T07:57:39.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.342+0000 7f62d7fff700 1 -- 172.21.15.26:0/632947324 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e4023070 con 0x7f62f009e1d0 2023-10-01T07:57:39.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.342+0000 7f62d7fff700 1 -- 172.21.15.26:0/632947324 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e401f840 con 0x7f62f009e1d0 2023-10-01T07:57:39.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.342+0000 7f62f5ac7700 1 -- 172.21.15.26:0/632947324 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f011f7c0 con 0x7f62f009e1d0 2023-10-01T07:57:39.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.342+0000 7f62f5ac7700 1 -- 172.21.15.26:0/632947324 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f01215e0 con 0x7f62f009e1d0 2023-10-01T07:57:39.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.343+0000 7f62d7fff700 1 -- 172.21.15.26:0/632947324 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f62e4025030 con 0x7f62f009e1d0 2023-10-01T07:57:39.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.343+0000 7f62d7fff700 1 -- 172.21.15.26:0/632947324 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f62e4044cb0 con 0x7f62f009e1d0 2023-10-01T07:57:39.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.344+0000 7f62f5ac7700 1 -- 172.21.15.26:0/632947324 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f0074ea0 con 0x7f62f009e1d0 2023-10-01T07:57:39.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.349+0000 7f62d7fff700 1 -- 172.21.15.26:0/632947324 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f62e4015080 con 0x7f62f009e1d0 2023-10-01T07:57:39.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.371+0000 7fb4a17b0700 1 Processor -- start 2023-10-01T07:57:39.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.371+0000 7fb4a17b0700 1 -- start start 2023-10-01T07:57:39.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.371+0000 7fb4a17b0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb49c0a09c0 0x7fb49c0a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:39.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.371+0000 7fb4a17b0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb49c09d5c0 0x7fb49c0a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:39.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.371+0000 7fb4a17b0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb49c133920 0x7fb49c133dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:39.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.371+0000 7fb4a17b0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb49c0a1810 con 0x7fb49c09d5c0 2023-10-01T07:57:39.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.371+0000 7fb4a17b0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb49c09ea10 con 0x7fb49c133920 2023-10-01T07:57:39.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.371+0000 7fb4a17b0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb49c09e210 con 0x7fb49c0a09c0 2023-10-01T07:57:39.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.372+0000 7fb49affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb49c0a09c0 0x7fb49c0a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:39.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.372+0000 7fb49a7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb49c09d5c0 0x7fb49c0a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:39.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.372+0000 7fb49affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb49c0a09c0 0x7fb49c0a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55614/0 (socket says 172.21.15.26:55614) 2023-10-01T07:57:39.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.372+0000 7fb49affd700 1 -- 172.21.15.26:0/3576642300 learned_addr learned my addr 172.21.15.26:0/3576642300 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:39.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.372+0000 7fb49b7fe700 1 --2- 172.21.15.26:0/3576642300 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb49c133920 0x7fb49c133dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:39.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.372+0000 7fb49a7fc700 1 -- 172.21.15.26:0/3576642300 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb49c0a09c0 msgr2=0x7fb49c0a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:39.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.372+0000 7fb49a7fc700 1 --2- 172.21.15.26:0/3576642300 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb49c0a09c0 0x7fb49c0a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.372+0000 7fb49a7fc700 1 -- 172.21.15.26:0/3576642300 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb49c133920 msgr2=0x7fb49c133dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:39.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.372+0000 7fb49a7fc700 1 --2- 172.21.15.26:0/3576642300 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb49c133920 0x7fb49c133dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.372+0000 7fb49a7fc700 1 -- 172.21.15.26:0/3576642300 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb49c0a26f0 con 0x7fb49c09d5c0 2023-10-01T07:57:39.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.372+0000 7fb49affd700 1 --2- 172.21.15.26:0/3576642300 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb49c0a09c0 0x7fb49c0a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:39.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.372+0000 7fb49b7fe700 1 --2- 172.21.15.26:0/3576642300 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb49c133920 0x7fb49c133dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:39.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.372+0000 7fb49a7fc700 1 --2- 172.21.15.26:0/3576642300 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb49c09d5c0 0x7fb49c0a12d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fb490009840 tx=0x7fb490009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27347121ab0d83b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:39.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.372+0000 7fb499ffb700 1 -- 172.21.15.26:0/3576642300 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb490011830 con 0x7fb49c09d5c0 2023-10-01T07:57:39.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.372+0000 7fb499ffb700 1 -- 172.21.15.26:0/3576642300 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb490011990 con 0x7fb49c09d5c0 2023-10-01T07:57:39.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.372+0000 7fb499ffb700 1 -- 172.21.15.26:0/3576642300 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb490011d20 con 0x7fb49c09d5c0 2023-10-01T07:57:39.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.373+0000 7fb4a17b0700 1 -- 172.21.15.26:0/3576642300 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb49c09d5c0 msgr2=0x7fb49c0a12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:39.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.373+0000 7fb4a17b0700 1 --2- 172.21.15.26:0/3576642300 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb49c09d5c0 0x7fb49c0a12d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fb490009840 tx=0x7fb490009b50 comp rx=0 tx=0).stop 2023-10-01T07:57:39.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.373+0000 7fb4a17b0700 1 -- 172.21.15.26:0/3576642300 shutdown_connections 2023-10-01T07:57:39.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.373+0000 7fb4a17b0700 1 --2- 172.21.15.26:0/3576642300 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb49c133920 0x7fb49c133dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.373+0000 7fb4a17b0700 1 --2- 172.21.15.26:0/3576642300 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb49c0a09c0 0x7fb49c0a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.373+0000 7fb4a17b0700 1 --2- 172.21.15.26:0/3576642300 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb49c09d5c0 0x7fb49c0a12d0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.373+0000 7fb4a17b0700 1 -- 172.21.15.26:0/3576642300 >> 172.21.15.26:0/3576642300 conn(0x7fb49c0a2fe0 msgr2=0x7fb49c0a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:39.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.373+0000 7fb4a17b0700 1 -- 172.21.15.26:0/3576642300 shutdown_connections 2023-10-01T07:57:39.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.373+0000 7fb4a17b0700 1 -- 172.21.15.26:0/3576642300 wait complete. 2023-10-01T07:57:39.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.374+0000 7fb4a17b0700 1 Processor -- start 2023-10-01T07:57:39.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.374+0000 7fb4a17b0700 1 -- start start 2023-10-01T07:57:39.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.375+0000 7fb4a17b0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb49c09d5c0 0x7fb49c11e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:39.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.375+0000 7fb4a17b0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb49c0a09c0 0x7fb49c11e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:39.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.375+0000 7fb4a17b0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb49c133920 0x7fb49c11ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:39.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.375+0000 7fb4a17b0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49c121970 con 0x7fb49c0a09c0 2023-10-01T07:57:39.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.375+0000 7fb4a17b0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb49c11fca0 con 0x7fb49c133920 2023-10-01T07:57:39.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.375+0000 7fb4a17b0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb49c120ef0 con 0x7fb49c09d5c0 2023-10-01T07:57:39.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.375+0000 7fb49a7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb49c0a09c0 0x7fb49c11e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:39.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.375+0000 7fb49a7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb49c0a09c0 0x7fb49c11e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56724/0 (socket says 172.21.15.26:56724) 2023-10-01T07:57:39.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.375+0000 7fb49a7fc700 1 -- 172.21.15.26:0/431791806 learned_addr learned my addr 172.21.15.26:0/431791806 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:39.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.375+0000 7fb49affd700 1 --2- 172.21.15.26:0/431791806 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb49c09d5c0 0x7fb49c11e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:39.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.375+0000 7fb49b7fe700 1 --2- 172.21.15.26:0/431791806 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb49c133920 0x7fb49c11ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:39.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.375+0000 7fb49affd700 1 -- 172.21.15.26:0/431791806 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb49c133920 msgr2=0x7fb49c11ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:39.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.375+0000 7fb49affd700 1 --2- 172.21.15.26:0/431791806 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb49c133920 0x7fb49c11ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.375+0000 7fb49affd700 1 -- 172.21.15.26:0/431791806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb49c0a09c0 msgr2=0x7fb49c11e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:39.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.375+0000 7fb49affd700 1 --2- 172.21.15.26:0/431791806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb49c0a09c0 0x7fb49c11e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.375+0000 7fb49affd700 1 -- 172.21.15.26:0/431791806 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48c009550 con 0x7fb49c09d5c0 2023-10-01T07:57:39.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.375+0000 7fb49a7fc700 1 --2- 172.21.15.26:0/431791806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb49c0a09c0 0x7fb49c11e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:39.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.376+0000 7fb49affd700 1 --2- 172.21.15.26:0/431791806 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb49c09d5c0 0x7fb49c11e130 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb48c00e9d0 tx=0x7fb48c00ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:39.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.376+0000 7fb4837fe700 1 -- 172.21.15.26:0/431791806 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c004030 con 0x7fb49c09d5c0 2023-10-01T07:57:39.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.376+0000 7fb4837fe700 1 -- 172.21.15.26:0/431791806 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48c004190 con 0x7fb49c09d5c0 2023-10-01T07:57:39.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.376+0000 7fb4a17b0700 1 -- 172.21.15.26:0/431791806 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb494009a70 con 0x7fb49c09d5c0 2023-10-01T07:57:39.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.376+0000 7fb4837fe700 1 -- 172.21.15.26:0/431791806 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c004520 con 0x7fb49c09d5c0 2023-10-01T07:57:39.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.376+0000 7fb4a17b0700 1 -- 172.21.15.26:0/431791806 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4900094a0 con 0x7fb49c09d5c0 2023-10-01T07:57:39.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.377+0000 7fb4837fe700 1 -- 172.21.15.26:0/431791806 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb48c00c850 con 0x7fb49c09d5c0 2023-10-01T07:57:39.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.377+0000 7fb4837fe700 1 -- 172.21.15.26:0/431791806 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb48c03f940 con 0x7fb49c09d5c0 2023-10-01T07:57:39.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.377+0000 7fb4a17b0700 1 -- 172.21.15.26:0/431791806 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb49c0a4000 con 0x7fb49c09d5c0 2023-10-01T07:57:39.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.382+0000 7fb4837fe700 1 -- 172.21.15.26:0/431791806 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb48c0036a0 con 0x7fb49c09d5c0 2023-10-01T07:57:39.496 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:39.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.549+0000 7feaee817700 1 -- 172.21.15.26:0/2435178673 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7feae8074ea0 con 0x7feae809d6f0 2023-10-01T07:57:39.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.550+0000 7feae4ff9700 1 -- 172.21.15.26:0/2435178673 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fead8015070 con 0x7feae809d6f0 2023-10-01T07:57:39.550 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:39.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.552+0000 7feaee817700 1 -- 172.21.15.26:0/2435178673 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feae809d6f0 msgr2=0x7feae81c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:39.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.552+0000 7feaee817700 1 --2- 172.21.15.26:0/2435178673 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feae809d6f0 0x7feae81c8020 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fead8000c00 tx=0x7fead8004750 comp rx=0 tx=0).stop 2023-10-01T07:57:39.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.552+0000 7feaee817700 1 -- 172.21.15.26:0/2435178673 shutdown_connections 2023-10-01T07:57:39.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.552+0000 7feaee817700 1 --2- 172.21.15.26:0/2435178673 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feae809e410 0x7feae81c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.552+0000 7feaee817700 1 --2- 172.21.15.26:0/2435178673 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feae809d6f0 0x7feae81c8020 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.552+0000 7feaee817700 1 --2- 172.21.15.26:0/2435178673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feae809e000 0x7feae81c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.552+0000 7feaee817700 1 -- 172.21.15.26:0/2435178673 >> 172.21.15.26:0/2435178673 conn(0x7feae8066f50 msgr2=0x7feae81bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:39.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.552+0000 7feaee817700 1 -- 172.21.15.26:0/2435178673 shutdown_connections 2023-10-01T07:57:39.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.552+0000 7feaee817700 1 -- 172.21.15.26:0/2435178673 wait complete. 2023-10-01T07:57:39.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:39.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.589+0000 7f62f5ac7700 1 -- 172.21.15.26:0/632947324 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f62f006c360 con 0x7f62f009e1d0 2023-10-01T07:57:39.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.590+0000 7f62d7fff700 1 -- 172.21.15.26:0/632947324 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f62e401f9a0 con 0x7f62f009e1d0 2023-10-01T07:57:39.591 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:39.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.592+0000 7fb4a17b0700 1 -- 172.21.15.26:0/431791806 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb49c09cec0 con 0x7fb49c09d5c0 2023-10-01T07:57:39.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.592+0000 7f62f5ac7700 1 -- 172.21.15.26:0/632947324 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62f009e1d0 msgr2=0x7f62f011d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:39.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.592+0000 7f62f5ac7700 1 --2- 172.21.15.26:0/632947324 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62f009e1d0 0x7f62f011d900 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f62e4016000 tx=0x7f62e4004750 comp rx=0 tx=0).stop 2023-10-01T07:57:39.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.592+0000 7fb4837fe700 1 -- 172.21.15.26:0/431791806 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb48c013e60 con 0x7fb49c09d5c0 2023-10-01T07:57:39.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.592+0000 7f62f5ac7700 1 -- 172.21.15.26:0/632947324 shutdown_connections 2023-10-01T07:57:39.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.592+0000 7f62f5ac7700 1 --2- 172.21.15.26:0/632947324 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62f0135e50 0x7f62f011de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.592+0000 7f62f5ac7700 1 --2- 172.21.15.26:0/632947324 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62f009d6f0 0x7f62f011d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.592+0000 7f62f5ac7700 1 --2- 172.21.15.26:0/632947324 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62f009e1d0 0x7f62f011d900 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.592+0000 7f62f5ac7700 1 -- 172.21.15.26:0/632947324 >> 172.21.15.26:0/632947324 conn(0x7f62f0066f50 msgr2=0x7f62f0134830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:39.595 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:39.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.593+0000 7f62f5ac7700 1 -- 172.21.15.26:0/632947324 shutdown_connections 2023-10-01T07:57:39.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.593+0000 7f62f5ac7700 1 -- 172.21.15.26:0/632947324 wait complete. 2023-10-01T07:57:39.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.595+0000 7fb4a17b0700 1 -- 172.21.15.26:0/431791806 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb49c09d5c0 msgr2=0x7fb49c11e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:39.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.595+0000 7fb4a17b0700 1 --2- 172.21.15.26:0/431791806 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb49c09d5c0 0x7fb49c11e130 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb48c00e9d0 tx=0x7fb48c00ece0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.595+0000 7fb4a17b0700 1 -- 172.21.15.26:0/431791806 shutdown_connections 2023-10-01T07:57:39.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.595+0000 7fb4a17b0700 1 --2- 172.21.15.26:0/431791806 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb49c133920 0x7fb49c11ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.595+0000 7fb4a17b0700 1 --2- 172.21.15.26:0/431791806 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb49c09d5c0 0x7fb49c11e130 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.595+0000 7fb4a17b0700 1 --2- 172.21.15.26:0/431791806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb49c0a09c0 0x7fb49c11e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.595+0000 7fb4a17b0700 1 -- 172.21.15.26:0/431791806 >> 172.21.15.26:0/431791806 conn(0x7fb49c0a2fe0 msgr2=0x7fb49c132e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:39.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.595+0000 7fb4a17b0700 1 -- 172.21.15.26:0/431791806 shutdown_connections 2023-10-01T07:57:39.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.595+0000 7fb4a17b0700 1 -- 172.21.15.26:0/431791806 wait complete. 2023-10-01T07:57:39.609 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:39.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:39.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.640+0000 7fdf235ba700 1 Processor -- start 2023-10-01T07:57:39.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.640+0000 7fdf235ba700 1 -- start start 2023-10-01T07:57:39.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.641+0000 7fdf235ba700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdf1c06a770 0x7fdf1c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:39.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.641+0000 7fdf235ba700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdf1c131d10 0x7fdf1c139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:39.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.641+0000 7fdf235ba700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf1c09ece0 con 0x7fdf1c06b080 2023-10-01T07:57:39.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.641+0000 7fdf235ba700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf1c09e760 con 0x7fdf1c06a770 2023-10-01T07:57:39.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.641+0000 7fdf235ba700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c09e040 con 0x7fdf1c131d10 2023-10-01T07:57:39.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.641+0000 7fdf21356700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdf1c06a770 0x7fdf1c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:39.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.641+0000 7fdf21b57700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdf1c131d10 0x7fdf1c139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:39.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.641+0000 7fdf21b57700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdf1c131d10 0x7fdf1c139860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55630/0 (socket says 172.21.15.26:55630) 2023-10-01T07:57:39.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.641+0000 7fdf21356700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdf1c06a770 0x7fdf1c06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56728/0 (socket says 172.21.15.26:56728) 2023-10-01T07:57:39.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.641+0000 7fdf21b57700 1 -- 172.21.15.26:0/723145344 learned_addr learned my addr 172.21.15.26:0/723145344 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:39.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.641+0000 7fdf21356700 1 -- 172.21.15.26:0/723145344 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdf1c131d10 msgr2=0x7fdf1c139860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:39.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.641+0000 7fdf21356700 1 --2- 172.21.15.26:0/723145344 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdf1c131d10 0x7fdf1c139860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.641+0000 7fdf21356700 1 -- 172.21.15.26:0/723145344 >> v1:172.21.15.26:6789/0 conn(0x7fdf1c06b080 legacy=0x7fdf1c131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:39.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.642+0000 7fdf0ffff700 1 -- 172.21.15.26:0/723145344 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 169424739 0 0) 0x7fdf1c09ece0 con 0x7fdf1c06b080 2023-10-01T07:57:39.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.642+0000 7fdf21356700 1 -- 172.21.15.26:0/723145344 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf1c09f630 con 0x7fdf1c06a770 2023-10-01T07:57:39.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.642+0000 7fdf21b57700 1 --2- 172.21.15.26:0/723145344 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdf1c131d10 0x7fdf1c139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:39.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.642+0000 7fdf21356700 1 --2- 172.21.15.26:0/723145344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf1c06a770 0x7fdf1c06ab40 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fdf18009840 tx=0x7fdf18009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11183b9a57ac2f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:39.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.642+0000 7fdf0ffff700 1 -- 172.21.15.26:0/723145344 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf18011830 con 0x7fdf1c06a770 2023-10-01T07:57:39.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.642+0000 7fdf0ffff700 1 -- 172.21.15.26:0/723145344 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf18011990 con 0x7fdf1c06a770 2023-10-01T07:57:39.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.642+0000 7fdf0ffff700 1 -- 172.21.15.26:0/723145344 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf18011d20 con 0x7fdf1c06a770 2023-10-01T07:57:39.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.642+0000 7fdf235ba700 1 -- 172.21.15.26:0/723145344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf1c06a770 msgr2=0x7fdf1c06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:39.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.642+0000 7fdf235ba700 1 --2- 172.21.15.26:0/723145344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf1c06a770 0x7fdf1c06ab40 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fdf18009840 tx=0x7fdf18009b50 comp rx=0 tx=0).stop 2023-10-01T07:57:39.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.643+0000 7fdf235ba700 1 -- 172.21.15.26:0/723145344 shutdown_connections 2023-10-01T07:57:39.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.643+0000 7fdf235ba700 1 --2- 172.21.15.26:0/723145344 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdf1c131d10 0x7fdf1c139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.643+0000 7fdf235ba700 1 --2- 172.21.15.26:0/723145344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf1c06a770 0x7fdf1c06ab40 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.643+0000 7fdf235ba700 1 -- 172.21.15.26:0/723145344 >> 172.21.15.26:0/723145344 conn(0x7fdf1c066f50 msgr2=0x7fdf1c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:39.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.643+0000 7fdf235ba700 1 -- 172.21.15.26:0/723145344 shutdown_connections 2023-10-01T07:57:39.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.643+0000 7fdf235ba700 1 -- 172.21.15.26:0/723145344 wait complete. 2023-10-01T07:57:39.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.644+0000 7fdf235ba700 1 Processor -- start 2023-10-01T07:57:39.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.644+0000 7fdf235ba700 1 -- start start 2023-10-01T07:57:39.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.644+0000 7fdf235ba700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdf1c06a770 0x7fdf1c09acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:39.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.644+0000 7fdf235ba700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf1c06b080 0x7fdf1c09b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:39.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.644+0000 7fdf235ba700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf1c131d10 0x7fdf1c1c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:39.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.644+0000 7fdf235ba700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c0a2ba0 con 0x7fdf1c06b080 2023-10-01T07:57:39.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.644+0000 7fdf235ba700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c1310e0 con 0x7fdf1c131d10 2023-10-01T07:57:39.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.644+0000 7fdf235ba700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c125d90 con 0x7fdf1c06a770 2023-10-01T07:57:39.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.644+0000 7fdf21356700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdf1c06a770 0x7fdf1c09acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:39.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.644+0000 7fdf21356700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdf1c06a770 0x7fdf1c09acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55636/0 (socket says 172.21.15.26:55636) 2023-10-01T07:57:39.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.644+0000 7fdf20b55700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf1c06b080 0x7fdf1c09b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:39.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.644+0000 7fdf21356700 1 -- 172.21.15.26:0/4013499908 learned_addr learned my addr 172.21.15.26:0/4013499908 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:39.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.644+0000 7fdf21b57700 1 --2- 172.21.15.26:0/4013499908 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf1c131d10 0x7fdf1c1c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:39.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.645+0000 7fdf21356700 1 -- 172.21.15.26:0/4013499908 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf1c131d10 msgr2=0x7fdf1c1c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:39.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.645+0000 7fdf21356700 1 --2- 172.21.15.26:0/4013499908 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf1c131d10 0x7fdf1c1c7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.645+0000 7fdf21356700 1 -- 172.21.15.26:0/4013499908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf1c06b080 msgr2=0x7fdf1c09b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:39.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.645+0000 7fdf21356700 1 --2- 172.21.15.26:0/4013499908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf1c06b080 0x7fdf1c09b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.645+0000 7fdf21356700 1 -- 172.21.15.26:0/4013499908 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf14009b30 con 0x7fdf1c06a770 2023-10-01T07:57:39.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.645+0000 7fdf21356700 1 --2- 172.21.15.26:0/4013499908 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdf1c06a770 0x7fdf1c09acd0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fdf18009fd0 tx=0x7fdf18004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:39.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.645+0000 7fdf0dffb700 1 -- 172.21.15.26:0/4013499908 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf180036a0 con 0x7fdf1c06a770 2023-10-01T07:57:39.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.645+0000 7fdf0dffb700 1 -- 172.21.15.26:0/4013499908 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1801f070 con 0x7fdf1c06a770 2023-10-01T07:57:39.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.645+0000 7fdf0dffb700 1 -- 172.21.15.26:0/4013499908 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf18003a60 con 0x7fdf1c06a770 2023-10-01T07:57:39.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.645+0000 7fdf235ba700 1 -- 172.21.15.26:0/4013499908 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf180094a0 con 0x7fdf1c06a770 2023-10-01T07:57:39.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.645+0000 7fdf235ba700 1 -- 172.21.15.26:0/4013499908 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf1c09a850 con 0x7fdf1c06a770 2023-10-01T07:57:39.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.646+0000 7fdf0dffb700 1 -- 172.21.15.26:0/4013499908 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdf18003bc0 con 0x7fdf1c06a770 2023-10-01T07:57:39.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.646+0000 7fdf0dffb700 1 -- 172.21.15.26:0/4013499908 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdf18021070 con 0x7fdf1c06a770 2023-10-01T07:57:39.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.646+0000 7fdf235ba700 1 -- 172.21.15.26:0/4013499908 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf1c074ea0 con 0x7fdf1c06a770 2023-10-01T07:57:39.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.651+0000 7fdf0dffb700 1 -- 172.21.15.26:0/4013499908 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdf18015080 con 0x7fdf1c06a770 2023-10-01T07:57:39.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.856+0000 7fdf235ba700 1 -- 172.21.15.26:0/4013499908 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdf1c09bfc0 con 0x7fdf1c06a770 2023-10-01T07:57:39.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.856+0000 7fdf0dffb700 1 -- 172.21.15.26:0/4013499908 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdf18035090 con 0x7fdf1c06a770 2023-10-01T07:57:39.857 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:39.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.858+0000 7fdf235ba700 1 -- 172.21.15.26:0/4013499908 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdf1c06a770 msgr2=0x7fdf1c09acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:39.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.859+0000 7fdf235ba700 1 --2- 172.21.15.26:0/4013499908 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdf1c06a770 0x7fdf1c09acd0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fdf18009fd0 tx=0x7fdf18004750 comp rx=0 tx=0).stop 2023-10-01T07:57:39.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.859+0000 7fdf235ba700 1 -- 172.21.15.26:0/4013499908 shutdown_connections 2023-10-01T07:57:39.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.859+0000 7fdf235ba700 1 --2- 172.21.15.26:0/4013499908 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf1c131d10 0x7fdf1c1c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.859+0000 7fdf235ba700 1 --2- 172.21.15.26:0/4013499908 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdf1c06a770 0x7fdf1c09acd0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.859+0000 7fdf235ba700 1 --2- 172.21.15.26:0/4013499908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf1c06b080 0x7fdf1c09b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:39.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.859+0000 7fdf235ba700 1 -- 172.21.15.26:0/4013499908 >> 172.21.15.26:0/4013499908 conn(0x7fdf1c066f50 msgr2=0x7fdf1c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:39.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.859+0000 7fdf235ba700 1 -- 172.21.15.26:0/4013499908 shutdown_connections 2023-10-01T07:57:39.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:39.859+0000 7fdf235ba700 1 -- 172.21.15.26:0/4013499908 wait complete. 2023-10-01T07:57:39.873 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:40.569 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:40.610 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:40.612 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.719+0000 7fa7ffc7b700 1 Processor -- start 2023-10-01T07:57:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.720+0000 7fa7ffc7b700 1 -- start start 2023-10-01T07:57:40.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.721+0000 7fa7ffc7b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7f809d6f0 0x7fa7f809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:40.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.721+0000 7fa7ffc7b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa7f809e000 0x7fa7f81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:40.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.721+0000 7fa7ffc7b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7f809e410 0x7fa7f8133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:40.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.721+0000 7fa7ffc7b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7f806b460 con 0x7fa7f809e000 2023-10-01T07:57:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.721+0000 7fa7ffc7b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f809b120 con 0x7fa7f809d6f0 2023-10-01T07:57:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.721+0000 7fa7ffc7b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f809a7e0 con 0x7fa7f809e410 2023-10-01T07:57:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.721+0000 7fa7fda17700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7f809d6f0 0x7fa7f809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.721+0000 7fa7fd216700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa7f809e000 0x7fa7f81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.721+0000 7fa7fd216700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa7f809e000 0x7fa7f81339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56738/0 (socket says 172.21.15.26:56738) 2023-10-01T07:57:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.721+0000 7fa7fda17700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7f809d6f0 0x7fa7f809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47554/0 (socket says 172.21.15.26:47554) 2023-10-01T07:57:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.721+0000 7fa7fd216700 1 -- 172.21.15.26:0/890617218 learned_addr learned my addr 172.21.15.26:0/890617218 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.721+0000 7fa7fe218700 1 --2- 172.21.15.26:0/890617218 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7f809e410 0x7fa7f8133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.721+0000 7fa7fd216700 1 -- 172.21.15.26:0/890617218 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7f809e410 msgr2=0x7fa7f8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.721+0000 7fa7fd216700 1 --2- 172.21.15.26:0/890617218 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7f809e410 0x7fa7f8133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.721+0000 7fa7fd216700 1 -- 172.21.15.26:0/890617218 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7f809d6f0 msgr2=0x7fa7f809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:40.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.721+0000 7fa7fd216700 1 --2- 172.21.15.26:0/890617218 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7f809d6f0 0x7fa7f809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:40.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.721+0000 7fa7fd216700 1 -- 172.21.15.26:0/890617218 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f809a500 con 0x7fa7f809e000 2023-10-01T07:57:40.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.721+0000 7fa7fe218700 1 --2- 172.21.15.26:0/890617218 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7f809e410 0x7fa7f8133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:57:40.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.722+0000 7fa7fd216700 1 --2- 172.21.15.26:0/890617218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f809e000 0x7fa7f81339f0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fa7e80098f0 tx=0x7fa7e8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f26d5f320b57e542 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:40.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.722+0000 7fa7fca15700 1 -- 172.21.15.26:0/890617218 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e8011830 con 0x7fa7f809e000 2023-10-01T07:57:40.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.722+0000 7fa7fca15700 1 -- 172.21.15.26:0/890617218 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e8011990 con 0x7fa7f809e000 2023-10-01T07:57:40.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.722+0000 7fa7fca15700 1 -- 172.21.15.26:0/890617218 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e8011d20 con 0x7fa7f809e000 2023-10-01T07:57:40.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.723+0000 7fa7ffc7b700 1 -- 172.21.15.26:0/890617218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f809e000 msgr2=0x7fa7f81339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:40.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.723+0000 7fa7ffc7b700 1 --2- 172.21.15.26:0/890617218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f809e000 0x7fa7f81339f0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fa7e80098f0 tx=0x7fa7e8009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:40.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.723+0000 7fa7ffc7b700 1 -- 172.21.15.26:0/890617218 shutdown_connections 2023-10-01T07:57:40.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.723+0000 7fa7ffc7b700 1 --2- 172.21.15.26:0/890617218 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7f809e410 0x7fa7f8133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:40.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.723+0000 7fa7ffc7b700 1 --2- 172.21.15.26:0/890617218 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7f809d6f0 0x7fa7f809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:40.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.723+0000 7fa7ffc7b700 1 --2- 172.21.15.26:0/890617218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f809e000 0x7fa7f81339f0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:40.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.723+0000 7fa7ffc7b700 1 -- 172.21.15.26:0/890617218 >> 172.21.15.26:0/890617218 conn(0x7fa7f8066f50 msgr2=0x7fa7f809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:40.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.723+0000 7fa7ffc7b700 1 -- 172.21.15.26:0/890617218 shutdown_connections 2023-10-01T07:57:40.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.723+0000 7fa7ffc7b700 1 -- 172.21.15.26:0/890617218 wait complete. 2023-10-01T07:57:40.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.724+0000 7fa7ffc7b700 1 Processor -- start 2023-10-01T07:57:40.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.724+0000 7fa7ffc7b700 1 -- start start 2023-10-01T07:57:40.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.725+0000 7fa7ffc7b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7f809d6f0 0x7fa7f81c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:40.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.725+0000 7fa7ffc7b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f809e000 0x7fa7f81c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:40.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.725+0000 7fa7ffc7b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7f809e410 0x7fa7f81c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:40.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.725+0000 7fa7ffc7b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f81a71d0 con 0x7fa7f809e000 2023-10-01T07:57:40.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.725+0000 7fa7ffc7b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f81a97f0 con 0x7fa7f809e410 2023-10-01T07:57:40.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.725+0000 7fa7ffc7b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f81c5aa0 con 0x7fa7f809d6f0 2023-10-01T07:57:40.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.725+0000 7fa7fda17700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7f809d6f0 0x7fa7f81c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:40.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.725+0000 7fa7fda17700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7f809d6f0 0x7fa7f81c5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55658/0 (socket says 172.21.15.26:55658) 2023-10-01T07:57:40.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.725+0000 7fa7fda17700 1 -- 172.21.15.26:0/2494807968 learned_addr learned my addr 172.21.15.26:0/2494807968 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:40.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.725+0000 7fa7fd216700 1 --2- 172.21.15.26:0/2494807968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f809e000 0x7fa7f81c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:40.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.725+0000 7fa7fe218700 1 --2- 172.21.15.26:0/2494807968 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7f809e410 0x7fa7f81c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:40.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.725+0000 7fa7fda17700 1 -- 172.21.15.26:0/2494807968 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7f809e410 msgr2=0x7fa7f81c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:40.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.725+0000 7fa7fda17700 1 --2- 172.21.15.26:0/2494807968 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7f809e410 0x7fa7f81c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:40.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.726+0000 7fa7fda17700 1 -- 172.21.15.26:0/2494807968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f809e000 msgr2=0x7fa7f81c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:40.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.726+0000 7fa7fda17700 1 --2- 172.21.15.26:0/2494807968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f809e000 0x7fa7f81c5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:40.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.726+0000 7fa7fda17700 1 -- 172.21.15.26:0/2494807968 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e8009550 con 0x7fa7f809d6f0 2023-10-01T07:57:40.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.726+0000 7fa7fd216700 1 --2- 172.21.15.26:0/2494807968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f809e000 0x7fa7f81c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:40.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.726+0000 7fa7fda17700 1 --2- 172.21.15.26:0/2494807968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7f809d6f0 0x7fa7f81c5020 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa7f400e9b0 tx=0x7fa7f400ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:40.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.726+0000 7fa7ee7fc700 1 -- 172.21.15.26:0/2494807968 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4009710 con 0x7fa7f809d6f0 2023-10-01T07:57:40.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.726+0000 7fa7ee7fc700 1 -- 172.21.15.26:0/2494807968 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f400ee50 con 0x7fa7f809d6f0 2023-10-01T07:57:40.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.726+0000 7fa7ffc7b700 1 -- 172.21.15.26:0/2494807968 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f80a20b0 con 0x7fa7f809d6f0 2023-10-01T07:57:40.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.726+0000 7fa7ee7fc700 1 -- 172.21.15.26:0/2494807968 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f400ca50 con 0x7fa7f809d6f0 2023-10-01T07:57:40.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.726+0000 7fa7ffc7b700 1 -- 172.21.15.26:0/2494807968 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f81a78e0 con 0x7fa7f809d6f0 2023-10-01T07:57:40.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.727+0000 7fa7ee7fc700 1 -- 172.21.15.26:0/2494807968 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa7f400cbb0 con 0x7fa7f809d6f0 2023-10-01T07:57:40.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.727+0000 7fa7ffc7b700 1 -- 172.21.15.26:0/2494807968 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f8074ea0 con 0x7fa7f809d6f0 2023-10-01T07:57:40.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.727+0000 7fa7ee7fc700 1 -- 172.21.15.26:0/2494807968 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa7f403f770 con 0x7fa7f809d6f0 2023-10-01T07:57:40.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.732+0000 7fa7ee7fc700 1 -- 172.21.15.26:0/2494807968 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa7f401be10 con 0x7fa7f809d6f0 2023-10-01T07:57:40.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.760+0000 7ff1c9b1c700 1 Processor -- start 2023-10-01T07:57:40.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.760+0000 7ff1c9b1c700 1 -- start start 2023-10-01T07:57:40.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.760+0000 7ff1c9b1c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff1c409d6f0 0x7ff1c409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:40.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.760+0000 7ff1c9b1c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1c409e410 0x7ff1c4134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:40.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.760+0000 7ff1c9b1c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c409b120 con 0x7ff1c409e000 2023-10-01T07:57:40.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.760+0000 7ff1c9b1c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c406b460 con 0x7ff1c409d6f0 2023-10-01T07:57:40.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.760+0000 7ff1c9b1c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c409a7e0 con 0x7ff1c409e410 2023-10-01T07:57:40.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.760+0000 7ff1c37fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff1c409d6f0 0x7ff1c409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:40.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.760+0000 7ff1c3fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1c409e410 0x7ff1c4134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:40.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.760+0000 7ff1c37fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff1c409d6f0 0x7ff1c409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47584/0 (socket says 172.21.15.26:47584) 2023-10-01T07:57:40.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.760+0000 7ff1c37fe700 1 -- 172.21.15.26:0/3478709378 learned_addr learned my addr 172.21.15.26:0/3478709378 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:40.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.761+0000 7ff1c37fe700 1 -- 172.21.15.26:0/3478709378 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1c409e410 msgr2=0x7ff1c4134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:40.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.761+0000 7ff1c37fe700 1 --2- 172.21.15.26:0/3478709378 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1c409e410 0x7ff1c4134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:40.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.761+0000 7ff1c37fe700 1 -- 172.21.15.26:0/3478709378 >> v1:172.21.15.26:6789/0 conn(0x7ff1c409e000 legacy=0x7ff1c41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:40.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.761+0000 7ff1c27fc700 1 -- 172.21.15.26:0/3478709378 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2086259180 0 0) 0x7ff1c409b120 con 0x7ff1c409e000 2023-10-01T07:57:40.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.761+0000 7ff1c37fe700 1 -- 172.21.15.26:0/3478709378 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c409a500 con 0x7ff1c409d6f0 2023-10-01T07:57:40.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.761+0000 7ff1c3fff700 1 --2- 172.21.15.26:0/3478709378 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1c409e410 0x7ff1c4134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:40.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.761+0000 7ff1c37fe700 1 --2- 172.21.15.26:0/3478709378 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff1c409d6f0 0x7ff1c409dac0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009920 tx=0x7ff1b4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9bbebed3a0f34cd server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:40.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.761+0000 7ff1c27fc700 1 -- 172.21.15.26:0/3478709378 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4011830 con 0x7ff1c409d6f0 2023-10-01T07:57:40.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.761+0000 7ff1c27fc700 1 -- 172.21.15.26:0/3478709378 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b4011990 con 0x7ff1c409d6f0 2023-10-01T07:57:40.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.761+0000 7ff1c27fc700 1 -- 172.21.15.26:0/3478709378 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4011d20 con 0x7ff1c409d6f0 2023-10-01T07:57:40.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.762+0000 7ff1c9b1c700 1 -- 172.21.15.26:0/3478709378 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff1c409d6f0 msgr2=0x7ff1c409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:40.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.762+0000 7ff1c9b1c700 1 --2- 172.21.15.26:0/3478709378 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff1c409d6f0 0x7ff1c409dac0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009920 tx=0x7ff1b4009c30 comp rx=0 tx=0).stop 2023-10-01T07:57:40.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.762+0000 7ff1c9b1c700 1 -- 172.21.15.26:0/3478709378 shutdown_connections 2023-10-01T07:57:40.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.762+0000 7ff1c9b1c700 1 --2- 172.21.15.26:0/3478709378 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1c409e410 0x7ff1c4134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:40.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.762+0000 7ff1c9b1c700 1 --2- 172.21.15.26:0/3478709378 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff1c409d6f0 0x7ff1c409dac0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:40.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.762+0000 7ff1c9b1c700 1 -- 172.21.15.26:0/3478709378 >> 172.21.15.26:0/3478709378 conn(0x7ff1c4066f50 msgr2=0x7ff1c409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:40.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.762+0000 7ff1c9b1c700 1 -- 172.21.15.26:0/3478709378 shutdown_connections 2023-10-01T07:57:40.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.762+0000 7ff1c9b1c700 1 -- 172.21.15.26:0/3478709378 wait complete. 2023-10-01T07:57:40.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.763+0000 7ff1c9b1c700 1 Processor -- start 2023-10-01T07:57:40.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.763+0000 7ff1c9b1c700 1 -- start start 2023-10-01T07:57:40.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.764+0000 7ff1c9b1c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1c409d6f0 0x7ff1c41225d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:40.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.764+0000 7ff1c9b1c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff1c409e000 0x7ff1c4122b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:40.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.764+0000 7ff1c9b1c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1c409e410 0x7ff1c4123050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:40.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.764+0000 7ff1c9b1c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c4125ab0 con 0x7ff1c409d6f0 2023-10-01T07:57:40.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.764+0000 7ff1c9b1c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c4124980 con 0x7ff1c409e000 2023-10-01T07:57:40.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.764+0000 7ff1c9b1c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c40a1af0 con 0x7ff1c409e410 2023-10-01T07:57:40.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.764+0000 7ff1c37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1c409d6f0 0x7ff1c41225d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:40.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.764+0000 7ff1c37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1c409d6f0 0x7ff1c41225d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56764/0 (socket says 172.21.15.26:56764) 2023-10-01T07:57:40.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.764+0000 7ff1c37fe700 1 -- 172.21.15.26:0/4037832111 learned_addr learned my addr 172.21.15.26:0/4037832111 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:40.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.764+0000 7ff1c3fff700 1 --2- 172.21.15.26:0/4037832111 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1c409e410 0x7ff1c4123050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:40.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.764+0000 7ff1c2ffd700 1 --2- 172.21.15.26:0/4037832111 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff1c409e000 0x7ff1c4122b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:40.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.764+0000 7ff1c37fe700 1 -- 172.21.15.26:0/4037832111 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1c409e410 msgr2=0x7ff1c4123050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:40.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.764+0000 7ff1c37fe700 1 --2- 172.21.15.26:0/4037832111 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1c409e410 0x7ff1c4123050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:40.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.764+0000 7ff1c37fe700 1 -- 172.21.15.26:0/4037832111 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff1c409e000 msgr2=0x7ff1c4122b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:40.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.764+0000 7ff1c37fe700 1 --2- 172.21.15.26:0/4037832111 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff1c409e000 0x7ff1c4122b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:40.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.764+0000 7ff1c37fe700 1 -- 172.21.15.26:0/4037832111 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1bc009a70 con 0x7ff1c409d6f0 2023-10-01T07:57:40.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.764+0000 7ff1c3fff700 1 --2- 172.21.15.26:0/4037832111 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1c409e410 0x7ff1c4123050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:40.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.765+0000 7ff1c37fe700 1 --2- 172.21.15.26:0/4037832111 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1c409d6f0 0x7ff1c41225d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009c70 tx=0x7ff1b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:40.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.765+0000 7ff1abfff700 1 -- 172.21.15.26:0/4037832111 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4004040 con 0x7ff1c409d6f0 2023-10-01T07:57:40.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.765+0000 7ff1abfff700 1 -- 172.21.15.26:0/4037832111 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b40041a0 con 0x7ff1c409d6f0 2023-10-01T07:57:40.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.765+0000 7ff1c9b1c700 1 -- 172.21.15.26:0/4037832111 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b4009550 con 0x7ff1c409d6f0 2023-10-01T07:57:40.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.765+0000 7ff1abfff700 1 -- 172.21.15.26:0/4037832111 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4004510 con 0x7ff1c409d6f0 2023-10-01T07:57:40.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.765+0000 7ff1c9b1c700 1 -- 172.21.15.26:0/4037832111 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1c41267e0 con 0x7ff1c409d6f0 2023-10-01T07:57:40.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.766+0000 7ff1abfff700 1 -- 172.21.15.26:0/4037832111 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff1b40036a0 con 0x7ff1c409d6f0 2023-10-01T07:57:40.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.766+0000 7ff1c9b1c700 1 -- 172.21.15.26:0/4037832111 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1c4074ea0 con 0x7ff1c409d6f0 2023-10-01T07:57:40.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.766+0000 7ff1abfff700 1 -- 172.21.15.26:0/4037832111 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff1b4048e10 con 0x7ff1c409d6f0 2023-10-01T07:57:40.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.771+0000 7f989f111700 1 Processor -- start 2023-10-01T07:57:40.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.771+0000 7f989f111700 1 -- start start 2023-10-01T07:57:40.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.772+0000 7f989f111700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9898133420 0x7f98981337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:40.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.772+0000 7f989f111700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9898134260 0x7f98981306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:40.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.772+0000 7f989f111700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f989806b990 con 0x7f9898133e30 2023-10-01T07:57:40.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.772+0000 7f989f111700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98980a0590 con 0x7f9898133420 2023-10-01T07:57:40.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.772+0000 7f989f111700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f989809fb80 con 0x7f9898134260 2023-10-01T07:57:40.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.772+0000 7f989cead700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9898133420 0x7f98981337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:40.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.772+0000 7f9897fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9898133e30 0x7f989812ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35390/0 (socket says 172.21.15.26:35390) 2023-10-01T07:57:40.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.772+0000 7f989cead700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9898133420 0x7f98981337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56780/0 (socket says 172.21.15.26:56780) 2023-10-01T07:57:40.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.772+0000 7f9897fff700 1 -- 172.21.15.26:0/772209302 learned_addr learned my addr 172.21.15.26:0/772209302 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:40.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.772+0000 7f989d6ae700 1 --2- 172.21.15.26:0/772209302 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9898134260 0x7f98981306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:40.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.772+0000 7f989d6ae700 1 -- 172.21.15.26:0/772209302 >> v2:172.21.15.26:3300/0 conn(0x7f9898133420 msgr2=0x7f98981337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:40.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.772+0000 7f989d6ae700 1 --2- 172.21.15.26:0/772209302 >> v2:172.21.15.26:3300/0 conn(0x7f9898133420 0x7f98981337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:40.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.772+0000 7f989d6ae700 1 -- 172.21.15.26:0/772209302 >> v1:172.21.15.26:6789/0 conn(0x7f9898133e30 legacy=0x7f989812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:40.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.772+0000 7f989d6ae700 1 -- 172.21.15.26:0/772209302 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98980a0030 con 0x7f9898134260 2023-10-01T07:57:40.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.772+0000 7f989cead700 1 --2- 172.21.15.26:0/772209302 >> v2:172.21.15.26:3300/0 conn(0x7f9898133420 0x7f98981337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:40.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.773+0000 7f989d6ae700 1 --2- 172.21.15.26:0/772209302 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9898134260 0x7f98981306a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9890009d90 tx=0x7f989000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f25faf9b0688de8e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:40.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.773+0000 7f98977fe700 1 -- 172.21.15.26:0/772209302 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989000e070 con 0x7f9898134260 2023-10-01T07:57:40.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.773+0000 7f98977fe700 1 -- 172.21.15.26:0/772209302 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989000bb20 con 0x7f9898134260 2023-10-01T07:57:40.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.773+0000 7f98977fe700 1 -- 172.21.15.26:0/772209302 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9890012430 con 0x7f9898134260 2023-10-01T07:57:40.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.773+0000 7ff1abfff700 1 -- 172.21.15.26:0/4037832111 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff1b4003950 con 0x7ff1c409d6f0 2023-10-01T07:57:40.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.774+0000 7f989f111700 1 -- 172.21.15.26:0/772209302 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9898134260 msgr2=0x7f98981306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:40.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.774+0000 7f989f111700 1 --2- 172.21.15.26:0/772209302 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9898134260 0x7f98981306a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9890009d90 tx=0x7f989000b330 comp rx=0 tx=0).stop 2023-10-01T07:57:40.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.774+0000 7f989f111700 1 -- 172.21.15.26:0/772209302 shutdown_connections 2023-10-01T07:57:40.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.774+0000 7f989f111700 1 --2- 172.21.15.26:0/772209302 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9898134260 0x7f98981306a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:40.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.774+0000 7f989f111700 1 --2- 172.21.15.26:0/772209302 >> v2:172.21.15.26:3300/0 conn(0x7f9898133420 0x7f98981337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:40.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.774+0000 7f989f111700 1 -- 172.21.15.26:0/772209302 >> 172.21.15.26:0/772209302 conn(0x7f98980a4210 msgr2=0x7f98980a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:40.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.774+0000 7f989f111700 1 -- 172.21.15.26:0/772209302 shutdown_connections 2023-10-01T07:57:40.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.774+0000 7f989f111700 1 -- 172.21.15.26:0/772209302 wait complete. 2023-10-01T07:57:40.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.775+0000 7f989f111700 1 Processor -- start 2023-10-01T07:57:40.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.775+0000 7f989f111700 1 -- start start 2023-10-01T07:57:40.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.776+0000 7f989f111700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9898133420 0x7f989809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:40.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.776+0000 7f989f111700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9898133e30 0x7f989809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:40.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.776+0000 7f989f111700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9898134260 0x7f989809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:40.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.776+0000 7f989f111700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989811fc20 con 0x7f9898133420 2023-10-01T07:57:40.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.776+0000 7f989f111700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989811fee0 con 0x7f9898134260 2023-10-01T07:57:40.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.776+0000 7f989f111700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f989811f910 con 0x7f9898133e30 2023-10-01T07:57:40.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.777+0000 7f9897fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9898133e30 0x7f989809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:40.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.777+0000 7f9897fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9898133e30 0x7f989809c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55690/0 (socket says 172.21.15.26:55690) 2023-10-01T07:57:40.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.777+0000 7f9897fff700 1 -- 172.21.15.26:0/4008671854 learned_addr learned my addr 172.21.15.26:0/4008671854 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:40.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.777+0000 7f989d6ae700 1 --2- 172.21.15.26:0/4008671854 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9898134260 0x7f989809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:40.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.777+0000 7f989cead700 1 --2- 172.21.15.26:0/4008671854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9898133420 0x7f989809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:40.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.777+0000 7f9897fff700 1 -- 172.21.15.26:0/4008671854 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9898134260 msgr2=0x7f989809cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:40.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.777+0000 7f9897fff700 1 --2- 172.21.15.26:0/4008671854 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9898134260 0x7f989809cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:40.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.777+0000 7f9897fff700 1 -- 172.21.15.26:0/4008671854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9898133420 msgr2=0x7f989809c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:40.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.777+0000 7f9897fff700 1 --2- 172.21.15.26:0/4008671854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9898133420 0x7f989809c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:40.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.777+0000 7f9897fff700 1 -- 172.21.15.26:0/4008671854 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f988c0094a0 con 0x7f9898133e30 2023-10-01T07:57:40.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.777+0000 7f989d6ae700 1 --2- 172.21.15.26:0/4008671854 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9898134260 0x7f989809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:40.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.777+0000 7f989cead700 1 --2- 172.21.15.26:0/4008671854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9898133420 0x7f989809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:40.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.777+0000 7f9897fff700 1 --2- 172.21.15.26:0/4008671854 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9898133e30 0x7f989809c9c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f988400c520 tx=0x7f988400c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:40.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.777+0000 7f98957fa700 1 -- 172.21.15.26:0/4008671854 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9884005d70 con 0x7f9898133e30 2023-10-01T07:57:40.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.778+0000 7f98957fa700 1 -- 172.21.15.26:0/4008671854 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98840070d0 con 0x7f9898133e30 2023-10-01T07:57:40.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.778+0000 7f989f111700 1 -- 172.21.15.26:0/4008671854 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9890009a70 con 0x7f9898133e30 2023-10-01T07:57:40.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.778+0000 7f98957fa700 1 -- 172.21.15.26:0/4008671854 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9884007440 con 0x7f9898133e30 2023-10-01T07:57:40.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.778+0000 7f989f111700 1 -- 172.21.15.26:0/4008671854 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98981201c0 con 0x7f9898133e30 2023-10-01T07:57:40.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.779+0000 7f98957fa700 1 -- 172.21.15.26:0/4008671854 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f98840075a0 con 0x7f9898133e30 2023-10-01T07:57:40.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.779+0000 7f989f111700 1 -- 172.21.15.26:0/4008671854 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9898074ea0 con 0x7f9898133e30 2023-10-01T07:57:40.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.779+0000 7f98957fa700 1 -- 172.21.15.26:0/4008671854 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f988403ea20 con 0x7f9898133e30 2023-10-01T07:57:40.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.784+0000 7f98957fa700 1 -- 172.21.15.26:0/4008671854 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9884019b40 con 0x7f9898133e30 2023-10-01T07:57:40.874 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:40.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.960+0000 7fa7ffc7b700 1 -- 172.21.15.26:0/2494807968 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa7f806c360 con 0x7fa7f809d6f0 2023-10-01T07:57:40.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.961+0000 7fa7ee7fc700 1 -- 172.21.15.26:0/2494807968 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa7f4021020 con 0x7fa7f809d6f0 2023-10-01T07:57:40.961 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:40.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.963+0000 7fa7ffc7b700 1 -- 172.21.15.26:0/2494807968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7f809d6f0 msgr2=0x7fa7f81c5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:40.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.963+0000 7fa7ffc7b700 1 --2- 172.21.15.26:0/2494807968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7f809d6f0 0x7fa7f81c5020 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa7f400e9b0 tx=0x7fa7f400ecc0 comp rx=0 tx=0).stop 2023-10-01T07:57:40.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.963+0000 7fa7ffc7b700 1 -- 172.21.15.26:0/2494807968 shutdown_connections 2023-10-01T07:57:40.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.963+0000 7fa7ffc7b700 1 --2- 172.21.15.26:0/2494807968 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7f809e410 0x7fa7f81c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:40.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.963+0000 7fa7ffc7b700 1 --2- 172.21.15.26:0/2494807968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa7f809d6f0 0x7fa7f81c5020 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:40.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.963+0000 7fa7ffc7b700 1 --2- 172.21.15.26:0/2494807968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7f809e000 0x7fa7f81c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:40.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.963+0000 7fa7ffc7b700 1 -- 172.21.15.26:0/2494807968 >> 172.21.15.26:0/2494807968 conn(0x7fa7f8066f50 msgr2=0x7fa7f81bac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:40.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.963+0000 7fa7ffc7b700 1 -- 172.21.15.26:0/2494807968 shutdown_connections 2023-10-01T07:57:40.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.963+0000 7fa7ffc7b700 1 -- 172.21.15.26:0/2494807968 wait complete. 2023-10-01T07:57:40.978 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:40.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.982+0000 7ff1c9b1c700 1 -- 172.21.15.26:0/4037832111 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff1c409c710 con 0x7ff1c409d6f0 2023-10-01T07:57:40.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.982+0000 7ff1abfff700 1 -- 172.21.15.26:0/4037832111 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff1b404b090 con 0x7ff1c409d6f0 2023-10-01T07:57:40.983 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:40.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.985+0000 7ff1c9b1c700 1 -- 172.21.15.26:0/4037832111 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1c409d6f0 msgr2=0x7ff1c41225d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:40.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.985+0000 7ff1c9b1c700 1 --2- 172.21.15.26:0/4037832111 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1c409d6f0 0x7ff1c41225d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009c70 tx=0x7ff1b4004750 comp rx=0 tx=0).stop 2023-10-01T07:57:40.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.985+0000 7ff1c9b1c700 1 -- 172.21.15.26:0/4037832111 shutdown_connections 2023-10-01T07:57:40.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.985+0000 7ff1c9b1c700 1 --2- 172.21.15.26:0/4037832111 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1c409e410 0x7ff1c4123050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:40.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.985+0000 7ff1c9b1c700 1 --2- 172.21.15.26:0/4037832111 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1c409d6f0 0x7ff1c41225d0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:40.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.985+0000 7ff1c9b1c700 1 --2- 172.21.15.26:0/4037832111 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff1c409e000 0x7ff1c4122b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:40.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.985+0000 7ff1c9b1c700 1 -- 172.21.15.26:0/4037832111 >> 172.21.15.26:0/4037832111 conn(0x7ff1c4066f50 msgr2=0x7ff1c4133f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:40.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.985+0000 7ff1c9b1c700 1 -- 172.21.15.26:0/4037832111 shutdown_connections 2023-10-01T07:57:40.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.985+0000 7ff1c9b1c700 1 -- 172.21.15.26:0/4037832111 wait complete. 2023-10-01T07:57:40.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.994+0000 7f989f111700 1 -- 172.21.15.26:0/4008671854 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f989806b250 con 0x7f9898133e30 2023-10-01T07:57:40.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.994+0000 7f98957fa700 1 -- 172.21.15.26:0/4008671854 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9884017030 con 0x7f9898133e30 2023-10-01T07:57:40.995 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:40.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.998+0000 7f989f111700 1 -- 172.21.15.26:0/4008671854 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9898133e30 msgr2=0x7f989809c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:40.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.998+0000 7f989f111700 1 --2- 172.21.15.26:0/4008671854 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9898133e30 0x7f989809c9c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f988400c520 tx=0x7f988400c830 comp rx=0 tx=0).stop 2023-10-01T07:57:40.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.998+0000 7f989f111700 1 -- 172.21.15.26:0/4008671854 shutdown_connections 2023-10-01T07:57:40.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.998+0000 7f989f111700 1 --2- 172.21.15.26:0/4008671854 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9898134260 0x7f989809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:40.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.998+0000 7f989f111700 1 --2- 172.21.15.26:0/4008671854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9898133420 0x7f989809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:40.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.998+0000 7f989f111700 1 --2- 172.21.15.26:0/4008671854 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9898133e30 0x7f989809c9c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:40.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.998+0000 7f989f111700 1 -- 172.21.15.26:0/4008671854 >> 172.21.15.26:0/4008671854 conn(0x7f98980a4210 msgr2=0x7f98980a0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:40.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.998+0000 7f989f111700 1 -- 172.21.15.26:0/4008671854 shutdown_connections 2023-10-01T07:57:40.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:40.998+0000 7f989f111700 1 -- 172.21.15.26:0/4008671854 wait complete. 2023-10-01T07:57:41.000 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:41.017 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:41.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.023+0000 7f22cb71f700 1 Processor -- start 2023-10-01T07:57:41.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.023+0000 7f22cb71f700 1 -- start start 2023-10-01T07:57:41.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.024+0000 7f22cb71f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f22c409d6f0 0x7f22c409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:41.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.024+0000 7f22cb71f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22c409e000 0x7f22c41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:41.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.024+0000 7f22cb71f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22c409b120 con 0x7f22c409e410 2023-10-01T07:57:41.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.024+0000 7f22cb71f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22c406b460 con 0x7f22c409d6f0 2023-10-01T07:57:41.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.024+0000 7f22cb71f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c409a7e0 con 0x7f22c409e000 2023-10-01T07:57:41.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.024+0000 7f22c8cba700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22c409e000 0x7f22c41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:41.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.024+0000 7f22c8cba700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22c409e000 0x7f22c41339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47590/0 (socket says 172.21.15.26:47590) 2023-10-01T07:57:41.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.024+0000 7f22c8cba700 1 -- 172.21.15.26:0/2623861382 learned_addr learned my addr 172.21.15.26:0/2623861382 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:41.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.024+0000 7f22c94bb700 1 --2- 172.21.15.26:0/2623861382 >> v2:172.21.15.26:3300/0 conn(0x7f22c409d6f0 0x7f22c409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:41.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.024+0000 7f22c8cba700 1 -- 172.21.15.26:0/2623861382 >> v2:172.21.15.26:3300/0 conn(0x7f22c409d6f0 msgr2=0x7f22c409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:41.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.024+0000 7f22c8cba700 1 --2- 172.21.15.26:0/2623861382 >> v2:172.21.15.26:3300/0 conn(0x7f22c409d6f0 0x7f22c409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:41.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.024+0000 7f22c8cba700 1 -- 172.21.15.26:0/2623861382 >> v1:172.21.15.26:6789/0 conn(0x7f22c409e410 legacy=0x7f22c4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:41.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.024+0000 7f22c8cba700 1 -- 172.21.15.26:0/2623861382 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c409a500 con 0x7f22c409e000 2023-10-01T07:57:41.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.024+0000 7f22c8cba700 1 --2- 172.21.15.26:0/2623861382 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22c409e000 0x7f22c41339f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f22b8009920 tx=0x7f22b8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f70b4fecb32f310d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:41.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.025+0000 7f22b7fff700 1 -- 172.21.15.26:0/2623861382 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b8011830 con 0x7f22c409e000 2023-10-01T07:57:41.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.025+0000 7f22b7fff700 1 -- 172.21.15.26:0/2623861382 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b8011990 con 0x7f22c409e000 2023-10-01T07:57:41.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.025+0000 7f22b7fff700 1 -- 172.21.15.26:0/2623861382 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b8011d20 con 0x7f22c409e000 2023-10-01T07:57:41.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.025+0000 7f22cb71f700 1 -- 172.21.15.26:0/2623861382 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22c409e000 msgr2=0x7f22c41339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:41.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.025+0000 7f22cb71f700 1 --2- 172.21.15.26:0/2623861382 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22c409e000 0x7f22c41339f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f22b8009920 tx=0x7f22b8009c30 comp rx=0 tx=0).stop 2023-10-01T07:57:41.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.025+0000 7f22cb71f700 1 -- 172.21.15.26:0/2623861382 shutdown_connections 2023-10-01T07:57:41.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.025+0000 7f22cb71f700 1 --2- 172.21.15.26:0/2623861382 >> v2:172.21.15.26:3300/0 conn(0x7f22c409d6f0 0x7f22c409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:41.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.025+0000 7f22cb71f700 1 --2- 172.21.15.26:0/2623861382 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22c409e000 0x7f22c41339f0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:41.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.025+0000 7f22cb71f700 1 -- 172.21.15.26:0/2623861382 >> 172.21.15.26:0/2623861382 conn(0x7f22c4066f50 msgr2=0x7f22c409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:41.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.025+0000 7f22cb71f700 1 -- 172.21.15.26:0/2623861382 shutdown_connections 2023-10-01T07:57:41.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.025+0000 7f22cb71f700 1 -- 172.21.15.26:0/2623861382 wait complete. 2023-10-01T07:57:41.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.026+0000 7f22cb71f700 1 Processor -- start 2023-10-01T07:57:41.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.026+0000 7f22cb71f700 1 -- start start 2023-10-01T07:57:41.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.027+0000 7f22cb71f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22c409d6f0 0x7f22c41a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:41.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.027+0000 7f22cb71f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22c409e000 0x7f22c41a6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:41.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.027+0000 7f22cb71f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f22c409e410 0x7f22c41a6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:41.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.027+0000 7f22cb71f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c41a7360 con 0x7f22c409d6f0 2023-10-01T07:57:41.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.027+0000 7f22cb71f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c41a80f0 con 0x7f22c409e000 2023-10-01T07:57:41.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.027+0000 7f22cb71f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22c41a91b0 con 0x7f22c409e410 2023-10-01T07:57:41.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.027+0000 7f22c8cba700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22c409e000 0x7f22c41a6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:41.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.027+0000 7f22c94bb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22c409d6f0 0x7f22c41a5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:41.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.027+0000 7f22c8cba700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22c409e000 0x7f22c41a6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47602/0 (socket says 172.21.15.26:47602) 2023-10-01T07:57:41.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.027+0000 7f22c8cba700 1 -- 172.21.15.26:0/3483458877 learned_addr learned my addr 172.21.15.26:0/3483458877 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:41.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.027+0000 7f22c9cbc700 1 --2- 172.21.15.26:0/3483458877 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f22c409e410 0x7f22c41a6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:41.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.027+0000 7f22c8cba700 1 -- 172.21.15.26:0/3483458877 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f22c409e410 msgr2=0x7f22c41a6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:41.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.027+0000 7f22c8cba700 1 --2- 172.21.15.26:0/3483458877 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f22c409e410 0x7f22c41a6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:41.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.027+0000 7f22c8cba700 1 -- 172.21.15.26:0/3483458877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22c409d6f0 msgr2=0x7f22c41a5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:41.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.027+0000 7f22c8cba700 1 --2- 172.21.15.26:0/3483458877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22c409d6f0 0x7f22c41a5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:41.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.027+0000 7f22c8cba700 1 -- 172.21.15.26:0/3483458877 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b8009550 con 0x7f22c409e000 2023-10-01T07:57:41.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.027+0000 7f22c94bb700 1 --2- 172.21.15.26:0/3483458877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22c409d6f0 0x7f22c41a5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:41.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.027+0000 7f22c8cba700 1 --2- 172.21.15.26:0/3483458877 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22c409e000 0x7f22c41a6440 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f22b8009870 tx=0x7f22b8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:41.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.028+0000 7f22b5ffb700 1 -- 172.21.15.26:0/3483458877 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b8004300 con 0x7f22c409e000 2023-10-01T07:57:41.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.028+0000 7f22b5ffb700 1 -- 172.21.15.26:0/3483458877 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b801f070 con 0x7f22c409e000 2023-10-01T07:57:41.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.028+0000 7f22b5ffb700 1 -- 172.21.15.26:0/3483458877 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b80036a0 con 0x7f22c409e000 2023-10-01T07:57:41.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.028+0000 7f22cb71f700 1 -- 172.21.15.26:0/3483458877 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22c409c710 con 0x7f22c409e000 2023-10-01T07:57:41.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.028+0000 7f22cb71f700 1 -- 172.21.15.26:0/3483458877 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22c41a7b10 con 0x7f22c409e000 2023-10-01T07:57:41.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.029+0000 7f22b5ffb700 1 -- 172.21.15.26:0/3483458877 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f22b8021030 con 0x7f22c409e000 2023-10-01T07:57:41.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.029+0000 7f22b5ffb700 1 -- 172.21.15.26:0/3483458877 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f22b8040940 con 0x7f22c409e000 2023-10-01T07:57:41.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.029+0000 7f22cb71f700 1 -- 172.21.15.26:0/3483458877 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22c4074ea0 con 0x7f22c409e000 2023-10-01T07:57:41.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.034+0000 7f22b5ffb700 1 -- 172.21.15.26:0/3483458877 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f22b8015020 con 0x7f22c409e000 2023-10-01T07:57:41.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.241+0000 7f22cb71f700 1 -- 172.21.15.26:0/3483458877 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f22c41a8d60 con 0x7f22c409e000 2023-10-01T07:57:41.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.241+0000 7f22b5ffb700 1 -- 172.21.15.26:0/3483458877 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f22b80199a0 con 0x7f22c409e000 2023-10-01T07:57:41.242 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:41.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.243+0000 7f22cb71f700 1 -- 172.21.15.26:0/3483458877 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22c409e000 msgr2=0x7f22c41a6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:41.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.243+0000 7f22cb71f700 1 --2- 172.21.15.26:0/3483458877 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22c409e000 0x7f22c41a6440 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f22b8009870 tx=0x7f22b8004750 comp rx=0 tx=0).stop 2023-10-01T07:57:41.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.243+0000 7f22cb71f700 1 -- 172.21.15.26:0/3483458877 shutdown_connections 2023-10-01T07:57:41.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.243+0000 7f22cb71f700 1 --2- 172.21.15.26:0/3483458877 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f22c409e410 0x7f22c41a6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:41.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.243+0000 7f22cb71f700 1 --2- 172.21.15.26:0/3483458877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22c409d6f0 0x7f22c41a5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:41.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.243+0000 7f22cb71f700 1 --2- 172.21.15.26:0/3483458877 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22c409e000 0x7f22c41a6440 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:41.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.243+0000 7f22cb71f700 1 -- 172.21.15.26:0/3483458877 >> 172.21.15.26:0/3483458877 conn(0x7f22c4066f50 msgr2=0x7f22c41bae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:41.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.243+0000 7f22cb71f700 1 -- 172.21.15.26:0/3483458877 shutdown_connections 2023-10-01T07:57:41.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:41.243+0000 7f22cb71f700 1 -- 172.21.15.26:0/3483458877 wait complete. 2023-10-01T07:57:41.257 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:41.979 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:42.000 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:42.017 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:42.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.132+0000 7fee3d393700 1 Processor -- start 2023-10-01T07:57:42.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.132+0000 7fee3d393700 1 -- start start 2023-10-01T07:57:42.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.132+0000 7fee3d393700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee380a0a30 0x7fee380a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:42.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.132+0000 7fee3d393700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee3809d630 0x7fee380a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:42.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.132+0000 7fee3d393700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fee38133930 0x7fee38133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:42.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.132+0000 7fee3d393700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee380a2a70 con 0x7fee38133930 2023-10-01T07:57:42.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.132+0000 7fee3d393700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee380a01d0 con 0x7fee3809d630 2023-10-01T07:57:42.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.132+0000 7fee3d393700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee3809e2b0 con 0x7fee380a0a30 2023-10-01T07:57:42.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.132+0000 7fee377fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fee38133930 0x7fee38133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:42.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.132+0000 7fee367fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee3809d630 0x7fee380a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:42.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.132+0000 7fee36ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee380a0a30 0x7fee380a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:42.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.132+0000 7fee377fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fee38133930 0x7fee38133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56812/0 (socket says 172.21.15.26:56812) 2023-10-01T07:57:42.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.132+0000 7fee367fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee3809d630 0x7fee380a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47616/0 (socket says 172.21.15.26:47616) 2023-10-01T07:57:42.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.132+0000 7fee377fe700 1 -- 172.21.15.26:0/241266360 learned_addr learned my addr 172.21.15.26:0/241266360 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:42.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.133+0000 7fee377fe700 1 -- 172.21.15.26:0/241266360 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee380a0a30 msgr2=0x7fee380a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:42.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.133+0000 7fee377fe700 1 --2- 172.21.15.26:0/241266360 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee380a0a30 0x7fee380a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.133+0000 7fee377fe700 1 -- 172.21.15.26:0/241266360 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee3809d630 msgr2=0x7fee380a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:42.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.133+0000 7fee377fe700 1 --2- 172.21.15.26:0/241266360 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee3809d630 0x7fee380a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.133+0000 7fee377fe700 1 -- 172.21.15.26:0/241266360 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee3809dc50 con 0x7fee38133930 2023-10-01T07:57:42.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.133+0000 7fee377fe700 1 --2- 172.21.15.26:0/241266360 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee38133930 0x7fee38133dd0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fee30009e50 tx=0x7fee3000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1174fa0167bf5c7e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:42.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.133+0000 7fee35ffb700 1 -- 172.21.15.26:0/241266360 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3000e070 con 0x7fee38133930 2023-10-01T07:57:42.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.133+0000 7fee35ffb700 1 -- 172.21.15.26:0/241266360 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3000b910 con 0x7fee38133930 2023-10-01T07:57:42.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.133+0000 7fee35ffb700 1 -- 172.21.15.26:0/241266360 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3000bcc0 con 0x7fee38133930 2023-10-01T07:57:42.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.134+0000 7fee3d393700 1 -- 172.21.15.26:0/241266360 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee38133930 msgr2=0x7fee38133dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:42.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.134+0000 7fee3d393700 1 --2- 172.21.15.26:0/241266360 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee38133930 0x7fee38133dd0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fee30009e50 tx=0x7fee3000b330 comp rx=0 tx=0).stop 2023-10-01T07:57:42.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.134+0000 7fee3d393700 1 -- 172.21.15.26:0/241266360 shutdown_connections 2023-10-01T07:57:42.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.134+0000 7fee3d393700 1 --2- 172.21.15.26:0/241266360 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee38133930 0x7fee38133dd0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.134+0000 7fee3d393700 1 --2- 172.21.15.26:0/241266360 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee380a0a30 0x7fee380a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.134+0000 7fee3d393700 1 --2- 172.21.15.26:0/241266360 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee3809d630 0x7fee380a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.134+0000 7fee3d393700 1 -- 172.21.15.26:0/241266360 >> 172.21.15.26:0/241266360 conn(0x7fee380a3050 msgr2=0x7fee380a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:42.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.134+0000 7fee3d393700 1 -- 172.21.15.26:0/241266360 shutdown_connections 2023-10-01T07:57:42.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.134+0000 7fee3d393700 1 -- 172.21.15.26:0/241266360 wait complete. 2023-10-01T07:57:42.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.135+0000 7fee3d393700 1 Processor -- start 2023-10-01T07:57:42.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.135+0000 7fee3d393700 1 -- start start 2023-10-01T07:57:42.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.136+0000 7fee3d393700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee3809d630 0x7fee3811f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:42.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.136+0000 7fee3d393700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee380a0a30 0x7fee3811fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:42.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.136+0000 7fee3d393700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee38133930 0x7fee381c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:42.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.136+0000 7fee3d393700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee381223b0 con 0x7fee3809d630 2023-10-01T07:57:42.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.136+0000 7fee3d393700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee3811ef40 con 0x7fee380a0a30 2023-10-01T07:57:42.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.136+0000 7fee3d393700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee38133420 con 0x7fee38133930 2023-10-01T07:57:42.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.136+0000 7fee367fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee380a0a30 0x7fee3811fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:42.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.136+0000 7fee377fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee38133930 0x7fee381c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:42.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.136+0000 7fee367fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee380a0a30 0x7fee3811fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47620/0 (socket says 172.21.15.26:47620) 2023-10-01T07:57:42.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.136+0000 7fee367fc700 1 -- 172.21.15.26:0/271806270 learned_addr learned my addr 172.21.15.26:0/271806270 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:42.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.136+0000 7fee36ffd700 1 --2- 172.21.15.26:0/271806270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee3809d630 0x7fee3811f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:42.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.136+0000 7fee377fe700 1 -- 172.21.15.26:0/271806270 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee380a0a30 msgr2=0x7fee3811fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:42.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.136+0000 7fee377fe700 1 --2- 172.21.15.26:0/271806270 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee380a0a30 0x7fee3811fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.136+0000 7fee377fe700 1 -- 172.21.15.26:0/271806270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee3809d630 msgr2=0x7fee3811f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:42.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.136+0000 7fee377fe700 1 --2- 172.21.15.26:0/271806270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee3809d630 0x7fee3811f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.136+0000 7fee377fe700 1 -- 172.21.15.26:0/271806270 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee30009b30 con 0x7fee38133930 2023-10-01T07:57:42.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.136+0000 7fee36ffd700 1 --2- 172.21.15.26:0/271806270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee3809d630 0x7fee3811f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:57:42.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.136+0000 7fee377fe700 1 --2- 172.21.15.26:0/271806270 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee38133930 0x7fee381c7f80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fee30015000 tx=0x7fee30004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:42.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.137+0000 7fee1f7fe700 1 -- 172.21.15.26:0/271806270 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee30004450 con 0x7fee38133930 2023-10-01T07:57:42.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.137+0000 7fee1f7fe700 1 -- 172.21.15.26:0/271806270 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee300045d0 con 0x7fee38133930 2023-10-01T07:57:42.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.137+0000 7fee1f7fe700 1 -- 172.21.15.26:0/271806270 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3000ce80 con 0x7fee38133930 2023-10-01T07:57:42.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.137+0000 7fee3d393700 1 -- 172.21.15.26:0/271806270 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee380a0410 con 0x7fee38133930 2023-10-01T07:57:42.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.137+0000 7fee3d393700 1 -- 172.21.15.26:0/271806270 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee38120e90 con 0x7fee38133930 2023-10-01T07:57:42.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.138+0000 7fee1f7fe700 1 -- 172.21.15.26:0/271806270 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fee3001c410 con 0x7fee38133930 2023-10-01T07:57:42.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.138+0000 7fee1f7fe700 1 -- 172.21.15.26:0/271806270 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fee30040e30 con 0x7fee38133930 2023-10-01T07:57:42.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.138+0000 7fee3d393700 1 -- 172.21.15.26:0/271806270 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee380747f0 con 0x7fee38133930 2023-10-01T07:57:42.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.147+0000 7fee1f7fe700 1 -- 172.21.15.26:0/271806270 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fee3002a020 con 0x7fee38133930 2023-10-01T07:57:42.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.170+0000 7f306b5ab700 1 Processor -- start 2023-10-01T07:57:42.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.170+0000 7f306b5ab700 1 -- start start 2023-10-01T07:57:42.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.171+0000 7f306b5ab700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f306406b250 0x7f3064136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:42.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.171+0000 7f306b5ab700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3064136d80 0x7f3064139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:42.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.171+0000 7f306b5ab700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f306409ece0 con 0x7f306406a770 2023-10-01T07:57:42.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.171+0000 7f306b5ab700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f306409e760 con 0x7f306406b250 2023-10-01T07:57:42.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.171+0000 7f306b5ab700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306409e040 con 0x7f3064136d80 2023-10-01T07:57:42.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.171+0000 7f3068b46700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f306406b250 0x7f3064136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:42.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.171+0000 7f3068b46700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f306406b250 0x7f3064136840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56830/0 (socket says 172.21.15.26:56830) 2023-10-01T07:57:42.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.171+0000 7f3068b46700 1 -- 172.21.15.26:0/1973365739 learned_addr learned my addr 172.21.15.26:0/1973365739 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:42.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.171+0000 7f3069b48700 1 --2- 172.21.15.26:0/1973365739 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3064136d80 0x7f3064139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:42.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.171+0000 7f3068b46700 1 -- 172.21.15.26:0/1973365739 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3064136d80 msgr2=0x7f3064139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:42.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.172+0000 7f3068b46700 1 --2- 172.21.15.26:0/1973365739 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3064136d80 0x7f3064139160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.172+0000 7f3068b46700 1 -- 172.21.15.26:0/1973365739 >> v1:172.21.15.26:6789/0 conn(0x7f306406a770 legacy=0x7f306406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:42.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.172+0000 7f3068b46700 1 -- 172.21.15.26:0/1973365739 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306409f630 con 0x7f306406b250 2023-10-01T07:57:42.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.172+0000 7f3069b48700 1 --2- 172.21.15.26:0/1973365739 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3064136d80 0x7f3064139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:42.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.172+0000 7f3068b46700 1 --2- 172.21.15.26:0/1973365739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f306406b250 0x7f3064136840 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f30540098f0 tx=0x7f3054009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f764cbbc1767e83e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:42.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.172+0000 7f305bfff700 1 -- 172.21.15.26:0/1973365739 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3054011830 con 0x7f306406b250 2023-10-01T07:57:42.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.172+0000 7f305bfff700 1 -- 172.21.15.26:0/1973365739 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3054011990 con 0x7f306406b250 2023-10-01T07:57:42.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.172+0000 7f305bfff700 1 -- 172.21.15.26:0/1973365739 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3054011d20 con 0x7f306406b250 2023-10-01T07:57:42.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.173+0000 7f306b5ab700 1 -- 172.21.15.26:0/1973365739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f306406b250 msgr2=0x7f3064136840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:42.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.173+0000 7f306b5ab700 1 --2- 172.21.15.26:0/1973365739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f306406b250 0x7f3064136840 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f30540098f0 tx=0x7f3054009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:42.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.173+0000 7f306b5ab700 1 -- 172.21.15.26:0/1973365739 shutdown_connections 2023-10-01T07:57:42.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.173+0000 7f306b5ab700 1 --2- 172.21.15.26:0/1973365739 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3064136d80 0x7f3064139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.173+0000 7f306b5ab700 1 --2- 172.21.15.26:0/1973365739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f306406b250 0x7f3064136840 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.173+0000 7f306b5ab700 1 -- 172.21.15.26:0/1973365739 >> 172.21.15.26:0/1973365739 conn(0x7f3064066f50 msgr2=0x7f306409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:42.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.173+0000 7f306b5ab700 1 -- 172.21.15.26:0/1973365739 shutdown_connections 2023-10-01T07:57:42.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.173+0000 7f306b5ab700 1 -- 172.21.15.26:0/1973365739 wait complete. 2023-10-01T07:57:42.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.174+0000 7f6f3858e700 1 Processor -- start 2023-10-01T07:57:42.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.174+0000 7f6f3858e700 1 -- start start 2023-10-01T07:57:42.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.174+0000 7f306b5ab700 1 Processor -- start 2023-10-01T07:57:42.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.174+0000 7f306b5ab700 1 -- start start 2023-10-01T07:57:42.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.174+0000 7f306b5ab700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f306406a770 0x7f306409ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:42.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.174+0000 7f306b5ab700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f306406b250 0x7f306409b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:42.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.174+0000 7f306b5ab700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3064136d80 0x7f30641c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:42.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.174+0000 7f306b5ab700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306411f1a0 con 0x7f306406a770 2023-10-01T07:57:42.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.174+0000 7f306b5ab700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306409a9f0 con 0x7f306406b250 2023-10-01T07:57:42.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.174+0000 7f306b5ab700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f306406e970 con 0x7f3064136d80 2023-10-01T07:57:42.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.175+0000 7f3068b46700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f306406b250 0x7f306409b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:42.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.175+0000 7f3068b46700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f306406b250 0x7f306409b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47636/0 (socket says 172.21.15.26:47636) 2023-10-01T07:57:42.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.175+0000 7f3068b46700 1 -- 172.21.15.26:0/1533467196 learned_addr learned my addr 172.21.15.26:0/1533467196 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:42.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.175+0000 7f3069b48700 1 --2- 172.21.15.26:0/1533467196 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3064136d80 0x7f30641c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:42.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.175+0000 7f6f3858e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f301334d0 0x7f6f301358b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:42.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.175+0000 7f3068b46700 1 -- 172.21.15.26:0/1533467196 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3064136d80 msgr2=0x7f30641c8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:42.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.175+0000 7f3068b46700 1 --2- 172.21.15.26:0/1533467196 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3064136d80 0x7f30641c8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.175+0000 7f3068b46700 1 -- 172.21.15.26:0/1533467196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f306406a770 msgr2=0x7f306409ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:42.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.175+0000 7f3068b46700 1 --2- 172.21.15.26:0/1533467196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f306406a770 0x7f306409ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.175+0000 7f3068b46700 1 -- 172.21.15.26:0/1533467196 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305c009a70 con 0x7f306406b250 2023-10-01T07:57:42.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.175+0000 7f3069b48700 1 --2- 172.21.15.26:0/1533467196 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3064136d80 0x7f30641c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:42.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.175+0000 7f6f3858e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f30135df0 0x7f6f301381d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:42.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.175+0000 7f6f3858e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f3009ef50 con 0x7f6f30130790 2023-10-01T07:57:42.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.175+0000 7f6f3858e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3009a370 con 0x7f6f301334d0 2023-10-01T07:57:42.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.175+0000 7f6f3858e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f30070860 con 0x7f6f30135df0 2023-10-01T07:57:42.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.175+0000 7f6f36b2b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f30135df0 0x7f6f301381d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:42.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.175+0000 7f6f35b29700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f301334d0 0x7f6f301358b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:42.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.175+0000 7f6f36b2b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f30135df0 0x7f6f301381d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55732/0 (socket says 172.21.15.26:55732) 2023-10-01T07:57:42.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.175+0000 7f6f36b2b700 1 -- 172.21.15.26:0/2971554170 learned_addr learned my addr 172.21.15.26:0/2971554170 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:42.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.175+0000 7f3068b46700 1 --2- 172.21.15.26:0/1533467196 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f306406b250 0x7f306409b360 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3054000c00 tx=0x7f3054004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:42.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.176+0000 7f6f36b2b700 1 -- 172.21.15.26:0/2971554170 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f301334d0 msgr2=0x7f6f301358b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:42.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.176+0000 7f6f36b2b700 1 --2- 172.21.15.26:0/2971554170 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f301334d0 0x7f6f301358b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.176+0000 7f6f36b2b700 1 -- 172.21.15.26:0/2971554170 >> v1:172.21.15.26:6789/0 conn(0x7f6f30130790 legacy=0x7f6f30130b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:42.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.176+0000 7f6f36b2b700 1 -- 172.21.15.26:0/2971554170 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f30130340 con 0x7f6f30135df0 2023-10-01T07:57:42.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.176+0000 7f3059ffb700 1 -- 172.21.15.26:0/1533467196 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30540044b0 con 0x7f306406b250 2023-10-01T07:57:42.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.176+0000 7f3059ffb700 1 -- 172.21.15.26:0/1533467196 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305401f070 con 0x7f306406b250 2023-10-01T07:57:42.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.176+0000 7f306b5ab700 1 -- 172.21.15.26:0/1533467196 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3054009550 con 0x7f306406b250 2023-10-01T07:57:42.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.176+0000 7f6f36b2b700 1 --2- 172.21.15.26:0/2971554170 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f30135df0 0x7f6f301381d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6f28009e80 tx=0x7f6f2800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=313209ced37c7899 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:42.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.176+0000 7f6f35328700 1 -- 172.21.15.26:0/2971554170 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2800e070 con 0x7f6f30135df0 2023-10-01T07:57:42.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.176+0000 7f6f35328700 1 -- 172.21.15.26:0/2971554170 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f28003a20 con 0x7f6f30135df0 2023-10-01T07:57:42.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.176+0000 7f6f35328700 1 -- 172.21.15.26:0/2971554170 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f28003dd0 con 0x7f6f30135df0 2023-10-01T07:57:42.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.176+0000 7f3059ffb700 1 -- 172.21.15.26:0/1533467196 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30540038c0 con 0x7f306406b250 2023-10-01T07:57:42.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.176+0000 7f306b5ab700 1 -- 172.21.15.26:0/1533467196 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f306411de60 con 0x7f306406b250 2023-10-01T07:57:42.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.177+0000 7f3059ffb700 1 -- 172.21.15.26:0/1533467196 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3054021030 con 0x7f306406b250 2023-10-01T07:57:42.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.177+0000 7f3059ffb700 1 -- 172.21.15.26:0/1533467196 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3054040a20 con 0x7f306406b250 2023-10-01T07:57:42.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.177+0000 7f306b5ab700 1 -- 172.21.15.26:0/1533467196 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3064074ea0 con 0x7f306406b250 2023-10-01T07:57:42.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.177+0000 7f6f3858e700 1 -- 172.21.15.26:0/2971554170 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f30135df0 msgr2=0x7f6f301381d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:42.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.177+0000 7f6f3858e700 1 --2- 172.21.15.26:0/2971554170 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f30135df0 0x7f6f301381d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6f28009e80 tx=0x7f6f2800b330 comp rx=0 tx=0).stop 2023-10-01T07:57:42.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.177+0000 7f6f3858e700 1 -- 172.21.15.26:0/2971554170 shutdown_connections 2023-10-01T07:57:42.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.178+0000 7f6f3858e700 1 --2- 172.21.15.26:0/2971554170 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f30135df0 0x7f6f301381d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.178+0000 7f6f3858e700 1 --2- 172.21.15.26:0/2971554170 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f301334d0 0x7f6f301358b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.178+0000 7f6f3858e700 1 -- 172.21.15.26:0/2971554170 >> 172.21.15.26:0/2971554170 conn(0x7f6f300a2aa0 msgr2=0x7f6f300a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:42.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.178+0000 7f6f3858e700 1 -- 172.21.15.26:0/2971554170 shutdown_connections 2023-10-01T07:57:42.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.178+0000 7f6f3858e700 1 -- 172.21.15.26:0/2971554170 wait complete. 2023-10-01T07:57:42.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.179+0000 7f6f3858e700 1 Processor -- start 2023-10-01T07:57:42.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.179+0000 7f6f3858e700 1 -- start start 2023-10-01T07:57:42.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.180+0000 7f6f3858e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f30130790 0x7f6f301c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:42.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.180+0000 7f6f3858e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f301334d0 0x7f6f301c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:42.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.180+0000 7f6f3858e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f30135df0 0x7f6f3006e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:42.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.180+0000 7f6f3858e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3009dc60 con 0x7f6f30135df0 2023-10-01T07:57:42.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.180+0000 7f6f3858e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3012fdf0 con 0x7f6f30130790 2023-10-01T07:57:42.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.180+0000 7f6f3858e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f30071800 con 0x7f6f301334d0 2023-10-01T07:57:42.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.180+0000 7f6f35b29700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f301334d0 0x7f6f301c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:42.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.180+0000 7f6f3632a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f30130790 0x7f6f301c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:42.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.180+0000 7f6f36b2b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f30135df0 0x7f6f3006e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:42.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.180+0000 7f6f35b29700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f301334d0 0x7f6f301c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55746/0 (socket says 172.21.15.26:55746) 2023-10-01T07:57:42.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.180+0000 7f6f35b29700 1 -- 172.21.15.26:0/3192860047 learned_addr learned my addr 172.21.15.26:0/3192860047 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:42.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.181+0000 7f6f36b2b700 1 -- 172.21.15.26:0/3192860047 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f301334d0 msgr2=0x7f6f301c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:42.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.181+0000 7f6f36b2b700 1 --2- 172.21.15.26:0/3192860047 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f301334d0 0x7f6f301c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.181+0000 7f6f36b2b700 1 -- 172.21.15.26:0/3192860047 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f30130790 msgr2=0x7f6f301c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:42.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.181+0000 7f6f36b2b700 1 --2- 172.21.15.26:0/3192860047 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f30130790 0x7f6f301c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.181+0000 7f6f36b2b700 1 -- 172.21.15.26:0/3192860047 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f28009b30 con 0x7f6f30135df0 2023-10-01T07:57:42.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.181+0000 7f6f35b29700 1 --2- 172.21.15.26:0/3192860047 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f301334d0 0x7f6f301c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:42.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.181+0000 7f6f36b2b700 1 --2- 172.21.15.26:0/3192860047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f30135df0 0x7f6f3006e530 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f6f28014000 tx=0x7f6f28004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:42.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.181+0000 7f6f26ffd700 1 -- 172.21.15.26:0/3192860047 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f28004440 con 0x7f6f30135df0 2023-10-01T07:57:42.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.181+0000 7f6f26ffd700 1 -- 172.21.15.26:0/3192860047 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f280045c0 con 0x7f6f30135df0 2023-10-01T07:57:42.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.181+0000 7f6f26ffd700 1 -- 172.21.15.26:0/3192860047 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f28004970 con 0x7f6f30135df0 2023-10-01T07:57:42.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.181+0000 7f6f3858e700 1 -- 172.21.15.26:0/3192860047 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f301c8180 con 0x7f6f30135df0 2023-10-01T07:57:42.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.181+0000 7f6f3858e700 1 -- 172.21.15.26:0/3192860047 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f3009e290 con 0x7f6f30135df0 2023-10-01T07:57:42.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.182+0000 7f6f3858e700 1 -- 172.21.15.26:0/3192860047 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f30074ea0 con 0x7f6f30135df0 2023-10-01T07:57:42.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.183+0000 7f6f26ffd700 1 -- 172.21.15.26:0/3192860047 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6f28030480 con 0x7f6f30135df0 2023-10-01T07:57:42.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.183+0000 7f6f26ffd700 1 -- 172.21.15.26:0/3192860047 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6f28041150 con 0x7f6f30135df0 2023-10-01T07:57:42.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.184+0000 7f3059ffb700 1 -- 172.21.15.26:0/1533467196 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3054015070 con 0x7f306406b250 2023-10-01T07:57:42.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.192+0000 7f6f26ffd700 1 -- 172.21.15.26:0/3192860047 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f2801c380 con 0x7f6f30135df0 2023-10-01T07:57:42.259 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:42.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.365+0000 7fee3d393700 1 -- 172.21.15.26:0/271806270 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fee38072980 con 0x7fee38133930 2023-10-01T07:57:42.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.366+0000 7fee1f7fe700 1 -- 172.21.15.26:0/271806270 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fee30023770 con 0x7fee38133930 2023-10-01T07:57:42.367 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:42.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.368+0000 7fee3d393700 1 -- 172.21.15.26:0/271806270 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee38133930 msgr2=0x7fee381c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:42.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.368+0000 7fee3d393700 1 --2- 172.21.15.26:0/271806270 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee38133930 0x7fee381c7f80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fee30015000 tx=0x7fee30004ad0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.368+0000 7fee3d393700 1 -- 172.21.15.26:0/271806270 shutdown_connections 2023-10-01T07:57:42.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.368+0000 7fee3d393700 1 --2- 172.21.15.26:0/271806270 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee38133930 0x7fee381c7f80 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.368+0000 7fee3d393700 1 --2- 172.21.15.26:0/271806270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee3809d630 0x7fee3811f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.368+0000 7fee3d393700 1 --2- 172.21.15.26:0/271806270 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee380a0a30 0x7fee3811fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.368+0000 7fee3d393700 1 -- 172.21.15.26:0/271806270 >> 172.21.15.26:0/271806270 conn(0x7fee380a3050 msgr2=0x7fee380a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:42.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.368+0000 7fee3d393700 1 -- 172.21.15.26:0/271806270 shutdown_connections 2023-10-01T07:57:42.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.368+0000 7fee3d393700 1 -- 172.21.15.26:0/271806270 wait complete. 2023-10-01T07:57:42.384 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:42.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.399+0000 7f6f3858e700 1 -- 172.21.15.26:0/3192860047 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6f3009ef50 con 0x7f6f30135df0 2023-10-01T07:57:42.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.399+0000 7f6f26ffd700 1 -- 172.21.15.26:0/3192860047 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6f3009ef50 con 0x7f6f30135df0 2023-10-01T07:57:42.400 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:42.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.400+0000 7fa50b59e700 1 Processor -- start 2023-10-01T07:57:42.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.400+0000 7fa50b59e700 1 -- start start 2023-10-01T07:57:42.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.401+0000 7f306b5ab700 1 -- 172.21.15.26:0/1533467196 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f306411ed40 con 0x7f306406b250 2023-10-01T07:57:42.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.401+0000 7fa50b59e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa50c09d800 0x7fa50c09dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:42.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.401+0000 7fa50b59e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa50c09e110 0x7fa50c133860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:42.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.401+0000 7fa50b59e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa50c133da0 0x7fa50c134210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:42.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.401+0000 7fa50b59e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa50c09f560 con 0x7fa50c09d800 2023-10-01T07:57:42.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.401+0000 7fa50b59e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c099e10 con 0x7fa50c09e110 2023-10-01T07:57:42.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.401+0000 7fa50b59e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c06b4d0 con 0x7fa50c133da0 2023-10-01T07:57:42.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.401+0000 7fa50a59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa50c09d800 0x7fa50c09dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:42.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.401+0000 7fa50a59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa50c09d800 0x7fa50c09dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56842/0 (socket says 172.21.15.26:56842) 2023-10-01T07:57:42.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.401+0000 7fa50a59c700 1 -- 172.21.15.26:0/3708485828 learned_addr learned my addr 172.21.15.26:0/3708485828 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:42.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.401+0000 7fa50ad9d700 1 --2- 172.21.15.26:0/3708485828 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa50c133da0 0x7fa50c134210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:42.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.401+0000 7fa509d9b700 1 --2- 172.21.15.26:0/3708485828 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa50c09e110 0x7fa50c133860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:42.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.401+0000 7f3059ffb700 1 -- 172.21.15.26:0/1533467196 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3054003cb0 con 0x7f306406b250 2023-10-01T07:57:42.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.401+0000 7fa50ad9d700 1 -- 172.21.15.26:0/3708485828 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa50c09e110 msgr2=0x7fa50c133860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:42.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.401+0000 7fa50ad9d700 1 --2- 172.21.15.26:0/3708485828 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa50c09e110 0x7fa50c133860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.401+0000 7fa50ad9d700 1 -- 172.21.15.26:0/3708485828 >> v2:172.21.15.26:3300/0 conn(0x7fa50c09d800 msgr2=0x7fa50c09dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:42.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.401+0000 7fa50ad9d700 1 --2- 172.21.15.26:0/3708485828 >> v2:172.21.15.26:3300/0 conn(0x7fa50c09d800 0x7fa50c09dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.402+0000 7fa50ad9d700 1 -- 172.21.15.26:0/3708485828 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50c09a060 con 0x7fa50c133da0 2023-10-01T07:57:42.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.402+0000 7f6f3858e700 1 -- 172.21.15.26:0/3192860047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f30135df0 msgr2=0x7f6f3006e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:42.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.402+0000 7f6f3858e700 1 --2- 172.21.15.26:0/3192860047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f30135df0 0x7f6f3006e530 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f6f28014000 tx=0x7f6f28004ad0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.402+0000 7fa50a59c700 1 --2- 172.21.15.26:0/3708485828 >> v2:172.21.15.26:3300/0 conn(0x7fa50c09d800 0x7fa50c09dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:42.405 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:42.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.402+0000 7f6f3858e700 1 -- 172.21.15.26:0/3192860047 shutdown_connections 2023-10-01T07:57:42.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.402+0000 7f6f3858e700 1 --2- 172.21.15.26:0/3192860047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f30135df0 0x7f6f3006e530 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.402+0000 7f6f3858e700 1 --2- 172.21.15.26:0/3192860047 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f30130790 0x7f6f301c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.402+0000 7f6f3858e700 1 --2- 172.21.15.26:0/3192860047 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f301334d0 0x7f6f301c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.402+0000 7f6f3858e700 1 -- 172.21.15.26:0/3192860047 >> 172.21.15.26:0/3192860047 conn(0x7f6f300a2aa0 msgr2=0x7f6f3006f640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:42.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.402+0000 7fa50ad9d700 1 --2- 172.21.15.26:0/3708485828 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa50c133da0 0x7fa50c134210 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa504009d90 tx=0x7fa50400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d60e3b4fa87a812f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:42.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.402+0000 7f6f3858e700 1 -- 172.21.15.26:0/3192860047 shutdown_connections 2023-10-01T07:57:42.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.402+0000 7f6f3858e700 1 -- 172.21.15.26:0/3192860047 wait complete. 2023-10-01T07:57:42.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.402+0000 7fa50959a700 1 -- 172.21.15.26:0/3708485828 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50400e070 con 0x7fa50c133da0 2023-10-01T07:57:42.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.402+0000 7fa50959a700 1 -- 172.21.15.26:0/3708485828 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50400bb20 con 0x7fa50c133da0 2023-10-01T07:57:42.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.402+0000 7fa50959a700 1 -- 172.21.15.26:0/3708485828 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa504012430 con 0x7fa50c133da0 2023-10-01T07:57:42.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.403+0000 7fa50b59e700 1 -- 172.21.15.26:0/3708485828 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa50c133da0 msgr2=0x7fa50c134210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:42.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.403+0000 7fa50b59e700 1 --2- 172.21.15.26:0/3708485828 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa50c133da0 0x7fa50c134210 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa504009d90 tx=0x7fa50400b330 comp rx=0 tx=0).stop 2023-10-01T07:57:42.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.403+0000 7fa50b59e700 1 -- 172.21.15.26:0/3708485828 shutdown_connections 2023-10-01T07:57:42.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.403+0000 7fa50b59e700 1 --2- 172.21.15.26:0/3708485828 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa50c133da0 0x7fa50c134210 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.403+0000 7fa50b59e700 1 --2- 172.21.15.26:0/3708485828 >> v2:172.21.15.26:3300/0 conn(0x7fa50c09d800 0x7fa50c09dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.403+0000 7fa50b59e700 1 --2- 172.21.15.26:0/3708485828 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa50c09e110 0x7fa50c133860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.403+0000 7fa50b59e700 1 -- 172.21.15.26:0/3708485828 >> 172.21.15.26:0/3708485828 conn(0x7fa50c0a2e20 msgr2=0x7fa50c0a3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:42.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.403+0000 7fa50b59e700 1 -- 172.21.15.26:0/3708485828 shutdown_connections 2023-10-01T07:57:42.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.403+0000 7fa50b59e700 1 -- 172.21.15.26:0/3708485828 wait complete. 2023-10-01T07:57:42.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.404+0000 7f306b5ab700 1 -- 172.21.15.26:0/1533467196 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f306406b250 msgr2=0x7f306409b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:42.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.404+0000 7f306b5ab700 1 --2- 172.21.15.26:0/1533467196 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f306406b250 0x7f306409b360 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3054000c00 tx=0x7f3054004750 comp rx=0 tx=0).stop 2023-10-01T07:57:42.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.404+0000 7f306b5ab700 1 -- 172.21.15.26:0/1533467196 shutdown_connections 2023-10-01T07:57:42.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.404+0000 7f306b5ab700 1 --2- 172.21.15.26:0/1533467196 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3064136d80 0x7f30641c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.404+0000 7f306b5ab700 1 --2- 172.21.15.26:0/1533467196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f306406a770 0x7f306409ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.404+0000 7f306b5ab700 1 --2- 172.21.15.26:0/1533467196 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f306406b250 0x7f306409b360 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.404+0000 7f306b5ab700 1 -- 172.21.15.26:0/1533467196 >> 172.21.15.26:0/1533467196 conn(0x7f3064066f50 msgr2=0x7f306406f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:42.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.405+0000 7f306b5ab700 1 -- 172.21.15.26:0/1533467196 shutdown_connections 2023-10-01T07:57:42.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.405+0000 7f306b5ab700 1 -- 172.21.15.26:0/1533467196 wait complete. 2023-10-01T07:57:42.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.405+0000 7fa50b59e700 1 Processor -- start 2023-10-01T07:57:42.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.405+0000 7fa50b59e700 1 -- start start 2023-10-01T07:57:42.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.406+0000 7fa50b59e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa50c09d800 0x7fa50c1221b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:42.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.406+0000 7fa50b59e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa50c09e110 0x7fa50c1226f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:42.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.406+0000 7fa50b59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa50c133da0 0x7fa50c122c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:42.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.406+0000 7fa50b59e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c123680 con 0x7fa50c133da0 2023-10-01T07:57:42.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.406+0000 7fa50b59e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c125cd0 con 0x7fa50c09d800 2023-10-01T07:57:42.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.406+0000 7fa50b59e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c124c70 con 0x7fa50c09e110 2023-10-01T07:57:42.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.406+0000 7fa50a59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa50c09d800 0x7fa50c1221b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:42.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.406+0000 7fa50a59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa50c09d800 0x7fa50c1221b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47670/0 (socket says 172.21.15.26:47670) 2023-10-01T07:57:42.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.406+0000 7fa50a59c700 1 -- 172.21.15.26:0/1309956502 learned_addr learned my addr 172.21.15.26:0/1309956502 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:42.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.406+0000 7fa509d9b700 1 --2- 172.21.15.26:0/1309956502 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa50c09e110 0x7fa50c1226f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:42.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.406+0000 7fa50ad9d700 1 --2- 172.21.15.26:0/1309956502 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa50c133da0 0x7fa50c122c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:42.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.406+0000 7fa509d9b700 1 -- 172.21.15.26:0/1309956502 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa50c09d800 msgr2=0x7fa50c1221b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:42.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.406+0000 7fa509d9b700 1 --2- 172.21.15.26:0/1309956502 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa50c09d800 0x7fa50c1221b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.406+0000 7fa509d9b700 1 -- 172.21.15.26:0/1309956502 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa50c133da0 msgr2=0x7fa50c122c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:42.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.406+0000 7fa509d9b700 1 --2- 172.21.15.26:0/1309956502 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa50c133da0 0x7fa50c122c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.406+0000 7fa509d9b700 1 -- 172.21.15.26:0/1309956502 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4fc009550 con 0x7fa50c09e110 2023-10-01T07:57:42.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.406+0000 7fa50a59c700 1 --2- 172.21.15.26:0/1309956502 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa50c09d800 0x7fa50c1221b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:42.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.407+0000 7fa509d9b700 1 --2- 172.21.15.26:0/1309956502 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa50c09e110 0x7fa50c1226f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa50000e900 tx=0x7fa50000ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:42.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.407+0000 7fa4faffd700 1 -- 172.21.15.26:0/1309956502 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa500013680 con 0x7fa50c09e110 2023-10-01T07:57:42.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.407+0000 7fa4faffd700 1 -- 172.21.15.26:0/1309956502 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5000137e0 con 0x7fa50c09e110 2023-10-01T07:57:42.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.407+0000 7fa50b59e700 1 -- 172.21.15.26:0/1309956502 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa504009a70 con 0x7fa50c09e110 2023-10-01T07:57:42.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.407+0000 7fa4faffd700 1 -- 172.21.15.26:0/1309956502 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa500013b50 con 0x7fa50c09e110 2023-10-01T07:57:42.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.407+0000 7fa50b59e700 1 -- 172.21.15.26:0/1309956502 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa50c1254b0 con 0x7fa50c09e110 2023-10-01T07:57:42.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.408+0000 7fa4faffd700 1 -- 172.21.15.26:0/1309956502 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa500013cb0 con 0x7fa50c09e110 2023-10-01T07:57:42.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.408+0000 7fa4faffd700 1 -- 172.21.15.26:0/1309956502 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa50003f6e0 con 0x7fa50c09e110 2023-10-01T07:57:42.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.408+0000 7fa50b59e700 1 -- 172.21.15.26:0/1309956502 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa50c11eea0 con 0x7fa50c09e110 2023-10-01T07:57:42.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.417+0000 7fa4faffd700 1 -- 172.21.15.26:0/1309956502 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa50001bbf0 con 0x7fa50c09e110 2023-10-01T07:57:42.419 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:42.423 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:42.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.623+0000 7fa50b59e700 1 -- 172.21.15.26:0/1309956502 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa50c1335e0 con 0x7fa50c09e110 2023-10-01T07:57:42.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.624+0000 7fa4faffd700 1 -- 172.21.15.26:0/1309956502 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa500021030 con 0x7fa50c09e110 2023-10-01T07:57:42.625 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:42.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.626+0000 7fa50b59e700 1 -- 172.21.15.26:0/1309956502 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa50c09e110 msgr2=0x7fa50c1226f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:42.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.626+0000 7fa50b59e700 1 --2- 172.21.15.26:0/1309956502 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa50c09e110 0x7fa50c1226f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa50000e900 tx=0x7fa50000ec10 comp rx=0 tx=0).stop 2023-10-01T07:57:42.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.626+0000 7fa50b59e700 1 -- 172.21.15.26:0/1309956502 shutdown_connections 2023-10-01T07:57:42.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.626+0000 7fa50b59e700 1 --2- 172.21.15.26:0/1309956502 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa50c133da0 0x7fa50c122c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.626+0000 7fa50b59e700 1 --2- 172.21.15.26:0/1309956502 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa50c09d800 0x7fa50c1221b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.626+0000 7fa50b59e700 1 --2- 172.21.15.26:0/1309956502 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa50c09e110 0x7fa50c1226f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:42.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.626+0000 7fa50b59e700 1 -- 172.21.15.26:0/1309956502 >> 172.21.15.26:0/1309956502 conn(0x7fa50c0a2e20 msgr2=0x7fa50c071ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:42.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.626+0000 7fa50b59e700 1 -- 172.21.15.26:0/1309956502 shutdown_connections 2023-10-01T07:57:42.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:42.626+0000 7fa50b59e700 1 -- 172.21.15.26:0/1309956502 wait complete. 2023-10-01T07:57:42.640 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:43.385 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:43.420 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:43.424 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:43.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.536+0000 7f004b67e700 1 Processor -- start 2023-10-01T07:57:43.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.536+0000 7f004b67e700 1 -- start start 2023-10-01T07:57:43.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.537+0000 7f004b67e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f004409d6f0 0x7f004409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:43.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.537+0000 7f004b67e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f004409e000 0x7f00441339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:43.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.537+0000 7f004b67e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f004409b120 con 0x7f004409e410 2023-10-01T07:57:43.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.537+0000 7f004b67e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f004406b460 con 0x7f004409d6f0 2023-10-01T07:57:43.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.537+0000 7f004b67e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f004409a7e0 con 0x7f004409e000 2023-10-01T07:57:43.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.537+0000 7f004941a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f004409d6f0 0x7f004409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:43.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.537+0000 7f004941a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f004409d6f0 0x7f004409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:49170/0 (socket says 172.21.15.26:49170) 2023-10-01T07:57:43.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.537+0000 7f004941a700 1 -- 172.21.15.26:0/1934821821 learned_addr learned my addr 172.21.15.26:0/1934821821 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:43.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.537+0000 7f0048c19700 1 --2- 172.21.15.26:0/1934821821 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f004409e000 0x7f00441339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:43.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.538+0000 7f0048c19700 1 -- 172.21.15.26:0/1934821821 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f004409d6f0 msgr2=0x7f004409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:43.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.538+0000 7f0048c19700 1 --2- 172.21.15.26:0/1934821821 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f004409d6f0 0x7f004409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:43.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.538+0000 7f0048c19700 1 -- 172.21.15.26:0/1934821821 >> v1:172.21.15.26:6789/0 conn(0x7f004409e410 legacy=0x7f0044133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:43.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.538+0000 7f0048c19700 1 -- 172.21.15.26:0/1934821821 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004409a500 con 0x7f004409e000 2023-10-01T07:57:43.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.538+0000 7f004941a700 1 --2- 172.21.15.26:0/1934821821 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f004409d6f0 0x7f004409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:43.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.538+0000 7f0048c19700 1 --2- 172.21.15.26:0/1934821821 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f004409e000 0x7f00441339f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f00340098a0 tx=0x7f0034009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2de726ae8d9d2c53 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:43.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.538+0000 7f003bfff700 1 -- 172.21.15.26:0/1934821821 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0034011830 con 0x7f004409e000 2023-10-01T07:57:43.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.538+0000 7f003bfff700 1 -- 172.21.15.26:0/1934821821 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0034011990 con 0x7f004409e000 2023-10-01T07:57:43.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.538+0000 7f003bfff700 1 -- 172.21.15.26:0/1934821821 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0034011d20 con 0x7f004409e000 2023-10-01T07:57:43.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.539+0000 7f004b67e700 1 -- 172.21.15.26:0/1934821821 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f004409e000 msgr2=0x7f00441339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:43.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.539+0000 7f004b67e700 1 --2- 172.21.15.26:0/1934821821 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f004409e000 0x7f00441339f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f00340098a0 tx=0x7f0034009bb0 comp rx=0 tx=0).stop 2023-10-01T07:57:43.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.539+0000 7f004b67e700 1 -- 172.21.15.26:0/1934821821 shutdown_connections 2023-10-01T07:57:43.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.539+0000 7f004b67e700 1 --2- 172.21.15.26:0/1934821821 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f004409d6f0 0x7f004409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:43.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.539+0000 7f004b67e700 1 --2- 172.21.15.26:0/1934821821 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f004409e000 0x7f00441339f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:43.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.539+0000 7f004b67e700 1 -- 172.21.15.26:0/1934821821 >> 172.21.15.26:0/1934821821 conn(0x7f0044066f50 msgr2=0x7f004409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:43.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.539+0000 7f004b67e700 1 -- 172.21.15.26:0/1934821821 shutdown_connections 2023-10-01T07:57:43.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.539+0000 7f004b67e700 1 -- 172.21.15.26:0/1934821821 wait complete. 2023-10-01T07:57:43.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.541+0000 7f004b67e700 1 Processor -- start 2023-10-01T07:57:43.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.541+0000 7f004b67e700 1 -- start start 2023-10-01T07:57:43.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.542+0000 7f004b67e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f004409d6f0 0x7f00441a5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:43.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.542+0000 7f004b67e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f004409e000 0x7f00441a6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:43.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.542+0000 7f004b67e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f004409e410 0x7f00441a6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:43.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.542+0000 7f004b67e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00441a7460 con 0x7f004409d6f0 2023-10-01T07:57:43.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.542+0000 7f004b67e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00441a7b90 con 0x7f004409e000 2023-10-01T07:57:43.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.542+0000 7f004b67e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00441a81b0 con 0x7f004409e410 2023-10-01T07:57:43.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.542+0000 7f004941a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f004409d6f0 0x7f00441a5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:43.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.542+0000 7f004941a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f004409d6f0 0x7f00441a5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34210/0 (socket says 172.21.15.26:34210) 2023-10-01T07:57:43.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.542+0000 7f0048c19700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f004409e000 0x7f00441a6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:43.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.542+0000 7f004941a700 1 -- 172.21.15.26:0/1960768489 learned_addr learned my addr 172.21.15.26:0/1960768489 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:43.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.542+0000 7f0049c1b700 1 --2- 172.21.15.26:0/1960768489 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f004409e410 0x7f00441a6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:43.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.542+0000 7f0048c19700 1 -- 172.21.15.26:0/1960768489 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f004409e410 msgr2=0x7f00441a6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:43.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.542+0000 7f0048c19700 1 --2- 172.21.15.26:0/1960768489 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f004409e410 0x7f00441a6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:43.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.542+0000 7f0048c19700 1 -- 172.21.15.26:0/1960768489 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f004409d6f0 msgr2=0x7f00441a5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:43.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.542+0000 7f0048c19700 1 --2- 172.21.15.26:0/1960768489 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f004409d6f0 0x7f00441a5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:43.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.542+0000 7f0048c19700 1 -- 172.21.15.26:0/1960768489 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0040009550 con 0x7f004409e000 2023-10-01T07:57:43.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.542+0000 7f004941a700 1 --2- 172.21.15.26:0/1960768489 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f004409d6f0 0x7f00441a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:43.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.542+0000 7f0048c19700 1 --2- 172.21.15.26:0/1960768489 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f004409e000 0x7f00441a6510 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f004409e9b0 tx=0x7f0034004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:43.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.543+0000 7f0039ffb700 1 -- 172.21.15.26:0/1960768489 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0034004510 con 0x7f004409e000 2023-10-01T07:57:43.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.543+0000 7f0039ffb700 1 -- 172.21.15.26:0/1960768489 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003401f070 con 0x7f004409e000 2023-10-01T07:57:43.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.543+0000 7f004b67e700 1 -- 172.21.15.26:0/1960768489 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00340094a0 con 0x7f004409e000 2023-10-01T07:57:43.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.543+0000 7f0039ffb700 1 -- 172.21.15.26:0/1960768489 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00340038e0 con 0x7f004409e000 2023-10-01T07:57:43.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.543+0000 7f004b67e700 1 -- 172.21.15.26:0/1960768489 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00440a3250 con 0x7f004409e000 2023-10-01T07:57:43.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.544+0000 7f004b67e700 1 -- 172.21.15.26:0/1960768489 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f004409c770 con 0x7f004409e000 2023-10-01T07:57:43.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.544+0000 7f0039ffb700 1 -- 172.21.15.26:0/1960768489 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0034003a40 con 0x7f004409e000 2023-10-01T07:57:43.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.545+0000 7f0039ffb700 1 -- 172.21.15.26:0/1960768489 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0034021070 con 0x7f004409e000 2023-10-01T07:57:43.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.549+0000 7f0039ffb700 1 -- 172.21.15.26:0/1960768489 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0034010d50 con 0x7f004409e000 2023-10-01T07:57:43.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.576+0000 7fd516b0d700 1 Processor -- start 2023-10-01T07:57:43.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.576+0000 7fd516b0d700 1 -- start start 2023-10-01T07:57:43.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.576+0000 7fd516b0d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd510133420 0x7fd5101337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:43.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.576+0000 7fd516b0d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd510133e30 0x7fd51012ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:43.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.576+0000 7fd516b0d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd510134260 0x7fd5101304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:43.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.576+0000 7fd516b0d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd51006b990 con 0x7fd510134260 2023-10-01T07:57:43.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.576+0000 7fd516b0d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5100a0590 con 0x7fd510133e30 2023-10-01T07:57:43.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.576+0000 7fd516b0d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd51009fb80 con 0x7fd510133420 2023-10-01T07:57:43.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.577+0000 7fd5148a9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd510133420 0x7fd5101337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:43.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.577+0000 7fd5148a9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd510133420 0x7fd5101337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:46982/0 (socket says 172.21.15.26:46982) 2023-10-01T07:57:43.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.577+0000 7fd5148a9700 1 -- 172.21.15.26:0/4142006568 learned_addr learned my addr 172.21.15.26:0/4142006568 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:43.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.577+0000 7fd5150aa700 1 --2- 172.21.15.26:0/4142006568 >> v2:172.21.15.26:3300/0 conn(0x7fd510134260 0x7fd5101304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:43.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.577+0000 7fd50ffff700 1 --2- 172.21.15.26:0/4142006568 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd510133e30 0x7fd51012ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:43.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.577+0000 7fd5148a9700 1 -- 172.21.15.26:0/4142006568 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd510133e30 msgr2=0x7fd51012ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:43.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.577+0000 7fd5148a9700 1 --2- 172.21.15.26:0/4142006568 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd510133e30 0x7fd51012ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:43.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.577+0000 7fd5148a9700 1 -- 172.21.15.26:0/4142006568 >> v2:172.21.15.26:3300/0 conn(0x7fd510134260 msgr2=0x7fd5101304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:43.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.577+0000 7fd5148a9700 1 --2- 172.21.15.26:0/4142006568 >> v2:172.21.15.26:3300/0 conn(0x7fd510134260 0x7fd5101304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:43.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.577+0000 7fd5148a9700 1 -- 172.21.15.26:0/4142006568 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5100a0030 con 0x7fd510133420 2023-10-01T07:57:43.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.577+0000 7fd5148a9700 1 --2- 172.21.15.26:0/4142006568 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd510133420 0x7fd5101337f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd5040098f0 tx=0x7fd504009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2364f45ee43be82 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:43.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.577+0000 7fd50f7fe700 1 -- 172.21.15.26:0/4142006568 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd504011830 con 0x7fd510133420 2023-10-01T07:57:43.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.577+0000 7fd50f7fe700 1 -- 172.21.15.26:0/4142006568 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd504011990 con 0x7fd510133420 2023-10-01T07:57:43.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.577+0000 7fd50f7fe700 1 -- 172.21.15.26:0/4142006568 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd504011d20 con 0x7fd510133420 2023-10-01T07:57:43.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.578+0000 7fd516b0d700 1 -- 172.21.15.26:0/4142006568 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd510133420 msgr2=0x7fd5101337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:43.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.578+0000 7fd516b0d700 1 --2- 172.21.15.26:0/4142006568 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd510133420 0x7fd5101337f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd5040098f0 tx=0x7fd504009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:43.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.578+0000 7fd516b0d700 1 -- 172.21.15.26:0/4142006568 shutdown_connections 2023-10-01T07:57:43.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.578+0000 7fd516b0d700 1 --2- 172.21.15.26:0/4142006568 >> v2:172.21.15.26:3300/0 conn(0x7fd510134260 0x7fd5101304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:43.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.578+0000 7fd516b0d700 1 --2- 172.21.15.26:0/4142006568 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd510133420 0x7fd5101337f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:43.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.578+0000 7fd516b0d700 1 --2- 172.21.15.26:0/4142006568 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd510133e30 0x7fd51012ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:43.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.578+0000 7fd516b0d700 1 -- 172.21.15.26:0/4142006568 >> 172.21.15.26:0/4142006568 conn(0x7fd5100a4210 msgr2=0x7fd5100a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:43.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.578+0000 7fd516b0d700 1 -- 172.21.15.26:0/4142006568 shutdown_connections 2023-10-01T07:57:43.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.578+0000 7fd516b0d700 1 -- 172.21.15.26:0/4142006568 wait complete. 2023-10-01T07:57:43.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.579+0000 7fd516b0d700 1 Processor -- start 2023-10-01T07:57:43.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.579+0000 7fd516b0d700 1 -- start start 2023-10-01T07:57:43.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.580+0000 7fd516b0d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd510133420 0x7fd51009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:43.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.580+0000 7fd516b0d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd510133e30 0x7fd51009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:43.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.580+0000 7fd516b0d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd510134260 0x7fd51009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:43.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.580+0000 7fd516b0d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51011fd30 con 0x7fd510133e30 2023-10-01T07:57:43.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.580+0000 7fd516b0d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51011ff80 con 0x7fd510133420 2023-10-01T07:57:43.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.580+0000 7fd516b0d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd51009deb0 con 0x7fd510134260 2023-10-01T07:57:43.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.580+0000 7fd5148a9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd510133420 0x7fd51009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:43.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.580+0000 7fd5148a9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd510133420 0x7fd51009c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:49198/0 (socket says 172.21.15.26:49198) 2023-10-01T07:57:43.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.580+0000 7fd5148a9700 1 -- 172.21.15.26:0/28999558 learned_addr learned my addr 172.21.15.26:0/28999558 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:43.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.580+0000 7fd5150aa700 1 --2- 172.21.15.26:0/28999558 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd510134260 0x7fd51009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:43.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.580+0000 7fd50ffff700 1 --2- 172.21.15.26:0/28999558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd510133e30 0x7fd51009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:43.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.580+0000 7fd5150aa700 1 -- 172.21.15.26:0/28999558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd510133420 msgr2=0x7fd51009c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:43.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.580+0000 7fd5150aa700 1 --2- 172.21.15.26:0/28999558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd510133420 0x7fd51009c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:43.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.580+0000 7fd5150aa700 1 -- 172.21.15.26:0/28999558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd510133e30 msgr2=0x7fd51009c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:43.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.580+0000 7fd5150aa700 1 --2- 172.21.15.26:0/28999558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd510133e30 0x7fd51009c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:43.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.581+0000 7fd5150aa700 1 -- 172.21.15.26:0/28999558 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd504009550 con 0x7fd510134260 2023-10-01T07:57:43.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.581+0000 7fd50ffff700 1 --2- 172.21.15.26:0/28999558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd510133e30 0x7fd51009c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:43.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.581+0000 7fd5150aa700 1 --2- 172.21.15.26:0/28999558 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd510134260 0x7fd51009cf00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd508009d90 tx=0x7fd50800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:43.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.581+0000 7fd50d7fa700 1 -- 172.21.15.26:0/28999558 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd508009c00 con 0x7fd510134260 2023-10-01T07:57:43.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.581+0000 7fd50d7fa700 1 -- 172.21.15.26:0/28999558 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50800f040 con 0x7fd510134260 2023-10-01T07:57:43.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.581+0000 7fd516b0d700 1 -- 172.21.15.26:0/28999558 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd51012d690 con 0x7fd510134260 2023-10-01T07:57:43.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.581+0000 7fd50d7fa700 1 -- 172.21.15.26:0/28999558 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd508014480 con 0x7fd510134260 2023-10-01T07:57:43.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.581+0000 7fd516b0d700 1 -- 172.21.15.26:0/28999558 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd51009e360 con 0x7fd510134260 2023-10-01T07:57:43.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.582+0000 7fd516b0d700 1 -- 172.21.15.26:0/28999558 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd510074ea0 con 0x7fd510134260 2023-10-01T07:57:43.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.582+0000 7fd50d7fa700 1 -- 172.21.15.26:0/28999558 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd5080145e0 con 0x7fd510134260 2023-10-01T07:57:43.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.582+0000 7fd50d7fa700 1 -- 172.21.15.26:0/28999558 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd5080401d0 con 0x7fd510134260 2023-10-01T07:57:43.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.583+0000 7fada7c0b700 1 Processor -- start 2023-10-01T07:57:43.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.583+0000 7fada7c0b700 1 -- start start 2023-10-01T07:57:43.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.583+0000 7fada7c0b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fada00a0a30 0x7fada00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:43.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.583+0000 7fada7c0b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fada0134170 0x7fada013bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:43.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.583+0000 7fada7c0b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fada009edd0 con 0x7fada00a1340 2023-10-01T07:57:43.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.584+0000 7fada7c0b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fada009e1f0 con 0x7fada00a0a30 2023-10-01T07:57:43.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.584+0000 7fada7c0b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fada009dc50 con 0x7fada0134170 2023-10-01T07:57:43.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.584+0000 7fada59a7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fada00a0a30 0x7fada00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:43.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.584+0000 7fada61a8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fada0134170 0x7fada013bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:43.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.584+0000 7fada59a7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fada00a0a30 0x7fada00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34242/0 (socket says 172.21.15.26:34242) 2023-10-01T07:57:43.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.584+0000 7fada59a7700 1 -- 172.21.15.26:0/4026632266 learned_addr learned my addr 172.21.15.26:0/4026632266 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:43.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.584+0000 7fada61a8700 1 -- 172.21.15.26:0/4026632266 >> v2:172.21.15.26:3300/0 conn(0x7fada00a0a30 msgr2=0x7fada00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:43.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.584+0000 7fada61a8700 1 --2- 172.21.15.26:0/4026632266 >> v2:172.21.15.26:3300/0 conn(0x7fada00a0a30 0x7fada00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:43.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.584+0000 7fada61a8700 1 -- 172.21.15.26:0/4026632266 >> v1:172.21.15.26:6789/0 conn(0x7fada00a1340 legacy=0x7fada0133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:43.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.584+0000 7fada61a8700 1 -- 172.21.15.26:0/4026632266 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada00a1fe0 con 0x7fada0134170 2023-10-01T07:57:43.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.584+0000 7fada59a7700 1 --2- 172.21.15.26:0/4026632266 >> v2:172.21.15.26:3300/0 conn(0x7fada00a0a30 0x7fada00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:43.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.584+0000 7fada61a8700 1 --2- 172.21.15.26:0/4026632266 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fada0134170 0x7fada013bd30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fad98009d90 tx=0x7fad9800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c6815c1393a164a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:43.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.592+0000 7fada49a5700 1 -- 172.21.15.26:0/4026632266 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9800e070 con 0x7fada0134170 2023-10-01T07:57:43.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.592+0000 7fada49a5700 1 -- 172.21.15.26:0/4026632266 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9800bb20 con 0x7fada0134170 2023-10-01T07:57:43.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.592+0000 7fada49a5700 1 -- 172.21.15.26:0/4026632266 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad98012430 con 0x7fada0134170 2023-10-01T07:57:43.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.592+0000 7fd50d7fa700 1 -- 172.21.15.26:0/28999558 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd508007900 con 0x7fd510134260 2023-10-01T07:57:43.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.592+0000 7fada7c0b700 1 -- 172.21.15.26:0/4026632266 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fada0134170 msgr2=0x7fada013bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:43.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.592+0000 7fada7c0b700 1 --2- 172.21.15.26:0/4026632266 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fada0134170 0x7fada013bd30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fad98009d90 tx=0x7fad9800b330 comp rx=0 tx=0).stop 2023-10-01T07:57:43.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.592+0000 7fada7c0b700 1 -- 172.21.15.26:0/4026632266 shutdown_connections 2023-10-01T07:57:43.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.592+0000 7fada7c0b700 1 --2- 172.21.15.26:0/4026632266 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fada0134170 0x7fada013bd30 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:43.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.592+0000 7fada7c0b700 1 --2- 172.21.15.26:0/4026632266 >> v2:172.21.15.26:3300/0 conn(0x7fada00a0a30 0x7fada00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:43.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.592+0000 7fada7c0b700 1 -- 172.21.15.26:0/4026632266 >> 172.21.15.26:0/4026632266 conn(0x7fada00a6550 msgr2=0x7fada00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:43.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.593+0000 7fada7c0b700 1 -- 172.21.15.26:0/4026632266 shutdown_connections 2023-10-01T07:57:43.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.593+0000 7fada7c0b700 1 -- 172.21.15.26:0/4026632266 wait complete. 2023-10-01T07:57:43.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.594+0000 7fada7c0b700 1 Processor -- start 2023-10-01T07:57:43.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.594+0000 7fada7c0b700 1 -- start start 2023-10-01T07:57:43.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.595+0000 7fada7c0b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fada00a0a30 0x7fada011e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:43.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.595+0000 7fada7c0b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fada00a1340 0x7fada011ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:43.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.595+0000 7fada7c0b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fada0134170 0x7fada011f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:43.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.595+0000 7fada7c0b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada0120220 con 0x7fada00a0a30 2023-10-01T07:57:43.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.595+0000 7fada7c0b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fada01335a0 con 0x7fada0134170 2023-10-01T07:57:43.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.595+0000 7fada7c0b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fada0122130 con 0x7fada00a1340 2023-10-01T07:57:43.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.595+0000 7fada59a7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fada00a0a30 0x7fada011e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:43.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.595+0000 7fada51a6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fada00a1340 0x7fada011ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:43.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.595+0000 7fada59a7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fada00a0a30 0x7fada011e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34256/0 (socket says 172.21.15.26:34256) 2023-10-01T07:57:43.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.595+0000 7fada59a7700 1 -- 172.21.15.26:0/3006881264 learned_addr learned my addr 172.21.15.26:0/3006881264 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:43.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.595+0000 7fada61a8700 1 --2- 172.21.15.26:0/3006881264 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fada0134170 0x7fada011f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:43.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.595+0000 7fada51a6700 1 -- 172.21.15.26:0/3006881264 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fada0134170 msgr2=0x7fada011f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:43.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.595+0000 7fada51a6700 1 --2- 172.21.15.26:0/3006881264 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fada0134170 0x7fada011f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:43.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.595+0000 7fada51a6700 1 -- 172.21.15.26:0/3006881264 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fada00a0a30 msgr2=0x7fada011e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:43.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.595+0000 7fada51a6700 1 --2- 172.21.15.26:0/3006881264 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fada00a0a30 0x7fada011e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:43.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.595+0000 7fada51a6700 1 -- 172.21.15.26:0/3006881264 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9c009550 con 0x7fada00a1340 2023-10-01T07:57:43.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.595+0000 7fada59a7700 1 --2- 172.21.15.26:0/3006881264 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fada00a0a30 0x7fada011e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:43.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.596+0000 7fada51a6700 1 --2- 172.21.15.26:0/3006881264 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fada00a1340 0x7fada011ebe0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fad9000c450 tx=0x7fad9000c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:43.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.596+0000 7fad967fc700 1 -- 172.21.15.26:0/3006881264 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad900052d0 con 0x7fada00a1340 2023-10-01T07:57:43.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.596+0000 7fad967fc700 1 -- 172.21.15.26:0/3006881264 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad90005430 con 0x7fada00a1340 2023-10-01T07:57:43.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.596+0000 7fad967fc700 1 -- 172.21.15.26:0/3006881264 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad900038c0 con 0x7fada00a1340 2023-10-01T07:57:43.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.596+0000 7fada7c0b700 1 -- 172.21.15.26:0/3006881264 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad98009a70 con 0x7fada00a1340 2023-10-01T07:57:43.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.596+0000 7fada7c0b700 1 -- 172.21.15.26:0/3006881264 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada00a25e0 con 0x7fada00a1340 2023-10-01T07:57:43.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.597+0000 7fad967fc700 1 -- 172.21.15.26:0/3006881264 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fad90003a20 con 0x7fada00a1340 2023-10-01T07:57:43.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.597+0000 7fada7c0b700 1 -- 172.21.15.26:0/3006881264 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada0074ea0 con 0x7fada00a1340 2023-10-01T07:57:43.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.597+0000 7fad967fc700 1 -- 172.21.15.26:0/3006881264 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fad9003e9b0 con 0x7fada00a1340 2023-10-01T07:57:43.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.602+0000 7fad967fc700 1 -- 172.21.15.26:0/3006881264 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fad90011590 con 0x7fada00a1340 2023-10-01T07:57:43.641 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:43.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.771+0000 7f004b67e700 1 -- 172.21.15.26:0/1960768489 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0044074ea0 con 0x7f004409e000 2023-10-01T07:57:43.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.771+0000 7f0039ffb700 1 -- 172.21.15.26:0/1960768489 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0034015030 con 0x7f004409e000 2023-10-01T07:57:43.772 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:43.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.774+0000 7f004b67e700 1 -- 172.21.15.26:0/1960768489 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f004409e000 msgr2=0x7f00441a6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:43.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.774+0000 7f004b67e700 1 --2- 172.21.15.26:0/1960768489 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f004409e000 0x7f00441a6510 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f004409e9b0 tx=0x7f0034004750 comp rx=0 tx=0).stop 2023-10-01T07:57:43.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.774+0000 7f004b67e700 1 -- 172.21.15.26:0/1960768489 shutdown_connections 2023-10-01T07:57:43.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.774+0000 7f004b67e700 1 --2- 172.21.15.26:0/1960768489 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f004409e410 0x7f00441a6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:43.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.774+0000 7f004b67e700 1 --2- 172.21.15.26:0/1960768489 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f004409d6f0 0x7f00441a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:43.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.774+0000 7f004b67e700 1 --2- 172.21.15.26:0/1960768489 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f004409e000 0x7f00441a6510 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:43.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.774+0000 7f004b67e700 1 -- 172.21.15.26:0/1960768489 >> 172.21.15.26:0/1960768489 conn(0x7f0044066f50 msgr2=0x7f00441baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:43.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.774+0000 7f004b67e700 1 -- 172.21.15.26:0/1960768489 shutdown_connections 2023-10-01T07:57:43.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.774+0000 7f004b67e700 1 -- 172.21.15.26:0/1960768489 wait complete. 2023-10-01T07:57:43.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.779+0000 7fbb478be700 1 Processor -- start 2023-10-01T07:57:43.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.779+0000 7fbb478be700 1 -- start start 2023-10-01T07:57:43.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.780+0000 7fbb478be700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbb4009f410 0x7fbb40136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:43.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.780+0000 7fbb478be700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbb40136fe0 0x7fbb401393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:43.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.780+0000 7fbb478be700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb40070940 con 0x7fbb4009e930 2023-10-01T07:57:43.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.780+0000 7fbb478be700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb4006fd60 con 0x7fbb40136fe0 2023-10-01T07:57:43.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.780+0000 7fbb478be700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4006fa80 con 0x7fbb4009f410 2023-10-01T07:57:43.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.781+0000 7fbb44e59700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbb4009f410 0x7fbb40136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:43.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.781+0000 7fbb44e59700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbb4009f410 0x7fbb40136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47012/0 (socket says 172.21.15.26:47012) 2023-10-01T07:57:43.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.781+0000 7fbb44e59700 1 -- 172.21.15.26:0/473613238 learned_addr learned my addr 172.21.15.26:0/473613238 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:43.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.781+0000 7fbb45e5b700 1 --2- 172.21.15.26:0/473613238 >> v2:172.21.15.26:3300/0 conn(0x7fbb40136fe0 0x7fbb401393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:43.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.781+0000 7fbb37fff700 1 -- 172.21.15.26:0/473613238 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3094305639 0 0) 0x7fbb40070940 con 0x7fbb4009e930 2023-10-01T07:57:43.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.781+0000 7fbb44e59700 1 -- 172.21.15.26:0/473613238 >> v2:172.21.15.26:3300/0 conn(0x7fbb40136fe0 msgr2=0x7fbb401393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:43.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.781+0000 7fbb44e59700 1 --2- 172.21.15.26:0/473613238 >> v2:172.21.15.26:3300/0 conn(0x7fbb40136fe0 0x7fbb401393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:43.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.781+0000 7fbb44e59700 1 -- 172.21.15.26:0/473613238 >> v1:172.21.15.26:6789/0 conn(0x7fbb4009e930 legacy=0x7fbb4009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:43.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.781+0000 7fbb44e59700 1 -- 172.21.15.26:0/473613238 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb4009fb60 con 0x7fbb4009f410 2023-10-01T07:57:43.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.781+0000 7fbb44e59700 1 --2- 172.21.15.26:0/473613238 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbb4009f410 0x7fbb40136aa0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbb300098f0 tx=0x7fbb30009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=121c7de0d0a6da45 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:43.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.781+0000 7fbb37fff700 1 -- 172.21.15.26:0/473613238 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3000b8a0 con 0x7fbb4009f410 2023-10-01T07:57:43.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.782+0000 7fbb37fff700 1 -- 172.21.15.26:0/473613238 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3000ba00 con 0x7fbb4009f410 2023-10-01T07:57:43.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.782+0000 7fbb37fff700 1 -- 172.21.15.26:0/473613238 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3000bd90 con 0x7fbb4009f410 2023-10-01T07:57:43.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.783+0000 7fbb478be700 1 -- 172.21.15.26:0/473613238 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbb4009f410 msgr2=0x7fbb40136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:43.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.783+0000 7fbb478be700 1 --2- 172.21.15.26:0/473613238 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbb4009f410 0x7fbb40136aa0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbb300098f0 tx=0x7fbb30009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:43.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.783+0000 7fbb478be700 1 -- 172.21.15.26:0/473613238 shutdown_connections 2023-10-01T07:57:43.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.783+0000 7fbb478be700 1 --2- 172.21.15.26:0/473613238 >> v2:172.21.15.26:3300/0 conn(0x7fbb40136fe0 0x7fbb401393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:43.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.783+0000 7fbb478be700 1 --2- 172.21.15.26:0/473613238 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbb4009f410 0x7fbb40136aa0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:43.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.783+0000 7fbb478be700 1 -- 172.21.15.26:0/473613238 >> 172.21.15.26:0/473613238 conn(0x7fbb400a4210 msgr2=0x7fbb400a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:43.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.783+0000 7fbb478be700 1 -- 172.21.15.26:0/473613238 shutdown_connections 2023-10-01T07:57:43.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.783+0000 7fbb478be700 1 -- 172.21.15.26:0/473613238 wait complete. 2023-10-01T07:57:43.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.784+0000 7fbb478be700 1 Processor -- start 2023-10-01T07:57:43.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.784+0000 7fbb478be700 1 -- start start 2023-10-01T07:57:43.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.785+0000 7fbb478be700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbb4009e930 0x7fbb4006c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:43.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.785+0000 7fbb478be700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb4009f410 0x7fbb4006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:43.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.785+0000 7fbb478be700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbb40136fe0 0x7fbb401c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:43.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.785+0000 7fbb478be700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb40121bb0 con 0x7fbb4009f410 2023-10-01T07:57:43.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.785+0000 7fbb478be700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb40122200 con 0x7fbb40136fe0 2023-10-01T07:57:43.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.785+0000 7fbb478be700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb40132260 con 0x7fbb4009e930 2023-10-01T07:57:43.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.785+0000 7fbb44e59700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb4009f410 0x7fbb4006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:43.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.785+0000 7fbb44e59700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb4009f410 0x7fbb4006c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34278/0 (socket says 172.21.15.26:34278) 2023-10-01T07:57:43.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.785+0000 7fbb44e59700 1 -- 172.21.15.26:0/3257295355 learned_addr learned my addr 172.21.15.26:0/3257295355 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:43.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.786+0000 7fbb4565a700 1 --2- 172.21.15.26:0/3257295355 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbb4009e930 0x7fbb4006c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:43.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.786+0000 7fbb45e5b700 1 --2- 172.21.15.26:0/3257295355 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbb40136fe0 0x7fbb401c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:43.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.786+0000 7fbb44e59700 1 -- 172.21.15.26:0/3257295355 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbb4009e930 msgr2=0x7fbb4006c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:43.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.786+0000 7fbb44e59700 1 --2- 172.21.15.26:0/3257295355 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbb4009e930 0x7fbb4006c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:43.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.786+0000 7fbb44e59700 1 -- 172.21.15.26:0/3257295355 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbb40136fe0 msgr2=0x7fbb401c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:43.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.786+0000 7fbb44e59700 1 --2- 172.21.15.26:0/3257295355 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbb40136fe0 0x7fbb401c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:43.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.786+0000 7fbb44e59700 1 -- 172.21.15.26:0/3257295355 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb30009550 con 0x7fbb4009f410 2023-10-01T07:57:43.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.786+0000 7fbb44e59700 1 --2- 172.21.15.26:0/3257295355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb4009f410 0x7fbb4006c8f0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fbb4006fbc0 tx=0x7fbb30004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:43.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.786+0000 7fbb35ffb700 1 -- 172.21.15.26:0/3257295355 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb30004240 con 0x7fbb4009f410 2023-10-01T07:57:43.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.786+0000 7fbb35ffb700 1 -- 172.21.15.26:0/3257295355 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3001f070 con 0x7fbb4009f410 2023-10-01T07:57:43.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.787+0000 7fbb478be700 1 -- 172.21.15.26:0/3257295355 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb40122400 con 0x7fbb4009f410 2023-10-01T07:57:43.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.787+0000 7fbb35ffb700 1 -- 172.21.15.26:0/3257295355 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb300045a0 con 0x7fbb4009f410 2023-10-01T07:57:43.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.787+0000 7fbb478be700 1 -- 172.21.15.26:0/3257295355 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb4006d4c0 con 0x7fbb4009f410 2023-10-01T07:57:43.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.788+0000 7fbb478be700 1 -- 172.21.15.26:0/3257295355 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb4009dee0 con 0x7fbb4009f410 2023-10-01T07:57:43.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.788+0000 7fbb35ffb700 1 -- 172.21.15.26:0/3257295355 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbb30021030 con 0x7fbb4009f410 2023-10-01T07:57:43.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.789+0000 7fbb35ffb700 1 -- 172.21.15.26:0/3257295355 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbb300409d0 con 0x7fbb4009f410 2023-10-01T07:57:43.792 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:43.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.793+0000 7fbb35ffb700 1 -- 172.21.15.26:0/3257295355 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbb30003e00 con 0x7fbb4009f410 2023-10-01T07:57:43.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.806+0000 7fd516b0d700 1 -- 172.21.15.26:0/28999558 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd5101200c0 con 0x7fd510134260 2023-10-01T07:57:43.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.807+0000 7fd50d7fa700 1 -- 172.21.15.26:0/28999558 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd508018020 con 0x7fd510134260 2023-10-01T07:57:43.807 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:43.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.809+0000 7fd516b0d700 1 -- 172.21.15.26:0/28999558 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd510134260 msgr2=0x7fd51009cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:43.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.809+0000 7fd516b0d700 1 --2- 172.21.15.26:0/28999558 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd510134260 0x7fd51009cf00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd508009d90 tx=0x7fd50800c3a0 comp rx=0 tx=0).stop 2023-10-01T07:57:43.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.809+0000 7fd516b0d700 1 -- 172.21.15.26:0/28999558 shutdown_connections 2023-10-01T07:57:43.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.809+0000 7fd516b0d700 1 --2- 172.21.15.26:0/28999558 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd510134260 0x7fd51009cf00 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:43.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.809+0000 7fd516b0d700 1 --2- 172.21.15.26:0/28999558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd510133420 0x7fd51009c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:43.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.809+0000 7fd516b0d700 1 --2- 172.21.15.26:0/28999558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd510133e30 0x7fd51009c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:43.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.809+0000 7fd516b0d700 1 -- 172.21.15.26:0/28999558 >> 172.21.15.26:0/28999558 conn(0x7fd5100a4210 msgr2=0x7fd5100a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:43.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.809+0000 7fd516b0d700 1 -- 172.21.15.26:0/28999558 shutdown_connections 2023-10-01T07:57:43.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.809+0000 7fd516b0d700 1 -- 172.21.15.26:0/28999558 wait complete. 2023-10-01T07:57:43.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:43.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.833+0000 7fada7c0b700 1 -- 172.21.15.26:0/3006881264 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fada00a28e0 con 0x7fada00a1340 2023-10-01T07:57:43.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.834+0000 7fad967fc700 1 -- 172.21.15.26:0/3006881264 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fad90017030 con 0x7fada00a1340 2023-10-01T07:57:43.834 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:43.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.836+0000 7fada7c0b700 1 -- 172.21.15.26:0/3006881264 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fada00a1340 msgr2=0x7fada011ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:43.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.836+0000 7fada7c0b700 1 --2- 172.21.15.26:0/3006881264 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fada00a1340 0x7fada011ebe0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fad9000c450 tx=0x7fad9000c760 comp rx=0 tx=0).stop 2023-10-01T07:57:43.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.836+0000 7fada7c0b700 1 -- 172.21.15.26:0/3006881264 shutdown_connections 2023-10-01T07:57:43.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.836+0000 7fada7c0b700 1 --2- 172.21.15.26:0/3006881264 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fada0134170 0x7fada011f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:43.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.836+0000 7fada7c0b700 1 --2- 172.21.15.26:0/3006881264 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fada00a0a30 0x7fada011e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:43.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.836+0000 7fada7c0b700 1 --2- 172.21.15.26:0/3006881264 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fada00a1340 0x7fada011ebe0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:43.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.836+0000 7fada7c0b700 1 -- 172.21.15.26:0/3006881264 >> 172.21.15.26:0/3006881264 conn(0x7fada00a6550 msgr2=0x7fada009ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:43.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.836+0000 7fada7c0b700 1 -- 172.21.15.26:0/3006881264 shutdown_connections 2023-10-01T07:57:43.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:43.836+0000 7fada7c0b700 1 -- 172.21.15.26:0/3006881264 wait complete. 2023-10-01T07:57:43.850 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:44.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.011+0000 7fbb478be700 1 -- 172.21.15.26:0/3257295355 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbb40071d20 con 0x7fbb4009f410 2023-10-01T07:57:44.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.013+0000 7fbb35ffb700 1 -- 172.21.15.26:0/3257295355 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbb30015030 con 0x7fbb4009f410 2023-10-01T07:57:44.014 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:44.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.016+0000 7fbb478be700 1 -- 172.21.15.26:0/3257295355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb4009f410 msgr2=0x7fbb4006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:44.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.016+0000 7fbb478be700 1 --2- 172.21.15.26:0/3257295355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb4009f410 0x7fbb4006c8f0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fbb4006fbc0 tx=0x7fbb30004750 comp rx=0 tx=0).stop 2023-10-01T07:57:44.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.016+0000 7fbb478be700 1 -- 172.21.15.26:0/3257295355 shutdown_connections 2023-10-01T07:57:44.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.016+0000 7fbb478be700 1 --2- 172.21.15.26:0/3257295355 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbb40136fe0 0x7fbb401c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:44.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.016+0000 7fbb478be700 1 --2- 172.21.15.26:0/3257295355 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbb4009e930 0x7fbb4006c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:44.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.016+0000 7fbb478be700 1 --2- 172.21.15.26:0/3257295355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb4009f410 0x7fbb4006c8f0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:44.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.016+0000 7fbb478be700 1 -- 172.21.15.26:0/3257295355 >> 172.21.15.26:0/3257295355 conn(0x7fbb400a4210 msgr2=0x7fbb40134990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:44.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.016+0000 7fbb478be700 1 -- 172.21.15.26:0/3257295355 shutdown_connections 2023-10-01T07:57:44.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.016+0000 7fbb478be700 1 -- 172.21.15.26:0/3257295355 wait complete. 2023-10-01T07:57:44.030 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:44.793 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:44.824 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:44.851 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:44.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.948+0000 7f191b301700 1 Processor -- start 2023-10-01T07:57:44.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.948+0000 7f191b301700 1 -- start start 2023-10-01T07:57:44.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.948+0000 7f191b301700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1914136820 0x7f1914138c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:44.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.948+0000 7f191b301700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1914139140 0x7f191413b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:44.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.949+0000 7f191b301700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f191406bc00 con 0x7f1914133a80 2023-10-01T07:57:44.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.949+0000 7f191b301700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f191406c570 con 0x7f1914136820 2023-10-01T07:57:44.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.949+0000 7f191b301700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19140a0040 con 0x7f1914139140 2023-10-01T07:57:44.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.949+0000 7f191889c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1914136820 0x7f1914138c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:44.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.949+0000 7f191889c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1914136820 0x7f1914138c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:49230/0 (socket says 172.21.15.26:49230) 2023-10-01T07:57:44.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.949+0000 7f191889c700 1 -- 172.21.15.26:0/4181501099 learned_addr learned my addr 172.21.15.26:0/4181501099 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:44.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.949+0000 7f191989e700 1 --2- 172.21.15.26:0/4181501099 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1914139140 0x7f191413b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:44.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.949+0000 7f191889c700 1 -- 172.21.15.26:0/4181501099 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1914139140 msgr2=0x7f191413b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:44.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.949+0000 7f191889c700 1 --2- 172.21.15.26:0/4181501099 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1914139140 0x7f191413b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:44.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.949+0000 7f191889c700 1 -- 172.21.15.26:0/4181501099 >> v1:172.21.15.26:6789/0 conn(0x7f1914133a80 legacy=0x7f1914133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:44.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.949+0000 7f191889c700 1 -- 172.21.15.26:0/4181501099 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1914133860 con 0x7f1914136820 2023-10-01T07:57:44.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.949+0000 7f191989e700 1 --2- 172.21.15.26:0/4181501099 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1914139140 0x7f191413b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:44.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.949+0000 7f191889c700 1 --2- 172.21.15.26:0/4181501099 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1914136820 0x7f1914138c00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1904009920 tx=0x7f1904009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=441d3808a41fd86c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:44.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.950+0000 7f190bfff700 1 -- 172.21.15.26:0/4181501099 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1904011830 con 0x7f1914136820 2023-10-01T07:57:44.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.950+0000 7f190bfff700 1 -- 172.21.15.26:0/4181501099 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1904011990 con 0x7f1914136820 2023-10-01T07:57:44.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.950+0000 7f190bfff700 1 -- 172.21.15.26:0/4181501099 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1904011d20 con 0x7f1914136820 2023-10-01T07:57:44.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.950+0000 7f191b301700 1 -- 172.21.15.26:0/4181501099 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1914136820 msgr2=0x7f1914138c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:44.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.950+0000 7f191b301700 1 --2- 172.21.15.26:0/4181501099 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1914136820 0x7f1914138c00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1904009920 tx=0x7f1904009c30 comp rx=0 tx=0).stop 2023-10-01T07:57:44.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.950+0000 7f191b301700 1 -- 172.21.15.26:0/4181501099 shutdown_connections 2023-10-01T07:57:44.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.950+0000 7f191b301700 1 --2- 172.21.15.26:0/4181501099 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1914139140 0x7f191413b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:44.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.950+0000 7f191b301700 1 --2- 172.21.15.26:0/4181501099 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1914136820 0x7f1914138c00 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:44.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.950+0000 7f191b301700 1 -- 172.21.15.26:0/4181501099 >> 172.21.15.26:0/4181501099 conn(0x7f19140a4210 msgr2=0x7f19140a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:44.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.951+0000 7f191b301700 1 -- 172.21.15.26:0/4181501099 shutdown_connections 2023-10-01T07:57:44.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.951+0000 7f191b301700 1 -- 172.21.15.26:0/4181501099 wait complete. 2023-10-01T07:57:44.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.952+0000 7f191b301700 1 Processor -- start 2023-10-01T07:57:44.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.952+0000 7f191b301700 1 -- start start 2023-10-01T07:57:44.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.953+0000 7f191b301700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1914133a80 0x7f19141c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:44.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.953+0000 7f191b301700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1914136820 0x7f19141c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:44.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.953+0000 7f191b301700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1914139140 0x7f19141c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:44.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.953+0000 7f191b301700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1914138df0 con 0x7f1914136820 2023-10-01T07:57:44.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.953+0000 7f191b301700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f191412db80 con 0x7f1914139140 2023-10-01T07:57:44.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.953+0000 7f191b301700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1914072530 con 0x7f1914133a80 2023-10-01T07:57:44.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.953+0000 7f191909d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1914133a80 0x7f19141c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:44.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.953+0000 7f191889c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1914136820 0x7f19141c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:44.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.953+0000 7f191889c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1914136820 0x7f19141c88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34280/0 (socket says 172.21.15.26:34280) 2023-10-01T07:57:44.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.953+0000 7f191909d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1914133a80 0x7f19141c83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47038/0 (socket says 172.21.15.26:47038) 2023-10-01T07:57:44.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.953+0000 7f191889c700 1 -- 172.21.15.26:0/3988139107 learned_addr learned my addr 172.21.15.26:0/3988139107 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:44.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.953+0000 7f191989e700 1 --2- 172.21.15.26:0/3988139107 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1914139140 0x7f19141c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:44.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.953+0000 7f191989e700 1 -- 172.21.15.26:0/3988139107 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1914133a80 msgr2=0x7f19141c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:44.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.953+0000 7f191989e700 1 --2- 172.21.15.26:0/3988139107 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1914133a80 0x7f19141c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:44.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.953+0000 7f191989e700 1 -- 172.21.15.26:0/3988139107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1914136820 msgr2=0x7f19141c88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:44.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.953+0000 7f191989e700 1 --2- 172.21.15.26:0/3988139107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1914136820 0x7f19141c88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:44.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.953+0000 7f191989e700 1 -- 172.21.15.26:0/3988139107 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f190c009a70 con 0x7f1914139140 2023-10-01T07:57:44.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.953+0000 7f191889c700 1 --2- 172.21.15.26:0/3988139107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1914136820 0x7f19141c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:44.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.954+0000 7f191989e700 1 --2- 172.21.15.26:0/3988139107 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1914139140 0x7f19141c8e20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f190c00ef90 tx=0x7f190c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:44.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.954+0000 7f1909ffb700 1 -- 172.21.15.26:0/3988139107 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190c00ca90 con 0x7f1914139140 2023-10-01T07:57:44.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.954+0000 7f1909ffb700 1 -- 172.21.15.26:0/3988139107 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190c00f040 con 0x7f1914139140 2023-10-01T07:57:44.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.954+0000 7f191b301700 1 -- 172.21.15.26:0/3988139107 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1904009550 con 0x7f1914139140 2023-10-01T07:57:44.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.954+0000 7f1909ffb700 1 -- 172.21.15.26:0/3988139107 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190c00ce30 con 0x7f1914139140 2023-10-01T07:57:44.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.954+0000 7f191b301700 1 -- 172.21.15.26:0/3988139107 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1914071fd0 con 0x7f1914139140 2023-10-01T07:57:44.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.955+0000 7f1909ffb700 1 -- 172.21.15.26:0/3988139107 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f190c014480 con 0x7f1914139140 2023-10-01T07:57:44.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.955+0000 7f1909ffb700 1 -- 172.21.15.26:0/3988139107 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f190c03fc70 con 0x7f1914139140 2023-10-01T07:57:44.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.956+0000 7f191b301700 1 -- 172.21.15.26:0/3988139107 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1914074ea0 con 0x7f1914139140 2023-10-01T07:57:44.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.961+0000 7f1909ffb700 1 -- 172.21.15.26:0/3988139107 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f190c012930 con 0x7f1914139140 2023-10-01T07:57:44.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.989+0000 7f274c0c4700 1 Processor -- start 2023-10-01T07:57:44.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.989+0000 7f274c0c4700 1 -- start start 2023-10-01T07:57:44.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.989+0000 7f274c0c4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f274406a770 0x7f274409d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:44.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.989+0000 7f274c0c4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f274409dc30 0x7f274409e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:44.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.990+0000 7f274c0c4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f274413c1e0 0x7f274413e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:44.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.990+0000 7f274c0c4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f274406ab40 con 0x7f274409dc30 2023-10-01T07:57:44.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.990+0000 7f274c0c4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274409ebc0 con 0x7f274413c1e0 2023-10-01T07:57:44.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.990+0000 7f274c0c4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f274409a810 con 0x7f274406a770 2023-10-01T07:57:44.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.990+0000 7f274965f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f274409dc30 0x7f274409e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:44.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.990+0000 7f274965f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f274409dc30 0x7f274409e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34288/0 (socket says 172.21.15.26:34288) 2023-10-01T07:57:44.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.990+0000 7f274965f700 1 -- 172.21.15.26:0/858575248 learned_addr learned my addr 172.21.15.26:0/858575248 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:44.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.990+0000 7f2749e60700 1 --2- 172.21.15.26:0/858575248 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f274406a770 0x7f274409d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:44.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.990+0000 7f274a661700 1 --2- 172.21.15.26:0/858575248 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f274413c1e0 0x7f274413e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:44.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.990+0000 7f2749e60700 1 -- 172.21.15.26:0/858575248 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f274413c1e0 msgr2=0x7f274413e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:44.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.990+0000 7f2749e60700 1 --2- 172.21.15.26:0/858575248 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f274413c1e0 0x7f274413e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:44.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.990+0000 7f2749e60700 1 -- 172.21.15.26:0/858575248 >> v2:172.21.15.26:3300/0 conn(0x7f274409dc30 msgr2=0x7f274409e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:44.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.990+0000 7f2749e60700 1 --2- 172.21.15.26:0/858575248 >> v2:172.21.15.26:3300/0 conn(0x7f274409dc30 0x7f274409e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:44.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.990+0000 7f2749e60700 1 -- 172.21.15.26:0/858575248 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274409e920 con 0x7f274406a770 2023-10-01T07:57:44.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.990+0000 7f274965f700 1 --2- 172.21.15.26:0/858575248 >> v2:172.21.15.26:3300/0 conn(0x7f274409dc30 0x7f274409e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:44.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.990+0000 7f2749e60700 1 --2- 172.21.15.26:0/858575248 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f274406a770 0x7f274409d6f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2740009870 tx=0x7f2740009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf7e061bd790e9b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:44.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.991+0000 7f2748e5e700 1 -- 172.21.15.26:0/858575248 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740011830 con 0x7f274406a770 2023-10-01T07:57:44.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.991+0000 7f2748e5e700 1 -- 172.21.15.26:0/858575248 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2740011990 con 0x7f274406a770 2023-10-01T07:57:44.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.991+0000 7f2748e5e700 1 -- 172.21.15.26:0/858575248 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740011d20 con 0x7f274406a770 2023-10-01T07:57:44.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.991+0000 7f274c0c4700 1 -- 172.21.15.26:0/858575248 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f274406a770 msgr2=0x7f274409d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:44.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.991+0000 7f274c0c4700 1 --2- 172.21.15.26:0/858575248 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f274406a770 0x7f274409d6f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2740009870 tx=0x7f2740009b80 comp rx=0 tx=0).stop 2023-10-01T07:57:44.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.991+0000 7f274c0c4700 1 -- 172.21.15.26:0/858575248 shutdown_connections 2023-10-01T07:57:44.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.991+0000 7f274c0c4700 1 --2- 172.21.15.26:0/858575248 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f274413c1e0 0x7f274413e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:44.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.991+0000 7f274c0c4700 1 --2- 172.21.15.26:0/858575248 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f274406a770 0x7f274409d6f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:44.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.991+0000 7f274c0c4700 1 --2- 172.21.15.26:0/858575248 >> v2:172.21.15.26:3300/0 conn(0x7f274409dc30 0x7f274409e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:44.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.991+0000 7f274c0c4700 1 -- 172.21.15.26:0/858575248 >> 172.21.15.26:0/858575248 conn(0x7f2744066f50 msgr2=0x7f274409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:44.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.992+0000 7f274c0c4700 1 -- 172.21.15.26:0/858575248 shutdown_connections 2023-10-01T07:57:44.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.992+0000 7f274c0c4700 1 -- 172.21.15.26:0/858575248 wait complete. 2023-10-01T07:57:45.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.993+0000 7f274c0c4700 1 Processor -- start 2023-10-01T07:57:45.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.993+0000 7f274c0c4700 1 -- start start 2023-10-01T07:57:45.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.994+0000 7f274c0c4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f274406a770 0x7f27441cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:45.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.994+0000 7f274c0c4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f274409dc30 0x7f27441ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:45.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.994+0000 7f274c0c4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f274413c1e0 0x7f27441270d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:45.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.994+0000 7f274c0c4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274413bc90 con 0x7f274409dc30 2023-10-01T07:57:45.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.994+0000 7f274c0c4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2744129560 con 0x7f274413c1e0 2023-10-01T07:57:45.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.994+0000 7f274c0c4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27441c12c0 con 0x7f274406a770 2023-10-01T07:57:45.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.994+0000 7f2749e60700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f274406a770 0x7f27441cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:45.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.994+0000 7f2749e60700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f274406a770 0x7f27441cc7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47060/0 (socket says 172.21.15.26:47060) 2023-10-01T07:57:45.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.994+0000 7f2749e60700 1 -- 172.21.15.26:0/1201819310 learned_addr learned my addr 172.21.15.26:0/1201819310 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:45.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.994+0000 7f274a661700 1 --2- 172.21.15.26:0/1201819310 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f274413c1e0 0x7f27441270d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:45.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.994+0000 7f274965f700 1 --2- 172.21.15.26:0/1201819310 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f274409dc30 0x7f27441ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:45.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.994+0000 7f2749e60700 1 -- 172.21.15.26:0/1201819310 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f274413c1e0 msgr2=0x7f27441270d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:45.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.994+0000 7f2749e60700 1 --2- 172.21.15.26:0/1201819310 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f274413c1e0 0x7f27441270d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:45.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.994+0000 7f2749e60700 1 -- 172.21.15.26:0/1201819310 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f274409dc30 msgr2=0x7f27441ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:45.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.994+0000 7f2749e60700 1 --2- 172.21.15.26:0/1201819310 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f274409dc30 0x7f27441ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:45.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.994+0000 7f2749e60700 1 -- 172.21.15.26:0/1201819310 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2734009550 con 0x7f274406a770 2023-10-01T07:57:45.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.994+0000 7f274a661700 1 --2- 172.21.15.26:0/1201819310 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f274413c1e0 0x7f27441270d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:45.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.995+0000 7f2749e60700 1 --2- 172.21.15.26:0/1201819310 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f274406a770 0x7f27441cc7a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2740000c00 tx=0x7f2740004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:45.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.995+0000 7f273a7fc700 1 -- 172.21.15.26:0/1201819310 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740004450 con 0x7f274406a770 2023-10-01T07:57:45.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.995+0000 7f273a7fc700 1 -- 172.21.15.26:0/1201819310 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274001f070 con 0x7f274406a770 2023-10-01T07:57:45.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.995+0000 7f274c0c4700 1 -- 172.21.15.26:0/1201819310 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27400094a0 con 0x7f274406a770 2023-10-01T07:57:45.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.995+0000 7f273a7fc700 1 -- 172.21.15.26:0/1201819310 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27400038a0 con 0x7f274406a770 2023-10-01T07:57:45.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.995+0000 7f274c0c4700 1 -- 172.21.15.26:0/1201819310 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2744128d30 con 0x7f274406a770 2023-10-01T07:57:45.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.996+0000 7f273a7fc700 1 -- 172.21.15.26:0/1201819310 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2740003a00 con 0x7f274406a770 2023-10-01T07:57:45.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.996+0000 7f274c0c4700 1 -- 172.21.15.26:0/1201819310 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27441cd280 con 0x7f274406a770 2023-10-01T07:57:45.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:44.996+0000 7f273a7fc700 1 -- 172.21.15.26:0/1201819310 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2740021070 con 0x7f274406a770 2023-10-01T07:57:45.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.005+0000 7f273a7fc700 1 -- 172.21.15.26:0/1201819310 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f27400045b0 con 0x7f274406a770 2023-10-01T07:57:45.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.025+0000 7fe8bd2d1700 1 Processor -- start 2023-10-01T07:57:45.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.026+0000 7fe8bd2d1700 1 -- start start 2023-10-01T07:57:45.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.026+0000 7fe8bd2d1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe8b809e850 0x7fe8b809ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:45.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.026+0000 7fe8bd2d1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe8b809f580 0x7fe8b8134290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:45.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.026+0000 7fe8bd2d1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8b806bec0 con 0x7fe8b809f160 2023-10-01T07:57:45.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.026+0000 7fe8bd2d1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b806bce0 con 0x7fe8b809e850 2023-10-01T07:57:45.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.026+0000 7fe8bd2d1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b806caa0 con 0x7fe8b809f580 2023-10-01T07:57:45.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.026+0000 7fe8b6ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe8b809e850 0x7fe8b809ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:45.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.026+0000 7fe8b6ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe8b809e850 0x7fe8b809ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34312/0 (socket says 172.21.15.26:34312) 2023-10-01T07:57:45.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.026+0000 7fe8b6ffd700 1 -- 172.21.15.26:0/3038875741 learned_addr learned my addr 172.21.15.26:0/3038875741 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:45.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.026+0000 7fe8b77fe700 1 --2- 172.21.15.26:0/3038875741 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe8b809f580 0x7fe8b8134290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:45.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.027+0000 7fe8b6ffd700 1 -- 172.21.15.26:0/3038875741 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe8b809f580 msgr2=0x7fe8b8134290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:45.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.027+0000 7fe8b6ffd700 1 --2- 172.21.15.26:0/3038875741 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe8b809f580 0x7fe8b8134290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:45.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.027+0000 7fe8b6ffd700 1 -- 172.21.15.26:0/3038875741 >> v1:172.21.15.26:6789/0 conn(0x7fe8b809f160 legacy=0x7fe8b8133b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:45.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.027+0000 7fe8b6ffd700 1 -- 172.21.15.26:0/3038875741 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b80a00a0 con 0x7fe8b809e850 2023-10-01T07:57:45.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.027+0000 7fe8b77fe700 1 --2- 172.21.15.26:0/3038875741 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe8b809f580 0x7fe8b8134290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:45.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.027+0000 7fe8b6ffd700 1 --2- 172.21.15.26:0/3038875741 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8b809e850 0x7fe8b809ec20 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8009e50 tx=0x7fe8a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a205b829c6ffd server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:45.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.027+0000 7fe8b5ffb700 1 -- 172.21.15.26:0/3038875741 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a800e070 con 0x7fe8b809e850 2023-10-01T07:57:45.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.027+0000 7fe8b5ffb700 1 -- 172.21.15.26:0/3038875741 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a800b910 con 0x7fe8b809e850 2023-10-01T07:57:45.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.027+0000 7fe8b5ffb700 1 -- 172.21.15.26:0/3038875741 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a800bcc0 con 0x7fe8b809e850 2023-10-01T07:57:45.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.028+0000 7fe8bd2d1700 1 -- 172.21.15.26:0/3038875741 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8b809e850 msgr2=0x7fe8b809ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:45.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.028+0000 7fe8bd2d1700 1 --2- 172.21.15.26:0/3038875741 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8b809e850 0x7fe8b809ec20 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8009e50 tx=0x7fe8a800b330 comp rx=0 tx=0).stop 2023-10-01T07:57:45.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.028+0000 7fe8bd2d1700 1 -- 172.21.15.26:0/3038875741 shutdown_connections 2023-10-01T07:57:45.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.028+0000 7fe8bd2d1700 1 --2- 172.21.15.26:0/3038875741 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe8b809f580 0x7fe8b8134290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:45.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.028+0000 7fe8bd2d1700 1 --2- 172.21.15.26:0/3038875741 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8b809e850 0x7fe8b809ec20 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:45.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.028+0000 7fe8bd2d1700 1 -- 172.21.15.26:0/3038875741 >> 172.21.15.26:0/3038875741 conn(0x7fe8b80a3f70 msgr2=0x7fe8b80a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:45.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.028+0000 7fe8bd2d1700 1 -- 172.21.15.26:0/3038875741 shutdown_connections 2023-10-01T07:57:45.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.028+0000 7fe8bd2d1700 1 -- 172.21.15.26:0/3038875741 wait complete. 2023-10-01T07:57:45.031 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:45.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.029+0000 7fe8bd2d1700 1 Processor -- start 2023-10-01T07:57:45.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.029+0000 7fe8bd2d1700 1 -- start start 2023-10-01T07:57:45.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.030+0000 7fe8bd2d1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe8b809e850 0x7fe8b8122690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:45.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.030+0000 7fe8bd2d1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe8b809f160 0x7fe8b8122bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:45.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.030+0000 7fe8bd2d1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8b809f580 0x7fe8b8123110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:45.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.030+0000 7fe8bd2d1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b806ccc0 con 0x7fe8b809f580 2023-10-01T07:57:45.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.030+0000 7fe8bd2d1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b8125e80 con 0x7fe8b809e850 2023-10-01T07:57:45.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.030+0000 7fe8bd2d1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b8125160 con 0x7fe8b809f160 2023-10-01T07:57:45.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.030+0000 7fe8b67fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe8b809f160 0x7fe8b8122bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:45.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.030+0000 7fe8b6ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe8b809e850 0x7fe8b8122690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:45.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.030+0000 7fe8b6ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe8b809e850 0x7fe8b8122690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:49270/0 (socket says 172.21.15.26:49270) 2023-10-01T07:57:45.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.030+0000 7fe8b6ffd700 1 -- 172.21.15.26:0/2361669578 learned_addr learned my addr 172.21.15.26:0/2361669578 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:45.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.030+0000 7fe8b67fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe8b809f160 0x7fe8b8122bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47078/0 (socket says 172.21.15.26:47078) 2023-10-01T07:57:45.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.030+0000 7fe8b77fe700 1 --2- 172.21.15.26:0/2361669578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8b809f580 0x7fe8b8123110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:45.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.030+0000 7fe8b67fc700 1 -- 172.21.15.26:0/2361669578 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe8b809e850 msgr2=0x7fe8b8122690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:45.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.030+0000 7fe8b67fc700 1 --2- 172.21.15.26:0/2361669578 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe8b809e850 0x7fe8b8122690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:45.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.030+0000 7fe8b67fc700 1 -- 172.21.15.26:0/2361669578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8b809f580 msgr2=0x7fe8b8123110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:45.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.030+0000 7fe8b67fc700 1 --2- 172.21.15.26:0/2361669578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8b809f580 0x7fe8b8123110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:45.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.030+0000 7fe8b67fc700 1 -- 172.21.15.26:0/2361669578 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b00094a0 con 0x7fe8b809f160 2023-10-01T07:57:45.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.030+0000 7fe8b67fc700 1 --2- 172.21.15.26:0/2361669578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe8b809f160 0x7fe8b8122bd0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe8a000c450 tx=0x7fe8a000c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:45.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.031+0000 7fe8af7fe700 1 -- 172.21.15.26:0/2361669578 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a00052d0 con 0x7fe8b809f160 2023-10-01T07:57:45.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.031+0000 7fe8af7fe700 1 -- 172.21.15.26:0/2361669578 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a0005430 con 0x7fe8b809f160 2023-10-01T07:57:45.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.031+0000 7fe8af7fe700 1 -- 172.21.15.26:0/2361669578 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a00038a0 con 0x7fe8b809f160 2023-10-01T07:57:45.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.031+0000 7fe8bd2d1700 1 -- 172.21.15.26:0/2361669578 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a8009b30 con 0x7fe8b809f160 2023-10-01T07:57:45.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.031+0000 7fe8bd2d1700 1 -- 172.21.15.26:0/2361669578 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b81268f0 con 0x7fe8b809f160 2023-10-01T07:57:45.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.032+0000 7fe8af7fe700 1 -- 172.21.15.26:0/2361669578 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe8a0003a00 con 0x7fe8b809f160 2023-10-01T07:57:45.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.032+0000 7fe8af7fe700 1 -- 172.21.15.26:0/2361669578 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe8a003e9f0 con 0x7fe8b809f160 2023-10-01T07:57:45.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.032+0000 7fe8bd2d1700 1 -- 172.21.15.26:0/2361669578 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b80a0830 con 0x7fe8b809f160 2023-10-01T07:57:45.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.037+0000 7fe8af7fe700 1 -- 172.21.15.26:0/2361669578 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe8a0003cb0 con 0x7fe8b809f160 2023-10-01T07:57:45.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.171+0000 7f0639448700 1 Processor -- start 2023-10-01T07:57:45.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.171+0000 7f0639448700 1 -- start start 2023-10-01T07:57:45.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.172+0000 7f0639448700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f063409d6f0 0x7f063409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:45.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.172+0000 7f0639448700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f063409e000 0x7f06341339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:45.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.172+0000 7f0639448700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063409b120 con 0x7f063409e410 2023-10-01T07:57:45.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.172+0000 7f0639448700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063406b460 con 0x7f063409d6f0 2023-10-01T07:57:45.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.172+0000 7f0639448700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f063409a7e0 con 0x7f063409e000 2023-10-01T07:57:45.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.172+0000 7f06327fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f063409e000 0x7f06341339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:45.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.172+0000 7f0632ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f063409d6f0 0x7f063409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:45.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.172+0000 7f0632ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f063409d6f0 0x7f063409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34340/0 (socket says 172.21.15.26:34340) 2023-10-01T07:57:45.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.172+0000 7f06327fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f063409e000 0x7f06341339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47082/0 (socket says 172.21.15.26:47082) 2023-10-01T07:57:45.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.172+0000 7f0632ffd700 1 -- 172.21.15.26:0/516866630 learned_addr learned my addr 172.21.15.26:0/516866630 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:45.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.172+0000 7f0632ffd700 1 -- 172.21.15.26:0/516866630 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f063409e000 msgr2=0x7f06341339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:45.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.172+0000 7f0632ffd700 1 --2- 172.21.15.26:0/516866630 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f063409e000 0x7f06341339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:45.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.172+0000 7f0632ffd700 1 -- 172.21.15.26:0/516866630 >> v1:172.21.15.26:6789/0 conn(0x7f063409e410 legacy=0x7f0634133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:45.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.172+0000 7f0632ffd700 1 -- 172.21.15.26:0/516866630 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063409a500 con 0x7f063409d6f0 2023-10-01T07:57:45.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.172+0000 7f06327fc700 1 --2- 172.21.15.26:0/516866630 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f063409e000 0x7f06341339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:45.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.173+0000 7f0632ffd700 1 --2- 172.21.15.26:0/516866630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f063409d6f0 0x7f063409dac0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f06240098f0 tx=0x7f0624009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6faf0e6e5cfe723f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:45.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.173+0000 7f0631ffb700 1 -- 172.21.15.26:0/516866630 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0624004230 con 0x7f063409d6f0 2023-10-01T07:57:45.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.173+0000 7f0631ffb700 1 -- 172.21.15.26:0/516866630 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0624004390 con 0x7f063409d6f0 2023-10-01T07:57:45.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.173+0000 7f0631ffb700 1 -- 172.21.15.26:0/516866630 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06240036a0 con 0x7f063409d6f0 2023-10-01T07:57:45.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.174+0000 7f0639448700 1 -- 172.21.15.26:0/516866630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f063409d6f0 msgr2=0x7f063409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:45.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.174+0000 7f0639448700 1 --2- 172.21.15.26:0/516866630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f063409d6f0 0x7f063409dac0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f06240098f0 tx=0x7f0624009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:45.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.174+0000 7f0639448700 1 -- 172.21.15.26:0/516866630 shutdown_connections 2023-10-01T07:57:45.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.174+0000 7f0639448700 1 --2- 172.21.15.26:0/516866630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f063409d6f0 0x7f063409dac0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:45.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.174+0000 7f0639448700 1 --2- 172.21.15.26:0/516866630 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f063409e000 0x7f06341339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:45.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.174+0000 7f0639448700 1 -- 172.21.15.26:0/516866630 >> 172.21.15.26:0/516866630 conn(0x7f0634066f50 msgr2=0x7f063409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:45.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.174+0000 7f0639448700 1 -- 172.21.15.26:0/516866630 shutdown_connections 2023-10-01T07:57:45.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.174+0000 7f0639448700 1 -- 172.21.15.26:0/516866630 wait complete. 2023-10-01T07:57:45.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.175+0000 7f0639448700 1 Processor -- start 2023-10-01T07:57:45.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.175+0000 7f0639448700 1 -- start start 2023-10-01T07:57:45.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.176+0000 7f0639448700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f063409d6f0 0x7f06341a5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:45.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.176+0000 7f0639448700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f063409e000 0x7f06341a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:45.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.176+0000 7f0639448700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f063409e410 0x7f06341a68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:45.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.176+0000 7f0639448700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06341a7300 con 0x7f063409d6f0 2023-10-01T07:57:45.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.176+0000 7f0639448700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06341a7a60 con 0x7f063409e000 2023-10-01T07:57:45.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.176+0000 7f0639448700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06341a8080 con 0x7f063409e410 2023-10-01T07:57:45.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.176+0000 7f0632ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f063409d6f0 0x7f06341a5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:45.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.176+0000 7f0632ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f063409d6f0 0x7f06341a5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34356/0 (socket says 172.21.15.26:34356) 2023-10-01T07:57:45.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.176+0000 7f0632ffd700 1 -- 172.21.15.26:0/92063898 learned_addr learned my addr 172.21.15.26:0/92063898 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:45.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.176+0000 7f06327fc700 1 --2- 172.21.15.26:0/92063898 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f063409e000 0x7f06341a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:45.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.176+0000 7f06337fe700 1 --2- 172.21.15.26:0/92063898 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f063409e410 0x7f06341a68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:45.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.176+0000 7f0632ffd700 1 -- 172.21.15.26:0/92063898 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f063409e410 msgr2=0x7f06341a68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:45.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.176+0000 7f0632ffd700 1 --2- 172.21.15.26:0/92063898 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f063409e410 0x7f06341a68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:45.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.176+0000 7f0632ffd700 1 -- 172.21.15.26:0/92063898 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f063409e000 msgr2=0x7f06341a6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:45.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.176+0000 7f0632ffd700 1 --2- 172.21.15.26:0/92063898 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f063409e000 0x7f06341a6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:45.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.176+0000 7f0632ffd700 1 -- 172.21.15.26:0/92063898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06280094a0 con 0x7f063409d6f0 2023-10-01T07:57:45.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.176+0000 7f06337fe700 1 --2- 172.21.15.26:0/92063898 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f063409e410 0x7f06341a68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:57:45.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.177+0000 7f0632ffd700 1 --2- 172.21.15.26:0/92063898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f063409d6f0 0x7f06341a5e50 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f0624009130 tx=0x7f0624004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:45.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.177+0000 7f061b7fe700 1 -- 172.21.15.26:0/92063898 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0624003e20 con 0x7f063409d6f0 2023-10-01T07:57:45.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.177+0000 7f0639448700 1 -- 172.21.15.26:0/92063898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0624009550 con 0x7f063409d6f0 2023-10-01T07:57:45.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.177+0000 7f061b7fe700 1 -- 172.21.15.26:0/92063898 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0624011630 con 0x7f063409d6f0 2023-10-01T07:57:45.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.177+0000 7f061b7fe700 1 -- 172.21.15.26:0/92063898 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06240119e0 con 0x7f063409d6f0 2023-10-01T07:57:45.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.177+0000 7f0639448700 1 -- 172.21.15.26:0/92063898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06340a32e0 con 0x7f063409d6f0 2023-10-01T07:57:45.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.178+0000 7f061b7fe700 1 -- 172.21.15.26:0/92063898 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0624011b40 con 0x7f063409d6f0 2023-10-01T07:57:45.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.178+0000 7f0639448700 1 -- 172.21.15.26:0/92063898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f063409c710 con 0x7f063409d6f0 2023-10-01T07:57:45.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.178+0000 7f061b7fe700 1 -- 172.21.15.26:0/92063898 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0624040de0 con 0x7f063409d6f0 2023-10-01T07:57:45.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.183+0000 7f061b7fe700 1 -- 172.21.15.26:0/92063898 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0624010380 con 0x7f063409d6f0 2023-10-01T07:57:45.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.188+0000 7f191b301700 1 -- 172.21.15.26:0/3988139107 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f191406b250 con 0x7f1914139140 2023-10-01T07:57:45.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.189+0000 7f1909ffb700 1 -- 172.21.15.26:0/3988139107 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f190c012340 con 0x7f1914139140 2023-10-01T07:57:45.189 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:45.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.191+0000 7f191b301700 1 -- 172.21.15.26:0/3988139107 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1914139140 msgr2=0x7f19141c8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:45.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.191+0000 7f191b301700 1 --2- 172.21.15.26:0/3988139107 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1914139140 0x7f19141c8e20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f190c00ef90 tx=0x7f190c00c3a0 comp rx=0 tx=0).stop 2023-10-01T07:57:45.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.191+0000 7f191b301700 1 -- 172.21.15.26:0/3988139107 shutdown_connections 2023-10-01T07:57:45.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.191+0000 7f191b301700 1 --2- 172.21.15.26:0/3988139107 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1914139140 0x7f19141c8e20 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:45.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.191+0000 7f191b301700 1 --2- 172.21.15.26:0/3988139107 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1914133a80 0x7f19141c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:45.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.191+0000 7f191b301700 1 --2- 172.21.15.26:0/3988139107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1914136820 0x7f19141c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:45.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.191+0000 7f191b301700 1 -- 172.21.15.26:0/3988139107 >> 172.21.15.26:0/3988139107 conn(0x7f19140a4210 msgr2=0x7f191412cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:45.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.191+0000 7f191b301700 1 -- 172.21.15.26:0/3988139107 shutdown_connections 2023-10-01T07:57:45.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.191+0000 7f191b301700 1 -- 172.21.15.26:0/3988139107 wait complete. 2023-10-01T07:57:45.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:45.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.244+0000 7f274c0c4700 1 -- 172.21.15.26:0/1201819310 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2744074ea0 con 0x7f274406a770 2023-10-01T07:57:45.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.244+0000 7f273a7fc700 1 -- 172.21.15.26:0/1201819310 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f274002b030 con 0x7f274406a770 2023-10-01T07:57:45.245 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:45.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.246+0000 7f274c0c4700 1 -- 172.21.15.26:0/1201819310 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f274406a770 msgr2=0x7f27441cc7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:45.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.246+0000 7f274c0c4700 1 --2- 172.21.15.26:0/1201819310 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f274406a770 0x7f27441cc7a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2740000c00 tx=0x7f2740004750 comp rx=0 tx=0).stop 2023-10-01T07:57:45.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.247+0000 7f274c0c4700 1 -- 172.21.15.26:0/1201819310 shutdown_connections 2023-10-01T07:57:45.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.247+0000 7f274c0c4700 1 --2- 172.21.15.26:0/1201819310 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f274413c1e0 0x7f27441270d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:45.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.247+0000 7f274c0c4700 1 --2- 172.21.15.26:0/1201819310 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f274406a770 0x7f27441cc7a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:45.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.247+0000 7f274c0c4700 1 --2- 172.21.15.26:0/1201819310 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f274409dc30 0x7f27441ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:45.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.247+0000 7f274c0c4700 1 -- 172.21.15.26:0/1201819310 >> 172.21.15.26:0/1201819310 conn(0x7f2744066f50 msgr2=0x7f27440a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:45.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.248+0000 7f274c0c4700 1 -- 172.21.15.26:0/1201819310 shutdown_connections 2023-10-01T07:57:45.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.248+0000 7f274c0c4700 1 -- 172.21.15.26:0/1201819310 wait complete. 2023-10-01T07:57:45.262 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:45.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.275+0000 7fe8bd2d1700 1 -- 172.21.15.26:0/2361669578 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe8b80747f0 con 0x7fe8b809f160 2023-10-01T07:57:45.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.275+0000 7fe8af7fe700 1 -- 172.21.15.26:0/2361669578 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe8a0017020 con 0x7fe8b809f160 2023-10-01T07:57:45.275 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:45.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.277+0000 7fe8bd2d1700 1 -- 172.21.15.26:0/2361669578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe8b809f160 msgr2=0x7fe8b8122bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:45.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.277+0000 7fe8bd2d1700 1 --2- 172.21.15.26:0/2361669578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe8b809f160 0x7fe8b8122bd0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe8a000c450 tx=0x7fe8a000c760 comp rx=0 tx=0).stop 2023-10-01T07:57:45.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.277+0000 7fe8bd2d1700 1 -- 172.21.15.26:0/2361669578 shutdown_connections 2023-10-01T07:57:45.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.277+0000 7fe8bd2d1700 1 --2- 172.21.15.26:0/2361669578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8b809f580 0x7fe8b8123110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:45.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.277+0000 7fe8bd2d1700 1 --2- 172.21.15.26:0/2361669578 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe8b809e850 0x7fe8b8122690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:45.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.277+0000 7fe8bd2d1700 1 --2- 172.21.15.26:0/2361669578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe8b809f160 0x7fe8b8122bd0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:45.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.277+0000 7fe8bd2d1700 1 -- 172.21.15.26:0/2361669578 >> 172.21.15.26:0/2361669578 conn(0x7fe8b80a3f70 msgr2=0x7fe8b809d360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:45.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.277+0000 7fe8bd2d1700 1 -- 172.21.15.26:0/2361669578 shutdown_connections 2023-10-01T07:57:45.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.277+0000 7fe8bd2d1700 1 -- 172.21.15.26:0/2361669578 wait complete. 2023-10-01T07:57:45.292 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:45.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.393+0000 7f0639448700 1 -- 172.21.15.26:0/92063898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0634074ea0 con 0x7f063409d6f0 2023-10-01T07:57:45.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.393+0000 7f061b7fe700 1 -- 172.21.15.26:0/92063898 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0624026e90 con 0x7f063409d6f0 2023-10-01T07:57:45.394 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:45.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.395+0000 7f0639448700 1 -- 172.21.15.26:0/92063898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f063409d6f0 msgr2=0x7f06341a5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:45.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.395+0000 7f0639448700 1 --2- 172.21.15.26:0/92063898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f063409d6f0 0x7f06341a5e50 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f0624009130 tx=0x7f0624004750 comp rx=0 tx=0).stop 2023-10-01T07:57:45.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.395+0000 7f0639448700 1 -- 172.21.15.26:0/92063898 shutdown_connections 2023-10-01T07:57:45.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.395+0000 7f0639448700 1 --2- 172.21.15.26:0/92063898 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f063409e410 0x7f06341a68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:45.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.395+0000 7f0639448700 1 --2- 172.21.15.26:0/92063898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f063409d6f0 0x7f06341a5e50 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:45.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.395+0000 7f0639448700 1 --2- 172.21.15.26:0/92063898 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f063409e000 0x7f06341a6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:45.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.395+0000 7f0639448700 1 -- 172.21.15.26:0/92063898 >> 172.21.15.26:0/92063898 conn(0x7f0634066f50 msgr2=0x7f06341bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:45.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.396+0000 7f0639448700 1 -- 172.21.15.26:0/92063898 shutdown_connections 2023-10-01T07:57:45.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:45.396+0000 7f0639448700 1 -- 172.21.15.26:0/92063898 wait complete. 2023-10-01T07:57:45.410 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:46.208 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:46.263 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:46.293 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:46.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.364+0000 7fa33471b700 1 Processor -- start 2023-10-01T07:57:46.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.364+0000 7fa33471b700 1 -- start start 2023-10-01T07:57:46.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.365+0000 7fa33471b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa32c09d6f0 0x7fa32c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:46.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.365+0000 7fa33471b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa32c09e440 0x7fa32c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:46.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.365+0000 7fa33471b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa32c09b120 con 0x7fa32c09e000 2023-10-01T07:57:46.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.365+0000 7fa33471b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa32c06b460 con 0x7fa32c09d6f0 2023-10-01T07:57:46.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.365+0000 7fa33471b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c09a7e0 con 0x7fa32c09e440 2023-10-01T07:57:46.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.365+0000 7fa3324b7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa32c09d6f0 0x7fa32c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:46.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.365+0000 7fa332cb8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa32c09e440 0x7fa32c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:46.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.365+0000 7fa3324b7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa32c09d6f0 0x7fa32c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34362/0 (socket says 172.21.15.26:34362) 2023-10-01T07:57:46.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.365+0000 7fa3324b7700 1 -- 172.21.15.26:0/2632761313 learned_addr learned my addr 172.21.15.26:0/2632761313 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:46.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.366+0000 7fa3324b7700 1 -- 172.21.15.26:0/2632761313 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa32c09e440 msgr2=0x7fa32c134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:46.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.366+0000 7fa3324b7700 1 --2- 172.21.15.26:0/2632761313 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa32c09e440 0x7fa32c134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.366+0000 7fa3324b7700 1 -- 172.21.15.26:0/2632761313 >> v1:172.21.15.26:6789/0 conn(0x7fa32c09e000 legacy=0x7fa32c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:46.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.366+0000 7fa3324b7700 1 -- 172.21.15.26:0/2632761313 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa32c09a500 con 0x7fa32c09d6f0 2023-10-01T07:57:46.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.366+0000 7fa332cb8700 1 --2- 172.21.15.26:0/2632761313 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa32c09e440 0x7fa32c134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:46.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.366+0000 7fa3324b7700 1 --2- 172.21.15.26:0/2632761313 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c09d6f0 0x7fa32c09dac0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fa328009920 tx=0x7fa328009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d1024c4a97cd601 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:46.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.366+0000 7fa3314b5700 1 -- 172.21.15.26:0/2632761313 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa328011830 con 0x7fa32c09d6f0 2023-10-01T07:57:46.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.366+0000 7fa3314b5700 1 -- 172.21.15.26:0/2632761313 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa328011990 con 0x7fa32c09d6f0 2023-10-01T07:57:46.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.366+0000 7fa3314b5700 1 -- 172.21.15.26:0/2632761313 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa328011d20 con 0x7fa32c09d6f0 2023-10-01T07:57:46.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.367+0000 7fa33471b700 1 -- 172.21.15.26:0/2632761313 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c09d6f0 msgr2=0x7fa32c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:46.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.367+0000 7fa33471b700 1 --2- 172.21.15.26:0/2632761313 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c09d6f0 0x7fa32c09dac0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fa328009920 tx=0x7fa328009c30 comp rx=0 tx=0).stop 2023-10-01T07:57:46.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.367+0000 7fa33471b700 1 -- 172.21.15.26:0/2632761313 shutdown_connections 2023-10-01T07:57:46.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.367+0000 7fa33471b700 1 --2- 172.21.15.26:0/2632761313 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c09d6f0 0x7fa32c09dac0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.367+0000 7fa33471b700 1 --2- 172.21.15.26:0/2632761313 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa32c09e440 0x7fa32c134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.367+0000 7fa33471b700 1 -- 172.21.15.26:0/2632761313 >> 172.21.15.26:0/2632761313 conn(0x7fa32c066f50 msgr2=0x7fa32c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:46.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.367+0000 7fa33471b700 1 -- 172.21.15.26:0/2632761313 shutdown_connections 2023-10-01T07:57:46.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.367+0000 7fa33471b700 1 -- 172.21.15.26:0/2632761313 wait complete. 2023-10-01T07:57:46.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.369+0000 7fa33471b700 1 Processor -- start 2023-10-01T07:57:46.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.369+0000 7fa33471b700 1 -- start start 2023-10-01T07:57:46.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.369+0000 7fa33471b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c09d6f0 0x7fa32c1a5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:46.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.369+0000 7fa33471b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa32c09e000 0x7fa32c1a6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:46.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.369+0000 7fa33471b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa32c09e440 0x7fa32c1a6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:46.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.369+0000 7fa33471b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c1a7ac0 con 0x7fa32c09d6f0 2023-10-01T07:57:46.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.369+0000 7fa33471b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c1a7310 con 0x7fa32c09e000 2023-10-01T07:57:46.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.369+0000 7fa33471b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c09c710 con 0x7fa32c09e440 2023-10-01T07:57:46.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.369+0000 7fa331cb6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa32c09e000 0x7fa32c1a6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:46.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.369+0000 7fa3324b7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c09d6f0 0x7fa32c1a5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:46.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.369+0000 7fa331cb6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa32c09e000 0x7fa32c1a6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:49302/0 (socket says 172.21.15.26:49302) 2023-10-01T07:57:46.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.369+0000 7fa3324b7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c09d6f0 0x7fa32c1a5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34364/0 (socket says 172.21.15.26:34364) 2023-10-01T07:57:46.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.369+0000 7fa331cb6700 1 -- 172.21.15.26:0/3223666733 learned_addr learned my addr 172.21.15.26:0/3223666733 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:46.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.369+0000 7fa332cb8700 1 --2- 172.21.15.26:0/3223666733 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa32c09e440 0x7fa32c1a6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:46.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.370+0000 7fa3324b7700 1 -- 172.21.15.26:0/3223666733 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa32c09e440 msgr2=0x7fa32c1a6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:46.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.370+0000 7fa3324b7700 1 --2- 172.21.15.26:0/3223666733 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa32c09e440 0x7fa32c1a6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.370+0000 7fa3324b7700 1 -- 172.21.15.26:0/3223666733 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa32c09e000 msgr2=0x7fa32c1a6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:46.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.370+0000 7fa3324b7700 1 --2- 172.21.15.26:0/3223666733 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa32c09e000 0x7fa32c1a6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.370+0000 7fa3324b7700 1 -- 172.21.15.26:0/3223666733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa324009a70 con 0x7fa32c09d6f0 2023-10-01T07:57:46.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.370+0000 7fa331cb6700 1 --2- 172.21.15.26:0/3223666733 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa32c09e000 0x7fa32c1a6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:46.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.370+0000 7fa3324b7700 1 --2- 172.21.15.26:0/3223666733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c09d6f0 0x7fa32c1a5ef0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fa328016000 tx=0x7fa328004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:46.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.370+0000 7fa322ffd700 1 -- 172.21.15.26:0/3223666733 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3280042c0 con 0x7fa32c09d6f0 2023-10-01T07:57:46.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.370+0000 7fa322ffd700 1 -- 172.21.15.26:0/3223666733 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32801f070 con 0x7fa32c09d6f0 2023-10-01T07:57:46.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.370+0000 7fa33471b700 1 -- 172.21.15.26:0/3223666733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa328009550 con 0x7fa32c09d6f0 2023-10-01T07:57:46.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.370+0000 7fa322ffd700 1 -- 172.21.15.26:0/3223666733 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3280036a0 con 0x7fa32c09d6f0 2023-10-01T07:57:46.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.370+0000 7fa33471b700 1 -- 172.21.15.26:0/3223666733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa32c1a8d10 con 0x7fa32c09d6f0 2023-10-01T07:57:46.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.371+0000 7fa322ffd700 1 -- 172.21.15.26:0/3223666733 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa328021030 con 0x7fa32c09d6f0 2023-10-01T07:57:46.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.372+0000 7fa322ffd700 1 -- 172.21.15.26:0/3223666733 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa3280407b0 con 0x7fa32c09d6f0 2023-10-01T07:57:46.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.372+0000 7fa33471b700 1 -- 172.21.15.26:0/3223666733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa32c074ea0 con 0x7fa32c09d6f0 2023-10-01T07:57:46.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.377+0000 7fa322ffd700 1 -- 172.21.15.26:0/3223666733 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa3280239c0 con 0x7fa32c09d6f0 2023-10-01T07:57:46.411 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:46.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.432+0000 7ff59df8c700 1 Processor -- start 2023-10-01T07:57:46.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.432+0000 7ff59df8c700 1 -- start start 2023-10-01T07:57:46.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.433+0000 7ff59df8c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff5981338a0 0x7ff598133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:46.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.433+0000 7ff59df8c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff59809e930 0x7ff59813b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:46.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.433+0000 7ff59df8c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff59806ef30 con 0x7ff59809de50 2023-10-01T07:57:46.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.433+0000 7ff59df8c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff59806fef0 con 0x7ff5981338a0 2023-10-01T07:57:46.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.433+0000 7ff59df8c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5981334b0 con 0x7ff59809e930 2023-10-01T07:57:46.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.433+0000 7ff596ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff59809de50 0x7ff59809e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48188/0 (socket says 172.21.15.26:48188) 2023-10-01T07:57:46.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.433+0000 7ff596ffd700 1 -- 172.21.15.26:0/2369506493 learned_addr learned my addr 172.21.15.26:0/2369506493 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:46.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.433+0000 7ff597fff700 1 --2- 172.21.15.26:0/2369506493 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff59809e930 0x7ff59813b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:46.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.433+0000 7ff5967fc700 1 -- 172.21.15.26:0/2369506493 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1469980556 0 0) 0x7ff59806ef30 con 0x7ff59809de50 2023-10-01T07:57:46.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.433+0000 7ff5967fc700 1 -- 172.21.15.26:0/2369506493 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5800035b0 con 0x7ff59809de50 2023-10-01T07:57:46.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.433+0000 7ff597fff700 1 -- 172.21.15.26:0/2369506493 >> v2:172.21.15.26:3300/0 conn(0x7ff5981338a0 msgr2=0x7ff598133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:46.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.433+0000 7ff597fff700 1 --2- 172.21.15.26:0/2369506493 >> v2:172.21.15.26:3300/0 conn(0x7ff5981338a0 0x7ff598133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.433+0000 7ff597fff700 1 -- 172.21.15.26:0/2369506493 >> v1:172.21.15.26:6789/0 conn(0x7ff59809de50 legacy=0x7ff59809e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:46.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.434+0000 7ff597fff700 1 -- 172.21.15.26:0/2369506493 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59806fc30 con 0x7ff59809e930 2023-10-01T07:57:46.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.434+0000 7ff597fff700 1 --2- 172.21.15.26:0/2369506493 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff59809e930 0x7ff59813b740 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff590009d90 tx=0x7ff59000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e246b5eb979bb91 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:46.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.434+0000 7ff5967fc700 1 -- 172.21.15.26:0/2369506493 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59000e070 con 0x7ff59809e930 2023-10-01T07:57:46.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.434+0000 7ff5967fc700 1 -- 172.21.15.26:0/2369506493 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59000bb20 con 0x7ff59809e930 2023-10-01T07:57:46.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.434+0000 7ff5967fc700 1 -- 172.21.15.26:0/2369506493 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff590012430 con 0x7ff59809e930 2023-10-01T07:57:46.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.435+0000 7ff59df8c700 1 -- 172.21.15.26:0/2369506493 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff59809e930 msgr2=0x7ff59813b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:46.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.435+0000 7ff59df8c700 1 --2- 172.21.15.26:0/2369506493 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff59809e930 0x7ff59813b740 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff590009d90 tx=0x7ff59000b330 comp rx=0 tx=0).stop 2023-10-01T07:57:46.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.435+0000 7ff59df8c700 1 -- 172.21.15.26:0/2369506493 shutdown_connections 2023-10-01T07:57:46.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.435+0000 7ff59df8c700 1 --2- 172.21.15.26:0/2369506493 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff59809e930 0x7ff59813b740 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.435+0000 7ff59df8c700 1 --2- 172.21.15.26:0/2369506493 >> v2:172.21.15.26:3300/0 conn(0x7ff5981338a0 0x7ff598133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.435+0000 7ff59df8c700 1 -- 172.21.15.26:0/2369506493 >> 172.21.15.26:0/2369506493 conn(0x7ff5980a2aa0 msgr2=0x7ff5980a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:46.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.435+0000 7ff59df8c700 1 -- 172.21.15.26:0/2369506493 shutdown_connections 2023-10-01T07:57:46.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.435+0000 7ff59df8c700 1 -- 172.21.15.26:0/2369506493 wait complete. 2023-10-01T07:57:46.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.437+0000 7ff59df8c700 1 Processor -- start 2023-10-01T07:57:46.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.437+0000 7ff59df8c700 1 -- start start 2023-10-01T07:57:46.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.438+0000 7ff59df8c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff59809de50 0x7ff59811a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:46.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.438+0000 7ff59df8c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff59809e930 0x7ff59811aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:46.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.438+0000 7ff59df8c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff5981338a0 0x7ff59811afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:46.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.438+0000 7ff59df8c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59811ea00 con 0x7ff59809de50 2023-10-01T07:57:46.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.438+0000 7ff59df8c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59811e040 con 0x7ff5981338a0 2023-10-01T07:57:46.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.438+0000 7ff59df8c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff59811d3f0 con 0x7ff59809e930 2023-10-01T07:57:46.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.438+0000 7ff596ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff59809e930 0x7ff59811aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:46.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.438+0000 7ff597fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff5981338a0 0x7ff59811afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:46.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.438+0000 7ff597fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff5981338a0 0x7ff59811afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:49310/0 (socket says 172.21.15.26:49310) 2023-10-01T07:57:46.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.438+0000 7ff596ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff59809e930 0x7ff59811aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47116/0 (socket says 172.21.15.26:47116) 2023-10-01T07:57:46.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.438+0000 7ff597fff700 1 -- 172.21.15.26:0/3334733544 learned_addr learned my addr 172.21.15.26:0/3334733544 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:46.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.438+0000 7ff596ffd700 1 -- 172.21.15.26:0/3334733544 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff5981338a0 msgr2=0x7ff59811afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:46.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.438+0000 7ff596ffd700 1 --2- 172.21.15.26:0/3334733544 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff5981338a0 0x7ff59811afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.438+0000 7ff596ffd700 1 -- 172.21.15.26:0/3334733544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff59809de50 msgr2=0x7ff59811a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:46.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.438+0000 7ff596ffd700 1 --2- 172.21.15.26:0/3334733544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff59809de50 0x7ff59811a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.438+0000 7ff596ffd700 1 -- 172.21.15.26:0/3334733544 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff590009a70 con 0x7ff59809e930 2023-10-01T07:57:46.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.438+0000 7ff597fff700 1 --2- 172.21.15.26:0/3334733544 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff5981338a0 0x7ff59811afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:46.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.439+0000 7ff596ffd700 1 --2- 172.21.15.26:0/3334733544 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff59809e930 0x7ff59811aa60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff58c00c490 tx=0x7ff58c00c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:46.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.439+0000 7ff57ffff700 1 -- 172.21.15.26:0/3334733544 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c005d70 con 0x7ff59809e930 2023-10-01T07:57:46.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.439+0000 7ff57ffff700 1 -- 172.21.15.26:0/3334733544 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58c0070d0 con 0x7ff59809e930 2023-10-01T07:57:46.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.439+0000 7ff59df8c700 1 -- 172.21.15.26:0/3334733544 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff59811c1d0 con 0x7ff59809e930 2023-10-01T07:57:46.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.439+0000 7ff57ffff700 1 -- 172.21.15.26:0/3334733544 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c007460 con 0x7ff59809e930 2023-10-01T07:57:46.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.439+0000 7ff59df8c700 1 -- 172.21.15.26:0/3334733544 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff59811cf30 con 0x7ff59809e930 2023-10-01T07:57:46.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.440+0000 7ff57ffff700 1 -- 172.21.15.26:0/3334733544 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff58c0075c0 con 0x7ff59809e930 2023-10-01T07:57:46.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.440+0000 7ff57ffff700 1 -- 172.21.15.26:0/3334733544 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff58c03e9d0 con 0x7ff59809e930 2023-10-01T07:57:46.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.441+0000 7ff59df8c700 1 -- 172.21.15.26:0/3334733544 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff59806ea40 con 0x7ff59809e930 2023-10-01T07:57:46.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.448+0000 7ff57ffff700 1 -- 172.21.15.26:0/3334733544 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff58c017080 con 0x7ff59809e930 2023-10-01T07:57:46.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.455+0000 7f2a260b0700 1 Processor -- start 2023-10-01T07:57:46.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.455+0000 7f2a260b0700 1 -- start start 2023-10-01T07:57:46.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.455+0000 7f2a260b0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a2012cf60 0x7f2a2006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:46.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.455+0000 7f2a260b0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2a20130430 0x7f2a20137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:46.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.455+0000 7f2a260b0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a2012cd90 con 0x7f2a2012f8b0 2023-10-01T07:57:46.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.455+0000 7f2a260b0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a2012d330 con 0x7f2a20130430 2023-10-01T07:57:46.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.455+0000 7f2a260b0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a20071780 con 0x7f2a2012cf60 2023-10-01T07:57:46.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.456+0000 7f2a1f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a2012cf60 0x7f2a2006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:46.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.456+0000 7f2a1effd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2a2012f8b0 0x7f2a2012fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48196/0 (socket says 172.21.15.26:48196) 2023-10-01T07:57:46.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.456+0000 7f2a1effd700 1 -- 172.21.15.26:0/4078261429 learned_addr learned my addr 172.21.15.26:0/4078261429 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:46.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.456+0000 7f2a1ffff700 1 --2- 172.21.15.26:0/4078261429 >> v2:172.21.15.26:3300/0 conn(0x7f2a20130430 0x7f2a20137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:46.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.456+0000 7f2a1ffff700 1 -- 172.21.15.26:0/4078261429 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a2012cf60 msgr2=0x7f2a2006f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:46.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.456+0000 7f2a1ffff700 1 --2- 172.21.15.26:0/4078261429 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a2012cf60 0x7f2a2006f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.456+0000 7f2a1ffff700 1 -- 172.21.15.26:0/4078261429 >> v1:172.21.15.26:6789/0 conn(0x7f2a2012f8b0 legacy=0x7f2a2012fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:46.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.456+0000 7f2a1ffff700 1 -- 172.21.15.26:0/4078261429 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a20071a40 con 0x7f2a20130430 2023-10-01T07:57:46.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.456+0000 7f2a1f7fe700 1 --2- 172.21.15.26:0/4078261429 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a2012cf60 0x7f2a2006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:46.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.456+0000 7f2a1ffff700 1 --2- 172.21.15.26:0/4078261429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a20130430 0x7f2a20137c30 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f2a18009d90 tx=0x7f2a1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=394a511a16fc7d94 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:46.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.459+0000 7f2a1e7fc700 1 -- 172.21.15.26:0/4078261429 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1800e070 con 0x7f2a20130430 2023-10-01T07:57:46.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.459+0000 7f2a1e7fc700 1 -- 172.21.15.26:0/4078261429 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1800bb20 con 0x7f2a20130430 2023-10-01T07:57:46.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.459+0000 7f2a1e7fc700 1 -- 172.21.15.26:0/4078261429 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a18012430 con 0x7f2a20130430 2023-10-01T07:57:46.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.460+0000 7f2a260b0700 1 -- 172.21.15.26:0/4078261429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a20130430 msgr2=0x7f2a20137c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:46.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.460+0000 7f2a260b0700 1 --2- 172.21.15.26:0/4078261429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a20130430 0x7f2a20137c30 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f2a18009d90 tx=0x7f2a1800b330 comp rx=0 tx=0).stop 2023-10-01T07:57:46.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.460+0000 7f2a260b0700 1 -- 172.21.15.26:0/4078261429 shutdown_connections 2023-10-01T07:57:46.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.460+0000 7f2a260b0700 1 --2- 172.21.15.26:0/4078261429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a20130430 0x7f2a20137c30 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.460+0000 7f2a260b0700 1 --2- 172.21.15.26:0/4078261429 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a2012cf60 0x7f2a2006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.460+0000 7f2a260b0700 1 -- 172.21.15.26:0/4078261429 >> 172.21.15.26:0/4078261429 conn(0x7f2a200a2aa0 msgr2=0x7f2a200a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:46.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.460+0000 7f2a260b0700 1 -- 172.21.15.26:0/4078261429 shutdown_connections 2023-10-01T07:57:46.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.460+0000 7f2a260b0700 1 -- 172.21.15.26:0/4078261429 wait complete. 2023-10-01T07:57:46.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.461+0000 7f2a260b0700 1 Processor -- start 2023-10-01T07:57:46.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.462+0000 7f2a260b0700 1 -- start start 2023-10-01T07:57:46.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.463+0000 7f2a260b0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a2012cf60 0x7f2a201b9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:46.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.463+0000 7f2a260b0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a2012f8b0 0x7f2a201b96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:46.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.463+0000 7f2a260b0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a20130430 0x7f2a201b9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:46.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.463+0000 7f2a260b0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a20119b10 con 0x7f2a2012cf60 2023-10-01T07:57:46.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.463+0000 7f2a260b0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a201bae10 con 0x7f2a20130430 2023-10-01T07:57:46.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.463+0000 7f2a260b0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2009e280 con 0x7f2a2012f8b0 2023-10-01T07:57:46.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.463+0000 7f2a1ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a20130430 0x7f2a201b9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:46.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.463+0000 7f2a1ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a20130430 0x7f2a201b9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:49340/0 (socket says 172.21.15.26:49340) 2023-10-01T07:57:46.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.463+0000 7f2a1ffff700 1 -- 172.21.15.26:0/1667160459 learned_addr learned my addr 172.21.15.26:0/1667160459 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:46.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.463+0000 7f2a1f7fe700 1 --2- 172.21.15.26:0/1667160459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a2012cf60 0x7f2a201b9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:46.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.463+0000 7f2a1ffff700 1 -- 172.21.15.26:0/1667160459 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a2012f8b0 msgr2=0x7f2a201b96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:46.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.463+0000 7f2a1ffff700 1 --2- 172.21.15.26:0/1667160459 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a2012f8b0 0x7f2a201b96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.463+0000 7f2a1ffff700 1 -- 172.21.15.26:0/1667160459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a2012cf60 msgr2=0x7f2a201b9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:46.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.463+0000 7f2a1ffff700 1 --2- 172.21.15.26:0/1667160459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a2012cf60 0x7f2a201b9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.463+0000 7f2a1ffff700 1 -- 172.21.15.26:0/1667160459 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a100094a0 con 0x7f2a20130430 2023-10-01T07:57:46.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.463+0000 7f2a1ffff700 1 --2- 172.21.15.26:0/1667160459 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a20130430 0x7f2a201b9be0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2a18014040 tx=0x7f2a18004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:46.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.464+0000 7f2a07fff700 1 -- 172.21.15.26:0/1667160459 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a18012430 con 0x7f2a20130430 2023-10-01T07:57:46.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.464+0000 7f2a07fff700 1 -- 172.21.15.26:0/1667160459 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a18020070 con 0x7f2a20130430 2023-10-01T07:57:46.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.464+0000 7f2a07fff700 1 -- 172.21.15.26:0/1667160459 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a18003ea0 con 0x7f2a20130430 2023-10-01T07:57:46.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.464+0000 7f2a260b0700 1 -- 172.21.15.26:0/1667160459 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a18009a70 con 0x7f2a20130430 2023-10-01T07:57:46.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.464+0000 7f2a260b0700 1 -- 172.21.15.26:0/1667160459 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a201bb560 con 0x7f2a20130430 2023-10-01T07:57:46.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.465+0000 7f2a260b0700 1 -- 172.21.15.26:0/1667160459 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a20074ea0 con 0x7f2a20130430 2023-10-01T07:57:46.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.465+0000 7f2a07fff700 1 -- 172.21.15.26:0/1667160459 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2a18004280 con 0x7f2a20130430 2023-10-01T07:57:46.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.465+0000 7f2a07fff700 1 -- 172.21.15.26:0/1667160459 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2a18022070 con 0x7f2a20130430 2023-10-01T07:57:46.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.470+0000 7f2a07fff700 1 -- 172.21.15.26:0/1667160459 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2a1801c400 con 0x7f2a20130430 2023-10-01T07:57:46.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.556+0000 7f4687ed6700 1 Processor -- start 2023-10-01T07:57:46.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.557+0000 7f4687ed6700 1 -- start start 2023-10-01T07:57:46.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.557+0000 7f4687ed6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f468009e1d0 0x7f4680135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:46.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.557+0000 7f4687ed6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4680135e50 0x7f4680138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:46.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.557+0000 7f4687ed6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f468009f130 con 0x7f468009d6f0 2023-10-01T07:57:46.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.557+0000 7f4687ed6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f468009f520 con 0x7f4680135e50 2023-10-01T07:57:46.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.557+0000 7f4687ed6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f468009e930 con 0x7f468009e1d0 2023-10-01T07:57:46.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.557+0000 7f4685471700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f468009e1d0 0x7f4680135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:46.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.558+0000 7f4685471700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f468009e1d0 0x7f4680135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47140/0 (socket says 172.21.15.26:47140) 2023-10-01T07:57:46.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.558+0000 7f4685471700 1 -- 172.21.15.26:0/148064614 learned_addr learned my addr 172.21.15.26:0/148064614 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:46.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.558+0000 7f4686473700 1 --2- 172.21.15.26:0/148064614 >> v2:172.21.15.26:3300/0 conn(0x7f4680135e50 0x7f4680138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:46.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.558+0000 7f4685471700 1 -- 172.21.15.26:0/148064614 >> v2:172.21.15.26:3300/0 conn(0x7f4680135e50 msgr2=0x7f4680138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:46.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.558+0000 7f4685471700 1 --2- 172.21.15.26:0/148064614 >> v2:172.21.15.26:3300/0 conn(0x7f4680135e50 0x7f4680138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.558+0000 7f4685471700 1 -- 172.21.15.26:0/148064614 >> v1:172.21.15.26:6789/0 conn(0x7f468009d6f0 legacy=0x7f468009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:46.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.558+0000 7f4685471700 1 -- 172.21.15.26:0/148064614 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468009b2d0 con 0x7f468009e1d0 2023-10-01T07:57:46.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.558+0000 7f4686473700 1 --2- 172.21.15.26:0/148064614 >> v2:172.21.15.26:3300/0 conn(0x7f4680135e50 0x7f4680138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:46.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.558+0000 7f4685471700 1 --2- 172.21.15.26:0/148064614 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f468009e1d0 0x7f4680135910 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f467000bbc0 tx=0x7f467000bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb9401c855b5e13d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:46.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.558+0000 7f4684c70700 1 -- 172.21.15.26:0/148064614 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467000dcf0 con 0x7f468009e1d0 2023-10-01T07:57:46.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.558+0000 7f4684c70700 1 -- 172.21.15.26:0/148064614 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467000de50 con 0x7f468009e1d0 2023-10-01T07:57:46.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.559+0000 7f4684c70700 1 -- 172.21.15.26:0/148064614 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4670010690 con 0x7f468009e1d0 2023-10-01T07:57:46.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.559+0000 7f4687ed6700 1 -- 172.21.15.26:0/148064614 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f468009e1d0 msgr2=0x7f4680135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:46.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.559+0000 7f4687ed6700 1 --2- 172.21.15.26:0/148064614 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f468009e1d0 0x7f4680135910 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f467000bbc0 tx=0x7f467000bed0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.559+0000 7f4687ed6700 1 -- 172.21.15.26:0/148064614 shutdown_connections 2023-10-01T07:57:46.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.559+0000 7f4687ed6700 1 --2- 172.21.15.26:0/148064614 >> v2:172.21.15.26:3300/0 conn(0x7f4680135e50 0x7f4680138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.559+0000 7f4687ed6700 1 --2- 172.21.15.26:0/148064614 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f468009e1d0 0x7f4680135910 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.559+0000 7f4687ed6700 1 -- 172.21.15.26:0/148064614 >> 172.21.15.26:0/148064614 conn(0x7f4680066f50 msgr2=0x7f468009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:46.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.560+0000 7f4687ed6700 1 -- 172.21.15.26:0/148064614 shutdown_connections 2023-10-01T07:57:46.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.560+0000 7f4687ed6700 1 -- 172.21.15.26:0/148064614 wait complete. 2023-10-01T07:57:46.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.561+0000 7f4687ed6700 1 Processor -- start 2023-10-01T07:57:46.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.561+0000 7f4687ed6700 1 -- start start 2023-10-01T07:57:46.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.562+0000 7f4687ed6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f468009d6f0 0x7f46801c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:46.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.562+0000 7f4687ed6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f468009e1d0 0x7f46801c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:46.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.562+0000 7f4687ed6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4680135e50 0x7f46801c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:46.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.562+0000 7f4687ed6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4680121250 con 0x7f468009e1d0 2023-10-01T07:57:46.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.562+0000 7f4687ed6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46800a1e20 con 0x7f468009d6f0 2023-10-01T07:57:46.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.562+0000 7f4687ed6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f468011fb70 con 0x7f4680135e50 2023-10-01T07:57:46.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.562+0000 7f4686473700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4680135e50 0x7f46801c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:46.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.562+0000 7f4686473700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4680135e50 0x7f46801c8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47142/0 (socket says 172.21.15.26:47142) 2023-10-01T07:57:46.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.562+0000 7f4686473700 1 -- 172.21.15.26:0/3412623433 learned_addr learned my addr 172.21.15.26:0/3412623433 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:46.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.562+0000 7f4685471700 1 --2- 172.21.15.26:0/3412623433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f468009e1d0 0x7f46801c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:46.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.562+0000 7f4685c72700 1 --2- 172.21.15.26:0/3412623433 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f468009d6f0 0x7f46801c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:46.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.563+0000 7f4686473700 1 -- 172.21.15.26:0/3412623433 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f468009d6f0 msgr2=0x7f46801c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:46.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.563+0000 7f4686473700 1 --2- 172.21.15.26:0/3412623433 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f468009d6f0 0x7f46801c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.563+0000 7f4686473700 1 -- 172.21.15.26:0/3412623433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f468009e1d0 msgr2=0x7f46801c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:46.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.563+0000 7f4686473700 1 --2- 172.21.15.26:0/3412623433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f468009e1d0 0x7f46801c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.563+0000 7f4686473700 1 -- 172.21.15.26:0/3412623433 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4678009a70 con 0x7f4680135e50 2023-10-01T07:57:46.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.563+0000 7f4685c72700 1 --2- 172.21.15.26:0/3412623433 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f468009d6f0 0x7f46801c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:57:46.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.563+0000 7f4686473700 1 --2- 172.21.15.26:0/3412623433 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4680135e50 0x7f46801c8ee0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4678009ea0 tx=0x7f467800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:46.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.563+0000 7f46767fc700 1 -- 172.21.15.26:0/3412623433 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467800cd40 con 0x7f4680135e50 2023-10-01T07:57:46.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.563+0000 7f46767fc700 1 -- 172.21.15.26:0/3412623433 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467800f040 con 0x7f4680135e50 2023-10-01T07:57:46.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.563+0000 7f4687ed6700 1 -- 172.21.15.26:0/3412623433 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f467000b7f0 con 0x7f4680135e50 2023-10-01T07:57:46.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.563+0000 7f46767fc700 1 -- 172.21.15.26:0/3412623433 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46780146c0 con 0x7f4680135e50 2023-10-01T07:57:46.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.563+0000 7f4687ed6700 1 -- 172.21.15.26:0/3412623433 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4680121cc0 con 0x7f4680135e50 2023-10-01T07:57:46.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.564+0000 7f4687ed6700 1 -- 172.21.15.26:0/3412623433 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f468009c700 con 0x7f4680135e50 2023-10-01T07:57:46.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.564+0000 7f46767fc700 1 -- 172.21.15.26:0/3412623433 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4678014820 con 0x7f4680135e50 2023-10-01T07:57:46.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.565+0000 7f46767fc700 1 -- 172.21.15.26:0/3412623433 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4678040450 con 0x7f4680135e50 2023-10-01T07:57:46.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.569+0000 7f46767fc700 1 -- 172.21.15.26:0/3412623433 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4678007d40 con 0x7f4680135e50 2023-10-01T07:57:46.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.637+0000 7fa33471b700 1 -- 172.21.15.26:0/3223666733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa32c06c360 con 0x7fa32c09d6f0 2023-10-01T07:57:46.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.638+0000 7fa322ffd700 1 -- 172.21.15.26:0/3223666733 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa328015020 con 0x7fa32c09d6f0 2023-10-01T07:57:46.639 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:46.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.640+0000 7fa33471b700 1 -- 172.21.15.26:0/3223666733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c09d6f0 msgr2=0x7fa32c1a5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:46.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.640+0000 7fa33471b700 1 --2- 172.21.15.26:0/3223666733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c09d6f0 0x7fa32c1a5ef0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fa328016000 tx=0x7fa328004750 comp rx=0 tx=0).stop 2023-10-01T07:57:46.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.640+0000 7fa33471b700 1 -- 172.21.15.26:0/3223666733 shutdown_connections 2023-10-01T07:57:46.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.640+0000 7fa33471b700 1 --2- 172.21.15.26:0/3223666733 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa32c09e440 0x7fa32c1a6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.640+0000 7fa33471b700 1 --2- 172.21.15.26:0/3223666733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c09d6f0 0x7fa32c1a5ef0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.640+0000 7fa33471b700 1 --2- 172.21.15.26:0/3223666733 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa32c09e000 0x7fa32c1a6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.640+0000 7fa33471b700 1 -- 172.21.15.26:0/3223666733 >> 172.21.15.26:0/3223666733 conn(0x7fa32c066f50 msgr2=0x7fa32c1bae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:46.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.640+0000 7fa33471b700 1 -- 172.21.15.26:0/3223666733 shutdown_connections 2023-10-01T07:57:46.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.640+0000 7fa33471b700 1 -- 172.21.15.26:0/3223666733 wait complete. 2023-10-01T07:57:46.655 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:46.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.665+0000 7ff59df8c700 1 -- 172.21.15.26:0/3334733544 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff598074ea0 con 0x7ff59809e930 2023-10-01T07:57:46.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.665+0000 7ff57ffff700 1 -- 172.21.15.26:0/3334733544 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff58c01bb10 con 0x7ff59809e930 2023-10-01T07:57:46.666 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:46.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.667+0000 7ff59df8c700 1 -- 172.21.15.26:0/3334733544 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff59809e930 msgr2=0x7ff59811aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:46.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.667+0000 7ff59df8c700 1 --2- 172.21.15.26:0/3334733544 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff59809e930 0x7ff59811aa60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff58c00c490 tx=0x7ff58c00c7a0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.667+0000 7ff59df8c700 1 -- 172.21.15.26:0/3334733544 shutdown_connections 2023-10-01T07:57:46.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.667+0000 7ff59df8c700 1 --2- 172.21.15.26:0/3334733544 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff5981338a0 0x7ff59811afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.667+0000 7ff59df8c700 1 --2- 172.21.15.26:0/3334733544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff59809de50 0x7ff59811a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.667+0000 7ff59df8c700 1 --2- 172.21.15.26:0/3334733544 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff59809e930 0x7ff59811aa60 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.667+0000 7ff59df8c700 1 -- 172.21.15.26:0/3334733544 >> 172.21.15.26:0/3334733544 conn(0x7ff5980a2aa0 msgr2=0x7ff598130730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:46.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.668+0000 7ff59df8c700 1 -- 172.21.15.26:0/3334733544 shutdown_connections 2023-10-01T07:57:46.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.668+0000 7ff59df8c700 1 -- 172.21.15.26:0/3334733544 wait complete. 2023-10-01T07:57:46.682 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:46.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.758+0000 7f2a260b0700 1 -- 172.21.15.26:0/1667160459 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2a200713a0 con 0x7f2a20130430 2023-10-01T07:57:46.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.758+0000 7f2a07fff700 1 -- 172.21.15.26:0/1667160459 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2a1802c030 con 0x7f2a20130430 2023-10-01T07:57:46.759 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:46.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.762+0000 7f2a260b0700 1 -- 172.21.15.26:0/1667160459 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a20130430 msgr2=0x7f2a201b9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:46.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.762+0000 7f2a260b0700 1 --2- 172.21.15.26:0/1667160459 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a20130430 0x7f2a201b9be0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2a18014040 tx=0x7f2a18004ad0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.762+0000 7f2a260b0700 1 -- 172.21.15.26:0/1667160459 shutdown_connections 2023-10-01T07:57:46.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.762+0000 7f2a260b0700 1 --2- 172.21.15.26:0/1667160459 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a20130430 0x7f2a201b9be0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.762+0000 7f2a260b0700 1 --2- 172.21.15.26:0/1667160459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a2012cf60 0x7f2a201b9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.762+0000 7f2a260b0700 1 --2- 172.21.15.26:0/1667160459 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a2012f8b0 0x7f2a201b96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.762+0000 7f2a260b0700 1 -- 172.21.15.26:0/1667160459 >> 172.21.15.26:0/1667160459 conn(0x7f2a200a2aa0 msgr2=0x7f2a200a1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:46.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.762+0000 7f2a260b0700 1 -- 172.21.15.26:0/1667160459 shutdown_connections 2023-10-01T07:57:46.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.762+0000 7f2a260b0700 1 -- 172.21.15.26:0/1667160459 wait complete. 2023-10-01T07:57:46.776 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:46.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.834+0000 7f4687ed6700 1 -- 172.21.15.26:0/3412623433 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f468009ef50 con 0x7f4680135e50 2023-10-01T07:57:46.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.835+0000 7f46767fc700 1 -- 172.21.15.26:0/3412623433 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4678018020 con 0x7f4680135e50 2023-10-01T07:57:46.835 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:46.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.837+0000 7f4687ed6700 1 -- 172.21.15.26:0/3412623433 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4680135e50 msgr2=0x7f46801c8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:46.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.837+0000 7f4687ed6700 1 --2- 172.21.15.26:0/3412623433 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4680135e50 0x7f46801c8ee0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4678009ea0 tx=0x7f467800c3a0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.837+0000 7f4687ed6700 1 -- 172.21.15.26:0/3412623433 shutdown_connections 2023-10-01T07:57:46.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.837+0000 7f4687ed6700 1 --2- 172.21.15.26:0/3412623433 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4680135e50 0x7f46801c8ee0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.837+0000 7f4687ed6700 1 --2- 172.21.15.26:0/3412623433 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f468009d6f0 0x7f46801c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.837+0000 7f4687ed6700 1 --2- 172.21.15.26:0/3412623433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f468009e1d0 0x7f46801c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:46.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.837+0000 7f4687ed6700 1 -- 172.21.15.26:0/3412623433 >> 172.21.15.26:0/3412623433 conn(0x7f4680066f50 msgr2=0x7f468006f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:46.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.837+0000 7f4687ed6700 1 -- 172.21.15.26:0/3412623433 shutdown_connections 2023-10-01T07:57:46.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:46.837+0000 7f4687ed6700 1 -- 172.21.15.26:0/3412623433 wait complete. 2023-10-01T07:57:46.851 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:47.656 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:47.682 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:47.777 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:47.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.804+0000 7faacfbe4700 1 Processor -- start 2023-10-01T07:57:47.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.804+0000 7faacfbe4700 1 -- start start 2023-10-01T07:57:47.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.805+0000 7faacfbe4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7faac812cf60 0x7faac806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:47.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.805+0000 7faacfbe4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faac8130430 0x7faac8137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:47.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.805+0000 7faacfbe4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac812cd90 con 0x7faac812f8b0 2023-10-01T07:57:47.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.805+0000 7faacfbe4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac812d330 con 0x7faac812cf60 2023-10-01T07:57:47.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.805+0000 7faacfbe4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faac8071780 con 0x7faac8130430 2023-10-01T07:57:47.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.805+0000 7faacd980700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7faac812cf60 0x7faac806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:47.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.805+0000 7faacd980700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7faac812cf60 0x7faac806f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34424/0 (socket says 172.21.15.26:34424) 2023-10-01T07:57:47.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.805+0000 7faacd980700 1 -- 172.21.15.26:0/624233078 learned_addr learned my addr 172.21.15.26:0/624233078 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:47.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.805+0000 7faace181700 1 --2- 172.21.15.26:0/624233078 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faac8130430 0x7faac8137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:47.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.806+0000 7faacd980700 1 -- 172.21.15.26:0/624233078 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faac8130430 msgr2=0x7faac8137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:47.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.806+0000 7faacd980700 1 --2- 172.21.15.26:0/624233078 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faac8130430 0x7faac8137c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:47.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.806+0000 7faacd980700 1 -- 172.21.15.26:0/624233078 >> v1:172.21.15.26:6789/0 conn(0x7faac812f8b0 legacy=0x7faac812fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:47.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.806+0000 7faacd980700 1 -- 172.21.15.26:0/624233078 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac8071a40 con 0x7faac812cf60 2023-10-01T07:57:47.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.806+0000 7faacd980700 1 --2- 172.21.15.26:0/624233078 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac812cf60 0x7faac806f5d0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7faac400bbc0 tx=0x7faac400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b43311e038ebd26d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:47.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.806+0000 7faace181700 1 --2- 172.21.15.26:0/624233078 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faac8130430 0x7faac8137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:47.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.806+0000 7faacc97e700 1 -- 172.21.15.26:0/624233078 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac400dcf0 con 0x7faac812cf60 2023-10-01T07:57:47.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.806+0000 7faacc97e700 1 -- 172.21.15.26:0/624233078 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac400de50 con 0x7faac812cf60 2023-10-01T07:57:47.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.806+0000 7faacc97e700 1 -- 172.21.15.26:0/624233078 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac4010670 con 0x7faac812cf60 2023-10-01T07:57:47.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.807+0000 7faacfbe4700 1 -- 172.21.15.26:0/624233078 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac812cf60 msgr2=0x7faac806f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:47.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.807+0000 7faacfbe4700 1 --2- 172.21.15.26:0/624233078 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac812cf60 0x7faac806f5d0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7faac400bbc0 tx=0x7faac400bed0 comp rx=0 tx=0).stop 2023-10-01T07:57:47.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.807+0000 7faacfbe4700 1 -- 172.21.15.26:0/624233078 shutdown_connections 2023-10-01T07:57:47.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.807+0000 7faacfbe4700 1 --2- 172.21.15.26:0/624233078 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faac8130430 0x7faac8137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:47.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.807+0000 7faacfbe4700 1 --2- 172.21.15.26:0/624233078 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac812cf60 0x7faac806f5d0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:47.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.807+0000 7faacfbe4700 1 -- 172.21.15.26:0/624233078 >> 172.21.15.26:0/624233078 conn(0x7faac80a2aa0 msgr2=0x7faac80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:47.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.807+0000 7faacfbe4700 1 -- 172.21.15.26:0/624233078 shutdown_connections 2023-10-01T07:57:47.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.807+0000 7faacfbe4700 1 -- 172.21.15.26:0/624233078 wait complete. 2023-10-01T07:57:47.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.808+0000 7faacfbe4700 1 Processor -- start 2023-10-01T07:57:47.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.808+0000 7faacfbe4700 1 -- start start 2023-10-01T07:57:47.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.809+0000 7faacfbe4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac812cf60 0x7faac81c4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:47.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.809+0000 7faacfbe4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faac812f8b0 0x7faac81c4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:47.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.809+0000 7faacfbe4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faac8130430 0x7faac81c4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:47.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.809+0000 7faacfbe4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac809e9d0 con 0x7faac812cf60 2023-10-01T07:57:47.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.809+0000 7faacfbe4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac809ccc0 con 0x7faac812f8b0 2023-10-01T07:57:47.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.809+0000 7faacfbe4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faac812f680 con 0x7faac8130430 2023-10-01T07:57:47.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.809+0000 7faacd17f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faac812f8b0 0x7faac81c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:47.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.809+0000 7faacd17f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faac812f8b0 0x7faac81c4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:49348/0 (socket says 172.21.15.26:49348) 2023-10-01T07:57:47.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.809+0000 7faacd17f700 1 -- 172.21.15.26:0/3255105599 learned_addr learned my addr 172.21.15.26:0/3255105599 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:47.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.809+0000 7faacd980700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac812cf60 0x7faac81c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:47.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.809+0000 7faace181700 1 --2- 172.21.15.26:0/3255105599 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faac8130430 0x7faac81c4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:47.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.809+0000 7faacd980700 1 -- 172.21.15.26:0/3255105599 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faac8130430 msgr2=0x7faac81c4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:47.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.809+0000 7faacd980700 1 --2- 172.21.15.26:0/3255105599 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faac8130430 0x7faac81c4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:47.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.809+0000 7faacd980700 1 -- 172.21.15.26:0/3255105599 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faac812f8b0 msgr2=0x7faac81c4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:47.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.809+0000 7faacd980700 1 --2- 172.21.15.26:0/3255105599 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faac812f8b0 0x7faac81c4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:47.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.809+0000 7faacd980700 1 -- 172.21.15.26:0/3255105599 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac0009a70 con 0x7faac812cf60 2023-10-01T07:57:47.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.809+0000 7faacd17f700 1 --2- 172.21.15.26:0/3255105599 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faac812f8b0 0x7faac81c4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:47.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.810+0000 7faacd980700 1 --2- 172.21.15.26:0/3255105599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac812cf60 0x7faac81c4020 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7faac4018000 tx=0x7faac4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:47.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.810+0000 7faabe7fc700 1 -- 172.21.15.26:0/3255105599 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac4003ab0 con 0x7faac812cf60 2023-10-01T07:57:47.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.810+0000 7faabe7fc700 1 -- 172.21.15.26:0/3255105599 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac4003c10 con 0x7faac812cf60 2023-10-01T07:57:47.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.810+0000 7faacfbe4700 1 -- 172.21.15.26:0/3255105599 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac400b7f0 con 0x7faac812cf60 2023-10-01T07:57:47.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.810+0000 7faabe7fc700 1 -- 172.21.15.26:0/3255105599 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac4010470 con 0x7faac812cf60 2023-10-01T07:57:47.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.810+0000 7faacfbe4700 1 -- 172.21.15.26:0/3255105599 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac809d4b0 con 0x7faac812cf60 2023-10-01T07:57:47.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.811+0000 7faabe7fc700 1 -- 172.21.15.26:0/3255105599 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faac402c430 con 0x7faac812cf60 2023-10-01T07:57:47.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.811+0000 7faacfbe4700 1 -- 172.21.15.26:0/3255105599 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac8074ea0 con 0x7faac812cf60 2023-10-01T07:57:47.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.811+0000 7faabe7fc700 1 -- 172.21.15.26:0/3255105599 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faac4040fa0 con 0x7faac812cf60 2023-10-01T07:57:47.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.820+0000 7faabe7fc700 1 -- 172.21.15.26:0/3255105599 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faac4021980 con 0x7faac812cf60 2023-10-01T07:57:47.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.847+0000 7f2b2b685700 1 Processor -- start 2023-10-01T07:57:47.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.847+0000 7f2b2b685700 1 -- start start 2023-10-01T07:57:47.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.847+0000 7f2b2b685700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2b24133a80 0x7f2b24133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:47.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.847+0000 7f2b2b685700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b2412ff20 0x7f2b24130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:47.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.847+0000 7f2b2b685700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b2406bc00 con 0x7f2b24130870 2023-10-01T07:57:47.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.847+0000 7f2b2b685700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b2406c570 con 0x7f2b24133a80 2023-10-01T07:57:47.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.847+0000 7f2b2b685700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b240a0040 con 0x7f2b2412ff20 2023-10-01T07:57:47.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.848+0000 7f2b28c20700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b2412ff20 0x7f2b24130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:47.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.848+0000 7f2b28c20700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b2412ff20 0x7f2b24130330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:49352/0 (socket says 172.21.15.26:49352) 2023-10-01T07:57:47.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.848+0000 7f2b28c20700 1 -- 172.21.15.26:0/1489295220 learned_addr learned my addr 172.21.15.26:0/1489295220 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:47.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.848+0000 7f2b29421700 1 --2- 172.21.15.26:0/1489295220 >> v2:172.21.15.26:3300/0 conn(0x7f2b24133a80 0x7f2b24133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:47.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.848+0000 7f2b29421700 1 -- 172.21.15.26:0/1489295220 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b2412ff20 msgr2=0x7f2b24130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:47.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.848+0000 7f2b29421700 1 --2- 172.21.15.26:0/1489295220 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b2412ff20 0x7f2b24130330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:47.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.848+0000 7f2b29421700 1 -- 172.21.15.26:0/1489295220 >> v1:172.21.15.26:6789/0 conn(0x7f2b24130870 legacy=0x7f2b2413a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:47.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.848+0000 7f2b29421700 1 -- 172.21.15.26:0/1489295220 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b24133860 con 0x7f2b24133a80 2023-10-01T07:57:47.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.848+0000 7f2b1bfff700 1 -- 172.21.15.26:0/1489295220 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3422039178 0 0) 0x7f2b2406bc00 con 0x7f2b24130870 2023-10-01T07:57:47.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.848+0000 7f2b28c20700 1 --2- 172.21.15.26:0/1489295220 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b2412ff20 0x7f2b24130330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:47.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.848+0000 7f2b29421700 1 --2- 172.21.15.26:0/1489295220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b24133a80 0x7f2b24133e50 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f2b20009840 tx=0x7f2b20009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c2a4684664ee067 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:47.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.849+0000 7f2b1bfff700 1 -- 172.21.15.26:0/1489295220 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b20011830 con 0x7f2b24133a80 2023-10-01T07:57:47.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.849+0000 7f2b1bfff700 1 -- 172.21.15.26:0/1489295220 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b20011990 con 0x7f2b24133a80 2023-10-01T07:57:47.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.849+0000 7f2b1bfff700 1 -- 172.21.15.26:0/1489295220 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b20011d20 con 0x7f2b24133a80 2023-10-01T07:57:47.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.849+0000 7f2b2b685700 1 -- 172.21.15.26:0/1489295220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b24133a80 msgr2=0x7f2b24133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:47.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.849+0000 7f2b2b685700 1 --2- 172.21.15.26:0/1489295220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b24133a80 0x7f2b24133e50 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f2b20009840 tx=0x7f2b20009b50 comp rx=0 tx=0).stop 2023-10-01T07:57:47.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.849+0000 7f2b2b685700 1 -- 172.21.15.26:0/1489295220 shutdown_connections 2023-10-01T07:57:47.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.849+0000 7f2b2b685700 1 --2- 172.21.15.26:0/1489295220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b24133a80 0x7f2b24133e50 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:47.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.849+0000 7f2b2b685700 1 --2- 172.21.15.26:0/1489295220 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b2412ff20 0x7f2b24130330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:47.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.849+0000 7f2b2b685700 1 -- 172.21.15.26:0/1489295220 >> 172.21.15.26:0/1489295220 conn(0x7f2b240a4210 msgr2=0x7f2b240a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:47.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.850+0000 7f2b2b685700 1 -- 172.21.15.26:0/1489295220 shutdown_connections 2023-10-01T07:57:47.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.850+0000 7f2b2b685700 1 -- 172.21.15.26:0/1489295220 wait complete. 2023-10-01T07:57:47.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.850+0000 7f2b2b685700 1 Processor -- start 2023-10-01T07:57:47.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.851+0000 7f2b2b685700 1 -- start start 2023-10-01T07:57:47.852 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:47.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.851+0000 7f2b2b685700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b2412ff20 0x7f2b2409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:47.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.851+0000 7f2b2b685700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2b24130870 0x7f2b2409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:47.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.851+0000 7f2b2b685700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b24133a80 0x7f2b2409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:47.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.851+0000 7f2b2b685700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2409deb0 con 0x7f2b2412ff20 2023-10-01T07:57:47.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.851+0000 7f2b2b685700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2411fb20 con 0x7f2b24133a80 2023-10-01T07:57:47.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.851+0000 7f2b2b685700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b241201a0 con 0x7f2b24130870 2023-10-01T07:57:47.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.851+0000 7f2b29421700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b2412ff20 0x7f2b2409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:47.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.851+0000 7f2b29421700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b2412ff20 0x7f2b2409c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34452/0 (socket says 172.21.15.26:34452) 2023-10-01T07:57:47.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.852+0000 7f2b29421700 1 -- 172.21.15.26:0/2998626035 learned_addr learned my addr 172.21.15.26:0/2998626035 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:47.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.852+0000 7f2b28c20700 1 --2- 172.21.15.26:0/2998626035 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2b24130870 0x7f2b2409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:47.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.852+0000 7f2b29c22700 1 --2- 172.21.15.26:0/2998626035 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b24133a80 0x7f2b2409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:47.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.852+0000 7f2b29421700 1 -- 172.21.15.26:0/2998626035 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2b24130870 msgr2=0x7f2b2409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:47.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.852+0000 7f2b29421700 1 --2- 172.21.15.26:0/2998626035 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2b24130870 0x7f2b2409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:47.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.852+0000 7f2b29421700 1 -- 172.21.15.26:0/2998626035 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b24133a80 msgr2=0x7f2b2409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:47.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.852+0000 7f2b29421700 1 --2- 172.21.15.26:0/2998626035 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b24133a80 0x7f2b2409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:47.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.852+0000 7f2b29421700 1 -- 172.21.15.26:0/2998626035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b14009550 con 0x7f2b2412ff20 2023-10-01T07:57:47.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.852+0000 7f2b29421700 1 --2- 172.21.15.26:0/2998626035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b2412ff20 0x7f2b2409c480 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f2b20009fd0 tx=0x7f2b20004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:47.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.852+0000 7f2b19ffb700 1 -- 172.21.15.26:0/2998626035 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b200036a0 con 0x7f2b2412ff20 2023-10-01T07:57:47.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.852+0000 7f2b19ffb700 1 -- 172.21.15.26:0/2998626035 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2001f070 con 0x7f2b2412ff20 2023-10-01T07:57:47.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.852+0000 7f2b2b685700 1 -- 172.21.15.26:0/2998626035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b200094a0 con 0x7f2b2412ff20 2023-10-01T07:57:47.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.852+0000 7f2b19ffb700 1 -- 172.21.15.26:0/2998626035 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b20003a60 con 0x7f2b2412ff20 2023-10-01T07:57:47.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.853+0000 7f2b2b685700 1 -- 172.21.15.26:0/2998626035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b2411f420 con 0x7f2b2412ff20 2023-10-01T07:57:47.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.854+0000 7f2b19ffb700 1 -- 172.21.15.26:0/2998626035 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2b20003bc0 con 0x7f2b2412ff20 2023-10-01T07:57:47.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.854+0000 7f2b19ffb700 1 -- 172.21.15.26:0/2998626035 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2b20021070 con 0x7f2b2412ff20 2023-10-01T07:57:47.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.854+0000 7f2b2b685700 1 -- 172.21.15.26:0/2998626035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b24120910 con 0x7f2b2412ff20 2023-10-01T07:57:47.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.859+0000 7f2b19ffb700 1 -- 172.21.15.26:0/2998626035 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2b200253e0 con 0x7f2b2412ff20 2023-10-01T07:57:47.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.932+0000 7f58309b3700 1 Processor -- start 2023-10-01T07:57:47.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.932+0000 7f58309b3700 1 -- start start 2023-10-01T07:57:47.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.933+0000 7f58309b3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f582c0a0a30 0x7f582c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:47.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.934+0000 7f58309b3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f582c138d80 0x7f582c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:47.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.934+0000 7f58309b3700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582c0a2a70 con 0x7f582c09d630 2023-10-01T07:57:47.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.934+0000 7f58309b3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f582c0a01d0 con 0x7f582c0a0a30 2023-10-01T07:57:47.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.934+0000 7f58309b3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582c09e2b0 con 0x7f582c138d80 2023-10-01T07:57:47.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.934+0000 7f582ad9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f582c138d80 0x7f582c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:47.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.934+0000 7f582a59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f582c0a0a30 0x7f582c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:47.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.934+0000 7f582ad9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f582c138d80 0x7f582c13b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:49370/0 (socket says 172.21.15.26:49370) 2023-10-01T07:57:47.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.934+0000 7f582a59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f582c0a0a30 0x7f582c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34460/0 (socket says 172.21.15.26:34460) 2023-10-01T07:57:47.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.934+0000 7f582ad9d700 1 -- 172.21.15.26:0/2651978488 learned_addr learned my addr 172.21.15.26:0/2651978488 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:47.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.934+0000 7f582a59c700 1 -- 172.21.15.26:0/2651978488 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f582c138d80 msgr2=0x7f582c13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:47.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.934+0000 7f582a59c700 1 --2- 172.21.15.26:0/2651978488 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f582c138d80 0x7f582c13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:47.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.934+0000 7f582a59c700 1 -- 172.21.15.26:0/2651978488 >> v1:172.21.15.26:6789/0 conn(0x7f582c09d630 legacy=0x7f582c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:47.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.934+0000 7f582959a700 1 -- 172.21.15.26:0/2651978488 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638208293 0 0) 0x7f582c0a2a70 con 0x7f582c09d630 2023-10-01T07:57:47.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.934+0000 7f582a59c700 1 -- 172.21.15.26:0/2651978488 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582c09dc50 con 0x7f582c0a0a30 2023-10-01T07:57:47.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.935+0000 7f582a59c700 1 --2- 172.21.15.26:0/2651978488 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f582c0a0a30 0x7f582c0a0e00 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f581c009840 tx=0x7f581c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65450d229bb02398 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:47.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.935+0000 7f582959a700 1 -- 172.21.15.26:0/2651978488 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c011830 con 0x7f582c0a0a30 2023-10-01T07:57:47.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.935+0000 7f582959a700 1 -- 172.21.15.26:0/2651978488 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581c011990 con 0x7f582c0a0a30 2023-10-01T07:57:47.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.935+0000 7f582959a700 1 -- 172.21.15.26:0/2651978488 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c011d20 con 0x7f582c0a0a30 2023-10-01T07:57:47.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.936+0000 7f58309b3700 1 -- 172.21.15.26:0/2651978488 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f582c0a0a30 msgr2=0x7f582c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:47.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.936+0000 7f58309b3700 1 --2- 172.21.15.26:0/2651978488 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f582c0a0a30 0x7f582c0a0e00 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f581c009840 tx=0x7f581c009b50 comp rx=0 tx=0).stop 2023-10-01T07:57:47.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.936+0000 7f58309b3700 1 -- 172.21.15.26:0/2651978488 shutdown_connections 2023-10-01T07:57:47.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.936+0000 7f58309b3700 1 --2- 172.21.15.26:0/2651978488 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f582c0a0a30 0x7f582c0a0e00 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:47.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.936+0000 7f58309b3700 1 --2- 172.21.15.26:0/2651978488 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f582c138d80 0x7f582c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:47.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.936+0000 7f58309b3700 1 -- 172.21.15.26:0/2651978488 >> 172.21.15.26:0/2651978488 conn(0x7f582c0a3050 msgr2=0x7f582c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:47.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.936+0000 7f58309b3700 1 -- 172.21.15.26:0/2651978488 shutdown_connections 2023-10-01T07:57:47.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.936+0000 7f58309b3700 1 -- 172.21.15.26:0/2651978488 wait complete. 2023-10-01T07:57:47.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.937+0000 7f58309b3700 1 Processor -- start 2023-10-01T07:57:47.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.938+0000 7f58309b3700 1 -- start start 2023-10-01T07:57:47.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.938+0000 7f58309b3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f582c09d630 0x7f582c12c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:47.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.938+0000 7f58309b3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f582c0a0a30 0x7f582c12ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:47.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.938+0000 7f582a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f582c09d630 0x7f582c12c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:47.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.938+0000 7f582a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f582c09d630 0x7f582c12c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34466/0 (socket says 172.21.15.26:34466) 2023-10-01T07:57:47.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.938+0000 7f58309b3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f582c138d80 0x7f582c12d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:47.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.938+0000 7f58309b3700 1 -- 172.21.15.26:0/3289210815 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c130220 con 0x7f582c09d630 2023-10-01T07:57:47.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.938+0000 7f582a59c700 1 -- 172.21.15.26:0/3289210815 learned_addr learned my addr 172.21.15.26:0/3289210815 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:47.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.938+0000 7f58309b3700 1 -- 172.21.15.26:0/3289210815 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582c12e470 con 0x7f582c0a0a30 2023-10-01T07:57:47.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.938+0000 7f58309b3700 1 -- 172.21.15.26:0/3289210815 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f582c12fba0 con 0x7f582c138d80 2023-10-01T07:57:47.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.939+0000 7f5829d9b700 1 --2- 172.21.15.26:0/3289210815 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f582c0a0a30 0x7f582c12ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:47.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.939+0000 7f582ad9d700 1 --2- 172.21.15.26:0/3289210815 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f582c138d80 0x7f582c12d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:47.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.939+0000 7f582a59c700 1 -- 172.21.15.26:0/3289210815 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f582c138d80 msgr2=0x7f582c12d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:47.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.939+0000 7f582a59c700 1 --2- 172.21.15.26:0/3289210815 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f582c138d80 0x7f582c12d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:47.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.939+0000 7f582a59c700 1 -- 172.21.15.26:0/3289210815 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f582c0a0a30 msgr2=0x7f582c12ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:47.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.939+0000 7f582a59c700 1 --2- 172.21.15.26:0/3289210815 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f582c0a0a30 0x7f582c12ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:47.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.939+0000 7f582a59c700 1 -- 172.21.15.26:0/3289210815 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f581c0094a0 con 0x7f582c09d630 2023-10-01T07:57:47.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.939+0000 7f582a59c700 1 --2- 172.21.15.26:0/3289210815 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f582c09d630 0x7f582c12c7b0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f581c009fd0 tx=0x7f581c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:47.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.939+0000 7f581affd700 1 -- 172.21.15.26:0/3289210815 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c0043c0 con 0x7f582c09d630 2023-10-01T07:57:47.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.939+0000 7f581affd700 1 -- 172.21.15.26:0/3289210815 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581c01f070 con 0x7f582c09d630 2023-10-01T07:57:47.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.939+0000 7f58309b3700 1 -- 172.21.15.26:0/3289210815 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f582c12fe60 con 0x7f582c09d630 2023-10-01T07:57:47.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.939+0000 7f581affd700 1 -- 172.21.15.26:0/3289210815 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c0036a0 con 0x7f582c09d630 2023-10-01T07:57:47.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.940+0000 7f58309b3700 1 -- 172.21.15.26:0/3289210815 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f582c1308d0 con 0x7f582c09d630 2023-10-01T07:57:47.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.940+0000 7f581affd700 1 -- 172.21.15.26:0/3289210815 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f581c021030 con 0x7f582c09d630 2023-10-01T07:57:47.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.941+0000 7f581affd700 1 -- 172.21.15.26:0/3289210815 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f581c040930 con 0x7f582c09d630 2023-10-01T07:57:47.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.941+0000 7f58309b3700 1 -- 172.21.15.26:0/3289210815 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f582c0747f0 con 0x7f582c09d630 2023-10-01T07:57:47.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:47.950+0000 7f581affd700 1 -- 172.21.15.26:0/3289210815 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f581c023790 con 0x7f582c09d630 2023-10-01T07:57:48.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.026+0000 7f51c47cd700 1 Processor -- start 2023-10-01T07:57:48.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.026+0000 7f51c47cd700 1 -- start start 2023-10-01T07:57:48.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.027+0000 7f51c47cd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f51bc0a0a30 0x7f51bc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:48.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.027+0000 7f51c47cd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f51bc0a1340 0x7f51bc133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:48.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.027+0000 7f51c47cd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f51bc133fa0 0x7f51bc134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:48.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.027+0000 7f51c47cd700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51bc09edd0 con 0x7f51bc0a0a30 2023-10-01T07:57:48.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.027+0000 7f51c47cd700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc09e1f0 con 0x7f51bc133fa0 2023-10-01T07:57:48.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.027+0000 7f51c47cd700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc09dc50 con 0x7f51bc0a1340 2023-10-01T07:57:48.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.027+0000 7f51c2d6a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f51bc133fa0 0x7f51bc134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:48.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.027+0000 7f51c2569700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f51bc0a0a30 0x7f51bc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:48.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.027+0000 7f51c1d68700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f51bc0a1340 0x7f51bc133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:48.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.027+0000 7f51c2569700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f51bc0a0a30 0x7f51bc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34476/0 (socket says 172.21.15.26:34476) 2023-10-01T07:57:48.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.027+0000 7f51c2d6a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f51bc133fa0 0x7f51bc134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:49388/0 (socket says 172.21.15.26:49388) 2023-10-01T07:57:48.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.027+0000 7f51c2569700 1 -- 172.21.15.26:0/1524795919 learned_addr learned my addr 172.21.15.26:0/1524795919 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:48.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.028+0000 7f51c2569700 1 -- 172.21.15.26:0/1524795919 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f51bc0a1340 msgr2=0x7f51bc133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:48.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.028+0000 7f51c2569700 1 --2- 172.21.15.26:0/1524795919 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f51bc0a1340 0x7f51bc133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:48.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.028+0000 7f51c2569700 1 -- 172.21.15.26:0/1524795919 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f51bc133fa0 msgr2=0x7f51bc134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:48.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.028+0000 7f51c2569700 1 --2- 172.21.15.26:0/1524795919 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f51bc133fa0 0x7f51bc134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:48.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.028+0000 7f51c2569700 1 -- 172.21.15.26:0/1524795919 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51bc0a1fe0 con 0x7f51bc0a0a30 2023-10-01T07:57:48.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.028+0000 7f51c2d6a700 1 --2- 172.21.15.26:0/1524795919 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f51bc133fa0 0x7f51bc134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:48.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.028+0000 7f51c2569700 1 --2- 172.21.15.26:0/1524795919 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51bc0a0a30 0x7f51bc0a0e00 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f51b80098f0 tx=0x7f51b8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573b20f578f6878a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:48.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.028+0000 7f51c1567700 1 -- 172.21.15.26:0/1524795919 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b8011830 con 0x7f51bc0a0a30 2023-10-01T07:57:48.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.028+0000 7f51c1567700 1 -- 172.21.15.26:0/1524795919 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b8011990 con 0x7f51bc0a0a30 2023-10-01T07:57:48.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.028+0000 7f51c1567700 1 -- 172.21.15.26:0/1524795919 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b8011d20 con 0x7f51bc0a0a30 2023-10-01T07:57:48.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.029+0000 7f51c47cd700 1 -- 172.21.15.26:0/1524795919 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51bc0a0a30 msgr2=0x7f51bc0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:48.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.029+0000 7f51c47cd700 1 --2- 172.21.15.26:0/1524795919 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51bc0a0a30 0x7f51bc0a0e00 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f51b80098f0 tx=0x7f51b8009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:48.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.029+0000 7f51c47cd700 1 -- 172.21.15.26:0/1524795919 shutdown_connections 2023-10-01T07:57:48.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.029+0000 7f51c47cd700 1 --2- 172.21.15.26:0/1524795919 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f51bc133fa0 0x7f51bc134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:48.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.029+0000 7f51c47cd700 1 --2- 172.21.15.26:0/1524795919 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51bc0a0a30 0x7f51bc0a0e00 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:48.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.029+0000 7f51c47cd700 1 --2- 172.21.15.26:0/1524795919 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f51bc0a1340 0x7f51bc133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:48.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.029+0000 7f51c47cd700 1 -- 172.21.15.26:0/1524795919 >> 172.21.15.26:0/1524795919 conn(0x7f51bc0a6550 msgr2=0x7f51bc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:48.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.030+0000 7f51c47cd700 1 -- 172.21.15.26:0/1524795919 shutdown_connections 2023-10-01T07:57:48.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.030+0000 7f51c47cd700 1 -- 172.21.15.26:0/1524795919 wait complete. 2023-10-01T07:57:48.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.031+0000 7f51c47cd700 1 Processor -- start 2023-10-01T07:57:48.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.031+0000 7f51c47cd700 1 -- start start 2023-10-01T07:57:48.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.032+0000 7f51c47cd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f51bc0a0a30 0x7f51bc120400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:48.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.032+0000 7f51c47cd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51bc0a1340 0x7f51bc120940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:48.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.032+0000 7f51c47cd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f51bc133fa0 0x7f51bc120e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:48.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.032+0000 7f51c47cd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc1337a0 con 0x7f51bc0a1340 2023-10-01T07:57:48.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.032+0000 7f51c47cd700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc123210 con 0x7f51bc133fa0 2023-10-01T07:57:48.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.032+0000 7f51c47cd700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc123bf0 con 0x7f51bc0a0a30 2023-10-01T07:57:48.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.032+0000 7f51c2d6a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f51bc133fa0 0x7f51bc120e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:48.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.032+0000 7f51c2569700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f51bc0a0a30 0x7f51bc120400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:48.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.032+0000 7f51c2d6a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f51bc133fa0 0x7f51bc120e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:49390/0 (socket says 172.21.15.26:49390) 2023-10-01T07:57:48.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.032+0000 7f51c2d6a700 1 -- 172.21.15.26:0/743047057 learned_addr learned my addr 172.21.15.26:0/743047057 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:48.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.032+0000 7f51c1d68700 1 --2- 172.21.15.26:0/743047057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51bc0a1340 0x7f51bc120940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:48.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.032+0000 7f51c2569700 1 -- 172.21.15.26:0/743047057 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f51bc133fa0 msgr2=0x7f51bc120e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:48.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.032+0000 7f51c2569700 1 --2- 172.21.15.26:0/743047057 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f51bc133fa0 0x7f51bc120e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:48.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.032+0000 7f51c2569700 1 -- 172.21.15.26:0/743047057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51bc0a1340 msgr2=0x7f51bc120940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:48.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.032+0000 7f51c2569700 1 --2- 172.21.15.26:0/743047057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51bc0a1340 0x7f51bc120940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:48.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.033+0000 7f51c2569700 1 -- 172.21.15.26:0/743047057 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b4009a70 con 0x7f51bc0a0a30 2023-10-01T07:57:48.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.033+0000 7f51c2569700 1 --2- 172.21.15.26:0/743047057 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f51bc0a0a30 0x7f51bc120400 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f51b80098f0 tx=0x7f51b8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:48.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.033+0000 7f51b2ffd700 1 -- 172.21.15.26:0/743047057 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b8004240 con 0x7f51bc0a0a30 2023-10-01T07:57:48.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.033+0000 7f51b2ffd700 1 -- 172.21.15.26:0/743047057 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b801f070 con 0x7f51bc0a0a30 2023-10-01T07:57:48.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.033+0000 7f51c47cd700 1 -- 172.21.15.26:0/743047057 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b8009550 con 0x7f51bc0a0a30 2023-10-01T07:57:48.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.033+0000 7f51b2ffd700 1 -- 172.21.15.26:0/743047057 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b80045a0 con 0x7f51bc0a0a30 2023-10-01T07:57:48.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.033+0000 7f51c47cd700 1 -- 172.21.15.26:0/743047057 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51bc0a3410 con 0x7f51bc0a0a30 2023-10-01T07:57:48.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.034+0000 7f51b2ffd700 1 -- 172.21.15.26:0/743047057 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f51b8021030 con 0x7f51bc0a0a30 2023-10-01T07:57:48.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.034+0000 7f51b2ffd700 1 -- 172.21.15.26:0/743047057 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f51b8040910 con 0x7f51bc0a0a30 2023-10-01T07:57:48.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.035+0000 7f51b0ff9700 1 -- 172.21.15.26:0/743047057 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51980052e0 con 0x7f51bc0a0a30 2023-10-01T07:57:48.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.044+0000 7f51b2ffd700 1 -- 172.21.15.26:0/743047057 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f51b801a450 con 0x7f51bc0a0a30 2023-10-01T07:57:48.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.052+0000 7faacfbe4700 1 -- 172.21.15.26:0/3255105599 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faac809e7c0 con 0x7faac812cf60 2023-10-01T07:57:48.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.053+0000 7faabe7fc700 1 -- 172.21.15.26:0/3255105599 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faac4021390 con 0x7faac812cf60 2023-10-01T07:57:48.075 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:48.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.056+0000 7faacfbe4700 1 -- 172.21.15.26:0/3255105599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac812cf60 msgr2=0x7faac81c4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:48.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.056+0000 7faacfbe4700 1 --2- 172.21.15.26:0/3255105599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac812cf60 0x7faac81c4020 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7faac4018000 tx=0x7faac4004750 comp rx=0 tx=0).stop 2023-10-01T07:57:48.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.056+0000 7faacfbe4700 1 -- 172.21.15.26:0/3255105599 shutdown_connections 2023-10-01T07:57:48.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.056+0000 7faacfbe4700 1 --2- 172.21.15.26:0/3255105599 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faac8130430 0x7faac81c4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:48.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.056+0000 7faacfbe4700 1 --2- 172.21.15.26:0/3255105599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac812cf60 0x7faac81c4020 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:48.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.056+0000 7faacfbe4700 1 --2- 172.21.15.26:0/3255105599 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faac812f8b0 0x7faac81c4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:48.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.056+0000 7faacfbe4700 1 -- 172.21.15.26:0/3255105599 >> 172.21.15.26:0/3255105599 conn(0x7faac80a2aa0 msgr2=0x7faac806e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:48.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.056+0000 7faacfbe4700 1 -- 172.21.15.26:0/3255105599 shutdown_connections 2023-10-01T07:57:48.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.056+0000 7faacfbe4700 1 -- 172.21.15.26:0/3255105599 wait complete. 2023-10-01T07:57:48.077 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:48.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.086+0000 7f2b2b685700 1 -- 172.21.15.26:0/2998626035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2b2411fd40 con 0x7f2b2412ff20 2023-10-01T07:57:48.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.086+0000 7f2b19ffb700 1 -- 172.21.15.26:0/2998626035 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2b20015020 con 0x7f2b2412ff20 2023-10-01T07:57:48.087 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:48.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.089+0000 7f2b2b685700 1 -- 172.21.15.26:0/2998626035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b2412ff20 msgr2=0x7f2b2409c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:48.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.089+0000 7f2b2b685700 1 --2- 172.21.15.26:0/2998626035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b2412ff20 0x7f2b2409c480 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f2b20009fd0 tx=0x7f2b20004750 comp rx=0 tx=0).stop 2023-10-01T07:57:48.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.089+0000 7f2b2b685700 1 -- 172.21.15.26:0/2998626035 shutdown_connections 2023-10-01T07:57:48.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.089+0000 7f2b2b685700 1 --2- 172.21.15.26:0/2998626035 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b24133a80 0x7f2b2409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:48.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.089+0000 7f2b2b685700 1 --2- 172.21.15.26:0/2998626035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b2412ff20 0x7f2b2409c480 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:48.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.089+0000 7f2b2b685700 1 --2- 172.21.15.26:0/2998626035 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2b24130870 0x7f2b2409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:48.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.089+0000 7f2b2b685700 1 -- 172.21.15.26:0/2998626035 >> 172.21.15.26:0/2998626035 conn(0x7f2b240a4210 msgr2=0x7f2b2409e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:48.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.089+0000 7f2b2b685700 1 -- 172.21.15.26:0/2998626035 shutdown_connections 2023-10-01T07:57:48.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.089+0000 7f2b2b685700 1 -- 172.21.15.26:0/2998626035 wait complete. 2023-10-01T07:57:48.104 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:48.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.174+0000 7f58309b3700 1 -- 172.21.15.26:0/3289210815 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f582c072980 con 0x7f582c09d630 2023-10-01T07:57:48.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.175+0000 7f581affd700 1 -- 172.21.15.26:0/3289210815 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f581c015020 con 0x7f582c09d630 2023-10-01T07:57:48.175 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:48.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.177+0000 7f58309b3700 1 -- 172.21.15.26:0/3289210815 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f582c09d630 msgr2=0x7f582c12c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:48.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.177+0000 7f58309b3700 1 --2- 172.21.15.26:0/3289210815 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f582c09d630 0x7f582c12c7b0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f581c009fd0 tx=0x7f581c004750 comp rx=0 tx=0).stop 2023-10-01T07:57:48.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.177+0000 7f58309b3700 1 -- 172.21.15.26:0/3289210815 shutdown_connections 2023-10-01T07:57:48.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.177+0000 7f58309b3700 1 --2- 172.21.15.26:0/3289210815 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f582c138d80 0x7f582c12d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:48.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.177+0000 7f58309b3700 1 --2- 172.21.15.26:0/3289210815 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f582c09d630 0x7f582c12c7b0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:48.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.177+0000 7f58309b3700 1 --2- 172.21.15.26:0/3289210815 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f582c0a0a30 0x7f582c12ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:48.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.177+0000 7f58309b3700 1 -- 172.21.15.26:0/3289210815 >> 172.21.15.26:0/3289210815 conn(0x7f582c0a3050 msgr2=0x7f582c09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:48.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.177+0000 7f58309b3700 1 -- 172.21.15.26:0/3289210815 shutdown_connections 2023-10-01T07:57:48.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.177+0000 7f58309b3700 1 -- 172.21.15.26:0/3289210815 wait complete. 2023-10-01T07:57:48.191 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:48.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.263+0000 7f51b0ff9700 1 -- 172.21.15.26:0/743047057 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5198005590 con 0x7f51bc0a0a30 2023-10-01T07:57:48.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.264+0000 7f51b2ffd700 1 -- 172.21.15.26:0/743047057 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f51b801b430 con 0x7f51bc0a0a30 2023-10-01T07:57:48.265 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:48.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.266+0000 7f51b0ff9700 1 -- 172.21.15.26:0/743047057 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f51bc0a0a30 msgr2=0x7f51bc120400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:48.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.266+0000 7f51b0ff9700 1 --2- 172.21.15.26:0/743047057 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f51bc0a0a30 0x7f51bc120400 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f51b80098f0 tx=0x7f51b8004750 comp rx=0 tx=0).stop 2023-10-01T07:57:48.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.266+0000 7f51b0ff9700 1 -- 172.21.15.26:0/743047057 shutdown_connections 2023-10-01T07:57:48.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.266+0000 7f51b0ff9700 1 --2- 172.21.15.26:0/743047057 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f51bc133fa0 0x7f51bc120e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:48.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.266+0000 7f51b0ff9700 1 --2- 172.21.15.26:0/743047057 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f51bc0a0a30 0x7f51bc120400 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:48.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.266+0000 7f51b0ff9700 1 --2- 172.21.15.26:0/743047057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51bc0a1340 0x7f51bc120940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:48.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.266+0000 7f51b0ff9700 1 -- 172.21.15.26:0/743047057 >> 172.21.15.26:0/743047057 conn(0x7f51bc0a6550 msgr2=0x7f51bc1bafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:48.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.266+0000 7f51b0ff9700 1 -- 172.21.15.26:0/743047057 shutdown_connections 2023-10-01T07:57:48.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:48.266+0000 7f51b0ff9700 1 -- 172.21.15.26:0/743047057 wait complete. 2023-10-01T07:57:48.280 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:49.078 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:49.104 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:49.191 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:49.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.226+0000 7f7433a9e700 1 Processor -- start 2023-10-01T07:57:49.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.226+0000 7f7433a9e700 1 -- start start 2023-10-01T07:57:49.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.227+0000 7f7433a9e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f742c06a770 0x7f742c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:49.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.227+0000 7f7433a9e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f742c131d10 0x7f742c139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:49.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.227+0000 7f7433a9e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f742c09ece0 con 0x7f742c06b080 2023-10-01T07:57:49.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.227+0000 7f7433a9e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f742c09e760 con 0x7f742c131d10 2023-10-01T07:57:49.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.227+0000 7f7433a9e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f742c09e040 con 0x7f742c06a770 2023-10-01T07:57:49.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.227+0000 7f7431039700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f742c06b080 0x7f742c131600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48240/0 (socket says 172.21.15.26:48240) 2023-10-01T07:57:49.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.227+0000 7f7431039700 1 -- 172.21.15.26:0/427003439 learned_addr learned my addr 172.21.15.26:0/427003439 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:49.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.227+0000 7f743203b700 1 --2- 172.21.15.26:0/427003439 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f742c131d10 0x7f742c139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:49.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.227+0000 7f743183a700 1 --2- 172.21.15.26:0/427003439 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f742c06a770 0x7f742c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:49.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.228+0000 7f743183a700 1 -- 172.21.15.26:0/427003439 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f742c131d10 msgr2=0x7f742c139860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:49.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.228+0000 7f743183a700 1 --2- 172.21.15.26:0/427003439 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f742c131d10 0x7f742c139860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:49.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.228+0000 7f7430838700 1 -- 172.21.15.26:0/427003439 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4156059740 0 0) 0x7f742c09ece0 con 0x7f742c06b080 2023-10-01T07:57:49.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.228+0000 7f743183a700 1 -- 172.21.15.26:0/427003439 >> v1:172.21.15.26:6789/0 conn(0x7f742c06b080 legacy=0x7f742c131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:49.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.228+0000 7f743183a700 1 -- 172.21.15.26:0/427003439 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f742c09f630 con 0x7f742c06a770 2023-10-01T07:57:49.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.228+0000 7f743203b700 1 --2- 172.21.15.26:0/427003439 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f742c131d10 0x7f742c139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:49.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.228+0000 7f743183a700 1 --2- 172.21.15.26:0/427003439 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f742c06a770 0x7f742c06ab40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7428009870 tx=0x7f7428009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49bfcbfb76d3fb72 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:49.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.228+0000 7f7430838700 1 -- 172.21.15.26:0/427003439 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7428011830 con 0x7f742c06a770 2023-10-01T07:57:49.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.228+0000 7f7430838700 1 -- 172.21.15.26:0/427003439 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7428011990 con 0x7f742c06a770 2023-10-01T07:57:49.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.228+0000 7f7430838700 1 -- 172.21.15.26:0/427003439 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7428011d20 con 0x7f742c06a770 2023-10-01T07:57:49.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.229+0000 7f7433a9e700 1 -- 172.21.15.26:0/427003439 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f742c06a770 msgr2=0x7f742c06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:49.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.229+0000 7f7433a9e700 1 --2- 172.21.15.26:0/427003439 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f742c06a770 0x7f742c06ab40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7428009870 tx=0x7f7428009b80 comp rx=0 tx=0).stop 2023-10-01T07:57:49.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.229+0000 7f7433a9e700 1 -- 172.21.15.26:0/427003439 shutdown_connections 2023-10-01T07:57:49.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.229+0000 7f7433a9e700 1 --2- 172.21.15.26:0/427003439 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f742c06a770 0x7f742c06ab40 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:49.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.229+0000 7f7433a9e700 1 --2- 172.21.15.26:0/427003439 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f742c131d10 0x7f742c139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:49.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.229+0000 7f7433a9e700 1 -- 172.21.15.26:0/427003439 >> 172.21.15.26:0/427003439 conn(0x7f742c066f50 msgr2=0x7f742c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:49.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.229+0000 7f7433a9e700 1 -- 172.21.15.26:0/427003439 shutdown_connections 2023-10-01T07:57:49.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.229+0000 7f7433a9e700 1 -- 172.21.15.26:0/427003439 wait complete. 2023-10-01T07:57:49.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.230+0000 7f7433a9e700 1 Processor -- start 2023-10-01T07:57:49.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.230+0000 7f7433a9e700 1 -- start start 2023-10-01T07:57:49.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.230+0000 7f7433a9e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f742c06a770 0x7f742c1203c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:49.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.230+0000 7f7433a9e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f742c06b080 0x7f742c120900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:49.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.230+0000 7f7433a9e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f742c131d10 0x7f742c120e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:49.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.230+0000 7f7433a9e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742c123860 con 0x7f742c06b080 2023-10-01T07:57:49.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.230+0000 7f7433a9e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f742c1312a0 con 0x7f742c06a770 2023-10-01T07:57:49.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.230+0000 7f7433a9e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f742c123f00 con 0x7f742c131d10 2023-10-01T07:57:49.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.231+0000 7f7431039700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f742c06b080 0x7f742c120900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:49.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.231+0000 7f743183a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f742c06a770 0x7f742c1203c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:49.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.231+0000 7f7431039700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f742c06b080 0x7f742c120900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34490/0 (socket says 172.21.15.26:34490) 2023-10-01T07:57:49.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.231+0000 7f7431039700 1 -- 172.21.15.26:0/1128519216 learned_addr learned my addr 172.21.15.26:0/1128519216 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:49.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.231+0000 7f743203b700 1 --2- 172.21.15.26:0/1128519216 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f742c131d10 0x7f742c120e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:49.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.231+0000 7f743183a700 1 -- 172.21.15.26:0/1128519216 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f742c131d10 msgr2=0x7f742c120e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:49.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.231+0000 7f743183a700 1 --2- 172.21.15.26:0/1128519216 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f742c131d10 0x7f742c120e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:49.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.231+0000 7f743183a700 1 -- 172.21.15.26:0/1128519216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f742c06b080 msgr2=0x7f742c120900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:49.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.231+0000 7f743183a700 1 --2- 172.21.15.26:0/1128519216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f742c06b080 0x7f742c120900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:49.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.231+0000 7f743183a700 1 -- 172.21.15.26:0/1128519216 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7424009a70 con 0x7f742c06a770 2023-10-01T07:57:49.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.231+0000 7f743183a700 1 --2- 172.21.15.26:0/1128519216 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f742c06a770 0x7f742c1203c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7428016000 tx=0x7f7428004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:49.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.231+0000 7f74227fc700 1 -- 172.21.15.26:0/1128519216 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74280044d0 con 0x7f742c06a770 2023-10-01T07:57:49.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.232+0000 7f74227fc700 1 -- 172.21.15.26:0/1128519216 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742801f070 con 0x7f742c06a770 2023-10-01T07:57:49.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.232+0000 7f7433a9e700 1 -- 172.21.15.26:0/1128519216 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74280094a0 con 0x7f742c06a770 2023-10-01T07:57:49.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.232+0000 7f74227fc700 1 -- 172.21.15.26:0/1128519216 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74280038a0 con 0x7f742c06a770 2023-10-01T07:57:49.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.232+0000 7f7433a9e700 1 -- 172.21.15.26:0/1128519216 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f742c071e60 con 0x7f742c06a770 2023-10-01T07:57:49.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.232+0000 7f74227fc700 1 -- 172.21.15.26:0/1128519216 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7428003a00 con 0x7f742c06a770 2023-10-01T07:57:49.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.233+0000 7f74227fc700 1 -- 172.21.15.26:0/1128519216 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7428021070 con 0x7f742c06a770 2023-10-01T07:57:49.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.233+0000 7f7433a9e700 1 -- 172.21.15.26:0/1128519216 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f742c074ea0 con 0x7f742c06a770 2023-10-01T07:57:49.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.242+0000 7f74227fc700 1 -- 172.21.15.26:0/1128519216 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f74280253e0 con 0x7f742c06a770 2023-10-01T07:57:49.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.267+0000 7f219797c700 1 Processor -- start 2023-10-01T07:57:49.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.268+0000 7f219797c700 1 -- start start 2023-10-01T07:57:49.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.268+0000 7f219797c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2190136710 0x7f2190138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:49.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.268+0000 7f219797c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2190139030 0x7f219013b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:49.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.268+0000 7f219797c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f219006ef30 con 0x7f21901338a0 2023-10-01T07:57:49.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.268+0000 7f219797c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f219006fef0 con 0x7f2190136710 2023-10-01T07:57:49.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.268+0000 7f219797c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21901334b0 con 0x7f2190139030 2023-10-01T07:57:49.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.268+0000 7f2194f17700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2190136710 0x7f2190138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:49.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.269+0000 7f2195718700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f21901338a0 0x7f2190133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48244/0 (socket says 172.21.15.26:48244) 2023-10-01T07:57:49.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.269+0000 7f2195718700 1 -- 172.21.15.26:0/756235927 learned_addr learned my addr 172.21.15.26:0/756235927 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:49.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.269+0000 7f2194f17700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2190136710 0x7f2190138af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:49416/0 (socket says 172.21.15.26:49416) 2023-10-01T07:57:49.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.269+0000 7f2195f19700 1 --2- 172.21.15.26:0/756235927 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2190139030 0x7f219013b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:49.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.269+0000 7f2195f19700 1 -- 172.21.15.26:0/756235927 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2190136710 msgr2=0x7f2190138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:49.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.269+0000 7f2195f19700 1 --2- 172.21.15.26:0/756235927 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2190136710 0x7f2190138af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:49.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.269+0000 7f2195f19700 1 -- 172.21.15.26:0/756235927 >> v1:172.21.15.26:6789/0 conn(0x7f21901338a0 legacy=0x7f2190133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:49.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.269+0000 7f2187fff700 1 -- 172.21.15.26:0/756235927 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 793698908 0 0) 0x7f219006ef30 con 0x7f21901338a0 2023-10-01T07:57:49.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.269+0000 7f2195f19700 1 -- 172.21.15.26:0/756235927 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219006fc30 con 0x7f2190139030 2023-10-01T07:57:49.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.269+0000 7f2194f17700 1 --2- 172.21.15.26:0/756235927 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2190136710 0x7f2190138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:49.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.269+0000 7f2195f19700 1 --2- 172.21.15.26:0/756235927 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2190139030 0x7f219013b410 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2188009dc0 tx=0x7f218800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d23d8b7644443bd server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:49.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.269+0000 7f2187fff700 1 -- 172.21.15.26:0/756235927 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218800e070 con 0x7f2190139030 2023-10-01T07:57:49.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.269+0000 7f2187fff700 1 -- 172.21.15.26:0/756235927 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218800bb20 con 0x7f2190139030 2023-10-01T07:57:49.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.269+0000 7f2187fff700 1 -- 172.21.15.26:0/756235927 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2188012430 con 0x7f2190139030 2023-10-01T07:57:49.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.270+0000 7f219797c700 1 -- 172.21.15.26:0/756235927 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2190139030 msgr2=0x7f219013b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:49.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.270+0000 7f219797c700 1 --2- 172.21.15.26:0/756235927 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2190139030 0x7f219013b410 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2188009dc0 tx=0x7f218800b330 comp rx=0 tx=0).stop 2023-10-01T07:57:49.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.270+0000 7f219797c700 1 -- 172.21.15.26:0/756235927 shutdown_connections 2023-10-01T07:57:49.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.270+0000 7f219797c700 1 --2- 172.21.15.26:0/756235927 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2190139030 0x7f219013b410 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:49.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.270+0000 7f219797c700 1 --2- 172.21.15.26:0/756235927 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2190136710 0x7f2190138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:49.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.270+0000 7f219797c700 1 -- 172.21.15.26:0/756235927 >> 172.21.15.26:0/756235927 conn(0x7f21900a2aa0 msgr2=0x7f21900a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:49.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.270+0000 7f219797c700 1 -- 172.21.15.26:0/756235927 shutdown_connections 2023-10-01T07:57:49.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.270+0000 7f219797c700 1 -- 172.21.15.26:0/756235927 wait complete. 2023-10-01T07:57:49.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.271+0000 7f219797c700 1 Processor -- start 2023-10-01T07:57:49.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.271+0000 7f219797c700 1 -- start start 2023-10-01T07:57:49.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.272+0000 7f219797c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21901338a0 0x7f21901c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:49.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.272+0000 7f219797c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2190136710 0x7f21901c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:49.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.272+0000 7f219797c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2190139030 0x7f219011ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:49.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.272+0000 7f219797c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f219011e080 con 0x7f21901338a0 2023-10-01T07:57:49.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.272+0000 7f219797c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2190138d40 con 0x7f2190136710 2023-10-01T07:57:49.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.272+0000 7f219797c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f219011eb30 con 0x7f2190139030 2023-10-01T07:57:49.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.272+0000 7f2194f17700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2190136710 0x7f21901c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:49.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.272+0000 7f2195718700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21901338a0 0x7f21901c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:49.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.272+0000 7f2194f17700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2190136710 0x7f21901c8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:49420/0 (socket says 172.21.15.26:49420) 2023-10-01T07:57:49.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.272+0000 7f2195718700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21901338a0 0x7f21901c85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34494/0 (socket says 172.21.15.26:34494) 2023-10-01T07:57:49.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.272+0000 7f2194f17700 1 -- 172.21.15.26:0/3790489001 learned_addr learned my addr 172.21.15.26:0/3790489001 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:49.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.272+0000 7f2195f19700 1 --2- 172.21.15.26:0/3790489001 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2190139030 0x7f219011ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:49.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.272+0000 7f2195718700 1 -- 172.21.15.26:0/3790489001 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2190139030 msgr2=0x7f219011ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:49.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.272+0000 7f2195718700 1 --2- 172.21.15.26:0/3790489001 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2190139030 0x7f219011ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:49.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.272+0000 7f2195718700 1 -- 172.21.15.26:0/3790489001 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2190136710 msgr2=0x7f21901c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:49.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.272+0000 7f2195718700 1 --2- 172.21.15.26:0/3790489001 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2190136710 0x7f21901c8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:49.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.272+0000 7f2195718700 1 -- 172.21.15.26:0/3790489001 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21800094a0 con 0x7f21901338a0 2023-10-01T07:57:49.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.273+0000 7f2194f17700 1 --2- 172.21.15.26:0/3790489001 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2190136710 0x7f21901c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:49.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.273+0000 7f2195718700 1 --2- 172.21.15.26:0/3790489001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21901338a0 0x7f21901c85e0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f218c00c470 tx=0x7f218c00c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:49.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.273+0000 7f2185ffb700 1 -- 172.21.15.26:0/3790489001 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c004c80 con 0x7f21901338a0 2023-10-01T07:57:49.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.273+0000 7f2185ffb700 1 -- 172.21.15.26:0/3790489001 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218c004de0 con 0x7f21901338a0 2023-10-01T07:57:49.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.273+0000 7f2185ffb700 1 -- 172.21.15.26:0/3790489001 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c007310 con 0x7f21901338a0 2023-10-01T07:57:49.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.273+0000 7f219797c700 1 -- 172.21.15.26:0/3790489001 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2188009a70 con 0x7f21901338a0 2023-10-01T07:57:49.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.273+0000 7f219797c700 1 -- 172.21.15.26:0/3790489001 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f219011e350 con 0x7f21901338a0 2023-10-01T07:57:49.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.274+0000 7f2185ffb700 1 -- 172.21.15.26:0/3790489001 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f218c007470 con 0x7f21901338a0 2023-10-01T07:57:49.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.274+0000 7f219797c700 1 -- 172.21.15.26:0/3790489001 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2190074ea0 con 0x7f21901338a0 2023-10-01T07:57:49.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.275+0000 7f2185ffb700 1 -- 172.21.15.26:0/3790489001 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f218c03f1c0 con 0x7f21901338a0 2023-10-01T07:57:49.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.280+0000 7f2185ffb700 1 -- 172.21.15.26:0/3790489001 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f218c007720 con 0x7f21901338a0 2023-10-01T07:57:49.281 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:49.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.339+0000 7fa6496c3700 1 Processor -- start 2023-10-01T07:57:49.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.339+0000 7fa6496c3700 1 -- start start 2023-10-01T07:57:49.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.340+0000 7fa6496c3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6441338c0 0x7fa644133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:49.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.340+0000 7fa6496c3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa6441341d0 0x7fa64409de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:49.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.340+0000 7fa6496c3700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa64406f720 con 0x7fa64409e390 2023-10-01T07:57:49.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.340+0000 7fa6496c3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa644070c80 con 0x7fa6441338c0 2023-10-01T07:57:49.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.340+0000 7fa6496c3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa64406fce0 con 0x7fa6441341d0 2023-10-01T07:57:49.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.340+0000 7fa642ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6441338c0 0x7fa644133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:49.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.340+0000 7fa6437fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa64409e390 0x7fa64413a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48246/0 (socket says 172.21.15.26:48246) 2023-10-01T07:57:49.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.340+0000 7fa642ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6441338c0 0x7fa644133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:49430/0 (socket says 172.21.15.26:49430) 2023-10-01T07:57:49.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.340+0000 7fa6437fe700 1 -- 172.21.15.26:0/1890680290 learned_addr learned my addr 172.21.15.26:0/1890680290 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:49.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.340+0000 7fa6427fc700 1 --2- 172.21.15.26:0/1890680290 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa6441341d0 0x7fa64409de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:49.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.341+0000 7fa642ffd700 1 -- 172.21.15.26:0/1890680290 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa6441341d0 msgr2=0x7fa64409de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:49.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.341+0000 7fa642ffd700 1 --2- 172.21.15.26:0/1890680290 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa6441341d0 0x7fa64409de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:49.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.341+0000 7fa642ffd700 1 -- 172.21.15.26:0/1890680290 >> v1:172.21.15.26:6789/0 conn(0x7fa64409e390 legacy=0x7fa64413a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:49.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.341+0000 7fa642ffd700 1 -- 172.21.15.26:0/1890680290 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6441336a0 con 0x7fa6441338c0 2023-10-01T07:57:49.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.341+0000 7fa6427fc700 1 --2- 172.21.15.26:0/1890680290 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa6441341d0 0x7fa64409de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:49.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.341+0000 7fa642ffd700 1 --2- 172.21.15.26:0/1890680290 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6441338c0 0x7fa644133c90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa634009870 tx=0x7fa634009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9cef5a8fd8b3939 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:49.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.341+0000 7fa641ffb700 1 -- 172.21.15.26:0/1890680290 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa634011830 con 0x7fa6441338c0 2023-10-01T07:57:49.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.341+0000 7fa641ffb700 1 -- 172.21.15.26:0/1890680290 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa634011990 con 0x7fa6441338c0 2023-10-01T07:57:49.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.341+0000 7fa641ffb700 1 -- 172.21.15.26:0/1890680290 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa634011d20 con 0x7fa6441338c0 2023-10-01T07:57:49.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.342+0000 7fa6496c3700 1 -- 172.21.15.26:0/1890680290 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6441338c0 msgr2=0x7fa644133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:49.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.342+0000 7fa6496c3700 1 --2- 172.21.15.26:0/1890680290 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6441338c0 0x7fa644133c90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa634009870 tx=0x7fa634009b80 comp rx=0 tx=0).stop 2023-10-01T07:57:49.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.342+0000 7fa6496c3700 1 -- 172.21.15.26:0/1890680290 shutdown_connections 2023-10-01T07:57:49.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.342+0000 7fa6496c3700 1 --2- 172.21.15.26:0/1890680290 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6441338c0 0x7fa644133c90 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:49.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.342+0000 7fa6496c3700 1 --2- 172.21.15.26:0/1890680290 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa6441341d0 0x7fa64409de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:49.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.342+0000 7fa6496c3700 1 -- 172.21.15.26:0/1890680290 >> 172.21.15.26:0/1890680290 conn(0x7fa6440a2aa0 msgr2=0x7fa6440a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:49.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.343+0000 7fa6496c3700 1 -- 172.21.15.26:0/1890680290 shutdown_connections 2023-10-01T07:57:49.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.343+0000 7fa6496c3700 1 -- 172.21.15.26:0/1890680290 wait complete. 2023-10-01T07:57:49.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.344+0000 7fa6496c3700 1 Processor -- start 2023-10-01T07:57:49.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.344+0000 7fa6496c3700 1 -- start start 2023-10-01T07:57:49.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.344+0000 7fa6496c3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa64409e390 0x7fa6441ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:49.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.344+0000 7fa6496c3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6441338c0 0x7fa6441cd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:49.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.344+0000 7fa6496c3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa6441341d0 0x7fa644123710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:49.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.344+0000 7fa6496c3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa644127a00 con 0x7fa6441338c0 2023-10-01T07:57:49.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.344+0000 7fa6496c3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa64406f9d0 con 0x7fa64409e390 2023-10-01T07:57:49.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.344+0000 7fa6496c3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa644130e70 con 0x7fa6441341d0 2023-10-01T07:57:49.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.344+0000 7fa642ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa64409e390 0x7fa6441ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:49.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.344+0000 7fa642ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa64409e390 0x7fa6441ccb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:49442/0 (socket says 172.21.15.26:49442) 2023-10-01T07:57:49.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.344+0000 7fa642ffd700 1 -- 172.21.15.26:0/294625392 learned_addr learned my addr 172.21.15.26:0/294625392 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:49.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.345+0000 7fa6437fe700 1 --2- 172.21.15.26:0/294625392 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa6441341d0 0x7fa644123710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:49.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.345+0000 7fa6427fc700 1 --2- 172.21.15.26:0/294625392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6441338c0 0x7fa6441cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:49.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.345+0000 7fa642ffd700 1 -- 172.21.15.26:0/294625392 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa6441341d0 msgr2=0x7fa644123710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:49.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.345+0000 7fa642ffd700 1 --2- 172.21.15.26:0/294625392 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa6441341d0 0x7fa644123710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:49.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.345+0000 7fa642ffd700 1 -- 172.21.15.26:0/294625392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6441338c0 msgr2=0x7fa6441cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:49.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.345+0000 7fa642ffd700 1 --2- 172.21.15.26:0/294625392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6441338c0 0x7fa6441cd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:49.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.345+0000 7fa642ffd700 1 -- 172.21.15.26:0/294625392 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6380094a0 con 0x7fa64409e390 2023-10-01T07:57:49.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.345+0000 7fa642ffd700 1 --2- 172.21.15.26:0/294625392 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa64409e390 0x7fa6441ccb40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa634000c00 tx=0x7fa634004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:49.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.345+0000 7fa62b7fe700 1 -- 172.21.15.26:0/294625392 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa634004510 con 0x7fa64409e390 2023-10-01T07:57:49.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.345+0000 7fa62b7fe700 1 -- 172.21.15.26:0/294625392 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63401f070 con 0x7fa64409e390 2023-10-01T07:57:49.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.346+0000 7fa62b7fe700 1 -- 172.21.15.26:0/294625392 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6340038e0 con 0x7fa64409e390 2023-10-01T07:57:49.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.346+0000 7fa6496c3700 1 -- 172.21.15.26:0/294625392 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6340094a0 con 0x7fa64409e390 2023-10-01T07:57:49.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.346+0000 7fa6496c3700 1 -- 172.21.15.26:0/294625392 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa644126d70 con 0x7fa64409e390 2023-10-01T07:57:49.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.347+0000 7fa6496c3700 1 -- 172.21.15.26:0/294625392 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa644074ea0 con 0x7fa64409e390 2023-10-01T07:57:49.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.348+0000 7fa62b7fe700 1 -- 172.21.15.26:0/294625392 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa634003a40 con 0x7fa64409e390 2023-10-01T07:57:49.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.348+0000 7fa62b7fe700 1 -- 172.21.15.26:0/294625392 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa634021070 con 0x7fa64409e390 2023-10-01T07:57:49.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.357+0000 7fa62b7fe700 1 -- 172.21.15.26:0/294625392 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa634024380 con 0x7fa64409e390 2023-10-01T07:57:49.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.430+0000 7fe294e11700 1 Processor -- start 2023-10-01T07:57:49.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.430+0000 7fe294e11700 1 -- start start 2023-10-01T07:57:49.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.431+0000 7fe294e11700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe2900a0a30 0x7fe2900a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:49.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.431+0000 7fe294e11700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe29009d630 0x7fe2900a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:49.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.431+0000 7fe294e11700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2900a2a70 con 0x7fe290133930 2023-10-01T07:57:49.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.431+0000 7fe294e11700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2900a01d0 con 0x7fe2900a0a30 2023-10-01T07:57:49.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.431+0000 7fe294e11700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29009e2b0 con 0x7fe29009d630 2023-10-01T07:57:49.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.431+0000 7fe28dd9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe29009d630 0x7fe2900a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:49.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.431+0000 7fe28dd9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe29009d630 0x7fe2900a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:49444/0 (socket says 172.21.15.26:49444) 2023-10-01T07:57:49.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.431+0000 7fe28dd9b700 1 -- 172.21.15.26:0/2175590134 learned_addr learned my addr 172.21.15.26:0/2175590134 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:49.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.432+0000 7fe28dd9b700 1 -- 172.21.15.26:0/2175590134 >> v2:172.21.15.26:3300/0 conn(0x7fe2900a0a30 msgr2=0x7fe2900a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:49.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.432+0000 7fe28dd9b700 1 --2- 172.21.15.26:0/2175590134 >> v2:172.21.15.26:3300/0 conn(0x7fe2900a0a30 0x7fe2900a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:49.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.432+0000 7fe28dd9b700 1 -- 172.21.15.26:0/2175590134 >> v1:172.21.15.26:6789/0 conn(0x7fe290133930 legacy=0x7fe290133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:49.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.432+0000 7fe28dd9b700 1 -- 172.21.15.26:0/2175590134 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29009dc50 con 0x7fe29009d630 2023-10-01T07:57:49.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.432+0000 7fe28dd9b700 1 --2- 172.21.15.26:0/2175590134 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe29009d630 0x7fe2900a1340 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe2840098f0 tx=0x7fe284009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=735cbad5cc6b4270 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:49.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.432+0000 7fe28d59a700 1 -- 172.21.15.26:0/2175590134 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe284004230 con 0x7fe29009d630 2023-10-01T07:57:49.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.432+0000 7fe28d59a700 1 -- 172.21.15.26:0/2175590134 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe284004390 con 0x7fe29009d630 2023-10-01T07:57:49.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.432+0000 7fe28d59a700 1 -- 172.21.15.26:0/2175590134 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2840036a0 con 0x7fe29009d630 2023-10-01T07:57:49.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.433+0000 7fe294e11700 1 -- 172.21.15.26:0/2175590134 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe29009d630 msgr2=0x7fe2900a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:49.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.433+0000 7fe294e11700 1 --2- 172.21.15.26:0/2175590134 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe29009d630 0x7fe2900a1340 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe2840098f0 tx=0x7fe284009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:49.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.433+0000 7fe294e11700 1 -- 172.21.15.26:0/2175590134 shutdown_connections 2023-10-01T07:57:49.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.433+0000 7fe294e11700 1 --2- 172.21.15.26:0/2175590134 >> v2:172.21.15.26:3300/0 conn(0x7fe2900a0a30 0x7fe2900a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:49.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.433+0000 7fe294e11700 1 --2- 172.21.15.26:0/2175590134 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe29009d630 0x7fe2900a1340 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:49.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.433+0000 7fe294e11700 1 -- 172.21.15.26:0/2175590134 >> 172.21.15.26:0/2175590134 conn(0x7fe2900a3050 msgr2=0x7fe2900a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:49.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.433+0000 7fe294e11700 1 -- 172.21.15.26:0/2175590134 shutdown_connections 2023-10-01T07:57:49.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.433+0000 7fe294e11700 1 -- 172.21.15.26:0/2175590134 wait complete. 2023-10-01T07:57:49.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.435+0000 7fe294e11700 1 Processor -- start 2023-10-01T07:57:49.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.435+0000 7fe294e11700 1 -- start start 2023-10-01T07:57:49.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.436+0000 7fe294e11700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe29009d630 0x7fe29011f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:49.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.436+0000 7fe294e11700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe2900a0a30 0x7fe29011f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:49.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.436+0000 7fe294e11700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe290133930 0x7fe2901c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:49.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.436+0000 7fe294e11700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29011efe0 con 0x7fe29009d630 2023-10-01T07:57:49.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.436+0000 7fe294e11700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe290122080 con 0x7fe290133930 2023-10-01T07:57:49.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.436+0000 7fe294e11700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2900a4350 con 0x7fe2900a0a30 2023-10-01T07:57:49.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.436+0000 7fe28dd9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe2900a0a30 0x7fe29011f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:49.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.436+0000 7fe28dd9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe2900a0a30 0x7fe29011f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47244/0 (socket says 172.21.15.26:47244) 2023-10-01T07:57:49.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.436+0000 7fe28dd9b700 1 -- 172.21.15.26:0/2981646996 learned_addr learned my addr 172.21.15.26:0/2981646996 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:49.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.436+0000 7fe28ed9d700 1 --2- 172.21.15.26:0/2981646996 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe290133930 0x7fe2901c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:49.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.436+0000 7fe28e59c700 1 --2- 172.21.15.26:0/2981646996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe29009d630 0x7fe29011f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:49.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.436+0000 7fe28dd9b700 1 -- 172.21.15.26:0/2981646996 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe290133930 msgr2=0x7fe2901c8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:49.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.436+0000 7fe28dd9b700 1 --2- 172.21.15.26:0/2981646996 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe290133930 0x7fe2901c8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:49.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.436+0000 7fe28dd9b700 1 -- 172.21.15.26:0/2981646996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe29009d630 msgr2=0x7fe29011f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:49.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.437+0000 7fe28dd9b700 1 --2- 172.21.15.26:0/2981646996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe29009d630 0x7fe29011f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:49.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.437+0000 7fe28dd9b700 1 -- 172.21.15.26:0/2981646996 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe284009550 con 0x7fe2900a0a30 2023-10-01T07:57:49.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.437+0000 7fe28ed9d700 1 --2- 172.21.15.26:0/2981646996 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe290133930 0x7fe2901c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:49.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.437+0000 7fe28dd9b700 1 --2- 172.21.15.26:0/2981646996 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe2900a0a30 0x7fe29011f910 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe284009130 tx=0x7fe284004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:49.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.437+0000 7fe27effd700 1 -- 172.21.15.26:0/2981646996 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe284003cd0 con 0x7fe2900a0a30 2023-10-01T07:57:49.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.437+0000 7fe27effd700 1 -- 172.21.15.26:0/2981646996 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28401f070 con 0x7fe2900a0a30 2023-10-01T07:57:49.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.437+0000 7fe294e11700 1 -- 172.21.15.26:0/2981646996 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2900a0410 con 0x7fe2900a0a30 2023-10-01T07:57:49.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.437+0000 7fe27effd700 1 -- 172.21.15.26:0/2981646996 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28400b8a0 con 0x7fe2900a0a30 2023-10-01T07:57:49.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.437+0000 7fe294e11700 1 -- 172.21.15.26:0/2981646996 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe290122db0 con 0x7fe2900a0a30 2023-10-01T07:57:49.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.439+0000 7fe294e11700 1 -- 172.21.15.26:0/2981646996 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2900747f0 con 0x7fe2900a0a30 2023-10-01T07:57:49.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.439+0000 7fe27effd700 1 -- 172.21.15.26:0/2981646996 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe284021030 con 0x7fe2900a0a30 2023-10-01T07:57:49.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.439+0000 7fe27effd700 1 -- 172.21.15.26:0/2981646996 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe284041040 con 0x7fe2900a0a30 2023-10-01T07:57:49.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.448+0000 7fe27effd700 1 -- 172.21.15.26:0/2981646996 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe284003e30 con 0x7fe2900a0a30 2023-10-01T07:57:49.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.471+0000 7f7433a9e700 1 -- 172.21.15.26:0/1128519216 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f742c121f90 con 0x7f742c06a770 2023-10-01T07:57:49.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.472+0000 7f74227fc700 1 -- 172.21.15.26:0/1128519216 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7428010b70 con 0x7f742c06a770 2023-10-01T07:57:49.472 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:49.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.475+0000 7f7433a9e700 1 -- 172.21.15.26:0/1128519216 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f742c06a770 msgr2=0x7f742c1203c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:49.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.475+0000 7f7433a9e700 1 --2- 172.21.15.26:0/1128519216 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f742c06a770 0x7f742c1203c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7428016000 tx=0x7f7428004750 comp rx=0 tx=0).stop 2023-10-01T07:57:49.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.475+0000 7f7433a9e700 1 -- 172.21.15.26:0/1128519216 shutdown_connections 2023-10-01T07:57:49.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.475+0000 7f7433a9e700 1 --2- 172.21.15.26:0/1128519216 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f742c131d10 0x7f742c120e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:49.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.475+0000 7f7433a9e700 1 --2- 172.21.15.26:0/1128519216 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f742c06a770 0x7f742c1203c0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:49.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.475+0000 7f7433a9e700 1 --2- 172.21.15.26:0/1128519216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f742c06b080 0x7f742c120900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:49.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.475+0000 7f7433a9e700 1 -- 172.21.15.26:0/1128519216 >> 172.21.15.26:0/1128519216 conn(0x7f742c066f50 msgr2=0x7f742c070070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:49.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.475+0000 7f7433a9e700 1 -- 172.21.15.26:0/1128519216 shutdown_connections 2023-10-01T07:57:49.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.475+0000 7f7433a9e700 1 -- 172.21.15.26:0/1128519216 wait complete. 2023-10-01T07:57:49.490 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:49.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.513+0000 7f219797c700 1 -- 172.21.15.26:0/3790489001 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2190136320 con 0x7f21901338a0 2023-10-01T07:57:49.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.513+0000 7f2185ffb700 1 -- 172.21.15.26:0/3790489001 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f218c011360 con 0x7f21901338a0 2023-10-01T07:57:49.515 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:49.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.516+0000 7f219797c700 1 -- 172.21.15.26:0/3790489001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21901338a0 msgr2=0x7f21901c85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:49.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.516+0000 7f219797c700 1 --2- 172.21.15.26:0/3790489001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21901338a0 0x7f21901c85e0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f218c00c470 tx=0x7f218c00c780 comp rx=0 tx=0).stop 2023-10-01T07:57:49.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.516+0000 7f219797c700 1 -- 172.21.15.26:0/3790489001 shutdown_connections 2023-10-01T07:57:49.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.516+0000 7f219797c700 1 --2- 172.21.15.26:0/3790489001 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2190139030 0x7f219011ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:49.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.516+0000 7f219797c700 1 --2- 172.21.15.26:0/3790489001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21901338a0 0x7f21901c85e0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:49.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.516+0000 7f219797c700 1 --2- 172.21.15.26:0/3790489001 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2190136710 0x7f21901c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:49.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.516+0000 7f219797c700 1 -- 172.21.15.26:0/3790489001 >> 172.21.15.26:0/3790489001 conn(0x7f21900a2aa0 msgr2=0x7f2190137170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:49.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.516+0000 7f219797c700 1 -- 172.21.15.26:0/3790489001 shutdown_connections 2023-10-01T07:57:49.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.516+0000 7f219797c700 1 -- 172.21.15.26:0/3790489001 wait complete. 2023-10-01T07:57:49.531 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:49.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.571+0000 7fa6496c3700 1 -- 172.21.15.26:0/294625392 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa64406b9e0 con 0x7fa64409e390 2023-10-01T07:57:49.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.571+0000 7fa62b7fe700 1 -- 172.21.15.26:0/294625392 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa634015020 con 0x7fa64409e390 2023-10-01T07:57:49.572 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:49.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.574+0000 7fa6496c3700 1 -- 172.21.15.26:0/294625392 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa64409e390 msgr2=0x7fa6441ccb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:49.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.574+0000 7fa6496c3700 1 --2- 172.21.15.26:0/294625392 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa64409e390 0x7fa6441ccb40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa634000c00 tx=0x7fa634004750 comp rx=0 tx=0).stop 2023-10-01T07:57:49.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.574+0000 7fa6496c3700 1 -- 172.21.15.26:0/294625392 shutdown_connections 2023-10-01T07:57:49.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.574+0000 7fa6496c3700 1 --2- 172.21.15.26:0/294625392 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa6441341d0 0x7fa644123710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:49.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.574+0000 7fa6496c3700 1 --2- 172.21.15.26:0/294625392 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa64409e390 0x7fa6441ccb40 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:49.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.574+0000 7fa6496c3700 1 --2- 172.21.15.26:0/294625392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6441338c0 0x7fa6441cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:49.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.574+0000 7fa6496c3700 1 -- 172.21.15.26:0/294625392 >> 172.21.15.26:0/294625392 conn(0x7fa6440a2aa0 msgr2=0x7fa6440a0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:49.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.574+0000 7fa6496c3700 1 -- 172.21.15.26:0/294625392 shutdown_connections 2023-10-01T07:57:49.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.574+0000 7fa6496c3700 1 -- 172.21.15.26:0/294625392 wait complete. 2023-10-01T07:57:49.588 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:49.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.668+0000 7fe294e11700 1 -- 172.21.15.26:0/2981646996 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe2900747f0 con 0x7fe2900a0a30 2023-10-01T07:57:49.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.668+0000 7fe27effd700 1 -- 172.21.15.26:0/2981646996 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe28401b440 con 0x7fe2900a0a30 2023-10-01T07:57:49.669 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:49.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.671+0000 7fe294e11700 1 -- 172.21.15.26:0/2981646996 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe2900a0a30 msgr2=0x7fe29011f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:49.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.671+0000 7fe294e11700 1 --2- 172.21.15.26:0/2981646996 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe2900a0a30 0x7fe29011f910 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe284009130 tx=0x7fe284004750 comp rx=0 tx=0).stop 2023-10-01T07:57:49.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.671+0000 7fe294e11700 1 -- 172.21.15.26:0/2981646996 shutdown_connections 2023-10-01T07:57:49.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.671+0000 7fe294e11700 1 --2- 172.21.15.26:0/2981646996 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe290133930 0x7fe2901c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:49.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.671+0000 7fe294e11700 1 --2- 172.21.15.26:0/2981646996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe29009d630 0x7fe29011f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:49.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.671+0000 7fe294e11700 1 --2- 172.21.15.26:0/2981646996 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe2900a0a30 0x7fe29011f910 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:49.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.671+0000 7fe294e11700 1 -- 172.21.15.26:0/2981646996 >> 172.21.15.26:0/2981646996 conn(0x7fe2900a3050 msgr2=0x7fe2901bbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:49.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.671+0000 7fe294e11700 1 -- 172.21.15.26:0/2981646996 shutdown_connections 2023-10-01T07:57:49.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:49.671+0000 7fe294e11700 1 -- 172.21.15.26:0/2981646996 wait complete. 2023-10-01T07:57:49.685 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:50.491 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:50.532 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:50.589 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:50.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.641+0000 7fdeabb2e700 1 Processor -- start 2023-10-01T07:57:50.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.641+0000 7fdeabb2e700 1 -- start start 2023-10-01T07:57:50.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.642+0000 7fdeabb2e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdea4130670 0x7fdea4130a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:50.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.642+0000 7fdeabb2e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdea40701a0 0x7fdea4138540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:50.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.642+0000 7fdeabb2e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdea4130260 con 0x7fdea406f680 2023-10-01T07:57:50.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.642+0000 7fdeabb2e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdea409a350 con 0x7fdea4130670 2023-10-01T07:57:50.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.642+0000 7fdeabb2e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdea4071ff0 con 0x7fdea40701a0 2023-10-01T07:57:50.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.642+0000 7fdea98ca700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdea4130670 0x7fdea4130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:50.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.643+0000 7fdea98ca700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdea4130670 0x7fdea4130a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34522/0 (socket says 172.21.15.26:34522) 2023-10-01T07:57:50.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.643+0000 7fdea98ca700 1 -- 172.21.15.26:0/3020914924 learned_addr learned my addr 172.21.15.26:0/3020914924 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:50.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.643+0000 7fdeaa0cb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdea40701a0 0x7fdea4138540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:50.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.643+0000 7fdea98ca700 1 -- 172.21.15.26:0/3020914924 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdea40701a0 msgr2=0x7fdea4138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:50.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.643+0000 7fdea98ca700 1 --2- 172.21.15.26:0/3020914924 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdea40701a0 0x7fdea4138540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:50.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.643+0000 7fdea98ca700 1 -- 172.21.15.26:0/3020914924 >> v1:172.21.15.26:6789/0 conn(0x7fdea406f680 legacy=0x7fdea406fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:50.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.643+0000 7fdea98ca700 1 -- 172.21.15.26:0/3020914924 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea409ecf0 con 0x7fdea4130670 2023-10-01T07:57:50.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.643+0000 7fdeaa0cb700 1 --2- 172.21.15.26:0/3020914924 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdea40701a0 0x7fdea4138540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:50.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.643+0000 7fdea98ca700 1 --2- 172.21.15.26:0/3020914924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdea4130670 0x7fdea4130a40 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fdea00098f0 tx=0x7fdea0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=492ac9958b87175d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:50.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.643+0000 7fdea88c8700 1 -- 172.21.15.26:0/3020914924 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea0011830 con 0x7fdea4130670 2023-10-01T07:57:50.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.643+0000 7fdea88c8700 1 -- 172.21.15.26:0/3020914924 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea0011990 con 0x7fdea4130670 2023-10-01T07:57:50.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.643+0000 7fdea88c8700 1 -- 172.21.15.26:0/3020914924 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea0011d20 con 0x7fdea4130670 2023-10-01T07:57:50.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.644+0000 7fdeabb2e700 1 -- 172.21.15.26:0/3020914924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdea4130670 msgr2=0x7fdea4130a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:50.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.644+0000 7fdeabb2e700 1 --2- 172.21.15.26:0/3020914924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdea4130670 0x7fdea4130a40 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fdea00098f0 tx=0x7fdea0009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:50.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.644+0000 7fdeabb2e700 1 -- 172.21.15.26:0/3020914924 shutdown_connections 2023-10-01T07:57:50.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.644+0000 7fdeabb2e700 1 --2- 172.21.15.26:0/3020914924 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdea40701a0 0x7fdea4138540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:50.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.644+0000 7fdeabb2e700 1 --2- 172.21.15.26:0/3020914924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdea4130670 0x7fdea4130a40 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:50.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.644+0000 7fdeabb2e700 1 -- 172.21.15.26:0/3020914924 >> 172.21.15.26:0/3020914924 conn(0x7fdea40a2aa0 msgr2=0x7fdea40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:50.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.644+0000 7fdeabb2e700 1 -- 172.21.15.26:0/3020914924 shutdown_connections 2023-10-01T07:57:50.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.644+0000 7fdeabb2e700 1 -- 172.21.15.26:0/3020914924 wait complete. 2023-10-01T07:57:50.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.646+0000 7fdeabb2e700 1 Processor -- start 2023-10-01T07:57:50.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.646+0000 7fdeabb2e700 1 -- start start 2023-10-01T07:57:50.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.646+0000 7fdeabb2e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdea406f680 0x7fdea411caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:50.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.646+0000 7fdeabb2e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdea40701a0 0x7fdea411cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:50.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.646+0000 7fdeabb2e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdea4130670 0x7fdea411d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:50.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.646+0000 7fdeabb2e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea406eff0 con 0x7fdea40701a0 2023-10-01T07:57:50.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.646+0000 7fdeabb2e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea4071820 con 0x7fdea4130670 2023-10-01T07:57:50.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.646+0000 7fdeabb2e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdea409fce0 con 0x7fdea406f680 2023-10-01T07:57:50.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.647+0000 7fdea98ca700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdea406f680 0x7fdea411caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:50.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.647+0000 7fdea98ca700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdea406f680 0x7fdea411caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47254/0 (socket says 172.21.15.26:47254) 2023-10-01T07:57:50.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.647+0000 7fdea98ca700 1 -- 172.21.15.26:0/4116191639 learned_addr learned my addr 172.21.15.26:0/4116191639 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:50.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.647+0000 7fdea90c9700 1 --2- 172.21.15.26:0/4116191639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdea40701a0 0x7fdea411cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:50.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.647+0000 7fdeaa0cb700 1 --2- 172.21.15.26:0/4116191639 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdea4130670 0x7fdea411d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:50.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.647+0000 7fdea98ca700 1 -- 172.21.15.26:0/4116191639 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdea4130670 msgr2=0x7fdea411d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:50.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.647+0000 7fdea98ca700 1 --2- 172.21.15.26:0/4116191639 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdea4130670 0x7fdea411d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:50.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.647+0000 7fdea98ca700 1 -- 172.21.15.26:0/4116191639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdea40701a0 msgr2=0x7fdea411cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:50.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.647+0000 7fdea98ca700 1 --2- 172.21.15.26:0/4116191639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdea40701a0 0x7fdea411cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:50.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.647+0000 7fdea98ca700 1 -- 172.21.15.26:0/4116191639 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde9c009a70 con 0x7fdea406f680 2023-10-01T07:57:50.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.647+0000 7fdea90c9700 1 --2- 172.21.15.26:0/4116191639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdea40701a0 0x7fdea411cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:50.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.647+0000 7fdea98ca700 1 --2- 172.21.15.26:0/4116191639 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdea406f680 0x7fdea411caa0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fdea0000c00 tx=0x7fdea0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:50.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.648+0000 7fde9a7fc700 1 -- 172.21.15.26:0/4116191639 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea00043c0 con 0x7fdea406f680 2023-10-01T07:57:50.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.648+0000 7fde9a7fc700 1 -- 172.21.15.26:0/4116191639 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea001f070 con 0x7fdea406f680 2023-10-01T07:57:50.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.648+0000 7fdeabb2e700 1 -- 172.21.15.26:0/4116191639 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdea0009550 con 0x7fdea406f680 2023-10-01T07:57:50.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.648+0000 7fde9a7fc700 1 -- 172.21.15.26:0/4116191639 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea00038c0 con 0x7fdea406f680 2023-10-01T07:57:50.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.648+0000 7fdeabb2e700 1 -- 172.21.15.26:0/4116191639 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea412dc60 con 0x7fdea406f680 2023-10-01T07:57:50.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.648+0000 7fde9a7fc700 1 -- 172.21.15.26:0/4116191639 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdea0021030 con 0x7fdea406f680 2023-10-01T07:57:50.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.649+0000 7fde9a7fc700 1 -- 172.21.15.26:0/4116191639 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdea0040ae0 con 0x7fdea406f680 2023-10-01T07:57:50.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.649+0000 7fdeabb2e700 1 -- 172.21.15.26:0/4116191639 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdea4074ea0 con 0x7fdea406f680 2023-10-01T07:57:50.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.654+0000 7fde9a7fc700 1 -- 172.21.15.26:0/4116191639 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdea0015020 con 0x7fdea406f680 2023-10-01T07:57:50.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.678+0000 7f82bcd85700 1 Processor -- start 2023-10-01T07:57:50.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.678+0000 7f82bcd85700 1 -- start start 2023-10-01T07:57:50.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.679+0000 7f82bcd85700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82b809d6f0 0x7f82b809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:50.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.679+0000 7f82bcd85700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82b809e410 0x7f82b8134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:50.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.679+0000 7f82bcd85700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82b809b120 con 0x7f82b809e000 2023-10-01T07:57:50.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.679+0000 7f82bcd85700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b806b460 con 0x7f82b809d6f0 2023-10-01T07:57:50.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.679+0000 7f82bcd85700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82b809a7e0 con 0x7f82b809e410 2023-10-01T07:57:50.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.679+0000 7f82b659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82b809d6f0 0x7f82b809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:50.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.679+0000 7f82b5d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f82b809e000 0x7f82b81339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48282/0 (socket says 172.21.15.26:48282) 2023-10-01T07:57:50.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.679+0000 7f82b5d9b700 1 -- 172.21.15.26:0/2141931876 learned_addr learned my addr 172.21.15.26:0/2141931876 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:50.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.679+0000 7f82b6d9d700 1 --2- 172.21.15.26:0/2141931876 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82b809e410 0x7f82b8134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:50.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.680+0000 7f82b559a700 1 -- 172.21.15.26:0/2141931876 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3998615201 0 0) 0x7f82b809b120 con 0x7f82b809e000 2023-10-01T07:57:50.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.680+0000 7f82b559a700 1 -- 172.21.15.26:0/2141931876 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82a00035b0 con 0x7f82b809e000 2023-10-01T07:57:50.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.680+0000 7f82b659c700 1 -- 172.21.15.26:0/2141931876 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82b809e410 msgr2=0x7f82b8134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:50.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.680+0000 7f82b659c700 1 --2- 172.21.15.26:0/2141931876 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82b809e410 0x7f82b8134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:50.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.680+0000 7f82b659c700 1 -- 172.21.15.26:0/2141931876 >> v1:172.21.15.26:6789/0 conn(0x7f82b809e000 legacy=0x7f82b81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:50.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.680+0000 7f82b659c700 1 -- 172.21.15.26:0/2141931876 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b809a500 con 0x7f82b809d6f0 2023-10-01T07:57:50.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.680+0000 7f82b6d9d700 1 --2- 172.21.15.26:0/2141931876 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82b809e410 0x7f82b8134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:50.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.680+0000 7f82b659c700 1 --2- 172.21.15.26:0/2141931876 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82b809d6f0 0x7f82b809dac0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f82a8009870 tx=0x7f82a8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec794819eaf7ea37 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:50.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.680+0000 7f82b559a700 1 -- 172.21.15.26:0/2141931876 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a8011830 con 0x7f82b809d6f0 2023-10-01T07:57:50.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.680+0000 7f82b559a700 1 -- 172.21.15.26:0/2141931876 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a8011990 con 0x7f82b809d6f0 2023-10-01T07:57:50.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.680+0000 7f82b559a700 1 -- 172.21.15.26:0/2141931876 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a8011d00 con 0x7f82b809d6f0 2023-10-01T07:57:50.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.681+0000 7f82bcd85700 1 -- 172.21.15.26:0/2141931876 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82b809d6f0 msgr2=0x7f82b809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:50.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.681+0000 7f82bcd85700 1 --2- 172.21.15.26:0/2141931876 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82b809d6f0 0x7f82b809dac0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f82a8009870 tx=0x7f82a8009b80 comp rx=0 tx=0).stop 2023-10-01T07:57:50.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.681+0000 7f82bcd85700 1 -- 172.21.15.26:0/2141931876 shutdown_connections 2023-10-01T07:57:50.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.681+0000 7f82bcd85700 1 --2- 172.21.15.26:0/2141931876 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82b809e410 0x7f82b8134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:50.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.681+0000 7f82bcd85700 1 --2- 172.21.15.26:0/2141931876 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82b809d6f0 0x7f82b809dac0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:50.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.681+0000 7f82bcd85700 1 -- 172.21.15.26:0/2141931876 >> 172.21.15.26:0/2141931876 conn(0x7f82b8066f50 msgr2=0x7f82b809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:50.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.681+0000 7f82bcd85700 1 -- 172.21.15.26:0/2141931876 shutdown_connections 2023-10-01T07:57:50.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.681+0000 7f82bcd85700 1 -- 172.21.15.26:0/2141931876 wait complete. 2023-10-01T07:57:50.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.683+0000 7f82bcd85700 1 Processor -- start 2023-10-01T07:57:50.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.683+0000 7f82bcd85700 1 -- start start 2023-10-01T07:57:50.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.684+0000 7f82bcd85700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82b809d6f0 0x7f82b81c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:50.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.684+0000 7f82bcd85700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82b809e000 0x7f82b81c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:50.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.684+0000 7f82bcd85700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82b809e410 0x7f82b81c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:50.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.684+0000 7f82bcd85700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b809c710 con 0x7f82b809d6f0 2023-10-01T07:57:50.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.684+0000 7f82bcd85700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b81a6950 con 0x7f82b809e410 2023-10-01T07:57:50.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.684+0000 7f82bcd85700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82b80a1e90 con 0x7f82b809e000 2023-10-01T07:57:50.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.684+0000 7f82b5d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82b809e000 0x7f82b81c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:50.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.684+0000 7f82b659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82b809d6f0 0x7f82b81c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:50.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.684+0000 7f82b5d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82b809e000 0x7f82b81c8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47274/0 (socket says 172.21.15.26:47274) 2023-10-01T07:57:50.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.684+0000 7f82b5d9b700 1 -- 172.21.15.26:0/4189122397 learned_addr learned my addr 172.21.15.26:0/4189122397 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:50.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.684+0000 7f82b6d9d700 1 --2- 172.21.15.26:0/4189122397 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82b809e410 0x7f82b81c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:50.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.684+0000 7f82b5d9b700 1 -- 172.21.15.26:0/4189122397 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82b809e410 msgr2=0x7f82b81c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:50.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.684+0000 7f82b5d9b700 1 --2- 172.21.15.26:0/4189122397 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82b809e410 0x7f82b81c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:50.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.684+0000 7f82b5d9b700 1 -- 172.21.15.26:0/4189122397 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82b809d6f0 msgr2=0x7f82b81c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:50.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.684+0000 7f82b5d9b700 1 --2- 172.21.15.26:0/4189122397 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82b809d6f0 0x7f82b81c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:50.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.684+0000 7f82b5d9b700 1 -- 172.21.15.26:0/4189122397 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b0009a70 con 0x7f82b809e000 2023-10-01T07:57:50.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.685+0000 7f82b659c700 1 --2- 172.21.15.26:0/4189122397 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82b809d6f0 0x7f82b81c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:50.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.685+0000 7f82b5d9b700 1 --2- 172.21.15.26:0/4189122397 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82b809e000 0x7f82b81c8560 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f82ac00c700 tx=0x7f82ac00ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:50.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.685+0000 7f82a6ffd700 1 -- 172.21.15.26:0/4189122397 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac005d70 con 0x7f82b809e000 2023-10-01T07:57:50.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.685+0000 7f82a6ffd700 1 -- 172.21.15.26:0/4189122397 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ac0070d0 con 0x7f82b809e000 2023-10-01T07:57:50.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.685+0000 7f82bcd85700 1 -- 172.21.15.26:0/4189122397 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a80094a0 con 0x7f82b809e000 2023-10-01T07:57:50.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.685+0000 7f82a6ffd700 1 -- 172.21.15.26:0/4189122397 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac007460 con 0x7f82b809e000 2023-10-01T07:57:50.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.685+0000 7f82bcd85700 1 -- 172.21.15.26:0/4189122397 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b81a7fd0 con 0x7f82b809e000 2023-10-01T07:57:50.690 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:50.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.686+0000 7f82a6ffd700 1 -- 172.21.15.26:0/4189122397 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f82ac0075c0 con 0x7f82b809e000 2023-10-01T07:57:50.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.686+0000 7f82a6ffd700 1 -- 172.21.15.26:0/4189122397 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f82ac03eb40 con 0x7f82b809e000 2023-10-01T07:57:50.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.686+0000 7f82bcd85700 1 -- 172.21.15.26:0/4189122397 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82b81a7c70 con 0x7f82b809e000 2023-10-01T07:57:50.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.691+0000 7f82a6ffd700 1 -- 172.21.15.26:0/4189122397 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f82ac00f260 con 0x7f82b809e000 2023-10-01T07:57:50.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.746+0000 7f3720b6e700 1 Processor -- start 2023-10-01T07:57:50.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.746+0000 7f3720b6e700 1 -- start start 2023-10-01T07:57:50.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.747+0000 7f3720b6e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f371c09d6f0 0x7f371c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:50.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.747+0000 7f3720b6e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f371c09e000 0x7f371c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:50.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.747+0000 7f3720b6e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f371c133f30 0x7f371c1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:50.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.747+0000 7f3720b6e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f371c09b0f0 con 0x7f371c09e000 2023-10-01T07:57:50.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.747+0000 7f3720b6e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f371c09d2f0 con 0x7f371c09d6f0 2023-10-01T07:57:50.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.747+0000 7f3720b6e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f371c09a810 con 0x7f371c133f30 2023-10-01T07:57:50.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.747+0000 7f371ad9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f371c133f30 0x7f371c1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:50.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.747+0000 7f371ad9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f371c133f30 0x7f371c1343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47288/0 (socket says 172.21.15.26:47288) 2023-10-01T07:57:50.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.747+0000 7f371ad9d700 1 -- 172.21.15.26:0/1126855669 learned_addr learned my addr 172.21.15.26:0/1126855669 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:50.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.747+0000 7f371a59c700 1 --2- 172.21.15.26:0/1126855669 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f371c09d6f0 0x7f371c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:50.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.747+0000 7f3719d9b700 1 --2- 172.21.15.26:0/1126855669 >> v2:172.21.15.26:3300/0 conn(0x7f371c09e000 0x7f371c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:50.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.747+0000 7f371ad9d700 1 -- 172.21.15.26:0/1126855669 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f371c09d6f0 msgr2=0x7f371c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:50.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.747+0000 7f371ad9d700 1 --2- 172.21.15.26:0/1126855669 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f371c09d6f0 0x7f371c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:50.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.747+0000 7f371ad9d700 1 -- 172.21.15.26:0/1126855669 >> v2:172.21.15.26:3300/0 conn(0x7f371c09e000 msgr2=0x7f371c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:50.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.747+0000 7f371ad9d700 1 --2- 172.21.15.26:0/1126855669 >> v2:172.21.15.26:3300/0 conn(0x7f371c09e000 0x7f371c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:50.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.747+0000 7f371ad9d700 1 -- 172.21.15.26:0/1126855669 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371c09a470 con 0x7f371c133f30 2023-10-01T07:57:50.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.748+0000 7f371ad9d700 1 --2- 172.21.15.26:0/1126855669 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f371c133f30 0x7f371c1343b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3714009e50 tx=0x7f371400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb9372d28c64ac20 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:50.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.749+0000 7f371959a700 1 -- 172.21.15.26:0/1126855669 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371400e070 con 0x7f371c133f30 2023-10-01T07:57:50.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.749+0000 7f371959a700 1 -- 172.21.15.26:0/1126855669 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371400b910 con 0x7f371c133f30 2023-10-01T07:57:50.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.749+0000 7f371959a700 1 -- 172.21.15.26:0/1126855669 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371400bcc0 con 0x7f371c133f30 2023-10-01T07:57:50.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.750+0000 7f3720b6e700 1 -- 172.21.15.26:0/1126855669 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f371c133f30 msgr2=0x7f371c1343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:50.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.750+0000 7f3720b6e700 1 --2- 172.21.15.26:0/1126855669 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f371c133f30 0x7f371c1343b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3714009e50 tx=0x7f371400b330 comp rx=0 tx=0).stop 2023-10-01T07:57:50.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.750+0000 7f3720b6e700 1 -- 172.21.15.26:0/1126855669 shutdown_connections 2023-10-01T07:57:50.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.750+0000 7f3720b6e700 1 --2- 172.21.15.26:0/1126855669 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f371c133f30 0x7f371c1343b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:50.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.750+0000 7f3720b6e700 1 --2- 172.21.15.26:0/1126855669 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f371c09d6f0 0x7f371c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:50.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.750+0000 7f3720b6e700 1 --2- 172.21.15.26:0/1126855669 >> v2:172.21.15.26:3300/0 conn(0x7f371c09e000 0x7f371c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:50.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.750+0000 7f3720b6e700 1 -- 172.21.15.26:0/1126855669 >> 172.21.15.26:0/1126855669 conn(0x7f371c066f50 msgr2=0x7f371c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:50.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.750+0000 7f3720b6e700 1 -- 172.21.15.26:0/1126855669 shutdown_connections 2023-10-01T07:57:50.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.750+0000 7f3720b6e700 1 -- 172.21.15.26:0/1126855669 wait complete. 2023-10-01T07:57:50.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.751+0000 7f3720b6e700 1 Processor -- start 2023-10-01T07:57:50.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.751+0000 7f3720b6e700 1 -- start start 2023-10-01T07:57:50.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.752+0000 7f3720b6e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f371c09d6f0 0x7f371c121390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:50.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.752+0000 7f3720b6e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f371c09e000 0x7f371c1218d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:50.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.752+0000 7f3720b6e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f371c133f30 0x7f371c121e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:50.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.752+0000 7f3720b6e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371c1249a0 con 0x7f371c09d6f0 2023-10-01T07:57:50.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.752+0000 7f3720b6e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f371c123e30 con 0x7f371c09e000 2023-10-01T07:57:50.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.752+0000 7f3720b6e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f371c09c640 con 0x7f371c133f30 2023-10-01T07:57:50.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.752+0000 7f3719d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f371c09e000 0x7f371c1218d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:50.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.752+0000 7f371a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f371c09d6f0 0x7f371c121390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:50.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.752+0000 7f3719d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f371c09e000 0x7f371c1218d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:49510/0 (socket says 172.21.15.26:49510) 2023-10-01T07:57:50.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.752+0000 7f3719d9b700 1 -- 172.21.15.26:0/1138995635 learned_addr learned my addr 172.21.15.26:0/1138995635 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:50.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.752+0000 7f371ad9d700 1 --2- 172.21.15.26:0/1138995635 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f371c133f30 0x7f371c121e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:50.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.753+0000 7f371a59c700 1 -- 172.21.15.26:0/1138995635 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f371c133f30 msgr2=0x7f371c121e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:50.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.753+0000 7f371a59c700 1 --2- 172.21.15.26:0/1138995635 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f371c133f30 0x7f371c121e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:50.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.753+0000 7f371a59c700 1 -- 172.21.15.26:0/1138995635 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f371c09e000 msgr2=0x7f371c1218d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:50.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.753+0000 7f371a59c700 1 --2- 172.21.15.26:0/1138995635 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f371c09e000 0x7f371c1218d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:50.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.753+0000 7f371a59c700 1 -- 172.21.15.26:0/1138995635 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3714009b30 con 0x7f371c09d6f0 2023-10-01T07:57:50.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.753+0000 7f3719d9b700 1 --2- 172.21.15.26:0/1138995635 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f371c09e000 0x7f371c1218d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:50.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.753+0000 7f371a59c700 1 --2- 172.21.15.26:0/1138995635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f371c09d6f0 0x7f371c121390 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f370c00e930 tx=0x7f370c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:50.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.753+0000 7f370affd700 1 -- 172.21.15.26:0/1138995635 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c013680 con 0x7f371c09d6f0 2023-10-01T07:57:50.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.753+0000 7f370affd700 1 -- 172.21.15.26:0/1138995635 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370c0137e0 con 0x7f371c09d6f0 2023-10-01T07:57:50.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.753+0000 7f3720b6e700 1 -- 172.21.15.26:0/1138995635 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f371c124640 con 0x7f371c09d6f0 2023-10-01T07:57:50.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.753+0000 7f370affd700 1 -- 172.21.15.26:0/1138995635 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c013b50 con 0x7f371c09d6f0 2023-10-01T07:57:50.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.753+0000 7f3720b6e700 1 -- 172.21.15.26:0/1138995635 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f371c132760 con 0x7f371c09d6f0 2023-10-01T07:57:50.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.755+0000 7f370affd700 1 -- 172.21.15.26:0/1138995635 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f370c013cb0 con 0x7f371c09d6f0 2023-10-01T07:57:50.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.755+0000 7f3720b6e700 1 -- 172.21.15.26:0/1138995635 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f371c074ea0 con 0x7f371c09d6f0 2023-10-01T07:57:50.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.755+0000 7f370affd700 1 -- 172.21.15.26:0/1138995635 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f370c03fa40 con 0x7f371c09d6f0 2023-10-01T07:57:50.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.760+0000 7f370affd700 1 -- 172.21.15.26:0/1138995635 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f370c017070 con 0x7f371c09d6f0 2023-10-01T07:57:50.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.844+0000 7f6656c95700 1 Processor -- start 2023-10-01T07:57:50.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.844+0000 7f6656c95700 1 -- start start 2023-10-01T07:57:50.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.845+0000 7f6656c95700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66500a0a30 0x7f66500a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:50.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.845+0000 7f6656c95700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6650138d80 0x7f665013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:50.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.845+0000 7f6656c95700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66500a2a70 con 0x7f665009d630 2023-10-01T07:57:50.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.845+0000 7f6656c95700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66500a01d0 con 0x7f6650138d80 2023-10-01T07:57:50.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.845+0000 7f6656c95700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f665009e2b0 con 0x7f66500a0a30 2023-10-01T07:57:50.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.846+0000 7f6655232700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6650138d80 0x7f665013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:50.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.846+0000 7f6654a31700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66500a0a30 0x7f66500a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:50.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.846+0000 7f6655232700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6650138d80 0x7f665013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:49518/0 (socket says 172.21.15.26:49518) 2023-10-01T07:57:50.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.846+0000 7f6655232700 1 -- 172.21.15.26:0/1129687419 learned_addr learned my addr 172.21.15.26:0/1129687419 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:50.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.846+0000 7f664ffff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f665009d630 0x7f66500a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48286/0 (socket says 172.21.15.26:48286) 2023-10-01T07:57:50.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.846+0000 7f664f7fe700 1 -- 172.21.15.26:0/1129687419 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 789462127 0 0) 0x7f66500a2a70 con 0x7f665009d630 2023-10-01T07:57:50.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.846+0000 7f6655232700 1 -- 172.21.15.26:0/1129687419 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66500a0a30 msgr2=0x7f66500a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:50.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.846+0000 7f6655232700 1 --2- 172.21.15.26:0/1129687419 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66500a0a30 0x7f66500a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:50.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.846+0000 7f6655232700 1 -- 172.21.15.26:0/1129687419 >> v1:172.21.15.26:6789/0 conn(0x7f665009d630 legacy=0x7f66500a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:50.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.846+0000 7f6655232700 1 -- 172.21.15.26:0/1129687419 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f665009dc50 con 0x7f6650138d80 2023-10-01T07:57:50.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.846+0000 7f6654a31700 1 --2- 172.21.15.26:0/1129687419 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66500a0a30 0x7f66500a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:57:50.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.846+0000 7f6655232700 1 --2- 172.21.15.26:0/1129687419 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6650138d80 0x7f665013b160 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6648009e80 tx=0x7f664800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6dbf8d22be992c4a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:50.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.846+0000 7f664f7fe700 1 -- 172.21.15.26:0/1129687419 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664800e070 con 0x7f6650138d80 2023-10-01T07:57:50.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.847+0000 7f664f7fe700 1 -- 172.21.15.26:0/1129687419 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664800b9c0 con 0x7f6650138d80 2023-10-01T07:57:50.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.847+0000 7f664f7fe700 1 -- 172.21.15.26:0/1129687419 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664800bd70 con 0x7f6650138d80 2023-10-01T07:57:50.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.847+0000 7f6656c95700 1 -- 172.21.15.26:0/1129687419 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6650138d80 msgr2=0x7f665013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:50.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.847+0000 7f6656c95700 1 --2- 172.21.15.26:0/1129687419 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6650138d80 0x7f665013b160 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6648009e80 tx=0x7f664800b330 comp rx=0 tx=0).stop 2023-10-01T07:57:50.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.847+0000 7f6656c95700 1 -- 172.21.15.26:0/1129687419 shutdown_connections 2023-10-01T07:57:50.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.848+0000 7f6656c95700 1 --2- 172.21.15.26:0/1129687419 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66500a0a30 0x7f66500a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:50.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.848+0000 7f6656c95700 1 --2- 172.21.15.26:0/1129687419 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6650138d80 0x7f665013b160 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:50.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.848+0000 7f6656c95700 1 -- 172.21.15.26:0/1129687419 >> 172.21.15.26:0/1129687419 conn(0x7f66500a3050 msgr2=0x7f66500a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:50.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.848+0000 7f6656c95700 1 -- 172.21.15.26:0/1129687419 shutdown_connections 2023-10-01T07:57:50.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.848+0000 7f6656c95700 1 -- 172.21.15.26:0/1129687419 wait complete. 2023-10-01T07:57:50.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.849+0000 7f6656c95700 1 Processor -- start 2023-10-01T07:57:50.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.849+0000 7f6656c95700 1 -- start start 2023-10-01T07:57:50.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.850+0000 7f6656c95700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f665009d630 0x7f6650120560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:50.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.850+0000 7f6656c95700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f66500a0a30 0x7f6650120aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:50.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.850+0000 7f6656c95700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6650138d80 0x7f6650120fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:50.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.850+0000 7f6656c95700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6650123770 con 0x7f6650138d80 2023-10-01T07:57:50.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.850+0000 7f6656c95700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66500a0410 con 0x7f66500a0a30 2023-10-01T07:57:50.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.850+0000 7f6656c95700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f665013aaf0 con 0x7f665009d630 2023-10-01T07:57:50.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.850+0000 7f6654a31700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f665009d630 0x7f6650120560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:50.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.850+0000 7f664ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f66500a0a30 0x7f6650120aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:50.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.850+0000 7f6654a31700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f665009d630 0x7f6650120560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47318/0 (socket says 172.21.15.26:47318) 2023-10-01T07:57:50.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.850+0000 7f6654a31700 1 -- 172.21.15.26:0/350706117 learned_addr learned my addr 172.21.15.26:0/350706117 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:50.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.851+0000 7f664ffff700 1 -- 172.21.15.26:0/350706117 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f665009d630 msgr2=0x7f6650120560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:50.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.851+0000 7f664ffff700 1 --2- 172.21.15.26:0/350706117 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f665009d630 0x7f6650120560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:50.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.851+0000 7f664ffff700 1 -- 172.21.15.26:0/350706117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6650138d80 msgr2=0x7f6650120fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:50.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.851+0000 7f664ffff700 1 --2- 172.21.15.26:0/350706117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6650138d80 0x7f6650120fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:50.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.851+0000 7f664ffff700 1 -- 172.21.15.26:0/350706117 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6648009b30 con 0x7f66500a0a30 2023-10-01T07:57:50.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.851+0000 7f664ffff700 1 --2- 172.21.15.26:0/350706117 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f66500a0a30 0x7f6650120aa0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f665006d980 tx=0x7f663c00c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:50.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.851+0000 7f664d7fa700 1 -- 172.21.15.26:0/350706117 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663c004c80 con 0x7f66500a0a30 2023-10-01T07:57:50.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.851+0000 7f664d7fa700 1 -- 172.21.15.26:0/350706117 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663c004e00 con 0x7f66500a0a30 2023-10-01T07:57:50.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.851+0000 7f664d7fa700 1 -- 172.21.15.26:0/350706117 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663c007310 con 0x7f66500a0a30 2023-10-01T07:57:50.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.851+0000 7f6656c95700 1 -- 172.21.15.26:0/350706117 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66501220d0 con 0x7f66500a0a30 2023-10-01T07:57:50.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.851+0000 7f6656c95700 1 -- 172.21.15.26:0/350706117 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66501244e0 con 0x7f66500a0a30 2023-10-01T07:57:50.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.852+0000 7f664d7fa700 1 -- 172.21.15.26:0/350706117 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f663c007470 con 0x7f66500a0a30 2023-10-01T07:57:50.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.853+0000 7f664d7fa700 1 -- 172.21.15.26:0/350706117 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f663c03f4a0 con 0x7f66500a0a30 2023-10-01T07:57:50.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.853+0000 7f6656c95700 1 -- 172.21.15.26:0/350706117 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66501239a0 con 0x7f66500a0a30 2023-10-01T07:57:50.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.862+0000 7f664d7fa700 1 -- 172.21.15.26:0/350706117 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f66501239a0 con 0x7f66500a0a30 2023-10-01T07:57:50.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.879+0000 7fdeabb2e700 1 -- 172.21.15.26:0/4116191639 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdea41233e0 con 0x7fdea406f680 2023-10-01T07:57:50.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.879+0000 7fde9a7fc700 1 -- 172.21.15.26:0/4116191639 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdea41233e0 con 0x7fdea406f680 2023-10-01T07:57:50.880 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:50.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.881+0000 7fdeabb2e700 1 -- 172.21.15.26:0/4116191639 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdea406f680 msgr2=0x7fdea411caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:50.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.881+0000 7fdeabb2e700 1 --2- 172.21.15.26:0/4116191639 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdea406f680 0x7fdea411caa0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fdea0000c00 tx=0x7fdea0004750 comp rx=0 tx=0).stop 2023-10-01T07:57:50.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.882+0000 7fdeabb2e700 1 -- 172.21.15.26:0/4116191639 shutdown_connections 2023-10-01T07:57:50.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.882+0000 7fdeabb2e700 1 --2- 172.21.15.26:0/4116191639 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdea4130670 0x7fdea411d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:50.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.882+0000 7fdeabb2e700 1 --2- 172.21.15.26:0/4116191639 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdea406f680 0x7fdea411caa0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:50.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.882+0000 7fdeabb2e700 1 --2- 172.21.15.26:0/4116191639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdea40701a0 0x7fdea411cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:50.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.882+0000 7fdeabb2e700 1 -- 172.21.15.26:0/4116191639 >> 172.21.15.26:0/4116191639 conn(0x7fdea40a2aa0 msgr2=0x7fdea412efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:50.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.882+0000 7fdeabb2e700 1 -- 172.21.15.26:0/4116191639 shutdown_connections 2023-10-01T07:57:50.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.882+0000 7fdeabb2e700 1 -- 172.21.15.26:0/4116191639 wait complete. 2023-10-01T07:57:50.896 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:50.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.940+0000 7f82bcd85700 1 -- 172.21.15.26:0/4189122397 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f82b8074ea0 con 0x7f82b809e000 2023-10-01T07:57:50.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.940+0000 7f82a6ffd700 1 -- 172.21.15.26:0/4189122397 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f82ac017020 con 0x7f82b809e000 2023-10-01T07:57:50.941 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:50.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.942+0000 7f82bcd85700 1 -- 172.21.15.26:0/4189122397 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82b809e000 msgr2=0x7f82b81c8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:50.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.942+0000 7f82bcd85700 1 --2- 172.21.15.26:0/4189122397 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82b809e000 0x7f82b81c8560 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f82ac00c700 tx=0x7f82ac00ca10 comp rx=0 tx=0).stop 2023-10-01T07:57:50.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.942+0000 7f82bcd85700 1 -- 172.21.15.26:0/4189122397 shutdown_connections 2023-10-01T07:57:50.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.942+0000 7f82bcd85700 1 --2- 172.21.15.26:0/4189122397 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82b809e410 0x7f82b81c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:50.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.942+0000 7f82bcd85700 1 --2- 172.21.15.26:0/4189122397 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82b809d6f0 0x7f82b81c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:50.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.942+0000 7f82bcd85700 1 --2- 172.21.15.26:0/4189122397 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82b809e000 0x7f82b81c8560 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:50.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.943+0000 7f82bcd85700 1 -- 172.21.15.26:0/4189122397 >> 172.21.15.26:0/4189122397 conn(0x7f82b8066f50 msgr2=0x7f82b806f270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:50.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.943+0000 7f82bcd85700 1 -- 172.21.15.26:0/4189122397 shutdown_connections 2023-10-01T07:57:50.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.943+0000 7f82bcd85700 1 -- 172.21.15.26:0/4189122397 wait complete. 2023-10-01T07:57:50.958 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:50.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.971+0000 7f3720b6e700 1 -- 172.21.15.26:0/1138995635 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f371c06c360 con 0x7f371c09d6f0 2023-10-01T07:57:50.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.971+0000 7f370affd700 1 -- 172.21.15.26:0/1138995635 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f370c01abe0 con 0x7f371c09d6f0 2023-10-01T07:57:50.973 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:50.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.974+0000 7f3720b6e700 1 -- 172.21.15.26:0/1138995635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f371c09d6f0 msgr2=0x7f371c121390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:50.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.974+0000 7f3720b6e700 1 --2- 172.21.15.26:0/1138995635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f371c09d6f0 0x7f371c121390 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f370c00e930 tx=0x7f370c00ec40 comp rx=0 tx=0).stop 2023-10-01T07:57:50.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.974+0000 7f3720b6e700 1 -- 172.21.15.26:0/1138995635 shutdown_connections 2023-10-01T07:57:50.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.974+0000 7f3720b6e700 1 --2- 172.21.15.26:0/1138995635 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f371c133f30 0x7f371c121e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:50.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.974+0000 7f3720b6e700 1 --2- 172.21.15.26:0/1138995635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f371c09d6f0 0x7f371c121390 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:50.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.974+0000 7f3720b6e700 1 --2- 172.21.15.26:0/1138995635 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f371c09e000 0x7f371c1218d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:50.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.974+0000 7f3720b6e700 1 -- 172.21.15.26:0/1138995635 >> 172.21.15.26:0/1138995635 conn(0x7f371c066f50 msgr2=0x7f371c133290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:50.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.974+0000 7f3720b6e700 1 -- 172.21.15.26:0/1138995635 shutdown_connections 2023-10-01T07:57:50.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:50.974+0000 7f3720b6e700 1 -- 172.21.15.26:0/1138995635 wait complete. 2023-10-01T07:57:50.988 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:51.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:51.083+0000 7f6656c95700 1 -- 172.21.15.26:0/350706117 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f66501239a0 con 0x7f66500a0a30 2023-10-01T07:57:51.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:51.084+0000 7f664d7fa700 1 -- 172.21.15.26:0/350706117 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f66501239a0 con 0x7f66500a0a30 2023-10-01T07:57:51.084 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:51.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:51.086+0000 7f6656c95700 1 -- 172.21.15.26:0/350706117 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f66500a0a30 msgr2=0x7f6650120aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:51.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:51.086+0000 7f6656c95700 1 --2- 172.21.15.26:0/350706117 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f66500a0a30 0x7f6650120aa0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f665006d980 tx=0x7f663c00c790 comp rx=0 tx=0).stop 2023-10-01T07:57:51.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:51.086+0000 7f6656c95700 1 -- 172.21.15.26:0/350706117 shutdown_connections 2023-10-01T07:57:51.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:51.086+0000 7f6656c95700 1 --2- 172.21.15.26:0/350706117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6650138d80 0x7f6650120fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:51.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:51.086+0000 7f6656c95700 1 --2- 172.21.15.26:0/350706117 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f665009d630 0x7f6650120560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:51.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:51.086+0000 7f6656c95700 1 --2- 172.21.15.26:0/350706117 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f66500a0a30 0x7f6650120aa0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:51.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:51.086+0000 7f6656c95700 1 -- 172.21.15.26:0/350706117 >> 172.21.15.26:0/350706117 conn(0x7f66500a3050 msgr2=0x7f665009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:51.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:51.086+0000 7f6656c95700 1 -- 172.21.15.26:0/350706117 shutdown_connections 2023-10-01T07:57:51.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:51.086+0000 7f6656c95700 1 -- 172.21.15.26:0/350706117 wait complete. 2023-10-01T07:57:51.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:51.897 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:51.959 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:51.989 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:52.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.046+0000 7ff3cc816700 1 Processor -- start 2023-10-01T07:57:52.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.046+0000 7ff3cc816700 1 -- start start 2023-10-01T07:57:52.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.047+0000 7ff3cc816700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff3c809e1d0 0x7ff3c8138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:52.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.047+0000 7ff3cc816700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff3c8139170 0x7ff3c813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:52.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.047+0000 7ff3cc816700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3c809b120 con 0x7ff3c809d6f0 2023-10-01T07:57:52.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.047+0000 7ff3cc816700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c806b460 con 0x7ff3c8139170 2023-10-01T07:57:52.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.047+0000 7ff3cc816700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c809a7e0 con 0x7ff3c809e1d0 2023-10-01T07:57:52.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.047+0000 7ff3c6d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff3c8139170 0x7ff3c813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:52.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.047+0000 7ff3c5d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff3c809e1d0 0x7ff3c8138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:52.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.047+0000 7ff3c5d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff3c809e1d0 0x7ff3c8138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:49546/0 (socket says 172.21.15.26:49546) 2023-10-01T07:57:52.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.047+0000 7ff3c6d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff3c8139170 0x7ff3c813b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34558/0 (socket says 172.21.15.26:34558) 2023-10-01T07:57:52.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.047+0000 7ff3c5d9b700 1 -- 172.21.15.26:0/1466321307 learned_addr learned my addr 172.21.15.26:0/1466321307 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:52.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.047+0000 7ff3c6d9d700 1 -- 172.21.15.26:0/1466321307 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff3c809e1d0 msgr2=0x7ff3c8138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:52.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.047+0000 7ff3c6d9d700 1 --2- 172.21.15.26:0/1466321307 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff3c809e1d0 0x7ff3c8138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:52.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.047+0000 7ff3c6d9d700 1 -- 172.21.15.26:0/1466321307 >> v1:172.21.15.26:6789/0 conn(0x7ff3c809d6f0 legacy=0x7ff3c809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:52.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.047+0000 7ff3c6d9d700 1 -- 172.21.15.26:0/1466321307 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c809a500 con 0x7ff3c8139170 2023-10-01T07:57:52.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.047+0000 7ff3c5d9b700 1 --2- 172.21.15.26:0/1466321307 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff3c809e1d0 0x7ff3c8138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:52.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.048+0000 7ff3c6d9d700 1 --2- 172.21.15.26:0/1466321307 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3c8139170 0x7ff3c813b550 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0009d90 tx=0x7ff3c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3cf282afb7369a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:52.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.048+0000 7ff3c559a700 1 -- 172.21.15.26:0/1466321307 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c000e070 con 0x7ff3c8139170 2023-10-01T07:57:52.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.048+0000 7ff3c559a700 1 -- 172.21.15.26:0/1466321307 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c000bb20 con 0x7ff3c8139170 2023-10-01T07:57:52.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.048+0000 7ff3c559a700 1 -- 172.21.15.26:0/1466321307 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0012430 con 0x7ff3c8139170 2023-10-01T07:57:52.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.049+0000 7ff3cc816700 1 -- 172.21.15.26:0/1466321307 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3c8139170 msgr2=0x7ff3c813b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:52.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.049+0000 7ff3cc816700 1 --2- 172.21.15.26:0/1466321307 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3c8139170 0x7ff3c813b550 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0009d90 tx=0x7ff3c000b330 comp rx=0 tx=0).stop 2023-10-01T07:57:52.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.049+0000 7ff3cc816700 1 -- 172.21.15.26:0/1466321307 shutdown_connections 2023-10-01T07:57:52.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.049+0000 7ff3cc816700 1 --2- 172.21.15.26:0/1466321307 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3c8139170 0x7ff3c813b550 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:52.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.049+0000 7ff3cc816700 1 --2- 172.21.15.26:0/1466321307 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff3c809e1d0 0x7ff3c8138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:52.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.049+0000 7ff3cc816700 1 -- 172.21.15.26:0/1466321307 >> 172.21.15.26:0/1466321307 conn(0x7ff3c8066f50 msgr2=0x7ff3c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:52.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.049+0000 7ff3cc816700 1 -- 172.21.15.26:0/1466321307 shutdown_connections 2023-10-01T07:57:52.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.049+0000 7ff3cc816700 1 -- 172.21.15.26:0/1466321307 wait complete. 2023-10-01T07:57:52.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.050+0000 7ff3cc816700 1 Processor -- start 2023-10-01T07:57:52.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.050+0000 7ff3cc816700 1 -- start start 2023-10-01T07:57:52.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.050+0000 7ff3cc816700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff3c809d6f0 0x7ff3c81c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:52.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.050+0000 7ff3cc816700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff3c809e1d0 0x7ff3c81c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:52.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.050+0000 7ff3cc816700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3c8139170 0x7ff3c8121770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:52.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.050+0000 7ff3cc816700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c8123330 con 0x7ff3c8139170 2023-10-01T07:57:52.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.051+0000 7ff3cc816700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c809c710 con 0x7ff3c809d6f0 2023-10-01T07:57:52.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.051+0000 7ff3cc816700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c8124fd0 con 0x7ff3c809e1d0 2023-10-01T07:57:52.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.051+0000 7ff3c6d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3c8139170 0x7ff3c8121770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:52.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.051+0000 7ff3c5d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff3c809e1d0 0x7ff3c81c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:52.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.051+0000 7ff3c659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff3c809d6f0 0x7ff3c81c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:52.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.051+0000 7ff3c6d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3c8139170 0x7ff3c8121770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34562/0 (socket says 172.21.15.26:34562) 2023-10-01T07:57:52.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.051+0000 7ff3c6d9d700 1 -- 172.21.15.26:0/179412170 learned_addr learned my addr 172.21.15.26:0/179412170 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:52.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.051+0000 7ff3c6d9d700 1 -- 172.21.15.26:0/179412170 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff3c809e1d0 msgr2=0x7ff3c81c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:52.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.051+0000 7ff3c6d9d700 1 --2- 172.21.15.26:0/179412170 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff3c809e1d0 0x7ff3c81c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:52.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.051+0000 7ff3c6d9d700 1 -- 172.21.15.26:0/179412170 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff3c809d6f0 msgr2=0x7ff3c81c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:52.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.051+0000 7ff3c6d9d700 1 --2- 172.21.15.26:0/179412170 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff3c809d6f0 0x7ff3c81c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:52.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.051+0000 7ff3c6d9d700 1 -- 172.21.15.26:0/179412170 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3bc009550 con 0x7ff3c8139170 2023-10-01T07:57:52.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.051+0000 7ff3c5d9b700 1 --2- 172.21.15.26:0/179412170 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff3c809e1d0 0x7ff3c81c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:52.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.051+0000 7ff3c6d9d700 1 --2- 172.21.15.26:0/179412170 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3c8139170 0x7ff3c8121770 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7ff3c000b680 tx=0x7ff3c0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:52.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.052+0000 7ff3b6ffd700 1 -- 172.21.15.26:0/179412170 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0012430 con 0x7ff3c8139170 2023-10-01T07:57:52.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.052+0000 7ff3b6ffd700 1 -- 172.21.15.26:0/179412170 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c0020070 con 0x7ff3c8139170 2023-10-01T07:57:52.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.052+0000 7ff3cc816700 1 -- 172.21.15.26:0/179412170 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c0009a70 con 0x7ff3c8139170 2023-10-01T07:57:52.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.052+0000 7ff3b6ffd700 1 -- 172.21.15.26:0/179412170 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c001ba70 con 0x7ff3c8139170 2023-10-01T07:57:52.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.052+0000 7ff3cc816700 1 -- 172.21.15.26:0/179412170 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3c81375f0 con 0x7ff3c8139170 2023-10-01T07:57:52.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.053+0000 7ff3b6ffd700 1 -- 172.21.15.26:0/179412170 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff3c001bbd0 con 0x7ff3c8139170 2023-10-01T07:57:52.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.053+0000 7ff3cc816700 1 -- 172.21.15.26:0/179412170 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c8074ea0 con 0x7ff3c8139170 2023-10-01T07:57:52.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.053+0000 7ff3b6ffd700 1 -- 172.21.15.26:0/179412170 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff3c0022070 con 0x7ff3c8139170 2023-10-01T07:57:52.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.062+0000 7ff3b6ffd700 1 -- 172.21.15.26:0/179412170 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff3c0024740 con 0x7ff3c8139170 2023-10-01T07:57:52.101 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:52.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.102+0000 7f47581d1700 1 Processor -- start 2023-10-01T07:57:52.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.103+0000 7f47581d1700 1 -- start start 2023-10-01T07:57:52.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.103+0000 7f47581d1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f475009d6f0 0x7f475009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:52.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.103+0000 7f47581d1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f475009e000 0x7f47501339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:52.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.103+0000 7f47581d1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f475009b120 con 0x7f475009e410 2023-10-01T07:57:52.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.103+0000 7f47581d1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475006b460 con 0x7f475009d6f0 2023-10-01T07:57:52.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.103+0000 7f47581d1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f475009a7e0 con 0x7f475009e000 2023-10-01T07:57:52.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.103+0000 7f4755f6d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f475009d6f0 0x7f475009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:52.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.103+0000 7f4755f6d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f475009d6f0 0x7f475009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:49564/0 (socket says 172.21.15.26:49564) 2023-10-01T07:57:52.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.103+0000 7f4755f6d700 1 -- 172.21.15.26:0/1248489846 learned_addr learned my addr 172.21.15.26:0/1248489846 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:52.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.104+0000 7f475576c700 1 --2- 172.21.15.26:0/1248489846 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f475009e000 0x7f47501339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:52.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.104+0000 7f4754f6b700 1 -- 172.21.15.26:0/1248489846 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3243937825 0 0) 0x7f475009b120 con 0x7f475009e410 2023-10-01T07:57:52.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.104+0000 7f4755f6d700 1 -- 172.21.15.26:0/1248489846 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f475009e000 msgr2=0x7f47501339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:52.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.104+0000 7f4755f6d700 1 --2- 172.21.15.26:0/1248489846 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f475009e000 0x7f47501339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:52.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.104+0000 7f4755f6d700 1 -- 172.21.15.26:0/1248489846 >> v1:172.21.15.26:6789/0 conn(0x7f475009e410 legacy=0x7f4750133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:52.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.104+0000 7f4755f6d700 1 -- 172.21.15.26:0/1248489846 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f475009a500 con 0x7f475009d6f0 2023-10-01T07:57:52.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.104+0000 7f4755f6d700 1 --2- 172.21.15.26:0/1248489846 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f475009d6f0 0x7f475009dac0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f474c009920 tx=0x7f474c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a34ca9d56f13cb43 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:52.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.104+0000 7f4754f6b700 1 -- 172.21.15.26:0/1248489846 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c011830 con 0x7f475009d6f0 2023-10-01T07:57:52.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.105+0000 7f4754f6b700 1 -- 172.21.15.26:0/1248489846 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474c011990 con 0x7f475009d6f0 2023-10-01T07:57:52.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.105+0000 7f4754f6b700 1 -- 172.21.15.26:0/1248489846 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c011d20 con 0x7f475009d6f0 2023-10-01T07:57:52.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.105+0000 7f47581d1700 1 -- 172.21.15.26:0/1248489846 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f475009d6f0 msgr2=0x7f475009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:52.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.105+0000 7f47581d1700 1 --2- 172.21.15.26:0/1248489846 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f475009d6f0 0x7f475009dac0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f474c009920 tx=0x7f474c009c30 comp rx=0 tx=0).stop 2023-10-01T07:57:52.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.105+0000 7f47581d1700 1 -- 172.21.15.26:0/1248489846 shutdown_connections 2023-10-01T07:57:52.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.105+0000 7f47581d1700 1 --2- 172.21.15.26:0/1248489846 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f475009d6f0 0x7f475009dac0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:52.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.105+0000 7f47581d1700 1 --2- 172.21.15.26:0/1248489846 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f475009e000 0x7f47501339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:52.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.105+0000 7f47581d1700 1 -- 172.21.15.26:0/1248489846 >> 172.21.15.26:0/1248489846 conn(0x7f4750066f50 msgr2=0x7f475009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:52.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.106+0000 7f47581d1700 1 -- 172.21.15.26:0/1248489846 shutdown_connections 2023-10-01T07:57:52.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.106+0000 7f47581d1700 1 -- 172.21.15.26:0/1248489846 wait complete. 2023-10-01T07:57:52.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.107+0000 7f47581d1700 1 Processor -- start 2023-10-01T07:57:52.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.107+0000 7f47581d1700 1 -- start start 2023-10-01T07:57:52.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.107+0000 7f47581d1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f475009d6f0 0x7f47501c0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:52.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.107+0000 7f47581d1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f475009e000 0x7f47501c11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:52.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.107+0000 7f47581d1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f475009e410 0x7f47501c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:52.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.107+0000 7f47581d1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475011e410 con 0x7f475009e410 2023-10-01T07:57:52.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.107+0000 7f47581d1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4750130420 con 0x7f475009d6f0 2023-10-01T07:57:52.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.107+0000 7f47581d1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f475011bf80 con 0x7f475009e000 2023-10-01T07:57:52.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.107+0000 7f475676e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f475009e410 0x7f47501c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:52.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.107+0000 7f475576c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f475009e000 0x7f47501c11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:52.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.107+0000 7f475676e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f475009e410 0x7f47501c3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34576/0 (socket says 172.21.15.26:34576) 2023-10-01T07:57:52.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.107+0000 7f475676e700 1 -- 172.21.15.26:0/1119243197 learned_addr learned my addr 172.21.15.26:0/1119243197 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:52.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.107+0000 7f4755f6d700 1 --2- 172.21.15.26:0/1119243197 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f475009d6f0 0x7f47501c0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:52.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.108+0000 7f475576c700 1 -- 172.21.15.26:0/1119243197 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f475009d6f0 msgr2=0x7f47501c0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:52.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.108+0000 7f475576c700 1 --2- 172.21.15.26:0/1119243197 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f475009d6f0 0x7f47501c0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:52.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.108+0000 7f475576c700 1 -- 172.21.15.26:0/1119243197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f475009e410 msgr2=0x7f47501c3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:52.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.108+0000 7f475576c700 1 --2- 172.21.15.26:0/1119243197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f475009e410 0x7f47501c3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:52.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.108+0000 7f475576c700 1 -- 172.21.15.26:0/1119243197 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f474c009550 con 0x7f475009e000 2023-10-01T07:57:52.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.108+0000 7f4755f6d700 1 --2- 172.21.15.26:0/1119243197 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f475009d6f0 0x7f47501c0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:52.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.108+0000 7f475576c700 1 --2- 172.21.15.26:0/1119243197 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f475009e000 0x7f47501c11b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f47400140f0 tx=0x7f4740014400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:52.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.108+0000 7f47467fc700 1 -- 172.21.15.26:0/1119243197 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4740014e90 con 0x7f475009e000 2023-10-01T07:57:52.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.108+0000 7f47467fc700 1 -- 172.21.15.26:0/1119243197 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4740016030 con 0x7f475009e000 2023-10-01T07:57:52.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.108+0000 7f47467fc700 1 -- 172.21.15.26:0/1119243197 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4740011310 con 0x7f475009e000 2023-10-01T07:57:52.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.108+0000 7f47581d1700 1 -- 172.21.15.26:0/1119243197 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f475011d900 con 0x7f475009e000 2023-10-01T07:57:52.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.108+0000 7f47581d1700 1 -- 172.21.15.26:0/1119243197 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f475011c6e0 con 0x7f475009e000 2023-10-01T07:57:52.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.109+0000 7f47467fc700 1 -- 172.21.15.26:0/1119243197 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4740011470 con 0x7f475009e000 2023-10-01T07:57:52.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.110+0000 7f47467fc700 1 -- 172.21.15.26:0/1119243197 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4740047d20 con 0x7f475009e000 2023-10-01T07:57:52.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.110+0000 7f47581d1700 1 -- 172.21.15.26:0/1119243197 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4750074ea0 con 0x7f475009e000 2023-10-01T07:57:52.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.115+0000 7f47467fc700 1 -- 172.21.15.26:0/1119243197 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f474001a700 con 0x7f475009e000 2023-10-01T07:57:52.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.158+0000 7f10f4b02700 1 Processor -- start 2023-10-01T07:57:52.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.159+0000 7f10f4b02700 1 -- start start 2023-10-01T07:57:52.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.160+0000 7f10f4b02700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f10f009e1d0 0x7f10f0135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:52.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.160+0000 7f10f4b02700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f10f0135e50 0x7f10f0138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:52.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.160+0000 7f10f4b02700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f009f130 con 0x7f10f009d6f0 2023-10-01T07:57:52.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.160+0000 7f10f4b02700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f009f520 con 0x7f10f0135e50 2023-10-01T07:57:52.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.160+0000 7f10f4b02700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10f009e930 con 0x7f10f009e1d0 2023-10-01T07:57:52.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.160+0000 7f10eed9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f10f0135e50 0x7f10f0138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:52.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.160+0000 7f10edd9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f10f009e1d0 0x7f10f0135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:52.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.160+0000 7f10ee59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f10f009d6f0 0x7f10f009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48302/0 (socket says 172.21.15.26:48302) 2023-10-01T07:57:52.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.160+0000 7f10eed9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f10f0135e50 0x7f10f0138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34582/0 (socket says 172.21.15.26:34582) 2023-10-01T07:57:52.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.160+0000 7f10ee59c700 1 -- 172.21.15.26:0/3922728985 learned_addr learned my addr 172.21.15.26:0/3922728985 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:52.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.160+0000 7f10edd9b700 1 -- 172.21.15.26:0/3922728985 >> v2:172.21.15.26:3300/0 conn(0x7f10f0135e50 msgr2=0x7f10f0138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:52.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.160+0000 7f10edd9b700 1 --2- 172.21.15.26:0/3922728985 >> v2:172.21.15.26:3300/0 conn(0x7f10f0135e50 0x7f10f0138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:52.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.160+0000 7f10edd9b700 1 -- 172.21.15.26:0/3922728985 >> v1:172.21.15.26:6789/0 conn(0x7f10f009d6f0 legacy=0x7f10f009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:52.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.160+0000 7f10edd9b700 1 -- 172.21.15.26:0/3922728985 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f009b2d0 con 0x7f10f009e1d0 2023-10-01T07:57:52.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.160+0000 7f10edd9b700 1 --2- 172.21.15.26:0/3922728985 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f10f009e1d0 0x7f10f0135910 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f10e4009870 tx=0x7f10e4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d7173b51103c002 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:52.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.161+0000 7f10ed59a700 1 -- 172.21.15.26:0/3922728985 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e4011830 con 0x7f10f009e1d0 2023-10-01T07:57:52.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.161+0000 7f10ed59a700 1 -- 172.21.15.26:0/3922728985 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e4011990 con 0x7f10f009e1d0 2023-10-01T07:57:52.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.161+0000 7f10ed59a700 1 -- 172.21.15.26:0/3922728985 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e4011d20 con 0x7f10f009e1d0 2023-10-01T07:57:52.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.161+0000 7f10f4b02700 1 -- 172.21.15.26:0/3922728985 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f10f009e1d0 msgr2=0x7f10f0135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:52.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.161+0000 7f10f4b02700 1 --2- 172.21.15.26:0/3922728985 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f10f009e1d0 0x7f10f0135910 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f10e4009870 tx=0x7f10e4009b80 comp rx=0 tx=0).stop 2023-10-01T07:57:52.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.162+0000 7f10f4b02700 1 -- 172.21.15.26:0/3922728985 shutdown_connections 2023-10-01T07:57:52.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.162+0000 7f10f4b02700 1 --2- 172.21.15.26:0/3922728985 >> v2:172.21.15.26:3300/0 conn(0x7f10f0135e50 0x7f10f0138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:52.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.162+0000 7f10f4b02700 1 --2- 172.21.15.26:0/3922728985 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f10f009e1d0 0x7f10f0135910 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:52.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.162+0000 7f10f4b02700 1 -- 172.21.15.26:0/3922728985 >> 172.21.15.26:0/3922728985 conn(0x7f10f0066f50 msgr2=0x7f10f009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:52.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.162+0000 7f10f4b02700 1 -- 172.21.15.26:0/3922728985 shutdown_connections 2023-10-01T07:57:52.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.162+0000 7f10f4b02700 1 -- 172.21.15.26:0/3922728985 wait complete. 2023-10-01T07:57:52.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.163+0000 7f10f4b02700 1 Processor -- start 2023-10-01T07:57:52.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.164+0000 7f10f4b02700 1 -- start start 2023-10-01T07:57:52.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.164+0000 7f10f4b02700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10f009d6f0 0x7f10f011d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:52.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.164+0000 7f10f4b02700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f10f009e1d0 0x7f10f011dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:52.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.164+0000 7f10f4b02700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10f0135e50 0x7f10f011e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:52.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.164+0000 7f10f4b02700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f011eb10 con 0x7f10f009d6f0 2023-10-01T07:57:52.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.164+0000 7f10f4b02700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f006b4b0 con 0x7f10f0135e50 2023-10-01T07:57:52.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.164+0000 7f10f4b02700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10f006e8d0 con 0x7f10f009e1d0 2023-10-01T07:57:52.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.165+0000 7f10eed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10f0135e50 0x7f10f011e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:52.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.165+0000 7f10edd9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f10f009e1d0 0x7f10f011dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:52.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.165+0000 7f10edd9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f10f009e1d0 0x7f10f011dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47380/0 (socket says 172.21.15.26:47380) 2023-10-01T07:57:52.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.165+0000 7f10eed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10f0135e50 0x7f10f011e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:49582/0 (socket says 172.21.15.26:49582) 2023-10-01T07:57:52.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.165+0000 7f10edd9b700 1 -- 172.21.15.26:0/559721930 learned_addr learned my addr 172.21.15.26:0/559721930 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:52.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.165+0000 7f10ee59c700 1 --2- 172.21.15.26:0/559721930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10f009d6f0 0x7f10f011d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:52.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.165+0000 7f10edd9b700 1 -- 172.21.15.26:0/559721930 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10f0135e50 msgr2=0x7f10f011e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:52.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.165+0000 7f10edd9b700 1 --2- 172.21.15.26:0/559721930 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10f0135e50 0x7f10f011e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:52.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.165+0000 7f10edd9b700 1 -- 172.21.15.26:0/559721930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10f009d6f0 msgr2=0x7f10f011d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:52.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.165+0000 7f10edd9b700 1 --2- 172.21.15.26:0/559721930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10f009d6f0 0x7f10f011d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:52.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.165+0000 7f10edd9b700 1 -- 172.21.15.26:0/559721930 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e40094a0 con 0x7f10f009e1d0 2023-10-01T07:57:52.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.166+0000 7f10edd9b700 1 --2- 172.21.15.26:0/559721930 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f10f009e1d0 0x7f10f011dbe0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f10e4009840 tx=0x7f10e4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:52.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.166+0000 7f10deffd700 1 -- 172.21.15.26:0/559721930 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e4004400 con 0x7f10f009e1d0 2023-10-01T07:57:52.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.166+0000 7f10deffd700 1 -- 172.21.15.26:0/559721930 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e401f070 con 0x7f10f009e1d0 2023-10-01T07:57:52.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.166+0000 7f10f4b02700 1 -- 172.21.15.26:0/559721930 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f009c700 con 0x7f10f009e1d0 2023-10-01T07:57:52.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.166+0000 7f10deffd700 1 -- 172.21.15.26:0/559721930 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e40038e0 con 0x7f10f009e1d0 2023-10-01T07:57:52.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.166+0000 7f10f4b02700 1 -- 172.21.15.26:0/559721930 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f0120130 con 0x7f10f009e1d0 2023-10-01T07:57:52.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.167+0000 7f10deffd700 1 -- 172.21.15.26:0/559721930 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f10e4021030 con 0x7f10f009e1d0 2023-10-01T07:57:52.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.167+0000 7f10deffd700 1 -- 172.21.15.26:0/559721930 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f10e4040940 con 0x7f10f009e1d0 2023-10-01T07:57:52.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.168+0000 7f10f4b02700 1 -- 172.21.15.26:0/559721930 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f0074ea0 con 0x7f10f009e1d0 2023-10-01T07:57:52.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.177+0000 7f10deffd700 1 -- 172.21.15.26:0/559721930 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f10e4015020 con 0x7f10f009e1d0 2023-10-01T07:57:52.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.249+0000 7fd0a20e9700 1 Processor -- start 2023-10-01T07:57:52.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.249+0000 7fd0a20e9700 1 -- start start 2023-10-01T07:57:52.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.250+0000 7fd0a20e9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd09c09d6f0 0x7fd09c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:52.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.250+0000 7fd0a20e9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd09c09e000 0x7fd09c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:52.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.250+0000 7fd0a20e9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd09c09e410 0x7fd09c133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:52.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.250+0000 7fd0a20e9700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd09c06b460 con 0x7fd09c09d6f0 2023-10-01T07:57:52.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.250+0000 7fd0a20e9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c09b120 con 0x7fd09c09e000 2023-10-01T07:57:52.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.250+0000 7fd0a20e9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c09a7e0 con 0x7fd09c09e410 2023-10-01T07:57:52.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.250+0000 7fd09bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd09c09e410 0x7fd09c133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:52.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.250+0000 7fd09bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd09c09e410 0x7fd09c133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47392/0 (socket says 172.21.15.26:47392) 2023-10-01T07:57:52.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.250+0000 7fd09bfff700 1 -- 172.21.15.26:0/3061962039 learned_addr learned my addr 172.21.15.26:0/3061962039 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:52.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.250+0000 7fd09bfff700 1 -- 172.21.15.26:0/3061962039 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd09c09e000 msgr2=0x7fd09c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:52.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.250+0000 7fd09bfff700 1 --2- 172.21.15.26:0/3061962039 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd09c09e000 0x7fd09c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:52.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.250+0000 7fd09bfff700 1 -- 172.21.15.26:0/3061962039 >> v2:172.21.15.26:3300/0 conn(0x7fd09c09d6f0 msgr2=0x7fd09c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:52.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.250+0000 7fd09bfff700 1 --2- 172.21.15.26:0/3061962039 >> v2:172.21.15.26:3300/0 conn(0x7fd09c09d6f0 0x7fd09c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:52.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.250+0000 7fd09bfff700 1 -- 172.21.15.26:0/3061962039 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd09c09a500 con 0x7fd09c09e410 2023-10-01T07:57:52.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.251+0000 7fd09bfff700 1 --2- 172.21.15.26:0/3061962039 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd09c09e410 0x7fd09c133f30 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd094009e80 tx=0x7fd09400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c641b6d2ef9b766 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:52.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.251+0000 7fd09a7fc700 1 -- 172.21.15.26:0/3061962039 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09400e070 con 0x7fd09c09e410 2023-10-01T07:57:52.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.251+0000 7fd09a7fc700 1 -- 172.21.15.26:0/3061962039 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09400b980 con 0x7fd09c09e410 2023-10-01T07:57:52.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.251+0000 7fd09a7fc700 1 -- 172.21.15.26:0/3061962039 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09400bd30 con 0x7fd09c09e410 2023-10-01T07:57:52.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.252+0000 7fd0a20e9700 1 -- 172.21.15.26:0/3061962039 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd09c09e410 msgr2=0x7fd09c133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:52.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.252+0000 7fd0a20e9700 1 --2- 172.21.15.26:0/3061962039 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd09c09e410 0x7fd09c133f30 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd094009e80 tx=0x7fd09400b330 comp rx=0 tx=0).stop 2023-10-01T07:57:52.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.252+0000 7fd0a20e9700 1 -- 172.21.15.26:0/3061962039 shutdown_connections 2023-10-01T07:57:52.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.252+0000 7fd0a20e9700 1 --2- 172.21.15.26:0/3061962039 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd09c09e410 0x7fd09c133f30 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:52.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.252+0000 7fd0a20e9700 1 --2- 172.21.15.26:0/3061962039 >> v2:172.21.15.26:3300/0 conn(0x7fd09c09d6f0 0x7fd09c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:52.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.252+0000 7fd0a20e9700 1 --2- 172.21.15.26:0/3061962039 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd09c09e000 0x7fd09c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:52.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.252+0000 7fd0a20e9700 1 -- 172.21.15.26:0/3061962039 >> 172.21.15.26:0/3061962039 conn(0x7fd09c066f50 msgr2=0x7fd09c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:52.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.252+0000 7fd0a20e9700 1 -- 172.21.15.26:0/3061962039 shutdown_connections 2023-10-01T07:57:52.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.252+0000 7fd0a20e9700 1 -- 172.21.15.26:0/3061962039 wait complete. 2023-10-01T07:57:52.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.253+0000 7fd0a20e9700 1 Processor -- start 2023-10-01T07:57:52.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.254+0000 7fd0a20e9700 1 -- start start 2023-10-01T07:57:52.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.254+0000 7fd0a20e9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd09c09d6f0 0x7fd09c1a25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:52.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.254+0000 7fd0a20e9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd09c09e000 0x7fd09c1a2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:52.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.254+0000 7fd0a20e9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd09c09e410 0x7fd09c1a3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:52.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.254+0000 7fd0a20e9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c09c710 con 0x7fd09c09e000 2023-10-01T07:57:52.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.254+0000 7fd0a20e9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c1a4c80 con 0x7fd09c09d6f0 2023-10-01T07:57:52.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.254+0000 7fd0a20e9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c0a1e20 con 0x7fd09c09e410 2023-10-01T07:57:52.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.255+0000 7fd09affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd09c09e000 0x7fd09c1a2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:52.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.255+0000 7fd09affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd09c09e000 0x7fd09c1a2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34602/0 (socket says 172.21.15.26:34602) 2023-10-01T07:57:52.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.255+0000 7fd09affd700 1 -- 172.21.15.26:0/2968594054 learned_addr learned my addr 172.21.15.26:0/2968594054 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:52.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.255+0000 7fd09bfff700 1 --2- 172.21.15.26:0/2968594054 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd09c09e410 0x7fd09c1a3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:52.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.255+0000 7fd09affd700 1 -- 172.21.15.26:0/2968594054 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd09c09e410 msgr2=0x7fd09c1a3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:52.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.255+0000 7fd09affd700 1 --2- 172.21.15.26:0/2968594054 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd09c09e410 0x7fd09c1a3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:52.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.255+0000 7fd09affd700 1 -- 172.21.15.26:0/2968594054 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd09c09d6f0 msgr2=0x7fd09c1a25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:52.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.255+0000 7fd09affd700 1 --2- 172.21.15.26:0/2968594054 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd09c09d6f0 0x7fd09c1a25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:52.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.255+0000 7fd09affd700 1 -- 172.21.15.26:0/2968594054 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd094009b30 con 0x7fd09c09e000 2023-10-01T07:57:52.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.255+0000 7fd09bfff700 1 --2- 172.21.15.26:0/2968594054 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd09c09e410 0x7fd09c1a3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:52.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.255+0000 7fd09affd700 1 --2- 172.21.15.26:0/2968594054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd09c09e000 0x7fd09c1a2ae0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fd09000b530 tx=0x7fd09000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:52.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.256+0000 7fd083fff700 1 -- 172.21.15.26:0/2968594054 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd090011830 con 0x7fd09c09e000 2023-10-01T07:57:52.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.256+0000 7fd083fff700 1 -- 172.21.15.26:0/2968594054 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd090011990 con 0x7fd09c09e000 2023-10-01T07:57:52.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.256+0000 7fd0a20e9700 1 -- 172.21.15.26:0/2968594054 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd09c1a3ae0 con 0x7fd09c09e000 2023-10-01T07:57:52.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.256+0000 7fd083fff700 1 -- 172.21.15.26:0/2968594054 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd090011d20 con 0x7fd09c09e000 2023-10-01T07:57:52.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.256+0000 7fd0a20e9700 1 -- 172.21.15.26:0/2968594054 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd09c071af0 con 0x7fd09c09e000 2023-10-01T07:57:52.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.257+0000 7fd0a20e9700 1 -- 172.21.15.26:0/2968594054 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd09c1a4dc0 con 0x7fd09c09e000 2023-10-01T07:57:52.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.257+0000 7fd083fff700 1 -- 172.21.15.26:0/2968594054 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd09001a400 con 0x7fd09c09e000 2023-10-01T07:57:52.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.257+0000 7fd083fff700 1 -- 172.21.15.26:0/2968594054 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd09003f770 con 0x7fd09c09e000 2023-10-01T07:57:52.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.267+0000 7fd083fff700 1 -- 172.21.15.26:0/2968594054 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd09000f8d0 con 0x7fd09c09e000 2023-10-01T07:57:52.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.291+0000 7ff3cc816700 1 -- 172.21.15.26:0/179412170 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff3c806c360 con 0x7ff3c8139170 2023-10-01T07:57:52.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.291+0000 7ff3b6ffd700 1 -- 172.21.15.26:0/179412170 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff3c001a380 con 0x7ff3c8139170 2023-10-01T07:57:52.293 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:52.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.294+0000 7ff3cc816700 1 -- 172.21.15.26:0/179412170 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3c8139170 msgr2=0x7ff3c8121770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:52.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.294+0000 7ff3cc816700 1 --2- 172.21.15.26:0/179412170 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3c8139170 0x7ff3c8121770 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7ff3c000b680 tx=0x7ff3c0004ad0 comp rx=0 tx=0).stop 2023-10-01T07:57:52.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.294+0000 7ff3cc816700 1 -- 172.21.15.26:0/179412170 shutdown_connections 2023-10-01T07:57:52.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.294+0000 7ff3cc816700 1 --2- 172.21.15.26:0/179412170 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3c8139170 0x7ff3c8121770 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:52.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.294+0000 7ff3cc816700 1 --2- 172.21.15.26:0/179412170 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff3c809d6f0 0x7ff3c81c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:52.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.294+0000 7ff3cc816700 1 --2- 172.21.15.26:0/179412170 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff3c809e1d0 0x7ff3c81c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:52.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.294+0000 7ff3cc816700 1 -- 172.21.15.26:0/179412170 >> 172.21.15.26:0/179412170 conn(0x7ff3c8066f50 msgr2=0x7ff3c80a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:52.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.295+0000 7ff3cc816700 1 -- 172.21.15.26:0/179412170 shutdown_connections 2023-10-01T07:57:52.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.295+0000 7ff3cc816700 1 -- 172.21.15.26:0/179412170 wait complete. 2023-10-01T07:57:52.310 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:52.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.350+0000 7f47581d1700 1 -- 172.21.15.26:0/1119243197 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f475011e0b0 con 0x7f475009e000 2023-10-01T07:57:52.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.350+0000 7f47467fc700 1 -- 172.21.15.26:0/1119243197 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f474001a340 con 0x7f475009e000 2023-10-01T07:57:52.352 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:52.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.352+0000 7f47581d1700 1 -- 172.21.15.26:0/1119243197 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f475009e000 msgr2=0x7f47501c11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:52.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.352+0000 7f47581d1700 1 --2- 172.21.15.26:0/1119243197 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f475009e000 0x7f47501c11b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f47400140f0 tx=0x7f4740014400 comp rx=0 tx=0).stop 2023-10-01T07:57:52.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.352+0000 7f47581d1700 1 -- 172.21.15.26:0/1119243197 shutdown_connections 2023-10-01T07:57:52.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.352+0000 7f47581d1700 1 --2- 172.21.15.26:0/1119243197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f475009e410 0x7f47501c3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:52.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.352+0000 7f47581d1700 1 --2- 172.21.15.26:0/1119243197 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f475009d6f0 0x7f47501c0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:52.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.352+0000 7f47581d1700 1 --2- 172.21.15.26:0/1119243197 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f475009e000 0x7f47501c11b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:52.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.352+0000 7f47581d1700 1 -- 172.21.15.26:0/1119243197 >> 172.21.15.26:0/1119243197 conn(0x7f4750066f50 msgr2=0x7f4750133bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:52.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.353+0000 7f47581d1700 1 -- 172.21.15.26:0/1119243197 shutdown_connections 2023-10-01T07:57:52.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.353+0000 7f47581d1700 1 -- 172.21.15.26:0/1119243197 wait complete. 2023-10-01T07:57:52.368 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:52.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.403+0000 7f10f4b02700 1 -- 172.21.15.26:0/559721930 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f10f006c360 con 0x7f10f009e1d0 2023-10-01T07:57:52.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.403+0000 7f10deffd700 1 -- 172.21.15.26:0/559721930 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f10e4004560 con 0x7f10f009e1d0 2023-10-01T07:57:52.405 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:52.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.405+0000 7f10f4b02700 1 -- 172.21.15.26:0/559721930 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f10f009e1d0 msgr2=0x7f10f011dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:52.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.405+0000 7f10f4b02700 1 --2- 172.21.15.26:0/559721930 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f10f009e1d0 0x7f10f011dbe0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f10e4009840 tx=0x7f10e4004750 comp rx=0 tx=0).stop 2023-10-01T07:57:52.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.405+0000 7f10f4b02700 1 -- 172.21.15.26:0/559721930 shutdown_connections 2023-10-01T07:57:52.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.405+0000 7f10f4b02700 1 --2- 172.21.15.26:0/559721930 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10f0135e50 0x7f10f011e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:52.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.405+0000 7f10f4b02700 1 --2- 172.21.15.26:0/559721930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10f009d6f0 0x7f10f011d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:52.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.405+0000 7f10f4b02700 1 --2- 172.21.15.26:0/559721930 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f10f009e1d0 0x7f10f011dbe0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:52.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.405+0000 7f10f4b02700 1 -- 172.21.15.26:0/559721930 >> 172.21.15.26:0/559721930 conn(0x7f10f0066f50 msgr2=0x7f10f0134d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:52.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.406+0000 7f10f4b02700 1 -- 172.21.15.26:0/559721930 shutdown_connections 2023-10-01T07:57:52.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.406+0000 7f10f4b02700 1 -- 172.21.15.26:0/559721930 wait complete. 2023-10-01T07:57:52.421 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:52.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.476+0000 7fd0a20e9700 1 -- 172.21.15.26:0/2968594054 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd09c074ea0 con 0x7fd09c09e000 2023-10-01T07:57:52.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.477+0000 7fd083fff700 1 -- 172.21.15.26:0/2968594054 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd090015030 con 0x7fd09c09e000 2023-10-01T07:57:52.479 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:52.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.479+0000 7fd0a20e9700 1 -- 172.21.15.26:0/2968594054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd09c09e000 msgr2=0x7fd09c1a2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:52.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.479+0000 7fd0a20e9700 1 --2- 172.21.15.26:0/2968594054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd09c09e000 0x7fd09c1a2ae0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fd09000b530 tx=0x7fd09000b840 comp rx=0 tx=0).stop 2023-10-01T07:57:52.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.479+0000 7fd0a20e9700 1 -- 172.21.15.26:0/2968594054 shutdown_connections 2023-10-01T07:57:52.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.479+0000 7fd0a20e9700 1 --2- 172.21.15.26:0/2968594054 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd09c09e410 0x7fd09c1a3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:52.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.479+0000 7fd0a20e9700 1 --2- 172.21.15.26:0/2968594054 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd09c09d6f0 0x7fd09c1a25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:52.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.479+0000 7fd0a20e9700 1 --2- 172.21.15.26:0/2968594054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd09c09e000 0x7fd09c1a2ae0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:52.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.479+0000 7fd0a20e9700 1 -- 172.21.15.26:0/2968594054 >> 172.21.15.26:0/2968594054 conn(0x7fd09c066f50 msgr2=0x7fd09c1bbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:52.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.479+0000 7fd0a20e9700 1 -- 172.21.15.26:0/2968594054 shutdown_connections 2023-10-01T07:57:52.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:52.479+0000 7fd0a20e9700 1 -- 172.21.15.26:0/2968594054 wait complete. 2023-10-01T07:57:52.494 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:53.311 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:53.369 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:53.422 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:53.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.468+0000 7ff12b9d6700 1 Processor -- start 2023-10-01T07:57:53.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.468+0000 7ff12b9d6700 1 -- start start 2023-10-01T07:57:53.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.469+0000 7ff12b9d6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff12409d6f0 0x7ff12409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:53.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.469+0000 7ff12b9d6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff12409e000 0x7ff1241339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:53.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.469+0000 7ff12b9d6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff12409e410 0x7ff124133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:53.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.469+0000 7ff12b9d6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff12406b460 con 0x7ff12409d6f0 2023-10-01T07:57:53.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.469+0000 7ff12b9d6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff12409b120 con 0x7ff12409e000 2023-10-01T07:57:53.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.469+0000 7ff12b9d6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff12409a7e0 con 0x7ff12409e410 2023-10-01T07:57:53.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.469+0000 7ff128f71700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff12409e000 0x7ff1241339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:53.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.469+0000 7ff128f71700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff12409e000 0x7ff1241339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58514/0 (socket says 172.21.15.26:58514) 2023-10-01T07:57:53.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.469+0000 7ff129772700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff12409d6f0 0x7ff12409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:53.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.469+0000 7ff128f71700 1 -- 172.21.15.26:0/1993519524 learned_addr learned my addr 172.21.15.26:0/1993519524 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:53.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.469+0000 7ff129f73700 1 --2- 172.21.15.26:0/1993519524 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff12409e410 0x7ff124133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:53.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.469+0000 7ff129772700 1 -- 172.21.15.26:0/1993519524 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff12409e410 msgr2=0x7ff124133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:53.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.469+0000 7ff129772700 1 --2- 172.21.15.26:0/1993519524 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff12409e410 0x7ff124133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:53.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.469+0000 7ff129772700 1 -- 172.21.15.26:0/1993519524 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff12409e000 msgr2=0x7ff1241339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:53.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.469+0000 7ff129772700 1 --2- 172.21.15.26:0/1993519524 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff12409e000 0x7ff1241339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:53.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.469+0000 7ff129772700 1 -- 172.21.15.26:0/1993519524 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff12409a500 con 0x7ff12409d6f0 2023-10-01T07:57:53.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.469+0000 7ff128f71700 1 --2- 172.21.15.26:0/1993519524 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff12409e000 0x7ff1241339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:53.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.470+0000 7ff129772700 1 --2- 172.21.15.26:0/1993519524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff12409d6f0 0x7ff12409dac0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7ff120009840 tx=0x7ff120009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd9c073e46daed6 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:53.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.470+0000 7ff11bfff700 1 -- 172.21.15.26:0/1993519524 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff120011830 con 0x7ff12409d6f0 2023-10-01T07:57:53.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.470+0000 7ff11bfff700 1 -- 172.21.15.26:0/1993519524 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff120011990 con 0x7ff12409d6f0 2023-10-01T07:57:53.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.470+0000 7ff11bfff700 1 -- 172.21.15.26:0/1993519524 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff120011d20 con 0x7ff12409d6f0 2023-10-01T07:57:53.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.470+0000 7ff12b9d6700 1 -- 172.21.15.26:0/1993519524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff12409d6f0 msgr2=0x7ff12409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:53.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.470+0000 7ff12b9d6700 1 --2- 172.21.15.26:0/1993519524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff12409d6f0 0x7ff12409dac0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7ff120009840 tx=0x7ff120009b50 comp rx=0 tx=0).stop 2023-10-01T07:57:53.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.471+0000 7ff12b9d6700 1 -- 172.21.15.26:0/1993519524 shutdown_connections 2023-10-01T07:57:53.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.471+0000 7ff12b9d6700 1 --2- 172.21.15.26:0/1993519524 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff12409e410 0x7ff124133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:53.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.471+0000 7ff12b9d6700 1 --2- 172.21.15.26:0/1993519524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff12409d6f0 0x7ff12409dac0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:53.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.471+0000 7ff12b9d6700 1 --2- 172.21.15.26:0/1993519524 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff12409e000 0x7ff1241339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:53.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.471+0000 7ff12b9d6700 1 -- 172.21.15.26:0/1993519524 >> 172.21.15.26:0/1993519524 conn(0x7ff124066f50 msgr2=0x7ff12409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:53.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.471+0000 7ff12b9d6700 1 -- 172.21.15.26:0/1993519524 shutdown_connections 2023-10-01T07:57:53.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.471+0000 7ff12b9d6700 1 -- 172.21.15.26:0/1993519524 wait complete. 2023-10-01T07:57:53.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.472+0000 7ff12b9d6700 1 Processor -- start 2023-10-01T07:57:53.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.472+0000 7ff12b9d6700 1 -- start start 2023-10-01T07:57:53.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.473+0000 7ff12b9d6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff12409d6f0 0x7ff1241a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:53.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.473+0000 7ff12b9d6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff12409e000 0x7ff1241a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:53.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.473+0000 7ff12b9d6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff12409e410 0x7ff1241c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:53.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.473+0000 7ff12b9d6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1240a1f20 con 0x7ff12409d6f0 2023-10-01T07:57:53.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.473+0000 7ff12b9d6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1241a80a0 con 0x7ff12409e410 2023-10-01T07:57:53.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.473+0000 7ff12b9d6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1241b91f0 con 0x7ff12409e000 2023-10-01T07:57:53.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.473+0000 7ff129772700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff12409d6f0 0x7ff1241a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:53.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.473+0000 7ff129772700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff12409d6f0 0x7ff1241a5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47748/0 (socket says 172.21.15.26:47748) 2023-10-01T07:57:53.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.473+0000 7ff129772700 1 -- 172.21.15.26:0/1980947873 learned_addr learned my addr 172.21.15.26:0/1980947873 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:53.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.473+0000 7ff128f71700 1 --2- 172.21.15.26:0/1980947873 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff12409e000 0x7ff1241a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:53.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.473+0000 7ff129f73700 1 --2- 172.21.15.26:0/1980947873 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff12409e410 0x7ff1241c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:53.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.474+0000 7ff129772700 1 -- 172.21.15.26:0/1980947873 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff12409e000 msgr2=0x7ff1241a5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:53.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.474+0000 7ff129772700 1 --2- 172.21.15.26:0/1980947873 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff12409e000 0x7ff1241a5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:53.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.474+0000 7ff129772700 1 -- 172.21.15.26:0/1980947873 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff12409e410 msgr2=0x7ff1241c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:53.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.474+0000 7ff129772700 1 --2- 172.21.15.26:0/1980947873 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff12409e410 0x7ff1241c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:53.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.474+0000 7ff129772700 1 -- 172.21.15.26:0/1980947873 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff114009550 con 0x7ff12409d6f0 2023-10-01T07:57:53.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.474+0000 7ff128f71700 1 --2- 172.21.15.26:0/1980947873 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff12409e000 0x7ff1241a5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:57:53.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.474+0000 7ff129772700 1 --2- 172.21.15.26:0/1980947873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff12409d6f0 0x7ff1241a5130 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7ff120009ea0 tx=0x7ff120004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:53.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.474+0000 7ff119ffb700 1 -- 172.21.15.26:0/1980947873 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff120004510 con 0x7ff12409d6f0 2023-10-01T07:57:53.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.474+0000 7ff119ffb700 1 -- 172.21.15.26:0/1980947873 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12001f070 con 0x7ff12409d6f0 2023-10-01T07:57:53.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.474+0000 7ff12b9d6700 1 -- 172.21.15.26:0/1980947873 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1200094a0 con 0x7ff12409d6f0 2023-10-01T07:57:53.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.474+0000 7ff119ffb700 1 -- 172.21.15.26:0/1980947873 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1200038e0 con 0x7ff12409d6f0 2023-10-01T07:57:53.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.474+0000 7ff12b9d6700 1 -- 172.21.15.26:0/1980947873 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1241a6c60 con 0x7ff12409d6f0 2023-10-01T07:57:53.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.475+0000 7ff119ffb700 1 -- 172.21.15.26:0/1980947873 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff120003a40 con 0x7ff12409d6f0 2023-10-01T07:57:53.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.476+0000 7ff119ffb700 1 -- 172.21.15.26:0/1980947873 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff120021070 con 0x7ff12409d6f0 2023-10-01T07:57:53.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.476+0000 7ff12b9d6700 1 -- 172.21.15.26:0/1980947873 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1241a81e0 con 0x7ff12409d6f0 2023-10-01T07:57:53.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.481+0000 7ff119ffb700 1 -- 172.21.15.26:0/1980947873 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff1241a81e0 con 0x7ff12409d6f0 2023-10-01T07:57:53.496 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:53.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.514+0000 7fe132b2c700 1 Processor -- start 2023-10-01T07:57:53.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.515+0000 7fe132b2c700 1 -- start start 2023-10-01T07:57:53.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.515+0000 7fe132b2c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe12c06a770 0x7fe12c09d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:53.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.515+0000 7fe132b2c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe12c13d1f0 0x7fe12c13f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:53.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.515+0000 7fe132b2c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe12c09a810 con 0x7fe12c09dc30 2023-10-01T07:57:53.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.515+0000 7fe132b2c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe12c06ab40 con 0x7fe12c06a770 2023-10-01T07:57:53.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.515+0000 7fe132b2c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c09ebc0 con 0x7fe12c13d1f0 2023-10-01T07:57:53.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.515+0000 7fe12bfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe12c09dc30 0x7fe12c09e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39732/0 (socket says 172.21.15.26:39732) 2023-10-01T07:57:53.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.515+0000 7fe12bfff700 1 -- 172.21.15.26:0/3006564794 learned_addr learned my addr 172.21.15.26:0/3006564794 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:53.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.515+0000 7fe1310c9700 1 --2- 172.21.15.26:0/3006564794 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe12c13d1f0 0x7fe12c13f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:53.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.516+0000 7fe1308c8700 1 --2- 172.21.15.26:0/3006564794 >> v2:172.21.15.26:3300/0 conn(0x7fe12c06a770 0x7fe12c09d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:53.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.516+0000 7fe12b7fe700 1 -- 172.21.15.26:0/3006564794 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3815868341 0 0) 0x7fe12c09a810 con 0x7fe12c09dc30 2023-10-01T07:57:53.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.516+0000 7fe12b7fe700 1 -- 172.21.15.26:0/3006564794 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe11c0035b0 con 0x7fe12c09dc30 2023-10-01T07:57:53.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.516+0000 7fe1310c9700 1 -- 172.21.15.26:0/3006564794 >> v2:172.21.15.26:3300/0 conn(0x7fe12c06a770 msgr2=0x7fe12c09d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:53.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.516+0000 7fe1310c9700 1 --2- 172.21.15.26:0/3006564794 >> v2:172.21.15.26:3300/0 conn(0x7fe12c06a770 0x7fe12c09d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:53.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.516+0000 7fe1310c9700 1 -- 172.21.15.26:0/3006564794 >> v1:172.21.15.26:6789/0 conn(0x7fe12c09dc30 legacy=0x7fe12c09e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:53.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.516+0000 7fe1310c9700 1 -- 172.21.15.26:0/3006564794 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe12c09e920 con 0x7fe12c13d1f0 2023-10-01T07:57:53.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.516+0000 7fe1310c9700 1 --2- 172.21.15.26:0/3006564794 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe12c13d1f0 0x7fe12c13f5d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe124009d90 tx=0x7fe12400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=129a60be6021c74d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:53.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.516+0000 7fe12b7fe700 1 -- 172.21.15.26:0/3006564794 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12400e070 con 0x7fe12c13d1f0 2023-10-01T07:57:53.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.516+0000 7fe12b7fe700 1 -- 172.21.15.26:0/3006564794 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe12400bb20 con 0x7fe12c13d1f0 2023-10-01T07:57:53.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.516+0000 7fe12b7fe700 1 -- 172.21.15.26:0/3006564794 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe124012430 con 0x7fe12c13d1f0 2023-10-01T07:57:53.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.517+0000 7fe132b2c700 1 -- 172.21.15.26:0/3006564794 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe12c13d1f0 msgr2=0x7fe12c13f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:53.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.517+0000 7fe132b2c700 1 --2- 172.21.15.26:0/3006564794 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe12c13d1f0 0x7fe12c13f5d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe124009d90 tx=0x7fe12400b330 comp rx=0 tx=0).stop 2023-10-01T07:57:53.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.517+0000 7fe132b2c700 1 -- 172.21.15.26:0/3006564794 shutdown_connections 2023-10-01T07:57:53.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.517+0000 7fe132b2c700 1 --2- 172.21.15.26:0/3006564794 >> v2:172.21.15.26:3300/0 conn(0x7fe12c06a770 0x7fe12c09d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:53.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.517+0000 7fe132b2c700 1 --2- 172.21.15.26:0/3006564794 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe12c13d1f0 0x7fe12c13f5d0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:53.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.517+0000 7fe132b2c700 1 -- 172.21.15.26:0/3006564794 >> 172.21.15.26:0/3006564794 conn(0x7fe12c066f50 msgr2=0x7fe12c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:53.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.517+0000 7fe132b2c700 1 -- 172.21.15.26:0/3006564794 shutdown_connections 2023-10-01T07:57:53.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.518+0000 7fe132b2c700 1 -- 172.21.15.26:0/3006564794 wait complete. 2023-10-01T07:57:53.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.518+0000 7fe132b2c700 1 Processor -- start 2023-10-01T07:57:53.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.519+0000 7fe132b2c700 1 -- start start 2023-10-01T07:57:53.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.519+0000 7fe132b2c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe12c06a770 0x7fe12c071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:53.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.519+0000 7fe132b2c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe12c09dc30 0x7fe12c13b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:53.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.519+0000 7fe132b2c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe12c13d1f0 0x7fe12c13b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:53.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.519+0000 7fe132b2c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c135b50 con 0x7fe12c09dc30 2023-10-01T07:57:53.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.519+0000 7fe132b2c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c13cd00 con 0x7fe12c06a770 2023-10-01T07:57:53.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.519+0000 7fe132b2c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c09f210 con 0x7fe12c13d1f0 2023-10-01T07:57:53.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.519+0000 7fe1308c8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe12c06a770 0x7fe12c071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:53.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.519+0000 7fe1308c8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe12c06a770 0x7fe12c071390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58536/0 (socket says 172.21.15.26:58536) 2023-10-01T07:57:53.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.519+0000 7fe1308c8700 1 -- 172.21.15.26:0/1200347077 learned_addr learned my addr 172.21.15.26:0/1200347077 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:53.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.519+0000 7fe1310c9700 1 --2- 172.21.15.26:0/1200347077 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe12c13d1f0 0x7fe12c13b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:53.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.520+0000 7fe12bfff700 1 --2- 172.21.15.26:0/1200347077 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe12c09dc30 0x7fe12c13b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:53.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.520+0000 7fe1308c8700 1 -- 172.21.15.26:0/1200347077 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe12c13d1f0 msgr2=0x7fe12c13b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:53.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.520+0000 7fe1308c8700 1 --2- 172.21.15.26:0/1200347077 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe12c13d1f0 0x7fe12c13b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:53.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.520+0000 7fe1308c8700 1 -- 172.21.15.26:0/1200347077 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe12c09dc30 msgr2=0x7fe12c13b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:53.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.520+0000 7fe1308c8700 1 --2- 172.21.15.26:0/1200347077 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe12c09dc30 0x7fe12c13b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:53.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.520+0000 7fe1308c8700 1 -- 172.21.15.26:0/1200347077 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe124009a70 con 0x7fe12c06a770 2023-10-01T07:57:53.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.520+0000 7fe1310c9700 1 --2- 172.21.15.26:0/1200347077 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe12c13d1f0 0x7fe12c13b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:53.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.520+0000 7fe1308c8700 1 --2- 172.21.15.26:0/1200347077 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe12c06a770 0x7fe12c071390 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe12000e9b0 tx=0x7fe12000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:53.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.520+0000 7fe1297fa700 1 -- 172.21.15.26:0/1200347077 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12000ee50 con 0x7fe12c06a770 2023-10-01T07:57:53.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.520+0000 7fe1297fa700 1 -- 172.21.15.26:0/1200347077 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe12000c7f0 con 0x7fe12c06a770 2023-10-01T07:57:53.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.520+0000 7fe132b2c700 1 -- 172.21.15.26:0/1200347077 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe12c11eaa0 con 0x7fe12c06a770 2023-10-01T07:57:53.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.520+0000 7fe1297fa700 1 -- 172.21.15.26:0/1200347077 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12000cb60 con 0x7fe12c06a770 2023-10-01T07:57:53.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.521+0000 7fe132b2c700 1 -- 172.21.15.26:0/1200347077 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe12c11e130 con 0x7fe12c06a770 2023-10-01T07:57:53.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.522+0000 7fe1297fa700 1 -- 172.21.15.26:0/1200347077 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe12000ccc0 con 0x7fe12c06a770 2023-10-01T07:57:53.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.522+0000 7fe1297fa700 1 -- 172.21.15.26:0/1200347077 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe12003fa60 con 0x7fe12c06a770 2023-10-01T07:57:53.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.522+0000 7fe132b2c700 1 -- 172.21.15.26:0/1200347077 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe12c074ea0 con 0x7fe12c06a770 2023-10-01T07:57:53.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.532+0000 7fe1297fa700 1 -- 172.21.15.26:0/1200347077 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe120021080 con 0x7fe12c06a770 2023-10-01T07:57:53.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.584+0000 7f8c5c6c0700 1 Processor -- start 2023-10-01T07:57:53.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.584+0000 7f8c5c6c0700 1 -- start start 2023-10-01T07:57:53.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.585+0000 7f8c5c6c0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8c540a0a30 0x7f8c540a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:53.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.585+0000 7f8c5c6c0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8c54138d80 0x7f8c5413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:53.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.585+0000 7f8c5c6c0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c540a2a70 con 0x7f8c5409d630 2023-10-01T07:57:53.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.585+0000 7f8c5c6c0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c540a01d0 con 0x7f8c54138d80 2023-10-01T07:57:53.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.585+0000 7f8c5c6c0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5409e2b0 con 0x7f8c540a0a30 2023-10-01T07:57:53.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.585+0000 7f8c5a45c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8c540a0a30 0x7f8c540a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:53.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.585+0000 7f8c59c5b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8c5409d630 0x7f8c540a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39748/0 (socket says 172.21.15.26:39748) 2023-10-01T07:57:53.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.585+0000 7f8c59c5b700 1 -- 172.21.15.26:0/589386668 learned_addr learned my addr 172.21.15.26:0/589386668 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:53.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.585+0000 7f8c5ac5d700 1 --2- 172.21.15.26:0/589386668 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8c54138d80 0x7f8c5413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:53.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.586+0000 7f8c5ac5d700 1 -- 172.21.15.26:0/589386668 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8c540a0a30 msgr2=0x7f8c540a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:53.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.586+0000 7f8c5ac5d700 1 --2- 172.21.15.26:0/589386668 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8c540a0a30 0x7f8c540a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:53.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.586+0000 7f8c5ac5d700 1 -- 172.21.15.26:0/589386668 >> v1:172.21.15.26:6789/0 conn(0x7f8c5409d630 legacy=0x7f8c540a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:53.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.586+0000 7f8c5ac5d700 1 -- 172.21.15.26:0/589386668 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5409dc50 con 0x7f8c54138d80 2023-10-01T07:57:53.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.586+0000 7f8c5945a700 1 -- 172.21.15.26:0/589386668 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3235465217 0 0) 0x7f8c540a2a70 con 0x7f8c5409d630 2023-10-01T07:57:53.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.586+0000 7f8c5ac5d700 1 --2- 172.21.15.26:0/589386668 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8c54138d80 0x7f8c5413b160 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c009dc0 tx=0x7f8c4c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb63a9b8aaac8e7a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:53.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.586+0000 7f8c5945a700 1 -- 172.21.15.26:0/589386668 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c00e070 con 0x7f8c54138d80 2023-10-01T07:57:53.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.586+0000 7f8c5945a700 1 -- 172.21.15.26:0/589386668 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c4c00bb20 con 0x7f8c54138d80 2023-10-01T07:57:53.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.586+0000 7f8c5945a700 1 -- 172.21.15.26:0/589386668 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c012430 con 0x7f8c54138d80 2023-10-01T07:57:53.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.587+0000 7f8c5c6c0700 1 -- 172.21.15.26:0/589386668 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8c54138d80 msgr2=0x7f8c5413b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:53.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.587+0000 7f8c5c6c0700 1 --2- 172.21.15.26:0/589386668 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8c54138d80 0x7f8c5413b160 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c009dc0 tx=0x7f8c4c00b330 comp rx=0 tx=0).stop 2023-10-01T07:57:53.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.587+0000 7f8c5c6c0700 1 -- 172.21.15.26:0/589386668 shutdown_connections 2023-10-01T07:57:53.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.587+0000 7f8c5c6c0700 1 --2- 172.21.15.26:0/589386668 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8c540a0a30 0x7f8c540a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:53.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.587+0000 7f8c5c6c0700 1 --2- 172.21.15.26:0/589386668 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8c54138d80 0x7f8c5413b160 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:53.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.587+0000 7f8c5c6c0700 1 -- 172.21.15.26:0/589386668 >> 172.21.15.26:0/589386668 conn(0x7f8c540a3050 msgr2=0x7f8c540a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:53.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.587+0000 7f8c5c6c0700 1 -- 172.21.15.26:0/589386668 shutdown_connections 2023-10-01T07:57:53.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.587+0000 7f8c5c6c0700 1 -- 172.21.15.26:0/589386668 wait complete. 2023-10-01T07:57:53.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.588+0000 7f8c5c6c0700 1 Processor -- start 2023-10-01T07:57:53.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.589+0000 7f8c5c6c0700 1 -- start start 2023-10-01T07:57:53.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.589+0000 7f8c5c6c0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8c5409d630 0x7f8c54133810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:53.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.589+0000 7f8c5c6c0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8c540a0a30 0x7f8c54133d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:53.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.589+0000 7f8c5c6c0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c54138d80 0x7f8c54134290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:53.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.589+0000 7f8c5c6c0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c54136f30 con 0x7f8c54138d80 2023-10-01T07:57:53.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.589+0000 7f8c5c6c0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c54135bd0 con 0x7f8c540a0a30 2023-10-01T07:57:53.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.589+0000 7f8c5c6c0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5413aba0 con 0x7f8c5409d630 2023-10-01T07:57:53.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.590+0000 7f8c5a45c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8c5409d630 0x7f8c54133810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:53.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.590+0000 7f8c5a45c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8c5409d630 0x7f8c54133810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:53936/0 (socket says 172.21.15.26:53936) 2023-10-01T07:57:53.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.590+0000 7f8c5a45c700 1 -- 172.21.15.26:0/1846703945 learned_addr learned my addr 172.21.15.26:0/1846703945 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:53.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.590+0000 7f8c59c5b700 1 --2- 172.21.15.26:0/1846703945 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8c540a0a30 0x7f8c54133d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:53.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.590+0000 7f8c5ac5d700 1 --2- 172.21.15.26:0/1846703945 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c54138d80 0x7f8c54134290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:53.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.590+0000 7f8c59c5b700 1 -- 172.21.15.26:0/1846703945 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8c5409d630 msgr2=0x7f8c54133810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:53.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.590+0000 7f8c59c5b700 1 --2- 172.21.15.26:0/1846703945 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8c5409d630 0x7f8c54133810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:53.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.590+0000 7f8c59c5b700 1 -- 172.21.15.26:0/1846703945 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c54138d80 msgr2=0x7f8c54134290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:53.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.590+0000 7f8c59c5b700 1 --2- 172.21.15.26:0/1846703945 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c54138d80 0x7f8c54134290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:53.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.590+0000 7f8c59c5b700 1 -- 172.21.15.26:0/1846703945 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c4c009a70 con 0x7f8c540a0a30 2023-10-01T07:57:53.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.590+0000 7f8c59c5b700 1 --2- 172.21.15.26:0/1846703945 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8c540a0a30 0x7f8c54133d50 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8c5406d980 tx=0x7f8c4400c750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:53.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.590+0000 7f8c4affd700 1 -- 172.21.15.26:0/1846703945 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c44004c80 con 0x7f8c540a0a30 2023-10-01T07:57:53.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.591+0000 7f8c4affd700 1 -- 172.21.15.26:0/1846703945 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c44004de0 con 0x7f8c540a0a30 2023-10-01T07:57:53.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.591+0000 7f8c5c6c0700 1 -- 172.21.15.26:0/1846703945 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c540a0410 con 0x7f8c540a0a30 2023-10-01T07:57:53.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.591+0000 7f8c4affd700 1 -- 172.21.15.26:0/1846703945 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c44007310 con 0x7f8c540a0a30 2023-10-01T07:57:53.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.591+0000 7f8c5c6c0700 1 -- 172.21.15.26:0/1846703945 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c54136550 con 0x7f8c540a0a30 2023-10-01T07:57:53.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.592+0000 7f8c4affd700 1 -- 172.21.15.26:0/1846703945 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8c44007470 con 0x7f8c540a0a30 2023-10-01T07:57:53.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.592+0000 7f8c4affd700 1 -- 172.21.15.26:0/1846703945 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8c4403f240 con 0x7f8c540a0a30 2023-10-01T07:57:53.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.592+0000 7f8c5c6c0700 1 -- 172.21.15.26:0/1846703945 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c540747f0 con 0x7f8c540a0a30 2023-10-01T07:57:53.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.597+0000 7f8c4affd700 1 -- 172.21.15.26:0/1846703945 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c44007720 con 0x7f8c540a0a30 2023-10-01T07:57:53.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.641+0000 7eff85e80700 1 Processor -- start 2023-10-01T07:57:53.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.641+0000 7eff85e80700 1 -- start start 2023-10-01T07:57:53.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.641+0000 7eff85e80700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7eff8006b250 0x7eff80136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:53.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.641+0000 7eff85e80700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7eff80136d80 0x7eff80139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:53.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.641+0000 7eff85e80700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff8009ece0 con 0x7eff8006a770 2023-10-01T07:57:53.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.641+0000 7eff85e80700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff8006b640 con 0x7eff8006b250 2023-10-01T07:57:53.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.641+0000 7eff85e80700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff8009e760 con 0x7eff80136d80 2023-10-01T07:57:53.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.642+0000 7eff7effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7eff8006b250 0x7eff80136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:53.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.642+0000 7eff7effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7eff8006b250 0x7eff80136840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58562/0 (socket says 172.21.15.26:58562) 2023-10-01T07:57:53.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.642+0000 7eff7effd700 1 -- 172.21.15.26:0/3532764498 learned_addr learned my addr 172.21.15.26:0/3532764498 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:53.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.642+0000 7eff7ffff700 1 --2- 172.21.15.26:0/3532764498 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7eff80136d80 0x7eff80139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:53.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.642+0000 7eff7effd700 1 -- 172.21.15.26:0/3532764498 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7eff80136d80 msgr2=0x7eff80139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:53.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.642+0000 7eff7effd700 1 --2- 172.21.15.26:0/3532764498 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7eff80136d80 0x7eff80139160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:53.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.642+0000 7eff7effd700 1 -- 172.21.15.26:0/3532764498 >> v1:172.21.15.26:6789/0 conn(0x7eff8006a770 legacy=0x7eff8006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:53.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.642+0000 7eff7effd700 1 -- 172.21.15.26:0/3532764498 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8009e040 con 0x7eff8006b250 2023-10-01T07:57:53.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.642+0000 7eff7effd700 1 --2- 172.21.15.26:0/3532764498 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7eff8006b250 0x7eff80136840 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7eff74009920 tx=0x7eff74009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5775aca27f5c6ec8 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:53.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.642+0000 7eff7e7fc700 1 -- 172.21.15.26:0/3532764498 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff74004230 con 0x7eff8006b250 2023-10-01T07:57:53.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.642+0000 7eff7e7fc700 1 -- 172.21.15.26:0/3532764498 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff74004390 con 0x7eff8006b250 2023-10-01T07:57:53.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.642+0000 7eff7e7fc700 1 -- 172.21.15.26:0/3532764498 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff74009e70 con 0x7eff8006b250 2023-10-01T07:57:53.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.643+0000 7eff85e80700 1 -- 172.21.15.26:0/3532764498 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7eff8006b250 msgr2=0x7eff80136840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:53.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.643+0000 7eff85e80700 1 --2- 172.21.15.26:0/3532764498 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7eff8006b250 0x7eff80136840 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7eff74009920 tx=0x7eff74009c30 comp rx=0 tx=0).stop 2023-10-01T07:57:53.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.643+0000 7eff85e80700 1 -- 172.21.15.26:0/3532764498 shutdown_connections 2023-10-01T07:57:53.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.643+0000 7eff85e80700 1 --2- 172.21.15.26:0/3532764498 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7eff80136d80 0x7eff80139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:53.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.643+0000 7eff85e80700 1 --2- 172.21.15.26:0/3532764498 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7eff8006b250 0x7eff80136840 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:53.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.643+0000 7eff85e80700 1 -- 172.21.15.26:0/3532764498 >> 172.21.15.26:0/3532764498 conn(0x7eff80066f50 msgr2=0x7eff8009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:53.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.643+0000 7eff85e80700 1 -- 172.21.15.26:0/3532764498 shutdown_connections 2023-10-01T07:57:53.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.643+0000 7eff85e80700 1 -- 172.21.15.26:0/3532764498 wait complete. 2023-10-01T07:57:53.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.645+0000 7eff85e80700 1 Processor -- start 2023-10-01T07:57:53.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.645+0000 7eff85e80700 1 -- start start 2023-10-01T07:57:53.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.646+0000 7eff85e80700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7eff8006a770 0x7eff8009ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:53.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.646+0000 7eff85e80700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff8006b250 0x7eff8009b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:53.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.646+0000 7eff85e80700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7eff80136d80 0x7eff801c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:53.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.646+0000 7eff85e80700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff80121340 con 0x7eff8006b250 2023-10-01T07:57:53.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.646+0000 7eff85e80700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff8009a8b0 con 0x7eff8006a770 2023-10-01T07:57:53.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.646+0000 7eff85e80700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff801321c0 con 0x7eff80136d80 2023-10-01T07:57:53.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.646+0000 7eff7f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7eff8006a770 0x7eff8009ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:53.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.646+0000 7eff7effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff8006b250 0x7eff8009b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:53.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.646+0000 7eff7ffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7eff80136d80 0x7eff801c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:53.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.646+0000 7eff7f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7eff8006a770 0x7eff8009ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58574/0 (socket says 172.21.15.26:58574) 2023-10-01T07:57:53.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.646+0000 7eff7f7fe700 1 -- 172.21.15.26:0/2505703697 learned_addr learned my addr 172.21.15.26:0/2505703697 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:53.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.646+0000 7eff7effd700 1 -- 172.21.15.26:0/2505703697 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7eff80136d80 msgr2=0x7eff801c8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:53.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.646+0000 7eff7effd700 1 --2- 172.21.15.26:0/2505703697 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7eff80136d80 0x7eff801c8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:53.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.646+0000 7eff7effd700 1 -- 172.21.15.26:0/2505703697 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7eff8006a770 msgr2=0x7eff8009ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:53.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.646+0000 7eff7effd700 1 --2- 172.21.15.26:0/2505703697 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7eff8006a770 0x7eff8009ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:53.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.646+0000 7eff7effd700 1 -- 172.21.15.26:0/2505703697 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff74009550 con 0x7eff8006b250 2023-10-01T07:57:53.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.646+0000 7eff7f7fe700 1 --2- 172.21.15.26:0/2505703697 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7eff8006a770 0x7eff8009ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:53.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.646+0000 7eff7ffff700 1 --2- 172.21.15.26:0/2505703697 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7eff80136d80 0x7eff801c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:53.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.647+0000 7eff7effd700 1 --2- 172.21.15.26:0/2505703697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff8006b250 0x7eff8009b3d0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7eff74015000 tx=0x7eff74004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:53.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.647+0000 7eff67fff700 1 -- 172.21.15.26:0/2505703697 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7400bcb0 con 0x7eff8006b250 2023-10-01T07:57:53.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.647+0000 7eff67fff700 1 -- 172.21.15.26:0/2505703697 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7400be70 con 0x7eff8006b250 2023-10-01T07:57:53.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.647+0000 7eff67fff700 1 -- 172.21.15.26:0/2505703697 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff740038e0 con 0x7eff8006b250 2023-10-01T07:57:53.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.647+0000 7eff85e80700 1 -- 172.21.15.26:0/2505703697 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff80122360 con 0x7eff8006b250 2023-10-01T07:57:53.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.647+0000 7eff85e80700 1 -- 172.21.15.26:0/2505703697 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff8006e8e0 con 0x7eff8006b250 2023-10-01T07:57:53.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.648+0000 7eff85e80700 1 -- 172.21.15.26:0/2505703697 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff80121e20 con 0x7eff8006b250 2023-10-01T07:57:53.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.648+0000 7eff67fff700 1 -- 172.21.15.26:0/2505703697 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7eff74021070 con 0x7eff8006b250 2023-10-01T07:57:53.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.648+0000 7eff67fff700 1 -- 172.21.15.26:0/2505703697 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7eff74040ea0 con 0x7eff8006b250 2023-10-01T07:57:53.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.658+0000 7eff67fff700 1 -- 172.21.15.26:0/2505703697 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7eff80121e20 con 0x7eff8006b250 2023-10-01T07:57:53.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.723+0000 7ff12b9d6700 1 -- 172.21.15.26:0/1980947873 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff1241a81e0 con 0x7ff12409d6f0 2023-10-01T07:57:53.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.723+0000 7ff119ffb700 1 -- 172.21.15.26:0/1980947873 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff1241a81e0 con 0x7ff12409d6f0 2023-10-01T07:57:53.725 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:53.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.726+0000 7ff12b9d6700 1 -- 172.21.15.26:0/1980947873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff12409d6f0 msgr2=0x7ff1241a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:53.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.726+0000 7ff12b9d6700 1 --2- 172.21.15.26:0/1980947873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff12409d6f0 0x7ff1241a5130 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7ff120009ea0 tx=0x7ff120004750 comp rx=0 tx=0).stop 2023-10-01T07:57:53.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.726+0000 7ff12b9d6700 1 -- 172.21.15.26:0/1980947873 shutdown_connections 2023-10-01T07:57:53.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.726+0000 7ff12b9d6700 1 --2- 172.21.15.26:0/1980947873 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff12409e410 0x7ff1241c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:53.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.726+0000 7ff12b9d6700 1 --2- 172.21.15.26:0/1980947873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff12409d6f0 0x7ff1241a5130 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:53.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.726+0000 7ff12b9d6700 1 --2- 172.21.15.26:0/1980947873 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff12409e000 0x7ff1241a5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:53.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.726+0000 7ff12b9d6700 1 -- 172.21.15.26:0/1980947873 >> 172.21.15.26:0/1980947873 conn(0x7ff124066f50 msgr2=0x7ff1241bbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:53.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.726+0000 7ff12b9d6700 1 -- 172.21.15.26:0/1980947873 shutdown_connections 2023-10-01T07:57:53.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.726+0000 7ff12b9d6700 1 -- 172.21.15.26:0/1980947873 wait complete. 2023-10-01T07:57:53.742 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:53.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.748+0000 7fe132b2c700 1 -- 172.21.15.26:0/1200347077 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe12c09a3d0 con 0x7fe12c06a770 2023-10-01T07:57:53.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.749+0000 7fe1297fa700 1 -- 172.21.15.26:0/1200347077 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe1200119a0 con 0x7fe12c06a770 2023-10-01T07:57:53.750 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:53.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.752+0000 7fe132b2c700 1 -- 172.21.15.26:0/1200347077 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe12c06a770 msgr2=0x7fe12c071390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:53.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.752+0000 7fe132b2c700 1 --2- 172.21.15.26:0/1200347077 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe12c06a770 0x7fe12c071390 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe12000e9b0 tx=0x7fe12000ecc0 comp rx=0 tx=0).stop 2023-10-01T07:57:53.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.752+0000 7fe132b2c700 1 -- 172.21.15.26:0/1200347077 shutdown_connections 2023-10-01T07:57:53.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.752+0000 7fe132b2c700 1 --2- 172.21.15.26:0/1200347077 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe12c13d1f0 0x7fe12c13b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:53.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.752+0000 7fe132b2c700 1 --2- 172.21.15.26:0/1200347077 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe12c06a770 0x7fe12c071390 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:53.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.752+0000 7fe132b2c700 1 --2- 172.21.15.26:0/1200347077 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe12c09dc30 0x7fe12c13b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:53.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.752+0000 7fe132b2c700 1 -- 172.21.15.26:0/1200347077 >> 172.21.15.26:0/1200347077 conn(0x7fe12c066f50 msgr2=0x7fe12c09b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:53.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.752+0000 7fe132b2c700 1 -- 172.21.15.26:0/1200347077 shutdown_connections 2023-10-01T07:57:53.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.752+0000 7fe132b2c700 1 -- 172.21.15.26:0/1200347077 wait complete. 2023-10-01T07:57:53.773 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:53.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.818+0000 7f8c5c6c0700 1 -- 172.21.15.26:0/1846703945 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8c54072980 con 0x7f8c540a0a30 2023-10-01T07:57:53.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.819+0000 7f8c4affd700 1 -- 172.21.15.26:0/1846703945 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8c4401b7b0 con 0x7f8c540a0a30 2023-10-01T07:57:53.820 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:53.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.821+0000 7f8c5c6c0700 1 -- 172.21.15.26:0/1846703945 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8c540a0a30 msgr2=0x7f8c54133d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:53.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.821+0000 7f8c5c6c0700 1 --2- 172.21.15.26:0/1846703945 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8c540a0a30 0x7f8c54133d50 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8c5406d980 tx=0x7f8c4400c750 comp rx=0 tx=0).stop 2023-10-01T07:57:53.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.821+0000 7f8c5c6c0700 1 -- 172.21.15.26:0/1846703945 shutdown_connections 2023-10-01T07:57:53.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.821+0000 7f8c5c6c0700 1 --2- 172.21.15.26:0/1846703945 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c54138d80 0x7f8c54134290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:53.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.821+0000 7f8c5c6c0700 1 --2- 172.21.15.26:0/1846703945 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8c5409d630 0x7f8c54133810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:53.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.821+0000 7f8c5c6c0700 1 --2- 172.21.15.26:0/1846703945 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8c540a0a30 0x7f8c54133d50 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:53.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.821+0000 7f8c5c6c0700 1 -- 172.21.15.26:0/1846703945 >> 172.21.15.26:0/1846703945 conn(0x7f8c540a3050 msgr2=0x7f8c5409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:53.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.821+0000 7f8c5c6c0700 1 -- 172.21.15.26:0/1846703945 shutdown_connections 2023-10-01T07:57:53.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.821+0000 7f8c5c6c0700 1 -- 172.21.15.26:0/1846703945 wait complete. 2023-10-01T07:57:53.836 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:53.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.877+0000 7eff85e80700 1 -- 172.21.15.26:0/2505703697 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7eff80121e20 con 0x7eff8006b250 2023-10-01T07:57:53.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.877+0000 7eff67fff700 1 -- 172.21.15.26:0/2505703697 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7eff80121e20 con 0x7eff8006b250 2023-10-01T07:57:53.879 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:53.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.879+0000 7eff85e80700 1 -- 172.21.15.26:0/2505703697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff8006b250 msgr2=0x7eff8009b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:53.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.879+0000 7eff85e80700 1 --2- 172.21.15.26:0/2505703697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff8006b250 0x7eff8009b3d0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7eff74015000 tx=0x7eff74004750 comp rx=0 tx=0).stop 2023-10-01T07:57:53.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.879+0000 7eff85e80700 1 -- 172.21.15.26:0/2505703697 shutdown_connections 2023-10-01T07:57:53.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.879+0000 7eff85e80700 1 --2- 172.21.15.26:0/2505703697 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7eff80136d80 0x7eff801c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:53.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.879+0000 7eff85e80700 1 --2- 172.21.15.26:0/2505703697 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7eff8006a770 0x7eff8009ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:53.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.879+0000 7eff85e80700 1 --2- 172.21.15.26:0/2505703697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff8006b250 0x7eff8009b3d0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:53.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.879+0000 7eff85e80700 1 -- 172.21.15.26:0/2505703697 >> 172.21.15.26:0/2505703697 conn(0x7eff80066f50 msgr2=0x7eff800702c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:53.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.879+0000 7eff85e80700 1 -- 172.21.15.26:0/2505703697 shutdown_connections 2023-10-01T07:57:53.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:53.879+0000 7eff85e80700 1 -- 172.21.15.26:0/2505703697 wait complete. 2023-10-01T07:57:53.894 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:54.743 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:54.774 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:54.837 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:54.895 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:54.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.895+0000 7fa52770e700 1 Processor -- start 2023-10-01T07:57:54.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.895+0000 7fa52770e700 1 -- start start 2023-10-01T07:57:54.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.896+0000 7fa52770e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa52009d6f0 0x7fa52009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:54.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.896+0000 7fa52770e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa52009e410 0x7fa520134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:54.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.896+0000 7fa52770e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa52009b120 con 0x7fa52009e000 2023-10-01T07:57:54.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.896+0000 7fa52770e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa52006b460 con 0x7fa52009e410 2023-10-01T07:57:54.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.896+0000 7fa52770e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa52009a7e0 con 0x7fa52009d6f0 2023-10-01T07:57:54.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.896+0000 7fa524ca9700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa52009e000 0x7fa5201339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39780/0 (socket says 172.21.15.26:39780) 2023-10-01T07:57:54.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.896+0000 7fa5254aa700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa52009d6f0 0x7fa52009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:54.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.896+0000 7fa524ca9700 1 -- 172.21.15.26:0/1278273165 learned_addr learned my addr 172.21.15.26:0/1278273165 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:54.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.897+0000 7fa525cab700 1 --2- 172.21.15.26:0/1278273165 >> v2:172.21.15.26:3300/0 conn(0x7fa52009e410 0x7fa520134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:54.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.897+0000 7fa517fff700 1 -- 172.21.15.26:0/1278273165 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 296243700 0 0) 0x7fa52009b120 con 0x7fa52009e000 2023-10-01T07:57:54.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.897+0000 7fa517fff700 1 -- 172.21.15.26:0/1278273165 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa50c0035b0 con 0x7fa52009e000 2023-10-01T07:57:54.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.897+0000 7fa5254aa700 1 -- 172.21.15.26:0/1278273165 >> v2:172.21.15.26:3300/0 conn(0x7fa52009e410 msgr2=0x7fa520134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:54.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.897+0000 7fa5254aa700 1 --2- 172.21.15.26:0/1278273165 >> v2:172.21.15.26:3300/0 conn(0x7fa52009e410 0x7fa520134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:54.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.897+0000 7fa5254aa700 1 -- 172.21.15.26:0/1278273165 >> v1:172.21.15.26:6789/0 conn(0x7fa52009e000 legacy=0x7fa5201339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:54.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.897+0000 7fa5254aa700 1 -- 172.21.15.26:0/1278273165 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52009a500 con 0x7fa52009d6f0 2023-10-01T07:57:54.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.897+0000 7fa525cab700 1 --2- 172.21.15.26:0/1278273165 >> v2:172.21.15.26:3300/0 conn(0x7fa52009e410 0x7fa520134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:57:54.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.897+0000 7fa5254aa700 1 --2- 172.21.15.26:0/1278273165 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa52009d6f0 0x7fa52009dac0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa51c009870 tx=0x7fa51c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fcef4b9b90e5e75 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:54.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.898+0000 7fa517fff700 1 -- 172.21.15.26:0/1278273165 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c011830 con 0x7fa52009d6f0 2023-10-01T07:57:54.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.898+0000 7fa517fff700 1 -- 172.21.15.26:0/1278273165 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51c011990 con 0x7fa52009d6f0 2023-10-01T07:57:54.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.898+0000 7fa517fff700 1 -- 172.21.15.26:0/1278273165 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c011d20 con 0x7fa52009d6f0 2023-10-01T07:57:54.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.898+0000 7fa52770e700 1 -- 172.21.15.26:0/1278273165 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa52009d6f0 msgr2=0x7fa52009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:54.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.898+0000 7fa52770e700 1 --2- 172.21.15.26:0/1278273165 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa52009d6f0 0x7fa52009dac0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa51c009870 tx=0x7fa51c009b80 comp rx=0 tx=0).stop 2023-10-01T07:57:54.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.899+0000 7fa52770e700 1 -- 172.21.15.26:0/1278273165 shutdown_connections 2023-10-01T07:57:54.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.899+0000 7fa52770e700 1 --2- 172.21.15.26:0/1278273165 >> v2:172.21.15.26:3300/0 conn(0x7fa52009e410 0x7fa520134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:54.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.899+0000 7fa52770e700 1 --2- 172.21.15.26:0/1278273165 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa52009d6f0 0x7fa52009dac0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:54.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.899+0000 7fa52770e700 1 -- 172.21.15.26:0/1278273165 >> 172.21.15.26:0/1278273165 conn(0x7fa520066f50 msgr2=0x7fa52009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:54.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.901+0000 7fa52770e700 1 -- 172.21.15.26:0/1278273165 shutdown_connections 2023-10-01T07:57:54.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.901+0000 7fa52770e700 1 -- 172.21.15.26:0/1278273165 wait complete. 2023-10-01T07:57:54.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.901+0000 7fa52770e700 1 Processor -- start 2023-10-01T07:57:54.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.901+0000 7fa52770e700 1 -- start start 2023-10-01T07:57:54.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.901+0000 7fa52770e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa52009d6f0 0x7fa5201a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:54.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.901+0000 7fa52770e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa52009e000 0x7fa5201c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:54.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.901+0000 7fa52770e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa52009e410 0x7fa5201c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:54.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.901+0000 7fa52770e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5201a7d50 con 0x7fa52009e000 2023-10-01T07:57:54.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.901+0000 7fa52770e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa52009c710 con 0x7fa52009e410 2023-10-01T07:57:54.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.901+0000 7fa52770e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5201a5040 con 0x7fa52009d6f0 2023-10-01T07:57:54.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.902+0000 7fa525cab700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa52009e410 0x7fa5201c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:54.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.902+0000 7fa5254aa700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa52009d6f0 0x7fa5201a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:54.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.902+0000 7fa525cab700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa52009e410 0x7fa5201c8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58578/0 (socket says 172.21.15.26:58578) 2023-10-01T07:57:54.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.902+0000 7fa525cab700 1 -- 172.21.15.26:0/2918451846 learned_addr learned my addr 172.21.15.26:0/2918451846 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:54.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.902+0000 7fa524ca9700 1 --2- 172.21.15.26:0/2918451846 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa52009e000 0x7fa5201c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:54.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.902+0000 7fa5254aa700 1 -- 172.21.15.26:0/2918451846 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa52009e410 msgr2=0x7fa5201c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:54.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.902+0000 7fa5254aa700 1 --2- 172.21.15.26:0/2918451846 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa52009e410 0x7fa5201c8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:54.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.902+0000 7fa5254aa700 1 -- 172.21.15.26:0/2918451846 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa52009e000 msgr2=0x7fa5201c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:54.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.902+0000 7fa5254aa700 1 --2- 172.21.15.26:0/2918451846 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa52009e000 0x7fa5201c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:54.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.902+0000 7fa5254aa700 1 -- 172.21.15.26:0/2918451846 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51c0094a0 con 0x7fa52009d6f0 2023-10-01T07:57:54.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.902+0000 7fa524ca9700 1 --2- 172.21.15.26:0/2918451846 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa52009e000 0x7fa5201c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:54.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.902+0000 7fa5254aa700 1 --2- 172.21.15.26:0/2918451846 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa52009d6f0 0x7fa5201a53f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa51c016000 tx=0x7fa51c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:54.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.903+0000 7fa515ffb700 1 -- 172.21.15.26:0/2918451846 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c0036a0 con 0x7fa52009d6f0 2023-10-01T07:57:54.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.903+0000 7fa515ffb700 1 -- 172.21.15.26:0/2918451846 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51c01f070 con 0x7fa52009d6f0 2023-10-01T07:57:54.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.903+0000 7fa52770e700 1 -- 172.21.15.26:0/2918451846 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5201a4d50 con 0x7fa52009d6f0 2023-10-01T07:57:54.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.903+0000 7fa515ffb700 1 -- 172.21.15.26:0/2918451846 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c003a20 con 0x7fa52009d6f0 2023-10-01T07:57:54.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.903+0000 7fa52770e700 1 -- 172.21.15.26:0/2918451846 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5201a6550 con 0x7fa52009d6f0 2023-10-01T07:57:54.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.904+0000 7fa515ffb700 1 -- 172.21.15.26:0/2918451846 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa51c003b80 con 0x7fa52009d6f0 2023-10-01T07:57:54.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.905+0000 7fa52770e700 1 -- 172.21.15.26:0/2918451846 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5201a6550 con 0x7fa52009d6f0 2023-10-01T07:57:54.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.905+0000 7fa515ffb700 1 -- 172.21.15.26:0/2918451846 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa51c021070 con 0x7fa52009d6f0 2023-10-01T07:57:54.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.911+0000 7fa515ffb700 1 -- 172.21.15.26:0/2918451846 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa5201a6550 con 0x7fa52009d6f0 2023-10-01T07:57:54.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.935+0000 7f85ee12d700 1 Processor -- start 2023-10-01T07:57:54.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.935+0000 7f85ee12d700 1 -- start start 2023-10-01T07:57:54.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.936+0000 7f85ee12d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f85e8134630 0x7f85e8136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:54.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.936+0000 7f85ee12d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f85e8136f50 0x7f85e8139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:54.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.936+0000 7f85ee12d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e809b4f0 con 0x7f85e8131810 2023-10-01T07:57:54.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.936+0000 7f85ee12d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e81313c0 con 0x7f85e8136f50 2023-10-01T07:57:54.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.936+0000 7f85ee12d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85e806e8c0 con 0x7f85e8134630 2023-10-01T07:57:54.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.936+0000 7f85e6ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f85e8134630 0x7f85e8136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:54.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.936+0000 7f85e77fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f85e8131810 0x7f85e8131be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39784/0 (socket says 172.21.15.26:39784) 2023-10-01T07:57:54.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.936+0000 7f85e77fe700 1 -- 172.21.15.26:0/3123264526 learned_addr learned my addr 172.21.15.26:0/3123264526 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:54.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.936+0000 7f85e6ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f85e8134630 0x7f85e8136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:53978/0 (socket says 172.21.15.26:53978) 2023-10-01T07:57:54.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.936+0000 7f85e6ffd700 1 -- 172.21.15.26:0/3123264526 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f85e8136f50 msgr2=0x7f85e8139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:54.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.936+0000 7f85e67fc700 1 -- 172.21.15.26:0/3123264526 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3747965898 0 0) 0x7f85e809b4f0 con 0x7f85e8131810 2023-10-01T07:57:54.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.936+0000 7f85e6ffd700 1 --2- 172.21.15.26:0/3123264526 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f85e8136f50 0x7f85e8139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:54.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.936+0000 7f85e6ffd700 1 -- 172.21.15.26:0/3123264526 >> v1:172.21.15.26:6789/0 conn(0x7f85e8131810 legacy=0x7f85e8131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:54.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.936+0000 7f85e6ffd700 1 -- 172.21.15.26:0/3123264526 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e8071d20 con 0x7f85e8134630 2023-10-01T07:57:54.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.937+0000 7f85e6ffd700 1 --2- 172.21.15.26:0/3123264526 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f85e8134630 0x7f85e8136a10 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f85dc009870 tx=0x7f85dc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb3da31b2a4c0c4c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:54.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.937+0000 7f85e67fc700 1 -- 172.21.15.26:0/3123264526 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc011830 con 0x7f85e8134630 2023-10-01T07:57:54.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.937+0000 7f85e67fc700 1 -- 172.21.15.26:0/3123264526 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85dc011990 con 0x7f85e8134630 2023-10-01T07:57:54.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.937+0000 7f85e67fc700 1 -- 172.21.15.26:0/3123264526 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc011d20 con 0x7f85e8134630 2023-10-01T07:57:54.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.938+0000 7f85ee12d700 1 -- 172.21.15.26:0/3123264526 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f85e8134630 msgr2=0x7f85e8136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:54.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.938+0000 7f85ee12d700 1 --2- 172.21.15.26:0/3123264526 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f85e8134630 0x7f85e8136a10 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f85dc009870 tx=0x7f85dc009b80 comp rx=0 tx=0).stop 2023-10-01T07:57:54.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.938+0000 7f85ee12d700 1 -- 172.21.15.26:0/3123264526 shutdown_connections 2023-10-01T07:57:54.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.938+0000 7f85ee12d700 1 --2- 172.21.15.26:0/3123264526 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f85e8136f50 0x7f85e8139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:54.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.938+0000 7f85ee12d700 1 --2- 172.21.15.26:0/3123264526 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f85e8134630 0x7f85e8136a10 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:54.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.938+0000 7f85ee12d700 1 -- 172.21.15.26:0/3123264526 >> 172.21.15.26:0/3123264526 conn(0x7f85e80a2aa0 msgr2=0x7f85e80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:54.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.938+0000 7f85ee12d700 1 -- 172.21.15.26:0/3123264526 shutdown_connections 2023-10-01T07:57:54.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.938+0000 7f85ee12d700 1 -- 172.21.15.26:0/3123264526 wait complete. 2023-10-01T07:57:54.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.940+0000 7f85ee12d700 1 Processor -- start 2023-10-01T07:57:54.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.940+0000 7f85ee12d700 1 -- start start 2023-10-01T07:57:54.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.941+0000 7f85ee12d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85e8131810 0x7f85e81199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:54.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.941+0000 7f85ee12d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f85e8134630 0x7f85e8119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:54.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.941+0000 7f85ee12d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f85e8136f50 0x7f85e81c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:54.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.941+0000 7f85ee12d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e811a440 con 0x7f85e8131810 2023-10-01T07:57:54.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.941+0000 7f85ee12d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e811b830 con 0x7f85e8134630 2023-10-01T07:57:54.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.941+0000 7f85ee12d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85e8119590 con 0x7f85e8136f50 2023-10-01T07:57:54.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.941+0000 7f85e7fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f85e8136f50 0x7f85e81c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:54.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.941+0000 7f85e7fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f85e8136f50 0x7f85e81c61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:53988/0 (socket says 172.21.15.26:53988) 2023-10-01T07:57:54.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.941+0000 7f85e7fff700 1 -- 172.21.15.26:0/813601195 learned_addr learned my addr 172.21.15.26:0/813601195 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:54.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.941+0000 7f85e77fe700 1 --2- 172.21.15.26:0/813601195 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85e8131810 0x7f85e81199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:54.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.941+0000 7f85e7fff700 1 -- 172.21.15.26:0/813601195 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f85e8134630 msgr2=0x7f85e8119f00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:57:54.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.941+0000 7f85e7fff700 1 --2- 172.21.15.26:0/813601195 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f85e8134630 0x7f85e8119f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:54.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.941+0000 7f85e7fff700 1 -- 172.21.15.26:0/813601195 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85e8131810 msgr2=0x7f85e81199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:54.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.941+0000 7f85e7fff700 1 --2- 172.21.15.26:0/813601195 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85e8131810 0x7f85e81199c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:54.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.941+0000 7f85e7fff700 1 -- 172.21.15.26:0/813601195 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85dc0094a0 con 0x7f85e8136f50 2023-10-01T07:57:54.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.942+0000 7f85e7fff700 1 --2- 172.21.15.26:0/813601195 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f85e8136f50 0x7f85e81c61b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f85e000fe70 tx=0x7f85e0009f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:54.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.942+0000 7f85cffff700 1 -- 172.21.15.26:0/813601195 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e0010d10 con 0x7f85e8136f50 2023-10-01T07:57:54.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.942+0000 7f85cffff700 1 -- 172.21.15.26:0/813601195 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e0010e90 con 0x7f85e8136f50 2023-10-01T07:57:54.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.942+0000 7f85cffff700 1 -- 172.21.15.26:0/813601195 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e0018680 con 0x7f85e8136f50 2023-10-01T07:57:54.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.942+0000 7f85ee12d700 1 -- 172.21.15.26:0/813601195 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e806e6b0 con 0x7f85e8136f50 2023-10-01T07:57:54.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.942+0000 7f85ee12d700 1 -- 172.21.15.26:0/813601195 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e811c6f0 con 0x7f85e8136f50 2023-10-01T07:57:54.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.943+0000 7f85cffff700 1 -- 172.21.15.26:0/813601195 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f85e00213b0 con 0x7f85e8136f50 2023-10-01T07:57:54.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.944+0000 7f85cffff700 1 -- 172.21.15.26:0/813601195 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f85e0006e40 con 0x7f85e8136f50 2023-10-01T07:57:54.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.950+0000 7f85ee12d700 1 -- 172.21.15.26:0/813601195 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e80721a0 con 0x7f85e8136f50 2023-10-01T07:57:54.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.954+0000 7f85cffff700 1 -- 172.21.15.26:0/813601195 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f85e001d020 con 0x7f85e8136f50 2023-10-01T07:57:54.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.990+0000 7fdd2b7c8700 1 Processor -- start 2023-10-01T07:57:54.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.990+0000 7fdd2b7c8700 1 -- start start 2023-10-01T07:57:54.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.991+0000 7fdd2b7c8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd24131810 0x7fdd24131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:54.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.991+0000 7fdd2b7c8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd24099a40 0x7fdd24099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:54.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.991+0000 7fdd2b7c8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd241313c0 con 0x7fdd2409a3b0 2023-10-01T07:57:54.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.991+0000 7fdd2b7c8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2409b580 con 0x7fdd24131810 2023-10-01T07:57:54.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.991+0000 7fdd2b7c8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2406e8c0 con 0x7fdd24099a40 2023-10-01T07:57:54.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.991+0000 7fdd28d63700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd24099a40 0x7fdd24099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:54.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.991+0000 7fdd29d65700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fdd2409a3b0 0x7fdd24138650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39788/0 (socket says 172.21.15.26:39788) 2023-10-01T07:57:54.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.991+0000 7fdd28d63700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd24099a40 0x7fdd24099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:53990/0 (socket says 172.21.15.26:53990) 2023-10-01T07:57:54.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.991+0000 7fdd29d65700 1 -- 172.21.15.26:0/881936187 learned_addr learned my addr 172.21.15.26:0/881936187 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:54.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.991+0000 7fdd29564700 1 --2- 172.21.15.26:0/881936187 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd24131810 0x7fdd24131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:54.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.992+0000 7fdd28d63700 1 -- 172.21.15.26:0/881936187 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd24131810 msgr2=0x7fdd24131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:54.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.992+0000 7fdd28d63700 1 --2- 172.21.15.26:0/881936187 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd24131810 0x7fdd24131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:54.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.992+0000 7fdd28d63700 1 -- 172.21.15.26:0/881936187 >> v1:172.21.15.26:6789/0 conn(0x7fdd2409a3b0 legacy=0x7fdd24138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:54.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.992+0000 7fdd28d63700 1 -- 172.21.15.26:0/881936187 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd2409a820 con 0x7fdd24099a40 2023-10-01T07:57:54.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.992+0000 7fdd1bfff700 1 -- 172.21.15.26:0/881936187 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1896601933 0 0) 0x7fdd241313c0 con 0x7fdd2409a3b0 2023-10-01T07:57:54.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.992+0000 7fdd29564700 1 --2- 172.21.15.26:0/881936187 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd24131810 0x7fdd24131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:54.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.992+0000 7fdd28d63700 1 --2- 172.21.15.26:0/881936187 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd24099a40 0x7fdd24099e70 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fdd14009870 tx=0x7fdd14009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46610e7502755b9c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:54.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.992+0000 7fdd1bfff700 1 -- 172.21.15.26:0/881936187 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd14011830 con 0x7fdd24099a40 2023-10-01T07:57:54.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.992+0000 7fdd1bfff700 1 -- 172.21.15.26:0/881936187 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd14011990 con 0x7fdd24099a40 2023-10-01T07:57:54.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.992+0000 7fdd1bfff700 1 -- 172.21.15.26:0/881936187 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd14011d20 con 0x7fdd24099a40 2023-10-01T07:57:54.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.993+0000 7fdd2b7c8700 1 -- 172.21.15.26:0/881936187 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd24099a40 msgr2=0x7fdd24099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:54.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.993+0000 7fdd2b7c8700 1 --2- 172.21.15.26:0/881936187 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd24099a40 0x7fdd24099e70 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fdd14009870 tx=0x7fdd14009b80 comp rx=0 tx=0).stop 2023-10-01T07:57:54.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.993+0000 7fdd2b7c8700 1 -- 172.21.15.26:0/881936187 shutdown_connections 2023-10-01T07:57:54.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.993+0000 7fdd2b7c8700 1 --2- 172.21.15.26:0/881936187 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd24131810 0x7fdd24131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:54.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.993+0000 7fdd2b7c8700 1 --2- 172.21.15.26:0/881936187 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd24099a40 0x7fdd24099e70 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:54.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.993+0000 7fdd2b7c8700 1 -- 172.21.15.26:0/881936187 >> 172.21.15.26:0/881936187 conn(0x7fdd240a2aa0 msgr2=0x7fdd240a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:54.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.993+0000 7fdd2b7c8700 1 -- 172.21.15.26:0/881936187 shutdown_connections 2023-10-01T07:57:54.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.993+0000 7fdd2b7c8700 1 -- 172.21.15.26:0/881936187 wait complete. 2023-10-01T07:57:54.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.995+0000 7fdd2b7c8700 1 Processor -- start 2023-10-01T07:57:54.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.995+0000 7fdd2b7c8700 1 -- start start 2023-10-01T07:57:54.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.995+0000 7fdd2b7c8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd24099a40 0x7fdd24119600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:54.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.995+0000 7fdd2b7c8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd2409a3b0 0x7fdd24119b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:54.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.995+0000 7fdd2b7c8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd24131810 0x7fdd2411a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:54.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.995+0000 7fdd2b7c8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2411aab0 con 0x7fdd24131810 2023-10-01T07:57:54.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.995+0000 7fdd2b7c8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2411b210 con 0x7fdd2409a3b0 2023-10-01T07:57:54.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.995+0000 7fdd2b7c8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2411c460 con 0x7fdd24099a40 2023-10-01T07:57:54.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.995+0000 7fdd29564700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd24099a40 0x7fdd24119600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:54.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.995+0000 7fdd29564700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd24099a40 0x7fdd24119600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:54004/0 (socket says 172.21.15.26:54004) 2023-10-01T07:57:54.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.996+0000 7fdd29564700 1 -- 172.21.15.26:0/333116732 learned_addr learned my addr 172.21.15.26:0/333116732 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:54.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.996+0000 7fdd29d65700 1 --2- 172.21.15.26:0/333116732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd24131810 0x7fdd2411a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:54.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.996+0000 7fdd28d63700 1 --2- 172.21.15.26:0/333116732 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd2409a3b0 0x7fdd24119b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:54.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.996+0000 7fdd29564700 1 -- 172.21.15.26:0/333116732 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd2409a3b0 msgr2=0x7fdd24119b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:54.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.996+0000 7fdd29564700 1 --2- 172.21.15.26:0/333116732 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd2409a3b0 0x7fdd24119b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:54.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.996+0000 7fdd29564700 1 -- 172.21.15.26:0/333116732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd24131810 msgr2=0x7fdd2411a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:55.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.996+0000 7fdd29564700 1 --2- 172.21.15.26:0/333116732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd24131810 0x7fdd2411a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:55.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.996+0000 7fdd29564700 1 -- 172.21.15.26:0/333116732 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd2000d940 con 0x7fdd24099a40 2023-10-01T07:57:55.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.996+0000 7fdd29d65700 1 --2- 172.21.15.26:0/333116732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd24131810 0x7fdd2411a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:55.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.996+0000 7fdd29564700 1 --2- 172.21.15.26:0/333116732 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd24099a40 0x7fdd24119600 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fdd2000de30 tx=0x7fdd200103a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:55.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.996+0000 7fdd19ffb700 1 -- 172.21.15.26:0/333116732 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd20010b00 con 0x7fdd24099a40 2023-10-01T07:57:55.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.997+0000 7fdd19ffb700 1 -- 172.21.15.26:0/333116732 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd20013040 con 0x7fdd24099a40 2023-10-01T07:57:55.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.997+0000 7fdd2b7c8700 1 -- 172.21.15.26:0/333116732 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd140094a0 con 0x7fdd24099a40 2023-10-01T07:57:55.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.997+0000 7fdd19ffb700 1 -- 172.21.15.26:0/333116732 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd20010e80 con 0x7fdd24099a40 2023-10-01T07:57:55.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.997+0000 7fdd2b7c8700 1 -- 172.21.15.26:0/333116732 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd24130820 con 0x7fdd24099a40 2023-10-01T07:57:55.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.997+0000 7fdd19ffb700 1 -- 172.21.15.26:0/333116732 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdd20018480 con 0x7fdd24099a40 2023-10-01T07:57:55.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.998+0000 7fdd19ffb700 1 -- 172.21.15.26:0/333116732 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdd20043660 con 0x7fdd24099a40 2023-10-01T07:57:55.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:54.998+0000 7fdd2b7c8700 1 -- 172.21.15.26:0/333116732 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd2406eb00 con 0x7fdd24099a40 2023-10-01T07:57:55.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.003+0000 7fdd19ffb700 1 -- 172.21.15.26:0/333116732 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdd20016930 con 0x7fdd24099a40 2023-10-01T07:57:55.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.082+0000 7fad8ed9f700 1 Processor -- start 2023-10-01T07:57:55.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.083+0000 7fad8ed9f700 1 -- start start 2023-10-01T07:57:55.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.083+0000 7fad8ed9f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fad8809d800 0x7fad8809dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:55.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.083+0000 7fad8ed9f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fad8809e110 0x7fad88133860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:55.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.083+0000 7fad8ed9f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad88099e10 con 0x7fad88133da0 2023-10-01T07:57:55.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.083+0000 7fad8ed9f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad8809f560 con 0x7fad8809d800 2023-10-01T07:57:55.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.083+0000 7fad8ed9f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad8806b4d0 con 0x7fad8809e110 2023-10-01T07:57:55.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.083+0000 7fad8dd9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fad8809d800 0x7fad8809dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:55.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.083+0000 7fad8d59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fad8809e110 0x7fad88133860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:55.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.083+0000 7fad8dd9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fad8809d800 0x7fad8809dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47832/0 (socket says 172.21.15.26:47832) 2023-10-01T07:57:55.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.083+0000 7fad8dd9d700 1 -- 172.21.15.26:0/2199491732 learned_addr learned my addr 172.21.15.26:0/2199491732 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:55.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.084+0000 7fad8dd9d700 1 -- 172.21.15.26:0/2199491732 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fad8809e110 msgr2=0x7fad88133860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:55.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.084+0000 7fad8dd9d700 1 --2- 172.21.15.26:0/2199491732 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fad8809e110 0x7fad88133860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:55.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.084+0000 7fad8dd9d700 1 -- 172.21.15.26:0/2199491732 >> v1:172.21.15.26:6789/0 conn(0x7fad88133da0 legacy=0x7fad8813aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:55.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.084+0000 7fad8dd9d700 1 -- 172.21.15.26:0/2199491732 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad8809a060 con 0x7fad8809d800 2023-10-01T07:57:55.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.084+0000 7fad8cd9b700 1 -- 172.21.15.26:0/2199491732 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3703826523 0 0) 0x7fad88099e10 con 0x7fad88133da0 2023-10-01T07:57:55.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.084+0000 7fad8dd9d700 1 --2- 172.21.15.26:0/2199491732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad8809d800 0x7fad8809dbd0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fad840098f0 tx=0x7fad84009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f141430e24dab2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:55.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.084+0000 7fad8cd9b700 1 -- 172.21.15.26:0/2199491732 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad84011830 con 0x7fad8809d800 2023-10-01T07:57:55.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.084+0000 7fad8cd9b700 1 -- 172.21.15.26:0/2199491732 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad84011990 con 0x7fad8809d800 2023-10-01T07:57:55.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.084+0000 7fad8cd9b700 1 -- 172.21.15.26:0/2199491732 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad84011d20 con 0x7fad8809d800 2023-10-01T07:57:55.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.085+0000 7fad8ed9f700 1 -- 172.21.15.26:0/2199491732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad8809d800 msgr2=0x7fad8809dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:55.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.085+0000 7fad8ed9f700 1 --2- 172.21.15.26:0/2199491732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad8809d800 0x7fad8809dbd0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fad840098f0 tx=0x7fad84009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:55.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.085+0000 7fad8ed9f700 1 -- 172.21.15.26:0/2199491732 shutdown_connections 2023-10-01T07:57:55.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.085+0000 7fad8ed9f700 1 --2- 172.21.15.26:0/2199491732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad8809d800 0x7fad8809dbd0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:55.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.085+0000 7fad8ed9f700 1 --2- 172.21.15.26:0/2199491732 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fad8809e110 0x7fad88133860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:55.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.085+0000 7fad8ed9f700 1 -- 172.21.15.26:0/2199491732 >> 172.21.15.26:0/2199491732 conn(0x7fad880a2e20 msgr2=0x7fad880a3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:55.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.085+0000 7fad8ed9f700 1 -- 172.21.15.26:0/2199491732 shutdown_connections 2023-10-01T07:57:55.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.085+0000 7fad8ed9f700 1 -- 172.21.15.26:0/2199491732 wait complete. 2023-10-01T07:57:55.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.087+0000 7fad8ed9f700 1 Processor -- start 2023-10-01T07:57:55.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.087+0000 7fad8ed9f700 1 -- start start 2023-10-01T07:57:55.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.087+0000 7fad8ed9f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad8809d800 0x7fad881c8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:55.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.087+0000 7fad8ed9f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fad8809e110 0x7fad881c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:55.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.087+0000 7fad8ed9f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fad88133da0 0x7fad88122830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:55.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.087+0000 7fad8ed9f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad88126ea0 con 0x7fad8809d800 2023-10-01T07:57:55.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.087+0000 7fad8ed9f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad88126070 con 0x7fad8809e110 2023-10-01T07:57:55.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.087+0000 7fad8ed9f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad881262c0 con 0x7fad88133da0 2023-10-01T07:57:55.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.088+0000 7fad8d59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fad8809e110 0x7fad881c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:55.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.088+0000 7fad8d59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fad8809e110 0x7fad881c89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58628/0 (socket says 172.21.15.26:58628) 2023-10-01T07:57:55.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.088+0000 7fad8dd9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad8809d800 0x7fad881c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:55.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.088+0000 7fad8d59c700 1 -- 172.21.15.26:0/3657192155 learned_addr learned my addr 172.21.15.26:0/3657192155 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:55.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.088+0000 7fad8d59c700 1 -- 172.21.15.26:0/3657192155 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fad88133da0 msgr2=0x7fad88122830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:55.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.088+0000 7fad8d59c700 1 --2- 172.21.15.26:0/3657192155 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fad88133da0 0x7fad88122830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:55.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.088+0000 7fad8d59c700 1 -- 172.21.15.26:0/3657192155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad8809d800 msgr2=0x7fad881c8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:55.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.088+0000 7fad8d59c700 1 --2- 172.21.15.26:0/3657192155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad8809d800 0x7fad881c8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:55.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.088+0000 7fad8d59c700 1 -- 172.21.15.26:0/3657192155 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad84009550 con 0x7fad8809e110 2023-10-01T07:57:55.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.088+0000 7fad8dd9d700 1 --2- 172.21.15.26:0/3657192155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad8809d800 0x7fad881c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:55.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.088+0000 7fad8d59c700 1 --2- 172.21.15.26:0/3657192155 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fad8809e110 0x7fad881c89d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fad7800e990 tx=0x7fad7800eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:55.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.088+0000 7fad7e7fc700 1 -- 172.21.15.26:0/3657192155 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad780096f0 con 0x7fad8809e110 2023-10-01T07:57:55.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.088+0000 7fad8ed9f700 1 -- 172.21.15.26:0/3657192155 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad881243b0 con 0x7fad8809e110 2023-10-01T07:57:55.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.089+0000 7fad8ed9f700 1 -- 172.21.15.26:0/3657192155 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad8809c510 con 0x7fad8809e110 2023-10-01T07:57:55.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.089+0000 7fad7e7fc700 1 -- 172.21.15.26:0/3657192155 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7800c850 con 0x7fad8809e110 2023-10-01T07:57:55.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.089+0000 7fad7e7fc700 1 -- 172.21.15.26:0/3657192155 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7800eee0 con 0x7fad8809e110 2023-10-01T07:57:55.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.090+0000 7fad7e7fc700 1 -- 172.21.15.26:0/3657192155 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fad7800cbc0 con 0x7fad8809e110 2023-10-01T07:57:55.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.090+0000 7fad8ed9f700 1 -- 172.21.15.26:0/3657192155 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad700052e0 con 0x7fad8809e110 2023-10-01T07:57:55.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.090+0000 7fad7e7fc700 1 -- 172.21.15.26:0/3657192155 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fad7803fff0 con 0x7fad8809e110 2023-10-01T07:57:55.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.095+0000 7fad7e7fc700 1 -- 172.21.15.26:0/3657192155 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fad78024350 con 0x7fad8809e110 2023-10-01T07:57:55.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.208+0000 7fa52770e700 1 -- 172.21.15.26:0/2918451846 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa5201a6550 con 0x7fa52009d6f0 2023-10-01T07:57:55.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.209+0000 7fa515ffb700 1 -- 172.21.15.26:0/2918451846 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa5201a6550 con 0x7fa52009d6f0 2023-10-01T07:57:55.210 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:55.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.211+0000 7fa52770e700 1 -- 172.21.15.26:0/2918451846 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa52009d6f0 msgr2=0x7fa5201a53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:55.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.211+0000 7fa52770e700 1 --2- 172.21.15.26:0/2918451846 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa52009d6f0 0x7fa5201a53f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa51c016000 tx=0x7fa51c004750 comp rx=0 tx=0).stop 2023-10-01T07:57:55.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.211+0000 7fa52770e700 1 -- 172.21.15.26:0/2918451846 shutdown_connections 2023-10-01T07:57:55.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.211+0000 7fa52770e700 1 --2- 172.21.15.26:0/2918451846 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa52009e410 0x7fa5201c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:55.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.211+0000 7fa52770e700 1 --2- 172.21.15.26:0/2918451846 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa52009d6f0 0x7fa5201a53f0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:55.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.211+0000 7fa52770e700 1 --2- 172.21.15.26:0/2918451846 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa52009e000 0x7fa5201c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:55.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.211+0000 7fa52770e700 1 -- 172.21.15.26:0/2918451846 >> 172.21.15.26:0/2918451846 conn(0x7fa520066f50 msgr2=0x7fa520071280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:55.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.211+0000 7fa52770e700 1 -- 172.21.15.26:0/2918451846 shutdown_connections 2023-10-01T07:57:55.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.211+0000 7fa52770e700 1 -- 172.21.15.26:0/2918451846 wait complete. 2023-10-01T07:57:55.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.217+0000 7f85ee12d700 1 -- 172.21.15.26:0/813601195 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f85e8074ea0 con 0x7f85e8136f50 2023-10-01T07:57:55.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.217+0000 7f85cffff700 1 -- 172.21.15.26:0/813601195 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f85e0049060 con 0x7f85e8136f50 2023-10-01T07:57:55.219 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:55.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.220+0000 7f85ee12d700 1 -- 172.21.15.26:0/813601195 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f85e8136f50 msgr2=0x7f85e81c61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:55.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.220+0000 7f85ee12d700 1 --2- 172.21.15.26:0/813601195 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f85e8136f50 0x7f85e81c61b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f85e000fe70 tx=0x7f85e0009f30 comp rx=0 tx=0).stop 2023-10-01T07:57:55.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.221+0000 7f85ee12d700 1 -- 172.21.15.26:0/813601195 shutdown_connections 2023-10-01T07:57:55.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.221+0000 7f85ee12d700 1 --2- 172.21.15.26:0/813601195 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f85e8136f50 0x7f85e81c61b0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:55.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.221+0000 7f85ee12d700 1 --2- 172.21.15.26:0/813601195 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85e8131810 0x7f85e81199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:55.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.221+0000 7f85ee12d700 1 --2- 172.21.15.26:0/813601195 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f85e8134630 0x7f85e8119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:55.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.221+0000 7f85ee12d700 1 -- 172.21.15.26:0/813601195 >> 172.21.15.26:0/813601195 conn(0x7f85e80a2aa0 msgr2=0x7f85e8099a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:55.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.221+0000 7f85ee12d700 1 -- 172.21.15.26:0/813601195 shutdown_connections 2023-10-01T07:57:55.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.221+0000 7f85ee12d700 1 -- 172.21.15.26:0/813601195 wait complete. 2023-10-01T07:57:55.228 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:55.237 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:55.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.284+0000 7fdd2b7c8700 1 -- 172.21.15.26:0/333116732 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdd24074ea0 con 0x7fdd24099a40 2023-10-01T07:57:55.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.285+0000 7fdd19ffb700 1 -- 172.21.15.26:0/333116732 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdd20016340 con 0x7fdd24099a40 2023-10-01T07:57:55.286 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:55.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.287+0000 7fdd2b7c8700 1 -- 172.21.15.26:0/333116732 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd24099a40 msgr2=0x7fdd24119600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:55.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.287+0000 7fdd2b7c8700 1 --2- 172.21.15.26:0/333116732 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd24099a40 0x7fdd24119600 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fdd2000de30 tx=0x7fdd200103a0 comp rx=0 tx=0).stop 2023-10-01T07:57:55.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.287+0000 7fdd2b7c8700 1 -- 172.21.15.26:0/333116732 shutdown_connections 2023-10-01T07:57:55.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.287+0000 7fdd2b7c8700 1 --2- 172.21.15.26:0/333116732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd24131810 0x7fdd2411a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:55.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.287+0000 7fdd2b7c8700 1 --2- 172.21.15.26:0/333116732 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd24099a40 0x7fdd24119600 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:55.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.287+0000 7fdd2b7c8700 1 --2- 172.21.15.26:0/333116732 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd2409a3b0 0x7fdd24119b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:55.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.287+0000 7fdd2b7c8700 1 -- 172.21.15.26:0/333116732 >> 172.21.15.26:0/333116732 conn(0x7fdd240a2aa0 msgr2=0x7fdd2412e610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:55.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.287+0000 7fdd2b7c8700 1 -- 172.21.15.26:0/333116732 shutdown_connections 2023-10-01T07:57:55.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.287+0000 7fdd2b7c8700 1 -- 172.21.15.26:0/333116732 wait complete. 2023-10-01T07:57:55.302 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:55.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.306+0000 7fad8ed9f700 1 -- 172.21.15.26:0/3657192155 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fad70005590 con 0x7fad8809e110 2023-10-01T07:57:55.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.306+0000 7fad7e7fc700 1 -- 172.21.15.26:0/3657192155 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fad78017030 con 0x7fad8809e110 2023-10-01T07:57:55.307 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:55.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.309+0000 7fad8ed9f700 1 -- 172.21.15.26:0/3657192155 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fad8809e110 msgr2=0x7fad881c89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:55.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.309+0000 7fad8ed9f700 1 --2- 172.21.15.26:0/3657192155 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fad8809e110 0x7fad881c89d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fad7800e990 tx=0x7fad7800eca0 comp rx=0 tx=0).stop 2023-10-01T07:57:55.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.309+0000 7fad8ed9f700 1 -- 172.21.15.26:0/3657192155 shutdown_connections 2023-10-01T07:57:55.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.309+0000 7fad8ed9f700 1 --2- 172.21.15.26:0/3657192155 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fad88133da0 0x7fad88122830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:55.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.309+0000 7fad8ed9f700 1 --2- 172.21.15.26:0/3657192155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad8809d800 0x7fad881c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:55.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.309+0000 7fad8ed9f700 1 --2- 172.21.15.26:0/3657192155 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fad8809e110 0x7fad881c89d0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:55.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.309+0000 7fad8ed9f700 1 -- 172.21.15.26:0/3657192155 >> 172.21.15.26:0/3657192155 conn(0x7fad880a2e20 msgr2=0x7fad88070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:55.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.309+0000 7fad8ed9f700 1 -- 172.21.15.26:0/3657192155 shutdown_connections 2023-10-01T07:57:55.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:55.309+0000 7fad8ed9f700 1 -- 172.21.15.26:0/3657192155 wait complete. 2023-10-01T07:57:55.323 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:56.229 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:56.237 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:56.303 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:56.324 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:56.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.382+0000 7fedcf6b9700 1 Processor -- start 2023-10-01T07:57:56.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.383+0000 7fedcf6b9700 1 -- start start 2023-10-01T07:57:56.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.383+0000 7fedcf6b9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedc81338a0 0x7fedc8133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:56.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.383+0000 7fedcf6b9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fedc809de50 0x7fedc809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:56.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.383+0000 7fedcf6b9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedc809e760 0x7fedc813a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:56.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.383+0000 7fedcf6b9700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedc806fef0 con 0x7fedc809de50 2023-10-01T07:57:56.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.383+0000 7fedcf6b9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc806ef30 con 0x7fedc81338a0 2023-10-01T07:57:56.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.383+0000 7fedcf6b9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fedc81334b0 con 0x7fedc809e760 2023-10-01T07:57:56.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.384+0000 7fedcd455700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedc81338a0 0x7fedc8133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:56.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.384+0000 7fedcd455700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedc81338a0 0x7fedc8133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58638/0 (socket says 172.21.15.26:58638) 2023-10-01T07:57:56.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.384+0000 7fedcd455700 1 -- 172.21.15.26:0/1673356172 learned_addr learned my addr 172.21.15.26:0/1673356172 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:56.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.384+0000 7fedcdc56700 1 --2- 172.21.15.26:0/1673356172 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedc809e760 0x7fedc813a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:56.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.384+0000 7fedccc54700 1 --2- 172.21.15.26:0/1673356172 >> v2:172.21.15.26:3300/0 conn(0x7fedc809de50 0x7fedc809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:56.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.384+0000 7fedcd455700 1 -- 172.21.15.26:0/1673356172 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedc809e760 msgr2=0x7fedc813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:56.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.384+0000 7fedcd455700 1 --2- 172.21.15.26:0/1673356172 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedc809e760 0x7fedc813a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.384+0000 7fedcd455700 1 -- 172.21.15.26:0/1673356172 >> v2:172.21.15.26:3300/0 conn(0x7fedc809de50 msgr2=0x7fedc809e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:56.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.384+0000 7fedcd455700 1 --2- 172.21.15.26:0/1673356172 >> v2:172.21.15.26:3300/0 conn(0x7fedc809de50 0x7fedc809e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.384+0000 7fedcd455700 1 -- 172.21.15.26:0/1673356172 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc806fc30 con 0x7fedc81338a0 2023-10-01T07:57:56.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.384+0000 7fedcd455700 1 --2- 172.21.15.26:0/1673356172 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedc81338a0 0x7fedc8133c70 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fedc40098f0 tx=0x7fedc4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=417596d2182e65b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:56.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.385+0000 7fedbffff700 1 -- 172.21.15.26:0/1673356172 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc4011830 con 0x7fedc81338a0 2023-10-01T07:57:56.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.385+0000 7fedbffff700 1 -- 172.21.15.26:0/1673356172 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc4011990 con 0x7fedc81338a0 2023-10-01T07:57:56.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.385+0000 7fedbffff700 1 -- 172.21.15.26:0/1673356172 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc4011d20 con 0x7fedc81338a0 2023-10-01T07:57:56.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.386+0000 7fedcf6b9700 1 -- 172.21.15.26:0/1673356172 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedc81338a0 msgr2=0x7fedc8133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:56.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.386+0000 7fedcf6b9700 1 --2- 172.21.15.26:0/1673356172 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedc81338a0 0x7fedc8133c70 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fedc40098f0 tx=0x7fedc4009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:56.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.388+0000 7fedcf6b9700 1 -- 172.21.15.26:0/1673356172 shutdown_connections 2023-10-01T07:57:56.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.388+0000 7fedcf6b9700 1 --2- 172.21.15.26:0/1673356172 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedc809e760 0x7fedc813a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.388+0000 7fedcf6b9700 1 --2- 172.21.15.26:0/1673356172 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedc81338a0 0x7fedc8133c70 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.388+0000 7fedcf6b9700 1 --2- 172.21.15.26:0/1673356172 >> v2:172.21.15.26:3300/0 conn(0x7fedc809de50 0x7fedc809e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.388+0000 7fedcf6b9700 1 -- 172.21.15.26:0/1673356172 >> 172.21.15.26:0/1673356172 conn(0x7fedc80a2aa0 msgr2=0x7fedc80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:56.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.388+0000 7fedcf6b9700 1 -- 172.21.15.26:0/1673356172 shutdown_connections 2023-10-01T07:57:56.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.388+0000 7fedcf6b9700 1 -- 172.21.15.26:0/1673356172 wait complete. 2023-10-01T07:57:56.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.389+0000 7fedcf6b9700 1 Processor -- start 2023-10-01T07:57:56.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.389+0000 7fedcf6b9700 1 -- start start 2023-10-01T07:57:56.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.390+0000 7fedcf6b9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedc809de50 0x7fedc811b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:56.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.390+0000 7fedcf6b9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedc809e760 0x7fedc811bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:56.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.390+0000 7fedcf6b9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedc81338a0 0x7fedc811c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:56.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.390+0000 7fedcf6b9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc811ef80 con 0x7fedc81338a0 2023-10-01T07:57:56.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.390+0000 7fedcf6b9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc811d2f0 con 0x7fedc809e760 2023-10-01T07:57:56.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.390+0000 7fedcf6b9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fedc811f1d0 con 0x7fedc809de50 2023-10-01T07:57:56.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.390+0000 7fedcd455700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedc809de50 0x7fedc811b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:56.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.390+0000 7fedcd455700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedc809de50 0x7fedc811b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:54034/0 (socket says 172.21.15.26:54034) 2023-10-01T07:57:56.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.390+0000 7fedcd455700 1 -- 172.21.15.26:0/2104312344 learned_addr learned my addr 172.21.15.26:0/2104312344 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:56.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.390+0000 7fedcdc56700 1 --2- 172.21.15.26:0/2104312344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedc81338a0 0x7fedc811c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:56.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.390+0000 7fedccc54700 1 --2- 172.21.15.26:0/2104312344 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedc809e760 0x7fedc811bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:56.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.391+0000 7fedcd455700 1 -- 172.21.15.26:0/2104312344 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedc809e760 msgr2=0x7fedc811bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:56.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.391+0000 7fedcd455700 1 --2- 172.21.15.26:0/2104312344 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedc809e760 0x7fedc811bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.391+0000 7fedcd455700 1 -- 172.21.15.26:0/2104312344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedc81338a0 msgr2=0x7fedc811c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:56.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.391+0000 7fedcd455700 1 --2- 172.21.15.26:0/2104312344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedc81338a0 0x7fedc811c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.391+0000 7fedcd455700 1 -- 172.21.15.26:0/2104312344 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc4009550 con 0x7fedc809de50 2023-10-01T07:57:56.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.391+0000 7fedcd455700 1 --2- 172.21.15.26:0/2104312344 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedc809de50 0x7fedc811b730 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fedc4009c40 tx=0x7fedc4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:56.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.391+0000 7fedbdffb700 1 -- 172.21.15.26:0/2104312344 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc4004450 con 0x7fedc809de50 2023-10-01T07:57:56.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.391+0000 7fedbdffb700 1 -- 172.21.15.26:0/2104312344 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc40045b0 con 0x7fedc809de50 2023-10-01T07:57:56.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.391+0000 7fedcf6b9700 1 -- 172.21.15.26:0/2104312344 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc80a0f70 con 0x7fedc809de50 2023-10-01T07:57:56.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.392+0000 7fedbdffb700 1 -- 172.21.15.26:0/2104312344 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc40038c0 con 0x7fedc809de50 2023-10-01T07:57:56.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.392+0000 7fedcf6b9700 1 -- 172.21.15.26:0/2104312344 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc811da00 con 0x7fedc809de50 2023-10-01T07:57:56.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.393+0000 7fedbdffb700 1 -- 172.21.15.26:0/2104312344 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fedc4003a20 con 0x7fedc809de50 2023-10-01T07:57:56.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.393+0000 7fedcf6b9700 1 -- 172.21.15.26:0/2104312344 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feda80052e0 con 0x7fedc809de50 2023-10-01T07:57:56.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.393+0000 7fedbdffb700 1 -- 172.21.15.26:0/2104312344 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fedc4040670 con 0x7fedc809de50 2023-10-01T07:57:56.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.399+0000 7fedbdffb700 1 -- 172.21.15.26:0/2104312344 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fedc401a420 con 0x7fedc809de50 2023-10-01T07:57:56.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.430+0000 7ff4a2570700 1 Processor -- start 2023-10-01T07:57:56.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.430+0000 7ff4a2570700 1 -- start start 2023-10-01T07:57:56.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.431+0000 7ff4a2570700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff49c09e930 0x7ff49c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:56.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.431+0000 7ff4a2570700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff49c09f240 0x7ff49c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:56.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.431+0000 7ff4a2570700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49c070940 con 0x7ff49c09f650 2023-10-01T07:57:56.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.431+0000 7ff4a2570700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff49c06fd60 con 0x7ff49c09f240 2023-10-01T07:57:56.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.431+0000 7ff4a2570700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c06fa80 con 0x7ff49c09e930 2023-10-01T07:57:56.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.431+0000 7ff49bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff49c09e930 0x7ff49c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:56.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.431+0000 7ff49bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff49c09e930 0x7ff49c09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58652/0 (socket says 172.21.15.26:58652) 2023-10-01T07:57:56.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.431+0000 7ff49bfff700 1 -- 172.21.15.26:0/698295924 learned_addr learned my addr 172.21.15.26:0/698295924 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:56.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.432+0000 7ff49b7fe700 1 --2- 172.21.15.26:0/698295924 >> v2:172.21.15.26:3300/0 conn(0x7ff49c09f240 0x7ff49c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:56.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.432+0000 7ff49bfff700 1 -- 172.21.15.26:0/698295924 >> v2:172.21.15.26:3300/0 conn(0x7ff49c09f240 msgr2=0x7ff49c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:56.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.432+0000 7ff49bfff700 1 --2- 172.21.15.26:0/698295924 >> v2:172.21.15.26:3300/0 conn(0x7ff49c09f240 0x7ff49c1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.432+0000 7ff49bfff700 1 -- 172.21.15.26:0/698295924 >> v1:172.21.15.26:6789/0 conn(0x7ff49c09f650 legacy=0x7ff49c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:56.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.432+0000 7ff49bfff700 1 -- 172.21.15.26:0/698295924 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49c09fb60 con 0x7ff49c09e930 2023-10-01T07:57:56.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.432+0000 7ff49bfff700 1 --2- 172.21.15.26:0/698295924 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff49c09e930 0x7ff49c09ed00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff48c0098f0 tx=0x7ff48c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=688d8788a545ba72 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:56.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.432+0000 7ff49affd700 1 -- 172.21.15.26:0/698295924 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c011830 con 0x7ff49c09e930 2023-10-01T07:57:56.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.432+0000 7ff49affd700 1 -- 172.21.15.26:0/698295924 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48c011990 con 0x7ff49c09e930 2023-10-01T07:57:56.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.432+0000 7ff49affd700 1 -- 172.21.15.26:0/698295924 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c011d20 con 0x7ff49c09e930 2023-10-01T07:57:56.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.433+0000 7ff4a2570700 1 -- 172.21.15.26:0/698295924 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff49c09e930 msgr2=0x7ff49c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:56.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.433+0000 7ff4a2570700 1 --2- 172.21.15.26:0/698295924 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff49c09e930 0x7ff49c09ed00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff48c0098f0 tx=0x7ff48c009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:56.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.433+0000 7ff4a2570700 1 -- 172.21.15.26:0/698295924 shutdown_connections 2023-10-01T07:57:56.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.433+0000 7ff4a2570700 1 --2- 172.21.15.26:0/698295924 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff49c09e930 0x7ff49c09ed00 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.433+0000 7ff4a2570700 1 --2- 172.21.15.26:0/698295924 >> v2:172.21.15.26:3300/0 conn(0x7ff49c09f240 0x7ff49c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.433+0000 7ff4a2570700 1 -- 172.21.15.26:0/698295924 >> 172.21.15.26:0/698295924 conn(0x7ff49c0a4210 msgr2=0x7ff49c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:56.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.433+0000 7ff4a2570700 1 -- 172.21.15.26:0/698295924 shutdown_connections 2023-10-01T07:57:56.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.433+0000 7ff4a2570700 1 -- 172.21.15.26:0/698295924 wait complete. 2023-10-01T07:57:56.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.435+0000 7ff4a2570700 1 Processor -- start 2023-10-01T07:57:56.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.435+0000 7ff4a2570700 1 -- start start 2023-10-01T07:57:56.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.436+0000 7ff4a2570700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff49c09e930 0x7ff49c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:56.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.436+0000 7ff4a2570700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff49c09f240 0x7ff49c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:56.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.436+0000 7ff4a2570700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff49c09f650 0x7ff49c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:56.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.436+0000 7ff4a2570700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c1b72b0 con 0x7ff49c09f240 2023-10-01T07:57:56.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.436+0000 7ff4a2570700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c1a9460 con 0x7ff49c09e930 2023-10-01T07:57:56.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.436+0000 7ff4a2570700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c1a8980 con 0x7ff49c09f650 2023-10-01T07:57:56.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.436+0000 7ff49bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff49c09e930 0x7ff49c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:56.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.436+0000 7ff49bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff49c09e930 0x7ff49c06b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58664/0 (socket says 172.21.15.26:58664) 2023-10-01T07:57:56.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.436+0000 7ff49bfff700 1 -- 172.21.15.26:0/2706094835 learned_addr learned my addr 172.21.15.26:0/2706094835 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:56.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.436+0000 7ff49b7fe700 1 --2- 172.21.15.26:0/2706094835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff49c09f240 0x7ff49c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:56.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.436+0000 7ff4a0b0d700 1 --2- 172.21.15.26:0/2706094835 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff49c09f650 0x7ff49c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:56.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.436+0000 7ff49bfff700 1 -- 172.21.15.26:0/2706094835 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff49c09f650 msgr2=0x7ff49c06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:56.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.436+0000 7ff49bfff700 1 --2- 172.21.15.26:0/2706094835 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff49c09f650 0x7ff49c06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.437+0000 7ff49bfff700 1 -- 172.21.15.26:0/2706094835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff49c09f240 msgr2=0x7ff49c06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:56.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.437+0000 7ff49bfff700 1 --2- 172.21.15.26:0/2706094835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff49c09f240 0x7ff49c06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.437+0000 7ff49bfff700 1 -- 172.21.15.26:0/2706094835 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff48c009550 con 0x7ff49c09e930 2023-10-01T07:57:56.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.437+0000 7ff49bfff700 1 --2- 172.21.15.26:0/2706094835 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff49c09e930 0x7ff49c06b8b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff48c009c40 tx=0x7ff48c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:56.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.437+0000 7ff498ff9700 1 -- 172.21.15.26:0/2706094835 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c004400 con 0x7ff49c09e930 2023-10-01T07:57:56.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.437+0000 7ff498ff9700 1 -- 172.21.15.26:0/2706094835 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48c01f070 con 0x7ff49c09e930 2023-10-01T07:57:56.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.437+0000 7ff4a2570700 1 -- 172.21.15.26:0/2706094835 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff49c0a0190 con 0x7ff49c09e930 2023-10-01T07:57:56.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.437+0000 7ff498ff9700 1 -- 172.21.15.26:0/2706094835 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c0038e0 con 0x7ff49c09e930 2023-10-01T07:57:56.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.437+0000 7ff4a2570700 1 -- 172.21.15.26:0/2706094835 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff49c1a9770 con 0x7ff49c09e930 2023-10-01T07:57:56.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.438+0000 7ff498ff9700 1 -- 172.21.15.26:0/2706094835 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff48c021030 con 0x7ff49c09e930 2023-10-01T07:57:56.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.438+0000 7ff498ff9700 1 -- 172.21.15.26:0/2706094835 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff48c040ac0 con 0x7ff49c09e930 2023-10-01T07:57:56.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.439+0000 7ff4a2570700 1 -- 172.21.15.26:0/2706094835 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff49c1a9770 con 0x7ff49c09e930 2023-10-01T07:57:56.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.447+0000 7ff498ff9700 1 -- 172.21.15.26:0/2706094835 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff49c1a9770 con 0x7ff49c09e930 2023-10-01T07:57:56.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.479+0000 7f89412bf700 1 Processor -- start 2023-10-01T07:57:56.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.479+0000 7f89412bf700 1 -- start start 2023-10-01T07:57:56.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.480+0000 7f89412bf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f893c09d6f0 0x7f893c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:56.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.480+0000 7f89412bf700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f893c09e000 0x7f893c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:56.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.480+0000 7f89412bf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f893c09e410 0x7f893c133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:56.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.480+0000 7f89412bf700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f893c06b460 con 0x7f893c09e000 2023-10-01T07:57:56.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.480+0000 7f89412bf700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f893c09b120 con 0x7f893c09e410 2023-10-01T07:57:56.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.480+0000 7f89412bf700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f893c09a7e0 con 0x7f893c09d6f0 2023-10-01T07:57:56.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.480+0000 7f893affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f893c09d6f0 0x7f893c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:56.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.480+0000 7f893affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f893c09d6f0 0x7f893c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:54038/0 (socket says 172.21.15.26:54038) 2023-10-01T07:57:56.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.480+0000 7f893affd700 1 -- 172.21.15.26:0/463548767 learned_addr learned my addr 172.21.15.26:0/463548767 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:56.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.480+0000 7f893a7fc700 1 --2- 172.21.15.26:0/463548767 >> v2:172.21.15.26:3300/0 conn(0x7f893c09e000 0x7f893c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:56.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.480+0000 7f893b7fe700 1 --2- 172.21.15.26:0/463548767 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f893c09e410 0x7f893c133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:56.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.481+0000 7f893affd700 1 -- 172.21.15.26:0/463548767 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f893c09e410 msgr2=0x7f893c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:56.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.481+0000 7f893affd700 1 --2- 172.21.15.26:0/463548767 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f893c09e410 0x7f893c133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.481+0000 7f893affd700 1 -- 172.21.15.26:0/463548767 >> v2:172.21.15.26:3300/0 conn(0x7f893c09e000 msgr2=0x7f893c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:56.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.481+0000 7f893affd700 1 --2- 172.21.15.26:0/463548767 >> v2:172.21.15.26:3300/0 conn(0x7f893c09e000 0x7f893c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.481+0000 7f893affd700 1 -- 172.21.15.26:0/463548767 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893c09a500 con 0x7f893c09d6f0 2023-10-01T07:57:56.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.481+0000 7f893affd700 1 --2- 172.21.15.26:0/463548767 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f893c09d6f0 0x7f893c09dac0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f892c009920 tx=0x7f892c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ce16ab8f2c64639 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:56.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.481+0000 7f8939ffb700 1 -- 172.21.15.26:0/463548767 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c011830 con 0x7f893c09d6f0 2023-10-01T07:57:56.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.481+0000 7f8939ffb700 1 -- 172.21.15.26:0/463548767 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892c011990 con 0x7f893c09d6f0 2023-10-01T07:57:56.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.481+0000 7f8939ffb700 1 -- 172.21.15.26:0/463548767 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c011d20 con 0x7f893c09d6f0 2023-10-01T07:57:56.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.482+0000 7f89412bf700 1 -- 172.21.15.26:0/463548767 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f893c09d6f0 msgr2=0x7f893c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:56.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.482+0000 7f89412bf700 1 --2- 172.21.15.26:0/463548767 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f893c09d6f0 0x7f893c09dac0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f892c009920 tx=0x7f892c009c30 comp rx=0 tx=0).stop 2023-10-01T07:57:56.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.482+0000 7f89412bf700 1 -- 172.21.15.26:0/463548767 shutdown_connections 2023-10-01T07:57:56.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.482+0000 7f89412bf700 1 --2- 172.21.15.26:0/463548767 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f893c09e410 0x7f893c133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.482+0000 7f89412bf700 1 --2- 172.21.15.26:0/463548767 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f893c09d6f0 0x7f893c09dac0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.482+0000 7f89412bf700 1 --2- 172.21.15.26:0/463548767 >> v2:172.21.15.26:3300/0 conn(0x7f893c09e000 0x7f893c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.482+0000 7f89412bf700 1 -- 172.21.15.26:0/463548767 >> 172.21.15.26:0/463548767 conn(0x7f893c066f50 msgr2=0x7f893c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:56.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.482+0000 7f89412bf700 1 -- 172.21.15.26:0/463548767 shutdown_connections 2023-10-01T07:57:56.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.482+0000 7f89412bf700 1 -- 172.21.15.26:0/463548767 wait complete. 2023-10-01T07:57:56.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.484+0000 7f89412bf700 1 Processor -- start 2023-10-01T07:57:56.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.484+0000 7f89412bf700 1 -- start start 2023-10-01T07:57:56.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.484+0000 7f89412bf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f893c09d6f0 0x7f893c1a4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:56.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.484+0000 7f89412bf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f893c09e000 0x7f893c1a5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.485+0000 7f89412bf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f893c09e410 0x7f893c1a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.485+0000 7f89412bf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893c1a8150 con 0x7f893c09d6f0 2023-10-01T07:57:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.485+0000 7f89412bf700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f893c1a92a0 con 0x7f893c09e000 2023-10-01T07:57:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.485+0000 7f89412bf700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f893c1a7c20 con 0x7f893c09e410 2023-10-01T07:57:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.485+0000 7f893a7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f893c09e000 0x7f893c1a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.485+0000 7f893b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f893c09e410 0x7f893c1a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.485+0000 7f893a7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f893c09e000 0x7f893c1a5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58690/0 (socket says 172.21.15.26:58690) 2023-10-01T07:57:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.485+0000 7f893b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f893c09e410 0x7f893c1a58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:54050/0 (socket says 172.21.15.26:54050) 2023-10-01T07:57:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.485+0000 7f893a7fc700 1 -- 172.21.15.26:0/4098501445 learned_addr learned my addr 172.21.15.26:0/4098501445 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.485+0000 7f893b7fe700 1 -- 172.21.15.26:0/4098501445 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f893c09e000 msgr2=0x7f893c1a5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:56.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.485+0000 7f893b7fe700 1 --2- 172.21.15.26:0/4098501445 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f893c09e000 0x7f893c1a5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.485+0000 7f893b7fe700 1 -- 172.21.15.26:0/4098501445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f893c09d6f0 msgr2=0x7f893c1a4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:56.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.485+0000 7f893b7fe700 1 --2- 172.21.15.26:0/4098501445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f893c09d6f0 0x7f893c1a4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.485+0000 7f893b7fe700 1 -- 172.21.15.26:0/4098501445 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f892c009550 con 0x7f893c09e410 2023-10-01T07:57:56.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.485+0000 7f893a7fc700 1 --2- 172.21.15.26:0/4098501445 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f893c09e000 0x7f893c1a5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:56.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.486+0000 7f893b7fe700 1 --2- 172.21.15.26:0/4098501445 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f893c09e410 0x7f893c1a58d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8934009d90 tx=0x7f893400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:56.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.486+0000 7f89237fe700 1 -- 172.21.15.26:0/4098501445 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8934009c00 con 0x7f893c09e410 2023-10-01T07:57:56.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.486+0000 7f89237fe700 1 -- 172.21.15.26:0/4098501445 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893400f040 con 0x7f893c09e410 2023-10-01T07:57:56.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.486+0000 7f89412bf700 1 -- 172.21.15.26:0/4098501445 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f893c1a8600 con 0x7f893c09e410 2023-10-01T07:57:56.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.486+0000 7f89237fe700 1 -- 172.21.15.26:0/4098501445 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8934014480 con 0x7f893c09e410 2023-10-01T07:57:56.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.486+0000 7f89412bf700 1 -- 172.21.15.26:0/4098501445 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f893c09c710 con 0x7f893c09e410 2023-10-01T07:57:56.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.487+0000 7f89237fe700 1 -- 172.21.15.26:0/4098501445 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f89340145e0 con 0x7f893c09e410 2023-10-01T07:57:56.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.487+0000 7f89412bf700 1 -- 172.21.15.26:0/4098501445 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f893c074ea0 con 0x7f893c09e410 2023-10-01T07:57:56.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.487+0000 7f89237fe700 1 -- 172.21.15.26:0/4098501445 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f89340417f0 con 0x7f893c09e410 2023-10-01T07:57:56.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.497+0000 7f89237fe700 1 -- 172.21.15.26:0/4098501445 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8934018080 con 0x7f893c09e410 2023-10-01T07:57:56.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.525+0000 7f71b3fbe700 1 Processor -- start 2023-10-01T07:57:56.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.525+0000 7f71b3fbe700 1 -- start start 2023-10-01T07:57:56.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.526+0000 7f71b3fbe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f71ac0a0a30 0x7f71ac0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:56.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.526+0000 7f71b3fbe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f71ac0a1340 0x7f71ac133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:56.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.526+0000 7f71b3fbe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f71ac133fa0 0x7f71ac134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:56.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.526+0000 7f71b3fbe700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71ac09edd0 con 0x7f71ac0a0a30 2023-10-01T07:57:56.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.526+0000 7f71b3fbe700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac09e1f0 con 0x7f71ac133fa0 2023-10-01T07:57:56.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.526+0000 7f71b3fbe700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac09dc50 con 0x7f71ac0a1340 2023-10-01T07:57:56.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.526+0000 7f71b1d5a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f71ac0a0a30 0x7f71ac0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:56.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.526+0000 7f71b1d5a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f71ac0a0a30 0x7f71ac0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47898/0 (socket says 172.21.15.26:47898) 2023-10-01T07:57:56.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.526+0000 7f71b1d5a700 1 -- 172.21.15.26:0/2163202645 learned_addr learned my addr 172.21.15.26:0/2163202645 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:56.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.526+0000 7f71b255b700 1 --2- 172.21.15.26:0/2163202645 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f71ac133fa0 0x7f71ac134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:56.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.527+0000 7f71b1559700 1 --2- 172.21.15.26:0/2163202645 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f71ac0a1340 0x7f71ac133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:56.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.527+0000 7f71b1d5a700 1 -- 172.21.15.26:0/2163202645 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f71ac0a1340 msgr2=0x7f71ac133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:56.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.527+0000 7f71b1d5a700 1 --2- 172.21.15.26:0/2163202645 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f71ac0a1340 0x7f71ac133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.527+0000 7f71b1d5a700 1 -- 172.21.15.26:0/2163202645 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f71ac133fa0 msgr2=0x7f71ac134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:56.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.527+0000 7f71b1d5a700 1 --2- 172.21.15.26:0/2163202645 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f71ac133fa0 0x7f71ac134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.527+0000 7f71b1d5a700 1 -- 172.21.15.26:0/2163202645 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ac0a1fe0 con 0x7f71ac0a0a30 2023-10-01T07:57:56.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.527+0000 7f71b255b700 1 --2- 172.21.15.26:0/2163202645 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f71ac133fa0 0x7f71ac134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:56.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.527+0000 7f71b1d5a700 1 --2- 172.21.15.26:0/2163202645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71ac0a0a30 0x7f71ac0a0e00 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f71a80098f0 tx=0x7f71a8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5100ba184971ae45 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:56.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.527+0000 7f71b0d58700 1 -- 172.21.15.26:0/2163202645 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a8011830 con 0x7f71ac0a0a30 2023-10-01T07:57:56.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.527+0000 7f71b0d58700 1 -- 172.21.15.26:0/2163202645 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a8011990 con 0x7f71ac0a0a30 2023-10-01T07:57:56.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.527+0000 7f71b0d58700 1 -- 172.21.15.26:0/2163202645 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a8011d20 con 0x7f71ac0a0a30 2023-10-01T07:57:56.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.528+0000 7f71b3fbe700 1 -- 172.21.15.26:0/2163202645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71ac0a0a30 msgr2=0x7f71ac0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:56.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.528+0000 7f71b3fbe700 1 --2- 172.21.15.26:0/2163202645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71ac0a0a30 0x7f71ac0a0e00 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f71a80098f0 tx=0x7f71a8009c00 comp rx=0 tx=0).stop 2023-10-01T07:57:56.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.528+0000 7f71b3fbe700 1 -- 172.21.15.26:0/2163202645 shutdown_connections 2023-10-01T07:57:56.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.528+0000 7f71b3fbe700 1 --2- 172.21.15.26:0/2163202645 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f71ac133fa0 0x7f71ac134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.528+0000 7f71b3fbe700 1 --2- 172.21.15.26:0/2163202645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71ac0a0a30 0x7f71ac0a0e00 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.528+0000 7f71b3fbe700 1 --2- 172.21.15.26:0/2163202645 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f71ac0a1340 0x7f71ac133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.528+0000 7f71b3fbe700 1 -- 172.21.15.26:0/2163202645 >> 172.21.15.26:0/2163202645 conn(0x7f71ac0a6550 msgr2=0x7f71ac0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:56.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.528+0000 7f71b3fbe700 1 -- 172.21.15.26:0/2163202645 shutdown_connections 2023-10-01T07:57:56.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.528+0000 7f71b3fbe700 1 -- 172.21.15.26:0/2163202645 wait complete. 2023-10-01T07:57:56.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.530+0000 7f71b3fbe700 1 Processor -- start 2023-10-01T07:57:56.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.530+0000 7f71b3fbe700 1 -- start start 2023-10-01T07:57:56.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.530+0000 7f71b3fbe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f71ac0a0a30 0x7f71ac1212a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:56.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.530+0000 7f71b3fbe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71ac0a1340 0x7f71ac1217e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:56.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.531+0000 7f71b3fbe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f71ac133fa0 0x7f71ac121d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:56.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.531+0000 7f71b3fbe700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac124dc0 con 0x7f71ac0a1340 2023-10-01T07:57:56.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.531+0000 7f71b3fbe700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac1248b0 con 0x7f71ac0a0a30 2023-10-01T07:57:56.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.531+0000 7f71b3fbe700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac123d40 con 0x7f71ac133fa0 2023-10-01T07:57:56.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.531+0000 7f71b1559700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71ac0a1340 0x7f71ac1217e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:56.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.531+0000 7f71b1559700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71ac0a1340 0x7f71ac1217e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47904/0 (socket says 172.21.15.26:47904) 2023-10-01T07:57:56.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.531+0000 7f71b1559700 1 -- 172.21.15.26:0/2607674904 learned_addr learned my addr 172.21.15.26:0/2607674904 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:56.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.531+0000 7f71b1d5a700 1 --2- 172.21.15.26:0/2607674904 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f71ac0a0a30 0x7f71ac1212a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:56.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.531+0000 7f71b1559700 1 -- 172.21.15.26:0/2607674904 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f71ac133fa0 msgr2=0x7f71ac121d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:56.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.531+0000 7f71b1559700 1 --2- 172.21.15.26:0/2607674904 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f71ac133fa0 0x7f71ac121d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.531+0000 7f71b1559700 1 -- 172.21.15.26:0/2607674904 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f71ac0a0a30 msgr2=0x7f71ac1212a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:56.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.531+0000 7f71b1559700 1 --2- 172.21.15.26:0/2607674904 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f71ac0a0a30 0x7f71ac1212a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.531+0000 7f71b1559700 1 -- 172.21.15.26:0/2607674904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a4009a70 con 0x7f71ac0a1340 2023-10-01T07:57:56.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.531+0000 7f71b1559700 1 --2- 172.21.15.26:0/2607674904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71ac0a1340 0x7f71ac1217e0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f719c00e9b0 tx=0x7f719c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:56.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.531+0000 7f71a27fc700 1 -- 172.21.15.26:0/2607674904 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719c009710 con 0x7f71ac0a1340 2023-10-01T07:57:56.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.532+0000 7f71a27fc700 1 -- 172.21.15.26:0/2607674904 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719c00c850 con 0x7f71ac0a1340 2023-10-01T07:57:56.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.532+0000 7f71a27fc700 1 -- 172.21.15.26:0/2607674904 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719c00cbc0 con 0x7f71ac0a1340 2023-10-01T07:57:56.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.532+0000 7f71b3fbe700 1 -- 172.21.15.26:0/2607674904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71a8009550 con 0x7f71ac0a1340 2023-10-01T07:57:56.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.532+0000 7f71b3fbe700 1 -- 172.21.15.26:0/2607674904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71ac0a0220 con 0x7f71ac0a1340 2023-10-01T07:57:56.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.533+0000 7f71a27fc700 1 -- 172.21.15.26:0/2607674904 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f719c00cd20 con 0x7f71ac0a1340 2023-10-01T07:57:56.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.533+0000 7f71b3fbe700 1 -- 172.21.15.26:0/2607674904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71ac074ea0 con 0x7f71ac0a1340 2023-10-01T07:57:56.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.534+0000 7f71a27fc700 1 -- 172.21.15.26:0/2607674904 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f719c03fb80 con 0x7f71ac0a1340 2023-10-01T07:57:56.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.539+0000 7f71a27fc700 1 -- 172.21.15.26:0/2607674904 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f719c011d90 con 0x7f71ac0a1340 2023-10-01T07:57:56.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.623+0000 7fedcf6b9700 1 -- 172.21.15.26:0/2104312344 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7feda8005590 con 0x7fedc809de50 2023-10-01T07:57:56.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.623+0000 7fedbdffb700 1 -- 172.21.15.26:0/2104312344 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fedc4028020 con 0x7fedc809de50 2023-10-01T07:57:56.626 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:56.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.626+0000 7fedcf6b9700 1 -- 172.21.15.26:0/2104312344 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedc809de50 msgr2=0x7fedc811b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:56.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.626+0000 7fedcf6b9700 1 --2- 172.21.15.26:0/2104312344 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedc809de50 0x7fedc811b730 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fedc4009c40 tx=0x7fedc4004750 comp rx=0 tx=0).stop 2023-10-01T07:57:56.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.626+0000 7fedcf6b9700 1 -- 172.21.15.26:0/2104312344 shutdown_connections 2023-10-01T07:57:56.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.626+0000 7fedcf6b9700 1 --2- 172.21.15.26:0/2104312344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedc81338a0 0x7fedc811c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.626+0000 7fedcf6b9700 1 --2- 172.21.15.26:0/2104312344 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedc809de50 0x7fedc811b730 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.626+0000 7fedcf6b9700 1 --2- 172.21.15.26:0/2104312344 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedc809e760 0x7fedc811bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.626+0000 7fedcf6b9700 1 -- 172.21.15.26:0/2104312344 >> 172.21.15.26:0/2104312344 conn(0x7fedc80a2aa0 msgr2=0x7fedc81306c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:56.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.626+0000 7fedcf6b9700 1 -- 172.21.15.26:0/2104312344 shutdown_connections 2023-10-01T07:57:56.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.626+0000 7fedcf6b9700 1 -- 172.21.15.26:0/2104312344 wait complete. 2023-10-01T07:57:56.641 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:56.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.667+0000 7ff4a2570700 1 -- 172.21.15.26:0/2706094835 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff49c1a9770 con 0x7ff49c09e930 2023-10-01T07:57:56.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.667+0000 7ff498ff9700 1 -- 172.21.15.26:0/2706094835 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff49c1a9770 con 0x7ff49c09e930 2023-10-01T07:57:56.668 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:56.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.669+0000 7ff4a2570700 1 -- 172.21.15.26:0/2706094835 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff49c09e930 msgr2=0x7ff49c06b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:56.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.669+0000 7ff4a2570700 1 --2- 172.21.15.26:0/2706094835 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff49c09e930 0x7ff49c06b8b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff48c009c40 tx=0x7ff48c004750 comp rx=0 tx=0).stop 2023-10-01T07:57:56.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.669+0000 7ff4a2570700 1 -- 172.21.15.26:0/2706094835 shutdown_connections 2023-10-01T07:57:56.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.669+0000 7ff4a2570700 1 --2- 172.21.15.26:0/2706094835 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff49c09f650 0x7ff49c06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.669+0000 7ff4a2570700 1 --2- 172.21.15.26:0/2706094835 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff49c09e930 0x7ff49c06b8b0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.669+0000 7ff4a2570700 1 --2- 172.21.15.26:0/2706094835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff49c09f240 0x7ff49c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.669+0000 7ff4a2570700 1 -- 172.21.15.26:0/2706094835 >> 172.21.15.26:0/2706094835 conn(0x7ff49c0a4210 msgr2=0x7ff49c1b8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:56.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.669+0000 7ff4a2570700 1 -- 172.21.15.26:0/2706094835 shutdown_connections 2023-10-01T07:57:56.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.670+0000 7ff4a2570700 1 -- 172.21.15.26:0/2706094835 wait complete. 2023-10-01T07:57:56.685 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:56.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.747+0000 7f89412bf700 1 -- 172.21.15.26:0/4098501445 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f893c1a8940 con 0x7f893c09e410 2023-10-01T07:57:56.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.747+0000 7f89237fe700 1 -- 172.21.15.26:0/4098501445 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8934045060 con 0x7f893c09e410 2023-10-01T07:57:56.748 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:56.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.750+0000 7f89412bf700 1 -- 172.21.15.26:0/4098501445 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f893c09e410 msgr2=0x7f893c1a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:56.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.750+0000 7f89412bf700 1 --2- 172.21.15.26:0/4098501445 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f893c09e410 0x7f893c1a58d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8934009d90 tx=0x7f893400c3a0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.750+0000 7f89412bf700 1 -- 172.21.15.26:0/4098501445 shutdown_connections 2023-10-01T07:57:56.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.750+0000 7f89412bf700 1 --2- 172.21.15.26:0/4098501445 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f893c09e410 0x7f893c1a58d0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.750+0000 7f89412bf700 1 --2- 172.21.15.26:0/4098501445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f893c09d6f0 0x7f893c1a4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.750+0000 7f89412bf700 1 --2- 172.21.15.26:0/4098501445 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f893c09e000 0x7f893c1a5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.750+0000 7f89412bf700 1 -- 172.21.15.26:0/4098501445 >> 172.21.15.26:0/4098501445 conn(0x7f893c066f50 msgr2=0x7f893c1bb010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:56.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.750+0000 7f89412bf700 1 -- 172.21.15.26:0/4098501445 shutdown_connections 2023-10-01T07:57:56.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.750+0000 7f89412bf700 1 -- 172.21.15.26:0/4098501445 wait complete. 2023-10-01T07:57:56.764 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:56.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.775+0000 7f71b3fbe700 1 -- 172.21.15.26:0/2607674904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f71ac132670 con 0x7f71ac0a1340 2023-10-01T07:57:56.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.775+0000 7f71a27fc700 1 -- 172.21.15.26:0/2607674904 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f719c017030 con 0x7f71ac0a1340 2023-10-01T07:57:56.776 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:56.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.778+0000 7f71b3fbe700 1 -- 172.21.15.26:0/2607674904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71ac0a1340 msgr2=0x7f71ac1217e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:56.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.778+0000 7f71b3fbe700 1 --2- 172.21.15.26:0/2607674904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71ac0a1340 0x7f71ac1217e0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f719c00e9b0 tx=0x7f719c00ed70 comp rx=0 tx=0).stop 2023-10-01T07:57:56.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.778+0000 7f71b3fbe700 1 -- 172.21.15.26:0/2607674904 shutdown_connections 2023-10-01T07:57:56.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.778+0000 7f71b3fbe700 1 --2- 172.21.15.26:0/2607674904 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f71ac133fa0 0x7f71ac121d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.778+0000 7f71b3fbe700 1 --2- 172.21.15.26:0/2607674904 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f71ac0a0a30 0x7f71ac1212a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.778+0000 7f71b3fbe700 1 --2- 172.21.15.26:0/2607674904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71ac0a1340 0x7f71ac1217e0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:56.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.778+0000 7f71b3fbe700 1 -- 172.21.15.26:0/2607674904 >> 172.21.15.26:0/2607674904 conn(0x7f71ac0a6550 msgr2=0x7f71ac0a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:56.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.778+0000 7f71b3fbe700 1 -- 172.21.15.26:0/2607674904 shutdown_connections 2023-10-01T07:57:56.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:56.778+0000 7f71b3fbe700 1 -- 172.21.15.26:0/2607674904 wait complete. 2023-10-01T07:57:56.791 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:57.642 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:57.687 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:57.765 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:57.792 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:57.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.795+0000 7f66cb34c700 1 Processor -- start 2023-10-01T07:57:57.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.796+0000 7f66cb34c700 1 -- start start 2023-10-01T07:57:57.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.796+0000 7f66cb34c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66c41338c0 0x7f66c4133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:57.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.796+0000 7f66cb34c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f66c409e560 0x7f66c413b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:57.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.796+0000 7f66cb34c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66c406f720 con 0x7f66c41341d0 2023-10-01T07:57:57.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.796+0000 7f66cb34c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66c4070c80 con 0x7f66c409e560 2023-10-01T07:57:57.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.796+0000 7f66cb34c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66c406fce0 con 0x7f66c41338c0 2023-10-01T07:57:57.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.796+0000 7f66c90e8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66c41338c0 0x7f66c4133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:57.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.796+0000 7f66c98e9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f66c409e560 0x7f66c413b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:57.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.796+0000 7f66c90e8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66c41338c0 0x7f66c4133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:54066/0 (socket says 172.21.15.26:54066) 2023-10-01T07:57:57.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.796+0000 7f66c90e8700 1 -- 172.21.15.26:0/1526661118 learned_addr learned my addr 172.21.15.26:0/1526661118 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:57.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.797+0000 7f66c98e9700 1 -- 172.21.15.26:0/1526661118 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66c41338c0 msgr2=0x7f66c4133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:57.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.797+0000 7f66c98e9700 1 --2- 172.21.15.26:0/1526661118 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66c41338c0 0x7f66c4133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:57.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.797+0000 7f66c98e9700 1 -- 172.21.15.26:0/1526661118 >> v1:172.21.15.26:6789/0 conn(0x7f66c41341d0 legacy=0x7f66c409de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:57.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.797+0000 7f66c98e9700 1 -- 172.21.15.26:0/1526661118 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c41336a0 con 0x7f66c409e560 2023-10-01T07:57:57.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.797+0000 7f66c98e9700 1 --2- 172.21.15.26:0/1526661118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66c409e560 0x7f66c413b860 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f66bc009d90 tx=0x7f66bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2178e86090064 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:57.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.797+0000 7f66bbfff700 1 -- 172.21.15.26:0/1526661118 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66bc00e070 con 0x7f66c409e560 2023-10-01T07:57:57.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.797+0000 7f66bbfff700 1 -- 172.21.15.26:0/1526661118 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66bc00bb20 con 0x7f66c409e560 2023-10-01T07:57:57.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.797+0000 7f66bbfff700 1 -- 172.21.15.26:0/1526661118 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66bc012430 con 0x7f66c409e560 2023-10-01T07:57:57.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.798+0000 7f66cb34c700 1 -- 172.21.15.26:0/1526661118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66c409e560 msgr2=0x7f66c413b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:57.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.798+0000 7f66cb34c700 1 --2- 172.21.15.26:0/1526661118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66c409e560 0x7f66c413b860 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f66bc009d90 tx=0x7f66bc00b330 comp rx=0 tx=0).stop 2023-10-01T07:57:57.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.798+0000 7f66cb34c700 1 -- 172.21.15.26:0/1526661118 shutdown_connections 2023-10-01T07:57:57.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.798+0000 7f66cb34c700 1 --2- 172.21.15.26:0/1526661118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66c409e560 0x7f66c413b860 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:57.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.798+0000 7f66cb34c700 1 --2- 172.21.15.26:0/1526661118 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66c41338c0 0x7f66c4133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:57.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.798+0000 7f66cb34c700 1 -- 172.21.15.26:0/1526661118 >> 172.21.15.26:0/1526661118 conn(0x7f66c40a2aa0 msgr2=0x7f66c40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:57.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.798+0000 7f66cb34c700 1 -- 172.21.15.26:0/1526661118 shutdown_connections 2023-10-01T07:57:57.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.798+0000 7f66cb34c700 1 -- 172.21.15.26:0/1526661118 wait complete. 2023-10-01T07:57:57.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.800+0000 7f66cb34c700 1 Processor -- start 2023-10-01T07:57:57.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.800+0000 7f66cb34c700 1 -- start start 2023-10-01T07:57:57.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.801+0000 7f66cb34c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66c409e560 0x7f66c411c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:57.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.801+0000 7f66cb34c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f66c41338c0 0x7f66c411cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:57.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.801+0000 7f66cb34c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66c41341d0 0x7f66c411d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:57.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.801+0000 7f66cb34c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c406f960 con 0x7f66c409e560 2023-10-01T07:57:57.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.801+0000 7f66cb34c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c40a1310 con 0x7f66c41338c0 2023-10-01T07:57:57.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.801+0000 7f66cb34c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66c411f390 con 0x7f66c41341d0 2023-10-01T07:57:57.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.801+0000 7f66c88e7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f66c41338c0 0x7f66c411cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:57.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.801+0000 7f66c88e7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f66c41338c0 0x7f66c411cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58714/0 (socket says 172.21.15.26:58714) 2023-10-01T07:57:57.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.801+0000 7f66c88e7700 1 -- 172.21.15.26:0/3039521968 learned_addr learned my addr 172.21.15.26:0/3039521968 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:57.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.801+0000 7f66c90e8700 1 --2- 172.21.15.26:0/3039521968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66c409e560 0x7f66c411c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:57.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.801+0000 7f66c98e9700 1 --2- 172.21.15.26:0/3039521968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66c41341d0 0x7f66c411d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:57.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.801+0000 7f66c90e8700 1 -- 172.21.15.26:0/3039521968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66c41341d0 msgr2=0x7f66c411d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:57.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.801+0000 7f66c90e8700 1 --2- 172.21.15.26:0/3039521968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66c41341d0 0x7f66c411d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:57.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.801+0000 7f66c90e8700 1 -- 172.21.15.26:0/3039521968 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f66c41338c0 msgr2=0x7f66c411cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:57.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.801+0000 7f66c90e8700 1 --2- 172.21.15.26:0/3039521968 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f66c41338c0 0x7f66c411cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:57.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.801+0000 7f66c90e8700 1 -- 172.21.15.26:0/3039521968 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66bc009a70 con 0x7f66c409e560 2023-10-01T07:57:57.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.801+0000 7f66c88e7700 1 --2- 172.21.15.26:0/3039521968 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f66c41338c0 0x7f66c411cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:57.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.802+0000 7f66c90e8700 1 --2- 172.21.15.26:0/3039521968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66c409e560 0x7f66c411c960 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f66c000e8e0 tx=0x7f66c000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:57.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.802+0000 7f66b9ffb700 1 -- 172.21.15.26:0/3039521968 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c0013680 con 0x7f66c409e560 2023-10-01T07:57:57.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.802+0000 7f66b9ffb700 1 -- 172.21.15.26:0/3039521968 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c00137e0 con 0x7f66c409e560 2023-10-01T07:57:57.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.802+0000 7f66cb34c700 1 -- 172.21.15.26:0/3039521968 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66c411fc10 con 0x7f66c409e560 2023-10-01T07:57:57.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.802+0000 7f66b9ffb700 1 -- 172.21.15.26:0/3039521968 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c0013b70 con 0x7f66c409e560 2023-10-01T07:57:57.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.802+0000 7f66cb34c700 1 -- 172.21.15.26:0/3039521968 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c4120c10 con 0x7f66c409e560 2023-10-01T07:57:57.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.803+0000 7f66b9ffb700 1 -- 172.21.15.26:0/3039521968 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f66c0013cd0 con 0x7f66c409e560 2023-10-01T07:57:57.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.803+0000 7f66b9ffb700 1 -- 172.21.15.26:0/3039521968 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f66c003f700 con 0x7f66c409e560 2023-10-01T07:57:57.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.804+0000 7f66cb34c700 1 -- 172.21.15.26:0/3039521968 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a40052e0 con 0x7f66c409e560 2023-10-01T07:57:57.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.813+0000 7f66b9ffb700 1 -- 172.21.15.26:0/3039521968 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f66c0017080 con 0x7f66c409e560 2023-10-01T07:57:57.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.837+0000 7f60d07a6700 1 Processor -- start 2023-10-01T07:57:57.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.837+0000 7f60d07a6700 1 -- start start 2023-10-01T07:57:57.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.838+0000 7f60d07a6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f60c809d6f0 0x7f60c809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:57.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.838+0000 7f60d07a6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60c809e410 0x7f60c8130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:57.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.838+0000 7f60d07a6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60c809f130 con 0x7f60c809e000 2023-10-01T07:57:57.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.838+0000 7f60d07a6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60c809f520 con 0x7f60c809d6f0 2023-10-01T07:57:57.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.838+0000 7f60d07a6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c809e930 con 0x7f60c809e410 2023-10-01T07:57:57.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.838+0000 7f60cdd41700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f60c809e000 0x7f60c8130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39820/0 (socket says 172.21.15.26:39820) 2023-10-01T07:57:57.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.838+0000 7f60cdd41700 1 -- 172.21.15.26:0/713545916 learned_addr learned my addr 172.21.15.26:0/713545916 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:57.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.838+0000 7f60ce542700 1 --2- 172.21.15.26:0/713545916 >> v2:172.21.15.26:3300/0 conn(0x7f60c809d6f0 0x7f60c809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:57.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.838+0000 7f60ced43700 1 --2- 172.21.15.26:0/713545916 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60c809e410 0x7f60c8130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:57.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.838+0000 7f60ce542700 1 -- 172.21.15.26:0/713545916 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60c809e410 msgr2=0x7f60c8130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:57.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.838+0000 7f60ce542700 1 --2- 172.21.15.26:0/713545916 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60c809e410 0x7f60c8130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:57.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.838+0000 7f60ce542700 1 -- 172.21.15.26:0/713545916 >> v1:172.21.15.26:6789/0 conn(0x7f60c809e000 legacy=0x7f60c8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:57.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.838+0000 7f60cd540700 1 -- 172.21.15.26:0/713545916 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3847076995 0 0) 0x7f60c809f130 con 0x7f60c809e000 2023-10-01T07:57:57.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.838+0000 7f60ce542700 1 -- 172.21.15.26:0/713545916 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c809b2d0 con 0x7f60c809d6f0 2023-10-01T07:57:57.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.839+0000 7f60ce542700 1 --2- 172.21.15.26:0/713545916 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60c809d6f0 0x7f60c809dac0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f60c4009840 tx=0x7f60c4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c50a44a1b619d5c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:57.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.839+0000 7f60cd540700 1 -- 172.21.15.26:0/713545916 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c400f8a0 con 0x7f60c809d6f0 2023-10-01T07:57:57.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.839+0000 7f60cd540700 1 -- 172.21.15.26:0/713545916 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c400fa00 con 0x7f60c809d6f0 2023-10-01T07:57:57.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.839+0000 7f60cd540700 1 -- 172.21.15.26:0/713545916 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c400fd90 con 0x7f60c809d6f0 2023-10-01T07:57:57.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.840+0000 7f60d07a6700 1 -- 172.21.15.26:0/713545916 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60c809d6f0 msgr2=0x7f60c809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:57.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.840+0000 7f60d07a6700 1 --2- 172.21.15.26:0/713545916 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60c809d6f0 0x7f60c809dac0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f60c4009840 tx=0x7f60c4009b50 comp rx=0 tx=0).stop 2023-10-01T07:57:57.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.840+0000 7f60d07a6700 1 -- 172.21.15.26:0/713545916 shutdown_connections 2023-10-01T07:57:57.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.840+0000 7f60d07a6700 1 --2- 172.21.15.26:0/713545916 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60c809d6f0 0x7f60c809dac0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:57.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.840+0000 7f60d07a6700 1 --2- 172.21.15.26:0/713545916 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60c809e410 0x7f60c8130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:57.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.840+0000 7f60d07a6700 1 -- 172.21.15.26:0/713545916 >> 172.21.15.26:0/713545916 conn(0x7f60c8066f50 msgr2=0x7f60c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:57.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.840+0000 7f60d07a6700 1 -- 172.21.15.26:0/713545916 shutdown_connections 2023-10-01T07:57:57.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.840+0000 7f60d07a6700 1 -- 172.21.15.26:0/713545916 wait complete. 2023-10-01T07:57:57.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.842+0000 7f60d07a6700 1 Processor -- start 2023-10-01T07:57:57.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.842+0000 7f60d07a6700 1 -- start start 2023-10-01T07:57:57.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.843+0000 7f60d07a6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60c809d6f0 0x7f60c811de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:57.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.843+0000 7f60d07a6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f60c809e000 0x7f60c811e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:57.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.843+0000 7f60d07a6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60c809e410 0x7f60c811e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:57.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.843+0000 7f60d07a6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c811f360 con 0x7f60c809e410 2023-10-01T07:57:57.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.843+0000 7f60d07a6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c8072640 con 0x7f60c809d6f0 2023-10-01T07:57:57.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.843+0000 7f60d07a6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60c81200f0 con 0x7f60c809e000 2023-10-01T07:57:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.843+0000 7f60ce542700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60c809d6f0 0x7f60c811de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.843+0000 7f60ce542700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60c809d6f0 0x7f60c811de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58732/0 (socket says 172.21.15.26:58732) 2023-10-01T07:57:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.843+0000 7f60ce542700 1 -- 172.21.15.26:0/438251792 learned_addr learned my addr 172.21.15.26:0/438251792 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.843+0000 7f60ced43700 1 --2- 172.21.15.26:0/438251792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60c809e410 0x7f60c811e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.843+0000 7f60cdd41700 1 --2- 172.21.15.26:0/438251792 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f60c809e000 0x7f60c811e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.843+0000 7f60ce542700 1 -- 172.21.15.26:0/438251792 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f60c809e000 msgr2=0x7f60c811e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.843+0000 7f60ce542700 1 --2- 172.21.15.26:0/438251792 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f60c809e000 0x7f60c811e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.844+0000 7f60ce542700 1 -- 172.21.15.26:0/438251792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60c809e410 msgr2=0x7f60c811e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.844+0000 7f60ce542700 1 --2- 172.21.15.26:0/438251792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60c809e410 0x7f60c811e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.844+0000 7f60ce542700 1 -- 172.21.15.26:0/438251792 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c40094a0 con 0x7f60c809d6f0 2023-10-01T07:57:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.844+0000 7f60ced43700 1 --2- 172.21.15.26:0/438251792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60c809e410 0x7f60c811e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:57.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.844+0000 7f60ce542700 1 --2- 172.21.15.26:0/438251792 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60c809d6f0 0x7f60c811de90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f60c4009b90 tx=0x7f60c4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:57.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.844+0000 7f60beffd700 1 -- 172.21.15.26:0/438251792 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c401e070 con 0x7f60c809d6f0 2023-10-01T07:57:57.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.844+0000 7f60beffd700 1 -- 172.21.15.26:0/438251792 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c4004430 con 0x7f60c809d6f0 2023-10-01T07:57:57.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.844+0000 7f60d07a6700 1 -- 172.21.15.26:0/438251792 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c8130270 con 0x7f60c809d6f0 2023-10-01T07:57:57.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.844+0000 7f60beffd700 1 -- 172.21.15.26:0/438251792 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c4003900 con 0x7f60c809d6f0 2023-10-01T07:57:57.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.844+0000 7f60d07a6700 1 -- 172.21.15.26:0/438251792 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c8120cf0 con 0x7f60c809d6f0 2023-10-01T07:57:57.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.845+0000 7f60beffd700 1 -- 172.21.15.26:0/438251792 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f60c4022070 con 0x7f60c809d6f0 2023-10-01T07:57:57.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.845+0000 7f60beffd700 1 -- 172.21.15.26:0/438251792 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f60c4041e70 con 0x7f60c809d6f0 2023-10-01T07:57:57.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.846+0000 7f60d07a6700 1 -- 172.21.15.26:0/438251792 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60c811ac20 con 0x7f60c809d6f0 2023-10-01T07:57:57.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.851+0000 7f60beffd700 1 -- 172.21.15.26:0/438251792 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f60c4029080 con 0x7f60c809d6f0 2023-10-01T07:57:57.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.918+0000 7fd2713d4700 1 Processor -- start 2023-10-01T07:57:57.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.918+0000 7fd2713d4700 1 -- start start 2023-10-01T07:57:57.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.919+0000 7fd2713d4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd26c09e1d0 0x7fd26c135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:57.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.919+0000 7fd2713d4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd26c135e50 0x7fd26c138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:57.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.919+0000 7fd2713d4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd26c09f130 con 0x7fd26c09d6f0 2023-10-01T07:57:57.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.919+0000 7fd2713d4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd26c09f520 con 0x7fd26c135e50 2023-10-01T07:57:57.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.919+0000 7fd2713d4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd26c09e930 con 0x7fd26c09e1d0 2023-10-01T07:57:57.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.919+0000 7fd26a7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd26c09e1d0 0x7fd26c135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:57.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.919+0000 7fd26a7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd26c09e1d0 0x7fd26c135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58740/0 (socket says 172.21.15.26:58740) 2023-10-01T07:57:57.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.919+0000 7fd26a7fc700 1 -- 172.21.15.26:0/2671253864 learned_addr learned my addr 172.21.15.26:0/2671253864 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:57.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.919+0000 7fd26b7fe700 1 --2- 172.21.15.26:0/2671253864 >> v2:172.21.15.26:3300/0 conn(0x7fd26c135e50 0x7fd26c138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:57.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.919+0000 7fd26a7fc700 1 -- 172.21.15.26:0/2671253864 >> v2:172.21.15.26:3300/0 conn(0x7fd26c135e50 msgr2=0x7fd26c138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:57.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.919+0000 7fd26a7fc700 1 --2- 172.21.15.26:0/2671253864 >> v2:172.21.15.26:3300/0 conn(0x7fd26c135e50 0x7fd26c138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:57.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.919+0000 7fd26a7fc700 1 -- 172.21.15.26:0/2671253864 >> v1:172.21.15.26:6789/0 conn(0x7fd26c09d6f0 legacy=0x7fd26c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:57.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.919+0000 7fd26a7fc700 1 -- 172.21.15.26:0/2671253864 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd26c09b2d0 con 0x7fd26c09e1d0 2023-10-01T07:57:57.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.919+0000 7fd26a7fc700 1 --2- 172.21.15.26:0/2671253864 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd26c09e1d0 0x7fd26c135910 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd260009920 tx=0x7fd260009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e8994681ab77538 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:57.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.920+0000 7fd269ffb700 1 -- 172.21.15.26:0/2671253864 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26000ba20 con 0x7fd26c09e1d0 2023-10-01T07:57:57.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.920+0000 7fd269ffb700 1 -- 172.21.15.26:0/2671253864 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26000bb80 con 0x7fd26c09e1d0 2023-10-01T07:57:57.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.920+0000 7fd269ffb700 1 -- 172.21.15.26:0/2671253864 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd260009e70 con 0x7fd26c09e1d0 2023-10-01T07:57:57.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.920+0000 7fd2713d4700 1 -- 172.21.15.26:0/2671253864 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd26c09e1d0 msgr2=0x7fd26c135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:57.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.920+0000 7fd2713d4700 1 --2- 172.21.15.26:0/2671253864 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd26c09e1d0 0x7fd26c135910 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd260009920 tx=0x7fd260009c30 comp rx=0 tx=0).stop 2023-10-01T07:57:57.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.920+0000 7fd2713d4700 1 -- 172.21.15.26:0/2671253864 shutdown_connections 2023-10-01T07:57:57.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.920+0000 7fd2713d4700 1 --2- 172.21.15.26:0/2671253864 >> v2:172.21.15.26:3300/0 conn(0x7fd26c135e50 0x7fd26c138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:57.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.920+0000 7fd2713d4700 1 --2- 172.21.15.26:0/2671253864 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd26c09e1d0 0x7fd26c135910 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:57.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.920+0000 7fd2713d4700 1 -- 172.21.15.26:0/2671253864 >> 172.21.15.26:0/2671253864 conn(0x7fd26c066f50 msgr2=0x7fd26c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:57.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.920+0000 7fd2713d4700 1 -- 172.21.15.26:0/2671253864 shutdown_connections 2023-10-01T07:57:57.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.920+0000 7fd2713d4700 1 -- 172.21.15.26:0/2671253864 wait complete. 2023-10-01T07:57:57.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.922+0000 7fd2713d4700 1 Processor -- start 2023-10-01T07:57:57.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.922+0000 7fd2713d4700 1 -- start start 2023-10-01T07:57:57.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.923+0000 7fd2713d4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd26c09d6f0 0x7fd26c132a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:57.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.923+0000 7fd2713d4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd26c09e1d0 0x7fd26c132f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:57.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.923+0000 7fd2713d4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd26c135e50 0x7fd26c133480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:57.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.923+0000 7fd2713d4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd26c130400 con 0x7fd26c135e50 2023-10-01T07:57:57.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.923+0000 7fd2713d4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd26c135810 con 0x7fd26c09d6f0 2023-10-01T07:57:57.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.923+0000 7fd2713d4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd26c133e60 con 0x7fd26c09e1d0 2023-10-01T07:57:57.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.923+0000 7fd26affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd26c09d6f0 0x7fd26c132a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:57.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.923+0000 7fd26affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd26c09d6f0 0x7fd26c132a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58744/0 (socket says 172.21.15.26:58744) 2023-10-01T07:57:57.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.923+0000 7fd26affd700 1 -- 172.21.15.26:0/1133022884 learned_addr learned my addr 172.21.15.26:0/1133022884 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:57.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.923+0000 7fd26a7fc700 1 --2- 172.21.15.26:0/1133022884 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd26c09e1d0 0x7fd26c132f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:57.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.923+0000 7fd26b7fe700 1 --2- 172.21.15.26:0/1133022884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd26c135e50 0x7fd26c133480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:57.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.923+0000 7fd26affd700 1 -- 172.21.15.26:0/1133022884 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd26c09e1d0 msgr2=0x7fd26c132f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:57.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.923+0000 7fd26affd700 1 --2- 172.21.15.26:0/1133022884 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd26c09e1d0 0x7fd26c132f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:57.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.923+0000 7fd26affd700 1 -- 172.21.15.26:0/1133022884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd26c135e50 msgr2=0x7fd26c133480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:57.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.923+0000 7fd26affd700 1 --2- 172.21.15.26:0/1133022884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd26c135e50 0x7fd26c133480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:57.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.923+0000 7fd26affd700 1 -- 172.21.15.26:0/1133022884 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd260009550 con 0x7fd26c09d6f0 2023-10-01T07:57:57.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.924+0000 7fd26b7fe700 1 --2- 172.21.15.26:0/1133022884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd26c135e50 0x7fd26c133480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:57:57.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.924+0000 7fd26affd700 1 --2- 172.21.15.26:0/1133022884 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd26c09d6f0 0x7fd26c132a00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd25c00c480 tx=0x7fd25c00c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:57.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.924+0000 7fd2537fe700 1 -- 172.21.15.26:0/1133022884 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25c0052d0 con 0x7fd26c09d6f0 2023-10-01T07:57:57.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.924+0000 7fd2537fe700 1 -- 172.21.15.26:0/1133022884 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25c005430 con 0x7fd26c09d6f0 2023-10-01T07:57:57.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.924+0000 7fd2537fe700 1 -- 172.21.15.26:0/1133022884 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25c0038c0 con 0x7fd26c09d6f0 2023-10-01T07:57:57.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.924+0000 7fd2713d4700 1 -- 172.21.15.26:0/1133022884 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd26c09c700 con 0x7fd26c09d6f0 2023-10-01T07:57:57.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.924+0000 7fd2713d4700 1 -- 172.21.15.26:0/1133022884 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd26c0a2260 con 0x7fd26c09d6f0 2023-10-01T07:57:57.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.925+0000 7fd2537fe700 1 -- 172.21.15.26:0/1133022884 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd25c003a20 con 0x7fd26c09d6f0 2023-10-01T07:57:57.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.925+0000 7fd2713d4700 1 -- 172.21.15.26:0/1133022884 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd26c071700 con 0x7fd26c09d6f0 2023-10-01T07:57:57.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.925+0000 7fd2537fe700 1 -- 172.21.15.26:0/1133022884 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd25c040bc0 con 0x7fd26c09d6f0 2023-10-01T07:57:57.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.930+0000 7fd2537fe700 1 -- 172.21.15.26:0/1133022884 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd25c017020 con 0x7fd26c09d6f0 2023-10-01T07:57:57.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.991+0000 7f1ed519e700 1 Processor -- start 2023-10-01T07:57:57.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.991+0000 7f1ed519e700 1 -- start start 2023-10-01T07:57:57.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.992+0000 7f1ed519e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1ed00a0a30 0x7f1ed00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:57.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.992+0000 7f1ed519e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ed0134170 0x7f1ed013bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:57.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.992+0000 7f1ed519e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed009edd0 con 0x7f1ed00a1340 2023-10-01T07:57:57.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.992+0000 7f1ed519e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ed009e1f0 con 0x7f1ed00a0a30 2023-10-01T07:57:57.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.992+0000 7f1ed519e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed009dc50 con 0x7f1ed0134170 2023-10-01T07:57:57.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.992+0000 7f1ece59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1ed00a1340 0x7f1ed0133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39836/0 (socket says 172.21.15.26:39836) 2023-10-01T07:57:57.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.992+0000 7f1ece59c700 1 -- 172.21.15.26:0/2155865304 learned_addr learned my addr 172.21.15.26:0/2155865304 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:57.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.992+0000 7f1ecf59e700 1 --2- 172.21.15.26:0/2155865304 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ed0134170 0x7f1ed013bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:57.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.992+0000 7f1eced9d700 1 --2- 172.21.15.26:0/2155865304 >> v2:172.21.15.26:3300/0 conn(0x7f1ed00a0a30 0x7f1ed00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:57.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.993+0000 7f1ecf59e700 1 -- 172.21.15.26:0/2155865304 >> v2:172.21.15.26:3300/0 conn(0x7f1ed00a0a30 msgr2=0x7f1ed00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:57.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.993+0000 7f1ecf59e700 1 --2- 172.21.15.26:0/2155865304 >> v2:172.21.15.26:3300/0 conn(0x7f1ed00a0a30 0x7f1ed00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:57.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.993+0000 7f1ecf59e700 1 -- 172.21.15.26:0/2155865304 >> v1:172.21.15.26:6789/0 conn(0x7f1ed00a1340 legacy=0x7f1ed0133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:57.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.993+0000 7f1ecf59e700 1 -- 172.21.15.26:0/2155865304 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed00a1fe0 con 0x7f1ed0134170 2023-10-01T07:57:57.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.993+0000 7f1ecf59e700 1 --2- 172.21.15.26:0/2155865304 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ed0134170 0x7f1ed013bd30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8009d90 tx=0x7f1ec800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73302fa2f44fec84 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:57.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.993+0000 7f1ecdd9b700 1 -- 172.21.15.26:0/2155865304 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec800e070 con 0x7f1ed0134170 2023-10-01T07:57:57.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.993+0000 7f1ecdd9b700 1 -- 172.21.15.26:0/2155865304 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec800bb20 con 0x7f1ed0134170 2023-10-01T07:57:57.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.993+0000 7f1ecdd9b700 1 -- 172.21.15.26:0/2155865304 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec8012430 con 0x7f1ed0134170 2023-10-01T07:57:57.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.994+0000 7f1ed519e700 1 -- 172.21.15.26:0/2155865304 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ed0134170 msgr2=0x7f1ed013bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:57.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.994+0000 7f1ed519e700 1 --2- 172.21.15.26:0/2155865304 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ed0134170 0x7f1ed013bd30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8009d90 tx=0x7f1ec800b330 comp rx=0 tx=0).stop 2023-10-01T07:57:57.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.994+0000 7f1ed519e700 1 -- 172.21.15.26:0/2155865304 shutdown_connections 2023-10-01T07:57:57.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.994+0000 7f1ed519e700 1 --2- 172.21.15.26:0/2155865304 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ed0134170 0x7f1ed013bd30 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:57.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.994+0000 7f1ed519e700 1 --2- 172.21.15.26:0/2155865304 >> v2:172.21.15.26:3300/0 conn(0x7f1ed00a0a30 0x7f1ed00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:57.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.994+0000 7f1ed519e700 1 -- 172.21.15.26:0/2155865304 >> 172.21.15.26:0/2155865304 conn(0x7f1ed00a6550 msgr2=0x7f1ed00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:57.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.994+0000 7f1ed519e700 1 -- 172.21.15.26:0/2155865304 shutdown_connections 2023-10-01T07:57:57.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.994+0000 7f1ed519e700 1 -- 172.21.15.26:0/2155865304 wait complete. 2023-10-01T07:57:57.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.996+0000 7f1ed519e700 1 Processor -- start 2023-10-01T07:57:57.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.996+0000 7f1ed519e700 1 -- start start 2023-10-01T07:57:57.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.997+0000 7f1ed519e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ed00a0a30 0x7f1ed01c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:57.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.997+0000 7f1ed519e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ed00a1340 0x7f1ed01c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:57.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.997+0000 7f1ed519e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ed0134170 0x7f1ed01c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:57.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.997+0000 7f1ed519e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed0124830 con 0x7f1ed0134170 2023-10-01T07:57:57.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.997+0000 7f1ed519e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed0124640 con 0x7f1ed00a0a30 2023-10-01T07:57:57.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.997+0000 7f1ed519e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed0126550 con 0x7f1ed00a1340 2023-10-01T07:57:57.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.997+0000 7f1ece59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ed00a1340 0x7f1ed01c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:57.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.997+0000 7f1ece59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ed00a1340 0x7f1ed01c8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:54112/0 (socket says 172.21.15.26:54112) 2023-10-01T07:57:57.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.997+0000 7f1ece59c700 1 -- 172.21.15.26:0/2896474410 learned_addr learned my addr 172.21.15.26:0/2896474410 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:57.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.997+0000 7f1ecf59e700 1 --2- 172.21.15.26:0/2896474410 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ed0134170 0x7f1ed01c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:57.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.997+0000 7f1ece59c700 1 -- 172.21.15.26:0/2896474410 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ed00a0a30 msgr2=0x7f1ed01c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:57.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.997+0000 7f1ece59c700 1 --2- 172.21.15.26:0/2896474410 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ed00a0a30 0x7f1ed01c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:57.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.997+0000 7f1ece59c700 1 -- 172.21.15.26:0/2896474410 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ed0134170 msgr2=0x7f1ed01c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:57.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.997+0000 7f1ece59c700 1 --2- 172.21.15.26:0/2896474410 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ed0134170 0x7f1ed01c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:57.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.997+0000 7f1ece59c700 1 -- 172.21.15.26:0/2896474410 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec8009a70 con 0x7f1ed00a1340 2023-10-01T07:57:58.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.998+0000 7f1ece59c700 1 --2- 172.21.15.26:0/2896474410 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ed00a1340 0x7f1ed01c8a20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1ec400c520 tx=0x7f1ec400c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:58.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.998+0000 7f1eb77fe700 1 -- 172.21.15.26:0/2896474410 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec4005d70 con 0x7f1ed00a1340 2023-10-01T07:57:58.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.998+0000 7f1eb77fe700 1 -- 172.21.15.26:0/2896474410 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec40070d0 con 0x7f1ed00a1340 2023-10-01T07:57:58.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.998+0000 7f1ed519e700 1 -- 172.21.15.26:0/2896474410 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ed00a25e0 con 0x7f1ed00a1340 2023-10-01T07:57:58.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.998+0000 7f1eb77fe700 1 -- 172.21.15.26:0/2896474410 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec4007440 con 0x7f1ed00a1340 2023-10-01T07:57:58.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.998+0000 7f1ed519e700 1 -- 172.21.15.26:0/2896474410 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed0133750 con 0x7f1ed00a1340 2023-10-01T07:57:58.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.999+0000 7f1ed519e700 1 -- 172.21.15.26:0/2896474410 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ed00a1a40 con 0x7f1ed00a1340 2023-10-01T07:57:58.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.999+0000 7f1eb77fe700 1 -- 172.21.15.26:0/2896474410 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1ec40075a0 con 0x7f1ed00a1340 2023-10-01T07:57:58.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:57.999+0000 7f1eb77fe700 1 -- 172.21.15.26:0/2896474410 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1ec403eb40 con 0x7f1ed00a1340 2023-10-01T07:57:58.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.009+0000 7f1eb77fe700 1 -- 172.21.15.26:0/2896474410 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1ec4019d20 con 0x7f1ed00a1340 2023-10-01T07:57:58.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.038+0000 7f66cb34c700 1 -- 172.21.15.26:0/3039521968 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f66a4005590 con 0x7f66c409e560 2023-10-01T07:57:58.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.038+0000 7f66b9ffb700 1 -- 172.21.15.26:0/3039521968 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f66c0021020 con 0x7f66c409e560 2023-10-01T07:57:58.039 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:58.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.040+0000 7f66cb34c700 1 -- 172.21.15.26:0/3039521968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66c409e560 msgr2=0x7f66c411c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:58.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.040+0000 7f66cb34c700 1 --2- 172.21.15.26:0/3039521968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66c409e560 0x7f66c411c960 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f66c000e8e0 tx=0x7f66c000ebf0 comp rx=0 tx=0).stop 2023-10-01T07:57:58.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.040+0000 7f66cb34c700 1 -- 172.21.15.26:0/3039521968 shutdown_connections 2023-10-01T07:57:58.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.040+0000 7f66cb34c700 1 --2- 172.21.15.26:0/3039521968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f66c41341d0 0x7f66c411d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:58.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.040+0000 7f66cb34c700 1 --2- 172.21.15.26:0/3039521968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66c409e560 0x7f66c411c960 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:58.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.040+0000 7f66cb34c700 1 --2- 172.21.15.26:0/3039521968 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f66c41338c0 0x7f66c411cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:58.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.041+0000 7f66cb34c700 1 -- 172.21.15.26:0/3039521968 >> 172.21.15.26:0/3039521968 conn(0x7f66c40a2aa0 msgr2=0x7f66c409f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:58.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.041+0000 7f66cb34c700 1 -- 172.21.15.26:0/3039521968 shutdown_connections 2023-10-01T07:57:58.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.041+0000 7f66cb34c700 1 -- 172.21.15.26:0/3039521968 wait complete. 2023-10-01T07:57:58.060 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:58.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.137+0000 7f60d07a6700 1 -- 172.21.15.26:0/438251792 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f60c8074ea0 con 0x7f60c809d6f0 2023-10-01T07:57:58.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.137+0000 7f60beffd700 1 -- 172.21.15.26:0/438251792 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f60c4022910 con 0x7f60c809d6f0 2023-10-01T07:57:58.138 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:58.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.140+0000 7f60d07a6700 1 -- 172.21.15.26:0/438251792 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60c809d6f0 msgr2=0x7f60c811de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:58.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.140+0000 7f60d07a6700 1 --2- 172.21.15.26:0/438251792 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60c809d6f0 0x7f60c811de90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f60c4009b90 tx=0x7f60c4004750 comp rx=0 tx=0).stop 2023-10-01T07:57:58.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.140+0000 7f60d07a6700 1 -- 172.21.15.26:0/438251792 shutdown_connections 2023-10-01T07:57:58.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.140+0000 7f60d07a6700 1 --2- 172.21.15.26:0/438251792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60c809e410 0x7f60c811e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:58.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.140+0000 7f60d07a6700 1 --2- 172.21.15.26:0/438251792 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60c809d6f0 0x7f60c811de90 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:58.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.140+0000 7f60d07a6700 1 --2- 172.21.15.26:0/438251792 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f60c809e000 0x7f60c811e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:58.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.140+0000 7f60d07a6700 1 -- 172.21.15.26:0/438251792 >> 172.21.15.26:0/438251792 conn(0x7f60c8066f50 msgr2=0x7f60c8130b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:58.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.140+0000 7f60d07a6700 1 -- 172.21.15.26:0/438251792 shutdown_connections 2023-10-01T07:57:58.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.140+0000 7f60d07a6700 1 -- 172.21.15.26:0/438251792 wait complete. 2023-10-01T07:57:58.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.142+0000 7fd2713d4700 1 -- 172.21.15.26:0/1133022884 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd26c074ea0 con 0x7fd26c09d6f0 2023-10-01T07:57:58.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.143+0000 7fd2537fe700 1 -- 172.21.15.26:0/1133022884 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd25c044060 con 0x7fd26c09d6f0 2023-10-01T07:57:58.143 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:58.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.145+0000 7fd2713d4700 1 -- 172.21.15.26:0/1133022884 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd26c09d6f0 msgr2=0x7fd26c132a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:58.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.145+0000 7fd2713d4700 1 --2- 172.21.15.26:0/1133022884 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd26c09d6f0 0x7fd26c132a00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd25c00c480 tx=0x7fd25c00c790 comp rx=0 tx=0).stop 2023-10-01T07:57:58.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.145+0000 7fd2713d4700 1 -- 172.21.15.26:0/1133022884 shutdown_connections 2023-10-01T07:57:58.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.145+0000 7fd2713d4700 1 --2- 172.21.15.26:0/1133022884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd26c135e50 0x7fd26c133480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:58.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.145+0000 7fd2713d4700 1 --2- 172.21.15.26:0/1133022884 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd26c09d6f0 0x7fd26c132a00 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:58.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.145+0000 7fd2713d4700 1 --2- 172.21.15.26:0/1133022884 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd26c09e1d0 0x7fd26c132f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:58.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.145+0000 7fd2713d4700 1 -- 172.21.15.26:0/1133022884 >> 172.21.15.26:0/1133022884 conn(0x7fd26c066f50 msgr2=0x7fd26c06e840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:58.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.146+0000 7fd2713d4700 1 -- 172.21.15.26:0/1133022884 shutdown_connections 2023-10-01T07:57:58.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.146+0000 7fd2713d4700 1 -- 172.21.15.26:0/1133022884 wait complete. 2023-10-01T07:57:58.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:58.160 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:58.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.217+0000 7f1ed519e700 1 -- 172.21.15.26:0/2896474410 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1ed0074ea0 con 0x7f1ed00a1340 2023-10-01T07:57:58.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.218+0000 7f1eb77fe700 1 -- 172.21.15.26:0/2896474410 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1ec4017030 con 0x7f1ed00a1340 2023-10-01T07:57:58.218 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:58.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.220+0000 7f1ed519e700 1 -- 172.21.15.26:0/2896474410 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ed00a1340 msgr2=0x7f1ed01c8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:58.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.220+0000 7f1ed519e700 1 --2- 172.21.15.26:0/2896474410 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ed00a1340 0x7f1ed01c8a20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1ec400c520 tx=0x7f1ec400c830 comp rx=0 tx=0).stop 2023-10-01T07:57:58.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.220+0000 7f1ed519e700 1 -- 172.21.15.26:0/2896474410 shutdown_connections 2023-10-01T07:57:58.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.220+0000 7f1ed519e700 1 --2- 172.21.15.26:0/2896474410 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ed0134170 0x7f1ed01c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:58.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.220+0000 7f1ed519e700 1 --2- 172.21.15.26:0/2896474410 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ed00a0a30 0x7f1ed01c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:58.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.220+0000 7f1ed519e700 1 --2- 172.21.15.26:0/2896474410 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ed00a1340 0x7f1ed01c8a20 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:58.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.220+0000 7f1ed519e700 1 -- 172.21.15.26:0/2896474410 >> 172.21.15.26:0/2896474410 conn(0x7f1ed00a6550 msgr2=0x7f1ed009ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:58.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.220+0000 7f1ed519e700 1 -- 172.21.15.26:0/2896474410 shutdown_connections 2023-10-01T07:57:58.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:58.220+0000 7f1ed519e700 1 -- 172.21.15.26:0/2896474410 wait complete. 2023-10-01T07:57:58.234 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:57:59.061 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:57:59.156 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:57:59.161 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:57:59.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.209+0000 7f4da448d700 1 Processor -- start 2023-10-01T07:57:59.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.209+0000 7f4da448d700 1 -- start start 2023-10-01T07:57:59.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.210+0000 7f4da448d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4d9c09d6f0 0x7f4d9c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:59.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.210+0000 7f4da448d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4d9c09e000 0x7f4d9c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:59.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.210+0000 7f4da448d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d9c09e410 0x7f4d9c133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:59.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.210+0000 7f4da448d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d9c06b460 con 0x7f4d9c09d6f0 2023-10-01T07:57:59.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.210+0000 7f4da448d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9c09b120 con 0x7f4d9c09e410 2023-10-01T07:57:59.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.210+0000 7f4da448d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9c09a7e0 con 0x7f4d9c09e000 2023-10-01T07:57:59.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.211+0000 7f4da2a2a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d9c09e410 0x7f4d9c133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:59.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.211+0000 7f4da2a2a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d9c09e410 0x7f4d9c133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58758/0 (socket says 172.21.15.26:58758) 2023-10-01T07:57:59.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.211+0000 7f4da2a2a700 1 -- 172.21.15.26:0/4128900779 learned_addr learned my addr 172.21.15.26:0/4128900779 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:59.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.211+0000 7f4da2229700 1 --2- 172.21.15.26:0/4128900779 >> v2:172.21.15.26:3300/0 conn(0x7f4d9c09d6f0 0x7f4d9c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:59.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.211+0000 7f4da1a28700 1 --2- 172.21.15.26:0/4128900779 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4d9c09e000 0x7f4d9c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:59.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.211+0000 7f4da2a2a700 1 -- 172.21.15.26:0/4128900779 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4d9c09e000 msgr2=0x7f4d9c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:59.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.211+0000 7f4da2a2a700 1 --2- 172.21.15.26:0/4128900779 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4d9c09e000 0x7f4d9c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:59.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.211+0000 7f4da2a2a700 1 -- 172.21.15.26:0/4128900779 >> v2:172.21.15.26:3300/0 conn(0x7f4d9c09d6f0 msgr2=0x7f4d9c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:59.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.211+0000 7f4da2a2a700 1 --2- 172.21.15.26:0/4128900779 >> v2:172.21.15.26:3300/0 conn(0x7f4d9c09d6f0 0x7f4d9c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:59.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.211+0000 7f4da2a2a700 1 -- 172.21.15.26:0/4128900779 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d9c09a500 con 0x7f4d9c09e410 2023-10-01T07:57:59.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.211+0000 7f4da1a28700 1 --2- 172.21.15.26:0/4128900779 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4d9c09e000 0x7f4d9c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:57:59.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.211+0000 7f4da2a2a700 1 --2- 172.21.15.26:0/4128900779 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d9c09e410 0x7f4d9c133f30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4d94009e80 tx=0x7f4d9400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=955ae39aaec0808d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:59.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.212+0000 7f4da1227700 1 -- 172.21.15.26:0/4128900779 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9400e070 con 0x7f4d9c09e410 2023-10-01T07:57:59.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.212+0000 7f4da1227700 1 -- 172.21.15.26:0/4128900779 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9400b8d0 con 0x7f4d9c09e410 2023-10-01T07:57:59.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.212+0000 7f4da1227700 1 -- 172.21.15.26:0/4128900779 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9400bc80 con 0x7f4d9c09e410 2023-10-01T07:57:59.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.212+0000 7f4da448d700 1 -- 172.21.15.26:0/4128900779 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d9c09e410 msgr2=0x7f4d9c133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:59.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.212+0000 7f4da448d700 1 --2- 172.21.15.26:0/4128900779 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d9c09e410 0x7f4d9c133f30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4d94009e80 tx=0x7f4d9400b330 comp rx=0 tx=0).stop 2023-10-01T07:57:59.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.213+0000 7f4da448d700 1 -- 172.21.15.26:0/4128900779 shutdown_connections 2023-10-01T07:57:59.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.213+0000 7f4da448d700 1 --2- 172.21.15.26:0/4128900779 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d9c09e410 0x7f4d9c133f30 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:59.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.213+0000 7f4da448d700 1 --2- 172.21.15.26:0/4128900779 >> v2:172.21.15.26:3300/0 conn(0x7f4d9c09d6f0 0x7f4d9c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:59.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.213+0000 7f4da448d700 1 --2- 172.21.15.26:0/4128900779 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4d9c09e000 0x7f4d9c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:59.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.213+0000 7f4da448d700 1 -- 172.21.15.26:0/4128900779 >> 172.21.15.26:0/4128900779 conn(0x7f4d9c066f50 msgr2=0x7f4d9c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:59.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.213+0000 7f4da448d700 1 -- 172.21.15.26:0/4128900779 shutdown_connections 2023-10-01T07:57:59.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.213+0000 7f4da448d700 1 -- 172.21.15.26:0/4128900779 wait complete. 2023-10-01T07:57:59.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.214+0000 7f4da448d700 1 Processor -- start 2023-10-01T07:57:59.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.214+0000 7f4da448d700 1 -- start start 2023-10-01T07:57:59.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.215+0000 7f4da448d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d9c09d6f0 0x7f4d9c1c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:59.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.215+0000 7f4da448d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d9c09e000 0x7f4d9c1c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:59.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.215+0000 7f4da448d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4d9c09e410 0x7f4d9c1c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:59.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.215+0000 7f4da448d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9c1a6580 con 0x7f4d9c09e000 2023-10-01T07:57:59.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.215+0000 7f4da448d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9c1a6350 con 0x7f4d9c09d6f0 2023-10-01T07:57:59.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.215+0000 7f4da448d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9c1a6fc0 con 0x7f4d9c09e410 2023-10-01T07:57:59.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.215+0000 7f4da1a28700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d9c09e000 0x7f4d9c1c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:59.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.215+0000 7f4da1a28700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d9c09e000 0x7f4d9c1c84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47992/0 (socket says 172.21.15.26:47992) 2023-10-01T07:57:59.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.215+0000 7f4da1a28700 1 -- 172.21.15.26:0/2348356797 learned_addr learned my addr 172.21.15.26:0/2348356797 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:59.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.215+0000 7f4da2229700 1 --2- 172.21.15.26:0/2348356797 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d9c09d6f0 0x7f4d9c1c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:59.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.215+0000 7f4da2a2a700 1 --2- 172.21.15.26:0/2348356797 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4d9c09e410 0x7f4d9c1c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:59.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.216+0000 7f4da1a28700 1 -- 172.21.15.26:0/2348356797 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4d9c09e410 msgr2=0x7f4d9c1c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:59.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.216+0000 7f4da1a28700 1 --2- 172.21.15.26:0/2348356797 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4d9c09e410 0x7f4d9c1c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:59.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.216+0000 7f4da1a28700 1 -- 172.21.15.26:0/2348356797 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d9c09d6f0 msgr2=0x7f4d9c1c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:59.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.216+0000 7f4da1a28700 1 --2- 172.21.15.26:0/2348356797 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d9c09d6f0 0x7f4d9c1c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:59.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.216+0000 7f4da1a28700 1 -- 172.21.15.26:0/2348356797 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d94009b30 con 0x7f4d9c09e000 2023-10-01T07:57:59.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.216+0000 7f4da2a2a700 1 --2- 172.21.15.26:0/2348356797 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4d9c09e410 0x7f4d9c1c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:59.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.216+0000 7f4da1a28700 1 --2- 172.21.15.26:0/2348356797 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d9c09e000 0x7f4d9c1c84f0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c00e840 tx=0x7f4d8c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:59.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.216+0000 7f4d92ffd700 1 -- 172.21.15.26:0/2348356797 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c013610 con 0x7f4d9c09e000 2023-10-01T07:57:59.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.216+0000 7f4da448d700 1 -- 172.21.15.26:0/2348356797 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d9c1a7cc0 con 0x7f4d9c09e000 2023-10-01T07:57:59.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.216+0000 7f4d92ffd700 1 -- 172.21.15.26:0/2348356797 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8c013770 con 0x7f4d9c09e000 2023-10-01T07:57:59.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.216+0000 7f4d92ffd700 1 -- 172.21.15.26:0/2348356797 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c013b20 con 0x7f4d9c09e000 2023-10-01T07:57:59.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.216+0000 7f4da448d700 1 -- 172.21.15.26:0/2348356797 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d9c1a82d0 con 0x7f4d9c09e000 2023-10-01T07:57:59.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.217+0000 7f4da448d700 1 -- 172.21.15.26:0/2348356797 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d9c1a7ee0 con 0x7f4d9c09e000 2023-10-01T07:57:59.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.218+0000 7f4d92ffd700 1 -- 172.21.15.26:0/2348356797 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4d8c013c80 con 0x7f4d9c09e000 2023-10-01T07:57:59.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.218+0000 7f4d92ffd700 1 -- 172.21.15.26:0/2348356797 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4d8c03f340 con 0x7f4d9c09e000 2023-10-01T07:57:59.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.223+0000 7f4d92ffd700 1 -- 172.21.15.26:0/2348356797 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4d8c012370 con 0x7f4d9c09e000 2023-10-01T07:57:59.235 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:57:59.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.304+0000 7f93a5d55700 1 Processor -- start 2023-10-01T07:57:59.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.305+0000 7f93a5d55700 1 -- start start 2023-10-01T07:57:59.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.305+0000 7f93a5d55700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f93a006e570 0x7f93a006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:59.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.305+0000 7f93a5d55700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f93a006ee80 0x7f93a0134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:59.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.305+0000 7f93a5d55700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a0070ee0 con 0x7f93a009eca0 2023-10-01T07:57:59.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.305+0000 7f93a5d55700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a0071480 con 0x7f93a006e570 2023-10-01T07:57:59.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.305+0000 7f93a5d55700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93a0071b90 con 0x7f93a006ee80 2023-10-01T07:57:59.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.305+0000 7f939ffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f93a006ee80 0x7f93a0134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:59.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.305+0000 7f939ffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f93a006ee80 0x7f93a0134d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:54130/0 (socket says 172.21.15.26:54130) 2023-10-01T07:57:59.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.305+0000 7f939ffff700 1 -- 172.21.15.26:0/2264591411 learned_addr learned my addr 172.21.15.26:0/2264591411 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:59.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.306+0000 7f939f7fe700 1 --2- 172.21.15.26:0/2264591411 >> v2:172.21.15.26:3300/0 conn(0x7f93a006e570 0x7f93a006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:59.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.306+0000 7f939e7fc700 1 -- 172.21.15.26:0/2264591411 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 972487970 0 0) 0x7f93a0070ee0 con 0x7f93a009eca0 2023-10-01T07:57:59.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.306+0000 7f939e7fc700 1 -- 172.21.15.26:0/2264591411 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93880035b0 con 0x7f93a009eca0 2023-10-01T07:57:59.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.306+0000 7f939ffff700 1 -- 172.21.15.26:0/2264591411 >> v2:172.21.15.26:3300/0 conn(0x7f93a006e570 msgr2=0x7f93a006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:59.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.306+0000 7f939ffff700 1 --2- 172.21.15.26:0/2264591411 >> v2:172.21.15.26:3300/0 conn(0x7f93a006e570 0x7f93a006e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:59.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.306+0000 7f939ffff700 1 -- 172.21.15.26:0/2264591411 >> v1:172.21.15.26:6789/0 conn(0x7f93a009eca0 legacy=0x7f93a0134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:59.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.306+0000 7f939ffff700 1 -- 172.21.15.26:0/2264591411 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a00711a0 con 0x7f93a006ee80 2023-10-01T07:57:59.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.306+0000 7f939ffff700 1 --2- 172.21.15.26:0/2264591411 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f93a006ee80 0x7f93a0134d20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9398009e50 tx=0x7f939800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab73e2095c2cf04e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:59.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.306+0000 7f939e7fc700 1 -- 172.21.15.26:0/2264591411 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939800e070 con 0x7f93a006ee80 2023-10-01T07:57:59.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.306+0000 7f939e7fc700 1 -- 172.21.15.26:0/2264591411 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939800b910 con 0x7f93a006ee80 2023-10-01T07:57:59.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.306+0000 7f939e7fc700 1 -- 172.21.15.26:0/2264591411 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939800bcc0 con 0x7f93a006ee80 2023-10-01T07:57:59.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.308+0000 7f93a5d55700 1 -- 172.21.15.26:0/2264591411 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f93a006ee80 msgr2=0x7f93a0134d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:59.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.308+0000 7f93a5d55700 1 --2- 172.21.15.26:0/2264591411 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f93a006ee80 0x7f93a0134d20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9398009e50 tx=0x7f939800b330 comp rx=0 tx=0).stop 2023-10-01T07:57:59.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.308+0000 7f93a5d55700 1 -- 172.21.15.26:0/2264591411 shutdown_connections 2023-10-01T07:57:59.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.308+0000 7f93a5d55700 1 --2- 172.21.15.26:0/2264591411 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f93a006ee80 0x7f93a0134d20 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:59.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.308+0000 7f93a5d55700 1 --2- 172.21.15.26:0/2264591411 >> v2:172.21.15.26:3300/0 conn(0x7f93a006e570 0x7f93a006e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:59.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.308+0000 7f93a5d55700 1 -- 172.21.15.26:0/2264591411 >> 172.21.15.26:0/2264591411 conn(0x7f93a00a2aa0 msgr2=0x7f93a00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:59.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.308+0000 7f93a5d55700 1 -- 172.21.15.26:0/2264591411 shutdown_connections 2023-10-01T07:57:59.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.308+0000 7f93a5d55700 1 -- 172.21.15.26:0/2264591411 wait complete. 2023-10-01T07:57:59.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.309+0000 7f93a5d55700 1 Processor -- start 2023-10-01T07:57:59.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.309+0000 7f93a5d55700 1 -- start start 2023-10-01T07:57:59.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.310+0000 7f93a5d55700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93a006e570 0x7f93a0127480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:59.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.310+0000 7f93a5d55700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f93a006ee80 0x7f93a0125f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:59.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.310+0000 7f93a5d55700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f93a01279c0 0x7f93a0126450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:59.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.310+0000 7f93a5d55700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a013e310 con 0x7f93a006e570 2023-10-01T07:57:59.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.310+0000 7f93a5d55700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a013c180 con 0x7f93a006ee80 2023-10-01T07:57:59.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.310+0000 7f93a5d55700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93a013e4f0 con 0x7f93a01279c0 2023-10-01T07:57:59.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.310+0000 7f939ffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f93a01279c0 0x7f93a0126450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:59.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.310+0000 7f939f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93a006e570 0x7f93a0127480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:59.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.310+0000 7f939ffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f93a01279c0 0x7f93a0126450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:54142/0 (socket says 172.21.15.26:54142) 2023-10-01T07:57:59.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.310+0000 7f939ffff700 1 -- 172.21.15.26:0/2657616829 learned_addr learned my addr 172.21.15.26:0/2657616829 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:59.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.310+0000 7f939effd700 1 --2- 172.21.15.26:0/2657616829 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f93a006ee80 0x7f93a0125f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:59.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.311+0000 7f939effd700 1 -- 172.21.15.26:0/2657616829 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f93a01279c0 msgr2=0x7f93a0126450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:59.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.311+0000 7f939effd700 1 --2- 172.21.15.26:0/2657616829 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f93a01279c0 0x7f93a0126450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:59.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.311+0000 7f939effd700 1 -- 172.21.15.26:0/2657616829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93a006e570 msgr2=0x7f93a0127480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:59.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.311+0000 7f939effd700 1 --2- 172.21.15.26:0/2657616829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93a006e570 0x7f93a0127480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:59.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.311+0000 7f939effd700 1 -- 172.21.15.26:0/2657616829 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9398009b30 con 0x7f93a006ee80 2023-10-01T07:57:59.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.311+0000 7f939effd700 1 --2- 172.21.15.26:0/2657616829 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f93a006ee80 0x7f93a0125f10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f93a00a35d0 tx=0x7f939400c700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:59.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.311+0000 7f9387fff700 1 -- 172.21.15.26:0/2657616829 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93940050d0 con 0x7f93a006ee80 2023-10-01T07:57:59.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.311+0000 7f9387fff700 1 -- 172.21.15.26:0/2657616829 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9394005230 con 0x7f93a006ee80 2023-10-01T07:57:59.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.311+0000 7f9387fff700 1 -- 172.21.15.26:0/2657616829 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9394003680 con 0x7f93a006ee80 2023-10-01T07:57:59.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.311+0000 7f93a5d55700 1 -- 172.21.15.26:0/2657616829 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a013ce70 con 0x7f93a006ee80 2023-10-01T07:57:59.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.312+0000 7f93a5d55700 1 -- 172.21.15.26:0/2657616829 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a0070610 con 0x7f93a006ee80 2023-10-01T07:57:59.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.312+0000 7f93a5d55700 1 -- 172.21.15.26:0/2657616829 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93a0074ea0 con 0x7f93a006ee80 2023-10-01T07:57:59.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.313+0000 7f9387fff700 1 -- 172.21.15.26:0/2657616829 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f93940037e0 con 0x7f93a006ee80 2023-10-01T07:57:59.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.314+0000 7f9387fff700 1 -- 172.21.15.26:0/2657616829 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f939403eef0 con 0x7f93a006ee80 2023-10-01T07:57:59.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.318+0000 7f9387fff700 1 -- 172.21.15.26:0/2657616829 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9394011590 con 0x7f93a006ee80 2023-10-01T07:57:59.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.347+0000 7f4b64efd700 1 Processor -- start 2023-10-01T07:57:59.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.347+0000 7f4b64efd700 1 -- start start 2023-10-01T07:57:59.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.348+0000 7f4b64efd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4b6009d6f0 0x7f4b6009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:59.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.348+0000 7f4b64efd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4b6009e000 0x7f4b60130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:59.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.348+0000 7f4b64efd700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b6009f130 con 0x7f4b6009e410 2023-10-01T07:57:59.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.349+0000 7f4b64efd700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b6009f520 con 0x7f4b6009e000 2023-10-01T07:57:59.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.349+0000 7f4b64efd700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6009e930 con 0x7f4b6009d6f0 2023-10-01T07:57:59.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.349+0000 7f4b5ed9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4b6009e410 0x7f4b60130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39856/0 (socket says 172.21.15.26:39856) 2023-10-01T07:57:59.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.349+0000 7f4b5ed9d700 1 -- 172.21.15.26:0/4160377975 learned_addr learned my addr 172.21.15.26:0/4160377975 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:59.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.349+0000 7f4b5e59c700 1 --2- 172.21.15.26:0/4160377975 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4b6009d6f0 0x7f4b6009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:59.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.349+0000 7f4b5dd9b700 1 --2- 172.21.15.26:0/4160377975 >> v2:172.21.15.26:3300/0 conn(0x7f4b6009e000 0x7f4b60130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:59.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.349+0000 7f4b5d59a700 1 -- 172.21.15.26:0/4160377975 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 181905243 0 0) 0x7f4b6009f130 con 0x7f4b6009e410 2023-10-01T07:57:59.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.349+0000 7f4b5e59c700 1 -- 172.21.15.26:0/4160377975 >> v2:172.21.15.26:3300/0 conn(0x7f4b6009e000 msgr2=0x7f4b60130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:59.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.349+0000 7f4b5e59c700 1 --2- 172.21.15.26:0/4160377975 >> v2:172.21.15.26:3300/0 conn(0x7f4b6009e000 0x7f4b60130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:59.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.349+0000 7f4b5e59c700 1 -- 172.21.15.26:0/4160377975 >> v1:172.21.15.26:6789/0 conn(0x7f4b6009e410 legacy=0x7f4b60130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:59.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.349+0000 7f4b5e59c700 1 -- 172.21.15.26:0/4160377975 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6009b2d0 con 0x7f4b6009d6f0 2023-10-01T07:57:59.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.350+0000 7f4b5e59c700 1 --2- 172.21.15.26:0/4160377975 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4b6009d6f0 0x7f4b6009dac0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4b50009840 tx=0x7f4b50009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcfa2d4f65843aa3 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:59.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.350+0000 7f4b5d59a700 1 -- 172.21.15.26:0/4160377975 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b50011830 con 0x7f4b6009d6f0 2023-10-01T07:57:59.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.350+0000 7f4b5d59a700 1 -- 172.21.15.26:0/4160377975 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b50011990 con 0x7f4b6009d6f0 2023-10-01T07:57:59.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.350+0000 7f4b5d59a700 1 -- 172.21.15.26:0/4160377975 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b50011d20 con 0x7f4b6009d6f0 2023-10-01T07:57:59.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.350+0000 7f4b64efd700 1 -- 172.21.15.26:0/4160377975 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4b6009d6f0 msgr2=0x7f4b6009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:59.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.350+0000 7f4b64efd700 1 --2- 172.21.15.26:0/4160377975 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4b6009d6f0 0x7f4b6009dac0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4b50009840 tx=0x7f4b50009b50 comp rx=0 tx=0).stop 2023-10-01T07:57:59.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.351+0000 7f4b64efd700 1 -- 172.21.15.26:0/4160377975 shutdown_connections 2023-10-01T07:57:59.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.351+0000 7f4b64efd700 1 --2- 172.21.15.26:0/4160377975 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4b6009d6f0 0x7f4b6009dac0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:59.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.351+0000 7f4b64efd700 1 --2- 172.21.15.26:0/4160377975 >> v2:172.21.15.26:3300/0 conn(0x7f4b6009e000 0x7f4b60130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:59.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.351+0000 7f4b64efd700 1 -- 172.21.15.26:0/4160377975 >> 172.21.15.26:0/4160377975 conn(0x7f4b60066f50 msgr2=0x7f4b6009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:59.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.351+0000 7f4b64efd700 1 -- 172.21.15.26:0/4160377975 shutdown_connections 2023-10-01T07:57:59.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.351+0000 7f4b64efd700 1 -- 172.21.15.26:0/4160377975 wait complete. 2023-10-01T07:57:59.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.352+0000 7f4b64efd700 1 Processor -- start 2023-10-01T07:57:59.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.352+0000 7f4b64efd700 1 -- start start 2023-10-01T07:57:59.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.352+0000 7f4b64efd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b6009d6f0 0x7f4b60139940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:59.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.352+0000 7f4b64efd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b6009e000 0x7f4b60139e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:59.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.352+0000 7f4b64efd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4b6009e410 0x7f4b6013a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:59.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.352+0000 7f4b64efd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b60137400 con 0x7f4b6009e000 2023-10-01T07:57:59.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.352+0000 7f4b64efd700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b60136a40 con 0x7f4b6009e410 2023-10-01T07:57:59.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.352+0000 7f4b64efd700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6009c700 con 0x7f4b6009d6f0 2023-10-01T07:57:59.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.353+0000 7f4b5dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b6009e000 0x7f4b60139e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:59.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.353+0000 7f4b5dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b6009e000 0x7f4b60139e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48030/0 (socket says 172.21.15.26:48030) 2023-10-01T07:57:59.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.353+0000 7f4b5dd9b700 1 -- 172.21.15.26:0/4217137425 learned_addr learned my addr 172.21.15.26:0/4217137425 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:59.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.353+0000 7f4b5ed9d700 1 --2- 172.21.15.26:0/4217137425 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4b6009e410 0x7f4b6013a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:59.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.353+0000 7f4b5e59c700 1 --2- 172.21.15.26:0/4217137425 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b6009d6f0 0x7f4b60139940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:59.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.353+0000 7f4b5ed9d700 1 -- 172.21.15.26:0/4217137425 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b6009d6f0 msgr2=0x7f4b60139940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:59.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.353+0000 7f4b5ed9d700 1 --2- 172.21.15.26:0/4217137425 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b6009d6f0 0x7f4b60139940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:59.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.353+0000 7f4b5ed9d700 1 -- 172.21.15.26:0/4217137425 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b6009e000 msgr2=0x7f4b60139e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:59.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.353+0000 7f4b5ed9d700 1 --2- 172.21.15.26:0/4217137425 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b6009e000 0x7f4b60139e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:59.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.353+0000 7f4b5ed9d700 1 -- 172.21.15.26:0/4217137425 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b500094a0 con 0x7f4b6009e410 2023-10-01T07:57:59.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.353+0000 7f4b5ed9d700 1 --2- 172.21.15.26:0/4217137425 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4b6009e410 0x7f4b6013a3c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800cc10 tx=0x7f4b5800cf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:59.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.353+0000 7f4b4effd700 1 -- 172.21.15.26:0/4217137425 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b58015e30 con 0x7f4b6009e410 2023-10-01T07:57:59.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.353+0000 7f4b4effd700 1 -- 172.21.15.26:0/4217137425 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5800a4f0 con 0x7f4b6009e410 2023-10-01T07:57:59.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.353+0000 7f4b64efd700 1 -- 172.21.15.26:0/4217137425 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b6013ac00 con 0x7f4b6009e410 2023-10-01T07:57:59.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.354+0000 7f4b4effd700 1 -- 172.21.15.26:0/4217137425 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5800a8a0 con 0x7f4b6009e410 2023-10-01T07:57:59.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.354+0000 7f4b64efd700 1 -- 172.21.15.26:0/4217137425 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b6013b3f0 con 0x7f4b6009e410 2023-10-01T07:57:59.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.355+0000 7f4b4effd700 1 -- 172.21.15.26:0/4217137425 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4b5801b020 con 0x7f4b6009e410 2023-10-01T07:57:59.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.355+0000 7f4b64efd700 1 -- 172.21.15.26:0/4217137425 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b60074ea0 con 0x7f4b6009e410 2023-10-01T07:57:59.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.355+0000 7f4b4effd700 1 -- 172.21.15.26:0/4217137425 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4b58047940 con 0x7f4b6009e410 2023-10-01T07:57:59.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.364+0000 7f4b4effd700 1 -- 172.21.15.26:0/4217137425 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b5801b8c0 con 0x7f4b6009e410 2023-10-01T07:57:59.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.389+0000 7f8d81fcf700 1 Processor -- start 2023-10-01T07:57:59.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.389+0000 7f8d81fcf700 1 -- start start 2023-10-01T07:57:59.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.390+0000 7f8d81fcf700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8d7c133420 0x7f8d7c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:59.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.390+0000 7f8d81fcf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d7c133e30 0x7f8d7c12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:59.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.390+0000 7f8d81fcf700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d7c06b990 con 0x7f8d7c134260 2023-10-01T07:57:59.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.390+0000 7f8d81fcf700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d7c0a0590 con 0x7f8d7c133420 2023-10-01T07:57:59.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.390+0000 7f8d81fcf700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c09fb80 con 0x7f8d7c133e30 2023-10-01T07:57:59.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.390+0000 7f8d7affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d7c133e30 0x7f8d7c12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:59.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.390+0000 7f8d7bfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8d7c134260 0x7f8d7c1304d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39868/0 (socket says 172.21.15.26:39868) 2023-10-01T07:57:59.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.390+0000 7f8d7affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d7c133e30 0x7f8d7c12ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:54168/0 (socket says 172.21.15.26:54168) 2023-10-01T07:57:59.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.390+0000 7f8d7bfff700 1 -- 172.21.15.26:0/3876156060 learned_addr learned my addr 172.21.15.26:0/3876156060 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:57:59.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.390+0000 7f8d7b7fe700 1 --2- 172.21.15.26:0/3876156060 >> v2:172.21.15.26:3300/0 conn(0x7f8d7c133420 0x7f8d7c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:59.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.391+0000 7f8d7b7fe700 1 -- 172.21.15.26:0/3876156060 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d7c133e30 msgr2=0x7f8d7c12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:57:59.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.391+0000 7f8d7b7fe700 1 --2- 172.21.15.26:0/3876156060 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d7c133e30 0x7f8d7c12ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:59.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.391+0000 7f8d7b7fe700 1 -- 172.21.15.26:0/3876156060 >> v1:172.21.15.26:6789/0 conn(0x7f8d7c134260 legacy=0x7f8d7c1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:59.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.391+0000 7f8d7b7fe700 1 -- 172.21.15.26:0/3876156060 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7c0a0030 con 0x7f8d7c133420 2023-10-01T07:57:59.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.391+0000 7f8d7b7fe700 1 --2- 172.21.15.26:0/3876156060 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d7c133420 0x7f8d7c1337f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c009840 tx=0x7f8d6c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be67a9a015c6fa65 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:59.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.391+0000 7f8d7a7fc700 1 -- 172.21.15.26:0/3876156060 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c011830 con 0x7f8d7c133420 2023-10-01T07:57:59.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.391+0000 7f8d7a7fc700 1 -- 172.21.15.26:0/3876156060 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6c011990 con 0x7f8d7c133420 2023-10-01T07:57:59.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.391+0000 7f8d7a7fc700 1 -- 172.21.15.26:0/3876156060 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c011d20 con 0x7f8d7c133420 2023-10-01T07:57:59.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.392+0000 7f8d81fcf700 1 -- 172.21.15.26:0/3876156060 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d7c133420 msgr2=0x7f8d7c1337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:59.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.392+0000 7f8d81fcf700 1 --2- 172.21.15.26:0/3876156060 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d7c133420 0x7f8d7c1337f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c009840 tx=0x7f8d6c009b50 comp rx=0 tx=0).stop 2023-10-01T07:57:59.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.392+0000 7f8d81fcf700 1 -- 172.21.15.26:0/3876156060 shutdown_connections 2023-10-01T07:57:59.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.392+0000 7f8d81fcf700 1 --2- 172.21.15.26:0/3876156060 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d7c133420 0x7f8d7c1337f0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:59.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.392+0000 7f8d81fcf700 1 --2- 172.21.15.26:0/3876156060 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d7c133e30 0x7f8d7c12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:59.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.392+0000 7f8d81fcf700 1 -- 172.21.15.26:0/3876156060 >> 172.21.15.26:0/3876156060 conn(0x7f8d7c0a4210 msgr2=0x7f8d7c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:59.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.392+0000 7f8d81fcf700 1 -- 172.21.15.26:0/3876156060 shutdown_connections 2023-10-01T07:57:59.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.392+0000 7f8d81fcf700 1 -- 172.21.15.26:0/3876156060 wait complete. 2023-10-01T07:57:59.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.394+0000 7f8d81fcf700 1 Processor -- start 2023-10-01T07:57:59.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.394+0000 7f8d81fcf700 1 -- start start 2023-10-01T07:57:59.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.395+0000 7f8d81fcf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d7c133420 0x7f8d7c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:59.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.395+0000 7f8d81fcf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d7c133e30 0x7f8d7c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:59.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.395+0000 7f8d81fcf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d7c134260 0x7f8d7c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:57:59.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.395+0000 7f8d81fcf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c131720 con 0x7f8d7c133e30 2023-10-01T07:57:59.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.395+0000 7f8d81fcf700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c11fd60 con 0x7f8d7c134260 2023-10-01T07:57:59.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.395+0000 7f8d81fcf700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c12d730 con 0x7f8d7c133420 2023-10-01T07:57:59.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.395+0000 7f8d7b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d7c133420 0x7f8d7c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:59.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.395+0000 7f8d7b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d7c133420 0x7f8d7c09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:54184/0 (socket says 172.21.15.26:54184) 2023-10-01T07:57:59.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.395+0000 7f8d7b7fe700 1 -- 172.21.15.26:0/290485347 learned_addr learned my addr 172.21.15.26:0/290485347 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:57:59.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.395+0000 7f8d7affd700 1 --2- 172.21.15.26:0/290485347 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d7c133e30 0x7f8d7c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:59.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.395+0000 7f8d7bfff700 1 --2- 172.21.15.26:0/290485347 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d7c134260 0x7f8d7c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:57:59.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.396+0000 7f8d7affd700 1 -- 172.21.15.26:0/290485347 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d7c133420 msgr2=0x7f8d7c09c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:59.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.396+0000 7f8d7affd700 1 --2- 172.21.15.26:0/290485347 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d7c133420 0x7f8d7c09c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:59.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.396+0000 7f8d7affd700 1 -- 172.21.15.26:0/290485347 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d7c134260 msgr2=0x7f8d7c09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:59.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.396+0000 7f8d7affd700 1 --2- 172.21.15.26:0/290485347 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d7c134260 0x7f8d7c09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:59.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.396+0000 7f8d7affd700 1 -- 172.21.15.26:0/290485347 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6c0094a0 con 0x7f8d7c133e30 2023-10-01T07:57:59.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.396+0000 7f8d7b7fe700 1 --2- 172.21.15.26:0/290485347 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d7c133420 0x7f8d7c09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:57:59.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.396+0000 7f8d7affd700 1 --2- 172.21.15.26:0/290485347 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d7c133e30 0x7f8d7c09c9c0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f8d7000e900 tx=0x7f8d7000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:57:59.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.396+0000 7f8d63fff700 1 -- 172.21.15.26:0/290485347 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d70013680 con 0x7f8d7c133e30 2023-10-01T07:57:59.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.396+0000 7f8d63fff700 1 -- 172.21.15.26:0/290485347 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d700137e0 con 0x7f8d7c133e30 2023-10-01T07:57:59.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.396+0000 7f8d81fcf700 1 -- 172.21.15.26:0/290485347 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d7c12db80 con 0x7f8d7c133e30 2023-10-01T07:57:59.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.396+0000 7f8d63fff700 1 -- 172.21.15.26:0/290485347 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d70013b50 con 0x7f8d7c133e30 2023-10-01T07:57:59.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.396+0000 7f8d81fcf700 1 -- 172.21.15.26:0/290485347 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d7c120a00 con 0x7f8d7c133e30 2023-10-01T07:57:59.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.398+0000 7f8d81fcf700 1 -- 172.21.15.26:0/290485347 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d5c0052e0 con 0x7f8d7c133e30 2023-10-01T07:57:59.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.398+0000 7f8d63fff700 1 -- 172.21.15.26:0/290485347 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8d7001c450 con 0x7f8d7c133e30 2023-10-01T07:57:59.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.399+0000 7f8d63fff700 1 -- 172.21.15.26:0/290485347 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8d7003fd30 con 0x7f8d7c133e30 2023-10-01T07:57:59.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.407+0000 7f8d63fff700 1 -- 172.21.15.26:0/290485347 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8d7001a540 con 0x7f8d7c133e30 2023-10-01T07:57:59.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.446+0000 7f4da448d700 1 -- 172.21.15.26:0/2348356797 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4d9c074ea0 con 0x7f4d9c09e000 2023-10-01T07:57:59.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.447+0000 7f4d92ffd700 1 -- 172.21.15.26:0/2348356797 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4d8c021070 con 0x7f4d9c09e000 2023-10-01T07:57:59.448 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:57:59.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.449+0000 7f4da448d700 1 -- 172.21.15.26:0/2348356797 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d9c09e000 msgr2=0x7f4d9c1c84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:59.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.449+0000 7f4da448d700 1 --2- 172.21.15.26:0/2348356797 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d9c09e000 0x7f4d9c1c84f0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c00e840 tx=0x7f4d8c00eb50 comp rx=0 tx=0).stop 2023-10-01T07:57:59.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.449+0000 7f4da448d700 1 -- 172.21.15.26:0/2348356797 shutdown_connections 2023-10-01T07:57:59.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.449+0000 7f4da448d700 1 --2- 172.21.15.26:0/2348356797 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4d9c09e410 0x7f4d9c1c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:59.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.449+0000 7f4da448d700 1 --2- 172.21.15.26:0/2348356797 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4d9c09d6f0 0x7f4d9c1c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:59.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.449+0000 7f4da448d700 1 --2- 172.21.15.26:0/2348356797 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d9c09e000 0x7f4d9c1c84f0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:59.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.449+0000 7f4da448d700 1 -- 172.21.15.26:0/2348356797 >> 172.21.15.26:0/2348356797 conn(0x7f4d9c066f50 msgr2=0x7f4d9c06f390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:59.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.450+0000 7f4da448d700 1 -- 172.21.15.26:0/2348356797 shutdown_connections 2023-10-01T07:57:59.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.450+0000 7f4da448d700 1 -- 172.21.15.26:0/2348356797 wait complete. 2023-10-01T07:57:59.464 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:57:59.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.531+0000 7f93a5d55700 1 -- 172.21.15.26:0/2657616829 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f93a013efc0 con 0x7f93a006ee80 2023-10-01T07:57:59.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.532+0000 7f9387fff700 1 -- 172.21.15.26:0/2657616829 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9394017030 con 0x7f93a006ee80 2023-10-01T07:57:59.533 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:57:59.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.534+0000 7f93a5d55700 1 -- 172.21.15.26:0/2657616829 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f93a006ee80 msgr2=0x7f93a0125f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:59.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.534+0000 7f93a5d55700 1 --2- 172.21.15.26:0/2657616829 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f93a006ee80 0x7f93a0125f10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f93a00a35d0 tx=0x7f939400c700 comp rx=0 tx=0).stop 2023-10-01T07:57:59.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.534+0000 7f93a5d55700 1 -- 172.21.15.26:0/2657616829 shutdown_connections 2023-10-01T07:57:59.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.534+0000 7f93a5d55700 1 --2- 172.21.15.26:0/2657616829 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f93a01279c0 0x7f93a0126450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:59.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.534+0000 7f93a5d55700 1 --2- 172.21.15.26:0/2657616829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93a006e570 0x7f93a0127480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:59.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.534+0000 7f93a5d55700 1 --2- 172.21.15.26:0/2657616829 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f93a006ee80 0x7f93a0125f10 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:59.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.534+0000 7f93a5d55700 1 -- 172.21.15.26:0/2657616829 >> 172.21.15.26:0/2657616829 conn(0x7f93a00a2aa0 msgr2=0x7f93a00a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:59.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.534+0000 7f93a5d55700 1 -- 172.21.15.26:0/2657616829 shutdown_connections 2023-10-01T07:57:59.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.534+0000 7f93a5d55700 1 -- 172.21.15.26:0/2657616829 wait complete. 2023-10-01T07:57:59.549 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:57:59.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.573+0000 7f4b64efd700 1 -- 172.21.15.26:0/4217137425 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4b6006c360 con 0x7f4b6009e410 2023-10-01T07:57:59.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.574+0000 7f4b4effd700 1 -- 172.21.15.26:0/4217137425 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4b58023020 con 0x7f4b6009e410 2023-10-01T07:57:59.574 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:57:59.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.576+0000 7f4b64efd700 1 -- 172.21.15.26:0/4217137425 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4b6009e410 msgr2=0x7f4b6013a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:59.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.576+0000 7f4b64efd700 1 --2- 172.21.15.26:0/4217137425 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4b6009e410 0x7f4b6013a3c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800cc10 tx=0x7f4b5800cf20 comp rx=0 tx=0).stop 2023-10-01T07:57:59.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.576+0000 7f4b64efd700 1 -- 172.21.15.26:0/4217137425 shutdown_connections 2023-10-01T07:57:59.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.576+0000 7f4b64efd700 1 --2- 172.21.15.26:0/4217137425 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4b6009e410 0x7f4b6013a3c0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:59.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.576+0000 7f4b64efd700 1 --2- 172.21.15.26:0/4217137425 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b6009d6f0 0x7f4b60139940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:59.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.576+0000 7f4b64efd700 1 --2- 172.21.15.26:0/4217137425 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b6009e000 0x7f4b60139e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:59.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.576+0000 7f4b64efd700 1 -- 172.21.15.26:0/4217137425 >> 172.21.15.26:0/4217137425 conn(0x7f4b60066f50 msgr2=0x7f4b60070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:59.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.576+0000 7f4b64efd700 1 -- 172.21.15.26:0/4217137425 shutdown_connections 2023-10-01T07:57:59.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.576+0000 7f4b64efd700 1 -- 172.21.15.26:0/4217137425 wait complete. 2023-10-01T07:57:59.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:57:59.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.615+0000 7f8d81fcf700 1 -- 172.21.15.26:0/290485347 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8d5c005150 con 0x7f8d7c133e30 2023-10-01T07:57:59.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.615+0000 7f8d63fff700 1 -- 172.21.15.26:0/290485347 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8d70017070 con 0x7f8d7c133e30 2023-10-01T07:57:59.616 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:57:59.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.618+0000 7f8d81fcf700 1 -- 172.21.15.26:0/290485347 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d7c133e30 msgr2=0x7f8d7c09c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:57:59.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.618+0000 7f8d81fcf700 1 --2- 172.21.15.26:0/290485347 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d7c133e30 0x7f8d7c09c9c0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f8d7000e900 tx=0x7f8d7000ec10 comp rx=0 tx=0).stop 2023-10-01T07:57:59.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.618+0000 7f8d81fcf700 1 -- 172.21.15.26:0/290485347 shutdown_connections 2023-10-01T07:57:59.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.618+0000 7f8d81fcf700 1 --2- 172.21.15.26:0/290485347 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d7c134260 0x7f8d7c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:59.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.618+0000 7f8d81fcf700 1 --2- 172.21.15.26:0/290485347 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d7c133420 0x7f8d7c09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:59.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.618+0000 7f8d81fcf700 1 --2- 172.21.15.26:0/290485347 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d7c133e30 0x7f8d7c09c9c0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:57:59.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.618+0000 7f8d81fcf700 1 -- 172.21.15.26:0/290485347 >> 172.21.15.26:0/290485347 conn(0x7f8d7c0a4210 msgr2=0x7f8d7c0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:57:59.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.618+0000 7f8d81fcf700 1 -- 172.21.15.26:0/290485347 shutdown_connections 2023-10-01T07:57:59.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:57:59.618+0000 7f8d81fcf700 1 -- 172.21.15.26:0/290485347 wait complete. 2023-10-01T07:57:59.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:00.465 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:00.550 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:00.591 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:00.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.613+0000 7fae1e153700 1 Processor -- start 2023-10-01T07:58:00.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.613+0000 7fae1e153700 1 -- start start 2023-10-01T07:58:00.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.614+0000 7fae1e153700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae1806f5d0 0x7fae1812ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:00.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.614+0000 7fae1e153700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae18135c20 0x7fae18138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:00.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.614+0000 7fae1e153700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae1806fa40 con 0x7fae1812cf60 2023-10-01T07:58:00.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.614+0000 7fae1e153700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae1812cd90 con 0x7fae1806f5d0 2023-10-01T07:58:00.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.614+0000 7fae1e153700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae18071780 con 0x7fae18135c20 2023-10-01T07:58:00.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.614+0000 7fae177fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fae1812cf60 0x7fae1812f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39872/0 (socket says 172.21.15.26:39872) 2023-10-01T07:58:00.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.614+0000 7fae177fe700 1 -- 172.21.15.26:0/4138610406 learned_addr learned my addr 172.21.15.26:0/4138610406 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:00.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.614+0000 7fae16ffd700 1 --2- 172.21.15.26:0/4138610406 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae1806f5d0 0x7fae1812ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:00.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.614+0000 7fae17fff700 1 --2- 172.21.15.26:0/4138610406 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae18135c20 0x7fae18138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:00.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.615+0000 7fae167fc700 1 -- 172.21.15.26:0/4138610406 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2625264610 0 0) 0x7fae1806fa40 con 0x7fae1812cf60 2023-10-01T07:58:00.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.615+0000 7fae167fc700 1 -- 172.21.15.26:0/4138610406 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae000057c0 con 0x7fae1812cf60 2023-10-01T07:58:00.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.615+0000 7fae16ffd700 1 -- 172.21.15.26:0/4138610406 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae18135c20 msgr2=0x7fae18138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:00.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.615+0000 7fae16ffd700 1 --2- 172.21.15.26:0/4138610406 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae18135c20 0x7fae18138000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:00.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.615+0000 7fae16ffd700 1 -- 172.21.15.26:0/4138610406 >> v1:172.21.15.26:6789/0 conn(0x7fae1812cf60 legacy=0x7fae1812f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:00.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.615+0000 7fae16ffd700 1 -- 172.21.15.26:0/4138610406 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae18071a40 con 0x7fae1806f5d0 2023-10-01T07:58:00.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.615+0000 7fae16ffd700 1 --2- 172.21.15.26:0/4138610406 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae1806f5d0 0x7fae1812ffc0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fae0c009870 tx=0x7fae0c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=118c03e0b875540b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:00.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.615+0000 7fae167fc700 1 -- 172.21.15.26:0/4138610406 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c011830 con 0x7fae1806f5d0 2023-10-01T07:58:00.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.615+0000 7fae167fc700 1 -- 172.21.15.26:0/4138610406 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0c011990 con 0x7fae1806f5d0 2023-10-01T07:58:00.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.615+0000 7fae167fc700 1 -- 172.21.15.26:0/4138610406 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c011d20 con 0x7fae1806f5d0 2023-10-01T07:58:00.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.616+0000 7fae1e153700 1 -- 172.21.15.26:0/4138610406 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae1806f5d0 msgr2=0x7fae1812ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:00.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.616+0000 7fae1e153700 1 --2- 172.21.15.26:0/4138610406 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae1806f5d0 0x7fae1812ffc0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fae0c009870 tx=0x7fae0c009b80 comp rx=0 tx=0).stop 2023-10-01T07:58:00.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.616+0000 7fae1e153700 1 -- 172.21.15.26:0/4138610406 shutdown_connections 2023-10-01T07:58:00.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.616+0000 7fae1e153700 1 --2- 172.21.15.26:0/4138610406 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae18135c20 0x7fae18138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:00.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.616+0000 7fae1e153700 1 --2- 172.21.15.26:0/4138610406 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae1806f5d0 0x7fae1812ffc0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:00.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.616+0000 7fae1e153700 1 -- 172.21.15.26:0/4138610406 >> 172.21.15.26:0/4138610406 conn(0x7fae180a2aa0 msgr2=0x7fae180a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:00.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.616+0000 7fae1e153700 1 -- 172.21.15.26:0/4138610406 shutdown_connections 2023-10-01T07:58:00.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.616+0000 7fae1e153700 1 -- 172.21.15.26:0/4138610406 wait complete. 2023-10-01T07:58:00.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.618+0000 7fae1e153700 1 Processor -- start 2023-10-01T07:58:00.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.618+0000 7fae1e153700 1 -- start start 2023-10-01T07:58:00.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.618+0000 7fae1e153700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae1806f5d0 0x7fae181c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:00.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.618+0000 7fae1e153700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae1812cf60 0x7fae181c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:00.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.619+0000 7fae1e153700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae18135c20 0x7fae181c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:00.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.619+0000 7fae1e153700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae180a1500 con 0x7fae1806f5d0 2023-10-01T07:58:00.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.619+0000 7fae1e153700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae18129fa0 con 0x7fae1812cf60 2023-10-01T07:58:00.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.619+0000 7fae1e153700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae1812e060 con 0x7fae18135c20 2023-10-01T07:58:00.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.619+0000 7fae16ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae1812cf60 0x7fae181c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:00.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.619+0000 7fae16ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae1812cf60 0x7fae181c43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58804/0 (socket says 172.21.15.26:58804) 2023-10-01T07:58:00.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.619+0000 7fae16ffd700 1 -- 172.21.15.26:0/282553740 learned_addr learned my addr 172.21.15.26:0/282553740 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:00.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.619+0000 7fae17fff700 1 --2- 172.21.15.26:0/282553740 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae18135c20 0x7fae181c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:00.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.619+0000 7fae177fe700 1 --2- 172.21.15.26:0/282553740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae1806f5d0 0x7fae181c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:00.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.619+0000 7fae16ffd700 1 -- 172.21.15.26:0/282553740 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae18135c20 msgr2=0x7fae181c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:00.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.619+0000 7fae16ffd700 1 --2- 172.21.15.26:0/282553740 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae18135c20 0x7fae181c48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:00.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.619+0000 7fae16ffd700 1 -- 172.21.15.26:0/282553740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae1806f5d0 msgr2=0x7fae181c3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:00.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.619+0000 7fae16ffd700 1 --2- 172.21.15.26:0/282553740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae1806f5d0 0x7fae181c3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:00.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.619+0000 7fae16ffd700 1 -- 172.21.15.26:0/282553740 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0c0094a0 con 0x7fae1812cf60 2023-10-01T07:58:00.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.619+0000 7fae16ffd700 1 --2- 172.21.15.26:0/282553740 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae1812cf60 0x7fae181c43b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fae0c009840 tx=0x7fae0c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:00.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.620+0000 7fadfffff700 1 -- 172.21.15.26:0/282553740 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c004450 con 0x7fae1812cf60 2023-10-01T07:58:00.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.620+0000 7fae1e153700 1 -- 172.21.15.26:0/282553740 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae18130380 con 0x7fae1812cf60 2023-10-01T07:58:00.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.620+0000 7fae1e153700 1 -- 172.21.15.26:0/282553740 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae1812dd20 con 0x7fae1812cf60 2023-10-01T07:58:00.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.620+0000 7fadfffff700 1 -- 172.21.15.26:0/282553740 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0c023070 con 0x7fae1812cf60 2023-10-01T07:58:00.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.620+0000 7fadfffff700 1 -- 172.21.15.26:0/282553740 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c01fa80 con 0x7fae1812cf60 2023-10-01T07:58:00.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.620+0000 7fadfffff700 1 -- 172.21.15.26:0/282553740 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fae0c01fbe0 con 0x7fae1812cf60 2023-10-01T07:58:00.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.621+0000 7fadfffff700 1 -- 172.21.15.26:0/282553740 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fae0c025070 con 0x7fae1812cf60 2023-10-01T07:58:00.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.621+0000 7fae1e153700 1 -- 172.21.15.26:0/282553740 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf80052e0 con 0x7fae1812cf60 2023-10-01T07:58:00.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.626+0000 7fadfffff700 1 -- 172.21.15.26:0/282553740 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fae0c015020 con 0x7fae1812cf60 2023-10-01T07:58:00.632 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:00.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.704+0000 7f0c1a3c7700 1 Processor -- start 2023-10-01T07:58:00.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.704+0000 7f0c1a3c7700 1 -- start start 2023-10-01T07:58:00.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.705+0000 7f0c1a3c7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0c1409e1d0 0x7f0c14138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:00.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.705+0000 7f0c1a3c7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0c14139170 0x7f0c1413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:00.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.705+0000 7f0c1a3c7700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1409b120 con 0x7f0c1409d6f0 2023-10-01T07:58:00.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.705+0000 7f0c1a3c7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1406b460 con 0x7f0c14139170 2023-10-01T07:58:00.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.705+0000 7f0c1a3c7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1409a7e0 con 0x7f0c1409e1d0 2023-10-01T07:58:00.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.705+0000 7f0c18964700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0c14139170 0x7f0c1413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:00.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.705+0000 7f0c18964700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0c14139170 0x7f0c1413b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48058/0 (socket says 172.21.15.26:48058) 2023-10-01T07:58:00.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.705+0000 7f0c18964700 1 -- 172.21.15.26:0/3063216726 learned_addr learned my addr 172.21.15.26:0/3063216726 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:00.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.705+0000 7f0c137fe700 1 --2- 172.21.15.26:0/3063216726 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0c1409e1d0 0x7f0c14138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:00.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.706+0000 7f0c18964700 1 -- 172.21.15.26:0/3063216726 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0c1409e1d0 msgr2=0x7f0c14138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:00.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.706+0000 7f0c18964700 1 --2- 172.21.15.26:0/3063216726 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0c1409e1d0 0x7f0c14138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:00.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.706+0000 7f0c18964700 1 -- 172.21.15.26:0/3063216726 >> v1:172.21.15.26:6789/0 conn(0x7f0c1409d6f0 legacy=0x7f0c1409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:00.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.706+0000 7f0c18964700 1 -- 172.21.15.26:0/3063216726 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c1409a500 con 0x7f0c14139170 2023-10-01T07:58:00.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.706+0000 7f0c137fe700 1 --2- 172.21.15.26:0/3063216726 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0c1409e1d0 0x7f0c14138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:00.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.706+0000 7f0c18964700 1 --2- 172.21.15.26:0/3063216726 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c14139170 0x7f0c1413b550 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c009e50 tx=0x7f0c0c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84969b00e4dc6330 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:00.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.706+0000 7f0c12ffd700 1 -- 172.21.15.26:0/3063216726 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c00e070 con 0x7f0c14139170 2023-10-01T07:58:00.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.706+0000 7f0c12ffd700 1 -- 172.21.15.26:0/3063216726 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c0c00b910 con 0x7f0c14139170 2023-10-01T07:58:00.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.706+0000 7f0c12ffd700 1 -- 172.21.15.26:0/3063216726 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c00bcc0 con 0x7f0c14139170 2023-10-01T07:58:00.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.707+0000 7f0c1a3c7700 1 -- 172.21.15.26:0/3063216726 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c14139170 msgr2=0x7f0c1413b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:00.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.707+0000 7f0c1a3c7700 1 --2- 172.21.15.26:0/3063216726 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c14139170 0x7f0c1413b550 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c009e50 tx=0x7f0c0c00b330 comp rx=0 tx=0).stop 2023-10-01T07:58:00.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.707+0000 7f0c1a3c7700 1 -- 172.21.15.26:0/3063216726 shutdown_connections 2023-10-01T07:58:00.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.707+0000 7f0c1a3c7700 1 --2- 172.21.15.26:0/3063216726 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c14139170 0x7f0c1413b550 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:00.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.707+0000 7f0c1a3c7700 1 --2- 172.21.15.26:0/3063216726 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0c1409e1d0 0x7f0c14138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:00.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.707+0000 7f0c1a3c7700 1 -- 172.21.15.26:0/3063216726 >> 172.21.15.26:0/3063216726 conn(0x7f0c14066f50 msgr2=0x7f0c1409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:00.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.707+0000 7f0c1a3c7700 1 -- 172.21.15.26:0/3063216726 shutdown_connections 2023-10-01T07:58:00.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.707+0000 7f0c1a3c7700 1 -- 172.21.15.26:0/3063216726 wait complete. 2023-10-01T07:58:00.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.708+0000 7f0c1a3c7700 1 Processor -- start 2023-10-01T07:58:00.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.709+0000 7f0c1a3c7700 1 -- start start 2023-10-01T07:58:00.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.709+0000 7f0c1a3c7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0c1409d6f0 0x7f0c141206c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:00.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.709+0000 7f0c1a3c7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c1409e1d0 0x7f0c14120c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:00.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.709+0000 7f0c1a3c7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c14139170 0x7f0c14121140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:00.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.709+0000 7f0c1a3c7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c140a2a30 con 0x7f0c14139170 2023-10-01T07:58:00.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.709+0000 7f0c1a3c7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c14123c40 con 0x7f0c1409e1d0 2023-10-01T07:58:00.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.709+0000 7f0c1a3c7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c141223e0 con 0x7f0c1409d6f0 2023-10-01T07:58:00.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.709+0000 7f0c137fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c1409e1d0 0x7f0c14120c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:00.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.709+0000 7f0c137fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c1409e1d0 0x7f0c14120c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58808/0 (socket says 172.21.15.26:58808) 2023-10-01T07:58:00.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.709+0000 7f0c137fe700 1 -- 172.21.15.26:0/4060432605 learned_addr learned my addr 172.21.15.26:0/4060432605 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:00.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.709+0000 7f0c18964700 1 --2- 172.21.15.26:0/4060432605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c14139170 0x7f0c14121140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:00.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.709+0000 7f0c13fff700 1 --2- 172.21.15.26:0/4060432605 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0c1409d6f0 0x7f0c141206c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:00.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.710+0000 7f0c137fe700 1 -- 172.21.15.26:0/4060432605 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0c1409d6f0 msgr2=0x7f0c141206c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:00.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.710+0000 7f0c137fe700 1 --2- 172.21.15.26:0/4060432605 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0c1409d6f0 0x7f0c141206c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:00.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.710+0000 7f0c137fe700 1 -- 172.21.15.26:0/4060432605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c14139170 msgr2=0x7f0c14121140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:00.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.710+0000 7f0c137fe700 1 --2- 172.21.15.26:0/4060432605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c14139170 0x7f0c14121140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:00.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.710+0000 7f0c137fe700 1 -- 172.21.15.26:0/4060432605 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c080094a0 con 0x7f0c1409e1d0 2023-10-01T07:58:00.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.710+0000 7f0c18964700 1 --2- 172.21.15.26:0/4060432605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c14139170 0x7f0c14121140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:00.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.710+0000 7f0c137fe700 1 --2- 172.21.15.26:0/4060432605 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c1409e1d0 0x7f0c14120c00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0c0800ebe0 tx=0x7f0c0800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:00.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.710+0000 7f0c10ff9700 1 -- 172.21.15.26:0/4060432605 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0800c850 con 0x7f0c1409e1d0 2023-10-01T07:58:00.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.710+0000 7f0c10ff9700 1 -- 172.21.15.26:0/4060432605 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c0800c9b0 con 0x7f0c1409e1d0 2023-10-01T07:58:00.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.710+0000 7f0c1a3c7700 1 -- 172.21.15.26:0/4060432605 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c0c009b30 con 0x7f0c1409e1d0 2023-10-01T07:58:00.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.710+0000 7f0c10ff9700 1 -- 172.21.15.26:0/4060432605 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0800cd40 con 0x7f0c1409e1d0 2023-10-01T07:58:00.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.710+0000 7f0c1a3c7700 1 -- 172.21.15.26:0/4060432605 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c14123940 con 0x7f0c1409e1d0 2023-10-01T07:58:00.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.711+0000 7f0c10ff9700 1 -- 172.21.15.26:0/4060432605 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0c08013470 con 0x7f0c1409e1d0 2023-10-01T07:58:00.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.712+0000 7f0c10ff9700 1 -- 172.21.15.26:0/4060432605 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0c0803fb60 con 0x7f0c1409e1d0 2023-10-01T07:58:00.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.712+0000 7f0c1a3c7700 1 -- 172.21.15.26:0/4060432605 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c14074ea0 con 0x7f0c1409e1d0 2023-10-01T07:58:00.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.717+0000 7f0c10ff9700 1 -- 172.21.15.26:0/4060432605 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0c08021080 con 0x7f0c1409e1d0 2023-10-01T07:58:00.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.764+0000 7fe582479700 1 Processor -- start 2023-10-01T07:58:00.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.764+0000 7fe582479700 1 -- start start 2023-10-01T07:58:00.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.765+0000 7fe582479700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe57c133a80 0x7fe57c133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:00.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.765+0000 7fe582479700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe57c130a40 0x7fe57c13b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:00.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.765+0000 7fe582479700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe57c06bc00 con 0x7fe57c12ff20 2023-10-01T07:58:00.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.765+0000 7fe582479700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c06c570 con 0x7fe57c133a80 2023-10-01T07:58:00.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.765+0000 7fe582479700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c0a0040 con 0x7fe57c130a40 2023-10-01T07:58:00.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.765+0000 7fe57b7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe57c12ff20 0x7fe57c130330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39898/0 (socket says 172.21.15.26:39898) 2023-10-01T07:58:00.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.765+0000 7fe57b7fe700 1 -- 172.21.15.26:0/2761959874 learned_addr learned my addr 172.21.15.26:0/2761959874 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:00.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.765+0000 7fe57bfff700 1 --2- 172.21.15.26:0/2761959874 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe57c133a80 0x7fe57c133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:00.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.765+0000 7fe580a16700 1 --2- 172.21.15.26:0/2761959874 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe57c130a40 0x7fe57c13b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:00.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.766+0000 7fe57affd700 1 -- 172.21.15.26:0/2761959874 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 315146380 0 0) 0x7fe57c06bc00 con 0x7fe57c12ff20 2023-10-01T07:58:00.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.766+0000 7fe57bfff700 1 -- 172.21.15.26:0/2761959874 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe57c130a40 msgr2=0x7fe57c13b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:00.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.766+0000 7fe57bfff700 1 --2- 172.21.15.26:0/2761959874 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe57c130a40 0x7fe57c13b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:00.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.766+0000 7fe57bfff700 1 -- 172.21.15.26:0/2761959874 >> v1:172.21.15.26:6789/0 conn(0x7fe57c12ff20 legacy=0x7fe57c130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:00.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.766+0000 7fe57bfff700 1 -- 172.21.15.26:0/2761959874 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57c133860 con 0x7fe57c133a80 2023-10-01T07:58:00.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.766+0000 7fe580a16700 1 --2- 172.21.15.26:0/2761959874 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe57c130a40 0x7fe57c13b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:00.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.766+0000 7fe57bfff700 1 --2- 172.21.15.26:0/2761959874 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe57c133a80 0x7fe57c133e50 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe56c009870 tx=0x7fe56c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e187592973d4a8d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:00.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.766+0000 7fe57affd700 1 -- 172.21.15.26:0/2761959874 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56c011830 con 0x7fe57c133a80 2023-10-01T07:58:00.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.766+0000 7fe57affd700 1 -- 172.21.15.26:0/2761959874 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56c011990 con 0x7fe57c133a80 2023-10-01T07:58:00.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.766+0000 7fe57affd700 1 -- 172.21.15.26:0/2761959874 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56c011d20 con 0x7fe57c133a80 2023-10-01T07:58:00.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.767+0000 7fe582479700 1 -- 172.21.15.26:0/2761959874 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe57c133a80 msgr2=0x7fe57c133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:00.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.767+0000 7fe582479700 1 --2- 172.21.15.26:0/2761959874 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe57c133a80 0x7fe57c133e50 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe56c009870 tx=0x7fe56c009b80 comp rx=0 tx=0).stop 2023-10-01T07:58:00.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.767+0000 7fe582479700 1 -- 172.21.15.26:0/2761959874 shutdown_connections 2023-10-01T07:58:00.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.767+0000 7fe582479700 1 --2- 172.21.15.26:0/2761959874 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe57c130a40 0x7fe57c13b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:00.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.767+0000 7fe582479700 1 --2- 172.21.15.26:0/2761959874 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe57c133a80 0x7fe57c133e50 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:00.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.767+0000 7fe582479700 1 -- 172.21.15.26:0/2761959874 >> 172.21.15.26:0/2761959874 conn(0x7fe57c0a4210 msgr2=0x7fe57c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:00.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.768+0000 7fe582479700 1 -- 172.21.15.26:0/2761959874 shutdown_connections 2023-10-01T07:58:00.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.768+0000 7fe582479700 1 -- 172.21.15.26:0/2761959874 wait complete. 2023-10-01T07:58:00.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.769+0000 7fe582479700 1 Processor -- start 2023-10-01T07:58:00.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.769+0000 7fe582479700 1 -- start start 2023-10-01T07:58:00.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.770+0000 7fe582479700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe57c12ff20 0x7fe57c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:00.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.770+0000 7fe582479700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe57c130a40 0x7fe57c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:00.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.770+0000 7fe582479700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe57c133a80 0x7fe57c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:00.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.770+0000 7fe582479700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c11ff10 con 0x7fe57c133a80 2023-10-01T07:58:00.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.770+0000 7fe582479700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c12d2c0 con 0x7fe57c130a40 2023-10-01T07:58:00.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.770+0000 7fe582479700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c09e410 con 0x7fe57c12ff20 2023-10-01T07:58:00.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.770+0000 7fe57b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe57c130a40 0x7fe57c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:00.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.770+0000 7fe57b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe57c130a40 0x7fe57c09c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58820/0 (socket says 172.21.15.26:58820) 2023-10-01T07:58:00.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.770+0000 7fe57b7fe700 1 -- 172.21.15.26:0/2039876341 learned_addr learned my addr 172.21.15.26:0/2039876341 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:00.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.770+0000 7fe580a16700 1 --2- 172.21.15.26:0/2039876341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe57c133a80 0x7fe57c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:00.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.770+0000 7fe57bfff700 1 --2- 172.21.15.26:0/2039876341 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe57c12ff20 0x7fe57c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:00.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.771+0000 7fe580a16700 1 -- 172.21.15.26:0/2039876341 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe57c12ff20 msgr2=0x7fe57c09c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:00.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.771+0000 7fe580a16700 1 --2- 172.21.15.26:0/2039876341 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe57c12ff20 0x7fe57c09c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:00.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.771+0000 7fe580a16700 1 -- 172.21.15.26:0/2039876341 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe57c130a40 msgr2=0x7fe57c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:00.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.771+0000 7fe580a16700 1 --2- 172.21.15.26:0/2039876341 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe57c130a40 0x7fe57c09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:00.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.771+0000 7fe580a16700 1 -- 172.21.15.26:0/2039876341 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe574009a70 con 0x7fe57c133a80 2023-10-01T07:58:00.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.771+0000 7fe57bfff700 1 --2- 172.21.15.26:0/2039876341 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe57c12ff20 0x7fe57c09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:00.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.771+0000 7fe580a16700 1 --2- 172.21.15.26:0/2039876341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe57c133a80 0x7fe57c09cf00 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fe57400efc0 tx=0x7fe57400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:00.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.771+0000 7fe578ff9700 1 -- 172.21.15.26:0/2039876341 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57400ca90 con 0x7fe57c133a80 2023-10-01T07:58:00.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.771+0000 7fe578ff9700 1 -- 172.21.15.26:0/2039876341 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57400f040 con 0x7fe57c133a80 2023-10-01T07:58:00.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.771+0000 7fe582479700 1 -- 172.21.15.26:0/2039876341 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe56c0094a0 con 0x7fe57c133a80 2023-10-01T07:58:00.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.771+0000 7fe582479700 1 -- 172.21.15.26:0/2039876341 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe57c0a20e0 con 0x7fe57c133a80 2023-10-01T07:58:00.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.771+0000 7fe578ff9700 1 -- 172.21.15.26:0/2039876341 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57400ce30 con 0x7fe57c133a80 2023-10-01T07:58:00.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.772+0000 7fe578ff9700 1 -- 172.21.15.26:0/2039876341 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe574014480 con 0x7fe57c133a80 2023-10-01T07:58:00.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.773+0000 7fe578ff9700 1 -- 172.21.15.26:0/2039876341 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe57403fc90 con 0x7fe57c133a80 2023-10-01T07:58:00.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.773+0000 7fe582479700 1 -- 172.21.15.26:0/2039876341 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe55c0052e0 con 0x7fe57c133a80 2023-10-01T07:58:00.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.777+0000 7f9c2e4ad700 1 Processor -- start 2023-10-01T07:58:00.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.777+0000 7f9c2e4ad700 1 -- start start 2023-10-01T07:58:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.778+0000 7f9c2e4ad700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c2806a770 0x7f9c2806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.778+0000 7f9c2e4ad700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9c2806b080 0x7f9c28131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:00.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.778+0000 7f9c2e4ad700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c2809ece0 con 0x7f9c28131b40 2023-10-01T07:58:00.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.778+0000 7f9c2e4ad700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c2809e760 con 0x7f9c2806b080 2023-10-01T07:58:00.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.778+0000 7f9c2e4ad700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2809e040 con 0x7f9c2806a770 2023-10-01T07:58:00.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.778+0000 7f9c277fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9c2806b080 0x7f9c28131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:00.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.778+0000 7f9c27fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c2806a770 0x7f9c2806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:00.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.778+0000 7f9c277fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9c2806b080 0x7f9c28131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48084/0 (socket says 172.21.15.26:48084) 2023-10-01T07:58:00.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.778+0000 7f9c277fe700 1 -- 172.21.15.26:0/2904459753 learned_addr learned my addr 172.21.15.26:0/2904459753 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:00.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.778+0000 7f9c2ca4a700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9c28131b40 0x7f9c28138850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39906/0 (socket says 172.21.15.26:39906) 2023-10-01T07:58:00.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.778+0000 7f9c277fe700 1 -- 172.21.15.26:0/2904459753 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c2806a770 msgr2=0x7f9c2806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:00.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.778+0000 7f9c277fe700 1 --2- 172.21.15.26:0/2904459753 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c2806a770 0x7f9c2806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:00.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.778+0000 7f9c277fe700 1 -- 172.21.15.26:0/2904459753 >> v1:172.21.15.26:6789/0 conn(0x7f9c28131b40 legacy=0x7f9c28138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:00.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.778+0000 7f9c277fe700 1 -- 172.21.15.26:0/2904459753 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c2809f630 con 0x7f9c2806b080 2023-10-01T07:58:00.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.778+0000 7f9c27fff700 1 --2- 172.21.15.26:0/2904459753 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c2806a770 0x7f9c2806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:00.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.778+0000 7f9c277fe700 1 --2- 172.21.15.26:0/2904459753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c2806b080 0x7f9c28131600 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0098f0 tx=0x7f9c1c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5cbaa59250d7ffb server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:00.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.782+0000 7f9c26ffd700 1 -- 172.21.15.26:0/2904459753 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c011830 con 0x7f9c2806b080 2023-10-01T07:58:00.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.782+0000 7f9c26ffd700 1 -- 172.21.15.26:0/2904459753 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1c011990 con 0x7f9c2806b080 2023-10-01T07:58:00.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.782+0000 7f9c26ffd700 1 -- 172.21.15.26:0/2904459753 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c011d20 con 0x7f9c2806b080 2023-10-01T07:58:00.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.782+0000 7fe578ff9700 1 -- 172.21.15.26:0/2039876341 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe574012930 con 0x7fe57c133a80 2023-10-01T07:58:00.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.783+0000 7f9c2e4ad700 1 -- 172.21.15.26:0/2904459753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c2806b080 msgr2=0x7f9c28131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:00.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.783+0000 7f9c2e4ad700 1 --2- 172.21.15.26:0/2904459753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c2806b080 0x7f9c28131600 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0098f0 tx=0x7f9c1c009c00 comp rx=0 tx=0).stop 2023-10-01T07:58:00.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.783+0000 7f9c2e4ad700 1 -- 172.21.15.26:0/2904459753 shutdown_connections 2023-10-01T07:58:00.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.783+0000 7f9c2e4ad700 1 --2- 172.21.15.26:0/2904459753 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c2806a770 0x7f9c2806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:00.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.783+0000 7f9c2e4ad700 1 --2- 172.21.15.26:0/2904459753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c2806b080 0x7f9c28131600 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:00.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.783+0000 7f9c2e4ad700 1 -- 172.21.15.26:0/2904459753 >> 172.21.15.26:0/2904459753 conn(0x7f9c28066f50 msgr2=0x7f9c2809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:00.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.784+0000 7f9c2e4ad700 1 -- 172.21.15.26:0/2904459753 shutdown_connections 2023-10-01T07:58:00.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.784+0000 7f9c2e4ad700 1 -- 172.21.15.26:0/2904459753 wait complete. 2023-10-01T07:58:00.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.785+0000 7f9c2e4ad700 1 Processor -- start 2023-10-01T07:58:00.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.785+0000 7f9c2e4ad700 1 -- start start 2023-10-01T07:58:00.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.786+0000 7f9c2e4ad700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c2806a770 0x7f9c281c6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:00.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.786+0000 7f9c2e4ad700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c2806b080 0x7f9c281c6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:00.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.786+0000 7f9c2e4ad700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c28131b40 0x7f9c281c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:00.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.786+0000 7f9c2e4ad700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2811e3a0 con 0x7f9c28131b40 2023-10-01T07:58:00.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.786+0000 7f9c2e4ad700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c28131600 con 0x7f9c2806b080 2023-10-01T07:58:00.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.786+0000 7f9c2e4ad700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c28071e60 con 0x7f9c2806a770 2023-10-01T07:58:00.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.786+0000 7f9c2ca4a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c28131b40 0x7f9c281c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:00.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.786+0000 7f9c27fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c2806a770 0x7f9c281c6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:00.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.786+0000 7f9c2ca4a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c28131b40 0x7f9c281c6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48088/0 (socket says 172.21.15.26:48088) 2023-10-01T07:58:00.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.786+0000 7f9c2ca4a700 1 -- 172.21.15.26:0/432193236 learned_addr learned my addr 172.21.15.26:0/432193236 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:00.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.787+0000 7f9c27fff700 1 -- 172.21.15.26:0/432193236 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c2806b080 msgr2=0x7f9c281c6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:00.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.787+0000 7f9c27fff700 1 --2- 172.21.15.26:0/432193236 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c2806b080 0x7f9c281c6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:00.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.787+0000 7f9c27fff700 1 -- 172.21.15.26:0/432193236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c28131b40 msgr2=0x7f9c281c6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:00.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.787+0000 7f9c27fff700 1 --2- 172.21.15.26:0/432193236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c28131b40 0x7f9c281c6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:00.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.787+0000 7f9c27fff700 1 -- 172.21.15.26:0/432193236 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c180094a0 con 0x7f9c2806a770 2023-10-01T07:58:00.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.787+0000 7f9c2ca4a700 1 --2- 172.21.15.26:0/432193236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c28131b40 0x7f9c281c6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:00.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.787+0000 7f9c27fff700 1 --2- 172.21.15.26:0/432193236 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c2806a770 0x7f9c281c6250 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800e9b0 tx=0x7f9c1800ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:00.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.787+0000 7f9c24ff9700 1 -- 172.21.15.26:0/432193236 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1800c850 con 0x7f9c2806a770 2023-10-01T07:58:00.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.787+0000 7f9c24ff9700 1 -- 172.21.15.26:0/432193236 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1800c9b0 con 0x7f9c2806a770 2023-10-01T07:58:00.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.787+0000 7f9c24ff9700 1 -- 172.21.15.26:0/432193236 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1800cd60 con 0x7f9c2806a770 2023-10-01T07:58:00.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.788+0000 7f9c2e4ad700 1 -- 172.21.15.26:0/432193236 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c1c009550 con 0x7f9c2806a770 2023-10-01T07:58:00.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.788+0000 7f9c2e4ad700 1 -- 172.21.15.26:0/432193236 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c28131240 con 0x7f9c2806a770 2023-10-01T07:58:00.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.789+0000 7f9c2e4ad700 1 -- 172.21.15.26:0/432193236 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c2804ea50 con 0x7f9c2806a770 2023-10-01T07:58:00.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.789+0000 7f9c24ff9700 1 -- 172.21.15.26:0/432193236 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9c18013470 con 0x7f9c2806a770 2023-10-01T07:58:00.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.789+0000 7f9c24ff9700 1 -- 172.21.15.26:0/432193236 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9c1803f810 con 0x7f9c2806a770 2023-10-01T07:58:00.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.799+0000 7f9c24ff9700 1 -- 172.21.15.26:0/432193236 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c180232f0 con 0x7f9c2806a770 2023-10-01T07:58:00.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.913+0000 7fae1e153700 1 -- 172.21.15.26:0/282553740 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fadf8005590 con 0x7fae1812cf60 2023-10-01T07:58:00.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.913+0000 7fadfffff700 1 -- 172.21.15.26:0/282553740 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fae0c0045b0 con 0x7fae1812cf60 2023-10-01T07:58:00.914 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:00.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.916+0000 7fae1e153700 1 -- 172.21.15.26:0/282553740 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae1812cf60 msgr2=0x7fae181c43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:00.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.916+0000 7fae1e153700 1 --2- 172.21.15.26:0/282553740 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae1812cf60 0x7fae181c43b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fae0c009840 tx=0x7fae0c004750 comp rx=0 tx=0).stop 2023-10-01T07:58:00.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.916+0000 7fae1e153700 1 -- 172.21.15.26:0/282553740 shutdown_connections 2023-10-01T07:58:00.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.916+0000 7fae1e153700 1 --2- 172.21.15.26:0/282553740 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae18135c20 0x7fae181c48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:00.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.916+0000 7fae1e153700 1 --2- 172.21.15.26:0/282553740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae1806f5d0 0x7fae181c3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:00.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.916+0000 7fae1e153700 1 --2- 172.21.15.26:0/282553740 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae1812cf60 0x7fae181c43b0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:00.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.916+0000 7fae1e153700 1 -- 172.21.15.26:0/282553740 >> 172.21.15.26:0/282553740 conn(0x7fae180a2aa0 msgr2=0x7fae1812a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:00.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.916+0000 7fae1e153700 1 -- 172.21.15.26:0/282553740 shutdown_connections 2023-10-01T07:58:00.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.916+0000 7fae1e153700 1 -- 172.21.15.26:0/282553740 wait complete. 2023-10-01T07:58:00.936 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:00.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.939+0000 7f0c1a3c7700 1 -- 172.21.15.26:0/4060432605 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0c14123d80 con 0x7f0c1409e1d0 2023-10-01T07:58:00.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.939+0000 7f0c10ff9700 1 -- 172.21.15.26:0/4060432605 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0c08017020 con 0x7f0c1409e1d0 2023-10-01T07:58:00.940 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:00.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.941+0000 7f0c1a3c7700 1 -- 172.21.15.26:0/4060432605 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c1409e1d0 msgr2=0x7f0c14120c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:00.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.941+0000 7f0c1a3c7700 1 --2- 172.21.15.26:0/4060432605 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c1409e1d0 0x7f0c14120c00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0c0800ebe0 tx=0x7f0c0800eef0 comp rx=0 tx=0).stop 2023-10-01T07:58:00.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.941+0000 7f0c1a3c7700 1 -- 172.21.15.26:0/4060432605 shutdown_connections 2023-10-01T07:58:00.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.941+0000 7f0c1a3c7700 1 --2- 172.21.15.26:0/4060432605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c14139170 0x7f0c14121140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:00.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.941+0000 7f0c1a3c7700 1 --2- 172.21.15.26:0/4060432605 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0c1409d6f0 0x7f0c141206c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:00.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.941+0000 7f0c1a3c7700 1 --2- 172.21.15.26:0/4060432605 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c1409e1d0 0x7f0c14120c00 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:00.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.941+0000 7f0c1a3c7700 1 -- 172.21.15.26:0/4060432605 >> 172.21.15.26:0/4060432605 conn(0x7f0c14066f50 msgr2=0x7f0c140a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:00.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.942+0000 7f0c1a3c7700 1 -- 172.21.15.26:0/4060432605 shutdown_connections 2023-10-01T07:58:00.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:00.942+0000 7f0c1a3c7700 1 -- 172.21.15.26:0/4060432605 wait complete. 2023-10-01T07:58:00.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:01.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:01.005+0000 7f9c2e4ad700 1 -- 172.21.15.26:0/432193236 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9c280a3540 con 0x7f9c2806a770 2023-10-01T07:58:01.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:01.005+0000 7f9c24ff9700 1 -- 172.21.15.26:0/432193236 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9c1801bb60 con 0x7f9c2806a770 2023-10-01T07:58:01.006 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:01.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:01.007+0000 7f9c2e4ad700 1 -- 172.21.15.26:0/432193236 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c2806a770 msgr2=0x7f9c281c6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:01.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:01.007+0000 7f9c2e4ad700 1 --2- 172.21.15.26:0/432193236 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c2806a770 0x7f9c281c6250 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800e9b0 tx=0x7f9c1800ecc0 comp rx=0 tx=0).stop 2023-10-01T07:58:01.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:01.007+0000 7f9c2e4ad700 1 -- 172.21.15.26:0/432193236 shutdown_connections 2023-10-01T07:58:01.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:01.007+0000 7f9c2e4ad700 1 --2- 172.21.15.26:0/432193236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c28131b40 0x7f9c281c6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:01.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:01.007+0000 7f9c2e4ad700 1 --2- 172.21.15.26:0/432193236 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c2806a770 0x7f9c281c6250 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:01.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:01.007+0000 7f9c2e4ad700 1 --2- 172.21.15.26:0/432193236 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c2806b080 0x7f9c281c6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:01.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:01.007+0000 7f9c2e4ad700 1 -- 172.21.15.26:0/432193236 >> 172.21.15.26:0/432193236 conn(0x7f9c28066f50 msgr2=0x7f9c280a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:01.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:01.008+0000 7f9c2e4ad700 1 -- 172.21.15.26:0/432193236 shutdown_connections 2023-10-01T07:58:01.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:01.008+0000 7f9c2e4ad700 1 -- 172.21.15.26:0/432193236 wait complete. 2023-10-01T07:58:01.022 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:01.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:01.046+0000 7fe582479700 1 -- 172.21.15.26:0/2039876341 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe55c005590 con 0x7fe57c133a80 2023-10-01T07:58:01.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:01.046+0000 7fe578ff9700 1 -- 172.21.15.26:0/2039876341 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe574012340 con 0x7fe57c133a80 2023-10-01T07:58:01.047 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:01.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:01.049+0000 7fe582479700 1 -- 172.21.15.26:0/2039876341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe57c133a80 msgr2=0x7fe57c09cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:01.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:01.049+0000 7fe582479700 1 --2- 172.21.15.26:0/2039876341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe57c133a80 0x7fe57c09cf00 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fe57400efc0 tx=0x7fe57400c3a0 comp rx=0 tx=0).stop 2023-10-01T07:58:01.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:01.049+0000 7fe582479700 1 -- 172.21.15.26:0/2039876341 shutdown_connections 2023-10-01T07:58:01.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:01.049+0000 7fe582479700 1 --2- 172.21.15.26:0/2039876341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe57c133a80 0x7fe57c09cf00 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:01.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:01.049+0000 7fe582479700 1 --2- 172.21.15.26:0/2039876341 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe57c12ff20 0x7fe57c09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:01.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:01.049+0000 7fe582479700 1 --2- 172.21.15.26:0/2039876341 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe57c130a40 0x7fe57c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:01.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:01.049+0000 7fe582479700 1 -- 172.21.15.26:0/2039876341 >> 172.21.15.26:0/2039876341 conn(0x7fe57c0a4210 msgr2=0x7fe57c09e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:01.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:01.049+0000 7fe582479700 1 -- 172.21.15.26:0/2039876341 shutdown_connections 2023-10-01T07:58:01.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:01.049+0000 7fe582479700 1 -- 172.21.15.26:0/2039876341 wait complete. 2023-10-01T07:58:01.063 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:01.936 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:01.957 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:02.024 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:02.063 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:02.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.093+0000 7f2586edb700 1 Processor -- start 2023-10-01T07:58:02.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.093+0000 7f2586edb700 1 -- start start 2023-10-01T07:58:02.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.093+0000 7f2586edb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f258006b250 0x7f2580136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:02.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.093+0000 7f2586edb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2580136d80 0x7f2580139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:02.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.093+0000 7f2586edb700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f258009ece0 con 0x7f258006a770 2023-10-01T07:58:02.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.093+0000 7f2586edb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258006b640 con 0x7f2580136d80 2023-10-01T07:58:02.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.093+0000 7f2586edb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f258009e760 con 0x7f258006b250 2023-10-01T07:58:02.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.093+0000 7f2585478700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2580136d80 0x7f2580139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:02.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.093+0000 7f2585478700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2580136d80 0x7f2580139160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58844/0 (socket says 172.21.15.26:58844) 2023-10-01T07:58:02.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.093+0000 7f2585478700 1 -- 172.21.15.26:0/4061823091 learned_addr learned my addr 172.21.15.26:0/4061823091 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:02.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.094+0000 7f2585478700 1 -- 172.21.15.26:0/4061823091 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f258006b250 msgr2=0x7f2580136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:02.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.094+0000 7f2585478700 1 --2- 172.21.15.26:0/4061823091 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f258006b250 0x7f2580136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.094+0000 7f2585478700 1 -- 172.21.15.26:0/4061823091 >> v1:172.21.15.26:6789/0 conn(0x7f258006a770 legacy=0x7f258006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:02.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.094+0000 7f2585478700 1 -- 172.21.15.26:0/4061823091 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f258009e040 con 0x7f2580136d80 2023-10-01T07:58:02.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.094+0000 7f2585478700 1 --2- 172.21.15.26:0/4061823091 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2580136d80 0x7f2580139160 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2578009e80 tx=0x7f257800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5efb53601051e36c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:02.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.094+0000 7f257f7fe700 1 -- 172.21.15.26:0/4061823091 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257800e070 con 0x7f2580136d80 2023-10-01T07:58:02.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.094+0000 7f257f7fe700 1 -- 172.21.15.26:0/4061823091 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2578003a20 con 0x7f2580136d80 2023-10-01T07:58:02.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.094+0000 7f257f7fe700 1 -- 172.21.15.26:0/4061823091 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2578003dd0 con 0x7f2580136d80 2023-10-01T07:58:02.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.095+0000 7f2586edb700 1 -- 172.21.15.26:0/4061823091 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2580136d80 msgr2=0x7f2580139160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:02.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.095+0000 7f2586edb700 1 --2- 172.21.15.26:0/4061823091 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2580136d80 0x7f2580139160 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2578009e80 tx=0x7f257800b330 comp rx=0 tx=0).stop 2023-10-01T07:58:02.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.095+0000 7f2586edb700 1 -- 172.21.15.26:0/4061823091 shutdown_connections 2023-10-01T07:58:02.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.095+0000 7f2586edb700 1 --2- 172.21.15.26:0/4061823091 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2580136d80 0x7f2580139160 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.095+0000 7f2586edb700 1 --2- 172.21.15.26:0/4061823091 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f258006b250 0x7f2580136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.095+0000 7f2586edb700 1 -- 172.21.15.26:0/4061823091 >> 172.21.15.26:0/4061823091 conn(0x7f2580066f50 msgr2=0x7f258009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:02.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.095+0000 7f2586edb700 1 -- 172.21.15.26:0/4061823091 shutdown_connections 2023-10-01T07:58:02.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.095+0000 7f2586edb700 1 -- 172.21.15.26:0/4061823091 wait complete. 2023-10-01T07:58:02.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.097+0000 7f2586edb700 1 Processor -- start 2023-10-01T07:58:02.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.097+0000 7f2586edb700 1 -- start start 2023-10-01T07:58:02.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.097+0000 7f2586edb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f258006a770 0x7f25801c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:02.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.097+0000 7f2586edb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f258006b250 0x7f25801c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:02.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.097+0000 7f2586edb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2580136d80 0x7f25801c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:02.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.097+0000 7f2586edb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2580071e60 con 0x7f2580136d80 2023-10-01T07:58:02.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.097+0000 7f2586edb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258006eb00 con 0x7f258006a770 2023-10-01T07:58:02.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.097+0000 7f2586edb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2580122320 con 0x7f258006b250 2023-10-01T07:58:02.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.097+0000 7f2584c77700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f258006a770 0x7f25801c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:02.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.098+0000 7f2584c77700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f258006a770 0x7f25801c8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58854/0 (socket says 172.21.15.26:58854) 2023-10-01T07:58:02.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.098+0000 7f2584c77700 1 -- 172.21.15.26:0/86330864 learned_addr learned my addr 172.21.15.26:0/86330864 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:02.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.098+0000 7f257ffff700 1 --2- 172.21.15.26:0/86330864 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f258006b250 0x7f25801c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:02.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.098+0000 7f2585478700 1 --2- 172.21.15.26:0/86330864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2580136d80 0x7f25801c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:02.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.098+0000 7f2584c77700 1 -- 172.21.15.26:0/86330864 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f258006b250 msgr2=0x7f25801c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:02.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.098+0000 7f2584c77700 1 --2- 172.21.15.26:0/86330864 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f258006b250 0x7f25801c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.098+0000 7f2584c77700 1 -- 172.21.15.26:0/86330864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2580136d80 msgr2=0x7f25801c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:02.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.098+0000 7f2584c77700 1 --2- 172.21.15.26:0/86330864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2580136d80 0x7f25801c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.098+0000 7f2584c77700 1 -- 172.21.15.26:0/86330864 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2578009b30 con 0x7f258006a770 2023-10-01T07:58:02.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.098+0000 7f2585478700 1 --2- 172.21.15.26:0/86330864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2580136d80 0x7f25801c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:58:02.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.098+0000 7f2584c77700 1 --2- 172.21.15.26:0/86330864 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f258006a770 0x7f25801c8380 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f257400b470 tx=0x7f257400b780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:02.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.098+0000 7f257d7fa700 1 -- 172.21.15.26:0/86330864 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2574011830 con 0x7f258006a770 2023-10-01T07:58:02.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.098+0000 7f257d7fa700 1 -- 172.21.15.26:0/86330864 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25740119b0 con 0x7f258006a770 2023-10-01T07:58:02.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.099+0000 7f2586edb700 1 -- 172.21.15.26:0/86330864 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2580121360 con 0x7f258006a770 2023-10-01T07:58:02.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.099+0000 7f257d7fa700 1 -- 172.21.15.26:0/86330864 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2574011d60 con 0x7f258006a770 2023-10-01T07:58:02.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.099+0000 7f2586edb700 1 -- 172.21.15.26:0/86330864 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2580122d90 con 0x7f258006a770 2023-10-01T07:58:02.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.100+0000 7f257d7fa700 1 -- 172.21.15.26:0/86330864 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f257401a400 con 0x7f258006a770 2023-10-01T07:58:02.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.100+0000 7f257d7fa700 1 -- 172.21.15.26:0/86330864 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f257403f6d0 con 0x7f258006a770 2023-10-01T07:58:02.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.100+0000 7f2586edb700 1 -- 172.21.15.26:0/86330864 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2580074ea0 con 0x7f258006a770 2023-10-01T07:58:02.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.106+0000 7f257d7fa700 1 -- 172.21.15.26:0/86330864 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2574015030 con 0x7f258006a770 2023-10-01T07:58:02.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.140+0000 7f6185613700 1 Processor -- start 2023-10-01T07:58:02.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.141+0000 7f6185613700 1 -- start start 2023-10-01T07:58:02.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.141+0000 7f6185613700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f618009d6f0 0x7f618009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:02.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.141+0000 7f6185613700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f618009e410 0x7f6180134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:02.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.141+0000 7f6185613700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f618009b120 con 0x7f618009e000 2023-10-01T07:58:02.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.141+0000 7f6185613700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f618006b460 con 0x7f618009d6f0 2023-10-01T07:58:02.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.141+0000 7f6185613700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f618009a7e0 con 0x7f618009e410 2023-10-01T07:58:02.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.142+0000 7f617effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f618009d6f0 0x7f618009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:02.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.142+0000 7f617effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f618009d6f0 0x7f618009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58856/0 (socket says 172.21.15.26:58856) 2023-10-01T07:58:02.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.142+0000 7f617effd700 1 -- 172.21.15.26:0/968645957 learned_addr learned my addr 172.21.15.26:0/968645957 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:02.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.142+0000 7f617f7fe700 1 --2- 172.21.15.26:0/968645957 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f618009e410 0x7f6180134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:02.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.142+0000 7f617effd700 1 -- 172.21.15.26:0/968645957 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f618009e410 msgr2=0x7f6180134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:02.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.142+0000 7f617effd700 1 --2- 172.21.15.26:0/968645957 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f618009e410 0x7f6180134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.142+0000 7f617effd700 1 -- 172.21.15.26:0/968645957 >> v1:172.21.15.26:6789/0 conn(0x7f618009e000 legacy=0x7f61801339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:02.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.142+0000 7f617effd700 1 -- 172.21.15.26:0/968645957 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f618009a500 con 0x7f618009d6f0 2023-10-01T07:58:02.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.142+0000 7f617f7fe700 1 --2- 172.21.15.26:0/968645957 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f618009e410 0x7f6180134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:58:02.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.142+0000 7f617effd700 1 --2- 172.21.15.26:0/968645957 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f618009d6f0 0x7f618009dac0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f6170009920 tx=0x7f6170009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e751669b8511989 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:02.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.143+0000 7f617dffb700 1 -- 172.21.15.26:0/968645957 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617000ba60 con 0x7f618009d6f0 2023-10-01T07:58:02.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.143+0000 7f617dffb700 1 -- 172.21.15.26:0/968645957 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617000bbc0 con 0x7f618009d6f0 2023-10-01T07:58:02.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.143+0000 7f617dffb700 1 -- 172.21.15.26:0/968645957 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6170009e70 con 0x7f618009d6f0 2023-10-01T07:58:02.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.144+0000 7f6185613700 1 -- 172.21.15.26:0/968645957 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f618009d6f0 msgr2=0x7f618009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:02.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.144+0000 7f6185613700 1 --2- 172.21.15.26:0/968645957 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f618009d6f0 0x7f618009dac0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f6170009920 tx=0x7f6170009c30 comp rx=0 tx=0).stop 2023-10-01T07:58:02.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.144+0000 7f6185613700 1 -- 172.21.15.26:0/968645957 shutdown_connections 2023-10-01T07:58:02.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.144+0000 7f6185613700 1 --2- 172.21.15.26:0/968645957 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f618009e410 0x7f6180134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.144+0000 7f6185613700 1 --2- 172.21.15.26:0/968645957 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f618009d6f0 0x7f618009dac0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.144+0000 7f6185613700 1 -- 172.21.15.26:0/968645957 >> 172.21.15.26:0/968645957 conn(0x7f6180066f50 msgr2=0x7f618009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:02.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.144+0000 7f6185613700 1 -- 172.21.15.26:0/968645957 shutdown_connections 2023-10-01T07:58:02.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.144+0000 7f6185613700 1 -- 172.21.15.26:0/968645957 wait complete. 2023-10-01T07:58:02.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.145+0000 7f6185613700 1 Processor -- start 2023-10-01T07:58:02.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.146+0000 7f6185613700 1 -- start start 2023-10-01T07:58:02.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.146+0000 7f6185613700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f618009d6f0 0x7f6180122490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:02.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.146+0000 7f6185613700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f618009e000 0x7f61801229d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:02.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.146+0000 7f6185613700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f618009e410 0x7f6180122f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:02.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.146+0000 7f6185613700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6180123960 con 0x7f618009e410 2023-10-01T07:58:02.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.146+0000 7f6185613700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6180125f20 con 0x7f618009e000 2023-10-01T07:58:02.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.146+0000 7f6185613700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6180124ea0 con 0x7f618009d6f0 2023-10-01T07:58:02.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.146+0000 7f617e7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f618009e000 0x7f61801229d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:02.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.147+0000 7f617e7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f618009e000 0x7f61801229d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58868/0 (socket says 172.21.15.26:58868) 2023-10-01T07:58:02.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.147+0000 7f617e7fc700 1 -- 172.21.15.26:0/2502001705 learned_addr learned my addr 172.21.15.26:0/2502001705 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:02.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.147+0000 7f617f7fe700 1 --2- 172.21.15.26:0/2502001705 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f618009e410 0x7f6180122f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:02.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.147+0000 7f617effd700 1 --2- 172.21.15.26:0/2502001705 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f618009d6f0 0x7f6180122490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:02.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.147+0000 7f617e7fc700 1 -- 172.21.15.26:0/2502001705 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f618009d6f0 msgr2=0x7f6180122490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:02.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.147+0000 7f617e7fc700 1 --2- 172.21.15.26:0/2502001705 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f618009d6f0 0x7f6180122490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.147+0000 7f617e7fc700 1 -- 172.21.15.26:0/2502001705 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f618009e410 msgr2=0x7f6180122f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:02.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.147+0000 7f617e7fc700 1 --2- 172.21.15.26:0/2502001705 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f618009e410 0x7f6180122f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.147+0000 7f617e7fc700 1 -- 172.21.15.26:0/2502001705 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6170009550 con 0x7f618009e000 2023-10-01T07:58:02.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.148+0000 7f617e7fc700 1 --2- 172.21.15.26:0/2502001705 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f618009e000 0x7f61801229d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f617400c510 tx=0x7f617400c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:02.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.148+0000 7f61677fe700 1 -- 172.21.15.26:0/2502001705 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617400cea0 con 0x7f618009e000 2023-10-01T07:58:02.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.148+0000 7f61677fe700 1 -- 172.21.15.26:0/2502001705 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61740052d0 con 0x7f618009e000 2023-10-01T07:58:02.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.148+0000 7f6185613700 1 -- 172.21.15.26:0/2502001705 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61801337d0 con 0x7f618009e000 2023-10-01T07:58:02.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.148+0000 7f61677fe700 1 -- 172.21.15.26:0/2502001705 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6174003680 con 0x7f618009e000 2023-10-01T07:58:02.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.148+0000 7f6185613700 1 -- 172.21.15.26:0/2502001705 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f618009c760 con 0x7f618009e000 2023-10-01T07:58:02.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.149+0000 7f6185613700 1 -- 172.21.15.26:0/2502001705 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6180074ea0 con 0x7f618009e000 2023-10-01T07:58:02.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.149+0000 7f61677fe700 1 -- 172.21.15.26:0/2502001705 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f61740037e0 con 0x7f618009e000 2023-10-01T07:58:02.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.149+0000 7f61677fe700 1 -- 172.21.15.26:0/2502001705 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f617403ea40 con 0x7f618009e000 2023-10-01T07:58:02.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.159+0000 7f61677fe700 1 -- 172.21.15.26:0/2502001705 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6174011590 con 0x7f618009e000 2023-10-01T07:58:02.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.179+0000 7f8ff385f700 1 Processor -- start 2023-10-01T07:58:02.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.179+0000 7f8ff385f700 1 -- start start 2023-10-01T07:58:02.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.180+0000 7f8ff385f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8fec0a0a30 0x7f8fec0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:02.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.180+0000 7f8ff385f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fec0a1340 0x7f8fec133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:02.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.180+0000 7f8ff385f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fec133fa0 0x7f8fec134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:02.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.180+0000 7f8ff385f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fec09edd0 con 0x7f8fec0a0a30 2023-10-01T07:58:02.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.180+0000 7f8ff385f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec09e1f0 con 0x7f8fec133fa0 2023-10-01T07:58:02.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.180+0000 7f8ff385f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec09dc50 con 0x7f8fec0a1340 2023-10-01T07:58:02.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.180+0000 7f8ff15fb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8fec0a0a30 0x7f8fec0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:02.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.180+0000 7f8ff15fb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8fec0a0a30 0x7f8fec0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48122/0 (socket says 172.21.15.26:48122) 2023-10-01T07:58:02.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.180+0000 7f8ff15fb700 1 -- 172.21.15.26:0/2574918688 learned_addr learned my addr 172.21.15.26:0/2574918688 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:02.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.180+0000 7f8ff1dfc700 1 --2- 172.21.15.26:0/2574918688 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fec133fa0 0x7f8fec134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:02.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.180+0000 7f8ff0dfa700 1 --2- 172.21.15.26:0/2574918688 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fec0a1340 0x7f8fec133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:02.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.181+0000 7f8ff0dfa700 1 -- 172.21.15.26:0/2574918688 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fec133fa0 msgr2=0x7f8fec134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:02.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.181+0000 7f8ff0dfa700 1 --2- 172.21.15.26:0/2574918688 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fec133fa0 0x7f8fec134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.181+0000 7f8ff0dfa700 1 -- 172.21.15.26:0/2574918688 >> v2:172.21.15.26:3300/0 conn(0x7f8fec0a0a30 msgr2=0x7f8fec0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:02.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.181+0000 7f8ff0dfa700 1 --2- 172.21.15.26:0/2574918688 >> v2:172.21.15.26:3300/0 conn(0x7f8fec0a0a30 0x7f8fec0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.181+0000 7f8ff0dfa700 1 -- 172.21.15.26:0/2574918688 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fec0a1fe0 con 0x7f8fec0a1340 2023-10-01T07:58:02.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.181+0000 7f8ff0dfa700 1 --2- 172.21.15.26:0/2574918688 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fec0a1340 0x7f8fec133a60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc009870 tx=0x7f8fdc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2dcbc44802584716 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:02.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.181+0000 7f8fe3fff700 1 -- 172.21.15.26:0/2574918688 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc011830 con 0x7f8fec0a1340 2023-10-01T07:58:02.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.181+0000 7f8fe3fff700 1 -- 172.21.15.26:0/2574918688 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fdc011990 con 0x7f8fec0a1340 2023-10-01T07:58:02.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.181+0000 7f8fe3fff700 1 -- 172.21.15.26:0/2574918688 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc011d20 con 0x7f8fec0a1340 2023-10-01T07:58:02.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.182+0000 7f8ff385f700 1 -- 172.21.15.26:0/2574918688 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fec0a1340 msgr2=0x7f8fec133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:02.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.182+0000 7f8ff385f700 1 --2- 172.21.15.26:0/2574918688 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fec0a1340 0x7f8fec133a60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc009870 tx=0x7f8fdc009b80 comp rx=0 tx=0).stop 2023-10-01T07:58:02.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.182+0000 7f8ff385f700 1 -- 172.21.15.26:0/2574918688 shutdown_connections 2023-10-01T07:58:02.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.182+0000 7f8ff385f700 1 --2- 172.21.15.26:0/2574918688 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fec133fa0 0x7f8fec134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.182+0000 7f8ff385f700 1 --2- 172.21.15.26:0/2574918688 >> v2:172.21.15.26:3300/0 conn(0x7f8fec0a0a30 0x7f8fec0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.182+0000 7f8ff385f700 1 --2- 172.21.15.26:0/2574918688 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fec0a1340 0x7f8fec133a60 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.182+0000 7f8ff385f700 1 -- 172.21.15.26:0/2574918688 >> 172.21.15.26:0/2574918688 conn(0x7f8fec0a6550 msgr2=0x7f8fec0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:02.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.182+0000 7f8ff385f700 1 -- 172.21.15.26:0/2574918688 shutdown_connections 2023-10-01T07:58:02.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.182+0000 7f8ff385f700 1 -- 172.21.15.26:0/2574918688 wait complete. 2023-10-01T07:58:02.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.183+0000 7f8ff385f700 1 Processor -- start 2023-10-01T07:58:02.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.184+0000 7f8ff385f700 1 -- start start 2023-10-01T07:58:02.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.184+0000 7f8ff385f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8fec0a0a30 0x7f8fec121400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:02.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.184+0000 7f8ff385f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fec0a1340 0x7f8fec121940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:02.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.184+0000 7f8ff385f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fec133fa0 0x7f8fec121e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:02.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.184+0000 7f8ff385f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec122860 con 0x7f8fec0a0a30 2023-10-01T07:58:02.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.184+0000 7f8ff385f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec124ed0 con 0x7f8fec0a1340 2023-10-01T07:58:02.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.184+0000 7f8ff385f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec0a3630 con 0x7f8fec133fa0 2023-10-01T07:58:02.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.184+0000 7f8ff1dfc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fec133fa0 0x7f8fec121e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:02.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.184+0000 7f8ff1dfc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fec133fa0 0x7f8fec121e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:54306/0 (socket says 172.21.15.26:54306) 2023-10-01T07:58:02.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.184+0000 7f8ff1dfc700 1 -- 172.21.15.26:0/1203865794 learned_addr learned my addr 172.21.15.26:0/1203865794 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:02.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.184+0000 7f8ff0dfa700 1 --2- 172.21.15.26:0/1203865794 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fec0a1340 0x7f8fec121940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:02.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.185+0000 7f8ff15fb700 1 --2- 172.21.15.26:0/1203865794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8fec0a0a30 0x7f8fec121400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:02.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.185+0000 7f8ff1dfc700 1 -- 172.21.15.26:0/1203865794 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fec0a1340 msgr2=0x7f8fec121940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:02.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.185+0000 7f8ff1dfc700 1 --2- 172.21.15.26:0/1203865794 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fec0a1340 0x7f8fec121940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.185+0000 7f8ff1dfc700 1 -- 172.21.15.26:0/1203865794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8fec0a0a30 msgr2=0x7f8fec121400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:02.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.185+0000 7f8ff1dfc700 1 --2- 172.21.15.26:0/1203865794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8fec0a0a30 0x7f8fec121400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.185+0000 7f8ff1dfc700 1 -- 172.21.15.26:0/1203865794 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fdc0094a0 con 0x7f8fec133fa0 2023-10-01T07:58:02.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.185+0000 7f8ff15fb700 1 --2- 172.21.15.26:0/1203865794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8fec0a0a30 0x7f8fec121400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:58:02.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.185+0000 7f8ff1dfc700 1 --2- 172.21.15.26:0/1203865794 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fec133fa0 0x7f8fec121e80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400efc0 tx=0x7f8fe400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:02.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.185+0000 7f8fe1ffb700 1 -- 172.21.15.26:0/1203865794 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4009ea0 con 0x7f8fec133fa0 2023-10-01T07:58:02.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.185+0000 7f8fe1ffb700 1 -- 172.21.15.26:0/1203865794 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe400f040 con 0x7f8fec133fa0 2023-10-01T07:58:02.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.185+0000 7f8fe1ffb700 1 -- 172.21.15.26:0/1203865794 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4014480 con 0x7f8fec133fa0 2023-10-01T07:58:02.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.185+0000 7f8ff385f700 1 -- 172.21.15.26:0/1203865794 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fec0a0280 con 0x7f8fec133fa0 2023-10-01T07:58:02.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.186+0000 7f8ff385f700 1 -- 172.21.15.26:0/1203865794 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fec124660 con 0x7f8fec133fa0 2023-10-01T07:58:02.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.187+0000 7f8ff385f700 1 -- 172.21.15.26:0/1203865794 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fec074ea0 con 0x7f8fec133fa0 2023-10-01T07:58:02.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.188+0000 7f8fe1ffb700 1 -- 172.21.15.26:0/1203865794 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8fe40145e0 con 0x7f8fec133fa0 2023-10-01T07:58:02.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.188+0000 7f8fe1ffb700 1 -- 172.21.15.26:0/1203865794 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8fe4040080 con 0x7f8fec133fa0 2023-10-01T07:58:02.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.193+0000 7f8fe1ffb700 1 -- 172.21.15.26:0/1203865794 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8fe4071750 con 0x7f8fec133fa0 2023-10-01T07:58:02.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.226+0000 7fdc88ca9700 1 Processor -- start 2023-10-01T07:58:02.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.226+0000 7fdc88ca9700 1 -- start start 2023-10-01T07:58:02.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.226+0000 7fdc88ca9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdc8412cf60 0x7fdc8406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:02.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.226+0000 7fdc88ca9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc8412f8b0 0x7fdc8412fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:02.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.227+0000 7fdc88ca9700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc8412cd90 con 0x7fdc84130260 2023-10-01T07:58:02.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.227+0000 7fdc88ca9700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc8412d330 con 0x7fdc8412cf60 2023-10-01T07:58:02.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.227+0000 7fdc88ca9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc841306d0 con 0x7fdc8412f8b0 2023-10-01T07:58:02.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.227+0000 7fdc81d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc8412f8b0 0x7fdc8412fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:02.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.227+0000 7fdc8259c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdc8412cf60 0x7fdc8406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:02.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.227+0000 7fdc81d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc8412f8b0 0x7fdc8412fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58880/0 (socket says 172.21.15.26:58880) 2023-10-01T07:58:02.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.227+0000 7fdc81d9b700 1 -- 172.21.15.26:0/160937141 learned_addr learned my addr 172.21.15.26:0/160937141 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:02.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.227+0000 7fdc81d9b700 1 -- 172.21.15.26:0/160937141 >> v2:172.21.15.26:3300/0 conn(0x7fdc8412cf60 msgr2=0x7fdc8406f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:02.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.227+0000 7fdc81d9b700 1 --2- 172.21.15.26:0/160937141 >> v2:172.21.15.26:3300/0 conn(0x7fdc8412cf60 0x7fdc8406f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.227+0000 7fdc81d9b700 1 -- 172.21.15.26:0/160937141 >> v1:172.21.15.26:6789/0 conn(0x7fdc84130260 legacy=0x7fdc84136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:02.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.227+0000 7fdc81d9b700 1 -- 172.21.15.26:0/160937141 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc84071780 con 0x7fdc8412f8b0 2023-10-01T07:58:02.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.227+0000 7fdc81d9b700 1 --2- 172.21.15.26:0/160937141 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc8412f8b0 0x7fdc8412fd20 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fdc7800aa90 tx=0x7fdc7800ada0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b5e59d0b13c4724 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:02.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.228+0000 7fdc8159a700 1 -- 172.21.15.26:0/160937141 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7800cb70 con 0x7fdc8412f8b0 2023-10-01T07:58:02.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.228+0000 7fdc8159a700 1 -- 172.21.15.26:0/160937141 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc7800ccd0 con 0x7fdc8412f8b0 2023-10-01T07:58:02.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.228+0000 7fdc8159a700 1 -- 172.21.15.26:0/160937141 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc78018620 con 0x7fdc8412f8b0 2023-10-01T07:58:02.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.228+0000 7fdc88ca9700 1 -- 172.21.15.26:0/160937141 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc8412f8b0 msgr2=0x7fdc8412fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:02.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.229+0000 7fdc88ca9700 1 --2- 172.21.15.26:0/160937141 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc8412f8b0 0x7fdc8412fd20 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fdc7800aa90 tx=0x7fdc7800ada0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.229+0000 7fdc88ca9700 1 -- 172.21.15.26:0/160937141 shutdown_connections 2023-10-01T07:58:02.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.229+0000 7fdc88ca9700 1 --2- 172.21.15.26:0/160937141 >> v2:172.21.15.26:3300/0 conn(0x7fdc8412cf60 0x7fdc8406f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.229+0000 7fdc88ca9700 1 --2- 172.21.15.26:0/160937141 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc8412f8b0 0x7fdc8412fd20 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.229+0000 7fdc88ca9700 1 -- 172.21.15.26:0/160937141 >> 172.21.15.26:0/160937141 conn(0x7fdc840a2aa0 msgr2=0x7fdc840a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:02.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.229+0000 7fdc88ca9700 1 -- 172.21.15.26:0/160937141 shutdown_connections 2023-10-01T07:58:02.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.229+0000 7fdc88ca9700 1 -- 172.21.15.26:0/160937141 wait complete. 2023-10-01T07:58:02.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.230+0000 7fdc88ca9700 1 Processor -- start 2023-10-01T07:58:02.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.230+0000 7fdc88ca9700 1 -- start start 2023-10-01T07:58:02.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.231+0000 7fdc88ca9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc8412cf60 0x7fdc84099d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:02.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.231+0000 7fdc88ca9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc8412f8b0 0x7fdc8409a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:02.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.231+0000 7fdc88ca9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdc84130260 0x7fdc8409a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:02.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.231+0000 7fdc88ca9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc84129b20 con 0x7fdc8412f8b0 2023-10-01T07:58:02.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.231+0000 7fdc88ca9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8411fd10 con 0x7fdc8412cf60 2023-10-01T07:58:02.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.231+0000 7fdc88ca9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8411ec00 con 0x7fdc84130260 2023-10-01T07:58:02.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.231+0000 7fdc8259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc8412cf60 0x7fdc84099d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:02.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.231+0000 7fdc8259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc8412cf60 0x7fdc84099d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58894/0 (socket says 172.21.15.26:58894) 2023-10-01T07:58:02.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.231+0000 7fdc8259c700 1 -- 172.21.15.26:0/1460096422 learned_addr learned my addr 172.21.15.26:0/1460096422 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:02.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.231+0000 7fdc82d9d700 1 --2- 172.21.15.26:0/1460096422 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdc84130260 0x7fdc8409a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:02.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.231+0000 7fdc81d9b700 1 --2- 172.21.15.26:0/1460096422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc8412f8b0 0x7fdc8409a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:02.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.231+0000 7fdc8259c700 1 -- 172.21.15.26:0/1460096422 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdc84130260 msgr2=0x7fdc8409a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:02.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.231+0000 7fdc8259c700 1 --2- 172.21.15.26:0/1460096422 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdc84130260 0x7fdc8409a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.231+0000 7fdc8259c700 1 -- 172.21.15.26:0/1460096422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc8412f8b0 msgr2=0x7fdc8409a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:02.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.231+0000 7fdc8259c700 1 --2- 172.21.15.26:0/1460096422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc8412f8b0 0x7fdc8409a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.231+0000 7fdc8259c700 1 -- 172.21.15.26:0/1460096422 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc7800a6f0 con 0x7fdc8412cf60 2023-10-01T07:58:02.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.231+0000 7fdc81d9b700 1 --2- 172.21.15.26:0/1460096422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc8412f8b0 0x7fdc8409a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:58:02.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.231+0000 7fdc8259c700 1 --2- 172.21.15.26:0/1460096422 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc8412cf60 0x7fdc84099d80 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fdc7400e9e0 tx=0x7fdc7400eda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:02.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.232+0000 7fdc72ffd700 1 -- 172.21.15.26:0/1460096422 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc74009710 con 0x7fdc8412cf60 2023-10-01T07:58:02.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.232+0000 7fdc72ffd700 1 -- 172.21.15.26:0/1460096422 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc7400c850 con 0x7fdc8412cf60 2023-10-01T07:58:02.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.232+0000 7fdc88ca9700 1 -- 172.21.15.26:0/1460096422 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc8411ffd0 con 0x7fdc8412cf60 2023-10-01T07:58:02.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.232+0000 7fdc72ffd700 1 -- 172.21.15.26:0/1460096422 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7400cbc0 con 0x7fdc8412cf60 2023-10-01T07:58:02.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.232+0000 7fdc88ca9700 1 -- 172.21.15.26:0/1460096422 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc8412f540 con 0x7fdc8412cf60 2023-10-01T07:58:02.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.233+0000 7fdc88ca9700 1 -- 172.21.15.26:0/1460096422 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc8411f5f0 con 0x7fdc8412cf60 2023-10-01T07:58:02.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.233+0000 7fdc72ffd700 1 -- 172.21.15.26:0/1460096422 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdc7400cd20 con 0x7fdc8412cf60 2023-10-01T07:58:02.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.233+0000 7fdc72ffd700 1 -- 172.21.15.26:0/1460096422 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdc7403fb60 con 0x7fdc8412cf60 2023-10-01T07:58:02.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.238+0000 7fdc72ffd700 1 -- 172.21.15.26:0/1460096422 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdc7401b3b0 con 0x7fdc8412cf60 2023-10-01T07:58:02.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.357+0000 7f2586edb700 1 -- 172.21.15.26:0/86330864 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f258009f6b0 con 0x7f258006a770 2023-10-01T07:58:02.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.358+0000 7f257d7fa700 1 -- 172.21.15.26:0/86330864 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2574029090 con 0x7f258006a770 2023-10-01T07:58:02.358 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:02.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.361+0000 7f2586edb700 1 -- 172.21.15.26:0/86330864 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f258006a770 msgr2=0x7f25801c8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:02.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.361+0000 7f2586edb700 1 --2- 172.21.15.26:0/86330864 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f258006a770 0x7f25801c8380 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f257400b470 tx=0x7f257400b780 comp rx=0 tx=0).stop 2023-10-01T07:58:02.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.361+0000 7f2586edb700 1 -- 172.21.15.26:0/86330864 shutdown_connections 2023-10-01T07:58:02.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.361+0000 7f2586edb700 1 --2- 172.21.15.26:0/86330864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2580136d80 0x7f25801c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.361+0000 7f2586edb700 1 --2- 172.21.15.26:0/86330864 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f258006a770 0x7f25801c8380 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.361+0000 7f2586edb700 1 --2- 172.21.15.26:0/86330864 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f258006b250 0x7f25801c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.362+0000 7f2586edb700 1 -- 172.21.15.26:0/86330864 >> 172.21.15.26:0/86330864 conn(0x7f2580066f50 msgr2=0x7f258006f260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:02.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.363+0000 7f2586edb700 1 -- 172.21.15.26:0/86330864 shutdown_connections 2023-10-01T07:58:02.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.365+0000 7f2586edb700 1 -- 172.21.15.26:0/86330864 wait complete. 2023-10-01T07:58:02.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.377+0000 7f6185613700 1 -- 172.21.15.26:0/2502001705 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f61801257d0 con 0x7f618009e000 2023-10-01T07:58:02.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.378+0000 7f61677fe700 1 -- 172.21.15.26:0/2502001705 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f61740192c0 con 0x7f618009e000 2023-10-01T07:58:02.378 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:02.379 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:02.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.380+0000 7f6185613700 1 -- 172.21.15.26:0/2502001705 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f618009e000 msgr2=0x7f61801229d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:02.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.380+0000 7f6185613700 1 --2- 172.21.15.26:0/2502001705 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f618009e000 0x7f61801229d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f617400c510 tx=0x7f617400c820 comp rx=0 tx=0).stop 2023-10-01T07:58:02.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.380+0000 7f6185613700 1 -- 172.21.15.26:0/2502001705 shutdown_connections 2023-10-01T07:58:02.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.380+0000 7f6185613700 1 --2- 172.21.15.26:0/2502001705 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f618009e410 0x7f6180122f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.380+0000 7f6185613700 1 --2- 172.21.15.26:0/2502001705 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f618009d6f0 0x7f6180122490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.380+0000 7f6185613700 1 --2- 172.21.15.26:0/2502001705 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f618009e000 0x7f61801229d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.380+0000 7f6185613700 1 -- 172.21.15.26:0/2502001705 >> 172.21.15.26:0/2502001705 conn(0x7f6180066f50 msgr2=0x7f61800a2580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:02.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.380+0000 7f6185613700 1 -- 172.21.15.26:0/2502001705 shutdown_connections 2023-10-01T07:58:02.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.380+0000 7f6185613700 1 -- 172.21.15.26:0/2502001705 wait complete. 2023-10-01T07:58:02.395 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:02.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.415+0000 7f8ff385f700 1 -- 172.21.15.26:0/1203865794 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8fec124850 con 0x7f8fec133fa0 2023-10-01T07:58:02.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.415+0000 7f8fe1ffb700 1 -- 172.21.15.26:0/1203865794 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8fe4018030 con 0x7f8fec133fa0 2023-10-01T07:58:02.418 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:02.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.417+0000 7f8ff385f700 1 -- 172.21.15.26:0/1203865794 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fec133fa0 msgr2=0x7f8fec121e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:02.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.418+0000 7f8ff385f700 1 --2- 172.21.15.26:0/1203865794 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fec133fa0 0x7f8fec121e80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400efc0 tx=0x7f8fe400c3a0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.418+0000 7f8ff385f700 1 -- 172.21.15.26:0/1203865794 shutdown_connections 2023-10-01T07:58:02.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.418+0000 7f8ff385f700 1 --2- 172.21.15.26:0/1203865794 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fec133fa0 0x7f8fec121e80 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.418+0000 7f8ff385f700 1 --2- 172.21.15.26:0/1203865794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8fec0a0a30 0x7f8fec121400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.418+0000 7f8ff385f700 1 --2- 172.21.15.26:0/1203865794 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fec0a1340 0x7f8fec121940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.418+0000 7f8ff385f700 1 -- 172.21.15.26:0/1203865794 >> 172.21.15.26:0/1203865794 conn(0x7f8fec0a6550 msgr2=0x7f8fec0a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:02.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.418+0000 7f8ff385f700 1 -- 172.21.15.26:0/1203865794 shutdown_connections 2023-10-01T07:58:02.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.418+0000 7f8ff385f700 1 -- 172.21.15.26:0/1203865794 wait complete. 2023-10-01T07:58:02.432 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:02.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.464+0000 7fdc88ca9700 1 -- 172.21.15.26:0/1460096422 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdc84074ea0 con 0x7fdc8412cf60 2023-10-01T07:58:02.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.464+0000 7fdc72ffd700 1 -- 172.21.15.26:0/1460096422 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdc74021070 con 0x7fdc8412cf60 2023-10-01T07:58:02.465 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:02.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.466+0000 7fdc88ca9700 1 -- 172.21.15.26:0/1460096422 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc8412cf60 msgr2=0x7fdc84099d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:02.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.466+0000 7fdc88ca9700 1 --2- 172.21.15.26:0/1460096422 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc8412cf60 0x7fdc84099d80 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fdc7400e9e0 tx=0x7fdc7400eda0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.467+0000 7fdc88ca9700 1 -- 172.21.15.26:0/1460096422 shutdown_connections 2023-10-01T07:58:02.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.467+0000 7fdc88ca9700 1 --2- 172.21.15.26:0/1460096422 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdc84130260 0x7fdc8409a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.467+0000 7fdc88ca9700 1 --2- 172.21.15.26:0/1460096422 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc8412cf60 0x7fdc84099d80 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.467+0000 7fdc88ca9700 1 --2- 172.21.15.26:0/1460096422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc8412f8b0 0x7fdc8409a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:02.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.467+0000 7fdc88ca9700 1 -- 172.21.15.26:0/1460096422 >> 172.21.15.26:0/1460096422 conn(0x7fdc840a2aa0 msgr2=0x7fdc8409e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:02.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.467+0000 7fdc88ca9700 1 -- 172.21.15.26:0/1460096422 shutdown_connections 2023-10-01T07:58:02.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:02.467+0000 7fdc88ca9700 1 -- 172.21.15.26:0/1460096422 wait complete. 2023-10-01T07:58:02.480 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:03.380 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:03.395 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:03.433 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:03.481 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:03.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.530+0000 7fb858aba700 1 Processor -- start 2023-10-01T07:58:03.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.530+0000 7fb858aba700 1 -- start start 2023-10-01T07:58:03.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.531+0000 7fb858aba700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb85409d6f0 0x7fb85409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:03.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.531+0000 7fb858aba700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb85409e440 0x7fb854134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:03.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.531+0000 7fb858aba700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb85409b120 con 0x7fb85409e000 2023-10-01T07:58:03.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.531+0000 7fb858aba700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb85406b460 con 0x7fb85409d6f0 2023-10-01T07:58:03.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.531+0000 7fb858aba700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb85409a7e0 con 0x7fb85409e440 2023-10-01T07:58:03.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.531+0000 7fb85259c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb85409d6f0 0x7fb85409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:03.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.531+0000 7fb85259c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb85409d6f0 0x7fb85409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49552/0 (socket says 172.21.15.26:49552) 2023-10-01T07:58:03.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.531+0000 7fb85259c700 1 -- 172.21.15.26:0/3232956335 learned_addr learned my addr 172.21.15.26:0/3232956335 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:03.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.531+0000 7fb852d9d700 1 --2- 172.21.15.26:0/3232956335 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb85409e440 0x7fb854134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:03.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.532+0000 7fb85259c700 1 -- 172.21.15.26:0/3232956335 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb85409e440 msgr2=0x7fb854134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:03.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.532+0000 7fb85259c700 1 --2- 172.21.15.26:0/3232956335 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb85409e440 0x7fb854134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.532+0000 7fb85259c700 1 -- 172.21.15.26:0/3232956335 >> v1:172.21.15.26:6789/0 conn(0x7fb85409e000 legacy=0x7fb8541339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:03.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.532+0000 7fb85259c700 1 -- 172.21.15.26:0/3232956335 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85409a500 con 0x7fb85409d6f0 2023-10-01T07:58:03.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.532+0000 7fb85259c700 1 --2- 172.21.15.26:0/3232956335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb85409d6f0 0x7fb85409dac0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fb844009920 tx=0x7fb844009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124a9aedf6d8e736 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:03.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.532+0000 7fb85159a700 1 -- 172.21.15.26:0/3232956335 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb844004230 con 0x7fb85409d6f0 2023-10-01T07:58:03.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.532+0000 7fb85159a700 1 -- 172.21.15.26:0/3232956335 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb844004390 con 0x7fb85409d6f0 2023-10-01T07:58:03.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.532+0000 7fb85159a700 1 -- 172.21.15.26:0/3232956335 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8440036a0 con 0x7fb85409d6f0 2023-10-01T07:58:03.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.533+0000 7fb858aba700 1 -- 172.21.15.26:0/3232956335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb85409d6f0 msgr2=0x7fb85409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:03.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.533+0000 7fb858aba700 1 --2- 172.21.15.26:0/3232956335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb85409d6f0 0x7fb85409dac0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fb844009920 tx=0x7fb844009c30 comp rx=0 tx=0).stop 2023-10-01T07:58:03.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.533+0000 7fb858aba700 1 -- 172.21.15.26:0/3232956335 shutdown_connections 2023-10-01T07:58:03.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.533+0000 7fb858aba700 1 --2- 172.21.15.26:0/3232956335 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb85409e440 0x7fb854134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.533+0000 7fb858aba700 1 --2- 172.21.15.26:0/3232956335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb85409d6f0 0x7fb85409dac0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.533+0000 7fb858aba700 1 -- 172.21.15.26:0/3232956335 >> 172.21.15.26:0/3232956335 conn(0x7fb854066f50 msgr2=0x7fb85409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:03.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.533+0000 7fb858aba700 1 -- 172.21.15.26:0/3232956335 shutdown_connections 2023-10-01T07:58:03.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.533+0000 7fb858aba700 1 -- 172.21.15.26:0/3232956335 wait complete. 2023-10-01T07:58:03.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.535+0000 7fb858aba700 1 Processor -- start 2023-10-01T07:58:03.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.535+0000 7fb858aba700 1 -- start start 2023-10-01T07:58:03.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.536+0000 7fb858aba700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb85409d6f0 0x7fb8541a5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:03.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.536+0000 7fb858aba700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb85409e000 0x7fb8541a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:03.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.536+0000 7fb858aba700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb85409e440 0x7fb8541a6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:03.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.536+0000 7fb858aba700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8541a99c0 con 0x7fb85409e000 2023-10-01T07:58:03.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.536+0000 7fb858aba700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8541a7b50 con 0x7fb85409e440 2023-10-01T07:58:03.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.536+0000 7fb858aba700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8540a2260 con 0x7fb85409d6f0 2023-10-01T07:58:03.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.536+0000 7fb852d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb85409e440 0x7fb8541a6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:03.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.536+0000 7fb852d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb85409e440 0x7fb8541a6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51390/0 (socket says 172.21.15.26:51390) 2023-10-01T07:58:03.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.536+0000 7fb852d9d700 1 -- 172.21.15.26:0/177993993 learned_addr learned my addr 172.21.15.26:0/177993993 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:03.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.536+0000 7fb85259c700 1 --2- 172.21.15.26:0/177993993 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb85409d6f0 0x7fb8541a5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:03.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.536+0000 7fb851d9b700 1 --2- 172.21.15.26:0/177993993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb85409e000 0x7fb8541a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:03.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.536+0000 7fb85259c700 1 -- 172.21.15.26:0/177993993 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb85409e440 msgr2=0x7fb8541a6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:03.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.536+0000 7fb85259c700 1 --2- 172.21.15.26:0/177993993 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb85409e440 0x7fb8541a6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.536+0000 7fb85259c700 1 -- 172.21.15.26:0/177993993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb85409e000 msgr2=0x7fb8541a63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:03.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.536+0000 7fb85259c700 1 --2- 172.21.15.26:0/177993993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb85409e000 0x7fb8541a63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.536+0000 7fb85259c700 1 -- 172.21.15.26:0/177993993 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb844009550 con 0x7fb85409d6f0 2023-10-01T07:58:03.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.536+0000 7fb852d9d700 1 --2- 172.21.15.26:0/177993993 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb85409e440 0x7fb8541a6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:03.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.537+0000 7fb85259c700 1 --2- 172.21.15.26:0/177993993 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb85409d6f0 0x7fb8541a5ea0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb844015000 tx=0x7fb844004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:03.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.537+0000 7fb842ffd700 1 -- 172.21.15.26:0/177993993 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb844003ba0 con 0x7fb85409d6f0 2023-10-01T07:58:03.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.537+0000 7fb842ffd700 1 -- 172.21.15.26:0/177993993 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84401f070 con 0x7fb85409d6f0 2023-10-01T07:58:03.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.537+0000 7fb842ffd700 1 -- 172.21.15.26:0/177993993 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb844011630 con 0x7fb85409d6f0 2023-10-01T07:58:03.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.537+0000 7fb858aba700 1 -- 172.21.15.26:0/177993993 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb85409c710 con 0x7fb85409d6f0 2023-10-01T07:58:03.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.537+0000 7fb858aba700 1 -- 172.21.15.26:0/177993993 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8541a88b0 con 0x7fb85409d6f0 2023-10-01T07:58:03.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.538+0000 7fb858aba700 1 -- 172.21.15.26:0/177993993 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb854074ea0 con 0x7fb85409d6f0 2023-10-01T07:58:03.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.539+0000 7fb842ffd700 1 -- 172.21.15.26:0/177993993 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb844021030 con 0x7fb85409d6f0 2023-10-01T07:58:03.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.539+0000 7fb842ffd700 1 -- 172.21.15.26:0/177993993 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb844041190 con 0x7fb85409d6f0 2023-10-01T07:58:03.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.544+0000 7fb842ffd700 1 -- 172.21.15.26:0/177993993 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb844011790 con 0x7fb85409d6f0 2023-10-01T07:58:03.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.583+0000 7f696d11d700 1 Processor -- start 2023-10-01T07:58:03.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.583+0000 7f696d11d700 1 -- start start 2023-10-01T07:58:03.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.583+0000 7f696d11d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f69681316c0 0x7f6968131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:03.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.583+0000 7f696d11d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f696809d9f0 0x7f696806a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:03.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.584+0000 7f696d11d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f696806acb0 0x7f696806b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:03.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.584+0000 7f696d11d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f696809e130 con 0x7f696806acb0 2023-10-01T07:58:03.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.584+0000 7f696d11d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69681312b0 con 0x7f696809d9f0 2023-10-01T07:58:03.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.584+0000 7f696d11d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f696809f6e0 con 0x7f69681316c0 2023-10-01T07:58:03.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.584+0000 7f6966d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f69681316c0 0x7f6968131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:03.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.584+0000 7f6966d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f69681316c0 0x7f6968131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:33576/0 (socket says 172.21.15.26:33576) 2023-10-01T07:58:03.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.584+0000 7f6966d9d700 1 -- 172.21.15.26:0/15461976 learned_addr learned my addr 172.21.15.26:0/15461976 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:03.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.584+0000 7f696659c700 1 --2- 172.21.15.26:0/15461976 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f696809d9f0 0x7f696806a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:03.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.584+0000 7f696759e700 1 --2- 172.21.15.26:0/15461976 >> v2:172.21.15.26:3300/0 conn(0x7f696806acb0 0x7f696806b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:03.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.584+0000 7f696659c700 1 -- 172.21.15.26:0/15461976 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f69681316c0 msgr2=0x7f6968131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:03.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.584+0000 7f696659c700 1 --2- 172.21.15.26:0/15461976 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f69681316c0 0x7f6968131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.584+0000 7f696659c700 1 -- 172.21.15.26:0/15461976 >> v2:172.21.15.26:3300/0 conn(0x7f696806acb0 msgr2=0x7f696806b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:03.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.584+0000 7f696659c700 1 --2- 172.21.15.26:0/15461976 >> v2:172.21.15.26:3300/0 conn(0x7f696806acb0 0x7f696806b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.584+0000 7f696659c700 1 -- 172.21.15.26:0/15461976 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696809e760 con 0x7f696809d9f0 2023-10-01T07:58:03.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.584+0000 7f6966d9d700 1 --2- 172.21.15.26:0/15461976 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f69681316c0 0x7f6968131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:03.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.584+0000 7f696659c700 1 --2- 172.21.15.26:0/15461976 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f696809d9f0 0x7f696806a770 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f695c009840 tx=0x7f695c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f4dde3585384fc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:03.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.585+0000 7f6965d9b700 1 -- 172.21.15.26:0/15461976 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c011830 con 0x7f696809d9f0 2023-10-01T07:58:03.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.585+0000 7f6965d9b700 1 -- 172.21.15.26:0/15461976 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695c011990 con 0x7f696809d9f0 2023-10-01T07:58:03.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.585+0000 7f6965d9b700 1 -- 172.21.15.26:0/15461976 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c011d20 con 0x7f696809d9f0 2023-10-01T07:58:03.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.586+0000 7f696d11d700 1 -- 172.21.15.26:0/15461976 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f696809d9f0 msgr2=0x7f696806a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:03.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.586+0000 7f696d11d700 1 --2- 172.21.15.26:0/15461976 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f696809d9f0 0x7f696806a770 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f695c009840 tx=0x7f695c009b50 comp rx=0 tx=0).stop 2023-10-01T07:58:03.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.586+0000 7f696d11d700 1 -- 172.21.15.26:0/15461976 shutdown_connections 2023-10-01T07:58:03.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.586+0000 7f696d11d700 1 --2- 172.21.15.26:0/15461976 >> v2:172.21.15.26:3300/0 conn(0x7f696806acb0 0x7f696806b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.586+0000 7f696d11d700 1 --2- 172.21.15.26:0/15461976 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f69681316c0 0x7f6968131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.586+0000 7f696d11d700 1 --2- 172.21.15.26:0/15461976 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f696809d9f0 0x7f696806a770 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.586+0000 7f696d11d700 1 -- 172.21.15.26:0/15461976 >> 172.21.15.26:0/15461976 conn(0x7f6968066f50 msgr2=0x7f696809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:03.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.586+0000 7f696d11d700 1 -- 172.21.15.26:0/15461976 shutdown_connections 2023-10-01T07:58:03.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.586+0000 7f696d11d700 1 -- 172.21.15.26:0/15461976 wait complete. 2023-10-01T07:58:03.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.588+0000 7f696d11d700 1 Processor -- start 2023-10-01T07:58:03.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.588+0000 7f696d11d700 1 -- start start 2023-10-01T07:58:03.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.589+0000 7f696d11d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f696806acb0 0x7f6968070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:03.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.589+0000 7f696d11d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f696809d9f0 0x7f69680711f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:03.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.589+0000 7f696d11d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69681316c0 0x7f6968071730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:03.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.589+0000 7f696d11d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696812b970 con 0x7f696809d9f0 2023-10-01T07:58:03.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.589+0000 7f696d11d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69681283e0 con 0x7f69681316c0 2023-10-01T07:58:03.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.589+0000 7f696d11d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f696809bbb0 con 0x7f696806acb0 2023-10-01T07:58:03.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.589+0000 7f696659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f696809d9f0 0x7f69680711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:03.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.589+0000 7f696759e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69681316c0 0x7f6968071730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:03.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.589+0000 7f696759e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69681316c0 0x7f6968071730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51406/0 (socket says 172.21.15.26:51406) 2023-10-01T07:58:03.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.589+0000 7f696759e700 1 -- 172.21.15.26:0/1243876779 learned_addr learned my addr 172.21.15.26:0/1243876779 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:03.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.589+0000 7f696659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f696809d9f0 0x7f69680711f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49558/0 (socket says 172.21.15.26:49558) 2023-10-01T07:58:03.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.589+0000 7f6966d9d700 1 --2- 172.21.15.26:0/1243876779 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f696806acb0 0x7f6968070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:03.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.589+0000 7f696759e700 1 -- 172.21.15.26:0/1243876779 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f696806acb0 msgr2=0x7f6968070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:03.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.589+0000 7f696759e700 1 --2- 172.21.15.26:0/1243876779 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f696806acb0 0x7f6968070cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.589+0000 7f696759e700 1 -- 172.21.15.26:0/1243876779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f696809d9f0 msgr2=0x7f69680711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:03.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.589+0000 7f696759e700 1 --2- 172.21.15.26:0/1243876779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f696809d9f0 0x7f69680711f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.589+0000 7f696759e700 1 -- 172.21.15.26:0/1243876779 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6958009550 con 0x7f69681316c0 2023-10-01T07:58:03.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.590+0000 7f696759e700 1 --2- 172.21.15.26:0/1243876779 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69681316c0 0x7f6968071730 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f696000efc0 tx=0x7f696000c0c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:03.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.590+0000 7f694f7fe700 1 -- 172.21.15.26:0/1243876779 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696000cad0 con 0x7f69681316c0 2023-10-01T07:58:03.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.590+0000 7f694f7fe700 1 -- 172.21.15.26:0/1243876779 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696000f040 con 0x7f69681316c0 2023-10-01T07:58:03.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.590+0000 7f694f7fe700 1 -- 172.21.15.26:0/1243876779 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696000ce70 con 0x7f69681316c0 2023-10-01T07:58:03.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.590+0000 7f696d11d700 1 -- 172.21.15.26:0/1243876779 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f695c0094a0 con 0x7f69681316c0 2023-10-01T07:58:03.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.590+0000 7f696d11d700 1 -- 172.21.15.26:0/1243876779 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f696809a540 con 0x7f69681316c0 2023-10-01T07:58:03.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.591+0000 7f694f7fe700 1 -- 172.21.15.26:0/1243876779 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6960014480 con 0x7f69681316c0 2023-10-01T07:58:03.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.591+0000 7f696d11d700 1 -- 172.21.15.26:0/1243876779 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f696809bdd0 con 0x7f69681316c0 2023-10-01T07:58:03.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.592+0000 7f694f7fe700 1 -- 172.21.15.26:0/1243876779 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6960012740 con 0x7f69681316c0 2023-10-01T07:58:03.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.597+0000 7f694f7fe700 1 -- 172.21.15.26:0/1243876779 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6960045060 con 0x7f69681316c0 2023-10-01T07:58:03.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.628+0000 7fe2246e7700 1 Processor -- start 2023-10-01T07:58:03.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.628+0000 7fe2246e7700 1 -- start start 2023-10-01T07:58:03.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.629+0000 7fe2246e7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe21c133420 0x7fe21c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:03.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.629+0000 7fe2246e7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe21c133e30 0x7fe21c12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:03.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.629+0000 7fe2246e7700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe21c06b990 con 0x7fe21c134260 2023-10-01T07:58:03.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.629+0000 7fe2246e7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe21c0a0590 con 0x7fe21c133420 2023-10-01T07:58:03.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.629+0000 7fe2246e7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c09fb80 con 0x7fe21c133e30 2023-10-01T07:58:03.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.630+0000 7fe222483700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe21c133420 0x7fe21c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:03.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.630+0000 7fe222483700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe21c133420 0x7fe21c1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49566/0 (socket says 172.21.15.26:49566) 2023-10-01T07:58:03.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.630+0000 7fe222483700 1 -- 172.21.15.26:0/3651709310 learned_addr learned my addr 172.21.15.26:0/3651709310 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:03.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.630+0000 7fe221c82700 1 --2- 172.21.15.26:0/3651709310 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe21c133e30 0x7fe21c12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:03.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.630+0000 7fe221c82700 1 -- 172.21.15.26:0/3651709310 >> v2:172.21.15.26:3300/0 conn(0x7fe21c133420 msgr2=0x7fe21c1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:03.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.630+0000 7fe221c82700 1 --2- 172.21.15.26:0/3651709310 >> v2:172.21.15.26:3300/0 conn(0x7fe21c133420 0x7fe21c1337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.630+0000 7fe221c82700 1 -- 172.21.15.26:0/3651709310 >> v1:172.21.15.26:6789/0 conn(0x7fe21c134260 legacy=0x7fe21c1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:03.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.630+0000 7fe221c82700 1 -- 172.21.15.26:0/3651709310 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe21c0a0030 con 0x7fe21c133e30 2023-10-01T07:58:03.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.630+0000 7fe221c82700 1 --2- 172.21.15.26:0/3651709310 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe21c133e30 0x7fe21c12ff90 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe20c009840 tx=0x7fe20c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a15f932a8e13948 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:03.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.631+0000 7fe221481700 1 -- 172.21.15.26:0/3651709310 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20c011830 con 0x7fe21c133e30 2023-10-01T07:58:03.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.631+0000 7fe221481700 1 -- 172.21.15.26:0/3651709310 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe20c011990 con 0x7fe21c133e30 2023-10-01T07:58:03.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.631+0000 7fe221481700 1 -- 172.21.15.26:0/3651709310 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20c011d20 con 0x7fe21c133e30 2023-10-01T07:58:03.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.632+0000 7fe2246e7700 1 -- 172.21.15.26:0/3651709310 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe21c133e30 msgr2=0x7fe21c12ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:03.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.632+0000 7fe2246e7700 1 --2- 172.21.15.26:0/3651709310 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe21c133e30 0x7fe21c12ff90 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe20c009840 tx=0x7fe20c009b50 comp rx=0 tx=0).stop 2023-10-01T07:58:03.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.632+0000 7fe2246e7700 1 -- 172.21.15.26:0/3651709310 shutdown_connections 2023-10-01T07:58:03.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.632+0000 7fe2246e7700 1 --2- 172.21.15.26:0/3651709310 >> v2:172.21.15.26:3300/0 conn(0x7fe21c133420 0x7fe21c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.632+0000 7fe2246e7700 1 --2- 172.21.15.26:0/3651709310 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe21c133e30 0x7fe21c12ff90 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.632+0000 7fe2246e7700 1 -- 172.21.15.26:0/3651709310 >> 172.21.15.26:0/3651709310 conn(0x7fe21c0a4210 msgr2=0x7fe21c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:03.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.632+0000 7fe2246e7700 1 -- 172.21.15.26:0/3651709310 shutdown_connections 2023-10-01T07:58:03.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.632+0000 7fe2246e7700 1 -- 172.21.15.26:0/3651709310 wait complete. 2023-10-01T07:58:03.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.633+0000 7fe2246e7700 1 Processor -- start 2023-10-01T07:58:03.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.633+0000 7fe2246e7700 1 -- start start 2023-10-01T07:58:03.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.634+0000 7fe2246e7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe21c133420 0x7fe21c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:03.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.634+0000 7fe2246e7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe21c133e30 0x7fe21c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:03.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.634+0000 7fe2246e7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe21c134260 0x7fe21c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:03.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.634+0000 7fe2246e7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c09dfa0 con 0x7fe21c134260 2023-10-01T07:58:03.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.634+0000 7fe2246e7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c12d650 con 0x7fe21c133420 2023-10-01T07:58:03.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.634+0000 7fe2246e7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c11ff40 con 0x7fe21c133e30 2023-10-01T07:58:03.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.634+0000 7fe222483700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe21c133420 0x7fe21c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:03.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.634+0000 7fe222483700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe21c133420 0x7fe21c09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51420/0 (socket says 172.21.15.26:51420) 2023-10-01T07:58:03.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.634+0000 7fe222483700 1 -- 172.21.15.26:0/3699537046 learned_addr learned my addr 172.21.15.26:0/3699537046 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:03.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.634+0000 7fe222c84700 1 --2- 172.21.15.26:0/3699537046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe21c134260 0x7fe21c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:03.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.635+0000 7fe222483700 1 -- 172.21.15.26:0/3699537046 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe21c133e30 msgr2=0x7fe21c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:03.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.635+0000 7fe222483700 1 --2- 172.21.15.26:0/3699537046 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe21c133e30 0x7fe21c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.635+0000 7fe222483700 1 -- 172.21.15.26:0/3699537046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe21c134260 msgr2=0x7fe21c09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:03.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.635+0000 7fe222483700 1 --2- 172.21.15.26:0/3699537046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe21c134260 0x7fe21c09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.635+0000 7fe222483700 1 -- 172.21.15.26:0/3699537046 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe20c0094a0 con 0x7fe21c133420 2023-10-01T07:58:03.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.635+0000 7fe222c84700 1 --2- 172.21.15.26:0/3699537046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe21c134260 0x7fe21c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:58:03.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.635+0000 7fe222483700 1 --2- 172.21.15.26:0/3699537046 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe21c133420 0x7fe21c09c480 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe21800e910 tx=0x7fe21800ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:03.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.635+0000 7fe212ffd700 1 -- 172.21.15.26:0/3699537046 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2180096a0 con 0x7fe21c133420 2023-10-01T07:58:03.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.635+0000 7fe212ffd700 1 -- 172.21.15.26:0/3699537046 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe21800c850 con 0x7fe21c133420 2023-10-01T07:58:03.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.635+0000 7fe2246e7700 1 -- 172.21.15.26:0/3699537046 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe21c11ea90 con 0x7fe21c133420 2023-10-01T07:58:03.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.635+0000 7fe212ffd700 1 -- 172.21.15.26:0/3699537046 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21800cc00 con 0x7fe21c133420 2023-10-01T07:58:03.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.635+0000 7fe2246e7700 1 -- 172.21.15.26:0/3699537046 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe21c120720 con 0x7fe21c133420 2023-10-01T07:58:03.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.636+0000 7fe212ffd700 1 -- 172.21.15.26:0/3699537046 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe21800cd60 con 0x7fe21c133420 2023-10-01T07:58:03.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.636+0000 7fe212ffd700 1 -- 172.21.15.26:0/3699537046 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe21803f790 con 0x7fe21c133420 2023-10-01T07:58:03.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.637+0000 7fe2246e7700 1 -- 172.21.15.26:0/3699537046 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe21c074ea0 con 0x7fe21c133420 2023-10-01T07:58:03.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.644+0000 7fe212ffd700 1 -- 172.21.15.26:0/3699537046 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe218017080 con 0x7fe21c133420 2023-10-01T07:58:03.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.669+0000 7fd66c18c700 1 Processor -- start 2023-10-01T07:58:03.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.670+0000 7fd66c18c700 1 -- start start 2023-10-01T07:58:03.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.670+0000 7fd66c18c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd66409d6f0 0x7fd66409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:03.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.670+0000 7fd66c18c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd66409e000 0x7fd6641339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:03.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.670+0000 7fd66c18c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd66409b120 con 0x7fd66409e410 2023-10-01T07:58:03.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.670+0000 7fd66c18c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd66406b460 con 0x7fd66409e000 2023-10-01T07:58:03.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.670+0000 7fd66c18c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd66409a7e0 con 0x7fd66409d6f0 2023-10-01T07:58:03.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.671+0000 7fd66a729700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd66409e410 0x7fd664133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46422/0 (socket says 172.21.15.26:46422) 2023-10-01T07:58:03.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.671+0000 7fd66a729700 1 -- 172.21.15.26:0/2629448248 learned_addr learned my addr 172.21.15.26:0/2629448248 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:03.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.671+0000 7fd669727700 1 --2- 172.21.15.26:0/2629448248 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd66409e000 0x7fd6641339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:03.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.671+0000 7fd669f28700 1 --2- 172.21.15.26:0/2629448248 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd66409d6f0 0x7fd66409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:03.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.671+0000 7fd669727700 1 -- 172.21.15.26:0/2629448248 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd66409d6f0 msgr2=0x7fd66409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:03.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.671+0000 7fd669727700 1 --2- 172.21.15.26:0/2629448248 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd66409d6f0 0x7fd66409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.671+0000 7fd669727700 1 -- 172.21.15.26:0/2629448248 >> v1:172.21.15.26:6789/0 conn(0x7fd66409e410 legacy=0x7fd664133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:03.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.671+0000 7fd669727700 1 -- 172.21.15.26:0/2629448248 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd66409a500 con 0x7fd66409e000 2023-10-01T07:58:03.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.671+0000 7fd668f26700 1 -- 172.21.15.26:0/2629448248 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 511548026 0 0) 0x7fd66409b120 con 0x7fd66409e410 2023-10-01T07:58:03.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.671+0000 7fd669f28700 1 --2- 172.21.15.26:0/2629448248 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd66409d6f0 0x7fd66409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:58:03.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.671+0000 7fd669727700 1 --2- 172.21.15.26:0/2629448248 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd66409e000 0x7fd6641339f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd654009870 tx=0x7fd654009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b27b19d995d289a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:03.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.671+0000 7fd668f26700 1 -- 172.21.15.26:0/2629448248 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd654011830 con 0x7fd66409e000 2023-10-01T07:58:03.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.672+0000 7fd668f26700 1 -- 172.21.15.26:0/2629448248 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd654011990 con 0x7fd66409e000 2023-10-01T07:58:03.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.672+0000 7fd668f26700 1 -- 172.21.15.26:0/2629448248 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd654011d20 con 0x7fd66409e000 2023-10-01T07:58:03.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.672+0000 7fd66c18c700 1 -- 172.21.15.26:0/2629448248 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd66409e000 msgr2=0x7fd6641339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:03.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.672+0000 7fd66c18c700 1 --2- 172.21.15.26:0/2629448248 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd66409e000 0x7fd6641339f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd654009870 tx=0x7fd654009b80 comp rx=0 tx=0).stop 2023-10-01T07:58:03.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.672+0000 7fd66c18c700 1 -- 172.21.15.26:0/2629448248 shutdown_connections 2023-10-01T07:58:03.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.672+0000 7fd66c18c700 1 --2- 172.21.15.26:0/2629448248 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd66409d6f0 0x7fd66409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.672+0000 7fd66c18c700 1 --2- 172.21.15.26:0/2629448248 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd66409e000 0x7fd6641339f0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.672+0000 7fd66c18c700 1 -- 172.21.15.26:0/2629448248 >> 172.21.15.26:0/2629448248 conn(0x7fd664066f50 msgr2=0x7fd66409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:03.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.673+0000 7fd66c18c700 1 -- 172.21.15.26:0/2629448248 shutdown_connections 2023-10-01T07:58:03.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.673+0000 7fd66c18c700 1 -- 172.21.15.26:0/2629448248 wait complete. 2023-10-01T07:58:03.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.674+0000 7fd66c18c700 1 Processor -- start 2023-10-01T07:58:03.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.674+0000 7fd66c18c700 1 -- start start 2023-10-01T07:58:03.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.675+0000 7fd66c18c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd66409d6f0 0x7fd664122410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:03.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.675+0000 7fd66c18c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd66409e000 0x7fd664122950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:03.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.675+0000 7fd66c18c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd66409e410 0x7fd664122e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:03.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.675+0000 7fd66c18c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd664125940 con 0x7fd66409e410 2023-10-01T07:58:03.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.675+0000 7fd66c18c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd664124dd0 con 0x7fd66409e000 2023-10-01T07:58:03.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.675+0000 7fd66c18c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd66409c710 con 0x7fd66409d6f0 2023-10-01T07:58:03.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.675+0000 7fd669f28700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd66409d6f0 0x7fd664122410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:03.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.675+0000 7fd669f28700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd66409d6f0 0x7fd664122410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:33604/0 (socket says 172.21.15.26:33604) 2023-10-01T07:58:03.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.675+0000 7fd669f28700 1 -- 172.21.15.26:0/2247837980 learned_addr learned my addr 172.21.15.26:0/2247837980 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:03.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.675+0000 7fd669727700 1 --2- 172.21.15.26:0/2247837980 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd66409e000 0x7fd664122950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:03.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.675+0000 7fd66a729700 1 --2- 172.21.15.26:0/2247837980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd66409e410 0x7fd664122e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:03.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.675+0000 7fd669727700 1 -- 172.21.15.26:0/2247837980 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd66409d6f0 msgr2=0x7fd664122410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:03.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.675+0000 7fd669727700 1 --2- 172.21.15.26:0/2247837980 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd66409d6f0 0x7fd664122410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.675+0000 7fd669727700 1 -- 172.21.15.26:0/2247837980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd66409e410 msgr2=0x7fd664122e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:03.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.675+0000 7fd669727700 1 --2- 172.21.15.26:0/2247837980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd66409e410 0x7fd664122e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.675+0000 7fd669727700 1 -- 172.21.15.26:0/2247837980 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6540094a0 con 0x7fd66409e000 2023-10-01T07:58:03.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.676+0000 7fd66a729700 1 --2- 172.21.15.26:0/2247837980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd66409e410 0x7fd664122e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:58:03.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.676+0000 7fd669727700 1 --2- 172.21.15.26:0/2247837980 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd66409e000 0x7fd664122950 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd66406e510 tx=0x7fd654004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:03.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.676+0000 7fd65a7fc700 1 -- 172.21.15.26:0/2247837980 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd654004590 con 0x7fd66409e000 2023-10-01T07:58:03.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.676+0000 7fd65a7fc700 1 -- 172.21.15.26:0/2247837980 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd65401f070 con 0x7fd66409e000 2023-10-01T07:58:03.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.676+0000 7fd66c18c700 1 -- 172.21.15.26:0/2247837980 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6641255e0 con 0x7fd66409e000 2023-10-01T07:58:03.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.676+0000 7fd65a7fc700 1 -- 172.21.15.26:0/2247837980 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6540038c0 con 0x7fd66409e000 2023-10-01T07:58:03.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.676+0000 7fd66c18c700 1 -- 172.21.15.26:0/2247837980 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd664126350 con 0x7fd66409e000 2023-10-01T07:58:03.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.677+0000 7fd66c18c700 1 -- 172.21.15.26:0/2247837980 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd664074ea0 con 0x7fd66409e000 2023-10-01T07:58:03.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.678+0000 7fd65a7fc700 1 -- 172.21.15.26:0/2247837980 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd654003a20 con 0x7fd66409e000 2023-10-01T07:58:03.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.678+0000 7fd65a7fc700 1 -- 172.21.15.26:0/2247837980 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd654021070 con 0x7fd66409e000 2023-10-01T07:58:03.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.683+0000 7fd65a7fc700 1 -- 172.21.15.26:0/2247837980 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd65400bdf0 con 0x7fd66409e000 2023-10-01T07:58:03.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.773+0000 7fb858aba700 1 -- 172.21.15.26:0/177993993 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb854074ea0 con 0x7fb85409d6f0 2023-10-01T07:58:03.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.774+0000 7fb842ffd700 1 -- 172.21.15.26:0/177993993 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb844010380 con 0x7fb85409d6f0 2023-10-01T07:58:03.774 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:03.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.776+0000 7fb858aba700 1 -- 172.21.15.26:0/177993993 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb85409d6f0 msgr2=0x7fb8541a5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:03.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.776+0000 7fb858aba700 1 --2- 172.21.15.26:0/177993993 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb85409d6f0 0x7fb8541a5ea0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb844015000 tx=0x7fb844004750 comp rx=0 tx=0).stop 2023-10-01T07:58:03.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.776+0000 7fb858aba700 1 -- 172.21.15.26:0/177993993 shutdown_connections 2023-10-01T07:58:03.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.776+0000 7fb858aba700 1 --2- 172.21.15.26:0/177993993 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb85409e440 0x7fb8541a6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.776+0000 7fb858aba700 1 --2- 172.21.15.26:0/177993993 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb85409d6f0 0x7fb8541a5ea0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.776+0000 7fb858aba700 1 --2- 172.21.15.26:0/177993993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb85409e000 0x7fb8541a63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.776+0000 7fb858aba700 1 -- 172.21.15.26:0/177993993 >> 172.21.15.26:0/177993993 conn(0x7fb854066f50 msgr2=0x7fb8540a2690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:03.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.777+0000 7fb858aba700 1 -- 172.21.15.26:0/177993993 shutdown_connections 2023-10-01T07:58:03.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.777+0000 7fb858aba700 1 -- 172.21.15.26:0/177993993 wait complete. 2023-10-01T07:58:03.791 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:03.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.813+0000 7f696d11d700 1 -- 172.21.15.26:0/1243876779 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f696809b9a0 con 0x7f69681316c0 2023-10-01T07:58:03.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.813+0000 7f694f7fe700 1 -- 172.21.15.26:0/1243876779 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6960018090 con 0x7f69681316c0 2023-10-01T07:58:03.814 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:03.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.816+0000 7f696d11d700 1 -- 172.21.15.26:0/1243876779 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69681316c0 msgr2=0x7f6968071730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:03.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.816+0000 7f696d11d700 1 --2- 172.21.15.26:0/1243876779 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69681316c0 0x7f6968071730 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f696000efc0 tx=0x7f696000c0c0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.816+0000 7f696d11d700 1 -- 172.21.15.26:0/1243876779 shutdown_connections 2023-10-01T07:58:03.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.816+0000 7f696d11d700 1 --2- 172.21.15.26:0/1243876779 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69681316c0 0x7f6968071730 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.816+0000 7f696d11d700 1 --2- 172.21.15.26:0/1243876779 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f696806acb0 0x7f6968070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.816+0000 7f696d11d700 1 --2- 172.21.15.26:0/1243876779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f696809d9f0 0x7f69680711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.816+0000 7f696d11d700 1 -- 172.21.15.26:0/1243876779 >> 172.21.15.26:0/1243876779 conn(0x7f6968066f50 msgr2=0x7f69680a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:03.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.816+0000 7f696d11d700 1 -- 172.21.15.26:0/1243876779 shutdown_connections 2023-10-01T07:58:03.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.816+0000 7f696d11d700 1 -- 172.21.15.26:0/1243876779 wait complete. 2023-10-01T07:58:03.830 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:03.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.860+0000 7fe2246e7700 1 -- 172.21.15.26:0/3699537046 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe21c1209d0 con 0x7fe21c133420 2023-10-01T07:58:03.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.861+0000 7fe212ffd700 1 -- 172.21.15.26:0/3699537046 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe2180232f0 con 0x7fe21c133420 2023-10-01T07:58:03.861 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:03.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.863+0000 7fe2246e7700 1 -- 172.21.15.26:0/3699537046 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe21c133420 msgr2=0x7fe21c09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:03.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.863+0000 7fe2246e7700 1 --2- 172.21.15.26:0/3699537046 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe21c133420 0x7fe21c09c480 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe21800e910 tx=0x7fe21800ecd0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.863+0000 7fe2246e7700 1 -- 172.21.15.26:0/3699537046 shutdown_connections 2023-10-01T07:58:03.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.863+0000 7fe2246e7700 1 --2- 172.21.15.26:0/3699537046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe21c134260 0x7fe21c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.863+0000 7fe2246e7700 1 --2- 172.21.15.26:0/3699537046 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe21c133420 0x7fe21c09c480 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.863+0000 7fe2246e7700 1 --2- 172.21.15.26:0/3699537046 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe21c133e30 0x7fe21c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.863+0000 7fe2246e7700 1 -- 172.21.15.26:0/3699537046 >> 172.21.15.26:0/3699537046 conn(0x7fe21c0a4210 msgr2=0x7fe21c0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:03.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.863+0000 7fe2246e7700 1 -- 172.21.15.26:0/3699537046 shutdown_connections 2023-10-01T07:58:03.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.863+0000 7fe2246e7700 1 -- 172.21.15.26:0/3699537046 wait complete. 2023-10-01T07:58:03.877 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:03.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.889+0000 7fd66c18c700 1 -- 172.21.15.26:0/2247837980 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd664072110 con 0x7fd66409e000 2023-10-01T07:58:03.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.890+0000 7fd65a7fc700 1 -- 172.21.15.26:0/2247837980 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd65402b070 con 0x7fd66409e000 2023-10-01T07:58:03.890 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:03.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.892+0000 7fd66c18c700 1 -- 172.21.15.26:0/2247837980 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd66409e000 msgr2=0x7fd664122950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:03.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.892+0000 7fd66c18c700 1 --2- 172.21.15.26:0/2247837980 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd66409e000 0x7fd664122950 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd66406e510 tx=0x7fd654004750 comp rx=0 tx=0).stop 2023-10-01T07:58:03.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.892+0000 7fd66c18c700 1 -- 172.21.15.26:0/2247837980 shutdown_connections 2023-10-01T07:58:03.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.892+0000 7fd66c18c700 1 --2- 172.21.15.26:0/2247837980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd66409e410 0x7fd664122e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.892+0000 7fd66c18c700 1 --2- 172.21.15.26:0/2247837980 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd66409d6f0 0x7fd664122410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.892+0000 7fd66c18c700 1 --2- 172.21.15.26:0/2247837980 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd66409e000 0x7fd664122950 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:03.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.892+0000 7fd66c18c700 1 -- 172.21.15.26:0/2247837980 >> 172.21.15.26:0/2247837980 conn(0x7fd664066f50 msgr2=0x7fd664070ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:03.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.892+0000 7fd66c18c700 1 -- 172.21.15.26:0/2247837980 shutdown_connections 2023-10-01T07:58:03.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:03.892+0000 7fd66c18c700 1 -- 172.21.15.26:0/2247837980 wait complete. 2023-10-01T07:58:03.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:04.792 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:04.831 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:04.878 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:04.907 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:04.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.952+0000 7f43b3e82700 1 Processor -- start 2023-10-01T07:58:04.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.952+0000 7f43b3e82700 1 -- start start 2023-10-01T07:58:04.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.953+0000 7f43b3e82700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43ac071b40 0x7f43ac130420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:04.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.953+0000 7f43b3e82700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f43ac130960 0x7f43ac133570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:04.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.953+0000 7f43b3e82700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f43ac130d50 0x7f43ac133ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:04.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.953+0000 7f43b3e82700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43ac099ef0 con 0x7f43ac130d50 2023-10-01T07:58:04.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.953+0000 7f43b3e82700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac099500 con 0x7f43ac071b40 2023-10-01T07:58:04.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.953+0000 7f43b3e82700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac099c10 con 0x7f43ac130960 2023-10-01T07:58:04.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.953+0000 7f43b1c1e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43ac071b40 0x7f43ac130420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:04.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.953+0000 7f43b1c1e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43ac071b40 0x7f43ac130420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51436/0 (socket says 172.21.15.26:51436) 2023-10-01T07:58:04.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.953+0000 7f43b1c1e700 1 -- 172.21.15.26:0/3302117971 learned_addr learned my addr 172.21.15.26:0/3302117971 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:04.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.953+0000 7f43b1c1e700 1 -- 172.21.15.26:0/3302117971 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f43ac130960 msgr2=0x7f43ac133570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:04.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.953+0000 7f43b1c1e700 1 --2- 172.21.15.26:0/3302117971 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f43ac130960 0x7f43ac133570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:04.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.953+0000 7f43b1c1e700 1 -- 172.21.15.26:0/3302117971 >> v2:172.21.15.26:3300/0 conn(0x7f43ac130d50 msgr2=0x7f43ac133ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:04.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.953+0000 7f43b1c1e700 1 --2- 172.21.15.26:0/3302117971 >> v2:172.21.15.26:3300/0 conn(0x7f43ac130d50 0x7f43ac133ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:04.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.953+0000 7f43b1c1e700 1 -- 172.21.15.26:0/3302117971 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ac09e370 con 0x7f43ac071b40 2023-10-01T07:58:04.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.954+0000 7f43b1c1e700 1 --2- 172.21.15.26:0/3302117971 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43ac071b40 0x7f43ac130420 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f43a80098f0 tx=0x7f43a8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=600a499f86a7915d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:04.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.954+0000 7f43b0c1c700 1 -- 172.21.15.26:0/3302117971 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a800b8a0 con 0x7f43ac071b40 2023-10-01T07:58:04.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.954+0000 7f43b0c1c700 1 -- 172.21.15.26:0/3302117971 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a800ba00 con 0x7f43ac071b40 2023-10-01T07:58:04.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.954+0000 7f43b0c1c700 1 -- 172.21.15.26:0/3302117971 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a800bd90 con 0x7f43ac071b40 2023-10-01T07:58:04.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.955+0000 7f43b3e82700 1 -- 172.21.15.26:0/3302117971 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43ac071b40 msgr2=0x7f43ac130420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:04.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.955+0000 7f43b3e82700 1 --2- 172.21.15.26:0/3302117971 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43ac071b40 0x7f43ac130420 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f43a80098f0 tx=0x7f43a8009c00 comp rx=0 tx=0).stop 2023-10-01T07:58:04.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.955+0000 7f43b3e82700 1 -- 172.21.15.26:0/3302117971 shutdown_connections 2023-10-01T07:58:04.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.955+0000 7f43b3e82700 1 --2- 172.21.15.26:0/3302117971 >> v2:172.21.15.26:3300/0 conn(0x7f43ac130d50 0x7f43ac133ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:04.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.955+0000 7f43b3e82700 1 --2- 172.21.15.26:0/3302117971 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43ac071b40 0x7f43ac130420 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:04.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.955+0000 7f43b3e82700 1 --2- 172.21.15.26:0/3302117971 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f43ac130960 0x7f43ac133570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:04.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.955+0000 7f43b3e82700 1 -- 172.21.15.26:0/3302117971 >> 172.21.15.26:0/3302117971 conn(0x7f43ac09e7e0 msgr2=0x7f43ac09ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:04.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.955+0000 7f43b3e82700 1 -- 172.21.15.26:0/3302117971 shutdown_connections 2023-10-01T07:58:04.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.955+0000 7f43b3e82700 1 -- 172.21.15.26:0/3302117971 wait complete. 2023-10-01T07:58:04.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.957+0000 7f43b3e82700 1 Processor -- start 2023-10-01T07:58:04.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.957+0000 7f43b3e82700 1 -- start start 2023-10-01T07:58:04.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.957+0000 7f43b3e82700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43ac071b40 0x7f43ac12ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:04.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.957+0000 7f43b3e82700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f43ac130960 0x7f43ac12d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:04.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.957+0000 7f43b3e82700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43ac130d50 0x7f43ac12d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:04.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.957+0000 7f43b3e82700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac08b350 con 0x7f43ac130d50 2023-10-01T07:58:04.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.957+0000 7f43b3e82700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac08b8b0 con 0x7f43ac071b40 2023-10-01T07:58:04.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.957+0000 7f43b3e82700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac098b90 con 0x7f43ac130960 2023-10-01T07:58:04.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.957+0000 7f43b241f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43ac130d50 0x7f43ac12d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:04.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.957+0000 7f43b241f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43ac130d50 0x7f43ac12d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49598/0 (socket says 172.21.15.26:49598) 2023-10-01T07:58:04.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.957+0000 7f43b241f700 1 -- 172.21.15.26:0/4015434627 learned_addr learned my addr 172.21.15.26:0/4015434627 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:04.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.958+0000 7f43b1c1e700 1 --2- 172.21.15.26:0/4015434627 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43ac071b40 0x7f43ac12ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:04.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.958+0000 7f43b241f700 1 -- 172.21.15.26:0/4015434627 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f43ac130960 msgr2=0x7f43ac12d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:04.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.958+0000 7f43b241f700 1 --2- 172.21.15.26:0/4015434627 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f43ac130960 0x7f43ac12d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:04.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.958+0000 7f43b241f700 1 -- 172.21.15.26:0/4015434627 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43ac071b40 msgr2=0x7f43ac12ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:04.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.958+0000 7f43b241f700 1 --2- 172.21.15.26:0/4015434627 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43ac071b40 0x7f43ac12ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:04.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.958+0000 7f43b241f700 1 -- 172.21.15.26:0/4015434627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a8009550 con 0x7f43ac130d50 2023-10-01T07:58:04.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.958+0000 7f43b241f700 1 --2- 172.21.15.26:0/4015434627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43ac130d50 0x7f43ac12d8c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f43a400b970 tx=0x7f43a400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:04.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.958+0000 7f43a27fc700 1 -- 172.21.15.26:0/4015434627 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a400c930 con 0x7f43ac130d50 2023-10-01T07:58:04.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.959+0000 7f43a27fc700 1 -- 172.21.15.26:0/4015434627 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a400cab0 con 0x7f43ac130d50 2023-10-01T07:58:04.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.959+0000 7f43b3e82700 1 -- 172.21.15.26:0/4015434627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43ac08afd0 con 0x7f43ac130d50 2023-10-01T07:58:04.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.959+0000 7f43a27fc700 1 -- 172.21.15.26:0/4015434627 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a400ce60 con 0x7f43ac130d50 2023-10-01T07:58:04.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.959+0000 7f43b3e82700 1 -- 172.21.15.26:0/4015434627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43ac08bd10 con 0x7f43ac130d50 2023-10-01T07:58:04.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.960+0000 7f43b3e82700 1 -- 172.21.15.26:0/4015434627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43940052e0 con 0x7f43ac130d50 2023-10-01T07:58:04.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.961+0000 7f43a27fc700 1 -- 172.21.15.26:0/4015434627 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f43a401d3b0 con 0x7f43ac130d50 2023-10-01T07:58:04.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.961+0000 7f43a27fc700 1 -- 172.21.15.26:0/4015434627 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f43a4006e40 con 0x7f43ac130d50 2023-10-01T07:58:04.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:04.970+0000 7f43a27fc700 1 -- 172.21.15.26:0/4015434627 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f43a4007370 con 0x7f43ac130d50 2023-10-01T07:58:05.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.006+0000 7f9bdd1e1700 1 Processor -- start 2023-10-01T07:58:05.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.007+0000 7f9bdd1e1700 1 -- start start 2023-10-01T07:58:05.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.007+0000 7f9bdd1e1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9bd809d6f0 0x7f9bd809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:05.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.007+0000 7f9bdd1e1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9bd809e000 0x7f9bd81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:05.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.007+0000 7f9bdd1e1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9bd8133f30 0x7f9bd81343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:05.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.007+0000 7f9bdd1e1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd809b0f0 con 0x7f9bd809e000 2023-10-01T07:58:05.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.007+0000 7f9bdd1e1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd809d2f0 con 0x7f9bd809d6f0 2023-10-01T07:58:05.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.007+0000 7f9bdd1e1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd809a810 con 0x7f9bd8133f30 2023-10-01T07:58:05.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.008+0000 7f9bd6d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9bd809d6f0 0x7f9bd809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:05.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.008+0000 7f9bd6d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9bd809d6f0 0x7f9bd809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51450/0 (socket says 172.21.15.26:51450) 2023-10-01T07:58:05.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.008+0000 7f9bd6d9d700 1 -- 172.21.15.26:0/420313996 learned_addr learned my addr 172.21.15.26:0/420313996 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:05.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.008+0000 7f9bd759e700 1 --2- 172.21.15.26:0/420313996 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9bd8133f30 0x7f9bd81343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:05.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.008+0000 7f9bd659c700 1 --2- 172.21.15.26:0/420313996 >> v2:172.21.15.26:3300/0 conn(0x7f9bd809e000 0x7f9bd81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:05.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.008+0000 7f9bd659c700 1 -- 172.21.15.26:0/420313996 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9bd8133f30 msgr2=0x7f9bd81343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:05.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.008+0000 7f9bd659c700 1 --2- 172.21.15.26:0/420313996 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9bd8133f30 0x7f9bd81343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:05.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.008+0000 7f9bd659c700 1 -- 172.21.15.26:0/420313996 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9bd809d6f0 msgr2=0x7f9bd809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:05.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.008+0000 7f9bd659c700 1 --2- 172.21.15.26:0/420313996 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9bd809d6f0 0x7f9bd809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:05.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.008+0000 7f9bd659c700 1 -- 172.21.15.26:0/420313996 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd809a470 con 0x7f9bd809e000 2023-10-01T07:58:05.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.008+0000 7f9bd6d9d700 1 --2- 172.21.15.26:0/420313996 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9bd809d6f0 0x7f9bd809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:05.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.008+0000 7f9bd759e700 1 --2- 172.21.15.26:0/420313996 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9bd8133f30 0x7f9bd81343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:58:05.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.008+0000 7f9bd659c700 1 --2- 172.21.15.26:0/420313996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd809e000 0x7f9bd81339f0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc009840 tx=0x7f9bcc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c015e07cb84ab49 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:05.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.009+0000 7f9bd5d9b700 1 -- 172.21.15.26:0/420313996 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc011830 con 0x7f9bd809e000 2023-10-01T07:58:05.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.009+0000 7f9bd5d9b700 1 -- 172.21.15.26:0/420313996 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bcc011990 con 0x7f9bd809e000 2023-10-01T07:58:05.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.009+0000 7f9bd5d9b700 1 -- 172.21.15.26:0/420313996 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc011d20 con 0x7f9bd809e000 2023-10-01T07:58:05.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.009+0000 7f9bdd1e1700 1 -- 172.21.15.26:0/420313996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd809e000 msgr2=0x7f9bd81339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:05.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.009+0000 7f9bdd1e1700 1 --2- 172.21.15.26:0/420313996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd809e000 0x7f9bd81339f0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc009840 tx=0x7f9bcc009b50 comp rx=0 tx=0).stop 2023-10-01T07:58:05.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.009+0000 7f9bdd1e1700 1 -- 172.21.15.26:0/420313996 shutdown_connections 2023-10-01T07:58:05.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.009+0000 7f9bdd1e1700 1 --2- 172.21.15.26:0/420313996 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9bd8133f30 0x7f9bd81343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:05.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.009+0000 7f9bdd1e1700 1 --2- 172.21.15.26:0/420313996 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9bd809d6f0 0x7f9bd809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:05.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.009+0000 7f9bdd1e1700 1 --2- 172.21.15.26:0/420313996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd809e000 0x7f9bd81339f0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:05.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.009+0000 7f9bdd1e1700 1 -- 172.21.15.26:0/420313996 >> 172.21.15.26:0/420313996 conn(0x7f9bd8066f50 msgr2=0x7f9bd809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:05.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.010+0000 7f9bdd1e1700 1 -- 172.21.15.26:0/420313996 shutdown_connections 2023-10-01T07:58:05.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.010+0000 7f9bdd1e1700 1 -- 172.21.15.26:0/420313996 wait complete. 2023-10-01T07:58:05.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.011+0000 7f9bdd1e1700 1 Processor -- start 2023-10-01T07:58:05.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.011+0000 7f9bdd1e1700 1 -- start start 2023-10-01T07:58:05.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.012+0000 7f9bdd1e1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9bd809d6f0 0x7f9bd8131950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:05.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.012+0000 7f9bdd1e1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9bd809e000 0x7f9bd8131e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:05.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.012+0000 7f9bdd1e1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd8133f30 0x7f9bd81c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:05.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.012+0000 7f9bdd1e1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd811dfe0 con 0x7f9bd8133f30 2023-10-01T07:58:05.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.012+0000 7f9bdd1e1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd8121400 con 0x7f9bd809d6f0 2023-10-01T07:58:05.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.012+0000 7f9bdd1e1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd811f6f0 con 0x7f9bd809e000 2023-10-01T07:58:05.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.012+0000 7f9bd6d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9bd809d6f0 0x7f9bd8131950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:05.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.012+0000 7f9bd6d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9bd809d6f0 0x7f9bd8131950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51460/0 (socket says 172.21.15.26:51460) 2023-10-01T07:58:05.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.012+0000 7f9bd6d9d700 1 -- 172.21.15.26:0/3944991835 learned_addr learned my addr 172.21.15.26:0/3944991835 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:05.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.012+0000 7f9bd659c700 1 --2- 172.21.15.26:0/3944991835 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9bd809e000 0x7f9bd8131e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:05.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.012+0000 7f9bd759e700 1 --2- 172.21.15.26:0/3944991835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd8133f30 0x7f9bd81c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:05.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.012+0000 7f9bd6d9d700 1 -- 172.21.15.26:0/3944991835 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9bd809e000 msgr2=0x7f9bd8131e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:05.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.012+0000 7f9bd6d9d700 1 --2- 172.21.15.26:0/3944991835 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9bd809e000 0x7f9bd8131e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:05.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.012+0000 7f9bd6d9d700 1 -- 172.21.15.26:0/3944991835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd8133f30 msgr2=0x7f9bd81c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:05.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.012+0000 7f9bd6d9d700 1 --2- 172.21.15.26:0/3944991835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd8133f30 0x7f9bd81c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:05.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.012+0000 7f9bd6d9d700 1 -- 172.21.15.26:0/3944991835 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc8009550 con 0x7f9bd809d6f0 2023-10-01T07:58:05.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.013+0000 7f9bd6d9d700 1 --2- 172.21.15.26:0/3944991835 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9bd809d6f0 0x7f9bd8131950 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f9bc800ebe0 tx=0x7f9bc800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:05.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.013+0000 7f9bd759e700 1 --2- 172.21.15.26:0/3944991835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd8133f30 0x7f9bd81c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:58:05.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.013+0000 7f9bbf7fe700 1 -- 172.21.15.26:0/3944991835 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc800c850 con 0x7f9bd809d6f0 2023-10-01T07:58:05.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.013+0000 7f9bbf7fe700 1 -- 172.21.15.26:0/3944991835 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc800c9b0 con 0x7f9bd809d6f0 2023-10-01T07:58:05.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.013+0000 7f9bbf7fe700 1 -- 172.21.15.26:0/3944991835 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc800cd20 con 0x7f9bd809d6f0 2023-10-01T07:58:05.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.013+0000 7f9bdd1e1700 1 -- 172.21.15.26:0/3944991835 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bcc0094a0 con 0x7f9bd809d6f0 2023-10-01T07:58:05.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.013+0000 7f9bdd1e1700 1 -- 172.21.15.26:0/3944991835 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd811fee0 con 0x7f9bd809d6f0 2023-10-01T07:58:05.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.014+0000 7f9bdd1e1700 1 -- 172.21.15.26:0/3944991835 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bd8074ea0 con 0x7f9bd809d6f0 2023-10-01T07:58:05.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.015+0000 7f9bbf7fe700 1 -- 172.21.15.26:0/3944991835 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9bc8013470 con 0x7f9bd809d6f0 2023-10-01T07:58:05.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.015+0000 7f9bbf7fe700 1 -- 172.21.15.26:0/3944991835 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9bc803f8c0 con 0x7f9bd809d6f0 2023-10-01T07:58:05.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.024+0000 7f9bbf7fe700 1 -- 172.21.15.26:0/3944991835 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9bc80232f0 con 0x7f9bd809d6f0 2023-10-01T07:58:05.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.037+0000 7f17c6974700 1 Processor -- start 2023-10-01T07:58:05.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.038+0000 7f17c6974700 1 -- start start 2023-10-01T07:58:05.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.038+0000 7f17c6974700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f17c009d6f0 0x7f17c009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:05.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.038+0000 7f17c6974700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f17c009e000 0x7f17c01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:05.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.038+0000 7f17c6974700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17c009e410 0x7f17c0133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:05.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.038+0000 7f17c6974700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c006b460 con 0x7f17c009e000 2023-10-01T07:58:05.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.038+0000 7f17c6974700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c009b120 con 0x7f17c009e410 2023-10-01T07:58:05.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.038+0000 7f17c6974700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17c009a7e0 con 0x7f17c009d6f0 2023-10-01T07:58:05.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.038+0000 7f17bf7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f17c009e000 0x7f17c01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:05.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.038+0000 7f17bf7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f17c009e000 0x7f17c01339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49630/0 (socket says 172.21.15.26:49630) 2023-10-01T07:58:05.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.038+0000 7f17bf7fe700 1 -- 172.21.15.26:0/1669077217 learned_addr learned my addr 172.21.15.26:0/1669077217 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:05.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.038+0000 7f17c4f11700 1 --2- 172.21.15.26:0/1669077217 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17c009e410 0x7f17c0133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:05.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.038+0000 7f17bffff700 1 --2- 172.21.15.26:0/1669077217 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f17c009d6f0 0x7f17c009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:05.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.039+0000 7f17bf7fe700 1 -- 172.21.15.26:0/1669077217 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f17c009d6f0 msgr2=0x7f17c009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:05.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.039+0000 7f17bf7fe700 1 --2- 172.21.15.26:0/1669077217 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f17c009d6f0 0x7f17c009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:05.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.039+0000 7f17bf7fe700 1 -- 172.21.15.26:0/1669077217 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17c009e410 msgr2=0x7f17c0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:05.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.039+0000 7f17bf7fe700 1 --2- 172.21.15.26:0/1669077217 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17c009e410 0x7f17c0133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:05.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.039+0000 7f17bf7fe700 1 -- 172.21.15.26:0/1669077217 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c009a500 con 0x7f17c009e000 2023-10-01T07:58:05.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.039+0000 7f17bffff700 1 --2- 172.21.15.26:0/1669077217 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f17c009d6f0 0x7f17c009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:05.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.039+0000 7f17c4f11700 1 --2- 172.21.15.26:0/1669077217 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17c009e410 0x7f17c0133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:05.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.039+0000 7f17bf7fe700 1 --2- 172.21.15.26:0/1669077217 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17c009e000 0x7f17c01339f0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f17b40098f0 tx=0x7f17b4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1914c272e141ed server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:05.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.039+0000 7f17beffd700 1 -- 172.21.15.26:0/1669077217 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b4011830 con 0x7f17c009e000 2023-10-01T07:58:05.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.039+0000 7f17beffd700 1 -- 172.21.15.26:0/1669077217 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b4011990 con 0x7f17c009e000 2023-10-01T07:58:05.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.039+0000 7f17beffd700 1 -- 172.21.15.26:0/1669077217 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b4011d20 con 0x7f17c009e000 2023-10-01T07:58:05.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.040+0000 7f17c6974700 1 -- 172.21.15.26:0/1669077217 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17c009e000 msgr2=0x7f17c01339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:05.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.040+0000 7f17c6974700 1 --2- 172.21.15.26:0/1669077217 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17c009e000 0x7f17c01339f0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f17b40098f0 tx=0x7f17b4009c00 comp rx=0 tx=0).stop 2023-10-01T07:58:05.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.040+0000 7f17c6974700 1 -- 172.21.15.26:0/1669077217 shutdown_connections 2023-10-01T07:58:05.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.040+0000 7f17c6974700 1 --2- 172.21.15.26:0/1669077217 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17c009e410 0x7f17c0133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:05.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.040+0000 7f17c6974700 1 --2- 172.21.15.26:0/1669077217 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f17c009d6f0 0x7f17c009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:05.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.040+0000 7f17c6974700 1 --2- 172.21.15.26:0/1669077217 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17c009e000 0x7f17c01339f0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:05.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.040+0000 7f17c6974700 1 -- 172.21.15.26:0/1669077217 >> 172.21.15.26:0/1669077217 conn(0x7f17c0066f50 msgr2=0x7f17c009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:05.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.040+0000 7f17c6974700 1 -- 172.21.15.26:0/1669077217 shutdown_connections 2023-10-01T07:58:05.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.040+0000 7f17c6974700 1 -- 172.21.15.26:0/1669077217 wait complete. 2023-10-01T07:58:05.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.041+0000 7f17c6974700 1 Processor -- start 2023-10-01T07:58:05.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.042+0000 7f17c6974700 1 -- start start 2023-10-01T07:58:05.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.042+0000 7f17c6974700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f17c009d6f0 0x7f17c01a5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:05.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.042+0000 7f17c6974700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17c009e000 0x7f17c01a62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:05.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.042+0000 7f17c6974700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17c009e410 0x7f17c01a6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:05.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.042+0000 7f17c6974700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c01a9a40 con 0x7f17c009e410 2023-10-01T07:58:05.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.042+0000 7f17c6974700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c01aa280 con 0x7f17c009e000 2023-10-01T07:58:05.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.042+0000 7f17c6974700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17c01a79b0 con 0x7f17c009d6f0 2023-10-01T07:58:05.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.042+0000 7f17bffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f17c009d6f0 0x7f17c01a5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:05.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.042+0000 7f17bffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f17c009d6f0 0x7f17c01a5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:33628/0 (socket says 172.21.15.26:33628) 2023-10-01T07:58:05.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.042+0000 7f17bffff700 1 -- 172.21.15.26:0/3156672890 learned_addr learned my addr 172.21.15.26:0/3156672890 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:05.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.042+0000 7f17bf7fe700 1 --2- 172.21.15.26:0/3156672890 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17c009e000 0x7f17c01a62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:05.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.042+0000 7f17c4f11700 1 --2- 172.21.15.26:0/3156672890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17c009e410 0x7f17c01a6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:05.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.043+0000 7f17bf7fe700 1 -- 172.21.15.26:0/3156672890 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f17c009d6f0 msgr2=0x7f17c01a5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:05.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.043+0000 7f17bf7fe700 1 --2- 172.21.15.26:0/3156672890 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f17c009d6f0 0x7f17c01a5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:05.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.043+0000 7f17bf7fe700 1 -- 172.21.15.26:0/3156672890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17c009e410 msgr2=0x7f17c01a6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:05.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.043+0000 7f17bf7fe700 1 --2- 172.21.15.26:0/3156672890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17c009e410 0x7f17c01a6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:05.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.043+0000 7f17bf7fe700 1 -- 172.21.15.26:0/3156672890 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b00094a0 con 0x7f17c009e000 2023-10-01T07:58:05.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.043+0000 7f17bffff700 1 --2- 172.21.15.26:0/3156672890 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f17c009d6f0 0x7f17c01a5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:05.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.043+0000 7f17bf7fe700 1 --2- 172.21.15.26:0/3156672890 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17c009e000 0x7f17c01a62e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f17c006e510 tx=0x7f17b4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:05.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.043+0000 7f17bcff9700 1 -- 172.21.15.26:0/3156672890 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b4004240 con 0x7f17c009e000 2023-10-01T07:58:05.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.043+0000 7f17bcff9700 1 -- 172.21.15.26:0/3156672890 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b4030070 con 0x7f17c009e000 2023-10-01T07:58:05.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.043+0000 7f17bcff9700 1 -- 172.21.15.26:0/3156672890 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b40045e0 con 0x7f17c009e000 2023-10-01T07:58:05.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.043+0000 7f17c6974700 1 -- 172.21.15.26:0/3156672890 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b8009a70 con 0x7f17c009e000 2023-10-01T07:58:05.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.044+0000 7f17c6974700 1 -- 172.21.15.26:0/3156672890 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b4009550 con 0x7f17c009e000 2023-10-01T07:58:05.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.044+0000 7f17bcff9700 1 -- 172.21.15.26:0/3156672890 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f17b4032030 con 0x7f17c009e000 2023-10-01T07:58:05.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.045+0000 7f17bcff9700 1 -- 172.21.15.26:0/3156672890 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f17b40517a0 con 0x7f17c009e000 2023-10-01T07:58:05.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.045+0000 7f17c6974700 1 -- 172.21.15.26:0/3156672890 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c009c710 con 0x7f17c009e000 2023-10-01T07:58:05.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.054+0000 7f17bcff9700 1 -- 172.21.15.26:0/3156672890 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f17b4011e30 con 0x7f17c009e000 2023-10-01T07:58:05.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.086+0000 7f25b434e700 1 Processor -- start 2023-10-01T07:58:05.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.087+0000 7f25b434e700 1 -- start start 2023-10-01T07:58:05.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.087+0000 7f25b434e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25ac09d6f0 0x7f25ac09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:05.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.087+0000 7f25b434e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25ac09e410 0x7f25ac130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:05.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.087+0000 7f25b434e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25ac09f130 con 0x7f25ac09e000 2023-10-01T07:58:05.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.087+0000 7f25b434e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac09f520 con 0x7f25ac09e410 2023-10-01T07:58:05.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.087+0000 7f25b434e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac09e930 con 0x7f25ac09d6f0 2023-10-01T07:58:05.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.088+0000 7f25b18e9700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f25ac09e000 0x7f25ac130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46424/0 (socket says 172.21.15.26:46424) 2023-10-01T07:58:05.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.088+0000 7f25b18e9700 1 -- 172.21.15.26:0/2032672917 learned_addr learned my addr 172.21.15.26:0/2032672917 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:05.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.088+0000 7f25b28eb700 1 --2- 172.21.15.26:0/2032672917 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25ac09e410 0x7f25ac130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:05.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.088+0000 7f25b20ea700 1 --2- 172.21.15.26:0/2032672917 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25ac09d6f0 0x7f25ac09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:05.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.088+0000 7f25b10e8700 1 -- 172.21.15.26:0/2032672917 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3301028635 0 0) 0x7f25ac09f130 con 0x7f25ac09e000 2023-10-01T07:58:05.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.088+0000 7f25b10e8700 1 -- 172.21.15.26:0/2032672917 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25980057c0 con 0x7f25ac09e000 2023-10-01T07:58:05.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.088+0000 7f25b28eb700 1 -- 172.21.15.26:0/2032672917 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25ac09d6f0 msgr2=0x7f25ac09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:05.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.088+0000 7f25b28eb700 1 --2- 172.21.15.26:0/2032672917 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25ac09d6f0 0x7f25ac09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:05.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.088+0000 7f25b28eb700 1 -- 172.21.15.26:0/2032672917 >> v1:172.21.15.26:6789/0 conn(0x7f25ac09e000 legacy=0x7f25ac130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:05.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.088+0000 7f25b28eb700 1 -- 172.21.15.26:0/2032672917 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ac09b2d0 con 0x7f25ac09e410 2023-10-01T07:58:05.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.088+0000 7f25b28eb700 1 --2- 172.21.15.26:0/2032672917 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25ac09e410 0x7f25ac130d70 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f25a4009dc0 tx=0x7f25a400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f43010552e68aff server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:05.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.089+0000 7f25b10e8700 1 -- 172.21.15.26:0/2032672917 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a400e070 con 0x7f25ac09e410 2023-10-01T07:58:05.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.089+0000 7f25b10e8700 1 -- 172.21.15.26:0/2032672917 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a400bb20 con 0x7f25ac09e410 2023-10-01T07:58:05.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.089+0000 7f25b10e8700 1 -- 172.21.15.26:0/2032672917 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a400be90 con 0x7f25ac09e410 2023-10-01T07:58:05.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.089+0000 7f25b434e700 1 -- 172.21.15.26:0/2032672917 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25ac09e410 msgr2=0x7f25ac130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:05.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.089+0000 7f25b434e700 1 --2- 172.21.15.26:0/2032672917 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25ac09e410 0x7f25ac130d70 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f25a4009dc0 tx=0x7f25a400b330 comp rx=0 tx=0).stop 2023-10-01T07:58:05.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.089+0000 7f25b434e700 1 -- 172.21.15.26:0/2032672917 shutdown_connections 2023-10-01T07:58:05.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.089+0000 7f25b434e700 1 --2- 172.21.15.26:0/2032672917 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25ac09d6f0 0x7f25ac09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:05.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.089+0000 7f25b434e700 1 --2- 172.21.15.26:0/2032672917 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25ac09e410 0x7f25ac130d70 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:05.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.089+0000 7f25b434e700 1 -- 172.21.15.26:0/2032672917 >> 172.21.15.26:0/2032672917 conn(0x7f25ac066f50 msgr2=0x7f25ac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:05.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.090+0000 7f25b434e700 1 -- 172.21.15.26:0/2032672917 shutdown_connections 2023-10-01T07:58:05.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.090+0000 7f25b434e700 1 -- 172.21.15.26:0/2032672917 wait complete. 2023-10-01T07:58:05.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.091+0000 7f25b434e700 1 Processor -- start 2023-10-01T07:58:05.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.091+0000 7f25b434e700 1 -- start start 2023-10-01T07:58:05.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.091+0000 7f25b434e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25ac09d6f0 0x7f25ac122080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:05.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.091+0000 7f25b434e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25ac09e000 0x7f25ac1225c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:05.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.091+0000 7f25b434e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25ac09e410 0x7f25ac122b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:05.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.091+0000 7f25b434e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac125ba0 con 0x7f25ac09d6f0 2023-10-01T07:58:05.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.091+0000 7f25b434e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac09c700 con 0x7f25ac09e410 2023-10-01T07:58:05.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.091+0000 7f25b434e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac125330 con 0x7f25ac09e000 2023-10-01T07:58:05.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.091+0000 7f25b28eb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25ac09e410 0x7f25ac122b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:05.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.091+0000 7f25b20ea700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25ac09d6f0 0x7f25ac122080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:05.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.091+0000 7f25b28eb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25ac09e410 0x7f25ac122b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51494/0 (socket says 172.21.15.26:51494) 2023-10-01T07:58:05.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.091+0000 7f25b28eb700 1 -- 172.21.15.26:0/1789436063 learned_addr learned my addr 172.21.15.26:0/1789436063 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:05.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.092+0000 7f25b28eb700 1 -- 172.21.15.26:0/1789436063 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25ac09e000 msgr2=0x7f25ac1225c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:05.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.092+0000 7f25b28eb700 1 --2- 172.21.15.26:0/1789436063 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25ac09e000 0x7f25ac1225c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:05.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.092+0000 7f25b28eb700 1 -- 172.21.15.26:0/1789436063 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25ac09d6f0 msgr2=0x7f25ac122080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:05.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.092+0000 7f25b28eb700 1 --2- 172.21.15.26:0/1789436063 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25ac09d6f0 0x7f25ac122080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:05.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.092+0000 7f25b28eb700 1 -- 172.21.15.26:0/1789436063 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a4009a70 con 0x7f25ac09e410 2023-10-01T07:58:05.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.092+0000 7f25b20ea700 1 --2- 172.21.15.26:0/1789436063 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25ac09d6f0 0x7f25ac122080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:05.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.092+0000 7f25b28eb700 1 --2- 172.21.15.26:0/1789436063 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25ac09e410 0x7f25ac122b00 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f25a400b370 tx=0x7f25a4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:05.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.092+0000 7f25a2ffd700 1 -- 172.21.15.26:0/1789436063 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a40048b0 con 0x7f25ac09e410 2023-10-01T07:58:05.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.092+0000 7f25a2ffd700 1 -- 172.21.15.26:0/1789436063 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a4020070 con 0x7f25ac09e410 2023-10-01T07:58:05.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.092+0000 7f25b434e700 1 -- 172.21.15.26:0/1789436063 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25ac125600 con 0x7f25ac09e410 2023-10-01T07:58:05.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.092+0000 7f25a2ffd700 1 -- 172.21.15.26:0/1789436063 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a40276c0 con 0x7f25ac09e410 2023-10-01T07:58:05.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.092+0000 7f25b434e700 1 -- 172.21.15.26:0/1789436063 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25ac071ef0 con 0x7f25ac09e410 2023-10-01T07:58:05.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.094+0000 7f25b434e700 1 -- 172.21.15.26:0/1789436063 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25ac11ac20 con 0x7f25ac09e410 2023-10-01T07:58:05.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.094+0000 7f25a2ffd700 1 -- 172.21.15.26:0/1789436063 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f25a4012430 con 0x7f25ac09e410 2023-10-01T07:58:05.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.094+0000 7f25a2ffd700 1 -- 172.21.15.26:0/1789436063 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f25a4022070 con 0x7f25ac09e410 2023-10-01T07:58:05.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.103+0000 7f25a2ffd700 1 -- 172.21.15.26:0/1789436063 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25a40126e0 con 0x7f25ac09e410 2023-10-01T07:58:05.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.200+0000 7f43b3e82700 1 -- 172.21.15.26:0/4015434627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4394005590 con 0x7f43ac130d50 2023-10-01T07:58:05.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.201+0000 7f43a27fc700 1 -- 172.21.15.26:0/4015434627 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f43a4019070 con 0x7f43ac130d50 2023-10-01T07:58:05.202 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:05.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.203+0000 7f43b3e82700 1 -- 172.21.15.26:0/4015434627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43ac130d50 msgr2=0x7f43ac12d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:05.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.203+0000 7f43b3e82700 1 --2- 172.21.15.26:0/4015434627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43ac130d50 0x7f43ac12d8c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f43a400b970 tx=0x7f43a400bc80 comp rx=0 tx=0).stop 2023-10-01T07:58:05.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.203+0000 7f43b3e82700 1 -- 172.21.15.26:0/4015434627 shutdown_connections 2023-10-01T07:58:05.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.203+0000 7f43b3e82700 1 --2- 172.21.15.26:0/4015434627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43ac130d50 0x7f43ac12d8c0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:05.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.203+0000 7f43b3e82700 1 --2- 172.21.15.26:0/4015434627 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43ac071b40 0x7f43ac12ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:05.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.203+0000 7f43b3e82700 1 --2- 172.21.15.26:0/4015434627 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f43ac130960 0x7f43ac12d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:05.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.203+0000 7f43b3e82700 1 -- 172.21.15.26:0/4015434627 >> 172.21.15.26:0/4015434627 conn(0x7f43ac09e7e0 msgr2=0x7f43ac1321e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:05.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.204+0000 7f43b3e82700 1 -- 172.21.15.26:0/4015434627 shutdown_connections 2023-10-01T07:58:05.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.204+0000 7f43b3e82700 1 -- 172.21.15.26:0/4015434627 wait complete. 2023-10-01T07:58:05.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:05.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.240+0000 7f9bdd1e1700 1 -- 172.21.15.26:0/3944991835 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9bd81323d0 con 0x7f9bd809d6f0 2023-10-01T07:58:05.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.241+0000 7f9bbf7fe700 1 -- 172.21.15.26:0/3944991835 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9bc8021070 con 0x7f9bd809d6f0 2023-10-01T07:58:05.241 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:05.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.243+0000 7f9bdd1e1700 1 -- 172.21.15.26:0/3944991835 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9bd809d6f0 msgr2=0x7f9bd8131950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:05.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.243+0000 7f9bdd1e1700 1 --2- 172.21.15.26:0/3944991835 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9bd809d6f0 0x7f9bd8131950 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f9bc800ebe0 tx=0x7f9bc800eef0 comp rx=0 tx=0).stop 2023-10-01T07:58:05.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.243+0000 7f9bdd1e1700 1 -- 172.21.15.26:0/3944991835 shutdown_connections 2023-10-01T07:58:05.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.243+0000 7f9bdd1e1700 1 --2- 172.21.15.26:0/3944991835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd8133f30 0x7f9bd81c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:05.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.243+0000 7f9bdd1e1700 1 --2- 172.21.15.26:0/3944991835 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9bd809d6f0 0x7f9bd8131950 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:05.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.243+0000 7f9bdd1e1700 1 --2- 172.21.15.26:0/3944991835 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9bd809e000 0x7f9bd8131e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:05.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.243+0000 7f9bdd1e1700 1 -- 172.21.15.26:0/3944991835 >> 172.21.15.26:0/3944991835 conn(0x7f9bd8066f50 msgr2=0x7f9bd80a2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:05.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.243+0000 7f9bdd1e1700 1 -- 172.21.15.26:0/3944991835 shutdown_connections 2023-10-01T07:58:05.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.243+0000 7f9bdd1e1700 1 -- 172.21.15.26:0/3944991835 wait complete. 2023-10-01T07:58:05.259 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:05.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.266+0000 7f17c6974700 1 -- 172.21.15.26:0/3156672890 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f17c006c360 con 0x7f17c009e000 2023-10-01T07:58:05.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.266+0000 7f17bcff9700 1 -- 172.21.15.26:0/3156672890 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f17b4015020 con 0x7f17c009e000 2023-10-01T07:58:05.267 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:05.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.269+0000 7f17c6974700 1 -- 172.21.15.26:0/3156672890 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17c009e000 msgr2=0x7f17c01a62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:05.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.269+0000 7f17c6974700 1 --2- 172.21.15.26:0/3156672890 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17c009e000 0x7f17c01a62e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f17c006e510 tx=0x7f17b4004750 comp rx=0 tx=0).stop 2023-10-01T07:58:05.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.269+0000 7f17c6974700 1 -- 172.21.15.26:0/3156672890 shutdown_connections 2023-10-01T07:58:05.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.269+0000 7f17c6974700 1 --2- 172.21.15.26:0/3156672890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17c009e410 0x7f17c01a6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:05.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.269+0000 7f17c6974700 1 --2- 172.21.15.26:0/3156672890 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f17c009d6f0 0x7f17c01a5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:05.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.269+0000 7f17c6974700 1 --2- 172.21.15.26:0/3156672890 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17c009e000 0x7f17c01a62e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:05.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.269+0000 7f17c6974700 1 -- 172.21.15.26:0/3156672890 >> 172.21.15.26:0/3156672890 conn(0x7f17c0066f50 msgr2=0x7f17c01bac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:05.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.269+0000 7f17c6974700 1 -- 172.21.15.26:0/3156672890 shutdown_connections 2023-10-01T07:58:05.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.269+0000 7f17c6974700 1 -- 172.21.15.26:0/3156672890 wait complete. 2023-10-01T07:58:05.283 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:05.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.312+0000 7f25b434e700 1 -- 172.21.15.26:0/1789436063 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f25ac074ea0 con 0x7f25ac09e410 2023-10-01T07:58:05.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.312+0000 7f25a2ffd700 1 -- 172.21.15.26:0/1789436063 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f25a402f390 con 0x7f25ac09e410 2023-10-01T07:58:05.313 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:05.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.315+0000 7f25b434e700 1 -- 172.21.15.26:0/1789436063 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25ac09e410 msgr2=0x7f25ac122b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:05.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.315+0000 7f25b434e700 1 --2- 172.21.15.26:0/1789436063 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25ac09e410 0x7f25ac122b00 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f25a400b370 tx=0x7f25a4004ad0 comp rx=0 tx=0).stop 2023-10-01T07:58:05.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.315+0000 7f25b434e700 1 -- 172.21.15.26:0/1789436063 shutdown_connections 2023-10-01T07:58:05.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.315+0000 7f25b434e700 1 --2- 172.21.15.26:0/1789436063 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25ac09e410 0x7f25ac122b00 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:05.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.315+0000 7f25b434e700 1 --2- 172.21.15.26:0/1789436063 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25ac09d6f0 0x7f25ac122080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:05.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.315+0000 7f25b434e700 1 --2- 172.21.15.26:0/1789436063 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25ac09e000 0x7f25ac1225c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:05.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.315+0000 7f25b434e700 1 -- 172.21.15.26:0/1789436063 >> 172.21.15.26:0/1789436063 conn(0x7f25ac066f50 msgr2=0x7f25ac130ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:05.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.315+0000 7f25b434e700 1 -- 172.21.15.26:0/1789436063 shutdown_connections 2023-10-01T07:58:05.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:05.315+0000 7f25b434e700 1 -- 172.21.15.26:0/1789436063 wait complete. 2023-10-01T07:58:05.328 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:06.219 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:06.260 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:06.284 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:06.329 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:06.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.378+0000 7f5afbcaf700 1 Processor -- start 2023-10-01T07:58:06.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.378+0000 7f5afbcaf700 1 -- start start 2023-10-01T07:58:06.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.379+0000 7f5afbcaf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5af4136710 0x7f5af4138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:06.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.379+0000 7f5afbcaf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5af4139030 0x7f5af413b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:06.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.379+0000 7f5afbcaf700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5af406ef30 con 0x7f5af41338a0 2023-10-01T07:58:06.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.379+0000 7f5afbcaf700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af406fef0 con 0x7f5af4136710 2023-10-01T07:58:06.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.379+0000 7f5afbcaf700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5af41334b0 con 0x7f5af4139030 2023-10-01T07:58:06.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.379+0000 7f5afa24c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5af4139030 0x7f5af413b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:06.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.379+0000 7f5afa24c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5af4139030 0x7f5af413b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:33656/0 (socket says 172.21.15.26:33656) 2023-10-01T07:58:06.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.379+0000 7f5afa24c700 1 -- 172.21.15.26:0/2156151033 learned_addr learned my addr 172.21.15.26:0/2156151033 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:06.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.379+0000 7f5afa24c700 1 -- 172.21.15.26:0/2156151033 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5af4136710 msgr2=0x7f5af4138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:06.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.379+0000 7f5afa24c700 1 --2- 172.21.15.26:0/2156151033 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5af4136710 0x7f5af4138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.379+0000 7f5afa24c700 1 -- 172.21.15.26:0/2156151033 >> v1:172.21.15.26:6789/0 conn(0x7f5af41338a0 legacy=0x7f5af4133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:06.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.379+0000 7f5afa24c700 1 -- 172.21.15.26:0/2156151033 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af406fc30 con 0x7f5af4139030 2023-10-01T07:58:06.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.380+0000 7f5afa24c700 1 --2- 172.21.15.26:0/2156151033 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5af4139030 0x7f5af413b410 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5aec009e80 tx=0x7f5aec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e97b9519bb08e780 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:06.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.380+0000 7f5af8a49700 1 -- 172.21.15.26:0/2156151033 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec00e070 con 0x7f5af4139030 2023-10-01T07:58:06.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.380+0000 7f5af8a49700 1 -- 172.21.15.26:0/2156151033 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aec00b9c0 con 0x7f5af4139030 2023-10-01T07:58:06.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.380+0000 7f5af8a49700 1 -- 172.21.15.26:0/2156151033 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec00bd70 con 0x7f5af4139030 2023-10-01T07:58:06.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.381+0000 7f5afbcaf700 1 -- 172.21.15.26:0/2156151033 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5af4139030 msgr2=0x7f5af413b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:06.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.381+0000 7f5afbcaf700 1 --2- 172.21.15.26:0/2156151033 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5af4139030 0x7f5af413b410 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5aec009e80 tx=0x7f5aec00b330 comp rx=0 tx=0).stop 2023-10-01T07:58:06.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.381+0000 7f5afbcaf700 1 -- 172.21.15.26:0/2156151033 shutdown_connections 2023-10-01T07:58:06.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.381+0000 7f5afbcaf700 1 --2- 172.21.15.26:0/2156151033 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5af4139030 0x7f5af413b410 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.381+0000 7f5afbcaf700 1 --2- 172.21.15.26:0/2156151033 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5af4136710 0x7f5af4138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.381+0000 7f5afbcaf700 1 -- 172.21.15.26:0/2156151033 >> 172.21.15.26:0/2156151033 conn(0x7f5af40a2aa0 msgr2=0x7f5af40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:06.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.381+0000 7f5afbcaf700 1 -- 172.21.15.26:0/2156151033 shutdown_connections 2023-10-01T07:58:06.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.381+0000 7f5afbcaf700 1 -- 172.21.15.26:0/2156151033 wait complete. 2023-10-01T07:58:06.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.382+0000 7f5afbcaf700 1 Processor -- start 2023-10-01T07:58:06.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.382+0000 7f5afbcaf700 1 -- start start 2023-10-01T07:58:06.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.382+0000 7f5afbcaf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5af41338a0 0x7f5af411b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:06.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.382+0000 7f5afbcaf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5af4136710 0x7f5af411bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:06.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.382+0000 7f5afbcaf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5af4139030 0x7f5af41c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:06.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.382+0000 7f5afbcaf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af411e9a0 con 0x7f5af41338a0 2023-10-01T07:58:06.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.382+0000 7f5afbcaf700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af411b3c0 con 0x7f5af4139030 2023-10-01T07:58:06.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.382+0000 7f5afbcaf700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5af411e400 con 0x7f5af4136710 2023-10-01T07:58:06.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.383+0000 7f5afa24c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5af4139030 0x7f5af41c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:06.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.383+0000 7f5afa24c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5af4139030 0x7f5af41c8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51518/0 (socket says 172.21.15.26:51518) 2023-10-01T07:58:06.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.383+0000 7f5afa24c700 1 -- 172.21.15.26:0/3654762618 learned_addr learned my addr 172.21.15.26:0/3654762618 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:06.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.383+0000 7f5af9a4b700 1 --2- 172.21.15.26:0/3654762618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5af41338a0 0x7f5af411b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:06.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.383+0000 7f5af924a700 1 --2- 172.21.15.26:0/3654762618 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5af4136710 0x7f5af411bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:06.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.383+0000 7f5afa24c700 1 -- 172.21.15.26:0/3654762618 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5af4136710 msgr2=0x7f5af411bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:06.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.383+0000 7f5afa24c700 1 --2- 172.21.15.26:0/3654762618 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5af4136710 0x7f5af411bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.383+0000 7f5afa24c700 1 -- 172.21.15.26:0/3654762618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5af41338a0 msgr2=0x7f5af411b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:06.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.383+0000 7f5afa24c700 1 --2- 172.21.15.26:0/3654762618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5af41338a0 0x7f5af411b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.383+0000 7f5afa24c700 1 -- 172.21.15.26:0/3654762618 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aec009b30 con 0x7f5af4139030 2023-10-01T07:58:06.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.383+0000 7f5afa24c700 1 --2- 172.21.15.26:0/3654762618 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5af4139030 0x7f5af41c8320 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00b370 tx=0x7f5aec004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:06.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.384+0000 7f5aea7fc700 1 -- 172.21.15.26:0/3654762618 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec004450 con 0x7f5af4139030 2023-10-01T07:58:06.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.384+0000 7f5aea7fc700 1 -- 172.21.15.26:0/3654762618 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aec0045b0 con 0x7f5af4139030 2023-10-01T07:58:06.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.384+0000 7f5afbcaf700 1 -- 172.21.15.26:0/3654762618 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5af4138b00 con 0x7f5af4139030 2023-10-01T07:58:06.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.384+0000 7f5aea7fc700 1 -- 172.21.15.26:0/3654762618 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec004960 con 0x7f5af4139030 2023-10-01T07:58:06.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.384+0000 7f5afbcaf700 1 -- 172.21.15.26:0/3654762618 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af411ca90 con 0x7f5af4139030 2023-10-01T07:58:06.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.385+0000 7f5aea7fc700 1 -- 172.21.15.26:0/3654762618 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5aec01c410 con 0x7f5af4139030 2023-10-01T07:58:06.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.385+0000 7f5aea7fc700 1 -- 172.21.15.26:0/3654762618 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5aec041790 con 0x7f5af4139030 2023-10-01T07:58:06.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.385+0000 7f5afbcaf700 1 -- 172.21.15.26:0/3654762618 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af411e600 con 0x7f5af4139030 2023-10-01T07:58:06.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.395+0000 7f5aea7fc700 1 -- 172.21.15.26:0/3654762618 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5af411e600 con 0x7f5af4139030 2023-10-01T07:58:06.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.414+0000 7f7fa73f6700 1 Processor -- start 2023-10-01T07:58:06.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.414+0000 7f7fa73f6700 1 -- start start 2023-10-01T07:58:06.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.415+0000 7f7fa73f6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7fa009e930 0x7f7fa009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:06.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.415+0000 7f7fa73f6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7fa009f240 0x7f7fa01317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:06.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.415+0000 7f7fa73f6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7fa009f650 0x7f7fa0131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:06.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.415+0000 7f7fa73f6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa0070940 con 0x7f7fa009e930 2023-10-01T07:58:06.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.415+0000 7f7fa73f6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa006fd60 con 0x7f7fa009f650 2023-10-01T07:58:06.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.415+0000 7f7fa73f6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa006fa80 con 0x7f7fa009f240 2023-10-01T07:58:06.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.415+0000 7f7fa5192700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7fa009e930 0x7f7fa009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:06.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.415+0000 7f7fa5192700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7fa009e930 0x7f7fa009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49666/0 (socket says 172.21.15.26:49666) 2023-10-01T07:58:06.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.415+0000 7f7fa5192700 1 -- 172.21.15.26:0/4119707461 learned_addr learned my addr 172.21.15.26:0/4119707461 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:06.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.415+0000 7f7fa5993700 1 --2- 172.21.15.26:0/4119707461 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7fa009f650 0x7f7fa0131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:06.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.415+0000 7f7fa4991700 1 --2- 172.21.15.26:0/4119707461 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7fa009f240 0x7f7fa01317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:06.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.415+0000 7f7fa5192700 1 -- 172.21.15.26:0/4119707461 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7fa009f240 msgr2=0x7f7fa01317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:06.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.415+0000 7f7fa5192700 1 --2- 172.21.15.26:0/4119707461 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7fa009f240 0x7f7fa01317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.415+0000 7f7fa5192700 1 -- 172.21.15.26:0/4119707461 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7fa009f650 msgr2=0x7f7fa0131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:06.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.415+0000 7f7fa5192700 1 --2- 172.21.15.26:0/4119707461 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7fa009f650 0x7f7fa0131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.415+0000 7f7fa5192700 1 -- 172.21.15.26:0/4119707461 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa009fb60 con 0x7f7fa009e930 2023-10-01T07:58:06.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.415+0000 7f7fa4991700 1 --2- 172.21.15.26:0/4119707461 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7fa009f240 0x7f7fa01317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:58:06.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.416+0000 7f7fa5192700 1 --2- 172.21.15.26:0/4119707461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fa009e930 0x7f7fa009ed00 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00dd10 tx=0x7f7f9c00f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319dfea530fac0e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:06.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.416+0000 7f7f97fff700 1 -- 172.21.15.26:0/4119707461 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c012070 con 0x7f7fa009e930 2023-10-01T07:58:06.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.416+0000 7f7f97fff700 1 -- 172.21.15.26:0/4119707461 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9c00d2e0 con 0x7f7fa009e930 2023-10-01T07:58:06.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.416+0000 7f7f97fff700 1 -- 172.21.15.26:0/4119707461 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c00fb10 con 0x7f7fa009e930 2023-10-01T07:58:06.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.417+0000 7f7fa73f6700 1 -- 172.21.15.26:0/4119707461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fa009e930 msgr2=0x7f7fa009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:06.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.417+0000 7f7fa73f6700 1 --2- 172.21.15.26:0/4119707461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fa009e930 0x7f7fa009ed00 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00dd10 tx=0x7f7f9c00f330 comp rx=0 tx=0).stop 2023-10-01T07:58:06.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.417+0000 7f7fa73f6700 1 -- 172.21.15.26:0/4119707461 shutdown_connections 2023-10-01T07:58:06.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.417+0000 7f7fa73f6700 1 --2- 172.21.15.26:0/4119707461 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7fa009f650 0x7f7fa0131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.417+0000 7f7fa73f6700 1 --2- 172.21.15.26:0/4119707461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fa009e930 0x7f7fa009ed00 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.417+0000 7f7fa73f6700 1 --2- 172.21.15.26:0/4119707461 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7fa009f240 0x7f7fa01317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.417+0000 7f7fa73f6700 1 -- 172.21.15.26:0/4119707461 >> 172.21.15.26:0/4119707461 conn(0x7f7fa00a4210 msgr2=0x7f7fa00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:06.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.417+0000 7f7fa73f6700 1 -- 172.21.15.26:0/4119707461 shutdown_connections 2023-10-01T07:58:06.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.417+0000 7f7fa73f6700 1 -- 172.21.15.26:0/4119707461 wait complete. 2023-10-01T07:58:06.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.418+0000 7f7fa73f6700 1 Processor -- start 2023-10-01T07:58:06.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.419+0000 7f7fa73f6700 1 -- start start 2023-10-01T07:58:06.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.419+0000 7f7fa73f6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7fa009e930 0x7f7fa01c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:06.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.419+0000 7f7fa73f6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7fa009f240 0x7f7fa01c42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:06.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.419+0000 7f7fa73f6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fa009f650 0x7f7fa01c4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:06.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.419+0000 7f7fa73f6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa01a2380 con 0x7f7fa009f650 2023-10-01T07:58:06.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.419+0000 7f7fa73f6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa01a2190 con 0x7f7fa009f240 2023-10-01T07:58:06.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.419+0000 7f7fa73f6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa01a40a0 con 0x7f7fa009e930 2023-10-01T07:58:06.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.420+0000 7f7fa5192700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7fa009e930 0x7f7fa01c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:06.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.420+0000 7f7fa5993700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fa009f650 0x7f7fa01c4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:06.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.420+0000 7f7fa5993700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fa009f650 0x7f7fa01c4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49670/0 (socket says 172.21.15.26:49670) 2023-10-01T07:58:06.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.420+0000 7f7fa5192700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7fa009e930 0x7f7fa01c3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:33682/0 (socket says 172.21.15.26:33682) 2023-10-01T07:58:06.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.420+0000 7f7fa5993700 1 -- 172.21.15.26:0/2949235304 learned_addr learned my addr 172.21.15.26:0/2949235304 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:06.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.420+0000 7f7fa4991700 1 --2- 172.21.15.26:0/2949235304 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7fa009f240 0x7f7fa01c42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:06.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.420+0000 7f7fa5192700 1 -- 172.21.15.26:0/2949235304 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7fa009f240 msgr2=0x7f7fa01c42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:06.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.420+0000 7f7fa5192700 1 --2- 172.21.15.26:0/2949235304 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7fa009f240 0x7f7fa01c42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.420+0000 7f7fa5192700 1 -- 172.21.15.26:0/2949235304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fa009f650 msgr2=0x7f7fa01c4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:06.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.420+0000 7f7fa5192700 1 --2- 172.21.15.26:0/2949235304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fa009f650 0x7f7fa01c4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.420+0000 7f7fa5192700 1 -- 172.21.15.26:0/2949235304 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f9c00d9f0 con 0x7f7fa009e930 2023-10-01T07:58:06.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.420+0000 7f7fa5192700 1 --2- 172.21.15.26:0/2949235304 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7fa009e930 0x7f7fa01c3db0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c019000 tx=0x7f7f9c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:06.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.423+0000 7f7f95ffb700 1 -- 172.21.15.26:0/2949235304 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c00de60 con 0x7f7fa009e930 2023-10-01T07:58:06.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.423+0000 7f7f95ffb700 1 -- 172.21.15.26:0/2949235304 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9c0036a0 con 0x7f7fa009e930 2023-10-01T07:58:06.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.423+0000 7f7fa73f6700 1 -- 172.21.15.26:0/2949235304 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa00a0190 con 0x7f7fa009e930 2023-10-01T07:58:06.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.423+0000 7f7f95ffb700 1 -- 172.21.15.26:0/2949235304 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c003a50 con 0x7f7fa009e930 2023-10-01T07:58:06.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.423+0000 7f7fa73f6700 1 -- 172.21.15.26:0/2949235304 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa01a3dc0 con 0x7f7fa009e930 2023-10-01T07:58:06.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.424+0000 7f7f95ffb700 1 -- 172.21.15.26:0/2949235304 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7f9c003bb0 con 0x7f7fa009e930 2023-10-01T07:58:06.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.424+0000 7f7f95ffb700 1 -- 172.21.15.26:0/2949235304 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7f9c044950 con 0x7f7fa009e930 2023-10-01T07:58:06.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.424+0000 7f7fa73f6700 1 -- 172.21.15.26:0/2949235304 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa0074ea0 con 0x7f7fa009e930 2023-10-01T07:58:06.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.430+0000 7f7f95ffb700 1 -- 172.21.15.26:0/2949235304 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7f9c00b970 con 0x7f7fa009e930 2023-10-01T07:58:06.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.457+0000 7f0cdc8ea700 1 Processor -- start 2023-10-01T07:58:06.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.457+0000 7f0cdc8ea700 1 -- start start 2023-10-01T07:58:06.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.458+0000 7f0cdc8ea700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0cd80a1510 0x7f0cd8138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:06.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.458+0000 7f0cdc8ea700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0cd8139250 0x7f0cd813b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:06.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.458+0000 7f0cdc8ea700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cd809edd0 con 0x7f0cd80a0a30 2023-10-01T07:58:06.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.458+0000 7f0cdc8ea700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cd80a18e0 con 0x7f0cd8139250 2023-10-01T07:58:06.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.458+0000 7f0cdc8ea700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd809e1f0 con 0x7f0cd80a1510 2023-10-01T07:58:06.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.458+0000 7f0cd5d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0cd80a1510 0x7f0cd8138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:06.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.458+0000 7f0cd6d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0cd8139250 0x7f0cd813b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:06.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.458+0000 7f0cd5d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0cd80a1510 0x7f0cd8138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51534/0 (socket says 172.21.15.26:51534) 2023-10-01T07:58:06.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.458+0000 7f0cd5d9b700 1 -- 172.21.15.26:0/3514438299 learned_addr learned my addr 172.21.15.26:0/3514438299 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:06.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.459+0000 7f0cd6d9d700 1 -- 172.21.15.26:0/3514438299 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0cd80a1510 msgr2=0x7f0cd8138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:06.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.459+0000 7f0cd6d9d700 1 --2- 172.21.15.26:0/3514438299 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0cd80a1510 0x7f0cd8138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.459+0000 7f0cd6d9d700 1 -- 172.21.15.26:0/3514438299 >> v1:172.21.15.26:6789/0 conn(0x7f0cd80a0a30 legacy=0x7f0cd80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:06.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.459+0000 7f0cd6d9d700 1 -- 172.21.15.26:0/3514438299 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd809dc50 con 0x7f0cd8139250 2023-10-01T07:58:06.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.459+0000 7f0cd5d9b700 1 --2- 172.21.15.26:0/3514438299 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0cd80a1510 0x7f0cd8138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:06.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.459+0000 7f0cd6d9d700 1 --2- 172.21.15.26:0/3514438299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cd8139250 0x7f0cd813b630 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009dc0 tx=0x7f0cd000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db04253eee45725b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:06.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.459+0000 7f0cd559a700 1 -- 172.21.15.26:0/3514438299 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd000e070 con 0x7f0cd8139250 2023-10-01T07:58:06.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.459+0000 7f0cd559a700 1 -- 172.21.15.26:0/3514438299 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd000bae0 con 0x7f0cd8139250 2023-10-01T07:58:06.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.459+0000 7f0cd559a700 1 -- 172.21.15.26:0/3514438299 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd000be90 con 0x7f0cd8139250 2023-10-01T07:58:06.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.460+0000 7f0cdc8ea700 1 -- 172.21.15.26:0/3514438299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cd8139250 msgr2=0x7f0cd813b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:06.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.460+0000 7f0cdc8ea700 1 --2- 172.21.15.26:0/3514438299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cd8139250 0x7f0cd813b630 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009dc0 tx=0x7f0cd000b330 comp rx=0 tx=0).stop 2023-10-01T07:58:06.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.460+0000 7f0cdc8ea700 1 -- 172.21.15.26:0/3514438299 shutdown_connections 2023-10-01T07:58:06.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.460+0000 7f0cdc8ea700 1 --2- 172.21.15.26:0/3514438299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cd8139250 0x7f0cd813b630 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.460+0000 7f0cdc8ea700 1 --2- 172.21.15.26:0/3514438299 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0cd80a1510 0x7f0cd8138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.460+0000 7f0cdc8ea700 1 -- 172.21.15.26:0/3514438299 >> 172.21.15.26:0/3514438299 conn(0x7f0cd80a6550 msgr2=0x7f0cd80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:06.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.460+0000 7f0cdc8ea700 1 -- 172.21.15.26:0/3514438299 shutdown_connections 2023-10-01T07:58:06.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.460+0000 7f0cdc8ea700 1 -- 172.21.15.26:0/3514438299 wait complete. 2023-10-01T07:58:06.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.461+0000 7f0cdc8ea700 1 Processor -- start 2023-10-01T07:58:06.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.461+0000 7f0cdc8ea700 1 -- start start 2023-10-01T07:58:06.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.462+0000 7f0cdc8ea700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0cd80a0a30 0x7f0cd8121860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:06.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.462+0000 7f0cdc8ea700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cd80a1510 0x7f0cd8121da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:06.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.462+0000 7f0cdc8ea700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0cd8139250 0x7f0cd81222e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:06.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.462+0000 7f0cdc8ea700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd81234f0 con 0x7f0cd80a1510 2023-10-01T07:58:06.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.462+0000 7f0cdc8ea700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd8125010 con 0x7f0cd8139250 2023-10-01T07:58:06.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.462+0000 7f0cdc8ea700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd8138ad0 con 0x7f0cd80a0a30 2023-10-01T07:58:06.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.462+0000 7f0cd6d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0cd8139250 0x7f0cd81222e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:06.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.462+0000 7f0cd6d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0cd8139250 0x7f0cd81222e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51548/0 (socket says 172.21.15.26:51548) 2023-10-01T07:58:06.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.462+0000 7f0cd6d9d700 1 -- 172.21.15.26:0/1491226178 learned_addr learned my addr 172.21.15.26:0/1491226178 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:06.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.462+0000 7f0cd5d9b700 1 --2- 172.21.15.26:0/1491226178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cd80a1510 0x7f0cd8121da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:06.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.462+0000 7f0cd6d9d700 1 -- 172.21.15.26:0/1491226178 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0cd80a0a30 msgr2=0x7f0cd8121860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:06.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.462+0000 7f0cd6d9d700 1 --2- 172.21.15.26:0/1491226178 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0cd80a0a30 0x7f0cd8121860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.462+0000 7f0cd6d9d700 1 -- 172.21.15.26:0/1491226178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cd80a1510 msgr2=0x7f0cd8121da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:06.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.462+0000 7f0cd6d9d700 1 --2- 172.21.15.26:0/1491226178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cd80a1510 0x7f0cd8121da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.462+0000 7f0cd6d9d700 1 -- 172.21.15.26:0/1491226178 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ccc009550 con 0x7f0cd8139250 2023-10-01T07:58:06.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.463+0000 7f0cd6d9d700 1 --2- 172.21.15.26:0/1491226178 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0cd8139250 0x7f0cd81222e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0cd000b370 tx=0x7f0cd0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:06.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.463+0000 7f0cc6ffd700 1 -- 172.21.15.26:0/1491226178 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0004680 con 0x7f0cd8139250 2023-10-01T07:58:06.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.463+0000 7f0cc6ffd700 1 -- 172.21.15.26:0/1491226178 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd0020070 con 0x7f0cd8139250 2023-10-01T07:58:06.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.463+0000 7f0cc6ffd700 1 -- 172.21.15.26:0/1491226178 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0027480 con 0x7f0cd8139250 2023-10-01T07:58:06.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.463+0000 7f0cdc8ea700 1 -- 172.21.15.26:0/1491226178 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd0009a70 con 0x7f0cd8139250 2023-10-01T07:58:06.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.463+0000 7f0cdc8ea700 1 -- 172.21.15.26:0/1491226178 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd8123bd0 con 0x7f0cd8139250 2023-10-01T07:58:06.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.464+0000 7f0cc6ffd700 1 -- 172.21.15.26:0/1491226178 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0cd00275e0 con 0x7f0cd8139250 2023-10-01T07:58:06.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.464+0000 7f0cc6ffd700 1 -- 172.21.15.26:0/1491226178 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0cd0022070 con 0x7f0cd8139250 2023-10-01T07:58:06.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.464+0000 7f0cdc8ea700 1 -- 172.21.15.26:0/1491226178 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cd8074ea0 con 0x7f0cd8139250 2023-10-01T07:58:06.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.469+0000 7f0cc6ffd700 1 -- 172.21.15.26:0/1491226178 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0cd0011980 con 0x7f0cd8139250 2023-10-01T07:58:06.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.533+0000 7f15356cd700 1 Processor -- start 2023-10-01T07:58:06.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.533+0000 7f15356cd700 1 -- start start 2023-10-01T07:58:06.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.534+0000 7f15356cd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f153009e1d0 0x7f1530138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:06.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.534+0000 7f15356cd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1530139170 0x7f153013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:06.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.534+0000 7f15356cd700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f153009b120 con 0x7f153009d6f0 2023-10-01T07:58:06.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.534+0000 7f15356cd700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f153006b460 con 0x7f153009e1d0 2023-10-01T07:58:06.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.534+0000 7f15356cd700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f153009a7e0 con 0x7f1530139170 2023-10-01T07:58:06.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.534+0000 7f152e7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f153009e1d0 0x7f1530138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:06.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.534+0000 7f152e7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f153009e1d0 0x7f1530138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49686/0 (socket says 172.21.15.26:49686) 2023-10-01T07:58:06.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.534+0000 7f152e7fc700 1 -- 172.21.15.26:0/2253677449 learned_addr learned my addr 172.21.15.26:0/2253677449 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:06.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.534+0000 7f152e7fc700 1 -- 172.21.15.26:0/2253677449 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1530139170 msgr2=0x7f153013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:06.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.534+0000 7f152f7fe700 1 --2- 172.21.15.26:0/2253677449 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1530139170 0x7f153013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:06.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.534+0000 7f152e7fc700 1 --2- 172.21.15.26:0/2253677449 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1530139170 0x7f153013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.534+0000 7f152e7fc700 1 -- 172.21.15.26:0/2253677449 >> v1:172.21.15.26:6789/0 conn(0x7f153009d6f0 legacy=0x7f153009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:06.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.534+0000 7f152e7fc700 1 -- 172.21.15.26:0/2253677449 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f153009a500 con 0x7f153009e1d0 2023-10-01T07:58:06.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.534+0000 7f152f7fe700 1 --2- 172.21.15.26:0/2253677449 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1530139170 0x7f153013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:58:06.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.535+0000 7f152e7fc700 1 --2- 172.21.15.26:0/2253677449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f153009e1d0 0x7f1530138c30 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f1524009920 tx=0x7f1524009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e351dbf5193baf21 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:06.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.535+0000 7f152dffb700 1 -- 172.21.15.26:0/2253677449 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152400ba20 con 0x7f153009e1d0 2023-10-01T07:58:06.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.535+0000 7f152dffb700 1 -- 172.21.15.26:0/2253677449 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152400bb80 con 0x7f153009e1d0 2023-10-01T07:58:06.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.535+0000 7f152dffb700 1 -- 172.21.15.26:0/2253677449 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1524009e70 con 0x7f153009e1d0 2023-10-01T07:58:06.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.536+0000 7f15356cd700 1 -- 172.21.15.26:0/2253677449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f153009e1d0 msgr2=0x7f1530138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:06.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.536+0000 7f15356cd700 1 --2- 172.21.15.26:0/2253677449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f153009e1d0 0x7f1530138c30 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f1524009920 tx=0x7f1524009c30 comp rx=0 tx=0).stop 2023-10-01T07:58:06.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.536+0000 7f15356cd700 1 -- 172.21.15.26:0/2253677449 shutdown_connections 2023-10-01T07:58:06.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.536+0000 7f15356cd700 1 --2- 172.21.15.26:0/2253677449 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1530139170 0x7f153013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.536+0000 7f15356cd700 1 --2- 172.21.15.26:0/2253677449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f153009e1d0 0x7f1530138c30 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.536+0000 7f15356cd700 1 -- 172.21.15.26:0/2253677449 >> 172.21.15.26:0/2253677449 conn(0x7f1530066f50 msgr2=0x7f153009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:06.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.536+0000 7f15356cd700 1 -- 172.21.15.26:0/2253677449 shutdown_connections 2023-10-01T07:58:06.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.536+0000 7f15356cd700 1 -- 172.21.15.26:0/2253677449 wait complete. 2023-10-01T07:58:06.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.538+0000 7f15356cd700 1 Processor -- start 2023-10-01T07:58:06.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.538+0000 7f15356cd700 1 -- start start 2023-10-01T07:58:06.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.538+0000 7f15356cd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f153009d6f0 0x7f15301c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:06.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.538+0000 7f15356cd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f153009e1d0 0x7f15301c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:06.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.538+0000 7f15356cd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1530139170 0x7f153011e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:06.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.538+0000 7f15356cd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153011fc10 con 0x7f153009e1d0 2023-10-01T07:58:06.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.538+0000 7f15356cd700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1530120350 con 0x7f1530139170 2023-10-01T07:58:06.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.538+0000 7f15356cd700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1530120540 con 0x7f153009d6f0 2023-10-01T07:58:06.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.539+0000 7f152e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f153009e1d0 0x7f15301c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:06.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.539+0000 7f152e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f153009e1d0 0x7f15301c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49702/0 (socket says 172.21.15.26:49702) 2023-10-01T07:58:06.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.539+0000 7f152e7fc700 1 -- 172.21.15.26:0/3567819208 learned_addr learned my addr 172.21.15.26:0/3567819208 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:06.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.539+0000 7f152f7fe700 1 --2- 172.21.15.26:0/3567819208 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1530139170 0x7f153011e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:06.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.539+0000 7f152effd700 1 --2- 172.21.15.26:0/3567819208 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f153009d6f0 0x7f15301c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:06.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.539+0000 7f152e7fc700 1 -- 172.21.15.26:0/3567819208 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f153009d6f0 msgr2=0x7f15301c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:06.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.539+0000 7f152e7fc700 1 --2- 172.21.15.26:0/3567819208 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f153009d6f0 0x7f15301c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.539+0000 7f152e7fc700 1 -- 172.21.15.26:0/3567819208 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1530139170 msgr2=0x7f153011e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:06.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.539+0000 7f152e7fc700 1 --2- 172.21.15.26:0/3567819208 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1530139170 0x7f153011e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.539+0000 7f152e7fc700 1 -- 172.21.15.26:0/3567819208 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1524009550 con 0x7f153009e1d0 2023-10-01T07:58:06.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.539+0000 7f152e7fc700 1 --2- 172.21.15.26:0/3567819208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f153009e1d0 0x7f15301c8a30 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f1524000c00 tx=0x7f1524004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:06.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.539+0000 7f15177fe700 1 -- 172.21.15.26:0/3567819208 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1524004380 con 0x7f153009e1d0 2023-10-01T07:58:06.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.540+0000 7f15177fe700 1 -- 172.21.15.26:0/3567819208 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152401f070 con 0x7f153009e1d0 2023-10-01T07:58:06.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.540+0000 7f15356cd700 1 -- 172.21.15.26:0/3567819208 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1530134610 con 0x7f153009e1d0 2023-10-01T07:58:06.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.540+0000 7f15356cd700 1 -- 172.21.15.26:0/3567819208 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15300a2b10 con 0x7f153009e1d0 2023-10-01T07:58:06.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.540+0000 7f15177fe700 1 -- 172.21.15.26:0/3567819208 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15240036a0 con 0x7f153009e1d0 2023-10-01T07:58:06.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.540+0000 7f15177fe700 1 -- 172.21.15.26:0/3567819208 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1524021030 con 0x7f153009e1d0 2023-10-01T07:58:06.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.541+0000 7f15177fe700 1 -- 172.21.15.26:0/3567819208 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1524040bc0 con 0x7f153009e1d0 2023-10-01T07:58:06.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.541+0000 7f15356cd700 1 -- 172.21.15.26:0/3567819208 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15100052e0 con 0x7f153009e1d0 2023-10-01T07:58:06.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.551+0000 7f15177fe700 1 -- 172.21.15.26:0/3567819208 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1524019590 con 0x7f153009e1d0 2023-10-01T07:58:06.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.655+0000 7f5afbcaf700 1 -- 172.21.15.26:0/3654762618 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5af411e600 con 0x7f5af4139030 2023-10-01T07:58:06.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.656+0000 7f5aea7fc700 1 -- 172.21.15.26:0/3654762618 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5af411e600 con 0x7f5af4139030 2023-10-01T07:58:06.657 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:06.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.658+0000 7f7fa73f6700 1 -- 172.21.15.26:0/2949235304 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7fa01a2980 con 0x7f7fa009e930 2023-10-01T07:58:06.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.658+0000 7f7f95ffb700 1 -- 172.21.15.26:0/2949235304 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7f9c024030 con 0x7f7fa009e930 2023-10-01T07:58:06.659 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:06.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.658+0000 7f5afbcaf700 1 -- 172.21.15.26:0/3654762618 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5af4139030 msgr2=0x7f5af41c8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:06.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.658+0000 7f5afbcaf700 1 --2- 172.21.15.26:0/3654762618 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5af4139030 0x7f5af41c8320 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00b370 tx=0x7f5aec004ad0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.658+0000 7f5afbcaf700 1 -- 172.21.15.26:0/3654762618 shutdown_connections 2023-10-01T07:58:06.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.658+0000 7f5afbcaf700 1 --2- 172.21.15.26:0/3654762618 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5af4139030 0x7f5af41c8320 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.658+0000 7f5afbcaf700 1 --2- 172.21.15.26:0/3654762618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5af41338a0 0x7f5af411b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.658+0000 7f5afbcaf700 1 --2- 172.21.15.26:0/3654762618 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5af4136710 0x7f5af411bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.658+0000 7f5afbcaf700 1 -- 172.21.15.26:0/3654762618 >> 172.21.15.26:0/3654762618 conn(0x7f5af40a2aa0 msgr2=0x7f5af41371e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:06.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.659+0000 7f5afbcaf700 1 -- 172.21.15.26:0/3654762618 shutdown_connections 2023-10-01T07:58:06.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.661+0000 7f5afbcaf700 1 -- 172.21.15.26:0/3654762618 wait complete. 2023-10-01T07:58:06.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.661+0000 7f7fa73f6700 1 -- 172.21.15.26:0/2949235304 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7fa009e930 msgr2=0x7f7fa01c3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:06.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.661+0000 7f7fa73f6700 1 --2- 172.21.15.26:0/2949235304 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7fa009e930 0x7f7fa01c3db0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c019000 tx=0x7f7f9c004750 comp rx=0 tx=0).stop 2023-10-01T07:58:06.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.661+0000 7f7fa73f6700 1 -- 172.21.15.26:0/2949235304 shutdown_connections 2023-10-01T07:58:06.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.661+0000 7f7fa73f6700 1 --2- 172.21.15.26:0/2949235304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fa009f650 0x7f7fa01c4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.661+0000 7f7fa73f6700 1 --2- 172.21.15.26:0/2949235304 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7fa009e930 0x7f7fa01c3db0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.661+0000 7f7fa73f6700 1 --2- 172.21.15.26:0/2949235304 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7fa009f240 0x7f7fa01c42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.661+0000 7f7fa73f6700 1 -- 172.21.15.26:0/2949235304 >> 172.21.15.26:0/2949235304 conn(0x7f7fa00a4210 msgr2=0x7f7fa01b7890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:06.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.662+0000 7f7fa73f6700 1 -- 172.21.15.26:0/2949235304 shutdown_connections 2023-10-01T07:58:06.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.662+0000 7f7fa73f6700 1 -- 172.21.15.26:0/2949235304 wait complete. 2023-10-01T07:58:06.676 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:06.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.681+0000 7f0cdc8ea700 1 -- 172.21.15.26:0/1491226178 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0cd8124cb0 con 0x7f0cd8139250 2023-10-01T07:58:06.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:06.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.682+0000 7f0cc6ffd700 1 -- 172.21.15.26:0/1491226178 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0cd8124cb0 con 0x7f0cd8139250 2023-10-01T07:58:06.683 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:06.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.685+0000 7f0cdc8ea700 1 -- 172.21.15.26:0/1491226178 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0cd8139250 msgr2=0x7f0cd81222e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:06.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.685+0000 7f0cdc8ea700 1 --2- 172.21.15.26:0/1491226178 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0cd8139250 0x7f0cd81222e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0cd000b370 tx=0x7f0cd0004ad0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.685+0000 7f0cdc8ea700 1 -- 172.21.15.26:0/1491226178 shutdown_connections 2023-10-01T07:58:06.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.685+0000 7f0cdc8ea700 1 --2- 172.21.15.26:0/1491226178 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0cd8139250 0x7f0cd81222e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.685+0000 7f0cdc8ea700 1 --2- 172.21.15.26:0/1491226178 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0cd80a0a30 0x7f0cd8121860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.685+0000 7f0cdc8ea700 1 --2- 172.21.15.26:0/1491226178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cd80a1510 0x7f0cd8121da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.685+0000 7f0cdc8ea700 1 -- 172.21.15.26:0/1491226178 >> 172.21.15.26:0/1491226178 conn(0x7f0cd80a6550 msgr2=0x7f0cd8137b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:06.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.685+0000 7f0cdc8ea700 1 -- 172.21.15.26:0/1491226178 shutdown_connections 2023-10-01T07:58:06.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.685+0000 7f0cdc8ea700 1 -- 172.21.15.26:0/1491226178 wait complete. 2023-10-01T07:58:06.702 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:06.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.784+0000 7f15356cd700 1 -- 172.21.15.26:0/3567819208 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1510005590 con 0x7f153009e1d0 2023-10-01T07:58:06.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.784+0000 7f15177fe700 1 -- 172.21.15.26:0/3567819208 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1524015030 con 0x7f153009e1d0 2023-10-01T07:58:06.785 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:06.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.786+0000 7f15356cd700 1 -- 172.21.15.26:0/3567819208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f153009e1d0 msgr2=0x7f15301c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:06.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.786+0000 7f15356cd700 1 --2- 172.21.15.26:0/3567819208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f153009e1d0 0x7f15301c8a30 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f1524000c00 tx=0x7f1524004750 comp rx=0 tx=0).stop 2023-10-01T07:58:06.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.786+0000 7f15356cd700 1 -- 172.21.15.26:0/3567819208 shutdown_connections 2023-10-01T07:58:06.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.786+0000 7f15356cd700 1 --2- 172.21.15.26:0/3567819208 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1530139170 0x7f153011e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.786+0000 7f15356cd700 1 --2- 172.21.15.26:0/3567819208 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f153009d6f0 0x7f15301c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.786+0000 7f15356cd700 1 --2- 172.21.15.26:0/3567819208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f153009e1d0 0x7f15301c8a30 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:06.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.786+0000 7f15356cd700 1 -- 172.21.15.26:0/3567819208 >> 172.21.15.26:0/3567819208 conn(0x7f1530066f50 msgr2=0x7f15300a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:06.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.786+0000 7f15356cd700 1 -- 172.21.15.26:0/3567819208 shutdown_connections 2023-10-01T07:58:06.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:06.787+0000 7f15356cd700 1 -- 172.21.15.26:0/3567819208 wait complete. 2023-10-01T07:58:06.800 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:07.678 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:07.683 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:07.703 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:07.801 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:07.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.828+0000 7f01784a3700 1 Processor -- start 2023-10-01T07:58:07.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.828+0000 7f01784a3700 1 -- start start 2023-10-01T07:58:07.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.829+0000 7f01784a3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f01701338a0 0x7f0170133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:07.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.829+0000 7f01784a3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f017009de50 0x7f017009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:07.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.829+0000 7f01784a3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f017009e760 0x7f017013a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:07.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.829+0000 7f01784a3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f017006fef0 con 0x7f017009de50 2023-10-01T07:58:07.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.829+0000 7f01784a3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f017006ef30 con 0x7f017009e760 2023-10-01T07:58:07.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.829+0000 7f01784a3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01701334b0 con 0x7f01701338a0 2023-10-01T07:58:07.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.829+0000 7f0175a3e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f017009de50 0x7f017009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:07.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.829+0000 7f017623f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f01701338a0 0x7f0170133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:07.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.829+0000 7f0176a40700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f017009e760 0x7f017013a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:07.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.829+0000 7f0175a3e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f017009de50 0x7f017009e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49718/0 (socket says 172.21.15.26:49718) 2023-10-01T07:58:07.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.829+0000 7f0175a3e700 1 -- 172.21.15.26:0/3335787992 learned_addr learned my addr 172.21.15.26:0/3335787992 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:07.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.830+0000 7f0175a3e700 1 -- 172.21.15.26:0/3335787992 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f01701338a0 msgr2=0x7f0170133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:07.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.830+0000 7f0175a3e700 1 --2- 172.21.15.26:0/3335787992 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f01701338a0 0x7f0170133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:07.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.830+0000 7f0175a3e700 1 -- 172.21.15.26:0/3335787992 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f017009e760 msgr2=0x7f017013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:07.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.830+0000 7f0175a3e700 1 --2- 172.21.15.26:0/3335787992 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f017009e760 0x7f017013a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:07.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.830+0000 7f0175a3e700 1 -- 172.21.15.26:0/3335787992 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f017006fc30 con 0x7f017009de50 2023-10-01T07:58:07.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.830+0000 7f0175a3e700 1 --2- 172.21.15.26:0/3335787992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f017009de50 0x7f017009e220 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f01600098f0 tx=0x7f0160009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c75113f29aa83889 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:07.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.830+0000 7f017523d700 1 -- 172.21.15.26:0/3335787992 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0160011830 con 0x7f017009de50 2023-10-01T07:58:07.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.830+0000 7f017523d700 1 -- 172.21.15.26:0/3335787992 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0160011990 con 0x7f017009de50 2023-10-01T07:58:07.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.830+0000 7f017523d700 1 -- 172.21.15.26:0/3335787992 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0160011d20 con 0x7f017009de50 2023-10-01T07:58:07.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.831+0000 7f01784a3700 1 -- 172.21.15.26:0/3335787992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f017009de50 msgr2=0x7f017009e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:07.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.831+0000 7f01784a3700 1 --2- 172.21.15.26:0/3335787992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f017009de50 0x7f017009e220 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f01600098f0 tx=0x7f0160009c00 comp rx=0 tx=0).stop 2023-10-01T07:58:07.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.831+0000 7f01784a3700 1 -- 172.21.15.26:0/3335787992 shutdown_connections 2023-10-01T07:58:07.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.831+0000 7f01784a3700 1 --2- 172.21.15.26:0/3335787992 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f017009e760 0x7f017013a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:07.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.831+0000 7f01784a3700 1 --2- 172.21.15.26:0/3335787992 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f01701338a0 0x7f0170133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:07.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.831+0000 7f01784a3700 1 --2- 172.21.15.26:0/3335787992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f017009de50 0x7f017009e220 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:07.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.831+0000 7f01784a3700 1 -- 172.21.15.26:0/3335787992 >> 172.21.15.26:0/3335787992 conn(0x7f01700a2aa0 msgr2=0x7f01700a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:07.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.831+0000 7f01784a3700 1 -- 172.21.15.26:0/3335787992 shutdown_connections 2023-10-01T07:58:07.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.831+0000 7f01784a3700 1 -- 172.21.15.26:0/3335787992 wait complete. 2023-10-01T07:58:07.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.832+0000 7f01784a3700 1 Processor -- start 2023-10-01T07:58:07.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.832+0000 7f01784a3700 1 -- start start 2023-10-01T07:58:07.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.833+0000 7f01784a3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f017009de50 0x7f017011d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:07.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.833+0000 7f01784a3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f017009e760 0x7f017011dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:07.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.833+0000 7f01784a3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f01701338a0 0x7f017011e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:07.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.833+0000 7f01784a3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0170120fe0 con 0x7f017009e760 2023-10-01T07:58:07.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.833+0000 7f01784a3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f017011f330 con 0x7f01701338a0 2023-10-01T07:58:07.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.833+0000 7f01784a3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f017011f930 con 0x7f017009de50 2023-10-01T07:58:07.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.833+0000 7f0176a40700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f01701338a0 0x7f017011e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:07.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.833+0000 7f0176a40700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f01701338a0 0x7f017011e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51570/0 (socket says 172.21.15.26:51570) 2023-10-01T07:58:07.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.833+0000 7f0176a40700 1 -- 172.21.15.26:0/435223972 learned_addr learned my addr 172.21.15.26:0/435223972 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:07.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.833+0000 7f017623f700 1 --2- 172.21.15.26:0/435223972 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f017009de50 0x7f017011d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:07.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.833+0000 7f0175a3e700 1 --2- 172.21.15.26:0/435223972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f017009e760 0x7f017011dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:07.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.834+0000 7f0176a40700 1 -- 172.21.15.26:0/435223972 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f017009de50 msgr2=0x7f017011d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:07.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.834+0000 7f0176a40700 1 --2- 172.21.15.26:0/435223972 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f017009de50 0x7f017011d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:07.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.834+0000 7f0176a40700 1 -- 172.21.15.26:0/435223972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f017009e760 msgr2=0x7f017011dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:07.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.834+0000 7f0176a40700 1 --2- 172.21.15.26:0/435223972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f017009e760 0x7f017011dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:07.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.834+0000 7f0176a40700 1 -- 172.21.15.26:0/435223972 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0160009550 con 0x7f01701338a0 2023-10-01T07:58:07.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.834+0000 7f0175a3e700 1 --2- 172.21.15.26:0/435223972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f017009e760 0x7f017011dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:07.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.834+0000 7f0176a40700 1 --2- 172.21.15.26:0/435223972 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f01701338a0 0x7f017011e280 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f0168009dd0 tx=0x7f016800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:07.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.834+0000 7f0166ffd700 1 -- 172.21.15.26:0/435223972 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0168009c40 con 0x7f01701338a0 2023-10-01T07:58:07.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.834+0000 7f0166ffd700 1 -- 172.21.15.26:0/435223972 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016800f040 con 0x7f01701338a0 2023-10-01T07:58:07.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.834+0000 7f01784a3700 1 -- 172.21.15.26:0/435223972 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0170120560 con 0x7f01701338a0 2023-10-01T07:58:07.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.834+0000 7f0166ffd700 1 -- 172.21.15.26:0/435223972 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016800ceb0 con 0x7f01701338a0 2023-10-01T07:58:07.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.835+0000 7f01784a3700 1 -- 172.21.15.26:0/435223972 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f017006f640 con 0x7f01701338a0 2023-10-01T07:58:07.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.836+0000 7f0166ffd700 1 -- 172.21.15.26:0/435223972 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0168014480 con 0x7f01701338a0 2023-10-01T07:58:07.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.836+0000 7f0166ffd700 1 -- 172.21.15.26:0/435223972 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f016803ff00 con 0x7f01701338a0 2023-10-01T07:58:07.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.836+0000 7f01784a3700 1 -- 172.21.15.26:0/435223972 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f017011a470 con 0x7f01701338a0 2023-10-01T07:58:07.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.841+0000 7f0166ffd700 1 -- 172.21.15.26:0/435223972 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0168018020 con 0x7f01701338a0 2023-10-01T07:58:07.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.871+0000 7fb8845b9700 1 Processor -- start 2023-10-01T07:58:07.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.871+0000 7fb8845b9700 1 -- start start 2023-10-01T07:58:07.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.872+0000 7fb8845b9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb87c12cf60 0x7fb87c06f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:07.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.872+0000 7f9069c75700 1 Processor -- start 2023-10-01T07:58:07.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.872+0000 7f9069c75700 1 -- start start 2023-10-01T07:58:07.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.872+0000 7fb8845b9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb87c130430 0x7fb87c137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:07.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.872+0000 7fb8845b9700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb87c12cd90 con 0x7fb87c12f8b0 2023-10-01T07:58:07.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.872+0000 7fb8845b9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c12d330 con 0x7fb87c130430 2023-10-01T07:58:07.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.872+0000 7fb8845b9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c071780 con 0x7fb87c12cf60 2023-10-01T07:58:07.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.872+0000 7fb882355700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb87c12cf60 0x7fb87c06f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:07.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.872+0000 7fb882355700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb87c12cf60 0x7fb87c06f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:33730/0 (socket says 172.21.15.26:33730) 2023-10-01T07:58:07.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.872+0000 7fb882355700 1 -- 172.21.15.26:0/1808750148 learned_addr learned my addr 172.21.15.26:0/1808750148 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:07.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.872+0000 7fb882b56700 1 --2- 172.21.15.26:0/1808750148 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb87c130430 0x7fb87c137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:07.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.873+0000 7f9069c75700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f906412cf60 0x7f906406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:07.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.873+0000 7fb882b56700 1 -- 172.21.15.26:0/1808750148 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb87c12cf60 msgr2=0x7fb87c06f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:07.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.873+0000 7fb882b56700 1 --2- 172.21.15.26:0/1808750148 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb87c12cf60 0x7fb87c06f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:07.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.873+0000 7fb882b56700 1 -- 172.21.15.26:0/1808750148 >> v1:172.21.15.26:6789/0 conn(0x7fb87c12f8b0 legacy=0x7fb87c12fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:07.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.873+0000 7fb882b56700 1 -- 172.21.15.26:0/1808750148 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb87c071a40 con 0x7fb87c130430 2023-10-01T07:58:07.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.873+0000 7f9069c75700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9064130430 0x7f9064137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:07.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.873+0000 7f9069c75700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f906412cd90 con 0x7f906412f8b0 2023-10-01T07:58:07.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.873+0000 7f9069c75700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f906412d330 con 0x7f9064130430 2023-10-01T07:58:07.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.873+0000 7f9069c75700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9064071780 con 0x7f906412cf60 2023-10-01T07:58:07.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.873+0000 7f9062ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f906412f8b0 0x7f906412fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46472/0 (socket says 172.21.15.26:46472) 2023-10-01T07:58:07.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.873+0000 7f9062ffd700 1 -- 172.21.15.26:0/2462525158 learned_addr learned my addr 172.21.15.26:0/2462525158 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:07.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.873+0000 7f9063fff700 1 --2- 172.21.15.26:0/2462525158 >> v2:172.21.15.26:3300/0 conn(0x7f9064130430 0x7f9064137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:07.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.873+0000 7fb882b56700 1 --2- 172.21.15.26:0/1808750148 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb87c130430 0x7fb87c137c30 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb87400bfd0 tx=0x7fb87400d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1cf79375103d83f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:07.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.873+0000 7f90627fc700 1 -- 172.21.15.26:0/2462525158 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3483377803 0 0) 0x7f906412cd90 con 0x7f906412f8b0 2023-10-01T07:58:07.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.873+0000 7f90627fc700 1 -- 172.21.15.26:0/2462525158 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f904c0035b0 con 0x7f906412f8b0 2023-10-01T07:58:07.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.873+0000 7fb881353700 1 -- 172.21.15.26:0/1808750148 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb874010070 con 0x7fb87c130430 2023-10-01T07:58:07.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.874+0000 7fb881353700 1 -- 172.21.15.26:0/1808750148 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb87400da30 con 0x7fb87c130430 2023-10-01T07:58:07.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.874+0000 7fb881353700 1 -- 172.21.15.26:0/1808750148 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87400dde0 con 0x7fb87c130430 2023-10-01T07:58:07.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.874+0000 7f90627fc700 1 -- 172.21.15.26:0/2462525158 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2864287757 0 0) 0x7f904c0035b0 con 0x7f906412f8b0 2023-10-01T07:58:07.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.874+0000 7f90627fc700 1 -- 172.21.15.26:0/2462525158 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f906412cf60 msgr2=0x7f906406f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:07.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.874+0000 7f90627fc700 1 --2- 172.21.15.26:0/2462525158 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f906412cf60 0x7f906406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:07.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.874+0000 7f90627fc700 1 -- 172.21.15.26:0/2462525158 >> v2:172.21.15.26:3300/0 conn(0x7f9064130430 msgr2=0x7f9064137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:07.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.874+0000 7f90627fc700 1 --2- 172.21.15.26:0/2462525158 >> v2:172.21.15.26:3300/0 conn(0x7f9064130430 0x7f9064137c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:07.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.874+0000 7f90627fc700 1 -- 172.21.15.26:0/2462525158 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9064071a40 con 0x7f906412f8b0 2023-10-01T07:58:07.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.874+0000 7f90627fc700 1 -- 172.21.15.26:0/2462525158 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1576910959 0 0) 0x7f9058001670 con 0x7f906412f8b0 2023-10-01T07:58:07.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.874+0000 7f9063fff700 1 --2- 172.21.15.26:0/2462525158 >> v2:172.21.15.26:3300/0 conn(0x7f9064130430 0x7f9064137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:07.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.874+0000 7f90627fc700 1 -- 172.21.15.26:0/2462525158 >> v1:172.21.15.26:6789/0 conn(0x7f906412f8b0 legacy=0x7f906412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:07.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.874+0000 7f90627fc700 1 --2- 172.21.15.26:0/2462525158 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f904c003a00 0x7f904c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:07.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.874+0000 7f90627fc700 1 --2- 172.21.15.26:0/2462525158 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f904c004850 0x7f904c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:07.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.874+0000 7f90627fc700 1 --2- 172.21.15.26:0/2462525158 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f904c005200 0x7f904c00fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:07.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.874+0000 7f90627fc700 1 -- 172.21.15.26:0/2462525158 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906412d330 con 0x7f904c004850 2023-10-01T07:58:07.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.874+0000 7f90627fc700 1 -- 172.21.15.26:0/2462525158 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9064071780 con 0x7f904c005200 2023-10-01T07:58:07.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.874+0000 7f90627fc700 1 -- 172.21.15.26:0/2462525158 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f904c005a90 con 0x7f904c003a00 2023-10-01T07:58:07.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.874+0000 7f9063fff700 1 --2- 172.21.15.26:0/2462525158 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f904c005200 0x7f904c00fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:07.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.874+0000 7f9062ffd700 1 --2- 172.21.15.26:0/2462525158 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f904c004850 0x7f904c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:07.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.874+0000 7f90637fe700 1 --2- 172.21.15.26:0/2462525158 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f904c003a00 0x7f904c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:07.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.875+0000 7f9063fff700 1 -- 172.21.15.26:0/2462525158 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f904c003a00 msgr2=0x7f904c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:07.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.875+0000 7f9063fff700 1 --2- 172.21.15.26:0/2462525158 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f904c003a00 0x7f904c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:07.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.875+0000 7f9063fff700 1 -- 172.21.15.26:0/2462525158 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f904c004850 msgr2=0x7f904c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:07.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.875+0000 7f9063fff700 1 --2- 172.21.15.26:0/2462525158 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f904c004850 0x7f904c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:07.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.875+0000 7f9063fff700 1 -- 172.21.15.26:0/2462525158 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904c0035b0 con 0x7f904c005200 2023-10-01T07:58:07.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.875+0000 7fb8845b9700 1 -- 172.21.15.26:0/1808750148 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb87c130430 msgr2=0x7fb87c137c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:07.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.875+0000 7fb8845b9700 1 --2- 172.21.15.26:0/1808750148 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb87c130430 0x7fb87c137c30 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb87400bfd0 tx=0x7fb87400d330 comp rx=0 tx=0).stop 2023-10-01T07:58:07.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.875+0000 7fb8845b9700 1 -- 172.21.15.26:0/1808750148 shutdown_connections 2023-10-01T07:58:07.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.875+0000 7fb8845b9700 1 --2- 172.21.15.26:0/1808750148 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb87c12cf60 0x7fb87c06f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:07.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.875+0000 7f9063fff700 1 --2- 172.21.15.26:0/2462525158 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f904c005200 0x7f904c00fe20 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f905c00e320 tx=0x7f904c005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d4519dad236f72b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:07.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.875+0000 7fb8845b9700 1 --2- 172.21.15.26:0/1808750148 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb87c130430 0x7fb87c137c30 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:07.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.875+0000 7fb8845b9700 1 -- 172.21.15.26:0/1808750148 >> 172.21.15.26:0/1808750148 conn(0x7fb87c0a2aa0 msgr2=0x7fb87c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:07.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.875+0000 7fb8845b9700 1 -- 172.21.15.26:0/1808750148 shutdown_connections 2023-10-01T07:58:07.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.875+0000 7fb8845b9700 1 -- 172.21.15.26:0/1808750148 wait complete. 2023-10-01T07:58:07.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.875+0000 7f90627fc700 1 -- 172.21.15.26:0/2462525158 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c00edc0 con 0x7f904c005200 2023-10-01T07:58:07.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.875+0000 7f90627fc700 1 -- 172.21.15.26:0/2462525158 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905c00f040 con 0x7f904c005200 2023-10-01T07:58:07.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.875+0000 7f90627fc700 1 -- 172.21.15.26:0/2462525158 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c0146a0 con 0x7f904c005200 2023-10-01T07:58:07.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.876+0000 7f9069c75700 1 -- 172.21.15.26:0/2462525158 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f904c005200 msgr2=0x7f904c00fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:07.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.876+0000 7f9069c75700 1 --2- 172.21.15.26:0/2462525158 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f904c005200 0x7f904c00fe20 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f905c00e320 tx=0x7f904c005880 comp rx=0 tx=0).stop 2023-10-01T07:58:07.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.876+0000 7f9063fff700 1 -- 172.21.15.26:0/2462525158 reap_dead start 2023-10-01T07:58:07.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.876+0000 7f9069c75700 1 -- 172.21.15.26:0/2462525158 shutdown_connections 2023-10-01T07:58:07.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.876+0000 7f9069c75700 1 -- 172.21.15.26:0/2462525158 >> 172.21.15.26:0/2462525158 conn(0x7f90640a2aa0 msgr2=0x7f90640a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:07.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.876+0000 7fb8845b9700 1 Processor -- start 2023-10-01T07:58:07.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.876+0000 7f9069c75700 1 -- 172.21.15.26:0/2462525158 shutdown_connections 2023-10-01T07:58:07.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.876+0000 7fb8845b9700 1 -- start start 2023-10-01T07:58:07.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.877+0000 7fb8845b9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb87c12cf60 0x7fb87c1c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:07.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.877+0000 7fb8845b9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb87c12f8b0 0x7fb87c1c17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:07.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.877+0000 7fb8845b9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb87c130430 0x7fb87c1c42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:07.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.877+0000 7fb8845b9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c09ea70 con 0x7fb87c12f8b0 2023-10-01T07:58:07.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.877+0000 7fb8845b9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c12f560 con 0x7fb87c130430 2023-10-01T07:58:07.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.877+0000 7fb8845b9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c129fa0 con 0x7fb87c12cf60 2023-10-01T07:58:07.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.877+0000 7fb881b54700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb87c12f8b0 0x7fb87c1c17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:07.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.877+0000 7f9069c75700 1 -- 172.21.15.26:0/2462525158 wait complete. 2023-10-01T07:58:07.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.877+0000 7fb881b54700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb87c12f8b0 0x7fb87c1c17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49736/0 (socket says 172.21.15.26:49736) 2023-10-01T07:58:07.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.877+0000 7fb881b54700 1 -- 172.21.15.26:0/1704674279 learned_addr learned my addr 172.21.15.26:0/1704674279 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:07.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.877+0000 7fb882b56700 1 --2- 172.21.15.26:0/1704674279 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb87c130430 0x7fb87c1c42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:07.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.877+0000 7fb881b54700 1 -- 172.21.15.26:0/1704674279 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb87c12cf60 msgr2=0x7fb87c1c12b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:58:07.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.877+0000 7fb881b54700 1 --2- 172.21.15.26:0/1704674279 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb87c12cf60 0x7fb87c1c12b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:07.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.877+0000 7fb881b54700 1 -- 172.21.15.26:0/1704674279 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb87c130430 msgr2=0x7fb87c1c42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:07.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.877+0000 7fb881b54700 1 --2- 172.21.15.26:0/1704674279 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb87c130430 0x7fb87c1c42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:07.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.877+0000 7fb881b54700 1 -- 172.21.15.26:0/1704674279 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb87400bc80 con 0x7fb87c12f8b0 2023-10-01T07:58:07.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.878+0000 7fb881b54700 1 --2- 172.21.15.26:0/1704674279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb87c12f8b0 0x7fb87c1c17f0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fb86c00c4b0 tx=0x7fb86c00c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:07.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.878+0000 7fb872ffd700 1 -- 172.21.15.26:0/1704674279 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c0052d0 con 0x7fb87c12f8b0 2023-10-01T07:58:07.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.878+0000 7fb872ffd700 1 -- 172.21.15.26:0/1704674279 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86c005430 con 0x7fb87c12f8b0 2023-10-01T07:58:07.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.878+0000 7fb872ffd700 1 -- 172.21.15.26:0/1704674279 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c0038a0 con 0x7fb87c12f8b0 2023-10-01T07:58:07.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.878+0000 7fb8845b9700 1 -- 172.21.15.26:0/1704674279 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb87c09dd70 con 0x7fb87c12f8b0 2023-10-01T07:58:07.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.878+0000 7fb8845b9700 1 -- 172.21.15.26:0/1704674279 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb87c09d100 con 0x7fb87c12f8b0 2023-10-01T07:58:07.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.878+0000 7f9069c75700 1 Processor -- start 2023-10-01T07:58:07.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.879+0000 7f9069c75700 1 -- start start 2023-10-01T07:58:07.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.879+0000 7f9069c75700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f904c005200 0x7f906409bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:07.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.879+0000 7f9069c75700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f906409c170 0x7f90641c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:07.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.879+0000 7f9069c75700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f90641c4360 0x7f90641c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:07.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.879+0000 7f9069c75700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90641c4cf0 con 0x7f904c005200 2023-10-01T07:58:07.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.879+0000 7f9069c75700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9064129fa0 con 0x7f90641c4360 2023-10-01T07:58:07.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.879+0000 7f9069c75700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f906409b620 con 0x7f906409c170 2023-10-01T07:58:07.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.879+0000 7fb872ffd700 1 -- 172.21.15.26:0/1704674279 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb86c003a00 con 0x7fb87c12f8b0 2023-10-01T07:58:07.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.880+0000 7fb8845b9700 1 -- 172.21.15.26:0/1704674279 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb87c09e2a0 con 0x7fb87c12f8b0 2023-10-01T07:58:07.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.880+0000 7fb872ffd700 1 -- 172.21.15.26:0/1704674279 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb86c03ec10 con 0x7fb87c12f8b0 2023-10-01T07:58:07.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.880+0000 7f9062ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f906409c170 0x7f90641c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:07.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.880+0000 7f9063fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f90641c4360 0x7f90641c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:07.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.880+0000 7f9062ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f906409c170 0x7f90641c3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:33756/0 (socket says 172.21.15.26:33756) 2023-10-01T07:58:07.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.880+0000 7f9062ffd700 1 -- 172.21.15.26:0/2436809511 learned_addr learned my addr 172.21.15.26:0/2436809511 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:07.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.880+0000 7f9063fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f90641c4360 0x7f90641c47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51590/0 (socket says 172.21.15.26:51590) 2023-10-01T07:58:07.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.880+0000 7f9063fff700 1 -- 172.21.15.26:0/2436809511 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f906409c170 msgr2=0x7f90641c3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:07.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.880+0000 7f9063fff700 1 --2- 172.21.15.26:0/2436809511 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f906409c170 0x7f90641c3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:07.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.880+0000 7f9063fff700 1 -- 172.21.15.26:0/2436809511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f904c005200 msgr2=0x7f906409bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:07.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.880+0000 7f9063fff700 1 --2- 172.21.15.26:0/2436809511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f904c005200 0x7f906409bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:07.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.880+0000 7f9063fff700 1 -- 172.21.15.26:0/2436809511 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f906409c5c0 con 0x7f90641c4360 2023-10-01T07:58:07.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.880+0000 7f9062ffd700 1 --2- 172.21.15.26:0/2436809511 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f906409c170 0x7f90641c3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:07.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.880+0000 7f9063fff700 1 --2- 172.21.15.26:0/2436809511 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f90641c4360 0x7f90641c47b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f905c019000 tx=0x7f905c009750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:07.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.881+0000 7f904bfff700 1 -- 172.21.15.26:0/2436809511 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c004450 con 0x7f90641c4360 2023-10-01T07:58:07.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.881+0000 7f904bfff700 1 -- 172.21.15.26:0/2436809511 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905c0045f0 con 0x7f90641c4360 2023-10-01T07:58:07.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.881+0000 7f9069c75700 1 -- 172.21.15.26:0/2436809511 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f906412f420 con 0x7f90641c4360 2023-10-01T07:58:07.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.881+0000 7f904bfff700 1 -- 172.21.15.26:0/2436809511 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c014480 con 0x7f90641c4360 2023-10-01T07:58:07.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.881+0000 7f9069c75700 1 -- 172.21.15.26:0/2436809511 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f906409d9a0 con 0x7f90641c4360 2023-10-01T07:58:07.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.882+0000 7f904bfff700 1 -- 172.21.15.26:0/2436809511 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f905c0145e0 con 0x7f90641c4360 2023-10-01T07:58:07.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.882+0000 7f904bfff700 1 -- 172.21.15.26:0/2436809511 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f905c040d40 con 0x7f90641c4360 2023-10-01T07:58:07.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.882+0000 7f9069c75700 1 -- 172.21.15.26:0/2436809511 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f906409e600 con 0x7f90641c4360 2023-10-01T07:58:07.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.887+0000 7fb872ffd700 1 -- 172.21.15.26:0/1704674279 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb86c017020 con 0x7fb87c12f8b0 2023-10-01T07:58:07.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.887+0000 7f904bfff700 1 -- 172.21.15.26:0/2436809511 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f906409e600 con 0x7f90641c4360 2023-10-01T07:58:07.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.959+0000 7f56f5cdc700 1 Processor -- start 2023-10-01T07:58:07.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.959+0000 7f56f5cdc700 1 -- start start 2023-10-01T07:58:07.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.960+0000 7f56f5cdc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f56f00a0a30 0x7f56f00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:07.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.960+0000 7f56f5cdc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f56f00a1340 0x7f56f0133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:07.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.960+0000 7f56f5cdc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f56f0133fa0 0x7f56f0134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:07.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.960+0000 7f56f5cdc700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56f009edd0 con 0x7f56f00a1340 2023-10-01T07:58:07.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.960+0000 7f56f5cdc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f009e1f0 con 0x7f56f00a0a30 2023-10-01T07:58:07.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.960+0000 7f56f5cdc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56f009dc50 con 0x7f56f0133fa0 2023-10-01T07:58:07.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.960+0000 7f56ef7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f56f00a0a30 0x7f56f00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:07.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.960+0000 7f56effff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f56f0133fa0 0x7f56f0134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:07.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.960+0000 7f56ef7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f56f00a0a30 0x7f56f00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51606/0 (socket says 172.21.15.26:51606) 2023-10-01T07:58:07.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.960+0000 7f56effff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f56f0133fa0 0x7f56f0134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:33768/0 (socket says 172.21.15.26:33768) 2023-10-01T07:58:07.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.960+0000 7f56ef7fe700 1 -- 172.21.15.26:0/2767497199 learned_addr learned my addr 172.21.15.26:0/2767497199 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:07.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.960+0000 7f56eeffd700 1 --2- 172.21.15.26:0/2767497199 >> v2:172.21.15.26:3300/0 conn(0x7f56f00a1340 0x7f56f0133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:07.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.961+0000 7f56eeffd700 1 -- 172.21.15.26:0/2767497199 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f56f0133fa0 msgr2=0x7f56f0134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:07.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.961+0000 7f56eeffd700 1 --2- 172.21.15.26:0/2767497199 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f56f0133fa0 0x7f56f0134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:07.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.961+0000 7f56eeffd700 1 -- 172.21.15.26:0/2767497199 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f56f00a0a30 msgr2=0x7f56f00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:07.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.961+0000 7f56eeffd700 1 --2- 172.21.15.26:0/2767497199 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f56f00a0a30 0x7f56f00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:07.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.961+0000 7f56eeffd700 1 -- 172.21.15.26:0/2767497199 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f00a1fe0 con 0x7f56f00a1340 2023-10-01T07:58:07.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.961+0000 7f56eeffd700 1 --2- 172.21.15.26:0/2767497199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56f00a1340 0x7f56f0133a60 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f56e4009840 tx=0x7f56e4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f66400cfe5567aff server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:07.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.961+0000 7f56ee7fc700 1 -- 172.21.15.26:0/2767497199 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e4011830 con 0x7f56f00a1340 2023-10-01T07:58:07.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.961+0000 7f56ee7fc700 1 -- 172.21.15.26:0/2767497199 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e4011990 con 0x7f56f00a1340 2023-10-01T07:58:07.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.961+0000 7f56ee7fc700 1 -- 172.21.15.26:0/2767497199 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e4011d20 con 0x7f56f00a1340 2023-10-01T07:58:07.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.962+0000 7f56f5cdc700 1 -- 172.21.15.26:0/2767497199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56f00a1340 msgr2=0x7f56f0133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:07.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.962+0000 7f56f5cdc700 1 --2- 172.21.15.26:0/2767497199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56f00a1340 0x7f56f0133a60 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f56e4009840 tx=0x7f56e4009b50 comp rx=0 tx=0).stop 2023-10-01T07:58:07.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.962+0000 7f56f5cdc700 1 -- 172.21.15.26:0/2767497199 shutdown_connections 2023-10-01T07:58:07.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.962+0000 7f56f5cdc700 1 --2- 172.21.15.26:0/2767497199 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f56f0133fa0 0x7f56f0134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:07.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.962+0000 7f56f5cdc700 1 --2- 172.21.15.26:0/2767497199 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f56f00a0a30 0x7f56f00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:07.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.962+0000 7f56f5cdc700 1 --2- 172.21.15.26:0/2767497199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56f00a1340 0x7f56f0133a60 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:07.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.962+0000 7f56f5cdc700 1 -- 172.21.15.26:0/2767497199 >> 172.21.15.26:0/2767497199 conn(0x7f56f00a6550 msgr2=0x7f56f00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:07.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.962+0000 7f56f5cdc700 1 -- 172.21.15.26:0/2767497199 shutdown_connections 2023-10-01T07:58:07.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.962+0000 7f56f5cdc700 1 -- 172.21.15.26:0/2767497199 wait complete. 2023-10-01T07:58:07.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.964+0000 7f56f5cdc700 1 Processor -- start 2023-10-01T07:58:07.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.964+0000 7f56f5cdc700 1 -- start start 2023-10-01T07:58:07.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.965+0000 7f56f5cdc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56f00a0a30 0x7f56f01201e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:07.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.965+0000 7f56f5cdc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f56f00a1340 0x7f56f0120720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:07.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.965+0000 7f56f5cdc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f56f0133fa0 0x7f56f0120c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:07.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.965+0000 7f56f5cdc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f01223c0 con 0x7f56f00a0a30 2023-10-01T07:58:07.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.965+0000 7f56f5cdc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f0123080 con 0x7f56f00a1340 2023-10-01T07:58:07.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.965+0000 7f56f5cdc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56f00a33a0 con 0x7f56f0133fa0 2023-10-01T07:58:07.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.965+0000 7f56ef7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56f00a0a30 0x7f56f01201e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:07.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.965+0000 7f56ef7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56f00a0a30 0x7f56f01201e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49766/0 (socket says 172.21.15.26:49766) 2023-10-01T07:58:07.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.965+0000 7f56ef7fe700 1 -- 172.21.15.26:0/2604975718 learned_addr learned my addr 172.21.15.26:0/2604975718 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:07.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.965+0000 7f56eeffd700 1 --2- 172.21.15.26:0/2604975718 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f56f00a1340 0x7f56f0120720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:07.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.965+0000 7f56effff700 1 --2- 172.21.15.26:0/2604975718 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f56f0133fa0 0x7f56f0120c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:07.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.965+0000 7f56ef7fe700 1 -- 172.21.15.26:0/2604975718 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f56f0133fa0 msgr2=0x7f56f0120c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:07.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.965+0000 7f56ef7fe700 1 --2- 172.21.15.26:0/2604975718 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f56f0133fa0 0x7f56f0120c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:07.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.965+0000 7f56ef7fe700 1 -- 172.21.15.26:0/2604975718 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f56f00a1340 msgr2=0x7f56f0120720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:07.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.965+0000 7f56ef7fe700 1 --2- 172.21.15.26:0/2604975718 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f56f00a1340 0x7f56f0120720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:07.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.966+0000 7f56ef7fe700 1 -- 172.21.15.26:0/2604975718 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e40094a0 con 0x7f56f00a0a30 2023-10-01T07:58:07.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.966+0000 7f56ef7fe700 1 --2- 172.21.15.26:0/2604975718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56f00a0a30 0x7f56f01201e0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f56e000e910 tx=0x7f56e000ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:07.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.966+0000 7f56d7fff700 1 -- 172.21.15.26:0/2604975718 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e00096a0 con 0x7f56f00a0a30 2023-10-01T07:58:07.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.966+0000 7f56d7fff700 1 -- 172.21.15.26:0/2604975718 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e0013680 con 0x7f56f00a0a30 2023-10-01T07:58:07.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.966+0000 7f56f5cdc700 1 -- 172.21.15.26:0/2604975718 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56f0123440 con 0x7f56f00a0a30 2023-10-01T07:58:07.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.966+0000 7f56d7fff700 1 -- 172.21.15.26:0/2604975718 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e0013a30 con 0x7f56f00a0a30 2023-10-01T07:58:07.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.966+0000 7f56f5cdc700 1 -- 172.21.15.26:0/2604975718 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56f0121da0 con 0x7f56f00a0a30 2023-10-01T07:58:07.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.967+0000 7f56d7fff700 1 -- 172.21.15.26:0/2604975718 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f56e0013b90 con 0x7f56f00a0a30 2023-10-01T07:58:07.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.967+0000 7f56d7fff700 1 -- 172.21.15.26:0/2604975718 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f56e003faf0 con 0x7f56f00a0a30 2023-10-01T07:58:07.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.968+0000 7f56f5cdc700 1 -- 172.21.15.26:0/2604975718 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56f0074ea0 con 0x7f56f00a0a30 2023-10-01T07:58:07.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:07.973+0000 7f56d7fff700 1 -- 172.21.15.26:0/2604975718 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f56e0021080 con 0x7f56f00a0a30 2023-10-01T07:58:08.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.056+0000 7f01784a3700 1 -- 172.21.15.26:0/435223972 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0170074ea0 con 0x7f01701338a0 2023-10-01T07:58:08.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.056+0000 7f0166ffd700 1 -- 172.21.15.26:0/435223972 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f01680114a0 con 0x7f01701338a0 2023-10-01T07:58:08.057 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:08.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.059+0000 7f01784a3700 1 -- 172.21.15.26:0/435223972 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f01701338a0 msgr2=0x7f017011e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:08.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.059+0000 7f01784a3700 1 --2- 172.21.15.26:0/435223972 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f01701338a0 0x7f017011e280 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f0168009dd0 tx=0x7f016800c3a0 comp rx=0 tx=0).stop 2023-10-01T07:58:08.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.059+0000 7f01784a3700 1 -- 172.21.15.26:0/435223972 shutdown_connections 2023-10-01T07:58:08.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.059+0000 7f01784a3700 1 --2- 172.21.15.26:0/435223972 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f01701338a0 0x7f017011e280 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:08.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.059+0000 7f01784a3700 1 --2- 172.21.15.26:0/435223972 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f017009de50 0x7f017011d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:08.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.059+0000 7f01784a3700 1 --2- 172.21.15.26:0/435223972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f017009e760 0x7f017011dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:08.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.059+0000 7f01784a3700 1 -- 172.21.15.26:0/435223972 >> 172.21.15.26:0/435223972 conn(0x7f01700a2aa0 msgr2=0x7f01701bae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:08.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.059+0000 7f01784a3700 1 -- 172.21.15.26:0/435223972 shutdown_connections 2023-10-01T07:58:08.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.059+0000 7f01784a3700 1 -- 172.21.15.26:0/435223972 wait complete. 2023-10-01T07:58:08.074 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:08.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.097+0000 7f9069c75700 1 -- 172.21.15.26:0/2436809511 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f906409e600 con 0x7f90641c4360 2023-10-01T07:58:08.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.098+0000 7f904bfff700 1 -- 172.21.15.26:0/2436809511 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f906409e600 con 0x7f90641c4360 2023-10-01T07:58:08.099 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:08.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.100+0000 7f9069c75700 1 -- 172.21.15.26:0/2436809511 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f90641c4360 msgr2=0x7f90641c47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:08.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.100+0000 7f9069c75700 1 --2- 172.21.15.26:0/2436809511 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f90641c4360 0x7f90641c47b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f905c019000 tx=0x7f905c009750 comp rx=0 tx=0).stop 2023-10-01T07:58:08.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.100+0000 7f9069c75700 1 -- 172.21.15.26:0/2436809511 shutdown_connections 2023-10-01T07:58:08.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.100+0000 7f9069c75700 1 --2- 172.21.15.26:0/2436809511 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f90641c4360 0x7f90641c47b0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:08.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.100+0000 7f9069c75700 1 --2- 172.21.15.26:0/2436809511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f904c005200 0x7f906409bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:08.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.100+0000 7f9069c75700 1 --2- 172.21.15.26:0/2436809511 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f906409c170 0x7f90641c3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:08.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.100+0000 7f9069c75700 1 -- 172.21.15.26:0/2436809511 >> 172.21.15.26:0/2436809511 conn(0x7f90640a2aa0 msgr2=0x7f906406e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:08.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.100+0000 7f9069c75700 1 -- 172.21.15.26:0/2436809511 shutdown_connections 2023-10-01T07:58:08.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.100+0000 7f9069c75700 1 -- 172.21.15.26:0/2436809511 wait complete. 2023-10-01T07:58:08.115 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:08.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.131+0000 7fb8845b9700 1 -- 172.21.15.26:0/1704674279 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb87c074ea0 con 0x7fb87c12f8b0 2023-10-01T07:58:08.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.132+0000 7fb872ffd700 1 -- 172.21.15.26:0/1704674279 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb86c018260 con 0x7fb87c12f8b0 2023-10-01T07:58:08.133 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:08.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.134+0000 7fb8845b9700 1 -- 172.21.15.26:0/1704674279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb87c12f8b0 msgr2=0x7fb87c1c17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:08.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.134+0000 7fb8845b9700 1 --2- 172.21.15.26:0/1704674279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb87c12f8b0 0x7fb87c1c17f0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fb86c00c4b0 tx=0x7fb86c00c7c0 comp rx=0 tx=0).stop 2023-10-01T07:58:08.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.134+0000 7fb8845b9700 1 -- 172.21.15.26:0/1704674279 shutdown_connections 2023-10-01T07:58:08.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.134+0000 7fb8845b9700 1 --2- 172.21.15.26:0/1704674279 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb87c130430 0x7fb87c1c42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:08.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.134+0000 7fb8845b9700 1 --2- 172.21.15.26:0/1704674279 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb87c12cf60 0x7fb87c1c12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:08.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.134+0000 7fb8845b9700 1 --2- 172.21.15.26:0/1704674279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb87c12f8b0 0x7fb87c1c17f0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:08.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.134+0000 7fb8845b9700 1 -- 172.21.15.26:0/1704674279 >> 172.21.15.26:0/1704674279 conn(0x7fb87c0a2aa0 msgr2=0x7fb87c06e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:08.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.134+0000 7fb8845b9700 1 -- 172.21.15.26:0/1704674279 shutdown_connections 2023-10-01T07:58:08.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.134+0000 7fb8845b9700 1 -- 172.21.15.26:0/1704674279 wait complete. 2023-10-01T07:58:08.149 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:08.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.203+0000 7f56f5cdc700 1 -- 172.21.15.26:0/2604975718 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f56f00a28e0 con 0x7f56f00a0a30 2023-10-01T07:58:08.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.203+0000 7f56d7fff700 1 -- 172.21.15.26:0/2604975718 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f56e0017020 con 0x7f56f00a0a30 2023-10-01T07:58:08.204 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:08.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.205+0000 7f56f5cdc700 1 -- 172.21.15.26:0/2604975718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56f00a0a30 msgr2=0x7f56f01201e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:08.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.205+0000 7f56f5cdc700 1 --2- 172.21.15.26:0/2604975718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56f00a0a30 0x7f56f01201e0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f56e000e910 tx=0x7f56e000ec20 comp rx=0 tx=0).stop 2023-10-01T07:58:08.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.205+0000 7f56f5cdc700 1 -- 172.21.15.26:0/2604975718 shutdown_connections 2023-10-01T07:58:08.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.205+0000 7f56f5cdc700 1 --2- 172.21.15.26:0/2604975718 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f56f0133fa0 0x7f56f0120c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:08.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.205+0000 7f56f5cdc700 1 --2- 172.21.15.26:0/2604975718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56f00a0a30 0x7f56f01201e0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:08.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.205+0000 7f56f5cdc700 1 --2- 172.21.15.26:0/2604975718 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f56f00a1340 0x7f56f0120720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:08.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.206+0000 7f56f5cdc700 1 -- 172.21.15.26:0/2604975718 >> 172.21.15.26:0/2604975718 conn(0x7f56f00a6550 msgr2=0x7f56f01bb060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:08.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.206+0000 7f56f5cdc700 1 -- 172.21.15.26:0/2604975718 shutdown_connections 2023-10-01T07:58:08.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:08.206+0000 7f56f5cdc700 1 -- 172.21.15.26:0/2604975718 wait complete. 2023-10-01T07:58:08.219 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:09.075 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:09.115 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:09.150 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:09.221 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:09.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.226+0000 7fc621bd0700 1 Processor -- start 2023-10-01T07:58:09.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.226+0000 7fc621bd0700 1 -- start start 2023-10-01T07:58:09.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.227+0000 7fc621bd0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc61c1338a0 0x7fc61c133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:09.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.227+0000 7fc621bd0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc61c09e930 0x7fc61c13b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:09.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.227+0000 7fc621bd0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc61c06ef30 con 0x7fc61c09de50 2023-10-01T07:58:09.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.227+0000 7fc621bd0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc61c06fef0 con 0x7fc61c1338a0 2023-10-01T07:58:09.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.227+0000 7fc621bd0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c1334b0 con 0x7fc61c09e930 2023-10-01T07:58:09.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.227+0000 7fc61bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc61c09e930 0x7fc61c13b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:09.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.227+0000 7fc61bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc61c09e930 0x7fc61c13b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51620/0 (socket says 172.21.15.26:51620) 2023-10-01T07:58:09.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.227+0000 7fc61bfff700 1 -- 172.21.15.26:0/1476836802 learned_addr learned my addr 172.21.15.26:0/1476836802 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:09.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.227+0000 7fc61b7fe700 1 --2- 172.21.15.26:0/1476836802 >> v2:172.21.15.26:3300/0 conn(0x7fc61c1338a0 0x7fc61c133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:09.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.227+0000 7fc61bfff700 1 -- 172.21.15.26:0/1476836802 >> v2:172.21.15.26:3300/0 conn(0x7fc61c1338a0 msgr2=0x7fc61c133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:09.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.227+0000 7fc61bfff700 1 --2- 172.21.15.26:0/1476836802 >> v2:172.21.15.26:3300/0 conn(0x7fc61c1338a0 0x7fc61c133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.227+0000 7fc61bfff700 1 -- 172.21.15.26:0/1476836802 >> v1:172.21.15.26:6789/0 conn(0x7fc61c09de50 legacy=0x7fc61c09e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:09.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.227+0000 7fc61bfff700 1 -- 172.21.15.26:0/1476836802 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61c06fc30 con 0x7fc61c09e930 2023-10-01T07:58:09.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.228+0000 7fc61bfff700 1 --2- 172.21.15.26:0/1476836802 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc61c09e930 0x7fc61c13b740 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc614009e50 tx=0x7fc61400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90cf594e76a55c46 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:09.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.228+0000 7fc61a7fc700 1 -- 172.21.15.26:0/1476836802 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61400e070 con 0x7fc61c09e930 2023-10-01T07:58:09.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.228+0000 7fc61a7fc700 1 -- 172.21.15.26:0/1476836802 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61400b910 con 0x7fc61c09e930 2023-10-01T07:58:09.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.228+0000 7fc61a7fc700 1 -- 172.21.15.26:0/1476836802 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61400bcc0 con 0x7fc61c09e930 2023-10-01T07:58:09.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.229+0000 7fc621bd0700 1 -- 172.21.15.26:0/1476836802 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc61c09e930 msgr2=0x7fc61c13b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:09.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.229+0000 7fc621bd0700 1 --2- 172.21.15.26:0/1476836802 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc61c09e930 0x7fc61c13b740 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc614009e50 tx=0x7fc61400b330 comp rx=0 tx=0).stop 2023-10-01T07:58:09.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.229+0000 7fc621bd0700 1 -- 172.21.15.26:0/1476836802 shutdown_connections 2023-10-01T07:58:09.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.229+0000 7fc621bd0700 1 --2- 172.21.15.26:0/1476836802 >> v2:172.21.15.26:3300/0 conn(0x7fc61c1338a0 0x7fc61c133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.229+0000 7fc621bd0700 1 --2- 172.21.15.26:0/1476836802 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc61c09e930 0x7fc61c13b740 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.229+0000 7fc621bd0700 1 -- 172.21.15.26:0/1476836802 >> 172.21.15.26:0/1476836802 conn(0x7fc61c0a2aa0 msgr2=0x7fc61c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:09.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.229+0000 7fc621bd0700 1 -- 172.21.15.26:0/1476836802 shutdown_connections 2023-10-01T07:58:09.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.229+0000 7fc621bd0700 1 -- 172.21.15.26:0/1476836802 wait complete. 2023-10-01T07:58:09.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.230+0000 7fc621bd0700 1 Processor -- start 2023-10-01T07:58:09.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.230+0000 7fc621bd0700 1 -- start start 2023-10-01T07:58:09.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.230+0000 7fc621bd0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc61c09de50 0x7fc61c11b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:09.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.231+0000 7fc621bd0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc61c09e930 0x7fc61c11bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:09.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.231+0000 7fc621bd0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc61c1338a0 0x7fc61c11c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:09.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.231+0000 7fc621bd0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c11f390 con 0x7fc61c1338a0 2023-10-01T07:58:09.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.231+0000 7fc621bd0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c06f6b0 con 0x7fc61c09de50 2023-10-01T07:58:09.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.231+0000 7fc621bd0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c0a0fb0 con 0x7fc61c09e930 2023-10-01T07:58:09.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.231+0000 7fc61bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc61c1338a0 0x7fc61c11c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:09.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.231+0000 7fc61bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc61c1338a0 0x7fc61c11c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49776/0 (socket says 172.21.15.26:49776) 2023-10-01T07:58:09.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.231+0000 7fc61bfff700 1 -- 172.21.15.26:0/2776769259 learned_addr learned my addr 172.21.15.26:0/2776769259 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:09.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.231+0000 7fc61affd700 1 --2- 172.21.15.26:0/2776769259 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc61c09e930 0x7fc61c11bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:09.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.231+0000 7fc61b7fe700 1 --2- 172.21.15.26:0/2776769259 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc61c09de50 0x7fc61c11b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:09.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.231+0000 7fc61affd700 1 -- 172.21.15.26:0/2776769259 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc61c09de50 msgr2=0x7fc61c11b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:09.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.231+0000 7fc61affd700 1 --2- 172.21.15.26:0/2776769259 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc61c09de50 0x7fc61c11b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.231+0000 7fc61affd700 1 -- 172.21.15.26:0/2776769259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc61c1338a0 msgr2=0x7fc61c11c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:09.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.231+0000 7fc61affd700 1 --2- 172.21.15.26:0/2776769259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc61c1338a0 0x7fc61c11c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.231+0000 7fc61affd700 1 -- 172.21.15.26:0/2776769259 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc614009b30 con 0x7fc61c09e930 2023-10-01T07:58:09.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.231+0000 7fc61bfff700 1 --2- 172.21.15.26:0/2776769259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc61c1338a0 0x7fc61c11c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:09.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.231+0000 7fc61affd700 1 --2- 172.21.15.26:0/2776769259 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc61c09e930 0x7fc61c11bdb0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc610000f60 tx=0x7fc61000c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:09.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.232+0000 7fc603fff700 1 -- 172.21.15.26:0/2776769259 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6100052d0 con 0x7fc61c09e930 2023-10-01T07:58:09.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.232+0000 7fc603fff700 1 -- 172.21.15.26:0/2776769259 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc610005430 con 0x7fc61c09e930 2023-10-01T07:58:09.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.232+0000 7fc603fff700 1 -- 172.21.15.26:0/2776769259 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6100038c0 con 0x7fc61c09e930 2023-10-01T07:58:09.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.233+0000 7fc621bd0700 1 -- 172.21.15.26:0/2776769259 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc61c11dce0 con 0x7fc61c09e930 2023-10-01T07:58:09.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.233+0000 7fc621bd0700 1 -- 172.21.15.26:0/2776769259 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc61c11da90 con 0x7fc61c09e930 2023-10-01T07:58:09.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.234+0000 7fc603fff700 1 -- 172.21.15.26:0/2776769259 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc610003a20 con 0x7fc61c09e930 2023-10-01T07:58:09.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.234+0000 7fc603fff700 1 -- 172.21.15.26:0/2776769259 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc61003e720 con 0x7fc61c09e930 2023-10-01T07:58:09.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.234+0000 7fc621bd0700 1 -- 172.21.15.26:0/2776769259 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc61c0a0580 con 0x7fc61c09e930 2023-10-01T07:58:09.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.240+0000 7fc603fff700 1 -- 172.21.15.26:0/2776769259 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc61001b3b0 con 0x7fc61c09e930 2023-10-01T07:58:09.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.269+0000 7f92fe752700 1 Processor -- start 2023-10-01T07:58:09.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.269+0000 7f92fe752700 1 -- start start 2023-10-01T07:58:09.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.270+0000 7f92fe752700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92f809d9f0 0x7f92f8136530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:09.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.270+0000 7f92fe752700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f92f8136a70 0x7f92f8138e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:09.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.270+0000 7f92fe752700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92f809e130 con 0x7f92f81316c0 2023-10-01T07:58:09.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.270+0000 7f92fe752700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92f81321a0 con 0x7f92f8136a70 2023-10-01T07:58:09.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.270+0000 7f92fe752700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92f81312b0 con 0x7f92f809d9f0 2023-10-01T07:58:09.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.270+0000 7f92f77fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92f809d9f0 0x7f92f8136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:09.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.270+0000 7f92f77fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92f809d9f0 0x7f92f8136530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:33794/0 (socket says 172.21.15.26:33794) 2023-10-01T07:58:09.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.270+0000 7f92f77fe700 1 -- 172.21.15.26:0/2015941273 learned_addr learned my addr 172.21.15.26:0/2015941273 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:09.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.270+0000 7f92fccef700 1 --2- 172.21.15.26:0/2015941273 >> v2:172.21.15.26:3300/0 conn(0x7f92f8136a70 0x7f92f8138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:09.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.271+0000 7f92fccef700 1 -- 172.21.15.26:0/2015941273 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92f809d9f0 msgr2=0x7f92f8136530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:09.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.271+0000 7f92fccef700 1 --2- 172.21.15.26:0/2015941273 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92f809d9f0 0x7f92f8136530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.271+0000 7f92fccef700 1 -- 172.21.15.26:0/2015941273 >> v1:172.21.15.26:6789/0 conn(0x7f92f81316c0 legacy=0x7f92f8131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:09.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.271+0000 7f92f6ffd700 1 -- 172.21.15.26:0/2015941273 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 744226782 0 0) 0x7f92e8001110 con 0x7f92f81316c0 2023-10-01T07:58:09.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.271+0000 7f92fccef700 1 -- 172.21.15.26:0/2015941273 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f809f6e0 con 0x7f92f8136a70 2023-10-01T07:58:09.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.271+0000 7f92fccef700 1 --2- 172.21.15.26:0/2015941273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92f8136a70 0x7f92f8138e50 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f92f0009d90 tx=0x7f92f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b8ee515d689ffc server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:09.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.271+0000 7f92f6ffd700 1 -- 172.21.15.26:0/2015941273 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f000e070 con 0x7f92f8136a70 2023-10-01T07:58:09.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.271+0000 7f92f6ffd700 1 -- 172.21.15.26:0/2015941273 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f000bb20 con 0x7f92f8136a70 2023-10-01T07:58:09.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.271+0000 7f92f6ffd700 1 -- 172.21.15.26:0/2015941273 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f0012430 con 0x7f92f8136a70 2023-10-01T07:58:09.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.272+0000 7f92fe752700 1 -- 172.21.15.26:0/2015941273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92f8136a70 msgr2=0x7f92f8138e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:09.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.272+0000 7f92fe752700 1 --2- 172.21.15.26:0/2015941273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92f8136a70 0x7f92f8138e50 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f92f0009d90 tx=0x7f92f000b330 comp rx=0 tx=0).stop 2023-10-01T07:58:09.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.272+0000 7f92fe752700 1 -- 172.21.15.26:0/2015941273 shutdown_connections 2023-10-01T07:58:09.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.272+0000 7f92fe752700 1 --2- 172.21.15.26:0/2015941273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92f8136a70 0x7f92f8138e50 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.272+0000 7f92fe752700 1 --2- 172.21.15.26:0/2015941273 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92f809d9f0 0x7f92f8136530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.272+0000 7f92fe752700 1 -- 172.21.15.26:0/2015941273 >> 172.21.15.26:0/2015941273 conn(0x7f92f8066f50 msgr2=0x7f92f809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:09.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.273+0000 7f92fe752700 1 -- 172.21.15.26:0/2015941273 shutdown_connections 2023-10-01T07:58:09.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.273+0000 7f92fe752700 1 -- 172.21.15.26:0/2015941273 wait complete. 2023-10-01T07:58:09.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.274+0000 7f92fe752700 1 Processor -- start 2023-10-01T07:58:09.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.274+0000 7f92fe752700 1 -- start start 2023-10-01T07:58:09.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.275+0000 7f92fe752700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92f809d9f0 0x7f92f812ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:09.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.275+0000 7f92fe752700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92f81316c0 0x7f92f8134260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:09.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.275+0000 7f92fe752700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92f8136a70 0x7f92f81347a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:09.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.275+0000 7f92fe752700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f809b190 con 0x7f92f809d9f0 2023-10-01T07:58:09.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.275+0000 7f92fe752700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f809a700 con 0x7f92f81316c0 2023-10-01T07:58:09.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.275+0000 7f92fe752700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92f8136550 con 0x7f92f8136a70 2023-10-01T07:58:09.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.275+0000 7f92f7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92f809d9f0 0x7f92f812ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:09.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.275+0000 7f92f7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92f809d9f0 0x7f92f812ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49806/0 (socket says 172.21.15.26:49806) 2023-10-01T07:58:09.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.275+0000 7f92f7fff700 1 -- 172.21.15.26:0/3913130065 learned_addr learned my addr 172.21.15.26:0/3913130065 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:09.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.276+0000 7f92f77fe700 1 --2- 172.21.15.26:0/3913130065 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92f81316c0 0x7f92f8134260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:09.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.276+0000 7f92fccef700 1 --2- 172.21.15.26:0/3913130065 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92f8136a70 0x7f92f81347a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:09.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.276+0000 7f92f7fff700 1 -- 172.21.15.26:0/3913130065 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92f8136a70 msgr2=0x7f92f81347a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:09.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.276+0000 7f92f7fff700 1 --2- 172.21.15.26:0/3913130065 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92f8136a70 0x7f92f81347a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.276+0000 7f92f7fff700 1 -- 172.21.15.26:0/3913130065 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92f81316c0 msgr2=0x7f92f8134260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:09.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.276+0000 7f92f7fff700 1 --2- 172.21.15.26:0/3913130065 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92f81316c0 0x7f92f8134260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.276+0000 7f92f7fff700 1 -- 172.21.15.26:0/3913130065 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f0009a70 con 0x7f92f809d9f0 2023-10-01T07:58:09.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.276+0000 7f92f77fe700 1 --2- 172.21.15.26:0/3913130065 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92f81316c0 0x7f92f8134260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:58:09.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.276+0000 7f92fccef700 1 --2- 172.21.15.26:0/3913130065 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92f8136a70 0x7f92f81347a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:58:09.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.276+0000 7f92f7fff700 1 --2- 172.21.15.26:0/3913130065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92f809d9f0 0x7f92f812ae00 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f92e800c780 tx=0x7f92e800cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:09.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.276+0000 7f92f4ff9700 1 -- 172.21.15.26:0/3913130065 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e80054e0 con 0x7f92f809d9f0 2023-10-01T07:58:09.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.276+0000 7f92f4ff9700 1 -- 172.21.15.26:0/3913130065 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e8003680 con 0x7f92f809d9f0 2023-10-01T07:58:09.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.276+0000 7f92fe752700 1 -- 172.21.15.26:0/3913130065 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92f812b900 con 0x7f92f809d9f0 2023-10-01T07:58:09.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.276+0000 7f92f4ff9700 1 -- 172.21.15.26:0/3913130065 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e8003a30 con 0x7f92f809d9f0 2023-10-01T07:58:09.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.276+0000 7f92fe752700 1 -- 172.21.15.26:0/3913130065 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92f809bde0 con 0x7f92f809d9f0 2023-10-01T07:58:09.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.278+0000 7f92fe752700 1 -- 172.21.15.26:0/3913130065 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92f8074ea0 con 0x7f92f809d9f0 2023-10-01T07:58:09.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.278+0000 7f92f4ff9700 1 -- 172.21.15.26:0/3913130065 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f92e8003b90 con 0x7f92f809d9f0 2023-10-01T07:58:09.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.279+0000 7f92f4ff9700 1 -- 172.21.15.26:0/3913130065 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f92e803eef0 con 0x7f92f809d9f0 2023-10-01T07:58:09.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.287+0000 7f92f4ff9700 1 -- 172.21.15.26:0/3913130065 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f92e801b3b0 con 0x7f92f809d9f0 2023-10-01T07:58:09.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.317+0000 7fb214c20700 1 Processor -- start 2023-10-01T07:58:09.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.317+0000 7fb214c20700 1 -- start start 2023-10-01T07:58:09.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.318+0000 7fb214c20700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb21009e7e0 0x7fb21009ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:09.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.318+0000 7fb214c20700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb21009fa10 0x7fb21009f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:09.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.318+0000 7fb214c20700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb2101316a0 0x7fb210131b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:09.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.318+0000 7fb214c20700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb21009b610 con 0x7fb21009e7e0 2023-10-01T07:58:09.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.318+0000 7fb214c20700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb21009f630 con 0x7fb21009fa10 2023-10-01T07:58:09.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.318+0000 7fb214c20700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb21009bbb0 con 0x7fb2101316a0 2023-10-01T07:58:09.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.318+0000 7fb20dd9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb21009fa10 0x7fb21009f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:09.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.318+0000 7fb20dd9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb21009fa10 0x7fb21009f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51656/0 (socket says 172.21.15.26:51656) 2023-10-01T07:58:09.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.318+0000 7fb20dd9b700 1 -- 172.21.15.26:0/1184617140 learned_addr learned my addr 172.21.15.26:0/1184617140 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:09.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.318+0000 7fb20e59c700 1 --2- 172.21.15.26:0/1184617140 >> v2:172.21.15.26:3300/0 conn(0x7fb21009e7e0 0x7fb21009ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:09.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.318+0000 7fb20ed9d700 1 --2- 172.21.15.26:0/1184617140 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb2101316a0 0x7fb210131b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:09.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.319+0000 7fb20dd9b700 1 -- 172.21.15.26:0/1184617140 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb2101316a0 msgr2=0x7fb210131b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:09.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.319+0000 7fb20dd9b700 1 --2- 172.21.15.26:0/1184617140 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb2101316a0 0x7fb210131b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.319+0000 7fb20dd9b700 1 -- 172.21.15.26:0/1184617140 >> v2:172.21.15.26:3300/0 conn(0x7fb21009e7e0 msgr2=0x7fb21009ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:09.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.319+0000 7fb20dd9b700 1 --2- 172.21.15.26:0/1184617140 >> v2:172.21.15.26:3300/0 conn(0x7fb21009e7e0 0x7fb21009ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.319+0000 7fb20dd9b700 1 -- 172.21.15.26:0/1184617140 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2100a0010 con 0x7fb21009fa10 2023-10-01T07:58:09.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.319+0000 7fb20e59c700 1 --2- 172.21.15.26:0/1184617140 >> v2:172.21.15.26:3300/0 conn(0x7fb21009e7e0 0x7fb21009ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:09.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.319+0000 7fb20dd9b700 1 --2- 172.21.15.26:0/1184617140 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb21009fa10 0x7fb21009f0f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb2040098f0 tx=0x7fb204009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2439682758e4b8ba server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:09.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.319+0000 7fb20d59a700 1 -- 172.21.15.26:0/1184617140 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb204011830 con 0x7fb21009fa10 2023-10-01T07:58:09.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.319+0000 7fb20d59a700 1 -- 172.21.15.26:0/1184617140 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb204011990 con 0x7fb21009fa10 2023-10-01T07:58:09.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.319+0000 7fb20d59a700 1 -- 172.21.15.26:0/1184617140 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb204011d20 con 0x7fb21009fa10 2023-10-01T07:58:09.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.320+0000 7fb214c20700 1 -- 172.21.15.26:0/1184617140 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb21009fa10 msgr2=0x7fb21009f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:09.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.320+0000 7fb214c20700 1 --2- 172.21.15.26:0/1184617140 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb21009fa10 0x7fb21009f0f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb2040098f0 tx=0x7fb204009c00 comp rx=0 tx=0).stop 2023-10-01T07:58:09.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.320+0000 7fb214c20700 1 -- 172.21.15.26:0/1184617140 shutdown_connections 2023-10-01T07:58:09.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.320+0000 7fb214c20700 1 --2- 172.21.15.26:0/1184617140 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb2101316a0 0x7fb210131b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.320+0000 7fb214c20700 1 --2- 172.21.15.26:0/1184617140 >> v2:172.21.15.26:3300/0 conn(0x7fb21009e7e0 0x7fb21009ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.320+0000 7fb214c20700 1 --2- 172.21.15.26:0/1184617140 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb21009fa10 0x7fb21009f0f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.320+0000 7fb214c20700 1 -- 172.21.15.26:0/1184617140 >> 172.21.15.26:0/1184617140 conn(0x7fb2100a4300 msgr2=0x7fb2100a4700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:09.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.320+0000 7fb214c20700 1 -- 172.21.15.26:0/1184617140 shutdown_connections 2023-10-01T07:58:09.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.320+0000 7fb214c20700 1 -- 172.21.15.26:0/1184617140 wait complete. 2023-10-01T07:58:09.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.321+0000 7fb214c20700 1 Processor -- start 2023-10-01T07:58:09.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.321+0000 7fb214c20700 1 -- start start 2023-10-01T07:58:09.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.322+0000 7fb214c20700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb21009e7e0 0x7fb21006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:09.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.322+0000 7fb214c20700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb21009fa10 0x7fb21006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:09.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.322+0000 7fb214c20700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb2101316a0 0x7fb21006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:09.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.322+0000 7fb214c20700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2100a2290 con 0x7fb21009fa10 2023-10-01T07:58:09.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.322+0000 7fb214c20700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb210123c50 con 0x7fb21009e7e0 2023-10-01T07:58:09.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.322+0000 7fb214c20700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb210123540 con 0x7fb2101316a0 2023-10-01T07:58:09.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.322+0000 7fb20ed9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb2101316a0 0x7fb21006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:09.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.322+0000 7fb20ed9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb2101316a0 0x7fb21006c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:33826/0 (socket says 172.21.15.26:33826) 2023-10-01T07:58:09.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.322+0000 7fb20ed9d700 1 -- 172.21.15.26:0/935873894 learned_addr learned my addr 172.21.15.26:0/935873894 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:09.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.322+0000 7fb20e59c700 1 --2- 172.21.15.26:0/935873894 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb21009e7e0 0x7fb21006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:09.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.322+0000 7fb20dd9b700 1 --2- 172.21.15.26:0/935873894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb21009fa10 0x7fb21006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:09.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.322+0000 7fb20e59c700 1 -- 172.21.15.26:0/935873894 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb2101316a0 msgr2=0x7fb21006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:09.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.322+0000 7fb20e59c700 1 --2- 172.21.15.26:0/935873894 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb2101316a0 0x7fb21006c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.323+0000 7fb20e59c700 1 -- 172.21.15.26:0/935873894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb21009fa10 msgr2=0x7fb21006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:09.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.323+0000 7fb20e59c700 1 --2- 172.21.15.26:0/935873894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb21009fa10 0x7fb21006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.323+0000 7fb20e59c700 1 -- 172.21.15.26:0/935873894 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2000094a0 con 0x7fb21009e7e0 2023-10-01T07:58:09.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.323+0000 7fb20e59c700 1 --2- 172.21.15.26:0/935873894 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb21009e7e0 0x7fb21006b8b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb20000e9b0 tx=0x7fb20000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:09.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.323+0000 7fb1feffd700 1 -- 172.21.15.26:0/935873894 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20000c850 con 0x7fb21009e7e0 2023-10-01T07:58:09.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.323+0000 7fb1feffd700 1 -- 172.21.15.26:0/935873894 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb20000c9b0 con 0x7fb21009e7e0 2023-10-01T07:58:09.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.323+0000 7fb214c20700 1 -- 172.21.15.26:0/935873894 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb204009550 con 0x7fb21009e7e0 2023-10-01T07:58:09.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.323+0000 7fb1feffd700 1 -- 172.21.15.26:0/935873894 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20000cd60 con 0x7fb21009e7e0 2023-10-01T07:58:09.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.323+0000 7fb214c20700 1 -- 172.21.15.26:0/935873894 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2100a0380 con 0x7fb21009e7e0 2023-10-01T07:58:09.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.324+0000 7fb1feffd700 1 -- 172.21.15.26:0/935873894 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb200013470 con 0x7fb21009e7e0 2023-10-01T07:58:09.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.324+0000 7fb1feffd700 1 -- 172.21.15.26:0/935873894 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb20003fb50 con 0x7fb21009e7e0 2023-10-01T07:58:09.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.324+0000 7fb214c20700 1 -- 172.21.15.26:0/935873894 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb21004f2a0 con 0x7fb21009e7e0 2023-10-01T07:58:09.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.330+0000 7fb1feffd700 1 -- 172.21.15.26:0/935873894 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb20001b3b0 con 0x7fb21009e7e0 2023-10-01T07:58:09.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.376+0000 7f6066e89700 1 Processor -- start 2023-10-01T07:58:09.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.376+0000 7f6066e89700 1 -- start start 2023-10-01T07:58:09.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.376+0000 7f6066e89700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f606009d6f0 0x7f606009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:09.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.376+0000 7f6066e89700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f606009e000 0x7f6060130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:09.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.376+0000 7f6066e89700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f606009f130 con 0x7f606009e410 2023-10-01T07:58:09.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.376+0000 7f6066e89700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f606009f520 con 0x7f606009d6f0 2023-10-01T07:58:09.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.376+0000 7f6066e89700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f606009e930 con 0x7f606009e000 2023-10-01T07:58:09.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.377+0000 7f605ffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f606009e000 0x7f6060130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:09.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.377+0000 7f605ffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f606009e000 0x7f6060130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:33834/0 (socket says 172.21.15.26:33834) 2023-10-01T07:58:09.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.377+0000 7f605ffff700 1 -- 172.21.15.26:0/814118598 learned_addr learned my addr 172.21.15.26:0/814118598 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:09.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.377+0000 7f6064c25700 1 --2- 172.21.15.26:0/814118598 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f606009d6f0 0x7f606009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:09.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.377+0000 7f605ffff700 1 -- 172.21.15.26:0/814118598 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f606009d6f0 msgr2=0x7f606009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:09.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.377+0000 7f605ffff700 1 --2- 172.21.15.26:0/814118598 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f606009d6f0 0x7f606009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.377+0000 7f605ffff700 1 -- 172.21.15.26:0/814118598 >> v1:172.21.15.26:6789/0 conn(0x7f606009e410 legacy=0x7f6060130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:09.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.377+0000 7f605ffff700 1 -- 172.21.15.26:0/814118598 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606009b2d0 con 0x7f606009e000 2023-10-01T07:58:09.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.377+0000 7f605f7fe700 1 -- 172.21.15.26:0/814118598 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2046188653 0 0) 0x7f606009f130 con 0x7f606009e410 2023-10-01T07:58:09.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.377+0000 7f605ffff700 1 --2- 172.21.15.26:0/814118598 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f606009e000 0x7f6060130660 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f604c009950 tx=0x7f604c009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26584963c313cbe4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:09.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.377+0000 7f605f7fe700 1 -- 172.21.15.26:0/814118598 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c009ea0 con 0x7f606009e000 2023-10-01T07:58:09.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.377+0000 7f605f7fe700 1 -- 172.21.15.26:0/814118598 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604c00ba20 con 0x7f606009e000 2023-10-01T07:58:09.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.377+0000 7f605f7fe700 1 -- 172.21.15.26:0/814118598 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c00bdb0 con 0x7f606009e000 2023-10-01T07:58:09.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.378+0000 7f6066e89700 1 -- 172.21.15.26:0/814118598 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f606009e000 msgr2=0x7f6060130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:09.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.378+0000 7f6066e89700 1 --2- 172.21.15.26:0/814118598 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f606009e000 0x7f6060130660 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f604c009950 tx=0x7f604c009c60 comp rx=0 tx=0).stop 2023-10-01T07:58:09.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.378+0000 7f6066e89700 1 -- 172.21.15.26:0/814118598 shutdown_connections 2023-10-01T07:58:09.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.378+0000 7f6066e89700 1 --2- 172.21.15.26:0/814118598 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f606009d6f0 0x7f606009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.378+0000 7f6066e89700 1 --2- 172.21.15.26:0/814118598 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f606009e000 0x7f6060130660 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.378+0000 7f6066e89700 1 -- 172.21.15.26:0/814118598 >> 172.21.15.26:0/814118598 conn(0x7f6060066f50 msgr2=0x7f606009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:09.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.378+0000 7f6066e89700 1 -- 172.21.15.26:0/814118598 shutdown_connections 2023-10-01T07:58:09.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.379+0000 7f6066e89700 1 -- 172.21.15.26:0/814118598 wait complete. 2023-10-01T07:58:09.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.379+0000 7f6066e89700 1 Processor -- start 2023-10-01T07:58:09.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.380+0000 7f6066e89700 1 -- start start 2023-10-01T07:58:09.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.380+0000 7f6066e89700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f606009d6f0 0x7f606011de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:09.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.380+0000 7f6066e89700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f606009e000 0x7f606011e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:09.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.380+0000 7f6066e89700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f606009e410 0x7f606011e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:09.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.380+0000 7f6066e89700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60601200d0 con 0x7f606009e000 2023-10-01T07:58:09.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.380+0000 7f6066e89700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6060121990 con 0x7f606009e410 2023-10-01T07:58:09.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.380+0000 7f6066e89700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6060120d60 con 0x7f606009d6f0 2023-10-01T07:58:09.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.380+0000 7f6064c25700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f606009d6f0 0x7f606011de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:09.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.380+0000 7f6065426700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f606009e410 0x7f606011e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:09.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.380+0000 7f6064c25700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f606009d6f0 0x7f606011de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:33838/0 (socket says 172.21.15.26:33838) 2023-10-01T07:58:09.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.380+0000 7f6064c25700 1 -- 172.21.15.26:0/1602690314 learned_addr learned my addr 172.21.15.26:0/1602690314 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:09.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.381+0000 7f605ffff700 1 --2- 172.21.15.26:0/1602690314 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f606009e000 0x7f606011e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:09.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.381+0000 7f6064c25700 1 -- 172.21.15.26:0/1602690314 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f606009e410 msgr2=0x7f606011e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:09.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.381+0000 7f6064c25700 1 --2- 172.21.15.26:0/1602690314 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f606009e410 0x7f606011e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.381+0000 7f6064c25700 1 -- 172.21.15.26:0/1602690314 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f606009e000 msgr2=0x7f606011e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:09.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.381+0000 7f6064c25700 1 --2- 172.21.15.26:0/1602690314 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f606009e000 0x7f606011e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.381+0000 7f6064c25700 1 -- 172.21.15.26:0/1602690314 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f604c009550 con 0x7f606009d6f0 2023-10-01T07:58:09.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.381+0000 7f6064c25700 1 --2- 172.21.15.26:0/1602690314 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f606009d6f0 0x7f606011de70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f605400e840 tx=0x7f605400eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:09.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.381+0000 7f605d7fa700 1 -- 172.21.15.26:0/1602690314 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6054013610 con 0x7f606009d6f0 2023-10-01T07:58:09.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.381+0000 7f605d7fa700 1 -- 172.21.15.26:0/1602690314 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6054013770 con 0x7f606009d6f0 2023-10-01T07:58:09.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.381+0000 7f6066e89700 1 -- 172.21.15.26:0/1602690314 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f606011f2d0 con 0x7f606009d6f0 2023-10-01T07:58:09.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.381+0000 7f605d7fa700 1 -- 172.21.15.26:0/1602690314 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6054013ae0 con 0x7f606009d6f0 2023-10-01T07:58:09.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.381+0000 7f6066e89700 1 -- 172.21.15.26:0/1602690314 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f606011fa80 con 0x7f606009d6f0 2023-10-01T07:58:09.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.382+0000 7f605d7fa700 1 -- 172.21.15.26:0/1602690314 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6054013c40 con 0x7f606009d6f0 2023-10-01T07:58:09.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.382+0000 7f605d7fa700 1 -- 172.21.15.26:0/1602690314 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f605403f320 con 0x7f606009d6f0 2023-10-01T07:58:09.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.383+0000 7f6066e89700 1 -- 172.21.15.26:0/1602690314 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f606011ac20 con 0x7f606009d6f0 2023-10-01T07:58:09.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.392+0000 7f605d7fa700 1 -- 172.21.15.26:0/1602690314 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6054012370 con 0x7f606009d6f0 2023-10-01T07:58:09.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.459+0000 7fc621bd0700 1 -- 172.21.15.26:0/2776769259 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc61c074ea0 con 0x7fc61c09e930 2023-10-01T07:58:09.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.460+0000 7fc603fff700 1 -- 172.21.15.26:0/2776769259 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc610017020 con 0x7fc61c09e930 2023-10-01T07:58:09.460 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:09.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.462+0000 7fc621bd0700 1 -- 172.21.15.26:0/2776769259 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc61c09e930 msgr2=0x7fc61c11bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:09.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.462+0000 7fc621bd0700 1 --2- 172.21.15.26:0/2776769259 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc61c09e930 0x7fc61c11bdb0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc610000f60 tx=0x7fc61000c6e0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.463+0000 7fc621bd0700 1 -- 172.21.15.26:0/2776769259 shutdown_connections 2023-10-01T07:58:09.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.463+0000 7fc621bd0700 1 --2- 172.21.15.26:0/2776769259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc61c1338a0 0x7fc61c11c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.463+0000 7fc621bd0700 1 --2- 172.21.15.26:0/2776769259 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc61c09de50 0x7fc61c11b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.463+0000 7fc621bd0700 1 --2- 172.21.15.26:0/2776769259 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc61c09e930 0x7fc61c11bdb0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.463+0000 7fc621bd0700 1 -- 172.21.15.26:0/2776769259 >> 172.21.15.26:0/2776769259 conn(0x7fc61c0a2aa0 msgr2=0x7fc61c1305a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:09.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.463+0000 7fc621bd0700 1 -- 172.21.15.26:0/2776769259 shutdown_connections 2023-10-01T07:58:09.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.463+0000 7fc621bd0700 1 -- 172.21.15.26:0/2776769259 wait complete. 2023-10-01T07:58:09.482 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:09.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.532+0000 7f92fe752700 1 -- 172.21.15.26:0/3913130065 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f92f809e130 con 0x7f92f809d9f0 2023-10-01T07:58:09.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.532+0000 7f92f4ff9700 1 -- 172.21.15.26:0/3913130065 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f92f809e130 con 0x7f92f809d9f0 2023-10-01T07:58:09.533 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:09.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.535+0000 7f92fe752700 1 -- 172.21.15.26:0/3913130065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92f809d9f0 msgr2=0x7f92f812ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:09.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.535+0000 7f92fe752700 1 --2- 172.21.15.26:0/3913130065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92f809d9f0 0x7f92f812ae00 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f92e800c780 tx=0x7f92e800cb40 comp rx=0 tx=0).stop 2023-10-01T07:58:09.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.535+0000 7f92fe752700 1 -- 172.21.15.26:0/3913130065 shutdown_connections 2023-10-01T07:58:09.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.535+0000 7f92fe752700 1 --2- 172.21.15.26:0/3913130065 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92f8136a70 0x7f92f81347a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.535+0000 7f92fe752700 1 --2- 172.21.15.26:0/3913130065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92f809d9f0 0x7f92f812ae00 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.535+0000 7f92fe752700 1 --2- 172.21.15.26:0/3913130065 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92f81316c0 0x7f92f8134260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.535+0000 7f92fe752700 1 -- 172.21.15.26:0/3913130065 >> 172.21.15.26:0/3913130065 conn(0x7f92f8066f50 msgr2=0x7f92f80a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:09.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.535+0000 7f92fe752700 1 -- 172.21.15.26:0/3913130065 shutdown_connections 2023-10-01T07:58:09.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.535+0000 7f92fe752700 1 -- 172.21.15.26:0/3913130065 wait complete. 2023-10-01T07:58:09.550 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:09.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.555+0000 7fb214c20700 1 -- 172.21.15.26:0/935873894 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb21009b830 con 0x7fb21009e7e0 2023-10-01T07:58:09.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.555+0000 7fb1feffd700 1 -- 172.21.15.26:0/935873894 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb200024350 con 0x7fb21009e7e0 2023-10-01T07:58:09.556 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:09.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.557+0000 7fb214c20700 1 -- 172.21.15.26:0/935873894 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb21009e7e0 msgr2=0x7fb21006b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:09.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.557+0000 7fb214c20700 1 --2- 172.21.15.26:0/935873894 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb21009e7e0 0x7fb21006b8b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb20000e9b0 tx=0x7fb20000ecc0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.557+0000 7fb214c20700 1 -- 172.21.15.26:0/935873894 shutdown_connections 2023-10-01T07:58:09.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.557+0000 7fb214c20700 1 --2- 172.21.15.26:0/935873894 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb2101316a0 0x7fb21006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.557+0000 7fb214c20700 1 --2- 172.21.15.26:0/935873894 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb21009e7e0 0x7fb21006b8b0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.557+0000 7fb214c20700 1 --2- 172.21.15.26:0/935873894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb21009fa10 0x7fb21006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.557+0000 7fb214c20700 1 -- 172.21.15.26:0/935873894 >> 172.21.15.26:0/935873894 conn(0x7fb2100a4300 msgr2=0x7fb2101b8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:09.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.558+0000 7fb214c20700 1 -- 172.21.15.26:0/935873894 shutdown_connections 2023-10-01T07:58:09.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.558+0000 7fb214c20700 1 -- 172.21.15.26:0/935873894 wait complete. 2023-10-01T07:58:09.572 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:09.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.633+0000 7f6066e89700 1 -- 172.21.15.26:0/1602690314 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6060074ea0 con 0x7f606009d6f0 2023-10-01T07:58:09.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.634+0000 7f605d7fa700 1 -- 172.21.15.26:0/1602690314 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6054010310 con 0x7f606009d6f0 2023-10-01T07:58:09.634 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:09.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.636+0000 7f6066e89700 1 -- 172.21.15.26:0/1602690314 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f606009d6f0 msgr2=0x7f606011de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:09.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.636+0000 7f6066e89700 1 --2- 172.21.15.26:0/1602690314 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f606009d6f0 0x7f606011de70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f605400e840 tx=0x7f605400eb50 comp rx=0 tx=0).stop 2023-10-01T07:58:09.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.636+0000 7f6066e89700 1 -- 172.21.15.26:0/1602690314 shutdown_connections 2023-10-01T07:58:09.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.636+0000 7f6066e89700 1 --2- 172.21.15.26:0/1602690314 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f606009e410 0x7f606011e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.636+0000 7f6066e89700 1 --2- 172.21.15.26:0/1602690314 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f606009d6f0 0x7f606011de70 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.636+0000 7f6066e89700 1 --2- 172.21.15.26:0/1602690314 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f606009e000 0x7f606011e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:09.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.636+0000 7f6066e89700 1 -- 172.21.15.26:0/1602690314 >> 172.21.15.26:0/1602690314 conn(0x7f6060066f50 msgr2=0x7f6060130a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:09.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.636+0000 7f6066e89700 1 -- 172.21.15.26:0/1602690314 shutdown_connections 2023-10-01T07:58:09.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:09.636+0000 7f6066e89700 1 -- 172.21.15.26:0/1602690314 wait complete. 2023-10-01T07:58:09.650 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:10.483 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:10.551 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:10.573 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:10.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.631+0000 7f329c072700 1 Processor -- start 2023-10-01T07:58:10.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.631+0000 7f329c072700 1 -- start start 2023-10-01T07:58:10.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.632+0000 7f329c072700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3294136710 0x7f3294138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:10.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.632+0000 7f329c072700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3294139030 0x7f329413b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:10.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.632+0000 7f329c072700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f329406ef30 con 0x7f32941338a0 2023-10-01T07:58:10.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.632+0000 7f329c072700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f329406fef0 con 0x7f3294136710 2023-10-01T07:58:10.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.632+0000 7f329c072700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32941334b0 con 0x7f3294139030 2023-10-01T07:58:10.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.632+0000 7f329960d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3294136710 0x7f3294138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:10.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.632+0000 7f329960d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3294136710 0x7f3294138af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49840/0 (socket says 172.21.15.26:49840) 2023-10-01T07:58:10.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.632+0000 7f329960d700 1 -- 172.21.15.26:0/2450055288 learned_addr learned my addr 172.21.15.26:0/2450055288 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:10.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.632+0000 7f3299e0e700 1 --1- 172.21.15.26:0/2450055288 >> v1:172.21.15.26:6789/0 conn(0x7f32941338a0 0x7f3294133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46510/0 (socket says 172.21.15.26:46510) 2023-10-01T07:58:10.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.633+0000 7f329a60f700 1 --2- 172.21.15.26:0/2450055288 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3294139030 0x7f329413b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:10.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.633+0000 7f329960d700 1 -- 172.21.15.26:0/2450055288 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3294139030 msgr2=0x7f329413b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:10.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.633+0000 7f329960d700 1 --2- 172.21.15.26:0/2450055288 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3294139030 0x7f329413b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:10.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.633+0000 7f329960d700 1 -- 172.21.15.26:0/2450055288 >> v1:172.21.15.26:6789/0 conn(0x7f32941338a0 legacy=0x7f3294133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:10.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.633+0000 7f3298e0c700 1 -- 172.21.15.26:0/2450055288 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3542794258 0 0) 0x7f329406ef30 con 0x7f32941338a0 2023-10-01T07:58:10.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.633+0000 7f329960d700 1 -- 172.21.15.26:0/2450055288 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f329406fc30 con 0x7f3294136710 2023-10-01T07:58:10.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.633+0000 7f329a60f700 1 --2- 172.21.15.26:0/2450055288 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3294139030 0x7f329413b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:58:10.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.633+0000 7f329960d700 1 --2- 172.21.15.26:0/2450055288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3294136710 0x7f3294138af0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f32840098f0 tx=0x7f3284009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4a63f8f2a984902 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:10.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.633+0000 7f3298e0c700 1 -- 172.21.15.26:0/2450055288 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328400b8a0 con 0x7f3294136710 2023-10-01T07:58:10.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.633+0000 7f3298e0c700 1 -- 172.21.15.26:0/2450055288 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328400ba00 con 0x7f3294136710 2023-10-01T07:58:10.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.633+0000 7f3298e0c700 1 -- 172.21.15.26:0/2450055288 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328400bd90 con 0x7f3294136710 2023-10-01T07:58:10.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.634+0000 7f329c072700 1 -- 172.21.15.26:0/2450055288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3294136710 msgr2=0x7f3294138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:10.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.634+0000 7f329c072700 1 --2- 172.21.15.26:0/2450055288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3294136710 0x7f3294138af0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f32840098f0 tx=0x7f3284009c00 comp rx=0 tx=0).stop 2023-10-01T07:58:10.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.634+0000 7f329c072700 1 -- 172.21.15.26:0/2450055288 shutdown_connections 2023-10-01T07:58:10.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.634+0000 7f329c072700 1 --2- 172.21.15.26:0/2450055288 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3294139030 0x7f329413b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:10.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.634+0000 7f329c072700 1 --2- 172.21.15.26:0/2450055288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3294136710 0x7f3294138af0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:10.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.634+0000 7f329c072700 1 -- 172.21.15.26:0/2450055288 >> 172.21.15.26:0/2450055288 conn(0x7f32940a2aa0 msgr2=0x7f32940a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:10.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.634+0000 7f329c072700 1 -- 172.21.15.26:0/2450055288 shutdown_connections 2023-10-01T07:58:10.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.634+0000 7f329c072700 1 -- 172.21.15.26:0/2450055288 wait complete. 2023-10-01T07:58:10.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.635+0000 7f329c072700 1 Processor -- start 2023-10-01T07:58:10.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.635+0000 7f329c072700 1 -- start start 2023-10-01T07:58:10.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.636+0000 7f329c072700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32941338a0 0x7f329411ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:10.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.636+0000 7f329c072700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3294136710 0x7f329411b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:10.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.636+0000 7f329c072700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3294139030 0x7f329411b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:10.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.636+0000 7f329c072700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329411e770 con 0x7f32941338a0 2023-10-01T07:58:10.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.636+0000 7f329c072700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f329406f640 con 0x7f3294136710 2023-10-01T07:58:10.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.636+0000 7f329c072700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3294138d90 con 0x7f3294139030 2023-10-01T07:58:10.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.636+0000 7f3299e0e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32941338a0 0x7f329411ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:10.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.636+0000 7f3299e0e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32941338a0 0x7f329411ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49844/0 (socket says 172.21.15.26:49844) 2023-10-01T07:58:10.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.636+0000 7f3299e0e700 1 -- 172.21.15.26:0/2089987746 learned_addr learned my addr 172.21.15.26:0/2089987746 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:10.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.636+0000 7f329960d700 1 --2- 172.21.15.26:0/2089987746 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3294136710 0x7f329411b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:10.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.636+0000 7f329a60f700 1 --2- 172.21.15.26:0/2089987746 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3294139030 0x7f329411b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:10.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.637+0000 7f3299e0e700 1 -- 172.21.15.26:0/2089987746 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3294139030 msgr2=0x7f329411b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:10.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.637+0000 7f3299e0e700 1 --2- 172.21.15.26:0/2089987746 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3294139030 0x7f329411b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:10.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.637+0000 7f3299e0e700 1 -- 172.21.15.26:0/2089987746 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3294136710 msgr2=0x7f329411b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:10.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.637+0000 7f3299e0e700 1 --2- 172.21.15.26:0/2089987746 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3294136710 0x7f329411b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:10.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.637+0000 7f3299e0e700 1 -- 172.21.15.26:0/2089987746 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3284009550 con 0x7f32941338a0 2023-10-01T07:58:10.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.637+0000 7f3299e0e700 1 --2- 172.21.15.26:0/2089987746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32941338a0 0x7f329411ac00 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f329000c550 tx=0x7f329000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:10.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.637+0000 7f328a7fc700 1 -- 172.21.15.26:0/2089987746 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3290004c80 con 0x7f32941338a0 2023-10-01T07:58:10.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.637+0000 7f328a7fc700 1 -- 172.21.15.26:0/2089987746 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3290004e00 con 0x7f32941338a0 2023-10-01T07:58:10.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.637+0000 7f329c072700 1 -- 172.21.15.26:0/2089987746 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f329411de60 con 0x7f32941338a0 2023-10-01T07:58:10.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.637+0000 7f328a7fc700 1 -- 172.21.15.26:0/2089987746 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3290007310 con 0x7f32941338a0 2023-10-01T07:58:10.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.637+0000 7f329c072700 1 -- 172.21.15.26:0/2089987746 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f329411e3f0 con 0x7f32941338a0 2023-10-01T07:58:10.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.638+0000 7f328a7fc700 1 -- 172.21.15.26:0/2089987746 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3290007470 con 0x7f32941338a0 2023-10-01T07:58:10.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.638+0000 7f328a7fc700 1 -- 172.21.15.26:0/2089987746 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f329003f290 con 0x7f32941338a0 2023-10-01T07:58:10.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.639+0000 7f329c072700 1 -- 172.21.15.26:0/2089987746 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f329411e050 con 0x7f32941338a0 2023-10-01T07:58:10.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.644+0000 7f328a7fc700 1 -- 172.21.15.26:0/2089987746 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f32900123b0 con 0x7f32941338a0 2023-10-01T07:58:10.650 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:10.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.703+0000 7f4408cf0700 1 Processor -- start 2023-10-01T07:58:10.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.703+0000 7f4408cf0700 1 -- start start 2023-10-01T07:58:10.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.704+0000 7f4408cf0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f440409d6f0 0x7f440409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:10.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.704+0000 7f4408cf0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f440409e000 0x7f44041339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:10.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.704+0000 7f4408cf0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f440409b120 con 0x7f440409e410 2023-10-01T07:58:10.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.704+0000 7f4408cf0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f440406b460 con 0x7f440409e000 2023-10-01T07:58:10.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.704+0000 7f4408cf0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f440409a7e0 con 0x7f440409d6f0 2023-10-01T07:58:10.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.704+0000 7f4401d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f440409e000 0x7f44041339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:10.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.704+0000 7f4401d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f440409e000 0x7f44041339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49846/0 (socket says 172.21.15.26:49846) 2023-10-01T07:58:10.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.704+0000 7f4401d9b700 1 -- 172.21.15.26:0/3303607044 learned_addr learned my addr 172.21.15.26:0/3303607044 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:10.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.704+0000 7f440259c700 1 --2- 172.21.15.26:0/3303607044 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f440409d6f0 0x7f440409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:10.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.705+0000 7f4401d9b700 1 -- 172.21.15.26:0/3303607044 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f440409d6f0 msgr2=0x7f440409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:10.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.705+0000 7f4401d9b700 1 --2- 172.21.15.26:0/3303607044 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f440409d6f0 0x7f440409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:10.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.705+0000 7f4401d9b700 1 -- 172.21.15.26:0/3303607044 >> v1:172.21.15.26:6789/0 conn(0x7f440409e410 legacy=0x7f4404133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:10.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.705+0000 7f4401d9b700 1 -- 172.21.15.26:0/3303607044 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f440409a500 con 0x7f440409e000 2023-10-01T07:58:10.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.705+0000 7f440259c700 1 --2- 172.21.15.26:0/3303607044 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f440409d6f0 0x7f440409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:10.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.705+0000 7f4401d9b700 1 --2- 172.21.15.26:0/3303607044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f440409e000 0x7f44041339f0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f43f80098f0 tx=0x7f43f8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ac211af0b62cd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:10.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.705+0000 7f440159a700 1 -- 172.21.15.26:0/3303607044 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f8011830 con 0x7f440409e000 2023-10-01T07:58:10.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.705+0000 7f440159a700 1 -- 172.21.15.26:0/3303607044 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f8011990 con 0x7f440409e000 2023-10-01T07:58:10.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.705+0000 7f440159a700 1 -- 172.21.15.26:0/3303607044 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f8011d20 con 0x7f440409e000 2023-10-01T07:58:10.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.706+0000 7f4408cf0700 1 -- 172.21.15.26:0/3303607044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f440409e000 msgr2=0x7f44041339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:10.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.706+0000 7f4408cf0700 1 --2- 172.21.15.26:0/3303607044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f440409e000 0x7f44041339f0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f43f80098f0 tx=0x7f43f8009c00 comp rx=0 tx=0).stop 2023-10-01T07:58:10.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.706+0000 7f4408cf0700 1 -- 172.21.15.26:0/3303607044 shutdown_connections 2023-10-01T07:58:10.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.706+0000 7f4408cf0700 1 --2- 172.21.15.26:0/3303607044 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f440409d6f0 0x7f440409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:10.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.706+0000 7f4408cf0700 1 --2- 172.21.15.26:0/3303607044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f440409e000 0x7f44041339f0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:10.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.706+0000 7f4408cf0700 1 -- 172.21.15.26:0/3303607044 >> 172.21.15.26:0/3303607044 conn(0x7f4404066f50 msgr2=0x7f440409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:10.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.707+0000 7f4408cf0700 1 -- 172.21.15.26:0/3303607044 shutdown_connections 2023-10-01T07:58:10.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.707+0000 7f4408cf0700 1 -- 172.21.15.26:0/3303607044 wait complete. 2023-10-01T07:58:10.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.708+0000 7f4408cf0700 1 Processor -- start 2023-10-01T07:58:10.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.708+0000 7f4408cf0700 1 -- start start 2023-10-01T07:58:10.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.709+0000 7f4408cf0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f440409d6f0 0x7f44041a5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:10.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.709+0000 7f4408cf0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f440409e000 0x7f44041a6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:10.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.709+0000 7f4408cf0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f440409e410 0x7f44041a6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:10.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.709+0000 7f4408cf0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44041a91f0 con 0x7f440409e410 2023-10-01T07:58:10.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.709+0000 7f4408cf0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f440409c710 con 0x7f440409e000 2023-10-01T07:58:10.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.709+0000 7f4408cf0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44040a3160 con 0x7f440409d6f0 2023-10-01T07:58:10.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.709+0000 7f4401d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f440409e000 0x7f44041a6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:10.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.709+0000 7f4402d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f440409e410 0x7f44041a6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:10.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.709+0000 7f4401d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f440409e000 0x7f44041a6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51710/0 (socket says 172.21.15.26:51710) 2023-10-01T07:58:10.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.709+0000 7f4401d9b700 1 -- 172.21.15.26:0/663415262 learned_addr learned my addr 172.21.15.26:0/663415262 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:10.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.710+0000 7f440259c700 1 --2- 172.21.15.26:0/663415262 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f440409d6f0 0x7f44041a5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:10.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.710+0000 7f4401d9b700 1 -- 172.21.15.26:0/663415262 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f440409d6f0 msgr2=0x7f44041a5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:10.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.710+0000 7f4401d9b700 1 --2- 172.21.15.26:0/663415262 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f440409d6f0 0x7f44041a5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:10.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.710+0000 7f4401d9b700 1 -- 172.21.15.26:0/663415262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f440409e410 msgr2=0x7f44041a6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:10.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.710+0000 7f4401d9b700 1 --2- 172.21.15.26:0/663415262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f440409e410 0x7f44041a6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:10.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.710+0000 7f4401d9b700 1 -- 172.21.15.26:0/663415262 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f40094a0 con 0x7f440409e000 2023-10-01T07:58:10.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.710+0000 7f440259c700 1 --2- 172.21.15.26:0/663415262 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f440409d6f0 0x7f44041a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:58:10.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.710+0000 7f4401d9b700 1 --2- 172.21.15.26:0/663415262 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f440409e000 0x7f44041a6510 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f43f8009c40 tx=0x7f43f8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:10.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.710+0000 7f43f2ffd700 1 -- 172.21.15.26:0/663415262 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f8004400 con 0x7f440409e000 2023-10-01T07:58:10.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.710+0000 7f43f2ffd700 1 -- 172.21.15.26:0/663415262 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f801f070 con 0x7f440409e000 2023-10-01T07:58:10.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.710+0000 7f43f2ffd700 1 -- 172.21.15.26:0/663415262 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f80038c0 con 0x7f440409e000 2023-10-01T07:58:10.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.711+0000 7f4408cf0700 1 -- 172.21.15.26:0/663415262 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43f8009550 con 0x7f440409e000 2023-10-01T07:58:10.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.711+0000 7f4408cf0700 1 -- 172.21.15.26:0/663415262 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44041a8da0 con 0x7f440409e000 2023-10-01T07:58:10.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.712+0000 7f43f2ffd700 1 -- 172.21.15.26:0/663415262 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f43f8021030 con 0x7f440409e000 2023-10-01T07:58:10.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.712+0000 7f4408cf0700 1 -- 172.21.15.26:0/663415262 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44041a9420 con 0x7f440409e000 2023-10-01T07:58:10.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.712+0000 7f43f2ffd700 1 -- 172.21.15.26:0/663415262 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f43f8040a10 con 0x7f440409e000 2023-10-01T07:58:10.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.721+0000 7f43f2ffd700 1 -- 172.21.15.26:0/663415262 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f44041a9420 con 0x7f440409e000 2023-10-01T07:58:10.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.757+0000 7fbdc55ce700 1 Processor -- start 2023-10-01T07:58:10.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.757+0000 7fbdc55ce700 1 -- start start 2023-10-01T07:58:10.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.757+0000 7fbdc55ce700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbdc0136710 0x7fbdc0138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:10.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.757+0000 7fbdc55ce700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdc0139030 0x7fbdc013b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:10.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.757+0000 7fbdc55ce700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdc006ef30 con 0x7fbdc01338a0 2023-10-01T07:58:10.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.758+0000 7fbdc55ce700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdc006fef0 con 0x7fbdc0136710 2023-10-01T07:58:10.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.758+0000 7fbdc55ce700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc01334b0 con 0x7fbdc0139030 2023-10-01T07:58:10.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.758+0000 7fbdbf7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdc0139030 0x7fbdc013b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:10.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.758+0000 7fbdbe7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbdc0136710 0x7fbdc0138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:10.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.758+0000 7fbdbf7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdc0139030 0x7fbdc013b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:33880/0 (socket says 172.21.15.26:33880) 2023-10-01T07:58:10.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.758+0000 7fbdbf7fe700 1 -- 172.21.15.26:0/1628587880 learned_addr learned my addr 172.21.15.26:0/1628587880 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:10.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.758+0000 7fbdbe7fc700 1 -- 172.21.15.26:0/1628587880 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdc0139030 msgr2=0x7fbdc013b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:10.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.758+0000 7fbdbe7fc700 1 --2- 172.21.15.26:0/1628587880 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdc0139030 0x7fbdc013b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:10.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.758+0000 7fbdbe7fc700 1 -- 172.21.15.26:0/1628587880 >> v1:172.21.15.26:6789/0 conn(0x7fbdc01338a0 legacy=0x7fbdc0133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:10.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.758+0000 7fbdbe7fc700 1 -- 172.21.15.26:0/1628587880 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc006fc30 con 0x7fbdc0136710 2023-10-01T07:58:10.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.758+0000 7fbdbf7fe700 1 --2- 172.21.15.26:0/1628587880 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdc0139030 0x7fbdc013b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:10.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.758+0000 7fbdbe7fc700 1 --2- 172.21.15.26:0/1628587880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdc0136710 0x7fbdc0138af0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4009840 tx=0x7fbdb4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de1a442fa481442 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:10.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.759+0000 7fbdbdffb700 1 -- 172.21.15.26:0/1628587880 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4004230 con 0x7fbdc0136710 2023-10-01T07:58:10.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.759+0000 7fbdbdffb700 1 -- 172.21.15.26:0/1628587880 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb4004390 con 0x7fbdc0136710 2023-10-01T07:58:10.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.759+0000 7fbdbdffb700 1 -- 172.21.15.26:0/1628587880 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb40036a0 con 0x7fbdc0136710 2023-10-01T07:58:10.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.759+0000 7fbdc55ce700 1 -- 172.21.15.26:0/1628587880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdc0136710 msgr2=0x7fbdc0138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:10.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.759+0000 7fbdc55ce700 1 --2- 172.21.15.26:0/1628587880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdc0136710 0x7fbdc0138af0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4009840 tx=0x7fbdb4009b50 comp rx=0 tx=0).stop 2023-10-01T07:58:10.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.759+0000 7fbdc55ce700 1 -- 172.21.15.26:0/1628587880 shutdown_connections 2023-10-01T07:58:10.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.759+0000 7fbdc55ce700 1 --2- 172.21.15.26:0/1628587880 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdc0139030 0x7fbdc013b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:10.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.759+0000 7fbdc55ce700 1 --2- 172.21.15.26:0/1628587880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdc0136710 0x7fbdc0138af0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:10.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.759+0000 7fbdc55ce700 1 -- 172.21.15.26:0/1628587880 >> 172.21.15.26:0/1628587880 conn(0x7fbdc00a2aa0 msgr2=0x7fbdc00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:10.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.759+0000 7fbdc55ce700 1 -- 172.21.15.26:0/1628587880 shutdown_connections 2023-10-01T07:58:10.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.760+0000 7fbdc55ce700 1 -- 172.21.15.26:0/1628587880 wait complete. 2023-10-01T07:58:10.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.761+0000 7fbdc55ce700 1 Processor -- start 2023-10-01T07:58:10.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.761+0000 7fbdc55ce700 1 -- start start 2023-10-01T07:58:10.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.761+0000 7fbdc55ce700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdc01338a0 0x7fbdc0118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:10.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.761+0000 7fbdc55ce700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbdc0136710 0x7fbdc0119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:10.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.761+0000 7fbdc55ce700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdc0139030 0x7fbdc0119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:10.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.761+0000 7fbdc55ce700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc011c0a0 con 0x7fbdc0139030 2023-10-01T07:58:10.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.761+0000 7fbdc55ce700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc011b310 con 0x7fbdc0136710 2023-10-01T07:58:10.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.761+0000 7fbdc55ce700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc013b420 con 0x7fbdc01338a0 2023-10-01T07:58:10.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.761+0000 7fbdbf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdc0139030 0x7fbdc0119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:10.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.761+0000 7fbdbf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdc0139030 0x7fbdc0119750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49882/0 (socket says 172.21.15.26:49882) 2023-10-01T07:58:10.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.761+0000 7fbdbf7fe700 1 -- 172.21.15.26:0/3271713121 learned_addr learned my addr 172.21.15.26:0/3271713121 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:10.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.761+0000 7fbdbe7fc700 1 --2- 172.21.15.26:0/3271713121 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbdc0136710 0x7fbdc0119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:10.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.762+0000 7fbdbf7fe700 1 -- 172.21.15.26:0/3271713121 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdc01338a0 msgr2=0x7fbdc0118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:10.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.762+0000 7fbdbeffd700 1 --2- 172.21.15.26:0/3271713121 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdc01338a0 0x7fbdc0118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:10.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.762+0000 7fbdbf7fe700 1 --2- 172.21.15.26:0/3271713121 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdc01338a0 0x7fbdc0118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:10.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.762+0000 7fbdbf7fe700 1 -- 172.21.15.26:0/3271713121 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbdc0136710 msgr2=0x7fbdc0119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:10.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.762+0000 7fbdbf7fe700 1 --2- 172.21.15.26:0/3271713121 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbdc0136710 0x7fbdc0119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:10.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.762+0000 7fbdbf7fe700 1 -- 172.21.15.26:0/3271713121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb8009b30 con 0x7fbdc0139030 2023-10-01T07:58:10.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.762+0000 7fbdbeffd700 1 --2- 172.21.15.26:0/3271713121 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdc01338a0 0x7fbdc0118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:58:10.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.762+0000 7fbdbf7fe700 1 --2- 172.21.15.26:0/3271713121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdc0139030 0x7fbdc0119750 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fbdb800efc0 tx=0x7fbdb800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:10.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.762+0000 7fbda77fe700 1 -- 172.21.15.26:0/3271713121 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb8018070 con 0x7fbdc0139030 2023-10-01T07:58:10.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.762+0000 7fbda77fe700 1 -- 172.21.15.26:0/3271713121 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb800f040 con 0x7fbdc0139030 2023-10-01T07:58:10.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.762+0000 7fbdc55ce700 1 -- 172.21.15.26:0/3271713121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdb40094a0 con 0x7fbdc0139030 2023-10-01T07:58:10.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.762+0000 7fbdc55ce700 1 -- 172.21.15.26:0/3271713121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdc011ac60 con 0x7fbdc0139030 2023-10-01T07:58:10.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.763+0000 7fbda77fe700 1 -- 172.21.15.26:0/3271713121 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb8003c20 con 0x7fbdc0139030 2023-10-01T07:58:10.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.763+0000 7fbda77fe700 1 -- 172.21.15.26:0/3271713121 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbdb800c930 con 0x7fbdc0139030 2023-10-01T07:58:10.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.764+0000 7fbda77fe700 1 -- 172.21.15.26:0/3271713121 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbdb803f8f0 con 0x7fbdc0139030 2023-10-01T07:58:10.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.764+0000 7fbdc55ce700 1 -- 172.21.15.26:0/3271713121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdc0074ea0 con 0x7fbdc0139030 2023-10-01T07:58:10.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.769+0000 7fbda77fe700 1 -- 172.21.15.26:0/3271713121 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbdb801cd50 con 0x7fbdc0139030 2023-10-01T07:58:10.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.805+0000 7fee86451700 1 Processor -- start 2023-10-01T07:58:10.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.805+0000 7fee86451700 1 -- start start 2023-10-01T07:58:10.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.806+0000 7fee86451700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee800a0a30 0x7fee800a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:10.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.806+0000 7fee86451700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fee8009d630 0x7fee800a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:10.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.806+0000 7fee86451700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee800a2a70 con 0x7fee80133930 2023-10-01T07:58:10.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.806+0000 7fee86451700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee800a01d0 con 0x7fee8009d630 2023-10-01T07:58:10.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.806+0000 7fee86451700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee8009e2b0 con 0x7fee800a0a30 2023-10-01T07:58:10.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.806+0000 7fee849ee700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fee80133930 0x7fee80133db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46530/0 (socket says 172.21.15.26:46530) 2023-10-01T07:58:10.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.806+0000 7fee849ee700 1 -- 172.21.15.26:0/2134761942 learned_addr learned my addr 172.21.15.26:0/2134761942 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:10.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.807+0000 7fee7ffff700 1 --2- 172.21.15.26:0/2134761942 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee800a0a30 0x7fee800a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:10.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.807+0000 7fee7f7fe700 1 --2- 172.21.15.26:0/2134761942 >> v2:172.21.15.26:3300/0 conn(0x7fee8009d630 0x7fee800a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:10.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.807+0000 7fee7ffff700 1 -- 172.21.15.26:0/2134761942 >> v2:172.21.15.26:3300/0 conn(0x7fee8009d630 msgr2=0x7fee800a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:10.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.807+0000 7fee7ffff700 1 --2- 172.21.15.26:0/2134761942 >> v2:172.21.15.26:3300/0 conn(0x7fee8009d630 0x7fee800a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:10.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.807+0000 7fee7ffff700 1 -- 172.21.15.26:0/2134761942 >> v1:172.21.15.26:6789/0 conn(0x7fee80133930 legacy=0x7fee80133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:10.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.807+0000 7fee7effd700 1 -- 172.21.15.26:0/2134761942 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3002415806 0 0) 0x7fee800a2a70 con 0x7fee80133930 2023-10-01T07:58:10.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.807+0000 7fee7ffff700 1 -- 172.21.15.26:0/2134761942 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee8009dc50 con 0x7fee800a0a30 2023-10-01T07:58:10.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.807+0000 7fee7ffff700 1 --2- 172.21.15.26:0/2134761942 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee800a0a30 0x7fee800a0e00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fee70009840 tx=0x7fee70009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=416fc9cd1e9585fa server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:10.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.808+0000 7fee7effd700 1 -- 172.21.15.26:0/2134761942 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee70011830 con 0x7fee800a0a30 2023-10-01T07:58:10.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.808+0000 7fee7effd700 1 -- 172.21.15.26:0/2134761942 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee70011990 con 0x7fee800a0a30 2023-10-01T07:58:10.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.808+0000 7fee7effd700 1 -- 172.21.15.26:0/2134761942 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee70011d20 con 0x7fee800a0a30 2023-10-01T07:58:10.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.808+0000 7fee86451700 1 -- 172.21.15.26:0/2134761942 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee800a0a30 msgr2=0x7fee800a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:10.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.808+0000 7fee86451700 1 --2- 172.21.15.26:0/2134761942 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee800a0a30 0x7fee800a0e00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fee70009840 tx=0x7fee70009b50 comp rx=0 tx=0).stop 2023-10-01T07:58:10.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.808+0000 7fee86451700 1 -- 172.21.15.26:0/2134761942 shutdown_connections 2023-10-01T07:58:10.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.808+0000 7fee86451700 1 --2- 172.21.15.26:0/2134761942 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee800a0a30 0x7fee800a0e00 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:10.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.808+0000 7fee86451700 1 --2- 172.21.15.26:0/2134761942 >> v2:172.21.15.26:3300/0 conn(0x7fee8009d630 0x7fee800a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:10.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.808+0000 7fee86451700 1 -- 172.21.15.26:0/2134761942 >> 172.21.15.26:0/2134761942 conn(0x7fee800a3050 msgr2=0x7fee800a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:10.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.808+0000 7fee86451700 1 -- 172.21.15.26:0/2134761942 shutdown_connections 2023-10-01T07:58:10.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.808+0000 7fee86451700 1 -- 172.21.15.26:0/2134761942 wait complete. 2023-10-01T07:58:10.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.810+0000 7fee86451700 1 Processor -- start 2023-10-01T07:58:10.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.810+0000 7fee86451700 1 -- start start 2023-10-01T07:58:10.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.811+0000 7fee86451700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee8009d630 0x7fee80126020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:10.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.811+0000 7fee86451700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee800a0a30 0x7fee80126560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:10.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.811+0000 7fee86451700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee80133930 0x7fee80126aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:10.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.811+0000 7fee86451700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee800a53d0 con 0x7fee80133930 2023-10-01T07:58:10.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.811+0000 7fee86451700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee800a0410 con 0x7fee800a0a30 2023-10-01T07:58:10.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.811+0000 7fee86451700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee8012a070 con 0x7fee8009d630 2023-10-01T07:58:10.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.811+0000 7fee7f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee800a0a30 0x7fee80126560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:10.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.811+0000 7fee7f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee800a0a30 0x7fee80126560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51726/0 (socket says 172.21.15.26:51726) 2023-10-01T07:58:10.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.811+0000 7fee7f7fe700 1 -- 172.21.15.26:0/658081227 learned_addr learned my addr 172.21.15.26:0/658081227 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:10.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.811+0000 7fee849ee700 1 --2- 172.21.15.26:0/658081227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee80133930 0x7fee80126aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:10.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.811+0000 7fee7ffff700 1 --2- 172.21.15.26:0/658081227 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee8009d630 0x7fee80126020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:10.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.811+0000 7fee849ee700 1 -- 172.21.15.26:0/658081227 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee8009d630 msgr2=0x7fee80126020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:10.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.812+0000 7fee849ee700 1 --2- 172.21.15.26:0/658081227 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee8009d630 0x7fee80126020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:10.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.812+0000 7fee849ee700 1 -- 172.21.15.26:0/658081227 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee800a0a30 msgr2=0x7fee80126560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:10.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.812+0000 7fee849ee700 1 --2- 172.21.15.26:0/658081227 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee800a0a30 0x7fee80126560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:10.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.812+0000 7fee849ee700 1 -- 172.21.15.26:0/658081227 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee700094a0 con 0x7fee80133930 2023-10-01T07:58:10.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.812+0000 7fee849ee700 1 --2- 172.21.15.26:0/658081227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee80133930 0x7fee80126aa0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fee7800cbe0 tx=0x7fee7800cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:10.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.812+0000 7fee7cff9700 1 -- 172.21.15.26:0/658081227 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7800aaa0 con 0x7fee80133930 2023-10-01T07:58:10.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.812+0000 7fee7cff9700 1 -- 172.21.15.26:0/658081227 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7800ac00 con 0x7fee80133930 2023-10-01T07:58:10.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.812+0000 7fee86451700 1 -- 172.21.15.26:0/658081227 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee80129260 con 0x7fee80133930 2023-10-01T07:58:10.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.812+0000 7fee7cff9700 1 -- 172.21.15.26:0/658081227 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee780070d0 con 0x7fee80133930 2023-10-01T07:58:10.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.812+0000 7fee86451700 1 -- 172.21.15.26:0/658081227 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee80129d00 con 0x7fee80133930 2023-10-01T07:58:10.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.813+0000 7fee7cff9700 1 -- 172.21.15.26:0/658081227 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fee78007230 con 0x7fee80133930 2023-10-01T07:58:10.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.813+0000 7fee7cff9700 1 -- 172.21.15.26:0/658081227 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fee7803f4b0 con 0x7fee80133930 2023-10-01T07:58:10.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.813+0000 7fee86451700 1 -- 172.21.15.26:0/658081227 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee80129480 con 0x7fee80133930 2023-10-01T07:58:10.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.823+0000 7fee7cff9700 1 -- 172.21.15.26:0/658081227 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fee78018030 con 0x7fee80133930 2023-10-01T07:58:10.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.880+0000 7f329c072700 1 -- 172.21.15.26:0/2089987746 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3294074ea0 con 0x7f32941338a0 2023-10-01T07:58:10.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.880+0000 7f328a7fc700 1 -- 172.21.15.26:0/2089987746 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3290011360 con 0x7f32941338a0 2023-10-01T07:58:10.881 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:10.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.883+0000 7f329c072700 1 -- 172.21.15.26:0/2089987746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32941338a0 msgr2=0x7f329411ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:10.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.883+0000 7f329c072700 1 --2- 172.21.15.26:0/2089987746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32941338a0 0x7f329411ac00 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f329000c550 tx=0x7f329000c860 comp rx=0 tx=0).stop 2023-10-01T07:58:10.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.884+0000 7f329c072700 1 -- 172.21.15.26:0/2089987746 shutdown_connections 2023-10-01T07:58:10.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.884+0000 7f329c072700 1 --2- 172.21.15.26:0/2089987746 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3294139030 0x7f329411b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:10.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.884+0000 7f329c072700 1 --2- 172.21.15.26:0/2089987746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32941338a0 0x7f329411ac00 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:10.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.884+0000 7f329c072700 1 --2- 172.21.15.26:0/2089987746 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3294136710 0x7f329411b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:10.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.884+0000 7f329c072700 1 -- 172.21.15.26:0/2089987746 >> 172.21.15.26:0/2089987746 conn(0x7f32940a2aa0 msgr2=0x7f32941344f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:10.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.884+0000 7f329c072700 1 -- 172.21.15.26:0/2089987746 shutdown_connections 2023-10-01T07:58:10.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.884+0000 7f329c072700 1 -- 172.21.15.26:0/2089987746 wait complete. 2023-10-01T07:58:10.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:10.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.947+0000 7f4408cf0700 1 -- 172.21.15.26:0/663415262 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f44041a9420 con 0x7f440409e000 2023-10-01T07:58:10.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.947+0000 7f43f2ffd700 1 -- 172.21.15.26:0/663415262 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f44041a9420 con 0x7f440409e000 2023-10-01T07:58:10.948 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:10.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.950+0000 7f4408cf0700 1 -- 172.21.15.26:0/663415262 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f440409e000 msgr2=0x7f44041a6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:10.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.950+0000 7f4408cf0700 1 --2- 172.21.15.26:0/663415262 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f440409e000 0x7f44041a6510 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f43f8009c40 tx=0x7f43f8004750 comp rx=0 tx=0).stop 2023-10-01T07:58:10.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.950+0000 7f4408cf0700 1 -- 172.21.15.26:0/663415262 shutdown_connections 2023-10-01T07:58:10.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.950+0000 7f4408cf0700 1 --2- 172.21.15.26:0/663415262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f440409e410 0x7f44041a6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:10.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.950+0000 7f4408cf0700 1 --2- 172.21.15.26:0/663415262 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f440409d6f0 0x7f44041a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:10.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.950+0000 7f4408cf0700 1 --2- 172.21.15.26:0/663415262 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f440409e000 0x7f44041a6510 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:10.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.950+0000 7f4408cf0700 1 -- 172.21.15.26:0/663415262 >> 172.21.15.26:0/663415262 conn(0x7f4404066f50 msgr2=0x7f44041baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:10.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.950+0000 7f4408cf0700 1 -- 172.21.15.26:0/663415262 shutdown_connections 2023-10-01T07:58:10.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.950+0000 7f4408cf0700 1 -- 172.21.15.26:0/663415262 wait complete. 2023-10-01T07:58:10.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:10.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.985+0000 7fbdc55ce700 1 -- 172.21.15.26:0/3271713121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbdc006b9e0 con 0x7fbdc0139030 2023-10-01T07:58:10.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.986+0000 7fbda77fe700 1 -- 172.21.15.26:0/3271713121 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbdb801de00 con 0x7fbdc0139030 2023-10-01T07:58:10.986 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:10.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.988+0000 7fbdc55ce700 1 -- 172.21.15.26:0/3271713121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdc0139030 msgr2=0x7fbdc0119750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:10.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.988+0000 7fbdc55ce700 1 --2- 172.21.15.26:0/3271713121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdc0139030 0x7fbdc0119750 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fbdb800efc0 tx=0x7fbdb800c3a0 comp rx=0 tx=0).stop 2023-10-01T07:58:10.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.988+0000 7fbdc55ce700 1 -- 172.21.15.26:0/3271713121 shutdown_connections 2023-10-01T07:58:10.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.988+0000 7fbdc55ce700 1 --2- 172.21.15.26:0/3271713121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdc0139030 0x7fbdc0119750 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:10.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.988+0000 7fbdc55ce700 1 --2- 172.21.15.26:0/3271713121 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdc01338a0 0x7fbdc0118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:10.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.988+0000 7fbdc55ce700 1 --2- 172.21.15.26:0/3271713121 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbdc0136710 0x7fbdc0119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:10.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.988+0000 7fbdc55ce700 1 -- 172.21.15.26:0/3271713121 >> 172.21.15.26:0/3271713121 conn(0x7fbdc00a2aa0 msgr2=0x7fbdc0136c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:10.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.988+0000 7fbdc55ce700 1 -- 172.21.15.26:0/3271713121 shutdown_connections 2023-10-01T07:58:10.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:10.988+0000 7fbdc55ce700 1 -- 172.21.15.26:0/3271713121 wait complete. 2023-10-01T07:58:11.002 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:11.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:11.032+0000 7fee86451700 1 -- 172.21.15.26:0/658081227 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fee800747f0 con 0x7fee80133930 2023-10-01T07:58:11.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:11.033+0000 7fee7cff9700 1 -- 172.21.15.26:0/658081227 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fee780074e0 con 0x7fee80133930 2023-10-01T07:58:11.034 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:11.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:11.035+0000 7fee86451700 1 -- 172.21.15.26:0/658081227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee80133930 msgr2=0x7fee80126aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:11.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:11.035+0000 7fee86451700 1 --2- 172.21.15.26:0/658081227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee80133930 0x7fee80126aa0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fee7800cbe0 tx=0x7fee7800cef0 comp rx=0 tx=0).stop 2023-10-01T07:58:11.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:11.035+0000 7fee86451700 1 -- 172.21.15.26:0/658081227 shutdown_connections 2023-10-01T07:58:11.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:11.035+0000 7fee86451700 1 --2- 172.21.15.26:0/658081227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee80133930 0x7fee80126aa0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:11.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:11.035+0000 7fee86451700 1 --2- 172.21.15.26:0/658081227 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee8009d630 0x7fee80126020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:11.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:11.035+0000 7fee86451700 1 --2- 172.21.15.26:0/658081227 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee800a0a30 0x7fee80126560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:11.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:11.035+0000 7fee86451700 1 -- 172.21.15.26:0/658081227 >> 172.21.15.26:0/658081227 conn(0x7fee800a3050 msgr2=0x7fee8009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:11.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:11.035+0000 7fee86451700 1 -- 172.21.15.26:0/658081227 shutdown_connections 2023-10-01T07:58:11.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:11.035+0000 7fee86451700 1 -- 172.21.15.26:0/658081227 wait complete. 2023-10-01T07:58:11.049 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:11.899 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:11.965 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:12.003 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:12.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.049+0000 7f906f86f700 1 Processor -- start 2023-10-01T07:58:12.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.049+0000 7f906f86f700 1 -- start start 2023-10-01T07:58:12.050 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:12.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.050+0000 7f906f86f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f90681338a0 0x7f9068133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:12.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.050+0000 7f906f86f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f906809e930 0x7f906813b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:12.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.050+0000 7f906f86f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f906806ef30 con 0x7f906809de50 2023-10-01T07:58:12.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.050+0000 7f906f86f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f906806fef0 con 0x7f906809e930 2023-10-01T07:58:12.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.050+0000 7f906f86f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90681334b0 con 0x7f90681338a0 2023-10-01T07:58:12.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.050+0000 7f906de0c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f906809e930 0x7f906813b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:12.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.050+0000 7f906ce0a700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f906809de50 0x7f906809e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46536/0 (socket says 172.21.15.26:46536) 2023-10-01T07:58:12.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.050+0000 7f906ce0a700 1 -- 172.21.15.26:0/3845415631 learned_addr learned my addr 172.21.15.26:0/3845415631 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:12.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.050+0000 7f906de0c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f906809e930 0x7f906813b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51734/0 (socket says 172.21.15.26:51734) 2023-10-01T07:58:12.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.050+0000 7f906d60b700 1 --2- 172.21.15.26:0/3845415631 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f90681338a0 0x7f9068133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:12.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.050+0000 7f905ffff700 1 -- 172.21.15.26:0/3845415631 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2982881483 0 0) 0x7f906806ef30 con 0x7f906809de50 2023-10-01T07:58:12.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.050+0000 7f905ffff700 1 -- 172.21.15.26:0/3845415631 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90540035b0 con 0x7f906809de50 2023-10-01T07:58:12.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.050+0000 7f906de0c700 1 -- 172.21.15.26:0/3845415631 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f90681338a0 msgr2=0x7f9068133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:12.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.050+0000 7f906de0c700 1 --2- 172.21.15.26:0/3845415631 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f90681338a0 0x7f9068133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.050+0000 7f906de0c700 1 -- 172.21.15.26:0/3845415631 >> v1:172.21.15.26:6789/0 conn(0x7f906809de50 legacy=0x7f906809e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:12.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.050+0000 7f906de0c700 1 -- 172.21.15.26:0/3845415631 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f906806fc30 con 0x7f906809e930 2023-10-01T07:58:12.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.050+0000 7f906de0c700 1 --2- 172.21.15.26:0/3845415631 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f906809e930 0x7f906813b740 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f9060009dc0 tx=0x7f906000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5e13949936e979f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:12.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.051+0000 7f905ffff700 1 -- 172.21.15.26:0/3845415631 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906000e070 con 0x7f906809e930 2023-10-01T07:58:12.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.051+0000 7f905ffff700 1 -- 172.21.15.26:0/3845415631 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906000bae0 con 0x7f906809e930 2023-10-01T07:58:12.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.051+0000 7f905ffff700 1 -- 172.21.15.26:0/3845415631 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906000be90 con 0x7f906809e930 2023-10-01T07:58:12.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.051+0000 7f906f86f700 1 -- 172.21.15.26:0/3845415631 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f906809e930 msgr2=0x7f906813b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:12.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.051+0000 7f906f86f700 1 --2- 172.21.15.26:0/3845415631 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f906809e930 0x7f906813b740 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f9060009dc0 tx=0x7f906000b330 comp rx=0 tx=0).stop 2023-10-01T07:58:12.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.051+0000 7f906f86f700 1 -- 172.21.15.26:0/3845415631 shutdown_connections 2023-10-01T07:58:12.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.051+0000 7f906f86f700 1 --2- 172.21.15.26:0/3845415631 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f90681338a0 0x7f9068133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.051+0000 7f906f86f700 1 --2- 172.21.15.26:0/3845415631 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f906809e930 0x7f906813b740 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.051+0000 7f906f86f700 1 -- 172.21.15.26:0/3845415631 >> 172.21.15.26:0/3845415631 conn(0x7f90680a2aa0 msgr2=0x7f90680a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:12.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.052+0000 7f906f86f700 1 -- 172.21.15.26:0/3845415631 shutdown_connections 2023-10-01T07:58:12.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.052+0000 7f906f86f700 1 -- 172.21.15.26:0/3845415631 wait complete. 2023-10-01T07:58:12.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.053+0000 7f906f86f700 1 Processor -- start 2023-10-01T07:58:12.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.053+0000 7f906f86f700 1 -- start start 2023-10-01T07:58:12.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.054+0000 7f906f86f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f906809de50 0x7f906811d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:12.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.054+0000 7f906f86f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f906809e930 0x7f906811dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:12.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.054+0000 7f906f86f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90681338a0 0x7f906811e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:12.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.054+0000 7f906f86f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906811ec60 con 0x7f90681338a0 2023-10-01T07:58:12.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.054+0000 7f906f86f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9068120060 con 0x7f906809e930 2023-10-01T07:58:12.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.054+0000 7f906f86f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90680a0c40 con 0x7f906809de50 2023-10-01T07:58:12.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.054+0000 7f906de0c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90681338a0 0x7f906811e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:12.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.054+0000 7f906d60b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f906809de50 0x7f906811d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:12.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.054+0000 7f906de0c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90681338a0 0x7f906811e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49920/0 (socket says 172.21.15.26:49920) 2023-10-01T07:58:12.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.054+0000 7f906d60b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f906809de50 0x7f906811d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:33922/0 (socket says 172.21.15.26:33922) 2023-10-01T07:58:12.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.054+0000 7f906de0c700 1 -- 172.21.15.26:0/1125095591 learned_addr learned my addr 172.21.15.26:0/1125095591 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:12.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.054+0000 7f906ce0a700 1 --2- 172.21.15.26:0/1125095591 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f906809e930 0x7f906811dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:12.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.055+0000 7f906de0c700 1 -- 172.21.15.26:0/1125095591 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f906809de50 msgr2=0x7f906811d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:12.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.055+0000 7f906de0c700 1 --2- 172.21.15.26:0/1125095591 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f906809de50 0x7f906811d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.055+0000 7f906de0c700 1 -- 172.21.15.26:0/1125095591 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f906809e930 msgr2=0x7f906811dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:12.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.055+0000 7f906de0c700 1 --2- 172.21.15.26:0/1125095591 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f906809e930 0x7f906811dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.055+0000 7f906de0c700 1 -- 172.21.15.26:0/1125095591 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9060009a70 con 0x7f90681338a0 2023-10-01T07:58:12.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.055+0000 7f906d60b700 1 --2- 172.21.15.26:0/1125095591 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f906809de50 0x7f906811d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:12.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.055+0000 7f906de0c700 1 --2- 172.21.15.26:0/1125095591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90681338a0 0x7f906811e210 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f906000b680 tx=0x7f9060004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:12.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.055+0000 7f905dffb700 1 -- 172.21.15.26:0/1125095591 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9060004540 con 0x7f90681338a0 2023-10-01T07:58:12.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.055+0000 7f905dffb700 1 -- 172.21.15.26:0/1125095591 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90600046c0 con 0x7f90681338a0 2023-10-01T07:58:12.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.055+0000 7f906f86f700 1 -- 172.21.15.26:0/1125095591 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f906806f6a0 con 0x7f90681338a0 2023-10-01T07:58:12.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.055+0000 7f905dffb700 1 -- 172.21.15.26:0/1125095591 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9060012430 con 0x7f90681338a0 2023-10-01T07:58:12.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.056+0000 7f906f86f700 1 -- 172.21.15.26:0/1125095591 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f906811fa00 con 0x7f90681338a0 2023-10-01T07:58:12.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.057+0000 7f906f86f700 1 -- 172.21.15.26:0/1125095591 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9068074ea0 con 0x7f90681338a0 2023-10-01T07:58:12.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.057+0000 7f905dffb700 1 -- 172.21.15.26:0/1125095591 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9060012590 con 0x7f90681338a0 2023-10-01T07:58:12.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.058+0000 7f905dffb700 1 -- 172.21.15.26:0/1125095591 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9060041b90 con 0x7f90681338a0 2023-10-01T07:58:12.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.063+0000 7f905dffb700 1 -- 172.21.15.26:0/1125095591 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f906002d750 con 0x7f90681338a0 2023-10-01T07:58:12.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.115+0000 7f10c0124700 1 Processor -- start 2023-10-01T07:58:12.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.116+0000 7f10c0124700 1 -- start start 2023-10-01T07:58:12.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.116+0000 7f10c0124700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f10b8130560 0x7f10b8130930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:12.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.116+0000 7f10c0124700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10b809eca0 0x7f10b806f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:12.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.116+0000 7f10c0124700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f10b8130e70 0x7f10b806fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:12.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.116+0000 7f10c0124700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10b8070a50 con 0x7f10b8130560 2023-10-01T07:58:12.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.116+0000 7f10c0124700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b80717d0 con 0x7f10b809eca0 2023-10-01T07:58:12.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.116+0000 7f10c0124700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10b8130340 con 0x7f10b8130e70 2023-10-01T07:58:12.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.117+0000 7f10bd6bf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10b809eca0 0x7f10b806f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:12.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.117+0000 7f10bd6bf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10b809eca0 0x7f10b806f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51754/0 (socket says 172.21.15.26:51754) 2023-10-01T07:58:12.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.117+0000 7f10bd6bf700 1 -- 172.21.15.26:0/3022800438 learned_addr learned my addr 172.21.15.26:0/3022800438 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:12.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.117+0000 7f10bdec0700 1 --2- 172.21.15.26:0/3022800438 >> v2:172.21.15.26:3300/0 conn(0x7f10b8130560 0x7f10b8130930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:12.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.117+0000 7f10be6c1700 1 --2- 172.21.15.26:0/3022800438 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f10b8130e70 0x7f10b806fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:12.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.117+0000 7f10bdec0700 1 -- 172.21.15.26:0/3022800438 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f10b8130e70 msgr2=0x7f10b806fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:12.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.117+0000 7f10bdec0700 1 --2- 172.21.15.26:0/3022800438 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f10b8130e70 0x7f10b806fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.117+0000 7f10bdec0700 1 -- 172.21.15.26:0/3022800438 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10b809eca0 msgr2=0x7f10b806f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:12.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.117+0000 7f10bdec0700 1 --2- 172.21.15.26:0/3022800438 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10b809eca0 0x7f10b806f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.117+0000 7f10bdec0700 1 -- 172.21.15.26:0/3022800438 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b8071060 con 0x7f10b8130560 2023-10-01T07:58:12.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.117+0000 7f10bdec0700 1 --2- 172.21.15.26:0/3022800438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10b8130560 0x7f10b8130930 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f10b4009840 tx=0x7f10b4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a86aabb5c4b63ce8 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:12.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.118+0000 7f10bcebe700 1 -- 172.21.15.26:0/3022800438 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b4011830 con 0x7f10b8130560 2023-10-01T07:58:12.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.118+0000 7f10bcebe700 1 -- 172.21.15.26:0/3022800438 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b4011990 con 0x7f10b8130560 2023-10-01T07:58:12.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.118+0000 7f10bcebe700 1 -- 172.21.15.26:0/3022800438 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b4011d20 con 0x7f10b8130560 2023-10-01T07:58:12.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.119+0000 7f10c0124700 1 -- 172.21.15.26:0/3022800438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10b8130560 msgr2=0x7f10b8130930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:12.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.119+0000 7f10c0124700 1 --2- 172.21.15.26:0/3022800438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10b8130560 0x7f10b8130930 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f10b4009840 tx=0x7f10b4009b50 comp rx=0 tx=0).stop 2023-10-01T07:58:12.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.119+0000 7f10c0124700 1 -- 172.21.15.26:0/3022800438 shutdown_connections 2023-10-01T07:58:12.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.119+0000 7f10c0124700 1 --2- 172.21.15.26:0/3022800438 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f10b8130e70 0x7f10b806fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.119+0000 7f10c0124700 1 --2- 172.21.15.26:0/3022800438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10b8130560 0x7f10b8130930 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.119+0000 7f10c0124700 1 --2- 172.21.15.26:0/3022800438 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10b809eca0 0x7f10b806f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.119+0000 7f10c0124700 1 -- 172.21.15.26:0/3022800438 >> 172.21.15.26:0/3022800438 conn(0x7f10b80a2aa0 msgr2=0x7f10b80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:12.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.119+0000 7f10c0124700 1 -- 172.21.15.26:0/3022800438 shutdown_connections 2023-10-01T07:58:12.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.119+0000 7f10c0124700 1 -- 172.21.15.26:0/3022800438 wait complete. 2023-10-01T07:58:12.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.120+0000 7f10c0124700 1 Processor -- start 2023-10-01T07:58:12.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.120+0000 7f10c0124700 1 -- start start 2023-10-01T07:58:12.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.121+0000 7f10c0124700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10b809eca0 0x7f10b809a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:12.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.121+0000 7f10c0124700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f10b8130560 0x7f10b809ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:12.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.121+0000 7f10c0124700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10b8130e70 0x7f10b809b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:12.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.121+0000 7f10c0124700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b809ba90 con 0x7f10b809eca0 2023-10-01T07:58:12.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.121+0000 7f10c0124700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b81232d0 con 0x7f10b8130e70 2023-10-01T07:58:12.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.121+0000 7f10c0124700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10b81234b0 con 0x7f10b8130560 2023-10-01T07:58:12.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.121+0000 7f10be6c1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10b8130e70 0x7f10b809b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:12.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.121+0000 7f10be6c1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10b8130e70 0x7f10b809b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51756/0 (socket says 172.21.15.26:51756) 2023-10-01T07:58:12.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.121+0000 7f10be6c1700 1 -- 172.21.15.26:0/1806967881 learned_addr learned my addr 172.21.15.26:0/1806967881 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:12.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.121+0000 7f10bdec0700 1 --2- 172.21.15.26:0/1806967881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10b809eca0 0x7f10b809a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:12.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.121+0000 7f10bd6bf700 1 --2- 172.21.15.26:0/1806967881 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f10b8130560 0x7f10b809ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:12.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.121+0000 7f10be6c1700 1 -- 172.21.15.26:0/1806967881 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f10b8130560 msgr2=0x7f10b809ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:12.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.121+0000 7f10be6c1700 1 --2- 172.21.15.26:0/1806967881 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f10b8130560 0x7f10b809ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.121+0000 7f10be6c1700 1 -- 172.21.15.26:0/1806967881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10b809eca0 msgr2=0x7f10b809a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:12.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.121+0000 7f10be6c1700 1 --2- 172.21.15.26:0/1806967881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10b809eca0 0x7f10b809a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.121+0000 7f10be6c1700 1 -- 172.21.15.26:0/1806967881 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b40094a0 con 0x7f10b8130e70 2023-10-01T07:58:12.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.121+0000 7f10be6c1700 1 --2- 172.21.15.26:0/1806967881 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10b8130e70 0x7f10b809b040 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f10b0007e70 tx=0x7f10b000e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:12.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.121+0000 7f10bd6bf700 1 --2- 172.21.15.26:0/1806967881 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f10b8130560 0x7f10b809ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:58:12.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.122+0000 7f10ae7fc700 1 -- 172.21.15.26:0/1806967881 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b000ede0 con 0x7f10b8130e70 2023-10-01T07:58:12.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.122+0000 7f10ae7fc700 1 -- 172.21.15.26:0/1806967881 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b0014420 con 0x7f10b8130e70 2023-10-01T07:58:12.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.122+0000 7f10c0124700 1 -- 172.21.15.26:0/1806967881 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10b812dc20 con 0x7f10b8130e70 2023-10-01T07:58:12.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.122+0000 7f10ae7fc700 1 -- 172.21.15.26:0/1806967881 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b00147d0 con 0x7f10b8130e70 2023-10-01T07:58:12.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.122+0000 7f10c0124700 1 -- 172.21.15.26:0/1806967881 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10b809cf00 con 0x7f10b8130e70 2023-10-01T07:58:12.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.123+0000 7f10c0124700 1 -- 172.21.15.26:0/1806967881 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10b809c240 con 0x7f10b8130e70 2023-10-01T07:58:12.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.123+0000 7f10ae7fc700 1 -- 172.21.15.26:0/1806967881 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f10b0014930 con 0x7f10b8130e70 2023-10-01T07:58:12.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.123+0000 7f10ae7fc700 1 -- 172.21.15.26:0/1806967881 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f10b003ff10 con 0x7f10b8130e70 2023-10-01T07:58:12.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.133+0000 7f10ae7fc700 1 -- 172.21.15.26:0/1806967881 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f10b001bce0 con 0x7f10b8130e70 2023-10-01T07:58:12.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.172+0000 7f4b77e67700 1 Processor -- start 2023-10-01T07:58:12.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.173+0000 7f4b77e67700 1 -- start start 2023-10-01T07:58:12.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.174+0000 7f4b77e67700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b700a1510 0x7f4b70138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:12.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.174+0000 7f4b77e67700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4b70139250 0x7f4b7013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:12.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.174+0000 7f4b77e67700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b7009edd0 con 0x7f4b700a0a30 2023-10-01T07:58:12.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.174+0000 7f4b77e67700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b700a18e0 con 0x7f4b70139250 2023-10-01T07:58:12.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.174+0000 7f4b77e67700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7009e1f0 con 0x7f4b700a1510 2023-10-01T07:58:12.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.174+0000 7f4b75402700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b700a1510 0x7f4b70138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:12.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.174+0000 7f4b75402700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b700a1510 0x7f4b70138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:33950/0 (socket says 172.21.15.26:33950) 2023-10-01T07:58:12.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.174+0000 7f4b75402700 1 -- 172.21.15.26:0/4243171826 learned_addr learned my addr 172.21.15.26:0/4243171826 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:12.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.174+0000 7f4b76404700 1 --2- 172.21.15.26:0/4243171826 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4b70139250 0x7f4b7013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:12.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.174+0000 7f4b75402700 1 -- 172.21.15.26:0/4243171826 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4b70139250 msgr2=0x7f4b7013b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:12.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.174+0000 7f4b75402700 1 --2- 172.21.15.26:0/4243171826 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4b70139250 0x7f4b7013b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.175+0000 7f4b75402700 1 -- 172.21.15.26:0/4243171826 >> v1:172.21.15.26:6789/0 conn(0x7f4b700a0a30 legacy=0x7f4b700a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:12.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.175+0000 7f4b75402700 1 -- 172.21.15.26:0/4243171826 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7009dc50 con 0x7f4b700a1510 2023-10-01T07:58:12.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.175+0000 7f4b75402700 1 --2- 172.21.15.26:0/4243171826 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b700a1510 0x7f4b70138d10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4b60009920 tx=0x7f4b60009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2836960b0e8facba server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:12.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.175+0000 7f4b74c01700 1 -- 172.21.15.26:0/4243171826 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3194769189 0 0) 0x7f4b7009edd0 con 0x7f4b700a0a30 2023-10-01T07:58:12.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.175+0000 7f4b74c01700 1 -- 172.21.15.26:0/4243171826 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b60011830 con 0x7f4b700a1510 2023-10-01T07:58:12.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.175+0000 7f4b74c01700 1 -- 172.21.15.26:0/4243171826 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b60011990 con 0x7f4b700a1510 2023-10-01T07:58:12.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.175+0000 7f4b74c01700 1 -- 172.21.15.26:0/4243171826 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b60011d00 con 0x7f4b700a1510 2023-10-01T07:58:12.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.176+0000 7f4b77e67700 1 -- 172.21.15.26:0/4243171826 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b700a1510 msgr2=0x7f4b70138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:12.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.176+0000 7f4b77e67700 1 --2- 172.21.15.26:0/4243171826 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b700a1510 0x7f4b70138d10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4b60009920 tx=0x7f4b60009c30 comp rx=0 tx=0).stop 2023-10-01T07:58:12.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.176+0000 7f4b77e67700 1 -- 172.21.15.26:0/4243171826 shutdown_connections 2023-10-01T07:58:12.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.176+0000 7f4b77e67700 1 --2- 172.21.15.26:0/4243171826 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4b70139250 0x7f4b7013b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.176+0000 7f4b77e67700 1 --2- 172.21.15.26:0/4243171826 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b700a1510 0x7f4b70138d10 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.176+0000 7f4b77e67700 1 -- 172.21.15.26:0/4243171826 >> 172.21.15.26:0/4243171826 conn(0x7f4b700a6550 msgr2=0x7f4b700a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:12.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.176+0000 7f4b77e67700 1 -- 172.21.15.26:0/4243171826 shutdown_connections 2023-10-01T07:58:12.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.176+0000 7f4b77e67700 1 -- 172.21.15.26:0/4243171826 wait complete. 2023-10-01T07:58:12.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.177+0000 7f4b77e67700 1 Processor -- start 2023-10-01T07:58:12.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.177+0000 7f4b77e67700 1 -- start start 2023-10-01T07:58:12.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.178+0000 7f4b77e67700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b700a0a30 0x7f4b701217e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:12.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.178+0000 7f4b77e67700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b700a1510 0x7f4b70121d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:12.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.178+0000 7f4b77e67700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4b70139250 0x7f4b70122260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:12.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.178+0000 7f4b77e67700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b701249e0 con 0x7f4b700a0a30 2023-10-01T07:58:12.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.178+0000 7f4b77e67700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b70124f90 con 0x7f4b70139250 2023-10-01T07:58:12.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.178+0000 7f4b77e67700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b70123360 con 0x7f4b700a1510 2023-10-01T07:58:12.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.178+0000 7f4b75402700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b700a1510 0x7f4b70121d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:12.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.178+0000 7f4b76404700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4b70139250 0x7f4b70122260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:12.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.178+0000 7f4b75402700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b700a1510 0x7f4b70121d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:33964/0 (socket says 172.21.15.26:33964) 2023-10-01T07:58:12.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.178+0000 7f4b75402700 1 -- 172.21.15.26:0/3106982572 learned_addr learned my addr 172.21.15.26:0/3106982572 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:12.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.178+0000 7f4b75402700 1 -- 172.21.15.26:0/3106982572 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4b70139250 msgr2=0x7f4b70122260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:12.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.178+0000 7f4b75402700 1 --2- 172.21.15.26:0/3106982572 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4b70139250 0x7f4b70122260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.178+0000 7f4b75402700 1 -- 172.21.15.26:0/3106982572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b700a0a30 msgr2=0x7f4b701217e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:12.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.178+0000 7f4b75402700 1 --2- 172.21.15.26:0/3106982572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b700a0a30 0x7f4b701217e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.178+0000 7f4b75402700 1 -- 172.21.15.26:0/3106982572 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b60009550 con 0x7f4b700a1510 2023-10-01T07:58:12.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.179+0000 7f4b75402700 1 --2- 172.21.15.26:0/3106982572 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b700a1510 0x7f4b70121d20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4b60009f80 tx=0x7f4b60004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:12.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.179+0000 7f4b667fc700 1 -- 172.21.15.26:0/3106982572 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b60004510 con 0x7f4b700a1510 2023-10-01T07:58:12.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.179+0000 7f4b77e67700 1 -- 172.21.15.26:0/3106982572 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b70138ad0 con 0x7f4b700a1510 2023-10-01T07:58:12.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.179+0000 7f4b667fc700 1 -- 172.21.15.26:0/3106982572 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6001f070 con 0x7f4b700a1510 2023-10-01T07:58:12.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.179+0000 7f4b667fc700 1 -- 172.21.15.26:0/3106982572 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b600038e0 con 0x7f4b700a1510 2023-10-01T07:58:12.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.179+0000 7f4b77e67700 1 -- 172.21.15.26:0/3106982572 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b70123b20 con 0x7f4b700a1510 2023-10-01T07:58:12.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.180+0000 7f4b667fc700 1 -- 172.21.15.26:0/3106982572 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4b60003a40 con 0x7f4b700a1510 2023-10-01T07:58:12.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.180+0000 7f4b77e67700 1 -- 172.21.15.26:0/3106982572 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b700a1d00 con 0x7f4b700a1510 2023-10-01T07:58:12.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.180+0000 7f4b667fc700 1 -- 172.21.15.26:0/3106982572 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4b60021070 con 0x7f4b700a1510 2023-10-01T07:58:12.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.185+0000 7f4b667fc700 1 -- 172.21.15.26:0/3106982572 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b60010380 con 0x7f4b700a1510 2023-10-01T07:58:12.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.217+0000 7f79e60fe700 1 Processor -- start 2023-10-01T07:58:12.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.217+0000 7f79e60fe700 1 -- start start 2023-10-01T07:58:12.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.218+0000 7f79e60fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f79e009d630 0x7f79e00a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:12.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.218+0000 7f79e60fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79e0138d80 0x7f79e013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:12.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.218+0000 7f79e60fe700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e00a2a70 con 0x7f79e00a0a30 2023-10-01T07:58:12.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.218+0000 7f79e60fe700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e00a01d0 con 0x7f79e009d630 2023-10-01T07:58:12.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.218+0000 7f79e60fe700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e009e2b0 con 0x7f79e0138d80 2023-10-01T07:58:12.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.218+0000 7f79dffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79e0138d80 0x7f79e013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:12.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.218+0000 7f79df7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f79e00a0a30 0x7f79e00a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46552/0 (socket says 172.21.15.26:46552) 2023-10-01T07:58:12.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.218+0000 7f79df7fe700 1 -- 172.21.15.26:0/636939549 learned_addr learned my addr 172.21.15.26:0/636939549 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:12.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.218+0000 7f79dffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79e0138d80 0x7f79e013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51770/0 (socket says 172.21.15.26:51770) 2023-10-01T07:58:12.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.218+0000 7f79deffd700 1 --2- 172.21.15.26:0/636939549 >> v2:172.21.15.26:3300/0 conn(0x7f79e009d630 0x7f79e00a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:12.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.219+0000 7f79dffff700 1 -- 172.21.15.26:0/636939549 >> v2:172.21.15.26:3300/0 conn(0x7f79e009d630 msgr2=0x7f79e00a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:12.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.219+0000 7f79dffff700 1 --2- 172.21.15.26:0/636939549 >> v2:172.21.15.26:3300/0 conn(0x7f79e009d630 0x7f79e00a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.219+0000 7f79dffff700 1 -- 172.21.15.26:0/636939549 >> v1:172.21.15.26:6789/0 conn(0x7f79e00a0a30 legacy=0x7f79e00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:12.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.219+0000 7f79dffff700 1 -- 172.21.15.26:0/636939549 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e009dc50 con 0x7f79e0138d80 2023-10-01T07:58:12.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.219+0000 7f79dffff700 1 --2- 172.21.15.26:0/636939549 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79e0138d80 0x7f79e013b160 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f79d8009d90 tx=0x7f79d800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc2c9ab4b8122588 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:12.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.219+0000 7f79de7fc700 1 -- 172.21.15.26:0/636939549 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d800e070 con 0x7f79e0138d80 2023-10-01T07:58:12.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.219+0000 7f79de7fc700 1 -- 172.21.15.26:0/636939549 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d800bb20 con 0x7f79e0138d80 2023-10-01T07:58:12.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.219+0000 7f79de7fc700 1 -- 172.21.15.26:0/636939549 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d8012430 con 0x7f79e0138d80 2023-10-01T07:58:12.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.220+0000 7f79e60fe700 1 -- 172.21.15.26:0/636939549 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79e0138d80 msgr2=0x7f79e013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:12.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.220+0000 7f79e60fe700 1 --2- 172.21.15.26:0/636939549 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79e0138d80 0x7f79e013b160 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f79d8009d90 tx=0x7f79d800b330 comp rx=0 tx=0).stop 2023-10-01T07:58:12.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.220+0000 7f79e60fe700 1 -- 172.21.15.26:0/636939549 shutdown_connections 2023-10-01T07:58:12.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.220+0000 7f79e60fe700 1 --2- 172.21.15.26:0/636939549 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79e0138d80 0x7f79e013b160 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.220+0000 7f79e60fe700 1 --2- 172.21.15.26:0/636939549 >> v2:172.21.15.26:3300/0 conn(0x7f79e009d630 0x7f79e00a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.220+0000 7f79e60fe700 1 -- 172.21.15.26:0/636939549 >> 172.21.15.26:0/636939549 conn(0x7f79e00a3050 msgr2=0x7f79e00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:12.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.220+0000 7f79e60fe700 1 -- 172.21.15.26:0/636939549 shutdown_connections 2023-10-01T07:58:12.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.220+0000 7f79e60fe700 1 -- 172.21.15.26:0/636939549 wait complete. 2023-10-01T07:58:12.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.222+0000 7f79e60fe700 1 Processor -- start 2023-10-01T07:58:12.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.222+0000 7f79e60fe700 1 -- start start 2023-10-01T07:58:12.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.223+0000 7f79e60fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79e009d630 0x7f79e0120670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:12.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.223+0000 7f79e60fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79e00a0a30 0x7f79e0120bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:12.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.223+0000 7f79e60fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79e0138d80 0x7f79e01210f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:12.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.223+0000 7f79e60fe700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e0124190 con 0x7f79e009d630 2023-10-01T07:58:12.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.223+0000 7f79e60fe700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e0121ad0 con 0x7f79e0138d80 2023-10-01T07:58:12.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.223+0000 7f79e60fe700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79e0123120 con 0x7f79e00a0a30 2023-10-01T07:58:12.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.223+0000 7f79df7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79e009d630 0x7f79e0120670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:12.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.223+0000 7f79df7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79e009d630 0x7f79e0120670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49952/0 (socket says 172.21.15.26:49952) 2023-10-01T07:58:12.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.223+0000 7f79df7fe700 1 -- 172.21.15.26:0/2133114643 learned_addr learned my addr 172.21.15.26:0/2133114643 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:12.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.223+0000 7f79dffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79e0138d80 0x7f79e01210f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:12.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.223+0000 7f79df7fe700 1 -- 172.21.15.26:0/2133114643 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79e00a0a30 msgr2=0x7f79e0120bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:12.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.223+0000 7f79df7fe700 1 --2- 172.21.15.26:0/2133114643 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79e00a0a30 0x7f79e0120bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.223+0000 7f79df7fe700 1 -- 172.21.15.26:0/2133114643 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79e0138d80 msgr2=0x7f79e01210f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:12.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.223+0000 7f79df7fe700 1 --2- 172.21.15.26:0/2133114643 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79e0138d80 0x7f79e01210f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.223+0000 7f79df7fe700 1 -- 172.21.15.26:0/2133114643 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d8009a70 con 0x7f79e009d630 2023-10-01T07:58:12.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.224+0000 7f79df7fe700 1 --2- 172.21.15.26:0/2133114643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79e009d630 0x7f79e0120670 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f79d000c550 tx=0x7f79d000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:12.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.224+0000 7f79c7fff700 1 -- 172.21.15.26:0/2133114643 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d0005d70 con 0x7f79e009d630 2023-10-01T07:58:12.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.224+0000 7f79c7fff700 1 -- 172.21.15.26:0/2133114643 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d00070d0 con 0x7f79e009d630 2023-10-01T07:58:12.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.224+0000 7f79e60fe700 1 -- 172.21.15.26:0/2133114643 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e0123540 con 0x7f79e009d630 2023-10-01T07:58:12.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.224+0000 7f79c7fff700 1 -- 172.21.15.26:0/2133114643 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d0007440 con 0x7f79e009d630 2023-10-01T07:58:12.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.224+0000 7f79e60fe700 1 -- 172.21.15.26:0/2133114643 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e0138ad0 con 0x7f79e009d630 2023-10-01T07:58:12.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.225+0000 7f79c7fff700 1 -- 172.21.15.26:0/2133114643 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f79d00075a0 con 0x7f79e009d630 2023-10-01T07:58:12.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.225+0000 7f79c7fff700 1 -- 172.21.15.26:0/2133114643 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f79d003eb70 con 0x7f79e009d630 2023-10-01T07:58:12.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.225+0000 7f79e60fe700 1 -- 172.21.15.26:0/2133114643 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79e00747f0 con 0x7f79e009d630 2023-10-01T07:58:12.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.230+0000 7f79c7fff700 1 -- 172.21.15.26:0/2133114643 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f79d0017080 con 0x7f79e009d630 2023-10-01T07:58:12.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.299+0000 7f906f86f700 1 -- 172.21.15.26:0/1125095591 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f906806b9e0 con 0x7f90681338a0 2023-10-01T07:58:12.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.299+0000 7f905dffb700 1 -- 172.21.15.26:0/1125095591 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f906002d390 con 0x7f90681338a0 2023-10-01T07:58:12.300 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:12.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.303+0000 7f906f86f700 1 -- 172.21.15.26:0/1125095591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90681338a0 msgr2=0x7f906811e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:12.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.303+0000 7f906f86f700 1 --2- 172.21.15.26:0/1125095591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90681338a0 0x7f906811e210 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f906000b680 tx=0x7f9060004ad0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.303+0000 7f906f86f700 1 -- 172.21.15.26:0/1125095591 shutdown_connections 2023-10-01T07:58:12.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.303+0000 7f906f86f700 1 --2- 172.21.15.26:0/1125095591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90681338a0 0x7f906811e210 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.303+0000 7f906f86f700 1 --2- 172.21.15.26:0/1125095591 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f906809de50 0x7f906811d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.303+0000 7f906f86f700 1 --2- 172.21.15.26:0/1125095591 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f906809e930 0x7f906811dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.303+0000 7f906f86f700 1 -- 172.21.15.26:0/1125095591 >> 172.21.15.26:0/1125095591 conn(0x7f90680a2aa0 msgr2=0x7f906809ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:12.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.303+0000 7f906f86f700 1 -- 172.21.15.26:0/1125095591 shutdown_connections 2023-10-01T07:58:12.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.303+0000 7f906f86f700 1 -- 172.21.15.26:0/1125095591 wait complete. 2023-10-01T07:58:12.323 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:12.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.359+0000 7f10c0124700 1 -- 172.21.15.26:0/1806967881 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f10b81235f0 con 0x7f10b8130e70 2023-10-01T07:58:12.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.359+0000 7f10ae7fc700 1 -- 172.21.15.26:0/1806967881 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f10b81235f0 con 0x7f10b8130e70 2023-10-01T07:58:12.360 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:12.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.361+0000 7f10c0124700 1 -- 172.21.15.26:0/1806967881 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10b8130e70 msgr2=0x7f10b809b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:12.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.361+0000 7f10c0124700 1 --2- 172.21.15.26:0/1806967881 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10b8130e70 0x7f10b809b040 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f10b0007e70 tx=0x7f10b000e3c0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.361+0000 7f10c0124700 1 -- 172.21.15.26:0/1806967881 shutdown_connections 2023-10-01T07:58:12.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.361+0000 7f10c0124700 1 --2- 172.21.15.26:0/1806967881 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10b8130e70 0x7f10b809b040 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.361+0000 7f10c0124700 1 --2- 172.21.15.26:0/1806967881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10b809eca0 0x7f10b809a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.361+0000 7f10c0124700 1 --2- 172.21.15.26:0/1806967881 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f10b8130560 0x7f10b809ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.361+0000 7f10c0124700 1 -- 172.21.15.26:0/1806967881 >> 172.21.15.26:0/1806967881 conn(0x7f10b80a2aa0 msgr2=0x7f10b812e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:12.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.362+0000 7f10c0124700 1 -- 172.21.15.26:0/1806967881 shutdown_connections 2023-10-01T07:58:12.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.362+0000 7f10c0124700 1 -- 172.21.15.26:0/1806967881 wait complete. 2023-10-01T07:58:12.376 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:12.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.404+0000 7f4b77e67700 1 -- 172.21.15.26:0/3106982572 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4b70074ea0 con 0x7f4b700a1510 2023-10-01T07:58:12.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.405+0000 7f4b667fc700 1 -- 172.21.15.26:0/3106982572 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4b60015020 con 0x7f4b700a1510 2023-10-01T07:58:12.405 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:12.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.407+0000 7f4b77e67700 1 -- 172.21.15.26:0/3106982572 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b700a1510 msgr2=0x7f4b70121d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:12.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.407+0000 7f4b77e67700 1 --2- 172.21.15.26:0/3106982572 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b700a1510 0x7f4b70121d20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4b60009f80 tx=0x7f4b60004750 comp rx=0 tx=0).stop 2023-10-01T07:58:12.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.407+0000 7f4b77e67700 1 -- 172.21.15.26:0/3106982572 shutdown_connections 2023-10-01T07:58:12.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.407+0000 7f4b77e67700 1 --2- 172.21.15.26:0/3106982572 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4b70139250 0x7f4b70122260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.407+0000 7f4b77e67700 1 --2- 172.21.15.26:0/3106982572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b700a0a30 0x7f4b701217e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.407+0000 7f4b77e67700 1 --2- 172.21.15.26:0/3106982572 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b700a1510 0x7f4b70121d20 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.407+0000 7f4b77e67700 1 -- 172.21.15.26:0/3106982572 >> 172.21.15.26:0/3106982572 conn(0x7f4b700a6550 msgr2=0x7f4b70137b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:12.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.407+0000 7f4b77e67700 1 -- 172.21.15.26:0/3106982572 shutdown_connections 2023-10-01T07:58:12.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.407+0000 7f4b77e67700 1 -- 172.21.15.26:0/3106982572 wait complete. 2023-10-01T07:58:12.421 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:12.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.439+0000 7f79e60fe700 1 -- 172.21.15.26:0/2133114643 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f79e0124980 con 0x7f79e009d630 2023-10-01T07:58:12.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.439+0000 7f79c7fff700 1 -- 172.21.15.26:0/2133114643 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f79d0011d70 con 0x7f79e009d630 2023-10-01T07:58:12.440 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:12.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.441+0000 7f79e60fe700 1 -- 172.21.15.26:0/2133114643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79e009d630 msgr2=0x7f79e0120670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:12.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.441+0000 7f79e60fe700 1 --2- 172.21.15.26:0/2133114643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79e009d630 0x7f79e0120670 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f79d000c550 tx=0x7f79d000c860 comp rx=0 tx=0).stop 2023-10-01T07:58:12.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.441+0000 7f79e60fe700 1 -- 172.21.15.26:0/2133114643 shutdown_connections 2023-10-01T07:58:12.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.441+0000 7f79e60fe700 1 --2- 172.21.15.26:0/2133114643 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79e0138d80 0x7f79e01210f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.441+0000 7f79e60fe700 1 --2- 172.21.15.26:0/2133114643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79e009d630 0x7f79e0120670 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.441+0000 7f79e60fe700 1 --2- 172.21.15.26:0/2133114643 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79e00a0a30 0x7f79e0120bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:12.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.441+0000 7f79e60fe700 1 -- 172.21.15.26:0/2133114643 >> 172.21.15.26:0/2133114643 conn(0x7f79e00a3050 msgr2=0x7f79e009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:12.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.442+0000 7f79e60fe700 1 -- 172.21.15.26:0/2133114643 shutdown_connections 2023-10-01T07:58:12.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:12.442+0000 7f79e60fe700 1 -- 172.21.15.26:0/2133114643 wait complete. 2023-10-01T07:58:12.455 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:13.324 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:13.377 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:13.422 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:13.456 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:13.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.475+0000 7f711a4e4700 1 Processor -- start 2023-10-01T07:58:13.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.475+0000 7f711a4e4700 1 -- start start 2023-10-01T07:58:13.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.476+0000 7f711a4e4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f71141338a0 0x7f7114133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:13.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.476+0000 7f711a4e4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f711409e930 0x7f711413b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:13.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.476+0000 7f711a4e4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f711406ef30 con 0x7f711409de50 2023-10-01T07:58:13.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.476+0000 7f711a4e4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711406fef0 con 0x7f71141338a0 2023-10-01T07:58:13.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.476+0000 7f711a4e4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71141334b0 con 0x7f711409e930 2023-10-01T07:58:13.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.476+0000 7f7113fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f71141338a0 0x7f7114133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:13.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.476+0000 7f7113fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f71141338a0 0x7f7114133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39028/0 (socket says 172.21.15.26:39028) 2023-10-01T07:58:13.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.476+0000 7f7113fff700 1 -- 172.21.15.26:0/3151902952 learned_addr learned my addr 172.21.15.26:0/3151902952 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:13.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.476+0000 7f71137fe700 1 --1- 172.21.15.26:0/3151902952 >> v1:172.21.15.26:6789/0 conn(0x7f711409de50 0x7f711409e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38768/0 (socket says 172.21.15.26:38768) 2023-10-01T07:58:13.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.477+0000 7f7113fff700 1 -- 172.21.15.26:0/3151902952 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f711409e930 msgr2=0x7f711413b740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-01T07:58:13.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.477+0000 7f7113fff700 1 --2- 172.21.15.26:0/3151902952 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f711409e930 0x7f711413b740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:13.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.477+0000 7f7113fff700 1 -- 172.21.15.26:0/3151902952 >> v1:172.21.15.26:6789/0 conn(0x7f711409de50 legacy=0x7f711409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:13.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.477+0000 7f7113fff700 1 -- 172.21.15.26:0/3151902952 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711406fc30 con 0x7f71141338a0 2023-10-01T07:58:13.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.477+0000 7f7113fff700 1 --2- 172.21.15.26:0/3151902952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71141338a0 0x7f7114133c70 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f71040098f0 tx=0x7f7104009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ddd6dd0114822c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:13.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.477+0000 7f7112ffd700 1 -- 172.21.15.26:0/3151902952 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710400b8a0 con 0x7f71141338a0 2023-10-01T07:58:13.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.477+0000 7f7112ffd700 1 -- 172.21.15.26:0/3151902952 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710400ba00 con 0x7f71141338a0 2023-10-01T07:58:13.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.477+0000 7f7112ffd700 1 -- 172.21.15.26:0/3151902952 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710400bd90 con 0x7f71141338a0 2023-10-01T07:58:13.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.478+0000 7f711a4e4700 1 -- 172.21.15.26:0/3151902952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71141338a0 msgr2=0x7f7114133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:13.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.478+0000 7f711a4e4700 1 --2- 172.21.15.26:0/3151902952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71141338a0 0x7f7114133c70 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f71040098f0 tx=0x7f7104009c00 comp rx=0 tx=0).stop 2023-10-01T07:58:13.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.478+0000 7f711a4e4700 1 -- 172.21.15.26:0/3151902952 shutdown_connections 2023-10-01T07:58:13.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.478+0000 7f711a4e4700 1 --2- 172.21.15.26:0/3151902952 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f711409e930 0x7f711413b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:13.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.478+0000 7f711a4e4700 1 --2- 172.21.15.26:0/3151902952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71141338a0 0x7f7114133c70 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:13.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.478+0000 7f711a4e4700 1 -- 172.21.15.26:0/3151902952 >> 172.21.15.26:0/3151902952 conn(0x7f71140a2aa0 msgr2=0x7f71140a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:13.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.478+0000 7f711a4e4700 1 -- 172.21.15.26:0/3151902952 shutdown_connections 2023-10-01T07:58:13.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.478+0000 7f711a4e4700 1 -- 172.21.15.26:0/3151902952 wait complete. 2023-10-01T07:58:13.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.479+0000 7f711a4e4700 1 Processor -- start 2023-10-01T07:58:13.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.480+0000 7f711a4e4700 1 -- start start 2023-10-01T07:58:13.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.480+0000 7f711a4e4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f711409de50 0x7f711411eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:13.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.480+0000 7f711a4e4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f711409e930 0x7f711411f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:13.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.480+0000 7f711a4e4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71141338a0 0x7f711411f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:13.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.480+0000 7f711a4e4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7114122730 con 0x7f71141338a0 2023-10-01T07:58:13.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.480+0000 7f711a4e4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71141207c0 con 0x7f711409de50 2023-10-01T07:58:13.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.480+0000 7f711a4e4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f711406f640 con 0x7f711409e930 2023-10-01T07:58:13.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.480+0000 7f7113fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f711409de50 0x7f711411eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:13.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.480+0000 7f7113fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f711409de50 0x7f711411eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43136/0 (socket says 172.21.15.26:43136) 2023-10-01T07:58:13.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.480+0000 7f7113fff700 1 -- 172.21.15.26:0/562163563 learned_addr learned my addr 172.21.15.26:0/562163563 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:13.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.480+0000 7f71137fe700 1 --2- 172.21.15.26:0/562163563 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f711409e930 0x7f711411f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:13.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.480+0000 7f7118a81700 1 --2- 172.21.15.26:0/562163563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71141338a0 0x7f711411f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:13.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.481+0000 7f71137fe700 1 -- 172.21.15.26:0/562163563 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f711409de50 msgr2=0x7f711411eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:13.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.481+0000 7f71137fe700 1 --2- 172.21.15.26:0/562163563 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f711409de50 0x7f711411eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:13.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.481+0000 7f71137fe700 1 -- 172.21.15.26:0/562163563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71141338a0 msgr2=0x7f711411f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:13.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.481+0000 7f71137fe700 1 --2- 172.21.15.26:0/562163563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71141338a0 0x7f711411f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:13.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.481+0000 7f71137fe700 1 -- 172.21.15.26:0/562163563 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7104009550 con 0x7f711409e930 2023-10-01T07:58:13.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.481+0000 7f7118a81700 1 --2- 172.21.15.26:0/562163563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71141338a0 0x7f711411f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:13.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.481+0000 7f71137fe700 1 --2- 172.21.15.26:0/562163563 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f711409e930 0x7f711411f050 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f710800c3c0 tx=0x7f710800c6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:13.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.481+0000 7f7110ff9700 1 -- 172.21.15.26:0/562163563 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7108005cb0 con 0x7f711409e930 2023-10-01T07:58:13.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.481+0000 7f7110ff9700 1 -- 172.21.15.26:0/562163563 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7108005e10 con 0x7f711409e930 2023-10-01T07:58:13.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.481+0000 7f711a4e4700 1 -- 172.21.15.26:0/562163563 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f711412fad0 con 0x7f711409e930 2023-10-01T07:58:13.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.481+0000 7f7110ff9700 1 -- 172.21.15.26:0/562163563 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71080072d0 con 0x7f711409e930 2023-10-01T07:58:13.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.481+0000 7f711a4e4700 1 -- 172.21.15.26:0/562163563 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7114121da0 con 0x7f711409e930 2023-10-01T07:58:13.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.482+0000 7f7110ff9700 1 -- 172.21.15.26:0/562163563 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7108007430 con 0x7f711409e930 2023-10-01T07:58:13.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.483+0000 7f7110ff9700 1 -- 172.21.15.26:0/562163563 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f710803e9d0 con 0x7f711409e930 2023-10-01T07:58:13.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.483+0000 7f711a4e4700 1 -- 172.21.15.26:0/562163563 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f711412f670 con 0x7f711409e930 2023-10-01T07:58:13.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.488+0000 7f7110ff9700 1 -- 172.21.15.26:0/562163563 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7108017080 con 0x7f711409e930 2023-10-01T07:58:13.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.540+0000 7f05d4984700 1 Processor -- start 2023-10-01T07:58:13.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.540+0000 7f05d4984700 1 -- start start 2023-10-01T07:58:13.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.541+0000 7f05d4984700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f05d009d630 0x7f05d00a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:13.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.541+0000 7f05d4984700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f05d0138d80 0x7f05d013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:13.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.541+0000 7f05d4984700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d00a2a70 con 0x7f05d00a0a30 2023-10-01T07:58:13.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.541+0000 7f05d4984700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d00a01d0 con 0x7f05d0138d80 2023-10-01T07:58:13.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.541+0000 7f05d4984700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05d009e2b0 con 0x7f05d009d630 2023-10-01T07:58:13.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.541+0000 7f05cdd9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f05d009d630 0x7f05d00a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:13.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.541+0000 7f05cdd9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f05d009d630 0x7f05d00a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59362/0 (socket says 172.21.15.26:59362) 2023-10-01T07:58:13.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.541+0000 7f05cdd9b700 1 -- 172.21.15.26:0/2368479886 learned_addr learned my addr 172.21.15.26:0/2368479886 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:13.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.542+0000 7f05ced9d700 1 --2- 172.21.15.26:0/2368479886 >> v2:172.21.15.26:3300/0 conn(0x7f05d0138d80 0x7f05d013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:13.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.542+0000 7f05cdd9b700 1 -- 172.21.15.26:0/2368479886 >> v2:172.21.15.26:3300/0 conn(0x7f05d0138d80 msgr2=0x7f05d013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:13.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.542+0000 7f05cdd9b700 1 --2- 172.21.15.26:0/2368479886 >> v2:172.21.15.26:3300/0 conn(0x7f05d0138d80 0x7f05d013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:13.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.542+0000 7f05cdd9b700 1 -- 172.21.15.26:0/2368479886 >> v1:172.21.15.26:6789/0 conn(0x7f05d00a0a30 legacy=0x7f05d00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:13.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.542+0000 7f05cdd9b700 1 -- 172.21.15.26:0/2368479886 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d009dc50 con 0x7f05d009d630 2023-10-01T07:58:13.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.542+0000 7f05cdd9b700 1 --2- 172.21.15.26:0/2368479886 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f05d009d630 0x7f05d00a1510 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f05c40098f0 tx=0x7f05c4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a971e4d84309696f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:13.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.542+0000 7f05cd59a700 1 -- 172.21.15.26:0/2368479886 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c4004230 con 0x7f05d009d630 2023-10-01T07:58:13.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.542+0000 7f05cd59a700 1 -- 172.21.15.26:0/2368479886 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c4004390 con 0x7f05d009d630 2023-10-01T07:58:13.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.542+0000 7f05cd59a700 1 -- 172.21.15.26:0/2368479886 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c40036a0 con 0x7f05d009d630 2023-10-01T07:58:13.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.543+0000 7f05d4984700 1 -- 172.21.15.26:0/2368479886 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f05d009d630 msgr2=0x7f05d00a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:13.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.543+0000 7f05d4984700 1 --2- 172.21.15.26:0/2368479886 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f05d009d630 0x7f05d00a1510 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f05c40098f0 tx=0x7f05c4009c00 comp rx=0 tx=0).stop 2023-10-01T07:58:13.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.544+0000 7f05d4984700 1 -- 172.21.15.26:0/2368479886 shutdown_connections 2023-10-01T07:58:13.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.544+0000 7f05d4984700 1 --2- 172.21.15.26:0/2368479886 >> v2:172.21.15.26:3300/0 conn(0x7f05d0138d80 0x7f05d013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:13.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.544+0000 7f05d4984700 1 --2- 172.21.15.26:0/2368479886 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f05d009d630 0x7f05d00a1510 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:13.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.544+0000 7f05d4984700 1 -- 172.21.15.26:0/2368479886 >> 172.21.15.26:0/2368479886 conn(0x7f05d00a3050 msgr2=0x7f05d00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:13.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.544+0000 7f05d4984700 1 -- 172.21.15.26:0/2368479886 shutdown_connections 2023-10-01T07:58:13.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.544+0000 7f05d4984700 1 -- 172.21.15.26:0/2368479886 wait complete. 2023-10-01T07:58:13.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.545+0000 7f05d4984700 1 Processor -- start 2023-10-01T07:58:13.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.546+0000 7f05d4984700 1 -- start start 2023-10-01T07:58:13.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.546+0000 7f05d4984700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f05d009d630 0x7f05d0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:13.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.546+0000 7f05d4984700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05d00a0a30 0x7f05d0133f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:13.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.546+0000 7f05d4984700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f05d0138d80 0x7f05d0134490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:13.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.546+0000 7f05d4984700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d0136f40 con 0x7f05d00a0a30 2023-10-01T07:58:13.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.546+0000 7f05d4984700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d01380f0 con 0x7f05d009d630 2023-10-01T07:58:13.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.546+0000 7f05d4984700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05d0137120 con 0x7f05d0138d80 2023-10-01T07:58:13.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.547+0000 7f05cdd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05d00a0a30 0x7f05d0133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:13.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.547+0000 7f05ced9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f05d0138d80 0x7f05d0134490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:13.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.547+0000 7f05cdd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05d00a0a30 0x7f05d0133f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39056/0 (socket says 172.21.15.26:39056) 2023-10-01T07:58:13.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.547+0000 7f05cdd9b700 1 -- 172.21.15.26:0/3717528433 learned_addr learned my addr 172.21.15.26:0/3717528433 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:13.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.547+0000 7f05ce59c700 1 --2- 172.21.15.26:0/3717528433 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f05d009d630 0x7f05d0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:13.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.547+0000 7f05cdd9b700 1 -- 172.21.15.26:0/3717528433 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f05d0138d80 msgr2=0x7f05d0134490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:13.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.547+0000 7f05cdd9b700 1 --2- 172.21.15.26:0/3717528433 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f05d0138d80 0x7f05d0134490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:13.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.547+0000 7f05cdd9b700 1 -- 172.21.15.26:0/3717528433 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f05d009d630 msgr2=0x7f05d0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:13.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.547+0000 7f05cdd9b700 1 --2- 172.21.15.26:0/3717528433 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f05d009d630 0x7f05d0133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:13.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.547+0000 7f05cdd9b700 1 -- 172.21.15.26:0/3717528433 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c4009550 con 0x7f05d00a0a30 2023-10-01T07:58:13.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.547+0000 7f05ce59c700 1 --2- 172.21.15.26:0/3717528433 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f05d009d630 0x7f05d0133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:13.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.547+0000 7f05cdd9b700 1 --2- 172.21.15.26:0/3717528433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05d00a0a30 0x7f05d0133f50 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f05c4009130 tx=0x7f05c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:13.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.547+0000 7f05beffd700 1 -- 172.21.15.26:0/3717528433 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c4003b20 con 0x7f05d00a0a30 2023-10-01T07:58:13.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.548+0000 7f05beffd700 1 -- 172.21.15.26:0/3717528433 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c401f070 con 0x7f05d00a0a30 2023-10-01T07:58:13.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.548+0000 7f05beffd700 1 -- 172.21.15.26:0/3717528433 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c4003e80 con 0x7f05d00a0a30 2023-10-01T07:58:13.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.548+0000 7f05d4984700 1 -- 172.21.15.26:0/3717528433 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d00a4d60 con 0x7f05d00a0a30 2023-10-01T07:58:13.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.548+0000 7f05d4984700 1 -- 172.21.15.26:0/3717528433 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d0137b90 con 0x7f05d00a0a30 2023-10-01T07:58:13.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.549+0000 7f05beffd700 1 -- 172.21.15.26:0/3717528433 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f05c4021030 con 0x7f05d00a0a30 2023-10-01T07:58:13.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.549+0000 7f05beffd700 1 -- 172.21.15.26:0/3717528433 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f05c40409b0 con 0x7f05d00a0a30 2023-10-01T07:58:13.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.549+0000 7f05d4984700 1 -- 172.21.15.26:0/3717528433 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d00747f0 con 0x7f05d00a0a30 2023-10-01T07:58:13.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.554+0000 7f05beffd700 1 -- 172.21.15.26:0/3717528433 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f05c40199b0 con 0x7f05d00a0a30 2023-10-01T07:58:13.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.572+0000 7fbdcbf6f700 1 Processor -- start 2023-10-01T07:58:13.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.572+0000 7fbdcbf6f700 1 -- start start 2023-10-01T07:58:13.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.573+0000 7fbdcbf6f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbdc409d6f0 0x7fbdc409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:13.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.573+0000 7fbdcbf6f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdc409e000 0x7fbdc41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:13.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.573+0000 7fbdcbf6f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdc409b120 con 0x7fbdc409e410 2023-10-01T07:58:13.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.573+0000 7fbdcbf6f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdc406b460 con 0x7fbdc409d6f0 2023-10-01T07:58:13.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.573+0000 7fbdcbf6f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc409a7e0 con 0x7fbdc409e000 2023-10-01T07:58:13.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.573+0000 7fbdc9d0b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbdc409d6f0 0x7fbdc409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:13.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.573+0000 7fbdc9d0b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbdc409d6f0 0x7fbdc409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39060/0 (socket says 172.21.15.26:39060) 2023-10-01T07:58:13.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.573+0000 7fbdc9d0b700 1 -- 172.21.15.26:0/1250484312 learned_addr learned my addr 172.21.15.26:0/1250484312 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:13.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.573+0000 7fbdc950a700 1 --2- 172.21.15.26:0/1250484312 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdc409e000 0x7fbdc41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:13.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.573+0000 7fbdc9d0b700 1 -- 172.21.15.26:0/1250484312 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdc409e000 msgr2=0x7fbdc41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:13.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.573+0000 7fbdc9d0b700 1 --2- 172.21.15.26:0/1250484312 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdc409e000 0x7fbdc41339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:13.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.573+0000 7fbdc9d0b700 1 -- 172.21.15.26:0/1250484312 >> v1:172.21.15.26:6789/0 conn(0x7fbdc409e410 legacy=0x7fbdc4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:13.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.573+0000 7fbdc9d0b700 1 -- 172.21.15.26:0/1250484312 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc409a500 con 0x7fbdc409d6f0 2023-10-01T07:58:13.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.574+0000 7fbdc9d0b700 1 --2- 172.21.15.26:0/1250484312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdc409d6f0 0x7fbdc409dac0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fbdc00098f0 tx=0x7fbdc0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f396af418540f96e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:13.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.574+0000 7fbdc8d09700 1 -- 172.21.15.26:0/1250484312 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc0011830 con 0x7fbdc409d6f0 2023-10-01T07:58:13.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.574+0000 7fbdc8d09700 1 -- 172.21.15.26:0/1250484312 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc0011990 con 0x7fbdc409d6f0 2023-10-01T07:58:13.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.574+0000 7fbdc8d09700 1 -- 172.21.15.26:0/1250484312 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc0011d20 con 0x7fbdc409d6f0 2023-10-01T07:58:13.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.574+0000 7fbdcbf6f700 1 -- 172.21.15.26:0/1250484312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdc409d6f0 msgr2=0x7fbdc409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:13.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.574+0000 7fbdcbf6f700 1 --2- 172.21.15.26:0/1250484312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdc409d6f0 0x7fbdc409dac0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fbdc00098f0 tx=0x7fbdc0009c00 comp rx=0 tx=0).stop 2023-10-01T07:58:13.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.575+0000 7fbdcbf6f700 1 -- 172.21.15.26:0/1250484312 shutdown_connections 2023-10-01T07:58:13.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.575+0000 7fbdcbf6f700 1 --2- 172.21.15.26:0/1250484312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdc409d6f0 0x7fbdc409dac0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:13.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.575+0000 7fbdcbf6f700 1 --2- 172.21.15.26:0/1250484312 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdc409e000 0x7fbdc41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:13.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.575+0000 7fbdcbf6f700 1 -- 172.21.15.26:0/1250484312 >> 172.21.15.26:0/1250484312 conn(0x7fbdc4066f50 msgr2=0x7fbdc409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:13.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.575+0000 7fbdcbf6f700 1 -- 172.21.15.26:0/1250484312 shutdown_connections 2023-10-01T07:58:13.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.575+0000 7fbdcbf6f700 1 -- 172.21.15.26:0/1250484312 wait complete. 2023-10-01T07:58:13.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.576+0000 7fbdcbf6f700 1 Processor -- start 2023-10-01T07:58:13.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.576+0000 7fbdcbf6f700 1 -- start start 2023-10-01T07:58:13.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.576+0000 7fbdcbf6f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdc409d6f0 0x7fbdc41a5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:13.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.576+0000 7fbdcbf6f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdc409e000 0x7fbdc41a63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:13.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.576+0000 7fbdcbf6f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbdc409e410 0x7fbdc41a6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:13.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.576+0000 7fbdcbf6f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc41a7340 con 0x7fbdc409e000 2023-10-01T07:58:13.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.576+0000 7fbdcbf6f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc41a7ac0 con 0x7fbdc409e410 2023-10-01T07:58:13.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.576+0000 7fbdcbf6f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc41a80e0 con 0x7fbdc409d6f0 2023-10-01T07:58:13.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.576+0000 7fbdc9d0b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdc409d6f0 0x7fbdc41a5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:13.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.577+0000 7fbdc9d0b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdc409d6f0 0x7fbdc41a5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59372/0 (socket says 172.21.15.26:59372) 2023-10-01T07:58:13.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.577+0000 7fbdc9d0b700 1 -- 172.21.15.26:0/1940691079 learned_addr learned my addr 172.21.15.26:0/1940691079 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:13.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.577+0000 7fbdc950a700 1 --2- 172.21.15.26:0/1940691079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdc409e000 0x7fbdc41a63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:13.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.577+0000 7fbdca50c700 1 --2- 172.21.15.26:0/1940691079 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbdc409e410 0x7fbdc41a6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:13.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.577+0000 7fbdca50c700 1 -- 172.21.15.26:0/1940691079 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdc409d6f0 msgr2=0x7fbdc41a5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:13.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.577+0000 7fbdca50c700 1 --2- 172.21.15.26:0/1940691079 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdc409d6f0 0x7fbdc41a5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:13.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.577+0000 7fbdca50c700 1 -- 172.21.15.26:0/1940691079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdc409e000 msgr2=0x7fbdc41a63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:13.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.577+0000 7fbdca50c700 1 --2- 172.21.15.26:0/1940691079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdc409e000 0x7fbdc41a63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:13.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.577+0000 7fbdca50c700 1 -- 172.21.15.26:0/1940691079 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc0009550 con 0x7fbdc409e410 2023-10-01T07:58:13.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.577+0000 7fbdc950a700 1 --2- 172.21.15.26:0/1940691079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdc409e000 0x7fbdc41a63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:13.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.577+0000 7fbdca50c700 1 --2- 172.21.15.26:0/1940691079 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbdc409e410 0x7fbdc41a6930 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc00cbf0 tx=0x7fbdbc00cf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:13.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.577+0000 7fbdba7fc700 1 -- 172.21.15.26:0/1940691079 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc00a9c0 con 0x7fbdc409e410 2023-10-01T07:58:13.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.577+0000 7fbdba7fc700 1 -- 172.21.15.26:0/1940691079 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdbc00ab20 con 0x7fbdc409e410 2023-10-01T07:58:13.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.578+0000 7fbdcbf6f700 1 -- 172.21.15.26:0/1940691079 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdc41a96f0 con 0x7fbdc409e410 2023-10-01T07:58:13.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.578+0000 7fbdba7fc700 1 -- 172.21.15.26:0/1940691079 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc00ae90 con 0x7fbdc409e410 2023-10-01T07:58:13.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.578+0000 7fbdcbf6f700 1 -- 172.21.15.26:0/1940691079 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdc409c710 con 0x7fbdc409e410 2023-10-01T07:58:13.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.579+0000 7fbdcbf6f700 1 -- 172.21.15.26:0/1940691079 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdc4074ea0 con 0x7fbdc409e410 2023-10-01T07:58:13.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.579+0000 7fbdba7fc700 1 -- 172.21.15.26:0/1940691079 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbdbc005080 con 0x7fbdc409e410 2023-10-01T07:58:13.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.579+0000 7fbdba7fc700 1 -- 172.21.15.26:0/1940691079 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbdbc03f650 con 0x7fbdc409e410 2023-10-01T07:58:13.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.584+0000 7fbdba7fc700 1 -- 172.21.15.26:0/1940691079 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbdbc0108d0 con 0x7fbdc409e410 2023-10-01T07:58:13.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.612+0000 7f164a67e700 1 Processor -- start 2023-10-01T07:58:13.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.612+0000 7f164a67e700 1 -- start start 2023-10-01T07:58:13.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.613+0000 7f164a67e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f164409d6f0 0x7f164409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:13.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.613+0000 7f164a67e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f164409e000 0x7f16441339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:13.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.613+0000 7f164a67e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f164409e410 0x7f1644133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:13.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.613+0000 7f164a67e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f164406b460 con 0x7f164409e410 2023-10-01T07:58:13.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.613+0000 7f164a67e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164409b120 con 0x7f164409e000 2023-10-01T07:58:13.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.613+0000 7f164a67e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f164409a7e0 con 0x7f164409d6f0 2023-10-01T07:58:13.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.613+0000 7f16437fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f164409e000 0x7f16441339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:13.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.613+0000 7f16437fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f164409e000 0x7f16441339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43176/0 (socket says 172.21.15.26:43176) 2023-10-01T07:58:13.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.613+0000 7f16437fe700 1 -- 172.21.15.26:0/2234356993 learned_addr learned my addr 172.21.15.26:0/2234356993 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:13.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.613+0000 7f1643fff700 1 --2- 172.21.15.26:0/2234356993 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f164409d6f0 0x7f164409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:13.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.613+0000 7f1648c1b700 1 --2- 172.21.15.26:0/2234356993 >> v2:172.21.15.26:3300/0 conn(0x7f164409e410 0x7f1644133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:13.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.613+0000 7f16437fe700 1 -- 172.21.15.26:0/2234356993 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f164409d6f0 msgr2=0x7f164409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:13.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.613+0000 7f16437fe700 1 --2- 172.21.15.26:0/2234356993 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f164409d6f0 0x7f164409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:13.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.613+0000 7f16437fe700 1 -- 172.21.15.26:0/2234356993 >> v2:172.21.15.26:3300/0 conn(0x7f164409e410 msgr2=0x7f1644133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:13.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.613+0000 7f16437fe700 1 --2- 172.21.15.26:0/2234356993 >> v2:172.21.15.26:3300/0 conn(0x7f164409e410 0x7f1644133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:13.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.613+0000 7f16437fe700 1 -- 172.21.15.26:0/2234356993 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164409a500 con 0x7f164409e000 2023-10-01T07:58:13.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.613+0000 7f1648c1b700 1 --2- 172.21.15.26:0/2234356993 >> v2:172.21.15.26:3300/0 conn(0x7f164409e410 0x7f1644133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:13.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.614+0000 7f16437fe700 1 --2- 172.21.15.26:0/2234356993 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f164409e000 0x7f16441339f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1638009920 tx=0x7f1638009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34de4efd8aaf474e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:13.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.614+0000 7f1642ffd700 1 -- 172.21.15.26:0/2234356993 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1638011830 con 0x7f164409e000 2023-10-01T07:58:13.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.614+0000 7f1642ffd700 1 -- 172.21.15.26:0/2234356993 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1638011990 con 0x7f164409e000 2023-10-01T07:58:13.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.614+0000 7f1642ffd700 1 -- 172.21.15.26:0/2234356993 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1638011d20 con 0x7f164409e000 2023-10-01T07:58:13.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.615+0000 7f164a67e700 1 -- 172.21.15.26:0/2234356993 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f164409e000 msgr2=0x7f16441339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:13.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.615+0000 7f164a67e700 1 --2- 172.21.15.26:0/2234356993 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f164409e000 0x7f16441339f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1638009920 tx=0x7f1638009c30 comp rx=0 tx=0).stop 2023-10-01T07:58:13.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.615+0000 7f164a67e700 1 -- 172.21.15.26:0/2234356993 shutdown_connections 2023-10-01T07:58:13.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.615+0000 7f164a67e700 1 --2- 172.21.15.26:0/2234356993 >> v2:172.21.15.26:3300/0 conn(0x7f164409e410 0x7f1644133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:13.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.615+0000 7f164a67e700 1 --2- 172.21.15.26:0/2234356993 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f164409d6f0 0x7f164409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:13.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.615+0000 7f164a67e700 1 --2- 172.21.15.26:0/2234356993 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f164409e000 0x7f16441339f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:13.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.615+0000 7f164a67e700 1 -- 172.21.15.26:0/2234356993 >> 172.21.15.26:0/2234356993 conn(0x7f1644066f50 msgr2=0x7f164409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:13.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.615+0000 7f164a67e700 1 -- 172.21.15.26:0/2234356993 shutdown_connections 2023-10-01T07:58:13.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.615+0000 7f164a67e700 1 -- 172.21.15.26:0/2234356993 wait complete. 2023-10-01T07:58:13.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.616+0000 7f164a67e700 1 Processor -- start 2023-10-01T07:58:13.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.616+0000 7f164a67e700 1 -- start start 2023-10-01T07:58:13.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.617+0000 7f164a67e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f164409d6f0 0x7f16441a5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:13.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.617+0000 7f164a67e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f164409e000 0x7f16441a6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:13.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.617+0000 7f164a67e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f164409e410 0x7f16441a69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:13.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.617+0000 7f164a67e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16441a8090 con 0x7f164409e000 2023-10-01T07:58:13.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.617+0000 7f164a67e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16441a9150 con 0x7f164409d6f0 2023-10-01T07:58:13.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.617+0000 7f164a67e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f164409c710 con 0x7f164409e410 2023-10-01T07:58:13.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.617+0000 7f1643fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f164409d6f0 0x7f16441a5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:13.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.617+0000 7f1643fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f164409d6f0 0x7f16441a5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43190/0 (socket says 172.21.15.26:43190) 2023-10-01T07:58:13.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.617+0000 7f1643fff700 1 -- 172.21.15.26:0/2803010227 learned_addr learned my addr 172.21.15.26:0/2803010227 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:13.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.617+0000 7f16437fe700 1 --2- 172.21.15.26:0/2803010227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f164409e000 0x7f16441a6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:13.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.617+0000 7f1648c1b700 1 --2- 172.21.15.26:0/2803010227 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f164409e410 0x7f16441a69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:13.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.617+0000 7f16437fe700 1 -- 172.21.15.26:0/2803010227 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f164409e410 msgr2=0x7f16441a69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:13.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.617+0000 7f16437fe700 1 --2- 172.21.15.26:0/2803010227 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f164409e410 0x7f16441a69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:13.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.617+0000 7f16437fe700 1 -- 172.21.15.26:0/2803010227 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f164409d6f0 msgr2=0x7f16441a5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:13.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.617+0000 7f16437fe700 1 --2- 172.21.15.26:0/2803010227 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f164409d6f0 0x7f16441a5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:13.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.617+0000 7f16437fe700 1 -- 172.21.15.26:0/2803010227 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163c009a70 con 0x7f164409e000 2023-10-01T07:58:13.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.617+0000 7f1643fff700 1 --2- 172.21.15.26:0/2803010227 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f164409d6f0 0x7f16441a5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:13.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.617+0000 7f16437fe700 1 --2- 172.21.15.26:0/2803010227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f164409e000 0x7f16441a6470 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f1638016000 tx=0x7f1638004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:13.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.618+0000 7f1640ff9700 1 -- 172.21.15.26:0/2803010227 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1638004240 con 0x7f164409e000 2023-10-01T07:58:13.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.618+0000 7f164a67e700 1 -- 172.21.15.26:0/2803010227 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1638009550 con 0x7f164409e000 2023-10-01T07:58:13.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.618+0000 7f1640ff9700 1 -- 172.21.15.26:0/2803010227 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163801f070 con 0x7f164409e000 2023-10-01T07:58:13.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.618+0000 7f1640ff9700 1 -- 172.21.15.26:0/2803010227 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16380036a0 con 0x7f164409e000 2023-10-01T07:58:13.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.618+0000 7f164a67e700 1 -- 172.21.15.26:0/2803010227 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16441a7ab0 con 0x7f164409e000 2023-10-01T07:58:13.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.619+0000 7f164a67e700 1 -- 172.21.15.26:0/2803010227 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16441a9540 con 0x7f164409e000 2023-10-01T07:58:13.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.619+0000 7f1640ff9700 1 -- 172.21.15.26:0/2803010227 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1638021030 con 0x7f164409e000 2023-10-01T07:58:13.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.619+0000 7f1640ff9700 1 -- 172.21.15.26:0/2803010227 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1638040a50 con 0x7f164409e000 2023-10-01T07:58:13.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.624+0000 7f1640ff9700 1 -- 172.21.15.26:0/2803010227 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f16380237e0 con 0x7f164409e000 2023-10-01T07:58:13.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.779+0000 7f711a4e4700 1 -- 172.21.15.26:0/562163563 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7114074ea0 con 0x7f711409e930 2023-10-01T07:58:13.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.780+0000 7f7110ff9700 1 -- 172.21.15.26:0/562163563 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f710801b3b0 con 0x7f711409e930 2023-10-01T07:58:13.781 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:13.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.782+0000 7f711a4e4700 1 -- 172.21.15.26:0/562163563 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f711409e930 msgr2=0x7f711411f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:13.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.782+0000 7f711a4e4700 1 --2- 172.21.15.26:0/562163563 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f711409e930 0x7f711411f050 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f710800c3c0 tx=0x7f710800c6d0 comp rx=0 tx=0).stop 2023-10-01T07:58:13.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.782+0000 7f711a4e4700 1 -- 172.21.15.26:0/562163563 shutdown_connections 2023-10-01T07:58:13.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.782+0000 7f711a4e4700 1 --2- 172.21.15.26:0/562163563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71141338a0 0x7f711411f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:13.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.782+0000 7f711a4e4700 1 --2- 172.21.15.26:0/562163563 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f711409de50 0x7f711411eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:13.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.782+0000 7f711a4e4700 1 --2- 172.21.15.26:0/562163563 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f711409e930 0x7f711411f050 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:13.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.782+0000 7f711a4e4700 1 -- 172.21.15.26:0/562163563 >> 172.21.15.26:0/562163563 conn(0x7f71140a2aa0 msgr2=0x7f711409ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:13.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.784+0000 7f711a4e4700 1 -- 172.21.15.26:0/562163563 shutdown_connections 2023-10-01T07:58:13.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.784+0000 7f711a4e4700 1 -- 172.21.15.26:0/562163563 wait complete. 2023-10-01T07:58:13.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.793+0000 7fbdcbf6f700 1 -- 172.21.15.26:0/1940691079 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbdc406c360 con 0x7fbdc409e410 2023-10-01T07:58:13.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.794+0000 7fbdba7fc700 1 -- 172.21.15.26:0/1940691079 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbdbc0102e0 con 0x7fbdc409e410 2023-10-01T07:58:13.794 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:13.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.796+0000 7fbdcbf6f700 1 -- 172.21.15.26:0/1940691079 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbdc409e410 msgr2=0x7fbdc41a6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:13.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.796+0000 7fbdcbf6f700 1 --2- 172.21.15.26:0/1940691079 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbdc409e410 0x7fbdc41a6930 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc00cbf0 tx=0x7fbdbc00cf00 comp rx=0 tx=0).stop 2023-10-01T07:58:13.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.796+0000 7fbdcbf6f700 1 -- 172.21.15.26:0/1940691079 shutdown_connections 2023-10-01T07:58:13.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.796+0000 7fbdcbf6f700 1 --2- 172.21.15.26:0/1940691079 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbdc409e410 0x7fbdc41a6930 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:13.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.796+0000 7fbdcbf6f700 1 --2- 172.21.15.26:0/1940691079 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdc409d6f0 0x7fbdc41a5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:13.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.796+0000 7fbdcbf6f700 1 --2- 172.21.15.26:0/1940691079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdc409e000 0x7fbdc41a63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:13.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.796+0000 7fbdcbf6f700 1 -- 172.21.15.26:0/1940691079 >> 172.21.15.26:0/1940691079 conn(0x7fbdc4066f50 msgr2=0x7fbdc41badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:13.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.796+0000 7fbdcbf6f700 1 -- 172.21.15.26:0/1940691079 shutdown_connections 2023-10-01T07:58:13.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.796+0000 7fbdcbf6f700 1 -- 172.21.15.26:0/1940691079 wait complete. 2023-10-01T07:58:13.799 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:13.811 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:13.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.822+0000 7f05d4984700 1 -- 172.21.15.26:0/3717528433 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f05d00747f0 con 0x7f05d00a0a30 2023-10-01T07:58:13.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.823+0000 7f05beffd700 1 -- 172.21.15.26:0/3717528433 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f05c401ce60 con 0x7f05d00a0a30 2023-10-01T07:58:13.823 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:13.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.825+0000 7f05d4984700 1 -- 172.21.15.26:0/3717528433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05d00a0a30 msgr2=0x7f05d0133f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:13.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.825+0000 7f05d4984700 1 --2- 172.21.15.26:0/3717528433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05d00a0a30 0x7f05d0133f50 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f05c4009130 tx=0x7f05c4004750 comp rx=0 tx=0).stop 2023-10-01T07:58:13.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.825+0000 7f05d4984700 1 -- 172.21.15.26:0/3717528433 shutdown_connections 2023-10-01T07:58:13.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.825+0000 7f05d4984700 1 --2- 172.21.15.26:0/3717528433 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f05d0138d80 0x7f05d0134490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:13.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.825+0000 7f05d4984700 1 --2- 172.21.15.26:0/3717528433 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f05d009d630 0x7f05d0133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:13.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.825+0000 7f05d4984700 1 --2- 172.21.15.26:0/3717528433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05d00a0a30 0x7f05d0133f50 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:13.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.825+0000 7f05d4984700 1 -- 172.21.15.26:0/3717528433 >> 172.21.15.26:0/3717528433 conn(0x7f05d00a3050 msgr2=0x7f05d009f620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:13.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.825+0000 7f05d4984700 1 -- 172.21.15.26:0/3717528433 shutdown_connections 2023-10-01T07:58:13.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.825+0000 7f05d4984700 1 -- 172.21.15.26:0/3717528433 wait complete. 2023-10-01T07:58:13.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.830+0000 7f164a67e700 1 -- 172.21.15.26:0/2803010227 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f16441a9540 con 0x7f164409e000 2023-10-01T07:58:13.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.830+0000 7f1640ff9700 1 -- 172.21.15.26:0/2803010227 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f16441a9540 con 0x7f164409e000 2023-10-01T07:58:13.831 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:13.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.833+0000 7f164a67e700 1 -- 172.21.15.26:0/2803010227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f164409e000 msgr2=0x7f16441a6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:13.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.833+0000 7f164a67e700 1 --2- 172.21.15.26:0/2803010227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f164409e000 0x7f16441a6470 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f1638016000 tx=0x7f1638004750 comp rx=0 tx=0).stop 2023-10-01T07:58:13.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.833+0000 7f164a67e700 1 -- 172.21.15.26:0/2803010227 shutdown_connections 2023-10-01T07:58:13.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.833+0000 7f164a67e700 1 --2- 172.21.15.26:0/2803010227 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f164409e410 0x7f16441a69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:13.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.833+0000 7f164a67e700 1 --2- 172.21.15.26:0/2803010227 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f164409d6f0 0x7f16441a5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:13.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.833+0000 7f164a67e700 1 --2- 172.21.15.26:0/2803010227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f164409e000 0x7f16441a6470 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:13.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.833+0000 7f164a67e700 1 -- 172.21.15.26:0/2803010227 >> 172.21.15.26:0/2803010227 conn(0x7f1644066f50 msgr2=0x7f16441baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:13.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.833+0000 7f164a67e700 1 -- 172.21.15.26:0/2803010227 shutdown_connections 2023-10-01T07:58:13.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:13.833+0000 7f164a67e700 1 -- 172.21.15.26:0/2803010227 wait complete. 2023-10-01T07:58:13.840 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:13.847 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:14.800 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:14.812 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:14.841 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:14.848 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:14.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.965+0000 7fc1f8b20700 1 Processor -- start 2023-10-01T07:58:14.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.965+0000 7fc1f8b20700 1 -- start start 2023-10-01T07:58:14.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.966+0000 7fc1f8b20700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc1f409d630 0x7fc1f40a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:14.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.966+0000 7fc1f8b20700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1f4138d80 0x7fc1f413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:14.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.966+0000 7fc1f8b20700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f40a2a70 con 0x7fc1f40a0a30 2023-10-01T07:58:14.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.966+0000 7fc1f8b20700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f40a01d0 con 0x7fc1f409d630 2023-10-01T07:58:14.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.966+0000 7fc1f8b20700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f409e2b0 con 0x7fc1f4138d80 2023-10-01T07:58:14.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.967+0000 7fc1f2d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1f4138d80 0x7fc1f413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:14.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.967+0000 7fc1f1d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc1f409d630 0x7fc1f40a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:14.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.967+0000 7fc1f2d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1f4138d80 0x7fc1f413b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43198/0 (socket says 172.21.15.26:43198) 2023-10-01T07:58:14.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.967+0000 7fc1f2d9d700 1 -- 172.21.15.26:0/3104240356 learned_addr learned my addr 172.21.15.26:0/3104240356 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:14.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.967+0000 7fc1f2d9d700 1 -- 172.21.15.26:0/3104240356 >> v2:172.21.15.26:3300/0 conn(0x7fc1f409d630 msgr2=0x7fc1f40a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:14.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.967+0000 7fc1f2d9d700 1 --2- 172.21.15.26:0/3104240356 >> v2:172.21.15.26:3300/0 conn(0x7fc1f409d630 0x7fc1f40a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:14.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.967+0000 7fc1f2d9d700 1 -- 172.21.15.26:0/3104240356 >> v1:172.21.15.26:6789/0 conn(0x7fc1f40a0a30 legacy=0x7fc1f40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:14.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.967+0000 7fc1f2d9d700 1 -- 172.21.15.26:0/3104240356 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f409dc50 con 0x7fc1f4138d80 2023-10-01T07:58:14.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.967+0000 7fc1f2d9d700 1 --2- 172.21.15.26:0/3104240356 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1f4138d80 0x7fc1f413b160 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec009e50 tx=0x7fc1ec00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=365455625c12d100 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:14.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.967+0000 7fc1f159a700 1 -- 172.21.15.26:0/3104240356 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec00e070 con 0x7fc1f4138d80 2023-10-01T07:58:14.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.967+0000 7fc1f159a700 1 -- 172.21.15.26:0/3104240356 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ec00b910 con 0x7fc1f4138d80 2023-10-01T07:58:14.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.967+0000 7fc1f159a700 1 -- 172.21.15.26:0/3104240356 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec00bcc0 con 0x7fc1f4138d80 2023-10-01T07:58:14.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.968+0000 7fc1f8b20700 1 -- 172.21.15.26:0/3104240356 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1f4138d80 msgr2=0x7fc1f413b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:14.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.968+0000 7fc1f8b20700 1 --2- 172.21.15.26:0/3104240356 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1f4138d80 0x7fc1f413b160 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec009e50 tx=0x7fc1ec00b330 comp rx=0 tx=0).stop 2023-10-01T07:58:14.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.968+0000 7fc1f8b20700 1 -- 172.21.15.26:0/3104240356 shutdown_connections 2023-10-01T07:58:14.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.968+0000 7fc1f8b20700 1 --2- 172.21.15.26:0/3104240356 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1f4138d80 0x7fc1f413b160 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:14.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.968+0000 7fc1f8b20700 1 --2- 172.21.15.26:0/3104240356 >> v2:172.21.15.26:3300/0 conn(0x7fc1f409d630 0x7fc1f40a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:14.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.968+0000 7fc1f8b20700 1 -- 172.21.15.26:0/3104240356 >> 172.21.15.26:0/3104240356 conn(0x7fc1f40a3050 msgr2=0x7fc1f40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:14.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.968+0000 7fc1f8b20700 1 -- 172.21.15.26:0/3104240356 shutdown_connections 2023-10-01T07:58:14.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.969+0000 7fc1f8b20700 1 -- 172.21.15.26:0/3104240356 wait complete. 2023-10-01T07:58:14.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.970+0000 7fc1f8b20700 1 Processor -- start 2023-10-01T07:58:14.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.970+0000 7fc1f8b20700 1 -- start start 2023-10-01T07:58:14.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.970+0000 7fc1f8b20700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc1f409d630 0x7fc1f4120620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:14.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.971+0000 7fc1f8b20700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1f40a0a30 0x7fc1f4120b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:14.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.971+0000 7fc1f8b20700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1f4138d80 0x7fc1f41210a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:14.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.971+0000 7fc1f8b20700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f4124140 con 0x7fc1f40a0a30 2023-10-01T07:58:14.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.971+0000 7fc1f8b20700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f41234f0 con 0x7fc1f4138d80 2023-10-01T07:58:14.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.971+0000 7fc1f8b20700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f4138b20 con 0x7fc1f409d630 2023-10-01T07:58:14.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.971+0000 7fc1f2d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1f4138d80 0x7fc1f41210a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:14.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.971+0000 7fc1f2d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1f4138d80 0x7fc1f41210a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43210/0 (socket says 172.21.15.26:43210) 2023-10-01T07:58:14.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.971+0000 7fc1f2d9d700 1 -- 172.21.15.26:0/2312769872 learned_addr learned my addr 172.21.15.26:0/2312769872 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:14.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.971+0000 7fc1f259c700 1 --2- 172.21.15.26:0/2312769872 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc1f409d630 0x7fc1f4120620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:14.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.971+0000 7fc1f2d9d700 1 -- 172.21.15.26:0/2312769872 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc1f409d630 msgr2=0x7fc1f4120620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:14.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.971+0000 7fc1f2d9d700 1 --2- 172.21.15.26:0/2312769872 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc1f409d630 0x7fc1f4120620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:14.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.971+0000 7fc1f2d9d700 1 -- 172.21.15.26:0/2312769872 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1f40a0a30 msgr2=0x7fc1f4120b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:14.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.971+0000 7fc1f2d9d700 1 --2- 172.21.15.26:0/2312769872 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1f40a0a30 0x7fc1f4120b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:14.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.971+0000 7fc1f2d9d700 1 -- 172.21.15.26:0/2312769872 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ec009b30 con 0x7fc1f4138d80 2023-10-01T07:58:14.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.971+0000 7fc1f2d9d700 1 --2- 172.21.15.26:0/2312769872 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1f4138d80 0x7fc1f41210a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec012000 tx=0x7fc1ec004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:14.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.972+0000 7fc1e2ffd700 1 -- 172.21.15.26:0/2312769872 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec0048b0 con 0x7fc1f4138d80 2023-10-01T07:58:14.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.972+0000 7fc1f8b20700 1 -- 172.21.15.26:0/2312769872 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f413afc0 con 0x7fc1f4138d80 2023-10-01T07:58:14.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.972+0000 7fc1e2ffd700 1 -- 172.21.15.26:0/2312769872 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ec0092e0 con 0x7fc1f4138d80 2023-10-01T07:58:14.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.972+0000 7fc1e2ffd700 1 -- 172.21.15.26:0/2312769872 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec01c630 con 0x7fc1f4138d80 2023-10-01T07:58:14.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.972+0000 7fc1f8b20700 1 -- 172.21.15.26:0/2312769872 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f41248d0 con 0x7fc1f4138d80 2023-10-01T07:58:14.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.973+0000 7fc1e2ffd700 1 -- 172.21.15.26:0/2312769872 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc1ec01c790 con 0x7fc1f4138d80 2023-10-01T07:58:14.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.973+0000 7fc1e2ffd700 1 -- 172.21.15.26:0/2312769872 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc1ec040f70 con 0x7fc1f4138d80 2023-10-01T07:58:14.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.974+0000 7fc1f8b20700 1 -- 172.21.15.26:0/2312769872 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d80052e0 con 0x7fc1f4138d80 2023-10-01T07:58:14.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.983+0000 7fc1e2ffd700 1 -- 172.21.15.26:0/2312769872 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc1ec029080 con 0x7fc1f4138d80 2023-10-01T07:58:14.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.993+0000 7f32432e9700 1 Processor -- start 2023-10-01T07:58:14.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.994+0000 7f32432e9700 1 -- start start 2023-10-01T07:58:14.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.994+0000 7f32432e9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f323c09e930 0x7f323c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:14.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.994+0000 7f32432e9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f323c09f240 0x7f323c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:14.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.994+0000 7f32432e9700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f323c070940 con 0x7f323c09f650 2023-10-01T07:58:14.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.994+0000 7f32432e9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323c06fd60 con 0x7f323c09e930 2023-10-01T07:58:14.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.994+0000 7f32432e9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f323c06fa80 con 0x7f323c09f240 2023-10-01T07:58:14.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.994+0000 7f3241085700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f323c09e930 0x7f323c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:14.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.994+0000 7f3240884700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f323c09f240 0x7f323c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:14.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.994+0000 7f3240884700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f323c09f240 0x7f323c1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59398/0 (socket says 172.21.15.26:59398) 2023-10-01T07:58:14.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.994+0000 7f3240884700 1 -- 172.21.15.26:0/3087037299 learned_addr learned my addr 172.21.15.26:0/3087037299 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:14.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.995+0000 7f3241085700 1 -- 172.21.15.26:0/3087037299 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f323c09f240 msgr2=0x7f323c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:14.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.995+0000 7f3233fff700 1 -- 172.21.15.26:0/3087037299 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3497817724 0 0) 0x7f323c070940 con 0x7f323c09f650 2023-10-01T07:58:14.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.995+0000 7f3241085700 1 --2- 172.21.15.26:0/3087037299 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f323c09f240 0x7f323c1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:14.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.995+0000 7f3241085700 1 -- 172.21.15.26:0/3087037299 >> v1:172.21.15.26:6789/0 conn(0x7f323c09f650 legacy=0x7f323c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:14.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.995+0000 7f3241085700 1 -- 172.21.15.26:0/3087037299 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323c09fb60 con 0x7f323c09e930 2023-10-01T07:58:14.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.995+0000 7f3240884700 1 --2- 172.21.15.26:0/3087037299 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f323c09f240 0x7f323c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:14.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.995+0000 7f3241085700 1 --2- 172.21.15.26:0/3087037299 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f323c09e930 0x7f323c09ed00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f3238009870 tx=0x7f3238009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6d3fcc353a2257 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:14.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.995+0000 7f3233fff700 1 -- 172.21.15.26:0/3087037299 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3238011830 con 0x7f323c09e930 2023-10-01T07:58:14.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.995+0000 7f3233fff700 1 -- 172.21.15.26:0/3087037299 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3238011990 con 0x7f323c09e930 2023-10-01T07:58:14.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.995+0000 7f3233fff700 1 -- 172.21.15.26:0/3087037299 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3238011d20 con 0x7f323c09e930 2023-10-01T07:58:14.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.996+0000 7f32432e9700 1 -- 172.21.15.26:0/3087037299 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f323c09e930 msgr2=0x7f323c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:14.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.996+0000 7f32432e9700 1 --2- 172.21.15.26:0/3087037299 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f323c09e930 0x7f323c09ed00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f3238009870 tx=0x7f3238009b80 comp rx=0 tx=0).stop 2023-10-01T07:58:14.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.996+0000 7f32432e9700 1 -- 172.21.15.26:0/3087037299 shutdown_connections 2023-10-01T07:58:14.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.996+0000 7f32432e9700 1 --2- 172.21.15.26:0/3087037299 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f323c09e930 0x7f323c09ed00 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:14.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.996+0000 7f32432e9700 1 --2- 172.21.15.26:0/3087037299 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f323c09f240 0x7f323c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:14.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.996+0000 7f32432e9700 1 -- 172.21.15.26:0/3087037299 >> 172.21.15.26:0/3087037299 conn(0x7f323c0a4210 msgr2=0x7f323c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:14.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.996+0000 7f32432e9700 1 -- 172.21.15.26:0/3087037299 shutdown_connections 2023-10-01T07:58:14.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.996+0000 7f32432e9700 1 -- 172.21.15.26:0/3087037299 wait complete. 2023-10-01T07:58:15.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.997+0000 7f32432e9700 1 Processor -- start 2023-10-01T07:58:15.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.997+0000 7f32432e9700 1 -- start start 2023-10-01T07:58:15.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.997+0000 7f3afa120700 1 Processor -- start 2023-10-01T07:58:15.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.998+0000 7f32432e9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f323c09e930 0x7f323c06b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:15.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.998+0000 7f32432e9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f323c09f240 0x7f323c06bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:15.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.998+0000 7f32432e9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f323c09f650 0x7f323c06c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:15.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.998+0000 7f32432e9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323c06cce0 con 0x7f323c09f650 2023-10-01T07:58:15.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.998+0000 7f32432e9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323c1a9080 con 0x7f323c09f240 2023-10-01T07:58:15.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.998+0000 7f32432e9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f323c06d4c0 con 0x7f323c09e930 2023-10-01T07:58:15.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.997+0000 7f3afa120700 1 -- start start 2023-10-01T07:58:15.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.998+0000 7f3afa120700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3af409eca0 0x7f3af413cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:15.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.998+0000 7f3afa120700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3af406f050 0x7f3af413f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:15.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.998+0000 7f3afa120700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3af4070ee0 con 0x7f3af406e570 2023-10-01T07:58:15.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.998+0000 7f3241085700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f323c09e930 0x7f323c06b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:15.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.998+0000 7f3241085700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f323c09e930 0x7f323c06b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59410/0 (socket says 172.21.15.26:59410) 2023-10-01T07:58:15.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.998+0000 7f3241085700 1 -- 172.21.15.26:0/822329275 learned_addr learned my addr 172.21.15.26:0/822329275 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:15.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.998+0000 7f3afa120700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3af4071980 con 0x7f3af409eca0 2023-10-01T07:58:15.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.998+0000 7f3afa120700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3af4071480 con 0x7f3af406f050 2023-10-01T07:58:15.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.998+0000 7f3af37fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3af406e570 0x7f3af406e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38804/0 (socket says 172.21.15.26:38804) 2023-10-01T07:58:15.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.998+0000 7f3af37fe700 1 -- 172.21.15.26:0/103552285 learned_addr learned my addr 172.21.15.26:0/103552285 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:15.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.998+0000 7f3241886700 1 --2- 172.21.15.26:0/822329275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f323c09f650 0x7f323c06c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:15.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.998+0000 7f3241085700 1 -- 172.21.15.26:0/822329275 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f323c09f240 msgr2=0x7f323c06bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:15.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.998+0000 7f3241085700 1 --2- 172.21.15.26:0/822329275 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f323c09f240 0x7f323c06bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:15.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.998+0000 7f3241085700 1 -- 172.21.15.26:0/822329275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f323c09f650 msgr2=0x7f323c06c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:15.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.998+0000 7f3241085700 1 --2- 172.21.15.26:0/822329275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f323c09f650 0x7f323c06c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:15.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.998+0000 7f3241085700 1 -- 172.21.15.26:0/822329275 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f322c009550 con 0x7f323c09e930 2023-10-01T07:58:15.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.998+0000 7f3af3fff700 1 --2- 172.21.15.26:0/103552285 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3af406f050 0x7f3af413f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:15.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.999+0000 7f3af2ffd700 1 --2- 172.21.15.26:0/103552285 >> v2:172.21.15.26:3300/0 conn(0x7f3af409eca0 0x7f3af413cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:15.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.999+0000 7f3241085700 1 --2- 172.21.15.26:0/822329275 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f323c09e930 0x7f323c06b880 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f323c06fea0 tx=0x7f3238004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:15.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.999+0000 7f3af2ffd700 1 -- 172.21.15.26:0/103552285 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3af406f050 msgr2=0x7f3af413f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:15.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.999+0000 7f3af2ffd700 1 --2- 172.21.15.26:0/103552285 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3af406f050 0x7f3af413f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:15.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.999+0000 7f3af2ffd700 1 -- 172.21.15.26:0/103552285 >> v1:172.21.15.26:6789/0 conn(0x7f3af406e570 legacy=0x7f3af406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:15.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.999+0000 7f3af2ffd700 1 -- 172.21.15.26:0/103552285 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af4071b90 con 0x7f3af409eca0 2023-10-01T07:58:15.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.999+0000 7f3af3fff700 1 --2- 172.21.15.26:0/103552285 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3af406f050 0x7f3af413f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:15.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.999+0000 7f3231ffb700 1 -- 172.21.15.26:0/822329275 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32380036a0 con 0x7f323c09e930 2023-10-01T07:58:15.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.999+0000 7f32432e9700 1 -- 172.21.15.26:0/822329275 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32380094a0 con 0x7f323c09e930 2023-10-01T07:58:15.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.999+0000 7f3231ffb700 1 -- 172.21.15.26:0/822329275 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323801f070 con 0x7f323c09e930 2023-10-01T07:58:15.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.999+0000 7f3231ffb700 1 -- 172.21.15.26:0/822329275 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3238003a60 con 0x7f323c09e930 2023-10-01T07:58:15.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.999+0000 7f3af2ffd700 1 --2- 172.21.15.26:0/103552285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3af409eca0 0x7f3af413cea0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f3ae8009840 tx=0x7f3ae8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91c19bcfb4b49988 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:15.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.999+0000 7f32432e9700 1 -- 172.21.15.26:0/822329275 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f323c0a0190 con 0x7f323c09e930 2023-10-01T07:58:15.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:14.999+0000 7f3af27fc700 1 -- 172.21.15.26:0/103552285 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae8011830 con 0x7f3af409eca0 2023-10-01T07:58:15.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.000+0000 7f3af27fc700 1 -- 172.21.15.26:0/103552285 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae8011990 con 0x7f3af409eca0 2023-10-01T07:58:15.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.000+0000 7f3af27fc700 1 -- 172.21.15.26:0/103552285 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae8011d20 con 0x7f3af409eca0 2023-10-01T07:58:15.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.000+0000 7f32432e9700 1 -- 172.21.15.26:0/822329275 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f323c1a0b30 con 0x7f323c09e930 2023-10-01T07:58:15.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.001+0000 7f3231ffb700 1 -- 172.21.15.26:0/822329275 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3238003bc0 con 0x7f323c09e930 2023-10-01T07:58:15.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.001+0000 7f3231ffb700 1 -- 172.21.15.26:0/822329275 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3238021070 con 0x7f323c09e930 2023-10-01T07:58:15.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.001+0000 7f3afa120700 1 -- 172.21.15.26:0/103552285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3af409eca0 msgr2=0x7f3af413cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:15.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.001+0000 7f3afa120700 1 --2- 172.21.15.26:0/103552285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3af409eca0 0x7f3af413cea0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f3ae8009840 tx=0x7f3ae8009b50 comp rx=0 tx=0).stop 2023-10-01T07:58:15.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.001+0000 7f3afa120700 1 -- 172.21.15.26:0/103552285 shutdown_connections 2023-10-01T07:58:15.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.001+0000 7f3afa120700 1 --2- 172.21.15.26:0/103552285 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3af406f050 0x7f3af413f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:15.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.001+0000 7f3afa120700 1 --2- 172.21.15.26:0/103552285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3af409eca0 0x7f3af413cea0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:15.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.001+0000 7f3afa120700 1 -- 172.21.15.26:0/103552285 >> 172.21.15.26:0/103552285 conn(0x7f3af40a2aa0 msgr2=0x7f3af40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:15.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.004+0000 7f3afa120700 1 -- 172.21.15.26:0/103552285 shutdown_connections 2023-10-01T07:58:15.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.004+0000 7f3afa120700 1 -- 172.21.15.26:0/103552285 wait complete. 2023-10-01T07:58:15.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.005+0000 7f3afa120700 1 Processor -- start 2023-10-01T07:58:15.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.005+0000 7f3afa120700 1 -- start start 2023-10-01T07:58:15.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.006+0000 7f3afa120700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3af406e570 0x7f3af4133500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:15.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.006+0000 7f3afa120700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3af406f050 0x7f3af4133a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:15.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.006+0000 7f3afa120700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3af4137480 0x7f3af4133f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:15.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.006+0000 7f3afa120700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af41362c0 con 0x7f3af4137480 2023-10-01T07:58:15.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.006+0000 7f3afa120700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af41351f0 con 0x7f3af406e570 2023-10-01T07:58:15.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.006+0000 7f3afa120700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3af4070610 con 0x7f3af406f050 2023-10-01T07:58:15.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.006+0000 7f3af37fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3af406e570 0x7f3af4133500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:15.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.006+0000 7f3af37fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3af406e570 0x7f3af4133500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43226/0 (socket says 172.21.15.26:43226) 2023-10-01T07:58:15.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.006+0000 7f3af37fe700 1 -- 172.21.15.26:0/581399015 learned_addr learned my addr 172.21.15.26:0/581399015 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:15.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.006+0000 7f3af3fff700 1 --2- 172.21.15.26:0/581399015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3af4137480 0x7f3af4133f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:15.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.007+0000 7f3af2ffd700 1 --2- 172.21.15.26:0/581399015 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3af406f050 0x7f3af4133a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:15.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.007+0000 7f3af37fe700 1 -- 172.21.15.26:0/581399015 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3af406f050 msgr2=0x7f3af4133a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:15.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.007+0000 7f3af37fe700 1 --2- 172.21.15.26:0/581399015 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3af406f050 0x7f3af4133a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:15.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.007+0000 7f3af37fe700 1 -- 172.21.15.26:0/581399015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3af4137480 msgr2=0x7f3af4133f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:15.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.007+0000 7f3af37fe700 1 --2- 172.21.15.26:0/581399015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3af4137480 0x7f3af4133f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:15.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.007+0000 7f3af37fe700 1 -- 172.21.15.26:0/581399015 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aec009a70 con 0x7f3af406e570 2023-10-01T07:58:15.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.007+0000 7f3af37fe700 1 --2- 172.21.15.26:0/581399015 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3af406e570 0x7f3af4133500 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f3ae400c520 tx=0x7f3ae400c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:15.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.007+0000 7f3adbfff700 1 -- 172.21.15.26:0/581399015 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4005d70 con 0x7f3af406e570 2023-10-01T07:58:15.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.007+0000 7f3adbfff700 1 -- 172.21.15.26:0/581399015 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae40070d0 con 0x7f3af406e570 2023-10-01T07:58:15.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.007+0000 7f3afa120700 1 -- 172.21.15.26:0/581399015 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae80094a0 con 0x7f3af406e570 2023-10-01T07:58:15.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.007+0000 7f3adbfff700 1 -- 172.21.15.26:0/581399015 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4007440 con 0x7f3af406e570 2023-10-01T07:58:15.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.007+0000 7f3afa120700 1 -- 172.21.15.26:0/581399015 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3af41369e0 con 0x7f3af406e570 2023-10-01T07:58:15.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.008+0000 7f3231ffb700 1 -- 172.21.15.26:0/822329275 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3238010b70 con 0x7f323c09e930 2023-10-01T07:58:15.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.008+0000 7f3afa120700 1 -- 172.21.15.26:0/581399015 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3af41358d0 con 0x7f3af406e570 2023-10-01T07:58:15.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.008+0000 7f3adbfff700 1 -- 172.21.15.26:0/581399015 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3ae40075a0 con 0x7f3af406e570 2023-10-01T07:58:15.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.009+0000 7f3adbfff700 1 -- 172.21.15.26:0/581399015 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3ae403ec30 con 0x7f3af406e570 2023-10-01T07:58:15.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.014+0000 7f3adbfff700 1 -- 172.21.15.26:0/581399015 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ae4045080 con 0x7f3af406e570 2023-10-01T07:58:15.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.055+0000 7f84e62bf700 1 Processor -- start 2023-10-01T07:58:15.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.055+0000 7f84e62bf700 1 -- start start 2023-10-01T07:58:15.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.056+0000 7f84e62bf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f84e006a770 0x7f84e006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:15.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.056+0000 7f84e62bf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f84e006b080 0x7f84e0131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:15.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.056+0000 7f84e62bf700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84e009ece0 con 0x7f84e0131b40 2023-10-01T07:58:15.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.056+0000 7f84e62bf700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e009e760 con 0x7f84e006b080 2023-10-01T07:58:15.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.056+0000 7f84e62bf700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84e009e040 con 0x7f84e006a770 2023-10-01T07:58:15.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.056+0000 7f84dffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f84e006a770 0x7f84e006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:15.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.056+0000 7f84df7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f84e006b080 0x7f84e0131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:15.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.056+0000 7f84e485c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f84e0131b40 0x7f84e0138850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38814/0 (socket says 172.21.15.26:38814) 2023-10-01T07:58:15.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.056+0000 7f84dffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f84e006a770 0x7f84e006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59436/0 (socket says 172.21.15.26:59436) 2023-10-01T07:58:15.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.056+0000 7f84e485c700 1 -- 172.21.15.26:0/348531090 learned_addr learned my addr 172.21.15.26:0/348531090 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:15.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.056+0000 7f84deffd700 1 -- 172.21.15.26:0/348531090 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1914993970 0 0) 0x7f84e009ece0 con 0x7f84e0131b40 2023-10-01T07:58:15.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.056+0000 7f84deffd700 1 -- 172.21.15.26:0/348531090 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84c80035b0 con 0x7f84e0131b40 2023-10-01T07:58:15.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.056+0000 7f84df7fe700 1 -- 172.21.15.26:0/348531090 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f84e006a770 msgr2=0x7f84e006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:15.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.056+0000 7f84df7fe700 1 --2- 172.21.15.26:0/348531090 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f84e006a770 0x7f84e006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:15.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.056+0000 7f84df7fe700 1 -- 172.21.15.26:0/348531090 >> v1:172.21.15.26:6789/0 conn(0x7f84e0131b40 legacy=0x7f84e0138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:15.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.056+0000 7f84df7fe700 1 -- 172.21.15.26:0/348531090 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e009f630 con 0x7f84e006b080 2023-10-01T07:58:15.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.057+0000 7f84df7fe700 1 --2- 172.21.15.26:0/348531090 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f84e006b080 0x7f84e0131600 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f84d400dc90 tx=0x7f84d400f050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e837a6321a2560c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:15.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.057+0000 7f84deffd700 1 -- 172.21.15.26:0/348531090 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d4012070 con 0x7f84e006b080 2023-10-01T07:58:15.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.057+0000 7f84deffd700 1 -- 172.21.15.26:0/348531090 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d400d2e0 con 0x7f84e006b080 2023-10-01T07:58:15.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.057+0000 7f84deffd700 1 -- 172.21.15.26:0/348531090 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d400f8f0 con 0x7f84e006b080 2023-10-01T07:58:15.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.057+0000 7f84e62bf700 1 -- 172.21.15.26:0/348531090 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f84e006b080 msgr2=0x7f84e0131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:15.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.057+0000 7f84e62bf700 1 --2- 172.21.15.26:0/348531090 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f84e006b080 0x7f84e0131600 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f84d400dc90 tx=0x7f84d400f050 comp rx=0 tx=0).stop 2023-10-01T07:58:15.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.058+0000 7f84e62bf700 1 -- 172.21.15.26:0/348531090 shutdown_connections 2023-10-01T07:58:15.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.058+0000 7f84e62bf700 1 --2- 172.21.15.26:0/348531090 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f84e006a770 0x7f84e006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:15.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.058+0000 7f84e62bf700 1 --2- 172.21.15.26:0/348531090 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f84e006b080 0x7f84e0131600 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:15.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.058+0000 7f84e62bf700 1 -- 172.21.15.26:0/348531090 >> 172.21.15.26:0/348531090 conn(0x7f84e0066f50 msgr2=0x7f84e009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:15.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.058+0000 7f84e62bf700 1 -- 172.21.15.26:0/348531090 shutdown_connections 2023-10-01T07:58:15.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.058+0000 7f84e62bf700 1 -- 172.21.15.26:0/348531090 wait complete. 2023-10-01T07:58:15.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.059+0000 7f84e62bf700 1 Processor -- start 2023-10-01T07:58:15.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.059+0000 7f84e62bf700 1 -- start start 2023-10-01T07:58:15.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.059+0000 7f84e62bf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f84e006a770 0x7f84e011e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:15.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.059+0000 7f84e62bf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84e006b080 0x7f84e011e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:15.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.059+0000 7f84e62bf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f84e0131b40 0x7f84e011eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:15.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.059+0000 7f84e62bf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e0121950 con 0x7f84e006b080 2023-10-01T07:58:15.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.059+0000 7f84e62bf700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e009a560 con 0x7f84e0131b40 2023-10-01T07:58:15.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.060+0000 7f84e62bf700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84e01200f0 con 0x7f84e006a770 2023-10-01T07:58:15.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.060+0000 7f84df7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84e006b080 0x7f84e011e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:15.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.060+0000 7f84e485c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f84e0131b40 0x7f84e011eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:15.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.060+0000 7f84df7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84e006b080 0x7f84e011e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39142/0 (socket says 172.21.15.26:39142) 2023-10-01T07:58:15.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.060+0000 7f84df7fe700 1 -- 172.21.15.26:0/44676668 learned_addr learned my addr 172.21.15.26:0/44676668 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:15.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.060+0000 7f84dffff700 1 --2- 172.21.15.26:0/44676668 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f84e006a770 0x7f84e011e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:15.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.060+0000 7f84df7fe700 1 -- 172.21.15.26:0/44676668 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f84e006a770 msgr2=0x7f84e011e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:15.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.060+0000 7f84df7fe700 1 --2- 172.21.15.26:0/44676668 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f84e006a770 0x7f84e011e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:15.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.060+0000 7f84df7fe700 1 -- 172.21.15.26:0/44676668 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f84e0131b40 msgr2=0x7f84e011eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:15.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.060+0000 7f84df7fe700 1 --2- 172.21.15.26:0/44676668 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f84e0131b40 0x7f84e011eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:15.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.060+0000 7f84df7fe700 1 -- 172.21.15.26:0/44676668 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d400d940 con 0x7f84e006b080 2023-10-01T07:58:15.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.060+0000 7f84dffff700 1 --2- 172.21.15.26:0/44676668 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f84e006a770 0x7f84e011e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:15.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.061+0000 7f84df7fe700 1 --2- 172.21.15.26:0/44676668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84e006b080 0x7f84e011e9b0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f84d4016000 tx=0x7f84d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:15.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.061+0000 7f84dcff9700 1 -- 172.21.15.26:0/44676668 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d4004220 con 0x7f84e006b080 2023-10-01T07:58:15.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.061+0000 7f84dcff9700 1 -- 172.21.15.26:0/44676668 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d4004380 con 0x7f84e006b080 2023-10-01T07:58:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.061+0000 7f84e62bf700 1 -- 172.21.15.26:0/44676668 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e0071e60 con 0x7f84e006b080 2023-10-01T07:58:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.061+0000 7f84dcff9700 1 -- 172.21.15.26:0/44676668 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d400c7b0 con 0x7f84e006b080 2023-10-01T07:58:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.061+0000 7f84e62bf700 1 -- 172.21.15.26:0/44676668 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e0122680 con 0x7f84e006b080 2023-10-01T07:58:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.062+0000 7f84dcff9700 1 -- 172.21.15.26:0/44676668 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f84d400c910 con 0x7f84e006b080 2023-10-01T07:58:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.062+0000 7f84dcff9700 1 -- 172.21.15.26:0/44676668 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f84d4044bf0 con 0x7f84e006b080 2023-10-01T07:58:15.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.062+0000 7f84c67fc700 1 -- 172.21.15.26:0/44676668 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b80052e0 con 0x7f84e006b080 2023-10-01T07:58:15.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.072+0000 7f84dcff9700 1 -- 172.21.15.26:0/44676668 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f84d401fb50 con 0x7f84e006b080 2023-10-01T07:58:15.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.212+0000 7fc1f8b20700 1 -- 172.21.15.26:0/2312769872 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc1d8005590 con 0x7fc1f4138d80 2023-10-01T07:58:15.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.213+0000 7fc1e2ffd700 1 -- 172.21.15.26:0/2312769872 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc1ec0123f0 con 0x7fc1f4138d80 2023-10-01T07:58:15.214 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:15.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.215+0000 7fc1f8b20700 1 -- 172.21.15.26:0/2312769872 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1f4138d80 msgr2=0x7fc1f41210a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:15.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.215+0000 7fc1f8b20700 1 --2- 172.21.15.26:0/2312769872 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1f4138d80 0x7fc1f41210a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec012000 tx=0x7fc1ec004ad0 comp rx=0 tx=0).stop 2023-10-01T07:58:15.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.215+0000 7fc1f8b20700 1 -- 172.21.15.26:0/2312769872 shutdown_connections 2023-10-01T07:58:15.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.215+0000 7fc1f8b20700 1 --2- 172.21.15.26:0/2312769872 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1f4138d80 0x7fc1f41210a0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:15.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.215+0000 7fc1f8b20700 1 --2- 172.21.15.26:0/2312769872 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc1f409d630 0x7fc1f4120620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:15.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.215+0000 7fc1f8b20700 1 --2- 172.21.15.26:0/2312769872 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1f40a0a30 0x7fc1f4120b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:15.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.215+0000 7fc1f8b20700 1 -- 172.21.15.26:0/2312769872 >> 172.21.15.26:0/2312769872 conn(0x7fc1f40a3050 msgr2=0x7fc1f4139150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:15.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.216+0000 7fc1f8b20700 1 -- 172.21.15.26:0/2312769872 shutdown_connections 2023-10-01T07:58:15.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.217+0000 7fc1f8b20700 1 -- 172.21.15.26:0/2312769872 wait complete. 2023-10-01T07:58:15.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.218+0000 7f32432e9700 1 -- 172.21.15.26:0/822329275 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f323c074ea0 con 0x7f323c09e930 2023-10-01T07:58:15.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.219+0000 7f3231ffb700 1 -- 172.21.15.26:0/822329275 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3238015020 con 0x7f323c09e930 2023-10-01T07:58:15.220 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:15.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.221+0000 7f32432e9700 1 -- 172.21.15.26:0/822329275 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f323c09e930 msgr2=0x7f323c06b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:15.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.221+0000 7f32432e9700 1 --2- 172.21.15.26:0/822329275 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f323c09e930 0x7f323c06b880 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f323c06fea0 tx=0x7f3238004750 comp rx=0 tx=0).stop 2023-10-01T07:58:15.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.222+0000 7f32432e9700 1 -- 172.21.15.26:0/822329275 shutdown_connections 2023-10-01T07:58:15.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.222+0000 7f32432e9700 1 --2- 172.21.15.26:0/822329275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f323c09f650 0x7f323c06c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:15.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.222+0000 7f32432e9700 1 --2- 172.21.15.26:0/822329275 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f323c09e930 0x7f323c06b880 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:15.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.222+0000 7f32432e9700 1 --2- 172.21.15.26:0/822329275 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f323c09f240 0x7f323c06bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:15.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.222+0000 7f32432e9700 1 -- 172.21.15.26:0/822329275 >> 172.21.15.26:0/822329275 conn(0x7f323c0a4210 msgr2=0x7f323c1b8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:15.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.223+0000 7f32432e9700 1 -- 172.21.15.26:0/822329275 shutdown_connections 2023-10-01T07:58:15.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.223+0000 7f32432e9700 1 -- 172.21.15.26:0/822329275 wait complete. 2023-10-01T07:58:15.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.225+0000 7f3afa120700 1 -- 172.21.15.26:0/581399015 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3af4074ea0 con 0x7f3af406e570 2023-10-01T07:58:15.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.226+0000 7f3adbfff700 1 -- 172.21.15.26:0/581399015 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3ae4011d70 con 0x7f3af406e570 2023-10-01T07:58:15.226 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:15.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.228+0000 7f3afa120700 1 -- 172.21.15.26:0/581399015 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3af406e570 msgr2=0x7f3af4133500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:15.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.228+0000 7f3afa120700 1 --2- 172.21.15.26:0/581399015 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3af406e570 0x7f3af4133500 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f3ae400c520 tx=0x7f3ae400c8e0 comp rx=0 tx=0).stop 2023-10-01T07:58:15.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.229+0000 7f3afa120700 1 -- 172.21.15.26:0/581399015 shutdown_connections 2023-10-01T07:58:15.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.229+0000 7f3afa120700 1 --2- 172.21.15.26:0/581399015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3af4137480 0x7f3af4133f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:15.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.229+0000 7f3afa120700 1 --2- 172.21.15.26:0/581399015 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3af406e570 0x7f3af4133500 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:15.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.229+0000 7f3afa120700 1 --2- 172.21.15.26:0/581399015 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3af406f050 0x7f3af4133a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:15.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.229+0000 7f3afa120700 1 -- 172.21.15.26:0/581399015 >> 172.21.15.26:0/581399015 conn(0x7f3af40a2aa0 msgr2=0x7f3af41310f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:15.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.229+0000 7f3afa120700 1 -- 172.21.15.26:0/581399015 shutdown_connections 2023-10-01T07:58:15.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.229+0000 7f3afa120700 1 -- 172.21.15.26:0/581399015 wait complete. 2023-10-01T07:58:15.234 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:15.240 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:15.245 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:15.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.282+0000 7f84c67fc700 1 -- 172.21.15.26:0/44676668 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f84b8005590 con 0x7f84e006b080 2023-10-01T07:58:15.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.282+0000 7f84dcff9700 1 -- 172.21.15.26:0/44676668 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f84d4039090 con 0x7f84e006b080 2023-10-01T07:58:15.283 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:15.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.284+0000 7f84c67fc700 1 -- 172.21.15.26:0/44676668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84e006b080 msgr2=0x7f84e011e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:15.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.284+0000 7f84c67fc700 1 --2- 172.21.15.26:0/44676668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84e006b080 0x7f84e011e9b0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f84d4016000 tx=0x7f84d4004750 comp rx=0 tx=0).stop 2023-10-01T07:58:15.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.284+0000 7f84c67fc700 1 -- 172.21.15.26:0/44676668 shutdown_connections 2023-10-01T07:58:15.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.284+0000 7f84c67fc700 1 --2- 172.21.15.26:0/44676668 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f84e0131b40 0x7f84e011eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:15.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.284+0000 7f84c67fc700 1 --2- 172.21.15.26:0/44676668 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f84e006a770 0x7f84e011e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:15.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.284+0000 7f84c67fc700 1 --2- 172.21.15.26:0/44676668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84e006b080 0x7f84e011e9b0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:15.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.284+0000 7f84c67fc700 1 -- 172.21.15.26:0/44676668 >> 172.21.15.26:0/44676668 conn(0x7f84e0066f50 msgr2=0x7f84e00a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:15.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.284+0000 7f84c67fc700 1 -- 172.21.15.26:0/44676668 shutdown_connections 2023-10-01T07:58:15.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:15.284+0000 7f84c67fc700 1 -- 172.21.15.26:0/44676668 wait complete. 2023-10-01T07:58:15.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:16.235 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:16.241 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:16.246 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:16.299 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:16.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.393+0000 7f9066f2a700 1 Processor -- start 2023-10-01T07:58:16.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.394+0000 7f9066f2a700 1 -- start start 2023-10-01T07:58:16.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.394+0000 7f9066f2a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9060130540 0x7f9060130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:16.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.394+0000 7f9066f2a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9060130e50 0x7f906006f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:16.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.394+0000 7f9066f2a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90600716a0 con 0x7f906006fb20 2023-10-01T07:58:16.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.394+0000 7f9066f2a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f906009a390 con 0x7f9060130540 2023-10-01T07:58:16.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.394+0000 7f9066f2a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9060071290 con 0x7f9060130e50 2023-10-01T07:58:16.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.394+0000 7f9064cc6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9060130540 0x7f9060130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:16.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.394+0000 7f9064cc6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9060130540 0x7f9060130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39144/0 (socket says 172.21.15.26:39144) 2023-10-01T07:58:16.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.394+0000 7f9064cc6700 1 -- 172.21.15.26:0/1946073053 learned_addr learned my addr 172.21.15.26:0/1946073053 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:16.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.394+0000 7f905ffff700 1 --2- 172.21.15.26:0/1946073053 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9060130e50 0x7f906006f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:16.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.395+0000 7f905ffff700 1 -- 172.21.15.26:0/1946073053 >> v2:172.21.15.26:3300/0 conn(0x7f9060130540 msgr2=0x7f9060130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:16.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.395+0000 7f905ffff700 1 --2- 172.21.15.26:0/1946073053 >> v2:172.21.15.26:3300/0 conn(0x7f9060130540 0x7f9060130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.395+0000 7f905ffff700 1 -- 172.21.15.26:0/1946073053 >> v1:172.21.15.26:6789/0 conn(0x7f906006fb20 legacy=0x7f9060137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:16.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.395+0000 7f905ffff700 1 -- 172.21.15.26:0/1946073053 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9060130340 con 0x7f9060130e50 2023-10-01T07:58:16.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.395+0000 7f905ffff700 1 --2- 172.21.15.26:0/1946073053 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9060130e50 0x7f906006f5e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f904c009870 tx=0x7f904c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a92f36621088e83 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:16.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.395+0000 7f905f7fe700 1 -- 172.21.15.26:0/1946073053 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c011830 con 0x7f9060130e50 2023-10-01T07:58:16.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.395+0000 7f905f7fe700 1 -- 172.21.15.26:0/1946073053 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904c011990 con 0x7f9060130e50 2023-10-01T07:58:16.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.395+0000 7f905f7fe700 1 -- 172.21.15.26:0/1946073053 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c011d20 con 0x7f9060130e50 2023-10-01T07:58:16.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.396+0000 7f9066f2a700 1 -- 172.21.15.26:0/1946073053 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9060130e50 msgr2=0x7f906006f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:16.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.396+0000 7f9066f2a700 1 --2- 172.21.15.26:0/1946073053 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9060130e50 0x7f906006f5e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f904c009870 tx=0x7f904c009b80 comp rx=0 tx=0).stop 2023-10-01T07:58:16.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.396+0000 7f9066f2a700 1 -- 172.21.15.26:0/1946073053 shutdown_connections 2023-10-01T07:58:16.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.396+0000 7f9066f2a700 1 --2- 172.21.15.26:0/1946073053 >> v2:172.21.15.26:3300/0 conn(0x7f9060130540 0x7f9060130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.396+0000 7f9066f2a700 1 --2- 172.21.15.26:0/1946073053 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9060130e50 0x7f906006f5e0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.396+0000 7f9066f2a700 1 -- 172.21.15.26:0/1946073053 >> 172.21.15.26:0/1946073053 conn(0x7f90600a2aa0 msgr2=0x7f90600a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:16.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.397+0000 7f9066f2a700 1 -- 172.21.15.26:0/1946073053 shutdown_connections 2023-10-01T07:58:16.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.397+0000 7f9066f2a700 1 -- 172.21.15.26:0/1946073053 wait complete. 2023-10-01T07:58:16.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.398+0000 7f9066f2a700 1 Processor -- start 2023-10-01T07:58:16.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.398+0000 7f9066f2a700 1 -- start start 2023-10-01T07:58:16.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.399+0000 7f9066f2a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f906006fb20 0x7f906006e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:16.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.399+0000 7f9066f2a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9060130540 0x7f906006ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:16.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.399+0000 7f9066f2a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9060130e50 0x7f906006ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:16.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.399+0000 7f9066f2a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906011fe00 con 0x7f9060130e50 2023-10-01T07:58:16.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.399+0000 7f9066f2a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f906012bcb0 con 0x7f9060130540 2023-10-01T07:58:16.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.399+0000 7f9066f2a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90600a1cf0 con 0x7f906006fb20 2023-10-01T07:58:16.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.399+0000 7f905ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9060130540 0x7f906006ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:16.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.399+0000 7f905ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9060130540 0x7f906006ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43254/0 (socket says 172.21.15.26:43254) 2023-10-01T07:58:16.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.399+0000 7f905ffff700 1 -- 172.21.15.26:0/3263542323 learned_addr learned my addr 172.21.15.26:0/3263542323 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:16.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.399+0000 7f90654c7700 1 --2- 172.21.15.26:0/3263542323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9060130e50 0x7f906006ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:16.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.400+0000 7f9064cc6700 1 --2- 172.21.15.26:0/3263542323 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f906006fb20 0x7f906006e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:16.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.400+0000 7f905ffff700 1 -- 172.21.15.26:0/3263542323 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f906006fb20 msgr2=0x7f906006e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:16.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.400+0000 7f905ffff700 1 --2- 172.21.15.26:0/3263542323 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f906006fb20 0x7f906006e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.400+0000 7f905ffff700 1 -- 172.21.15.26:0/3263542323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9060130e50 msgr2=0x7f906006ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:16.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.400+0000 7f905ffff700 1 --2- 172.21.15.26:0/3263542323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9060130e50 0x7f906006ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.400+0000 7f905ffff700 1 -- 172.21.15.26:0/3263542323 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904c0094a0 con 0x7f9060130540 2023-10-01T07:58:16.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.400+0000 7f9064cc6700 1 --2- 172.21.15.26:0/3263542323 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f906006fb20 0x7f906006e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:58:16.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.400+0000 7f905ffff700 1 --2- 172.21.15.26:0/3263542323 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9060130540 0x7f906006ea10 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f904c000c00 tx=0x7f904c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:16.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.400+0000 7f905d7fa700 1 -- 172.21.15.26:0/3263542323 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c0036a0 con 0x7f9060130540 2023-10-01T07:58:16.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.400+0000 7f905d7fa700 1 -- 172.21.15.26:0/3263542323 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904c003800 con 0x7f9060130540 2023-10-01T07:58:16.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.400+0000 7f905d7fa700 1 -- 172.21.15.26:0/3263542323 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c003b70 con 0x7f9060130540 2023-10-01T07:58:16.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.401+0000 7f9066f2a700 1 -- 172.21.15.26:0/3263542323 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9060119e90 con 0x7f9060130540 2023-10-01T07:58:16.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.401+0000 7f9066f2a700 1 -- 172.21.15.26:0/3263542323 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9060119860 con 0x7f9060130540 2023-10-01T07:58:16.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.402+0000 7f905d7fa700 1 -- 172.21.15.26:0/3263542323 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f904c003cd0 con 0x7f9060130540 2023-10-01T07:58:16.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.403+0000 7f905d7fa700 1 -- 172.21.15.26:0/3263542323 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f904c044310 con 0x7f9060130540 2023-10-01T07:58:16.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.403+0000 7f9066f2a700 1 -- 172.21.15.26:0/3263542323 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9060074ea0 con 0x7f9060130540 2023-10-01T07:58:16.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.411+0000 7f905d7fa700 1 -- 172.21.15.26:0/3263542323 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f904c028020 con 0x7f9060130540 2023-10-01T07:58:16.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.431+0000 7fc8ffbeb700 1 Processor -- start 2023-10-01T07:58:16.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.431+0000 7fc8ffbeb700 1 -- start start 2023-10-01T07:58:16.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.432+0000 7fc8ffbeb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc8f809d6f0 0x7fc8f809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:16.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.432+0000 7fc8ffbeb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc8f809e000 0x7fc8f8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:16.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.432+0000 7fc8ffbeb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc8f809e410 0x7fc8f8130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:16.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.432+0000 7fc8ffbeb700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f809f520 con 0x7fc8f809e000 2023-10-01T07:58:16.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.432+0000 7fc8ffbeb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f809f130 con 0x7fc8f809d6f0 2023-10-01T07:58:16.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.432+0000 7fc8ffbeb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f809e930 con 0x7fc8f809e410 2023-10-01T07:58:16.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.432+0000 7fc8fe188700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc8f809e410 0x7fc8f8130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:16.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.432+0000 7fc8fd987700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc8f809d6f0 0x7fc8f809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:16.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.432+0000 7fc8fe188700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc8f809e410 0x7fc8f8130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59468/0 (socket says 172.21.15.26:59468) 2023-10-01T07:58:16.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.432+0000 7fc8fe188700 1 -- 172.21.15.26:0/2728761634 learned_addr learned my addr 172.21.15.26:0/2728761634 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:16.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.432+0000 7fc8fd186700 1 --2- 172.21.15.26:0/2728761634 >> v2:172.21.15.26:3300/0 conn(0x7fc8f809e000 0x7fc8f8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:16.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.433+0000 7fc8fd186700 1 -- 172.21.15.26:0/2728761634 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc8f809e410 msgr2=0x7fc8f8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:16.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.433+0000 7fc8fd186700 1 --2- 172.21.15.26:0/2728761634 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc8f809e410 0x7fc8f8130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.433+0000 7fc8fd186700 1 -- 172.21.15.26:0/2728761634 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc8f809d6f0 msgr2=0x7fc8f809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:16.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.433+0000 7fc8fd186700 1 --2- 172.21.15.26:0/2728761634 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc8f809d6f0 0x7fc8f809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.433+0000 7fc8fd186700 1 -- 172.21.15.26:0/2728761634 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f809b2d0 con 0x7fc8f809e000 2023-10-01T07:58:16.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.433+0000 7fc8fd987700 1 --2- 172.21.15.26:0/2728761634 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc8f809d6f0 0x7fc8f809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:16.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.433+0000 7fc8fd186700 1 --2- 172.21.15.26:0/2728761634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f809e000 0x7fc8f8130660 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8009870 tx=0x7fc8e8009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed0319e7192d493 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:16.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.433+0000 7fc8fc985700 1 -- 172.21.15.26:0/2728761634 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8011830 con 0x7fc8f809e000 2023-10-01T07:58:16.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.433+0000 7fc8fc985700 1 -- 172.21.15.26:0/2728761634 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e8011990 con 0x7fc8f809e000 2023-10-01T07:58:16.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.433+0000 7fc8fc985700 1 -- 172.21.15.26:0/2728761634 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8011d20 con 0x7fc8f809e000 2023-10-01T07:58:16.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.434+0000 7fc8ffbeb700 1 -- 172.21.15.26:0/2728761634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f809e000 msgr2=0x7fc8f8130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:16.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.434+0000 7fc8ffbeb700 1 --2- 172.21.15.26:0/2728761634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f809e000 0x7fc8f8130660 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8009870 tx=0x7fc8e8009b80 comp rx=0 tx=0).stop 2023-10-01T07:58:16.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.434+0000 7fc8ffbeb700 1 -- 172.21.15.26:0/2728761634 shutdown_connections 2023-10-01T07:58:16.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.434+0000 7fc8ffbeb700 1 --2- 172.21.15.26:0/2728761634 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc8f809e410 0x7fc8f8130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.434+0000 7fc8ffbeb700 1 --2- 172.21.15.26:0/2728761634 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc8f809d6f0 0x7fc8f809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.434+0000 7fc8ffbeb700 1 --2- 172.21.15.26:0/2728761634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f809e000 0x7fc8f8130660 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.434+0000 7fc8ffbeb700 1 -- 172.21.15.26:0/2728761634 >> 172.21.15.26:0/2728761634 conn(0x7fc8f8066f50 msgr2=0x7fc8f809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:16.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.434+0000 7fc8ffbeb700 1 -- 172.21.15.26:0/2728761634 shutdown_connections 2023-10-01T07:58:16.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.434+0000 7fc8ffbeb700 1 -- 172.21.15.26:0/2728761634 wait complete. 2023-10-01T07:58:16.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.435+0000 7fc8ffbeb700 1 Processor -- start 2023-10-01T07:58:16.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.435+0000 7fc8ffbeb700 1 -- start start 2023-10-01T07:58:16.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.436+0000 7fc8ffbeb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc8f809d6f0 0x7fc8f8119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:16.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.436+0000 7fc8ffbeb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f809e000 0x7fc8f81199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:16.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.436+0000 7fc8ffbeb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc8f809e410 0x7fc8f8119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:16.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.436+0000 7fc8ffbeb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f811ba20 con 0x7fc8f809e000 2023-10-01T07:58:16.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.436+0000 7fc8ffbeb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f811b1b0 con 0x7fc8f809d6f0 2023-10-01T07:58:16.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.436+0000 7fc8ffbeb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f811ad60 con 0x7fc8f809e410 2023-10-01T07:58:16.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.436+0000 7fc8fd186700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f809e000 0x7fc8f81199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:16.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.436+0000 7fc8fd186700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f809e000 0x7fc8f81199c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39170/0 (socket says 172.21.15.26:39170) 2023-10-01T07:58:16.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.436+0000 7fc8fd186700 1 -- 172.21.15.26:0/682761298 learned_addr learned my addr 172.21.15.26:0/682761298 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:16.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.436+0000 7fc8fd987700 1 --2- 172.21.15.26:0/682761298 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc8f809d6f0 0x7fc8f8119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:16.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.437+0000 7fc8fd186700 1 -- 172.21.15.26:0/682761298 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc8f809e410 msgr2=0x7fc8f8119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:16.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.437+0000 7fc8fd186700 1 --2- 172.21.15.26:0/682761298 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc8f809e410 0x7fc8f8119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.437+0000 7fc8fd186700 1 -- 172.21.15.26:0/682761298 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc8f809d6f0 msgr2=0x7fc8f8119480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:16.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.437+0000 7fc8fd186700 1 --2- 172.21.15.26:0/682761298 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc8f809d6f0 0x7fc8f8119480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.437+0000 7fc8fd186700 1 -- 172.21.15.26:0/682761298 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f40094a0 con 0x7fc8f809e000 2023-10-01T07:58:16.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.437+0000 7fc8fd987700 1 --2- 172.21.15.26:0/682761298 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc8f809d6f0 0x7fc8f8119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:16.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.437+0000 7fc8fd186700 1 --2- 172.21.15.26:0/682761298 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f809e000 0x7fc8f81199c0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8009840 tx=0x7fc8e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:16.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.437+0000 7fc8ee7fc700 1 -- 172.21.15.26:0/682761298 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8004040 con 0x7fc8f809e000 2023-10-01T07:58:16.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.437+0000 7fc8ee7fc700 1 -- 172.21.15.26:0/682761298 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e80041c0 con 0x7fc8f809e000 2023-10-01T07:58:16.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.437+0000 7fc8ffbeb700 1 -- 172.21.15.26:0/682761298 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e80094a0 con 0x7fc8f809e000 2023-10-01T07:58:16.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.437+0000 7fc8ee7fc700 1 -- 172.21.15.26:0/682761298 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8004570 con 0x7fc8f809e000 2023-10-01T07:58:16.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.437+0000 7fc8ffbeb700 1 -- 172.21.15.26:0/682761298 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f809c700 con 0x7fc8f809e000 2023-10-01T07:58:16.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.438+0000 7fc8ee7fc700 1 -- 172.21.15.26:0/682761298 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc8e802a070 con 0x7fc8f809e000 2023-10-01T07:58:16.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.438+0000 7fc8ee7fc700 1 -- 172.21.15.26:0/682761298 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc8e80488d0 con 0x7fc8f809e000 2023-10-01T07:58:16.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.439+0000 7fc8ffbeb700 1 -- 172.21.15.26:0/682761298 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f8074ea0 con 0x7fc8f809e000 2023-10-01T07:58:16.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.439+0000 7f42d99f5700 1 Processor -- start 2023-10-01T07:58:16.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.439+0000 7f42d99f5700 1 -- start start 2023-10-01T07:58:16.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.440+0000 7f42d99f5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f42d409d6f0 0x7f42d409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:16.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.440+0000 7f42d99f5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f42d409e000 0x7f42d4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:16.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.440+0000 7f42d99f5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f42d409e410 0x7f42d4130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:16.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.440+0000 7f42d99f5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d409f520 con 0x7f42d409e000 2023-10-01T07:58:16.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.440+0000 7f42d99f5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d409f130 con 0x7f42d409e410 2023-10-01T07:58:16.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.440+0000 7f42d99f5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42d409e930 con 0x7f42d409d6f0 2023-10-01T07:58:16.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.441+0000 7f42d37fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f42d409e410 0x7f42d4130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:16.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.441+0000 7f42d37fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f42d409e410 0x7f42d4130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43286/0 (socket says 172.21.15.26:43286) 2023-10-01T07:58:16.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.441+0000 7f42d37fe700 1 -- 172.21.15.26:0/1727203543 learned_addr learned my addr 172.21.15.26:0/1727203543 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:16.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.441+0000 7f42d27fc700 1 --2- 172.21.15.26:0/1727203543 >> v2:172.21.15.26:3300/0 conn(0x7f42d409e000 0x7f42d4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:16.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.441+0000 7f42d2ffd700 1 --2- 172.21.15.26:0/1727203543 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f42d409d6f0 0x7f42d409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:16.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.441+0000 7f42d37fe700 1 -- 172.21.15.26:0/1727203543 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f42d409d6f0 msgr2=0x7f42d409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:16.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.441+0000 7f42d37fe700 1 --2- 172.21.15.26:0/1727203543 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f42d409d6f0 0x7f42d409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.441+0000 7f42d37fe700 1 -- 172.21.15.26:0/1727203543 >> v2:172.21.15.26:3300/0 conn(0x7f42d409e000 msgr2=0x7f42d4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:16.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.441+0000 7f42d37fe700 1 --2- 172.21.15.26:0/1727203543 >> v2:172.21.15.26:3300/0 conn(0x7f42d409e000 0x7f42d4130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.441+0000 7f42d37fe700 1 -- 172.21.15.26:0/1727203543 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d409b2d0 con 0x7f42d409e410 2023-10-01T07:58:16.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.441+0000 7f42d2ffd700 1 --2- 172.21.15.26:0/1727203543 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f42d409d6f0 0x7f42d409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:58:16.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.441+0000 7f42d37fe700 1 --2- 172.21.15.26:0/1727203543 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f42d409e410 0x7f42d4130ba0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f42cc009ed0 tx=0x7f42cc00d540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d6089a144578819 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:16.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.441+0000 7f42d1ffb700 1 -- 172.21.15.26:0/1727203543 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc00dde0 con 0x7f42d409e410 2023-10-01T07:58:16.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.442+0000 7f42d1ffb700 1 -- 172.21.15.26:0/1727203543 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42cc011460 con 0x7f42d409e410 2023-10-01T07:58:16.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.442+0000 7f42d1ffb700 1 -- 172.21.15.26:0/1727203543 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc011810 con 0x7f42d409e410 2023-10-01T07:58:16.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.442+0000 7f42d99f5700 1 -- 172.21.15.26:0/1727203543 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f42d409e410 msgr2=0x7f42d4130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:16.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.443+0000 7f42d99f5700 1 --2- 172.21.15.26:0/1727203543 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f42d409e410 0x7f42d4130ba0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f42cc009ed0 tx=0x7f42cc00d540 comp rx=0 tx=0).stop 2023-10-01T07:58:16.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.443+0000 7f42d99f5700 1 -- 172.21.15.26:0/1727203543 shutdown_connections 2023-10-01T07:58:16.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.443+0000 7f42d99f5700 1 --2- 172.21.15.26:0/1727203543 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f42d409e410 0x7f42d4130ba0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.443+0000 7f42d99f5700 1 --2- 172.21.15.26:0/1727203543 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f42d409d6f0 0x7f42d409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.443+0000 7f42d99f5700 1 --2- 172.21.15.26:0/1727203543 >> v2:172.21.15.26:3300/0 conn(0x7f42d409e000 0x7f42d4130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.443+0000 7f42d99f5700 1 -- 172.21.15.26:0/1727203543 >> 172.21.15.26:0/1727203543 conn(0x7f42d4066f50 msgr2=0x7f42d409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:16.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.443+0000 7f42d99f5700 1 -- 172.21.15.26:0/1727203543 shutdown_connections 2023-10-01T07:58:16.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.443+0000 7f42d99f5700 1 -- 172.21.15.26:0/1727203543 wait complete. 2023-10-01T07:58:16.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.444+0000 7f42d99f5700 1 Processor -- start 2023-10-01T07:58:16.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.444+0000 7f42d99f5700 1 -- start start 2023-10-01T07:58:16.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.445+0000 7f42d99f5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f42d409d6f0 0x7f42d411dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:16.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.445+0000 7f42d99f5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f42d409e000 0x7f42d411e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:16.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.445+0000 7f42d99f5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42d409e410 0x7f42d411ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:16.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.445+0000 7f42d99f5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d4130380 con 0x7f42d409e410 2023-10-01T07:58:16.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.445+0000 7f42d99f5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d41201d0 con 0x7f42d409d6f0 2023-10-01T07:58:16.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.445+0000 7f42d99f5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42d4120e00 con 0x7f42d409e000 2023-10-01T07:58:16.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.445+0000 7f42d2ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f42d409d6f0 0x7f42d411dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:16.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.445+0000 7f42d2ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f42d409d6f0 0x7f42d411dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43298/0 (socket says 172.21.15.26:43298) 2023-10-01T07:58:16.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.445+0000 7f42d2ffd700 1 -- 172.21.15.26:0/581620391 learned_addr learned my addr 172.21.15.26:0/581620391 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:16.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.446+0000 7f42d27fc700 1 --2- 172.21.15.26:0/581620391 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f42d409e000 0x7f42d411e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:16.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.446+0000 7f42d37fe700 1 --2- 172.21.15.26:0/581620391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42d409e410 0x7f42d411ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:16.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.446+0000 7f42d2ffd700 1 -- 172.21.15.26:0/581620391 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f42d409e000 msgr2=0x7f42d411e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:16.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.446+0000 7f42d2ffd700 1 --2- 172.21.15.26:0/581620391 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f42d409e000 0x7f42d411e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.446+0000 7f42d2ffd700 1 -- 172.21.15.26:0/581620391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42d409e410 msgr2=0x7f42d411ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:16.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.446+0000 7f42d2ffd700 1 --2- 172.21.15.26:0/581620391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42d409e410 0x7f42d411ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.446+0000 7f42d2ffd700 1 -- 172.21.15.26:0/581620391 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42cc009b30 con 0x7f42d409d6f0 2023-10-01T07:58:16.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.446+0000 7f42d27fc700 1 --2- 172.21.15.26:0/581620391 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f42d409e000 0x7f42d411e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:58:16.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.446+0000 7f42d2ffd700 1 --2- 172.21.15.26:0/581620391 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f42d409d6f0 0x7f42d411dfa0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f42c400c770 tx=0x7f42c400ca80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:16.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.446+0000 7f42bbfff700 1 -- 172.21.15.26:0/581620391 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c4011800 con 0x7f42d409d6f0 2023-10-01T07:58:16.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.446+0000 7f42bbfff700 1 -- 172.21.15.26:0/581620391 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c4011960 con 0x7f42d409d6f0 2023-10-01T07:58:16.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.446+0000 7f42d99f5700 1 -- 172.21.15.26:0/581620391 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d411f400 con 0x7f42d409d6f0 2023-10-01T07:58:16.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.446+0000 7f42bbfff700 1 -- 172.21.15.26:0/581620391 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c4011cd0 con 0x7f42d409d6f0 2023-10-01T07:58:16.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.446+0000 7f42d99f5700 1 -- 172.21.15.26:0/581620391 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d40a16b0 con 0x7f42d409d6f0 2023-10-01T07:58:16.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.448+0000 7fc8ee7fc700 1 -- 172.21.15.26:0/682761298 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc8e8031080 con 0x7fc8f809e000 2023-10-01T07:58:16.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.447+0000 7f42bbfff700 1 -- 172.21.15.26:0/581620391 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f42c4021350 con 0x7f42d409d6f0 2023-10-01T07:58:16.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.448+0000 7f42bbfff700 1 -- 172.21.15.26:0/581620391 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f42c403f6b0 con 0x7f42d409d6f0 2023-10-01T07:58:16.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.448+0000 7f42d99f5700 1 -- 172.21.15.26:0/581620391 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d411ac20 con 0x7f42d409d6f0 2023-10-01T07:58:16.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.453+0000 7f42bbfff700 1 -- 172.21.15.26:0/581620391 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f42c4017d40 con 0x7f42d409d6f0 2023-10-01T07:58:16.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.484+0000 7f7607ca0700 1 Processor -- start 2023-10-01T07:58:16.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.485+0000 7f7607ca0700 1 -- start start 2023-10-01T07:58:16.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.485+0000 7f7607ca0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f76000a0a30 0x7f76000a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:16.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.485+0000 7f7607ca0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f76000a1340 0x7f7600133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:16.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.485+0000 7f7607ca0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760009edd0 con 0x7f7600133fa0 2023-10-01T07:58:16.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.485+0000 7f7607ca0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f760009e1f0 con 0x7f76000a1340 2023-10-01T07:58:16.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.485+0000 7f7607ca0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760009dc50 con 0x7f76000a0a30 2023-10-01T07:58:16.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.486+0000 7f7605a3c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f76000a0a30 0x7f76000a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:16.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.486+0000 7f7605a3c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f76000a0a30 0x7f76000a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43314/0 (socket says 172.21.15.26:43314) 2023-10-01T07:58:16.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.486+0000 7f7605a3c700 1 -- 172.21.15.26:0/1990929397 learned_addr learned my addr 172.21.15.26:0/1990929397 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:16.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.486+0000 7f760623d700 1 --1- 172.21.15.26:0/1990929397 >> v1:172.21.15.26:6789/0 conn(0x7f7600133fa0 0x7f760013ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38818/0 (socket says 172.21.15.26:38818) 2023-10-01T07:58:16.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.486+0000 7f760523b700 1 --2- 172.21.15.26:0/1990929397 >> v2:172.21.15.26:3300/0 conn(0x7f76000a1340 0x7f7600133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:16.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.486+0000 7f760523b700 1 -- 172.21.15.26:0/1990929397 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f76000a0a30 msgr2=0x7f76000a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:16.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.486+0000 7f760523b700 1 --2- 172.21.15.26:0/1990929397 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f76000a0a30 0x7f76000a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.486+0000 7f760523b700 1 -- 172.21.15.26:0/1990929397 >> v1:172.21.15.26:6789/0 conn(0x7f7600133fa0 legacy=0x7f760013ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:16.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.486+0000 7f760523b700 1 -- 172.21.15.26:0/1990929397 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76000a1fe0 con 0x7f76000a1340 2023-10-01T07:58:16.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.486+0000 7f760523b700 1 --2- 172.21.15.26:0/1990929397 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76000a1340 0x7f7600133a60 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f75f0009840 tx=0x7f75f0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9415c20df0d45f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:16.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.486+0000 7f7604a3a700 1 -- 172.21.15.26:0/1990929397 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f0011830 con 0x7f76000a1340 2023-10-01T07:58:16.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.487+0000 7f7604a3a700 1 -- 172.21.15.26:0/1990929397 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f0011990 con 0x7f76000a1340 2023-10-01T07:58:16.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.487+0000 7f7604a3a700 1 -- 172.21.15.26:0/1990929397 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f0011d20 con 0x7f76000a1340 2023-10-01T07:58:16.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.487+0000 7f7607ca0700 1 -- 172.21.15.26:0/1990929397 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76000a1340 msgr2=0x7f7600133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:16.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.487+0000 7f7607ca0700 1 --2- 172.21.15.26:0/1990929397 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76000a1340 0x7f7600133a60 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f75f0009840 tx=0x7f75f0009b50 comp rx=0 tx=0).stop 2023-10-01T07:58:16.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.487+0000 7f7607ca0700 1 -- 172.21.15.26:0/1990929397 shutdown_connections 2023-10-01T07:58:16.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.487+0000 7f7607ca0700 1 --2- 172.21.15.26:0/1990929397 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f76000a0a30 0x7f76000a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.487+0000 7f7607ca0700 1 --2- 172.21.15.26:0/1990929397 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76000a1340 0x7f7600133a60 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.487+0000 7f7607ca0700 1 -- 172.21.15.26:0/1990929397 >> 172.21.15.26:0/1990929397 conn(0x7f76000a6550 msgr2=0x7f76000a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:16.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.487+0000 7f7607ca0700 1 -- 172.21.15.26:0/1990929397 shutdown_connections 2023-10-01T07:58:16.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.488+0000 7f7607ca0700 1 -- 172.21.15.26:0/1990929397 wait complete. 2023-10-01T07:58:16.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.489+0000 7f7607ca0700 1 Processor -- start 2023-10-01T07:58:16.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.489+0000 7f7607ca0700 1 -- start start 2023-10-01T07:58:16.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.489+0000 7f7607ca0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f76000a0a30 0x7f760011f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:16.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.489+0000 7f7607ca0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76000a1340 0x7f760011f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:16.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.489+0000 7f7607ca0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7600133fa0 0x7f76001c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:16.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.489+0000 7f7607ca0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760009c030 con 0x7f76000a1340 2023-10-01T07:58:16.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.489+0000 7f7607ca0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76000a0220 con 0x7f7600133fa0 2023-10-01T07:58:16.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.489+0000 7f7607ca0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76001206b0 con 0x7f76000a0a30 2023-10-01T07:58:16.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.489+0000 7f760523b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76000a1340 0x7f760011f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:16.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.489+0000 7f760523b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76000a1340 0x7f760011f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39194/0 (socket says 172.21.15.26:39194) 2023-10-01T07:58:16.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.489+0000 7f760523b700 1 -- 172.21.15.26:0/4196432785 learned_addr learned my addr 172.21.15.26:0/4196432785 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:16.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.489+0000 7f760623d700 1 --2- 172.21.15.26:0/4196432785 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7600133fa0 0x7f76001c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:16.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.490+0000 7f760523b700 1 -- 172.21.15.26:0/4196432785 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f76000a0a30 msgr2=0x7f760011f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:16.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.490+0000 7f7605a3c700 1 --2- 172.21.15.26:0/4196432785 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f76000a0a30 0x7f760011f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:16.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.490+0000 7f760523b700 1 --2- 172.21.15.26:0/4196432785 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f76000a0a30 0x7f760011f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.490+0000 7f760523b700 1 -- 172.21.15.26:0/4196432785 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7600133fa0 msgr2=0x7f76001c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:16.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.490+0000 7f760523b700 1 --2- 172.21.15.26:0/4196432785 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7600133fa0 0x7f76001c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.490+0000 7f760523b700 1 -- 172.21.15.26:0/4196432785 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f00094a0 con 0x7f76000a1340 2023-10-01T07:58:16.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.490+0000 7f760623d700 1 --2- 172.21.15.26:0/4196432785 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7600133fa0 0x7f76001c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:58:16.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.490+0000 7f7605a3c700 1 --2- 172.21.15.26:0/4196432785 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f76000a0a30 0x7f760011f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:58:16.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.490+0000 7f760523b700 1 --2- 172.21.15.26:0/4196432785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76000a1340 0x7f760011f9a0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f75f0009fd0 tx=0x7f75f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:16.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.490+0000 7f75f67fc700 1 -- 172.21.15.26:0/4196432785 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f00036a0 con 0x7f76000a1340 2023-10-01T07:58:16.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.490+0000 7f7607ca0700 1 -- 172.21.15.26:0/4196432785 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7600120e10 con 0x7f76000a1340 2023-10-01T07:58:16.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.490+0000 7f75f67fc700 1 -- 172.21.15.26:0/4196432785 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f001f070 con 0x7f76000a1340 2023-10-01T07:58:16.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.490+0000 7f7607ca0700 1 -- 172.21.15.26:0/4196432785 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f760011ef50 con 0x7f76000a1340 2023-10-01T07:58:16.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.490+0000 7f75f67fc700 1 -- 172.21.15.26:0/4196432785 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f0003a60 con 0x7f76000a1340 2023-10-01T07:58:16.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.491+0000 7f75f67fc700 1 -- 172.21.15.26:0/4196432785 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f75f0003bc0 con 0x7f76000a1340 2023-10-01T07:58:16.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.492+0000 7f75f67fc700 1 -- 172.21.15.26:0/4196432785 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f75f0021070 con 0x7f76000a1340 2023-10-01T07:58:16.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.492+0000 7f7607ca0700 1 -- 172.21.15.26:0/4196432785 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75e80052e0 con 0x7f76000a1340 2023-10-01T07:58:16.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.497+0000 7f75f67fc700 1 -- 172.21.15.26:0/4196432785 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f75f0015080 con 0x7f76000a1340 2023-10-01T07:58:16.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.634+0000 7f9066f2a700 1 -- 172.21.15.26:0/3263542323 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f906006b9e0 con 0x7f9060130540 2023-10-01T07:58:16.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.635+0000 7f905d7fa700 1 -- 172.21.15.26:0/3263542323 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f904c031090 con 0x7f9060130540 2023-10-01T07:58:16.636 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:16.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.637+0000 7f9066f2a700 1 -- 172.21.15.26:0/3263542323 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9060130540 msgr2=0x7f906006ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:16.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.637+0000 7f9066f2a700 1 --2- 172.21.15.26:0/3263542323 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9060130540 0x7f906006ea10 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f904c000c00 tx=0x7f904c004750 comp rx=0 tx=0).stop 2023-10-01T07:58:16.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.637+0000 7f9066f2a700 1 -- 172.21.15.26:0/3263542323 shutdown_connections 2023-10-01T07:58:16.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.637+0000 7f9066f2a700 1 --2- 172.21.15.26:0/3263542323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9060130e50 0x7f906006ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.637+0000 7f9066f2a700 1 --2- 172.21.15.26:0/3263542323 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f906006fb20 0x7f906006e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.637+0000 7f9066f2a700 1 --2- 172.21.15.26:0/3263542323 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9060130540 0x7f906006ea10 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.637+0000 7f9066f2a700 1 -- 172.21.15.26:0/3263542323 >> 172.21.15.26:0/3263542323 conn(0x7f90600a2aa0 msgr2=0x7f906012d600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:16.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.637+0000 7f9066f2a700 1 -- 172.21.15.26:0/3263542323 shutdown_connections 2023-10-01T07:58:16.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.637+0000 7f9066f2a700 1 -- 172.21.15.26:0/3263542323 wait complete. 2023-10-01T07:58:16.652 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:16.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.663+0000 7f42d99f5700 1 -- 172.21.15.26:0/581620391 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f42d4074ea0 con 0x7f42d409d6f0 2023-10-01T07:58:16.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.663+0000 7f42bbfff700 1 -- 172.21.15.26:0/581620391 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f42c4028090 con 0x7f42d409d6f0 2023-10-01T07:58:16.664 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:16.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.665+0000 7f42d99f5700 1 -- 172.21.15.26:0/581620391 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f42d409d6f0 msgr2=0x7f42d411dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:16.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.665+0000 7f42d99f5700 1 --2- 172.21.15.26:0/581620391 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f42d409d6f0 0x7f42d411dfa0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f42c400c770 tx=0x7f42c400ca80 comp rx=0 tx=0).stop 2023-10-01T07:58:16.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.666+0000 7f42d99f5700 1 -- 172.21.15.26:0/581620391 shutdown_connections 2023-10-01T07:58:16.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.666+0000 7f42d99f5700 1 --2- 172.21.15.26:0/581620391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42d409e410 0x7f42d411ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.666+0000 7f42d99f5700 1 --2- 172.21.15.26:0/581620391 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f42d409d6f0 0x7f42d411dfa0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.666+0000 7f42d99f5700 1 --2- 172.21.15.26:0/581620391 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f42d409e000 0x7f42d411e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.666+0000 7f42d99f5700 1 -- 172.21.15.26:0/581620391 >> 172.21.15.26:0/581620391 conn(0x7f42d4066f50 msgr2=0x7f42d4130890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:16.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.666+0000 7f42d99f5700 1 -- 172.21.15.26:0/581620391 shutdown_connections 2023-10-01T07:58:16.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.666+0000 7f42d99f5700 1 -- 172.21.15.26:0/581620391 wait complete. 2023-10-01T07:58:16.680 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:16.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.696+0000 7fc8ffbeb700 1 -- 172.21.15.26:0/682761298 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc8f812e320 con 0x7fc8f809e000 2023-10-01T07:58:16.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.697+0000 7fc8ee7fc700 1 -- 172.21.15.26:0/682761298 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc8e8033310 con 0x7fc8f809e000 2023-10-01T07:58:16.697 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:16.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.699+0000 7fc8ffbeb700 1 -- 172.21.15.26:0/682761298 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f809e000 msgr2=0x7fc8f81199c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:16.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.699+0000 7fc8ffbeb700 1 --2- 172.21.15.26:0/682761298 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f809e000 0x7fc8f81199c0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8009840 tx=0x7fc8e8004750 comp rx=0 tx=0).stop 2023-10-01T07:58:16.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.699+0000 7fc8ffbeb700 1 -- 172.21.15.26:0/682761298 shutdown_connections 2023-10-01T07:58:16.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.699+0000 7fc8ffbeb700 1 --2- 172.21.15.26:0/682761298 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc8f809e410 0x7fc8f8119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.699+0000 7fc8ffbeb700 1 --2- 172.21.15.26:0/682761298 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc8f809d6f0 0x7fc8f8119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.699+0000 7fc8ffbeb700 1 --2- 172.21.15.26:0/682761298 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f809e000 0x7fc8f81199c0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.699+0000 7fc8ffbeb700 1 -- 172.21.15.26:0/682761298 >> 172.21.15.26:0/682761298 conn(0x7fc8f8066f50 msgr2=0x7fc8f806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:16.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.699+0000 7fc8ffbeb700 1 -- 172.21.15.26:0/682761298 shutdown_connections 2023-10-01T07:58:16.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.699+0000 7fc8ffbeb700 1 -- 172.21.15.26:0/682761298 wait complete. 2023-10-01T07:58:16.713 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:16.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.730+0000 7f7607ca0700 1 -- 172.21.15.26:0/4196432785 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f75e8005590 con 0x7f76000a1340 2023-10-01T07:58:16.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.730+0000 7f75f67fc700 1 -- 172.21.15.26:0/4196432785 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f75f00253e0 con 0x7f76000a1340 2023-10-01T07:58:16.731 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:16.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.733+0000 7f7607ca0700 1 -- 172.21.15.26:0/4196432785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76000a1340 msgr2=0x7f760011f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:16.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.733+0000 7f7607ca0700 1 --2- 172.21.15.26:0/4196432785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76000a1340 0x7f760011f9a0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f75f0009fd0 tx=0x7f75f0004750 comp rx=0 tx=0).stop 2023-10-01T07:58:16.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.733+0000 7f7607ca0700 1 -- 172.21.15.26:0/4196432785 shutdown_connections 2023-10-01T07:58:16.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.733+0000 7f7607ca0700 1 --2- 172.21.15.26:0/4196432785 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7600133fa0 0x7f76001c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.733+0000 7f7607ca0700 1 --2- 172.21.15.26:0/4196432785 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f76000a0a30 0x7f760011f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.733+0000 7f7607ca0700 1 --2- 172.21.15.26:0/4196432785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76000a1340 0x7f760011f9a0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:16.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.733+0000 7f7607ca0700 1 -- 172.21.15.26:0/4196432785 >> 172.21.15.26:0/4196432785 conn(0x7f76000a6550 msgr2=0x7f76001b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:16.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.733+0000 7f7607ca0700 1 -- 172.21.15.26:0/4196432785 shutdown_connections 2023-10-01T07:58:16.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:16.733+0000 7f7607ca0700 1 -- 172.21.15.26:0/4196432785 wait complete. 2023-10-01T07:58:16.746 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:17.653 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:17.681 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:17.714 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:17.747 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:17.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.813+0000 7f2660f81700 1 Processor -- start 2023-10-01T07:58:17.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.813+0000 7f2660f81700 1 -- start start 2023-10-01T07:58:17.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.814+0000 7f2660f81700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f265c136710 0x7f265c138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:17.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.814+0000 7f2660f81700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f265c139030 0x7f265c13b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:17.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.814+0000 7f2660f81700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f265c06ef30 con 0x7f265c1338a0 2023-10-01T07:58:17.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.814+0000 7f2660f81700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f265c06fef0 con 0x7f265c139030 2023-10-01T07:58:17.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.814+0000 7f2660f81700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f265c1334b0 con 0x7f265c136710 2023-10-01T07:58:17.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.814+0000 7f265a59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f265c1338a0 0x7f265c133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38828/0 (socket says 172.21.15.26:38828) 2023-10-01T07:58:17.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.814+0000 7f265a59c700 1 -- 172.21.15.26:0/3339160780 learned_addr learned my addr 172.21.15.26:0/3339160780 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:17.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.814+0000 7f265ad9d700 1 --2- 172.21.15.26:0/3339160780 >> v2:172.21.15.26:3300/0 conn(0x7f265c139030 0x7f265c13b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:17.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.814+0000 7f2659d9b700 1 --2- 172.21.15.26:0/3339160780 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f265c136710 0x7f265c138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:17.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.814+0000 7f265959a700 1 -- 172.21.15.26:0/3339160780 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1773592668 0 0) 0x7f265c06ef30 con 0x7f265c1338a0 2023-10-01T07:58:17.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.815+0000 7f265959a700 1 -- 172.21.15.26:0/3339160780 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26440035b0 con 0x7f265c1338a0 2023-10-01T07:58:17.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.815+0000 7f2659d9b700 1 -- 172.21.15.26:0/3339160780 >> v2:172.21.15.26:3300/0 conn(0x7f265c139030 msgr2=0x7f265c13b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:17.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.815+0000 7f2659d9b700 1 --2- 172.21.15.26:0/3339160780 >> v2:172.21.15.26:3300/0 conn(0x7f265c139030 0x7f265c13b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:17.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.815+0000 7f2659d9b700 1 -- 172.21.15.26:0/3339160780 >> v1:172.21.15.26:6789/0 conn(0x7f265c1338a0 legacy=0x7f265c133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:17.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.815+0000 7f2659d9b700 1 -- 172.21.15.26:0/3339160780 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f265c06fc30 con 0x7f265c136710 2023-10-01T07:58:17.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.815+0000 7f2659d9b700 1 --2- 172.21.15.26:0/3339160780 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f265c136710 0x7f265c138af0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f2650009840 tx=0x7f2650009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4cb40a064d5e899 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:17.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.815+0000 7f265959a700 1 -- 172.21.15.26:0/3339160780 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2650011830 con 0x7f265c136710 2023-10-01T07:58:17.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.815+0000 7f265959a700 1 -- 172.21.15.26:0/3339160780 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2650011990 con 0x7f265c136710 2023-10-01T07:58:17.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.815+0000 7f265959a700 1 -- 172.21.15.26:0/3339160780 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2650011d20 con 0x7f265c136710 2023-10-01T07:58:17.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.816+0000 7f2660f81700 1 -- 172.21.15.26:0/3339160780 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f265c136710 msgr2=0x7f265c138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:17.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.816+0000 7f2660f81700 1 --2- 172.21.15.26:0/3339160780 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f265c136710 0x7f265c138af0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f2650009840 tx=0x7f2650009b50 comp rx=0 tx=0).stop 2023-10-01T07:58:17.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.816+0000 7f2660f81700 1 -- 172.21.15.26:0/3339160780 shutdown_connections 2023-10-01T07:58:17.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.816+0000 7f2660f81700 1 --2- 172.21.15.26:0/3339160780 >> v2:172.21.15.26:3300/0 conn(0x7f265c139030 0x7f265c13b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:17.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.816+0000 7f2660f81700 1 --2- 172.21.15.26:0/3339160780 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f265c136710 0x7f265c138af0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:17.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.816+0000 7f2660f81700 1 -- 172.21.15.26:0/3339160780 >> 172.21.15.26:0/3339160780 conn(0x7f265c0a2aa0 msgr2=0x7f265c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:17.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.816+0000 7f2660f81700 1 -- 172.21.15.26:0/3339160780 shutdown_connections 2023-10-01T07:58:17.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.816+0000 7f2660f81700 1 -- 172.21.15.26:0/3339160780 wait complete. 2023-10-01T07:58:17.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.818+0000 7f2660f81700 1 Processor -- start 2023-10-01T07:58:17.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.818+0000 7f2660f81700 1 -- start start 2023-10-01T07:58:17.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.818+0000 7f2660f81700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f265c1338a0 0x7f265c1c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:17.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.818+0000 7f2660f81700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f265c136710 0x7f265c1c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:17.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.818+0000 7f2660f81700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f265c139030 0x7f265c11ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:17.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.818+0000 7f2660f81700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265c11e4d0 con 0x7f265c139030 2023-10-01T07:58:17.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.818+0000 7f2660f81700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f265c1be110 con 0x7f265c1338a0 2023-10-01T07:58:17.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.818+0000 7f2660f81700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f265c11e720 con 0x7f265c136710 2023-10-01T07:58:17.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.818+0000 7f265a59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f265c1338a0 0x7f265c1c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:17.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.818+0000 7f2659d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f265c136710 0x7f265c1c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:17.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.818+0000 7f265a59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f265c1338a0 0x7f265c1c8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43326/0 (socket says 172.21.15.26:43326) 2023-10-01T07:58:17.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.818+0000 7f265a59c700 1 -- 172.21.15.26:0/3245681785 learned_addr learned my addr 172.21.15.26:0/3245681785 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:17.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.819+0000 7f265ad9d700 1 --2- 172.21.15.26:0/3245681785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f265c139030 0x7f265c11ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:17.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.819+0000 7f265ad9d700 1 -- 172.21.15.26:0/3245681785 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f265c136710 msgr2=0x7f265c1c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:17.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.819+0000 7f265ad9d700 1 --2- 172.21.15.26:0/3245681785 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f265c136710 0x7f265c1c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:17.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.819+0000 7f265ad9d700 1 -- 172.21.15.26:0/3245681785 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f265c1338a0 msgr2=0x7f265c1c8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:17.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.819+0000 7f265ad9d700 1 --2- 172.21.15.26:0/3245681785 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f265c1338a0 0x7f265c1c8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:17.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.819+0000 7f265ad9d700 1 -- 172.21.15.26:0/3245681785 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26500094a0 con 0x7f265c139030 2023-10-01T07:58:17.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.819+0000 7f2659d9b700 1 --2- 172.21.15.26:0/3245681785 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f265c136710 0x7f265c1c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:17.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.819+0000 7f265ad9d700 1 --2- 172.21.15.26:0/3245681785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f265c139030 0x7f265c11ac00 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f265400ef90 tx=0x7f265400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:17.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.820+0000 7f264affd700 1 -- 172.21.15.26:0/3245681785 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265400cc90 con 0x7f265c139030 2023-10-01T07:58:17.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.820+0000 7f2660f81700 1 -- 172.21.15.26:0/3245681785 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f265c11c810 con 0x7f265c139030 2023-10-01T07:58:17.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.820+0000 7f264affd700 1 -- 172.21.15.26:0/3245681785 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265400f040 con 0x7f265c139030 2023-10-01T07:58:17.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.820+0000 7f264affd700 1 -- 172.21.15.26:0/3245681785 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26540146c0 con 0x7f265c139030 2023-10-01T07:58:17.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.820+0000 7f2660f81700 1 -- 172.21.15.26:0/3245681785 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f265c130ad0 con 0x7f265c139030 2023-10-01T07:58:17.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.820+0000 7f264affd700 1 -- 172.21.15.26:0/3245681785 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2654014820 con 0x7f265c139030 2023-10-01T07:58:17.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.821+0000 7f264affd700 1 -- 172.21.15.26:0/3245681785 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2654040300 con 0x7f265c139030 2023-10-01T07:58:17.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.821+0000 7f2660f81700 1 -- 172.21.15.26:0/3245681785 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f265c11e330 con 0x7f265c139030 2023-10-01T07:58:17.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.830+0000 7f264affd700 1 -- 172.21.15.26:0/3245681785 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f265c11e330 con 0x7f265c139030 2023-10-01T07:58:17.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.854+0000 7f6521f26700 1 Processor -- start 2023-10-01T07:58:17.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.854+0000 7f6521f26700 1 -- start start 2023-10-01T07:58:17.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.855+0000 7f6521f26700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f651c09eca0 0x7f651c13cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:17.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.855+0000 7f6521f26700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f651c06f050 0x7f651c13f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:17.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.855+0000 7f6521f26700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f651c070ee0 con 0x7f651c06e570 2023-10-01T07:58:17.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.855+0000 7f6521f26700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f651c071980 con 0x7f651c06f050 2023-10-01T07:58:17.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.855+0000 7f6521f26700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f651c071480 con 0x7f651c09eca0 2023-10-01T07:58:17.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.855+0000 7f651affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f651c09eca0 0x7f651c13cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:17.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.855+0000 7f651b7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f651c06e570 0x7f651c06e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38830/0 (socket says 172.21.15.26:38830) 2023-10-01T07:58:17.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.855+0000 7f651b7fe700 1 -- 172.21.15.26:0/231830593 learned_addr learned my addr 172.21.15.26:0/231830593 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:17.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.855+0000 7f651bfff700 1 --2- 172.21.15.26:0/231830593 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f651c06f050 0x7f651c13f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:17.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.855+0000 7f651a7fc700 1 -- 172.21.15.26:0/231830593 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2281421130 0 0) 0x7f651c070ee0 con 0x7f651c06e570 2023-10-01T07:58:17.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.855+0000 7f651a7fc700 1 -- 172.21.15.26:0/231830593 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65040035b0 con 0x7f651c06e570 2023-10-01T07:58:17.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.855+0000 7f651affd700 1 -- 172.21.15.26:0/231830593 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f651c06f050 msgr2=0x7f651c13f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:17.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.855+0000 7f651affd700 1 --2- 172.21.15.26:0/231830593 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f651c06f050 0x7f651c13f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:17.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.855+0000 7f651affd700 1 -- 172.21.15.26:0/231830593 >> v1:172.21.15.26:6789/0 conn(0x7f651c06e570 legacy=0x7f651c06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:17.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.855+0000 7f651affd700 1 -- 172.21.15.26:0/231830593 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f651c071b90 con 0x7f651c09eca0 2023-10-01T07:58:17.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.855+0000 7f651bfff700 1 --2- 172.21.15.26:0/231830593 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f651c06f050 0x7f651c13f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:17.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.856+0000 7f651affd700 1 --2- 172.21.15.26:0/231830593 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f651c09eca0 0x7f651c13cea0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6510009870 tx=0x7f6510009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d5e013d57d09d1e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:17.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.856+0000 7f651a7fc700 1 -- 172.21.15.26:0/231830593 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6510011830 con 0x7f651c09eca0 2023-10-01T07:58:17.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.856+0000 7f651a7fc700 1 -- 172.21.15.26:0/231830593 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6510011990 con 0x7f651c09eca0 2023-10-01T07:58:17.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.856+0000 7f651a7fc700 1 -- 172.21.15.26:0/231830593 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6510011d00 con 0x7f651c09eca0 2023-10-01T07:58:17.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.857+0000 7f6521f26700 1 -- 172.21.15.26:0/231830593 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f651c09eca0 msgr2=0x7f651c13cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:17.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.857+0000 7f6521f26700 1 --2- 172.21.15.26:0/231830593 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f651c09eca0 0x7f651c13cea0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6510009870 tx=0x7f6510009b80 comp rx=0 tx=0).stop 2023-10-01T07:58:17.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.857+0000 7f6521f26700 1 -- 172.21.15.26:0/231830593 shutdown_connections 2023-10-01T07:58:17.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.857+0000 7f6521f26700 1 --2- 172.21.15.26:0/231830593 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f651c06f050 0x7f651c13f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:17.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.857+0000 7f6521f26700 1 --2- 172.21.15.26:0/231830593 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f651c09eca0 0x7f651c13cea0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:17.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.857+0000 7f6521f26700 1 -- 172.21.15.26:0/231830593 >> 172.21.15.26:0/231830593 conn(0x7f651c0a2aa0 msgr2=0x7f651c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:17.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.857+0000 7f6521f26700 1 -- 172.21.15.26:0/231830593 shutdown_connections 2023-10-01T07:58:17.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.857+0000 7f6521f26700 1 -- 172.21.15.26:0/231830593 wait complete. 2023-10-01T07:58:17.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.858+0000 7f6521f26700 1 Processor -- start 2023-10-01T07:58:17.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.858+0000 7f6521f26700 1 -- start start 2023-10-01T07:58:17.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.859+0000 7f6521f26700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f651c06e570 0x7f651c126710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:17.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.859+0000 7f6521f26700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f651c06f050 0x7f651c126c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:17.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.859+0000 7f6521f26700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f651c127190 0x7f651c1d2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:17.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.859+0000 7f6521f26700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651c13eb00 con 0x7f651c06e570 2023-10-01T07:58:17.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.859+0000 7f6521f26700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f651c129520 con 0x7f651c127190 2023-10-01T07:58:17.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.859+0000 7f6521f26700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f651c127b50 con 0x7f651c06f050 2023-10-01T07:58:17.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.859+0000 7f651bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f651c127190 0x7f651c1d2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:17.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.859+0000 7f651bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f651c127190 0x7f651c1d2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43350/0 (socket says 172.21.15.26:43350) 2023-10-01T07:58:17.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.859+0000 7f651b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f651c06e570 0x7f651c126710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:17.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.859+0000 7f651affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f651c06f050 0x7f651c126c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:17.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.859+0000 7f651bfff700 1 -- 172.21.15.26:0/2877533825 learned_addr learned my addr 172.21.15.26:0/2877533825 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:17.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.860+0000 7f651affd700 1 -- 172.21.15.26:0/2877533825 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f651c127190 msgr2=0x7f651c1d2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:17.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.860+0000 7f651affd700 1 --2- 172.21.15.26:0/2877533825 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f651c127190 0x7f651c1d2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:17.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.860+0000 7f651affd700 1 -- 172.21.15.26:0/2877533825 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f651c06e570 msgr2=0x7f651c126710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:17.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.860+0000 7f651affd700 1 --2- 172.21.15.26:0/2877533825 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f651c06e570 0x7f651c126710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:17.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.860+0000 7f651affd700 1 -- 172.21.15.26:0/2877533825 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6514009a70 con 0x7f651c06f050 2023-10-01T07:58:17.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.860+0000 7f651bfff700 1 --2- 172.21.15.26:0/2877533825 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f651c127190 0x7f651c1d2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:17.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.860+0000 7f651affd700 1 --2- 172.21.15.26:0/2877533825 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f651c06f050 0x7f651c126c50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6510016000 tx=0x7f6510004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:17.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.860+0000 7f6503fff700 1 -- 172.21.15.26:0/2877533825 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6510004450 con 0x7f651c06f050 2023-10-01T07:58:17.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.860+0000 7f6503fff700 1 -- 172.21.15.26:0/2877533825 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65100045b0 con 0x7f651c06f050 2023-10-01T07:58:17.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.860+0000 7f6503fff700 1 -- 172.21.15.26:0/2877533825 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65100038a0 con 0x7f651c06f050 2023-10-01T07:58:17.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.860+0000 7f6521f26700 1 -- 172.21.15.26:0/2877533825 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65100094a0 con 0x7f651c06f050 2023-10-01T07:58:17.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.861+0000 7f6521f26700 1 -- 172.21.15.26:0/2877533825 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f651c128b30 con 0x7f651c06f050 2023-10-01T07:58:17.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.861+0000 7f6503fff700 1 -- 172.21.15.26:0/2877533825 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6510003a00 con 0x7f651c06f050 2023-10-01T07:58:17.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.862+0000 7f6503fff700 1 -- 172.21.15.26:0/2877533825 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f65100408c0 con 0x7f651c06f050 2023-10-01T07:58:17.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.862+0000 7f6521f26700 1 -- 172.21.15.26:0/2877533825 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f651c122c80 con 0x7f651c06f050 2023-10-01T07:58:17.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.867+0000 7f6503fff700 1 -- 172.21.15.26:0/2877533825 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6510015080 con 0x7f651c06f050 2023-10-01T07:58:17.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.928+0000 7f92a84f1700 1 Processor -- start 2023-10-01T07:58:17.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.928+0000 7f92a84f1700 1 -- start start 2023-10-01T07:58:17.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.929+0000 7f92a84f1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f92a01337f0 0x7f92a0138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:17.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.929+0000 7f92a84f1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92a0138dc0 0x7f92a013b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:17.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.929+0000 7f92a84f1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92a006b990 con 0x7f92a0133420 2023-10-01T07:58:17.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.929+0000 7f92a84f1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92a009b0e0 con 0x7f92a01337f0 2023-10-01T07:58:17.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.929+0000 7f92a84f1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92a0133c20 con 0x7f92a0138dc0 2023-10-01T07:58:17.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.929+0000 7f92a5a8c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f92a01337f0 0x7f92a0138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:17.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.929+0000 7f92a628d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f92a0133420 0x7f92a0133e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38836/0 (socket says 172.21.15.26:38836) 2023-10-01T07:58:17.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.929+0000 7f92a628d700 1 -- 172.21.15.26:0/1882692343 learned_addr learned my addr 172.21.15.26:0/1882692343 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:17.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.929+0000 7f92a528b700 1 -- 172.21.15.26:0/1882692343 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3478444903 0 0) 0x7f92a006b990 con 0x7f92a0133420 2023-10-01T07:58:17.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.929+0000 7f92a528b700 1 -- 172.21.15.26:0/1882692343 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f928c0035b0 con 0x7f92a0133420 2023-10-01T07:58:17.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.929+0000 7f92a5a8c700 1 -- 172.21.15.26:0/1882692343 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92a0138dc0 msgr2=0x7f92a013b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:17.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.929+0000 7f92a5a8c700 1 --2- 172.21.15.26:0/1882692343 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92a0138dc0 0x7f92a013b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:17.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.929+0000 7f92a5a8c700 1 -- 172.21.15.26:0/1882692343 >> v1:172.21.15.26:6789/0 conn(0x7f92a0133420 legacy=0x7f92a0133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:17.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.929+0000 7f92a5a8c700 1 -- 172.21.15.26:0/1882692343 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a00a0590 con 0x7f92a01337f0 2023-10-01T07:58:17.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.930+0000 7f92a5a8c700 1 --2- 172.21.15.26:0/1882692343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92a01337f0 0x7f92a0138880 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f9290009840 tx=0x7f9290009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3847383eb69599c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:17.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.930+0000 7f92a528b700 1 -- 172.21.15.26:0/1882692343 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9290011830 con 0x7f92a01337f0 2023-10-01T07:58:17.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.930+0000 7f92a528b700 1 -- 172.21.15.26:0/1882692343 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9290011990 con 0x7f92a01337f0 2023-10-01T07:58:17.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.930+0000 7f92a528b700 1 -- 172.21.15.26:0/1882692343 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9290011d20 con 0x7f92a01337f0 2023-10-01T07:58:17.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.931+0000 7f92a84f1700 1 -- 172.21.15.26:0/1882692343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92a01337f0 msgr2=0x7f92a0138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:17.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.931+0000 7f92a84f1700 1 --2- 172.21.15.26:0/1882692343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92a01337f0 0x7f92a0138880 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f9290009840 tx=0x7f9290009b50 comp rx=0 tx=0).stop 2023-10-01T07:58:17.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.931+0000 7f92a84f1700 1 -- 172.21.15.26:0/1882692343 shutdown_connections 2023-10-01T07:58:17.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.931+0000 7f92a84f1700 1 --2- 172.21.15.26:0/1882692343 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92a0138dc0 0x7f92a013b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:17.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.931+0000 7f92a84f1700 1 --2- 172.21.15.26:0/1882692343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92a01337f0 0x7f92a0138880 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:17.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.931+0000 7f92a84f1700 1 -- 172.21.15.26:0/1882692343 >> 172.21.15.26:0/1882692343 conn(0x7f92a00a4210 msgr2=0x7f92a00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:17.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.931+0000 7f92a84f1700 1 -- 172.21.15.26:0/1882692343 shutdown_connections 2023-10-01T07:58:17.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.931+0000 7f92a84f1700 1 -- 172.21.15.26:0/1882692343 wait complete. 2023-10-01T07:58:17.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.932+0000 7f92a84f1700 1 Processor -- start 2023-10-01T07:58:17.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.932+0000 7f92a84f1700 1 -- start start 2023-10-01T07:58:17.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.932+0000 7f92a84f1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92a0133420 0x7f92a012ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:17.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.932+0000 7f92a84f1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92a01337f0 0x7f92a012f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:17.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.932+0000 7f92a84f1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92a0138dc0 0x7f92a012f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:17.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.932+0000 7f92a84f1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a009c740 con 0x7f92a0133420 2023-10-01T07:58:17.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.932+0000 7f92a84f1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a0130970 con 0x7f92a0138dc0 2023-10-01T07:58:17.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.932+0000 7f92a84f1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92a009bee0 con 0x7f92a01337f0 2023-10-01T07:58:17.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.933+0000 7f92a628d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92a0133420 0x7f92a012ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:17.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.933+0000 7f92a5a8c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92a01337f0 0x7f92a012f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:17.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.933+0000 7f92a628d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92a0133420 0x7f92a012ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39226/0 (socket says 172.21.15.26:39226) 2023-10-01T07:58:17.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.933+0000 7f92a628d700 1 -- 172.21.15.26:0/883946476 learned_addr learned my addr 172.21.15.26:0/883946476 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:17.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.933+0000 7f92a6a8e700 1 --2- 172.21.15.26:0/883946476 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92a0138dc0 0x7f92a012f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:17.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.933+0000 7f92a628d700 1 -- 172.21.15.26:0/883946476 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92a01337f0 msgr2=0x7f92a012f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:17.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.933+0000 7f92a628d700 1 --2- 172.21.15.26:0/883946476 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92a01337f0 0x7f92a012f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:17.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.933+0000 7f92a628d700 1 -- 172.21.15.26:0/883946476 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92a0138dc0 msgr2=0x7f92a012f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:17.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.933+0000 7f92a628d700 1 --2- 172.21.15.26:0/883946476 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92a0138dc0 0x7f92a012f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:17.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.933+0000 7f92a628d700 1 -- 172.21.15.26:0/883946476 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92900094a0 con 0x7f92a0133420 2023-10-01T07:58:17.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.933+0000 7f92a6a8e700 1 --2- 172.21.15.26:0/883946476 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92a0138dc0 0x7f92a012f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:17.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.933+0000 7f92a628d700 1 --2- 172.21.15.26:0/883946476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92a0133420 0x7f92a012ee50 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f929c00c700 tx=0x7f929c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:17.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.933+0000 7f9296ffd700 1 -- 172.21.15.26:0/883946476 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929c005d70 con 0x7f92a0133420 2023-10-01T07:58:17.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.933+0000 7f9296ffd700 1 -- 172.21.15.26:0/883946476 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929c0070d0 con 0x7f92a0133420 2023-10-01T07:58:17.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.933+0000 7f92a84f1700 1 -- 172.21.15.26:0/883946476 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92a009e440 con 0x7f92a0133420 2023-10-01T07:58:17.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.933+0000 7f9296ffd700 1 -- 172.21.15.26:0/883946476 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929c007460 con 0x7f92a0133420 2023-10-01T07:58:17.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.934+0000 7f92a84f1700 1 -- 172.21.15.26:0/883946476 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92a009d8c0 con 0x7f92a0133420 2023-10-01T07:58:17.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.934+0000 7f92a84f1700 1 -- 172.21.15.26:0/883946476 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92a0074ea0 con 0x7f92a0133420 2023-10-01T07:58:17.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.935+0000 7f9296ffd700 1 -- 172.21.15.26:0/883946476 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f929c0075c0 con 0x7f92a0133420 2023-10-01T07:58:17.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.935+0000 7f9296ffd700 1 -- 172.21.15.26:0/883946476 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f929c03eb20 con 0x7f92a0133420 2023-10-01T07:58:17.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.938+0000 7fc0a5579700 1 Processor -- start 2023-10-01T07:58:17.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.938+0000 7fc0a5579700 1 -- start start 2023-10-01T07:58:17.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.938+0000 7fc0a5579700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0a01338a0 0x7fc0a0133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:17.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.938+0000 7fc0a5579700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc0a009de50 0x7fc0a009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:17.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.938+0000 7fc0a5579700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a006ef30 con 0x7fc0a009e760 2023-10-01T07:58:17.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.938+0000 7fc0a5579700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a006fef0 con 0x7fc0a01338a0 2023-10-01T07:58:17.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.938+0000 7fc0a5579700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a01334b0 con 0x7fc0a009de50 2023-10-01T07:58:17.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.938+0000 7fc09effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0a01338a0 0x7fc0a0133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:17.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.939+0000 7fc09effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0a01338a0 0x7fc0a0133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43356/0 (socket says 172.21.15.26:43356) 2023-10-01T07:58:17.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.939+0000 7fc09effd700 1 -- 172.21.15.26:0/493510213 learned_addr learned my addr 172.21.15.26:0/493510213 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:17.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.939+0000 7fc09e7fc700 1 --2- 172.21.15.26:0/493510213 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc0a009de50 0x7fc0a009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:17.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.939+0000 7fc09effd700 1 -- 172.21.15.26:0/493510213 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc0a009de50 msgr2=0x7fc0a009e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:17.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.939+0000 7fc09effd700 1 --2- 172.21.15.26:0/493510213 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc0a009de50 0x7fc0a009e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:17.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.939+0000 7fc09effd700 1 -- 172.21.15.26:0/493510213 >> v1:172.21.15.26:6789/0 conn(0x7fc0a009e760 legacy=0x7fc0a013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:17.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.939+0000 7fc09effd700 1 -- 172.21.15.26:0/493510213 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a006fc30 con 0x7fc0a01338a0 2023-10-01T07:58:17.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.939+0000 7fc09effd700 1 --2- 172.21.15.26:0/493510213 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0a01338a0 0x7fc0a0133c70 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc090009920 tx=0x7fc090009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=837fcc0f685efbc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:17.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.939+0000 7fc09dffb700 1 -- 172.21.15.26:0/493510213 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc090004230 con 0x7fc0a01338a0 2023-10-01T07:58:17.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.939+0000 7fc09dffb700 1 -- 172.21.15.26:0/493510213 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc090004390 con 0x7fc0a01338a0 2023-10-01T07:58:17.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.939+0000 7fc09dffb700 1 -- 172.21.15.26:0/493510213 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0900036a0 con 0x7fc0a01338a0 2023-10-01T07:58:17.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.940+0000 7fc0a5579700 1 -- 172.21.15.26:0/493510213 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0a01338a0 msgr2=0x7fc0a0133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:17.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.940+0000 7fc0a5579700 1 --2- 172.21.15.26:0/493510213 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0a01338a0 0x7fc0a0133c70 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc090009920 tx=0x7fc090009c30 comp rx=0 tx=0).stop 2023-10-01T07:58:17.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.940+0000 7fc0a5579700 1 -- 172.21.15.26:0/493510213 shutdown_connections 2023-10-01T07:58:17.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.940+0000 7fc0a5579700 1 --2- 172.21.15.26:0/493510213 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0a01338a0 0x7fc0a0133c70 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:17.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.940+0000 7fc0a5579700 1 --2- 172.21.15.26:0/493510213 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc0a009de50 0x7fc0a009e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:17.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.940+0000 7fc0a5579700 1 -- 172.21.15.26:0/493510213 >> 172.21.15.26:0/493510213 conn(0x7fc0a00a2aa0 msgr2=0x7fc0a00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:17.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.940+0000 7fc0a5579700 1 -- 172.21.15.26:0/493510213 shutdown_connections 2023-10-01T07:58:17.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.940+0000 7fc0a5579700 1 -- 172.21.15.26:0/493510213 wait complete. 2023-10-01T07:58:17.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.940+0000 7f9296ffd700 1 -- 172.21.15.26:0/883946476 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f929c01bb10 con 0x7f92a0133420 2023-10-01T07:58:17.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.942+0000 7fc0a5579700 1 Processor -- start 2023-10-01T07:58:17.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.942+0000 7fc0a5579700 1 -- start start 2023-10-01T07:58:17.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.942+0000 7fc0a5579700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0a009de50 0x7fc0a01cc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:17.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.942+0000 7fc0a5579700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc0a009e760 0x7fc0a01ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:17.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.942+0000 7fc0a5579700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0a01338a0 0x7fc0a01cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:17.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.942+0000 7fc0a5579700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a0122e60 con 0x7fc0a01338a0 2023-10-01T07:58:17.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.942+0000 7fc0a5579700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a0125df0 con 0x7fc0a009de50 2023-10-01T07:58:17.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.942+0000 7fc0a5579700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a01260b0 con 0x7fc0a009e760 2023-10-01T07:58:17.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.943+0000 7fc09f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0a01338a0 0x7fc0a01cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:17.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.943+0000 7fc09f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0a01338a0 0x7fc0a01cd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39234/0 (socket says 172.21.15.26:39234) 2023-10-01T07:58:17.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.943+0000 7fc09f7fe700 1 -- 172.21.15.26:0/4056010600 learned_addr learned my addr 172.21.15.26:0/4056010600 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:17.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.943+0000 7fc09e7fc700 1 --2- 172.21.15.26:0/4056010600 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc0a009e760 0x7fc0a01ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:17.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.943+0000 7fc09effd700 1 --2- 172.21.15.26:0/4056010600 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0a009de50 0x7fc0a01cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:17.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.943+0000 7fc09e7fc700 1 -- 172.21.15.26:0/4056010600 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0a009de50 msgr2=0x7fc0a01cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:17.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.943+0000 7fc09e7fc700 1 --2- 172.21.15.26:0/4056010600 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0a009de50 0x7fc0a01cc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:17.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.943+0000 7fc09e7fc700 1 -- 172.21.15.26:0/4056010600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0a01338a0 msgr2=0x7fc0a01cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:17.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.943+0000 7fc09e7fc700 1 --2- 172.21.15.26:0/4056010600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0a01338a0 0x7fc0a01cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:17.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.943+0000 7fc09e7fc700 1 -- 172.21.15.26:0/4056010600 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc090009550 con 0x7fc0a009e760 2023-10-01T07:58:17.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.943+0000 7fc09f7fe700 1 --2- 172.21.15.26:0/4056010600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0a01338a0 0x7fc0a01cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:17.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.943+0000 7fc09e7fc700 1 --2- 172.21.15.26:0/4056010600 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc0a009e760 0x7fc0a01ccd70 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc09400e840 tx=0x7fc09400eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:17.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.944+0000 7fc0877fe700 1 -- 172.21.15.26:0/4056010600 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc094013680 con 0x7fc0a009e760 2023-10-01T07:58:17.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.944+0000 7fc0877fe700 1 -- 172.21.15.26:0/4056010600 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0940137e0 con 0x7fc0a009e760 2023-10-01T07:58:17.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.944+0000 7fc0a5579700 1 -- 172.21.15.26:0/4056010600 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a0124c40 con 0x7fc0a009e760 2023-10-01T07:58:17.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.944+0000 7fc0a5579700 1 -- 172.21.15.26:0/4056010600 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a0126b20 con 0x7fc0a009e760 2023-10-01T07:58:17.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.945+0000 7fc0877fe700 1 -- 172.21.15.26:0/4056010600 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc094013b70 con 0x7fc0a009e760 2023-10-01T07:58:17.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.945+0000 7fc0877fe700 1 -- 172.21.15.26:0/4056010600 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc094013cd0 con 0x7fc0a009e760 2023-10-01T07:58:17.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.945+0000 7fc0a5579700 1 -- 172.21.15.26:0/4056010600 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a0124a90 con 0x7fc0a009e760 2023-10-01T07:58:17.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.945+0000 7fc0877fe700 1 -- 172.21.15.26:0/4056010600 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc09403f6e0 con 0x7fc0a009e760 2023-10-01T07:58:17.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:17.954+0000 7fc0877fe700 1 -- 172.21.15.26:0/4056010600 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc09401be10 con 0x7fc0a009e760 2023-10-01T07:58:18.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.079+0000 7f6521f26700 1 -- 172.21.15.26:0/2877533825 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f651c09a0c0 con 0x7f651c06f050 2023-10-01T07:58:18.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.080+0000 7f6503fff700 1 -- 172.21.15.26:0/2877533825 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6510010740 con 0x7f651c06f050 2023-10-01T07:58:18.080 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:18.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.082+0000 7f6521f26700 1 -- 172.21.15.26:0/2877533825 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f651c06f050 msgr2=0x7f651c126c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:18.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.082+0000 7f6521f26700 1 --2- 172.21.15.26:0/2877533825 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f651c06f050 0x7f651c126c50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6510016000 tx=0x7f6510004750 comp rx=0 tx=0).stop 2023-10-01T07:58:18.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.082+0000 7f6521f26700 1 -- 172.21.15.26:0/2877533825 shutdown_connections 2023-10-01T07:58:18.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.082+0000 7f6521f26700 1 --2- 172.21.15.26:0/2877533825 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f651c127190 0x7f651c1d2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:18.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.082+0000 7f6521f26700 1 --2- 172.21.15.26:0/2877533825 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f651c06e570 0x7f651c126710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:18.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.082+0000 7f6521f26700 1 --2- 172.21.15.26:0/2877533825 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f651c06f050 0x7f651c126c50 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:18.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.082+0000 7f6521f26700 1 -- 172.21.15.26:0/2877533825 >> 172.21.15.26:0/2877533825 conn(0x7f651c0a2aa0 msgr2=0x7f651c09a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:18.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.082+0000 7f6521f26700 1 -- 172.21.15.26:0/2877533825 shutdown_connections 2023-10-01T07:58:18.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.082+0000 7f6521f26700 1 -- 172.21.15.26:0/2877533825 wait complete. 2023-10-01T07:58:18.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.095+0000 7f2660f81700 1 -- 172.21.15.26:0/3245681785 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f265c11e330 con 0x7f265c139030 2023-10-01T07:58:18.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.095+0000 7f264affd700 1 -- 172.21.15.26:0/3245681785 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f265c11e330 con 0x7f265c139030 2023-10-01T07:58:18.096 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:18.097 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:18.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.099+0000 7f2660f81700 1 -- 172.21.15.26:0/3245681785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f265c139030 msgr2=0x7f265c11ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:18.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.099+0000 7f2660f81700 1 --2- 172.21.15.26:0/3245681785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f265c139030 0x7f265c11ac00 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f265400ef90 tx=0x7f265400c3a0 comp rx=0 tx=0).stop 2023-10-01T07:58:18.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.099+0000 7f2660f81700 1 -- 172.21.15.26:0/3245681785 shutdown_connections 2023-10-01T07:58:18.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.099+0000 7f2660f81700 1 --2- 172.21.15.26:0/3245681785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f265c139030 0x7f265c11ac00 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:18.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.099+0000 7f2660f81700 1 --2- 172.21.15.26:0/3245681785 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f265c1338a0 0x7f265c1c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:18.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.099+0000 7f2660f81700 1 --2- 172.21.15.26:0/3245681785 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f265c136710 0x7f265c1c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:18.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.099+0000 7f2660f81700 1 -- 172.21.15.26:0/3245681785 >> 172.21.15.26:0/3245681785 conn(0x7f265c0a2aa0 msgr2=0x7f265c1344f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:18.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.099+0000 7f2660f81700 1 -- 172.21.15.26:0/3245681785 shutdown_connections 2023-10-01T07:58:18.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.099+0000 7f2660f81700 1 -- 172.21.15.26:0/3245681785 wait complete. 2023-10-01T07:58:18.118 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:18.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.152+0000 7f92a84f1700 1 -- 172.21.15.26:0/883946476 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f92a006b250 con 0x7f92a0133420 2023-10-01T07:58:18.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.152+0000 7f9296ffd700 1 -- 172.21.15.26:0/883946476 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f929c017030 con 0x7f92a0133420 2023-10-01T07:58:18.153 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:18.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.155+0000 7f92a84f1700 1 -- 172.21.15.26:0/883946476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92a0133420 msgr2=0x7f92a012ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:18.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.155+0000 7f92a84f1700 1 --2- 172.21.15.26:0/883946476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92a0133420 0x7f92a012ee50 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f929c00c700 tx=0x7f929c00ca10 comp rx=0 tx=0).stop 2023-10-01T07:58:18.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.155+0000 7f92a84f1700 1 -- 172.21.15.26:0/883946476 shutdown_connections 2023-10-01T07:58:18.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.155+0000 7f92a84f1700 1 --2- 172.21.15.26:0/883946476 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92a0138dc0 0x7f92a012f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:18.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.155+0000 7f92a84f1700 1 --2- 172.21.15.26:0/883946476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92a0133420 0x7f92a012ee50 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:18.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.155+0000 7f92a84f1700 1 --2- 172.21.15.26:0/883946476 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f92a01337f0 0x7f92a012f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:18.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.155+0000 7f92a84f1700 1 -- 172.21.15.26:0/883946476 >> 172.21.15.26:0/883946476 conn(0x7f92a00a4210 msgr2=0x7f92a00a0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:18.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.155+0000 7f92a84f1700 1 -- 172.21.15.26:0/883946476 shutdown_connections 2023-10-01T07:58:18.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.155+0000 7f92a84f1700 1 -- 172.21.15.26:0/883946476 wait complete. 2023-10-01T07:58:18.169 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:18.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.174+0000 7fc0a5579700 1 -- 172.21.15.26:0/4056010600 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc0a0074ea0 con 0x7fc0a009e760 2023-10-01T07:58:18.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.174+0000 7fc0877fe700 1 -- 172.21.15.26:0/4056010600 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc094017020 con 0x7fc0a009e760 2023-10-01T07:58:18.175 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:18.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.177+0000 7fc0a5579700 1 -- 172.21.15.26:0/4056010600 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc0a009e760 msgr2=0x7fc0a01ccd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:18.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.177+0000 7fc0a5579700 1 --2- 172.21.15.26:0/4056010600 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc0a009e760 0x7fc0a01ccd70 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc09400e840 tx=0x7fc09400eb50 comp rx=0 tx=0).stop 2023-10-01T07:58:18.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.177+0000 7fc0a5579700 1 -- 172.21.15.26:0/4056010600 shutdown_connections 2023-10-01T07:58:18.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.177+0000 7fc0a5579700 1 --2- 172.21.15.26:0/4056010600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0a01338a0 0x7fc0a01cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:18.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.177+0000 7fc0a5579700 1 --2- 172.21.15.26:0/4056010600 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc0a009de50 0x7fc0a01cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:18.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.177+0000 7fc0a5579700 1 --2- 172.21.15.26:0/4056010600 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc0a009e760 0x7fc0a01ccd70 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:18.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.177+0000 7fc0a5579700 1 -- 172.21.15.26:0/4056010600 >> 172.21.15.26:0/4056010600 conn(0x7fc0a00a2aa0 msgr2=0x7fc0a009ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:18.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.177+0000 7fc0a5579700 1 -- 172.21.15.26:0/4056010600 shutdown_connections 2023-10-01T07:58:18.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:18.177+0000 7fc0a5579700 1 -- 172.21.15.26:0/4056010600 wait complete. 2023-10-01T07:58:18.191 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:19.098 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:19.119 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:19.169 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:19.192 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:19.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.256+0000 7fb45d64c700 1 Processor -- start 2023-10-01T07:58:19.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.256+0000 7fb45d64c700 1 -- start start 2023-10-01T07:58:19.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.257+0000 7fb45d64c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb458131810 0x7fb458131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:19.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.257+0000 7fb45d64c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb458099a40 0x7fb458099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:19.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.257+0000 7fb45d64c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb45809a3b0 0x7fb458138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:19.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.257+0000 7fb45d64c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4581313c0 con 0x7fb458131810 2023-10-01T07:58:19.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.257+0000 7fb45d64c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45806e8c0 con 0x7fb458099a40 2023-10-01T07:58:19.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.257+0000 7fb45d64c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb458071d20 con 0x7fb45809a3b0 2023-10-01T07:58:19.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.257+0000 7fb4567fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb458099a40 0x7fb458099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:19.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.257+0000 7fb456ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb458131810 0x7fb458131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:19.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.257+0000 7fb4567fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb458099a40 0x7fb458099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43368/0 (socket says 172.21.15.26:43368) 2023-10-01T07:58:19.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.257+0000 7fb4567fc700 1 -- 172.21.15.26:0/3846884100 learned_addr learned my addr 172.21.15.26:0/3846884100 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:19.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.257+0000 7fb4577fe700 1 --2- 172.21.15.26:0/3846884100 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb45809a3b0 0x7fb458138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:19.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.258+0000 7fb4567fc700 1 -- 172.21.15.26:0/3846884100 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb45809a3b0 msgr2=0x7fb458138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:19.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.258+0000 7fb4567fc700 1 --2- 172.21.15.26:0/3846884100 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb45809a3b0 0x7fb458138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:19.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.258+0000 7fb4567fc700 1 -- 172.21.15.26:0/3846884100 >> v2:172.21.15.26:3300/0 conn(0x7fb458131810 msgr2=0x7fb458131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:19.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.258+0000 7fb4567fc700 1 --2- 172.21.15.26:0/3846884100 >> v2:172.21.15.26:3300/0 conn(0x7fb458131810 0x7fb458131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:19.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.258+0000 7fb4567fc700 1 -- 172.21.15.26:0/3846884100 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4580721a0 con 0x7fb458099a40 2023-10-01T07:58:19.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.258+0000 7fb4567fc700 1 --2- 172.21.15.26:0/3846884100 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb458099a40 0x7fb458099e70 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0098f0 tx=0x7fb44c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b47126730f64bc85 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:19.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.258+0000 7fb455ffb700 1 -- 172.21.15.26:0/3846884100 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c011830 con 0x7fb458099a40 2023-10-01T07:58:19.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.258+0000 7fb455ffb700 1 -- 172.21.15.26:0/3846884100 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44c011990 con 0x7fb458099a40 2023-10-01T07:58:19.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.258+0000 7fb455ffb700 1 -- 172.21.15.26:0/3846884100 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c011d20 con 0x7fb458099a40 2023-10-01T07:58:19.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.259+0000 7fb45d64c700 1 -- 172.21.15.26:0/3846884100 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb458099a40 msgr2=0x7fb458099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:19.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.259+0000 7fb45d64c700 1 --2- 172.21.15.26:0/3846884100 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb458099a40 0x7fb458099e70 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0098f0 tx=0x7fb44c009c00 comp rx=0 tx=0).stop 2023-10-01T07:58:19.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.259+0000 7fb45d64c700 1 -- 172.21.15.26:0/3846884100 shutdown_connections 2023-10-01T07:58:19.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.259+0000 7fb45d64c700 1 --2- 172.21.15.26:0/3846884100 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb45809a3b0 0x7fb458138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:19.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.259+0000 7fb45d64c700 1 --2- 172.21.15.26:0/3846884100 >> v2:172.21.15.26:3300/0 conn(0x7fb458131810 0x7fb458131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:19.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.259+0000 7fb45d64c700 1 --2- 172.21.15.26:0/3846884100 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb458099a40 0x7fb458099e70 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:19.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.259+0000 7fb45d64c700 1 -- 172.21.15.26:0/3846884100 >> 172.21.15.26:0/3846884100 conn(0x7fb4580a2aa0 msgr2=0x7fb4580a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:19.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.259+0000 7fb45d64c700 1 -- 172.21.15.26:0/3846884100 shutdown_connections 2023-10-01T07:58:19.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.259+0000 7fb45d64c700 1 -- 172.21.15.26:0/3846884100 wait complete. 2023-10-01T07:58:19.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.260+0000 7fb45d64c700 1 Processor -- start 2023-10-01T07:58:19.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.260+0000 7fb45d64c700 1 -- start start 2023-10-01T07:58:19.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.261+0000 7fb45d64c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb458099a40 0x7fb4581195e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:19.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.261+0000 7fb45d64c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb45809a3b0 0x7fb458119b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:19.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.261+0000 7fb45d64c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb458131810 0x7fb45811a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:19.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.261+0000 7fb45d64c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45811c800 con 0x7fb458099a40 2023-10-01T07:58:19.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.261+0000 7fb45d64c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45806eb00 con 0x7fb45809a3b0 2023-10-01T07:58:19.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.261+0000 7fb45d64c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb458130890 con 0x7fb458131810 2023-10-01T07:58:19.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.261+0000 7fb456ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb458099a40 0x7fb4581195e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:19.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.261+0000 7fb456ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb458099a40 0x7fb4581195e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39248/0 (socket says 172.21.15.26:39248) 2023-10-01T07:58:19.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.261+0000 7fb456ffd700 1 -- 172.21.15.26:0/3779971852 learned_addr learned my addr 172.21.15.26:0/3779971852 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:19.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.262+0000 7fb456ffd700 1 -- 172.21.15.26:0/3779971852 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb458131810 msgr2=0x7fb45811a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:19.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.262+0000 7fb456ffd700 1 --2- 172.21.15.26:0/3779971852 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb458131810 0x7fb45811a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:19.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.262+0000 7fb456ffd700 1 -- 172.21.15.26:0/3779971852 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb45809a3b0 msgr2=0x7fb458119b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:58:19.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.262+0000 7fb456ffd700 1 --2- 172.21.15.26:0/3779971852 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb45809a3b0 0x7fb458119b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:19.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.262+0000 7fb456ffd700 1 -- 172.21.15.26:0/3779971852 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c009550 con 0x7fb458099a40 2023-10-01T07:58:19.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.262+0000 7fb456ffd700 1 --2- 172.21.15.26:0/3779971852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb458099a40 0x7fb4581195e0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fb44800e9b0 tx=0x7fb44800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:19.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.262+0000 7fb43f7fe700 1 -- 172.21.15.26:0/3779971852 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb448009710 con 0x7fb458099a40 2023-10-01T07:58:19.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.262+0000 7fb43f7fe700 1 -- 172.21.15.26:0/3779971852 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44800c850 con 0x7fb458099a40 2023-10-01T07:58:19.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.262+0000 7fb45d64c700 1 -- 172.21.15.26:0/3779971852 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb45811b160 con 0x7fb458099a40 2023-10-01T07:58:19.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.262+0000 7fb43f7fe700 1 -- 172.21.15.26:0/3779971852 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44800cbe0 con 0x7fb458099a40 2023-10-01T07:58:19.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.262+0000 7fb45d64c700 1 -- 172.21.15.26:0/3779971852 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb45811d570 con 0x7fb458099a40 2023-10-01T07:58:19.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.263+0000 7fb43f7fe700 1 -- 172.21.15.26:0/3779971852 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb44800cd40 con 0x7fb458099a40 2023-10-01T07:58:19.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.263+0000 7fb43f7fe700 1 -- 172.21.15.26:0/3779971852 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb44803f930 con 0x7fb458099a40 2023-10-01T07:58:19.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.263+0000 7fb45d64c700 1 -- 172.21.15.26:0/3779971852 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb458074ea0 con 0x7fb458099a40 2023-10-01T07:58:19.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.273+0000 7fb43f7fe700 1 -- 172.21.15.26:0/3779971852 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb448017020 con 0x7fb458099a40 2023-10-01T07:58:19.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.290+0000 7f1269112700 1 Processor -- start 2023-10-01T07:58:19.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.290+0000 7f1269112700 1 -- start start 2023-10-01T07:58:19.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.291+0000 7f1269112700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f12640954c0 0x7f1264095890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:19.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.291+0000 7f1269112700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f126409a1f0 0x7f12641385a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:19.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.291+0000 7f1269112700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f126409c280 con 0x7f1264099680 2023-10-01T07:58:19.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.291+0000 7f1269112700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f126409aaf0 con 0x7f12640954c0 2023-10-01T07:58:19.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.291+0000 7f1269112700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126409b960 con 0x7f126409a1f0 2023-10-01T07:58:19.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.291+0000 7f126259c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1264099680 0x7f1264099ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38848/0 (socket says 172.21.15.26:38848) 2023-10-01T07:58:19.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.291+0000 7f126259c700 1 -- 172.21.15.26:0/545587605 learned_addr learned my addr 172.21.15.26:0/545587605 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:19.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.291+0000 7f1262d9d700 1 --2- 172.21.15.26:0/545587605 >> v2:172.21.15.26:3300/0 conn(0x7f12640954c0 0x7f1264095890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:19.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.291+0000 7f126359e700 1 --2- 172.21.15.26:0/545587605 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f126409a1f0 0x7f12641385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:19.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.291+0000 7f1262d9d700 1 -- 172.21.15.26:0/545587605 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f126409a1f0 msgr2=0x7f12641385a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:19.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.291+0000 7f1262d9d700 1 --2- 172.21.15.26:0/545587605 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f126409a1f0 0x7f12641385a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:19.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.291+0000 7f1262d9d700 1 -- 172.21.15.26:0/545587605 >> v1:172.21.15.26:6789/0 conn(0x7f1264099680 legacy=0x7f1264099ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:19.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.291+0000 7f1262d9d700 1 -- 172.21.15.26:0/545587605 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126409a7b0 con 0x7f12640954c0 2023-10-01T07:58:19.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.291+0000 7f126359e700 1 --2- 172.21.15.26:0/545587605 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f126409a1f0 0x7f12641385a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:19.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.292+0000 7f1262d9d700 1 --2- 172.21.15.26:0/545587605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12640954c0 0x7f1264095890 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f1254009840 tx=0x7f1254009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b51237d1a9d71dfb server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:19.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.292+0000 7f1261d9b700 1 -- 172.21.15.26:0/545587605 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1254011830 con 0x7f12640954c0 2023-10-01T07:58:19.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.292+0000 7f1261d9b700 1 -- 172.21.15.26:0/545587605 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1254011990 con 0x7f12640954c0 2023-10-01T07:58:19.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.292+0000 7f1261d9b700 1 -- 172.21.15.26:0/545587605 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1254011d20 con 0x7f12640954c0 2023-10-01T07:58:19.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.292+0000 7f1269112700 1 -- 172.21.15.26:0/545587605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12640954c0 msgr2=0x7f1264095890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:19.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.292+0000 7f1269112700 1 --2- 172.21.15.26:0/545587605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12640954c0 0x7f1264095890 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f1254009840 tx=0x7f1254009b50 comp rx=0 tx=0).stop 2023-10-01T07:58:19.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.293+0000 7f1269112700 1 -- 172.21.15.26:0/545587605 shutdown_connections 2023-10-01T07:58:19.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.293+0000 7f1269112700 1 --2- 172.21.15.26:0/545587605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12640954c0 0x7f1264095890 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:19.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.293+0000 7f1269112700 1 --2- 172.21.15.26:0/545587605 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f126409a1f0 0x7f12641385a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:19.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.293+0000 7f1269112700 1 -- 172.21.15.26:0/545587605 >> 172.21.15.26:0/545587605 conn(0x7f12640a2360 msgr2=0x7f12640a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:19.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.293+0000 7f1269112700 1 -- 172.21.15.26:0/545587605 shutdown_connections 2023-10-01T07:58:19.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.293+0000 7f1269112700 1 -- 172.21.15.26:0/545587605 wait complete. 2023-10-01T07:58:19.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.294+0000 7f1269112700 1 Processor -- start 2023-10-01T07:58:19.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.294+0000 7f1269112700 1 -- start start 2023-10-01T07:58:19.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.295+0000 7f1269112700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12640954c0 0x7f126408d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:19.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.295+0000 7f1269112700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1264099680 0x7f126408d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:19.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.295+0000 7f1269112700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f126409a1f0 0x7f126408dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:19.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.295+0000 7f1269112700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1264094e90 con 0x7f12640954c0 2023-10-01T07:58:19.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.295+0000 7f1269112700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126409f9c0 con 0x7f126409a1f0 2023-10-01T07:58:19.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.295+0000 7f1269112700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f126408f610 con 0x7f1264099680 2023-10-01T07:58:19.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.295+0000 7f126259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1264099680 0x7f126408d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:19.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.295+0000 7f126259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1264099680 0x7f126408d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59572/0 (socket says 172.21.15.26:59572) 2023-10-01T07:58:19.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.295+0000 7f126259c700 1 -- 172.21.15.26:0/3185076913 learned_addr learned my addr 172.21.15.26:0/3185076913 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:19.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.295+0000 7f1262d9d700 1 --2- 172.21.15.26:0/3185076913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12640954c0 0x7f126408d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:19.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.295+0000 7f126359e700 1 --2- 172.21.15.26:0/3185076913 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f126409a1f0 0x7f126408dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:19.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.295+0000 7f126259c700 1 -- 172.21.15.26:0/3185076913 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f126409a1f0 msgr2=0x7f126408dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:19.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.295+0000 7f126259c700 1 --2- 172.21.15.26:0/3185076913 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f126409a1f0 0x7f126408dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:19.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.295+0000 7f126259c700 1 -- 172.21.15.26:0/3185076913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12640954c0 msgr2=0x7f126408d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:19.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.295+0000 7f126259c700 1 --2- 172.21.15.26:0/3185076913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12640954c0 0x7f126408d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:19.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.295+0000 7f126259c700 1 -- 172.21.15.26:0/3185076913 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125c00bc80 con 0x7f1264099680 2023-10-01T07:58:19.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.296+0000 7f126259c700 1 --2- 172.21.15.26:0/3185076913 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1264099680 0x7f126408d720 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f125800c520 tx=0x7f125800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:19.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.296+0000 7f124b7fe700 1 -- 172.21.15.26:0/3185076913 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1258005d70 con 0x7f1264099680 2023-10-01T07:58:19.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.296+0000 7f124b7fe700 1 -- 172.21.15.26:0/3185076913 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12580070d0 con 0x7f1264099680 2023-10-01T07:58:19.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.296+0000 7f124b7fe700 1 -- 172.21.15.26:0/3185076913 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1258007440 con 0x7f1264099680 2023-10-01T07:58:19.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.296+0000 7f1269112700 1 -- 172.21.15.26:0/3185076913 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12540094a0 con 0x7f1264099680 2023-10-01T07:58:19.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.296+0000 7f1269112700 1 -- 172.21.15.26:0/3185076913 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1264090cc0 con 0x7f1264099680 2023-10-01T07:58:19.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.297+0000 7f1269112700 1 -- 172.21.15.26:0/3185076913 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1264074ea0 con 0x7f1264099680 2023-10-01T07:58:19.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.297+0000 7f124b7fe700 1 -- 172.21.15.26:0/3185076913 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f12580075a0 con 0x7f1264099680 2023-10-01T07:58:19.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.297+0000 7f124b7fe700 1 -- 172.21.15.26:0/3185076913 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1258010300 con 0x7f1264099680 2023-10-01T07:58:19.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.302+0000 7f124b7fe700 1 -- 172.21.15.26:0/3185076913 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1258044060 con 0x7f1264099680 2023-10-01T07:58:19.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.366+0000 7fee8291a700 1 Processor -- start 2023-10-01T07:58:19.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.366+0000 7fee8291a700 1 -- start start 2023-10-01T07:58:19.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.367+0000 7fee8291a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee7c06a770 0x7fee7c09d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:19.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.367+0000 7fee8291a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee7c13d1f0 0x7fee7c13f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:19.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.367+0000 7fee8291a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee7c09a810 con 0x7fee7c09dc30 2023-10-01T07:58:19.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.367+0000 7fee8291a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c06ab40 con 0x7fee7c06a770 2023-10-01T07:58:19.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.367+0000 7fee8291a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c09ebc0 con 0x7fee7c13d1f0 2023-10-01T07:58:19.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.367+0000 7fee7bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee7c06a770 0x7fee7c09d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:19.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.367+0000 7fee7bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee7c06a770 0x7fee7c09d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43382/0 (socket says 172.21.15.26:43382) 2023-10-01T07:58:19.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.367+0000 7fee7bfff700 1 -- 172.21.15.26:0/1265731408 learned_addr learned my addr 172.21.15.26:0/1265731408 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:19.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.367+0000 7fee80eb7700 1 --2- 172.21.15.26:0/1265731408 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee7c13d1f0 0x7fee7c13f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:19.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.368+0000 7fee7bfff700 1 -- 172.21.15.26:0/1265731408 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee7c13d1f0 msgr2=0x7fee7c13f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:19.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.368+0000 7fee7bfff700 1 --2- 172.21.15.26:0/1265731408 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee7c13d1f0 0x7fee7c13f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:19.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.368+0000 7fee7bfff700 1 -- 172.21.15.26:0/1265731408 >> v1:172.21.15.26:6789/0 conn(0x7fee7c09dc30 legacy=0x7fee7c09e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:19.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.368+0000 7fee7affd700 1 -- 172.21.15.26:0/1265731408 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 379000908 0 0) 0x7fee7c09a810 con 0x7fee7c09dc30 2023-10-01T07:58:19.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.368+0000 7fee7bfff700 1 -- 172.21.15.26:0/1265731408 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7c09e920 con 0x7fee7c06a770 2023-10-01T07:58:19.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.368+0000 7fee80eb7700 1 --2- 172.21.15.26:0/1265731408 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee7c13d1f0 0x7fee7c13f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:19.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.368+0000 7fee7bfff700 1 --2- 172.21.15.26:0/1265731408 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee7c06a770 0x7fee7c09d6f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fee6c009920 tx=0x7fee6c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=faf9d37b637327c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:19.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.368+0000 7fee7affd700 1 -- 172.21.15.26:0/1265731408 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c011830 con 0x7fee7c06a770 2023-10-01T07:58:19.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.368+0000 7fee7affd700 1 -- 172.21.15.26:0/1265731408 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6c011990 con 0x7fee7c06a770 2023-10-01T07:58:19.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.368+0000 7fee7affd700 1 -- 172.21.15.26:0/1265731408 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c011d20 con 0x7fee7c06a770 2023-10-01T07:58:19.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.369+0000 7fee8291a700 1 -- 172.21.15.26:0/1265731408 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee7c06a770 msgr2=0x7fee7c09d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:19.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.369+0000 7fee8291a700 1 --2- 172.21.15.26:0/1265731408 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee7c06a770 0x7fee7c09d6f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fee6c009920 tx=0x7fee6c009c30 comp rx=0 tx=0).stop 2023-10-01T07:58:19.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.369+0000 7fee8291a700 1 -- 172.21.15.26:0/1265731408 shutdown_connections 2023-10-01T07:58:19.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.369+0000 7fee8291a700 1 --2- 172.21.15.26:0/1265731408 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee7c13d1f0 0x7fee7c13f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:19.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.369+0000 7fee8291a700 1 --2- 172.21.15.26:0/1265731408 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee7c06a770 0x7fee7c09d6f0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:19.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.369+0000 7fee8291a700 1 -- 172.21.15.26:0/1265731408 >> 172.21.15.26:0/1265731408 conn(0x7fee7c066f50 msgr2=0x7fee7c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:19.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.369+0000 7fee8291a700 1 -- 172.21.15.26:0/1265731408 shutdown_connections 2023-10-01T07:58:19.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.369+0000 7fee8291a700 1 -- 172.21.15.26:0/1265731408 wait complete. 2023-10-01T07:58:19.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.371+0000 7fee8291a700 1 Processor -- start 2023-10-01T07:58:19.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.371+0000 7fee8291a700 1 -- start start 2023-10-01T07:58:19.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.372+0000 7fee8291a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee7c06a770 0x7fee7c11bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:19.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.372+0000 7fee8291a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee7c09dc30 0x7fee7c13b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:19.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.372+0000 7fee8291a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee7c13d1f0 0x7fee7c13bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:19.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.372+0000 7fee8291a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c11ecb0 con 0x7fee7c13d1f0 2023-10-01T07:58:19.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.372+0000 7fee8291a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c11dbf0 con 0x7fee7c06a770 2023-10-01T07:58:19.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.372+0000 7fee8291a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c11ee90 con 0x7fee7c09dc30 2023-10-01T07:58:19.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.372+0000 7fee7bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee7c06a770 0x7fee7c11bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:19.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.372+0000 7fee7bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee7c06a770 0x7fee7c11bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43388/0 (socket says 172.21.15.26:43388) 2023-10-01T07:58:19.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.372+0000 7fee7bfff700 1 -- 172.21.15.26:0/91385135 learned_addr learned my addr 172.21.15.26:0/91385135 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:19.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.372+0000 7fee80eb7700 1 --2- 172.21.15.26:0/91385135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee7c13d1f0 0x7fee7c13bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:19.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.372+0000 7fee7bfff700 1 -- 172.21.15.26:0/91385135 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee7c09dc30 msgr2=0x7fee7c13b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:19.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.372+0000 7fee7bfff700 1 --2- 172.21.15.26:0/91385135 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee7c09dc30 0x7fee7c13b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:19.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.372+0000 7fee7bfff700 1 -- 172.21.15.26:0/91385135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee7c13d1f0 msgr2=0x7fee7c13bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:19.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.372+0000 7fee7bfff700 1 --2- 172.21.15.26:0/91385135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee7c13d1f0 0x7fee7c13bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:19.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.372+0000 7fee7bfff700 1 -- 172.21.15.26:0/91385135 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee74009a70 con 0x7fee7c06a770 2023-10-01T07:58:19.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.373+0000 7fee7bfff700 1 --2- 172.21.15.26:0/91385135 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee7c06a770 0x7fee7c11bfa0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fee6c0098f0 tx=0x7fee6c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:19.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.373+0000 7fee78ff9700 1 -- 172.21.15.26:0/91385135 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c004450 con 0x7fee7c06a770 2023-10-01T07:58:19.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.373+0000 7fee78ff9700 1 -- 172.21.15.26:0/91385135 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6c0045b0 con 0x7fee7c06a770 2023-10-01T07:58:19.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.373+0000 7fee8291a700 1 -- 172.21.15.26:0/91385135 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee6c009550 con 0x7fee7c06a770 2023-10-01T07:58:19.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.373+0000 7fee78ff9700 1 -- 172.21.15.26:0/91385135 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c0038c0 con 0x7fee7c06a770 2023-10-01T07:58:19.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.373+0000 7fee8291a700 1 -- 172.21.15.26:0/91385135 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee7c11e260 con 0x7fee7c06a770 2023-10-01T07:58:19.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.374+0000 7fee78ff9700 1 -- 172.21.15.26:0/91385135 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fee6c003a20 con 0x7fee7c06a770 2023-10-01T07:58:19.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.374+0000 7fee78ff9700 1 -- 172.21.15.26:0/91385135 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fee6c021030 con 0x7fee7c06a770 2023-10-01T07:58:19.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.374+0000 7fee8291a700 1 -- 172.21.15.26:0/91385135 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee7c074ea0 con 0x7fee7c06a770 2023-10-01T07:58:19.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.380+0000 7fee78ff9700 1 -- 172.21.15.26:0/91385135 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fee6c015070 con 0x7fee7c06a770 2023-10-01T07:58:19.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.398+0000 7f056e3af700 1 Processor -- start 2023-10-01T07:58:19.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.398+0000 7f056e3af700 1 -- start start 2023-10-01T07:58:19.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.399+0000 7f056e3af700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f056809f410 0x7f0568136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:19.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.399+0000 7f056e3af700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0568136fe0 0x7f05681393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:19.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.399+0000 7f056e3af700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0568070940 con 0x7f056809e930 2023-10-01T07:58:19.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.399+0000 7f056e3af700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f056806fd60 con 0x7f0568136fe0 2023-10-01T07:58:19.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.399+0000 7f056e3af700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056806fa80 con 0x7f056809f410 2023-10-01T07:58:19.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.399+0000 7f0567fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f056809e930 0x7f056809ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38856/0 (socket says 172.21.15.26:38856) 2023-10-01T07:58:19.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.399+0000 7f0567fff700 1 -- 172.21.15.26:0/3023997666 learned_addr learned my addr 172.21.15.26:0/3023997666 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:19.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.399+0000 7f05677fe700 1 --2- 172.21.15.26:0/3023997666 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f056809f410 0x7f0568136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:19.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.399+0000 7f056c94c700 1 --2- 172.21.15.26:0/3023997666 >> v2:172.21.15.26:3300/0 conn(0x7f0568136fe0 0x7f05681393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:19.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.399+0000 7f056c94c700 1 -- 172.21.15.26:0/3023997666 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f056809f410 msgr2=0x7f0568136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:19.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.399+0000 7f056c94c700 1 --2- 172.21.15.26:0/3023997666 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f056809f410 0x7f0568136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:19.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.399+0000 7f056c94c700 1 -- 172.21.15.26:0/3023997666 >> v1:172.21.15.26:6789/0 conn(0x7f056809e930 legacy=0x7f056809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:19.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.399+0000 7f056c94c700 1 -- 172.21.15.26:0/3023997666 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056809fb60 con 0x7f0568136fe0 2023-10-01T07:58:19.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.400+0000 7f056c94c700 1 --2- 172.21.15.26:0/3023997666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0568136fe0 0x7f05681393c0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f056000f370 tx=0x7f056000f680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a44fa6c3415eb319 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:19.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.401+0000 7f0566ffd700 1 -- 172.21.15.26:0/3023997666 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0560012070 con 0x7f0568136fe0 2023-10-01T07:58:19.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.401+0000 7f0566ffd700 1 -- 172.21.15.26:0/3023997666 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056000fe70 con 0x7f0568136fe0 2023-10-01T07:58:19.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.401+0000 7f0566ffd700 1 -- 172.21.15.26:0/3023997666 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056000d2f0 con 0x7f0568136fe0 2023-10-01T07:58:19.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.402+0000 7f056e3af700 1 -- 172.21.15.26:0/3023997666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0568136fe0 msgr2=0x7f05681393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:19.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.402+0000 7f056e3af700 1 --2- 172.21.15.26:0/3023997666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0568136fe0 0x7f05681393c0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f056000f370 tx=0x7f056000f680 comp rx=0 tx=0).stop 2023-10-01T07:58:19.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.402+0000 7f056e3af700 1 -- 172.21.15.26:0/3023997666 shutdown_connections 2023-10-01T07:58:19.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.402+0000 7f056e3af700 1 --2- 172.21.15.26:0/3023997666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0568136fe0 0x7f05681393c0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:19.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.402+0000 7f056e3af700 1 --2- 172.21.15.26:0/3023997666 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f056809f410 0x7f0568136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:19.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.402+0000 7f056e3af700 1 -- 172.21.15.26:0/3023997666 >> 172.21.15.26:0/3023997666 conn(0x7f05680a4210 msgr2=0x7f05680a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:19.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.402+0000 7f056e3af700 1 -- 172.21.15.26:0/3023997666 shutdown_connections 2023-10-01T07:58:19.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.402+0000 7f056e3af700 1 -- 172.21.15.26:0/3023997666 wait complete. 2023-10-01T07:58:19.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.403+0000 7f056e3af700 1 Processor -- start 2023-10-01T07:58:19.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.404+0000 7f056e3af700 1 -- start start 2023-10-01T07:58:19.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.404+0000 7f056e3af700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f056809e930 0x7f056811b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:19.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.404+0000 7f056e3af700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f056809f410 0x7f056811b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:19.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.405+0000 7f056e3af700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0568136fe0 0x7f056811bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:19.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.405+0000 7f056e3af700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056811efc0 con 0x7f0568136fe0 2023-10-01T07:58:19.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.405+0000 7f056e3af700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056811e390 con 0x7f056809f410 2023-10-01T07:58:19.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.405+0000 7f056e3af700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0568071d20 con 0x7f056809e930 2023-10-01T07:58:19.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.405+0000 7f056c94c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0568136fe0 0x7f056811bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:19.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.405+0000 7f056c94c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0568136fe0 0x7f056811bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39278/0 (socket says 172.21.15.26:39278) 2023-10-01T07:58:19.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.405+0000 7f056c94c700 1 -- 172.21.15.26:0/1530161963 learned_addr learned my addr 172.21.15.26:0/1530161963 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:19.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.405+0000 7f05677fe700 1 --2- 172.21.15.26:0/1530161963 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f056809f410 0x7f056811b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:19.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.405+0000 7f056c94c700 1 -- 172.21.15.26:0/1530161963 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f056809e930 msgr2=0x7f056811b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:19.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.405+0000 7f056c94c700 1 --2- 172.21.15.26:0/1530161963 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f056809e930 0x7f056811b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:19.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.405+0000 7f056c94c700 1 -- 172.21.15.26:0/1530161963 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f056809f410 msgr2=0x7f056811b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:19.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.405+0000 7f056c94c700 1 --2- 172.21.15.26:0/1530161963 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f056809f410 0x7f056811b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:19.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.405+0000 7f056c94c700 1 -- 172.21.15.26:0/1530161963 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056000f050 con 0x7f0568136fe0 2023-10-01T07:58:19.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.405+0000 7f05677fe700 1 --2- 172.21.15.26:0/1530161963 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f056809f410 0x7f056811b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:58:19.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.406+0000 7f056c94c700 1 --2- 172.21.15.26:0/1530161963 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0568136fe0 0x7f056811bf20 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f0560016000 tx=0x7f0560004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:19.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.406+0000 7f0564ff9700 1 -- 172.21.15.26:0/1530161963 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056000bb50 con 0x7f0568136fe0 2023-10-01T07:58:19.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.406+0000 7f0564ff9700 1 -- 172.21.15.26:0/1530161963 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056000bcd0 con 0x7f0568136fe0 2023-10-01T07:58:19.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.406+0000 7f056e3af700 1 -- 172.21.15.26:0/1530161963 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f056811e750 con 0x7f0568136fe0 2023-10-01T07:58:19.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.406+0000 7f0564ff9700 1 -- 172.21.15.26:0/1530161963 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0560004280 con 0x7f0568136fe0 2023-10-01T07:58:19.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.406+0000 7f056e3af700 1 -- 172.21.15.26:0/1530161963 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f056811d8b0 con 0x7f0568136fe0 2023-10-01T07:58:19.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.408+0000 7f054e7fc700 1 -- 172.21.15.26:0/1530161963 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05400052e0 con 0x7f0568136fe0 2023-10-01T07:58:19.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.408+0000 7f0564ff9700 1 -- 172.21.15.26:0/1530161963 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f05600043e0 con 0x7f0568136fe0 2023-10-01T07:58:19.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.409+0000 7f0564ff9700 1 -- 172.21.15.26:0/1530161963 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f05600451f0 con 0x7f0568136fe0 2023-10-01T07:58:19.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.418+0000 7f0564ff9700 1 -- 172.21.15.26:0/1530161963 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0560027930 con 0x7f0568136fe0 2023-10-01T07:58:19.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.528+0000 7f1269112700 1 -- 172.21.15.26:0/3185076913 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1264095e60 con 0x7f1264099680 2023-10-01T07:58:19.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.529+0000 7f124b7fe700 1 -- 172.21.15.26:0/3185076913 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1258017020 con 0x7f1264099680 2023-10-01T07:58:19.529 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:19.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.532+0000 7f1269112700 1 -- 172.21.15.26:0/3185076913 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1264099680 msgr2=0x7f126408d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:19.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.532+0000 7f1269112700 1 --2- 172.21.15.26:0/3185076913 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1264099680 0x7f126408d720 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f125800c520 tx=0x7f125800c830 comp rx=0 tx=0).stop 2023-10-01T07:58:19.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.532+0000 7f1269112700 1 -- 172.21.15.26:0/3185076913 shutdown_connections 2023-10-01T07:58:19.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.532+0000 7f1269112700 1 --2- 172.21.15.26:0/3185076913 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f126409a1f0 0x7f126408dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:19.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.532+0000 7f1269112700 1 --2- 172.21.15.26:0/3185076913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12640954c0 0x7f126408d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:19.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.532+0000 7f1269112700 1 --2- 172.21.15.26:0/3185076913 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1264099680 0x7f126408d720 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:19.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.532+0000 7f1269112700 1 -- 172.21.15.26:0/3185076913 >> 172.21.15.26:0/3185076913 conn(0x7f12640a2360 msgr2=0x7f12640a0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:19.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.533+0000 7f1269112700 1 -- 172.21.15.26:0/3185076913 shutdown_connections 2023-10-01T07:58:19.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.533+0000 7f1269112700 1 -- 172.21.15.26:0/3185076913 wait complete. 2023-10-01T07:58:19.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.535+0000 7fb45d64c700 1 -- 172.21.15.26:0/3779971852 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb45811ca30 con 0x7fb458099a40 2023-10-01T07:58:19.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.535+0000 7fb43f7fe700 1 -- 172.21.15.26:0/3779971852 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb45811ca30 con 0x7fb458099a40 2023-10-01T07:58:19.536 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:19.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.538+0000 7fb45d64c700 1 -- 172.21.15.26:0/3779971852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb458099a40 msgr2=0x7fb4581195e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:19.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.538+0000 7fb45d64c700 1 --2- 172.21.15.26:0/3779971852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb458099a40 0x7fb4581195e0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fb44800e9b0 tx=0x7fb44800ed70 comp rx=0 tx=0).stop 2023-10-01T07:58:19.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.538+0000 7fb45d64c700 1 -- 172.21.15.26:0/3779971852 shutdown_connections 2023-10-01T07:58:19.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.538+0000 7fb45d64c700 1 --2- 172.21.15.26:0/3779971852 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb458131810 0x7fb45811a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:19.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.538+0000 7fb45d64c700 1 --2- 172.21.15.26:0/3779971852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb458099a40 0x7fb4581195e0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:19.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.538+0000 7fb45d64c700 1 --2- 172.21.15.26:0/3779971852 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb45809a3b0 0x7fb458119b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:19.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.538+0000 7fb45d64c700 1 -- 172.21.15.26:0/3779971852 >> 172.21.15.26:0/3779971852 conn(0x7fb4580a2aa0 msgr2=0x7fb45812e440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:19.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.538+0000 7fb45d64c700 1 -- 172.21.15.26:0/3779971852 shutdown_connections 2023-10-01T07:58:19.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.538+0000 7fb45d64c700 1 -- 172.21.15.26:0/3779971852 wait complete. 2023-10-01T07:58:19.553 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:19.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:19.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.599+0000 7fee8291a700 1 -- 172.21.15.26:0/91385135 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fee7c09a3d0 con 0x7fee7c06a770 2023-10-01T07:58:19.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.599+0000 7fee78ff9700 1 -- 172.21.15.26:0/91385135 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fee6c03d090 con 0x7fee7c06a770 2023-10-01T07:58:19.600 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:19.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.601+0000 7fee8291a700 1 -- 172.21.15.26:0/91385135 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee7c06a770 msgr2=0x7fee7c11bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:19.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.601+0000 7fee8291a700 1 --2- 172.21.15.26:0/91385135 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee7c06a770 0x7fee7c11bfa0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fee6c0098f0 tx=0x7fee6c004750 comp rx=0 tx=0).stop 2023-10-01T07:58:19.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.602+0000 7fee8291a700 1 -- 172.21.15.26:0/91385135 shutdown_connections 2023-10-01T07:58:19.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.602+0000 7fee8291a700 1 --2- 172.21.15.26:0/91385135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee7c13d1f0 0x7fee7c13bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:19.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.602+0000 7fee8291a700 1 --2- 172.21.15.26:0/91385135 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee7c06a770 0x7fee7c11bfa0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:19.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.602+0000 7fee8291a700 1 --2- 172.21.15.26:0/91385135 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee7c09dc30 0x7fee7c13b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:19.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.602+0000 7fee8291a700 1 -- 172.21.15.26:0/91385135 >> 172.21.15.26:0/91385135 conn(0x7fee7c066f50 msgr2=0x7fee7c0a2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:19.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.602+0000 7fee8291a700 1 -- 172.21.15.26:0/91385135 shutdown_connections 2023-10-01T07:58:19.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.602+0000 7fee8291a700 1 -- 172.21.15.26:0/91385135 wait complete. 2023-10-01T07:58:19.616 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:19.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.637+0000 7f054e7fc700 1 -- 172.21.15.26:0/1530161963 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0540005590 con 0x7f0568136fe0 2023-10-01T07:58:19.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.637+0000 7f0564ff9700 1 -- 172.21.15.26:0/1530161963 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0560027360 con 0x7f0568136fe0 2023-10-01T07:58:19.638 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:19.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.639+0000 7f054e7fc700 1 -- 172.21.15.26:0/1530161963 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0568136fe0 msgr2=0x7f056811bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:19.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.639+0000 7f054e7fc700 1 --2- 172.21.15.26:0/1530161963 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0568136fe0 0x7f056811bf20 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f0560016000 tx=0x7f0560004ad0 comp rx=0 tx=0).stop 2023-10-01T07:58:19.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.639+0000 7f054e7fc700 1 -- 172.21.15.26:0/1530161963 shutdown_connections 2023-10-01T07:58:19.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.639+0000 7f054e7fc700 1 --2- 172.21.15.26:0/1530161963 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0568136fe0 0x7f056811bf20 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:19.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.639+0000 7f054e7fc700 1 --2- 172.21.15.26:0/1530161963 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f056809e930 0x7f056811b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:19.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.639+0000 7f054e7fc700 1 --2- 172.21.15.26:0/1530161963 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f056809f410 0x7f056811b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:19.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.639+0000 7f054e7fc700 1 -- 172.21.15.26:0/1530161963 >> 172.21.15.26:0/1530161963 conn(0x7f05680a4210 msgr2=0x7f05680a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:19.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.639+0000 7f054e7fc700 1 -- 172.21.15.26:0/1530161963 shutdown_connections 2023-10-01T07:58:19.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:19.639+0000 7f054e7fc700 1 -- 172.21.15.26:0/1530161963 wait complete. 2023-10-01T07:58:19.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:20.554 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:20.555 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:20.617 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:20.655 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:20.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.706+0000 7f83f5bd1700 1 Processor -- start 2023-10-01T07:58:20.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.706+0000 7f83f5bd1700 1 -- start start 2023-10-01T07:58:20.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.707+0000 7f83f5bd1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f83f006c0e0 0x7f83f009ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:20.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.707+0000 7f83f5bd1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f83f01380f0 0x7f83f013fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:20.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.707+0000 7f83f5bd1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f0134980 con 0x7f83f0134ec0 2023-10-01T07:58:20.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.707+0000 7f83f5bd1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f006c4b0 con 0x7f83f01380f0 2023-10-01T07:58:20.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.707+0000 7f83f5bd1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83f00a09c0 con 0x7f83f006c0e0 2023-10-01T07:58:20.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.707+0000 7f83effff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f83f01380f0 0x7f83f013fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:20.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.707+0000 7f83effff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f83f01380f0 0x7f83f013fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43424/0 (socket says 172.21.15.26:43424) 2023-10-01T07:58:20.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.707+0000 7f83effff700 1 -- 172.21.15.26:0/2515287024 learned_addr learned my addr 172.21.15.26:0/2515287024 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:20.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.707+0000 7f83ef7fe700 1 --2- 172.21.15.26:0/2515287024 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f83f006c0e0 0x7f83f009ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:20.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.707+0000 7f83effff700 1 -- 172.21.15.26:0/2515287024 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f83f006c0e0 msgr2=0x7f83f009ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:20.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.707+0000 7f83effff700 1 --2- 172.21.15.26:0/2515287024 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f83f006c0e0 0x7f83f009ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:20.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.707+0000 7f83effff700 1 -- 172.21.15.26:0/2515287024 >> v1:172.21.15.26:6789/0 conn(0x7f83f0134ec0 legacy=0x7f83f01379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:20.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.707+0000 7f83effff700 1 -- 172.21.15.26:0/2515287024 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f00a0600 con 0x7f83f01380f0 2023-10-01T07:58:20.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.708+0000 7f83effff700 1 --2- 172.21.15.26:0/2515287024 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f83f01380f0 0x7f83f013fd20 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f83e8009e80 tx=0x7f83e800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=771f92f497555a9c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:20.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.708+0000 7f83ee7fc700 1 -- 172.21.15.26:0/2515287024 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e800e070 con 0x7f83f01380f0 2023-10-01T07:58:20.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.708+0000 7f83ee7fc700 1 -- 172.21.15.26:0/2515287024 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e800b910 con 0x7f83f01380f0 2023-10-01T07:58:20.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.708+0000 7f83ee7fc700 1 -- 172.21.15.26:0/2515287024 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e800bcc0 con 0x7f83f01380f0 2023-10-01T07:58:20.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.709+0000 7f83f5bd1700 1 -- 172.21.15.26:0/2515287024 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f83f01380f0 msgr2=0x7f83f013fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:20.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.709+0000 7f83f5bd1700 1 --2- 172.21.15.26:0/2515287024 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f83f01380f0 0x7f83f013fd20 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f83e8009e80 tx=0x7f83e800b330 comp rx=0 tx=0).stop 2023-10-01T07:58:20.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.709+0000 7f83f5bd1700 1 -- 172.21.15.26:0/2515287024 shutdown_connections 2023-10-01T07:58:20.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.709+0000 7f83f5bd1700 1 --2- 172.21.15.26:0/2515287024 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f83f006c0e0 0x7f83f009ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:20.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.709+0000 7f83f5bd1700 1 --2- 172.21.15.26:0/2515287024 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f83f01380f0 0x7f83f013fd20 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:20.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.709+0000 7f83f5bd1700 1 -- 172.21.15.26:0/2515287024 >> 172.21.15.26:0/2515287024 conn(0x7f83f00a4210 msgr2=0x7f83f00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:20.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.709+0000 7f83f5bd1700 1 -- 172.21.15.26:0/2515287024 shutdown_connections 2023-10-01T07:58:20.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.709+0000 7f83f5bd1700 1 -- 172.21.15.26:0/2515287024 wait complete. 2023-10-01T07:58:20.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.710+0000 7f83f5bd1700 1 Processor -- start 2023-10-01T07:58:20.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.710+0000 7f83f5bd1700 1 -- start start 2023-10-01T07:58:20.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.711+0000 7f83f5bd1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f83f006c0e0 0x7f83f011a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:20.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.711+0000 7f83f5bd1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83f0134ec0 0x7f83f011ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:20.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.711+0000 7f83f5bd1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f83f01380f0 0x7f83f011b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:20.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.711+0000 7f83f5bd1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f011e1d0 con 0x7f83f0134ec0 2023-10-01T07:58:20.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.711+0000 7f83f5bd1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f00a3c10 con 0x7f83f01380f0 2023-10-01T07:58:20.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.711+0000 7f83f5bd1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83f00a03f0 con 0x7f83f006c0e0 2023-10-01T07:58:20.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.711+0000 7f83eeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83f0134ec0 0x7f83f011ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:20.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.711+0000 7f83eeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83f0134ec0 0x7f83f011ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39288/0 (socket says 172.21.15.26:39288) 2023-10-01T07:58:20.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.711+0000 7f83eeffd700 1 -- 172.21.15.26:0/20663319 learned_addr learned my addr 172.21.15.26:0/20663319 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:20.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.711+0000 7f83ef7fe700 1 --2- 172.21.15.26:0/20663319 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f83f006c0e0 0x7f83f011a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:20.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.711+0000 7f83effff700 1 --2- 172.21.15.26:0/20663319 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f83f01380f0 0x7f83f011b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:20.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.711+0000 7f83eeffd700 1 -- 172.21.15.26:0/20663319 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f83f006c0e0 msgr2=0x7f83f011a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:20.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.711+0000 7f83eeffd700 1 --2- 172.21.15.26:0/20663319 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f83f006c0e0 0x7f83f011a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:20.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.711+0000 7f83eeffd700 1 -- 172.21.15.26:0/20663319 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f83f01380f0 msgr2=0x7f83f011b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:20.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.711+0000 7f83eeffd700 1 --2- 172.21.15.26:0/20663319 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f83f01380f0 0x7f83f011b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:20.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.711+0000 7f83eeffd700 1 -- 172.21.15.26:0/20663319 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e8009b30 con 0x7f83f0134ec0 2023-10-01T07:58:20.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.712+0000 7f83eeffd700 1 --2- 172.21.15.26:0/20663319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83f0134ec0 0x7f83f011ae20 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f83e400c4b0 tx=0x7f83e400c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:20.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.712+0000 7f83d7fff700 1 -- 172.21.15.26:0/20663319 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e40052d0 con 0x7f83f0134ec0 2023-10-01T07:58:20.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.712+0000 7f83d7fff700 1 -- 172.21.15.26:0/20663319 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e4005430 con 0x7f83f0134ec0 2023-10-01T07:58:20.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.712+0000 7f83d7fff700 1 -- 172.21.15.26:0/20663319 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e40038a0 con 0x7f83f0134ec0 2023-10-01T07:58:20.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.712+0000 7f83f5bd1700 1 -- 172.21.15.26:0/20663319 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f011dc30 con 0x7f83f0134ec0 2023-10-01T07:58:20.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.712+0000 7f83f5bd1700 1 -- 172.21.15.26:0/20663319 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f011d890 con 0x7f83f0134ec0 2023-10-01T07:58:20.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.713+0000 7f83d7fff700 1 -- 172.21.15.26:0/20663319 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f83e4003a00 con 0x7f83f0134ec0 2023-10-01T07:58:20.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.713+0000 7f83d7fff700 1 -- 172.21.15.26:0/20663319 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f83e403ea30 con 0x7f83f0134ec0 2023-10-01T07:58:20.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.713+0000 7f83f5bd1700 1 -- 172.21.15.26:0/20663319 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83f011ddf0 con 0x7f83f0134ec0 2023-10-01T07:58:20.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.716+0000 7f707db9e700 1 Processor -- start 2023-10-01T07:58:20.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.716+0000 7f707db9e700 1 -- start start 2023-10-01T07:58:20.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.716+0000 7f707db9e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f707809d800 0x7f707809dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:20.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.716+0000 7f707db9e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f707809e110 0x7f7078133860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:20.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.716+0000 7f707db9e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7078099e10 con 0x7f7078133da0 2023-10-01T07:58:20.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.716+0000 7f707db9e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f707809f560 con 0x7f707809d800 2023-10-01T07:58:20.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.716+0000 7f707db9e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f707806b4d0 con 0x7f707809e110 2023-10-01T07:58:20.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.717+0000 7f707cb9c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f707809d800 0x7f707809dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:20.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.717+0000 7f7077fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f707809e110 0x7f7078133860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:20.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.717+0000 7f707cb9c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f707809d800 0x7f707809dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43442/0 (socket says 172.21.15.26:43442) 2023-10-01T07:58:20.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.717+0000 7f707cb9c700 1 -- 172.21.15.26:0/3103787029 learned_addr learned my addr 172.21.15.26:0/3103787029 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:20.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.717+0000 7f7077fff700 1 -- 172.21.15.26:0/3103787029 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f707809d800 msgr2=0x7f707809dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:20.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.717+0000 7f7077fff700 1 --2- 172.21.15.26:0/3103787029 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f707809d800 0x7f707809dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:20.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.717+0000 7f7077fff700 1 -- 172.21.15.26:0/3103787029 >> v1:172.21.15.26:6789/0 conn(0x7f7078133da0 legacy=0x7f707813aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:20.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.717+0000 7f7077fff700 1 -- 172.21.15.26:0/3103787029 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f707809a060 con 0x7f707809e110 2023-10-01T07:58:20.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.717+0000 7f707cb9c700 1 --2- 172.21.15.26:0/3103787029 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f707809d800 0x7f707809dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:20.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.717+0000 7f7077fff700 1 --2- 172.21.15.26:0/3103787029 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f707809e110 0x7f7078133860 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7064009850 tx=0x7f7064009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9342993ea5adaa29 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:20.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.718+0000 7f70777fe700 1 -- 172.21.15.26:0/3103787029 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7064005e30 con 0x7f707809e110 2023-10-01T07:58:20.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.718+0000 7f70777fe700 1 -- 172.21.15.26:0/3103787029 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7064006030 con 0x7f707809e110 2023-10-01T07:58:20.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.718+0000 7f70777fe700 1 -- 172.21.15.26:0/3103787029 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70640063e0 con 0x7f707809e110 2023-10-01T07:58:20.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.718+0000 7f707db9e700 1 -- 172.21.15.26:0/3103787029 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f707809e110 msgr2=0x7f7078133860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:20.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.718+0000 7f707db9e700 1 --2- 172.21.15.26:0/3103787029 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f707809e110 0x7f7078133860 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7064009850 tx=0x7f7064009b60 comp rx=0 tx=0).stop 2023-10-01T07:58:20.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.718+0000 7f707db9e700 1 -- 172.21.15.26:0/3103787029 shutdown_connections 2023-10-01T07:58:20.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.718+0000 7f707db9e700 1 --2- 172.21.15.26:0/3103787029 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f707809d800 0x7f707809dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:20.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.718+0000 7f707db9e700 1 --2- 172.21.15.26:0/3103787029 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f707809e110 0x7f7078133860 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:20.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.718+0000 7f707db9e700 1 -- 172.21.15.26:0/3103787029 >> 172.21.15.26:0/3103787029 conn(0x7f70780a2e20 msgr2=0x7f70780a3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:20.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.719+0000 7f707db9e700 1 -- 172.21.15.26:0/3103787029 shutdown_connections 2023-10-01T07:58:20.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.719+0000 7f707db9e700 1 -- 172.21.15.26:0/3103787029 wait complete. 2023-10-01T07:58:20.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.719+0000 7f83d7fff700 1 -- 172.21.15.26:0/20663319 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f83e4018260 con 0x7f83f0134ec0 2023-10-01T07:58:20.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.720+0000 7f707db9e700 1 Processor -- start 2023-10-01T07:58:20.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.720+0000 7f707db9e700 1 -- start start 2023-10-01T07:58:20.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.721+0000 7f707db9e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f707809d800 0x7f70781c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:20.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.721+0000 7f707db9e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f707809e110 0x7f70781c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:20.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.721+0000 7f707db9e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7078133da0 0x7f70781c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:20.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.721+0000 7f707db9e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7078133620 con 0x7f707809e110 2023-10-01T07:58:20.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.721+0000 7f707db9e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7078126530 con 0x7f7078133da0 2023-10-01T07:58:20.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.721+0000 7f707db9e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7078125eb0 con 0x7f707809d800 2023-10-01T07:58:20.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.721+0000 7f707d39d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7078133da0 0x7f70781c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:20.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.721+0000 7f707d39d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7078133da0 0x7f70781c8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43446/0 (socket says 172.21.15.26:43446) 2023-10-01T07:58:20.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.721+0000 7f707d39d700 1 -- 172.21.15.26:0/3352435222 learned_addr learned my addr 172.21.15.26:0/3352435222 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:20.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.721+0000 7f7077fff700 1 --2- 172.21.15.26:0/3352435222 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f707809e110 0x7f70781c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:20.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.721+0000 7f707d39d700 1 -- 172.21.15.26:0/3352435222 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f707809d800 msgr2=0x7f70781c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:20.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.721+0000 7f707d39d700 1 --2- 172.21.15.26:0/3352435222 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f707809d800 0x7f70781c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:20.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.721+0000 7f707d39d700 1 -- 172.21.15.26:0/3352435222 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f707809e110 msgr2=0x7f70781c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:20.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.721+0000 7f707d39d700 1 --2- 172.21.15.26:0/3352435222 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f707809e110 0x7f70781c86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:20.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.721+0000 7f707d39d700 1 -- 172.21.15.26:0/3352435222 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706c009550 con 0x7f7078133da0 2023-10-01T07:58:20.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.722+0000 7f707d39d700 1 --2- 172.21.15.26:0/3352435222 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7078133da0 0x7f70781c8c00 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f707000cc50 tx=0x7f707000cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:20.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.722+0000 7f70757fa700 1 -- 172.21.15.26:0/3352435222 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7070003c00 con 0x7f7078133da0 2023-10-01T07:58:20.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.722+0000 7f70757fa700 1 -- 172.21.15.26:0/3352435222 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7070003d60 con 0x7f7078133da0 2023-10-01T07:58:20.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.722+0000 7f70757fa700 1 -- 172.21.15.26:0/3352435222 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707000ab60 con 0x7f7078133da0 2023-10-01T07:58:20.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.723+0000 7f707db9e700 1 -- 172.21.15.26:0/3352435222 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7064009430 con 0x7f7078133da0 2023-10-01T07:58:20.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.723+0000 7f707db9e700 1 -- 172.21.15.26:0/3352435222 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7078126be0 con 0x7f7078133da0 2023-10-01T07:58:20.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.724+0000 7f70757fa700 1 -- 172.21.15.26:0/3352435222 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f707000acc0 con 0x7f7078133da0 2023-10-01T07:58:20.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.724+0000 7f707db9e700 1 -- 172.21.15.26:0/3352435222 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f707804f2a0 con 0x7f7078133da0 2023-10-01T07:58:20.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.724+0000 7f70757fa700 1 -- 172.21.15.26:0/3352435222 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f707003f6d0 con 0x7f7078133da0 2023-10-01T07:58:20.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.733+0000 7f70757fa700 1 -- 172.21.15.26:0/3352435222 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f70700198f0 con 0x7f7078133da0 2023-10-01T07:58:20.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.775+0000 7f7ef2330700 1 Processor -- start 2023-10-01T07:58:20.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.775+0000 7f7ef2330700 1 -- start start 2023-10-01T07:58:20.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.776+0000 7f7ef2330700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7eec0a0a30 0x7f7eec0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:20.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.776+0000 7f7ef2330700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7eec13d820 0x7f7eec13fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:20.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.776+0000 7f7ef2330700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eec09d920 con 0x7f7eec0a1340 2023-10-01T07:58:20.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.776+0000 7f7ef2330700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec09d020 con 0x7f7eec0a0a30 2023-10-01T07:58:20.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.776+0000 7f7ef2330700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec0a2010 con 0x7f7eec13d820 2023-10-01T07:58:20.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.777+0000 7f7ef08cd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7eec13d820 0x7f7eec13fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:20.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.777+0000 7f7eebfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7eec0a0a30 0x7f7eec0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:20.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.777+0000 7f7ef08cd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7eec13d820 0x7f7eec13fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59632/0 (socket says 172.21.15.26:59632) 2023-10-01T07:58:20.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.777+0000 7f7ef08cd700 1 -- 172.21.15.26:0/2277585988 learned_addr learned my addr 172.21.15.26:0/2277585988 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:20.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.777+0000 7f7ef08cd700 1 -- 172.21.15.26:0/2277585988 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7eec0a0a30 msgr2=0x7f7eec0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:20.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.777+0000 7f7ef08cd700 1 --2- 172.21.15.26:0/2277585988 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7eec0a0a30 0x7f7eec0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:20.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.777+0000 7f7ef08cd700 1 -- 172.21.15.26:0/2277585988 >> v1:172.21.15.26:6789/0 conn(0x7f7eec0a1340 legacy=0x7f7eec13c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:20.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.777+0000 7f7ef08cd700 1 -- 172.21.15.26:0/2277585988 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eec09dbe0 con 0x7f7eec13d820 2023-10-01T07:58:20.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.777+0000 7f7ef08cd700 1 --2- 172.21.15.26:0/2277585988 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7eec13d820 0x7f7eec13fc00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4009e80 tx=0x7f7ee400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3c9b3b7cf4832dc server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:20.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.777+0000 7f7eeaffd700 1 -- 172.21.15.26:0/2277585988 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee400e070 con 0x7f7eec13d820 2023-10-01T07:58:20.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.777+0000 7f7eeaffd700 1 -- 172.21.15.26:0/2277585988 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee400b910 con 0x7f7eec13d820 2023-10-01T07:58:20.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.777+0000 7f7eeaffd700 1 -- 172.21.15.26:0/2277585988 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee400bcc0 con 0x7f7eec13d820 2023-10-01T07:58:20.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.778+0000 7f7ef2330700 1 -- 172.21.15.26:0/2277585988 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7eec13d820 msgr2=0x7f7eec13fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:20.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.778+0000 7f7ef2330700 1 --2- 172.21.15.26:0/2277585988 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7eec13d820 0x7f7eec13fc00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4009e80 tx=0x7f7ee400b330 comp rx=0 tx=0).stop 2023-10-01T07:58:20.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.779+0000 7f7ef2330700 1 -- 172.21.15.26:0/2277585988 shutdown_connections 2023-10-01T07:58:20.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.779+0000 7f7ef2330700 1 --2- 172.21.15.26:0/2277585988 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7eec13d820 0x7f7eec13fc00 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:20.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.779+0000 7f7ef2330700 1 --2- 172.21.15.26:0/2277585988 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7eec0a0a30 0x7f7eec0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:20.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.779+0000 7f7ef2330700 1 -- 172.21.15.26:0/2277585988 >> 172.21.15.26:0/2277585988 conn(0x7f7eec0a6550 msgr2=0x7f7eec0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:20.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.779+0000 7f7ef2330700 1 -- 172.21.15.26:0/2277585988 shutdown_connections 2023-10-01T07:58:20.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.779+0000 7f7ef2330700 1 -- 172.21.15.26:0/2277585988 wait complete. 2023-10-01T07:58:20.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.780+0000 7f7ef2330700 1 Processor -- start 2023-10-01T07:58:20.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.780+0000 7f7ef2330700 1 -- start start 2023-10-01T07:58:20.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.781+0000 7f7ef2330700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7eec0a0a30 0x7f7eec125ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:20.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.781+0000 7f7ef2330700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7eec0a1340 0x7f7eec126220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:20.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.781+0000 7f7ef2330700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7eec13d820 0x7f7eec126760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:20.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.781+0000 7f7ef2330700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec127f50 con 0x7f7eec0a1340 2023-10-01T07:58:20.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.781+0000 7f7ef2330700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec129800 con 0x7f7eec0a0a30 2023-10-01T07:58:20.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.781+0000 7f7ef2330700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec09ff90 con 0x7f7eec13d820 2023-10-01T07:58:20.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.781+0000 7f7eebfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7eec0a0a30 0x7f7eec125ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:20.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.781+0000 7f7eebfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7eec0a0a30 0x7f7eec125ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43472/0 (socket says 172.21.15.26:43472) 2023-10-01T07:58:20.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.781+0000 7f7eebfff700 1 -- 172.21.15.26:0/1671649468 learned_addr learned my addr 172.21.15.26:0/1671649468 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:20.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.781+0000 7f7ef08cd700 1 --2- 172.21.15.26:0/1671649468 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7eec13d820 0x7f7eec126760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:20.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.781+0000 7f7eeb7fe700 1 --2- 172.21.15.26:0/1671649468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7eec0a1340 0x7f7eec126220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:20.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.782+0000 7f7ef08cd700 1 -- 172.21.15.26:0/1671649468 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7eec0a0a30 msgr2=0x7f7eec125ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:20.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.782+0000 7f7ef08cd700 1 --2- 172.21.15.26:0/1671649468 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7eec0a0a30 0x7f7eec125ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:20.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.782+0000 7f7ef08cd700 1 -- 172.21.15.26:0/1671649468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7eec0a1340 msgr2=0x7f7eec126220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:20.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.782+0000 7f7ef08cd700 1 --2- 172.21.15.26:0/1671649468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7eec0a1340 0x7f7eec126220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:20.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.782+0000 7f7ef08cd700 1 -- 172.21.15.26:0/1671649468 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee4009b30 con 0x7f7eec13d820 2023-10-01T07:58:20.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.782+0000 7f7ef08cd700 1 --2- 172.21.15.26:0/1671649468 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7eec13d820 0x7f7eec126760 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4015000 tx=0x7f7ee4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:20.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.782+0000 7f7ee8ff9700 1 -- 172.21.15.26:0/1671649468 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4004450 con 0x7f7eec13d820 2023-10-01T07:58:20.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.782+0000 7f7ee8ff9700 1 -- 172.21.15.26:0/1671649468 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee40045f0 con 0x7f7eec13d820 2023-10-01T07:58:20.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.782+0000 7f7ef2330700 1 -- 172.21.15.26:0/1671649468 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eec1278f0 con 0x7f7eec13d820 2023-10-01T07:58:20.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.782+0000 7f7ee8ff9700 1 -- 172.21.15.26:0/1671649468 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee40099b0 con 0x7f7eec13d820 2023-10-01T07:58:20.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.782+0000 7f7ef2330700 1 -- 172.21.15.26:0/1671649468 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eec1280e0 con 0x7f7eec13d820 2023-10-01T07:58:20.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.783+0000 7f7ee8ff9700 1 -- 172.21.15.26:0/1671649468 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7ee4025460 con 0x7f7eec13d820 2023-10-01T07:58:20.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.784+0000 7f7ef2330700 1 -- 172.21.15.26:0/1671649468 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eec071e20 con 0x7f7eec13d820 2023-10-01T07:58:20.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.784+0000 7f7ee8ff9700 1 -- 172.21.15.26:0/1671649468 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7ee4041190 con 0x7f7eec13d820 2023-10-01T07:58:20.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.789+0000 7f7ee8ff9700 1 -- 172.21.15.26:0/1671649468 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7ee401b7b0 con 0x7f7eec13d820 2023-10-01T07:58:21.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.810+0000 7ff09a35e700 1 Processor -- start 2023-10-01T07:58:21.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.810+0000 7ff09a35e700 1 -- start start 2023-10-01T07:58:21.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.810+0000 7ff09a35e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff09406a770 0x7ff09406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:21.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.811+0000 7ff09a35e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff094131d10 0x7ff094139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:21.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.811+0000 7ff09a35e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff09409ece0 con 0x7ff09406b080 2023-10-01T07:58:21.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.811+0000 7ff09a35e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff09409e760 con 0x7ff094131d10 2023-10-01T07:58:21.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.811+0000 7ff09a35e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff09409e040 con 0x7ff09406a770 2023-10-01T07:58:21.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.811+0000 7ff0937fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff09406b080 0x7ff094131600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38902/0 (socket says 172.21.15.26:38902) 2023-10-01T07:58:21.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.811+0000 7ff093fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff09406a770 0x7ff09406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:21.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.811+0000 7ff0937fe700 1 -- 172.21.15.26:0/342354420 learned_addr learned my addr 172.21.15.26:0/342354420 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:21.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.811+0000 7ff0988fb700 1 --2- 172.21.15.26:0/342354420 >> v2:172.21.15.26:3300/0 conn(0x7ff094131d10 0x7ff094139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:21.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.811+0000 7ff0988fb700 1 -- 172.21.15.26:0/342354420 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff09406a770 msgr2=0x7ff09406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:21.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.811+0000 7ff0988fb700 1 --2- 172.21.15.26:0/342354420 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff09406a770 0x7ff09406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:21.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.811+0000 7ff0988fb700 1 -- 172.21.15.26:0/342354420 >> v1:172.21.15.26:6789/0 conn(0x7ff09406b080 legacy=0x7ff094131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:21.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.811+0000 7ff0988fb700 1 -- 172.21.15.26:0/342354420 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09409f630 con 0x7ff094131d10 2023-10-01T07:58:21.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.812+0000 7ff0988fb700 1 --2- 172.21.15.26:0/342354420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff094131d10 0x7ff094139860 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7ff08c009d90 tx=0x7ff08c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21c151f8aed48141 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:21.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.812+0000 7ff092ffd700 1 -- 172.21.15.26:0/342354420 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c00bd20 con 0x7ff094131d10 2023-10-01T07:58:21.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.812+0000 7ff092ffd700 1 -- 172.21.15.26:0/342354420 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08c00be80 con 0x7ff094131d10 2023-10-01T07:58:21.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.812+0000 7ff092ffd700 1 -- 172.21.15.26:0/342354420 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c010710 con 0x7ff094131d10 2023-10-01T07:58:21.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.812+0000 7ff09a35e700 1 -- 172.21.15.26:0/342354420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff094131d10 msgr2=0x7ff094139860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:21.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.812+0000 7ff09a35e700 1 --2- 172.21.15.26:0/342354420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff094131d10 0x7ff094139860 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7ff08c009d90 tx=0x7ff08c00b330 comp rx=0 tx=0).stop 2023-10-01T07:58:21.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.812+0000 7ff09a35e700 1 -- 172.21.15.26:0/342354420 shutdown_connections 2023-10-01T07:58:21.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.812+0000 7ff09a35e700 1 --2- 172.21.15.26:0/342354420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff094131d10 0x7ff094139860 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:21.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.812+0000 7ff09a35e700 1 --2- 172.21.15.26:0/342354420 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff09406a770 0x7ff09406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:21.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.812+0000 7ff09a35e700 1 -- 172.21.15.26:0/342354420 >> 172.21.15.26:0/342354420 conn(0x7ff094066f50 msgr2=0x7ff09409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:21.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.813+0000 7ff09a35e700 1 -- 172.21.15.26:0/342354420 shutdown_connections 2023-10-01T07:58:21.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.813+0000 7ff09a35e700 1 -- 172.21.15.26:0/342354420 wait complete. 2023-10-01T07:58:21.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.814+0000 7ff09a35e700 1 Processor -- start 2023-10-01T07:58:21.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.814+0000 7ff09a35e700 1 -- start start 2023-10-01T07:58:21.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.814+0000 7ff09a35e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff09406a770 0x7ff0941c3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:21.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.814+0000 7ff09a35e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff09406b080 0x7ff0941c4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:21.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.814+0000 7ff09a35e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff094131d10 0x7ff0941c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:21.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.814+0000 7ff09a35e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff094120360 con 0x7ff094131d10 2023-10-01T07:58:21.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.814+0000 7ff09a35e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff094120130 con 0x7ff09406a770 2023-10-01T07:58:21.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.814+0000 7ff09a35e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff094121aa0 con 0x7ff09406b080 2023-10-01T07:58:21.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.814+0000 7ff093fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff09406a770 0x7ff0941c3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:21.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.814+0000 7ff093fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff09406a770 0x7ff0941c3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43484/0 (socket says 172.21.15.26:43484) 2023-10-01T07:58:21.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.814+0000 7ff093fff700 1 -- 172.21.15.26:0/2733618921 learned_addr learned my addr 172.21.15.26:0/2733618921 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:21.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.815+0000 7ff0988fb700 1 --2- 172.21.15.26:0/2733618921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff094131d10 0x7ff0941c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:21.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.815+0000 7ff0937fe700 1 --2- 172.21.15.26:0/2733618921 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff09406b080 0x7ff0941c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:21.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.815+0000 7ff093fff700 1 -- 172.21.15.26:0/2733618921 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff09406b080 msgr2=0x7ff0941c4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:21.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.815+0000 7ff093fff700 1 --2- 172.21.15.26:0/2733618921 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff09406b080 0x7ff0941c4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:21.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.815+0000 7ff093fff700 1 -- 172.21.15.26:0/2733618921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff094131d10 msgr2=0x7ff0941c49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:21.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.815+0000 7ff093fff700 1 --2- 172.21.15.26:0/2733618921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff094131d10 0x7ff0941c49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:21.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.815+0000 7ff093fff700 1 -- 172.21.15.26:0/2733618921 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08c009a70 con 0x7ff09406a770 2023-10-01T07:58:21.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.815+0000 7ff093fff700 1 --2- 172.21.15.26:0/2733618921 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff09406a770 0x7ff0941c3f30 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff08400e9b0 tx=0x7ff08400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:21.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.815+0000 7ff090ff9700 1 -- 172.21.15.26:0/2733618921 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff084009710 con 0x7ff09406a770 2023-10-01T07:58:21.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.815+0000 7ff090ff9700 1 -- 172.21.15.26:0/2733618921 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08400ee50 con 0x7ff09406a770 2023-10-01T07:58:21.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.815+0000 7ff09a35e700 1 -- 172.21.15.26:0/2733618921 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff09409c2c0 con 0x7ff09406a770 2023-10-01T07:58:21.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.816+0000 7ff090ff9700 1 -- 172.21.15.26:0/2733618921 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08400ca50 con 0x7ff09406a770 2023-10-01T07:58:21.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.816+0000 7ff09a35e700 1 -- 172.21.15.26:0/2733618921 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff094131040 con 0x7ff09406a770 2023-10-01T07:58:21.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.817+0000 7ff090ff9700 1 -- 172.21.15.26:0/2733618921 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff08400cbb0 con 0x7ff09406a770 2023-10-01T07:58:21.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.817+0000 7ff09a35e700 1 -- 172.21.15.26:0/2733618921 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff094121f80 con 0x7ff09406a770 2023-10-01T07:58:21.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.817+0000 7ff090ff9700 1 -- 172.21.15.26:0/2733618921 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff08403fa80 con 0x7ff09406a770 2023-10-01T07:58:21.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.826+0000 7ff090ff9700 1 -- 172.21.15.26:0/2733618921 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff094121f80 con 0x7ff09406a770 2023-10-01T07:58:21.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.948+0000 7f707db9e700 1 -- 172.21.15.26:0/3352435222 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f707809a260 con 0x7f7078133da0 2023-10-01T07:58:21.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.949+0000 7f70757fa700 1 -- 172.21.15.26:0/3352435222 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7070019300 con 0x7f7078133da0 2023-10-01T07:58:21.054 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:21.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.950+0000 7f83f5bd1700 1 -- 172.21.15.26:0/20663319 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f83f0074ea0 con 0x7f83f0134ec0 2023-10-01T07:58:21.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.950+0000 7f83d7fff700 1 -- 172.21.15.26:0/20663319 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f83e4017020 con 0x7f83f0134ec0 2023-10-01T07:58:21.055 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:21.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.952+0000 7f707db9e700 1 -- 172.21.15.26:0/3352435222 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7078133da0 msgr2=0x7f70781c8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:21.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.952+0000 7f707db9e700 1 --2- 172.21.15.26:0/3352435222 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7078133da0 0x7f70781c8c00 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f707000cc50 tx=0x7f707000cf60 comp rx=0 tx=0).stop 2023-10-01T07:58:21.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.952+0000 7f707db9e700 1 -- 172.21.15.26:0/3352435222 shutdown_connections 2023-10-01T07:58:21.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.952+0000 7f707db9e700 1 --2- 172.21.15.26:0/3352435222 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7078133da0 0x7f70781c8c00 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:21.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.952+0000 7f707db9e700 1 --2- 172.21.15.26:0/3352435222 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f707809d800 0x7f70781c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:21.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.952+0000 7f707db9e700 1 --2- 172.21.15.26:0/3352435222 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f707809e110 0x7f70781c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:21.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.952+0000 7f707db9e700 1 -- 172.21.15.26:0/3352435222 >> 172.21.15.26:0/3352435222 conn(0x7f70780a2e20 msgr2=0x7f7078070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:21.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.952+0000 7f707db9e700 1 -- 172.21.15.26:0/3352435222 shutdown_connections 2023-10-01T07:58:21.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.952+0000 7f707db9e700 1 -- 172.21.15.26:0/3352435222 wait complete. 2023-10-01T07:58:21.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.953+0000 7f83f5bd1700 1 -- 172.21.15.26:0/20663319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83f0134ec0 msgr2=0x7f83f011ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:21.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.953+0000 7f83f5bd1700 1 --2- 172.21.15.26:0/20663319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83f0134ec0 0x7f83f011ae20 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f83e400c4b0 tx=0x7f83e400c7c0 comp rx=0 tx=0).stop 2023-10-01T07:58:21.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.953+0000 7f83f5bd1700 1 -- 172.21.15.26:0/20663319 shutdown_connections 2023-10-01T07:58:21.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.953+0000 7f83f5bd1700 1 --2- 172.21.15.26:0/20663319 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f83f01380f0 0x7f83f011b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:21.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.953+0000 7f83f5bd1700 1 --2- 172.21.15.26:0/20663319 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f83f006c0e0 0x7f83f011a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:21.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.953+0000 7f83f5bd1700 1 --2- 172.21.15.26:0/20663319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83f0134ec0 0x7f83f011ae20 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:21.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.953+0000 7f83f5bd1700 1 -- 172.21.15.26:0/20663319 >> 172.21.15.26:0/20663319 conn(0x7f83f00a4210 msgr2=0x7f83f006f950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:21.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.954+0000 7f83f5bd1700 1 -- 172.21.15.26:0/20663319 shutdown_connections 2023-10-01T07:58:21.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:20.955+0000 7f83f5bd1700 1 -- 172.21.15.26:0/20663319 wait complete. 2023-10-01T07:58:21.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:21.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:21.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:21.012+0000 7f7ef2330700 1 -- 172.21.15.26:0/1671649468 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7eec074ea0 con 0x7f7eec13d820 2023-10-01T07:58:21.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:21.012+0000 7f7ee8ff9700 1 -- 172.21.15.26:0/1671649468 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7ee402a030 con 0x7f7eec13d820 2023-10-01T07:58:21.060 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:21.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:21.015+0000 7f7ef2330700 1 -- 172.21.15.26:0/1671649468 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7eec13d820 msgr2=0x7f7eec126760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:21.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:21.015+0000 7f7ef2330700 1 --2- 172.21.15.26:0/1671649468 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7eec13d820 0x7f7eec126760 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4015000 tx=0x7f7ee4004ad0 comp rx=0 tx=0).stop 2023-10-01T07:58:21.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:21.015+0000 7f7ef2330700 1 -- 172.21.15.26:0/1671649468 shutdown_connections 2023-10-01T07:58:21.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:21.015+0000 7f7ef2330700 1 --2- 172.21.15.26:0/1671649468 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7eec13d820 0x7f7eec126760 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:21.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:21.015+0000 7f7ef2330700 1 --2- 172.21.15.26:0/1671649468 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7eec0a0a30 0x7f7eec125ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:21.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:21.015+0000 7f7ef2330700 1 --2- 172.21.15.26:0/1671649468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7eec0a1340 0x7f7eec126220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:21.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:21.015+0000 7f7ef2330700 1 -- 172.21.15.26:0/1671649468 >> 172.21.15.26:0/1671649468 conn(0x7f7eec0a6550 msgr2=0x7f7eec0a2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:21.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:21.015+0000 7f7ef2330700 1 -- 172.21.15.26:0/1671649468 shutdown_connections 2023-10-01T07:58:21.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:21.015+0000 7f7ef2330700 1 -- 172.21.15.26:0/1671649468 wait complete. 2023-10-01T07:58:21.062 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:21.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:21.036+0000 7ff09a35e700 1 -- 172.21.15.26:0/2733618921 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff094121f20 con 0x7ff09406a770 2023-10-01T07:58:21.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:21.036+0000 7ff090ff9700 1 -- 172.21.15.26:0/2733618921 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff084021020 con 0x7ff09406a770 2023-10-01T07:58:21.063 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:21.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:21.039+0000 7ff09a35e700 1 -- 172.21.15.26:0/2733618921 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff09406a770 msgr2=0x7ff0941c3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:21.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:21.039+0000 7ff09a35e700 1 --2- 172.21.15.26:0/2733618921 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff09406a770 0x7ff0941c3f30 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff08400e9b0 tx=0x7ff08400ecc0 comp rx=0 tx=0).stop 2023-10-01T07:58:21.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:21.039+0000 7ff09a35e700 1 -- 172.21.15.26:0/2733618921 shutdown_connections 2023-10-01T07:58:21.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:21.039+0000 7ff09a35e700 1 --2- 172.21.15.26:0/2733618921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff094131d10 0x7ff0941c49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:21.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:21.039+0000 7ff09a35e700 1 --2- 172.21.15.26:0/2733618921 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff09406a770 0x7ff0941c3f30 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:21.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:21.039+0000 7ff09a35e700 1 --2- 172.21.15.26:0/2733618921 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff09406b080 0x7ff0941c4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:21.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:21.039+0000 7ff09a35e700 1 -- 172.21.15.26:0/2733618921 >> 172.21.15.26:0/2733618921 conn(0x7ff094066f50 msgr2=0x7ff0940a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:21.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:21.039+0000 7ff09a35e700 1 -- 172.21.15.26:0/2733618921 shutdown_connections 2023-10-01T07:58:21.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:21.039+0000 7ff09a35e700 1 -- 172.21.15.26:0/2733618921 wait complete. 2023-10-01T07:58:21.065 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:22.060 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:22.060 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:22.063 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:22.066 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:22.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.213+0000 7fabba323700 1 Processor -- start 2023-10-01T07:58:22.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.213+0000 7fb075abd700 1 Processor -- start 2023-10-01T07:58:22.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.213+0000 7fabba323700 1 -- start start 2023-10-01T07:58:22.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.213+0000 7fb075abd700 1 -- start start 2023-10-01T07:58:22.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.214+0000 7fabba323700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabb409f410 0x7fabb4136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:22.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.214+0000 7fabba323700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabb4136fe0 0x7fabb41393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:22.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.214+0000 7fb075abd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb0700a0a30 0x7fb0700a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:22.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.214+0000 7fb075abd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb07009d630 0x7fb0700a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:22.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.214+0000 7fb075abd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb070133930 0x7fb070133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:22.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.214+0000 7fb075abd700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0700a2a70 con 0x7fb07009d630 2023-10-01T07:58:22.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.214+0000 7fb075abd700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0700a01d0 con 0x7fb0700a0a30 2023-10-01T07:58:22.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.214+0000 7fb075abd700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb07009e2b0 con 0x7fb070133930 2023-10-01T07:58:22.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.214+0000 7fabba323700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabb4070940 con 0x7fabb409e930 2023-10-01T07:58:22.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.214+0000 7fabba323700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb406fd60 con 0x7fabb4136fe0 2023-10-01T07:58:22.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.214+0000 7fabba323700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabb406fa80 con 0x7fabb409f410 2023-10-01T07:58:22.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.214+0000 7fabb3fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fabb409e930 0x7fabb409ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38912/0 (socket says 172.21.15.26:38912) 2023-10-01T07:58:22.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.214+0000 7fabb3fff700 1 -- 172.21.15.26:0/3522382412 learned_addr learned my addr 172.21.15.26:0/3522382412 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:22.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.214+0000 7fabb88c0700 1 --2- 172.21.15.26:0/3522382412 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabb4136fe0 0x7fabb41393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:22.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.214+0000 7fb06ffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb070133930 0x7fb070133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:22.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.214+0000 7fb06f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb0700a0a30 0x7fb0700a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:22.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.214+0000 7fb06ffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb070133930 0x7fb070133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59684/0 (socket says 172.21.15.26:59684) 2023-10-01T07:58:22.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.214+0000 7fb06ffff700 1 -- 172.21.15.26:0/1463011309 learned_addr learned my addr 172.21.15.26:0/1463011309 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:22.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.214+0000 7fb06effd700 1 --2- 172.21.15.26:0/1463011309 >> v2:172.21.15.26:3300/0 conn(0x7fb07009d630 0x7fb0700a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:22.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.214+0000 7fabb37fe700 1 --2- 172.21.15.26:0/3522382412 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabb409f410 0x7fabb4136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:22.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.215+0000 7fb06ffff700 1 -- 172.21.15.26:0/1463011309 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb0700a0a30 msgr2=0x7fb0700a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:22.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.215+0000 7fb06ffff700 1 --2- 172.21.15.26:0/1463011309 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb0700a0a30 0x7fb0700a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.215+0000 7fb06ffff700 1 -- 172.21.15.26:0/1463011309 >> v2:172.21.15.26:3300/0 conn(0x7fb07009d630 msgr2=0x7fb0700a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:22.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.215+0000 7fb06ffff700 1 --2- 172.21.15.26:0/1463011309 >> v2:172.21.15.26:3300/0 conn(0x7fb07009d630 0x7fb0700a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.215+0000 7fb06ffff700 1 -- 172.21.15.26:0/1463011309 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07009dc50 con 0x7fb070133930 2023-10-01T07:58:22.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.215+0000 7fabb88c0700 1 -- 172.21.15.26:0/3522382412 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabb409f410 msgr2=0x7fabb4136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:22.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.215+0000 7fabb88c0700 1 --2- 172.21.15.26:0/3522382412 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabb409f410 0x7fabb4136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.215+0000 7fabb88c0700 1 -- 172.21.15.26:0/3522382412 >> v1:172.21.15.26:6789/0 conn(0x7fabb409e930 legacy=0x7fabb409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:22.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.215+0000 7fabb88c0700 1 -- 172.21.15.26:0/3522382412 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb409fb60 con 0x7fabb4136fe0 2023-10-01T07:58:22.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.215+0000 7fb06ffff700 1 --2- 172.21.15.26:0/1463011309 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb070133930 0x7fb070133dd0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb068009e50 tx=0x7fb06800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87fbeddc398cac9f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:22.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.215+0000 7fabb88c0700 1 --2- 172.21.15.26:0/3522382412 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabb4136fe0 0x7fabb41393c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fabac009dc0 tx=0x7fabac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd749074e9a176f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:22.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.215+0000 7fabb2ffd700 1 -- 172.21.15.26:0/3522382412 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac00e070 con 0x7fabb4136fe0 2023-10-01T07:58:22.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.215+0000 7fb06e7fc700 1 -- 172.21.15.26:0/1463011309 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06800e070 con 0x7fb070133930 2023-10-01T07:58:22.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.215+0000 7fb06e7fc700 1 -- 172.21.15.26:0/1463011309 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06800b910 con 0x7fb070133930 2023-10-01T07:58:22.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.215+0000 7fb06e7fc700 1 -- 172.21.15.26:0/1463011309 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06800bcc0 con 0x7fb070133930 2023-10-01T07:58:22.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.215+0000 7fabb2ffd700 1 -- 172.21.15.26:0/3522382412 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabac00bb20 con 0x7fabb4136fe0 2023-10-01T07:58:22.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.215+0000 7fabb2ffd700 1 -- 172.21.15.26:0/3522382412 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac012430 con 0x7fabb4136fe0 2023-10-01T07:58:22.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.215+0000 7f1e4e6e7700 1 Processor -- start 2023-10-01T07:58:22.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.216+0000 7f1e4e6e7700 1 -- start start 2023-10-01T07:58:22.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.216+0000 7fb075abd700 1 -- 172.21.15.26:0/1463011309 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb070133930 msgr2=0x7fb070133dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:22.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.216+0000 7fb075abd700 1 --2- 172.21.15.26:0/1463011309 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb070133930 0x7fb070133dd0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb068009e50 tx=0x7fb06800b330 comp rx=0 tx=0).stop 2023-10-01T07:58:22.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.216+0000 7fabba323700 1 -- 172.21.15.26:0/3522382412 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabb4136fe0 msgr2=0x7fabb41393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:22.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.216+0000 7fabba323700 1 --2- 172.21.15.26:0/3522382412 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabb4136fe0 0x7fabb41393c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fabac009dc0 tx=0x7fabac00b330 comp rx=0 tx=0).stop 2023-10-01T07:58:22.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.216+0000 7fabba323700 1 -- 172.21.15.26:0/3522382412 shutdown_connections 2023-10-01T07:58:22.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.216+0000 7fabba323700 1 --2- 172.21.15.26:0/3522382412 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabb4136fe0 0x7fabb41393c0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.216+0000 7fabba323700 1 --2- 172.21.15.26:0/3522382412 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabb409f410 0x7fabb4136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.216+0000 7fabba323700 1 -- 172.21.15.26:0/3522382412 >> 172.21.15.26:0/3522382412 conn(0x7fabb40a4210 msgr2=0x7fabb40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:22.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.216+0000 7f1e4e6e7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e481337f0 0x7f1e48138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:22.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.216+0000 7fabba323700 1 -- 172.21.15.26:0/3522382412 shutdown_connections 2023-10-01T07:58:22.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.216+0000 7f1e4e6e7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1e48138dc0 0x7f1e4813b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:22.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.216+0000 7f1e4e6e7700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e4806b990 con 0x7f1e48133420 2023-10-01T07:58:22.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.216+0000 7f1e4e6e7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e4809b0e0 con 0x7f1e48138dc0 2023-10-01T07:58:22.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.216+0000 7f1e4e6e7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e48133c20 con 0x7f1e481337f0 2023-10-01T07:58:22.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.217+0000 7fabba323700 1 -- 172.21.15.26:0/3522382412 wait complete. 2023-10-01T07:58:22.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.217+0000 7f1e4cc84700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1e48138dc0 0x7f1e4813b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:22.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.217+0000 7f1e4cc84700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1e48138dc0 0x7f1e4813b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39332/0 (socket says 172.21.15.26:39332) 2023-10-01T07:58:22.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.217+0000 7f1e4cc84700 1 -- 172.21.15.26:0/760303069 learned_addr learned my addr 172.21.15.26:0/760303069 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:22.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.217+0000 7f1e477fe700 1 --2- 172.21.15.26:0/760303069 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e481337f0 0x7f1e48138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:22.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.217+0000 7f1e4cc84700 1 -- 172.21.15.26:0/760303069 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e481337f0 msgr2=0x7f1e48138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:22.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.217+0000 7f1e4cc84700 1 --2- 172.21.15.26:0/760303069 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e481337f0 0x7f1e48138880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.217+0000 7f1e4cc84700 1 -- 172.21.15.26:0/760303069 >> v1:172.21.15.26:6789/0 conn(0x7f1e48133420 legacy=0x7f1e48133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:22.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.217+0000 7f1e4cc84700 1 -- 172.21.15.26:0/760303069 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e480a0590 con 0x7f1e48138dc0 2023-10-01T07:58:22.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.217+0000 7f1e4cc84700 1 --2- 172.21.15.26:0/760303069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e48138dc0 0x7f1e4813b1a0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f1e38009e50 tx=0x7f1e3800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc977d5328ef1557 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:22.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.218+0000 7f1e46ffd700 1 -- 172.21.15.26:0/760303069 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3800e070 con 0x7f1e48138dc0 2023-10-01T07:58:22.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.218+0000 7fb075abd700 1 -- 172.21.15.26:0/1463011309 shutdown_connections 2023-10-01T07:58:22.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.218+0000 7fb075abd700 1 --2- 172.21.15.26:0/1463011309 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb070133930 0x7fb070133dd0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.218+0000 7fb075abd700 1 --2- 172.21.15.26:0/1463011309 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb0700a0a30 0x7fb0700a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.218+0000 7fb075abd700 1 --2- 172.21.15.26:0/1463011309 >> v2:172.21.15.26:3300/0 conn(0x7fb07009d630 0x7fb0700a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.218+0000 7fb075abd700 1 -- 172.21.15.26:0/1463011309 >> 172.21.15.26:0/1463011309 conn(0x7fb0700a3050 msgr2=0x7fb0700a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:22.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.218+0000 7fb075abd700 1 -- 172.21.15.26:0/1463011309 shutdown_connections 2023-10-01T07:58:22.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.218+0000 7fb075abd700 1 -- 172.21.15.26:0/1463011309 wait complete. 2023-10-01T07:58:22.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.218+0000 7fabba323700 1 Processor -- start 2023-10-01T07:58:22.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.218+0000 7fabba323700 1 -- start start 2023-10-01T07:58:22.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.218+0000 7f1e46ffd700 1 -- 172.21.15.26:0/760303069 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3800b910 con 0x7f1e48138dc0 2023-10-01T07:58:22.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.218+0000 7f1e46ffd700 1 -- 172.21.15.26:0/760303069 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3800bcc0 con 0x7f1e48138dc0 2023-10-01T07:58:22.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.218+0000 7f1e4e6e7700 1 -- 172.21.15.26:0/760303069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e48138dc0 msgr2=0x7f1e4813b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:22.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.218+0000 7f1e4e6e7700 1 --2- 172.21.15.26:0/760303069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e48138dc0 0x7f1e4813b1a0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f1e38009e50 tx=0x7f1e3800b330 comp rx=0 tx=0).stop 2023-10-01T07:58:22.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.219+0000 7f1e4e6e7700 1 -- 172.21.15.26:0/760303069 shutdown_connections 2023-10-01T07:58:22.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.219+0000 7f1e4e6e7700 1 --2- 172.21.15.26:0/760303069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e48138dc0 0x7f1e4813b1a0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.219+0000 7f1e4e6e7700 1 --2- 172.21.15.26:0/760303069 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e481337f0 0x7f1e48138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.219+0000 7f1e4e6e7700 1 -- 172.21.15.26:0/760303069 >> 172.21.15.26:0/760303069 conn(0x7f1e480a4210 msgr2=0x7f1e480a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:22.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.219+0000 7f1e4e6e7700 1 -- 172.21.15.26:0/760303069 shutdown_connections 2023-10-01T07:58:22.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.219+0000 7f1e4e6e7700 1 -- 172.21.15.26:0/760303069 wait complete. 2023-10-01T07:58:22.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.219+0000 7fb075abd700 1 Processor -- start 2023-10-01T07:58:22.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.219+0000 7fabba323700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabb409e930 0x7fabb406c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:22.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.219+0000 7fabba323700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabb409f410 0x7fabb406c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:22.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.219+0000 7fabba323700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabb4136fe0 0x7fabb41c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:22.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.219+0000 7fabba323700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb406be60 con 0x7fabb409e930 2023-10-01T07:58:22.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.219+0000 7fabba323700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb4122080 con 0x7fabb409f410 2023-10-01T07:58:22.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.219+0000 7fabba323700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabb406cd30 con 0x7fabb4136fe0 2023-10-01T07:58:22.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.219+0000 7fabb3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabb409e930 0x7fabb406c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:22.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.219+0000 7fabb3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabb409e930 0x7fabb406c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39346/0 (socket says 172.21.15.26:39346) 2023-10-01T07:58:22.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.219+0000 7fabb3fff700 1 -- 172.21.15.26:0/2724159673 learned_addr learned my addr 172.21.15.26:0/2724159673 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:22.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.219+0000 7fabb37fe700 1 --2- 172.21.15.26:0/2724159673 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabb409f410 0x7fabb406c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:22.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.220+0000 7fabb3fff700 1 -- 172.21.15.26:0/2724159673 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabb4136fe0 msgr2=0x7fabb41c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:22.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.220+0000 7fabb3fff700 1 --2- 172.21.15.26:0/2724159673 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabb4136fe0 0x7fabb41c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.220+0000 7fabb3fff700 1 -- 172.21.15.26:0/2724159673 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabb409f410 msgr2=0x7fabb406c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:22.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.220+0000 7fabb3fff700 1 --2- 172.21.15.26:0/2724159673 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabb409f410 0x7fabb406c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.220+0000 7fabb3fff700 1 -- 172.21.15.26:0/2724159673 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabac009a70 con 0x7fabb409e930 2023-10-01T07:58:22.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.220+0000 7fabb3fff700 1 --2- 172.21.15.26:0/2724159673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabb409e930 0x7fabb406c2b0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7faba400c480 tx=0x7faba400c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:22.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.220+0000 7f1e4e6e7700 1 Processor -- start 2023-10-01T07:58:22.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.220+0000 7fabb0ff9700 1 -- 172.21.15.26:0/2724159673 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba4005d70 con 0x7fabb409e930 2023-10-01T07:58:22.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.220+0000 7fabb0ff9700 1 -- 172.21.15.26:0/2724159673 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba40070d0 con 0x7fabb409e930 2023-10-01T07:58:22.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.220+0000 7fabb0ff9700 1 -- 172.21.15.26:0/2724159673 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba4007440 con 0x7fabb409e930 2023-10-01T07:58:22.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.220+0000 7fabba323700 1 -- 172.21.15.26:0/2724159673 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb4132480 con 0x7fabb409e930 2023-10-01T07:58:22.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.220+0000 7fabba323700 1 -- 172.21.15.26:0/2724159673 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb4071d20 con 0x7fabb409e930 2023-10-01T07:58:22.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.220+0000 7f1e4e6e7700 1 -- start start 2023-10-01T07:58:22.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.221+0000 7f1e4e6e7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e48133420 0x7f1e48070750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:22.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.221+0000 7f1e4e6e7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e481337f0 0x7f1e48070c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:22.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.221+0000 7f1e4e6e7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e48138dc0 0x7f1e480711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:22.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.221+0000 7f1e4e6e7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e48071bb0 con 0x7f1e48133420 2023-10-01T07:58:22.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.221+0000 7f1e4e6e7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e480722d0 con 0x7f1e48138dc0 2023-10-01T07:58:22.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.221+0000 7f1e4e6e7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4809ca00 con 0x7f1e481337f0 2023-10-01T07:58:22.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.221+0000 7f1e477fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e481337f0 0x7f1e48070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:22.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.221+0000 7f1e477fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e481337f0 0x7f1e48070c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59726/0 (socket says 172.21.15.26:59726) 2023-10-01T07:58:22.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.221+0000 7f1e477fe700 1 -- 172.21.15.26:0/1373511155 learned_addr learned my addr 172.21.15.26:0/1373511155 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:22.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.221+0000 7f1e4cc84700 1 --2- 172.21.15.26:0/1373511155 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e48138dc0 0x7f1e480711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:22.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.220+0000 7fb075abd700 1 -- start start 2023-10-01T07:58:22.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.220+0000 7fb075abd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb07009d630 0x7fb070133190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:22.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.220+0000 7fb075abd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0700a0a30 0x7fb070135a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:22.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.220+0000 7fb075abd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb070133930 0x7fb070135fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:22.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.220+0000 7fb075abd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07013a240 con 0x7fb0700a0a30 2023-10-01T07:58:22.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.220+0000 7fb075abd700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb070138fb0 con 0x7fb070133930 2023-10-01T07:58:22.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.220+0000 7fb075abd700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0700a0410 con 0x7fb07009d630 2023-10-01T07:58:22.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.220+0000 7fb06effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0700a0a30 0x7fb070135a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:22.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.221+0000 7fb06effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0700a0a30 0x7fb070135a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39362/0 (socket says 172.21.15.26:39362) 2023-10-01T07:58:22.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.221+0000 7fb06effd700 1 -- 172.21.15.26:0/381913832 learned_addr learned my addr 172.21.15.26:0/381913832 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:22.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.221+0000 7fb06f7fe700 1 --2- 172.21.15.26:0/381913832 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb07009d630 0x7fb070133190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:22.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.221+0000 7fb06effd700 1 -- 172.21.15.26:0/381913832 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb07009d630 msgr2=0x7fb070133190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:22.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.221+0000 7fb06effd700 1 --2- 172.21.15.26:0/381913832 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb07009d630 0x7fb070133190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.221+0000 7fb06effd700 1 -- 172.21.15.26:0/381913832 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb070133930 msgr2=0x7fb070135fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:22.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.221+0000 7fb06effd700 1 --2- 172.21.15.26:0/381913832 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb070133930 0x7fb070135fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.221+0000 7fb06effd700 1 -- 172.21.15.26:0/381913832 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb068009b30 con 0x7fb0700a0a30 2023-10-01T07:58:22.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.221+0000 7fb06f7fe700 1 --2- 172.21.15.26:0/381913832 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb07009d630 0x7fb070133190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:22.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.222+0000 7fb06effd700 1 --2- 172.21.15.26:0/381913832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0700a0a30 0x7fb070135a80 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fb06400e980 tx=0x7fb06400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:22.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.222+0000 7f1e477fe700 1 -- 172.21.15.26:0/1373511155 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e48138dc0 msgr2=0x7f1e480711d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:22.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.222+0000 7f1e477fe700 1 --2- 172.21.15.26:0/1373511155 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e48138dc0 0x7f1e480711d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.222+0000 7fabba323700 1 -- 172.21.15.26:0/2724159673 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab940052e0 con 0x7fabb409e930 2023-10-01T07:58:22.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.222+0000 7f1e477fe700 1 -- 172.21.15.26:0/1373511155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e48133420 msgr2=0x7f1e48070750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:22.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.222+0000 7f1e477fe700 1 --2- 172.21.15.26:0/1373511155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e48133420 0x7f1e48070750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.222+0000 7f1e477fe700 1 -- 172.21.15.26:0/1373511155 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e38009b30 con 0x7f1e481337f0 2023-10-01T07:58:22.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.222+0000 7f1e4cc84700 1 --2- 172.21.15.26:0/1373511155 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e48138dc0 0x7f1e480711d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:22.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.222+0000 7fb057fff700 1 -- 172.21.15.26:0/381913832 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb064009710 con 0x7fb0700a0a30 2023-10-01T07:58:22.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.222+0000 7fb057fff700 1 -- 172.21.15.26:0/381913832 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06400eed0 con 0x7fb0700a0a30 2023-10-01T07:58:22.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.222+0000 7fb075abd700 1 -- 172.21.15.26:0/381913832 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb070139270 con 0x7fb0700a0a30 2023-10-01T07:58:22.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.222+0000 7fb075abd700 1 -- 172.21.15.26:0/381913832 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0701336d0 con 0x7fb0700a0a30 2023-10-01T07:58:22.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.222+0000 7fb057fff700 1 -- 172.21.15.26:0/381913832 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06400ca50 con 0x7fb0700a0a30 2023-10-01T07:58:22.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.222+0000 7f1e477fe700 1 --2- 172.21.15.26:0/1373511155 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e481337f0 0x7f1e48070c90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1e3000e9b0 tx=0x7f1e3000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:22.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.222+0000 7f1e44ff9700 1 -- 172.21.15.26:0/1373511155 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e30009710 con 0x7f1e481337f0 2023-10-01T07:58:22.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.223+0000 7f1e44ff9700 1 -- 172.21.15.26:0/1373511155 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3000c850 con 0x7f1e481337f0 2023-10-01T07:58:22.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.223+0000 7f1e44ff9700 1 -- 172.21.15.26:0/1373511155 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3000cbc0 con 0x7f1e481337f0 2023-10-01T07:58:22.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.223+0000 7fb075abd700 1 -- 172.21.15.26:0/381913832 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0500052e0 con 0x7fb0700a0a30 2023-10-01T07:58:22.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.224+0000 7f1e4e6e7700 1 -- 172.21.15.26:0/1373511155 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e4809cc70 con 0x7f1e481337f0 2023-10-01T07:58:22.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.224+0000 7f1e4e6e7700 1 -- 172.21.15.26:0/1373511155 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e4809d850 con 0x7f1e481337f0 2023-10-01T07:58:22.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.224+0000 7fabb0ff9700 1 -- 172.21.15.26:0/2724159673 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faba40075a0 con 0x7fabb409e930 2023-10-01T07:58:22.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.224+0000 7fabb0ff9700 1 -- 172.21.15.26:0/2724159673 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faba403f0a0 con 0x7fabb409e930 2023-10-01T07:58:22.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.225+0000 7f1e44ff9700 1 -- 172.21.15.26:0/1373511155 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e3000cd20 con 0x7f1e481337f0 2023-10-01T07:58:22.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.225+0000 7f1e4e6e7700 1 -- 172.21.15.26:0/1373511155 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e4809ffb0 con 0x7f1e481337f0 2023-10-01T07:58:22.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.225+0000 7f1e44ff9700 1 -- 172.21.15.26:0/1373511155 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1e3003f790 con 0x7f1e481337f0 2023-10-01T07:58:22.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.231+0000 7fabb0ff9700 1 -- 172.21.15.26:0/2724159673 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faba401b3b0 con 0x7fabb409e930 2023-10-01T07:58:22.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.231+0000 7fb057fff700 1 -- 172.21.15.26:0/381913832 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb06400cbb0 con 0x7fb0700a0a30 2023-10-01T07:58:22.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.231+0000 7fb057fff700 1 -- 172.21.15.26:0/381913832 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb06403ff90 con 0x7fb0700a0a30 2023-10-01T07:58:22.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.234+0000 7f1e44ff9700 1 -- 172.21.15.26:0/1373511155 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e3001be10 con 0x7f1e481337f0 2023-10-01T07:58:22.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.239+0000 7fb057fff700 1 -- 172.21.15.26:0/381913832 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb064011350 con 0x7fb0700a0a30 2023-10-01T07:58:22.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.269+0000 7f2d70a3f700 1 Processor -- start 2023-10-01T07:58:22.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.269+0000 7f2d70a3f700 1 -- start start 2023-10-01T07:58:22.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.270+0000 7f2d70a3f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2d6c09f410 0x7f2d6c136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:22.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.270+0000 7f2d70a3f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d6c136fe0 0x7f2d6c1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:22.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.270+0000 7f2d70a3f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d6c070940 con 0x7f2d6c09e930 2023-10-01T07:58:22.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.270+0000 7f2d70a3f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d6c06fd60 con 0x7f2d6c09f410 2023-10-01T07:58:22.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.270+0000 7f2d70a3f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c06fa80 con 0x7f2d6c136fe0 2023-10-01T07:58:22.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.270+0000 7f2d6ad9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d6c136fe0 0x7f2d6c1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:22.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.270+0000 7f2d6ad9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d6c136fe0 0x7f2d6c1393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59740/0 (socket says 172.21.15.26:59740) 2023-10-01T07:58:22.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.270+0000 7f2d6ad9d700 1 -- 172.21.15.26:0/2886446872 learned_addr learned my addr 172.21.15.26:0/2886446872 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:22.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.270+0000 7f2d69d9b700 1 --2- 172.21.15.26:0/2886446872 >> v2:172.21.15.26:3300/0 conn(0x7f2d6c09f410 0x7f2d6c136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:22.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.271+0000 7f2d6ad9d700 1 -- 172.21.15.26:0/2886446872 >> v2:172.21.15.26:3300/0 conn(0x7f2d6c09f410 msgr2=0x7f2d6c136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:22.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.271+0000 7f2d6ad9d700 1 --2- 172.21.15.26:0/2886446872 >> v2:172.21.15.26:3300/0 conn(0x7f2d6c09f410 0x7f2d6c136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.271+0000 7f2d6ad9d700 1 -- 172.21.15.26:0/2886446872 >> v1:172.21.15.26:6789/0 conn(0x7f2d6c09e930 legacy=0x7f2d6c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:22.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.271+0000 7f2d6ad9d700 1 -- 172.21.15.26:0/2886446872 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6c09fb60 con 0x7f2d6c136fe0 2023-10-01T07:58:22.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.271+0000 7f2d6ad9d700 1 --2- 172.21.15.26:0/2886446872 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d6c136fe0 0x7f2d6c1393c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2d64009e50 tx=0x7f2d6400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7eb44eaee46415cc server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:22.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.271+0000 7f2d6959a700 1 -- 172.21.15.26:0/2886446872 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6400e070 con 0x7f2d6c136fe0 2023-10-01T07:58:22.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.271+0000 7f2d6959a700 1 -- 172.21.15.26:0/2886446872 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d64003a20 con 0x7f2d6c136fe0 2023-10-01T07:58:22.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.271+0000 7f2d6959a700 1 -- 172.21.15.26:0/2886446872 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d64003dd0 con 0x7f2d6c136fe0 2023-10-01T07:58:22.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.272+0000 7f2d70a3f700 1 -- 172.21.15.26:0/2886446872 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d6c136fe0 msgr2=0x7f2d6c1393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:22.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.272+0000 7f2d70a3f700 1 --2- 172.21.15.26:0/2886446872 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d6c136fe0 0x7f2d6c1393c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2d64009e50 tx=0x7f2d6400b330 comp rx=0 tx=0).stop 2023-10-01T07:58:22.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.272+0000 7f2d70a3f700 1 -- 172.21.15.26:0/2886446872 shutdown_connections 2023-10-01T07:58:22.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.272+0000 7f2d70a3f700 1 --2- 172.21.15.26:0/2886446872 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d6c136fe0 0x7f2d6c1393c0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.272+0000 7f2d70a3f700 1 --2- 172.21.15.26:0/2886446872 >> v2:172.21.15.26:3300/0 conn(0x7f2d6c09f410 0x7f2d6c136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.272+0000 7f2d70a3f700 1 -- 172.21.15.26:0/2886446872 >> 172.21.15.26:0/2886446872 conn(0x7f2d6c0a4210 msgr2=0x7f2d6c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:22.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.272+0000 7f2d70a3f700 1 -- 172.21.15.26:0/2886446872 shutdown_connections 2023-10-01T07:58:22.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.272+0000 7f2d70a3f700 1 -- 172.21.15.26:0/2886446872 wait complete. 2023-10-01T07:58:22.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.273+0000 7f2d70a3f700 1 Processor -- start 2023-10-01T07:58:22.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.273+0000 7f2d70a3f700 1 -- start start 2023-10-01T07:58:22.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.274+0000 7f2d70a3f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d6c09e930 0x7f2d6c11c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:22.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.274+0000 7f2d70a3f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d6c09f410 0x7f2d6c11cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:22.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.274+0000 7f2d70a3f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d6c136fe0 0x7f2d6c11d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:22.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.274+0000 7f2d70a3f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c11f870 con 0x7f2d6c136fe0 2023-10-01T07:58:22.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.274+0000 7f2d70a3f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c11e1f0 con 0x7f2d6c09f410 2023-10-01T07:58:22.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.274+0000 7f2d70a3f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c0a2f40 con 0x7f2d6c09e930 2023-10-01T07:58:22.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.274+0000 7f2d6ad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d6c136fe0 0x7f2d6c11d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:22.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.274+0000 7f2d6a59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d6c09e930 0x7f2d6c11c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:22.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.274+0000 7f2d6ad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d6c136fe0 0x7f2d6c11d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39388/0 (socket says 172.21.15.26:39388) 2023-10-01T07:58:22.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.274+0000 7f2d6ad9d700 1 -- 172.21.15.26:0/3305472057 learned_addr learned my addr 172.21.15.26:0/3305472057 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:22.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.274+0000 7f2d6ad9d700 1 -- 172.21.15.26:0/3305472057 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d6c09e930 msgr2=0x7f2d6c11c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:22.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.274+0000 7f2d6ad9d700 1 --2- 172.21.15.26:0/3305472057 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d6c09e930 0x7f2d6c11c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.274+0000 7f2d6ad9d700 1 -- 172.21.15.26:0/3305472057 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d6c09f410 msgr2=0x7f2d6c11cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:22.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.274+0000 7f2d6ad9d700 1 --2- 172.21.15.26:0/3305472057 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d6c09f410 0x7f2d6c11cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.274+0000 7f2d6ad9d700 1 -- 172.21.15.26:0/3305472057 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d64009b30 con 0x7f2d6c136fe0 2023-10-01T07:58:22.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.275+0000 7f2d6ad9d700 1 --2- 172.21.15.26:0/3305472057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d6c136fe0 0x7f2d6c11d060 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f2d6400b370 tx=0x7f2d64004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:22.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.275+0000 7f2d5affd700 1 -- 172.21.15.26:0/3305472057 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d64004440 con 0x7f2d6c136fe0 2023-10-01T07:58:22.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.275+0000 7f2d5affd700 1 -- 172.21.15.26:0/3305472057 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d640045c0 con 0x7f2d6c136fe0 2023-10-01T07:58:22.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.275+0000 7f2d70a3f700 1 -- 172.21.15.26:0/3305472057 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d6c071d20 con 0x7f2d6c136fe0 2023-10-01T07:58:22.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.275+0000 7f2d5affd700 1 -- 172.21.15.26:0/3305472057 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d640094d0 con 0x7f2d6c136fe0 2023-10-01T07:58:22.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.275+0000 7f2d70a3f700 1 -- 172.21.15.26:0/3305472057 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d6c11fbc0 con 0x7f2d6c136fe0 2023-10-01T07:58:22.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.276+0000 7f2d5affd700 1 -- 172.21.15.26:0/3305472057 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d6401e450 con 0x7f2d6c136fe0 2023-10-01T07:58:22.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.276+0000 7f2d70a3f700 1 -- 172.21.15.26:0/3305472057 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d6c074ea0 con 0x7f2d6c136fe0 2023-10-01T07:58:22.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.276+0000 7f2d5affd700 1 -- 172.21.15.26:0/3305472057 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2d64040c70 con 0x7f2d6c136fe0 2023-10-01T07:58:22.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.286+0000 7f2d5affd700 1 -- 172.21.15.26:0/3305472057 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d640263b0 con 0x7f2d6c136fe0 2023-10-01T07:58:22.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.449+0000 7fb075abd700 1 -- 172.21.15.26:0/381913832 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb050005860 con 0x7fb0700a0a30 2023-10-01T07:58:22.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.449+0000 7fb057fff700 1 -- 172.21.15.26:0/381913832 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb064017070 con 0x7fb0700a0a30 2023-10-01T07:58:22.450 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:22.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.450+0000 7fabba323700 1 -- 172.21.15.26:0/2724159673 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fab94005860 con 0x7fabb409e930 2023-10-01T07:58:22.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.451+0000 7fabb0ff9700 1 -- 172.21.15.26:0/2724159673 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faba4017020 con 0x7fabb409e930 2023-10-01T07:58:22.451 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:22.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.451+0000 7f1e4e6e7700 1 -- 172.21.15.26:0/1373511155 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1e48074ea0 con 0x7f1e481337f0 2023-10-01T07:58:22.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.452+0000 7f1e44ff9700 1 -- 172.21.15.26:0/1373511155 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e30021030 con 0x7f1e481337f0 2023-10-01T07:58:22.452 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:22.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.453+0000 7fb075abd700 1 -- 172.21.15.26:0/381913832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0700a0a30 msgr2=0x7fb070135a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:22.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.453+0000 7fb075abd700 1 --2- 172.21.15.26:0/381913832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0700a0a30 0x7fb070135a80 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fb06400e980 tx=0x7fb06400ec90 comp rx=0 tx=0).stop 2023-10-01T07:58:22.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.453+0000 7fb075abd700 1 -- 172.21.15.26:0/381913832 shutdown_connections 2023-10-01T07:58:22.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.453+0000 7fb075abd700 1 --2- 172.21.15.26:0/381913832 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb070133930 0x7fb070135fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.453+0000 7fb075abd700 1 --2- 172.21.15.26:0/381913832 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb07009d630 0x7fb070133190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.453+0000 7fb075abd700 1 --2- 172.21.15.26:0/381913832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0700a0a30 0x7fb070135a80 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.453+0000 7fb075abd700 1 -- 172.21.15.26:0/381913832 >> 172.21.15.26:0/381913832 conn(0x7fb0700a3050 msgr2=0x7fb07009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:22.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.453+0000 7fb075abd700 1 -- 172.21.15.26:0/381913832 shutdown_connections 2023-10-01T07:58:22.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.453+0000 7fb075abd700 1 -- 172.21.15.26:0/381913832 wait complete. 2023-10-01T07:58:22.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.454+0000 7fabba323700 1 -- 172.21.15.26:0/2724159673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabb409e930 msgr2=0x7fabb406c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:22.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.454+0000 7fabba323700 1 --2- 172.21.15.26:0/2724159673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabb409e930 0x7fabb406c2b0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7faba400c480 tx=0x7faba400c790 comp rx=0 tx=0).stop 2023-10-01T07:58:22.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.454+0000 7fabba323700 1 -- 172.21.15.26:0/2724159673 shutdown_connections 2023-10-01T07:58:22.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.454+0000 7fabba323700 1 --2- 172.21.15.26:0/2724159673 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabb4136fe0 0x7fabb41c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.454+0000 7fabba323700 1 --2- 172.21.15.26:0/2724159673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabb409e930 0x7fabb406c2b0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.454+0000 7fabba323700 1 --2- 172.21.15.26:0/2724159673 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabb409f410 0x7fabb406c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.454+0000 7fabba323700 1 -- 172.21.15.26:0/2724159673 >> 172.21.15.26:0/2724159673 conn(0x7fabb40a4210 msgr2=0x7fabb4135f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:22.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.454+0000 7fabba323700 1 -- 172.21.15.26:0/2724159673 shutdown_connections 2023-10-01T07:58:22.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.454+0000 7fabba323700 1 -- 172.21.15.26:0/2724159673 wait complete. 2023-10-01T07:58:22.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.454+0000 7f1e4e6e7700 1 -- 172.21.15.26:0/1373511155 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e481337f0 msgr2=0x7f1e48070c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:22.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.454+0000 7f1e4e6e7700 1 --2- 172.21.15.26:0/1373511155 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e481337f0 0x7f1e48070c90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1e3000e9b0 tx=0x7f1e3000ecc0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.455+0000 7f1e4e6e7700 1 -- 172.21.15.26:0/1373511155 shutdown_connections 2023-10-01T07:58:22.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.455+0000 7f1e4e6e7700 1 --2- 172.21.15.26:0/1373511155 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e48138dc0 0x7f1e480711d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.455+0000 7f1e4e6e7700 1 --2- 172.21.15.26:0/1373511155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e48133420 0x7f1e48070750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.455+0000 7f1e4e6e7700 1 --2- 172.21.15.26:0/1373511155 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e481337f0 0x7f1e48070c90 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.455+0000 7f1e4e6e7700 1 -- 172.21.15.26:0/1373511155 >> 172.21.15.26:0/1373511155 conn(0x7f1e480a4210 msgr2=0x7f1e48131400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:22.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.455+0000 7f1e4e6e7700 1 -- 172.21.15.26:0/1373511155 shutdown_connections 2023-10-01T07:58:22.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.455+0000 7f1e4e6e7700 1 -- 172.21.15.26:0/1373511155 wait complete. 2023-10-01T07:58:22.477 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:22.478 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:22.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:22.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.504+0000 7f2d70a3f700 1 -- 172.21.15.26:0/3305472057 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2d6c06b250 con 0x7f2d6c136fe0 2023-10-01T07:58:22.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.504+0000 7f2d5affd700 1 -- 172.21.15.26:0/3305472057 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d64022070 con 0x7f2d6c136fe0 2023-10-01T07:58:22.505 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:22.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.506+0000 7f2d70a3f700 1 -- 172.21.15.26:0/3305472057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d6c136fe0 msgr2=0x7f2d6c11d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:22.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.506+0000 7f2d70a3f700 1 --2- 172.21.15.26:0/3305472057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d6c136fe0 0x7f2d6c11d060 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f2d6400b370 tx=0x7f2d64004ad0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.506+0000 7f2d70a3f700 1 -- 172.21.15.26:0/3305472057 shutdown_connections 2023-10-01T07:58:22.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.506+0000 7f2d70a3f700 1 --2- 172.21.15.26:0/3305472057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d6c136fe0 0x7f2d6c11d060 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.506+0000 7f2d70a3f700 1 --2- 172.21.15.26:0/3305472057 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d6c09e930 0x7f2d6c11c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.506+0000 7f2d70a3f700 1 --2- 172.21.15.26:0/3305472057 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d6c09f410 0x7f2d6c11cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:22.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.506+0000 7f2d70a3f700 1 -- 172.21.15.26:0/3305472057 >> 172.21.15.26:0/3305472057 conn(0x7f2d6c0a4210 msgr2=0x7f2d6c0a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:22.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.506+0000 7f2d70a3f700 1 -- 172.21.15.26:0/3305472057 shutdown_connections 2023-10-01T07:58:22.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:22.506+0000 7f2d70a3f700 1 -- 172.21.15.26:0/3305472057 wait complete. 2023-10-01T07:58:22.520 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:23.479 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:23.479 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:23.480 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:23.522 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:23.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.633+0000 7f48d03a7700 1 Processor -- start 2023-10-01T07:58:23.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.633+0000 7f48d03a7700 1 -- start start 2023-10-01T07:58:23.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.634+0000 7f48d03a7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f48c809e1d0 0x7f48c8135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:23.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.634+0000 7f48d03a7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48c8135e50 0x7f48c8138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:23.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.634+0000 7f48d03a7700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48c809f130 con 0x7f48c809d6f0 2023-10-01T07:58:23.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.634+0000 7f48d03a7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48c809f520 con 0x7f48c809e1d0 2023-10-01T07:58:23.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.634+0000 7f48d03a7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48c809e930 con 0x7f48c8135e50 2023-10-01T07:58:23.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.634+0000 7f48cd942700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f48c809e1d0 0x7f48c8135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:23.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.634+0000 7f48cd942700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f48c809e1d0 0x7f48c8135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49848/0 (socket says 172.21.15.26:49848) 2023-10-01T07:58:23.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.634+0000 7f48cd942700 1 -- 172.21.15.26:0/4002004685 learned_addr learned my addr 172.21.15.26:0/4002004685 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:23.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.634+0000 7f48cd942700 1 -- 172.21.15.26:0/4002004685 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48c8135e50 msgr2=0x7f48c8138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:23.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.634+0000 7f48cd942700 1 --2- 172.21.15.26:0/4002004685 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48c8135e50 0x7f48c8138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.634+0000 7f48cd942700 1 -- 172.21.15.26:0/4002004685 >> v1:172.21.15.26:6789/0 conn(0x7f48c809d6f0 legacy=0x7f48c809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:23.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.634+0000 7f48cd942700 1 -- 172.21.15.26:0/4002004685 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c809b2d0 con 0x7f48c809e1d0 2023-10-01T07:58:23.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.635+0000 7f48cd942700 1 --2- 172.21.15.26:0/4002004685 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48c809e1d0 0x7f48c8135910 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f48b80098f0 tx=0x7f48b8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e9507ae3a02f560 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:23.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.635+0000 7f48cd141700 1 -- 172.21.15.26:0/4002004685 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b800b8a0 con 0x7f48c809e1d0 2023-10-01T07:58:23.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.635+0000 7f48cd141700 1 -- 172.21.15.26:0/4002004685 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b800ba00 con 0x7f48c809e1d0 2023-10-01T07:58:23.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.635+0000 7f48cd141700 1 -- 172.21.15.26:0/4002004685 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b800bd90 con 0x7f48c809e1d0 2023-10-01T07:58:23.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.636+0000 7f48d03a7700 1 -- 172.21.15.26:0/4002004685 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48c809e1d0 msgr2=0x7f48c8135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:23.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.636+0000 7f48d03a7700 1 --2- 172.21.15.26:0/4002004685 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48c809e1d0 0x7f48c8135910 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f48b80098f0 tx=0x7f48b8009c00 comp rx=0 tx=0).stop 2023-10-01T07:58:23.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.636+0000 7f5e652fc700 1 Processor -- start 2023-10-01T07:58:23.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.636+0000 7f5e652fc700 1 -- start start 2023-10-01T07:58:23.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.636+0000 7f48d03a7700 1 -- 172.21.15.26:0/4002004685 shutdown_connections 2023-10-01T07:58:23.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.636+0000 7f48d03a7700 1 --2- 172.21.15.26:0/4002004685 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48c8135e50 0x7f48c8138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.636+0000 7f48d03a7700 1 --2- 172.21.15.26:0/4002004685 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48c809e1d0 0x7f48c8135910 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.636+0000 7f48d03a7700 1 -- 172.21.15.26:0/4002004685 >> 172.21.15.26:0/4002004685 conn(0x7f48c8066f50 msgr2=0x7f48c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:23.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.637+0000 7f48d03a7700 1 -- 172.21.15.26:0/4002004685 shutdown_connections 2023-10-01T07:58:23.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.637+0000 7f48d03a7700 1 -- 172.21.15.26:0/4002004685 wait complete. 2023-10-01T07:58:23.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.637+0000 7f5e652fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5e60130540 0x7f5e60130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:23.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.637+0000 7f5e652fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5e60130e50 0x7f5e6006f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:23.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.637+0000 7f5e652fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5e6006fb20 0x7f5e6006ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:23.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.637+0000 7f5e652fc700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e600704b0 con 0x7f5e60130e50 2023-10-01T07:58:23.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.637+0000 7f5e652fc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6009a390 con 0x7f5e6006fb20 2023-10-01T07:58:23.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.637+0000 7f5e652fc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e600716a0 con 0x7f5e60130540 2023-10-01T07:58:23.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.637+0000 7f5e5e7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5e60130e50 0x7f5e6006f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:23.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.637+0000 7f5e5e7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5e60130e50 0x7f5e6006f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49858/0 (socket says 172.21.15.26:49858) 2023-10-01T07:58:23.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.637+0000 7f5e5e7fc700 1 -- 172.21.15.26:0/609511174 learned_addr learned my addr 172.21.15.26:0/609511174 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:23.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.637+0000 7f5e5f7fe700 1 --2- 172.21.15.26:0/609511174 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5e6006fb20 0x7f5e6006ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:23.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.638+0000 7f5e5e7fc700 1 -- 172.21.15.26:0/609511174 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5e60130540 msgr2=0x7f5e60130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:23.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.638+0000 7f5e5effd700 1 --2- 172.21.15.26:0/609511174 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5e60130540 0x7f5e60130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:23.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.638+0000 7f5e5e7fc700 1 --2- 172.21.15.26:0/609511174 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5e60130540 0x7f5e60130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.638+0000 7f5e5e7fc700 1 -- 172.21.15.26:0/609511174 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5e6006fb20 msgr2=0x7f5e6006ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:23.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.638+0000 7f5e5e7fc700 1 --2- 172.21.15.26:0/609511174 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5e6006fb20 0x7f5e6006ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.638+0000 7f5e5e7fc700 1 -- 172.21.15.26:0/609511174 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e60071290 con 0x7f5e60130e50 2023-10-01T07:58:23.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.638+0000 7f5e5f7fe700 1 --2- 172.21.15.26:0/609511174 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5e6006fb20 0x7f5e6006ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:23.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.638+0000 7f5e5effd700 1 --2- 172.21.15.26:0/609511174 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5e60130540 0x7f5e60130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:58:23.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.638+0000 7f48d03a7700 1 Processor -- start 2023-10-01T07:58:23.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.638+0000 7f5e5e7fc700 1 --2- 172.21.15.26:0/609511174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e60130e50 0x7f5e6006f5e0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f5e54009920 tx=0x7f5e54009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd41cc51609bfca server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:23.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.638+0000 7f5e5dffb700 1 -- 172.21.15.26:0/609511174 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e54011830 con 0x7f5e60130e50 2023-10-01T07:58:23.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.638+0000 7f5e5dffb700 1 -- 172.21.15.26:0/609511174 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e54011990 con 0x7f5e60130e50 2023-10-01T07:58:23.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.638+0000 7f5e5dffb700 1 -- 172.21.15.26:0/609511174 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e54011d20 con 0x7f5e60130e50 2023-10-01T07:58:23.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.639+0000 7f48d03a7700 1 -- start start 2023-10-01T07:58:23.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.639+0000 7f48d03a7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48c809d6f0 0x7f48c8137fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:23.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.639+0000 7f48d03a7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48c809e1d0 0x7f48c81384f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:23.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.639+0000 7f48d03a7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48c8135e50 0x7f48c8138a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:23.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.639+0000 7f48d03a7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c811ddf0 con 0x7f48c8135e50 2023-10-01T07:58:23.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.639+0000 7f48d03a7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c8139cd0 con 0x7f48c809e1d0 2023-10-01T07:58:23.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.639+0000 7f48d03a7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48c813b300 con 0x7f48c809d6f0 2023-10-01T07:58:23.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.639+0000 7f5e652fc700 1 -- 172.21.15.26:0/609511174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e60130e50 msgr2=0x7f5e6006f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:23.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.639+0000 7f5e652fc700 1 --2- 172.21.15.26:0/609511174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e60130e50 0x7f5e6006f5e0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f5e54009920 tx=0x7f5e54009c30 comp rx=0 tx=0).stop 2023-10-01T07:58:23.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.639+0000 7f48ce143700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48c809d6f0 0x7f48c8137fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:23.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.639+0000 7f48ce143700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48c809d6f0 0x7f48c8137fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41180/0 (socket says 172.21.15.26:41180) 2023-10-01T07:58:23.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.639+0000 7f48ce143700 1 -- 172.21.15.26:0/2413339806 learned_addr learned my addr 172.21.15.26:0/2413339806 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:23.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.640+0000 7f48ce944700 1 --2- 172.21.15.26:0/2413339806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48c8135e50 0x7f48c8138a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:23.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.640+0000 7f48ce143700 1 -- 172.21.15.26:0/2413339806 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48c809e1d0 msgr2=0x7f48c81384f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:58:23.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.640+0000 7f48ce143700 1 --2- 172.21.15.26:0/2413339806 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48c809e1d0 0x7f48c81384f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.640+0000 7f48ce143700 1 -- 172.21.15.26:0/2413339806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48c8135e50 msgr2=0x7f48c8138a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:23.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.640+0000 7f48ce143700 1 --2- 172.21.15.26:0/2413339806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48c8135e50 0x7f48c8138a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.640+0000 7f48ce143700 1 -- 172.21.15.26:0/2413339806 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b8009550 con 0x7f48c809d6f0 2023-10-01T07:58:23.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.640+0000 7f48ce143700 1 --2- 172.21.15.26:0/2413339806 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48c809d6f0 0x7f48c8137fb0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f48c400c450 tx=0x7f48c400c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:23.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.640+0000 7f5e652fc700 1 -- 172.21.15.26:0/609511174 shutdown_connections 2023-10-01T07:58:23.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.640+0000 7f5e652fc700 1 --2- 172.21.15.26:0/609511174 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5e6006fb20 0x7f5e6006ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.640+0000 7f5e652fc700 1 --2- 172.21.15.26:0/609511174 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5e60130540 0x7f5e60130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.640+0000 7f5e652fc700 1 --2- 172.21.15.26:0/609511174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e60130e50 0x7f5e6006f5e0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.640+0000 7f5e652fc700 1 -- 172.21.15.26:0/609511174 >> 172.21.15.26:0/609511174 conn(0x7f5e600a2aa0 msgr2=0x7f5e600a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:23.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.640+0000 7f5e652fc700 1 -- 172.21.15.26:0/609511174 shutdown_connections 2023-10-01T07:58:23.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.640+0000 7f5e652fc700 1 -- 172.21.15.26:0/609511174 wait complete. 2023-10-01T07:58:23.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.640+0000 7f48beffd700 1 -- 172.21.15.26:0/2413339806 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c40052d0 con 0x7f48c809d6f0 2023-10-01T07:58:23.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.640+0000 7f48beffd700 1 -- 172.21.15.26:0/2413339806 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c4005430 con 0x7f48c809d6f0 2023-10-01T07:58:23.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.640+0000 7f48beffd700 1 -- 172.21.15.26:0/2413339806 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c40038c0 con 0x7f48c809d6f0 2023-10-01T07:58:23.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.640+0000 7f48d03a7700 1 -- 172.21.15.26:0/2413339806 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48c813a5b0 con 0x7f48c809d6f0 2023-10-01T07:58:23.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.640+0000 7f48d03a7700 1 -- 172.21.15.26:0/2413339806 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c811e0d0 con 0x7f48c809d6f0 2023-10-01T07:58:23.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.641+0000 7f48beffd700 1 -- 172.21.15.26:0/2413339806 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f48c4003a20 con 0x7f48c809d6f0 2023-10-01T07:58:23.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.642+0000 7f48beffd700 1 -- 172.21.15.26:0/2413339806 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f48c403eb80 con 0x7f48c809d6f0 2023-10-01T07:58:23.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.642+0000 7f48d03a7700 1 -- 172.21.15.26:0/2413339806 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48c811da20 con 0x7f48c809d6f0 2023-10-01T07:58:23.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.641+0000 7f5e652fc700 1 Processor -- start 2023-10-01T07:58:23.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.641+0000 7f5e652fc700 1 -- start start 2023-10-01T07:58:23.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.642+0000 7f5e652fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5e6006fb20 0x7f5e60118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:23.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.642+0000 7f5e652fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5e60130540 0x7f5e60119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:23.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.642+0000 7f5e652fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e60130e50 0x7f5e60119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:23.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.642+0000 7f5e652fc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6011cc00 con 0x7f5e60130e50 2023-10-01T07:58:23.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.642+0000 7f5e652fc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6011bdb0 con 0x7f5e60130540 2023-10-01T07:58:23.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.642+0000 7f5e652fc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6011c020 con 0x7f5e6006fb20 2023-10-01T07:58:23.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.642+0000 7f5e5effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5e6006fb20 0x7f5e60118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:23.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.642+0000 7f5e5effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5e6006fb20 0x7f5e60118cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41188/0 (socket says 172.21.15.26:41188) 2023-10-01T07:58:23.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.642+0000 7f5e5effd700 1 -- 172.21.15.26:0/1074884968 learned_addr learned my addr 172.21.15.26:0/1074884968 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:23.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.642+0000 7f5e5f7fe700 1 --2- 172.21.15.26:0/1074884968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e60130e50 0x7f5e60119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:23.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.643+0000 7f5e5e7fc700 1 --2- 172.21.15.26:0/1074884968 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5e60130540 0x7f5e60119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:23.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.643+0000 7f5e5effd700 1 -- 172.21.15.26:0/1074884968 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5e60130540 msgr2=0x7f5e60119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:23.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.643+0000 7f5e5effd700 1 --2- 172.21.15.26:0/1074884968 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5e60130540 0x7f5e60119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.643+0000 7f5e5effd700 1 -- 172.21.15.26:0/1074884968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e60130e50 msgr2=0x7f5e60119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:23.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.643+0000 7f5e5effd700 1 --2- 172.21.15.26:0/1074884968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e60130e50 0x7f5e60119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.643+0000 7f5e5effd700 1 -- 172.21.15.26:0/1074884968 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e580099e0 con 0x7f5e6006fb20 2023-10-01T07:58:23.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.643+0000 7f5e5effd700 1 --2- 172.21.15.26:0/1074884968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5e6006fb20 0x7f5e60118cd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5e5000c750 tx=0x7f5e5000ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:23.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.646+0000 7fa28d901700 1 Processor -- start 2023-10-01T07:58:23.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.646+0000 7fa28d901700 1 -- start start 2023-10-01T07:58:23.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.647+0000 7fa28d901700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa28812cf60 0x7fa28806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:23.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.647+0000 7fa28d901700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa28812f8b0 0x7fa28812fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:23.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.647+0000 7fa28d901700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa28812cd90 con 0x7fa288130260 2023-10-01T07:58:23.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.647+0000 7fa28d901700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa28812d330 con 0x7fa28812f8b0 2023-10-01T07:58:23.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.647+0000 7fa28d901700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2881306d0 con 0x7fa28812cf60 2023-10-01T07:58:23.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.647+0000 7fa286ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa28812cf60 0x7fa28806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:23.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.647+0000 7fa286ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa28812cf60 0x7fa28806f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41200/0 (socket says 172.21.15.26:41200) 2023-10-01T07:58:23.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.647+0000 7fa286ffd700 1 -- 172.21.15.26:0/3404818526 learned_addr learned my addr 172.21.15.26:0/3404818526 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:23.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.647+0000 7fa2867fc700 1 --2- 172.21.15.26:0/3404818526 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa28812f8b0 0x7fa28812fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:23.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.648+0000 7fa2867fc700 1 -- 172.21.15.26:0/3404818526 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa28812cf60 msgr2=0x7fa28806f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:23.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.648+0000 7fa2867fc700 1 --2- 172.21.15.26:0/3404818526 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa28812cf60 0x7fa28806f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.648+0000 7fa2867fc700 1 -- 172.21.15.26:0/3404818526 >> v1:172.21.15.26:6789/0 conn(0x7fa288130260 legacy=0x7fa288136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:23.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.648+0000 7fa2867fc700 1 -- 172.21.15.26:0/3404818526 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa288071780 con 0x7fa28812f8b0 2023-10-01T07:58:23.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.648+0000 7fa2867fc700 1 --2- 172.21.15.26:0/3404818526 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa28812f8b0 0x7fa28812fd20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa27c009870 tx=0x7fa27c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f697324ca6902a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:23.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.648+0000 7f48beffd700 1 -- 172.21.15.26:0/2413339806 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f48c4018260 con 0x7f48c809d6f0 2023-10-01T07:58:23.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.648+0000 7f5e477fe700 1 -- 172.21.15.26:0/1074884968 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e50011800 con 0x7f5e6006fb20 2023-10-01T07:58:23.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.648+0000 7f5e477fe700 1 -- 172.21.15.26:0/1074884968 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e50011960 con 0x7f5e6006fb20 2023-10-01T07:58:23.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.648+0000 7f5e477fe700 1 -- 172.21.15.26:0/1074884968 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e50011cd0 con 0x7f5e6006fb20 2023-10-01T07:58:23.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.648+0000 7f5e652fc700 1 -- 172.21.15.26:0/1074884968 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e54009550 con 0x7f5e6006fb20 2023-10-01T07:58:23.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.648+0000 7f5e652fc700 1 -- 172.21.15.26:0/1074884968 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e600a0c90 con 0x7f5e6006fb20 2023-10-01T07:58:23.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.648+0000 7fa285ffb700 1 -- 172.21.15.26:0/3404818526 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c00f8a0 con 0x7fa28812f8b0 2023-10-01T07:58:23.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.648+0000 7fa285ffb700 1 -- 172.21.15.26:0/3404818526 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27c00fa00 con 0x7fa28812f8b0 2023-10-01T07:58:23.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.648+0000 7fa285ffb700 1 -- 172.21.15.26:0/3404818526 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c00fd90 con 0x7fa28812f8b0 2023-10-01T07:58:23.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.649+0000 7fa28d901700 1 -- 172.21.15.26:0/3404818526 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa28812f8b0 msgr2=0x7fa28812fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:23.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.649+0000 7fa28d901700 1 --2- 172.21.15.26:0/3404818526 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa28812f8b0 0x7fa28812fd20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa27c009870 tx=0x7fa27c009b80 comp rx=0 tx=0).stop 2023-10-01T07:58:23.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.649+0000 7fa28d901700 1 -- 172.21.15.26:0/3404818526 shutdown_connections 2023-10-01T07:58:23.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.649+0000 7fa28d901700 1 --2- 172.21.15.26:0/3404818526 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa28812cf60 0x7fa28806f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.649+0000 7fa28d901700 1 --2- 172.21.15.26:0/3404818526 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa28812f8b0 0x7fa28812fd20 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.649+0000 7fa28d901700 1 -- 172.21.15.26:0/3404818526 >> 172.21.15.26:0/3404818526 conn(0x7fa2880a2aa0 msgr2=0x7fa2880a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:23.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.649+0000 7f5e477fe700 1 -- 172.21.15.26:0/1074884968 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5e50021350 con 0x7f5e6006fb20 2023-10-01T07:58:23.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.649+0000 7f5e477fe700 1 -- 172.21.15.26:0/1074884968 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5e5003f550 con 0x7f5e6006fb20 2023-10-01T07:58:23.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.649+0000 7f5e652fc700 1 -- 172.21.15.26:0/1074884968 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e6011bbf0 con 0x7f5e6006fb20 2023-10-01T07:58:23.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.650+0000 7fa28d901700 1 -- 172.21.15.26:0/3404818526 shutdown_connections 2023-10-01T07:58:23.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.650+0000 7fa28d901700 1 -- 172.21.15.26:0/3404818526 wait complete. 2023-10-01T07:58:23.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.651+0000 7fa28d901700 1 Processor -- start 2023-10-01T07:58:23.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.652+0000 7fa28d901700 1 -- start start 2023-10-01T07:58:23.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.653+0000 7fa28d901700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa28812cf60 0x7fa2881d4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:23.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.653+0000 7fa28d901700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa28812f8b0 0x7fa2881d5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:23.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.653+0000 7fa28d901700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa288130260 0x7fa2881d59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:23.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.653+0000 7fa28d901700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28809ecd0 con 0x7fa28812f8b0 2023-10-01T07:58:23.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.653+0000 7fa28d901700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa28812f550 con 0x7fa28812cf60 2023-10-01T07:58:23.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.653+0000 7fa28d901700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa288129fa0 con 0x7fa288130260 2023-10-01T07:58:23.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.653+0000 7fa2867fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa28812f8b0 0x7fa2881d5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:23.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.653+0000 7fa2867fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa28812f8b0 0x7fa2881d5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49878/0 (socket says 172.21.15.26:49878) 2023-10-01T07:58:23.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.653+0000 7fa2867fc700 1 -- 172.21.15.26:0/3422202487 learned_addr learned my addr 172.21.15.26:0/3422202487 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:23.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.653+0000 7fa2877fe700 1 --2- 172.21.15.26:0/3422202487 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa288130260 0x7fa2881d59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:23.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.653+0000 7fa286ffd700 1 --2- 172.21.15.26:0/3422202487 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa28812cf60 0x7fa2881d4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:23.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.654+0000 7fa2867fc700 1 -- 172.21.15.26:0/3422202487 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa288130260 msgr2=0x7fa2881d59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:23.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.654+0000 7fa2867fc700 1 --2- 172.21.15.26:0/3422202487 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa288130260 0x7fa2881d59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.654+0000 7fa2867fc700 1 -- 172.21.15.26:0/3422202487 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa28812cf60 msgr2=0x7fa2881d4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:23.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.654+0000 7fa2867fc700 1 --2- 172.21.15.26:0/3422202487 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa28812cf60 0x7fa2881d4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.654+0000 7fa2867fc700 1 -- 172.21.15.26:0/3422202487 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa27c0094a0 con 0x7fa28812f8b0 2023-10-01T07:58:23.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.654+0000 7fa2867fc700 1 --2- 172.21.15.26:0/3422202487 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa28812f8b0 0x7fa2881d5470 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fa27c009bc0 tx=0x7fa27c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:23.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.654+0000 7fa26ffff700 1 -- 172.21.15.26:0/3422202487 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c003ab0 con 0x7fa28812f8b0 2023-10-01T07:58:23.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.654+0000 7fa26ffff700 1 -- 172.21.15.26:0/3422202487 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27c003c10 con 0x7fa28812f8b0 2023-10-01T07:58:23.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.654+0000 7fa26ffff700 1 -- 172.21.15.26:0/3422202487 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c010470 con 0x7fa28812f8b0 2023-10-01T07:58:23.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.654+0000 7fa28d901700 1 -- 172.21.15.26:0/3422202487 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2881b5e10 con 0x7fa28812f8b0 2023-10-01T07:58:23.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.654+0000 7fa28d901700 1 -- 172.21.15.26:0/3422202487 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2881b5900 con 0x7fa28812f8b0 2023-10-01T07:58:23.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.655+0000 7f5e477fe700 1 -- 172.21.15.26:0/1074884968 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5e5001e080 con 0x7f5e6006fb20 2023-10-01T07:58:23.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.655+0000 7fa26ffff700 1 -- 172.21.15.26:0/3422202487 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa27c019400 con 0x7fa28812f8b0 2023-10-01T07:58:23.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.656+0000 7fa26ffff700 1 -- 172.21.15.26:0/3422202487 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa27c040450 con 0x7fa28812f8b0 2023-10-01T07:58:23.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.656+0000 7fa28d901700 1 -- 172.21.15.26:0/3422202487 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2881b71b0 con 0x7fa28812f8b0 2023-10-01T07:58:23.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.662+0000 7fa26ffff700 1 -- 172.21.15.26:0/3422202487 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa2881b71b0 con 0x7fa28812f8b0 2023-10-01T07:58:23.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.692+0000 7f7b09aee700 1 Processor -- start 2023-10-01T07:58:23.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.692+0000 7f7b09aee700 1 -- start start 2023-10-01T07:58:23.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.693+0000 7f7b09aee700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7b0409c650 0x7f7b0409ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:23.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.693+0000 7f7b09aee700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7b040a0090 0x7f7b0409cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:23.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.693+0000 7f7b09aee700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7b04131970 0x7f7b04131e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:23.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.693+0000 7f7b09aee700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b0409ba70 con 0x7f7b040a0090 2023-10-01T07:58:23.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.693+0000 7f7b09aee700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0409d4a0 con 0x7f7b04131970 2023-10-01T07:58:23.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.693+0000 7f7b09aee700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0409e8f0 con 0x7f7b0409c650 2023-10-01T07:58:23.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.693+0000 7f7b03fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7b04131970 0x7f7b04131e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:23.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.693+0000 7f7b03fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7b04131970 0x7f7b04131e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34044/0 (socket says 172.21.15.26:34044) 2023-10-01T07:58:23.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.693+0000 7f7b03fff700 1 -- 172.21.15.26:0/1052486908 learned_addr learned my addr 172.21.15.26:0/1052486908 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:23.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.693+0000 7f7b037fe700 1 --2- 172.21.15.26:0/1052486908 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7b0409c650 0x7f7b0409ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:23.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.693+0000 7f7b02ffd700 1 --2- 172.21.15.26:0/1052486908 >> v2:172.21.15.26:3300/0 conn(0x7f7b040a0090 0x7f7b0409cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:23.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.693+0000 7f7b037fe700 1 -- 172.21.15.26:0/1052486908 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7b04131970 msgr2=0x7f7b04131e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:23.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.693+0000 7f7b037fe700 1 --2- 172.21.15.26:0/1052486908 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7b04131970 0x7f7b04131e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.693+0000 7f7b037fe700 1 -- 172.21.15.26:0/1052486908 >> v2:172.21.15.26:3300/0 conn(0x7f7b040a0090 msgr2=0x7f7b0409cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:23.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.693+0000 7f7b037fe700 1 --2- 172.21.15.26:0/1052486908 >> v2:172.21.15.26:3300/0 conn(0x7f7b040a0090 0x7f7b0409cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.693+0000 7f7b037fe700 1 -- 172.21.15.26:0/1052486908 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b040a0760 con 0x7f7b0409c650 2023-10-01T07:58:23.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.694+0000 7f7b02ffd700 1 --2- 172.21.15.26:0/1052486908 >> v2:172.21.15.26:3300/0 conn(0x7f7b040a0090 0x7f7b0409cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:23.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.694+0000 7f7b037fe700 1 --2- 172.21.15.26:0/1052486908 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7b0409c650 0x7f7b0409ca20 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7af4009840 tx=0x7f7af4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5b29159c6028e1e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:23.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.694+0000 7f7b027fc700 1 -- 172.21.15.26:0/1052486908 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af4011830 con 0x7f7b0409c650 2023-10-01T07:58:23.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.694+0000 7f7b027fc700 1 -- 172.21.15.26:0/1052486908 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af4011990 con 0x7f7b0409c650 2023-10-01T07:58:23.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.694+0000 7f7b027fc700 1 -- 172.21.15.26:0/1052486908 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af4011d20 con 0x7f7b0409c650 2023-10-01T07:58:23.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.695+0000 7f7b09aee700 1 -- 172.21.15.26:0/1052486908 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7b0409c650 msgr2=0x7f7b0409ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:23.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.695+0000 7f7b09aee700 1 --2- 172.21.15.26:0/1052486908 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7b0409c650 0x7f7b0409ca20 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7af4009840 tx=0x7f7af4009b50 comp rx=0 tx=0).stop 2023-10-01T07:58:23.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.695+0000 7f7b09aee700 1 -- 172.21.15.26:0/1052486908 shutdown_connections 2023-10-01T07:58:23.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.695+0000 7f7b09aee700 1 --2- 172.21.15.26:0/1052486908 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7b04131970 0x7f7b04131e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.695+0000 7f7b09aee700 1 --2- 172.21.15.26:0/1052486908 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7b0409c650 0x7f7b0409ca20 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.695+0000 7f7b09aee700 1 --2- 172.21.15.26:0/1052486908 >> v2:172.21.15.26:3300/0 conn(0x7f7b040a0090 0x7f7b0409cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.695+0000 7f7b09aee700 1 -- 172.21.15.26:0/1052486908 >> 172.21.15.26:0/1052486908 conn(0x7f7b040a3f70 msgr2=0x7f7b040a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:23.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.695+0000 7f7b09aee700 1 -- 172.21.15.26:0/1052486908 shutdown_connections 2023-10-01T07:58:23.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.695+0000 7f7b09aee700 1 -- 172.21.15.26:0/1052486908 wait complete. 2023-10-01T07:58:23.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.696+0000 7f7b09aee700 1 Processor -- start 2023-10-01T07:58:23.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.696+0000 7f7b09aee700 1 -- start start 2023-10-01T07:58:23.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.697+0000 7f7b09aee700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7b0409c650 0x7f7b041c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:23.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.697+0000 7f7b09aee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b040a0090 0x7f7b041c57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:23.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.697+0000 7f7b09aee700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7b04131970 0x7f7b041c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:23.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.697+0000 7f7b09aee700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b04072700 con 0x7f7b040a0090 2023-10-01T07:58:23.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.697+0000 7f7b09aee700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b041c5d30 con 0x7f7b0409c650 2023-10-01T07:58:23.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.697+0000 7f7b09aee700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0409d980 con 0x7f7b04131970 2023-10-01T07:58:23.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.697+0000 7f7b03fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7b04131970 0x7f7b041c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:23.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.697+0000 7f7b03fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7b04131970 0x7f7b041c82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41222/0 (socket says 172.21.15.26:41222) 2023-10-01T07:58:23.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.697+0000 7f7b03fff700 1 -- 172.21.15.26:0/1389249658 learned_addr learned my addr 172.21.15.26:0/1389249658 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:23.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.697+0000 7f7b037fe700 1 --2- 172.21.15.26:0/1389249658 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7b0409c650 0x7f7b041c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:23.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.697+0000 7f7b02ffd700 1 --2- 172.21.15.26:0/1389249658 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b040a0090 0x7f7b041c57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:23.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.697+0000 7f7b037fe700 1 -- 172.21.15.26:0/1389249658 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7b04131970 msgr2=0x7f7b041c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:23.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.697+0000 7f7b037fe700 1 --2- 172.21.15.26:0/1389249658 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7b04131970 0x7f7b041c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.697+0000 7f7b037fe700 1 -- 172.21.15.26:0/1389249658 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b040a0090 msgr2=0x7f7b041c57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:23.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.697+0000 7f7b037fe700 1 --2- 172.21.15.26:0/1389249658 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b040a0090 0x7f7b041c57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.697+0000 7f7b037fe700 1 -- 172.21.15.26:0/1389249658 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af80094a0 con 0x7f7b0409c650 2023-10-01T07:58:23.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.697+0000 7f7b03fff700 1 --2- 172.21.15.26:0/1389249658 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7b04131970 0x7f7b041c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:23.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.698+0000 7f7b037fe700 1 --2- 172.21.15.26:0/1389249658 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7b0409c650 0x7f7b041c52b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7af4016000 tx=0x7f7af4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:23.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.698+0000 7f7aebfff700 1 -- 172.21.15.26:0/1389249658 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af4004450 con 0x7f7b0409c650 2023-10-01T07:58:23.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.698+0000 7f7aebfff700 1 -- 172.21.15.26:0/1389249658 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af401f070 con 0x7f7b0409c650 2023-10-01T07:58:23.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.698+0000 7f7aebfff700 1 -- 172.21.15.26:0/1389249658 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af40038e0 con 0x7f7b0409c650 2023-10-01T07:58:23.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.698+0000 7f7b09aee700 1 -- 172.21.15.26:0/1389249658 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7af40094a0 con 0x7f7b0409c650 2023-10-01T07:58:23.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.698+0000 7f7b09aee700 1 -- 172.21.15.26:0/1389249658 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b0412acf0 con 0x7f7b0409c650 2023-10-01T07:58:23.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.699+0000 7f7aebfff700 1 -- 172.21.15.26:0/1389249658 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7af4003a40 con 0x7f7b0409c650 2023-10-01T07:58:23.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.699+0000 7f7aebfff700 1 -- 172.21.15.26:0/1389249658 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7af4021070 con 0x7f7b0409c650 2023-10-01T07:58:23.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.699+0000 7f7b09aee700 1 -- 172.21.15.26:0/1389249658 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b040747f0 con 0x7f7b0409c650 2023-10-01T07:58:23.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.704+0000 7f7aebfff700 1 -- 172.21.15.26:0/1389249658 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7af402b080 con 0x7f7b0409c650 2023-10-01T07:58:23.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.902+0000 7f48d03a7700 1 -- 172.21.15.26:0/2413339806 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f48c8074ea0 con 0x7f48c809d6f0 2023-10-01T07:58:23.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.902+0000 7f48beffd700 1 -- 172.21.15.26:0/2413339806 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f48c4017020 con 0x7f48c809d6f0 2023-10-01T07:58:23.903 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:23.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.903+0000 7fa28d901700 1 -- 172.21.15.26:0/3422202487 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa2881b71b0 con 0x7fa28812f8b0 2023-10-01T07:58:23.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.903+0000 7fa26ffff700 1 -- 172.21.15.26:0/3422202487 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa2881b71b0 con 0x7fa28812f8b0 2023-10-01T07:58:23.904 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:23.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.904+0000 7f5e652fc700 1 -- 172.21.15.26:0/1074884968 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5e60070b80 con 0x7f5e6006fb20 2023-10-01T07:58:23.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.904+0000 7f5e477fe700 1 -- 172.21.15.26:0/1074884968 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5e5000ead0 con 0x7f5e6006fb20 2023-10-01T07:58:23.905 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:23.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.906+0000 7fa28d901700 1 -- 172.21.15.26:0/3422202487 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa28812f8b0 msgr2=0x7fa2881d5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:23.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.906+0000 7fa28d901700 1 --2- 172.21.15.26:0/3422202487 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa28812f8b0 0x7fa2881d5470 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fa27c009bc0 tx=0x7fa27c004750 comp rx=0 tx=0).stop 2023-10-01T07:58:23.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.906+0000 7fa28d901700 1 -- 172.21.15.26:0/3422202487 shutdown_connections 2023-10-01T07:58:23.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.906+0000 7fa28d901700 1 --2- 172.21.15.26:0/3422202487 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa288130260 0x7fa2881d59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.906+0000 7fa28d901700 1 --2- 172.21.15.26:0/3422202487 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa28812cf60 0x7fa2881d4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.906+0000 7fa28d901700 1 --2- 172.21.15.26:0/3422202487 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa28812f8b0 0x7fa2881d5470 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.906+0000 7fa28d901700 1 -- 172.21.15.26:0/3422202487 >> 172.21.15.26:0/3422202487 conn(0x7fa2880a2aa0 msgr2=0x7fa28806e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:23.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.906+0000 7f48d03a7700 1 -- 172.21.15.26:0/2413339806 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48c809d6f0 msgr2=0x7f48c8137fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:23.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.906+0000 7f48d03a7700 1 --2- 172.21.15.26:0/2413339806 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48c809d6f0 0x7f48c8137fb0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f48c400c450 tx=0x7f48c400c760 comp rx=0 tx=0).stop 2023-10-01T07:58:23.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.906+0000 7fa28d901700 1 -- 172.21.15.26:0/3422202487 shutdown_connections 2023-10-01T07:58:23.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.906+0000 7fa28d901700 1 -- 172.21.15.26:0/3422202487 wait complete. 2023-10-01T07:58:23.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.907+0000 7f48d03a7700 1 -- 172.21.15.26:0/2413339806 shutdown_connections 2023-10-01T07:58:23.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.907+0000 7f48d03a7700 1 --2- 172.21.15.26:0/2413339806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48c8135e50 0x7f48c8138a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.907+0000 7f48d03a7700 1 --2- 172.21.15.26:0/2413339806 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48c809d6f0 0x7f48c8137fb0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.907+0000 7f48d03a7700 1 --2- 172.21.15.26:0/2413339806 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48c809e1d0 0x7f48c81384f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.907+0000 7f48d03a7700 1 -- 172.21.15.26:0/2413339806 >> 172.21.15.26:0/2413339806 conn(0x7f48c8066f50 msgr2=0x7f48c80a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:23.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.907+0000 7f5e652fc700 1 -- 172.21.15.26:0/1074884968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5e6006fb20 msgr2=0x7f5e60118cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:23.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.907+0000 7f5e652fc700 1 --2- 172.21.15.26:0/1074884968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5e6006fb20 0x7f5e60118cd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5e5000c750 tx=0x7f5e5000ca60 comp rx=0 tx=0).stop 2023-10-01T07:58:23.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.907+0000 7f48d03a7700 1 -- 172.21.15.26:0/2413339806 shutdown_connections 2023-10-01T07:58:23.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.907+0000 7f48d03a7700 1 -- 172.21.15.26:0/2413339806 wait complete. 2023-10-01T07:58:23.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.907+0000 7f5e652fc700 1 -- 172.21.15.26:0/1074884968 shutdown_connections 2023-10-01T07:58:23.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.907+0000 7f5e652fc700 1 --2- 172.21.15.26:0/1074884968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e60130e50 0x7f5e60119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.907+0000 7f5e652fc700 1 --2- 172.21.15.26:0/1074884968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5e6006fb20 0x7f5e60118cd0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.907+0000 7f5e652fc700 1 --2- 172.21.15.26:0/1074884968 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5e60130540 0x7f5e60119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.907+0000 7f5e652fc700 1 -- 172.21.15.26:0/1074884968 >> 172.21.15.26:0/1074884968 conn(0x7f5e600a2aa0 msgr2=0x7f5e6012d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:23.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.907+0000 7f5e652fc700 1 -- 172.21.15.26:0/1074884968 shutdown_connections 2023-10-01T07:58:23.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.907+0000 7f5e652fc700 1 -- 172.21.15.26:0/1074884968 wait complete. 2023-10-01T07:58:23.924 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:23.925 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:23.925 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:23.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.933+0000 7f7b09aee700 1 -- 172.21.15.26:0/1389249658 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7b04072840 con 0x7f7b0409c650 2023-10-01T07:58:23.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.933+0000 7f7aebfff700 1 -- 172.21.15.26:0/1389249658 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7af403ee60 con 0x7f7b0409c650 2023-10-01T07:58:23.934 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:23.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.936+0000 7f7b09aee700 1 -- 172.21.15.26:0/1389249658 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7b0409c650 msgr2=0x7f7b041c52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:23.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.936+0000 7f7b09aee700 1 --2- 172.21.15.26:0/1389249658 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7b0409c650 0x7f7b041c52b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7af4016000 tx=0x7f7af4004750 comp rx=0 tx=0).stop 2023-10-01T07:58:23.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.936+0000 7f7b09aee700 1 -- 172.21.15.26:0/1389249658 shutdown_connections 2023-10-01T07:58:23.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.936+0000 7f7b09aee700 1 --2- 172.21.15.26:0/1389249658 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7b04131970 0x7f7b041c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.936+0000 7f7b09aee700 1 --2- 172.21.15.26:0/1389249658 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7b0409c650 0x7f7b041c52b0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.936+0000 7f7b09aee700 1 --2- 172.21.15.26:0/1389249658 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b040a0090 0x7f7b041c57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:23.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.936+0000 7f7b09aee700 1 -- 172.21.15.26:0/1389249658 >> 172.21.15.26:0/1389249658 conn(0x7f7b040a3f70 msgr2=0x7f7b0409eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:23.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.936+0000 7f7b09aee700 1 -- 172.21.15.26:0/1389249658 shutdown_connections 2023-10-01T07:58:23.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:23.936+0000 7f7b09aee700 1 -- 172.21.15.26:0/1389249658 wait complete. 2023-10-01T07:58:23.950 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:24.925 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:24.926 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:24.926 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:24.951 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:25.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.081+0000 7f1a20ee0700 1 Processor -- start 2023-10-01T07:58:25.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.081+0000 7f6957607700 1 Processor -- start 2023-10-01T07:58:25.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.081+0000 7f1a20ee0700 1 -- start start 2023-10-01T07:58:25.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.081+0000 7f6957607700 1 -- start start 2023-10-01T07:58:25.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.081+0000 7f1a20ee0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1a1c09d6f0 0x7f1a1c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:25.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.081+0000 7f1a20ee0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1a1c09e410 0x7f1a1c130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:25.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.082+0000 7f1a20ee0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a1c09f130 con 0x7f1a1c09e000 2023-10-01T07:58:25.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.082+0000 7f1a20ee0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a1c09f520 con 0x7f1a1c09e410 2023-10-01T07:58:25.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.082+0000 7f1a20ee0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c09e930 con 0x7f1a1c09d6f0 2023-10-01T07:58:25.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.082+0000 7f1a1a59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1a1c09d6f0 0x7f1a1c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:25.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.082+0000 7f1a1a59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1a1c09d6f0 0x7f1a1c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41224/0 (socket says 172.21.15.26:41224) 2023-10-01T07:58:25.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.082+0000 7f1a1a59c700 1 -- 172.21.15.26:0/3050969419 learned_addr learned my addr 172.21.15.26:0/3050969419 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:25.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.082+0000 7f1a1ad9d700 1 --2- 172.21.15.26:0/3050969419 >> v2:172.21.15.26:3300/0 conn(0x7f1a1c09e410 0x7f1a1c130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:25.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.082+0000 7f6957607700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6950133510 0x7f69501358f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:25.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.082+0000 7f6957607700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6950135e30 0x7f6950138210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:25.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.082+0000 7f6957607700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6950130260 con 0x7f6950130670 2023-10-01T07:58:25.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.082+0000 7f6957607700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695009a350 con 0x7f6950135e30 2023-10-01T07:58:25.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.082+0000 7f6957607700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6950071ff0 con 0x7f6950133510 2023-10-01T07:58:25.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.082+0000 7f1a1a59c700 1 -- 172.21.15.26:0/3050969419 >> v2:172.21.15.26:3300/0 conn(0x7f1a1c09e410 msgr2=0x7f1a1c130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:25.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.082+0000 7f1a1a59c700 1 --2- 172.21.15.26:0/3050969419 >> v2:172.21.15.26:3300/0 conn(0x7f1a1c09e410 0x7f1a1c130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:25.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.082+0000 7f1a1a59c700 1 -- 172.21.15.26:0/3050969419 >> v1:172.21.15.26:6789/0 conn(0x7f1a1c09e000 legacy=0x7f1a1c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:25.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.082+0000 7f1a1a59c700 1 -- 172.21.15.26:0/3050969419 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1c09b2d0 con 0x7f1a1c09d6f0 2023-10-01T07:58:25.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.082+0000 7f6955ba4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6950135e30 0x7f6950138210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:25.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.082+0000 7f6955ba4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6950135e30 0x7f6950138210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34054/0 (socket says 172.21.15.26:34054) 2023-10-01T07:58:25.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.082+0000 7f6955ba4700 1 -- 172.21.15.26:0/1199388102 learned_addr learned my addr 172.21.15.26:0/1199388102 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:25.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.083+0000 7f1a1a59c700 1 --2- 172.21.15.26:0/3050969419 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1a1c09d6f0 0x7f1a1c09dac0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c0098f0 tx=0x7f1a0c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4dff26341c76fed server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:25.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.083+0000 7f6954ba2700 1 --2- 172.21.15.26:0/1199388102 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6950133510 0x7f69501358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:25.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.083+0000 7f6955ba4700 1 -- 172.21.15.26:0/1199388102 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6950133510 msgr2=0x7f69501358f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:25.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.083+0000 7f6955ba4700 1 --2- 172.21.15.26:0/1199388102 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6950133510 0x7f69501358f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:25.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.083+0000 7f6955ba4700 1 -- 172.21.15.26:0/1199388102 >> v1:172.21.15.26:6789/0 conn(0x7f6950130670 legacy=0x7f6950130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:25.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.083+0000 7f1a1959a700 1 -- 172.21.15.26:0/3050969419 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c011830 con 0x7f1a1c09d6f0 2023-10-01T07:58:25.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.083+0000 7f1a1959a700 1 -- 172.21.15.26:0/3050969419 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0c011990 con 0x7f1a1c09d6f0 2023-10-01T07:58:25.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.083+0000 7f1a1959a700 1 -- 172.21.15.26:0/3050969419 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c011d00 con 0x7f1a1c09d6f0 2023-10-01T07:58:25.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.083+0000 7f6947fff700 1 -- 172.21.15.26:0/1199388102 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1061682995 0 0) 0x7f6950130260 con 0x7f6950130670 2023-10-01T07:58:25.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.083+0000 7f6955ba4700 1 -- 172.21.15.26:0/1199388102 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695009ecf0 con 0x7f6950135e30 2023-10-01T07:58:25.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.083+0000 7f6955ba4700 1 --2- 172.21.15.26:0/1199388102 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6950135e30 0x7f6950138210 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f694800d180 tx=0x7f694800d490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=539dfe3204c06cd2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:25.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.084+0000 7f6954ba2700 1 --2- 172.21.15.26:0/1199388102 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6950133510 0x7f69501358f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:58:25.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.084+0000 7f6947fff700 1 -- 172.21.15.26:0/1199388102 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6948010070 con 0x7f6950135e30 2023-10-01T07:58:25.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.084+0000 7f6947fff700 1 -- 172.21.15.26:0/1199388102 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694800ddf0 con 0x7f6950135e30 2023-10-01T07:58:25.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.084+0000 7f6947fff700 1 -- 172.21.15.26:0/1199388102 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694800b310 con 0x7f6950135e30 2023-10-01T07:58:25.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.084+0000 7f1a20ee0700 1 -- 172.21.15.26:0/3050969419 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1a1c09d6f0 msgr2=0x7f1a1c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:25.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.084+0000 7f1a20ee0700 1 --2- 172.21.15.26:0/3050969419 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1a1c09d6f0 0x7f1a1c09dac0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c0098f0 tx=0x7f1a0c009c00 comp rx=0 tx=0).stop 2023-10-01T07:58:25.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.084+0000 7f1a20ee0700 1 -- 172.21.15.26:0/3050969419 shutdown_connections 2023-10-01T07:58:25.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.084+0000 7f1a20ee0700 1 --2- 172.21.15.26:0/3050969419 >> v2:172.21.15.26:3300/0 conn(0x7f1a1c09e410 0x7f1a1c130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:25.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.084+0000 7f1a20ee0700 1 --2- 172.21.15.26:0/3050969419 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1a1c09d6f0 0x7f1a1c09dac0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:25.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.084+0000 7f1a20ee0700 1 -- 172.21.15.26:0/3050969419 >> 172.21.15.26:0/3050969419 conn(0x7f1a1c066f50 msgr2=0x7f1a1c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:25.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.084+0000 7f1a20ee0700 1 -- 172.21.15.26:0/3050969419 shutdown_connections 2023-10-01T07:58:25.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.084+0000 7f1a20ee0700 1 -- 172.21.15.26:0/3050969419 wait complete. 2023-10-01T07:58:25.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.084+0000 7f6957607700 1 -- 172.21.15.26:0/1199388102 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6950135e30 msgr2=0x7f6950138210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:25.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.084+0000 7f6957607700 1 --2- 172.21.15.26:0/1199388102 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6950135e30 0x7f6950138210 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f694800d180 tx=0x7f694800d490 comp rx=0 tx=0).stop 2023-10-01T07:58:25.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.084+0000 7f6957607700 1 -- 172.21.15.26:0/1199388102 shutdown_connections 2023-10-01T07:58:25.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.084+0000 7f6957607700 1 --2- 172.21.15.26:0/1199388102 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6950135e30 0x7f6950138210 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:25.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.084+0000 7f6957607700 1 --2- 172.21.15.26:0/1199388102 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6950133510 0x7f69501358f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:25.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.084+0000 7f6957607700 1 -- 172.21.15.26:0/1199388102 >> 172.21.15.26:0/1199388102 conn(0x7f69500a2aa0 msgr2=0x7f69500a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:25.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.085+0000 7f6957607700 1 -- 172.21.15.26:0/1199388102 shutdown_connections 2023-10-01T07:58:25.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.085+0000 7f6957607700 1 -- 172.21.15.26:0/1199388102 wait complete. 2023-10-01T07:58:25.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.085+0000 7f1a20ee0700 1 Processor -- start 2023-10-01T07:58:25.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.085+0000 7f1a20ee0700 1 -- start start 2023-10-01T07:58:25.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.086+0000 7f6957607700 1 Processor -- start 2023-10-01T07:58:25.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.086+0000 7f6957607700 1 -- start start 2023-10-01T07:58:25.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.086+0000 7f6957607700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6950130670 0x7f69501c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:25.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.086+0000 7f1a20ee0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1a1c09d6f0 0x7f1a1c119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:25.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.086+0000 7f1a20ee0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a1c09e000 0x7f1a1c1199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:25.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.086+0000 7f1a20ee0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1a1c09e410 0x7f1a1c119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:25.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.086+0000 7f6957607700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6950133510 0x7f69501c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:25.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.086+0000 7f6957607700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6950135e30 0x7f69501c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:25.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.086+0000 7f6957607700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695009e3f0 con 0x7f6950133510 2023-10-01T07:58:25.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.086+0000 7f6957607700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695009e200 con 0x7f6950135e30 2023-10-01T07:58:25.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.086+0000 7f6957607700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f695012dba0 con 0x7f6950130670 2023-10-01T07:58:25.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.086+0000 7f69553a3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6950130670 0x7f69501c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:25.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.086+0000 7f6955ba4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6950135e30 0x7f69501c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:25.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.087+0000 7f69553a3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6950130670 0x7f69501c8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41248/0 (socket says 172.21.15.26:41248) 2023-10-01T07:58:25.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.087+0000 7f6955ba4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6950135e30 0x7f69501c8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34064/0 (socket says 172.21.15.26:34064) 2023-10-01T07:58:25.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.087+0000 7f69553a3700 1 -- 172.21.15.26:0/1010547320 learned_addr learned my addr 172.21.15.26:0/1010547320 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:25.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.086+0000 7f1a20ee0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c11d030 con 0x7f1a1c09e000 2023-10-01T07:58:25.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.086+0000 7f1a20ee0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c11c650 con 0x7f1a1c09e410 2023-10-01T07:58:25.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.086+0000 7f1a20ee0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c072470 con 0x7f1a1c09d6f0 2023-10-01T07:58:25.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.086+0000 7f1a1a59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1a1c09d6f0 0x7f1a1c119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:25.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.087+0000 7f1a1a59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1a1c09d6f0 0x7f1a1c119480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41238/0 (socket says 172.21.15.26:41238) 2023-10-01T07:58:25.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.087+0000 7f1a1a59c700 1 -- 172.21.15.26:0/1682391226 learned_addr learned my addr 172.21.15.26:0/1682391226 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:25.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.087+0000 7f6954ba2700 1 --2- 172.21.15.26:0/1010547320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6950133510 0x7f69501c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:25.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.087+0000 7f1a1ad9d700 1 --2- 172.21.15.26:0/1682391226 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1a1c09e410 0x7f1a1c119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:25.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.087+0000 7f1a19d9b700 1 --2- 172.21.15.26:0/1682391226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a1c09e000 0x7f1a1c1199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:25.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.087+0000 7f6955ba4700 1 -- 172.21.15.26:0/1010547320 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6950130670 msgr2=0x7f69501c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:25.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.087+0000 7f6955ba4700 1 --2- 172.21.15.26:0/1010547320 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6950130670 0x7f69501c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:25.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.087+0000 7f6955ba4700 1 -- 172.21.15.26:0/1010547320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6950133510 msgr2=0x7f69501c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:25.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.087+0000 7f6955ba4700 1 --2- 172.21.15.26:0/1010547320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6950133510 0x7f69501c8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:25.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.087+0000 7f6955ba4700 1 -- 172.21.15.26:0/1010547320 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f694800bd40 con 0x7f6950135e30 2023-10-01T07:58:25.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.087+0000 7f1a1a59c700 1 -- 172.21.15.26:0/1682391226 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1a1c09e410 msgr2=0x7f1a1c119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:25.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.087+0000 7f1a1a59c700 1 --2- 172.21.15.26:0/1682391226 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1a1c09e410 0x7f1a1c119f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:25.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.087+0000 7f1a1a59c700 1 -- 172.21.15.26:0/1682391226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a1c09e000 msgr2=0x7f1a1c1199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:25.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.087+0000 7f1a1a59c700 1 --2- 172.21.15.26:0/1682391226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a1c09e000 0x7f1a1c1199c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:25.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.087+0000 7f1a1a59c700 1 -- 172.21.15.26:0/1682391226 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a0c009550 con 0x7f1a1c09d6f0 2023-10-01T07:58:25.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.087+0000 7f1a1a59c700 1 --2- 172.21.15.26:0/1682391226 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1a1c09d6f0 0x7f1a1c119480 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c009f50 tx=0x7f1a0c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:25.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.087+0000 7f6955ba4700 1 --2- 172.21.15.26:0/1010547320 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6950135e30 0x7f69501c8ad0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f6950071280 tx=0x7f6948004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:25.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.087+0000 7f6945ffb700 1 -- 172.21.15.26:0/1010547320 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6948009a10 con 0x7f6950135e30 2023-10-01T07:58:25.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.088+0000 7f6945ffb700 1 -- 172.21.15.26:0/1010547320 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6948009bb0 con 0x7f6950135e30 2023-10-01T07:58:25.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.087+0000 7f1a0affd700 1 -- 172.21.15.26:0/1682391226 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c0036a0 con 0x7f1a1c09d6f0 2023-10-01T07:58:25.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.088+0000 7f1a0affd700 1 -- 172.21.15.26:0/1682391226 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0c003800 con 0x7f1a1c09d6f0 2023-10-01T07:58:25.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.088+0000 7f1a20ee0700 1 -- 172.21.15.26:0/1682391226 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a1c09c700 con 0x7f1a1c09d6f0 2023-10-01T07:58:25.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.088+0000 7f1a0affd700 1 -- 172.21.15.26:0/1682391226 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c003bb0 con 0x7f1a1c09d6f0 2023-10-01T07:58:25.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.088+0000 7f1a20ee0700 1 -- 172.21.15.26:0/1682391226 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a1c11bde0 con 0x7f1a1c09d6f0 2023-10-01T07:58:25.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.088+0000 7f6945ffb700 1 -- 172.21.15.26:0/1010547320 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6948004040 con 0x7f6950135e30 2023-10-01T07:58:25.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.089+0000 7f6957607700 1 -- 172.21.15.26:0/1010547320 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f695011ead0 con 0x7f6950135e30 2023-10-01T07:58:25.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.089+0000 7f61b1d27700 1 Processor -- start 2023-10-01T07:58:25.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.089+0000 7f61b1d27700 1 -- start start 2023-10-01T07:58:25.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.088+0000 7f1a0affd700 1 -- 172.21.15.26:0/1682391226 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1a0c021070 con 0x7f1a1c09d6f0 2023-10-01T07:58:25.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.089+0000 7f1a0affd700 1 -- 172.21.15.26:0/1682391226 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1a0c040f60 con 0x7f1a1c09d6f0 2023-10-01T07:58:25.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.089+0000 7f6957607700 1 -- 172.21.15.26:0/1010547320 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f695011e7f0 con 0x7f6950135e30 2023-10-01T07:58:25.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.089+0000 7f1a20ee0700 1 -- 172.21.15.26:0/1682391226 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a000052e0 con 0x7f1a1c09d6f0 2023-10-01T07:58:25.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.090+0000 7f61b1d27700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61ac06ccc0 0x7f61ac0a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:25.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.090+0000 7f61b1d27700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f61ac13d130 0x7f61ac13f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:25.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.090+0000 7f61b1d27700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61ac0a27e0 con 0x7f61ac0a2360 2023-10-01T07:58:25.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.090+0000 7f61b1d27700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac0a1dc0 con 0x7f61ac06ccc0 2023-10-01T07:58:25.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.090+0000 7f61b1d27700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac09dde0 con 0x7f61ac13d130 2023-10-01T07:58:25.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.090+0000 7f61ab7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61ac06ccc0 0x7f61ac0a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:25.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.090+0000 7f61ab7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61ac06ccc0 0x7f61ac0a0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34084/0 (socket says 172.21.15.26:34084) 2023-10-01T07:58:25.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.090+0000 7f61ab7fe700 1 -- 172.21.15.26:0/3147853351 learned_addr learned my addr 172.21.15.26:0/3147853351 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:25.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.090+0000 7f61abfff700 1 --2- 172.21.15.26:0/3147853351 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f61ac13d130 0x7f61ac13f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:25.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.090+0000 7f6945ffb700 1 -- 172.21.15.26:0/1010547320 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f69480041a0 con 0x7f6950135e30 2023-10-01T07:58:25.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.090+0000 7f61ab7fe700 1 -- 172.21.15.26:0/3147853351 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f61ac13d130 msgr2=0x7f61ac13f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:25.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.090+0000 7f61ab7fe700 1 --2- 172.21.15.26:0/3147853351 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f61ac13d130 0x7f61ac13f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:25.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.090+0000 7f61ab7fe700 1 -- 172.21.15.26:0/3147853351 >> v1:172.21.15.26:6789/0 conn(0x7f61ac0a2360 legacy=0x7f61ac0a0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:25.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.090+0000 7f61ab7fe700 1 -- 172.21.15.26:0/3147853351 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ac071b00 con 0x7f61ac06ccc0 2023-10-01T07:58:25.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.090+0000 7f6945ffb700 1 -- 172.21.15.26:0/1010547320 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6948041040 con 0x7f6950135e30 2023-10-01T07:58:25.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.090+0000 7f61abfff700 1 --2- 172.21.15.26:0/3147853351 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f61ac13d130 0x7f61ac13f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:25.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.091+0000 7f61ab7fe700 1 --2- 172.21.15.26:0/3147853351 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61ac06ccc0 0x7f61ac0a0a30 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f61a0009920 tx=0x7f61a0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f3f3ae3e36a139c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:25.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.091+0000 7f6957607700 1 -- 172.21.15.26:0/1010547320 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6950071850 con 0x7f6950135e30 2023-10-01T07:58:25.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.091+0000 7f61aa7fc700 1 -- 172.21.15.26:0/3147853351 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a0011830 con 0x7f61ac06ccc0 2023-10-01T07:58:25.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.091+0000 7f61aa7fc700 1 -- 172.21.15.26:0/3147853351 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a0011990 con 0x7f61ac06ccc0 2023-10-01T07:58:25.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.091+0000 7f61aa7fc700 1 -- 172.21.15.26:0/3147853351 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a0011d20 con 0x7f61ac06ccc0 2023-10-01T07:58:25.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.092+0000 7f61b1d27700 1 -- 172.21.15.26:0/3147853351 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61ac06ccc0 msgr2=0x7f61ac0a0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:25.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.092+0000 7f61b1d27700 1 --2- 172.21.15.26:0/3147853351 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61ac06ccc0 0x7f61ac0a0a30 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f61a0009920 tx=0x7f61a0009c30 comp rx=0 tx=0).stop 2023-10-01T07:58:25.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.094+0000 7f61b1d27700 1 -- 172.21.15.26:0/3147853351 shutdown_connections 2023-10-01T07:58:25.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.094+0000 7f61b1d27700 1 --2- 172.21.15.26:0/3147853351 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f61ac13d130 0x7f61ac13f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:25.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.094+0000 7f61b1d27700 1 --2- 172.21.15.26:0/3147853351 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61ac06ccc0 0x7f61ac0a0a30 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:25.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.094+0000 7f61b1d27700 1 -- 172.21.15.26:0/3147853351 >> 172.21.15.26:0/3147853351 conn(0x7f61ac0a6550 msgr2=0x7f61ac0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:25.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.094+0000 7f61b1d27700 1 -- 172.21.15.26:0/3147853351 shutdown_connections 2023-10-01T07:58:25.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.094+0000 7f61b1d27700 1 -- 172.21.15.26:0/3147853351 wait complete. 2023-10-01T07:58:25.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.095+0000 7f61b1d27700 1 Processor -- start 2023-10-01T07:58:25.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.095+0000 7f61b1d27700 1 -- start start 2023-10-01T07:58:25.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.095+0000 7f1a0affd700 1 -- 172.21.15.26:0/1682391226 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1a0c06c750 con 0x7f1a1c09d6f0 2023-10-01T07:58:25.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.096+0000 7f61b1d27700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61ac06ccc0 0x7f61ac124fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:25.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.096+0000 7f61b1d27700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61ac0a2360 0x7f61ac125510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:25.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.096+0000 7f61b1d27700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f61ac13d130 0x7f61ac125a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:25.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.096+0000 7f61b1d27700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac128510 con 0x7f61ac06ccc0 2023-10-01T07:58:25.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.096+0000 7f61b1d27700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac128760 con 0x7f61ac0a2360 2023-10-01T07:58:25.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.096+0000 7f61b1d27700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac127650 con 0x7f61ac13d130 2023-10-01T07:58:25.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.096+0000 7f61aaffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61ac0a2360 0x7f61ac125510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:25.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.096+0000 7f61aaffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61ac0a2360 0x7f61ac125510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34098/0 (socket says 172.21.15.26:34098) 2023-10-01T07:58:25.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.096+0000 7f61aaffd700 1 -- 172.21.15.26:0/463497338 learned_addr learned my addr 172.21.15.26:0/463497338 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:25.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.096+0000 7f61aaffd700 1 -- 172.21.15.26:0/463497338 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f61ac13d130 msgr2=0x7f61ac125a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:25.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.096+0000 7f61aaffd700 1 --2- 172.21.15.26:0/463497338 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f61ac13d130 0x7f61ac125a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:25.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.096+0000 7f61aaffd700 1 -- 172.21.15.26:0/463497338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61ac06ccc0 msgr2=0x7f61ac124fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:25.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.096+0000 7f61aaffd700 1 --2- 172.21.15.26:0/463497338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61ac06ccc0 0x7f61ac124fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:25.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.096+0000 7f61aaffd700 1 -- 172.21.15.26:0/463497338 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a4009a70 con 0x7f61ac0a2360 2023-10-01T07:58:25.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.096+0000 7f61aaffd700 1 --2- 172.21.15.26:0/463497338 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61ac0a2360 0x7f61ac125510 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f619c00c480 tx=0x7f619c00c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:25.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.100+0000 7f6193fff700 1 -- 172.21.15.26:0/463497338 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c0052d0 con 0x7f61ac0a2360 2023-10-01T07:58:25.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.100+0000 7f6193fff700 1 -- 172.21.15.26:0/463497338 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619c005430 con 0x7f61ac0a2360 2023-10-01T07:58:25.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.100+0000 7f61b1d27700 1 -- 172.21.15.26:0/463497338 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61a0009550 con 0x7f61ac0a2360 2023-10-01T07:58:25.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.100+0000 7f6945ffb700 1 -- 172.21.15.26:0/1010547320 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6948004450 con 0x7f6950135e30 2023-10-01T07:58:25.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.100+0000 7f6193fff700 1 -- 172.21.15.26:0/463497338 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c0038c0 con 0x7f61ac0a2360 2023-10-01T07:58:25.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.100+0000 7f61b1d27700 1 -- 172.21.15.26:0/463497338 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61ac126910 con 0x7f61ac0a2360 2023-10-01T07:58:25.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.101+0000 7f61b1d27700 1 -- 172.21.15.26:0/463497338 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61ac074ea0 con 0x7f61ac0a2360 2023-10-01T07:58:25.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.102+0000 7f6193fff700 1 -- 172.21.15.26:0/463497338 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f619c003a20 con 0x7f61ac0a2360 2023-10-01T07:58:25.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.102+0000 7f6193fff700 1 -- 172.21.15.26:0/463497338 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f619c03eb40 con 0x7f61ac0a2360 2023-10-01T07:58:25.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.107+0000 7f6193fff700 1 -- 172.21.15.26:0/463497338 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f619c019e60 con 0x7f61ac0a2360 2023-10-01T07:58:25.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.140+0000 7f97f6ab0700 1 Processor -- start 2023-10-01T07:58:25.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.140+0000 7f97f6ab0700 1 -- start start 2023-10-01T07:58:25.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.141+0000 7f97f6ab0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f97f01338a0 0x7f97f0133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:25.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.141+0000 7f97f6ab0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97f009de50 0x7f97f009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:25.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.141+0000 7f97f6ab0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97f006ef30 con 0x7f97f009e760 2023-10-01T07:58:25.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.141+0000 7f97f6ab0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f006fef0 con 0x7f97f01338a0 2023-10-01T07:58:25.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.141+0000 7f97f6ab0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f01334b0 con 0x7f97f009de50 2023-10-01T07:58:25.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.141+0000 7f97effff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97f009de50 0x7f97f009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:25.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.141+0000 7f97f484c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f97f01338a0 0x7f97f0133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:25.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.142+0000 7f97f484c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f97f01338a0 0x7f97f0133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49932/0 (socket says 172.21.15.26:49932) 2023-10-01T07:58:25.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.142+0000 7f97effff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97f009de50 0x7f97f009e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34112/0 (socket says 172.21.15.26:34112) 2023-10-01T07:58:25.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.142+0000 7f97f484c700 1 -- 172.21.15.26:0/3915651882 learned_addr learned my addr 172.21.15.26:0/3915651882 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:25.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.142+0000 7f97effff700 1 -- 172.21.15.26:0/3915651882 >> v2:172.21.15.26:3300/0 conn(0x7f97f01338a0 msgr2=0x7f97f0133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:25.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.142+0000 7f97effff700 1 --2- 172.21.15.26:0/3915651882 >> v2:172.21.15.26:3300/0 conn(0x7f97f01338a0 0x7f97f0133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:25.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.142+0000 7f97effff700 1 -- 172.21.15.26:0/3915651882 >> v1:172.21.15.26:6789/0 conn(0x7f97f009e760 legacy=0x7f97f013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:25.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.142+0000 7f97effff700 1 -- 172.21.15.26:0/3915651882 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f006fc30 con 0x7f97f009de50 2023-10-01T07:58:25.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.142+0000 7f97effff700 1 --2- 172.21.15.26:0/3915651882 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97f009de50 0x7f97f009e220 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f97dc009840 tx=0x7f97dc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db95fe4fba81e4db server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:25.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.142+0000 7f97ef7fe700 1 -- 172.21.15.26:0/3915651882 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc011830 con 0x7f97f009de50 2023-10-01T07:58:25.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.142+0000 7f97ef7fe700 1 -- 172.21.15.26:0/3915651882 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97dc011990 con 0x7f97f009de50 2023-10-01T07:58:25.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.142+0000 7f97ef7fe700 1 -- 172.21.15.26:0/3915651882 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc011d20 con 0x7f97f009de50 2023-10-01T07:58:25.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.143+0000 7f97f6ab0700 1 -- 172.21.15.26:0/3915651882 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97f009de50 msgr2=0x7f97f009e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:25.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.143+0000 7f97f6ab0700 1 --2- 172.21.15.26:0/3915651882 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97f009de50 0x7f97f009e220 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f97dc009840 tx=0x7f97dc009b50 comp rx=0 tx=0).stop 2023-10-01T07:58:25.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.143+0000 7f97f6ab0700 1 -- 172.21.15.26:0/3915651882 shutdown_connections 2023-10-01T07:58:25.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.143+0000 7f97f6ab0700 1 --2- 172.21.15.26:0/3915651882 >> v2:172.21.15.26:3300/0 conn(0x7f97f01338a0 0x7f97f0133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:25.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.143+0000 7f97f6ab0700 1 --2- 172.21.15.26:0/3915651882 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97f009de50 0x7f97f009e220 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:25.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.143+0000 7f97f6ab0700 1 -- 172.21.15.26:0/3915651882 >> 172.21.15.26:0/3915651882 conn(0x7f97f00a2aa0 msgr2=0x7f97f00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:25.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.144+0000 7f97f6ab0700 1 -- 172.21.15.26:0/3915651882 shutdown_connections 2023-10-01T07:58:25.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.144+0000 7f97f6ab0700 1 -- 172.21.15.26:0/3915651882 wait complete. 2023-10-01T07:58:25.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.145+0000 7f97f6ab0700 1 Processor -- start 2023-10-01T07:58:25.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.145+0000 7f97f6ab0700 1 -- start start 2023-10-01T07:58:25.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.146+0000 7f97f6ab0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97f009de50 0x7f97f011ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:25.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.146+0000 7f97f6ab0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97f009e760 0x7f97f011efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:25.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.146+0000 7f97f6ab0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97f01338a0 0x7f97f011f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:25.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.146+0000 7f97f6ab0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f006f640 con 0x7f97f009e760 2023-10-01T07:58:25.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.146+0000 7f97f6ab0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f01222b0 con 0x7f97f009de50 2023-10-01T07:58:25.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.146+0000 7f97f6ab0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97f0120790 con 0x7f97f01338a0 2023-10-01T07:58:25.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.146+0000 7f97f484c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97f009de50 0x7f97f011ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:25.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.146+0000 7f97f484c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97f009de50 0x7f97f011ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34114/0 (socket says 172.21.15.26:34114) 2023-10-01T07:58:25.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.146+0000 7f97f484c700 1 -- 172.21.15.26:0/4253008917 learned_addr learned my addr 172.21.15.26:0/4253008917 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:25.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.147+0000 7f97f504d700 1 --2- 172.21.15.26:0/4253008917 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97f01338a0 0x7f97f011f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:25.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.147+0000 7f97effff700 1 --2- 172.21.15.26:0/4253008917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97f009e760 0x7f97f011efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:25.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.147+0000 7f97f504d700 1 -- 172.21.15.26:0/4253008917 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97f009de50 msgr2=0x7f97f011ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:25.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.147+0000 7f97f504d700 1 --2- 172.21.15.26:0/4253008917 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97f009de50 0x7f97f011ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:25.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.147+0000 7f97f504d700 1 -- 172.21.15.26:0/4253008917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97f009e760 msgr2=0x7f97f011efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:25.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.147+0000 7f97f504d700 1 --2- 172.21.15.26:0/4253008917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97f009e760 0x7f97f011efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:25.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.147+0000 7f97f504d700 1 -- 172.21.15.26:0/4253008917 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97dc0094a0 con 0x7f97f01338a0 2023-10-01T07:58:25.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.147+0000 7f97effff700 1 --2- 172.21.15.26:0/4253008917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97f009e760 0x7f97f011efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:58:25.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.147+0000 7f97f504d700 1 --2- 172.21.15.26:0/4253008917 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97f01338a0 0x7f97f011f4f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f97e800cbc0 tx=0x7f97e800ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:25.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.148+0000 7f97ed7fa700 1 -- 172.21.15.26:0/4253008917 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e8003c00 con 0x7f97f01338a0 2023-10-01T07:58:25.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.148+0000 7f97ed7fa700 1 -- 172.21.15.26:0/4253008917 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e8003d60 con 0x7f97f01338a0 2023-10-01T07:58:25.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.148+0000 7f97f6ab0700 1 -- 172.21.15.26:0/4253008917 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f00a1000 con 0x7f97f01338a0 2023-10-01T07:58:25.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.148+0000 7f97ed7fa700 1 -- 172.21.15.26:0/4253008917 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e800aaa0 con 0x7f97f01338a0 2023-10-01T07:58:25.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.148+0000 7f97f6ab0700 1 -- 172.21.15.26:0/4253008917 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f0122d20 con 0x7f97f01338a0 2023-10-01T07:58:25.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.149+0000 7f97f6ab0700 1 -- 172.21.15.26:0/4253008917 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f0074ea0 con 0x7f97f01338a0 2023-10-01T07:58:25.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.153+0000 7f97ed7fa700 1 -- 172.21.15.26:0/4253008917 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f97e800ac00 con 0x7f97f01338a0 2023-10-01T07:58:25.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.153+0000 7f97ed7fa700 1 -- 172.21.15.26:0/4253008917 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f97e8040160 con 0x7f97f01338a0 2023-10-01T07:58:25.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.161+0000 7f97ed7fa700 1 -- 172.21.15.26:0/4253008917 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f97e80050d0 con 0x7f97f01338a0 2023-10-01T07:58:25.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.313+0000 7f1a20ee0700 1 -- 172.21.15.26:0/1682391226 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1a00005590 con 0x7f1a1c09d6f0 2023-10-01T07:58:25.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.313+0000 7f1a0affd700 1 -- 172.21.15.26:0/1682391226 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1a0c033090 con 0x7f1a1c09d6f0 2023-10-01T07:58:25.314 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:25.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.316+0000 7f1a20ee0700 1 -- 172.21.15.26:0/1682391226 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1a1c09d6f0 msgr2=0x7f1a1c119480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:25.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.316+0000 7f1a20ee0700 1 --2- 172.21.15.26:0/1682391226 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1a1c09d6f0 0x7f1a1c119480 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c009f50 tx=0x7f1a0c004750 comp rx=0 tx=0).stop 2023-10-01T07:58:25.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.317+0000 7f1a20ee0700 1 -- 172.21.15.26:0/1682391226 shutdown_connections 2023-10-01T07:58:25.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.317+0000 7f1a20ee0700 1 --2- 172.21.15.26:0/1682391226 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1a1c09e410 0x7f1a1c119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:25.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.317+0000 7f1a20ee0700 1 --2- 172.21.15.26:0/1682391226 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1a1c09d6f0 0x7f1a1c119480 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:25.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.317+0000 7f1a20ee0700 1 --2- 172.21.15.26:0/1682391226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a1c09e000 0x7f1a1c1199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:25.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.317+0000 7f1a20ee0700 1 -- 172.21.15.26:0/1682391226 >> 172.21.15.26:0/1682391226 conn(0x7f1a1c066f50 msgr2=0x7f1a1c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:25.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.317+0000 7f1a20ee0700 1 -- 172.21.15.26:0/1682391226 shutdown_connections 2023-10-01T07:58:25.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.317+0000 7f1a20ee0700 1 -- 172.21.15.26:0/1682391226 wait complete. 2023-10-01T07:58:25.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.320+0000 7f61b1d27700 1 -- 172.21.15.26:0/463497338 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f61ac128120 con 0x7f61ac0a2360 2023-10-01T07:58:25.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.320+0000 7f6193fff700 1 -- 172.21.15.26:0/463497338 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f619c019a70 con 0x7f61ac0a2360 2023-10-01T07:58:25.321 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:25.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.323+0000 7f61b1d27700 1 -- 172.21.15.26:0/463497338 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61ac0a2360 msgr2=0x7f61ac125510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:25.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.323+0000 7f61b1d27700 1 --2- 172.21.15.26:0/463497338 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61ac0a2360 0x7f61ac125510 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f619c00c480 tx=0x7f619c00c840 comp rx=0 tx=0).stop 2023-10-01T07:58:25.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.323+0000 7f61b1d27700 1 -- 172.21.15.26:0/463497338 shutdown_connections 2023-10-01T07:58:25.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.323+0000 7f61b1d27700 1 --2- 172.21.15.26:0/463497338 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f61ac13d130 0x7f61ac125a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:25.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.323+0000 7f61b1d27700 1 --2- 172.21.15.26:0/463497338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61ac06ccc0 0x7f61ac124fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:25.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.323+0000 7f61b1d27700 1 --2- 172.21.15.26:0/463497338 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61ac0a2360 0x7f61ac125510 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:25.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.323+0000 7f61b1d27700 1 -- 172.21.15.26:0/463497338 >> 172.21.15.26:0/463497338 conn(0x7f61ac0a6550 msgr2=0x7f61ac0a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:25.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.323+0000 7f61b1d27700 1 -- 172.21.15.26:0/463497338 shutdown_connections 2023-10-01T07:58:25.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.323+0000 7f61b1d27700 1 -- 172.21.15.26:0/463497338 wait complete. 2023-10-01T07:58:25.333 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:25.339 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:25.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.349+0000 7f6957607700 1 -- 172.21.15.26:0/1010547320 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6950074ea0 con 0x7f6950135e30 2023-10-01T07:58:25.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.349+0000 7f6945ffb700 1 -- 172.21.15.26:0/1010547320 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6948036090 con 0x7f6950135e30 2023-10-01T07:58:25.350 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:25.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.352+0000 7f6957607700 1 -- 172.21.15.26:0/1010547320 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6950135e30 msgr2=0x7f69501c8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:25.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.352+0000 7f6957607700 1 --2- 172.21.15.26:0/1010547320 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6950135e30 0x7f69501c8ad0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f6950071280 tx=0x7f6948004ad0 comp rx=0 tx=0).stop 2023-10-01T07:58:25.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.352+0000 7f6957607700 1 -- 172.21.15.26:0/1010547320 shutdown_connections 2023-10-01T07:58:25.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.352+0000 7f6957607700 1 --2- 172.21.15.26:0/1010547320 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6950135e30 0x7f69501c8ad0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:25.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.352+0000 7f6957607700 1 --2- 172.21.15.26:0/1010547320 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6950130670 0x7f69501c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:25.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.352+0000 7f6957607700 1 --2- 172.21.15.26:0/1010547320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6950133510 0x7f69501c8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:25.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.352+0000 7f6957607700 1 -- 172.21.15.26:0/1010547320 >> 172.21.15.26:0/1010547320 conn(0x7f69500a2aa0 msgr2=0x7f6950132390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:25.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.352+0000 7f6957607700 1 -- 172.21.15.26:0/1010547320 shutdown_connections 2023-10-01T07:58:25.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.352+0000 7f6957607700 1 -- 172.21.15.26:0/1010547320 wait complete. 2023-10-01T07:58:25.366 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:25.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.393+0000 7f97f6ab0700 1 -- 172.21.15.26:0/4253008917 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f97f01223f0 con 0x7f97f01338a0 2023-10-01T07:58:25.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.393+0000 7f97ed7fa700 1 -- 172.21.15.26:0/4253008917 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f97f01223f0 con 0x7f97f01338a0 2023-10-01T07:58:25.394 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:25.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.395+0000 7f97f6ab0700 1 -- 172.21.15.26:0/4253008917 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97f01338a0 msgr2=0x7f97f011f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:25.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.395+0000 7f97f6ab0700 1 --2- 172.21.15.26:0/4253008917 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97f01338a0 0x7f97f011f4f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f97e800cbc0 tx=0x7f97e800ced0 comp rx=0 tx=0).stop 2023-10-01T07:58:25.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.396+0000 7f97f6ab0700 1 -- 172.21.15.26:0/4253008917 shutdown_connections 2023-10-01T07:58:25.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.396+0000 7f97f6ab0700 1 --2- 172.21.15.26:0/4253008917 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97f01338a0 0x7f97f011f4f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:25.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.396+0000 7f97f6ab0700 1 --2- 172.21.15.26:0/4253008917 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97f009de50 0x7f97f011ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:25.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.396+0000 7f97f6ab0700 1 --2- 172.21.15.26:0/4253008917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97f009e760 0x7f97f011efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:25.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.396+0000 7f97f6ab0700 1 -- 172.21.15.26:0/4253008917 >> 172.21.15.26:0/4253008917 conn(0x7f97f00a2aa0 msgr2=0x7f97f009ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:25.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.396+0000 7f97f6ab0700 1 -- 172.21.15.26:0/4253008917 shutdown_connections 2023-10-01T07:58:25.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:25.396+0000 7f97f6ab0700 1 -- 172.21.15.26:0/4253008917 wait complete. 2023-10-01T07:58:25.410 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:26.333 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:26.340 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:26.367 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:26.411 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:26.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.487+0000 7fcb4de5e700 1 Processor -- start 2023-10-01T07:58:26.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.487+0000 7fcb4de5e700 1 -- start start 2023-10-01T07:58:26.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.487+0000 7fcb4de5e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcb480a0a30 0x7fcb480a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:26.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.488+0000 7fcb4de5e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb48134170 0x7fcb4813bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:26.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.488+0000 7fcb4de5e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb4809edd0 con 0x7fcb480a1340 2023-10-01T07:58:26.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.488+0000 7fcb4de5e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb4809e1f0 con 0x7fcb480a0a30 2023-10-01T07:58:26.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.488+0000 7fcb4de5e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4809dc50 con 0x7fcb48134170 2023-10-01T07:58:26.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.488+0000 7fcb477fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcb480a0a30 0x7fcb480a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:26.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.488+0000 7fcb477fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcb480a0a30 0x7fcb480a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49942/0 (socket says 172.21.15.26:49942) 2023-10-01T07:58:26.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.488+0000 7fcb477fe700 1 -- 172.21.15.26:0/1065878622 learned_addr learned my addr 172.21.15.26:0/1065878622 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:26.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.488+0000 7fcb477fe700 1 -- 172.21.15.26:0/1065878622 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb48134170 msgr2=0x7fcb4813bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:26.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.488+0000 7fcb477fe700 1 --2- 172.21.15.26:0/1065878622 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb48134170 0x7fcb4813bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:26.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.488+0000 7fcb477fe700 1 -- 172.21.15.26:0/1065878622 >> v1:172.21.15.26:6789/0 conn(0x7fcb480a1340 legacy=0x7fcb48133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:26.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.488+0000 7fcb477fe700 1 -- 172.21.15.26:0/1065878622 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb480a1fe0 con 0x7fcb480a0a30 2023-10-01T07:58:26.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.488+0000 7fcb477fe700 1 --2- 172.21.15.26:0/1065878622 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb480a0a30 0x7fcb480a0e00 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fcb380098f0 tx=0x7fcb38009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de1688f1bab1f4a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:26.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.489+0000 7fcb467fc700 1 -- 172.21.15.26:0/1065878622 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3800b8a0 con 0x7fcb480a0a30 2023-10-01T07:58:26.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.489+0000 7fcb467fc700 1 -- 172.21.15.26:0/1065878622 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3800ba00 con 0x7fcb480a0a30 2023-10-01T07:58:26.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.489+0000 7fcb467fc700 1 -- 172.21.15.26:0/1065878622 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3800bd90 con 0x7fcb480a0a30 2023-10-01T07:58:26.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.489+0000 7fcb4de5e700 1 -- 172.21.15.26:0/1065878622 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb480a0a30 msgr2=0x7fcb480a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:26.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.489+0000 7fcb4de5e700 1 --2- 172.21.15.26:0/1065878622 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb480a0a30 0x7fcb480a0e00 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fcb380098f0 tx=0x7fcb38009c00 comp rx=0 tx=0).stop 2023-10-01T07:58:26.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.490+0000 7fcb4de5e700 1 -- 172.21.15.26:0/1065878622 shutdown_connections 2023-10-01T07:58:26.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.490+0000 7fcb4de5e700 1 --2- 172.21.15.26:0/1065878622 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb48134170 0x7fcb4813bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:26.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.490+0000 7fcb4de5e700 1 --2- 172.21.15.26:0/1065878622 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb480a0a30 0x7fcb480a0e00 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:26.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.490+0000 7fcb4de5e700 1 -- 172.21.15.26:0/1065878622 >> 172.21.15.26:0/1065878622 conn(0x7fcb480a6550 msgr2=0x7fcb480a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:26.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.490+0000 7fcb4de5e700 1 -- 172.21.15.26:0/1065878622 shutdown_connections 2023-10-01T07:58:26.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.490+0000 7fcb4de5e700 1 -- 172.21.15.26:0/1065878622 wait complete. 2023-10-01T07:58:26.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.491+0000 7fcb4de5e700 1 Processor -- start 2023-10-01T07:58:26.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.491+0000 7fcb4de5e700 1 -- start start 2023-10-01T07:58:26.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.492+0000 7fcb4de5e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb480a0a30 0x7fcb481c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:26.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.492+0000 7fcb4de5e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb480a1340 0x7fcb481c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.492+0000 7fcb4de5e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb48134170 0x7fcb4811e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.492+0000 7fcb4de5e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb481bd580 con 0x7fcb48134170 2023-10-01T07:58:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.492+0000 7fcb4de5e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb48133440 con 0x7fcb480a1340 2023-10-01T07:58:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.492+0000 7fcb4de5e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb48133200 con 0x7fcb480a0a30 2023-10-01T07:58:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.492+0000 7fcb477fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb480a0a30 0x7fcb481c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.492+0000 7fcb47fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb48134170 0x7fcb4811e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.492+0000 7fcb477fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb480a0a30 0x7fcb481c8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41280/0 (socket says 172.21.15.26:41280) 2023-10-01T07:58:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.493+0000 7fcb477fe700 1 -- 172.21.15.26:0/2235648193 learned_addr learned my addr 172.21.15.26:0/2235648193 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.493+0000 7fcb46ffd700 1 --2- 172.21.15.26:0/2235648193 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb480a1340 0x7fcb481c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.493+0000 7fcb477fe700 1 -- 172.21.15.26:0/2235648193 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb480a1340 msgr2=0x7fcb481c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.493+0000 7fcb477fe700 1 --2- 172.21.15.26:0/2235648193 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb480a1340 0x7fcb481c8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:26.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.493+0000 7fcb477fe700 1 -- 172.21.15.26:0/2235648193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb48134170 msgr2=0x7fcb4811e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:26.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.493+0000 7fcb477fe700 1 --2- 172.21.15.26:0/2235648193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb48134170 0x7fcb4811e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:26.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.493+0000 7fcb477fe700 1 -- 172.21.15.26:0/2235648193 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb38009550 con 0x7fcb480a0a30 2023-10-01T07:58:26.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.493+0000 7fcb47fff700 1 --2- 172.21.15.26:0/2235648193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb48134170 0x7fcb4811e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:26.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.493+0000 7fcb477fe700 1 --2- 172.21.15.26:0/2235648193 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb480a0a30 0x7fcb481c8a60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fcb38000c00 tx=0x7fcb38004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:26.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.493+0000 7fcb2ffff700 1 -- 172.21.15.26:0/2235648193 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb380036a0 con 0x7fcb480a0a30 2023-10-01T07:58:26.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.493+0000 7fcb2ffff700 1 -- 172.21.15.26:0/2235648193 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb38003800 con 0x7fcb480a0a30 2023-10-01T07:58:26.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.494+0000 7fcb4de5e700 1 -- 172.21.15.26:0/2235648193 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb480a25e0 con 0x7fcb480a0a30 2023-10-01T07:58:26.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.494+0000 7fcb2ffff700 1 -- 172.21.15.26:0/2235648193 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb38003b70 con 0x7fcb480a0a30 2023-10-01T07:58:26.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.494+0000 7fcb4de5e700 1 -- 172.21.15.26:0/2235648193 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb481c94e0 con 0x7fcb480a0a30 2023-10-01T07:58:26.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.495+0000 7fcb2ffff700 1 -- 172.21.15.26:0/2235648193 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcb38003cd0 con 0x7fcb480a0a30 2023-10-01T07:58:26.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.495+0000 7fcb4de5e700 1 -- 172.21.15.26:0/2235648193 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb48074ea0 con 0x7fcb480a0a30 2023-10-01T07:58:26.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.495+0000 7fcb2ffff700 1 -- 172.21.15.26:0/2235648193 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcb38021030 con 0x7fcb480a0a30 2023-10-01T07:58:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.500+0000 7fcb2ffff700 1 -- 172.21.15.26:0/2235648193 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcb38046020 con 0x7fcb480a0a30 2023-10-01T07:58:26.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.526+0000 7f0b9a787700 1 Processor -- start 2023-10-01T07:58:26.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.526+0000 7f0b9a787700 1 -- start start 2023-10-01T07:58:26.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.526+0000 7f0b9a787700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0b9409e1d0 0x7f0b94138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:26.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.526+0000 7f0b9a787700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0b94139170 0x7f0b9413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:26.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.526+0000 7f0b9a787700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b9409b120 con 0x7f0b9409d6f0 2023-10-01T07:58:26.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.526+0000 7f0b9a787700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9406b460 con 0x7f0b94139170 2023-10-01T07:58:26.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.526+0000 7f0b9a787700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9409a7e0 con 0x7f0b9409e1d0 2023-10-01T07:58:26.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.527+0000 7f0b93fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0b9409d6f0 0x7f0b9409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60254/0 (socket says 172.21.15.26:60254) 2023-10-01T07:58:26.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.527+0000 7f0b93fff700 1 -- 172.21.15.26:0/382934603 learned_addr learned my addr 172.21.15.26:0/382934603 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:26.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.527+0000 7f0b937fe700 1 --2- 172.21.15.26:0/382934603 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0b9409e1d0 0x7f0b94138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:26.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.527+0000 7f0b98d24700 1 --2- 172.21.15.26:0/382934603 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0b94139170 0x7f0b9413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:26.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.527+0000 7f0b92ffd700 1 -- 172.21.15.26:0/382934603 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2078630356 0 0) 0x7f0b9409b120 con 0x7f0b9409d6f0 2023-10-01T07:58:26.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.527+0000 7f0b92ffd700 1 -- 172.21.15.26:0/382934603 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b7c0035b0 con 0x7f0b9409d6f0 2023-10-01T07:58:26.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.527+0000 7f0b937fe700 1 -- 172.21.15.26:0/382934603 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0b94139170 msgr2=0x7f0b9413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:26.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.527+0000 7f0b937fe700 1 --2- 172.21.15.26:0/382934603 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0b94139170 0x7f0b9413b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:26.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.527+0000 7f0b937fe700 1 -- 172.21.15.26:0/382934603 >> v1:172.21.15.26:6789/0 conn(0x7f0b9409d6f0 legacy=0x7f0b9409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:26.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.527+0000 7f0b937fe700 1 -- 172.21.15.26:0/382934603 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9409a500 con 0x7f0b9409e1d0 2023-10-01T07:58:26.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.527+0000 7f0b98d24700 1 --2- 172.21.15.26:0/382934603 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0b94139170 0x7f0b9413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:26.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.527+0000 7f0b937fe700 1 --2- 172.21.15.26:0/382934603 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0b9409e1d0 0x7f0b94138c30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0b880098a0 tx=0x7f0b88009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83342c6b1fd1ea0e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:26.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.528+0000 7f0b92ffd700 1 -- 172.21.15.26:0/382934603 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b88011830 con 0x7f0b9409e1d0 2023-10-01T07:58:26.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.528+0000 7f0b92ffd700 1 -- 172.21.15.26:0/382934603 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b88011990 con 0x7f0b9409e1d0 2023-10-01T07:58:26.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.528+0000 7f0b92ffd700 1 -- 172.21.15.26:0/382934603 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b88011d20 con 0x7f0b9409e1d0 2023-10-01T07:58:26.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.529+0000 7f0b9a787700 1 -- 172.21.15.26:0/382934603 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0b9409e1d0 msgr2=0x7f0b94138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:26.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.529+0000 7f0b9a787700 1 --2- 172.21.15.26:0/382934603 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0b9409e1d0 0x7f0b94138c30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0b880098a0 tx=0x7f0b88009bb0 comp rx=0 tx=0).stop 2023-10-01T07:58:26.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.529+0000 7f0b9a787700 1 -- 172.21.15.26:0/382934603 shutdown_connections 2023-10-01T07:58:26.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.529+0000 7f0b9a787700 1 --2- 172.21.15.26:0/382934603 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0b94139170 0x7f0b9413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:26.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.529+0000 7f0b9a787700 1 --2- 172.21.15.26:0/382934603 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0b9409e1d0 0x7f0b94138c30 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:26.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.529+0000 7f0b9a787700 1 -- 172.21.15.26:0/382934603 >> 172.21.15.26:0/382934603 conn(0x7f0b94066f50 msgr2=0x7f0b9409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:26.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.529+0000 7f0b9a787700 1 -- 172.21.15.26:0/382934603 shutdown_connections 2023-10-01T07:58:26.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.529+0000 7f0b9a787700 1 -- 172.21.15.26:0/382934603 wait complete. 2023-10-01T07:58:26.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.530+0000 7f0b9a787700 1 Processor -- start 2023-10-01T07:58:26.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.531+0000 7f0b9a787700 1 -- start start 2023-10-01T07:58:26.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.531+0000 7f0b9a787700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b9409d6f0 0x7f0b94120750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.531+0000 7f0b9a787700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0b9409e1d0 0x7f0b94120c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.531+0000 7f0b9a787700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0b94139170 0x7f0b941211d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.531+0000 7f0b9a787700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9409c7a0 con 0x7f0b9409d6f0 2023-10-01T07:58:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.531+0000 7f0b9a787700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b94123a20 con 0x7f0b9409e1d0 2023-10-01T07:58:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.531+0000 7f0b9a787700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b94122bc0 con 0x7f0b94139170 2023-10-01T07:58:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.531+0000 7f0b93fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b9409d6f0 0x7f0b94120750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.531+0000 7f0b937fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0b9409e1d0 0x7f0b94120c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.531+0000 7f0b93fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b9409d6f0 0x7f0b94120750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49954/0 (socket says 172.21.15.26:49954) 2023-10-01T07:58:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.531+0000 7f0b93fff700 1 -- 172.21.15.26:0/3319602149 learned_addr learned my addr 172.21.15.26:0/3319602149 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.531+0000 7f0b937fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0b9409e1d0 0x7f0b94120c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34146/0 (socket says 172.21.15.26:34146) 2023-10-01T07:58:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.532+0000 7f0b98d24700 1 --2- 172.21.15.26:0/3319602149 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0b94139170 0x7f0b941211d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.532+0000 7f0b937fe700 1 -- 172.21.15.26:0/3319602149 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0b94139170 msgr2=0x7f0b941211d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:26.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.532+0000 7f0b937fe700 1 --2- 172.21.15.26:0/3319602149 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0b94139170 0x7f0b941211d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:26.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.532+0000 7f0b937fe700 1 -- 172.21.15.26:0/3319602149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b9409d6f0 msgr2=0x7f0b94120750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:26.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.532+0000 7f0b937fe700 1 --2- 172.21.15.26:0/3319602149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b9409d6f0 0x7f0b94120750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:26.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.532+0000 7f0b937fe700 1 -- 172.21.15.26:0/3319602149 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8c009a70 con 0x7f0b9409e1d0 2023-10-01T07:58:26.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.532+0000 7f0b937fe700 1 --2- 172.21.15.26:0/3319602149 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0b9409e1d0 0x7f0b94120c90 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0b9406b640 tx=0x7f0b88004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:26.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.532+0000 7f0b90ff9700 1 -- 172.21.15.26:0/3319602149 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b880042c0 con 0x7f0b9409e1d0 2023-10-01T07:58:26.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.532+0000 7f98f38c0700 1 Processor -- start 2023-10-01T07:58:26.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.532+0000 7f0b90ff9700 1 -- 172.21.15.26:0/3319602149 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8801f070 con 0x7f0b9409e1d0 2023-10-01T07:58:26.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.532+0000 7f0b9a787700 1 -- 172.21.15.26:0/3319602149 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b880094a0 con 0x7f0b9409e1d0 2023-10-01T07:58:26.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.533+0000 7f0b90ff9700 1 -- 172.21.15.26:0/3319602149 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b880036a0 con 0x7f0b9409e1d0 2023-10-01T07:58:26.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.533+0000 7f0b9a787700 1 -- 172.21.15.26:0/3319602149 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b940a1790 con 0x7f0b9409e1d0 2023-10-01T07:58:26.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.533+0000 7f98f38c0700 1 -- start start 2023-10-01T07:58:26.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.534+0000 7f98f38c0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f98ec09e1d0 0x7f98ec135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:26.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.534+0000 7f98f38c0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98ec135e50 0x7f98ec138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:26.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.534+0000 7f98f38c0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98ec09f130 con 0x7f98ec09d6f0 2023-10-01T07:58:26.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.534+0000 7f98f38c0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98ec09f520 con 0x7f98ec09e1d0 2023-10-01T07:58:26.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.534+0000 7f98f38c0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec09e930 con 0x7f98ec135e50 2023-10-01T07:58:26.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.534+0000 7f98f1e5d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98ec135e50 0x7f98ec138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:26.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.534+0000 7f98f165c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f98ec09d6f0 0x7f98ec09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60260/0 (socket says 172.21.15.26:60260) 2023-10-01T07:58:26.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.534+0000 7f98f165c700 1 -- 172.21.15.26:0/1125789945 learned_addr learned my addr 172.21.15.26:0/1125789945 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:26.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.534+0000 7f98f1e5d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98ec135e50 0x7f98ec138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41300/0 (socket says 172.21.15.26:41300) 2023-10-01T07:58:26.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.534+0000 7f98f0e5b700 1 --2- 172.21.15.26:0/1125789945 >> v2:172.21.15.26:3300/0 conn(0x7f98ec09e1d0 0x7f98ec135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:26.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.534+0000 7f0b9a787700 1 -- 172.21.15.26:0/3319602149 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b94074ea0 con 0x7f0b9409e1d0 2023-10-01T07:58:26.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.535+0000 7f98f1e5d700 1 -- 172.21.15.26:0/1125789945 >> v2:172.21.15.26:3300/0 conn(0x7f98ec09e1d0 msgr2=0x7f98ec135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:26.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.535+0000 7f98f1e5d700 1 --2- 172.21.15.26:0/1125789945 >> v2:172.21.15.26:3300/0 conn(0x7f98ec09e1d0 0x7f98ec135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:26.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.535+0000 7f98f1e5d700 1 -- 172.21.15.26:0/1125789945 >> v1:172.21.15.26:6789/0 conn(0x7f98ec09d6f0 legacy=0x7f98ec09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:26.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.535+0000 7f98f1e5d700 1 -- 172.21.15.26:0/1125789945 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ec09b2d0 con 0x7f98ec135e50 2023-10-01T07:58:26.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.535+0000 7f0b90ff9700 1 -- 172.21.15.26:0/3319602149 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0b88021030 con 0x7f0b9409e1d0 2023-10-01T07:58:26.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.535+0000 7f98f1e5d700 1 --2- 172.21.15.26:0/1125789945 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98ec135e50 0x7f98ec138230 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f98e4009d90 tx=0x7f98e400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5861ec2da8618e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:26.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.535+0000 7f0b90ff9700 1 -- 172.21.15.26:0/3319602149 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0b88040e80 con 0x7f0b9409e1d0 2023-10-01T07:58:26.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.535+0000 7f98e3fff700 1 -- 172.21.15.26:0/1125789945 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e400bd20 con 0x7f98ec135e50 2023-10-01T07:58:26.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.535+0000 7f98e3fff700 1 -- 172.21.15.26:0/1125789945 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e400be80 con 0x7f98ec135e50 2023-10-01T07:58:26.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.535+0000 7f98e3fff700 1 -- 172.21.15.26:0/1125789945 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e4011680 con 0x7f98ec135e50 2023-10-01T07:58:26.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.536+0000 7f98f38c0700 1 -- 172.21.15.26:0/1125789945 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98ec135e50 msgr2=0x7f98ec138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:26.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.536+0000 7f98f38c0700 1 --2- 172.21.15.26:0/1125789945 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98ec135e50 0x7f98ec138230 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f98e4009d90 tx=0x7f98e400b330 comp rx=0 tx=0).stop 2023-10-01T07:58:26.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.536+0000 7f98f38c0700 1 -- 172.21.15.26:0/1125789945 shutdown_connections 2023-10-01T07:58:26.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.536+0000 7f98f38c0700 1 --2- 172.21.15.26:0/1125789945 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98ec135e50 0x7f98ec138230 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:26.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.536+0000 7f98f38c0700 1 --2- 172.21.15.26:0/1125789945 >> v2:172.21.15.26:3300/0 conn(0x7f98ec09e1d0 0x7f98ec135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:26.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.536+0000 7f98f38c0700 1 -- 172.21.15.26:0/1125789945 >> 172.21.15.26:0/1125789945 conn(0x7f98ec066f50 msgr2=0x7f98ec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:26.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.537+0000 7f98f38c0700 1 -- 172.21.15.26:0/1125789945 shutdown_connections 2023-10-01T07:58:26.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.537+0000 7f98f38c0700 1 -- 172.21.15.26:0/1125789945 wait complete. 2023-10-01T07:58:26.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.538+0000 7f98f38c0700 1 Processor -- start 2023-10-01T07:58:26.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.538+0000 7f98f38c0700 1 -- start start 2023-10-01T07:58:26.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.538+0000 7f98f38c0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98ec09d6f0 0x7f98ec121c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:26.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.538+0000 7f98f38c0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98ec09e1d0 0x7f98ec1221d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:26.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.538+0000 7f98f38c0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f98ec135e50 0x7f98ec122710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:26.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.538+0000 7f98f38c0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec124a90 con 0x7f98ec09e1d0 2023-10-01T07:58:26.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.538+0000 7f98f38c0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec09c700 con 0x7f98ec135e50 2023-10-01T07:58:26.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.538+0000 7f98f38c0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec0a1d00 con 0x7f98ec09d6f0 2023-10-01T07:58:26.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.538+0000 7f98f1e5d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f98ec135e50 0x7f98ec122710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:26.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.538+0000 7f98f1e5d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f98ec135e50 0x7f98ec122710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34156/0 (socket says 172.21.15.26:34156) 2023-10-01T07:58:26.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.538+0000 7f98f1e5d700 1 -- 172.21.15.26:0/1800693933 learned_addr learned my addr 172.21.15.26:0/1800693933 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:26.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.538+0000 7f98f165c700 1 --2- 172.21.15.26:0/1800693933 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98ec09d6f0 0x7f98ec121c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:26.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.539+0000 7f98f0e5b700 1 --2- 172.21.15.26:0/1800693933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98ec09e1d0 0x7f98ec1221d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:26.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.539+0000 7f98f1e5d700 1 -- 172.21.15.26:0/1800693933 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98ec09d6f0 msgr2=0x7f98ec121c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:26.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.539+0000 7f98f1e5d700 1 --2- 172.21.15.26:0/1800693933 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98ec09d6f0 0x7f98ec121c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:26.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.539+0000 7f98f1e5d700 1 -- 172.21.15.26:0/1800693933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98ec09e1d0 msgr2=0x7f98ec1221d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:26.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.539+0000 7f98f1e5d700 1 --2- 172.21.15.26:0/1800693933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98ec09e1d0 0x7f98ec1221d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:26.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.539+0000 7f98f1e5d700 1 -- 172.21.15.26:0/1800693933 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e4009a70 con 0x7f98ec135e50 2023-10-01T07:58:26.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.539+0000 7f98f0e5b700 1 --2- 172.21.15.26:0/1800693933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98ec09e1d0 0x7f98ec1221d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:58:26.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.539+0000 7f98f1e5d700 1 --2- 172.21.15.26:0/1800693933 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f98ec135e50 0x7f98ec122710 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f98ec09ea70 tx=0x7f98e4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:26.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.539+0000 7f98e1ffb700 1 -- 172.21.15.26:0/1800693933 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e401d070 con 0x7f98ec135e50 2023-10-01T07:58:26.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.539+0000 7f98e1ffb700 1 -- 172.21.15.26:0/1800693933 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e40045b0 con 0x7f98ec135e50 2023-10-01T07:58:26.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.540+0000 7f98e1ffb700 1 -- 172.21.15.26:0/1800693933 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e4004940 con 0x7f98ec135e50 2023-10-01T07:58:26.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.540+0000 7f0b90ff9700 1 -- 172.21.15.26:0/3319602149 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0b880239c0 con 0x7f0b9409e1d0 2023-10-01T07:58:26.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.540+0000 7f98f38c0700 1 -- 172.21.15.26:0/1800693933 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98ec123650 con 0x7f98ec135e50 2023-10-01T07:58:26.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.540+0000 7f98f38c0700 1 -- 172.21.15.26:0/1800693933 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98ec1bf7b0 con 0x7f98ec135e50 2023-10-01T07:58:26.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.542+0000 7f98e1ffb700 1 -- 172.21.15.26:0/1800693933 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f98e4011460 con 0x7f98ec135e50 2023-10-01T07:58:26.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.542+0000 7f98d77fe700 1 -- 172.21.15.26:0/1800693933 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98c40052e0 con 0x7f98ec135e50 2023-10-01T07:58:26.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.543+0000 7f98e1ffb700 1 -- 172.21.15.26:0/1800693933 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f98e4040f90 con 0x7f98ec135e50 2023-10-01T07:58:26.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.548+0000 7f98e1ffb700 1 -- 172.21.15.26:0/1800693933 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f98e400be60 con 0x7f98ec135e50 2023-10-01T07:58:26.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.571+0000 7f684aa1c700 1 Processor -- start 2023-10-01T07:58:26.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.571+0000 7f684aa1c700 1 -- start start 2023-10-01T07:58:26.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.571+0000 7f684aa1c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f684409e1d0 0x7f6844138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:26.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.571+0000 7f684aa1c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6844139170 0x7f684413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:26.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.571+0000 7f684aa1c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f684409b120 con 0x7f684409d6f0 2023-10-01T07:58:26.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.571+0000 7f684aa1c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f684406b460 con 0x7f684409e1d0 2023-10-01T07:58:26.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.572+0000 7f684aa1c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f684409a7e0 con 0x7f6844139170 2023-10-01T07:58:26.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.572+0000 7f68437fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f684409e1d0 0x7f6844138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:26.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.572+0000 7f68437fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f684409e1d0 0x7f6844138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49978/0 (socket says 172.21.15.26:49978) 2023-10-01T07:58:26.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.572+0000 7f68437fe700 1 -- 172.21.15.26:0/2346825245 learned_addr learned my addr 172.21.15.26:0/2346825245 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:26.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.572+0000 7f6848fb9700 1 --2- 172.21.15.26:0/2346825245 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6844139170 0x7f684413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:26.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.572+0000 7f68437fe700 1 -- 172.21.15.26:0/2346825245 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6844139170 msgr2=0x7f684413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:26.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.572+0000 7f68437fe700 1 --2- 172.21.15.26:0/2346825245 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6844139170 0x7f684413b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:26.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.572+0000 7f68437fe700 1 -- 172.21.15.26:0/2346825245 >> v1:172.21.15.26:6789/0 conn(0x7f684409d6f0 legacy=0x7f684409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:26.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.572+0000 7f68437fe700 1 -- 172.21.15.26:0/2346825245 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f684409a500 con 0x7f684409e1d0 2023-10-01T07:58:26.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.572+0000 7f68437fe700 1 --2- 172.21.15.26:0/2346825245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f684409e1d0 0x7f6844138c30 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f6838009920 tx=0x7f6838009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0820ab79119174 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:26.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.572+0000 7f6842ffd700 1 -- 172.21.15.26:0/2346825245 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6838004230 con 0x7f684409e1d0 2023-10-01T07:58:26.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.573+0000 7f6842ffd700 1 -- 172.21.15.26:0/2346825245 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6838004390 con 0x7f684409e1d0 2023-10-01T07:58:26.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.573+0000 7f6842ffd700 1 -- 172.21.15.26:0/2346825245 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68380036a0 con 0x7f684409e1d0 2023-10-01T07:58:26.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.573+0000 7f684aa1c700 1 -- 172.21.15.26:0/2346825245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f684409e1d0 msgr2=0x7f6844138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:26.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.573+0000 7f684aa1c700 1 --2- 172.21.15.26:0/2346825245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f684409e1d0 0x7f6844138c30 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f6838009920 tx=0x7f6838009c30 comp rx=0 tx=0).stop 2023-10-01T07:58:26.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.573+0000 7f684aa1c700 1 -- 172.21.15.26:0/2346825245 shutdown_connections 2023-10-01T07:58:26.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.573+0000 7f684aa1c700 1 --2- 172.21.15.26:0/2346825245 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6844139170 0x7f684413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:26.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.573+0000 7f684aa1c700 1 --2- 172.21.15.26:0/2346825245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f684409e1d0 0x7f6844138c30 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:26.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.573+0000 7f684aa1c700 1 -- 172.21.15.26:0/2346825245 >> 172.21.15.26:0/2346825245 conn(0x7f6844066f50 msgr2=0x7f684409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:26.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.573+0000 7f684aa1c700 1 -- 172.21.15.26:0/2346825245 shutdown_connections 2023-10-01T07:58:26.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.573+0000 7f684aa1c700 1 -- 172.21.15.26:0/2346825245 wait complete. 2023-10-01T07:58:26.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.575+0000 7f684aa1c700 1 Processor -- start 2023-10-01T07:58:26.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.575+0000 7f684aa1c700 1 -- start start 2023-10-01T07:58:26.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.576+0000 7f684aa1c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f684409d6f0 0x7f68441c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:26.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.576+0000 7f684aa1c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f684409e1d0 0x7f68441c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:26.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.576+0000 7f684aa1c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6844139170 0x7f68441c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:26.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.576+0000 7f684aa1c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68440a2b90 con 0x7f684409e1d0 2023-10-01T07:58:26.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.576+0000 7f684aa1c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f684409c710 con 0x7f6844139170 2023-10-01T07:58:26.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.576+0000 7f684aa1c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68441207c0 con 0x7f684409d6f0 2023-10-01T07:58:26.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.576+0000 7f68437fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f684409e1d0 0x7f68441c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:26.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.576+0000 7f68437fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f684409e1d0 0x7f68441c89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49984/0 (socket says 172.21.15.26:49984) 2023-10-01T07:58:26.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.576+0000 7f68437fe700 1 -- 172.21.15.26:0/1729128679 learned_addr learned my addr 172.21.15.26:0/1729128679 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:26.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.576+0000 7f6848fb9700 1 --2- 172.21.15.26:0/1729128679 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6844139170 0x7f68441c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:26.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.576+0000 7f68437fe700 1 -- 172.21.15.26:0/1729128679 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f684409d6f0 msgr2=0x7f68441c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:26.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.576+0000 7f68437fe700 1 --2- 172.21.15.26:0/1729128679 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f684409d6f0 0x7f68441c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:26.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.576+0000 7f68437fe700 1 -- 172.21.15.26:0/1729128679 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6844139170 msgr2=0x7f68441c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:26.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.576+0000 7f68437fe700 1 --2- 172.21.15.26:0/1729128679 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6844139170 0x7f68441c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:26.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.576+0000 7f68437fe700 1 -- 172.21.15.26:0/1729128679 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6838009550 con 0x7f684409e1d0 2023-10-01T07:58:26.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.577+0000 7f68437fe700 1 --2- 172.21.15.26:0/1729128679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f684409e1d0 0x7f68441c89a0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f68380098f0 tx=0x7f6838004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:26.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.577+0000 7f6840ff9700 1 -- 172.21.15.26:0/1729128679 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6838003c50 con 0x7f684409e1d0 2023-10-01T07:58:26.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.577+0000 7f6840ff9700 1 -- 172.21.15.26:0/1729128679 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f683801f070 con 0x7f684409e1d0 2023-10-01T07:58:26.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.577+0000 7f6840ff9700 1 -- 172.21.15.26:0/1729128679 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6838011630 con 0x7f684409e1d0 2023-10-01T07:58:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.577+0000 7f684aa1c700 1 -- 172.21.15.26:0/1729128679 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6844122020 con 0x7f684409e1d0 2023-10-01T07:58:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.577+0000 7f684aa1c700 1 -- 172.21.15.26:0/1729128679 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68441225c0 con 0x7f684409e1d0 2023-10-01T07:58:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.578+0000 7f6840ff9700 1 -- 172.21.15.26:0/1729128679 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6838021030 con 0x7f684409e1d0 2023-10-01T07:58:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.578+0000 7f684aa1c700 1 -- 172.21.15.26:0/1729128679 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68441221b0 con 0x7f684409e1d0 2023-10-01T07:58:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.578+0000 7f6840ff9700 1 -- 172.21.15.26:0/1729128679 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6838040cb0 con 0x7f684409e1d0 2023-10-01T07:58:26.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.583+0000 7f6840ff9700 1 -- 172.21.15.26:0/1729128679 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f68441221b0 con 0x7f684409e1d0 2023-10-01T07:58:26.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.712+0000 7fcb4de5e700 1 -- 172.21.15.26:0/2235648193 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcb480a28e0 con 0x7fcb480a0a30 2023-10-01T07:58:26.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.713+0000 7fcb2ffff700 1 -- 172.21.15.26:0/2235648193 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcb38015070 con 0x7fcb480a0a30 2023-10-01T07:58:26.714 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:26.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.715+0000 7fcb4de5e700 1 -- 172.21.15.26:0/2235648193 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb480a0a30 msgr2=0x7fcb481c8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:26.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.715+0000 7fcb4de5e700 1 --2- 172.21.15.26:0/2235648193 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb480a0a30 0x7fcb481c8a60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fcb38000c00 tx=0x7fcb38004750 comp rx=0 tx=0).stop 2023-10-01T07:58:26.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.715+0000 7fcb4de5e700 1 -- 172.21.15.26:0/2235648193 shutdown_connections 2023-10-01T07:58:26.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.715+0000 7fcb4de5e700 1 --2- 172.21.15.26:0/2235648193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb48134170 0x7fcb4811e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:26.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.715+0000 7fcb4de5e700 1 --2- 172.21.15.26:0/2235648193 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb480a0a30 0x7fcb481c8a60 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:26.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.715+0000 7fcb4de5e700 1 --2- 172.21.15.26:0/2235648193 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb480a1340 0x7fcb481c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:26.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.715+0000 7fcb4de5e700 1 -- 172.21.15.26:0/2235648193 >> 172.21.15.26:0/2235648193 conn(0x7fcb480a6550 msgr2=0x7fcb4809f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:26.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.715+0000 7fcb4de5e700 1 -- 172.21.15.26:0/2235648193 shutdown_connections 2023-10-01T07:58:26.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.715+0000 7fcb4de5e700 1 -- 172.21.15.26:0/2235648193 wait complete. 2023-10-01T07:58:26.730 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:26.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.768+0000 7f0b9a787700 1 -- 172.21.15.26:0/3319602149 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0b9406c360 con 0x7f0b9409e1d0 2023-10-01T07:58:26.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.768+0000 7f0b90ff9700 1 -- 172.21.15.26:0/3319602149 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0b88015030 con 0x7f0b9409e1d0 2023-10-01T07:58:26.769 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:26.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.770+0000 7f0b9a787700 1 -- 172.21.15.26:0/3319602149 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0b9409e1d0 msgr2=0x7f0b94120c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:26.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.770+0000 7f0b9a787700 1 --2- 172.21.15.26:0/3319602149 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0b9409e1d0 0x7f0b94120c90 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0b9406b640 tx=0x7f0b88004750 comp rx=0 tx=0).stop 2023-10-01T07:58:26.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.770+0000 7f0b9a787700 1 -- 172.21.15.26:0/3319602149 shutdown_connections 2023-10-01T07:58:26.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.770+0000 7f0b9a787700 1 --2- 172.21.15.26:0/3319602149 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0b94139170 0x7f0b941211d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:26.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.770+0000 7f0b9a787700 1 --2- 172.21.15.26:0/3319602149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b9409d6f0 0x7f0b94120750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:26.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.770+0000 7f0b9a787700 1 --2- 172.21.15.26:0/3319602149 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0b9409e1d0 0x7f0b94120c90 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:26.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.770+0000 7f0b9a787700 1 -- 172.21.15.26:0/3319602149 >> 172.21.15.26:0/3319602149 conn(0x7f0b94066f50 msgr2=0x7f0b9409b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:26.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.771+0000 7f0b9a787700 1 -- 172.21.15.26:0/3319602149 shutdown_connections 2023-10-01T07:58:26.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.771+0000 7f0b9a787700 1 -- 172.21.15.26:0/3319602149 wait complete. 2023-10-01T07:58:26.785 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:26.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.799+0000 7f98d77fe700 1 -- 172.21.15.26:0/1800693933 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f98c4005590 con 0x7f98ec135e50 2023-10-01T07:58:26.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.799+0000 7f98e1ffb700 1 -- 172.21.15.26:0/1800693933 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f98e4027020 con 0x7f98ec135e50 2023-10-01T07:58:26.802 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:26.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.801+0000 7f98d77fe700 1 -- 172.21.15.26:0/1800693933 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f98ec135e50 msgr2=0x7f98ec122710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:26.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.801+0000 7f98d77fe700 1 --2- 172.21.15.26:0/1800693933 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f98ec135e50 0x7f98ec122710 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f98ec09ea70 tx=0x7f98e4004ad0 comp rx=0 tx=0).stop 2023-10-01T07:58:26.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.801+0000 7f98d77fe700 1 -- 172.21.15.26:0/1800693933 shutdown_connections 2023-10-01T07:58:26.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.801+0000 7f98d77fe700 1 --2- 172.21.15.26:0/1800693933 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f98ec135e50 0x7f98ec122710 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:26.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.801+0000 7f98d77fe700 1 --2- 172.21.15.26:0/1800693933 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98ec09d6f0 0x7f98ec121c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:26.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.801+0000 7f98d77fe700 1 --2- 172.21.15.26:0/1800693933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98ec09e1d0 0x7f98ec1221d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:26.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.801+0000 7f98d77fe700 1 -- 172.21.15.26:0/1800693933 >> 172.21.15.26:0/1800693933 conn(0x7f98ec066f50 msgr2=0x7f98ec0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:26.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.801+0000 7f98d77fe700 1 -- 172.21.15.26:0/1800693933 shutdown_connections 2023-10-01T07:58:26.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.801+0000 7f98d77fe700 1 -- 172.21.15.26:0/1800693933 wait complete. 2023-10-01T07:58:26.816 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:26.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.815+0000 7f684aa1c700 1 -- 172.21.15.26:0/1729128679 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f68441221b0 con 0x7f684409e1d0 2023-10-01T07:58:26.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.815+0000 7f6840ff9700 1 -- 172.21.15.26:0/1729128679 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f68441221b0 con 0x7f684409e1d0 2023-10-01T07:58:26.817 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:26.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.818+0000 7f684aa1c700 1 -- 172.21.15.26:0/1729128679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f684409e1d0 msgr2=0x7f68441c89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:26.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.818+0000 7f684aa1c700 1 --2- 172.21.15.26:0/1729128679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f684409e1d0 0x7f68441c89a0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f68380098f0 tx=0x7f6838004750 comp rx=0 tx=0).stop 2023-10-01T07:58:26.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.818+0000 7f684aa1c700 1 -- 172.21.15.26:0/1729128679 shutdown_connections 2023-10-01T07:58:26.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.818+0000 7f684aa1c700 1 --2- 172.21.15.26:0/1729128679 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6844139170 0x7f68441c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:26.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.818+0000 7f684aa1c700 1 --2- 172.21.15.26:0/1729128679 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f684409d6f0 0x7f68441c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:26.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.818+0000 7f684aa1c700 1 --2- 172.21.15.26:0/1729128679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f684409e1d0 0x7f68441c89a0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:26.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.818+0000 7f684aa1c700 1 -- 172.21.15.26:0/1729128679 >> 172.21.15.26:0/1729128679 conn(0x7f6844066f50 msgr2=0x7f68440a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:26.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.818+0000 7f684aa1c700 1 -- 172.21.15.26:0/1729128679 shutdown_connections 2023-10-01T07:58:26.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:26.818+0000 7f684aa1c700 1 -- 172.21.15.26:0/1729128679 wait complete. 2023-10-01T07:58:26.832 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:27.731 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:27.786 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:27.817 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:27.832 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:27.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.891+0000 7f89c80b0700 1 Processor -- start 2023-10-01T07:58:27.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.891+0000 7f89c80b0700 1 -- start start 2023-10-01T07:58:27.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.892+0000 7f89c80b0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89c009d6f0 0x7f89c009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:27.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.892+0000 7f89c80b0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f89c009e000 0x7f89c0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:27.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.892+0000 7f89c80b0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89c009f130 con 0x7f89c009e410 2023-10-01T07:58:27.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.892+0000 7f89c80b0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89c009f520 con 0x7f89c009e000 2023-10-01T07:58:27.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.892+0000 7f89c80b0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c009e930 con 0x7f89c009d6f0 2023-10-01T07:58:27.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.892+0000 7f89c5e4c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89c009d6f0 0x7f89c009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:27.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.892+0000 7f89c5e4c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89c009d6f0 0x7f89c009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34188/0 (socket says 172.21.15.26:34188) 2023-10-01T07:58:27.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.892+0000 7f89c5e4c700 1 -- 172.21.15.26:0/2540662421 learned_addr learned my addr 172.21.15.26:0/2540662421 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:27.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.892+0000 7f89c564b700 1 --2- 172.21.15.26:0/2540662421 >> v2:172.21.15.26:3300/0 conn(0x7f89c009e000 0x7f89c0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:27.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.893+0000 7f89c564b700 1 -- 172.21.15.26:0/2540662421 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89c009d6f0 msgr2=0x7f89c009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:27.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.893+0000 7f89c564b700 1 --2- 172.21.15.26:0/2540662421 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89c009d6f0 0x7f89c009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:27.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.893+0000 7f89c564b700 1 -- 172.21.15.26:0/2540662421 >> v1:172.21.15.26:6789/0 conn(0x7f89c009e410 legacy=0x7f89c0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:27.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.893+0000 7f89c564b700 1 -- 172.21.15.26:0/2540662421 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c009b2d0 con 0x7f89c009e000 2023-10-01T07:58:27.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.893+0000 7f89c5e4c700 1 --2- 172.21.15.26:0/2540662421 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89c009d6f0 0x7f89c009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:27.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.893+0000 7f89c564b700 1 --2- 172.21.15.26:0/2540662421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89c009e000 0x7f89c0130660 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f89b000dc60 tx=0x7f89b000df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df65e425373698fb server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:27.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.893+0000 7f89c4e4a700 1 -- 172.21.15.26:0/2540662421 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b0012070 con 0x7f89c009e000 2023-10-01T07:58:27.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.893+0000 7f89c4e4a700 1 -- 172.21.15.26:0/2540662421 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b000d2e0 con 0x7f89c009e000 2023-10-01T07:58:27.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.893+0000 7f89c4e4a700 1 -- 172.21.15.26:0/2540662421 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b0004250 con 0x7f89c009e000 2023-10-01T07:58:27.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.894+0000 7f89c80b0700 1 -- 172.21.15.26:0/2540662421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89c009e000 msgr2=0x7f89c0130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:27.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.894+0000 7f89c80b0700 1 --2- 172.21.15.26:0/2540662421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89c009e000 0x7f89c0130660 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f89b000dc60 tx=0x7f89b000df70 comp rx=0 tx=0).stop 2023-10-01T07:58:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.894+0000 7f89c80b0700 1 -- 172.21.15.26:0/2540662421 shutdown_connections 2023-10-01T07:58:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.894+0000 7f89c80b0700 1 --2- 172.21.15.26:0/2540662421 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89c009d6f0 0x7f89c009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.894+0000 7f89c80b0700 1 --2- 172.21.15.26:0/2540662421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89c009e000 0x7f89c0130660 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.894+0000 7f89c80b0700 1 -- 172.21.15.26:0/2540662421 >> 172.21.15.26:0/2540662421 conn(0x7f89c0066f50 msgr2=0x7f89c009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.894+0000 7f89c80b0700 1 -- 172.21.15.26:0/2540662421 shutdown_connections 2023-10-01T07:58:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.894+0000 7f89c80b0700 1 -- 172.21.15.26:0/2540662421 wait complete. 2023-10-01T07:58:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.895+0000 7f89c80b0700 1 Processor -- start 2023-10-01T07:58:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.896+0000 7f89c80b0700 1 -- start start 2023-10-01T07:58:27.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.896+0000 7f89c80b0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89c009d6f0 0x7f89c011e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:27.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.896+0000 7f89c80b0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89c009e000 0x7f89c011e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:27.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.896+0000 7f89c80b0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89c009e410 0x7f89c011ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:27.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.896+0000 7f89c80b0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c0120630 con 0x7f89c009e410 2023-10-01T07:58:27.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.896+0000 7f89c80b0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c0120310 con 0x7f89c009e000 2023-10-01T07:58:27.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.896+0000 7f89c80b0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89c00a1d00 con 0x7f89c009d6f0 2023-10-01T07:58:27.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.896+0000 7f89c5e4c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89c009d6f0 0x7f89c011e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:27.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.896+0000 7f89c5e4c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89c009d6f0 0x7f89c011e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41328/0 (socket says 172.21.15.26:41328) 2023-10-01T07:58:27.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.896+0000 7f89c5e4c700 1 -- 172.21.15.26:0/4169773697 learned_addr learned my addr 172.21.15.26:0/4169773697 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:27.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.896+0000 7f89c664d700 1 --2- 172.21.15.26:0/4169773697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89c009e410 0x7f89c011ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:27.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.897+0000 7f89c664d700 1 -- 172.21.15.26:0/4169773697 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89c009d6f0 msgr2=0x7f89c011e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:27.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.897+0000 7f89c664d700 1 --2- 172.21.15.26:0/4169773697 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89c009d6f0 0x7f89c011e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:27.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.897+0000 7f89c664d700 1 -- 172.21.15.26:0/4169773697 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89c009e000 msgr2=0x7f89c011e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:27.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.897+0000 7f89c564b700 1 --2- 172.21.15.26:0/4169773697 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89c009e000 0x7f89c011e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:27.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.897+0000 7f89c664d700 1 --2- 172.21.15.26:0/4169773697 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89c009e000 0x7f89c011e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:27.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.897+0000 7f89c664d700 1 -- 172.21.15.26:0/4169773697 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89bc00b600 con 0x7f89c009e410 2023-10-01T07:58:27.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.897+0000 7f89c5e4c700 1 --2- 172.21.15.26:0/4169773697 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89c009d6f0 0x7f89c011e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:27.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.897+0000 7f89c564b700 1 --2- 172.21.15.26:0/4169773697 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89c009e000 0x7f89c011e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:58:27.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.897+0000 7f89c664d700 1 --2- 172.21.15.26:0/4169773697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89c009e410 0x7f89c011ec60 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f89b800cae0 tx=0x7f89b800cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:27.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.897+0000 7f89b67fc700 1 -- 172.21.15.26:0/4169773697 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b800aaa0 con 0x7f89c009e410 2023-10-01T07:58:27.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.897+0000 7f89b67fc700 1 -- 172.21.15.26:0/4169773697 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b800ac00 con 0x7f89c009e410 2023-10-01T07:58:27.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.897+0000 7f89c80b0700 1 -- 172.21.15.26:0/4169773697 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b000d940 con 0x7f89c009e410 2023-10-01T07:58:27.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.897+0000 7f89b67fc700 1 -- 172.21.15.26:0/4169773697 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b8012420 con 0x7f89c009e410 2023-10-01T07:58:27.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.897+0000 7f89c80b0700 1 -- 172.21.15.26:0/4169773697 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c0121d10 con 0x7f89c009e410 2023-10-01T07:58:27.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.898+0000 7f89b67fc700 1 -- 172.21.15.26:0/4169773697 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f89b8012580 con 0x7f89c009e410 2023-10-01T07:58:27.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.898+0000 7f89b67fc700 1 -- 172.21.15.26:0/4169773697 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f89b803fd60 con 0x7f89c009e410 2023-10-01T07:58:27.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.899+0000 7f89c80b0700 1 -- 172.21.15.26:0/4169773697 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89c01215e0 con 0x7f89c009e410 2023-10-01T07:58:27.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.904+0000 7f89b67fc700 1 -- 172.21.15.26:0/4169773697 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f89b8016030 con 0x7f89c009e410 2023-10-01T07:58:27.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.942+0000 7f4984983700 1 Processor -- start 2023-10-01T07:58:27.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.942+0000 7f4984983700 1 -- start start 2023-10-01T07:58:27.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.943+0000 7f4984983700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f49800a0a30 0x7f49800a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:27.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.943+0000 7f4984983700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f498009d630 0x7f49800a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:27.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.943+0000 7f4984983700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49800a2a70 con 0x7f4980133930 2023-10-01T07:58:27.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.943+0000 7f4984983700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49800a01d0 con 0x7f498009d630 2023-10-01T07:58:27.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.943+0000 7f4984983700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f498009e2b0 con 0x7f49800a0a30 2023-10-01T07:58:27.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.944+0000 7f497e59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f49800a0a30 0x7f49800a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:27.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.944+0000 7f497ed9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4980133930 0x7f4980133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60276/0 (socket says 172.21.15.26:60276) 2023-10-01T07:58:27.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.944+0000 7f497ed9d700 1 -- 172.21.15.26:0/417953577 learned_addr learned my addr 172.21.15.26:0/417953577 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:27.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.944+0000 7f497dd9b700 1 --2- 172.21.15.26:0/417953577 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f498009d630 0x7f49800a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:27.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.944+0000 7f497d59a700 1 -- 172.21.15.26:0/417953577 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3401906495 0 0) 0x7f49800a2a70 con 0x7f4980133930 2023-10-01T07:58:27.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.944+0000 7f497d59a700 1 -- 172.21.15.26:0/417953577 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49680035b0 con 0x7f4980133930 2023-10-01T07:58:27.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.944+0000 7f497e59c700 1 -- 172.21.15.26:0/417953577 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f498009d630 msgr2=0x7f49800a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:27.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.944+0000 7f497e59c700 1 --2- 172.21.15.26:0/417953577 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f498009d630 0x7f49800a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:27.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.944+0000 7f497e59c700 1 -- 172.21.15.26:0/417953577 >> v1:172.21.15.26:6789/0 conn(0x7f4980133930 legacy=0x7f4980133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:27.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.944+0000 7f497e59c700 1 -- 172.21.15.26:0/417953577 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498009dc50 con 0x7f49800a0a30 2023-10-01T07:58:27.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.944+0000 7f497e59c700 1 --2- 172.21.15.26:0/417953577 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f49800a0a30 0x7f49800a0e00 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4970009870 tx=0x7f4970009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e58a573524a111e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:27.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.944+0000 7f497d59a700 1 -- 172.21.15.26:0/417953577 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4970004230 con 0x7f49800a0a30 2023-10-01T07:58:27.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.945+0000 7f497d59a700 1 -- 172.21.15.26:0/417953577 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4970004390 con 0x7f49800a0a30 2023-10-01T07:58:27.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.945+0000 7f497d59a700 1 -- 172.21.15.26:0/417953577 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49700036a0 con 0x7f49800a0a30 2023-10-01T07:58:27.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.945+0000 7f4984983700 1 -- 172.21.15.26:0/417953577 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f49800a0a30 msgr2=0x7f49800a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:27.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.945+0000 7f4984983700 1 --2- 172.21.15.26:0/417953577 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f49800a0a30 0x7f49800a0e00 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4970009870 tx=0x7f4970009b80 comp rx=0 tx=0).stop 2023-10-01T07:58:27.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.945+0000 7f4984983700 1 -- 172.21.15.26:0/417953577 shutdown_connections 2023-10-01T07:58:27.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.945+0000 7f4984983700 1 --2- 172.21.15.26:0/417953577 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f49800a0a30 0x7f49800a0e00 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:27.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.945+0000 7f4984983700 1 --2- 172.21.15.26:0/417953577 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f498009d630 0x7f49800a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:27.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.945+0000 7f4984983700 1 -- 172.21.15.26:0/417953577 >> 172.21.15.26:0/417953577 conn(0x7f49800a3050 msgr2=0x7f49800a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:27.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.946+0000 7f4984983700 1 -- 172.21.15.26:0/417953577 shutdown_connections 2023-10-01T07:58:27.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.946+0000 7f4984983700 1 -- 172.21.15.26:0/417953577 wait complete. 2023-10-01T07:58:27.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.947+0000 7f4984983700 1 Processor -- start 2023-10-01T07:58:27.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.947+0000 7f4984983700 1 -- start start 2023-10-01T07:58:27.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.948+0000 7f4984983700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f498009d630 0x7f49801c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:27.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.948+0000 7f4984983700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49800a0a30 0x7f49801c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:27.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.948+0000 7f4984983700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4980133930 0x7f49801c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:27.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.948+0000 7f4984983700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4980120560 con 0x7f49800a0a30 2023-10-01T07:58:27.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.948+0000 7f4984983700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4980121ed0 con 0x7f4980133930 2023-10-01T07:58:27.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.948+0000 7f4984983700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49800a4030 con 0x7f498009d630 2023-10-01T07:58:27.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.948+0000 7f497e59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f498009d630 0x7f49801c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:27.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.948+0000 7f497e59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f498009d630 0x7f49801c8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41346/0 (socket says 172.21.15.26:41346) 2023-10-01T07:58:27.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.948+0000 7f497e59c700 1 -- 172.21.15.26:0/1456036219 learned_addr learned my addr 172.21.15.26:0/1456036219 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:27.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.948+0000 7f497dd9b700 1 --2- 172.21.15.26:0/1456036219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49800a0a30 0x7f49801c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:27.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.948+0000 7f497ed9d700 1 --2- 172.21.15.26:0/1456036219 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4980133930 0x7f49801c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:27.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.949+0000 7f497dd9b700 1 -- 172.21.15.26:0/1456036219 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f498009d630 msgr2=0x7f49801c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:27.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.949+0000 7f497dd9b700 1 --2- 172.21.15.26:0/1456036219 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f498009d630 0x7f49801c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:27.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.949+0000 7f497dd9b700 1 -- 172.21.15.26:0/1456036219 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4980133930 msgr2=0x7f49801c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:27.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.949+0000 7f497dd9b700 1 --2- 172.21.15.26:0/1456036219 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4980133930 0x7f49801c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:27.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.949+0000 7f497dd9b700 1 -- 172.21.15.26:0/1456036219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49700094a0 con 0x7f49800a0a30 2023-10-01T07:58:27.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.949+0000 7f497e59c700 1 --2- 172.21.15.26:0/1456036219 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f498009d630 0x7f49801c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:27.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.949+0000 7f497dd9b700 1 --2- 172.21.15.26:0/1456036219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49800a0a30 0x7f49801c8540 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f497400e8d0 tx=0x7f497400ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:27.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.949+0000 7f496effd700 1 -- 172.21.15.26:0/1456036219 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4974013680 con 0x7f49800a0a30 2023-10-01T07:58:27.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.949+0000 7f496effd700 1 -- 172.21.15.26:0/1456036219 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49740137e0 con 0x7f49800a0a30 2023-10-01T07:58:27.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.949+0000 7f4984983700 1 -- 172.21.15.26:0/1456036219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49800a0410 con 0x7f49800a0a30 2023-10-01T07:58:27.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.949+0000 7f496effd700 1 -- 172.21.15.26:0/1456036219 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4974013b50 con 0x7f49800a0a30 2023-10-01T07:58:27.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.950+0000 7f4984983700 1 -- 172.21.15.26:0/1456036219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49801211d0 con 0x7f49800a0a30 2023-10-01T07:58:27.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.950+0000 7f496effd700 1 -- 172.21.15.26:0/1456036219 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4974013cb0 con 0x7f49800a0a30 2023-10-01T07:58:27.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.951+0000 7f4984983700 1 -- 172.21.15.26:0/1456036219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49800747f0 con 0x7f49800a0a30 2023-10-01T07:58:27.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.951+0000 7f496effd700 1 -- 172.21.15.26:0/1456036219 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f497401ae10 con 0x7f49800a0a30 2023-10-01T07:58:27.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:27.956+0000 7f496effd700 1 -- 172.21.15.26:0/1456036219 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4974017070 con 0x7f49800a0a30 2023-10-01T07:58:28.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.006+0000 7fc862277700 1 Processor -- start 2023-10-01T07:58:28.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.006+0000 7fc862277700 1 -- start start 2023-10-01T07:58:28.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.007+0000 7fc862277700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc85c09d6f0 0x7fc85c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:28.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.007+0000 7fc862277700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc85c09e000 0x7fc85c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:28.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.007+0000 7fc862277700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc85c09f130 con 0x7fc85c09e410 2023-10-01T07:58:28.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.007+0000 7fc862277700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc85c09f520 con 0x7fc85c09e000 2023-10-01T07:58:28.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.007+0000 7fc862277700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c09e930 con 0x7fc85c09d6f0 2023-10-01T07:58:28.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.007+0000 7fc85bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc85c09d6f0 0x7fc85c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:28.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.007+0000 7fc85bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc85c09d6f0 0x7fc85c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41358/0 (socket says 172.21.15.26:41358) 2023-10-01T07:58:28.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.007+0000 7fc85bfff700 1 -- 172.21.15.26:0/3823209333 learned_addr learned my addr 172.21.15.26:0/3823209333 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:28.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.007+0000 7fc85b7fe700 1 --2- 172.21.15.26:0/3823209333 >> v2:172.21.15.26:3300/0 conn(0x7fc85c09e000 0x7fc85c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:28.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.007+0000 7fc85bfff700 1 -- 172.21.15.26:0/3823209333 >> v2:172.21.15.26:3300/0 conn(0x7fc85c09e000 msgr2=0x7fc85c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:28.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.007+0000 7fc85bfff700 1 --2- 172.21.15.26:0/3823209333 >> v2:172.21.15.26:3300/0 conn(0x7fc85c09e000 0x7fc85c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:28.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.007+0000 7fc85bfff700 1 -- 172.21.15.26:0/3823209333 >> v1:172.21.15.26:6789/0 conn(0x7fc85c09e410 legacy=0x7fc85c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:28.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.007+0000 7fc85bfff700 1 -- 172.21.15.26:0/3823209333 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85c09b2d0 con 0x7fc85c09d6f0 2023-10-01T07:58:28.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.008+0000 7fc85bfff700 1 --2- 172.21.15.26:0/3823209333 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc85c09d6f0 0x7fc85c09dac0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00bb90 tx=0x7fc84c00bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c946865945372fd server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:28.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.008+0000 7fc85affd700 1 -- 172.21.15.26:0/3823209333 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c00dd30 con 0x7fc85c09d6f0 2023-10-01T07:58:28.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.008+0000 7fc85affd700 1 -- 172.21.15.26:0/3823209333 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84c00de90 con 0x7fc85c09d6f0 2023-10-01T07:58:28.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.008+0000 7fc85affd700 1 -- 172.21.15.26:0/3823209333 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c010690 con 0x7fc85c09d6f0 2023-10-01T07:58:28.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.008+0000 7fc862277700 1 -- 172.21.15.26:0/3823209333 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc85c09d6f0 msgr2=0x7fc85c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:28.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.008+0000 7fc862277700 1 --2- 172.21.15.26:0/3823209333 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc85c09d6f0 0x7fc85c09dac0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00bb90 tx=0x7fc84c00bea0 comp rx=0 tx=0).stop 2023-10-01T07:58:28.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.009+0000 7fc862277700 1 -- 172.21.15.26:0/3823209333 shutdown_connections 2023-10-01T07:58:28.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.009+0000 7fc862277700 1 --2- 172.21.15.26:0/3823209333 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc85c09d6f0 0x7fc85c09dac0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:28.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.009+0000 7fc862277700 1 --2- 172.21.15.26:0/3823209333 >> v2:172.21.15.26:3300/0 conn(0x7fc85c09e000 0x7fc85c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:28.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.009+0000 7fc862277700 1 -- 172.21.15.26:0/3823209333 >> 172.21.15.26:0/3823209333 conn(0x7fc85c066f50 msgr2=0x7fc85c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:28.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.009+0000 7fc862277700 1 -- 172.21.15.26:0/3823209333 shutdown_connections 2023-10-01T07:58:28.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.009+0000 7fc862277700 1 -- 172.21.15.26:0/3823209333 wait complete. 2023-10-01T07:58:28.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.010+0000 7fc862277700 1 Processor -- start 2023-10-01T07:58:28.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.010+0000 7fc862277700 1 -- start start 2023-10-01T07:58:28.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.011+0000 7fc862277700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc85c09d6f0 0x7fc85c122520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:28.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.011+0000 7fc862277700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc85c09e000 0x7fc85c122a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:28.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.011+0000 7fc862277700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc85c09e410 0x7fc85c122fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:28.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.011+0000 7fc862277700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c123910 con 0x7fc85c09e410 2023-10-01T07:58:28.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.011+0000 7fc862277700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c125f40 con 0x7fc85c09d6f0 2023-10-01T07:58:28.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.011+0000 7fc862277700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c1259a0 con 0x7fc85c09e000 2023-10-01T07:58:28.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.011+0000 7fc85bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc85c09d6f0 0x7fc85c122520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:28.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.011+0000 7fc85bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc85c09d6f0 0x7fc85c122520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34220/0 (socket says 172.21.15.26:34220) 2023-10-01T07:58:28.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.011+0000 7fc85bfff700 1 -- 172.21.15.26:0/3893944517 learned_addr learned my addr 172.21.15.26:0/3893944517 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:28.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.011+0000 7fc85b7fe700 1 --2- 172.21.15.26:0/3893944517 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc85c09e000 0x7fc85c122a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:28.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.011+0000 7fc860814700 1 --2- 172.21.15.26:0/3893944517 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc85c09e410 0x7fc85c122fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:28.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.011+0000 7fc85bfff700 1 -- 172.21.15.26:0/3893944517 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc85c09e000 msgr2=0x7fc85c122a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:28.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.011+0000 7fc85bfff700 1 --2- 172.21.15.26:0/3893944517 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc85c09e000 0x7fc85c122a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:28.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.011+0000 7fc85bfff700 1 -- 172.21.15.26:0/3893944517 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc85c09e410 msgr2=0x7fc85c122fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:28.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.011+0000 7fc85bfff700 1 --2- 172.21.15.26:0/3893944517 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc85c09e410 0x7fc85c122fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:28.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.011+0000 7fc85bfff700 1 -- 172.21.15.26:0/3893944517 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc84c00b7f0 con 0x7fc85c09d6f0 2023-10-01T07:58:28.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.011+0000 7fc85b7fe700 1 --2- 172.21.15.26:0/3893944517 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc85c09e000 0x7fc85c122a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:58:28.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.011+0000 7fc85bfff700 1 --2- 172.21.15.26:0/3893944517 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc85c09d6f0 0x7fc85c122520 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc85c09ea70 tx=0x7fc84c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:28.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.012+0000 7fc858ff9700 1 -- 172.21.15.26:0/3893944517 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c003c70 con 0x7fc85c09d6f0 2023-10-01T07:58:28.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.012+0000 7fc862277700 1 -- 172.21.15.26:0/3893944517 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc85c0a1d00 con 0x7fc85c09d6f0 2023-10-01T07:58:28.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.012+0000 7fc858ff9700 1 -- 172.21.15.26:0/3893944517 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84c003df0 con 0x7fc85c09d6f0 2023-10-01T07:58:28.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.012+0000 7fc858ff9700 1 -- 172.21.15.26:0/3893944517 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c0106b0 con 0x7fc85c09d6f0 2023-10-01T07:58:28.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.012+0000 7fc862277700 1 -- 172.21.15.26:0/3893944517 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc85c124030 con 0x7fc85c09d6f0 2023-10-01T07:58:28.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.013+0000 7fc862277700 1 -- 172.21.15.26:0/3893944517 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc85c074ea0 con 0x7fc85c09d6f0 2023-10-01T07:58:28.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.014+0000 7fc858ff9700 1 -- 172.21.15.26:0/3893944517 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc84c019400 con 0x7fc85c09d6f0 2023-10-01T07:58:28.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.014+0000 7fc858ff9700 1 -- 172.21.15.26:0/3893944517 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc84c049350 con 0x7fc85c09d6f0 2023-10-01T07:58:28.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.019+0000 7fc858ff9700 1 -- 172.21.15.26:0/3893944517 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc84c046060 con 0x7fc85c09d6f0 2023-10-01T07:58:28.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.050+0000 7fb824388700 1 Processor -- start 2023-10-01T07:58:28.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.050+0000 7fb824388700 1 -- start start 2023-10-01T07:58:28.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.051+0000 7fb824388700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb81c06a770 0x7fb81c09d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:28.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.051+0000 7fb824388700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb81c09dc30 0x7fb81c09e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:28.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.051+0000 7fb824388700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb81c13c1e0 0x7fb81c13e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:28.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.051+0000 7fb824388700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb81c06ab40 con 0x7fb81c09dc30 2023-10-01T07:58:28.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.051+0000 7fb824388700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb81c09ebc0 con 0x7fb81c13c1e0 2023-10-01T07:58:28.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.051+0000 7fb824388700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb81c09a810 con 0x7fb81c06a770 2023-10-01T07:58:28.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.051+0000 7fb822124700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb81c06a770 0x7fb81c09d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:28.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.051+0000 7fb822925700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb81c13c1e0 0x7fb81c13e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:28.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.051+0000 7fb822124700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb81c06a770 0x7fb81c09d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41374/0 (socket says 172.21.15.26:41374) 2023-10-01T07:58:28.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.051+0000 7fb822124700 1 -- 172.21.15.26:0/94591996 learned_addr learned my addr 172.21.15.26:0/94591996 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:28.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.051+0000 7fb821923700 1 --2- 172.21.15.26:0/94591996 >> v2:172.21.15.26:3300/0 conn(0x7fb81c09dc30 0x7fb81c09e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:28.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.051+0000 7fb822124700 1 -- 172.21.15.26:0/94591996 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb81c13c1e0 msgr2=0x7fb81c13e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:28.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.051+0000 7fb822124700 1 --2- 172.21.15.26:0/94591996 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb81c13c1e0 0x7fb81c13e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:28.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.051+0000 7fb822124700 1 -- 172.21.15.26:0/94591996 >> v2:172.21.15.26:3300/0 conn(0x7fb81c09dc30 msgr2=0x7fb81c09e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:28.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.051+0000 7fb822124700 1 --2- 172.21.15.26:0/94591996 >> v2:172.21.15.26:3300/0 conn(0x7fb81c09dc30 0x7fb81c09e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:28.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.051+0000 7fb822124700 1 -- 172.21.15.26:0/94591996 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81c09e920 con 0x7fb81c06a770 2023-10-01T07:58:28.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.051+0000 7fb822925700 1 --2- 172.21.15.26:0/94591996 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb81c13c1e0 0x7fb81c13e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:28.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.052+0000 7fb822124700 1 --2- 172.21.15.26:0/94591996 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb81c06a770 0x7fb81c09d6f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb818009920 tx=0x7fb818009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ef5e7aa48a19832 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:28.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.052+0000 7fb821122700 1 -- 172.21.15.26:0/94591996 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb818011830 con 0x7fb81c06a770 2023-10-01T07:58:28.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.052+0000 7fb821122700 1 -- 172.21.15.26:0/94591996 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb818011990 con 0x7fb81c06a770 2023-10-01T07:58:28.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.052+0000 7fb821122700 1 -- 172.21.15.26:0/94591996 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb818011d20 con 0x7fb81c06a770 2023-10-01T07:58:28.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.052+0000 7fb824388700 1 -- 172.21.15.26:0/94591996 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb81c06a770 msgr2=0x7fb81c09d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:28.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.052+0000 7fb824388700 1 --2- 172.21.15.26:0/94591996 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb81c06a770 0x7fb81c09d6f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb818009920 tx=0x7fb818009c30 comp rx=0 tx=0).stop 2023-10-01T07:58:28.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.053+0000 7fb824388700 1 -- 172.21.15.26:0/94591996 shutdown_connections 2023-10-01T07:58:28.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.053+0000 7fb824388700 1 --2- 172.21.15.26:0/94591996 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb81c13c1e0 0x7fb81c13e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:28.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.053+0000 7fb824388700 1 --2- 172.21.15.26:0/94591996 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb81c06a770 0x7fb81c09d6f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:28.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.053+0000 7fb824388700 1 --2- 172.21.15.26:0/94591996 >> v2:172.21.15.26:3300/0 conn(0x7fb81c09dc30 0x7fb81c09e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:28.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.053+0000 7fb824388700 1 -- 172.21.15.26:0/94591996 >> 172.21.15.26:0/94591996 conn(0x7fb81c066f50 msgr2=0x7fb81c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:28.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.053+0000 7fb824388700 1 -- 172.21.15.26:0/94591996 shutdown_connections 2023-10-01T07:58:28.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.053+0000 7fb824388700 1 -- 172.21.15.26:0/94591996 wait complete. 2023-10-01T07:58:28.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.054+0000 7fb824388700 1 Processor -- start 2023-10-01T07:58:28.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.054+0000 7fb824388700 1 -- start start 2023-10-01T07:58:28.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.054+0000 7fb824388700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb81c06a770 0x7fb81c13b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:28.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.054+0000 7fb824388700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb81c09dc30 0x7fb81c13a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:28.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.054+0000 7fb824388700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb81c13c1e0 0x7fb81c13aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:28.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.054+0000 7fb824388700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81c09f250 con 0x7fb81c06a770 2023-10-01T07:58:28.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.054+0000 7fb824388700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb81c11ee90 con 0x7fb81c13c1e0 2023-10-01T07:58:28.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.054+0000 7fb824388700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb81c11fa00 con 0x7fb81c09dc30 2023-10-01T07:58:28.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.054+0000 7fb822925700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb81c13c1e0 0x7fb81c13aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:28.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.055+0000 7fb822124700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb81c06a770 0x7fb81c13b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:28.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.055+0000 7fb821923700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb81c09dc30 0x7fb81c13a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:28.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.055+0000 7fb822925700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb81c13c1e0 0x7fb81c13aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34242/0 (socket says 172.21.15.26:34242) 2023-10-01T07:58:28.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.055+0000 7fb822925700 1 -- 172.21.15.26:0/77689057 learned_addr learned my addr 172.21.15.26:0/77689057 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:28.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.055+0000 7fb821923700 1 -- 172.21.15.26:0/77689057 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb81c13c1e0 msgr2=0x7fb81c13aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:28.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.055+0000 7fb821923700 1 --2- 172.21.15.26:0/77689057 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb81c13c1e0 0x7fb81c13aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:28.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.055+0000 7fb821923700 1 -- 172.21.15.26:0/77689057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb81c06a770 msgr2=0x7fb81c13b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:28.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.055+0000 7fb821923700 1 --2- 172.21.15.26:0/77689057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb81c06a770 0x7fb81c13b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:28.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.055+0000 7fb821923700 1 -- 172.21.15.26:0/77689057 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb814009a70 con 0x7fb81c09dc30 2023-10-01T07:58:28.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.055+0000 7fb821923700 1 --2- 172.21.15.26:0/77689057 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb81c09dc30 0x7fb81c13a510 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00e900 tx=0x7fb80c00ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:28.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.055+0000 7fb812ffd700 1 -- 172.21.15.26:0/77689057 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c013680 con 0x7fb81c09dc30 2023-10-01T07:58:28.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.055+0000 7fb812ffd700 1 -- 172.21.15.26:0/77689057 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80c0137e0 con 0x7fb81c09dc30 2023-10-01T07:58:28.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.056+0000 7fb824388700 1 -- 172.21.15.26:0/77689057 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb818009550 con 0x7fb81c09dc30 2023-10-01T07:58:28.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.056+0000 7fb824388700 1 -- 172.21.15.26:0/77689057 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb81c0717c0 con 0x7fb81c09dc30 2023-10-01T07:58:28.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.056+0000 7fb812ffd700 1 -- 172.21.15.26:0/77689057 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c013b50 con 0x7fb81c09dc30 2023-10-01T07:58:28.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.057+0000 7fb812ffd700 1 -- 172.21.15.26:0/77689057 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb80c013cb0 con 0x7fb81c09dc30 2023-10-01T07:58:28.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.057+0000 7fb824388700 1 -- 172.21.15.26:0/77689057 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb81c11ff00 con 0x7fb81c09dc30 2023-10-01T07:58:28.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.057+0000 7fb812ffd700 1 -- 172.21.15.26:0/77689057 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb80c03fa40 con 0x7fb81c09dc30 2023-10-01T07:58:28.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.067+0000 7fb812ffd700 1 -- 172.21.15.26:0/77689057 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb80c01abe0 con 0x7fb81c09dc30 2023-10-01T07:58:28.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.127+0000 7f89c80b0700 1 -- 172.21.15.26:0/4169773697 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f89c0074ea0 con 0x7f89c009e410 2023-10-01T07:58:28.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.127+0000 7f89b67fc700 1 -- 172.21.15.26:0/4169773697 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f89b80228f0 con 0x7f89c009e410 2023-10-01T07:58:28.128 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:28.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.130+0000 7f89c80b0700 1 -- 172.21.15.26:0/4169773697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89c009e410 msgr2=0x7f89c011ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:28.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.130+0000 7f89c80b0700 1 --2- 172.21.15.26:0/4169773697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89c009e410 0x7f89c011ec60 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f89b800cae0 tx=0x7f89b800cdf0 comp rx=0 tx=0).stop 2023-10-01T07:58:28.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.130+0000 7f89c80b0700 1 -- 172.21.15.26:0/4169773697 shutdown_connections 2023-10-01T07:58:28.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.130+0000 7f89c80b0700 1 --2- 172.21.15.26:0/4169773697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89c009e410 0x7f89c011ec60 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:28.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.130+0000 7f89c80b0700 1 --2- 172.21.15.26:0/4169773697 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89c009d6f0 0x7f89c011e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:28.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.130+0000 7f89c80b0700 1 --2- 172.21.15.26:0/4169773697 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89c009e000 0x7f89c011e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:28.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.130+0000 7f89c80b0700 1 -- 172.21.15.26:0/4169773697 >> 172.21.15.26:0/4169773697 conn(0x7f89c0066f50 msgr2=0x7f89c006f070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:28.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.130+0000 7f89c80b0700 1 -- 172.21.15.26:0/4169773697 shutdown_connections 2023-10-01T07:58:28.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.130+0000 7f89c80b0700 1 -- 172.21.15.26:0/4169773697 wait complete. 2023-10-01T07:58:28.144 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:28.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.196+0000 7f4984983700 1 -- 172.21.15.26:0/1456036219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4980072980 con 0x7f49800a0a30 2023-10-01T07:58:28.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.196+0000 7f496effd700 1 -- 172.21.15.26:0/1456036219 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f497401abe0 con 0x7f49800a0a30 2023-10-01T07:58:28.197 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:28.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.199+0000 7f4984983700 1 -- 172.21.15.26:0/1456036219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49800a0a30 msgr2=0x7f49801c8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:28.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.199+0000 7f4984983700 1 --2- 172.21.15.26:0/1456036219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49800a0a30 0x7f49801c8540 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f497400e8d0 tx=0x7f497400ebe0 comp rx=0 tx=0).stop 2023-10-01T07:58:28.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.199+0000 7f4984983700 1 -- 172.21.15.26:0/1456036219 shutdown_connections 2023-10-01T07:58:28.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.199+0000 7f4984983700 1 --2- 172.21.15.26:0/1456036219 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4980133930 0x7f49801c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:28.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.199+0000 7f4984983700 1 --2- 172.21.15.26:0/1456036219 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f498009d630 0x7f49801c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:28.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.199+0000 7f4984983700 1 --2- 172.21.15.26:0/1456036219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49800a0a30 0x7f49801c8540 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:28.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.199+0000 7f4984983700 1 -- 172.21.15.26:0/1456036219 >> 172.21.15.26:0/1456036219 conn(0x7f49800a3050 msgr2=0x7f498009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:28.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.200+0000 7f4984983700 1 -- 172.21.15.26:0/1456036219 shutdown_connections 2023-10-01T07:58:28.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.200+0000 7f4984983700 1 -- 172.21.15.26:0/1456036219 wait complete. 2023-10-01T07:58:28.214 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:28.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.244+0000 7fc862277700 1 -- 172.21.15.26:0/3893944517 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc85c125cc0 con 0x7fc85c09d6f0 2023-10-01T07:58:28.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.245+0000 7fc858ff9700 1 -- 172.21.15.26:0/3893944517 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc84c046070 con 0x7fc85c09d6f0 2023-10-01T07:58:28.246 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:28.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.247+0000 7fc862277700 1 -- 172.21.15.26:0/3893944517 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc85c09d6f0 msgr2=0x7fc85c122520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:28.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.247+0000 7fc862277700 1 --2- 172.21.15.26:0/3893944517 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc85c09d6f0 0x7fc85c122520 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc85c09ea70 tx=0x7fc84c004750 comp rx=0 tx=0).stop 2023-10-01T07:58:28.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.247+0000 7fc862277700 1 -- 172.21.15.26:0/3893944517 shutdown_connections 2023-10-01T07:58:28.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.247+0000 7fc862277700 1 --2- 172.21.15.26:0/3893944517 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc85c09e410 0x7fc85c122fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:28.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.247+0000 7fc862277700 1 --2- 172.21.15.26:0/3893944517 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc85c09d6f0 0x7fc85c122520 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:28.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.247+0000 7fc862277700 1 --2- 172.21.15.26:0/3893944517 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc85c09e000 0x7fc85c122a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:28.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.247+0000 7fc862277700 1 -- 172.21.15.26:0/3893944517 >> 172.21.15.26:0/3893944517 conn(0x7fc85c066f50 msgr2=0x7fc85c06f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:28.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.247+0000 7fc862277700 1 -- 172.21.15.26:0/3893944517 shutdown_connections 2023-10-01T07:58:28.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.247+0000 7fc862277700 1 -- 172.21.15.26:0/3893944517 wait complete. 2023-10-01T07:58:28.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:28.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.297+0000 7fb824388700 1 -- 172.21.15.26:0/77689057 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb81c074ea0 con 0x7fb81c09dc30 2023-10-01T07:58:28.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.298+0000 7fb812ffd700 1 -- 172.21.15.26:0/77689057 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb80c017020 con 0x7fb81c09dc30 2023-10-01T07:58:28.298 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:28.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.300+0000 7fb824388700 1 -- 172.21.15.26:0/77689057 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb81c09dc30 msgr2=0x7fb81c13a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:28.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.300+0000 7fb824388700 1 --2- 172.21.15.26:0/77689057 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb81c09dc30 0x7fb81c13a510 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00e900 tx=0x7fb80c00ec10 comp rx=0 tx=0).stop 2023-10-01T07:58:28.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.300+0000 7fb824388700 1 -- 172.21.15.26:0/77689057 shutdown_connections 2023-10-01T07:58:28.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.300+0000 7fb824388700 1 --2- 172.21.15.26:0/77689057 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb81c13c1e0 0x7fb81c13aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:28.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.300+0000 7fb824388700 1 --2- 172.21.15.26:0/77689057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb81c06a770 0x7fb81c13b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:28.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.300+0000 7fb824388700 1 --2- 172.21.15.26:0/77689057 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb81c09dc30 0x7fb81c13a510 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:28.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.300+0000 7fb824388700 1 -- 172.21.15.26:0/77689057 >> 172.21.15.26:0/77689057 conn(0x7fb81c066f50 msgr2=0x7fb81c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:28.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.300+0000 7fb824388700 1 -- 172.21.15.26:0/77689057 shutdown_connections 2023-10-01T07:58:28.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:28.300+0000 7fb824388700 1 -- 172.21.15.26:0/77689057 wait complete. 2023-10-01T07:58:28.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:29.146 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:29.215 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:29.262 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:29.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.294+0000 7f5c9e334700 1 Processor -- start 2023-10-01T07:58:29.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.294+0000 7f5c9e334700 1 -- start start 2023-10-01T07:58:29.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.295+0000 7f5c9e334700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5c9809d6f0 0x7f5c9809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:29.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.295+0000 7f5c9e334700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c9809e440 0x7f5c98134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:29.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.295+0000 7f5c9e334700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c9809b120 con 0x7f5c9809e000 2023-10-01T07:58:29.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.295+0000 7f5c9e334700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c9806b460 con 0x7f5c9809d6f0 2023-10-01T07:58:29.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.295+0000 7f5c9e334700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9809a7e0 con 0x7f5c9809e440 2023-10-01T07:58:29.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.295+0000 7f5c9c8d1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c9809e440 0x7f5c98134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:29.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.295+0000 7f5c9c8d1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c9809e440 0x7f5c98134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41400/0 (socket says 172.21.15.26:41400) 2023-10-01T07:58:29.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.295+0000 7f5c9c8d1700 1 -- 172.21.15.26:0/1846301138 learned_addr learned my addr 172.21.15.26:0/1846301138 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:29.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.295+0000 7f5c977fe700 1 --1- 172.21.15.26:0/1846301138 >> v1:172.21.15.26:6789/0 conn(0x7f5c9809e000 0x7f5c981339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60280/0 (socket says 172.21.15.26:60280) 2023-10-01T07:58:29.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.295+0000 7f5c97fff700 1 --2- 172.21.15.26:0/1846301138 >> v2:172.21.15.26:3300/0 conn(0x7f5c9809d6f0 0x7f5c9809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:29.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.295+0000 7f5c9c8d1700 1 -- 172.21.15.26:0/1846301138 >> v2:172.21.15.26:3300/0 conn(0x7f5c9809d6f0 msgr2=0x7f5c9809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:29.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.295+0000 7f5c9c8d1700 1 --2- 172.21.15.26:0/1846301138 >> v2:172.21.15.26:3300/0 conn(0x7f5c9809d6f0 0x7f5c9809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.295+0000 7f5c9c8d1700 1 -- 172.21.15.26:0/1846301138 >> v1:172.21.15.26:6789/0 conn(0x7f5c9809e000 legacy=0x7f5c981339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:29.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.296+0000 7f5c9c8d1700 1 -- 172.21.15.26:0/1846301138 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c9809a500 con 0x7f5c9809e440 2023-10-01T07:58:29.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.296+0000 7f5c97fff700 1 --2- 172.21.15.26:0/1846301138 >> v2:172.21.15.26:3300/0 conn(0x7f5c9809d6f0 0x7f5c9809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:29.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.296+0000 7f5c9c8d1700 1 --2- 172.21.15.26:0/1846301138 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c9809e440 0x7f5c98134100 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5c90009e80 tx=0x7f5c9000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d88df4743d23b5cc server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:29.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.296+0000 7f5c96ffd700 1 -- 172.21.15.26:0/1846301138 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9000e070 con 0x7f5c9809e440 2023-10-01T07:58:29.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.296+0000 7f5c96ffd700 1 -- 172.21.15.26:0/1846301138 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9000b8d0 con 0x7f5c9809e440 2023-10-01T07:58:29.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.296+0000 7f5c96ffd700 1 -- 172.21.15.26:0/1846301138 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9000bc80 con 0x7f5c9809e440 2023-10-01T07:58:29.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.297+0000 7f5c9e334700 1 -- 172.21.15.26:0/1846301138 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c9809e440 msgr2=0x7f5c98134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:29.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.297+0000 7f5c9e334700 1 --2- 172.21.15.26:0/1846301138 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c9809e440 0x7f5c98134100 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5c90009e80 tx=0x7f5c9000b330 comp rx=0 tx=0).stop 2023-10-01T07:58:29.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.297+0000 7f5c9e334700 1 -- 172.21.15.26:0/1846301138 shutdown_connections 2023-10-01T07:58:29.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.297+0000 7f5c9e334700 1 --2- 172.21.15.26:0/1846301138 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c9809e440 0x7f5c98134100 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.297+0000 7f5c9e334700 1 --2- 172.21.15.26:0/1846301138 >> v2:172.21.15.26:3300/0 conn(0x7f5c9809d6f0 0x7f5c9809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.297+0000 7f5c9e334700 1 -- 172.21.15.26:0/1846301138 >> 172.21.15.26:0/1846301138 conn(0x7f5c98066f50 msgr2=0x7f5c9809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:29.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.297+0000 7f5c9e334700 1 -- 172.21.15.26:0/1846301138 shutdown_connections 2023-10-01T07:58:29.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.297+0000 7f5c9e334700 1 -- 172.21.15.26:0/1846301138 wait complete. 2023-10-01T07:58:29.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.298+0000 7f5c9e334700 1 Processor -- start 2023-10-01T07:58:29.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.299+0000 7f5c9e334700 1 -- start start 2023-10-01T07:58:29.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.299+0000 7f5c9e334700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c9809d6f0 0x7f5c981a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:29.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.299+0000 7f5c9e334700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c9809e000 0x7f5c981a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:29.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.299+0000 7f5c9e334700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c9809e440 0x7f5c981a6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:29.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.299+0000 7f5c9e334700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c981aa360 con 0x7f5c9809e000 2023-10-01T07:58:29.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.299+0000 7f5c9e334700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c981a99a0 con 0x7f5c9809d6f0 2023-10-01T07:58:29.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.299+0000 7f5c9e334700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c981a8ce0 con 0x7f5c9809e440 2023-10-01T07:58:29.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.300+0000 7f5c97fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c9809d6f0 0x7f5c981a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:29.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.300+0000 7f5c97fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c9809d6f0 0x7f5c981a5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34252/0 (socket says 172.21.15.26:34252) 2023-10-01T07:58:29.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.300+0000 7f5c97fff700 1 -- 172.21.15.26:0/3728752879 learned_addr learned my addr 172.21.15.26:0/3728752879 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:29.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.300+0000 7f5c9c8d1700 1 --2- 172.21.15.26:0/3728752879 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c9809e440 0x7f5c981a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:29.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.300+0000 7f5c977fe700 1 --2- 172.21.15.26:0/3728752879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c9809e000 0x7f5c981a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:29.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.300+0000 7f5c9c8d1700 1 -- 172.21.15.26:0/3728752879 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c9809d6f0 msgr2=0x7f5c981a5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:29.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.300+0000 7f5c9c8d1700 1 --2- 172.21.15.26:0/3728752879 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c9809d6f0 0x7f5c981a5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.300+0000 7f5c9c8d1700 1 -- 172.21.15.26:0/3728752879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c9809e000 msgr2=0x7f5c981a6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:29.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.300+0000 7f5c9c8d1700 1 --2- 172.21.15.26:0/3728752879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c9809e000 0x7f5c981a6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.300+0000 7f5c9c8d1700 1 -- 172.21.15.26:0/3728752879 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c880094a0 con 0x7f5c9809e440 2023-10-01T07:58:29.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.300+0000 7f5c97fff700 1 --2- 172.21.15.26:0/3728752879 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c9809d6f0 0x7f5c981a5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:29.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.300+0000 7f5c977fe700 1 --2- 172.21.15.26:0/3728752879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c9809e000 0x7f5c981a6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:29.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.300+0000 7f5c9c8d1700 1 --2- 172.21.15.26:0/3728752879 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c9809e440 0x7f5c981a6950 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5c90009e50 tx=0x7f5c90004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:29.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.301+0000 7f5c94ff9700 1 -- 172.21.15.26:0/3728752879 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c90004800 con 0x7f5c9809e440 2023-10-01T07:58:29.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.301+0000 7f5c94ff9700 1 -- 172.21.15.26:0/3728752879 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c90004960 con 0x7f5c9809e440 2023-10-01T07:58:29.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.301+0000 7f5c9e334700 1 -- 172.21.15.26:0/3728752879 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c90009b30 con 0x7f5c9809e440 2023-10-01T07:58:29.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.301+0000 7f5c94ff9700 1 -- 172.21.15.26:0/3728752879 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9001c680 con 0x7f5c9809e440 2023-10-01T07:58:29.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.301+0000 7f5c9e334700 1 -- 172.21.15.26:0/3728752879 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c981a7a90 con 0x7f5c9809e440 2023-10-01T07:58:29.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.302+0000 7f5c94ff9700 1 -- 172.21.15.26:0/3728752879 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5c9001c7e0 con 0x7f5c9809e440 2023-10-01T07:58:29.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.302+0000 7f5c9e334700 1 -- 172.21.15.26:0/3728752879 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c981a9540 con 0x7f5c9809e440 2023-10-01T07:58:29.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.302+0000 7f5c94ff9700 1 -- 172.21.15.26:0/3728752879 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5c900410f0 con 0x7f5c9809e440 2023-10-01T07:58:29.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.311+0000 7f5c94ff9700 1 -- 172.21.15.26:0/3728752879 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5c9001a330 con 0x7f5c9809e440 2023-10-01T07:58:29.315 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:29.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.360+0000 7f8e1fc2b700 1 Processor -- start 2023-10-01T07:58:29.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.360+0000 7f8e1fc2b700 1 -- start start 2023-10-01T07:58:29.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.361+0000 7f8e1fc2b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e1806a770 0x7f8e1806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:29.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.361+0000 7f8e1fc2b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e1806b080 0x7f8e18131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:29.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.361+0000 7f8e1fc2b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e1809ece0 con 0x7f8e18131b40 2023-10-01T07:58:29.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.361+0000 7f8e1fc2b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1809e760 con 0x7f8e1806a770 2023-10-01T07:58:29.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.361+0000 7f8e1fc2b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1809e040 con 0x7f8e1806b080 2023-10-01T07:58:29.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.361+0000 7f8e1e1c8700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8e18131b40 0x7f8e18138850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60290/0 (socket says 172.21.15.26:60290) 2023-10-01T07:58:29.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.361+0000 7f8e1e1c8700 1 -- 172.21.15.26:0/1122406773 learned_addr learned my addr 172.21.15.26:0/1122406773 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:29.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.361+0000 7f8e1d9c7700 1 --2- 172.21.15.26:0/1122406773 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e1806a770 0x7f8e1806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:29.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.361+0000 7f8e1d1c6700 1 --2- 172.21.15.26:0/1122406773 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e1806b080 0x7f8e18131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:29.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.361+0000 7f8e1c9c5700 1 -- 172.21.15.26:0/1122406773 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4076289510 0 0) 0x7f8e1809ece0 con 0x7f8e18131b40 2023-10-01T07:58:29.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.361+0000 7f8e1c9c5700 1 -- 172.21.15.26:0/1122406773 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e040035b0 con 0x7f8e18131b40 2023-10-01T07:58:29.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.362+0000 7f8e1d9c7700 1 -- 172.21.15.26:0/1122406773 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e1806b080 msgr2=0x7f8e18131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:29.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.362+0000 7f8e1d9c7700 1 --2- 172.21.15.26:0/1122406773 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e1806b080 0x7f8e18131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.362+0000 7f8e1d9c7700 1 -- 172.21.15.26:0/1122406773 >> v1:172.21.15.26:6789/0 conn(0x7f8e18131b40 legacy=0x7f8e18138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:29.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.362+0000 7f8e1d9c7700 1 -- 172.21.15.26:0/1122406773 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1809f630 con 0x7f8e1806a770 2023-10-01T07:58:29.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.362+0000 7f8e1d1c6700 1 --2- 172.21.15.26:0/1122406773 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e1806b080 0x7f8e18131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:29.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.362+0000 7f8e1d9c7700 1 --2- 172.21.15.26:0/1122406773 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e1806a770 0x7f8e1806ab40 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f8e14009870 tx=0x7f8e14009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44cd7b01095aef0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:29.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.362+0000 7f8e1c9c5700 1 -- 172.21.15.26:0/1122406773 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e14004230 con 0x7f8e1806a770 2023-10-01T07:58:29.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.362+0000 7f8e1c9c5700 1 -- 172.21.15.26:0/1122406773 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e14004390 con 0x7f8e1806a770 2023-10-01T07:58:29.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.362+0000 7f8e1c9c5700 1 -- 172.21.15.26:0/1122406773 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e140036a0 con 0x7f8e1806a770 2023-10-01T07:58:29.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.363+0000 7f8e1fc2b700 1 -- 172.21.15.26:0/1122406773 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e1806a770 msgr2=0x7f8e1806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:29.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.363+0000 7f8e1fc2b700 1 --2- 172.21.15.26:0/1122406773 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e1806a770 0x7f8e1806ab40 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f8e14009870 tx=0x7f8e14009b80 comp rx=0 tx=0).stop 2023-10-01T07:58:29.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.363+0000 7f8e1fc2b700 1 -- 172.21.15.26:0/1122406773 shutdown_connections 2023-10-01T07:58:29.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.363+0000 7f8e1fc2b700 1 --2- 172.21.15.26:0/1122406773 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e1806a770 0x7f8e1806ab40 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.363+0000 7f8e1fc2b700 1 --2- 172.21.15.26:0/1122406773 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e1806b080 0x7f8e18131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.363+0000 7f8e1fc2b700 1 -- 172.21.15.26:0/1122406773 >> 172.21.15.26:0/1122406773 conn(0x7f8e18066f50 msgr2=0x7f8e1809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:29.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.363+0000 7f8e1fc2b700 1 -- 172.21.15.26:0/1122406773 shutdown_connections 2023-10-01T07:58:29.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.363+0000 7f8e1fc2b700 1 -- 172.21.15.26:0/1122406773 wait complete. 2023-10-01T07:58:29.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.364+0000 7f8e1fc2b700 1 Processor -- start 2023-10-01T07:58:29.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.364+0000 7f8e1fc2b700 1 -- start start 2023-10-01T07:58:29.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.365+0000 7f8e1fc2b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e1806a770 0x7f8e181c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:29.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.365+0000 7f8e1fc2b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e1806b080 0x7f8e181c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:29.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.365+0000 7f8e1fc2b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e18131b40 0x7f8e181c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:29.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.365+0000 7f8e1fc2b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e18125340 con 0x7f8e18131b40 2023-10-01T07:58:29.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.365+0000 7f8e1fc2b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e18126160 con 0x7f8e1806b080 2023-10-01T07:58:29.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.365+0000 7f8e1fc2b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1809c010 con 0x7f8e1806a770 2023-10-01T07:58:29.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.365+0000 7f8e1d1c6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e1806b080 0x7f8e181c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:29.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.365+0000 7f8e1e1c8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e18131b40 0x7f8e181c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:29.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.365+0000 7f8e1d1c6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e1806b080 0x7f8e181c8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34276/0 (socket says 172.21.15.26:34276) 2023-10-01T07:58:29.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.365+0000 7f8e1d1c6700 1 -- 172.21.15.26:0/1745733684 learned_addr learned my addr 172.21.15.26:0/1745733684 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:29.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.365+0000 7f8e1d9c7700 1 --2- 172.21.15.26:0/1745733684 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e1806a770 0x7f8e181c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:29.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.365+0000 7f8e1d1c6700 1 -- 172.21.15.26:0/1745733684 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e1806a770 msgr2=0x7f8e181c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:29.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.365+0000 7f8e1d1c6700 1 --2- 172.21.15.26:0/1745733684 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e1806a770 0x7f8e181c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.365+0000 7f8e1d1c6700 1 -- 172.21.15.26:0/1745733684 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e18131b40 msgr2=0x7f8e181c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:29.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.365+0000 7f8e1d1c6700 1 --2- 172.21.15.26:0/1745733684 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e18131b40 0x7f8e181c8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.365+0000 7f8e1d1c6700 1 -- 172.21.15.26:0/1745733684 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e080094a0 con 0x7f8e1806b080 2023-10-01T07:58:29.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.365+0000 7f8e1e1c8700 1 --2- 172.21.15.26:0/1745733684 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e18131b40 0x7f8e181c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:29.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.365+0000 7f8e1d1c6700 1 --2- 172.21.15.26:0/1745733684 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e1806b080 0x7f8e181c8630 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8e0800ebe0 tx=0x7f8e0800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:29.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.366+0000 7f8e0e7fc700 1 -- 172.21.15.26:0/1745733684 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0800c850 con 0x7f8e1806b080 2023-10-01T07:58:29.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.366+0000 7f8e0e7fc700 1 -- 172.21.15.26:0/1745733684 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0800c9b0 con 0x7f8e1806b080 2023-10-01T07:58:29.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.366+0000 7f8e1fc2b700 1 -- 172.21.15.26:0/1745733684 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e140094a0 con 0x7f8e1806b080 2023-10-01T07:58:29.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.366+0000 7f8e0e7fc700 1 -- 172.21.15.26:0/1745733684 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0800cd40 con 0x7f8e1806b080 2023-10-01T07:58:29.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.366+0000 7f8e1fc2b700 1 -- 172.21.15.26:0/1745733684 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e18071e60 con 0x7f8e1806b080 2023-10-01T07:58:29.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.367+0000 7f8e0e7fc700 1 -- 172.21.15.26:0/1745733684 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e08013470 con 0x7f8e1806b080 2023-10-01T07:58:29.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.367+0000 7f8e0e7fc700 1 -- 172.21.15.26:0/1745733684 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8e0803fb80 con 0x7f8e1806b080 2023-10-01T07:58:29.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.368+0000 7f8e1fc2b700 1 -- 172.21.15.26:0/1745733684 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e18131380 con 0x7f8e1806b080 2023-10-01T07:58:29.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.377+0000 7f8e0e7fc700 1 -- 172.21.15.26:0/1745733684 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e0803fe60 con 0x7f8e1806b080 2023-10-01T07:58:29.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.415+0000 7f73397d2700 1 Processor -- start 2023-10-01T07:58:29.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.415+0000 7f73397d2700 1 -- start start 2023-10-01T07:58:29.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.415+0000 7f73397d2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f733412cf60 0x7f733406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:29.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.415+0000 7f73397d2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f733412f8b0 0x7f733412fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:29.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.415+0000 7f73397d2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7334130260 0x7f7334136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:29.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.415+0000 7f73397d2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f733412d330 con 0x7f733412f8b0 2023-10-01T07:58:29.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.415+0000 7f73397d2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f733412cd90 con 0x7f733412cf60 2023-10-01T07:58:29.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.415+0000 7f73397d2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73341306d0 con 0x7f7334130260 2023-10-01T07:58:29.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.416+0000 7f7332ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f733412cf60 0x7f733406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:29.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.416+0000 7f7332ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f733412cf60 0x7f733406f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34284/0 (socket says 172.21.15.26:34284) 2023-10-01T07:58:29.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.416+0000 7f7332ffd700 1 -- 172.21.15.26:0/4964612 learned_addr learned my addr 172.21.15.26:0/4964612 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:29.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.416+0000 7f73337fe700 1 --2- 172.21.15.26:0/4964612 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7334130260 0x7f7334136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:29.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.416+0000 7f73327fc700 1 --2- 172.21.15.26:0/4964612 >> v2:172.21.15.26:3300/0 conn(0x7f733412f8b0 0x7f733412fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:29.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.416+0000 7f73337fe700 1 -- 172.21.15.26:0/4964612 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f733412cf60 msgr2=0x7f733406f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:29.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.416+0000 7f73337fe700 1 --2- 172.21.15.26:0/4964612 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f733412cf60 0x7f733406f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.416+0000 7f73337fe700 1 -- 172.21.15.26:0/4964612 >> v2:172.21.15.26:3300/0 conn(0x7f733412f8b0 msgr2=0x7f733412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:29.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.416+0000 7f73337fe700 1 --2- 172.21.15.26:0/4964612 >> v2:172.21.15.26:3300/0 conn(0x7f733412f8b0 0x7f733412fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.416+0000 7f73337fe700 1 -- 172.21.15.26:0/4964612 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7334071780 con 0x7f7334130260 2023-10-01T07:58:29.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.416+0000 7f73327fc700 1 --2- 172.21.15.26:0/4964612 >> v2:172.21.15.26:3300/0 conn(0x7f733412f8b0 0x7f733412fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:29.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.416+0000 7f73337fe700 1 --2- 172.21.15.26:0/4964612 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7334130260 0x7f7334136c20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f732c009dc0 tx=0x7f732c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c6253e9e55f5b2f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:29.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.416+0000 7f7331ffb700 1 -- 172.21.15.26:0/4964612 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c00e070 con 0x7f7334130260 2023-10-01T07:58:29.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.417+0000 7f7331ffb700 1 -- 172.21.15.26:0/4964612 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732c00bae0 con 0x7f7334130260 2023-10-01T07:58:29.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.417+0000 7f7331ffb700 1 -- 172.21.15.26:0/4964612 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c00be90 con 0x7f7334130260 2023-10-01T07:58:29.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.417+0000 7f73397d2700 1 -- 172.21.15.26:0/4964612 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7334130260 msgr2=0x7f7334136c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:29.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.417+0000 7f73397d2700 1 --2- 172.21.15.26:0/4964612 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7334130260 0x7f7334136c20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f732c009dc0 tx=0x7f732c00b330 comp rx=0 tx=0).stop 2023-10-01T07:58:29.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.417+0000 7f73397d2700 1 -- 172.21.15.26:0/4964612 shutdown_connections 2023-10-01T07:58:29.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.417+0000 7f73397d2700 1 --2- 172.21.15.26:0/4964612 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7334130260 0x7f7334136c20 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.417+0000 7f73397d2700 1 --2- 172.21.15.26:0/4964612 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f733412cf60 0x7f733406f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.417+0000 7f73397d2700 1 --2- 172.21.15.26:0/4964612 >> v2:172.21.15.26:3300/0 conn(0x7f733412f8b0 0x7f733412fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.417+0000 7f73397d2700 1 -- 172.21.15.26:0/4964612 >> 172.21.15.26:0/4964612 conn(0x7f73340a2aa0 msgr2=0x7f73340a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:29.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.417+0000 7f73397d2700 1 -- 172.21.15.26:0/4964612 shutdown_connections 2023-10-01T07:58:29.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.417+0000 7f73397d2700 1 -- 172.21.15.26:0/4964612 wait complete. 2023-10-01T07:58:29.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.419+0000 7f73397d2700 1 Processor -- start 2023-10-01T07:58:29.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.419+0000 7f73397d2700 1 -- start start 2023-10-01T07:58:29.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.419+0000 7f73397d2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f733412cf60 0x7f73341c3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:29.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.419+0000 7f73397d2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f733412f8b0 0x7f73341c3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:29.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.419+0000 7f73397d2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7334130260 0x7f73341c6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:29.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.419+0000 7f73397d2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733411dda0 con 0x7f733412cf60 2023-10-01T07:58:29.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.419+0000 7f73397d2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73341c3aa0 con 0x7f7334130260 2023-10-01T07:58:29.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.419+0000 7f73397d2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f733411dfa0 con 0x7f733412f8b0 2023-10-01T07:58:29.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.419+0000 7f7332ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f733412cf60 0x7f73341c3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:29.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.419+0000 7f73337fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7334130260 0x7f73341c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:29.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.419+0000 7f7332ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f733412cf60 0x7f73341c3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50070/0 (socket says 172.21.15.26:50070) 2023-10-01T07:58:29.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.419+0000 7f73337fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7334130260 0x7f73341c6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34286/0 (socket says 172.21.15.26:34286) 2023-10-01T07:58:29.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.419+0000 7f7332ffd700 1 -- 172.21.15.26:0/3064382158 learned_addr learned my addr 172.21.15.26:0/3064382158 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:29.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.420+0000 7f73327fc700 1 --2- 172.21.15.26:0/3064382158 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f733412f8b0 0x7f73341c3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:29.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.420+0000 7f7332ffd700 1 -- 172.21.15.26:0/3064382158 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f733412f8b0 msgr2=0x7f73341c3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:29.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.420+0000 7f7332ffd700 1 --2- 172.21.15.26:0/3064382158 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f733412f8b0 0x7f73341c3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.420+0000 7f7332ffd700 1 -- 172.21.15.26:0/3064382158 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7334130260 msgr2=0x7f73341c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:29.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.420+0000 7f7332ffd700 1 --2- 172.21.15.26:0/3064382158 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7334130260 0x7f73341c6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.420+0000 7f7332ffd700 1 -- 172.21.15.26:0/3064382158 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732800a640 con 0x7f733412cf60 2023-10-01T07:58:29.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.420+0000 7f73327fc700 1 --2- 172.21.15.26:0/3064382158 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f733412f8b0 0x7f73341c3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:58:29.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.420+0000 7f73337fe700 1 --2- 172.21.15.26:0/3064382158 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7334130260 0x7f73341c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:29.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.420+0000 7f7332ffd700 1 --2- 172.21.15.26:0/3064382158 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f733412cf60 0x7f73341c3020 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f732400e910 tx=0x7f732400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:29.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.420+0000 7f731b7fe700 1 -- 172.21.15.26:0/3064382158 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73240096a0 con 0x7f733412cf60 2023-10-01T07:58:29.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.420+0000 7f731b7fe700 1 -- 172.21.15.26:0/3064382158 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732400ee60 con 0x7f733412cf60 2023-10-01T07:58:29.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.420+0000 7f73397d2700 1 -- 172.21.15.26:0/3064382158 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f732c009a70 con 0x7f733412cf60 2023-10-01T07:58:29.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.420+0000 7f731b7fe700 1 -- 172.21.15.26:0/3064382158 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732400ca90 con 0x7f733412cf60 2023-10-01T07:58:29.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.420+0000 7f73397d2700 1 -- 172.21.15.26:0/3064382158 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f733412d960 con 0x7f733412cf60 2023-10-01T07:58:29.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.422+0000 7f731b7fe700 1 -- 172.21.15.26:0/3064382158 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f732400cbf0 con 0x7f733412cf60 2023-10-01T07:58:29.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.422+0000 7f73397d2700 1 -- 172.21.15.26:0/3064382158 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7334074ea0 con 0x7f733412cf60 2023-10-01T07:58:29.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.422+0000 7f731b7fe700 1 -- 172.21.15.26:0/3064382158 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f732403fab0 con 0x7f733412cf60 2023-10-01T07:58:29.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.431+0000 7f731b7fe700 1 -- 172.21.15.26:0/3064382158 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f732401b3b0 con 0x7f733412cf60 2023-10-01T07:58:29.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.460+0000 7fa16a9e1700 1 Processor -- start 2023-10-01T07:58:29.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.460+0000 7fa16a9e1700 1 -- start start 2023-10-01T07:58:29.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.461+0000 7fa16a9e1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa1640a0a30 0x7fa1640a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:29.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.461+0000 7fa16a9e1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa16409d630 0x7fa1640a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:29.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.461+0000 7fa16a9e1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa164133930 0x7fa164133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:29.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.461+0000 7fa16a9e1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1640a2a70 con 0x7fa1640a0a30 2023-10-01T07:58:29.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.461+0000 7fa16a9e1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1640a01d0 con 0x7fa164133930 2023-10-01T07:58:29.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.461+0000 7fa16a9e1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa16409e2b0 con 0x7fa16409d630 2023-10-01T07:58:29.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.461+0000 7fa163fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa1640a0a30 0x7fa1640a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:29.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.461+0000 7fa163fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa1640a0a30 0x7fa1640a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50082/0 (socket says 172.21.15.26:50082) 2023-10-01T07:58:29.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.461+0000 7fa168f7e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa164133930 0x7fa164133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:29.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.461+0000 7fa163fff700 1 -- 172.21.15.26:0/2858491823 learned_addr learned my addr 172.21.15.26:0/2858491823 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:29.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.462+0000 7fa1637fe700 1 --2- 172.21.15.26:0/2858491823 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa16409d630 0x7fa1640a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:29.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.462+0000 7fa168f7e700 1 -- 172.21.15.26:0/2858491823 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa16409d630 msgr2=0x7fa1640a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:29.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.462+0000 7fa168f7e700 1 --2- 172.21.15.26:0/2858491823 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa16409d630 0x7fa1640a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.462+0000 7fa168f7e700 1 -- 172.21.15.26:0/2858491823 >> v2:172.21.15.26:3300/0 conn(0x7fa1640a0a30 msgr2=0x7fa1640a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:29.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.462+0000 7fa168f7e700 1 --2- 172.21.15.26:0/2858491823 >> v2:172.21.15.26:3300/0 conn(0x7fa1640a0a30 0x7fa1640a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.462+0000 7fa168f7e700 1 -- 172.21.15.26:0/2858491823 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa16409dc50 con 0x7fa164133930 2023-10-01T07:58:29.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.462+0000 7fa1637fe700 1 --2- 172.21.15.26:0/2858491823 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa16409d630 0x7fa1640a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:58:29.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.462+0000 7fa168f7e700 1 --2- 172.21.15.26:0/2858491823 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa164133930 0x7fa164133db0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fa15c009d90 tx=0x7fa15c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=859ea727cf67dc85 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:29.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.462+0000 7fa162ffd700 1 -- 172.21.15.26:0/2858491823 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15c00e070 con 0x7fa164133930 2023-10-01T07:58:29.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.462+0000 7fa162ffd700 1 -- 172.21.15.26:0/2858491823 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa15c00bb20 con 0x7fa164133930 2023-10-01T07:58:29.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.462+0000 7fa162ffd700 1 -- 172.21.15.26:0/2858491823 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15c012430 con 0x7fa164133930 2023-10-01T07:58:29.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.463+0000 7fa16a9e1700 1 -- 172.21.15.26:0/2858491823 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa164133930 msgr2=0x7fa164133db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:29.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.463+0000 7fa16a9e1700 1 --2- 172.21.15.26:0/2858491823 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa164133930 0x7fa164133db0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fa15c009d90 tx=0x7fa15c00b330 comp rx=0 tx=0).stop 2023-10-01T07:58:29.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.463+0000 7fa16a9e1700 1 -- 172.21.15.26:0/2858491823 shutdown_connections 2023-10-01T07:58:29.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.463+0000 7fa16a9e1700 1 --2- 172.21.15.26:0/2858491823 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa164133930 0x7fa164133db0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.463+0000 7fa16a9e1700 1 --2- 172.21.15.26:0/2858491823 >> v2:172.21.15.26:3300/0 conn(0x7fa1640a0a30 0x7fa1640a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.463+0000 7fa16a9e1700 1 --2- 172.21.15.26:0/2858491823 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa16409d630 0x7fa1640a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.463+0000 7fa16a9e1700 1 -- 172.21.15.26:0/2858491823 >> 172.21.15.26:0/2858491823 conn(0x7fa1640a3050 msgr2=0x7fa1640a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:29.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.463+0000 7fa16a9e1700 1 -- 172.21.15.26:0/2858491823 shutdown_connections 2023-10-01T07:58:29.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.463+0000 7fa16a9e1700 1 -- 172.21.15.26:0/2858491823 wait complete. 2023-10-01T07:58:29.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.465+0000 7fa16a9e1700 1 Processor -- start 2023-10-01T07:58:29.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.465+0000 7fa16a9e1700 1 -- start start 2023-10-01T07:58:29.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.465+0000 7fa16a9e1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa16409d630 0x7fa1641c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:29.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.465+0000 7fa16a9e1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1640a0a30 0x7fa1641c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:29.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.465+0000 7fa16a9e1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa164133930 0x7fa1641c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:29.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.465+0000 7fa16a9e1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa164120630 con 0x7fa1640a0a30 2023-10-01T07:58:29.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.465+0000 7fa16a9e1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1640a4030 con 0x7fa164133930 2023-10-01T07:58:29.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.465+0000 7fa16a9e1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1640a0410 con 0x7fa16409d630 2023-10-01T07:58:29.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.466+0000 7fa168f7e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa164133930 0x7fa1641c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:29.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.466+0000 7fa163fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa16409d630 0x7fa1641c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:29.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.466+0000 7fa168f7e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa164133930 0x7fa1641c8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34302/0 (socket says 172.21.15.26:34302) 2023-10-01T07:58:29.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.466+0000 7fa168f7e700 1 -- 172.21.15.26:0/3956779491 learned_addr learned my addr 172.21.15.26:0/3956779491 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:29.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.466+0000 7fa1637fe700 1 --2- 172.21.15.26:0/3956779491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1640a0a30 0x7fa1641c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:29.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.466+0000 7fa168f7e700 1 -- 172.21.15.26:0/3956779491 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa16409d630 msgr2=0x7fa1641c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:29.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.466+0000 7fa168f7e700 1 --2- 172.21.15.26:0/3956779491 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa16409d630 0x7fa1641c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.466+0000 7fa168f7e700 1 -- 172.21.15.26:0/3956779491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1640a0a30 msgr2=0x7fa1641c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:29.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.466+0000 7fa168f7e700 1 --2- 172.21.15.26:0/3956779491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1640a0a30 0x7fa1641c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.466+0000 7fa168f7e700 1 -- 172.21.15.26:0/3956779491 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa15c009a70 con 0x7fa164133930 2023-10-01T07:58:29.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.466+0000 7fa163fff700 1 --2- 172.21.15.26:0/3956779491 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa16409d630 0x7fa1641c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:29.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.466+0000 7fa168f7e700 1 --2- 172.21.15.26:0/3956779491 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa164133930 0x7fa1641c8900 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fa15c014040 tx=0x7fa15c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:29.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.466+0000 7fa160ff9700 1 -- 172.21.15.26:0/3956779491 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15c012430 con 0x7fa164133930 2023-10-01T07:58:29.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.466+0000 7fa160ff9700 1 -- 172.21.15.26:0/3956779491 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa15c020070 con 0x7fa164133930 2023-10-01T07:58:29.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.466+0000 7fa160ff9700 1 -- 172.21.15.26:0/3956779491 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15c003ea0 con 0x7fa164133930 2023-10-01T07:58:29.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.466+0000 7fa16a9e1700 1 -- 172.21.15.26:0/3956779491 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1641220e0 con 0x7fa164133930 2023-10-01T07:58:29.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.466+0000 7fa16a9e1700 1 -- 172.21.15.26:0/3956779491 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa164133350 con 0x7fa164133930 2023-10-01T07:58:29.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.467+0000 7fa160ff9700 1 -- 172.21.15.26:0/3956779491 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa15c004280 con 0x7fa164133930 2023-10-01T07:58:29.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.468+0000 7fa160ff9700 1 -- 172.21.15.26:0/3956779491 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa15c022070 con 0x7fa164133930 2023-10-01T07:58:29.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.468+0000 7fa16a9e1700 1 -- 172.21.15.26:0/3956779491 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa164121d80 con 0x7fa164133930 2023-10-01T07:58:29.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.473+0000 7fa160ff9700 1 -- 172.21.15.26:0/3956779491 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa164121d80 con 0x7fa164133930 2023-10-01T07:58:29.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.592+0000 7f8e1fc2b700 1 -- 172.21.15.26:0/1745733684 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8e18074ea0 con 0x7f8e1806b080 2023-10-01T07:58:29.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.593+0000 7f8e0e7fc700 1 -- 172.21.15.26:0/1745733684 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8e08021030 con 0x7f8e1806b080 2023-10-01T07:58:29.594 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:29.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.596+0000 7f8e1fc2b700 1 -- 172.21.15.26:0/1745733684 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e1806b080 msgr2=0x7f8e181c8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:29.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.596+0000 7f8e1fc2b700 1 --2- 172.21.15.26:0/1745733684 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e1806b080 0x7f8e181c8630 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8e0800ebe0 tx=0x7f8e0800eef0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.596+0000 7f8e1fc2b700 1 -- 172.21.15.26:0/1745733684 shutdown_connections 2023-10-01T07:58:29.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.596+0000 7f8e1fc2b700 1 --2- 172.21.15.26:0/1745733684 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e18131b40 0x7f8e181c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.596+0000 7f8e1fc2b700 1 --2- 172.21.15.26:0/1745733684 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e1806a770 0x7f8e181c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.597+0000 7f8e1fc2b700 1 --2- 172.21.15.26:0/1745733684 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e1806b080 0x7f8e181c8630 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.597+0000 7f8e1fc2b700 1 -- 172.21.15.26:0/1745733684 >> 172.21.15.26:0/1745733684 conn(0x7f8e18066f50 msgr2=0x7f8e18070060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:29.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.597+0000 7f8e1fc2b700 1 -- 172.21.15.26:0/1745733684 shutdown_connections 2023-10-01T07:58:29.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.597+0000 7f8e1fc2b700 1 -- 172.21.15.26:0/1745733684 wait complete. 2023-10-01T07:58:29.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.608+0000 7f5c9e334700 1 -- 172.21.15.26:0/3728752879 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5c98074ea0 con 0x7f5c9809e440 2023-10-01T07:58:29.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.608+0000 7f5c94ff9700 1 -- 172.21.15.26:0/3728752879 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5c90024ba0 con 0x7f5c9809e440 2023-10-01T07:58:29.609 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:29.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.611+0000 7f5c9e334700 1 -- 172.21.15.26:0/3728752879 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c9809e440 msgr2=0x7f5c981a6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:29.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.611+0000 7f5c9e334700 1 --2- 172.21.15.26:0/3728752879 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c9809e440 0x7f5c981a6950 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5c90009e50 tx=0x7f5c90004ad0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.611+0000 7f5c9e334700 1 -- 172.21.15.26:0/3728752879 shutdown_connections 2023-10-01T07:58:29.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.611+0000 7f5c9e334700 1 --2- 172.21.15.26:0/3728752879 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5c9809e440 0x7f5c981a6950 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.611+0000 7f5c9e334700 1 --2- 172.21.15.26:0/3728752879 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5c9809d6f0 0x7f5c981a5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.611+0000 7f5c9e334700 1 --2- 172.21.15.26:0/3728752879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c9809e000 0x7f5c981a6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.611+0000 7f5c9e334700 1 -- 172.21.15.26:0/3728752879 >> 172.21.15.26:0/3728752879 conn(0x7f5c98066f50 msgr2=0x7f5c981baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:29.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.611+0000 7f5c9e334700 1 -- 172.21.15.26:0/3728752879 shutdown_connections 2023-10-01T07:58:29.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.611+0000 7f5c9e334700 1 -- 172.21.15.26:0/3728752879 wait complete. 2023-10-01T07:58:29.617 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:29.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:29.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.682+0000 7fa16a9e1700 1 -- 172.21.15.26:0/3956779491 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa164121d80 con 0x7fa164133930 2023-10-01T07:58:29.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.682+0000 7fa160ff9700 1 -- 172.21.15.26:0/3956779491 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa164121d80 con 0x7fa164133930 2023-10-01T07:58:29.683 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:29.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.684+0000 7fa16a9e1700 1 -- 172.21.15.26:0/3956779491 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa164133930 msgr2=0x7fa1641c8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:29.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.684+0000 7fa16a9e1700 1 --2- 172.21.15.26:0/3956779491 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa164133930 0x7fa1641c8900 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fa15c014040 tx=0x7fa15c004ad0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.684+0000 7fa16a9e1700 1 -- 172.21.15.26:0/3956779491 shutdown_connections 2023-10-01T07:58:29.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.684+0000 7fa16a9e1700 1 --2- 172.21.15.26:0/3956779491 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa164133930 0x7fa1641c8900 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.684+0000 7fa16a9e1700 1 --2- 172.21.15.26:0/3956779491 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa16409d630 0x7fa1641c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.684+0000 7fa16a9e1700 1 --2- 172.21.15.26:0/3956779491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1640a0a30 0x7fa1641c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.684+0000 7fa16a9e1700 1 -- 172.21.15.26:0/3956779491 >> 172.21.15.26:0/3956779491 conn(0x7fa1640a3050 msgr2=0x7fa16409ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:29.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.685+0000 7fa16a9e1700 1 -- 172.21.15.26:0/3956779491 shutdown_connections 2023-10-01T07:58:29.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.685+0000 7fa16a9e1700 1 -- 172.21.15.26:0/3956779491 wait complete. 2023-10-01T07:58:29.698 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:29.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.725+0000 7f73397d2700 1 -- 172.21.15.26:0/3064382158 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f733411d2e0 con 0x7f733412cf60 2023-10-01T07:58:29.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.726+0000 7f731b7fe700 1 -- 172.21.15.26:0/3064382158 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7324021070 con 0x7f733412cf60 2023-10-01T07:58:29.727 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:29.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.728+0000 7f73397d2700 1 -- 172.21.15.26:0/3064382158 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f733412cf60 msgr2=0x7f73341c3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:29.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.728+0000 7f73397d2700 1 --2- 172.21.15.26:0/3064382158 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f733412cf60 0x7f73341c3020 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f732400e910 tx=0x7f732400ec20 comp rx=0 tx=0).stop 2023-10-01T07:58:29.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.728+0000 7f73397d2700 1 -- 172.21.15.26:0/3064382158 shutdown_connections 2023-10-01T07:58:29.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.728+0000 7f73397d2700 1 --2- 172.21.15.26:0/3064382158 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7334130260 0x7f73341c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.728+0000 7f73397d2700 1 --2- 172.21.15.26:0/3064382158 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f733412cf60 0x7f73341c3020 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.728+0000 7f73397d2700 1 --2- 172.21.15.26:0/3064382158 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f733412f8b0 0x7f73341c3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:29.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.728+0000 7f73397d2700 1 -- 172.21.15.26:0/3064382158 >> 172.21.15.26:0/3064382158 conn(0x7f73340a2aa0 msgr2=0x7f733409e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:29.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.728+0000 7f73397d2700 1 -- 172.21.15.26:0/3064382158 shutdown_connections 2023-10-01T07:58:29.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:29.728+0000 7f73397d2700 1 -- 172.21.15.26:0/3064382158 wait complete. 2023-10-01T07:58:29.742 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:30.618 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:30.627 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:30.699 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:30.743 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:30.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.768+0000 7f4c867b7700 1 Processor -- start 2023-10-01T07:58:30.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.768+0000 7f4c867b7700 1 -- start start 2023-10-01T07:58:30.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.768+0000 7f4c867b7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c8006e570 0x7f4c8006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:30.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.768+0000 7f4c867b7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c8009eca0 0x7f4c8006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:30.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.768+0000 7f4c867b7700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c80070ee0 con 0x7f4c80134610 2023-10-01T07:58:30.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.768+0000 7f4c867b7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c80071480 con 0x7f4c8009eca0 2023-10-01T07:58:30.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.768+0000 7f4c867b7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8006f3c0 con 0x7f4c8006e570 2023-10-01T07:58:30.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.768+0000 7f4c7f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c8009eca0 0x7f4c8006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:30.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.769+0000 7f4c7f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c8009eca0 0x7f4c8006ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34318/0 (socket says 172.21.15.26:34318) 2023-10-01T07:58:30.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.768+0000 7f4c7ffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c8006e570 0x7f4c8006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:30.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.769+0000 7f4c7f7fe700 1 -- 172.21.15.26:0/500601769 learned_addr learned my addr 172.21.15.26:0/500601769 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:30.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.769+0000 7f4c7ffff700 1 -- 172.21.15.26:0/500601769 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c8009eca0 msgr2=0x7f4c8006ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:30.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.769+0000 7f4c7ffff700 1 --2- 172.21.15.26:0/500601769 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c8009eca0 0x7f4c8006ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:30.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.769+0000 7f4c7ffff700 1 -- 172.21.15.26:0/500601769 >> v1:172.21.15.26:6789/0 conn(0x7f4c80134610 legacy=0x7f4c80134ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:30.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.769+0000 7f4c7ffff700 1 -- 172.21.15.26:0/500601769 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c80071b90 con 0x7f4c8006e570 2023-10-01T07:58:30.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.769+0000 7f4c7f7fe700 1 --2- 172.21.15.26:0/500601769 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c8009eca0 0x7f4c8006ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:30.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.769+0000 7f4c7ffff700 1 --2- 172.21.15.26:0/500601769 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c8006e570 0x7f4c8006e940 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f4c70009870 tx=0x7f4c70009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28dd726f21928e4d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:30.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.769+0000 7f4c7effd700 1 -- 172.21.15.26:0/500601769 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c70011830 con 0x7f4c8006e570 2023-10-01T07:58:30.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.770+0000 7f4c7effd700 1 -- 172.21.15.26:0/500601769 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c70011990 con 0x7f4c8006e570 2023-10-01T07:58:30.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.770+0000 7f4c7effd700 1 -- 172.21.15.26:0/500601769 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c70011d20 con 0x7f4c8006e570 2023-10-01T07:58:30.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.770+0000 7f4c867b7700 1 -- 172.21.15.26:0/500601769 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c8006e570 msgr2=0x7f4c8006e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:30.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.770+0000 7f4c867b7700 1 --2- 172.21.15.26:0/500601769 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c8006e570 0x7f4c8006e940 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f4c70009870 tx=0x7f4c70009b80 comp rx=0 tx=0).stop 2023-10-01T07:58:30.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.770+0000 7f4c867b7700 1 -- 172.21.15.26:0/500601769 shutdown_connections 2023-10-01T07:58:30.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.770+0000 7f4c867b7700 1 --2- 172.21.15.26:0/500601769 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c8006e570 0x7f4c8006e940 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:30.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.770+0000 7f4c867b7700 1 --2- 172.21.15.26:0/500601769 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c8009eca0 0x7f4c8006ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:30.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.770+0000 7f4c867b7700 1 -- 172.21.15.26:0/500601769 >> 172.21.15.26:0/500601769 conn(0x7f4c800a2aa0 msgr2=0x7f4c800a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:30.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.770+0000 7f4c867b7700 1 -- 172.21.15.26:0/500601769 shutdown_connections 2023-10-01T07:58:30.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.771+0000 7f4c867b7700 1 -- 172.21.15.26:0/500601769 wait complete. 2023-10-01T07:58:30.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.771+0000 7f4c867b7700 1 Processor -- start 2023-10-01T07:58:30.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.772+0000 7f4c867b7700 1 -- start start 2023-10-01T07:58:30.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.772+0000 7f4c867b7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c8006e570 0x7f4c8013f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:30.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.772+0000 7f4c867b7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c80134610 0x7f4c8013f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:30.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.772+0000 7f4c867b7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c8013fb10 0x7f4c80132e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:30.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.772+0000 7f4c867b7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c800a1d00 con 0x7f4c8013fb10 2023-10-01T07:58:30.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.772+0000 7f4c867b7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c80070610 con 0x7f4c8006e570 2023-10-01T07:58:30.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.772+0000 7f4c867b7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8013e1d0 con 0x7f4c80134610 2023-10-01T07:58:30.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.772+0000 7f4c7ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c8006e570 0x7f4c8013f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:30.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.772+0000 7f4c84d54700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c8013fb10 0x7f4c80132e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:30.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.772+0000 7f4c7ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c8006e570 0x7f4c8013f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34324/0 (socket says 172.21.15.26:34324) 2023-10-01T07:58:30.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.772+0000 7f4c7ffff700 1 -- 172.21.15.26:0/2482922104 learned_addr learned my addr 172.21.15.26:0/2482922104 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:30.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.772+0000 7f4c84d54700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c8013fb10 0x7f4c80132e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50110/0 (socket says 172.21.15.26:50110) 2023-10-01T07:58:30.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.773+0000 7f4c7f7fe700 1 --2- 172.21.15.26:0/2482922104 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c80134610 0x7f4c8013f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:30.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.773+0000 7f4c7f7fe700 1 -- 172.21.15.26:0/2482922104 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c8006e570 msgr2=0x7f4c8013f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:30.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.773+0000 7f4c7f7fe700 1 --2- 172.21.15.26:0/2482922104 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c8006e570 0x7f4c8013f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:30.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.773+0000 7f4c7f7fe700 1 -- 172.21.15.26:0/2482922104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c8013fb10 msgr2=0x7f4c80132e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:30.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.773+0000 7f4c7f7fe700 1 --2- 172.21.15.26:0/2482922104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c8013fb10 0x7f4c80132e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:30.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.773+0000 7f4c7f7fe700 1 -- 172.21.15.26:0/2482922104 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c74009550 con 0x7f4c80134610 2023-10-01T07:58:30.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.773+0000 7f4c84d54700 1 --2- 172.21.15.26:0/2482922104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c8013fb10 0x7f4c80132e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:30.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.773+0000 7f4c7ffff700 1 --2- 172.21.15.26:0/2482922104 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c8006e570 0x7f4c8013f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:30.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.774+0000 7f4c7f7fe700 1 --2- 172.21.15.26:0/2482922104 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c80134610 0x7f4c8013f5d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4c80070e10 tx=0x7f4c7400ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:30.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.774+0000 7f4c7cff9700 1 -- 172.21.15.26:0/2482922104 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c74004030 con 0x7f4c80134610 2023-10-01T07:58:30.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.774+0000 7f4c7cff9700 1 -- 172.21.15.26:0/2482922104 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c74004190 con 0x7f4c80134610 2023-10-01T07:58:30.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.774+0000 7f4c7cff9700 1 -- 172.21.15.26:0/2482922104 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c74004520 con 0x7f4c80134610 2023-10-01T07:58:30.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.774+0000 7f4c867b7700 1 -- 172.21.15.26:0/2482922104 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c700094a0 con 0x7f4c80134610 2023-10-01T07:58:30.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.774+0000 7f4c867b7700 1 -- 172.21.15.26:0/2482922104 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c8013ec40 con 0x7f4c80134610 2023-10-01T07:58:30.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.775+0000 7f4c7cff9700 1 -- 172.21.15.26:0/2482922104 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4c740036a0 con 0x7f4c80134610 2023-10-01T07:58:30.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.775+0000 7f4c7cff9700 1 -- 172.21.15.26:0/2482922104 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4c7403f500 con 0x7f4c80134610 2023-10-01T07:58:30.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.775+0000 7f4c867b7700 1 -- 172.21.15.26:0/2482922104 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c8013de70 con 0x7f4c80134610 2023-10-01T07:58:30.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.785+0000 7f4c7cff9700 1 -- 172.21.15.26:0/2482922104 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4c74019d40 con 0x7f4c80134610 2023-10-01T07:58:30.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.808+0000 7f7797eb2700 1 Processor -- start 2023-10-01T07:58:30.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.809+0000 7f7797eb2700 1 -- start start 2023-10-01T07:58:30.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.809+0000 7f7797eb2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779009d6f0 0x7f779009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:30.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.809+0000 7f7797eb2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779009e410 0x7f7790130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:30.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.809+0000 7f7797eb2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f779009f130 con 0x7f779009e000 2023-10-01T07:58:30.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.809+0000 7f7797eb2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f779009f520 con 0x7f779009d6f0 2023-10-01T07:58:30.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.809+0000 7f7797eb2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f779009e930 con 0x7f779009e410 2023-10-01T07:58:30.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.810+0000 7f7795c4e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779009d6f0 0x7f779009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:30.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.810+0000 7f7795c4e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779009d6f0 0x7f779009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34332/0 (socket says 172.21.15.26:34332) 2023-10-01T07:58:30.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.810+0000 7f7795c4e700 1 -- 172.21.15.26:0/2841670857 learned_addr learned my addr 172.21.15.26:0/2841670857 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:30.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.810+0000 7f779544d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f779009e000 0x7f7790130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60316/0 (socket says 172.21.15.26:60316) 2023-10-01T07:58:30.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.810+0000 7f779644f700 1 --2- 172.21.15.26:0/2841670857 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779009e410 0x7f7790130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:30.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.810+0000 7f7795c4e700 1 -- 172.21.15.26:0/2841670857 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779009e410 msgr2=0x7f7790130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:30.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.810+0000 7f7795c4e700 1 --2- 172.21.15.26:0/2841670857 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779009e410 0x7f7790130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:30.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.810+0000 7f7795c4e700 1 -- 172.21.15.26:0/2841670857 >> v1:172.21.15.26:6789/0 conn(0x7f779009e000 legacy=0x7f7790130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:30.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.810+0000 7f7795c4e700 1 -- 172.21.15.26:0/2841670857 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779009b2d0 con 0x7f779009d6f0 2023-10-01T07:58:30.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.810+0000 7f779644f700 1 --2- 172.21.15.26:0/2841670857 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779009e410 0x7f7790130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:30.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.810+0000 7f7795c4e700 1 --2- 172.21.15.26:0/2841670857 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779009d6f0 0x7f779009dac0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f778c009920 tx=0x7f778c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d894ef46d19a8c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:30.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.811+0000 7f7794c4c700 1 -- 172.21.15.26:0/2841670857 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778c011830 con 0x7f779009d6f0 2023-10-01T07:58:30.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.811+0000 7f7794c4c700 1 -- 172.21.15.26:0/2841670857 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778c011990 con 0x7f779009d6f0 2023-10-01T07:58:30.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.811+0000 7f7794c4c700 1 -- 172.21.15.26:0/2841670857 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778c011d20 con 0x7f779009d6f0 2023-10-01T07:58:30.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.811+0000 7f7797eb2700 1 -- 172.21.15.26:0/2841670857 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779009d6f0 msgr2=0x7f779009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:30.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.811+0000 7f7797eb2700 1 --2- 172.21.15.26:0/2841670857 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779009d6f0 0x7f779009dac0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f778c009920 tx=0x7f778c009c30 comp rx=0 tx=0).stop 2023-10-01T07:58:30.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.811+0000 7f7797eb2700 1 -- 172.21.15.26:0/2841670857 shutdown_connections 2023-10-01T07:58:30.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.811+0000 7f7797eb2700 1 --2- 172.21.15.26:0/2841670857 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779009e410 0x7f7790130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:30.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.811+0000 7f7797eb2700 1 --2- 172.21.15.26:0/2841670857 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779009d6f0 0x7f779009dac0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:30.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.811+0000 7f7797eb2700 1 -- 172.21.15.26:0/2841670857 >> 172.21.15.26:0/2841670857 conn(0x7f7790066f50 msgr2=0x7f779009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:30.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.811+0000 7f7797eb2700 1 -- 172.21.15.26:0/2841670857 shutdown_connections 2023-10-01T07:58:30.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.811+0000 7f7797eb2700 1 -- 172.21.15.26:0/2841670857 wait complete. 2023-10-01T07:58:30.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.812+0000 7f7797eb2700 1 Processor -- start 2023-10-01T07:58:30.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.813+0000 7f7797eb2700 1 -- start start 2023-10-01T07:58:30.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.813+0000 7f7797eb2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779009d6f0 0x7f779012ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:30.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.813+0000 7f7797eb2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779009e000 0x7f779012efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:30.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.813+0000 7f7797eb2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f779009e410 0x7f779012f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:30.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.813+0000 7f7797eb2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779013b5b0 con 0x7f779009e410 2023-10-01T07:58:30.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.813+0000 7f7797eb2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7790131110 con 0x7f779009e000 2023-10-01T07:58:30.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.813+0000 7f7797eb2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77901307d0 con 0x7f779009d6f0 2023-10-01T07:58:30.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.813+0000 7f779644f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f779009e410 0x7f779012f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.813+0000 7f7795c4e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779009d6f0 0x7f779012ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.813+0000 7f779644f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f779009e410 0x7f779012f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50116/0 (socket says 172.21.15.26:50116) 2023-10-01T07:58:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.813+0000 7f779644f700 1 -- 172.21.15.26:0/2071270630 learned_addr learned my addr 172.21.15.26:0/2071270630 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.813+0000 7f7795c4e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779009d6f0 0x7f779012ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41522/0 (socket says 172.21.15.26:41522) 2023-10-01T07:58:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.813+0000 7f779544d700 1 --2- 172.21.15.26:0/2071270630 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779009e000 0x7f779012efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.814+0000 7f779644f700 1 -- 172.21.15.26:0/2071270630 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779009d6f0 msgr2=0x7f779012ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.814+0000 7f779644f700 1 --2- 172.21.15.26:0/2071270630 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779009d6f0 0x7f779012ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.814+0000 7f779644f700 1 -- 172.21.15.26:0/2071270630 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779009e000 msgr2=0x7f779012efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.814+0000 7f779644f700 1 --2- 172.21.15.26:0/2071270630 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779009e000 0x7f779012efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.814+0000 7f779644f700 1 -- 172.21.15.26:0/2071270630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7788009a70 con 0x7f779009e410 2023-10-01T07:58:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.814+0000 7f779644f700 1 --2- 172.21.15.26:0/2071270630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f779009e410 0x7f779012f510 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f778800efc0 tx=0x7f778800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.814+0000 7f77867fc700 1 -- 172.21.15.26:0/2071270630 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778800ca30 con 0x7f779009e410 2023-10-01T07:58:30.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.814+0000 7f77867fc700 1 -- 172.21.15.26:0/2071270630 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778800f040 con 0x7f779009e410 2023-10-01T07:58:30.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.814+0000 7f7797eb2700 1 -- 172.21.15.26:0/2071270630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f778c009550 con 0x7f779009e410 2023-10-01T07:58:30.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.814+0000 7f77867fc700 1 -- 172.21.15.26:0/2071270630 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778800cdb0 con 0x7f779009e410 2023-10-01T07:58:30.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.814+0000 7f7797eb2700 1 -- 172.21.15.26:0/2071270630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7790131780 con 0x7f779009e410 2023-10-01T07:58:30.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.815+0000 7f77867fc700 1 -- 172.21.15.26:0/2071270630 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7788014480 con 0x7f779009e410 2023-10-01T07:58:30.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.815+0000 7f77867fc700 1 -- 172.21.15.26:0/2071270630 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f778803fd30 con 0x7f779009e410 2023-10-01T07:58:30.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.815+0000 7f7797eb2700 1 -- 172.21.15.26:0/2071270630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7790131250 con 0x7f779009e410 2023-10-01T07:58:30.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.821+0000 7f77867fc700 1 -- 172.21.15.26:0/2071270630 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7788012930 con 0x7f779009e410 2023-10-01T07:58:30.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.856+0000 7fe79f28f700 1 Processor -- start 2023-10-01T07:58:30.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.856+0000 7fe79f28f700 1 -- start start 2023-10-01T07:58:30.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.857+0000 7fe79f28f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe79809e930 0x7fe79809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:30.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.857+0000 7fe79f28f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe79809f240 0x7fe7981317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:30.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.857+0000 7fe79f28f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe798070940 con 0x7fe79809f650 2023-10-01T07:58:30.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.857+0000 7fe79f28f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe79806fd60 con 0x7fe79809e930 2023-10-01T07:58:30.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.857+0000 7fe79f28f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe79806fa80 con 0x7fe79809f240 2023-10-01T07:58:30.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.857+0000 7fe79d02b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe79809e930 0x7fe79809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:30.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.857+0000 7fe79d82c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe79809f650 0x7fe798131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60328/0 (socket says 172.21.15.26:60328) 2023-10-01T07:58:30.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.857+0000 7fe79d82c700 1 -- 172.21.15.26:0/3990066546 learned_addr learned my addr 172.21.15.26:0/3990066546 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:30.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.857+0000 7fe79c82a700 1 --2- 172.21.15.26:0/3990066546 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe79809f240 0x7fe7981317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:30.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.857+0000 7fe79d02b700 1 -- 172.21.15.26:0/3990066546 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe79809f240 msgr2=0x7fe7981317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:30.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.857+0000 7fe79d02b700 1 --2- 172.21.15.26:0/3990066546 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe79809f240 0x7fe7981317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:30.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.857+0000 7fe79d02b700 1 -- 172.21.15.26:0/3990066546 >> v1:172.21.15.26:6789/0 conn(0x7fe79809f650 legacy=0x7fe798131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:30.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.857+0000 7fe78ffff700 1 -- 172.21.15.26:0/3990066546 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 544745773 0 0) 0x7fe798070940 con 0x7fe79809f650 2023-10-01T07:58:30.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.857+0000 7fe79d02b700 1 -- 172.21.15.26:0/3990066546 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79809fb60 con 0x7fe79809e930 2023-10-01T07:58:30.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.858+0000 7fe79d02b700 1 --2- 172.21.15.26:0/3990066546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe79809e930 0x7fe79809ed00 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fe794009840 tx=0x7fe794009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56fa4ebbbaa65629 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:30.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.858+0000 7fe78ffff700 1 -- 172.21.15.26:0/3990066546 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe794011830 con 0x7fe79809e930 2023-10-01T07:58:30.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.858+0000 7fe78ffff700 1 -- 172.21.15.26:0/3990066546 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe794011990 con 0x7fe79809e930 2023-10-01T07:58:30.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.858+0000 7fe78ffff700 1 -- 172.21.15.26:0/3990066546 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe794011d20 con 0x7fe79809e930 2023-10-01T07:58:30.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.858+0000 7fe79f28f700 1 -- 172.21.15.26:0/3990066546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe79809e930 msgr2=0x7fe79809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:30.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.858+0000 7fe79f28f700 1 --2- 172.21.15.26:0/3990066546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe79809e930 0x7fe79809ed00 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fe794009840 tx=0x7fe794009b50 comp rx=0 tx=0).stop 2023-10-01T07:58:30.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.859+0000 7fe79f28f700 1 -- 172.21.15.26:0/3990066546 shutdown_connections 2023-10-01T07:58:30.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.859+0000 7fe79f28f700 1 --2- 172.21.15.26:0/3990066546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe79809e930 0x7fe79809ed00 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:30.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.859+0000 7fe79f28f700 1 --2- 172.21.15.26:0/3990066546 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe79809f240 0x7fe7981317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:30.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.859+0000 7fe79f28f700 1 -- 172.21.15.26:0/3990066546 >> 172.21.15.26:0/3990066546 conn(0x7fe7980a4210 msgr2=0x7fe7980a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:30.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.859+0000 7fe79f28f700 1 -- 172.21.15.26:0/3990066546 shutdown_connections 2023-10-01T07:58:30.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.859+0000 7fe79f28f700 1 -- 172.21.15.26:0/3990066546 wait complete. 2023-10-01T07:58:30.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.860+0000 7fe79f28f700 1 Processor -- start 2023-10-01T07:58:30.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.860+0000 7fe79f28f700 1 -- start start 2023-10-01T07:58:30.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.860+0000 7fe79f28f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe79809e930 0x7fe7981a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:30.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.860+0000 7fe79f28f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe79809f240 0x7fe7981a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:30.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.860+0000 7fe79f28f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe79809f650 0x7fe7981c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:30.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.860+0000 7fe79f28f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7981a7ea0 con 0x7fe79809f240 2023-10-01T07:58:30.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.860+0000 7fe79f28f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7981b9220 con 0x7fe79809e930 2023-10-01T07:58:30.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.860+0000 7fe79f28f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7981a4d50 con 0x7fe79809f650 2023-10-01T07:58:30.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.860+0000 7fe79c82a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe79809f240 0x7fe7981a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:30.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.861+0000 7fe79c82a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe79809f240 0x7fe7981a5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50130/0 (socket says 172.21.15.26:50130) 2023-10-01T07:58:30.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.861+0000 7fe79c82a700 1 -- 172.21.15.26:0/3824058738 learned_addr learned my addr 172.21.15.26:0/3824058738 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:30.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.861+0000 7fe79d82c700 1 --2- 172.21.15.26:0/3824058738 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe79809f650 0x7fe7981c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:30.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.861+0000 7fe79c82a700 1 -- 172.21.15.26:0/3824058738 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe79809f650 msgr2=0x7fe7981c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:30.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.861+0000 7fe79c82a700 1 --2- 172.21.15.26:0/3824058738 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe79809f650 0x7fe7981c80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:30.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.861+0000 7fe79d02b700 1 --2- 172.21.15.26:0/3824058738 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe79809e930 0x7fe7981a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:30.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.861+0000 7fe79c82a700 1 -- 172.21.15.26:0/3824058738 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe79809e930 msgr2=0x7fe7981a51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:30.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.861+0000 7fe79c82a700 1 --2- 172.21.15.26:0/3824058738 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe79809e930 0x7fe7981a51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:30.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.861+0000 7fe79c82a700 1 -- 172.21.15.26:0/3824058738 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7940094a0 con 0x7fe79809f240 2023-10-01T07:58:30.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.861+0000 7fe79d82c700 1 --2- 172.21.15.26:0/3824058738 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe79809f650 0x7fe7981c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:30.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.861+0000 7fe79d02b700 1 --2- 172.21.15.26:0/3824058738 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe79809e930 0x7fe7981a51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:58:30.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.861+0000 7fe79c82a700 1 --2- 172.21.15.26:0/3824058738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe79809f240 0x7fe7981a5730 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fe78800e9e0 tx=0x7fe78800ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:30.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.861+0000 7fe78dffb700 1 -- 172.21.15.26:0/3824058738 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe788009710 con 0x7fe79809f240 2023-10-01T07:58:30.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.861+0000 7fe78dffb700 1 -- 172.21.15.26:0/3824058738 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78800c7f0 con 0x7fe79809f240 2023-10-01T07:58:30.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.861+0000 7fe79f28f700 1 -- 172.21.15.26:0/3824058738 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7980a0190 con 0x7fe79809f240 2023-10-01T07:58:30.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.861+0000 7fe78dffb700 1 -- 172.21.15.26:0/3824058738 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78800cb60 con 0x7fe79809f240 2023-10-01T07:58:30.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.862+0000 7fe79f28f700 1 -- 172.21.15.26:0/3824058738 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7981a64f0 con 0x7fe79809f240 2023-10-01T07:58:30.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.862+0000 7fe78dffb700 1 -- 172.21.15.26:0/3824058738 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe78800ccc0 con 0x7fe79809f240 2023-10-01T07:58:30.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.863+0000 7fe78dffb700 1 -- 172.21.15.26:0/3824058738 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe78803fc40 con 0x7fe79809f240 2023-10-01T07:58:30.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.863+0000 7fe79f28f700 1 -- 172.21.15.26:0/3824058738 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe798074ea0 con 0x7fe79809f240 2023-10-01T07:58:30.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.872+0000 7fe78dffb700 1 -- 172.21.15.26:0/3824058738 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe788021080 con 0x7fe79809f240 2023-10-01T07:58:30.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.923+0000 7f62951ee700 1 Processor -- start 2023-10-01T07:58:30.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.923+0000 7f62951ee700 1 -- start start 2023-10-01T07:58:30.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.924+0000 7f62951ee700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f629006c0e0 0x7f629009ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:30.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.924+0000 7f62951ee700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6290134ec0 0x7f62901379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:30.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.924+0000 7f62951ee700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6290137f20 0x7f62901383c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:30.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.924+0000 7f62951ee700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f629006c4b0 con 0x7f6290134ec0 2023-10-01T07:58:30.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.924+0000 7f62951ee700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62900a09c0 con 0x7f629006c0e0 2023-10-01T07:58:30.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.924+0000 7f62951ee700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6290134980 con 0x7f6290137f20 2023-10-01T07:58:30.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.924+0000 7f628e59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6290134ec0 0x7f62901379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:30.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.924+0000 7f628e59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6290134ec0 0x7f62901379e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50136/0 (socket says 172.21.15.26:50136) 2023-10-01T07:58:30.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.924+0000 7f628ed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f629006c0e0 0x7f629009ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:30.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.924+0000 7f628e59c700 1 -- 172.21.15.26:0/3706762095 learned_addr learned my addr 172.21.15.26:0/3706762095 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:30.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.924+0000 7f628f59e700 1 --2- 172.21.15.26:0/3706762095 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6290137f20 0x7f62901383c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:30.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.925+0000 7f628f59e700 1 -- 172.21.15.26:0/3706762095 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f629006c0e0 msgr2=0x7f629009ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:30.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.925+0000 7f628f59e700 1 --2- 172.21.15.26:0/3706762095 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f629006c0e0 0x7f629009ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:30.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.925+0000 7f628f59e700 1 -- 172.21.15.26:0/3706762095 >> v2:172.21.15.26:3300/0 conn(0x7f6290134ec0 msgr2=0x7f62901379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:30.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.925+0000 7f628f59e700 1 --2- 172.21.15.26:0/3706762095 >> v2:172.21.15.26:3300/0 conn(0x7f6290134ec0 0x7f62901379e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:30.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.925+0000 7f628f59e700 1 -- 172.21.15.26:0/3706762095 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62900a0600 con 0x7f6290137f20 2023-10-01T07:58:30.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.925+0000 7f628ed9d700 1 --2- 172.21.15.26:0/3706762095 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f629006c0e0 0x7f629009ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:30.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.925+0000 7f628f59e700 1 --2- 172.21.15.26:0/3706762095 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6290137f20 0x7f62901383c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6288009d90 tx=0x7f628800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9d9d5f731784bdf server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:30.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.925+0000 7f628dd9b700 1 -- 172.21.15.26:0/3706762095 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628800e070 con 0x7f6290137f20 2023-10-01T07:58:30.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.925+0000 7f628dd9b700 1 -- 172.21.15.26:0/3706762095 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628800bb20 con 0x7f6290137f20 2023-10-01T07:58:30.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.925+0000 7f628dd9b700 1 -- 172.21.15.26:0/3706762095 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6288012430 con 0x7f6290137f20 2023-10-01T07:58:30.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.926+0000 7f62951ee700 1 -- 172.21.15.26:0/3706762095 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6290137f20 msgr2=0x7f62901383c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:30.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.926+0000 7f62951ee700 1 --2- 172.21.15.26:0/3706762095 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6290137f20 0x7f62901383c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6288009d90 tx=0x7f628800b330 comp rx=0 tx=0).stop 2023-10-01T07:58:30.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.926+0000 7f62951ee700 1 -- 172.21.15.26:0/3706762095 shutdown_connections 2023-10-01T07:58:30.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.926+0000 7f62951ee700 1 --2- 172.21.15.26:0/3706762095 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6290137f20 0x7f62901383c0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:30.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.926+0000 7f62951ee700 1 --2- 172.21.15.26:0/3706762095 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f629006c0e0 0x7f629009ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:30.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.926+0000 7f62951ee700 1 --2- 172.21.15.26:0/3706762095 >> v2:172.21.15.26:3300/0 conn(0x7f6290134ec0 0x7f62901379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:30.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.926+0000 7f62951ee700 1 -- 172.21.15.26:0/3706762095 >> 172.21.15.26:0/3706762095 conn(0x7f62900a4210 msgr2=0x7f62900a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:30.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.926+0000 7f62951ee700 1 -- 172.21.15.26:0/3706762095 shutdown_connections 2023-10-01T07:58:30.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.926+0000 7f62951ee700 1 -- 172.21.15.26:0/3706762095 wait complete. 2023-10-01T07:58:30.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.928+0000 7f62951ee700 1 Processor -- start 2023-10-01T07:58:30.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.928+0000 7f62951ee700 1 -- start start 2023-10-01T07:58:30.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.928+0000 7f62951ee700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f629006c0e0 0x7f6290133e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:30.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.928+0000 7f62951ee700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6290134ec0 0x7f629011a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:30.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.928+0000 7f62951ee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6290137f20 0x7f629011abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:30.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.928+0000 7f62951ee700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629011c380 con 0x7f6290137f20 2023-10-01T07:58:30.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.928+0000 7f62951ee700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6290134350 con 0x7f629006c0e0 2023-10-01T07:58:30.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.928+0000 7f62951ee700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62900a1550 con 0x7f6290134ec0 2023-10-01T07:58:30.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.929+0000 7f628f59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6290137f20 0x7f629011abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:30.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.929+0000 7f628f59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6290137f20 0x7f629011abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50140/0 (socket says 172.21.15.26:50140) 2023-10-01T07:58:30.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.929+0000 7f628f59e700 1 -- 172.21.15.26:0/1677512909 learned_addr learned my addr 172.21.15.26:0/1677512909 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:30.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.929+0000 7f628e59c700 1 --2- 172.21.15.26:0/1677512909 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6290134ec0 0x7f629011a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:30.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.929+0000 7f628ed9d700 1 --2- 172.21.15.26:0/1677512909 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f629006c0e0 0x7f6290133e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:30.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.929+0000 7f628f59e700 1 -- 172.21.15.26:0/1677512909 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6290134ec0 msgr2=0x7f629011a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:30.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.929+0000 7f628f59e700 1 --2- 172.21.15.26:0/1677512909 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6290134ec0 0x7f629011a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:30.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.929+0000 7f628f59e700 1 -- 172.21.15.26:0/1677512909 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f629006c0e0 msgr2=0x7f6290133e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:30.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.929+0000 7f628f59e700 1 --2- 172.21.15.26:0/1677512909 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f629006c0e0 0x7f6290133e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:30.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.929+0000 7f628f59e700 1 -- 172.21.15.26:0/1677512909 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62800094a0 con 0x7f6290137f20 2023-10-01T07:58:30.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.929+0000 7f628f59e700 1 --2- 172.21.15.26:0/1677512909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6290137f20 0x7f629011abc0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f628800b370 tx=0x7f6288004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:30.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.930+0000 7f62777fe700 1 -- 172.21.15.26:0/1677512909 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6288012430 con 0x7f6290137f20 2023-10-01T07:58:30.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.930+0000 7f62777fe700 1 -- 172.21.15.26:0/1677512909 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6288020070 con 0x7f6290137f20 2023-10-01T07:58:30.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.930+0000 7f62951ee700 1 -- 172.21.15.26:0/1677512909 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6288009a70 con 0x7f6290137f20 2023-10-01T07:58:30.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.930+0000 7f62777fe700 1 -- 172.21.15.26:0/1677512909 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6288004280 con 0x7f6290137f20 2023-10-01T07:58:30.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.930+0000 7f62777fe700 1 -- 172.21.15.26:0/1677512909 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f62880043e0 con 0x7f6290137f20 2023-10-01T07:58:30.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.931+0000 7f62951ee700 1 -- 172.21.15.26:0/1677512909 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f629011ca60 con 0x7f6290137f20 2023-10-01T07:58:30.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.931+0000 7f62777fe700 1 -- 172.21.15.26:0/1677512909 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6288022070 con 0x7f6290137f20 2023-10-01T07:58:30.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.932+0000 7f62951ee700 1 -- 172.21.15.26:0/1677512909 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6290074ea0 con 0x7f6290137f20 2023-10-01T07:58:30.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:30.937+0000 7f62777fe700 1 -- 172.21.15.26:0/1677512909 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6288003e10 con 0x7f6290137f20 2023-10-01T07:58:31.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.033+0000 7f4c867b7700 1 -- 172.21.15.26:0/2482922104 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4c80135140 con 0x7f4c80134610 2023-10-01T07:58:31.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.033+0000 7f7797eb2700 1 -- 172.21.15.26:0/2071270630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7790074ea0 con 0x7f779009e410 2023-10-01T07:58:31.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.034+0000 7f4c7cff9700 1 -- 172.21.15.26:0/2482922104 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4c74019300 con 0x7f4c80134610 2023-10-01T07:58:31.035 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:31.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.034+0000 7f77867fc700 1 -- 172.21.15.26:0/2071270630 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f778802a090 con 0x7f779009e410 2023-10-01T07:58:31.035 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:31.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.037+0000 7f4c867b7700 1 -- 172.21.15.26:0/2482922104 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c80134610 msgr2=0x7f4c8013f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:31.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.037+0000 7f4c867b7700 1 --2- 172.21.15.26:0/2482922104 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c80134610 0x7f4c8013f5d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4c80070e10 tx=0x7f4c7400ec80 comp rx=0 tx=0).stop 2023-10-01T07:58:31.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.037+0000 7f4c867b7700 1 -- 172.21.15.26:0/2482922104 shutdown_connections 2023-10-01T07:58:31.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.037+0000 7f7797eb2700 1 -- 172.21.15.26:0/2071270630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f779009e410 msgr2=0x7f779012f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:31.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.037+0000 7f4c867b7700 1 --2- 172.21.15.26:0/2482922104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c8013fb10 0x7f4c80132e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:31.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.037+0000 7f4c867b7700 1 --2- 172.21.15.26:0/2482922104 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c8006e570 0x7f4c8013f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:31.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.037+0000 7f4c867b7700 1 --2- 172.21.15.26:0/2482922104 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c80134610 0x7f4c8013f5d0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:31.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.037+0000 7f4c867b7700 1 -- 172.21.15.26:0/2482922104 >> 172.21.15.26:0/2482922104 conn(0x7f4c800a2aa0 msgr2=0x7f4c80136860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:31.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.037+0000 7f7797eb2700 1 --2- 172.21.15.26:0/2071270630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f779009e410 0x7f779012f510 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f778800efc0 tx=0x7f778800c3a0 comp rx=0 tx=0).stop 2023-10-01T07:58:31.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.037+0000 7f4c867b7700 1 -- 172.21.15.26:0/2482922104 shutdown_connections 2023-10-01T07:58:31.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.037+0000 7f4c867b7700 1 -- 172.21.15.26:0/2482922104 wait complete. 2023-10-01T07:58:31.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.038+0000 7f7797eb2700 1 -- 172.21.15.26:0/2071270630 shutdown_connections 2023-10-01T07:58:31.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.038+0000 7f7797eb2700 1 --2- 172.21.15.26:0/2071270630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f779009e410 0x7f779012f510 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:31.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.038+0000 7f7797eb2700 1 --2- 172.21.15.26:0/2071270630 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779009d6f0 0x7f779012ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:31.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.038+0000 7f7797eb2700 1 --2- 172.21.15.26:0/2071270630 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779009e000 0x7f779012efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:31.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.038+0000 7f7797eb2700 1 -- 172.21.15.26:0/2071270630 >> 172.21.15.26:0/2071270630 conn(0x7f7790066f50 msgr2=0x7f77900a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:31.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.038+0000 7f7797eb2700 1 -- 172.21.15.26:0/2071270630 shutdown_connections 2023-10-01T07:58:31.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.038+0000 7f7797eb2700 1 -- 172.21.15.26:0/2071270630 wait complete. 2023-10-01T07:58:31.060 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:31.060 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:31.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.082+0000 7fe79f28f700 1 -- 172.21.15.26:0/3824058738 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe7981a6a10 con 0x7fe79809f240 2023-10-01T07:58:31.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.082+0000 7fe78dffb700 1 -- 172.21.15.26:0/3824058738 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe788017020 con 0x7fe79809f240 2023-10-01T07:58:31.083 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:31.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.085+0000 7fe79f28f700 1 -- 172.21.15.26:0/3824058738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe79809f240 msgr2=0x7fe7981a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:31.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.085+0000 7fe79f28f700 1 --2- 172.21.15.26:0/3824058738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe79809f240 0x7fe7981a5730 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fe78800e9e0 tx=0x7fe78800ecf0 comp rx=0 tx=0).stop 2023-10-01T07:58:31.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.085+0000 7fe79f28f700 1 -- 172.21.15.26:0/3824058738 shutdown_connections 2023-10-01T07:58:31.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.085+0000 7fe79f28f700 1 --2- 172.21.15.26:0/3824058738 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe79809f650 0x7fe7981c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:31.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.085+0000 7fe79f28f700 1 --2- 172.21.15.26:0/3824058738 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe79809e930 0x7fe7981a51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:31.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.085+0000 7fe79f28f700 1 --2- 172.21.15.26:0/3824058738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe79809f240 0x7fe7981a5730 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:31.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.085+0000 7fe79f28f700 1 -- 172.21.15.26:0/3824058738 >> 172.21.15.26:0/3824058738 conn(0x7fe7980a4210 msgr2=0x7fe79806c320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:31.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.086+0000 7fe79f28f700 1 -- 172.21.15.26:0/3824058738 shutdown_connections 2023-10-01T07:58:31.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.086+0000 7fe79f28f700 1 -- 172.21.15.26:0/3824058738 wait complete. 2023-10-01T07:58:31.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:31.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.147+0000 7f62951ee700 1 -- 172.21.15.26:0/1677512909 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f629011e1e0 con 0x7f6290137f20 2023-10-01T07:58:31.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.147+0000 7f62777fe700 1 -- 172.21.15.26:0/1677512909 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6288011390 con 0x7f6290137f20 2023-10-01T07:58:31.148 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:31.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.149+0000 7f62951ee700 1 -- 172.21.15.26:0/1677512909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6290137f20 msgr2=0x7f629011abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:31.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.149+0000 7f62951ee700 1 --2- 172.21.15.26:0/1677512909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6290137f20 0x7f629011abc0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f628800b370 tx=0x7f6288004ad0 comp rx=0 tx=0).stop 2023-10-01T07:58:31.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.149+0000 7f62951ee700 1 -- 172.21.15.26:0/1677512909 shutdown_connections 2023-10-01T07:58:31.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.149+0000 7f62951ee700 1 --2- 172.21.15.26:0/1677512909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6290137f20 0x7f629011abc0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:31.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.149+0000 7f62951ee700 1 --2- 172.21.15.26:0/1677512909 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f629006c0e0 0x7f6290133e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:31.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.149+0000 7f62951ee700 1 --2- 172.21.15.26:0/1677512909 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6290134ec0 0x7f629011a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:31.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.149+0000 7f62951ee700 1 -- 172.21.15.26:0/1677512909 >> 172.21.15.26:0/1677512909 conn(0x7f62900a4210 msgr2=0x7f6290099c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:31.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.149+0000 7f62951ee700 1 -- 172.21.15.26:0/1677512909 shutdown_connections 2023-10-01T07:58:31.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:31.149+0000 7f62951ee700 1 -- 172.21.15.26:0/1677512909 wait complete. 2023-10-01T07:58:31.163 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:32.061 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:32.062 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:32.102 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:32.164 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:32.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.214+0000 7f9d285aa700 1 Processor -- start 2023-10-01T07:58:32.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.214+0000 7f9d285aa700 1 -- start start 2023-10-01T07:58:32.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.215+0000 7f9d285aa700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d20130540 0x7f9d20130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:32.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.215+0000 7f9d285aa700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9d20130e50 0x7f9d2006f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:32.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.215+0000 7f9d285aa700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d200716a0 con 0x7f9d2006fb20 2023-10-01T07:58:32.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.215+0000 7f9d285aa700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d2009a390 con 0x7f9d20130e50 2023-10-01T07:58:32.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.215+0000 7f9d285aa700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d20071290 con 0x7f9d20130540 2023-10-01T07:58:32.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.215+0000 7f9d26346700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d20130540 0x7f9d20130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:32.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.215+0000 7f9d26b47700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9d2006fb20 0x7f9d20137560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60334/0 (socket says 172.21.15.26:60334) 2023-10-01T07:58:32.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.215+0000 7f9d25b45700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9d20130e50 0x7f9d2006f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:32.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.215+0000 7f9d26b47700 1 -- 172.21.15.26:0/4028789166 learned_addr learned my addr 172.21.15.26:0/4028789166 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:32.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.215+0000 7f9d26346700 1 -- 172.21.15.26:0/4028789166 >> v2:172.21.15.26:3300/0 conn(0x7f9d20130e50 msgr2=0x7f9d2006f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:32.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.215+0000 7f9d26346700 1 --2- 172.21.15.26:0/4028789166 >> v2:172.21.15.26:3300/0 conn(0x7f9d20130e50 0x7f9d2006f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.215+0000 7f9d26346700 1 -- 172.21.15.26:0/4028789166 >> v1:172.21.15.26:6789/0 conn(0x7f9d2006fb20 legacy=0x7f9d20137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:32.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.215+0000 7f9d26346700 1 -- 172.21.15.26:0/4028789166 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d20130340 con 0x7f9d20130540 2023-10-01T07:58:32.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.216+0000 7f9d26346700 1 --2- 172.21.15.26:0/4028789166 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d20130540 0x7f9d20130910 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009870 tx=0x7f9d1c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a15c88d37ec67a58 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:32.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.216+0000 7f9d25344700 1 -- 172.21.15.26:0/4028789166 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c011830 con 0x7f9d20130540 2023-10-01T07:58:32.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.216+0000 7f9d25344700 1 -- 172.21.15.26:0/4028789166 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1c011990 con 0x7f9d20130540 2023-10-01T07:58:32.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.216+0000 7f9d25344700 1 -- 172.21.15.26:0/4028789166 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c011d20 con 0x7f9d20130540 2023-10-01T07:58:32.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.217+0000 7f9d285aa700 1 -- 172.21.15.26:0/4028789166 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d20130540 msgr2=0x7f9d20130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:32.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.217+0000 7f9d285aa700 1 --2- 172.21.15.26:0/4028789166 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d20130540 0x7f9d20130910 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009870 tx=0x7f9d1c009b80 comp rx=0 tx=0).stop 2023-10-01T07:58:32.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.217+0000 7f9d285aa700 1 -- 172.21.15.26:0/4028789166 shutdown_connections 2023-10-01T07:58:32.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.217+0000 7f9d285aa700 1 --2- 172.21.15.26:0/4028789166 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d20130540 0x7f9d20130910 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.217+0000 7f9d285aa700 1 --2- 172.21.15.26:0/4028789166 >> v2:172.21.15.26:3300/0 conn(0x7f9d20130e50 0x7f9d2006f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.217+0000 7f9d285aa700 1 -- 172.21.15.26:0/4028789166 >> 172.21.15.26:0/4028789166 conn(0x7f9d200a2aa0 msgr2=0x7f9d200a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:32.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.217+0000 7f9d285aa700 1 -- 172.21.15.26:0/4028789166 shutdown_connections 2023-10-01T07:58:32.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.217+0000 7f9d285aa700 1 -- 172.21.15.26:0/4028789166 wait complete. 2023-10-01T07:58:32.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.218+0000 7f9d285aa700 1 Processor -- start 2023-10-01T07:58:32.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.218+0000 7f9d285aa700 1 -- start start 2023-10-01T07:58:32.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.218+0000 7f9d285aa700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d2006fb20 0x7f9d2006e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:32.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.218+0000 7f9d285aa700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d20130540 0x7f9d2006ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:32.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.218+0000 7f9d285aa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d20130e50 0x7f9d2006ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:32.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.218+0000 7f9d285aa700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d200a1d50 con 0x7f9d20130e50 2023-10-01T07:58:32.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.218+0000 7f9d285aa700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2011a830 con 0x7f9d20130540 2023-10-01T07:58:32.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.218+0000 7f9d285aa700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2011a030 con 0x7f9d2006fb20 2023-10-01T07:58:32.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.219+0000 7f9d25b45700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d20130540 0x7f9d2006ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:32.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.219+0000 7f9d25b45700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d20130540 0x7f9d2006ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34376/0 (socket says 172.21.15.26:34376) 2023-10-01T07:58:32.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.219+0000 7f9d25b45700 1 -- 172.21.15.26:0/1737030629 learned_addr learned my addr 172.21.15.26:0/1737030629 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:32.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.219+0000 7f9d26b47700 1 --2- 172.21.15.26:0/1737030629 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d20130e50 0x7f9d2006ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:32.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.219+0000 7f9d26b47700 1 -- 172.21.15.26:0/1737030629 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d2006fb20 msgr2=0x7f9d2006e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:32.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.219+0000 7f9d26b47700 1 --2- 172.21.15.26:0/1737030629 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d2006fb20 0x7f9d2006e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.219+0000 7f9d26b47700 1 -- 172.21.15.26:0/1737030629 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d20130540 msgr2=0x7f9d2006ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:32.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.219+0000 7f9d26b47700 1 --2- 172.21.15.26:0/1737030629 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d20130540 0x7f9d2006ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.219+0000 7f9d26b47700 1 -- 172.21.15.26:0/1737030629 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1c0094a0 con 0x7f9d20130e50 2023-10-01T07:58:32.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.219+0000 7f9d25b45700 1 --2- 172.21.15.26:0/1737030629 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d20130540 0x7f9d2006ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:32.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.219+0000 7f9d26b47700 1 --2- 172.21.15.26:0/1737030629 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d20130e50 0x7f9d2006ef50 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f9d1800cad0 tx=0x7f9d1800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:32.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.219+0000 7f9d16ffd700 1 -- 172.21.15.26:0/1737030629 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1800a9c0 con 0x7f9d20130e50 2023-10-01T07:58:32.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.219+0000 7f9d16ffd700 1 -- 172.21.15.26:0/1737030629 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1800ab20 con 0x7f9d20130e50 2023-10-01T07:58:32.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.219+0000 7f9d16ffd700 1 -- 172.21.15.26:0/1737030629 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1800ae90 con 0x7f9d20130e50 2023-10-01T07:58:32.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.220+0000 7f9d285aa700 1 -- 172.21.15.26:0/1737030629 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d2011a3e0 con 0x7f9d20130e50 2023-10-01T07:58:32.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.220+0000 7f9d285aa700 1 -- 172.21.15.26:0/1737030629 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d2009e2f0 con 0x7f9d20130e50 2023-10-01T07:58:32.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.221+0000 7f9d16ffd700 1 -- 172.21.15.26:0/1737030629 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d1801b3b0 con 0x7f9d20130e50 2023-10-01T07:58:32.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.221+0000 7f9d16ffd700 1 -- 172.21.15.26:0/1737030629 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9d1803f1e0 con 0x7f9d20130e50 2023-10-01T07:58:32.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.221+0000 7f9d285aa700 1 -- 172.21.15.26:0/1737030629 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d200718a0 con 0x7f9d20130e50 2023-10-01T07:58:32.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.228+0000 7fd8b0f62700 1 Processor -- start 2023-10-01T07:58:32.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.228+0000 7fd8b0f62700 1 -- start start 2023-10-01T07:58:32.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.229+0000 7fd8b0f62700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd8ac09d6f0 0x7fd8ac09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:32.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.229+0000 7fd8b0f62700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd8ac09e000 0x7fd8ac130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:32.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.229+0000 7fd8b0f62700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8ac09f130 con 0x7fd8ac09e410 2023-10-01T07:58:32.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.229+0000 7fd8b0f62700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac09f520 con 0x7fd8ac09d6f0 2023-10-01T07:58:32.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.229+0000 7fd8b0f62700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac09e930 con 0x7fd8ac09e000 2023-10-01T07:58:32.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.229+0000 7fd8aad9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd8ac09e410 0x7fd8ac130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60346/0 (socket says 172.21.15.26:60346) 2023-10-01T07:58:32.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.229+0000 7fd8aad9d700 1 -- 172.21.15.26:0/1599812322 learned_addr learned my addr 172.21.15.26:0/1599812322 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:32.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.229+0000 7fd8aa59c700 1 --2- 172.21.15.26:0/1599812322 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd8ac09d6f0 0x7fd8ac09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:32.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.230+0000 7fd8a9d9b700 1 --2- 172.21.15.26:0/1599812322 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd8ac09e000 0x7fd8ac130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:32.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.230+0000 7fd8aa59c700 1 -- 172.21.15.26:0/1599812322 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd8ac09e000 msgr2=0x7fd8ac130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:32.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.230+0000 7fd8aa59c700 1 --2- 172.21.15.26:0/1599812322 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd8ac09e000 0x7fd8ac130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.230+0000 7fd8aa59c700 1 -- 172.21.15.26:0/1599812322 >> v1:172.21.15.26:6789/0 conn(0x7fd8ac09e410 legacy=0x7fd8ac130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:32.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.230+0000 7fd8aa59c700 1 -- 172.21.15.26:0/1599812322 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ac09b2d0 con 0x7fd8ac09d6f0 2023-10-01T07:58:32.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.230+0000 7fd8aa59c700 1 --2- 172.21.15.26:0/1599812322 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd8ac09d6f0 0x7fd8ac09dac0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd89c009870 tx=0x7fd89c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e6af431e5e1837d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:32.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.230+0000 7fd8a959a700 1 -- 172.21.15.26:0/1599812322 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c011830 con 0x7fd8ac09d6f0 2023-10-01T07:58:32.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.230+0000 7fd8a959a700 1 -- 172.21.15.26:0/1599812322 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89c011990 con 0x7fd8ac09d6f0 2023-10-01T07:58:32.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.230+0000 7fd8a959a700 1 -- 172.21.15.26:0/1599812322 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c011d20 con 0x7fd8ac09d6f0 2023-10-01T07:58:32.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.231+0000 7f9d16ffd700 1 -- 172.21.15.26:0/1737030629 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d180192c0 con 0x7f9d20130e50 2023-10-01T07:58:32.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.231+0000 7fd8b0f62700 1 -- 172.21.15.26:0/1599812322 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd8ac09d6f0 msgr2=0x7fd8ac09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:32.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.231+0000 7fd8b0f62700 1 --2- 172.21.15.26:0/1599812322 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd8ac09d6f0 0x7fd8ac09dac0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd89c009870 tx=0x7fd89c009b80 comp rx=0 tx=0).stop 2023-10-01T07:58:32.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.231+0000 7fd8b0f62700 1 -- 172.21.15.26:0/1599812322 shutdown_connections 2023-10-01T07:58:32.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.231+0000 7fd8b0f62700 1 --2- 172.21.15.26:0/1599812322 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd8ac09d6f0 0x7fd8ac09dac0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.231+0000 7fd8b0f62700 1 --2- 172.21.15.26:0/1599812322 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd8ac09e000 0x7fd8ac130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.231+0000 7fd8b0f62700 1 -- 172.21.15.26:0/1599812322 >> 172.21.15.26:0/1599812322 conn(0x7fd8ac066f50 msgr2=0x7fd8ac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:32.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.231+0000 7fd8b0f62700 1 -- 172.21.15.26:0/1599812322 shutdown_connections 2023-10-01T07:58:32.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.231+0000 7fd8b0f62700 1 -- 172.21.15.26:0/1599812322 wait complete. 2023-10-01T07:58:32.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.233+0000 7fd8b0f62700 1 Processor -- start 2023-10-01T07:58:32.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.233+0000 7fd8b0f62700 1 -- start start 2023-10-01T07:58:32.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.234+0000 7fd8b0f62700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8ac09d6f0 0x7fd8ac12daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:32.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.234+0000 7fd8b0f62700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd8ac09e000 0x7fd8ac12e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:32.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.234+0000 7fd8b0f62700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd8ac09e410 0x7fd8ac12e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:32.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.234+0000 7fd8b0f62700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac072450 con 0x7fd8ac09d6f0 2023-10-01T07:58:32.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.234+0000 7fd8b0f62700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac09c700 con 0x7fd8ac09e000 2023-10-01T07:58:32.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.234+0000 7fd8b0f62700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac131ab0 con 0x7fd8ac09e410 2023-10-01T07:58:32.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.234+0000 7fd8aa59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8ac09d6f0 0x7fd8ac12daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:32.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.234+0000 7fd8aa59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8ac09d6f0 0x7fd8ac12daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50162/0 (socket says 172.21.15.26:50162) 2023-10-01T07:58:32.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.234+0000 7fd8aa59c700 1 -- 172.21.15.26:0/1609707104 learned_addr learned my addr 172.21.15.26:0/1609707104 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:32.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.234+0000 7fd8aad9d700 1 --2- 172.21.15.26:0/1609707104 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd8ac09e410 0x7fd8ac12e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:32.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.234+0000 7fd8a9d9b700 1 --2- 172.21.15.26:0/1609707104 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd8ac09e000 0x7fd8ac12e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:32.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.235+0000 7fd8aa59c700 1 -- 172.21.15.26:0/1609707104 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd8ac09e410 msgr2=0x7fd8ac12e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:32.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.235+0000 7fd8aa59c700 1 --2- 172.21.15.26:0/1609707104 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd8ac09e410 0x7fd8ac12e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.235+0000 7fd8aa59c700 1 -- 172.21.15.26:0/1609707104 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd8ac09e000 msgr2=0x7fd8ac12e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:32.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.235+0000 7fd8aa59c700 1 --2- 172.21.15.26:0/1609707104 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd8ac09e000 0x7fd8ac12e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.235+0000 7fd8aa59c700 1 -- 172.21.15.26:0/1609707104 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89c0094a0 con 0x7fd8ac09d6f0 2023-10-01T07:58:32.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.235+0000 7fd8aa59c700 1 --2- 172.21.15.26:0/1609707104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8ac09d6f0 0x7fd8ac12daf0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fd89c0090b0 tx=0x7fd89c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:32.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.235+0000 7fd89affd700 1 -- 172.21.15.26:0/1609707104 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c004510 con 0x7fd8ac09d6f0 2023-10-01T07:58:32.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.235+0000 7fd89affd700 1 -- 172.21.15.26:0/1609707104 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89c01f070 con 0x7fd8ac09d6f0 2023-10-01T07:58:32.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.235+0000 7fd8b0f62700 1 -- 172.21.15.26:0/1609707104 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8ac12fcb0 con 0x7fd8ac09d6f0 2023-10-01T07:58:32.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.235+0000 7fd89affd700 1 -- 172.21.15.26:0/1609707104 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c0038c0 con 0x7fd8ac09d6f0 2023-10-01T07:58:32.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.235+0000 7fd8b0f62700 1 -- 172.21.15.26:0/1609707104 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8ac12f700 con 0x7fd8ac09d6f0 2023-10-01T07:58:32.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.236+0000 7fd89affd700 1 -- 172.21.15.26:0/1609707104 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd89c003a20 con 0x7fd8ac09d6f0 2023-10-01T07:58:32.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.236+0000 7fd89affd700 1 -- 172.21.15.26:0/1609707104 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd89c021070 con 0x7fd8ac09d6f0 2023-10-01T07:58:32.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.237+0000 7fd8b0f62700 1 -- 172.21.15.26:0/1609707104 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8ac074ea0 con 0x7fd8ac09d6f0 2023-10-01T07:58:32.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.243+0000 7fd89affd700 1 -- 172.21.15.26:0/1609707104 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd89c01a430 con 0x7fd8ac09d6f0 2023-10-01T07:58:32.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.273+0000 7fe351fa3700 1 Processor -- start 2023-10-01T07:58:32.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.273+0000 7fe351fa3700 1 -- start start 2023-10-01T07:58:32.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.274+0000 7fe351fa3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe34c133a80 0x7fe34c133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:32.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.274+0000 7fe351fa3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe34c12ff20 0x7fe34c130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:32.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.274+0000 7fe351fa3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe34c130870 0x7fe34c13a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:32.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.274+0000 7fe351fa3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe34c06c570 con 0x7fe34c130870 2023-10-01T07:58:32.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.274+0000 7fe351fa3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c06bc00 con 0x7fe34c133a80 2023-10-01T07:58:32.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.274+0000 7fe351fa3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c0a0040 con 0x7fe34c12ff20 2023-10-01T07:58:32.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.274+0000 7fe34b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe34c133a80 0x7fe34c133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:32.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.275+0000 7fe34b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe34c133a80 0x7fe34c133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34398/0 (socket says 172.21.15.26:34398) 2023-10-01T07:58:32.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.275+0000 7fe34b7fe700 1 -- 172.21.15.26:0/639784879 learned_addr learned my addr 172.21.15.26:0/639784879 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:32.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.275+0000 7fe34bfff700 1 --2- 172.21.15.26:0/639784879 >> v2:172.21.15.26:3300/0 conn(0x7fe34c130870 0x7fe34c13a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:32.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.275+0000 7fe34affd700 1 --2- 172.21.15.26:0/639784879 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe34c12ff20 0x7fe34c130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:32.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.275+0000 7fe34b7fe700 1 -- 172.21.15.26:0/639784879 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe34c12ff20 msgr2=0x7fe34c130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:32.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.275+0000 7fe34b7fe700 1 --2- 172.21.15.26:0/639784879 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe34c12ff20 0x7fe34c130330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.275+0000 7fe34b7fe700 1 -- 172.21.15.26:0/639784879 >> v2:172.21.15.26:3300/0 conn(0x7fe34c130870 msgr2=0x7fe34c13a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:32.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.275+0000 7fe34b7fe700 1 --2- 172.21.15.26:0/639784879 >> v2:172.21.15.26:3300/0 conn(0x7fe34c130870 0x7fe34c13a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.275+0000 7fe34b7fe700 1 -- 172.21.15.26:0/639784879 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe34c133860 con 0x7fe34c133a80 2023-10-01T07:58:32.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.275+0000 7fe34b7fe700 1 --2- 172.21.15.26:0/639784879 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe34c133a80 0x7fe34c133e50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe33c0098f0 tx=0x7fe33c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdd8db0b58c903c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:32.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.275+0000 7fe34a7fc700 1 -- 172.21.15.26:0/639784879 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c011830 con 0x7fe34c133a80 2023-10-01T07:58:32.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.276+0000 7fe34a7fc700 1 -- 172.21.15.26:0/639784879 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33c011990 con 0x7fe34c133a80 2023-10-01T07:58:32.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.276+0000 7fe34a7fc700 1 -- 172.21.15.26:0/639784879 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c011d20 con 0x7fe34c133a80 2023-10-01T07:58:32.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.277+0000 7fe351fa3700 1 -- 172.21.15.26:0/639784879 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe34c133a80 msgr2=0x7fe34c133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:32.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.277+0000 7fe351fa3700 1 --2- 172.21.15.26:0/639784879 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe34c133a80 0x7fe34c133e50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe33c0098f0 tx=0x7fe33c009c00 comp rx=0 tx=0).stop 2023-10-01T07:58:32.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.277+0000 7fe351fa3700 1 -- 172.21.15.26:0/639784879 shutdown_connections 2023-10-01T07:58:32.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.277+0000 7fe351fa3700 1 --2- 172.21.15.26:0/639784879 >> v2:172.21.15.26:3300/0 conn(0x7fe34c130870 0x7fe34c13a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.277+0000 7fe351fa3700 1 --2- 172.21.15.26:0/639784879 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe34c133a80 0x7fe34c133e50 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.277+0000 7fe351fa3700 1 --2- 172.21.15.26:0/639784879 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe34c12ff20 0x7fe34c130330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.277+0000 7fe351fa3700 1 -- 172.21.15.26:0/639784879 >> 172.21.15.26:0/639784879 conn(0x7fe34c0a4210 msgr2=0x7fe34c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:32.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.277+0000 7fe351fa3700 1 -- 172.21.15.26:0/639784879 shutdown_connections 2023-10-01T07:58:32.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.277+0000 7fe351fa3700 1 -- 172.21.15.26:0/639784879 wait complete. 2023-10-01T07:58:32.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.278+0000 7fe351fa3700 1 Processor -- start 2023-10-01T07:58:32.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.278+0000 7fe351fa3700 1 -- start start 2023-10-01T07:58:32.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.278+0000 7fe351fa3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe34c12ff20 0x7fe34c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:32.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.279+0000 7fe351fa3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe34c130870 0x7fe34c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:32.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.279+0000 7fe351fa3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe34c133a80 0x7fe34c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:32.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.279+0000 7fe351fa3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c09dce0 con 0x7fe34c133a80 2023-10-01T07:58:32.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.279+0000 7fe351fa3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c11ff00 con 0x7fe34c12ff20 2023-10-01T07:58:32.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.279+0000 7fe351fa3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c09df40 con 0x7fe34c130870 2023-10-01T07:58:32.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.279+0000 7fe34b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe34c12ff20 0x7fe34c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:32.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.279+0000 7fe34b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe34c12ff20 0x7fe34c09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:34404/0 (socket says 172.21.15.26:34404) 2023-10-01T07:58:32.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.279+0000 7fe34b7fe700 1 -- 172.21.15.26:0/2359383206 learned_addr learned my addr 172.21.15.26:0/2359383206 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:32.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.279+0000 7fe34bfff700 1 --2- 172.21.15.26:0/2359383206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe34c133a80 0x7fe34c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:32.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.279+0000 7fe34b7fe700 1 -- 172.21.15.26:0/2359383206 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe34c130870 msgr2=0x7fe34c09c9c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:58:32.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.279+0000 7fe34b7fe700 1 --2- 172.21.15.26:0/2359383206 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe34c130870 0x7fe34c09c9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.279+0000 7fe34b7fe700 1 -- 172.21.15.26:0/2359383206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe34c133a80 msgr2=0x7fe34c09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:32.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.279+0000 7fe34b7fe700 1 --2- 172.21.15.26:0/2359383206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe34c133a80 0x7fe34c09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.279+0000 7fe34b7fe700 1 -- 172.21.15.26:0/2359383206 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe33c009550 con 0x7fe34c12ff20 2023-10-01T07:58:32.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.279+0000 7fe34b7fe700 1 --2- 172.21.15.26:0/2359383206 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe34c12ff20 0x7fe34c09c480 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fe34c06bd40 tx=0x7fe33c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:32.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.280+0000 7fe333fff700 1 -- 172.21.15.26:0/2359383206 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c004450 con 0x7fe34c12ff20 2023-10-01T07:58:32.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.280+0000 7fe333fff700 1 -- 172.21.15.26:0/2359383206 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33c0045b0 con 0x7fe34c12ff20 2023-10-01T07:58:32.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.280+0000 7fe351fa3700 1 -- 172.21.15.26:0/2359383206 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe34c120170 con 0x7fe34c12ff20 2023-10-01T07:58:32.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.280+0000 7fe333fff700 1 -- 172.21.15.26:0/2359383206 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c0038e0 con 0x7fe34c12ff20 2023-10-01T07:58:32.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.280+0000 7fe351fa3700 1 -- 172.21.15.26:0/2359383206 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe34c11f450 con 0x7fe34c12ff20 2023-10-01T07:58:32.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.281+0000 7fe333fff700 1 -- 172.21.15.26:0/2359383206 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe33c003a40 con 0x7fe34c12ff20 2023-10-01T07:58:32.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.281+0000 7fe351fa3700 1 -- 172.21.15.26:0/2359383206 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe34c074ea0 con 0x7fe34c12ff20 2023-10-01T07:58:32.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.281+0000 7fe333fff700 1 -- 172.21.15.26:0/2359383206 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe33c040e70 con 0x7fe34c12ff20 2023-10-01T07:58:32.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.287+0000 7fe333fff700 1 -- 172.21.15.26:0/2359383206 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe33c00b3e0 con 0x7fe34c12ff20 2023-10-01T07:58:32.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.317+0000 7f33c3752700 1 Processor -- start 2023-10-01T07:58:32.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.317+0000 7f33c3752700 1 -- start start 2023-10-01T07:58:32.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.318+0000 7f33c3752700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33bc09d6f0 0x7f33bc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:32.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.318+0000 7f33c3752700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f33bc09e000 0x7f33bc130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:32.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.318+0000 7f33c3752700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33bc09f130 con 0x7f33bc09e410 2023-10-01T07:58:32.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.318+0000 7f33c3752700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33bc09f520 con 0x7f33bc09e000 2023-10-01T07:58:32.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.318+0000 7f33c3752700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc09e930 con 0x7f33bc09d6f0 2023-10-01T07:58:32.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.318+0000 7f33c0ced700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f33bc09e000 0x7f33bc130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:32.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.318+0000 7f33c1cef700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f33bc09e410 0x7f33bc130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60352/0 (socket says 172.21.15.26:60352) 2023-10-01T07:58:32.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.318+0000 7f33c1cef700 1 -- 172.21.15.26:0/2200669773 learned_addr learned my addr 172.21.15.26:0/2200669773 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:32.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.318+0000 7f33c0ced700 1 -- 172.21.15.26:0/2200669773 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33bc09d6f0 msgr2=0x7f33bc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:32.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.318+0000 7f33c0ced700 1 --2- 172.21.15.26:0/2200669773 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33bc09d6f0 0x7f33bc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.318+0000 7f33c0ced700 1 -- 172.21.15.26:0/2200669773 >> v1:172.21.15.26:6789/0 conn(0x7f33bc09e410 legacy=0x7f33bc130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:32.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.318+0000 7f33c0ced700 1 -- 172.21.15.26:0/2200669773 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33bc09b2d0 con 0x7f33bc09e000 2023-10-01T07:58:32.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.319+0000 7f33c0ced700 1 --2- 172.21.15.26:0/2200669773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33bc09e000 0x7f33bc130660 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f33ac009840 tx=0x7f33ac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e2487e6e81ade58 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:32.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.319+0000 7f33b3fff700 1 -- 172.21.15.26:0/2200669773 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac011830 con 0x7f33bc09e000 2023-10-01T07:58:32.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.319+0000 7f33b3fff700 1 -- 172.21.15.26:0/2200669773 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ac011990 con 0x7f33bc09e000 2023-10-01T07:58:32.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.319+0000 7f33b3fff700 1 -- 172.21.15.26:0/2200669773 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac011d20 con 0x7f33bc09e000 2023-10-01T07:58:32.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.320+0000 7f33c3752700 1 -- 172.21.15.26:0/2200669773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33bc09e000 msgr2=0x7f33bc130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:32.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.320+0000 7f33c3752700 1 --2- 172.21.15.26:0/2200669773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33bc09e000 0x7f33bc130660 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f33ac009840 tx=0x7f33ac009b50 comp rx=0 tx=0).stop 2023-10-01T07:58:32.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.320+0000 7f33c3752700 1 -- 172.21.15.26:0/2200669773 shutdown_connections 2023-10-01T07:58:32.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.320+0000 7f33c3752700 1 --2- 172.21.15.26:0/2200669773 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33bc09d6f0 0x7f33bc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.320+0000 7f33c3752700 1 --2- 172.21.15.26:0/2200669773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33bc09e000 0x7f33bc130660 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.320+0000 7f33c3752700 1 -- 172.21.15.26:0/2200669773 >> 172.21.15.26:0/2200669773 conn(0x7f33bc066f50 msgr2=0x7f33bc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:32.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.320+0000 7f33c3752700 1 -- 172.21.15.26:0/2200669773 shutdown_connections 2023-10-01T07:58:32.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.320+0000 7f33c3752700 1 -- 172.21.15.26:0/2200669773 wait complete. 2023-10-01T07:58:32.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.321+0000 7f33c3752700 1 Processor -- start 2023-10-01T07:58:32.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.321+0000 7f33c3752700 1 -- start start 2023-10-01T07:58:32.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.322+0000 7f33c3752700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33bc09d6f0 0x7f33bc12dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:32.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.322+0000 7f33c3752700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33bc09e000 0x7f33bc12e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:32.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.322+0000 7f33c3752700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33bc09e410 0x7f33bc12e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:32.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.322+0000 7f33c3752700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc131c30 con 0x7f33bc09d6f0 2023-10-01T07:58:32.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.322+0000 7f33c3752700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc130f20 con 0x7f33bc09e410 2023-10-01T07:58:32.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.322+0000 7f33c3752700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc12f7e0 con 0x7f33bc09e000 2023-10-01T07:58:32.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.322+0000 7f33c14ee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33bc09d6f0 0x7f33bc12dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:32.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.322+0000 7f33c14ee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33bc09d6f0 0x7f33bc12dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50208/0 (socket says 172.21.15.26:50208) 2023-10-01T07:58:32.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.322+0000 7f33c14ee700 1 -- 172.21.15.26:0/3351958032 learned_addr learned my addr 172.21.15.26:0/3351958032 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:32.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.322+0000 7f33c1cef700 1 --2- 172.21.15.26:0/3351958032 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33bc09e410 0x7f33bc12e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:32.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.322+0000 7f33c0ced700 1 --2- 172.21.15.26:0/3351958032 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33bc09e000 0x7f33bc12e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:32.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.322+0000 7f33c14ee700 1 -- 172.21.15.26:0/3351958032 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33bc09e000 msgr2=0x7f33bc12e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.322+0000 7f33c14ee700 1 --2- 172.21.15.26:0/3351958032 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33bc09e000 0x7f33bc12e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.322+0000 7f33c14ee700 1 -- 172.21.15.26:0/3351958032 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33bc09e410 msgr2=0x7f33bc12e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.322+0000 7f33c14ee700 1 --2- 172.21.15.26:0/3351958032 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33bc09e410 0x7f33bc12e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.322+0000 7f33c14ee700 1 -- 172.21.15.26:0/3351958032 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ac0094a0 con 0x7f33bc09d6f0 2023-10-01T07:58:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.322+0000 7f33c0ced700 1 --2- 172.21.15.26:0/3351958032 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33bc09e000 0x7f33bc12e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:58:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.322+0000 7f33c14ee700 1 --2- 172.21.15.26:0/3351958032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33bc09d6f0 0x7f33bc12dce0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f33b800b4d0 tx=0x7f33b800b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.323+0000 7f33b1ffb700 1 -- 172.21.15.26:0/3351958032 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b8011830 con 0x7f33bc09d6f0 2023-10-01T07:58:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.323+0000 7f33b1ffb700 1 -- 172.21.15.26:0/3351958032 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b8011990 con 0x7f33bc09d6f0 2023-10-01T07:58:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.323+0000 7f33c3752700 1 -- 172.21.15.26:0/3351958032 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33bc130040 con 0x7f33bc09d6f0 2023-10-01T07:58:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.323+0000 7f33b1ffb700 1 -- 172.21.15.26:0/3351958032 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b8011d40 con 0x7f33bc09d6f0 2023-10-01T07:58:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.323+0000 7f33c3752700 1 -- 172.21.15.26:0/3351958032 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33bc12fd60 con 0x7f33bc09d6f0 2023-10-01T07:58:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.324+0000 7f33c3752700 1 -- 172.21.15.26:0/3351958032 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33bc074ea0 con 0x7f33bc09d6f0 2023-10-01T07:58:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.324+0000 7f33b1ffb700 1 -- 172.21.15.26:0/3351958032 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f33b801a400 con 0x7f33bc09d6f0 2023-10-01T07:58:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.324+0000 7f33b1ffb700 1 -- 172.21.15.26:0/3351958032 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f33b803f680 con 0x7f33bc09d6f0 2023-10-01T07:58:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.334+0000 7f33b1ffb700 1 -- 172.21.15.26:0/3351958032 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f33b800f8d0 con 0x7f33bc09d6f0 2023-10-01T07:58:32.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.453+0000 7f9d285aa700 1 -- 172.21.15.26:0/1737030629 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9d2011abb0 con 0x7f9d20130e50 2023-10-01T07:58:32.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.453+0000 7f9d16ffd700 1 -- 172.21.15.26:0/1737030629 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9d18017020 con 0x7f9d20130e50 2023-10-01T07:58:32.454 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:32.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.455+0000 7f9d285aa700 1 -- 172.21.15.26:0/1737030629 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d20130e50 msgr2=0x7f9d2006ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:32.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.455+0000 7f9d285aa700 1 --2- 172.21.15.26:0/1737030629 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d20130e50 0x7f9d2006ef50 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f9d1800cad0 tx=0x7f9d1800cde0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.456+0000 7f9d285aa700 1 -- 172.21.15.26:0/1737030629 shutdown_connections 2023-10-01T07:58:32.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.456+0000 7f9d285aa700 1 --2- 172.21.15.26:0/1737030629 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d20130e50 0x7f9d2006ef50 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.456+0000 7f9d285aa700 1 --2- 172.21.15.26:0/1737030629 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d2006fb20 0x7f9d2006e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.456+0000 7f9d285aa700 1 --2- 172.21.15.26:0/1737030629 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d20130540 0x7f9d2006ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.456+0000 7f9d285aa700 1 -- 172.21.15.26:0/1737030629 >> 172.21.15.26:0/1737030629 conn(0x7f9d200a2aa0 msgr2=0x7f9d2012d690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:32.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.456+0000 7f9d285aa700 1 -- 172.21.15.26:0/1737030629 shutdown_connections 2023-10-01T07:58:32.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.456+0000 7f9d285aa700 1 -- 172.21.15.26:0/1737030629 wait complete. 2023-10-01T07:58:32.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.465+0000 7fd8b0f62700 1 -- 172.21.15.26:0/1609707104 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd8ac06c360 con 0x7fd8ac09d6f0 2023-10-01T07:58:32.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.466+0000 7fd89affd700 1 -- 172.21.15.26:0/1609707104 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd89c015020 con 0x7fd8ac09d6f0 2023-10-01T07:58:32.466 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:32.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.469+0000 7fd8b0f62700 1 -- 172.21.15.26:0/1609707104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8ac09d6f0 msgr2=0x7fd8ac12daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:32.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.469+0000 7fd8b0f62700 1 --2- 172.21.15.26:0/1609707104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8ac09d6f0 0x7fd8ac12daf0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fd89c0090b0 tx=0x7fd89c004750 comp rx=0 tx=0).stop 2023-10-01T07:58:32.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.470+0000 7fd8b0f62700 1 -- 172.21.15.26:0/1609707104 shutdown_connections 2023-10-01T07:58:32.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.470+0000 7fd8b0f62700 1 --2- 172.21.15.26:0/1609707104 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd8ac09e410 0x7fd8ac12e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.470+0000 7fd8b0f62700 1 --2- 172.21.15.26:0/1609707104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8ac09d6f0 0x7fd8ac12daf0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.470+0000 7fd8b0f62700 1 --2- 172.21.15.26:0/1609707104 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd8ac09e000 0x7fd8ac12e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.470+0000 7fd8b0f62700 1 -- 172.21.15.26:0/1609707104 >> 172.21.15.26:0/1609707104 conn(0x7fd8ac066f50 msgr2=0x7fd8ac0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:32.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.470+0000 7fd8b0f62700 1 -- 172.21.15.26:0/1609707104 shutdown_connections 2023-10-01T07:58:32.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.470+0000 7fd8b0f62700 1 -- 172.21.15.26:0/1609707104 wait complete. 2023-10-01T07:58:32.471 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:32.484 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:32.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.502+0000 7fe351fa3700 1 -- 172.21.15.26:0/2359383206 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe34c06b250 con 0x7fe34c12ff20 2023-10-01T07:58:32.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.503+0000 7fe333fff700 1 -- 172.21.15.26:0/2359383206 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe33c015070 con 0x7fe34c12ff20 2023-10-01T07:58:32.503 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:32.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.505+0000 7fe351fa3700 1 -- 172.21.15.26:0/2359383206 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe34c12ff20 msgr2=0x7fe34c09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:32.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.505+0000 7fe351fa3700 1 --2- 172.21.15.26:0/2359383206 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe34c12ff20 0x7fe34c09c480 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fe34c06bd40 tx=0x7fe33c004750 comp rx=0 tx=0).stop 2023-10-01T07:58:32.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.505+0000 7fe351fa3700 1 -- 172.21.15.26:0/2359383206 shutdown_connections 2023-10-01T07:58:32.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.505+0000 7fe351fa3700 1 --2- 172.21.15.26:0/2359383206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe34c133a80 0x7fe34c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.505+0000 7fe351fa3700 1 --2- 172.21.15.26:0/2359383206 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe34c12ff20 0x7fe34c09c480 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.505+0000 7fe351fa3700 1 --2- 172.21.15.26:0/2359383206 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe34c130870 0x7fe34c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.505+0000 7fe351fa3700 1 -- 172.21.15.26:0/2359383206 >> 172.21.15.26:0/2359383206 conn(0x7fe34c0a4210 msgr2=0x7fe34c0a0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:32.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.505+0000 7fe351fa3700 1 -- 172.21.15.26:0/2359383206 shutdown_connections 2023-10-01T07:58:32.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.505+0000 7fe351fa3700 1 -- 172.21.15.26:0/2359383206 wait complete. 2023-10-01T07:58:32.519 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:32.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.542+0000 7f33c3752700 1 -- 172.21.15.26:0/3351958032 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f33bc131770 con 0x7f33bc09d6f0 2023-10-01T07:58:32.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.542+0000 7f33b1ffb700 1 -- 172.21.15.26:0/3351958032 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f33b8015030 con 0x7f33bc09d6f0 2023-10-01T07:58:32.543 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:32.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.544+0000 7f33c3752700 1 -- 172.21.15.26:0/3351958032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33bc09d6f0 msgr2=0x7f33bc12dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:32.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.544+0000 7f33c3752700 1 --2- 172.21.15.26:0/3351958032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33bc09d6f0 0x7f33bc12dce0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f33b800b4d0 tx=0x7f33b800b7e0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.545+0000 7f33c3752700 1 -- 172.21.15.26:0/3351958032 shutdown_connections 2023-10-01T07:58:32.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.545+0000 7f33c3752700 1 --2- 172.21.15.26:0/3351958032 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33bc09e410 0x7f33bc12e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.545+0000 7f33c3752700 1 --2- 172.21.15.26:0/3351958032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33bc09d6f0 0x7f33bc12dce0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.545+0000 7f33c3752700 1 --2- 172.21.15.26:0/3351958032 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33bc09e000 0x7f33bc12e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:32.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.545+0000 7f33c3752700 1 -- 172.21.15.26:0/3351958032 >> 172.21.15.26:0/3351958032 conn(0x7f33bc066f50 msgr2=0x7f33bc0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:32.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.545+0000 7f33c3752700 1 -- 172.21.15.26:0/3351958032 shutdown_connections 2023-10-01T07:58:32.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:32.545+0000 7f33c3752700 1 -- 172.21.15.26:0/3351958032 wait complete. 2023-10-01T07:58:32.558 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:33.472 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:33.485 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:33.520 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:33.559 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:33.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.628+0000 7f0782bb7700 1 Processor -- start 2023-10-01T07:58:33.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.628+0000 7f0782bb7700 1 -- start start 2023-10-01T07:58:33.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.629+0000 7f0782bb7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f077c09e930 0x7f077c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:33.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.629+0000 7f0782bb7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f077c09f240 0x7f077c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:33.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.629+0000 7f0782bb7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f077c09f650 0x7f077c131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:33.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.629+0000 7f0782bb7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f077c070940 con 0x7f077c09e930 2023-10-01T07:58:33.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.629+0000 7f0782bb7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077c06fd60 con 0x7f077c09f240 2023-10-01T07:58:33.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.629+0000 7f0782bb7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f077c06fa80 con 0x7f077c09f650 2023-10-01T07:58:33.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.629+0000 7f077bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f077c09f240 0x7f077c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:33.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.629+0000 7f077bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f077c09f240 0x7f077c1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51882/0 (socket says 172.21.15.26:51882) 2023-10-01T07:58:33.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.629+0000 7f077bfff700 1 -- 172.21.15.26:0/3878530672 learned_addr learned my addr 172.21.15.26:0/3878530672 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:33.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.629+0000 7f0781154700 1 --2- 172.21.15.26:0/3878530672 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f077c09f650 0x7f077c131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:33.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.629+0000 7f077bfff700 1 -- 172.21.15.26:0/3878530672 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f077c09f650 msgr2=0x7f077c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:33.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.629+0000 7f077bfff700 1 --2- 172.21.15.26:0/3878530672 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f077c09f650 0x7f077c131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.629+0000 7f077bfff700 1 -- 172.21.15.26:0/3878530672 >> v2:172.21.15.26:3300/0 conn(0x7f077c09e930 msgr2=0x7f077c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:33.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.629+0000 7f077bfff700 1 --2- 172.21.15.26:0/3878530672 >> v2:172.21.15.26:3300/0 conn(0x7f077c09e930 0x7f077c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.629+0000 7f077bfff700 1 -- 172.21.15.26:0/3878530672 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077c09fb60 con 0x7f077c09f240 2023-10-01T07:58:33.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.630+0000 7f077bfff700 1 --2- 172.21.15.26:0/3878530672 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f077c09f240 0x7f077c1317f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f07680098f0 tx=0x7f0768009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59410298111fea16 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:33.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.630+0000 7f077b7fe700 1 -- 172.21.15.26:0/3878530672 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0768011830 con 0x7f077c09f240 2023-10-01T07:58:33.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.630+0000 7f077b7fe700 1 -- 172.21.15.26:0/3878530672 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0768011990 con 0x7f077c09f240 2023-10-01T07:58:33.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.630+0000 7f077b7fe700 1 -- 172.21.15.26:0/3878530672 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0768011d20 con 0x7f077c09f240 2023-10-01T07:58:33.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.631+0000 7f0782bb7700 1 -- 172.21.15.26:0/3878530672 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f077c09f240 msgr2=0x7f077c1317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:33.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.631+0000 7f0782bb7700 1 --2- 172.21.15.26:0/3878530672 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f077c09f240 0x7f077c1317f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f07680098f0 tx=0x7f0768009c00 comp rx=0 tx=0).stop 2023-10-01T07:58:33.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.631+0000 7f0782bb7700 1 -- 172.21.15.26:0/3878530672 shutdown_connections 2023-10-01T07:58:33.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.631+0000 7f0782bb7700 1 --2- 172.21.15.26:0/3878530672 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f077c09f650 0x7f077c131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.631+0000 7f0782bb7700 1 --2- 172.21.15.26:0/3878530672 >> v2:172.21.15.26:3300/0 conn(0x7f077c09e930 0x7f077c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.631+0000 7f0782bb7700 1 --2- 172.21.15.26:0/3878530672 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f077c09f240 0x7f077c1317f0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.631+0000 7f0782bb7700 1 -- 172.21.15.26:0/3878530672 >> 172.21.15.26:0/3878530672 conn(0x7f077c0a4210 msgr2=0x7f077c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:33.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.631+0000 7f0782bb7700 1 -- 172.21.15.26:0/3878530672 shutdown_connections 2023-10-01T07:58:33.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.631+0000 7f0782bb7700 1 -- 172.21.15.26:0/3878530672 wait complete. 2023-10-01T07:58:33.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.632+0000 7f0782bb7700 1 Processor -- start 2023-10-01T07:58:33.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.632+0000 7f0782bb7700 1 -- start start 2023-10-01T07:58:33.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.633+0000 7f0782bb7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f077c09e930 0x7f077c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:33.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.633+0000 7f0782bb7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f077c09f240 0x7f077c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:33.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.633+0000 7f0782bb7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f077c09f650 0x7f077c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:33.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.633+0000 7f0782bb7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c1b72d0 con 0x7f077c09f650 2023-10-01T07:58:33.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.633+0000 7f0782bb7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077c1a9480 con 0x7f077c09e930 2023-10-01T07:58:33.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.633+0000 7f0782bb7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f077c1a97e0 con 0x7f077c09f240 2023-10-01T07:58:33.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.634+0000 7f0780953700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f077c09e930 0x7f077c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:33.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.634+0000 7f0780953700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f077c09e930 0x7f077c06b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51884/0 (socket says 172.21.15.26:51884) 2023-10-01T07:58:33.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.634+0000 7f0780953700 1 -- 172.21.15.26:0/3850572993 learned_addr learned my addr 172.21.15.26:0/3850572993 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:33.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.634+0000 7f0781154700 1 --2- 172.21.15.26:0/3850572993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f077c09f650 0x7f077c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:33.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.634+0000 7f077bfff700 1 --2- 172.21.15.26:0/3850572993 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f077c09f240 0x7f077c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:33.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.634+0000 7f0780953700 1 -- 172.21.15.26:0/3850572993 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f077c09f240 msgr2=0x7f077c06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:33.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.634+0000 7f0780953700 1 --2- 172.21.15.26:0/3850572993 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f077c09f240 0x7f077c06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.634+0000 7f0780953700 1 -- 172.21.15.26:0/3850572993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f077c09f650 msgr2=0x7f077c06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:33.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.634+0000 7f0780953700 1 --2- 172.21.15.26:0/3850572993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f077c09f650 0x7f077c06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.634+0000 7f0780953700 1 -- 172.21.15.26:0/3850572993 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0768009550 con 0x7f077c09e930 2023-10-01T07:58:33.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.634+0000 7f0780953700 1 --2- 172.21.15.26:0/3850572993 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f077c09e930 0x7f077c06b8b0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f077000b560 tx=0x7f077000b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:33.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.634+0000 7f07797fa700 1 -- 172.21.15.26:0/3850572993 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0770011830 con 0x7f077c09e930 2023-10-01T07:58:33.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.634+0000 7f07797fa700 1 -- 172.21.15.26:0/3850572993 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0770011990 con 0x7f077c09e930 2023-10-01T07:58:33.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.634+0000 7f07797fa700 1 -- 172.21.15.26:0/3850572993 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0770011d40 con 0x7f077c09e930 2023-10-01T07:58:33.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.635+0000 7f0782bb7700 1 -- 172.21.15.26:0/3850572993 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f077c0a0190 con 0x7f077c09e930 2023-10-01T07:58:33.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.635+0000 7f0782bb7700 1 -- 172.21.15.26:0/3850572993 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f077c0a36e0 con 0x7f077c09e930 2023-10-01T07:58:33.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.636+0000 7f07797fa700 1 -- 172.21.15.26:0/3850572993 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f077001a400 con 0x7f077c09e930 2023-10-01T07:58:33.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.636+0000 7f0782bb7700 1 -- 172.21.15.26:0/3850572993 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f077c071d80 con 0x7f077c09e930 2023-10-01T07:58:33.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.636+0000 7f07797fa700 1 -- 172.21.15.26:0/3850572993 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f077003f740 con 0x7f077c09e930 2023-10-01T07:58:33.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.641+0000 7f07797fa700 1 -- 172.21.15.26:0/3850572993 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f07700193b0 con 0x7f077c09e930 2023-10-01T07:58:33.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.665+0000 7effde311700 1 Processor -- start 2023-10-01T07:58:33.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.665+0000 7effde311700 1 -- start start 2023-10-01T07:58:33.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.666+0000 7effde311700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effd809e930 0x7effd809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:33.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.666+0000 7effde311700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effd809f650 0x7effd8131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:33.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.666+0000 7effde311700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effd8070940 con 0x7effd809f240 2023-10-01T07:58:33.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.666+0000 7effde311700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd806fd60 con 0x7effd809e930 2023-10-01T07:58:33.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.666+0000 7effde311700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effd806fa80 con 0x7effd809f650 2023-10-01T07:58:33.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.666+0000 7effd77fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7effd809f240 0x7effd81317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:32868/0 (socket says 172.21.15.26:32868) 2023-10-01T07:58:33.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.666+0000 7effd77fe700 1 -- 172.21.15.26:0/784650736 learned_addr learned my addr 172.21.15.26:0/784650736 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:33.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.666+0000 7effd7fff700 1 --2- 172.21.15.26:0/784650736 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effd809e930 0x7effd809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:33.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.667+0000 7effdc8ae700 1 --2- 172.21.15.26:0/784650736 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effd809f650 0x7effd8131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:33.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.667+0000 7effd7fff700 1 -- 172.21.15.26:0/784650736 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effd809f650 msgr2=0x7effd8131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:33.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.667+0000 7effd7fff700 1 --2- 172.21.15.26:0/784650736 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effd809f650 0x7effd8131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.667+0000 7effd7fff700 1 -- 172.21.15.26:0/784650736 >> v1:172.21.15.26:6789/0 conn(0x7effd809f240 legacy=0x7effd81317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:33.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.667+0000 7effd7fff700 1 -- 172.21.15.26:0/784650736 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd809fb60 con 0x7effd809e930 2023-10-01T07:58:33.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.667+0000 7effd6ffd700 1 -- 172.21.15.26:0/784650736 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2976633105 0 0) 0x7effd8070940 con 0x7effd809f240 2023-10-01T07:58:33.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.667+0000 7effdc8ae700 1 --2- 172.21.15.26:0/784650736 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effd809f650 0x7effd8131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:58:33.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.667+0000 7effd7fff700 1 --2- 172.21.15.26:0/784650736 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effd809e930 0x7effd809ed00 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7effc8009870 tx=0x7effc8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a766646dc919af9 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:33.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.667+0000 7effd6ffd700 1 -- 172.21.15.26:0/784650736 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc8011830 con 0x7effd809e930 2023-10-01T07:58:33.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.667+0000 7effd6ffd700 1 -- 172.21.15.26:0/784650736 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc8011990 con 0x7effd809e930 2023-10-01T07:58:33.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.667+0000 7effd6ffd700 1 -- 172.21.15.26:0/784650736 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc8011d20 con 0x7effd809e930 2023-10-01T07:58:33.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.668+0000 7effde311700 1 -- 172.21.15.26:0/784650736 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effd809e930 msgr2=0x7effd809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:33.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.668+0000 7effde311700 1 --2- 172.21.15.26:0/784650736 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effd809e930 0x7effd809ed00 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7effc8009870 tx=0x7effc8009b80 comp rx=0 tx=0).stop 2023-10-01T07:58:33.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.668+0000 7effde311700 1 -- 172.21.15.26:0/784650736 shutdown_connections 2023-10-01T07:58:33.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.668+0000 7effde311700 1 --2- 172.21.15.26:0/784650736 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effd809f650 0x7effd8131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.668+0000 7effde311700 1 --2- 172.21.15.26:0/784650736 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effd809e930 0x7effd809ed00 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.668+0000 7effde311700 1 -- 172.21.15.26:0/784650736 >> 172.21.15.26:0/784650736 conn(0x7effd80a4210 msgr2=0x7effd80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:33.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.668+0000 7effde311700 1 -- 172.21.15.26:0/784650736 shutdown_connections 2023-10-01T07:58:33.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.668+0000 7effde311700 1 -- 172.21.15.26:0/784650736 wait complete. 2023-10-01T07:58:33.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.669+0000 7effde311700 1 Processor -- start 2023-10-01T07:58:33.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.670+0000 7effde311700 1 -- start start 2023-10-01T07:58:33.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.670+0000 7effde311700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effd809e930 0x7effd81a2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:33.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.670+0000 7effde311700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effd809f240 0x7effd81a2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:33.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.670+0000 7effde311700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effd809f650 0x7effd81c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:33.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.670+0000 7effde311700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd80a3430 con 0x7effd809f650 2023-10-01T07:58:33.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.670+0000 7effde311700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd81b52f0 con 0x7effd809f240 2023-10-01T07:58:33.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.670+0000 7effde311700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effd81a1e40 con 0x7effd809e930 2023-10-01T07:58:33.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.670+0000 7effd7fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effd809e930 0x7effd81a2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:33.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.670+0000 7effd77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effd809f240 0x7effd81a2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:33.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.670+0000 7effd7fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effd809e930 0x7effd81a2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:38970/0 (socket says 172.21.15.26:38970) 2023-10-01T07:58:33.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.670+0000 7effd7fff700 1 -- 172.21.15.26:0/3451812497 learned_addr learned my addr 172.21.15.26:0/3451812497 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:33.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.670+0000 7effdc8ae700 1 --2- 172.21.15.26:0/3451812497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effd809f650 0x7effd81c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:33.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.671+0000 7effd7fff700 1 -- 172.21.15.26:0/3451812497 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effd809f240 msgr2=0x7effd81a2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:33.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.671+0000 7effd7fff700 1 --2- 172.21.15.26:0/3451812497 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effd809f240 0x7effd81a2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.671+0000 7effd7fff700 1 -- 172.21.15.26:0/3451812497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effd809f650 msgr2=0x7effd81c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:33.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.671+0000 7effd7fff700 1 --2- 172.21.15.26:0/3451812497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effd809f650 0x7effd81c3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.671+0000 7effd7fff700 1 -- 172.21.15.26:0/3451812497 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc80094a0 con 0x7effd809e930 2023-10-01T07:58:33.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.671+0000 7effdc8ae700 1 --2- 172.21.15.26:0/3451812497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effd809f650 0x7effd81c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:33.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.671+0000 7effd7fff700 1 --2- 172.21.15.26:0/3451812497 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effd809e930 0x7effd81a2300 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7effc8000c00 tx=0x7effc8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:33.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.671+0000 7effd4ff9700 1 -- 172.21.15.26:0/3451812497 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc8004590 con 0x7effd809e930 2023-10-01T07:58:33.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.671+0000 7effd4ff9700 1 -- 172.21.15.26:0/3451812497 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc801f070 con 0x7effd809e930 2023-10-01T07:58:33.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.671+0000 7effd4ff9700 1 -- 172.21.15.26:0/3451812497 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc80038e0 con 0x7effd809e930 2023-10-01T07:58:33.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.671+0000 7effde311700 1 -- 172.21.15.26:0/3451812497 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd80a0190 con 0x7effd809e930 2023-10-01T07:58:33.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.671+0000 7effde311700 1 -- 172.21.15.26:0/3451812497 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd81a4690 con 0x7effd809e930 2023-10-01T07:58:33.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.673+0000 7effde311700 1 -- 172.21.15.26:0/3451812497 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd8074ea0 con 0x7effd809e930 2023-10-01T07:58:33.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.673+0000 7effd4ff9700 1 -- 172.21.15.26:0/3451812497 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7effc8003a40 con 0x7effd809e930 2023-10-01T07:58:33.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.673+0000 7effd4ff9700 1 -- 172.21.15.26:0/3451812497 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7effc8021070 con 0x7effd809e930 2023-10-01T07:58:33.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.682+0000 7effd4ff9700 1 -- 172.21.15.26:0/3451812497 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7effc800bdf0 con 0x7effd809e930 2023-10-01T07:58:33.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.709+0000 7ff1d3535700 1 Processor -- start 2023-10-01T07:58:33.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.709+0000 7ff1d3535700 1 -- start start 2023-10-01T07:58:33.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.710+0000 7ff1d3535700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1cc136710 0x7ff1cc138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:33.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.710+0000 7ff1d3535700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff1cc139030 0x7ff1cc13b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:33.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.710+0000 7ff1d3535700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1cc06ef30 con 0x7ff1cc1338a0 2023-10-01T07:58:33.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.710+0000 7ff1d3535700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc06fef0 con 0x7ff1cc139030 2023-10-01T07:58:33.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.710+0000 7ff1d3535700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc1334b0 con 0x7ff1cc136710 2023-10-01T07:58:33.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.710+0000 7ff1d0ad0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1cc136710 0x7ff1cc138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:33.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.710+0000 7ff1d12d1700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff1cc1338a0 0x7ff1cc133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:32870/0 (socket says 172.21.15.26:32870) 2023-10-01T07:58:33.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.710+0000 7ff1d12d1700 1 -- 172.21.15.26:0/1012983684 learned_addr learned my addr 172.21.15.26:0/1012983684 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:33.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.710+0000 7ff1c3fff700 1 -- 172.21.15.26:0/1012983684 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1643997620 0 0) 0x7ff1cc06ef30 con 0x7ff1cc1338a0 2023-10-01T07:58:33.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.710+0000 7ff1c3fff700 1 -- 172.21.15.26:0/1012983684 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1b80035b0 con 0x7ff1cc1338a0 2023-10-01T07:58:33.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.710+0000 7ff1d0ad0700 1 -- 172.21.15.26:0/1012983684 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff1cc139030 msgr2=0x7ff1cc13b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:33.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.710+0000 7ff1d0ad0700 1 --2- 172.21.15.26:0/1012983684 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff1cc139030 0x7ff1cc13b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.710+0000 7ff1d0ad0700 1 -- 172.21.15.26:0/1012983684 >> v1:172.21.15.26:6789/0 conn(0x7ff1cc1338a0 legacy=0x7ff1cc133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:33.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.710+0000 7ff1d0ad0700 1 -- 172.21.15.26:0/1012983684 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1cc06fc30 con 0x7ff1cc136710 2023-10-01T07:58:33.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.711+0000 7ff1d0ad0700 1 --2- 172.21.15.26:0/1012983684 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1cc136710 0x7ff1cc138af0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc009870 tx=0x7ff1bc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ccfe543366b35d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:33.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.711+0000 7ff1c3fff700 1 -- 172.21.15.26:0/1012983684 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc004230 con 0x7ff1cc136710 2023-10-01T07:58:33.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.711+0000 7ff1c3fff700 1 -- 172.21.15.26:0/1012983684 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1bc004390 con 0x7ff1cc136710 2023-10-01T07:58:33.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.711+0000 7ff1c3fff700 1 -- 172.21.15.26:0/1012983684 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc0036a0 con 0x7ff1cc136710 2023-10-01T07:58:33.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.712+0000 7ff1d3535700 1 -- 172.21.15.26:0/1012983684 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1cc136710 msgr2=0x7ff1cc138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:33.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.712+0000 7ff1d3535700 1 --2- 172.21.15.26:0/1012983684 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1cc136710 0x7ff1cc138af0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc009870 tx=0x7ff1bc009b80 comp rx=0 tx=0).stop 2023-10-01T07:58:33.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.712+0000 7ff1d3535700 1 -- 172.21.15.26:0/1012983684 shutdown_connections 2023-10-01T07:58:33.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.712+0000 7ff1d3535700 1 --2- 172.21.15.26:0/1012983684 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff1cc139030 0x7ff1cc13b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.712+0000 7ff1d3535700 1 --2- 172.21.15.26:0/1012983684 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1cc136710 0x7ff1cc138af0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.712+0000 7ff1d3535700 1 -- 172.21.15.26:0/1012983684 >> 172.21.15.26:0/1012983684 conn(0x7ff1cc0a2aa0 msgr2=0x7ff1cc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:33.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.712+0000 7ff1d3535700 1 -- 172.21.15.26:0/1012983684 shutdown_connections 2023-10-01T07:58:33.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.712+0000 7ff1d3535700 1 -- 172.21.15.26:0/1012983684 wait complete. 2023-10-01T07:58:33.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.713+0000 7ff1d3535700 1 Processor -- start 2023-10-01T07:58:33.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.713+0000 7ff1d3535700 1 -- start start 2023-10-01T07:58:33.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.713+0000 7ff1d3535700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1cc1338a0 0x7ff1cc11b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:33.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.713+0000 7ff1d3535700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff1cc136710 0x7ff1cc11bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:33.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.713+0000 7ff1d3535700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1cc139030 0x7ff1cc1c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:33.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.713+0000 7ff1d3535700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc11b500 con 0x7ff1cc139030 2023-10-01T07:58:33.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.713+0000 7ff1d3535700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc138b00 con 0x7ff1cc136710 2023-10-01T07:58:33.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.713+0000 7ff1d3535700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc06f640 con 0x7ff1cc1338a0 2023-10-01T07:58:33.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.714+0000 7ff1d0ad0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff1cc136710 0x7ff1cc11bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:33.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.714+0000 7ff1d0ad0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff1cc136710 0x7ff1cc11bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51912/0 (socket says 172.21.15.26:51912) 2023-10-01T07:58:33.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.714+0000 7ff1d0ad0700 1 -- 172.21.15.26:0/2523014394 learned_addr learned my addr 172.21.15.26:0/2523014394 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:33.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.714+0000 7ff1d12d1700 1 --2- 172.21.15.26:0/2523014394 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1cc1338a0 0x7ff1cc11b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:33.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.714+0000 7ff1d1ad2700 1 --2- 172.21.15.26:0/2523014394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1cc139030 0x7ff1cc1c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:33.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.714+0000 7ff1d0ad0700 1 -- 172.21.15.26:0/2523014394 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1cc1338a0 msgr2=0x7ff1cc11b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:33.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.714+0000 7ff1d0ad0700 1 --2- 172.21.15.26:0/2523014394 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1cc1338a0 0x7ff1cc11b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.714+0000 7ff1d0ad0700 1 -- 172.21.15.26:0/2523014394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1cc139030 msgr2=0x7ff1cc1c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:33.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.714+0000 7ff1d0ad0700 1 --2- 172.21.15.26:0/2523014394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1cc139030 0x7ff1cc1c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.714+0000 7ff1d0ad0700 1 -- 172.21.15.26:0/2523014394 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1bc0094a0 con 0x7ff1cc136710 2023-10-01T07:58:33.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.714+0000 7ff1d0ad0700 1 --2- 172.21.15.26:0/2523014394 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff1cc136710 0x7ff1cc11bc80 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc0090b0 tx=0x7ff1bc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:33.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.714+0000 7ff1c1ffb700 1 -- 172.21.15.26:0/2523014394 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc003db0 con 0x7ff1cc136710 2023-10-01T07:58:33.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.715+0000 7ff1c1ffb700 1 -- 172.21.15.26:0/2523014394 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1bc01e070 con 0x7ff1cc136710 2023-10-01T07:58:33.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.715+0000 7ff1c1ffb700 1 -- 172.21.15.26:0/2523014394 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc011850 con 0x7ff1cc136710 2023-10-01T07:58:33.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.715+0000 7ff1d3535700 1 -- 172.21.15.26:0/2523014394 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1cc11f200 con 0x7ff1cc136710 2023-10-01T07:58:33.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.715+0000 7ff1d3535700 1 -- 172.21.15.26:0/2523014394 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1cc11cb60 con 0x7ff1cc136710 2023-10-01T07:58:33.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.716+0000 7ff1c1ffb700 1 -- 172.21.15.26:0/2523014394 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff1bc0119b0 con 0x7ff1cc136710 2023-10-01T07:58:33.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.716+0000 7ff1c1ffb700 1 -- 172.21.15.26:0/2523014394 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff1bc040700 con 0x7ff1cc136710 2023-10-01T07:58:33.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.716+0000 7ff1d3535700 1 -- 172.21.15.26:0/2523014394 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1cc11e890 con 0x7ff1cc136710 2023-10-01T07:58:33.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.718+0000 7f71655ee700 1 Processor -- start 2023-10-01T07:58:33.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.718+0000 7f71655ee700 1 -- start start 2023-10-01T07:58:33.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.719+0000 7f71655ee700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f716009d6f0 0x7f716009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:33.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.719+0000 7f71655ee700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f716009e000 0x7f71601339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:33.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.719+0000 7f71655ee700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f716009e410 0x7f7160133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:33.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.719+0000 7f71655ee700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f716006b460 con 0x7f716009e000 2023-10-01T07:58:33.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.719+0000 7f71655ee700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716009b120 con 0x7f716009d6f0 2023-10-01T07:58:33.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.719+0000 7f71655ee700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f716009a7e0 con 0x7f716009e410 2023-10-01T07:58:33.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.719+0000 7f715effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f716009d6f0 0x7f716009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:33.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.719+0000 7f715e7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f716009e000 0x7f71601339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:33.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.719+0000 7f715effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f716009d6f0 0x7f716009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51914/0 (socket says 172.21.15.26:51914) 2023-10-01T07:58:33.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.719+0000 7f715e7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f716009e000 0x7f71601339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52220/0 (socket says 172.21.15.26:52220) 2023-10-01T07:58:33.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.719+0000 7f715effd700 1 -- 172.21.15.26:0/1102777400 learned_addr learned my addr 172.21.15.26:0/1102777400 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:33.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.719+0000 7f715f7fe700 1 --2- 172.21.15.26:0/1102777400 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f716009e410 0x7f7160133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:33.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.720+0000 7f715e7fc700 1 -- 172.21.15.26:0/1102777400 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f716009e410 msgr2=0x7f7160133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:33.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.720+0000 7f715e7fc700 1 --2- 172.21.15.26:0/1102777400 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f716009e410 0x7f7160133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.720+0000 7f715e7fc700 1 -- 172.21.15.26:0/1102777400 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f716009d6f0 msgr2=0x7f716009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:33.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.720+0000 7f715e7fc700 1 --2- 172.21.15.26:0/1102777400 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f716009d6f0 0x7f716009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.720+0000 7f715e7fc700 1 -- 172.21.15.26:0/1102777400 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716009a500 con 0x7f716009e000 2023-10-01T07:58:33.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.720+0000 7f715e7fc700 1 --2- 172.21.15.26:0/1102777400 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f716009e000 0x7f71601339f0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f7154009840 tx=0x7f7154009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=246418e1bdab3e4f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:33.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.720+0000 7f715dffb700 1 -- 172.21.15.26:0/1102777400 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7154011830 con 0x7f716009e000 2023-10-01T07:58:33.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.720+0000 7f715dffb700 1 -- 172.21.15.26:0/1102777400 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7154011990 con 0x7f716009e000 2023-10-01T07:58:33.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.720+0000 7f715dffb700 1 -- 172.21.15.26:0/1102777400 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7154011d20 con 0x7f716009e000 2023-10-01T07:58:33.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.721+0000 7f71655ee700 1 -- 172.21.15.26:0/1102777400 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f716009e000 msgr2=0x7f71601339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:33.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.721+0000 7f71655ee700 1 --2- 172.21.15.26:0/1102777400 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f716009e000 0x7f71601339f0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f7154009840 tx=0x7f7154009b50 comp rx=0 tx=0).stop 2023-10-01T07:58:33.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.721+0000 7f71655ee700 1 -- 172.21.15.26:0/1102777400 shutdown_connections 2023-10-01T07:58:33.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.721+0000 7f71655ee700 1 --2- 172.21.15.26:0/1102777400 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f716009e410 0x7f7160133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.721+0000 7f71655ee700 1 --2- 172.21.15.26:0/1102777400 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f716009d6f0 0x7f716009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.721+0000 7f71655ee700 1 --2- 172.21.15.26:0/1102777400 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f716009e000 0x7f71601339f0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.721+0000 7f71655ee700 1 -- 172.21.15.26:0/1102777400 >> 172.21.15.26:0/1102777400 conn(0x7f7160066f50 msgr2=0x7f716009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:33.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.721+0000 7f71655ee700 1 -- 172.21.15.26:0/1102777400 shutdown_connections 2023-10-01T07:58:33.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.721+0000 7f71655ee700 1 -- 172.21.15.26:0/1102777400 wait complete. 2023-10-01T07:58:33.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.723+0000 7f71655ee700 1 Processor -- start 2023-10-01T07:58:33.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.723+0000 7f71655ee700 1 -- start start 2023-10-01T07:58:33.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.724+0000 7f71655ee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f716009d6f0 0x7f71601a5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:33.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.724+0000 7f71655ee700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f716009e000 0x7f71601a6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:33.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.724+0000 7f71655ee700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f716009e410 0x7f71601a67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:33.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.724+0000 7f71655ee700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71601aa230 con 0x7f716009d6f0 2023-10-01T07:58:33.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.724+0000 7f71655ee700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71601a7960 con 0x7f716009e410 2023-10-01T07:58:33.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.724+0000 7f71655ee700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71601a7f80 con 0x7f716009e000 2023-10-01T07:58:33.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.724+0000 7f715effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f716009d6f0 0x7f71601a5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:33.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.724+0000 7f715effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f716009d6f0 0x7f71601a5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52232/0 (socket says 172.21.15.26:52232) 2023-10-01T07:58:33.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.724+0000 7f715effd700 1 -- 172.21.15.26:0/220694980 learned_addr learned my addr 172.21.15.26:0/220694980 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:33.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.724+0000 7f715e7fc700 1 --2- 172.21.15.26:0/220694980 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f716009e000 0x7f71601a6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:33.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.724+0000 7f715f7fe700 1 --2- 172.21.15.26:0/220694980 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f716009e410 0x7f71601a67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:33.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.724+0000 7ff1c1ffb700 1 -- 172.21.15.26:0/2523014394 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff1bc02d970 con 0x7ff1cc136710 2023-10-01T07:58:33.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.725+0000 7f715effd700 1 -- 172.21.15.26:0/220694980 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f716009e000 msgr2=0x7f71601a6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:33.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.725+0000 7f715effd700 1 --2- 172.21.15.26:0/220694980 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f716009e000 0x7f71601a6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.725+0000 7f715effd700 1 -- 172.21.15.26:0/220694980 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f716009e410 msgr2=0x7f71601a67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:33.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.725+0000 7f715effd700 1 --2- 172.21.15.26:0/220694980 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f716009e410 0x7f71601a67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.725+0000 7f715effd700 1 -- 172.21.15.26:0/220694980 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71540094a0 con 0x7f716009d6f0 2023-10-01T07:58:33.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.725+0000 7f715e7fc700 1 --2- 172.21.15.26:0/220694980 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f716009e000 0x7f71601a6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:33.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.725+0000 7f715f7fe700 1 --2- 172.21.15.26:0/220694980 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f716009e410 0x7f71601a67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:33.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.725+0000 7f715effd700 1 --2- 172.21.15.26:0/220694980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f716009d6f0 0x7f71601a5d50 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f715000e940 tx=0x7f715000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:33.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.725+0000 7f71477fe700 1 -- 172.21.15.26:0/220694980 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71500096a0 con 0x7f716009d6f0 2023-10-01T07:58:33.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.725+0000 7f71477fe700 1 -- 172.21.15.26:0/220694980 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7150013680 con 0x7f716009d6f0 2023-10-01T07:58:33.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.725+0000 7f71655ee700 1 -- 172.21.15.26:0/220694980 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71601a8bb0 con 0x7f716009d6f0 2023-10-01T07:58:33.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.725+0000 7f71477fe700 1 -- 172.21.15.26:0/220694980 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7150013a30 con 0x7f716009d6f0 2023-10-01T07:58:33.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.725+0000 7f71655ee700 1 -- 172.21.15.26:0/220694980 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f716009c710 con 0x7f716009d6f0 2023-10-01T07:58:33.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.726+0000 7f71477fe700 1 -- 172.21.15.26:0/220694980 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7150013b90 con 0x7f716009d6f0 2023-10-01T07:58:33.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.727+0000 7f71477fe700 1 -- 172.21.15.26:0/220694980 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f715003f940 con 0x7f716009d6f0 2023-10-01T07:58:33.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.727+0000 7f71655ee700 1 -- 172.21.15.26:0/220694980 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71400052e0 con 0x7f716009d6f0 2023-10-01T07:58:33.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.737+0000 7f71477fe700 1 -- 172.21.15.26:0/220694980 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7150013e40 con 0x7f716009d6f0 2023-10-01T07:58:33.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.864+0000 7f0782bb7700 1 -- 172.21.15.26:0/3850572993 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f077c074ea0 con 0x7f077c09e930 2023-10-01T07:58:33.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.865+0000 7f07797fa700 1 -- 172.21.15.26:0/3850572993 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0770015030 con 0x7f077c09e930 2023-10-01T07:58:33.865 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:33.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.868+0000 7f0782bb7700 1 -- 172.21.15.26:0/3850572993 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f077c09e930 msgr2=0x7f077c06b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:33.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.868+0000 7f0782bb7700 1 --2- 172.21.15.26:0/3850572993 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f077c09e930 0x7f077c06b8b0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f077000b560 tx=0x7f077000b870 comp rx=0 tx=0).stop 2023-10-01T07:58:33.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.868+0000 7f0782bb7700 1 -- 172.21.15.26:0/3850572993 shutdown_connections 2023-10-01T07:58:33.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.868+0000 7f0782bb7700 1 --2- 172.21.15.26:0/3850572993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f077c09f650 0x7f077c06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.868+0000 7f0782bb7700 1 --2- 172.21.15.26:0/3850572993 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f077c09e930 0x7f077c06b8b0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.868+0000 7f0782bb7700 1 --2- 172.21.15.26:0/3850572993 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f077c09f240 0x7f077c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.868+0000 7f0782bb7700 1 -- 172.21.15.26:0/3850572993 >> 172.21.15.26:0/3850572993 conn(0x7f077c0a4210 msgr2=0x7f077c1b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:33.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.869+0000 7f0782bb7700 1 -- 172.21.15.26:0/3850572993 shutdown_connections 2023-10-01T07:58:33.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.869+0000 7f0782bb7700 1 -- 172.21.15.26:0/3850572993 wait complete. 2023-10-01T07:58:33.888 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:33.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.903+0000 7effde311700 1 -- 172.21.15.26:0/3451812497 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7effd81a41f0 con 0x7effd809e930 2023-10-01T07:58:33.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.903+0000 7effd4ff9700 1 -- 172.21.15.26:0/3451812497 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7effc802b030 con 0x7effd809e930 2023-10-01T07:58:33.904 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:33.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.906+0000 7effde311700 1 -- 172.21.15.26:0/3451812497 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effd809e930 msgr2=0x7effd81a2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:33.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.906+0000 7effde311700 1 --2- 172.21.15.26:0/3451812497 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effd809e930 0x7effd81a2300 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7effc8000c00 tx=0x7effc8004750 comp rx=0 tx=0).stop 2023-10-01T07:58:33.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.906+0000 7effde311700 1 -- 172.21.15.26:0/3451812497 shutdown_connections 2023-10-01T07:58:33.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.906+0000 7effde311700 1 --2- 172.21.15.26:0/3451812497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effd809f650 0x7effd81c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.906+0000 7effde311700 1 --2- 172.21.15.26:0/3451812497 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effd809e930 0x7effd81a2300 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.906+0000 7effde311700 1 --2- 172.21.15.26:0/3451812497 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effd809f240 0x7effd81a2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.906+0000 7effde311700 1 -- 172.21.15.26:0/3451812497 >> 172.21.15.26:0/3451812497 conn(0x7effd80a4210 msgr2=0x7effd81b6910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:33.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.906+0000 7effde311700 1 -- 172.21.15.26:0/3451812497 shutdown_connections 2023-10-01T07:58:33.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.906+0000 7effde311700 1 -- 172.21.15.26:0/3451812497 wait complete. 2023-10-01T07:58:33.920 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:33.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.944+0000 7ff1d3535700 1 -- 172.21.15.26:0/2523014394 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff1cc11e670 con 0x7ff1cc136710 2023-10-01T07:58:33.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.944+0000 7ff1c1ffb700 1 -- 172.21.15.26:0/2523014394 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff1bc010b70 con 0x7ff1cc136710 2023-10-01T07:58:33.945 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:33.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.947+0000 7ff1d3535700 1 -- 172.21.15.26:0/2523014394 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff1cc136710 msgr2=0x7ff1cc11bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:33.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.947+0000 7ff1d3535700 1 --2- 172.21.15.26:0/2523014394 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff1cc136710 0x7ff1cc11bc80 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc0090b0 tx=0x7ff1bc004750 comp rx=0 tx=0).stop 2023-10-01T07:58:33.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.947+0000 7ff1d3535700 1 -- 172.21.15.26:0/2523014394 shutdown_connections 2023-10-01T07:58:33.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.947+0000 7ff1d3535700 1 --2- 172.21.15.26:0/2523014394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1cc139030 0x7ff1cc1c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.947+0000 7ff1d3535700 1 --2- 172.21.15.26:0/2523014394 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1cc1338a0 0x7ff1cc11b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.947+0000 7ff1d3535700 1 --2- 172.21.15.26:0/2523014394 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff1cc136710 0x7ff1cc11bc80 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.947+0000 7ff1d3535700 1 -- 172.21.15.26:0/2523014394 >> 172.21.15.26:0/2523014394 conn(0x7ff1cc0a2aa0 msgr2=0x7ff1cc1344f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:33.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.947+0000 7f71655ee700 1 -- 172.21.15.26:0/220694980 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7140005150 con 0x7f716009d6f0 2023-10-01T07:58:33.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.947+0000 7ff1d3535700 1 -- 172.21.15.26:0/2523014394 shutdown_connections 2023-10-01T07:58:33.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.947+0000 7ff1d3535700 1 -- 172.21.15.26:0/2523014394 wait complete. 2023-10-01T07:58:33.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.947+0000 7f71477fe700 1 -- 172.21.15.26:0/220694980 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7150021030 con 0x7f716009d6f0 2023-10-01T07:58:33.949 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:33.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.949+0000 7f71655ee700 1 -- 172.21.15.26:0/220694980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f716009d6f0 msgr2=0x7f71601a5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:33.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.949+0000 7f71655ee700 1 --2- 172.21.15.26:0/220694980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f716009d6f0 0x7f71601a5d50 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f715000e940 tx=0x7f715000ec50 comp rx=0 tx=0).stop 2023-10-01T07:58:33.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.949+0000 7f71655ee700 1 -- 172.21.15.26:0/220694980 shutdown_connections 2023-10-01T07:58:33.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.949+0000 7f71655ee700 1 --2- 172.21.15.26:0/220694980 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f716009e410 0x7f71601a67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.949+0000 7f71655ee700 1 --2- 172.21.15.26:0/220694980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f716009d6f0 0x7f71601a5d50 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.949+0000 7f71655ee700 1 --2- 172.21.15.26:0/220694980 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f716009e000 0x7f71601a6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:33.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.949+0000 7f71655ee700 1 -- 172.21.15.26:0/220694980 >> 172.21.15.26:0/220694980 conn(0x7f7160066f50 msgr2=0x7f71601bad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:33.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.950+0000 7f71655ee700 1 -- 172.21.15.26:0/220694980 shutdown_connections 2023-10-01T07:58:33.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:33.950+0000 7f71655ee700 1 -- 172.21.15.26:0/220694980 wait complete. 2023-10-01T07:58:33.962 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:33.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:34.889 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:34.921 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:34.963 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:34.965 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:35.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.044+0000 7f34aa0b7700 1 Processor -- start 2023-10-01T07:58:35.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.044+0000 7f34aa0b7700 1 -- start start 2023-10-01T07:58:35.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.045+0000 7f34aa0b7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34a409d6f0 0x7f34a409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:35.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.045+0000 7f34aa0b7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f34a409e410 0x7f34a4130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:35.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.045+0000 7f34aa0b7700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a409f130 con 0x7f34a409e000 2023-10-01T07:58:35.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.045+0000 7f34aa0b7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a409f520 con 0x7f34a409e410 2023-10-01T07:58:35.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.045+0000 7f34aa0b7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34a409e930 con 0x7f34a409d6f0 2023-10-01T07:58:35.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.045+0000 7f34a3fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f34a409e410 0x7f34a4130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:35.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.045+0000 7f34a3fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f34a409e410 0x7f34a4130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52244/0 (socket says 172.21.15.26:52244) 2023-10-01T07:58:35.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.045+0000 7f34a3fff700 1 -- 172.21.15.26:0/2883393582 learned_addr learned my addr 172.21.15.26:0/2883393582 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:35.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.045+0000 7f34a37fe700 1 --2- 172.21.15.26:0/2883393582 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34a409d6f0 0x7f34a409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:35.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.046+0000 7f34a3fff700 1 -- 172.21.15.26:0/2883393582 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34a409d6f0 msgr2=0x7f34a409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:35.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.046+0000 7f34a3fff700 1 --2- 172.21.15.26:0/2883393582 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34a409d6f0 0x7f34a409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:35.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.046+0000 7f34a3fff700 1 -- 172.21.15.26:0/2883393582 >> v1:172.21.15.26:6789/0 conn(0x7f34a409e000 legacy=0x7f34a4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:35.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.046+0000 7f34a3fff700 1 -- 172.21.15.26:0/2883393582 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a409b2d0 con 0x7f34a409e410 2023-10-01T07:58:35.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.046+0000 7f34a37fe700 1 --2- 172.21.15.26:0/2883393582 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34a409d6f0 0x7f34a409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:35.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.046+0000 7f34a3fff700 1 --2- 172.21.15.26:0/2883393582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34a409e410 0x7f34a4130d70 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f349c009e50 tx=0x7f349c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e272146a556fdf0d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:35.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.046+0000 7f34a27fc700 1 -- 172.21.15.26:0/2883393582 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c00e070 con 0x7f34a409e410 2023-10-01T07:58:35.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.046+0000 7f34a27fc700 1 -- 172.21.15.26:0/2883393582 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349c003a20 con 0x7f34a409e410 2023-10-01T07:58:35.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.046+0000 7f34a27fc700 1 -- 172.21.15.26:0/2883393582 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c003dd0 con 0x7f34a409e410 2023-10-01T07:58:35.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.047+0000 7f34aa0b7700 1 -- 172.21.15.26:0/2883393582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34a409e410 msgr2=0x7f34a4130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:35.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.047+0000 7f34aa0b7700 1 --2- 172.21.15.26:0/2883393582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34a409e410 0x7f34a4130d70 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f349c009e50 tx=0x7f349c00b330 comp rx=0 tx=0).stop 2023-10-01T07:58:35.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.047+0000 7f34aa0b7700 1 -- 172.21.15.26:0/2883393582 shutdown_connections 2023-10-01T07:58:35.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.047+0000 7f34aa0b7700 1 --2- 172.21.15.26:0/2883393582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34a409e410 0x7f34a4130d70 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:35.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.047+0000 7f34aa0b7700 1 --2- 172.21.15.26:0/2883393582 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34a409d6f0 0x7f34a409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:35.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.047+0000 7f34aa0b7700 1 -- 172.21.15.26:0/2883393582 >> 172.21.15.26:0/2883393582 conn(0x7f34a4066f50 msgr2=0x7f34a409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:35.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.047+0000 7f34aa0b7700 1 -- 172.21.15.26:0/2883393582 shutdown_connections 2023-10-01T07:58:35.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.047+0000 7f34aa0b7700 1 -- 172.21.15.26:0/2883393582 wait complete. 2023-10-01T07:58:35.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.049+0000 7f34aa0b7700 1 Processor -- start 2023-10-01T07:58:35.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.049+0000 7f34aa0b7700 1 -- start start 2023-10-01T07:58:35.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.049+0000 7f34aa0b7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f34a409d6f0 0x7f34a4122370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:35.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.049+0000 7f34aa0b7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34a409e000 0x7f34a41228b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:35.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.049+0000 7f34aa0b7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34a409e410 0x7f34a4122df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:35.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.049+0000 7f34aa0b7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a4124810 con 0x7f34a409e410 2023-10-01T07:58:35.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.049+0000 7f34aa0b7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a41237d0 con 0x7f34a409d6f0 2023-10-01T07:58:35.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.049+0000 7f34aa0b7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34a4125e90 con 0x7f34a409e000 2023-10-01T07:58:35.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.050+0000 7f34a2ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34a409e000 0x7f34a41228b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:35.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.050+0000 7f34a2ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34a409e000 0x7f34a41228b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39014/0 (socket says 172.21.15.26:39014) 2023-10-01T07:58:35.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.050+0000 7f34a2ffd700 1 -- 172.21.15.26:0/495086070 learned_addr learned my addr 172.21.15.26:0/495086070 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:35.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.050+0000 7f34a37fe700 1 --2- 172.21.15.26:0/495086070 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f34a409d6f0 0x7f34a4122370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:35.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.050+0000 7f34a3fff700 1 --2- 172.21.15.26:0/495086070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34a409e410 0x7f34a4122df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:35.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.050+0000 7f34a37fe700 1 -- 172.21.15.26:0/495086070 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34a409e000 msgr2=0x7f34a41228b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:35.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.050+0000 7f34a37fe700 1 --2- 172.21.15.26:0/495086070 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34a409e000 0x7f34a41228b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:35.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.050+0000 7f34a37fe700 1 -- 172.21.15.26:0/495086070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34a409e410 msgr2=0x7f34a4122df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:35.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.050+0000 7f34a37fe700 1 --2- 172.21.15.26:0/495086070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34a409e410 0x7f34a4122df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:35.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.050+0000 7f34a37fe700 1 -- 172.21.15.26:0/495086070 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34940094a0 con 0x7f34a409d6f0 2023-10-01T07:58:35.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.050+0000 7f34a37fe700 1 --2- 172.21.15.26:0/495086070 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f34a409d6f0 0x7f34a4122370 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f349400e9b0 tx=0x7f349400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:35.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.051+0000 7f348bfff700 1 -- 172.21.15.26:0/495086070 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349400ee50 con 0x7f34a409d6f0 2023-10-01T07:58:35.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.051+0000 7f348bfff700 1 -- 172.21.15.26:0/495086070 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349400c850 con 0x7f34a409d6f0 2023-10-01T07:58:35.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.051+0000 7f34aa0b7700 1 -- 172.21.15.26:0/495086070 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f349c009b30 con 0x7f34a409d6f0 2023-10-01T07:58:35.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.051+0000 7f348bfff700 1 -- 172.21.15.26:0/495086070 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349400cc00 con 0x7f34a409d6f0 2023-10-01T07:58:35.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.051+0000 7f34aa0b7700 1 -- 172.21.15.26:0/495086070 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a40a1d00 con 0x7f34a409d6f0 2023-10-01T07:58:35.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.052+0000 7f348bfff700 1 -- 172.21.15.26:0/495086070 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3494013470 con 0x7f34a409d6f0 2023-10-01T07:58:35.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.052+0000 7f348bfff700 1 -- 172.21.15.26:0/495086070 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f349403fa90 con 0x7f34a409d6f0 2023-10-01T07:58:35.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.052+0000 7f34aa0b7700 1 -- 172.21.15.26:0/495086070 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a4074ea0 con 0x7f34a409d6f0 2023-10-01T07:58:35.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.057+0000 7f348bfff700 1 -- 172.21.15.26:0/495086070 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3494013720 con 0x7f34a409d6f0 2023-10-01T07:58:35.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.087+0000 7f70aa057700 1 Processor -- start 2023-10-01T07:58:35.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.087+0000 7f70aa057700 1 -- start start 2023-10-01T07:58:35.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.088+0000 7f70aa057700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f70a40a1510 0x7f70a4138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:35.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.088+0000 7f70aa057700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70a4139250 0x7f70a413b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:35.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.088+0000 7f70aa057700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70a409edd0 con 0x7f70a40a0a30 2023-10-01T07:58:35.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.088+0000 7f70aa057700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a40a18e0 con 0x7f70a4139250 2023-10-01T07:58:35.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.088+0000 7f70aa057700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70a409e1f0 con 0x7f70a40a1510 2023-10-01T07:58:35.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.088+0000 7f70a37fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f70a40a0a30 0x7f70a40a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:32886/0 (socket says 172.21.15.26:32886) 2023-10-01T07:58:35.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.088+0000 7f70a37fe700 1 -- 172.21.15.26:0/3743888403 learned_addr learned my addr 172.21.15.26:0/3743888403 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:35.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.088+0000 7f70a3fff700 1 --2- 172.21.15.26:0/3743888403 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70a4139250 0x7f70a413b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:35.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.088+0000 7f70a2ffd700 1 --2- 172.21.15.26:0/3743888403 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f70a40a1510 0x7f70a4138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:35.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.088+0000 7f70a27fc700 1 -- 172.21.15.26:0/3743888403 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 323697010 0 0) 0x7f70a409edd0 con 0x7f70a40a0a30 2023-10-01T07:58:35.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.089+0000 7f70a27fc700 1 -- 172.21.15.26:0/3743888403 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f708c0035b0 con 0x7f70a40a0a30 2023-10-01T07:58:35.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.089+0000 7f70a3fff700 1 -- 172.21.15.26:0/3743888403 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f70a40a1510 msgr2=0x7f70a4138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:35.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.089+0000 7f70a3fff700 1 --2- 172.21.15.26:0/3743888403 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f70a40a1510 0x7f70a4138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:35.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.089+0000 7f70a3fff700 1 -- 172.21.15.26:0/3743888403 >> v1:172.21.15.26:6789/0 conn(0x7f70a40a0a30 legacy=0x7f70a40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:35.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.089+0000 7f70a3fff700 1 -- 172.21.15.26:0/3743888403 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a409dc50 con 0x7f70a4139250 2023-10-01T07:58:35.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.089+0000 7f70a2ffd700 1 --2- 172.21.15.26:0/3743888403 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f70a40a1510 0x7f70a4138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:35.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.089+0000 7f70a3fff700 1 --2- 172.21.15.26:0/3743888403 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70a4139250 0x7f70a413b630 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f709c009dc0 tx=0x7f709c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46d890664c7f3ec0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:35.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.089+0000 7f70a27fc700 1 -- 172.21.15.26:0/3743888403 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709c00e070 con 0x7f70a4139250 2023-10-01T07:58:35.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.089+0000 7f70a27fc700 1 -- 172.21.15.26:0/3743888403 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709c00bae0 con 0x7f70a4139250 2023-10-01T07:58:35.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.089+0000 7f70a27fc700 1 -- 172.21.15.26:0/3743888403 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709c00be90 con 0x7f70a4139250 2023-10-01T07:58:35.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.090+0000 7f70aa057700 1 -- 172.21.15.26:0/3743888403 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70a4139250 msgr2=0x7f70a413b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:35.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.090+0000 7f70aa057700 1 --2- 172.21.15.26:0/3743888403 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70a4139250 0x7f70a413b630 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f709c009dc0 tx=0x7f709c00b330 comp rx=0 tx=0).stop 2023-10-01T07:58:35.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.090+0000 7f70aa057700 1 -- 172.21.15.26:0/3743888403 shutdown_connections 2023-10-01T07:58:35.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.090+0000 7f70aa057700 1 --2- 172.21.15.26:0/3743888403 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70a4139250 0x7f70a413b630 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:35.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.090+0000 7f70aa057700 1 --2- 172.21.15.26:0/3743888403 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f70a40a1510 0x7f70a4138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:35.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.090+0000 7f70aa057700 1 -- 172.21.15.26:0/3743888403 >> 172.21.15.26:0/3743888403 conn(0x7f70a40a6550 msgr2=0x7f70a40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:35.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.090+0000 7f70aa057700 1 -- 172.21.15.26:0/3743888403 shutdown_connections 2023-10-01T07:58:35.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.090+0000 7f70aa057700 1 -- 172.21.15.26:0/3743888403 wait complete. 2023-10-01T07:58:35.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.091+0000 7f70aa057700 1 Processor -- start 2023-10-01T07:58:35.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.092+0000 7f70aa057700 1 -- start start 2023-10-01T07:58:35.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.092+0000 7f70aa057700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70a40a0a30 0x7f70a411e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:35.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.092+0000 7f70aa057700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f70a40a1510 0x7f70a411ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:35.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.092+0000 7f70aa057700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70a4139250 0x7f70a411f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:35.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.092+0000 7f70aa057700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a40a0220 con 0x7f70a4139250 2023-10-01T07:58:35.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.092+0000 7f70aa057700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a41204b0 con 0x7f70a40a0a30 2023-10-01T07:58:35.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.092+0000 7f70aa057700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70a409c9e0 con 0x7f70a40a1510 2023-10-01T07:58:35.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.092+0000 7f70a37fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70a40a0a30 0x7f70a411e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:35.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.092+0000 7f70a37fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70a40a0a30 0x7f70a411e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51946/0 (socket says 172.21.15.26:51946) 2023-10-01T07:58:35.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.092+0000 7f70a37fe700 1 -- 172.21.15.26:0/4126128376 learned_addr learned my addr 172.21.15.26:0/4126128376 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:35.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.093+0000 7f70a3fff700 1 --2- 172.21.15.26:0/4126128376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70a4139250 0x7f70a411f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:35.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.093+0000 7f70a2ffd700 1 --2- 172.21.15.26:0/4126128376 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f70a40a1510 0x7f70a411ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:35.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.093+0000 7f70a3fff700 1 -- 172.21.15.26:0/4126128376 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f70a40a1510 msgr2=0x7f70a411ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:35.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.093+0000 7f70a3fff700 1 --2- 172.21.15.26:0/4126128376 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f70a40a1510 0x7f70a411ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:35.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.093+0000 7f70a3fff700 1 -- 172.21.15.26:0/4126128376 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70a40a0a30 msgr2=0x7f70a411e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:35.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.093+0000 7f70a3fff700 1 --2- 172.21.15.26:0/4126128376 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70a40a0a30 0x7f70a411e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:35.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.093+0000 7f70a3fff700 1 -- 172.21.15.26:0/4126128376 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70980094a0 con 0x7f70a4139250 2023-10-01T07:58:35.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.093+0000 7f70a37fe700 1 --2- 172.21.15.26:0/4126128376 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70a40a0a30 0x7f70a411e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:35.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.093+0000 7f70a3fff700 1 --2- 172.21.15.26:0/4126128376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70a4139250 0x7f70a411f210 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f709c015000 tx=0x7f709c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:35.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.093+0000 7f708bfff700 1 -- 172.21.15.26:0/4126128376 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709c004540 con 0x7f70a4139250 2023-10-01T07:58:35.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.094+0000 7f708bfff700 1 -- 172.21.15.26:0/4126128376 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709c004700 con 0x7f70a4139250 2023-10-01T07:58:35.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.094+0000 7f70aa057700 1 -- 172.21.15.26:0/4126128376 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f709c009a70 con 0x7f70a4139250 2023-10-01T07:58:35.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.094+0000 7f708bfff700 1 -- 172.21.15.26:0/4126128376 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709c012430 con 0x7f70a4139250 2023-10-01T07:58:35.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.094+0000 7f70aa057700 1 -- 172.21.15.26:0/4126128376 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a4122a40 con 0x7f70a4139250 2023-10-01T07:58:35.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.095+0000 7f708bfff700 1 -- 172.21.15.26:0/4126128376 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f709c012590 con 0x7f70a4139250 2023-10-01T07:58:35.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.095+0000 7f70aa057700 1 -- 172.21.15.26:0/4126128376 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70a4074ea0 con 0x7f70a4139250 2023-10-01T07:58:35.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.095+0000 7f708bfff700 1 -- 172.21.15.26:0/4126128376 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f709c041a50 con 0x7f70a4139250 2023-10-01T07:58:35.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.100+0000 7f708bfff700 1 -- 172.21.15.26:0/4126128376 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f709c0093b0 con 0x7f70a4139250 2023-10-01T07:58:35.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.132+0000 7f1f76acd700 1 Processor -- start 2023-10-01T07:58:35.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.132+0000 7f1f76acd700 1 -- start start 2023-10-01T07:58:35.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.133+0000 7f1f76acd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1f7009e930 0x7f1f7009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:35.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.133+0000 7f1f76acd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1f7009f240 0x7f1f701317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:35.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.133+0000 7f1f76acd700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f70070940 con 0x7f1f7009f650 2023-10-01T07:58:35.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.133+0000 7f1f76acd700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f7006fd60 con 0x7f1f7009f240 2023-10-01T07:58:35.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.133+0000 7f1f76acd700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7006fa80 con 0x7f1f7009e930 2023-10-01T07:58:35.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.133+0000 7f1f74869700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1f7009e930 0x7f1f7009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:35.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.133+0000 7f1f6ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1f7009f240 0x7f1f701317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:35.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.133+0000 7f1f7506a700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1f7009f650 0x7f1f70131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:32900/0 (socket says 172.21.15.26:32900) 2023-10-01T07:58:35.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.133+0000 7f1f7506a700 1 -- 172.21.15.26:0/3917623623 learned_addr learned my addr 172.21.15.26:0/3917623623 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:35.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.133+0000 7f1f74869700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1f7009e930 0x7f1f7009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39052/0 (socket says 172.21.15.26:39052) 2023-10-01T07:58:35.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.133+0000 7f1f74869700 1 -- 172.21.15.26:0/3917623623 >> v2:172.21.15.26:3300/0 conn(0x7f1f7009f240 msgr2=0x7f1f701317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:35.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.133+0000 7f1f74869700 1 --2- 172.21.15.26:0/3917623623 >> v2:172.21.15.26:3300/0 conn(0x7f1f7009f240 0x7f1f701317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:35.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.133+0000 7f1f74869700 1 -- 172.21.15.26:0/3917623623 >> v1:172.21.15.26:6789/0 conn(0x7f1f7009f650 legacy=0x7f1f70131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:35.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.133+0000 7f1f74869700 1 -- 172.21.15.26:0/3917623623 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f7009fb60 con 0x7f1f7009e930 2023-10-01T07:58:35.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.134+0000 7f1f74869700 1 --2- 172.21.15.26:0/3917623623 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1f7009e930 0x7f1f7009ed00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1f64009840 tx=0x7f1f64009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9b8afc61158e31c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:35.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.134+0000 7f1f6f7fe700 1 -- 172.21.15.26:0/3917623623 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f64004230 con 0x7f1f7009e930 2023-10-01T07:58:35.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.134+0000 7f1f6f7fe700 1 -- 172.21.15.26:0/3917623623 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f64004390 con 0x7f1f7009e930 2023-10-01T07:58:35.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.134+0000 7f1f6f7fe700 1 -- 172.21.15.26:0/3917623623 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f640036a0 con 0x7f1f7009e930 2023-10-01T07:58:35.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.134+0000 7f1f76acd700 1 -- 172.21.15.26:0/3917623623 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1f7009e930 msgr2=0x7f1f7009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:35.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.135+0000 7f1f76acd700 1 --2- 172.21.15.26:0/3917623623 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1f7009e930 0x7f1f7009ed00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1f64009840 tx=0x7f1f64009b50 comp rx=0 tx=0).stop 2023-10-01T07:58:35.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.135+0000 7f1f76acd700 1 -- 172.21.15.26:0/3917623623 shutdown_connections 2023-10-01T07:58:35.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.135+0000 7f1f76acd700 1 --2- 172.21.15.26:0/3917623623 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1f7009e930 0x7f1f7009ed00 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:35.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.135+0000 7f1f76acd700 1 --2- 172.21.15.26:0/3917623623 >> v2:172.21.15.26:3300/0 conn(0x7f1f7009f240 0x7f1f701317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:35.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.135+0000 7f1f76acd700 1 -- 172.21.15.26:0/3917623623 >> 172.21.15.26:0/3917623623 conn(0x7f1f700a4210 msgr2=0x7f1f700a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:35.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.135+0000 7f1f76acd700 1 -- 172.21.15.26:0/3917623623 shutdown_connections 2023-10-01T07:58:35.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.135+0000 7f1f76acd700 1 -- 172.21.15.26:0/3917623623 wait complete. 2023-10-01T07:58:35.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.136+0000 7f1f76acd700 1 Processor -- start 2023-10-01T07:58:35.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.136+0000 7f1f76acd700 1 -- start start 2023-10-01T07:58:35.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.136+0000 7f1f76acd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f7009e930 0x7f1f70120460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:35.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.136+0000 7f1f76acd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1f7009f240 0x7f1f701209a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:35.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.136+0000 7f1f76acd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1f7009f650 0x7f1f70120ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:35.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.136+0000 7f1f76acd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f700a30d0 con 0x7f1f7009e930 2023-10-01T07:58:35.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.136+0000 7f1f76acd700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f70071d20 con 0x7f1f7009f240 2023-10-01T07:58:35.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.136+0000 7f1f76acd700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f70122d60 con 0x7f1f7009f650 2023-10-01T07:58:35.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.137+0000 7f1f74869700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f7009e930 0x7f1f70120460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:35.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.137+0000 7f1f74869700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f7009e930 0x7f1f70120460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52278/0 (socket says 172.21.15.26:52278) 2023-10-01T07:58:35.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.137+0000 7f1f74869700 1 -- 172.21.15.26:0/2925208714 learned_addr learned my addr 172.21.15.26:0/2925208714 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:35.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.137+0000 7f1f6ffff700 1 --2- 172.21.15.26:0/2925208714 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1f7009f240 0x7f1f701209a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:35.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.137+0000 7f1f7506a700 1 --2- 172.21.15.26:0/2925208714 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1f7009f650 0x7f1f70120ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:35.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.137+0000 7f1f74869700 1 -- 172.21.15.26:0/2925208714 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1f7009f650 msgr2=0x7f1f70120ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:35.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.137+0000 7f1f74869700 1 --2- 172.21.15.26:0/2925208714 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1f7009f650 0x7f1f70120ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:35.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.137+0000 7f1f74869700 1 -- 172.21.15.26:0/2925208714 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1f7009f240 msgr2=0x7f1f701209a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:35.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.137+0000 7f1f74869700 1 --2- 172.21.15.26:0/2925208714 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1f7009f240 0x7f1f701209a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:35.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.137+0000 7f1f74869700 1 -- 172.21.15.26:0/2925208714 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f640094a0 con 0x7f1f7009e930 2023-10-01T07:58:35.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.137+0000 7f1f74869700 1 --2- 172.21.15.26:0/2925208714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f7009e930 0x7f1f70120460 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f1f64000c00 tx=0x7f1f64004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:35.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.138+0000 7f1f6d7fa700 1 -- 172.21.15.26:0/2925208714 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f64003cb0 con 0x7f1f7009e930 2023-10-01T07:58:35.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.138+0000 7f1f6d7fa700 1 -- 172.21.15.26:0/2925208714 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f64003e10 con 0x7f1f7009e930 2023-10-01T07:58:35.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.138+0000 7f1f76acd700 1 -- 172.21.15.26:0/2925208714 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f700a0190 con 0x7f1f7009e930 2023-10-01T07:58:35.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.138+0000 7f1f6d7fa700 1 -- 172.21.15.26:0/2925208714 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f64011870 con 0x7f1f7009e930 2023-10-01T07:58:35.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.138+0000 7f1f76acd700 1 -- 172.21.15.26:0/2925208714 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f70123b70 con 0x7f1f7009e930 2023-10-01T07:58:35.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.139+0000 7f1f76acd700 1 -- 172.21.15.26:0/2925208714 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f70074ea0 con 0x7f1f7009e930 2023-10-01T07:58:35.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.139+0000 7f1f6d7fa700 1 -- 172.21.15.26:0/2925208714 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1f64018040 con 0x7f1f7009e930 2023-10-01T07:58:35.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.139+0000 7f1f6d7fa700 1 -- 172.21.15.26:0/2925208714 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1f6403ffe0 con 0x7f1f7009e930 2023-10-01T07:58:35.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.141+0000 7fd31d241700 1 Processor -- start 2023-10-01T07:58:35.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.141+0000 7fd31d241700 1 -- start start 2023-10-01T07:58:35.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.142+0000 7fd31d241700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd31809d6f0 0x7fd31809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:35.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.142+0000 7fd31d241700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd31809e000 0x7fd3181339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:35.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.142+0000 7fd31d241700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd31809b120 con 0x7fd31809e410 2023-10-01T07:58:35.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.142+0000 7fd31d241700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd31806b460 con 0x7fd31809d6f0 2023-10-01T07:58:35.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.142+0000 7fd31d241700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd31809a7e0 con 0x7fd31809e000 2023-10-01T07:58:35.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.142+0000 7fd316d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd31809d6f0 0x7fd31809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:35.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.142+0000 7fd316d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd31809d6f0 0x7fd31809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51964/0 (socket says 172.21.15.26:51964) 2023-10-01T07:58:35.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.142+0000 7fd316d9d700 1 -- 172.21.15.26:0/1452122267 learned_addr learned my addr 172.21.15.26:0/1452122267 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:35.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.143+0000 7fd316d9d700 1 -- 172.21.15.26:0/1452122267 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd31809e000 msgr2=0x7fd3181339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:35.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.143+0000 7fd316d9d700 1 --2- 172.21.15.26:0/1452122267 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd31809e000 0x7fd3181339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:35.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.143+0000 7fd316d9d700 1 -- 172.21.15.26:0/1452122267 >> v1:172.21.15.26:6789/0 conn(0x7fd31809e410 legacy=0x7fd318133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:35.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.143+0000 7fd316d9d700 1 -- 172.21.15.26:0/1452122267 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd31809a500 con 0x7fd31809d6f0 2023-10-01T07:58:35.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.143+0000 7fd316d9d700 1 --2- 172.21.15.26:0/1452122267 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd31809d6f0 0x7fd31809dac0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fd308009920 tx=0x7fd308009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c65aee01de16ece2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:35.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.143+0000 7fd315d9b700 1 -- 172.21.15.26:0/1452122267 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30800ba60 con 0x7fd31809d6f0 2023-10-01T07:58:35.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.143+0000 7fd315d9b700 1 -- 172.21.15.26:0/1452122267 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30800bbc0 con 0x7fd31809d6f0 2023-10-01T07:58:35.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.143+0000 7fd315d9b700 1 -- 172.21.15.26:0/1452122267 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd308009e70 con 0x7fd31809d6f0 2023-10-01T07:58:35.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.144+0000 7fd31d241700 1 -- 172.21.15.26:0/1452122267 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd31809d6f0 msgr2=0x7fd31809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:35.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.144+0000 7fd31d241700 1 --2- 172.21.15.26:0/1452122267 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd31809d6f0 0x7fd31809dac0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fd308009920 tx=0x7fd308009c30 comp rx=0 tx=0).stop 2023-10-01T07:58:35.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.144+0000 7fd31d241700 1 -- 172.21.15.26:0/1452122267 shutdown_connections 2023-10-01T07:58:35.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.144+0000 7fd31d241700 1 --2- 172.21.15.26:0/1452122267 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd31809d6f0 0x7fd31809dac0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:35.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.144+0000 7fd31d241700 1 --2- 172.21.15.26:0/1452122267 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd31809e000 0x7fd3181339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:35.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.144+0000 7fd31d241700 1 -- 172.21.15.26:0/1452122267 >> 172.21.15.26:0/1452122267 conn(0x7fd318066f50 msgr2=0x7fd31809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:35.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.144+0000 7fd31d241700 1 -- 172.21.15.26:0/1452122267 shutdown_connections 2023-10-01T07:58:35.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.144+0000 7fd31d241700 1 -- 172.21.15.26:0/1452122267 wait complete. 2023-10-01T07:58:35.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.145+0000 7f1f6d7fa700 1 -- 172.21.15.26:0/2925208714 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f6401a400 con 0x7f1f7009e930 2023-10-01T07:58:35.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.145+0000 7fd31d241700 1 Processor -- start 2023-10-01T07:58:35.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.146+0000 7fd31d241700 1 -- start start 2023-10-01T07:58:35.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.146+0000 7fd31d241700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd31809d6f0 0x7fd318126300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:35.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.146+0000 7fd31d241700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd31809e000 0x7fd318126840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:35.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.146+0000 7fd31d241700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd31809e410 0x7fd318126d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:35.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.146+0000 7fd31d241700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd318129d20 con 0x7fd31809e000 2023-10-01T07:58:35.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.146+0000 7fd31d241700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3180a2ff0 con 0x7fd31809e410 2023-10-01T07:58:35.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.146+0000 7fd31d241700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd31812a930 con 0x7fd31809d6f0 2023-10-01T07:58:35.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.146+0000 7fd31759e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd31809e410 0x7fd318126d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:35.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.146+0000 7fd31759e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd31809e410 0x7fd318126d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51968/0 (socket says 172.21.15.26:51968) 2023-10-01T07:58:35.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.146+0000 7fd31759e700 1 -- 172.21.15.26:0/4057638430 learned_addr learned my addr 172.21.15.26:0/4057638430 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:35.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.146+0000 7fd31659c700 1 --2- 172.21.15.26:0/4057638430 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd31809e000 0x7fd318126840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:35.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.146+0000 7fd316d9d700 1 --2- 172.21.15.26:0/4057638430 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd31809d6f0 0x7fd318126300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:35.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.146+0000 7fd31759e700 1 -- 172.21.15.26:0/4057638430 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd31809d6f0 msgr2=0x7fd318126300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:35.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.147+0000 7fd31759e700 1 --2- 172.21.15.26:0/4057638430 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd31809d6f0 0x7fd318126300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:35.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.147+0000 7fd31759e700 1 -- 172.21.15.26:0/4057638430 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd31809e000 msgr2=0x7fd318126840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:35.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.147+0000 7fd31759e700 1 --2- 172.21.15.26:0/4057638430 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd31809e000 0x7fd318126840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:35.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.147+0000 7fd31759e700 1 -- 172.21.15.26:0/4057638430 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd308009550 con 0x7fd31809e410 2023-10-01T07:58:35.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.147+0000 7fd316d9d700 1 --2- 172.21.15.26:0/4057638430 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd31809d6f0 0x7fd318126300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:58:35.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.147+0000 7fd31759e700 1 --2- 172.21.15.26:0/4057638430 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd31809e410 0x7fd318126d80 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fd31000cbc0 tx=0x7fd31000ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:35.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.147+0000 7fd2ff7fe700 1 -- 172.21.15.26:0/4057638430 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd310003c00 con 0x7fd31809e410 2023-10-01T07:58:35.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.147+0000 7fd2ff7fe700 1 -- 172.21.15.26:0/4057638430 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd310003d60 con 0x7fd31809e410 2023-10-01T07:58:35.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.147+0000 7fd2ff7fe700 1 -- 172.21.15.26:0/4057638430 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31000ab20 con 0x7fd31809e410 2023-10-01T07:58:35.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.147+0000 7fd31d241700 1 -- 172.21.15.26:0/4057638430 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd31809c710 con 0x7fd31809e410 2023-10-01T07:58:35.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.147+0000 7fd31d241700 1 -- 172.21.15.26:0/4057638430 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd31812a360 con 0x7fd31809e410 2023-10-01T07:58:35.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.148+0000 7fd31d241700 1 -- 172.21.15.26:0/4057638430 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd318129810 con 0x7fd31809e410 2023-10-01T07:58:35.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.149+0000 7fd2ff7fe700 1 -- 172.21.15.26:0/4057638430 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd31000ac80 con 0x7fd31809e410 2023-10-01T07:58:35.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.149+0000 7fd2ff7fe700 1 -- 172.21.15.26:0/4057638430 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd31003f920 con 0x7fd31809e410 2023-10-01T07:58:35.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.158+0000 7fd2ff7fe700 1 -- 172.21.15.26:0/4057638430 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd310012e60 con 0x7fd31809e410 2023-10-01T07:58:35.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.278+0000 7f34aa0b7700 1 -- 172.21.15.26:0/495086070 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f34a406c360 con 0x7f34a409d6f0 2023-10-01T07:58:35.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.279+0000 7f348bfff700 1 -- 172.21.15.26:0/495086070 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3494017020 con 0x7f34a409d6f0 2023-10-01T07:58:35.280 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:35.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.281+0000 7f34aa0b7700 1 -- 172.21.15.26:0/495086070 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f34a409d6f0 msgr2=0x7f34a4122370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:35.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.281+0000 7f34aa0b7700 1 --2- 172.21.15.26:0/495086070 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f34a409d6f0 0x7f34a4122370 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f349400e9b0 tx=0x7f349400ecc0 comp rx=0 tx=0).stop 2023-10-01T07:58:35.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.281+0000 7f34aa0b7700 1 -- 172.21.15.26:0/495086070 shutdown_connections 2023-10-01T07:58:35.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.281+0000 7f34aa0b7700 1 --2- 172.21.15.26:0/495086070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34a409e410 0x7f34a4122df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:35.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.281+0000 7f34aa0b7700 1 --2- 172.21.15.26:0/495086070 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f34a409d6f0 0x7f34a4122370 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:35.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.281+0000 7f34aa0b7700 1 --2- 172.21.15.26:0/495086070 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f34a409e000 0x7f34a41228b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:35.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.281+0000 7f34aa0b7700 1 -- 172.21.15.26:0/495086070 >> 172.21.15.26:0/495086070 conn(0x7f34a4066f50 msgr2=0x7f34a4071050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:35.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.281+0000 7f34aa0b7700 1 -- 172.21.15.26:0/495086070 shutdown_connections 2023-10-01T07:58:35.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.281+0000 7f34aa0b7700 1 -- 172.21.15.26:0/495086070 wait complete. 2023-10-01T07:58:35.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:35.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.318+0000 7f70aa057700 1 -- 172.21.15.26:0/4126128376 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f70a40a28c0 con 0x7f70a4139250 2023-10-01T07:58:35.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.318+0000 7f708bfff700 1 -- 172.21.15.26:0/4126128376 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f709c01b3d0 con 0x7f70a4139250 2023-10-01T07:58:35.319 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:35.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.320+0000 7f70aa057700 1 -- 172.21.15.26:0/4126128376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70a4139250 msgr2=0x7f70a411f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:35.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.320+0000 7f70aa057700 1 --2- 172.21.15.26:0/4126128376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70a4139250 0x7f70a411f210 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f709c015000 tx=0x7f709c004ad0 comp rx=0 tx=0).stop 2023-10-01T07:58:35.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.320+0000 7f70aa057700 1 -- 172.21.15.26:0/4126128376 shutdown_connections 2023-10-01T07:58:35.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.320+0000 7f70aa057700 1 --2- 172.21.15.26:0/4126128376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70a4139250 0x7f70a411f210 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:35.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.320+0000 7f70aa057700 1 --2- 172.21.15.26:0/4126128376 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70a40a0a30 0x7f70a411e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:35.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.320+0000 7f70aa057700 1 --2- 172.21.15.26:0/4126128376 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f70a40a1510 0x7f70a411ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:35.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.320+0000 7f70aa057700 1 -- 172.21.15.26:0/4126128376 >> 172.21.15.26:0/4126128376 conn(0x7f70a40a6550 msgr2=0x7f70a40a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:35.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.321+0000 7f70aa057700 1 -- 172.21.15.26:0/4126128376 shutdown_connections 2023-10-01T07:58:35.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.321+0000 7f70aa057700 1 -- 172.21.15.26:0/4126128376 wait complete. 2023-10-01T07:58:35.335 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:35.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.355+0000 7f1f76acd700 1 -- 172.21.15.26:0/2925208714 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1f7006b250 con 0x7f1f7009e930 2023-10-01T07:58:35.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.356+0000 7f1f6d7fa700 1 -- 172.21.15.26:0/2925208714 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1f64016030 con 0x7f1f7009e930 2023-10-01T07:58:35.356 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:35.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.358+0000 7f1f76acd700 1 -- 172.21.15.26:0/2925208714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f7009e930 msgr2=0x7f1f70120460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:35.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.358+0000 7f1f76acd700 1 --2- 172.21.15.26:0/2925208714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f7009e930 0x7f1f70120460 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f1f64000c00 tx=0x7f1f64004750 comp rx=0 tx=0).stop 2023-10-01T07:58:35.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.358+0000 7f1f76acd700 1 -- 172.21.15.26:0/2925208714 shutdown_connections 2023-10-01T07:58:35.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.358+0000 7f1f76acd700 1 --2- 172.21.15.26:0/2925208714 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1f7009f650 0x7f1f70120ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:35.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.358+0000 7f1f76acd700 1 --2- 172.21.15.26:0/2925208714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f7009e930 0x7f1f70120460 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:35.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.358+0000 7f1f76acd700 1 --2- 172.21.15.26:0/2925208714 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1f7009f240 0x7f1f701209a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:35.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.358+0000 7f1f76acd700 1 -- 172.21.15.26:0/2925208714 >> 172.21.15.26:0/2925208714 conn(0x7f1f700a4210 msgr2=0x7f1f7009bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:35.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.358+0000 7f1f76acd700 1 -- 172.21.15.26:0/2925208714 shutdown_connections 2023-10-01T07:58:35.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.358+0000 7f1f76acd700 1 -- 172.21.15.26:0/2925208714 wait complete. 2023-10-01T07:58:35.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.368+0000 7fd31d241700 1 -- 172.21.15.26:0/4057638430 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd318074ea0 con 0x7fd31809e410 2023-10-01T07:58:35.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.369+0000 7fd2ff7fe700 1 -- 172.21.15.26:0/4057638430 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd31001a360 con 0x7fd31809e410 2023-10-01T07:58:35.370 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:35.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.371+0000 7fd31d241700 1 -- 172.21.15.26:0/4057638430 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd31809e410 msgr2=0x7fd318126d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:35.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.371+0000 7fd31d241700 1 --2- 172.21.15.26:0/4057638430 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd31809e410 0x7fd318126d80 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fd31000cbc0 tx=0x7fd31000ced0 comp rx=0 tx=0).stop 2023-10-01T07:58:35.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.371+0000 7fd31d241700 1 -- 172.21.15.26:0/4057638430 shutdown_connections 2023-10-01T07:58:35.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.371+0000 7fd31d241700 1 --2- 172.21.15.26:0/4057638430 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd31809e410 0x7fd318126d80 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:35.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.371+0000 7fd31d241700 1 --2- 172.21.15.26:0/4057638430 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd31809d6f0 0x7fd318126300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:35.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.371+0000 7fd31d241700 1 --2- 172.21.15.26:0/4057638430 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd31809e000 0x7fd318126840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:35.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.371+0000 7fd31d241700 1 -- 172.21.15.26:0/4057638430 >> 172.21.15.26:0/4057638430 conn(0x7fd318066f50 msgr2=0x7fd318071770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:35.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.371+0000 7fd31d241700 1 -- 172.21.15.26:0/4057638430 shutdown_connections 2023-10-01T07:58:35.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:35.371+0000 7fd31d241700 1 -- 172.21.15.26:0/4057638430 wait complete. 2023-10-01T07:58:35.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:35.385 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:36.297 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:36.336 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:36.375 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:36.385 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:36.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.448+0000 7f3992892700 1 Processor -- start 2023-10-01T07:58:36.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.448+0000 7f3992892700 1 -- start start 2023-10-01T07:58:36.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.449+0000 7f3992892700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f398c09f410 0x7f398c136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:36.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.449+0000 7f3992892700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f398c136fe0 0x7f398c1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:36.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.449+0000 7f3992892700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398c070940 con 0x7f398c09e930 2023-10-01T07:58:36.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.449+0000 7f3992892700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f398c06fd60 con 0x7f398c136fe0 2023-10-01T07:58:36.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.449+0000 7f3992892700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f398c06fa80 con 0x7f398c09f410 2023-10-01T07:58:36.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.449+0000 7f398b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f398c09f410 0x7f398c136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:36.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.449+0000 7f398b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f398c09f410 0x7f398c136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39112/0 (socket says 172.21.15.26:39112) 2023-10-01T07:58:36.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.449+0000 7f398b7fe700 1 -- 172.21.15.26:0/1673983545 learned_addr learned my addr 172.21.15.26:0/1673983545 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:36.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.449+0000 7f3990e2f700 1 --2- 172.21.15.26:0/1673983545 >> v2:172.21.15.26:3300/0 conn(0x7f398c136fe0 0x7f398c1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:36.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.449+0000 7f398b7fe700 1 -- 172.21.15.26:0/1673983545 >> v2:172.21.15.26:3300/0 conn(0x7f398c136fe0 msgr2=0x7f398c1393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:36.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.449+0000 7f398b7fe700 1 --2- 172.21.15.26:0/1673983545 >> v2:172.21.15.26:3300/0 conn(0x7f398c136fe0 0x7f398c1393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:36.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.449+0000 7f398b7fe700 1 -- 172.21.15.26:0/1673983545 >> v1:172.21.15.26:6789/0 conn(0x7f398c09e930 legacy=0x7f398c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:36.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.449+0000 7f398b7fe700 1 -- 172.21.15.26:0/1673983545 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c09fb60 con 0x7f398c09f410 2023-10-01T07:58:36.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.450+0000 7f3990e2f700 1 --2- 172.21.15.26:0/1673983545 >> v2:172.21.15.26:3300/0 conn(0x7f398c136fe0 0x7f398c1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:58:36.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.450+0000 7f398b7fe700 1 --2- 172.21.15.26:0/1673983545 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f398c09f410 0x7f398c136aa0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f39800098f0 tx=0x7f3980009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59cded6ed607d1cd server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:36.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.450+0000 7f398affd700 1 -- 172.21.15.26:0/1673983545 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3980004230 con 0x7f398c09f410 2023-10-01T07:58:36.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.450+0000 7f398affd700 1 -- 172.21.15.26:0/1673983545 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3980004390 con 0x7f398c09f410 2023-10-01T07:58:36.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.450+0000 7f398affd700 1 -- 172.21.15.26:0/1673983545 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39800036a0 con 0x7f398c09f410 2023-10-01T07:58:36.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.451+0000 7f3992892700 1 -- 172.21.15.26:0/1673983545 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f398c09f410 msgr2=0x7f398c136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:36.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.451+0000 7f3992892700 1 --2- 172.21.15.26:0/1673983545 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f398c09f410 0x7f398c136aa0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f39800098f0 tx=0x7f3980009c00 comp rx=0 tx=0).stop 2023-10-01T07:58:36.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.451+0000 7f3992892700 1 -- 172.21.15.26:0/1673983545 shutdown_connections 2023-10-01T07:58:36.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.451+0000 7f3992892700 1 --2- 172.21.15.26:0/1673983545 >> v2:172.21.15.26:3300/0 conn(0x7f398c136fe0 0x7f398c1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:36.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.451+0000 7f3992892700 1 --2- 172.21.15.26:0/1673983545 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f398c09f410 0x7f398c136aa0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:36.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.451+0000 7f3992892700 1 -- 172.21.15.26:0/1673983545 >> 172.21.15.26:0/1673983545 conn(0x7f398c0a4210 msgr2=0x7f398c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:36.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.451+0000 7f3992892700 1 -- 172.21.15.26:0/1673983545 shutdown_connections 2023-10-01T07:58:36.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.451+0000 7f3992892700 1 -- 172.21.15.26:0/1673983545 wait complete. 2023-10-01T07:58:36.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.453+0000 7f3992892700 1 Processor -- start 2023-10-01T07:58:36.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.453+0000 7f3992892700 1 -- start start 2023-10-01T07:58:36.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.454+0000 7f3992892700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f398c09e930 0x7f398c06c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:36.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.454+0000 7f3992892700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f398c09f410 0x7f398c06c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:36.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.454+0000 7f3992892700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f398c136fe0 0x7f398c1c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:36.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.454+0000 7f3992892700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c06d420 con 0x7f398c09e930 2023-10-01T07:58:36.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.454+0000 7f3992892700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398c1323c0 con 0x7f398c136fe0 2023-10-01T07:58:36.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.454+0000 7f3992892700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f398c1220c0 con 0x7f398c09f410 2023-10-01T07:58:36.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.454+0000 7f398bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f398c09e930 0x7f398c06c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:36.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.454+0000 7f3990e2f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f398c136fe0 0x7f398c1c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:36.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.454+0000 7f398bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f398c09e930 0x7f398c06c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52306/0 (socket says 172.21.15.26:52306) 2023-10-01T07:58:36.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.454+0000 7f398bfff700 1 -- 172.21.15.26:0/2915634824 learned_addr learned my addr 172.21.15.26:0/2915634824 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:36.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.454+0000 7f3990e2f700 1 -- 172.21.15.26:0/2915634824 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f398c09f410 msgr2=0x7f398c06c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:36.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.454+0000 7f3990e2f700 1 --2- 172.21.15.26:0/2915634824 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f398c09f410 0x7f398c06c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:36.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.454+0000 7f3990e2f700 1 -- 172.21.15.26:0/2915634824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f398c09e930 msgr2=0x7f398c06c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:36.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.454+0000 7f3990e2f700 1 --2- 172.21.15.26:0/2915634824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f398c09e930 0x7f398c06c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:36.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.454+0000 7f3990e2f700 1 -- 172.21.15.26:0/2915634824 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3980009550 con 0x7f398c136fe0 2023-10-01T07:58:36.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.454+0000 7f398bfff700 1 --2- 172.21.15.26:0/2915634824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f398c09e930 0x7f398c06c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:36.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.455+0000 7f3990e2f700 1 --2- 172.21.15.26:0/2915634824 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f398c136fe0 0x7f398c1c8260 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3984007e60 tx=0x7f398400d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:36.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.455+0000 7f3988ff9700 1 -- 172.21.15.26:0/2915634824 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398400ddd0 con 0x7f398c136fe0 2023-10-01T07:58:36.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.455+0000 7f3988ff9700 1 -- 172.21.15.26:0/2915634824 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398400f040 con 0x7f398c136fe0 2023-10-01T07:58:36.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.455+0000 7f3992892700 1 -- 172.21.15.26:0/2915634824 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f398c0a2f40 con 0x7f398c136fe0 2023-10-01T07:58:36.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.455+0000 7f3988ff9700 1 -- 172.21.15.26:0/2915634824 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3984015640 con 0x7f398c136fe0 2023-10-01T07:58:36.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.455+0000 7f3992892700 1 -- 172.21.15.26:0/2915634824 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f398c06cbb0 con 0x7f398c136fe0 2023-10-01T07:58:36.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.456+0000 7f3988ff9700 1 -- 172.21.15.26:0/2915634824 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f39840157a0 con 0x7f398c136fe0 2023-10-01T07:58:36.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.456+0000 7f3988ff9700 1 -- 172.21.15.26:0/2915634824 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f398403f7d0 con 0x7f398c136fe0 2023-10-01T07:58:36.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.456+0000 7f3992892700 1 -- 172.21.15.26:0/2915634824 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f398c121cf0 con 0x7f398c136fe0 2023-10-01T07:58:36.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.466+0000 7f3988ff9700 1 -- 172.21.15.26:0/2915634824 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f398401a020 con 0x7f398c136fe0 2023-10-01T07:58:36.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.488+0000 7fc762e68700 1 Processor -- start 2023-10-01T07:58:36.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.488+0000 7fc762e68700 1 -- start start 2023-10-01T07:58:36.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.489+0000 7fc762e68700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc75c1316c0 0x7fc75c131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:36.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.489+0000 7fc762e68700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc75c09d9f0 0x7fc75c06a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:36.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.489+0000 7fc762e68700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc75c09e130 con 0x7fc75c06acb0 2023-10-01T07:58:36.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.489+0000 7fc762e68700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc75c1312b0 con 0x7fc75c09d9f0 2023-10-01T07:58:36.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.489+0000 7fc762e68700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c09f6e0 con 0x7fc75c1316c0 2023-10-01T07:58:36.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.489+0000 7fc761405700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc75c06acb0 0x7fc75c138540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:32926/0 (socket says 172.21.15.26:32926) 2023-10-01T07:58:36.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.490+0000 7fc761405700 1 -- 172.21.15.26:0/3759047005 learned_addr learned my addr 172.21.15.26:0/3759047005 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:36.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.490+0000 7fc760c04700 1 --2- 172.21.15.26:0/3759047005 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc75c1316c0 0x7fc75c131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:36.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.490+0000 7fc75bfff700 1 --2- 172.21.15.26:0/3759047005 >> v2:172.21.15.26:3300/0 conn(0x7fc75c09d9f0 0x7fc75c06a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:36.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.490+0000 7fc75b7fe700 1 -- 172.21.15.26:0/3759047005 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2609739509 0 0) 0x7fc754001490 con 0x7fc75c06acb0 2023-10-01T07:58:36.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.490+0000 7fc75b7fe700 1 -- 172.21.15.26:0/3759047005 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc74c0035b0 con 0x7fc75c06acb0 2023-10-01T07:58:36.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.490+0000 7fc760c04700 1 -- 172.21.15.26:0/3759047005 >> v2:172.21.15.26:3300/0 conn(0x7fc75c09d9f0 msgr2=0x7fc75c06a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:36.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.490+0000 7fc760c04700 1 --2- 172.21.15.26:0/3759047005 >> v2:172.21.15.26:3300/0 conn(0x7fc75c09d9f0 0x7fc75c06a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:36.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.490+0000 7fc760c04700 1 -- 172.21.15.26:0/3759047005 >> v1:172.21.15.26:6789/0 conn(0x7fc75c06acb0 legacy=0x7fc75c138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:36.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.490+0000 7fc760c04700 1 -- 172.21.15.26:0/3759047005 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75c09e760 con 0x7fc75c1316c0 2023-10-01T07:58:36.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.490+0000 7fc760c04700 1 --2- 172.21.15.26:0/3759047005 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc75c1316c0 0x7fc75c131a90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc750009840 tx=0x7fc750009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e98985b2e14a70d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:36.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.491+0000 7fc75b7fe700 1 -- 172.21.15.26:0/3759047005 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc750011830 con 0x7fc75c1316c0 2023-10-01T07:58:36.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.491+0000 7fc75b7fe700 1 -- 172.21.15.26:0/3759047005 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc750011990 con 0x7fc75c1316c0 2023-10-01T07:58:36.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.491+0000 7fc75b7fe700 1 -- 172.21.15.26:0/3759047005 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc750011d20 con 0x7fc75c1316c0 2023-10-01T07:58:36.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.491+0000 7fc762e68700 1 -- 172.21.15.26:0/3759047005 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc75c1316c0 msgr2=0x7fc75c131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:36.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.491+0000 7fc762e68700 1 --2- 172.21.15.26:0/3759047005 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc75c1316c0 0x7fc75c131a90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc750009840 tx=0x7fc750009b50 comp rx=0 tx=0).stop 2023-10-01T07:58:36.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.492+0000 7fc762e68700 1 -- 172.21.15.26:0/3759047005 shutdown_connections 2023-10-01T07:58:36.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.492+0000 7fc762e68700 1 --2- 172.21.15.26:0/3759047005 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc75c1316c0 0x7fc75c131a90 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:36.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.492+0000 7fc762e68700 1 --2- 172.21.15.26:0/3759047005 >> v2:172.21.15.26:3300/0 conn(0x7fc75c09d9f0 0x7fc75c06a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:36.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.492+0000 7fc762e68700 1 -- 172.21.15.26:0/3759047005 >> 172.21.15.26:0/3759047005 conn(0x7fc75c066f50 msgr2=0x7fc75c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:36.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.492+0000 7fc762e68700 1 -- 172.21.15.26:0/3759047005 shutdown_connections 2023-10-01T07:58:36.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.492+0000 7fc762e68700 1 -- 172.21.15.26:0/3759047005 wait complete. 2023-10-01T07:58:36.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.493+0000 7fc762e68700 1 Processor -- start 2023-10-01T07:58:36.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.493+0000 7fc762e68700 1 -- start start 2023-10-01T07:58:36.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.494+0000 7fc762e68700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc75c06acb0 0x7fc75c119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:36.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.494+0000 7fc762e68700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc75c09d9f0 0x7fc75c1199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:36.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.494+0000 7fc762e68700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc75c1316c0 0x7fc75c119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:36.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.494+0000 7fc762e68700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c11bbe0 con 0x7fc75c1316c0 2023-10-01T07:58:36.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.494+0000 7fc762e68700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c0a35d0 con 0x7fc75c06acb0 2023-10-01T07:58:36.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.494+0000 7fc762e68700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c12b900 con 0x7fc75c09d9f0 2023-10-01T07:58:36.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.494+0000 7fc760c04700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc75c06acb0 0x7fc75c119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:36.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.494+0000 7fc760c04700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc75c06acb0 0x7fc75c119480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51992/0 (socket says 172.21.15.26:51992) 2023-10-01T07:58:36.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.494+0000 7fc760c04700 1 -- 172.21.15.26:0/102308558 learned_addr learned my addr 172.21.15.26:0/102308558 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:36.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.494+0000 7fc761405700 1 --2- 172.21.15.26:0/102308558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc75c1316c0 0x7fc75c119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:36.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.495+0000 7fc761405700 1 -- 172.21.15.26:0/102308558 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc75c09d9f0 msgr2=0x7fc75c1199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:36.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.495+0000 7fc761405700 1 --2- 172.21.15.26:0/102308558 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc75c09d9f0 0x7fc75c1199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:36.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.495+0000 7fc761405700 1 -- 172.21.15.26:0/102308558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc75c06acb0 msgr2=0x7fc75c119480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:36.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.495+0000 7fc761405700 1 --2- 172.21.15.26:0/102308558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc75c06acb0 0x7fc75c119480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:36.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.495+0000 7fc761405700 1 -- 172.21.15.26:0/102308558 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7500094a0 con 0x7fc75c1316c0 2023-10-01T07:58:36.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.495+0000 7fc760c04700 1 --2- 172.21.15.26:0/102308558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc75c06acb0 0x7fc75c119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:36.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.495+0000 7fc761405700 1 --2- 172.21.15.26:0/102308558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc75c1316c0 0x7fc75c119f00 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fc75400caa0 tx=0x7fc75400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:36.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.495+0000 7fc7597fa700 1 -- 172.21.15.26:0/102308558 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75400aaa0 con 0x7fc75c1316c0 2023-10-01T07:58:36.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.495+0000 7fc7597fa700 1 -- 172.21.15.26:0/102308558 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75400ac00 con 0x7fc75c1316c0 2023-10-01T07:58:36.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.495+0000 7fc7597fa700 1 -- 172.21.15.26:0/102308558 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc754012400 con 0x7fc75c1316c0 2023-10-01T07:58:36.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.495+0000 7fc762e68700 1 -- 172.21.15.26:0/102308558 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc75c11a8d0 con 0x7fc75c1316c0 2023-10-01T07:58:36.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.495+0000 7fc762e68700 1 -- 172.21.15.26:0/102308558 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc75c11af20 con 0x7fc75c1316c0 2023-10-01T07:58:36.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.497+0000 7fc762e68700 1 -- 172.21.15.26:0/102308558 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc75c074ea0 con 0x7fc75c1316c0 2023-10-01T07:58:36.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.497+0000 7fc7597fa700 1 -- 172.21.15.26:0/102308558 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc7540113a0 con 0x7fc75c1316c0 2023-10-01T07:58:36.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.497+0000 7fc7597fa700 1 -- 172.21.15.26:0/102308558 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc75403f3d0 con 0x7fc75c1316c0 2023-10-01T07:58:36.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.506+0000 7fc7597fa700 1 -- 172.21.15.26:0/102308558 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc754018270 con 0x7fc75c1316c0 2023-10-01T07:58:36.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.538+0000 7fcb6b164700 1 Processor -- start 2023-10-01T07:58:36.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.538+0000 7fcb6b164700 1 -- start start 2023-10-01T07:58:36.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.539+0000 7fcb6b164700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcb64133a80 0x7fcb64133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:36.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.539+0000 7fcb6b164700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb6412ff20 0x7fcb64130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:36.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.539+0000 7fcb6b164700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb6406bc00 con 0x7fcb64130870 2023-10-01T07:58:36.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.539+0000 7fcb6b164700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb6406c570 con 0x7fcb64133a80 2023-10-01T07:58:36.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.539+0000 7fcb6b164700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb640a0040 con 0x7fcb6412ff20 2023-10-01T07:58:36.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.539+0000 7fcb63fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb6412ff20 0x7fcb64130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:36.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.539+0000 7fcb63fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb6412ff20 0x7fcb64130330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39142/0 (socket says 172.21.15.26:39142) 2023-10-01T07:58:36.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.539+0000 7fcb63fff700 1 -- 172.21.15.26:0/3843352052 learned_addr learned my addr 172.21.15.26:0/3843352052 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:36.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.539+0000 7fcb68f00700 1 --2- 172.21.15.26:0/3843352052 >> v2:172.21.15.26:3300/0 conn(0x7fcb64133a80 0x7fcb64133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:36.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.539+0000 7fcb63fff700 1 -- 172.21.15.26:0/3843352052 >> v2:172.21.15.26:3300/0 conn(0x7fcb64133a80 msgr2=0x7fcb64133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:36.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.539+0000 7fcb63fff700 1 --2- 172.21.15.26:0/3843352052 >> v2:172.21.15.26:3300/0 conn(0x7fcb64133a80 0x7fcb64133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:36.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.539+0000 7fcb63fff700 1 -- 172.21.15.26:0/3843352052 >> v1:172.21.15.26:6789/0 conn(0x7fcb64130870 legacy=0x7fcb6413a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:36.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.539+0000 7fcb63fff700 1 -- 172.21.15.26:0/3843352052 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb64133860 con 0x7fcb6412ff20 2023-10-01T07:58:36.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.540+0000 7fcb63fff700 1 --2- 172.21.15.26:0/3843352052 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb6412ff20 0x7fcb64130330 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fcb500098f0 tx=0x7fcb50009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=932a9553d4bb88c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:36.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.540+0000 7fcb637fe700 1 -- 172.21.15.26:0/3843352052 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb50011830 con 0x7fcb6412ff20 2023-10-01T07:58:36.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.540+0000 7fcb637fe700 1 -- 172.21.15.26:0/3843352052 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb50011990 con 0x7fcb6412ff20 2023-10-01T07:58:36.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.540+0000 7fcb637fe700 1 -- 172.21.15.26:0/3843352052 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb50011d20 con 0x7fcb6412ff20 2023-10-01T07:58:36.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.540+0000 7fcb6b164700 1 -- 172.21.15.26:0/3843352052 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb6412ff20 msgr2=0x7fcb64130330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:36.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.540+0000 7fcb6b164700 1 --2- 172.21.15.26:0/3843352052 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb6412ff20 0x7fcb64130330 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fcb500098f0 tx=0x7fcb50009c00 comp rx=0 tx=0).stop 2023-10-01T07:58:36.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.541+0000 7fcb6b164700 1 -- 172.21.15.26:0/3843352052 shutdown_connections 2023-10-01T07:58:36.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.541+0000 7fcb6b164700 1 --2- 172.21.15.26:0/3843352052 >> v2:172.21.15.26:3300/0 conn(0x7fcb64133a80 0x7fcb64133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:36.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.541+0000 7fcb6b164700 1 --2- 172.21.15.26:0/3843352052 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb6412ff20 0x7fcb64130330 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:36.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.541+0000 7fcb6b164700 1 -- 172.21.15.26:0/3843352052 >> 172.21.15.26:0/3843352052 conn(0x7fcb640a4210 msgr2=0x7fcb640a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:36.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.541+0000 7fcb6b164700 1 -- 172.21.15.26:0/3843352052 shutdown_connections 2023-10-01T07:58:36.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.541+0000 7fcb6b164700 1 -- 172.21.15.26:0/3843352052 wait complete. 2023-10-01T07:58:36.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.542+0000 7fcb6b164700 1 Processor -- start 2023-10-01T07:58:36.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.542+0000 7fcb6b164700 1 -- start start 2023-10-01T07:58:36.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.543+0000 7fcb6b164700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb6412ff20 0x7fcb6409c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:36.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.543+0000 7fcb6b164700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb64130870 0x7fcb6409cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:36.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.543+0000 7fcb6b164700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb64133a80 0x7fcb6409d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:36.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.543+0000 7fcb6b164700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb640a2150 con 0x7fcb64130870 2023-10-01T07:58:36.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.543+0000 7fcb6b164700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6412d2d0 con 0x7fcb64133a80 2023-10-01T07:58:36.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.543+0000 7fcb6b164700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb641202d0 con 0x7fcb6412ff20 2023-10-01T07:58:36.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.543+0000 7fcb68f00700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb6412ff20 0x7fcb6409c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:36.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.543+0000 7fcb68f00700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb6412ff20 0x7fcb6409c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39158/0 (socket says 172.21.15.26:39158) 2023-10-01T07:58:36.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.543+0000 7fcb68f00700 1 -- 172.21.15.26:0/486023364 learned_addr learned my addr 172.21.15.26:0/486023364 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:36.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.543+0000 7fcb69701700 1 --2- 172.21.15.26:0/486023364 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb64133a80 0x7fcb6409d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:36.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.544+0000 7fcb63fff700 1 --2- 172.21.15.26:0/486023364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb64130870 0x7fcb6409cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:36.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.544+0000 7fcb69701700 1 -- 172.21.15.26:0/486023364 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb6412ff20 msgr2=0x7fcb6409c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:36.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.544+0000 7fcb69701700 1 --2- 172.21.15.26:0/486023364 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb6412ff20 0x7fcb6409c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:36.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.544+0000 7fcb69701700 1 -- 172.21.15.26:0/486023364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb64130870 msgr2=0x7fcb6409cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:36.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.544+0000 7fcb69701700 1 --2- 172.21.15.26:0/486023364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb64130870 0x7fcb6409cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:36.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.544+0000 7fcb69701700 1 -- 172.21.15.26:0/486023364 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb50009550 con 0x7fcb64133a80 2023-10-01T07:58:36.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.544+0000 7fcb69701700 1 --2- 172.21.15.26:0/486023364 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb64133a80 0x7fcb6409d160 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c00cbc0 tx=0x7fcb5c00ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:36.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.544+0000 7fcb617fa700 1 -- 172.21.15.26:0/486023364 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c027070 con 0x7fcb64133a80 2023-10-01T07:58:36.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.544+0000 7fcb617fa700 1 -- 172.21.15.26:0/486023364 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5c003a00 con 0x7fcb64133a80 2023-10-01T07:58:36.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.544+0000 7fcb617fa700 1 -- 172.21.15.26:0/486023364 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c003db0 con 0x7fcb64133a80 2023-10-01T07:58:36.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.544+0000 7fcb6b164700 1 -- 172.21.15.26:0/486023364 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb6412db80 con 0x7fcb64133a80 2023-10-01T07:58:36.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.545+0000 7fcb6b164700 1 -- 172.21.15.26:0/486023364 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb6409e1b0 con 0x7fcb64133a80 2023-10-01T07:58:36.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.546+0000 7fcb6b164700 1 -- 172.21.15.26:0/486023364 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb64074ea0 con 0x7fcb64133a80 2023-10-01T07:58:36.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.546+0000 7fcb617fa700 1 -- 172.21.15.26:0/486023364 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcb5c00a860 con 0x7fcb64133a80 2023-10-01T07:58:36.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.546+0000 7fcb617fa700 1 -- 172.21.15.26:0/486023364 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcb5c0503c0 con 0x7fcb64133a80 2023-10-01T07:58:36.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.555+0000 7fcb617fa700 1 -- 172.21.15.26:0/486023364 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcb5c02a720 con 0x7fcb64133a80 2023-10-01T07:58:36.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.581+0000 7f8e460ab700 1 Processor -- start 2023-10-01T07:58:36.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.581+0000 7f8e460ab700 1 -- start start 2023-10-01T07:58:36.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.582+0000 7f8e460ab700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8e4009e1d0 0x7f8e40135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:36.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.582+0000 7f8e460ab700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e40135e50 0x7f8e40138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:36.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.582+0000 7f8e460ab700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e4009f130 con 0x7f8e4009d6f0 2023-10-01T07:58:36.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.582+0000 7f8e460ab700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e4009f520 con 0x7f8e4009e1d0 2023-10-01T07:58:36.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.582+0000 7f8e460ab700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4009e930 con 0x7f8e40135e50 2023-10-01T07:58:36.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.582+0000 7f8e3effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8e4009e1d0 0x7f8e40135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:36.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.582+0000 7f8e3f7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8e4009d6f0 0x7f8e4009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:32938/0 (socket says 172.21.15.26:32938) 2023-10-01T07:58:36.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.582+0000 7f8e3f7fe700 1 -- 172.21.15.26:0/306406299 learned_addr learned my addr 172.21.15.26:0/306406299 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:36.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.582+0000 7f8e3ffff700 1 --2- 172.21.15.26:0/306406299 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e40135e50 0x7f8e40138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:36.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.582+0000 7f8e3ffff700 1 -- 172.21.15.26:0/306406299 >> v2:172.21.15.26:3300/0 conn(0x7f8e4009e1d0 msgr2=0x7f8e40135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:36.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.582+0000 7f8e3ffff700 1 --2- 172.21.15.26:0/306406299 >> v2:172.21.15.26:3300/0 conn(0x7f8e4009e1d0 0x7f8e40135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:36.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.582+0000 7f8e3ffff700 1 -- 172.21.15.26:0/306406299 >> v1:172.21.15.26:6789/0 conn(0x7f8e4009d6f0 legacy=0x7f8e4009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:36.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.582+0000 7f8e3ffff700 1 -- 172.21.15.26:0/306406299 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4009b2d0 con 0x7f8e40135e50 2023-10-01T07:58:36.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.583+0000 7f8e3ffff700 1 --2- 172.21.15.26:0/306406299 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e40135e50 0x7f8e40138230 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f8e38009e10 tx=0x7f8e3800f740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40c8e44b06e5a7bb server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:36.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.583+0000 7f8e3e7fc700 1 -- 172.21.15.26:0/306406299 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e38017410 con 0x7f8e40135e50 2023-10-01T07:58:36.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.583+0000 7f8e3e7fc700 1 -- 172.21.15.26:0/306406299 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e38017570 con 0x7f8e40135e50 2023-10-01T07:58:36.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.583+0000 7f8e3e7fc700 1 -- 172.21.15.26:0/306406299 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e38017920 con 0x7f8e40135e50 2023-10-01T07:58:36.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.584+0000 7f8e460ab700 1 -- 172.21.15.26:0/306406299 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e40135e50 msgr2=0x7f8e40138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:36.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.584+0000 7f8e460ab700 1 --2- 172.21.15.26:0/306406299 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e40135e50 0x7f8e40138230 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f8e38009e10 tx=0x7f8e3800f740 comp rx=0 tx=0).stop 2023-10-01T07:58:36.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.584+0000 7f8e460ab700 1 -- 172.21.15.26:0/306406299 shutdown_connections 2023-10-01T07:58:36.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.584+0000 7f8e460ab700 1 --2- 172.21.15.26:0/306406299 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e40135e50 0x7f8e40138230 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:36.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.584+0000 7f8e460ab700 1 --2- 172.21.15.26:0/306406299 >> v2:172.21.15.26:3300/0 conn(0x7f8e4009e1d0 0x7f8e40135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:36.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.584+0000 7f8e460ab700 1 -- 172.21.15.26:0/306406299 >> 172.21.15.26:0/306406299 conn(0x7f8e40066f50 msgr2=0x7f8e4009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:36.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.584+0000 7f8e460ab700 1 -- 172.21.15.26:0/306406299 shutdown_connections 2023-10-01T07:58:36.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.584+0000 7f8e460ab700 1 -- 172.21.15.26:0/306406299 wait complete. 2023-10-01T07:58:36.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.585+0000 7f8e460ab700 1 Processor -- start 2023-10-01T07:58:36.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.586+0000 7f8e460ab700 1 -- start start 2023-10-01T07:58:36.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.587+0000 7f8e460ab700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e4009d6f0 0x7f8e4011a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:36.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.587+0000 7f8e460ab700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e4009e1d0 0x7f8e4011a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:36.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.587+0000 7f8e460ab700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e40135e50 0x7f8e401c4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:36.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.587+0000 7f8e460ab700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4011cdf0 con 0x7f8e40135e50 2023-10-01T07:58:36.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.587+0000 7f8e460ab700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e40119bd0 con 0x7f8e4009d6f0 2023-10-01T07:58:36.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.587+0000 7f8e460ab700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e400a1f20 con 0x7f8e4009e1d0 2023-10-01T07:58:36.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.587+0000 7f8e3f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e4009d6f0 0x7f8e4011a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:36.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.587+0000 7f8e3f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e4009d6f0 0x7f8e4011a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:52022/0 (socket says 172.21.15.26:52022) 2023-10-01T07:58:36.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.587+0000 7f8e3f7fe700 1 -- 172.21.15.26:0/2115648894 learned_addr learned my addr 172.21.15.26:0/2115648894 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:36.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.587+0000 7f8e3ffff700 1 --2- 172.21.15.26:0/2115648894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e40135e50 0x7f8e401c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:36.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.587+0000 7f8e3f7fe700 1 -- 172.21.15.26:0/2115648894 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e4009e1d0 msgr2=0x7f8e4011a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:36.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.587+0000 7f8e3f7fe700 1 --2- 172.21.15.26:0/2115648894 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e4009e1d0 0x7f8e4011a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:36.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.587+0000 7f8e3f7fe700 1 -- 172.21.15.26:0/2115648894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e40135e50 msgr2=0x7f8e401c4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:36.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.587+0000 7f8e3f7fe700 1 --2- 172.21.15.26:0/2115648894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e40135e50 0x7f8e401c4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:36.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.587+0000 7f8e3f7fe700 1 -- 172.21.15.26:0/2115648894 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e38009a70 con 0x7f8e4009d6f0 2023-10-01T07:58:36.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.587+0000 7f8e3ffff700 1 --2- 172.21.15.26:0/2115648894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e40135e50 0x7f8e401c4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:58:36.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.587+0000 7f8e3f7fe700 1 --2- 172.21.15.26:0/2115648894 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e4009d6f0 0x7f8e4011a220 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000c4b0 tx=0x7f8e3000c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:36.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.588+0000 7f8e27fff700 1 -- 172.21.15.26:0/2115648894 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e30005d70 con 0x7f8e4009d6f0 2023-10-01T07:58:36.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.588+0000 7f8e27fff700 1 -- 172.21.15.26:0/2115648894 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e300070d0 con 0x7f8e4009d6f0 2023-10-01T07:58:36.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.588+0000 7f8e27fff700 1 -- 172.21.15.26:0/2115648894 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e30007440 con 0x7f8e4009d6f0 2023-10-01T07:58:36.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.589+0000 7f8e460ab700 1 -- 172.21.15.26:0/2115648894 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e4009c700 con 0x7f8e4009d6f0 2023-10-01T07:58:36.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.589+0000 7f8e460ab700 1 -- 172.21.15.26:0/2115648894 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e4011b1c0 con 0x7f8e4009d6f0 2023-10-01T07:58:36.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.590+0000 7f8e27fff700 1 -- 172.21.15.26:0/2115648894 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e300075a0 con 0x7f8e4009d6f0 2023-10-01T07:58:36.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.590+0000 7f8e460ab700 1 -- 172.21.15.26:0/2115648894 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e4011cc30 con 0x7f8e4009d6f0 2023-10-01T07:58:36.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.590+0000 7f8e27fff700 1 -- 172.21.15.26:0/2115648894 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8e3003ead0 con 0x7f8e4009d6f0 2023-10-01T07:58:36.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.595+0000 7f8e27fff700 1 -- 172.21.15.26:0/2115648894 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e30019b40 con 0x7f8e4009d6f0 2023-10-01T07:58:36.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.682+0000 7f3992892700 1 -- 172.21.15.26:0/2915634824 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f398c074ea0 con 0x7f398c136fe0 2023-10-01T07:58:36.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.683+0000 7f3988ff9700 1 -- 172.21.15.26:0/2915634824 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f39840138f0 con 0x7f398c136fe0 2023-10-01T07:58:36.683 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:36.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.686+0000 7f3992892700 1 -- 172.21.15.26:0/2915634824 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f398c136fe0 msgr2=0x7f398c1c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:36.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.686+0000 7f3992892700 1 --2- 172.21.15.26:0/2915634824 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f398c136fe0 0x7f398c1c8260 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3984007e60 tx=0x7f398400d3b0 comp rx=0 tx=0).stop 2023-10-01T07:58:36.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.686+0000 7f3992892700 1 -- 172.21.15.26:0/2915634824 shutdown_connections 2023-10-01T07:58:36.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.686+0000 7f3992892700 1 --2- 172.21.15.26:0/2915634824 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f398c136fe0 0x7f398c1c8260 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:36.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.686+0000 7f3992892700 1 --2- 172.21.15.26:0/2915634824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f398c09e930 0x7f398c06c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:36.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.686+0000 7f3992892700 1 --2- 172.21.15.26:0/2915634824 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f398c09f410 0x7f398c06c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:36.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.686+0000 7f3992892700 1 -- 172.21.15.26:0/2915634824 >> 172.21.15.26:0/2915634824 conn(0x7f398c0a4210 msgr2=0x7f398c0a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:36.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.686+0000 7f3992892700 1 -- 172.21.15.26:0/2915634824 shutdown_connections 2023-10-01T07:58:36.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.686+0000 7f3992892700 1 -- 172.21.15.26:0/2915634824 wait complete. 2023-10-01T07:58:36.706 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:36.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.726+0000 7fc762e68700 1 -- 172.21.15.26:0/102308558 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc75c09e130 con 0x7fc75c1316c0 2023-10-01T07:58:36.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.727+0000 7fc7597fa700 1 -- 172.21.15.26:0/102308558 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc75c09e130 con 0x7fc75c1316c0 2023-10-01T07:58:36.727 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:36.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.729+0000 7fc762e68700 1 -- 172.21.15.26:0/102308558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc75c1316c0 msgr2=0x7fc75c119f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:36.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.729+0000 7fc762e68700 1 --2- 172.21.15.26:0/102308558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc75c1316c0 0x7fc75c119f00 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fc75400caa0 tx=0x7fc75400cdb0 comp rx=0 tx=0).stop 2023-10-01T07:58:36.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.729+0000 7fc762e68700 1 -- 172.21.15.26:0/102308558 shutdown_connections 2023-10-01T07:58:36.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.729+0000 7fc762e68700 1 --2- 172.21.15.26:0/102308558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc75c1316c0 0x7fc75c119f00 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:36.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.729+0000 7fc762e68700 1 --2- 172.21.15.26:0/102308558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc75c06acb0 0x7fc75c119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:36.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.729+0000 7fc762e68700 1 --2- 172.21.15.26:0/102308558 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc75c09d9f0 0x7fc75c1199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:36.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.729+0000 7fc762e68700 1 -- 172.21.15.26:0/102308558 >> 172.21.15.26:0/102308558 conn(0x7fc75c066f50 msgr2=0x7fc75c130150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:36.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.729+0000 7fc762e68700 1 -- 172.21.15.26:0/102308558 shutdown_connections 2023-10-01T07:58:36.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.729+0000 7fc762e68700 1 -- 172.21.15.26:0/102308558 wait complete. 2023-10-01T07:58:36.744 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:36.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.783+0000 7fcb6b164700 1 -- 172.21.15.26:0/486023364 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcb6406b250 con 0x7fcb64133a80 2023-10-01T07:58:36.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.784+0000 7fcb617fa700 1 -- 172.21.15.26:0/486023364 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcb5c011380 con 0x7fcb64133a80 2023-10-01T07:58:36.784 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:36.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.786+0000 7fcb6b164700 1 -- 172.21.15.26:0/486023364 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb64133a80 msgr2=0x7fcb6409d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:36.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.786+0000 7fcb6b164700 1 --2- 172.21.15.26:0/486023364 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb64133a80 0x7fcb6409d160 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c00cbc0 tx=0x7fcb5c00ced0 comp rx=0 tx=0).stop 2023-10-01T07:58:36.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.786+0000 7fcb6b164700 1 -- 172.21.15.26:0/486023364 shutdown_connections 2023-10-01T07:58:36.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.786+0000 7fcb6b164700 1 --2- 172.21.15.26:0/486023364 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb64133a80 0x7fcb6409d160 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:36.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.786+0000 7fcb6b164700 1 --2- 172.21.15.26:0/486023364 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb6412ff20 0x7fcb6409c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:36.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.786+0000 7fcb6b164700 1 --2- 172.21.15.26:0/486023364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb64130870 0x7fcb6409cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:36.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.786+0000 7fcb6b164700 1 -- 172.21.15.26:0/486023364 >> 172.21.15.26:0/486023364 conn(0x7fcb640a4210 msgr2=0x7fcb6409e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:36.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.786+0000 7fcb6b164700 1 -- 172.21.15.26:0/486023364 shutdown_connections 2023-10-01T07:58:36.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.786+0000 7fcb6b164700 1 -- 172.21.15.26:0/486023364 wait complete. 2023-10-01T07:58:36.800 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:36.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.802+0000 7f8e460ab700 1 -- 172.21.15.26:0/2115648894 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8e4011ca90 con 0x7f8e4009d6f0 2023-10-01T07:58:36.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.803+0000 7f8e27fff700 1 -- 172.21.15.26:0/2115648894 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8e4011ca90 con 0x7f8e4009d6f0 2023-10-01T07:58:36.803 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:36.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.805+0000 7f8e460ab700 1 -- 172.21.15.26:0/2115648894 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e4009d6f0 msgr2=0x7f8e4011a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:36.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.805+0000 7f8e460ab700 1 --2- 172.21.15.26:0/2115648894 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e4009d6f0 0x7f8e4011a220 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000c4b0 tx=0x7f8e3000c870 comp rx=0 tx=0).stop 2023-10-01T07:58:36.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.805+0000 7f8e460ab700 1 -- 172.21.15.26:0/2115648894 shutdown_connections 2023-10-01T07:58:36.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.805+0000 7f8e460ab700 1 --2- 172.21.15.26:0/2115648894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e40135e50 0x7f8e401c4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:36.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.805+0000 7f8e460ab700 1 --2- 172.21.15.26:0/2115648894 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e4009d6f0 0x7f8e4011a220 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:36.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.805+0000 7f8e460ab700 1 --2- 172.21.15.26:0/2115648894 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e4009e1d0 0x7f8e4011a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:36.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.805+0000 7f8e460ab700 1 -- 172.21.15.26:0/2115648894 >> 172.21.15.26:0/2115648894 conn(0x7f8e40066f50 msgr2=0x7f8e40134830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:36.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.805+0000 7f8e460ab700 1 -- 172.21.15.26:0/2115648894 shutdown_connections 2023-10-01T07:58:36.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:36.805+0000 7f8e460ab700 1 -- 172.21.15.26:0/2115648894 wait complete. 2023-10-01T07:58:36.819 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:37.707 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:37.745 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:37.801 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:37.820 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:37.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.859+0000 7f781799b700 1 Processor -- start 2023-10-01T07:58:37.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.860+0000 7f781799b700 1 -- start start 2023-10-01T07:58:37.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.860+0000 7f781799b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f781009d6f0 0x7f781009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:37.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.860+0000 7f781799b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f781009e440 0x7f7810134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:37.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.860+0000 7f781799b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f781009b120 con 0x7f781009e000 2023-10-01T07:58:37.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.860+0000 7f781799b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f781006b460 con 0x7f781009d6f0 2023-10-01T07:58:37.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.860+0000 7f781799b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781009a7e0 con 0x7f781009e440 2023-10-01T07:58:37.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.860+0000 7f7815f38700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f781009e440 0x7f7810134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:37.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.860+0000 7f7815f38700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f781009e440 0x7f7810134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:52038/0 (socket says 172.21.15.26:52038) 2023-10-01T07:58:37.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.860+0000 7f7815f38700 1 -- 172.21.15.26:0/1987187079 learned_addr learned my addr 172.21.15.26:0/1987187079 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:37.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.860+0000 7f7815737700 1 --2- 172.21.15.26:0/1987187079 >> v2:172.21.15.26:3300/0 conn(0x7f781009d6f0 0x7f781009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:37.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.861+0000 7f7815737700 1 -- 172.21.15.26:0/1987187079 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f781009e440 msgr2=0x7f7810134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:37.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.861+0000 7f7815737700 1 --2- 172.21.15.26:0/1987187079 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f781009e440 0x7f7810134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:37.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.861+0000 7f7815737700 1 -- 172.21.15.26:0/1987187079 >> v1:172.21.15.26:6789/0 conn(0x7f781009e000 legacy=0x7f78101339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:37.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.861+0000 7f7815737700 1 -- 172.21.15.26:0/1987187079 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781009a500 con 0x7f781009d6f0 2023-10-01T07:58:37.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.861+0000 7f7815f38700 1 --2- 172.21.15.26:0/1987187079 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f781009e440 0x7f7810134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:37.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.861+0000 7f7815737700 1 --2- 172.21.15.26:0/1987187079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f781009d6f0 0x7f781009dac0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f780c009870 tx=0x7f780c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8178156cdfaf0735 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:37.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.861+0000 7f7807fff700 1 -- 172.21.15.26:0/1987187079 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c011830 con 0x7f781009d6f0 2023-10-01T07:58:37.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.861+0000 7f7807fff700 1 -- 172.21.15.26:0/1987187079 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780c011990 con 0x7f781009d6f0 2023-10-01T07:58:37.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.861+0000 7f7807fff700 1 -- 172.21.15.26:0/1987187079 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c011d20 con 0x7f781009d6f0 2023-10-01T07:58:37.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.862+0000 7f781799b700 1 -- 172.21.15.26:0/1987187079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f781009d6f0 msgr2=0x7f781009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:37.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.862+0000 7f781799b700 1 --2- 172.21.15.26:0/1987187079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f781009d6f0 0x7f781009dac0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f780c009870 tx=0x7f780c009b80 comp rx=0 tx=0).stop 2023-10-01T07:58:37.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.863+0000 7f781799b700 1 -- 172.21.15.26:0/1987187079 shutdown_connections 2023-10-01T07:58:37.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.863+0000 7f781799b700 1 --2- 172.21.15.26:0/1987187079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f781009d6f0 0x7f781009dac0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:37.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.863+0000 7f781799b700 1 --2- 172.21.15.26:0/1987187079 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f781009e440 0x7f7810134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:37.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.863+0000 7f781799b700 1 -- 172.21.15.26:0/1987187079 >> 172.21.15.26:0/1987187079 conn(0x7f7810066f50 msgr2=0x7f781009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:37.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.863+0000 7f781799b700 1 -- 172.21.15.26:0/1987187079 shutdown_connections 2023-10-01T07:58:37.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.863+0000 7f781799b700 1 -- 172.21.15.26:0/1987187079 wait complete. 2023-10-01T07:58:37.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.864+0000 7f781799b700 1 Processor -- start 2023-10-01T07:58:37.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.864+0000 7f781799b700 1 -- start start 2023-10-01T07:58:37.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.865+0000 7f781799b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f781009d6f0 0x7f78101a5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:37.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.865+0000 7f781799b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f781009e000 0x7f78101a63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:37.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.865+0000 7f781799b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f781009e440 0x7f78101a6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:37.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.865+0000 7f781799b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78101a7a60 con 0x7f781009e000 2023-10-01T07:58:37.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.865+0000 7f781799b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781009c710 con 0x7f781009e440 2023-10-01T07:58:37.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.865+0000 7f781799b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78101a9690 con 0x7f781009d6f0 2023-10-01T07:58:37.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.865+0000 7f7814f36700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f781009e000 0x7f78101a63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:37.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.865+0000 7f7814f36700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f781009e000 0x7f78101a63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52380/0 (socket says 172.21.15.26:52380) 2023-10-01T07:58:37.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.865+0000 7f7814f36700 1 -- 172.21.15.26:0/3245121473 learned_addr learned my addr 172.21.15.26:0/3245121473 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:37.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.865+0000 7f7815737700 1 --2- 172.21.15.26:0/3245121473 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f781009d6f0 0x7f78101a5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:37.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.865+0000 7f7815f38700 1 --2- 172.21.15.26:0/3245121473 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f781009e440 0x7f78101a6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:37.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.866+0000 7f7814f36700 1 -- 172.21.15.26:0/3245121473 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f781009d6f0 msgr2=0x7f78101a5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:37.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.866+0000 7f7814f36700 1 --2- 172.21.15.26:0/3245121473 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f781009d6f0 0x7f78101a5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:37.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.866+0000 7f7814f36700 1 -- 172.21.15.26:0/3245121473 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f781009e440 msgr2=0x7f78101a6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:37.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.866+0000 7f7814f36700 1 --2- 172.21.15.26:0/3245121473 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f781009e440 0x7f78101a6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:37.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.866+0000 7f7814f36700 1 -- 172.21.15.26:0/3245121473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7808009b30 con 0x7f781009e000 2023-10-01T07:58:37.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.866+0000 7f7814f36700 1 --2- 172.21.15.26:0/3245121473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f781009e000 0x7f78101a63d0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f780000c4e0 tx=0x7f780000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:37.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.866+0000 7f7805ffb700 1 -- 172.21.15.26:0/3245121473 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78000052d0 con 0x7f781009e000 2023-10-01T07:58:37.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.866+0000 7f7805ffb700 1 -- 172.21.15.26:0/3245121473 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7800005430 con 0x7f781009e000 2023-10-01T07:58:37.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.866+0000 7f781799b700 1 -- 172.21.15.26:0/3245121473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f780c0094a0 con 0x7f781009e000 2023-10-01T07:58:37.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.866+0000 7f7805ffb700 1 -- 172.21.15.26:0/3245121473 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78000038c0 con 0x7f781009e000 2023-10-01T07:58:37.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.867+0000 7f781799b700 1 -- 172.21.15.26:0/3245121473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78101a8cb0 con 0x7f781009e000 2023-10-01T07:58:37.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.868+0000 7f7805ffb700 1 -- 172.21.15.26:0/3245121473 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7800003a20 con 0x7f781009e000 2023-10-01T07:58:37.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.868+0000 7f7805ffb700 1 -- 172.21.15.26:0/3245121473 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f780003ea90 con 0x7f781009e000 2023-10-01T07:58:37.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.870+0000 7f781799b700 1 -- 172.21.15.26:0/3245121473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7810074ea0 con 0x7f781009e000 2023-10-01T07:58:37.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.879+0000 7f7805ffb700 1 -- 172.21.15.26:0/3245121473 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7800018260 con 0x7f781009e000 2023-10-01T07:58:37.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.913+0000 7f7680a67700 1 Processor -- start 2023-10-01T07:58:37.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.914+0000 7f7680a67700 1 -- start start 2023-10-01T07:58:37.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.915+0000 7f7680a67700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f767c09d6f0 0x7f767c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:37.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.915+0000 7f7680a67700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f767c09e410 0x7f767c130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:37.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.915+0000 7f7680a67700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f767c09f130 con 0x7f767c09e000 2023-10-01T07:58:37.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.915+0000 7f7680a67700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f767c09f520 con 0x7f767c09e410 2023-10-01T07:58:37.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.915+0000 7f7680a67700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767c09e930 con 0x7f767c09d6f0 2023-10-01T07:58:37.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.915+0000 7f767a59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f767c09d6f0 0x7f767c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:37.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.915+0000 7f767ad9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f767c09e410 0x7f767c130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:37.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.915+0000 7f767a59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f767c09d6f0 0x7f767c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:52050/0 (socket says 172.21.15.26:52050) 2023-10-01T07:58:37.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.915+0000 7f767a59c700 1 -- 172.21.15.26:0/457558247 learned_addr learned my addr 172.21.15.26:0/457558247 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:37.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.915+0000 7f767a59c700 1 -- 172.21.15.26:0/457558247 >> v2:172.21.15.26:3300/0 conn(0x7f767c09e410 msgr2=0x7f767c130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:37.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.915+0000 7f767a59c700 1 --2- 172.21.15.26:0/457558247 >> v2:172.21.15.26:3300/0 conn(0x7f767c09e410 0x7f767c130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:37.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.915+0000 7f767a59c700 1 -- 172.21.15.26:0/457558247 >> v1:172.21.15.26:6789/0 conn(0x7f767c09e000 legacy=0x7f767c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:37.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.915+0000 7f767a59c700 1 -- 172.21.15.26:0/457558247 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767c09b2d0 con 0x7f767c09d6f0 2023-10-01T07:58:37.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.916+0000 7f767a59c700 1 --2- 172.21.15.26:0/457558247 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f767c09d6f0 0x7f767c09dac0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f766c00dd20 tx=0x7f766c00f330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f0f19e1b49e9007 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:37.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.916+0000 7f767959a700 1 -- 172.21.15.26:0/457558247 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c012070 con 0x7f767c09d6f0 2023-10-01T07:58:37.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.916+0000 7f767959a700 1 -- 172.21.15.26:0/457558247 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766c00de70 con 0x7f767c09d6f0 2023-10-01T07:58:37.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.916+0000 7f767959a700 1 -- 172.21.15.26:0/457558247 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c00fd20 con 0x7f767c09d6f0 2023-10-01T07:58:37.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.916+0000 7f7680a67700 1 -- 172.21.15.26:0/457558247 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f767c09d6f0 msgr2=0x7f767c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:37.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.916+0000 7f7680a67700 1 --2- 172.21.15.26:0/457558247 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f767c09d6f0 0x7f767c09dac0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f766c00dd20 tx=0x7f766c00f330 comp rx=0 tx=0).stop 2023-10-01T07:58:37.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.917+0000 7f7680a67700 1 -- 172.21.15.26:0/457558247 shutdown_connections 2023-10-01T07:58:37.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.917+0000 7f7680a67700 1 --2- 172.21.15.26:0/457558247 >> v2:172.21.15.26:3300/0 conn(0x7f767c09e410 0x7f767c130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:37.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.917+0000 7f7680a67700 1 --2- 172.21.15.26:0/457558247 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f767c09d6f0 0x7f767c09dac0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:37.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.917+0000 7f7680a67700 1 -- 172.21.15.26:0/457558247 >> 172.21.15.26:0/457558247 conn(0x7f767c066f50 msgr2=0x7f767c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:37.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.917+0000 7f7680a67700 1 -- 172.21.15.26:0/457558247 shutdown_connections 2023-10-01T07:58:37.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.917+0000 7f7680a67700 1 -- 172.21.15.26:0/457558247 wait complete. 2023-10-01T07:58:37.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.918+0000 7f7680a67700 1 Processor -- start 2023-10-01T07:58:37.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.918+0000 7f7680a67700 1 -- start start 2023-10-01T07:58:37.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.919+0000 7f7680a67700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f767c09d6f0 0x7f767c11df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:37.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.919+0000 7f7680a67700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f767c09e000 0x7f767c11e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:37.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.919+0000 7f7680a67700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f767c09e410 0x7f767c11e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:37.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.919+0000 7f7680a67700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767c11f410 con 0x7f767c09e410 2023-10-01T07:58:37.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.919+0000 7f7680a67700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767c130320 con 0x7f767c09e000 2023-10-01T07:58:37.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.919+0000 7f7680a67700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f767c120da0 con 0x7f767c09d6f0 2023-10-01T07:58:37.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.919+0000 7f7679d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f767c09e000 0x7f767c11e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:37.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.919+0000 7f767ad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f767c09e410 0x7f767c11e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:37.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.919+0000 7f7679d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f767c09e000 0x7f767c11e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:52064/0 (socket says 172.21.15.26:52064) 2023-10-01T07:58:37.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.919+0000 7f7679d9b700 1 -- 172.21.15.26:0/3318954842 learned_addr learned my addr 172.21.15.26:0/3318954842 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:37.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.920+0000 7f767a59c700 1 --2- 172.21.15.26:0/3318954842 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f767c09d6f0 0x7f767c11df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:37.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.920+0000 7f7679d9b700 1 -- 172.21.15.26:0/3318954842 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f767c09d6f0 msgr2=0x7f767c11df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:37.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.920+0000 7f7679d9b700 1 --2- 172.21.15.26:0/3318954842 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f767c09d6f0 0x7f767c11df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.920+0000 7f7679d9b700 1 -- 172.21.15.26:0/3318954842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f767c09e410 msgr2=0x7f767c11e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.920+0000 7f7679d9b700 1 --2- 172.21.15.26:0/3318954842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f767c09e410 0x7f767c11e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.920+0000 7f7679d9b700 1 -- 172.21.15.26:0/3318954842 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766c00da00 con 0x7f767c09e000 2023-10-01T07:58:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.920+0000 7f767ad9d700 1 --2- 172.21.15.26:0/3318954842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f767c09e410 0x7f767c11e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.920+0000 7f7679d9b700 1 --2- 172.21.15.26:0/3318954842 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f767c09e000 0x7f767c11e480 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f767000c4b0 tx=0x7f767000c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.920+0000 7f766affd700 1 -- 172.21.15.26:0/3318954842 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7670015d70 con 0x7f767c09e000 2023-10-01T07:58:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.920+0000 7f766affd700 1 -- 172.21.15.26:0/3318954842 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76700050d0 con 0x7f767c09e000 2023-10-01T07:58:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.920+0000 7f766affd700 1 -- 172.21.15.26:0/3318954842 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7670005480 con 0x7f767c09e000 2023-10-01T07:58:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.920+0000 7f7680a67700 1 -- 172.21.15.26:0/3318954842 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f767c121780 con 0x7f767c09e000 2023-10-01T07:58:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.921+0000 7f7680a67700 1 -- 172.21.15.26:0/3318954842 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f767c0a1d00 con 0x7f767c09e000 2023-10-01T07:58:37.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.922+0000 7f7680a67700 1 -- 172.21.15.26:0/3318954842 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f767c11ac20 con 0x7f767c09e000 2023-10-01T07:58:37.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.923+0000 7f766affd700 1 -- 172.21.15.26:0/3318954842 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7670003680 con 0x7f767c09e000 2023-10-01T07:58:37.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.923+0000 7f766affd700 1 -- 172.21.15.26:0/3318954842 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7670047630 con 0x7f767c09e000 2023-10-01T07:58:37.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.927+0000 7f766affd700 1 -- 172.21.15.26:0/3318954842 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f767001c940 con 0x7f767c09e000 2023-10-01T07:58:37.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.949+0000 7ff94923c700 1 Processor -- start 2023-10-01T07:58:37.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.950+0000 7ff94923c700 1 -- start start 2023-10-01T07:58:37.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.950+0000 7ff94923c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94412cf60 0x7ff94406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:37.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.950+0000 7ff94923c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff944130430 0x7ff944137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:37.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.950+0000 7ff94923c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff94412cd90 con 0x7ff94412f8b0 2023-10-01T07:58:37.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.950+0000 7ff94923c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff94412d330 con 0x7ff944130430 2023-10-01T07:58:37.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.950+0000 7ff94923c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff944071780 con 0x7ff94412cf60 2023-10-01T07:58:37.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.950+0000 7ff94359e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff944130430 0x7ff944137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:37.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.950+0000 7ff942d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94412cf60 0x7ff94406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:37.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.950+0000 7ff94359e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff944130430 0x7ff944137c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52400/0 (socket says 172.21.15.26:52400) 2023-10-01T07:58:37.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.950+0000 7ff94259c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff94412f8b0 0x7ff94412fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:32960/0 (socket says 172.21.15.26:32960) 2023-10-01T07:58:37.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.950+0000 7ff94359e700 1 -- 172.21.15.26:0/1832173227 learned_addr learned my addr 172.21.15.26:0/1832173227 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:37.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.951+0000 7ff942d9d700 1 -- 172.21.15.26:0/1832173227 >> v2:172.21.15.26:3300/0 conn(0x7ff944130430 msgr2=0x7ff944137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:37.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.951+0000 7ff942d9d700 1 --2- 172.21.15.26:0/1832173227 >> v2:172.21.15.26:3300/0 conn(0x7ff944130430 0x7ff944137c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:37.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.951+0000 7ff942d9d700 1 -- 172.21.15.26:0/1832173227 >> v1:172.21.15.26:6789/0 conn(0x7ff94412f8b0 legacy=0x7ff94412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:37.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.951+0000 7ff942d9d700 1 -- 172.21.15.26:0/1832173227 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff944071a40 con 0x7ff94412cf60 2023-10-01T07:58:37.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.951+0000 7ff942d9d700 1 --2- 172.21.15.26:0/1832173227 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94412cf60 0x7ff94406f5d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ff934009840 tx=0x7ff934009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46eecff33572c499 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:37.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.951+0000 7ff941d9b700 1 -- 172.21.15.26:0/1832173227 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93400c880 con 0x7ff94412cf60 2023-10-01T07:58:37.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.951+0000 7ff941d9b700 1 -- 172.21.15.26:0/1832173227 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93400c9e0 con 0x7ff94412cf60 2023-10-01T07:58:37.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.951+0000 7ff941d9b700 1 -- 172.21.15.26:0/1832173227 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93400cd70 con 0x7ff94412cf60 2023-10-01T07:58:37.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.952+0000 7ff94923c700 1 -- 172.21.15.26:0/1832173227 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94412cf60 msgr2=0x7ff94406f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:37.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.952+0000 7ff94923c700 1 --2- 172.21.15.26:0/1832173227 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94412cf60 0x7ff94406f5d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ff934009840 tx=0x7ff934009b50 comp rx=0 tx=0).stop 2023-10-01T07:58:37.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.952+0000 7ff94923c700 1 -- 172.21.15.26:0/1832173227 shutdown_connections 2023-10-01T07:58:37.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.952+0000 7ff94923c700 1 --2- 172.21.15.26:0/1832173227 >> v2:172.21.15.26:3300/0 conn(0x7ff944130430 0x7ff944137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:37.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.952+0000 7ff94923c700 1 --2- 172.21.15.26:0/1832173227 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94412cf60 0x7ff94406f5d0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:37.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.952+0000 7ff94923c700 1 -- 172.21.15.26:0/1832173227 >> 172.21.15.26:0/1832173227 conn(0x7ff9440a2aa0 msgr2=0x7ff9440a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:37.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.952+0000 7ff94923c700 1 -- 172.21.15.26:0/1832173227 shutdown_connections 2023-10-01T07:58:37.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.952+0000 7ff94923c700 1 -- 172.21.15.26:0/1832173227 wait complete. 2023-10-01T07:58:37.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.954+0000 7ff94923c700 1 Processor -- start 2023-10-01T07:58:37.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.954+0000 7ff94923c700 1 -- start start 2023-10-01T07:58:37.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.955+0000 7ff94923c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff94412cf60 0x7ff94409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:37.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.955+0000 7ff94923c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94412f8b0 0x7ff94409e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:37.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.955+0000 7ff94923c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff944130430 0x7ff9441c6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:37.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.955+0000 7ff94923c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94409d9f0 con 0x7ff944130430 2023-10-01T07:58:37.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.955+0000 7ff94923c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff944129fa0 con 0x7ff94412f8b0 2023-10-01T07:58:37.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.955+0000 7ff94923c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff944119f50 con 0x7ff94412cf60 2023-10-01T07:58:37.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.955+0000 7ff94359e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff944130430 0x7ff9441c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:37.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.955+0000 7ff94359e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff944130430 0x7ff9441c6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52404/0 (socket says 172.21.15.26:52404) 2023-10-01T07:58:37.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.955+0000 7ff94259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94412f8b0 0x7ff94409e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:37.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.955+0000 7ff94359e700 1 -- 172.21.15.26:0/4135998193 learned_addr learned my addr 172.21.15.26:0/4135998193 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:37.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.955+0000 7ff94359e700 1 -- 172.21.15.26:0/4135998193 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff94412cf60 msgr2=0x7ff94409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:37.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.955+0000 7ff94359e700 1 --2- 172.21.15.26:0/4135998193 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff94412cf60 0x7ff94409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:37.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.955+0000 7ff94359e700 1 -- 172.21.15.26:0/4135998193 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94412f8b0 msgr2=0x7ff94409e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:37.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.955+0000 7ff94359e700 1 --2- 172.21.15.26:0/4135998193 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94412f8b0 0x7ff94409e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:37.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.955+0000 7ff94359e700 1 -- 172.21.15.26:0/4135998193 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9340094a0 con 0x7ff944130430 2023-10-01T07:58:37.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.956+0000 7ff94259c700 1 --2- 172.21.15.26:0/4135998193 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94412f8b0 0x7ff94409e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:37.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.956+0000 7ff94359e700 1 --2- 172.21.15.26:0/4135998193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff944130430 0x7ff9441c6230 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7ff93c009d60 tx=0x7ff93c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:37.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.956+0000 7ff92b7fe700 1 -- 172.21.15.26:0/4135998193 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c009bd0 con 0x7ff944130430 2023-10-01T07:58:37.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.956+0000 7ff92b7fe700 1 -- 172.21.15.26:0/4135998193 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93c00f040 con 0x7ff944130430 2023-10-01T07:58:37.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.956+0000 7ff92b7fe700 1 -- 172.21.15.26:0/4135998193 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c003e80 con 0x7ff944130430 2023-10-01T07:58:37.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.956+0000 7ff94923c700 1 -- 172.21.15.26:0/4135998193 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff94411a7b0 con 0x7ff944130430 2023-10-01T07:58:37.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.956+0000 7ff94923c700 1 -- 172.21.15.26:0/4135998193 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94411b4e0 con 0x7ff944130430 2023-10-01T07:58:37.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.957+0000 7ff94923c700 1 -- 172.21.15.26:0/4135998193 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff944074ea0 con 0x7ff944130430 2023-10-01T07:58:37.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.958+0000 7ff92b7fe700 1 -- 172.21.15.26:0/4135998193 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff93c00c930 con 0x7ff944130430 2023-10-01T07:58:37.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.958+0000 7ff92b7fe700 1 -- 172.21.15.26:0/4135998193 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff93c040840 con 0x7ff944130430 2023-10-01T07:58:37.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.963+0000 7ff92b7fe700 1 -- 172.21.15.26:0/4135998193 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff93c026d70 con 0x7ff944130430 2023-10-01T07:58:37.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.994+0000 7fdce74d5700 1 Processor -- start 2023-10-01T07:58:37.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.994+0000 7fdce74d5700 1 -- start start 2023-10-01T07:58:37.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.995+0000 7fdce74d5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdce01338a0 0x7fdce0133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:37.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.995+0000 7fdce74d5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdce009de50 0x7fdce009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:37.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.995+0000 7fdce74d5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce006ef30 con 0x7fdce009e760 2023-10-01T07:58:37.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.995+0000 7fdce74d5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce006fef0 con 0x7fdce01338a0 2023-10-01T07:58:37.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.995+0000 7fdce74d5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdce01334b0 con 0x7fdce009de50 2023-10-01T07:58:37.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.995+0000 7fdce4a70700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdce009de50 0x7fdce009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:37.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.995+0000 7fdce4a70700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdce009de50 0x7fdce009e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39210/0 (socket says 172.21.15.26:39210) 2023-10-01T07:58:37.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.995+0000 7fdce4a70700 1 -- 172.21.15.26:0/4159828454 learned_addr learned my addr 172.21.15.26:0/4159828454 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:37.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.995+0000 7fdce5271700 1 --2- 172.21.15.26:0/4159828454 >> v2:172.21.15.26:3300/0 conn(0x7fdce01338a0 0x7fdce0133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:37.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.996+0000 7fdce4a70700 1 -- 172.21.15.26:0/4159828454 >> v2:172.21.15.26:3300/0 conn(0x7fdce01338a0 msgr2=0x7fdce0133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:37.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.996+0000 7fdce4a70700 1 --2- 172.21.15.26:0/4159828454 >> v2:172.21.15.26:3300/0 conn(0x7fdce01338a0 0x7fdce0133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:37.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.996+0000 7fdce4a70700 1 -- 172.21.15.26:0/4159828454 >> v1:172.21.15.26:6789/0 conn(0x7fdce009e760 legacy=0x7fdce013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:37.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.996+0000 7fdce4a70700 1 -- 172.21.15.26:0/4159828454 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce006fc30 con 0x7fdce009de50 2023-10-01T07:58:37.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.996+0000 7fdcd7fff700 1 -- 172.21.15.26:0/4159828454 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2126882497 0 0) 0x7fdce006ef30 con 0x7fdce009e760 2023-10-01T07:58:37.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.996+0000 7fdce4a70700 1 --2- 172.21.15.26:0/4159828454 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdce009de50 0x7fdce009e220 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fdcd00098f0 tx=0x7fdcd0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f43e894c9a59a248 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:37.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.996+0000 7fdcd7fff700 1 -- 172.21.15.26:0/4159828454 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0011830 con 0x7fdce009de50 2023-10-01T07:58:37.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.996+0000 7fdcd7fff700 1 -- 172.21.15.26:0/4159828454 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd0011990 con 0x7fdce009de50 2023-10-01T07:58:37.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.996+0000 7fdcd7fff700 1 -- 172.21.15.26:0/4159828454 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0011d20 con 0x7fdce009de50 2023-10-01T07:58:37.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.997+0000 7fdce74d5700 1 -- 172.21.15.26:0/4159828454 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdce009de50 msgr2=0x7fdce009e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:37.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.997+0000 7fdce74d5700 1 --2- 172.21.15.26:0/4159828454 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdce009de50 0x7fdce009e220 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fdcd00098f0 tx=0x7fdcd0009c00 comp rx=0 tx=0).stop 2023-10-01T07:58:37.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.997+0000 7fdce74d5700 1 -- 172.21.15.26:0/4159828454 shutdown_connections 2023-10-01T07:58:37.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.997+0000 7fdce74d5700 1 --2- 172.21.15.26:0/4159828454 >> v2:172.21.15.26:3300/0 conn(0x7fdce01338a0 0x7fdce0133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:37.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.997+0000 7fdce74d5700 1 --2- 172.21.15.26:0/4159828454 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdce009de50 0x7fdce009e220 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:37.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.997+0000 7fdce74d5700 1 -- 172.21.15.26:0/4159828454 >> 172.21.15.26:0/4159828454 conn(0x7fdce00a2aa0 msgr2=0x7fdce00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:37.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.997+0000 7fdce74d5700 1 -- 172.21.15.26:0/4159828454 shutdown_connections 2023-10-01T07:58:37.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.997+0000 7fdce74d5700 1 -- 172.21.15.26:0/4159828454 wait complete. 2023-10-01T07:58:38.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.998+0000 7fdce74d5700 1 Processor -- start 2023-10-01T07:58:38.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.998+0000 7fdce74d5700 1 -- start start 2023-10-01T07:58:38.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.998+0000 7fdce74d5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdce009de50 0x7fdce011a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:38.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.999+0000 7fdce74d5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdce009e760 0x7fdce011ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:38.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.999+0000 7fdce74d5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdce01338a0 0x7fdce011b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:38.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.999+0000 7fdce74d5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce011c260 con 0x7fdce01338a0 2023-10-01T07:58:38.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.999+0000 7fdce74d5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce011d4b0 con 0x7fdce009e760 2023-10-01T07:58:38.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.999+0000 7fdce74d5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdce011c850 con 0x7fdce009de50 2023-10-01T07:58:38.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.999+0000 7fdce5a72700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdce01338a0 0x7fdce011b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:38.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.999+0000 7fdce5a72700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdce01338a0 0x7fdce011b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52416/0 (socket says 172.21.15.26:52416) 2023-10-01T07:58:38.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.999+0000 7fdce5a72700 1 -- 172.21.15.26:0/2514814595 learned_addr learned my addr 172.21.15.26:0/2514814595 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:38.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.999+0000 7fdce5271700 1 --2- 172.21.15.26:0/2514814595 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdce009de50 0x7fdce011a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:38.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.999+0000 7fdce5a72700 1 -- 172.21.15.26:0/2514814595 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdce009de50 msgr2=0x7fdce011a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:38.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.999+0000 7fdce5a72700 1 --2- 172.21.15.26:0/2514814595 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdce009de50 0x7fdce011a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:38.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.999+0000 7fdce5a72700 1 -- 172.21.15.26:0/2514814595 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdce009e760 msgr2=0x7fdce011ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:38.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.999+0000 7fdce5a72700 1 --2- 172.21.15.26:0/2514814595 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdce009e760 0x7fdce011ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:38.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.999+0000 7fdce5a72700 1 -- 172.21.15.26:0/2514814595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd0009550 con 0x7fdce01338a0 2023-10-01T07:58:38.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:37.999+0000 7fdce5a72700 1 --2- 172.21.15.26:0/2514814595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdce01338a0 0x7fdce011b1b0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800c810 tx=0x7fdcd800cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:38.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.000+0000 7fdcd5ffb700 1 -- 172.21.15.26:0/2514814595 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8003e30 con 0x7fdce01338a0 2023-10-01T07:58:38.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.000+0000 7fdcd5ffb700 1 -- 172.21.15.26:0/2514814595 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd8005070 con 0x7fdce01338a0 2023-10-01T07:58:38.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.000+0000 7fdcd5ffb700 1 -- 172.21.15.26:0/2514814595 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8005420 con 0x7fdce01338a0 2023-10-01T07:58:38.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.000+0000 7fdce74d5700 1 -- 172.21.15.26:0/2514814595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce011d900 con 0x7fdce01338a0 2023-10-01T07:58:38.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.000+0000 7fdce74d5700 1 -- 172.21.15.26:0/2514814595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce006f640 con 0x7fdce01338a0 2023-10-01T07:58:38.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.001+0000 7fdcd5ffb700 1 -- 172.21.15.26:0/2514814595 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdcd8005580 con 0x7fdce01338a0 2023-10-01T07:58:38.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.001+0000 7fdcd5ffb700 1 -- 172.21.15.26:0/2514814595 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdcd803f3b0 con 0x7fdce01338a0 2023-10-01T07:58:38.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.001+0000 7fdce74d5700 1 -- 172.21.15.26:0/2514814595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce0074ea0 con 0x7fdce01338a0 2023-10-01T07:58:38.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.011+0000 7fdcd5ffb700 1 -- 172.21.15.26:0/2514814595 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdcd8005830 con 0x7fdce01338a0 2023-10-01T07:58:38.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.126+0000 7f781799b700 1 -- 172.21.15.26:0/3245121473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f781009f420 con 0x7f781009e000 2023-10-01T07:58:38.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.127+0000 7f7805ffb700 1 -- 172.21.15.26:0/3245121473 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7800017020 con 0x7f781009e000 2023-10-01T07:58:38.127 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:38.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.130+0000 7f781799b700 1 -- 172.21.15.26:0/3245121473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f781009e000 msgr2=0x7f78101a63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:38.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.130+0000 7f781799b700 1 --2- 172.21.15.26:0/3245121473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f781009e000 0x7f78101a63d0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f780000c4e0 tx=0x7f780000c7f0 comp rx=0 tx=0).stop 2023-10-01T07:58:38.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.130+0000 7f781799b700 1 -- 172.21.15.26:0/3245121473 shutdown_connections 2023-10-01T07:58:38.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.130+0000 7f781799b700 1 --2- 172.21.15.26:0/3245121473 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f781009e440 0x7f78101a6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:38.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.130+0000 7f781799b700 1 --2- 172.21.15.26:0/3245121473 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f781009d6f0 0x7f78101a5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:38.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.130+0000 7f781799b700 1 --2- 172.21.15.26:0/3245121473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f781009e000 0x7f78101a63d0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:38.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.130+0000 7f781799b700 1 -- 172.21.15.26:0/3245121473 >> 172.21.15.26:0/3245121473 conn(0x7f7810066f50 msgr2=0x7f78101bae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:38.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.130+0000 7f781799b700 1 -- 172.21.15.26:0/3245121473 shutdown_connections 2023-10-01T07:58:38.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.130+0000 7f781799b700 1 -- 172.21.15.26:0/3245121473 wait complete. 2023-10-01T07:58:38.145 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:38.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.156+0000 7f7680a67700 1 -- 172.21.15.26:0/3318954842 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f767c074ea0 con 0x7f767c09e000 2023-10-01T07:58:38.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.157+0000 7f766affd700 1 -- 172.21.15.26:0/3318954842 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f767001c350 con 0x7f767c09e000 2023-10-01T07:58:38.157 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:38.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.159+0000 7f7680a67700 1 -- 172.21.15.26:0/3318954842 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f767c09e000 msgr2=0x7f767c11e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:38.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.159+0000 7f7680a67700 1 --2- 172.21.15.26:0/3318954842 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f767c09e000 0x7f767c11e480 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f767000c4b0 tx=0x7f767000c7c0 comp rx=0 tx=0).stop 2023-10-01T07:58:38.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.159+0000 7f7680a67700 1 -- 172.21.15.26:0/3318954842 shutdown_connections 2023-10-01T07:58:38.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.159+0000 7f7680a67700 1 --2- 172.21.15.26:0/3318954842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f767c09e410 0x7f767c11e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:38.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.159+0000 7f7680a67700 1 --2- 172.21.15.26:0/3318954842 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f767c09d6f0 0x7f767c11df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:38.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.159+0000 7f7680a67700 1 --2- 172.21.15.26:0/3318954842 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f767c09e000 0x7f767c11e480 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:38.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.159+0000 7f7680a67700 1 -- 172.21.15.26:0/3318954842 >> 172.21.15.26:0/3318954842 conn(0x7f767c066f50 msgr2=0x7f767c130b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:38.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.159+0000 7f7680a67700 1 -- 172.21.15.26:0/3318954842 shutdown_connections 2023-10-01T07:58:38.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.159+0000 7f7680a67700 1 -- 172.21.15.26:0/3318954842 wait complete. 2023-10-01T07:58:38.174 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:38.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.179+0000 7ff94923c700 1 -- 172.21.15.26:0/4135998193 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff94411a9d0 con 0x7ff944130430 2023-10-01T07:58:38.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.179+0000 7ff92b7fe700 1 -- 172.21.15.26:0/4135998193 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff94411a9d0 con 0x7ff944130430 2023-10-01T07:58:38.180 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:38.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.181+0000 7ff94923c700 1 -- 172.21.15.26:0/4135998193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff944130430 msgr2=0x7ff9441c6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:38.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.181+0000 7ff94923c700 1 --2- 172.21.15.26:0/4135998193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff944130430 0x7ff9441c6230 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7ff93c009d60 tx=0x7ff93c00c3a0 comp rx=0 tx=0).stop 2023-10-01T07:58:38.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.181+0000 7ff94923c700 1 -- 172.21.15.26:0/4135998193 shutdown_connections 2023-10-01T07:58:38.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.181+0000 7ff94923c700 1 --2- 172.21.15.26:0/4135998193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff944130430 0x7ff9441c6230 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:38.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.181+0000 7ff94923c700 1 --2- 172.21.15.26:0/4135998193 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff94412cf60 0x7ff94409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:38.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.181+0000 7ff94923c700 1 --2- 172.21.15.26:0/4135998193 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff94412f8b0 0x7ff94409e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:38.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.181+0000 7ff94923c700 1 -- 172.21.15.26:0/4135998193 >> 172.21.15.26:0/4135998193 conn(0x7ff9440a2aa0 msgr2=0x7ff94406e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:38.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.182+0000 7ff94923c700 1 -- 172.21.15.26:0/4135998193 shutdown_connections 2023-10-01T07:58:38.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.182+0000 7ff94923c700 1 -- 172.21.15.26:0/4135998193 wait complete. 2023-10-01T07:58:38.196 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:38.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.219+0000 7fdce74d5700 1 -- 172.21.15.26:0/2514814595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdce011def0 con 0x7fdce01338a0 2023-10-01T07:58:38.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.220+0000 7fdcd5ffb700 1 -- 172.21.15.26:0/2514814595 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdcd801a360 con 0x7fdce01338a0 2023-10-01T07:58:38.220 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:38.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.222+0000 7fdce74d5700 1 -- 172.21.15.26:0/2514814595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdce01338a0 msgr2=0x7fdce011b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:38.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.222+0000 7fdce74d5700 1 --2- 172.21.15.26:0/2514814595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdce01338a0 0x7fdce011b1b0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800c810 tx=0x7fdcd800cb20 comp rx=0 tx=0).stop 2023-10-01T07:58:38.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.222+0000 7fdce74d5700 1 -- 172.21.15.26:0/2514814595 shutdown_connections 2023-10-01T07:58:38.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.222+0000 7fdce74d5700 1 --2- 172.21.15.26:0/2514814595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdce01338a0 0x7fdce011b1b0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:38.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.222+0000 7fdce74d5700 1 --2- 172.21.15.26:0/2514814595 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdce009de50 0x7fdce011a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:38.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.222+0000 7fdce74d5700 1 --2- 172.21.15.26:0/2514814595 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdce009e760 0x7fdce011ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:38.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.222+0000 7fdce74d5700 1 -- 172.21.15.26:0/2514814595 >> 172.21.15.26:0/2514814595 conn(0x7fdce00a2aa0 msgr2=0x7fdce0130730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:38.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.222+0000 7fdce74d5700 1 -- 172.21.15.26:0/2514814595 shutdown_connections 2023-10-01T07:58:38.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:38.222+0000 7fdce74d5700 1 -- 172.21.15.26:0/2514814595 wait complete. 2023-10-01T07:58:38.236 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:39.146 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:39.175 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:39.197 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:39.237 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:39.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.297+0000 7fbf873a1700 1 Processor -- start 2023-10-01T07:58:39.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.297+0000 7fbf873a1700 1 -- start start 2023-10-01T07:58:39.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.298+0000 7fbf873a1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf800a0870 0x7fbf800a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:39.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.298+0000 7fbf873a1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbf800a1180 0x7fbf80133790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:39.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.298+0000 7fbf873a1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf8009db90 con 0x7fbf800a15b0 2023-10-01T07:58:39.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.298+0000 7fbf873a1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf800a1ce0 con 0x7fbf800a1180 2023-10-01T07:58:39.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.298+0000 7fbf873a1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf800a24f0 con 0x7fbf800a0870 2023-10-01T07:58:39.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.298+0000 7fbf85b9e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbf800a1180 0x7fbf80133790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:39.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.298+0000 7fbf8639f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf800a0870 0x7fbf800a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:39.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.298+0000 7fbf8639f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf800a0870 0x7fbf800a0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39226/0 (socket says 172.21.15.26:39226) 2023-10-01T07:58:39.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.298+0000 7fbf85b9e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbf800a1180 0x7fbf80133790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52430/0 (socket says 172.21.15.26:52430) 2023-10-01T07:58:39.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.298+0000 7fbf8639f700 1 -- 172.21.15.26:0/706135354 learned_addr learned my addr 172.21.15.26:0/706135354 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:39.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.299+0000 7fbf8639f700 1 -- 172.21.15.26:0/706135354 >> v2:172.21.15.26:3300/0 conn(0x7fbf800a1180 msgr2=0x7fbf80133790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:39.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.299+0000 7fbf8639f700 1 --2- 172.21.15.26:0/706135354 >> v2:172.21.15.26:3300/0 conn(0x7fbf800a1180 0x7fbf80133790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.299+0000 7fbf8639f700 1 -- 172.21.15.26:0/706135354 >> v1:172.21.15.26:6789/0 conn(0x7fbf800a15b0 legacy=0x7fbf80133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:39.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.299+0000 7fbf8639f700 1 -- 172.21.15.26:0/706135354 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf800a1aa0 con 0x7fbf800a0870 2023-10-01T07:58:39.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.299+0000 7fbf8639f700 1 --2- 172.21.15.26:0/706135354 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf800a0870 0x7fbf800a0c40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c0098f0 tx=0x7fbf7c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe7aa9f4d47156fd server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:39.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.299+0000 7fbf8539d700 1 -- 172.21.15.26:0/706135354 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c011830 con 0x7fbf800a0870 2023-10-01T07:58:39.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.299+0000 7fbf8539d700 1 -- 172.21.15.26:0/706135354 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7c011990 con 0x7fbf800a0870 2023-10-01T07:58:39.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.299+0000 7fbf8539d700 1 -- 172.21.15.26:0/706135354 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c011d20 con 0x7fbf800a0870 2023-10-01T07:58:39.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.300+0000 7fbf873a1700 1 -- 172.21.15.26:0/706135354 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf800a0870 msgr2=0x7fbf800a0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:39.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.300+0000 7fbf873a1700 1 --2- 172.21.15.26:0/706135354 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf800a0870 0x7fbf800a0c40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c0098f0 tx=0x7fbf7c009c00 comp rx=0 tx=0).stop 2023-10-01T07:58:39.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.300+0000 7fbf873a1700 1 -- 172.21.15.26:0/706135354 shutdown_connections 2023-10-01T07:58:39.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.300+0000 7fbf873a1700 1 --2- 172.21.15.26:0/706135354 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf800a0870 0x7fbf800a0c40 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.300+0000 7fbf873a1700 1 --2- 172.21.15.26:0/706135354 >> v2:172.21.15.26:3300/0 conn(0x7fbf800a1180 0x7fbf80133790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.300+0000 7fbf873a1700 1 -- 172.21.15.26:0/706135354 >> 172.21.15.26:0/706135354 conn(0x7fbf800a6390 msgr2=0x7fbf800a6790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:39.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.300+0000 7fbf873a1700 1 -- 172.21.15.26:0/706135354 shutdown_connections 2023-10-01T07:58:39.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.300+0000 7fbf873a1700 1 -- 172.21.15.26:0/706135354 wait complete. 2023-10-01T07:58:39.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.302+0000 7fbf873a1700 1 Processor -- start 2023-10-01T07:58:39.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.302+0000 7fbf873a1700 1 -- start start 2023-10-01T07:58:39.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.302+0000 7fbf873a1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf800a0870 0x7fbf80122050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:39.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.302+0000 7fbf873a1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf800a1180 0x7fbf80122590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:39.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.302+0000 7fbf873a1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf800a15b0 0x7fbf80122ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:39.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.302+0000 7fbf873a1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf80124e90 con 0x7fbf800a0870 2023-10-01T07:58:39.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.302+0000 7fbf873a1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf80123ce0 con 0x7fbf800a1180 2023-10-01T07:58:39.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.302+0000 7fbf873a1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf80125540 con 0x7fbf800a15b0 2023-10-01T07:58:39.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.303+0000 7fbf8639f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf800a0870 0x7fbf80122050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:39.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.303+0000 7fbf85b9e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf800a1180 0x7fbf80122590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:39.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.303+0000 7fbf8639f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf800a0870 0x7fbf80122050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52442/0 (socket says 172.21.15.26:52442) 2023-10-01T07:58:39.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.303+0000 7fbf8639f700 1 -- 172.21.15.26:0/1968960169 learned_addr learned my addr 172.21.15.26:0/1968960169 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:39.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.303+0000 7fbf86ba0700 1 --2- 172.21.15.26:0/1968960169 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf800a15b0 0x7fbf80122ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:39.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.303+0000 7fbf8639f700 1 -- 172.21.15.26:0/1968960169 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf800a15b0 msgr2=0x7fbf80122ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:39.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.303+0000 7fbf8639f700 1 --2- 172.21.15.26:0/1968960169 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf800a15b0 0x7fbf80122ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.303+0000 7fbf8639f700 1 -- 172.21.15.26:0/1968960169 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf800a1180 msgr2=0x7fbf80122590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:39.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.303+0000 7fbf8639f700 1 --2- 172.21.15.26:0/1968960169 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf800a1180 0x7fbf80122590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.303+0000 7fbf8639f700 1 -- 172.21.15.26:0/1968960169 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf7c009550 con 0x7fbf800a0870 2023-10-01T07:58:39.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.303+0000 7fbf85b9e700 1 --2- 172.21.15.26:0/1968960169 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf800a1180 0x7fbf80122590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:39.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.303+0000 7fbf8639f700 1 --2- 172.21.15.26:0/1968960169 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf800a0870 0x7fbf80122050 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c009c40 tx=0x7fbf7c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:39.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.304+0000 7fbf76ffd700 1 -- 172.21.15.26:0/1968960169 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c004510 con 0x7fbf800a0870 2023-10-01T07:58:39.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.304+0000 7fbf76ffd700 1 -- 172.21.15.26:0/1968960169 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7c01e070 con 0x7fbf800a0870 2023-10-01T07:58:39.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.304+0000 7fbf873a1700 1 -- 172.21.15.26:0/1968960169 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf8009cec0 con 0x7fbf800a0870 2023-10-01T07:58:39.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.304+0000 7fbf76ffd700 1 -- 172.21.15.26:0/1968960169 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c0038e0 con 0x7fbf800a0870 2023-10-01T07:58:39.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.304+0000 7fbf873a1700 1 -- 172.21.15.26:0/1968960169 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf80125ae0 con 0x7fbf800a0870 2023-10-01T07:58:39.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.305+0000 7fbf76ffd700 1 -- 172.21.15.26:0/1968960169 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbf7c003a40 con 0x7fbf800a0870 2023-10-01T07:58:39.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.305+0000 7fbf76ffd700 1 -- 172.21.15.26:0/1968960169 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbf7c020070 con 0x7fbf800a0870 2023-10-01T07:58:39.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.305+0000 7fbf873a1700 1 -- 172.21.15.26:0/1968960169 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf8004f2a0 con 0x7fbf800a0870 2023-10-01T07:58:39.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.315+0000 7fbf76ffd700 1 -- 172.21.15.26:0/1968960169 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbf7c015020 con 0x7fbf800a0870 2023-10-01T07:58:39.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.341+0000 7f5607cd3700 1 Processor -- start 2023-10-01T07:58:39.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.341+0000 7f5607cd3700 1 -- start start 2023-10-01T07:58:39.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.342+0000 7f5607cd3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f560009d6f0 0x7f560009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:39.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.342+0000 7f5607cd3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f560009e000 0x7f56001339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.342+0000 7f5607cd3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f560009e410 0x7f5600133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.342+0000 7f5607cd3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f560006b460 con 0x7f560009d6f0 2023-10-01T07:58:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.342+0000 7f5607cd3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f560009b120 con 0x7f560009e000 2023-10-01T07:58:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.342+0000 7f5607cd3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f560009a7e0 con 0x7f560009e410 2023-10-01T07:58:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.342+0000 7f5605a6f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f560009d6f0 0x7f560009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.342+0000 7f560526e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f560009e000 0x7f56001339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.342+0000 7f5605a6f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f560009d6f0 0x7f560009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52456/0 (socket says 172.21.15.26:52456) 2023-10-01T07:58:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.342+0000 7f5605a6f700 1 -- 172.21.15.26:0/3662950425 learned_addr learned my addr 172.21.15.26:0/3662950425 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.342+0000 7f5606270700 1 --2- 172.21.15.26:0/3662950425 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f560009e410 0x7f5600133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.343+0000 7f560526e700 1 -- 172.21.15.26:0/3662950425 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f560009e410 msgr2=0x7f5600133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.343+0000 7f560526e700 1 --2- 172.21.15.26:0/3662950425 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f560009e410 0x7f5600133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.343+0000 7f560526e700 1 -- 172.21.15.26:0/3662950425 >> v2:172.21.15.26:3300/0 conn(0x7f560009d6f0 msgr2=0x7f560009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:39.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.343+0000 7f560526e700 1 --2- 172.21.15.26:0/3662950425 >> v2:172.21.15.26:3300/0 conn(0x7f560009d6f0 0x7f560009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.343+0000 7f560526e700 1 -- 172.21.15.26:0/3662950425 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560009a500 con 0x7f560009e000 2023-10-01T07:58:39.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.343+0000 7f560526e700 1 --2- 172.21.15.26:0/3662950425 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f560009e000 0x7f56001339f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f55f0009870 tx=0x7f55f0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97dd43e19fb46b00 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:39.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.343+0000 7f5604a6d700 1 -- 172.21.15.26:0/3662950425 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f0014e90 con 0x7f560009e000 2023-10-01T07:58:39.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.343+0000 7f5604a6d700 1 -- 172.21.15.26:0/3662950425 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f001c440 con 0x7f560009e000 2023-10-01T07:58:39.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.343+0000 7f5604a6d700 1 -- 172.21.15.26:0/3662950425 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f001c7d0 con 0x7f560009e000 2023-10-01T07:58:39.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.344+0000 7f5607cd3700 1 -- 172.21.15.26:0/3662950425 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f560009e000 msgr2=0x7f56001339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:39.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.344+0000 7f5607cd3700 1 --2- 172.21.15.26:0/3662950425 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f560009e000 0x7f56001339f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f55f0009870 tx=0x7f55f0009b80 comp rx=0 tx=0).stop 2023-10-01T07:58:39.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.344+0000 7f5607cd3700 1 -- 172.21.15.26:0/3662950425 shutdown_connections 2023-10-01T07:58:39.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.344+0000 7f5607cd3700 1 --2- 172.21.15.26:0/3662950425 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f560009e410 0x7f5600133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.344+0000 7f5607cd3700 1 --2- 172.21.15.26:0/3662950425 >> v2:172.21.15.26:3300/0 conn(0x7f560009d6f0 0x7f560009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.344+0000 7f5607cd3700 1 --2- 172.21.15.26:0/3662950425 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f560009e000 0x7f56001339f0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.344+0000 7f5607cd3700 1 -- 172.21.15.26:0/3662950425 >> 172.21.15.26:0/3662950425 conn(0x7f5600066f50 msgr2=0x7f560009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:39.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.344+0000 7f5607cd3700 1 -- 172.21.15.26:0/3662950425 shutdown_connections 2023-10-01T07:58:39.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.344+0000 7f5607cd3700 1 -- 172.21.15.26:0/3662950425 wait complete. 2023-10-01T07:58:39.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.345+0000 7f5607cd3700 1 Processor -- start 2023-10-01T07:58:39.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.345+0000 7f5607cd3700 1 -- start start 2023-10-01T07:58:39.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.346+0000 7f5607cd3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f560009d6f0 0x7f56001a1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:39.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.346+0000 7f5607cd3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f560009e000 0x7f56001a2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:39.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.346+0000 7f5605a6f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f560009d6f0 0x7f56001a1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:39.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.346+0000 7f5605a6f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f560009d6f0 0x7f56001a1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39244/0 (socket says 172.21.15.26:39244) 2023-10-01T07:58:39.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.346+0000 7f560526e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f560009e000 0x7f56001a2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:39.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.346+0000 7f560526e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f560009e000 0x7f56001a2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52464/0 (socket says 172.21.15.26:52464) 2023-10-01T07:58:39.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.346+0000 7f5607cd3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f560009e410 0x7f56001a2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:39.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.346+0000 7f5607cd3700 1 -- 172.21.15.26:0/1572986816 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56001b4fc0 con 0x7f560009e000 2023-10-01T07:58:39.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.346+0000 7f5605a6f700 1 -- 172.21.15.26:0/1572986816 learned_addr learned my addr 172.21.15.26:0/1572986816 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:39.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.346+0000 7f5607cd3700 1 -- 172.21.15.26:0/1572986816 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56001a3030 con 0x7f560009e410 2023-10-01T07:58:39.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.346+0000 7f5607cd3700 1 -- 172.21.15.26:0/1572986816 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56001a4a30 con 0x7f560009d6f0 2023-10-01T07:58:39.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.346+0000 7f5606270700 1 --2- 172.21.15.26:0/1572986816 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f560009e410 0x7f56001a2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:39.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.346+0000 7f560526e700 1 -- 172.21.15.26:0/1572986816 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f560009d6f0 msgr2=0x7f56001a1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:39.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.346+0000 7f560526e700 1 --2- 172.21.15.26:0/1572986816 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f560009d6f0 0x7f56001a1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.346+0000 7f560526e700 1 -- 172.21.15.26:0/1572986816 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f560009e410 msgr2=0x7f56001a2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:39.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.346+0000 7f560526e700 1 --2- 172.21.15.26:0/1572986816 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f560009e410 0x7f56001a2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.346+0000 7f560526e700 1 -- 172.21.15.26:0/1572986816 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f00094a0 con 0x7f560009e000 2023-10-01T07:58:39.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.347+0000 7f560526e700 1 --2- 172.21.15.26:0/1572986816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f560009e000 0x7f56001a2110 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f55f001e000 tx=0x7f55f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:39.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.347+0000 7f55f67fc700 1 -- 172.21.15.26:0/1572986816 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f001c7b0 con 0x7f560009e000 2023-10-01T07:58:39.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.347+0000 7f55f67fc700 1 -- 172.21.15.26:0/1572986816 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f0003e90 con 0x7f560009e000 2023-10-01T07:58:39.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.347+0000 7f55f67fc700 1 -- 172.21.15.26:0/1572986816 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f001cb10 con 0x7f560009e000 2023-10-01T07:58:39.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.347+0000 7f5607cd3700 1 -- 172.21.15.26:0/1572986816 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56001a3dc0 con 0x7f560009e000 2023-10-01T07:58:39.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.347+0000 7f5607cd3700 1 -- 172.21.15.26:0/1572986816 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56000a1fb0 con 0x7f560009e000 2023-10-01T07:58:39.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.348+0000 7f5607cd3700 1 -- 172.21.15.26:0/1572986816 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f560009c710 con 0x7f560009e000 2023-10-01T07:58:39.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.349+0000 7f55f67fc700 1 -- 172.21.15.26:0/1572986816 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f55f0023070 con 0x7f560009e000 2023-10-01T07:58:39.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.349+0000 7f55f67fc700 1 -- 172.21.15.26:0/1572986816 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f55f0049920 con 0x7f560009e000 2023-10-01T07:58:39.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.354+0000 7f55f67fc700 1 -- 172.21.15.26:0/1572986816 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f55f002f770 con 0x7f560009e000 2023-10-01T07:58:39.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.384+0000 7fac0abcf700 1 Processor -- start 2023-10-01T07:58:39.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.384+0000 7fac0abcf700 1 -- start start 2023-10-01T07:58:39.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.384+0000 7fac0abcf700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fac0406e570 0x7fac0406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:39.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.384+0000 7fac0abcf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac0406ee80 0x7fac04134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:39.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.384+0000 7fac0abcf700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac04070ee0 con 0x7fac0409eca0 2023-10-01T07:58:39.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.384+0000 7fac0abcf700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac04071480 con 0x7fac0406e570 2023-10-01T07:58:39.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.384+0000 7fac0abcf700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac04071b90 con 0x7fac0406ee80 2023-10-01T07:58:39.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.384+0000 7fac0916c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac0406ee80 0x7fac04134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:39.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.385+0000 7fac0916c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac0406ee80 0x7fac04134d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:52138/0 (socket says 172.21.15.26:52138) 2023-10-01T07:58:39.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.385+0000 7fac0916c700 1 -- 172.21.15.26:0/2049361399 learned_addr learned my addr 172.21.15.26:0/2049361399 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:39.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.385+0000 7fac0896b700 1 --2- 172.21.15.26:0/2049361399 >> v2:172.21.15.26:3300/0 conn(0x7fac0406e570 0x7fac0406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:39.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.385+0000 7fac0896b700 1 -- 172.21.15.26:0/2049361399 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac0406ee80 msgr2=0x7fac04134d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:39.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.385+0000 7fac0896b700 1 --2- 172.21.15.26:0/2049361399 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac0406ee80 0x7fac04134d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.385+0000 7fac0896b700 1 -- 172.21.15.26:0/2049361399 >> v1:172.21.15.26:6789/0 conn(0x7fac0409eca0 legacy=0x7fac04134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:39.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.385+0000 7fac0896b700 1 -- 172.21.15.26:0/2049361399 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac040711a0 con 0x7fac0406e570 2023-10-01T07:58:39.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.385+0000 7fac0896b700 1 --2- 172.21.15.26:0/2049361399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac0406e570 0x7fac0406e940 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fabf8009840 tx=0x7fabf8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be2e018484160e11 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:39.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.385+0000 7fac037fe700 1 -- 172.21.15.26:0/2049361399 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf8011830 con 0x7fac0406e570 2023-10-01T07:58:39.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.385+0000 7fac037fe700 1 -- 172.21.15.26:0/2049361399 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf8011990 con 0x7fac0406e570 2023-10-01T07:58:39.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.386+0000 7fac037fe700 1 -- 172.21.15.26:0/2049361399 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf8011d20 con 0x7fac0406e570 2023-10-01T07:58:39.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.386+0000 7fac0abcf700 1 -- 172.21.15.26:0/2049361399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac0406e570 msgr2=0x7fac0406e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:39.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.386+0000 7fac0abcf700 1 --2- 172.21.15.26:0/2049361399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac0406e570 0x7fac0406e940 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fabf8009840 tx=0x7fabf8009b50 comp rx=0 tx=0).stop 2023-10-01T07:58:39.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.387+0000 7fac0abcf700 1 -- 172.21.15.26:0/2049361399 shutdown_connections 2023-10-01T07:58:39.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.387+0000 7fac0abcf700 1 --2- 172.21.15.26:0/2049361399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac0406e570 0x7fac0406e940 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.387+0000 7fac0abcf700 1 --2- 172.21.15.26:0/2049361399 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac0406ee80 0x7fac04134d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.387+0000 7fac0abcf700 1 -- 172.21.15.26:0/2049361399 >> 172.21.15.26:0/2049361399 conn(0x7fac040a2aa0 msgr2=0x7fac040a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:39.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.387+0000 7fac0abcf700 1 -- 172.21.15.26:0/2049361399 shutdown_connections 2023-10-01T07:58:39.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.387+0000 7fac0abcf700 1 -- 172.21.15.26:0/2049361399 wait complete. 2023-10-01T07:58:39.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.388+0000 7fac0abcf700 1 Processor -- start 2023-10-01T07:58:39.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.388+0000 7fac0abcf700 1 -- start start 2023-10-01T07:58:39.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.389+0000 7fac0abcf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac0406e570 0x7fac04134cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:39.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.389+0000 7fac0abcf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac0406ee80 0x7fac04138880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:39.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.389+0000 7fac0abcf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac04138dc0 0x7fac04139240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:39.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.389+0000 7fac0abcf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0413b7d0 con 0x7fac0406ee80 2023-10-01T07:58:39.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.389+0000 7fac0abcf700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac0413b9b0 con 0x7fac0406e570 2023-10-01T07:58:39.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.389+0000 7fac0abcf700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac04134910 con 0x7fac04138dc0 2023-10-01T07:58:39.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.389+0000 7fac03fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac0406ee80 0x7fac04138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:39.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.389+0000 7fac0896b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac0406e570 0x7fac04134cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:39.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.389+0000 7fac03fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac0406ee80 0x7fac04138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52488/0 (socket says 172.21.15.26:52488) 2023-10-01T07:58:39.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.389+0000 7fac03fff700 1 -- 172.21.15.26:0/1399788067 learned_addr learned my addr 172.21.15.26:0/1399788067 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:39.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.389+0000 7fac0916c700 1 --2- 172.21.15.26:0/1399788067 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac04138dc0 0x7fac04139240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:39.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.390+0000 7fac03fff700 1 -- 172.21.15.26:0/1399788067 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac04138dc0 msgr2=0x7fac04139240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:39.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.390+0000 7fac03fff700 1 --2- 172.21.15.26:0/1399788067 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac04138dc0 0x7fac04139240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.390+0000 7fac03fff700 1 -- 172.21.15.26:0/1399788067 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac0406e570 msgr2=0x7fac04134cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:39.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.390+0000 7fac03fff700 1 --2- 172.21.15.26:0/1399788067 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac0406e570 0x7fac04134cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.390+0000 7fac03fff700 1 -- 172.21.15.26:0/1399788067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf80094a0 con 0x7fac0406ee80 2023-10-01T07:58:39.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.390+0000 7fac0896b700 1 --2- 172.21.15.26:0/1399788067 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac0406e570 0x7fac04134cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:39.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.390+0000 7fac03fff700 1 --2- 172.21.15.26:0/1399788067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac0406ee80 0x7fac04138880 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fabf000c4b0 tx=0x7fabf000c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:39.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.390+0000 7fac017fa700 1 -- 172.21.15.26:0/1399788067 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf00052d0 con 0x7fac0406ee80 2023-10-01T07:58:39.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.390+0000 7fac017fa700 1 -- 172.21.15.26:0/1399788067 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf0005430 con 0x7fac0406ee80 2023-10-01T07:58:39.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.390+0000 7fac017fa700 1 -- 172.21.15.26:0/1399788067 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf00038c0 con 0x7fac0406ee80 2023-10-01T07:58:39.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.390+0000 7fac0abcf700 1 -- 172.21.15.26:0/1399788067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac04135a00 con 0x7fac0406ee80 2023-10-01T07:58:39.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.390+0000 7fac0abcf700 1 -- 172.21.15.26:0/1399788067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac0413c320 con 0x7fac0406ee80 2023-10-01T07:58:39.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.392+0000 7fac0abcf700 1 -- 172.21.15.26:0/1399788067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac04137c40 con 0x7fac0406ee80 2023-10-01T07:58:39.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.393+0000 7fac017fa700 1 -- 172.21.15.26:0/1399788067 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fabf0003a20 con 0x7fac0406ee80 2023-10-01T07:58:39.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.393+0000 7fac017fa700 1 -- 172.21.15.26:0/1399788067 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fabf003ecf0 con 0x7fac0406ee80 2023-10-01T07:58:39.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.401+0000 7fac017fa700 1 -- 172.21.15.26:0/1399788067 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fabf0011590 con 0x7fac0406ee80 2023-10-01T07:58:39.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.427+0000 7f1c0769b700 1 Processor -- start 2023-10-01T07:58:39.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.428+0000 7f1c0769b700 1 -- start start 2023-10-01T07:58:39.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.428+0000 7f1c0769b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c0006a770 0x7f1c0006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:39.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.428+0000 7f1c0769b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1c0006b080 0x7f1c00131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:39.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.428+0000 7f1c0769b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c00131b40 0x7f1c00131fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:39.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.428+0000 7f1c0769b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c0009ece0 con 0x7f1c0006b080 2023-10-01T07:58:39.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.428+0000 7f1c0769b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0009e760 con 0x7f1c00131b40 2023-10-01T07:58:39.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.428+0000 7f1c0769b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0009e040 con 0x7f1c0006a770 2023-10-01T07:58:39.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.428+0000 7f1c05c38700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c00131b40 0x7f1c00131fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:39.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.428+0000 7f1c05c38700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c00131b40 0x7f1c00131fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:52152/0 (socket says 172.21.15.26:52152) 2023-10-01T07:58:39.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.428+0000 7f1c05c38700 1 -- 172.21.15.26:0/3271397751 learned_addr learned my addr 172.21.15.26:0/3271397751 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:39.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.428+0000 7f1c04c36700 1 --2- 172.21.15.26:0/3271397751 >> v2:172.21.15.26:3300/0 conn(0x7f1c0006b080 0x7f1c00131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:39.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.428+0000 7f1c05437700 1 --2- 172.21.15.26:0/3271397751 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c0006a770 0x7f1c0006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:39.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.429+0000 7f1c05c38700 1 -- 172.21.15.26:0/3271397751 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c0006a770 msgr2=0x7f1c0006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:39.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.429+0000 7f1c05c38700 1 --2- 172.21.15.26:0/3271397751 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c0006a770 0x7f1c0006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.429+0000 7f1c05c38700 1 -- 172.21.15.26:0/3271397751 >> v2:172.21.15.26:3300/0 conn(0x7f1c0006b080 msgr2=0x7f1c00131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:39.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.429+0000 7f1c05c38700 1 --2- 172.21.15.26:0/3271397751 >> v2:172.21.15.26:3300/0 conn(0x7f1c0006b080 0x7f1c00131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.429+0000 7f1c05c38700 1 -- 172.21.15.26:0/3271397751 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0009f630 con 0x7f1c00131b40 2023-10-01T07:58:39.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.429+0000 7f1c05c38700 1 --2- 172.21.15.26:0/3271397751 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c00131b40 0x7f1c00131fc0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8009e50 tx=0x7f1bf800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65c16d7964f04098 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:39.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.429+0000 7f1bf7fff700 1 -- 172.21.15.26:0/3271397751 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf800e070 con 0x7f1c00131b40 2023-10-01T07:58:39.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.429+0000 7f1bf7fff700 1 -- 172.21.15.26:0/3271397751 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf800b910 con 0x7f1c00131b40 2023-10-01T07:58:39.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.429+0000 7f1bf7fff700 1 -- 172.21.15.26:0/3271397751 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf800bcc0 con 0x7f1c00131b40 2023-10-01T07:58:39.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.430+0000 7f1c0769b700 1 -- 172.21.15.26:0/3271397751 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c00131b40 msgr2=0x7f1c00131fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:39.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.430+0000 7f1c0769b700 1 --2- 172.21.15.26:0/3271397751 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c00131b40 0x7f1c00131fc0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8009e50 tx=0x7f1bf800b330 comp rx=0 tx=0).stop 2023-10-01T07:58:39.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.430+0000 7f1c0769b700 1 -- 172.21.15.26:0/3271397751 shutdown_connections 2023-10-01T07:58:39.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.430+0000 7f1c0769b700 1 --2- 172.21.15.26:0/3271397751 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c00131b40 0x7f1c00131fc0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.430+0000 7f1c0769b700 1 --2- 172.21.15.26:0/3271397751 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c0006a770 0x7f1c0006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.430+0000 7f1c0769b700 1 --2- 172.21.15.26:0/3271397751 >> v2:172.21.15.26:3300/0 conn(0x7f1c0006b080 0x7f1c00131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.430+0000 7f1c0769b700 1 -- 172.21.15.26:0/3271397751 >> 172.21.15.26:0/3271397751 conn(0x7f1c00066f50 msgr2=0x7f1c0009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:39.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.430+0000 7f1c0769b700 1 -- 172.21.15.26:0/3271397751 shutdown_connections 2023-10-01T07:58:39.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.430+0000 7f1c0769b700 1 -- 172.21.15.26:0/3271397751 wait complete. 2023-10-01T07:58:39.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.431+0000 7f1c0769b700 1 Processor -- start 2023-10-01T07:58:39.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.432+0000 7f1c0769b700 1 -- start start 2023-10-01T07:58:39.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.432+0000 7f1c0769b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c0006a770 0x7f1c0009a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:39.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.432+0000 7f1c0769b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c0006b080 0x7f1c0009a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:39.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.432+0000 7f1c0769b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c00131b40 0x7f1c0009ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:39.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.432+0000 7f1c0769b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0009c030 con 0x7f1c00131b40 2023-10-01T07:58:39.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.432+0000 7f1c0769b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0009b7d0 con 0x7f1c0006b080 2023-10-01T07:58:39.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.432+0000 7f1c0769b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c001227e0 con 0x7f1c0006a770 2023-10-01T07:58:39.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.432+0000 7f1c05437700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c0006a770 0x7f1c0009a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:39.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.432+0000 7f1c05437700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c0006a770 0x7f1c0009a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39278/0 (socket says 172.21.15.26:39278) 2023-10-01T07:58:39.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.432+0000 7f1c05437700 1 -- 172.21.15.26:0/612343996 learned_addr learned my addr 172.21.15.26:0/612343996 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:39.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.432+0000 7f1c05c38700 1 --2- 172.21.15.26:0/612343996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c00131b40 0x7f1c0009ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:39.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.432+0000 7f1c04c36700 1 --2- 172.21.15.26:0/612343996 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c0006b080 0x7f1c0009a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:39.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.433+0000 7f1c05437700 1 -- 172.21.15.26:0/612343996 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c0006b080 msgr2=0x7f1c0009a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:39.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.433+0000 7f1c05437700 1 --2- 172.21.15.26:0/612343996 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c0006b080 0x7f1c0009a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.433+0000 7f1c05437700 1 -- 172.21.15.26:0/612343996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c00131b40 msgr2=0x7f1c0009ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:39.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.433+0000 7f1c05437700 1 --2- 172.21.15.26:0/612343996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c00131b40 0x7f1c0009ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.433+0000 7f1c05437700 1 -- 172.21.15.26:0/612343996 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf8009b30 con 0x7f1c0006a770 2023-10-01T07:58:39.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.433+0000 7f1c05437700 1 --2- 172.21.15.26:0/612343996 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c0006a770 0x7f1c0009a400 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc00e9b0 tx=0x7f1bfc00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:39.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.433+0000 7f1bf5ffb700 1 -- 172.21.15.26:0/612343996 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc00ee50 con 0x7f1c0006a770 2023-10-01T07:58:39.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.433+0000 7f1bf5ffb700 1 -- 172.21.15.26:0/612343996 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bfc00c850 con 0x7f1c0006a770 2023-10-01T07:58:39.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.433+0000 7f1c0769b700 1 -- 172.21.15.26:0/612343996 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c0012e200 con 0x7f1c0006a770 2023-10-01T07:58:39.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.433+0000 7f1bf5ffb700 1 -- 172.21.15.26:0/612343996 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc00cbc0 con 0x7f1c0006a770 2023-10-01T07:58:39.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.433+0000 7f1c0769b700 1 -- 172.21.15.26:0/612343996 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c00123510 con 0x7f1c0006a770 2023-10-01T07:58:39.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.434+0000 7f1bf5ffb700 1 -- 172.21.15.26:0/612343996 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1bfc00cd20 con 0x7f1c0006a770 2023-10-01T07:58:39.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.435+0000 7f1c0769b700 1 -- 172.21.15.26:0/612343996 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c00074ea0 con 0x7f1c0006a770 2023-10-01T07:58:39.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.435+0000 7f1bf5ffb700 1 -- 172.21.15.26:0/612343996 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1bfc03f740 con 0x7f1c0006a770 2023-10-01T07:58:39.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.440+0000 7f1bf5ffb700 1 -- 172.21.15.26:0/612343996 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1bfc0232f0 con 0x7f1c0006a770 2023-10-01T07:58:39.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.531+0000 7fbf873a1700 1 -- 172.21.15.26:0/1968960169 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbf800726e0 con 0x7fbf800a0870 2023-10-01T07:58:39.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.532+0000 7fbf76ffd700 1 -- 172.21.15.26:0/1968960169 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbf7c010380 con 0x7fbf800a0870 2023-10-01T07:58:39.532 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:39.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.534+0000 7fbf873a1700 1 -- 172.21.15.26:0/1968960169 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf800a0870 msgr2=0x7fbf80122050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:39.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.534+0000 7fbf873a1700 1 --2- 172.21.15.26:0/1968960169 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf800a0870 0x7fbf80122050 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c009c40 tx=0x7fbf7c004750 comp rx=0 tx=0).stop 2023-10-01T07:58:39.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.534+0000 7fbf873a1700 1 -- 172.21.15.26:0/1968960169 shutdown_connections 2023-10-01T07:58:39.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.534+0000 7fbf873a1700 1 --2- 172.21.15.26:0/1968960169 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf800a15b0 0x7fbf80122ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.534+0000 7fbf873a1700 1 --2- 172.21.15.26:0/1968960169 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf800a0870 0x7fbf80122050 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.534+0000 7fbf873a1700 1 --2- 172.21.15.26:0/1968960169 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf800a1180 0x7fbf80122590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.534+0000 7fbf873a1700 1 -- 172.21.15.26:0/1968960169 >> 172.21.15.26:0/1968960169 conn(0x7fbf800a6390 msgr2=0x7fbf80133bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:39.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.534+0000 7fbf873a1700 1 -- 172.21.15.26:0/1968960169 shutdown_connections 2023-10-01T07:58:39.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.534+0000 7fbf873a1700 1 -- 172.21.15.26:0/1968960169 wait complete. 2023-10-01T07:58:39.553 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:39.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.619+0000 7f5607cd3700 1 -- 172.21.15.26:0/1572986816 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5600074ea0 con 0x7f560009e000 2023-10-01T07:58:39.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.620+0000 7f55f67fc700 1 -- 172.21.15.26:0/1572986816 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f55f002f3b0 con 0x7f560009e000 2023-10-01T07:58:39.620 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:39.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.622+0000 7f5607cd3700 1 -- 172.21.15.26:0/1572986816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f560009e000 msgr2=0x7f56001a2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:39.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.622+0000 7f5607cd3700 1 --2- 172.21.15.26:0/1572986816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f560009e000 0x7f56001a2110 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f55f001e000 tx=0x7f55f0004750 comp rx=0 tx=0).stop 2023-10-01T07:58:39.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.622+0000 7f5607cd3700 1 -- 172.21.15.26:0/1572986816 shutdown_connections 2023-10-01T07:58:39.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.622+0000 7f5607cd3700 1 --2- 172.21.15.26:0/1572986816 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f560009e410 0x7f56001a2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.622+0000 7f5607cd3700 1 --2- 172.21.15.26:0/1572986816 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f560009d6f0 0x7f56001a1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.622+0000 7f5607cd3700 1 --2- 172.21.15.26:0/1572986816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f560009e000 0x7f56001a2110 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.622+0000 7f5607cd3700 1 -- 172.21.15.26:0/1572986816 >> 172.21.15.26:0/1572986816 conn(0x7f5600066f50 msgr2=0x7f56001b6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:39.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.622+0000 7f5607cd3700 1 -- 172.21.15.26:0/1572986816 shutdown_connections 2023-10-01T07:58:39.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.622+0000 7f5607cd3700 1 -- 172.21.15.26:0/1572986816 wait complete. 2023-10-01T07:58:39.636 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:39.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.646+0000 7f1c0769b700 1 -- 172.21.15.26:0/612343996 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1c00122cc0 con 0x7f1c0006a770 2023-10-01T07:58:39.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.646+0000 7f1bf5ffb700 1 -- 172.21.15.26:0/612343996 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1c00122cc0 con 0x7f1c0006a770 2023-10-01T07:58:39.647 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:39.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.648+0000 7f1c0769b700 1 -- 172.21.15.26:0/612343996 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c0006a770 msgr2=0x7f1c0009a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:39.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.648+0000 7f1c0769b700 1 --2- 172.21.15.26:0/612343996 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c0006a770 0x7f1c0009a400 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc00e9b0 tx=0x7f1bfc00ecc0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.648+0000 7f1c0769b700 1 -- 172.21.15.26:0/612343996 shutdown_connections 2023-10-01T07:58:39.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.648+0000 7f1c0769b700 1 --2- 172.21.15.26:0/612343996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c00131b40 0x7f1c0009ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.648+0000 7f1c0769b700 1 --2- 172.21.15.26:0/612343996 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c0006a770 0x7f1c0009a400 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.648+0000 7f1c0769b700 1 --2- 172.21.15.26:0/612343996 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c0006b080 0x7f1c0009a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.649+0000 7f1c0769b700 1 -- 172.21.15.26:0/612343996 >> 172.21.15.26:0/612343996 conn(0x7f1c00066f50 msgr2=0x7f1c000a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:39.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.649+0000 7f1c0769b700 1 -- 172.21.15.26:0/612343996 shutdown_connections 2023-10-01T07:58:39.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.649+0000 7f1c0769b700 1 -- 172.21.15.26:0/612343996 wait complete. 2023-10-01T07:58:39.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.656+0000 7fac0abcf700 1 -- 172.21.15.26:0/1399788067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fac04135a00 con 0x7fac0406ee80 2023-10-01T07:58:39.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.656+0000 7fac017fa700 1 -- 172.21.15.26:0/1399788067 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fac04135a00 con 0x7fac0406ee80 2023-10-01T07:58:39.657 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:39.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.659+0000 7fac0abcf700 1 -- 172.21.15.26:0/1399788067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac0406ee80 msgr2=0x7fac04138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:39.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.659+0000 7fac0abcf700 1 --2- 172.21.15.26:0/1399788067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac0406ee80 0x7fac04138880 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fabf000c4b0 tx=0x7fabf000c7c0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.659+0000 7fac0abcf700 1 -- 172.21.15.26:0/1399788067 shutdown_connections 2023-10-01T07:58:39.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.659+0000 7fac0abcf700 1 --2- 172.21.15.26:0/1399788067 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac04138dc0 0x7fac04139240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.659+0000 7fac0abcf700 1 --2- 172.21.15.26:0/1399788067 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac0406e570 0x7fac04134cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.659+0000 7fac0abcf700 1 --2- 172.21.15.26:0/1399788067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac0406ee80 0x7fac04138880 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:39.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.659+0000 7fac0abcf700 1 -- 172.21.15.26:0/1399788067 >> 172.21.15.26:0/1399788067 conn(0x7fac040a2aa0 msgr2=0x7fac040a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:39.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.659+0000 7fac0abcf700 1 -- 172.21.15.26:0/1399788067 shutdown_connections 2023-10-01T07:58:39.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:39.659+0000 7fac0abcf700 1 -- 172.21.15.26:0/1399788067 wait complete. 2023-10-01T07:58:39.663 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:39.673 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:40.555 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:40.637 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:40.664 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:40.674 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:40.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.707+0000 7f514a097700 1 Processor -- start 2023-10-01T07:58:40.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.707+0000 7f514a097700 1 -- start start 2023-10-01T07:58:40.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.708+0000 7f514a097700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f514409d6f0 0x7f514409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:40.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.708+0000 7f514a097700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f514409e410 0x7f5144130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:40.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.708+0000 7f514a097700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514409f130 con 0x7f514409e000 2023-10-01T07:58:40.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.708+0000 7f514a097700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f514409f520 con 0x7f514409e410 2023-10-01T07:58:40.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.708+0000 7f514a097700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514409e930 con 0x7f514409d6f0 2023-10-01T07:58:40.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.708+0000 7f5143fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f514409e410 0x7f5144130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:40.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.708+0000 7f5143fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f514409e410 0x7f5144130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52522/0 (socket says 172.21.15.26:52522) 2023-10-01T07:58:40.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.708+0000 7f5143fff700 1 -- 172.21.15.26:0/2679793404 learned_addr learned my addr 172.21.15.26:0/2679793404 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:40.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.708+0000 7f5143fff700 1 -- 172.21.15.26:0/2679793404 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f514409d6f0 msgr2=0x7f514409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:40.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.709+0000 7f5143fff700 1 --2- 172.21.15.26:0/2679793404 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f514409d6f0 0x7f514409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:40.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.709+0000 7f5143fff700 1 -- 172.21.15.26:0/2679793404 >> v1:172.21.15.26:6789/0 conn(0x7f514409e000 legacy=0x7f5144130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:40.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.709+0000 7f5143fff700 1 -- 172.21.15.26:0/2679793404 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514409b2d0 con 0x7f514409e410 2023-10-01T07:58:40.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.709+0000 7f5143fff700 1 --2- 172.21.15.26:0/2679793404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f514409e410 0x7f5144130d70 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f513c00d150 tx=0x7f513c00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d83f947c8b600fcb server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:40.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.709+0000 7f51427fc700 1 -- 172.21.15.26:0/2679793404 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c010070 con 0x7f514409e410 2023-10-01T07:58:40.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.709+0000 7f51427fc700 1 -- 172.21.15.26:0/2679793404 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513c00ddc0 con 0x7f514409e410 2023-10-01T07:58:40.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.709+0000 7f51427fc700 1 -- 172.21.15.26:0/2679793404 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c00b310 con 0x7f514409e410 2023-10-01T07:58:40.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.710+0000 7f514a097700 1 -- 172.21.15.26:0/2679793404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f514409e410 msgr2=0x7f5144130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:40.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.710+0000 7f514a097700 1 --2- 172.21.15.26:0/2679793404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f514409e410 0x7f5144130d70 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f513c00d150 tx=0x7f513c00d460 comp rx=0 tx=0).stop 2023-10-01T07:58:40.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.710+0000 7f514a097700 1 -- 172.21.15.26:0/2679793404 shutdown_connections 2023-10-01T07:58:40.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.710+0000 7f514a097700 1 --2- 172.21.15.26:0/2679793404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f514409e410 0x7f5144130d70 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:40.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.710+0000 7f514a097700 1 --2- 172.21.15.26:0/2679793404 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f514409d6f0 0x7f514409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:40.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.710+0000 7f514a097700 1 -- 172.21.15.26:0/2679793404 >> 172.21.15.26:0/2679793404 conn(0x7f5144066f50 msgr2=0x7f514409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:40.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.711+0000 7f514a097700 1 -- 172.21.15.26:0/2679793404 shutdown_connections 2023-10-01T07:58:40.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.711+0000 7f514a097700 1 -- 172.21.15.26:0/2679793404 wait complete. 2023-10-01T07:58:40.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.712+0000 7f514a097700 1 Processor -- start 2023-10-01T07:58:40.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.712+0000 7f514a097700 1 -- start start 2023-10-01T07:58:40.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.713+0000 7f514a097700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f514409d6f0 0x7f5144122430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:40.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.713+0000 7f514a097700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f514409e000 0x7f5144122970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:40.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.713+0000 7f514a097700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f514409e410 0x7f5144122eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:40.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.713+0000 7f514a097700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51440a1d90 con 0x7f514409e000 2023-10-01T07:58:40.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.713+0000 7f514a097700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5144124150 con 0x7f514409e410 2023-10-01T07:58:40.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.713+0000 7f514a097700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f514409c700 con 0x7f514409d6f0 2023-10-01T07:58:40.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.713+0000 7f5143fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f514409e410 0x7f5144122eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:40.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.713+0000 7f5143fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f514409e410 0x7f5144122eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:52182/0 (socket says 172.21.15.26:52182) 2023-10-01T07:58:40.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.713+0000 7f5143fff700 1 -- 172.21.15.26:0/2435002297 learned_addr learned my addr 172.21.15.26:0/2435002297 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:40.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.713+0000 7f5142ffd700 1 --2- 172.21.15.26:0/2435002297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f514409e000 0x7f5144122970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:40.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.714+0000 7f51437fe700 1 --2- 172.21.15.26:0/2435002297 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f514409d6f0 0x7f5144122430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:40.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.714+0000 7f5143fff700 1 -- 172.21.15.26:0/2435002297 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f514409d6f0 msgr2=0x7f5144122430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:40.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.714+0000 7f5143fff700 1 --2- 172.21.15.26:0/2435002297 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f514409d6f0 0x7f5144122430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:40.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.714+0000 7f5143fff700 1 -- 172.21.15.26:0/2435002297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f514409e000 msgr2=0x7f5144122970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:40.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.714+0000 7f5143fff700 1 --2- 172.21.15.26:0/2435002297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f514409e000 0x7f5144122970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:40.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.714+0000 7f5143fff700 1 -- 172.21.15.26:0/2435002297 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f513c00bd40 con 0x7f514409e410 2023-10-01T07:58:40.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.714+0000 7f5143fff700 1 --2- 172.21.15.26:0/2435002297 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f514409e410 0x7f5144122eb0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f513c00d4a0 tx=0x7f513c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:40.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.714+0000 7f512bfff700 1 -- 172.21.15.26:0/2435002297 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c009a10 con 0x7f514409e410 2023-10-01T07:58:40.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.714+0000 7f512bfff700 1 -- 172.21.15.26:0/2435002297 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513c009b70 con 0x7f514409e410 2023-10-01T07:58:40.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.714+0000 7f512bfff700 1 -- 172.21.15.26:0/2435002297 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c004040 con 0x7f514409e410 2023-10-01T07:58:40.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.715+0000 7f514a097700 1 -- 172.21.15.26:0/2435002297 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5144123800 con 0x7f514409e410 2023-10-01T07:58:40.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.715+0000 7f514a097700 1 -- 172.21.15.26:0/2435002297 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51441266e0 con 0x7f514409e410 2023-10-01T07:58:40.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.716+0000 7f514a097700 1 -- 172.21.15.26:0/2435002297 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5144074ea0 con 0x7f514409e410 2023-10-01T07:58:40.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.716+0000 7f512bfff700 1 -- 172.21.15.26:0/2435002297 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f513c0041a0 con 0x7f514409e410 2023-10-01T07:58:40.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.725+0000 7f512bfff700 1 -- 172.21.15.26:0/2435002297 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f513c0147f0 con 0x7f514409e410 2023-10-01T07:58:40.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.725+0000 7f512bfff700 1 -- 172.21.15.26:0/2435002297 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f513c046060 con 0x7f514409e410 2023-10-01T07:58:40.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.792+0000 7f0e4b4ec700 1 Processor -- start 2023-10-01T07:58:40.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.793+0000 7f0e4b4ec700 1 -- start start 2023-10-01T07:58:40.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.794+0000 7f0e4b4ec700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0e4406a770 0x7f0e4406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:40.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.794+0000 7f0e4b4ec700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e4406b080 0x7f0e44131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:40.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.794+0000 7f0e4b4ec700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e4409ece0 con 0x7f0e44131b40 2023-10-01T07:58:40.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.794+0000 7f0e4b4ec700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e4409e760 con 0x7f0e4406a770 2023-10-01T07:58:40.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.794+0000 7f0e4b4ec700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4409e040 con 0x7f0e4406b080 2023-10-01T07:58:40.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.794+0000 7f0e49288700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0e4406a770 0x7f0e4406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:40.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.794+0000 7f0e48a87700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e4406b080 0x7f0e44131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:40.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.794+0000 7f0e48a87700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e4406b080 0x7f0e44131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39296/0 (socket says 172.21.15.26:39296) 2023-10-01T07:58:40.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.794+0000 7f0e49288700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0e4406a770 0x7f0e4406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52542/0 (socket says 172.21.15.26:52542) 2023-10-01T07:58:40.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.794+0000 7f0e48a87700 1 -- 172.21.15.26:0/2568265588 learned_addr learned my addr 172.21.15.26:0/2568265588 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:40.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.794+0000 7f0e49288700 1 -- 172.21.15.26:0/2568265588 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e4406b080 msgr2=0x7f0e44131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:40.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.794+0000 7f0e49288700 1 --2- 172.21.15.26:0/2568265588 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e4406b080 0x7f0e44131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:40.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.794+0000 7f0e49288700 1 -- 172.21.15.26:0/2568265588 >> v1:172.21.15.26:6789/0 conn(0x7f0e44131b40 legacy=0x7f0e44138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:40.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.794+0000 7f0e49288700 1 -- 172.21.15.26:0/2568265588 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4409f630 con 0x7f0e4406a770 2023-10-01T07:58:40.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.795+0000 7f0e49288700 1 --2- 172.21.15.26:0/2568265588 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e4406a770 0x7f0e4406ab40 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f0e40009840 tx=0x7f0e40009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e8956869afc8630 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:40.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.795+0000 7f0e3bfff700 1 -- 172.21.15.26:0/2568265588 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e40011830 con 0x7f0e4406a770 2023-10-01T07:58:40.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.795+0000 7f0e3bfff700 1 -- 172.21.15.26:0/2568265588 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e40011990 con 0x7f0e4406a770 2023-10-01T07:58:40.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.795+0000 7f0e3bfff700 1 -- 172.21.15.26:0/2568265588 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e40011d20 con 0x7f0e4406a770 2023-10-01T07:58:40.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.796+0000 7f0e4b4ec700 1 -- 172.21.15.26:0/2568265588 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e4406a770 msgr2=0x7f0e4406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:40.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.796+0000 7f0e4b4ec700 1 --2- 172.21.15.26:0/2568265588 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e4406a770 0x7f0e4406ab40 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f0e40009840 tx=0x7f0e40009b50 comp rx=0 tx=0).stop 2023-10-01T07:58:40.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.796+0000 7f0e4b4ec700 1 -- 172.21.15.26:0/2568265588 shutdown_connections 2023-10-01T07:58:40.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.796+0000 7f0e4b4ec700 1 --2- 172.21.15.26:0/2568265588 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e4406a770 0x7f0e4406ab40 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:40.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.796+0000 7f0e4b4ec700 1 --2- 172.21.15.26:0/2568265588 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e4406b080 0x7f0e44131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:40.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.796+0000 7f0e4b4ec700 1 -- 172.21.15.26:0/2568265588 >> 172.21.15.26:0/2568265588 conn(0x7f0e44066f50 msgr2=0x7f0e4409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:40.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.796+0000 7f0e4b4ec700 1 -- 172.21.15.26:0/2568265588 shutdown_connections 2023-10-01T07:58:40.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.796+0000 7f0e4b4ec700 1 -- 172.21.15.26:0/2568265588 wait complete. 2023-10-01T07:58:40.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.798+0000 7f0e4b4ec700 1 Processor -- start 2023-10-01T07:58:40.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.798+0000 7f0e4b4ec700 1 -- start start 2023-10-01T07:58:40.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.799+0000 7f0e4b4ec700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e4406a770 0x7f0e441c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:40.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.799+0000 7f0e4b4ec700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0e4406b080 0x7f0e441c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:40.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.799+0000 7f0e4b4ec700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e44131b40 0x7f0e441c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:40.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.799+0000 7f0e4b4ec700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e44121d10 con 0x7f0e44131b40 2023-10-01T07:58:40.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.799+0000 7f0e4b4ec700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4409bf30 con 0x7f0e4406b080 2023-10-01T07:58:40.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.799+0000 7f0e4b4ec700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e44071e60 con 0x7f0e4406a770 2023-10-01T07:58:40.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.799+0000 7f0e49288700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e4406a770 0x7f0e441c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:40.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.799+0000 7f0e49288700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e4406a770 0x7f0e441c8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39312/0 (socket says 172.21.15.26:39312) 2023-10-01T07:58:40.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.799+0000 7f0e49288700 1 -- 172.21.15.26:0/2722991701 learned_addr learned my addr 172.21.15.26:0/2722991701 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:40.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.799+0000 7f0e49a89700 1 --2- 172.21.15.26:0/2722991701 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e44131b40 0x7f0e441c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:40.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.799+0000 7f0e49288700 1 -- 172.21.15.26:0/2722991701 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0e4406b080 msgr2=0x7f0e441c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:40.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.799+0000 7f0e49288700 1 --2- 172.21.15.26:0/2722991701 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0e4406b080 0x7f0e441c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:40.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.799+0000 7f0e49288700 1 -- 172.21.15.26:0/2722991701 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e44131b40 msgr2=0x7f0e441c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:40.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.799+0000 7f0e49288700 1 --2- 172.21.15.26:0/2722991701 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e44131b40 0x7f0e441c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:40.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.799+0000 7f0e49288700 1 -- 172.21.15.26:0/2722991701 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e400094a0 con 0x7f0e4406a770 2023-10-01T07:58:40.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.799+0000 7f0e49288700 1 --2- 172.21.15.26:0/2722991701 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e4406a770 0x7f0e441c8160 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0e40009fd0 tx=0x7f0e40004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:40.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.800+0000 7f0e39ffb700 1 -- 172.21.15.26:0/2722991701 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e400036a0 con 0x7f0e4406a770 2023-10-01T07:58:40.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.800+0000 7f0e39ffb700 1 -- 172.21.15.26:0/2722991701 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4001f070 con 0x7f0e4406a770 2023-10-01T07:58:40.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.800+0000 7f0e39ffb700 1 -- 172.21.15.26:0/2722991701 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e40003a60 con 0x7f0e4406a770 2023-10-01T07:58:40.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.800+0000 7f0e4b4ec700 1 -- 172.21.15.26:0/2722991701 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e44122460 con 0x7f0e4406a770 2023-10-01T07:58:40.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.800+0000 7f0e4b4ec700 1 -- 172.21.15.26:0/2722991701 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e44131480 con 0x7f0e4406a770 2023-10-01T07:58:40.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.801+0000 7f0e39ffb700 1 -- 172.21.15.26:0/2722991701 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0e40003bc0 con 0x7f0e4406a770 2023-10-01T07:58:40.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.801+0000 7f0e4b4ec700 1 -- 172.21.15.26:0/2722991701 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e44121ec0 con 0x7f0e4406a770 2023-10-01T07:58:40.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.802+0000 7f0e39ffb700 1 -- 172.21.15.26:0/2722991701 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0e40021070 con 0x7f0e4406a770 2023-10-01T07:58:40.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.807+0000 7f0e39ffb700 1 -- 172.21.15.26:0/2722991701 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0e44121ec0 con 0x7f0e4406a770 2023-10-01T07:58:40.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.829+0000 7f24063d9700 1 Processor -- start 2023-10-01T07:58:40.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.829+0000 7f24063d9700 1 -- start start 2023-10-01T07:58:40.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.830+0000 7f24063d9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2400133540 0x7f2400135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:40.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.830+0000 7f24063d9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2400135e60 0x7f2400138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:40.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.830+0000 7f24063d9700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24000716a0 con 0x7f2400130540 2023-10-01T07:58:40.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.830+0000 7f24063d9700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2400071290 con 0x7f2400135e60 2023-10-01T07:58:40.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.830+0000 7f24063d9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2400130340 con 0x7f2400133540 2023-10-01T07:58:40.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.832+0000 7f2404976700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2400135e60 0x7f2400138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:40.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.832+0000 7f2404976700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2400135e60 0x7f2400138240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52572/0 (socket says 172.21.15.26:52572) 2023-10-01T07:58:40.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.832+0000 7f2404976700 1 -- 172.21.15.26:0/1792415898 learned_addr learned my addr 172.21.15.26:0/1792415898 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:40.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.832+0000 7f2404976700 1 -- 172.21.15.26:0/1792415898 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2400133540 msgr2=0x7f2400135920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:40.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.832+0000 7f2404976700 1 --2- 172.21.15.26:0/1792415898 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2400133540 0x7f2400135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:40.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.832+0000 7f2404976700 1 -- 172.21.15.26:0/1792415898 >> v1:172.21.15.26:6789/0 conn(0x7f2400130540 legacy=0x7f2400130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:40.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.832+0000 7f2404976700 1 -- 172.21.15.26:0/1792415898 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2400070b80 con 0x7f2400135e60 2023-10-01T07:58:40.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.832+0000 7f2404976700 1 --2- 172.21.15.26:0/1792415898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2400135e60 0x7f2400138240 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f23f800d150 tx=0x7f23f800d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e646fb10e31332c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:40.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.832+0000 7f23feffd700 1 -- 172.21.15.26:0/1792415898 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f8010070 con 0x7f2400135e60 2023-10-01T07:58:40.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.833+0000 7f23feffd700 1 -- 172.21.15.26:0/1792415898 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f800ddc0 con 0x7f2400135e60 2023-10-01T07:58:40.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.833+0000 7f23feffd700 1 -- 172.21.15.26:0/1792415898 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f800b310 con 0x7f2400135e60 2023-10-01T07:58:40.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.833+0000 7f24063d9700 1 -- 172.21.15.26:0/1792415898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2400135e60 msgr2=0x7f2400138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:40.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.833+0000 7f24063d9700 1 --2- 172.21.15.26:0/1792415898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2400135e60 0x7f2400138240 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f23f800d150 tx=0x7f23f800d460 comp rx=0 tx=0).stop 2023-10-01T07:58:40.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.833+0000 7f24063d9700 1 -- 172.21.15.26:0/1792415898 shutdown_connections 2023-10-01T07:58:40.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.833+0000 7f24063d9700 1 --2- 172.21.15.26:0/1792415898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2400135e60 0x7f2400138240 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:40.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.833+0000 7f24063d9700 1 --2- 172.21.15.26:0/1792415898 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2400133540 0x7f2400135920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:40.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.833+0000 7f24063d9700 1 -- 172.21.15.26:0/1792415898 >> 172.21.15.26:0/1792415898 conn(0x7f24000a2aa0 msgr2=0x7f24000a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:40.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.833+0000 7f24063d9700 1 -- 172.21.15.26:0/1792415898 shutdown_connections 2023-10-01T07:58:40.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.833+0000 7f24063d9700 1 -- 172.21.15.26:0/1792415898 wait complete. 2023-10-01T07:58:40.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.834+0000 7f24063d9700 1 Processor -- start 2023-10-01T07:58:40.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.835+0000 7f24063d9700 1 -- start start 2023-10-01T07:58:40.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.835+0000 7f24063d9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2400130540 0x7f240012cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:40.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.835+0000 7f24063d9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2400133540 0x7f240012d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:40.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.836+0000 7f24063d9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2400135e60 0x7f24001c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:40.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.836+0000 7f24063d9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24000718e0 con 0x7f2400135e60 2023-10-01T07:58:40.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.836+0000 7f24063d9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f240009e4f0 con 0x7f2400130540 2023-10-01T07:58:40.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.836+0000 7f24063d9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24000a23d0 con 0x7f2400133540 2023-10-01T07:58:40.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.836+0000 7f23ff7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2400133540 0x7f240012d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:40.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.836+0000 7f23ff7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2400133540 0x7f240012d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39336/0 (socket says 172.21.15.26:39336) 2023-10-01T07:58:40.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.836+0000 7f23ff7fe700 1 -- 172.21.15.26:0/1250174530 learned_addr learned my addr 172.21.15.26:0/1250174530 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:40.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.836+0000 7f2404976700 1 --2- 172.21.15.26:0/1250174530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2400135e60 0x7f24001c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:40.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.836+0000 7f23fffff700 1 --2- 172.21.15.26:0/1250174530 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2400130540 0x7f240012cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:40.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.836+0000 7f23ff7fe700 1 -- 172.21.15.26:0/1250174530 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2400130540 msgr2=0x7f240012cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:40.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.836+0000 7f23ff7fe700 1 --2- 172.21.15.26:0/1250174530 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2400130540 0x7f240012cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:40.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.836+0000 7f23ff7fe700 1 -- 172.21.15.26:0/1250174530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2400135e60 msgr2=0x7f24001c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:40.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.836+0000 7f23ff7fe700 1 --2- 172.21.15.26:0/1250174530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2400135e60 0x7f24001c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:40.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.836+0000 7f23ff7fe700 1 -- 172.21.15.26:0/1250174530 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f800bd40 con 0x7f2400133540 2023-10-01T07:58:40.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.836+0000 7f2404976700 1 --2- 172.21.15.26:0/1250174530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2400135e60 0x7f24001c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:58:40.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.837+0000 7f23ff7fe700 1 --2- 172.21.15.26:0/1250174530 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2400133540 0x7f240012d4c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f23f400b560 tx=0x7f23f400b870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:40.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.837+0000 7f23fcff9700 1 -- 172.21.15.26:0/1250174530 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f4011830 con 0x7f2400133540 2023-10-01T07:58:40.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.837+0000 7f23fcff9700 1 -- 172.21.15.26:0/1250174530 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f40119b0 con 0x7f2400133540 2023-10-01T07:58:40.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.837+0000 7f24063d9700 1 -- 172.21.15.26:0/1250174530 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f240011ea00 con 0x7f2400133540 2023-10-01T07:58:40.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.837+0000 7f23fcff9700 1 -- 172.21.15.26:0/1250174530 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f4011d60 con 0x7f2400133540 2023-10-01T07:58:40.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.837+0000 7f24063d9700 1 -- 172.21.15.26:0/1250174530 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f240012dce0 con 0x7f2400133540 2023-10-01T07:58:40.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.838+0000 7f24063d9700 1 -- 172.21.15.26:0/1250174530 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2400074ea0 con 0x7f2400133540 2023-10-01T07:58:40.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.839+0000 7f23fcff9700 1 -- 172.21.15.26:0/1250174530 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f23f401a400 con 0x7f2400133540 2023-10-01T07:58:40.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.839+0000 7f23fcff9700 1 -- 172.21.15.26:0/1250174530 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f23f403f6a0 con 0x7f2400133540 2023-10-01T07:58:40.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.844+0000 7f23fcff9700 1 -- 172.21.15.26:0/1250174530 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f23f401ae60 con 0x7f2400133540 2023-10-01T07:58:40.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.855+0000 7f4fdab73700 1 Processor -- start 2023-10-01T07:58:40.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.855+0000 7f4fdab73700 1 -- start start 2023-10-01T07:58:40.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.855+0000 7f4fdab73700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4fd40a0a30 0x7f4fd40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:40.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.855+0000 7f4fdab73700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4fd4138d80 0x7f4fd413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:40.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.855+0000 7f4fdab73700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd40a2a70 con 0x7f4fd409d630 2023-10-01T07:58:40.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.855+0000 7f4fdab73700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd40a01d0 con 0x7f4fd40a0a30 2023-10-01T07:58:40.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.855+0000 7f4fdab73700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd409e2b0 con 0x7f4fd4138d80 2023-10-01T07:58:40.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.855+0000 7f4fd890f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4fd40a0a30 0x7f4fd40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:40.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.856+0000 7f4fd890f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4fd40a0a30 0x7f4fd40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:52208/0 (socket says 172.21.15.26:52208) 2023-10-01T07:58:40.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.856+0000 7f4fd890f700 1 -- 172.21.15.26:0/1005532524 learned_addr learned my addr 172.21.15.26:0/1005532524 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:40.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.856+0000 7f4fd9110700 1 --2- 172.21.15.26:0/1005532524 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4fd4138d80 0x7f4fd413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:40.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.856+0000 7f4fd890f700 1 -- 172.21.15.26:0/1005532524 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4fd4138d80 msgr2=0x7f4fd413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:40.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.856+0000 7f4fd890f700 1 --2- 172.21.15.26:0/1005532524 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4fd4138d80 0x7f4fd413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:40.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.856+0000 7f4fd37fe700 1 -- 172.21.15.26:0/1005532524 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1222431565 0 0) 0x7f4fd40a2a70 con 0x7f4fd409d630 2023-10-01T07:58:40.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.856+0000 7f4fd890f700 1 -- 172.21.15.26:0/1005532524 >> v1:172.21.15.26:6789/0 conn(0x7f4fd409d630 legacy=0x7f4fd40a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:40.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.856+0000 7f4fd890f700 1 -- 172.21.15.26:0/1005532524 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd409dc50 con 0x7f4fd40a0a30 2023-10-01T07:58:40.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.856+0000 7f4fd890f700 1 --2- 172.21.15.26:0/1005532524 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4fd40a0a30 0x7f4fd40a0e00 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8009920 tx=0x7f4fc8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e614baeb1dbe568 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:40.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.856+0000 7f4fd37fe700 1 -- 172.21.15.26:0/1005532524 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8011830 con 0x7f4fd40a0a30 2023-10-01T07:58:40.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.856+0000 7f4fd37fe700 1 -- 172.21.15.26:0/1005532524 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc8011990 con 0x7f4fd40a0a30 2023-10-01T07:58:40.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.856+0000 7f4fd37fe700 1 -- 172.21.15.26:0/1005532524 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8011d20 con 0x7f4fd40a0a30 2023-10-01T07:58:40.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.857+0000 7f4fdab73700 1 -- 172.21.15.26:0/1005532524 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4fd40a0a30 msgr2=0x7f4fd40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:40.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.857+0000 7f4fdab73700 1 --2- 172.21.15.26:0/1005532524 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4fd40a0a30 0x7f4fd40a0e00 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8009920 tx=0x7f4fc8009c30 comp rx=0 tx=0).stop 2023-10-01T07:58:40.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.857+0000 7f4fdab73700 1 -- 172.21.15.26:0/1005532524 shutdown_connections 2023-10-01T07:58:40.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.857+0000 7f4fdab73700 1 --2- 172.21.15.26:0/1005532524 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4fd4138d80 0x7f4fd413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:40.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.857+0000 7f4fdab73700 1 --2- 172.21.15.26:0/1005532524 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4fd40a0a30 0x7f4fd40a0e00 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:40.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.857+0000 7f4fdab73700 1 -- 172.21.15.26:0/1005532524 >> 172.21.15.26:0/1005532524 conn(0x7f4fd40a3050 msgr2=0x7f4fd40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:40.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.857+0000 7f4fdab73700 1 -- 172.21.15.26:0/1005532524 shutdown_connections 2023-10-01T07:58:40.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.857+0000 7f4fdab73700 1 -- 172.21.15.26:0/1005532524 wait complete. 2023-10-01T07:58:40.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.858+0000 7f4fdab73700 1 Processor -- start 2023-10-01T07:58:40.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.858+0000 7f4fdab73700 1 -- start start 2023-10-01T07:58:40.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.859+0000 7f4fdab73700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4fd409d630 0x7f4fd41cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:40.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.859+0000 7f4fdab73700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4fd40a0a30 0x7f4fd41ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:40.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.859+0000 7f4fdab73700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fd4138d80 0x7f4fd41cd170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:40.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.859+0000 7f4fdab73700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd411c7c0 con 0x7f4fd4138d80 2023-10-01T07:58:40.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.859+0000 7f4fdab73700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd4071710 con 0x7f4fd40a0a30 2023-10-01T07:58:40.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.859+0000 7f4fdab73700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd411ed80 con 0x7f4fd409d630 2023-10-01T07:58:40.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.859+0000 7f4fd9110700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fd4138d80 0x7f4fd41cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:40.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.859+0000 7f4fd9110700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fd4138d80 0x7f4fd41cd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52590/0 (socket says 172.21.15.26:52590) 2023-10-01T07:58:40.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.859+0000 7f4fd9110700 1 -- 172.21.15.26:0/2188285118 learned_addr learned my addr 172.21.15.26:0/2188285118 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:40.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.860+0000 7f4fd3fff700 1 --2- 172.21.15.26:0/2188285118 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4fd40a0a30 0x7f4fd41ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:40.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.860+0000 7f4fd890f700 1 --2- 172.21.15.26:0/2188285118 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4fd409d630 0x7f4fd41cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:40.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.860+0000 7f4fd9110700 1 -- 172.21.15.26:0/2188285118 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4fd409d630 msgr2=0x7f4fd41cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:40.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.860+0000 7f4fd9110700 1 --2- 172.21.15.26:0/2188285118 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4fd409d630 0x7f4fd41cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:40.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.860+0000 7f4fd9110700 1 -- 172.21.15.26:0/2188285118 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4fd40a0a30 msgr2=0x7f4fd41ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:40.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.860+0000 7f4fd9110700 1 --2- 172.21.15.26:0/2188285118 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4fd40a0a30 0x7f4fd41ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:40.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.860+0000 7f4fd9110700 1 -- 172.21.15.26:0/2188285118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc8009550 con 0x7f4fd4138d80 2023-10-01T07:58:40.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.860+0000 7f4fd9110700 1 --2- 172.21.15.26:0/2188285118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fd4138d80 0x7f4fd41cd170 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc00efc0 tx=0x7f4fcc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:40.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.860+0000 7f4fd17fa700 1 -- 172.21.15.26:0/2188285118 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc009ea0 con 0x7f4fd4138d80 2023-10-01T07:58:40.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.860+0000 7f4fd17fa700 1 -- 172.21.15.26:0/2188285118 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fcc00f040 con 0x7f4fd4138d80 2023-10-01T07:58:40.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.860+0000 7f4fd17fa700 1 -- 172.21.15.26:0/2188285118 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc014480 con 0x7f4fd4138d80 2023-10-01T07:58:40.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.861+0000 7f4fdab73700 1 -- 172.21.15.26:0/2188285118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd40a4bc0 con 0x7f4fd4138d80 2023-10-01T07:58:40.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.861+0000 7f4fdab73700 1 -- 172.21.15.26:0/2188285118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd412f330 con 0x7f4fd4138d80 2023-10-01T07:58:40.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.862+0000 7f4fdab73700 1 -- 172.21.15.26:0/2188285118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd40747f0 con 0x7f4fd4138d80 2023-10-01T07:58:40.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.862+0000 7f4fd17fa700 1 -- 172.21.15.26:0/2188285118 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4fcc0145e0 con 0x7f4fd4138d80 2023-10-01T07:58:40.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.862+0000 7f4fd17fa700 1 -- 172.21.15.26:0/2188285118 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4fcc0403e0 con 0x7f4fd4138d80 2023-10-01T07:58:40.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:40.867+0000 7f4fd17fa700 1 -- 172.21.15.26:0/2188285118 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4fcc012930 con 0x7f4fd4138d80 2023-10-01T07:58:41.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.036+0000 7f514a097700 1 -- 172.21.15.26:0/2435002297 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f514406c360 con 0x7f514409e410 2023-10-01T07:58:41.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.037+0000 7f512bfff700 1 -- 172.21.15.26:0/2435002297 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f513c021070 con 0x7f514409e410 2023-10-01T07:58:41.038 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:41.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.040+0000 7f514a097700 1 -- 172.21.15.26:0/2435002297 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f514409e410 msgr2=0x7f5144122eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:41.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.040+0000 7f514a097700 1 --2- 172.21.15.26:0/2435002297 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f514409e410 0x7f5144122eb0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f513c00d4a0 tx=0x7f513c004ad0 comp rx=0 tx=0).stop 2023-10-01T07:58:41.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.040+0000 7f514a097700 1 -- 172.21.15.26:0/2435002297 shutdown_connections 2023-10-01T07:58:41.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.040+0000 7f514a097700 1 --2- 172.21.15.26:0/2435002297 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f514409e410 0x7f5144122eb0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:41.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.040+0000 7f514a097700 1 --2- 172.21.15.26:0/2435002297 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f514409d6f0 0x7f5144122430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:41.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.040+0000 7f514a097700 1 --2- 172.21.15.26:0/2435002297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f514409e000 0x7f5144122970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:41.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.040+0000 7f514a097700 1 -- 172.21.15.26:0/2435002297 >> 172.21.15.26:0/2435002297 conn(0x7f5144066f50 msgr2=0x7f51440710a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:41.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.040+0000 7f514a097700 1 -- 172.21.15.26:0/2435002297 shutdown_connections 2023-10-01T07:58:41.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.041+0000 7f514a097700 1 -- 172.21.15.26:0/2435002297 wait complete. 2023-10-01T07:58:41.060 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:41.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.062+0000 7f24063d9700 1 -- 172.21.15.26:0/1250174530 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f240006b9e0 con 0x7f2400133540 2023-10-01T07:58:41.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.063+0000 7f23fcff9700 1 -- 172.21.15.26:0/1250174530 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f23f400f2e0 con 0x7f2400133540 2023-10-01T07:58:41.063 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:41.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.065+0000 7f24063d9700 1 -- 172.21.15.26:0/1250174530 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2400133540 msgr2=0x7f240012d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:41.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.065+0000 7f24063d9700 1 --2- 172.21.15.26:0/1250174530 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2400133540 0x7f240012d4c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f23f400b560 tx=0x7f23f400b870 comp rx=0 tx=0).stop 2023-10-01T07:58:41.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.065+0000 7f24063d9700 1 -- 172.21.15.26:0/1250174530 shutdown_connections 2023-10-01T07:58:41.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.065+0000 7f24063d9700 1 --2- 172.21.15.26:0/1250174530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2400135e60 0x7f24001c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:41.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.065+0000 7f24063d9700 1 --2- 172.21.15.26:0/1250174530 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2400130540 0x7f240012cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:41.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.065+0000 7f24063d9700 1 --2- 172.21.15.26:0/1250174530 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2400133540 0x7f240012d4c0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:41.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.065+0000 7f24063d9700 1 -- 172.21.15.26:0/1250174530 >> 172.21.15.26:0/1250174530 conn(0x7f24000a2aa0 msgr2=0x7f24000677c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:41.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.065+0000 7f24063d9700 1 -- 172.21.15.26:0/1250174530 shutdown_connections 2023-10-01T07:58:41.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.065+0000 7f24063d9700 1 -- 172.21.15.26:0/1250174530 wait complete. 2023-10-01T07:58:41.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.077+0000 7f4fdab73700 1 -- 172.21.15.26:0/2188285118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4fd413b2f0 con 0x7f4fd4138d80 2023-10-01T07:58:41.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.077+0000 7f4fd17fa700 1 -- 172.21.15.26:0/2188285118 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4fcc012340 con 0x7f4fd4138d80 2023-10-01T07:58:41.078 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:41.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:41.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.079+0000 7f4fdab73700 1 -- 172.21.15.26:0/2188285118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fd4138d80 msgr2=0x7f4fd41cd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:41.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.079+0000 7f4fdab73700 1 --2- 172.21.15.26:0/2188285118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fd4138d80 0x7f4fd41cd170 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc00efc0 tx=0x7f4fcc00c3a0 comp rx=0 tx=0).stop 2023-10-01T07:58:41.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.080+0000 7f4fdab73700 1 -- 172.21.15.26:0/2188285118 shutdown_connections 2023-10-01T07:58:41.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.080+0000 7f4fdab73700 1 --2- 172.21.15.26:0/2188285118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fd4138d80 0x7f4fd41cd170 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:41.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.080+0000 7f4fdab73700 1 --2- 172.21.15.26:0/2188285118 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4fd409d630 0x7f4fd41cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:41.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.080+0000 7f4fdab73700 1 --2- 172.21.15.26:0/2188285118 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4fd40a0a30 0x7f4fd41ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:41.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.080+0000 7f4fdab73700 1 -- 172.21.15.26:0/2188285118 >> 172.21.15.26:0/2188285118 conn(0x7f4fd40a3050 msgr2=0x7f4fd4099a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:41.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.080+0000 7f4fdab73700 1 -- 172.21.15.26:0/2188285118 shutdown_connections 2023-10-01T07:58:41.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.080+0000 7f4fdab73700 1 -- 172.21.15.26:0/2188285118 wait complete. 2023-10-01T07:58:41.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.084+0000 7f0e4b4ec700 1 -- 172.21.15.26:0/2722991701 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0e44121ec0 con 0x7f0e4406a770 2023-10-01T07:58:41.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.085+0000 7f0e39ffb700 1 -- 172.21.15.26:0/2722991701 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0e44121ec0 con 0x7f0e4406a770 2023-10-01T07:58:41.085 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:41.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.087+0000 7f0e4b4ec700 1 -- 172.21.15.26:0/2722991701 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e4406a770 msgr2=0x7f0e441c8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:41.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.087+0000 7f0e4b4ec700 1 --2- 172.21.15.26:0/2722991701 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e4406a770 0x7f0e441c8160 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0e40009fd0 tx=0x7f0e40004750 comp rx=0 tx=0).stop 2023-10-01T07:58:41.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.087+0000 7f0e4b4ec700 1 -- 172.21.15.26:0/2722991701 shutdown_connections 2023-10-01T07:58:41.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.087+0000 7f0e4b4ec700 1 --2- 172.21.15.26:0/2722991701 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e44131b40 0x7f0e441c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:41.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.087+0000 7f0e4b4ec700 1 --2- 172.21.15.26:0/2722991701 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e4406a770 0x7f0e441c8160 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:41.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.087+0000 7f0e4b4ec700 1 --2- 172.21.15.26:0/2722991701 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0e4406b080 0x7f0e441c86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:41.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.087+0000 7f0e4b4ec700 1 -- 172.21.15.26:0/2722991701 >> 172.21.15.26:0/2722991701 conn(0x7f0e44066f50 msgr2=0x7f0e440701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:41.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.087+0000 7f0e4b4ec700 1 -- 172.21.15.26:0/2722991701 shutdown_connections 2023-10-01T07:58:41.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:41.087+0000 7f0e4b4ec700 1 -- 172.21.15.26:0/2722991701 wait complete. 2023-10-01T07:58:41.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:41.103 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:42.061 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:42.080 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:42.096 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:42.104 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:42.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.217+0000 7f0138ff6700 1 Processor -- start 2023-10-01T07:58:42.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.217+0000 7f0138ff6700 1 -- start start 2023-10-01T07:58:42.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.218+0000 7f0138ff6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0134131810 0x7f0134131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:42.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.218+0000 7f0138ff6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f013409a580 0x7f0134139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:42.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.218+0000 7f0138ff6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01341313c0 con 0x7f0134099a40 2023-10-01T07:58:42.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.218+0000 7f0138ff6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f013409b580 con 0x7f013409a580 2023-10-01T07:58:42.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.218+0000 7f0138ff6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f013406e8c0 con 0x7f0134131810 2023-10-01T07:58:42.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.218+0000 7f013259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0134131810 0x7f0134131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:42.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.218+0000 7f0132d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f013409a580 0x7f0134139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:42.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.218+0000 7f0132d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f013409a580 0x7f0134139660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52604/0 (socket says 172.21.15.26:52604) 2023-10-01T07:58:42.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.218+0000 7f013259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0134131810 0x7f0134131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39356/0 (socket says 172.21.15.26:39356) 2023-10-01T07:58:42.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.218+0000 7f0132d9d700 1 -- 172.21.15.26:0/1123634272 learned_addr learned my addr 172.21.15.26:0/1123634272 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:42.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.219+0000 7f0132d9d700 1 -- 172.21.15.26:0/1123634272 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0134131810 msgr2=0x7f0134131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:42.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.219+0000 7f0132d9d700 1 --2- 172.21.15.26:0/1123634272 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0134131810 0x7f0134131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:42.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.219+0000 7f0132d9d700 1 -- 172.21.15.26:0/1123634272 >> v1:172.21.15.26:6789/0 conn(0x7f0134099a40 legacy=0x7f0134099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:42.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.219+0000 7f0132d9d700 1 -- 172.21.15.26:0/1123634272 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0134071d20 con 0x7f013409a580 2023-10-01T07:58:42.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.219+0000 7f0132d9d700 1 --2- 172.21.15.26:0/1123634272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f013409a580 0x7f0134139660 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f012c009e50 tx=0x7f012c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f5cbf8726d32c7f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:42.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.219+0000 7f013159a700 1 -- 172.21.15.26:0/1123634272 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012c00e070 con 0x7f013409a580 2023-10-01T07:58:42.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.219+0000 7f013159a700 1 -- 172.21.15.26:0/1123634272 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f012c00b910 con 0x7f013409a580 2023-10-01T07:58:42.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.219+0000 7f013159a700 1 -- 172.21.15.26:0/1123634272 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012c00bcc0 con 0x7f013409a580 2023-10-01T07:58:42.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.220+0000 7f0138ff6700 1 -- 172.21.15.26:0/1123634272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f013409a580 msgr2=0x7f0134139660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:42.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.220+0000 7f0138ff6700 1 --2- 172.21.15.26:0/1123634272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f013409a580 0x7f0134139660 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f012c009e50 tx=0x7f012c00b330 comp rx=0 tx=0).stop 2023-10-01T07:58:42.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.220+0000 7f0138ff6700 1 -- 172.21.15.26:0/1123634272 shutdown_connections 2023-10-01T07:58:42.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.220+0000 7f0138ff6700 1 --2- 172.21.15.26:0/1123634272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f013409a580 0x7f0134139660 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:42.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.220+0000 7f0138ff6700 1 --2- 172.21.15.26:0/1123634272 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0134131810 0x7f0134131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:42.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.220+0000 7f0138ff6700 1 -- 172.21.15.26:0/1123634272 >> 172.21.15.26:0/1123634272 conn(0x7f01340a2aa0 msgr2=0x7f01340a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:42.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.220+0000 7f0138ff6700 1 -- 172.21.15.26:0/1123634272 shutdown_connections 2023-10-01T07:58:42.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.220+0000 7f0138ff6700 1 -- 172.21.15.26:0/1123634272 wait complete. 2023-10-01T07:58:42.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.222+0000 7f0138ff6700 1 Processor -- start 2023-10-01T07:58:42.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.222+0000 7f0138ff6700 1 -- start start 2023-10-01T07:58:42.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.223+0000 7f0138ff6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0134099a40 0x7f013411b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:42.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.223+0000 7f0138ff6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f013409a580 0x7f013411bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:42.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.223+0000 7f0138ff6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0134131810 0x7f013411c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:42.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.223+0000 7f0138ff6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013411d890 con 0x7f0134099a40 2023-10-01T07:58:42.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.223+0000 7f0138ff6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013411f150 con 0x7f013409a580 2023-10-01T07:58:42.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.223+0000 7f0138ff6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f013411e520 con 0x7f0134131810 2023-10-01T07:58:42.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.223+0000 7f0132d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0134131810 0x7f013411c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:42.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.223+0000 7f013259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0134099a40 0x7f013411b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:42.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.223+0000 7f0132d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0134131810 0x7f013411c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39360/0 (socket says 172.21.15.26:39360) 2023-10-01T07:58:42.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.223+0000 7f0132d9d700 1 -- 172.21.15.26:0/646548094 learned_addr learned my addr 172.21.15.26:0/646548094 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:42.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.223+0000 7f0131d9b700 1 --2- 172.21.15.26:0/646548094 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f013409a580 0x7f013411bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:42.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.224+0000 7f013259c700 1 -- 172.21.15.26:0/646548094 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0134131810 msgr2=0x7f013411c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:42.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.224+0000 7f013259c700 1 --2- 172.21.15.26:0/646548094 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0134131810 0x7f013411c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:42.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.224+0000 7f013259c700 1 -- 172.21.15.26:0/646548094 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f013409a580 msgr2=0x7f013411bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:42.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.224+0000 7f013259c700 1 --2- 172.21.15.26:0/646548094 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f013409a580 0x7f013411bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:42.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.224+0000 7f013259c700 1 -- 172.21.15.26:0/646548094 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f012c009b30 con 0x7f0134099a40 2023-10-01T07:58:42.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.224+0000 7f013259c700 1 --2- 172.21.15.26:0/646548094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0134099a40 0x7f013411b630 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f012400e930 tx=0x7f012400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:42.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.224+0000 7f0122ffd700 1 -- 172.21.15.26:0/646548094 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0124013680 con 0x7f0134099a40 2023-10-01T07:58:42.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.224+0000 7f0122ffd700 1 -- 172.21.15.26:0/646548094 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01240137e0 con 0x7f0134099a40 2023-10-01T07:58:42.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.224+0000 7f0122ffd700 1 -- 172.21.15.26:0/646548094 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0124013b50 con 0x7f0134099a40 2023-10-01T07:58:42.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.225+0000 7f0138ff6700 1 -- 172.21.15.26:0/646548094 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0134072250 con 0x7f0134099a40 2023-10-01T07:58:42.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.225+0000 7f0138ff6700 1 -- 172.21.15.26:0/646548094 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f013406eb00 con 0x7f0134099a40 2023-10-01T07:58:42.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.226+0000 7f0122ffd700 1 -- 172.21.15.26:0/646548094 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0124013cb0 con 0x7f0134099a40 2023-10-01T07:58:42.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.227+0000 7f0122ffd700 1 -- 172.21.15.26:0/646548094 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f012403f700 con 0x7f0134099a40 2023-10-01T07:58:42.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.227+0000 7f0138ff6700 1 -- 172.21.15.26:0/646548094 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0134074ea0 con 0x7f0134099a40 2023-10-01T07:58:42.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.236+0000 7f0122ffd700 1 -- 172.21.15.26:0/646548094 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0124017080 con 0x7f0134099a40 2023-10-01T07:58:42.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.255+0000 7f6389820700 1 Processor -- start 2023-10-01T07:58:42.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.255+0000 7f6389820700 1 -- start start 2023-10-01T07:58:42.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.255+0000 7f6389820700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f638409e1d0 0x7f6384135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:42.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.255+0000 7f6389820700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6384135e50 0x7f6384138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:42.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.255+0000 7f6389820700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f638409f130 con 0x7f638409d6f0 2023-10-01T07:58:42.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.255+0000 7f6389820700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f638409f520 con 0x7f6384135e50 2023-10-01T07:58:42.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.255+0000 7f6389820700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f638409e930 con 0x7f638409e1d0 2023-10-01T07:58:42.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.256+0000 7f6382ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f638409d6f0 0x7f638409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33038/0 (socket says 172.21.15.26:33038) 2023-10-01T07:58:42.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.256+0000 7f6382ffd700 1 -- 172.21.15.26:0/3645328801 learned_addr learned my addr 172.21.15.26:0/3645328801 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:42.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.256+0000 7f63827fc700 1 --2- 172.21.15.26:0/3645328801 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f638409e1d0 0x7f6384135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:42.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.256+0000 7f63837fe700 1 --2- 172.21.15.26:0/3645328801 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6384135e50 0x7f6384138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:42.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.256+0000 7f6381ffb700 1 -- 172.21.15.26:0/3645328801 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3617192556 0 0) 0x7f638409f130 con 0x7f638409d6f0 2023-10-01T07:58:42.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.256+0000 7f63827fc700 1 -- 172.21.15.26:0/3645328801 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6384135e50 msgr2=0x7f6384138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:42.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.256+0000 7f63827fc700 1 --2- 172.21.15.26:0/3645328801 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6384135e50 0x7f6384138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:42.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.256+0000 7f63827fc700 1 -- 172.21.15.26:0/3645328801 >> v1:172.21.15.26:6789/0 conn(0x7f638409d6f0 legacy=0x7f638409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:42.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.256+0000 7f63827fc700 1 -- 172.21.15.26:0/3645328801 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638409b2d0 con 0x7f638409e1d0 2023-10-01T07:58:42.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.256+0000 7f63827fc700 1 --2- 172.21.15.26:0/3645328801 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f638409e1d0 0x7f6384135910 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6378009870 tx=0x7f6378009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbef14712a94cb46 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:42.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.257+0000 7f6381ffb700 1 -- 172.21.15.26:0/3645328801 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6378011830 con 0x7f638409e1d0 2023-10-01T07:58:42.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.257+0000 7f6381ffb700 1 -- 172.21.15.26:0/3645328801 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6378011990 con 0x7f638409e1d0 2023-10-01T07:58:42.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.257+0000 7f6381ffb700 1 -- 172.21.15.26:0/3645328801 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6378011d20 con 0x7f638409e1d0 2023-10-01T07:58:42.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.257+0000 7f6389820700 1 -- 172.21.15.26:0/3645328801 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f638409e1d0 msgr2=0x7f6384135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:42.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.257+0000 7f6389820700 1 --2- 172.21.15.26:0/3645328801 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f638409e1d0 0x7f6384135910 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6378009870 tx=0x7f6378009b80 comp rx=0 tx=0).stop 2023-10-01T07:58:42.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.257+0000 7f6389820700 1 -- 172.21.15.26:0/3645328801 shutdown_connections 2023-10-01T07:58:42.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.257+0000 7f6389820700 1 --2- 172.21.15.26:0/3645328801 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6384135e50 0x7f6384138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:42.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.257+0000 7f6389820700 1 --2- 172.21.15.26:0/3645328801 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f638409e1d0 0x7f6384135910 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:42.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.257+0000 7f6389820700 1 -- 172.21.15.26:0/3645328801 >> 172.21.15.26:0/3645328801 conn(0x7f6384066f50 msgr2=0x7f638409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:42.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.257+0000 7f6389820700 1 -- 172.21.15.26:0/3645328801 shutdown_connections 2023-10-01T07:58:42.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.257+0000 7f6389820700 1 -- 172.21.15.26:0/3645328801 wait complete. 2023-10-01T07:58:42.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.259+0000 7f6389820700 1 Processor -- start 2023-10-01T07:58:42.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.259+0000 7f6389820700 1 -- start start 2023-10-01T07:58:42.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.260+0000 7f6389820700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f638409d6f0 0x7f638411b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:42.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.260+0000 7f6389820700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f638409e1d0 0x7f638411b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:42.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.260+0000 7f6389820700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6384135e50 0x7f638411bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:42.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.260+0000 7f6389820700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6384131ed0 con 0x7f638409e1d0 2023-10-01T07:58:42.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.260+0000 7f6389820700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f638411d240 con 0x7f638409d6f0 2023-10-01T07:58:42.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.260+0000 7f6389820700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6384132290 con 0x7f6384135e50 2023-10-01T07:58:42.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.260+0000 7f6382ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f638409d6f0 0x7f638411b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:42.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.260+0000 7f6382ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f638409d6f0 0x7f638411b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:52244/0 (socket says 172.21.15.26:52244) 2023-10-01T07:58:42.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.260+0000 7f6382ffd700 1 -- 172.21.15.26:0/3597525855 learned_addr learned my addr 172.21.15.26:0/3597525855 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:42.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.260+0000 7f63837fe700 1 --2- 172.21.15.26:0/3597525855 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6384135e50 0x7f638411bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:42.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.260+0000 7f63827fc700 1 --2- 172.21.15.26:0/3597525855 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f638409e1d0 0x7f638411b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:42.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.260+0000 7f6382ffd700 1 -- 172.21.15.26:0/3597525855 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6384135e50 msgr2=0x7f638411bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:42.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.260+0000 7f6382ffd700 1 --2- 172.21.15.26:0/3597525855 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6384135e50 0x7f638411bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:42.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.260+0000 7f6382ffd700 1 -- 172.21.15.26:0/3597525855 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f638409e1d0 msgr2=0x7f638411b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:42.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.260+0000 7f6382ffd700 1 --2- 172.21.15.26:0/3597525855 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f638409e1d0 0x7f638411b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:42.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.260+0000 7f6382ffd700 1 -- 172.21.15.26:0/3597525855 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63780094a0 con 0x7f638409d6f0 2023-10-01T07:58:42.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.260+0000 7f63827fc700 1 --2- 172.21.15.26:0/3597525855 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f638409e1d0 0x7f638411b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:58:42.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.261+0000 7f6382ffd700 1 --2- 172.21.15.26:0/3597525855 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f638409d6f0 0x7f638411b4b0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f637400c500 tx=0x7f637400c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:42.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.261+0000 7f636bfff700 1 -- 172.21.15.26:0/3597525855 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6374004c80 con 0x7f638409d6f0 2023-10-01T07:58:42.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.261+0000 7f636bfff700 1 -- 172.21.15.26:0/3597525855 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6374015070 con 0x7f638409d6f0 2023-10-01T07:58:42.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.261+0000 7f6389820700 1 -- 172.21.15.26:0/3597525855 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f638411efd0 con 0x7f638409d6f0 2023-10-01T07:58:42.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.261+0000 7f636bfff700 1 -- 172.21.15.26:0/3597525855 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63740070d0 con 0x7f638409d6f0 2023-10-01T07:58:42.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.261+0000 7f6389820700 1 -- 172.21.15.26:0/3597525855 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f638411ecf0 con 0x7f638409d6f0 2023-10-01T07:58:42.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.262+0000 7f85dbb91700 1 Processor -- start 2023-10-01T07:58:42.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.262+0000 7f85dbb91700 1 -- start start 2023-10-01T07:58:42.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.262+0000 7f85dbb91700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f85d4071b40 0x7f85d4130420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:42.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.262+0000 7f85dbb91700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f85d4130960 0x7f85d4133570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:42.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.262+0000 7f85dbb91700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d4099ef0 con 0x7f85d4130d50 2023-10-01T07:58:42.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.262+0000 7f85dbb91700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85d4099500 con 0x7f85d4071b40 2023-10-01T07:58:42.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.262+0000 7f85dbb91700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d4099c10 con 0x7f85d4130960 2023-10-01T07:58:42.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.263+0000 7f85d912c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f85d4130960 0x7f85d4133570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:42.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.263+0000 7f85da12e700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f85d4130d50 0x7f85d4133ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33044/0 (socket says 172.21.15.26:33044) 2023-10-01T07:58:42.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.263+0000 7f85da12e700 1 -- 172.21.15.26:0/2723162747 learned_addr learned my addr 172.21.15.26:0/2723162747 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:42.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.262+0000 7f6389820700 1 -- 172.21.15.26:0/3597525855 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f638409dfc0 con 0x7f638409d6f0 2023-10-01T07:58:42.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.263+0000 7f85d992d700 1 --2- 172.21.15.26:0/2723162747 >> v2:172.21.15.26:3300/0 conn(0x7f85d4071b40 0x7f85d4130420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:42.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.263+0000 7f85d912c700 1 -- 172.21.15.26:0/2723162747 >> v2:172.21.15.26:3300/0 conn(0x7f85d4071b40 msgr2=0x7f85d4130420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:42.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.263+0000 7f85d912c700 1 --2- 172.21.15.26:0/2723162747 >> v2:172.21.15.26:3300/0 conn(0x7f85d4071b40 0x7f85d4130420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:42.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.263+0000 7f85d912c700 1 -- 172.21.15.26:0/2723162747 >> v1:172.21.15.26:6789/0 conn(0x7f85d4130d50 legacy=0x7f85d4133ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:42.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.263+0000 7f85d912c700 1 -- 172.21.15.26:0/2723162747 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d409e370 con 0x7f85d4130960 2023-10-01T07:58:42.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.263+0000 7f636bfff700 1 -- 172.21.15.26:0/3597525855 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6374007230 con 0x7f638409d6f0 2023-10-01T07:58:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.263+0000 7f85d912c700 1 --2- 172.21.15.26:0/2723162747 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f85d4130960 0x7f85d4133570 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f85c4009840 tx=0x7f85c4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c428b72509803965 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.263+0000 7f636bfff700 1 -- 172.21.15.26:0/3597525855 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6374042f50 con 0x7f638409d6f0 2023-10-01T07:58:42.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.265+0000 7fbdace97700 1 Processor -- start 2023-10-01T07:58:42.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.265+0000 7fbdace97700 1 -- start start 2023-10-01T07:58:42.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.266+0000 7fbdace97700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbda8131810 0x7fbda8131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:42.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.266+0000 7fbdace97700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbda809a580 0x7fbda8139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:42.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.266+0000 7fbdace97700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda81313c0 con 0x7fbda8099a40 2023-10-01T07:58:42.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.266+0000 7fbdace97700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda806e8c0 con 0x7fbda8131810 2023-10-01T07:58:42.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.266+0000 7fbdace97700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbda8071d20 con 0x7fbda809a580 2023-10-01T07:58:42.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.266+0000 7fbda659c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbda8131810 0x7fbda8131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:42.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.266+0000 7fbda659c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbda8131810 0x7fbda8131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52636/0 (socket says 172.21.15.26:52636) 2023-10-01T07:58:42.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.266+0000 7fbda659c700 1 -- 172.21.15.26:0/3863641742 learned_addr learned my addr 172.21.15.26:0/3863641742 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:42.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.266+0000 7fbda6d9d700 1 --2- 172.21.15.26:0/3863641742 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbda809a580 0x7fbda8139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:42.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.266+0000 7fbda6d9d700 1 -- 172.21.15.26:0/3863641742 >> v2:172.21.15.26:3300/0 conn(0x7fbda8131810 msgr2=0x7fbda8131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:42.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.266+0000 7fbda6d9d700 1 --2- 172.21.15.26:0/3863641742 >> v2:172.21.15.26:3300/0 conn(0x7fbda8131810 0x7fbda8131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:42.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.266+0000 7fbda6d9d700 1 -- 172.21.15.26:0/3863641742 >> v1:172.21.15.26:6789/0 conn(0x7fbda8099a40 legacy=0x7fbda8099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:42.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.266+0000 7fbda559a700 1 -- 172.21.15.26:0/3863641742 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 940738871 0 0) 0x7fbda81313c0 con 0x7fbda8099a40 2023-10-01T07:58:42.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.266+0000 7fbda6d9d700 1 -- 172.21.15.26:0/3863641742 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda80721a0 con 0x7fbda809a580 2023-10-01T07:58:42.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.266+0000 7fbda659c700 1 --2- 172.21.15.26:0/3863641742 >> v2:172.21.15.26:3300/0 conn(0x7fbda8131810 0x7fbda8131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:42.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.266+0000 7fbda6d9d700 1 --2- 172.21.15.26:0/3863641742 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbda809a580 0x7fbda8139660 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fbda0009d90 tx=0x7fbda000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b8b5979e511fb3b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:42.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.267+0000 7fbda559a700 1 -- 172.21.15.26:0/3863641742 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda000e070 con 0x7fbda809a580 2023-10-01T07:58:42.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.267+0000 7fbda559a700 1 -- 172.21.15.26:0/3863641742 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda000bb20 con 0x7fbda809a580 2023-10-01T07:58:42.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.267+0000 7fbda559a700 1 -- 172.21.15.26:0/3863641742 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda0012430 con 0x7fbda809a580 2023-10-01T07:58:42.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.267+0000 7fbdace97700 1 -- 172.21.15.26:0/3863641742 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbda809a580 msgr2=0x7fbda8139660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:42.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.267+0000 7fbdace97700 1 --2- 172.21.15.26:0/3863641742 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbda809a580 0x7fbda8139660 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fbda0009d90 tx=0x7fbda000b330 comp rx=0 tx=0).stop 2023-10-01T07:58:42.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.267+0000 7fbdace97700 1 -- 172.21.15.26:0/3863641742 shutdown_connections 2023-10-01T07:58:42.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.267+0000 7fbdace97700 1 --2- 172.21.15.26:0/3863641742 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbda809a580 0x7fbda8139660 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:42.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.267+0000 7fbdace97700 1 --2- 172.21.15.26:0/3863641742 >> v2:172.21.15.26:3300/0 conn(0x7fbda8131810 0x7fbda8131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:42.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.267+0000 7fbdace97700 1 -- 172.21.15.26:0/3863641742 >> 172.21.15.26:0/3863641742 conn(0x7fbda80a2aa0 msgr2=0x7fbda80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:42.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.268+0000 7fbdace97700 1 -- 172.21.15.26:0/3863641742 shutdown_connections 2023-10-01T07:58:42.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.268+0000 7fbdace97700 1 -- 172.21.15.26:0/3863641742 wait complete. 2023-10-01T07:58:42.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.269+0000 7fbdace97700 1 Processor -- start 2023-10-01T07:58:42.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.269+0000 7fbdace97700 1 -- start start 2023-10-01T07:58:42.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.269+0000 7fbdace97700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbda8099a40 0x7fbda811fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:42.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.269+0000 7fbdace97700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbda809a580 0x7fbda8120150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:42.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.269+0000 7fbdace97700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbda8131810 0x7fbda8120690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:42.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.269+0000 7fbdace97700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda8123730 con 0x7fbda8131810 2023-10-01T07:58:42.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.269+0000 7fbdace97700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda80a1b20 con 0x7fbda8099a40 2023-10-01T07:58:42.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.269+0000 7fbdace97700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbda806eb00 con 0x7fbda809a580 2023-10-01T07:58:42.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.269+0000 7fbda5d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbda809a580 0x7fbda8120150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:42.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.269+0000 7fbda5d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbda809a580 0x7fbda8120150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39394/0 (socket says 172.21.15.26:39394) 2023-10-01T07:58:42.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.269+0000 7fbda5d9b700 1 -- 172.21.15.26:0/2668947606 learned_addr learned my addr 172.21.15.26:0/2668947606 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:42.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.269+0000 7fbda659c700 1 --2- 172.21.15.26:0/2668947606 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbda8099a40 0x7fbda811fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:42.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.270+0000 7fbda6d9d700 1 --2- 172.21.15.26:0/2668947606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbda8131810 0x7fbda8120690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:42.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.270+0000 7fbda5d9b700 1 -- 172.21.15.26:0/2668947606 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbda8099a40 msgr2=0x7fbda811fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:42.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.270+0000 7fbda5d9b700 1 --2- 172.21.15.26:0/2668947606 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbda8099a40 0x7fbda811fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:42.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.270+0000 7fbda5d9b700 1 -- 172.21.15.26:0/2668947606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbda8131810 msgr2=0x7fbda8120690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:42.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.270+0000 7fbda5d9b700 1 --2- 172.21.15.26:0/2668947606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbda8131810 0x7fbda8120690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:42.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.270+0000 7fbda5d9b700 1 -- 172.21.15.26:0/2668947606 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd98009550 con 0x7fbda809a580 2023-10-01T07:58:42.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.270+0000 7fbda5d9b700 1 --2- 172.21.15.26:0/2668947606 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbda809a580 0x7fbda8120150 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c00c550 tx=0x7fbd9c00c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:42.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.270+0000 7fbd96ffd700 1 -- 172.21.15.26:0/2668947606 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c0054e0 con 0x7fbda809a580 2023-10-01T07:58:42.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.270+0000 7fbd96ffd700 1 -- 172.21.15.26:0/2668947606 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9c003680 con 0x7fbda809a580 2023-10-01T07:58:42.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.270+0000 7fbdace97700 1 -- 172.21.15.26:0/2668947606 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda0009a70 con 0x7fbda809a580 2023-10-01T07:58:42.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.270+0000 7fbd96ffd700 1 -- 172.21.15.26:0/2668947606 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c003a30 con 0x7fbda809a580 2023-10-01T07:58:42.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.270+0000 7fbdace97700 1 -- 172.21.15.26:0/2668947606 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda8122ac0 con 0x7fbda809a580 2023-10-01T07:58:42.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.271+0000 7fbd96ffd700 1 -- 172.21.15.26:0/2668947606 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbd9c003b90 con 0x7fbda809a580 2023-10-01T07:58:42.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.271+0000 7fbd96ffd700 1 -- 172.21.15.26:0/2668947606 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbd9c03eab0 con 0x7fbda809a580 2023-10-01T07:58:42.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.272+0000 7fbdace97700 1 -- 172.21.15.26:0/2668947606 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbda81232b0 con 0x7fbda809a580 2023-10-01T07:58:42.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.273+0000 7f85d892b700 1 -- 172.21.15.26:0/2723162747 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c4011830 con 0x7f85d4130960 2023-10-01T07:58:42.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.273+0000 7f85d892b700 1 -- 172.21.15.26:0/2723162747 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c4011990 con 0x7f85d4130960 2023-10-01T07:58:42.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.273+0000 7f85d892b700 1 -- 172.21.15.26:0/2723162747 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c4011d20 con 0x7f85d4130960 2023-10-01T07:58:42.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.273+0000 7f636bfff700 1 -- 172.21.15.26:0/3597525855 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6374017240 con 0x7f638409d6f0 2023-10-01T07:58:42.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.273+0000 7f85dbb91700 1 -- 172.21.15.26:0/2723162747 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f85d4130960 msgr2=0x7f85d4133570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:42.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.273+0000 7f85dbb91700 1 --2- 172.21.15.26:0/2723162747 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f85d4130960 0x7f85d4133570 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f85c4009840 tx=0x7f85c4009b50 comp rx=0 tx=0).stop 2023-10-01T07:58:42.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.273+0000 7f85dbb91700 1 -- 172.21.15.26:0/2723162747 shutdown_connections 2023-10-01T07:58:42.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.273+0000 7f85dbb91700 1 --2- 172.21.15.26:0/2723162747 >> v2:172.21.15.26:3300/0 conn(0x7f85d4071b40 0x7f85d4130420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:42.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.273+0000 7f85dbb91700 1 --2- 172.21.15.26:0/2723162747 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f85d4130960 0x7f85d4133570 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:42.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.274+0000 7f85dbb91700 1 -- 172.21.15.26:0/2723162747 >> 172.21.15.26:0/2723162747 conn(0x7f85d409e7e0 msgr2=0x7f85d409ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:42.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.274+0000 7f85dbb91700 1 -- 172.21.15.26:0/2723162747 shutdown_connections 2023-10-01T07:58:42.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.274+0000 7f85dbb91700 1 -- 172.21.15.26:0/2723162747 wait complete. 2023-10-01T07:58:42.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.275+0000 7f85dbb91700 1 Processor -- start 2023-10-01T07:58:42.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.275+0000 7f85dbb91700 1 -- start start 2023-10-01T07:58:42.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.275+0000 7f85dbb91700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85d4071b40 0x7f85d413a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:42.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.275+0000 7f85dbb91700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f85d4130960 0x7f85d413aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:42.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.275+0000 7f85dbb91700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f85d4130d50 0x7f85d413b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:42.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.275+0000 7f85dbb91700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d406f110 con 0x7f85d4071b40 2023-10-01T07:58:42.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.275+0000 7f85dbb91700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d406eeb0 con 0x7f85d4130960 2023-10-01T07:58:42.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.275+0000 7f85dbb91700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85d409fe70 con 0x7f85d4130d50 2023-10-01T07:58:42.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.276+0000 7f85da12e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f85d4130d50 0x7f85d413b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:42.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.276+0000 7f85da12e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f85d4130d50 0x7f85d413b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:39404/0 (socket says 172.21.15.26:39404) 2023-10-01T07:58:42.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.276+0000 7f85da12e700 1 -- 172.21.15.26:0/3274457750 learned_addr learned my addr 172.21.15.26:0/3274457750 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:42.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.276+0000 7f85d912c700 1 --2- 172.21.15.26:0/3274457750 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f85d4130960 0x7f85d413aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:42.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.276+0000 7f85da12e700 1 -- 172.21.15.26:0/3274457750 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f85d4130960 msgr2=0x7f85d413aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:42.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.276+0000 7f85da12e700 1 --2- 172.21.15.26:0/3274457750 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f85d4130960 0x7f85d413aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:42.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.276+0000 7f85da12e700 1 -- 172.21.15.26:0/3274457750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85d4071b40 msgr2=0x7f85d413a580 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:58:42.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.276+0000 7f85da12e700 1 --2- 172.21.15.26:0/3274457750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85d4071b40 0x7f85d413a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:42.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.276+0000 7f85da12e700 1 -- 172.21.15.26:0/3274457750 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c40094a0 con 0x7f85d4130d50 2023-10-01T07:58:42.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.276+0000 7f85da12e700 1 --2- 172.21.15.26:0/3274457750 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f85d4130d50 0x7f85d413b000 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f85cc00cb10 tx=0x7f85cc00ce20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:42.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.278+0000 7f85ca7fc700 1 -- 172.21.15.26:0/3274457750 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc00aaa0 con 0x7f85d4130d50 2023-10-01T07:58:42.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.278+0000 7f85ca7fc700 1 -- 172.21.15.26:0/3274457750 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85cc00ac00 con 0x7f85d4130d50 2023-10-01T07:58:42.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.278+0000 7f85ca7fc700 1 -- 172.21.15.26:0/3274457750 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc012400 con 0x7f85d4130d50 2023-10-01T07:58:42.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.278+0000 7fbd96ffd700 1 -- 172.21.15.26:0/2668947606 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbda81232b0 con 0x7fbda809a580 2023-10-01T07:58:42.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.279+0000 7f85dbb91700 1 -- 172.21.15.26:0/3274457750 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d409c150 con 0x7f85d4130d50 2023-10-01T07:58:42.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.279+0000 7f85dbb91700 1 -- 172.21.15.26:0/3274457750 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d412f880 con 0x7f85d4130d50 2023-10-01T07:58:42.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.279+0000 7f85ca7fc700 1 -- 172.21.15.26:0/3274457750 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f85cc01b3b0 con 0x7f85d4130d50 2023-10-01T07:58:42.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.280+0000 7f85ca7fc700 1 -- 172.21.15.26:0/3274457750 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f85cc03f320 con 0x7f85d4130d50 2023-10-01T07:58:42.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.280+0000 7f85dbb91700 1 -- 172.21.15.26:0/3274457750 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85d40747f0 con 0x7f85d4130d50 2023-10-01T07:58:42.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.289+0000 7f85ca7fc700 1 -- 172.21.15.26:0/3274457750 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f85cc0192c0 con 0x7f85d4130d50 2023-10-01T07:58:42.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.483+0000 7f6389820700 1 -- 172.21.15.26:0/3597525855 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6384074ea0 con 0x7f638409d6f0 2023-10-01T07:58:42.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.484+0000 7f636bfff700 1 -- 172.21.15.26:0/3597525855 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f637401a390 con 0x7f638409d6f0 2023-10-01T07:58:42.485 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:42.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.487+0000 7f6389820700 1 -- 172.21.15.26:0/3597525855 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f638409d6f0 msgr2=0x7f638411b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:42.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.487+0000 7f6389820700 1 --2- 172.21.15.26:0/3597525855 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f638409d6f0 0x7f638411b4b0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f637400c500 tx=0x7f637400c810 comp rx=0 tx=0).stop 2023-10-01T07:58:42.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.487+0000 7f6389820700 1 -- 172.21.15.26:0/3597525855 shutdown_connections 2023-10-01T07:58:42.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.487+0000 7f6389820700 1 --2- 172.21.15.26:0/3597525855 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6384135e50 0x7f638411bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:42.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.487+0000 7f6389820700 1 --2- 172.21.15.26:0/3597525855 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f638409d6f0 0x7f638411b4b0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:42.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.487+0000 7f6389820700 1 --2- 172.21.15.26:0/3597525855 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f638409e1d0 0x7f638411b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:42.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.487+0000 7f6389820700 1 -- 172.21.15.26:0/3597525855 >> 172.21.15.26:0/3597525855 conn(0x7f6384066f50 msgr2=0x7f63841326f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:42.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.487+0000 7f6389820700 1 -- 172.21.15.26:0/3597525855 shutdown_connections 2023-10-01T07:58:42.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.487+0000 7f6389820700 1 -- 172.21.15.26:0/3597525855 wait complete. 2023-10-01T07:58:42.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.488+0000 7f0138ff6700 1 -- 172.21.15.26:0/646548094 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f013411ecd0 con 0x7f0134099a40 2023-10-01T07:58:42.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.489+0000 7f0122ffd700 1 -- 172.21.15.26:0/646548094 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f013411ecd0 con 0x7f0134099a40 2023-10-01T07:58:42.490 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:42.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.491+0000 7f0138ff6700 1 -- 172.21.15.26:0/646548094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0134099a40 msgr2=0x7f013411b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:42.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.491+0000 7f0138ff6700 1 --2- 172.21.15.26:0/646548094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0134099a40 0x7f013411b630 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f012400e930 tx=0x7f012400ec40 comp rx=0 tx=0).stop 2023-10-01T07:58:42.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.491+0000 7f0138ff6700 1 -- 172.21.15.26:0/646548094 shutdown_connections 2023-10-01T07:58:42.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.491+0000 7f0138ff6700 1 --2- 172.21.15.26:0/646548094 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0134131810 0x7f013411c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:42.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.491+0000 7f0138ff6700 1 --2- 172.21.15.26:0/646548094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0134099a40 0x7f013411b630 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:42.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.491+0000 7f0138ff6700 1 --2- 172.21.15.26:0/646548094 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f013409a580 0x7f013411bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:42.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.491+0000 7f0138ff6700 1 -- 172.21.15.26:0/646548094 >> 172.21.15.26:0/646548094 conn(0x7f01340a2aa0 msgr2=0x7f01341b8420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:42.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.491+0000 7f0138ff6700 1 -- 172.21.15.26:0/646548094 shutdown_connections 2023-10-01T07:58:42.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.491+0000 7f0138ff6700 1 -- 172.21.15.26:0/646548094 wait complete. 2023-10-01T07:58:42.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.492+0000 7fbdace97700 1 -- 172.21.15.26:0/2668947606 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbda81232b0 con 0x7fbda809a580 2023-10-01T07:58:42.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.492+0000 7fbd96ffd700 1 -- 172.21.15.26:0/2668947606 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbda81232b0 con 0x7fbda809a580 2023-10-01T07:58:42.493 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:42.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.495+0000 7fbdace97700 1 -- 172.21.15.26:0/2668947606 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbda809a580 msgr2=0x7fbda8120150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:42.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.495+0000 7fbdace97700 1 --2- 172.21.15.26:0/2668947606 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbda809a580 0x7fbda8120150 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c00c550 tx=0x7fbd9c00c860 comp rx=0 tx=0).stop 2023-10-01T07:58:42.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.495+0000 7fbdace97700 1 -- 172.21.15.26:0/2668947606 shutdown_connections 2023-10-01T07:58:42.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.495+0000 7fbdace97700 1 --2- 172.21.15.26:0/2668947606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbda8131810 0x7fbda8120690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:42.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.495+0000 7fbdace97700 1 --2- 172.21.15.26:0/2668947606 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbda8099a40 0x7fbda811fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:42.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.495+0000 7fbdace97700 1 --2- 172.21.15.26:0/2668947606 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbda809a580 0x7fbda8120150 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:42.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.495+0000 7fbdace97700 1 -- 172.21.15.26:0/2668947606 >> 172.21.15.26:0/2668947606 conn(0x7fbda80a2aa0 msgr2=0x7fbda809d770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:42.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.495+0000 7fbdace97700 1 -- 172.21.15.26:0/2668947606 shutdown_connections 2023-10-01T07:58:42.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.495+0000 7fbdace97700 1 -- 172.21.15.26:0/2668947606 wait complete. 2023-10-01T07:58:42.506 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:42.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:42.512 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:42.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.526+0000 7f85dbb91700 1 -- 172.21.15.26:0/3274457750 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f85d406b250 con 0x7f85d4130d50 2023-10-01T07:58:42.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.527+0000 7f85ca7fc700 1 -- 172.21.15.26:0/3274457750 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f85cc017020 con 0x7f85d4130d50 2023-10-01T07:58:42.527 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:42.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.529+0000 7f85dbb91700 1 -- 172.21.15.26:0/3274457750 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f85d4130d50 msgr2=0x7f85d413b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:42.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.529+0000 7f85dbb91700 1 --2- 172.21.15.26:0/3274457750 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f85d4130d50 0x7f85d413b000 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f85cc00cb10 tx=0x7f85cc00ce20 comp rx=0 tx=0).stop 2023-10-01T07:58:42.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.529+0000 7f85dbb91700 1 -- 172.21.15.26:0/3274457750 shutdown_connections 2023-10-01T07:58:42.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.529+0000 7f85dbb91700 1 --2- 172.21.15.26:0/3274457750 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f85d4130d50 0x7f85d413b000 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:42.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.529+0000 7f85dbb91700 1 --2- 172.21.15.26:0/3274457750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85d4071b40 0x7f85d413a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:42.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.529+0000 7f85dbb91700 1 --2- 172.21.15.26:0/3274457750 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f85d4130960 0x7f85d413aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:42.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.529+0000 7f85dbb91700 1 -- 172.21.15.26:0/3274457750 >> 172.21.15.26:0/3274457750 conn(0x7f85d409e7e0 msgr2=0x7f85d409c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:42.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.529+0000 7f85dbb91700 1 -- 172.21.15.26:0/3274457750 shutdown_connections 2023-10-01T07:58:42.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:42.529+0000 7f85dbb91700 1 -- 172.21.15.26:0/3274457750 wait complete. 2023-10-01T07:58:42.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:43.507 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:43.509 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:43.513 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:43.545 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:43.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.662+0000 7efcea09c700 1 Processor -- start 2023-10-01T07:58:43.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.662+0000 7efcea09c700 1 -- start start 2023-10-01T07:58:43.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.663+0000 7efcea09c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efce4133420 0x7efce41337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:43.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.663+0000 7efcea09c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efce4133e30 0x7efce412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:43.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.663+0000 7efcea09c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce406b990 con 0x7efce4134260 2023-10-01T07:58:43.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.663+0000 7efcea09c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efce40a0590 con 0x7efce4133e30 2023-10-01T07:58:43.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.663+0000 7efcea09c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efce409fb80 con 0x7efce4133420 2023-10-01T07:58:43.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.663+0000 7efce2ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efce4133e30 0x7efce412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:43.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.663+0000 7efce2ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efce4133e30 0x7efce412ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50374/0 (socket says 172.21.15.26:50374) 2023-10-01T07:58:43.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.663+0000 7efce2ffd700 1 -- 172.21.15.26:0/1784095700 learned_addr learned my addr 172.21.15.26:0/1784095700 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:43.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.663+0000 7efce3fff700 1 --1- 172.21.15.26:0/1784095700 >> v1:172.21.15.26:6789/0 conn(0x7efce4134260 0x7efce41304d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:55832/0 (socket says 172.21.15.26:55832) 2023-10-01T07:58:43.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.663+0000 7efce37fe700 1 --2- 172.21.15.26:0/1784095700 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efce4133420 0x7efce41337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:43.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.663+0000 7fc1fa591700 1 Processor -- start 2023-10-01T07:58:43.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.663+0000 7efce37fe700 1 -- 172.21.15.26:0/1784095700 >> v2:172.21.15.26:3300/0 conn(0x7efce4133e30 msgr2=0x7efce412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:43.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.663+0000 7efce37fe700 1 --2- 172.21.15.26:0/1784095700 >> v2:172.21.15.26:3300/0 conn(0x7efce4133e30 0x7efce412ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:43.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.663+0000 7efce37fe700 1 -- 172.21.15.26:0/1784095700 >> v1:172.21.15.26:6789/0 conn(0x7efce4134260 legacy=0x7efce41304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:43.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.663+0000 7efce37fe700 1 -- 172.21.15.26:0/1784095700 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce40a0030 con 0x7efce4133420 2023-10-01T07:58:43.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.663+0000 7fc1fa591700 1 -- start start 2023-10-01T07:58:43.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.664+0000 7efce37fe700 1 --2- 172.21.15.26:0/1784095700 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efce4133420 0x7efce41337f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7efcd4009840 tx=0x7efcd4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5884d00a8cdae3ee server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:43.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.664+0000 7fc1fa591700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc1f412cf60 0x7fc1f406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:43.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.664+0000 7fc1fa591700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1f4130430 0x7fc1f4137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:43.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.664+0000 7fc1fa591700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f412cd90 con 0x7fc1f412f8b0 2023-10-01T07:58:43.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.664+0000 7fc1fa591700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f412d330 con 0x7fc1f4130430 2023-10-01T07:58:43.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.664+0000 7fc1fa591700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f4071780 con 0x7fc1f412cf60 2023-10-01T07:58:43.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.664+0000 7fc1f37fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc1f412f8b0 0x7fc1f412fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:55834/0 (socket says 172.21.15.26:55834) 2023-10-01T07:58:43.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.664+0000 7fc1f37fe700 1 -- 172.21.15.26:0/3461364514 learned_addr learned my addr 172.21.15.26:0/3461364514 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:43.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.664+0000 7fc1f3fff700 1 --2- 172.21.15.26:0/3461364514 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc1f412cf60 0x7fc1f406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:43.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.664+0000 7fc1f8b2e700 1 --2- 172.21.15.26:0/3461364514 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1f4130430 0x7fc1f4137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:43.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.664+0000 7efce27fc700 1 -- 172.21.15.26:0/1784095700 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd4004230 con 0x7efce4133420 2023-10-01T07:58:43.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.664+0000 7efce27fc700 1 -- 172.21.15.26:0/1784095700 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd4004390 con 0x7efce4133420 2023-10-01T07:58:43.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.664+0000 7efce27fc700 1 -- 172.21.15.26:0/1784095700 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd40036a0 con 0x7efce4133420 2023-10-01T07:58:43.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.665+0000 7fc1f8b2e700 1 -- 172.21.15.26:0/3461364514 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc1f412cf60 msgr2=0x7fc1f406f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:43.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.665+0000 7fc1f8b2e700 1 --2- 172.21.15.26:0/3461364514 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc1f412cf60 0x7fc1f406f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:43.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.665+0000 7fc1f8b2e700 1 -- 172.21.15.26:0/3461364514 >> v1:172.21.15.26:6789/0 conn(0x7fc1f412f8b0 legacy=0x7fc1f412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:43.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.665+0000 7fc1f8b2e700 1 -- 172.21.15.26:0/3461364514 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f4071a40 con 0x7fc1f4130430 2023-10-01T07:58:43.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.665+0000 7fc1f8b2e700 1 --2- 172.21.15.26:0/3461364514 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1f4130430 0x7fc1f4137c30 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec010400 tx=0x7fc1ec010710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3b79567c487db8a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:43.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.665+0000 7efcea09c700 1 -- 172.21.15.26:0/1784095700 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efce4133420 msgr2=0x7efce41337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:43.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.665+0000 7efcea09c700 1 --2- 172.21.15.26:0/1784095700 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efce4133420 0x7efce41337f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7efcd4009840 tx=0x7efcd4009b50 comp rx=0 tx=0).stop 2023-10-01T07:58:43.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.665+0000 7fc1f2ffd700 1 -- 172.21.15.26:0/3461364514 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec01b680 con 0x7fc1f4130430 2023-10-01T07:58:43.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.665+0000 7efcea09c700 1 -- 172.21.15.26:0/1784095700 shutdown_connections 2023-10-01T07:58:43.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.665+0000 7efcea09c700 1 --2- 172.21.15.26:0/1784095700 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efce4133420 0x7efce41337f0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:43.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.665+0000 7efcea09c700 1 --2- 172.21.15.26:0/1784095700 >> v2:172.21.15.26:3300/0 conn(0x7efce4133e30 0x7efce412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:43.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.665+0000 7efcea09c700 1 -- 172.21.15.26:0/1784095700 >> 172.21.15.26:0/1784095700 conn(0x7efce40a4210 msgr2=0x7efce40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:43.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.665+0000 7fc1f2ffd700 1 -- 172.21.15.26:0/3461364514 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ec01b7e0 con 0x7fc1f4130430 2023-10-01T07:58:43.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.665+0000 7fc1f2ffd700 1 -- 172.21.15.26:0/3461364514 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec01bb70 con 0x7fc1f4130430 2023-10-01T07:58:43.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.665+0000 7efcea09c700 1 -- 172.21.15.26:0/1784095700 shutdown_connections 2023-10-01T07:58:43.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.666+0000 7efcea09c700 1 -- 172.21.15.26:0/1784095700 wait complete. 2023-10-01T07:58:43.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.666+0000 7fc1fa591700 1 -- 172.21.15.26:0/3461364514 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1f4130430 msgr2=0x7fc1f4137c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:43.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.666+0000 7fc1fa591700 1 --2- 172.21.15.26:0/3461364514 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1f4130430 0x7fc1f4137c30 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec010400 tx=0x7fc1ec010710 comp rx=0 tx=0).stop 2023-10-01T07:58:43.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.667+0000 7fc1fa591700 1 -- 172.21.15.26:0/3461364514 shutdown_connections 2023-10-01T07:58:43.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.667+0000 7efcea09c700 1 Processor -- start 2023-10-01T07:58:43.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.667+0000 7fc1fa591700 1 --2- 172.21.15.26:0/3461364514 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc1f412cf60 0x7fc1f406f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:43.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.667+0000 7fc1fa591700 1 --2- 172.21.15.26:0/3461364514 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1f4130430 0x7fc1f4137c30 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:43.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.667+0000 7fc1fa591700 1 -- 172.21.15.26:0/3461364514 >> 172.21.15.26:0/3461364514 conn(0x7fc1f40a2aa0 msgr2=0x7fc1f40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:43.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.667+0000 7fc1fa591700 1 -- 172.21.15.26:0/3461364514 shutdown_connections 2023-10-01T07:58:43.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.667+0000 7fc1fa591700 1 -- 172.21.15.26:0/3461364514 wait complete. 2023-10-01T07:58:43.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.667+0000 7efcea09c700 1 -- start start 2023-10-01T07:58:43.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.668+0000 7efcea09c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efce4133420 0x7efce40709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:43.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.668+0000 7efcea09c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efce4133e30 0x7efce4070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:43.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.668+0000 7efcea09c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efce4134260 0x7efce4071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:43.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.668+0000 7efcea09c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce41200c0 con 0x7efce4133420 2023-10-01T07:58:43.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.668+0000 7efcea09c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce412d970 con 0x7efce4134260 2023-10-01T07:58:43.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.668+0000 7efcea09c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efce4071d70 con 0x7efce4133e30 2023-10-01T07:58:43.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.668+0000 7efce3fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efce4134260 0x7efce4071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:43.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.668+0000 7efce3fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efce4134260 0x7efce4071420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58682/0 (socket says 172.21.15.26:58682) 2023-10-01T07:58:43.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.668+0000 7efce3fff700 1 -- 172.21.15.26:0/1437139278 learned_addr learned my addr 172.21.15.26:0/1437139278 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:43.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.668+0000 7efce2ffd700 1 --2- 172.21.15.26:0/1437139278 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efce4133e30 0x7efce4070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:43.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.668+0000 7fc1fa591700 1 Processor -- start 2023-10-01T07:58:43.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.668+0000 7efce3fff700 1 -- 172.21.15.26:0/1437139278 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efce4133e30 msgr2=0x7efce4070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:43.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.668+0000 7efce3fff700 1 --2- 172.21.15.26:0/1437139278 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efce4133e30 0x7efce4070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:43.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.668+0000 7efce3fff700 1 -- 172.21.15.26:0/1437139278 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efce4133420 msgr2=0x7efce40709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:43.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.668+0000 7efce3fff700 1 --2- 172.21.15.26:0/1437139278 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efce4133420 0x7efce40709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:43.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.668+0000 7efce3fff700 1 -- 172.21.15.26:0/1437139278 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd40094a0 con 0x7efce4134260 2023-10-01T07:58:43.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.669+0000 7fc1fa591700 1 -- start start 2023-10-01T07:58:43.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.669+0000 7efce3fff700 1 --2- 172.21.15.26:0/1437139278 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efce4134260 0x7efce4071420 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7efcdc00cc40 tx=0x7efcdc00cf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:43.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.669+0000 7efccbfff700 1 -- 172.21.15.26:0/1437139278 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc00aa70 con 0x7efce4134260 2023-10-01T07:58:43.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.669+0000 7efccbfff700 1 -- 172.21.15.26:0/1437139278 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcdc00abd0 con 0x7efce4134260 2023-10-01T07:58:43.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.669+0000 7efccbfff700 1 -- 172.21.15.26:0/1437139278 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc007070 con 0x7efce4134260 2023-10-01T07:58:43.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.669+0000 7efcea09c700 1 -- 172.21.15.26:0/1437139278 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce411f850 con 0x7efce4134260 2023-10-01T07:58:43.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.669+0000 7efcea09c700 1 -- 172.21.15.26:0/1437139278 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efce411f400 con 0x7efce4134260 2023-10-01T07:58:43.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.669+0000 7fc1fa591700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1f412cf60 0x7fc1f409bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:43.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.669+0000 7fc1fa591700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1f412f8b0 0x7fc1f409c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:43.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.669+0000 7fc1fa591700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc1f4130430 0x7fc1f41c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:43.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.669+0000 7fc1fa591700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f41297d0 con 0x7fc1f412cf60 2023-10-01T07:58:43.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.669+0000 7fc1fa591700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f409b5d0 con 0x7fc1f412f8b0 2023-10-01T07:58:43.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.669+0000 7fc1fa591700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f41299a0 con 0x7fc1f4130430 2023-10-01T07:58:43.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.669+0000 7fc1f3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1f412cf60 0x7fc1f409bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:43.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.669+0000 7fc1f8b2e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc1f4130430 0x7fc1f41c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:43.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.669+0000 7fc1f3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1f412cf60 0x7fc1f409bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50388/0 (socket says 172.21.15.26:50388) 2023-10-01T07:58:43.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.669+0000 7fc1f3fff700 1 -- 172.21.15.26:0/433778864 learned_addr learned my addr 172.21.15.26:0/433778864 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:43.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.670+0000 7fc1f3fff700 1 -- 172.21.15.26:0/433778864 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc1f4130430 msgr2=0x7fc1f41c3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:43.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.670+0000 7fc1f3fff700 1 --2- 172.21.15.26:0/433778864 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc1f4130430 0x7fc1f41c3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:43.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.670+0000 7fc1f3fff700 1 -- 172.21.15.26:0/433778864 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1f412f8b0 msgr2=0x7fc1f409c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:43.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.670+0000 7fc1f3fff700 1 --2- 172.21.15.26:0/433778864 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1f412f8b0 0x7fc1f409c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:43.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.670+0000 7fc1f3fff700 1 -- 172.21.15.26:0/433778864 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ec00bc50 con 0x7fc1f412cf60 2023-10-01T07:58:43.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.670+0000 7fc1f8b2e700 1 --2- 172.21.15.26:0/433778864 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc1f4130430 0x7fc1f41c3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:43.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.670+0000 7fc1f3fff700 1 --2- 172.21.15.26:0/433778864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1f412cf60 0x7fc1f409bac0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fc1e400e930 tx=0x7fc1e400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:43.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.670+0000 7fc1f0ff9700 1 -- 172.21.15.26:0/433778864 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e400ee80 con 0x7fc1f412cf60 2023-10-01T07:58:43.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.670+0000 7fc1f0ff9700 1 -- 172.21.15.26:0/433778864 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e400c850 con 0x7fc1f412cf60 2023-10-01T07:58:43.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.670+0000 7fc1f0ff9700 1 -- 172.21.15.26:0/433778864 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e400cbe0 con 0x7fc1f412cf60 2023-10-01T07:58:43.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.671+0000 7fc1fa591700 1 -- 172.21.15.26:0/433778864 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f409c540 con 0x7fc1f412cf60 2023-10-01T07:58:43.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.671+0000 7fc1fa591700 1 -- 172.21.15.26:0/433778864 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f412a000 con 0x7fc1f412cf60 2023-10-01T07:58:43.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.671+0000 7efcea09c700 1 -- 172.21.15.26:0/1437139278 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efce4072280 con 0x7efce4134260 2023-10-01T07:58:43.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.672+0000 7fc1fa591700 1 -- 172.21.15.26:0/433778864 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f4072280 con 0x7fc1f412cf60 2023-10-01T07:58:43.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.672+0000 7fc1f0ff9700 1 -- 172.21.15.26:0/433778864 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc1e400cd40 con 0x7fc1f412cf60 2023-10-01T07:58:43.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.672+0000 7fc1f0ff9700 1 -- 172.21.15.26:0/433778864 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc1e403f7a0 con 0x7fc1f412cf60 2023-10-01T07:58:43.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.672+0000 7efccbfff700 1 -- 172.21.15.26:0/1437139278 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efcdc0071d0 con 0x7efce4134260 2023-10-01T07:58:43.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.673+0000 7efccbfff700 1 -- 172.21.15.26:0/1437139278 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efcdc03f9f0 con 0x7efce4134260 2023-10-01T07:58:43.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.677+0000 7efccbfff700 1 -- 172.21.15.26:0/1437139278 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efcdc0198b0 con 0x7efce4134260 2023-10-01T07:58:43.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.679+0000 7fc1f0ff9700 1 -- 172.21.15.26:0/433778864 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc1e401bdf0 con 0x7fc1f412cf60 2023-10-01T07:58:43.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.702+0000 7fabf1857700 1 Processor -- start 2023-10-01T07:58:43.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.703+0000 7fabf1857700 1 -- start start 2023-10-01T07:58:43.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.703+0000 7fabf1857700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabec0a0a30 0x7fabec0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:43.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.703+0000 7fabf1857700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabec134170 0x7fabec13bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:43.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.703+0000 7fabf1857700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabec09edd0 con 0x7fabec0a1340 2023-10-01T07:58:43.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.703+0000 7fabf1857700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabec09e1f0 con 0x7fabec0a0a30 2023-10-01T07:58:43.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.703+0000 7fabf1857700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabec09dc50 con 0x7fabec134170 2023-10-01T07:58:43.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.704+0000 7fabeb7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabec134170 0x7fabec13bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:43.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.704+0000 7fabeb7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabec134170 0x7fabec13bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:52438/0 (socket says 172.21.15.26:52438) 2023-10-01T07:58:43.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.704+0000 7fabeb7fe700 1 -- 172.21.15.26:0/476207597 learned_addr learned my addr 172.21.15.26:0/476207597 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:43.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.704+0000 7fabeb7fe700 1 -- 172.21.15.26:0/476207597 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabec0a0a30 msgr2=0x7fabec0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:43.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.704+0000 7fabeb7fe700 1 --2- 172.21.15.26:0/476207597 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabec0a0a30 0x7fabec0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:43.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.704+0000 7fabeb7fe700 1 -- 172.21.15.26:0/476207597 >> v1:172.21.15.26:6789/0 conn(0x7fabec0a1340 legacy=0x7fabec133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:43.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.704+0000 7fabeb7fe700 1 -- 172.21.15.26:0/476207597 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabec0a1fe0 con 0x7fabec134170 2023-10-01T07:58:43.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.704+0000 7fabeb7fe700 1 --2- 172.21.15.26:0/476207597 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabec134170 0x7fabec13bd30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fabe4009e80 tx=0x7fabe400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f26f23c573723267 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:43.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.705+0000 7fabe9ffb700 1 -- 172.21.15.26:0/476207597 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe400e070 con 0x7fabec134170 2023-10-01T07:58:43.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.705+0000 7fabe9ffb700 1 -- 172.21.15.26:0/476207597 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe400b9c0 con 0x7fabec134170 2023-10-01T07:58:43.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.705+0000 7fabe9ffb700 1 -- 172.21.15.26:0/476207597 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe400bd70 con 0x7fabec134170 2023-10-01T07:58:43.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.705+0000 7fabf1857700 1 -- 172.21.15.26:0/476207597 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabec134170 msgr2=0x7fabec13bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:43.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.705+0000 7fabf1857700 1 --2- 172.21.15.26:0/476207597 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabec134170 0x7fabec13bd30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fabe4009e80 tx=0x7fabe400b330 comp rx=0 tx=0).stop 2023-10-01T07:58:43.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.705+0000 7fabf1857700 1 -- 172.21.15.26:0/476207597 shutdown_connections 2023-10-01T07:58:43.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.705+0000 7fabf1857700 1 --2- 172.21.15.26:0/476207597 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabec134170 0x7fabec13bd30 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:43.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.705+0000 7fabf1857700 1 --2- 172.21.15.26:0/476207597 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabec0a0a30 0x7fabec0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:43.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.705+0000 7fabf1857700 1 -- 172.21.15.26:0/476207597 >> 172.21.15.26:0/476207597 conn(0x7fabec0a6550 msgr2=0x7fabec0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:43.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.706+0000 7fabf1857700 1 -- 172.21.15.26:0/476207597 shutdown_connections 2023-10-01T07:58:43.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.706+0000 7fabf1857700 1 -- 172.21.15.26:0/476207597 wait complete. 2023-10-01T07:58:43.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.707+0000 7fabf1857700 1 Processor -- start 2023-10-01T07:58:43.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.707+0000 7fabf1857700 1 -- start start 2023-10-01T07:58:43.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.707+0000 7fabf1857700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabec0a0a30 0x7fabec11e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:43.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.707+0000 7fabf1857700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabec0a1340 0x7fabec11ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:43.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.707+0000 7fabf1857700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabec134170 0x7fabec11f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:43.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.707+0000 7fabf1857700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabec121fe0 con 0x7fabec0a0a30 2023-10-01T07:58:43.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.707+0000 7fabf1857700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabec133170 con 0x7fabec134170 2023-10-01T07:58:43.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.707+0000 7fabf1857700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabec120370 con 0x7fabec0a1340 2023-10-01T07:58:43.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.707+0000 7fabeb7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabec134170 0x7fabec11f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:43.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.707+0000 7fabeb7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabec134170 0x7fabec11f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58714/0 (socket says 172.21.15.26:58714) 2023-10-01T07:58:43.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.708+0000 7fabeb7fe700 1 -- 172.21.15.26:0/15681403 learned_addr learned my addr 172.21.15.26:0/15681403 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:43.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.708+0000 7fabea7fc700 1 --2- 172.21.15.26:0/15681403 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabec0a1340 0x7fabec11ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:43.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.708+0000 7fabeb7fe700 1 -- 172.21.15.26:0/15681403 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabec0a1340 msgr2=0x7fabec11ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:43.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.708+0000 7fabeb7fe700 1 --2- 172.21.15.26:0/15681403 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabec0a1340 0x7fabec11ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:43.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.708+0000 7fabeb7fe700 1 -- 172.21.15.26:0/15681403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabec0a0a30 msgr2=0x7fabec11e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:43.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.708+0000 7fabeb7fe700 1 --2- 172.21.15.26:0/15681403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabec0a0a30 0x7fabec11e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:43.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.708+0000 7fabeb7fe700 1 -- 172.21.15.26:0/15681403 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe4009b30 con 0x7fabec134170 2023-10-01T07:58:43.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.708+0000 7fabea7fc700 1 --2- 172.21.15.26:0/15681403 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabec0a1340 0x7fabec11ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:58:43.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.708+0000 7fabeb7fe700 1 --2- 172.21.15.26:0/15681403 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabec134170 0x7fabec11f140 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fabec09dde0 tx=0x7fabe4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:43.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.708+0000 7fabd3fff700 1 -- 172.21.15.26:0/15681403 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe4004450 con 0x7fabec134170 2023-10-01T07:58:43.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.708+0000 7fabd3fff700 1 -- 172.21.15.26:0/15681403 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe40045b0 con 0x7fabec134170 2023-10-01T07:58:43.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.708+0000 7fabf1857700 1 -- 172.21.15.26:0/15681403 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabec0a25e0 con 0x7fabec134170 2023-10-01T07:58:43.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.708+0000 7fabd3fff700 1 -- 172.21.15.26:0/15681403 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe4004920 con 0x7fabec134170 2023-10-01T07:58:43.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.708+0000 7fabf1857700 1 -- 172.21.15.26:0/15681403 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabec133630 con 0x7fabec134170 2023-10-01T07:58:43.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.710+0000 7fabf1857700 1 -- 172.21.15.26:0/15681403 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabec074ea0 con 0x7fabec134170 2023-10-01T07:58:43.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.713+0000 7f2b4894b700 1 Processor -- start 2023-10-01T07:58:43.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.713+0000 7f2b4894b700 1 -- start start 2023-10-01T07:58:43.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.713+0000 7f2b4894b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2b4409d6f0 0x7f2b4409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:43.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.713+0000 7f2b4894b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b4409e410 0x7f2b44130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:43.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.713+0000 7f2b4894b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b4409f130 con 0x7f2b4409e000 2023-10-01T07:58:43.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.713+0000 7f2b4894b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b4409f520 con 0x7f2b4409d6f0 2023-10-01T07:58:43.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.713+0000 7f2b4894b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4409e930 con 0x7f2b4409e410 2023-10-01T07:58:43.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.714+0000 7f2b42d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b4409e410 0x7f2b44130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:43.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.714+0000 7f2b42d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b4409e410 0x7f2b44130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58730/0 (socket says 172.21.15.26:58730) 2023-10-01T07:58:43.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.714+0000 7f2b42d9d700 1 -- 172.21.15.26:0/268940207 learned_addr learned my addr 172.21.15.26:0/268940207 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:43.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.714+0000 7f2b4259c700 1 --2- 172.21.15.26:0/268940207 >> v2:172.21.15.26:3300/0 conn(0x7f2b4409d6f0 0x7f2b4409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:43.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.714+0000 7f2b42d9d700 1 -- 172.21.15.26:0/268940207 >> v2:172.21.15.26:3300/0 conn(0x7f2b4409d6f0 msgr2=0x7f2b4409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:43.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.714+0000 7f2b42d9d700 1 --2- 172.21.15.26:0/268940207 >> v2:172.21.15.26:3300/0 conn(0x7f2b4409d6f0 0x7f2b4409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:43.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.714+0000 7f2b42d9d700 1 -- 172.21.15.26:0/268940207 >> v1:172.21.15.26:6789/0 conn(0x7f2b4409e000 legacy=0x7f2b44130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:43.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.714+0000 7f2b42d9d700 1 -- 172.21.15.26:0/268940207 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4409b2d0 con 0x7f2b4409e410 2023-10-01T07:58:43.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.714+0000 7f2b4259c700 1 --2- 172.21.15.26:0/268940207 >> v2:172.21.15.26:3300/0 conn(0x7f2b4409d6f0 0x7f2b4409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:43.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.714+0000 7f2b42d9d700 1 --2- 172.21.15.26:0/268940207 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b4409e410 0x7f2b44130d70 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c00d150 tx=0x7f2b3c00d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2406c989e318467f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:43.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.710+0000 7fabd3fff700 1 -- 172.21.15.26:0/15681403 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fabe401c410 con 0x7fabec134170 2023-10-01T07:58:43.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.710+0000 7fabd3fff700 1 -- 172.21.15.26:0/15681403 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fabe40415e0 con 0x7fabec134170 2023-10-01T07:58:43.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.719+0000 7f2b4159a700 1 -- 172.21.15.26:0/268940207 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c010070 con 0x7f2b4409e410 2023-10-01T07:58:43.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.719+0000 7f2b4159a700 1 -- 172.21.15.26:0/268940207 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3c00dcd0 con 0x7f2b4409e410 2023-10-01T07:58:43.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.719+0000 7f2b4159a700 1 -- 172.21.15.26:0/268940207 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c00b310 con 0x7f2b4409e410 2023-10-01T07:58:43.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.719+0000 7fabd3fff700 1 -- 172.21.15.26:0/15681403 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fabe401c6c0 con 0x7fabec134170 2023-10-01T07:58:43.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.720+0000 7f2b4894b700 1 -- 172.21.15.26:0/268940207 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b4409e410 msgr2=0x7f2b44130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:43.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.720+0000 7f2b4894b700 1 --2- 172.21.15.26:0/268940207 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b4409e410 0x7f2b44130d70 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c00d150 tx=0x7f2b3c00d460 comp rx=0 tx=0).stop 2023-10-01T07:58:43.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.720+0000 7f2b4894b700 1 -- 172.21.15.26:0/268940207 shutdown_connections 2023-10-01T07:58:43.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.720+0000 7f2b4894b700 1 --2- 172.21.15.26:0/268940207 >> v2:172.21.15.26:3300/0 conn(0x7f2b4409d6f0 0x7f2b4409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:43.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.720+0000 7f2b4894b700 1 --2- 172.21.15.26:0/268940207 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b4409e410 0x7f2b44130d70 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:43.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.720+0000 7f2b4894b700 1 -- 172.21.15.26:0/268940207 >> 172.21.15.26:0/268940207 conn(0x7f2b44066f50 msgr2=0x7f2b4409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:43.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.720+0000 7f2b4894b700 1 -- 172.21.15.26:0/268940207 shutdown_connections 2023-10-01T07:58:43.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.720+0000 7f2b4894b700 1 -- 172.21.15.26:0/268940207 wait complete. 2023-10-01T07:58:43.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.722+0000 7f2b4894b700 1 Processor -- start 2023-10-01T07:58:43.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.722+0000 7f2b4894b700 1 -- start start 2023-10-01T07:58:43.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.722+0000 7f2b4894b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b4409d6f0 0x7f2b4411e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:43.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.722+0000 7f2b4894b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2b4409e000 0x7f2b4411e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:43.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.722+0000 7f2b4894b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b4409e410 0x7f2b4411ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:43.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.722+0000 7f2b4894b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b441305f0 con 0x7f2b4409d6f0 2023-10-01T07:58:43.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.722+0000 7f2b4894b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b44121a20 con 0x7f2b4409e410 2023-10-01T07:58:43.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.722+0000 7f2b4894b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b440a1d00 con 0x7f2b4409e000 2023-10-01T07:58:43.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.722+0000 7f2b41d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2b4409e000 0x7f2b4411e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:43.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.723+0000 7f2b41d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2b4409e000 0x7f2b4411e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:52456/0 (socket says 172.21.15.26:52456) 2023-10-01T07:58:43.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.723+0000 7f2b41d9b700 1 -- 172.21.15.26:0/4259334800 learned_addr learned my addr 172.21.15.26:0/4259334800 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:43.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.723+0000 7f2b4259c700 1 --2- 172.21.15.26:0/4259334800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b4409d6f0 0x7f2b4411e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:43.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.723+0000 7f2b42d9d700 1 --2- 172.21.15.26:0/4259334800 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b4409e410 0x7f2b4411ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:43.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.723+0000 7f2b41d9b700 1 -- 172.21.15.26:0/4259334800 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b4409e410 msgr2=0x7f2b4411ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:43.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.723+0000 7f2b41d9b700 1 --2- 172.21.15.26:0/4259334800 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b4409e410 0x7f2b4411ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:43.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.723+0000 7f2b41d9b700 1 -- 172.21.15.26:0/4259334800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b4409d6f0 msgr2=0x7f2b4411e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:43.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.723+0000 7f2b41d9b700 1 --2- 172.21.15.26:0/4259334800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b4409d6f0 0x7f2b4411e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:43.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.723+0000 7f2b41d9b700 1 -- 172.21.15.26:0/4259334800 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b340094a0 con 0x7f2b4409e000 2023-10-01T07:58:43.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.723+0000 7f2b41d9b700 1 --2- 172.21.15.26:0/4259334800 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2b4409e000 0x7f2b4411e8e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2b3800c4a0 tx=0x7f2b3800c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:43.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.723+0000 7f2b32ffd700 1 -- 172.21.15.26:0/4259334800 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b380054e0 con 0x7f2b4409e000 2023-10-01T07:58:43.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.723+0000 7f2b32ffd700 1 -- 172.21.15.26:0/4259334800 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b38003680 con 0x7f2b4409e000 2023-10-01T07:58:43.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.723+0000 7f2b4894b700 1 -- 172.21.15.26:0/4259334800 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b3c00bd40 con 0x7f2b4409e000 2023-10-01T07:58:43.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.724+0000 7f2b32ffd700 1 -- 172.21.15.26:0/4259334800 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b38003a30 con 0x7f2b4409e000 2023-10-01T07:58:43.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.724+0000 7f2b4894b700 1 -- 172.21.15.26:0/4259334800 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b44122490 con 0x7f2b4409e000 2023-10-01T07:58:43.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.725+0000 7f2b32ffd700 1 -- 172.21.15.26:0/4259334800 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2b38003b90 con 0x7f2b4409e000 2023-10-01T07:58:43.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.725+0000 7f2b4894b700 1 -- 172.21.15.26:0/4259334800 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b44120bf0 con 0x7f2b4409e000 2023-10-01T07:58:43.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.725+0000 7f2b32ffd700 1 -- 172.21.15.26:0/4259334800 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2b3803ebb0 con 0x7f2b4409e000 2023-10-01T07:58:43.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.734+0000 7f2b32ffd700 1 -- 172.21.15.26:0/4259334800 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2b38003e40 con 0x7f2b4409e000 2023-10-01T07:58:43.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.899+0000 7fc1fa591700 1 -- 172.21.15.26:0/433778864 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc1f4074ea0 con 0x7fc1f412cf60 2023-10-01T07:58:43.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.899+0000 7fc1f0ff9700 1 -- 172.21.15.26:0/433778864 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc1e4021070 con 0x7fc1f412cf60 2023-10-01T07:58:43.900 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:43.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.900+0000 7efcea09c700 1 -- 172.21.15.26:0/1437139278 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efce411ec00 con 0x7efce4134260 2023-10-01T07:58:43.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.901+0000 7efccbfff700 1 -- 172.21.15.26:0/1437139278 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efcdc017070 con 0x7efce4134260 2023-10-01T07:58:43.901 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:43.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.902+0000 7fc1fa591700 1 -- 172.21.15.26:0/433778864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1f412cf60 msgr2=0x7fc1f409bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:43.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.902+0000 7fc1fa591700 1 --2- 172.21.15.26:0/433778864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1f412cf60 0x7fc1f409bac0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fc1e400e930 tx=0x7fc1e400ec40 comp rx=0 tx=0).stop 2023-10-01T07:58:43.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.903+0000 7fc1fa591700 1 -- 172.21.15.26:0/433778864 shutdown_connections 2023-10-01T07:58:43.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.903+0000 7fc1fa591700 1 --2- 172.21.15.26:0/433778864 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc1f4130430 0x7fc1f41c3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:43.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.903+0000 7fc1fa591700 1 --2- 172.21.15.26:0/433778864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1f412cf60 0x7fc1f409bac0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:43.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.903+0000 7fc1fa591700 1 --2- 172.21.15.26:0/433778864 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1f412f8b0 0x7fc1f409c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:43.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.903+0000 7fc1fa591700 1 -- 172.21.15.26:0/433778864 >> 172.21.15.26:0/433778864 conn(0x7fc1f40a2aa0 msgr2=0x7fc1f406e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:43.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.903+0000 7fc1fa591700 1 -- 172.21.15.26:0/433778864 shutdown_connections 2023-10-01T07:58:43.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.903+0000 7fc1fa591700 1 -- 172.21.15.26:0/433778864 wait complete. 2023-10-01T07:58:43.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.903+0000 7efcea09c700 1 -- 172.21.15.26:0/1437139278 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efce4134260 msgr2=0x7efce4071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:43.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.903+0000 7efcea09c700 1 --2- 172.21.15.26:0/1437139278 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efce4134260 0x7efce4071420 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7efcdc00cc40 tx=0x7efcdc00cf50 comp rx=0 tx=0).stop 2023-10-01T07:58:43.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.903+0000 7efcea09c700 1 -- 172.21.15.26:0/1437139278 shutdown_connections 2023-10-01T07:58:43.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.903+0000 7efcea09c700 1 --2- 172.21.15.26:0/1437139278 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efce4134260 0x7efce4071420 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:43.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.903+0000 7efcea09c700 1 --2- 172.21.15.26:0/1437139278 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efce4133420 0x7efce40709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:43.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.903+0000 7efcea09c700 1 --2- 172.21.15.26:0/1437139278 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efce4133e30 0x7efce4070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:43.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.903+0000 7efcea09c700 1 -- 172.21.15.26:0/1437139278 >> 172.21.15.26:0/1437139278 conn(0x7efce40a4210 msgr2=0x7efce40a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:43.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.903+0000 7efcea09c700 1 -- 172.21.15.26:0/1437139278 shutdown_connections 2023-10-01T07:58:43.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.903+0000 7efcea09c700 1 -- 172.21.15.26:0/1437139278 wait complete. 2023-10-01T07:58:43.919 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:43.920 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:43.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.976+0000 7fabf1857700 1 -- 172.21.15.26:0/15681403 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fabec0a28e0 con 0x7fabec134170 2023-10-01T07:58:43.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.976+0000 7fabd3fff700 1 -- 172.21.15.26:0/15681403 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fabe4032090 con 0x7fabec134170 2023-10-01T07:58:43.977 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:43.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.978+0000 7fabf1857700 1 -- 172.21.15.26:0/15681403 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabec134170 msgr2=0x7fabec11f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:43.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.978+0000 7fabf1857700 1 --2- 172.21.15.26:0/15681403 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabec134170 0x7fabec11f140 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fabec09dde0 tx=0x7fabe4004ad0 comp rx=0 tx=0).stop 2023-10-01T07:58:43.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.978+0000 7fabf1857700 1 -- 172.21.15.26:0/15681403 shutdown_connections 2023-10-01T07:58:43.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.978+0000 7fabf1857700 1 --2- 172.21.15.26:0/15681403 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabec134170 0x7fabec11f140 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:43.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.978+0000 7fabf1857700 1 --2- 172.21.15.26:0/15681403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabec0a0a30 0x7fabec11e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:43.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.978+0000 7fabf1857700 1 --2- 172.21.15.26:0/15681403 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabec0a1340 0x7fabec11ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:43.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.978+0000 7fabf1857700 1 -- 172.21.15.26:0/15681403 >> 172.21.15.26:0/15681403 conn(0x7fabec0a6550 msgr2=0x7fabec09ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:43.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.979+0000 7fabf1857700 1 -- 172.21.15.26:0/15681403 shutdown_connections 2023-10-01T07:58:43.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.979+0000 7fabf1857700 1 -- 172.21.15.26:0/15681403 wait complete. 2023-10-01T07:58:43.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.991+0000 7f2b4894b700 1 -- 172.21.15.26:0/4259334800 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2b44074ea0 con 0x7f2b4409e000 2023-10-01T07:58:43.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.991+0000 7f2b32ffd700 1 -- 172.21.15.26:0/4259334800 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2b38017030 con 0x7f2b4409e000 2023-10-01T07:58:43.994 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:43.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:43.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.994+0000 7f2b4894b700 1 -- 172.21.15.26:0/4259334800 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2b4409e000 msgr2=0x7f2b4411e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:43.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.994+0000 7f2b4894b700 1 --2- 172.21.15.26:0/4259334800 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2b4409e000 0x7f2b4411e8e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2b3800c4a0 tx=0x7f2b3800c7b0 comp rx=0 tx=0).stop 2023-10-01T07:58:43.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.994+0000 7f2b4894b700 1 -- 172.21.15.26:0/4259334800 shutdown_connections 2023-10-01T07:58:43.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.994+0000 7f2b4894b700 1 --2- 172.21.15.26:0/4259334800 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b4409e410 0x7f2b4411ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:43.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.994+0000 7f2b4894b700 1 --2- 172.21.15.26:0/4259334800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b4409d6f0 0x7f2b4411e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:43.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.994+0000 7f2b4894b700 1 --2- 172.21.15.26:0/4259334800 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2b4409e000 0x7f2b4411e8e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:43.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.994+0000 7f2b4894b700 1 -- 172.21.15.26:0/4259334800 >> 172.21.15.26:0/4259334800 conn(0x7f2b44066f50 msgr2=0x7f2b4406f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:43.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.994+0000 7f2b4894b700 1 -- 172.21.15.26:0/4259334800 shutdown_connections 2023-10-01T07:58:43.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:43.994+0000 7f2b4894b700 1 -- 172.21.15.26:0/4259334800 wait complete. 2023-10-01T07:58:44.008 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:44.920 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:44.920 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:44.995 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:45.009 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:45.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.075+0000 7fcdd779c700 1 Processor -- start 2023-10-01T07:58:45.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.075+0000 7fcdd779c700 1 -- start start 2023-10-01T07:58:45.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.076+0000 7fcdd779c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcdd0130540 0x7fcdd0130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:45.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.076+0000 7fcdd779c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcdd0130e50 0x7fcdd006f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:45.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.076+0000 7fcdd779c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd00716a0 con 0x7fcdd006fb20 2023-10-01T07:58:45.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.076+0000 7fcdd779c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd009a390 con 0x7fcdd0130e50 2023-10-01T07:58:45.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.076+0000 7fcdd779c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd0071290 con 0x7fcdd0130540 2023-10-01T07:58:45.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.076+0000 7fcdd4d37700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcdd0130e50 0x7fcdd006f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:45.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.076+0000 7fcdd5d39700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fcdd006fb20 0x7fcdd0137560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:55864/0 (socket says 172.21.15.26:55864) 2023-10-01T07:58:45.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.076+0000 7fcdd5d39700 1 -- 172.21.15.26:0/2126368053 learned_addr learned my addr 172.21.15.26:0/2126368053 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:45.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.076+0000 7fcdd5538700 1 --2- 172.21.15.26:0/2126368053 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcdd0130540 0x7fcdd0130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:45.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.077+0000 7fcdd4d37700 1 -- 172.21.15.26:0/2126368053 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcdd0130540 msgr2=0x7fcdd0130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:45.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.077+0000 7fcdd4d37700 1 --2- 172.21.15.26:0/2126368053 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcdd0130540 0x7fcdd0130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.077+0000 7fcdd4d37700 1 -- 172.21.15.26:0/2126368053 >> v1:172.21.15.26:6789/0 conn(0x7fcdd006fb20 legacy=0x7fcdd0137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:45.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.077+0000 7fcdd4d37700 1 -- 172.21.15.26:0/2126368053 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd0130340 con 0x7fcdd0130e50 2023-10-01T07:58:45.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.077+0000 7fcdd4d37700 1 --2- 172.21.15.26:0/2126368053 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcdd0130e50 0x7fcdd006f5e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fcdc00098a0 tx=0x7fcdc0009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8247dae86dffdba server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:45.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.077+0000 7fcdc7fff700 1 -- 172.21.15.26:0/2126368053 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc0011830 con 0x7fcdd0130e50 2023-10-01T07:58:45.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.077+0000 7fcdc7fff700 1 -- 172.21.15.26:0/2126368053 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc0011990 con 0x7fcdd0130e50 2023-10-01T07:58:45.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.077+0000 7fcdc7fff700 1 -- 172.21.15.26:0/2126368053 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc0011d20 con 0x7fcdd0130e50 2023-10-01T07:58:45.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.078+0000 7fcdd779c700 1 -- 172.21.15.26:0/2126368053 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcdd0130e50 msgr2=0x7fcdd006f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:45.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.078+0000 7fcdd779c700 1 --2- 172.21.15.26:0/2126368053 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcdd0130e50 0x7fcdd006f5e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fcdc00098a0 tx=0x7fcdc0009bb0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.078+0000 7fcdd779c700 1 -- 172.21.15.26:0/2126368053 shutdown_connections 2023-10-01T07:58:45.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.078+0000 7fcdd779c700 1 --2- 172.21.15.26:0/2126368053 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcdd0130540 0x7fcdd0130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.078+0000 7fcdd779c700 1 --2- 172.21.15.26:0/2126368053 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcdd0130e50 0x7fcdd006f5e0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.078+0000 7fcdd779c700 1 -- 172.21.15.26:0/2126368053 >> 172.21.15.26:0/2126368053 conn(0x7fcdd00a2aa0 msgr2=0x7fcdd00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:45.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.078+0000 7fcdd779c700 1 -- 172.21.15.26:0/2126368053 shutdown_connections 2023-10-01T07:58:45.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.078+0000 7fcdd779c700 1 -- 172.21.15.26:0/2126368053 wait complete. 2023-10-01T07:58:45.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.079+0000 7fcdd779c700 1 Processor -- start 2023-10-01T07:58:45.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.079+0000 7fcdd779c700 1 -- start start 2023-10-01T07:58:45.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.079+0000 7f6dd5596700 1 Processor -- start 2023-10-01T07:58:45.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.079+0000 7f6dd5596700 1 -- start start 2023-10-01T07:58:45.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.080+0000 7fcdd779c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcdd006fb20 0x7fcdd0118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:45.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.080+0000 7fcdd779c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcdd0130540 0x7fcdd0119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:45.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.080+0000 7fcdd779c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdd0130e50 0x7fcdd0119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:45.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.080+0000 7fcdd779c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd009e2a0 con 0x7fcdd0130e50 2023-10-01T07:58:45.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.080+0000 7fcdd779c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd00a0c40 con 0x7fcdd0130540 2023-10-01T07:58:45.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.080+0000 7fcdd779c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd00718e0 con 0x7fcdd006fb20 2023-10-01T07:58:45.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.080+0000 7fcdd5538700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcdd006fb20 0x7fcdd0118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:45.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.080+0000 7fcdd4d37700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcdd0130540 0x7fcdd0119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:45.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.080+0000 7fcdd5538700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcdd006fb20 0x7fcdd0118cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:52470/0 (socket says 172.21.15.26:52470) 2023-10-01T07:58:45.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.080+0000 7fcdd5538700 1 -- 172.21.15.26:0/2606649968 learned_addr learned my addr 172.21.15.26:0/2606649968 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:45.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.080+0000 7fcdd5d39700 1 --2- 172.21.15.26:0/2606649968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdd0130e50 0x7fcdd0119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:45.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.080+0000 7fcdd5538700 1 -- 172.21.15.26:0/2606649968 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcdd0130540 msgr2=0x7fcdd0119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:45.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.080+0000 7fcdd5538700 1 --2- 172.21.15.26:0/2606649968 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcdd0130540 0x7fcdd0119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.080+0000 7fcdd5538700 1 -- 172.21.15.26:0/2606649968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdd0130e50 msgr2=0x7fcdd0119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:45.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.080+0000 7fcdd5538700 1 --2- 172.21.15.26:0/2606649968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdd0130e50 0x7fcdd0119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.081+0000 7fcdd5538700 1 -- 172.21.15.26:0/2606649968 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc00094a0 con 0x7fcdd006fb20 2023-10-01T07:58:45.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.080+0000 7f6dd5596700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6dd009d6f0 0x7f6dd009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:45.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.080+0000 7f6dd5596700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6dd009e410 0x7f6dd0134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:45.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.080+0000 7f6dd5596700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd009b120 con 0x7f6dd009e000 2023-10-01T07:58:45.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.080+0000 7f6dd5596700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd006b460 con 0x7f6dd009e410 2023-10-01T07:58:45.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.080+0000 7f6dd5596700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd009a7e0 con 0x7f6dd009d6f0 2023-10-01T07:58:45.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.081+0000 7f6dcf7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6dd009e410 0x7f6dd0134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:45.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.081+0000 7f6dcf7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6dd009e410 0x7f6dd0134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50420/0 (socket says 172.21.15.26:50420) 2023-10-01T07:58:45.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.081+0000 7f6dcf7fe700 1 -- 172.21.15.26:0/1762387600 learned_addr learned my addr 172.21.15.26:0/1762387600 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:45.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.081+0000 7fcdd5538700 1 --2- 172.21.15.26:0/2606649968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcdd006fb20 0x7fcdd0118cd0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc010f40 tx=0x7fcdcc010f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:45.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.081+0000 7f6dceffd700 1 --2- 172.21.15.26:0/1762387600 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6dd009d6f0 0x7f6dd009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:45.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.081+0000 7f6dcf7fe700 1 -- 172.21.15.26:0/1762387600 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6dd009d6f0 msgr2=0x7f6dd009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:45.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.081+0000 7f6dcf7fe700 1 --2- 172.21.15.26:0/1762387600 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6dd009d6f0 0x7f6dd009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.081+0000 7f6dcf7fe700 1 -- 172.21.15.26:0/1762387600 >> v1:172.21.15.26:6789/0 conn(0x7f6dd009e000 legacy=0x7f6dd01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:45.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.081+0000 7f6dcf7fe700 1 -- 172.21.15.26:0/1762387600 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd009a500 con 0x7f6dd009e410 2023-10-01T07:58:45.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.081+0000 7f6dceffd700 1 --2- 172.21.15.26:0/1762387600 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6dd009d6f0 0x7f6dd009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:58:45.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.081+0000 7f6dcf7fe700 1 --2- 172.21.15.26:0/1762387600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6dd009e410 0x7f6dd0134100 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8014500 tx=0x7f6dc8014810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289c05c1940c5b63 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:45.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.081+0000 7fcdc5ffb700 1 -- 172.21.15.26:0/2606649968 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc012070 con 0x7fcdd006fb20 2023-10-01T07:58:45.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.081+0000 7fcdc5ffb700 1 -- 172.21.15.26:0/2606649968 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdcc00f840 con 0x7fcdd006fb20 2023-10-01T07:58:45.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.081+0000 7fcdd779c700 1 -- 172.21.15.26:0/2606649968 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdd011bab0 con 0x7fcdd006fb20 2023-10-01T07:58:45.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.082+0000 7f6dcdffb700 1 -- 172.21.15.26:0/1762387600 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8018710 con 0x7f6dd009e410 2023-10-01T07:58:45.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.082+0000 7f6dcdffb700 1 -- 172.21.15.26:0/1762387600 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc8018870 con 0x7f6dd009e410 2023-10-01T07:58:45.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.082+0000 7f6dcdffb700 1 -- 172.21.15.26:0/1762387600 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8018c00 con 0x7f6dd009e410 2023-10-01T07:58:45.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.082+0000 7fcdd779c700 1 -- 172.21.15.26:0/2606649968 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd011aed0 con 0x7fcdd006fb20 2023-10-01T07:58:45.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.082+0000 7fcdc5ffb700 1 -- 172.21.15.26:0/2606649968 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc00b070 con 0x7fcdd006fb20 2023-10-01T07:58:45.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.083+0000 7f6dd5596700 1 -- 172.21.15.26:0/1762387600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6dd009e410 msgr2=0x7f6dd0134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:45.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.083+0000 7f6dd5596700 1 --2- 172.21.15.26:0/1762387600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6dd009e410 0x7f6dd0134100 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8014500 tx=0x7f6dc8014810 comp rx=0 tx=0).stop 2023-10-01T07:58:45.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.083+0000 7f6dd5596700 1 -- 172.21.15.26:0/1762387600 shutdown_connections 2023-10-01T07:58:45.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.083+0000 7f6dd5596700 1 --2- 172.21.15.26:0/1762387600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6dd009e410 0x7f6dd0134100 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.083+0000 7f6dd5596700 1 --2- 172.21.15.26:0/1762387600 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6dd009d6f0 0x7f6dd009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.083+0000 7f6dd5596700 1 -- 172.21.15.26:0/1762387600 >> 172.21.15.26:0/1762387600 conn(0x7f6dd0066f50 msgr2=0x7f6dd009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:45.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.083+0000 7fcdc5ffb700 1 -- 172.21.15.26:0/2606649968 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcdcc00fbb0 con 0x7fcdd006fb20 2023-10-01T07:58:45.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.083+0000 7f6dd5596700 1 -- 172.21.15.26:0/1762387600 shutdown_connections 2023-10-01T07:58:45.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.083+0000 7fcdc5ffb700 1 -- 172.21.15.26:0/2606649968 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcdcc03f350 con 0x7fcdd006fb20 2023-10-01T07:58:45.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.083+0000 7fcdd779c700 1 -- 172.21.15.26:0/2606649968 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb00052e0 con 0x7fcdd006fb20 2023-10-01T07:58:45.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.083+0000 7f6dd5596700 1 -- 172.21.15.26:0/1762387600 wait complete. 2023-10-01T07:58:45.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.084+0000 7f6dd5596700 1 Processor -- start 2023-10-01T07:58:45.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.084+0000 7f6dd5596700 1 -- start start 2023-10-01T07:58:45.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.085+0000 7f6dd5596700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6dd009d6f0 0x7f6dd011ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:45.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.085+0000 7f6dd5596700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6dd009e000 0x7f6dd011b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:45.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.085+0000 7f6dd5596700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6dd009e410 0x7f6dd011b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:45.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.085+0000 7f6dd5596700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd011f0d0 con 0x7f6dd009e000 2023-10-01T07:58:45.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.085+0000 7f6dd5596700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd011e710 con 0x7f6dd009d6f0 2023-10-01T07:58:45.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.085+0000 7f6dd5596700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd011dae0 con 0x7f6dd009e410 2023-10-01T07:58:45.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.085+0000 7f6dce7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6dd009e000 0x7f6dd011b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:45.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.085+0000 7f6dce7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6dd009e000 0x7f6dd011b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50424/0 (socket says 172.21.15.26:50424) 2023-10-01T07:58:45.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.085+0000 7f6dce7fc700 1 -- 172.21.15.26:0/88678379 learned_addr learned my addr 172.21.15.26:0/88678379 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:45.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.086+0000 7f6dceffd700 1 --2- 172.21.15.26:0/88678379 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6dd009d6f0 0x7f6dd011ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:45.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.086+0000 7f6dce7fc700 1 -- 172.21.15.26:0/88678379 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6dd009e410 msgr2=0x7f6dd011b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:45.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.086+0000 7f6dce7fc700 1 --2- 172.21.15.26:0/88678379 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6dd009e410 0x7f6dd011b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.086+0000 7f6dce7fc700 1 -- 172.21.15.26:0/88678379 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6dd009d6f0 msgr2=0x7f6dd011ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:45.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.086+0000 7f6dce7fc700 1 --2- 172.21.15.26:0/88678379 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6dd009d6f0 0x7f6dd011ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.086+0000 7f6dce7fc700 1 -- 172.21.15.26:0/88678379 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc8014160 con 0x7f6dd009e000 2023-10-01T07:58:45.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.086+0000 7f6dceffd700 1 --2- 172.21.15.26:0/88678379 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6dd009d6f0 0x7f6dd011ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:58:45.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.086+0000 7f6dce7fc700 1 --2- 172.21.15.26:0/88678379 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6dd009e000 0x7f6dd011b1c0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400c4e0 tx=0x7f6dc400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:45.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.086+0000 7f6db77fe700 1 -- 172.21.15.26:0/88678379 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc40052d0 con 0x7f6dd009e000 2023-10-01T07:58:45.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.086+0000 7f6db77fe700 1 -- 172.21.15.26:0/88678379 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc4005430 con 0x7f6dd009e000 2023-10-01T07:58:45.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.087+0000 7f6dd5596700 1 -- 172.21.15.26:0/88678379 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd009c710 con 0x7f6dd009e000 2023-10-01T07:58:45.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.087+0000 7f6db77fe700 1 -- 172.21.15.26:0/88678379 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc40038c0 con 0x7f6dd009e000 2023-10-01T07:58:45.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.087+0000 7f6dd5596700 1 -- 172.21.15.26:0/88678379 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd011c800 con 0x7f6dd009e000 2023-10-01T07:58:45.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.088+0000 7f6db77fe700 1 -- 172.21.15.26:0/88678379 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6dc4003a20 con 0x7f6dd009e000 2023-10-01T07:58:45.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.088+0000 7f6dd5596700 1 -- 172.21.15.26:0/88678379 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd0131fa0 con 0x7f6dd009e000 2023-10-01T07:58:45.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.088+0000 7f6db77fe700 1 -- 172.21.15.26:0/88678379 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6dc403ec50 con 0x7f6dd009e000 2023-10-01T07:58:45.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.089+0000 7fcdc5ffb700 1 -- 172.21.15.26:0/2606649968 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcdcc00fe60 con 0x7fcdd006fb20 2023-10-01T07:58:45.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.094+0000 7f6db77fe700 1 -- 172.21.15.26:0/88678379 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6dc4017020 con 0x7f6dd009e000 2023-10-01T07:58:45.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.176+0000 7f7ab6b61700 1 Processor -- start 2023-10-01T07:58:45.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.177+0000 7f7ab6b61700 1 -- start start 2023-10-01T07:58:45.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.177+0000 7f7ab6b61700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7ab006c0e0 0x7f7ab009ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:45.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.177+0000 7f7ab6b61700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7ab0134ec0 0x7f7ab01379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:45.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.177+0000 7f7ab6b61700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7ab0137f20 0x7f7ab01383c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:45.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.177+0000 7f7ab6b61700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ab006c4b0 con 0x7f7ab0134ec0 2023-10-01T07:58:45.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.177+0000 7f7ab6b61700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab00a09c0 con 0x7f7ab0137f20 2023-10-01T07:58:45.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.177+0000 7f7ab6b61700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab0134980 con 0x7f7ab006c0e0 2023-10-01T07:58:45.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.177+0000 7f7ab48fd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7ab006c0e0 0x7f7ab009ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:45.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.177+0000 7f7ab50fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7ab0137f20 0x7f7ab01383c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:45.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.177+0000 7f7ab48fd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7ab006c0e0 0x7f7ab009ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:52484/0 (socket says 172.21.15.26:52484) 2023-10-01T07:58:45.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.177+0000 7f7ab50fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7ab0137f20 0x7f7ab01383c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58764/0 (socket says 172.21.15.26:58764) 2023-10-01T07:58:45.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.177+0000 7f7ab48fd700 1 -- 172.21.15.26:0/1624679426 learned_addr learned my addr 172.21.15.26:0/1624679426 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:45.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.178+0000 7f7aaffff700 1 --2- 172.21.15.26:0/1624679426 >> v2:172.21.15.26:3300/0 conn(0x7f7ab0134ec0 0x7f7ab01379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:45.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.178+0000 7f7ab48fd700 1 -- 172.21.15.26:0/1624679426 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7ab0137f20 msgr2=0x7f7ab01383c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:45.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.178+0000 7f7ab48fd700 1 --2- 172.21.15.26:0/1624679426 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7ab0137f20 0x7f7ab01383c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.178+0000 7f7ab48fd700 1 -- 172.21.15.26:0/1624679426 >> v2:172.21.15.26:3300/0 conn(0x7f7ab0134ec0 msgr2=0x7f7ab01379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:45.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.178+0000 7f7ab48fd700 1 --2- 172.21.15.26:0/1624679426 >> v2:172.21.15.26:3300/0 conn(0x7f7ab0134ec0 0x7f7ab01379e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.178+0000 7f7ab48fd700 1 -- 172.21.15.26:0/1624679426 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab00a0600 con 0x7f7ab006c0e0 2023-10-01T07:58:45.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.178+0000 7f7ab50fe700 1 --2- 172.21.15.26:0/1624679426 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7ab0137f20 0x7f7ab01383c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:45.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.178+0000 7f7ab48fd700 1 --2- 172.21.15.26:0/1624679426 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7ab006c0e0 0x7f7ab009ac90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40098f0 tx=0x7f7aa4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12ce92512496135b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:45.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.178+0000 7f7aaf7fe700 1 -- 172.21.15.26:0/1624679426 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4011830 con 0x7f7ab006c0e0 2023-10-01T07:58:45.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.178+0000 7f7aaf7fe700 1 -- 172.21.15.26:0/1624679426 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa4011990 con 0x7f7ab006c0e0 2023-10-01T07:58:45.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.178+0000 7f7aaf7fe700 1 -- 172.21.15.26:0/1624679426 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4011d20 con 0x7f7ab006c0e0 2023-10-01T07:58:45.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.179+0000 7f7ab6b61700 1 -- 172.21.15.26:0/1624679426 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7ab006c0e0 msgr2=0x7f7ab009ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:45.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.179+0000 7f7ab6b61700 1 --2- 172.21.15.26:0/1624679426 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7ab006c0e0 0x7f7ab009ac90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40098f0 tx=0x7f7aa4009c00 comp rx=0 tx=0).stop 2023-10-01T07:58:45.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.179+0000 7f7ab6b61700 1 -- 172.21.15.26:0/1624679426 shutdown_connections 2023-10-01T07:58:45.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.179+0000 7f7ab6b61700 1 --2- 172.21.15.26:0/1624679426 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7ab0137f20 0x7f7ab01383c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.179+0000 7f7ab6b61700 1 --2- 172.21.15.26:0/1624679426 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7ab006c0e0 0x7f7ab009ac90 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.179+0000 7f7ab6b61700 1 --2- 172.21.15.26:0/1624679426 >> v2:172.21.15.26:3300/0 conn(0x7f7ab0134ec0 0x7f7ab01379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.179+0000 7f7ab6b61700 1 -- 172.21.15.26:0/1624679426 >> 172.21.15.26:0/1624679426 conn(0x7f7ab00a4210 msgr2=0x7f7ab00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:45.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.179+0000 7f7ab6b61700 1 -- 172.21.15.26:0/1624679426 shutdown_connections 2023-10-01T07:58:45.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.179+0000 7f7ab6b61700 1 -- 172.21.15.26:0/1624679426 wait complete. 2023-10-01T07:58:45.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.180+0000 7f7ab6b61700 1 Processor -- start 2023-10-01T07:58:45.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.180+0000 7f7ab6b61700 1 -- start start 2023-10-01T07:58:45.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.181+0000 7f7ab6b61700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ab006c0e0 0x7f7ab0134090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:45.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.181+0000 7f7ab6b61700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7ab0134ec0 0x7f7ab011a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:45.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.181+0000 7f7ab6b61700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7ab0137f20 0x7f7ab011ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:45.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.181+0000 7f7ab6b61700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab011cdc0 con 0x7f7ab006c0e0 2023-10-01T07:58:45.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.181+0000 7f7ab6b61700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab011c4a0 con 0x7f7ab0137f20 2023-10-01T07:58:45.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.181+0000 7f7ab6b61700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab011dc90 con 0x7f7ab0134ec0 2023-10-01T07:58:45.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.181+0000 7f7ab48fd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ab006c0e0 0x7f7ab0134090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:45.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.181+0000 7f7ab48fd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ab006c0e0 0x7f7ab0134090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50442/0 (socket says 172.21.15.26:50442) 2023-10-01T07:58:45.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.181+0000 7f7ab48fd700 1 -- 172.21.15.26:0/3511481521 learned_addr learned my addr 172.21.15.26:0/3511481521 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:45.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.181+0000 7f7ab50fe700 1 --2- 172.21.15.26:0/3511481521 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7ab0137f20 0x7f7ab011ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:45.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.181+0000 7f7aaffff700 1 --2- 172.21.15.26:0/3511481521 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7ab0134ec0 0x7f7ab011a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:45.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.181+0000 7f7ab48fd700 1 -- 172.21.15.26:0/3511481521 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7ab0134ec0 msgr2=0x7f7ab011a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:45.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.181+0000 7f7ab48fd700 1 --2- 172.21.15.26:0/3511481521 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7ab0134ec0 0x7f7ab011a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.181+0000 7f7ab48fd700 1 -- 172.21.15.26:0/3511481521 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7ab0137f20 msgr2=0x7f7ab011ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:45.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.181+0000 7f7ab48fd700 1 --2- 172.21.15.26:0/3511481521 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7ab0137f20 0x7f7ab011ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.181+0000 7f7ab48fd700 1 -- 172.21.15.26:0/3511481521 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa8009a70 con 0x7f7ab006c0e0 2023-10-01T07:58:45.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.182+0000 7f7ab48fd700 1 --2- 172.21.15.26:0/3511481521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ab006c0e0 0x7f7ab0134090 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4014040 tx=0x7f7aa4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:45.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.182+0000 7f7aad7fa700 1 -- 172.21.15.26:0/3511481521 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4004450 con 0x7f7ab006c0e0 2023-10-01T07:58:45.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.182+0000 7f7aad7fa700 1 -- 172.21.15.26:0/3511481521 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa401e070 con 0x7f7ab006c0e0 2023-10-01T07:58:45.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.182+0000 7f7aad7fa700 1 -- 172.21.15.26:0/3511481521 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa40038e0 con 0x7f7ab006c0e0 2023-10-01T07:58:45.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.182+0000 7f7ab6b61700 1 -- 172.21.15.26:0/3511481521 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa4009550 con 0x7f7ab006c0e0 2023-10-01T07:58:45.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.182+0000 7f7ab6b61700 1 -- 172.21.15.26:0/3511481521 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab00a03f0 con 0x7f7ab006c0e0 2023-10-01T07:58:45.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.183+0000 7f7aad7fa700 1 -- 172.21.15.26:0/3511481521 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7aa4003a40 con 0x7f7ab006c0e0 2023-10-01T07:58:45.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.183+0000 7f7ab6b61700 1 -- 172.21.15.26:0/3511481521 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab00a46e0 con 0x7f7ab006c0e0 2023-10-01T07:58:45.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.185+0000 7f7aad7fa700 1 -- 172.21.15.26:0/3511481521 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7aa4019c40 con 0x7f7ab006c0e0 2023-10-01T07:58:45.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.191+0000 7f7aad7fa700 1 -- 172.21.15.26:0/3511481521 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7aa401a420 con 0x7f7ab006c0e0 2023-10-01T07:58:45.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.193+0000 7faa46637700 1 Processor -- start 2023-10-01T07:58:45.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.193+0000 7faa46637700 1 -- start start 2023-10-01T07:58:45.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.193+0000 7faa46637700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa400a0a30 0x7faa400a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:45.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.193+0000 7faa46637700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa400a1340 0x7faa40133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:45.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.193+0000 7faa46637700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7faa40133fa0 0x7faa40134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:45.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.193+0000 7faa46637700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa4009edd0 con 0x7faa40133fa0 2023-10-01T07:58:45.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.193+0000 7faa46637700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4009e1f0 con 0x7faa400a0a30 2023-10-01T07:58:45.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.193+0000 7faa46637700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa4009dc50 con 0x7faa400a1340 2023-10-01T07:58:45.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.193+0000 7faa3ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa400a0a30 0x7faa400a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:45.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.193+0000 7faa3f7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa400a1340 0x7faa40133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:45.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.194+0000 7faa3f7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa400a1340 0x7faa40133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:52502/0 (socket says 172.21.15.26:52502) 2023-10-01T07:58:45.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.194+0000 7faa3ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa400a0a30 0x7faa400a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58780/0 (socket says 172.21.15.26:58780) 2023-10-01T07:58:45.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.194+0000 7faa3f7fe700 1 -- 172.21.15.26:0/2243875540 learned_addr learned my addr 172.21.15.26:0/2243875540 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:45.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.194+0000 7faa3ffff700 1 -- 172.21.15.26:0/2243875540 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa400a1340 msgr2=0x7faa40133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:45.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.194+0000 7faa3ffff700 1 --2- 172.21.15.26:0/2243875540 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa400a1340 0x7faa40133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.194+0000 7faa3ffff700 1 -- 172.21.15.26:0/2243875540 >> v2:172.21.15.26:3300/0 conn(0x7faa40133fa0 msgr2=0x7faa40134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:45.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.194+0000 7faa3ffff700 1 --2- 172.21.15.26:0/2243875540 >> v2:172.21.15.26:3300/0 conn(0x7faa40133fa0 0x7faa40134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.194+0000 7faa3ffff700 1 -- 172.21.15.26:0/2243875540 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa400a1fe0 con 0x7faa400a0a30 2023-10-01T07:58:45.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.194+0000 7faa3f7fe700 1 --2- 172.21.15.26:0/2243875540 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa400a1340 0x7faa40133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:45.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.194+0000 7faa3ffff700 1 --2- 172.21.15.26:0/2243875540 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa400a0a30 0x7faa400a0e00 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7faa30009840 tx=0x7faa30009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9642b2eb911087a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:45.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.194+0000 7faa3effd700 1 -- 172.21.15.26:0/2243875540 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa30011830 con 0x7faa400a0a30 2023-10-01T07:58:45.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.195+0000 7faa3effd700 1 -- 172.21.15.26:0/2243875540 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa30011990 con 0x7faa400a0a30 2023-10-01T07:58:45.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.195+0000 7faa3effd700 1 -- 172.21.15.26:0/2243875540 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa30011d20 con 0x7faa400a0a30 2023-10-01T07:58:45.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.196+0000 7faa46637700 1 -- 172.21.15.26:0/2243875540 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa400a0a30 msgr2=0x7faa400a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:45.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.196+0000 7faa46637700 1 --2- 172.21.15.26:0/2243875540 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa400a0a30 0x7faa400a0e00 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7faa30009840 tx=0x7faa30009b50 comp rx=0 tx=0).stop 2023-10-01T07:58:45.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.196+0000 7faa46637700 1 -- 172.21.15.26:0/2243875540 shutdown_connections 2023-10-01T07:58:45.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.196+0000 7faa46637700 1 --2- 172.21.15.26:0/2243875540 >> v2:172.21.15.26:3300/0 conn(0x7faa40133fa0 0x7faa40134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.196+0000 7faa46637700 1 --2- 172.21.15.26:0/2243875540 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa400a0a30 0x7faa400a0e00 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.196+0000 7faa46637700 1 --2- 172.21.15.26:0/2243875540 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa400a1340 0x7faa40133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.196+0000 7faa46637700 1 -- 172.21.15.26:0/2243875540 >> 172.21.15.26:0/2243875540 conn(0x7faa400a6550 msgr2=0x7faa400a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:45.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.196+0000 7faa46637700 1 -- 172.21.15.26:0/2243875540 shutdown_connections 2023-10-01T07:58:45.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.196+0000 7faa46637700 1 -- 172.21.15.26:0/2243875540 wait complete. 2023-10-01T07:58:45.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.197+0000 7faa46637700 1 Processor -- start 2023-10-01T07:58:45.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.198+0000 7faa46637700 1 -- start start 2023-10-01T07:58:45.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.198+0000 7faa46637700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa400a0a30 0x7faa401213f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:45.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.198+0000 7faa46637700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa400a1340 0x7faa40121930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:45.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.198+0000 7faa46637700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa40133fa0 0x7faa40121e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:45.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.198+0000 7faa46637700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa40124fb0 con 0x7faa400a1340 2023-10-01T07:58:45.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.198+0000 7faa46637700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa400a3630 con 0x7faa40133fa0 2023-10-01T07:58:45.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.198+0000 7faa46637700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa400a0220 con 0x7faa400a0a30 2023-10-01T07:58:45.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.199+0000 7faa3ffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa400a0a30 0x7faa401213f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:45.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.199+0000 7faa3ffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa400a0a30 0x7faa401213f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:52510/0 (socket says 172.21.15.26:52510) 2023-10-01T07:58:45.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.199+0000 7faa3ffff700 1 -- 172.21.15.26:0/1464798171 learned_addr learned my addr 172.21.15.26:0/1464798171 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:45.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.199+0000 7faa44bd4700 1 --2- 172.21.15.26:0/1464798171 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa40133fa0 0x7faa40121e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:45.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.199+0000 7faa3f7fe700 1 --2- 172.21.15.26:0/1464798171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa400a1340 0x7faa40121930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:45.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.199+0000 7faa3f7fe700 1 -- 172.21.15.26:0/1464798171 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa400a0a30 msgr2=0x7faa401213f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:45.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.199+0000 7faa3f7fe700 1 --2- 172.21.15.26:0/1464798171 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa400a0a30 0x7faa401213f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.199+0000 7faa3f7fe700 1 -- 172.21.15.26:0/1464798171 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa40133fa0 msgr2=0x7faa40121e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:45.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.199+0000 7faa3f7fe700 1 --2- 172.21.15.26:0/1464798171 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa40133fa0 0x7faa40121e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.199+0000 7faa3f7fe700 1 -- 172.21.15.26:0/1464798171 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa34009550 con 0x7faa400a1340 2023-10-01T07:58:45.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.199+0000 7faa44bd4700 1 --2- 172.21.15.26:0/1464798171 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa40133fa0 0x7faa40121e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:45.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.199+0000 7faa3f7fe700 1 --2- 172.21.15.26:0/1464798171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa400a1340 0x7faa40121930 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7faa3400e9a0 tx=0x7faa3400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:45.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.200+0000 7faa3cff9700 1 -- 172.21.15.26:0/1464798171 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa34004030 con 0x7faa400a1340 2023-10-01T07:58:45.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.200+0000 7faa3cff9700 1 -- 172.21.15.26:0/1464798171 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa34004190 con 0x7faa400a1340 2023-10-01T07:58:45.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.200+0000 7faa46637700 1 -- 172.21.15.26:0/1464798171 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa300094a0 con 0x7faa400a1340 2023-10-01T07:58:45.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.200+0000 7faa3cff9700 1 -- 172.21.15.26:0/1464798171 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa34004520 con 0x7faa400a1340 2023-10-01T07:58:45.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.201+0000 7faa3cff9700 1 -- 172.21.15.26:0/1464798171 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faa3400c850 con 0x7faa400a1340 2023-10-01T07:58:45.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.201+0000 7faa46637700 1 -- 172.21.15.26:0/1464798171 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa401246a0 con 0x7faa400a1340 2023-10-01T07:58:45.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.201+0000 7faa3cff9700 1 -- 172.21.15.26:0/1464798171 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faa34019c90 con 0x7faa400a1340 2023-10-01T07:58:45.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.202+0000 7faa46637700 1 -- 172.21.15.26:0/1464798171 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa40074ea0 con 0x7faa400a1340 2023-10-01T07:58:45.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.207+0000 7faa3cff9700 1 -- 172.21.15.26:0/1464798171 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faa340036a0 con 0x7faa400a1340 2023-10-01T07:58:45.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.308+0000 7f6dd5596700 1 -- 172.21.15.26:0/88678379 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6dd0074ea0 con 0x7f6dd009e000 2023-10-01T07:58:45.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.309+0000 7f6db77fe700 1 -- 172.21.15.26:0/88678379 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6dc400e280 con 0x7f6dd009e000 2023-10-01T07:58:45.309 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:45.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.311+0000 7f6dd5596700 1 -- 172.21.15.26:0/88678379 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6dd009e000 msgr2=0x7f6dd011b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:45.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.311+0000 7f6dd5596700 1 --2- 172.21.15.26:0/88678379 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6dd009e000 0x7f6dd011b1c0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400c4e0 tx=0x7f6dc400c8a0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.311+0000 7f6dd5596700 1 -- 172.21.15.26:0/88678379 shutdown_connections 2023-10-01T07:58:45.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.311+0000 7f6dd5596700 1 --2- 172.21.15.26:0/88678379 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6dd009e410 0x7f6dd011b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.311+0000 7f6dd5596700 1 --2- 172.21.15.26:0/88678379 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6dd009d6f0 0x7f6dd011ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.311+0000 7f6dd5596700 1 --2- 172.21.15.26:0/88678379 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6dd009e000 0x7f6dd011b1c0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.311+0000 7f6dd5596700 1 -- 172.21.15.26:0/88678379 >> 172.21.15.26:0/88678379 conn(0x7f6dd0066f50 msgr2=0x7f6dd0133b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:45.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.311+0000 7f6dd5596700 1 -- 172.21.15.26:0/88678379 shutdown_connections 2023-10-01T07:58:45.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.311+0000 7f6dd5596700 1 -- 172.21.15.26:0/88678379 wait complete. 2023-10-01T07:58:45.326 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:45.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.342+0000 7fcdd779c700 1 -- 172.21.15.26:0/2606649968 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcdb0005590 con 0x7fcdd006fb20 2023-10-01T07:58:45.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.343+0000 7fcdc5ffb700 1 -- 172.21.15.26:0/2606649968 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcdcc015370 con 0x7fcdd006fb20 2023-10-01T07:58:45.343 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:45.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.345+0000 7fcdd779c700 1 -- 172.21.15.26:0/2606649968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcdd006fb20 msgr2=0x7fcdd0118cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:45.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.345+0000 7fcdd779c700 1 --2- 172.21.15.26:0/2606649968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcdd006fb20 0x7fcdd0118cd0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc010f40 tx=0x7fcdcc010f70 comp rx=0 tx=0).stop 2023-10-01T07:58:45.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.345+0000 7fcdd779c700 1 -- 172.21.15.26:0/2606649968 shutdown_connections 2023-10-01T07:58:45.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.345+0000 7fcdd779c700 1 --2- 172.21.15.26:0/2606649968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdd0130e50 0x7fcdd0119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.345+0000 7fcdd779c700 1 --2- 172.21.15.26:0/2606649968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcdd006fb20 0x7fcdd0118cd0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.345+0000 7fcdd779c700 1 --2- 172.21.15.26:0/2606649968 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcdd0130540 0x7fcdd0119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.345+0000 7fcdd779c700 1 -- 172.21.15.26:0/2606649968 >> 172.21.15.26:0/2606649968 conn(0x7fcdd00a2aa0 msgr2=0x7fcdd012d470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:45.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.346+0000 7fcdd779c700 1 -- 172.21.15.26:0/2606649968 shutdown_connections 2023-10-01T07:58:45.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.346+0000 7fcdd779c700 1 -- 172.21.15.26:0/2606649968 wait complete. 2023-10-01T07:58:45.360 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:45.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.438+0000 7f7ab6b61700 1 -- 172.21.15.26:0/3511481521 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7ab01345d0 con 0x7f7ab006c0e0 2023-10-01T07:58:45.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.438+0000 7f7aad7fa700 1 -- 172.21.15.26:0/3511481521 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7aa4015030 con 0x7f7ab006c0e0 2023-10-01T07:58:45.439 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:45.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.441+0000 7f7ab6b61700 1 -- 172.21.15.26:0/3511481521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ab006c0e0 msgr2=0x7f7ab0134090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:45.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.441+0000 7f7ab6b61700 1 --2- 172.21.15.26:0/3511481521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ab006c0e0 0x7f7ab0134090 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4014040 tx=0x7f7aa4004750 comp rx=0 tx=0).stop 2023-10-01T07:58:45.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.441+0000 7f7ab6b61700 1 -- 172.21.15.26:0/3511481521 shutdown_connections 2023-10-01T07:58:45.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.441+0000 7f7ab6b61700 1 --2- 172.21.15.26:0/3511481521 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7ab0137f20 0x7f7ab011ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.441+0000 7f7ab6b61700 1 --2- 172.21.15.26:0/3511481521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ab006c0e0 0x7f7ab0134090 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.441+0000 7f7ab6b61700 1 --2- 172.21.15.26:0/3511481521 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7ab0134ec0 0x7f7ab011a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.441+0000 7f7ab6b61700 1 -- 172.21.15.26:0/3511481521 >> 172.21.15.26:0/3511481521 conn(0x7f7ab00a4210 msgr2=0x7f7ab0099c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:45.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.441+0000 7f7ab6b61700 1 -- 172.21.15.26:0/3511481521 shutdown_connections 2023-10-01T07:58:45.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.441+0000 7f7ab6b61700 1 -- 172.21.15.26:0/3511481521 wait complete. 2023-10-01T07:58:45.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.452+0000 7faa46637700 1 -- 172.21.15.26:0/1464798171 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faa400a28e0 con 0x7faa400a1340 2023-10-01T07:58:45.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.452+0000 7faa3cff9700 1 -- 172.21.15.26:0/1464798171 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faa34013e60 con 0x7faa400a1340 2023-10-01T07:58:45.453 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:45.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.454+0000 7faa46637700 1 -- 172.21.15.26:0/1464798171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa400a1340 msgr2=0x7faa40121930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:45.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.454+0000 7faa46637700 1 --2- 172.21.15.26:0/1464798171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa400a1340 0x7faa40121930 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7faa3400e9a0 tx=0x7faa3400ecb0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.454+0000 7faa46637700 1 -- 172.21.15.26:0/1464798171 shutdown_connections 2023-10-01T07:58:45.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.454+0000 7faa46637700 1 --2- 172.21.15.26:0/1464798171 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa40133fa0 0x7faa40121e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.454+0000 7faa46637700 1 --2- 172.21.15.26:0/1464798171 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa400a0a30 0x7faa401213f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.454+0000 7faa46637700 1 --2- 172.21.15.26:0/1464798171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa400a1340 0x7faa40121930 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:45.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.454+0000 7faa46637700 1 -- 172.21.15.26:0/1464798171 >> 172.21.15.26:0/1464798171 conn(0x7faa400a6550 msgr2=0x7faa400a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:45.456 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:45.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.454+0000 7faa46637700 1 -- 172.21.15.26:0/1464798171 shutdown_connections 2023-10-01T07:58:45.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:45.454+0000 7faa46637700 1 -- 172.21.15.26:0/1464798171 wait complete. 2023-10-01T07:58:45.468 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:46.327 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:46.360 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:46.457 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:46.469 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:46.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.474+0000 7feb8ce88700 1 Processor -- start 2023-10-01T07:58:46.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.474+0000 7feb8ce88700 1 -- start start 2023-10-01T07:58:46.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.475+0000 7feb8ce88700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feb8809d6f0 0x7feb8809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:46.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.475+0000 7feb8ce88700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb8809e000 0x7feb881339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:46.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.475+0000 7feb8ce88700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb8809e410 0x7feb88133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:46.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.475+0000 7feb8ce88700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb8806b460 con 0x7feb8809d6f0 2023-10-01T07:58:46.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.475+0000 7feb8ce88700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8809b120 con 0x7feb8809e000 2023-10-01T07:58:46.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.475+0000 7feb8ce88700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb8809a7e0 con 0x7feb8809e410 2023-10-01T07:58:46.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.475+0000 7feb8659c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feb8809d6f0 0x7feb8809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:46.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.475+0000 7feb86d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb8809e410 0x7feb88133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:46.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.475+0000 7feb8659c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feb8809d6f0 0x7feb8809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50470/0 (socket says 172.21.15.26:50470) 2023-10-01T07:58:46.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.475+0000 7feb8659c700 1 -- 172.21.15.26:0/3020895061 learned_addr learned my addr 172.21.15.26:0/3020895061 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:46.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.476+0000 7feb85d9b700 1 --2- 172.21.15.26:0/3020895061 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb8809e000 0x7feb881339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:46.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.476+0000 7feb8659c700 1 -- 172.21.15.26:0/3020895061 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb8809e410 msgr2=0x7feb88133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:46.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.476+0000 7feb8659c700 1 --2- 172.21.15.26:0/3020895061 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb8809e410 0x7feb88133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.476+0000 7feb8659c700 1 -- 172.21.15.26:0/3020895061 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb8809e000 msgr2=0x7feb881339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:46.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.476+0000 7feb8659c700 1 --2- 172.21.15.26:0/3020895061 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb8809e000 0x7feb881339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.476+0000 7feb8659c700 1 -- 172.21.15.26:0/3020895061 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8809a500 con 0x7feb8809d6f0 2023-10-01T07:58:46.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.476+0000 7feb8659c700 1 --2- 172.21.15.26:0/3020895061 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8809d6f0 0x7feb8809dac0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7feb780098f0 tx=0x7feb78009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67f9d21fe4bed026 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:46.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.476+0000 7feb8559a700 1 -- 172.21.15.26:0/3020895061 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb78011830 con 0x7feb8809d6f0 2023-10-01T07:58:46.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.476+0000 7feb8559a700 1 -- 172.21.15.26:0/3020895061 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb78011990 con 0x7feb8809d6f0 2023-10-01T07:58:46.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.476+0000 7feb8559a700 1 -- 172.21.15.26:0/3020895061 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb78011d20 con 0x7feb8809d6f0 2023-10-01T07:58:46.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.478+0000 7feb8ce88700 1 -- 172.21.15.26:0/3020895061 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8809d6f0 msgr2=0x7feb8809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:46.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.478+0000 7feb8ce88700 1 --2- 172.21.15.26:0/3020895061 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8809d6f0 0x7feb8809dac0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7feb780098f0 tx=0x7feb78009c00 comp rx=0 tx=0).stop 2023-10-01T07:58:46.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.478+0000 7feb8ce88700 1 -- 172.21.15.26:0/3020895061 shutdown_connections 2023-10-01T07:58:46.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.478+0000 7feb8ce88700 1 --2- 172.21.15.26:0/3020895061 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb8809e410 0x7feb88133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.478+0000 7feb8ce88700 1 --2- 172.21.15.26:0/3020895061 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8809d6f0 0x7feb8809dac0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.478+0000 7feb8ce88700 1 --2- 172.21.15.26:0/3020895061 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb8809e000 0x7feb881339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.478+0000 7feb8ce88700 1 -- 172.21.15.26:0/3020895061 >> 172.21.15.26:0/3020895061 conn(0x7feb88066f50 msgr2=0x7feb8809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:46.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.478+0000 7feb8ce88700 1 -- 172.21.15.26:0/3020895061 shutdown_connections 2023-10-01T07:58:46.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.478+0000 7feb8ce88700 1 -- 172.21.15.26:0/3020895061 wait complete. 2023-10-01T07:58:46.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.479+0000 7feb8ce88700 1 Processor -- start 2023-10-01T07:58:46.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.479+0000 7feb8ce88700 1 -- start start 2023-10-01T07:58:46.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.480+0000 7feb8ce88700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb8809d6f0 0x7feb881a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:46.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.480+0000 7feb8ce88700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8809e000 0x7feb881a6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:46.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.480+0000 7feb8ce88700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb8809e410 0x7feb881a68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:46.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.480+0000 7feb8ce88700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb881a7270 con 0x7feb8809e000 2023-10-01T07:58:46.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.480+0000 7feb8ce88700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb881a79a0 con 0x7feb8809d6f0 2023-10-01T07:58:46.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.480+0000 7feb8ce88700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb881a9880 con 0x7feb8809e410 2023-10-01T07:58:46.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.480+0000 7feb8659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb8809d6f0 0x7feb881a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:46.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.480+0000 7feb8659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb8809d6f0 0x7feb881a5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58800/0 (socket says 172.21.15.26:58800) 2023-10-01T07:58:46.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.480+0000 7feb8659c700 1 -- 172.21.15.26:0/3473498088 learned_addr learned my addr 172.21.15.26:0/3473498088 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:46.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.480+0000 7feb86d9d700 1 --2- 172.21.15.26:0/3473498088 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb8809e410 0x7feb881a68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:46.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.480+0000 7feb85d9b700 1 --2- 172.21.15.26:0/3473498088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8809e000 0x7feb881a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:46.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.481+0000 7feb85d9b700 1 -- 172.21.15.26:0/3473498088 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb8809e410 msgr2=0x7feb881a68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:46.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.481+0000 7feb85d9b700 1 --2- 172.21.15.26:0/3473498088 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb8809e410 0x7feb881a68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.481+0000 7feb85d9b700 1 -- 172.21.15.26:0/3473498088 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb8809d6f0 msgr2=0x7feb881a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:46.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.481+0000 7feb85d9b700 1 --2- 172.21.15.26:0/3473498088 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb8809d6f0 0x7feb881a5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.481+0000 7feb85d9b700 1 -- 172.21.15.26:0/3473498088 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb78009550 con 0x7feb8809e000 2023-10-01T07:58:46.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.481+0000 7feb86d9d700 1 --2- 172.21.15.26:0/3473498088 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb8809e410 0x7feb881a68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:46.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.481+0000 7feb85d9b700 1 --2- 172.21.15.26:0/3473498088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8809e000 0x7feb881a6370 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7feb7c00e900 tx=0x7feb7c00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:46.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.481+0000 7feb76ffd700 1 -- 172.21.15.26:0/3473498088 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c013680 con 0x7feb8809e000 2023-10-01T07:58:46.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.481+0000 7feb76ffd700 1 -- 172.21.15.26:0/3473498088 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7c0137e0 con 0x7feb8809e000 2023-10-01T07:58:46.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.481+0000 7feb8ce88700 1 -- 172.21.15.26:0/3473498088 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb8809c710 con 0x7feb8809e000 2023-10-01T07:58:46.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.481+0000 7feb76ffd700 1 -- 172.21.15.26:0/3473498088 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c013b50 con 0x7feb8809e000 2023-10-01T07:58:46.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.481+0000 7feb8ce88700 1 -- 172.21.15.26:0/3473498088 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb881a8700 con 0x7feb8809e000 2023-10-01T07:58:46.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.481+0000 7feb8659c700 1 --2- 172.21.15.26:0/3473498088 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb8809d6f0 0x7feb881a5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:46.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.482+0000 7feb76ffd700 1 -- 172.21.15.26:0/3473498088 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feb7c013cb0 con 0x7feb8809e000 2023-10-01T07:58:46.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.482+0000 7feb76ffd700 1 -- 172.21.15.26:0/3473498088 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7feb7c03f680 con 0x7feb8809e000 2023-10-01T07:58:46.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.483+0000 7feb8ce88700 1 -- 172.21.15.26:0/3473498088 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb88074ea0 con 0x7feb8809e000 2023-10-01T07:58:46.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.489+0000 7feb76ffd700 1 -- 172.21.15.26:0/3473498088 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feb7c01bde0 con 0x7feb8809e000 2023-10-01T07:58:46.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.524+0000 7fd6e43e0700 1 Processor -- start 2023-10-01T07:58:46.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.524+0000 7fd6e43e0700 1 -- start start 2023-10-01T07:58:46.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.525+0000 7fd6e43e0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd6dc133420 0x7fd6dc1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:46.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.525+0000 7fd6e43e0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6dc133e30 0x7fd6dc12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:46.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.525+0000 7fd6e43e0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6dc134260 0x7fd6dc1304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:46.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.525+0000 7fd6e43e0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6dc06b990 con 0x7fd6dc133420 2023-10-01T07:58:46.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.525+0000 7fd6e43e0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc0a0590 con 0x7fd6dc134260 2023-10-01T07:58:46.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.525+0000 7fd6e43e0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc09fb80 con 0x7fd6dc133e30 2023-10-01T07:58:46.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.526+0000 7fd6e197b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6dc133e30 0x7fd6dc12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:46.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.526+0000 7fd6e197b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6dc133e30 0x7fd6dc12ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:52554/0 (socket says 172.21.15.26:52554) 2023-10-01T07:58:46.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.526+0000 7fd6e197b700 1 -- 172.21.15.26:0/1219793940 learned_addr learned my addr 172.21.15.26:0/1219793940 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:46.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.526+0000 7fd6e297d700 1 --2- 172.21.15.26:0/1219793940 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6dc134260 0x7fd6dc1304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:46.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.526+0000 7fd6e217c700 1 --2- 172.21.15.26:0/1219793940 >> v2:172.21.15.26:3300/0 conn(0x7fd6dc133420 0x7fd6dc1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:46.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.526+0000 7fd6e197b700 1 -- 172.21.15.26:0/1219793940 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6dc134260 msgr2=0x7fd6dc1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:46.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.526+0000 7fd6e197b700 1 --2- 172.21.15.26:0/1219793940 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6dc134260 0x7fd6dc1304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.526+0000 7fd6e197b700 1 -- 172.21.15.26:0/1219793940 >> v2:172.21.15.26:3300/0 conn(0x7fd6dc133420 msgr2=0x7fd6dc1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:46.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.526+0000 7fd6e197b700 1 --2- 172.21.15.26:0/1219793940 >> v2:172.21.15.26:3300/0 conn(0x7fd6dc133420 0x7fd6dc1337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.526+0000 7fd6e197b700 1 -- 172.21.15.26:0/1219793940 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6dc0a0030 con 0x7fd6dc133e30 2023-10-01T07:58:46.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.526+0000 7fd6e197b700 1 --2- 172.21.15.26:0/1219793940 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6dc133e30 0x7fd6dc12ff90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0098f0 tx=0x7fd6cc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=989c89763799c7d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:46.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.527+0000 7fd6e117a700 1 -- 172.21.15.26:0/1219793940 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc011830 con 0x7fd6dc133e30 2023-10-01T07:58:46.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.527+0000 7fd6e117a700 1 -- 172.21.15.26:0/1219793940 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6cc011990 con 0x7fd6dc133e30 2023-10-01T07:58:46.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.527+0000 7fd6e117a700 1 -- 172.21.15.26:0/1219793940 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc011d20 con 0x7fd6dc133e30 2023-10-01T07:58:46.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.527+0000 7fd6e43e0700 1 -- 172.21.15.26:0/1219793940 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6dc133e30 msgr2=0x7fd6dc12ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:46.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.527+0000 7fd6e43e0700 1 --2- 172.21.15.26:0/1219793940 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6dc133e30 0x7fd6dc12ff90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0098f0 tx=0x7fd6cc009c00 comp rx=0 tx=0).stop 2023-10-01T07:58:46.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.527+0000 7fd6e43e0700 1 -- 172.21.15.26:0/1219793940 shutdown_connections 2023-10-01T07:58:46.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.527+0000 7fd6e43e0700 1 --2- 172.21.15.26:0/1219793940 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6dc134260 0x7fd6dc1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.527+0000 7fd6e43e0700 1 --2- 172.21.15.26:0/1219793940 >> v2:172.21.15.26:3300/0 conn(0x7fd6dc133420 0x7fd6dc1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.527+0000 7fd6e43e0700 1 --2- 172.21.15.26:0/1219793940 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6dc133e30 0x7fd6dc12ff90 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.527+0000 7fd6e43e0700 1 -- 172.21.15.26:0/1219793940 >> 172.21.15.26:0/1219793940 conn(0x7fd6dc0a4210 msgr2=0x7fd6dc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:46.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.528+0000 7fd6e43e0700 1 -- 172.21.15.26:0/1219793940 shutdown_connections 2023-10-01T07:58:46.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.528+0000 7fd6e43e0700 1 -- 172.21.15.26:0/1219793940 wait complete. 2023-10-01T07:58:46.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.529+0000 7fd6e43e0700 1 Processor -- start 2023-10-01T07:58:46.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.529+0000 7fd6e43e0700 1 -- start start 2023-10-01T07:58:46.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.530+0000 7fd6e43e0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6dc133420 0x7fd6dc09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:46.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.530+0000 7fd6e43e0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6dc133e30 0x7fd6dc09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:46.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.530+0000 7fd6e43e0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6dc134260 0x7fd6dc09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:46.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.530+0000 7fd6e43e0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc12d950 con 0x7fd6dc133e30 2023-10-01T07:58:46.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.530+0000 7fd6e43e0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc11fb90 con 0x7fd6dc133420 2023-10-01T07:58:46.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.530+0000 7fd6e43e0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc11f450 con 0x7fd6dc134260 2023-10-01T07:58:46.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.530+0000 7fd6e297d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6dc134260 0x7fd6dc09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:46.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.530+0000 7fd6e297d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6dc134260 0x7fd6dc09cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:52558/0 (socket says 172.21.15.26:52558) 2023-10-01T07:58:46.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.530+0000 7fd6e297d700 1 -- 172.21.15.26:0/1527224224 learned_addr learned my addr 172.21.15.26:0/1527224224 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:46.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.530+0000 7fd6e197b700 1 --2- 172.21.15.26:0/1527224224 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6dc133e30 0x7fd6dc09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:46.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.530+0000 7fd6e217c700 1 --2- 172.21.15.26:0/1527224224 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6dc133420 0x7fd6dc09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:46.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.531+0000 7fd6e297d700 1 -- 172.21.15.26:0/1527224224 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6dc133420 msgr2=0x7fd6dc09c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:46.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.531+0000 7fd6e297d700 1 --2- 172.21.15.26:0/1527224224 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6dc133420 0x7fd6dc09c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.531+0000 7fd6e297d700 1 -- 172.21.15.26:0/1527224224 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6dc133e30 msgr2=0x7fd6dc09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:46.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.531+0000 7fd6e297d700 1 --2- 172.21.15.26:0/1527224224 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6dc133e30 0x7fd6dc09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.531+0000 7fd6e297d700 1 -- 172.21.15.26:0/1527224224 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6cc009550 con 0x7fd6dc134260 2023-10-01T07:58:46.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.531+0000 7fd6e297d700 1 --2- 172.21.15.26:0/1527224224 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6dc134260 0x7fd6dc09cf00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4009fc0 tx=0x7fd6d400e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:46.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.531+0000 7fd6d2ffd700 1 -- 172.21.15.26:0/1527224224 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d400ede0 con 0x7fd6dc134260 2023-10-01T07:58:46.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.531+0000 7fd6d2ffd700 1 -- 172.21.15.26:0/1527224224 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d4017960 con 0x7fd6dc134260 2023-10-01T07:58:46.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.531+0000 7fd6e43e0700 1 -- 172.21.15.26:0/1527224224 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6dc09dd90 con 0x7fd6dc134260 2023-10-01T07:58:46.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.531+0000 7fd6d2ffd700 1 -- 172.21.15.26:0/1527224224 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d4017d10 con 0x7fd6dc134260 2023-10-01T07:58:46.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.531+0000 7fd6e43e0700 1 -- 172.21.15.26:0/1527224224 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6dc1208c0 con 0x7fd6dc134260 2023-10-01T07:58:46.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.532+0000 7fd6e43e0700 1 -- 172.21.15.26:0/1527224224 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6dc074ea0 con 0x7fd6dc134260 2023-10-01T07:58:46.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.532+0000 7fd6d2ffd700 1 -- 172.21.15.26:0/1527224224 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd6d401f3f0 con 0x7fd6dc134260 2023-10-01T07:58:46.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.533+0000 7fd6d2ffd700 1 -- 172.21.15.26:0/1527224224 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd6d4047d80 con 0x7fd6dc134260 2023-10-01T07:58:46.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.538+0000 7fd6d2ffd700 1 -- 172.21.15.26:0/1527224224 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd6d404b030 con 0x7fd6dc134260 2023-10-01T07:58:46.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.605+0000 7f44dec9a700 1 Processor -- start 2023-10-01T07:58:46.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.606+0000 7f44dec9a700 1 -- start start 2023-10-01T07:58:46.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.606+0000 7f44dec9a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f44d809d6f0 0x7f44d809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:46.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.606+0000 7f44dec9a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f44d809e000 0x7f44d8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:46.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.606+0000 7f44dec9a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44d809e410 0x7f44d8130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:46.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.606+0000 7f44dec9a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44d809f520 con 0x7f44d809e410 2023-10-01T07:58:46.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.606+0000 7f44dec9a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d809f130 con 0x7f44d809e000 2023-10-01T07:58:46.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.606+0000 7f44dec9a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44d809e930 con 0x7f44d809d6f0 2023-10-01T07:58:46.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.606+0000 7f44d7fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f44d809e000 0x7f44d8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:46.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.606+0000 7f44d7fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f44d809e000 0x7f44d8130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58828/0 (socket says 172.21.15.26:58828) 2023-10-01T07:58:46.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.606+0000 7f44d7fff700 1 -- 172.21.15.26:0/1142860674 learned_addr learned my addr 172.21.15.26:0/1142860674 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:46.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.606+0000 7f44dca36700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f44d809d6f0 0x7f44d809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:46.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.606+0000 7f44dd237700 1 --2- 172.21.15.26:0/1142860674 >> v2:172.21.15.26:3300/0 conn(0x7f44d809e410 0x7f44d8130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:46.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.607+0000 7f44dca36700 1 -- 172.21.15.26:0/1142860674 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f44d809e000 msgr2=0x7f44d8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:46.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.607+0000 7f44dca36700 1 --2- 172.21.15.26:0/1142860674 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f44d809e000 0x7f44d8130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.607+0000 7f44dca36700 1 -- 172.21.15.26:0/1142860674 >> v2:172.21.15.26:3300/0 conn(0x7f44d809e410 msgr2=0x7f44d8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:46.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.607+0000 7f44dca36700 1 --2- 172.21.15.26:0/1142860674 >> v2:172.21.15.26:3300/0 conn(0x7f44d809e410 0x7f44d8130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.607+0000 7f44dca36700 1 -- 172.21.15.26:0/1142860674 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d809b2d0 con 0x7f44d809d6f0 2023-10-01T07:58:46.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.607+0000 7f44dd237700 1 --2- 172.21.15.26:0/1142860674 >> v2:172.21.15.26:3300/0 conn(0x7f44d809e410 0x7f44d8130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:46.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.607+0000 7f44d7fff700 1 --2- 172.21.15.26:0/1142860674 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f44d809e000 0x7f44d8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:46.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.607+0000 7f44dca36700 1 --2- 172.21.15.26:0/1142860674 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f44d809d6f0 0x7f44d809dac0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f44cc009870 tx=0x7f44cc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c09ee0ecfb0ec29 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:46.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.607+0000 7f44d77fe700 1 -- 172.21.15.26:0/1142860674 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc011830 con 0x7f44d809d6f0 2023-10-01T07:58:46.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.607+0000 7f44d77fe700 1 -- 172.21.15.26:0/1142860674 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44cc011990 con 0x7f44d809d6f0 2023-10-01T07:58:46.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.607+0000 7f44d77fe700 1 -- 172.21.15.26:0/1142860674 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc011d20 con 0x7f44d809d6f0 2023-10-01T07:58:46.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.608+0000 7f44dec9a700 1 -- 172.21.15.26:0/1142860674 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f44d809d6f0 msgr2=0x7f44d809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:46.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.608+0000 7f44dec9a700 1 --2- 172.21.15.26:0/1142860674 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f44d809d6f0 0x7f44d809dac0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f44cc009870 tx=0x7f44cc009b80 comp rx=0 tx=0).stop 2023-10-01T07:58:46.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.609+0000 7f44dec9a700 1 -- 172.21.15.26:0/1142860674 shutdown_connections 2023-10-01T07:58:46.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.609+0000 7f44dec9a700 1 --2- 172.21.15.26:0/1142860674 >> v2:172.21.15.26:3300/0 conn(0x7f44d809e410 0x7f44d8130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.609+0000 7f44dec9a700 1 --2- 172.21.15.26:0/1142860674 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f44d809d6f0 0x7f44d809dac0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.609+0000 7f44dec9a700 1 --2- 172.21.15.26:0/1142860674 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f44d809e000 0x7f44d8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.609+0000 7f44dec9a700 1 -- 172.21.15.26:0/1142860674 >> 172.21.15.26:0/1142860674 conn(0x7f44d8066f50 msgr2=0x7f44d809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:46.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.609+0000 7f44dec9a700 1 -- 172.21.15.26:0/1142860674 shutdown_connections 2023-10-01T07:58:46.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.609+0000 7f44dec9a700 1 -- 172.21.15.26:0/1142860674 wait complete. 2023-10-01T07:58:46.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.610+0000 7f44dec9a700 1 Processor -- start 2023-10-01T07:58:46.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.610+0000 7f44dec9a700 1 -- start start 2023-10-01T07:58:46.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.611+0000 7f44dec9a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f44d809d6f0 0x7f44d81214a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:46.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.611+0000 7f44dec9a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44d809e000 0x7f44d81219e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:46.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.611+0000 7f44dec9a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f44d809e410 0x7f44d8121f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:46.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.611+0000 7f44dec9a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d81235c0 con 0x7f44d809e000 2023-10-01T07:58:46.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.611+0000 7f44dec9a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d8122560 con 0x7f44d809d6f0 2023-10-01T07:58:46.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.611+0000 7f44dec9a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44d8123940 con 0x7f44d809e410 2023-10-01T07:58:46.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.611+0000 7f44dd237700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f44d809e410 0x7f44d8121f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:46.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.611+0000 7f44dd237700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f44d809e410 0x7f44d8121f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:52574/0 (socket says 172.21.15.26:52574) 2023-10-01T07:58:46.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.611+0000 7f44dca36700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f44d809d6f0 0x7f44d81214a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:46.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.611+0000 7f44dd237700 1 -- 172.21.15.26:0/575892625 learned_addr learned my addr 172.21.15.26:0/575892625 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:46.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.612+0000 7f44d7fff700 1 --2- 172.21.15.26:0/575892625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44d809e000 0x7f44d81219e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:46.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.612+0000 7f44dca36700 1 -- 172.21.15.26:0/575892625 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f44d809e410 msgr2=0x7f44d8121f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:46.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.612+0000 7f44dca36700 1 --2- 172.21.15.26:0/575892625 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f44d809e410 0x7f44d8121f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.612+0000 7f44dca36700 1 -- 172.21.15.26:0/575892625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44d809e000 msgr2=0x7f44d81219e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:46.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.612+0000 7f44dca36700 1 --2- 172.21.15.26:0/575892625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44d809e000 0x7f44d81219e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.612+0000 7f44dca36700 1 -- 172.21.15.26:0/575892625 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c4009550 con 0x7f44d809d6f0 2023-10-01T07:58:46.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.612+0000 7f44dca36700 1 --2- 172.21.15.26:0/575892625 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f44d809d6f0 0x7f44d81214a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f44cc016000 tx=0x7f44cc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:46.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.612+0000 7f44d57fa700 1 -- 172.21.15.26:0/575892625 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc004510 con 0x7f44d809d6f0 2023-10-01T07:58:46.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.612+0000 7f44d57fa700 1 -- 172.21.15.26:0/575892625 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44cc01f070 con 0x7f44d809d6f0 2023-10-01T07:58:46.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.612+0000 7f44dec9a700 1 -- 172.21.15.26:0/575892625 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44d0009a70 con 0x7f44d809d6f0 2023-10-01T07:58:46.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.612+0000 7f44d57fa700 1 -- 172.21.15.26:0/575892625 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc0038c0 con 0x7f44d809d6f0 2023-10-01T07:58:46.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.612+0000 7f44dec9a700 1 -- 172.21.15.26:0/575892625 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44cc0094a0 con 0x7f44d809d6f0 2023-10-01T07:58:46.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.613+0000 7f44dec9a700 1 -- 172.21.15.26:0/575892625 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44d8074ea0 con 0x7f44d809d6f0 2023-10-01T07:58:46.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.614+0000 7f44d57fa700 1 -- 172.21.15.26:0/575892625 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f44cc003a20 con 0x7f44d809d6f0 2023-10-01T07:58:46.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.614+0000 7f44d57fa700 1 -- 172.21.15.26:0/575892625 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f44cc021070 con 0x7f44d809d6f0 2023-10-01T07:58:46.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.623+0000 7f44d57fa700 1 -- 172.21.15.26:0/575892625 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f44cc010380 con 0x7f44d809d6f0 2023-10-01T07:58:46.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.625+0000 7f129ad1d700 1 Processor -- start 2023-10-01T07:58:46.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.625+0000 7f129ad1d700 1 -- start start 2023-10-01T07:58:46.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.626+0000 7f129ad1d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f129409e1d0 0x7f1294135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:46.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.626+0000 7f129ad1d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1294135e50 0x7f1294138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:46.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.626+0000 7f129ad1d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f129409f130 con 0x7f129409d6f0 2023-10-01T07:58:46.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.626+0000 7f129ad1d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f129409f520 con 0x7f1294135e50 2023-10-01T07:58:46.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.626+0000 7f129ad1d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f129409e930 con 0x7f129409e1d0 2023-10-01T07:58:46.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.626+0000 7f1298ab9700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f129409d6f0 0x7f129409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:55886/0 (socket says 172.21.15.26:55886) 2023-10-01T07:58:46.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.626+0000 7f1298ab9700 1 -- 172.21.15.26:0/730687857 learned_addr learned my addr 172.21.15.26:0/730687857 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:46.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.626+0000 7f12992ba700 1 --2- 172.21.15.26:0/730687857 >> v2:172.21.15.26:3300/0 conn(0x7f1294135e50 0x7f1294138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:46.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.626+0000 7f1293fff700 1 --2- 172.21.15.26:0/730687857 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f129409e1d0 0x7f1294135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:46.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.626+0000 7f12992ba700 1 -- 172.21.15.26:0/730687857 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f129409e1d0 msgr2=0x7f1294135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:46.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.626+0000 7f12937fe700 1 -- 172.21.15.26:0/730687857 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2707822462 0 0) 0x7f129409f130 con 0x7f129409d6f0 2023-10-01T07:58:46.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.626+0000 7f12992ba700 1 --2- 172.21.15.26:0/730687857 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f129409e1d0 0x7f1294135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.626+0000 7f12992ba700 1 -- 172.21.15.26:0/730687857 >> v1:172.21.15.26:6789/0 conn(0x7f129409d6f0 legacy=0x7f129409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:46.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.626+0000 7f12992ba700 1 -- 172.21.15.26:0/730687857 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129409b2d0 con 0x7f1294135e50 2023-10-01T07:58:46.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.626+0000 7f1293fff700 1 --2- 172.21.15.26:0/730687857 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f129409e1d0 0x7f1294135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:58:46.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.627+0000 7f12992ba700 1 --2- 172.21.15.26:0/730687857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1294135e50 0x7f1294138230 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f128c009df0 tx=0x7f128c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b561e19704be41e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:46.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.627+0000 7f12937fe700 1 -- 172.21.15.26:0/730687857 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c00e070 con 0x7f1294135e50 2023-10-01T07:58:46.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.627+0000 7f12937fe700 1 -- 172.21.15.26:0/730687857 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128c00bb50 con 0x7f1294135e50 2023-10-01T07:58:46.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.627+0000 7f12937fe700 1 -- 172.21.15.26:0/730687857 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c012430 con 0x7f1294135e50 2023-10-01T07:58:46.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.628+0000 7f129ad1d700 1 -- 172.21.15.26:0/730687857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1294135e50 msgr2=0x7f1294138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:46.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.628+0000 7f129ad1d700 1 --2- 172.21.15.26:0/730687857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1294135e50 0x7f1294138230 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f128c009df0 tx=0x7f128c00b330 comp rx=0 tx=0).stop 2023-10-01T07:58:46.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.628+0000 7f129ad1d700 1 -- 172.21.15.26:0/730687857 shutdown_connections 2023-10-01T07:58:46.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.628+0000 7f129ad1d700 1 --2- 172.21.15.26:0/730687857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1294135e50 0x7f1294138230 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.628+0000 7f129ad1d700 1 --2- 172.21.15.26:0/730687857 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f129409e1d0 0x7f1294135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.628+0000 7f129ad1d700 1 -- 172.21.15.26:0/730687857 >> 172.21.15.26:0/730687857 conn(0x7f1294066f50 msgr2=0x7f129409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:46.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.628+0000 7f129ad1d700 1 -- 172.21.15.26:0/730687857 shutdown_connections 2023-10-01T07:58:46.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.628+0000 7f129ad1d700 1 -- 172.21.15.26:0/730687857 wait complete. 2023-10-01T07:58:46.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.629+0000 7f129ad1d700 1 Processor -- start 2023-10-01T07:58:46.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.629+0000 7f129ad1d700 1 -- start start 2023-10-01T07:58:46.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.630+0000 7f129ad1d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f129409d6f0 0x7f129411d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:46.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.630+0000 7f129ad1d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f129409e1d0 0x7f129411ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:46.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.630+0000 7f129ad1d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1294135e50 0x7f129411e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:46.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.630+0000 7f129ad1d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129409c700 con 0x7f129409d6f0 2023-10-01T07:58:46.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.630+0000 7f129ad1d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12941208e0 con 0x7f1294135e50 2023-10-01T07:58:46.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.630+0000 7f129ad1d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12940a20b0 con 0x7f129409e1d0 2023-10-01T07:58:46.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.630+0000 7f1298ab9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f129409d6f0 0x7f129411d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:46.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.630+0000 7f12992ba700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1294135e50 0x7f129411e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:46.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.630+0000 7f1298ab9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f129409d6f0 0x7f129411d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50526/0 (socket says 172.21.15.26:50526) 2023-10-01T07:58:46.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.630+0000 7f1298ab9700 1 -- 172.21.15.26:0/121182818 learned_addr learned my addr 172.21.15.26:0/121182818 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:46.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.630+0000 7f1293fff700 1 --2- 172.21.15.26:0/121182818 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f129409e1d0 0x7f129411ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:46.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.630+0000 7f1298ab9700 1 -- 172.21.15.26:0/121182818 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f129409e1d0 msgr2=0x7f129411ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:46.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.630+0000 7f1298ab9700 1 --2- 172.21.15.26:0/121182818 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f129409e1d0 0x7f129411ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.630+0000 7f1298ab9700 1 -- 172.21.15.26:0/121182818 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1294135e50 msgr2=0x7f129411e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:46.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.630+0000 7f1298ab9700 1 --2- 172.21.15.26:0/121182818 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1294135e50 0x7f129411e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.630+0000 7f1298ab9700 1 -- 172.21.15.26:0/121182818 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128c009a70 con 0x7f129409d6f0 2023-10-01T07:58:46.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.630+0000 7f12992ba700 1 --2- 172.21.15.26:0/121182818 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1294135e50 0x7f129411e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:46.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.630+0000 7f1298ab9700 1 --2- 172.21.15.26:0/121182818 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f129409d6f0 0x7f129411d890 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f1288001b60 tx=0x7f1288001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:46.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.631+0000 7f12917fa700 1 -- 172.21.15.26:0/121182818 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1288007380 con 0x7f129409d6f0 2023-10-01T07:58:46.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.631+0000 7f12917fa700 1 -- 172.21.15.26:0/121182818 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12880074e0 con 0x7f129409d6f0 2023-10-01T07:58:46.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.631+0000 7f12917fa700 1 -- 172.21.15.26:0/121182818 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1288004870 con 0x7f129409d6f0 2023-10-01T07:58:46.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.631+0000 7f129ad1d700 1 -- 172.21.15.26:0/121182818 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f129411f240 con 0x7f129409d6f0 2023-10-01T07:58:46.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.631+0000 7f129ad1d700 1 -- 172.21.15.26:0/121182818 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1294121650 con 0x7f129409d6f0 2023-10-01T07:58:46.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.632+0000 7f129ad1d700 1 -- 172.21.15.26:0/121182818 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1294074ea0 con 0x7f129409d6f0 2023-10-01T07:58:46.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.632+0000 7f12917fa700 1 -- 172.21.15.26:0/121182818 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f12880049f0 con 0x7f129409d6f0 2023-10-01T07:58:46.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.633+0000 7f12917fa700 1 -- 172.21.15.26:0/121182818 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1288046350 con 0x7f129409d6f0 2023-10-01T07:58:46.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.637+0000 7f12917fa700 1 -- 172.21.15.26:0/121182818 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1288043060 con 0x7f129409d6f0 2023-10-01T07:58:46.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.733+0000 7feb8ce88700 1 -- 172.21.15.26:0/3473498088 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7feb8806c360 con 0x7feb8809e000 2023-10-01T07:58:46.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.733+0000 7feb76ffd700 1 -- 172.21.15.26:0/3473498088 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feb7c01b3b0 con 0x7feb8809e000 2023-10-01T07:58:46.734 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:46.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.736+0000 7feb8ce88700 1 -- 172.21.15.26:0/3473498088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8809e000 msgr2=0x7feb881a6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:46.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.736+0000 7feb8ce88700 1 --2- 172.21.15.26:0/3473498088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8809e000 0x7feb881a6370 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7feb7c00e900 tx=0x7feb7c00ec10 comp rx=0 tx=0).stop 2023-10-01T07:58:46.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.736+0000 7feb8ce88700 1 -- 172.21.15.26:0/3473498088 shutdown_connections 2023-10-01T07:58:46.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.736+0000 7feb8ce88700 1 --2- 172.21.15.26:0/3473498088 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb8809e410 0x7feb881a68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.736+0000 7feb8ce88700 1 --2- 172.21.15.26:0/3473498088 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb8809d6f0 0x7feb881a5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.736+0000 7feb8ce88700 1 --2- 172.21.15.26:0/3473498088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8809e000 0x7feb881a6370 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.736+0000 7feb8ce88700 1 -- 172.21.15.26:0/3473498088 >> 172.21.15.26:0/3473498088 conn(0x7feb88066f50 msgr2=0x7feb881bad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:46.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.736+0000 7feb8ce88700 1 -- 172.21.15.26:0/3473498088 shutdown_connections 2023-10-01T07:58:46.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.736+0000 7feb8ce88700 1 -- 172.21.15.26:0/3473498088 wait complete. 2023-10-01T07:58:46.751 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:46.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.757+0000 7fd6e43e0700 1 -- 172.21.15.26:0/1527224224 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd6dc06b250 con 0x7fd6dc134260 2023-10-01T07:58:46.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.757+0000 7fd6d2ffd700 1 -- 172.21.15.26:0/1527224224 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd6d401e3a0 con 0x7fd6dc134260 2023-10-01T07:58:46.758 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:46.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.759+0000 7fd6e43e0700 1 -- 172.21.15.26:0/1527224224 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6dc134260 msgr2=0x7fd6dc09cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:46.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.759+0000 7fd6e43e0700 1 --2- 172.21.15.26:0/1527224224 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6dc134260 0x7fd6dc09cf00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4009fc0 tx=0x7fd6d400e3c0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.760+0000 7fd6e43e0700 1 -- 172.21.15.26:0/1527224224 shutdown_connections 2023-10-01T07:58:46.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.760+0000 7fd6e43e0700 1 --2- 172.21.15.26:0/1527224224 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd6dc134260 0x7fd6dc09cf00 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.760+0000 7fd6e43e0700 1 --2- 172.21.15.26:0/1527224224 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd6dc133420 0x7fd6dc09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.760+0000 7fd6e43e0700 1 --2- 172.21.15.26:0/1527224224 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6dc133e30 0x7fd6dc09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.760+0000 7fd6e43e0700 1 -- 172.21.15.26:0/1527224224 >> 172.21.15.26:0/1527224224 conn(0x7fd6dc0a4210 msgr2=0x7fd6dc1302c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:46.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.760+0000 7fd6e43e0700 1 -- 172.21.15.26:0/1527224224 shutdown_connections 2023-10-01T07:58:46.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.760+0000 7fd6e43e0700 1 -- 172.21.15.26:0/1527224224 wait complete. 2023-10-01T07:58:46.774 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:46.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.833+0000 7f44dec9a700 1 -- 172.21.15.26:0/575892625 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f44d806b300 con 0x7f44d809d6f0 2023-10-01T07:58:46.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.834+0000 7f44d57fa700 1 -- 172.21.15.26:0/575892625 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f44cc015020 con 0x7f44d809d6f0 2023-10-01T07:58:46.834 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:46.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.836+0000 7f44dec9a700 1 -- 172.21.15.26:0/575892625 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f44d809d6f0 msgr2=0x7f44d81214a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:46.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.836+0000 7f44dec9a700 1 --2- 172.21.15.26:0/575892625 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f44d809d6f0 0x7f44d81214a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f44cc016000 tx=0x7f44cc004750 comp rx=0 tx=0).stop 2023-10-01T07:58:46.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.836+0000 7f44dec9a700 1 -- 172.21.15.26:0/575892625 shutdown_connections 2023-10-01T07:58:46.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.836+0000 7f44dec9a700 1 --2- 172.21.15.26:0/575892625 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f44d809e410 0x7f44d8121f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.836+0000 7f44dec9a700 1 --2- 172.21.15.26:0/575892625 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f44d809d6f0 0x7f44d81214a0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.836+0000 7f44dec9a700 1 --2- 172.21.15.26:0/575892625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44d809e000 0x7f44d81219e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.836+0000 7f44dec9a700 1 -- 172.21.15.26:0/575892625 >> 172.21.15.26:0/575892625 conn(0x7f44d8066f50 msgr2=0x7f44d8119480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:46.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.836+0000 7f44dec9a700 1 -- 172.21.15.26:0/575892625 shutdown_connections 2023-10-01T07:58:46.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.836+0000 7f44dec9a700 1 -- 172.21.15.26:0/575892625 wait complete. 2023-10-01T07:58:46.850 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:46.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.862+0000 7f129ad1d700 1 -- 172.21.15.26:0/121182818 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f129406c360 con 0x7f129409d6f0 2023-10-01T07:58:46.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.863+0000 7f12917fa700 1 -- 172.21.15.26:0/121182818 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1288043020 con 0x7f129409d6f0 2023-10-01T07:58:46.863 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:46.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.865+0000 7f129ad1d700 1 -- 172.21.15.26:0/121182818 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f129409d6f0 msgr2=0x7f129411d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:46.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.865+0000 7f129ad1d700 1 --2- 172.21.15.26:0/121182818 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f129409d6f0 0x7f129411d890 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f1288001b60 tx=0x7f1288001e70 comp rx=0 tx=0).stop 2023-10-01T07:58:46.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.865+0000 7f129ad1d700 1 -- 172.21.15.26:0/121182818 shutdown_connections 2023-10-01T07:58:46.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.865+0000 7f129ad1d700 1 --2- 172.21.15.26:0/121182818 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1294135e50 0x7f129411e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.865+0000 7f129ad1d700 1 --2- 172.21.15.26:0/121182818 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f129409d6f0 0x7f129411d890 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.865+0000 7f129ad1d700 1 --2- 172.21.15.26:0/121182818 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f129409e1d0 0x7f129411ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:46.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.865+0000 7f129ad1d700 1 -- 172.21.15.26:0/121182818 >> 172.21.15.26:0/121182818 conn(0x7f1294066f50 msgr2=0x7f1294070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:46.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.865+0000 7f129ad1d700 1 -- 172.21.15.26:0/121182818 shutdown_connections 2023-10-01T07:58:46.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:46.865+0000 7f129ad1d700 1 -- 172.21.15.26:0/121182818 wait complete. 2023-10-01T07:58:46.879 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:47.752 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:47.775 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:47.851 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:47.880 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:47.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.915+0000 7f8e156d7700 1 Processor -- start 2023-10-01T07:58:47.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.915+0000 7f8e156d7700 1 -- start start 2023-10-01T07:58:47.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.915+0000 7f8e156d7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8e10131810 0x7f8e10131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:47.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.915+0000 7f8e156d7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e10099a40 0x7f8e10099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:47.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.916+0000 7f8e156d7700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e101313c0 con 0x7f8e1009a3b0 2023-10-01T07:58:47.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.916+0000 7f8e156d7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e1009b580 con 0x7f8e10131810 2023-10-01T07:58:47.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.916+0000 7f8e156d7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1006e8c0 con 0x7f8e10099a40 2023-10-01T07:58:47.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.916+0000 7f8e0effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8e10131810 0x7f8e10131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:47.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.916+0000 7f8e0effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8e10131810 0x7f8e10131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50542/0 (socket says 172.21.15.26:50542) 2023-10-01T07:58:47.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.916+0000 7f8e0effd700 1 -- 172.21.15.26:0/702544832 learned_addr learned my addr 172.21.15.26:0/702544832 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:47.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.916+0000 7f8e0e7fc700 1 --2- 172.21.15.26:0/702544832 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e10099a40 0x7f8e10099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:47.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.916+0000 7f8e0effd700 1 -- 172.21.15.26:0/702544832 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e10099a40 msgr2=0x7f8e10099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:47.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.916+0000 7f8e0effd700 1 --2- 172.21.15.26:0/702544832 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e10099a40 0x7f8e10099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:47.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.916+0000 7f8e0effd700 1 -- 172.21.15.26:0/702544832 >> v1:172.21.15.26:6789/0 conn(0x7f8e1009a3b0 legacy=0x7f8e10138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:47.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.916+0000 7f8e0effd700 1 -- 172.21.15.26:0/702544832 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1009a830 con 0x7f8e10131810 2023-10-01T07:58:47.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.917+0000 7f8e0effd700 1 --2- 172.21.15.26:0/702544832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e10131810 0x7f8e10131be0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f8e000098f0 tx=0x7f8e00009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6045d77991a970f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:47.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.917+0000 7f8e0dffb700 1 -- 172.21.15.26:0/702544832 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e00011830 con 0x7f8e10131810 2023-10-01T07:58:47.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.917+0000 7f8e0dffb700 1 -- 172.21.15.26:0/702544832 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e00011990 con 0x7f8e10131810 2023-10-01T07:58:47.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.917+0000 7f8e0dffb700 1 -- 172.21.15.26:0/702544832 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e00011d20 con 0x7f8e10131810 2023-10-01T07:58:47.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.917+0000 7f8e156d7700 1 -- 172.21.15.26:0/702544832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e10131810 msgr2=0x7f8e10131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:47.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.917+0000 7f8e156d7700 1 --2- 172.21.15.26:0/702544832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e10131810 0x7f8e10131be0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f8e000098f0 tx=0x7f8e00009c00 comp rx=0 tx=0).stop 2023-10-01T07:58:47.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.918+0000 7f8e156d7700 1 -- 172.21.15.26:0/702544832 shutdown_connections 2023-10-01T07:58:47.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.918+0000 7f8e156d7700 1 --2- 172.21.15.26:0/702544832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e10131810 0x7f8e10131be0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:47.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.918+0000 7f8e156d7700 1 --2- 172.21.15.26:0/702544832 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e10099a40 0x7f8e10099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:47.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.918+0000 7f8e156d7700 1 -- 172.21.15.26:0/702544832 >> 172.21.15.26:0/702544832 conn(0x7f8e100a2aa0 msgr2=0x7f8e100a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:47.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.918+0000 7f8e156d7700 1 -- 172.21.15.26:0/702544832 shutdown_connections 2023-10-01T07:58:47.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.918+0000 7f8e156d7700 1 -- 172.21.15.26:0/702544832 wait complete. 2023-10-01T07:58:47.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.919+0000 7f8e156d7700 1 Processor -- start 2023-10-01T07:58:47.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.919+0000 7f8e156d7700 1 -- start start 2023-10-01T07:58:47.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.919+0000 7f8e156d7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e10099a40 0x7f8e1011b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:47.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.919+0000 7f8e156d7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e1009a3b0 0x7f8e1011bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:47.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.920+0000 7f8e156d7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e10131810 0x7f8e1011c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:47.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.920+0000 7f8e156d7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1011d310 con 0x7f8e10099a40 2023-10-01T07:58:47.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.920+0000 7f8e156d7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1011d900 con 0x7f8e10131810 2023-10-01T07:58:47.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.920+0000 7f8e156d7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1011e9b0 con 0x7f8e1009a3b0 2023-10-01T07:58:47.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.920+0000 7f8e0e7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e1009a3b0 0x7f8e1011bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:47.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.920+0000 7f8e0e7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e1009a3b0 0x7f8e1011bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:52602/0 (socket says 172.21.15.26:52602) 2023-10-01T07:58:47.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.920+0000 7f8e0f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e10131810 0x7f8e1011c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:47.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.920+0000 7f8e0e7fc700 1 -- 172.21.15.26:0/3401103586 learned_addr learned my addr 172.21.15.26:0/3401103586 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:47.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.920+0000 7f8e0effd700 1 --2- 172.21.15.26:0/3401103586 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e10099a40 0x7f8e1011b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:47.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.920+0000 7f8e0e7fc700 1 -- 172.21.15.26:0/3401103586 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e10131810 msgr2=0x7f8e1011c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:47.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.920+0000 7f8e0e7fc700 1 --2- 172.21.15.26:0/3401103586 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e10131810 0x7f8e1011c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:47.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.920+0000 7f8e0e7fc700 1 -- 172.21.15.26:0/3401103586 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e10099a40 msgr2=0x7f8e1011b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:47.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.920+0000 7f8e0e7fc700 1 --2- 172.21.15.26:0/3401103586 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e10099a40 0x7f8e1011b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:47.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.920+0000 7f8e0e7fc700 1 -- 172.21.15.26:0/3401103586 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e00009550 con 0x7f8e1009a3b0 2023-10-01T07:58:47.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.920+0000 7f8e0effd700 1 --2- 172.21.15.26:0/3401103586 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e10099a40 0x7f8e1011b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:47.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.921+0000 7f8e0e7fc700 1 --2- 172.21.15.26:0/3401103586 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e1009a3b0 0x7f8e1011bc90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8e0400e9b0 tx=0x7f8e0400ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:47.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.921+0000 7f8df77fe700 1 -- 172.21.15.26:0/3401103586 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e04009710 con 0x7f8e1009a3b0 2023-10-01T07:58:47.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.921+0000 7f8df77fe700 1 -- 172.21.15.26:0/3401103586 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0400ee50 con 0x7f8e1009a3b0 2023-10-01T07:58:47.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.921+0000 7f8e156d7700 1 -- 172.21.15.26:0/3401103586 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e100a1c20 con 0x7f8e1009a3b0 2023-10-01T07:58:47.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.921+0000 7f8df77fe700 1 -- 172.21.15.26:0/3401103586 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0400ca50 con 0x7f8e1009a3b0 2023-10-01T07:58:47.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.921+0000 7f8e156d7700 1 -- 172.21.15.26:0/3401103586 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e1011ef40 con 0x7f8e1009a3b0 2023-10-01T07:58:47.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.922+0000 7f8df77fe700 1 -- 172.21.15.26:0/3401103586 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e0400cbb0 con 0x7f8e1009a3b0 2023-10-01T07:58:47.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.922+0000 7f8df77fe700 1 -- 172.21.15.26:0/3401103586 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8e0403fab0 con 0x7f8e1009a3b0 2023-10-01T07:58:47.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.923+0000 7f8e156d7700 1 -- 172.21.15.26:0/3401103586 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e10074ea0 con 0x7f8e1009a3b0 2023-10-01T07:58:47.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.929+0000 7f8df77fe700 1 -- 172.21.15.26:0/3401103586 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e0401b3b0 con 0x7f8e1009a3b0 2023-10-01T07:58:47.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.959+0000 7faa2435c700 1 Processor -- start 2023-10-01T07:58:47.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.959+0000 7faa2435c700 1 -- start start 2023-10-01T07:58:47.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.960+0000 7faa2435c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7faa1c09e930 0x7faa1c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:47.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.960+0000 7faa2435c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa1c09f650 0x7faa1c131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:47.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.960+0000 7faa2435c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa1c070940 con 0x7faa1c09f240 2023-10-01T07:58:47.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.960+0000 7faa2435c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa1c06fd60 con 0x7faa1c09e930 2023-10-01T07:58:47.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.960+0000 7faa2435c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c06fa80 con 0x7faa1c09f650 2023-10-01T07:58:47.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.960+0000 7faa228f9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa1c09f650 0x7faa1c131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:47.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.960+0000 7faa218f7700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7faa1c09f240 0x7faa1c1317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:55894/0 (socket says 172.21.15.26:55894) 2023-10-01T07:58:47.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.960+0000 7faa218f7700 1 -- 172.21.15.26:0/579168347 learned_addr learned my addr 172.21.15.26:0/579168347 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:47.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.960+0000 7faa220f8700 1 --2- 172.21.15.26:0/579168347 >> v2:172.21.15.26:3300/0 conn(0x7faa1c09e930 0x7faa1c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:47.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.960+0000 7faa228f9700 1 -- 172.21.15.26:0/579168347 >> v2:172.21.15.26:3300/0 conn(0x7faa1c09e930 msgr2=0x7faa1c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:47.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.960+0000 7faa228f9700 1 --2- 172.21.15.26:0/579168347 >> v2:172.21.15.26:3300/0 conn(0x7faa1c09e930 0x7faa1c09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:47.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.960+0000 7faa228f9700 1 -- 172.21.15.26:0/579168347 >> v1:172.21.15.26:6789/0 conn(0x7faa1c09f240 legacy=0x7faa1c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:47.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.961+0000 7faa228f9700 1 -- 172.21.15.26:0/579168347 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa1c09fb60 con 0x7faa1c09f650 2023-10-01T07:58:47.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.961+0000 7faa228f9700 1 --2- 172.21.15.26:0/579168347 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa1c09f650 0x7faa1c131f00 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7faa14009d90 tx=0x7faa1400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e37849d4ce90d063 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:47.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.961+0000 7faa210f6700 1 -- 172.21.15.26:0/579168347 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1400e070 con 0x7faa1c09f650 2023-10-01T07:58:47.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.961+0000 7faa210f6700 1 -- 172.21.15.26:0/579168347 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa1400bb20 con 0x7faa1c09f650 2023-10-01T07:58:47.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.961+0000 7faa210f6700 1 -- 172.21.15.26:0/579168347 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa14012430 con 0x7faa1c09f650 2023-10-01T07:58:47.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.962+0000 7faa2435c700 1 -- 172.21.15.26:0/579168347 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa1c09f650 msgr2=0x7faa1c131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:47.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.962+0000 7faa2435c700 1 --2- 172.21.15.26:0/579168347 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa1c09f650 0x7faa1c131f00 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7faa14009d90 tx=0x7faa1400b330 comp rx=0 tx=0).stop 2023-10-01T07:58:47.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.962+0000 7faa2435c700 1 -- 172.21.15.26:0/579168347 shutdown_connections 2023-10-01T07:58:47.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.962+0000 7faa2435c700 1 --2- 172.21.15.26:0/579168347 >> v2:172.21.15.26:3300/0 conn(0x7faa1c09e930 0x7faa1c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:47.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.962+0000 7faa2435c700 1 --2- 172.21.15.26:0/579168347 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa1c09f650 0x7faa1c131f00 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:47.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.962+0000 7faa2435c700 1 -- 172.21.15.26:0/579168347 >> 172.21.15.26:0/579168347 conn(0x7faa1c0a4210 msgr2=0x7faa1c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:47.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.962+0000 7faa2435c700 1 -- 172.21.15.26:0/579168347 shutdown_connections 2023-10-01T07:58:47.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.962+0000 7faa2435c700 1 -- 172.21.15.26:0/579168347 wait complete. 2023-10-01T07:58:47.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.963+0000 7faa2435c700 1 Processor -- start 2023-10-01T07:58:47.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.963+0000 7faa2435c700 1 -- start start 2023-10-01T07:58:47.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.964+0000 7faa2435c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa1c09e930 0x7faa1c1a3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:47.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.964+0000 7faa2435c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa1c09f240 0x7faa1c1a4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:47.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.964+0000 7faa2435c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa1c09f650 0x7faa1c1a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:47.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.964+0000 7faa2435c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c1a80b0 con 0x7faa1c09e930 2023-10-01T07:58:47.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.964+0000 7faa2435c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c1a76f0 con 0x7faa1c09f650 2023-10-01T07:58:47.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.964+0000 7faa2435c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c0a34a0 con 0x7faa1c09f240 2023-10-01T07:58:47.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.964+0000 7faa220f8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa1c09e930 0x7faa1c1a3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:47.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.964+0000 7faa220f8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa1c09e930 0x7faa1c1a3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50564/0 (socket says 172.21.15.26:50564) 2023-10-01T07:58:47.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.964+0000 7faa220f8700 1 -- 172.21.15.26:0/3617424373 learned_addr learned my addr 172.21.15.26:0/3617424373 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:47.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.964+0000 7faa228f9700 1 --2- 172.21.15.26:0/3617424373 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa1c09f650 0x7faa1c1a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:47.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.964+0000 7faa218f7700 1 --2- 172.21.15.26:0/3617424373 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa1c09f240 0x7faa1c1a4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:47.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.964+0000 7faa228f9700 1 -- 172.21.15.26:0/3617424373 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa1c09f240 msgr2=0x7faa1c1a4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:47.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.964+0000 7faa228f9700 1 --2- 172.21.15.26:0/3617424373 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa1c09f240 0x7faa1c1a4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:47.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.964+0000 7faa228f9700 1 -- 172.21.15.26:0/3617424373 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa1c09e930 msgr2=0x7faa1c1a3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:47.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.964+0000 7faa228f9700 1 --2- 172.21.15.26:0/3617424373 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa1c09e930 0x7faa1c1a3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:47.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.964+0000 7faa228f9700 1 -- 172.21.15.26:0/3617424373 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa14009a70 con 0x7faa1c09f650 2023-10-01T07:58:47.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.964+0000 7faa220f8700 1 --2- 172.21.15.26:0/3617424373 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa1c09e930 0x7faa1c1a3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:47.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.965+0000 7faa228f9700 1 --2- 172.21.15.26:0/3617424373 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa1c09f650 0x7faa1c1a46a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7faa1c072a80 tx=0x7faa14004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:47.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.965+0000 7faa12ffd700 1 -- 172.21.15.26:0/3617424373 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa14012430 con 0x7faa1c09f650 2023-10-01T07:58:47.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.965+0000 7faa12ffd700 1 -- 172.21.15.26:0/3617424373 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa14028070 con 0x7faa1c09f650 2023-10-01T07:58:47.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.965+0000 7faa12ffd700 1 -- 172.21.15.26:0/3617424373 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa14012e60 con 0x7faa1c09f650 2023-10-01T07:58:47.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.966+0000 7faa2435c700 1 -- 172.21.15.26:0/3617424373 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa1c0a0190 con 0x7faa1c09f650 2023-10-01T07:58:47.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.966+0000 7faa2435c700 1 -- 172.21.15.26:0/3617424373 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa1c071d20 con 0x7faa1c09f650 2023-10-01T07:58:47.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.967+0000 7faa2435c700 1 -- 172.21.15.26:0/3617424373 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa1c1a0b30 con 0x7faa1c09f650 2023-10-01T07:58:47.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.968+0000 7faa12ffd700 1 -- 172.21.15.26:0/3617424373 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faa14004040 con 0x7faa1c09f650 2023-10-01T07:58:47.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.968+0000 7faa12ffd700 1 -- 172.21.15.26:0/3617424373 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faa1402a070 con 0x7faa1c09f650 2023-10-01T07:58:47.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:47.972+0000 7faa12ffd700 1 -- 172.21.15.26:0/3617424373 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faa1402d970 con 0x7faa1c09f650 2023-10-01T07:58:48.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.008+0000 7f65d87a0700 1 Processor -- start 2023-10-01T07:58:48.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.008+0000 7f65d87a0700 1 -- start start 2023-10-01T07:58:48.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.010+0000 7f65d87a0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f65d009d630 0x7f65d00a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:48.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.010+0000 7f65d87a0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f65d0138d80 0x7f65d013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:48.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.010+0000 7f65d87a0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65d00a2a70 con 0x7f65d00a0a30 2023-10-01T07:58:48.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.010+0000 7f65d87a0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d00a01d0 con 0x7f65d0138d80 2023-10-01T07:58:48.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.010+0000 7f65d87a0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65d009e2b0 con 0x7f65d009d630 2023-10-01T07:58:48.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.010+0000 7f65d5d3b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f65d009d630 0x7f65d00a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:48.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.010+0000 7f65d653c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f65d00a0a30 0x7f65d00a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:55902/0 (socket says 172.21.15.26:55902) 2023-10-01T07:58:48.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.010+0000 7f65d653c700 1 -- 172.21.15.26:0/3739033228 learned_addr learned my addr 172.21.15.26:0/3739033228 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:48.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.010+0000 7f65d6d3d700 1 --2- 172.21.15.26:0/3739033228 >> v2:172.21.15.26:3300/0 conn(0x7f65d0138d80 0x7f65d013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:48.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.010+0000 7f65d5d3b700 1 -- 172.21.15.26:0/3739033228 >> v2:172.21.15.26:3300/0 conn(0x7f65d0138d80 msgr2=0x7f65d013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:48.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.010+0000 7f65d5d3b700 1 --2- 172.21.15.26:0/3739033228 >> v2:172.21.15.26:3300/0 conn(0x7f65d0138d80 0x7f65d013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:48.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.010+0000 7f65d5d3b700 1 -- 172.21.15.26:0/3739033228 >> v1:172.21.15.26:6789/0 conn(0x7f65d00a0a30 legacy=0x7f65d00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:48.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.010+0000 7f65d5d3b700 1 -- 172.21.15.26:0/3739033228 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d009dc50 con 0x7f65d009d630 2023-10-01T07:58:48.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.010+0000 7f65d6d3d700 1 --2- 172.21.15.26:0/3739033228 >> v2:172.21.15.26:3300/0 conn(0x7f65d0138d80 0x7f65d013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:48.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.010+0000 7f65d5d3b700 1 --2- 172.21.15.26:0/3739033228 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f65d009d630 0x7f65d00a1510 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f65c0009840 tx=0x7f65c0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a22e525615888268 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:48.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.011+0000 7f65d553a700 1 -- 172.21.15.26:0/3739033228 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c0011830 con 0x7f65d009d630 2023-10-01T07:58:48.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.011+0000 7f65d553a700 1 -- 172.21.15.26:0/3739033228 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c0011990 con 0x7f65d009d630 2023-10-01T07:58:48.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.011+0000 7f65d553a700 1 -- 172.21.15.26:0/3739033228 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c0011d20 con 0x7f65d009d630 2023-10-01T07:58:48.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.012+0000 7f65d87a0700 1 -- 172.21.15.26:0/3739033228 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f65d009d630 msgr2=0x7f65d00a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:48.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.012+0000 7f65d87a0700 1 --2- 172.21.15.26:0/3739033228 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f65d009d630 0x7f65d00a1510 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f65c0009840 tx=0x7f65c0009b50 comp rx=0 tx=0).stop 2023-10-01T07:58:48.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.012+0000 7f65d87a0700 1 -- 172.21.15.26:0/3739033228 shutdown_connections 2023-10-01T07:58:48.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.012+0000 7f65d87a0700 1 --2- 172.21.15.26:0/3739033228 >> v2:172.21.15.26:3300/0 conn(0x7f65d0138d80 0x7f65d013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:48.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.012+0000 7f65d87a0700 1 --2- 172.21.15.26:0/3739033228 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f65d009d630 0x7f65d00a1510 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:48.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.012+0000 7f65d87a0700 1 -- 172.21.15.26:0/3739033228 >> 172.21.15.26:0/3739033228 conn(0x7f65d00a3050 msgr2=0x7f65d00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:48.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.012+0000 7f65d87a0700 1 -- 172.21.15.26:0/3739033228 shutdown_connections 2023-10-01T07:58:48.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.012+0000 7f65d87a0700 1 -- 172.21.15.26:0/3739033228 wait complete. 2023-10-01T07:58:48.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.013+0000 7f65d87a0700 1 Processor -- start 2023-10-01T07:58:48.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.014+0000 7f65d87a0700 1 -- start start 2023-10-01T07:58:48.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.014+0000 7f65d87a0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65d009d630 0x7f65d0120730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:48.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.014+0000 7f65d87a0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f65d00a0a30 0x7f65d0120c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:48.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.014+0000 7f65d87a0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f65d0138d80 0x7f65d01211b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:48.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.014+0000 7f65d87a0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d0123150 con 0x7f65d009d630 2023-10-01T07:58:48.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.014+0000 7f65d87a0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d0121b00 con 0x7f65d00a0a30 2023-10-01T07:58:48.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.014+0000 7f65d87a0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65d013aff0 con 0x7f65d0138d80 2023-10-01T07:58:48.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.015+0000 7f65d6d3d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f65d0138d80 0x7f65d01211b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:48.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.015+0000 7f65d6d3d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f65d0138d80 0x7f65d01211b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:52634/0 (socket says 172.21.15.26:52634) 2023-10-01T07:58:48.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.015+0000 7f65d6d3d700 1 -- 172.21.15.26:0/3746274035 learned_addr learned my addr 172.21.15.26:0/3746274035 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:48.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.015+0000 7f65d5d3b700 1 --2- 172.21.15.26:0/3746274035 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f65d00a0a30 0x7f65d0120c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:48.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.015+0000 7f65d653c700 1 --2- 172.21.15.26:0/3746274035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65d009d630 0x7f65d0120730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:48.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.015+0000 7f65d6d3d700 1 -- 172.21.15.26:0/3746274035 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f65d00a0a30 msgr2=0x7f65d0120c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:48.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.015+0000 7f65d6d3d700 1 --2- 172.21.15.26:0/3746274035 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f65d00a0a30 0x7f65d0120c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:48.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.015+0000 7f65d6d3d700 1 -- 172.21.15.26:0/3746274035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65d009d630 msgr2=0x7f65d0120730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:48.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.015+0000 7f65d6d3d700 1 --2- 172.21.15.26:0/3746274035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65d009d630 0x7f65d0120730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:48.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.015+0000 7f65d6d3d700 1 -- 172.21.15.26:0/3746274035 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c8009a70 con 0x7f65d0138d80 2023-10-01T07:58:48.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.015+0000 7f65d6d3d700 1 --2- 172.21.15.26:0/3746274035 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f65d0138d80 0x7f65d01211b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f65c800efb0 tx=0x7f65c800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:48.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.016+0000 7f65c6ffd700 1 -- 172.21.15.26:0/3746274035 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c800cc90 con 0x7f65d0138d80 2023-10-01T07:58:48.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.016+0000 7f65c6ffd700 1 -- 172.21.15.26:0/3746274035 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c800f040 con 0x7f65d0138d80 2023-10-01T07:58:48.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.016+0000 7f65d87a0700 1 -- 172.21.15.26:0/3746274035 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65c00094a0 con 0x7f65d0138d80 2023-10-01T07:58:48.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.016+0000 7f65c6ffd700 1 -- 172.21.15.26:0/3746274035 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c8014480 con 0x7f65d0138d80 2023-10-01T07:58:48.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.016+0000 7f65d87a0700 1 -- 172.21.15.26:0/3746274035 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d0123570 con 0x7f65d0138d80 2023-10-01T07:58:48.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.017+0000 7f65d87a0700 1 -- 172.21.15.26:0/3746274035 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d0138bc0 con 0x7f65d0138d80 2023-10-01T07:58:48.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.018+0000 7f65c6ffd700 1 -- 172.21.15.26:0/3746274035 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f65c80145e0 con 0x7f65d0138d80 2023-10-01T07:58:48.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.018+0000 7f65c6ffd700 1 -- 172.21.15.26:0/3746274035 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f65c80408d0 con 0x7f65d0138d80 2023-10-01T07:58:48.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.027+0000 7f65c6ffd700 1 -- 172.21.15.26:0/3746274035 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f65c8012930 con 0x7f65d0138d80 2023-10-01T07:58:48.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.069+0000 7f4f42bf9700 1 Processor -- start 2023-10-01T07:58:48.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.069+0000 7f4f42bf9700 1 -- start start 2023-10-01T07:58:48.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.070+0000 7f4f42bf9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4f3c09d630 0x7f4f3c0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:48.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.070+0000 7f4f42bf9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4f3c138d80 0x7f4f3c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:48.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.070+0000 7f4f42bf9700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f3c0a2a70 con 0x7f4f3c0a0a30 2023-10-01T07:58:48.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.070+0000 7f4f42bf9700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3c0a01d0 con 0x7f4f3c09d630 2023-10-01T07:58:48.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.070+0000 7f4f42bf9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c09e2b0 con 0x7f4f3c138d80 2023-10-01T07:58:48.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.070+0000 7f4f3bfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4f3c09d630 0x7f4f3c0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:48.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.070+0000 7f4f3bfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4f3c09d630 0x7f4f3c0a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50582/0 (socket says 172.21.15.26:50582) 2023-10-01T07:58:48.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.070+0000 7f4f3bfff700 1 -- 172.21.15.26:0/99370416 learned_addr learned my addr 172.21.15.26:0/99370416 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:48.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.070+0000 7f4f41196700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4f3c138d80 0x7f4f3c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:48.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.070+0000 7f4f3bfff700 1 -- 172.21.15.26:0/99370416 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4f3c138d80 msgr2=0x7f4f3c13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:48.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.070+0000 7f4f3bfff700 1 --2- 172.21.15.26:0/99370416 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4f3c138d80 0x7f4f3c13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:48.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.070+0000 7f4f3bfff700 1 -- 172.21.15.26:0/99370416 >> v1:172.21.15.26:6789/0 conn(0x7f4f3c0a0a30 legacy=0x7f4f3c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:48.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.070+0000 7f4f3bfff700 1 -- 172.21.15.26:0/99370416 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3c09dc50 con 0x7f4f3c09d630 2023-10-01T07:58:48.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.070+0000 7f4f41196700 1 --2- 172.21.15.26:0/99370416 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4f3c138d80 0x7f4f3c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:48.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.071+0000 7f4f3bfff700 1 --2- 172.21.15.26:0/99370416 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f3c09d630 0x7f4f3c0a1510 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f4f280098f0 tx=0x7f4f28009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee09bc87ca4ddd9e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:48.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.071+0000 7f4f3b7fe700 1 -- 172.21.15.26:0/99370416 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f28011830 con 0x7f4f3c09d630 2023-10-01T07:58:48.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.071+0000 7f4f3b7fe700 1 -- 172.21.15.26:0/99370416 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f28011990 con 0x7f4f3c09d630 2023-10-01T07:58:48.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.071+0000 7f4f3b7fe700 1 -- 172.21.15.26:0/99370416 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f28011d20 con 0x7f4f3c09d630 2023-10-01T07:58:48.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.071+0000 7f4f42bf9700 1 -- 172.21.15.26:0/99370416 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f3c09d630 msgr2=0x7f4f3c0a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:48.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.071+0000 7f4f42bf9700 1 --2- 172.21.15.26:0/99370416 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f3c09d630 0x7f4f3c0a1510 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f4f280098f0 tx=0x7f4f28009c00 comp rx=0 tx=0).stop 2023-10-01T07:58:48.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.071+0000 7f4f42bf9700 1 -- 172.21.15.26:0/99370416 shutdown_connections 2023-10-01T07:58:48.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.072+0000 7f4f42bf9700 1 --2- 172.21.15.26:0/99370416 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4f3c138d80 0x7f4f3c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:48.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.072+0000 7f4f42bf9700 1 --2- 172.21.15.26:0/99370416 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f3c09d630 0x7f4f3c0a1510 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:48.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.072+0000 7f4f42bf9700 1 -- 172.21.15.26:0/99370416 >> 172.21.15.26:0/99370416 conn(0x7f4f3c0a3050 msgr2=0x7f4f3c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:48.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.072+0000 7f4f42bf9700 1 -- 172.21.15.26:0/99370416 shutdown_connections 2023-10-01T07:58:48.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.072+0000 7f4f42bf9700 1 -- 172.21.15.26:0/99370416 wait complete. 2023-10-01T07:58:48.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.073+0000 7f4f42bf9700 1 Processor -- start 2023-10-01T07:58:48.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.073+0000 7f4f42bf9700 1 -- start start 2023-10-01T07:58:48.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.074+0000 7f4f42bf9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4f3c09d630 0x7f4f3c120800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:48.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.074+0000 7f4f42bf9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f3c0a0a30 0x7f4f3c120d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:48.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.074+0000 7f4f42bf9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4f3c138d80 0x7f4f3c121280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:48.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.074+0000 7f4f42bf9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c123fb0 con 0x7f4f3c0a0a30 2023-10-01T07:58:48.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.074+0000 7f4f42bf9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c0a4e00 con 0x7f4f3c09d630 2023-10-01T07:58:48.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.074+0000 7f4f42bf9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c0a0410 con 0x7f4f3c138d80 2023-10-01T07:58:48.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.074+0000 7f4f40995700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4f3c09d630 0x7f4f3c120800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:48.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.074+0000 7f4f40995700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4f3c09d630 0x7f4f3c120800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58914/0 (socket says 172.21.15.26:58914) 2023-10-01T07:58:48.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.074+0000 7f4f41196700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4f3c138d80 0x7f4f3c121280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:48.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.074+0000 7f4f40995700 1 -- 172.21.15.26:0/3050087940 learned_addr learned my addr 172.21.15.26:0/3050087940 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:48.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.075+0000 7f4f3bfff700 1 --2- 172.21.15.26:0/3050087940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f3c0a0a30 0x7f4f3c120d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:48.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.075+0000 7f4f40995700 1 -- 172.21.15.26:0/3050087940 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4f3c138d80 msgr2=0x7f4f3c121280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:48.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.075+0000 7f4f40995700 1 --2- 172.21.15.26:0/3050087940 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4f3c138d80 0x7f4f3c121280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:48.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.075+0000 7f4f40995700 1 -- 172.21.15.26:0/3050087940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f3c0a0a30 msgr2=0x7f4f3c120d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:48.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.075+0000 7f4f40995700 1 --2- 172.21.15.26:0/3050087940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f3c0a0a30 0x7f4f3c120d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:48.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.075+0000 7f4f40995700 1 -- 172.21.15.26:0/3050087940 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f34009a70 con 0x7f4f3c09d630 2023-10-01T07:58:48.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.075+0000 7f4f41196700 1 --2- 172.21.15.26:0/3050087940 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4f3c138d80 0x7f4f3c121280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:48.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.075+0000 7f4f3bfff700 1 --2- 172.21.15.26:0/3050087940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f3c0a0a30 0x7f4f3c120d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:58:48.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.075+0000 7f4f40995700 1 --2- 172.21.15.26:0/3050087940 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4f3c09d630 0x7f4f3c120800 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4f3000c4e0 tx=0x7f4f3000c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:48.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.076+0000 7f4f397fa700 1 -- 172.21.15.26:0/3050087940 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f300052d0 con 0x7f4f3c09d630 2023-10-01T07:58:48.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.076+0000 7f4f397fa700 1 -- 172.21.15.26:0/3050087940 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f30005430 con 0x7f4f3c09d630 2023-10-01T07:58:48.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.076+0000 7f4f397fa700 1 -- 172.21.15.26:0/3050087940 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f300038c0 con 0x7f4f3c09d630 2023-10-01T07:58:48.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.076+0000 7f4f42bf9700 1 -- 172.21.15.26:0/3050087940 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f28009550 con 0x7f4f3c09d630 2023-10-01T07:58:48.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.076+0000 7f4f42bf9700 1 -- 172.21.15.26:0/3050087940 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3c124a20 con 0x7f4f3c09d630 2023-10-01T07:58:48.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.077+0000 7f4f42bf9700 1 -- 172.21.15.26:0/3050087940 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f3c0747f0 con 0x7f4f3c09d630 2023-10-01T07:58:48.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.078+0000 7f4f397fa700 1 -- 172.21.15.26:0/3050087940 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4f30003a20 con 0x7f4f3c09d630 2023-10-01T07:58:48.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.078+0000 7f4f397fa700 1 -- 172.21.15.26:0/3050087940 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4f3003eb10 con 0x7f4f3c09d630 2023-10-01T07:58:48.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.087+0000 7f4f397fa700 1 -- 172.21.15.26:0/3050087940 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4f30018260 con 0x7f4f3c09d630 2023-10-01T07:58:48.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.147+0000 7f8e156d7700 1 -- 172.21.15.26:0/3401103586 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8e1006b9e0 con 0x7f8e1009a3b0 2023-10-01T07:58:48.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.147+0000 7f8df77fe700 1 -- 172.21.15.26:0/3401103586 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8e04017020 con 0x7f8e1009a3b0 2023-10-01T07:58:48.148 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:48.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.150+0000 7f8e156d7700 1 -- 172.21.15.26:0/3401103586 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e1009a3b0 msgr2=0x7f8e1011bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:48.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.150+0000 7f8e156d7700 1 --2- 172.21.15.26:0/3401103586 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e1009a3b0 0x7f8e1011bc90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8e0400e9b0 tx=0x7f8e0400ecc0 comp rx=0 tx=0).stop 2023-10-01T07:58:48.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.150+0000 7f8e156d7700 1 -- 172.21.15.26:0/3401103586 shutdown_connections 2023-10-01T07:58:48.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.150+0000 7f8e156d7700 1 --2- 172.21.15.26:0/3401103586 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e10131810 0x7f8e1011c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:48.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.150+0000 7f8e156d7700 1 --2- 172.21.15.26:0/3401103586 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e10099a40 0x7f8e1011b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:48.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.150+0000 7f8e156d7700 1 --2- 172.21.15.26:0/3401103586 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e1009a3b0 0x7f8e1011bc90 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:48.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.150+0000 7f8e156d7700 1 -- 172.21.15.26:0/3401103586 >> 172.21.15.26:0/3401103586 conn(0x7f8e100a2aa0 msgr2=0x7f8e101b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:48.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.150+0000 7f8e156d7700 1 -- 172.21.15.26:0/3401103586 shutdown_connections 2023-10-01T07:58:48.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.150+0000 7f8e156d7700 1 -- 172.21.15.26:0/3401103586 wait complete. 2023-10-01T07:58:48.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:48.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.188+0000 7faa2435c700 1 -- 172.21.15.26:0/3617424373 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faa1c074ea0 con 0x7faa1c09f650 2023-10-01T07:58:48.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.189+0000 7faa12ffd700 1 -- 172.21.15.26:0/3617424373 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faa14034020 con 0x7faa1c09f650 2023-10-01T07:58:48.189 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:48.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.191+0000 7faa2435c700 1 -- 172.21.15.26:0/3617424373 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa1c09f650 msgr2=0x7faa1c1a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:48.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.191+0000 7faa2435c700 1 --2- 172.21.15.26:0/3617424373 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa1c09f650 0x7faa1c1a46a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7faa1c072a80 tx=0x7faa14004ad0 comp rx=0 tx=0).stop 2023-10-01T07:58:48.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.191+0000 7faa2435c700 1 -- 172.21.15.26:0/3617424373 shutdown_connections 2023-10-01T07:58:48.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.191+0000 7faa2435c700 1 --2- 172.21.15.26:0/3617424373 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa1c09f650 0x7faa1c1a46a0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:48.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.191+0000 7faa2435c700 1 --2- 172.21.15.26:0/3617424373 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa1c09e930 0x7faa1c1a3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:48.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.191+0000 7faa2435c700 1 --2- 172.21.15.26:0/3617424373 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa1c09f240 0x7faa1c1a4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:48.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.191+0000 7faa2435c700 1 -- 172.21.15.26:0/3617424373 >> 172.21.15.26:0/3617424373 conn(0x7faa1c0a4210 msgr2=0x7faa1c1b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:48.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.192+0000 7faa2435c700 1 -- 172.21.15.26:0/3617424373 shutdown_connections 2023-10-01T07:58:48.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.192+0000 7faa2435c700 1 -- 172.21.15.26:0/3617424373 wait complete. 2023-10-01T07:58:48.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:48.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.266+0000 7f65d87a0700 1 -- 172.21.15.26:0/3746274035 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f65d00747f0 con 0x7f65d0138d80 2023-10-01T07:58:48.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.267+0000 7f65c6ffd700 1 -- 172.21.15.26:0/3746274035 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f65c802a020 con 0x7f65d0138d80 2023-10-01T07:58:48.267 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:48.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.269+0000 7f65d87a0700 1 -- 172.21.15.26:0/3746274035 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f65d0138d80 msgr2=0x7f65d01211b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:48.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.269+0000 7f65d87a0700 1 --2- 172.21.15.26:0/3746274035 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f65d0138d80 0x7f65d01211b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f65c800efb0 tx=0x7f65c800c3a0 comp rx=0 tx=0).stop 2023-10-01T07:58:48.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.269+0000 7f65d87a0700 1 -- 172.21.15.26:0/3746274035 shutdown_connections 2023-10-01T07:58:48.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.269+0000 7f65d87a0700 1 --2- 172.21.15.26:0/3746274035 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f65d0138d80 0x7f65d01211b0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:48.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.269+0000 7f65d87a0700 1 --2- 172.21.15.26:0/3746274035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65d009d630 0x7f65d0120730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:48.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.269+0000 7f65d87a0700 1 --2- 172.21.15.26:0/3746274035 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f65d00a0a30 0x7f65d0120c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:48.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.269+0000 7f65d87a0700 1 -- 172.21.15.26:0/3746274035 >> 172.21.15.26:0/3746274035 conn(0x7f65d00a3050 msgr2=0x7f65d0139150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:48.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.269+0000 7f65d87a0700 1 -- 172.21.15.26:0/3746274035 shutdown_connections 2023-10-01T07:58:48.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.269+0000 7f65d87a0700 1 -- 172.21.15.26:0/3746274035 wait complete. 2023-10-01T07:58:48.283 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:48.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.307+0000 7f4f42bf9700 1 -- 172.21.15.26:0/3050087940 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4f3c072980 con 0x7f4f3c09d630 2023-10-01T07:58:48.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.308+0000 7f4f397fa700 1 -- 172.21.15.26:0/3050087940 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4f30017030 con 0x7f4f3c09d630 2023-10-01T07:58:48.308 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:48.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.310+0000 7f4f42bf9700 1 -- 172.21.15.26:0/3050087940 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4f3c09d630 msgr2=0x7f4f3c120800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:48.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.310+0000 7f4f42bf9700 1 --2- 172.21.15.26:0/3050087940 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4f3c09d630 0x7f4f3c120800 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4f3000c4e0 tx=0x7f4f3000c7f0 comp rx=0 tx=0).stop 2023-10-01T07:58:48.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.310+0000 7f4f42bf9700 1 -- 172.21.15.26:0/3050087940 shutdown_connections 2023-10-01T07:58:48.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.310+0000 7f4f42bf9700 1 --2- 172.21.15.26:0/3050087940 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4f3c138d80 0x7f4f3c121280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:48.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.310+0000 7f4f42bf9700 1 --2- 172.21.15.26:0/3050087940 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4f3c09d630 0x7f4f3c120800 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:48.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.310+0000 7f4f42bf9700 1 --2- 172.21.15.26:0/3050087940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f3c0a0a30 0x7f4f3c120d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:48.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.310+0000 7f4f42bf9700 1 -- 172.21.15.26:0/3050087940 >> 172.21.15.26:0/3050087940 conn(0x7f4f3c0a3050 msgr2=0x7f4f3c09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:48.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.310+0000 7f4f42bf9700 1 -- 172.21.15.26:0/3050087940 shutdown_connections 2023-10-01T07:58:48.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:48.310+0000 7f4f42bf9700 1 -- 172.21.15.26:0/3050087940 wait complete. 2023-10-01T07:58:48.324 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:49.166 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:49.208 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:49.284 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:49.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.315+0000 7f5dae026700 1 Processor -- start 2023-10-01T07:58:49.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.316+0000 7f5dae026700 1 -- start start 2023-10-01T07:58:49.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.316+0000 7f5dae026700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5da8133420 0x7f5da81337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:49.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.316+0000 7f5dae026700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5da8134260 0x7f5da81306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:49.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.316+0000 7f5dae026700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5da806b990 con 0x7f5da8133e30 2023-10-01T07:58:49.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.316+0000 7f5dae026700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da80a0590 con 0x7f5da8134260 2023-10-01T07:58:49.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.316+0000 7f5dae026700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da809fb80 con 0x7f5da8133420 2023-10-01T07:58:49.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.316+0000 7f5da77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5da8133420 0x7f5da81337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:49.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.316+0000 7f5da7fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5da8134260 0x7f5da81306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:49.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.316+0000 7f5da7fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5da8134260 0x7f5da81306a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50596/0 (socket says 172.21.15.26:50596) 2023-10-01T07:58:49.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.316+0000 7f5da77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5da8133420 0x7f5da81337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58926/0 (socket says 172.21.15.26:58926) 2023-10-01T07:58:49.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.316+0000 7f5da7fff700 1 -- 172.21.15.26:0/3893429839 learned_addr learned my addr 172.21.15.26:0/3893429839 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:49.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.317+0000 7f5da7fff700 1 -- 172.21.15.26:0/3893429839 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5da8133420 msgr2=0x7f5da81337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:49.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.317+0000 7f5da7fff700 1 --2- 172.21.15.26:0/3893429839 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5da8133420 0x7f5da81337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.317+0000 7f5da7fff700 1 -- 172.21.15.26:0/3893429839 >> v1:172.21.15.26:6789/0 conn(0x7f5da8133e30 legacy=0x7f5da812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:49.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.317+0000 7f5da7fff700 1 -- 172.21.15.26:0/3893429839 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da80a0030 con 0x7f5da8134260 2023-10-01T07:58:49.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.317+0000 7f5da77fe700 1 --2- 172.21.15.26:0/3893429839 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5da8133420 0x7f5da81337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:49.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.317+0000 7f5da7fff700 1 --2- 172.21.15.26:0/3893429839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5da8134260 0x7f5da81306a0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f5da0009e50 tx=0x7f5da000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c938cd2c3b6c319c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:49.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.317+0000 7f5da67fc700 1 -- 172.21.15.26:0/3893429839 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da000e070 con 0x7f5da8134260 2023-10-01T07:58:49.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.317+0000 7f5da67fc700 1 -- 172.21.15.26:0/3893429839 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da000b910 con 0x7f5da8134260 2023-10-01T07:58:49.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.317+0000 7f5da67fc700 1 -- 172.21.15.26:0/3893429839 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da000bcc0 con 0x7f5da8134260 2023-10-01T07:58:49.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.318+0000 7f5dae026700 1 -- 172.21.15.26:0/3893429839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5da8134260 msgr2=0x7f5da81306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:49.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.318+0000 7f5dae026700 1 --2- 172.21.15.26:0/3893429839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5da8134260 0x7f5da81306a0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f5da0009e50 tx=0x7f5da000b330 comp rx=0 tx=0).stop 2023-10-01T07:58:49.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.318+0000 7f5dae026700 1 -- 172.21.15.26:0/3893429839 shutdown_connections 2023-10-01T07:58:49.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.318+0000 7f5dae026700 1 --2- 172.21.15.26:0/3893429839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5da8134260 0x7f5da81306a0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.318+0000 7f5dae026700 1 --2- 172.21.15.26:0/3893429839 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5da8133420 0x7f5da81337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.318+0000 7f5dae026700 1 -- 172.21.15.26:0/3893429839 >> 172.21.15.26:0/3893429839 conn(0x7f5da80a4210 msgr2=0x7f5da80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:49.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.318+0000 7f5dae026700 1 -- 172.21.15.26:0/3893429839 shutdown_connections 2023-10-01T07:58:49.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.318+0000 7f5dae026700 1 -- 172.21.15.26:0/3893429839 wait complete. 2023-10-01T07:58:49.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.319+0000 7f5dae026700 1 Processor -- start 2023-10-01T07:58:49.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.319+0000 7f5dae026700 1 -- start start 2023-10-01T07:58:49.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.320+0000 7f5dae026700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5da8133420 0x7f5da809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:49.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.320+0000 7f5dae026700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5da8133e30 0x7f5da809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:49.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.320+0000 7f5dae026700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5da8134260 0x7f5da809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:49.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.320+0000 7f5dae026700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da81202f0 con 0x7f5da8133420 2023-10-01T07:58:49.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.320+0000 7f5dae026700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da812da20 con 0x7f5da8134260 2023-10-01T07:58:49.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.320+0000 7f5dae026700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5da811ff20 con 0x7f5da8133e30 2023-10-01T07:58:49.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.320+0000 7f5da6ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5da8133e30 0x7f5da809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:49.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.320+0000 7f5da6ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5da8133e30 0x7f5da809c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:52662/0 (socket says 172.21.15.26:52662) 2023-10-01T07:58:49.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.320+0000 7f5da6ffd700 1 -- 172.21.15.26:0/1304105654 learned_addr learned my addr 172.21.15.26:0/1304105654 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:49.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.320+0000 7f5da7fff700 1 --2- 172.21.15.26:0/1304105654 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5da8134260 0x7f5da809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:49.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.320+0000 7f5da77fe700 1 --2- 172.21.15.26:0/1304105654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5da8133420 0x7f5da809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:49.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.320+0000 7f5da7fff700 1 -- 172.21.15.26:0/1304105654 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5da8133e30 msgr2=0x7f5da809c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:49.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.321+0000 7f5da7fff700 1 --2- 172.21.15.26:0/1304105654 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5da8133e30 0x7f5da809c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.321+0000 7f5da7fff700 1 -- 172.21.15.26:0/1304105654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5da8133420 msgr2=0x7f5da809c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:49.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.321+0000 7f5da7fff700 1 --2- 172.21.15.26:0/1304105654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5da8133420 0x7f5da809c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.321+0000 7f5da7fff700 1 -- 172.21.15.26:0/1304105654 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d980094a0 con 0x7f5da8134260 2023-10-01T07:58:49.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.321+0000 7f5da6ffd700 1 --2- 172.21.15.26:0/1304105654 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5da8133e30 0x7f5da809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:49.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.321+0000 7f5da7fff700 1 --2- 172.21.15.26:0/1304105654 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5da8134260 0x7f5da809cf00 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5da0015000 tx=0x7f5da0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:49.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.321+0000 7f5d8ffff700 1 -- 172.21.15.26:0/1304105654 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da0004570 con 0x7f5da8134260 2023-10-01T07:58:49.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.321+0000 7f5d8ffff700 1 -- 172.21.15.26:0/1304105654 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da00092e0 con 0x7f5da8134260 2023-10-01T07:58:49.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.321+0000 7f5d8ffff700 1 -- 172.21.15.26:0/1304105654 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da0004910 con 0x7f5da8134260 2023-10-01T07:58:49.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.321+0000 7f5dae026700 1 -- 172.21.15.26:0/1304105654 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da0009b30 con 0x7f5da8134260 2023-10-01T07:58:49.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.321+0000 7f5dae026700 1 -- 172.21.15.26:0/1304105654 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5da811fbd0 con 0x7f5da8134260 2023-10-01T07:58:49.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.322+0000 7f5d8ffff700 1 -- 172.21.15.26:0/1304105654 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5da001c410 con 0x7f5da8134260 2023-10-01T07:58:49.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.323+0000 7f5d8ffff700 1 -- 172.21.15.26:0/1304105654 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5da0040cf0 con 0x7f5da8134260 2023-10-01T07:58:49.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.323+0000 7f5dae026700 1 -- 172.21.15.26:0/1304105654 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5da8074ea0 con 0x7f5da8134260 2023-10-01T07:58:49.328 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:49.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.332+0000 7f5d8ffff700 1 -- 172.21.15.26:0/1304105654 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5da0029020 con 0x7f5da8134260 2023-10-01T07:58:49.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.363+0000 7fda8e546700 1 Processor -- start 2023-10-01T07:58:49.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.363+0000 7fda8e546700 1 -- start start 2023-10-01T07:58:49.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.364+0000 7fda8e546700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fda88133540 0x7fda88135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:49.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.364+0000 7fda8e546700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fda88135e60 0x7fda88138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:49.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.364+0000 7fda8e546700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda880716a0 con 0x7fda88130540 2023-10-01T07:58:49.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.364+0000 7fda8e546700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda88071290 con 0x7fda88135e60 2023-10-01T07:58:49.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.364+0000 7fda8e546700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda88130340 con 0x7fda88133540 2023-10-01T07:58:49.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.364+0000 7fda87fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fda88130540 0x7fda88130910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:55916/0 (socket says 172.21.15.26:55916) 2023-10-01T07:58:49.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.364+0000 7fda87fff700 1 -- 172.21.15.26:0/3804926972 learned_addr learned my addr 172.21.15.26:0/3804926972 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:49.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.364+0000 7fda877fe700 1 --2- 172.21.15.26:0/3804926972 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fda88133540 0x7fda88135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:49.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.364+0000 7fda8cae3700 1 --2- 172.21.15.26:0/3804926972 >> v2:172.21.15.26:3300/0 conn(0x7fda88135e60 0x7fda88138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:49.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.365+0000 7fda8cae3700 1 -- 172.21.15.26:0/3804926972 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fda88133540 msgr2=0x7fda88135920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:49.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.365+0000 7fda8cae3700 1 --2- 172.21.15.26:0/3804926972 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fda88133540 0x7fda88135920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.365+0000 7fda8cae3700 1 -- 172.21.15.26:0/3804926972 >> v1:172.21.15.26:6789/0 conn(0x7fda88130540 legacy=0x7fda88130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:49.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.365+0000 7fda8cae3700 1 -- 172.21.15.26:0/3804926972 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda88070b80 con 0x7fda88135e60 2023-10-01T07:58:49.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.365+0000 7fda86ffd700 1 -- 172.21.15.26:0/3804926972 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1648262420 0 0) 0x7fda880716a0 con 0x7fda88130540 2023-10-01T07:58:49.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.365+0000 7fda8cae3700 1 --2- 172.21.15.26:0/3804926972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda88135e60 0x7fda88138240 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fda80009d90 tx=0x7fda8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=360b71e7fa995fcc server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:49.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.365+0000 7fda86ffd700 1 -- 172.21.15.26:0/3804926972 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8000e070 con 0x7fda88135e60 2023-10-01T07:58:49.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.365+0000 7fda86ffd700 1 -- 172.21.15.26:0/3804926972 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8000bb20 con 0x7fda88135e60 2023-10-01T07:58:49.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.365+0000 7fda86ffd700 1 -- 172.21.15.26:0/3804926972 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda80012430 con 0x7fda88135e60 2023-10-01T07:58:49.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.366+0000 7fda8e546700 1 -- 172.21.15.26:0/3804926972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda88135e60 msgr2=0x7fda88138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:49.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.366+0000 7fda8e546700 1 --2- 172.21.15.26:0/3804926972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda88135e60 0x7fda88138240 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fda80009d90 tx=0x7fda8000b330 comp rx=0 tx=0).stop 2023-10-01T07:58:49.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.366+0000 7fda8e546700 1 -- 172.21.15.26:0/3804926972 shutdown_connections 2023-10-01T07:58:49.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.366+0000 7fda8e546700 1 --2- 172.21.15.26:0/3804926972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda88135e60 0x7fda88138240 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.366+0000 7fda8e546700 1 --2- 172.21.15.26:0/3804926972 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fda88133540 0x7fda88135920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.366+0000 7fda8e546700 1 -- 172.21.15.26:0/3804926972 >> 172.21.15.26:0/3804926972 conn(0x7fda880a2aa0 msgr2=0x7fda880a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:49.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.366+0000 7fda8e546700 1 -- 172.21.15.26:0/3804926972 shutdown_connections 2023-10-01T07:58:49.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.366+0000 7fda8e546700 1 -- 172.21.15.26:0/3804926972 wait complete. 2023-10-01T07:58:49.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.368+0000 7fda8e546700 1 Processor -- start 2023-10-01T07:58:49.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.368+0000 7fda8e546700 1 -- start start 2023-10-01T07:58:49.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.369+0000 7fda8e546700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda88130540 0x7fda8809c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:49.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.369+0000 7fda8e546700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fda88133540 0x7fda8809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:49.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.369+0000 7fda8e546700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fda88135e60 0x7fda8809d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:49.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.369+0000 7fda8e546700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda88119160 con 0x7fda88130540 2023-10-01T07:58:49.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.369+0000 7fda8e546700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda88119bf0 con 0x7fda88133540 2023-10-01T07:58:49.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.369+0000 7fda8e546700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda88135930 con 0x7fda88135e60 2023-10-01T07:58:49.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.369+0000 7fda877fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fda88133540 0x7fda8809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:49.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.369+0000 7fda877fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fda88133540 0x7fda8809cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58962/0 (socket says 172.21.15.26:58962) 2023-10-01T07:58:49.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.369+0000 7fda877fe700 1 -- 172.21.15.26:0/681600392 learned_addr learned my addr 172.21.15.26:0/681600392 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:49.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.369+0000 7fda87fff700 1 --2- 172.21.15.26:0/681600392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda88130540 0x7fda8809c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:49.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.369+0000 7fda8cae3700 1 --2- 172.21.15.26:0/681600392 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fda88135e60 0x7fda8809d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:49.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.370+0000 7fda877fe700 1 -- 172.21.15.26:0/681600392 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fda88135e60 msgr2=0x7fda8809d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:49.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.370+0000 7fda877fe700 1 --2- 172.21.15.26:0/681600392 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fda88135e60 0x7fda8809d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.370+0000 7fda877fe700 1 -- 172.21.15.26:0/681600392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda88130540 msgr2=0x7fda8809c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:49.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.370+0000 7fda877fe700 1 --2- 172.21.15.26:0/681600392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda88130540 0x7fda8809c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.370+0000 7fda877fe700 1 -- 172.21.15.26:0/681600392 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda80009a70 con 0x7fda88133540 2023-10-01T07:58:49.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.370+0000 7fda87fff700 1 --2- 172.21.15.26:0/681600392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda88130540 0x7fda8809c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:58:49.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.370+0000 7fda877fe700 1 --2- 172.21.15.26:0/681600392 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fda88133540 0x7fda8809cc60 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fda7c00e9e0 tx=0x7fda7c00ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:49.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.370+0000 7fda84ff9700 1 -- 172.21.15.26:0/681600392 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c009710 con 0x7fda88133540 2023-10-01T07:58:49.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.370+0000 7fda84ff9700 1 -- 172.21.15.26:0/681600392 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7c00c850 con 0x7fda88133540 2023-10-01T07:58:49.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.370+0000 7fda8e546700 1 -- 172.21.15.26:0/681600392 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda880718e0 con 0x7fda88133540 2023-10-01T07:58:49.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.370+0000 7fda84ff9700 1 -- 172.21.15.26:0/681600392 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c00cbc0 con 0x7fda88133540 2023-10-01T07:58:49.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.370+0000 7fda8e546700 1 -- 172.21.15.26:0/681600392 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda8811afd0 con 0x7fda88133540 2023-10-01T07:58:49.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.371+0000 7fda84ff9700 1 -- 172.21.15.26:0/681600392 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fda7c00cd20 con 0x7fda88133540 2023-10-01T07:58:49.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.371+0000 7fda84ff9700 1 -- 172.21.15.26:0/681600392 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fda7c03fc90 con 0x7fda88133540 2023-10-01T07:58:49.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.372+0000 7fda8e546700 1 -- 172.21.15.26:0/681600392 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda880a1df0 con 0x7fda88133540 2023-10-01T07:58:49.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.376+0000 7fda84ff9700 1 -- 172.21.15.26:0/681600392 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fda7c017020 con 0x7fda88133540 2023-10-01T07:58:49.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.441+0000 7fcd6d687700 1 Processor -- start 2023-10-01T07:58:49.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.441+0000 7fcd6d687700 1 -- start start 2023-10-01T07:58:49.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.441+0000 7fcd6d687700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd6809d6f0 0x7fcd6809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:49.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.441+0000 7fcd6d687700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcd6809e000 0x7fcd681339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:49.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.441+0000 7fcd6d687700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd6809d2f0 con 0x7fcd68133f30 2023-10-01T07:58:49.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.441+0000 7fcd6d687700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6809a810 con 0x7fcd6809e000 2023-10-01T07:58:49.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.441+0000 7fcd6d687700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6809a470 con 0x7fcd6809d6f0 2023-10-01T07:58:49.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.442+0000 7fcd66ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd6809d6f0 0x7fcd6809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:49.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.442+0000 7fcd66ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd6809d6f0 0x7fcd6809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:52674/0 (socket says 172.21.15.26:52674) 2023-10-01T07:58:49.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.442+0000 7fcd66ffd700 1 -- 172.21.15.26:0/973703102 learned_addr learned my addr 172.21.15.26:0/973703102 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:49.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.442+0000 7fcd667fc700 1 --2- 172.21.15.26:0/973703102 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcd6809e000 0x7fcd681339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:49.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.442+0000 7fcd667fc700 1 -- 172.21.15.26:0/973703102 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd6809d6f0 msgr2=0x7fcd6809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:49.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.442+0000 7fcd667fc700 1 --2- 172.21.15.26:0/973703102 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd6809d6f0 0x7fcd6809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.442+0000 7fcd667fc700 1 -- 172.21.15.26:0/973703102 >> v1:172.21.15.26:6789/0 conn(0x7fcd68133f30 legacy=0x7fcd6813ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:49.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.442+0000 7fcd65ffb700 1 -- 172.21.15.26:0/973703102 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 419105359 0 0) 0x7fcd6809d2f0 con 0x7fcd68133f30 2023-10-01T07:58:49.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.442+0000 7fcd667fc700 1 -- 172.21.15.26:0/973703102 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6809ec40 con 0x7fcd6809e000 2023-10-01T07:58:49.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.442+0000 7fcd667fc700 1 --2- 172.21.15.26:0/973703102 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcd6809e000 0x7fcd681339f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c009870 tx=0x7fcd5c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f88006005817ceae server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:49.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.442+0000 7fcd65ffb700 1 -- 172.21.15.26:0/973703102 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c011830 con 0x7fcd6809e000 2023-10-01T07:58:49.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.443+0000 7fcd65ffb700 1 -- 172.21.15.26:0/973703102 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5c011990 con 0x7fcd6809e000 2023-10-01T07:58:49.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.443+0000 7fcd65ffb700 1 -- 172.21.15.26:0/973703102 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c011d20 con 0x7fcd6809e000 2023-10-01T07:58:49.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.443+0000 7fcd6d687700 1 -- 172.21.15.26:0/973703102 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcd6809e000 msgr2=0x7fcd681339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:49.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.443+0000 7fcd6d687700 1 --2- 172.21.15.26:0/973703102 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcd6809e000 0x7fcd681339f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c009870 tx=0x7fcd5c009b80 comp rx=0 tx=0).stop 2023-10-01T07:58:49.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.443+0000 7fcd6d687700 1 -- 172.21.15.26:0/973703102 shutdown_connections 2023-10-01T07:58:49.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.443+0000 7fcd6d687700 1 --2- 172.21.15.26:0/973703102 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd6809d6f0 0x7fcd6809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.443+0000 7fcd6d687700 1 --2- 172.21.15.26:0/973703102 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcd6809e000 0x7fcd681339f0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.443+0000 7fcd6d687700 1 -- 172.21.15.26:0/973703102 >> 172.21.15.26:0/973703102 conn(0x7fcd68066f50 msgr2=0x7fcd6809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:49.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.443+0000 7fcd6d687700 1 -- 172.21.15.26:0/973703102 shutdown_connections 2023-10-01T07:58:49.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.443+0000 7fcd6d687700 1 -- 172.21.15.26:0/973703102 wait complete. 2023-10-01T07:58:49.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.445+0000 7fcd6d687700 1 Processor -- start 2023-10-01T07:58:49.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.445+0000 7fcd6d687700 1 -- start start 2023-10-01T07:58:49.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.445+0000 7fcd6d687700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd6809d6f0 0x7fcd68122700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:49.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.445+0000 7fcd6d687700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd6809e000 0x7fcd68122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:49.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.445+0000 7fcd6d687700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcd68133f30 0x7fcd68123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:49.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.446+0000 7fcd6d687700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd68125a40 con 0x7fcd6809e000 2023-10-01T07:58:49.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.446+0000 7fcd6d687700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd68125c30 con 0x7fcd68133f30 2023-10-01T07:58:49.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.446+0000 7fcd6d687700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd68133670 con 0x7fcd6809d6f0 2023-10-01T07:58:49.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.446+0000 7fcd66ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd6809d6f0 0x7fcd68122700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:49.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.446+0000 7fcd66ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd6809d6f0 0x7fcd68122700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:52680/0 (socket says 172.21.15.26:52680) 2023-10-01T07:58:49.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.446+0000 7fcd66ffd700 1 -- 172.21.15.26:0/2906421512 learned_addr learned my addr 172.21.15.26:0/2906421512 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:49.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.446+0000 7fcd677fe700 1 --2- 172.21.15.26:0/2906421512 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcd68133f30 0x7fcd68123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:49.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.446+0000 7fcd66ffd700 1 -- 172.21.15.26:0/2906421512 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcd68133f30 msgr2=0x7fcd68123180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:49.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.446+0000 7fcd66ffd700 1 --2- 172.21.15.26:0/2906421512 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcd68133f30 0x7fcd68123180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.446+0000 7fcd66ffd700 1 -- 172.21.15.26:0/2906421512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd6809e000 msgr2=0x7fcd68122c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:49.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.446+0000 7fcd66ffd700 1 --2- 172.21.15.26:0/2906421512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd6809e000 0x7fcd68122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.446+0000 7fcd66ffd700 1 -- 172.21.15.26:0/2906421512 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd5c0094a0 con 0x7fcd6809d6f0 2023-10-01T07:58:49.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.446+0000 7fcd66ffd700 1 --2- 172.21.15.26:0/2906421512 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd6809d6f0 0x7fcd68122700 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fcd5800e8b0 tx=0x7fcd5800ebc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:49.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.447+0000 7fcd4f7fe700 1 -- 172.21.15.26:0/2906421512 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd58009600 con 0x7fcd6809d6f0 2023-10-01T07:58:49.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.447+0000 7fcd4f7fe700 1 -- 172.21.15.26:0/2906421512 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd58013680 con 0x7fcd6809d6f0 2023-10-01T07:58:49.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.447+0000 7fcd6d687700 1 -- 172.21.15.26:0/2906421512 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd681339b0 con 0x7fcd6809d6f0 2023-10-01T07:58:49.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.447+0000 7fcd6d687700 1 -- 172.21.15.26:0/2906421512 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd68125ef0 con 0x7fcd6809d6f0 2023-10-01T07:58:49.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.447+0000 7fcd4f7fe700 1 -- 172.21.15.26:0/2906421512 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd58013a30 con 0x7fcd6809d6f0 2023-10-01T07:58:49.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.448+0000 7fcd4f7fe700 1 -- 172.21.15.26:0/2906421512 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcd58013b90 con 0x7fcd6809d6f0 2023-10-01T07:58:49.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.448+0000 7fcd6d687700 1 -- 172.21.15.26:0/2906421512 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd480052e0 con 0x7fcd6809d6f0 2023-10-01T07:58:49.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.448+0000 7fcd4f7fe700 1 -- 172.21.15.26:0/2906421512 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcd5801be60 con 0x7fcd6809d6f0 2023-10-01T07:58:49.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.458+0000 7fcd4f7fe700 1 -- 172.21.15.26:0/2906421512 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcd58017070 con 0x7fcd6809d6f0 2023-10-01T07:58:49.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.482+0000 7f2cf8f23700 1 Processor -- start 2023-10-01T07:58:49.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.482+0000 7f2cf8f23700 1 -- start start 2023-10-01T07:58:49.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.483+0000 7f2cf8f23700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2cf409d6f0 0x7f2cf409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:49.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.483+0000 7f2cf8f23700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2cf409e000 0x7f2cf41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:49.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.483+0000 7f2cf8f23700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cf409b120 con 0x7f2cf409e410 2023-10-01T07:58:49.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.483+0000 7f2cf8f23700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf406b460 con 0x7f2cf409d6f0 2023-10-01T07:58:49.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.483+0000 7f2cf8f23700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf409a7e0 con 0x7f2cf409e000 2023-10-01T07:58:49.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.483+0000 7f2cf1d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2cf409e000 0x7f2cf41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:49.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.483+0000 7f2cf1d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2cf409e000 0x7f2cf41339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:52686/0 (socket says 172.21.15.26:52686) 2023-10-01T07:58:49.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.483+0000 7f2cf1d9b700 1 -- 172.21.15.26:0/1463566033 learned_addr learned my addr 172.21.15.26:0/1463566033 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:49.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.483+0000 7f2cf259c700 1 --2- 172.21.15.26:0/1463566033 >> v2:172.21.15.26:3300/0 conn(0x7f2cf409d6f0 0x7f2cf409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:49.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.483+0000 7f2cf1d9b700 1 -- 172.21.15.26:0/1463566033 >> v2:172.21.15.26:3300/0 conn(0x7f2cf409d6f0 msgr2=0x7f2cf409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:49.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.483+0000 7f2cf1d9b700 1 --2- 172.21.15.26:0/1463566033 >> v2:172.21.15.26:3300/0 conn(0x7f2cf409d6f0 0x7f2cf409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.483+0000 7f2cf1d9b700 1 -- 172.21.15.26:0/1463566033 >> v1:172.21.15.26:6789/0 conn(0x7f2cf409e410 legacy=0x7f2cf4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:49.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.483+0000 7f2cf1d9b700 1 -- 172.21.15.26:0/1463566033 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf409a500 con 0x7f2cf409e000 2023-10-01T07:58:49.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.484+0000 7f2cf1d9b700 1 --2- 172.21.15.26:0/1463566033 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2cf409e000 0x7f2cf41339f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8009920 tx=0x7f2ce8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb1f2eef0c0aab37 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:49.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.484+0000 7f2cf159a700 1 -- 172.21.15.26:0/1463566033 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce8011830 con 0x7f2cf409e000 2023-10-01T07:58:49.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.484+0000 7f2cf159a700 1 -- 172.21.15.26:0/1463566033 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce8011990 con 0x7f2cf409e000 2023-10-01T07:58:49.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.484+0000 7f2cf159a700 1 -- 172.21.15.26:0/1463566033 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce8011d20 con 0x7f2cf409e000 2023-10-01T07:58:49.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.485+0000 7f2cf8f23700 1 -- 172.21.15.26:0/1463566033 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2cf409e000 msgr2=0x7f2cf41339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:49.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.485+0000 7f2cf8f23700 1 --2- 172.21.15.26:0/1463566033 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2cf409e000 0x7f2cf41339f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8009920 tx=0x7f2ce8009c30 comp rx=0 tx=0).stop 2023-10-01T07:58:49.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.485+0000 7f2cf8f23700 1 -- 172.21.15.26:0/1463566033 shutdown_connections 2023-10-01T07:58:49.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.485+0000 7f2cf8f23700 1 --2- 172.21.15.26:0/1463566033 >> v2:172.21.15.26:3300/0 conn(0x7f2cf409d6f0 0x7f2cf409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.485+0000 7f2cf8f23700 1 --2- 172.21.15.26:0/1463566033 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2cf409e000 0x7f2cf41339f0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.485+0000 7f2cf8f23700 1 -- 172.21.15.26:0/1463566033 >> 172.21.15.26:0/1463566033 conn(0x7f2cf4066f50 msgr2=0x7f2cf409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:49.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.485+0000 7f2cf8f23700 1 -- 172.21.15.26:0/1463566033 shutdown_connections 2023-10-01T07:58:49.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.485+0000 7f2cf8f23700 1 -- 172.21.15.26:0/1463566033 wait complete. 2023-10-01T07:58:49.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.487+0000 7f2cf8f23700 1 Processor -- start 2023-10-01T07:58:49.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.487+0000 7f2cf8f23700 1 -- start start 2023-10-01T07:58:49.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.487+0000 7f2cf8f23700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2cf409d6f0 0x7f2cf41a4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:49.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.487+0000 7f2cf8f23700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cf409e000 0x7f2cf41a54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:49.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.487+0000 7f2cf8f23700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2cf409e410 0x7f2cf41a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:49.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.488+0000 7f2cf8f23700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf41a87a0 con 0x7f2cf409e000 2023-10-01T07:58:49.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.488+0000 7f2cf8f23700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf40a3240 con 0x7f2cf409d6f0 2023-10-01T07:58:49.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.488+0000 7f2cf8f23700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf409c710 con 0x7f2cf409e410 2023-10-01T07:58:49.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.488+0000 7f2cf259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2cf409d6f0 0x7f2cf41a4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:49.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.488+0000 7f2cf259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2cf409d6f0 0x7f2cf41a4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:58998/0 (socket says 172.21.15.26:58998) 2023-10-01T07:58:49.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.488+0000 7f2cf259c700 1 -- 172.21.15.26:0/205734183 learned_addr learned my addr 172.21.15.26:0/205734183 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:49.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.488+0000 7f2cf2d9d700 1 --2- 172.21.15.26:0/205734183 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2cf409e410 0x7f2cf41a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:49.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.488+0000 7f2cf1d9b700 1 --2- 172.21.15.26:0/205734183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cf409e000 0x7f2cf41a54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:49.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.488+0000 7f2cf2d9d700 1 -- 172.21.15.26:0/205734183 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2cf409d6f0 msgr2=0x7f2cf41a4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:49.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.488+0000 7f2cf2d9d700 1 --2- 172.21.15.26:0/205734183 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2cf409d6f0 0x7f2cf41a4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.488+0000 7f2cf2d9d700 1 -- 172.21.15.26:0/205734183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cf409e000 msgr2=0x7f2cf41a54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:49.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.488+0000 7f2cf2d9d700 1 --2- 172.21.15.26:0/205734183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cf409e000 0x7f2cf41a54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.488+0000 7f2cf2d9d700 1 -- 172.21.15.26:0/205734183 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce8009550 con 0x7f2cf409e410 2023-10-01T07:58:49.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.488+0000 7f2cf2d9d700 1 --2- 172.21.15.26:0/205734183 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2cf409e410 0x7f2cf41a5a20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2cec00cbc0 tx=0x7f2cec00ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:49.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.489+0000 7f2ce2ffd700 1 -- 172.21.15.26:0/205734183 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cec003c00 con 0x7f2cf409e410 2023-10-01T07:58:49.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.489+0000 7f2ce2ffd700 1 -- 172.21.15.26:0/205734183 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cec003d60 con 0x7f2cf409e410 2023-10-01T07:58:49.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.489+0000 7f2cf8f23700 1 -- 172.21.15.26:0/205734183 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf41a6390 con 0x7f2cf409e410 2023-10-01T07:58:49.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.489+0000 7f2ce2ffd700 1 -- 172.21.15.26:0/205734183 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cec00aa20 con 0x7f2cf409e410 2023-10-01T07:58:49.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.489+0000 7f2cf8f23700 1 -- 172.21.15.26:0/205734183 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf41a7dc0 con 0x7f2cf409e410 2023-10-01T07:58:49.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.490+0000 7f2cf8f23700 1 -- 172.21.15.26:0/205734183 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cf4074ea0 con 0x7f2cf409e410 2023-10-01T07:58:49.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.491+0000 7f2ce2ffd700 1 -- 172.21.15.26:0/205734183 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2cec00ab80 con 0x7f2cf409e410 2023-10-01T07:58:49.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.491+0000 7f2ce2ffd700 1 -- 172.21.15.26:0/205734183 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2cec040120 con 0x7f2cf409e410 2023-10-01T07:58:49.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.500+0000 7f2ce2ffd700 1 -- 172.21.15.26:0/205734183 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2cec00ae30 con 0x7f2cf409e410 2023-10-01T07:58:49.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.590+0000 7f5dae026700 1 -- 172.21.15.26:0/1304105654 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5da811f4b0 con 0x7f5da8134260 2023-10-01T07:58:49.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.591+0000 7f5d8ffff700 1 -- 172.21.15.26:0/1304105654 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5da00123f0 con 0x7f5da8134260 2023-10-01T07:58:49.592 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:49.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.593+0000 7f5dae026700 1 -- 172.21.15.26:0/1304105654 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5da8134260 msgr2=0x7f5da809cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:49.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.593+0000 7f5dae026700 1 --2- 172.21.15.26:0/1304105654 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5da8134260 0x7f5da809cf00 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5da0015000 tx=0x7f5da0004ad0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.593+0000 7f5dae026700 1 -- 172.21.15.26:0/1304105654 shutdown_connections 2023-10-01T07:58:49.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.593+0000 7f5dae026700 1 --2- 172.21.15.26:0/1304105654 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5da8134260 0x7f5da809cf00 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.593+0000 7f5dae026700 1 --2- 172.21.15.26:0/1304105654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5da8133420 0x7f5da809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.593+0000 7f5dae026700 1 --2- 172.21.15.26:0/1304105654 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5da8133e30 0x7f5da809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.593+0000 7f5dae026700 1 -- 172.21.15.26:0/1304105654 >> 172.21.15.26:0/1304105654 conn(0x7f5da80a4210 msgr2=0x7f5da80a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:49.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.593+0000 7f5dae026700 1 -- 172.21.15.26:0/1304105654 shutdown_connections 2023-10-01T07:58:49.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.593+0000 7f5dae026700 1 -- 172.21.15.26:0/1304105654 wait complete. 2023-10-01T07:58:49.608 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:49.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.635+0000 7fda8e546700 1 -- 172.21.15.26:0/681600392 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fda88074ea0 con 0x7fda88133540 2023-10-01T07:58:49.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.635+0000 7fda84ff9700 1 -- 172.21.15.26:0/681600392 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fda7c02b090 con 0x7fda88133540 2023-10-01T07:58:49.636 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:49.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.638+0000 7fda8e546700 1 -- 172.21.15.26:0/681600392 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fda88133540 msgr2=0x7fda8809cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:49.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.638+0000 7fda8e546700 1 --2- 172.21.15.26:0/681600392 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fda88133540 0x7fda8809cc60 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fda7c00e9e0 tx=0x7fda7c00ecf0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.638+0000 7fda8e546700 1 -- 172.21.15.26:0/681600392 shutdown_connections 2023-10-01T07:58:49.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.638+0000 7fda8e546700 1 --2- 172.21.15.26:0/681600392 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fda88135e60 0x7fda8809d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.638+0000 7fda8e546700 1 --2- 172.21.15.26:0/681600392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda88130540 0x7fda8809c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.638+0000 7fda8e546700 1 --2- 172.21.15.26:0/681600392 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fda88133540 0x7fda8809cc60 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.638+0000 7fda8e546700 1 -- 172.21.15.26:0/681600392 >> 172.21.15.26:0/681600392 conn(0x7fda880a2aa0 msgr2=0x7fda88133cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:49.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.638+0000 7fda8e546700 1 -- 172.21.15.26:0/681600392 shutdown_connections 2023-10-01T07:58:49.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.638+0000 7fda8e546700 1 -- 172.21.15.26:0/681600392 wait complete. 2023-10-01T07:58:49.652 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:49.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.670+0000 7fcd6d687700 1 -- 172.21.15.26:0/2906421512 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcd48005590 con 0x7fcd6809d6f0 2023-10-01T07:58:49.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.671+0000 7fcd4f7fe700 1 -- 172.21.15.26:0/2906421512 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcd58017030 con 0x7fcd6809d6f0 2023-10-01T07:58:49.672 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:49.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.673+0000 7fcd6d687700 1 -- 172.21.15.26:0/2906421512 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd6809d6f0 msgr2=0x7fcd68122700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:49.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.673+0000 7fcd6d687700 1 --2- 172.21.15.26:0/2906421512 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd6809d6f0 0x7fcd68122700 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fcd5800e8b0 tx=0x7fcd5800ebc0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.673+0000 7fcd6d687700 1 -- 172.21.15.26:0/2906421512 shutdown_connections 2023-10-01T07:58:49.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.673+0000 7fcd6d687700 1 --2- 172.21.15.26:0/2906421512 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcd68133f30 0x7fcd68123180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.673+0000 7fcd6d687700 1 --2- 172.21.15.26:0/2906421512 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcd6809d6f0 0x7fcd68122700 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.673+0000 7fcd6d687700 1 --2- 172.21.15.26:0/2906421512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd6809e000 0x7fcd68122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.673+0000 7fcd6d687700 1 -- 172.21.15.26:0/2906421512 >> 172.21.15.26:0/2906421512 conn(0x7fcd68066f50 msgr2=0x7fcd68070ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:49.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.673+0000 7fcd6d687700 1 -- 172.21.15.26:0/2906421512 shutdown_connections 2023-10-01T07:58:49.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.673+0000 7fcd6d687700 1 -- 172.21.15.26:0/2906421512 wait complete. 2023-10-01T07:58:49.687 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:49.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.708+0000 7f2cf8f23700 1 -- 172.21.15.26:0/205734183 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2cf406c360 con 0x7f2cf409e410 2023-10-01T07:58:49.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.709+0000 7f2ce2ffd700 1 -- 172.21.15.26:0/205734183 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2cec011380 con 0x7f2cf409e410 2023-10-01T07:58:49.709 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:49.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.711+0000 7f2cf8f23700 1 -- 172.21.15.26:0/205734183 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2cf409e410 msgr2=0x7f2cf41a5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:49.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.711+0000 7f2cf8f23700 1 --2- 172.21.15.26:0/205734183 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2cf409e410 0x7f2cf41a5a20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2cec00cbc0 tx=0x7f2cec00ced0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.711+0000 7f2cf8f23700 1 -- 172.21.15.26:0/205734183 shutdown_connections 2023-10-01T07:58:49.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.711+0000 7f2cf8f23700 1 --2- 172.21.15.26:0/205734183 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2cf409e410 0x7f2cf41a5a20 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.711+0000 7f2cf8f23700 1 --2- 172.21.15.26:0/205734183 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2cf409d6f0 0x7f2cf41a4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.711+0000 7f2cf8f23700 1 --2- 172.21.15.26:0/205734183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cf409e000 0x7f2cf41a54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:49.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.711+0000 7f2cf8f23700 1 -- 172.21.15.26:0/205734183 >> 172.21.15.26:0/205734183 conn(0x7f2cf4066f50 msgr2=0x7f2cf406f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:49.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.711+0000 7f2cf8f23700 1 -- 172.21.15.26:0/205734183 shutdown_connections 2023-10-01T07:58:49.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:49.711+0000 7f2cf8f23700 1 -- 172.21.15.26:0/205734183 wait complete. 2023-10-01T07:58:49.725 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:50.609 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:50.653 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:50.688 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:50.726 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:50.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.765+0000 7efec7c7e700 1 Processor -- start 2023-10-01T07:58:50.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.765+0000 7efec7c7e700 1 -- start start 2023-10-01T07:58:50.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.766+0000 7efec7c7e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efec009d6f0 0x7efec009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:50.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.766+0000 7efec7c7e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efec009e000 0x7efec0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:50.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.766+0000 7efec7c7e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efec009f130 con 0x7efec009e410 2023-10-01T07:58:50.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.766+0000 7efec7c7e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec009f520 con 0x7efec009d6f0 2023-10-01T07:58:50.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.766+0000 7efec7c7e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec009e930 con 0x7efec009e000 2023-10-01T07:58:50.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.766+0000 7efec5a1a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efec009d6f0 0x7efec009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:50.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.766+0000 7efec5219700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efec009e000 0x7efec0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:50.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.766+0000 7efec5219700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efec009e000 0x7efec0130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:59002/0 (socket says 172.21.15.26:59002) 2023-10-01T07:58:50.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.766+0000 7efec5a1a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efec009d6f0 0x7efec009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50648/0 (socket says 172.21.15.26:50648) 2023-10-01T07:58:50.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.766+0000 7efec5219700 1 -- 172.21.15.26:0/3390235469 learned_addr learned my addr 172.21.15.26:0/3390235469 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:50.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.766+0000 7efec621b700 1 --1- 172.21.15.26:0/3390235469 >> v1:172.21.15.26:6789/0 conn(0x7efec009e410 0x7efec0130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:55940/0 (socket says 172.21.15.26:55940) 2023-10-01T07:58:50.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.766+0000 7efec5219700 1 -- 172.21.15.26:0/3390235469 >> v2:172.21.15.26:3300/0 conn(0x7efec009d6f0 msgr2=0x7efec009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:50.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.766+0000 7efec5219700 1 --2- 172.21.15.26:0/3390235469 >> v2:172.21.15.26:3300/0 conn(0x7efec009d6f0 0x7efec009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:50.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.767+0000 7efec5219700 1 -- 172.21.15.26:0/3390235469 >> v1:172.21.15.26:6789/0 conn(0x7efec009e410 legacy=0x7efec0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:50.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.766+0000 7efec4a18700 1 -- 172.21.15.26:0/3390235469 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2819013284 0 0) 0x7efec009f130 con 0x7efec009e410 2023-10-01T07:58:50.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.767+0000 7efec5219700 1 -- 172.21.15.26:0/3390235469 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec009b2d0 con 0x7efec009e000 2023-10-01T07:58:50.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.767+0000 7efec5a1a700 1 --2- 172.21.15.26:0/3390235469 >> v2:172.21.15.26:3300/0 conn(0x7efec009d6f0 0x7efec009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:50.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.767+0000 7efec5219700 1 --2- 172.21.15.26:0/3390235469 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efec009e000 0x7efec0130660 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7efeb00098f0 tx=0x7efeb0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7cedf5d1e1c8553 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:50.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.767+0000 7efec4a18700 1 -- 172.21.15.26:0/3390235469 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb0011830 con 0x7efec009e000 2023-10-01T07:58:50.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.767+0000 7efec4a18700 1 -- 172.21.15.26:0/3390235469 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb0011990 con 0x7efec009e000 2023-10-01T07:58:50.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.767+0000 7efec4a18700 1 -- 172.21.15.26:0/3390235469 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb0011d20 con 0x7efec009e000 2023-10-01T07:58:50.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.768+0000 7efec7c7e700 1 -- 172.21.15.26:0/3390235469 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efec009e000 msgr2=0x7efec0130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:50.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.768+0000 7efec7c7e700 1 --2- 172.21.15.26:0/3390235469 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efec009e000 0x7efec0130660 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7efeb00098f0 tx=0x7efeb0009c00 comp rx=0 tx=0).stop 2023-10-01T07:58:50.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.768+0000 7efec7c7e700 1 -- 172.21.15.26:0/3390235469 shutdown_connections 2023-10-01T07:58:50.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.768+0000 7efec7c7e700 1 --2- 172.21.15.26:0/3390235469 >> v2:172.21.15.26:3300/0 conn(0x7efec009d6f0 0x7efec009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:50.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.768+0000 7efec7c7e700 1 --2- 172.21.15.26:0/3390235469 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efec009e000 0x7efec0130660 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:50.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.768+0000 7efec7c7e700 1 -- 172.21.15.26:0/3390235469 >> 172.21.15.26:0/3390235469 conn(0x7efec0066f50 msgr2=0x7efec009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:50.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.768+0000 7efec7c7e700 1 -- 172.21.15.26:0/3390235469 shutdown_connections 2023-10-01T07:58:50.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.768+0000 7efec7c7e700 1 -- 172.21.15.26:0/3390235469 wait complete. 2023-10-01T07:58:50.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.769+0000 7efec7c7e700 1 Processor -- start 2023-10-01T07:58:50.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.769+0000 7efec7c7e700 1 -- start start 2023-10-01T07:58:50.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.770+0000 7efec7c7e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efec009d6f0 0x7efec0139940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:50.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.770+0000 7efec7c7e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efec009e000 0x7efec0139e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:50.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.770+0000 7efec7c7e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efec009e410 0x7efec013a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:50.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.770+0000 7efec7c7e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec0137350 con 0x7efec009e000 2023-10-01T07:58:50.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.770+0000 7efec7c7e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec0136990 con 0x7efec009e410 2023-10-01T07:58:50.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.770+0000 7efec7c7e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efec013b3f0 con 0x7efec009d6f0 2023-10-01T07:58:50.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.770+0000 7efec621b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efec009e410 0x7efec013a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:50.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.770+0000 7efec621b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efec009e410 0x7efec013a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:59004/0 (socket says 172.21.15.26:59004) 2023-10-01T07:58:50.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.770+0000 7efec621b700 1 -- 172.21.15.26:0/4190401983 learned_addr learned my addr 172.21.15.26:0/4190401983 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:50.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.770+0000 7efec5219700 1 --2- 172.21.15.26:0/4190401983 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efec009e000 0x7efec0139e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:50.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.770+0000 7efec5a1a700 1 --2- 172.21.15.26:0/4190401983 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efec009d6f0 0x7efec0139940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:50.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.770+0000 7efec5219700 1 -- 172.21.15.26:0/4190401983 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efec009d6f0 msgr2=0x7efec0139940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:50.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.770+0000 7efec5219700 1 --2- 172.21.15.26:0/4190401983 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efec009d6f0 0x7efec0139940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:50.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.770+0000 7efec5219700 1 -- 172.21.15.26:0/4190401983 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efec009e410 msgr2=0x7efec013a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:50.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.770+0000 7efec5219700 1 --2- 172.21.15.26:0/4190401983 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efec009e410 0x7efec013a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:50.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.770+0000 7efec5219700 1 -- 172.21.15.26:0/4190401983 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efebc0094a0 con 0x7efec009e000 2023-10-01T07:58:50.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.770+0000 7efec621b700 1 --2- 172.21.15.26:0/4190401983 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efec009e410 0x7efec013a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:50.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.771+0000 7efec5219700 1 --2- 172.21.15.26:0/4190401983 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efec009e000 0x7efec0139e80 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7efeb0016000 tx=0x7efeb0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:50.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.771+0000 7efeb67fc700 1 -- 172.21.15.26:0/4190401983 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb0004300 con 0x7efec009e000 2023-10-01T07:58:50.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.771+0000 7efeb67fc700 1 -- 172.21.15.26:0/4190401983 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb001f070 con 0x7efec009e000 2023-10-01T07:58:50.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.771+0000 7efec7c7e700 1 -- 172.21.15.26:0/4190401983 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb0009550 con 0x7efec009e000 2023-10-01T07:58:50.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.771+0000 7efeb67fc700 1 -- 172.21.15.26:0/4190401983 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb00036a0 con 0x7efec009e000 2023-10-01T07:58:50.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.771+0000 7efec7c7e700 1 -- 172.21.15.26:0/4190401983 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec009c700 con 0x7efec009e000 2023-10-01T07:58:50.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.772+0000 7efec7c7e700 1 -- 172.21.15.26:0/4190401983 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec0074ea0 con 0x7efec009e000 2023-10-01T07:58:50.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.772+0000 7efeb67fc700 1 -- 172.21.15.26:0/4190401983 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efeb0021030 con 0x7efec009e000 2023-10-01T07:58:50.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.773+0000 7efeb67fc700 1 -- 172.21.15.26:0/4190401983 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efeb00408f0 con 0x7efec009e000 2023-10-01T07:58:50.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.778+0000 7efeb67fc700 1 -- 172.21.15.26:0/4190401983 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efeb00239c0 con 0x7efec009e000 2023-10-01T07:58:50.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.804+0000 7fd24ce82700 1 Processor -- start 2023-10-01T07:58:50.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.804+0000 7fd24ce82700 1 -- start start 2023-10-01T07:58:50.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.805+0000 7fd24ce82700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd24809e1d0 0x7fd248138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:50.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.805+0000 7fd24ce82700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd248139170 0x7fd24813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:50.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.805+0000 7fd24ce82700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd24809b120 con 0x7fd24809d6f0 2023-10-01T07:58:50.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.805+0000 7fd24ce82700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd24806b460 con 0x7fd248139170 2023-10-01T07:58:50.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.805+0000 7fd24ce82700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd24809a7e0 con 0x7fd24809e1d0 2023-10-01T07:58:50.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.805+0000 7fd24659c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd24809d6f0 0x7fd24809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:55946/0 (socket says 172.21.15.26:55946) 2023-10-01T07:58:50.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.805+0000 7fd24659c700 1 -- 172.21.15.26:0/2737026085 learned_addr learned my addr 172.21.15.26:0/2737026085 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:50.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.805+0000 7fd245d9b700 1 --2- 172.21.15.26:0/2737026085 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd24809e1d0 0x7fd248138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:50.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.805+0000 7fd246d9d700 1 --2- 172.21.15.26:0/2737026085 >> v2:172.21.15.26:3300/0 conn(0x7fd248139170 0x7fd24813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:50.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.806+0000 7fd24559a700 1 -- 172.21.15.26:0/2737026085 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2593374081 0 0) 0x7fd24809b120 con 0x7fd24809d6f0 2023-10-01T07:58:50.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.806+0000 7fd24559a700 1 -- 172.21.15.26:0/2737026085 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2300035b0 con 0x7fd24809d6f0 2023-10-01T07:58:50.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.806+0000 7fd245d9b700 1 -- 172.21.15.26:0/2737026085 >> v2:172.21.15.26:3300/0 conn(0x7fd248139170 msgr2=0x7fd24813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:50.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.806+0000 7fd245d9b700 1 --2- 172.21.15.26:0/2737026085 >> v2:172.21.15.26:3300/0 conn(0x7fd248139170 0x7fd24813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:50.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.806+0000 7fd245d9b700 1 -- 172.21.15.26:0/2737026085 >> v1:172.21.15.26:6789/0 conn(0x7fd24809d6f0 legacy=0x7fd24809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:50.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.806+0000 7fd245d9b700 1 -- 172.21.15.26:0/2737026085 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24809a500 con 0x7fd24809e1d0 2023-10-01T07:58:50.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.806+0000 7fd245d9b700 1 --2- 172.21.15.26:0/2737026085 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd24809e1d0 0x7fd248138c30 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd23c009870 tx=0x7fd23c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cec2e1a17dcf06c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:50.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.806+0000 7fd24559a700 1 -- 172.21.15.26:0/2737026085 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c011830 con 0x7fd24809e1d0 2023-10-01T07:58:50.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.806+0000 7fd24559a700 1 -- 172.21.15.26:0/2737026085 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23c011990 con 0x7fd24809e1d0 2023-10-01T07:58:50.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.806+0000 7fd24559a700 1 -- 172.21.15.26:0/2737026085 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c011d20 con 0x7fd24809e1d0 2023-10-01T07:58:50.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.807+0000 7fd24ce82700 1 -- 172.21.15.26:0/2737026085 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd24809e1d0 msgr2=0x7fd248138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:50.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.807+0000 7fd24ce82700 1 --2- 172.21.15.26:0/2737026085 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd24809e1d0 0x7fd248138c30 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd23c009870 tx=0x7fd23c009b80 comp rx=0 tx=0).stop 2023-10-01T07:58:50.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.807+0000 7fd24ce82700 1 -- 172.21.15.26:0/2737026085 shutdown_connections 2023-10-01T07:58:50.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.807+0000 7fd24ce82700 1 --2- 172.21.15.26:0/2737026085 >> v2:172.21.15.26:3300/0 conn(0x7fd248139170 0x7fd24813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:50.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.807+0000 7fd24ce82700 1 --2- 172.21.15.26:0/2737026085 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd24809e1d0 0x7fd248138c30 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:50.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.807+0000 7fd24ce82700 1 -- 172.21.15.26:0/2737026085 >> 172.21.15.26:0/2737026085 conn(0x7fd248066f50 msgr2=0x7fd24809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:50.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.807+0000 7fd24ce82700 1 -- 172.21.15.26:0/2737026085 shutdown_connections 2023-10-01T07:58:50.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.807+0000 7fd24ce82700 1 -- 172.21.15.26:0/2737026085 wait complete. 2023-10-01T07:58:50.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.808+0000 7fd24ce82700 1 Processor -- start 2023-10-01T07:58:50.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.809+0000 7fd24ce82700 1 -- start start 2023-10-01T07:58:50.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.809+0000 7fd24ce82700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd24809d6f0 0x7fd248120770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:50.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.809+0000 7fd24ce82700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd24809e1d0 0x7fd248120cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:50.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.809+0000 7fd24ce82700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd248139170 0x7fd2481211f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:50.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.809+0000 7fd24ce82700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2480a2700 con 0x7fd24809d6f0 2023-10-01T07:58:50.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.809+0000 7fd24ce82700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd248123ca0 con 0x7fd24809e1d0 2023-10-01T07:58:50.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.809+0000 7fd24ce82700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd248124240 con 0x7fd248139170 2023-10-01T07:58:50.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.809+0000 7fd246d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd248139170 0x7fd2481211f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:50.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.809+0000 7fd246d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd248139170 0x7fd2481211f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:52716/0 (socket says 172.21.15.26:52716) 2023-10-01T07:58:50.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.809+0000 7fd246d9d700 1 -- 172.21.15.26:0/1172138322 learned_addr learned my addr 172.21.15.26:0/1172138322 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:50.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.809+0000 7fd24659c700 1 --2- 172.21.15.26:0/1172138322 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd24809d6f0 0x7fd248120770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:50.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.810+0000 7fd245d9b700 1 --2- 172.21.15.26:0/1172138322 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd24809e1d0 0x7fd248120cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:50.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.810+0000 7fd246d9d700 1 -- 172.21.15.26:0/1172138322 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd24809e1d0 msgr2=0x7fd248120cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:50.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.810+0000 7fd246d9d700 1 --2- 172.21.15.26:0/1172138322 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd24809e1d0 0x7fd248120cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:50.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.810+0000 7fd246d9d700 1 -- 172.21.15.26:0/1172138322 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd24809d6f0 msgr2=0x7fd248120770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:50.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.810+0000 7fd246d9d700 1 --2- 172.21.15.26:0/1172138322 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd24809d6f0 0x7fd248120770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:50.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.810+0000 7fd246d9d700 1 -- 172.21.15.26:0/1172138322 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23c0094a0 con 0x7fd248139170 2023-10-01T07:58:50.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.810+0000 7fd245d9b700 1 --2- 172.21.15.26:0/1172138322 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd24809e1d0 0x7fd248120cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:58:50.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.810+0000 7fd246d9d700 1 --2- 172.21.15.26:0/1172138322 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd248139170 0x7fd2481211f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd240009dd0 tx=0x7fd24000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:50.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.810+0000 7fd236ffd700 1 -- 172.21.15.26:0/1172138322 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd240009c40 con 0x7fd248139170 2023-10-01T07:58:50.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.810+0000 7fd24ce82700 1 -- 172.21.15.26:0/1172138322 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2481224b0 con 0x7fd248139170 2023-10-01T07:58:50.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.810+0000 7fd236ffd700 1 -- 172.21.15.26:0/1172138322 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd24000f040 con 0x7fd248139170 2023-10-01T07:58:50.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.810+0000 7fd236ffd700 1 -- 172.21.15.26:0/1172138322 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd240014480 con 0x7fd248139170 2023-10-01T07:58:50.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.810+0000 7fd24ce82700 1 -- 172.21.15.26:0/1172138322 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2481365f0 con 0x7fd248139170 2023-10-01T07:58:50.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.811+0000 7fd236ffd700 1 -- 172.21.15.26:0/1172138322 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd2400145e0 con 0x7fd248139170 2023-10-01T07:58:50.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.811+0000 7fd24ce82700 1 -- 172.21.15.26:0/1172138322 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd248074ea0 con 0x7fd248139170 2023-10-01T07:58:50.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.812+0000 7fd236ffd700 1 -- 172.21.15.26:0/1172138322 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd240040150 con 0x7fd248139170 2023-10-01T07:58:50.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.817+0000 7fd236ffd700 1 -- 172.21.15.26:0/1172138322 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd2400248f0 con 0x7fd248139170 2023-10-01T07:58:50.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.847+0000 7f99e479c700 1 Processor -- start 2023-10-01T07:58:50.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.847+0000 7f99e479c700 1 -- start start 2023-10-01T07:58:50.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.848+0000 7f99e479c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f99dc09d6f0 0x7f99dc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:50.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.848+0000 7f99e479c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f99dc09e000 0x7f99dc130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:50.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.849+0000 7f99e479c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99dc09f130 con 0x7f99dc09e410 2023-10-01T07:58:50.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.849+0000 7f99e479c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99dc09f520 con 0x7f99dc09e000 2023-10-01T07:58:50.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.849+0000 7f99e479c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc09e930 con 0x7f99dc09d6f0 2023-10-01T07:58:50.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.849+0000 7f99e2538700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f99dc09d6f0 0x7f99dc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:50.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.849+0000 7f99e2538700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f99dc09d6f0 0x7f99dc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:52718/0 (socket says 172.21.15.26:52718) 2023-10-01T07:58:50.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.849+0000 7f99e2538700 1 -- 172.21.15.26:0/3949863785 learned_addr learned my addr 172.21.15.26:0/3949863785 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:50.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.849+0000 7f99e1d37700 1 --2- 172.21.15.26:0/3949863785 >> v2:172.21.15.26:3300/0 conn(0x7f99dc09e000 0x7f99dc130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:50.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.849+0000 7f99e2538700 1 -- 172.21.15.26:0/3949863785 >> v2:172.21.15.26:3300/0 conn(0x7f99dc09e000 msgr2=0x7f99dc130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:50.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.849+0000 7f99e2538700 1 --2- 172.21.15.26:0/3949863785 >> v2:172.21.15.26:3300/0 conn(0x7f99dc09e000 0x7f99dc130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:50.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.849+0000 7f99e2538700 1 -- 172.21.15.26:0/3949863785 >> v1:172.21.15.26:6789/0 conn(0x7f99dc09e410 legacy=0x7f99dc130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:50.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.849+0000 7f99e2538700 1 -- 172.21.15.26:0/3949863785 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99dc09b2d0 con 0x7f99dc09d6f0 2023-10-01T07:58:50.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.849+0000 7f99e2538700 1 --2- 172.21.15.26:0/3949863785 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f99dc09d6f0 0x7f99dc09dac0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f99d800b9a0 tx=0x7f99d800bcb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bca7006bfd8031eb server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:50.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.850+0000 7f99e1536700 1 -- 172.21.15.26:0/3949863785 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d800caa0 con 0x7f99dc09d6f0 2023-10-01T07:58:50.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.850+0000 7f99e1536700 1 -- 172.21.15.26:0/3949863785 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d800cc00 con 0x7f99dc09d6f0 2023-10-01T07:58:50.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.850+0000 7f99e1536700 1 -- 172.21.15.26:0/3949863785 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d800f460 con 0x7f99dc09d6f0 2023-10-01T07:58:50.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.851+0000 7f99e479c700 1 -- 172.21.15.26:0/3949863785 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f99dc09d6f0 msgr2=0x7f99dc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:50.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.851+0000 7f99e479c700 1 --2- 172.21.15.26:0/3949863785 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f99dc09d6f0 0x7f99dc09dac0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f99d800b9a0 tx=0x7f99d800bcb0 comp rx=0 tx=0).stop 2023-10-01T07:58:50.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.851+0000 7f99e479c700 1 -- 172.21.15.26:0/3949863785 shutdown_connections 2023-10-01T07:58:50.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.851+0000 7f99e479c700 1 --2- 172.21.15.26:0/3949863785 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f99dc09d6f0 0x7f99dc09dac0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:50.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.851+0000 7f99e479c700 1 --2- 172.21.15.26:0/3949863785 >> v2:172.21.15.26:3300/0 conn(0x7f99dc09e000 0x7f99dc130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:50.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.851+0000 7f99e479c700 1 -- 172.21.15.26:0/3949863785 >> 172.21.15.26:0/3949863785 conn(0x7f99dc066f50 msgr2=0x7f99dc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:50.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.851+0000 7f99e479c700 1 -- 172.21.15.26:0/3949863785 shutdown_connections 2023-10-01T07:58:50.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.851+0000 7f99e479c700 1 -- 172.21.15.26:0/3949863785 wait complete. 2023-10-01T07:58:50.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.852+0000 7f99e479c700 1 Processor -- start 2023-10-01T07:58:50.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.853+0000 7f99e479c700 1 -- start start 2023-10-01T07:58:50.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.853+0000 7f99e479c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f99dc09d6f0 0x7f99dc11e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:50.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.853+0000 7f99e479c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99dc09e000 0x7f99dc11e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:50.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.853+0000 7f99e479c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f99dc09e410 0x7f99dc11eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:50.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.853+0000 7f99e479c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc121bb0 con 0x7f99dc09e000 2023-10-01T07:58:50.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.853+0000 7f99e479c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc0a1d00 con 0x7f99dc09e410 2023-10-01T07:58:50.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.853+0000 7f99e479c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc09c700 con 0x7f99dc09d6f0 2023-10-01T07:58:50.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.853+0000 7f99e2538700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f99dc09d6f0 0x7f99dc11e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:50.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.853+0000 7f99e2538700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f99dc09d6f0 0x7f99dc11e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:52732/0 (socket says 172.21.15.26:52732) 2023-10-01T07:58:50.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.853+0000 7f99e2538700 1 -- 172.21.15.26:0/1196875578 learned_addr learned my addr 172.21.15.26:0/1196875578 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:50.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.854+0000 7f99e1d37700 1 --2- 172.21.15.26:0/1196875578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99dc09e000 0x7f99dc11e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:50.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.854+0000 7f99e2d39700 1 --2- 172.21.15.26:0/1196875578 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f99dc09e410 0x7f99dc11eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:50.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.854+0000 7f99e2538700 1 -- 172.21.15.26:0/1196875578 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f99dc09e410 msgr2=0x7f99dc11eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:50.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.854+0000 7f99e2538700 1 --2- 172.21.15.26:0/1196875578 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f99dc09e410 0x7f99dc11eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:50.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.854+0000 7f99e2538700 1 -- 172.21.15.26:0/1196875578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99dc09e000 msgr2=0x7f99dc11e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:50.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.854+0000 7f99e2538700 1 --2- 172.21.15.26:0/1196875578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99dc09e000 0x7f99dc11e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:50.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.854+0000 7f99e2538700 1 -- 172.21.15.26:0/1196875578 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d800b600 con 0x7f99dc09d6f0 2023-10-01T07:58:50.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.854+0000 7f99e2538700 1 --2- 172.21.15.26:0/1196875578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f99dc09d6f0 0x7f99dc11e0e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f99d80090b0 tx=0x7f99d8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:50.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.854+0000 7f99d2ffd700 1 -- 172.21.15.26:0/1196875578 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d801c070 con 0x7f99dc09d6f0 2023-10-01T07:58:50.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.854+0000 7f99d2ffd700 1 -- 172.21.15.26:0/1196875578 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d800c8a0 con 0x7f99dc09d6f0 2023-10-01T07:58:50.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.854+0000 7f99d2ffd700 1 -- 172.21.15.26:0/1196875578 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d8004290 con 0x7f99dc09d6f0 2023-10-01T07:58:50.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.854+0000 7f99e479c700 1 -- 172.21.15.26:0/1196875578 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99dc121610 con 0x7f99dc09d6f0 2023-10-01T07:58:50.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.855+0000 7f99e479c700 1 -- 172.21.15.26:0/1196875578 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99dc1201f0 con 0x7f99dc09d6f0 2023-10-01T07:58:50.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.856+0000 7f99d2ffd700 1 -- 172.21.15.26:0/1196875578 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f99d80043f0 con 0x7f99dc09d6f0 2023-10-01T07:58:50.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.856+0000 7f99d2ffd700 1 -- 172.21.15.26:0/1196875578 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f99d8040c50 con 0x7f99dc09d6f0 2023-10-01T07:58:50.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.856+0000 7f99e479c700 1 -- 172.21.15.26:0/1196875578 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99dc120f80 con 0x7f99dc09d6f0 2023-10-01T07:58:50.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.866+0000 7f99d2ffd700 1 -- 172.21.15.26:0/1196875578 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f99d80203d0 con 0x7f99dc09d6f0 2023-10-01T07:58:50.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.899+0000 7f9839832700 1 Processor -- start 2023-10-01T07:58:50.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.900+0000 7f9839832700 1 -- start start 2023-10-01T07:58:50.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.900+0000 7f9839832700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98340a0a30 0x7f98340a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:50.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.900+0000 7f9839832700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f98340a1340 0x7f983413c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:50.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.900+0000 7f9839832700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f983409d920 con 0x7f983413c640 2023-10-01T07:58:50.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.900+0000 7f9839832700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f983409d020 con 0x7f98340a1340 2023-10-01T07:58:50.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.900+0000 7f9839832700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98340a2010 con 0x7f98340a0a30 2023-10-01T07:58:50.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.901+0000 7f9832ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98340a0a30 0x7f98340a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:50.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.901+0000 7f98337fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f983413c640 0x7f983413ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:55962/0 (socket says 172.21.15.26:55962) 2023-10-01T07:58:50.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.901+0000 7f98337fe700 1 -- 172.21.15.26:0/818987334 learned_addr learned my addr 172.21.15.26:0/818987334 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:50.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.901+0000 7f98327fc700 1 --2- 172.21.15.26:0/818987334 >> v2:172.21.15.26:3300/0 conn(0x7f98340a1340 0x7f983413c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:50.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.901+0000 7f9832ffd700 1 -- 172.21.15.26:0/818987334 >> v2:172.21.15.26:3300/0 conn(0x7f98340a1340 msgr2=0x7f983413c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:50.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.901+0000 7f9832ffd700 1 --2- 172.21.15.26:0/818987334 >> v2:172.21.15.26:3300/0 conn(0x7f98340a1340 0x7f983413c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:50.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.901+0000 7f9832ffd700 1 -- 172.21.15.26:0/818987334 >> v1:172.21.15.26:6789/0 conn(0x7f983413c640 legacy=0x7f983413ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:50.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.901+0000 7f9831ffb700 1 -- 172.21.15.26:0/818987334 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3938554955 0 0) 0x7f983409d920 con 0x7f983413c640 2023-10-01T07:58:50.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.901+0000 7f9832ffd700 1 -- 172.21.15.26:0/818987334 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983409dbe0 con 0x7f98340a0a30 2023-10-01T07:58:50.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.901+0000 7f9832ffd700 1 --2- 172.21.15.26:0/818987334 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98340a0a30 0x7f98340a0e00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f9824009840 tx=0x7f9824009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5f5fb8e18da4d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:50.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.902+0000 7f9831ffb700 1 -- 172.21.15.26:0/818987334 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9824011830 con 0x7f98340a0a30 2023-10-01T07:58:50.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.902+0000 7f9831ffb700 1 -- 172.21.15.26:0/818987334 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9824011990 con 0x7f98340a0a30 2023-10-01T07:58:50.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.902+0000 7f9831ffb700 1 -- 172.21.15.26:0/818987334 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9824011d20 con 0x7f98340a0a30 2023-10-01T07:58:50.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.902+0000 7f9839832700 1 -- 172.21.15.26:0/818987334 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98340a0a30 msgr2=0x7f98340a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:50.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.902+0000 7f9839832700 1 --2- 172.21.15.26:0/818987334 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98340a0a30 0x7f98340a0e00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f9824009840 tx=0x7f9824009b50 comp rx=0 tx=0).stop 2023-10-01T07:58:50.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.902+0000 7f9839832700 1 -- 172.21.15.26:0/818987334 shutdown_connections 2023-10-01T07:58:50.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.902+0000 7f9839832700 1 --2- 172.21.15.26:0/818987334 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98340a0a30 0x7f98340a0e00 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:50.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.902+0000 7f9839832700 1 --2- 172.21.15.26:0/818987334 >> v2:172.21.15.26:3300/0 conn(0x7f98340a1340 0x7f983413c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:50.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.902+0000 7f9839832700 1 -- 172.21.15.26:0/818987334 >> 172.21.15.26:0/818987334 conn(0x7f98340a6550 msgr2=0x7f98340a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:50.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.902+0000 7f9839832700 1 -- 172.21.15.26:0/818987334 shutdown_connections 2023-10-01T07:58:50.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.903+0000 7f9839832700 1 -- 172.21.15.26:0/818987334 wait complete. 2023-10-01T07:58:50.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.904+0000 7f9839832700 1 Processor -- start 2023-10-01T07:58:50.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.904+0000 7f9839832700 1 -- start start 2023-10-01T07:58:50.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.905+0000 7f9839832700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98340a0a30 0x7f9834126d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:50.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.905+0000 7f9839832700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98340a1340 0x7f9834127260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:50.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.905+0000 7f9839832700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f983413c640 0x7f98341277a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:50.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.905+0000 7f9839832700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983412a560 con 0x7f98340a1340 2023-10-01T07:58:50.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.905+0000 7f9839832700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9834128a40 con 0x7f983413c640 2023-10-01T07:58:50.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.905+0000 7f9839832700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f983409c110 con 0x7f98340a0a30 2023-10-01T07:58:50.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.905+0000 7f98327fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98340a1340 0x7f9834127260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:50.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.905+0000 7f98327fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98340a1340 0x7f9834127260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50712/0 (socket says 172.21.15.26:50712) 2023-10-01T07:58:50.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.905+0000 7f98327fc700 1 -- 172.21.15.26:0/4014743549 learned_addr learned my addr 172.21.15.26:0/4014743549 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:50.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.905+0000 7f9832ffd700 1 --2- 172.21.15.26:0/4014743549 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98340a0a30 0x7f9834126d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:50.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.905+0000 7f98337fe700 1 --2- 172.21.15.26:0/4014743549 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f983413c640 0x7f98341277a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:50.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.906+0000 7f98327fc700 1 -- 172.21.15.26:0/4014743549 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98340a0a30 msgr2=0x7f9834126d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:50.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.906+0000 7f98327fc700 1 --2- 172.21.15.26:0/4014743549 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98340a0a30 0x7f9834126d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:50.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.906+0000 7f98327fc700 1 -- 172.21.15.26:0/4014743549 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f983413c640 msgr2=0x7f98341277a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:50.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.906+0000 7f98327fc700 1 --2- 172.21.15.26:0/4014743549 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f983413c640 0x7f98341277a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:50.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.906+0000 7f98327fc700 1 -- 172.21.15.26:0/4014743549 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98240094a0 con 0x7f98340a1340 2023-10-01T07:58:50.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.906+0000 7f98327fc700 1 --2- 172.21.15.26:0/4014743549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98340a1340 0x7f9834127260 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f982800e980 tx=0x7f982800ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:50.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.906+0000 7f981bfff700 1 -- 172.21.15.26:0/4014743549 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9828009710 con 0x7f98340a1340 2023-10-01T07:58:50.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.906+0000 7f981bfff700 1 -- 172.21.15.26:0/4014743549 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982800eed0 con 0x7f98340a1340 2023-10-01T07:58:50.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.906+0000 7f9839832700 1 -- 172.21.15.26:0/4014743549 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f983409ff90 con 0x7f98340a1340 2023-10-01T07:58:50.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.906+0000 7f981bfff700 1 -- 172.21.15.26:0/4014743549 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982800ca50 con 0x7f98340a1340 2023-10-01T07:58:50.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.906+0000 7f9839832700 1 -- 172.21.15.26:0/4014743549 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f983412afd0 con 0x7f98340a1340 2023-10-01T07:58:50.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.907+0000 7f981bfff700 1 -- 172.21.15.26:0/4014743549 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f982800cbb0 con 0x7f98340a1340 2023-10-01T07:58:50.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.908+0000 7f981bfff700 1 -- 172.21.15.26:0/4014743549 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f982803f8a0 con 0x7f98340a1340 2023-10-01T07:58:50.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.908+0000 7f9839832700 1 -- 172.21.15.26:0/4014743549 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9834071e20 con 0x7f98340a1340 2023-10-01T07:58:50.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:50.913+0000 7f981bfff700 1 -- 172.21.15.26:0/4014743549 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9828017080 con 0x7f98340a1340 2023-10-01T07:58:51.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.027+0000 7efec7c7e700 1 -- 172.21.15.26:0/4190401983 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efec006c360 con 0x7efec009e000 2023-10-01T07:58:51.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.027+0000 7efeb67fc700 1 -- 172.21.15.26:0/4190401983 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efeb0015030 con 0x7efec009e000 2023-10-01T07:58:51.028 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:51.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.031+0000 7efec7c7e700 1 -- 172.21.15.26:0/4190401983 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efec009e000 msgr2=0x7efec0139e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:51.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.031+0000 7efec7c7e700 1 --2- 172.21.15.26:0/4190401983 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efec009e000 0x7efec0139e80 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7efeb0016000 tx=0x7efeb0004750 comp rx=0 tx=0).stop 2023-10-01T07:58:51.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.031+0000 7efec7c7e700 1 -- 172.21.15.26:0/4190401983 shutdown_connections 2023-10-01T07:58:51.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.031+0000 7efec7c7e700 1 --2- 172.21.15.26:0/4190401983 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efec009e410 0x7efec013a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:51.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.031+0000 7efec7c7e700 1 --2- 172.21.15.26:0/4190401983 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efec009d6f0 0x7efec0139940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:51.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.031+0000 7efec7c7e700 1 --2- 172.21.15.26:0/4190401983 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efec009e000 0x7efec0139e80 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:51.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.031+0000 7efec7c7e700 1 -- 172.21.15.26:0/4190401983 >> 172.21.15.26:0/4190401983 conn(0x7efec0066f50 msgr2=0x7efec0070e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:51.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.031+0000 7efec7c7e700 1 -- 172.21.15.26:0/4190401983 shutdown_connections 2023-10-01T07:58:51.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.031+0000 7efec7c7e700 1 -- 172.21.15.26:0/4190401983 wait complete. 2023-10-01T07:58:51.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.035+0000 7fd24ce82700 1 -- 172.21.15.26:0/1172138322 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd24809f420 con 0x7fd248139170 2023-10-01T07:58:51.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.036+0000 7fd236ffd700 1 -- 172.21.15.26:0/1172138322 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd240024300 con 0x7fd248139170 2023-10-01T07:58:51.036 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:51.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.038+0000 7fd24ce82700 1 -- 172.21.15.26:0/1172138322 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd248139170 msgr2=0x7fd2481211f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:51.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.038+0000 7fd24ce82700 1 --2- 172.21.15.26:0/1172138322 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd248139170 0x7fd2481211f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd240009dd0 tx=0x7fd24000c3a0 comp rx=0 tx=0).stop 2023-10-01T07:58:51.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.038+0000 7fd24ce82700 1 -- 172.21.15.26:0/1172138322 shutdown_connections 2023-10-01T07:58:51.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.038+0000 7fd24ce82700 1 --2- 172.21.15.26:0/1172138322 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd248139170 0x7fd2481211f0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:51.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.038+0000 7fd24ce82700 1 --2- 172.21.15.26:0/1172138322 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd24809d6f0 0x7fd248120770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:51.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.038+0000 7fd24ce82700 1 --2- 172.21.15.26:0/1172138322 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd24809e1d0 0x7fd248120cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:51.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.038+0000 7fd24ce82700 1 -- 172.21.15.26:0/1172138322 >> 172.21.15.26:0/1172138322 conn(0x7fd248066f50 msgr2=0x7fd248070c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:51.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.038+0000 7fd24ce82700 1 -- 172.21.15.26:0/1172138322 shutdown_connections 2023-10-01T07:58:51.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.038+0000 7fd24ce82700 1 -- 172.21.15.26:0/1172138322 wait complete. 2023-10-01T07:58:51.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:51.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:51.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.080+0000 7f99e479c700 1 -- 172.21.15.26:0/1196875578 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f99dc074ea0 con 0x7f99dc09d6f0 2023-10-01T07:58:51.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.081+0000 7f99d2ffd700 1 -- 172.21.15.26:0/1196875578 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f99d8026020 con 0x7f99dc09d6f0 2023-10-01T07:58:51.081 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:51.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.083+0000 7f99e479c700 1 -- 172.21.15.26:0/1196875578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f99dc09d6f0 msgr2=0x7f99dc11e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:51.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.083+0000 7f99e479c700 1 --2- 172.21.15.26:0/1196875578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f99dc09d6f0 0x7f99dc11e0e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f99d80090b0 tx=0x7f99d8004750 comp rx=0 tx=0).stop 2023-10-01T07:58:51.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.083+0000 7f99e479c700 1 -- 172.21.15.26:0/1196875578 shutdown_connections 2023-10-01T07:58:51.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.083+0000 7f99e479c700 1 --2- 172.21.15.26:0/1196875578 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f99dc09e410 0x7f99dc11eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:51.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.083+0000 7f99e479c700 1 --2- 172.21.15.26:0/1196875578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f99dc09d6f0 0x7f99dc11e0e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:51.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.083+0000 7f99e479c700 1 --2- 172.21.15.26:0/1196875578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99dc09e000 0x7f99dc11e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:51.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.083+0000 7f99e479c700 1 -- 172.21.15.26:0/1196875578 >> 172.21.15.26:0/1196875578 conn(0x7f99dc066f50 msgr2=0x7f99dc06f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:51.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.083+0000 7f99e479c700 1 -- 172.21.15.26:0/1196875578 shutdown_connections 2023-10-01T07:58:51.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.083+0000 7f99e479c700 1 -- 172.21.15.26:0/1196875578 wait complete. 2023-10-01T07:58:51.097 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:51.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.152+0000 7f9839832700 1 -- 172.21.15.26:0/4014743549 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9834074ea0 con 0x7f98340a1340 2023-10-01T07:58:51.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.152+0000 7f981bfff700 1 -- 172.21.15.26:0/4014743549 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9828021020 con 0x7f98340a1340 2023-10-01T07:58:51.153 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:51.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.154+0000 7f9839832700 1 -- 172.21.15.26:0/4014743549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98340a1340 msgr2=0x7f9834127260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:51.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.154+0000 7f9839832700 1 --2- 172.21.15.26:0/4014743549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98340a1340 0x7f9834127260 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f982800e980 tx=0x7f982800ec90 comp rx=0 tx=0).stop 2023-10-01T07:58:51.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.154+0000 7f9839832700 1 -- 172.21.15.26:0/4014743549 shutdown_connections 2023-10-01T07:58:51.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.154+0000 7f9839832700 1 --2- 172.21.15.26:0/4014743549 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f983413c640 0x7f98341277a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:51.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.154+0000 7f9839832700 1 --2- 172.21.15.26:0/4014743549 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98340a0a30 0x7f9834126d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:51.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.154+0000 7f9839832700 1 --2- 172.21.15.26:0/4014743549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98340a1340 0x7f9834127260 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:51.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.154+0000 7f9839832700 1 -- 172.21.15.26:0/4014743549 >> 172.21.15.26:0/4014743549 conn(0x7f98340a6550 msgr2=0x7f98340a2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:51.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.154+0000 7f9839832700 1 -- 172.21.15.26:0/4014743549 shutdown_connections 2023-10-01T07:58:51.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:51.154+0000 7f9839832700 1 -- 172.21.15.26:0/4014743549 wait complete. 2023-10-01T07:58:51.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:52.047 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:52.060 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:52.098 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:52.169 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:52.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.201+0000 7f396e529700 1 Processor -- start 2023-10-01T07:58:52.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.201+0000 7f396e529700 1 -- start start 2023-10-01T07:58:52.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.202+0000 7f396e529700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f39681338c0 0x7f3968133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:52.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.202+0000 7f396e529700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f39681341d0 0x7f396809de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:52.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.202+0000 7f396e529700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f396809e390 0x7f396809e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:52.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.202+0000 7f396e529700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3968070c80 con 0x7f39681341d0 2023-10-01T07:58:52.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.202+0000 7f396e529700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f396809ed20 con 0x7f396809e390 2023-10-01T07:58:52.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.202+0000 7f396e529700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f396806f720 con 0x7f39681338c0 2023-10-01T07:58:52.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.202+0000 7f3967fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f39681338c0 0x7f3968133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:52.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.202+0000 7f39677fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f39681341d0 0x7f396809de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:52.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.202+0000 7f3967fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f39681338c0 0x7f3968133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:52770/0 (socket says 172.21.15.26:52770) 2023-10-01T07:58:52.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.202+0000 7f3967fff700 1 -- 172.21.15.26:0/2408896027 learned_addr learned my addr 172.21.15.26:0/2408896027 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:52.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.202+0000 7f396cac6700 1 --2- 172.21.15.26:0/2408896027 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f396809e390 0x7f396809e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:52.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.203+0000 7f396cac6700 1 -- 172.21.15.26:0/2408896027 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f39681338c0 msgr2=0x7f3968133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:52.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.203+0000 7f396cac6700 1 --2- 172.21.15.26:0/2408896027 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f39681338c0 0x7f3968133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.203+0000 7f396cac6700 1 -- 172.21.15.26:0/2408896027 >> v2:172.21.15.26:3300/0 conn(0x7f39681341d0 msgr2=0x7f396809de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:52.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.203+0000 7f396cac6700 1 --2- 172.21.15.26:0/2408896027 >> v2:172.21.15.26:3300/0 conn(0x7f39681341d0 0x7f396809de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.203+0000 7f396cac6700 1 -- 172.21.15.26:0/2408896027 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396806fce0 con 0x7f396809e390 2023-10-01T07:58:52.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.203+0000 7f396cac6700 1 --2- 172.21.15.26:0/2408896027 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f396809e390 0x7f396809e7e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f3960009dc0 tx=0x7f396000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddabd40f8132aed9 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:52.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.203+0000 7f3966ffd700 1 -- 172.21.15.26:0/2408896027 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396000e070 con 0x7f396809e390 2023-10-01T07:58:52.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.203+0000 7f3966ffd700 1 -- 172.21.15.26:0/2408896027 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f396000bae0 con 0x7f396809e390 2023-10-01T07:58:52.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.203+0000 7f3966ffd700 1 -- 172.21.15.26:0/2408896027 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396000be90 con 0x7f396809e390 2023-10-01T07:58:52.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.204+0000 7f396e529700 1 -- 172.21.15.26:0/2408896027 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f396809e390 msgr2=0x7f396809e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:52.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.204+0000 7f396e529700 1 --2- 172.21.15.26:0/2408896027 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f396809e390 0x7f396809e7e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f3960009dc0 tx=0x7f396000b330 comp rx=0 tx=0).stop 2023-10-01T07:58:52.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.204+0000 7f396e529700 1 -- 172.21.15.26:0/2408896027 shutdown_connections 2023-10-01T07:58:52.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.204+0000 7f396e529700 1 --2- 172.21.15.26:0/2408896027 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f396809e390 0x7f396809e7e0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.204+0000 7f396e529700 1 --2- 172.21.15.26:0/2408896027 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f39681338c0 0x7f3968133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.204+0000 7f396e529700 1 --2- 172.21.15.26:0/2408896027 >> v2:172.21.15.26:3300/0 conn(0x7f39681341d0 0x7f396809de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.204+0000 7f396e529700 1 -- 172.21.15.26:0/2408896027 >> 172.21.15.26:0/2408896027 conn(0x7f39680a2aa0 msgr2=0x7f39680a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:52.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.204+0000 7f396e529700 1 -- 172.21.15.26:0/2408896027 shutdown_connections 2023-10-01T07:58:52.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.204+0000 7f396e529700 1 -- 172.21.15.26:0/2408896027 wait complete. 2023-10-01T07:58:52.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.205+0000 7f396e529700 1 Processor -- start 2023-10-01T07:58:52.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.206+0000 7f396e529700 1 -- start start 2023-10-01T07:58:52.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.206+0000 7f396e529700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f396809e390 0x7f39681cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:52.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.206+0000 7f396e529700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f39681338c0 0x7f39681ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:52.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.206+0000 7f396e529700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f39681341d0 0x7f39681cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:52.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.206+0000 7f396e529700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39681245f0 con 0x7f396809e390 2023-10-01T07:58:52.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.206+0000 7f396e529700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3968130b00 con 0x7f39681338c0 2023-10-01T07:58:52.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.206+0000 7f396e529700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f396809d430 con 0x7f39681341d0 2023-10-01T07:58:52.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.207+0000 7f3967fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f396809e390 0x7f39681cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:52.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.207+0000 7f3967fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f396809e390 0x7f39681cc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50728/0 (socket says 172.21.15.26:50728) 2023-10-01T07:58:52.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.207+0000 7f3967fff700 1 -- 172.21.15.26:0/2556080687 learned_addr learned my addr 172.21.15.26:0/2556080687 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:52.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.207+0000 7f39677fe700 1 --2- 172.21.15.26:0/2556080687 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f39681338c0 0x7f39681ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:52.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.207+0000 7f3967fff700 1 -- 172.21.15.26:0/2556080687 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f39681341d0 msgr2=0x7f39681cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:52.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.207+0000 7f3967fff700 1 --2- 172.21.15.26:0/2556080687 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f39681341d0 0x7f39681cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.207+0000 7f3967fff700 1 -- 172.21.15.26:0/2556080687 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f39681338c0 msgr2=0x7f39681ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:52.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.207+0000 7f3967fff700 1 --2- 172.21.15.26:0/2556080687 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f39681338c0 0x7f39681ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.207+0000 7f3967fff700 1 -- 172.21.15.26:0/2556080687 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3960009a70 con 0x7f396809e390 2023-10-01T07:58:52.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.207+0000 7f39677fe700 1 --2- 172.21.15.26:0/2556080687 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f39681338c0 0x7f39681ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:52.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.207+0000 7f3967fff700 1 --2- 172.21.15.26:0/2556080687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f396809e390 0x7f39681cc870 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f395800e910 tx=0x7f395800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:52.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.207+0000 7f3964ff9700 1 -- 172.21.15.26:0/2556080687 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39580096a0 con 0x7f396809e390 2023-10-01T07:58:52.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.208+0000 7f3964ff9700 1 -- 172.21.15.26:0/2556080687 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395800ee60 con 0x7f396809e390 2023-10-01T07:58:52.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.208+0000 7f396e529700 1 -- 172.21.15.26:0/2556080687 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39681239c0 con 0x7f396809e390 2023-10-01T07:58:52.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.208+0000 7f3964ff9700 1 -- 172.21.15.26:0/2556080687 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395800ca90 con 0x7f396809e390 2023-10-01T07:58:52.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.208+0000 7f396e529700 1 -- 172.21.15.26:0/2556080687 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f396809ca60 con 0x7f396809e390 2023-10-01T07:58:52.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.208+0000 7f3964ff9700 1 -- 172.21.15.26:0/2556080687 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f395800cbf0 con 0x7f396809e390 2023-10-01T07:58:52.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.209+0000 7f3964ff9700 1 -- 172.21.15.26:0/2556080687 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f395803f7c0 con 0x7f396809e390 2023-10-01T07:58:52.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.209+0000 7f396e529700 1 -- 172.21.15.26:0/2556080687 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3968074ea0 con 0x7f396809e390 2023-10-01T07:58:52.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.214+0000 7f3964ff9700 1 -- 172.21.15.26:0/2556080687 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f39580232f0 con 0x7f396809e390 2023-10-01T07:58:52.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.239+0000 7f47e69a0700 1 Processor -- start 2023-10-01T07:58:52.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.239+0000 7f47e69a0700 1 -- start start 2023-10-01T07:58:52.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.240+0000 7f47e69a0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f47e01348a0 0x7f47e0134c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:52.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.240+0000 7f47e69a0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f47e009d100 0x7f47e009d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:52.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.240+0000 7f47e69a0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e009ebc0 con 0x7f47e009da70 2023-10-01T07:58:52.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.240+0000 7f47e69a0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e0095cb0 con 0x7f47e009d100 2023-10-01T07:58:52.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.240+0000 7f47e69a0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47e009e980 con 0x7f47e01348a0 2023-10-01T07:58:52.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.240+0000 7f47e599e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f47e01348a0 0x7f47e0134c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:52.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.240+0000 7f47e619f700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f47e009da70 0x7f47e013ec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:55966/0 (socket says 172.21.15.26:55966) 2023-10-01T07:58:52.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.240+0000 7f47e619f700 1 -- 172.21.15.26:0/3959005527 learned_addr learned my addr 172.21.15.26:0/3959005527 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:52.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.240+0000 7f47e599e700 1 -- 172.21.15.26:0/3959005527 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f47e009d100 msgr2=0x7f47e009d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:52.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.240+0000 7f47e499c700 1 -- 172.21.15.26:0/3959005527 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761339796 0 0) 0x7f47e009ebc0 con 0x7f47e009da70 2023-10-01T07:58:52.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.240+0000 7f47e599e700 1 --2- 172.21.15.26:0/3959005527 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f47e009d100 0x7f47e009d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.240+0000 7f47e599e700 1 -- 172.21.15.26:0/3959005527 >> v1:172.21.15.26:6789/0 conn(0x7f47e009da70 legacy=0x7f47e013ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:52.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.240+0000 7f47e599e700 1 -- 172.21.15.26:0/3959005527 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e0094ec0 con 0x7f47e01348a0 2023-10-01T07:58:52.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.241+0000 7f47e599e700 1 --2- 172.21.15.26:0/3959005527 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f47e01348a0 0x7f47e0134c70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009850 tx=0x7f47dc009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cde5332ccd7435b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:52.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.241+0000 7f47e499c700 1 -- 172.21.15.26:0/3959005527 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc005e30 con 0x7f47e01348a0 2023-10-01T07:58:52.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.241+0000 7f47e499c700 1 -- 172.21.15.26:0/3959005527 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47dc006030 con 0x7f47e01348a0 2023-10-01T07:58:52.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.241+0000 7f47e499c700 1 -- 172.21.15.26:0/3959005527 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc0063c0 con 0x7f47e01348a0 2023-10-01T07:58:52.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.242+0000 7f47e69a0700 1 -- 172.21.15.26:0/3959005527 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f47e01348a0 msgr2=0x7f47e0134c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:52.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.242+0000 7f47e69a0700 1 --2- 172.21.15.26:0/3959005527 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f47e01348a0 0x7f47e0134c70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009850 tx=0x7f47dc009b60 comp rx=0 tx=0).stop 2023-10-01T07:58:52.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.242+0000 7f47e69a0700 1 -- 172.21.15.26:0/3959005527 shutdown_connections 2023-10-01T07:58:52.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.242+0000 7f47e69a0700 1 --2- 172.21.15.26:0/3959005527 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f47e01348a0 0x7f47e0134c70 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.242+0000 7f47e69a0700 1 --2- 172.21.15.26:0/3959005527 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f47e009d100 0x7f47e009d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.242+0000 7f47e69a0700 1 -- 172.21.15.26:0/3959005527 >> 172.21.15.26:0/3959005527 conn(0x7f47e00a2540 msgr2=0x7f47e00a2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:52.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.242+0000 7f47e69a0700 1 -- 172.21.15.26:0/3959005527 shutdown_connections 2023-10-01T07:58:52.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.242+0000 7f47e69a0700 1 -- 172.21.15.26:0/3959005527 wait complete. 2023-10-01T07:58:52.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.243+0000 7f47e69a0700 1 Processor -- start 2023-10-01T07:58:52.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.244+0000 7f47e69a0700 1 -- start start 2023-10-01T07:58:52.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.244+0000 7f47e69a0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f47e009d100 0x7f47e0132760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:52.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.244+0000 7f47e69a0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47e009da70 0x7f47e0132ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:52.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.244+0000 7f47e69a0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f47e01348a0 0x7f47e0133750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:52.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.244+0000 7f47e69a0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e0071490 con 0x7f47e009da70 2023-10-01T07:58:52.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.244+0000 7f47e69a0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e0070ee0 con 0x7f47e009d100 2023-10-01T07:58:52.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.244+0000 7f47e69a0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47e006e040 con 0x7f47e01348a0 2023-10-01T07:58:52.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.245+0000 7f47e599e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f47e009d100 0x7f47e0132760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:52.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.245+0000 7f47e599e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f47e009d100 0x7f47e0132760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:59044/0 (socket says 172.21.15.26:59044) 2023-10-01T07:58:52.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.245+0000 7f47e599e700 1 -- 172.21.15.26:0/1527005112 learned_addr learned my addr 172.21.15.26:0/1527005112 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:52.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.245+0000 7f47e519d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47e009da70 0x7f47e0132ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:52.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.245+0000 7f47e619f700 1 --2- 172.21.15.26:0/1527005112 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f47e01348a0 0x7f47e0133750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:52.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.245+0000 7f47e599e700 1 -- 172.21.15.26:0/1527005112 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f47e01348a0 msgr2=0x7f47e0133750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:52.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.245+0000 7f47e599e700 1 --2- 172.21.15.26:0/1527005112 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f47e01348a0 0x7f47e0133750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.245+0000 7f47e599e700 1 -- 172.21.15.26:0/1527005112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47e009da70 msgr2=0x7f47e0132ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:52.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.245+0000 7f47e599e700 1 --2- 172.21.15.26:0/1527005112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47e009da70 0x7f47e0132ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.245+0000 7f47e599e700 1 -- 172.21.15.26:0/1527005112 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47dc009430 con 0x7f47e009d100 2023-10-01T07:58:52.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.245+0000 7f47e519d700 1 --2- 172.21.15.26:0/1527005112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47e009da70 0x7f47e0132ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:58:52.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.245+0000 7f47e599e700 1 --2- 172.21.15.26:0/1527005112 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f47e009d100 0x7f47e0132760 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009fd0 tx=0x7f47dc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:52.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.246+0000 7f47d67fc700 1 -- 172.21.15.26:0/1527005112 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc004240 con 0x7f47e009d100 2023-10-01T07:58:52.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.246+0000 7f47d67fc700 1 -- 172.21.15.26:0/1527005112 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47dc0043a0 con 0x7f47e009d100 2023-10-01T07:58:52.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.246+0000 7f47d67fc700 1 -- 172.21.15.26:0/1527005112 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc0036a0 con 0x7f47e009d100 2023-10-01T07:58:52.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.246+0000 7f47e69a0700 1 -- 172.21.15.26:0/1527005112 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e0072ac0 con 0x7f47e009d100 2023-10-01T07:58:52.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.246+0000 7f47e69a0700 1 -- 172.21.15.26:0/1527005112 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e0072350 con 0x7f47e009d100 2023-10-01T07:58:52.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.247+0000 7f47e69a0700 1 -- 172.21.15.26:0/1527005112 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e0074740 con 0x7f47e009d100 2023-10-01T07:58:52.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.247+0000 7f47d67fc700 1 -- 172.21.15.26:0/1527005112 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f47dc022020 con 0x7f47e009d100 2023-10-01T07:58:52.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.247+0000 7f47d67fc700 1 -- 172.21.15.26:0/1527005112 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f47dc041080 con 0x7f47e009d100 2023-10-01T07:58:52.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.257+0000 7f47d67fc700 1 -- 172.21.15.26:0/1527005112 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f47dc00ba10 con 0x7f47e009d100 2023-10-01T07:58:52.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.288+0000 7f87b8c50700 1 Processor -- start 2023-10-01T07:58:52.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.288+0000 7f87b8c50700 1 -- start start 2023-10-01T07:58:52.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.289+0000 7f87b8c50700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f87b40a0a30 0x7f87b40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:52.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.289+0000 7f87b8c50700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f87b40a1340 0x7f87b4133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:52.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.289+0000 7f87b8c50700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f87b4133fa0 0x7f87b4134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:52.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.289+0000 7f87b8c50700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87b409edd0 con 0x7f87b40a0a30 2023-10-01T07:58:52.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.289+0000 7f87b8c50700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b409e1f0 con 0x7f87b4133fa0 2023-10-01T07:58:52.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.289+0000 7f87b8c50700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87b409dc50 con 0x7f87b40a1340 2023-10-01T07:58:52.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.289+0000 7f87b2d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f87b4133fa0 0x7f87b4134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:52.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.289+0000 7f87b2d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f87b4133fa0 0x7f87b4134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:59046/0 (socket says 172.21.15.26:59046) 2023-10-01T07:58:52.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.289+0000 7f87b2d9d700 1 -- 172.21.15.26:0/328775901 learned_addr learned my addr 172.21.15.26:0/328775901 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:52.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.289+0000 7f87b1d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f87b40a1340 0x7f87b4133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:52.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.289+0000 7f87b259c700 1 --2- 172.21.15.26:0/328775901 >> v2:172.21.15.26:3300/0 conn(0x7f87b40a0a30 0x7f87b40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:52.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.289+0000 7f87b2d9d700 1 -- 172.21.15.26:0/328775901 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f87b40a1340 msgr2=0x7f87b4133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:52.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.289+0000 7f87b2d9d700 1 --2- 172.21.15.26:0/328775901 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f87b40a1340 0x7f87b4133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.289+0000 7f87b2d9d700 1 -- 172.21.15.26:0/328775901 >> v2:172.21.15.26:3300/0 conn(0x7f87b40a0a30 msgr2=0x7f87b40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:52.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.289+0000 7f87b2d9d700 1 --2- 172.21.15.26:0/328775901 >> v2:172.21.15.26:3300/0 conn(0x7f87b40a0a30 0x7f87b40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.289+0000 7f87b2d9d700 1 -- 172.21.15.26:0/328775901 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b40a1fe0 con 0x7f87b4133fa0 2023-10-01T07:58:52.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.289+0000 7f87b1d9b700 1 --2- 172.21.15.26:0/328775901 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f87b40a1340 0x7f87b4133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:52.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.290+0000 7f87b2d9d700 1 --2- 172.21.15.26:0/328775901 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f87b4133fa0 0x7f87b4134410 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f87ac009e80 tx=0x7f87ac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96372f33291d6504 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:52.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.290+0000 7f87b159a700 1 -- 172.21.15.26:0/328775901 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ac00e070 con 0x7f87b4133fa0 2023-10-01T07:58:52.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.290+0000 7f87b159a700 1 -- 172.21.15.26:0/328775901 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87ac00b8d0 con 0x7f87b4133fa0 2023-10-01T07:58:52.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.290+0000 7f87b159a700 1 -- 172.21.15.26:0/328775901 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ac00bc80 con 0x7f87b4133fa0 2023-10-01T07:58:52.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.291+0000 7f87b8c50700 1 -- 172.21.15.26:0/328775901 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f87b4133fa0 msgr2=0x7f87b4134410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:52.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.291+0000 7f87b8c50700 1 --2- 172.21.15.26:0/328775901 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f87b4133fa0 0x7f87b4134410 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f87ac009e80 tx=0x7f87ac00b330 comp rx=0 tx=0).stop 2023-10-01T07:58:52.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.291+0000 7f87b8c50700 1 -- 172.21.15.26:0/328775901 shutdown_connections 2023-10-01T07:58:52.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.291+0000 7f87b8c50700 1 --2- 172.21.15.26:0/328775901 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f87b4133fa0 0x7f87b4134410 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.291+0000 7f87b8c50700 1 --2- 172.21.15.26:0/328775901 >> v2:172.21.15.26:3300/0 conn(0x7f87b40a0a30 0x7f87b40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.291+0000 7f87b8c50700 1 --2- 172.21.15.26:0/328775901 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f87b40a1340 0x7f87b4133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.291+0000 7f87b8c50700 1 -- 172.21.15.26:0/328775901 >> 172.21.15.26:0/328775901 conn(0x7f87b40a6550 msgr2=0x7f87b40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:52.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.291+0000 7f87b8c50700 1 -- 172.21.15.26:0/328775901 shutdown_connections 2023-10-01T07:58:52.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.291+0000 7f87b8c50700 1 -- 172.21.15.26:0/328775901 wait complete. 2023-10-01T07:58:52.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.293+0000 7f87b8c50700 1 Processor -- start 2023-10-01T07:58:52.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.293+0000 7f87b8c50700 1 -- start start 2023-10-01T07:58:52.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.294+0000 7f87b8c50700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87b40a0a30 0x7f87b41200a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:52.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.294+0000 7f87b8c50700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f87b40a1340 0x7f87b41205e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:52.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.294+0000 7f87b8c50700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f87b4133fa0 0x7f87b4120b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:52.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.294+0000 7f87b8c50700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b4121d70 con 0x7f87b40a0a30 2023-10-01T07:58:52.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.294+0000 7f87b8c50700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b40a6b20 con 0x7f87b40a1340 2023-10-01T07:58:52.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.294+0000 7f87b8c50700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87b40a0220 con 0x7f87b4133fa0 2023-10-01T07:58:52.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.294+0000 7f87b259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87b40a0a30 0x7f87b41200a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:52.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.294+0000 7f87b259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87b40a0a30 0x7f87b41200a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50760/0 (socket says 172.21.15.26:50760) 2023-10-01T07:58:52.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.294+0000 7f87b259c700 1 -- 172.21.15.26:0/2300890040 learned_addr learned my addr 172.21.15.26:0/2300890040 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:52.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.294+0000 7f87b1d9b700 1 --2- 172.21.15.26:0/2300890040 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f87b40a1340 0x7f87b41205e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:52.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.294+0000 7f87b2d9d700 1 --2- 172.21.15.26:0/2300890040 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f87b4133fa0 0x7f87b4120b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:52.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.294+0000 7f87b259c700 1 -- 172.21.15.26:0/2300890040 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f87b4133fa0 msgr2=0x7f87b4120b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:52.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.294+0000 7f87b259c700 1 --2- 172.21.15.26:0/2300890040 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f87b4133fa0 0x7f87b4120b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.294+0000 7f87b259c700 1 -- 172.21.15.26:0/2300890040 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f87b40a1340 msgr2=0x7f87b41205e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:52.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.294+0000 7f87b259c700 1 --2- 172.21.15.26:0/2300890040 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f87b40a1340 0x7f87b41205e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.294+0000 7f87b259c700 1 -- 172.21.15.26:0/2300890040 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a80094a0 con 0x7f87b40a0a30 2023-10-01T07:58:52.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.295+0000 7f87b1d9b700 1 --2- 172.21.15.26:0/2300890040 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f87b40a1340 0x7f87b41205e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:52.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.295+0000 7f87b259c700 1 --2- 172.21.15.26:0/2300890040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87b40a0a30 0x7f87b41200a0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f87a400e9b0 tx=0x7f87a400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:52.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.295+0000 7f87a2ffd700 1 -- 172.21.15.26:0/2300890040 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a4009710 con 0x7f87b40a0a30 2023-10-01T07:58:52.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.295+0000 7f87a2ffd700 1 -- 172.21.15.26:0/2300890040 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a400ee50 con 0x7f87b40a0a30 2023-10-01T07:58:52.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.295+0000 7f87b8c50700 1 -- 172.21.15.26:0/2300890040 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87ac009b30 con 0x7f87b40a0a30 2023-10-01T07:58:52.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.295+0000 7f87a2ffd700 1 -- 172.21.15.26:0/2300890040 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a400ca50 con 0x7f87b40a0a30 2023-10-01T07:58:52.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.295+0000 7f87b8c50700 1 -- 172.21.15.26:0/2300890040 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87b4123b70 con 0x7f87b40a0a30 2023-10-01T07:58:52.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.296+0000 7f87b8c50700 1 -- 172.21.15.26:0/2300890040 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87b4074ea0 con 0x7f87b40a0a30 2023-10-01T07:58:52.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.296+0000 7f87a2ffd700 1 -- 172.21.15.26:0/2300890040 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f87a400cbb0 con 0x7f87b40a0a30 2023-10-01T07:58:52.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.296+0000 7f87a2ffd700 1 -- 172.21.15.26:0/2300890040 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f87a403f770 con 0x7f87b40a0a30 2023-10-01T07:58:52.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.305+0000 7f87a2ffd700 1 -- 172.21.15.26:0/2300890040 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f87a401be10 con 0x7f87b40a0a30 2023-10-01T07:58:52.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.341+0000 7f52d377c700 1 Processor -- start 2023-10-01T07:58:52.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.341+0000 7f52d377c700 1 -- start start 2023-10-01T07:58:52.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.342+0000 7f52d377c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f52cc133420 0x7f52cc1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:52.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.342+0000 7f52d377c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f52cc134260 0x7f52cc1306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:52.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.342+0000 7f52d377c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52cc06b990 con 0x7f52cc133e30 2023-10-01T07:58:52.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.342+0000 7f52d377c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52cc0a0590 con 0x7f52cc133420 2023-10-01T07:58:52.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.342+0000 7f52d377c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc09fb80 con 0x7f52cc134260 2023-10-01T07:58:52.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.343+0000 7f52d1d19700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f52cc134260 0x7f52cc1306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:52.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.343+0000 7f52d1518700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f52cc133420 0x7f52cc1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:52.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.343+0000 7f52d0d17700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f52cc133e30 0x7f52cc12ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:55978/0 (socket says 172.21.15.26:55978) 2023-10-01T07:58:52.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.343+0000 7f52d1d19700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f52cc134260 0x7f52cc1306a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:52830/0 (socket says 172.21.15.26:52830) 2023-10-01T07:58:52.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.343+0000 7f52d0d17700 1 -- 172.21.15.26:0/2069512943 learned_addr learned my addr 172.21.15.26:0/2069512943 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:52.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.343+0000 7f52d1518700 1 -- 172.21.15.26:0/2069512943 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f52cc134260 msgr2=0x7f52cc1306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:52.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.343+0000 7f52d1518700 1 --2- 172.21.15.26:0/2069512943 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f52cc134260 0x7f52cc1306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.343+0000 7f52d1518700 1 -- 172.21.15.26:0/2069512943 >> v1:172.21.15.26:6789/0 conn(0x7f52cc133e30 legacy=0x7f52cc12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:52.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.343+0000 7f52d1518700 1 -- 172.21.15.26:0/2069512943 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52cc0a0030 con 0x7f52cc133420 2023-10-01T07:58:52.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.343+0000 7f52c3fff700 1 -- 172.21.15.26:0/2069512943 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1768900740 0 0) 0x7f52cc06b990 con 0x7f52cc133e30 2023-10-01T07:58:52.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.343+0000 7f52d1518700 1 --2- 172.21.15.26:0/2069512943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52cc133420 0x7f52cc1337f0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f52c8009840 tx=0x7f52c8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc6a6c018c43882 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:52.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.343+0000 7f52c3fff700 1 -- 172.21.15.26:0/2069512943 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c8011830 con 0x7f52cc133420 2023-10-01T07:58:52.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.344+0000 7f52c3fff700 1 -- 172.21.15.26:0/2069512943 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c8011990 con 0x7f52cc133420 2023-10-01T07:58:52.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.344+0000 7f52c3fff700 1 -- 172.21.15.26:0/2069512943 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c8011d20 con 0x7f52cc133420 2023-10-01T07:58:52.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.344+0000 7f52d377c700 1 -- 172.21.15.26:0/2069512943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52cc133420 msgr2=0x7f52cc1337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:52.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.344+0000 7f52d377c700 1 --2- 172.21.15.26:0/2069512943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52cc133420 0x7f52cc1337f0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f52c8009840 tx=0x7f52c8009b50 comp rx=0 tx=0).stop 2023-10-01T07:58:52.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.345+0000 7f52d377c700 1 -- 172.21.15.26:0/2069512943 shutdown_connections 2023-10-01T07:58:52.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.345+0000 7f52d377c700 1 --2- 172.21.15.26:0/2069512943 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f52cc134260 0x7f52cc1306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.345+0000 7f52d377c700 1 --2- 172.21.15.26:0/2069512943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52cc133420 0x7f52cc1337f0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.345+0000 7f52d377c700 1 -- 172.21.15.26:0/2069512943 >> 172.21.15.26:0/2069512943 conn(0x7f52cc0a4210 msgr2=0x7f52cc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:52.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.345+0000 7f52d377c700 1 -- 172.21.15.26:0/2069512943 shutdown_connections 2023-10-01T07:58:52.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.345+0000 7f52d377c700 1 -- 172.21.15.26:0/2069512943 wait complete. 2023-10-01T07:58:52.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.346+0000 7f52d377c700 1 Processor -- start 2023-10-01T07:58:52.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.346+0000 7f52d377c700 1 -- start start 2023-10-01T07:58:52.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.347+0000 7f52d377c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52cc133420 0x7f52cc09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:52.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.347+0000 7f52d377c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f52cc133e30 0x7f52cc09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:52.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.347+0000 7f52d377c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f52cc134260 0x7f52cc09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:52.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.347+0000 7f52d377c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc131690 con 0x7f52cc133420 2023-10-01T07:58:52.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.347+0000 7f52d377c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc1200b0 con 0x7f52cc134260 2023-10-01T07:58:52.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.347+0000 7f52d377c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc11fe20 con 0x7f52cc133e30 2023-10-01T07:58:52.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.347+0000 7f52d1518700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52cc133420 0x7f52cc09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:52.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.347+0000 7f52d1518700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52cc133420 0x7f52cc09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50780/0 (socket says 172.21.15.26:50780) 2023-10-01T07:58:52.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.347+0000 7f52d1518700 1 -- 172.21.15.26:0/1654953747 learned_addr learned my addr 172.21.15.26:0/1654953747 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:52.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.347+0000 7f52d1d19700 1 --2- 172.21.15.26:0/1654953747 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f52cc134260 0x7f52cc09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:52.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.347+0000 7f52d0d17700 1 --2- 172.21.15.26:0/1654953747 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f52cc133e30 0x7f52cc09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:52.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.348+0000 7f52d1518700 1 -- 172.21.15.26:0/1654953747 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f52cc133e30 msgr2=0x7f52cc09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:52.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.348+0000 7f52d1518700 1 --2- 172.21.15.26:0/1654953747 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f52cc133e30 0x7f52cc09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.348+0000 7f52d1518700 1 -- 172.21.15.26:0/1654953747 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f52cc134260 msgr2=0x7f52cc09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:52.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.348+0000 7f52d1518700 1 --2- 172.21.15.26:0/1654953747 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f52cc134260 0x7f52cc09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.348+0000 7f52d1518700 1 -- 172.21.15.26:0/1654953747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c80094a0 con 0x7f52cc133420 2023-10-01T07:58:52.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.348+0000 7f52d1518700 1 --2- 172.21.15.26:0/1654953747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52cc133420 0x7f52cc09c480 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f52c8009fd0 tx=0x7f52c8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:52.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.348+0000 7f52c1ffb700 1 -- 172.21.15.26:0/1654953747 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c80036a0 con 0x7f52cc133420 2023-10-01T07:58:52.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.348+0000 7f52c1ffb700 1 -- 172.21.15.26:0/1654953747 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c801f070 con 0x7f52cc133420 2023-10-01T07:58:52.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.348+0000 7f52c1ffb700 1 -- 172.21.15.26:0/1654953747 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c8003a60 con 0x7f52cc133420 2023-10-01T07:58:52.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.348+0000 7f52d377c700 1 -- 172.21.15.26:0/1654953747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52cc09e020 con 0x7f52cc133420 2023-10-01T07:58:52.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.348+0000 7f52d377c700 1 -- 172.21.15.26:0/1654953747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52cc120b20 con 0x7f52cc133420 2023-10-01T07:58:52.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.350+0000 7f52c1ffb700 1 -- 172.21.15.26:0/1654953747 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f52c8003bc0 con 0x7f52cc133420 2023-10-01T07:58:52.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.350+0000 7f52c1ffb700 1 -- 172.21.15.26:0/1654953747 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f52c8021070 con 0x7f52cc133420 2023-10-01T07:58:52.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.350+0000 7f52d377c700 1 -- 172.21.15.26:0/1654953747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52cc132eb0 con 0x7f52cc133420 2023-10-01T07:58:52.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.360+0000 7f52c1ffb700 1 -- 172.21.15.26:0/1654953747 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f52c8015020 con 0x7f52cc133420 2023-10-01T07:58:52.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.463+0000 7f396e529700 1 -- 172.21.15.26:0/2556080687 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f396806b9e0 con 0x7f396809e390 2023-10-01T07:58:52.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.463+0000 7f3964ff9700 1 -- 172.21.15.26:0/2556080687 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3958011350 con 0x7f396809e390 2023-10-01T07:58:52.464 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:52.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.465+0000 7f396e529700 1 -- 172.21.15.26:0/2556080687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f396809e390 msgr2=0x7f39681cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:52.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.465+0000 7f396e529700 1 --2- 172.21.15.26:0/2556080687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f396809e390 0x7f39681cc870 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f395800e910 tx=0x7f395800ec20 comp rx=0 tx=0).stop 2023-10-01T07:58:52.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.466+0000 7f396e529700 1 -- 172.21.15.26:0/2556080687 shutdown_connections 2023-10-01T07:58:52.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.466+0000 7f396e529700 1 --2- 172.21.15.26:0/2556080687 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f39681341d0 0x7f39681cd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.466+0000 7f396e529700 1 --2- 172.21.15.26:0/2556080687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f396809e390 0x7f39681cc870 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.466+0000 7f396e529700 1 --2- 172.21.15.26:0/2556080687 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f39681338c0 0x7f39681ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.466+0000 7f396e529700 1 -- 172.21.15.26:0/2556080687 >> 172.21.15.26:0/2556080687 conn(0x7f39680a2aa0 msgr2=0x7f3968132170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:52.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.466+0000 7f396e529700 1 -- 172.21.15.26:0/2556080687 shutdown_connections 2023-10-01T07:58:52.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.466+0000 7f396e529700 1 -- 172.21.15.26:0/2556080687 wait complete. 2023-10-01T07:58:52.480 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:52.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.506+0000 7f47e69a0700 1 -- 172.21.15.26:0/1527005112 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f47e00716d0 con 0x7f47e009d100 2023-10-01T07:58:52.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.506+0000 7f47d67fc700 1 -- 172.21.15.26:0/1527005112 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f47dc02a020 con 0x7f47e009d100 2023-10-01T07:58:52.507 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:52.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.508+0000 7f47e69a0700 1 -- 172.21.15.26:0/1527005112 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f47e009d100 msgr2=0x7f47e0132760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:52.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.508+0000 7f47e69a0700 1 --2- 172.21.15.26:0/1527005112 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f47e009d100 0x7f47e0132760 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009fd0 tx=0x7f47dc004750 comp rx=0 tx=0).stop 2023-10-01T07:58:52.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.508+0000 7f47e69a0700 1 -- 172.21.15.26:0/1527005112 shutdown_connections 2023-10-01T07:58:52.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.508+0000 7f47e69a0700 1 --2- 172.21.15.26:0/1527005112 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f47e01348a0 0x7f47e0133750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.508+0000 7f47e69a0700 1 --2- 172.21.15.26:0/1527005112 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f47e009d100 0x7f47e0132760 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.508+0000 7f47e69a0700 1 --2- 172.21.15.26:0/1527005112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47e009da70 0x7f47e0132ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.508+0000 7f47e69a0700 1 -- 172.21.15.26:0/1527005112 >> 172.21.15.26:0/1527005112 conn(0x7f47e00a2540 msgr2=0x7f47e009edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:52.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.509+0000 7f47e69a0700 1 -- 172.21.15.26:0/1527005112 shutdown_connections 2023-10-01T07:58:52.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.509+0000 7f47e69a0700 1 -- 172.21.15.26:0/1527005112 wait complete. 2023-10-01T07:58:52.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.521+0000 7f87b8c50700 1 -- 172.21.15.26:0/2300890040 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f87b4123660 con 0x7f87b40a0a30 2023-10-01T07:58:52.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.521+0000 7f87a2ffd700 1 -- 172.21.15.26:0/2300890040 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f87a4017090 con 0x7f87b40a0a30 2023-10-01T07:58:52.522 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:52.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.523+0000 7f87b8c50700 1 -- 172.21.15.26:0/2300890040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87b40a0a30 msgr2=0x7f87b41200a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:52.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.523+0000 7f87b8c50700 1 --2- 172.21.15.26:0/2300890040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87b40a0a30 0x7f87b41200a0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f87a400e9b0 tx=0x7f87a400ecc0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.523+0000 7f87b8c50700 1 -- 172.21.15.26:0/2300890040 shutdown_connections 2023-10-01T07:58:52.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.523+0000 7f87b8c50700 1 --2- 172.21.15.26:0/2300890040 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f87b4133fa0 0x7f87b4120b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.523+0000 7f87b8c50700 1 --2- 172.21.15.26:0/2300890040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87b40a0a30 0x7f87b41200a0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.523+0000 7f87b8c50700 1 --2- 172.21.15.26:0/2300890040 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f87b40a1340 0x7f87b41205e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.523+0000 7f87b8c50700 1 -- 172.21.15.26:0/2300890040 >> 172.21.15.26:0/2300890040 conn(0x7f87b40a6550 msgr2=0x7f87b409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:52.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.523+0000 7f87b8c50700 1 -- 172.21.15.26:0/2300890040 shutdown_connections 2023-10-01T07:58:52.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.523+0000 7f87b8c50700 1 -- 172.21.15.26:0/2300890040 wait complete. 2023-10-01T07:58:52.526 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:52.538 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:52.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.572+0000 7f52d377c700 1 -- 172.21.15.26:0/1654953747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f52cc074ea0 con 0x7f52cc133420 2023-10-01T07:58:52.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.572+0000 7f52c1ffb700 1 -- 172.21.15.26:0/1654953747 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f52c8042020 con 0x7f52cc133420 2023-10-01T07:58:52.573 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:52.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.574+0000 7f52d377c700 1 -- 172.21.15.26:0/1654953747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52cc133420 msgr2=0x7f52cc09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:52.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.575+0000 7f52d377c700 1 --2- 172.21.15.26:0/1654953747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52cc133420 0x7f52cc09c480 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f52c8009fd0 tx=0x7f52c8004750 comp rx=0 tx=0).stop 2023-10-01T07:58:52.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.575+0000 7f52d377c700 1 -- 172.21.15.26:0/1654953747 shutdown_connections 2023-10-01T07:58:52.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.575+0000 7f52d377c700 1 --2- 172.21.15.26:0/1654953747 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f52cc134260 0x7f52cc09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.575+0000 7f52d377c700 1 --2- 172.21.15.26:0/1654953747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52cc133420 0x7f52cc09c480 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.575+0000 7f52d377c700 1 --2- 172.21.15.26:0/1654953747 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f52cc133e30 0x7f52cc09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:52.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.575+0000 7f52d377c700 1 -- 172.21.15.26:0/1654953747 >> 172.21.15.26:0/1654953747 conn(0x7f52cc0a4210 msgr2=0x7f52cc0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:52.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.575+0000 7f52d377c700 1 -- 172.21.15.26:0/1654953747 shutdown_connections 2023-10-01T07:58:52.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:52.575+0000 7f52d377c700 1 -- 172.21.15.26:0/1654953747 wait complete. 2023-10-01T07:58:52.588 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:53.481 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:53.527 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:53.538 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:53.590 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:53.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.632+0000 7fcf12d84700 1 Processor -- start 2023-10-01T07:58:53.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.632+0000 7fcf12d84700 1 -- start start 2023-10-01T07:58:53.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.632+0000 7fcf12d84700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf0c09d6f0 0x7fcf0c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:53.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.632+0000 7fcf12d84700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf0c09e000 0x7fcf0c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:53.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.632+0000 7fcf12d84700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf0c09f130 con 0x7fcf0c09e410 2023-10-01T07:58:53.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.632+0000 7fcf12d84700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c09f520 con 0x7fcf0c09e000 2023-10-01T07:58:53.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.632+0000 7fcf12d84700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c09e930 con 0x7fcf0c09d6f0 2023-10-01T07:58:53.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.633+0000 7fcf10b20700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf0c09d6f0 0x7fcf0c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:53.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.633+0000 7fcf10b20700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf0c09d6f0 0x7fcf0c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37148/0 (socket says 172.21.15.26:37148) 2023-10-01T07:58:53.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.633+0000 7fcf10b20700 1 -- 172.21.15.26:0/3666445069 learned_addr learned my addr 172.21.15.26:0/3666445069 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:53.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.633+0000 7fcf0bfff700 1 --2- 172.21.15.26:0/3666445069 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf0c09e000 0x7fcf0c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:53.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.633+0000 7fcf10b20700 1 -- 172.21.15.26:0/3666445069 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf0c09e000 msgr2=0x7fcf0c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:53.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.633+0000 7fcf10b20700 1 --2- 172.21.15.26:0/3666445069 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf0c09e000 0x7fcf0c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:53.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.633+0000 7fcf10b20700 1 -- 172.21.15.26:0/3666445069 >> v1:172.21.15.26:6789/0 conn(0x7fcf0c09e410 legacy=0x7fcf0c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:53.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.633+0000 7fcf10b20700 1 -- 172.21.15.26:0/3666445069 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0c09b2d0 con 0x7fcf0c09d6f0 2023-10-01T07:58:53.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.633+0000 7fcf10b20700 1 --2- 172.21.15.26:0/3666445069 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf0c09d6f0 0x7fcf0c09dac0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fcf00009950 tx=0x7fcf00009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e0976dfe695a8e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:53.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.634+0000 7fcf0b7fe700 1 -- 172.21.15.26:0/3666445069 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf00011830 con 0x7fcf0c09d6f0 2023-10-01T07:58:53.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.634+0000 7fcf0b7fe700 1 -- 172.21.15.26:0/3666445069 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf00011990 con 0x7fcf0c09d6f0 2023-10-01T07:58:53.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.634+0000 7fcf0b7fe700 1 -- 172.21.15.26:0/3666445069 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf00011d40 con 0x7fcf0c09d6f0 2023-10-01T07:58:53.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.634+0000 7fcf12d84700 1 -- 172.21.15.26:0/3666445069 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf0c09d6f0 msgr2=0x7fcf0c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:53.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.634+0000 7fcf12d84700 1 --2- 172.21.15.26:0/3666445069 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf0c09d6f0 0x7fcf0c09dac0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fcf00009950 tx=0x7fcf00009c60 comp rx=0 tx=0).stop 2023-10-01T07:58:53.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.634+0000 7fcf12d84700 1 -- 172.21.15.26:0/3666445069 shutdown_connections 2023-10-01T07:58:53.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.634+0000 7fcf12d84700 1 --2- 172.21.15.26:0/3666445069 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf0c09d6f0 0x7fcf0c09dac0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:53.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.634+0000 7fcf12d84700 1 --2- 172.21.15.26:0/3666445069 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf0c09e000 0x7fcf0c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:53.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.635+0000 7fcf12d84700 1 -- 172.21.15.26:0/3666445069 >> 172.21.15.26:0/3666445069 conn(0x7fcf0c066f50 msgr2=0x7fcf0c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:53.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.635+0000 7fcf12d84700 1 -- 172.21.15.26:0/3666445069 shutdown_connections 2023-10-01T07:58:53.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.635+0000 7fcf12d84700 1 -- 172.21.15.26:0/3666445069 wait complete. 2023-10-01T07:58:53.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.636+0000 7fcf12d84700 1 Processor -- start 2023-10-01T07:58:53.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.636+0000 7fcf12d84700 1 -- start start 2023-10-01T07:58:53.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.637+0000 7fcf12d84700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf0c09d6f0 0x7fcf0c122420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:53.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.637+0000 7fcf12d84700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf0c09e000 0x7fcf0c122960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:53.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.637+0000 7fcf12d84700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf0c09e410 0x7fcf0c122ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:53.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.637+0000 7fcf12d84700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c1248e0 con 0x7fcf0c09e000 2023-10-01T07:58:53.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.637+0000 7fcf12d84700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c124200 con 0x7fcf0c09e410 2023-10-01T07:58:53.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.637+0000 7fcf12d84700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c0a1d00 con 0x7fcf0c09d6f0 2023-10-01T07:58:53.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.637+0000 7fcf10b20700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf0c09d6f0 0x7fcf0c122420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:53.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.637+0000 7fcf10b20700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf0c09d6f0 0x7fcf0c122420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37156/0 (socket says 172.21.15.26:37156) 2023-10-01T07:58:53.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.637+0000 7fcf10b20700 1 -- 172.21.15.26:0/3489895703 learned_addr learned my addr 172.21.15.26:0/3489895703 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:53.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.637+0000 7fcf11321700 1 --2- 172.21.15.26:0/3489895703 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf0c09e410 0x7fcf0c122ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:53.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.638+0000 7fcf0bfff700 1 --2- 172.21.15.26:0/3489895703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf0c09e000 0x7fcf0c122960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:53.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.638+0000 7fcf10b20700 1 -- 172.21.15.26:0/3489895703 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf0c09e410 msgr2=0x7fcf0c122ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:53.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.638+0000 7fcf10b20700 1 --2- 172.21.15.26:0/3489895703 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf0c09e410 0x7fcf0c122ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:53.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.638+0000 7fcf10b20700 1 -- 172.21.15.26:0/3489895703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf0c09e000 msgr2=0x7fcf0c122960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:53.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.638+0000 7fcf10b20700 1 --2- 172.21.15.26:0/3489895703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf0c09e000 0x7fcf0c122960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:53.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.638+0000 7fcf10b20700 1 -- 172.21.15.26:0/3489895703 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf00009550 con 0x7fcf0c09d6f0 2023-10-01T07:58:53.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.638+0000 7fcf10b20700 1 --2- 172.21.15.26:0/3489895703 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf0c09d6f0 0x7fcf0c122420 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c09ea70 tx=0x7fcf00004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:53.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.638+0000 7fcf097fa700 1 -- 172.21.15.26:0/3489895703 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf00004240 con 0x7fcf0c09d6f0 2023-10-01T07:58:53.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.639+0000 7fcf097fa700 1 -- 172.21.15.26:0/3489895703 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0001f070 con 0x7fcf0c09d6f0 2023-10-01T07:58:53.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.639+0000 7fcf12d84700 1 -- 172.21.15.26:0/3489895703 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf0c125f20 con 0x7fcf0c09d6f0 2023-10-01T07:58:53.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.639+0000 7fcf097fa700 1 -- 172.21.15.26:0/3489895703 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf000036a0 con 0x7fcf0c09d6f0 2023-10-01T07:58:53.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.639+0000 7fcf12d84700 1 -- 172.21.15.26:0/3489895703 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf0c09c700 con 0x7fcf0c09d6f0 2023-10-01T07:58:53.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.640+0000 7fcef6ffd700 1 -- 172.21.15.26:0/3489895703 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee40052e0 con 0x7fcf0c09d6f0 2023-10-01T07:58:53.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.640+0000 7fcf097fa700 1 -- 172.21.15.26:0/3489895703 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcf00021030 con 0x7fcf0c09d6f0 2023-10-01T07:58:53.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.641+0000 7fcf097fa700 1 -- 172.21.15.26:0/3489895703 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcf000408a0 con 0x7fcf0c09d6f0 2023-10-01T07:58:53.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.646+0000 7fcf097fa700 1 -- 172.21.15.26:0/3489895703 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcf000239c0 con 0x7fcf0c09d6f0 2023-10-01T07:58:53.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.683+0000 7ff523d43700 1 Processor -- start 2023-10-01T07:58:53.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.683+0000 7ff523d43700 1 -- start start 2023-10-01T07:58:53.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.684+0000 7ff523d43700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff51c133420 0x7ff51c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:53.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.684+0000 7ff523d43700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff51c134260 0x7ff51c1306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:53.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.684+0000 7ff523d43700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff51c06b990 con 0x7ff51c133e30 2023-10-01T07:58:53.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.684+0000 7ff523d43700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff51c0a0590 con 0x7ff51c133420 2023-10-01T07:58:53.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.684+0000 7ff523d43700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c09fb80 con 0x7ff51c134260 2023-10-01T07:58:53.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.684+0000 7ff521adf700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff51c133420 0x7ff51c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:53.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.684+0000 7ff521adf700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff51c133420 0x7ff51c1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56436/0 (socket says 172.21.15.26:56436) 2023-10-01T07:58:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.684+0000 7ff521adf700 1 -- 172.21.15.26:0/2571779103 learned_addr learned my addr 172.21.15.26:0/2571779103 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.684+0000 7ff5212de700 1 --1- 172.21.15.26:0/2571779103 >> v1:172.21.15.26:6789/0 conn(0x7ff51c133e30 0x7ff51c12ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44352/0 (socket says 172.21.15.26:44352) 2023-10-01T07:58:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.684+0000 7ff5222e0700 1 --2- 172.21.15.26:0/2571779103 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff51c134260 0x7ff51c1306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.684+0000 7ff5222e0700 1 -- 172.21.15.26:0/2571779103 >> v2:172.21.15.26:3300/0 conn(0x7ff51c133420 msgr2=0x7ff51c1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.684+0000 7ff5222e0700 1 --2- 172.21.15.26:0/2571779103 >> v2:172.21.15.26:3300/0 conn(0x7ff51c133420 0x7ff51c1337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.684+0000 7ff5222e0700 1 -- 172.21.15.26:0/2571779103 >> v1:172.21.15.26:6789/0 conn(0x7ff51c133e30 legacy=0x7ff51c12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.684+0000 7ff5222e0700 1 -- 172.21.15.26:0/2571779103 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51c0a0030 con 0x7ff51c134260 2023-10-01T07:58:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.684+0000 7ff521adf700 1 --2- 172.21.15.26:0/2571779103 >> v2:172.21.15.26:3300/0 conn(0x7ff51c133420 0x7ff51c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.685+0000 7ff5222e0700 1 --2- 172.21.15.26:0/2571779103 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff51c134260 0x7ff51c1306a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff514009d90 tx=0x7ff51400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e425d57b4f57151 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.685+0000 7ff520add700 1 -- 172.21.15.26:0/2571779103 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51400e070 con 0x7ff51c134260 2023-10-01T07:58:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.685+0000 7ff520add700 1 -- 172.21.15.26:0/2571779103 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51400bb20 con 0x7ff51c134260 2023-10-01T07:58:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.685+0000 7ff520add700 1 -- 172.21.15.26:0/2571779103 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff514012430 con 0x7ff51c134260 2023-10-01T07:58:53.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.686+0000 7ff523d43700 1 -- 172.21.15.26:0/2571779103 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff51c134260 msgr2=0x7ff51c1306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:53.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.686+0000 7ff523d43700 1 --2- 172.21.15.26:0/2571779103 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff51c134260 0x7ff51c1306a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff514009d90 tx=0x7ff51400b330 comp rx=0 tx=0).stop 2023-10-01T07:58:53.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.686+0000 7ff523d43700 1 -- 172.21.15.26:0/2571779103 shutdown_connections 2023-10-01T07:58:53.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.686+0000 7ff523d43700 1 --2- 172.21.15.26:0/2571779103 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff51c134260 0x7ff51c1306a0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:53.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.686+0000 7ff523d43700 1 --2- 172.21.15.26:0/2571779103 >> v2:172.21.15.26:3300/0 conn(0x7ff51c133420 0x7ff51c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:53.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.686+0000 7ff523d43700 1 -- 172.21.15.26:0/2571779103 >> 172.21.15.26:0/2571779103 conn(0x7ff51c0a4210 msgr2=0x7ff51c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:53.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.686+0000 7ff523d43700 1 -- 172.21.15.26:0/2571779103 shutdown_connections 2023-10-01T07:58:53.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.686+0000 7ff523d43700 1 -- 172.21.15.26:0/2571779103 wait complete. 2023-10-01T07:58:53.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.687+0000 7ff523d43700 1 Processor -- start 2023-10-01T07:58:53.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.687+0000 7ff523d43700 1 -- start start 2023-10-01T07:58:53.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.688+0000 7ff523d43700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff51c133420 0x7ff51c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:53.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.688+0000 7ff523d43700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff51c133e30 0x7ff51c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:53.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.688+0000 7ff523d43700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff51c134260 0x7ff51c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:53.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.688+0000 7ff523d43700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c09e3f0 con 0x7ff51c133e30 2023-10-01T07:58:53.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.688+0000 7ff523d43700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c09df40 con 0x7ff51c133420 2023-10-01T07:58:53.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.688+0000 7ff523d43700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c1318b0 con 0x7ff51c134260 2023-10-01T07:58:53.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.688+0000 7ff5222e0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff51c134260 0x7ff51c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:53.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.688+0000 7ff5222e0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff51c134260 0x7ff51c09cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37180/0 (socket says 172.21.15.26:37180) 2023-10-01T07:58:53.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.688+0000 7ff5222e0700 1 -- 172.21.15.26:0/388083204 learned_addr learned my addr 172.21.15.26:0/388083204 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:53.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.688+0000 7ff521adf700 1 --2- 172.21.15.26:0/388083204 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff51c133420 0x7ff51c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:53.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.688+0000 7ff5212de700 1 --2- 172.21.15.26:0/388083204 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff51c133e30 0x7ff51c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:53.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.688+0000 7ff521adf700 1 -- 172.21.15.26:0/388083204 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff51c134260 msgr2=0x7ff51c09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:53.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.688+0000 7ff521adf700 1 --2- 172.21.15.26:0/388083204 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff51c134260 0x7ff51c09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:53.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.688+0000 7ff521adf700 1 -- 172.21.15.26:0/388083204 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff51c133e30 msgr2=0x7ff51c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:53.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.689+0000 7ff521adf700 1 --2- 172.21.15.26:0/388083204 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff51c133e30 0x7ff51c09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:53.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.689+0000 7ff521adf700 1 -- 172.21.15.26:0/388083204 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff518009550 con 0x7ff51c133420 2023-10-01T07:58:53.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.689+0000 7ff5212de700 1 --2- 172.21.15.26:0/388083204 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff51c133e30 0x7ff51c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:58:53.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.689+0000 7ff521adf700 1 --2- 172.21.15.26:0/388083204 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff51c133420 0x7ff51c09c480 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ff51800e9a0 tx=0x7ff51800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:53.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.689+0000 7ff5127fc700 1 -- 172.21.15.26:0/388083204 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff518004030 con 0x7ff51c133420 2023-10-01T07:58:53.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.689+0000 7ff5127fc700 1 -- 172.21.15.26:0/388083204 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff518004190 con 0x7ff51c133420 2023-10-01T07:58:53.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.689+0000 7ff523d43700 1 -- 172.21.15.26:0/388083204 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff514009a70 con 0x7ff51c133420 2023-10-01T07:58:53.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.689+0000 7ff523d43700 1 -- 172.21.15.26:0/388083204 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff51c12d330 con 0x7ff51c133420 2023-10-01T07:58:53.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.689+0000 7ff5127fc700 1 -- 172.21.15.26:0/388083204 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff518004520 con 0x7ff51c133420 2023-10-01T07:58:53.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.690+0000 7ff5127fc700 1 -- 172.21.15.26:0/388083204 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff51800c7f0 con 0x7ff51c133420 2023-10-01T07:58:53.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.690+0000 7ff5127fc700 1 -- 172.21.15.26:0/388083204 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff51803f900 con 0x7ff51c133420 2023-10-01T07:58:53.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.690+0000 7ff523d43700 1 -- 172.21.15.26:0/388083204 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5040052e0 con 0x7ff51c133420 2023-10-01T07:58:53.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.695+0000 7ff5127fc700 1 -- 172.21.15.26:0/388083204 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff5180036a0 con 0x7ff51c133420 2023-10-01T07:58:53.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.722+0000 7fe6580a6700 1 Processor -- start 2023-10-01T07:58:53.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.722+0000 7fe6580a6700 1 -- start start 2023-10-01T07:58:53.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.723+0000 7fe6580a6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe65009d6f0 0x7fe65009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:53.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.723+0000 7fe6580a6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe65009e000 0x7fe65013bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:53.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.723+0000 7fe6580a6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6500992c0 con 0x7fe65013c470 2023-10-01T07:58:53.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.723+0000 7fe6580a6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe650099520 con 0x7fe65009e000 2023-10-01T07:58:53.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.723+0000 7fe6580a6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6500997e0 con 0x7fe65009d6f0 2023-10-01T07:58:53.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.723+0000 7fe656643700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe65013c470 0x7fe65013e850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44358/0 (socket says 172.21.15.26:44358) 2023-10-01T07:58:53.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.723+0000 7fe655e42700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe65009d6f0 0x7fe65009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:53.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.723+0000 7fe656643700 1 -- 172.21.15.26:0/3315309045 learned_addr learned my addr 172.21.15.26:0/3315309045 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:53.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.723+0000 7fe655641700 1 --2- 172.21.15.26:0/3315309045 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe65009e000 0x7fe65013bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:53.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.723+0000 7fe654e40700 1 -- 172.21.15.26:0/3315309045 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2747839111 0 0) 0x7fe6500992c0 con 0x7fe65013c470 2023-10-01T07:58:53.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.723+0000 7fe654e40700 1 -- 172.21.15.26:0/3315309045 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe63c0035b0 con 0x7fe65013c470 2023-10-01T07:58:53.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.724+0000 7fe655e42700 1 -- 172.21.15.26:0/3315309045 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe65009e000 msgr2=0x7fe65013bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:53.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.724+0000 7fe655e42700 1 --2- 172.21.15.26:0/3315309045 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe65009e000 0x7fe65013bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:53.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.724+0000 7fe655e42700 1 -- 172.21.15.26:0/3315309045 >> v1:172.21.15.26:6789/0 conn(0x7fe65013c470 legacy=0x7fe65013e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:53.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.724+0000 7fe655e42700 1 -- 172.21.15.26:0/3315309045 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe650099b30 con 0x7fe65009d6f0 2023-10-01T07:58:53.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.724+0000 7fe655e42700 1 --2- 172.21.15.26:0/3315309045 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe65009d6f0 0x7fe65009dac0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe64c009870 tx=0x7fe64c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=322e4a58316d3c35 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:53.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.724+0000 7fe654e40700 1 -- 172.21.15.26:0/3315309045 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c004230 con 0x7fe65009d6f0 2023-10-01T07:58:53.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.724+0000 7fe654e40700 1 -- 172.21.15.26:0/3315309045 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe64c004390 con 0x7fe65009d6f0 2023-10-01T07:58:53.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.724+0000 7fe654e40700 1 -- 172.21.15.26:0/3315309045 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c0036a0 con 0x7fe65009d6f0 2023-10-01T07:58:53.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.725+0000 7fe6580a6700 1 -- 172.21.15.26:0/3315309045 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe65009d6f0 msgr2=0x7fe65009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:53.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.725+0000 7fe6580a6700 1 --2- 172.21.15.26:0/3315309045 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe65009d6f0 0x7fe65009dac0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe64c009870 tx=0x7fe64c009b80 comp rx=0 tx=0).stop 2023-10-01T07:58:53.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.725+0000 7fe6580a6700 1 -- 172.21.15.26:0/3315309045 shutdown_connections 2023-10-01T07:58:53.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.725+0000 7fe6580a6700 1 --2- 172.21.15.26:0/3315309045 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe65009d6f0 0x7fe65009dac0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:53.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.725+0000 7fe6580a6700 1 --2- 172.21.15.26:0/3315309045 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe65009e000 0x7fe65013bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:53.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.725+0000 7fe6580a6700 1 -- 172.21.15.26:0/3315309045 >> 172.21.15.26:0/3315309045 conn(0x7fe65009f470 msgr2=0x7fe6500a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:53.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.725+0000 7fe6580a6700 1 -- 172.21.15.26:0/3315309045 shutdown_connections 2023-10-01T07:58:53.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.725+0000 7fe6580a6700 1 -- 172.21.15.26:0/3315309045 wait complete. 2023-10-01T07:58:53.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.727+0000 7fe6580a6700 1 Processor -- start 2023-10-01T07:58:53.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.727+0000 7fe6580a6700 1 -- start start 2023-10-01T07:58:53.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.728+0000 7fe6580a6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe65009d6f0 0x7fe65006f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:53.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.728+0000 7fe6580a6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe65009e000 0x7fe65006f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:53.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.728+0000 7fe6580a6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe65013c470 0x7fe65006ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:53.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.728+0000 7fe6580a6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe650070930 con 0x7fe65009d6f0 2023-10-01T07:58:53.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.728+0000 7fe6580a6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe650098c70 con 0x7fe65013c470 2023-10-01T07:58:53.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.728+0000 7fe6580a6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe650071040 con 0x7fe65009e000 2023-10-01T07:58:53.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.728+0000 7fe656643700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe65013c470 0x7fe65006ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:53.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.728+0000 7fe655e42700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe65009d6f0 0x7fe65006f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:53.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.728+0000 7fe656643700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe65013c470 0x7fe65006ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46648/0 (socket says 172.21.15.26:46648) 2023-10-01T07:58:53.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.728+0000 7fe656643700 1 -- 172.21.15.26:0/216706075 learned_addr learned my addr 172.21.15.26:0/216706075 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:53.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.728+0000 7fe655641700 1 --2- 172.21.15.26:0/216706075 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe65009e000 0x7fe65006f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:53.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.728+0000 7fe655e42700 1 -- 172.21.15.26:0/216706075 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe65009e000 msgr2=0x7fe65006f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:53.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.728+0000 7fe655e42700 1 --2- 172.21.15.26:0/216706075 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe65009e000 0x7fe65006f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:53.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.728+0000 7fe655e42700 1 -- 172.21.15.26:0/216706075 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe65013c470 msgr2=0x7fe65006ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:53.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.728+0000 7fe655e42700 1 --2- 172.21.15.26:0/216706075 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe65013c470 0x7fe65006ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:53.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.728+0000 7fe655e42700 1 -- 172.21.15.26:0/216706075 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64c0094a0 con 0x7fe65009d6f0 2023-10-01T07:58:53.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.729+0000 7fe655e42700 1 --2- 172.21.15.26:0/216706075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe65009d6f0 0x7fe65006f480 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fe64c015000 tx=0x7fe64c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:53.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.729+0000 7fe6427fc700 1 -- 172.21.15.26:0/216706075 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c003cd0 con 0x7fe65009d6f0 2023-10-01T07:58:53.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.729+0000 7fe6427fc700 1 -- 172.21.15.26:0/216706075 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe64c01e070 con 0x7fe65009d6f0 2023-10-01T07:58:53.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.729+0000 7fe6427fc700 1 -- 172.21.15.26:0/216706075 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c011870 con 0x7fe65009d6f0 2023-10-01T07:58:53.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.729+0000 7fe6580a6700 1 -- 172.21.15.26:0/216706075 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6501278d0 con 0x7fe65009d6f0 2023-10-01T07:58:53.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.729+0000 7fe6580a6700 1 -- 172.21.15.26:0/216706075 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6500715a0 con 0x7fe65009d6f0 2023-10-01T07:58:53.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.730+0000 7fe6580a6700 1 -- 172.21.15.26:0/216706075 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6500747f0 con 0x7fe65009d6f0 2023-10-01T07:58:53.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.730+0000 7fe6427fc700 1 -- 172.21.15.26:0/216706075 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe64c020030 con 0x7fe65009d6f0 2023-10-01T07:58:53.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.731+0000 7fe6427fc700 1 -- 172.21.15.26:0/216706075 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe64c040850 con 0x7fe65009d6f0 2023-10-01T07:58:53.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.735+0000 7fe6427fc700 1 -- 172.21.15.26:0/216706075 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe64c010740 con 0x7fe65009d6f0 2023-10-01T07:58:53.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.764+0000 7f57659ab700 1 Processor -- start 2023-10-01T07:58:53.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.764+0000 7f57659ab700 1 -- start start 2023-10-01T07:58:53.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.765+0000 7f57659ab700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f576009d6f0 0x7f576009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:53.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.765+0000 7f57659ab700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f576009e000 0x7f5760130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:53.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.765+0000 7f57659ab700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f576009f130 con 0x7f576009e410 2023-10-01T07:58:53.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.765+0000 7f57659ab700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f576009f520 con 0x7f576009d6f0 2023-10-01T07:58:53.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.765+0000 7f57659ab700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f576009e930 con 0x7f576009e000 2023-10-01T07:58:53.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.765+0000 7f575e7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f576009e000 0x7f5760130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:53.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.765+0000 7f575effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f576009d6f0 0x7f576009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:53.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.765+0000 7f575f7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f576009e410 0x7f5760130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44364/0 (socket says 172.21.15.26:44364) 2023-10-01T07:58:53.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.765+0000 7f575e7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f576009e000 0x7f5760130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37210/0 (socket says 172.21.15.26:37210) 2023-10-01T07:58:53.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.765+0000 7f575effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f576009d6f0 0x7f576009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46660/0 (socket says 172.21.15.26:46660) 2023-10-01T07:58:53.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.765+0000 7f575f7fe700 1 -- 172.21.15.26:0/939624502 learned_addr learned my addr 172.21.15.26:0/939624502 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:53.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.765+0000 7f575effd700 1 -- 172.21.15.26:0/939624502 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f576009e000 msgr2=0x7f5760130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:53.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.765+0000 7f575effd700 1 --2- 172.21.15.26:0/939624502 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f576009e000 0x7f5760130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:53.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.765+0000 7f575effd700 1 -- 172.21.15.26:0/939624502 >> v1:172.21.15.26:6789/0 conn(0x7f576009e410 legacy=0x7f5760130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:53.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.765+0000 7f575effd700 1 -- 172.21.15.26:0/939624502 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f576009b2d0 con 0x7f576009d6f0 2023-10-01T07:58:53.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.766+0000 7f575effd700 1 --2- 172.21.15.26:0/939624502 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f576009d6f0 0x7f576009dac0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5750009870 tx=0x7f5750009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e98504dc920882d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:53.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.766+0000 7f575dffb700 1 -- 172.21.15.26:0/939624502 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5750010a90 con 0x7f576009d6f0 2023-10-01T07:58:53.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.766+0000 7f575dffb700 1 -- 172.21.15.26:0/939624502 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5750010bf0 con 0x7f576009d6f0 2023-10-01T07:58:53.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.766+0000 7f575dffb700 1 -- 172.21.15.26:0/939624502 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5750018440 con 0x7f576009d6f0 2023-10-01T07:58:53.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.767+0000 7f57659ab700 1 -- 172.21.15.26:0/939624502 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f576009d6f0 msgr2=0x7f576009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:53.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.767+0000 7f57659ab700 1 --2- 172.21.15.26:0/939624502 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f576009d6f0 0x7f576009dac0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5750009870 tx=0x7f5750009b80 comp rx=0 tx=0).stop 2023-10-01T07:58:53.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.767+0000 7f57659ab700 1 -- 172.21.15.26:0/939624502 shutdown_connections 2023-10-01T07:58:53.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.767+0000 7f57659ab700 1 --2- 172.21.15.26:0/939624502 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f576009d6f0 0x7f576009dac0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:53.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.767+0000 7f57659ab700 1 --2- 172.21.15.26:0/939624502 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f576009e000 0x7f5760130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:53.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.767+0000 7f57659ab700 1 -- 172.21.15.26:0/939624502 >> 172.21.15.26:0/939624502 conn(0x7f5760066f50 msgr2=0x7f576009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:53.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.767+0000 7f57659ab700 1 -- 172.21.15.26:0/939624502 shutdown_connections 2023-10-01T07:58:53.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.767+0000 7f57659ab700 1 -- 172.21.15.26:0/939624502 wait complete. 2023-10-01T07:58:53.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.769+0000 7f57659ab700 1 Processor -- start 2023-10-01T07:58:53.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.769+0000 7f57659ab700 1 -- start start 2023-10-01T07:58:53.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.770+0000 7f57659ab700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f576009d6f0 0x7f576011e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:53.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.770+0000 7f57659ab700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f576009e000 0x7f576011e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:53.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.770+0000 7f57659ab700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f576009e410 0x7f576011eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:53.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.770+0000 7f57659ab700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5760130360 con 0x7f576009d6f0 2023-10-01T07:58:53.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.770+0000 7f57659ab700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57601201b0 con 0x7f576009e000 2023-10-01T07:58:53.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.770+0000 7f57659ab700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5760121500 con 0x7f576009e410 2023-10-01T07:58:53.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.770+0000 7f575effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f576009d6f0 0x7f576011e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:53.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.770+0000 7f575effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f576009d6f0 0x7f576011e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56454/0 (socket says 172.21.15.26:56454) 2023-10-01T07:58:53.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.770+0000 7f575effd700 1 -- 172.21.15.26:0/1713758601 learned_addr learned my addr 172.21.15.26:0/1713758601 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:53.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.770+0000 7f575f7fe700 1 --2- 172.21.15.26:0/1713758601 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f576009e410 0x7f576011eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:53.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.770+0000 7f575e7fc700 1 --2- 172.21.15.26:0/1713758601 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f576009e000 0x7f576011e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:53.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.770+0000 7f575effd700 1 -- 172.21.15.26:0/1713758601 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f576009e410 msgr2=0x7f576011eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:53.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.770+0000 7f575effd700 1 --2- 172.21.15.26:0/1713758601 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f576009e410 0x7f576011eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:53.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.770+0000 7f575effd700 1 -- 172.21.15.26:0/1713758601 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f576009e000 msgr2=0x7f576011e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:53.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.770+0000 7f575effd700 1 --2- 172.21.15.26:0/1713758601 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f576009e000 0x7f576011e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:53.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.770+0000 7f575effd700 1 -- 172.21.15.26:0/1713758601 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57500094a0 con 0x7f576009d6f0 2023-10-01T07:58:53.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.771+0000 7f575effd700 1 --2- 172.21.15.26:0/1713758601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f576009d6f0 0x7f576011e060 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f57500090b0 tx=0x7f5750004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:53.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.771+0000 7f5747fff700 1 -- 172.21.15.26:0/1713758601 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5750025e30 con 0x7f576009d6f0 2023-10-01T07:58:53.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.771+0000 7f5747fff700 1 -- 172.21.15.26:0/1713758601 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5750003720 con 0x7f576009d6f0 2023-10-01T07:58:53.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.771+0000 7f5747fff700 1 -- 172.21.15.26:0/1713758601 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5750003ab0 con 0x7f576009d6f0 2023-10-01T07:58:53.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.771+0000 7f57659ab700 1 -- 172.21.15.26:0/1713758601 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f576011f4c0 con 0x7f576009d6f0 2023-10-01T07:58:53.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.771+0000 7f57659ab700 1 -- 172.21.15.26:0/1713758601 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f576009c700 con 0x7f576009d6f0 2023-10-01T07:58:53.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.772+0000 7f57659ab700 1 -- 172.21.15.26:0/1713758601 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5760074ea0 con 0x7f576009d6f0 2023-10-01T07:58:53.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.773+0000 7f5747fff700 1 -- 172.21.15.26:0/1713758601 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5750003c10 con 0x7f576009d6f0 2023-10-01T07:58:53.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.773+0000 7f5747fff700 1 -- 172.21.15.26:0/1713758601 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5750049550 con 0x7f576009d6f0 2023-10-01T07:58:53.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.778+0000 7f5747fff700 1 -- 172.21.15.26:0/1713758601 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5750039480 con 0x7f576009d6f0 2023-10-01T07:58:53.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.905+0000 7fcef6ffd700 1 -- 172.21.15.26:0/3489895703 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcee4005590 con 0x7fcf0c09d6f0 2023-10-01T07:58:53.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.906+0000 7fcf097fa700 1 -- 172.21.15.26:0/3489895703 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcf00015070 con 0x7fcf0c09d6f0 2023-10-01T07:58:53.907 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:53.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.908+0000 7fcef6ffd700 1 -- 172.21.15.26:0/3489895703 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf0c09d6f0 msgr2=0x7fcf0c122420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:53.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.908+0000 7fcef6ffd700 1 --2- 172.21.15.26:0/3489895703 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf0c09d6f0 0x7fcf0c122420 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c09ea70 tx=0x7fcf00004750 comp rx=0 tx=0).stop 2023-10-01T07:58:53.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.908+0000 7fcef6ffd700 1 -- 172.21.15.26:0/3489895703 shutdown_connections 2023-10-01T07:58:53.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.908+0000 7fcef6ffd700 1 --2- 172.21.15.26:0/3489895703 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf0c09e410 0x7fcf0c122ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:53.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.908+0000 7fcef6ffd700 1 --2- 172.21.15.26:0/3489895703 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf0c09d6f0 0x7fcf0c122420 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:53.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.908+0000 7fcef6ffd700 1 --2- 172.21.15.26:0/3489895703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf0c09e000 0x7fcf0c122960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:53.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.908+0000 7fcef6ffd700 1 -- 172.21.15.26:0/3489895703 >> 172.21.15.26:0/3489895703 conn(0x7fcf0c066f50 msgr2=0x7fcf0c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:53.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.908+0000 7fcef6ffd700 1 -- 172.21.15.26:0/3489895703 shutdown_connections 2023-10-01T07:58:53.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.908+0000 7fcef6ffd700 1 -- 172.21.15.26:0/3489895703 wait complete. 2023-10-01T07:58:53.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:53.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.946+0000 7fe6580a6700 1 -- 172.21.15.26:0/216706075 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe6500747f0 con 0x7fe65009d6f0 2023-10-01T07:58:53.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.946+0000 7fe6427fc700 1 -- 172.21.15.26:0/216706075 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe64c010380 con 0x7fe65009d6f0 2023-10-01T07:58:53.947 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:53.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.948+0000 7fe6580a6700 1 -- 172.21.15.26:0/216706075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe65009d6f0 msgr2=0x7fe65006f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:53.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.948+0000 7fe6580a6700 1 --2- 172.21.15.26:0/216706075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe65009d6f0 0x7fe65006f480 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fe64c015000 tx=0x7fe64c004750 comp rx=0 tx=0).stop 2023-10-01T07:58:53.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.948+0000 7fe6580a6700 1 -- 172.21.15.26:0/216706075 shutdown_connections 2023-10-01T07:58:53.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.948+0000 7fe6580a6700 1 --2- 172.21.15.26:0/216706075 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe65013c470 0x7fe65006ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:53.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.948+0000 7fe6580a6700 1 --2- 172.21.15.26:0/216706075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe65009d6f0 0x7fe65006f480 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:53.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.948+0000 7fe6580a6700 1 --2- 172.21.15.26:0/216706075 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe65009e000 0x7fe65006f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:53.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.948+0000 7fe6580a6700 1 -- 172.21.15.26:0/216706075 >> 172.21.15.26:0/216706075 conn(0x7fe65009f470 msgr2=0x7fe65013f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:53.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.948+0000 7fe6580a6700 1 -- 172.21.15.26:0/216706075 shutdown_connections 2023-10-01T07:58:53.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.948+0000 7fe6580a6700 1 -- 172.21.15.26:0/216706075 wait complete. 2023-10-01T07:58:53.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.961+0000 7ff523d43700 1 -- 172.21.15.26:0/388083204 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff504005590 con 0x7ff51c133420 2023-10-01T07:58:53.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.962+0000 7ff5127fc700 1 -- 172.21.15.26:0/388083204 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff518020020 con 0x7ff51c133420 2023-10-01T07:58:53.962 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:53.963 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:53.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.964+0000 7ff523d43700 1 -- 172.21.15.26:0/388083204 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff51c133420 msgr2=0x7ff51c09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:53.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.964+0000 7ff523d43700 1 --2- 172.21.15.26:0/388083204 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff51c133420 0x7ff51c09c480 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ff51800e9a0 tx=0x7ff51800ecb0 comp rx=0 tx=0).stop 2023-10-01T07:58:53.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.964+0000 7ff523d43700 1 -- 172.21.15.26:0/388083204 shutdown_connections 2023-10-01T07:58:53.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.964+0000 7ff523d43700 1 --2- 172.21.15.26:0/388083204 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff51c134260 0x7ff51c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:53.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.964+0000 7ff523d43700 1 --2- 172.21.15.26:0/388083204 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff51c133420 0x7ff51c09c480 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:53.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.964+0000 7ff523d43700 1 --2- 172.21.15.26:0/388083204 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff51c133e30 0x7ff51c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:53.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.964+0000 7ff523d43700 1 -- 172.21.15.26:0/388083204 >> 172.21.15.26:0/388083204 conn(0x7ff51c0a4210 msgr2=0x7ff51c0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:53.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.964+0000 7ff523d43700 1 -- 172.21.15.26:0/388083204 shutdown_connections 2023-10-01T07:58:53.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:53.964+0000 7ff523d43700 1 -- 172.21.15.26:0/388083204 wait complete. 2023-10-01T07:58:53.978 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:54.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:54.006+0000 7f57659ab700 1 -- 172.21.15.26:0/1713758601 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5760121880 con 0x7f576009d6f0 2023-10-01T07:58:54.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:54.007+0000 7f5747fff700 1 -- 172.21.15.26:0/1713758601 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f575002e820 con 0x7f576009d6f0 2023-10-01T07:58:54.007 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:54.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:54.009+0000 7f57659ab700 1 -- 172.21.15.26:0/1713758601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f576009d6f0 msgr2=0x7f576011e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:54.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:54.009+0000 7f57659ab700 1 --2- 172.21.15.26:0/1713758601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f576009d6f0 0x7f576011e060 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f57500090b0 tx=0x7f5750004750 comp rx=0 tx=0).stop 2023-10-01T07:58:54.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:54.009+0000 7f57659ab700 1 -- 172.21.15.26:0/1713758601 shutdown_connections 2023-10-01T07:58:54.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:54.009+0000 7f57659ab700 1 --2- 172.21.15.26:0/1713758601 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f576009e410 0x7f576011eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:54.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:54.009+0000 7f57659ab700 1 --2- 172.21.15.26:0/1713758601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f576009d6f0 0x7f576011e060 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:54.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:54.009+0000 7f57659ab700 1 --2- 172.21.15.26:0/1713758601 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f576009e000 0x7f576011e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:54.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:54.009+0000 7f57659ab700 1 -- 172.21.15.26:0/1713758601 >> 172.21.15.26:0/1713758601 conn(0x7f5760066f50 msgr2=0x7f5760071150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:54.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:54.009+0000 7f57659ab700 1 -- 172.21.15.26:0/1713758601 shutdown_connections 2023-10-01T07:58:54.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:54.009+0000 7f57659ab700 1 -- 172.21.15.26:0/1713758601 wait complete. 2023-10-01T07:58:54.023 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:54.924 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:54.964 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:54.980 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:55.024 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:55.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.079+0000 7f51c96f5700 1 Processor -- start 2023-10-01T07:58:55.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.079+0000 7f51c96f5700 1 -- start start 2023-10-01T07:58:55.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.079+0000 7f51c96f5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f51c41338a0 0x7f51c4133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:55.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.079+0000 7f51c96f5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f51c409de50 0x7f51c409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:55.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.079+0000 7f51c96f5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f51c409e760 0x7f51c413a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:55.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.079+0000 7f51c96f5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c406fef0 con 0x7f51c409de50 2023-10-01T07:58:55.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.079+0000 7f51c96f5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c406ef30 con 0x7f51c409e760 2023-10-01T07:58:55.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.079+0000 7f51c96f5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51c41334b0 con 0x7f51c41338a0 2023-10-01T07:58:55.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.080+0000 7f51c37fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f51c409e760 0x7f51c413a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:55.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.080+0000 7f51c37fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f51c409e760 0x7f51c413a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46686/0 (socket says 172.21.15.26:46686) 2023-10-01T07:58:55.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.080+0000 7f51c37fe700 1 -- 172.21.15.26:0/3490338257 learned_addr learned my addr 172.21.15.26:0/3490338257 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:55.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.080+0000 7f51c2ffd700 1 --2- 172.21.15.26:0/3490338257 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f51c41338a0 0x7f51c4133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:55.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.080+0000 7f51c37fe700 1 -- 172.21.15.26:0/3490338257 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f51c41338a0 msgr2=0x7f51c4133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:55.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.080+0000 7f51c37fe700 1 --2- 172.21.15.26:0/3490338257 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f51c41338a0 0x7f51c4133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.080+0000 7f51c37fe700 1 -- 172.21.15.26:0/3490338257 >> v2:172.21.15.26:3300/0 conn(0x7f51c409de50 msgr2=0x7f51c409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:55.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.080+0000 7f51c37fe700 1 --2- 172.21.15.26:0/3490338257 >> v2:172.21.15.26:3300/0 conn(0x7f51c409de50 0x7f51c409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.080+0000 7f51c37fe700 1 -- 172.21.15.26:0/3490338257 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c406fc30 con 0x7f51c409e760 2023-10-01T07:58:55.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.080+0000 7f51c2ffd700 1 --2- 172.21.15.26:0/3490338257 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f51c41338a0 0x7f51c4133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:58:55.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.080+0000 7f51c37fe700 1 --2- 172.21.15.26:0/3490338257 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f51c409e760 0x7f51c413a730 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f51bc009e50 tx=0x7f51bc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43aba92be7317515 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:55.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.081+0000 7f51c1ffb700 1 -- 172.21.15.26:0/3490338257 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc00e070 con 0x7f51c409e760 2023-10-01T07:58:55.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.081+0000 7f51c1ffb700 1 -- 172.21.15.26:0/3490338257 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51bc00b9c0 con 0x7f51c409e760 2023-10-01T07:58:55.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.081+0000 7f51c1ffb700 1 -- 172.21.15.26:0/3490338257 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc00bd70 con 0x7f51c409e760 2023-10-01T07:58:55.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.081+0000 7f51c96f5700 1 -- 172.21.15.26:0/3490338257 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f51c409e760 msgr2=0x7f51c413a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:55.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.081+0000 7f51c96f5700 1 --2- 172.21.15.26:0/3490338257 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f51c409e760 0x7f51c413a730 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f51bc009e50 tx=0x7f51bc00b330 comp rx=0 tx=0).stop 2023-10-01T07:58:55.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.082+0000 7f51c96f5700 1 -- 172.21.15.26:0/3490338257 shutdown_connections 2023-10-01T07:58:55.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.082+0000 7f51c96f5700 1 --2- 172.21.15.26:0/3490338257 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f51c409e760 0x7f51c413a730 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.082+0000 7f51c96f5700 1 --2- 172.21.15.26:0/3490338257 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f51c41338a0 0x7f51c4133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.082+0000 7f51c96f5700 1 --2- 172.21.15.26:0/3490338257 >> v2:172.21.15.26:3300/0 conn(0x7f51c409de50 0x7f51c409e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.082+0000 7f51c96f5700 1 -- 172.21.15.26:0/3490338257 >> 172.21.15.26:0/3490338257 conn(0x7f51c40a2aa0 msgr2=0x7f51c40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:55.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.082+0000 7f51c96f5700 1 -- 172.21.15.26:0/3490338257 shutdown_connections 2023-10-01T07:58:55.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.082+0000 7f51c96f5700 1 -- 172.21.15.26:0/3490338257 wait complete. 2023-10-01T07:58:55.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.083+0000 7f51c96f5700 1 Processor -- start 2023-10-01T07:58:55.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.084+0000 7f51c96f5700 1 -- start start 2023-10-01T07:58:55.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.084+0000 7f51c96f5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f51c409de50 0x7f51c411ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:55.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.084+0000 7f51c96f5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f51c409e760 0x7f51c411f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:55.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.084+0000 7f51c96f5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51c41338a0 0x7f51c411f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:55.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.084+0000 7f51c96f5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c4122420 con 0x7f51c41338a0 2023-10-01T07:58:55.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.084+0000 7f51c96f5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c40a1060 con 0x7f51c409de50 2023-10-01T07:58:55.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.084+0000 7f51c96f5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51c406f640 con 0x7f51c409e760 2023-10-01T07:58:55.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.084+0000 7f51c2ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f51c409de50 0x7f51c411ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:55.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.084+0000 7f51c2ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f51c409de50 0x7f51c411ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46692/0 (socket says 172.21.15.26:46692) 2023-10-01T07:58:55.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.085+0000 7f51c2ffd700 1 -- 172.21.15.26:0/4162847981 learned_addr learned my addr 172.21.15.26:0/4162847981 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:55.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.085+0000 7f51c27fc700 1 --2- 172.21.15.26:0/4162847981 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f51c409e760 0x7f51c411f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:55.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.085+0000 7f51c37fe700 1 --2- 172.21.15.26:0/4162847981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51c41338a0 0x7f51c411f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:55.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.085+0000 7f51c2ffd700 1 -- 172.21.15.26:0/4162847981 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f51c409e760 msgr2=0x7f51c411f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:55.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.085+0000 7f51c2ffd700 1 --2- 172.21.15.26:0/4162847981 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f51c409e760 0x7f51c411f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.085+0000 7f51c2ffd700 1 -- 172.21.15.26:0/4162847981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51c41338a0 msgr2=0x7f51c411f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:55.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.085+0000 7f51c2ffd700 1 --2- 172.21.15.26:0/4162847981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51c41338a0 0x7f51c411f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.085+0000 7f51c2ffd700 1 -- 172.21.15.26:0/4162847981 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51bc009b30 con 0x7f51c409de50 2023-10-01T07:58:55.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.085+0000 7f51c27fc700 1 --2- 172.21.15.26:0/4162847981 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f51c409e760 0x7f51c411f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:55.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.085+0000 7f51c37fe700 1 --2- 172.21.15.26:0/4162847981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51c41338a0 0x7f51c411f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:58:55.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.085+0000 7f51c2ffd700 1 --2- 172.21.15.26:0/4162847981 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f51c409de50 0x7f51c411ec20 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f51b400c750 tx=0x7f51b400ca60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:55.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.085+0000 7f51ab7fe700 1 -- 172.21.15.26:0/4162847981 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b4011800 con 0x7f51c409de50 2023-10-01T07:58:55.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.086+0000 7f51ab7fe700 1 -- 172.21.15.26:0/4162847981 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b4011960 con 0x7f51c409de50 2023-10-01T07:58:55.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.086+0000 7f51ab7fe700 1 -- 172.21.15.26:0/4162847981 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b4011cd0 con 0x7f51c409de50 2023-10-01T07:58:55.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.086+0000 7f51c96f5700 1 -- 172.21.15.26:0/4162847981 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c412f700 con 0x7f51c409de50 2023-10-01T07:58:55.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.086+0000 7f51c96f5700 1 -- 172.21.15.26:0/4162847981 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c4122700 con 0x7f51c409de50 2023-10-01T07:58:55.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.087+0000 7f51ab7fe700 1 -- 172.21.15.26:0/4162847981 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f51b4021350 con 0x7f51c409de50 2023-10-01T07:58:55.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.087+0000 7f51c96f5700 1 -- 172.21.15.26:0/4162847981 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c406f950 con 0x7f51c409de50 2023-10-01T07:58:55.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.087+0000 7f51ab7fe700 1 -- 172.21.15.26:0/4162847981 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f51b403f790 con 0x7f51c409de50 2023-10-01T07:58:55.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.093+0000 7f51ab7fe700 1 -- 172.21.15.26:0/4162847981 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f51b4017d60 con 0x7f51c409de50 2023-10-01T07:58:55.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.120+0000 7fa9ac1d1700 1 Processor -- start 2023-10-01T07:58:55.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.121+0000 7fa9ac1d1700 1 -- start start 2023-10-01T07:58:55.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.121+0000 7fa9ac1d1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa9a41338a0 0x7fa9a4133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:55.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.121+0000 7fa9ac1d1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa9a409e930 0x7fa9a413b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:55.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.121+0000 7fa9ac1d1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9a406ef30 con 0x7fa9a409de50 2023-10-01T07:58:55.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.121+0000 7fa9ac1d1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9a406fef0 con 0x7fa9a41338a0 2023-10-01T07:58:55.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.121+0000 7fa9ac1d1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a41334b0 con 0x7fa9a409e930 2023-10-01T07:58:55.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.122+0000 7fa9aa76e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa9a409e930 0x7fa9a413b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:55.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.122+0000 7fa9aa76e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa9a409e930 0x7fa9a413b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37252/0 (socket says 172.21.15.26:37252) 2023-10-01T07:58:55.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.122+0000 7fa9aa76e700 1 -- 172.21.15.26:0/3523536803 learned_addr learned my addr 172.21.15.26:0/3523536803 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:55.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.122+0000 7fa9a9f6d700 1 --2- 172.21.15.26:0/3523536803 >> v2:172.21.15.26:3300/0 conn(0x7fa9a41338a0 0x7fa9a4133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:55.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.122+0000 7fa9aa76e700 1 -- 172.21.15.26:0/3523536803 >> v2:172.21.15.26:3300/0 conn(0x7fa9a41338a0 msgr2=0x7fa9a4133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:55.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.122+0000 7fa9aa76e700 1 --2- 172.21.15.26:0/3523536803 >> v2:172.21.15.26:3300/0 conn(0x7fa9a41338a0 0x7fa9a4133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.122+0000 7fa9aa76e700 1 -- 172.21.15.26:0/3523536803 >> v1:172.21.15.26:6789/0 conn(0x7fa9a409de50 legacy=0x7fa9a409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:55.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.122+0000 7fa9aa76e700 1 -- 172.21.15.26:0/3523536803 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a406fc30 con 0x7fa9a409e930 2023-10-01T07:58:55.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.122+0000 7fa9a9f6d700 1 --2- 172.21.15.26:0/3523536803 >> v2:172.21.15.26:3300/0 conn(0x7fa9a41338a0 0x7fa9a4133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:58:55.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.122+0000 7fa9aa76e700 1 --2- 172.21.15.26:0/3523536803 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa9a409e930 0x7fa9a413b740 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa99c009e50 tx=0x7fa99c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4811596935c5e3df server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:55.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.122+0000 7fa9a8f6b700 1 -- 172.21.15.26:0/3523536803 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99c00e070 con 0x7fa9a409e930 2023-10-01T07:58:55.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.122+0000 7fa9a8f6b700 1 -- 172.21.15.26:0/3523536803 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa99c00b9c0 con 0x7fa9a409e930 2023-10-01T07:58:55.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.122+0000 7fa9a8f6b700 1 -- 172.21.15.26:0/3523536803 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99c00bd70 con 0x7fa9a409e930 2023-10-01T07:58:55.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.123+0000 7fa9ac1d1700 1 -- 172.21.15.26:0/3523536803 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa9a409e930 msgr2=0x7fa9a413b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:55.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.123+0000 7fa9ac1d1700 1 --2- 172.21.15.26:0/3523536803 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa9a409e930 0x7fa9a413b740 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa99c009e50 tx=0x7fa99c00b330 comp rx=0 tx=0).stop 2023-10-01T07:58:55.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.123+0000 7fa9ac1d1700 1 -- 172.21.15.26:0/3523536803 shutdown_connections 2023-10-01T07:58:55.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.123+0000 7fa9ac1d1700 1 --2- 172.21.15.26:0/3523536803 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa9a409e930 0x7fa9a413b740 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.123+0000 7fa9ac1d1700 1 --2- 172.21.15.26:0/3523536803 >> v2:172.21.15.26:3300/0 conn(0x7fa9a41338a0 0x7fa9a4133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.123+0000 7fa9ac1d1700 1 -- 172.21.15.26:0/3523536803 >> 172.21.15.26:0/3523536803 conn(0x7fa9a40a2aa0 msgr2=0x7fa9a40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:55.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.123+0000 7fa9ac1d1700 1 -- 172.21.15.26:0/3523536803 shutdown_connections 2023-10-01T07:58:55.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.123+0000 7fa9ac1d1700 1 -- 172.21.15.26:0/3523536803 wait complete. 2023-10-01T07:58:55.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.124+0000 7fa9ac1d1700 1 Processor -- start 2023-10-01T07:58:55.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.124+0000 7fa9ac1d1700 1 -- start start 2023-10-01T07:58:55.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.125+0000 7fa9ac1d1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa9a409de50 0x7fa9a411b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:55.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.125+0000 7fa9ac1d1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9a409e930 0x7fa9a411bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:55.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.125+0000 7fa9ac1d1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9a41338a0 0x7fa9a411c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:55.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.125+0000 7fa9ac1d1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a411d350 con 0x7fa9a41338a0 2023-10-01T07:58:55.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.125+0000 7fa9ac1d1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a406f640 con 0x7fa9a409e930 2023-10-01T07:58:55.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.125+0000 7fa9ac1d1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a411ef80 con 0x7fa9a409de50 2023-10-01T07:58:55.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.125+0000 7fa9a9f6d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa9a409de50 0x7fa9a411b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:55.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.125+0000 7fa9aa76e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9a41338a0 0x7fa9a411c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:55.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.125+0000 7fa9aa76e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9a41338a0 0x7fa9a411c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56484/0 (socket says 172.21.15.26:56484) 2023-10-01T07:58:55.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.125+0000 7fa9a9f6d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa9a409de50 0x7fa9a411b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37254/0 (socket says 172.21.15.26:37254) 2023-10-01T07:58:55.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.125+0000 7fa9aa76e700 1 -- 172.21.15.26:0/589379114 learned_addr learned my addr 172.21.15.26:0/589379114 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:55.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.125+0000 7fa9a976c700 1 --2- 172.21.15.26:0/589379114 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9a409e930 0x7fa9a411bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:55.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.126+0000 7fa9a9f6d700 1 -- 172.21.15.26:0/589379114 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9a409e930 msgr2=0x7fa9a411bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:55.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.126+0000 7fa9a9f6d700 1 --2- 172.21.15.26:0/589379114 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9a409e930 0x7fa9a411bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.126+0000 7fa9a9f6d700 1 -- 172.21.15.26:0/589379114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9a41338a0 msgr2=0x7fa9a411c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:55.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.126+0000 7fa9a9f6d700 1 --2- 172.21.15.26:0/589379114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9a41338a0 0x7fa9a411c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.126+0000 7fa9a9f6d700 1 -- 172.21.15.26:0/589379114 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa99c009b30 con 0x7fa9a409de50 2023-10-01T07:58:55.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.126+0000 7fa9a976c700 1 --2- 172.21.15.26:0/589379114 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9a409e930 0x7fa9a411bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:55.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.126+0000 7fa9a9f6d700 1 --2- 172.21.15.26:0/589379114 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa9a409de50 0x7fa9a411b7d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa9a000e7e0 tx=0x7fa9a000eaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:55.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.126+0000 7fa99a7fc700 1 -- 172.21.15.26:0/589379114 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a000c070 con 0x7fa9a409de50 2023-10-01T07:58:55.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.126+0000 7fa99a7fc700 1 -- 172.21.15.26:0/589379114 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a0013610 con 0x7fa9a409de50 2023-10-01T07:58:55.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.126+0000 7fa9ac1d1700 1 -- 172.21.15.26:0/589379114 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a40a0ee0 con 0x7fa9a409de50 2023-10-01T07:58:55.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.126+0000 7fa99a7fc700 1 -- 172.21.15.26:0/589379114 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a0013980 con 0x7fa9a409de50 2023-10-01T07:58:55.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.126+0000 7fa9ac1d1700 1 -- 172.21.15.26:0/589379114 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a411e9f0 con 0x7fa9a409de50 2023-10-01T07:58:55.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.127+0000 7fa99a7fc700 1 -- 172.21.15.26:0/589379114 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa9a0013ae0 con 0x7fa9a409de50 2023-10-01T07:58:55.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.128+0000 7fa99a7fc700 1 -- 172.21.15.26:0/589379114 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa9a003f2e0 con 0x7fa9a409de50 2023-10-01T07:58:55.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.128+0000 7fa9ac1d1700 1 -- 172.21.15.26:0/589379114 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9a4074ea0 con 0x7fa9a409de50 2023-10-01T07:58:55.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.137+0000 7fa99a7fc700 1 -- 172.21.15.26:0/589379114 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa9a00104f0 con 0x7fa9a409de50 2023-10-01T07:58:55.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.165+0000 7f9b7ef33700 1 Processor -- start 2023-10-01T07:58:55.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.165+0000 7f9b7ef33700 1 -- start start 2023-10-01T07:58:55.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.165+0000 7f9b7ef33700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9b781316c0 0x7f9b78131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:55.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.165+0000 7f9b7ef33700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9b7809d9f0 0x7f9b7806a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:55.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.165+0000 7f9b7ef33700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b7806acb0 0x7f9b7806b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:55.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.165+0000 7f9b7ef33700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b7806b630 con 0x7f9b7809d9f0 2023-10-01T07:58:55.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.165+0000 7f9b7ef33700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7809e130 con 0x7f9b781316c0 2023-10-01T07:58:55.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.165+0000 7f9b7ef33700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b781312b0 con 0x7f9b7806acb0 2023-10-01T07:58:55.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.165+0000 7f9b7cccf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9b781316c0 0x7f9b78131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:55.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.165+0000 7f9b7cccf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9b781316c0 0x7f9b78131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46704/0 (socket says 172.21.15.26:46704) 2023-10-01T07:58:55.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.165+0000 7f9b7cccf700 1 -- 172.21.15.26:0/2186940119 learned_addr learned my addr 172.21.15.26:0/2186940119 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:55.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.165+0000 7f9b7d4d0700 1 --2- 172.21.15.26:0/2186940119 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b7806acb0 0x7f9b7806b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:55.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.166+0000 7f9b77fff700 1 --2- 172.21.15.26:0/2186940119 >> v2:172.21.15.26:3300/0 conn(0x7f9b7809d9f0 0x7f9b7806a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:55.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.166+0000 7f9b7cccf700 1 -- 172.21.15.26:0/2186940119 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b7806acb0 msgr2=0x7f9b7806b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:55.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.166+0000 7f9b7cccf700 1 --2- 172.21.15.26:0/2186940119 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b7806acb0 0x7f9b7806b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.166+0000 7f9b7cccf700 1 -- 172.21.15.26:0/2186940119 >> v2:172.21.15.26:3300/0 conn(0x7f9b7809d9f0 msgr2=0x7f9b7806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:55.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.166+0000 7f9b7cccf700 1 --2- 172.21.15.26:0/2186940119 >> v2:172.21.15.26:3300/0 conn(0x7f9b7809d9f0 0x7f9b7806a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.166+0000 7f9b7cccf700 1 -- 172.21.15.26:0/2186940119 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b7809f6e0 con 0x7f9b781316c0 2023-10-01T07:58:55.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.166+0000 7f9b7cccf700 1 --2- 172.21.15.26:0/2186940119 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9b781316c0 0x7f9b78131a90 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c009920 tx=0x7f9b6c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7d4f4e69ce48e7a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:55.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.166+0000 7f9b777fe700 1 -- 172.21.15.26:0/2186940119 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c011830 con 0x7f9b781316c0 2023-10-01T07:58:55.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.166+0000 7f9b777fe700 1 -- 172.21.15.26:0/2186940119 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6c011990 con 0x7f9b781316c0 2023-10-01T07:58:55.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.166+0000 7f9b777fe700 1 -- 172.21.15.26:0/2186940119 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c011d20 con 0x7f9b781316c0 2023-10-01T07:58:55.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.167+0000 7f9b7ef33700 1 -- 172.21.15.26:0/2186940119 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9b781316c0 msgr2=0x7f9b78131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:55.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.167+0000 7f9b7ef33700 1 --2- 172.21.15.26:0/2186940119 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9b781316c0 0x7f9b78131a90 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c009920 tx=0x7f9b6c009c30 comp rx=0 tx=0).stop 2023-10-01T07:58:55.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.167+0000 7f9b7ef33700 1 -- 172.21.15.26:0/2186940119 shutdown_connections 2023-10-01T07:58:55.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.167+0000 7f9b7ef33700 1 --2- 172.21.15.26:0/2186940119 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b7806acb0 0x7f9b7806b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.167+0000 7f9b7ef33700 1 --2- 172.21.15.26:0/2186940119 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9b781316c0 0x7f9b78131a90 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.167+0000 7f9b7ef33700 1 --2- 172.21.15.26:0/2186940119 >> v2:172.21.15.26:3300/0 conn(0x7f9b7809d9f0 0x7f9b7806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.167+0000 7f9b7ef33700 1 -- 172.21.15.26:0/2186940119 >> 172.21.15.26:0/2186940119 conn(0x7f9b78066f50 msgr2=0x7f9b7809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:55.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.167+0000 7f9b7ef33700 1 -- 172.21.15.26:0/2186940119 shutdown_connections 2023-10-01T07:58:55.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.167+0000 7f9b7ef33700 1 -- 172.21.15.26:0/2186940119 wait complete. 2023-10-01T07:58:55.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.169+0000 7f9b7ef33700 1 Processor -- start 2023-10-01T07:58:55.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.169+0000 7f9b7ef33700 1 -- start start 2023-10-01T07:58:55.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.170+0000 7f9b7ef33700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b7806acb0 0x7f9b78070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:55.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.170+0000 7f9b7ef33700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9b7809d9f0 0x7f9b78070bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:55.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.170+0000 7f9b7ef33700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b781316c0 0x7f9b78071110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:55.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.170+0000 7f9b7ef33700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b780a36d0 con 0x7f9b781316c0 2023-10-01T07:58:55.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.170+0000 7f9b7ef33700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7812b900 con 0x7f9b7809d9f0 2023-10-01T07:58:55.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.170+0000 7f9b7ef33700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7811a070 con 0x7f9b7806acb0 2023-10-01T07:58:55.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.170+0000 7f9b7cccf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b7806acb0 0x7f9b78070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:55.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.170+0000 7f9b7cccf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b7806acb0 0x7f9b78070690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37276/0 (socket says 172.21.15.26:37276) 2023-10-01T07:58:55.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.170+0000 7f9b7cccf700 1 -- 172.21.15.26:0/4089151344 learned_addr learned my addr 172.21.15.26:0/4089151344 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:55.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.170+0000 7f9b77fff700 1 --2- 172.21.15.26:0/4089151344 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9b7809d9f0 0x7f9b78070bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:55.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.170+0000 7f9b7d4d0700 1 --2- 172.21.15.26:0/4089151344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b781316c0 0x7f9b78071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:55.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.171+0000 7f9b7cccf700 1 -- 172.21.15.26:0/4089151344 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9b7809d9f0 msgr2=0x7f9b78070bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:55.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.171+0000 7f9b7cccf700 1 --2- 172.21.15.26:0/4089151344 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9b7809d9f0 0x7f9b78070bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.171+0000 7f9b7cccf700 1 -- 172.21.15.26:0/4089151344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b781316c0 msgr2=0x7f9b78071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:55.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.171+0000 7f9b7cccf700 1 --2- 172.21.15.26:0/4089151344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b781316c0 0x7f9b78071110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.171+0000 7f9b7cccf700 1 -- 172.21.15.26:0/4089151344 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b6c009550 con 0x7f9b7806acb0 2023-10-01T07:58:55.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.171+0000 7f9b7cccf700 1 --2- 172.21.15.26:0/4089151344 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b7806acb0 0x7f9b78070690 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c0098f0 tx=0x7f9b6c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:55.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.171+0000 7f9b757fa700 1 -- 172.21.15.26:0/4089151344 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c004510 con 0x7f9b7806acb0 2023-10-01T07:58:55.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.171+0000 7f9b757fa700 1 -- 172.21.15.26:0/4089151344 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6c0036a0 con 0x7f9b7806acb0 2023-10-01T07:58:55.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.171+0000 7f9b757fa700 1 -- 172.21.15.26:0/4089151344 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c003a50 con 0x7f9b7806acb0 2023-10-01T07:58:55.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.171+0000 7f9b7ef33700 1 -- 172.21.15.26:0/4089151344 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b78119c40 con 0x7f9b7806acb0 2023-10-01T07:58:55.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.172+0000 7f9b7ef33700 1 -- 172.21.15.26:0/4089151344 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b7811b430 con 0x7f9b7806acb0 2023-10-01T07:58:55.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.172+0000 7f9b757fa700 1 -- 172.21.15.26:0/4089151344 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9b6c003bb0 con 0x7f9b7806acb0 2023-10-01T07:58:55.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.173+0000 7f9b757fa700 1 -- 172.21.15.26:0/4089151344 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9b6c0403c0 con 0x7f9b7806acb0 2023-10-01T07:58:55.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.173+0000 7f9b7ef33700 1 -- 172.21.15.26:0/4089151344 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b7811a800 con 0x7f9b7806acb0 2023-10-01T07:58:55.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.178+0000 7f9b757fa700 1 -- 172.21.15.26:0/4089151344 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9b6c01a420 con 0x7f9b7806acb0 2023-10-01T07:58:55.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.209+0000 7f58e0c6b700 1 Processor -- start 2023-10-01T07:58:55.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.209+0000 7f58e0c6b700 1 -- start start 2023-10-01T07:58:55.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.210+0000 7f58e0c6b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f58dc09d6f0 0x7f58dc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:55.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.210+0000 7f58e0c6b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f58dc09e000 0x7f58dc130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:55.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.210+0000 7f58e0c6b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58dc09f130 con 0x7f58dc09e410 2023-10-01T07:58:55.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.210+0000 7f58e0c6b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc09f520 con 0x7f58dc09d6f0 2023-10-01T07:58:55.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.210+0000 7f58e0c6b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc09e930 con 0x7f58dc09e000 2023-10-01T07:58:55.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.210+0000 7f58da59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f58dc09d6f0 0x7f58dc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:55.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.210+0000 7f58da59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f58dc09d6f0 0x7f58dc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46712/0 (socket says 172.21.15.26:46712) 2023-10-01T07:58:55.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.210+0000 7f58da59c700 1 -- 172.21.15.26:0/3717372305 learned_addr learned my addr 172.21.15.26:0/3717372305 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:55.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.210+0000 7f58d9d9b700 1 --2- 172.21.15.26:0/3717372305 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f58dc09e000 0x7f58dc130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:55.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.210+0000 7f58da59c700 1 -- 172.21.15.26:0/3717372305 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f58dc09e000 msgr2=0x7f58dc130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:55.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.210+0000 7f58da59c700 1 --2- 172.21.15.26:0/3717372305 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f58dc09e000 0x7f58dc130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.210+0000 7f58d959a700 1 -- 172.21.15.26:0/3717372305 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2100384878 0 0) 0x7f58dc09f130 con 0x7f58dc09e410 2023-10-01T07:58:55.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.210+0000 7f58da59c700 1 -- 172.21.15.26:0/3717372305 >> v1:172.21.15.26:6789/0 conn(0x7f58dc09e410 legacy=0x7f58dc130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:55.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.210+0000 7f58da59c700 1 -- 172.21.15.26:0/3717372305 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58dc09b2d0 con 0x7f58dc09d6f0 2023-10-01T07:58:55.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.210+0000 7f58d9d9b700 1 --2- 172.21.15.26:0/3717372305 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f58dc09e000 0x7f58dc130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:55.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.211+0000 7f58da59c700 1 --2- 172.21.15.26:0/3717372305 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f58dc09d6f0 0x7f58dc09dac0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f58cc009920 tx=0x7f58cc009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ffcd9d3428fecc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:55.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.211+0000 7f58d959a700 1 -- 172.21.15.26:0/3717372305 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc011830 con 0x7f58dc09d6f0 2023-10-01T07:58:55.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.211+0000 7f58d959a700 1 -- 172.21.15.26:0/3717372305 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58cc011990 con 0x7f58dc09d6f0 2023-10-01T07:58:55.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.211+0000 7f58d959a700 1 -- 172.21.15.26:0/3717372305 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc011d20 con 0x7f58dc09d6f0 2023-10-01T07:58:55.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.211+0000 7f58e0c6b700 1 -- 172.21.15.26:0/3717372305 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f58dc09d6f0 msgr2=0x7f58dc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:55.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.211+0000 7f58e0c6b700 1 --2- 172.21.15.26:0/3717372305 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f58dc09d6f0 0x7f58dc09dac0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f58cc009920 tx=0x7f58cc009c30 comp rx=0 tx=0).stop 2023-10-01T07:58:55.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.212+0000 7f58e0c6b700 1 -- 172.21.15.26:0/3717372305 shutdown_connections 2023-10-01T07:58:55.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.212+0000 7f58e0c6b700 1 --2- 172.21.15.26:0/3717372305 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f58dc09d6f0 0x7f58dc09dac0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.212+0000 7f58e0c6b700 1 --2- 172.21.15.26:0/3717372305 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f58dc09e000 0x7f58dc130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.212+0000 7f58e0c6b700 1 -- 172.21.15.26:0/3717372305 >> 172.21.15.26:0/3717372305 conn(0x7f58dc066f50 msgr2=0x7f58dc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:55.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.212+0000 7f58e0c6b700 1 -- 172.21.15.26:0/3717372305 shutdown_connections 2023-10-01T07:58:55.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.212+0000 7f58e0c6b700 1 -- 172.21.15.26:0/3717372305 wait complete. 2023-10-01T07:58:55.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.213+0000 7f58e0c6b700 1 Processor -- start 2023-10-01T07:58:55.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.213+0000 7f58e0c6b700 1 -- start start 2023-10-01T07:58:55.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.213+0000 7f58e0c6b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58dc09d6f0 0x7f58dc11dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:55.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.213+0000 7f58e0c6b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f58dc09e000 0x7f58dc11e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:55.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.213+0000 7f58e0c6b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f58dc09e410 0x7f58dc11e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:55.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.213+0000 7f58e0c6b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc11fa20 con 0x7f58dc09d6f0 2023-10-01T07:58:55.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.213+0000 7f58e0c6b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc1215b0 con 0x7f58dc09e410 2023-10-01T07:58:55.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.213+0000 7f58e0c6b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc0a3b80 con 0x7f58dc09e000 2023-10-01T07:58:55.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.214+0000 7f58dad9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f58dc09e410 0x7f58dc11e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:55.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.214+0000 7f58dad9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f58dc09e410 0x7f58dc11e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46726/0 (socket says 172.21.15.26:46726) 2023-10-01T07:58:55.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.214+0000 7f58dad9d700 1 -- 172.21.15.26:0/2563184408 learned_addr learned my addr 172.21.15.26:0/2563184408 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:55.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.214+0000 7f58da59c700 1 --2- 172.21.15.26:0/2563184408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58dc09d6f0 0x7f58dc11dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:55.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.214+0000 7f58d9d9b700 1 --2- 172.21.15.26:0/2563184408 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f58dc09e000 0x7f58dc11e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:55.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.214+0000 7f58dad9d700 1 -- 172.21.15.26:0/2563184408 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f58dc09e000 msgr2=0x7f58dc11e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:55.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.214+0000 7f58dad9d700 1 --2- 172.21.15.26:0/2563184408 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f58dc09e000 0x7f58dc11e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.214+0000 7f58dad9d700 1 -- 172.21.15.26:0/2563184408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58dc09d6f0 msgr2=0x7f58dc11dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:55.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.214+0000 7f58dad9d700 1 --2- 172.21.15.26:0/2563184408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58dc09d6f0 0x7f58dc11dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.214+0000 7f58dad9d700 1 -- 172.21.15.26:0/2563184408 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d000b740 con 0x7f58dc09e410 2023-10-01T07:58:55.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.214+0000 7f58d9d9b700 1 --2- 172.21.15.26:0/2563184408 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f58dc09e000 0x7f58dc11e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:55.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.214+0000 7f58dad9d700 1 --2- 172.21.15.26:0/2563184408 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f58dc09e410 0x7f58dc11e7f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f58d400c810 tx=0x7f58d400cb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:55.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.215+0000 7f58caffd700 1 -- 172.21.15.26:0/2563184408 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d4003e30 con 0x7f58dc09e410 2023-10-01T07:58:55.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.215+0000 7f58caffd700 1 -- 172.21.15.26:0/2563184408 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d4005070 con 0x7f58dc09e410 2023-10-01T07:58:55.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.215+0000 7f58caffd700 1 -- 172.21.15.26:0/2563184408 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d4005420 con 0x7f58dc09e410 2023-10-01T07:58:55.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.215+0000 7f58e0c6b700 1 -- 172.21.15.26:0/2563184408 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58cc009550 con 0x7f58dc09e410 2023-10-01T07:58:55.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.215+0000 7f58e0c6b700 1 -- 172.21.15.26:0/2563184408 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58dc120bd0 con 0x7f58dc09e410 2023-10-01T07:58:55.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.216+0000 7f58e0c6b700 1 -- 172.21.15.26:0/2563184408 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58dc11ac20 con 0x7f58dc09e410 2023-10-01T07:58:55.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.217+0000 7f58caffd700 1 -- 172.21.15.26:0/2563184408 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f58d4005580 con 0x7f58dc09e410 2023-10-01T07:58:55.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.217+0000 7f58caffd700 1 -- 172.21.15.26:0/2563184408 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f58d403f2c0 con 0x7f58dc09e410 2023-10-01T07:58:55.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.226+0000 7f58caffd700 1 -- 172.21.15.26:0/2563184408 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f58d4005830 con 0x7f58dc09e410 2023-10-01T07:58:55.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.309+0000 7f51c96f5700 1 -- 172.21.15.26:0/4162847981 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f51c4074ea0 con 0x7f51c409de50 2023-10-01T07:58:55.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.309+0000 7f51ab7fe700 1 -- 172.21.15.26:0/4162847981 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f51b4017300 con 0x7f51c409de50 2023-10-01T07:58:55.311 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:55.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.311+0000 7f51c96f5700 1 -- 172.21.15.26:0/4162847981 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f51c409de50 msgr2=0x7f51c411ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:55.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.311+0000 7f51c96f5700 1 --2- 172.21.15.26:0/4162847981 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f51c409de50 0x7f51c411ec20 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f51b400c750 tx=0x7f51b400ca60 comp rx=0 tx=0).stop 2023-10-01T07:58:55.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.312+0000 7f51c96f5700 1 -- 172.21.15.26:0/4162847981 shutdown_connections 2023-10-01T07:58:55.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.312+0000 7f51c96f5700 1 --2- 172.21.15.26:0/4162847981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51c41338a0 0x7f51c411f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.312+0000 7f51c96f5700 1 --2- 172.21.15.26:0/4162847981 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f51c409de50 0x7f51c411ec20 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.312+0000 7f51c96f5700 1 --2- 172.21.15.26:0/4162847981 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f51c409e760 0x7f51c411f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.312+0000 7f51c96f5700 1 -- 172.21.15.26:0/4162847981 >> 172.21.15.26:0/4162847981 conn(0x7f51c40a2aa0 msgr2=0x7f51c409ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:55.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.312+0000 7f51c96f5700 1 -- 172.21.15.26:0/4162847981 shutdown_connections 2023-10-01T07:58:55.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.312+0000 7f51c96f5700 1 -- 172.21.15.26:0/4162847981 wait complete. 2023-10-01T07:58:55.327 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:55.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.352+0000 7fa9ac1d1700 1 -- 172.21.15.26:0/589379114 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa9a406b9e0 con 0x7fa9a409de50 2023-10-01T07:58:55.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.353+0000 7fa99a7fc700 1 -- 172.21.15.26:0/589379114 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa9a002b090 con 0x7fa9a409de50 2023-10-01T07:58:55.353 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:55.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.355+0000 7fa9ac1d1700 1 -- 172.21.15.26:0/589379114 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa9a409de50 msgr2=0x7fa9a411b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:55.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.355+0000 7fa9ac1d1700 1 --2- 172.21.15.26:0/589379114 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa9a409de50 0x7fa9a411b7d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa9a000e7e0 tx=0x7fa9a000eaf0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.355+0000 7fa9ac1d1700 1 -- 172.21.15.26:0/589379114 shutdown_connections 2023-10-01T07:58:55.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.355+0000 7fa9ac1d1700 1 --2- 172.21.15.26:0/589379114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9a41338a0 0x7fa9a411c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.355+0000 7fa9ac1d1700 1 --2- 172.21.15.26:0/589379114 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa9a409de50 0x7fa9a411b7d0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.355+0000 7fa9ac1d1700 1 --2- 172.21.15.26:0/589379114 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9a409e930 0x7fa9a411bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.355+0000 7fa9ac1d1700 1 -- 172.21.15.26:0/589379114 >> 172.21.15.26:0/589379114 conn(0x7fa9a40a2aa0 msgr2=0x7fa9a41306a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:55.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.355+0000 7fa9ac1d1700 1 -- 172.21.15.26:0/589379114 shutdown_connections 2023-10-01T07:58:55.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.355+0000 7fa9ac1d1700 1 -- 172.21.15.26:0/589379114 wait complete. 2023-10-01T07:58:55.370 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:55.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.394+0000 7f9b7ef33700 1 -- 172.21.15.26:0/4089151344 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9b78074ea0 con 0x7f9b7806acb0 2023-10-01T07:58:55.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.394+0000 7f9b757fa700 1 -- 172.21.15.26:0/4089151344 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9b6c028030 con 0x7f9b7806acb0 2023-10-01T07:58:55.395 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:55.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.396+0000 7f9b7ef33700 1 -- 172.21.15.26:0/4089151344 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b7806acb0 msgr2=0x7f9b78070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:55.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.396+0000 7f9b7ef33700 1 --2- 172.21.15.26:0/4089151344 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b7806acb0 0x7f9b78070690 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c0098f0 tx=0x7f9b6c004750 comp rx=0 tx=0).stop 2023-10-01T07:58:55.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.397+0000 7f9b7ef33700 1 -- 172.21.15.26:0/4089151344 shutdown_connections 2023-10-01T07:58:55.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.397+0000 7f9b7ef33700 1 --2- 172.21.15.26:0/4089151344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b781316c0 0x7f9b78071110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.397+0000 7f9b7ef33700 1 --2- 172.21.15.26:0/4089151344 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b7806acb0 0x7f9b78070690 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.397+0000 7f9b7ef33700 1 --2- 172.21.15.26:0/4089151344 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9b7809d9f0 0x7f9b78070bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.397+0000 7f9b7ef33700 1 -- 172.21.15.26:0/4089151344 >> 172.21.15.26:0/4089151344 conn(0x7f9b78066f50 msgr2=0x7f9b780a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:55.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.397+0000 7f9b7ef33700 1 -- 172.21.15.26:0/4089151344 shutdown_connections 2023-10-01T07:58:55.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.397+0000 7f9b7ef33700 1 -- 172.21.15.26:0/4089151344 wait complete. 2023-10-01T07:58:55.412 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:55.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.434+0000 7f58e0c6b700 1 -- 172.21.15.26:0/2563184408 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f58dc074ea0 con 0x7f58dc09e410 2023-10-01T07:58:55.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.434+0000 7f58caffd700 1 -- 172.21.15.26:0/2563184408 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f58d401a360 con 0x7f58dc09e410 2023-10-01T07:58:55.435 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:55.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.437+0000 7f58e0c6b700 1 -- 172.21.15.26:0/2563184408 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f58dc09e410 msgr2=0x7f58dc11e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:55.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.437+0000 7f58e0c6b700 1 --2- 172.21.15.26:0/2563184408 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f58dc09e410 0x7f58dc11e7f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f58d400c810 tx=0x7f58d400cb20 comp rx=0 tx=0).stop 2023-10-01T07:58:55.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.437+0000 7f58e0c6b700 1 -- 172.21.15.26:0/2563184408 shutdown_connections 2023-10-01T07:58:55.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.437+0000 7f58e0c6b700 1 --2- 172.21.15.26:0/2563184408 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f58dc09e410 0x7f58dc11e7f0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.437+0000 7f58e0c6b700 1 --2- 172.21.15.26:0/2563184408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58dc09d6f0 0x7f58dc11dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.437+0000 7f58e0c6b700 1 --2- 172.21.15.26:0/2563184408 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f58dc09e000 0x7f58dc11e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:55.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.437+0000 7f58e0c6b700 1 -- 172.21.15.26:0/2563184408 >> 172.21.15.26:0/2563184408 conn(0x7f58dc066f50 msgr2=0x7f58dc130990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:55.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.437+0000 7f58e0c6b700 1 -- 172.21.15.26:0/2563184408 shutdown_connections 2023-10-01T07:58:55.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:55.437+0000 7f58e0c6b700 1 -- 172.21.15.26:0/2563184408 wait complete. 2023-10-01T07:58:55.451 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:56.328 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:56.372 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:56.412 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:56.452 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:56.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.482+0000 7f1008ef1700 1 Processor -- start 2023-10-01T07:58:56.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.483+0000 7f1008ef1700 1 -- start start 2023-10-01T07:58:56.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.484+0000 7f1008ef1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f100409d6f0 0x7f100409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:56.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.484+0000 7f1008ef1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f100409e000 0x7f10041339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:56.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.484+0000 7f1008ef1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f100409b120 con 0x7f100409e410 2023-10-01T07:58:56.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.484+0000 7f1008ef1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f100406b460 con 0x7f100409d6f0 2023-10-01T07:58:56.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.484+0000 7f1008ef1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f100409a7e0 con 0x7f100409e000 2023-10-01T07:58:56.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.484+0000 7f100259c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f100409d6f0 0x7f100409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:56.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.484+0000 7f1001d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f100409e000 0x7f10041339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:56.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.484+0000 7f1002d9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f100409e410 0x7f1004133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44392/0 (socket says 172.21.15.26:44392) 2023-10-01T07:58:56.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.484+0000 7f1002d9d700 1 -- 172.21.15.26:0/1157881004 learned_addr learned my addr 172.21.15.26:0/1157881004 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:56.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.484+0000 7f1001d9b700 1 -- 172.21.15.26:0/1157881004 >> v2:172.21.15.26:3300/0 conn(0x7f100409d6f0 msgr2=0x7f100409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:56.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.484+0000 7f1001d9b700 1 --2- 172.21.15.26:0/1157881004 >> v2:172.21.15.26:3300/0 conn(0x7f100409d6f0 0x7f100409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.484+0000 7f1001d9b700 1 -- 172.21.15.26:0/1157881004 >> v1:172.21.15.26:6789/0 conn(0x7f100409e410 legacy=0x7f1004133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.484+0000 7f1001d9b700 1 -- 172.21.15.26:0/1157881004 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f100409a500 con 0x7f100409e000 2023-10-01T07:58:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.484+0000 7f100159a700 1 -- 172.21.15.26:0/1157881004 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 702430767 0 0) 0x7f100409b120 con 0x7f100409e410 2023-10-01T07:58:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.484+0000 7f100259c700 1 --2- 172.21.15.26:0/1157881004 >> v2:172.21.15.26:3300/0 conn(0x7f100409d6f0 0x7f100409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.485+0000 7f1001d9b700 1 --2- 172.21.15.26:0/1157881004 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f100409e000 0x7f10041339f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8009870 tx=0x7f0ff8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdef2c55cad5a2e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.485+0000 7f100159a700 1 -- 172.21.15.26:0/1157881004 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff8011830 con 0x7f100409e000 2023-10-01T07:58:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.485+0000 7f100159a700 1 -- 172.21.15.26:0/1157881004 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff8011990 con 0x7f100409e000 2023-10-01T07:58:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.485+0000 7f100159a700 1 -- 172.21.15.26:0/1157881004 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff8011d20 con 0x7f100409e000 2023-10-01T07:58:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.486+0000 7f1008ef1700 1 -- 172.21.15.26:0/1157881004 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f100409e000 msgr2=0x7f10041339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.486+0000 7f1008ef1700 1 --2- 172.21.15.26:0/1157881004 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f100409e000 0x7f10041339f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8009870 tx=0x7f0ff8009b80 comp rx=0 tx=0).stop 2023-10-01T07:58:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.486+0000 7f1008ef1700 1 -- 172.21.15.26:0/1157881004 shutdown_connections 2023-10-01T07:58:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.486+0000 7f1008ef1700 1 --2- 172.21.15.26:0/1157881004 >> v2:172.21.15.26:3300/0 conn(0x7f100409d6f0 0x7f100409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.486+0000 7f1008ef1700 1 --2- 172.21.15.26:0/1157881004 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f100409e000 0x7f10041339f0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.486+0000 7f1008ef1700 1 -- 172.21.15.26:0/1157881004 >> 172.21.15.26:0/1157881004 conn(0x7f1004066f50 msgr2=0x7f100409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:56.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.486+0000 7f1008ef1700 1 -- 172.21.15.26:0/1157881004 shutdown_connections 2023-10-01T07:58:56.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.486+0000 7f1008ef1700 1 -- 172.21.15.26:0/1157881004 wait complete. 2023-10-01T07:58:56.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.488+0000 7f1008ef1700 1 Processor -- start 2023-10-01T07:58:56.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.488+0000 7f1008ef1700 1 -- start start 2023-10-01T07:58:56.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.489+0000 7f1008ef1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f100409d6f0 0x7f10041c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:56.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.489+0000 7f1008ef1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f100409e000 0x7f10041c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:56.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.489+0000 7f1008ef1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f100409e410 0x7f10041a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:56.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.489+0000 7f1008ef1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10041b8140 con 0x7f100409e410 2023-10-01T07:58:56.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.489+0000 7f1008ef1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10041bd010 con 0x7f100409e000 2023-10-01T07:58:56.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.489+0000 7f1008ef1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10041c8f20 con 0x7f100409d6f0 2023-10-01T07:58:56.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.489+0000 7f100259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f100409d6f0 0x7f10041c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:56.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.489+0000 7f100259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f100409d6f0 0x7f10041c84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37308/0 (socket says 172.21.15.26:37308) 2023-10-01T07:58:56.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.489+0000 7f100259c700 1 -- 172.21.15.26:0/4064476266 learned_addr learned my addr 172.21.15.26:0/4064476266 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:56.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.489+0000 7f1001d9b700 1 --2- 172.21.15.26:0/4064476266 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f100409e000 0x7f10041c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:56.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.489+0000 7f1002d9d700 1 --2- 172.21.15.26:0/4064476266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f100409e410 0x7f10041a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:56.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.489+0000 7f100259c700 1 -- 172.21.15.26:0/4064476266 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f100409e000 msgr2=0x7f10041c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:56.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.489+0000 7f100259c700 1 --2- 172.21.15.26:0/4064476266 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f100409e000 0x7f10041c89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.489+0000 7f100259c700 1 -- 172.21.15.26:0/4064476266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f100409e410 msgr2=0x7f10041a35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:56.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.489+0000 7f100259c700 1 --2- 172.21.15.26:0/4064476266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f100409e410 0x7f10041a35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.489+0000 7f100259c700 1 -- 172.21.15.26:0/4064476266 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff40094a0 con 0x7f100409d6f0 2023-10-01T07:58:56.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.489+0000 7f100259c700 1 --2- 172.21.15.26:0/4064476266 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f100409d6f0 0x7f10041c84a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0ff400ebe0 tx=0x7f0ff400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:56.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.490+0000 7f0ff2ffd700 1 -- 172.21.15.26:0/4064476266 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff400c850 con 0x7f100409d6f0 2023-10-01T07:58:56.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.490+0000 7f0ff2ffd700 1 -- 172.21.15.26:0/4064476266 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff400c9b0 con 0x7f100409d6f0 2023-10-01T07:58:56.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.490+0000 7f0ff2ffd700 1 -- 172.21.15.26:0/4064476266 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff400cd40 con 0x7f100409d6f0 2023-10-01T07:58:56.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.490+0000 7f1008ef1700 1 -- 172.21.15.26:0/4064476266 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff80094a0 con 0x7f100409d6f0 2023-10-01T07:58:56.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.490+0000 7f1008ef1700 1 -- 172.21.15.26:0/4064476266 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10041b84f0 con 0x7f100409d6f0 2023-10-01T07:58:56.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.491+0000 7f1008ef1700 1 -- 172.21.15.26:0/4064476266 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1004074ea0 con 0x7f100409d6f0 2023-10-01T07:58:56.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.494+0000 7f0ff2ffd700 1 -- 172.21.15.26:0/4064476266 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0ff4013470 con 0x7f100409d6f0 2023-10-01T07:58:56.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.495+0000 7f0ff2ffd700 1 -- 172.21.15.26:0/4064476266 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0ff4040100 con 0x7f100409d6f0 2023-10-01T07:58:56.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.497+0000 7f0ff2ffd700 1 -- 172.21.15.26:0/4064476266 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0ff4013720 con 0x7f100409d6f0 2023-10-01T07:58:56.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.520+0000 7f935e4a3700 1 Processor -- start 2023-10-01T07:58:56.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.520+0000 7f935e4a3700 1 -- start start 2023-10-01T07:58:56.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.520+0000 7f935e4a3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f935809e930 0x7f935809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:56.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.520+0000 7f935e4a3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f935809f650 0x7f9358131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:56.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.520+0000 7f935e4a3700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9358070940 con 0x7f935809f240 2023-10-01T07:58:56.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.520+0000 7f935e4a3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f935806fd60 con 0x7f935809e930 2023-10-01T07:58:56.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.520+0000 7f935e4a3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f935806fa80 con 0x7f935809f650 2023-10-01T07:58:56.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.521+0000 7f9357fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f935809e930 0x7f935809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:56.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.521+0000 7f9357fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f935809e930 0x7f935809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56548/0 (socket says 172.21.15.26:56548) 2023-10-01T07:58:56.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.521+0000 7f9357fff700 1 -- 172.21.15.26:0/750710201 learned_addr learned my addr 172.21.15.26:0/750710201 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:56.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.521+0000 7f935ca40700 1 --2- 172.21.15.26:0/750710201 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f935809f650 0x7f9358131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:56.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.521+0000 7f9357fff700 1 -- 172.21.15.26:0/750710201 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f935809f650 msgr2=0x7f9358131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:56.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.521+0000 7f9357fff700 1 --2- 172.21.15.26:0/750710201 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f935809f650 0x7f9358131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.521+0000 7f9357fff700 1 -- 172.21.15.26:0/750710201 >> v1:172.21.15.26:6789/0 conn(0x7f935809f240 legacy=0x7f93581317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:56.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.521+0000 7f9356ffd700 1 -- 172.21.15.26:0/750710201 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4010664076 0 0) 0x7f9358070940 con 0x7f935809f240 2023-10-01T07:58:56.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.521+0000 7f9357fff700 1 -- 172.21.15.26:0/750710201 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935809fb60 con 0x7f935809e930 2023-10-01T07:58:56.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.521+0000 7f935ca40700 1 --2- 172.21.15.26:0/750710201 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f935809f650 0x7f9358131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:56.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.521+0000 7f9357fff700 1 --2- 172.21.15.26:0/750710201 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f935809e930 0x7f935809ed00 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f93480098f0 tx=0x7f9348009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f0027c4aa6c291 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:56.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.522+0000 7f9356ffd700 1 -- 172.21.15.26:0/750710201 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9348011830 con 0x7f935809e930 2023-10-01T07:58:56.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.522+0000 7f9356ffd700 1 -- 172.21.15.26:0/750710201 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9348011990 con 0x7f935809e930 2023-10-01T07:58:56.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.522+0000 7f9356ffd700 1 -- 172.21.15.26:0/750710201 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9348011d20 con 0x7f935809e930 2023-10-01T07:58:56.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.522+0000 7f935e4a3700 1 -- 172.21.15.26:0/750710201 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f935809e930 msgr2=0x7f935809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:56.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.522+0000 7f935e4a3700 1 --2- 172.21.15.26:0/750710201 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f935809e930 0x7f935809ed00 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f93480098f0 tx=0x7f9348009c00 comp rx=0 tx=0).stop 2023-10-01T07:58:56.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.522+0000 7f935e4a3700 1 -- 172.21.15.26:0/750710201 shutdown_connections 2023-10-01T07:58:56.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.522+0000 7f935e4a3700 1 --2- 172.21.15.26:0/750710201 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f935809f650 0x7f9358131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.522+0000 7f935e4a3700 1 --2- 172.21.15.26:0/750710201 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f935809e930 0x7f935809ed00 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.522+0000 7f935e4a3700 1 -- 172.21.15.26:0/750710201 >> 172.21.15.26:0/750710201 conn(0x7f93580a4210 msgr2=0x7f93580a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:56.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.522+0000 7f935e4a3700 1 -- 172.21.15.26:0/750710201 shutdown_connections 2023-10-01T07:58:56.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.523+0000 7f935e4a3700 1 -- 172.21.15.26:0/750710201 wait complete. 2023-10-01T07:58:56.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.524+0000 7f935e4a3700 1 Processor -- start 2023-10-01T07:58:56.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.524+0000 7f935e4a3700 1 -- start start 2023-10-01T07:58:56.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.524+0000 7f935e4a3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f935809e930 0x7f93581c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:56.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.524+0000 7f935e4a3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f935809f240 0x7f93581c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:56.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.524+0000 7f935e4a3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f935809f650 0x7f93581c4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:56.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.524+0000 7f935e4a3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93581a2140 con 0x7f935809e930 2023-10-01T07:58:56.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.524+0000 7f935e4a3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93581a3e00 con 0x7f935809f240 2023-10-01T07:58:56.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.524+0000 7f935e4a3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93580a30f0 con 0x7f935809f650 2023-10-01T07:58:56.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.524+0000 7f935ca40700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f935809f650 0x7f93581c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:56.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.525+0000 7f935ca40700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f935809f650 0x7f93581c4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37330/0 (socket says 172.21.15.26:37330) 2023-10-01T07:58:56.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.525+0000 7f935ca40700 1 -- 172.21.15.26:0/913030488 learned_addr learned my addr 172.21.15.26:0/913030488 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:56.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.525+0000 7f9357fff700 1 --2- 172.21.15.26:0/913030488 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f935809e930 0x7f93581c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:56.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.525+0000 7f93577fe700 1 --2- 172.21.15.26:0/913030488 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f935809f240 0x7f93581c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:56.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.525+0000 7f935ca40700 1 -- 172.21.15.26:0/913030488 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f935809f240 msgr2=0x7f93581c41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:56.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.525+0000 7f935ca40700 1 --2- 172.21.15.26:0/913030488 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f935809f240 0x7f93581c41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.525+0000 7f935ca40700 1 -- 172.21.15.26:0/913030488 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f935809e930 msgr2=0x7f93581c3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:56.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.525+0000 7f935ca40700 1 --2- 172.21.15.26:0/913030488 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f935809e930 0x7f93581c3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.525+0000 7f935ca40700 1 -- 172.21.15.26:0/913030488 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9350009a70 con 0x7f935809f650 2023-10-01T07:58:56.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.525+0000 7f935ca40700 1 --2- 172.21.15.26:0/913030488 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f935809f650 0x7f93581c4710 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f9350012320 tx=0x7f9350012630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:56.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.525+0000 7f9354ff9700 1 -- 172.21.15.26:0/913030488 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9350014040 con 0x7f935809f650 2023-10-01T07:58:56.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.525+0000 7f9354ff9700 1 -- 172.21.15.26:0/913030488 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9350012eb0 con 0x7f935809f650 2023-10-01T07:58:56.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.525+0000 7f9354ff9700 1 -- 172.21.15.26:0/913030488 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9350009d70 con 0x7f935809f650 2023-10-01T07:58:56.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.526+0000 7f935e4a3700 1 -- 172.21.15.26:0/913030488 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9348009550 con 0x7f935809f650 2023-10-01T07:58:56.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.526+0000 7f935e4a3700 1 -- 172.21.15.26:0/913030488 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93580a0190 con 0x7f935809f650 2023-10-01T07:58:56.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.527+0000 7f935e4a3700 1 -- 172.21.15.26:0/913030488 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93581a3c60 con 0x7f935809f650 2023-10-01T07:58:56.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.528+0000 7f9354ff9700 1 -- 172.21.15.26:0/913030488 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f935002a420 con 0x7f935809f650 2023-10-01T07:58:56.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.528+0000 7f9354ff9700 1 -- 172.21.15.26:0/913030488 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9350044550 con 0x7f935809f650 2023-10-01T07:58:56.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.536+0000 7f9354ff9700 1 -- 172.21.15.26:0/913030488 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f935001f770 con 0x7f935809f650 2023-10-01T07:58:56.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.572+0000 7ffa2c612700 1 Processor -- start 2023-10-01T07:58:56.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.572+0000 7ffa2c612700 1 -- start start 2023-10-01T07:58:56.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.573+0000 7ffa2c612700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa2409d6f0 0x7ffa2409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:56.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.573+0000 7ffa2c612700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffa2409e410 0x7ffa24130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:56.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.573+0000 7ffa2c612700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa2409f130 con 0x7ffa2409e000 2023-10-01T07:58:56.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.573+0000 7ffa2c612700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2409f520 con 0x7ffa2409e410 2023-10-01T07:58:56.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.573+0000 7ffa2c612700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2409e930 con 0x7ffa2409d6f0 2023-10-01T07:58:56.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.574+0000 7ffa29bad700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ffa2409e000 0x7ffa24130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44408/0 (socket says 172.21.15.26:44408) 2023-10-01T07:58:56.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.574+0000 7ffa29bad700 1 -- 172.21.15.26:0/388613389 learned_addr learned my addr 172.21.15.26:0/388613389 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:56.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.574+0000 7ffa2a3ae700 1 --2- 172.21.15.26:0/388613389 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa2409d6f0 0x7ffa2409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:56.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.574+0000 7ffa2abaf700 1 --2- 172.21.15.26:0/388613389 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffa2409e410 0x7ffa24130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:56.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.574+0000 7ffa2abaf700 1 -- 172.21.15.26:0/388613389 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa2409d6f0 msgr2=0x7ffa2409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:56.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.574+0000 7ffa2abaf700 1 --2- 172.21.15.26:0/388613389 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa2409d6f0 0x7ffa2409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.574+0000 7ffa2abaf700 1 -- 172.21.15.26:0/388613389 >> v1:172.21.15.26:6789/0 conn(0x7ffa2409e000 legacy=0x7ffa24130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:56.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.574+0000 7ffa2abaf700 1 -- 172.21.15.26:0/388613389 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa2409b2d0 con 0x7ffa2409e410 2023-10-01T07:58:56.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.574+0000 7ffa293ac700 1 -- 172.21.15.26:0/388613389 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 37278464 0 0) 0x7ffa2409f130 con 0x7ffa2409e000 2023-10-01T07:58:56.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.574+0000 7ffa2a3ae700 1 --2- 172.21.15.26:0/388613389 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa2409d6f0 0x7ffa2409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:56.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.574+0000 7ffa2abaf700 1 --2- 172.21.15.26:0/388613389 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffa2409e410 0x7ffa24130d70 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c009dc0 tx=0x7ffa1c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b99f7f2e463b544 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:56.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.575+0000 7ffa293ac700 1 -- 172.21.15.26:0/388613389 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c00e070 con 0x7ffa2409e410 2023-10-01T07:58:56.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.575+0000 7ffa293ac700 1 -- 172.21.15.26:0/388613389 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1c00bb20 con 0x7ffa2409e410 2023-10-01T07:58:56.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.575+0000 7ffa293ac700 1 -- 172.21.15.26:0/388613389 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c012430 con 0x7ffa2409e410 2023-10-01T07:58:56.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.576+0000 7ffa2c612700 1 -- 172.21.15.26:0/388613389 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffa2409e410 msgr2=0x7ffa24130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:56.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.576+0000 7ffa2c612700 1 --2- 172.21.15.26:0/388613389 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffa2409e410 0x7ffa24130d70 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c009dc0 tx=0x7ffa1c00b330 comp rx=0 tx=0).stop 2023-10-01T07:58:56.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.576+0000 7ffa2c612700 1 -- 172.21.15.26:0/388613389 shutdown_connections 2023-10-01T07:58:56.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.576+0000 7ffa2c612700 1 --2- 172.21.15.26:0/388613389 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa2409d6f0 0x7ffa2409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.576+0000 7ffa2c612700 1 --2- 172.21.15.26:0/388613389 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffa2409e410 0x7ffa24130d70 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.576+0000 7ffa2c612700 1 -- 172.21.15.26:0/388613389 >> 172.21.15.26:0/388613389 conn(0x7ffa24066f50 msgr2=0x7ffa2409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:56.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.576+0000 7ffa2c612700 1 -- 172.21.15.26:0/388613389 shutdown_connections 2023-10-01T07:58:56.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.576+0000 7ffa2c612700 1 -- 172.21.15.26:0/388613389 wait complete. 2023-10-01T07:58:56.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.577+0000 7ffa2c612700 1 Processor -- start 2023-10-01T07:58:56.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.578+0000 7ffa2c612700 1 -- start start 2023-10-01T07:58:56.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.578+0000 7ffa2c612700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa2409d6f0 0x7ffa241226d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:56.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.578+0000 7ffa2c612700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa2409e000 0x7ffa24122c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:56.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.578+0000 7ffa2c612700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffa2409e410 0x7ffa24123150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:56.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.578+0000 7ffa2c612700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa241258d0 con 0x7ffa2409e000 2023-10-01T07:58:56.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.578+0000 7ffa2c612700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa241242e0 con 0x7ffa2409e410 2023-10-01T07:58:56.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.578+0000 7ffa2c612700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa24124b70 con 0x7ffa2409d6f0 2023-10-01T07:58:56.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.578+0000 7ffa2a3ae700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa2409d6f0 0x7ffa241226d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:56.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.578+0000 7ffa2a3ae700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa2409d6f0 0x7ffa241226d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37344/0 (socket says 172.21.15.26:37344) 2023-10-01T07:58:56.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.578+0000 7ffa2a3ae700 1 -- 172.21.15.26:0/390368709 learned_addr learned my addr 172.21.15.26:0/390368709 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:56.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.579+0000 7ffa29bad700 1 --2- 172.21.15.26:0/390368709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa2409e000 0x7ffa24122c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:56.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.579+0000 7ffa2abaf700 1 --2- 172.21.15.26:0/390368709 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffa2409e410 0x7ffa24123150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:56.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.579+0000 7ffa2a3ae700 1 -- 172.21.15.26:0/390368709 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffa2409e410 msgr2=0x7ffa24123150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:56.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.579+0000 7ffa2a3ae700 1 --2- 172.21.15.26:0/390368709 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffa2409e410 0x7ffa24123150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.579+0000 7ffa2a3ae700 1 -- 172.21.15.26:0/390368709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa2409e000 msgr2=0x7ffa24122c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:56.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.579+0000 7ffa2a3ae700 1 --2- 172.21.15.26:0/390368709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa2409e000 0x7ffa24122c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.579+0000 7ffa2a3ae700 1 -- 172.21.15.26:0/390368709 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa2000b740 con 0x7ffa2409d6f0 2023-10-01T07:58:56.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.579+0000 7ffa29bad700 1 --2- 172.21.15.26:0/390368709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa2409e000 0x7ffa24122c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:58:56.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.579+0000 7ffa2a3ae700 1 --2- 172.21.15.26:0/390368709 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa2409d6f0 0x7ffa241226d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ffa2000ed70 tx=0x7ffa2000d630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:56.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.579+0000 7ffa1affd700 1 -- 172.21.15.26:0/390368709 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa20010640 con 0x7ffa2409d6f0 2023-10-01T07:58:56.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.579+0000 7ffa1affd700 1 -- 172.21.15.26:0/390368709 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa200107a0 con 0x7ffa2409d6f0 2023-10-01T07:58:56.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.579+0000 7ffa2c612700 1 -- 172.21.15.26:0/390368709 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa1c009a70 con 0x7ffa2409d6f0 2023-10-01T07:58:56.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.579+0000 7ffa1affd700 1 -- 172.21.15.26:0/390368709 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa20010b10 con 0x7ffa2409d6f0 2023-10-01T07:58:56.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.580+0000 7ffa2c612700 1 -- 172.21.15.26:0/390368709 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa24125c50 con 0x7ffa2409d6f0 2023-10-01T07:58:56.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.581+0000 7ffa2c612700 1 -- 172.21.15.26:0/390368709 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa2409c700 con 0x7ffa2409d6f0 2023-10-01T07:58:56.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.581+0000 7ffa1affd700 1 -- 172.21.15.26:0/390368709 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffa20010c70 con 0x7ffa2409d6f0 2023-10-01T07:58:56.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.581+0000 7ffa1affd700 1 -- 172.21.15.26:0/390368709 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ffa20043480 con 0x7ffa2409d6f0 2023-10-01T07:58:56.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.586+0000 7ffa1affd700 1 -- 172.21.15.26:0/390368709 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa2000c930 con 0x7ffa2409d6f0 2023-10-01T07:58:56.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.640+0000 7f6e0bcf8700 1 Processor -- start 2023-10-01T07:58:56.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.640+0000 7f6e0bcf8700 1 -- start start 2023-10-01T07:58:56.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.641+0000 7f6e0bcf8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e0409d6f0 0x7f6e0409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:56.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.641+0000 7f6e0bcf8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e0409e000 0x7f6e041339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:56.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.641+0000 7f6e0bcf8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e0409e410 0x7f6e04133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:56.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.641+0000 7f6e0bcf8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e0406b460 con 0x7f6e0409e000 2023-10-01T07:58:56.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.641+0000 7f6e0bcf8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0409b120 con 0x7f6e0409d6f0 2023-10-01T07:58:56.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.641+0000 7f6e0bcf8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0409a7e0 con 0x7f6e0409e410 2023-10-01T07:58:56.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.641+0000 7f6e09a94700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e0409d6f0 0x7f6e0409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:56.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.641+0000 7f6e09a94700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e0409d6f0 0x7f6e0409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46772/0 (socket says 172.21.15.26:46772) 2023-10-01T07:58:56.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.641+0000 7f6e09a94700 1 -- 172.21.15.26:0/1138744492 learned_addr learned my addr 172.21.15.26:0/1138744492 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:56.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.641+0000 7f6e09293700 1 --2- 172.21.15.26:0/1138744492 >> v2:172.21.15.26:3300/0 conn(0x7f6e0409e000 0x7f6e041339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:56.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.641+0000 7f6e0a295700 1 --2- 172.21.15.26:0/1138744492 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e0409e410 0x7f6e04133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:56.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.642+0000 7f6e09a94700 1 -- 172.21.15.26:0/1138744492 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e0409e410 msgr2=0x7f6e04133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:56.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.642+0000 7f6e09a94700 1 --2- 172.21.15.26:0/1138744492 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e0409e410 0x7f6e04133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.642+0000 7f6e09a94700 1 -- 172.21.15.26:0/1138744492 >> v2:172.21.15.26:3300/0 conn(0x7f6e0409e000 msgr2=0x7f6e041339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:56.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.642+0000 7f6e09a94700 1 --2- 172.21.15.26:0/1138744492 >> v2:172.21.15.26:3300/0 conn(0x7f6e0409e000 0x7f6e041339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.642+0000 7f6e09a94700 1 -- 172.21.15.26:0/1138744492 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0409a500 con 0x7f6e0409d6f0 2023-10-01T07:58:56.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.642+0000 7f6e09a94700 1 --2- 172.21.15.26:0/1138744492 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e0409d6f0 0x7f6e0409dac0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f6e00009920 tx=0x7f6e00009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bceaf89c5926c1b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:56.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.642+0000 7f6e08a92700 1 -- 172.21.15.26:0/1138744492 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e00011830 con 0x7f6e0409d6f0 2023-10-01T07:58:56.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.642+0000 7f6e08a92700 1 -- 172.21.15.26:0/1138744492 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e00011990 con 0x7f6e0409d6f0 2023-10-01T07:58:56.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.642+0000 7f6e08a92700 1 -- 172.21.15.26:0/1138744492 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e00011d20 con 0x7f6e0409d6f0 2023-10-01T07:58:56.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.643+0000 7f6e0bcf8700 1 -- 172.21.15.26:0/1138744492 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e0409d6f0 msgr2=0x7f6e0409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:56.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.643+0000 7f6e0bcf8700 1 --2- 172.21.15.26:0/1138744492 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e0409d6f0 0x7f6e0409dac0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f6e00009920 tx=0x7f6e00009c30 comp rx=0 tx=0).stop 2023-10-01T07:58:56.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.643+0000 7f6e0bcf8700 1 -- 172.21.15.26:0/1138744492 shutdown_connections 2023-10-01T07:58:56.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.643+0000 7f6e0bcf8700 1 --2- 172.21.15.26:0/1138744492 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e0409e410 0x7f6e04133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.643+0000 7f6e0bcf8700 1 --2- 172.21.15.26:0/1138744492 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e0409d6f0 0x7f6e0409dac0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.643+0000 7f6e0bcf8700 1 --2- 172.21.15.26:0/1138744492 >> v2:172.21.15.26:3300/0 conn(0x7f6e0409e000 0x7f6e041339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.643+0000 7f6e0bcf8700 1 -- 172.21.15.26:0/1138744492 >> 172.21.15.26:0/1138744492 conn(0x7f6e04066f50 msgr2=0x7f6e0409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:56.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.643+0000 7f6e0bcf8700 1 -- 172.21.15.26:0/1138744492 shutdown_connections 2023-10-01T07:58:56.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.643+0000 7f6e0bcf8700 1 -- 172.21.15.26:0/1138744492 wait complete. 2023-10-01T07:58:56.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.644+0000 7f6e0bcf8700 1 Processor -- start 2023-10-01T07:58:56.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.645+0000 7f6e0bcf8700 1 -- start start 2023-10-01T07:58:56.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.645+0000 7f6e0bcf8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e0409d6f0 0x7f6e041c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:56.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.645+0000 7f6e0bcf8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e0409e000 0x7f6e041c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:56.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.645+0000 7f6e0bcf8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e0409e410 0x7f6e041c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:56.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.645+0000 7f6e0bcf8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e041aaa00 con 0x7f6e0409e410 2023-10-01T07:58:56.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.645+0000 7f6e0bcf8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e040a2090 con 0x7f6e0409e000 2023-10-01T07:58:56.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.645+0000 7f6e0bcf8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0409c710 con 0x7f6e0409d6f0 2023-10-01T07:58:56.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.646+0000 7f6e0a295700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e0409e410 0x7f6e041c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:56.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.646+0000 7f6e0a295700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e0409e410 0x7f6e041c49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56590/0 (socket says 172.21.15.26:56590) 2023-10-01T07:58:56.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.646+0000 7f6e0a295700 1 -- 172.21.15.26:0/567512918 learned_addr learned my addr 172.21.15.26:0/567512918 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:56.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.646+0000 7f6e09293700 1 --2- 172.21.15.26:0/567512918 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e0409e000 0x7f6e041c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:56.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.646+0000 7f6e09a94700 1 --2- 172.21.15.26:0/567512918 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e0409d6f0 0x7f6e041c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:56.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.646+0000 7f6e09293700 1 -- 172.21.15.26:0/567512918 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e0409d6f0 msgr2=0x7f6e041c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:56.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.646+0000 7f6e09293700 1 --2- 172.21.15.26:0/567512918 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e0409d6f0 0x7f6e041c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.646+0000 7f6e09293700 1 -- 172.21.15.26:0/567512918 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e0409e410 msgr2=0x7f6e041c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:56.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.646+0000 7f6e09293700 1 --2- 172.21.15.26:0/567512918 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e0409e410 0x7f6e041c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.646+0000 7f6e09293700 1 -- 172.21.15.26:0/567512918 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e00009550 con 0x7f6e0409e000 2023-10-01T07:58:56.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.646+0000 7f6e09293700 1 --2- 172.21.15.26:0/567512918 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e0409e000 0x7f6e041c8c40 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f6df400e8d0 tx=0x7f6df400ebe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:56.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.646+0000 7f6dfa7fc700 1 -- 172.21.15.26:0/567512918 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df4013680 con 0x7f6e0409e000 2023-10-01T07:58:56.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.647+0000 7f6dfa7fc700 1 -- 172.21.15.26:0/567512918 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df40137e0 con 0x7f6e0409e000 2023-10-01T07:58:56.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.647+0000 7f6e0bcf8700 1 -- 172.21.15.26:0/567512918 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e041a9be0 con 0x7f6e0409e000 2023-10-01T07:58:56.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.647+0000 7f6dfa7fc700 1 -- 172.21.15.26:0/567512918 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df4013b50 con 0x7f6e0409e000 2023-10-01T07:58:56.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.647+0000 7f6e0bcf8700 1 -- 172.21.15.26:0/567512918 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e041ac1b0 con 0x7f6e0409e000 2023-10-01T07:58:56.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.648+0000 7f6dfa7fc700 1 -- 172.21.15.26:0/567512918 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6df4013cb0 con 0x7f6e0409e000 2023-10-01T07:58:56.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.648+0000 7f6dfa7fc700 1 -- 172.21.15.26:0/567512918 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6df403f660 con 0x7f6e0409e000 2023-10-01T07:58:56.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.648+0000 7f6e0bcf8700 1 -- 172.21.15.26:0/567512918 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e04074ea0 con 0x7f6e0409e000 2023-10-01T07:58:56.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.657+0000 7f6dfa7fc700 1 -- 172.21.15.26:0/567512918 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6df401be10 con 0x7f6e0409e000 2023-10-01T07:58:56.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.740+0000 7f1008ef1700 1 -- 172.21.15.26:0/4064476266 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f100406c360 con 0x7f100409d6f0 2023-10-01T07:58:56.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.741+0000 7f0ff2ffd700 1 -- 172.21.15.26:0/4064476266 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0ff4017090 con 0x7f100409d6f0 2023-10-01T07:58:56.742 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:56.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.743+0000 7f1008ef1700 1 -- 172.21.15.26:0/4064476266 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f100409d6f0 msgr2=0x7f10041c84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:56.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.743+0000 7f1008ef1700 1 --2- 172.21.15.26:0/4064476266 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f100409d6f0 0x7f10041c84a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0ff400ebe0 tx=0x7f0ff400eef0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.744+0000 7f1008ef1700 1 -- 172.21.15.26:0/4064476266 shutdown_connections 2023-10-01T07:58:56.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.744+0000 7f1008ef1700 1 --2- 172.21.15.26:0/4064476266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f100409e410 0x7f10041a35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.744+0000 7f1008ef1700 1 --2- 172.21.15.26:0/4064476266 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f100409d6f0 0x7f10041c84a0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.744+0000 7f1008ef1700 1 --2- 172.21.15.26:0/4064476266 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f100409e000 0x7f10041c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.744+0000 7f1008ef1700 1 -- 172.21.15.26:0/4064476266 >> 172.21.15.26:0/4064476266 conn(0x7f1004066f50 msgr2=0x7f10041bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:56.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.744+0000 7f1008ef1700 1 -- 172.21.15.26:0/4064476266 shutdown_connections 2023-10-01T07:58:56.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.744+0000 7f1008ef1700 1 -- 172.21.15.26:0/4064476266 wait complete. 2023-10-01T07:58:56.759 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:56.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.762+0000 7f935e4a3700 1 -- 172.21.15.26:0/913030488 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f93581a3c60 con 0x7f935809f650 2023-10-01T07:58:56.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.763+0000 7f9354ff9700 1 -- 172.21.15.26:0/913030488 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f93581a3c60 con 0x7f935809f650 2023-10-01T07:58:56.763 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:56.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.765+0000 7f935e4a3700 1 -- 172.21.15.26:0/913030488 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f935809f650 msgr2=0x7f93581c4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:56.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.765+0000 7f935e4a3700 1 --2- 172.21.15.26:0/913030488 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f935809f650 0x7f93581c4710 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f9350012320 tx=0x7f9350012630 comp rx=0 tx=0).stop 2023-10-01T07:58:56.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.765+0000 7f935e4a3700 1 -- 172.21.15.26:0/913030488 shutdown_connections 2023-10-01T07:58:56.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.765+0000 7f935e4a3700 1 --2- 172.21.15.26:0/913030488 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f935809f650 0x7f93581c4710 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.765+0000 7f935e4a3700 1 --2- 172.21.15.26:0/913030488 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f935809e930 0x7f93581c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.765+0000 7f935e4a3700 1 --2- 172.21.15.26:0/913030488 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f935809f240 0x7f93581c41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.765+0000 7f935e4a3700 1 -- 172.21.15.26:0/913030488 >> 172.21.15.26:0/913030488 conn(0x7f93580a4210 msgr2=0x7f935806c360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:56.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.765+0000 7f935e4a3700 1 -- 172.21.15.26:0/913030488 shutdown_connections 2023-10-01T07:58:56.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.765+0000 7f935e4a3700 1 -- 172.21.15.26:0/913030488 wait complete. 2023-10-01T07:58:56.780 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:56.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.835+0000 7ffa2c612700 1 -- 172.21.15.26:0/390368709 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffa24074ea0 con 0x7ffa2409d6f0 2023-10-01T07:58:56.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.835+0000 7ffa1affd700 1 -- 172.21.15.26:0/390368709 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffa20017e70 con 0x7ffa2409d6f0 2023-10-01T07:58:56.836 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:56.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.838+0000 7ffa2c612700 1 -- 172.21.15.26:0/390368709 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa2409d6f0 msgr2=0x7ffa241226d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:56.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.838+0000 7ffa2c612700 1 --2- 172.21.15.26:0/390368709 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa2409d6f0 0x7ffa241226d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ffa2000ed70 tx=0x7ffa2000d630 comp rx=0 tx=0).stop 2023-10-01T07:58:56.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.838+0000 7ffa2c612700 1 -- 172.21.15.26:0/390368709 shutdown_connections 2023-10-01T07:58:56.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.838+0000 7ffa2c612700 1 --2- 172.21.15.26:0/390368709 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffa2409e410 0x7ffa24123150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.838+0000 7ffa2c612700 1 --2- 172.21.15.26:0/390368709 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa2409d6f0 0x7ffa241226d0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.838+0000 7ffa2c612700 1 --2- 172.21.15.26:0/390368709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa2409e000 0x7ffa24122c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.838+0000 7ffa2c612700 1 -- 172.21.15.26:0/390368709 >> 172.21.15.26:0/390368709 conn(0x7ffa24066f50 msgr2=0x7ffa24070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:56.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.838+0000 7ffa2c612700 1 -- 172.21.15.26:0/390368709 shutdown_connections 2023-10-01T07:58:56.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.838+0000 7ffa2c612700 1 -- 172.21.15.26:0/390368709 wait complete. 2023-10-01T07:58:56.852 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:56.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.882+0000 7f6e0bcf8700 1 -- 172.21.15.26:0/567512918 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6e0406c360 con 0x7f6e0409e000 2023-10-01T07:58:56.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.882+0000 7f6dfa7fc700 1 -- 172.21.15.26:0/567512918 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6df401b3b0 con 0x7f6e0409e000 2023-10-01T07:58:56.883 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:56.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.884+0000 7f6e0bcf8700 1 -- 172.21.15.26:0/567512918 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e0409e000 msgr2=0x7f6e041c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:56.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.884+0000 7f6e0bcf8700 1 --2- 172.21.15.26:0/567512918 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e0409e000 0x7f6e041c8c40 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f6df400e8d0 tx=0x7f6df400ebe0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.885+0000 7f6e0bcf8700 1 -- 172.21.15.26:0/567512918 shutdown_connections 2023-10-01T07:58:56.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.885+0000 7f6e0bcf8700 1 --2- 172.21.15.26:0/567512918 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e0409e410 0x7f6e041c49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.885+0000 7f6e0bcf8700 1 --2- 172.21.15.26:0/567512918 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e0409d6f0 0x7f6e041c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.885+0000 7f6e0bcf8700 1 --2- 172.21.15.26:0/567512918 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e0409e000 0x7f6e041c8c40 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:56.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.885+0000 7f6e0bcf8700 1 -- 172.21.15.26:0/567512918 >> 172.21.15.26:0/567512918 conn(0x7f6e04066f50 msgr2=0x7f6e04071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:56.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.885+0000 7f6e0bcf8700 1 -- 172.21.15.26:0/567512918 shutdown_connections 2023-10-01T07:58:56.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:56.885+0000 7f6e0bcf8700 1 -- 172.21.15.26:0/567512918 wait complete. 2023-10-01T07:58:56.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:57.760 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:57.781 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:57.853 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:57.899 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:57.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.910+0000 7f400a9c3700 1 Processor -- start 2023-10-01T07:58:57.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.910+0000 7f400a9c3700 1 -- start start 2023-10-01T07:58:57.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.911+0000 7f400a9c3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f400409d6f0 0x7f400409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:57.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.911+0000 7f400a9c3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f400409e000 0x7f4004130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:57.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.911+0000 7f400a9c3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f400409e410 0x7f4004130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:57.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.911+0000 7f400a9c3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f400409f520 con 0x7f400409d6f0 2023-10-01T07:58:57.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.911+0000 7f400a9c3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400409f130 con 0x7f400409e410 2023-10-01T07:58:57.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.911+0000 7f400a9c3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f400409e930 con 0x7f400409e000 2023-10-01T07:58:57.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.911+0000 7f4003fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f400409d6f0 0x7f400409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:57.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.911+0000 7f4003fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f400409d6f0 0x7f400409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56606/0 (socket says 172.21.15.26:56606) 2023-10-01T07:58:57.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.911+0000 7f4003fff700 1 -- 172.21.15.26:0/1128072613 learned_addr learned my addr 172.21.15.26:0/1128072613 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:57.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.911+0000 7f4008f60700 1 --2- 172.21.15.26:0/1128072613 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f400409e410 0x7f4004130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:57.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.912+0000 7f40037fe700 1 --2- 172.21.15.26:0/1128072613 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f400409e000 0x7f4004130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:57.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.912+0000 7f4008f60700 1 -- 172.21.15.26:0/1128072613 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f400409e000 msgr2=0x7f4004130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:57.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.912+0000 7f4008f60700 1 --2- 172.21.15.26:0/1128072613 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f400409e000 0x7f4004130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:57.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.912+0000 7f4008f60700 1 -- 172.21.15.26:0/1128072613 >> v2:172.21.15.26:3300/0 conn(0x7f400409d6f0 msgr2=0x7f400409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:57.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.912+0000 7f4008f60700 1 --2- 172.21.15.26:0/1128072613 >> v2:172.21.15.26:3300/0 conn(0x7f400409d6f0 0x7f400409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:57.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.912+0000 7f4008f60700 1 -- 172.21.15.26:0/1128072613 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f400409b2d0 con 0x7f400409e410 2023-10-01T07:58:57.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.912+0000 7f4008f60700 1 --2- 172.21.15.26:0/1128072613 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f400409e410 0x7f4004130ba0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc009d90 tx=0x7f3ffc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=725015ab863ec393 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:57.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.912+0000 7f4002ffd700 1 -- 172.21.15.26:0/1128072613 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc00e070 con 0x7f400409e410 2023-10-01T07:58:57.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.912+0000 7f4002ffd700 1 -- 172.21.15.26:0/1128072613 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ffc00bb20 con 0x7f400409e410 2023-10-01T07:58:57.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.912+0000 7f4002ffd700 1 -- 172.21.15.26:0/1128072613 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc012430 con 0x7f400409e410 2023-10-01T07:58:57.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.913+0000 7f400a9c3700 1 -- 172.21.15.26:0/1128072613 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f400409e410 msgr2=0x7f4004130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:57.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.913+0000 7f400a9c3700 1 --2- 172.21.15.26:0/1128072613 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f400409e410 0x7f4004130ba0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc009d90 tx=0x7f3ffc00b330 comp rx=0 tx=0).stop 2023-10-01T07:58:57.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.913+0000 7f400a9c3700 1 -- 172.21.15.26:0/1128072613 shutdown_connections 2023-10-01T07:58:57.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.913+0000 7f400a9c3700 1 --2- 172.21.15.26:0/1128072613 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f400409e410 0x7f4004130ba0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:57.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.913+0000 7f400a9c3700 1 --2- 172.21.15.26:0/1128072613 >> v2:172.21.15.26:3300/0 conn(0x7f400409d6f0 0x7f400409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:57.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.913+0000 7f400a9c3700 1 --2- 172.21.15.26:0/1128072613 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f400409e000 0x7f4004130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:57.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.913+0000 7f400a9c3700 1 -- 172.21.15.26:0/1128072613 >> 172.21.15.26:0/1128072613 conn(0x7f4004066f50 msgr2=0x7f400409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:57.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.914+0000 7f400a9c3700 1 -- 172.21.15.26:0/1128072613 shutdown_connections 2023-10-01T07:58:57.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.914+0000 7f400a9c3700 1 -- 172.21.15.26:0/1128072613 wait complete. 2023-10-01T07:58:57.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.915+0000 7f400a9c3700 1 Processor -- start 2023-10-01T07:58:57.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.915+0000 7f400a9c3700 1 -- start start 2023-10-01T07:58:57.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.916+0000 7f400a9c3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f400409d6f0 0x7f400411dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:57.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.916+0000 7f400a9c3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f400409e000 0x7f400411e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:57.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.916+0000 7f400a9c3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f400409e410 0x7f400411e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:57.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.916+0000 7f400a9c3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400411f230 con 0x7f400409d6f0 2023-10-01T07:58:57.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.916+0000 7f400a9c3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400411f9b0 con 0x7f400409e410 2023-10-01T07:58:57.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.916+0000 7f400a9c3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f400411ffd0 con 0x7f400409e000 2023-10-01T07:58:57.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.916+0000 7f4008f60700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f400409e410 0x7f400411e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:57.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.916+0000 7f4008f60700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f400409e410 0x7f400411e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46808/0 (socket says 172.21.15.26:46808) 2023-10-01T07:58:57.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.916+0000 7f4008f60700 1 -- 172.21.15.26:0/1394156707 learned_addr learned my addr 172.21.15.26:0/1394156707 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:57.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.916+0000 7f4003fff700 1 --2- 172.21.15.26:0/1394156707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f400409d6f0 0x7f400411dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:57.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.916+0000 7f40037fe700 1 --2- 172.21.15.26:0/1394156707 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f400409e000 0x7f400411e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:57.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.917+0000 7f4008f60700 1 -- 172.21.15.26:0/1394156707 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f400409e000 msgr2=0x7f400411e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:57.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.917+0000 7f4008f60700 1 --2- 172.21.15.26:0/1394156707 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f400409e000 0x7f400411e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:57.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.917+0000 7f4008f60700 1 -- 172.21.15.26:0/1394156707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f400409d6f0 msgr2=0x7f400411dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:57.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.917+0000 7f4008f60700 1 --2- 172.21.15.26:0/1394156707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f400409d6f0 0x7f400411dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:57.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.917+0000 7f4008f60700 1 -- 172.21.15.26:0/1394156707 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ffc009a70 con 0x7f400409e410 2023-10-01T07:58:57.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.917+0000 7f4003fff700 1 --2- 172.21.15.26:0/1394156707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f400409d6f0 0x7f400411dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:58:57.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.917+0000 7f40037fe700 1 --2- 172.21.15.26:0/1394156707 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f400409e000 0x7f400411e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:58:57.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.917+0000 7f4008f60700 1 --2- 172.21.15.26:0/1394156707 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f400409e410 0x7f400411e820 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc0042a0 tx=0x7f3ffc004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:57.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.917+0000 7f4000ff9700 1 -- 172.21.15.26:0/1394156707 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc027480 con 0x7f400409e410 2023-10-01T07:58:57.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.917+0000 7f4000ff9700 1 -- 172.21.15.26:0/1394156707 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ffc020070 con 0x7f400409e410 2023-10-01T07:58:57.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.917+0000 7f4000ff9700 1 -- 172.21.15.26:0/1394156707 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc027820 con 0x7f400409e410 2023-10-01T07:58:57.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.918+0000 7f400a9c3700 1 -- 172.21.15.26:0/1394156707 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40041215e0 con 0x7f400409e410 2023-10-01T07:58:57.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.918+0000 7f400a9c3700 1 -- 172.21.15.26:0/1394156707 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40040a16b0 con 0x7f400409e410 2023-10-01T07:58:57.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.919+0000 7f4000ff9700 1 -- 172.21.15.26:0/1394156707 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3ffc012430 con 0x7f400409e410 2023-10-01T07:58:57.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.919+0000 7f4000ff9700 1 -- 172.21.15.26:0/1394156707 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3ffc022070 con 0x7f400409e410 2023-10-01T07:58:57.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.920+0000 7f400a9c3700 1 -- 172.21.15.26:0/1394156707 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f400409c760 con 0x7f400409e410 2023-10-01T07:58:57.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.929+0000 7f4000ff9700 1 -- 172.21.15.26:0/1394156707 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ffc01b400 con 0x7f400409e410 2023-10-01T07:58:57.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.955+0000 7f633e254700 1 Processor -- start 2023-10-01T07:58:57.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.955+0000 7f633e254700 1 -- start start 2023-10-01T07:58:57.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.956+0000 7f633e254700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6338130750 0x7f6338130b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:57.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.956+0000 7f633e254700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f633809d6f0 0x7f633809db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:57.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.956+0000 7f633e254700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f633809e080 0x7f63381374b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:57.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.956+0000 7f633e254700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f633809c190 con 0x7f6338130750 2023-10-01T07:58:57.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.956+0000 7f633e254700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633809b090 con 0x7f633809d6f0 2023-10-01T07:58:57.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.956+0000 7f633e254700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f633809a6c0 con 0x7f633809e080 2023-10-01T07:58:57.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.956+0000 7f6337fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f633809e080 0x7f63381374b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:57.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.956+0000 7f6337fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f633809e080 0x7f63381374b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37400/0 (socket says 172.21.15.26:37400) 2023-10-01T07:58:57.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.956+0000 7f6337fff700 1 -- 172.21.15.26:0/620579511 learned_addr learned my addr 172.21.15.26:0/620579511 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:57.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.957+0000 7f63377fe700 1 --2- 172.21.15.26:0/620579511 >> v2:172.21.15.26:3300/0 conn(0x7f6338130750 0x7f6338130b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:57.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.957+0000 7f6336ffd700 1 --2- 172.21.15.26:0/620579511 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f633809d6f0 0x7f633809db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:57.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.957+0000 7f6337fff700 1 -- 172.21.15.26:0/620579511 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f633809d6f0 msgr2=0x7f633809db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:57.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.957+0000 7f6337fff700 1 --2- 172.21.15.26:0/620579511 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f633809d6f0 0x7f633809db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:57.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.957+0000 7f6337fff700 1 -- 172.21.15.26:0/620579511 >> v2:172.21.15.26:3300/0 conn(0x7f6338130750 msgr2=0x7f6338130b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:57.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.957+0000 7f6337fff700 1 --2- 172.21.15.26:0/620579511 >> v2:172.21.15.26:3300/0 conn(0x7f6338130750 0x7f6338130b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:57.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.957+0000 7f6337fff700 1 -- 172.21.15.26:0/620579511 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6338131060 con 0x7f633809e080 2023-10-01T07:58:57.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.957+0000 7f6337fff700 1 --2- 172.21.15.26:0/620579511 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f633809e080 0x7f63381374b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6330009e50 tx=0x7f633000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71935accbc10e301 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:57.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.958+0000 7f63367fc700 1 -- 172.21.15.26:0/620579511 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633000e070 con 0x7f633809e080 2023-10-01T07:58:57.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.958+0000 7f63367fc700 1 -- 172.21.15.26:0/620579511 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633000b910 con 0x7f633809e080 2023-10-01T07:58:57.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.958+0000 7f63367fc700 1 -- 172.21.15.26:0/620579511 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633000bcc0 con 0x7f633809e080 2023-10-01T07:58:57.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.958+0000 7f633e254700 1 -- 172.21.15.26:0/620579511 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f633809e080 msgr2=0x7f63381374b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:57.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.958+0000 7f633e254700 1 --2- 172.21.15.26:0/620579511 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f633809e080 0x7f63381374b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6330009e50 tx=0x7f633000b330 comp rx=0 tx=0).stop 2023-10-01T07:58:57.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.958+0000 7f633e254700 1 -- 172.21.15.26:0/620579511 shutdown_connections 2023-10-01T07:58:57.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.958+0000 7f633e254700 1 --2- 172.21.15.26:0/620579511 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f633809e080 0x7f63381374b0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:57.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.958+0000 7f633e254700 1 --2- 172.21.15.26:0/620579511 >> v2:172.21.15.26:3300/0 conn(0x7f6338130750 0x7f6338130b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:57.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.958+0000 7f633e254700 1 --2- 172.21.15.26:0/620579511 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f633809d6f0 0x7f633809db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:57.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.958+0000 7f633e254700 1 -- 172.21.15.26:0/620579511 >> 172.21.15.26:0/620579511 conn(0x7f633809f470 msgr2=0x7f63380a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:57.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.959+0000 7f633e254700 1 -- 172.21.15.26:0/620579511 shutdown_connections 2023-10-01T07:58:57.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.959+0000 7f633e254700 1 -- 172.21.15.26:0/620579511 wait complete. 2023-10-01T07:58:57.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.960+0000 7f633e254700 1 Processor -- start 2023-10-01T07:58:57.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.960+0000 7f633e254700 1 -- start start 2023-10-01T07:58:57.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.960+0000 7f633e254700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f633809d6f0 0x7f63380917f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:57.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.960+0000 7f633e254700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f633809e080 0x7f6338096900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:57.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.960+0000 7f633e254700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6338130750 0x7f6338096e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:57.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.960+0000 7f633e254700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6338098f30 con 0x7f633809d6f0 2023-10-01T07:58:57.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.960+0000 7f633e254700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633809b270 con 0x7f6338130750 2023-10-01T07:58:57.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.960+0000 7f633e254700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f633808bd80 con 0x7f633809e080 2023-10-01T07:58:57.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.961+0000 7f63377fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f633809d6f0 0x7f63380917f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:57.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.961+0000 7f6337fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6338130750 0x7f6338096e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:57.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.961+0000 7f63377fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f633809d6f0 0x7f63380917f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56638/0 (socket says 172.21.15.26:56638) 2023-10-01T07:58:57.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.961+0000 7f63377fe700 1 -- 172.21.15.26:0/1767720998 learned_addr learned my addr 172.21.15.26:0/1767720998 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:57.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.961+0000 7f63377fe700 1 -- 172.21.15.26:0/1767720998 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f633809e080 msgr2=0x7f6338096900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:57.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.961+0000 7f63377fe700 1 --2- 172.21.15.26:0/1767720998 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f633809e080 0x7f6338096900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:57.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.961+0000 7f63377fe700 1 -- 172.21.15.26:0/1767720998 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6338130750 msgr2=0x7f6338096e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:57.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.961+0000 7f63377fe700 1 --2- 172.21.15.26:0/1767720998 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6338130750 0x7f6338096e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:57.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.961+0000 7f63377fe700 1 -- 172.21.15.26:0/1767720998 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6330009b30 con 0x7f633809d6f0 2023-10-01T07:58:57.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.961+0000 7f6337fff700 1 --2- 172.21.15.26:0/1767720998 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6338130750 0x7f6338096e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:57.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.961+0000 7f63377fe700 1 --2- 172.21.15.26:0/1767720998 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f633809d6f0 0x7f63380917f0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f632800e9b0 tx=0x7f632800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:57.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.961+0000 7f631ffff700 1 -- 172.21.15.26:0/1767720998 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6328009710 con 0x7f633809d6f0 2023-10-01T07:58:57.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.961+0000 7f631ffff700 1 -- 172.21.15.26:0/1767720998 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632800c850 con 0x7f633809d6f0 2023-10-01T07:58:57.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.962+0000 7f631ffff700 1 -- 172.21.15.26:0/1767720998 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632800cbc0 con 0x7f633809d6f0 2023-10-01T07:58:57.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.962+0000 7f633e254700 1 -- 172.21.15.26:0/1767720998 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f633808c040 con 0x7f633809d6f0 2023-10-01T07:58:57.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.962+0000 7f633e254700 1 -- 172.21.15.26:0/1767720998 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6338098490 con 0x7f633809d6f0 2023-10-01T07:58:57.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.963+0000 7f631ffff700 1 -- 172.21.15.26:0/1767720998 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f632800cd20 con 0x7f633809d6f0 2023-10-01T07:58:57.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.963+0000 7f631ffff700 1 -- 172.21.15.26:0/1767720998 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f632803f700 con 0x7f633809d6f0 2023-10-01T07:58:57.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.964+0000 7f633e254700 1 -- 172.21.15.26:0/1767720998 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63380986e0 con 0x7f633809d6f0 2023-10-01T07:58:57.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:57.969+0000 7f631ffff700 1 -- 172.21.15.26:0/1767720998 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f63380986e0 con 0x7f633809d6f0 2023-10-01T07:58:58.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.026+0000 7f640f6c2700 1 Processor -- start 2023-10-01T07:58:58.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.026+0000 7f640f6c2700 1 -- start start 2023-10-01T07:58:58.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.027+0000 7f640f6c2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6408130540 0x7f6408130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:58.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.027+0000 7f640f6c2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6408130e50 0x7f640806f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:58.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.027+0000 7f640f6c2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64080716a0 con 0x7f640806fb20 2023-10-01T07:58:58.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.027+0000 7f640f6c2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f640809a390 con 0x7f6408130540 2023-10-01T07:58:58.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.027+0000 7f640f6c2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6408071290 con 0x7f6408130e50 2023-10-01T07:58:58.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.027+0000 7f640d45e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6408130540 0x7f6408130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:58.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.027+0000 7f640dc5f700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f640806fb20 0x7f6408137560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44424/0 (socket says 172.21.15.26:44424) 2023-10-01T07:58:58.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.027+0000 7f640dc5f700 1 -- 172.21.15.26:0/1842575431 learned_addr learned my addr 172.21.15.26:0/1842575431 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:58.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.027+0000 7f640cc5d700 1 --2- 172.21.15.26:0/1842575431 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6408130e50 0x7f640806f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:58.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.028+0000 7f63fffff700 1 -- 172.21.15.26:0/1842575431 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2353631740 0 0) 0x7f64080716a0 con 0x7f640806fb20 2023-10-01T07:58:58.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.028+0000 7f63fffff700 1 -- 172.21.15.26:0/1842575431 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63f40035b0 con 0x7f640806fb20 2023-10-01T07:58:58.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.028+0000 7f640cc5d700 1 -- 172.21.15.26:0/1842575431 >> v2:172.21.15.26:3300/0 conn(0x7f6408130540 msgr2=0x7f6408130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:58.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.028+0000 7f640cc5d700 1 --2- 172.21.15.26:0/1842575431 >> v2:172.21.15.26:3300/0 conn(0x7f6408130540 0x7f6408130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:58.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.028+0000 7f640cc5d700 1 -- 172.21.15.26:0/1842575431 >> v1:172.21.15.26:6789/0 conn(0x7f640806fb20 legacy=0x7f6408137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:58.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.028+0000 7f640cc5d700 1 -- 172.21.15.26:0/1842575431 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6408130340 con 0x7f6408130e50 2023-10-01T07:58:58.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.028+0000 7f640d45e700 1 --2- 172.21.15.26:0/1842575431 >> v2:172.21.15.26:3300/0 conn(0x7f6408130540 0x7f6408130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:58.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.028+0000 7f640cc5d700 1 --2- 172.21.15.26:0/1842575431 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6408130e50 0x7f640806f5e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f63f8009870 tx=0x7f63f8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3c14802bdbacd62 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:58.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.028+0000 7f63fffff700 1 -- 172.21.15.26:0/1842575431 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f8011830 con 0x7f6408130e50 2023-10-01T07:58:58.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.028+0000 7f63fffff700 1 -- 172.21.15.26:0/1842575431 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f8011990 con 0x7f6408130e50 2023-10-01T07:58:58.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.028+0000 7f63fffff700 1 -- 172.21.15.26:0/1842575431 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f8011d20 con 0x7f6408130e50 2023-10-01T07:58:58.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.029+0000 7f640f6c2700 1 -- 172.21.15.26:0/1842575431 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6408130e50 msgr2=0x7f640806f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:58.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.029+0000 7f640f6c2700 1 --2- 172.21.15.26:0/1842575431 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6408130e50 0x7f640806f5e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f63f8009870 tx=0x7f63f8009b80 comp rx=0 tx=0).stop 2023-10-01T07:58:58.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.029+0000 7f640f6c2700 1 -- 172.21.15.26:0/1842575431 shutdown_connections 2023-10-01T07:58:58.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.029+0000 7f640f6c2700 1 --2- 172.21.15.26:0/1842575431 >> v2:172.21.15.26:3300/0 conn(0x7f6408130540 0x7f6408130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:58.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.029+0000 7f640f6c2700 1 --2- 172.21.15.26:0/1842575431 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6408130e50 0x7f640806f5e0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:58.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.029+0000 7f640f6c2700 1 -- 172.21.15.26:0/1842575431 >> 172.21.15.26:0/1842575431 conn(0x7f64080a2aa0 msgr2=0x7f64080a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:58.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.029+0000 7f640f6c2700 1 -- 172.21.15.26:0/1842575431 shutdown_connections 2023-10-01T07:58:58.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.029+0000 7f640f6c2700 1 -- 172.21.15.26:0/1842575431 wait complete. 2023-10-01T07:58:58.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.031+0000 7f640f6c2700 1 Processor -- start 2023-10-01T07:58:58.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.031+0000 7f640f6c2700 1 -- start start 2023-10-01T07:58:58.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.032+0000 7f640f6c2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f640806fb20 0x7f6408138540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:58.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.032+0000 7f640f6c2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6408130540 0x7f6408138a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:58.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.032+0000 7f640f6c2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6408130e50 0x7f64081c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:58.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.032+0000 7f640f6c2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6408134d00 con 0x7f640806fb20 2023-10-01T07:58:58.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.032+0000 7f640f6c2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6408139840 con 0x7f6408130540 2023-10-01T07:58:58.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.032+0000 7f640f6c2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f64080718e0 con 0x7f6408130e50 2023-10-01T07:58:58.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.032+0000 7f640d45e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f640806fb20 0x7f6408138540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:58.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.032+0000 7f640d45e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f640806fb20 0x7f6408138540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56656/0 (socket says 172.21.15.26:56656) 2023-10-01T07:58:58.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.032+0000 7f640d45e700 1 -- 172.21.15.26:0/3550550673 learned_addr learned my addr 172.21.15.26:0/3550550673 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:58.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.032+0000 7f640cc5d700 1 --2- 172.21.15.26:0/3550550673 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6408130540 0x7f6408138a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:58.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.032+0000 7f640dc5f700 1 --2- 172.21.15.26:0/3550550673 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6408130e50 0x7f64081c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:58.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.032+0000 7f640d45e700 1 -- 172.21.15.26:0/3550550673 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6408130e50 msgr2=0x7f64081c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:58.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.032+0000 7f640d45e700 1 --2- 172.21.15.26:0/3550550673 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6408130e50 0x7f64081c5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:58.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.032+0000 7f640d45e700 1 -- 172.21.15.26:0/3550550673 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6408130540 msgr2=0x7f6408138a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:58.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.032+0000 7f640d45e700 1 --2- 172.21.15.26:0/3550550673 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6408130540 0x7f6408138a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:58.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.032+0000 7f640d45e700 1 -- 172.21.15.26:0/3550550673 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64040094a0 con 0x7f640806fb20 2023-10-01T07:58:58.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.032+0000 7f640cc5d700 1 --2- 172.21.15.26:0/3550550673 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6408130540 0x7f6408138a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:58.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.033+0000 7f640d45e700 1 --2- 172.21.15.26:0/3550550673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f640806fb20 0x7f6408138540 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f6404009ec0 tx=0x7f640400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:58.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.033+0000 7f63fdffb700 1 -- 172.21.15.26:0/3550550673 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6404013860 con 0x7f640806fb20 2023-10-01T07:58:58.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.033+0000 7f63fdffb700 1 -- 172.21.15.26:0/3550550673 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64040139c0 con 0x7f640806fb20 2023-10-01T07:58:58.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.033+0000 7f640f6c2700 1 -- 172.21.15.26:0/3550550673 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63f80094a0 con 0x7f640806fb20 2023-10-01T07:58:58.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.033+0000 7f63fdffb700 1 -- 172.21.15.26:0/3550550673 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6404013d50 con 0x7f640806fb20 2023-10-01T07:58:58.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.033+0000 7f640f6c2700 1 -- 172.21.15.26:0/3550550673 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6408137b40 con 0x7f640806fb20 2023-10-01T07:58:58.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.034+0000 7f640f6c2700 1 -- 172.21.15.26:0/3550550673 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6408074ea0 con 0x7f640806fb20 2023-10-01T07:58:58.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.034+0000 7f63fdffb700 1 -- 172.21.15.26:0/3550550673 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f640400c640 con 0x7f640806fb20 2023-10-01T07:58:58.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.035+0000 7f63fdffb700 1 -- 172.21.15.26:0/3550550673 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6404043610 con 0x7f640806fb20 2023-10-01T07:58:58.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.039+0000 7f63fdffb700 1 -- 172.21.15.26:0/3550550673 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f640401b440 con 0x7f640806fb20 2023-10-01T07:58:58.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.052+0000 7fe964a28700 1 Processor -- start 2023-10-01T07:58:58.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.052+0000 7fe964a28700 1 -- start start 2023-10-01T07:58:58.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.053+0000 7fe964a28700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe96012cf60 0x7fe96006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:58.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.053+0000 7fe964a28700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe96012f8b0 0x7fe96012fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:58.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.053+0000 7fe964a28700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe960130260 0x7fe960136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:58.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.053+0000 7fe964a28700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe96012d330 con 0x7fe96012cf60 2023-10-01T07:58:58.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.053+0000 7fe964a28700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe96012cd90 con 0x7fe96012f8b0 2023-10-01T07:58:58.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.053+0000 7fe964a28700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9601306d0 con 0x7fe960130260 2023-10-01T07:58:58.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.053+0000 7fe95ed9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe960130260 0x7fe960136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:58.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.053+0000 7fe95ed9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe960130260 0x7fe960136c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37436/0 (socket says 172.21.15.26:37436) 2023-10-01T07:58:58.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.053+0000 7fe95ed9d700 1 -- 172.21.15.26:0/342507523 learned_addr learned my addr 172.21.15.26:0/342507523 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:58.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.053+0000 7fe95dd9b700 1 --2- 172.21.15.26:0/342507523 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe96012f8b0 0x7fe96012fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:58.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.053+0000 7fe95e59c700 1 --2- 172.21.15.26:0/342507523 >> v2:172.21.15.26:3300/0 conn(0x7fe96012cf60 0x7fe96006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:58.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.054+0000 7fe95e59c700 1 -- 172.21.15.26:0/342507523 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe960130260 msgr2=0x7fe960136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:58.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.054+0000 7fe95e59c700 1 --2- 172.21.15.26:0/342507523 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe960130260 0x7fe960136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:58.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.054+0000 7fe95e59c700 1 -- 172.21.15.26:0/342507523 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe96012f8b0 msgr2=0x7fe96012fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:58.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.054+0000 7fe95e59c700 1 --2- 172.21.15.26:0/342507523 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe96012f8b0 0x7fe96012fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:58.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.054+0000 7fe95e59c700 1 -- 172.21.15.26:0/342507523 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe960071780 con 0x7fe96012cf60 2023-10-01T07:58:58.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.054+0000 7fe95ed9d700 1 --2- 172.21.15.26:0/342507523 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe960130260 0x7fe960136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:58.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.054+0000 7fe95e59c700 1 --2- 172.21.15.26:0/342507523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe96012cf60 0x7fe96006f5d0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fe95000dc90 tx=0x7fe95000f050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb146c73a769d4af server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:58.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.054+0000 7fe95d59a700 1 -- 172.21.15.26:0/342507523 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe950012070 con 0x7fe96012cf60 2023-10-01T07:58:58.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.054+0000 7fe95d59a700 1 -- 172.21.15.26:0/342507523 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95000d2e0 con 0x7fe96012cf60 2023-10-01T07:58:58.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.054+0000 7fe95d59a700 1 -- 172.21.15.26:0/342507523 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95000f8b0 con 0x7fe96012cf60 2023-10-01T07:58:58.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.055+0000 7fe964a28700 1 -- 172.21.15.26:0/342507523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe96012cf60 msgr2=0x7fe96006f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:58.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.055+0000 7fe964a28700 1 --2- 172.21.15.26:0/342507523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe96012cf60 0x7fe96006f5d0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fe95000dc90 tx=0x7fe95000f050 comp rx=0 tx=0).stop 2023-10-01T07:58:58.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.055+0000 7fe964a28700 1 -- 172.21.15.26:0/342507523 shutdown_connections 2023-10-01T07:58:58.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.055+0000 7fe964a28700 1 --2- 172.21.15.26:0/342507523 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe960130260 0x7fe960136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:58.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.055+0000 7fe964a28700 1 --2- 172.21.15.26:0/342507523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe96012cf60 0x7fe96006f5d0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:58.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.055+0000 7fe964a28700 1 --2- 172.21.15.26:0/342507523 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe96012f8b0 0x7fe96012fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:58.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.055+0000 7fe964a28700 1 -- 172.21.15.26:0/342507523 >> 172.21.15.26:0/342507523 conn(0x7fe9600a2aa0 msgr2=0x7fe9600a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:58.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.055+0000 7fe964a28700 1 -- 172.21.15.26:0/342507523 shutdown_connections 2023-10-01T07:58:58.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.055+0000 7fe964a28700 1 -- 172.21.15.26:0/342507523 wait complete. 2023-10-01T07:58:58.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.057+0000 7fe964a28700 1 Processor -- start 2023-10-01T07:58:58.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.057+0000 7fe964a28700 1 -- start start 2023-10-01T07:58:58.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.058+0000 7fe964a28700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe96012cf60 0x7fe9601c40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:58.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.058+0000 7fe964a28700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe96012f8b0 0x7fe9601c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:58.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.058+0000 7fe964a28700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe960130260 0x7fe9601c4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:58.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.058+0000 7fe964a28700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96009b7b0 con 0x7fe96012f8b0 2023-10-01T07:58:58.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.058+0000 7fe964a28700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe96009cec0 con 0x7fe96012cf60 2023-10-01T07:58:58.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.058+0000 7fe964a28700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe96009eaf0 con 0x7fe960130260 2023-10-01T07:58:58.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.058+0000 7fe95dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe96012f8b0 0x7fe9601c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:58.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.058+0000 7fe95dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe96012f8b0 0x7fe9601c45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56680/0 (socket says 172.21.15.26:56680) 2023-10-01T07:58:58.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.058+0000 7fe95dd9b700 1 -- 172.21.15.26:0/3253507383 learned_addr learned my addr 172.21.15.26:0/3253507383 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:58.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.058+0000 7fe95e59c700 1 --2- 172.21.15.26:0/3253507383 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe96012cf60 0x7fe9601c40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:58.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.058+0000 7fe95ed9d700 1 --2- 172.21.15.26:0/3253507383 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe960130260 0x7fe9601c4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:58.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.058+0000 7fe95dd9b700 1 -- 172.21.15.26:0/3253507383 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe960130260 msgr2=0x7fe9601c4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:58.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.058+0000 7fe95dd9b700 1 --2- 172.21.15.26:0/3253507383 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe960130260 0x7fe9601c4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:58.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.058+0000 7fe95dd9b700 1 -- 172.21.15.26:0/3253507383 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe96012cf60 msgr2=0x7fe9601c40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:58.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.058+0000 7fe95dd9b700 1 --2- 172.21.15.26:0/3253507383 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe96012cf60 0x7fe9601c40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:58.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.058+0000 7fe95dd9b700 1 -- 172.21.15.26:0/3253507383 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95800bb50 con 0x7fe96012f8b0 2023-10-01T07:58:58.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.059+0000 7fe95dd9b700 1 --2- 172.21.15.26:0/3253507383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe96012f8b0 0x7fe9601c45e0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fe95400e9b0 tx=0x7fe95400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:58.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.059+0000 7fe94effd700 1 -- 172.21.15.26:0/3253507383 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe954009710 con 0x7fe96012f8b0 2023-10-01T07:58:58.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.059+0000 7fe94effd700 1 -- 172.21.15.26:0/3253507383 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95400c850 con 0x7fe96012f8b0 2023-10-01T07:58:58.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.059+0000 7fe964a28700 1 -- 172.21.15.26:0/3253507383 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe95000d940 con 0x7fe96012f8b0 2023-10-01T07:58:58.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.059+0000 7fe94effd700 1 -- 172.21.15.26:0/3253507383 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95400cbc0 con 0x7fe96012f8b0 2023-10-01T07:58:58.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.059+0000 7fe964a28700 1 -- 172.21.15.26:0/3253507383 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe96009e830 con 0x7fe96012f8b0 2023-10-01T07:58:58.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.060+0000 7fe94effd700 1 -- 172.21.15.26:0/3253507383 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe95400cd20 con 0x7fe96012f8b0 2023-10-01T07:58:58.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.060+0000 7fe94effd700 1 -- 172.21.15.26:0/3253507383 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe95403f890 con 0x7fe96012f8b0 2023-10-01T07:58:58.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.060+0000 7fe964a28700 1 -- 172.21.15.26:0/3253507383 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9601309e0 con 0x7fe96012f8b0 2023-10-01T07:58:58.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.066+0000 7fe94effd700 1 -- 172.21.15.26:0/3253507383 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe954021080 con 0x7fe96012f8b0 2023-10-01T07:58:58.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.174+0000 7f400a9c3700 1 -- 172.21.15.26:0/1394156707 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4004074ea0 con 0x7f400409e410 2023-10-01T07:58:58.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.174+0000 7f4000ff9700 1 -- 172.21.15.26:0/1394156707 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3ffc02c030 con 0x7f400409e410 2023-10-01T07:58:58.175 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:58.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.176+0000 7f400a9c3700 1 -- 172.21.15.26:0/1394156707 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f400409e410 msgr2=0x7f400411e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:58.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.176+0000 7f400a9c3700 1 --2- 172.21.15.26:0/1394156707 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f400409e410 0x7f400411e820 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc0042a0 tx=0x7f3ffc004ad0 comp rx=0 tx=0).stop 2023-10-01T07:58:58.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.176+0000 7f400a9c3700 1 -- 172.21.15.26:0/1394156707 shutdown_connections 2023-10-01T07:58:58.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.176+0000 7f400a9c3700 1 --2- 172.21.15.26:0/1394156707 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f400409e410 0x7f400411e820 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:58.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.176+0000 7f400a9c3700 1 --2- 172.21.15.26:0/1394156707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f400409d6f0 0x7f400411dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:58.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.176+0000 7f400a9c3700 1 --2- 172.21.15.26:0/1394156707 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f400409e000 0x7f400411e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:58.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.176+0000 7f400a9c3700 1 -- 172.21.15.26:0/1394156707 >> 172.21.15.26:0/1394156707 conn(0x7f4004066f50 msgr2=0x7f400406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:58.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.176+0000 7f400a9c3700 1 -- 172.21.15.26:0/1394156707 shutdown_connections 2023-10-01T07:58:58.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.177+0000 7f400a9c3700 1 -- 172.21.15.26:0/1394156707 wait complete. 2023-10-01T07:58:58.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.185+0000 7f633e254700 1 -- 172.21.15.26:0/1767720998 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f63380986e0 con 0x7f633809d6f0 2023-10-01T07:58:58.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.186+0000 7f631ffff700 1 -- 172.21.15.26:0/1767720998 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f63380986e0 con 0x7f633809d6f0 2023-10-01T07:58:58.186 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:58.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.188+0000 7f633e254700 1 -- 172.21.15.26:0/1767720998 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f633809d6f0 msgr2=0x7f63380917f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:58.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.188+0000 7f633e254700 1 --2- 172.21.15.26:0/1767720998 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f633809d6f0 0x7f63380917f0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f632800e9b0 tx=0x7f632800ecc0 comp rx=0 tx=0).stop 2023-10-01T07:58:58.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.188+0000 7f633e254700 1 -- 172.21.15.26:0/1767720998 shutdown_connections 2023-10-01T07:58:58.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.188+0000 7f633e254700 1 --2- 172.21.15.26:0/1767720998 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6338130750 0x7f6338096e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:58.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.188+0000 7f633e254700 1 --2- 172.21.15.26:0/1767720998 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f633809d6f0 0x7f63380917f0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:58.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.188+0000 7f633e254700 1 --2- 172.21.15.26:0/1767720998 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f633809e080 0x7f6338096900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:58.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.188+0000 7f633e254700 1 -- 172.21.15.26:0/1767720998 >> 172.21.15.26:0/1767720998 conn(0x7f633809f470 msgr2=0x7f63380920b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:58.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.189+0000 7f633e254700 1 -- 172.21.15.26:0/1767720998 shutdown_connections 2023-10-01T07:58:58.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.189+0000 7f633e254700 1 -- 172.21.15.26:0/1767720998 wait complete. 2023-10-01T07:58:58.191 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:58.203 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:58.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.255+0000 7f640f6c2700 1 -- 172.21.15.26:0/3550550673 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f640806b9e0 con 0x7f640806fb20 2023-10-01T07:58:58.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.256+0000 7f63fdffb700 1 -- 172.21.15.26:0/3550550673 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6404020030 con 0x7f640806fb20 2023-10-01T07:58:58.256 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:58.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.258+0000 7f640f6c2700 1 -- 172.21.15.26:0/3550550673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f640806fb20 msgr2=0x7f6408138540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:58.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.258+0000 7f640f6c2700 1 --2- 172.21.15.26:0/3550550673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f640806fb20 0x7f6408138540 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f6404009ec0 tx=0x7f640400eec0 comp rx=0 tx=0).stop 2023-10-01T07:58:58.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.258+0000 7f640f6c2700 1 -- 172.21.15.26:0/3550550673 shutdown_connections 2023-10-01T07:58:58.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.258+0000 7f640f6c2700 1 --2- 172.21.15.26:0/3550550673 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6408130e50 0x7f64081c5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:58.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.258+0000 7f640f6c2700 1 --2- 172.21.15.26:0/3550550673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f640806fb20 0x7f6408138540 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:58.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.258+0000 7f640f6c2700 1 --2- 172.21.15.26:0/3550550673 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6408130540 0x7f6408138a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:58.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.258+0000 7f640f6c2700 1 -- 172.21.15.26:0/3550550673 >> 172.21.15.26:0/3550550673 conn(0x7f64080a2aa0 msgr2=0x7f640806e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:58.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.258+0000 7f640f6c2700 1 -- 172.21.15.26:0/3550550673 shutdown_connections 2023-10-01T07:58:58.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.258+0000 7f640f6c2700 1 -- 172.21.15.26:0/3550550673 wait complete. 2023-10-01T07:58:58.272 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:58.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.275+0000 7fe964a28700 1 -- 172.21.15.26:0/3253507383 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe960074ea0 con 0x7fe96012f8b0 2023-10-01T07:58:58.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.275+0000 7fe94effd700 1 -- 172.21.15.26:0/3253507383 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe954017020 con 0x7fe96012f8b0 2023-10-01T07:58:58.275 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:58.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.277+0000 7fe964a28700 1 -- 172.21.15.26:0/3253507383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe96012f8b0 msgr2=0x7fe9601c45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:58.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.277+0000 7fe964a28700 1 --2- 172.21.15.26:0/3253507383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe96012f8b0 0x7fe9601c45e0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fe95400e9b0 tx=0x7fe95400ecc0 comp rx=0 tx=0).stop 2023-10-01T07:58:58.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.277+0000 7fe964a28700 1 -- 172.21.15.26:0/3253507383 shutdown_connections 2023-10-01T07:58:58.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.277+0000 7fe964a28700 1 --2- 172.21.15.26:0/3253507383 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe960130260 0x7fe9601c4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:58.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.277+0000 7fe964a28700 1 --2- 172.21.15.26:0/3253507383 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe96012cf60 0x7fe9601c40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:58.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.277+0000 7fe964a28700 1 --2- 172.21.15.26:0/3253507383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe96012f8b0 0x7fe9601c45e0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:58.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.277+0000 7fe964a28700 1 -- 172.21.15.26:0/3253507383 >> 172.21.15.26:0/3253507383 conn(0x7fe9600a2aa0 msgr2=0x7fe9601b7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:58.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.277+0000 7fe964a28700 1 -- 172.21.15.26:0/3253507383 shutdown_connections 2023-10-01T07:58:58.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:58.277+0000 7fe964a28700 1 -- 172.21.15.26:0/3253507383 wait complete. 2023-10-01T07:58:58.291 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:58:59.192 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:58:59.204 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:58:59.273 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:58:59.292 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:58:59.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.342+0000 7fa3c0022700 1 Processor -- start 2023-10-01T07:58:59.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.342+0000 7fa3c0022700 1 -- start start 2023-10-01T07:58:59.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.343+0000 7fa3c0022700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3b8130540 0x7fa3b8130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:59.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.343+0000 7fa3c0022700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa3b8130e50 0x7fa3b806f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:59.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.343+0000 7fa3c0022700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa3b806fb20 0x7fa3b806ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:59.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.343+0000 7fa3c0022700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b80704b0 con 0x7fa3b8130e50 2023-10-01T07:58:59.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.343+0000 7fa3c0022700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b809a390 con 0x7fa3b8130540 2023-10-01T07:58:59.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.343+0000 7fa3c0022700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b80716a0 con 0x7fa3b806fb20 2023-10-01T07:58:59.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.343+0000 7fa3bd5bd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa3b8130e50 0x7fa3b806f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:59.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.343+0000 7fa3bddbe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3b8130540 0x7fa3b8130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:59.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.343+0000 7fa3bddbe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3b8130540 0x7fa3b8130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46858/0 (socket says 172.21.15.26:46858) 2023-10-01T07:58:59.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.343+0000 7fa3bd5bd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa3b8130e50 0x7fa3b806f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56688/0 (socket says 172.21.15.26:56688) 2023-10-01T07:58:59.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.343+0000 7fa3bddbe700 1 -- 172.21.15.26:0/1008324965 learned_addr learned my addr 172.21.15.26:0/1008324965 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:59.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.343+0000 7fa3be5bf700 1 --2- 172.21.15.26:0/1008324965 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa3b806fb20 0x7fa3b806ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:59.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.343+0000 7fa3bd5bd700 1 -- 172.21.15.26:0/1008324965 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa3b806fb20 msgr2=0x7fa3b806ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:59.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.343+0000 7fa3bd5bd700 1 --2- 172.21.15.26:0/1008324965 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa3b806fb20 0x7fa3b806ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:59.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.343+0000 7fa3bd5bd700 1 -- 172.21.15.26:0/1008324965 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3b8130540 msgr2=0x7fa3b8130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:59.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.344+0000 7fa3bd5bd700 1 --2- 172.21.15.26:0/1008324965 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3b8130540 0x7fa3b8130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:59.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.344+0000 7fa3bd5bd700 1 -- 172.21.15.26:0/1008324965 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b8071290 con 0x7fa3b8130e50 2023-10-01T07:58:59.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.344+0000 7fa3bddbe700 1 --2- 172.21.15.26:0/1008324965 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3b8130540 0x7fa3b8130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:59.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.344+0000 7fa3bd5bd700 1 --2- 172.21.15.26:0/1008324965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3b8130e50 0x7fa3b806f5e0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8009870 tx=0x7fa3a8009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e5196f4640d399 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:59.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.344+0000 7fa3bcdbc700 1 -- 172.21.15.26:0/1008324965 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8011830 con 0x7fa3b8130e50 2023-10-01T07:58:59.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.344+0000 7fa3bcdbc700 1 -- 172.21.15.26:0/1008324965 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a8011990 con 0x7fa3b8130e50 2023-10-01T07:58:59.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.344+0000 7fa3bcdbc700 1 -- 172.21.15.26:0/1008324965 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8011d20 con 0x7fa3b8130e50 2023-10-01T07:58:59.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.345+0000 7fa3c0022700 1 -- 172.21.15.26:0/1008324965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3b8130e50 msgr2=0x7fa3b806f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:59.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.345+0000 7fa3c0022700 1 --2- 172.21.15.26:0/1008324965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3b8130e50 0x7fa3b806f5e0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8009870 tx=0x7fa3a8009b80 comp rx=0 tx=0).stop 2023-10-01T07:58:59.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.345+0000 7fa3c0022700 1 -- 172.21.15.26:0/1008324965 shutdown_connections 2023-10-01T07:58:59.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.345+0000 7fa3c0022700 1 --2- 172.21.15.26:0/1008324965 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa3b806fb20 0x7fa3b806ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:59.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.345+0000 7fa3c0022700 1 --2- 172.21.15.26:0/1008324965 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3b8130540 0x7fa3b8130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:59.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.345+0000 7fa3c0022700 1 --2- 172.21.15.26:0/1008324965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3b8130e50 0x7fa3b806f5e0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:59.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.345+0000 7fa3c0022700 1 -- 172.21.15.26:0/1008324965 >> 172.21.15.26:0/1008324965 conn(0x7fa3b80a2aa0 msgr2=0x7fa3b80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:59.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.345+0000 7fa3c0022700 1 -- 172.21.15.26:0/1008324965 shutdown_connections 2023-10-01T07:58:59.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.345+0000 7fa3c0022700 1 -- 172.21.15.26:0/1008324965 wait complete. 2023-10-01T07:58:59.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.346+0000 7fa3c0022700 1 Processor -- start 2023-10-01T07:58:59.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.346+0000 7fa3c0022700 1 -- start start 2023-10-01T07:58:59.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.347+0000 7fa3c0022700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3b806fb20 0x7fa3b811eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:59.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.347+0000 7fa3c0022700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3b8130540 0x7fa3b811f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:59.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.347+0000 7fa3c0022700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa3b8130e50 0x7fa3b811fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:59.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.347+0000 7fa3c0022700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b81224e0 con 0x7fa3b8130540 2023-10-01T07:58:59.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.347+0000 7fa3c0022700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b812cef0 con 0x7fa3b806fb20 2023-10-01T07:58:59.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.347+0000 7fa3c0022700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b8122b80 con 0x7fa3b8130e50 2023-10-01T07:58:59.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.347+0000 7fa3bd5bd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3b8130540 0x7fa3b811f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:59.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.347+0000 7fa3bd5bd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3b8130540 0x7fa3b811f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56698/0 (socket says 172.21.15.26:56698) 2023-10-01T07:58:59.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.347+0000 7fa3bd5bd700 1 -- 172.21.15.26:0/1198362237 learned_addr learned my addr 172.21.15.26:0/1198362237 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:59.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.347+0000 7fa3be5bf700 1 --2- 172.21.15.26:0/1198362237 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa3b8130e50 0x7fa3b811fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:59.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.347+0000 7fa3bddbe700 1 --2- 172.21.15.26:0/1198362237 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3b806fb20 0x7fa3b811eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:59.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.347+0000 7fa3bd5bd700 1 -- 172.21.15.26:0/1198362237 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa3b8130e50 msgr2=0x7fa3b811fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:59.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.348+0000 7fa3bd5bd700 1 --2- 172.21.15.26:0/1198362237 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa3b8130e50 0x7fa3b811fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:59.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.348+0000 7fa3bd5bd700 1 -- 172.21.15.26:0/1198362237 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3b806fb20 msgr2=0x7fa3b811eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:59.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.348+0000 7fa3bd5bd700 1 --2- 172.21.15.26:0/1198362237 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3b806fb20 0x7fa3b811eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:59.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.348+0000 7fa3bd5bd700 1 -- 172.21.15.26:0/1198362237 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b4009550 con 0x7fa3b8130540 2023-10-01T07:58:59.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.348+0000 7fa3be5bf700 1 --2- 172.21.15.26:0/1198362237 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa3b8130e50 0x7fa3b811fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:59.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.348+0000 7fa3bd5bd700 1 --2- 172.21.15.26:0/1198362237 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3b8130540 0x7fa3b811f530 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8009840 tx=0x7fa3a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:59.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.348+0000 7fa3ae7fc700 1 -- 172.21.15.26:0/1198362237 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8004510 con 0x7fa3b8130540 2023-10-01T07:58:59.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.348+0000 7fa3ae7fc700 1 -- 172.21.15.26:0/1198362237 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a80036a0 con 0x7fa3b8130540 2023-10-01T07:58:59.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.348+0000 7fa3ae7fc700 1 -- 172.21.15.26:0/1198362237 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8003a10 con 0x7fa3b8130540 2023-10-01T07:58:59.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.348+0000 7fa3c0022700 1 -- 172.21.15.26:0/1198362237 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a80094a0 con 0x7fa3b8130540 2023-10-01T07:58:59.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.348+0000 7fa3c0022700 1 -- 172.21.15.26:0/1198362237 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b80718e0 con 0x7fa3b8130540 2023-10-01T07:58:59.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.350+0000 7fa3c0022700 1 -- 172.21.15.26:0/1198362237 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b8120c70 con 0x7fa3b8130540 2023-10-01T07:58:59.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.350+0000 7fa3ae7fc700 1 -- 172.21.15.26:0/1198362237 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa3a8003b70 con 0x7fa3b8130540 2023-10-01T07:58:59.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.351+0000 7fa3ae7fc700 1 -- 172.21.15.26:0/1198362237 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa3a8040540 con 0x7fa3b8130540 2023-10-01T07:58:59.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.356+0000 7fa3ae7fc700 1 -- 172.21.15.26:0/1198362237 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa3a801a420 con 0x7fa3b8130540 2023-10-01T07:58:59.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.395+0000 7fcf5b182700 1 Processor -- start 2023-10-01T07:58:59.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.395+0000 7fcf5b182700 1 -- start start 2023-10-01T07:58:59.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.396+0000 7fcf5b182700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf5409d6f0 0x7fcf5409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:59.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.396+0000 7fcf5b182700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf5409ace0 0x7fcf5409e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:59.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.396+0000 7fcf5b182700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5409b150 con 0x7fcf541339f0 2023-10-01T07:58:59.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.396+0000 7fcf5b182700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5409a500 con 0x7fcf5409ace0 2023-10-01T07:58:59.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.396+0000 7fcf5b182700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5409e540 con 0x7fcf5409d6f0 2023-10-01T07:58:59.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.396+0000 7fcf53fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf5409ace0 0x7fcf5409e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:59.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.396+0000 7fcf53fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf5409ace0 0x7fcf5409e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46880/0 (socket says 172.21.15.26:46880) 2023-10-01T07:58:59.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.396+0000 7fcf53fff700 1 -- 172.21.15.26:0/1960845834 learned_addr learned my addr 172.21.15.26:0/1960845834 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:59.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.396+0000 7fcf58f1e700 1 --2- 172.21.15.26:0/1960845834 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf5409d6f0 0x7fcf5409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:59.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.397+0000 7fcf58f1e700 1 -- 172.21.15.26:0/1960845834 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf5409ace0 msgr2=0x7fcf5409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:59.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.397+0000 7fcf58f1e700 1 --2- 172.21.15.26:0/1960845834 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf5409ace0 0x7fcf5409e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:59.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.397+0000 7fcf58f1e700 1 -- 172.21.15.26:0/1960845834 >> v1:172.21.15.26:6789/0 conn(0x7fcf541339f0 legacy=0x7fcf54133e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:59.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.397+0000 7fcf537fe700 1 -- 172.21.15.26:0/1960845834 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2989458062 0 0) 0x7fcf5409b150 con 0x7fcf541339f0 2023-10-01T07:58:59.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.397+0000 7fcf58f1e700 1 -- 172.21.15.26:0/1960845834 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5409f720 con 0x7fcf5409d6f0 2023-10-01T07:58:59.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.397+0000 7fcf58f1e700 1 --2- 172.21.15.26:0/1960845834 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf5409d6f0 0x7fcf5409dac0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fcf48009870 tx=0x7fcf48009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f649ebf705339e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:59.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.397+0000 7fcf537fe700 1 -- 172.21.15.26:0/1960845834 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf48011830 con 0x7fcf5409d6f0 2023-10-01T07:58:59.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.397+0000 7fcf537fe700 1 -- 172.21.15.26:0/1960845834 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf48011990 con 0x7fcf5409d6f0 2023-10-01T07:58:59.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.397+0000 7fcf537fe700 1 -- 172.21.15.26:0/1960845834 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf48011d20 con 0x7fcf5409d6f0 2023-10-01T07:58:59.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.398+0000 7fcf5b182700 1 -- 172.21.15.26:0/1960845834 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf5409d6f0 msgr2=0x7fcf5409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:59.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.398+0000 7fcf5b182700 1 --2- 172.21.15.26:0/1960845834 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf5409d6f0 0x7fcf5409dac0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fcf48009870 tx=0x7fcf48009b80 comp rx=0 tx=0).stop 2023-10-01T07:58:59.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.398+0000 7fcf5b182700 1 -- 172.21.15.26:0/1960845834 shutdown_connections 2023-10-01T07:58:59.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.398+0000 7fcf5b182700 1 --2- 172.21.15.26:0/1960845834 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf5409d6f0 0x7fcf5409dac0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:59.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.398+0000 7fcf5b182700 1 --2- 172.21.15.26:0/1960845834 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf5409ace0 0x7fcf5409e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:59.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.398+0000 7fcf5b182700 1 -- 172.21.15.26:0/1960845834 >> 172.21.15.26:0/1960845834 conn(0x7fcf54066f50 msgr2=0x7fcf5409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:59.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.399+0000 7fcf5b182700 1 -- 172.21.15.26:0/1960845834 shutdown_connections 2023-10-01T07:58:59.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.399+0000 7fcf5b182700 1 -- 172.21.15.26:0/1960845834 wait complete. 2023-10-01T07:58:59.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.400+0000 7fcf5b182700 1 Processor -- start 2023-10-01T07:58:59.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.400+0000 7fcf5b182700 1 -- start start 2023-10-01T07:58:59.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.401+0000 7fcf5b182700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf5409ace0 0x7fcf5411f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:59.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.401+0000 7fcf5b182700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf5409d6f0 0x7fcf5411fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:59.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.401+0000 7fcf5b182700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf541339f0 0x7fcf541c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:59.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.401+0000 7fcf5b182700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf541224e0 con 0x7fcf541339f0 2023-10-01T07:58:59.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.401+0000 7fcf5b182700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf54133550 con 0x7fcf5409ace0 2023-10-01T07:58:59.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.401+0000 7fcf5b182700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5411f220 con 0x7fcf5409d6f0 2023-10-01T07:58:59.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.401+0000 7fcf58f1e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf5409ace0 0x7fcf5411f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:59.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.401+0000 7fcf58f1e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf5409ace0 0x7fcf5411f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46892/0 (socket says 172.21.15.26:46892) 2023-10-01T07:58:59.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.401+0000 7fcf53fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf5409d6f0 0x7fcf5411fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:59.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.401+0000 7fcf58f1e700 1 -- 172.21.15.26:0/1279651423 learned_addr learned my addr 172.21.15.26:0/1279651423 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:59.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.401+0000 7fcf5971f700 1 --2- 172.21.15.26:0/1279651423 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf541339f0 0x7fcf541c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:59.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.402+0000 7fcf53fff700 1 -- 172.21.15.26:0/1279651423 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf5409ace0 msgr2=0x7fcf5411f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:59.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.402+0000 7fcf53fff700 1 --2- 172.21.15.26:0/1279651423 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf5409ace0 0x7fcf5411f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:59.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.402+0000 7fcf53fff700 1 -- 172.21.15.26:0/1279651423 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf541339f0 msgr2=0x7fcf541c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:59.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.402+0000 7fcf53fff700 1 --2- 172.21.15.26:0/1279651423 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf541339f0 0x7fcf541c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:59.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.402+0000 7fcf53fff700 1 -- 172.21.15.26:0/1279651423 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf480094a0 con 0x7fcf5409d6f0 2023-10-01T07:58:59.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.402+0000 7fcf5971f700 1 --2- 172.21.15.26:0/1279651423 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf541339f0 0x7fcf541c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:58:59.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.402+0000 7fcf53fff700 1 --2- 172.21.15.26:0/1279651423 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf5409d6f0 0x7fcf5411fc00 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fcf540673f0 tx=0x7fcf4000eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:59.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.402+0000 7fcf517fa700 1 -- 172.21.15.26:0/1279651423 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf40013680 con 0x7fcf5409d6f0 2023-10-01T07:58:59.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.402+0000 7fcf517fa700 1 -- 172.21.15.26:0/1279651423 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf400137e0 con 0x7fcf5409d6f0 2023-10-01T07:58:59.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.402+0000 7fcf517fa700 1 -- 172.21.15.26:0/1279651423 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf40013b70 con 0x7fcf5409d6f0 2023-10-01T07:58:59.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.402+0000 7fcf5b182700 1 -- 172.21.15.26:0/1279651423 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf54122740 con 0x7fcf5409d6f0 2023-10-01T07:58:59.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.402+0000 7fcf5b182700 1 -- 172.21.15.26:0/1279651423 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf540a27e0 con 0x7fcf5409d6f0 2023-10-01T07:58:59.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.403+0000 7fcf517fa700 1 -- 172.21.15.26:0/1279651423 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcf40013cd0 con 0x7fcf5409d6f0 2023-10-01T07:58:59.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.404+0000 7fcf5b182700 1 -- 172.21.15.26:0/1279651423 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf540747f0 con 0x7fcf5409d6f0 2023-10-01T07:58:59.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.404+0000 7fcf517fa700 1 -- 172.21.15.26:0/1279651423 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcf4003f580 con 0x7fcf5409d6f0 2023-10-01T07:58:59.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.413+0000 7fcf517fa700 1 -- 172.21.15.26:0/1279651423 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcf40021080 con 0x7fcf5409d6f0 2023-10-01T07:58:59.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.427+0000 7fef9c55e700 1 Processor -- start 2023-10-01T07:58:59.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.427+0000 7fef9c55e700 1 -- start start 2023-10-01T07:58:59.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.428+0000 7fef9c55e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fef9409e850 0x7fef9409ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:59.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.428+0000 7fef9c55e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fef9409f160 0x7fef94133b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:59.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.428+0000 7fef9c55e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9406bc50 con 0x7fef941340c0 2023-10-01T07:58:59.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.428+0000 7fef9c55e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9409ae60 con 0x7fef9409e850 2023-10-01T07:58:59.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.428+0000 7fef9c55e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9406b990 con 0x7fef9409f160 2023-10-01T07:58:59.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.428+0000 7fef9aafb700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fef941340c0 0x7fef9413ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44446/0 (socket says 172.21.15.26:44446) 2023-10-01T07:58:59.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.428+0000 7fef99af9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fef9409f160 0x7fef94133b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:59.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.428+0000 7fef9aafb700 1 -- 172.21.15.26:0/353387594 learned_addr learned my addr 172.21.15.26:0/353387594 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:58:59.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.428+0000 7fef9a2fa700 1 --2- 172.21.15.26:0/353387594 >> v2:172.21.15.26:3300/0 conn(0x7fef9409e850 0x7fef9409ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:59.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.428+0000 7fef992f8700 1 -- 172.21.15.26:0/353387594 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2794092323 0 0) 0x7fef9406bc50 con 0x7fef941340c0 2023-10-01T07:58:59.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.428+0000 7fef992f8700 1 -- 172.21.15.26:0/353387594 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef800035b0 con 0x7fef941340c0 2023-10-01T07:58:59.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.429+0000 7fef9a2fa700 1 -- 172.21.15.26:0/353387594 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fef9409f160 msgr2=0x7fef94133b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:59.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.429+0000 7fef9a2fa700 1 --2- 172.21.15.26:0/353387594 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fef9409f160 0x7fef94133b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:59.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.429+0000 7fef9a2fa700 1 -- 172.21.15.26:0/353387594 >> v1:172.21.15.26:6789/0 conn(0x7fef941340c0 legacy=0x7fef9413ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:59.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.429+0000 7fef9a2fa700 1 -- 172.21.15.26:0/353387594 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9406cb10 con 0x7fef9409e850 2023-10-01T07:58:59.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.429+0000 7fef9a2fa700 1 --2- 172.21.15.26:0/353387594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef9409e850 0x7fef9409ec20 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fef90009840 tx=0x7fef90009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e13d2f236af2d3b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:59.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.429+0000 7fef992f8700 1 -- 172.21.15.26:0/353387594 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef90011830 con 0x7fef9409e850 2023-10-01T07:58:59.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.429+0000 7fef992f8700 1 -- 172.21.15.26:0/353387594 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef90011990 con 0x7fef9409e850 2023-10-01T07:58:59.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.429+0000 7fef992f8700 1 -- 172.21.15.26:0/353387594 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef90011d20 con 0x7fef9409e850 2023-10-01T07:58:59.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.430+0000 7fef9c55e700 1 -- 172.21.15.26:0/353387594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef9409e850 msgr2=0x7fef9409ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:59.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.430+0000 7fef9c55e700 1 --2- 172.21.15.26:0/353387594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef9409e850 0x7fef9409ec20 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fef90009840 tx=0x7fef90009b50 comp rx=0 tx=0).stop 2023-10-01T07:58:59.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.430+0000 7fef9c55e700 1 -- 172.21.15.26:0/353387594 shutdown_connections 2023-10-01T07:58:59.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.430+0000 7fef9c55e700 1 --2- 172.21.15.26:0/353387594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef9409e850 0x7fef9409ec20 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:59.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.430+0000 7fef9c55e700 1 --2- 172.21.15.26:0/353387594 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fef9409f160 0x7fef94133b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:59.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.430+0000 7fef9c55e700 1 -- 172.21.15.26:0/353387594 >> 172.21.15.26:0/353387594 conn(0x7fef940a3f70 msgr2=0x7fef940a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:59.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.430+0000 7fef9c55e700 1 -- 172.21.15.26:0/353387594 shutdown_connections 2023-10-01T07:58:59.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.430+0000 7fef9c55e700 1 -- 172.21.15.26:0/353387594 wait complete. 2023-10-01T07:58:59.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.432+0000 7fef9c55e700 1 Processor -- start 2023-10-01T07:58:59.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.432+0000 7fef9c55e700 1 -- start start 2023-10-01T07:58:59.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.433+0000 7fef9c55e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fef9409e850 0x7fef941235b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:59.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.433+0000 7fef9c55e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fef9409f160 0x7fef94123af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:59.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.433+0000 7fef9c55e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef941340c0 0x7fef941c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:59.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.433+0000 7fef9c55e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9406cd30 con 0x7fef941340c0 2023-10-01T07:58:59.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.433+0000 7fef9c55e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9406fa10 con 0x7fef9409e850 2023-10-01T07:58:59.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.433+0000 7fef9c55e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef941250a0 con 0x7fef9409f160 2023-10-01T07:58:59.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.433+0000 7fef9a2fa700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fef9409e850 0x7fef941235b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:59.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.433+0000 7fef9a2fa700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fef9409e850 0x7fef941235b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46902/0 (socket says 172.21.15.26:46902) 2023-10-01T07:58:59.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.433+0000 7fef9a2fa700 1 -- 172.21.15.26:0/98936681 learned_addr learned my addr 172.21.15.26:0/98936681 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:59.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.433+0000 7fef9aafb700 1 --2- 172.21.15.26:0/98936681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef941340c0 0x7fef941c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:59.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.433+0000 7fef99af9700 1 --2- 172.21.15.26:0/98936681 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fef9409f160 0x7fef94123af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:59.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.433+0000 7fef9a2fa700 1 -- 172.21.15.26:0/98936681 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fef9409f160 msgr2=0x7fef94123af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:59.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.433+0000 7fef9a2fa700 1 --2- 172.21.15.26:0/98936681 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fef9409f160 0x7fef94123af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:59.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.433+0000 7fef9a2fa700 1 -- 172.21.15.26:0/98936681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef941340c0 msgr2=0x7fef941c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:59.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.433+0000 7fef9a2fa700 1 --2- 172.21.15.26:0/98936681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef941340c0 0x7fef941c84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:59.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.433+0000 7fef9a2fa700 1 -- 172.21.15.26:0/98936681 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef900094a0 con 0x7fef9409e850 2023-10-01T07:58:59.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.433+0000 7fef99af9700 1 --2- 172.21.15.26:0/98936681 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fef9409f160 0x7fef94123af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:58:59.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.433+0000 7fef9a2fa700 1 --2- 172.21.15.26:0/98936681 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fef9409e850 0x7fef941235b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fef900090b0 tx=0x7fef90004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:59.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.434+0000 7fef8affd700 1 -- 172.21.15.26:0/98936681 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef900036a0 con 0x7fef9409e850 2023-10-01T07:58:59.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.434+0000 7fef8affd700 1 -- 172.21.15.26:0/98936681 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9001f070 con 0x7fef9409e850 2023-10-01T07:58:59.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.434+0000 7fef9c55e700 1 -- 172.21.15.26:0/98936681 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef941248b0 con 0x7fef9409e850 2023-10-01T07:58:59.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.434+0000 7fef8affd700 1 -- 172.21.15.26:0/98936681 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef90003a60 con 0x7fef9409e850 2023-10-01T07:58:59.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.434+0000 7fef9c55e700 1 -- 172.21.15.26:0/98936681 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef941337a0 con 0x7fef9409e850 2023-10-01T07:58:59.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.435+0000 7fef9c55e700 1 -- 172.21.15.26:0/98936681 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef94126420 con 0x7fef9409e850 2023-10-01T07:58:59.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.436+0000 7fef8affd700 1 -- 172.21.15.26:0/98936681 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fef90003bc0 con 0x7fef9409e850 2023-10-01T07:58:59.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.436+0000 7fef8affd700 1 -- 172.21.15.26:0/98936681 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fef90021070 con 0x7fef9409e850 2023-10-01T07:58:59.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.445+0000 7fef8affd700 1 -- 172.21.15.26:0/98936681 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef94126420 con 0x7fef9409e850 2023-10-01T07:58:59.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.476+0000 7f063249c700 1 Processor -- start 2023-10-01T07:58:59.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.477+0000 7f063249c700 1 -- start start 2023-10-01T07:58:59.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.477+0000 7f063249c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f062c09eca0 0x7f062c13cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:59.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.477+0000 7f063249c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f062c06f050 0x7f062c13f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:59.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.477+0000 7f063249c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f062c070ee0 con 0x7f062c06e570 2023-10-01T07:58:59.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.477+0000 7f063249c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f062c071980 con 0x7f062c09eca0 2023-10-01T07:58:59.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.477+0000 7f063249c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062c071480 con 0x7f062c06f050 2023-10-01T07:58:59.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.477+0000 7f062b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f062c09eca0 0x7f062c13cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:59.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.477+0000 7f062b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f062c09eca0 0x7f062c13cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56730/0 (socket says 172.21.15.26:56730) 2023-10-01T07:58:59.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.477+0000 7f062b7fe700 1 -- 172.21.15.26:0/3874665739 learned_addr learned my addr 172.21.15.26:0/3874665739 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:59.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.477+0000 7f0630a39700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f062c06f050 0x7f062c13f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:59.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.477+0000 7f062bfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f062c06e570 0x7f062c06e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44450/0 (socket says 172.21.15.26:44450) 2023-10-01T07:58:59.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.478+0000 7f062b7fe700 1 -- 172.21.15.26:0/3874665739 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f062c06f050 msgr2=0x7f062c13f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:58:59.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.478+0000 7f062b7fe700 1 --2- 172.21.15.26:0/3874665739 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f062c06f050 0x7f062c13f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:59.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.478+0000 7f062b7fe700 1 -- 172.21.15.26:0/3874665739 >> v1:172.21.15.26:6789/0 conn(0x7f062c06e570 legacy=0x7f062c06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:59.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.478+0000 7f062b7fe700 1 -- 172.21.15.26:0/3874665739 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062c071b90 con 0x7f062c09eca0 2023-10-01T07:58:59.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.478+0000 7f062b7fe700 1 --2- 172.21.15.26:0/3874665739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f062c09eca0 0x7f062c13cea0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f06200098f0 tx=0x7f0620009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dfd9e46d34f6c1f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:59.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.478+0000 7f062affd700 1 -- 172.21.15.26:0/3874665739 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0620011830 con 0x7f062c09eca0 2023-10-01T07:58:59.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.478+0000 7f062affd700 1 -- 172.21.15.26:0/3874665739 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0620011990 con 0x7f062c09eca0 2023-10-01T07:58:59.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.478+0000 7f062affd700 1 -- 172.21.15.26:0/3874665739 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0620011d20 con 0x7f062c09eca0 2023-10-01T07:58:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.479+0000 7f063249c700 1 -- 172.21.15.26:0/3874665739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f062c09eca0 msgr2=0x7f062c13cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.479+0000 7f063249c700 1 --2- 172.21.15.26:0/3874665739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f062c09eca0 0x7f062c13cea0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f06200098f0 tx=0x7f0620009c00 comp rx=0 tx=0).stop 2023-10-01T07:58:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.479+0000 7f063249c700 1 -- 172.21.15.26:0/3874665739 shutdown_connections 2023-10-01T07:58:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.479+0000 7f063249c700 1 --2- 172.21.15.26:0/3874665739 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f062c06f050 0x7f062c13f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.479+0000 7f063249c700 1 --2- 172.21.15.26:0/3874665739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f062c09eca0 0x7f062c13cea0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.479+0000 7f063249c700 1 -- 172.21.15.26:0/3874665739 >> 172.21.15.26:0/3874665739 conn(0x7f062c0a2aa0 msgr2=0x7f062c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.479+0000 7f063249c700 1 -- 172.21.15.26:0/3874665739 shutdown_connections 2023-10-01T07:58:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.479+0000 7f063249c700 1 -- 172.21.15.26:0/3874665739 wait complete. 2023-10-01T07:58:59.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.480+0000 7f063249c700 1 Processor -- start 2023-10-01T07:58:59.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.481+0000 7f063249c700 1 -- start start 2023-10-01T07:58:59.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.481+0000 7f063249c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f062c06e570 0x7f062c135380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:59.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.481+0000 7f063249c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f062c06f050 0x7f062c1358c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:59.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.481+0000 7f063249c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f062c13e660 0x7f062c135e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:58:59.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.481+0000 7f063249c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062c0a24a0 con 0x7f062c06f050 2023-10-01T07:58:59.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.481+0000 7f063249c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062c139860 con 0x7f062c06e570 2023-10-01T07:58:59.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.481+0000 7f063249c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f062c138250 con 0x7f062c13e660 2023-10-01T07:58:59.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.481+0000 7f062bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f062c06e570 0x7f062c135380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:59.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.481+0000 7f062bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f062c06e570 0x7f062c135380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46922/0 (socket says 172.21.15.26:46922) 2023-10-01T07:58:59.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.481+0000 7f062bfff700 1 -- 172.21.15.26:0/1821786742 learned_addr learned my addr 172.21.15.26:0/1821786742 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:58:59.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.482+0000 7f062b7fe700 1 --2- 172.21.15.26:0/1821786742 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f062c06f050 0x7f062c1358c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:59.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.482+0000 7f0630a39700 1 --2- 172.21.15.26:0/1821786742 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f062c13e660 0x7f062c135e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:58:59.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.482+0000 7f062bfff700 1 -- 172.21.15.26:0/1821786742 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f062c13e660 msgr2=0x7f062c135e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:59.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.482+0000 7f062bfff700 1 --2- 172.21.15.26:0/1821786742 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f062c13e660 0x7f062c135e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:59.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.482+0000 7f062bfff700 1 -- 172.21.15.26:0/1821786742 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f062c06f050 msgr2=0x7f062c1358c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:59.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.482+0000 7f062bfff700 1 --2- 172.21.15.26:0/1821786742 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f062c06f050 0x7f062c1358c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:59.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.482+0000 7f062bfff700 1 -- 172.21.15.26:0/1821786742 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0620009550 con 0x7f062c06e570 2023-10-01T07:58:59.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.482+0000 7f062b7fe700 1 --2- 172.21.15.26:0/1821786742 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f062c06f050 0x7f062c1358c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:58:59.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.482+0000 7f062bfff700 1 --2- 172.21.15.26:0/1821786742 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f062c06e570 0x7f062c135380 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f061c00c550 tx=0x7f061c00c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:58:59.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.482+0000 7f0628ff9700 1 -- 172.21.15.26:0/1821786742 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c005cb0 con 0x7f062c06e570 2023-10-01T07:58:59.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.483+0000 7f0628ff9700 1 -- 172.21.15.26:0/1821786742 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061c005e10 con 0x7f062c06e570 2023-10-01T07:58:59.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.483+0000 7f063249c700 1 -- 172.21.15.26:0/1821786742 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f062c070610 con 0x7f062c06e570 2023-10-01T07:58:59.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.483+0000 7f0628ff9700 1 -- 172.21.15.26:0/1821786742 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c0072d0 con 0x7f062c06e570 2023-10-01T07:58:59.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.483+0000 7f063249c700 1 -- 172.21.15.26:0/1821786742 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f062c138950 con 0x7f062c06e570 2023-10-01T07:58:59.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.484+0000 7f063249c700 1 -- 172.21.15.26:0/1821786742 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f062c074ea0 con 0x7f062c06e570 2023-10-01T07:58:59.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.485+0000 7f0628ff9700 1 -- 172.21.15.26:0/1821786742 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f061c007430 con 0x7f062c06e570 2023-10-01T07:58:59.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.485+0000 7f0628ff9700 1 -- 172.21.15.26:0/1821786742 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f061c03ef00 con 0x7f062c06e570 2023-10-01T07:58:59.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.493+0000 7f0628ff9700 1 -- 172.21.15.26:0/1821786742 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f061c01b3b0 con 0x7f062c06e570 2023-10-01T07:58:59.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.588+0000 7fa3c0022700 1 -- 172.21.15.26:0/1198362237 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa3b8070b80 con 0x7fa3b8130540 2023-10-01T07:58:59.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.588+0000 7fa3ae7fc700 1 -- 172.21.15.26:0/1198362237 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa3a8015020 con 0x7fa3b8130540 2023-10-01T07:58:59.590 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:58:59.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.590+0000 7fa3c0022700 1 -- 172.21.15.26:0/1198362237 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3b8130540 msgr2=0x7fa3b811f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:59.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.590+0000 7fa3c0022700 1 --2- 172.21.15.26:0/1198362237 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3b8130540 0x7fa3b811f530 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8009840 tx=0x7fa3a8004750 comp rx=0 tx=0).stop 2023-10-01T07:58:59.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.591+0000 7fa3c0022700 1 -- 172.21.15.26:0/1198362237 shutdown_connections 2023-10-01T07:58:59.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.591+0000 7fa3c0022700 1 --2- 172.21.15.26:0/1198362237 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa3b8130e50 0x7fa3b811fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:59.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.591+0000 7fa3c0022700 1 --2- 172.21.15.26:0/1198362237 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3b806fb20 0x7fa3b811eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:59.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.591+0000 7fa3c0022700 1 --2- 172.21.15.26:0/1198362237 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3b8130540 0x7fa3b811f530 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:59.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.591+0000 7fa3c0022700 1 -- 172.21.15.26:0/1198362237 >> 172.21.15.26:0/1198362237 conn(0x7fa3b80a2aa0 msgr2=0x7fa3b806e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:59.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.591+0000 7fa3c0022700 1 -- 172.21.15.26:0/1198362237 shutdown_connections 2023-10-01T07:58:59.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.591+0000 7fa3c0022700 1 -- 172.21.15.26:0/1198362237 wait complete. 2023-10-01T07:58:59.608 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:58:59.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.635+0000 7fcf5b182700 1 -- 172.21.15.26:0/1279651423 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcf54120140 con 0x7fcf5409d6f0 2023-10-01T07:58:59.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.635+0000 7fcf517fa700 1 -- 172.21.15.26:0/1279651423 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcf40017020 con 0x7fcf5409d6f0 2023-10-01T07:58:59.637 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:58:59.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.637+0000 7fcf5b182700 1 -- 172.21.15.26:0/1279651423 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf5409d6f0 msgr2=0x7fcf5411fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:59.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.637+0000 7fcf5b182700 1 --2- 172.21.15.26:0/1279651423 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf5409d6f0 0x7fcf5411fc00 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fcf540673f0 tx=0x7fcf4000eb20 comp rx=0 tx=0).stop 2023-10-01T07:58:59.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.637+0000 7fcf5b182700 1 -- 172.21.15.26:0/1279651423 shutdown_connections 2023-10-01T07:58:59.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.637+0000 7fcf5b182700 1 --2- 172.21.15.26:0/1279651423 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf541339f0 0x7fcf541c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:59.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.637+0000 7fcf5b182700 1 --2- 172.21.15.26:0/1279651423 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf5409ace0 0x7fcf5411f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:59.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.637+0000 7fcf5b182700 1 --2- 172.21.15.26:0/1279651423 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf5409d6f0 0x7fcf5411fc00 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:59.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.637+0000 7fcf5b182700 1 -- 172.21.15.26:0/1279651423 >> 172.21.15.26:0/1279651423 conn(0x7fcf54066f50 msgr2=0x7fcf540a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:59.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.637+0000 7fcf5b182700 1 -- 172.21.15.26:0/1279651423 shutdown_connections 2023-10-01T07:58:59.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.638+0000 7fcf5b182700 1 -- 172.21.15.26:0/1279651423 wait complete. 2023-10-01T07:58:59.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:58:59.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.656+0000 7fef9c55e700 1 -- 172.21.15.26:0/98936681 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fef94126420 con 0x7fef9409e850 2023-10-01T07:58:59.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.657+0000 7fef8affd700 1 -- 172.21.15.26:0/98936681 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fef94126420 con 0x7fef9409e850 2023-10-01T07:58:59.658 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:58:59.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.659+0000 7fef9c55e700 1 -- 172.21.15.26:0/98936681 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fef9409e850 msgr2=0x7fef941235b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:59.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.659+0000 7fef9c55e700 1 --2- 172.21.15.26:0/98936681 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fef9409e850 0x7fef941235b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fef900090b0 tx=0x7fef90004750 comp rx=0 tx=0).stop 2023-10-01T07:58:59.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.659+0000 7fef9c55e700 1 -- 172.21.15.26:0/98936681 shutdown_connections 2023-10-01T07:58:59.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.659+0000 7fef9c55e700 1 --2- 172.21.15.26:0/98936681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef941340c0 0x7fef941c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:59.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.659+0000 7fef9c55e700 1 --2- 172.21.15.26:0/98936681 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fef9409e850 0x7fef941235b0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:59.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.659+0000 7fef9c55e700 1 --2- 172.21.15.26:0/98936681 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fef9409f160 0x7fef94123af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:59.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.659+0000 7fef9c55e700 1 -- 172.21.15.26:0/98936681 >> 172.21.15.26:0/98936681 conn(0x7fef940a3f70 msgr2=0x7fef94070e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:59.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.659+0000 7fef9c55e700 1 -- 172.21.15.26:0/98936681 shutdown_connections 2023-10-01T07:58:59.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.659+0000 7fef9c55e700 1 -- 172.21.15.26:0/98936681 wait complete. 2023-10-01T07:58:59.675 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:58:59.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.700+0000 7f063249c700 1 -- 172.21.15.26:0/1821786742 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f062c06b9e0 con 0x7f062c06e570 2023-10-01T07:58:59.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.700+0000 7f0628ff9700 1 -- 172.21.15.26:0/1821786742 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f061c017030 con 0x7f062c06e570 2023-10-01T07:58:59.702 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:58:59.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.702+0000 7f063249c700 1 -- 172.21.15.26:0/1821786742 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f062c06e570 msgr2=0x7f062c135380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:58:59.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.702+0000 7f063249c700 1 --2- 172.21.15.26:0/1821786742 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f062c06e570 0x7f062c135380 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f061c00c550 tx=0x7f061c00c860 comp rx=0 tx=0).stop 2023-10-01T07:58:59.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.702+0000 7f063249c700 1 -- 172.21.15.26:0/1821786742 shutdown_connections 2023-10-01T07:58:59.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.702+0000 7f063249c700 1 --2- 172.21.15.26:0/1821786742 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f062c13e660 0x7f062c135e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:59.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.702+0000 7f063249c700 1 --2- 172.21.15.26:0/1821786742 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f062c06e570 0x7f062c135380 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:59.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.702+0000 7f063249c700 1 --2- 172.21.15.26:0/1821786742 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f062c06f050 0x7f062c1358c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:58:59.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.702+0000 7f063249c700 1 -- 172.21.15.26:0/1821786742 >> 172.21.15.26:0/1821786742 conn(0x7f062c0a2aa0 msgr2=0x7f062c130f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:58:59.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.703+0000 7f063249c700 1 -- 172.21.15.26:0/1821786742 shutdown_connections 2023-10-01T07:58:59.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:58:59.703+0000 7f063249c700 1 -- 172.21.15.26:0/1821786742 wait complete. 2023-10-01T07:58:59.717 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:00.609 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:00.654 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:00.676 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:00.718 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:00.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.769+0000 7f4cbd85a700 1 Processor -- start 2023-10-01T07:59:00.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.769+0000 7f4cbd85a700 1 -- start start 2023-10-01T07:59:00.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.769+0000 7f4cbd85a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4cb80a0a30 0x7f4cb80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:00.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.769+0000 7f4cbd85a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4cb80a1340 0x7f4cb8133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:00.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.769+0000 7f4cbd85a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4cb8133fa0 0x7f4cb8134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:00.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.769+0000 7f4cbd85a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cb809edd0 con 0x7f4cb80a1340 2023-10-01T07:59:00.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.770+0000 7f4cbd85a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb809e1f0 con 0x7f4cb80a0a30 2023-10-01T07:59:00.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.770+0000 7f4cbd85a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb809dc50 con 0x7f4cb8133fa0 2023-10-01T07:59:00.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.770+0000 7f4cb6ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4cb80a0a30 0x7f4cb80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:00.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.770+0000 7f4cb6ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4cb80a0a30 0x7f4cb80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46930/0 (socket says 172.21.15.26:46930) 2023-10-01T07:59:00.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.770+0000 7f4cb6ffd700 1 -- 172.21.15.26:0/498836929 learned_addr learned my addr 172.21.15.26:0/498836929 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:00.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.770+0000 7f4cb67fc700 1 --2- 172.21.15.26:0/498836929 >> v2:172.21.15.26:3300/0 conn(0x7f4cb80a1340 0x7f4cb8133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:00.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.770+0000 7f4cb77fe700 1 --2- 172.21.15.26:0/498836929 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4cb8133fa0 0x7f4cb8134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:00.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.770+0000 7f4cb67fc700 1 -- 172.21.15.26:0/498836929 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4cb8133fa0 msgr2=0x7f4cb8134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:00.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.770+0000 7f4cb67fc700 1 --2- 172.21.15.26:0/498836929 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4cb8133fa0 0x7f4cb8134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:00.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.770+0000 7f4cb67fc700 1 -- 172.21.15.26:0/498836929 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4cb80a0a30 msgr2=0x7f4cb80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:00.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.770+0000 7f4cb67fc700 1 --2- 172.21.15.26:0/498836929 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4cb80a0a30 0x7f4cb80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:00.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.770+0000 7f4cb67fc700 1 -- 172.21.15.26:0/498836929 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb80a1fe0 con 0x7f4cb80a1340 2023-10-01T07:59:00.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.770+0000 7f4cb67fc700 1 --2- 172.21.15.26:0/498836929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cb80a1340 0x7f4cb8133a60 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f4cac009840 tx=0x7f4cac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd7fde31b5ade85 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:00.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.771+0000 7f4cb5ffb700 1 -- 172.21.15.26:0/498836929 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cac011830 con 0x7f4cb80a1340 2023-10-01T07:59:00.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.771+0000 7f4cb5ffb700 1 -- 172.21.15.26:0/498836929 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cac011990 con 0x7f4cb80a1340 2023-10-01T07:59:00.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.771+0000 7f4cb5ffb700 1 -- 172.21.15.26:0/498836929 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cac011d20 con 0x7f4cb80a1340 2023-10-01T07:59:00.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.772+0000 7f4cbd85a700 1 -- 172.21.15.26:0/498836929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cb80a1340 msgr2=0x7f4cb8133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:00.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.772+0000 7f4cbd85a700 1 --2- 172.21.15.26:0/498836929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cb80a1340 0x7f4cb8133a60 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f4cac009840 tx=0x7f4cac009b50 comp rx=0 tx=0).stop 2023-10-01T07:59:00.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.772+0000 7f4cbd85a700 1 -- 172.21.15.26:0/498836929 shutdown_connections 2023-10-01T07:59:00.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.772+0000 7f4cbd85a700 1 --2- 172.21.15.26:0/498836929 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4cb8133fa0 0x7f4cb8134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:00.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.772+0000 7f4cbd85a700 1 --2- 172.21.15.26:0/498836929 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4cb80a0a30 0x7f4cb80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:00.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.772+0000 7f4cbd85a700 1 --2- 172.21.15.26:0/498836929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cb80a1340 0x7f4cb8133a60 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:00.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.772+0000 7f4cbd85a700 1 -- 172.21.15.26:0/498836929 >> 172.21.15.26:0/498836929 conn(0x7f4cb80a6550 msgr2=0x7f4cb80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:00.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.772+0000 7f4cbd85a700 1 -- 172.21.15.26:0/498836929 shutdown_connections 2023-10-01T07:59:00.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.772+0000 7f4cbd85a700 1 -- 172.21.15.26:0/498836929 wait complete. 2023-10-01T07:59:00.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.773+0000 7f4cbd85a700 1 Processor -- start 2023-10-01T07:59:00.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.773+0000 7f4cbd85a700 1 -- start start 2023-10-01T07:59:00.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.774+0000 7f4cbd85a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cb80a0a30 0x7f4cb81201f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:00.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.774+0000 7f4cbd85a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4cb80a1340 0x7f4cb8120730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:00.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.774+0000 7f4cbd85a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4cb8133fa0 0x7f4cb8120c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.774+0000 7f4cbd85a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb8123450 con 0x7f4cb80a0a30 2023-10-01T07:59:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.774+0000 7f4cbd85a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb80a0220 con 0x7f4cb8133fa0 2023-10-01T07:59:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.774+0000 7f4cbd85a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb80a3410 con 0x7f4cb80a1340 2023-10-01T07:59:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.774+0000 7f4cb67fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4cb80a1340 0x7f4cb8120730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.774+0000 7f4cb67fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4cb80a1340 0x7f4cb8120730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37526/0 (socket says 172.21.15.26:37526) 2023-10-01T07:59:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.774+0000 7f4cb67fc700 1 -- 172.21.15.26:0/2413254253 learned_addr learned my addr 172.21.15.26:0/2413254253 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.774+0000 7f4cb77fe700 1 --2- 172.21.15.26:0/2413254253 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4cb8133fa0 0x7f4cb8120c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.774+0000 7f4cb6ffd700 1 --2- 172.21.15.26:0/2413254253 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cb80a0a30 0x7f4cb81201f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.775+0000 7f4cb67fc700 1 -- 172.21.15.26:0/2413254253 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4cb8133fa0 msgr2=0x7f4cb8120c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.775+0000 7f4cb67fc700 1 --2- 172.21.15.26:0/2413254253 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4cb8133fa0 0x7f4cb8120c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:00.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.775+0000 7f4cb67fc700 1 -- 172.21.15.26:0/2413254253 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cb80a0a30 msgr2=0x7f4cb81201f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:00.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.775+0000 7f4cb67fc700 1 --2- 172.21.15.26:0/2413254253 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cb80a0a30 0x7f4cb81201f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:00.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.775+0000 7f4cb67fc700 1 -- 172.21.15.26:0/2413254253 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cac0094a0 con 0x7f4cb80a1340 2023-10-01T07:59:00.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.775+0000 7f4cb67fc700 1 --2- 172.21.15.26:0/2413254253 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4cb80a1340 0x7f4cb8120730 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4cac009fd0 tx=0x7f4cac004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:00.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.775+0000 7f4c9ffff700 1 -- 172.21.15.26:0/2413254253 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cac004590 con 0x7f4cb80a1340 2023-10-01T07:59:00.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.775+0000 7f4cbd85a700 1 -- 172.21.15.26:0/2413254253 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cb8121db0 con 0x7f4cb80a1340 2023-10-01T07:59:00.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.775+0000 7f4c9ffff700 1 -- 172.21.15.26:0/2413254253 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cac01f070 con 0x7f4cb80a1340 2023-10-01T07:59:00.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.775+0000 7f4c9ffff700 1 -- 172.21.15.26:0/2413254253 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cac0038a0 con 0x7f4cb80a1340 2023-10-01T07:59:00.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.775+0000 7f4cbd85a700 1 -- 172.21.15.26:0/2413254253 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cb81241c0 con 0x7f4cb80a1340 2023-10-01T07:59:00.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.777+0000 7f4c9dffb700 1 -- 172.21.15.26:0/2413254253 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c900052e0 con 0x7f4cb80a1340 2023-10-01T07:59:00.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.777+0000 7f4c9ffff700 1 -- 172.21.15.26:0/2413254253 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4cac003a00 con 0x7f4cb80a1340 2023-10-01T07:59:00.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.778+0000 7f4c9ffff700 1 -- 172.21.15.26:0/2413254253 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4cac021070 con 0x7f4cb80a1340 2023-10-01T07:59:00.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.783+0000 7f4c9ffff700 1 -- 172.21.15.26:0/2413254253 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4cac02f990 con 0x7f4cb80a1340 2023-10-01T07:59:00.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.806+0000 7f25f6809700 1 Processor -- start 2023-10-01T07:59:00.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.807+0000 7f25f6809700 1 -- start start 2023-10-01T07:59:00.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.807+0000 7f25f6809700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f006c0e0 0x7f25f009ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:00.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.807+0000 7f25f6809700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f25f01380f0 0x7f25f013fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:00.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.807+0000 7f25f6809700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f0134980 con 0x7f25f0134ec0 2023-10-01T07:59:00.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.807+0000 7f25f6809700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f006c4b0 con 0x7f25f01380f0 2023-10-01T07:59:00.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.807+0000 7f25f6809700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25f00a09c0 con 0x7f25f006c0e0 2023-10-01T07:59:00.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.807+0000 7f25f4da6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f25f01380f0 0x7f25f013fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:00.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.807+0000 7f25f4da6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f25f01380f0 0x7f25f013fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56758/0 (socket says 172.21.15.26:56758) 2023-10-01T07:59:00.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.807+0000 7f25f4da6700 1 -- 172.21.15.26:0/1689923243 learned_addr learned my addr 172.21.15.26:0/1689923243 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:00.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.808+0000 7f25effff700 1 --2- 172.21.15.26:0/1689923243 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f006c0e0 0x7f25f009ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:00.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.808+0000 7f25f4da6700 1 -- 172.21.15.26:0/1689923243 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f006c0e0 msgr2=0x7f25f009ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:00.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.808+0000 7f25f4da6700 1 --2- 172.21.15.26:0/1689923243 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f006c0e0 0x7f25f009ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:00.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.808+0000 7f25f4da6700 1 -- 172.21.15.26:0/1689923243 >> v1:172.21.15.26:6789/0 conn(0x7f25f0134ec0 legacy=0x7f25f01379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:00.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.808+0000 7f25f4da6700 1 -- 172.21.15.26:0/1689923243 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f00a0600 con 0x7f25f01380f0 2023-10-01T07:59:00.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.808+0000 7f25effff700 1 --2- 172.21.15.26:0/1689923243 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f006c0e0 0x7f25f009ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:59:00.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.808+0000 7f25f4da6700 1 --2- 172.21.15.26:0/1689923243 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f01380f0 0x7f25f013fd20 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f25e8009e50 tx=0x7f25e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee2df8025f5db94 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:00.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.808+0000 7f25eeffd700 1 -- 172.21.15.26:0/1689923243 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e800e070 con 0x7f25f01380f0 2023-10-01T07:59:00.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.808+0000 7f25eeffd700 1 -- 172.21.15.26:0/1689923243 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e800b9c0 con 0x7f25f01380f0 2023-10-01T07:59:00.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.808+0000 7f25eeffd700 1 -- 172.21.15.26:0/1689923243 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e800bd70 con 0x7f25f01380f0 2023-10-01T07:59:00.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.809+0000 7f25f6809700 1 -- 172.21.15.26:0/1689923243 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f01380f0 msgr2=0x7f25f013fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:00.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.809+0000 7f25f6809700 1 --2- 172.21.15.26:0/1689923243 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f01380f0 0x7f25f013fd20 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f25e8009e50 tx=0x7f25e800b330 comp rx=0 tx=0).stop 2023-10-01T07:59:00.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.809+0000 7f25f6809700 1 -- 172.21.15.26:0/1689923243 shutdown_connections 2023-10-01T07:59:00.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.809+0000 7f25f6809700 1 --2- 172.21.15.26:0/1689923243 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f01380f0 0x7f25f013fd20 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:00.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.809+0000 7f25f6809700 1 --2- 172.21.15.26:0/1689923243 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f006c0e0 0x7f25f009ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:00.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.809+0000 7f25f6809700 1 -- 172.21.15.26:0/1689923243 >> 172.21.15.26:0/1689923243 conn(0x7f25f00a4210 msgr2=0x7f25f00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:00.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.810+0000 7f25f6809700 1 -- 172.21.15.26:0/1689923243 shutdown_connections 2023-10-01T07:59:00.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.810+0000 7f25f6809700 1 -- 172.21.15.26:0/1689923243 wait complete. 2023-10-01T07:59:00.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.811+0000 7f25f6809700 1 Processor -- start 2023-10-01T07:59:00.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.811+0000 7f25f6809700 1 -- start start 2023-10-01T07:59:00.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.811+0000 7f25f6809700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f006c0e0 0x7f25f011a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:00.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.811+0000 7f25f6809700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25f0134ec0 0x7f25f011abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:00.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.811+0000 7f25f6809700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f01380f0 0x7f25f011b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:00.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.811+0000 7f25f6809700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f011d840 con 0x7f25f006c0e0 2023-10-01T07:59:00.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.811+0000 7f25f6809700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f0140e80 con 0x7f25f0134ec0 2023-10-01T07:59:00.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.811+0000 7f25f6809700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25f011c6a0 con 0x7f25f01380f0 2023-10-01T07:59:00.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.811+0000 7f25f4da6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f01380f0 0x7f25f011b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:00.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.811+0000 7f25effff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f006c0e0 0x7f25f011a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:00.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.811+0000 7f25f4da6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f01380f0 0x7f25f011b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37558/0 (socket says 172.21.15.26:37558) 2023-10-01T07:59:00.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.811+0000 7f25f4da6700 1 -- 172.21.15.26:0/4151979080 learned_addr learned my addr 172.21.15.26:0/4151979080 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:00.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.812+0000 7f25effff700 1 -- 172.21.15.26:0/4151979080 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f01380f0 msgr2=0x7f25f011b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:00.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.812+0000 7f25effff700 1 --2- 172.21.15.26:0/4151979080 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f01380f0 0x7f25f011b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:00.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.812+0000 7f25effff700 1 -- 172.21.15.26:0/4151979080 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25f0134ec0 msgr2=0x7f25f011abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:00.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.812+0000 7f25effff700 1 --2- 172.21.15.26:0/4151979080 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25f0134ec0 0x7f25f011abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:00.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.812+0000 7f25effff700 1 -- 172.21.15.26:0/4151979080 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e8009b30 con 0x7f25f006c0e0 2023-10-01T07:59:00.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.812+0000 7f25f4da6700 1 --2- 172.21.15.26:0/4151979080 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f01380f0 0x7f25f011b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:00.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.812+0000 7f25effff700 1 --2- 172.21.15.26:0/4151979080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f006c0e0 0x7f25f011a680 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f25e000e810 tx=0x7f25e000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:00.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.812+0000 7f25ecff9700 1 -- 172.21.15.26:0/4151979080 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e000c070 con 0x7f25f006c0e0 2023-10-01T07:59:00.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.812+0000 7f25ecff9700 1 -- 172.21.15.26:0/4151979080 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e0013610 con 0x7f25f006c0e0 2023-10-01T07:59:00.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.812+0000 7f25f6809700 1 -- 172.21.15.26:0/4151979080 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f00a03f0 con 0x7f25f006c0e0 2023-10-01T07:59:00.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.812+0000 7f25ecff9700 1 -- 172.21.15.26:0/4151979080 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e0013980 con 0x7f25f006c0e0 2023-10-01T07:59:00.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.812+0000 7f25f6809700 1 -- 172.21.15.26:0/4151979080 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f01408d0 con 0x7f25f006c0e0 2023-10-01T07:59:00.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.813+0000 7f25ecff9700 1 -- 172.21.15.26:0/4151979080 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f25e0013ae0 con 0x7f25f006c0e0 2023-10-01T07:59:00.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.814+0000 7f25ecff9700 1 -- 172.21.15.26:0/4151979080 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f25e003f480 con 0x7f25f006c0e0 2023-10-01T07:59:00.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.814+0000 7f25f6809700 1 -- 172.21.15.26:0/4151979080 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f0074ea0 con 0x7f25f006c0e0 2023-10-01T07:59:00.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.819+0000 7f25ecff9700 1 -- 172.21.15.26:0/4151979080 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25e001c400 con 0x7f25f006c0e0 2023-10-01T07:59:00.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.848+0000 7f40b55b5700 1 Processor -- start 2023-10-01T07:59:00.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.848+0000 7f40b55b5700 1 -- start start 2023-10-01T07:59:00.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.849+0000 7f40b55b5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f40b0131810 0x7f40b0131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:00.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.849+0000 7f40b55b5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f40b0099a40 0x7f40b0099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:00.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.849+0000 7f40b55b5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f40b009a3b0 0x7f40b0138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:00.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.849+0000 7f40b55b5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b009b580 con 0x7f40b009a3b0 2023-10-01T07:59:00.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.849+0000 7f40b55b5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b01313c0 con 0x7f40b0099a40 2023-10-01T07:59:00.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.849+0000 7f40b55b5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40b006e8c0 con 0x7f40b0131810 2023-10-01T07:59:00.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.849+0000 7f40aeffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f40b0131810 0x7f40b0131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:00.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.849+0000 7f40aeffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f40b0131810 0x7f40b0131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37570/0 (socket says 172.21.15.26:37570) 2023-10-01T07:59:00.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.849+0000 7f40aeffd700 1 -- 172.21.15.26:0/3021252888 learned_addr learned my addr 172.21.15.26:0/3021252888 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:00.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.849+0000 7f40ae7fc700 1 --2- 172.21.15.26:0/3021252888 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f40b0099a40 0x7f40b0099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:00.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.849+0000 7f40af7fe700 1 --2- 172.21.15.26:0/3021252888 >> v2:172.21.15.26:3300/0 conn(0x7f40b009a3b0 0x7f40b0138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:00.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.849+0000 7f40aeffd700 1 -- 172.21.15.26:0/3021252888 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f40b0099a40 msgr2=0x7f40b0099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:00.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.849+0000 7f40aeffd700 1 --2- 172.21.15.26:0/3021252888 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f40b0099a40 0x7f40b0099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:00.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.849+0000 7f40aeffd700 1 -- 172.21.15.26:0/3021252888 >> v2:172.21.15.26:3300/0 conn(0x7f40b009a3b0 msgr2=0x7f40b0138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:00.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.849+0000 7f40aeffd700 1 --2- 172.21.15.26:0/3021252888 >> v2:172.21.15.26:3300/0 conn(0x7f40b009a3b0 0x7f40b0138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:00.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.849+0000 7f40aeffd700 1 -- 172.21.15.26:0/3021252888 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b009a820 con 0x7f40b0131810 2023-10-01T07:59:00.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.849+0000 7f40ae7fc700 1 --2- 172.21.15.26:0/3021252888 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f40b0099a40 0x7f40b0099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:00.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.849+0000 7f40af7fe700 1 --2- 172.21.15.26:0/3021252888 >> v2:172.21.15.26:3300/0 conn(0x7f40b009a3b0 0x7f40b0138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:00.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.849+0000 7f40aeffd700 1 --2- 172.21.15.26:0/3021252888 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f40b0131810 0x7f40b0131be0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f40a00098f0 tx=0x7f40a0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f014adfffb081466 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:00.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.850+0000 7f40adffb700 1 -- 172.21.15.26:0/3021252888 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a0011830 con 0x7f40b0131810 2023-10-01T07:59:00.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.850+0000 7f40adffb700 1 -- 172.21.15.26:0/3021252888 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a0011990 con 0x7f40b0131810 2023-10-01T07:59:00.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.850+0000 7f40adffb700 1 -- 172.21.15.26:0/3021252888 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a0011d20 con 0x7f40b0131810 2023-10-01T07:59:00.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.850+0000 7f40b55b5700 1 -- 172.21.15.26:0/3021252888 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f40b0131810 msgr2=0x7f40b0131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:00.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.850+0000 7f40b55b5700 1 --2- 172.21.15.26:0/3021252888 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f40b0131810 0x7f40b0131be0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f40a00098f0 tx=0x7f40a0009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:00.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.851+0000 7f40b55b5700 1 -- 172.21.15.26:0/3021252888 shutdown_connections 2023-10-01T07:59:00.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.851+0000 7f40b55b5700 1 --2- 172.21.15.26:0/3021252888 >> v2:172.21.15.26:3300/0 conn(0x7f40b009a3b0 0x7f40b0138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:00.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.851+0000 7f40b55b5700 1 --2- 172.21.15.26:0/3021252888 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f40b0131810 0x7f40b0131be0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:00.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.851+0000 7f40b55b5700 1 --2- 172.21.15.26:0/3021252888 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f40b0099a40 0x7f40b0099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:00.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.851+0000 7f40b55b5700 1 -- 172.21.15.26:0/3021252888 >> 172.21.15.26:0/3021252888 conn(0x7f40b00a2aa0 msgr2=0x7f40b00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:00.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.851+0000 7f40b55b5700 1 -- 172.21.15.26:0/3021252888 shutdown_connections 2023-10-01T07:59:00.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.851+0000 7f40b55b5700 1 -- 172.21.15.26:0/3021252888 wait complete. 2023-10-01T07:59:00.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.852+0000 7f40b55b5700 1 Processor -- start 2023-10-01T07:59:00.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.852+0000 7f40b55b5700 1 -- start start 2023-10-01T07:59:00.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.852+0000 7f40b55b5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f40b0099a40 0x7f40b011b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:00.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.852+0000 7f40b55b5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f40b009a3b0 0x7f40b011bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:00.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.852+0000 7f40b55b5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40b0131810 0x7f40b011c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:00.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.852+0000 7f40b55b5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b011d8c0 con 0x7f40b0131810 2023-10-01T07:59:00.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.852+0000 7f40b55b5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b011ec10 con 0x7f40b009a3b0 2023-10-01T07:59:00.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.852+0000 7f40b55b5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40b01309d0 con 0x7f40b0099a40 2023-10-01T07:59:00.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.853+0000 7f40ae7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f40b009a3b0 0x7f40b011bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:00.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.853+0000 7f40aeffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f40b0099a40 0x7f40b011b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:00.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.853+0000 7f40ae7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f40b009a3b0 0x7f40b011bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46956/0 (socket says 172.21.15.26:46956) 2023-10-01T07:59:00.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.853+0000 7f40ae7fc700 1 -- 172.21.15.26:0/3346329489 learned_addr learned my addr 172.21.15.26:0/3346329489 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:00.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.853+0000 7f40af7fe700 1 --2- 172.21.15.26:0/3346329489 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40b0131810 0x7f40b011c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:00.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.853+0000 7f40aeffd700 1 -- 172.21.15.26:0/3346329489 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f40b009a3b0 msgr2=0x7f40b011bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:00.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.853+0000 7f40aeffd700 1 --2- 172.21.15.26:0/3346329489 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f40b009a3b0 0x7f40b011bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:00.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.853+0000 7f40aeffd700 1 -- 172.21.15.26:0/3346329489 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40b0131810 msgr2=0x7f40b011c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:00.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.853+0000 7f40aeffd700 1 --2- 172.21.15.26:0/3346329489 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40b0131810 0x7f40b011c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:00.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.853+0000 7f40aeffd700 1 -- 172.21.15.26:0/3346329489 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a40094a0 con 0x7f40b0099a40 2023-10-01T07:59:00.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.853+0000 7f40aeffd700 1 --2- 172.21.15.26:0/3346329489 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f40b0099a40 0x7f40b011b690 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f40b0066c70 tx=0x7f40a0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:00.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.853+0000 7f40977fe700 1 -- 172.21.15.26:0/3346329489 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a0004450 con 0x7f40b0099a40 2023-10-01T07:59:00.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.854+0000 7f40977fe700 1 -- 172.21.15.26:0/3346329489 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a00045b0 con 0x7f40b0099a40 2023-10-01T07:59:00.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.854+0000 7f40b55b5700 1 -- 172.21.15.26:0/3346329489 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a8014be0 con 0x7f40b0099a40 2023-10-01T07:59:00.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.854+0000 7f40977fe700 1 -- 172.21.15.26:0/3346329489 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a00038c0 con 0x7f40b0099a40 2023-10-01T07:59:00.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.854+0000 7f40b55b5700 1 -- 172.21.15.26:0/3346329489 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a0009550 con 0x7f40b0099a40 2023-10-01T07:59:00.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.855+0000 7f40977fe700 1 -- 172.21.15.26:0/3346329489 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f40a0003a20 con 0x7f40b0099a40 2023-10-01T07:59:00.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.855+0000 7f40977fe700 1 -- 172.21.15.26:0/3346329489 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f40a0040930 con 0x7f40b0099a40 2023-10-01T07:59:00.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.856+0000 7f40b55b5700 1 -- 172.21.15.26:0/3346329489 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40b0074ea0 con 0x7f40b0099a40 2023-10-01T07:59:00.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.861+0000 7f40977fe700 1 -- 172.21.15.26:0/3346329489 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f40a0003cd0 con 0x7f40b0099a40 2023-10-01T07:59:00.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.898+0000 7f6ee0ac8700 1 Processor -- start 2023-10-01T07:59:00.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.898+0000 7f6ee0ac8700 1 -- start start 2023-10-01T07:59:00.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.899+0000 7f6ee0ac8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6edc133420 0x7f6edc1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:00.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.899+0000 7f6ee0ac8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6edc133e30 0x7f6edc12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:00.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.899+0000 7f6ee0ac8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6edc134260 0x7f6edc1304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:00.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.899+0000 7f6ee0ac8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6edc06b990 con 0x7f6edc134260 2023-10-01T07:59:00.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.899+0000 7f6ee0ac8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc0a0590 con 0x7f6edc133420 2023-10-01T07:59:00.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.899+0000 7f6ee0ac8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc09fb80 con 0x7f6edc133e30 2023-10-01T07:59:00.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.899+0000 7f6ed9d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6edc133e30 0x7f6edc12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:00.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.899+0000 7f6ed9d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6edc133e30 0x7f6edc12ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37586/0 (socket says 172.21.15.26:37586) 2023-10-01T07:59:00.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.899+0000 7f6ed9d9b700 1 -- 172.21.15.26:0/800906038 learned_addr learned my addr 172.21.15.26:0/800906038 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:00.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.899+0000 7f6eda59c700 1 --2- 172.21.15.26:0/800906038 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6edc133420 0x7f6edc1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:00.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.900+0000 7f6edad9d700 1 --2- 172.21.15.26:0/800906038 >> v2:172.21.15.26:3300/0 conn(0x7f6edc134260 0x7f6edc1304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:00.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.900+0000 7f6ed9d9b700 1 -- 172.21.15.26:0/800906038 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6edc133420 msgr2=0x7f6edc1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:00.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.900+0000 7f6ed9d9b700 1 --2- 172.21.15.26:0/800906038 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6edc133420 0x7f6edc1337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:00.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.900+0000 7f6ed9d9b700 1 -- 172.21.15.26:0/800906038 >> v2:172.21.15.26:3300/0 conn(0x7f6edc134260 msgr2=0x7f6edc1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:00.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.900+0000 7f6ed9d9b700 1 --2- 172.21.15.26:0/800906038 >> v2:172.21.15.26:3300/0 conn(0x7f6edc134260 0x7f6edc1304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:00.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.900+0000 7f6ed9d9b700 1 -- 172.21.15.26:0/800906038 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6edc0a0030 con 0x7f6edc133e30 2023-10-01T07:59:00.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.900+0000 7f6ed9d9b700 1 --2- 172.21.15.26:0/800906038 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6edc133e30 0x7f6edc12ff90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f6ed00098f0 tx=0x7f6ed0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=939ecc8dee962e03 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:00.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.900+0000 7f6ed959a700 1 -- 172.21.15.26:0/800906038 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0011830 con 0x7f6edc133e30 2023-10-01T07:59:00.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.900+0000 7f6ed959a700 1 -- 172.21.15.26:0/800906038 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed0011990 con 0x7f6edc133e30 2023-10-01T07:59:00.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.900+0000 7f6ed959a700 1 -- 172.21.15.26:0/800906038 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0011d20 con 0x7f6edc133e30 2023-10-01T07:59:00.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.901+0000 7f6ee0ac8700 1 -- 172.21.15.26:0/800906038 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6edc133e30 msgr2=0x7f6edc12ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:00.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.901+0000 7f6ee0ac8700 1 --2- 172.21.15.26:0/800906038 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6edc133e30 0x7f6edc12ff90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f6ed00098f0 tx=0x7f6ed0009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:00.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.901+0000 7f6ee0ac8700 1 -- 172.21.15.26:0/800906038 shutdown_connections 2023-10-01T07:59:00.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.901+0000 7f6ee0ac8700 1 --2- 172.21.15.26:0/800906038 >> v2:172.21.15.26:3300/0 conn(0x7f6edc134260 0x7f6edc1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:00.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.901+0000 7f6ee0ac8700 1 --2- 172.21.15.26:0/800906038 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6edc133420 0x7f6edc1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:00.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.901+0000 7f6ee0ac8700 1 --2- 172.21.15.26:0/800906038 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6edc133e30 0x7f6edc12ff90 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:00.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.901+0000 7f6ee0ac8700 1 -- 172.21.15.26:0/800906038 >> 172.21.15.26:0/800906038 conn(0x7f6edc0a4210 msgr2=0x7f6edc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:00.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.901+0000 7f6ee0ac8700 1 -- 172.21.15.26:0/800906038 shutdown_connections 2023-10-01T07:59:00.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.901+0000 7f6ee0ac8700 1 -- 172.21.15.26:0/800906038 wait complete. 2023-10-01T07:59:00.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.903+0000 7f6ee0ac8700 1 Processor -- start 2023-10-01T07:59:00.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.903+0000 7f6ee0ac8700 1 -- start start 2023-10-01T07:59:00.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.904+0000 7f6ee0ac8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6edc133420 0x7f6edc1cc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:00.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.904+0000 7f6ee0ac8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6edc133e30 0x7f6edc1cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:00.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.904+0000 7f6ee0ac8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6edc134260 0x7f6edc1cd200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:00.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.904+0000 7f6ee0ac8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc09dc70 con 0x7f6edc134260 2023-10-01T07:59:00.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.904+0000 7f6ee0ac8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc11b1a0 con 0x7f6edc133420 2023-10-01T07:59:00.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.904+0000 7f6ee0ac8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc09d590 con 0x7f6edc133e30 2023-10-01T07:59:00.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.904+0000 7f6ed9d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6edc133e30 0x7f6edc1cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:00.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.904+0000 7f6eda59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6edc133420 0x7f6edc1cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:00.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.904+0000 7f6ed9d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6edc133e30 0x7f6edc1cccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37600/0 (socket says 172.21.15.26:37600) 2023-10-01T07:59:00.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.904+0000 7f6ed9d9b700 1 -- 172.21.15.26:0/3439625144 learned_addr learned my addr 172.21.15.26:0/3439625144 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:00.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.904+0000 7f6eda59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6edc133420 0x7f6edc1cc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46982/0 (socket says 172.21.15.26:46982) 2023-10-01T07:59:00.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.904+0000 7f6ed9d9b700 1 -- 172.21.15.26:0/3439625144 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6edc133420 msgr2=0x7f6edc1cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:00.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.904+0000 7f6ed9d9b700 1 --2- 172.21.15.26:0/3439625144 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6edc133420 0x7f6edc1cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:00.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.904+0000 7f6ed9d9b700 1 -- 172.21.15.26:0/3439625144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6edc134260 msgr2=0x7f6edc1cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:00.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.904+0000 7f6ed9d9b700 1 --2- 172.21.15.26:0/3439625144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6edc134260 0x7f6edc1cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:00.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.904+0000 7f6ed9d9b700 1 -- 172.21.15.26:0/3439625144 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed0009550 con 0x7f6edc133e30 2023-10-01T07:59:00.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.905+0000 7f6ed9d9b700 1 --2- 172.21.15.26:0/3439625144 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6edc133e30 0x7f6edc1cccc0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0009c40 tx=0x7f6ed0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:00.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.905+0000 7f6ecaffd700 1 -- 172.21.15.26:0/3439625144 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0004300 con 0x7f6edc133e30 2023-10-01T07:59:00.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.905+0000 7f6ecaffd700 1 -- 172.21.15.26:0/3439625144 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed001f070 con 0x7f6edc133e30 2023-10-01T07:59:00.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.905+0000 7f6ee0ac8700 1 -- 172.21.15.26:0/3439625144 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6edc09e2a0 con 0x7f6edc133e30 2023-10-01T07:59:00.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.905+0000 7f6ecaffd700 1 -- 172.21.15.26:0/3439625144 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed00036a0 con 0x7f6edc133e30 2023-10-01T07:59:00.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.905+0000 7f6ee0ac8700 1 -- 172.21.15.26:0/3439625144 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6edc09da00 con 0x7f6edc133e30 2023-10-01T07:59:00.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.907+0000 7f6ee0ac8700 1 -- 172.21.15.26:0/3439625144 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ec00052e0 con 0x7f6edc133e30 2023-10-01T07:59:00.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.908+0000 7f6ecaffd700 1 -- 172.21.15.26:0/3439625144 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6ed0021030 con 0x7f6edc133e30 2023-10-01T07:59:00.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.909+0000 7f6ecaffd700 1 -- 172.21.15.26:0/3439625144 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6ed0040d70 con 0x7f6edc133e30 2023-10-01T07:59:00.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:00.917+0000 7f6ecaffd700 1 -- 172.21.15.26:0/3439625144 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6ed00199a0 con 0x7f6edc133e30 2023-10-01T07:59:01.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.033+0000 7f4c9dffb700 1 -- 172.21.15.26:0/2413254253 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4c90005590 con 0x7f4cb80a1340 2023-10-01T07:59:01.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.033+0000 7f4c9ffff700 1 -- 172.21.15.26:0/2413254253 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4cac02b070 con 0x7f4cb80a1340 2023-10-01T07:59:01.035 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:01.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.036+0000 7f4c9dffb700 1 -- 172.21.15.26:0/2413254253 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4cb80a1340 msgr2=0x7f4cb8120730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:01.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.036+0000 7f4c9dffb700 1 --2- 172.21.15.26:0/2413254253 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4cb80a1340 0x7f4cb8120730 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4cac009fd0 tx=0x7f4cac004750 comp rx=0 tx=0).stop 2023-10-01T07:59:01.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.037+0000 7f4c9dffb700 1 -- 172.21.15.26:0/2413254253 shutdown_connections 2023-10-01T07:59:01.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.037+0000 7f4c9dffb700 1 --2- 172.21.15.26:0/2413254253 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4cb8133fa0 0x7f4cb8120c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:01.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.037+0000 7f4c9dffb700 1 --2- 172.21.15.26:0/2413254253 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cb80a0a30 0x7f4cb81201f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:01.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.037+0000 7f4c9dffb700 1 --2- 172.21.15.26:0/2413254253 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4cb80a1340 0x7f4cb8120730 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:01.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.037+0000 7f4c9dffb700 1 -- 172.21.15.26:0/2413254253 >> 172.21.15.26:0/2413254253 conn(0x7f4cb80a6550 msgr2=0x7f4cb81b9780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:01.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.037+0000 7f4c9dffb700 1 -- 172.21.15.26:0/2413254253 shutdown_connections 2023-10-01T07:59:01.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.037+0000 7f4c9dffb700 1 -- 172.21.15.26:0/2413254253 wait complete. 2023-10-01T07:59:01.057 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:01.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.089+0000 7f40b55b5700 1 -- 172.21.15.26:0/3346329489 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f40b006b9e0 con 0x7f40b0099a40 2023-10-01T07:59:01.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.090+0000 7f40977fe700 1 -- 172.21.15.26:0/3346329489 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f40a0015020 con 0x7f40b0099a40 2023-10-01T07:59:01.091 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:01.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.092+0000 7f40b55b5700 1 -- 172.21.15.26:0/3346329489 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f40b0099a40 msgr2=0x7f40b011b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:01.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.092+0000 7f40b55b5700 1 --2- 172.21.15.26:0/3346329489 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f40b0099a40 0x7f40b011b690 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f40b0066c70 tx=0x7f40a0004750 comp rx=0 tx=0).stop 2023-10-01T07:59:01.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.092+0000 7f40b55b5700 1 -- 172.21.15.26:0/3346329489 shutdown_connections 2023-10-01T07:59:01.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.092+0000 7f40b55b5700 1 --2- 172.21.15.26:0/3346329489 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40b0131810 0x7f40b011c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:01.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.092+0000 7f40b55b5700 1 --2- 172.21.15.26:0/3346329489 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f40b0099a40 0x7f40b011b690 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:01.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.092+0000 7f40b55b5700 1 --2- 172.21.15.26:0/3346329489 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f40b009a3b0 0x7f40b011bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:01.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.092+0000 7f40b55b5700 1 -- 172.21.15.26:0/3346329489 >> 172.21.15.26:0/3346329489 conn(0x7f40b00a2aa0 msgr2=0x7f40b00a1630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:01.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.092+0000 7f40b55b5700 1 -- 172.21.15.26:0/3346329489 shutdown_connections 2023-10-01T07:59:01.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.092+0000 7f40b55b5700 1 -- 172.21.15.26:0/3346329489 wait complete. 2023-10-01T07:59:01.107 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:01.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.119+0000 7f25f6809700 1 -- 172.21.15.26:0/4151979080 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f25f006b250 con 0x7f25f006c0e0 2023-10-01T07:59:01.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.119+0000 7f25ecff9700 1 -- 172.21.15.26:0/4151979080 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f25e0010310 con 0x7f25f006c0e0 2023-10-01T07:59:01.121 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:01.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.121+0000 7f25f6809700 1 -- 172.21.15.26:0/4151979080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f006c0e0 msgr2=0x7f25f011a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:01.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.121+0000 7f25f6809700 1 --2- 172.21.15.26:0/4151979080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f006c0e0 0x7f25f011a680 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f25e000e810 tx=0x7f25e000eb20 comp rx=0 tx=0).stop 2023-10-01T07:59:01.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.121+0000 7f25f6809700 1 -- 172.21.15.26:0/4151979080 shutdown_connections 2023-10-01T07:59:01.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.121+0000 7f25f6809700 1 --2- 172.21.15.26:0/4151979080 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25f01380f0 0x7f25f011b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:01.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.121+0000 7f25f6809700 1 --2- 172.21.15.26:0/4151979080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f006c0e0 0x7f25f011a680 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:01.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.121+0000 7f25f6809700 1 --2- 172.21.15.26:0/4151979080 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25f0134ec0 0x7f25f011abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:01.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.121+0000 7f25f6809700 1 -- 172.21.15.26:0/4151979080 >> 172.21.15.26:0/4151979080 conn(0x7f25f00a4210 msgr2=0x7f25f00a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:01.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.121+0000 7f25f6809700 1 -- 172.21.15.26:0/4151979080 shutdown_connections 2023-10-01T07:59:01.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.121+0000 7f25f6809700 1 -- 172.21.15.26:0/4151979080 wait complete. 2023-10-01T07:59:01.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:01.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.176+0000 7f6ee0ac8700 1 -- 172.21.15.26:0/3439625144 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6ec0005860 con 0x7f6edc133e30 2023-10-01T07:59:01.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.177+0000 7f6ecaffd700 1 -- 172.21.15.26:0/3439625144 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6ed001b430 con 0x7f6edc133e30 2023-10-01T07:59:01.179 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:01.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.179+0000 7f6ee0ac8700 1 -- 172.21.15.26:0/3439625144 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6edc133e30 msgr2=0x7f6edc1cccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:01.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.179+0000 7f6ee0ac8700 1 --2- 172.21.15.26:0/3439625144 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6edc133e30 0x7f6edc1cccc0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0009c40 tx=0x7f6ed0004750 comp rx=0 tx=0).stop 2023-10-01T07:59:01.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.179+0000 7f6ee0ac8700 1 -- 172.21.15.26:0/3439625144 shutdown_connections 2023-10-01T07:59:01.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.179+0000 7f6ee0ac8700 1 --2- 172.21.15.26:0/3439625144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6edc134260 0x7f6edc1cd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:01.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.179+0000 7f6ee0ac8700 1 --2- 172.21.15.26:0/3439625144 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6edc133420 0x7f6edc1cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:01.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.179+0000 7f6ee0ac8700 1 --2- 172.21.15.26:0/3439625144 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6edc133e30 0x7f6edc1cccc0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:01.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.179+0000 7f6ee0ac8700 1 -- 172.21.15.26:0/3439625144 >> 172.21.15.26:0/3439625144 conn(0x7f6edc0a4210 msgr2=0x7f6edc12fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:01.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.179+0000 7f6ee0ac8700 1 -- 172.21.15.26:0/3439625144 shutdown_connections 2023-10-01T07:59:01.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:01.179+0000 7f6ee0ac8700 1 -- 172.21.15.26:0/3439625144 wait complete. 2023-10-01T07:59:01.194 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:02.058 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:02.109 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:02.137 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:02.195 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:02.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.207+0000 7fec75a27700 1 Processor -- start 2023-10-01T07:59:02.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.207+0000 7fec75a27700 1 -- start start 2023-10-01T07:59:02.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.208+0000 7fec75a27700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fec7009e1d0 0x7fec70138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:02.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.208+0000 7fec75a27700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fec70139170 0x7fec7013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:02.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.208+0000 7fec75a27700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec7009b120 con 0x7fec7009d6f0 2023-10-01T07:59:02.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.208+0000 7fec75a27700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec7006b460 con 0x7fec70139170 2023-10-01T07:59:02.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.208+0000 7fec75a27700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec7009a7e0 con 0x7fec7009e1d0 2023-10-01T07:59:02.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.208+0000 7fec6effd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fec7009d6f0 0x7fec7009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44466/0 (socket says 172.21.15.26:44466) 2023-10-01T07:59:02.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.208+0000 7fec6effd700 1 -- 172.21.15.26:0/1788121968 learned_addr learned my addr 172.21.15.26:0/1788121968 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:59:02.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.208+0000 7fec6f7fe700 1 --2- 172.21.15.26:0/1788121968 >> v2:172.21.15.26:3300/0 conn(0x7fec70139170 0x7fec7013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:02.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.209+0000 7fec6e7fc700 1 --2- 172.21.15.26:0/1788121968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fec7009e1d0 0x7fec70138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:02.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.209+0000 7fec6f7fe700 1 -- 172.21.15.26:0/1788121968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fec7009e1d0 msgr2=0x7fec70138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:02.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.209+0000 7fec6f7fe700 1 --2- 172.21.15.26:0/1788121968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fec7009e1d0 0x7fec70138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.209+0000 7fec6f7fe700 1 -- 172.21.15.26:0/1788121968 >> v1:172.21.15.26:6789/0 conn(0x7fec7009d6f0 legacy=0x7fec7009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:02.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.209+0000 7fec6dffb700 1 -- 172.21.15.26:0/1788121968 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2279459493 0 0) 0x7fec7009b120 con 0x7fec7009d6f0 2023-10-01T07:59:02.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.209+0000 7fec6f7fe700 1 -- 172.21.15.26:0/1788121968 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7009a500 con 0x7fec70139170 2023-10-01T07:59:02.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.209+0000 7fec6f7fe700 1 --2- 172.21.15.26:0/1788121968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec70139170 0x7fec7013b550 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fec68009d90 tx=0x7fec6800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=748cc60f3a0ceec7 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:02.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.209+0000 7fec6dffb700 1 -- 172.21.15.26:0/1788121968 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6800e070 con 0x7fec70139170 2023-10-01T07:59:02.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.209+0000 7fec6dffb700 1 -- 172.21.15.26:0/1788121968 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6800bb20 con 0x7fec70139170 2023-10-01T07:59:02.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.209+0000 7fec6dffb700 1 -- 172.21.15.26:0/1788121968 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec68012430 con 0x7fec70139170 2023-10-01T07:59:02.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.210+0000 7fec75a27700 1 -- 172.21.15.26:0/1788121968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec70139170 msgr2=0x7fec7013b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:02.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.210+0000 7fec75a27700 1 --2- 172.21.15.26:0/1788121968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec70139170 0x7fec7013b550 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fec68009d90 tx=0x7fec6800b330 comp rx=0 tx=0).stop 2023-10-01T07:59:02.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.210+0000 7fec75a27700 1 -- 172.21.15.26:0/1788121968 shutdown_connections 2023-10-01T07:59:02.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.210+0000 7fec75a27700 1 --2- 172.21.15.26:0/1788121968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec70139170 0x7fec7013b550 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.210+0000 7fec75a27700 1 --2- 172.21.15.26:0/1788121968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fec7009e1d0 0x7fec70138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.210+0000 7fec75a27700 1 -- 172.21.15.26:0/1788121968 >> 172.21.15.26:0/1788121968 conn(0x7fec70066f50 msgr2=0x7fec7009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:02.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.210+0000 7fec75a27700 1 -- 172.21.15.26:0/1788121968 shutdown_connections 2023-10-01T07:59:02.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.211+0000 7fec75a27700 1 -- 172.21.15.26:0/1788121968 wait complete. 2023-10-01T07:59:02.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.212+0000 7fec75a27700 1 Processor -- start 2023-10-01T07:59:02.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.212+0000 7fec75a27700 1 -- start start 2023-10-01T07:59:02.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.212+0000 7fec75a27700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fec7009d6f0 0x7fec70121640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:02.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.212+0000 7fec75a27700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fec7009e1d0 0x7fec70121b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:02.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.212+0000 7fec75a27700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec70139170 0x7fec701220c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:02.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.212+0000 7fec75a27700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec701238b0 con 0x7fec70139170 2023-10-01T07:59:02.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.212+0000 7fec75a27700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec70125160 con 0x7fec7009e1d0 2023-10-01T07:59:02.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.212+0000 7fec75a27700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec70072040 con 0x7fec7009d6f0 2023-10-01T07:59:02.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.213+0000 7fec6e7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fec7009e1d0 0x7fec70121b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:02.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.213+0000 7fec6e7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fec7009e1d0 0x7fec70121b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46988/0 (socket says 172.21.15.26:46988) 2023-10-01T07:59:02.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.213+0000 7fec6e7fc700 1 -- 172.21.15.26:0/522796855 learned_addr learned my addr 172.21.15.26:0/522796855 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:02.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.213+0000 7fec6f7fe700 1 --2- 172.21.15.26:0/522796855 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec70139170 0x7fec701220c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:02.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.213+0000 7fec6f7fe700 1 -- 172.21.15.26:0/522796855 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fec7009d6f0 msgr2=0x7fec70121640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:02.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.213+0000 7fec6f7fe700 1 --2- 172.21.15.26:0/522796855 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fec7009d6f0 0x7fec70121640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.213+0000 7fec6f7fe700 1 -- 172.21.15.26:0/522796855 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fec7009e1d0 msgr2=0x7fec70121b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:02.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.213+0000 7fec6f7fe700 1 --2- 172.21.15.26:0/522796855 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fec7009e1d0 0x7fec70121b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.213+0000 7fec6f7fe700 1 -- 172.21.15.26:0/522796855 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec68009a70 con 0x7fec70139170 2023-10-01T07:59:02.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.213+0000 7fec6e7fc700 1 --2- 172.21.15.26:0/522796855 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fec7009e1d0 0x7fec70121b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:02.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.213+0000 7fec6f7fe700 1 --2- 172.21.15.26:0/522796855 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec70139170 0x7fec701220c0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fec68009d90 tx=0x7fec68004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:02.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.214+0000 7fec57fff700 1 -- 172.21.15.26:0/522796855 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec68012430 con 0x7fec70139170 2023-10-01T07:59:02.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.214+0000 7fec75a27700 1 -- 172.21.15.26:0/522796855 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec70123250 con 0x7fec70139170 2023-10-01T07:59:02.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.214+0000 7fec57fff700 1 -- 172.21.15.26:0/522796855 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec68020070 con 0x7fec70139170 2023-10-01T07:59:02.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.214+0000 7fec57fff700 1 -- 172.21.15.26:0/522796855 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec68004280 con 0x7fec70139170 2023-10-01T07:59:02.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.214+0000 7fec75a27700 1 -- 172.21.15.26:0/522796855 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec70123a40 con 0x7fec70139170 2023-10-01T07:59:02.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.216+0000 7fec57fff700 1 -- 172.21.15.26:0/522796855 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fec680043e0 con 0x7fec70139170 2023-10-01T07:59:02.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.216+0000 7fec75a27700 1 -- 172.21.15.26:0/522796855 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec70074ea0 con 0x7fec70139170 2023-10-01T07:59:02.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.216+0000 7fec57fff700 1 -- 172.21.15.26:0/522796855 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fec68022070 con 0x7fec70139170 2023-10-01T07:59:02.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.225+0000 7fec57fff700 1 -- 172.21.15.26:0/522796855 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fec6801ad50 con 0x7fec70139170 2023-10-01T07:59:02.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.272+0000 7f9cfc95d700 1 Processor -- start 2023-10-01T07:59:02.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.272+0000 7f9cfc95d700 1 -- start start 2023-10-01T07:59:02.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.273+0000 7f9cfc95d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9cf806a770 0x7f9cf806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:02.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.273+0000 7f9cfc95d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9cf806b080 0x7f9cf8131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:02.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.273+0000 7f9cfc95d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9cf8131b40 0x7f9cf8131fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:02.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.273+0000 7f9cfc95d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cf809ece0 con 0x7f9cf806b080 2023-10-01T07:59:02.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.273+0000 7f9cfc95d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf809e760 con 0x7f9cf8131b40 2023-10-01T07:59:02.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.273+0000 7f9cfc95d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf809e040 con 0x7f9cf806a770 2023-10-01T07:59:02.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.273+0000 7f9cf6d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9cf8131b40 0x7f9cf8131fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:02.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.273+0000 7f9cf659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9cf806a770 0x7f9cf806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:02.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.273+0000 7f9cf6d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9cf8131b40 0x7f9cf8131fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46998/0 (socket says 172.21.15.26:46998) 2023-10-01T07:59:02.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.273+0000 7f9cf6d9d700 1 -- 172.21.15.26:0/405324617 learned_addr learned my addr 172.21.15.26:0/405324617 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:02.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.273+0000 7f9cf5d9b700 1 --2- 172.21.15.26:0/405324617 >> v2:172.21.15.26:3300/0 conn(0x7f9cf806b080 0x7f9cf8131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:02.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.274+0000 7f9cf6d9d700 1 -- 172.21.15.26:0/405324617 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9cf806a770 msgr2=0x7f9cf806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:02.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.274+0000 7f9cf6d9d700 1 --2- 172.21.15.26:0/405324617 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9cf806a770 0x7f9cf806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.274+0000 7f9cf6d9d700 1 -- 172.21.15.26:0/405324617 >> v2:172.21.15.26:3300/0 conn(0x7f9cf806b080 msgr2=0x7f9cf8131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:02.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.274+0000 7f9cf6d9d700 1 --2- 172.21.15.26:0/405324617 >> v2:172.21.15.26:3300/0 conn(0x7f9cf806b080 0x7f9cf8131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.274+0000 7f9cf6d9d700 1 -- 172.21.15.26:0/405324617 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf809f630 con 0x7f9cf8131b40 2023-10-01T07:59:02.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.274+0000 7f9cf659c700 1 --2- 172.21.15.26:0/405324617 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9cf806a770 0x7f9cf806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:02.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.274+0000 7f9cf6d9d700 1 --2- 172.21.15.26:0/405324617 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9cf8131b40 0x7f9cf8131fc0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0009e50 tx=0x7f9cf000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e36cd64e6f3c77e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:02.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.274+0000 7f9cf559a700 1 -- 172.21.15.26:0/405324617 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf000e070 con 0x7f9cf8131b40 2023-10-01T07:59:02.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.274+0000 7f9cf559a700 1 -- 172.21.15.26:0/405324617 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf000b910 con 0x7f9cf8131b40 2023-10-01T07:59:02.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.274+0000 7f9cf559a700 1 -- 172.21.15.26:0/405324617 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf000bcc0 con 0x7f9cf8131b40 2023-10-01T07:59:02.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.275+0000 7f9cfc95d700 1 -- 172.21.15.26:0/405324617 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9cf8131b40 msgr2=0x7f9cf8131fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:02.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.275+0000 7f9cfc95d700 1 --2- 172.21.15.26:0/405324617 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9cf8131b40 0x7f9cf8131fc0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0009e50 tx=0x7f9cf000b330 comp rx=0 tx=0).stop 2023-10-01T07:59:02.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.275+0000 7f9cfc95d700 1 -- 172.21.15.26:0/405324617 shutdown_connections 2023-10-01T07:59:02.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.275+0000 7f9cfc95d700 1 --2- 172.21.15.26:0/405324617 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9cf8131b40 0x7f9cf8131fc0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.275+0000 7f9cfc95d700 1 --2- 172.21.15.26:0/405324617 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9cf806a770 0x7f9cf806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.275+0000 7f9cfc95d700 1 --2- 172.21.15.26:0/405324617 >> v2:172.21.15.26:3300/0 conn(0x7f9cf806b080 0x7f9cf8131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.275+0000 7f9cfc95d700 1 -- 172.21.15.26:0/405324617 >> 172.21.15.26:0/405324617 conn(0x7f9cf8066f50 msgr2=0x7f9cf809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:02.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.275+0000 7f9cfc95d700 1 -- 172.21.15.26:0/405324617 shutdown_connections 2023-10-01T07:59:02.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.275+0000 7f9cfc95d700 1 -- 172.21.15.26:0/405324617 wait complete. 2023-10-01T07:59:02.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.276+0000 7f9cfc95d700 1 Processor -- start 2023-10-01T07:59:02.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.277+0000 7f9cfc95d700 1 -- start start 2023-10-01T07:59:02.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.277+0000 7f9cfc95d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9cf806a770 0x7f9cf809a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:02.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.277+0000 7f9cfc95d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cf806b080 0x7f9cf809a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:02.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.277+0000 7f9cfc95d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9cf8131b40 0x7f9cf809ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:02.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.277+0000 7f9cfc95d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf809c030 con 0x7f9cf806b080 2023-10-01T07:59:02.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.277+0000 7f9cfc95d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf809b7d0 con 0x7f9cf806a770 2023-10-01T07:59:02.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.277+0000 7f9cfc95d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf81227e0 con 0x7f9cf8131b40 2023-10-01T07:59:02.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.278+0000 7f9cf659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9cf806a770 0x7f9cf809a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:02.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.278+0000 7f9cf6d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9cf8131b40 0x7f9cf809ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:02.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.278+0000 7f9cf659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9cf806a770 0x7f9cf809a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47002/0 (socket says 172.21.15.26:47002) 2023-10-01T07:59:02.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.278+0000 7f9cf659c700 1 -- 172.21.15.26:0/2766456102 learned_addr learned my addr 172.21.15.26:0/2766456102 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:02.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.278+0000 7f9cf5d9b700 1 --2- 172.21.15.26:0/2766456102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cf806b080 0x7f9cf809a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:02.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.278+0000 7f9cf659c700 1 -- 172.21.15.26:0/2766456102 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9cf8131b40 msgr2=0x7f9cf809ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:02.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.278+0000 7f9cf659c700 1 --2- 172.21.15.26:0/2766456102 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9cf8131b40 0x7f9cf809ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.278+0000 7f9cf659c700 1 -- 172.21.15.26:0/2766456102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cf806b080 msgr2=0x7f9cf809a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:02.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.278+0000 7f9cf659c700 1 --2- 172.21.15.26:0/2766456102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cf806b080 0x7f9cf809a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.278+0000 7f9cf659c700 1 -- 172.21.15.26:0/2766456102 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce80094a0 con 0x7f9cf806a770 2023-10-01T07:59:02.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.278+0000 7f9cf5d9b700 1 --2- 172.21.15.26:0/2766456102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cf806b080 0x7f9cf809a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:59:02.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.278+0000 7f9cf659c700 1 --2- 172.21.15.26:0/2766456102 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9cf806a770 0x7f9cf809a400 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f9ce800ebe0 tx=0x7f9ce800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:02.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.278+0000 7f9ce6ffd700 1 -- 172.21.15.26:0/2766456102 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce8009800 con 0x7f9cf806a770 2023-10-01T07:59:02.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.278+0000 7f9ce6ffd700 1 -- 172.21.15.26:0/2766456102 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce800c910 con 0x7f9cf806a770 2023-10-01T07:59:02.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.278+0000 7f9cfc95d700 1 -- 172.21.15.26:0/2766456102 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf0009b30 con 0x7f9cf806a770 2023-10-01T07:59:02.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.279+0000 7f9ce6ffd700 1 -- 172.21.15.26:0/2766456102 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce800cc80 con 0x7f9cf806a770 2023-10-01T07:59:02.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.279+0000 7f9cfc95d700 1 -- 172.21.15.26:0/2766456102 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cf8071e60 con 0x7f9cf806a770 2023-10-01T07:59:02.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.280+0000 7f9ce6ffd700 1 -- 172.21.15.26:0/2766456102 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9ce8013470 con 0x7f9cf806a770 2023-10-01T07:59:02.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.280+0000 7f9ce6ffd700 1 -- 172.21.15.26:0/2766456102 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9ce803f900 con 0x7f9cf806a770 2023-10-01T07:59:02.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.280+0000 7f9cfc95d700 1 -- 172.21.15.26:0/2766456102 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cf8122cc0 con 0x7f9cf806a770 2023-10-01T07:59:02.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.289+0000 7f9ce6ffd700 1 -- 172.21.15.26:0/2766456102 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9cf8122cc0 con 0x7f9cf806a770 2023-10-01T07:59:02.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.298+0000 7f61221e4700 1 Processor -- start 2023-10-01T07:59:02.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.298+0000 7f61221e4700 1 -- start start 2023-10-01T07:59:02.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.299+0000 7f61221e4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f611c09e1d0 0x7f611c138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:02.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.299+0000 7f61221e4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f611c139170 0x7f611c13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:02.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.299+0000 7f61221e4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f611c09b120 con 0x7f611c09d6f0 2023-10-01T07:59:02.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.299+0000 7f61221e4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f611c06b460 con 0x7f611c139170 2023-10-01T07:59:02.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.299+0000 7f61221e4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f611c09a7e0 con 0x7f611c09e1d0 2023-10-01T07:59:02.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.299+0000 7f611affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f611c09e1d0 0x7f611c138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:02.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.299+0000 7f611b7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f611c09d6f0 0x7f611c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44468/0 (socket says 172.21.15.26:44468) 2023-10-01T07:59:02.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.299+0000 7f611b7fe700 1 -- 172.21.15.26:0/4098336728 learned_addr learned my addr 172.21.15.26:0/4098336728 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:59:02.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.299+0000 7f611bfff700 1 --2- 172.21.15.26:0/4098336728 >> v2:172.21.15.26:3300/0 conn(0x7f611c139170 0x7f611c13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:02.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.300+0000 7f611affd700 1 -- 172.21.15.26:0/4098336728 >> v2:172.21.15.26:3300/0 conn(0x7f611c139170 msgr2=0x7f611c13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:02.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.300+0000 7f611a7fc700 1 -- 172.21.15.26:0/4098336728 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987951448 0 0) 0x7f611c09b120 con 0x7f611c09d6f0 2023-10-01T07:59:02.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.300+0000 7f611affd700 1 --2- 172.21.15.26:0/4098336728 >> v2:172.21.15.26:3300/0 conn(0x7f611c139170 0x7f611c13b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.300+0000 7f611affd700 1 -- 172.21.15.26:0/4098336728 >> v1:172.21.15.26:6789/0 conn(0x7f611c09d6f0 legacy=0x7f611c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:02.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.300+0000 7f611affd700 1 -- 172.21.15.26:0/4098336728 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611c09a500 con 0x7f611c09e1d0 2023-10-01T07:59:02.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.300+0000 7f611affd700 1 --2- 172.21.15.26:0/4098336728 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f611c09e1d0 0x7f611c138c30 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f6110009870 tx=0x7f6110009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e790de6991b406a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:02.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.300+0000 7f611a7fc700 1 -- 172.21.15.26:0/4098336728 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6110011830 con 0x7f611c09e1d0 2023-10-01T07:59:02.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.300+0000 7f611a7fc700 1 -- 172.21.15.26:0/4098336728 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6110011990 con 0x7f611c09e1d0 2023-10-01T07:59:02.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.300+0000 7f611a7fc700 1 -- 172.21.15.26:0/4098336728 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6110011d20 con 0x7f611c09e1d0 2023-10-01T07:59:02.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.301+0000 7f61221e4700 1 -- 172.21.15.26:0/4098336728 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f611c09e1d0 msgr2=0x7f611c138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:02.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.301+0000 7f61221e4700 1 --2- 172.21.15.26:0/4098336728 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f611c09e1d0 0x7f611c138c30 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f6110009870 tx=0x7f6110009b80 comp rx=0 tx=0).stop 2023-10-01T07:59:02.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.301+0000 7f61221e4700 1 -- 172.21.15.26:0/4098336728 shutdown_connections 2023-10-01T07:59:02.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.301+0000 7f61221e4700 1 --2- 172.21.15.26:0/4098336728 >> v2:172.21.15.26:3300/0 conn(0x7f611c139170 0x7f611c13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.301+0000 7f61221e4700 1 --2- 172.21.15.26:0/4098336728 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f611c09e1d0 0x7f611c138c30 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.301+0000 7f61221e4700 1 -- 172.21.15.26:0/4098336728 >> 172.21.15.26:0/4098336728 conn(0x7f611c066f50 msgr2=0x7f611c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.301+0000 7f61221e4700 1 -- 172.21.15.26:0/4098336728 shutdown_connections 2023-10-01T07:59:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.301+0000 7f61221e4700 1 -- 172.21.15.26:0/4098336728 wait complete. 2023-10-01T07:59:02.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.302+0000 7f61221e4700 1 Processor -- start 2023-10-01T07:59:02.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.303+0000 7f61221e4700 1 -- start start 2023-10-01T07:59:02.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.303+0000 7f61221e4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f611c09d6f0 0x7f611c1216c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:02.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.303+0000 7f61221e4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f611c09e1d0 0x7f611c121c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:02.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.303+0000 7f61221e4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f611c139170 0x7f611c122140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:02.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.303+0000 7f61221e4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611c123450 con 0x7f611c139170 2023-10-01T07:59:02.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.303+0000 7f61221e4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f611c124cb0 con 0x7f611c09d6f0 2023-10-01T07:59:02.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.303+0000 7f61221e4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f611c123aa0 con 0x7f611c09e1d0 2023-10-01T07:59:02.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.303+0000 7f611affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f611c09e1d0 0x7f611c121c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:02.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.303+0000 7f611affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f611c09e1d0 0x7f611c121c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37648/0 (socket says 172.21.15.26:37648) 2023-10-01T07:59:02.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.303+0000 7f611affd700 1 -- 172.21.15.26:0/2771427123 learned_addr learned my addr 172.21.15.26:0/2771427123 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:02.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.304+0000 7f611bfff700 1 --2- 172.21.15.26:0/2771427123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f611c139170 0x7f611c122140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:02.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.304+0000 7f611b7fe700 1 --2- 172.21.15.26:0/2771427123 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f611c09d6f0 0x7f611c1216c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:02.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.304+0000 7f611affd700 1 -- 172.21.15.26:0/2771427123 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f611c09d6f0 msgr2=0x7f611c1216c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:02.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.304+0000 7f611affd700 1 --2- 172.21.15.26:0/2771427123 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f611c09d6f0 0x7f611c1216c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.304+0000 7f611affd700 1 -- 172.21.15.26:0/2771427123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f611c139170 msgr2=0x7f611c122140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:02.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.304+0000 7f611affd700 1 --2- 172.21.15.26:0/2771427123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f611c139170 0x7f611c122140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.304+0000 7f611affd700 1 -- 172.21.15.26:0/2771427123 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61100094a0 con 0x7f611c09e1d0 2023-10-01T07:59:02.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.304+0000 7f611bfff700 1 --2- 172.21.15.26:0/2771427123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f611c139170 0x7f611c122140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:59:02.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.304+0000 7f611affd700 1 --2- 172.21.15.26:0/2771427123 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f611c09e1d0 0x7f611c121c00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f61100090b0 tx=0x7f6110004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:02.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.304+0000 7f6103fff700 1 -- 172.21.15.26:0/2771427123 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61100036a0 con 0x7f611c09e1d0 2023-10-01T07:59:02.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.305+0000 7f6103fff700 1 -- 172.21.15.26:0/2771427123 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611001f070 con 0x7f611c09e1d0 2023-10-01T07:59:02.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.305+0000 7f6103fff700 1 -- 172.21.15.26:0/2771427123 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6110003a00 con 0x7f611c09e1d0 2023-10-01T07:59:02.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.305+0000 7f61221e4700 1 -- 172.21.15.26:0/2771427123 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f611c124520 con 0x7f611c09e1d0 2023-10-01T07:59:02.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.305+0000 7f61221e4700 1 -- 172.21.15.26:0/2771427123 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f611c125900 con 0x7f611c09e1d0 2023-10-01T07:59:02.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.306+0000 7f6103fff700 1 -- 172.21.15.26:0/2771427123 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6110003b60 con 0x7f611c09e1d0 2023-10-01T07:59:02.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.306+0000 7f61221e4700 1 -- 172.21.15.26:0/2771427123 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f611c124df0 con 0x7f611c09e1d0 2023-10-01T07:59:02.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.306+0000 7f6103fff700 1 -- 172.21.15.26:0/2771427123 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6110021070 con 0x7f611c09e1d0 2023-10-01T07:59:02.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.315+0000 7f6103fff700 1 -- 172.21.15.26:0/2771427123 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f611c124df0 con 0x7f611c09e1d0 2023-10-01T07:59:02.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.347+0000 7fc190aa3700 1 Processor -- start 2023-10-01T07:59:02.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.347+0000 7fc190aa3700 1 -- start start 2023-10-01T07:59:02.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.348+0000 7fc190aa3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc18c0a0a30 0x7fc18c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:02.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.348+0000 7fc190aa3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc18c09d630 0x7fc18c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:02.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.348+0000 7fc190aa3700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc18c0a2a70 con 0x7fc18c133930 2023-10-01T07:59:02.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.348+0000 7fc190aa3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc18c0a01d0 con 0x7fc18c09d630 2023-10-01T07:59:02.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.348+0000 7fc190aa3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c09e2b0 con 0x7fc18c0a0a30 2023-10-01T07:59:02.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.348+0000 7fc18a59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc18c0a0a30 0x7fc18c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:02.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.348+0000 7fc18a59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc18c0a0a30 0x7fc18c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37656/0 (socket says 172.21.15.26:37656) 2023-10-01T07:59:02.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.348+0000 7fc18a59c700 1 -- 172.21.15.26:0/1082303102 learned_addr learned my addr 172.21.15.26:0/1082303102 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:02.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.348+0000 7fc18ad9d700 1 --1- 172.21.15.26:0/1082303102 >> v1:172.21.15.26:6789/0 conn(0x7fc18c133930 0x7fc18c133db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44482/0 (socket says 172.21.15.26:44482) 2023-10-01T07:59:02.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.348+0000 7fc189d9b700 1 --2- 172.21.15.26:0/1082303102 >> v2:172.21.15.26:3300/0 conn(0x7fc18c09d630 0x7fc18c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:02.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.348+0000 7fc18a59c700 1 -- 172.21.15.26:0/1082303102 >> v2:172.21.15.26:3300/0 conn(0x7fc18c09d630 msgr2=0x7fc18c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:02.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.348+0000 7fc18a59c700 1 --2- 172.21.15.26:0/1082303102 >> v2:172.21.15.26:3300/0 conn(0x7fc18c09d630 0x7fc18c0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.348+0000 7fc18a59c700 1 -- 172.21.15.26:0/1082303102 >> v1:172.21.15.26:6789/0 conn(0x7fc18c133930 legacy=0x7fc18c133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:02.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.348+0000 7fc18a59c700 1 -- 172.21.15.26:0/1082303102 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18c09dc50 con 0x7fc18c0a0a30 2023-10-01T07:59:02.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.349+0000 7fc18a59c700 1 --2- 172.21.15.26:0/1082303102 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc18c0a0a30 0x7fc18c0a0e00 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fc17c0098f0 tx=0x7fc17c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9f86ae840865a99 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:02.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.349+0000 7fc18959a700 1 -- 172.21.15.26:0/1082303102 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c011830 con 0x7fc18c0a0a30 2023-10-01T07:59:02.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.349+0000 7fc18959a700 1 -- 172.21.15.26:0/1082303102 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17c011990 con 0x7fc18c0a0a30 2023-10-01T07:59:02.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.349+0000 7fc18959a700 1 -- 172.21.15.26:0/1082303102 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c011d20 con 0x7fc18c0a0a30 2023-10-01T07:59:02.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.349+0000 7fc190aa3700 1 -- 172.21.15.26:0/1082303102 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc18c0a0a30 msgr2=0x7fc18c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:02.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.349+0000 7fc190aa3700 1 --2- 172.21.15.26:0/1082303102 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc18c0a0a30 0x7fc18c0a0e00 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fc17c0098f0 tx=0x7fc17c009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:02.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.350+0000 7fc190aa3700 1 -- 172.21.15.26:0/1082303102 shutdown_connections 2023-10-01T07:59:02.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.350+0000 7fc190aa3700 1 --2- 172.21.15.26:0/1082303102 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc18c0a0a30 0x7fc18c0a0e00 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.350+0000 7fc190aa3700 1 --2- 172.21.15.26:0/1082303102 >> v2:172.21.15.26:3300/0 conn(0x7fc18c09d630 0x7fc18c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.350+0000 7fc190aa3700 1 -- 172.21.15.26:0/1082303102 >> 172.21.15.26:0/1082303102 conn(0x7fc18c0a3050 msgr2=0x7fc18c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:02.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.350+0000 7fc190aa3700 1 -- 172.21.15.26:0/1082303102 shutdown_connections 2023-10-01T07:59:02.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.350+0000 7fc190aa3700 1 -- 172.21.15.26:0/1082303102 wait complete. 2023-10-01T07:59:02.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.351+0000 7fc190aa3700 1 Processor -- start 2023-10-01T07:59:02.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.351+0000 7fc190aa3700 1 -- start start 2023-10-01T07:59:02.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.351+0000 7fc190aa3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc18c09d630 0x7fc18c121290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:02.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.351+0000 7fc190aa3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc18c0a0a30 0x7fc18c1217d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:02.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.352+0000 7fc190aa3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc18c133930 0x7fc18c121d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:02.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.352+0000 7fc190aa3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c122dc0 con 0x7fc18c0a0a30 2023-10-01T07:59:02.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.352+0000 7fc190aa3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c123c50 con 0x7fc18c133930 2023-10-01T07:59:02.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.352+0000 7fc190aa3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c124730 con 0x7fc18c09d630 2023-10-01T07:59:02.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.352+0000 7fc18a59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc18c09d630 0x7fc18c121290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:02.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.352+0000 7fc18a59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc18c09d630 0x7fc18c121290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37668/0 (socket says 172.21.15.26:37668) 2023-10-01T07:59:02.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.352+0000 7fc18a59c700 1 -- 172.21.15.26:0/3362448245 learned_addr learned my addr 172.21.15.26:0/3362448245 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:02.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.352+0000 7fc18ad9d700 1 --2- 172.21.15.26:0/3362448245 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc18c133930 0x7fc18c121d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:02.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.352+0000 7fc189d9b700 1 --2- 172.21.15.26:0/3362448245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc18c0a0a30 0x7fc18c1217d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:02.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.352+0000 7fc18a59c700 1 -- 172.21.15.26:0/3362448245 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc18c133930 msgr2=0x7fc18c121d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:02.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.352+0000 7fc18a59c700 1 --2- 172.21.15.26:0/3362448245 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc18c133930 0x7fc18c121d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.352+0000 7fc18a59c700 1 -- 172.21.15.26:0/3362448245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc18c0a0a30 msgr2=0x7fc18c1217d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:02.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.352+0000 7fc18a59c700 1 --2- 172.21.15.26:0/3362448245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc18c0a0a30 0x7fc18c1217d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.352+0000 7fc18a59c700 1 -- 172.21.15.26:0/3362448245 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17c009550 con 0x7fc18c09d630 2023-10-01T07:59:02.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.352+0000 7fc18ad9d700 1 --2- 172.21.15.26:0/3362448245 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc18c133930 0x7fc18c121d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:59:02.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.352+0000 7fc18a59c700 1 --2- 172.21.15.26:0/3362448245 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc18c09d630 0x7fc18c121290 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fc17c000c00 tx=0x7fc17c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:02.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.352+0000 7fc17affd700 1 -- 172.21.15.26:0/3362448245 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c004570 con 0x7fc18c09d630 2023-10-01T07:59:02.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.353+0000 7fc17affd700 1 -- 172.21.15.26:0/3362448245 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17c01f070 con 0x7fc18c09d630 2023-10-01T07:59:02.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.353+0000 7fc17affd700 1 -- 172.21.15.26:0/3362448245 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c0038c0 con 0x7fc18c09d630 2023-10-01T07:59:02.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.353+0000 7fc190aa3700 1 -- 172.21.15.26:0/3362448245 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc18c1249f0 con 0x7fc18c09d630 2023-10-01T07:59:02.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.353+0000 7fc190aa3700 1 -- 172.21.15.26:0/3362448245 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc18c0a5130 con 0x7fc18c09d630 2023-10-01T07:59:02.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.354+0000 7fc17affd700 1 -- 172.21.15.26:0/3362448245 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc17c021030 con 0x7fc18c09d630 2023-10-01T07:59:02.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.354+0000 7fc190aa3700 1 -- 172.21.15.26:0/3362448245 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc18c124580 con 0x7fc18c09d630 2023-10-01T07:59:02.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.355+0000 7fc17affd700 1 -- 172.21.15.26:0/3362448245 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc17c040b20 con 0x7fc18c09d630 2023-10-01T07:59:02.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.359+0000 7fc17affd700 1 -- 172.21.15.26:0/3362448245 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc17c01a450 con 0x7fc18c09d630 2023-10-01T07:59:02.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.510+0000 7fec75a27700 1 -- 172.21.15.26:0/522796855 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fec7006c360 con 0x7fec70139170 2023-10-01T07:59:02.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.510+0000 7fec57fff700 1 -- 172.21.15.26:0/522796855 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fec6801ab70 con 0x7fec70139170 2023-10-01T07:59:02.512 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:02.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.512+0000 7fec75a27700 1 -- 172.21.15.26:0/522796855 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec70139170 msgr2=0x7fec701220c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:02.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.512+0000 7fec75a27700 1 --2- 172.21.15.26:0/522796855 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec70139170 0x7fec701220c0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fec68009d90 tx=0x7fec68004ad0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.512+0000 7fec75a27700 1 -- 172.21.15.26:0/522796855 shutdown_connections 2023-10-01T07:59:02.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.512+0000 7fec75a27700 1 --2- 172.21.15.26:0/522796855 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec70139170 0x7fec701220c0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.512+0000 7fec75a27700 1 --2- 172.21.15.26:0/522796855 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fec7009d6f0 0x7fec70121640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.512+0000 7fec75a27700 1 --2- 172.21.15.26:0/522796855 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fec7009e1d0 0x7fec70121b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.512+0000 7fec75a27700 1 -- 172.21.15.26:0/522796855 >> 172.21.15.26:0/522796855 conn(0x7fec70066f50 msgr2=0x7fec70070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:02.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.513+0000 7fec75a27700 1 -- 172.21.15.26:0/522796855 shutdown_connections 2023-10-01T07:59:02.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.513+0000 7fec75a27700 1 -- 172.21.15.26:0/522796855 wait complete. 2023-10-01T07:59:02.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.523+0000 7f61221e4700 1 -- 172.21.15.26:0/2771427123 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f611c124df0 con 0x7f611c09e1d0 2023-10-01T07:59:02.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.524+0000 7f6103fff700 1 -- 172.21.15.26:0/2771427123 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f611c124df0 con 0x7f611c09e1d0 2023-10-01T07:59:02.525 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:02.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.526+0000 7f61221e4700 1 -- 172.21.15.26:0/2771427123 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f611c09e1d0 msgr2=0x7f611c121c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:02.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.526+0000 7f61221e4700 1 --2- 172.21.15.26:0/2771427123 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f611c09e1d0 0x7f611c121c00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f61100090b0 tx=0x7f6110004750 comp rx=0 tx=0).stop 2023-10-01T07:59:02.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.527+0000 7f61221e4700 1 -- 172.21.15.26:0/2771427123 shutdown_connections 2023-10-01T07:59:02.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.527+0000 7f61221e4700 1 --2- 172.21.15.26:0/2771427123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f611c139170 0x7f611c122140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.527+0000 7f61221e4700 1 --2- 172.21.15.26:0/2771427123 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f611c09d6f0 0x7f611c1216c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.527+0000 7f61221e4700 1 --2- 172.21.15.26:0/2771427123 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f611c09e1d0 0x7f611c121c00 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.527+0000 7f61221e4700 1 -- 172.21.15.26:0/2771427123 >> 172.21.15.26:0/2771427123 conn(0x7f611c066f50 msgr2=0x7f611c070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:02.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.527+0000 7f61221e4700 1 -- 172.21.15.26:0/2771427123 shutdown_connections 2023-10-01T07:59:02.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.527+0000 7f61221e4700 1 -- 172.21.15.26:0/2771427123 wait complete. 2023-10-01T07:59:02.529 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:02.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:02.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.557+0000 7f9cfc95d700 1 -- 172.21.15.26:0/2766456102 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9cf8122cc0 con 0x7f9cf806a770 2023-10-01T07:59:02.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.557+0000 7f9ce6ffd700 1 -- 172.21.15.26:0/2766456102 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9cf8122cc0 con 0x7f9cf806a770 2023-10-01T07:59:02.559 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:02.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.560+0000 7f9cfc95d700 1 -- 172.21.15.26:0/2766456102 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9cf806a770 msgr2=0x7f9cf809a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:02.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.560+0000 7f9cfc95d700 1 --2- 172.21.15.26:0/2766456102 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9cf806a770 0x7f9cf809a400 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f9ce800ebe0 tx=0x7f9ce800eef0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.560+0000 7f9cfc95d700 1 -- 172.21.15.26:0/2766456102 shutdown_connections 2023-10-01T07:59:02.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.560+0000 7f9cfc95d700 1 --2- 172.21.15.26:0/2766456102 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9cf8131b40 0x7f9cf809ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.560+0000 7f9cfc95d700 1 --2- 172.21.15.26:0/2766456102 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9cf806a770 0x7f9cf809a400 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.560+0000 7f9cfc95d700 1 --2- 172.21.15.26:0/2766456102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cf806b080 0x7f9cf809a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.560+0000 7f9cfc95d700 1 -- 172.21.15.26:0/2766456102 >> 172.21.15.26:0/2766456102 conn(0x7f9cf8066f50 msgr2=0x7f9cf80a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:02.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.560+0000 7f9cfc95d700 1 -- 172.21.15.26:0/2766456102 shutdown_connections 2023-10-01T07:59:02.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.560+0000 7f9cfc95d700 1 -- 172.21.15.26:0/2766456102 wait complete. 2023-10-01T07:59:02.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.568+0000 7fc190aa3700 1 -- 172.21.15.26:0/3362448245 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc18c11df60 con 0x7fc18c09d630 2023-10-01T07:59:02.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.568+0000 7fc17affd700 1 -- 172.21.15.26:0/3362448245 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc17c015020 con 0x7fc18c09d630 2023-10-01T07:59:02.570 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:02.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.570+0000 7fc190aa3700 1 -- 172.21.15.26:0/3362448245 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc18c09d630 msgr2=0x7fc18c121290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:02.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.570+0000 7fc190aa3700 1 --2- 172.21.15.26:0/3362448245 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc18c09d630 0x7fc18c121290 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fc17c000c00 tx=0x7fc17c004750 comp rx=0 tx=0).stop 2023-10-01T07:59:02.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.570+0000 7fc190aa3700 1 -- 172.21.15.26:0/3362448245 shutdown_connections 2023-10-01T07:59:02.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.570+0000 7fc190aa3700 1 --2- 172.21.15.26:0/3362448245 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc18c133930 0x7fc18c121d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.570+0000 7fc190aa3700 1 --2- 172.21.15.26:0/3362448245 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc18c09d630 0x7fc18c121290 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.570+0000 7fc190aa3700 1 --2- 172.21.15.26:0/3362448245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc18c0a0a30 0x7fc18c1217d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:02.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.570+0000 7fc190aa3700 1 -- 172.21.15.26:0/3362448245 >> 172.21.15.26:0/3362448245 conn(0x7fc18c0a3050 msgr2=0x7fc18c1331a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:02.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.570+0000 7fc190aa3700 1 -- 172.21.15.26:0/3362448245 shutdown_connections 2023-10-01T07:59:02.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:02.570+0000 7fc190aa3700 1 -- 172.21.15.26:0/3362448245 wait complete. 2023-10-01T07:59:02.576 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:02.586 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:03.531 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:03.543 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:03.576 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:03.587 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:03.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.697+0000 7f763749c700 1 Processor -- start 2023-10-01T07:59:03.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.698+0000 7f763749c700 1 -- start start 2023-10-01T07:59:03.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.698+0000 7f763749c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f763009d6f0 0x7f763009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:03.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.698+0000 7f763749c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f763009e000 0x7f76301339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:03.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.698+0000 7f763749c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f763009b120 con 0x7f763009e410 2023-10-01T07:59:03.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.698+0000 7f763749c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f763006b460 con 0x7f763009e000 2023-10-01T07:59:03.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.698+0000 7f763749c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f763009a7e0 con 0x7f763009d6f0 2023-10-01T07:59:03.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.699+0000 7f7635238700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f763009d6f0 0x7f763009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:03.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.699+0000 7f7634a37700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f763009e000 0x7f76301339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:03.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.699+0000 7f7635238700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f763009d6f0 0x7f763009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59616/0 (socket says 172.21.15.26:59616) 2023-10-01T07:59:03.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.699+0000 7f7635238700 1 -- 172.21.15.26:0/1925959823 learned_addr learned my addr 172.21.15.26:0/1925959823 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:03.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.699+0000 7f7634a37700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f763009e000 0x7f76301339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35618/0 (socket says 172.21.15.26:35618) 2023-10-01T07:59:03.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.699+0000 7f7635238700 1 -- 172.21.15.26:0/1925959823 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f763009e000 msgr2=0x7f76301339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:03.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.699+0000 7f7635238700 1 --2- 172.21.15.26:0/1925959823 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f763009e000 0x7f76301339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:03.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.699+0000 7f7635238700 1 -- 172.21.15.26:0/1925959823 >> v1:172.21.15.26:6789/0 conn(0x7f763009e410 legacy=0x7f7630133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:03.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.699+0000 7f7635238700 1 -- 172.21.15.26:0/1925959823 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763009a500 con 0x7f763009d6f0 2023-10-01T07:59:03.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.699+0000 7f7627fff700 1 -- 172.21.15.26:0/1925959823 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1871918605 0 0) 0x7f763009b120 con 0x7f763009e410 2023-10-01T07:59:03.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.699+0000 7f7634a37700 1 --2- 172.21.15.26:0/1925959823 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f763009e000 0x7f76301339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:03.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.699+0000 7f7635238700 1 --2- 172.21.15.26:0/1925959823 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f763009d6f0 0x7f763009dac0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f762c009950 tx=0x7f762c009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad5375034f035c7e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:03.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.700+0000 7f7627fff700 1 -- 172.21.15.26:0/1925959823 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c011830 con 0x7f763009d6f0 2023-10-01T07:59:03.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.700+0000 7f7627fff700 1 -- 172.21.15.26:0/1925959823 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762c011990 con 0x7f763009d6f0 2023-10-01T07:59:03.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.700+0000 7f7627fff700 1 -- 172.21.15.26:0/1925959823 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c011d40 con 0x7f763009d6f0 2023-10-01T07:59:03.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.701+0000 7f763749c700 1 -- 172.21.15.26:0/1925959823 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f763009d6f0 msgr2=0x7f763009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:03.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.701+0000 7f763749c700 1 --2- 172.21.15.26:0/1925959823 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f763009d6f0 0x7f763009dac0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f762c009950 tx=0x7f762c009c60 comp rx=0 tx=0).stop 2023-10-01T07:59:03.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.701+0000 7f763749c700 1 -- 172.21.15.26:0/1925959823 shutdown_connections 2023-10-01T07:59:03.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.701+0000 7f763749c700 1 --2- 172.21.15.26:0/1925959823 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f763009d6f0 0x7f763009dac0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:03.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.701+0000 7f763749c700 1 --2- 172.21.15.26:0/1925959823 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f763009e000 0x7f76301339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:03.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.701+0000 7f763749c700 1 -- 172.21.15.26:0/1925959823 >> 172.21.15.26:0/1925959823 conn(0x7f7630066f50 msgr2=0x7f763009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:03.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.701+0000 7f763749c700 1 -- 172.21.15.26:0/1925959823 shutdown_connections 2023-10-01T07:59:03.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.701+0000 7f763749c700 1 -- 172.21.15.26:0/1925959823 wait complete. 2023-10-01T07:59:03.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.703+0000 7f763749c700 1 Processor -- start 2023-10-01T07:59:03.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.703+0000 7f763749c700 1 -- start start 2023-10-01T07:59:03.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.703+0000 7f763749c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f763009d6f0 0x7f76301c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:03.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.703+0000 7f763749c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f763009e000 0x7f76301c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:03.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.703+0000 7f763749c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f763009e410 0x7f76301c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:03.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.703+0000 7f763749c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76301a6e60 con 0x7f763009d6f0 2023-10-01T07:59:03.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.703+0000 7f763749c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76301a6710 con 0x7f763009e410 2023-10-01T07:59:03.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.703+0000 7f763749c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76301a7510 con 0x7f763009e000 2023-10-01T07:59:03.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.704+0000 7f7635238700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f763009d6f0 0x7f76301c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:03.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.704+0000 7f7635238700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f763009d6f0 0x7f76301c8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39542/0 (socket says 172.21.15.26:39542) 2023-10-01T07:59:03.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.704+0000 7f7635238700 1 -- 172.21.15.26:0/429633849 learned_addr learned my addr 172.21.15.26:0/429633849 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:03.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.704+0000 7f7635a39700 1 --2- 172.21.15.26:0/429633849 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f763009e410 0x7f76301c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:03.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.704+0000 7f7635238700 1 -- 172.21.15.26:0/429633849 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f763009e000 msgr2=0x7f76301c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:03.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.704+0000 7f7635238700 1 --2- 172.21.15.26:0/429633849 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f763009e000 0x7f76301c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:03.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.704+0000 7f7635238700 1 -- 172.21.15.26:0/429633849 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f763009e410 msgr2=0x7f76301c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:03.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.704+0000 7f7635238700 1 --2- 172.21.15.26:0/429633849 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f763009e410 0x7f76301c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:03.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.704+0000 7f7635238700 1 -- 172.21.15.26:0/429633849 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76200094a0 con 0x7f763009d6f0 2023-10-01T07:59:03.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.704+0000 7f7635a39700 1 --2- 172.21.15.26:0/429633849 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f763009e410 0x7f76301c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:03.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.704+0000 7f7635238700 1 --2- 172.21.15.26:0/429633849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f763009d6f0 0x7f76301c8250 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f763009a970 tx=0x7f762c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:03.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.705+0000 7f7625ffb700 1 -- 172.21.15.26:0/429633849 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c01a840 con 0x7f763009d6f0 2023-10-01T07:59:03.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.705+0000 7f7625ffb700 1 -- 172.21.15.26:0/429633849 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762c01f070 con 0x7f763009d6f0 2023-10-01T07:59:03.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.705+0000 7f763749c700 1 -- 172.21.15.26:0/429633849 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f762c009550 con 0x7f763009d6f0 2023-10-01T07:59:03.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.705+0000 7f7625ffb700 1 -- 172.21.15.26:0/429633849 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c01abe0 con 0x7f763009d6f0 2023-10-01T07:59:03.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.705+0000 7f763749c700 1 -- 172.21.15.26:0/429633849 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f763009c760 con 0x7f763009d6f0 2023-10-01T07:59:03.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.706+0000 7f7625ffb700 1 -- 172.21.15.26:0/429633849 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f762c01ad40 con 0x7f763009d6f0 2023-10-01T07:59:03.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.706+0000 7f763749c700 1 -- 172.21.15.26:0/429633849 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76301b94f0 con 0x7f763009d6f0 2023-10-01T07:59:03.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.706+0000 7f7625ffb700 1 -- 172.21.15.26:0/429633849 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f762c021070 con 0x7f763009d6f0 2023-10-01T07:59:03.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.715+0000 7f7625ffb700 1 -- 172.21.15.26:0/429633849 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f76301b94f0 con 0x7f763009d6f0 2023-10-01T07:59:03.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.728+0000 7f0aeab0e700 1 Processor -- start 2023-10-01T07:59:03.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.728+0000 7f0aeab0e700 1 -- start start 2023-10-01T07:59:03.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.729+0000 7f0aeab0e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ae41338a0 0x7f0ae4133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:03.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.729+0000 7f0aeab0e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ae409e930 0x7f0ae413b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:03.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.729+0000 7f0aeab0e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ae406ef30 con 0x7f0ae409de50 2023-10-01T07:59:03.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.729+0000 7f0aeab0e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae406fef0 con 0x7f0ae41338a0 2023-10-01T07:59:03.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.729+0000 7f0aeab0e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae41334b0 con 0x7f0ae409e930 2023-10-01T07:59:03.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.729+0000 7f0ae88aa700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ae41338a0 0x7f0ae4133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:03.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.729+0000 7f0ae88aa700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ae41338a0 0x7f0ae4133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35636/0 (socket says 172.21.15.26:35636) 2023-10-01T07:59:03.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.729+0000 7f0ae88aa700 1 -- 172.21.15.26:0/1213417071 learned_addr learned my addr 172.21.15.26:0/1213417071 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:03.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.729+0000 7f0ae90ab700 1 --2- 172.21.15.26:0/1213417071 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ae409e930 0x7f0ae413b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:03.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.730+0000 7f0ae88aa700 1 -- 172.21.15.26:0/1213417071 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ae409e930 msgr2=0x7f0ae413b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:03.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.730+0000 7f0ae88aa700 1 --2- 172.21.15.26:0/1213417071 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ae409e930 0x7f0ae413b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:03.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.730+0000 7f0ae88aa700 1 -- 172.21.15.26:0/1213417071 >> v1:172.21.15.26:6789/0 conn(0x7f0ae409de50 legacy=0x7f0ae409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:03.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.730+0000 7f0ae88aa700 1 -- 172.21.15.26:0/1213417071 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae406fc30 con 0x7f0ae41338a0 2023-10-01T07:59:03.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.730+0000 7f0ae88aa700 1 --2- 172.21.15.26:0/1213417071 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ae41338a0 0x7f0ae4133c70 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0ad8009920 tx=0x7f0ad8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d490e8979904897 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:03.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.730+0000 7f0ae37fe700 1 -- 172.21.15.26:0/1213417071 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad8011830 con 0x7f0ae41338a0 2023-10-01T07:59:03.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.730+0000 7f0ae37fe700 1 -- 172.21.15.26:0/1213417071 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad8011990 con 0x7f0ae41338a0 2023-10-01T07:59:03.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.730+0000 7f0ae37fe700 1 -- 172.21.15.26:0/1213417071 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad8011d20 con 0x7f0ae41338a0 2023-10-01T07:59:03.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.731+0000 7f0aeab0e700 1 -- 172.21.15.26:0/1213417071 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ae41338a0 msgr2=0x7f0ae4133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:03.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.731+0000 7f0aeab0e700 1 --2- 172.21.15.26:0/1213417071 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ae41338a0 0x7f0ae4133c70 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0ad8009920 tx=0x7f0ad8009c30 comp rx=0 tx=0).stop 2023-10-01T07:59:03.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.731+0000 7f0aeab0e700 1 -- 172.21.15.26:0/1213417071 shutdown_connections 2023-10-01T07:59:03.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.731+0000 7f0aeab0e700 1 --2- 172.21.15.26:0/1213417071 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ae409e930 0x7f0ae413b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:03.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.731+0000 7f0aeab0e700 1 --2- 172.21.15.26:0/1213417071 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ae41338a0 0x7f0ae4133c70 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:03.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.731+0000 7f0aeab0e700 1 -- 172.21.15.26:0/1213417071 >> 172.21.15.26:0/1213417071 conn(0x7f0ae40a2aa0 msgr2=0x7f0ae40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:03.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.731+0000 7f0aeab0e700 1 -- 172.21.15.26:0/1213417071 shutdown_connections 2023-10-01T07:59:03.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.731+0000 7f0aeab0e700 1 -- 172.21.15.26:0/1213417071 wait complete. 2023-10-01T07:59:03.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.732+0000 7f0aeab0e700 1 Processor -- start 2023-10-01T07:59:03.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.732+0000 7f0aeab0e700 1 -- start start 2023-10-01T07:59:03.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.733+0000 7f0aeab0e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ae409de50 0x7f0ae411da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:03.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.733+0000 7f0aeab0e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ae409e930 0x7f0ae411df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:03.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.733+0000 7f0aeab0e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ae41338a0 0x7f0ae411e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:03.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.733+0000 7f0aeab0e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae411fac0 con 0x7f0ae409de50 2023-10-01T07:59:03.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.733+0000 7f0aeab0e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae40a1040 con 0x7f0ae409e930 2023-10-01T07:59:03.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.733+0000 7f0aeab0e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae4130cc0 con 0x7f0ae41338a0 2023-10-01T07:59:03.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.733+0000 7f0ae3fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ae409e930 0x7f0ae411df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:03.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.733+0000 7f0ae3fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ae409e930 0x7f0ae411df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35646/0 (socket says 172.21.15.26:35646) 2023-10-01T07:59:03.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.733+0000 7f0ae3fff700 1 -- 172.21.15.26:0/2291449494 learned_addr learned my addr 172.21.15.26:0/2291449494 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:03.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.733+0000 7f0ae88aa700 1 --2- 172.21.15.26:0/2291449494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ae409de50 0x7f0ae411da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:03.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.734+0000 7f0ae3fff700 1 -- 172.21.15.26:0/2291449494 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ae41338a0 msgr2=0x7f0ae411e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:03.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.734+0000 7f0ae3fff700 1 --2- 172.21.15.26:0/2291449494 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ae41338a0 0x7f0ae411e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:03.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.734+0000 7f0ae3fff700 1 -- 172.21.15.26:0/2291449494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ae409de50 msgr2=0x7f0ae411da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:03.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.734+0000 7f0ae3fff700 1 --2- 172.21.15.26:0/2291449494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ae409de50 0x7f0ae411da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:03.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.734+0000 7f0ae3fff700 1 -- 172.21.15.26:0/2291449494 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad8009550 con 0x7f0ae409e930 2023-10-01T07:59:03.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.734+0000 7f0ae3fff700 1 --2- 172.21.15.26:0/2291449494 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ae409e930 0x7f0ae411df70 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0ad000c3a0 tx=0x7f0ad000c6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:03.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.734+0000 7f0ae17fa700 1 -- 172.21.15.26:0/2291449494 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad00052d0 con 0x7f0ae409e930 2023-10-01T07:59:03.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.734+0000 7f0ae17fa700 1 -- 172.21.15.26:0/2291449494 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad0005430 con 0x7f0ae409e930 2023-10-01T07:59:03.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.734+0000 7f0aeab0e700 1 -- 172.21.15.26:0/2291449494 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae4121450 con 0x7f0ae409e930 2023-10-01T07:59:03.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.734+0000 7f0ae17fa700 1 -- 172.21.15.26:0/2291449494 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad00038c0 con 0x7f0ae409e930 2023-10-01T07:59:03.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.734+0000 7f0aeab0e700 1 -- 172.21.15.26:0/2291449494 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae406f690 con 0x7f0ae409e930 2023-10-01T07:59:03.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.736+0000 7f0ae17fa700 1 -- 172.21.15.26:0/2291449494 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0ad0003a20 con 0x7f0ae409e930 2023-10-01T07:59:03.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.736+0000 7f0ae17fa700 1 -- 172.21.15.26:0/2291449494 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0ad003eb20 con 0x7f0ae409e930 2023-10-01T07:59:03.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.736+0000 7f0aeab0e700 1 -- 172.21.15.26:0/2291449494 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae411a470 con 0x7f0ae409e930 2023-10-01T07:59:03.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.741+0000 7f0ae17fa700 1 -- 172.21.15.26:0/2291449494 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0ad0017070 con 0x7f0ae409e930 2023-10-01T07:59:03.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.747+0000 7f8b7dcfc700 1 Processor -- start 2023-10-01T07:59:03.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.747+0000 7f8b7dcfc700 1 -- start start 2023-10-01T07:59:03.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.747+0000 7f8b7dcfc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b7806a770 0x7f8b7809d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:03.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.747+0000 7f8b7dcfc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b7809dc30 0x7f8b7809e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:03.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.747+0000 7f8b7dcfc700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b7809a810 con 0x7f8b7813c1e0 2023-10-01T07:59:03.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.747+0000 7f8b7dcfc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7806ab40 con 0x7f8b7806a770 2023-10-01T07:59:03.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.747+0000 7f8b7dcfc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7809ebc0 con 0x7f8b7809dc30 2023-10-01T07:59:03.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.747+0000 7f8b777fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b7806a770 0x7f8b7809d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:03.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.747+0000 7f8b777fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b7806a770 0x7f8b7809d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35654/0 (socket says 172.21.15.26:35654) 2023-10-01T07:59:03.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.747+0000 7f8b777fe700 1 -- 172.21.15.26:0/1517861277 learned_addr learned my addr 172.21.15.26:0/1517861277 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:03.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.748+0000 7f8b76ffd700 1 --2- 172.21.15.26:0/1517861277 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b7809dc30 0x7f8b7809e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:03.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.748+0000 7f8b777fe700 1 -- 172.21.15.26:0/1517861277 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b7809dc30 msgr2=0x7f8b7809e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:03.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.748+0000 7f8b777fe700 1 --2- 172.21.15.26:0/1517861277 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b7809dc30 0x7f8b7809e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:03.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.748+0000 7f8b777fe700 1 -- 172.21.15.26:0/1517861277 >> v1:172.21.15.26:6789/0 conn(0x7f8b7813c1e0 legacy=0x7f8b7813e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:03.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.748+0000 7f8b777fe700 1 -- 172.21.15.26:0/1517861277 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b7809e920 con 0x7f8b7806a770 2023-10-01T07:59:03.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.748+0000 7f8b777fe700 1 --2- 172.21.15.26:0/1517861277 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b7806a770 0x7f8b7809d6f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f8b68009920 tx=0x7f8b68009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=736c8d2ee9a19b3a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:03.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.748+0000 7f8b767fc700 1 -- 172.21.15.26:0/1517861277 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b68004230 con 0x7f8b7806a770 2023-10-01T07:59:03.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.748+0000 7f8b767fc700 1 -- 172.21.15.26:0/1517861277 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b68004390 con 0x7f8b7806a770 2023-10-01T07:59:03.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.748+0000 7f8b767fc700 1 -- 172.21.15.26:0/1517861277 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b680036a0 con 0x7f8b7806a770 2023-10-01T07:59:03.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.749+0000 7f8b7dcfc700 1 -- 172.21.15.26:0/1517861277 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b7806a770 msgr2=0x7f8b7809d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:03.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.749+0000 7f8b7dcfc700 1 --2- 172.21.15.26:0/1517861277 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b7806a770 0x7f8b7809d6f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f8b68009920 tx=0x7f8b68009c30 comp rx=0 tx=0).stop 2023-10-01T07:59:03.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.749+0000 7f8b7dcfc700 1 -- 172.21.15.26:0/1517861277 shutdown_connections 2023-10-01T07:59:03.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.749+0000 7f8b7dcfc700 1 --2- 172.21.15.26:0/1517861277 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b7806a770 0x7f8b7809d6f0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:03.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.749+0000 7f8b7dcfc700 1 --2- 172.21.15.26:0/1517861277 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b7809dc30 0x7f8b7809e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:03.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.749+0000 7f8b7dcfc700 1 -- 172.21.15.26:0/1517861277 >> 172.21.15.26:0/1517861277 conn(0x7f8b78066f50 msgr2=0x7f8b7809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:03.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.749+0000 7f8b7dcfc700 1 -- 172.21.15.26:0/1517861277 shutdown_connections 2023-10-01T07:59:03.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.749+0000 7f8b7dcfc700 1 -- 172.21.15.26:0/1517861277 wait complete. 2023-10-01T07:59:03.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.750+0000 7f8b7dcfc700 1 Processor -- start 2023-10-01T07:59:03.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.751+0000 7f8b7dcfc700 1 -- start start 2023-10-01T07:59:03.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.751+0000 7f8b7dcfc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b7806a770 0x7f8b7813e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:03.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.751+0000 7f8b7dcfc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b7809dc30 0x7f8b7813a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:03.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.751+0000 7f8b7dcfc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b7813c1e0 0x7f8b7813aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:03.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.752+0000 7f8b7dcfc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7809f1a0 con 0x7f8b7809dc30 2023-10-01T07:59:03.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.752+0000 7f8b7dcfc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7811e000 con 0x7f8b7813c1e0 2023-10-01T07:59:03.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.752+0000 7f8b7dcfc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b780a3990 con 0x7f8b7806a770 2023-10-01T07:59:03.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.752+0000 7f8b76ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b7809dc30 0x7f8b7813a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:03.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.752+0000 7f8b76ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b7809dc30 0x7f8b7813a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39564/0 (socket says 172.21.15.26:39564) 2023-10-01T07:59:03.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.752+0000 7f8b76ffd700 1 -- 172.21.15.26:0/1549017859 learned_addr learned my addr 172.21.15.26:0/1549017859 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:03.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.752+0000 7f8b77fff700 1 --2- 172.21.15.26:0/1549017859 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b7813c1e0 0x7f8b7813aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:03.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.752+0000 7f8b777fe700 1 --2- 172.21.15.26:0/1549017859 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b7806a770 0x7f8b7813e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:03.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.752+0000 7f8b76ffd700 1 -- 172.21.15.26:0/1549017859 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b7806a770 msgr2=0x7f8b7813e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:03.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.752+0000 7f8b76ffd700 1 --2- 172.21.15.26:0/1549017859 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b7806a770 0x7f8b7813e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:03.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.752+0000 7f8b76ffd700 1 -- 172.21.15.26:0/1549017859 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b7813c1e0 msgr2=0x7f8b7813aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:03.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.752+0000 7f8b76ffd700 1 --2- 172.21.15.26:0/1549017859 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b7813c1e0 0x7f8b7813aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:03.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.752+0000 7f8b76ffd700 1 -- 172.21.15.26:0/1549017859 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b68009550 con 0x7f8b7809dc30 2023-10-01T07:59:03.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.753+0000 7f8b76ffd700 1 --2- 172.21.15.26:0/1549017859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b7809dc30 0x7f8b7813a590 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c00e980 tx=0x7f8b6c00ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:03.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.753+0000 7f8b5ffff700 1 -- 172.21.15.26:0/1549017859 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c009710 con 0x7f8b7809dc30 2023-10-01T07:59:03.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.753+0000 7f8b5ffff700 1 -- 172.21.15.26:0/1549017859 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b6c00c690 con 0x7f8b7809dc30 2023-10-01T07:59:03.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.753+0000 7f8b7dcfc700 1 -- 172.21.15.26:0/1549017859 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b7813ede0 con 0x7f8b7809dc30 2023-10-01T07:59:03.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.753+0000 7f8b7dcfc700 1 -- 172.21.15.26:0/1549017859 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b7813fbe0 con 0x7f8b7809dc30 2023-10-01T07:59:03.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.753+0000 7f8b5ffff700 1 -- 172.21.15.26:0/1549017859 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c00ca20 con 0x7f8b7809dc30 2023-10-01T07:59:03.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.754+0000 7f8b5ffff700 1 -- 172.21.15.26:0/1549017859 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8b6c00cb80 con 0x7f8b7809dc30 2023-10-01T07:59:03.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.754+0000 7f8b5ffff700 1 -- 172.21.15.26:0/1549017859 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8b6c03fba0 con 0x7f8b7809dc30 2023-10-01T07:59:03.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.755+0000 7f8b7dcfc700 1 -- 172.21.15.26:0/1549017859 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b580052e0 con 0x7f8b7809dc30 2023-10-01T07:59:03.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.764+0000 7f8b5ffff700 1 -- 172.21.15.26:0/1549017859 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8b6c017080 con 0x7f8b7809dc30 2023-10-01T07:59:03.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.775+0000 7f85f206c700 1 Processor -- start 2023-10-01T07:59:03.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.775+0000 7f85f206c700 1 -- start start 2023-10-01T07:59:03.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.775+0000 7f85f206c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f85ec09d6f0 0x7f85ec09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:03.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.775+0000 7f85f206c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f85ec09e000 0x7f85ec130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:03.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.775+0000 7f85f206c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f85ec09e410 0x7f85ec130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:03.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.775+0000 7f85f206c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85ec09f520 con 0x7f85ec09e000 2023-10-01T07:59:03.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.775+0000 7f85f206c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec09f130 con 0x7f85ec09d6f0 2023-10-01T07:59:03.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.775+0000 7f85f206c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec09e930 con 0x7f85ec09e410 2023-10-01T07:59:03.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.776+0000 7f85eaffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f85ec09e000 0x7f85ec130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:03.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.776+0000 7f85eb7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f85ec09d6f0 0x7f85ec09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:03.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.776+0000 7f85eaffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f85ec09e000 0x7f85ec130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39572/0 (socket says 172.21.15.26:39572) 2023-10-01T07:59:03.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.776+0000 7f85eaffd700 1 -- 172.21.15.26:0/1392552545 learned_addr learned my addr 172.21.15.26:0/1392552545 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:03.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.776+0000 7f85ebfff700 1 --2- 172.21.15.26:0/1392552545 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f85ec09e410 0x7f85ec130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:03.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.776+0000 7f85eb7fe700 1 -- 172.21.15.26:0/1392552545 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f85ec09e410 msgr2=0x7f85ec130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:03.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.776+0000 7f85eb7fe700 1 --2- 172.21.15.26:0/1392552545 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f85ec09e410 0x7f85ec130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:03.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.776+0000 7f85eb7fe700 1 -- 172.21.15.26:0/1392552545 >> v2:172.21.15.26:3300/0 conn(0x7f85ec09e000 msgr2=0x7f85ec130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:03.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.776+0000 7f85eb7fe700 1 --2- 172.21.15.26:0/1392552545 >> v2:172.21.15.26:3300/0 conn(0x7f85ec09e000 0x7f85ec130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:03.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.776+0000 7f85eb7fe700 1 -- 172.21.15.26:0/1392552545 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ec09b2d0 con 0x7f85ec09d6f0 2023-10-01T07:59:03.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.776+0000 7f85eaffd700 1 --2- 172.21.15.26:0/1392552545 >> v2:172.21.15.26:3300/0 conn(0x7f85ec09e000 0x7f85ec130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:03.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.776+0000 7f85ebfff700 1 --2- 172.21.15.26:0/1392552545 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f85ec09e410 0x7f85ec130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:03.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.777+0000 7f85eb7fe700 1 --2- 172.21.15.26:0/1392552545 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f85ec09d6f0 0x7f85ec09dac0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f85dc009840 tx=0x7f85dc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34c6370daf78cd7b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:03.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.777+0000 7f85ea7fc700 1 -- 172.21.15.26:0/1392552545 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc011830 con 0x7f85ec09d6f0 2023-10-01T07:59:03.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.777+0000 7f85ea7fc700 1 -- 172.21.15.26:0/1392552545 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85dc011990 con 0x7f85ec09d6f0 2023-10-01T07:59:03.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.777+0000 7f85ea7fc700 1 -- 172.21.15.26:0/1392552545 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc011d20 con 0x7f85ec09d6f0 2023-10-01T07:59:03.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.778+0000 7f85f206c700 1 -- 172.21.15.26:0/1392552545 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f85ec09d6f0 msgr2=0x7f85ec09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:03.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.778+0000 7f85f206c700 1 --2- 172.21.15.26:0/1392552545 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f85ec09d6f0 0x7f85ec09dac0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f85dc009840 tx=0x7f85dc009b50 comp rx=0 tx=0).stop 2023-10-01T07:59:03.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.778+0000 7f85f206c700 1 -- 172.21.15.26:0/1392552545 shutdown_connections 2023-10-01T07:59:03.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.778+0000 7f85f206c700 1 --2- 172.21.15.26:0/1392552545 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f85ec09e410 0x7f85ec130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:03.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.778+0000 7f85f206c700 1 --2- 172.21.15.26:0/1392552545 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f85ec09d6f0 0x7f85ec09dac0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:03.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.778+0000 7f85f206c700 1 --2- 172.21.15.26:0/1392552545 >> v2:172.21.15.26:3300/0 conn(0x7f85ec09e000 0x7f85ec130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:03.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.778+0000 7f85f206c700 1 -- 172.21.15.26:0/1392552545 >> 172.21.15.26:0/1392552545 conn(0x7f85ec066f50 msgr2=0x7f85ec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:03.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.778+0000 7f85f206c700 1 -- 172.21.15.26:0/1392552545 shutdown_connections 2023-10-01T07:59:03.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.778+0000 7f85f206c700 1 -- 172.21.15.26:0/1392552545 wait complete. 2023-10-01T07:59:03.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.779+0000 7f85f206c700 1 Processor -- start 2023-10-01T07:59:03.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.779+0000 7f85f206c700 1 -- start start 2023-10-01T07:59:03.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.779+0000 7f85f206c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85ec09d6f0 0x7f85ec122540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:03.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.779+0000 7f85f206c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f85ec09e000 0x7f85ec122a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:03.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.779+0000 7f85f206c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f85ec09e410 0x7f85ec122fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:03.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.779+0000 7f85f206c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec126060 con 0x7f85ec09d6f0 2023-10-01T07:59:03.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.779+0000 7f85f206c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec123980 con 0x7f85ec09e410 2023-10-01T07:59:03.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.779+0000 7f85f206c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec124150 con 0x7f85ec09e000 2023-10-01T07:59:03.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.780+0000 7f85eaffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f85ec09e000 0x7f85ec122a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:03.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.780+0000 7f85eb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85ec09d6f0 0x7f85ec122540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:03.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.780+0000 7f85eaffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f85ec09e000 0x7f85ec122a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59666/0 (socket says 172.21.15.26:59666) 2023-10-01T07:59:03.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.780+0000 7f85eb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85ec09d6f0 0x7f85ec122540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39584/0 (socket says 172.21.15.26:39584) 2023-10-01T07:59:03.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.780+0000 7f85eaffd700 1 -- 172.21.15.26:0/3517128557 learned_addr learned my addr 172.21.15.26:0/3517128557 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:03.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.780+0000 7f85ebfff700 1 --2- 172.21.15.26:0/3517128557 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f85ec09e410 0x7f85ec122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:03.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.780+0000 7f85eaffd700 1 -- 172.21.15.26:0/3517128557 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f85ec09e410 msgr2=0x7f85ec122fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:03.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.780+0000 7f85eaffd700 1 --2- 172.21.15.26:0/3517128557 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f85ec09e410 0x7f85ec122fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:03.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.780+0000 7f85eaffd700 1 -- 172.21.15.26:0/3517128557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85ec09d6f0 msgr2=0x7f85ec122540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:03.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.780+0000 7f85eaffd700 1 --2- 172.21.15.26:0/3517128557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85ec09d6f0 0x7f85ec122540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:03.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.780+0000 7f85eaffd700 1 -- 172.21.15.26:0/3517128557 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e0009550 con 0x7f85ec09e000 2023-10-01T07:59:03.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.780+0000 7f85eaffd700 1 --2- 172.21.15.26:0/3517128557 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f85ec09e000 0x7f85ec122a80 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f85e000ebe0 tx=0x7f85e000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:03.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.780+0000 7f85d3fff700 1 -- 172.21.15.26:0/3517128557 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e0004240 con 0x7f85ec09e000 2023-10-01T07:59:03.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.781+0000 7f85d3fff700 1 -- 172.21.15.26:0/3517128557 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e00043a0 con 0x7f85ec09e000 2023-10-01T07:59:03.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.781+0000 7f85f206c700 1 -- 172.21.15.26:0/3517128557 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e4009a70 con 0x7f85ec09e000 2023-10-01T07:59:03.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.781+0000 7f85f206c700 1 -- 172.21.15.26:0/3517128557 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85dc0094a0 con 0x7f85ec09e000 2023-10-01T07:59:03.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.782+0000 7f85d3fff700 1 -- 172.21.15.26:0/3517128557 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e00036a0 con 0x7f85ec09e000 2023-10-01T07:59:03.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.782+0000 7f85d3fff700 1 -- 172.21.15.26:0/3517128557 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f85e0003800 con 0x7f85ec09e000 2023-10-01T07:59:03.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.783+0000 7f85f206c700 1 -- 172.21.15.26:0/3517128557 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85cc0052e0 con 0x7f85ec09e000 2023-10-01T07:59:03.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.783+0000 7f85d3fff700 1 -- 172.21.15.26:0/3517128557 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f85e0003de0 con 0x7f85ec09e000 2023-10-01T07:59:03.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.792+0000 7f85d3fff700 1 -- 172.21.15.26:0/3517128557 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f85e0017070 con 0x7f85ec09e000 2023-10-01T07:59:03.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.937+0000 7f763749c700 1 -- 172.21.15.26:0/429633849 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f76301b94f0 con 0x7f763009d6f0 2023-10-01T07:59:03.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.938+0000 7f7625ffb700 1 -- 172.21.15.26:0/429633849 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f76301b94f0 con 0x7f763009d6f0 2023-10-01T07:59:03.939 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:03.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.940+0000 7f763749c700 1 -- 172.21.15.26:0/429633849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f763009d6f0 msgr2=0x7f76301c8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:03.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.940+0000 7f763749c700 1 --2- 172.21.15.26:0/429633849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f763009d6f0 0x7f76301c8250 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f763009a970 tx=0x7f762c004750 comp rx=0 tx=0).stop 2023-10-01T07:59:03.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.940+0000 7f763749c700 1 -- 172.21.15.26:0/429633849 shutdown_connections 2023-10-01T07:59:03.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.940+0000 7f763749c700 1 --2- 172.21.15.26:0/429633849 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f763009e410 0x7f76301c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:03.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.940+0000 7f763749c700 1 --2- 172.21.15.26:0/429633849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f763009d6f0 0x7f76301c8250 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:03.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.940+0000 7f763749c700 1 --2- 172.21.15.26:0/429633849 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f763009e000 0x7f76301c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:03.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.940+0000 7f763749c700 1 -- 172.21.15.26:0/429633849 >> 172.21.15.26:0/429633849 conn(0x7f7630066f50 msgr2=0x7f76301bbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:03.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.941+0000 7f763749c700 1 -- 172.21.15.26:0/429633849 shutdown_connections 2023-10-01T07:59:03.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.941+0000 7f763749c700 1 -- 172.21.15.26:0/429633849 wait complete. 2023-10-01T07:59:03.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.959+0000 7f0aeab0e700 1 -- 172.21.15.26:0/2291449494 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0ae411fd20 con 0x7f0ae409e930 2023-10-01T07:59:03.960 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:03.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.959+0000 7f0ae17fa700 1 -- 172.21.15.26:0/2291449494 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0ad0011590 con 0x7f0ae409e930 2023-10-01T07:59:03.961 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:03.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.962+0000 7f0aeab0e700 1 -- 172.21.15.26:0/2291449494 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ae409e930 msgr2=0x7f0ae411df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:03.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.962+0000 7f0aeab0e700 1 --2- 172.21.15.26:0/2291449494 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ae409e930 0x7f0ae411df70 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0ad000c3a0 tx=0x7f0ad000c6b0 comp rx=0 tx=0).stop 2023-10-01T07:59:03.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.962+0000 7f0aeab0e700 1 -- 172.21.15.26:0/2291449494 shutdown_connections 2023-10-01T07:59:03.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.962+0000 7f0aeab0e700 1 --2- 172.21.15.26:0/2291449494 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0ae41338a0 0x7f0ae411e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:03.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.962+0000 7f0aeab0e700 1 --2- 172.21.15.26:0/2291449494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ae409de50 0x7f0ae411da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:03.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.962+0000 7f0aeab0e700 1 --2- 172.21.15.26:0/2291449494 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0ae409e930 0x7f0ae411df70 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:03.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.962+0000 7f0aeab0e700 1 -- 172.21.15.26:0/2291449494 >> 172.21.15.26:0/2291449494 conn(0x7f0ae40a2aa0 msgr2=0x7f0ae41bae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:03.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.962+0000 7f0aeab0e700 1 -- 172.21.15.26:0/2291449494 shutdown_connections 2023-10-01T07:59:03.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.962+0000 7f0aeab0e700 1 -- 172.21.15.26:0/2291449494 wait complete. 2023-10-01T07:59:03.977 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:03.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.986+0000 7f8b7dcfc700 1 -- 172.21.15.26:0/1549017859 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8b58005150 con 0x7f8b7809dc30 2023-10-01T07:59:03.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.987+0000 7f8b5ffff700 1 -- 172.21.15.26:0/1549017859 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8b6c01b3b0 con 0x7f8b7809dc30 2023-10-01T07:59:03.987 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:03.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.989+0000 7f8b7dcfc700 1 -- 172.21.15.26:0/1549017859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b7809dc30 msgr2=0x7f8b7813a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:03.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.989+0000 7f8b7dcfc700 1 --2- 172.21.15.26:0/1549017859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b7809dc30 0x7f8b7813a590 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c00e980 tx=0x7f8b6c00ec90 comp rx=0 tx=0).stop 2023-10-01T07:59:03.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.989+0000 7f8b7dcfc700 1 -- 172.21.15.26:0/1549017859 shutdown_connections 2023-10-01T07:59:03.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.989+0000 7f8b7dcfc700 1 --2- 172.21.15.26:0/1549017859 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8b7813c1e0 0x7f8b7813aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:03.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.989+0000 7f8b7dcfc700 1 --2- 172.21.15.26:0/1549017859 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8b7806a770 0x7f8b7813e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:03.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.989+0000 7f8b7dcfc700 1 --2- 172.21.15.26:0/1549017859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b7809dc30 0x7f8b7813a590 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:03.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.989+0000 7f8b7dcfc700 1 -- 172.21.15.26:0/1549017859 >> 172.21.15.26:0/1549017859 conn(0x7f8b78066f50 msgr2=0x7f8b780a2060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:03.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.989+0000 7f8b7dcfc700 1 -- 172.21.15.26:0/1549017859 shutdown_connections 2023-10-01T07:59:03.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:03.989+0000 7f8b7dcfc700 1 -- 172.21.15.26:0/1549017859 wait complete. 2023-10-01T07:59:04.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:04.000+0000 7f85f206c700 1 -- 172.21.15.26:0/3517128557 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f85cc005590 con 0x7f85ec09e000 2023-10-01T07:59:04.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:04.001+0000 7f85d3fff700 1 -- 172.21.15.26:0/3517128557 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f85e0017020 con 0x7f85ec09e000 2023-10-01T07:59:04.001 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:04.004 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:04.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:04.003+0000 7f85f206c700 1 -- 172.21.15.26:0/3517128557 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f85ec09e000 msgr2=0x7f85ec122a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:04.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:04.003+0000 7f85f206c700 1 --2- 172.21.15.26:0/3517128557 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f85ec09e000 0x7f85ec122a80 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f85e000ebe0 tx=0x7f85e000eef0 comp rx=0 tx=0).stop 2023-10-01T07:59:04.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:04.003+0000 7f85f206c700 1 -- 172.21.15.26:0/3517128557 shutdown_connections 2023-10-01T07:59:04.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:04.003+0000 7f85f206c700 1 --2- 172.21.15.26:0/3517128557 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f85ec09e410 0x7f85ec122fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:04.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:04.003+0000 7f85f206c700 1 --2- 172.21.15.26:0/3517128557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85ec09d6f0 0x7f85ec122540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:04.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:04.003+0000 7f85f206c700 1 --2- 172.21.15.26:0/3517128557 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f85ec09e000 0x7f85ec122a80 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:04.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:04.003+0000 7f85f206c700 1 -- 172.21.15.26:0/3517128557 >> 172.21.15.26:0/3517128557 conn(0x7f85ec066f50 msgr2=0x7f85ec130920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:04.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:04.003+0000 7f85f206c700 1 -- 172.21.15.26:0/3517128557 shutdown_connections 2023-10-01T07:59:04.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:04.003+0000 7f85f206c700 1 -- 172.21.15.26:0/3517128557 wait complete. 2023-10-01T07:59:04.017 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:04.961 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:04.977 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:05.005 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:05.018 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:05.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.126+0000 7f5b9185b700 1 Processor -- start 2023-10-01T07:59:05.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.126+0000 7f5b9185b700 1 -- start start 2023-10-01T07:59:05.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.127+0000 7f5b9185b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5b8c0a0a30 0x7f5b8c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:05.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.127+0000 7f5b9185b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5b8c0a1340 0x7f5b8c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:05.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.127+0000 7f5b9185b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b8c09edd0 con 0x7f5b8c133fa0 2023-10-01T07:59:05.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.127+0000 7f5b9185b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b8c09e1f0 con 0x7f5b8c0a1340 2023-10-01T07:59:05.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.127+0000 7f5b9185b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c09dc50 con 0x7f5b8c0a0a30 2023-10-01T07:59:05.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.128+0000 7f5b8affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5b8c0a0a30 0x7f5b8c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:05.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.128+0000 7f5b8a7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5b8c0a1340 0x7f5b8c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:05.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.128+0000 7f5b8affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5b8c0a0a30 0x7f5b8c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59678/0 (socket says 172.21.15.26:59678) 2023-10-01T07:59:05.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.128+0000 7f5b8affd700 1 -- 172.21.15.26:0/1480889533 learned_addr learned my addr 172.21.15.26:0/1480889533 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:05.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.128+0000 7f5b8b7fe700 1 --1- 172.21.15.26:0/1480889533 >> v1:172.21.15.26:6789/0 conn(0x7f5b8c133fa0 0x7f5b8c13ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41676/0 (socket says 172.21.15.26:41676) 2023-10-01T07:59:05.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.128+0000 7f5b8affd700 1 -- 172.21.15.26:0/1480889533 >> v2:172.21.15.26:3300/0 conn(0x7f5b8c0a1340 msgr2=0x7f5b8c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:05.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.128+0000 7f5b8affd700 1 --2- 172.21.15.26:0/1480889533 >> v2:172.21.15.26:3300/0 conn(0x7f5b8c0a1340 0x7f5b8c133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.128+0000 7f5b8affd700 1 -- 172.21.15.26:0/1480889533 >> v1:172.21.15.26:6789/0 conn(0x7f5b8c133fa0 legacy=0x7f5b8c13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:05.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.128+0000 7f5b8affd700 1 -- 172.21.15.26:0/1480889533 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b8c0a1fe0 con 0x7f5b8c0a0a30 2023-10-01T07:59:05.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.128+0000 7f5b89ffb700 1 -- 172.21.15.26:0/1480889533 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 641297635 0 0) 0x7f5b8c09edd0 con 0x7f5b8c133fa0 2023-10-01T07:59:05.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.128+0000 7f5b8a7fc700 1 --2- 172.21.15.26:0/1480889533 >> v2:172.21.15.26:3300/0 conn(0x7f5b8c0a1340 0x7f5b8c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:05.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.128+0000 7f5b8affd700 1 --2- 172.21.15.26:0/1480889533 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5b8c0a0a30 0x7f5b8c0a0e00 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c0098f0 tx=0x7f5b7c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=841f9b18dd82b1a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:05.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.129+0000 7f5b89ffb700 1 -- 172.21.15.26:0/1480889533 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c011830 con 0x7f5b8c0a0a30 2023-10-01T07:59:05.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.129+0000 7f5b89ffb700 1 -- 172.21.15.26:0/1480889533 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7c011990 con 0x7f5b8c0a0a30 2023-10-01T07:59:05.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.129+0000 7f5b89ffb700 1 -- 172.21.15.26:0/1480889533 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c011d20 con 0x7f5b8c0a0a30 2023-10-01T07:59:05.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.129+0000 7f5b9185b700 1 -- 172.21.15.26:0/1480889533 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5b8c0a0a30 msgr2=0x7f5b8c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:05.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.129+0000 7f5b9185b700 1 --2- 172.21.15.26:0/1480889533 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5b8c0a0a30 0x7f5b8c0a0e00 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c0098f0 tx=0x7f5b7c009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:05.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.129+0000 7f5b9185b700 1 -- 172.21.15.26:0/1480889533 shutdown_connections 2023-10-01T07:59:05.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.129+0000 7f5b9185b700 1 --2- 172.21.15.26:0/1480889533 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5b8c0a0a30 0x7f5b8c0a0e00 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.129+0000 7f5b9185b700 1 --2- 172.21.15.26:0/1480889533 >> v2:172.21.15.26:3300/0 conn(0x7f5b8c0a1340 0x7f5b8c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.129+0000 7f5b9185b700 1 -- 172.21.15.26:0/1480889533 >> 172.21.15.26:0/1480889533 conn(0x7f5b8c0a6550 msgr2=0x7f5b8c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:05.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.129+0000 7f5b9185b700 1 -- 172.21.15.26:0/1480889533 shutdown_connections 2023-10-01T07:59:05.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.130+0000 7f5b9185b700 1 -- 172.21.15.26:0/1480889533 wait complete. 2023-10-01T07:59:05.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.130+0000 7f5b9185b700 1 Processor -- start 2023-10-01T07:59:05.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.131+0000 7f5b9185b700 1 -- start start 2023-10-01T07:59:05.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.131+0000 7f5b9185b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5b8c0a0a30 0x7f5b8c1c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:05.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.131+0000 7f5b9185b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b8c0a1340 0x7f5b8c1c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:05.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.131+0000 7f5b9185b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5b8c133fa0 0x7f5b8c122850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:05.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.131+0000 7f5b9185b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c125d40 con 0x7f5b8c0a1340 2023-10-01T07:59:05.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.131+0000 7f5b9185b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c1263e0 con 0x7f5b8c133fa0 2023-10-01T07:59:05.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.131+0000 7f5b9185b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c0a35a0 con 0x7f5b8c0a0a30 2023-10-01T07:59:05.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.132+0000 7f5b8affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5b8c0a0a30 0x7f5b8c1c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:05.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.132+0000 7f5b8affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5b8c0a0a30 0x7f5b8c1c8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59688/0 (socket says 172.21.15.26:59688) 2023-10-01T07:59:05.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.132+0000 7f5b8affd700 1 -- 172.21.15.26:0/2971338830 learned_addr learned my addr 172.21.15.26:0/2971338830 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:05.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.132+0000 7f5b8a7fc700 1 --2- 172.21.15.26:0/2971338830 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b8c0a1340 0x7f5b8c1c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:05.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.132+0000 7f5b8affd700 1 -- 172.21.15.26:0/2971338830 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5b8c133fa0 msgr2=0x7f5b8c122850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:05.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.132+0000 7f5b8affd700 1 --2- 172.21.15.26:0/2971338830 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5b8c133fa0 0x7f5b8c122850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.132+0000 7f5b8affd700 1 -- 172.21.15.26:0/2971338830 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b8c0a1340 msgr2=0x7f5b8c1c8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:05.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.132+0000 7f5b8affd700 1 --2- 172.21.15.26:0/2971338830 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b8c0a1340 0x7f5b8c1c8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.132+0000 7f5b8affd700 1 -- 172.21.15.26:0/2971338830 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b800094a0 con 0x7f5b8c0a0a30 2023-10-01T07:59:05.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.132+0000 7f5b8affd700 1 --2- 172.21.15.26:0/2971338830 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5b8c0a0a30 0x7f5b8c1c8590 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c009c40 tx=0x7f5b7c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:05.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.132+0000 7f5b73fff700 1 -- 172.21.15.26:0/2971338830 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c0045d0 con 0x7f5b8c0a0a30 2023-10-01T07:59:05.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.132+0000 7f5b73fff700 1 -- 172.21.15.26:0/2971338830 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7c0036a0 con 0x7f5b8c0a0a30 2023-10-01T07:59:05.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.132+0000 7f5b9185b700 1 -- 172.21.15.26:0/2971338830 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b7c009550 con 0x7f5b8c0a0a30 2023-10-01T07:59:05.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.132+0000 7f5b73fff700 1 -- 172.21.15.26:0/2971338830 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c003a30 con 0x7f5b8c0a0a30 2023-10-01T07:59:05.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.133+0000 7f5b9185b700 1 -- 172.21.15.26:0/2971338830 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b8c1243d0 con 0x7f5b8c0a0a30 2023-10-01T07:59:05.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.134+0000 7f5b73fff700 1 -- 172.21.15.26:0/2971338830 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5b7c021070 con 0x7f5b8c0a0a30 2023-10-01T07:59:05.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.134+0000 7f5b9185b700 1 -- 172.21.15.26:0/2971338830 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b8c074ea0 con 0x7f5b8c0a0a30 2023-10-01T07:59:05.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.134+0000 7f5b73fff700 1 -- 172.21.15.26:0/2971338830 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5b7c01a810 con 0x7f5b8c0a0a30 2023-10-01T07:59:05.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.143+0000 7f5b73fff700 1 -- 172.21.15.26:0/2971338830 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5b7c015020 con 0x7f5b8c0a0a30 2023-10-01T07:59:05.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.159+0000 7fceda6d6700 1 Processor -- start 2023-10-01T07:59:05.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.159+0000 7fceda6d6700 1 -- start start 2023-10-01T07:59:05.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.159+0000 7fceda6d6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fced409eca0 0x7fced413cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:05.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.159+0000 7fceda6d6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fced406f050 0x7fced413f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:05.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.159+0000 7fceda6d6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced4070ee0 con 0x7fced406e570 2023-10-01T07:59:05.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.159+0000 7fceda6d6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced4071980 con 0x7fced409eca0 2023-10-01T07:59:05.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.159+0000 7fceda6d6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fced4071480 con 0x7fced406f050 2023-10-01T07:59:05.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.159+0000 7fced8c73700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fced406f050 0x7fced413f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:05.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.159+0000 7fced8c73700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fced406f050 0x7fced413f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59692/0 (socket says 172.21.15.26:59692) 2023-10-01T07:59:05.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.159+0000 7fced8c73700 1 -- 172.21.15.26:0/3615618261 learned_addr learned my addr 172.21.15.26:0/3615618261 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:05.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.160+0000 7fced37fe700 1 --2- 172.21.15.26:0/3615618261 >> v2:172.21.15.26:3300/0 conn(0x7fced409eca0 0x7fced413cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:05.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.160+0000 7fced8c73700 1 -- 172.21.15.26:0/3615618261 >> v2:172.21.15.26:3300/0 conn(0x7fced409eca0 msgr2=0x7fced413cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:05.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.160+0000 7fced8c73700 1 --2- 172.21.15.26:0/3615618261 >> v2:172.21.15.26:3300/0 conn(0x7fced409eca0 0x7fced413cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.160+0000 7fced8c73700 1 -- 172.21.15.26:0/3615618261 >> v1:172.21.15.26:6789/0 conn(0x7fced406e570 legacy=0x7fced406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:05.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.160+0000 7fced8c73700 1 -- 172.21.15.26:0/3615618261 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced4071b90 con 0x7fced406f050 2023-10-01T07:59:05.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.160+0000 7fced8c73700 1 --2- 172.21.15.26:0/3615618261 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fced406f050 0x7fced413f3f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009e50 tx=0x7fcecc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=770768e032d0f4bc server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:05.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.160+0000 7fced2ffd700 1 -- 172.21.15.26:0/3615618261 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc00e070 con 0x7fced406f050 2023-10-01T07:59:05.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.160+0000 7fced2ffd700 1 -- 172.21.15.26:0/3615618261 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcecc00b910 con 0x7fced406f050 2023-10-01T07:59:05.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.160+0000 7fced2ffd700 1 -- 172.21.15.26:0/3615618261 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc00bcc0 con 0x7fced406f050 2023-10-01T07:59:05.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.161+0000 7fceda6d6700 1 -- 172.21.15.26:0/3615618261 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fced406f050 msgr2=0x7fced413f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:05.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.161+0000 7fceda6d6700 1 --2- 172.21.15.26:0/3615618261 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fced406f050 0x7fced413f3f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009e50 tx=0x7fcecc00b330 comp rx=0 tx=0).stop 2023-10-01T07:59:05.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.161+0000 7fceda6d6700 1 -- 172.21.15.26:0/3615618261 shutdown_connections 2023-10-01T07:59:05.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.161+0000 7fceda6d6700 1 --2- 172.21.15.26:0/3615618261 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fced406f050 0x7fced413f3f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.161+0000 7fceda6d6700 1 --2- 172.21.15.26:0/3615618261 >> v2:172.21.15.26:3300/0 conn(0x7fced409eca0 0x7fced413cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.161+0000 7fceda6d6700 1 -- 172.21.15.26:0/3615618261 >> 172.21.15.26:0/3615618261 conn(0x7fced40a2aa0 msgr2=0x7fced40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:05.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.161+0000 7fceda6d6700 1 -- 172.21.15.26:0/3615618261 shutdown_connections 2023-10-01T07:59:05.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.161+0000 7fceda6d6700 1 -- 172.21.15.26:0/3615618261 wait complete. 2023-10-01T07:59:05.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.163+0000 7fceda6d6700 1 Processor -- start 2023-10-01T07:59:05.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.163+0000 7fceda6d6700 1 -- start start 2023-10-01T07:59:05.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.163+0000 7fceda6d6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fced406e570 0x7fced41214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:05.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.164+0000 7fceda6d6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fced406f050 0x7fced4121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:05.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.164+0000 7fceda6d6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fced4121f60 0x7fced41cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:05.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.164+0000 7fceda6d6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced4122f70 con 0x7fced4121f60 2023-10-01T07:59:05.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.164+0000 7fceda6d6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced41248e0 con 0x7fced406e570 2023-10-01T07:59:05.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.164+0000 7fceda6d6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fced409a200 con 0x7fced406f050 2023-10-01T07:59:05.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.164+0000 7fced37fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fced406f050 0x7fced4121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:05.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.164+0000 7fced3fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fced406e570 0x7fced41214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:05.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.164+0000 7fced37fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fced406f050 0x7fced4121a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59702/0 (socket says 172.21.15.26:59702) 2023-10-01T07:59:05.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.164+0000 7fced37fe700 1 -- 172.21.15.26:0/2034666852 learned_addr learned my addr 172.21.15.26:0/2034666852 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:05.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.164+0000 7fced8c73700 1 --2- 172.21.15.26:0/2034666852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fced4121f60 0x7fced41cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:05.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.164+0000 7fced37fe700 1 -- 172.21.15.26:0/2034666852 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fced406e570 msgr2=0x7fced41214e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:05.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.164+0000 7fced37fe700 1 --2- 172.21.15.26:0/2034666852 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fced406e570 0x7fced41214e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.164+0000 7fced37fe700 1 -- 172.21.15.26:0/2034666852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fced4121f60 msgr2=0x7fced41cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:05.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.164+0000 7fced37fe700 1 --2- 172.21.15.26:0/2034666852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fced4121f60 0x7fced41cc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.164+0000 7fced37fe700 1 -- 172.21.15.26:0/2034666852 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc009b30 con 0x7fced406f050 2023-10-01T07:59:05.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.165+0000 7fced37fe700 1 --2- 172.21.15.26:0/2034666852 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fced406f050 0x7fced4121a20 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fcec800e9b0 tx=0x7fcec800ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:05.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.165+0000 7fced0ff9700 1 -- 172.21.15.26:0/2034666852 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec800ee50 con 0x7fced406f050 2023-10-01T07:59:05.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.165+0000 7fced0ff9700 1 -- 172.21.15.26:0/2034666852 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec800c7f0 con 0x7fced406f050 2023-10-01T07:59:05.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.165+0000 7fceda6d6700 1 -- 172.21.15.26:0/2034666852 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced4070610 con 0x7fced406f050 2023-10-01T07:59:05.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.165+0000 7fced0ff9700 1 -- 172.21.15.26:0/2034666852 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec800cb60 con 0x7fced406f050 2023-10-01T07:59:05.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.165+0000 7fceda6d6700 1 -- 172.21.15.26:0/2034666852 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced413dbe0 con 0x7fced406f050 2023-10-01T07:59:05.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.166+0000 7fced0ff9700 1 -- 172.21.15.26:0/2034666852 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcec800ccc0 con 0x7fced406f050 2023-10-01T07:59:05.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.166+0000 7fced0ff9700 1 -- 172.21.15.26:0/2034666852 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcec803f9c0 con 0x7fced406f050 2023-10-01T07:59:05.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.166+0000 7fceda6d6700 1 -- 172.21.15.26:0/2034666852 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced4122360 con 0x7fced406f050 2023-10-01T07:59:05.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.170+0000 7fe84cb0e700 1 Processor -- start 2023-10-01T07:59:05.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.170+0000 7fe84cb0e700 1 -- start start 2023-10-01T07:59:05.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.171+0000 7fe84cb0e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe84806f5d0 0x7fe84812ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:05.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.171+0000 7fe84cb0e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe848135c20 0x7fe848138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:05.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.171+0000 7fe84cb0e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe84806fa40 con 0x7fe84812cf60 2023-10-01T07:59:05.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.171+0000 7fe84cb0e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe84812cd90 con 0x7fe84806f5d0 2023-10-01T07:59:05.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.171+0000 7fe84cb0e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe848071780 con 0x7fe848135c20 2023-10-01T07:59:05.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.171+0000 7fe845d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe84806f5d0 0x7fe84812ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:05.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.171+0000 7fe845d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe84806f5d0 0x7fe84812ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39624/0 (socket says 172.21.15.26:39624) 2023-10-01T07:59:05.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.171+0000 7fe845d9b700 1 -- 172.21.15.26:0/1062365109 learned_addr learned my addr 172.21.15.26:0/1062365109 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:05.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.171+0000 7fe846d9d700 1 --2- 172.21.15.26:0/1062365109 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe848135c20 0x7fe848138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:05.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.171+0000 7fe845d9b700 1 -- 172.21.15.26:0/1062365109 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe848135c20 msgr2=0x7fe848138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:05.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.171+0000 7fe845d9b700 1 --2- 172.21.15.26:0/1062365109 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe848135c20 0x7fe848138000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.171+0000 7fe845d9b700 1 -- 172.21.15.26:0/1062365109 >> v1:172.21.15.26:6789/0 conn(0x7fe84812cf60 legacy=0x7fe84812f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:05.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.171+0000 7fe845d9b700 1 -- 172.21.15.26:0/1062365109 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe848071a40 con 0x7fe84806f5d0 2023-10-01T07:59:05.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.172+0000 7fe845d9b700 1 --2- 172.21.15.26:0/1062365109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe84806f5d0 0x7fe84812ffc0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fe83c00bb90 tx=0x7fe83c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e11dff58ec59d221 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:05.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.172+0000 7fe84559a700 1 -- 172.21.15.26:0/1062365109 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c00dc20 con 0x7fe84806f5d0 2023-10-01T07:59:05.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.172+0000 7fe84559a700 1 -- 172.21.15.26:0/1062365109 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83c00dd80 con 0x7fe84806f5d0 2023-10-01T07:59:05.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.172+0000 7fe84559a700 1 -- 172.21.15.26:0/1062365109 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c017630 con 0x7fe84806f5d0 2023-10-01T07:59:05.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.172+0000 7fced0ff9700 1 -- 172.21.15.26:0/2034666852 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcec8021080 con 0x7fced406f050 2023-10-01T07:59:05.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.173+0000 7fe84cb0e700 1 -- 172.21.15.26:0/1062365109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe84806f5d0 msgr2=0x7fe84812ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:05.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.173+0000 7fe84cb0e700 1 --2- 172.21.15.26:0/1062365109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe84806f5d0 0x7fe84812ffc0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fe83c00bb90 tx=0x7fe83c00bea0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.173+0000 7fe84cb0e700 1 -- 172.21.15.26:0/1062365109 shutdown_connections 2023-10-01T07:59:05.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.173+0000 7fe84cb0e700 1 --2- 172.21.15.26:0/1062365109 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe848135c20 0x7fe848138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.173+0000 7fe84cb0e700 1 --2- 172.21.15.26:0/1062365109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe84806f5d0 0x7fe84812ffc0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.173+0000 7fe84cb0e700 1 -- 172.21.15.26:0/1062365109 >> 172.21.15.26:0/1062365109 conn(0x7fe8480a2aa0 msgr2=0x7fe8480a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:05.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.173+0000 7fe84cb0e700 1 -- 172.21.15.26:0/1062365109 shutdown_connections 2023-10-01T07:59:05.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.173+0000 7fe84cb0e700 1 -- 172.21.15.26:0/1062365109 wait complete. 2023-10-01T07:59:05.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.174+0000 7fe84cb0e700 1 Processor -- start 2023-10-01T07:59:05.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.174+0000 7fe84cb0e700 1 -- start start 2023-10-01T07:59:05.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.175+0000 7fe84cb0e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe84806f5d0 0x7fe84812d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:05.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.175+0000 7fe84cb0e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe84812cf60 0x7fe84812e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:05.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.175+0000 7fe84cb0e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe848135c20 0x7fe84812e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:05.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.175+0000 7fe84cb0e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8481356b0 con 0x7fe84806f5d0 2023-10-01T07:59:05.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.175+0000 7fe84cb0e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe84812ec80 con 0x7fe848135c20 2023-10-01T07:59:05.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.175+0000 7fe84cb0e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe84812ddd0 con 0x7fe84812cf60 2023-10-01T07:59:05.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.175+0000 7fe84659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe84806f5d0 0x7fe84812d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:05.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.175+0000 7fe84659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe84806f5d0 0x7fe84812d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39640/0 (socket says 172.21.15.26:39640) 2023-10-01T07:59:05.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.175+0000 7fe84659c700 1 -- 172.21.15.26:0/2251431761 learned_addr learned my addr 172.21.15.26:0/2251431761 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:05.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.175+0000 7fe846d9d700 1 --2- 172.21.15.26:0/2251431761 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe848135c20 0x7fe84812e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:05.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.175+0000 7fe84659c700 1 -- 172.21.15.26:0/2251431761 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe84812cf60 msgr2=0x7fe84812e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:05.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.176+0000 7fe84659c700 1 --2- 172.21.15.26:0/2251431761 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe84812cf60 0x7fe84812e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.176+0000 7fe84659c700 1 -- 172.21.15.26:0/2251431761 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe848135c20 msgr2=0x7fe84812e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:05.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.176+0000 7fe84659c700 1 --2- 172.21.15.26:0/2251431761 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe848135c20 0x7fe84812e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.176+0000 7fe84659c700 1 -- 172.21.15.26:0/2251431761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83c00b7f0 con 0x7fe84806f5d0 2023-10-01T07:59:05.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.176+0000 7fe84659c700 1 --2- 172.21.15.26:0/2251431761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe84806f5d0 0x7fe84812d7b0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fe83800c510 tx=0x7fe83800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:05.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.176+0000 7fe836ffd700 1 -- 172.21.15.26:0/2251431761 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8380052d0 con 0x7fe84806f5d0 2023-10-01T07:59:05.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.176+0000 7fe836ffd700 1 -- 172.21.15.26:0/2251431761 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe838005430 con 0x7fe84806f5d0 2023-10-01T07:59:05.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.176+0000 7fe836ffd700 1 -- 172.21.15.26:0/2251431761 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8380038c0 con 0x7fe84806f5d0 2023-10-01T07:59:05.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.176+0000 7fe84cb0e700 1 -- 172.21.15.26:0/2251431761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe848129fa0 con 0x7fe84806f5d0 2023-10-01T07:59:05.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.176+0000 7fe84cb0e700 1 -- 172.21.15.26:0/2251431761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe84809e690 con 0x7fe84806f5d0 2023-10-01T07:59:05.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.177+0000 7fe836ffd700 1 -- 172.21.15.26:0/2251431761 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe838003a20 con 0x7fe84806f5d0 2023-10-01T07:59:05.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.177+0000 7fe836ffd700 1 -- 172.21.15.26:0/2251431761 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe83803eb30 con 0x7fe84806f5d0 2023-10-01T07:59:05.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.178+0000 7fe84cb0e700 1 -- 172.21.15.26:0/2251431761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe848074ea0 con 0x7fe84806f5d0 2023-10-01T07:59:05.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.187+0000 7fe836ffd700 1 -- 172.21.15.26:0/2251431761 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe838017080 con 0x7fe84806f5d0 2023-10-01T07:59:05.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.200+0000 7f5802c2f700 1 Processor -- start 2023-10-01T07:59:05.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.200+0000 7f5802c2f700 1 -- start start 2023-10-01T07:59:05.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.200+0000 7f5802c2f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57fc06e570 0x7f57fc06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:05.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.200+0000 7f5802c2f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f57fc09eca0 0x7f57fc06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:05.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.200+0000 7f5802c2f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f57fc134610 0x7f57fc134a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:05.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.200+0000 7f5802c2f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57fc070ee0 con 0x7f57fc09eca0 2023-10-01T07:59:05.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.200+0000 7f5802c2f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57fc071480 con 0x7f57fc06e570 2023-10-01T07:59:05.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.200+0000 7f5802c2f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f57fc06f3c0 con 0x7f57fc134610 2023-10-01T07:59:05.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.200+0000 7f58009cb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57fc06e570 0x7f57fc06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:05.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.200+0000 7f57fbfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f57fc09eca0 0x7f57fc06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:05.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.200+0000 7f58009cb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57fc06e570 0x7f57fc06e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35736/0 (socket says 172.21.15.26:35736) 2023-10-01T07:59:05.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.200+0000 7f57fbfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f57fc09eca0 0x7f57fc06ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39644/0 (socket says 172.21.15.26:39644) 2023-10-01T07:59:05.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.201+0000 7f58009cb700 1 -- 172.21.15.26:0/2616842985 learned_addr learned my addr 172.21.15.26:0/2616842985 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:05.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.201+0000 7f58011cc700 1 --2- 172.21.15.26:0/2616842985 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f57fc134610 0x7f57fc134a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:05.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.201+0000 7f58009cb700 1 -- 172.21.15.26:0/2616842985 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f57fc134610 msgr2=0x7f57fc134a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:05.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.201+0000 7f58009cb700 1 --2- 172.21.15.26:0/2616842985 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f57fc134610 0x7f57fc134a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.201+0000 7f58009cb700 1 -- 172.21.15.26:0/2616842985 >> v2:172.21.15.26:3300/0 conn(0x7f57fc09eca0 msgr2=0x7f57fc06ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:05.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.201+0000 7f58009cb700 1 --2- 172.21.15.26:0/2616842985 >> v2:172.21.15.26:3300/0 conn(0x7f57fc09eca0 0x7f57fc06ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.201+0000 7f58009cb700 1 -- 172.21.15.26:0/2616842985 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57fc071b90 con 0x7f57fc06e570 2023-10-01T07:59:05.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.201+0000 7f57fbfff700 1 --2- 172.21.15.26:0/2616842985 >> v2:172.21.15.26:3300/0 conn(0x7f57fc09eca0 0x7f57fc06ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:05.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.201+0000 7f58009cb700 1 --2- 172.21.15.26:0/2616842985 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57fc06e570 0x7f57fc06e940 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f57f00098f0 tx=0x7f57f0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0699f48eb0cd630 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:05.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.201+0000 7f57fb7fe700 1 -- 172.21.15.26:0/2616842985 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f0011830 con 0x7f57fc06e570 2023-10-01T07:59:05.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.201+0000 7f57fb7fe700 1 -- 172.21.15.26:0/2616842985 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f0011990 con 0x7f57fc06e570 2023-10-01T07:59:05.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.201+0000 7f57fb7fe700 1 -- 172.21.15.26:0/2616842985 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f0011d20 con 0x7f57fc06e570 2023-10-01T07:59:05.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.202+0000 7f5802c2f700 1 -- 172.21.15.26:0/2616842985 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57fc06e570 msgr2=0x7f57fc06e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:05.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.202+0000 7f5802c2f700 1 --2- 172.21.15.26:0/2616842985 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57fc06e570 0x7f57fc06e940 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f57f00098f0 tx=0x7f57f0009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:05.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.202+0000 7f5802c2f700 1 -- 172.21.15.26:0/2616842985 shutdown_connections 2023-10-01T07:59:05.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.202+0000 7f5802c2f700 1 --2- 172.21.15.26:0/2616842985 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f57fc134610 0x7f57fc134a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.202+0000 7f5802c2f700 1 --2- 172.21.15.26:0/2616842985 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57fc06e570 0x7f57fc06e940 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.202+0000 7f5802c2f700 1 --2- 172.21.15.26:0/2616842985 >> v2:172.21.15.26:3300/0 conn(0x7f57fc09eca0 0x7f57fc06ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.202+0000 7f5802c2f700 1 -- 172.21.15.26:0/2616842985 >> 172.21.15.26:0/2616842985 conn(0x7f57fc0a2aa0 msgr2=0x7f57fc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:05.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.202+0000 7f5802c2f700 1 -- 172.21.15.26:0/2616842985 shutdown_connections 2023-10-01T07:59:05.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.202+0000 7f5802c2f700 1 -- 172.21.15.26:0/2616842985 wait complete. 2023-10-01T07:59:05.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.203+0000 7f5802c2f700 1 Processor -- start 2023-10-01T07:59:05.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.203+0000 7f5802c2f700 1 -- start start 2023-10-01T07:59:05.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.204+0000 7f5802c2f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57fc06e570 0x7f57fc1214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:05.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.204+0000 7f5802c2f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57fc134610 0x7f57fc121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:05.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.204+0000 7f5802c2f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f57fc121f60 0x7f57fc1d2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:05.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.204+0000 7f5802c2f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57fc123160 con 0x7f57fc134610 2023-10-01T07:59:05.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.204+0000 7f5802c2f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57fc124a80 con 0x7f57fc06e570 2023-10-01T07:59:05.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.204+0000 7f5802c2f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f57fc123a90 con 0x7f57fc121f60 2023-10-01T07:59:05.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.204+0000 7f57fbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57fc134610 0x7f57fc121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:05.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.204+0000 7f57fbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57fc134610 0x7f57fc121a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39656/0 (socket says 172.21.15.26:39656) 2023-10-01T07:59:05.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.204+0000 7f57fbfff700 1 -- 172.21.15.26:0/1705810914 learned_addr learned my addr 172.21.15.26:0/1705810914 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:05.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.204+0000 7f58011cc700 1 --2- 172.21.15.26:0/1705810914 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f57fc121f60 0x7f57fc1d2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:05.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.205+0000 7f57fbfff700 1 -- 172.21.15.26:0/1705810914 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f57fc121f60 msgr2=0x7f57fc1d2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:05.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.205+0000 7f57fbfff700 1 --2- 172.21.15.26:0/1705810914 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f57fc121f60 0x7f57fc1d2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.205+0000 7f57fbfff700 1 -- 172.21.15.26:0/1705810914 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57fc06e570 msgr2=0x7f57fc1214e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:05.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.205+0000 7f57fbfff700 1 --2- 172.21.15.26:0/1705810914 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57fc06e570 0x7f57fc1214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.205+0000 7f57fbfff700 1 -- 172.21.15.26:0/1705810914 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e80094a0 con 0x7f57fc134610 2023-10-01T07:59:05.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.205+0000 7f57fbfff700 1 --2- 172.21.15.26:0/1705810914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57fc134610 0x7f57fc121a20 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f57e800ebb0 tx=0x7f57e800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:05.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.205+0000 7f57f97fa700 1 -- 172.21.15.26:0/1705810914 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e800c850 con 0x7f57fc134610 2023-10-01T07:59:05.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.205+0000 7f5802c2f700 1 -- 172.21.15.26:0/1705810914 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57f0009550 con 0x7f57fc134610 2023-10-01T07:59:05.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.205+0000 7f57f97fa700 1 -- 172.21.15.26:0/1705810914 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e800c9b0 con 0x7f57fc134610 2023-10-01T07:59:05.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.205+0000 7f57f97fa700 1 -- 172.21.15.26:0/1705810914 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e800cd60 con 0x7f57fc134610 2023-10-01T07:59:05.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.205+0000 7f5802c2f700 1 -- 172.21.15.26:0/1705810914 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57fc123e50 con 0x7f57fc134610 2023-10-01T07:59:05.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.206+0000 7f5802c2f700 1 -- 172.21.15.26:0/1705810914 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57fc09b1e0 con 0x7f57fc134610 2023-10-01T07:59:05.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.207+0000 7f57f97fa700 1 -- 172.21.15.26:0/1705810914 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f57e8004020 con 0x7f57fc134610 2023-10-01T07:59:05.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.207+0000 7f57f97fa700 1 -- 172.21.15.26:0/1705810914 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f57e803fc50 con 0x7f57fc134610 2023-10-01T07:59:05.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.211+0000 7f57f97fa700 1 -- 172.21.15.26:0/1705810914 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f57e803fe60 con 0x7f57fc134610 2023-10-01T07:59:05.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.364+0000 7f5b9185b700 1 -- 172.21.15.26:0/2971338830 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5b8c0a28e0 con 0x7f5b8c0a0a30 2023-10-01T07:59:05.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.364+0000 7f5b73fff700 1 -- 172.21.15.26:0/2971338830 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5b7c029030 con 0x7f5b8c0a0a30 2023-10-01T07:59:05.365 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:05.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.367+0000 7f5b9185b700 1 -- 172.21.15.26:0/2971338830 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5b8c0a0a30 msgr2=0x7f5b8c1c8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:05.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.367+0000 7f5b9185b700 1 --2- 172.21.15.26:0/2971338830 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5b8c0a0a30 0x7f5b8c1c8590 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c009c40 tx=0x7f5b7c004750 comp rx=0 tx=0).stop 2023-10-01T07:59:05.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.367+0000 7f5b9185b700 1 -- 172.21.15.26:0/2971338830 shutdown_connections 2023-10-01T07:59:05.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.367+0000 7f5b9185b700 1 --2- 172.21.15.26:0/2971338830 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5b8c133fa0 0x7f5b8c122850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.367+0000 7f5b9185b700 1 --2- 172.21.15.26:0/2971338830 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5b8c0a0a30 0x7f5b8c1c8590 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.367+0000 7f5b9185b700 1 --2- 172.21.15.26:0/2971338830 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b8c0a1340 0x7f5b8c1c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.367+0000 7f5b9185b700 1 -- 172.21.15.26:0/2971338830 >> 172.21.15.26:0/2971338830 conn(0x7f5b8c0a6550 msgr2=0x7f5b8c11c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:05.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.367+0000 7f5b9185b700 1 -- 172.21.15.26:0/2971338830 shutdown_connections 2023-10-01T07:59:05.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.367+0000 7f5b9185b700 1 -- 172.21.15.26:0/2971338830 wait complete. 2023-10-01T07:59:05.386 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:05.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.431+0000 7f5802c2f700 1 -- 172.21.15.26:0/1705810914 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f57fc070610 con 0x7f57fc134610 2023-10-01T07:59:05.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.431+0000 7f57f97fa700 1 -- 172.21.15.26:0/1705810914 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f57e8021070 con 0x7f57fc134610 2023-10-01T07:59:05.432 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:05.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.433+0000 7f5802c2f700 1 -- 172.21.15.26:0/1705810914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57fc134610 msgr2=0x7f57fc121a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:05.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.433+0000 7f5802c2f700 1 --2- 172.21.15.26:0/1705810914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57fc134610 0x7f57fc121a20 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f57e800ebb0 tx=0x7f57e800eec0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.434+0000 7f5802c2f700 1 -- 172.21.15.26:0/1705810914 shutdown_connections 2023-10-01T07:59:05.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.434+0000 7f5802c2f700 1 --2- 172.21.15.26:0/1705810914 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f57fc121f60 0x7f57fc1d2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.434+0000 7f5802c2f700 1 --2- 172.21.15.26:0/1705810914 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57fc06e570 0x7f57fc1214e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.434+0000 7f5802c2f700 1 --2- 172.21.15.26:0/1705810914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57fc134610 0x7f57fc121a20 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.434+0000 7f5802c2f700 1 -- 172.21.15.26:0/1705810914 >> 172.21.15.26:0/1705810914 conn(0x7f57fc0a2aa0 msgr2=0x7f57fc0a0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:05.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.434+0000 7f5802c2f700 1 -- 172.21.15.26:0/1705810914 shutdown_connections 2023-10-01T07:59:05.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.434+0000 7f5802c2f700 1 -- 172.21.15.26:0/1705810914 wait complete. 2023-10-01T07:59:05.448 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:05.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.470+0000 7fceda6d6700 1 -- 172.21.15.26:0/2034666852 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fced4074ea0 con 0x7fced406f050 2023-10-01T07:59:05.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.470+0000 7fced0ff9700 1 -- 172.21.15.26:0/2034666852 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcec8017020 con 0x7fced406f050 2023-10-01T07:59:05.471 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:05.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.473+0000 7fceda6d6700 1 -- 172.21.15.26:0/2034666852 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fced406f050 msgr2=0x7fced4121a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:05.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.473+0000 7fceda6d6700 1 --2- 172.21.15.26:0/2034666852 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fced406f050 0x7fced4121a20 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fcec800e9b0 tx=0x7fcec800ecc0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.473+0000 7fceda6d6700 1 -- 172.21.15.26:0/2034666852 shutdown_connections 2023-10-01T07:59:05.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.473+0000 7fceda6d6700 1 --2- 172.21.15.26:0/2034666852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fced4121f60 0x7fced41cc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.473+0000 7fceda6d6700 1 --2- 172.21.15.26:0/2034666852 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fced406e570 0x7fced41214e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.473+0000 7fceda6d6700 1 --2- 172.21.15.26:0/2034666852 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fced406f050 0x7fced4121a20 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.473+0000 7fceda6d6700 1 -- 172.21.15.26:0/2034666852 >> 172.21.15.26:0/2034666852 conn(0x7fced40a2aa0 msgr2=0x7fced40a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:05.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.473+0000 7fceda6d6700 1 -- 172.21.15.26:0/2034666852 shutdown_connections 2023-10-01T07:59:05.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.473+0000 7fceda6d6700 1 -- 172.21.15.26:0/2034666852 wait complete. 2023-10-01T07:59:05.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.482+0000 7fe84cb0e700 1 -- 172.21.15.26:0/2251431761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe8480713a0 con 0x7fe84806f5d0 2023-10-01T07:59:05.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.482+0000 7fe836ffd700 1 -- 172.21.15.26:0/2251431761 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe8380192c0 con 0x7fe84806f5d0 2023-10-01T07:59:05.483 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:05.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.485+0000 7fe84cb0e700 1 -- 172.21.15.26:0/2251431761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe84806f5d0 msgr2=0x7fe84812d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:05.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.485+0000 7fe84cb0e700 1 --2- 172.21.15.26:0/2251431761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe84806f5d0 0x7fe84812d7b0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fe83800c510 tx=0x7fe83800c820 comp rx=0 tx=0).stop 2023-10-01T07:59:05.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.485+0000 7fe84cb0e700 1 -- 172.21.15.26:0/2251431761 shutdown_connections 2023-10-01T07:59:05.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.485+0000 7fe84cb0e700 1 --2- 172.21.15.26:0/2251431761 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe848135c20 0x7fe84812e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.485+0000 7fe84cb0e700 1 --2- 172.21.15.26:0/2251431761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe84806f5d0 0x7fe84812d7b0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.485+0000 7fe84cb0e700 1 --2- 172.21.15.26:0/2251431761 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe84812cf60 0x7fe84812e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:05.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.485+0000 7fe84cb0e700 1 -- 172.21.15.26:0/2251431761 >> 172.21.15.26:0/2251431761 conn(0x7fe8480a2aa0 msgr2=0x7fe84806e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:05.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.485+0000 7fe84cb0e700 1 -- 172.21.15.26:0/2251431761 shutdown_connections 2023-10-01T07:59:05.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:05.485+0000 7fe84cb0e700 1 -- 172.21.15.26:0/2251431761 wait complete. 2023-10-01T07:59:05.487 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:05.499 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:06.387 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:06.449 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:06.488 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:06.501 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:06.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.535+0000 7f604ba88700 1 Processor -- start 2023-10-01T07:59:06.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.535+0000 7f604ba88700 1 -- start start 2023-10-01T07:59:06.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.536+0000 7f604ba88700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f604409e1d0 0x7f6044135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:06.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.536+0000 7f604ba88700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6044135e50 0x7f6044138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:06.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.536+0000 7f604ba88700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f604409f130 con 0x7f604409d6f0 2023-10-01T07:59:06.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.536+0000 7f604ba88700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f604409f520 con 0x7f6044135e50 2023-10-01T07:59:06.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.536+0000 7f604ba88700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f604409e930 con 0x7f604409e1d0 2023-10-01T07:59:06.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.536+0000 7f604a025700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6044135e50 0x7f6044138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:06.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.536+0000 7f6049023700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f604409e1d0 0x7f6044135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:06.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.536+0000 7f6049023700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f604409e1d0 0x7f6044135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59732/0 (socket says 172.21.15.26:59732) 2023-10-01T07:59:06.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.536+0000 7f604a025700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6044135e50 0x7f6044138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39658/0 (socket says 172.21.15.26:39658) 2023-10-01T07:59:06.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.536+0000 7f6049023700 1 -- 172.21.15.26:0/2802357678 learned_addr learned my addr 172.21.15.26:0/2802357678 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:06.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.537+0000 7f6049023700 1 -- 172.21.15.26:0/2802357678 >> v2:172.21.15.26:3300/0 conn(0x7f6044135e50 msgr2=0x7f6044138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:06.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.537+0000 7f6049023700 1 --2- 172.21.15.26:0/2802357678 >> v2:172.21.15.26:3300/0 conn(0x7f6044135e50 0x7f6044138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:06.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.537+0000 7f6049023700 1 -- 172.21.15.26:0/2802357678 >> v1:172.21.15.26:6789/0 conn(0x7f604409d6f0 legacy=0x7f604409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:06.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.537+0000 7f6049023700 1 -- 172.21.15.26:0/2802357678 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f604409b2d0 con 0x7f604409e1d0 2023-10-01T07:59:06.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.537+0000 7f6049023700 1 --2- 172.21.15.26:0/2802357678 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f604409e1d0 0x7f6044135910 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f603400bbc0 tx=0x7f603400bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34fe2645df0d9be4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:06.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.537+0000 7f6048822700 1 -- 172.21.15.26:0/2802357678 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603400dcf0 con 0x7f604409e1d0 2023-10-01T07:59:06.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.537+0000 7f6048822700 1 -- 172.21.15.26:0/2802357678 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603400de50 con 0x7f604409e1d0 2023-10-01T07:59:06.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.537+0000 7f6048822700 1 -- 172.21.15.26:0/2802357678 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6034010690 con 0x7f604409e1d0 2023-10-01T07:59:06.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.538+0000 7f604ba88700 1 -- 172.21.15.26:0/2802357678 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f604409e1d0 msgr2=0x7f6044135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:06.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.538+0000 7f604ba88700 1 --2- 172.21.15.26:0/2802357678 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f604409e1d0 0x7f6044135910 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f603400bbc0 tx=0x7f603400bed0 comp rx=0 tx=0).stop 2023-10-01T07:59:06.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.538+0000 7f604ba88700 1 -- 172.21.15.26:0/2802357678 shutdown_connections 2023-10-01T07:59:06.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.538+0000 7f604ba88700 1 --2- 172.21.15.26:0/2802357678 >> v2:172.21.15.26:3300/0 conn(0x7f6044135e50 0x7f6044138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:06.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.538+0000 7f604ba88700 1 --2- 172.21.15.26:0/2802357678 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f604409e1d0 0x7f6044135910 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:06.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.538+0000 7f604ba88700 1 -- 172.21.15.26:0/2802357678 >> 172.21.15.26:0/2802357678 conn(0x7f6044066f50 msgr2=0x7f604409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:06.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.538+0000 7f604ba88700 1 -- 172.21.15.26:0/2802357678 shutdown_connections 2023-10-01T07:59:06.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.538+0000 7f604ba88700 1 -- 172.21.15.26:0/2802357678 wait complete. 2023-10-01T07:59:06.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.540+0000 7f604ba88700 1 Processor -- start 2023-10-01T07:59:06.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.540+0000 7f604ba88700 1 -- start start 2023-10-01T07:59:06.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.540+0000 7f604ba88700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f604409d6f0 0x7f604411e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:06.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.540+0000 7f604ba88700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f604409e1d0 0x7f604411e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:06.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.540+0000 7f604ba88700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6044135e50 0x7f60441c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:06.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.540+0000 7f604ba88700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604411e070 con 0x7f6044135e50 2023-10-01T07:59:06.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.540+0000 7f604ba88700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f604411ee30 con 0x7f604409e1d0 2023-10-01T07:59:06.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.540+0000 7f604ba88700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60441213a0 con 0x7f604409d6f0 2023-10-01T07:59:06.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.540+0000 7f604a025700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6044135e50 0x7f60441c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:06.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.540+0000 7f6049824700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f604409d6f0 0x7f604411e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:06.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.540+0000 7f6049824700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f604409d6f0 0x7f604411e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59736/0 (socket says 172.21.15.26:59736) 2023-10-01T07:59:06.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.540+0000 7f604a025700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6044135e50 0x7f60441c8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39664/0 (socket says 172.21.15.26:39664) 2023-10-01T07:59:06.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.540+0000 7f6049824700 1 -- 172.21.15.26:0/4131971607 learned_addr learned my addr 172.21.15.26:0/4131971607 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:06.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.541+0000 7f6049023700 1 --2- 172.21.15.26:0/4131971607 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f604409e1d0 0x7f604411e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:06.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.541+0000 7f6049824700 1 -- 172.21.15.26:0/4131971607 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f604409e1d0 msgr2=0x7f604411e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:06.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.541+0000 7f6049824700 1 --2- 172.21.15.26:0/4131971607 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f604409e1d0 0x7f604411e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:06.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.541+0000 7f6049824700 1 -- 172.21.15.26:0/4131971607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6044135e50 msgr2=0x7f60441c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:06.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.541+0000 7f6049824700 1 --2- 172.21.15.26:0/4131971607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6044135e50 0x7f60441c8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:06.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.541+0000 7f6049824700 1 -- 172.21.15.26:0/4131971607 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603400b7f0 con 0x7f604409d6f0 2023-10-01T07:59:06.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.542+0000 7f6049824700 1 --2- 172.21.15.26:0/4131971607 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f604409d6f0 0x7f604411e3b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f604000c510 tx=0x7f604000c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:06.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.542+0000 7f603a7fc700 1 -- 172.21.15.26:0/4131971607 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60400052d0 con 0x7f604409d6f0 2023-10-01T07:59:06.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.542+0000 7f603a7fc700 1 -- 172.21.15.26:0/4131971607 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6040005430 con 0x7f604409d6f0 2023-10-01T07:59:06.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.542+0000 7f603a7fc700 1 -- 172.21.15.26:0/4131971607 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60400038c0 con 0x7f604409d6f0 2023-10-01T07:59:06.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.543+0000 7f604ba88700 1 -- 172.21.15.26:0/4131971607 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f604411fcc0 con 0x7f604409d6f0 2023-10-01T07:59:06.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.543+0000 7f604ba88700 1 -- 172.21.15.26:0/4131971607 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f604409c700 con 0x7f604409d6f0 2023-10-01T07:59:06.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.544+0000 7f603a7fc700 1 -- 172.21.15.26:0/4131971607 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6040003a20 con 0x7f604409d6f0 2023-10-01T07:59:06.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.544+0000 7f604ba88700 1 -- 172.21.15.26:0/4131971607 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6044074ea0 con 0x7f604409d6f0 2023-10-01T07:59:06.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.544+0000 7f603a7fc700 1 -- 172.21.15.26:0/4131971607 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f604003ea80 con 0x7f604409d6f0 2023-10-01T07:59:06.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.550+0000 7f603a7fc700 1 -- 172.21.15.26:0/4131971607 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6040018260 con 0x7f604409d6f0 2023-10-01T07:59:06.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.596+0000 7f3026fb8700 1 Processor -- start 2023-10-01T07:59:06.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.596+0000 7f3026fb8700 1 -- start start 2023-10-01T07:59:06.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.596+0000 7f3026fb8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f302009e1d0 0x7f3020135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:06.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.596+0000 7f3026fb8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3020135e50 0x7f3020138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:06.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.596+0000 7f3026fb8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f302009f130 con 0x7f302009d6f0 2023-10-01T07:59:06.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.596+0000 7f3026fb8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f302009f520 con 0x7f3020135e50 2023-10-01T07:59:06.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.596+0000 7f3026fb8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f302009e930 con 0x7f302009e1d0 2023-10-01T07:59:06.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.596+0000 7f301ffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f302009e1d0 0x7f3020135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:06.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.596+0000 7f301ffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f302009e1d0 0x7f3020135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59742/0 (socket says 172.21.15.26:59742) 2023-10-01T07:59:06.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.596+0000 7f301ffff700 1 -- 172.21.15.26:0/3775607155 learned_addr learned my addr 172.21.15.26:0/3775607155 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:06.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.596+0000 7f3024d54700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f302009d6f0 0x7f302009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41716/0 (socket says 172.21.15.26:41716) 2023-10-01T07:59:06.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.597+0000 7f3025555700 1 --2- 172.21.15.26:0/3775607155 >> v2:172.21.15.26:3300/0 conn(0x7f3020135e50 0x7f3020138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:06.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.597+0000 7f301f7fe700 1 -- 172.21.15.26:0/3775607155 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 84730328 0 0) 0x7f302009f130 con 0x7f302009d6f0 2023-10-01T07:59:06.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.597+0000 7f301f7fe700 1 -- 172.21.15.26:0/3775607155 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30100035b0 con 0x7f302009d6f0 2023-10-01T07:59:06.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.597+0000 7f3025555700 1 -- 172.21.15.26:0/3775607155 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f302009e1d0 msgr2=0x7f3020135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:06.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.597+0000 7f3025555700 1 --2- 172.21.15.26:0/3775607155 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f302009e1d0 0x7f3020135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:06.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.597+0000 7f3025555700 1 -- 172.21.15.26:0/3775607155 >> v1:172.21.15.26:6789/0 conn(0x7f302009d6f0 legacy=0x7f302009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:06.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.597+0000 7f3025555700 1 -- 172.21.15.26:0/3775607155 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f302009b2d0 con 0x7f3020135e50 2023-10-01T07:59:06.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.597+0000 7f3025555700 1 --2- 172.21.15.26:0/3775607155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3020135e50 0x7f3020138230 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f3018009dc0 tx=0x7f301800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c3a1f0146c4ae0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:06.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.598+0000 7f301f7fe700 1 -- 172.21.15.26:0/3775607155 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301800e070 con 0x7f3020135e50 2023-10-01T07:59:06.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.598+0000 7f301f7fe700 1 -- 172.21.15.26:0/3775607155 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301800bae0 con 0x7f3020135e50 2023-10-01T07:59:06.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.598+0000 7f301f7fe700 1 -- 172.21.15.26:0/3775607155 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301800be90 con 0x7f3020135e50 2023-10-01T07:59:06.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.598+0000 7f3026fb8700 1 -- 172.21.15.26:0/3775607155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3020135e50 msgr2=0x7f3020138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:06.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.598+0000 7f3026fb8700 1 --2- 172.21.15.26:0/3775607155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3020135e50 0x7f3020138230 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f3018009dc0 tx=0x7f301800b330 comp rx=0 tx=0).stop 2023-10-01T07:59:06.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.598+0000 7f3026fb8700 1 -- 172.21.15.26:0/3775607155 shutdown_connections 2023-10-01T07:59:06.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.598+0000 7f3026fb8700 1 --2- 172.21.15.26:0/3775607155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3020135e50 0x7f3020138230 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:06.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.598+0000 7f3026fb8700 1 --2- 172.21.15.26:0/3775607155 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f302009e1d0 0x7f3020135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:06.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.598+0000 7f3026fb8700 1 -- 172.21.15.26:0/3775607155 >> 172.21.15.26:0/3775607155 conn(0x7f3020066f50 msgr2=0x7f302009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:06.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.599+0000 7f3026fb8700 1 -- 172.21.15.26:0/3775607155 shutdown_connections 2023-10-01T07:59:06.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.599+0000 7f3026fb8700 1 -- 172.21.15.26:0/3775607155 wait complete. 2023-10-01T07:59:06.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.600+0000 7f3026fb8700 1 Processor -- start 2023-10-01T07:59:06.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.600+0000 7f3026fb8700 1 -- start start 2023-10-01T07:59:06.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.601+0000 7f3026fb8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f302009d6f0 0x7f302011d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:06.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.601+0000 7f3026fb8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f302009e1d0 0x7f302011ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:06.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.601+0000 7f3026fb8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3020135e50 0x7f302011e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:06.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.601+0000 7f3026fb8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3020120eb0 con 0x7f302009e1d0 2023-10-01T07:59:06.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.601+0000 7f3026fb8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f302011f130 con 0x7f3020135e50 2023-10-01T07:59:06.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.601+0000 7f3026fb8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30200a2020 con 0x7f302009d6f0 2023-10-01T07:59:06.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.601+0000 7f3025555700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3020135e50 0x7f302011e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:06.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.601+0000 7f3025555700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3020135e50 0x7f302011e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35756/0 (socket says 172.21.15.26:35756) 2023-10-01T07:59:06.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.601+0000 7f3025555700 1 -- 172.21.15.26:0/1077108926 learned_addr learned my addr 172.21.15.26:0/1077108926 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:06.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.601+0000 7f3024d54700 1 --2- 172.21.15.26:0/1077108926 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f302009d6f0 0x7f302011d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:06.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.601+0000 7f301ffff700 1 --2- 172.21.15.26:0/1077108926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f302009e1d0 0x7f302011ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:06.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.602+0000 7f3024d54700 1 -- 172.21.15.26:0/1077108926 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3020135e50 msgr2=0x7f302011e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:06.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.602+0000 7f3024d54700 1 --2- 172.21.15.26:0/1077108926 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3020135e50 0x7f302011e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:06.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.602+0000 7f3024d54700 1 -- 172.21.15.26:0/1077108926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f302009e1d0 msgr2=0x7f302011ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:06.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.602+0000 7f3024d54700 1 --2- 172.21.15.26:0/1077108926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f302009e1d0 0x7f302011ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:06.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.602+0000 7f3024d54700 1 -- 172.21.15.26:0/1077108926 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3018009a70 con 0x7f302009d6f0 2023-10-01T07:59:06.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.602+0000 7f3025555700 1 --2- 172.21.15.26:0/1077108926 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3020135e50 0x7f302011e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:06.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.602+0000 7f3024d54700 1 --2- 172.21.15.26:0/1077108926 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f302009d6f0 0x7f302011d890 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f301400c490 tx=0x7f301400c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:06.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.602+0000 7f301d7fa700 1 -- 172.21.15.26:0/1077108926 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301400cea0 con 0x7f302009d6f0 2023-10-01T07:59:06.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.602+0000 7f301d7fa700 1 -- 172.21.15.26:0/1077108926 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3014005cb0 con 0x7f302009d6f0 2023-10-01T07:59:06.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.602+0000 7f3026fb8700 1 -- 172.21.15.26:0/1077108926 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f302009c700 con 0x7f302009d6f0 2023-10-01T07:59:06.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.602+0000 7f301d7fa700 1 -- 172.21.15.26:0/1077108926 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3014007310 con 0x7f302009d6f0 2023-10-01T07:59:06.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.602+0000 7f3026fb8700 1 -- 172.21.15.26:0/1077108926 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3020121840 con 0x7f302009d6f0 2023-10-01T07:59:06.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.603+0000 7f3026fb8700 1 -- 172.21.15.26:0/1077108926 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3020074ea0 con 0x7f302009d6f0 2023-10-01T07:59:06.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.604+0000 7f301d7fa700 1 -- 172.21.15.26:0/1077108926 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3014007470 con 0x7f302009d6f0 2023-10-01T07:59:06.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.604+0000 7f301d7fa700 1 -- 172.21.15.26:0/1077108926 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f301403e9d0 con 0x7f302009d6f0 2023-10-01T07:59:06.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.609+0000 7f301d7fa700 1 -- 172.21.15.26:0/1077108926 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f301401b3b0 con 0x7f302009d6f0 2023-10-01T07:59:06.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.640+0000 7f81596bb700 1 Processor -- start 2023-10-01T07:59:06.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.640+0000 7f81596bb700 1 -- start start 2023-10-01T07:59:06.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.641+0000 7f81596bb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f815406f5d0 0x7f815412ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:06.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.641+0000 7f81596bb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8154135c20 0x7f8154138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:06.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.641+0000 7f81596bb700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f815406fa40 con 0x7f815412cf60 2023-10-01T07:59:06.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.641+0000 7f81596bb700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f815412cd90 con 0x7f8154135c20 2023-10-01T07:59:06.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.641+0000 7f81596bb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8154071780 con 0x7f815406f5d0 2023-10-01T07:59:06.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.641+0000 7f8152ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f815412cf60 0x7f815412f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41718/0 (socket says 172.21.15.26:41718) 2023-10-01T07:59:06.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.641+0000 7f8152ffd700 1 -- 172.21.15.26:0/2077960140 learned_addr learned my addr 172.21.15.26:0/2077960140 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:59:06.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.641+0000 7f81527fc700 1 --2- 172.21.15.26:0/2077960140 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f815406f5d0 0x7f815412ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:06.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.641+0000 7f81537fe700 1 --2- 172.21.15.26:0/2077960140 >> v2:172.21.15.26:3300/0 conn(0x7f8154135c20 0x7f8154138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:06.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.641+0000 7f81527fc700 1 -- 172.21.15.26:0/2077960140 >> v2:172.21.15.26:3300/0 conn(0x7f8154135c20 msgr2=0x7f8154138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:06.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.641+0000 7f81527fc700 1 --2- 172.21.15.26:0/2077960140 >> v2:172.21.15.26:3300/0 conn(0x7f8154135c20 0x7f8154138000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:06.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.641+0000 7f81527fc700 1 -- 172.21.15.26:0/2077960140 >> v1:172.21.15.26:6789/0 conn(0x7f815412cf60 legacy=0x7f815412f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:06.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.641+0000 7f81527fc700 1 -- 172.21.15.26:0/2077960140 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8154071a40 con 0x7f815406f5d0 2023-10-01T07:59:06.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.642+0000 7f81527fc700 1 --2- 172.21.15.26:0/2077960140 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f815406f5d0 0x7f815412ffc0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f8148009840 tx=0x7f8148009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed6d401b09661e7b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:06.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.642+0000 7f8151ffb700 1 -- 172.21.15.26:0/2077960140 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8148011830 con 0x7f815406f5d0 2023-10-01T07:59:06.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.642+0000 7f8151ffb700 1 -- 172.21.15.26:0/2077960140 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8148011990 con 0x7f815406f5d0 2023-10-01T07:59:06.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.642+0000 7f8151ffb700 1 -- 172.21.15.26:0/2077960140 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8148011d20 con 0x7f815406f5d0 2023-10-01T07:59:06.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.643+0000 7f81596bb700 1 -- 172.21.15.26:0/2077960140 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f815406f5d0 msgr2=0x7f815412ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:06.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.643+0000 7f81596bb700 1 --2- 172.21.15.26:0/2077960140 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f815406f5d0 0x7f815412ffc0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f8148009840 tx=0x7f8148009b50 comp rx=0 tx=0).stop 2023-10-01T07:59:06.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.643+0000 7f81596bb700 1 -- 172.21.15.26:0/2077960140 shutdown_connections 2023-10-01T07:59:06.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.643+0000 7f81596bb700 1 --2- 172.21.15.26:0/2077960140 >> v2:172.21.15.26:3300/0 conn(0x7f8154135c20 0x7f8154138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:06.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.643+0000 7f81596bb700 1 --2- 172.21.15.26:0/2077960140 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f815406f5d0 0x7f815412ffc0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:06.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.643+0000 7f81596bb700 1 -- 172.21.15.26:0/2077960140 >> 172.21.15.26:0/2077960140 conn(0x7f81540a2aa0 msgr2=0x7f81540a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:06.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.643+0000 7f81596bb700 1 -- 172.21.15.26:0/2077960140 shutdown_connections 2023-10-01T07:59:06.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.643+0000 7f81596bb700 1 -- 172.21.15.26:0/2077960140 wait complete. 2023-10-01T07:59:06.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.645+0000 7f81596bb700 1 Processor -- start 2023-10-01T07:59:06.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.645+0000 7f81596bb700 1 -- start start 2023-10-01T07:59:06.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.645+0000 7f81596bb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f815406f5d0 0x7f8154130bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:06.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.645+0000 7f81596bb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f815412cf60 0x7f8154131100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:06.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.646+0000 7f81596bb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8154135c20 0x7f8154131640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:06.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.646+0000 7f81596bb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8154132640 con 0x7f8154135c20 2023-10-01T07:59:06.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.646+0000 7f81596bb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8154134330 con 0x7f815406f5d0 2023-10-01T07:59:06.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.646+0000 7f81596bb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8154132830 con 0x7f815412cf60 2023-10-01T07:59:06.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.646+0000 7f81527fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f815412cf60 0x7f8154131100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:06.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.646+0000 7f81527fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f815412cf60 0x7f8154131100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59760/0 (socket says 172.21.15.26:59760) 2023-10-01T07:59:06.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.646+0000 7f81527fc700 1 -- 172.21.15.26:0/3873843815 learned_addr learned my addr 172.21.15.26:0/3873843815 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:06.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.646+0000 7f8152ffd700 1 --2- 172.21.15.26:0/3873843815 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f815406f5d0 0x7f8154130bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:06.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.646+0000 7f81537fe700 1 --2- 172.21.15.26:0/3873843815 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8154135c20 0x7f8154131640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:06.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.646+0000 7f81527fc700 1 -- 172.21.15.26:0/3873843815 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f815406f5d0 msgr2=0x7f8154130bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:06.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.646+0000 7f81527fc700 1 --2- 172.21.15.26:0/3873843815 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f815406f5d0 0x7f8154130bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:06.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.646+0000 7f81527fc700 1 -- 172.21.15.26:0/3873843815 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8154135c20 msgr2=0x7f8154131640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:06.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.646+0000 7f81527fc700 1 --2- 172.21.15.26:0/3873843815 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8154135c20 0x7f8154131640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:06.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.646+0000 7f81527fc700 1 -- 172.21.15.26:0/3873843815 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81480094a0 con 0x7f815412cf60 2023-10-01T07:59:06.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.646+0000 7f81527fc700 1 --2- 172.21.15.26:0/3873843815 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f815412cf60 0x7f8154131100 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f81480090b0 tx=0x7f8148004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:06.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.647+0000 7f813b7fe700 1 -- 172.21.15.26:0/3873843815 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8148004400 con 0x7f815412cf60 2023-10-01T07:59:06.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.647+0000 7f813b7fe700 1 -- 172.21.15.26:0/3873843815 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814801f070 con 0x7f815412cf60 2023-10-01T07:59:06.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.647+0000 7f81596bb700 1 -- 172.21.15.26:0/3873843815 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81541330c0 con 0x7f815412cf60 2023-10-01T07:59:06.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.647+0000 7f813b7fe700 1 -- 172.21.15.26:0/3873843815 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81480038a0 con 0x7f815412cf60 2023-10-01T07:59:06.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.647+0000 7f81596bb700 1 -- 172.21.15.26:0/3873843815 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8154134a30 con 0x7f815412cf60 2023-10-01T07:59:06.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.648+0000 7f813b7fe700 1 -- 172.21.15.26:0/3873843815 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8148021030 con 0x7f815412cf60 2023-10-01T07:59:06.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.648+0000 7f81596bb700 1 -- 172.21.15.26:0/3873843815 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8154074ea0 con 0x7f815412cf60 2023-10-01T07:59:06.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.648+0000 7f813b7fe700 1 -- 172.21.15.26:0/3873843815 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f81480408c0 con 0x7f815412cf60 2023-10-01T07:59:06.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.657+0000 7f813b7fe700 1 -- 172.21.15.26:0/3873843815 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f81480199a0 con 0x7f815412cf60 2023-10-01T07:59:06.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.690+0000 7f88bde52700 1 Processor -- start 2023-10-01T07:59:06.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.691+0000 7f88bde52700 1 -- start start 2023-10-01T07:59:06.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.691+0000 7f88bde52700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f88b809d9f0 0x7f88b8136530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:06.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.691+0000 7f88bde52700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f88b8136a70 0x7f88b8138e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:06.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.691+0000 7f88bde52700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b809e130 con 0x7f88b81316c0 2023-10-01T07:59:06.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.691+0000 7f88bde52700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b81321a0 con 0x7f88b8136a70 2023-10-01T07:59:06.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.691+0000 7f88bde52700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88b81312b0 con 0x7f88b809d9f0 2023-10-01T07:59:06.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.692+0000 7f88b6ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f88b809d9f0 0x7f88b8136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:06.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.692+0000 7f88b6ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f88b809d9f0 0x7f88b8136530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59764/0 (socket says 172.21.15.26:59764) 2023-10-01T07:59:06.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.692+0000 7f88b6ffd700 1 -- 172.21.15.26:0/1593681832 learned_addr learned my addr 172.21.15.26:0/1593681832 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:06.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.692+0000 7f88b7fff700 1 --2- 172.21.15.26:0/1593681832 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f88b8136a70 0x7f88b8138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:06.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.692+0000 7f88b67fc700 1 -- 172.21.15.26:0/1593681832 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 790875000 0 0) 0x7f88a8001110 con 0x7f88b81316c0 2023-10-01T07:59:06.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.692+0000 7f88b6ffd700 1 -- 172.21.15.26:0/1593681832 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f88b8136a70 msgr2=0x7f88b8138e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:06.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.692+0000 7f88b6ffd700 1 --2- 172.21.15.26:0/1593681832 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f88b8136a70 0x7f88b8138e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:06.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.692+0000 7f88b6ffd700 1 -- 172.21.15.26:0/1593681832 >> v1:172.21.15.26:6789/0 conn(0x7f88b81316c0 legacy=0x7f88b8131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:06.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.692+0000 7f88b6ffd700 1 -- 172.21.15.26:0/1593681832 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b809f6e0 con 0x7f88b809d9f0 2023-10-01T07:59:06.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.692+0000 7f88b7fff700 1 --2- 172.21.15.26:0/1593681832 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f88b8136a70 0x7f88b8138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:59:06.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.692+0000 7f88b6ffd700 1 --2- 172.21.15.26:0/1593681832 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f88b809d9f0 0x7f88b8136530 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f88ac009950 tx=0x7f88ac009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db99e86c3c70269c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:06.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.692+0000 7f88b67fc700 1 -- 172.21.15.26:0/1593681832 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac009ea0 con 0x7f88b809d9f0 2023-10-01T07:59:06.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.693+0000 7f88b67fc700 1 -- 172.21.15.26:0/1593681832 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ac00ba20 con 0x7f88b809d9f0 2023-10-01T07:59:06.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.693+0000 7f88b67fc700 1 -- 172.21.15.26:0/1593681832 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac00bdb0 con 0x7f88b809d9f0 2023-10-01T07:59:06.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.693+0000 7f88bde52700 1 -- 172.21.15.26:0/1593681832 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f88b809d9f0 msgr2=0x7f88b8136530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:06.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.693+0000 7f88bde52700 1 --2- 172.21.15.26:0/1593681832 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f88b809d9f0 0x7f88b8136530 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f88ac009950 tx=0x7f88ac009c60 comp rx=0 tx=0).stop 2023-10-01T07:59:06.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.694+0000 7f88bde52700 1 -- 172.21.15.26:0/1593681832 shutdown_connections 2023-10-01T07:59:06.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.694+0000 7f88bde52700 1 --2- 172.21.15.26:0/1593681832 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f88b8136a70 0x7f88b8138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:06.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.694+0000 7f88bde52700 1 --2- 172.21.15.26:0/1593681832 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f88b809d9f0 0x7f88b8136530 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:06.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.694+0000 7f88bde52700 1 -- 172.21.15.26:0/1593681832 >> 172.21.15.26:0/1593681832 conn(0x7f88b8066f50 msgr2=0x7f88b809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:06.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.694+0000 7f88bde52700 1 -- 172.21.15.26:0/1593681832 shutdown_connections 2023-10-01T07:59:06.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.694+0000 7f88bde52700 1 -- 172.21.15.26:0/1593681832 wait complete. 2023-10-01T07:59:06.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.695+0000 7f88bde52700 1 Processor -- start 2023-10-01T07:59:06.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.695+0000 7f88bde52700 1 -- start start 2023-10-01T07:59:06.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.696+0000 7f88bde52700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88b809d9f0 0x7f88b812ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:06.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.696+0000 7f88bde52700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f88b81316c0 0x7f88b809a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:06.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.696+0000 7f88bde52700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f88b8136a70 0x7f88b809a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:06.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.696+0000 7f88bde52700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b80726e0 con 0x7f88b809d9f0 2023-10-01T07:59:06.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.696+0000 7f88bde52700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b809c010 con 0x7f88b8136a70 2023-10-01T07:59:06.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.696+0000 7f88bde52700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88b8136550 con 0x7f88b81316c0 2023-10-01T07:59:06.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.696+0000 7f88b77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88b809d9f0 0x7f88b812ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:06.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.696+0000 7f88b7fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f88b8136a70 0x7f88b809a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:06.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.696+0000 7f88b77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88b809d9f0 0x7f88b812ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39692/0 (socket says 172.21.15.26:39692) 2023-10-01T07:59:06.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.696+0000 7f88b77fe700 1 -- 172.21.15.26:0/1896379051 learned_addr learned my addr 172.21.15.26:0/1896379051 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:06.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.696+0000 7f88b6ffd700 1 --2- 172.21.15.26:0/1896379051 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f88b81316c0 0x7f88b809a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:06.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.697+0000 7f88b77fe700 1 -- 172.21.15.26:0/1896379051 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f88b81316c0 msgr2=0x7f88b809a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:06.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.697+0000 7f88b77fe700 1 --2- 172.21.15.26:0/1896379051 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f88b81316c0 0x7f88b809a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:06.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.697+0000 7f88b77fe700 1 -- 172.21.15.26:0/1896379051 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f88b8136a70 msgr2=0x7f88b809a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:06.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.697+0000 7f88b77fe700 1 --2- 172.21.15.26:0/1896379051 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f88b8136a70 0x7f88b809a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:06.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.697+0000 7f88b77fe700 1 -- 172.21.15.26:0/1896379051 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ac009550 con 0x7f88b809d9f0 2023-10-01T07:59:06.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.697+0000 7f88b77fe700 1 --2- 172.21.15.26:0/1896379051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88b809d9f0 0x7f88b812ae00 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f88a800c780 tx=0x7f88a800ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:06.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.697+0000 7f889ffff700 1 -- 172.21.15.26:0/1896379051 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a80054e0 con 0x7f88b809d9f0 2023-10-01T07:59:06.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.697+0000 7f889ffff700 1 -- 172.21.15.26:0/1896379051 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a8003680 con 0x7f88b809d9f0 2023-10-01T07:59:06.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.697+0000 7f88bde52700 1 -- 172.21.15.26:0/1896379051 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b812b900 con 0x7f88b809d9f0 2023-10-01T07:59:06.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.697+0000 7f88bde52700 1 -- 172.21.15.26:0/1896379051 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b8135990 con 0x7f88b809d9f0 2023-10-01T07:59:06.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.697+0000 7f889ffff700 1 -- 172.21.15.26:0/1896379051 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a8003a30 con 0x7f88b809d9f0 2023-10-01T07:59:06.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.698+0000 7f889ffff700 1 -- 172.21.15.26:0/1896379051 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f88a8003b90 con 0x7f88b809d9f0 2023-10-01T07:59:06.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.699+0000 7f889ffff700 1 -- 172.21.15.26:0/1896379051 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f88a803e930 con 0x7f88b809d9f0 2023-10-01T07:59:06.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.699+0000 7f88bde52700 1 -- 172.21.15.26:0/1896379051 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88980052e0 con 0x7f88b809d9f0 2023-10-01T07:59:06.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.704+0000 7f889ffff700 1 -- 172.21.15.26:0/1896379051 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f88a8017080 con 0x7f88b809d9f0 2023-10-01T07:59:06.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.768+0000 7f604ba88700 1 -- 172.21.15.26:0/4131971607 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f604406c360 con 0x7f604409d6f0 2023-10-01T07:59:06.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.768+0000 7f603a7fc700 1 -- 172.21.15.26:0/4131971607 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6040017070 con 0x7f604409d6f0 2023-10-01T07:59:06.769 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:06.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.770+0000 7f604ba88700 1 -- 172.21.15.26:0/4131971607 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f604409d6f0 msgr2=0x7f604411e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:06.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.770+0000 7f604ba88700 1 --2- 172.21.15.26:0/4131971607 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f604409d6f0 0x7f604411e3b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f604000c510 tx=0x7f604000c820 comp rx=0 tx=0).stop 2023-10-01T07:59:06.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.770+0000 7f604ba88700 1 -- 172.21.15.26:0/4131971607 shutdown_connections 2023-10-01T07:59:06.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.770+0000 7f604ba88700 1 --2- 172.21.15.26:0/4131971607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6044135e50 0x7f60441c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:06.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.770+0000 7f604ba88700 1 --2- 172.21.15.26:0/4131971607 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f604409d6f0 0x7f604411e3b0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:06.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.770+0000 7f604ba88700 1 --2- 172.21.15.26:0/4131971607 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f604409e1d0 0x7f604411e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:06.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.770+0000 7f604ba88700 1 -- 172.21.15.26:0/4131971607 >> 172.21.15.26:0/4131971607 conn(0x7f6044066f50 msgr2=0x7f60440a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:06.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.771+0000 7f604ba88700 1 -- 172.21.15.26:0/4131971607 shutdown_connections 2023-10-01T07:59:06.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.771+0000 7f604ba88700 1 -- 172.21.15.26:0/4131971607 wait complete. 2023-10-01T07:59:06.786 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:06.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.826+0000 7f3026fb8700 1 -- 172.21.15.26:0/1077108926 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f302006c360 con 0x7f302009d6f0 2023-10-01T07:59:06.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.827+0000 7f301d7fa700 1 -- 172.21.15.26:0/1077108926 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3014017030 con 0x7f302009d6f0 2023-10-01T07:59:06.827 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:06.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.830+0000 7f3026fb8700 1 -- 172.21.15.26:0/1077108926 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f302009d6f0 msgr2=0x7f302011d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:06.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.830+0000 7f3026fb8700 1 --2- 172.21.15.26:0/1077108926 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f302009d6f0 0x7f302011d890 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f301400c490 tx=0x7f301400c7a0 comp rx=0 tx=0).stop 2023-10-01T07:59:06.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.830+0000 7f3026fb8700 1 -- 172.21.15.26:0/1077108926 shutdown_connections 2023-10-01T07:59:06.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.830+0000 7f3026fb8700 1 --2- 172.21.15.26:0/1077108926 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3020135e50 0x7f302011e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:06.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.830+0000 7f3026fb8700 1 --2- 172.21.15.26:0/1077108926 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f302009d6f0 0x7f302011d890 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:06.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.830+0000 7f3026fb8700 1 --2- 172.21.15.26:0/1077108926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f302009e1d0 0x7f302011ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:06.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.830+0000 7f3026fb8700 1 -- 172.21.15.26:0/1077108926 >> 172.21.15.26:0/1077108926 conn(0x7f3020066f50 msgr2=0x7f3020132780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:06.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.830+0000 7f3026fb8700 1 -- 172.21.15.26:0/1077108926 shutdown_connections 2023-10-01T07:59:06.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.830+0000 7f3026fb8700 1 -- 172.21.15.26:0/1077108926 wait complete. 2023-10-01T07:59:06.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:06.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.867+0000 7f81596bb700 1 -- 172.21.15.26:0/3873843815 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f81540713a0 con 0x7f815412cf60 2023-10-01T07:59:06.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.867+0000 7f813b7fe700 1 -- 172.21.15.26:0/3873843815 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8148015020 con 0x7f815412cf60 2023-10-01T07:59:06.868 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:06.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.869+0000 7f81596bb700 1 -- 172.21.15.26:0/3873843815 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f815412cf60 msgr2=0x7f8154131100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:06.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.869+0000 7f81596bb700 1 --2- 172.21.15.26:0/3873843815 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f815412cf60 0x7f8154131100 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f81480090b0 tx=0x7f8148004750 comp rx=0 tx=0).stop 2023-10-01T07:59:06.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.869+0000 7f81596bb700 1 -- 172.21.15.26:0/3873843815 shutdown_connections 2023-10-01T07:59:06.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.869+0000 7f81596bb700 1 --2- 172.21.15.26:0/3873843815 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8154135c20 0x7f8154131640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:06.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.869+0000 7f81596bb700 1 --2- 172.21.15.26:0/3873843815 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f815406f5d0 0x7f8154130bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:06.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.869+0000 7f81596bb700 1 --2- 172.21.15.26:0/3873843815 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f815412cf60 0x7f8154131100 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:06.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.869+0000 7f81596bb700 1 -- 172.21.15.26:0/3873843815 >> 172.21.15.26:0/3873843815 conn(0x7f81540a2aa0 msgr2=0x7f815412f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:06.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.869+0000 7f81596bb700 1 -- 172.21.15.26:0/3873843815 shutdown_connections 2023-10-01T07:59:06.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.869+0000 7f81596bb700 1 -- 172.21.15.26:0/3873843815 wait complete. 2023-10-01T07:59:06.884 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:06.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.916+0000 7f88bde52700 1 -- 172.21.15.26:0/1896379051 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8898005590 con 0x7f88b809d9f0 2023-10-01T07:59:06.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.916+0000 7f889ffff700 1 -- 172.21.15.26:0/1896379051 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f88a801b3b0 con 0x7f88b809d9f0 2023-10-01T07:59:06.917 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:06.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.919+0000 7f88bde52700 1 -- 172.21.15.26:0/1896379051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88b809d9f0 msgr2=0x7f88b812ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:06.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.919+0000 7f88bde52700 1 --2- 172.21.15.26:0/1896379051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88b809d9f0 0x7f88b812ae00 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f88a800c780 tx=0x7f88a800ca90 comp rx=0 tx=0).stop 2023-10-01T07:59:06.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.919+0000 7f88bde52700 1 -- 172.21.15.26:0/1896379051 shutdown_connections 2023-10-01T07:59:06.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.919+0000 7f88bde52700 1 --2- 172.21.15.26:0/1896379051 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f88b8136a70 0x7f88b809a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:06.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.919+0000 7f88bde52700 1 --2- 172.21.15.26:0/1896379051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88b809d9f0 0x7f88b812ae00 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:06.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.919+0000 7f88bde52700 1 --2- 172.21.15.26:0/1896379051 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f88b81316c0 0x7f88b809a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:06.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.919+0000 7f88bde52700 1 -- 172.21.15.26:0/1896379051 >> 172.21.15.26:0/1896379051 conn(0x7f88b8066f50 msgr2=0x7f88b8136e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:06.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.919+0000 7f88bde52700 1 -- 172.21.15.26:0/1896379051 shutdown_connections 2023-10-01T07:59:06.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:06.919+0000 7f88bde52700 1 -- 172.21.15.26:0/1896379051 wait complete. 2023-10-01T07:59:06.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:07.787 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:07.846 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:07.885 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:07.934 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:07.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.938+0000 7f61025ca700 1 Processor -- start 2023-10-01T07:59:07.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.938+0000 7f61025ca700 1 -- start start 2023-10-01T07:59:07.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.938+0000 7f61025ca700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f60fc0a0a30 0x7f60fc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:07.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.938+0000 7f61025ca700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60fc09d630 0x7f60fc0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:07.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.938+0000 7f61025ca700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f60fc133930 0x7f60fc133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:07.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.938+0000 7f61025ca700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60fc0a2a70 con 0x7f60fc0a0a30 2023-10-01T07:59:07.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.938+0000 7f61025ca700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc0a01d0 con 0x7f60fc09d630 2023-10-01T07:59:07.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.938+0000 7f61025ca700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc09e2b0 con 0x7f60fc133930 2023-10-01T07:59:07.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.938+0000 7f60fbfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f60fc0a0a30 0x7f60fc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:07.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.938+0000 7f60fbfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f60fc0a0a30 0x7f60fc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39696/0 (socket says 172.21.15.26:39696) 2023-10-01T07:59:07.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.938+0000 7f60fb7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60fc09d630 0x7f60fc0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:07.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.938+0000 7f60fbfff700 1 -- 172.21.15.26:0/2114400807 learned_addr learned my addr 172.21.15.26:0/2114400807 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:07.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.939+0000 7f60fbfff700 1 -- 172.21.15.26:0/2114400807 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f60fc133930 msgr2=0x7f60fc133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:07.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.939+0000 7f60fbfff700 1 --2- 172.21.15.26:0/2114400807 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f60fc133930 0x7f60fc133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:07.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.939+0000 7f60fbfff700 1 -- 172.21.15.26:0/2114400807 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60fc09d630 msgr2=0x7f60fc0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:07.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.939+0000 7f60fbfff700 1 --2- 172.21.15.26:0/2114400807 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60fc09d630 0x7f60fc0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:07.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.939+0000 7f60fbfff700 1 -- 172.21.15.26:0/2114400807 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60fc09dc50 con 0x7f60fc0a0a30 2023-10-01T07:59:07.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.939+0000 7f60fb7fe700 1 --2- 172.21.15.26:0/2114400807 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60fc09d630 0x7f60fc0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:07.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.939+0000 7f60fbfff700 1 --2- 172.21.15.26:0/2114400807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60fc0a0a30 0x7f60fc0a0e00 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f60ec0098f0 tx=0x7f60ec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=901937d28edd39b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:07.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.939+0000 7f60faffd700 1 -- 172.21.15.26:0/2114400807 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec011830 con 0x7f60fc0a0a30 2023-10-01T07:59:07.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.939+0000 7f60faffd700 1 -- 172.21.15.26:0/2114400807 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ec011990 con 0x7f60fc0a0a30 2023-10-01T07:59:07.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.939+0000 7f60faffd700 1 -- 172.21.15.26:0/2114400807 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec011d20 con 0x7f60fc0a0a30 2023-10-01T07:59:07.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.940+0000 7f61025ca700 1 -- 172.21.15.26:0/2114400807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60fc0a0a30 msgr2=0x7f60fc0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:07.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.940+0000 7f61025ca700 1 --2- 172.21.15.26:0/2114400807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60fc0a0a30 0x7f60fc0a0e00 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f60ec0098f0 tx=0x7f60ec009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:07.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.940+0000 7f61025ca700 1 -- 172.21.15.26:0/2114400807 shutdown_connections 2023-10-01T07:59:07.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.940+0000 7f61025ca700 1 --2- 172.21.15.26:0/2114400807 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f60fc133930 0x7f60fc133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:07.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.940+0000 7f61025ca700 1 --2- 172.21.15.26:0/2114400807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60fc0a0a30 0x7f60fc0a0e00 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:07.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.940+0000 7f61025ca700 1 --2- 172.21.15.26:0/2114400807 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60fc09d630 0x7f60fc0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:07.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.940+0000 7f61025ca700 1 -- 172.21.15.26:0/2114400807 >> 172.21.15.26:0/2114400807 conn(0x7f60fc0a3050 msgr2=0x7f60fc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:07.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.940+0000 7f61025ca700 1 -- 172.21.15.26:0/2114400807 shutdown_connections 2023-10-01T07:59:07.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.940+0000 7f61025ca700 1 -- 172.21.15.26:0/2114400807 wait complete. 2023-10-01T07:59:07.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.941+0000 7f61025ca700 1 Processor -- start 2023-10-01T07:59:07.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.942+0000 7f61025ca700 1 -- start start 2023-10-01T07:59:07.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.942+0000 7f61025ca700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60fc09d630 0x7f60fc1c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:07.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.942+0000 7f61025ca700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f60fc0a0a30 0x7f60fc1c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:07.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.942+0000 7f61025ca700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60fc133930 0x7f60fc1c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:07.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.942+0000 7f61025ca700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc1221a0 con 0x7f60fc133930 2023-10-01T07:59:07.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.942+0000 7f61025ca700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc133510 con 0x7f60fc09d630 2023-10-01T07:59:07.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.942+0000 7f61025ca700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc1206f0 con 0x7f60fc0a0a30 2023-10-01T07:59:07.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.942+0000 7f60fbfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60fc09d630 0x7f60fc1c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:07.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.942+0000 7f60fbfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60fc09d630 0x7f60fc1c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35786/0 (socket says 172.21.15.26:35786) 2023-10-01T07:59:07.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.942+0000 7f60fbfff700 1 -- 172.21.15.26:0/3722525499 learned_addr learned my addr 172.21.15.26:0/3722525499 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:07.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.942+0000 7f6100b67700 1 --2- 172.21.15.26:0/3722525499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60fc133930 0x7f60fc1c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:07.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.943+0000 7f60fb7fe700 1 --2- 172.21.15.26:0/3722525499 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f60fc0a0a30 0x7f60fc1c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:07.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.943+0000 7f60fbfff700 1 -- 172.21.15.26:0/3722525499 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f60fc0a0a30 msgr2=0x7f60fc1c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:07.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.943+0000 7f60fbfff700 1 --2- 172.21.15.26:0/3722525499 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f60fc0a0a30 0x7f60fc1c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:07.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.943+0000 7f60fbfff700 1 -- 172.21.15.26:0/3722525499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60fc133930 msgr2=0x7f60fc1c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:07.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.943+0000 7f60fbfff700 1 --2- 172.21.15.26:0/3722525499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60fc133930 0x7f60fc1c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:07.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.943+0000 7f60fbfff700 1 -- 172.21.15.26:0/3722525499 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f00094a0 con 0x7f60fc09d630 2023-10-01T07:59:07.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.943+0000 7f60fb7fe700 1 --2- 172.21.15.26:0/3722525499 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f60fc0a0a30 0x7f60fc1c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:59:07.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.943+0000 7f60fbfff700 1 --2- 172.21.15.26:0/3722525499 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60fc09d630 0x7f60fc1c8190 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f60ec009c40 tx=0x7f60ec004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:07.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.943+0000 7f60f8ff9700 1 -- 172.21.15.26:0/3722525499 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec004510 con 0x7f60fc09d630 2023-10-01T07:59:07.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.943+0000 7f60f8ff9700 1 -- 172.21.15.26:0/3722525499 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ec0036a0 con 0x7f60fc09d630 2023-10-01T07:59:07.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.943+0000 7f61025ca700 1 -- 172.21.15.26:0/3722525499 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60ec009550 con 0x7f60fc09d630 2023-10-01T07:59:07.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.943+0000 7f60f8ff9700 1 -- 172.21.15.26:0/3722525499 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec003a30 con 0x7f60fc09d630 2023-10-01T07:59:07.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.943+0000 7f61025ca700 1 -- 172.21.15.26:0/3722525499 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60fc122c10 con 0x7f60fc09d630 2023-10-01T07:59:07.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.944+0000 7f60f8ff9700 1 -- 172.21.15.26:0/3722525499 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f60ec021070 con 0x7f60fc09d630 2023-10-01T07:59:07.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.945+0000 7f60f8ff9700 1 -- 172.21.15.26:0/3722525499 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f60ec040980 con 0x7f60fc09d630 2023-10-01T07:59:07.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.945+0000 7f61025ca700 1 -- 172.21.15.26:0/3722525499 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60fc0747f0 con 0x7f60fc09d630 2023-10-01T07:59:07.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:07.954+0000 7f60f8ff9700 1 -- 172.21.15.26:0/3722525499 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f60ec015080 con 0x7f60fc09d630 2023-10-01T07:59:08.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.001+0000 7f2e6caa0700 1 Processor -- start 2023-10-01T07:59:08.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.001+0000 7f2e6caa0700 1 -- start start 2023-10-01T07:59:08.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.002+0000 7f2e6caa0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e6809fa10 0x7f2e68136950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:08.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.002+0000 7f2e6caa0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2e6809f2c0 0x7f2e68138ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:08.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.002+0000 7f2e6caa0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e6809b610 con 0x7f2e6809e7e0 2023-10-01T07:59:08.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.002+0000 7f2e6caa0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e6809bbb0 con 0x7f2e6809f2c0 2023-10-01T07:59:08.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.002+0000 7f2e6caa0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e680a0010 con 0x7f2e6809fa10 2023-10-01T07:59:08.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.002+0000 7f2e66d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2e6809f2c0 0x7f2e68138ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:08.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.002+0000 7f2e66d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2e6809f2c0 0x7f2e68138ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39716/0 (socket says 172.21.15.26:39716) 2023-10-01T07:59:08.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.002+0000 7f2e66d9d700 1 -- 172.21.15.26:0/2694503819 learned_addr learned my addr 172.21.15.26:0/2694503819 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:08.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.002+0000 7f2e66d9d700 1 -- 172.21.15.26:0/2694503819 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e6809fa10 msgr2=0x7f2e68136950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:08.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.002+0000 7f2e66d9d700 1 --2- 172.21.15.26:0/2694503819 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e6809fa10 0x7f2e68136950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:08.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.002+0000 7f2e66d9d700 1 -- 172.21.15.26:0/2694503819 >> v1:172.21.15.26:6789/0 conn(0x7f2e6809e7e0 legacy=0x7f2e6809ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:08.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.002+0000 7f2e66d9d700 1 -- 172.21.15.26:0/2694503819 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6809b8d0 con 0x7f2e6809f2c0 2023-10-01T07:59:08.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.003+0000 7f2e66d9d700 1 --2- 172.21.15.26:0/2694503819 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e6809f2c0 0x7f2e68138ea0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f2e60009e50 tx=0x7f2e6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5850d540647f0755 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:08.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.003+0000 7f2e6559a700 1 -- 172.21.15.26:0/2694503819 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6000e070 con 0x7f2e6809f2c0 2023-10-01T07:59:08.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.003+0000 7f2e6559a700 1 -- 172.21.15.26:0/2694503819 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6000b9c0 con 0x7f2e6809f2c0 2023-10-01T07:59:08.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.003+0000 7f2e6559a700 1 -- 172.21.15.26:0/2694503819 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6000bd70 con 0x7f2e6809f2c0 2023-10-01T07:59:08.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.004+0000 7f2e6caa0700 1 -- 172.21.15.26:0/2694503819 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e6809f2c0 msgr2=0x7f2e68138ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:08.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.004+0000 7f2e6caa0700 1 --2- 172.21.15.26:0/2694503819 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e6809f2c0 0x7f2e68138ea0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f2e60009e50 tx=0x7f2e6000b330 comp rx=0 tx=0).stop 2023-10-01T07:59:08.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.004+0000 7f2e6caa0700 1 -- 172.21.15.26:0/2694503819 shutdown_connections 2023-10-01T07:59:08.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.004+0000 7f2e6caa0700 1 --2- 172.21.15.26:0/2694503819 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e6809f2c0 0x7f2e68138ea0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:08.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.004+0000 7f2e6caa0700 1 --2- 172.21.15.26:0/2694503819 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e6809fa10 0x7f2e68136950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:08.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.004+0000 7f2e6caa0700 1 -- 172.21.15.26:0/2694503819 >> 172.21.15.26:0/2694503819 conn(0x7f2e680a4300 msgr2=0x7f2e680a4700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:08.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.004+0000 7f2e6caa0700 1 -- 172.21.15.26:0/2694503819 shutdown_connections 2023-10-01T07:59:08.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.004+0000 7f2e6caa0700 1 -- 172.21.15.26:0/2694503819 wait complete. 2023-10-01T07:59:08.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.006+0000 7f2e6caa0700 1 Processor -- start 2023-10-01T07:59:08.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.006+0000 7f2e6caa0700 1 -- start start 2023-10-01T07:59:08.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.006+0000 7f2e6caa0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e6809e7e0 0x7f2e6811a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:08.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.006+0000 7f2e6caa0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e6809f2c0 0x7f2e6811aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:08.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.006+0000 7f2e6caa0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e6809fa10 0x7f2e6811afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:08.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.006+0000 7f2e6caa0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6811c590 con 0x7f2e6809f2c0 2023-10-01T07:59:08.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.006+0000 7f2e6caa0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6811dbd0 con 0x7f2e6809fa10 2023-10-01T07:59:08.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.006+0000 7f2e6caa0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6811cac0 con 0x7f2e6809e7e0 2023-10-01T07:59:08.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.007+0000 7f2e6659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e6809e7e0 0x7f2e6811a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:08.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.007+0000 7f2e6659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e6809e7e0 0x7f2e6811a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59800/0 (socket says 172.21.15.26:59800) 2023-10-01T07:59:08.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.007+0000 7f2e6659c700 1 -- 172.21.15.26:0/95405250 learned_addr learned my addr 172.21.15.26:0/95405250 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:08.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.007+0000 7f2e65d9b700 1 --2- 172.21.15.26:0/95405250 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e6809f2c0 0x7f2e6811aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:08.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.007+0000 7f2e6659c700 1 -- 172.21.15.26:0/95405250 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e6809fa10 msgr2=0x7f2e6811afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:08.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.007+0000 7f2e6659c700 1 --2- 172.21.15.26:0/95405250 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e6809fa10 0x7f2e6811afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:08.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.007+0000 7f2e6659c700 1 -- 172.21.15.26:0/95405250 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e6809f2c0 msgr2=0x7f2e6811aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:08.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.007+0000 7f2e6659c700 1 --2- 172.21.15.26:0/95405250 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e6809f2c0 0x7f2e6811aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:08.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.007+0000 7f2e6659c700 1 -- 172.21.15.26:0/95405250 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e60009b30 con 0x7f2e6809e7e0 2023-10-01T07:59:08.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.007+0000 7f2e6659c700 1 --2- 172.21.15.26:0/95405250 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e6809e7e0 0x7f2e6811a530 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800c510 tx=0x7f2e5800c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:08.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.007+0000 7f2e56ffd700 1 -- 172.21.15.26:0/95405250 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e580052d0 con 0x7f2e6809e7e0 2023-10-01T07:59:08.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.008+0000 7f2e56ffd700 1 -- 172.21.15.26:0/95405250 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e58005430 con 0x7f2e6809e7e0 2023-10-01T07:59:08.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.008+0000 7f2e6caa0700 1 -- 172.21.15.26:0/95405250 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e680a2df0 con 0x7f2e6809e7e0 2023-10-01T07:59:08.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.008+0000 7f2e6caa0700 1 -- 172.21.15.26:0/95405250 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e6809da10 con 0x7f2e6809e7e0 2023-10-01T07:59:08.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.008+0000 7f2e56ffd700 1 -- 172.21.15.26:0/95405250 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e580038c0 con 0x7f2e6809e7e0 2023-10-01T07:59:08.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.009+0000 7f2e56ffd700 1 -- 172.21.15.26:0/95405250 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2e58003a20 con 0x7f2e6809e7e0 2023-10-01T07:59:08.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.009+0000 7f2e6caa0700 1 -- 172.21.15.26:0/95405250 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e4c0052e0 con 0x7f2e6809e7e0 2023-10-01T07:59:08.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.009+0000 7f2e56ffd700 1 -- 172.21.15.26:0/95405250 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2e5803eaf0 con 0x7f2e6809e7e0 2023-10-01T07:59:08.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.018+0000 7f2e56ffd700 1 -- 172.21.15.26:0/95405250 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e58018260 con 0x7f2e6809e7e0 2023-10-01T07:59:08.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.051+0000 7f16a7260700 1 Processor -- start 2023-10-01T07:59:08.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.051+0000 7f16a7260700 1 -- start start 2023-10-01T07:59:08.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.052+0000 7f16a7260700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f16a009d630 0x7f16a00a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:08.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.052+0000 7f16a7260700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f16a0138d80 0x7f16a013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:08.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.052+0000 7f16a7260700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a00a2a70 con 0x7f16a00a0a30 2023-10-01T07:59:08.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.052+0000 7f16a7260700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a00a01d0 con 0x7f16a009d630 2023-10-01T07:59:08.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.052+0000 7f16a7260700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16a009e2b0 con 0x7f16a0138d80 2023-10-01T07:59:08.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.052+0000 7f169ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f16a009d630 0x7f16a00a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:08.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.052+0000 7f169ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f16a009d630 0x7f16a00a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35808/0 (socket says 172.21.15.26:35808) 2023-10-01T07:59:08.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.053+0000 7f169ffff700 1 -- 172.21.15.26:0/119898426 learned_addr learned my addr 172.21.15.26:0/119898426 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:08.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.053+0000 7f16a57fd700 1 --2- 172.21.15.26:0/119898426 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f16a0138d80 0x7f16a013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:08.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.053+0000 7f169ffff700 1 -- 172.21.15.26:0/119898426 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f16a0138d80 msgr2=0x7f16a013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:08.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.053+0000 7f169ffff700 1 --2- 172.21.15.26:0/119898426 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f16a0138d80 0x7f16a013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:08.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.053+0000 7f169ffff700 1 -- 172.21.15.26:0/119898426 >> v1:172.21.15.26:6789/0 conn(0x7f16a00a0a30 legacy=0x7f16a00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:08.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.053+0000 7f169f7fe700 1 -- 172.21.15.26:0/119898426 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3143073691 0 0) 0x7f16a00a2a70 con 0x7f16a00a0a30 2023-10-01T07:59:08.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.053+0000 7f169ffff700 1 -- 172.21.15.26:0/119898426 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a009dc50 con 0x7f16a009d630 2023-10-01T07:59:08.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.053+0000 7f169ffff700 1 --2- 172.21.15.26:0/119898426 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f16a009d630 0x7f16a00a1510 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f168c009920 tx=0x7f168c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89b89619c42cc8ae server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:08.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.053+0000 7f169f7fe700 1 -- 172.21.15.26:0/119898426 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c011830 con 0x7f16a009d630 2023-10-01T07:59:08.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.053+0000 7f169f7fe700 1 -- 172.21.15.26:0/119898426 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168c011990 con 0x7f16a009d630 2023-10-01T07:59:08.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.053+0000 7f169f7fe700 1 -- 172.21.15.26:0/119898426 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c011d20 con 0x7f16a009d630 2023-10-01T07:59:08.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.054+0000 7f16a7260700 1 -- 172.21.15.26:0/119898426 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f16a009d630 msgr2=0x7f16a00a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:08.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.054+0000 7f16a7260700 1 --2- 172.21.15.26:0/119898426 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f16a009d630 0x7f16a00a1510 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f168c009920 tx=0x7f168c009c30 comp rx=0 tx=0).stop 2023-10-01T07:59:08.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.054+0000 7f16a7260700 1 -- 172.21.15.26:0/119898426 shutdown_connections 2023-10-01T07:59:08.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.055+0000 7f16a7260700 1 --2- 172.21.15.26:0/119898426 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f16a0138d80 0x7f16a013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:08.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.055+0000 7f16a7260700 1 --2- 172.21.15.26:0/119898426 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f16a009d630 0x7f16a00a1510 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:08.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.055+0000 7f16a7260700 1 -- 172.21.15.26:0/119898426 >> 172.21.15.26:0/119898426 conn(0x7f16a00a3050 msgr2=0x7f16a00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:08.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.055+0000 7f16a7260700 1 -- 172.21.15.26:0/119898426 shutdown_connections 2023-10-01T07:59:08.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.055+0000 7f16a7260700 1 -- 172.21.15.26:0/119898426 wait complete. 2023-10-01T07:59:08.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.056+0000 7f16a7260700 1 Processor -- start 2023-10-01T07:59:08.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.056+0000 7f16a7260700 1 -- start start 2023-10-01T07:59:08.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.057+0000 7f16a7260700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16a009d630 0x7f16a0133730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:08.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.057+0000 7f16a7260700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f16a00a0a30 0x7f16a0133c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:08.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.057+0000 7f16a7260700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f16a0138d80 0x7f16a01341b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:08.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.057+0000 7f16a7260700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a0137220 con 0x7f16a009d630 2023-10-01T07:59:08.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.057+0000 7f16a7260700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a0137d60 con 0x7f16a00a0a30 2023-10-01T07:59:08.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.057+0000 7f16a7260700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16a00a4cb0 con 0x7f16a0138d80 2023-10-01T07:59:08.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.057+0000 7f169ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f16a00a0a30 0x7f16a0133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:08.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.057+0000 7f169ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f16a00a0a30 0x7f16a0133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35810/0 (socket says 172.21.15.26:35810) 2023-10-01T07:59:08.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.057+0000 7f169ffff700 1 -- 172.21.15.26:0/2641260659 learned_addr learned my addr 172.21.15.26:0/2641260659 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:08.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.057+0000 7f16a57fd700 1 --2- 172.21.15.26:0/2641260659 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f16a0138d80 0x7f16a01341b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:08.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.058+0000 7f16a4ffc700 1 --2- 172.21.15.26:0/2641260659 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16a009d630 0x7f16a0133730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:08.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.058+0000 7f169ffff700 1 -- 172.21.15.26:0/2641260659 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f16a0138d80 msgr2=0x7f16a01341b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:08.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.058+0000 7f169ffff700 1 --2- 172.21.15.26:0/2641260659 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f16a0138d80 0x7f16a01341b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:08.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.058+0000 7f169ffff700 1 -- 172.21.15.26:0/2641260659 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16a009d630 msgr2=0x7f16a0133730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:08.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.058+0000 7f169ffff700 1 --2- 172.21.15.26:0/2641260659 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16a009d630 0x7f16a0133730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:08.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.058+0000 7f169ffff700 1 -- 172.21.15.26:0/2641260659 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168c009550 con 0x7f16a00a0a30 2023-10-01T07:59:08.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.058+0000 7f16a4ffc700 1 --2- 172.21.15.26:0/2641260659 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16a009d630 0x7f16a0133730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:59:08.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.058+0000 7f169ffff700 1 --2- 172.21.15.26:0/2641260659 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f16a00a0a30 0x7f16a0133c70 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f168c00a010 tx=0x7f168c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:08.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.058+0000 7f169d7fa700 1 -- 172.21.15.26:0/2641260659 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c004300 con 0x7f16a00a0a30 2023-10-01T07:59:08.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.058+0000 7f169d7fa700 1 -- 172.21.15.26:0/2641260659 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168c01f070 con 0x7f16a00a0a30 2023-10-01T07:59:08.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.058+0000 7f169d7fa700 1 -- 172.21.15.26:0/2641260659 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c0036a0 con 0x7f16a00a0a30 2023-10-01T07:59:08.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.058+0000 7f16a7260700 1 -- 172.21.15.26:0/2641260659 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a00a0410 con 0x7f16a00a0a30 2023-10-01T07:59:08.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.058+0000 7f16a7260700 1 -- 172.21.15.26:0/2641260659 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a0136530 con 0x7f16a00a0a30 2023-10-01T07:59:08.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.059+0000 7f169d7fa700 1 -- 172.21.15.26:0/2641260659 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f168c021030 con 0x7f16a00a0a30 2023-10-01T07:59:08.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.060+0000 7f169d7fa700 1 -- 172.21.15.26:0/2641260659 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f168c040940 con 0x7f16a00a0a30 2023-10-01T07:59:08.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.060+0000 7f16a7260700 1 -- 172.21.15.26:0/2641260659 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a00747f0 con 0x7f16a00a0a30 2023-10-01T07:59:08.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.069+0000 7f169d7fa700 1 -- 172.21.15.26:0/2641260659 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f168c0199a0 con 0x7f16a00a0a30 2023-10-01T07:59:08.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.085+0000 7f3fa1716700 1 Processor -- start 2023-10-01T07:59:08.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.085+0000 7f3fa1716700 1 -- start start 2023-10-01T07:59:08.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.085+0000 7f3fa1716700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3f9c06f5d0 0x7f3f9c12ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:08.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.085+0000 7f3fa1716700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f9c135c20 0x7f3f9c138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:08.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.085+0000 7f3fa1716700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f9c06fa40 con 0x7f3f9c12cf60 2023-10-01T07:59:08.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.085+0000 7f3fa1716700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f9c12cd90 con 0x7f3f9c06f5d0 2023-10-01T07:59:08.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.085+0000 7f3fa1716700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c071780 con 0x7f3f9c135c20 2023-10-01T07:59:08.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.086+0000 7f3f9b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f9c135c20 0x7f3f9c138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:08.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.086+0000 7f3f9b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f9c135c20 0x7f3f9c138000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59834/0 (socket says 172.21.15.26:59834) 2023-10-01T07:59:08.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.086+0000 7f3f9b7fe700 1 -- 172.21.15.26:0/3045337425 learned_addr learned my addr 172.21.15.26:0/3045337425 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:08.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.086+0000 7f3f9a7fc700 1 --2- 172.21.15.26:0/3045337425 >> v2:172.21.15.26:3300/0 conn(0x7f3f9c06f5d0 0x7f3f9c12ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:08.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.086+0000 7f3f9b7fe700 1 -- 172.21.15.26:0/3045337425 >> v2:172.21.15.26:3300/0 conn(0x7f3f9c06f5d0 msgr2=0x7f3f9c12ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:08.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.086+0000 7f3f9b7fe700 1 --2- 172.21.15.26:0/3045337425 >> v2:172.21.15.26:3300/0 conn(0x7f3f9c06f5d0 0x7f3f9c12ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:08.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.086+0000 7f3f9b7fe700 1 -- 172.21.15.26:0/3045337425 >> v1:172.21.15.26:6789/0 conn(0x7f3f9c12cf60 legacy=0x7f3f9c12f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:08.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.086+0000 7f3f9b7fe700 1 -- 172.21.15.26:0/3045337425 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9c071a40 con 0x7f3f9c135c20 2023-10-01T07:59:08.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.086+0000 7f3f9b7fe700 1 --2- 172.21.15.26:0/3045337425 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f9c135c20 0x7f3f9c138000 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f3f94009e50 tx=0x7f3f9400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6248c073a3ac6a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:08.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.086+0000 7f3f99ffb700 1 -- 172.21.15.26:0/3045337425 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9400e070 con 0x7f3f9c135c20 2023-10-01T07:59:08.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.087+0000 7f3f99ffb700 1 -- 172.21.15.26:0/3045337425 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f94003a20 con 0x7f3f9c135c20 2023-10-01T07:59:08.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.087+0000 7f3f99ffb700 1 -- 172.21.15.26:0/3045337425 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f94003dd0 con 0x7f3f9c135c20 2023-10-01T07:59:08.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.087+0000 7f3fa1716700 1 -- 172.21.15.26:0/3045337425 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f9c135c20 msgr2=0x7f3f9c138000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:08.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.087+0000 7f3fa1716700 1 --2- 172.21.15.26:0/3045337425 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f9c135c20 0x7f3f9c138000 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f3f94009e50 tx=0x7f3f9400b330 comp rx=0 tx=0).stop 2023-10-01T07:59:08.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.088+0000 7f3fa1716700 1 -- 172.21.15.26:0/3045337425 shutdown_connections 2023-10-01T07:59:08.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.088+0000 7f3fa1716700 1 --2- 172.21.15.26:0/3045337425 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f9c135c20 0x7f3f9c138000 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:08.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.088+0000 7f3fa1716700 1 --2- 172.21.15.26:0/3045337425 >> v2:172.21.15.26:3300/0 conn(0x7f3f9c06f5d0 0x7f3f9c12ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:08.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.088+0000 7f3fa1716700 1 -- 172.21.15.26:0/3045337425 >> 172.21.15.26:0/3045337425 conn(0x7f3f9c0a2aa0 msgr2=0x7f3f9c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:08.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.088+0000 7f3fa1716700 1 -- 172.21.15.26:0/3045337425 shutdown_connections 2023-10-01T07:59:08.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.088+0000 7f3fa1716700 1 -- 172.21.15.26:0/3045337425 wait complete. 2023-10-01T07:59:08.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.089+0000 7f3fa1716700 1 Processor -- start 2023-10-01T07:59:08.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.089+0000 7f3fa1716700 1 -- start start 2023-10-01T07:59:08.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.090+0000 7f3fa1716700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f9c06f5d0 0x7f3f9c133f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:08.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.090+0000 7f3fa1716700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f9c12cf60 0x7f3f9c134440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:08.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.090+0000 7f3fa1716700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3f9c135c20 0x7f3f9c134980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:08.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.090+0000 7f3fa1716700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c1266d0 con 0x7f3f9c06f5d0 2023-10-01T07:59:08.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.090+0000 7f3fa1716700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c0a2290 con 0x7f3f9c135c20 2023-10-01T07:59:08.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.090+0000 7f3fa1716700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c129fa0 con 0x7f3f9c12cf60 2023-10-01T07:59:08.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.090+0000 7f3f9a7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f9c12cf60 0x7f3f9c134440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:08.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.090+0000 7f3f9a7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f9c12cf60 0x7f3f9c134440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59840/0 (socket says 172.21.15.26:59840) 2023-10-01T07:59:08.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.090+0000 7f3f9a7fc700 1 -- 172.21.15.26:0/4124200656 learned_addr learned my addr 172.21.15.26:0/4124200656 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:08.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.091+0000 7f3f9b7fe700 1 --2- 172.21.15.26:0/4124200656 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3f9c135c20 0x7f3f9c134980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:08.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.091+0000 7f3f9affd700 1 --2- 172.21.15.26:0/4124200656 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f9c06f5d0 0x7f3f9c133f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:08.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.091+0000 7f3f9b7fe700 1 -- 172.21.15.26:0/4124200656 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f9c12cf60 msgr2=0x7f3f9c134440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:08.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.091+0000 7f3f9b7fe700 1 --2- 172.21.15.26:0/4124200656 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f9c12cf60 0x7f3f9c134440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:08.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.091+0000 7f3f9b7fe700 1 -- 172.21.15.26:0/4124200656 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f9c06f5d0 msgr2=0x7f3f9c133f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:08.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.091+0000 7f3f9b7fe700 1 --2- 172.21.15.26:0/4124200656 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f9c06f5d0 0x7f3f9c133f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:08.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.091+0000 7f3f9b7fe700 1 -- 172.21.15.26:0/4124200656 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f94009b30 con 0x7f3f9c135c20 2023-10-01T07:59:08.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.091+0000 7f3f9a7fc700 1 --2- 172.21.15.26:0/4124200656 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f9c12cf60 0x7f3f9c134440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:08.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.091+0000 7f3f9b7fe700 1 --2- 172.21.15.26:0/4124200656 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3f9c135c20 0x7f3f9c134980 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f3f94014000 tx=0x7f3f94004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:08.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.091+0000 7f3f837fe700 1 -- 172.21.15.26:0/4124200656 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f94004440 con 0x7f3f9c135c20 2023-10-01T07:59:08.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.091+0000 7f3f837fe700 1 -- 172.21.15.26:0/4124200656 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f940092e0 con 0x7f3f9c135c20 2023-10-01T07:59:08.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.091+0000 7f3f837fe700 1 -- 172.21.15.26:0/4124200656 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f94004800 con 0x7f3f9c135c20 2023-10-01T07:59:08.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.092+0000 7f3fa1716700 1 -- 172.21.15.26:0/4124200656 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f9c0a0a40 con 0x7f3f9c135c20 2023-10-01T07:59:08.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.092+0000 7f3fa1716700 1 -- 172.21.15.26:0/4124200656 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f9c0a0c40 con 0x7f3f9c135c20 2023-10-01T07:59:08.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.092+0000 7f3f837fe700 1 -- 172.21.15.26:0/4124200656 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f94012430 con 0x7f3f9c135c20 2023-10-01T07:59:08.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.093+0000 7f3f837fe700 1 -- 172.21.15.26:0/4124200656 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3f94040a20 con 0x7f3f9c135c20 2023-10-01T07:59:08.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.093+0000 7f3fa1716700 1 -- 172.21.15.26:0/4124200656 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f9c135570 con 0x7f3f9c135c20 2023-10-01T07:59:08.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.102+0000 7f3f837fe700 1 -- 172.21.15.26:0/4124200656 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f9c135570 con 0x7f3f9c135c20 2023-10-01T07:59:08.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.199+0000 7f61025ca700 1 -- 172.21.15.26:0/3722525499 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f60fc1223e0 con 0x7f60fc09d630 2023-10-01T07:59:08.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.199+0000 7f60f8ff9700 1 -- 172.21.15.26:0/3722525499 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f60ec01b7b0 con 0x7f60fc09d630 2023-10-01T07:59:08.200 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:08.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.203+0000 7f61025ca700 1 -- 172.21.15.26:0/3722525499 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60fc09d630 msgr2=0x7f60fc1c8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:08.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.203+0000 7f61025ca700 1 --2- 172.21.15.26:0/3722525499 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60fc09d630 0x7f60fc1c8190 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f60ec009c40 tx=0x7f60ec004750 comp rx=0 tx=0).stop 2023-10-01T07:59:08.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.203+0000 7f61025ca700 1 -- 172.21.15.26:0/3722525499 shutdown_connections 2023-10-01T07:59:08.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.203+0000 7f61025ca700 1 --2- 172.21.15.26:0/3722525499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60fc133930 0x7f60fc1c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:08.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.203+0000 7f61025ca700 1 --2- 172.21.15.26:0/3722525499 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60fc09d630 0x7f60fc1c8190 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:08.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.203+0000 7f61025ca700 1 --2- 172.21.15.26:0/3722525499 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f60fc0a0a30 0x7f60fc1c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:08.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.203+0000 7f61025ca700 1 -- 172.21.15.26:0/3722525499 >> 172.21.15.26:0/3722525499 conn(0x7f60fc0a3050 msgr2=0x7f60fc09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:08.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.203+0000 7f61025ca700 1 -- 172.21.15.26:0/3722525499 shutdown_connections 2023-10-01T07:59:08.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.203+0000 7f61025ca700 1 -- 172.21.15.26:0/3722525499 wait complete. 2023-10-01T07:59:08.223 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:08.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.250+0000 7f2e6caa0700 1 -- 172.21.15.26:0/95405250 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2e4c005590 con 0x7f2e6809e7e0 2023-10-01T07:59:08.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.250+0000 7f2e56ffd700 1 -- 172.21.15.26:0/95405250 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2e5803ee60 con 0x7f2e6809e7e0 2023-10-01T07:59:08.251 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:08.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.253+0000 7f2e6caa0700 1 -- 172.21.15.26:0/95405250 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e6809e7e0 msgr2=0x7f2e6811a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:08.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.253+0000 7f2e6caa0700 1 --2- 172.21.15.26:0/95405250 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e6809e7e0 0x7f2e6811a530 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800c510 tx=0x7f2e5800c820 comp rx=0 tx=0).stop 2023-10-01T07:59:08.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.253+0000 7f2e6caa0700 1 -- 172.21.15.26:0/95405250 shutdown_connections 2023-10-01T07:59:08.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.253+0000 7f2e6caa0700 1 --2- 172.21.15.26:0/95405250 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e6809fa10 0x7f2e6811afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:08.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.253+0000 7f2e6caa0700 1 --2- 172.21.15.26:0/95405250 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e6809e7e0 0x7f2e6811a530 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:08.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.253+0000 7f2e6caa0700 1 --2- 172.21.15.26:0/95405250 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e6809f2c0 0x7f2e6811aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:08.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.253+0000 7f2e6caa0700 1 -- 172.21.15.26:0/95405250 >> 172.21.15.26:0/95405250 conn(0x7f2e680a4300 msgr2=0x7f2e680703e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:08.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.253+0000 7f2e6caa0700 1 -- 172.21.15.26:0/95405250 shutdown_connections 2023-10-01T07:59:08.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.253+0000 7f2e6caa0700 1 -- 172.21.15.26:0/95405250 wait complete. 2023-10-01T07:59:08.268 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:08.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.301+0000 7f16a7260700 1 -- 172.21.15.26:0/2641260659 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f16a0072980 con 0x7f16a00a0a30 2023-10-01T07:59:08.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.301+0000 7f169d7fa700 1 -- 172.21.15.26:0/2641260659 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f168c015020 con 0x7f16a00a0a30 2023-10-01T07:59:08.302 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:08.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.303+0000 7f16a7260700 1 -- 172.21.15.26:0/2641260659 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f16a00a0a30 msgr2=0x7f16a0133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:08.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.303+0000 7f16a7260700 1 --2- 172.21.15.26:0/2641260659 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f16a00a0a30 0x7f16a0133c70 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f168c00a010 tx=0x7f168c004750 comp rx=0 tx=0).stop 2023-10-01T07:59:08.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.303+0000 7f16a7260700 1 -- 172.21.15.26:0/2641260659 shutdown_connections 2023-10-01T07:59:08.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.303+0000 7f16a7260700 1 --2- 172.21.15.26:0/2641260659 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f16a0138d80 0x7f16a01341b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:08.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.303+0000 7f16a7260700 1 --2- 172.21.15.26:0/2641260659 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16a009d630 0x7f16a0133730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:08.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.303+0000 7f16a7260700 1 --2- 172.21.15.26:0/2641260659 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f16a00a0a30 0x7f16a0133c70 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:08.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.303+0000 7f16a7260700 1 -- 172.21.15.26:0/2641260659 >> 172.21.15.26:0/2641260659 conn(0x7f16a00a3050 msgr2=0x7f16a009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:08.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.304+0000 7f16a7260700 1 -- 172.21.15.26:0/2641260659 shutdown_connections 2023-10-01T07:59:08.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.304+0000 7f16a7260700 1 -- 172.21.15.26:0/2641260659 wait complete. 2023-10-01T07:59:08.318 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:08.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.324+0000 7f3fa1716700 1 -- 172.21.15.26:0/4124200656 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3f9c135570 con 0x7f3f9c135c20 2023-10-01T07:59:08.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.324+0000 7f3f837fe700 1 -- 172.21.15.26:0/4124200656 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f9c135570 con 0x7f3f9c135c20 2023-10-01T07:59:08.325 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:08.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.326+0000 7f3fa1716700 1 -- 172.21.15.26:0/4124200656 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3f9c135c20 msgr2=0x7f3f9c134980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:08.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.326+0000 7f3fa1716700 1 --2- 172.21.15.26:0/4124200656 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3f9c135c20 0x7f3f9c134980 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f3f94014000 tx=0x7f3f94004ad0 comp rx=0 tx=0).stop 2023-10-01T07:59:08.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.326+0000 7f3fa1716700 1 -- 172.21.15.26:0/4124200656 shutdown_connections 2023-10-01T07:59:08.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.326+0000 7f3fa1716700 1 --2- 172.21.15.26:0/4124200656 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3f9c135c20 0x7f3f9c134980 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:08.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.326+0000 7f3fa1716700 1 --2- 172.21.15.26:0/4124200656 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f9c06f5d0 0x7f3f9c133f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:08.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.326+0000 7f3fa1716700 1 --2- 172.21.15.26:0/4124200656 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3f9c12cf60 0x7f3f9c134440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:08.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.326+0000 7f3fa1716700 1 -- 172.21.15.26:0/4124200656 >> 172.21.15.26:0/4124200656 conn(0x7f3f9c0a2aa0 msgr2=0x7f3f9c129170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:08.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.327+0000 7f3fa1716700 1 -- 172.21.15.26:0/4124200656 shutdown_connections 2023-10-01T07:59:08.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:08.327+0000 7f3fa1716700 1 -- 172.21.15.26:0/4124200656 wait complete. 2023-10-01T07:59:08.340 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:09.223 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:09.269 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:09.319 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:09.341 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:09.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.378+0000 7fab2b615700 1 Processor -- start 2023-10-01T07:59:09.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.379+0000 7fab2b615700 1 -- start start 2023-10-01T07:59:09.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.380+0000 7fab2b615700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fab24130540 0x7fab24130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:09.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.380+0000 7fab2b615700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab2406fcf0 0x7fab24138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:09.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.380+0000 7fab2b615700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab240716a0 con 0x7fab24130e50 2023-10-01T07:59:09.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.380+0000 7fab2b615700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab2409a390 con 0x7fab24130540 2023-10-01T07:59:09.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.380+0000 7fab2b615700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab24071290 con 0x7fab2406fcf0 2023-10-01T07:59:09.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.380+0000 7fab293b1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fab24130540 0x7fab24130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:09.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.380+0000 7fab293b1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fab24130540 0x7fab24130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39750/0 (socket says 172.21.15.26:39750) 2023-10-01T07:59:09.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.380+0000 7fab293b1700 1 -- 172.21.15.26:0/396171898 learned_addr learned my addr 172.21.15.26:0/396171898 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:09.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.380+0000 7fab29bb2700 1 --2- 172.21.15.26:0/396171898 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab2406fcf0 0x7fab24138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:09.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.380+0000 7fab293b1700 1 -- 172.21.15.26:0/396171898 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab2406fcf0 msgr2=0x7fab24138570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:09.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.380+0000 7fab293b1700 1 --2- 172.21.15.26:0/396171898 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab2406fcf0 0x7fab24138570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.380+0000 7fab293b1700 1 -- 172.21.15.26:0/396171898 >> v1:172.21.15.26:6789/0 conn(0x7fab24130e50 legacy=0x7fab2406f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:09.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.380+0000 7fab293b1700 1 -- 172.21.15.26:0/396171898 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab24130340 con 0x7fab24130540 2023-10-01T07:59:09.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.381+0000 7fab293b1700 1 --2- 172.21.15.26:0/396171898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab24130540 0x7fab24130910 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fab200098f0 tx=0x7fab20009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17853bd9fa594a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:09.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.381+0000 7fab1bfff700 1 -- 172.21.15.26:0/396171898 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab20011830 con 0x7fab24130540 2023-10-01T07:59:09.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.381+0000 7fab1bfff700 1 -- 172.21.15.26:0/396171898 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab20011990 con 0x7fab24130540 2023-10-01T07:59:09.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.381+0000 7fab1bfff700 1 -- 172.21.15.26:0/396171898 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab20011d20 con 0x7fab24130540 2023-10-01T07:59:09.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.382+0000 7fab2b615700 1 -- 172.21.15.26:0/396171898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab24130540 msgr2=0x7fab24130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:09.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.382+0000 7fab2b615700 1 --2- 172.21.15.26:0/396171898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab24130540 0x7fab24130910 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fab200098f0 tx=0x7fab20009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:09.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.382+0000 7fab2b615700 1 -- 172.21.15.26:0/396171898 shutdown_connections 2023-10-01T07:59:09.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.382+0000 7fab2b615700 1 --2- 172.21.15.26:0/396171898 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab2406fcf0 0x7fab24138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.382+0000 7fab2b615700 1 --2- 172.21.15.26:0/396171898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab24130540 0x7fab24130910 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.382+0000 7fab2b615700 1 -- 172.21.15.26:0/396171898 >> 172.21.15.26:0/396171898 conn(0x7fab240a2aa0 msgr2=0x7fab240a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:09.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.382+0000 7fab2b615700 1 -- 172.21.15.26:0/396171898 shutdown_connections 2023-10-01T07:59:09.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.382+0000 7fab2b615700 1 -- 172.21.15.26:0/396171898 wait complete. 2023-10-01T07:59:09.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.383+0000 7fab2b615700 1 Processor -- start 2023-10-01T07:59:09.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.384+0000 7fab2b615700 1 -- start start 2023-10-01T07:59:09.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.384+0000 7fab2b615700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab2406fcf0 0x7fab24118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:09.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.384+0000 7fab2b615700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab24130540 0x7fab24119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:09.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.384+0000 7fab2b615700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab24130e50 0x7fab24119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:09.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.384+0000 7fab2b615700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2411bd60 con 0x7fab24130540 2023-10-01T07:59:09.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.384+0000 7fab2b615700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab240a0cc0 con 0x7fab2406fcf0 2023-10-01T07:59:09.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.384+0000 7fab2b615700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab240718e0 con 0x7fab24130e50 2023-10-01T07:59:09.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.385+0000 7fab293b1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab2406fcf0 0x7fab24118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:09.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.385+0000 7fab28bb0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab24130540 0x7fab24119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:09.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.385+0000 7fab293b1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab2406fcf0 0x7fab24118cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35830/0 (socket says 172.21.15.26:35830) 2023-10-01T07:59:09.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.385+0000 7fab293b1700 1 -- 172.21.15.26:0/2837361270 learned_addr learned my addr 172.21.15.26:0/2837361270 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:09.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.385+0000 7fab29bb2700 1 --2- 172.21.15.26:0/2837361270 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab24130e50 0x7fab24119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:09.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.385+0000 7fab28bb0700 1 -- 172.21.15.26:0/2837361270 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab24130e50 msgr2=0x7fab24119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:09.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.385+0000 7fab28bb0700 1 --2- 172.21.15.26:0/2837361270 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab24130e50 0x7fab24119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.385+0000 7fab28bb0700 1 -- 172.21.15.26:0/2837361270 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab2406fcf0 msgr2=0x7fab24118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:09.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.385+0000 7fab28bb0700 1 --2- 172.21.15.26:0/2837361270 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab2406fcf0 0x7fab24118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.385+0000 7fab28bb0700 1 -- 172.21.15.26:0/2837361270 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab20009550 con 0x7fab24130540 2023-10-01T07:59:09.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.386+0000 7fab28bb0700 1 --2- 172.21.15.26:0/2837361270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab24130540 0x7fab24119210 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fab14000f60 tx=0x7fab1400c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:09.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.386+0000 7fab19ffb700 1 -- 172.21.15.26:0/2837361270 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab140052d0 con 0x7fab24130540 2023-10-01T07:59:09.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.386+0000 7fab19ffb700 1 -- 172.21.15.26:0/2837361270 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab14005430 con 0x7fab24130540 2023-10-01T07:59:09.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.386+0000 7fab19ffb700 1 -- 172.21.15.26:0/2837361270 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab140038c0 con 0x7fab24130540 2023-10-01T07:59:09.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.386+0000 7fab2b615700 1 -- 172.21.15.26:0/2837361270 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab2411a260 con 0x7fab24130540 2023-10-01T07:59:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.386+0000 7fab2b615700 1 -- 172.21.15.26:0/2837361270 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab2411c040 con 0x7fab24130540 2023-10-01T07:59:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.387+0000 7fab19ffb700 1 -- 172.21.15.26:0/2837361270 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab14003a20 con 0x7fab24130540 2023-10-01T07:59:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.387+0000 7fab19ffb700 1 -- 172.21.15.26:0/2837361270 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fab1403e970 con 0x7fab24130540 2023-10-01T07:59:09.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.389+0000 7fab2b615700 1 -- 172.21.15.26:0/2837361270 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab2411bea0 con 0x7fab24130540 2023-10-01T07:59:09.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.394+0000 7fab19ffb700 1 -- 172.21.15.26:0/2837361270 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab2411bea0 con 0x7fab24130540 2023-10-01T07:59:09.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.429+0000 7fdbfb8b3700 1 Processor -- start 2023-10-01T07:59:09.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.429+0000 7fdbfb8b3700 1 -- start start 2023-10-01T07:59:09.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.430+0000 7fdbfb8b3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdbf409f410 0x7fdbf4136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:09.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.430+0000 7fdbfb8b3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbf4136fe0 0x7fdbf41393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:09.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.430+0000 7fdbfb8b3700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbf4070940 con 0x7fdbf409e930 2023-10-01T07:59:09.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.430+0000 7fdbfb8b3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbf406fd60 con 0x7fdbf409f410 2023-10-01T07:59:09.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.430+0000 7fdbfb8b3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf406fa80 con 0x7fdbf4136fe0 2023-10-01T07:59:09.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.430+0000 7fdbf8e4e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdbf409f410 0x7fdbf4136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:09.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.430+0000 7fdbf8e4e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdbf409f410 0x7fdbf4136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39778/0 (socket says 172.21.15.26:39778) 2023-10-01T07:59:09.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.430+0000 7fdbf8e4e700 1 -- 172.21.15.26:0/2620133768 learned_addr learned my addr 172.21.15.26:0/2620133768 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:09.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.430+0000 7fdbf9e50700 1 --2- 172.21.15.26:0/2620133768 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbf4136fe0 0x7fdbf41393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:09.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.431+0000 7fdbf8e4e700 1 -- 172.21.15.26:0/2620133768 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbf4136fe0 msgr2=0x7fdbf41393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:09.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.431+0000 7fdbf8e4e700 1 --2- 172.21.15.26:0/2620133768 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbf4136fe0 0x7fdbf41393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.431+0000 7fdbf8e4e700 1 -- 172.21.15.26:0/2620133768 >> v1:172.21.15.26:6789/0 conn(0x7fdbf409e930 legacy=0x7fdbf409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:09.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.431+0000 7fdbf8e4e700 1 -- 172.21.15.26:0/2620133768 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf409fb60 con 0x7fdbf409f410 2023-10-01T07:59:09.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.431+0000 7fdbebfff700 1 -- 172.21.15.26:0/2620133768 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2933303002 0 0) 0x7fdbf4070940 con 0x7fdbf409e930 2023-10-01T07:59:09.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.431+0000 7fdbf8e4e700 1 --2- 172.21.15.26:0/2620133768 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbf409f410 0x7fdbf4136aa0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fdbe40098f0 tx=0x7fdbe4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0eb34169fa7e861 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:09.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.431+0000 7fdbebfff700 1 -- 172.21.15.26:0/2620133768 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe4011830 con 0x7fdbf409f410 2023-10-01T07:59:09.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.431+0000 7fdbebfff700 1 -- 172.21.15.26:0/2620133768 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe4011990 con 0x7fdbf409f410 2023-10-01T07:59:09.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.431+0000 7fdbebfff700 1 -- 172.21.15.26:0/2620133768 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe4011d20 con 0x7fdbf409f410 2023-10-01T07:59:09.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.432+0000 7fdbfb8b3700 1 -- 172.21.15.26:0/2620133768 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbf409f410 msgr2=0x7fdbf4136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:09.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.432+0000 7fdbfb8b3700 1 --2- 172.21.15.26:0/2620133768 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbf409f410 0x7fdbf4136aa0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fdbe40098f0 tx=0x7fdbe4009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:09.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.432+0000 7fdbfb8b3700 1 -- 172.21.15.26:0/2620133768 shutdown_connections 2023-10-01T07:59:09.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.432+0000 7fdbfb8b3700 1 --2- 172.21.15.26:0/2620133768 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbf4136fe0 0x7fdbf41393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.432+0000 7fdbfb8b3700 1 --2- 172.21.15.26:0/2620133768 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbf409f410 0x7fdbf4136aa0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.432+0000 7fdbfb8b3700 1 -- 172.21.15.26:0/2620133768 >> 172.21.15.26:0/2620133768 conn(0x7fdbf40a4210 msgr2=0x7fdbf40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:09.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.433+0000 7fdbfb8b3700 1 -- 172.21.15.26:0/2620133768 shutdown_connections 2023-10-01T07:59:09.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.433+0000 7fdbfb8b3700 1 -- 172.21.15.26:0/2620133768 wait complete. 2023-10-01T07:59:09.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.434+0000 7fdbfb8b3700 1 Processor -- start 2023-10-01T07:59:09.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.434+0000 7fdbfb8b3700 1 -- start start 2023-10-01T07:59:09.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.435+0000 7fdbfb8b3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdbf409e930 0x7fdbf411f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:09.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.435+0000 7fdbfb8b3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbf409f410 0x7fdbf411fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:09.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.435+0000 7fdbfb8b3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbf4136fe0 0x7fdbf411ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:09.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.435+0000 7fdbfb8b3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf4122830 con 0x7fdbf409f410 2023-10-01T07:59:09.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.435+0000 7fdbfb8b3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf4122d50 con 0x7fdbf4136fe0 2023-10-01T07:59:09.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.435+0000 7fdbfb8b3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf40a33b0 con 0x7fdbf409e930 2023-10-01T07:59:09.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.435+0000 7fdbf964f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdbf409e930 0x7fdbf411f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:09.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.435+0000 7fdbf9e50700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbf4136fe0 0x7fdbf411ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:09.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.435+0000 7fdbf8e4e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbf409f410 0x7fdbf411fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:09.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.435+0000 7fdbf964f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdbf409e930 0x7fdbf411f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59872/0 (socket says 172.21.15.26:59872) 2023-10-01T07:59:09.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.435+0000 7fdbf9e50700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbf4136fe0 0x7fdbf411ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35846/0 (socket says 172.21.15.26:35846) 2023-10-01T07:59:09.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.435+0000 7fdbf964f700 1 -- 172.21.15.26:0/875471584 learned_addr learned my addr 172.21.15.26:0/875471584 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:09.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.436+0000 7fdbf9e50700 1 -- 172.21.15.26:0/875471584 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdbf409e930 msgr2=0x7fdbf411f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:09.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.436+0000 7fdbf9e50700 1 --2- 172.21.15.26:0/875471584 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdbf409e930 0x7fdbf411f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.436+0000 7fdbf9e50700 1 -- 172.21.15.26:0/875471584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbf409f410 msgr2=0x7fdbf411fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:09.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.436+0000 7fdbf9e50700 1 --2- 172.21.15.26:0/875471584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbf409f410 0x7fdbf411fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.436+0000 7fdbf9e50700 1 -- 172.21.15.26:0/875471584 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe4009550 con 0x7fdbf4136fe0 2023-10-01T07:59:09.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.436+0000 7fdbf8e4e700 1 --2- 172.21.15.26:0/875471584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbf409f410 0x7fdbf411fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:09.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.436+0000 7fdbf9e50700 1 --2- 172.21.15.26:0/875471584 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbf4136fe0 0x7fdbf411ff90 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00efc0 tx=0x7fdbec00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:09.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.436+0000 7fdbe9ffb700 1 -- 172.21.15.26:0/875471584 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec00cc90 con 0x7fdbf4136fe0 2023-10-01T07:59:09.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.436+0000 7fdbe9ffb700 1 -- 172.21.15.26:0/875471584 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbec00f040 con 0x7fdbf4136fe0 2023-10-01T07:59:09.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.436+0000 7fdbfb8b3700 1 -- 172.21.15.26:0/875471584 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf4071d20 con 0x7fdbf4136fe0 2023-10-01T07:59:09.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.436+0000 7fdbe9ffb700 1 -- 172.21.15.26:0/875471584 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec0146c0 con 0x7fdbf4136fe0 2023-10-01T07:59:09.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.436+0000 7fdbfb8b3700 1 -- 172.21.15.26:0/875471584 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf41237c0 con 0x7fdbf4136fe0 2023-10-01T07:59:09.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.438+0000 7fdbe9ffb700 1 -- 172.21.15.26:0/875471584 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdbec014820 con 0x7fdbf4136fe0 2023-10-01T07:59:09.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.438+0000 7fdbfb8b3700 1 -- 172.21.15.26:0/875471584 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbf4074ea0 con 0x7fdbf4136fe0 2023-10-01T07:59:09.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.438+0000 7fdbe9ffb700 1 -- 172.21.15.26:0/875471584 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdbec040200 con 0x7fdbf4136fe0 2023-10-01T07:59:09.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.443+0000 7fdbe9ffb700 1 -- 172.21.15.26:0/875471584 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdbec007900 con 0x7fdbf4136fe0 2023-10-01T07:59:09.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.474+0000 7f4dde5a1700 1 Processor -- start 2023-10-01T07:59:09.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.474+0000 7f4dde5a1700 1 -- start start 2023-10-01T07:59:09.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.474+0000 7f4dde5a1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dd809d6f0 0x7f4dd809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:09.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.474+0000 7f4dde5a1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4dd809e410 0x7f4dd8134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:09.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.474+0000 7f4dde5a1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dd809b120 con 0x7f4dd809e000 2023-10-01T07:59:09.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.474+0000 7f4dde5a1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dd806b460 con 0x7f4dd809e410 2023-10-01T07:59:09.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.474+0000 7f4dde5a1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd809a7e0 con 0x7f4dd809d6f0 2023-10-01T07:59:09.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.474+0000 7f4ddcb3e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4dd809e410 0x7f4dd8134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:09.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.474+0000 7f4dd77fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4dd809e000 0x7f4dd81339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41772/0 (socket says 172.21.15.26:41772) 2023-10-01T07:59:09.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.475+0000 7f4dd77fe700 1 -- 172.21.15.26:0/2839757716 learned_addr learned my addr 172.21.15.26:0/2839757716 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:59:09.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.475+0000 7f4dd7fff700 1 --2- 172.21.15.26:0/2839757716 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dd809d6f0 0x7f4dd809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:09.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.475+0000 7f4ddcb3e700 1 -- 172.21.15.26:0/2839757716 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dd809d6f0 msgr2=0x7f4dd809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:09.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.475+0000 7f4ddcb3e700 1 --2- 172.21.15.26:0/2839757716 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dd809d6f0 0x7f4dd809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.475+0000 7f4ddcb3e700 1 -- 172.21.15.26:0/2839757716 >> v1:172.21.15.26:6789/0 conn(0x7f4dd809e000 legacy=0x7f4dd81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:09.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.475+0000 7f4ddcb3e700 1 -- 172.21.15.26:0/2839757716 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd809a500 con 0x7f4dd809e410 2023-10-01T07:59:09.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.475+0000 7f4dd6ffd700 1 -- 172.21.15.26:0/2839757716 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 132686821 0 0) 0x7f4dd809b120 con 0x7f4dd809e000 2023-10-01T07:59:09.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.475+0000 7f4ddcb3e700 1 --2- 172.21.15.26:0/2839757716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dd809e410 0x7f4dd8134100 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0009d90 tx=0x7f4dd000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e2f62b43936af5b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:09.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.475+0000 7f4dd6ffd700 1 -- 172.21.15.26:0/2839757716 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd000e070 con 0x7f4dd809e410 2023-10-01T07:59:09.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.476+0000 7f4dd6ffd700 1 -- 172.21.15.26:0/2839757716 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd000bb20 con 0x7f4dd809e410 2023-10-01T07:59:09.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.476+0000 7f4dd6ffd700 1 -- 172.21.15.26:0/2839757716 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd0012430 con 0x7f4dd809e410 2023-10-01T07:59:09.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.476+0000 7f4dde5a1700 1 -- 172.21.15.26:0/2839757716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dd809e410 msgr2=0x7f4dd8134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:09.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.476+0000 7f4dde5a1700 1 --2- 172.21.15.26:0/2839757716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dd809e410 0x7f4dd8134100 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0009d90 tx=0x7f4dd000b330 comp rx=0 tx=0).stop 2023-10-01T07:59:09.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.477+0000 7f4dde5a1700 1 -- 172.21.15.26:0/2839757716 shutdown_connections 2023-10-01T07:59:09.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.477+0000 7f4dde5a1700 1 --2- 172.21.15.26:0/2839757716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dd809e410 0x7f4dd8134100 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.477+0000 7f4dde5a1700 1 --2- 172.21.15.26:0/2839757716 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dd809d6f0 0x7f4dd809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.477+0000 7f4dde5a1700 1 -- 172.21.15.26:0/2839757716 >> 172.21.15.26:0/2839757716 conn(0x7f4dd8066f50 msgr2=0x7f4dd809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:09.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.477+0000 7f4dde5a1700 1 -- 172.21.15.26:0/2839757716 shutdown_connections 2023-10-01T07:59:09.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.477+0000 7f4dde5a1700 1 -- 172.21.15.26:0/2839757716 wait complete. 2023-10-01T07:59:09.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.478+0000 7f4dde5a1700 1 Processor -- start 2023-10-01T07:59:09.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.478+0000 7f4dde5a1700 1 -- start start 2023-10-01T07:59:09.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.478+0000 7f4dde5a1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dd809d6f0 0x7f4dd81c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:09.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.478+0000 7f4dde5a1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dd809e000 0x7f4dd81c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:09.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.478+0000 7f4dde5a1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dd809e410 0x7f4dd81c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:09.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.478+0000 7f4dde5a1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd81a4db0 con 0x7f4dd809d6f0 2023-10-01T07:59:09.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.478+0000 7f4dde5a1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd81a8180 con 0x7f4dd809e410 2023-10-01T07:59:09.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.478+0000 7f4dde5a1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd81a6470 con 0x7f4dd809e000 2023-10-01T07:59:09.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.479+0000 7f4dd77fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dd809e000 0x7f4dd81c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:09.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.479+0000 7f4dd77fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dd809e000 0x7f4dd81c84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59880/0 (socket says 172.21.15.26:59880) 2023-10-01T07:59:09.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.479+0000 7f4dd7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dd809d6f0 0x7f4dd81c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:09.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.479+0000 7f4dd77fe700 1 -- 172.21.15.26:0/1331293472 learned_addr learned my addr 172.21.15.26:0/1331293472 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:09.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.479+0000 7f4dd77fe700 1 -- 172.21.15.26:0/1331293472 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dd809e410 msgr2=0x7f4dd81c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:09.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.479+0000 7f4dd77fe700 1 --2- 172.21.15.26:0/1331293472 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dd809e410 0x7f4dd81c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.479+0000 7f4dd77fe700 1 -- 172.21.15.26:0/1331293472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dd809d6f0 msgr2=0x7f4dd81c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:09.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.479+0000 7f4dd77fe700 1 --2- 172.21.15.26:0/1331293472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dd809d6f0 0x7f4dd81c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.479+0000 7f4dd77fe700 1 -- 172.21.15.26:0/1331293472 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd0009a70 con 0x7f4dd809e000 2023-10-01T07:59:09.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.479+0000 7f4dd77fe700 1 --2- 172.21.15.26:0/1331293472 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dd809e000 0x7f4dd81c84f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc001eb0 tx=0x7f4dcc00c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:09.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.479+0000 7f4dd4ff9700 1 -- 172.21.15.26:0/1331293472 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc004c80 con 0x7f4dd809e000 2023-10-01T07:59:09.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.480+0000 7f4dd4ff9700 1 -- 172.21.15.26:0/1331293472 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dcc004de0 con 0x7f4dd809e000 2023-10-01T07:59:09.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.480+0000 7f4dde5a1700 1 -- 172.21.15.26:0/1331293472 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd80a2c80 con 0x7f4dd809e000 2023-10-01T07:59:09.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.480+0000 7f4dd4ff9700 1 -- 172.21.15.26:0/1331293472 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc007310 con 0x7f4dd809e000 2023-10-01T07:59:09.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.480+0000 7f4dde5a1700 1 -- 172.21.15.26:0/1331293472 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dd81a6c00 con 0x7f4dd809e000 2023-10-01T07:59:09.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.481+0000 7f4dde5a1700 1 -- 172.21.15.26:0/1331293472 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dd8074ea0 con 0x7f4dd809e000 2023-10-01T07:59:09.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.481+0000 7f4dd4ff9700 1 -- 172.21.15.26:0/1331293472 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4dcc007470 con 0x7f4dd809e000 2023-10-01T07:59:09.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.481+0000 7f4dd4ff9700 1 -- 172.21.15.26:0/1331293472 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4dcc03f450 con 0x7f4dd809e000 2023-10-01T07:59:09.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.491+0000 7f4dd4ff9700 1 -- 172.21.15.26:0/1331293472 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4dcc0133c0 con 0x7f4dd809e000 2023-10-01T07:59:09.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.520+0000 7ff91cabb700 1 Processor -- start 2023-10-01T07:59:09.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.521+0000 7ff91cabb700 1 -- start start 2023-10-01T07:59:09.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.522+0000 7ff91cabb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff9180a0a30 0x7ff9180a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:09.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.522+0000 7ff91cabb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff91809d630 0x7ff9180a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:09.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.522+0000 7ff91cabb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff918133930 0x7ff918133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:09.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.522+0000 7ff91cabb700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9180a2a70 con 0x7ff91809d630 2023-10-01T07:59:09.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.522+0000 7ff91cabb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9180a01d0 con 0x7ff918133930 2023-10-01T07:59:09.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.522+0000 7ff91cabb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff91809e2b0 con 0x7ff9180a0a30 2023-10-01T07:59:09.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.522+0000 7ff916d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff918133930 0x7ff918133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:09.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.522+0000 7ff916d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff918133930 0x7ff918133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35876/0 (socket says 172.21.15.26:35876) 2023-10-01T07:59:09.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.522+0000 7ff91659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff9180a0a30 0x7ff9180a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:09.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.522+0000 7ff916d9d700 1 -- 172.21.15.26:0/2017931337 learned_addr learned my addr 172.21.15.26:0/2017931337 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:09.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.522+0000 7ff915d9b700 1 --2- 172.21.15.26:0/2017931337 >> v2:172.21.15.26:3300/0 conn(0x7ff91809d630 0x7ff9180a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:09.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.522+0000 7ff91659c700 1 -- 172.21.15.26:0/2017931337 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff918133930 msgr2=0x7ff918133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:09.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.522+0000 7ff91659c700 1 --2- 172.21.15.26:0/2017931337 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff918133930 0x7ff918133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.522+0000 7ff91659c700 1 -- 172.21.15.26:0/2017931337 >> v2:172.21.15.26:3300/0 conn(0x7ff91809d630 msgr2=0x7ff9180a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:09.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.522+0000 7ff91659c700 1 --2- 172.21.15.26:0/2017931337 >> v2:172.21.15.26:3300/0 conn(0x7ff91809d630 0x7ff9180a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.522+0000 7ff91659c700 1 -- 172.21.15.26:0/2017931337 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff91809dc50 con 0x7ff9180a0a30 2023-10-01T07:59:09.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.523+0000 7ff91659c700 1 --2- 172.21.15.26:0/2017931337 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff9180a0a30 0x7ff9180a0e00 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff908009840 tx=0x7ff908009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9102fdbff2b8f9ca server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:09.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.523+0000 7ff91559a700 1 -- 172.21.15.26:0/2017931337 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff908011830 con 0x7ff9180a0a30 2023-10-01T07:59:09.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.523+0000 7ff91559a700 1 -- 172.21.15.26:0/2017931337 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff908011990 con 0x7ff9180a0a30 2023-10-01T07:59:09.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.523+0000 7ff91559a700 1 -- 172.21.15.26:0/2017931337 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff908011d20 con 0x7ff9180a0a30 2023-10-01T07:59:09.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.524+0000 7ff91cabb700 1 -- 172.21.15.26:0/2017931337 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff9180a0a30 msgr2=0x7ff9180a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:09.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.524+0000 7ff91cabb700 1 --2- 172.21.15.26:0/2017931337 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff9180a0a30 0x7ff9180a0e00 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff908009840 tx=0x7ff908009b50 comp rx=0 tx=0).stop 2023-10-01T07:59:09.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.524+0000 7ff91cabb700 1 -- 172.21.15.26:0/2017931337 shutdown_connections 2023-10-01T07:59:09.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.524+0000 7ff91cabb700 1 --2- 172.21.15.26:0/2017931337 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff918133930 0x7ff918133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.524+0000 7ff91cabb700 1 --2- 172.21.15.26:0/2017931337 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff9180a0a30 0x7ff9180a0e00 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.524+0000 7ff91cabb700 1 --2- 172.21.15.26:0/2017931337 >> v2:172.21.15.26:3300/0 conn(0x7ff91809d630 0x7ff9180a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.524+0000 7ff91cabb700 1 -- 172.21.15.26:0/2017931337 >> 172.21.15.26:0/2017931337 conn(0x7ff9180a3050 msgr2=0x7ff9180a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:09.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.524+0000 7ff91cabb700 1 -- 172.21.15.26:0/2017931337 shutdown_connections 2023-10-01T07:59:09.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.524+0000 7ff91cabb700 1 -- 172.21.15.26:0/2017931337 wait complete. 2023-10-01T07:59:09.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.526+0000 7ff91cabb700 1 Processor -- start 2023-10-01T07:59:09.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.526+0000 7ff91cabb700 1 -- start start 2023-10-01T07:59:09.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.527+0000 7ff91cabb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff91809d630 0x7ff918132670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:09.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.527+0000 7ff91cabb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9180a0a30 0x7ff918132bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:09.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.527+0000 7ff91cabb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff918133930 0x7ff91811e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:09.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.527+0000 7ff91cabb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff918120480 con 0x7ff9180a0a30 2023-10-01T07:59:09.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.527+0000 7ff91cabb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9180a41c0 con 0x7ff918133930 2023-10-01T07:59:09.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.527+0000 7ff91cabb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9181225b0 con 0x7ff91809d630 2023-10-01T07:59:09.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.527+0000 7ff91659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff91809d630 0x7ff918132670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:09.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.527+0000 7ff91659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff91809d630 0x7ff918132670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59896/0 (socket says 172.21.15.26:59896) 2023-10-01T07:59:09.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.527+0000 7ff91659c700 1 -- 172.21.15.26:0/1523481802 learned_addr learned my addr 172.21.15.26:0/1523481802 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:09.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.527+0000 7ff916d9d700 1 --2- 172.21.15.26:0/1523481802 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff918133930 0x7ff91811e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:09.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.527+0000 7ff915d9b700 1 --2- 172.21.15.26:0/1523481802 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9180a0a30 0x7ff918132bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:09.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.528+0000 7ff915d9b700 1 -- 172.21.15.26:0/1523481802 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff91809d630 msgr2=0x7ff918132670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:09.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.528+0000 7ff915d9b700 1 --2- 172.21.15.26:0/1523481802 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff91809d630 0x7ff918132670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.528+0000 7ff915d9b700 1 -- 172.21.15.26:0/1523481802 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff918133930 msgr2=0x7ff91811e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:09.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.528+0000 7ff915d9b700 1 --2- 172.21.15.26:0/1523481802 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff918133930 0x7ff91811e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.528+0000 7ff915d9b700 1 -- 172.21.15.26:0/1523481802 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9080094a0 con 0x7ff9180a0a30 2023-10-01T07:59:09.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.528+0000 7ff91659c700 1 --2- 172.21.15.26:0/1523481802 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff91809d630 0x7ff918132670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:09.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.528+0000 7ff916d9d700 1 --2- 172.21.15.26:0/1523481802 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff918133930 0x7ff91811e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:09.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.528+0000 7ff915d9b700 1 --2- 172.21.15.26:0/1523481802 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9180a0a30 0x7ff918132bb0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7ff90c00e8d0 tx=0x7ff90c00ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:09.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.528+0000 7ff906ffd700 1 -- 172.21.15.26:0/1523481802 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90c013680 con 0x7ff9180a0a30 2023-10-01T07:59:09.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.528+0000 7ff906ffd700 1 -- 172.21.15.26:0/1523481802 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff90c0137e0 con 0x7ff9180a0a30 2023-10-01T07:59:09.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.528+0000 7ff91cabb700 1 -- 172.21.15.26:0/1523481802 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9181220b0 con 0x7ff9180a0a30 2023-10-01T07:59:09.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.528+0000 7ff906ffd700 1 -- 172.21.15.26:0/1523481802 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90c013b50 con 0x7ff9180a0a30 2023-10-01T07:59:09.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.528+0000 7ff91cabb700 1 -- 172.21.15.26:0/1523481802 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff918121df0 con 0x7ff9180a0a30 2023-10-01T07:59:09.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.529+0000 7ff906ffd700 1 -- 172.21.15.26:0/1523481802 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff90c013cb0 con 0x7ff9180a0a30 2023-10-01T07:59:09.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.529+0000 7ff906ffd700 1 -- 172.21.15.26:0/1523481802 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff90c03fa20 con 0x7ff9180a0a30 2023-10-01T07:59:09.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.529+0000 7ff91cabb700 1 -- 172.21.15.26:0/1523481802 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9180747f0 con 0x7ff9180a0a30 2023-10-01T07:59:09.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.535+0000 7ff906ffd700 1 -- 172.21.15.26:0/1523481802 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff90c021080 con 0x7ff9180a0a30 2023-10-01T07:59:09.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.612+0000 7fab2b615700 1 -- 172.21.15.26:0/2837361270 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fab2411bea0 con 0x7fab24130540 2023-10-01T07:59:09.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.612+0000 7fab19ffb700 1 -- 172.21.15.26:0/2837361270 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fab2411bea0 con 0x7fab24130540 2023-10-01T07:59:09.613 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:09.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.615+0000 7fab2b615700 1 -- 172.21.15.26:0/2837361270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab24130540 msgr2=0x7fab24119210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:09.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.615+0000 7fab2b615700 1 --2- 172.21.15.26:0/2837361270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab24130540 0x7fab24119210 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fab14000f60 tx=0x7fab1400c730 comp rx=0 tx=0).stop 2023-10-01T07:59:09.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.615+0000 7fab2b615700 1 -- 172.21.15.26:0/2837361270 shutdown_connections 2023-10-01T07:59:09.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.615+0000 7fab2b615700 1 --2- 172.21.15.26:0/2837361270 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab24130e50 0x7fab24119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.615+0000 7fab2b615700 1 --2- 172.21.15.26:0/2837361270 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab2406fcf0 0x7fab24118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.615+0000 7fab2b615700 1 --2- 172.21.15.26:0/2837361270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab24130540 0x7fab24119210 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.615+0000 7fab2b615700 1 -- 172.21.15.26:0/2837361270 >> 172.21.15.26:0/2837361270 conn(0x7fab240a2aa0 msgr2=0x7fab2412d600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:09.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.615+0000 7fab2b615700 1 -- 172.21.15.26:0/2837361270 shutdown_connections 2023-10-01T07:59:09.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.615+0000 7fab2b615700 1 -- 172.21.15.26:0/2837361270 wait complete. 2023-10-01T07:59:09.629 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:09.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.680+0000 7fdbfb8b3700 1 -- 172.21.15.26:0/875471584 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdbf406b250 con 0x7fdbf4136fe0 2023-10-01T07:59:09.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.681+0000 7fdbe9ffb700 1 -- 172.21.15.26:0/875471584 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdbec018020 con 0x7fdbf4136fe0 2023-10-01T07:59:09.682 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:09.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.683+0000 7fdbfb8b3700 1 -- 172.21.15.26:0/875471584 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbf4136fe0 msgr2=0x7fdbf411ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:09.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.683+0000 7fdbfb8b3700 1 --2- 172.21.15.26:0/875471584 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbf4136fe0 0x7fdbf411ff90 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00efc0 tx=0x7fdbec00c3a0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.683+0000 7fdbfb8b3700 1 -- 172.21.15.26:0/875471584 shutdown_connections 2023-10-01T07:59:09.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.683+0000 7fdbfb8b3700 1 --2- 172.21.15.26:0/875471584 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdbf4136fe0 0x7fdbf411ff90 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.683+0000 7fdbfb8b3700 1 --2- 172.21.15.26:0/875471584 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdbf409e930 0x7fdbf411f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.683+0000 7fdbfb8b3700 1 --2- 172.21.15.26:0/875471584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbf409f410 0x7fdbf411fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.683+0000 7fdbfb8b3700 1 -- 172.21.15.26:0/875471584 >> 172.21.15.26:0/875471584 conn(0x7fdbf40a4210 msgr2=0x7fdbf4135ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:09.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.683+0000 7fdbfb8b3700 1 -- 172.21.15.26:0/875471584 shutdown_connections 2023-10-01T07:59:09.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.683+0000 7fdbfb8b3700 1 -- 172.21.15.26:0/875471584 wait complete. 2023-10-01T07:59:09.698 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:09.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.699+0000 7f4dde5a1700 1 -- 172.21.15.26:0/1331293472 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4dd806c360 con 0x7f4dd809e000 2023-10-01T07:59:09.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.700+0000 7f4dd4ff9700 1 -- 172.21.15.26:0/1331293472 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4dcc011360 con 0x7f4dd809e000 2023-10-01T07:59:09.700 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:09.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.702+0000 7f4dde5a1700 1 -- 172.21.15.26:0/1331293472 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dd809e000 msgr2=0x7f4dd81c84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:09.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.702+0000 7f4dde5a1700 1 --2- 172.21.15.26:0/1331293472 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dd809e000 0x7f4dd81c84f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc001eb0 tx=0x7f4dcc00c800 comp rx=0 tx=0).stop 2023-10-01T07:59:09.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.702+0000 7f4dde5a1700 1 -- 172.21.15.26:0/1331293472 shutdown_connections 2023-10-01T07:59:09.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.702+0000 7f4dde5a1700 1 --2- 172.21.15.26:0/1331293472 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dd809e410 0x7f4dd81c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.702+0000 7f4dde5a1700 1 --2- 172.21.15.26:0/1331293472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dd809d6f0 0x7f4dd81c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.702+0000 7f4dde5a1700 1 --2- 172.21.15.26:0/1331293472 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dd809e000 0x7f4dd81c84f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.702+0000 7f4dde5a1700 1 -- 172.21.15.26:0/1331293472 >> 172.21.15.26:0/1331293472 conn(0x7f4dd8066f50 msgr2=0x7f4dd80a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:09.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.703+0000 7f4dde5a1700 1 -- 172.21.15.26:0/1331293472 shutdown_connections 2023-10-01T07:59:09.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.703+0000 7f4dde5a1700 1 -- 172.21.15.26:0/1331293472 wait complete. 2023-10-01T07:59:09.717 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:09.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.751+0000 7ff91cabb700 1 -- 172.21.15.26:0/1523481802 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff918072980 con 0x7ff9180a0a30 2023-10-01T07:59:09.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.751+0000 7ff906ffd700 1 -- 172.21.15.26:0/1523481802 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff90c017020 con 0x7ff9180a0a30 2023-10-01T07:59:09.752 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:09.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.754+0000 7ff91cabb700 1 -- 172.21.15.26:0/1523481802 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9180a0a30 msgr2=0x7ff918132bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:09.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.754+0000 7ff91cabb700 1 --2- 172.21.15.26:0/1523481802 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9180a0a30 0x7ff918132bb0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7ff90c00e8d0 tx=0x7ff90c00ebe0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.754+0000 7ff91cabb700 1 -- 172.21.15.26:0/1523481802 shutdown_connections 2023-10-01T07:59:09.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.754+0000 7ff91cabb700 1 --2- 172.21.15.26:0/1523481802 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff918133930 0x7ff91811e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.754+0000 7ff91cabb700 1 --2- 172.21.15.26:0/1523481802 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff91809d630 0x7ff918132670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.754+0000 7ff91cabb700 1 --2- 172.21.15.26:0/1523481802 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9180a0a30 0x7ff918132bb0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:09.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.754+0000 7ff91cabb700 1 -- 172.21.15.26:0/1523481802 >> 172.21.15.26:0/1523481802 conn(0x7ff9180a3050 msgr2=0x7ff9181bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:09.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.754+0000 7ff91cabb700 1 -- 172.21.15.26:0/1523481802 shutdown_connections 2023-10-01T07:59:09.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:09.754+0000 7ff91cabb700 1 -- 172.21.15.26:0/1523481802 wait complete. 2023-10-01T07:59:09.768 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:10.630 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:10.699 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:10.718 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:10.768 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:10.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.781+0000 7f077e2c1700 1 Processor -- start 2023-10-01T07:59:10.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.781+0000 7f077e2c1700 1 -- start start 2023-10-01T07:59:10.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.782+0000 7f077e2c1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f07781367c0 0x7f0778138ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:10.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.782+0000 7f077e2c1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f07781390e0 0x7f077813b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:10.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.782+0000 7f077e2c1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07781334b0 con 0x7f0778133870 2023-10-01T07:59:10.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.782+0000 7f077e2c1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f077809fa40 con 0x7f07781390e0 2023-10-01T07:59:10.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.782+0000 7f077e2c1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f077806f250 con 0x7f07781367c0 2023-10-01T07:59:10.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.782+0000 7f07777fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f07781367c0 0x7f0778138ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:10.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.782+0000 7f0777fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0778133870 0x7f0778133c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41776/0 (socket says 172.21.15.26:41776) 2023-10-01T07:59:10.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.782+0000 7f0777fff700 1 -- 172.21.15.26:0/2306097650 learned_addr learned my addr 172.21.15.26:0/2306097650 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:59:10.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.782+0000 7f077c85e700 1 --2- 172.21.15.26:0/2306097650 >> v2:172.21.15.26:3300/0 conn(0x7f07781390e0 0x7f077813b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:10.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.782+0000 7f07777fe700 1 -- 172.21.15.26:0/2306097650 >> v2:172.21.15.26:3300/0 conn(0x7f07781390e0 msgr2=0x7f077813b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:10.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.782+0000 7f07777fe700 1 --2- 172.21.15.26:0/2306097650 >> v2:172.21.15.26:3300/0 conn(0x7f07781390e0 0x7f077813b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:10.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.782+0000 7f07777fe700 1 -- 172.21.15.26:0/2306097650 >> v1:172.21.15.26:6789/0 conn(0x7f0778133870 legacy=0x7f0778133c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:10.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.782+0000 7f07777fe700 1 -- 172.21.15.26:0/2306097650 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077806fb20 con 0x7f07781367c0 2023-10-01T07:59:10.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.782+0000 7f07777fe700 1 --2- 172.21.15.26:0/2306097650 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f07781367c0 0x7f0778138ba0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f076c009840 tx=0x7f076c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c87bac29bcdc5ea1 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:10.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.783+0000 7f0776ffd700 1 -- 172.21.15.26:0/2306097650 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c011830 con 0x7f07781367c0 2023-10-01T07:59:10.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.783+0000 7f0776ffd700 1 -- 172.21.15.26:0/2306097650 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076c011990 con 0x7f07781367c0 2023-10-01T07:59:10.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.783+0000 7f0776ffd700 1 -- 172.21.15.26:0/2306097650 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c011d20 con 0x7f07781367c0 2023-10-01T07:59:10.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.783+0000 7f077e2c1700 1 -- 172.21.15.26:0/2306097650 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f07781367c0 msgr2=0x7f0778138ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:10.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.783+0000 7f077e2c1700 1 --2- 172.21.15.26:0/2306097650 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f07781367c0 0x7f0778138ba0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f076c009840 tx=0x7f076c009b50 comp rx=0 tx=0).stop 2023-10-01T07:59:10.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.784+0000 7f077e2c1700 1 -- 172.21.15.26:0/2306097650 shutdown_connections 2023-10-01T07:59:10.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.784+0000 7f077e2c1700 1 --2- 172.21.15.26:0/2306097650 >> v2:172.21.15.26:3300/0 conn(0x7f07781390e0 0x7f077813b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:10.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.784+0000 7f077e2c1700 1 --2- 172.21.15.26:0/2306097650 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f07781367c0 0x7f0778138ba0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:10.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.784+0000 7f077e2c1700 1 -- 172.21.15.26:0/2306097650 >> 172.21.15.26:0/2306097650 conn(0x7f07780a2610 msgr2=0x7f07780a2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:10.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.784+0000 7f077e2c1700 1 -- 172.21.15.26:0/2306097650 shutdown_connections 2023-10-01T07:59:10.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.784+0000 7f077e2c1700 1 -- 172.21.15.26:0/2306097650 wait complete. 2023-10-01T07:59:10.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.785+0000 7f077e2c1700 1 Processor -- start 2023-10-01T07:59:10.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.785+0000 7f077e2c1700 1 -- start start 2023-10-01T07:59:10.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.786+0000 7f077e2c1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0778133870 0x7f0778119970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:10.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.786+0000 7f077e2c1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f07781367c0 0x7f0778119eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:10.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.786+0000 7f077e2c1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f07781390e0 0x7f07781c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:10.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.786+0000 7f077e2c1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077811c2c0 con 0x7f0778133870 2023-10-01T07:59:10.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.786+0000 7f077e2c1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077811a3f0 con 0x7f07781390e0 2023-10-01T07:59:10.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.786+0000 7f077e2c1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f077812ec10 con 0x7f07781367c0 2023-10-01T07:59:10.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.786+0000 7f0777fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0778133870 0x7f0778119970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:10.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.786+0000 7f0777fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0778133870 0x7f0778119970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39820/0 (socket says 172.21.15.26:39820) 2023-10-01T07:59:10.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.786+0000 7f0777fff700 1 -- 172.21.15.26:0/709202881 learned_addr learned my addr 172.21.15.26:0/709202881 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:10.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.787+0000 7f077c85e700 1 --2- 172.21.15.26:0/709202881 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f07781390e0 0x7f07781c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:10.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.787+0000 7f07777fe700 1 --2- 172.21.15.26:0/709202881 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f07781367c0 0x7f0778119eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:10.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.787+0000 7f07777fe700 1 -- 172.21.15.26:0/709202881 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f07781390e0 msgr2=0x7f07781c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:10.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.787+0000 7f07777fe700 1 --2- 172.21.15.26:0/709202881 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f07781390e0 0x7f07781c82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:10.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.787+0000 7f07777fe700 1 -- 172.21.15.26:0/709202881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0778133870 msgr2=0x7f0778119970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:10.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.787+0000 7f07777fe700 1 --2- 172.21.15.26:0/709202881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0778133870 0x7f0778119970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:10.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.787+0000 7f07777fe700 1 -- 172.21.15.26:0/709202881 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076c0094a0 con 0x7f07781367c0 2023-10-01T07:59:10.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.787+0000 7f077c85e700 1 --2- 172.21.15.26:0/709202881 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f07781390e0 0x7f07781c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:10.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.787+0000 7f0777fff700 1 --2- 172.21.15.26:0/709202881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0778133870 0x7f0778119970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:10.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.787+0000 7f07777fe700 1 --2- 172.21.15.26:0/709202881 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f07781367c0 0x7f0778119eb0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f076c016000 tx=0x7f076c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:10.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.788+0000 7f0774ff9700 1 -- 172.21.15.26:0/709202881 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c004400 con 0x7f07781367c0 2023-10-01T07:59:10.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.788+0000 7f0774ff9700 1 -- 172.21.15.26:0/709202881 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076c01f070 con 0x7f07781367c0 2023-10-01T07:59:10.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.788+0000 7f077e2c1700 1 -- 172.21.15.26:0/709202881 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f077811c940 con 0x7f07781367c0 2023-10-01T07:59:10.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.788+0000 7f0774ff9700 1 -- 172.21.15.26:0/709202881 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c0038c0 con 0x7f07781367c0 2023-10-01T07:59:10.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.788+0000 7f077e2c1700 1 -- 172.21.15.26:0/709202881 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0778119520 con 0x7f07781367c0 2023-10-01T07:59:10.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.789+0000 7f077e2c1700 1 -- 172.21.15.26:0/709202881 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07780747f0 con 0x7f07781367c0 2023-10-01T07:59:10.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.789+0000 7f0774ff9700 1 -- 172.21.15.26:0/709202881 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f076c021030 con 0x7f07781367c0 2023-10-01T07:59:10.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.789+0000 7f0774ff9700 1 -- 172.21.15.26:0/709202881 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f076c040900 con 0x7f07781367c0 2023-10-01T07:59:10.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.795+0000 7f0774ff9700 1 -- 172.21.15.26:0/709202881 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f076c0239c0 con 0x7f07781367c0 2023-10-01T07:59:10.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.852+0000 7f5846cf6700 1 Processor -- start 2023-10-01T07:59:10.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.852+0000 7f5846cf6700 1 -- start start 2023-10-01T07:59:10.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.853+0000 7f5846cf6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f584006e570 0x7f584006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:10.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.853+0000 7f5846cf6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f584006ee80 0x7f5840134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:10.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.853+0000 7f5846cf6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5840070ee0 con 0x7f584009eca0 2023-10-01T07:59:10.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.853+0000 7f5846cf6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5840071480 con 0x7f584006e570 2023-10-01T07:59:10.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.853+0000 7f5846cf6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5840071b90 con 0x7f584006ee80 2023-10-01T07:59:10.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.853+0000 7f5845293700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f584006ee80 0x7f5840134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:10.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.853+0000 7f583ffff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f584009eca0 0x7f5840134610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41788/0 (socket says 172.21.15.26:41788) 2023-10-01T07:59:10.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.853+0000 7f583ffff700 1 -- 172.21.15.26:0/3463906296 learned_addr learned my addr 172.21.15.26:0/3463906296 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:59:10.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.853+0000 7f5844a92700 1 --2- 172.21.15.26:0/3463906296 >> v2:172.21.15.26:3300/0 conn(0x7f584006e570 0x7f584006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:10.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.854+0000 7f5844a92700 1 -- 172.21.15.26:0/3463906296 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f584006ee80 msgr2=0x7f5840134d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:10.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.854+0000 7f5844a92700 1 --2- 172.21.15.26:0/3463906296 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f584006ee80 0x7f5840134d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:10.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.854+0000 7f5844a92700 1 -- 172.21.15.26:0/3463906296 >> v1:172.21.15.26:6789/0 conn(0x7f584009eca0 legacy=0x7f5840134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:10.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.854+0000 7f5844a92700 1 -- 172.21.15.26:0/3463906296 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58400711a0 con 0x7f584006e570 2023-10-01T07:59:10.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.854+0000 7f5845293700 1 --2- 172.21.15.26:0/3463906296 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f584006ee80 0x7f5840134d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:10.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.854+0000 7f5844a92700 1 --2- 172.21.15.26:0/3463906296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f584006e570 0x7f584006e940 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f5834009840 tx=0x7f5834009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43ac4c94baff6c70 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:10.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.854+0000 7f583f7fe700 1 -- 172.21.15.26:0/3463906296 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5834011830 con 0x7f584006e570 2023-10-01T07:59:10.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.854+0000 7f583f7fe700 1 -- 172.21.15.26:0/3463906296 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5834011990 con 0x7f584006e570 2023-10-01T07:59:10.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.854+0000 7f583f7fe700 1 -- 172.21.15.26:0/3463906296 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5834011d20 con 0x7f584006e570 2023-10-01T07:59:10.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.855+0000 7f5846cf6700 1 -- 172.21.15.26:0/3463906296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f584006e570 msgr2=0x7f584006e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:10.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.855+0000 7f5846cf6700 1 --2- 172.21.15.26:0/3463906296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f584006e570 0x7f584006e940 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f5834009840 tx=0x7f5834009b50 comp rx=0 tx=0).stop 2023-10-01T07:59:10.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.855+0000 7f5846cf6700 1 -- 172.21.15.26:0/3463906296 shutdown_connections 2023-10-01T07:59:10.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.855+0000 7f5846cf6700 1 --2- 172.21.15.26:0/3463906296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f584006e570 0x7f584006e940 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:10.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.855+0000 7f5846cf6700 1 --2- 172.21.15.26:0/3463906296 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f584006ee80 0x7f5840134d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:10.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.855+0000 7f5846cf6700 1 -- 172.21.15.26:0/3463906296 >> 172.21.15.26:0/3463906296 conn(0x7f58400a2aa0 msgr2=0x7f58400a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:10.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.856+0000 7f5846cf6700 1 -- 172.21.15.26:0/3463906296 shutdown_connections 2023-10-01T07:59:10.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.856+0000 7f5846cf6700 1 -- 172.21.15.26:0/3463906296 wait complete. 2023-10-01T07:59:10.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.857+0000 7f5846cf6700 1 Processor -- start 2023-10-01T07:59:10.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.857+0000 7f5846cf6700 1 -- start start 2023-10-01T07:59:10.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.858+0000 7f5846cf6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f584006e570 0x7f58401233e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:10.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.858+0000 7f5846cf6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f584006ee80 0x7f5840123920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:10.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.858+0000 7f5846cf6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5840123e60 0x7f58401cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:10.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.858+0000 7f5846cf6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5840126f00 con 0x7f584006ee80 2023-10-01T07:59:10.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.858+0000 7f5846cf6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5840125880 con 0x7f5840123e60 2023-10-01T07:59:10.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.858+0000 7f5846cf6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5840135d40 con 0x7f584006e570 2023-10-01T07:59:10.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.858+0000 7f5845293700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5840123e60 0x7f58401cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:10.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.858+0000 7f5845293700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5840123e60 0x7f58401cca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35920/0 (socket says 172.21.15.26:35920) 2023-10-01T07:59:10.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.858+0000 7f5845293700 1 -- 172.21.15.26:0/2858888067 learned_addr learned my addr 172.21.15.26:0/2858888067 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:10.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.858+0000 7f583ffff700 1 --2- 172.21.15.26:0/2858888067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f584006ee80 0x7f5840123920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:10.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.858+0000 7f5844a92700 1 --2- 172.21.15.26:0/2858888067 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f584006e570 0x7f58401233e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:10.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.859+0000 7f5845293700 1 -- 172.21.15.26:0/2858888067 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f584006e570 msgr2=0x7f58401233e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:10.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.859+0000 7f5845293700 1 --2- 172.21.15.26:0/2858888067 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f584006e570 0x7f58401233e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:10.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.859+0000 7f5845293700 1 -- 172.21.15.26:0/2858888067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f584006ee80 msgr2=0x7f5840123920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:10.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.859+0000 7f5845293700 1 --2- 172.21.15.26:0/2858888067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f584006ee80 0x7f5840123920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:10.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.859+0000 7f5845293700 1 -- 172.21.15.26:0/2858888067 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5838009a70 con 0x7f5840123e60 2023-10-01T07:59:10.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.859+0000 7f583ffff700 1 --2- 172.21.15.26:0/2858888067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f584006ee80 0x7f5840123920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:59:10.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.859+0000 7f5845293700 1 --2- 172.21.15.26:0/2858888067 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5840123e60 0x7f58401cca00 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5838009f00 tx=0x7f583800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:10.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.859+0000 7f583d7fa700 1 -- 172.21.15.26:0/2858888067 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5838009d70 con 0x7f5840123e60 2023-10-01T07:59:10.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.859+0000 7f583d7fa700 1 -- 172.21.15.26:0/2858888067 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583800f040 con 0x7f5840123e60 2023-10-01T07:59:10.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.859+0000 7f5846cf6700 1 -- 172.21.15.26:0/2858888067 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58340094a0 con 0x7f5840123e60 2023-10-01T07:59:10.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.859+0000 7f583d7fa700 1 -- 172.21.15.26:0/2858888067 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583800ce20 con 0x7f5840123e60 2023-10-01T07:59:10.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.859+0000 7f5846cf6700 1 -- 172.21.15.26:0/2858888067 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5840134330 con 0x7f5840123e60 2023-10-01T07:59:10.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.861+0000 7f5846cf6700 1 -- 172.21.15.26:0/2858888067 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5840126a80 con 0x7f5840123e60 2023-10-01T07:59:10.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.861+0000 7f583d7fa700 1 -- 172.21.15.26:0/2858888067 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5838003a20 con 0x7f5840123e60 2023-10-01T07:59:10.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.861+0000 7f583d7fa700 1 -- 172.21.15.26:0/2858888067 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5838040680 con 0x7f5840123e60 2023-10-01T07:59:10.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.870+0000 7f583d7fa700 1 -- 172.21.15.26:0/2858888067 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f583801c3b0 con 0x7f5840123e60 2023-10-01T07:59:10.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.893+0000 7fd302317700 1 Processor -- start 2023-10-01T07:59:10.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.893+0000 7fd302317700 1 -- start start 2023-10-01T07:59:10.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.894+0000 7fd302317700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2fc09de00 0x7fd2fc09e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:10.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.894+0000 7fd302317700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd2fc13d1f0 0x7fd2fc13f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:10.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.894+0000 7fd302317700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2fc09a810 con 0x7fd2fc06a770 2023-10-01T07:59:10.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.894+0000 7fd302317700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2fc06ab40 con 0x7fd2fc13d1f0 2023-10-01T07:59:10.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.894+0000 7fd302317700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc09ebc0 con 0x7fd2fc09de00 2023-10-01T07:59:10.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.894+0000 7fd3008b4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd2fc13d1f0 0x7fd2fc13f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:10.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.894+0000 7fd2fb7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2fc09de00 0x7fd2fc09e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:10.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.894+0000 7fd3008b4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd2fc13d1f0 0x7fd2fc13f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39844/0 (socket says 172.21.15.26:39844) 2023-10-01T07:59:10.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.894+0000 7fd3008b4700 1 -- 172.21.15.26:0/3568655984 learned_addr learned my addr 172.21.15.26:0/3568655984 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:10.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.895+0000 7fd3008b4700 1 -- 172.21.15.26:0/3568655984 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2fc09de00 msgr2=0x7fd2fc09e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:10.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.895+0000 7fd3008b4700 1 --2- 172.21.15.26:0/3568655984 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2fc09de00 0x7fd2fc09e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:10.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.895+0000 7fd3008b4700 1 -- 172.21.15.26:0/3568655984 >> v1:172.21.15.26:6789/0 conn(0x7fd2fc06a770 legacy=0x7fd2fc09d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:10.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.895+0000 7fd3008b4700 1 -- 172.21.15.26:0/3568655984 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2fc09e920 con 0x7fd2fc13d1f0 2023-10-01T07:59:10.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.895+0000 7fd3008b4700 1 --2- 172.21.15.26:0/3568655984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2fc13d1f0 0x7fd2fc13f5d0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4009e50 tx=0x7fd2f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d35b7b0ee918f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:10.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.895+0000 7fd2faffd700 1 -- 172.21.15.26:0/3568655984 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f400e070 con 0x7fd2fc13d1f0 2023-10-01T07:59:10.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.895+0000 7fd2faffd700 1 -- 172.21.15.26:0/3568655984 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f400b910 con 0x7fd2fc13d1f0 2023-10-01T07:59:10.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.895+0000 7fd2faffd700 1 -- 172.21.15.26:0/3568655984 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f400bcc0 con 0x7fd2fc13d1f0 2023-10-01T07:59:10.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.896+0000 7fd302317700 1 -- 172.21.15.26:0/3568655984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2fc13d1f0 msgr2=0x7fd2fc13f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:10.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.896+0000 7fd302317700 1 --2- 172.21.15.26:0/3568655984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2fc13d1f0 0x7fd2fc13f5d0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4009e50 tx=0x7fd2f400b330 comp rx=0 tx=0).stop 2023-10-01T07:59:10.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.896+0000 7fd302317700 1 -- 172.21.15.26:0/3568655984 shutdown_connections 2023-10-01T07:59:10.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.896+0000 7fd302317700 1 --2- 172.21.15.26:0/3568655984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2fc13d1f0 0x7fd2fc13f5d0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:10.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.896+0000 7fd302317700 1 --2- 172.21.15.26:0/3568655984 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2fc09de00 0x7fd2fc09e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:10.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.896+0000 7fd302317700 1 -- 172.21.15.26:0/3568655984 >> 172.21.15.26:0/3568655984 conn(0x7fd2fc066f50 msgr2=0x7fd2fc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:10.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.896+0000 7fd302317700 1 -- 172.21.15.26:0/3568655984 shutdown_connections 2023-10-01T07:59:10.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.896+0000 7fd302317700 1 -- 172.21.15.26:0/3568655984 wait complete. 2023-10-01T07:59:10.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.897+0000 7fd302317700 1 Processor -- start 2023-10-01T07:59:10.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.898+0000 7fd302317700 1 -- start start 2023-10-01T07:59:10.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.898+0000 7fd302317700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2fc06a770 0x7fd2fc1cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:10.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.898+0000 7fd302317700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2fc09de00 0x7fd2fc1ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:10.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.898+0000 7fd302317700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2fc13d1f0 0x7fd2fc1cd440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:10.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.898+0000 7fd302317700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc06fe60 con 0x7fd2fc09de00 2023-10-01T07:59:10.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.898+0000 7fd302317700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc071e40 con 0x7fd2fc13d1f0 2023-10-01T07:59:10.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.898+0000 7fd302317700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc06f900 con 0x7fd2fc06a770 2023-10-01T07:59:10.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.898+0000 7fd3008b4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2fc13d1f0 0x7fd2fc1cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:10.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.898+0000 7fd2fb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2fc09de00 0x7fd2fc1ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:10.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.898+0000 7fd3008b4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2fc13d1f0 0x7fd2fc1cd440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35946/0 (socket says 172.21.15.26:35946) 2023-10-01T07:59:10.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.898+0000 7fd2fb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2fc09de00 0x7fd2fc1ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39850/0 (socket says 172.21.15.26:39850) 2023-10-01T07:59:10.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.898+0000 7fd3008b4700 1 -- 172.21.15.26:0/3373980405 learned_addr learned my addr 172.21.15.26:0/3373980405 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:10.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.899+0000 7fd3008b4700 1 -- 172.21.15.26:0/3373980405 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2fc06a770 msgr2=0x7fd2fc1cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:10.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.899+0000 7fd3008b4700 1 --2- 172.21.15.26:0/3373980405 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2fc06a770 0x7fd2fc1cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:10.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.899+0000 7fd3008b4700 1 -- 172.21.15.26:0/3373980405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2fc09de00 msgr2=0x7fd2fc1ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:10.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.899+0000 7fd3008b4700 1 --2- 172.21.15.26:0/3373980405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2fc09de00 0x7fd2fc1ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:10.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.899+0000 7fd3008b4700 1 -- 172.21.15.26:0/3373980405 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f4009b30 con 0x7fd2fc13d1f0 2023-10-01T07:59:10.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.899+0000 7fd3008b4700 1 --2- 172.21.15.26:0/3373980405 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2fc13d1f0 0x7fd2fc1cd440 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc09eff0 tx=0x7fd2f4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:10.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.899+0000 7fd2f8ff9700 1 -- 172.21.15.26:0/3373980405 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f40048b0 con 0x7fd2fc13d1f0 2023-10-01T07:59:10.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.899+0000 7fd2f8ff9700 1 -- 172.21.15.26:0/3373980405 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f40092e0 con 0x7fd2fc13d1f0 2023-10-01T07:59:10.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.899+0000 7fd2f8ff9700 1 -- 172.21.15.26:0/3373980405 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f401c660 con 0x7fd2fc13d1f0 2023-10-01T07:59:10.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.899+0000 7fd302317700 1 -- 172.21.15.26:0/3373980405 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2fc0a37d0 con 0x7fd2fc13d1f0 2023-10-01T07:59:10.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.899+0000 7fd302317700 1 -- 172.21.15.26:0/3373980405 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2fc070140 con 0x7fd2fc13d1f0 2023-10-01T07:59:10.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.900+0000 7fd2f8ff9700 1 -- 172.21.15.26:0/3373980405 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd2f401c7c0 con 0x7fd2fc13d1f0 2023-10-01T07:59:10.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.900+0000 7fd2f8ff9700 1 -- 172.21.15.26:0/3373980405 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd2f40415e0 con 0x7fd2fc13d1f0 2023-10-01T07:59:10.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.901+0000 7fd2e27fc700 1 -- 172.21.15.26:0/3373980405 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d40052e0 con 0x7fd2fc13d1f0 2023-10-01T07:59:10.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.909+0000 7fd2f8ff9700 1 -- 172.21.15.26:0/3373980405 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd2f40257d0 con 0x7fd2fc13d1f0 2023-10-01T07:59:10.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.930+0000 7f57c39de700 1 Processor -- start 2023-10-01T07:59:10.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.930+0000 7f57c39de700 1 -- start start 2023-10-01T07:59:10.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.930+0000 7f57c39de700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f57bc133a80 0x7f57bc133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:10.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.930+0000 7f57c39de700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57bc130a70 0x7f57bc13b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:10.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.931+0000 7f57c39de700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57bc06bc00 con 0x7f57bc12ff20 2023-10-01T07:59:10.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.931+0000 7f57c39de700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57bc06c570 con 0x7f57bc133a80 2023-10-01T07:59:10.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.931+0000 7f57c39de700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc0a0040 con 0x7f57bc130a70 2023-10-01T07:59:10.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.931+0000 7f57c1f7b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57bc130a70 0x7f57bc13b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:10.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.931+0000 7f57c177a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f57bc133a80 0x7f57bc133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:10.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.931+0000 7f57c1f7b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57bc130a70 0x7f57bc13b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35952/0 (socket says 172.21.15.26:35952) 2023-10-01T07:59:10.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.931+0000 7f57c177a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f57bc133a80 0x7f57bc133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39858/0 (socket says 172.21.15.26:39858) 2023-10-01T07:59:10.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.931+0000 7f57c1f7b700 1 -- 172.21.15.26:0/1703431080 learned_addr learned my addr 172.21.15.26:0/1703431080 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:10.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.931+0000 7f57c177a700 1 -- 172.21.15.26:0/1703431080 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57bc130a70 msgr2=0x7f57bc13b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:10.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.931+0000 7f57c177a700 1 --2- 172.21.15.26:0/1703431080 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57bc130a70 0x7f57bc13b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:10.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.931+0000 7f57c177a700 1 -- 172.21.15.26:0/1703431080 >> v1:172.21.15.26:6789/0 conn(0x7f57bc12ff20 legacy=0x7f57bc130360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:10.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.931+0000 7f57c177a700 1 -- 172.21.15.26:0/1703431080 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57bc133860 con 0x7f57bc133a80 2023-10-01T07:59:10.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.931+0000 7f57c1f7b700 1 --2- 172.21.15.26:0/1703431080 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57bc130a70 0x7f57bc13b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:10.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.932+0000 7f57c177a700 1 --2- 172.21.15.26:0/1703431080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57bc133a80 0x7f57bc133e50 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f57b8009840 tx=0x7f57b8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b4c574f54c03f51 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:10.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.932+0000 7f57b3fff700 1 -- 172.21.15.26:0/1703431080 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b8011830 con 0x7f57bc133a80 2023-10-01T07:59:10.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.932+0000 7f57b3fff700 1 -- 172.21.15.26:0/1703431080 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b8011990 con 0x7f57bc133a80 2023-10-01T07:59:10.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.932+0000 7f57b3fff700 1 -- 172.21.15.26:0/1703431080 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b8011d20 con 0x7f57bc133a80 2023-10-01T07:59:10.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.932+0000 7f57c39de700 1 -- 172.21.15.26:0/1703431080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57bc133a80 msgr2=0x7f57bc133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:10.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.932+0000 7f57c39de700 1 --2- 172.21.15.26:0/1703431080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57bc133a80 0x7f57bc133e50 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f57b8009840 tx=0x7f57b8009b50 comp rx=0 tx=0).stop 2023-10-01T07:59:10.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.933+0000 7f57c39de700 1 -- 172.21.15.26:0/1703431080 shutdown_connections 2023-10-01T07:59:10.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.933+0000 7f57c39de700 1 --2- 172.21.15.26:0/1703431080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57bc133a80 0x7f57bc133e50 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:10.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.933+0000 7f57c39de700 1 --2- 172.21.15.26:0/1703431080 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57bc130a70 0x7f57bc13b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:10.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.933+0000 7f57c39de700 1 -- 172.21.15.26:0/1703431080 >> 172.21.15.26:0/1703431080 conn(0x7f57bc0a4210 msgr2=0x7f57bc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:10.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.933+0000 7f57c39de700 1 -- 172.21.15.26:0/1703431080 shutdown_connections 2023-10-01T07:59:10.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.933+0000 7f57c39de700 1 -- 172.21.15.26:0/1703431080 wait complete. 2023-10-01T07:59:10.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.934+0000 7f57c39de700 1 Processor -- start 2023-10-01T07:59:10.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.934+0000 7f57c39de700 1 -- start start 2023-10-01T07:59:10.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.935+0000 7f57c39de700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57bc12ff20 0x7f57bc09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:10.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.935+0000 7f57c39de700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f57bc130a70 0x7f57bc09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:10.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.935+0000 7f57c39de700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57bc133a80 0x7f57bc09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:10.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.935+0000 7f57c39de700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc11ed70 con 0x7f57bc12ff20 2023-10-01T07:59:10.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.935+0000 7f57c39de700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc11ea90 con 0x7f57bc133a80 2023-10-01T07:59:10.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.935+0000 7f57c39de700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc120090 con 0x7f57bc130a70 2023-10-01T07:59:10.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.935+0000 7f57c177a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57bc12ff20 0x7f57bc09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:10.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.935+0000 7f57c177a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57bc12ff20 0x7f57bc09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39874/0 (socket says 172.21.15.26:39874) 2023-10-01T07:59:10.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.935+0000 7f57c177a700 1 -- 172.21.15.26:0/1335990947 learned_addr learned my addr 172.21.15.26:0/1335990947 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:10.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.935+0000 7f57c0f79700 1 --2- 172.21.15.26:0/1335990947 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f57bc130a70 0x7f57bc09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:10.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.935+0000 7f57c1f7b700 1 --2- 172.21.15.26:0/1335990947 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57bc133a80 0x7f57bc09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:10.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.936+0000 7f57c0f79700 1 -- 172.21.15.26:0/1335990947 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57bc133a80 msgr2=0x7f57bc09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:10.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.936+0000 7f57c0f79700 1 --2- 172.21.15.26:0/1335990947 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57bc133a80 0x7f57bc09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:10.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.936+0000 7f57c0f79700 1 -- 172.21.15.26:0/1335990947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57bc12ff20 msgr2=0x7f57bc09c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:10.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.936+0000 7f57c0f79700 1 --2- 172.21.15.26:0/1335990947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57bc12ff20 0x7f57bc09c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:10.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.936+0000 7f57c0f79700 1 -- 172.21.15.26:0/1335990947 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b4009b30 con 0x7f57bc130a70 2023-10-01T07:59:10.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.936+0000 7f57c1f7b700 1 --2- 172.21.15.26:0/1335990947 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57bc133a80 0x7f57bc09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:10.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.936+0000 7f57c0f79700 1 --2- 172.21.15.26:0/1335990947 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f57bc130a70 0x7f57bc09c9c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f57ac000f60 tx=0x7f57ac00c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:10.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.936+0000 7f57b1ffb700 1 -- 172.21.15.26:0/1335990947 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac0052d0 con 0x7f57bc130a70 2023-10-01T07:59:10.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.936+0000 7f57b1ffb700 1 -- 172.21.15.26:0/1335990947 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ac005430 con 0x7f57bc130a70 2023-10-01T07:59:10.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.936+0000 7f57b1ffb700 1 -- 172.21.15.26:0/1335990947 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac0038c0 con 0x7f57bc130a70 2023-10-01T07:59:10.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.936+0000 7f57c39de700 1 -- 172.21.15.26:0/1335990947 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b80094a0 con 0x7f57bc130a70 2023-10-01T07:59:10.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.937+0000 7f57c39de700 1 -- 172.21.15.26:0/1335990947 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57bc12d300 con 0x7f57bc130a70 2023-10-01T07:59:10.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.937+0000 7f57b1ffb700 1 -- 172.21.15.26:0/1335990947 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f57ac003a20 con 0x7f57bc130a70 2023-10-01T07:59:10.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.937+0000 7f57b1ffb700 1 -- 172.21.15.26:0/1335990947 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f57ac01a9b0 con 0x7f57bc130a70 2023-10-01T07:59:10.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.938+0000 7f57c39de700 1 -- 172.21.15.26:0/1335990947 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57bc1201d0 con 0x7f57bc130a70 2023-10-01T07:59:10.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:10.947+0000 7f57b1ffb700 1 -- 172.21.15.26:0/1335990947 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f57ac044060 con 0x7f57bc130a70 2023-10-01T07:59:11.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.039+0000 7f077e2c1700 1 -- 172.21.15.26:0/709202881 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f077811d050 con 0x7f07781367c0 2023-10-01T07:59:11.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.039+0000 7f0774ff9700 1 -- 172.21.15.26:0/709202881 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f076c015070 con 0x7f07781367c0 2023-10-01T07:59:11.040 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:11.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.043+0000 7f077e2c1700 1 -- 172.21.15.26:0/709202881 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f07781367c0 msgr2=0x7f0778119eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:11.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.043+0000 7f077e2c1700 1 --2- 172.21.15.26:0/709202881 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f07781367c0 0x7f0778119eb0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f076c016000 tx=0x7f076c004750 comp rx=0 tx=0).stop 2023-10-01T07:59:11.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.043+0000 7f077e2c1700 1 -- 172.21.15.26:0/709202881 shutdown_connections 2023-10-01T07:59:11.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.043+0000 7f077e2c1700 1 --2- 172.21.15.26:0/709202881 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f07781390e0 0x7f07781c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:11.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.043+0000 7f077e2c1700 1 --2- 172.21.15.26:0/709202881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0778133870 0x7f0778119970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:11.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.043+0000 7f077e2c1700 1 --2- 172.21.15.26:0/709202881 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f07781367c0 0x7f0778119eb0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:11.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.043+0000 7f077e2c1700 1 -- 172.21.15.26:0/709202881 >> 172.21.15.26:0/709202881 conn(0x7f07780a2610 msgr2=0x7f07780709e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:11.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.043+0000 7f077e2c1700 1 -- 172.21.15.26:0/709202881 shutdown_connections 2023-10-01T07:59:11.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.043+0000 7f077e2c1700 1 -- 172.21.15.26:0/709202881 wait complete. 2023-10-01T07:59:11.063 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:11.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.112+0000 7f5846cf6700 1 -- 172.21.15.26:0/2858888067 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5840126a80 con 0x7f5840123e60 2023-10-01T07:59:11.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.112+0000 7f583d7fa700 1 -- 172.21.15.26:0/2858888067 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5840126a80 con 0x7f5840123e60 2023-10-01T07:59:11.113 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:11.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.115+0000 7f5846cf6700 1 -- 172.21.15.26:0/2858888067 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5840123e60 msgr2=0x7f58401cca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:11.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.115+0000 7f5846cf6700 1 --2- 172.21.15.26:0/2858888067 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5840123e60 0x7f58401cca00 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5838009f00 tx=0x7f583800c3a0 comp rx=0 tx=0).stop 2023-10-01T07:59:11.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.115+0000 7f5846cf6700 1 -- 172.21.15.26:0/2858888067 shutdown_connections 2023-10-01T07:59:11.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.115+0000 7f5846cf6700 1 --2- 172.21.15.26:0/2858888067 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5840123e60 0x7f58401cca00 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:11.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.115+0000 7f5846cf6700 1 --2- 172.21.15.26:0/2858888067 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f584006e570 0x7f58401233e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:11.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.115+0000 7f5846cf6700 1 --2- 172.21.15.26:0/2858888067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f584006ee80 0x7f5840123920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:11.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.115+0000 7f5846cf6700 1 -- 172.21.15.26:0/2858888067 >> 172.21.15.26:0/2858888067 conn(0x7f58400a2aa0 msgr2=0x7f58400a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:11.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.115+0000 7f5846cf6700 1 -- 172.21.15.26:0/2858888067 shutdown_connections 2023-10-01T07:59:11.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.115+0000 7f5846cf6700 1 -- 172.21.15.26:0/2858888067 wait complete. 2023-10-01T07:59:11.129 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:11.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.128+0000 7fd2e27fc700 1 -- 172.21.15.26:0/3373980405 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd2d4005590 con 0x7fd2fc13d1f0 2023-10-01T07:59:11.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.129+0000 7fd2f8ff9700 1 -- 172.21.15.26:0/3373980405 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd2f4034090 con 0x7fd2fc13d1f0 2023-10-01T07:59:11.130 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:11.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.131+0000 7fd2e27fc700 1 -- 172.21.15.26:0/3373980405 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2fc13d1f0 msgr2=0x7fd2fc1cd440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:11.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.131+0000 7fd2e27fc700 1 --2- 172.21.15.26:0/3373980405 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2fc13d1f0 0x7fd2fc1cd440 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc09eff0 tx=0x7fd2f4004ad0 comp rx=0 tx=0).stop 2023-10-01T07:59:11.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.131+0000 7fd2e27fc700 1 -- 172.21.15.26:0/3373980405 shutdown_connections 2023-10-01T07:59:11.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.131+0000 7fd2e27fc700 1 --2- 172.21.15.26:0/3373980405 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2fc13d1f0 0x7fd2fc1cd440 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:11.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.131+0000 7fd2e27fc700 1 --2- 172.21.15.26:0/3373980405 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2fc06a770 0x7fd2fc1cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:11.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.131+0000 7fd2e27fc700 1 --2- 172.21.15.26:0/3373980405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2fc09de00 0x7fd2fc1ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:11.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.131+0000 7fd2e27fc700 1 -- 172.21.15.26:0/3373980405 >> 172.21.15.26:0/3373980405 conn(0x7fd2fc066f50 msgr2=0x7fd2fc13eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:11.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.131+0000 7fd2e27fc700 1 -- 172.21.15.26:0/3373980405 shutdown_connections 2023-10-01T07:59:11.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.131+0000 7fd2e27fc700 1 -- 172.21.15.26:0/3373980405 wait complete. 2023-10-01T07:59:11.145 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:11.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.173+0000 7f57c39de700 1 -- 172.21.15.26:0/1335990947 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f57bc074ea0 con 0x7f57bc130a70 2023-10-01T07:59:11.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.173+0000 7f57b1ffb700 1 -- 172.21.15.26:0/1335990947 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f57ac017020 con 0x7f57bc130a70 2023-10-01T07:59:11.174 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:11.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.175+0000 7f57c39de700 1 -- 172.21.15.26:0/1335990947 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f57bc130a70 msgr2=0x7f57bc09c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:11.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.175+0000 7f57c39de700 1 --2- 172.21.15.26:0/1335990947 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f57bc130a70 0x7f57bc09c9c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f57ac000f60 tx=0x7f57ac00c730 comp rx=0 tx=0).stop 2023-10-01T07:59:11.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.175+0000 7f57c39de700 1 -- 172.21.15.26:0/1335990947 shutdown_connections 2023-10-01T07:59:11.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.175+0000 7f57c39de700 1 --2- 172.21.15.26:0/1335990947 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57bc133a80 0x7f57bc09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:11.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.175+0000 7f57c39de700 1 --2- 172.21.15.26:0/1335990947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57bc12ff20 0x7f57bc09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:11.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.175+0000 7f57c39de700 1 --2- 172.21.15.26:0/1335990947 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f57bc130a70 0x7f57bc09c9c0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:11.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.175+0000 7f57c39de700 1 -- 172.21.15.26:0/1335990947 >> 172.21.15.26:0/1335990947 conn(0x7f57bc0a4210 msgr2=0x7f57bc09e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:11.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.176+0000 7f57c39de700 1 -- 172.21.15.26:0/1335990947 shutdown_connections 2023-10-01T07:59:11.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:11.176+0000 7f57c39de700 1 -- 172.21.15.26:0/1335990947 wait complete. 2023-10-01T07:59:11.189 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:12.063 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:12.130 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:12.146 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:12.190 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:12.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.215+0000 7fd5cf775700 1 Processor -- start 2023-10-01T07:59:12.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.215+0000 7fd5cf775700 1 -- start start 2023-10-01T07:59:12.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.216+0000 7fd5cf775700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd5c8131730 0x7fd5c8131b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:12.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.216+0000 7fd5cf775700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd5c809a5a0 0x7fd5c8139580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:12.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.216+0000 7fd5cf775700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c806f5d0 con 0x7fd5c8099a40 2023-10-01T07:59:12.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.216+0000 7fd5cf775700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c806f9a0 con 0x7fd5c809a5a0 2023-10-01T07:59:12.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.216+0000 7fd5cf775700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c81312e0 con 0x7fd5c8131730 2023-10-01T07:59:12.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.216+0000 7fd5cdd12700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd5c809a5a0 0x7fd5c8139580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:12.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.216+0000 7fd5ccd10700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd5c8099a40 0x7fd5c8099e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41822/0 (socket says 172.21.15.26:41822) 2023-10-01T07:59:12.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.216+0000 7fd5ccd10700 1 -- 172.21.15.26:0/4206039847 learned_addr learned my addr 172.21.15.26:0/4206039847 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:59:12.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.216+0000 7fd5cd511700 1 --2- 172.21.15.26:0/4206039847 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd5c8131730 0x7fd5c8131b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:12.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.216+0000 7fd5cdd12700 1 -- 172.21.15.26:0/4206039847 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd5c8131730 msgr2=0x7fd5c8131b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:12.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.216+0000 7fd5cdd12700 1 --2- 172.21.15.26:0/4206039847 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd5c8131730 0x7fd5c8131b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:12.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.216+0000 7fd5cdd12700 1 -- 172.21.15.26:0/4206039847 >> v1:172.21.15.26:6789/0 conn(0x7fd5c8099a40 legacy=0x7fd5c8099e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:12.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.216+0000 7fd5bffff700 1 -- 172.21.15.26:0/4206039847 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 466814896 0 0) 0x7fd5c806f5d0 con 0x7fd5c8099a40 2023-10-01T07:59:12.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.216+0000 7fd5cdd12700 1 -- 172.21.15.26:0/4206039847 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c809b630 con 0x7fd5c809a5a0 2023-10-01T07:59:12.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.217+0000 7fd5cdd12700 1 --2- 172.21.15.26:0/4206039847 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd5c809a5a0 0x7fd5c8139580 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0009dc0 tx=0x7fd5c000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=888e783860b60173 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:12.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.217+0000 7fd5bffff700 1 -- 172.21.15.26:0/4206039847 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c000e070 con 0x7fd5c809a5a0 2023-10-01T07:59:12.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.217+0000 7fd5bffff700 1 -- 172.21.15.26:0/4206039847 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c000bb20 con 0x7fd5c809a5a0 2023-10-01T07:59:12.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.217+0000 7fd5bffff700 1 -- 172.21.15.26:0/4206039847 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0012430 con 0x7fd5c809a5a0 2023-10-01T07:59:12.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.218+0000 7fd5cf775700 1 -- 172.21.15.26:0/4206039847 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd5c809a5a0 msgr2=0x7fd5c8139580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:12.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.218+0000 7fd5cf775700 1 --2- 172.21.15.26:0/4206039847 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd5c809a5a0 0x7fd5c8139580 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0009dc0 tx=0x7fd5c000b330 comp rx=0 tx=0).stop 2023-10-01T07:59:12.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.218+0000 7fd5cf775700 1 -- 172.21.15.26:0/4206039847 shutdown_connections 2023-10-01T07:59:12.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.218+0000 7fd5cf775700 1 --2- 172.21.15.26:0/4206039847 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd5c8131730 0x7fd5c8131b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:12.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.218+0000 7fd5cf775700 1 --2- 172.21.15.26:0/4206039847 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd5c809a5a0 0x7fd5c8139580 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:12.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.218+0000 7fd5cf775700 1 -- 172.21.15.26:0/4206039847 >> 172.21.15.26:0/4206039847 conn(0x7fd5c80a27f0 msgr2=0x7fd5c80a2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:12.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.218+0000 7fd5cf775700 1 -- 172.21.15.26:0/4206039847 shutdown_connections 2023-10-01T07:59:12.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.218+0000 7fd5cf775700 1 -- 172.21.15.26:0/4206039847 wait complete. 2023-10-01T07:59:12.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.219+0000 7fd5cf775700 1 Processor -- start 2023-10-01T07:59:12.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.220+0000 7fd5cf775700 1 -- start start 2023-10-01T07:59:12.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.220+0000 7fd5cf775700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd5c8099a40 0x7fd5c811ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:12.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.220+0000 7fd5cf775700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd5c809a5a0 0x7fd5c811f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:12.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.220+0000 7fd5cf775700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5c8131730 0x7fd5c80700e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:12.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.220+0000 7fd5cf775700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c811c750 con 0x7fd5c8131730 2023-10-01T07:59:12.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.220+0000 7fd5cf775700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c811cf80 con 0x7fd5c8099a40 2023-10-01T07:59:12.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.220+0000 7fd5cf775700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c812ec60 con 0x7fd5c809a5a0 2023-10-01T07:59:12.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.221+0000 7fd5cd511700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd5c8099a40 0x7fd5c811ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:12.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.221+0000 7fd5cd511700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd5c8099a40 0x7fd5c811ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35982/0 (socket says 172.21.15.26:35982) 2023-10-01T07:59:12.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.221+0000 7fd5cd511700 1 -- 172.21.15.26:0/909466684 learned_addr learned my addr 172.21.15.26:0/909466684 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:12.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.221+0000 7fd5ccd10700 1 --2- 172.21.15.26:0/909466684 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd5c809a5a0 0x7fd5c811f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:12.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.221+0000 7fd5cdd12700 1 --2- 172.21.15.26:0/909466684 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5c8131730 0x7fd5c80700e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:12.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.221+0000 7fd5cd511700 1 -- 172.21.15.26:0/909466684 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd5c809a5a0 msgr2=0x7fd5c811f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:12.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.221+0000 7fd5cd511700 1 --2- 172.21.15.26:0/909466684 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd5c809a5a0 0x7fd5c811f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:12.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.221+0000 7fd5cd511700 1 -- 172.21.15.26:0/909466684 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5c8131730 msgr2=0x7fd5c80700e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:12.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.221+0000 7fd5cd511700 1 --2- 172.21.15.26:0/909466684 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5c8131730 0x7fd5c80700e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:12.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.221+0000 7fd5cd511700 1 -- 172.21.15.26:0/909466684 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c0009a70 con 0x7fd5c8099a40 2023-10-01T07:59:12.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.221+0000 7fd5ccd10700 1 --2- 172.21.15.26:0/909466684 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd5c809a5a0 0x7fd5c811f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:12.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.221+0000 7fd5cd511700 1 --2- 172.21.15.26:0/909466684 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd5c8099a40 0x7fd5c811ed00 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd5c400e9e0 tx=0x7fd5c400ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:12.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.221+0000 7fd5bdffb700 1 -- 172.21.15.26:0/909466684 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c4009710 con 0x7fd5c8099a40 2023-10-01T07:59:12.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.222+0000 7fd5bdffb700 1 -- 172.21.15.26:0/909466684 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c400c850 con 0x7fd5c8099a40 2023-10-01T07:59:12.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.222+0000 7fd5cf775700 1 -- 172.21.15.26:0/909466684 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c80a2cc0 con 0x7fd5c8099a40 2023-10-01T07:59:12.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.222+0000 7fd5bdffb700 1 -- 172.21.15.26:0/909466684 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c400cbc0 con 0x7fd5c8099a40 2023-10-01T07:59:12.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.222+0000 7fd5cf775700 1 -- 172.21.15.26:0/909466684 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c811cc00 con 0x7fd5c8099a40 2023-10-01T07:59:12.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.223+0000 7fd5bdffb700 1 -- 172.21.15.26:0/909466684 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd5c400cd20 con 0x7fd5c8099a40 2023-10-01T07:59:12.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.223+0000 7fd5bdffb700 1 -- 172.21.15.26:0/909466684 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd5c403f8d0 con 0x7fd5c8099a40 2023-10-01T07:59:12.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.223+0000 7fd5cf775700 1 -- 172.21.15.26:0/909466684 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c804f2a0 con 0x7fd5c8099a40 2023-10-01T07:59:12.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.229+0000 7fd5bdffb700 1 -- 172.21.15.26:0/909466684 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd5c4021080 con 0x7fd5c8099a40 2023-10-01T07:59:12.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.275+0000 7efd7f74a700 1 Processor -- start 2023-10-01T07:59:12.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.275+0000 7efd7f74a700 1 -- start start 2023-10-01T07:59:12.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.275+0000 7efd7f74a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efd781337f0 0x7efd78138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:12.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.276+0000 7efd7f74a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efd78138dc0 0x7efd7813b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:12.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.276+0000 7efd7f74a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd7806b990 con 0x7efd78133420 2023-10-01T07:59:12.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.276+0000 7efd7f74a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd7809b0e0 con 0x7efd781337f0 2023-10-01T07:59:12.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.276+0000 7efd7f74a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd78133c20 con 0x7efd78138dc0 2023-10-01T07:59:12.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.276+0000 7efd7cce5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efd781337f0 0x7efd78138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:12.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.276+0000 7efd7dce7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efd78138dc0 0x7efd7813b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:12.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.276+0000 7efd7cce5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efd781337f0 0x7efd78138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39900/0 (socket says 172.21.15.26:39900) 2023-10-01T07:59:12.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.276+0000 7efd7cce5700 1 -- 172.21.15.26:0/2606063085 learned_addr learned my addr 172.21.15.26:0/2606063085 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:12.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.276+0000 7efd7cce5700 1 -- 172.21.15.26:0/2606063085 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efd78138dc0 msgr2=0x7efd7813b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:12.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.276+0000 7efd7cce5700 1 --2- 172.21.15.26:0/2606063085 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efd78138dc0 0x7efd7813b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:12.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.276+0000 7efd7cce5700 1 -- 172.21.15.26:0/2606063085 >> v1:172.21.15.26:6789/0 conn(0x7efd78133420 legacy=0x7efd78133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:12.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.276+0000 7efd7cce5700 1 -- 172.21.15.26:0/2606063085 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd780a0590 con 0x7efd781337f0 2023-10-01T07:59:12.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.276+0000 7efd7cce5700 1 --2- 172.21.15.26:0/2606063085 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd781337f0 0x7efd78138880 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7efd680098f0 tx=0x7efd68009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bed70be13567e0e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:12.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.277+0000 7efd6ffff700 1 -- 172.21.15.26:0/2606063085 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd68011830 con 0x7efd781337f0 2023-10-01T07:59:12.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.277+0000 7efd6ffff700 1 -- 172.21.15.26:0/2606063085 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd68011990 con 0x7efd781337f0 2023-10-01T07:59:12.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.277+0000 7efd6ffff700 1 -- 172.21.15.26:0/2606063085 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd68011d20 con 0x7efd781337f0 2023-10-01T07:59:12.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.277+0000 7efd7f74a700 1 -- 172.21.15.26:0/2606063085 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd781337f0 msgr2=0x7efd78138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:12.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.277+0000 7efd7f74a700 1 --2- 172.21.15.26:0/2606063085 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd781337f0 0x7efd78138880 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7efd680098f0 tx=0x7efd68009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:12.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.278+0000 7efd7f74a700 1 -- 172.21.15.26:0/2606063085 shutdown_connections 2023-10-01T07:59:12.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.278+0000 7efd7f74a700 1 --2- 172.21.15.26:0/2606063085 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efd78138dc0 0x7efd7813b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:12.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.278+0000 7efd7f74a700 1 --2- 172.21.15.26:0/2606063085 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd781337f0 0x7efd78138880 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:12.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.278+0000 7efd7f74a700 1 -- 172.21.15.26:0/2606063085 >> 172.21.15.26:0/2606063085 conn(0x7efd780a4210 msgr2=0x7efd780a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:12.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.280+0000 7efd7f74a700 1 -- 172.21.15.26:0/2606063085 shutdown_connections 2023-10-01T07:59:12.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.280+0000 7efd7f74a700 1 -- 172.21.15.26:0/2606063085 wait complete. 2023-10-01T07:59:12.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.281+0000 7efd7f74a700 1 Processor -- start 2023-10-01T07:59:12.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.281+0000 7efd7f74a700 1 -- start start 2023-10-01T07:59:12.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.281+0000 7efd7f74a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd78133420 0x7efd7809c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:12.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.281+0000 7efd7f74a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efd781337f0 0x7efd7809cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:12.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.281+0000 7efd7f74a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efd78138dc0 0x7efd7809d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:12.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.281+0000 7efd7f74a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7812f240 con 0x7efd78133420 2023-10-01T07:59:12.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.281+0000 7efd7f74a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7809e050 con 0x7efd78138dc0 2023-10-01T07:59:12.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.281+0000 7efd7f74a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd78130620 con 0x7efd781337f0 2023-10-01T07:59:12.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.281+0000 7efd7dce7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efd78138dc0 0x7efd7809d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:12.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.281+0000 7efd7d4e6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd78133420 0x7efd7809c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:12.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.281+0000 7efd7dce7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efd78138dc0 0x7efd7809d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35996/0 (socket says 172.21.15.26:35996) 2023-10-01T07:59:12.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.281+0000 7efd7dce7700 1 -- 172.21.15.26:0/1544005159 learned_addr learned my addr 172.21.15.26:0/1544005159 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:12.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.282+0000 7efd7cce5700 1 --2- 172.21.15.26:0/1544005159 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efd781337f0 0x7efd7809cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:12.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.282+0000 7efd7dce7700 1 -- 172.21.15.26:0/1544005159 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efd781337f0 msgr2=0x7efd7809cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:12.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.282+0000 7efd7dce7700 1 --2- 172.21.15.26:0/1544005159 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efd781337f0 0x7efd7809cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:12.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.282+0000 7efd7dce7700 1 -- 172.21.15.26:0/1544005159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd78133420 msgr2=0x7efd7809c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:12.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.282+0000 7efd7dce7700 1 --2- 172.21.15.26:0/1544005159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd78133420 0x7efd7809c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:12.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.282+0000 7efd7dce7700 1 -- 172.21.15.26:0/1544005159 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd68009550 con 0x7efd78138dc0 2023-10-01T07:59:12.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.282+0000 7efd7cce5700 1 --2- 172.21.15.26:0/1544005159 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efd781337f0 0x7efd7809cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:59:12.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.282+0000 7efd7d4e6700 1 --2- 172.21.15.26:0/1544005159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd78133420 0x7efd7809c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:12.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.282+0000 7efd7dce7700 1 --2- 172.21.15.26:0/1544005159 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efd78138dc0 0x7efd7809d0e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7efd7000efc0 tx=0x7efd7000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:12.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.282+0000 7efd6dffb700 1 -- 172.21.15.26:0/1544005159 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7000cd40 con 0x7efd78138dc0 2023-10-01T07:59:12.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.282+0000 7efd6dffb700 1 -- 172.21.15.26:0/1544005159 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7000f040 con 0x7efd78138dc0 2023-10-01T07:59:12.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.282+0000 7efd7f74a700 1 -- 172.21.15.26:0/1544005159 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd78130a50 con 0x7efd78138dc0 2023-10-01T07:59:12.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.282+0000 7efd6dffb700 1 -- 172.21.15.26:0/1544005159 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd700146c0 con 0x7efd78138dc0 2023-10-01T07:59:12.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.283+0000 7efd7f74a700 1 -- 172.21.15.26:0/1544005159 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd7812f720 con 0x7efd78138dc0 2023-10-01T07:59:12.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.284+0000 7efd6dffb700 1 -- 172.21.15.26:0/1544005159 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efd70014820 con 0x7efd78138dc0 2023-10-01T07:59:12.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.284+0000 7efd7f74a700 1 -- 172.21.15.26:0/1544005159 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd78074ea0 con 0x7efd78138dc0 2023-10-01T07:59:12.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.284+0000 7efd6dffb700 1 -- 172.21.15.26:0/1544005159 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efd70040310 con 0x7efd78138dc0 2023-10-01T07:59:12.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.293+0000 7efd6dffb700 1 -- 172.21.15.26:0/1544005159 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efd70007d60 con 0x7efd78138dc0 2023-10-01T07:59:12.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.325+0000 7f131ff6a700 1 Processor -- start 2023-10-01T07:59:12.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.325+0000 7f131ff6a700 1 -- start start 2023-10-01T07:59:12.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.326+0000 7f131ff6a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f131806b250 0x7f1318136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:12.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.326+0000 7f131ff6a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1318136d80 0x7f1318139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:12.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.326+0000 7f131ff6a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f131809ece0 con 0x7f131806a770 2023-10-01T07:59:12.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.326+0000 7f131ff6a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f131809e760 con 0x7f131806b250 2023-10-01T07:59:12.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.326+0000 7f131ff6a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f131809e040 con 0x7f1318136d80 2023-10-01T07:59:12.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.326+0000 7f131d505700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f131806b250 0x7f1318136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:12.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.326+0000 7f131d505700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f131806b250 0x7f1318136840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39930/0 (socket says 172.21.15.26:39930) 2023-10-01T07:59:12.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.326+0000 7f131d505700 1 -- 172.21.15.26:0/1874548186 learned_addr learned my addr 172.21.15.26:0/1874548186 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:12.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.326+0000 7f131e507700 1 --2- 172.21.15.26:0/1874548186 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1318136d80 0x7f1318139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:12.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.327+0000 7f131d505700 1 -- 172.21.15.26:0/1874548186 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1318136d80 msgr2=0x7f1318139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:12.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.327+0000 7f131d505700 1 --2- 172.21.15.26:0/1874548186 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1318136d80 0x7f1318139160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:12.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.327+0000 7f131d505700 1 -- 172.21.15.26:0/1874548186 >> v1:172.21.15.26:6789/0 conn(0x7f131806a770 legacy=0x7f131806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:12.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.327+0000 7f131d505700 1 -- 172.21.15.26:0/1874548186 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131809f630 con 0x7f131806b250 2023-10-01T07:59:12.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.327+0000 7f131d505700 1 --2- 172.21.15.26:0/1874548186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f131806b250 0x7f1318136840 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f13080098f0 tx=0x7f1308009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a53fa0cd53b018f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:12.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.327+0000 7f131cd04700 1 -- 172.21.15.26:0/1874548186 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1308011830 con 0x7f131806b250 2023-10-01T07:59:12.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.327+0000 7f131cd04700 1 -- 172.21.15.26:0/1874548186 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1308011990 con 0x7f131806b250 2023-10-01T07:59:12.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.327+0000 7f131cd04700 1 -- 172.21.15.26:0/1874548186 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1308011d20 con 0x7f131806b250 2023-10-01T07:59:12.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.328+0000 7f131ff6a700 1 -- 172.21.15.26:0/1874548186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f131806b250 msgr2=0x7f1318136840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:12.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.328+0000 7f131ff6a700 1 --2- 172.21.15.26:0/1874548186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f131806b250 0x7f1318136840 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f13080098f0 tx=0x7f1308009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:12.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.328+0000 7f131ff6a700 1 -- 172.21.15.26:0/1874548186 shutdown_connections 2023-10-01T07:59:12.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.328+0000 7f131ff6a700 1 --2- 172.21.15.26:0/1874548186 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1318136d80 0x7f1318139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:12.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.328+0000 7f131ff6a700 1 --2- 172.21.15.26:0/1874548186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f131806b250 0x7f1318136840 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:12.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.328+0000 7f131ff6a700 1 -- 172.21.15.26:0/1874548186 >> 172.21.15.26:0/1874548186 conn(0x7f1318066f50 msgr2=0x7f131809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:12.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.328+0000 7f131ff6a700 1 -- 172.21.15.26:0/1874548186 shutdown_connections 2023-10-01T07:59:12.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.328+0000 7f131ff6a700 1 -- 172.21.15.26:0/1874548186 wait complete. 2023-10-01T07:59:12.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.329+0000 7f131ff6a700 1 Processor -- start 2023-10-01T07:59:12.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.329+0000 7f131ff6a700 1 -- start start 2023-10-01T07:59:12.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.330+0000 7f131ff6a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f131806a770 0x7f131809ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:12.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.330+0000 7f131ff6a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f131806b250 0x7f131809b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:12.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.330+0000 7f131ff6a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1318136d80 0x7f13181c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:12.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.330+0000 7f131ff6a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131809a8e0 con 0x7f131806a770 2023-10-01T07:59:12.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.330+0000 7f131ff6a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f131809b810 con 0x7f131806b250 2023-10-01T07:59:12.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.330+0000 7f131ff6a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1318132430 con 0x7f1318136d80 2023-10-01T07:59:12.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.330+0000 7f131dd06700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f131806a770 0x7f131809ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:12.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.330+0000 7f131dd06700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f131806a770 0x7f131809ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39946/0 (socket says 172.21.15.26:39946) 2023-10-01T07:59:12.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.330+0000 7f131dd06700 1 -- 172.21.15.26:0/1543107115 learned_addr learned my addr 172.21.15.26:0/1543107115 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:12.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.330+0000 7f131e507700 1 --2- 172.21.15.26:0/1543107115 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1318136d80 0x7f13181c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:12.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.330+0000 7f131d505700 1 --2- 172.21.15.26:0/1543107115 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f131806b250 0x7f131809b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:12.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.330+0000 7f131dd06700 1 -- 172.21.15.26:0/1543107115 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1318136d80 msgr2=0x7f13181c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:12.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.330+0000 7f131dd06700 1 --2- 172.21.15.26:0/1543107115 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1318136d80 0x7f13181c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:12.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.330+0000 7f131dd06700 1 -- 172.21.15.26:0/1543107115 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f131806b250 msgr2=0x7f131809b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:12.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.330+0000 7f131dd06700 1 --2- 172.21.15.26:0/1543107115 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f131806b250 0x7f131809b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:12.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.330+0000 7f131dd06700 1 -- 172.21.15.26:0/1543107115 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1308009550 con 0x7f131806a770 2023-10-01T07:59:12.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.330+0000 7f131d505700 1 --2- 172.21.15.26:0/1543107115 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f131806b250 0x7f131809b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:59:12.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.330+0000 7f131dd06700 1 --2- 172.21.15.26:0/1543107115 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f131806a770 0x7f131809ad90 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f131400c510 tx=0x7f131400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:12.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.331+0000 7f130e7fc700 1 -- 172.21.15.26:0/1543107115 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13140052d0 con 0x7f131806a770 2023-10-01T07:59:12.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.331+0000 7f131ff6a700 1 -- 172.21.15.26:0/1543107115 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1318071e60 con 0x7f131806a770 2023-10-01T07:59:12.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.331+0000 7f130e7fc700 1 -- 172.21.15.26:0/1543107115 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1314005430 con 0x7f131806a770 2023-10-01T07:59:12.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.331+0000 7f130e7fc700 1 -- 172.21.15.26:0/1543107115 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13140038c0 con 0x7f131806a770 2023-10-01T07:59:12.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.331+0000 7f131ff6a700 1 -- 172.21.15.26:0/1543107115 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f131809bf50 con 0x7f131806a770 2023-10-01T07:59:12.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.332+0000 7f131ff6a700 1 -- 172.21.15.26:0/1543107115 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1318074ea0 con 0x7f131806a770 2023-10-01T07:59:12.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.332+0000 7f130e7fc700 1 -- 172.21.15.26:0/1543107115 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1314003a20 con 0x7f131806a770 2023-10-01T07:59:12.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.332+0000 7f130e7fc700 1 -- 172.21.15.26:0/1543107115 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1314040ac0 con 0x7f131806a770 2023-10-01T07:59:12.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.341+0000 7f130e7fc700 1 -- 172.21.15.26:0/1543107115 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1314044060 con 0x7f131806a770 2023-10-01T07:59:12.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.367+0000 7fd46a486700 1 Processor -- start 2023-10-01T07:59:12.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.367+0000 7fd46a486700 1 -- start start 2023-10-01T07:59:12.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.368+0000 7fd46a486700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd46409e1d0 0x7fd464135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:12.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.368+0000 7fd46a486700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd464135e50 0x7fd464138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:12.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.368+0000 7fd46a486700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd46409f130 con 0x7fd46409d6f0 2023-10-01T07:59:12.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.368+0000 7fd46a486700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd46409f520 con 0x7fd464135e50 2023-10-01T07:59:12.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.368+0000 7fd46a486700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd46409e930 con 0x7fd46409e1d0 2023-10-01T07:59:12.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.368+0000 7fd4637fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd46409e1d0 0x7fd464135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:12.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.368+0000 7fd463fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd46409d6f0 0x7fd46409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41854/0 (socket says 172.21.15.26:41854) 2023-10-01T07:59:12.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.368+0000 7fd463fff700 1 -- 172.21.15.26:0/1608492677 learned_addr learned my addr 172.21.15.26:0/1608492677 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:59:12.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.368+0000 7fd468a23700 1 --2- 172.21.15.26:0/1608492677 >> v2:172.21.15.26:3300/0 conn(0x7fd464135e50 0x7fd464138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:12.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.369+0000 7fd4637fe700 1 -- 172.21.15.26:0/1608492677 >> v2:172.21.15.26:3300/0 conn(0x7fd464135e50 msgr2=0x7fd464138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:12.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.369+0000 7fd4637fe700 1 --2- 172.21.15.26:0/1608492677 >> v2:172.21.15.26:3300/0 conn(0x7fd464135e50 0x7fd464138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:12.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.369+0000 7fd4637fe700 1 -- 172.21.15.26:0/1608492677 >> v1:172.21.15.26:6789/0 conn(0x7fd46409d6f0 legacy=0x7fd46409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:12.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.369+0000 7fd4637fe700 1 -- 172.21.15.26:0/1608492677 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46409b2d0 con 0x7fd46409e1d0 2023-10-01T07:59:12.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.369+0000 7fd468a23700 1 --2- 172.21.15.26:0/1608492677 >> v2:172.21.15.26:3300/0 conn(0x7fd464135e50 0x7fd464138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:59:12.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.369+0000 7fd4637fe700 1 --2- 172.21.15.26:0/1608492677 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd46409e1d0 0x7fd464135910 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd458009870 tx=0x7fd458009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fedc3acbddc33a87 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:12.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.369+0000 7fd462ffd700 1 -- 172.21.15.26:0/1608492677 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd458011830 con 0x7fd46409e1d0 2023-10-01T07:59:12.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.369+0000 7fd462ffd700 1 -- 172.21.15.26:0/1608492677 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd458011990 con 0x7fd46409e1d0 2023-10-01T07:59:12.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.369+0000 7fd462ffd700 1 -- 172.21.15.26:0/1608492677 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd458011d20 con 0x7fd46409e1d0 2023-10-01T07:59:12.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.370+0000 7fd46a486700 1 -- 172.21.15.26:0/1608492677 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd46409e1d0 msgr2=0x7fd464135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:12.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.370+0000 7fd46a486700 1 --2- 172.21.15.26:0/1608492677 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd46409e1d0 0x7fd464135910 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd458009870 tx=0x7fd458009b80 comp rx=0 tx=0).stop 2023-10-01T07:59:12.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.370+0000 7fd46a486700 1 -- 172.21.15.26:0/1608492677 shutdown_connections 2023-10-01T07:59:12.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.370+0000 7fd46a486700 1 --2- 172.21.15.26:0/1608492677 >> v2:172.21.15.26:3300/0 conn(0x7fd464135e50 0x7fd464138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:12.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.370+0000 7fd46a486700 1 --2- 172.21.15.26:0/1608492677 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd46409e1d0 0x7fd464135910 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:12.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.370+0000 7fd46a486700 1 -- 172.21.15.26:0/1608492677 >> 172.21.15.26:0/1608492677 conn(0x7fd464066f50 msgr2=0x7fd46409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:12.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.370+0000 7fd46a486700 1 -- 172.21.15.26:0/1608492677 shutdown_connections 2023-10-01T07:59:12.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.370+0000 7fd46a486700 1 -- 172.21.15.26:0/1608492677 wait complete. 2023-10-01T07:59:12.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.371+0000 7fd46a486700 1 Processor -- start 2023-10-01T07:59:12.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.371+0000 7fd46a486700 1 -- start start 2023-10-01T07:59:12.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.372+0000 7fd46a486700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd46409d6f0 0x7fd464119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:12.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.372+0000 7fd46a486700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd46409e1d0 0x7fd4641199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:12.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.372+0000 7fd46a486700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd464135e50 0x7fd464119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:12.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.372+0000 7fd46a486700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46412fde0 con 0x7fd464135e50 2023-10-01T07:59:12.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.372+0000 7fd46a486700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd464130180 con 0x7fd46409e1d0 2023-10-01T07:59:12.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.372+0000 7fd46a486700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4640a1d00 con 0x7fd46409d6f0 2023-10-01T07:59:12.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.372+0000 7fd463fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd46409d6f0 0x7fd464119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:12.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.372+0000 7fd463fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd46409d6f0 0x7fd464119480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:60014/0 (socket says 172.21.15.26:60014) 2023-10-01T07:59:12.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.372+0000 7fd463fff700 1 -- 172.21.15.26:0/2450875775 learned_addr learned my addr 172.21.15.26:0/2450875775 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:12.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.372+0000 7fd4637fe700 1 --2- 172.21.15.26:0/2450875775 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd46409e1d0 0x7fd4641199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:12.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.372+0000 7fd468a23700 1 --2- 172.21.15.26:0/2450875775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd464135e50 0x7fd464119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:12.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.373+0000 7fd463fff700 1 -- 172.21.15.26:0/2450875775 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd46409e1d0 msgr2=0x7fd4641199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:12.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.373+0000 7fd463fff700 1 --2- 172.21.15.26:0/2450875775 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd46409e1d0 0x7fd4641199c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:12.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.373+0000 7fd463fff700 1 -- 172.21.15.26:0/2450875775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd464135e50 msgr2=0x7fd464119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:12.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.373+0000 7fd463fff700 1 --2- 172.21.15.26:0/2450875775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd464135e50 0x7fd464119f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:12.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.373+0000 7fd463fff700 1 -- 172.21.15.26:0/2450875775 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4580094a0 con 0x7fd46409d6f0 2023-10-01T07:59:12.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.373+0000 7fd463fff700 1 --2- 172.21.15.26:0/2450875775 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd46409d6f0 0x7fd464119480 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd45400c520 tx=0x7fd45400c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:12.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.373+0000 7fd460ff9700 1 -- 172.21.15.26:0/2450875775 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd454005d70 con 0x7fd46409d6f0 2023-10-01T07:59:12.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.373+0000 7fd460ff9700 1 -- 172.21.15.26:0/2450875775 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4540070d0 con 0x7fd46409d6f0 2023-10-01T07:59:12.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.373+0000 7fd46a486700 1 -- 172.21.15.26:0/2450875775 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd46411cec0 con 0x7fd46409d6f0 2023-10-01T07:59:12.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.373+0000 7fd46a486700 1 -- 172.21.15.26:0/2450875775 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd46409c700 con 0x7fd46409d6f0 2023-10-01T07:59:12.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.374+0000 7fd460ff9700 1 -- 172.21.15.26:0/2450875775 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd454007440 con 0x7fd46409d6f0 2023-10-01T07:59:12.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.375+0000 7fd46a486700 1 -- 172.21.15.26:0/2450875775 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd464074ea0 con 0x7fd46409d6f0 2023-10-01T07:59:12.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.375+0000 7fd460ff9700 1 -- 172.21.15.26:0/2450875775 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd4540075a0 con 0x7fd46409d6f0 2023-10-01T07:59:12.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.376+0000 7fd460ff9700 1 -- 172.21.15.26:0/2450875775 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd45403eb90 con 0x7fd46409d6f0 2023-10-01T07:59:12.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.385+0000 7fd460ff9700 1 -- 172.21.15.26:0/2450875775 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd454019d20 con 0x7fd46409d6f0 2023-10-01T07:59:12.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.455+0000 7fd5cf775700 1 -- 172.21.15.26:0/909466684 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd5c811f7e0 con 0x7fd5c8099a40 2023-10-01T07:59:12.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.456+0000 7fd5bdffb700 1 -- 172.21.15.26:0/909466684 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd5c40232f0 con 0x7fd5c8099a40 2023-10-01T07:59:12.457 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:12.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.459+0000 7fd5cf775700 1 -- 172.21.15.26:0/909466684 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd5c8099a40 msgr2=0x7fd5c811ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:12.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.459+0000 7fd5cf775700 1 --2- 172.21.15.26:0/909466684 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd5c8099a40 0x7fd5c811ed00 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd5c400e9e0 tx=0x7fd5c400ecf0 comp rx=0 tx=0).stop 2023-10-01T07:59:12.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.459+0000 7fd5cf775700 1 -- 172.21.15.26:0/909466684 shutdown_connections 2023-10-01T07:59:12.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.459+0000 7fd5cf775700 1 --2- 172.21.15.26:0/909466684 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5c8131730 0x7fd5c80700e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:12.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.459+0000 7fd5cf775700 1 --2- 172.21.15.26:0/909466684 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd5c8099a40 0x7fd5c811ed00 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:12.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.459+0000 7fd5cf775700 1 --2- 172.21.15.26:0/909466684 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd5c809a5a0 0x7fd5c811f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:12.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.459+0000 7fd5cf775700 1 -- 172.21.15.26:0/909466684 >> 172.21.15.26:0/909466684 conn(0x7fd5c80a27f0 msgr2=0x7fd5c81b8a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:12.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.459+0000 7fd5cf775700 1 -- 172.21.15.26:0/909466684 shutdown_connections 2023-10-01T07:59:12.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.460+0000 7fd5cf775700 1 -- 172.21.15.26:0/909466684 wait complete. 2023-10-01T07:59:12.475 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:12.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.511+0000 7efd7f74a700 1 -- 172.21.15.26:0/1544005159 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efd7812f380 con 0x7efd78138dc0 2023-10-01T07:59:12.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.512+0000 7efd6dffb700 1 -- 172.21.15.26:0/1544005159 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efd7812f380 con 0x7efd78138dc0 2023-10-01T07:59:12.513 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:12.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.514+0000 7efd7f74a700 1 -- 172.21.15.26:0/1544005159 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efd78138dc0 msgr2=0x7efd7809d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:12.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.514+0000 7efd7f74a700 1 --2- 172.21.15.26:0/1544005159 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efd78138dc0 0x7efd7809d0e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7efd7000efc0 tx=0x7efd7000c3a0 comp rx=0 tx=0).stop 2023-10-01T07:59:12.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.514+0000 7efd7f74a700 1 -- 172.21.15.26:0/1544005159 shutdown_connections 2023-10-01T07:59:12.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.514+0000 7efd7f74a700 1 --2- 172.21.15.26:0/1544005159 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efd78138dc0 0x7efd7809d0e0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:12.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.514+0000 7efd7f74a700 1 --2- 172.21.15.26:0/1544005159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd78133420 0x7efd7809c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:12.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.514+0000 7efd7f74a700 1 --2- 172.21.15.26:0/1544005159 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efd781337f0 0x7efd7809cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:12.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.514+0000 7efd7f74a700 1 -- 172.21.15.26:0/1544005159 >> 172.21.15.26:0/1544005159 conn(0x7efd780a4210 msgr2=0x7efd78131400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:12.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.514+0000 7efd7f74a700 1 -- 172.21.15.26:0/1544005159 shutdown_connections 2023-10-01T07:59:12.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.514+0000 7efd7f74a700 1 -- 172.21.15.26:0/1544005159 wait complete. 2023-10-01T07:59:12.529 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:12.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.553+0000 7f131ff6a700 1 -- 172.21.15.26:0/1543107115 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f131806c360 con 0x7f131806a770 2023-10-01T07:59:12.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.553+0000 7f130e7fc700 1 -- 172.21.15.26:0/1543107115 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1314044020 con 0x7f131806a770 2023-10-01T07:59:12.554 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:12.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.555+0000 7f131ff6a700 1 -- 172.21.15.26:0/1543107115 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f131806a770 msgr2=0x7f131809ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:12.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.555+0000 7f131ff6a700 1 --2- 172.21.15.26:0/1543107115 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f131806a770 0x7f131809ad90 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f131400c510 tx=0x7f131400c820 comp rx=0 tx=0).stop 2023-10-01T07:59:12.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.555+0000 7f131ff6a700 1 -- 172.21.15.26:0/1543107115 shutdown_connections 2023-10-01T07:59:12.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.555+0000 7f131ff6a700 1 --2- 172.21.15.26:0/1543107115 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1318136d80 0x7f13181c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:12.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.555+0000 7f131ff6a700 1 --2- 172.21.15.26:0/1543107115 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f131806a770 0x7f131809ad90 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:12.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.555+0000 7f131ff6a700 1 --2- 172.21.15.26:0/1543107115 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f131806b250 0x7f131809b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:12.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.555+0000 7f131ff6a700 1 -- 172.21.15.26:0/1543107115 >> 172.21.15.26:0/1543107115 conn(0x7f1318066f50 msgr2=0x7f1318135ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:12.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.556+0000 7f131ff6a700 1 -- 172.21.15.26:0/1543107115 shutdown_connections 2023-10-01T07:59:12.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.556+0000 7f131ff6a700 1 -- 172.21.15.26:0/1543107115 wait complete. 2023-10-01T07:59:12.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:12.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.593+0000 7fd46a486700 1 -- 172.21.15.26:0/2450875775 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd46411cca0 con 0x7fd46409d6f0 2023-10-01T07:59:12.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.594+0000 7fd460ff9700 1 -- 172.21.15.26:0/2450875775 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd454017070 con 0x7fd46409d6f0 2023-10-01T07:59:12.594 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:12.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.596+0000 7fd46a486700 1 -- 172.21.15.26:0/2450875775 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd46409d6f0 msgr2=0x7fd464119480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:12.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.596+0000 7fd46a486700 1 --2- 172.21.15.26:0/2450875775 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd46409d6f0 0x7fd464119480 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd45400c520 tx=0x7fd45400c830 comp rx=0 tx=0).stop 2023-10-01T07:59:12.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.596+0000 7fd46a486700 1 -- 172.21.15.26:0/2450875775 shutdown_connections 2023-10-01T07:59:12.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.596+0000 7fd46a486700 1 --2- 172.21.15.26:0/2450875775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd464135e50 0x7fd464119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:12.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.596+0000 7fd46a486700 1 --2- 172.21.15.26:0/2450875775 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd46409d6f0 0x7fd464119480 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:12.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.596+0000 7fd46a486700 1 --2- 172.21.15.26:0/2450875775 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd46409e1d0 0x7fd4641199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:12.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.596+0000 7fd46a486700 1 -- 172.21.15.26:0/2450875775 >> 172.21.15.26:0/2450875775 conn(0x7fd464066f50 msgr2=0x7fd46406f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:12.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.596+0000 7fd46a486700 1 -- 172.21.15.26:0/2450875775 shutdown_connections 2023-10-01T07:59:12.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:12.596+0000 7fd46a486700 1 -- 172.21.15.26:0/2450875775 wait complete. 2023-10-01T07:59:12.610 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:13.476 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:13.530 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:13.571 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:13.611 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:13.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.628+0000 7fc62aeed700 1 Processor -- start 2023-10-01T07:59:13.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.628+0000 7fc62aeed700 1 -- start start 2023-10-01T07:59:13.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.628+0000 7fc62aeed700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc6241338a0 0x7fc624133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:13.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.628+0000 7fc62aeed700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc62409e930 0x7fc62413b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:13.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.628+0000 7fc62aeed700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc62406ef30 con 0x7fc62409de50 2023-10-01T07:59:13.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.628+0000 7fc62aeed700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc62406fef0 con 0x7fc6241338a0 2023-10-01T07:59:13.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.628+0000 7fc62aeed700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6241334b0 con 0x7fc62409e930 2023-10-01T07:59:13.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.629+0000 7fc62948a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc62409e930 0x7fc62413b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:13.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.629+0000 7fc62948a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc62409e930 0x7fc62413b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44000/0 (socket says 172.21.15.26:44000) 2023-10-01T07:59:13.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.629+0000 7fc62948a700 1 -- 172.21.15.26:0/2622847931 learned_addr learned my addr 172.21.15.26:0/2622847931 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:13.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.629+0000 7fc628c89700 1 --2- 172.21.15.26:0/2622847931 >> v2:172.21.15.26:3300/0 conn(0x7fc6241338a0 0x7fc624133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:13.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.629+0000 7fc6237fe700 1 -- 172.21.15.26:0/2622847931 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1175447380 0 0) 0x7fc62406ef30 con 0x7fc62409de50 2023-10-01T07:59:13.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.629+0000 7fc6237fe700 1 -- 172.21.15.26:0/2622847931 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6140035b0 con 0x7fc62409de50 2023-10-01T07:59:13.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.629+0000 7fc628c89700 1 -- 172.21.15.26:0/2622847931 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc62409e930 msgr2=0x7fc62413b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:13.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.629+0000 7fc628c89700 1 --2- 172.21.15.26:0/2622847931 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc62409e930 0x7fc62413b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:13.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.629+0000 7fc628c89700 1 -- 172.21.15.26:0/2622847931 >> v1:172.21.15.26:6789/0 conn(0x7fc62409de50 legacy=0x7fc62409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:13.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.629+0000 7fc628c89700 1 -- 172.21.15.26:0/2622847931 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc62406fc30 con 0x7fc6241338a0 2023-10-01T07:59:13.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.630+0000 7fc628c89700 1 --2- 172.21.15.26:0/2622847931 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6241338a0 0x7fc624133c70 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fc618009840 tx=0x7fc618009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1714de9fd9f49394 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:13.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.630+0000 7fc6237fe700 1 -- 172.21.15.26:0/2622847931 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc618011830 con 0x7fc6241338a0 2023-10-01T07:59:13.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.630+0000 7fc6237fe700 1 -- 172.21.15.26:0/2622847931 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc618011990 con 0x7fc6241338a0 2023-10-01T07:59:13.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.630+0000 7fc6237fe700 1 -- 172.21.15.26:0/2622847931 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc618011d20 con 0x7fc6241338a0 2023-10-01T07:59:13.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.631+0000 7fc62aeed700 1 -- 172.21.15.26:0/2622847931 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6241338a0 msgr2=0x7fc624133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:13.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.631+0000 7fc62aeed700 1 --2- 172.21.15.26:0/2622847931 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6241338a0 0x7fc624133c70 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fc618009840 tx=0x7fc618009b50 comp rx=0 tx=0).stop 2023-10-01T07:59:13.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.631+0000 7fc62aeed700 1 -- 172.21.15.26:0/2622847931 shutdown_connections 2023-10-01T07:59:13.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.631+0000 7fc62aeed700 1 --2- 172.21.15.26:0/2622847931 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6241338a0 0x7fc624133c70 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:13.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.631+0000 7fc62aeed700 1 --2- 172.21.15.26:0/2622847931 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc62409e930 0x7fc62413b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:13.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.631+0000 7fc62aeed700 1 -- 172.21.15.26:0/2622847931 >> 172.21.15.26:0/2622847931 conn(0x7fc6240a2aa0 msgr2=0x7fc6240a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:13.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.631+0000 7fc62aeed700 1 -- 172.21.15.26:0/2622847931 shutdown_connections 2023-10-01T07:59:13.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.631+0000 7fc62aeed700 1 -- 172.21.15.26:0/2622847931 wait complete. 2023-10-01T07:59:13.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.632+0000 7fc62aeed700 1 Processor -- start 2023-10-01T07:59:13.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.633+0000 7fc62aeed700 1 -- start start 2023-10-01T07:59:13.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.633+0000 7fc62aeed700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc62409de50 0x7fc62411d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:13.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.633+0000 7fc62aeed700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc62409e930 0x7fc62411dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:13.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.633+0000 7fc62aeed700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6241338a0 0x7fc62411e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:13.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.633+0000 7fc62aeed700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62411f240 con 0x7fc6241338a0 2023-10-01T07:59:13.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.633+0000 7fc62aeed700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc624120490 con 0x7fc62409de50 2023-10-01T07:59:13.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.633+0000 7fc62aeed700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc62411f830 con 0x7fc62409e930 2023-10-01T07:59:13.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.633+0000 7fc62948a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6241338a0 0x7fc62411e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:13.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.634+0000 7fc62948a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6241338a0 0x7fc62411e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34472/0 (socket says 172.21.15.26:34472) 2023-10-01T07:59:13.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.634+0000 7fc62948a700 1 -- 172.21.15.26:0/2197780860 learned_addr learned my addr 172.21.15.26:0/2197780860 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:13.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.634+0000 7fc628c89700 1 --2- 172.21.15.26:0/2197780860 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc62409de50 0x7fc62411d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:13.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.634+0000 7fc62948a700 1 -- 172.21.15.26:0/2197780860 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc62409e930 msgr2=0x7fc62411dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:13.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.634+0000 7fc62948a700 1 --2- 172.21.15.26:0/2197780860 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc62409e930 0x7fc62411dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:13.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.634+0000 7fc62948a700 1 -- 172.21.15.26:0/2197780860 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc62409de50 msgr2=0x7fc62411d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:13.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.634+0000 7fc62948a700 1 --2- 172.21.15.26:0/2197780860 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc62409de50 0x7fc62411d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:13.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.634+0000 7fc62948a700 1 -- 172.21.15.26:0/2197780860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6180094a0 con 0x7fc6241338a0 2023-10-01T07:59:13.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.634+0000 7fc62948a700 1 --2- 172.21.15.26:0/2197780860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6241338a0 0x7fc62411e140 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fc61c00efc0 tx=0x7fc61c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:13.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.635+0000 7fc6217fa700 1 -- 172.21.15.26:0/2197780860 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c003c20 con 0x7fc6241338a0 2023-10-01T07:59:13.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.635+0000 7fc6217fa700 1 -- 172.21.15.26:0/2197780860 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61c00f040 con 0x7fc6241338a0 2023-10-01T07:59:13.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.635+0000 7fc6217fa700 1 -- 172.21.15.26:0/2197780860 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c009e60 con 0x7fc6241338a0 2023-10-01T07:59:13.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.635+0000 7fc62aeed700 1 -- 172.21.15.26:0/2197780860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6241208e0 con 0x7fc6241338a0 2023-10-01T07:59:13.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.635+0000 7fc62aeed700 1 -- 172.21.15.26:0/2197780860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6240a0cd0 con 0x7fc6241338a0 2023-10-01T07:59:13.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.636+0000 7fc62aeed700 1 -- 172.21.15.26:0/2197780860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc624074ea0 con 0x7fc6241338a0 2023-10-01T07:59:13.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.636+0000 7fc6217fa700 1 -- 172.21.15.26:0/2197780860 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc61c00c930 con 0x7fc6241338a0 2023-10-01T07:59:13.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.636+0000 7fc6217fa700 1 -- 172.21.15.26:0/2197780860 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc61c03faf0 con 0x7fc6241338a0 2023-10-01T07:59:13.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.645+0000 7fc6217fa700 1 -- 172.21.15.26:0/2197780860 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc61c013bd0 con 0x7fc6241338a0 2023-10-01T07:59:13.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.682+0000 7fd590037700 1 Processor -- start 2023-10-01T07:59:13.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.682+0000 7fd590037700 1 -- start start 2023-10-01T07:59:13.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.683+0000 7fd590037700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd58809d6f0 0x7fd58809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:13.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.683+0000 7fd590037700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd58809e000 0x7fd5881339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:13.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.683+0000 7fd590037700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd58809b120 con 0x7fd58809e410 2023-10-01T07:59:13.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.683+0000 7fd590037700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58806b460 con 0x7fd58809e000 2023-10-01T07:59:13.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.683+0000 7fd590037700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd58809a7e0 con 0x7fd58809d6f0 2023-10-01T07:59:13.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.683+0000 7fd58ddd3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd58809d6f0 0x7fd58809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:13.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.683+0000 7fd58ddd3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd58809d6f0 0x7fd58809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56454/0 (socket says 172.21.15.26:56454) 2023-10-01T07:59:13.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.683+0000 7fd58ddd3700 1 -- 172.21.15.26:0/2562129514 learned_addr learned my addr 172.21.15.26:0/2562129514 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:13.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.683+0000 7fd58d5d2700 1 --2- 172.21.15.26:0/2562129514 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd58809e000 0x7fd5881339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:13.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.683+0000 7fd58cdd1700 1 -- 172.21.15.26:0/2562129514 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3629132299 0 0) 0x7fd58809b120 con 0x7fd58809e410 2023-10-01T07:59:13.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.684+0000 7fd58cdd1700 1 -- 172.21.15.26:0/2562129514 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5740035b0 con 0x7fd58809e410 2023-10-01T07:59:13.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.684+0000 7fd58ddd3700 1 -- 172.21.15.26:0/2562129514 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd58809e000 msgr2=0x7fd5881339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:13.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.684+0000 7fd58ddd3700 1 --2- 172.21.15.26:0/2562129514 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd58809e000 0x7fd5881339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:13.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.684+0000 7fd58ddd3700 1 -- 172.21.15.26:0/2562129514 >> v1:172.21.15.26:6789/0 conn(0x7fd58809e410 legacy=0x7fd588133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:13.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.684+0000 7fd58ddd3700 1 -- 172.21.15.26:0/2562129514 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd58809a500 con 0x7fd58809d6f0 2023-10-01T07:59:13.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.684+0000 7fd58ddd3700 1 --2- 172.21.15.26:0/2562129514 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd58809d6f0 0x7fd58809dac0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd584009950 tx=0x7fd584009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=307dbc995bdbc5e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:13.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.684+0000 7fd58cdd1700 1 -- 172.21.15.26:0/2562129514 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd584011830 con 0x7fd58809d6f0 2023-10-01T07:59:13.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.684+0000 7fd58cdd1700 1 -- 172.21.15.26:0/2562129514 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd584011990 con 0x7fd58809d6f0 2023-10-01T07:59:13.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.684+0000 7fd58cdd1700 1 -- 172.21.15.26:0/2562129514 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd584011d40 con 0x7fd58809d6f0 2023-10-01T07:59:13.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.685+0000 7fd590037700 1 -- 172.21.15.26:0/2562129514 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd58809d6f0 msgr2=0x7fd58809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:13.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.685+0000 7fd590037700 1 --2- 172.21.15.26:0/2562129514 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd58809d6f0 0x7fd58809dac0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd584009950 tx=0x7fd584009c60 comp rx=0 tx=0).stop 2023-10-01T07:59:13.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.685+0000 7fd590037700 1 -- 172.21.15.26:0/2562129514 shutdown_connections 2023-10-01T07:59:13.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.685+0000 7fd590037700 1 --2- 172.21.15.26:0/2562129514 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd58809d6f0 0x7fd58809dac0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:13.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.685+0000 7fd590037700 1 --2- 172.21.15.26:0/2562129514 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd58809e000 0x7fd5881339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:13.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.685+0000 7fd590037700 1 -- 172.21.15.26:0/2562129514 >> 172.21.15.26:0/2562129514 conn(0x7fd588066f50 msgr2=0x7fd58809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:13.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.685+0000 7fd590037700 1 -- 172.21.15.26:0/2562129514 shutdown_connections 2023-10-01T07:59:13.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.685+0000 7fd590037700 1 -- 172.21.15.26:0/2562129514 wait complete. 2023-10-01T07:59:13.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.686+0000 7fd590037700 1 Processor -- start 2023-10-01T07:59:13.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.686+0000 7fd590037700 1 -- start start 2023-10-01T07:59:13.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.687+0000 7fd590037700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd58809d6f0 0x7fd5881a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:13.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.687+0000 7fd590037700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd58809e000 0x7fd5881a56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:13.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.687+0000 7fd590037700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd58809e410 0x7fd5881c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:13.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.687+0000 7fd590037700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5881a4bf0 con 0x7fd58809d6f0 2023-10-01T07:59:13.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.687+0000 7fd590037700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5881a6fd0 con 0x7fd58809e410 2023-10-01T07:59:13.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.687+0000 7fd590037700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5881a62d0 con 0x7fd58809e000 2023-10-01T07:59:13.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.687+0000 7fd58ddd3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd58809d6f0 0x7fd5881a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:13.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.687+0000 7fd58ddd3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd58809d6f0 0x7fd5881a5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34486/0 (socket says 172.21.15.26:34486) 2023-10-01T07:59:13.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.687+0000 7fd58ddd3700 1 -- 172.21.15.26:0/3526461591 learned_addr learned my addr 172.21.15.26:0/3526461591 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:13.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.687+0000 7fd58e5d4700 1 --2- 172.21.15.26:0/3526461591 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd58809e410 0x7fd5881c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:13.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.687+0000 7fd58ddd3700 1 -- 172.21.15.26:0/3526461591 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd58809e000 msgr2=0x7fd5881a56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:13.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.687+0000 7fd58ddd3700 1 --2- 172.21.15.26:0/3526461591 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd58809e000 0x7fd5881a56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:13.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.687+0000 7fd58ddd3700 1 -- 172.21.15.26:0/3526461591 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd58809e410 msgr2=0x7fd5881c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:13.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.687+0000 7fd58ddd3700 1 --2- 172.21.15.26:0/3526461591 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd58809e410 0x7fd5881c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:13.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.687+0000 7fd58ddd3700 1 -- 172.21.15.26:0/3526461591 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd584009550 con 0x7fd58809d6f0 2023-10-01T07:59:13.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.687+0000 7fd58e5d4700 1 --2- 172.21.15.26:0/3526461591 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd58809e410 0x7fd5881c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:13.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.688+0000 7fd58ddd3700 1 --2- 172.21.15.26:0/3526461591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd58809d6f0 0x7fd5881a5190 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fd58809a970 tx=0x7fd584004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:13.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.688+0000 7fd57e7fc700 1 -- 172.21.15.26:0/3526461591 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd584004240 con 0x7fd58809d6f0 2023-10-01T07:59:13.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.688+0000 7fd57e7fc700 1 -- 172.21.15.26:0/3526461591 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58401f070 con 0x7fd58809d6f0 2023-10-01T07:59:13.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.688+0000 7fd57e7fc700 1 -- 172.21.15.26:0/3526461591 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5840045e0 con 0x7fd58809d6f0 2023-10-01T07:59:13.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.688+0000 7fd590037700 1 -- 172.21.15.26:0/3526461591 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd58809c710 con 0x7fd58809d6f0 2023-10-01T07:59:13.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.688+0000 7fd590037700 1 -- 172.21.15.26:0/3526461591 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5881a7f00 con 0x7fd58809d6f0 2023-10-01T07:59:13.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.689+0000 7fd57e7fc700 1 -- 172.21.15.26:0/3526461591 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd584021030 con 0x7fd58809d6f0 2023-10-01T07:59:13.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.689+0000 7fd590037700 1 -- 172.21.15.26:0/3526461591 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5881a8110 con 0x7fd58809d6f0 2023-10-01T07:59:13.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.690+0000 7fd57e7fc700 1 -- 172.21.15.26:0/3526461591 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd58401a450 con 0x7fd58809d6f0 2023-10-01T07:59:13.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.699+0000 7fd57e7fc700 1 -- 172.21.15.26:0/3526461591 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd584044070 con 0x7fd58809d6f0 2023-10-01T07:59:13.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.722+0000 7fb6031d9700 1 Processor -- start 2023-10-01T07:59:13.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.722+0000 7fb6031d9700 1 -- start start 2023-10-01T07:59:13.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.722+0000 7fb6031d9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5fc06e570 0x7fb5fc06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:13.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.722+0000 7fb6031d9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb5fc06ee80 0x7fb5fc134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:13.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.722+0000 7fb6031d9700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5fc070ee0 con 0x7fb5fc09eca0 2023-10-01T07:59:13.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.722+0000 7fb6031d9700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5fc071480 con 0x7fb5fc06ee80 2023-10-01T07:59:13.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.722+0000 7fb6031d9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc071b90 con 0x7fb5fc06e570 2023-10-01T07:59:13.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.723+0000 7fb600f75700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5fc06e570 0x7fb5fc06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:13.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.723+0000 7fb601776700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb5fc06ee80 0x7fb5fc134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:13.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.723+0000 7fb600f75700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5fc06e570 0x7fb5fc06e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44046/0 (socket says 172.21.15.26:44046) 2023-10-01T07:59:13.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.723+0000 7fb600f75700 1 -- 172.21.15.26:0/678275102 learned_addr learned my addr 172.21.15.26:0/678275102 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:13.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.723+0000 7fb601776700 1 -- 172.21.15.26:0/678275102 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5fc06e570 msgr2=0x7fb5fc06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:13.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.723+0000 7fb601776700 1 --2- 172.21.15.26:0/678275102 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5fc06e570 0x7fb5fc06e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:13.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.723+0000 7fb601776700 1 -- 172.21.15.26:0/678275102 >> v1:172.21.15.26:6789/0 conn(0x7fb5fc09eca0 legacy=0x7fb5fc134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:13.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.723+0000 7fb601776700 1 -- 172.21.15.26:0/678275102 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5fc0711a0 con 0x7fb5fc06ee80 2023-10-01T07:59:13.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.723+0000 7fb601776700 1 --2- 172.21.15.26:0/678275102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5fc06ee80 0x7fb5fc134d20 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4009d90 tx=0x7fb5f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74605fc074dceec3 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:13.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.723+0000 7fb5fb7fe700 1 -- 172.21.15.26:0/678275102 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f400e070 con 0x7fb5fc06ee80 2023-10-01T07:59:13.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.724+0000 7fb5fb7fe700 1 -- 172.21.15.26:0/678275102 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f400bb20 con 0x7fb5fc06ee80 2023-10-01T07:59:13.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.724+0000 7fb5fb7fe700 1 -- 172.21.15.26:0/678275102 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4012430 con 0x7fb5fc06ee80 2023-10-01T07:59:13.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.724+0000 7fb6031d9700 1 -- 172.21.15.26:0/678275102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5fc06ee80 msgr2=0x7fb5fc134d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:13.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.724+0000 7fb6031d9700 1 --2- 172.21.15.26:0/678275102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5fc06ee80 0x7fb5fc134d20 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4009d90 tx=0x7fb5f400b330 comp rx=0 tx=0).stop 2023-10-01T07:59:13.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.724+0000 7fb6031d9700 1 -- 172.21.15.26:0/678275102 shutdown_connections 2023-10-01T07:59:13.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.724+0000 7fb6031d9700 1 --2- 172.21.15.26:0/678275102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5fc06ee80 0x7fb5fc134d20 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:13.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.724+0000 7fb6031d9700 1 --2- 172.21.15.26:0/678275102 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5fc06e570 0x7fb5fc06e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:13.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.724+0000 7fb6031d9700 1 -- 172.21.15.26:0/678275102 >> 172.21.15.26:0/678275102 conn(0x7fb5fc0a2aa0 msgr2=0x7fb5fc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:13.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.724+0000 7fb6031d9700 1 -- 172.21.15.26:0/678275102 shutdown_connections 2023-10-01T07:59:13.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.724+0000 7fb6031d9700 1 -- 172.21.15.26:0/678275102 wait complete. 2023-10-01T07:59:13.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.725+0000 7fb6031d9700 1 Processor -- start 2023-10-01T07:59:13.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.725+0000 7fb6031d9700 1 -- start start 2023-10-01T07:59:13.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.726+0000 7fb6031d9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5fc06e570 0x7fb5fc13c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:13.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.726+0000 7fb6031d9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb5fc06ee80 0x7fb5fc133450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:13.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.726+0000 7fb6031d9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5fc13cf90 0x7fb5fc133990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:13.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.726+0000 7fb6031d9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc13e960 con 0x7fb5fc13cf90 2023-10-01T07:59:13.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.726+0000 7fb6031d9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc13f7e0 con 0x7fb5fc06e570 2023-10-01T07:59:13.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.726+0000 7fb6031d9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc070610 con 0x7fb5fc06ee80 2023-10-01T07:59:13.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.726+0000 7fb601776700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5fc13cf90 0x7fb5fc133990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:13.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.726+0000 7fb601776700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5fc13cf90 0x7fb5fc133990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34492/0 (socket says 172.21.15.26:34492) 2023-10-01T07:59:13.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.726+0000 7fb601776700 1 -- 172.21.15.26:0/3161887037 learned_addr learned my addr 172.21.15.26:0/3161887037 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:13.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.726+0000 7fb5fbfff700 1 --2- 172.21.15.26:0/3161887037 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb5fc06ee80 0x7fb5fc133450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:13.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.726+0000 7fb600f75700 1 --2- 172.21.15.26:0/3161887037 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5fc06e570 0x7fb5fc13c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:13.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.727+0000 7fb601776700 1 -- 172.21.15.26:0/3161887037 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb5fc06ee80 msgr2=0x7fb5fc133450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:13.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.727+0000 7fb601776700 1 --2- 172.21.15.26:0/3161887037 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb5fc06ee80 0x7fb5fc133450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:13.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.727+0000 7fb601776700 1 -- 172.21.15.26:0/3161887037 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5fc06e570 msgr2=0x7fb5fc13c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:13.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.727+0000 7fb601776700 1 --2- 172.21.15.26:0/3161887037 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5fc06e570 0x7fb5fc13c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:13.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.727+0000 7fb601776700 1 -- 172.21.15.26:0/3161887037 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f4009a70 con 0x7fb5fc13cf90 2023-10-01T07:59:13.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.727+0000 7fb601776700 1 --2- 172.21.15.26:0/3161887037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5fc13cf90 0x7fb5fc133990 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4014040 tx=0x7fb5f4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:13.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.727+0000 7fb5f97fa700 1 -- 172.21.15.26:0/3161887037 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4012430 con 0x7fb5fc13cf90 2023-10-01T07:59:13.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.727+0000 7fb5f97fa700 1 -- 172.21.15.26:0/3161887037 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f4020070 con 0x7fb5fc13cf90 2023-10-01T07:59:13.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.727+0000 7fb5f97fa700 1 -- 172.21.15.26:0/3161887037 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4003ea0 con 0x7fb5fc13cf90 2023-10-01T07:59:13.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.727+0000 7fb6031d9700 1 -- 172.21.15.26:0/3161887037 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5fc134b70 con 0x7fb5fc13cf90 2023-10-01T07:59:13.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.727+0000 7fb6031d9700 1 -- 172.21.15.26:0/3161887037 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5fc13e110 con 0x7fb5fc13cf90 2023-10-01T07:59:13.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.729+0000 7fb6031d9700 1 -- 172.21.15.26:0/3161887037 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5fc13eaa0 con 0x7fb5fc13cf90 2023-10-01T07:59:13.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.729+0000 7fb5f97fa700 1 -- 172.21.15.26:0/3161887037 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb5f4004040 con 0x7fb5fc13cf90 2023-10-01T07:59:13.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.730+0000 7fb5f97fa700 1 -- 172.21.15.26:0/3161887037 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb5f4022070 con 0x7fb5fc13cf90 2023-10-01T07:59:13.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.738+0000 7fb5f97fa700 1 -- 172.21.15.26:0/3161887037 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb5f4031430 con 0x7fb5fc13cf90 2023-10-01T07:59:13.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.769+0000 7f6f5824e700 1 Processor -- start 2023-10-01T07:59:13.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.770+0000 7f6f5824e700 1 -- start start 2023-10-01T07:59:13.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.771+0000 7f6f5824e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f501316c0 0x7f6f50131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:13.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.771+0000 7f6f5824e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f5006ae80 0x7f6f50139550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:13.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.771+0000 7f6f5824e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5009e130 con 0x7f6f5009d9f0 2023-10-01T07:59:13.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.771+0000 7f6f5824e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f501312b0 con 0x7f6f501316c0 2023-10-01T07:59:13.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.771+0000 7f6f5824e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5009f6e0 con 0x7f6f5006ae80 2023-10-01T07:59:13.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.771+0000 7f6f55fea700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f501316c0 0x7f6f50131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:13.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.771+0000 7f6f567eb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f5006ae80 0x7f6f50139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.771+0000 7f6f557e9700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6f5009d9f0 0x7f6f5006a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44116/0 (socket says 172.21.15.26:44116) 2023-10-01T07:59:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.771+0000 7f6f557e9700 1 -- 172.21.15.26:0/3320098359 learned_addr learned my addr 172.21.15.26:0/3320098359 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:59:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.771+0000 7f6f567eb700 1 -- 172.21.15.26:0/3320098359 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f501316c0 msgr2=0x7f6f50131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.771+0000 7f6f567eb700 1 --2- 172.21.15.26:0/3320098359 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f501316c0 0x7f6f50131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.771+0000 7f6f567eb700 1 -- 172.21.15.26:0/3320098359 >> v1:172.21.15.26:6789/0 conn(0x7f6f5009d9f0 legacy=0x7f6f5006a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.771+0000 7f6f54fe8700 1 -- 172.21.15.26:0/3320098359 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 179341898 0 0) 0x7f6f40001110 con 0x7f6f5009d9f0 2023-10-01T07:59:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.771+0000 7f6f567eb700 1 -- 172.21.15.26:0/3320098359 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5009e760 con 0x7f6f5006ae80 2023-10-01T07:59:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.772+0000 7f6f567eb700 1 --2- 172.21.15.26:0/3320098359 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f5006ae80 0x7f6f50139550 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6f48009dc0 tx=0x7f6f4800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78e346123e8f7d18 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.772+0000 7f6f54fe8700 1 -- 172.21.15.26:0/3320098359 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4800e070 con 0x7f6f5006ae80 2023-10-01T07:59:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.772+0000 7f6f54fe8700 1 -- 172.21.15.26:0/3320098359 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4800bb20 con 0x7f6f5006ae80 2023-10-01T07:59:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.772+0000 7f6f54fe8700 1 -- 172.21.15.26:0/3320098359 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f48012430 con 0x7f6f5006ae80 2023-10-01T07:59:13.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.773+0000 7f6f5824e700 1 -- 172.21.15.26:0/3320098359 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f5006ae80 msgr2=0x7f6f50139550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:13.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.773+0000 7f6f5824e700 1 --2- 172.21.15.26:0/3320098359 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f5006ae80 0x7f6f50139550 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6f48009dc0 tx=0x7f6f4800b330 comp rx=0 tx=0).stop 2023-10-01T07:59:13.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.773+0000 7f6f5824e700 1 -- 172.21.15.26:0/3320098359 shutdown_connections 2023-10-01T07:59:13.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.773+0000 7f6f5824e700 1 --2- 172.21.15.26:0/3320098359 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f5006ae80 0x7f6f50139550 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:13.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.773+0000 7f6f5824e700 1 --2- 172.21.15.26:0/3320098359 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f501316c0 0x7f6f50131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:13.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.773+0000 7f6f5824e700 1 -- 172.21.15.26:0/3320098359 >> 172.21.15.26:0/3320098359 conn(0x7f6f50066f50 msgr2=0x7f6f5009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:13.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.773+0000 7f6f5824e700 1 -- 172.21.15.26:0/3320098359 shutdown_connections 2023-10-01T07:59:13.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.773+0000 7f6f5824e700 1 -- 172.21.15.26:0/3320098359 wait complete. 2023-10-01T07:59:13.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.774+0000 7f6f5824e700 1 Processor -- start 2023-10-01T07:59:13.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.774+0000 7f6f5824e700 1 -- start start 2023-10-01T07:59:13.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.775+0000 7f6f5824e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f5006ae80 0x7f6f5011a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:13.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.775+0000 7f6f5824e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f5009d9f0 0x7f6f5011a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:13.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.775+0000 7f6f5824e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f501316c0 0x7f6f5011ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:13.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.775+0000 7f6f5824e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5011cd40 con 0x7f6f5009d9f0 2023-10-01T07:59:13.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.775+0000 7f6f5824e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5011bf40 con 0x7f6f5006ae80 2023-10-01T07:59:13.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.775+0000 7f6f5824e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5011c7d0 con 0x7f6f501316c0 2023-10-01T07:59:13.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.775+0000 7f6f55fea700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f5006ae80 0x7f6f5011a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:13.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.775+0000 7f6f55fea700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f5006ae80 0x7f6f5011a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44072/0 (socket says 172.21.15.26:44072) 2023-10-01T07:59:13.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.775+0000 7f6f55fea700 1 -- 172.21.15.26:0/2537704923 learned_addr learned my addr 172.21.15.26:0/2537704923 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:13.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.775+0000 7f6f557e9700 1 --2- 172.21.15.26:0/2537704923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f5009d9f0 0x7f6f5011a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:13.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.775+0000 7f6f567eb700 1 --2- 172.21.15.26:0/2537704923 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f501316c0 0x7f6f5011ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:13.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.775+0000 7f6f55fea700 1 -- 172.21.15.26:0/2537704923 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f501316c0 msgr2=0x7f6f5011ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:13.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.775+0000 7f6f55fea700 1 --2- 172.21.15.26:0/2537704923 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f501316c0 0x7f6f5011ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:13.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.775+0000 7f6f55fea700 1 -- 172.21.15.26:0/2537704923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f5009d9f0 msgr2=0x7f6f5011a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:13.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.775+0000 7f6f55fea700 1 --2- 172.21.15.26:0/2537704923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f5009d9f0 0x7f6f5011a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:13.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.775+0000 7f6f55fea700 1 -- 172.21.15.26:0/2537704923 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f48009a70 con 0x7f6f5006ae80 2023-10-01T07:59:13.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.776+0000 7f6f55fea700 1 --2- 172.21.15.26:0/2537704923 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f5006ae80 0x7f6f5011a3f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00b3f0 tx=0x7f6f4c00b700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:13.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.776+0000 7f6f467fc700 1 -- 172.21.15.26:0/2537704923 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c019070 con 0x7f6f5006ae80 2023-10-01T07:59:13.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.776+0000 7f6f467fc700 1 -- 172.21.15.26:0/2537704923 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4c00be10 con 0x7f6f5006ae80 2023-10-01T07:59:13.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.776+0000 7f6f5824e700 1 -- 172.21.15.26:0/2537704923 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f5012b900 con 0x7f6f5006ae80 2023-10-01T07:59:13.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.776+0000 7f6f467fc700 1 -- 172.21.15.26:0/2537704923 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c014af0 con 0x7f6f5006ae80 2023-10-01T07:59:13.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.776+0000 7f6f5824e700 1 -- 172.21.15.26:0/2537704923 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f5011d910 con 0x7f6f5006ae80 2023-10-01T07:59:13.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.777+0000 7f6f467fc700 1 -- 172.21.15.26:0/2537704923 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6f4c01d610 con 0x7f6f5006ae80 2023-10-01T07:59:13.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.777+0000 7f6f467fc700 1 -- 172.21.15.26:0/2537704923 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6f4c047390 con 0x7f6f5006ae80 2023-10-01T07:59:13.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.778+0000 7f6f5824e700 1 -- 172.21.15.26:0/2537704923 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f5009eaa0 con 0x7f6f5006ae80 2023-10-01T07:59:13.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.787+0000 7f6f467fc700 1 -- 172.21.15.26:0/2537704923 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f4c022080 con 0x7f6f5006ae80 2023-10-01T07:59:13.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.869+0000 7fc62aeed700 1 -- 172.21.15.26:0/2197780860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc62406b9e0 con 0x7fc6241338a0 2023-10-01T07:59:13.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.869+0000 7fc6217fa700 1 -- 172.21.15.26:0/2197780860 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc61c013bd0 con 0x7fc6241338a0 2023-10-01T07:59:13.870 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:13.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.872+0000 7fc62aeed700 1 -- 172.21.15.26:0/2197780860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6241338a0 msgr2=0x7fc62411e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:13.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.872+0000 7fc62aeed700 1 --2- 172.21.15.26:0/2197780860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6241338a0 0x7fc62411e140 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fc61c00efc0 tx=0x7fc61c00c3a0 comp rx=0 tx=0).stop 2023-10-01T07:59:13.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.873+0000 7fc62aeed700 1 -- 172.21.15.26:0/2197780860 shutdown_connections 2023-10-01T07:59:13.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.873+0000 7fc62aeed700 1 --2- 172.21.15.26:0/2197780860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6241338a0 0x7fc62411e140 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:13.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.873+0000 7fc62aeed700 1 --2- 172.21.15.26:0/2197780860 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc62409de50 0x7fc62411d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:13.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.873+0000 7fc62aeed700 1 --2- 172.21.15.26:0/2197780860 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc62409e930 0x7fc62411dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:13.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.873+0000 7fc62aeed700 1 -- 172.21.15.26:0/2197780860 >> 172.21.15.26:0/2197780860 conn(0x7fc6240a2aa0 msgr2=0x7fc6241b9410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:13.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.874+0000 7fc62aeed700 1 -- 172.21.15.26:0/2197780860 shutdown_connections 2023-10-01T07:59:13.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.874+0000 7fc62aeed700 1 -- 172.21.15.26:0/2197780860 wait complete. 2023-10-01T07:59:13.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:13.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.916+0000 7fd590037700 1 -- 172.21.15.26:0/3526461591 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd588074ea0 con 0x7fd58809d6f0 2023-10-01T07:59:13.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.916+0000 7fd57e7fc700 1 -- 172.21.15.26:0/3526461591 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd58403d020 con 0x7fd58809d6f0 2023-10-01T07:59:13.917 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:13.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.919+0000 7fd590037700 1 -- 172.21.15.26:0/3526461591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd58809d6f0 msgr2=0x7fd5881a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:13.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.919+0000 7fd590037700 1 --2- 172.21.15.26:0/3526461591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd58809d6f0 0x7fd5881a5190 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fd58809a970 tx=0x7fd584004750 comp rx=0 tx=0).stop 2023-10-01T07:59:13.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.919+0000 7fd590037700 1 -- 172.21.15.26:0/3526461591 shutdown_connections 2023-10-01T07:59:13.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.919+0000 7fd590037700 1 --2- 172.21.15.26:0/3526461591 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd58809e410 0x7fd5881c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:13.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.919+0000 7fd590037700 1 --2- 172.21.15.26:0/3526461591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd58809d6f0 0x7fd5881a5190 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:13.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.919+0000 7fd590037700 1 --2- 172.21.15.26:0/3526461591 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd58809e000 0x7fd5881a56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:13.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.919+0000 7fd590037700 1 -- 172.21.15.26:0/3526461591 >> 172.21.15.26:0/3526461591 conn(0x7fd588066f50 msgr2=0x7fd58806f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:13.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.919+0000 7fd590037700 1 -- 172.21.15.26:0/3526461591 shutdown_connections 2023-10-01T07:59:13.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.919+0000 7fd590037700 1 -- 172.21.15.26:0/3526461591 wait complete. 2023-10-01T07:59:13.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:13.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.952+0000 7fb6031d9700 1 -- 172.21.15.26:0/3161887037 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb5fc13eaa0 con 0x7fb5fc13cf90 2023-10-01T07:59:13.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.952+0000 7fb5f97fa700 1 -- 172.21.15.26:0/3161887037 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb5fc13eaa0 con 0x7fb5fc13cf90 2023-10-01T07:59:13.953 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:13.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.955+0000 7fb6031d9700 1 -- 172.21.15.26:0/3161887037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5fc13cf90 msgr2=0x7fb5fc133990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:13.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.955+0000 7fb6031d9700 1 --2- 172.21.15.26:0/3161887037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5fc13cf90 0x7fb5fc133990 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4014040 tx=0x7fb5f4004ad0 comp rx=0 tx=0).stop 2023-10-01T07:59:13.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.955+0000 7fb6031d9700 1 -- 172.21.15.26:0/3161887037 shutdown_connections 2023-10-01T07:59:13.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.955+0000 7fb6031d9700 1 --2- 172.21.15.26:0/3161887037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5fc13cf90 0x7fb5fc133990 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:13.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.955+0000 7fb6031d9700 1 --2- 172.21.15.26:0/3161887037 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5fc06e570 0x7fb5fc13c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:13.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.955+0000 7fb6031d9700 1 --2- 172.21.15.26:0/3161887037 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb5fc06ee80 0x7fb5fc133450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:13.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.955+0000 7fb6031d9700 1 -- 172.21.15.26:0/3161887037 >> 172.21.15.26:0/3161887037 conn(0x7fb5fc0a2aa0 msgr2=0x7fb5fc1373a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:13.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.955+0000 7fb6031d9700 1 -- 172.21.15.26:0/3161887037 shutdown_connections 2023-10-01T07:59:13.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.955+0000 7fb6031d9700 1 -- 172.21.15.26:0/3161887037 wait complete. 2023-10-01T07:59:13.969 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:13.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.997+0000 7f6f5824e700 1 -- 172.21.15.26:0/2537704923 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6f50074ea0 con 0x7f6f5006ae80 2023-10-01T07:59:13.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.997+0000 7f6f467fc700 1 -- 172.21.15.26:0/2537704923 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6f4c0470c0 con 0x7f6f5006ae80 2023-10-01T07:59:13.998 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:14.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.999+0000 7f6f5824e700 1 -- 172.21.15.26:0/2537704923 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f5006ae80 msgr2=0x7f6f5011a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:14.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:13.999+0000 7f6f5824e700 1 --2- 172.21.15.26:0/2537704923 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f5006ae80 0x7f6f5011a3f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00b3f0 tx=0x7f6f4c00b700 comp rx=0 tx=0).stop 2023-10-01T07:59:14.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:14.000+0000 7f6f5824e700 1 -- 172.21.15.26:0/2537704923 shutdown_connections 2023-10-01T07:59:14.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:14.000+0000 7f6f5824e700 1 --2- 172.21.15.26:0/2537704923 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f501316c0 0x7f6f5011ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:14.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:14.000+0000 7f6f5824e700 1 --2- 172.21.15.26:0/2537704923 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f5006ae80 0x7f6f5011a3f0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:14.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:14.000+0000 7f6f5824e700 1 --2- 172.21.15.26:0/2537704923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f5009d9f0 0x7f6f5011a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:14.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:14.000+0000 7f6f5824e700 1 -- 172.21.15.26:0/2537704923 >> 172.21.15.26:0/2537704923 conn(0x7f6f50066f50 msgr2=0x7f6f500a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:14.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:14.000+0000 7f6f5824e700 1 -- 172.21.15.26:0/2537704923 shutdown_connections 2023-10-01T07:59:14.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:14.000+0000 7f6f5824e700 1 -- 172.21.15.26:0/2537704923 wait complete. 2023-10-01T07:59:14.014 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:14.891 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:14.934 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:14.970 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:15.014 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:15.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.052+0000 7f15547c5700 1 Processor -- start 2023-10-01T07:59:15.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.052+0000 7f15547c5700 1 -- start start 2023-10-01T07:59:15.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.053+0000 7f15547c5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f154c136710 0x7f154c138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:15.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.053+0000 7f15547c5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f154c139030 0x7f154c13b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:15.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.053+0000 7f15547c5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f154c06ef30 con 0x7f154c1338a0 2023-10-01T07:59:15.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.053+0000 7f15547c5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f154c06fef0 con 0x7f154c136710 2023-10-01T07:59:15.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.053+0000 7f15547c5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f154c1334b0 con 0x7f154c139030 2023-10-01T07:59:15.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.053+0000 7f1551d60700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f154c136710 0x7f154c138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:15.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.054+0000 7f1551d60700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f154c136710 0x7f154c138af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34496/0 (socket says 172.21.15.26:34496) 2023-10-01T07:59:15.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.054+0000 7f1551d60700 1 -- 172.21.15.26:0/3087172084 learned_addr learned my addr 172.21.15.26:0/3087172084 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:15.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.054+0000 7f1552d62700 1 --2- 172.21.15.26:0/3087172084 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f154c139030 0x7f154c13b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:15.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.054+0000 7f1551d60700 1 -- 172.21.15.26:0/3087172084 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f154c139030 msgr2=0x7f154c13b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:15.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.054+0000 7f1551d60700 1 --2- 172.21.15.26:0/3087172084 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f154c139030 0x7f154c13b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.054+0000 7f1551d60700 1 -- 172.21.15.26:0/3087172084 >> v1:172.21.15.26:6789/0 conn(0x7f154c1338a0 legacy=0x7f154c133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:15.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.054+0000 7f1551d60700 1 -- 172.21.15.26:0/3087172084 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f154c06fc30 con 0x7f154c136710 2023-10-01T07:59:15.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.054+0000 7f1551d60700 1 --2- 172.21.15.26:0/3087172084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f154c136710 0x7f154c138af0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f153c0098f0 tx=0x7f153c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a308a1e48b592c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:15.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.054+0000 7f155155f700 1 -- 172.21.15.26:0/3087172084 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c011830 con 0x7f154c136710 2023-10-01T07:59:15.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.055+0000 7f155155f700 1 -- 172.21.15.26:0/3087172084 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153c011990 con 0x7f154c136710 2023-10-01T07:59:15.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.055+0000 7f155155f700 1 -- 172.21.15.26:0/3087172084 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c011d20 con 0x7f154c136710 2023-10-01T07:59:15.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.055+0000 7f15547c5700 1 -- 172.21.15.26:0/3087172084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f154c136710 msgr2=0x7f154c138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:15.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.055+0000 7f15547c5700 1 --2- 172.21.15.26:0/3087172084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f154c136710 0x7f154c138af0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f153c0098f0 tx=0x7f153c009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:15.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.056+0000 7f15547c5700 1 -- 172.21.15.26:0/3087172084 shutdown_connections 2023-10-01T07:59:15.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.056+0000 7f15547c5700 1 --2- 172.21.15.26:0/3087172084 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f154c139030 0x7f154c13b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.056+0000 7f15547c5700 1 --2- 172.21.15.26:0/3087172084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f154c136710 0x7f154c138af0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.056+0000 7f15547c5700 1 -- 172.21.15.26:0/3087172084 >> 172.21.15.26:0/3087172084 conn(0x7f154c0a2aa0 msgr2=0x7f154c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:15.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.056+0000 7f15547c5700 1 -- 172.21.15.26:0/3087172084 shutdown_connections 2023-10-01T07:59:15.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.056+0000 7f15547c5700 1 -- 172.21.15.26:0/3087172084 wait complete. 2023-10-01T07:59:15.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.057+0000 7f15547c5700 1 Processor -- start 2023-10-01T07:59:15.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.057+0000 7f15547c5700 1 -- start start 2023-10-01T07:59:15.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.058+0000 7f15547c5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f154c1338a0 0x7f154c11aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:15.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.058+0000 7f15547c5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f154c136710 0x7f154c11b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:15.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.058+0000 7f15547c5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f154c139030 0x7f154c11b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:15.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.058+0000 7f15547c5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154c11ca20 con 0x7f154c139030 2023-10-01T07:59:15.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.058+0000 7f15547c5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f154c11eb70 con 0x7f154c136710 2023-10-01T07:59:15.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.058+0000 7f15547c5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f154c11e650 con 0x7f154c1338a0 2023-10-01T07:59:15.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.058+0000 7f1552d62700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f154c139030 0x7f154c11b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:15.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.058+0000 7f1552d62700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f154c139030 0x7f154c11b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34510/0 (socket says 172.21.15.26:34510) 2023-10-01T07:59:15.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.058+0000 7f1552d62700 1 -- 172.21.15.26:0/4156489433 learned_addr learned my addr 172.21.15.26:0/4156489433 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:15.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.058+0000 7f1551d60700 1 --2- 172.21.15.26:0/4156489433 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f154c136710 0x7f154c11b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:15.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.059+0000 7f1552d62700 1 -- 172.21.15.26:0/4156489433 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f154c1338a0 msgr2=0x7f154c11aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:15.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.059+0000 7f1552d62700 1 --2- 172.21.15.26:0/4156489433 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f154c1338a0 0x7f154c11aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.059+0000 7f1552d62700 1 -- 172.21.15.26:0/4156489433 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f154c136710 msgr2=0x7f154c11b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:15.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.059+0000 7f1552d62700 1 --2- 172.21.15.26:0/4156489433 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f154c136710 0x7f154c11b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.059+0000 7f1552d62700 1 -- 172.21.15.26:0/4156489433 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f153c009550 con 0x7f154c139030 2023-10-01T07:59:15.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.059+0000 7f1551d60700 1 --2- 172.21.15.26:0/4156489433 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f154c136710 0x7f154c11b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:15.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.059+0000 7f1552d62700 1 --2- 172.21.15.26:0/4156489433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f154c139030 0x7f154c11b930 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f154400efc0 tx=0x7f154400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:15.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.060+0000 7f1542ffd700 1 -- 172.21.15.26:0/4156489433 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1544009ea0 con 0x7f154c139030 2023-10-01T07:59:15.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.060+0000 7f1542ffd700 1 -- 172.21.15.26:0/4156489433 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f154400f040 con 0x7f154c139030 2023-10-01T07:59:15.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.060+0000 7f15547c5700 1 -- 172.21.15.26:0/4156489433 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f154c11e0c0 con 0x7f154c139030 2023-10-01T07:59:15.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.060+0000 7f1542ffd700 1 -- 172.21.15.26:0/4156489433 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1544014480 con 0x7f154c139030 2023-10-01T07:59:15.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.060+0000 7f15547c5700 1 -- 172.21.15.26:0/4156489433 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f154c11d210 con 0x7f154c139030 2023-10-01T07:59:15.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.061+0000 7f1542ffd700 1 -- 172.21.15.26:0/4156489433 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f15440145e0 con 0x7f154c139030 2023-10-01T07:59:15.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.061+0000 7f15547c5700 1 -- 172.21.15.26:0/4156489433 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f154c074ea0 con 0x7f154c139030 2023-10-01T07:59:15.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.061+0000 7f1542ffd700 1 -- 172.21.15.26:0/4156489433 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1544040060 con 0x7f154c139030 2023-10-01T07:59:15.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.071+0000 7f1542ffd700 1 -- 172.21.15.26:0/4156489433 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1544018030 con 0x7f154c139030 2023-10-01T07:59:15.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.087+0000 7f1b277a8700 1 Processor -- start 2023-10-01T07:59:15.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.087+0000 7f1b277a8700 1 -- start start 2023-10-01T07:59:15.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.087+0000 7f1b277a8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b2009d6f0 0x7f1b2009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:15.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.087+0000 7f1b277a8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1b2009e000 0x7f1b20130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:15.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.087+0000 7f1b277a8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b2009e410 0x7f1b20130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:15.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.087+0000 7f1b277a8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b2009f520 con 0x7f1b2009e000 2023-10-01T07:59:15.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.087+0000 7f1b277a8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2009f130 con 0x7f1b2009d6f0 2023-10-01T07:59:15.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.087+0000 7f1b277a8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2009e930 con 0x7f1b2009e410 2023-10-01T07:59:15.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.088+0000 7f1b25544700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b2009d6f0 0x7f1b2009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:15.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.088+0000 7f1b25544700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b2009d6f0 0x7f1b2009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44086/0 (socket says 172.21.15.26:44086) 2023-10-01T07:59:15.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.088+0000 7f1b25544700 1 -- 172.21.15.26:0/275601558 learned_addr learned my addr 172.21.15.26:0/275601558 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:15.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.088+0000 7f1b25d45700 1 --2- 172.21.15.26:0/275601558 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b2009e410 0x7f1b20130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:15.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.088+0000 7f1b24d43700 1 --2- 172.21.15.26:0/275601558 >> v2:172.21.15.26:3300/0 conn(0x7f1b2009e000 0x7f1b20130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:15.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.088+0000 7f1b25d45700 1 -- 172.21.15.26:0/275601558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b2009d6f0 msgr2=0x7f1b2009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:15.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.088+0000 7f1b25d45700 1 --2- 172.21.15.26:0/275601558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b2009d6f0 0x7f1b2009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.088+0000 7f1b25d45700 1 -- 172.21.15.26:0/275601558 >> v2:172.21.15.26:3300/0 conn(0x7f1b2009e000 msgr2=0x7f1b20130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:15.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.088+0000 7f1b25d45700 1 --2- 172.21.15.26:0/275601558 >> v2:172.21.15.26:3300/0 conn(0x7f1b2009e000 0x7f1b20130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.088+0000 7f1b25d45700 1 -- 172.21.15.26:0/275601558 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2009b2d0 con 0x7f1b2009e410 2023-10-01T07:59:15.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.089+0000 7f1b25d45700 1 --2- 172.21.15.26:0/275601558 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b2009e410 0x7f1b20130ba0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1b18009dc0 tx=0x7f1b1800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62ecd21347f62035 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:15.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.089+0000 7f1b17fff700 1 -- 172.21.15.26:0/275601558 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1800e070 con 0x7f1b2009e410 2023-10-01T07:59:15.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.089+0000 7f1b17fff700 1 -- 172.21.15.26:0/275601558 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1800bae0 con 0x7f1b2009e410 2023-10-01T07:59:15.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.089+0000 7f1b17fff700 1 -- 172.21.15.26:0/275601558 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1800be90 con 0x7f1b2009e410 2023-10-01T07:59:15.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.089+0000 7f1b277a8700 1 -- 172.21.15.26:0/275601558 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b2009e410 msgr2=0x7f1b20130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:15.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.089+0000 7f1b277a8700 1 --2- 172.21.15.26:0/275601558 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b2009e410 0x7f1b20130ba0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1b18009dc0 tx=0x7f1b1800b330 comp rx=0 tx=0).stop 2023-10-01T07:59:15.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.090+0000 7f1b277a8700 1 -- 172.21.15.26:0/275601558 shutdown_connections 2023-10-01T07:59:15.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.090+0000 7f1b277a8700 1 --2- 172.21.15.26:0/275601558 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b2009e410 0x7f1b20130ba0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.090+0000 7f1b277a8700 1 --2- 172.21.15.26:0/275601558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b2009d6f0 0x7f1b2009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.090+0000 7f1b277a8700 1 --2- 172.21.15.26:0/275601558 >> v2:172.21.15.26:3300/0 conn(0x7f1b2009e000 0x7f1b20130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.090+0000 7f1b277a8700 1 -- 172.21.15.26:0/275601558 >> 172.21.15.26:0/275601558 conn(0x7f1b20066f50 msgr2=0x7f1b2009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:15.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.090+0000 7f1b277a8700 1 -- 172.21.15.26:0/275601558 shutdown_connections 2023-10-01T07:59:15.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.090+0000 7f1b277a8700 1 -- 172.21.15.26:0/275601558 wait complete. 2023-10-01T07:59:15.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.091+0000 7f1b277a8700 1 Processor -- start 2023-10-01T07:59:15.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.091+0000 7f1b277a8700 1 -- start start 2023-10-01T07:59:15.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.091+0000 7f1b277a8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b2009d6f0 0x7f1b20122730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:15.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.091+0000 7f1b277a8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b2009e000 0x7f1b20122c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:15.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.091+0000 7f1b277a8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b2009e410 0x7f1b201231b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:15.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.091+0000 7f1b277a8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b20130650 con 0x7f1b2009d6f0 2023-10-01T07:59:15.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.091+0000 7f1b277a8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b20123b70 con 0x7f1b2009e000 2023-10-01T07:59:15.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.091+0000 7f1b277a8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b20130990 con 0x7f1b2009e410 2023-10-01T07:59:15.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.092+0000 7f1b25d45700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b2009e410 0x7f1b201231b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:15.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.092+0000 7f1b25d45700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b2009e410 0x7f1b201231b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56510/0 (socket says 172.21.15.26:56510) 2023-10-01T07:59:15.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.092+0000 7f1b25d45700 1 -- 172.21.15.26:0/2908717973 learned_addr learned my addr 172.21.15.26:0/2908717973 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:15.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.092+0000 7f1b24d43700 1 --2- 172.21.15.26:0/2908717973 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b2009e000 0x7f1b20122c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:15.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.092+0000 7f1b25d45700 1 -- 172.21.15.26:0/2908717973 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b2009e000 msgr2=0x7f1b20122c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:15.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.092+0000 7f1b25d45700 1 --2- 172.21.15.26:0/2908717973 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b2009e000 0x7f1b20122c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.092+0000 7f1b25544700 1 --2- 172.21.15.26:0/2908717973 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b2009d6f0 0x7f1b20122730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:15.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.092+0000 7f1b25d45700 1 -- 172.21.15.26:0/2908717973 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b2009d6f0 msgr2=0x7f1b20122730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:15.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.092+0000 7f1b25d45700 1 --2- 172.21.15.26:0/2908717973 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b2009d6f0 0x7f1b20122730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.092+0000 7f1b25d45700 1 -- 172.21.15.26:0/2908717973 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b18009a70 con 0x7f1b2009e410 2023-10-01T07:59:15.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.092+0000 7f1b25544700 1 --2- 172.21.15.26:0/2908717973 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b2009d6f0 0x7f1b20122730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:59:15.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.092+0000 7f1b25d45700 1 --2- 172.21.15.26:0/2908717973 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b2009e410 0x7f1b201231b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1b2009ea70 tx=0x7f1b18004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:15.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.092+0000 7f1b15ffb700 1 -- 172.21.15.26:0/2908717973 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b18004550 con 0x7f1b2009e410 2023-10-01T07:59:15.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.092+0000 7f1b15ffb700 1 -- 172.21.15.26:0/2908717973 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b18020070 con 0x7f1b2009e410 2023-10-01T07:59:15.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.093+0000 7f1b277a8700 1 -- 172.21.15.26:0/2908717973 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b20124b60 con 0x7f1b2009e410 2023-10-01T07:59:15.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.093+0000 7f1b15ffb700 1 -- 172.21.15.26:0/2908717973 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b180048f0 con 0x7f1b2009e410 2023-10-01T07:59:15.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.093+0000 7f1b277a8700 1 -- 172.21.15.26:0/2908717973 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b20125cb0 con 0x7f1b2009e410 2023-10-01T07:59:15.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.094+0000 7f1b0b7fe700 1 -- 172.21.15.26:0/2908717973 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af80052e0 con 0x7f1b2009e410 2023-10-01T07:59:15.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.094+0000 7f1b15ffb700 1 -- 172.21.15.26:0/2908717973 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1b18012430 con 0x7f1b2009e410 2023-10-01T07:59:15.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.095+0000 7f1b15ffb700 1 -- 172.21.15.26:0/2908717973 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1b18022070 con 0x7f1b2009e410 2023-10-01T07:59:15.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.104+0000 7f1b15ffb700 1 -- 172.21.15.26:0/2908717973 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1b18025740 con 0x7f1b2009e410 2023-10-01T07:59:15.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.144+0000 7f7047a6a700 1 Processor -- start 2023-10-01T07:59:15.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.145+0000 7f7047a6a700 1 -- start start 2023-10-01T07:59:15.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.146+0000 7f7047a6a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f70401338a0 0x7f7040133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:15.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.146+0000 7f7047a6a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f704009e930 0x7f704013b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:15.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.146+0000 7f7047a6a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f704006ef30 con 0x7f704009de50 2023-10-01T07:59:15.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.146+0000 7f7047a6a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f704006fef0 con 0x7f70401338a0 2023-10-01T07:59:15.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.146+0000 7f7047a6a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70401334b0 con 0x7f704009e930 2023-10-01T07:59:15.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.146+0000 7f7045005700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f704009de50 0x7f704009e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44134/0 (socket says 172.21.15.26:44134) 2023-10-01T07:59:15.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.146+0000 7f7045005700 1 -- 172.21.15.26:0/1993418590 learned_addr learned my addr 172.21.15.26:0/1993418590 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:59:15.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.146+0000 7f7046007700 1 --2- 172.21.15.26:0/1993418590 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f704009e930 0x7f704013b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:15.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.146+0000 7f7045806700 1 --2- 172.21.15.26:0/1993418590 >> v2:172.21.15.26:3300/0 conn(0x7f70401338a0 0x7f7040133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:15.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.146+0000 7f7044804700 1 -- 172.21.15.26:0/1993418590 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158073912 0 0) 0x7f704006ef30 con 0x7f704009de50 2023-10-01T07:59:15.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.146+0000 7f7044804700 1 -- 172.21.15.26:0/1993418590 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f702c0035b0 con 0x7f704009de50 2023-10-01T07:59:15.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.146+0000 7f7046007700 1 -- 172.21.15.26:0/1993418590 >> v2:172.21.15.26:3300/0 conn(0x7f70401338a0 msgr2=0x7f7040133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:15.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.146+0000 7f7046007700 1 --2- 172.21.15.26:0/1993418590 >> v2:172.21.15.26:3300/0 conn(0x7f70401338a0 0x7f7040133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.146+0000 7f7046007700 1 -- 172.21.15.26:0/1993418590 >> v1:172.21.15.26:6789/0 conn(0x7f704009de50 legacy=0x7f704009e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:15.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.146+0000 7f7046007700 1 -- 172.21.15.26:0/1993418590 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f704006fc30 con 0x7f704009e930 2023-10-01T07:59:15.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.146+0000 7f7045806700 1 --2- 172.21.15.26:0/1993418590 >> v2:172.21.15.26:3300/0 conn(0x7f70401338a0 0x7f7040133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:15.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.147+0000 7f7046007700 1 --2- 172.21.15.26:0/1993418590 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f704009e930 0x7f704013b740 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f7038009d90 tx=0x7f703800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8add74e7f6d8dd0c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:15.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.147+0000 7f7044804700 1 -- 172.21.15.26:0/1993418590 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703800e070 con 0x7f704009e930 2023-10-01T07:59:15.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.147+0000 7f7044804700 1 -- 172.21.15.26:0/1993418590 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703800bb20 con 0x7f704009e930 2023-10-01T07:59:15.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.147+0000 7f7044804700 1 -- 172.21.15.26:0/1993418590 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7038012430 con 0x7f704009e930 2023-10-01T07:59:15.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.148+0000 7f7047a6a700 1 -- 172.21.15.26:0/1993418590 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f704009e930 msgr2=0x7f704013b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:15.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.148+0000 7f7047a6a700 1 --2- 172.21.15.26:0/1993418590 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f704009e930 0x7f704013b740 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f7038009d90 tx=0x7f703800b330 comp rx=0 tx=0).stop 2023-10-01T07:59:15.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.148+0000 7f7047a6a700 1 -- 172.21.15.26:0/1993418590 shutdown_connections 2023-10-01T07:59:15.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.148+0000 7f7047a6a700 1 --2- 172.21.15.26:0/1993418590 >> v2:172.21.15.26:3300/0 conn(0x7f70401338a0 0x7f7040133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.148+0000 7f7047a6a700 1 --2- 172.21.15.26:0/1993418590 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f704009e930 0x7f704013b740 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.148+0000 7f7047a6a700 1 -- 172.21.15.26:0/1993418590 >> 172.21.15.26:0/1993418590 conn(0x7f70400a2aa0 msgr2=0x7f70400a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:15.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.148+0000 7f7047a6a700 1 -- 172.21.15.26:0/1993418590 shutdown_connections 2023-10-01T07:59:15.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.148+0000 7f7047a6a700 1 -- 172.21.15.26:0/1993418590 wait complete. 2023-10-01T07:59:15.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.150+0000 7f7047a6a700 1 Processor -- start 2023-10-01T07:59:15.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.150+0000 7f7047a6a700 1 -- start start 2023-10-01T07:59:15.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.150+0000 7f7047a6a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f704009de50 0x7f704011d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:15.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.151+0000 7f7047a6a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f704009e930 0x7f704011dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:15.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.151+0000 7f7047a6a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70401338a0 0x7f704011e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:15.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.151+0000 7f7047a6a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70401208f0 con 0x7f70401338a0 2023-10-01T07:59:15.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.151+0000 7f7047a6a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704006f640 con 0x7f704009de50 2023-10-01T07:59:15.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.151+0000 7f7047a6a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70400a0c40 con 0x7f704009e930 2023-10-01T07:59:15.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.151+0000 7f7046007700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70401338a0 0x7f704011e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:15.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.151+0000 7f7046007700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70401338a0 0x7f704011e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34554/0 (socket says 172.21.15.26:34554) 2023-10-01T07:59:15.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.151+0000 7f7046007700 1 -- 172.21.15.26:0/1502600491 learned_addr learned my addr 172.21.15.26:0/1502600491 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:15.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.151+0000 7f7045005700 1 --2- 172.21.15.26:0/1502600491 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f704009e930 0x7f704011dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:15.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.151+0000 7f7045806700 1 --2- 172.21.15.26:0/1502600491 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f704009de50 0x7f704011d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:15.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.151+0000 7f7045005700 1 -- 172.21.15.26:0/1502600491 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f704009de50 msgr2=0x7f704011d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:15.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.151+0000 7f7045005700 1 --2- 172.21.15.26:0/1502600491 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f704009de50 0x7f704011d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.151+0000 7f7045005700 1 -- 172.21.15.26:0/1502600491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70401338a0 msgr2=0x7f704011e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:15.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.151+0000 7f7045005700 1 --2- 172.21.15.26:0/1502600491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70401338a0 0x7f704011e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.151+0000 7f7045005700 1 -- 172.21.15.26:0/1502600491 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703c0094a0 con 0x7f704009e930 2023-10-01T07:59:15.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.151+0000 7f7045005700 1 --2- 172.21.15.26:0/1502600491 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f704009e930 0x7f704011dcb0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f703000c430 tx=0x7f703000c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:15.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.152+0000 7f70367fc700 1 -- 172.21.15.26:0/1502600491 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7030005d70 con 0x7f704009e930 2023-10-01T07:59:15.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.152+0000 7f70367fc700 1 -- 172.21.15.26:0/1502600491 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70300070d0 con 0x7f704009e930 2023-10-01T07:59:15.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.152+0000 7f7047a6a700 1 -- 172.21.15.26:0/1502600491 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7038009a70 con 0x7f704009e930 2023-10-01T07:59:15.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.152+0000 7f70367fc700 1 -- 172.21.15.26:0/1502600491 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7030007480 con 0x7f704009e930 2023-10-01T07:59:15.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.152+0000 7f7047a6a700 1 -- 172.21.15.26:0/1502600491 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70401204a0 con 0x7f704009e930 2023-10-01T07:59:15.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.153+0000 7f70367fc700 1 -- 172.21.15.26:0/1502600491 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f70300075e0 con 0x7f704009e930 2023-10-01T07:59:15.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.153+0000 7f70367fc700 1 -- 172.21.15.26:0/1502600491 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f703003e7e0 con 0x7f704009e930 2023-10-01T07:59:15.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.153+0000 7f7047a6a700 1 -- 172.21.15.26:0/1502600491 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7040120b20 con 0x7f704009e930 2023-10-01T07:59:15.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.159+0000 7f70367fc700 1 -- 172.21.15.26:0/1502600491 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7040120b20 con 0x7f704009e930 2023-10-01T07:59:15.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.175+0000 7f8076b5b700 1 Processor -- start 2023-10-01T07:59:15.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.176+0000 7f8076b5b700 1 -- start start 2023-10-01T07:59:15.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.176+0000 7f8076b5b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f807009e930 0x7f807009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:15.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.176+0000 7f8076b5b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f807009f650 0x7f8070131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:15.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.176+0000 7f8076b5b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8070070940 con 0x7f807009f240 2023-10-01T07:59:15.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.176+0000 7f8076b5b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f807006fd60 con 0x7f807009e930 2023-10-01T07:59:15.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.176+0000 7f8076b5b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f807006fa80 con 0x7f807009f650 2023-10-01T07:59:15.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.177+0000 7f80748f7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f807009e930 0x7f807009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:15.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.177+0000 7f80748f7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f807009e930 0x7f807009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34564/0 (socket says 172.21.15.26:34564) 2023-10-01T07:59:15.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.177+0000 7f80748f7700 1 -- 172.21.15.26:0/1419232367 learned_addr learned my addr 172.21.15.26:0/1419232367 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:15.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.177+0000 7f80750f8700 1 --2- 172.21.15.26:0/1419232367 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f807009f650 0x7f8070131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:15.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.177+0000 7f80748f7700 1 -- 172.21.15.26:0/1419232367 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f807009f650 msgr2=0x7f8070131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:15.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.177+0000 7f80748f7700 1 --2- 172.21.15.26:0/1419232367 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f807009f650 0x7f8070131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.177+0000 7f80748f7700 1 -- 172.21.15.26:0/1419232367 >> v1:172.21.15.26:6789/0 conn(0x7f807009f240 legacy=0x7f80701317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:15.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.177+0000 7f806f7fe700 1 -- 172.21.15.26:0/1419232367 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096821821 0 0) 0x7f8070070940 con 0x7f807009f240 2023-10-01T07:59:15.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.177+0000 7f80748f7700 1 -- 172.21.15.26:0/1419232367 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f807009fb60 con 0x7f807009e930 2023-10-01T07:59:15.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.177+0000 7f80748f7700 1 --2- 172.21.15.26:0/1419232367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f807009e930 0x7f807009ed00 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f80640098f0 tx=0x7f8064009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e1847d8ffca266e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:15.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.177+0000 7f806f7fe700 1 -- 172.21.15.26:0/1419232367 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8064011830 con 0x7f807009e930 2023-10-01T07:59:15.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.177+0000 7f806f7fe700 1 -- 172.21.15.26:0/1419232367 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8064011990 con 0x7f807009e930 2023-10-01T07:59:15.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.178+0000 7f806f7fe700 1 -- 172.21.15.26:0/1419232367 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8064011d20 con 0x7f807009e930 2023-10-01T07:59:15.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.178+0000 7f8076b5b700 1 -- 172.21.15.26:0/1419232367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f807009e930 msgr2=0x7f807009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:15.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.178+0000 7f8076b5b700 1 --2- 172.21.15.26:0/1419232367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f807009e930 0x7f807009ed00 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f80640098f0 tx=0x7f8064009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:15.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.178+0000 7f8076b5b700 1 -- 172.21.15.26:0/1419232367 shutdown_connections 2023-10-01T07:59:15.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.178+0000 7f8076b5b700 1 --2- 172.21.15.26:0/1419232367 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f807009f650 0x7f8070131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.178+0000 7f8076b5b700 1 --2- 172.21.15.26:0/1419232367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f807009e930 0x7f807009ed00 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.178+0000 7f8076b5b700 1 -- 172.21.15.26:0/1419232367 >> 172.21.15.26:0/1419232367 conn(0x7f80700a4210 msgr2=0x7f80700a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:15.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.178+0000 7f8076b5b700 1 -- 172.21.15.26:0/1419232367 shutdown_connections 2023-10-01T07:59:15.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.178+0000 7f8076b5b700 1 -- 172.21.15.26:0/1419232367 wait complete. 2023-10-01T07:59:15.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.179+0000 7f8076b5b700 1 Processor -- start 2023-10-01T07:59:15.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.179+0000 7f8076b5b700 1 -- start start 2023-10-01T07:59:15.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.180+0000 7f8076b5b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f807009e930 0x7f80701c5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:15.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.180+0000 7f8076b5b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f807009f240 0x7f80701c5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:15.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.180+0000 7f8076b5b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f807009f650 0x7f80701c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:15.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.180+0000 7f8076b5b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8070136610 con 0x7f807009f650 2023-10-01T07:59:15.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.180+0000 7f8076b5b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8070138720 con 0x7f807009f240 2023-10-01T07:59:15.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.180+0000 7f8076b5b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8070071d20 con 0x7f807009e930 2023-10-01T07:59:15.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.180+0000 7f80750f8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f807009f650 0x7f80701c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:15.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.180+0000 7f80750f8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f807009f650 0x7f80701c3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34568/0 (socket says 172.21.15.26:34568) 2023-10-01T07:59:15.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.180+0000 7f80750f8700 1 -- 172.21.15.26:0/865484693 learned_addr learned my addr 172.21.15.26:0/865484693 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:15.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.180+0000 7f806ffff700 1 --2- 172.21.15.26:0/865484693 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f807009f240 0x7f80701c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:15.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.180+0000 7f80748f7700 1 --2- 172.21.15.26:0/865484693 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f807009e930 0x7f80701c5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:15.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.181+0000 7f80750f8700 1 -- 172.21.15.26:0/865484693 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f807009e930 msgr2=0x7f80701c5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:15.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.181+0000 7f80750f8700 1 --2- 172.21.15.26:0/865484693 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f807009e930 0x7f80701c5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.181+0000 7f80750f8700 1 -- 172.21.15.26:0/865484693 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f807009f240 msgr2=0x7f80701c5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:15.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.181+0000 7f80750f8700 1 --2- 172.21.15.26:0/865484693 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f807009f240 0x7f80701c5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.181+0000 7f80750f8700 1 -- 172.21.15.26:0/865484693 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8064009550 con 0x7f807009f650 2023-10-01T07:59:15.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.181+0000 7f80750f8700 1 --2- 172.21.15.26:0/865484693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f807009f650 0x7f80701c3bf0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f8068009dd0 tx=0x7f806800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:15.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.181+0000 7f806d7fa700 1 -- 172.21.15.26:0/865484693 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8068009c40 con 0x7f807009f650 2023-10-01T07:59:15.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.181+0000 7f806d7fa700 1 -- 172.21.15.26:0/865484693 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806800f040 con 0x7f807009f650 2023-10-01T07:59:15.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.181+0000 7f806d7fa700 1 -- 172.21.15.26:0/865484693 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806800ceb0 con 0x7f807009f650 2023-10-01T07:59:15.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.181+0000 7f8076b5b700 1 -- 172.21.15.26:0/865484693 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80700a0190 con 0x7f807009f650 2023-10-01T07:59:15.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.181+0000 7f8076b5b700 1 -- 172.21.15.26:0/865484693 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8070136d20 con 0x7f807009f650 2023-10-01T07:59:15.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.182+0000 7f806d7fa700 1 -- 172.21.15.26:0/865484693 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8068014480 con 0x7f807009f650 2023-10-01T07:59:15.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.182+0000 7f806d7fa700 1 -- 172.21.15.26:0/865484693 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f806803ff30 con 0x7f807009f650 2023-10-01T07:59:15.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.183+0000 7f8076b5b700 1 -- 172.21.15.26:0/865484693 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8070138a90 con 0x7f807009f650 2023-10-01T07:59:15.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.192+0000 7f806d7fa700 1 -- 172.21.15.26:0/865484693 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8070138a90 con 0x7f807009f650 2023-10-01T07:59:15.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.331+0000 7f15547c5700 1 -- 172.21.15.26:0/4156489433 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f154c06f640 con 0x7f154c139030 2023-10-01T07:59:15.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.332+0000 7f1542ffd700 1 -- 172.21.15.26:0/4156489433 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f154401a680 con 0x7f154c139030 2023-10-01T07:59:15.333 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:15.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.333+0000 7f1b0b7fe700 1 -- 172.21.15.26:0/2908717973 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1af8005590 con 0x7f1b2009e410 2023-10-01T07:59:15.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.333+0000 7f1b15ffb700 1 -- 172.21.15.26:0/2908717973 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1b18025380 con 0x7f1b2009e410 2023-10-01T07:59:15.334 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:15.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.334+0000 7f15547c5700 1 -- 172.21.15.26:0/4156489433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f154c139030 msgr2=0x7f154c11b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:15.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.334+0000 7f15547c5700 1 --2- 172.21.15.26:0/4156489433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f154c139030 0x7f154c11b930 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f154400efc0 tx=0x7f154400c3a0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.335+0000 7f15547c5700 1 -- 172.21.15.26:0/4156489433 shutdown_connections 2023-10-01T07:59:15.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.335+0000 7f15547c5700 1 --2- 172.21.15.26:0/4156489433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f154c139030 0x7f154c11b930 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.335+0000 7f15547c5700 1 --2- 172.21.15.26:0/4156489433 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f154c1338a0 0x7f154c11aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.335+0000 7f15547c5700 1 --2- 172.21.15.26:0/4156489433 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f154c136710 0x7f154c11b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.335+0000 7f15547c5700 1 -- 172.21.15.26:0/4156489433 >> 172.21.15.26:0/4156489433 conn(0x7f154c0a2aa0 msgr2=0x7f154c1344f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:15.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.335+0000 7f15547c5700 1 -- 172.21.15.26:0/4156489433 shutdown_connections 2023-10-01T07:59:15.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.335+0000 7f15547c5700 1 -- 172.21.15.26:0/4156489433 wait complete. 2023-10-01T07:59:15.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.337+0000 7f1b0b7fe700 1 -- 172.21.15.26:0/2908717973 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b2009e410 msgr2=0x7f1b201231b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:15.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.337+0000 7f1b0b7fe700 1 --2- 172.21.15.26:0/2908717973 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b2009e410 0x7f1b201231b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1b2009ea70 tx=0x7f1b18004ad0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.337+0000 7f1b0b7fe700 1 -- 172.21.15.26:0/2908717973 shutdown_connections 2023-10-01T07:59:15.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.337+0000 7f1b0b7fe700 1 --2- 172.21.15.26:0/2908717973 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b2009e410 0x7f1b201231b0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.337+0000 7f1b0b7fe700 1 --2- 172.21.15.26:0/2908717973 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b2009d6f0 0x7f1b20122730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.337+0000 7f1b0b7fe700 1 --2- 172.21.15.26:0/2908717973 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b2009e000 0x7f1b20122c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.337+0000 7f1b0b7fe700 1 -- 172.21.15.26:0/2908717973 >> 172.21.15.26:0/2908717973 conn(0x7f1b20066f50 msgr2=0x7f1b200a1640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:15.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.338+0000 7f1b0b7fe700 1 -- 172.21.15.26:0/2908717973 shutdown_connections 2023-10-01T07:59:15.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.338+0000 7f1b0b7fe700 1 -- 172.21.15.26:0/2908717973 wait complete. 2023-10-01T07:59:15.351 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:15.353 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:15.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.403+0000 7f8076b5b700 1 -- 172.21.15.26:0/865484693 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8070138a90 con 0x7f807009f650 2023-10-01T07:59:15.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.403+0000 7f806d7fa700 1 -- 172.21.15.26:0/865484693 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8070138a90 con 0x7f807009f650 2023-10-01T07:59:15.404 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:15.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.405+0000 7f8076b5b700 1 -- 172.21.15.26:0/865484693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f807009f650 msgr2=0x7f80701c3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:15.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.405+0000 7f8076b5b700 1 --2- 172.21.15.26:0/865484693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f807009f650 0x7f80701c3bf0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f8068009dd0 tx=0x7f806800c3a0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.405+0000 7f8076b5b700 1 -- 172.21.15.26:0/865484693 shutdown_connections 2023-10-01T07:59:15.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.405+0000 7f8076b5b700 1 --2- 172.21.15.26:0/865484693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f807009f650 0x7f80701c3bf0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.405+0000 7f8076b5b700 1 --2- 172.21.15.26:0/865484693 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f807009e930 0x7f80701c5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.405+0000 7f8076b5b700 1 --2- 172.21.15.26:0/865484693 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f807009f240 0x7f80701c5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.405+0000 7f8076b5b700 1 -- 172.21.15.26:0/865484693 >> 172.21.15.26:0/865484693 conn(0x7f80700a4210 msgr2=0x7f8070132c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:15.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.405+0000 7f8076b5b700 1 -- 172.21.15.26:0/865484693 shutdown_connections 2023-10-01T07:59:15.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.405+0000 7f8076b5b700 1 -- 172.21.15.26:0/865484693 wait complete. 2023-10-01T07:59:15.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.411+0000 7f7047a6a700 1 -- 172.21.15.26:0/1502600491 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7040120b20 con 0x7f704009e930 2023-10-01T07:59:15.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.412+0000 7f70367fc700 1 -- 172.21.15.26:0/1502600491 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7040120b20 con 0x7f704009e930 2023-10-01T07:59:15.412 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:15.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.414+0000 7f7047a6a700 1 -- 172.21.15.26:0/1502600491 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f704009e930 msgr2=0x7f704011dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:15.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.414+0000 7f7047a6a700 1 --2- 172.21.15.26:0/1502600491 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f704009e930 0x7f704011dcb0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f703000c430 tx=0x7f703000c740 comp rx=0 tx=0).stop 2023-10-01T07:59:15.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.414+0000 7f7047a6a700 1 -- 172.21.15.26:0/1502600491 shutdown_connections 2023-10-01T07:59:15.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.414+0000 7f7047a6a700 1 --2- 172.21.15.26:0/1502600491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70401338a0 0x7f704011e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.414+0000 7f7047a6a700 1 --2- 172.21.15.26:0/1502600491 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f704009de50 0x7f704011d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.414+0000 7f7047a6a700 1 --2- 172.21.15.26:0/1502600491 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f704009e930 0x7f704011dcb0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:15.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.414+0000 7f7047a6a700 1 -- 172.21.15.26:0/1502600491 >> 172.21.15.26:0/1502600491 conn(0x7f70400a2aa0 msgr2=0x7f70401baac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:15.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.414+0000 7f7047a6a700 1 -- 172.21.15.26:0/1502600491 shutdown_connections 2023-10-01T07:59:15.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:15.414+0000 7f7047a6a700 1 -- 172.21.15.26:0/1502600491 wait complete. 2023-10-01T07:59:15.421 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:15.428 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:16.351 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:16.354 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:16.422 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:16.429 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:16.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.505+0000 7fd67680d700 1 Processor -- start 2023-10-01T07:59:16.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.505+0000 7fd67680d700 1 -- start start 2023-10-01T07:59:16.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.506+0000 7fd67680d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd67006e570 0x7fd67006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:16.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.506+0000 7fd67680d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd67009eca0 0x7fd67006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:16.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.506+0000 7fd67680d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd670070ee0 con 0x7fd670134610 2023-10-01T07:59:16.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.506+0000 7fd67680d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd670071480 con 0x7fd67006e570 2023-10-01T07:59:16.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.506+0000 7fd67680d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd67006f3c0 con 0x7fd67009eca0 2023-10-01T07:59:16.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.506+0000 7fd66f7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd67009eca0 0x7fd67006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:16.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.506+0000 7fd66ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd67006e570 0x7fd67006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:16.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.506+0000 7fd674daa700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd670134610 0x7fd670134a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44152/0 (socket says 172.21.15.26:44152) 2023-10-01T07:59:16.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.506+0000 7fd674daa700 1 -- 172.21.15.26:0/2693783274 learned_addr learned my addr 172.21.15.26:0/2693783274 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:59:16.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.507+0000 7fd66ffff700 1 -- 172.21.15.26:0/2693783274 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd67009eca0 msgr2=0x7fd67006ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:16.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.507+0000 7fd66ffff700 1 --2- 172.21.15.26:0/2693783274 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd67009eca0 0x7fd67006ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:16.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.507+0000 7fd66ffff700 1 -- 172.21.15.26:0/2693783274 >> v1:172.21.15.26:6789/0 conn(0x7fd670134610 legacy=0x7fd670134a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:16.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.507+0000 7fd66ffff700 1 -- 172.21.15.26:0/2693783274 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd670071b90 con 0x7fd67006e570 2023-10-01T07:59:16.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.507+0000 7fd66ffff700 1 --2- 172.21.15.26:0/2693783274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd67006e570 0x7fd67006e940 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fd660009840 tx=0x7fd660009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=238d32b087c1a049 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:16.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.508+0000 7fd66effd700 1 -- 172.21.15.26:0/2693783274 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd660011830 con 0x7fd67006e570 2023-10-01T07:59:16.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.508+0000 7fd66effd700 1 -- 172.21.15.26:0/2693783274 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd660011990 con 0x7fd67006e570 2023-10-01T07:59:16.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.508+0000 7fd66effd700 1 -- 172.21.15.26:0/2693783274 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd660011d20 con 0x7fd67006e570 2023-10-01T07:59:16.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.508+0000 7fd67680d700 1 -- 172.21.15.26:0/2693783274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd67006e570 msgr2=0x7fd67006e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:16.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.508+0000 7fd67680d700 1 --2- 172.21.15.26:0/2693783274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd67006e570 0x7fd67006e940 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fd660009840 tx=0x7fd660009b50 comp rx=0 tx=0).stop 2023-10-01T07:59:16.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.508+0000 7fd67680d700 1 -- 172.21.15.26:0/2693783274 shutdown_connections 2023-10-01T07:59:16.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.509+0000 7fd67680d700 1 --2- 172.21.15.26:0/2693783274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd67006e570 0x7fd67006e940 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:16.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.509+0000 7fd67680d700 1 --2- 172.21.15.26:0/2693783274 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd67009eca0 0x7fd67006ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:16.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.509+0000 7fd67680d700 1 -- 172.21.15.26:0/2693783274 >> 172.21.15.26:0/2693783274 conn(0x7fd6700a2aa0 msgr2=0x7fd6700a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:16.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.509+0000 7fd67680d700 1 -- 172.21.15.26:0/2693783274 shutdown_connections 2023-10-01T07:59:16.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.509+0000 7fd67680d700 1 -- 172.21.15.26:0/2693783274 wait complete. 2023-10-01T07:59:16.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.510+0000 7fd67680d700 1 Processor -- start 2023-10-01T07:59:16.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.510+0000 7fd67680d700 1 -- start start 2023-10-01T07:59:16.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.511+0000 7fd67680d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd67006e570 0x7fd6701214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:16.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.511+0000 7fd67680d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd670134610 0x7fd670121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:16.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.511+0000 7fd67680d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd670121f60 0x7fd6701d2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:16.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.511+0000 7fd67680d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6701247a0 con 0x7fd670134610 2023-10-01T07:59:16.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.511+0000 7fd67680d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd670123160 con 0x7fd67006e570 2023-10-01T07:59:16.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.511+0000 7fd67680d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd670123ab0 con 0x7fd670121f60 2023-10-01T07:59:16.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.511+0000 7fd674daa700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd670121f60 0x7fd6701d2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:16.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.511+0000 7fd66f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd670134610 0x7fd670121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:16.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.511+0000 7fd674daa700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd670121f60 0x7fd6701d2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56550/0 (socket says 172.21.15.26:56550) 2023-10-01T07:59:16.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.511+0000 7fd66f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd670134610 0x7fd670121a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34572/0 (socket says 172.21.15.26:34572) 2023-10-01T07:59:16.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.511+0000 7fd674daa700 1 -- 172.21.15.26:0/22664577 learned_addr learned my addr 172.21.15.26:0/22664577 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:16.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.511+0000 7fd66ffff700 1 --2- 172.21.15.26:0/22664577 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd67006e570 0x7fd6701214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:16.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.512+0000 7fd66f7fe700 1 -- 172.21.15.26:0/22664577 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd670121f60 msgr2=0x7fd6701d2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:16.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.512+0000 7fd66f7fe700 1 --2- 172.21.15.26:0/22664577 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd670121f60 0x7fd6701d2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:16.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.512+0000 7fd66f7fe700 1 -- 172.21.15.26:0/22664577 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd67006e570 msgr2=0x7fd6701214e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:16.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.512+0000 7fd66f7fe700 1 --2- 172.21.15.26:0/22664577 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd67006e570 0x7fd6701214e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:16.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.512+0000 7fd66f7fe700 1 -- 172.21.15.26:0/22664577 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6600094a0 con 0x7fd670134610 2023-10-01T07:59:16.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.512+0000 7fd66f7fe700 1 --2- 172.21.15.26:0/22664577 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd670134610 0x7fd670121a20 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fd66400e900 tx=0x7fd66400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:16.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.512+0000 7fd66cff9700 1 -- 172.21.15.26:0/22664577 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd664013680 con 0x7fd670134610 2023-10-01T07:59:16.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.512+0000 7fd66cff9700 1 -- 172.21.15.26:0/22664577 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6640137e0 con 0x7fd670134610 2023-10-01T07:59:16.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.512+0000 7fd67680d700 1 -- 172.21.15.26:0/22664577 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6700a22e0 con 0x7fd670134610 2023-10-01T07:59:16.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.512+0000 7fd66cff9700 1 -- 172.21.15.26:0/22664577 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd664013b50 con 0x7fd670134610 2023-10-01T07:59:16.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.512+0000 7fd67680d700 1 -- 172.21.15.26:0/22664577 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd670124ad0 con 0x7fd670134610 2023-10-01T07:59:16.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.514+0000 7fd67680d700 1 -- 172.21.15.26:0/22664577 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd670124600 con 0x7fd670134610 2023-10-01T07:59:16.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.514+0000 7f7795779700 1 Processor -- start 2023-10-01T07:59:16.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.515+0000 7f7795779700 1 -- start start 2023-10-01T07:59:16.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.515+0000 7f7795779700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f779012cf60 0x7f779006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:16.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.515+0000 7f7795779700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779012f8b0 0x7f779012fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:16.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.515+0000 7f7795779700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f779012cd90 con 0x7f7790130260 2023-10-01T07:59:16.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.515+0000 7f7795779700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f779012d330 con 0x7f779012cf60 2023-10-01T07:59:16.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.515+0000 7f7795779700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77901306d0 con 0x7f779012f8b0 2023-10-01T07:59:16.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.515+0000 7f778e7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779012f8b0 0x7f779012fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:16.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.515+0000 7f778e7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779012f8b0 0x7f779012fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56566/0 (socket says 172.21.15.26:56566) 2023-10-01T07:59:16.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.515+0000 7f778e7fc700 1 -- 172.21.15.26:0/2527499067 learned_addr learned my addr 172.21.15.26:0/2527499067 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:16.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.516+0000 7f778e7fc700 1 -- 172.21.15.26:0/2527499067 >> v2:172.21.15.26:3300/0 conn(0x7f779012cf60 msgr2=0x7f779006f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:16.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.516+0000 7f778e7fc700 1 --2- 172.21.15.26:0/2527499067 >> v2:172.21.15.26:3300/0 conn(0x7f779012cf60 0x7f779006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:16.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.516+0000 7f778e7fc700 1 -- 172.21.15.26:0/2527499067 >> v1:172.21.15.26:6789/0 conn(0x7f7790130260 legacy=0x7f7790136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:16.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.516+0000 7f778e7fc700 1 -- 172.21.15.26:0/2527499067 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7790071780 con 0x7f779012f8b0 2023-10-01T07:59:16.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.516+0000 7f778e7fc700 1 --2- 172.21.15.26:0/2527499067 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779012f8b0 0x7f779012fd20 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f77840098f0 tx=0x7f7784009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=845d83a51d67d003 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:16.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.516+0000 7f778dffb700 1 -- 172.21.15.26:0/2527499067 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7784004230 con 0x7f779012f8b0 2023-10-01T07:59:16.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.516+0000 7f778dffb700 1 -- 172.21.15.26:0/2527499067 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7784004390 con 0x7f779012f8b0 2023-10-01T07:59:16.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.516+0000 7f778dffb700 1 -- 172.21.15.26:0/2527499067 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77840036a0 con 0x7f779012f8b0 2023-10-01T07:59:16.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.517+0000 7f7795779700 1 -- 172.21.15.26:0/2527499067 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779012f8b0 msgr2=0x7f779012fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:16.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.517+0000 7f7795779700 1 --2- 172.21.15.26:0/2527499067 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779012f8b0 0x7f779012fd20 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f77840098f0 tx=0x7f7784009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:16.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.517+0000 7f7795779700 1 -- 172.21.15.26:0/2527499067 shutdown_connections 2023-10-01T07:59:16.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.517+0000 7f7795779700 1 --2- 172.21.15.26:0/2527499067 >> v2:172.21.15.26:3300/0 conn(0x7f779012cf60 0x7f779006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:16.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.517+0000 7f7795779700 1 --2- 172.21.15.26:0/2527499067 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779012f8b0 0x7f779012fd20 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:16.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.517+0000 7f7795779700 1 -- 172.21.15.26:0/2527499067 >> 172.21.15.26:0/2527499067 conn(0x7f77900a2aa0 msgr2=0x7f77900a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:16.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.517+0000 7f7795779700 1 -- 172.21.15.26:0/2527499067 shutdown_connections 2023-10-01T07:59:16.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.517+0000 7f7795779700 1 -- 172.21.15.26:0/2527499067 wait complete. 2023-10-01T07:59:16.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.518+0000 7f7795779700 1 Processor -- start 2023-10-01T07:59:16.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.519+0000 7f7795779700 1 -- start start 2023-10-01T07:59:16.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.515+0000 7fd66cff9700 1 -- 172.21.15.26:0/22664577 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd664013cb0 con 0x7fd670134610 2023-10-01T07:59:16.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.515+0000 7fd66cff9700 1 -- 172.21.15.26:0/22664577 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd66403fc60 con 0x7fd670134610 2023-10-01T07:59:16.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.519+0000 7f7795779700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779012cf60 0x7f7790099d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:16.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.519+0000 7f7795779700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f779012f8b0 0x7f779009a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:16.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.519+0000 7f7795779700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7790130260 0x7f779009a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:16.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.519+0000 7f7795779700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779012f4b0 con 0x7f779012f8b0 2023-10-01T07:59:16.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.519+0000 7f7795779700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7790129fa0 con 0x7f7790130260 2023-10-01T07:59:16.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.519+0000 7f7795779700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f779009b170 con 0x7f779012cf60 2023-10-01T07:59:16.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.519+0000 7f778effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779012cf60 0x7f7790099d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:16.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.519+0000 7f778effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779012cf60 0x7f7790099d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56570/0 (socket says 172.21.15.26:56570) 2023-10-01T07:59:16.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.519+0000 7f778effd700 1 -- 172.21.15.26:0/1195122609 learned_addr learned my addr 172.21.15.26:0/1195122609 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:16.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.519+0000 7f778e7fc700 1 --2- 172.21.15.26:0/1195122609 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f779012f8b0 0x7f779009a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:16.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.519+0000 7f778f7fe700 1 --2- 172.21.15.26:0/1195122609 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7790130260 0x7f779009a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:16.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.520+0000 7f778effd700 1 -- 172.21.15.26:0/1195122609 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7790130260 msgr2=0x7f779009a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:16.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.520+0000 7f778effd700 1 --2- 172.21.15.26:0/1195122609 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7790130260 0x7f779009a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:16.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.520+0000 7f778effd700 1 -- 172.21.15.26:0/1195122609 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f779012f8b0 msgr2=0x7f779009a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:16.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.520+0000 7f778effd700 1 --2- 172.21.15.26:0/1195122609 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f779012f8b0 0x7f779009a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:16.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.520+0000 7f778effd700 1 -- 172.21.15.26:0/1195122609 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7784009550 con 0x7f779012cf60 2023-10-01T07:59:16.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.520+0000 7f778effd700 1 --2- 172.21.15.26:0/1195122609 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779012cf60 0x7f7790099d80 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f778000b530 tx=0x7f778000b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:16.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.520+0000 7f77777fe700 1 -- 172.21.15.26:0/1195122609 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7780011830 con 0x7f779012cf60 2023-10-01T07:59:16.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.520+0000 7f77777fe700 1 -- 172.21.15.26:0/1195122609 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7780011990 con 0x7f779012cf60 2023-10-01T07:59:16.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.520+0000 7f7795779700 1 -- 172.21.15.26:0/1195122609 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f779011f830 con 0x7f779012cf60 2023-10-01T07:59:16.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.520+0000 7f77777fe700 1 -- 172.21.15.26:0/1195122609 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7780011d20 con 0x7f779012cf60 2023-10-01T07:59:16.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.520+0000 7f7795779700 1 -- 172.21.15.26:0/1195122609 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f779011ed40 con 0x7f779012cf60 2023-10-01T07:59:16.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.521+0000 7fd66cff9700 1 -- 172.21.15.26:0/22664577 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd664026430 con 0x7fd670134610 2023-10-01T07:59:16.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.521+0000 7f77777fe700 1 -- 172.21.15.26:0/1195122609 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f778001a400 con 0x7f779012cf60 2023-10-01T07:59:16.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.522+0000 7f77777fe700 1 -- 172.21.15.26:0/1195122609 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f778003f710 con 0x7f779012cf60 2023-10-01T07:59:16.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.522+0000 7f7795779700 1 -- 172.21.15.26:0/1195122609 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f779011ffc0 con 0x7f779012cf60 2023-10-01T07:59:16.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.527+0000 7f77777fe700 1 -- 172.21.15.26:0/1195122609 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7780015070 con 0x7f779012cf60 2023-10-01T07:59:16.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.576+0000 7fabe76db700 1 Processor -- start 2023-10-01T07:59:16.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.577+0000 7fabe76db700 1 -- start start 2023-10-01T07:59:16.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.577+0000 7fabe76db700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabe009e930 0x7fabe009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:16.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.577+0000 7fabe76db700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabe009f650 0x7fabe0131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:16.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.577+0000 7fabe76db700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe0070940 con 0x7fabe009f240 2023-10-01T07:59:16.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.577+0000 7fabe76db700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe006fd60 con 0x7fabe009f650 2023-10-01T07:59:16.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.577+0000 7fabe76db700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabe006fa80 con 0x7fabe009e930 2023-10-01T07:59:16.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.577+0000 7fabe5c78700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabe009f650 0x7fabe0131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:16.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.577+0000 7fabe5477700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabe009e930 0x7fabe009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:16.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.577+0000 7fabe5c78700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabe009f650 0x7fabe0131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44124/0 (socket says 172.21.15.26:44124) 2023-10-01T07:59:16.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.577+0000 7fabe5477700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabe009e930 0x7fabe009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56574/0 (socket says 172.21.15.26:56574) 2023-10-01T07:59:16.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.577+0000 7fabe5c78700 1 -- 172.21.15.26:0/4267493561 learned_addr learned my addr 172.21.15.26:0/4267493561 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:16.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.577+0000 7fabe4c76700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fabe009f240 0x7fabe01317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44174/0 (socket says 172.21.15.26:44174) 2023-10-01T07:59:16.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.578+0000 7fabe5c78700 1 -- 172.21.15.26:0/4267493561 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabe009e930 msgr2=0x7fabe009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:16.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.578+0000 7fabe5c78700 1 --2- 172.21.15.26:0/4267493561 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabe009e930 0x7fabe009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:16.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.578+0000 7fabe5c78700 1 -- 172.21.15.26:0/4267493561 >> v1:172.21.15.26:6789/0 conn(0x7fabe009f240 legacy=0x7fabe01317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:16.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.578+0000 7fabd7fff700 1 -- 172.21.15.26:0/4267493561 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2838469764 0 0) 0x7fabe0070940 con 0x7fabe009f240 2023-10-01T07:59:16.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.578+0000 7fabe5c78700 1 -- 172.21.15.26:0/4267493561 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe009fb60 con 0x7fabe009f650 2023-10-01T07:59:16.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.578+0000 7fabe5c78700 1 --2- 172.21.15.26:0/4267493561 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabe009f650 0x7fabe0131f00 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fabd8009e80 tx=0x7fabd800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f31368df32639c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:16.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.578+0000 7fabd7fff700 1 -- 172.21.15.26:0/4267493561 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd800bb10 con 0x7fabe009f650 2023-10-01T07:59:16.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.578+0000 7fabd7fff700 1 -- 172.21.15.26:0/4267493561 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd800bc70 con 0x7fabe009f650 2023-10-01T07:59:16.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.578+0000 7fabd7fff700 1 -- 172.21.15.26:0/4267493561 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd80104d0 con 0x7fabe009f650 2023-10-01T07:59:16.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.579+0000 7fabe76db700 1 -- 172.21.15.26:0/4267493561 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabe009f650 msgr2=0x7fabe0131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:16.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.579+0000 7fabe76db700 1 --2- 172.21.15.26:0/4267493561 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabe009f650 0x7fabe0131f00 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fabd8009e80 tx=0x7fabd800b330 comp rx=0 tx=0).stop 2023-10-01T07:59:16.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.579+0000 7fabe76db700 1 -- 172.21.15.26:0/4267493561 shutdown_connections 2023-10-01T07:59:16.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.579+0000 7fabe76db700 1 --2- 172.21.15.26:0/4267493561 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabe009e930 0x7fabe009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:16.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.579+0000 7fabe76db700 1 --2- 172.21.15.26:0/4267493561 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabe009f650 0x7fabe0131f00 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:16.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.579+0000 7fabe76db700 1 -- 172.21.15.26:0/4267493561 >> 172.21.15.26:0/4267493561 conn(0x7fabe00a4210 msgr2=0x7fabe00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:16.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.579+0000 7fabe76db700 1 -- 172.21.15.26:0/4267493561 shutdown_connections 2023-10-01T07:59:16.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.579+0000 7fabe76db700 1 -- 172.21.15.26:0/4267493561 wait complete. 2023-10-01T07:59:16.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.580+0000 7fabe76db700 1 Processor -- start 2023-10-01T07:59:16.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.580+0000 7fabe76db700 1 -- start start 2023-10-01T07:59:16.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.581+0000 7fabe76db700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabe009e930 0x7fabe01a10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:16.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.581+0000 7fabe76db700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabe009f240 0x7fabe01a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:16.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.581+0000 7fabe76db700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabe009f650 0x7fabe01c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:16.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.581+0000 7fabe76db700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe01a3f00 con 0x7fabe009f240 2023-10-01T07:59:16.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.581+0000 7fabe76db700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe01b4f70 con 0x7fabe009e930 2023-10-01T07:59:16.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.581+0000 7fabe76db700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabe01a0b50 con 0x7fabe009f650 2023-10-01T07:59:16.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.581+0000 7fabe5477700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabe009e930 0x7fabe01a10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:16.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.581+0000 7fabe5477700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabe009e930 0x7fabe01a10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44134/0 (socket says 172.21.15.26:44134) 2023-10-01T07:59:16.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.581+0000 7fabe5477700 1 -- 172.21.15.26:0/219501602 learned_addr learned my addr 172.21.15.26:0/219501602 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:16.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.581+0000 7fabe4c76700 1 --2- 172.21.15.26:0/219501602 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabe009f240 0x7fabe01a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:16.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.581+0000 7fabe5c78700 1 --2- 172.21.15.26:0/219501602 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabe009f650 0x7fabe01c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:16.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.581+0000 7fabe5477700 1 -- 172.21.15.26:0/219501602 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabe009f650 msgr2=0x7fabe01c3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:16.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.581+0000 7fabe5477700 1 --2- 172.21.15.26:0/219501602 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabe009f650 0x7fabe01c3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:16.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.581+0000 7fabe5477700 1 -- 172.21.15.26:0/219501602 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabe009f240 msgr2=0x7fabe01a1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:16.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.581+0000 7fabe5477700 1 --2- 172.21.15.26:0/219501602 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabe009f240 0x7fabe01a1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:16.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.581+0000 7fabe5477700 1 -- 172.21.15.26:0/219501602 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd8009b30 con 0x7fabe009e930 2023-10-01T07:59:16.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.581+0000 7fabe5477700 1 --2- 172.21.15.26:0/219501602 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabe009e930 0x7fabe01a10d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fabdc00e9b0 tx=0x7fabdc00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:16.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.582+0000 7fabd5ffb700 1 -- 172.21.15.26:0/219501602 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabdc009710 con 0x7fabe009e930 2023-10-01T07:59:16.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.582+0000 7fabd5ffb700 1 -- 172.21.15.26:0/219501602 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabdc00ee50 con 0x7fabe009e930 2023-10-01T07:59:16.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.582+0000 7fabe76db700 1 -- 172.21.15.26:0/219501602 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe00a0190 con 0x7fabe009e930 2023-10-01T07:59:16.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.582+0000 7fabd5ffb700 1 -- 172.21.15.26:0/219501602 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabdc00ca50 con 0x7fabe009e930 2023-10-01T07:59:16.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.582+0000 7fabe76db700 1 -- 172.21.15.26:0/219501602 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe01a4150 con 0x7fabe009e930 2023-10-01T07:59:16.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.583+0000 7fabe76db700 1 -- 172.21.15.26:0/219501602 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe009a3c0 con 0x7fabe009e930 2023-10-01T07:59:16.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.583+0000 7fabd5ffb700 1 -- 172.21.15.26:0/219501602 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fabdc00cbb0 con 0x7fabe009e930 2023-10-01T07:59:16.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.583+0000 7fabd5ffb700 1 -- 172.21.15.26:0/219501602 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fabdc03f5a0 con 0x7fabe009e930 2023-10-01T07:59:16.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.588+0000 7fabd5ffb700 1 -- 172.21.15.26:0/219501602 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fabdc013470 con 0x7fabe009e930 2023-10-01T07:59:16.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.645+0000 7f91409aa700 1 Processor -- start 2023-10-01T07:59:16.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.645+0000 7f91409aa700 1 -- start start 2023-10-01T07:59:16.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.646+0000 7f91409aa700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f913c0a0a30 0x7f913c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:16.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.646+0000 7f91409aa700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f913c09d630 0x7f913c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:16.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.646+0000 7f91409aa700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f913c0a2a70 con 0x7f913c133930 2023-10-01T07:59:16.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.646+0000 7f91409aa700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f913c0a01d0 con 0x7f913c09d630 2023-10-01T07:59:16.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.646+0000 7f91409aa700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f913c09e2b0 con 0x7f913c0a0a30 2023-10-01T07:59:16.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.646+0000 7f9139d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f913c09d630 0x7f913c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:16.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.646+0000 7f9139d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f913c09d630 0x7f913c0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34606/0 (socket says 172.21.15.26:34606) 2023-10-01T07:59:16.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.646+0000 7f9139d9b700 1 -- 172.21.15.26:0/3727937640 learned_addr learned my addr 172.21.15.26:0/3727937640 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:16.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.646+0000 7f913ad9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f913c133930 0x7f913c133db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44176/0 (socket says 172.21.15.26:44176) 2023-10-01T07:59:16.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.646+0000 7f913a59c700 1 --2- 172.21.15.26:0/3727937640 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f913c0a0a30 0x7f913c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:16.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.647+0000 7f9139d9b700 1 -- 172.21.15.26:0/3727937640 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f913c0a0a30 msgr2=0x7f913c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:16.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.647+0000 7f9139d9b700 1 --2- 172.21.15.26:0/3727937640 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f913c0a0a30 0x7f913c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:16.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.647+0000 7f9139d9b700 1 -- 172.21.15.26:0/3727937640 >> v1:172.21.15.26:6789/0 conn(0x7f913c133930 legacy=0x7f913c133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:16.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.647+0000 7f913959a700 1 -- 172.21.15.26:0/3727937640 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 377099622 0 0) 0x7f913c0a2a70 con 0x7f913c133930 2023-10-01T07:59:16.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.647+0000 7f9139d9b700 1 -- 172.21.15.26:0/3727937640 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913c09dc50 con 0x7f913c09d630 2023-10-01T07:59:16.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.647+0000 7f9139d9b700 1 --2- 172.21.15.26:0/3727937640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f913c09d630 0x7f913c0a1340 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f91300098f0 tx=0x7f9130009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32b4b24b9f78e3a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:16.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.647+0000 7f913959a700 1 -- 172.21.15.26:0/3727937640 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9130011830 con 0x7f913c09d630 2023-10-01T07:59:16.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.647+0000 7f913959a700 1 -- 172.21.15.26:0/3727937640 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9130011990 con 0x7f913c09d630 2023-10-01T07:59:16.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.647+0000 7f913959a700 1 -- 172.21.15.26:0/3727937640 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9130011d20 con 0x7f913c09d630 2023-10-01T07:59:16.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.648+0000 7f91409aa700 1 -- 172.21.15.26:0/3727937640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f913c09d630 msgr2=0x7f913c0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:16.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.648+0000 7f91409aa700 1 --2- 172.21.15.26:0/3727937640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f913c09d630 0x7f913c0a1340 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f91300098f0 tx=0x7f9130009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:16.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.648+0000 7f91409aa700 1 -- 172.21.15.26:0/3727937640 shutdown_connections 2023-10-01T07:59:16.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.648+0000 7f91409aa700 1 --2- 172.21.15.26:0/3727937640 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f913c0a0a30 0x7f913c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:16.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.648+0000 7f91409aa700 1 --2- 172.21.15.26:0/3727937640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f913c09d630 0x7f913c0a1340 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:16.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.648+0000 7f91409aa700 1 -- 172.21.15.26:0/3727937640 >> 172.21.15.26:0/3727937640 conn(0x7f913c0a3050 msgr2=0x7f913c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:16.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.648+0000 7f91409aa700 1 -- 172.21.15.26:0/3727937640 shutdown_connections 2023-10-01T07:59:16.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.648+0000 7f91409aa700 1 -- 172.21.15.26:0/3727937640 wait complete. 2023-10-01T07:59:16.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.650+0000 7f91409aa700 1 Processor -- start 2023-10-01T07:59:16.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.650+0000 7f91409aa700 1 -- start start 2023-10-01T07:59:16.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.650+0000 7f91409aa700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f913c09d630 0x7f913c11f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:16.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.650+0000 7f91409aa700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f913c0a0a30 0x7f913c11f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:16.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.650+0000 7f91409aa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f913c133930 0x7f913c1c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:16.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.650+0000 7f91409aa700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913c1223a0 con 0x7f913c133930 2023-10-01T07:59:16.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.650+0000 7f91409aa700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f913c122580 con 0x7f913c0a0a30 2023-10-01T07:59:16.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.650+0000 7f91409aa700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f913c1333f0 con 0x7f913c09d630 2023-10-01T07:59:16.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.650+0000 7f913ad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f913c133930 0x7f913c1c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:16.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.650+0000 7f913ad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f913c133930 0x7f913c1c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34620/0 (socket says 172.21.15.26:34620) 2023-10-01T07:59:16.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.650+0000 7f913ad9d700 1 -- 172.21.15.26:0/2708217313 learned_addr learned my addr 172.21.15.26:0/2708217313 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:16.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.650+0000 7f9139d9b700 1 --2- 172.21.15.26:0/2708217313 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f913c0a0a30 0x7f913c11f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:16.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.651+0000 7f913ad9d700 1 -- 172.21.15.26:0/2708217313 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f913c09d630 msgr2=0x7f913c11f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:16.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.651+0000 7f913ad9d700 1 --2- 172.21.15.26:0/2708217313 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f913c09d630 0x7f913c11f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:16.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.651+0000 7f913ad9d700 1 -- 172.21.15.26:0/2708217313 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f913c0a0a30 msgr2=0x7f913c11f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:16.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.651+0000 7f913ad9d700 1 --2- 172.21.15.26:0/2708217313 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f913c0a0a30 0x7f913c11f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:16.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.651+0000 7f913ad9d700 1 -- 172.21.15.26:0/2708217313 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9130009550 con 0x7f913c133930 2023-10-01T07:59:16.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.651+0000 7f913ad9d700 1 --2- 172.21.15.26:0/2708217313 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f913c133930 0x7f913c1c8200 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f913400cc70 tx=0x7f913400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:16.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.651+0000 7f912affd700 1 -- 172.21.15.26:0/2708217313 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913400ab70 con 0x7f913c133930 2023-10-01T07:59:16.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.651+0000 7f912affd700 1 -- 172.21.15.26:0/2708217313 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913400acf0 con 0x7f913c133930 2023-10-01T07:59:16.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.651+0000 7f91409aa700 1 -- 172.21.15.26:0/2708217313 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f913c11feb0 con 0x7f913c133930 2023-10-01T07:59:16.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.651+0000 7f91409aa700 1 -- 172.21.15.26:0/2708217313 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f913c09d380 con 0x7f913c133930 2023-10-01T07:59:16.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.651+0000 7f912affd700 1 -- 172.21.15.26:0/2708217313 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9134007310 con 0x7f913c133930 2023-10-01T07:59:16.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.653+0000 7f91409aa700 1 -- 172.21.15.26:0/2708217313 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f913c0747f0 con 0x7f913c133930 2023-10-01T07:59:16.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.653+0000 7f912affd700 1 -- 172.21.15.26:0/2708217313 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9134007470 con 0x7f913c133930 2023-10-01T07:59:16.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.653+0000 7f912affd700 1 -- 172.21.15.26:0/2708217313 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9134042510 con 0x7f913c133930 2023-10-01T07:59:16.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.658+0000 7f912affd700 1 -- 172.21.15.26:0/2708217313 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f913400ae60 con 0x7f913c133930 2023-10-01T07:59:16.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.740+0000 7f7795779700 1 -- 172.21.15.26:0/1195122609 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7790074ea0 con 0x7f779012cf60 2023-10-01T07:59:16.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.741+0000 7f77777fe700 1 -- 172.21.15.26:0/1195122609 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7780028090 con 0x7f779012cf60 2023-10-01T07:59:16.742 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:16.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.744+0000 7f7795779700 1 -- 172.21.15.26:0/1195122609 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779012cf60 msgr2=0x7f7790099d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:16.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.744+0000 7f7795779700 1 --2- 172.21.15.26:0/1195122609 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779012cf60 0x7f7790099d80 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f778000b530 tx=0x7f778000b840 comp rx=0 tx=0).stop 2023-10-01T07:59:16.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.744+0000 7f7795779700 1 -- 172.21.15.26:0/1195122609 shutdown_connections 2023-10-01T07:59:16.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.744+0000 7f7795779700 1 --2- 172.21.15.26:0/1195122609 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7790130260 0x7f779009a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:16.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.744+0000 7f7795779700 1 --2- 172.21.15.26:0/1195122609 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779012cf60 0x7f7790099d80 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:16.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.744+0000 7f7795779700 1 --2- 172.21.15.26:0/1195122609 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f779012f8b0 0x7f779009a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:16.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.744+0000 7f7795779700 1 -- 172.21.15.26:0/1195122609 >> 172.21.15.26:0/1195122609 conn(0x7f77900a2aa0 msgr2=0x7f779009e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:16.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.745+0000 7f7795779700 1 -- 172.21.15.26:0/1195122609 shutdown_connections 2023-10-01T07:59:16.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.745+0000 7f7795779700 1 -- 172.21.15.26:0/1195122609 wait complete. 2023-10-01T07:59:16.764 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:16.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.774+0000 7fd67680d700 1 -- 172.21.15.26:0/22664577 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd670124600 con 0x7fd670134610 2023-10-01T07:59:16.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.775+0000 7fd66cff9700 1 -- 172.21.15.26:0/22664577 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd670124600 con 0x7fd670134610 2023-10-01T07:59:16.775 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:16.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.777+0000 7fd67680d700 1 -- 172.21.15.26:0/22664577 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd670134610 msgr2=0x7fd670121a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:16.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.777+0000 7fd67680d700 1 --2- 172.21.15.26:0/22664577 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd670134610 0x7fd670121a20 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fd66400e900 tx=0x7fd66400ec10 comp rx=0 tx=0).stop 2023-10-01T07:59:16.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.777+0000 7fd67680d700 1 -- 172.21.15.26:0/22664577 shutdown_connections 2023-10-01T07:59:16.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.777+0000 7fd67680d700 1 --2- 172.21.15.26:0/22664577 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd670121f60 0x7fd6701d2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:16.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.777+0000 7fd67680d700 1 --2- 172.21.15.26:0/22664577 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd67006e570 0x7fd6701214e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:16.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.777+0000 7fd67680d700 1 --2- 172.21.15.26:0/22664577 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd670134610 0x7fd670121a20 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:16.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.777+0000 7fd67680d700 1 -- 172.21.15.26:0/22664577 >> 172.21.15.26:0/22664577 conn(0x7fd6700a2aa0 msgr2=0x7fd6701bf280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:16.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.777+0000 7fd67680d700 1 -- 172.21.15.26:0/22664577 shutdown_connections 2023-10-01T07:59:16.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.777+0000 7fd67680d700 1 -- 172.21.15.26:0/22664577 wait complete. 2023-10-01T07:59:16.792 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:16.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.807+0000 7fabe76db700 1 -- 172.21.15.26:0/219501602 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fabe01a1b50 con 0x7fabe009e930 2023-10-01T07:59:16.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.808+0000 7fabd5ffb700 1 -- 172.21.15.26:0/219501602 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fabdc01b3b0 con 0x7fabe009e930 2023-10-01T07:59:16.808 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:16.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.810+0000 7fabe76db700 1 -- 172.21.15.26:0/219501602 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabe009e930 msgr2=0x7fabe01a10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:16.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.810+0000 7fabe76db700 1 --2- 172.21.15.26:0/219501602 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabe009e930 0x7fabe01a10d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fabdc00e9b0 tx=0x7fabdc00ecc0 comp rx=0 tx=0).stop 2023-10-01T07:59:16.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.810+0000 7fabe76db700 1 -- 172.21.15.26:0/219501602 shutdown_connections 2023-10-01T07:59:16.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.810+0000 7fabe76db700 1 --2- 172.21.15.26:0/219501602 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fabe009f650 0x7fabe01c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:16.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.810+0000 7fabe76db700 1 --2- 172.21.15.26:0/219501602 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fabe009e930 0x7fabe01a10d0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:16.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.810+0000 7fabe76db700 1 --2- 172.21.15.26:0/219501602 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabe009f240 0x7fabe01a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:16.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.810+0000 7fabe76db700 1 -- 172.21.15.26:0/219501602 >> 172.21.15.26:0/219501602 conn(0x7fabe00a4210 msgr2=0x7fabe00a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:16.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.810+0000 7fabe76db700 1 -- 172.21.15.26:0/219501602 shutdown_connections 2023-10-01T07:59:16.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.810+0000 7fabe76db700 1 -- 172.21.15.26:0/219501602 wait complete. 2023-10-01T07:59:16.824 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:16.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.865+0000 7f91409aa700 1 -- 172.21.15.26:0/2708217313 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f913c0a4400 con 0x7f913c133930 2023-10-01T07:59:16.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.866+0000 7f912affd700 1 -- 172.21.15.26:0/2708217313 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9134010300 con 0x7f913c133930 2023-10-01T07:59:16.867 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:16.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.868+0000 7f91409aa700 1 -- 172.21.15.26:0/2708217313 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f913c133930 msgr2=0x7f913c1c8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:16.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.868+0000 7f91409aa700 1 --2- 172.21.15.26:0/2708217313 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f913c133930 0x7f913c1c8200 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f913400cc70 tx=0x7f913400cf80 comp rx=0 tx=0).stop 2023-10-01T07:59:16.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.868+0000 7f91409aa700 1 -- 172.21.15.26:0/2708217313 shutdown_connections 2023-10-01T07:59:16.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.868+0000 7f91409aa700 1 --2- 172.21.15.26:0/2708217313 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f913c133930 0x7f913c1c8200 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:16.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.868+0000 7f91409aa700 1 --2- 172.21.15.26:0/2708217313 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f913c09d630 0x7f913c11f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:16.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.868+0000 7f91409aa700 1 --2- 172.21.15.26:0/2708217313 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f913c0a0a30 0x7f913c11f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:16.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.868+0000 7f91409aa700 1 -- 172.21.15.26:0/2708217313 >> 172.21.15.26:0/2708217313 conn(0x7f913c0a3050 msgr2=0x7f913c1bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:16.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.868+0000 7f91409aa700 1 -- 172.21.15.26:0/2708217313 shutdown_connections 2023-10-01T07:59:16.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:16.868+0000 7f91409aa700 1 -- 172.21.15.26:0/2708217313 wait complete. 2023-10-01T07:59:16.882 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:17.765 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:17.793 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:17.825 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:17.883 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:17.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.925+0000 7f6946936700 1 Processor -- start 2023-10-01T07:59:17.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.925+0000 7f6946936700 1 -- start start 2023-10-01T07:59:17.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.926+0000 7f6946936700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f694006f5d0 0x7f694012cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:17.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.926+0000 7f6946936700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6940066880 0x7f694012ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:17.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.926+0000 7f6946936700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f694012d2d0 con 0x7f6940066410 2023-10-01T07:59:17.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.926+0000 7f6946936700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6940071780 con 0x7f694006f5d0 2023-10-01T07:59:17.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.926+0000 7f6946936700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f694006f9a0 con 0x7f6940066880 2023-10-01T07:59:17.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.926+0000 7f6944ed3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6940066880 0x7f694012ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:17.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.926+0000 7f693ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f694006f5d0 0x7f694012cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:17.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.926+0000 7f693ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f694006f5d0 0x7f694012cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44152/0 (socket says 172.21.15.26:44152) 2023-10-01T07:59:17.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.926+0000 7f6944ed3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6940066880 0x7f694012ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56598/0 (socket says 172.21.15.26:56598) 2023-10-01T07:59:17.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.926+0000 7f693ffff700 1 -- 172.21.15.26:0/114865439 learned_addr learned my addr 172.21.15.26:0/114865439 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:17.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.926+0000 7f693ffff700 1 -- 172.21.15.26:0/114865439 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6940066880 msgr2=0x7f694012ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:17.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.926+0000 7f693ffff700 1 --2- 172.21.15.26:0/114865439 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6940066880 0x7f694012ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:17.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.926+0000 7f693ffff700 1 -- 172.21.15.26:0/114865439 >> v1:172.21.15.26:6789/0 conn(0x7f6940066410 legacy=0x7f694012f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:17.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.926+0000 7f693f7fe700 1 -- 172.21.15.26:0/114865439 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3399051249 0 0) 0x7f694012d2d0 con 0x7f6940066410 2023-10-01T07:59:17.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.926+0000 7f693ffff700 1 -- 172.21.15.26:0/114865439 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6940071a40 con 0x7f694006f5d0 2023-10-01T07:59:17.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.927+0000 7f693ffff700 1 --2- 172.21.15.26:0/114865439 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f694006f5d0 0x7f694012cd90 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f6930009920 tx=0x7f6930009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71cb363e61816689 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:17.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.927+0000 7f693f7fe700 1 -- 172.21.15.26:0/114865439 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6930011830 con 0x7f694006f5d0 2023-10-01T07:59:17.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.927+0000 7f693f7fe700 1 -- 172.21.15.26:0/114865439 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6930011990 con 0x7f694006f5d0 2023-10-01T07:59:17.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.927+0000 7f693f7fe700 1 -- 172.21.15.26:0/114865439 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6930011d20 con 0x7f694006f5d0 2023-10-01T07:59:17.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.928+0000 7f6946936700 1 -- 172.21.15.26:0/114865439 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f694006f5d0 msgr2=0x7f694012cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:17.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.928+0000 7f6946936700 1 --2- 172.21.15.26:0/114865439 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f694006f5d0 0x7f694012cd90 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f6930009920 tx=0x7f6930009c30 comp rx=0 tx=0).stop 2023-10-01T07:59:17.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.928+0000 7f6946936700 1 -- 172.21.15.26:0/114865439 shutdown_connections 2023-10-01T07:59:17.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.928+0000 7f6946936700 1 --2- 172.21.15.26:0/114865439 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6940066880 0x7f694012ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:17.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.928+0000 7f6946936700 1 --2- 172.21.15.26:0/114865439 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f694006f5d0 0x7f694012cd90 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:17.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.928+0000 7f6946936700 1 -- 172.21.15.26:0/114865439 >> 172.21.15.26:0/114865439 conn(0x7f69400a2aa0 msgr2=0x7f69400a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:17.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.928+0000 7f6946936700 1 -- 172.21.15.26:0/114865439 shutdown_connections 2023-10-01T07:59:17.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.928+0000 7f6946936700 1 -- 172.21.15.26:0/114865439 wait complete. 2023-10-01T07:59:17.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.930+0000 7f6946936700 1 Processor -- start 2023-10-01T07:59:17.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.930+0000 7f6946936700 1 -- start start 2023-10-01T07:59:17.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.930+0000 7f6946936700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6940066410 0x7f694009bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:17.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.930+0000 7f6946936700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6940066880 0x7f694009c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:17.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.930+0000 7f6946936700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f694006f5d0 0x7f69401c5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:17.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.930+0000 7f6946936700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694009e570 con 0x7f6940066880 2023-10-01T07:59:17.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.930+0000 7f6946936700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6940129fa0 con 0x7f6940066410 2023-10-01T07:59:17.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.930+0000 7f6946936700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f694009ec10 con 0x7f694006f5d0 2023-10-01T07:59:17.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.931+0000 7f693ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6940066410 0x7f694009bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:17.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.931+0000 7f693ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6940066410 0x7f694009bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44156/0 (socket says 172.21.15.26:44156) 2023-10-01T07:59:17.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.931+0000 7f693ffff700 1 -- 172.21.15.26:0/2032227902 learned_addr learned my addr 172.21.15.26:0/2032227902 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:17.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.931+0000 7f6937fff700 1 --2- 172.21.15.26:0/2032227902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6940066880 0x7f694009c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:17.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.931+0000 7f6944ed3700 1 --2- 172.21.15.26:0/2032227902 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f694006f5d0 0x7f69401c5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:17.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.931+0000 7f693ffff700 1 -- 172.21.15.26:0/2032227902 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f694006f5d0 msgr2=0x7f69401c5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:17.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.931+0000 7f693ffff700 1 --2- 172.21.15.26:0/2032227902 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f694006f5d0 0x7f69401c5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:17.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.931+0000 7f693ffff700 1 -- 172.21.15.26:0/2032227902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6940066880 msgr2=0x7f694009c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:17.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.931+0000 7f693ffff700 1 --2- 172.21.15.26:0/2032227902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6940066880 0x7f694009c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:17.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.931+0000 7f693ffff700 1 -- 172.21.15.26:0/2032227902 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6930009550 con 0x7f6940066410 2023-10-01T07:59:17.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.931+0000 7f6944ed3700 1 --2- 172.21.15.26:0/2032227902 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f694006f5d0 0x7f69401c5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:59:17.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.932+0000 7f693ffff700 1 --2- 172.21.15.26:0/2032227902 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6940066410 0x7f694009bb80 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f6930009c70 tx=0x7f6930004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:17.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.932+0000 7f693d7fa700 1 -- 172.21.15.26:0/2032227902 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6930004590 con 0x7f6940066410 2023-10-01T07:59:17.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.932+0000 7f693d7fa700 1 -- 172.21.15.26:0/2032227902 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69300036a0 con 0x7f6940066410 2023-10-01T07:59:17.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.932+0000 7f6946936700 1 -- 172.21.15.26:0/2032227902 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f694009b530 con 0x7f6940066410 2023-10-01T07:59:17.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.932+0000 7f6946936700 1 -- 172.21.15.26:0/2032227902 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f694009cc00 con 0x7f6940066410 2023-10-01T07:59:17.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.932+0000 7f693d7fa700 1 -- 172.21.15.26:0/2032227902 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6930003a50 con 0x7f6940066410 2023-10-01T07:59:17.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.933+0000 7f693d7fa700 1 -- 172.21.15.26:0/2032227902 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6930003bb0 con 0x7f6940066410 2023-10-01T07:59:17.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.933+0000 7f693d7fa700 1 -- 172.21.15.26:0/2032227902 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6930040610 con 0x7f6940066410 2023-10-01T07:59:17.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.935+0000 7f6946936700 1 -- 172.21.15.26:0/2032227902 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69240052e0 con 0x7f6940066410 2023-10-01T07:59:17.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.940+0000 7f693d7fa700 1 -- 172.21.15.26:0/2032227902 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6930003e60 con 0x7f6940066410 2023-10-01T07:59:17.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.956+0000 7f62d7ab5700 1 Processor -- start 2023-10-01T07:59:17.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.956+0000 7f62d7ab5700 1 -- start start 2023-10-01T07:59:17.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.956+0000 7f62d7ab5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62d009d6f0 0x7f62d009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:17.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.956+0000 7f62d7ab5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62d009e000 0x7f62d01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:17.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.956+0000 7f62d7ab5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62d009b120 con 0x7f62d009e410 2023-10-01T07:59:17.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.956+0000 7f62d7ab5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d006b460 con 0x7f62d009e000 2023-10-01T07:59:17.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.956+0000 7f62d7ab5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62d009a7e0 con 0x7f62d009d6f0 2023-10-01T07:59:17.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.957+0000 7f62d5851700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62d009d6f0 0x7f62d009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:17.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.957+0000 7f62d5050700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62d009e000 0x7f62d01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:17.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.957+0000 7f62d5050700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62d009e000 0x7f62d01339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44158/0 (socket says 172.21.15.26:44158) 2023-10-01T07:59:17.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.957+0000 7f62d5851700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62d009d6f0 0x7f62d009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56610/0 (socket says 172.21.15.26:56610) 2023-10-01T07:59:17.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.957+0000 7f62d5050700 1 -- 172.21.15.26:0/3316139622 learned_addr learned my addr 172.21.15.26:0/3316139622 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:17.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.957+0000 7f62d5851700 1 -- 172.21.15.26:0/3316139622 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62d009e000 msgr2=0x7f62d01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:17.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.957+0000 7f62d5851700 1 --2- 172.21.15.26:0/3316139622 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62d009e000 0x7f62d01339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:17.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.957+0000 7f62d5851700 1 -- 172.21.15.26:0/3316139622 >> v1:172.21.15.26:6789/0 conn(0x7f62d009e410 legacy=0x7f62d0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:17.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.957+0000 7f62d5851700 1 -- 172.21.15.26:0/3316139622 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d009a500 con 0x7f62d009d6f0 2023-10-01T07:59:17.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.957+0000 7f62d5050700 1 --2- 172.21.15.26:0/3316139622 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62d009e000 0x7f62d01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:17.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.957+0000 7f62d5851700 1 --2- 172.21.15.26:0/3316139622 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62d009d6f0 0x7f62d009dac0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f62cc0098a0 tx=0x7f62cc009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f993bbd2bddafc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:17.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.957+0000 7f62d484f700 1 -- 172.21.15.26:0/3316139622 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62cc004230 con 0x7f62d009d6f0 2023-10-01T07:59:17.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.958+0000 7f62d484f700 1 -- 172.21.15.26:0/3316139622 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62cc004390 con 0x7f62d009d6f0 2023-10-01T07:59:17.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.958+0000 7f62d484f700 1 -- 172.21.15.26:0/3316139622 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62cc0036a0 con 0x7f62d009d6f0 2023-10-01T07:59:17.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.958+0000 7f62d7ab5700 1 -- 172.21.15.26:0/3316139622 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62d009d6f0 msgr2=0x7f62d009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:17.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.958+0000 7f62d7ab5700 1 --2- 172.21.15.26:0/3316139622 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62d009d6f0 0x7f62d009dac0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f62cc0098a0 tx=0x7f62cc009bb0 comp rx=0 tx=0).stop 2023-10-01T07:59:17.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.958+0000 7f62d7ab5700 1 -- 172.21.15.26:0/3316139622 shutdown_connections 2023-10-01T07:59:17.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.958+0000 7f62d7ab5700 1 --2- 172.21.15.26:0/3316139622 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62d009d6f0 0x7f62d009dac0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:17.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.958+0000 7f62d7ab5700 1 --2- 172.21.15.26:0/3316139622 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62d009e000 0x7f62d01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:17.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.958+0000 7f62d7ab5700 1 -- 172.21.15.26:0/3316139622 >> 172.21.15.26:0/3316139622 conn(0x7f62d0066f50 msgr2=0x7f62d009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:17.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.958+0000 7f62d7ab5700 1 -- 172.21.15.26:0/3316139622 shutdown_connections 2023-10-01T07:59:17.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.959+0000 7f62d7ab5700 1 -- 172.21.15.26:0/3316139622 wait complete. 2023-10-01T07:59:17.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.959+0000 7f62d7ab5700 1 Processor -- start 2023-10-01T07:59:17.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.960+0000 7f62d7ab5700 1 -- start start 2023-10-01T07:59:17.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.960+0000 7f62d7ab5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62d009d6f0 0x7f62d01225c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:17.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.960+0000 7f62d7ab5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62d009e000 0x7f62d0122b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:17.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.960+0000 7f62d7ab5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62d009e410 0x7f62d0123040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:17.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.960+0000 7f62d7ab5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d0125d20 con 0x7f62d009e000 2023-10-01T07:59:17.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.960+0000 7f62d7ab5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d00a1d20 con 0x7f62d009d6f0 2023-10-01T07:59:17.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.960+0000 7f62d7ab5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62d009c710 con 0x7f62d009e410 2023-10-01T07:59:17.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.960+0000 7f62d5851700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62d009d6f0 0x7f62d01225c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:17.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.960+0000 7f62d5851700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62d009d6f0 0x7f62d01225c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44172/0 (socket says 172.21.15.26:44172) 2023-10-01T07:59:17.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.960+0000 7f62d5851700 1 -- 172.21.15.26:0/554501182 learned_addr learned my addr 172.21.15.26:0/554501182 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:17.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.960+0000 7f62d5050700 1 --2- 172.21.15.26:0/554501182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62d009e000 0x7f62d0122b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:17.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.960+0000 7f62d6052700 1 --2- 172.21.15.26:0/554501182 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62d009e410 0x7f62d0123040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:17.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.961+0000 7f62d5851700 1 -- 172.21.15.26:0/554501182 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62d009e410 msgr2=0x7f62d0123040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:17.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.961+0000 7f62d5851700 1 --2- 172.21.15.26:0/554501182 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62d009e410 0x7f62d0123040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:17.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.961+0000 7f62d5851700 1 -- 172.21.15.26:0/554501182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62d009e000 msgr2=0x7f62d0122b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:17.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.961+0000 7f62d5851700 1 --2- 172.21.15.26:0/554501182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62d009e000 0x7f62d0122b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:17.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.961+0000 7f62d5851700 1 -- 172.21.15.26:0/554501182 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c0009550 con 0x7f62d009d6f0 2023-10-01T07:59:17.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.961+0000 7f62d5851700 1 --2- 172.21.15.26:0/554501182 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62d009d6f0 0x7f62d01225c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f62cc009bf0 tx=0x7f62cc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:17.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.961+0000 7f62c67fc700 1 -- 172.21.15.26:0/554501182 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62cc003ea0 con 0x7f62d009d6f0 2023-10-01T07:59:17.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.961+0000 7f62c67fc700 1 -- 172.21.15.26:0/554501182 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62cc01e070 con 0x7f62d009d6f0 2023-10-01T07:59:17.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.961+0000 7f62d7ab5700 1 -- 172.21.15.26:0/554501182 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62cc0094a0 con 0x7f62d009d6f0 2023-10-01T07:59:17.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.961+0000 7f62c67fc700 1 -- 172.21.15.26:0/554501182 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62cc011850 con 0x7f62d009d6f0 2023-10-01T07:59:17.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.961+0000 7f62d7ab5700 1 -- 172.21.15.26:0/554501182 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62d0126790 con 0x7f62d009d6f0 2023-10-01T07:59:17.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.962+0000 7f62d7ab5700 1 -- 172.21.15.26:0/554501182 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62d0074ea0 con 0x7f62d009d6f0 2023-10-01T07:59:17.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.963+0000 7f62c67fc700 1 -- 172.21.15.26:0/554501182 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f62cc0119b0 con 0x7f62d009d6f0 2023-10-01T07:59:17.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.963+0000 7f62c67fc700 1 -- 172.21.15.26:0/554501182 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f62cc040c40 con 0x7f62d009d6f0 2023-10-01T07:59:17.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:17.968+0000 7f62c67fc700 1 -- 172.21.15.26:0/554501182 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f62cc018350 con 0x7f62d009d6f0 2023-10-01T07:59:18.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.023+0000 7f94988be700 1 Processor -- start 2023-10-01T07:59:18.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.023+0000 7f94988be700 1 -- start start 2023-10-01T07:59:18.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.024+0000 7f94988be700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f949409d6f0 0x7f949409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:18.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.024+0000 7f94988be700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f949409e000 0x7f94941339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:18.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.024+0000 7f94988be700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f949409b120 con 0x7f949409e410 2023-10-01T07:59:18.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.024+0000 7f94988be700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f949406b460 con 0x7f949409e000 2023-10-01T07:59:18.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.024+0000 7f94988be700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f949409a7e0 con 0x7f949409d6f0 2023-10-01T07:59:18.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.024+0000 7f949259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f949409d6f0 0x7f949409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:18.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.024+0000 7f9492d9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f949409e410 0x7f9494133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44194/0 (socket says 172.21.15.26:44194) 2023-10-01T07:59:18.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.024+0000 7f9492d9d700 1 -- 172.21.15.26:0/3254180541 learned_addr learned my addr 172.21.15.26:0/3254180541 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:59:18.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.024+0000 7f949259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f949409d6f0 0x7f949409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44182/0 (socket says 172.21.15.26:44182) 2023-10-01T07:59:18.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.024+0000 7f9491d9b700 1 --2- 172.21.15.26:0/3254180541 >> v2:172.21.15.26:3300/0 conn(0x7f949409e000 0x7f94941339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:18.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.024+0000 7f9491d9b700 1 -- 172.21.15.26:0/3254180541 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f949409d6f0 msgr2=0x7f949409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:18.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.024+0000 7f9491d9b700 1 --2- 172.21.15.26:0/3254180541 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f949409d6f0 0x7f949409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:18.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.024+0000 7f9491d9b700 1 -- 172.21.15.26:0/3254180541 >> v1:172.21.15.26:6789/0 conn(0x7f949409e410 legacy=0x7f9494133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:18.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.025+0000 7f9491d9b700 1 -- 172.21.15.26:0/3254180541 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949409a500 con 0x7f949409e000 2023-10-01T07:59:18.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.024+0000 7f949159a700 1 -- 172.21.15.26:0/3254180541 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3302438872 0 0) 0x7f949409b120 con 0x7f949409e410 2023-10-01T07:59:18.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.025+0000 7f949259c700 1 --2- 172.21.15.26:0/3254180541 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f949409d6f0 0x7f949409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:18.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.025+0000 7f9491d9b700 1 --2- 172.21.15.26:0/3254180541 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f949409e000 0x7f94941339f0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f9488009840 tx=0x7f9488009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64168284734dba1 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:18.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.025+0000 7f949159a700 1 -- 172.21.15.26:0/3254180541 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9488011830 con 0x7f949409e000 2023-10-01T07:59:18.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.025+0000 7f949159a700 1 -- 172.21.15.26:0/3254180541 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9488011990 con 0x7f949409e000 2023-10-01T07:59:18.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.025+0000 7f949159a700 1 -- 172.21.15.26:0/3254180541 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9488011d20 con 0x7f949409e000 2023-10-01T07:59:18.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.026+0000 7f94988be700 1 -- 172.21.15.26:0/3254180541 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f949409e000 msgr2=0x7f94941339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:18.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.026+0000 7f94988be700 1 --2- 172.21.15.26:0/3254180541 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f949409e000 0x7f94941339f0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f9488009840 tx=0x7f9488009b50 comp rx=0 tx=0).stop 2023-10-01T07:59:18.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.026+0000 7f94988be700 1 -- 172.21.15.26:0/3254180541 shutdown_connections 2023-10-01T07:59:18.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.026+0000 7f94988be700 1 --2- 172.21.15.26:0/3254180541 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f949409d6f0 0x7f949409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:18.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.026+0000 7f94988be700 1 --2- 172.21.15.26:0/3254180541 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f949409e000 0x7f94941339f0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:18.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.026+0000 7f94988be700 1 -- 172.21.15.26:0/3254180541 >> 172.21.15.26:0/3254180541 conn(0x7f9494066f50 msgr2=0x7f949409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:18.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.026+0000 7f94988be700 1 -- 172.21.15.26:0/3254180541 shutdown_connections 2023-10-01T07:59:18.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.026+0000 7f94988be700 1 -- 172.21.15.26:0/3254180541 wait complete. 2023-10-01T07:59:18.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.027+0000 7f94988be700 1 Processor -- start 2023-10-01T07:59:18.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.027+0000 7f94988be700 1 -- start start 2023-10-01T07:59:18.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.028+0000 7f94988be700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f949409d6f0 0x7f94941a5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:18.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.028+0000 7f94988be700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f949409e000 0x7f94941a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:18.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.028+0000 7f94988be700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f949409e410 0x7f94941a6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:18.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.028+0000 7f94988be700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94941a9150 con 0x7f949409e410 2023-10-01T07:59:18.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.028+0000 7f94988be700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f949409c710 con 0x7f949409d6f0 2023-10-01T07:59:18.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.028+0000 7f94988be700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f94940a2e40 con 0x7f949409e000 2023-10-01T07:59:18.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.028+0000 7f949259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f949409d6f0 0x7f94941a5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:18.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.028+0000 7f9492d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f949409e410 0x7f94941a6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:18.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.028+0000 7f949259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f949409d6f0 0x7f94941a5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44186/0 (socket says 172.21.15.26:44186) 2023-10-01T07:59:18.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.028+0000 7f949259c700 1 -- 172.21.15.26:0/4072265878 learned_addr learned my addr 172.21.15.26:0/4072265878 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:18.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.028+0000 7f949259c700 1 -- 172.21.15.26:0/4072265878 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f949409e000 msgr2=0x7f94941a63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:18.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.028+0000 7f949259c700 1 --2- 172.21.15.26:0/4072265878 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f949409e000 0x7f94941a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:18.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.028+0000 7f949259c700 1 -- 172.21.15.26:0/4072265878 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f949409e410 msgr2=0x7f94941a6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:18.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.028+0000 7f949259c700 1 --2- 172.21.15.26:0/4072265878 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f949409e410 0x7f94941a6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:18.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.028+0000 7f949259c700 1 -- 172.21.15.26:0/4072265878 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94840094a0 con 0x7f949409d6f0 2023-10-01T07:59:18.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.029+0000 7f949259c700 1 --2- 172.21.15.26:0/4072265878 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f949409d6f0 0x7f94941a5ea0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f948400ebe0 tx=0x7f948400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:18.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.029+0000 7f9482ffd700 1 -- 172.21.15.26:0/4072265878 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948400c910 con 0x7f949409d6f0 2023-10-01T07:59:18.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.029+0000 7f9482ffd700 1 -- 172.21.15.26:0/4072265878 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948400ca70 con 0x7f949409d6f0 2023-10-01T07:59:18.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.029+0000 7f9482ffd700 1 -- 172.21.15.26:0/4072265878 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948400cde0 con 0x7f949409d6f0 2023-10-01T07:59:18.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.029+0000 7f94988be700 1 -- 172.21.15.26:0/4072265878 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94880094a0 con 0x7f949409d6f0 2023-10-01T07:59:18.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.029+0000 7f94988be700 1 -- 172.21.15.26:0/4072265878 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94941a8d00 con 0x7f949409d6f0 2023-10-01T07:59:18.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.030+0000 7f94988be700 1 -- 172.21.15.26:0/4072265878 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94941a9380 con 0x7f949409d6f0 2023-10-01T07:59:18.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.031+0000 7f9482ffd700 1 -- 172.21.15.26:0/4072265878 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9484013470 con 0x7f949409d6f0 2023-10-01T07:59:18.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.035+0000 7f9482ffd700 1 -- 172.21.15.26:0/4072265878 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9484024380 con 0x7f949409d6f0 2023-10-01T07:59:18.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.036+0000 7f9482ffd700 1 -- 172.21.15.26:0/4072265878 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9484013720 con 0x7f949409d6f0 2023-10-01T07:59:18.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.078+0000 7f7fabe26700 1 Processor -- start 2023-10-01T07:59:18.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.078+0000 7f7fabe26700 1 -- start start 2023-10-01T07:59:18.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.078+0000 7f7fabe26700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7fa406e570 0x7f7fa406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:18.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.078+0000 7f7fabe26700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7fa409eca0 0x7f7fa406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:18.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.078+0000 7f7fabe26700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa4070ee0 con 0x7f7fa4134610 2023-10-01T07:59:18.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.078+0000 7f7fabe26700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa4071480 con 0x7f7fa409eca0 2023-10-01T07:59:18.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.078+0000 7f7fabe26700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa406f3c0 con 0x7f7fa406e570 2023-10-01T07:59:18.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.079+0000 7f7fa9bc2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7fa406e570 0x7f7fa406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:18.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.079+0000 7f7fa9bc2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7fa406e570 0x7f7fa406e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44190/0 (socket says 172.21.15.26:44190) 2023-10-01T07:59:18.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.079+0000 7f7fa9bc2700 1 -- 172.21.15.26:0/4252811154 learned_addr learned my addr 172.21.15.26:0/4252811154 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:18.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.079+0000 7f7fa93c1700 1 --2- 172.21.15.26:0/4252811154 >> v2:172.21.15.26:3300/0 conn(0x7f7fa409eca0 0x7f7fa406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:18.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.079+0000 7f7fa9bc2700 1 -- 172.21.15.26:0/4252811154 >> v2:172.21.15.26:3300/0 conn(0x7f7fa409eca0 msgr2=0x7f7fa406ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:18.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.079+0000 7f7fa9bc2700 1 --2- 172.21.15.26:0/4252811154 >> v2:172.21.15.26:3300/0 conn(0x7f7fa409eca0 0x7f7fa406ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:18.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.079+0000 7f7fa9bc2700 1 -- 172.21.15.26:0/4252811154 >> v1:172.21.15.26:6789/0 conn(0x7f7fa4134610 legacy=0x7f7fa4134a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:18.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.079+0000 7f7fa9bc2700 1 -- 172.21.15.26:0/4252811154 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa4071b90 con 0x7f7fa406e570 2023-10-01T07:59:18.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.079+0000 7f7fa9bc2700 1 --2- 172.21.15.26:0/4252811154 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7fa406e570 0x7f7fa406e940 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f7fa00098f0 tx=0x7f7fa0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee2e019d6423d67a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:18.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.080+0000 7f7fa8bc0700 1 -- 172.21.15.26:0/4252811154 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0011830 con 0x7f7fa406e570 2023-10-01T07:59:18.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.080+0000 7f7fa8bc0700 1 -- 172.21.15.26:0/4252811154 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa0011990 con 0x7f7fa406e570 2023-10-01T07:59:18.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.080+0000 7f7fa8bc0700 1 -- 172.21.15.26:0/4252811154 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0011d20 con 0x7f7fa406e570 2023-10-01T07:59:18.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.080+0000 7f7fabe26700 1 -- 172.21.15.26:0/4252811154 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7fa406e570 msgr2=0x7f7fa406e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:18.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.080+0000 7f7fabe26700 1 --2- 172.21.15.26:0/4252811154 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7fa406e570 0x7f7fa406e940 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f7fa00098f0 tx=0x7f7fa0009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:18.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.080+0000 7f7fabe26700 1 -- 172.21.15.26:0/4252811154 shutdown_connections 2023-10-01T07:59:18.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.080+0000 7f7fabe26700 1 --2- 172.21.15.26:0/4252811154 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7fa406e570 0x7f7fa406e940 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:18.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.080+0000 7f7fabe26700 1 --2- 172.21.15.26:0/4252811154 >> v2:172.21.15.26:3300/0 conn(0x7f7fa409eca0 0x7f7fa406ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:18.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.080+0000 7f7fabe26700 1 -- 172.21.15.26:0/4252811154 >> 172.21.15.26:0/4252811154 conn(0x7f7fa40a2aa0 msgr2=0x7f7fa40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:18.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.080+0000 7f7fabe26700 1 -- 172.21.15.26:0/4252811154 shutdown_connections 2023-10-01T07:59:18.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.081+0000 7f7fabe26700 1 -- 172.21.15.26:0/4252811154 wait complete. 2023-10-01T07:59:18.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.081+0000 7f7fabe26700 1 Processor -- start 2023-10-01T07:59:18.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.081+0000 7f7fabe26700 1 -- start start 2023-10-01T07:59:18.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.082+0000 7f7fabe26700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7fa406e570 0x7f7fa4140150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:18.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.082+0000 7f7fabe26700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fa4134610 0x7f7fa413e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:18.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.082+0000 7f7fabe26700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7fa413ec50 0x7f7fa413f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:18.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.082+0000 7f7fabe26700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa41344d0 con 0x7f7fa4134610 2023-10-01T07:59:18.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.082+0000 7f7fabe26700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa40a2170 con 0x7f7fa413ec50 2023-10-01T07:59:18.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.082+0000 7f7fabe26700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa413cdc0 con 0x7f7fa406e570 2023-10-01T07:59:18.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.082+0000 7f7fa9bc2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7fa406e570 0x7f7fa4140150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:18.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.082+0000 7f7fa9bc2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7fa406e570 0x7f7fa4140150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56628/0 (socket says 172.21.15.26:56628) 2023-10-01T07:59:18.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.082+0000 7f7fa9bc2700 1 -- 172.21.15.26:0/494736826 learned_addr learned my addr 172.21.15.26:0/494736826 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:18.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.082+0000 7f7fa93c1700 1 --2- 172.21.15.26:0/494736826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fa4134610 0x7f7fa413e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:18.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.082+0000 7f7faa3c3700 1 --2- 172.21.15.26:0/494736826 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7fa413ec50 0x7f7fa413f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:18.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.082+0000 7f7fa9bc2700 1 -- 172.21.15.26:0/494736826 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7fa413ec50 msgr2=0x7f7fa413f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:18.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.082+0000 7f7fa9bc2700 1 --2- 172.21.15.26:0/494736826 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7fa413ec50 0x7f7fa413f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:18.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.082+0000 7f7fa9bc2700 1 -- 172.21.15.26:0/494736826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fa4134610 msgr2=0x7f7fa413e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:18.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.082+0000 7f7fa9bc2700 1 --2- 172.21.15.26:0/494736826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fa4134610 0x7f7fa413e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:18.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.082+0000 7f7fa9bc2700 1 -- 172.21.15.26:0/494736826 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa0009550 con 0x7f7fa406e570 2023-10-01T07:59:18.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.083+0000 7f7fa9bc2700 1 --2- 172.21.15.26:0/494736826 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7fa406e570 0x7f7fa4140150 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0000c00 tx=0x7f7fa0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:18.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.083+0000 7f7f9a7fc700 1 -- 172.21.15.26:0/494736826 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0004480 con 0x7f7fa406e570 2023-10-01T07:59:18.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.083+0000 7f7f9a7fc700 1 -- 172.21.15.26:0/494736826 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa001f070 con 0x7f7fa406e570 2023-10-01T07:59:18.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.083+0000 7f7f9a7fc700 1 -- 172.21.15.26:0/494736826 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa00038e0 con 0x7f7fa406e570 2023-10-01T07:59:18.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.083+0000 7f7fabe26700 1 -- 172.21.15.26:0/494736826 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa4070610 con 0x7f7fa406e570 2023-10-01T07:59:18.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.083+0000 7f7fabe26700 1 -- 172.21.15.26:0/494736826 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa413d850 con 0x7f7fa406e570 2023-10-01T07:59:18.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.084+0000 7f7f9a7fc700 1 -- 172.21.15.26:0/494736826 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7fa0021030 con 0x7f7fa406e570 2023-10-01T07:59:18.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.084+0000 7f7fabe26700 1 -- 172.21.15.26:0/494736826 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa4074ea0 con 0x7f7fa406e570 2023-10-01T07:59:18.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.084+0000 7f7f9a7fc700 1 -- 172.21.15.26:0/494736826 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7fa0040a90 con 0x7f7fa406e570 2023-10-01T07:59:18.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.094+0000 7f7f9a7fc700 1 -- 172.21.15.26:0/494736826 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7fa00199a0 con 0x7f7fa406e570 2023-10-01T07:59:18.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.180+0000 7f6946936700 1 -- 172.21.15.26:0/2032227902 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6924005590 con 0x7f6940066410 2023-10-01T07:59:18.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.180+0000 7f693d7fa700 1 -- 172.21.15.26:0/2032227902 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6930015030 con 0x7f6940066410 2023-10-01T07:59:18.181 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:18.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.183+0000 7f6946936700 1 -- 172.21.15.26:0/2032227902 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6940066410 msgr2=0x7f694009bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:18.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.183+0000 7f6946936700 1 --2- 172.21.15.26:0/2032227902 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6940066410 0x7f694009bb80 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f6930009c70 tx=0x7f6930004750 comp rx=0 tx=0).stop 2023-10-01T07:59:18.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.183+0000 7f6946936700 1 -- 172.21.15.26:0/2032227902 shutdown_connections 2023-10-01T07:59:18.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.183+0000 7f6946936700 1 --2- 172.21.15.26:0/2032227902 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f694006f5d0 0x7f69401c5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:18.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.183+0000 7f6946936700 1 --2- 172.21.15.26:0/2032227902 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6940066410 0x7f694009bb80 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:18.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.183+0000 7f6946936700 1 --2- 172.21.15.26:0/2032227902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6940066880 0x7f694009c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:18.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.183+0000 7f6946936700 1 -- 172.21.15.26:0/2032227902 >> 172.21.15.26:0/2032227902 conn(0x7f69400a2aa0 msgr2=0x7f694006e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:18.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.183+0000 7f6946936700 1 -- 172.21.15.26:0/2032227902 shutdown_connections 2023-10-01T07:59:18.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.183+0000 7f6946936700 1 -- 172.21.15.26:0/2032227902 wait complete. 2023-10-01T07:59:18.198 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:18.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.228+0000 7f62d7ab5700 1 -- 172.21.15.26:0/554501182 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f62d006c360 con 0x7f62d009d6f0 2023-10-01T07:59:18.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.229+0000 7f62c67fc700 1 -- 172.21.15.26:0/554501182 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f62cc010b70 con 0x7f62d009d6f0 2023-10-01T07:59:18.229 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:18.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.231+0000 7f62d7ab5700 1 -- 172.21.15.26:0/554501182 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62d009d6f0 msgr2=0x7f62d01225c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:18.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.231+0000 7f62d7ab5700 1 --2- 172.21.15.26:0/554501182 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62d009d6f0 0x7f62d01225c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f62cc009bf0 tx=0x7f62cc004750 comp rx=0 tx=0).stop 2023-10-01T07:59:18.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.231+0000 7f62d7ab5700 1 -- 172.21.15.26:0/554501182 shutdown_connections 2023-10-01T07:59:18.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.231+0000 7f62d7ab5700 1 --2- 172.21.15.26:0/554501182 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62d009e410 0x7f62d0123040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:18.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.231+0000 7f62d7ab5700 1 --2- 172.21.15.26:0/554501182 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62d009d6f0 0x7f62d01225c0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:18.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.231+0000 7f62d7ab5700 1 --2- 172.21.15.26:0/554501182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62d009e000 0x7f62d0122b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:18.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.231+0000 7f62d7ab5700 1 -- 172.21.15.26:0/554501182 >> 172.21.15.26:0/554501182 conn(0x7f62d0066f50 msgr2=0x7f62d00a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:18.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.231+0000 7f62d7ab5700 1 -- 172.21.15.26:0/554501182 shutdown_connections 2023-10-01T07:59:18.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.231+0000 7f62d7ab5700 1 -- 172.21.15.26:0/554501182 wait complete. 2023-10-01T07:59:18.246 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:18.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.247+0000 7f94988be700 1 -- 172.21.15.26:0/4072265878 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f94941a9380 con 0x7f949409d6f0 2023-10-01T07:59:18.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.247+0000 7f9482ffd700 1 -- 172.21.15.26:0/4072265878 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f94941a9380 con 0x7f949409d6f0 2023-10-01T07:59:18.248 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:18.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.249+0000 7f94988be700 1 -- 172.21.15.26:0/4072265878 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f949409d6f0 msgr2=0x7f94941a5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:18.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.249+0000 7f94988be700 1 --2- 172.21.15.26:0/4072265878 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f949409d6f0 0x7f94941a5ea0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f948400ebe0 tx=0x7f948400eef0 comp rx=0 tx=0).stop 2023-10-01T07:59:18.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.249+0000 7f94988be700 1 -- 172.21.15.26:0/4072265878 shutdown_connections 2023-10-01T07:59:18.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.249+0000 7f94988be700 1 --2- 172.21.15.26:0/4072265878 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f949409e410 0x7f94941a6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:18.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.249+0000 7f94988be700 1 --2- 172.21.15.26:0/4072265878 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f949409d6f0 0x7f94941a5ea0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:18.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.249+0000 7f94988be700 1 --2- 172.21.15.26:0/4072265878 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f949409e000 0x7f94941a63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:18.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.249+0000 7f94988be700 1 -- 172.21.15.26:0/4072265878 >> 172.21.15.26:0/4072265878 conn(0x7f9494066f50 msgr2=0x7f94941bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:18.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.250+0000 7f94988be700 1 -- 172.21.15.26:0/4072265878 shutdown_connections 2023-10-01T07:59:18.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.250+0000 7f94988be700 1 -- 172.21.15.26:0/4072265878 wait complete. 2023-10-01T07:59:18.264 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:18.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.304+0000 7f7fabe26700 1 -- 172.21.15.26:0/494736826 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7fa4071100 con 0x7f7fa406e570 2023-10-01T07:59:18.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.304+0000 7f7f9a7fc700 1 -- 172.21.15.26:0/494736826 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7fa0015030 con 0x7f7fa406e570 2023-10-01T07:59:18.305 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:18.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.307+0000 7f7fabe26700 1 -- 172.21.15.26:0/494736826 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7fa406e570 msgr2=0x7f7fa4140150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:18.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.307+0000 7f7fabe26700 1 --2- 172.21.15.26:0/494736826 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7fa406e570 0x7f7fa4140150 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0000c00 tx=0x7f7fa0004750 comp rx=0 tx=0).stop 2023-10-01T07:59:18.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.307+0000 7f7fabe26700 1 -- 172.21.15.26:0/494736826 shutdown_connections 2023-10-01T07:59:18.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.307+0000 7f7fabe26700 1 --2- 172.21.15.26:0/494736826 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7fa413ec50 0x7f7fa413f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:18.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.307+0000 7f7fabe26700 1 --2- 172.21.15.26:0/494736826 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7fa406e570 0x7f7fa4140150 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:18.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.307+0000 7f7fabe26700 1 --2- 172.21.15.26:0/494736826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fa4134610 0x7f7fa413e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:18.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.307+0000 7f7fabe26700 1 -- 172.21.15.26:0/494736826 >> 172.21.15.26:0/494736826 conn(0x7f7fa40a2aa0 msgr2=0x7f7fa409e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:18.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.307+0000 7f7fabe26700 1 -- 172.21.15.26:0/494736826 shutdown_connections 2023-10-01T07:59:18.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:18.307+0000 7f7fabe26700 1 -- 172.21.15.26:0/494736826 wait complete. 2023-10-01T07:59:18.320 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:19.199 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:19.247 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:19.265 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:19.321 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:19.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.357+0000 7f8bfd840700 1 Processor -- start 2023-10-01T07:59:19.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.357+0000 7f8bfd840700 1 -- start start 2023-10-01T07:59:19.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.358+0000 7f8bfd840700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8bf8133540 0x7f8bf8135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:19.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.358+0000 7f8bfd840700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8bf8135e60 0x7f8bf8138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:19.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.358+0000 7f8bfd840700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf80716a0 con 0x7f8bf8130540 2023-10-01T07:59:19.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.358+0000 7f8bfd840700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bf8071290 con 0x7f8bf8133540 2023-10-01T07:59:19.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.358+0000 7f8bfd840700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf8130340 con 0x7f8bf8135e60 2023-10-01T07:59:19.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.358+0000 7f8bf77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8bf8135e60 0x7f8bf8138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:19.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.358+0000 7f8bf77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8bf8135e60 0x7f8bf8138240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44204/0 (socket says 172.21.15.26:44204) 2023-10-01T07:59:19.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.358+0000 7f8bf77fe700 1 -- 172.21.15.26:0/1201734114 learned_addr learned my addr 172.21.15.26:0/1201734114 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:19.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.358+0000 7f8bf67fc700 1 --2- 172.21.15.26:0/1201734114 >> v2:172.21.15.26:3300/0 conn(0x7f8bf8133540 0x7f8bf8135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:19.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.358+0000 7f8bf77fe700 1 -- 172.21.15.26:0/1201734114 >> v2:172.21.15.26:3300/0 conn(0x7f8bf8133540 msgr2=0x7f8bf8135920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:19.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.358+0000 7f8bf77fe700 1 --2- 172.21.15.26:0/1201734114 >> v2:172.21.15.26:3300/0 conn(0x7f8bf8133540 0x7f8bf8135920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.358+0000 7f8bf77fe700 1 -- 172.21.15.26:0/1201734114 >> v1:172.21.15.26:6789/0 conn(0x7f8bf8130540 legacy=0x7f8bf8130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:19.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.358+0000 7f8bf77fe700 1 -- 172.21.15.26:0/1201734114 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf8070b80 con 0x7f8bf8135e60 2023-10-01T07:59:19.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.358+0000 7f8bf67fc700 1 --2- 172.21.15.26:0/1201734114 >> v2:172.21.15.26:3300/0 conn(0x7f8bf8133540 0x7f8bf8135920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:59:19.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.359+0000 7f8bf77fe700 1 --2- 172.21.15.26:0/1201734114 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8bf8135e60 0x7f8bf8138240 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0009e50 tx=0x7f8bf000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffcb36e06dd696e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:19.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.359+0000 7f8bf5ffb700 1 -- 172.21.15.26:0/1201734114 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf000e070 con 0x7f8bf8135e60 2023-10-01T07:59:19.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.359+0000 7f8bf5ffb700 1 -- 172.21.15.26:0/1201734114 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf000b9c0 con 0x7f8bf8135e60 2023-10-01T07:59:19.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.359+0000 7f8bf5ffb700 1 -- 172.21.15.26:0/1201734114 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf000bd70 con 0x7f8bf8135e60 2023-10-01T07:59:19.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.360+0000 7f8bfd840700 1 -- 172.21.15.26:0/1201734114 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8bf8135e60 msgr2=0x7f8bf8138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:19.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.360+0000 7f8bfd840700 1 --2- 172.21.15.26:0/1201734114 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8bf8135e60 0x7f8bf8138240 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0009e50 tx=0x7f8bf000b330 comp rx=0 tx=0).stop 2023-10-01T07:59:19.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.360+0000 7f8bfd840700 1 -- 172.21.15.26:0/1201734114 shutdown_connections 2023-10-01T07:59:19.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.360+0000 7f8bfd840700 1 --2- 172.21.15.26:0/1201734114 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8bf8135e60 0x7f8bf8138240 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.360+0000 7f8bfd840700 1 --2- 172.21.15.26:0/1201734114 >> v2:172.21.15.26:3300/0 conn(0x7f8bf8133540 0x7f8bf8135920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.360+0000 7f8bfd840700 1 -- 172.21.15.26:0/1201734114 >> 172.21.15.26:0/1201734114 conn(0x7f8bf80a2aa0 msgr2=0x7f8bf80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:19.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.360+0000 7f8bfd840700 1 -- 172.21.15.26:0/1201734114 shutdown_connections 2023-10-01T07:59:19.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.360+0000 7f8bfd840700 1 -- 172.21.15.26:0/1201734114 wait complete. 2023-10-01T07:59:19.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.362+0000 7f8bfd840700 1 Processor -- start 2023-10-01T07:59:19.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.362+0000 7f8bfd840700 1 -- start start 2023-10-01T07:59:19.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.363+0000 7f8bfd840700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bf8130540 0x7f8bf813b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:19.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.363+0000 7f8bfd840700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8bf8133540 0x7f8bf809c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:19.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.363+0000 7f8bfd840700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8bf8135e60 0x7f8bf809cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:19.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.363+0000 7f8bfd840700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf8136720 con 0x7f8bf8130540 2023-10-01T07:59:19.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.363+0000 7f8bfd840700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf809e1f0 con 0x7f8bf8135e60 2023-10-01T07:59:19.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.363+0000 7f8bfd840700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf8137130 con 0x7f8bf8133540 2023-10-01T07:59:19.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.363+0000 7f8bf77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8bf8135e60 0x7f8bf809cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:19.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.363+0000 7f8bf67fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8bf8133540 0x7f8bf809c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:19.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.363+0000 7f8bf77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8bf8135e60 0x7f8bf809cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44212/0 (socket says 172.21.15.26:44212) 2023-10-01T07:59:19.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.363+0000 7f8bf67fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8bf8133540 0x7f8bf809c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56638/0 (socket says 172.21.15.26:56638) 2023-10-01T07:59:19.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.363+0000 7f8bf77fe700 1 -- 172.21.15.26:0/3915417346 learned_addr learned my addr 172.21.15.26:0/3915417346 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:19.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.363+0000 7f8bf6ffd700 1 --2- 172.21.15.26:0/3915417346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bf8130540 0x7f8bf813b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:19.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.363+0000 7f8bf77fe700 1 -- 172.21.15.26:0/3915417346 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8bf8133540 msgr2=0x7f8bf809c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:19.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.363+0000 7f8bf77fe700 1 --2- 172.21.15.26:0/3915417346 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8bf8133540 0x7f8bf809c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.363+0000 7f8bf77fe700 1 -- 172.21.15.26:0/3915417346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bf8130540 msgr2=0x7f8bf813b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:19.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.363+0000 7f8bf77fe700 1 --2- 172.21.15.26:0/3915417346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bf8130540 0x7f8bf813b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.363+0000 7f8bf77fe700 1 -- 172.21.15.26:0/3915417346 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf0009b30 con 0x7f8bf8135e60 2023-10-01T07:59:19.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.363+0000 7f8bf67fc700 1 --2- 172.21.15.26:0/3915417346 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8bf8133540 0x7f8bf809c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:19.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.364+0000 7f8bf77fe700 1 --2- 172.21.15.26:0/3915417346 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8bf8135e60 0x7f8bf809cba0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0012000 tx=0x7f8bf0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:19.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.364+0000 7f8bdffff700 1 -- 172.21.15.26:0/3915417346 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf0004800 con 0x7f8bf8135e60 2023-10-01T07:59:19.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.364+0000 7f8bdffff700 1 -- 172.21.15.26:0/3915417346 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf0004960 con 0x7f8bf8135e60 2023-10-01T07:59:19.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.364+0000 7f8bdffff700 1 -- 172.21.15.26:0/3915417346 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf001c650 con 0x7f8bf8135e60 2023-10-01T07:59:19.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.364+0000 7f8bfd840700 1 -- 172.21.15.26:0/3915417346 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf80a23f0 con 0x7f8bf8135e60 2023-10-01T07:59:19.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.364+0000 7f8bfd840700 1 -- 172.21.15.26:0/3915417346 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf81374f0 con 0x7f8bf8135e60 2023-10-01T07:59:19.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.365+0000 7f8bdffff700 1 -- 172.21.15.26:0/3915417346 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8bf001c7b0 con 0x7f8bf8135e60 2023-10-01T07:59:19.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.366+0000 7f8bdffff700 1 -- 172.21.15.26:0/3915417346 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8bf0041130 con 0x7f8bf8135e60 2023-10-01T07:59:19.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.366+0000 7f8bfd840700 1 -- 172.21.15.26:0/3915417346 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bf80718e0 con 0x7f8bf8135e60 2023-10-01T07:59:19.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.372+0000 7f8bdffff700 1 -- 172.21.15.26:0/3915417346 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8bf001ca60 con 0x7f8bf8135e60 2023-10-01T07:59:19.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.406+0000 7f1b9a8e3700 1 Processor -- start 2023-10-01T07:59:19.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.406+0000 7f1b9a8e3700 1 -- start start 2023-10-01T07:59:19.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.407+0000 7f1b9a8e3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1b940a1510 0x7f1b94138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:19.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.407+0000 7f1b9a8e3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b94139250 0x7f1b9413b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:19.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.407+0000 7f1b9a8e3700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b9409edd0 con 0x7f1b940a0a30 2023-10-01T07:59:19.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.407+0000 7f1b9a8e3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b940a18e0 con 0x7f1b940a1510 2023-10-01T07:59:19.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.407+0000 7f1b9a8e3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9409e1f0 con 0x7f1b94139250 2023-10-01T07:59:19.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.407+0000 7f1b98e80700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b94139250 0x7f1b9413b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:19.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.407+0000 7f1b937fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1b940a1510 0x7f1b94138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:19.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.407+0000 7f1b937fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1b940a1510 0x7f1b94138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34696/0 (socket says 172.21.15.26:34696) 2023-10-01T07:59:19.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.407+0000 7f1b937fe700 1 -- 172.21.15.26:0/3898732457 learned_addr learned my addr 172.21.15.26:0/3898732457 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:19.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.407+0000 7f1b98e80700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b94139250 0x7f1b9413b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56648/0 (socket says 172.21.15.26:56648) 2023-10-01T07:59:19.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.407+0000 7f1b937fe700 1 -- 172.21.15.26:0/3898732457 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b94139250 msgr2=0x7f1b9413b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:19.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.407+0000 7f1b937fe700 1 --2- 172.21.15.26:0/3898732457 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b94139250 0x7f1b9413b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.407+0000 7f1b937fe700 1 -- 172.21.15.26:0/3898732457 >> v1:172.21.15.26:6789/0 conn(0x7f1b940a0a30 legacy=0x7f1b940a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:19.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.407+0000 7f1b937fe700 1 -- 172.21.15.26:0/3898732457 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b9409dc50 con 0x7f1b940a1510 2023-10-01T07:59:19.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.407+0000 7f1b92ffd700 1 -- 172.21.15.26:0/3898732457 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3463318521 0 0) 0x7f1b9409edd0 con 0x7f1b940a0a30 2023-10-01T07:59:19.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.407+0000 7f1b98e80700 1 --2- 172.21.15.26:0/3898732457 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b94139250 0x7f1b9413b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:19.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.408+0000 7f1b937fe700 1 --2- 172.21.15.26:0/3898732457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b940a1510 0x7f1b94138d10 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f1b840098f0 tx=0x7f1b84009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47db73be11aaff3a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:19.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.408+0000 7f1b92ffd700 1 -- 172.21.15.26:0/3898732457 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b84011830 con 0x7f1b940a1510 2023-10-01T07:59:19.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.408+0000 7f1b92ffd700 1 -- 172.21.15.26:0/3898732457 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b84011990 con 0x7f1b940a1510 2023-10-01T07:59:19.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.408+0000 7f1b92ffd700 1 -- 172.21.15.26:0/3898732457 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b84011d20 con 0x7f1b940a1510 2023-10-01T07:59:19.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.409+0000 7f1b9a8e3700 1 -- 172.21.15.26:0/3898732457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b940a1510 msgr2=0x7f1b94138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:19.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.409+0000 7f1b9a8e3700 1 --2- 172.21.15.26:0/3898732457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b940a1510 0x7f1b94138d10 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f1b840098f0 tx=0x7f1b84009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:19.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.409+0000 7f1b9a8e3700 1 -- 172.21.15.26:0/3898732457 shutdown_connections 2023-10-01T07:59:19.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.409+0000 7f1b9a8e3700 1 --2- 172.21.15.26:0/3898732457 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b94139250 0x7f1b9413b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.409+0000 7f1b9a8e3700 1 --2- 172.21.15.26:0/3898732457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b940a1510 0x7f1b94138d10 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.409+0000 7f1b9a8e3700 1 -- 172.21.15.26:0/3898732457 >> 172.21.15.26:0/3898732457 conn(0x7f1b940a6550 msgr2=0x7f1b940a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:19.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.409+0000 7f1b9a8e3700 1 -- 172.21.15.26:0/3898732457 shutdown_connections 2023-10-01T07:59:19.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.409+0000 7f1b9a8e3700 1 -- 172.21.15.26:0/3898732457 wait complete. 2023-10-01T07:59:19.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.410+0000 7f1b9a8e3700 1 Processor -- start 2023-10-01T07:59:19.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.410+0000 7f1b9a8e3700 1 -- start start 2023-10-01T07:59:19.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.411+0000 7f1b9a8e3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b940a0a30 0x7f1b941228c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:19.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.411+0000 7f1b9a8e3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b940a1510 0x7f1b94122e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:19.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.411+0000 7f1b9a8e3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b94139250 0x7f1b94123340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:19.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.411+0000 7f1b9a8e3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b941389e0 con 0x7f1b940a1510 2023-10-01T07:59:19.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.411+0000 7f1b9a8e3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b940a0220 con 0x7f1b94139250 2023-10-01T07:59:19.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.411+0000 7f1b9a8e3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b94126060 con 0x7f1b940a0a30 2023-10-01T07:59:19.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.411+0000 7f1b98e80700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b94139250 0x7f1b94123340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:19.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.411+0000 7f1b937fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b940a1510 0x7f1b94122e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:19.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.411+0000 7f1b98e80700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b94139250 0x7f1b94123340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44228/0 (socket says 172.21.15.26:44228) 2023-10-01T07:59:19.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.411+0000 7f1b98e80700 1 -- 172.21.15.26:0/25898621 learned_addr learned my addr 172.21.15.26:0/25898621 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:19.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.411+0000 7f1b93fff700 1 --2- 172.21.15.26:0/25898621 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b940a0a30 0x7f1b941228c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:19.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.412+0000 7f1b937fe700 1 -- 172.21.15.26:0/25898621 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b940a0a30 msgr2=0x7f1b941228c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:19.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.412+0000 7f1b937fe700 1 --2- 172.21.15.26:0/25898621 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b940a0a30 0x7f1b941228c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.412+0000 7f1b937fe700 1 -- 172.21.15.26:0/25898621 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b94139250 msgr2=0x7f1b94123340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:19.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.412+0000 7f1b937fe700 1 --2- 172.21.15.26:0/25898621 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b94139250 0x7f1b94123340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.412+0000 7f1b937fe700 1 -- 172.21.15.26:0/25898621 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8c009a70 con 0x7f1b940a1510 2023-10-01T07:59:19.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.412+0000 7f1b98e80700 1 --2- 172.21.15.26:0/25898621 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b94139250 0x7f1b94123340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:19.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.412+0000 7f1b937fe700 1 --2- 172.21.15.26:0/25898621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b940a1510 0x7f1b94122e00 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f1b84016000 tx=0x7f1b84004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:19.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.412+0000 7f1b90ff9700 1 -- 172.21.15.26:0/25898621 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b84004510 con 0x7f1b940a1510 2023-10-01T07:59:19.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.412+0000 7f1b90ff9700 1 -- 172.21.15.26:0/25898621 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b840036a0 con 0x7f1b940a1510 2023-10-01T07:59:19.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.412+0000 7f1b9a8e3700 1 -- 172.21.15.26:0/25898621 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b84009550 con 0x7f1b940a1510 2023-10-01T07:59:19.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.412+0000 7f1b9a8e3700 1 -- 172.21.15.26:0/25898621 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b94124bb0 con 0x7f1b940a1510 2023-10-01T07:59:19.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.412+0000 7f1b90ff9700 1 -- 172.21.15.26:0/25898621 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b84003a30 con 0x7f1b940a1510 2023-10-01T07:59:19.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.413+0000 7f1b9a8e3700 1 -- 172.21.15.26:0/25898621 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b780052e0 con 0x7f1b940a1510 2023-10-01T07:59:19.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.413+0000 7f1b90ff9700 1 -- 172.21.15.26:0/25898621 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1b84021070 con 0x7f1b940a1510 2023-10-01T07:59:19.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.414+0000 7f1b90ff9700 1 -- 172.21.15.26:0/25898621 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1b84040ad0 con 0x7f1b940a1510 2023-10-01T07:59:19.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.423+0000 7f1b90ff9700 1 -- 172.21.15.26:0/25898621 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1b8400b3e0 con 0x7f1b940a1510 2023-10-01T07:59:19.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.450+0000 7fcdde617700 1 Processor -- start 2023-10-01T07:59:19.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.451+0000 7fcdde617700 1 -- start start 2023-10-01T07:59:19.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.451+0000 7fcdde617700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcdd809d6f0 0x7fcdd809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:19.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.451+0000 7fcdde617700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcdd809e000 0x7fcdd81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:19.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.451+0000 7fcdde617700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcdd809e410 0x7fcdd8133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:19.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.451+0000 7fcdde617700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdd806b460 con 0x7fcdd809e410 2023-10-01T07:59:19.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.451+0000 7fcdde617700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd809b120 con 0x7fcdd809d6f0 2023-10-01T07:59:19.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.451+0000 7fcdde617700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd809a7e0 con 0x7fcdd809e000 2023-10-01T07:59:19.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.451+0000 7fcddcbb4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcdd809e410 0x7fcdd8133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:19.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.451+0000 7fcdd7fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcdd809d6f0 0x7fcdd809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:19.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.451+0000 7fcddcbb4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcdd809e410 0x7fcdd8133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34712/0 (socket says 172.21.15.26:34712) 2023-10-01T07:59:19.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.451+0000 7fcddcbb4700 1 -- 172.21.15.26:0/2159103137 learned_addr learned my addr 172.21.15.26:0/2159103137 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:19.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.451+0000 7fcdd77fe700 1 --2- 172.21.15.26:0/2159103137 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcdd809e000 0x7fcdd81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:19.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.452+0000 7fcdd7fff700 1 -- 172.21.15.26:0/2159103137 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcdd809e000 msgr2=0x7fcdd81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:19.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.452+0000 7fcdd7fff700 1 --2- 172.21.15.26:0/2159103137 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcdd809e000 0x7fcdd81339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.452+0000 7fcdd7fff700 1 -- 172.21.15.26:0/2159103137 >> v2:172.21.15.26:3300/0 conn(0x7fcdd809e410 msgr2=0x7fcdd8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:19.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.452+0000 7fcdd7fff700 1 --2- 172.21.15.26:0/2159103137 >> v2:172.21.15.26:3300/0 conn(0x7fcdd809e410 0x7fcdd8133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.452+0000 7fcdd7fff700 1 -- 172.21.15.26:0/2159103137 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd809a500 con 0x7fcdd809d6f0 2023-10-01T07:59:19.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.452+0000 7fcdd77fe700 1 --2- 172.21.15.26:0/2159103137 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcdd809e000 0x7fcdd81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:19.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.452+0000 7fcdd7fff700 1 --2- 172.21.15.26:0/2159103137 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcdd809d6f0 0x7fcdd809dac0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8009870 tx=0x7fcdc8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ca67b58793f56b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:19.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.452+0000 7fcdd6ffd700 1 -- 172.21.15.26:0/2159103137 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc8011830 con 0x7fcdd809d6f0 2023-10-01T07:59:19.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.452+0000 7fcdd6ffd700 1 -- 172.21.15.26:0/2159103137 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc8011990 con 0x7fcdd809d6f0 2023-10-01T07:59:19.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.452+0000 7fcdd6ffd700 1 -- 172.21.15.26:0/2159103137 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc8011d20 con 0x7fcdd809d6f0 2023-10-01T07:59:19.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.453+0000 7fcdde617700 1 -- 172.21.15.26:0/2159103137 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcdd809d6f0 msgr2=0x7fcdd809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:19.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.453+0000 7fcdde617700 1 --2- 172.21.15.26:0/2159103137 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcdd809d6f0 0x7fcdd809dac0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8009870 tx=0x7fcdc8009b80 comp rx=0 tx=0).stop 2023-10-01T07:59:19.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.453+0000 7fcdde617700 1 -- 172.21.15.26:0/2159103137 shutdown_connections 2023-10-01T07:59:19.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.453+0000 7fcdde617700 1 --2- 172.21.15.26:0/2159103137 >> v2:172.21.15.26:3300/0 conn(0x7fcdd809e410 0x7fcdd8133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.453+0000 7fcdde617700 1 --2- 172.21.15.26:0/2159103137 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcdd809d6f0 0x7fcdd809dac0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.453+0000 7fcdde617700 1 --2- 172.21.15.26:0/2159103137 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcdd809e000 0x7fcdd81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.453+0000 7fcdde617700 1 -- 172.21.15.26:0/2159103137 >> 172.21.15.26:0/2159103137 conn(0x7fcdd8066f50 msgr2=0x7fcdd809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:19.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.453+0000 7fcdde617700 1 -- 172.21.15.26:0/2159103137 shutdown_connections 2023-10-01T07:59:19.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.453+0000 7fcdde617700 1 -- 172.21.15.26:0/2159103137 wait complete. 2023-10-01T07:59:19.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.454+0000 7fcdde617700 1 Processor -- start 2023-10-01T07:59:19.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.455+0000 7fcdde617700 1 -- start start 2023-10-01T07:59:19.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.455+0000 7fcdde617700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcdd809d6f0 0x7fcdd81a4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:19.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.455+0000 7fcdde617700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcdd809e000 0x7fcdd81a5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:19.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.455+0000 7fcdde617700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdd809e410 0x7fcdd81a5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:19.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.455+0000 7fcdde617700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd81a8600 con 0x7fcdd809e410 2023-10-01T07:59:19.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.455+0000 7fcdde617700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd80a31a0 con 0x7fcdd809e000 2023-10-01T07:59:19.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.455+0000 7fcdde617700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd81a6ae0 con 0x7fcdd809d6f0 2023-10-01T07:59:19.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.456+0000 7fcdd7fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcdd809d6f0 0x7fcdd81a4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:19.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.456+0000 7fcdd7fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcdd809d6f0 0x7fcdd81a4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56672/0 (socket says 172.21.15.26:56672) 2023-10-01T07:59:19.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.456+0000 7fcdd7fff700 1 -- 172.21.15.26:0/420809547 learned_addr learned my addr 172.21.15.26:0/420809547 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:19.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.456+0000 7fcdd77fe700 1 --2- 172.21.15.26:0/420809547 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcdd809e000 0x7fcdd81a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:19.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.456+0000 7fcddcbb4700 1 --2- 172.21.15.26:0/420809547 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdd809e410 0x7fcdd81a5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:19.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.456+0000 7fcdd7fff700 1 -- 172.21.15.26:0/420809547 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcdd809e000 msgr2=0x7fcdd81a5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:19.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.456+0000 7fcdd7fff700 1 --2- 172.21.15.26:0/420809547 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcdd809e000 0x7fcdd81a5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.456+0000 7fcdd7fff700 1 -- 172.21.15.26:0/420809547 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdd809e410 msgr2=0x7fcdd81a5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:19.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.456+0000 7fcdd7fff700 1 --2- 172.21.15.26:0/420809547 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdd809e410 0x7fcdd81a5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.456+0000 7fcdd7fff700 1 -- 172.21.15.26:0/420809547 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdcc0094a0 con 0x7fcdd809d6f0 2023-10-01T07:59:19.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.456+0000 7fcdd7fff700 1 --2- 172.21.15.26:0/420809547 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcdd809d6f0 0x7fcdd81a4ed0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80090b0 tx=0x7fcdc8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:19.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.456+0000 7fcdd4ff9700 1 -- 172.21.15.26:0/420809547 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc8004510 con 0x7fcdd809d6f0 2023-10-01T07:59:19.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.457+0000 7fcdd4ff9700 1 -- 172.21.15.26:0/420809547 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc801f070 con 0x7fcdd809d6f0 2023-10-01T07:59:19.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.457+0000 7fcdde617700 1 -- 172.21.15.26:0/420809547 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdc80094a0 con 0x7fcdd809d6f0 2023-10-01T07:59:19.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.457+0000 7fcdd4ff9700 1 -- 172.21.15.26:0/420809547 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc80038c0 con 0x7fcdd809d6f0 2023-10-01T07:59:19.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.457+0000 7fcdde617700 1 -- 172.21.15.26:0/420809547 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd81a7c20 con 0x7fcdd809d6f0 2023-10-01T07:59:19.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.458+0000 7fcdde617700 1 -- 172.21.15.26:0/420809547 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdd8074ea0 con 0x7fcdd809d6f0 2023-10-01T07:59:19.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.458+0000 7fcdd4ff9700 1 -- 172.21.15.26:0/420809547 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcdc8003a20 con 0x7fcdd809d6f0 2023-10-01T07:59:19.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.459+0000 7fcdd4ff9700 1 -- 172.21.15.26:0/420809547 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcdc8021070 con 0x7fcdd809d6f0 2023-10-01T07:59:19.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.468+0000 7fcdd4ff9700 1 -- 172.21.15.26:0/420809547 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcdc8010380 con 0x7fcdd809d6f0 2023-10-01T07:59:19.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.489+0000 7fd9df38f700 1 Processor -- start 2023-10-01T07:59:19.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.489+0000 7fd9df38f700 1 -- start start 2023-10-01T07:59:19.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.490+0000 7fd9df38f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9d806a770 0x7fd9d809d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:19.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.490+0000 7fd9df38f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd9d813d1f0 0x7fd9d813f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:19.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.490+0000 7fd9df38f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d809a810 con 0x7fd9d809dc30 2023-10-01T07:59:19.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.490+0000 7fd9df38f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d806ab40 con 0x7fd9d813d1f0 2023-10-01T07:59:19.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.490+0000 7fd9df38f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d809ebc0 con 0x7fd9d806a770 2023-10-01T07:59:19.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.491+0000 7fd9dd92c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd9d813d1f0 0x7fd9d813f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:19.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.491+0000 7fd9dd92c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd9d813d1f0 0x7fd9d813f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34726/0 (socket says 172.21.15.26:34726) 2023-10-01T07:59:19.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.491+0000 7fd9dd92c700 1 -- 172.21.15.26:0/3443224466 learned_addr learned my addr 172.21.15.26:0/3443224466 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:19.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.491+0000 7fd9dd12b700 1 --2- 172.21.15.26:0/3443224466 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9d806a770 0x7fd9d809d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:19.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.491+0000 7fd9dd12b700 1 -- 172.21.15.26:0/3443224466 >> v2:172.21.15.26:3300/0 conn(0x7fd9d813d1f0 msgr2=0x7fd9d813f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:19.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.491+0000 7fd9dd12b700 1 --2- 172.21.15.26:0/3443224466 >> v2:172.21.15.26:3300/0 conn(0x7fd9d813d1f0 0x7fd9d813f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.491+0000 7fd9dd12b700 1 -- 172.21.15.26:0/3443224466 >> v1:172.21.15.26:6789/0 conn(0x7fd9d809dc30 legacy=0x7fd9d809e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:19.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.491+0000 7fd9dd12b700 1 -- 172.21.15.26:0/3443224466 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d809e920 con 0x7fd9d806a770 2023-10-01T07:59:19.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.491+0000 7fd9dd12b700 1 --2- 172.21.15.26:0/3443224466 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9d806a770 0x7fd9d809d6f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4009870 tx=0x7fd9d4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4248084e05139b22 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:19.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.491+0000 7fd9cffff700 1 -- 172.21.15.26:0/3443224466 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4011830 con 0x7fd9d806a770 2023-10-01T07:59:19.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.492+0000 7fd9cffff700 1 -- 172.21.15.26:0/3443224466 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d4011990 con 0x7fd9d806a770 2023-10-01T07:59:19.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.492+0000 7fd9cffff700 1 -- 172.21.15.26:0/3443224466 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4011d20 con 0x7fd9d806a770 2023-10-01T07:59:19.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.493+0000 7fd9df38f700 1 -- 172.21.15.26:0/3443224466 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9d806a770 msgr2=0x7fd9d809d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:19.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.493+0000 7fd9df38f700 1 --2- 172.21.15.26:0/3443224466 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9d806a770 0x7fd9d809d6f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4009870 tx=0x7fd9d4009b80 comp rx=0 tx=0).stop 2023-10-01T07:59:19.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.493+0000 7fd9df38f700 1 -- 172.21.15.26:0/3443224466 shutdown_connections 2023-10-01T07:59:19.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.493+0000 7fd9df38f700 1 --2- 172.21.15.26:0/3443224466 >> v2:172.21.15.26:3300/0 conn(0x7fd9d813d1f0 0x7fd9d813f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.493+0000 7fd9df38f700 1 --2- 172.21.15.26:0/3443224466 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9d806a770 0x7fd9d809d6f0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.493+0000 7fd9df38f700 1 -- 172.21.15.26:0/3443224466 >> 172.21.15.26:0/3443224466 conn(0x7fd9d8066f50 msgr2=0x7fd9d809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:19.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.493+0000 7fd9df38f700 1 -- 172.21.15.26:0/3443224466 shutdown_connections 2023-10-01T07:59:19.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.493+0000 7fd9df38f700 1 -- 172.21.15.26:0/3443224466 wait complete. 2023-10-01T07:59:19.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.494+0000 7fd9df38f700 1 Processor -- start 2023-10-01T07:59:19.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.494+0000 7fd9df38f700 1 -- start start 2023-10-01T07:59:19.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.495+0000 7fd9df38f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9d806a770 0x7fd9d81260a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:19.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.495+0000 7fd9df38f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9d809dc30 0x7fd9d81265e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:19.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.495+0000 7fd9df38f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9d813d1f0 0x7fd9d8126b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:19.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.495+0000 7fd9df38f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d809c110 con 0x7fd9d809dc30 2023-10-01T07:59:19.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.495+0000 7fd9df38f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d8129020 con 0x7fd9d813d1f0 2023-10-01T07:59:19.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.495+0000 7fd9df38f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d8128110 con 0x7fd9d806a770 2023-10-01T07:59:19.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.495+0000 7fd9dd12b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9d806a770 0x7fd9d81260a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:19.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.495+0000 7fd9dd12b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9d806a770 0x7fd9d81260a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56692/0 (socket says 172.21.15.26:56692) 2023-10-01T07:59:19.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.495+0000 7fd9dd12b700 1 -- 172.21.15.26:0/2097895362 learned_addr learned my addr 172.21.15.26:0/2097895362 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:19.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.495+0000 7fd9dc92a700 1 --2- 172.21.15.26:0/2097895362 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9d809dc30 0x7fd9d81265e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:19.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.495+0000 7fd9dd92c700 1 --2- 172.21.15.26:0/2097895362 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9d813d1f0 0x7fd9d8126b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:19.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.496+0000 7fd9dd92c700 1 -- 172.21.15.26:0/2097895362 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9d806a770 msgr2=0x7fd9d81260a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:19.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.496+0000 7fd9dd92c700 1 --2- 172.21.15.26:0/2097895362 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9d806a770 0x7fd9d81260a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.496+0000 7fd9dd92c700 1 -- 172.21.15.26:0/2097895362 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9d809dc30 msgr2=0x7fd9d81265e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:19.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.496+0000 7fd9dd92c700 1 --2- 172.21.15.26:0/2097895362 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9d809dc30 0x7fd9d81265e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.496+0000 7fd9dd92c700 1 -- 172.21.15.26:0/2097895362 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d40094a0 con 0x7fd9d813d1f0 2023-10-01T07:59:19.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.496+0000 7fd9dc92a700 1 --2- 172.21.15.26:0/2097895362 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9d809dc30 0x7fd9d81265e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:19.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.496+0000 7fd9dd92c700 1 --2- 172.21.15.26:0/2097895362 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9d813d1f0 0x7fd9d8126b20 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fd9d000ef90 tx=0x7fd9d000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:19.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.496+0000 7fd9cdffb700 1 -- 172.21.15.26:0/2097895362 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d0003c20 con 0x7fd9d813d1f0 2023-10-01T07:59:19.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.496+0000 7fd9cdffb700 1 -- 172.21.15.26:0/2097895362 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d000f040 con 0x7fd9d813d1f0 2023-10-01T07:59:19.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.496+0000 7fd9df38f700 1 -- 172.21.15.26:0/2097895362 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d8127410 con 0x7fd9d813d1f0 2023-10-01T07:59:19.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.497+0000 7fd9df38f700 1 -- 172.21.15.26:0/2097895362 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d8127190 con 0x7fd9d813d1f0 2023-10-01T07:59:19.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.498+0000 7fd9df38f700 1 -- 172.21.15.26:0/2097895362 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d8074ea0 con 0x7fd9d813d1f0 2023-10-01T07:59:19.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.498+0000 7fd9cdffb700 1 -- 172.21.15.26:0/2097895362 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d0009e60 con 0x7fd9d813d1f0 2023-10-01T07:59:19.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.498+0000 7fd9cdffb700 1 -- 172.21.15.26:0/2097895362 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd9d000c880 con 0x7fd9d813d1f0 2023-10-01T07:59:19.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.499+0000 7fd9cdffb700 1 -- 172.21.15.26:0/2097895362 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd9d0047450 con 0x7fd9d813d1f0 2023-10-01T07:59:19.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.503+0000 7fd9cdffb700 1 -- 172.21.15.26:0/2097895362 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd9d0042030 con 0x7fd9d813d1f0 2023-10-01T07:59:19.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.590+0000 7f8bfd840700 1 -- 172.21.15.26:0/3915417346 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8bf8074ea0 con 0x7f8bf8135e60 2023-10-01T07:59:19.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.590+0000 7f8bdffff700 1 -- 172.21.15.26:0/3915417346 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8bf001bb90 con 0x7f8bf8135e60 2023-10-01T07:59:19.592 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:19.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.593+0000 7f8bfd840700 1 -- 172.21.15.26:0/3915417346 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8bf8135e60 msgr2=0x7f8bf809cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:19.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.593+0000 7f8bfd840700 1 --2- 172.21.15.26:0/3915417346 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8bf8135e60 0x7f8bf809cba0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0012000 tx=0x7f8bf0004ad0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.593+0000 7f8bfd840700 1 -- 172.21.15.26:0/3915417346 shutdown_connections 2023-10-01T07:59:19.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.593+0000 7f8bfd840700 1 --2- 172.21.15.26:0/3915417346 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8bf8135e60 0x7f8bf809cba0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.593+0000 7f8bfd840700 1 --2- 172.21.15.26:0/3915417346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bf8130540 0x7f8bf813b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.593+0000 7f8bfd840700 1 --2- 172.21.15.26:0/3915417346 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8bf8133540 0x7f8bf809c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.593+0000 7f8bfd840700 1 -- 172.21.15.26:0/3915417346 >> 172.21.15.26:0/3915417346 conn(0x7f8bf80a2aa0 msgr2=0x7f8bf80a0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:19.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.593+0000 7f8bfd840700 1 -- 172.21.15.26:0/3915417346 shutdown_connections 2023-10-01T07:59:19.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.593+0000 7f8bfd840700 1 -- 172.21.15.26:0/3915417346 wait complete. 2023-10-01T07:59:19.609 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:19.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.637+0000 7f1b9a8e3700 1 -- 172.21.15.26:0/25898621 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1b78005590 con 0x7f1b940a1510 2023-10-01T07:59:19.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.637+0000 7f1b90ff9700 1 -- 172.21.15.26:0/25898621 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1b84015020 con 0x7f1b940a1510 2023-10-01T07:59:19.638 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:19.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.640+0000 7f1b9a8e3700 1 -- 172.21.15.26:0/25898621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b940a1510 msgr2=0x7f1b94122e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:19.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.640+0000 7f1b9a8e3700 1 --2- 172.21.15.26:0/25898621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b940a1510 0x7f1b94122e00 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f1b84016000 tx=0x7f1b84004750 comp rx=0 tx=0).stop 2023-10-01T07:59:19.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.640+0000 7f1b9a8e3700 1 -- 172.21.15.26:0/25898621 shutdown_connections 2023-10-01T07:59:19.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.640+0000 7f1b9a8e3700 1 --2- 172.21.15.26:0/25898621 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b94139250 0x7f1b94123340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.640+0000 7f1b9a8e3700 1 --2- 172.21.15.26:0/25898621 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1b940a0a30 0x7f1b941228c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.640+0000 7f1b9a8e3700 1 --2- 172.21.15.26:0/25898621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b940a1510 0x7f1b94122e00 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.640+0000 7f1b9a8e3700 1 -- 172.21.15.26:0/25898621 >> 172.21.15.26:0/25898621 conn(0x7f1b940a6550 msgr2=0x7f1b940a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:19.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.640+0000 7f1b9a8e3700 1 -- 172.21.15.26:0/25898621 shutdown_connections 2023-10-01T07:59:19.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.640+0000 7f1b9a8e3700 1 -- 172.21.15.26:0/25898621 wait complete. 2023-10-01T07:59:19.654 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:19.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.687+0000 7fcdde617700 1 -- 172.21.15.26:0/420809547 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcdd806c360 con 0x7fcdd809d6f0 2023-10-01T07:59:19.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.687+0000 7fcdd4ff9700 1 -- 172.21.15.26:0/420809547 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcdc8034090 con 0x7fcdd809d6f0 2023-10-01T07:59:19.688 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:19.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.691+0000 7fcdde617700 1 -- 172.21.15.26:0/420809547 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcdd809d6f0 msgr2=0x7fcdd81a4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:19.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.691+0000 7fcdde617700 1 --2- 172.21.15.26:0/420809547 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcdd809d6f0 0x7fcdd81a4ed0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80090b0 tx=0x7fcdc8004750 comp rx=0 tx=0).stop 2023-10-01T07:59:19.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.691+0000 7fcdde617700 1 -- 172.21.15.26:0/420809547 shutdown_connections 2023-10-01T07:59:19.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.691+0000 7fcdde617700 1 --2- 172.21.15.26:0/420809547 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdd809e410 0x7fcdd81a5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.691+0000 7fcdde617700 1 --2- 172.21.15.26:0/420809547 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcdd809d6f0 0x7fcdd81a4ed0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.691+0000 7fcdde617700 1 --2- 172.21.15.26:0/420809547 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcdd809e000 0x7fcdd81a5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.691+0000 7fcdde617700 1 -- 172.21.15.26:0/420809547 >> 172.21.15.26:0/420809547 conn(0x7fcdd8066f50 msgr2=0x7fcdd81b9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:19.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.691+0000 7fcdde617700 1 -- 172.21.15.26:0/420809547 shutdown_connections 2023-10-01T07:59:19.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.691+0000 7fcdde617700 1 -- 172.21.15.26:0/420809547 wait complete. 2023-10-01T07:59:19.710 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:19.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.721+0000 7fd9df38f700 1 -- 172.21.15.26:0/2097895362 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd9d809a3d0 con 0x7fd9d813d1f0 2023-10-01T07:59:19.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.722+0000 7fd9cdffb700 1 -- 172.21.15.26:0/2097895362 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd9d0013bd0 con 0x7fd9d813d1f0 2023-10-01T07:59:19.722 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:19.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.724+0000 7fd9df38f700 1 -- 172.21.15.26:0/2097895362 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9d813d1f0 msgr2=0x7fd9d8126b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:19.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.724+0000 7fd9df38f700 1 --2- 172.21.15.26:0/2097895362 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9d813d1f0 0x7fd9d8126b20 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fd9d000ef90 tx=0x7fd9d000c3a0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.724+0000 7fd9df38f700 1 -- 172.21.15.26:0/2097895362 shutdown_connections 2023-10-01T07:59:19.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.724+0000 7fd9df38f700 1 --2- 172.21.15.26:0/2097895362 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9d813d1f0 0x7fd9d8126b20 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.724+0000 7fd9df38f700 1 --2- 172.21.15.26:0/2097895362 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9d806a770 0x7fd9d81260a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.724+0000 7fd9df38f700 1 --2- 172.21.15.26:0/2097895362 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9d809dc30 0x7fd9d81265e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:19.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.724+0000 7fd9df38f700 1 -- 172.21.15.26:0/2097895362 >> 172.21.15.26:0/2097895362 conn(0x7fd9d8066f50 msgr2=0x7fd9d80a27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:19.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.724+0000 7fd9df38f700 1 -- 172.21.15.26:0/2097895362 shutdown_connections 2023-10-01T07:59:19.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:19.724+0000 7fd9df38f700 1 -- 172.21.15.26:0/2097895362 wait complete. 2023-10-01T07:59:19.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:20.610 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:20.655 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:20.711 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:20.739 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:20.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.759+0000 7fb3bb3ac700 1 Processor -- start 2023-10-01T07:59:20.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.759+0000 7fb3bb3ac700 1 -- start start 2023-10-01T07:59:20.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.760+0000 7fb3bb3ac700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3b4131810 0x7fb3b4131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:20.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.760+0000 7fb3bb3ac700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb3b4099a40 0x7fb3b4099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:20.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.760+0000 7fb3bb3ac700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3b41313c0 con 0x7fb3b409a3b0 2023-10-01T07:59:20.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.760+0000 7fb3bb3ac700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b409b580 con 0x7fb3b4131810 2023-10-01T07:59:20.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.760+0000 7fb3bb3ac700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b406e8c0 con 0x7fb3b4099a40 2023-10-01T07:59:20.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.760+0000 7fb3b8947700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb3b4099a40 0x7fb3b4099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:20.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.760+0000 7fb3b8947700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb3b4099a40 0x7fb3b4099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56702/0 (socket says 172.21.15.26:56702) 2023-10-01T07:59:20.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.760+0000 7fb3b8947700 1 -- 172.21.15.26:0/1744844485 learned_addr learned my addr 172.21.15.26:0/1744844485 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:20.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.760+0000 7fb3b9148700 1 --2- 172.21.15.26:0/1744844485 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3b4131810 0x7fb3b4131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:20.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.760+0000 7fb3b9148700 1 -- 172.21.15.26:0/1744844485 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb3b4099a40 msgr2=0x7fb3b4099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:20.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.760+0000 7fb3b9148700 1 --2- 172.21.15.26:0/1744844485 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb3b4099a40 0x7fb3b4099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:20.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.760+0000 7fb3b9148700 1 -- 172.21.15.26:0/1744844485 >> v1:172.21.15.26:6789/0 conn(0x7fb3b409a3b0 legacy=0x7fb3b4138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:20.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.760+0000 7fb3abfff700 1 -- 172.21.15.26:0/1744844485 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1299337530 0 0) 0x7fb3b41313c0 con 0x7fb3b409a3b0 2023-10-01T07:59:20.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.760+0000 7fb3b9148700 1 -- 172.21.15.26:0/1744844485 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b409a820 con 0x7fb3b4131810 2023-10-01T07:59:20.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.761+0000 7fb3b9148700 1 --2- 172.21.15.26:0/1744844485 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3b4131810 0x7fb3b4131be0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0009870 tx=0x7fb3b0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65695b3aba24fead server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:20.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.761+0000 7fb3abfff700 1 -- 172.21.15.26:0/1744844485 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b0011830 con 0x7fb3b4131810 2023-10-01T07:59:20.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.761+0000 7fb3abfff700 1 -- 172.21.15.26:0/1744844485 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b0011990 con 0x7fb3b4131810 2023-10-01T07:59:20.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.761+0000 7fb3abfff700 1 -- 172.21.15.26:0/1744844485 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b0011d20 con 0x7fb3b4131810 2023-10-01T07:59:20.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.762+0000 7fb3bb3ac700 1 -- 172.21.15.26:0/1744844485 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3b4131810 msgr2=0x7fb3b4131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:20.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.762+0000 7fb3bb3ac700 1 --2- 172.21.15.26:0/1744844485 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3b4131810 0x7fb3b4131be0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0009870 tx=0x7fb3b0009b80 comp rx=0 tx=0).stop 2023-10-01T07:59:20.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.762+0000 7fb3bb3ac700 1 -- 172.21.15.26:0/1744844485 shutdown_connections 2023-10-01T07:59:20.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.762+0000 7fb3bb3ac700 1 --2- 172.21.15.26:0/1744844485 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3b4131810 0x7fb3b4131be0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:20.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.762+0000 7fb3bb3ac700 1 --2- 172.21.15.26:0/1744844485 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb3b4099a40 0x7fb3b4099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:20.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.762+0000 7fb3bb3ac700 1 -- 172.21.15.26:0/1744844485 >> 172.21.15.26:0/1744844485 conn(0x7fb3b40a2aa0 msgr2=0x7fb3b40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:20.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.762+0000 7fb3bb3ac700 1 -- 172.21.15.26:0/1744844485 shutdown_connections 2023-10-01T07:59:20.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.762+0000 7fb3bb3ac700 1 -- 172.21.15.26:0/1744844485 wait complete. 2023-10-01T07:59:20.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.763+0000 7fb3bb3ac700 1 Processor -- start 2023-10-01T07:59:20.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.763+0000 7fb3bb3ac700 1 -- start start 2023-10-01T07:59:20.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.764+0000 7fb3bb3ac700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb3b4099a40 0x7fb3b406f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:20.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.764+0000 7fb3bb3ac700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3b409a3b0 0x7fb3b406fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:20.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.764+0000 7fb3bb3ac700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3b4131810 0x7fb3b4070060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:20.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.764+0000 7fb3bb3ac700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b411dbd0 con 0x7fb3b4131810 2023-10-01T07:59:20.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.764+0000 7fb3bb3ac700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b412cb40 con 0x7fb3b409a3b0 2023-10-01T07:59:20.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.764+0000 7fb3bb3ac700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b411e1a0 con 0x7fb3b4099a40 2023-10-01T07:59:20.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.764+0000 7fb3b9148700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb3b4099a40 0x7fb3b406f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:20.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.764+0000 7fb3b9148700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb3b4099a40 0x7fb3b406f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56718/0 (socket says 172.21.15.26:56718) 2023-10-01T07:59:20.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.764+0000 7fb3b9148700 1 -- 172.21.15.26:0/2103276766 learned_addr learned my addr 172.21.15.26:0/2103276766 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:20.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.764+0000 7fb3b8947700 1 --2- 172.21.15.26:0/2103276766 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3b409a3b0 0x7fb3b406fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:20.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.764+0000 7fb3b9949700 1 --2- 172.21.15.26:0/2103276766 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3b4131810 0x7fb3b4070060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:20.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.764+0000 7fb3b8947700 1 -- 172.21.15.26:0/2103276766 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb3b4099a40 msgr2=0x7fb3b406f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:20.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.764+0000 7fb3b8947700 1 --2- 172.21.15.26:0/2103276766 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb3b4099a40 0x7fb3b406f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:20.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.764+0000 7fb3b8947700 1 -- 172.21.15.26:0/2103276766 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3b4131810 msgr2=0x7fb3b4070060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:20.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.765+0000 7fb3b8947700 1 --2- 172.21.15.26:0/2103276766 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3b4131810 0x7fb3b4070060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:20.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.765+0000 7fb3b8947700 1 -- 172.21.15.26:0/2103276766 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b00094a0 con 0x7fb3b409a3b0 2023-10-01T07:59:20.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.765+0000 7fb3b9949700 1 --2- 172.21.15.26:0/2103276766 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3b4131810 0x7fb3b4070060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:20.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.765+0000 7fb3b8947700 1 --2- 172.21.15.26:0/2103276766 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3b409a3b0 0x7fb3b406fb20 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fb3a400e8e0 tx=0x7fb3a400ebf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:20.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.765+0000 7fb3a9ffb700 1 -- 172.21.15.26:0/2103276766 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a4013680 con 0x7fb3b409a3b0 2023-10-01T07:59:20.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.765+0000 7fb3a9ffb700 1 -- 172.21.15.26:0/2103276766 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a40137e0 con 0x7fb3b409a3b0 2023-10-01T07:59:20.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.765+0000 7fb3bb3ac700 1 -- 172.21.15.26:0/2103276766 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3b411eef0 con 0x7fb3b409a3b0 2023-10-01T07:59:20.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.765+0000 7fb3a9ffb700 1 -- 172.21.15.26:0/2103276766 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a4013b50 con 0x7fb3b409a3b0 2023-10-01T07:59:20.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.766+0000 7fb3bb3ac700 1 -- 172.21.15.26:0/2103276766 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3b406eb00 con 0x7fb3b409a3b0 2023-10-01T07:59:20.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.767+0000 7fb3a9ffb700 1 -- 172.21.15.26:0/2103276766 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb3a4013cb0 con 0x7fb3b409a3b0 2023-10-01T07:59:20.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.767+0000 7fb3bb3ac700 1 -- 172.21.15.26:0/2103276766 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3b4074ea0 con 0x7fb3b409a3b0 2023-10-01T07:59:20.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.767+0000 7fb3a9ffb700 1 -- 172.21.15.26:0/2103276766 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb3a403f640 con 0x7fb3b409a3b0 2023-10-01T07:59:20.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.776+0000 7fb3a9ffb700 1 -- 172.21.15.26:0/2103276766 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb3a401bbe0 con 0x7fb3b409a3b0 2023-10-01T07:59:20.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.810+0000 7f0c972b8700 1 Processor -- start 2023-10-01T07:59:20.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.810+0000 7f0c972b8700 1 -- start start 2023-10-01T07:59:20.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.811+0000 7f0c972b8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0c9006c0e0 0x7f0c9009ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:20.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.811+0000 7f0c972b8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0c901380f0 0x7f0c9013fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:20.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.811+0000 7f0c972b8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c90134980 con 0x7f0c90134ec0 2023-10-01T07:59:20.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.811+0000 7f0c972b8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c9006c4b0 con 0x7f0c9006c0e0 2023-10-01T07:59:20.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.811+0000 7f0c972b8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c900a09c0 con 0x7f0c901380f0 2023-10-01T07:59:20.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.811+0000 7f0c95054700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0c9006c0e0 0x7f0c9009ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:20.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.811+0000 7f0c95054700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0c9006c0e0 0x7f0c9009ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34760/0 (socket says 172.21.15.26:34760) 2023-10-01T07:59:20.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.811+0000 7f0c95054700 1 -- 172.21.15.26:0/1067067261 learned_addr learned my addr 172.21.15.26:0/1067067261 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:20.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.811+0000 7f0c95855700 1 --2- 172.21.15.26:0/1067067261 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0c901380f0 0x7f0c9013fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:20.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.812+0000 7f0c95054700 1 -- 172.21.15.26:0/1067067261 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0c901380f0 msgr2=0x7f0c9013fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:20.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.812+0000 7f0c95054700 1 --2- 172.21.15.26:0/1067067261 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0c901380f0 0x7f0c9013fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:20.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.812+0000 7f0c95054700 1 -- 172.21.15.26:0/1067067261 >> v1:172.21.15.26:6789/0 conn(0x7f0c90134ec0 legacy=0x7f0c901379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:20.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.812+0000 7f0c95054700 1 -- 172.21.15.26:0/1067067261 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c900a0600 con 0x7f0c9006c0e0 2023-10-01T07:59:20.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.812+0000 7f0c87fff700 1 -- 172.21.15.26:0/1067067261 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1223211388 0 0) 0x7f0c90134980 con 0x7f0c90134ec0 2023-10-01T07:59:20.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.812+0000 7f0c95054700 1 --2- 172.21.15.26:0/1067067261 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c9006c0e0 0x7f0c9009ac90 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0098f0 tx=0x7f0c8c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dac8fc34174b43b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:20.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.812+0000 7f0c87fff700 1 -- 172.21.15.26:0/1067067261 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c011830 con 0x7f0c9006c0e0 2023-10-01T07:59:20.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.812+0000 7f0c87fff700 1 -- 172.21.15.26:0/1067067261 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8c011990 con 0x7f0c9006c0e0 2023-10-01T07:59:20.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.812+0000 7f0c87fff700 1 -- 172.21.15.26:0/1067067261 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c011d20 con 0x7f0c9006c0e0 2023-10-01T07:59:20.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.813+0000 7f0c972b8700 1 -- 172.21.15.26:0/1067067261 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c9006c0e0 msgr2=0x7f0c9009ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:20.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.813+0000 7f0c972b8700 1 --2- 172.21.15.26:0/1067067261 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c9006c0e0 0x7f0c9009ac90 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0098f0 tx=0x7f0c8c009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:20.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.813+0000 7f0c972b8700 1 -- 172.21.15.26:0/1067067261 shutdown_connections 2023-10-01T07:59:20.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.813+0000 7f0c972b8700 1 --2- 172.21.15.26:0/1067067261 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0c901380f0 0x7f0c9013fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:20.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.813+0000 7f0c972b8700 1 --2- 172.21.15.26:0/1067067261 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c9006c0e0 0x7f0c9009ac90 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:20.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.813+0000 7f0c972b8700 1 -- 172.21.15.26:0/1067067261 >> 172.21.15.26:0/1067067261 conn(0x7f0c900a4210 msgr2=0x7f0c900a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:20.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.813+0000 7f0c972b8700 1 -- 172.21.15.26:0/1067067261 shutdown_connections 2023-10-01T07:59:20.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.814+0000 7f0c972b8700 1 -- 172.21.15.26:0/1067067261 wait complete. 2023-10-01T07:59:20.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.815+0000 7f0c972b8700 1 Processor -- start 2023-10-01T07:59:20.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.815+0000 7f0c972b8700 1 -- start start 2023-10-01T07:59:20.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.816+0000 7f0c972b8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c9006c0e0 0x7f0c901ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:20.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.816+0000 7f0c972b8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c90134ec0 0x7f0c901cd020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:20.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.816+0000 7f0c972b8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0c901380f0 0x7f0c901cd560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:20.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.816+0000 7f0c972b8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9011c7f0 con 0x7f0c90134ec0 2023-10-01T07:59:20.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.816+0000 7f0c972b8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9011c0e0 con 0x7f0c9006c0e0 2023-10-01T07:59:20.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.816+0000 7f0c972b8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c900a03f0 con 0x7f0c901380f0 2023-10-01T07:59:20.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.816+0000 7f0c95054700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c9006c0e0 0x7f0c901ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:20.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.816+0000 7f0c95855700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0c901380f0 0x7f0c901cd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:20.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.816+0000 7f0c95054700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c9006c0e0 0x7f0c901ccae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44282/0 (socket says 172.21.15.26:44282) 2023-10-01T07:59:20.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.816+0000 7f0c95054700 1 -- 172.21.15.26:0/38750670 learned_addr learned my addr 172.21.15.26:0/38750670 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:20.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.816+0000 7f0c94853700 1 --2- 172.21.15.26:0/38750670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c90134ec0 0x7f0c901cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:20.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.816+0000 7f0c95855700 1 -- 172.21.15.26:0/38750670 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c9006c0e0 msgr2=0x7f0c901ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:20.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.816+0000 7f0c95855700 1 --2- 172.21.15.26:0/38750670 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c9006c0e0 0x7f0c901ccae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:20.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.816+0000 7f0c95855700 1 -- 172.21.15.26:0/38750670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c90134ec0 msgr2=0x7f0c901cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:20.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.816+0000 7f0c95855700 1 --2- 172.21.15.26:0/38750670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c90134ec0 0x7f0c901cd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:20.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.816+0000 7f0c95855700 1 -- 172.21.15.26:0/38750670 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8c009550 con 0x7f0c901380f0 2023-10-01T07:59:20.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.817+0000 7f0c95855700 1 --2- 172.21.15.26:0/38750670 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0c901380f0 0x7f0c901cd560 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f0c8800efc0 tx=0x7f0c8800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:20.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.817+0000 7f0c85ffb700 1 -- 172.21.15.26:0/38750670 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8800cc30 con 0x7f0c901380f0 2023-10-01T07:59:20.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.817+0000 7f0c972b8700 1 -- 172.21.15.26:0/38750670 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c9011d940 con 0x7f0c901380f0 2023-10-01T07:59:20.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.817+0000 7f0c85ffb700 1 -- 172.21.15.26:0/38750670 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8800f040 con 0x7f0c901380f0 2023-10-01T07:59:20.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.817+0000 7f0c85ffb700 1 -- 172.21.15.26:0/38750670 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c88009e60 con 0x7f0c901380f0 2023-10-01T07:59:20.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.817+0000 7f0c972b8700 1 -- 172.21.15.26:0/38750670 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c9011dee0 con 0x7f0c901380f0 2023-10-01T07:59:20.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.818+0000 7f0c972b8700 1 -- 172.21.15.26:0/38750670 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c90074ea0 con 0x7f0c901380f0 2023-10-01T07:59:20.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.819+0000 7f0c85ffb700 1 -- 172.21.15.26:0/38750670 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0c88014480 con 0x7f0c901380f0 2023-10-01T07:59:20.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.820+0000 7f0c85ffb700 1 -- 172.21.15.26:0/38750670 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0c88040800 con 0x7f0c901380f0 2023-10-01T07:59:20.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.824+0000 7f0c85ffb700 1 -- 172.21.15.26:0/38750670 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0c88012930 con 0x7f0c901380f0 2023-10-01T07:59:20.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.862+0000 7fb87fc86700 1 Processor -- start 2023-10-01T07:59:20.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.862+0000 7fb87fc86700 1 -- start start 2023-10-01T07:59:20.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.863+0000 7fb87fc86700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb8781338a0 0x7fb878133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:20.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.863+0000 7fb87fc86700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb87809de50 0x7fb87809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:20.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.863+0000 7fb87fc86700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb87809e760 0x7fb87813a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:20.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.863+0000 7fb87fc86700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb87806fef0 con 0x7fb87809de50 2023-10-01T07:59:20.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.863+0000 7fb87fc86700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87806ef30 con 0x7fb8781338a0 2023-10-01T07:59:20.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.863+0000 7fb87fc86700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8781334b0 con 0x7fb87809e760 2023-10-01T07:59:20.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.863+0000 7fb87da22700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb8781338a0 0x7fb878133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:20.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.863+0000 7fb87da22700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb8781338a0 0x7fb878133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44290/0 (socket says 172.21.15.26:44290) 2023-10-01T07:59:20.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.863+0000 7fb87da22700 1 -- 172.21.15.26:0/3145684054 learned_addr learned my addr 172.21.15.26:0/3145684054 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:20.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.863+0000 7fb87d221700 1 --2- 172.21.15.26:0/3145684054 >> v2:172.21.15.26:3300/0 conn(0x7fb87809de50 0x7fb87809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:20.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.863+0000 7fb87e223700 1 --2- 172.21.15.26:0/3145684054 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb87809e760 0x7fb87813a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:20.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.864+0000 7fb87da22700 1 -- 172.21.15.26:0/3145684054 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb87809e760 msgr2=0x7fb87813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:20.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.864+0000 7fb87da22700 1 --2- 172.21.15.26:0/3145684054 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb87809e760 0x7fb87813a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:20.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.864+0000 7fb87da22700 1 -- 172.21.15.26:0/3145684054 >> v2:172.21.15.26:3300/0 conn(0x7fb87809de50 msgr2=0x7fb87809e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:20.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.864+0000 7fb87da22700 1 --2- 172.21.15.26:0/3145684054 >> v2:172.21.15.26:3300/0 conn(0x7fb87809de50 0x7fb87809e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:20.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.864+0000 7fb87da22700 1 -- 172.21.15.26:0/3145684054 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb87806fc30 con 0x7fb8781338a0 2023-10-01T07:59:20.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.864+0000 7fb87da22700 1 --2- 172.21.15.26:0/3145684054 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb8781338a0 0x7fb878133c70 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fb8740098f0 tx=0x7fb874009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa7230d6b4029d87 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:20.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.864+0000 7fb87ca20700 1 -- 172.21.15.26:0/3145684054 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb874011830 con 0x7fb8781338a0 2023-10-01T07:59:20.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.864+0000 7fb87ca20700 1 -- 172.21.15.26:0/3145684054 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb874011990 con 0x7fb8781338a0 2023-10-01T07:59:20.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.864+0000 7fb87ca20700 1 -- 172.21.15.26:0/3145684054 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb874011d20 con 0x7fb8781338a0 2023-10-01T07:59:20.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.865+0000 7fb87fc86700 1 -- 172.21.15.26:0/3145684054 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb8781338a0 msgr2=0x7fb878133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:20.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.865+0000 7fb87fc86700 1 --2- 172.21.15.26:0/3145684054 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb8781338a0 0x7fb878133c70 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fb8740098f0 tx=0x7fb874009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:20.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.865+0000 7fb87fc86700 1 -- 172.21.15.26:0/3145684054 shutdown_connections 2023-10-01T07:59:20.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.865+0000 7fb87fc86700 1 --2- 172.21.15.26:0/3145684054 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb87809e760 0x7fb87813a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:20.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.865+0000 7fb87fc86700 1 --2- 172.21.15.26:0/3145684054 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb8781338a0 0x7fb878133c70 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:20.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.865+0000 7fb87fc86700 1 --2- 172.21.15.26:0/3145684054 >> v2:172.21.15.26:3300/0 conn(0x7fb87809de50 0x7fb87809e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:20.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.865+0000 7fb87fc86700 1 -- 172.21.15.26:0/3145684054 >> 172.21.15.26:0/3145684054 conn(0x7fb8780a2aa0 msgr2=0x7fb8780a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:20.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.865+0000 7fb87fc86700 1 -- 172.21.15.26:0/3145684054 shutdown_connections 2023-10-01T07:59:20.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.865+0000 7fb87fc86700 1 -- 172.21.15.26:0/3145684054 wait complete. 2023-10-01T07:59:20.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.866+0000 7fb87fc86700 1 Processor -- start 2023-10-01T07:59:20.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.866+0000 7fb87fc86700 1 -- start start 2023-10-01T07:59:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.867+0000 7fb87fc86700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb87809de50 0x7fb87811eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.867+0000 7fb87fc86700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb87809e760 0x7fb87811f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.867+0000 7fb87fc86700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb8781338a0 0x7fb87811f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.867+0000 7fb87fc86700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87806f640 con 0x7fb87809de50 2023-10-01T07:59:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.867+0000 7fb87fc86700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb878121e30 con 0x7fb87809e760 2023-10-01T07:59:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.867+0000 7fb87fc86700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8780a1020 con 0x7fb8781338a0 2023-10-01T07:59:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.867+0000 7fb87da22700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb87809de50 0x7fb87811eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.867+0000 7fb87da22700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb87809de50 0x7fb87811eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34790/0 (socket says 172.21.15.26:34790) 2023-10-01T07:59:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.867+0000 7fb87da22700 1 -- 172.21.15.26:0/3940181006 learned_addr learned my addr 172.21.15.26:0/3940181006 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.867+0000 7fb87e223700 1 --2- 172.21.15.26:0/3940181006 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb8781338a0 0x7fb87811f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.867+0000 7fb87d221700 1 --2- 172.21.15.26:0/3940181006 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb87809e760 0x7fb87811f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.867+0000 7fb87e223700 1 -- 172.21.15.26:0/3940181006 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb87809e760 msgr2=0x7fb87811f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.867+0000 7fb87e223700 1 --2- 172.21.15.26:0/3940181006 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb87809e760 0x7fb87811f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.867+0000 7fb87e223700 1 -- 172.21.15.26:0/3940181006 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb87809de50 msgr2=0x7fb87811eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.867+0000 7fb87e223700 1 --2- 172.21.15.26:0/3940181006 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb87809de50 0x7fb87811eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.867+0000 7fb87e223700 1 -- 172.21.15.26:0/3940181006 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb874009550 con 0x7fb8781338a0 2023-10-01T07:59:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.867+0000 7fb87e223700 1 --2- 172.21.15.26:0/3940181006 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb8781338a0 0x7fb87811f620 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb87000efc0 tx=0x7fb87000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:20.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.868+0000 7fb86e7fc700 1 -- 172.21.15.26:0/3940181006 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87000cc90 con 0x7fb8781338a0 2023-10-01T07:59:20.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.868+0000 7fb86e7fc700 1 -- 172.21.15.26:0/3940181006 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb87000f040 con 0x7fb8781338a0 2023-10-01T07:59:20.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.868+0000 7fb87fc86700 1 -- 172.21.15.26:0/3940181006 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb878120850 con 0x7fb8781338a0 2023-10-01T07:59:20.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.868+0000 7fb86e7fc700 1 -- 172.21.15.26:0/3940181006 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8700146c0 con 0x7fb8781338a0 2023-10-01T07:59:20.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.868+0000 7fb87fc86700 1 -- 172.21.15.26:0/3940181006 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb878122e50 con 0x7fb8781338a0 2023-10-01T07:59:20.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.869+0000 7fb87fc86700 1 -- 172.21.15.26:0/3940181006 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb878122300 con 0x7fb8781338a0 2023-10-01T07:59:20.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.869+0000 7fb86e7fc700 1 -- 172.21.15.26:0/3940181006 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb870014820 con 0x7fb8781338a0 2023-10-01T07:59:20.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.870+0000 7fb86e7fc700 1 -- 172.21.15.26:0/3940181006 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb870040700 con 0x7fb8781338a0 2023-10-01T07:59:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.878+0000 7fb86e7fc700 1 -- 172.21.15.26:0/3940181006 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb870014ad0 con 0x7fb8781338a0 2023-10-01T07:59:20.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.902+0000 7fdb0e2bc700 1 Processor -- start 2023-10-01T07:59:20.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.902+0000 7fdb0e2bc700 1 -- start start 2023-10-01T07:59:20.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.902+0000 7fdb0e2bc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb0809e930 0x7fdb0809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:20.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.902+0000 7fdb0e2bc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb0809f650 0x7fdb08131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:20.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.902+0000 7fdb0e2bc700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb08070940 con 0x7fdb0809f240 2023-10-01T07:59:20.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.902+0000 7fdb0e2bc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0806fd60 con 0x7fdb0809e930 2023-10-01T07:59:20.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.902+0000 7fdb0e2bc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0806fa80 con 0x7fdb0809f650 2023-10-01T07:59:20.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.903+0000 7fdb077fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fdb0809f240 0x7fdb081317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44248/0 (socket says 172.21.15.26:44248) 2023-10-01T07:59:20.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.903+0000 7fdb077fe700 1 -- 172.21.15.26:0/3805876886 learned_addr learned my addr 172.21.15.26:0/3805876886 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:59:20.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.903+0000 7fdb07fff700 1 --2- 172.21.15.26:0/3805876886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb0809e930 0x7fdb0809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:20.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.903+0000 7fdb0c859700 1 --2- 172.21.15.26:0/3805876886 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb0809f650 0x7fdb08131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:20.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.903+0000 7fdb0c859700 1 -- 172.21.15.26:0/3805876886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb0809e930 msgr2=0x7fdb0809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:20.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.903+0000 7fdb0c859700 1 --2- 172.21.15.26:0/3805876886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb0809e930 0x7fdb0809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:20.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.903+0000 7fdb06ffd700 1 -- 172.21.15.26:0/3805876886 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1119787934 0 0) 0x7fdb08070940 con 0x7fdb0809f240 2023-10-01T07:59:20.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.903+0000 7fdb0c859700 1 -- 172.21.15.26:0/3805876886 >> v1:172.21.15.26:6789/0 conn(0x7fdb0809f240 legacy=0x7fdb081317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:20.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.903+0000 7fdb0c859700 1 -- 172.21.15.26:0/3805876886 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0809fb60 con 0x7fdb0809f650 2023-10-01T07:59:20.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.903+0000 7fdb0c859700 1 --2- 172.21.15.26:0/3805876886 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb0809f650 0x7fdb08131f00 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fdb00009dc0 tx=0x7fdb0000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eac64ef7d7bf7ea5 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:20.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.904+0000 7fdb06ffd700 1 -- 172.21.15.26:0/3805876886 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0000e070 con 0x7fdb0809f650 2023-10-01T07:59:20.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.904+0000 7fdb06ffd700 1 -- 172.21.15.26:0/3805876886 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0000bb20 con 0x7fdb0809f650 2023-10-01T07:59:20.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.904+0000 7fdb06ffd700 1 -- 172.21.15.26:0/3805876886 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb00012430 con 0x7fdb0809f650 2023-10-01T07:59:20.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.904+0000 7fdb0e2bc700 1 -- 172.21.15.26:0/3805876886 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb0809f650 msgr2=0x7fdb08131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:20.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.904+0000 7fdb0e2bc700 1 --2- 172.21.15.26:0/3805876886 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb0809f650 0x7fdb08131f00 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fdb00009dc0 tx=0x7fdb0000b330 comp rx=0 tx=0).stop 2023-10-01T07:59:20.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.904+0000 7fdb0e2bc700 1 -- 172.21.15.26:0/3805876886 shutdown_connections 2023-10-01T07:59:20.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.904+0000 7fdb0e2bc700 1 --2- 172.21.15.26:0/3805876886 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb0809f650 0x7fdb08131f00 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:20.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.904+0000 7fdb0e2bc700 1 --2- 172.21.15.26:0/3805876886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb0809e930 0x7fdb0809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:20.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.904+0000 7fdb0e2bc700 1 -- 172.21.15.26:0/3805876886 >> 172.21.15.26:0/3805876886 conn(0x7fdb080a4210 msgr2=0x7fdb080a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:20.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.904+0000 7fdb0e2bc700 1 -- 172.21.15.26:0/3805876886 shutdown_connections 2023-10-01T07:59:20.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.904+0000 7fdb0e2bc700 1 -- 172.21.15.26:0/3805876886 wait complete. 2023-10-01T07:59:20.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.906+0000 7fdb0e2bc700 1 Processor -- start 2023-10-01T07:59:20.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.906+0000 7fdb0e2bc700 1 -- start start 2023-10-01T07:59:20.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.907+0000 7fdb0e2bc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb0809e930 0x7fdb0806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:20.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.907+0000 7fdb0e2bc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb0809f240 0x7fdb0806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:20.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.907+0000 7fdb0e2bc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb0809f650 0x7fdb0806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:20.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.907+0000 7fdb0e2bc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb081a8840 con 0x7fdb0809e930 2023-10-01T07:59:20.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.907+0000 7fdb0e2bc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb081a9880 con 0x7fdb0809f240 2023-10-01T07:59:20.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.907+0000 7fdb0e2bc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb081a9010 con 0x7fdb0809f650 2023-10-01T07:59:20.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.907+0000 7fdb07fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb0809e930 0x7fdb0806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:20.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.907+0000 7fdb07fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb0809e930 0x7fdb0806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34804/0 (socket says 172.21.15.26:34804) 2023-10-01T07:59:20.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.907+0000 7fdb07fff700 1 -- 172.21.15.26:0/687881363 learned_addr learned my addr 172.21.15.26:0/687881363 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:20.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.907+0000 7fdb0c859700 1 --2- 172.21.15.26:0/687881363 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb0809f650 0x7fdb0806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:20.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.907+0000 7fdb077fe700 1 --2- 172.21.15.26:0/687881363 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb0809f240 0x7fdb0806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:20.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.908+0000 7fdb07fff700 1 -- 172.21.15.26:0/687881363 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb0809f650 msgr2=0x7fdb0806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:20.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.908+0000 7fdb07fff700 1 --2- 172.21.15.26:0/687881363 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb0809f650 0x7fdb0806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:20.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.908+0000 7fdb07fff700 1 -- 172.21.15.26:0/687881363 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb0809f240 msgr2=0x7fdb0806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:20.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.908+0000 7fdb07fff700 1 --2- 172.21.15.26:0/687881363 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb0809f240 0x7fdb0806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:20.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.908+0000 7fdb07fff700 1 -- 172.21.15.26:0/687881363 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb00009a70 con 0x7fdb0809e930 2023-10-01T07:59:20.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.908+0000 7fdb07fff700 1 --2- 172.21.15.26:0/687881363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb0809e930 0x7fdb0806b8b0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fdaf800e9b0 tx=0x7fdaf800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:20.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.908+0000 7fdb04ff9700 1 -- 172.21.15.26:0/687881363 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf8009710 con 0x7fdb0809e930 2023-10-01T07:59:20.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.908+0000 7fdb04ff9700 1 -- 172.21.15.26:0/687881363 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf800ee50 con 0x7fdb0809e930 2023-10-01T07:59:20.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.908+0000 7fdb0e2bc700 1 -- 172.21.15.26:0/687881363 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb080a0190 con 0x7fdb0809e930 2023-10-01T07:59:20.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.908+0000 7fdb04ff9700 1 -- 172.21.15.26:0/687881363 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf800ca50 con 0x7fdb0809e930 2023-10-01T07:59:20.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.908+0000 7fdb0e2bc700 1 -- 172.21.15.26:0/687881363 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb08071d20 con 0x7fdb0809e930 2023-10-01T07:59:20.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.910+0000 7fdb04ff9700 1 -- 172.21.15.26:0/687881363 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdaf800cbb0 con 0x7fdb0809e930 2023-10-01T07:59:20.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.910+0000 7fdb0e2bc700 1 -- 172.21.15.26:0/687881363 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb081a8c50 con 0x7fdb0809e930 2023-10-01T07:59:20.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.910+0000 7fdb04ff9700 1 -- 172.21.15.26:0/687881363 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdaf803f740 con 0x7fdb0809e930 2023-10-01T07:59:20.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.915+0000 7fdb04ff9700 1 -- 172.21.15.26:0/687881363 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdaf80232f0 con 0x7fdb0809e930 2023-10-01T07:59:20.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.997+0000 7fb3bb3ac700 1 -- 172.21.15.26:0/2103276766 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb3b406b9e0 con 0x7fb3b409a3b0 2023-10-01T07:59:21.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:20.997+0000 7fb3a9ffb700 1 -- 172.21.15.26:0/2103276766 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb3a4017030 con 0x7fb3b409a3b0 2023-10-01T07:59:21.029 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:21.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.000+0000 7fb3bb3ac700 1 -- 172.21.15.26:0/2103276766 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3b409a3b0 msgr2=0x7fb3b406fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:21.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.000+0000 7fb3bb3ac700 1 --2- 172.21.15.26:0/2103276766 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3b409a3b0 0x7fb3b406fb20 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fb3a400e8e0 tx=0x7fb3a400ebf0 comp rx=0 tx=0).stop 2023-10-01T07:59:21.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.000+0000 7fb3bb3ac700 1 -- 172.21.15.26:0/2103276766 shutdown_connections 2023-10-01T07:59:21.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.000+0000 7fb3bb3ac700 1 --2- 172.21.15.26:0/2103276766 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3b4131810 0x7fb3b4070060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:21.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.000+0000 7fb3bb3ac700 1 --2- 172.21.15.26:0/2103276766 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb3b4099a40 0x7fb3b406f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:21.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.000+0000 7fb3bb3ac700 1 --2- 172.21.15.26:0/2103276766 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3b409a3b0 0x7fb3b406fb20 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:21.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.000+0000 7fb3bb3ac700 1 -- 172.21.15.26:0/2103276766 >> 172.21.15.26:0/2103276766 conn(0x7fb3b40a2aa0 msgr2=0x7fb3b412e460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:21.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.000+0000 7fb3bb3ac700 1 -- 172.21.15.26:0/2103276766 shutdown_connections 2023-10-01T07:59:21.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.000+0000 7fb3bb3ac700 1 -- 172.21.15.26:0/2103276766 wait complete. 2023-10-01T07:59:21.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:21.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.069+0000 7f0c972b8700 1 -- 172.21.15.26:0/38750670 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0c9006b250 con 0x7f0c901380f0 2023-10-01T07:59:21.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.070+0000 7f0c85ffb700 1 -- 172.21.15.26:0/38750670 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0c88012340 con 0x7f0c901380f0 2023-10-01T07:59:21.070 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:21.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.072+0000 7f0c972b8700 1 -- 172.21.15.26:0/38750670 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0c901380f0 msgr2=0x7f0c901cd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:21.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.072+0000 7f0c972b8700 1 --2- 172.21.15.26:0/38750670 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0c901380f0 0x7f0c901cd560 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f0c8800efc0 tx=0x7f0c8800c3a0 comp rx=0 tx=0).stop 2023-10-01T07:59:21.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.072+0000 7f0c972b8700 1 -- 172.21.15.26:0/38750670 shutdown_connections 2023-10-01T07:59:21.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.072+0000 7f0c972b8700 1 --2- 172.21.15.26:0/38750670 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0c901380f0 0x7f0c901cd560 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:21.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.072+0000 7f0c972b8700 1 --2- 172.21.15.26:0/38750670 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c9006c0e0 0x7f0c901ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:21.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.072+0000 7f0c972b8700 1 --2- 172.21.15.26:0/38750670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c90134ec0 0x7f0c901cd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:21.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.072+0000 7f0c972b8700 1 -- 172.21.15.26:0/38750670 >> 172.21.15.26:0/38750670 conn(0x7f0c900a4210 msgr2=0x7f0c90071960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:21.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.072+0000 7f0c972b8700 1 -- 172.21.15.26:0/38750670 shutdown_connections 2023-10-01T07:59:21.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.072+0000 7f0c972b8700 1 -- 172.21.15.26:0/38750670 wait complete. 2023-10-01T07:59:21.087 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:21.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.091+0000 7fb87fc86700 1 -- 172.21.15.26:0/3940181006 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb87806f950 con 0x7fb8781338a0 2023-10-01T07:59:21.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.092+0000 7fb86e7fc700 1 -- 172.21.15.26:0/3940181006 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb87001c3b0 con 0x7fb8781338a0 2023-10-01T07:59:21.092 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:21.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.094+0000 7fb87fc86700 1 -- 172.21.15.26:0/3940181006 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb8781338a0 msgr2=0x7fb87811f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:21.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.094+0000 7fb87fc86700 1 --2- 172.21.15.26:0/3940181006 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb8781338a0 0x7fb87811f620 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb87000efc0 tx=0x7fb87000c3a0 comp rx=0 tx=0).stop 2023-10-01T07:59:21.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.094+0000 7fb87fc86700 1 -- 172.21.15.26:0/3940181006 shutdown_connections 2023-10-01T07:59:21.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.094+0000 7fb87fc86700 1 --2- 172.21.15.26:0/3940181006 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb8781338a0 0x7fb87811f620 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:21.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.094+0000 7fb87fc86700 1 --2- 172.21.15.26:0/3940181006 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb87809de50 0x7fb87811eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:21.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.094+0000 7fb87fc86700 1 --2- 172.21.15.26:0/3940181006 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb87809e760 0x7fb87811f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:21.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.094+0000 7fb87fc86700 1 -- 172.21.15.26:0/3940181006 >> 172.21.15.26:0/3940181006 conn(0x7fb8780a2aa0 msgr2=0x7fb87809ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:21.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.094+0000 7fb87fc86700 1 -- 172.21.15.26:0/3940181006 shutdown_connections 2023-10-01T07:59:21.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.094+0000 7fb87fc86700 1 -- 172.21.15.26:0/3940181006 wait complete. 2023-10-01T07:59:21.109 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:21.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.142+0000 7fdb0e2bc700 1 -- 172.21.15.26:0/687881363 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdb08074ea0 con 0x7fdb0809e930 2023-10-01T07:59:21.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.143+0000 7fdb04ff9700 1 -- 172.21.15.26:0/687881363 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdaf8017070 con 0x7fdb0809e930 2023-10-01T07:59:21.143 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:21.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.145+0000 7fdb0e2bc700 1 -- 172.21.15.26:0/687881363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb0809e930 msgr2=0x7fdb0806b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:21.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.145+0000 7fdb0e2bc700 1 --2- 172.21.15.26:0/687881363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb0809e930 0x7fdb0806b8b0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fdaf800e9b0 tx=0x7fdaf800ecc0 comp rx=0 tx=0).stop 2023-10-01T07:59:21.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.145+0000 7fdb0e2bc700 1 -- 172.21.15.26:0/687881363 shutdown_connections 2023-10-01T07:59:21.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.145+0000 7fdb0e2bc700 1 --2- 172.21.15.26:0/687881363 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb0809f650 0x7fdb0806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:21.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.145+0000 7fdb0e2bc700 1 --2- 172.21.15.26:0/687881363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb0809e930 0x7fdb0806b8b0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:21.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.145+0000 7fdb0e2bc700 1 --2- 172.21.15.26:0/687881363 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb0809f240 0x7fdb0806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:21.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.145+0000 7fdb0e2bc700 1 -- 172.21.15.26:0/687881363 >> 172.21.15.26:0/687881363 conn(0x7fdb080a4210 msgr2=0x7fdb081b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:21.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.145+0000 7fdb0e2bc700 1 -- 172.21.15.26:0/687881363 shutdown_connections 2023-10-01T07:59:21.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:21.145+0000 7fdb0e2bc700 1 -- 172.21.15.26:0/687881363 wait complete. 2023-10-01T07:59:21.159 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:22.032 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:22.087 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:22.110 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:22.160 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:22.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.182+0000 7efff0dd0700 1 Processor -- start 2023-10-01T07:59:22.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.182+0000 7efff0dd0700 1 -- start start 2023-10-01T07:59:22.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.183+0000 7efff0dd0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7effec136710 0x7effec138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:22.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.183+0000 7efff0dd0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effec139030 0x7effec13b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:22.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.183+0000 7efff0dd0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effec06ef30 con 0x7effec1338a0 2023-10-01T07:59:22.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.183+0000 7efff0dd0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effec06fef0 con 0x7effec136710 2023-10-01T07:59:22.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.183+0000 7efff0dd0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effec1334b0 con 0x7effec139030 2023-10-01T07:59:22.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.183+0000 7effea59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7effec1338a0 0x7effec133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44254/0 (socket says 172.21.15.26:44254) 2023-10-01T07:59:22.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.183+0000 7effea59c700 1 -- 172.21.15.26:0/3235689052 learned_addr learned my addr 172.21.15.26:0/3235689052 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:59:22.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.183+0000 7effe9d9b700 1 --2- 172.21.15.26:0/3235689052 >> v2:172.21.15.26:3300/0 conn(0x7effec136710 0x7effec138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:22.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.184+0000 7effead9d700 1 --2- 172.21.15.26:0/3235689052 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effec139030 0x7effec13b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:22.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.184+0000 7effe9d9b700 1 -- 172.21.15.26:0/3235689052 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effec139030 msgr2=0x7effec13b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:22.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.184+0000 7effe9d9b700 1 --2- 172.21.15.26:0/3235689052 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effec139030 0x7effec13b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:22.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.184+0000 7effe9d9b700 1 -- 172.21.15.26:0/3235689052 >> v1:172.21.15.26:6789/0 conn(0x7effec1338a0 legacy=0x7effec133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:22.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.184+0000 7effe9d9b700 1 -- 172.21.15.26:0/3235689052 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effec06fc30 con 0x7effec136710 2023-10-01T07:59:22.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.184+0000 7effead9d700 1 --2- 172.21.15.26:0/3235689052 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effec139030 0x7effec13b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:22.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.184+0000 7effe9d9b700 1 --2- 172.21.15.26:0/3235689052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effec136710 0x7effec138af0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7effe0009840 tx=0x7effe0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c3f6986fd9c71 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:22.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.184+0000 7effe959a700 1 -- 172.21.15.26:0/3235689052 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe0011830 con 0x7effec136710 2023-10-01T07:59:22.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.184+0000 7effe959a700 1 -- 172.21.15.26:0/3235689052 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe0011990 con 0x7effec136710 2023-10-01T07:59:22.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.185+0000 7effe959a700 1 -- 172.21.15.26:0/3235689052 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe0011d20 con 0x7effec136710 2023-10-01T07:59:22.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.185+0000 7efff0dd0700 1 -- 172.21.15.26:0/3235689052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effec136710 msgr2=0x7effec138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:22.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.185+0000 7efff0dd0700 1 --2- 172.21.15.26:0/3235689052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effec136710 0x7effec138af0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7effe0009840 tx=0x7effe0009b50 comp rx=0 tx=0).stop 2023-10-01T07:59:22.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.185+0000 7efff0dd0700 1 -- 172.21.15.26:0/3235689052 shutdown_connections 2023-10-01T07:59:22.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.186+0000 7efff0dd0700 1 --2- 172.21.15.26:0/3235689052 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effec139030 0x7effec13b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:22.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.186+0000 7efff0dd0700 1 --2- 172.21.15.26:0/3235689052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effec136710 0x7effec138af0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:22.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.186+0000 7efff0dd0700 1 -- 172.21.15.26:0/3235689052 >> 172.21.15.26:0/3235689052 conn(0x7effec0a2aa0 msgr2=0x7effec0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:22.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.186+0000 7efff0dd0700 1 -- 172.21.15.26:0/3235689052 shutdown_connections 2023-10-01T07:59:22.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.186+0000 7efff0dd0700 1 -- 172.21.15.26:0/3235689052 wait complete. 2023-10-01T07:59:22.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.187+0000 7efff0dd0700 1 Processor -- start 2023-10-01T07:59:22.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.187+0000 7efff0dd0700 1 -- start start 2023-10-01T07:59:22.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.187+0000 7efff0dd0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effec1338a0 0x7effec11ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:22.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.187+0000 7efff0dd0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effec136710 0x7effec11b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:22.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.187+0000 7efff0dd0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effec139030 0x7effec11b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:22.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.187+0000 7efff0dd0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec11cad0 con 0x7effec136710 2023-10-01T07:59:22.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.187+0000 7efff0dd0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effec11e330 con 0x7effec1338a0 2023-10-01T07:59:22.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.187+0000 7efff0dd0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effec138b00 con 0x7effec139030 2023-10-01T07:59:22.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.188+0000 7effead9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effec139030 0x7effec11b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:22.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.188+0000 7effead9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effec139030 0x7effec11b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56790/0 (socket says 172.21.15.26:56790) 2023-10-01T07:59:22.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.188+0000 7effead9d700 1 -- 172.21.15.26:0/794921925 learned_addr learned my addr 172.21.15.26:0/794921925 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:22.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.188+0000 7effe9d9b700 1 --2- 172.21.15.26:0/794921925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effec136710 0x7effec11b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:22.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.188+0000 7effead9d700 1 -- 172.21.15.26:0/794921925 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effec1338a0 msgr2=0x7effec11ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:22.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.188+0000 7effead9d700 1 --2- 172.21.15.26:0/794921925 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effec1338a0 0x7effec11ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:22.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.188+0000 7effead9d700 1 -- 172.21.15.26:0/794921925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effec136710 msgr2=0x7effec11b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:22.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.188+0000 7effead9d700 1 --2- 172.21.15.26:0/794921925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effec136710 0x7effec11b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:22.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.188+0000 7effead9d700 1 -- 172.21.15.26:0/794921925 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe4009a70 con 0x7effec139030 2023-10-01T07:59:22.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.188+0000 7effe9d9b700 1 --2- 172.21.15.26:0/794921925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effec136710 0x7effec11b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:59:22.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.189+0000 7effead9d700 1 --2- 172.21.15.26:0/794921925 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effec139030 0x7effec11b8d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7effe400efc0 tx=0x7effe400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:22.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.189+0000 7effdaffd700 1 -- 172.21.15.26:0/794921925 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe4009d70 con 0x7effec139030 2023-10-01T07:59:22.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.189+0000 7effdaffd700 1 -- 172.21.15.26:0/794921925 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe400f040 con 0x7effec139030 2023-10-01T07:59:22.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.189+0000 7effdaffd700 1 -- 172.21.15.26:0/794921925 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe400ce00 con 0x7effec139030 2023-10-01T07:59:22.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.190+0000 7efff0dd0700 1 -- 172.21.15.26:0/794921925 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effe00094a0 con 0x7effec139030 2023-10-01T07:59:22.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.190+0000 7efff0dd0700 1 -- 172.21.15.26:0/794921925 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effec11f060 con 0x7effec139030 2023-10-01T07:59:22.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.191+0000 7efff0dd0700 1 -- 172.21.15.26:0/794921925 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effec074ea0 con 0x7effec139030 2023-10-01T07:59:22.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.191+0000 7effdaffd700 1 -- 172.21.15.26:0/794921925 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7effe4014480 con 0x7effec139030 2023-10-01T07:59:22.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.191+0000 7effdaffd700 1 -- 172.21.15.26:0/794921925 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7effe4014730 con 0x7effec139030 2023-10-01T07:59:22.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.201+0000 7effdaffd700 1 -- 172.21.15.26:0/794921925 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7effe4045060 con 0x7effec139030 2023-10-01T07:59:22.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.248+0000 7f809759e700 1 Processor -- start 2023-10-01T07:59:22.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.248+0000 7f809759e700 1 -- start start 2023-10-01T07:59:22.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.249+0000 7f809759e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f809809d800 0x7f809809dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:22.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.249+0000 7f809759e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f809809e110 0x7f8098133860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:22.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.249+0000 7f809759e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8098099e10 con 0x7f8098133da0 2023-10-01T07:59:22.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.249+0000 7f809759e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f809809f560 con 0x7f809809d800 2023-10-01T07:59:22.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.249+0000 7f809759e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809806b4d0 con 0x7f809809e110 2023-10-01T07:59:22.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.250+0000 7f8095d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f809809e110 0x7f8098133860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:22.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.250+0000 7f8096d9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8098133da0 0x7f809813aab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44258/0 (socket says 172.21.15.26:44258) 2023-10-01T07:59:22.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.250+0000 7f809659c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f809809d800 0x7f809809dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:22.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.250+0000 7f8096d9d700 1 -- 172.21.15.26:0/1049797058 learned_addr learned my addr 172.21.15.26:0/1049797058 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:59:22.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.250+0000 7f809659c700 1 -- 172.21.15.26:0/1049797058 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f809809e110 msgr2=0x7f8098133860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:22.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.250+0000 7f809659c700 1 --2- 172.21.15.26:0/1049797058 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f809809e110 0x7f8098133860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:22.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.250+0000 7f809659c700 1 -- 172.21.15.26:0/1049797058 >> v1:172.21.15.26:6789/0 conn(0x7f8098133da0 legacy=0x7f809813aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:22.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.250+0000 7f809559a700 1 -- 172.21.15.26:0/1049797058 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2577101438 0 0) 0x7f8098099e10 con 0x7f8098133da0 2023-10-01T07:59:22.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.250+0000 7f809659c700 1 -- 172.21.15.26:0/1049797058 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809809a060 con 0x7f809809d800 2023-10-01T07:59:22.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.250+0000 7f8095d9b700 1 --2- 172.21.15.26:0/1049797058 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f809809e110 0x7f8098133860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:22.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.250+0000 7f809659c700 1 --2- 172.21.15.26:0/1049797058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f809809d800 0x7f809809dbd0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f8088009840 tx=0x7f8088009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=893b2347ee28631f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:22.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.251+0000 7f809559a700 1 -- 172.21.15.26:0/1049797058 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8088011830 con 0x7f809809d800 2023-10-01T07:59:22.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.251+0000 7f809559a700 1 -- 172.21.15.26:0/1049797058 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8088011990 con 0x7f809809d800 2023-10-01T07:59:22.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.251+0000 7f809559a700 1 -- 172.21.15.26:0/1049797058 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8088011d20 con 0x7f809809d800 2023-10-01T07:59:22.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.252+0000 7f809759e700 1 -- 172.21.15.26:0/1049797058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f809809d800 msgr2=0x7f809809dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:22.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.252+0000 7f809759e700 1 --2- 172.21.15.26:0/1049797058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f809809d800 0x7f809809dbd0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f8088009840 tx=0x7f8088009b50 comp rx=0 tx=0).stop 2023-10-01T07:59:22.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.252+0000 7f809759e700 1 -- 172.21.15.26:0/1049797058 shutdown_connections 2023-10-01T07:59:22.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.252+0000 7f809759e700 1 --2- 172.21.15.26:0/1049797058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f809809d800 0x7f809809dbd0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:22.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.252+0000 7f809759e700 1 --2- 172.21.15.26:0/1049797058 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f809809e110 0x7f8098133860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:22.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.252+0000 7f809759e700 1 -- 172.21.15.26:0/1049797058 >> 172.21.15.26:0/1049797058 conn(0x7f80980a2e20 msgr2=0x7f80980a3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:22.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.252+0000 7f809759e700 1 -- 172.21.15.26:0/1049797058 shutdown_connections 2023-10-01T07:59:22.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.252+0000 7f809759e700 1 -- 172.21.15.26:0/1049797058 wait complete. 2023-10-01T07:59:22.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.254+0000 7f809759e700 1 Processor -- start 2023-10-01T07:59:22.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.254+0000 7f809759e700 1 -- start start 2023-10-01T07:59:22.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.254+0000 7f809759e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f809809d800 0x7f80981c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:22.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.254+0000 7f809759e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f809809e110 0x7f80981c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:22.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.254+0000 7f809759e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8098133da0 0x7f809811ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:22.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.254+0000 7f809759e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80981220f0 con 0x7f8098133da0 2023-10-01T07:59:22.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.254+0000 7f809759e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80981c9170 con 0x7f809809d800 2023-10-01T07:59:22.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.254+0000 7f809759e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8098133390 con 0x7f809809e110 2023-10-01T07:59:22.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.255+0000 7f809659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f809809d800 0x7f80981c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:22.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.255+0000 7f809659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f809809d800 0x7f80981c86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44336/0 (socket says 172.21.15.26:44336) 2023-10-01T07:59:22.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.255+0000 7f809659c700 1 -- 172.21.15.26:0/4257755750 learned_addr learned my addr 172.21.15.26:0/4257755750 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:22.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.255+0000 7f8095d9b700 1 --2- 172.21.15.26:0/4257755750 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f809809e110 0x7f80981c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:22.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.255+0000 7f8096d9d700 1 --2- 172.21.15.26:0/4257755750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8098133da0 0x7f809811ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:22.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.255+0000 7f8095d9b700 1 -- 172.21.15.26:0/4257755750 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f809809d800 msgr2=0x7f80981c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:22.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.255+0000 7f8095d9b700 1 --2- 172.21.15.26:0/4257755750 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f809809d800 0x7f80981c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:22.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.255+0000 7f8095d9b700 1 -- 172.21.15.26:0/4257755750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8098133da0 msgr2=0x7f809811ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:22.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.255+0000 7f8095d9b700 1 --2- 172.21.15.26:0/4257755750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8098133da0 0x7f809811ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:22.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.255+0000 7f8095d9b700 1 -- 172.21.15.26:0/4257755750 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f808c009430 con 0x7f809809e110 2023-10-01T07:59:22.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.255+0000 7f8095d9b700 1 --2- 172.21.15.26:0/4257755750 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f809809e110 0x7f80981c8c30 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f808c00e9b0 tx=0x7f808c00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:22.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.256+0000 7f8086ffd700 1 -- 172.21.15.26:0/4257755750 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c00ee50 con 0x7f809809e110 2023-10-01T07:59:22.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.256+0000 7f809759e700 1 -- 172.21.15.26:0/4257755750 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80880094a0 con 0x7f809809e110 2023-10-01T07:59:22.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.256+0000 7f809759e700 1 -- 172.21.15.26:0/4257755750 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f809809e570 con 0x7f809809e110 2023-10-01T07:59:22.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.256+0000 7f8086ffd700 1 -- 172.21.15.26:0/4257755750 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808c005a20 con 0x7f809809e110 2023-10-01T07:59:22.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.256+0000 7f8086ffd700 1 -- 172.21.15.26:0/4257755750 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c005d90 con 0x7f809809e110 2023-10-01T07:59:22.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.257+0000 7f809759e700 1 -- 172.21.15.26:0/4257755750 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f807c0052e0 con 0x7f809809e110 2023-10-01T07:59:22.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.258+0000 7f8086ffd700 1 -- 172.21.15.26:0/4257755750 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f808c00c850 con 0x7f809809e110 2023-10-01T07:59:22.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.258+0000 7f8086ffd700 1 -- 172.21.15.26:0/4257755750 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f808c03fdd0 con 0x7f809809e110 2023-10-01T07:59:22.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.266+0000 7f8086ffd700 1 -- 172.21.15.26:0/4257755750 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f808c006030 con 0x7f809809e110 2023-10-01T07:59:22.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.287+0000 7f38a9775700 1 Processor -- start 2023-10-01T07:59:22.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.287+0000 7f38a9775700 1 -- start start 2023-10-01T07:59:22.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.288+0000 7f38a9775700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f38a409d6f0 0x7f38a409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:22.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.288+0000 7f38a9775700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f38a409e410 0x7f38a4130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:22.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.288+0000 7f38a9775700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38a409f130 con 0x7f38a409e000 2023-10-01T07:59:22.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.288+0000 7f38a9775700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a409f520 con 0x7f38a409e410 2023-10-01T07:59:22.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.288+0000 7f38a9775700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38a409e930 con 0x7f38a409d6f0 2023-10-01T07:59:22.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.288+0000 7f38a27fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f38a409e000 0x7f38a4130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44272/0 (socket says 172.21.15.26:44272) 2023-10-01T07:59:22.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.288+0000 7f38a27fc700 1 -- 172.21.15.26:0/1051560287 learned_addr learned my addr 172.21.15.26:0/1051560287 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:59:22.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.288+0000 7f38a37fe700 1 --2- 172.21.15.26:0/1051560287 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f38a409e410 0x7f38a4130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:22.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.288+0000 7f38a2ffd700 1 --2- 172.21.15.26:0/1051560287 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f38a409d6f0 0x7f38a409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:22.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.288+0000 7f38a1ffb700 1 -- 172.21.15.26:0/1051560287 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2162629865 0 0) 0x7f38a409f130 con 0x7f38a409e000 2023-10-01T07:59:22.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.288+0000 7f38a1ffb700 1 -- 172.21.15.26:0/1051560287 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f388c0035b0 con 0x7f38a409e000 2023-10-01T07:59:22.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.288+0000 7f38a37fe700 1 -- 172.21.15.26:0/1051560287 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f38a409d6f0 msgr2=0x7f38a409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:22.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.288+0000 7f38a37fe700 1 --2- 172.21.15.26:0/1051560287 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f38a409d6f0 0x7f38a409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:22.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.288+0000 7f38a37fe700 1 -- 172.21.15.26:0/1051560287 >> v1:172.21.15.26:6789/0 conn(0x7f38a409e000 legacy=0x7f38a4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:22.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.288+0000 7f38a37fe700 1 -- 172.21.15.26:0/1051560287 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a409b2d0 con 0x7f38a409e410 2023-10-01T07:59:22.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.289+0000 7f38a37fe700 1 --2- 172.21.15.26:0/1051560287 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f38a409e410 0x7f38a4130d70 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f389c009dc0 tx=0x7f389c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d822348afac9bf5e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:22.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.289+0000 7f38a1ffb700 1 -- 172.21.15.26:0/1051560287 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c00e070 con 0x7f38a409e410 2023-10-01T07:59:22.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.289+0000 7f38a1ffb700 1 -- 172.21.15.26:0/1051560287 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389c00bb20 con 0x7f38a409e410 2023-10-01T07:59:22.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.289+0000 7f38a1ffb700 1 -- 172.21.15.26:0/1051560287 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c012430 con 0x7f38a409e410 2023-10-01T07:59:22.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.290+0000 7f38a9775700 1 -- 172.21.15.26:0/1051560287 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f38a409e410 msgr2=0x7f38a4130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:22.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.290+0000 7f38a9775700 1 --2- 172.21.15.26:0/1051560287 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f38a409e410 0x7f38a4130d70 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f389c009dc0 tx=0x7f389c00b330 comp rx=0 tx=0).stop 2023-10-01T07:59:22.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.290+0000 7f38a9775700 1 -- 172.21.15.26:0/1051560287 shutdown_connections 2023-10-01T07:59:22.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.290+0000 7f38a9775700 1 --2- 172.21.15.26:0/1051560287 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f38a409d6f0 0x7f38a409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:22.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.290+0000 7f38a9775700 1 --2- 172.21.15.26:0/1051560287 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f38a409e410 0x7f38a4130d70 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:22.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.290+0000 7f38a9775700 1 -- 172.21.15.26:0/1051560287 >> 172.21.15.26:0/1051560287 conn(0x7f38a4066f50 msgr2=0x7f38a409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:22.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.290+0000 7f38a9775700 1 -- 172.21.15.26:0/1051560287 shutdown_connections 2023-10-01T07:59:22.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.290+0000 7f38a9775700 1 -- 172.21.15.26:0/1051560287 wait complete. 2023-10-01T07:59:22.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.291+0000 7f38a9775700 1 Processor -- start 2023-10-01T07:59:22.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.291+0000 7f38a9775700 1 -- start start 2023-10-01T07:59:22.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.292+0000 7f38a9775700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f38a409d6f0 0x7f38a4130d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:22.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.292+0000 7f38a9775700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f38a409e000 0x7f38a4136a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:22.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.292+0000 7f38a9775700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38a409e410 0x7f38a4136fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:22.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.292+0000 7f38a9775700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a413a2a0 con 0x7f38a409e410 2023-10-01T07:59:22.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.292+0000 7f38a9775700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a413b270 con 0x7f38a409d6f0 2023-10-01T07:59:22.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.292+0000 7f38a9775700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38a40a3850 con 0x7f38a409e000 2023-10-01T07:59:22.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.292+0000 7f38a2ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f38a409d6f0 0x7f38a4130d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:22.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.292+0000 7f38a2ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f38a409d6f0 0x7f38a4130d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44348/0 (socket says 172.21.15.26:44348) 2023-10-01T07:59:22.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.292+0000 7f38a2ffd700 1 -- 172.21.15.26:0/2050687910 learned_addr learned my addr 172.21.15.26:0/2050687910 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:22.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.292+0000 7f38a27fc700 1 --2- 172.21.15.26:0/2050687910 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f38a409e000 0x7f38a4136a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:22.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.292+0000 7f38a37fe700 1 --2- 172.21.15.26:0/2050687910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38a409e410 0x7f38a4136fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:22.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.292+0000 7f38a2ffd700 1 -- 172.21.15.26:0/2050687910 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f38a409e000 msgr2=0x7f38a4136a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:22.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.292+0000 7f38a2ffd700 1 --2- 172.21.15.26:0/2050687910 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f38a409e000 0x7f38a4136a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:22.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.292+0000 7f38a2ffd700 1 -- 172.21.15.26:0/2050687910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38a409e410 msgr2=0x7f38a4136fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:22.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.292+0000 7f38a2ffd700 1 --2- 172.21.15.26:0/2050687910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38a409e410 0x7f38a4136fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:22.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.292+0000 7f38a2ffd700 1 -- 172.21.15.26:0/2050687910 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f389c009a70 con 0x7f38a409d6f0 2023-10-01T07:59:22.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.293+0000 7f38a2ffd700 1 --2- 172.21.15.26:0/2050687910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f38a409d6f0 0x7f38a4130d30 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f389400e810 tx=0x7f389400eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:22.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.293+0000 7f388b7fe700 1 -- 172.21.15.26:0/2050687910 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3894013610 con 0x7f38a409d6f0 2023-10-01T07:59:22.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.293+0000 7f388b7fe700 1 -- 172.21.15.26:0/2050687910 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3894013770 con 0x7f38a409d6f0 2023-10-01T07:59:22.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.293+0000 7f388b7fe700 1 -- 172.21.15.26:0/2050687910 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3894013b00 con 0x7f38a409d6f0 2023-10-01T07:59:22.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.293+0000 7f38a9775700 1 -- 172.21.15.26:0/2050687910 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a4138e60 con 0x7f38a409d6f0 2023-10-01T07:59:22.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.293+0000 7f38a9775700 1 -- 172.21.15.26:0/2050687910 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a413ad10 con 0x7f38a409d6f0 2023-10-01T07:59:22.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.294+0000 7f38a9775700 1 -- 172.21.15.26:0/2050687910 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a4131290 con 0x7f38a409d6f0 2023-10-01T07:59:22.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.295+0000 7f388b7fe700 1 -- 172.21.15.26:0/2050687910 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3894013c60 con 0x7f38a409d6f0 2023-10-01T07:59:22.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.295+0000 7f388b7fe700 1 -- 172.21.15.26:0/2050687910 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f389403f6c0 con 0x7f38a409d6f0 2023-10-01T07:59:22.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.299+0000 7f388b7fe700 1 -- 172.21.15.26:0/2050687910 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f389400f040 con 0x7f38a409d6f0 2023-10-01T07:59:22.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.345+0000 7f884e4e0700 1 Processor -- start 2023-10-01T07:59:22.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.345+0000 7f884e4e0700 1 -- start start 2023-10-01T07:59:22.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.345+0000 7f884e4e0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f884809e930 0x7f884809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:22.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.345+0000 7f884e4e0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f884809f240 0x7f88481317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:22.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.345+0000 7f884e4e0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8848070940 con 0x7f884809f650 2023-10-01T07:59:22.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.345+0000 7f884e4e0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f884806fd60 con 0x7f884809e930 2023-10-01T07:59:22.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.345+0000 7f884e4e0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f884806fa80 con 0x7f884809f240 2023-10-01T07:59:22.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.345+0000 7f8847fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f884809e930 0x7f884809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:22.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.345+0000 7f8847fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f884809e930 0x7f884809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34866/0 (socket says 172.21.15.26:34866) 2023-10-01T07:59:22.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.346+0000 7f8847fff700 1 -- 172.21.15.26:0/1724061569 learned_addr learned my addr 172.21.15.26:0/1724061569 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:22.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.346+0000 7f88477fe700 1 --2- 172.21.15.26:0/1724061569 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f884809f240 0x7f88481317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:22.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.346+0000 7f8847fff700 1 -- 172.21.15.26:0/1724061569 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f884809f240 msgr2=0x7f88481317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:22.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.346+0000 7f8847fff700 1 --2- 172.21.15.26:0/1724061569 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f884809f240 0x7f88481317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:22.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.346+0000 7f8847fff700 1 -- 172.21.15.26:0/1724061569 >> v1:172.21.15.26:6789/0 conn(0x7f884809f650 legacy=0x7f8848131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:22.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.346+0000 7f8847fff700 1 -- 172.21.15.26:0/1724061569 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884809fb60 con 0x7f884809e930 2023-10-01T07:59:22.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.346+0000 7f88477fe700 1 --2- 172.21.15.26:0/1724061569 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f884809f240 0x7f88481317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:22.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.346+0000 7f8847fff700 1 --2- 172.21.15.26:0/1724061569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f884809e930 0x7f884809ed00 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f88380098f0 tx=0x7f8838009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68502c7badf1c171 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:22.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.346+0000 7f8846ffd700 1 -- 172.21.15.26:0/1724061569 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8838004230 con 0x7f884809e930 2023-10-01T07:59:22.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.346+0000 7f8846ffd700 1 -- 172.21.15.26:0/1724061569 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8838004390 con 0x7f884809e930 2023-10-01T07:59:22.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.346+0000 7f8846ffd700 1 -- 172.21.15.26:0/1724061569 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88380036a0 con 0x7f884809e930 2023-10-01T07:59:22.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.347+0000 7f884e4e0700 1 -- 172.21.15.26:0/1724061569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f884809e930 msgr2=0x7f884809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:22.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.347+0000 7f884e4e0700 1 --2- 172.21.15.26:0/1724061569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f884809e930 0x7f884809ed00 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f88380098f0 tx=0x7f8838009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:22.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.347+0000 7f884e4e0700 1 -- 172.21.15.26:0/1724061569 shutdown_connections 2023-10-01T07:59:22.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.347+0000 7f884e4e0700 1 --2- 172.21.15.26:0/1724061569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f884809e930 0x7f884809ed00 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:22.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.347+0000 7f884e4e0700 1 --2- 172.21.15.26:0/1724061569 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f884809f240 0x7f88481317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:22.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.347+0000 7f884e4e0700 1 -- 172.21.15.26:0/1724061569 >> 172.21.15.26:0/1724061569 conn(0x7f88480a4210 msgr2=0x7f88480a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:22.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.347+0000 7f884e4e0700 1 -- 172.21.15.26:0/1724061569 shutdown_connections 2023-10-01T07:59:22.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.347+0000 7f884e4e0700 1 -- 172.21.15.26:0/1724061569 wait complete. 2023-10-01T07:59:22.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.349+0000 7f884e4e0700 1 Processor -- start 2023-10-01T07:59:22.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.349+0000 7f884e4e0700 1 -- start start 2023-10-01T07:59:22.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.350+0000 7f884e4e0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f884809e930 0x7f88481a3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:22.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.350+0000 7f884e4e0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f884809f240 0x7f88481a4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:22.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.350+0000 7f884e4e0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f884809f650 0x7f88481a4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:22.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.350+0000 7f884e4e0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88481a5ec0 con 0x7f884809f650 2023-10-01T07:59:22.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.350+0000 7f884e4e0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88481a6f80 con 0x7f884809f240 2023-10-01T07:59:22.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.350+0000 7f884e4e0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8848071d20 con 0x7f884809e930 2023-10-01T07:59:22.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.350+0000 7f884ca7d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f884809f650 0x7f88481a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:22.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.350+0000 7f884ca7d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f884809f650 0x7f88481a4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34868/0 (socket says 172.21.15.26:34868) 2023-10-01T07:59:22.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.350+0000 7f884ca7d700 1 -- 172.21.15.26:0/2972504683 learned_addr learned my addr 172.21.15.26:0/2972504683 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:22.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.350+0000 7f88477fe700 1 --2- 172.21.15.26:0/2972504683 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f884809f240 0x7f88481a4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:22.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.350+0000 7f8847fff700 1 --2- 172.21.15.26:0/2972504683 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f884809e930 0x7f88481a3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:22.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.350+0000 7f884ca7d700 1 -- 172.21.15.26:0/2972504683 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f884809e930 msgr2=0x7f88481a3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:22.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.350+0000 7f884ca7d700 1 --2- 172.21.15.26:0/2972504683 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f884809e930 0x7f88481a3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:22.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.350+0000 7f884ca7d700 1 -- 172.21.15.26:0/2972504683 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f884809f240 msgr2=0x7f88481a4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:22.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.350+0000 7f884ca7d700 1 --2- 172.21.15.26:0/2972504683 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f884809f240 0x7f88481a4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:22.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.350+0000 7f884ca7d700 1 -- 172.21.15.26:0/2972504683 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883c0094a0 con 0x7f884809f650 2023-10-01T07:59:22.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.351+0000 7f884ca7d700 1 --2- 172.21.15.26:0/2972504683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f884809f650 0x7f88481a4750 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f884000cc10 tx=0x7f884000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:22.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.351+0000 7f88477fe700 1 --2- 172.21.15.26:0/2972504683 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f884809f240 0x7f88481a4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:59:22.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.351+0000 7f8844ff9700 1 -- 172.21.15.26:0/2972504683 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884000ab10 con 0x7f884809f650 2023-10-01T07:59:22.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.351+0000 7f8844ff9700 1 -- 172.21.15.26:0/2972504683 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884000ac70 con 0x7f884809f650 2023-10-01T07:59:22.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.351+0000 7f8844ff9700 1 -- 172.21.15.26:0/2972504683 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8840012420 con 0x7f884809f650 2023-10-01T07:59:22.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.351+0000 7f884e4e0700 1 -- 172.21.15.26:0/2972504683 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8838009550 con 0x7f884809f650 2023-10-01T07:59:22.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.351+0000 7f884e4e0700 1 -- 172.21.15.26:0/2972504683 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88480a0190 con 0x7f884809f650 2023-10-01T07:59:22.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.352+0000 7f8844ff9700 1 -- 172.21.15.26:0/2972504683 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8840012580 con 0x7f884809f650 2023-10-01T07:59:22.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.352+0000 7f8844ff9700 1 -- 172.21.15.26:0/2972504683 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f884003faa0 con 0x7f884809f650 2023-10-01T07:59:22.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.352+0000 7f884e4e0700 1 -- 172.21.15.26:0/2972504683 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88481a71b0 con 0x7f884809f650 2023-10-01T07:59:22.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.361+0000 7f8844ff9700 1 -- 172.21.15.26:0/2972504683 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f88481a71b0 con 0x7f884809f650 2023-10-01T07:59:22.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.425+0000 7efff0dd0700 1 -- 172.21.15.26:0/794921925 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7effec06b9e0 con 0x7effec139030 2023-10-01T07:59:22.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.426+0000 7effdaffd700 1 -- 172.21.15.26:0/794921925 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7effe4031090 con 0x7effec139030 2023-10-01T07:59:22.427 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:22.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.428+0000 7efff0dd0700 1 -- 172.21.15.26:0/794921925 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effec139030 msgr2=0x7effec11b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:22.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.428+0000 7efff0dd0700 1 --2- 172.21.15.26:0/794921925 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effec139030 0x7effec11b8d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7effe400efc0 tx=0x7effe400c3a0 comp rx=0 tx=0).stop 2023-10-01T07:59:22.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.428+0000 7efff0dd0700 1 -- 172.21.15.26:0/794921925 shutdown_connections 2023-10-01T07:59:22.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.428+0000 7efff0dd0700 1 --2- 172.21.15.26:0/794921925 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effec139030 0x7effec11b8d0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:22.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.428+0000 7efff0dd0700 1 --2- 172.21.15.26:0/794921925 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effec1338a0 0x7effec11ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:22.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.428+0000 7efff0dd0700 1 --2- 172.21.15.26:0/794921925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effec136710 0x7effec11b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:22.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.428+0000 7efff0dd0700 1 -- 172.21.15.26:0/794921925 >> 172.21.15.26:0/794921925 conn(0x7effec0a2aa0 msgr2=0x7effec137360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:22.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.429+0000 7efff0dd0700 1 -- 172.21.15.26:0/794921925 shutdown_connections 2023-10-01T07:59:22.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.429+0000 7efff0dd0700 1 -- 172.21.15.26:0/794921925 wait complete. 2023-10-01T07:59:22.444 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:22.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.480+0000 7f809759e700 1 -- 172.21.15.26:0/4257755750 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f807c005590 con 0x7f809809e110 2023-10-01T07:59:22.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.480+0000 7f8086ffd700 1 -- 172.21.15.26:0/4257755750 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f808c024b90 con 0x7f809809e110 2023-10-01T07:59:22.481 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:22.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.483+0000 7f809759e700 1 -- 172.21.15.26:0/4257755750 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f809809e110 msgr2=0x7f80981c8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:22.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.483+0000 7f809759e700 1 --2- 172.21.15.26:0/4257755750 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f809809e110 0x7f80981c8c30 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f808c00e9b0 tx=0x7f808c00ecc0 comp rx=0 tx=0).stop 2023-10-01T07:59:22.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.483+0000 7f809759e700 1 -- 172.21.15.26:0/4257755750 shutdown_connections 2023-10-01T07:59:22.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.483+0000 7f809759e700 1 --2- 172.21.15.26:0/4257755750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8098133da0 0x7f809811ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:22.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.483+0000 7f809759e700 1 --2- 172.21.15.26:0/4257755750 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f809809d800 0x7f80981c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:22.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.483+0000 7f809759e700 1 --2- 172.21.15.26:0/4257755750 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f809809e110 0x7f80981c8c30 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:22.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.483+0000 7f809759e700 1 -- 172.21.15.26:0/4257755750 >> 172.21.15.26:0/4257755750 conn(0x7f80980a2e20 msgr2=0x7f809806eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:22.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.483+0000 7f809759e700 1 -- 172.21.15.26:0/4257755750 shutdown_connections 2023-10-01T07:59:22.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.483+0000 7f809759e700 1 -- 172.21.15.26:0/4257755750 wait complete. 2023-10-01T07:59:22.498 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:22.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.539+0000 7f38a9775700 1 -- 172.21.15.26:0/2050687910 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f38a4131290 con 0x7f38a409d6f0 2023-10-01T07:59:22.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.539+0000 7f388b7fe700 1 -- 172.21.15.26:0/2050687910 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f38a4131290 con 0x7f38a409d6f0 2023-10-01T07:59:22.540 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:22.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.542+0000 7f38a9775700 1 -- 172.21.15.26:0/2050687910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f38a409d6f0 msgr2=0x7f38a4130d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:22.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.542+0000 7f38a9775700 1 --2- 172.21.15.26:0/2050687910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f38a409d6f0 0x7f38a4130d30 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f389400e810 tx=0x7f389400eb20 comp rx=0 tx=0).stop 2023-10-01T07:59:22.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.542+0000 7f38a9775700 1 -- 172.21.15.26:0/2050687910 shutdown_connections 2023-10-01T07:59:22.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.542+0000 7f38a9775700 1 --2- 172.21.15.26:0/2050687910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38a409e410 0x7f38a4136fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:22.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.542+0000 7f38a9775700 1 --2- 172.21.15.26:0/2050687910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f38a409d6f0 0x7f38a4130d30 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:22.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.542+0000 7f38a9775700 1 --2- 172.21.15.26:0/2050687910 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f38a409e000 0x7f38a4136a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:22.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.542+0000 7f38a9775700 1 -- 172.21.15.26:0/2050687910 >> 172.21.15.26:0/2050687910 conn(0x7f38a4066f50 msgr2=0x7f38a4070dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:22.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.542+0000 7f38a9775700 1 -- 172.21.15.26:0/2050687910 shutdown_connections 2023-10-01T07:59:22.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.542+0000 7f38a9775700 1 -- 172.21.15.26:0/2050687910 wait complete. 2023-10-01T07:59:22.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:22.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.590+0000 7f884e4e0700 1 -- 172.21.15.26:0/2972504683 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f88481a71b0 con 0x7f884809f650 2023-10-01T07:59:22.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.590+0000 7f8844ff9700 1 -- 172.21.15.26:0/2972504683 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8840019960 con 0x7f884809f650 2023-10-01T07:59:22.591 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:22.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.592+0000 7f884e4e0700 1 -- 172.21.15.26:0/2972504683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f884809f650 msgr2=0x7f88481a4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:22.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.592+0000 7f884e4e0700 1 --2- 172.21.15.26:0/2972504683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f884809f650 0x7f88481a4750 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f884000cc10 tx=0x7f884000cf20 comp rx=0 tx=0).stop 2023-10-01T07:59:22.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.592+0000 7f884e4e0700 1 -- 172.21.15.26:0/2972504683 shutdown_connections 2023-10-01T07:59:22.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.592+0000 7f884e4e0700 1 --2- 172.21.15.26:0/2972504683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f884809f650 0x7f88481a4750 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:22.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.592+0000 7f884e4e0700 1 --2- 172.21.15.26:0/2972504683 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f884809e930 0x7f88481a3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:22.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.592+0000 7f884e4e0700 1 --2- 172.21.15.26:0/2972504683 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f884809f240 0x7f88481a4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:22.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.592+0000 7f884e4e0700 1 -- 172.21.15.26:0/2972504683 >> 172.21.15.26:0/2972504683 conn(0x7f88480a4210 msgr2=0x7f88481b8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:22.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.592+0000 7f884e4e0700 1 -- 172.21.15.26:0/2972504683 shutdown_connections 2023-10-01T07:59:22.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:22.593+0000 7f884e4e0700 1 -- 172.21.15.26:0/2972504683 wait complete. 2023-10-01T07:59:22.607 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:23.446 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:23.499 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:23.562 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:23.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.597+0000 7fe339408700 1 Processor -- start 2023-10-01T07:59:23.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.598+0000 7fe339408700 1 -- start start 2023-10-01T07:59:23.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.598+0000 7fe339408700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe33409d6f0 0x7fe33409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:23.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.598+0000 7fe339408700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe33409e000 0x7fe3341339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:23.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.598+0000 7fe339408700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe33409e410 0x7fe334133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:23.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.598+0000 7fe339408700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe33406b460 con 0x7fe33409e000 2023-10-01T07:59:23.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.598+0000 7fe339408700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33409b120 con 0x7fe33409e410 2023-10-01T07:59:23.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.598+0000 7fe339408700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe33409a7e0 con 0x7fe33409d6f0 2023-10-01T07:59:23.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.598+0000 7fe3327fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe33409e000 0x7fe3341339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:23.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.598+0000 7fe3327fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe33409e000 0x7fe3341339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48580/0 (socket says 172.21.15.26:48580) 2023-10-01T07:59:23.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.598+0000 7fe3327fc700 1 -- 172.21.15.26:0/1866789947 learned_addr learned my addr 172.21.15.26:0/1866789947 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:23.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.598+0000 7fe332ffd700 1 --2- 172.21.15.26:0/1866789947 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe33409d6f0 0x7fe33409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:23.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.599+0000 7fe3337fe700 1 --2- 172.21.15.26:0/1866789947 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe33409e410 0x7fe334133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:23.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.599+0000 7fe3327fc700 1 -- 172.21.15.26:0/1866789947 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe33409d6f0 msgr2=0x7fe33409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:23.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.599+0000 7fe3327fc700 1 --2- 172.21.15.26:0/1866789947 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe33409d6f0 0x7fe33409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.599+0000 7fe3327fc700 1 -- 172.21.15.26:0/1866789947 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe33409e410 msgr2=0x7fe334133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:23.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.599+0000 7fe3327fc700 1 --2- 172.21.15.26:0/1866789947 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe33409e410 0x7fe334133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.599+0000 7fe3327fc700 1 -- 172.21.15.26:0/1866789947 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe33409a500 con 0x7fe33409e000 2023-10-01T07:59:23.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.599+0000 7fe3337fe700 1 --2- 172.21.15.26:0/1866789947 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe33409e410 0x7fe334133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:59:23.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.599+0000 7fe3327fc700 1 --2- 172.21.15.26:0/1866789947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe33409e000 0x7fe3341339f0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fe3280098f0 tx=0x7fe328009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f763b74d89a374cc server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:23.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.599+0000 7fe331ffb700 1 -- 172.21.15.26:0/1866789947 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe328011830 con 0x7fe33409e000 2023-10-01T07:59:23.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.599+0000 7fe331ffb700 1 -- 172.21.15.26:0/1866789947 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe328011990 con 0x7fe33409e000 2023-10-01T07:59:23.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.599+0000 7fe331ffb700 1 -- 172.21.15.26:0/1866789947 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe328011d20 con 0x7fe33409e000 2023-10-01T07:59:23.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.600+0000 7fe339408700 1 -- 172.21.15.26:0/1866789947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe33409e000 msgr2=0x7fe3341339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:23.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.600+0000 7fe339408700 1 --2- 172.21.15.26:0/1866789947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe33409e000 0x7fe3341339f0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fe3280098f0 tx=0x7fe328009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:23.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.600+0000 7fe339408700 1 -- 172.21.15.26:0/1866789947 shutdown_connections 2023-10-01T07:59:23.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.600+0000 7fe339408700 1 --2- 172.21.15.26:0/1866789947 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe33409e410 0x7fe334133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.600+0000 7fe339408700 1 --2- 172.21.15.26:0/1866789947 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe33409d6f0 0x7fe33409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.600+0000 7fe339408700 1 --2- 172.21.15.26:0/1866789947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe33409e000 0x7fe3341339f0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.600+0000 7fe339408700 1 -- 172.21.15.26:0/1866789947 >> 172.21.15.26:0/1866789947 conn(0x7fe334066f50 msgr2=0x7fe33409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:23.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.600+0000 7fe339408700 1 -- 172.21.15.26:0/1866789947 shutdown_connections 2023-10-01T07:59:23.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.600+0000 7fe339408700 1 -- 172.21.15.26:0/1866789947 wait complete. 2023-10-01T07:59:23.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.602+0000 7fe339408700 1 Processor -- start 2023-10-01T07:59:23.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.602+0000 7fe339408700 1 -- start start 2023-10-01T07:59:23.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.603+0000 7fe339408700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe33409d6f0 0x7fe3341a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:23.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.603+0000 7fe339408700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe33409e000 0x7fe3341a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:23.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.603+0000 7fe339408700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe33409e410 0x7fe3341c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:23.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.603+0000 7fe339408700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3341a4e50 con 0x7fe33409d6f0 2023-10-01T07:59:23.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.603+0000 7fe339408700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3341b91f0 con 0x7fe33409e000 2023-10-01T07:59:23.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.603+0000 7fe339408700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3341a7de0 con 0x7fe33409e410 2023-10-01T07:59:23.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.603+0000 7fe3327fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe33409e000 0x7fe3341a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:23.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.603+0000 7fe332ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe33409d6f0 0x7fe3341a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:23.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.603+0000 7fe3327fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe33409e000 0x7fe3341a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47226/0 (socket says 172.21.15.26:47226) 2023-10-01T07:59:23.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.603+0000 7fe332ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe33409d6f0 0x7fe3341a52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48584/0 (socket says 172.21.15.26:48584) 2023-10-01T07:59:23.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.603+0000 7fe3327fc700 1 -- 172.21.15.26:0/1311408510 learned_addr learned my addr 172.21.15.26:0/1311408510 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:23.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.603+0000 7fe3337fe700 1 --2- 172.21.15.26:0/1311408510 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe33409e410 0x7fe3341c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:23.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.603+0000 7fe3327fc700 1 -- 172.21.15.26:0/1311408510 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe33409e410 msgr2=0x7fe3341c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:23.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.603+0000 7fe3327fc700 1 --2- 172.21.15.26:0/1311408510 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe33409e410 0x7fe3341c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.603+0000 7fe3327fc700 1 -- 172.21.15.26:0/1311408510 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe33409d6f0 msgr2=0x7fe3341a52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:23.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.603+0000 7fe3327fc700 1 --2- 172.21.15.26:0/1311408510 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe33409d6f0 0x7fe3341a52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.603+0000 7fe3327fc700 1 -- 172.21.15.26:0/1311408510 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe328009550 con 0x7fe33409e000 2023-10-01T07:59:23.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.603+0000 7fe332ffd700 1 --2- 172.21.15.26:0/1311408510 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe33409d6f0 0x7fe3341a52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:23.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.604+0000 7fe3327fc700 1 --2- 172.21.15.26:0/1311408510 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe33409e000 0x7fe3341a57f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fe328009c40 tx=0x7fe328004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:23.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.604+0000 7fe31b7fe700 1 -- 172.21.15.26:0/1311408510 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe328004240 con 0x7fe33409e000 2023-10-01T07:59:23.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.604+0000 7fe31b7fe700 1 -- 172.21.15.26:0/1311408510 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32801f070 con 0x7fe33409e000 2023-10-01T07:59:23.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.604+0000 7fe339408700 1 -- 172.21.15.26:0/1311408510 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3340a1fe0 con 0x7fe33409e000 2023-10-01T07:59:23.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.604+0000 7fe31b7fe700 1 -- 172.21.15.26:0/1311408510 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3280045a0 con 0x7fe33409e000 2023-10-01T07:59:23.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.604+0000 7fe339408700 1 -- 172.21.15.26:0/1311408510 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3341a70e0 con 0x7fe33409e000 2023-10-01T07:59:23.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.605+0000 7fe31b7fe700 1 -- 172.21.15.26:0/1311408510 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe328021030 con 0x7fe33409e000 2023-10-01T07:59:23.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.605+0000 7fe31b7fe700 1 -- 172.21.15.26:0/1311408510 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe328040870 con 0x7fe33409e000 2023-10-01T07:59:23.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.605+0000 7fe339408700 1 -- 172.21.15.26:0/1311408510 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe334074ea0 con 0x7fe33409e000 2023-10-01T07:59:23.608 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:23.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.610+0000 7fe31b7fe700 1 -- 172.21.15.26:0/1311408510 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe328015020 con 0x7fe33409e000 2023-10-01T07:59:23.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.663+0000 7f4df0ef7700 1 Processor -- start 2023-10-01T07:59:23.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.663+0000 7f4df0ef7700 1 -- start start 2023-10-01T07:59:23.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.664+0000 7f4df0ef7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4dec09d6f0 0x7f4dec09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:23.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.664+0000 7f4df0ef7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dec09e000 0x7f4dec1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:23.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.664+0000 7f4df0ef7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dec133f30 0x7f4dec134390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:23.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.664+0000 7f4df0ef7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dec09b0f0 con 0x7f4dec09d6f0 2023-10-01T07:59:23.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.664+0000 7f4df0ef7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec09d2f0 con 0x7f4dec133f30 2023-10-01T07:59:23.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.664+0000 7f4df0ef7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec09a810 con 0x7f4dec09e000 2023-10-01T07:59:23.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.664+0000 7f4dead9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dec133f30 0x7f4dec134390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:23.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.664+0000 7f4dead9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dec133f30 0x7f4dec134390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47236/0 (socket says 172.21.15.26:47236) 2023-10-01T07:59:23.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.664+0000 7f4dead9d700 1 -- 172.21.15.26:0/3255535167 learned_addr learned my addr 172.21.15.26:0/3255535167 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:23.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.665+0000 7f4dead9d700 1 -- 172.21.15.26:0/3255535167 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dec09e000 msgr2=0x7f4dec1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:23.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.665+0000 7f4de3fff700 1 --2- 172.21.15.26:0/3255535167 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dec09e000 0x7f4dec1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:23.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.665+0000 7f4dead9d700 1 --2- 172.21.15.26:0/3255535167 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dec09e000 0x7f4dec1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.665+0000 7f4dead9d700 1 -- 172.21.15.26:0/3255535167 >> v2:172.21.15.26:3300/0 conn(0x7f4dec09d6f0 msgr2=0x7f4dec09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:23.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.665+0000 7f4dead9d700 1 --2- 172.21.15.26:0/3255535167 >> v2:172.21.15.26:3300/0 conn(0x7f4dec09d6f0 0x7f4dec09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.665+0000 7f4dead9d700 1 -- 172.21.15.26:0/3255535167 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dec09a470 con 0x7f4dec133f30 2023-10-01T07:59:23.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.665+0000 7f4de3fff700 1 --2- 172.21.15.26:0/3255535167 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dec09e000 0x7f4dec1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:59:23.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.665+0000 7f4dead9d700 1 --2- 172.21.15.26:0/3255535167 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dec133f30 0x7f4dec134390 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f4de4009e50 tx=0x7f4de400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7af6136ef7153175 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:23.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.665+0000 7f4de9d9b700 1 -- 172.21.15.26:0/3255535167 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de400e070 con 0x7f4dec133f30 2023-10-01T07:59:23.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.665+0000 7f4de9d9b700 1 -- 172.21.15.26:0/3255535167 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de400b9c0 con 0x7f4dec133f30 2023-10-01T07:59:23.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.665+0000 7f4de9d9b700 1 -- 172.21.15.26:0/3255535167 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de400bd70 con 0x7f4dec133f30 2023-10-01T07:59:23.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.666+0000 7f4df0ef7700 1 -- 172.21.15.26:0/3255535167 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dec133f30 msgr2=0x7f4dec134390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:23.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.666+0000 7f4df0ef7700 1 --2- 172.21.15.26:0/3255535167 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dec133f30 0x7f4dec134390 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f4de4009e50 tx=0x7f4de400b330 comp rx=0 tx=0).stop 2023-10-01T07:59:23.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.666+0000 7f4df0ef7700 1 -- 172.21.15.26:0/3255535167 shutdown_connections 2023-10-01T07:59:23.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.666+0000 7f4df0ef7700 1 --2- 172.21.15.26:0/3255535167 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dec133f30 0x7f4dec134390 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.666+0000 7f4df0ef7700 1 --2- 172.21.15.26:0/3255535167 >> v2:172.21.15.26:3300/0 conn(0x7f4dec09d6f0 0x7f4dec09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.666+0000 7f4df0ef7700 1 --2- 172.21.15.26:0/3255535167 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dec09e000 0x7f4dec1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.666+0000 7f4df0ef7700 1 -- 172.21.15.26:0/3255535167 >> 172.21.15.26:0/3255535167 conn(0x7f4dec066f50 msgr2=0x7f4dec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:23.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.666+0000 7f4df0ef7700 1 -- 172.21.15.26:0/3255535167 shutdown_connections 2023-10-01T07:59:23.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.666+0000 7f4df0ef7700 1 -- 172.21.15.26:0/3255535167 wait complete. 2023-10-01T07:59:23.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.668+0000 7f4df0ef7700 1 Processor -- start 2023-10-01T07:59:23.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.668+0000 7f4df0ef7700 1 -- start start 2023-10-01T07:59:23.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.669+0000 7f4df0ef7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dec09d6f0 0x7f4dec121460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:23.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.669+0000 7f4df0ef7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dec09e000 0x7f4dec1219a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:23.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.669+0000 7f4df0ef7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dec133f30 0x7f4dec121ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:23.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.669+0000 7f4df0ef7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec124ca0 con 0x7f4dec133f30 2023-10-01T07:59:23.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.669+0000 7f4df0ef7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec09a0c0 con 0x7f4dec09d6f0 2023-10-01T07:59:23.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.669+0000 7f4df0ef7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec09c640 con 0x7f4dec09e000 2023-10-01T07:59:23.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.669+0000 7f4dead9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dec133f30 0x7f4dec121ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:23.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.669+0000 7f4de3fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dec09e000 0x7f4dec1219a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:23.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.669+0000 7f4dead9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dec133f30 0x7f4dec121ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48604/0 (socket says 172.21.15.26:48604) 2023-10-01T07:59:23.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.669+0000 7f4dea59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dec09d6f0 0x7f4dec121460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:23.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.669+0000 7f4dead9d700 1 -- 172.21.15.26:0/1526930537 learned_addr learned my addr 172.21.15.26:0/1526930537 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:23.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.670+0000 7f4dead9d700 1 -- 172.21.15.26:0/1526930537 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dec09e000 msgr2=0x7f4dec1219a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:23.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.670+0000 7f4dead9d700 1 --2- 172.21.15.26:0/1526930537 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dec09e000 0x7f4dec1219a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.670+0000 7f4dead9d700 1 -- 172.21.15.26:0/1526930537 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dec09d6f0 msgr2=0x7f4dec121460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:23.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.670+0000 7f4dead9d700 1 --2- 172.21.15.26:0/1526930537 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dec09d6f0 0x7f4dec121460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.670+0000 7f4dead9d700 1 -- 172.21.15.26:0/1526930537 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de4009b30 con 0x7f4dec133f30 2023-10-01T07:59:23.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.670+0000 7f4dead9d700 1 --2- 172.21.15.26:0/1526930537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dec133f30 0x7f4dec121ee0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f4dec072a80 tx=0x7f4de4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:23.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.670+0000 7f4de2ffd700 1 -- 172.21.15.26:0/1526930537 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de4004450 con 0x7f4dec133f30 2023-10-01T07:59:23.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.670+0000 7f4de2ffd700 1 -- 172.21.15.26:0/1526930537 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de40045d0 con 0x7f4dec133f30 2023-10-01T07:59:23.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.670+0000 7f4df0ef7700 1 -- 172.21.15.26:0/1526930537 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dec123860 con 0x7f4dec133f30 2023-10-01T07:59:23.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.670+0000 7f4de2ffd700 1 -- 172.21.15.26:0/1526930537 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de4025460 con 0x7f4dec133f30 2023-10-01T07:59:23.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.670+0000 7f4df0ef7700 1 -- 172.21.15.26:0/1526930537 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dec124f80 con 0x7f4dec133f30 2023-10-01T07:59:23.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.671+0000 7f4de2ffd700 1 -- 172.21.15.26:0/1526930537 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4de401c410 con 0x7f4dec133f30 2023-10-01T07:59:23.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.671+0000 7f4de2ffd700 1 -- 172.21.15.26:0/1526930537 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4de40415f0 con 0x7f4dec133f30 2023-10-01T07:59:23.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.673+0000 7f4df0ef7700 1 -- 172.21.15.26:0/1526930537 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dec074ea0 con 0x7f4dec133f30 2023-10-01T07:59:23.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.678+0000 7f4de2ffd700 1 -- 172.21.15.26:0/1526930537 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4de40123f0 con 0x7f4dec133f30 2023-10-01T07:59:23.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.720+0000 7fc748bb6700 1 Processor -- start 2023-10-01T07:59:23.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.720+0000 7fc748bb6700 1 -- start start 2023-10-01T07:59:23.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.721+0000 7fc748bb6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc74409f410 0x7fc744136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:23.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.721+0000 7fc748bb6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc744136fe0 0x7fc7441393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:23.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.721+0000 7fc748bb6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc744070940 con 0x7fc74409e930 2023-10-01T07:59:23.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.721+0000 7fc748bb6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc74406fd60 con 0x7fc744136fe0 2023-10-01T07:59:23.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.721+0000 7fc748bb6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc74406fa80 con 0x7fc74409f410 2023-10-01T07:59:23.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.721+0000 7fc742d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc744136fe0 0x7fc7441393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:23.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.721+0000 7fc742d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc744136fe0 0x7fc7441393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48618/0 (socket says 172.21.15.26:48618) 2023-10-01T07:59:23.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.721+0000 7fc742d9d700 1 -- 172.21.15.26:0/1925167579 learned_addr learned my addr 172.21.15.26:0/1925167579 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:23.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.721+0000 7fc741d9b700 1 --2- 172.21.15.26:0/1925167579 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc74409f410 0x7fc744136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:23.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.722+0000 7fc742d9d700 1 -- 172.21.15.26:0/1925167579 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc74409f410 msgr2=0x7fc744136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:23.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.722+0000 7fc742d9d700 1 --2- 172.21.15.26:0/1925167579 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc74409f410 0x7fc744136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.722+0000 7fc742d9d700 1 -- 172.21.15.26:0/1925167579 >> v1:172.21.15.26:6789/0 conn(0x7fc74409e930 legacy=0x7fc74409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:23.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.722+0000 7fc742d9d700 1 -- 172.21.15.26:0/1925167579 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc74409fb60 con 0x7fc744136fe0 2023-10-01T07:59:23.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.722+0000 7fc74159a700 1 -- 172.21.15.26:0/1925167579 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3405842769 0 0) 0x7fc744070940 con 0x7fc74409e930 2023-10-01T07:59:23.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.722+0000 7fc741d9b700 1 --2- 172.21.15.26:0/1925167579 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc74409f410 0x7fc744136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:23.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.722+0000 7fc742d9d700 1 --2- 172.21.15.26:0/1925167579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc744136fe0 0x7fc7441393c0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fc73c009e50 tx=0x7fc73c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53fca90c918b9fdc server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:23.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.722+0000 7fc74159a700 1 -- 172.21.15.26:0/1925167579 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c00e070 con 0x7fc744136fe0 2023-10-01T07:59:23.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.722+0000 7fc74159a700 1 -- 172.21.15.26:0/1925167579 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73c00b910 con 0x7fc744136fe0 2023-10-01T07:59:23.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.722+0000 7fc74159a700 1 -- 172.21.15.26:0/1925167579 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c00bcc0 con 0x7fc744136fe0 2023-10-01T07:59:23.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.723+0000 7fc748bb6700 1 -- 172.21.15.26:0/1925167579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc744136fe0 msgr2=0x7fc7441393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:23.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.723+0000 7fc748bb6700 1 --2- 172.21.15.26:0/1925167579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc744136fe0 0x7fc7441393c0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fc73c009e50 tx=0x7fc73c00b330 comp rx=0 tx=0).stop 2023-10-01T07:59:23.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.723+0000 7fc748bb6700 1 -- 172.21.15.26:0/1925167579 shutdown_connections 2023-10-01T07:59:23.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.723+0000 7fc748bb6700 1 --2- 172.21.15.26:0/1925167579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc744136fe0 0x7fc7441393c0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.723+0000 7fc748bb6700 1 --2- 172.21.15.26:0/1925167579 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc74409f410 0x7fc744136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.723+0000 7fc748bb6700 1 -- 172.21.15.26:0/1925167579 >> 172.21.15.26:0/1925167579 conn(0x7fc7440a4210 msgr2=0x7fc7440a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:23.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.724+0000 7fc748bb6700 1 -- 172.21.15.26:0/1925167579 shutdown_connections 2023-10-01T07:59:23.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.724+0000 7fc748bb6700 1 -- 172.21.15.26:0/1925167579 wait complete. 2023-10-01T07:59:23.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.725+0000 7fc748bb6700 1 Processor -- start 2023-10-01T07:59:23.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.725+0000 7fc748bb6700 1 -- start start 2023-10-01T07:59:23.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.726+0000 7fc748bb6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc74409e930 0x7fc74411c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:23.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.726+0000 7fc748bb6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc74409f410 0x7fc74411cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:23.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.726+0000 7fc748bb6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc744136fe0 0x7fc74411d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:23.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.726+0000 7fc748bb6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74411dac0 con 0x7fc744136fe0 2023-10-01T07:59:23.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.726+0000 7fc748bb6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74411ead0 con 0x7fc74409e930 2023-10-01T07:59:23.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.726+0000 7fc748bb6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc744120b00 con 0x7fc74409f410 2023-10-01T07:59:23.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.726+0000 7fc742d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc744136fe0 0x7fc74411d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:23.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.726+0000 7fc742d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc744136fe0 0x7fc74411d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48622/0 (socket says 172.21.15.26:48622) 2023-10-01T07:59:23.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.726+0000 7fc742d9d700 1 -- 172.21.15.26:0/2740393474 learned_addr learned my addr 172.21.15.26:0/2740393474 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:23.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.726+0000 7fc741d9b700 1 --2- 172.21.15.26:0/2740393474 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc74409f410 0x7fc74411cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:23.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.727+0000 7fc74259c700 1 --2- 172.21.15.26:0/2740393474 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc74409e930 0x7fc74411c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:23.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.727+0000 7fc741d9b700 1 -- 172.21.15.26:0/2740393474 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc74409e930 msgr2=0x7fc74411c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:23.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.727+0000 7fc741d9b700 1 --2- 172.21.15.26:0/2740393474 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc74409e930 0x7fc74411c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.727+0000 7fc741d9b700 1 -- 172.21.15.26:0/2740393474 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc744136fe0 msgr2=0x7fc74411d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:23.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.727+0000 7fc741d9b700 1 --2- 172.21.15.26:0/2740393474 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc744136fe0 0x7fc74411d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.727+0000 7fc741d9b700 1 -- 172.21.15.26:0/2740393474 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7380094a0 con 0x7fc74409f410 2023-10-01T07:59:23.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.727+0000 7fc742d9d700 1 --2- 172.21.15.26:0/2740393474 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc744136fe0 0x7fc74411d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:23.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.727+0000 7fc74259c700 1 --2- 172.21.15.26:0/2740393474 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc74409e930 0x7fc74411c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:59:23.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.727+0000 7fc741d9b700 1 --2- 172.21.15.26:0/2740393474 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc74409f410 0x7fc74411cb30 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc73800e9b0 tx=0x7fc73800ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:23.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.727+0000 7fc732ffd700 1 -- 172.21.15.26:0/2740393474 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73800c850 con 0x7fc74409f410 2023-10-01T07:59:23.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.727+0000 7fc732ffd700 1 -- 172.21.15.26:0/2740393474 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73800c9b0 con 0x7fc74409f410 2023-10-01T07:59:23.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.727+0000 7fc732ffd700 1 -- 172.21.15.26:0/2740393474 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73800cd60 con 0x7fc74409f410 2023-10-01T07:59:23.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.728+0000 7fc748bb6700 1 -- 172.21.15.26:0/2740393474 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc73c009b30 con 0x7fc74409f410 2023-10-01T07:59:23.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.728+0000 7fc748bb6700 1 -- 172.21.15.26:0/2740393474 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7440a0190 con 0x7fc74409f410 2023-10-01T07:59:23.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.729+0000 7fc748bb6700 1 -- 172.21.15.26:0/2740393474 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc74411fc90 con 0x7fc74409f410 2023-10-01T07:59:23.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.729+0000 7fc732ffd700 1 -- 172.21.15.26:0/2740393474 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc738013470 con 0x7fc74409f410 2023-10-01T07:59:23.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.729+0000 7fc732ffd700 1 -- 172.21.15.26:0/2740393474 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc73803f750 con 0x7fc74409f410 2023-10-01T07:59:23.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.739+0000 7fc732ffd700 1 -- 172.21.15.26:0/2740393474 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc74411fc90 con 0x7fc74409f410 2023-10-01T07:59:23.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.752+0000 7f82c95b5700 1 Processor -- start 2023-10-01T07:59:23.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.752+0000 7f82c95b5700 1 -- start start 2023-10-01T07:59:23.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.753+0000 7f82c95b5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82c409e230 0x7f82c4131c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:23.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.753+0000 7f82c95b5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f82c406ae80 0x7f82c4139590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:23.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.753+0000 7f82c95b5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82c409dba0 con 0x7f82c4131830 2023-10-01T07:59:23.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.753+0000 7f82c95b5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82c4132140 con 0x7f82c406ae80 2023-10-01T07:59:23.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.753+0000 7f82c95b5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82c41313e0 con 0x7f82c409e230 2023-10-01T07:59:23.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.753+0000 7f82c37fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f82c406ae80 0x7f82c4139590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:23.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.753+0000 7f82c27fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82c409e230 0x7f82c4131c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:23.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.753+0000 7f82c2ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f82c4131830 0x7f82c406a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37754/0 (socket says 172.21.15.26:37754) 2023-10-01T07:59:23.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.753+0000 7f82c37fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f82c406ae80 0x7f82c4139590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48626/0 (socket says 172.21.15.26:48626) 2023-10-01T07:59:23.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.753+0000 7f82c27fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82c409e230 0x7f82c4131c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47074/0 (socket says 172.21.15.26:47074) 2023-10-01T07:59:23.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.753+0000 7f82c2ffd700 1 -- 172.21.15.26:0/2698771138 learned_addr learned my addr 172.21.15.26:0/2698771138 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:59:23.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.754+0000 7f82c27fc700 1 -- 172.21.15.26:0/2698771138 >> v2:172.21.15.26:3300/0 conn(0x7f82c406ae80 msgr2=0x7f82c4139590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:23.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.754+0000 7f82c27fc700 1 --2- 172.21.15.26:0/2698771138 >> v2:172.21.15.26:3300/0 conn(0x7f82c406ae80 0x7f82c4139590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.754+0000 7f82c27fc700 1 -- 172.21.15.26:0/2698771138 >> v1:172.21.15.26:6789/0 conn(0x7f82c4131830 legacy=0x7f82c406a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:23.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.754+0000 7f82c1ffb700 1 -- 172.21.15.26:0/2698771138 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2118071499 0 0) 0x7f82c409dba0 con 0x7f82c4131830 2023-10-01T07:59:23.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.754+0000 7f82c27fc700 1 -- 172.21.15.26:0/2698771138 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c409d6d0 con 0x7f82c409e230 2023-10-01T07:59:23.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.754+0000 7f82c27fc700 1 --2- 172.21.15.26:0/2698771138 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82c409e230 0x7f82c4131c00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f82b8009840 tx=0x7f82b8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27d8cafbf48a4d04 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:23.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.754+0000 7f82c1ffb700 1 -- 172.21.15.26:0/2698771138 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b8011830 con 0x7f82c409e230 2023-10-01T07:59:23.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.754+0000 7f82c1ffb700 1 -- 172.21.15.26:0/2698771138 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b8011990 con 0x7f82c409e230 2023-10-01T07:59:23.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.754+0000 7f82c1ffb700 1 -- 172.21.15.26:0/2698771138 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b8011d20 con 0x7f82c409e230 2023-10-01T07:59:23.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.755+0000 7f82c95b5700 1 -- 172.21.15.26:0/2698771138 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82c409e230 msgr2=0x7f82c4131c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:23.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.755+0000 7f82c95b5700 1 --2- 172.21.15.26:0/2698771138 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82c409e230 0x7f82c4131c00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f82b8009840 tx=0x7f82b8009b50 comp rx=0 tx=0).stop 2023-10-01T07:59:23.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.755+0000 7f82c95b5700 1 -- 172.21.15.26:0/2698771138 shutdown_connections 2023-10-01T07:59:23.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.755+0000 7f82c95b5700 1 --2- 172.21.15.26:0/2698771138 >> v2:172.21.15.26:3300/0 conn(0x7f82c406ae80 0x7f82c4139590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.755+0000 7f82c95b5700 1 --2- 172.21.15.26:0/2698771138 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82c409e230 0x7f82c4131c00 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.755+0000 7f82c95b5700 1 -- 172.21.15.26:0/2698771138 >> 172.21.15.26:0/2698771138 conn(0x7f82c4099c20 msgr2=0x7f82c40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:23.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.755+0000 7f82c95b5700 1 -- 172.21.15.26:0/2698771138 shutdown_connections 2023-10-01T07:59:23.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.755+0000 7f82c95b5700 1 -- 172.21.15.26:0/2698771138 wait complete. 2023-10-01T07:59:23.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.756+0000 7f82c95b5700 1 Processor -- start 2023-10-01T07:59:23.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.756+0000 7f82c95b5700 1 -- start start 2023-10-01T07:59:23.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.756+0000 7f82c95b5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82c406ae80 0x7f82c411a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:23.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.756+0000 7f82c95b5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82c409e230 0x7f82c411a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:23.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.757+0000 7f82c95b5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82c4131830 0x7f82c411ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:23.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.757+0000 7f82c95b5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c412b9b0 con 0x7f82c406ae80 2023-10-01T07:59:23.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.757+0000 7f82c95b5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c411d750 con 0x7f82c4131830 2023-10-01T07:59:23.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.757+0000 7f82c95b5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82c411d0a0 con 0x7f82c409e230 2023-10-01T07:59:23.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.757+0000 7f82c27fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82c409e230 0x7f82c411a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:23.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.757+0000 7f82c2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82c406ae80 0x7f82c411a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:23.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.757+0000 7f82c27fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82c409e230 0x7f82c411a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47080/0 (socket says 172.21.15.26:47080) 2023-10-01T07:59:23.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.757+0000 7f82c27fc700 1 -- 172.21.15.26:0/4278497201 learned_addr learned my addr 172.21.15.26:0/4278497201 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:23.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.757+0000 7f82c37fe700 1 --2- 172.21.15.26:0/4278497201 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82c4131830 0x7f82c411ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:23.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.757+0000 7f82c2ffd700 1 -- 172.21.15.26:0/4278497201 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82c409e230 msgr2=0x7f82c411a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:23.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.757+0000 7f82c2ffd700 1 --2- 172.21.15.26:0/4278497201 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82c409e230 0x7f82c411a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.757+0000 7f82c2ffd700 1 -- 172.21.15.26:0/4278497201 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82c4131830 msgr2=0x7f82c411ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:23.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.757+0000 7f82c2ffd700 1 --2- 172.21.15.26:0/4278497201 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82c4131830 0x7f82c411ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.757+0000 7f82c2ffd700 1 -- 172.21.15.26:0/4278497201 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b80094a0 con 0x7f82c406ae80 2023-10-01T07:59:23.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.757+0000 7f82c27fc700 1 --2- 172.21.15.26:0/4278497201 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82c409e230 0x7f82c411a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:23.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.757+0000 7f82c2ffd700 1 --2- 172.21.15.26:0/4278497201 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82c406ae80 0x7f82c411a1d0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f82b400c470 tx=0x7f82b400c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:23.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.757+0000 7f82ab7fe700 1 -- 172.21.15.26:0/4278497201 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b4004c80 con 0x7f82c406ae80 2023-10-01T07:59:23.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.758+0000 7f82ab7fe700 1 -- 172.21.15.26:0/4278497201 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b4004de0 con 0x7f82c406ae80 2023-10-01T07:59:23.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.758+0000 7f82c95b5700 1 -- 172.21.15.26:0/4278497201 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c411e480 con 0x7f82c406ae80 2023-10-01T07:59:23.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.758+0000 7f82ab7fe700 1 -- 172.21.15.26:0/4278497201 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b4007310 con 0x7f82c406ae80 2023-10-01T07:59:23.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.758+0000 7f82c95b5700 1 -- 172.21.15.26:0/4278497201 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c411dcf0 con 0x7f82c406ae80 2023-10-01T07:59:23.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.759+0000 7f82c95b5700 1 -- 172.21.15.26:0/4278497201 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82c411d970 con 0x7f82c406ae80 2023-10-01T07:59:23.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.759+0000 7f82ab7fe700 1 -- 172.21.15.26:0/4278497201 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f82b4007470 con 0x7f82c406ae80 2023-10-01T07:59:23.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.759+0000 7f82ab7fe700 1 -- 172.21.15.26:0/4278497201 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f82b403f390 con 0x7f82c406ae80 2023-10-01T07:59:23.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.764+0000 7f82ab7fe700 1 -- 172.21.15.26:0/4278497201 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f82b4007720 con 0x7f82c406ae80 2023-10-01T07:59:23.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.883+0000 7fe339408700 1 -- 172.21.15.26:0/1311408510 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe33406c360 con 0x7fe33409e000 2023-10-01T07:59:23.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.884+0000 7fe31b7fe700 1 -- 172.21.15.26:0/1311408510 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe3280036a0 con 0x7fe33409e000 2023-10-01T07:59:23.885 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:23.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.887+0000 7fe339408700 1 -- 172.21.15.26:0/1311408510 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe33409e000 msgr2=0x7fe3341a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:23.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.887+0000 7fe339408700 1 --2- 172.21.15.26:0/1311408510 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe33409e000 0x7fe3341a57f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fe328009c40 tx=0x7fe328004750 comp rx=0 tx=0).stop 2023-10-01T07:59:23.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.888+0000 7fe339408700 1 -- 172.21.15.26:0/1311408510 shutdown_connections 2023-10-01T07:59:23.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.888+0000 7fe339408700 1 --2- 172.21.15.26:0/1311408510 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe33409e410 0x7fe3341c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.888+0000 7fe339408700 1 --2- 172.21.15.26:0/1311408510 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe33409d6f0 0x7fe3341a52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.888+0000 7fe339408700 1 --2- 172.21.15.26:0/1311408510 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe33409e000 0x7fe3341a57f0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.888+0000 7fe339408700 1 -- 172.21.15.26:0/1311408510 >> 172.21.15.26:0/1311408510 conn(0x7fe334066f50 msgr2=0x7fe33406f350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:23.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.889+0000 7fe339408700 1 -- 172.21.15.26:0/1311408510 shutdown_connections 2023-10-01T07:59:23.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.889+0000 7fe339408700 1 -- 172.21.15.26:0/1311408510 wait complete. 2023-10-01T07:59:23.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.892+0000 7f4df0ef7700 1 -- 172.21.15.26:0/1526930537 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4dec133d10 con 0x7f4dec133f30 2023-10-01T07:59:23.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.892+0000 7f4de2ffd700 1 -- 172.21.15.26:0/1526930537 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4de402e390 con 0x7f4dec133f30 2023-10-01T07:59:23.893 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:23.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.896+0000 7f4df0ef7700 1 -- 172.21.15.26:0/1526930537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dec133f30 msgr2=0x7f4dec121ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:23.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.896+0000 7f4df0ef7700 1 --2- 172.21.15.26:0/1526930537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dec133f30 0x7f4dec121ee0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f4dec072a80 tx=0x7f4de4004ad0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.897+0000 7f4df0ef7700 1 -- 172.21.15.26:0/1526930537 shutdown_connections 2023-10-01T07:59:23.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.897+0000 7f4df0ef7700 1 --2- 172.21.15.26:0/1526930537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dec133f30 0x7f4dec121ee0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.897+0000 7f4df0ef7700 1 --2- 172.21.15.26:0/1526930537 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4dec09d6f0 0x7f4dec121460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.897+0000 7f4df0ef7700 1 --2- 172.21.15.26:0/1526930537 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4dec09e000 0x7f4dec1219a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.897+0000 7f4df0ef7700 1 -- 172.21.15.26:0/1526930537 >> 172.21.15.26:0/1526930537 conn(0x7f4dec066f50 msgr2=0x7f4dec0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:23.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.897+0000 7f4df0ef7700 1 -- 172.21.15.26:0/1526930537 shutdown_connections 2023-10-01T07:59:23.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.897+0000 7f4df0ef7700 1 -- 172.21.15.26:0/1526930537 wait complete. 2023-10-01T07:59:23.907 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:23.912 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:23.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.973+0000 7f82c95b5700 1 -- 172.21.15.26:0/4278497201 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f82c404f2a0 con 0x7f82c406ae80 2023-10-01T07:59:23.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.973+0000 7fc748bb6700 1 -- 172.21.15.26:0/2740393474 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc74411fc90 con 0x7fc74409f410 2023-10-01T07:59:23.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.973+0000 7fc732ffd700 1 -- 172.21.15.26:0/2740393474 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc74411fc90 con 0x7fc74409f410 2023-10-01T07:59:23.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.973+0000 7f82ab7fe700 1 -- 172.21.15.26:0/4278497201 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f82b4011360 con 0x7f82c406ae80 2023-10-01T07:59:23.975 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:23.975 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:23.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.976+0000 7f82c95b5700 1 -- 172.21.15.26:0/4278497201 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82c406ae80 msgr2=0x7f82c411a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:23.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.976+0000 7f82c95b5700 1 --2- 172.21.15.26:0/4278497201 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82c406ae80 0x7f82c411a1d0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f82b400c470 tx=0x7f82b400c780 comp rx=0 tx=0).stop 2023-10-01T07:59:23.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.976+0000 7fc748bb6700 1 -- 172.21.15.26:0/2740393474 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc74409f410 msgr2=0x7fc74411cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:23.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.976+0000 7fc748bb6700 1 --2- 172.21.15.26:0/2740393474 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc74409f410 0x7fc74411cb30 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc73800e9b0 tx=0x7fc73800ecc0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.976+0000 7f82c95b5700 1 -- 172.21.15.26:0/4278497201 shutdown_connections 2023-10-01T07:59:23.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.976+0000 7f82c95b5700 1 --2- 172.21.15.26:0/4278497201 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82c4131830 0x7f82c411ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.976+0000 7f82c95b5700 1 --2- 172.21.15.26:0/4278497201 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82c406ae80 0x7f82c411a1d0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.976+0000 7fc748bb6700 1 -- 172.21.15.26:0/2740393474 shutdown_connections 2023-10-01T07:59:23.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.976+0000 7fc748bb6700 1 --2- 172.21.15.26:0/2740393474 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc744136fe0 0x7fc74411d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.976+0000 7fc748bb6700 1 --2- 172.21.15.26:0/2740393474 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc74409e930 0x7fc74411c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.976+0000 7fc748bb6700 1 --2- 172.21.15.26:0/2740393474 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc74409f410 0x7fc74411cb30 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.976+0000 7f82c95b5700 1 --2- 172.21.15.26:0/4278497201 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82c409e230 0x7f82c411a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:23.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.976+0000 7f82c95b5700 1 -- 172.21.15.26:0/4278497201 >> 172.21.15.26:0/4278497201 conn(0x7f82c4099c20 msgr2=0x7f82c412c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:23.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.976+0000 7fc748bb6700 1 -- 172.21.15.26:0/2740393474 >> 172.21.15.26:0/2740393474 conn(0x7fc7440a4210 msgr2=0x7fc74406bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:23.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.976+0000 7f82c95b5700 1 -- 172.21.15.26:0/4278497201 shutdown_connections 2023-10-01T07:59:23.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.976+0000 7fc748bb6700 1 -- 172.21.15.26:0/2740393474 shutdown_connections 2023-10-01T07:59:23.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.976+0000 7f82c95b5700 1 -- 172.21.15.26:0/4278497201 wait complete. 2023-10-01T07:59:23.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:23.976+0000 7fc748bb6700 1 -- 172.21.15.26:0/2740393474 wait complete. 2023-10-01T07:59:23.992 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:23.992 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:24.908 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:24.913 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:24.993 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:24.994 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:25.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.065+0000 7fa8f851f700 1 Processor -- start 2023-10-01T07:59:25.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.065+0000 7fa8f851f700 1 -- start start 2023-10-01T07:59:25.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.066+0000 7fa8f851f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa8f006b250 0x7fa8f0136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:25.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.066+0000 7fa8f851f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa8f0136d80 0x7fa8f0139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:25.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.066+0000 7fa8f851f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8f009ece0 con 0x7fa8f006a770 2023-10-01T07:59:25.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.066+0000 7fa8f851f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f006b640 con 0x7fa8f006b250 2023-10-01T07:59:25.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.066+0000 7fa8f851f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f009e760 con 0x7fa8f0136d80 2023-10-01T07:59:25.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.066+0000 7fa8f6abc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa8f0136d80 0x7fa8f0139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:25.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.066+0000 7fa8f6abc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa8f0136d80 0x7fa8f0139160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47090/0 (socket says 172.21.15.26:47090) 2023-10-01T07:59:25.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.066+0000 7fa8f6abc700 1 -- 172.21.15.26:0/2932376597 learned_addr learned my addr 172.21.15.26:0/2932376597 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:25.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.066+0000 7fa8f5aba700 1 --2- 172.21.15.26:0/2932376597 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa8f006b250 0x7fa8f0136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:25.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.066+0000 7fa8f6abc700 1 -- 172.21.15.26:0/2932376597 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa8f006b250 msgr2=0x7fa8f0136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:25.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.066+0000 7fa8f6abc700 1 --2- 172.21.15.26:0/2932376597 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa8f006b250 0x7fa8f0136840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:25.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.066+0000 7fa8f6abc700 1 -- 172.21.15.26:0/2932376597 >> v1:172.21.15.26:6789/0 conn(0x7fa8f006a770 legacy=0x7fa8f006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:25.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.066+0000 7fa8f6abc700 1 -- 172.21.15.26:0/2932376597 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f009e040 con 0x7fa8f0136d80 2023-10-01T07:59:25.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.066+0000 7fa8f5aba700 1 --2- 172.21.15.26:0/2932376597 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa8f006b250 0x7fa8f0136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:25.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.067+0000 7fa8f6abc700 1 --2- 172.21.15.26:0/2932376597 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa8f0136d80 0x7fa8f0139160 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8009e80 tx=0x7fa8e800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7e30bbf76a7c161 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:25.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.067+0000 7fa8f52b9700 1 -- 172.21.15.26:0/2932376597 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e800e070 con 0x7fa8f0136d80 2023-10-01T07:59:25.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.067+0000 7fa8f52b9700 1 -- 172.21.15.26:0/2932376597 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e800b910 con 0x7fa8f0136d80 2023-10-01T07:59:25.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.067+0000 7fa8f52b9700 1 -- 172.21.15.26:0/2932376597 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e800bcc0 con 0x7fa8f0136d80 2023-10-01T07:59:25.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.068+0000 7fa8f851f700 1 -- 172.21.15.26:0/2932376597 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa8f0136d80 msgr2=0x7fa8f0139160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:25.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.068+0000 7fa8f851f700 1 --2- 172.21.15.26:0/2932376597 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa8f0136d80 0x7fa8f0139160 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8009e80 tx=0x7fa8e800b330 comp rx=0 tx=0).stop 2023-10-01T07:59:25.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.068+0000 7fa8f851f700 1 -- 172.21.15.26:0/2932376597 shutdown_connections 2023-10-01T07:59:25.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.068+0000 7fa8f851f700 1 --2- 172.21.15.26:0/2932376597 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa8f0136d80 0x7fa8f0139160 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:25.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.068+0000 7fa8f851f700 1 --2- 172.21.15.26:0/2932376597 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa8f006b250 0x7fa8f0136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:25.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.068+0000 7fa8f851f700 1 -- 172.21.15.26:0/2932376597 >> 172.21.15.26:0/2932376597 conn(0x7fa8f0066f50 msgr2=0x7fa8f009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:25.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.068+0000 7fa8f851f700 1 -- 172.21.15.26:0/2932376597 shutdown_connections 2023-10-01T07:59:25.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.068+0000 7fa8f851f700 1 -- 172.21.15.26:0/2932376597 wait complete. 2023-10-01T07:59:25.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.069+0000 7fa8f851f700 1 Processor -- start 2023-10-01T07:59:25.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.069+0000 7fa8f851f700 1 -- start start 2023-10-01T07:59:25.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.069+0000 7fa8f851f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa8f006a770 0x7fa8f01c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:25.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.069+0000 7fa8f851f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa8f006b250 0x7fa8f01c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:25.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.069+0000 7fa8f851f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8f0136d80 0x7fa8f01c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:25.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.069+0000 7fa8f851f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f0122300 con 0x7fa8f0136d80 2023-10-01T07:59:25.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.069+0000 7fa8f851f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f01212e0 con 0x7fa8f006a770 2023-10-01T07:59:25.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.069+0000 7fa8f851f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f006e8e0 con 0x7fa8f006b250 2023-10-01T07:59:25.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.070+0000 7fa8f5aba700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa8f006b250 0x7fa8f01c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:25.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.070+0000 7fa8f5aba700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa8f006b250 0x7fa8f01c8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47092/0 (socket says 172.21.15.26:47092) 2023-10-01T07:59:25.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.070+0000 7fa8f5aba700 1 -- 172.21.15.26:0/2231837399 learned_addr learned my addr 172.21.15.26:0/2231837399 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:25.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.070+0000 7fa8f62bb700 1 --2- 172.21.15.26:0/2231837399 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa8f006a770 0x7fa8f01c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:25.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.070+0000 7fa8f5aba700 1 -- 172.21.15.26:0/2231837399 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa8f006a770 msgr2=0x7fa8f01c8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:25.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.070+0000 7fa8f5aba700 1 --2- 172.21.15.26:0/2231837399 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa8f006a770 0x7fa8f01c8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:25.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.070+0000 7fa8f5aba700 1 -- 172.21.15.26:0/2231837399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8f0136d80 msgr2=0x7fa8f01c8c90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:59:25.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.070+0000 7fa8f5aba700 1 --2- 172.21.15.26:0/2231837399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8f0136d80 0x7fa8f01c8c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:25.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.070+0000 7fa8f5aba700 1 -- 172.21.15.26:0/2231837399 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e00094a0 con 0x7fa8f006b250 2023-10-01T07:59:25.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.070+0000 7fa8f5aba700 1 --2- 172.21.15.26:0/2231837399 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa8f006b250 0x7fa8f01c8750 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fa8e000ebe0 tx=0x7fa8e000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:25.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.070+0000 7fa8e6ffd700 1 -- 172.21.15.26:0/2231837399 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e0009800 con 0x7fa8f006b250 2023-10-01T07:59:25.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.070+0000 7fa8e6ffd700 1 -- 172.21.15.26:0/2231837399 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e000c910 con 0x7fa8f006b250 2023-10-01T07:59:25.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.070+0000 7fa8e6ffd700 1 -- 172.21.15.26:0/2231837399 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e000cc80 con 0x7fa8f006b250 2023-10-01T07:59:25.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.071+0000 7fa8f851f700 1 -- 172.21.15.26:0/2231837399 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e8009b30 con 0x7fa8f006b250 2023-10-01T07:59:25.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.071+0000 7fa8f851f700 1 -- 172.21.15.26:0/2231837399 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f009bfc0 con 0x7fa8f006b250 2023-10-01T07:59:25.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.072+0000 7fa8e6ffd700 1 -- 172.21.15.26:0/2231837399 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa8e0013470 con 0x7fa8f006b250 2023-10-01T07:59:25.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.072+0000 7fa8e6ffd700 1 -- 172.21.15.26:0/2231837399 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa8e003fc00 con 0x7fa8f006b250 2023-10-01T07:59:25.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.072+0000 7fa8f851f700 1 -- 172.21.15.26:0/2231837399 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f0074ea0 con 0x7fa8f006b250 2023-10-01T07:59:25.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.081+0000 7fa8e6ffd700 1 -- 172.21.15.26:0/2231837399 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa8e0017070 con 0x7fa8f006b250 2023-10-01T07:59:25.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.104+0000 7f16ad17d700 1 Processor -- start 2023-10-01T07:59:25.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.105+0000 7f16ad17d700 1 -- start start 2023-10-01T07:59:25.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.105+0000 7f16ad17d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f16a81338a0 0x7f16a8133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:25.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.105+0000 7f16ad17d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f16a809e930 0x7f16a813b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:25.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.105+0000 7f16ad17d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a806ef30 con 0x7f16a809de50 2023-10-01T07:59:25.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.105+0000 7f16ad17d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a806fef0 con 0x7f16a809e930 2023-10-01T07:59:25.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.105+0000 7f16ad17d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a81334b0 con 0x7f16a81338a0 2023-10-01T07:59:25.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.105+0000 7f16a6d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f16a81338a0 0x7f16a8133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:25.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.105+0000 7f16a6d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f16a81338a0 0x7f16a8133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47294/0 (socket says 172.21.15.26:47294) 2023-10-01T07:59:25.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.105+0000 7f16a6d9d700 1 -- 172.21.15.26:0/940149398 learned_addr learned my addr 172.21.15.26:0/940149398 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:25.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.105+0000 7f16a759e700 1 --2- 172.21.15.26:0/940149398 >> v2:172.21.15.26:3300/0 conn(0x7f16a809e930 0x7f16a813b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:25.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.106+0000 7f16a6d9d700 1 -- 172.21.15.26:0/940149398 >> v2:172.21.15.26:3300/0 conn(0x7f16a809e930 msgr2=0x7f16a813b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:25.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.106+0000 7f16a6d9d700 1 --2- 172.21.15.26:0/940149398 >> v2:172.21.15.26:3300/0 conn(0x7f16a809e930 0x7f16a813b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:25.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.106+0000 7f16a6d9d700 1 -- 172.21.15.26:0/940149398 >> v1:172.21.15.26:6789/0 conn(0x7f16a809de50 legacy=0x7f16a809e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:25.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.106+0000 7f16a6d9d700 1 -- 172.21.15.26:0/940149398 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a806fc30 con 0x7f16a81338a0 2023-10-01T07:59:25.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.106+0000 7f16a6d9d700 1 --2- 172.21.15.26:0/940149398 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f16a81338a0 0x7f16a8133c70 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f16980098f0 tx=0x7f1698009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f9b56c5a050d67f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:25.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.106+0000 7f16a5d9b700 1 -- 172.21.15.26:0/940149398 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1698011830 con 0x7f16a81338a0 2023-10-01T07:59:25.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.106+0000 7f16a5d9b700 1 -- 172.21.15.26:0/940149398 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1698011990 con 0x7f16a81338a0 2023-10-01T07:59:25.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.106+0000 7f16a5d9b700 1 -- 172.21.15.26:0/940149398 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1698011d20 con 0x7f16a81338a0 2023-10-01T07:59:25.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.107+0000 7f16ad17d700 1 -- 172.21.15.26:0/940149398 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f16a81338a0 msgr2=0x7f16a8133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:25.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.107+0000 7f16ad17d700 1 --2- 172.21.15.26:0/940149398 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f16a81338a0 0x7f16a8133c70 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f16980098f0 tx=0x7f1698009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:25.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.107+0000 7f16ad17d700 1 -- 172.21.15.26:0/940149398 shutdown_connections 2023-10-01T07:59:25.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.107+0000 7f16ad17d700 1 --2- 172.21.15.26:0/940149398 >> v2:172.21.15.26:3300/0 conn(0x7f16a809e930 0x7f16a813b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:25.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.107+0000 7f16ad17d700 1 --2- 172.21.15.26:0/940149398 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f16a81338a0 0x7f16a8133c70 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:25.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.107+0000 7f16ad17d700 1 -- 172.21.15.26:0/940149398 >> 172.21.15.26:0/940149398 conn(0x7f16a80a2aa0 msgr2=0x7f16a80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:25.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.107+0000 7f16ad17d700 1 -- 172.21.15.26:0/940149398 shutdown_connections 2023-10-01T07:59:25.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.108+0000 7f16ad17d700 1 -- 172.21.15.26:0/940149398 wait complete. 2023-10-01T07:59:25.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.109+0000 7f16ad17d700 1 Processor -- start 2023-10-01T07:59:25.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.109+0000 7f16ad17d700 1 -- start start 2023-10-01T07:59:25.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.109+0000 7f16ad17d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f16a809de50 0x7f16a811b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:25.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.109+0000 7f16ad17d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f16a809e930 0x7f16a811bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:25.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.109+0000 7f16ad17d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16a81338a0 0x7f16a811c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:25.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.109+0000 7f16ad17d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a811cae0 con 0x7f16a81338a0 2023-10-01T07:59:25.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.109+0000 7f16ad17d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a811f150 con 0x7f16a809de50 2023-10-01T07:59:25.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.109+0000 7f16ad17d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16a811e500 con 0x7f16a809e930 2023-10-01T07:59:25.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.110+0000 7f16a6d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f16a809de50 0x7f16a811b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:25.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.110+0000 7f16a6d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f16a809de50 0x7f16a811b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47310/0 (socket says 172.21.15.26:47310) 2023-10-01T07:59:25.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.110+0000 7f16a6d9d700 1 -- 172.21.15.26:0/544654678 learned_addr learned my addr 172.21.15.26:0/544654678 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:25.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.110+0000 7f16a759e700 1 --2- 172.21.15.26:0/544654678 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16a81338a0 0x7f16a811c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:25.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.110+0000 7f16a6d9d700 1 -- 172.21.15.26:0/544654678 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f16a809e930 msgr2=0x7f16a811bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:25.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.110+0000 7f16a6d9d700 1 --2- 172.21.15.26:0/544654678 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f16a809e930 0x7f16a811bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:25.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.110+0000 7f16a6d9d700 1 -- 172.21.15.26:0/544654678 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16a81338a0 msgr2=0x7f16a811c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:25.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.110+0000 7f16a6d9d700 1 --2- 172.21.15.26:0/544654678 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16a81338a0 0x7f16a811c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:25.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.110+0000 7f16a6d9d700 1 -- 172.21.15.26:0/544654678 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1698009550 con 0x7f16a809de50 2023-10-01T07:59:25.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.110+0000 7f16a759e700 1 --2- 172.21.15.26:0/544654678 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16a81338a0 0x7f16a811c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:25.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.110+0000 7f16a6d9d700 1 --2- 172.21.15.26:0/544654678 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f16a809de50 0x7f16a811b630 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f1698000c00 tx=0x7f1698004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:25.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.111+0000 7f168f7fe700 1 -- 172.21.15.26:0/544654678 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16980036a0 con 0x7f16a809de50 2023-10-01T07:59:25.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.111+0000 7f168f7fe700 1 -- 172.21.15.26:0/544654678 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1698003800 con 0x7f16a809de50 2023-10-01T07:59:25.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.111+0000 7f168f7fe700 1 -- 172.21.15.26:0/544654678 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1698003bb0 con 0x7f16a809de50 2023-10-01T07:59:25.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.111+0000 7f16ad17d700 1 -- 172.21.15.26:0/544654678 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a80a0ff0 con 0x7f16a809de50 2023-10-01T07:59:25.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.111+0000 7f16ad17d700 1 -- 172.21.15.26:0/544654678 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a806f6a0 con 0x7f16a809de50 2023-10-01T07:59:25.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.112+0000 7f168f7fe700 1 -- 172.21.15.26:0/544654678 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1698003d10 con 0x7f16a809de50 2023-10-01T07:59:25.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.112+0000 7f168f7fe700 1 -- 172.21.15.26:0/544654678 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1698021030 con 0x7f16a809de50 2023-10-01T07:59:25.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.112+0000 7f16ad17d700 1 -- 172.21.15.26:0/544654678 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a811edb0 con 0x7f16a809de50 2023-10-01T07:59:25.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.117+0000 7f168f7fe700 1 -- 172.21.15.26:0/544654678 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f16a811edb0 con 0x7f16a809de50 2023-10-01T07:59:25.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.152+0000 7f3bb5ec8700 1 Processor -- start 2023-10-01T07:59:25.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.152+0000 7f3bb5ec8700 1 -- start start 2023-10-01T07:59:25.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.153+0000 7f3bb5ec8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3bb0130670 0x7f3bb0130a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:25.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.153+0000 7f3bb5ec8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3bb006f680 0x7f3bb006fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:25.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.153+0000 7f3bb5ec8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb0130260 con 0x7f3bb006ffd0 2023-10-01T07:59:25.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.153+0000 7f3bb5ec8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb0071ff0 con 0x7f3bb006f680 2023-10-01T07:59:25.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.153+0000 7f3bb5ec8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb009ecf0 con 0x7f3bb0130670 2023-10-01T07:59:25.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.153+0000 7f3baeffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3bb006f680 0x7f3bb006fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:25.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.153+0000 7f3baeffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3bb006f680 0x7f3bb006fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48664/0 (socket says 172.21.15.26:48664) 2023-10-01T07:59:25.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.153+0000 7f3baeffd700 1 -- 172.21.15.26:0/1977017167 learned_addr learned my addr 172.21.15.26:0/1977017167 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:25.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.153+0000 7f3baf7fe700 1 --2- 172.21.15.26:0/1977017167 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3bb0130670 0x7f3bb0130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:25.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.154+0000 7f3baeffd700 1 -- 172.21.15.26:0/1977017167 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3bb0130670 msgr2=0x7f3bb0130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:25.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.154+0000 7f3baeffd700 1 --2- 172.21.15.26:0/1977017167 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3bb0130670 0x7f3bb0130a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:25.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.154+0000 7f3baeffd700 1 -- 172.21.15.26:0/1977017167 >> v1:172.21.15.26:6789/0 conn(0x7f3bb006ffd0 legacy=0x7f3bb0137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:25.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.154+0000 7f3baeffd700 1 -- 172.21.15.26:0/1977017167 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb0070e70 con 0x7f3bb006f680 2023-10-01T07:59:25.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.154+0000 7f3baf7fe700 1 --2- 172.21.15.26:0/1977017167 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3bb0130670 0x7f3bb0130a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:25.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.154+0000 7f3baeffd700 1 --2- 172.21.15.26:0/1977017167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bb006f680 0x7f3bb006fa90 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400bb90 tx=0x7f3ba400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1181b0dc6d36304 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:25.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.154+0000 7f3bae7fc700 1 -- 172.21.15.26:0/1977017167 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba400dd30 con 0x7f3bb006f680 2023-10-01T07:59:25.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.154+0000 7f3bae7fc700 1 -- 172.21.15.26:0/1977017167 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba400de90 con 0x7f3bb006f680 2023-10-01T07:59:25.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.154+0000 7f3bae7fc700 1 -- 172.21.15.26:0/1977017167 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba4010690 con 0x7f3bb006f680 2023-10-01T07:59:25.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.155+0000 7f3bb5ec8700 1 -- 172.21.15.26:0/1977017167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bb006f680 msgr2=0x7f3bb006fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:25.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.155+0000 7f3bb5ec8700 1 --2- 172.21.15.26:0/1977017167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bb006f680 0x7f3bb006fa90 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400bb90 tx=0x7f3ba400bea0 comp rx=0 tx=0).stop 2023-10-01T07:59:25.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.155+0000 7f3bb5ec8700 1 -- 172.21.15.26:0/1977017167 shutdown_connections 2023-10-01T07:59:25.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.155+0000 7f3bb5ec8700 1 --2- 172.21.15.26:0/1977017167 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3bb0130670 0x7f3bb0130a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:25.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.155+0000 7f3bb5ec8700 1 --2- 172.21.15.26:0/1977017167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bb006f680 0x7f3bb006fa90 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:25.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.155+0000 7f3bb5ec8700 1 -- 172.21.15.26:0/1977017167 >> 172.21.15.26:0/1977017167 conn(0x7f3bb00a2aa0 msgr2=0x7f3bb00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:25.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.155+0000 7f3bb5ec8700 1 -- 172.21.15.26:0/1977017167 shutdown_connections 2023-10-01T07:59:25.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.155+0000 7f3bb5ec8700 1 -- 172.21.15.26:0/1977017167 wait complete. 2023-10-01T07:59:25.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.156+0000 7f3bb5ec8700 1 Processor -- start 2023-10-01T07:59:25.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.156+0000 7f3bb5ec8700 1 -- start start 2023-10-01T07:59:25.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.157+0000 7f3bb5ec8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3bb006f680 0x7f3bb011bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:25.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.157+0000 7f3bb5ec8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bb006ffd0 0x7f3bb011c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:25.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.157+0000 7f3bb5ec8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3bb0130670 0x7f3bb011c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:25.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.157+0000 7f3bb5ec8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb012db30 con 0x7f3bb006ffd0 2023-10-01T07:59:25.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.157+0000 7f3bb5ec8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb011f0e0 con 0x7f3bb0130670 2023-10-01T07:59:25.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.157+0000 7f3bb5ec8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb011f780 con 0x7f3bb006f680 2023-10-01T07:59:25.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.157+0000 7f3baf7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3bb006f680 0x7f3bb011bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:25.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.157+0000 7f3baf7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3bb006f680 0x7f3bb011bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47106/0 (socket says 172.21.15.26:47106) 2023-10-01T07:59:25.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.157+0000 7f3baf7fe700 1 -- 172.21.15.26:0/1981085620 learned_addr learned my addr 172.21.15.26:0/1981085620 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:25.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.158+0000 7f3baeffd700 1 --2- 172.21.15.26:0/1981085620 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bb006ffd0 0x7f3bb011c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:25.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.158+0000 7f3baffff700 1 --2- 172.21.15.26:0/1981085620 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3bb0130670 0x7f3bb011c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:25.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.158+0000 7f3baf7fe700 1 -- 172.21.15.26:0/1981085620 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3bb0130670 msgr2=0x7f3bb011c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:25.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.158+0000 7f3baf7fe700 1 --2- 172.21.15.26:0/1981085620 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3bb0130670 0x7f3bb011c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:25.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.158+0000 7f3baf7fe700 1 -- 172.21.15.26:0/1981085620 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bb006ffd0 msgr2=0x7f3bb011c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:25.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.158+0000 7f3baf7fe700 1 --2- 172.21.15.26:0/1981085620 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bb006ffd0 0x7f3bb011c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:25.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.158+0000 7f3baf7fe700 1 -- 172.21.15.26:0/1981085620 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba00094a0 con 0x7f3bb006f680 2023-10-01T07:59:25.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.158+0000 7f3baf7fe700 1 --2- 172.21.15.26:0/1981085620 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3bb006f680 0x7f3bb011bbf0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f3ba000ebe0 tx=0x7f3ba000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:25.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.158+0000 7f3b97fff700 1 -- 172.21.15.26:0/1981085620 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba000c850 con 0x7f3bb006f680 2023-10-01T07:59:25.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.158+0000 7f3b97fff700 1 -- 172.21.15.26:0/1981085620 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba000c9b0 con 0x7f3bb006f680 2023-10-01T07:59:25.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.158+0000 7f3bb5ec8700 1 -- 172.21.15.26:0/1981085620 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba400b7f0 con 0x7f3bb006f680 2023-10-01T07:59:25.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.158+0000 7f3b97fff700 1 -- 172.21.15.26:0/1981085620 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba000cd20 con 0x7f3bb006f680 2023-10-01T07:59:25.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.158+0000 7f3bb5ec8700 1 -- 172.21.15.26:0/1981085620 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb0071820 con 0x7f3bb006f680 2023-10-01T07:59:25.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.160+0000 7f3bb5ec8700 1 -- 172.21.15.26:0/1981085620 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb011f5b0 con 0x7f3bb006f680 2023-10-01T07:59:25.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.160+0000 7f3b97fff700 1 -- 172.21.15.26:0/1981085620 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3ba0013470 con 0x7f3bb006f680 2023-10-01T07:59:25.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.160+0000 7f3b97fff700 1 -- 172.21.15.26:0/1981085620 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3ba003fb50 con 0x7f3bb006f680 2023-10-01T07:59:25.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.165+0000 7f3b97fff700 1 -- 172.21.15.26:0/1981085620 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ba0013720 con 0x7f3bb006f680 2023-10-01T07:59:25.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.176+0000 7efe9065e700 1 Processor -- start 2023-10-01T07:59:25.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.177+0000 7efe9065e700 1 -- start start 2023-10-01T07:59:25.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.177+0000 7efe9065e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe880a0a30 0x7efe880a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:25.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.177+0000 7efe9065e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efe8809d630 0x7efe880a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:25.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.177+0000 7efe8e3fa700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe880a0a30 0x7efe880a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:25.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.177+0000 7efe9065e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe880a2a70 con 0x7efe88133930 2023-10-01T07:59:25.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.178+0000 7efe9065e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe880a01d0 con 0x7efe8809d630 2023-10-01T07:59:25.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.178+0000 7efe9065e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe8809e2b0 con 0x7efe880a0a30 2023-10-01T07:59:25.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.178+0000 7efe8e3fa700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe880a0a30 0x7efe880a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47114/0 (socket says 172.21.15.26:47114) 2023-10-01T07:59:25.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.178+0000 7efe8e3fa700 1 -- 172.21.15.26:0/668281160 learned_addr learned my addr 172.21.15.26:0/668281160 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:25.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.178+0000 7efe8dbf9700 1 --2- 172.21.15.26:0/668281160 >> v2:172.21.15.26:3300/0 conn(0x7efe8809d630 0x7efe880a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:25.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.178+0000 7efe8e3fa700 1 -- 172.21.15.26:0/668281160 >> v2:172.21.15.26:3300/0 conn(0x7efe8809d630 msgr2=0x7efe880a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:25.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.178+0000 7efe8e3fa700 1 --2- 172.21.15.26:0/668281160 >> v2:172.21.15.26:3300/0 conn(0x7efe8809d630 0x7efe880a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:25.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.178+0000 7efe8e3fa700 1 -- 172.21.15.26:0/668281160 >> v1:172.21.15.26:6789/0 conn(0x7efe88133930 legacy=0x7efe88133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:25.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.178+0000 7efe8e3fa700 1 -- 172.21.15.26:0/668281160 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8809dc50 con 0x7efe880a0a30 2023-10-01T07:59:25.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.178+0000 7efe8dbf9700 1 --2- 172.21.15.26:0/668281160 >> v2:172.21.15.26:3300/0 conn(0x7efe8809d630 0x7efe880a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:25.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.178+0000 7efe8e3fa700 1 --2- 172.21.15.26:0/668281160 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe880a0a30 0x7efe880a0e00 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7efe840098f0 tx=0x7efe84009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f3d5de04ec962de server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:25.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.179+0000 7efe8d3f8700 1 -- 172.21.15.26:0/668281160 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe84004230 con 0x7efe880a0a30 2023-10-01T07:59:25.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.179+0000 7efe8d3f8700 1 -- 172.21.15.26:0/668281160 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe84004390 con 0x7efe880a0a30 2023-10-01T07:59:25.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.179+0000 7efe8d3f8700 1 -- 172.21.15.26:0/668281160 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe840036a0 con 0x7efe880a0a30 2023-10-01T07:59:25.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.179+0000 7efe9065e700 1 -- 172.21.15.26:0/668281160 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe880a0a30 msgr2=0x7efe880a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:25.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.179+0000 7efe9065e700 1 --2- 172.21.15.26:0/668281160 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe880a0a30 0x7efe880a0e00 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7efe840098f0 tx=0x7efe84009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:25.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.179+0000 7efe9065e700 1 -- 172.21.15.26:0/668281160 shutdown_connections 2023-10-01T07:59:25.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.179+0000 7efe9065e700 1 --2- 172.21.15.26:0/668281160 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe880a0a30 0x7efe880a0e00 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:25.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.179+0000 7efe9065e700 1 --2- 172.21.15.26:0/668281160 >> v2:172.21.15.26:3300/0 conn(0x7efe8809d630 0x7efe880a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:25.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.179+0000 7efe9065e700 1 -- 172.21.15.26:0/668281160 >> 172.21.15.26:0/668281160 conn(0x7efe880a3050 msgr2=0x7efe880a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:25.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.180+0000 7efe9065e700 1 -- 172.21.15.26:0/668281160 shutdown_connections 2023-10-01T07:59:25.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.180+0000 7efe9065e700 1 -- 172.21.15.26:0/668281160 wait complete. 2023-10-01T07:59:25.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.181+0000 7efe9065e700 1 Processor -- start 2023-10-01T07:59:25.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.181+0000 7efe9065e700 1 -- start start 2023-10-01T07:59:25.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.181+0000 7efe9065e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe8809d630 0x7efe8811f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:25.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.181+0000 7efe9065e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe880a0a30 0x7efe8811f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:25.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.181+0000 7efe9065e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe88133930 0x7efe881c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:25.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.181+0000 7efe9065e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe881207f0 con 0x7efe880a0a30 2023-10-01T07:59:25.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.181+0000 7efe9065e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe88120600 con 0x7efe8809d630 2023-10-01T07:59:25.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.181+0000 7efe9065e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe8811fe90 con 0x7efe88133930 2023-10-01T07:59:25.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.181+0000 7efe8dbf9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe880a0a30 0x7efe8811f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:25.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.181+0000 7efe8dbf9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe880a0a30 0x7efe8811f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48704/0 (socket says 172.21.15.26:48704) 2023-10-01T07:59:25.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.181+0000 7efe8dbf9700 1 -- 172.21.15.26:0/3788083117 learned_addr learned my addr 172.21.15.26:0/3788083117 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:25.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.181+0000 7efe8ebfb700 1 --2- 172.21.15.26:0/3788083117 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe88133930 0x7efe881c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:25.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.182+0000 7efe8ebfb700 1 -- 172.21.15.26:0/3788083117 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe8809d630 msgr2=0x7efe8811f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:25.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.182+0000 7efe8ebfb700 1 --2- 172.21.15.26:0/3788083117 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe8809d630 0x7efe8811f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:25.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.182+0000 7efe8ebfb700 1 -- 172.21.15.26:0/3788083117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe880a0a30 msgr2=0x7efe8811f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:25.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.182+0000 7efe8ebfb700 1 --2- 172.21.15.26:0/3788083117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe880a0a30 0x7efe8811f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:25.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.182+0000 7efe8ebfb700 1 -- 172.21.15.26:0/3788083117 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe780094a0 con 0x7efe88133930 2023-10-01T07:59:25.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.182+0000 7efe8ebfb700 1 --2- 172.21.15.26:0/3788083117 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe88133930 0x7efe881c8120 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7efe8000cb10 tx=0x7efe8000ce20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:25.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.182+0000 7efe7effd700 1 -- 172.21.15.26:0/3788083117 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8000aaa0 con 0x7efe88133930 2023-10-01T07:59:25.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.182+0000 7efe7effd700 1 -- 172.21.15.26:0/3788083117 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8000ac00 con 0x7efe88133930 2023-10-01T07:59:25.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.182+0000 7efe9065e700 1 -- 172.21.15.26:0/3788083117 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe84009550 con 0x7efe88133930 2023-10-01T07:59:25.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.182+0000 7efe7effd700 1 -- 172.21.15.26:0/3788083117 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe80012420 con 0x7efe88133930 2023-10-01T07:59:25.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.182+0000 7efe9065e700 1 -- 172.21.15.26:0/3788083117 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe880a0410 con 0x7efe88133930 2023-10-01T07:59:25.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.183+0000 7efe7effd700 1 -- 172.21.15.26:0/3788083117 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efe80012580 con 0x7efe88133930 2023-10-01T07:59:25.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.184+0000 7efe7effd700 1 -- 172.21.15.26:0/3788083117 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efe8003fc90 con 0x7efe88133930 2023-10-01T07:59:25.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.184+0000 7efe9065e700 1 -- 172.21.15.26:0/3788083117 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe88121ed0 con 0x7efe88133930 2023-10-01T07:59:25.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.193+0000 7efe7effd700 1 -- 172.21.15.26:0/3788083117 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efe800226c0 con 0x7efe88133930 2023-10-01T07:59:25.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.336+0000 7f16ad17d700 1 -- 172.21.15.26:0/544654678 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f16a811edb0 con 0x7f16a809de50 2023-10-01T07:59:25.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.336+0000 7f168f7fe700 1 -- 172.21.15.26:0/544654678 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f16a811edb0 con 0x7f16a809de50 2023-10-01T07:59:25.337 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:25.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.340+0000 7f16ad17d700 1 -- 172.21.15.26:0/544654678 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f16a809de50 msgr2=0x7f16a811b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:25.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.340+0000 7f16ad17d700 1 --2- 172.21.15.26:0/544654678 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f16a809de50 0x7f16a811b630 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f1698000c00 tx=0x7f1698004750 comp rx=0 tx=0).stop 2023-10-01T07:59:25.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.340+0000 7f16ad17d700 1 -- 172.21.15.26:0/544654678 shutdown_connections 2023-10-01T07:59:25.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.340+0000 7f16ad17d700 1 --2- 172.21.15.26:0/544654678 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16a81338a0 0x7f16a811c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:25.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.340+0000 7f16ad17d700 1 --2- 172.21.15.26:0/544654678 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f16a809de50 0x7f16a811b630 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:25.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.340+0000 7f16ad17d700 1 --2- 172.21.15.26:0/544654678 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f16a809e930 0x7f16a811bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:25.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.340+0000 7f16ad17d700 1 -- 172.21.15.26:0/544654678 >> 172.21.15.26:0/544654678 conn(0x7f16a80a2aa0 msgr2=0x7f16a8130630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:25.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.340+0000 7f16ad17d700 1 -- 172.21.15.26:0/544654678 shutdown_connections 2023-10-01T07:59:25.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.340+0000 7f16ad17d700 1 -- 172.21.15.26:0/544654678 wait complete. 2023-10-01T07:59:25.360 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:25.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.374+0000 7fa8f851f700 1 -- 172.21.15.26:0/2231837399 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa8f0121f60 con 0x7fa8f006b250 2023-10-01T07:59:25.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.374+0000 7fa8e6ffd700 1 -- 172.21.15.26:0/2231837399 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa8f0121f60 con 0x7fa8f006b250 2023-10-01T07:59:25.375 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:25.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.377+0000 7fa8f851f700 1 -- 172.21.15.26:0/2231837399 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa8f006b250 msgr2=0x7fa8f01c8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:25.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.377+0000 7fa8f851f700 1 --2- 172.21.15.26:0/2231837399 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa8f006b250 0x7fa8f01c8750 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fa8e000ebe0 tx=0x7fa8e000eef0 comp rx=0 tx=0).stop 2023-10-01T07:59:25.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.377+0000 7fa8f851f700 1 -- 172.21.15.26:0/2231837399 shutdown_connections 2023-10-01T07:59:25.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.377+0000 7fa8f851f700 1 --2- 172.21.15.26:0/2231837399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8f0136d80 0x7fa8f01c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:25.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.377+0000 7fa8f851f700 1 --2- 172.21.15.26:0/2231837399 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa8f006a770 0x7fa8f01c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:25.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.377+0000 7fa8f851f700 1 --2- 172.21.15.26:0/2231837399 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa8f006b250 0x7fa8f01c8750 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:25.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.377+0000 7fa8f851f700 1 -- 172.21.15.26:0/2231837399 >> 172.21.15.26:0/2231837399 conn(0x7fa8f0066f50 msgr2=0x7fa8f00a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:25.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.377+0000 7fa8f851f700 1 -- 172.21.15.26:0/2231837399 shutdown_connections 2023-10-01T07:59:25.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.377+0000 7fa8f851f700 1 -- 172.21.15.26:0/2231837399 wait complete. 2023-10-01T07:59:25.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.381+0000 7f3bb5ec8700 1 -- 172.21.15.26:0/1981085620 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3bb004f300 con 0x7f3bb006f680 2023-10-01T07:59:25.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.381+0000 7f3b97fff700 1 -- 172.21.15.26:0/1981085620 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3ba0021090 con 0x7f3bb006f680 2023-10-01T07:59:25.381 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:25.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.383+0000 7f3bb5ec8700 1 -- 172.21.15.26:0/1981085620 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3bb006f680 msgr2=0x7f3bb011bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:25.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.383+0000 7f3bb5ec8700 1 --2- 172.21.15.26:0/1981085620 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3bb006f680 0x7f3bb011bbf0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f3ba000ebe0 tx=0x7f3ba000eef0 comp rx=0 tx=0).stop 2023-10-01T07:59:25.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.384+0000 7f3bb5ec8700 1 -- 172.21.15.26:0/1981085620 shutdown_connections 2023-10-01T07:59:25.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.384+0000 7f3bb5ec8700 1 --2- 172.21.15.26:0/1981085620 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3bb0130670 0x7f3bb011c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:25.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.384+0000 7f3bb5ec8700 1 --2- 172.21.15.26:0/1981085620 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3bb006f680 0x7f3bb011bbf0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:25.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.384+0000 7f3bb5ec8700 1 --2- 172.21.15.26:0/1981085620 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bb006ffd0 0x7f3bb011c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:25.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.384+0000 7f3bb5ec8700 1 -- 172.21.15.26:0/1981085620 >> 172.21.15.26:0/1981085620 conn(0x7f3bb00a2aa0 msgr2=0x7f3bb006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:25.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.384+0000 7f3bb5ec8700 1 -- 172.21.15.26:0/1981085620 shutdown_connections 2023-10-01T07:59:25.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.384+0000 7f3bb5ec8700 1 -- 172.21.15.26:0/1981085620 wait complete. 2023-10-01T07:59:25.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:25.401 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:25.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.434+0000 7efe9065e700 1 -- 172.21.15.26:0/3788083117 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efe880747f0 con 0x7efe88133930 2023-10-01T07:59:25.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.434+0000 7efe7effd700 1 -- 172.21.15.26:0/3788083117 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efe80029020 con 0x7efe88133930 2023-10-01T07:59:25.435 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:25.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.436+0000 7efe9065e700 1 -- 172.21.15.26:0/3788083117 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe88133930 msgr2=0x7efe881c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:25.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.436+0000 7efe9065e700 1 --2- 172.21.15.26:0/3788083117 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe88133930 0x7efe881c8120 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7efe8000cb10 tx=0x7efe8000ce20 comp rx=0 tx=0).stop 2023-10-01T07:59:25.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.436+0000 7efe9065e700 1 -- 172.21.15.26:0/3788083117 shutdown_connections 2023-10-01T07:59:25.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.436+0000 7efe9065e700 1 --2- 172.21.15.26:0/3788083117 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe88133930 0x7efe881c8120 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:25.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.436+0000 7efe9065e700 1 --2- 172.21.15.26:0/3788083117 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe8809d630 0x7efe8811f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:25.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.436+0000 7efe9065e700 1 --2- 172.21.15.26:0/3788083117 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe880a0a30 0x7efe8811f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:25.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.436+0000 7efe9065e700 1 -- 172.21.15.26:0/3788083117 >> 172.21.15.26:0/3788083117 conn(0x7efe880a3050 msgr2=0x7efe8809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:25.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.436+0000 7efe9065e700 1 -- 172.21.15.26:0/3788083117 shutdown_connections 2023-10-01T07:59:25.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:25.436+0000 7efe9065e700 1 -- 172.21.15.26:0/3788083117 wait complete. 2023-10-01T07:59:25.450 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:26.361 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:26.396 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:26.402 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:26.451 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:26.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.529+0000 7fb5c43bb700 1 Processor -- start 2023-10-01T07:59:26.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.529+0000 7fb5c43bb700 1 -- start start 2023-10-01T07:59:26.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.530+0000 7fb5c43bb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5bc09e930 0x7fb5bc09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:26.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.530+0000 7fb5c43bb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb5bc09f240 0x7fb5bc1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:26.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.530+0000 7fb5c43bb700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5bc070940 con 0x7fb5bc09f650 2023-10-01T07:59:26.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.530+0000 7fb5c43bb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc06fd60 con 0x7fb5bc09e930 2023-10-01T07:59:26.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.530+0000 7fb5c43bb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc06fa80 con 0x7fb5bc09f240 2023-10-01T07:59:26.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.531+0000 7fb5c2958700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb5bc09f650 0x7fb5bc131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37776/0 (socket says 172.21.15.26:37776) 2023-10-01T07:59:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.531+0000 7fb5c2958700 1 -- 172.21.15.26:0/89811547 learned_addr learned my addr 172.21.15.26:0/89811547 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:59:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.531+0000 7fb5c1956700 1 --2- 172.21.15.26:0/89811547 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb5bc09f240 0x7fb5bc1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.531+0000 7fb5c2157700 1 --2- 172.21.15.26:0/89811547 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5bc09e930 0x7fb5bc09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.531+0000 7fb5c2157700 1 -- 172.21.15.26:0/89811547 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb5bc09f240 msgr2=0x7fb5bc1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.531+0000 7fb5c1155700 1 -- 172.21.15.26:0/89811547 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1296325484 0 0) 0x7fb5bc070940 con 0x7fb5bc09f650 2023-10-01T07:59:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.531+0000 7fb5c2157700 1 --2- 172.21.15.26:0/89811547 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb5bc09f240 0x7fb5bc1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.531+0000 7fb5c2157700 1 -- 172.21.15.26:0/89811547 >> v1:172.21.15.26:6789/0 conn(0x7fb5bc09f650 legacy=0x7fb5bc131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.531+0000 7fb5c2157700 1 -- 172.21.15.26:0/89811547 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5bc09fb60 con 0x7fb5bc09e930 2023-10-01T07:59:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.532+0000 7fb5c2157700 1 --2- 172.21.15.26:0/89811547 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5bc09e930 0x7fb5bc09ed00 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8009870 tx=0x7fb5b8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50b6d064e17dc8f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.532+0000 7fb5c1155700 1 -- 172.21.15.26:0/89811547 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8011830 con 0x7fb5bc09e930 2023-10-01T07:59:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.532+0000 7fb5c1155700 1 -- 172.21.15.26:0/89811547 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b8011990 con 0x7fb5bc09e930 2023-10-01T07:59:26.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.532+0000 7fb5c1155700 1 -- 172.21.15.26:0/89811547 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8011d20 con 0x7fb5bc09e930 2023-10-01T07:59:26.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.532+0000 7fb5c43bb700 1 -- 172.21.15.26:0/89811547 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5bc09e930 msgr2=0x7fb5bc09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:26.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.532+0000 7fb5c43bb700 1 --2- 172.21.15.26:0/89811547 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5bc09e930 0x7fb5bc09ed00 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8009870 tx=0x7fb5b8009b80 comp rx=0 tx=0).stop 2023-10-01T07:59:26.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.533+0000 7fb5c43bb700 1 -- 172.21.15.26:0/89811547 shutdown_connections 2023-10-01T07:59:26.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.533+0000 7fb5c43bb700 1 --2- 172.21.15.26:0/89811547 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5bc09e930 0x7fb5bc09ed00 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.533+0000 7fb5c43bb700 1 --2- 172.21.15.26:0/89811547 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb5bc09f240 0x7fb5bc1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.533+0000 7fb5c43bb700 1 -- 172.21.15.26:0/89811547 >> 172.21.15.26:0/89811547 conn(0x7fb5bc0a4210 msgr2=0x7fb5bc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:26.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.533+0000 7fb5c43bb700 1 -- 172.21.15.26:0/89811547 shutdown_connections 2023-10-01T07:59:26.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.533+0000 7fb5c43bb700 1 -- 172.21.15.26:0/89811547 wait complete. 2023-10-01T07:59:26.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.534+0000 7fb5c43bb700 1 Processor -- start 2023-10-01T07:59:26.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.534+0000 7fb5c43bb700 1 -- start start 2023-10-01T07:59:26.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.535+0000 7fb5c43bb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5bc09e930 0x7fb5bc06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:26.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.535+0000 7fb5c43bb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb5bc09f240 0x7fb5bc06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:26.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.535+0000 7fb5c43bb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5bc09f650 0x7fb5bc06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:26.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.535+0000 7fb5c43bb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc1a95c0 con 0x7fb5bc09f650 2023-10-01T07:59:26.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.535+0000 7fb5c43bb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc06d4c0 con 0x7fb5bc09e930 2023-10-01T07:59:26.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.535+0000 7fb5c43bb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc1a9260 con 0x7fb5bc09f240 2023-10-01T07:59:26.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.535+0000 7fb5c2157700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5bc09e930 0x7fb5bc06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:26.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.535+0000 7fb5c2157700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5bc09e930 0x7fb5bc06b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47382/0 (socket says 172.21.15.26:47382) 2023-10-01T07:59:26.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.535+0000 7fb5c2157700 1 -- 172.21.15.26:0/2854638988 learned_addr learned my addr 172.21.15.26:0/2854638988 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:26.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.535+0000 7fb5c1956700 1 --2- 172.21.15.26:0/2854638988 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb5bc09f240 0x7fb5bc06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:26.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.535+0000 7fb5c2958700 1 --2- 172.21.15.26:0/2854638988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5bc09f650 0x7fb5bc06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:26.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.536+0000 7fb5c2157700 1 -- 172.21.15.26:0/2854638988 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb5bc09f240 msgr2=0x7fb5bc06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:26.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.536+0000 7fb5c2157700 1 --2- 172.21.15.26:0/2854638988 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb5bc09f240 0x7fb5bc06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.536+0000 7fb5c2157700 1 -- 172.21.15.26:0/2854638988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5bc09f650 msgr2=0x7fb5bc06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:26.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.536+0000 7fb5c2157700 1 --2- 172.21.15.26:0/2854638988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5bc09f650 0x7fb5bc06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.536+0000 7fb5c2157700 1 -- 172.21.15.26:0/2854638988 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b80094a0 con 0x7fb5bc09e930 2023-10-01T07:59:26.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.536+0000 7fb5c2157700 1 --2- 172.21.15.26:0/2854638988 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5bc09e930 0x7fb5bc06b8b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8009bc0 tx=0x7fb5b8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:26.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.536+0000 7fb5b2ffd700 1 -- 172.21.15.26:0/2854638988 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b80036a0 con 0x7fb5bc09e930 2023-10-01T07:59:26.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.536+0000 7fb5b2ffd700 1 -- 172.21.15.26:0/2854638988 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b801f070 con 0x7fb5bc09e930 2023-10-01T07:59:26.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.536+0000 7fb5b2ffd700 1 -- 172.21.15.26:0/2854638988 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8003a40 con 0x7fb5bc09e930 2023-10-01T07:59:26.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.537+0000 7fb5c43bb700 1 -- 172.21.15.26:0/2854638988 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5bc0a0190 con 0x7fb5bc09e930 2023-10-01T07:59:26.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.537+0000 7fb5c43bb700 1 -- 172.21.15.26:0/2854638988 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5bc1a8780 con 0x7fb5bc09e930 2023-10-01T07:59:26.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.538+0000 7fb5c43bb700 1 -- 172.21.15.26:0/2854638988 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5bc1a8b40 con 0x7fb5bc09e930 2023-10-01T07:59:26.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.539+0000 7fb5b2ffd700 1 -- 172.21.15.26:0/2854638988 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb5b8003ba0 con 0x7fb5bc09e930 2023-10-01T07:59:26.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.539+0000 7fb5b2ffd700 1 -- 172.21.15.26:0/2854638988 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb5b8021070 con 0x7fb5bc09e930 2023-10-01T07:59:26.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.544+0000 7fb5b2ffd700 1 -- 172.21.15.26:0/2854638988 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb5b8026480 con 0x7fb5bc09e930 2023-10-01T07:59:26.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.554+0000 7f18ff973700 1 Processor -- start 2023-10-01T07:59:26.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.554+0000 7f18ff973700 1 -- start start 2023-10-01T07:59:26.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.555+0000 7f18ff973700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f18f809d6f0 0x7f18f809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:26.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.555+0000 7f18ff973700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f18f809e000 0x7f18f8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:26.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.555+0000 7f18ff973700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f18f809e410 0x7f18f8130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:26.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.555+0000 7f18ff973700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18f809f520 con 0x7f18f809e410 2023-10-01T07:59:26.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.555+0000 7f18ff973700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f809f130 con 0x7f18f809d6f0 2023-10-01T07:59:26.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.555+0000 7f18ff973700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18f809e930 con 0x7f18f809e000 2023-10-01T07:59:26.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.555+0000 7f18fd70f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f18f809d6f0 0x7f18f809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:26.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.555+0000 7f18fd70f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f18f809d6f0 0x7f18f809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47386/0 (socket says 172.21.15.26:47386) 2023-10-01T07:59:26.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.555+0000 7f18fd70f700 1 -- 172.21.15.26:0/2907414520 learned_addr learned my addr 172.21.15.26:0/2907414520 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:26.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.555+0000 7f18fdf10700 1 --2- 172.21.15.26:0/2907414520 >> v2:172.21.15.26:3300/0 conn(0x7f18f809e410 0x7f18f8130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:26.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.555+0000 7f18fcf0e700 1 --2- 172.21.15.26:0/2907414520 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f18f809e000 0x7f18f8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:26.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.556+0000 7f18fdf10700 1 -- 172.21.15.26:0/2907414520 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f18f809e000 msgr2=0x7f18f8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:26.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.556+0000 7f18fdf10700 1 --2- 172.21.15.26:0/2907414520 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f18f809e000 0x7f18f8130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.556+0000 7f18fdf10700 1 -- 172.21.15.26:0/2907414520 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f18f809d6f0 msgr2=0x7f18f809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:26.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.556+0000 7f18fdf10700 1 --2- 172.21.15.26:0/2907414520 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f18f809d6f0 0x7f18f809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.556+0000 7f18fdf10700 1 -- 172.21.15.26:0/2907414520 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f809b2d0 con 0x7f18f809e410 2023-10-01T07:59:26.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.556+0000 7f18fcf0e700 1 --2- 172.21.15.26:0/2907414520 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f18f809e000 0x7f18f8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:26.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.556+0000 7f18fd70f700 1 --2- 172.21.15.26:0/2907414520 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f18f809d6f0 0x7f18f809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:26.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.556+0000 7f18fdf10700 1 --2- 172.21.15.26:0/2907414520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18f809e410 0x7f18f8130ba0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f18f0009d90 tx=0x7f18f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d05213d5b7e36263 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:26.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.556+0000 7f18effff700 1 -- 172.21.15.26:0/2907414520 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f000e070 con 0x7f18f809e410 2023-10-01T07:59:26.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.556+0000 7f18effff700 1 -- 172.21.15.26:0/2907414520 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f000bb20 con 0x7f18f809e410 2023-10-01T07:59:26.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.556+0000 7f18effff700 1 -- 172.21.15.26:0/2907414520 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f0012430 con 0x7f18f809e410 2023-10-01T07:59:26.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.557+0000 7f18ff973700 1 -- 172.21.15.26:0/2907414520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18f809e410 msgr2=0x7f18f8130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:26.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.557+0000 7f18ff973700 1 --2- 172.21.15.26:0/2907414520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18f809e410 0x7f18f8130ba0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f18f0009d90 tx=0x7f18f000b330 comp rx=0 tx=0).stop 2023-10-01T07:59:26.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.557+0000 7f18ff973700 1 -- 172.21.15.26:0/2907414520 shutdown_connections 2023-10-01T07:59:26.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.557+0000 7f18ff973700 1 --2- 172.21.15.26:0/2907414520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18f809e410 0x7f18f8130ba0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.557+0000 7f18ff973700 1 --2- 172.21.15.26:0/2907414520 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f18f809d6f0 0x7f18f809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.557+0000 7f18ff973700 1 --2- 172.21.15.26:0/2907414520 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f18f809e000 0x7f18f8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.557+0000 7f18ff973700 1 -- 172.21.15.26:0/2907414520 >> 172.21.15.26:0/2907414520 conn(0x7f18f8066f50 msgr2=0x7f18f809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:26.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.557+0000 7f18ff973700 1 -- 172.21.15.26:0/2907414520 shutdown_connections 2023-10-01T07:59:26.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.557+0000 7f18ff973700 1 -- 172.21.15.26:0/2907414520 wait complete. 2023-10-01T07:59:26.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.558+0000 7f18ff973700 1 Processor -- start 2023-10-01T07:59:26.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.559+0000 7f18ff973700 1 -- start start 2023-10-01T07:59:26.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.559+0000 7f18ff973700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f18f809d6f0 0x7f18f8137920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:26.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.559+0000 7f18ff973700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f18f809e000 0x7f18f8137e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:26.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.559+0000 7f18ff973700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18f809e410 0x7f18f81383a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:26.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.559+0000 7f18ff973700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f8138d10 con 0x7f18f809e410 2023-10-01T07:59:26.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.559+0000 7f18ff973700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f811a9d0 con 0x7f18f809e000 2023-10-01T07:59:26.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.559+0000 7f18ff973700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18f809c700 con 0x7f18f809d6f0 2023-10-01T07:59:26.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.560+0000 7f18fcf0e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f18f809e000 0x7f18f8137e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:26.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.560+0000 7f18fcf0e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f18f809e000 0x7f18f8137e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47396/0 (socket says 172.21.15.26:47396) 2023-10-01T07:59:26.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.560+0000 7f18fd70f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f18f809d6f0 0x7f18f8137920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:26.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.560+0000 7f18fcf0e700 1 -- 172.21.15.26:0/1348420514 learned_addr learned my addr 172.21.15.26:0/1348420514 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:26.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.560+0000 7f18fdf10700 1 --2- 172.21.15.26:0/1348420514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18f809e410 0x7f18f81383a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:26.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.560+0000 7f18fd70f700 1 -- 172.21.15.26:0/1348420514 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f18f809e000 msgr2=0x7f18f8137e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:26.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.560+0000 7f18fd70f700 1 --2- 172.21.15.26:0/1348420514 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f18f809e000 0x7f18f8137e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.560+0000 7f18fd70f700 1 -- 172.21.15.26:0/1348420514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18f809e410 msgr2=0x7f18f81383a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:26.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.560+0000 7f18fd70f700 1 --2- 172.21.15.26:0/1348420514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18f809e410 0x7f18f81383a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.560+0000 7f18fd70f700 1 -- 172.21.15.26:0/1348420514 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f4009550 con 0x7f18f809d6f0 2023-10-01T07:59:26.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.560+0000 7f18fd70f700 1 --2- 172.21.15.26:0/1348420514 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f18f809d6f0 0x7f18f8137920 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f18f400e9e0 tx=0x7f18f400ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:26.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.561+0000 7f18edffb700 1 -- 172.21.15.26:0/1348420514 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f400eee0 con 0x7f18f809d6f0 2023-10-01T07:59:26.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.561+0000 7f18edffb700 1 -- 172.21.15.26:0/1348420514 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f400c850 con 0x7f18f809d6f0 2023-10-01T07:59:26.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.561+0000 7f18ff973700 1 -- 172.21.15.26:0/1348420514 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e80094a0 con 0x7f18f809d6f0 2023-10-01T07:59:26.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.561+0000 7f18edffb700 1 -- 172.21.15.26:0/1348420514 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f400cbe0 con 0x7f18f809d6f0 2023-10-01T07:59:26.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.561+0000 7f18ff973700 1 -- 172.21.15.26:0/1348420514 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f0009a70 con 0x7f18f809d6f0 2023-10-01T07:59:26.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.562+0000 7f18edffb700 1 -- 172.21.15.26:0/1348420514 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f18f400cd40 con 0x7f18f809d6f0 2023-10-01T07:59:26.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.562+0000 7f18edffb700 1 -- 172.21.15.26:0/1348420514 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f18f403fa30 con 0x7f18f809d6f0 2023-10-01T07:59:26.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.562+0000 7f18ff973700 1 -- 172.21.15.26:0/1348420514 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f809dac0 con 0x7f18f809d6f0 2023-10-01T07:59:26.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.567+0000 7f18edffb700 1 -- 172.21.15.26:0/1348420514 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f18f4017080 con 0x7f18f809d6f0 2023-10-01T07:59:26.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.576+0000 7fee0951e700 1 Processor -- start 2023-10-01T07:59:26.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.576+0000 7fee0951e700 1 -- start start 2023-10-01T07:59:26.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.577+0000 7fee0951e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fee0409d6f0 0x7fee0409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:26.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.577+0000 7fee0951e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee0409e000 0x7fee041339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:26.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.577+0000 7fee0951e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee0409b120 con 0x7fee0409e410 2023-10-01T07:59:26.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.577+0000 7fee0951e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee0406b460 con 0x7fee0409d6f0 2023-10-01T07:59:26.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.577+0000 7fee0951e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee0409a7e0 con 0x7fee0409e000 2023-10-01T07:59:26.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.577+0000 7fee027fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee0409e000 0x7fee041339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:26.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.577+0000 7fee027fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee0409e000 0x7fee041339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47412/0 (socket says 172.21.15.26:47412) 2023-10-01T07:59:26.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.577+0000 7fee027fc700 1 -- 172.21.15.26:0/2038783348 learned_addr learned my addr 172.21.15.26:0/2038783348 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:26.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.578+0000 7fee027fc700 1 -- 172.21.15.26:0/2038783348 >> v2:172.21.15.26:3300/0 conn(0x7fee0409d6f0 msgr2=0x7fee0409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:26.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.578+0000 7fee027fc700 1 --2- 172.21.15.26:0/2038783348 >> v2:172.21.15.26:3300/0 conn(0x7fee0409d6f0 0x7fee0409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.578+0000 7fee027fc700 1 -- 172.21.15.26:0/2038783348 >> v1:172.21.15.26:6789/0 conn(0x7fee0409e410 legacy=0x7fee04133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:26.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.578+0000 7fee027fc700 1 -- 172.21.15.26:0/2038783348 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0409a500 con 0x7fee0409e000 2023-10-01T07:59:26.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.578+0000 7fee027fc700 1 --2- 172.21.15.26:0/2038783348 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee0409e000 0x7fee041339f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fedf8009920 tx=0x7fedf8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=604be1ac2a6beabd server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:26.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.578+0000 7fee01ffb700 1 -- 172.21.15.26:0/2038783348 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf8004230 con 0x7fee0409e000 2023-10-01T07:59:26.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.578+0000 7fee01ffb700 1 -- 172.21.15.26:0/2038783348 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf8004390 con 0x7fee0409e000 2023-10-01T07:59:26.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.578+0000 7fee01ffb700 1 -- 172.21.15.26:0/2038783348 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf8009e70 con 0x7fee0409e000 2023-10-01T07:59:26.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.579+0000 7fee0951e700 1 -- 172.21.15.26:0/2038783348 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee0409e000 msgr2=0x7fee041339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.579+0000 7fee0951e700 1 --2- 172.21.15.26:0/2038783348 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee0409e000 0x7fee041339f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fedf8009920 tx=0x7fedf8009c30 comp rx=0 tx=0).stop 2023-10-01T07:59:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.579+0000 7fee0951e700 1 -- 172.21.15.26:0/2038783348 shutdown_connections 2023-10-01T07:59:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.579+0000 7fee0951e700 1 --2- 172.21.15.26:0/2038783348 >> v2:172.21.15.26:3300/0 conn(0x7fee0409d6f0 0x7fee0409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.579+0000 7fee0951e700 1 --2- 172.21.15.26:0/2038783348 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee0409e000 0x7fee041339f0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.579+0000 7fee0951e700 1 -- 172.21.15.26:0/2038783348 >> 172.21.15.26:0/2038783348 conn(0x7fee04066f50 msgr2=0x7fee0409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.579+0000 7fee0951e700 1 -- 172.21.15.26:0/2038783348 shutdown_connections 2023-10-01T07:59:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.579+0000 7fee0951e700 1 -- 172.21.15.26:0/2038783348 wait complete. 2023-10-01T07:59:26.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.581+0000 7fee0951e700 1 Processor -- start 2023-10-01T07:59:26.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.581+0000 7fee0951e700 1 -- start start 2023-10-01T07:59:26.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.581+0000 7fee0951e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee0409d6f0 0x7fee041a4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:26.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.581+0000 7fee0951e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee0409e000 0x7fee041a54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:26.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.581+0000 7fee0951e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee0409e410 0x7fee041a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:26.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.581+0000 7fee0951e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee041a8450 con 0x7fee0409e000 2023-10-01T07:59:26.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.581+0000 7fee0951e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee041a7980 con 0x7fee0409d6f0 2023-10-01T07:59:26.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.581+0000 7fee0951e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee041a6bf0 con 0x7fee0409e410 2023-10-01T07:59:26.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.582+0000 7fee02ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee0409d6f0 0x7fee041a4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:26.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.582+0000 7fee02ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee0409d6f0 0x7fee041a4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47418/0 (socket says 172.21.15.26:47418) 2023-10-01T07:59:26.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.582+0000 7fee02ffd700 1 -- 172.21.15.26:0/3001304909 learned_addr learned my addr 172.21.15.26:0/3001304909 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:26.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.582+0000 7fee027fc700 1 --2- 172.21.15.26:0/3001304909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee0409e000 0x7fee041a54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:26.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.582+0000 7fee037fe700 1 --2- 172.21.15.26:0/3001304909 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee0409e410 0x7fee041a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:26.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.582+0000 7fee02ffd700 1 -- 172.21.15.26:0/3001304909 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee0409e410 msgr2=0x7fee041a59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:26.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.582+0000 7fee02ffd700 1 --2- 172.21.15.26:0/3001304909 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee0409e410 0x7fee041a59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.582+0000 7fee02ffd700 1 -- 172.21.15.26:0/3001304909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee0409e000 msgr2=0x7fee041a54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:26.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.582+0000 7fee02ffd700 1 --2- 172.21.15.26:0/3001304909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee0409e000 0x7fee041a54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.582+0000 7fee02ffd700 1 -- 172.21.15.26:0/3001304909 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf8009550 con 0x7fee0409d6f0 2023-10-01T07:59:26.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.583+0000 7fee02ffd700 1 --2- 172.21.15.26:0/3001304909 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee0409d6f0 0x7fee041a4f70 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fedf400b4a0 tx=0x7fedf400b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:26.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.583+0000 7fedeb7fe700 1 -- 172.21.15.26:0/3001304909 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf4011830 con 0x7fee0409d6f0 2023-10-01T07:59:26.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.583+0000 7fedeb7fe700 1 -- 172.21.15.26:0/3001304909 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf4011990 con 0x7fee0409d6f0 2023-10-01T07:59:26.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.583+0000 7fee0951e700 1 -- 172.21.15.26:0/3001304909 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee041a7da0 con 0x7fee0409d6f0 2023-10-01T07:59:26.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.583+0000 7fedeb7fe700 1 -- 172.21.15.26:0/3001304909 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf4011d40 con 0x7fee0409d6f0 2023-10-01T07:59:26.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.583+0000 7fee0951e700 1 -- 172.21.15.26:0/3001304909 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee0409c760 con 0x7fee0409d6f0 2023-10-01T07:59:26.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.584+0000 7fedeb7fe700 1 -- 172.21.15.26:0/3001304909 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fedf401a400 con 0x7fee0409d6f0 2023-10-01T07:59:26.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.584+0000 7fedeb7fe700 1 -- 172.21.15.26:0/3001304909 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fedf400f4a0 con 0x7fee0409d6f0 2023-10-01T07:59:26.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.584+0000 7fee0951e700 1 -- 172.21.15.26:0/3001304909 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee041a85c0 con 0x7fee0409d6f0 2023-10-01T07:59:26.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.594+0000 7fedeb7fe700 1 -- 172.21.15.26:0/3001304909 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fedf4015070 con 0x7fee0409d6f0 2023-10-01T07:59:26.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.604+0000 7f1c25b5a700 1 Processor -- start 2023-10-01T07:59:26.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.604+0000 7f1c25b5a700 1 -- start start 2023-10-01T07:59:26.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.605+0000 7f1c25b5a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c200a0a30 0x7f1c200a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:26.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.605+0000 7f1c25b5a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1c2009d630 0x7f1c200a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:26.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.605+0000 7f1c25b5a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c20133930 0x7f1c20133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:26.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.605+0000 7f1c25b5a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c200a2a70 con 0x7f1c2009d630 2023-10-01T07:59:26.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.605+0000 7f1c25b5a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c200a01d0 con 0x7f1c20133930 2023-10-01T07:59:26.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.605+0000 7f1c25b5a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2009e2b0 con 0x7f1c200a0a30 2023-10-01T07:59:26.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.606+0000 7f1c1ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c20133930 0x7f1c20133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:26.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.606+0000 7f1c1f7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c200a0a30 0x7f1c200a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:26.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.606+0000 7f1c1ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c20133930 0x7f1c20133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47430/0 (socket says 172.21.15.26:47430) 2023-10-01T07:59:26.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.606+0000 7f1c1ffff700 1 -- 172.21.15.26:0/1967967877 learned_addr learned my addr 172.21.15.26:0/1967967877 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:26.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.606+0000 7f1c1effd700 1 --2- 172.21.15.26:0/1967967877 >> v2:172.21.15.26:3300/0 conn(0x7f1c2009d630 0x7f1c200a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:26.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.606+0000 7f1c1ffff700 1 -- 172.21.15.26:0/1967967877 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c200a0a30 msgr2=0x7f1c200a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:26.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.606+0000 7f1c1ffff700 1 --2- 172.21.15.26:0/1967967877 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c200a0a30 0x7f1c200a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.606+0000 7f1c1ffff700 1 -- 172.21.15.26:0/1967967877 >> v2:172.21.15.26:3300/0 conn(0x7f1c2009d630 msgr2=0x7f1c200a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:26.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.606+0000 7f1c1ffff700 1 --2- 172.21.15.26:0/1967967877 >> v2:172.21.15.26:3300/0 conn(0x7f1c2009d630 0x7f1c200a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.606+0000 7f1c1ffff700 1 -- 172.21.15.26:0/1967967877 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2009dc50 con 0x7f1c20133930 2023-10-01T07:59:26.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.606+0000 7f1c1ffff700 1 --2- 172.21.15.26:0/1967967877 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c20133930 0x7f1c20133dd0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f1c18009e50 tx=0x7f1c1800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20b611a41fa8aa42 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:26.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.607+0000 7f1c1e7fc700 1 -- 172.21.15.26:0/1967967877 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1800e070 con 0x7f1c20133930 2023-10-01T07:59:26.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.607+0000 7f1c1e7fc700 1 -- 172.21.15.26:0/1967967877 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1800b910 con 0x7f1c20133930 2023-10-01T07:59:26.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.607+0000 7f1c1e7fc700 1 -- 172.21.15.26:0/1967967877 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1800bcc0 con 0x7f1c20133930 2023-10-01T07:59:26.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.607+0000 7f1c25b5a700 1 -- 172.21.15.26:0/1967967877 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c20133930 msgr2=0x7f1c20133dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:26.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.608+0000 7f1c25b5a700 1 --2- 172.21.15.26:0/1967967877 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c20133930 0x7f1c20133dd0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f1c18009e50 tx=0x7f1c1800b330 comp rx=0 tx=0).stop 2023-10-01T07:59:26.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.608+0000 7f1c25b5a700 1 -- 172.21.15.26:0/1967967877 shutdown_connections 2023-10-01T07:59:26.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.608+0000 7f1c25b5a700 1 --2- 172.21.15.26:0/1967967877 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c20133930 0x7f1c20133dd0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.608+0000 7f1c25b5a700 1 --2- 172.21.15.26:0/1967967877 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c200a0a30 0x7f1c200a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.608+0000 7f1c25b5a700 1 --2- 172.21.15.26:0/1967967877 >> v2:172.21.15.26:3300/0 conn(0x7f1c2009d630 0x7f1c200a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.608+0000 7f1c25b5a700 1 -- 172.21.15.26:0/1967967877 >> 172.21.15.26:0/1967967877 conn(0x7f1c200a3050 msgr2=0x7f1c200a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:26.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.608+0000 7f1c25b5a700 1 -- 172.21.15.26:0/1967967877 shutdown_connections 2023-10-01T07:59:26.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.608+0000 7f1c25b5a700 1 -- 172.21.15.26:0/1967967877 wait complete. 2023-10-01T07:59:26.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.609+0000 7f1c25b5a700 1 Processor -- start 2023-10-01T07:59:26.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.609+0000 7f1c25b5a700 1 -- start start 2023-10-01T07:59:26.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.610+0000 7f1c25b5a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c2009d630 0x7f1c20126020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:26.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.610+0000 7f1c25b5a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c200a0a30 0x7f1c20126560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:26.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.610+0000 7f1c1f7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c2009d630 0x7f1c20126020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:26.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.610+0000 7f1c1f7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c2009d630 0x7f1c20126020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47160/0 (socket says 172.21.15.26:47160) 2023-10-01T07:59:26.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.610+0000 7f1c1effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c200a0a30 0x7f1c20126560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:26.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.610+0000 7f1c25b5a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c20133930 0x7f1c20126aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:26.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.610+0000 7f1c1effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c200a0a30 0x7f1c20126560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47432/0 (socket says 172.21.15.26:47432) 2023-10-01T07:59:26.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.610+0000 7f1c1f7fe700 1 -- 172.21.15.26:0/459577187 learned_addr learned my addr 172.21.15.26:0/459577187 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:26.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.610+0000 7f1c25b5a700 1 -- 172.21.15.26:0/459577187 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c201273f0 con 0x7f1c20133930 2023-10-01T07:59:26.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.610+0000 7f1c25b5a700 1 -- 172.21.15.26:0/459577187 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c20132da0 con 0x7f1c200a0a30 2023-10-01T07:59:26.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.610+0000 7f1c25b5a700 1 -- 172.21.15.26:0/459577187 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c201294b0 con 0x7f1c2009d630 2023-10-01T07:59:26.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.611+0000 7f1c1ffff700 1 --2- 172.21.15.26:0/459577187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c20133930 0x7f1c20126aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:26.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.611+0000 7f1c1f7fe700 1 -- 172.21.15.26:0/459577187 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c200a0a30 msgr2=0x7f1c20126560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:26.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.611+0000 7f1c1f7fe700 1 --2- 172.21.15.26:0/459577187 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c200a0a30 0x7f1c20126560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.611+0000 7f1c1f7fe700 1 -- 172.21.15.26:0/459577187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c20133930 msgr2=0x7f1c20126aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:26.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.611+0000 7f1c1f7fe700 1 --2- 172.21.15.26:0/459577187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c20133930 0x7f1c20126aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.611+0000 7f1c1f7fe700 1 -- 172.21.15.26:0/459577187 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c18009b30 con 0x7f1c2009d630 2023-10-01T07:59:26.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.611+0000 7f1c1f7fe700 1 --2- 172.21.15.26:0/459577187 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c2009d630 0x7f1c20126020 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1c1000e840 tx=0x7f1c1000eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:26.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.611+0000 7f1c07fff700 1 -- 172.21.15.26:0/459577187 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c10013610 con 0x7f1c2009d630 2023-10-01T07:59:26.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.611+0000 7f1c07fff700 1 -- 172.21.15.26:0/459577187 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c10013770 con 0x7f1c2009d630 2023-10-01T07:59:26.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.611+0000 7f1c07fff700 1 -- 172.21.15.26:0/459577187 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c10013b20 con 0x7f1c2009d630 2023-10-01T07:59:26.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.612+0000 7f1c25b5a700 1 -- 172.21.15.26:0/459577187 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c200a0410 con 0x7f1c2009d630 2023-10-01T07:59:26.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.612+0000 7f1c25b5a700 1 -- 172.21.15.26:0/459577187 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c20128f70 con 0x7f1c2009d630 2023-10-01T07:59:26.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.613+0000 7f1c07fff700 1 -- 172.21.15.26:0/459577187 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1c10013c80 con 0x7f1c2009d630 2023-10-01T07:59:26.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.613+0000 7f1c07fff700 1 -- 172.21.15.26:0/459577187 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1c100126f0 con 0x7f1c2009d630 2023-10-01T07:59:26.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.613+0000 7f1c25b5a700 1 -- 172.21.15.26:0/459577187 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c200747f0 con 0x7f1c2009d630 2023-10-01T07:59:26.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.623+0000 7f1c07fff700 1 -- 172.21.15.26:0/459577187 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1c20128f70 con 0x7f1c2009d630 2023-10-01T07:59:26.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.764+0000 7fb5c43bb700 1 -- 172.21.15.26:0/2854638988 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb5bc1a0b30 con 0x7fb5bc09e930 2023-10-01T07:59:26.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.765+0000 7fb5b2ffd700 1 -- 172.21.15.26:0/2854638988 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb5b8015070 con 0x7fb5bc09e930 2023-10-01T07:59:26.766 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:26.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.767+0000 7fb5c43bb700 1 -- 172.21.15.26:0/2854638988 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5bc09e930 msgr2=0x7fb5bc06b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:26.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.767+0000 7fb5c43bb700 1 --2- 172.21.15.26:0/2854638988 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5bc09e930 0x7fb5bc06b8b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8009bc0 tx=0x7fb5b8004750 comp rx=0 tx=0).stop 2023-10-01T07:59:26.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.767+0000 7fb5c43bb700 1 -- 172.21.15.26:0/2854638988 shutdown_connections 2023-10-01T07:59:26.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.767+0000 7fb5c43bb700 1 --2- 172.21.15.26:0/2854638988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5bc09f650 0x7fb5bc06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.767+0000 7fb5c43bb700 1 --2- 172.21.15.26:0/2854638988 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5bc09e930 0x7fb5bc06b8b0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.767+0000 7fb5c43bb700 1 --2- 172.21.15.26:0/2854638988 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb5bc09f240 0x7fb5bc06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.767+0000 7fb5c43bb700 1 -- 172.21.15.26:0/2854638988 >> 172.21.15.26:0/2854638988 conn(0x7fb5bc0a4210 msgr2=0x7fb5bc1b8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:26.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.767+0000 7fb5c43bb700 1 -- 172.21.15.26:0/2854638988 shutdown_connections 2023-10-01T07:59:26.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.767+0000 7fb5c43bb700 1 -- 172.21.15.26:0/2854638988 wait complete. 2023-10-01T07:59:26.782 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:26.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.788+0000 7f18ff973700 1 -- 172.21.15.26:0/1348420514 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f18f8074ea0 con 0x7f18f809d6f0 2023-10-01T07:59:26.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.788+0000 7f18edffb700 1 -- 172.21.15.26:0/1348420514 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f18f4021020 con 0x7f18f809d6f0 2023-10-01T07:59:26.789 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.792+0000 7f18ff973700 1 -- 172.21.15.26:0/1348420514 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f18f809d6f0 msgr2=0x7f18f8137920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.792+0000 7f18ff973700 1 --2- 172.21.15.26:0/1348420514 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f18f809d6f0 0x7f18f8137920 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f18f400e9e0 tx=0x7f18f400ecf0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.792+0000 7f18ff973700 1 -- 172.21.15.26:0/1348420514 shutdown_connections 2023-10-01T07:59:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.792+0000 7f18ff973700 1 --2- 172.21.15.26:0/1348420514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18f809e410 0x7f18f81383a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.792+0000 7f18ff973700 1 --2- 172.21.15.26:0/1348420514 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f18f809d6f0 0x7f18f8137920 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.792+0000 7f18ff973700 1 --2- 172.21.15.26:0/1348420514 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f18f809e000 0x7f18f8137e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.792+0000 7f18ff973700 1 -- 172.21.15.26:0/1348420514 >> 172.21.15.26:0/1348420514 conn(0x7f18f8066f50 msgr2=0x7f18f806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.793+0000 7f18ff973700 1 -- 172.21.15.26:0/1348420514 shutdown_connections 2023-10-01T07:59:26.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.793+0000 7f18ff973700 1 -- 172.21.15.26:0/1348420514 wait complete. 2023-10-01T07:59:26.807 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:26.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.830+0000 7fee0951e700 1 -- 172.21.15.26:0/3001304909 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fee04074ea0 con 0x7fee0409d6f0 2023-10-01T07:59:26.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.831+0000 7fedeb7fe700 1 -- 172.21.15.26:0/3001304909 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fedf4015030 con 0x7fee0409d6f0 2023-10-01T07:59:26.832 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:26.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.834+0000 7fee0951e700 1 -- 172.21.15.26:0/3001304909 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee0409d6f0 msgr2=0x7fee041a4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:26.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.834+0000 7fee0951e700 1 --2- 172.21.15.26:0/3001304909 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee0409d6f0 0x7fee041a4f70 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fedf400b4a0 tx=0x7fedf400b7b0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.834+0000 7fee0951e700 1 -- 172.21.15.26:0/3001304909 shutdown_connections 2023-10-01T07:59:26.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.834+0000 7fee0951e700 1 --2- 172.21.15.26:0/3001304909 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee0409e410 0x7fee041a59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.834+0000 7fee0951e700 1 --2- 172.21.15.26:0/3001304909 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee0409d6f0 0x7fee041a4f70 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.834+0000 7fee0951e700 1 --2- 172.21.15.26:0/3001304909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee0409e000 0x7fee041a54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.834+0000 7fee0951e700 1 -- 172.21.15.26:0/3001304909 >> 172.21.15.26:0/3001304909 conn(0x7fee04066f50 msgr2=0x7fee041b9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:26.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.834+0000 7fee0951e700 1 -- 172.21.15.26:0/3001304909 shutdown_connections 2023-10-01T07:59:26.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.834+0000 7fee0951e700 1 -- 172.21.15.26:0/3001304909 wait complete. 2023-10-01T07:59:26.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:26.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.868+0000 7f1c25b5a700 1 -- 172.21.15.26:0/459577187 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1c20072980 con 0x7f1c2009d630 2023-10-01T07:59:26.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.868+0000 7f1c07fff700 1 -- 172.21.15.26:0/459577187 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1c10044060 con 0x7f1c2009d630 2023-10-01T07:59:26.869 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:26.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.870+0000 7f1c25b5a700 1 -- 172.21.15.26:0/459577187 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c2009d630 msgr2=0x7f1c20126020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:26.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.870+0000 7f1c25b5a700 1 --2- 172.21.15.26:0/459577187 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c2009d630 0x7f1c20126020 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1c1000e840 tx=0x7f1c1000eb50 comp rx=0 tx=0).stop 2023-10-01T07:59:26.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.870+0000 7f1c25b5a700 1 -- 172.21.15.26:0/459577187 shutdown_connections 2023-10-01T07:59:26.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.870+0000 7f1c25b5a700 1 --2- 172.21.15.26:0/459577187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c20133930 0x7f1c20126aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.870+0000 7f1c25b5a700 1 --2- 172.21.15.26:0/459577187 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c2009d630 0x7f1c20126020 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.870+0000 7f1c25b5a700 1 --2- 172.21.15.26:0/459577187 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c200a0a30 0x7f1c20126560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:26.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.870+0000 7f1c25b5a700 1 -- 172.21.15.26:0/459577187 >> 172.21.15.26:0/459577187 conn(0x7f1c200a3050 msgr2=0x7f1c2009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:26.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.871+0000 7f1c25b5a700 1 -- 172.21.15.26:0/459577187 shutdown_connections 2023-10-01T07:59:26.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:26.871+0000 7f1c25b5a700 1 -- 172.21.15.26:0/459577187 wait complete. 2023-10-01T07:59:26.884 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:27.782 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:27.808 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:27.855 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:27.885 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:27.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.939+0000 7f6f73d96700 1 Processor -- start 2023-10-01T07:59:27.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.939+0000 7f6f73d96700 1 -- start start 2023-10-01T07:59:27.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.940+0000 7f6f73d96700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f6c133420 0x7f6f6c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:27.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.940+0000 7f6f73d96700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f6c133e30 0x7f6f6c12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:27.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.940+0000 7f6f73d96700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f6c06b990 con 0x7f6f6c134260 2023-10-01T07:59:27.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.940+0000 7f6f73d96700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c0a0590 con 0x7f6f6c133420 2023-10-01T07:59:27.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.940+0000 7f6f73d96700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c09fb80 con 0x7f6f6c133e30 2023-10-01T07:59:27.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.940+0000 7f6f71b32700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f6c133420 0x7f6f6c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:27.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.940+0000 7f6f71b32700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f6c133420 0x7f6f6c1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47438/0 (socket says 172.21.15.26:47438) 2023-10-01T07:59:27.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.940+0000 7f6f71b32700 1 -- 172.21.15.26:0/2679383763 learned_addr learned my addr 172.21.15.26:0/2679383763 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:27.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.940+0000 7f6f71331700 1 --2- 172.21.15.26:0/2679383763 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f6c133e30 0x7f6f6c12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:27.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.941+0000 7f6f71331700 1 -- 172.21.15.26:0/2679383763 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f6c133420 msgr2=0x7f6f6c1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:27.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.941+0000 7f6f71331700 1 --2- 172.21.15.26:0/2679383763 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f6c133420 0x7f6f6c1337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:27.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.941+0000 7f6f71331700 1 -- 172.21.15.26:0/2679383763 >> v1:172.21.15.26:6789/0 conn(0x7f6f6c134260 legacy=0x7f6f6c1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:27.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.941+0000 7f6f71331700 1 -- 172.21.15.26:0/2679383763 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6c0a0030 con 0x7f6f6c133e30 2023-10-01T07:59:27.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.941+0000 7f6f71331700 1 --2- 172.21.15.26:0/2679383763 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f6c133e30 0x7f6f6c12ff90 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c009870 tx=0x7f6f5c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46cd0163def9a07b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:27.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.941+0000 7f6f70b30700 1 -- 172.21.15.26:0/2679383763 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c004230 con 0x7f6f6c133e30 2023-10-01T07:59:27.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.941+0000 7f6f70b30700 1 -- 172.21.15.26:0/2679383763 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5c004390 con 0x7f6f6c133e30 2023-10-01T07:59:27.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.941+0000 7f6f70b30700 1 -- 172.21.15.26:0/2679383763 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c0036a0 con 0x7f6f6c133e30 2023-10-01T07:59:27.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.942+0000 7f6f73d96700 1 -- 172.21.15.26:0/2679383763 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f6c133e30 msgr2=0x7f6f6c12ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:27.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.942+0000 7f6f73d96700 1 --2- 172.21.15.26:0/2679383763 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f6c133e30 0x7f6f6c12ff90 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c009870 tx=0x7f6f5c009b80 comp rx=0 tx=0).stop 2023-10-01T07:59:27.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.942+0000 7f6f73d96700 1 -- 172.21.15.26:0/2679383763 shutdown_connections 2023-10-01T07:59:27.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.942+0000 7f6f73d96700 1 --2- 172.21.15.26:0/2679383763 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f6c133420 0x7f6f6c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:27.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.942+0000 7f6f73d96700 1 --2- 172.21.15.26:0/2679383763 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f6c133e30 0x7f6f6c12ff90 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:27.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.942+0000 7f6f73d96700 1 -- 172.21.15.26:0/2679383763 >> 172.21.15.26:0/2679383763 conn(0x7f6f6c0a4210 msgr2=0x7f6f6c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:27.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.943+0000 7f6f73d96700 1 -- 172.21.15.26:0/2679383763 shutdown_connections 2023-10-01T07:59:27.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.943+0000 7f6f73d96700 1 -- 172.21.15.26:0/2679383763 wait complete. 2023-10-01T07:59:27.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.944+0000 7f6f73d96700 1 Processor -- start 2023-10-01T07:59:27.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.944+0000 7f6f73d96700 1 -- start start 2023-10-01T07:59:27.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.944+0000 7f6f73d96700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f6c133420 0x7f6f6c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:27.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.944+0000 7f6f73d96700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f6c133e30 0x7f6f6c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:27.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.944+0000 7f6f73d96700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f6c134260 0x7f6f6c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:27.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.944+0000 7f6f73d96700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c11f230 con 0x7f6f6c133e30 2023-10-01T07:59:27.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.944+0000 7f6f73d96700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c12daf0 con 0x7f6f6c133420 2023-10-01T07:59:27.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.944+0000 7f6f73d96700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c1318b0 con 0x7f6f6c134260 2023-10-01T07:59:27.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.944+0000 7f6f71331700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f6c133e30 0x7f6f6c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:27.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.944+0000 7f6f71b32700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f6c133420 0x7f6f6c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:27.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.944+0000 7f6f71331700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f6c133e30 0x7f6f6c09c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48764/0 (socket says 172.21.15.26:48764) 2023-10-01T07:59:27.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.944+0000 7f6f71b32700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f6c133420 0x7f6f6c09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47446/0 (socket says 172.21.15.26:47446) 2023-10-01T07:59:27.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.944+0000 7f6f71331700 1 -- 172.21.15.26:0/4181754187 learned_addr learned my addr 172.21.15.26:0/4181754187 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:27.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.945+0000 7f6f72333700 1 --2- 172.21.15.26:0/4181754187 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f6c134260 0x7f6f6c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:27.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.945+0000 7f6f71331700 1 -- 172.21.15.26:0/4181754187 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f6c134260 msgr2=0x7f6f6c09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:27.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.945+0000 7f6f71331700 1 --2- 172.21.15.26:0/4181754187 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f6c134260 0x7f6f6c09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:27.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.945+0000 7f6f71331700 1 -- 172.21.15.26:0/4181754187 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f6c133420 msgr2=0x7f6f6c09c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:27.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.945+0000 7f6f71331700 1 --2- 172.21.15.26:0/4181754187 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f6c133420 0x7f6f6c09c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:27.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.945+0000 7f6f71331700 1 -- 172.21.15.26:0/4181754187 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5c0094a0 con 0x7f6f6c133e30 2023-10-01T07:59:27.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.945+0000 7f6f71331700 1 --2- 172.21.15.26:0/4181754187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f6c133e30 0x7f6f6c09c9c0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c09fcc0 tx=0x7f6f5c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:27.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.945+0000 7f6f627fc700 1 -- 172.21.15.26:0/4181754187 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c003e20 con 0x7f6f6c133e30 2023-10-01T07:59:27.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.945+0000 7f6f73d96700 1 -- 172.21.15.26:0/4181754187 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f6c11ef10 con 0x7f6f6c133e30 2023-10-01T07:59:27.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.946+0000 7f6f73d96700 1 -- 172.21.15.26:0/4181754187 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f6c11fc60 con 0x7f6f6c133e30 2023-10-01T07:59:27.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.947+0000 7f6f627fc700 1 -- 172.21.15.26:0/4181754187 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5c01e070 con 0x7f6f6c133e30 2023-10-01T07:59:27.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.947+0000 7f6f627fc700 1 -- 172.21.15.26:0/4181754187 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c011870 con 0x7f6f6c133e30 2023-10-01T07:59:27.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.947+0000 7f6f627fc700 1 -- 172.21.15.26:0/4181754187 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6f5c011a10 con 0x7f6f6c133e30 2023-10-01T07:59:27.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.947+0000 7f6f627fc700 1 -- 172.21.15.26:0/4181754187 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6f5c020070 con 0x7f6f6c133e30 2023-10-01T07:59:27.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.948+0000 7f6f4ffff700 1 -- 172.21.15.26:0/4181754187 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f6c074ea0 con 0x7f6f6c133e30 2023-10-01T07:59:27.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.957+0000 7f6f627fc700 1 -- 172.21.15.26:0/4181754187 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f5c010380 con 0x7f6f6c133e30 2023-10-01T07:59:27.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.984+0000 7fa9d6e52700 1 Processor -- start 2023-10-01T07:59:27.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.984+0000 7fa9d6e52700 1 -- start start 2023-10-01T07:59:27.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.985+0000 7fa9d6e52700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9d009e850 0x7fa9d009ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:27.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.985+0000 7fa9d6e52700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa9d009f160 0x7fa9d0133c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:27.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.985+0000 7fa9d6e52700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa9d009f5b0 0x7fa9d01341a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:27.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.985+0000 7fa9d6e52700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9d006bec0 con 0x7fa9d009f5b0 2023-10-01T07:59:27.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.985+0000 7fa9d6e52700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d00a0030 con 0x7fa9d009e850 2023-10-01T07:59:27.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.985+0000 7fa9d6e52700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d00a0830 con 0x7fa9d009f160 2023-10-01T07:59:27.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.985+0000 7fa9d4bee700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9d009e850 0x7fa9d009ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:27.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.986+0000 7fa9d4bee700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9d009e850 0x7fa9d009ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47452/0 (socket says 172.21.15.26:47452) 2023-10-01T07:59:27.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.986+0000 7fa9d4bee700 1 -- 172.21.15.26:0/4277845563 learned_addr learned my addr 172.21.15.26:0/4277845563 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:27.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.986+0000 7fa9d53ef700 1 --2- 172.21.15.26:0/4277845563 >> v2:172.21.15.26:3300/0 conn(0x7fa9d009f5b0 0x7fa9d01341a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:27.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.986+0000 7fa9cffff700 1 --2- 172.21.15.26:0/4277845563 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa9d009f160 0x7fa9d0133c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:27.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.986+0000 7fa9cffff700 1 -- 172.21.15.26:0/4277845563 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9d009e850 msgr2=0x7fa9d009ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:27.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.986+0000 7fa9cffff700 1 --2- 172.21.15.26:0/4277845563 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9d009e850 0x7fa9d009ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:27.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.986+0000 7fa9cffff700 1 -- 172.21.15.26:0/4277845563 >> v2:172.21.15.26:3300/0 conn(0x7fa9d009f5b0 msgr2=0x7fa9d01341a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:27.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.986+0000 7fa9cffff700 1 --2- 172.21.15.26:0/4277845563 >> v2:172.21.15.26:3300/0 conn(0x7fa9d009f5b0 0x7fa9d01341a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:27.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.986+0000 7fa9cffff700 1 -- 172.21.15.26:0/4277845563 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d006caa0 con 0x7fa9d009f160 2023-10-01T07:59:27.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.986+0000 7fa9d53ef700 1 --2- 172.21.15.26:0/4277845563 >> v2:172.21.15.26:3300/0 conn(0x7fa9d009f5b0 0x7fa9d01341a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:27.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.986+0000 7fa9cffff700 1 --2- 172.21.15.26:0/4277845563 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa9d009f160 0x7fa9d0133c60 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc009840 tx=0x7fa9bc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82f034f8c48ccb2f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:27.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.986+0000 7fa9cf7fe700 1 -- 172.21.15.26:0/4277845563 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc011830 con 0x7fa9d009f160 2023-10-01T07:59:27.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.986+0000 7fa9cf7fe700 1 -- 172.21.15.26:0/4277845563 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9bc011990 con 0x7fa9d009f160 2023-10-01T07:59:27.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.987+0000 7fa9cf7fe700 1 -- 172.21.15.26:0/4277845563 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc011d20 con 0x7fa9d009f160 2023-10-01T07:59:27.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.987+0000 7fa9d6e52700 1 -- 172.21.15.26:0/4277845563 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa9d009f160 msgr2=0x7fa9d0133c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:27.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.988+0000 7fa9d6e52700 1 --2- 172.21.15.26:0/4277845563 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa9d009f160 0x7fa9d0133c60 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc009840 tx=0x7fa9bc009b50 comp rx=0 tx=0).stop 2023-10-01T07:59:27.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.988+0000 7fa9d6e52700 1 -- 172.21.15.26:0/4277845563 shutdown_connections 2023-10-01T07:59:27.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.988+0000 7fa9d6e52700 1 --2- 172.21.15.26:0/4277845563 >> v2:172.21.15.26:3300/0 conn(0x7fa9d009f5b0 0x7fa9d01341a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:27.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.988+0000 7fa9d6e52700 1 --2- 172.21.15.26:0/4277845563 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9d009e850 0x7fa9d009ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:27.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.988+0000 7fa9d6e52700 1 --2- 172.21.15.26:0/4277845563 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa9d009f160 0x7fa9d0133c60 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:27.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.988+0000 7fa9d6e52700 1 -- 172.21.15.26:0/4277845563 >> 172.21.15.26:0/4277845563 conn(0x7fa9d00a3f70 msgr2=0x7fa9d00a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:27.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.988+0000 7fa9d6e52700 1 -- 172.21.15.26:0/4277845563 shutdown_connections 2023-10-01T07:59:27.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.988+0000 7fa9d6e52700 1 -- 172.21.15.26:0/4277845563 wait complete. 2023-10-01T07:59:27.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.989+0000 7fa9d6e52700 1 Processor -- start 2023-10-01T07:59:27.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.989+0000 7fa9d6e52700 1 -- start start 2023-10-01T07:59:27.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.989+0000 7fa9d6e52700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9d009e850 0x7fa9d01204f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:27.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.989+0000 7fa9d6e52700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9d009f160 0x7fa9d0120a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:27.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.989+0000 7fa9d6e52700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa9d009f5b0 0x7fa9d0120f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:27.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.990+0000 7fa9d6e52700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d0123cb0 con 0x7fa9d009f160 2023-10-01T07:59:27.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.990+0000 7fa9d6e52700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d00a3770 con 0x7fa9d009e850 2023-10-01T07:59:27.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.990+0000 7fa9d6e52700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d006ccc0 con 0x7fa9d009f5b0 2023-10-01T07:59:27.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.990+0000 7fa9d53ef700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa9d009f5b0 0x7fa9d0120f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:27.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.990+0000 7fa9d53ef700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa9d009f5b0 0x7fa9d0120f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47194/0 (socket says 172.21.15.26:47194) 2023-10-01T07:59:27.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.990+0000 7fa9d53ef700 1 -- 172.21.15.26:0/4002790222 learned_addr learned my addr 172.21.15.26:0/4002790222 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:27.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.990+0000 7fa9d4bee700 1 --2- 172.21.15.26:0/4002790222 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9d009e850 0x7fa9d01204f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:27.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.990+0000 7fa9cffff700 1 --2- 172.21.15.26:0/4002790222 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9d009f160 0x7fa9d0120a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:27.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.990+0000 7fa9d53ef700 1 -- 172.21.15.26:0/4002790222 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9d009e850 msgr2=0x7fa9d01204f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:27.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.990+0000 7fa9d53ef700 1 --2- 172.21.15.26:0/4002790222 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9d009e850 0x7fa9d01204f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:27.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.990+0000 7fa9d53ef700 1 -- 172.21.15.26:0/4002790222 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9d009f160 msgr2=0x7fa9d0120a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:27.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.990+0000 7fa9d53ef700 1 --2- 172.21.15.26:0/4002790222 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9d009f160 0x7fa9d0120a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:27.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.990+0000 7fa9d53ef700 1 -- 172.21.15.26:0/4002790222 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c8009a70 con 0x7fa9d009f5b0 2023-10-01T07:59:27.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.990+0000 7fa9cffff700 1 --2- 172.21.15.26:0/4002790222 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9d009f160 0x7fa9d0120a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:27.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.990+0000 7fa9d53ef700 1 --2- 172.21.15.26:0/4002790222 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa9d009f5b0 0x7fa9d0120f70 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fa9c800efc0 tx=0x7fa9c800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:27.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.991+0000 7fa9cd7fa700 1 -- 172.21.15.26:0/4002790222 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c800cb40 con 0x7fa9d009f5b0 2023-10-01T07:59:27.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.991+0000 7fa9cd7fa700 1 -- 172.21.15.26:0/4002790222 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c800f040 con 0x7fa9d009f5b0 2023-10-01T07:59:27.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.991+0000 7fa9cd7fa700 1 -- 172.21.15.26:0/4002790222 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8003a20 con 0x7fa9d009f5b0 2023-10-01T07:59:27.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.991+0000 7fa9d6e52700 1 -- 172.21.15.26:0/4002790222 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9bc0094a0 con 0x7fa9d009f5b0 2023-10-01T07:59:27.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.991+0000 7fa9d6e52700 1 -- 172.21.15.26:0/4002790222 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d0123f90 con 0x7fa9d009f5b0 2023-10-01T07:59:27.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.992+0000 7fa9cd7fa700 1 -- 172.21.15.26:0/4002790222 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa9c8014480 con 0x7fa9d009f5b0 2023-10-01T07:59:27.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.992+0000 7fa9d6e52700 1 -- 172.21.15.26:0/4002790222 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d009caf0 con 0x7fa9d009f5b0 2023-10-01T07:59:27.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.992+0000 7fa9cd7fa700 1 -- 172.21.15.26:0/4002790222 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa9c803fff0 con 0x7fa9d009f5b0 2023-10-01T07:59:27.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:27.997+0000 7fa9cd7fa700 1 -- 172.21.15.26:0/4002790222 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa9c8071750 con 0x7fa9d009f5b0 2023-10-01T07:59:28.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.017+0000 7fee013ed700 1 Processor -- start 2023-10-01T07:59:28.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.017+0000 7fee013ed700 1 -- start start 2023-10-01T07:59:28.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.018+0000 7fee013ed700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedfc09d6f0 0x7fedfc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:28.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.018+0000 7fee013ed700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fedfc09e000 0x7fedfc1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:28.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.018+0000 7fee013ed700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedfc09b120 con 0x7fedfc09e410 2023-10-01T07:59:28.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.018+0000 7fee013ed700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedfc06b460 con 0x7fedfc09e000 2023-10-01T07:59:28.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.018+0000 7fee013ed700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc09a7e0 con 0x7fedfc09d6f0 2023-10-01T07:59:28.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.018+0000 7fedfa7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fedfc09e000 0x7fedfc1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:28.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.018+0000 7fedfa7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fedfc09e000 0x7fedfc1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48810/0 (socket says 172.21.15.26:48810) 2023-10-01T07:59:28.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.018+0000 7fedfa7fc700 1 -- 172.21.15.26:0/81510644 learned_addr learned my addr 172.21.15.26:0/81510644 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:28.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.018+0000 7fedfb7fe700 1 --1- 172.21.15.26:0/81510644 >> v1:172.21.15.26:6789/0 conn(0x7fedfc09e410 0x7fedfc133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37804/0 (socket says 172.21.15.26:37804) 2023-10-01T07:59:28.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.018+0000 7fedfaffd700 1 --2- 172.21.15.26:0/81510644 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedfc09d6f0 0x7fedfc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:28.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.019+0000 7fedfaffd700 1 -- 172.21.15.26:0/81510644 >> v2:172.21.15.26:3300/0 conn(0x7fedfc09e000 msgr2=0x7fedfc1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:28.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.019+0000 7fedfaffd700 1 --2- 172.21.15.26:0/81510644 >> v2:172.21.15.26:3300/0 conn(0x7fedfc09e000 0x7fedfc1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:28.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.019+0000 7fedfaffd700 1 -- 172.21.15.26:0/81510644 >> v1:172.21.15.26:6789/0 conn(0x7fedfc09e410 legacy=0x7fedfc133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:28.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.019+0000 7fedfaffd700 1 -- 172.21.15.26:0/81510644 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedfc09a500 con 0x7fedfc09d6f0 2023-10-01T07:59:28.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.019+0000 7fedfa7fc700 1 --2- 172.21.15.26:0/81510644 >> v2:172.21.15.26:3300/0 conn(0x7fedfc09e000 0x7fedfc1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:28.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.019+0000 7fedfaffd700 1 --2- 172.21.15.26:0/81510644 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedfc09d6f0 0x7fedfc09dac0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fedec009870 tx=0x7fedec009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa6e2338bfe02c7e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:28.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.019+0000 7fedf9ffb700 1 -- 172.21.15.26:0/81510644 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedec004230 con 0x7fedfc09d6f0 2023-10-01T07:59:28.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.019+0000 7fedf9ffb700 1 -- 172.21.15.26:0/81510644 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedec004390 con 0x7fedfc09d6f0 2023-10-01T07:59:28.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.019+0000 7fedf9ffb700 1 -- 172.21.15.26:0/81510644 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedec0036a0 con 0x7fedfc09d6f0 2023-10-01T07:59:28.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.020+0000 7fee013ed700 1 -- 172.21.15.26:0/81510644 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedfc09d6f0 msgr2=0x7fedfc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:28.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.020+0000 7fee013ed700 1 --2- 172.21.15.26:0/81510644 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedfc09d6f0 0x7fedfc09dac0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fedec009870 tx=0x7fedec009b80 comp rx=0 tx=0).stop 2023-10-01T07:59:28.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.020+0000 7fee013ed700 1 -- 172.21.15.26:0/81510644 shutdown_connections 2023-10-01T07:59:28.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.020+0000 7fee013ed700 1 --2- 172.21.15.26:0/81510644 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedfc09d6f0 0x7fedfc09dac0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:28.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.020+0000 7fee013ed700 1 --2- 172.21.15.26:0/81510644 >> v2:172.21.15.26:3300/0 conn(0x7fedfc09e000 0x7fedfc1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:28.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.020+0000 7fee013ed700 1 -- 172.21.15.26:0/81510644 >> 172.21.15.26:0/81510644 conn(0x7fedfc066f50 msgr2=0x7fedfc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:28.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.020+0000 7fee013ed700 1 -- 172.21.15.26:0/81510644 shutdown_connections 2023-10-01T07:59:28.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.020+0000 7fee013ed700 1 -- 172.21.15.26:0/81510644 wait complete. 2023-10-01T07:59:28.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.022+0000 7fee013ed700 1 Processor -- start 2023-10-01T07:59:28.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.022+0000 7fee013ed700 1 -- start start 2023-10-01T07:59:28.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.022+0000 7fee013ed700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedfc09d6f0 0x7fedfc1a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:28.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.022+0000 7fee013ed700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedfc09e000 0x7fedfc1a56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:28.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.022+0000 7fee013ed700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedfc09e410 0x7fedfc1a5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:28.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.022+0000 7fee013ed700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc1a72b0 con 0x7fedfc09d6f0 2023-10-01T07:59:28.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.022+0000 7fee013ed700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc1a8b90 con 0x7fedfc09e000 2023-10-01T07:59:28.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.022+0000 7fee013ed700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc1a6600 con 0x7fedfc09e410 2023-10-01T07:59:28.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.022+0000 7fedfb7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedfc09e410 0x7fedfc1a5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:28.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.022+0000 7fedfb7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedfc09e410 0x7fedfc1a5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47202/0 (socket says 172.21.15.26:47202) 2023-10-01T07:59:28.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.022+0000 7fedfb7fe700 1 -- 172.21.15.26:0/353960030 learned_addr learned my addr 172.21.15.26:0/353960030 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:28.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.022+0000 7fedfa7fc700 1 --2- 172.21.15.26:0/353960030 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedfc09e000 0x7fedfc1a56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:28.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.023+0000 7fedfb7fe700 1 -- 172.21.15.26:0/353960030 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedfc09e000 msgr2=0x7fedfc1a56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:28.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.023+0000 7fedfb7fe700 1 --2- 172.21.15.26:0/353960030 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedfc09e000 0x7fedfc1a56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:28.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.023+0000 7fedfb7fe700 1 -- 172.21.15.26:0/353960030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedfc09d6f0 msgr2=0x7fedfc1a51a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:59:28.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.023+0000 7fedfb7fe700 1 --2- 172.21.15.26:0/353960030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedfc09d6f0 0x7fedfc1a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:28.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.023+0000 7fedfb7fe700 1 -- 172.21.15.26:0/353960030 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf0009550 con 0x7fedfc09e410 2023-10-01T07:59:28.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.023+0000 7fedfa7fc700 1 --2- 172.21.15.26:0/353960030 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedfc09e000 0x7fedfc1a56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:59:28.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.023+0000 7fedfb7fe700 1 --2- 172.21.15.26:0/353960030 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedfc09e410 0x7fedfc1a5c20 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fedf4002090 tx=0x7fedf400a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:28.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.023+0000 7fede37fe700 1 -- 172.21.15.26:0/353960030 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf400adc0 con 0x7fedfc09e410 2023-10-01T07:59:28.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.023+0000 7fede37fe700 1 -- 172.21.15.26:0/353960030 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf40070d0 con 0x7fedfc09e410 2023-10-01T07:59:28.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.023+0000 7fede37fe700 1 -- 172.21.15.26:0/353960030 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf4007440 con 0x7fedfc09e410 2023-10-01T07:59:28.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.023+0000 7fee013ed700 1 -- 172.21.15.26:0/353960030 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedec0094a0 con 0x7fedfc09e410 2023-10-01T07:59:28.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.023+0000 7fee013ed700 1 -- 172.21.15.26:0/353960030 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedfc09c710 con 0x7fedfc09e410 2023-10-01T07:59:28.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.025+0000 7fede37fe700 1 -- 172.21.15.26:0/353960030 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fedf40075a0 con 0x7fedfc09e410 2023-10-01T07:59:28.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.025+0000 7fee013ed700 1 -- 172.21.15.26:0/353960030 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedfc1a8550 con 0x7fedfc09e410 2023-10-01T07:59:28.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.025+0000 7fede37fe700 1 -- 172.21.15.26:0/353960030 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fedf403f8a0 con 0x7fedfc09e410 2023-10-01T07:59:28.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.030+0000 7fede37fe700 1 -- 172.21.15.26:0/353960030 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fedf401a8b0 con 0x7fedfc09e410 2023-10-01T07:59:28.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.062+0000 7f3881ec6700 1 Processor -- start 2023-10-01T07:59:28.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.063+0000 7f3881ec6700 1 -- start start 2023-10-01T07:59:28.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.063+0000 7f3881ec6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f387c09d6f0 0x7f387c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:28.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.063+0000 7f3881ec6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f387c09e410 0x7f387c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:28.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.063+0000 7f3881ec6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f387c09b120 con 0x7f387c09e000 2023-10-01T07:59:28.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.063+0000 7f3881ec6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387c06b460 con 0x7f387c09e410 2023-10-01T07:59:28.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.063+0000 7f3881ec6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f387c09a7e0 con 0x7f387c09d6f0 2023-10-01T07:59:28.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.063+0000 7f387b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f387c09d6f0 0x7f387c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:28.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.063+0000 7f387b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f387c09d6f0 0x7f387c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47206/0 (socket says 172.21.15.26:47206) 2023-10-01T07:59:28.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.063+0000 7f387b7fe700 1 -- 172.21.15.26:0/305825381 learned_addr learned my addr 172.21.15.26:0/305825381 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:28.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.064+0000 7f387b7fe700 1 -- 172.21.15.26:0/305825381 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f387c09e410 msgr2=0x7f387c134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:28.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.064+0000 7f387b7fe700 1 --2- 172.21.15.26:0/305825381 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f387c09e410 0x7f387c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:28.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.064+0000 7f387b7fe700 1 -- 172.21.15.26:0/305825381 >> v1:172.21.15.26:6789/0 conn(0x7f387c09e000 legacy=0x7f387c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:28.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.064+0000 7f387b7fe700 1 -- 172.21.15.26:0/305825381 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387c09a500 con 0x7f387c09d6f0 2023-10-01T07:59:28.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.064+0000 7f387b7fe700 1 --2- 172.21.15.26:0/305825381 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f387c09d6f0 0x7f387c09dac0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f386c009950 tx=0x7f386c009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef6363c08eca1ed5 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:28.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.064+0000 7f387affd700 1 -- 172.21.15.26:0/305825381 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386c009ea0 con 0x7f387c09d6f0 2023-10-01T07:59:28.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.064+0000 7f387affd700 1 -- 172.21.15.26:0/305825381 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386c00ba20 con 0x7f387c09d6f0 2023-10-01T07:59:28.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.064+0000 7f387affd700 1 -- 172.21.15.26:0/305825381 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386c00bdb0 con 0x7f387c09d6f0 2023-10-01T07:59:28.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.065+0000 7f3881ec6700 1 -- 172.21.15.26:0/305825381 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f387c09d6f0 msgr2=0x7f387c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:28.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.065+0000 7f3881ec6700 1 --2- 172.21.15.26:0/305825381 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f387c09d6f0 0x7f387c09dac0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f386c009950 tx=0x7f386c009c60 comp rx=0 tx=0).stop 2023-10-01T07:59:28.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.065+0000 7f3881ec6700 1 -- 172.21.15.26:0/305825381 shutdown_connections 2023-10-01T07:59:28.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.065+0000 7f3881ec6700 1 --2- 172.21.15.26:0/305825381 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f387c09d6f0 0x7f387c09dac0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:28.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.065+0000 7f3881ec6700 1 --2- 172.21.15.26:0/305825381 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f387c09e410 0x7f387c134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:28.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.065+0000 7f3881ec6700 1 -- 172.21.15.26:0/305825381 >> 172.21.15.26:0/305825381 conn(0x7f387c066f50 msgr2=0x7f387c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:28.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.065+0000 7f3881ec6700 1 -- 172.21.15.26:0/305825381 shutdown_connections 2023-10-01T07:59:28.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.065+0000 7f3881ec6700 1 -- 172.21.15.26:0/305825381 wait complete. 2023-10-01T07:59:28.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.066+0000 7f3881ec6700 1 Processor -- start 2023-10-01T07:59:28.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.067+0000 7f3881ec6700 1 -- start start 2023-10-01T07:59:28.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.067+0000 7f3881ec6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f387c09d6f0 0x7f387c1a5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:28.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.067+0000 7f3881ec6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f387c09e000 0x7f387c1a64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:28.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.067+0000 7f3881ec6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f387c09e410 0x7f387c1a6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:28.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.067+0000 7f3881ec6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387c1a7b30 con 0x7f387c09e410 2023-10-01T07:59:28.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.067+0000 7f3881ec6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387c1a8150 con 0x7f387c09e000 2023-10-01T07:59:28.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.067+0000 7f3881ec6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f387c1a8d80 con 0x7f387c09d6f0 2023-10-01T07:59:28.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.067+0000 7f3872ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f387c09e000 0x7f387c1a64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:28.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.067+0000 7f387b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f387c09d6f0 0x7f387c1a5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:28.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.067+0000 7f3872ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f387c09e000 0x7f387c1a64f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47500/0 (socket says 172.21.15.26:47500) 2023-10-01T07:59:28.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.067+0000 7f3872ffd700 1 -- 172.21.15.26:0/1552747944 learned_addr learned my addr 172.21.15.26:0/1552747944 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:28.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.067+0000 7f387b7fe700 1 --2- 172.21.15.26:0/1552747944 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f387c09d6f0 0x7f387c1a5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47210/0 (socket says 172.21.15.26:47210) 2023-10-01T07:59:28.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.067+0000 7f387bfff700 1 --2- 172.21.15.26:0/1552747944 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f387c09e410 0x7f387c1a6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:28.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.068+0000 7f387b7fe700 1 -- 172.21.15.26:0/1552747944 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f387c09e000 msgr2=0x7f387c1a64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:28.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.068+0000 7f387b7fe700 1 --2- 172.21.15.26:0/1552747944 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f387c09e000 0x7f387c1a64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:28.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.068+0000 7f387b7fe700 1 -- 172.21.15.26:0/1552747944 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f387c09e410 msgr2=0x7f387c1a6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:28.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.068+0000 7f387b7fe700 1 --2- 172.21.15.26:0/1552747944 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f387c09e410 0x7f387c1a6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:28.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.068+0000 7f387b7fe700 1 -- 172.21.15.26:0/1552747944 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386c009550 con 0x7f387c09d6f0 2023-10-01T07:59:28.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.068+0000 7f387b7fe700 1 --2- 172.21.15.26:0/1552747944 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f387c09d6f0 0x7f387c1a5fb0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f386c016000 tx=0x7f386c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:28.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.068+0000 7f3878ff9700 1 -- 172.21.15.26:0/1552747944 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386c0036a0 con 0x7f387c09d6f0 2023-10-01T07:59:28.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.068+0000 7f3878ff9700 1 -- 172.21.15.26:0/1552747944 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386c003840 con 0x7f387c09d6f0 2023-10-01T07:59:28.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.068+0000 7f3878ff9700 1 -- 172.21.15.26:0/1552747944 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386c003bf0 con 0x7f387c09d6f0 2023-10-01T07:59:28.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.068+0000 7f3881ec6700 1 -- 172.21.15.26:0/1552747944 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f387c1a9760 con 0x7f387c09d6f0 2023-10-01T07:59:28.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.068+0000 7f3881ec6700 1 -- 172.21.15.26:0/1552747944 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f387c1a9230 con 0x7f387c09d6f0 2023-10-01T07:59:28.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.069+0000 7f3881ec6700 1 -- 172.21.15.26:0/1552747944 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f387c074ea0 con 0x7f387c09d6f0 2023-10-01T07:59:28.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.070+0000 7f3878ff9700 1 -- 172.21.15.26:0/1552747944 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f386c003d50 con 0x7f387c09d6f0 2023-10-01T07:59:28.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.070+0000 7f3878ff9700 1 -- 172.21.15.26:0/1552747944 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f386c021030 con 0x7f387c09d6f0 2023-10-01T07:59:28.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.075+0000 7f3878ff9700 1 -- 172.21.15.26:0/1552747944 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f387c1a9230 con 0x7f387c09d6f0 2023-10-01T07:59:28.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.237+0000 7fee013ed700 1 -- 172.21.15.26:0/353960030 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fedfc074ea0 con 0x7fedfc09e410 2023-10-01T07:59:28.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.238+0000 7fede37fe700 1 -- 172.21.15.26:0/353960030 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fedf401a2c0 con 0x7fedfc09e410 2023-10-01T07:59:28.239 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:28.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.240+0000 7fee013ed700 1 -- 172.21.15.26:0/353960030 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedfc09e410 msgr2=0x7fedfc1a5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:28.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.240+0000 7fee013ed700 1 --2- 172.21.15.26:0/353960030 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedfc09e410 0x7fedfc1a5c20 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fedf4002090 tx=0x7fedf400a340 comp rx=0 tx=0).stop 2023-10-01T07:59:28.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.240+0000 7fee013ed700 1 -- 172.21.15.26:0/353960030 shutdown_connections 2023-10-01T07:59:28.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.240+0000 7fee013ed700 1 --2- 172.21.15.26:0/353960030 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedfc09e410 0x7fedfc1a5c20 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:28.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.240+0000 7fee013ed700 1 --2- 172.21.15.26:0/353960030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedfc09d6f0 0x7fedfc1a51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:28.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.240+0000 7fee013ed700 1 --2- 172.21.15.26:0/353960030 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedfc09e000 0x7fedfc1a56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:28.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.240+0000 7fee013ed700 1 -- 172.21.15.26:0/353960030 >> 172.21.15.26:0/353960030 conn(0x7fedfc066f50 msgr2=0x7fedfc06f420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:28.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.240+0000 7fee013ed700 1 -- 172.21.15.26:0/353960030 shutdown_connections 2023-10-01T07:59:28.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.240+0000 7fee013ed700 1 -- 172.21.15.26:0/353960030 wait complete. 2023-10-01T07:59:28.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.248+0000 7f6f4ffff700 1 -- 172.21.15.26:0/4181754187 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6f6c1209a0 con 0x7f6f6c133e30 2023-10-01T07:59:28.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.249+0000 7f6f627fc700 1 -- 172.21.15.26:0/4181754187 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6f5c032070 con 0x7f6f6c133e30 2023-10-01T07:59:28.249 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:28.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.251+0000 7f6f4ffff700 1 -- 172.21.15.26:0/4181754187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f6c133e30 msgr2=0x7f6f6c09c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:28.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.251+0000 7f6f4ffff700 1 --2- 172.21.15.26:0/4181754187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f6c133e30 0x7f6f6c09c9c0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c09fcc0 tx=0x7f6f5c004750 comp rx=0 tx=0).stop 2023-10-01T07:59:28.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.251+0000 7f6f4ffff700 1 -- 172.21.15.26:0/4181754187 shutdown_connections 2023-10-01T07:59:28.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.251+0000 7f6f4ffff700 1 --2- 172.21.15.26:0/4181754187 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f6c134260 0x7f6f6c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:28.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.251+0000 7f6f4ffff700 1 --2- 172.21.15.26:0/4181754187 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f6c133420 0x7f6f6c09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:28.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.251+0000 7f6f4ffff700 1 --2- 172.21.15.26:0/4181754187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f6c133e30 0x7f6f6c09c9c0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:28.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.251+0000 7f6f4ffff700 1 -- 172.21.15.26:0/4181754187 >> 172.21.15.26:0/4181754187 conn(0x7f6f6c0a4210 msgr2=0x7f6f6c0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:28.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.251+0000 7f6f4ffff700 1 -- 172.21.15.26:0/4181754187 shutdown_connections 2023-10-01T07:59:28.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.251+0000 7f6f4ffff700 1 -- 172.21.15.26:0/4181754187 wait complete. 2023-10-01T07:59:28.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:28.267 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:28.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.280+0000 7fa9d6e52700 1 -- 172.21.15.26:0/4002790222 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa9d00747f0 con 0x7fa9d009f5b0 2023-10-01T07:59:28.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.280+0000 7fa9cd7fa700 1 -- 172.21.15.26:0/4002790222 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa9c8012930 con 0x7fa9d009f5b0 2023-10-01T07:59:28.281 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:28.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.282+0000 7fa9d6e52700 1 -- 172.21.15.26:0/4002790222 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa9d009f5b0 msgr2=0x7fa9d0120f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:28.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.283+0000 7fa9d6e52700 1 --2- 172.21.15.26:0/4002790222 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa9d009f5b0 0x7fa9d0120f70 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fa9c800efc0 tx=0x7fa9c800c3a0 comp rx=0 tx=0).stop 2023-10-01T07:59:28.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.283+0000 7fa9d6e52700 1 -- 172.21.15.26:0/4002790222 shutdown_connections 2023-10-01T07:59:28.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.283+0000 7fa9d6e52700 1 --2- 172.21.15.26:0/4002790222 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa9d009f5b0 0x7fa9d0120f70 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:28.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.283+0000 7fa9d6e52700 1 --2- 172.21.15.26:0/4002790222 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9d009e850 0x7fa9d01204f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:28.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.283+0000 7fa9d6e52700 1 --2- 172.21.15.26:0/4002790222 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9d009f160 0x7fa9d0120a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:28.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.283+0000 7fa9d6e52700 1 -- 172.21.15.26:0/4002790222 >> 172.21.15.26:0/4002790222 conn(0x7fa9d00a3f70 msgr2=0x7fa9d01bb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:28.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.283+0000 7fa9d6e52700 1 -- 172.21.15.26:0/4002790222 shutdown_connections 2023-10-01T07:59:28.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.283+0000 7fa9d6e52700 1 -- 172.21.15.26:0/4002790222 wait complete. 2023-10-01T07:59:28.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.283+0000 7f3881ec6700 1 -- 172.21.15.26:0/1552747944 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f387c1a9230 con 0x7f387c09d6f0 2023-10-01T07:59:28.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.283+0000 7f3878ff9700 1 -- 172.21.15.26:0/1552747944 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f387c1a9230 con 0x7f387c09d6f0 2023-10-01T07:59:28.285 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:28.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.286+0000 7f3881ec6700 1 -- 172.21.15.26:0/1552747944 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f387c09d6f0 msgr2=0x7f387c1a5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:28.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.286+0000 7f3881ec6700 1 --2- 172.21.15.26:0/1552747944 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f387c09d6f0 0x7f387c1a5fb0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f386c016000 tx=0x7f386c004750 comp rx=0 tx=0).stop 2023-10-01T07:59:28.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.286+0000 7f3881ec6700 1 -- 172.21.15.26:0/1552747944 shutdown_connections 2023-10-01T07:59:28.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.286+0000 7f3881ec6700 1 --2- 172.21.15.26:0/1552747944 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f387c09e410 0x7f387c1a6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:28.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.286+0000 7f3881ec6700 1 --2- 172.21.15.26:0/1552747944 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f387c09d6f0 0x7f387c1a5fb0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:28.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.286+0000 7f3881ec6700 1 --2- 172.21.15.26:0/1552747944 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f387c09e000 0x7f387c1a64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:28.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.286+0000 7f3881ec6700 1 -- 172.21.15.26:0/1552747944 >> 172.21.15.26:0/1552747944 conn(0x7f387c066f50 msgr2=0x7f387c1badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:28.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.286+0000 7f3881ec6700 1 -- 172.21.15.26:0/1552747944 shutdown_connections 2023-10-01T07:59:28.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:28.286+0000 7f3881ec6700 1 -- 172.21.15.26:0/1552747944 wait complete. 2023-10-01T07:59:28.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:28.300 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:29.257 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:29.268 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:29.299 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:29.301 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:29.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.423+0000 7f99cea79700 1 Processor -- start 2023-10-01T07:59:29.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.423+0000 7f99cea79700 1 -- start start 2023-10-01T07:59:29.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.424+0000 7f99cea79700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f99c809f410 0x7f99c8136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:29.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.424+0000 7f99cea79700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f99c8136fe0 0x7f99c81393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:29.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.424+0000 7f99cea79700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99c8070940 con 0x7f99c809e930 2023-10-01T07:59:29.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.424+0000 7f99cea79700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99c806fd60 con 0x7f99c8136fe0 2023-10-01T07:59:29.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.424+0000 7f99cea79700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99c806fa80 con 0x7f99c809f410 2023-10-01T07:59:29.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.424+0000 7f99cd016700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f99c8136fe0 0x7f99c81393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:29.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.424+0000 7f99c7fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f99c809f410 0x7f99c8136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:29.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.424+0000 7f99cd016700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f99c8136fe0 0x7f99c81393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48836/0 (socket says 172.21.15.26:48836) 2023-10-01T07:59:29.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.424+0000 7f99cd016700 1 -- 172.21.15.26:0/3535240129 learned_addr learned my addr 172.21.15.26:0/3535240129 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:29.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.425+0000 7f99c7fff700 1 -- 172.21.15.26:0/3535240129 >> v2:172.21.15.26:3300/0 conn(0x7f99c8136fe0 msgr2=0x7f99c81393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:29.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.425+0000 7f99c7fff700 1 --2- 172.21.15.26:0/3535240129 >> v2:172.21.15.26:3300/0 conn(0x7f99c8136fe0 0x7f99c81393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:29.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.425+0000 7f99c7fff700 1 -- 172.21.15.26:0/3535240129 >> v1:172.21.15.26:6789/0 conn(0x7f99c809e930 legacy=0x7f99c809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:29.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.425+0000 7f99c7fff700 1 -- 172.21.15.26:0/3535240129 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c809fb60 con 0x7f99c809f410 2023-10-01T07:59:29.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.425+0000 7f99cd016700 1 --2- 172.21.15.26:0/3535240129 >> v2:172.21.15.26:3300/0 conn(0x7f99c8136fe0 0x7f99c81393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:29.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.425+0000 7f99c7fff700 1 --2- 172.21.15.26:0/3535240129 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f99c809f410 0x7f99c8136aa0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f99b4009840 tx=0x7f99b4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8281437adee78251 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:29.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.426+0000 7f99c77fe700 1 -- 172.21.15.26:0/3535240129 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b4011830 con 0x7f99c809f410 2023-10-01T07:59:29.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.426+0000 7f99c77fe700 1 -- 172.21.15.26:0/3535240129 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b4011990 con 0x7f99c809f410 2023-10-01T07:59:29.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.426+0000 7f99c77fe700 1 -- 172.21.15.26:0/3535240129 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b4011d20 con 0x7f99c809f410 2023-10-01T07:59:29.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.426+0000 7f99cea79700 1 -- 172.21.15.26:0/3535240129 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f99c809f410 msgr2=0x7f99c8136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:29.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.426+0000 7f99cea79700 1 --2- 172.21.15.26:0/3535240129 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f99c809f410 0x7f99c8136aa0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f99b4009840 tx=0x7f99b4009b50 comp rx=0 tx=0).stop 2023-10-01T07:59:29.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.427+0000 7f99cea79700 1 -- 172.21.15.26:0/3535240129 shutdown_connections 2023-10-01T07:59:29.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.427+0000 7f99cea79700 1 --2- 172.21.15.26:0/3535240129 >> v2:172.21.15.26:3300/0 conn(0x7f99c8136fe0 0x7f99c81393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:29.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.427+0000 7f99cea79700 1 --2- 172.21.15.26:0/3535240129 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f99c809f410 0x7f99c8136aa0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:29.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.427+0000 7f99cea79700 1 -- 172.21.15.26:0/3535240129 >> 172.21.15.26:0/3535240129 conn(0x7f99c80a4210 msgr2=0x7f99c80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:29.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.427+0000 7f99cea79700 1 -- 172.21.15.26:0/3535240129 shutdown_connections 2023-10-01T07:59:29.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.427+0000 7f99cea79700 1 -- 172.21.15.26:0/3535240129 wait complete. 2023-10-01T07:59:29.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.428+0000 7f99cea79700 1 Processor -- start 2023-10-01T07:59:29.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.428+0000 7f99cea79700 1 -- start start 2023-10-01T07:59:29.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.429+0000 7f99cea79700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f99c809e930 0x7f99c81c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:29.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.429+0000 7f99cea79700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f99c809f410 0x7f99c81c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:29.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.429+0000 7f99cea79700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99c8136fe0 0x7f99c81c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:29.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.429+0000 7f99cea79700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c81223e0 con 0x7f99c8136fe0 2023-10-01T07:59:29.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.429+0000 7f99cea79700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c806d4c0 con 0x7f99c809f410 2023-10-01T07:59:29.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.429+0000 7f99cea79700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99c8121db0 con 0x7f99c809e930 2023-10-01T07:59:29.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.429+0000 7f99c7fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f99c809f410 0x7f99c81c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:29.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.429+0000 7f99c7fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f99c809f410 0x7f99c81c8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47510/0 (socket says 172.21.15.26:47510) 2023-10-01T07:59:29.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.429+0000 7f99c7fff700 1 -- 172.21.15.26:0/1745018868 learned_addr learned my addr 172.21.15.26:0/1745018868 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:29.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.430+0000 7f99cd016700 1 --2- 172.21.15.26:0/1745018868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99c8136fe0 0x7f99c81c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:29.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.430+0000 7f99cc815700 1 --2- 172.21.15.26:0/1745018868 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f99c809e930 0x7f99c81c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:29.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.430+0000 7f99c7fff700 1 -- 172.21.15.26:0/1745018868 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f99c809e930 msgr2=0x7f99c81c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:29.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.430+0000 7f99c7fff700 1 --2- 172.21.15.26:0/1745018868 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f99c809e930 0x7f99c81c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:29.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.430+0000 7f99c7fff700 1 -- 172.21.15.26:0/1745018868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99c8136fe0 msgr2=0x7f99c81c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:29.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.430+0000 7f99c7fff700 1 --2- 172.21.15.26:0/1745018868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99c8136fe0 0x7f99c81c8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:29.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.430+0000 7f99c7fff700 1 -- 172.21.15.26:0/1745018868 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c0009b30 con 0x7f99c809f410 2023-10-01T07:59:29.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.430+0000 7f99c7fff700 1 --2- 172.21.15.26:0/1745018868 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f99c809f410 0x7f99c81c8830 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f99b40090b0 tx=0x7f99b4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:29.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.430+0000 7f99c57fa700 1 -- 172.21.15.26:0/1745018868 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b40036a0 con 0x7f99c809f410 2023-10-01T07:59:29.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.430+0000 7f99c57fa700 1 -- 172.21.15.26:0/1745018868 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b401f070 con 0x7f99c809f410 2023-10-01T07:59:29.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.430+0000 7f99cea79700 1 -- 172.21.15.26:0/1745018868 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b40094a0 con 0x7f99c809f410 2023-10-01T07:59:29.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.430+0000 7f99c57fa700 1 -- 172.21.15.26:0/1745018868 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b4003a20 con 0x7f99c809f410 2023-10-01T07:59:29.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.431+0000 7f99cea79700 1 -- 172.21.15.26:0/1745018868 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c8071d20 con 0x7f99c809f410 2023-10-01T07:59:29.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.431+0000 7f99c57fa700 1 -- 172.21.15.26:0/1745018868 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f99b4003b80 con 0x7f99c809f410 2023-10-01T07:59:29.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.432+0000 7f99c57fa700 1 -- 172.21.15.26:0/1745018868 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f99b4021070 con 0x7f99c809f410 2023-10-01T07:59:29.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.432+0000 7f99cea79700 1 -- 172.21.15.26:0/1745018868 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99c81323c0 con 0x7f99c809f410 2023-10-01T07:59:29.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.441+0000 7f99c57fa700 1 -- 172.21.15.26:0/1745018868 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f99b4015080 con 0x7f99c809f410 2023-10-01T07:59:29.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.452+0000 7ff0ba8b4700 1 Processor -- start 2023-10-01T07:59:29.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.452+0000 7ff0ba8b4700 1 -- start start 2023-10-01T07:59:29.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.453+0000 7ff0ba8b4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0b409f410 0x7ff0b4136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:29.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.453+0000 7ff0ba8b4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff0b4136fe0 0x7ff0b41393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:29.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.453+0000 7ff0ba8b4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0b4070940 con 0x7ff0b409e930 2023-10-01T07:59:29.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.453+0000 7ff0ba8b4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0b406fd60 con 0x7ff0b4136fe0 2023-10-01T07:59:29.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.453+0000 7ff0ba8b4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b406fa80 con 0x7ff0b409f410 2023-10-01T07:59:29.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.454+0000 7ff0b8e51700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff0b4136fe0 0x7ff0b41393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:29.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.454+0000 7ff0b8e51700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff0b4136fe0 0x7ff0b41393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48854/0 (socket says 172.21.15.26:48854) 2023-10-01T07:59:29.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.454+0000 7ff0b8e51700 1 -- 172.21.15.26:0/1239924070 learned_addr learned my addr 172.21.15.26:0/1239924070 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:29.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.454+0000 7ff0b8e51700 1 -- 172.21.15.26:0/1239924070 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0b409f410 msgr2=0x7ff0b4136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:29.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.454+0000 7ff0b8e51700 1 --2- 172.21.15.26:0/1239924070 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0b409f410 0x7ff0b4136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:29.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.454+0000 7ff0b8e51700 1 -- 172.21.15.26:0/1239924070 >> v1:172.21.15.26:6789/0 conn(0x7ff0b409e930 legacy=0x7ff0b409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:29.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.454+0000 7ff0b8e51700 1 -- 172.21.15.26:0/1239924070 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b409fb60 con 0x7ff0b4136fe0 2023-10-01T07:59:29.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.454+0000 7ff0b8e51700 1 --2- 172.21.15.26:0/1239924070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0b4136fe0 0x7ff0b41393c0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac009e50 tx=0x7ff0ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d95a5fc79326359b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:29.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.454+0000 7ff0b2ffd700 1 -- 172.21.15.26:0/1239924070 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac00e070 con 0x7ff0b4136fe0 2023-10-01T07:59:29.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.455+0000 7ff0b2ffd700 1 -- 172.21.15.26:0/1239924070 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ac00b9c0 con 0x7ff0b4136fe0 2023-10-01T07:59:29.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.455+0000 7ff0b2ffd700 1 -- 172.21.15.26:0/1239924070 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac00bd70 con 0x7ff0b4136fe0 2023-10-01T07:59:29.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.455+0000 7ff0ba8b4700 1 -- 172.21.15.26:0/1239924070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0b4136fe0 msgr2=0x7ff0b41393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:29.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.455+0000 7ff0ba8b4700 1 --2- 172.21.15.26:0/1239924070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0b4136fe0 0x7ff0b41393c0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac009e50 tx=0x7ff0ac00b330 comp rx=0 tx=0).stop 2023-10-01T07:59:29.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.455+0000 7ff0ba8b4700 1 -- 172.21.15.26:0/1239924070 shutdown_connections 2023-10-01T07:59:29.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.455+0000 7ff0ba8b4700 1 --2- 172.21.15.26:0/1239924070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0b4136fe0 0x7ff0b41393c0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:29.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.455+0000 7ff0ba8b4700 1 --2- 172.21.15.26:0/1239924070 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0b409f410 0x7ff0b4136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:29.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.455+0000 7ff0ba8b4700 1 -- 172.21.15.26:0/1239924070 >> 172.21.15.26:0/1239924070 conn(0x7ff0b40a4210 msgr2=0x7ff0b40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:29.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.455+0000 7ff0ba8b4700 1 -- 172.21.15.26:0/1239924070 shutdown_connections 2023-10-01T07:59:29.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.455+0000 7ff0ba8b4700 1 -- 172.21.15.26:0/1239924070 wait complete. 2023-10-01T07:59:29.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.456+0000 7ff0ba8b4700 1 Processor -- start 2023-10-01T07:59:29.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.457+0000 7ff0ba8b4700 1 -- start start 2023-10-01T07:59:29.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.457+0000 7ff0ba8b4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0b409e930 0x7ff0b411b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:29.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.457+0000 7ff0ba8b4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0b409f410 0x7ff0b411b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:29.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.457+0000 7ff0ba8b4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0b4136fe0 0x7ff0b411bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:29.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.457+0000 7ff0ba8b4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b411ec40 con 0x7ff0b409e930 2023-10-01T07:59:29.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.457+0000 7ff0ba8b4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b4132cc0 con 0x7ff0b409f410 2023-10-01T07:59:29.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.457+0000 7ff0ba8b4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b4071d90 con 0x7ff0b4136fe0 2023-10-01T07:59:29.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.457+0000 7ff0b8e51700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0b4136fe0 0x7ff0b411bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:29.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.457+0000 7ff0b8e51700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0b4136fe0 0x7ff0b411bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47240/0 (socket says 172.21.15.26:47240) 2023-10-01T07:59:29.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.457+0000 7ff0b8e51700 1 -- 172.21.15.26:0/1967120375 learned_addr learned my addr 172.21.15.26:0/1967120375 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:29.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.457+0000 7ff0b37fe700 1 --2- 172.21.15.26:0/1967120375 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0b409f410 0x7ff0b411b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:29.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.458+0000 7ff0b3fff700 1 --2- 172.21.15.26:0/1967120375 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0b409e930 0x7ff0b411b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:29.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.458+0000 7ff0b8e51700 1 -- 172.21.15.26:0/1967120375 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0b409f410 msgr2=0x7ff0b411b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:29.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.458+0000 7ff0b8e51700 1 --2- 172.21.15.26:0/1967120375 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0b409f410 0x7ff0b411b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:29.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.458+0000 7ff0b8e51700 1 -- 172.21.15.26:0/1967120375 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0b409e930 msgr2=0x7ff0b411b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:29.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.458+0000 7ff0b8e51700 1 --2- 172.21.15.26:0/1967120375 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0b409e930 0x7ff0b411b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:29.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.458+0000 7ff0b8e51700 1 -- 172.21.15.26:0/1967120375 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ac009b30 con 0x7ff0b4136fe0 2023-10-01T07:59:29.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.458+0000 7ff0b8e51700 1 --2- 172.21.15.26:0/1967120375 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0b4136fe0 0x7ff0b411bef0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac012000 tx=0x7ff0ac004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:29.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.458+0000 7ff0b0ff9700 1 -- 172.21.15.26:0/1967120375 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac004840 con 0x7ff0b4136fe0 2023-10-01T07:59:29.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.458+0000 7ff0b0ff9700 1 -- 172.21.15.26:0/1967120375 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ac0092e0 con 0x7ff0b4136fe0 2023-10-01T07:59:29.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.458+0000 7ff0b0ff9700 1 -- 172.21.15.26:0/1967120375 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac01c660 con 0x7ff0b4136fe0 2023-10-01T07:59:29.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.458+0000 7ff0ba8b4700 1 -- 172.21.15.26:0/1967120375 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0b40a2f40 con 0x7ff0b4136fe0 2023-10-01T07:59:29.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.458+0000 7ff0ba8b4700 1 -- 172.21.15.26:0/1967120375 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0b411e980 con 0x7ff0b4136fe0 2023-10-01T07:59:29.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.459+0000 7ff0b0ff9700 1 -- 172.21.15.26:0/1967120375 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff0ac01c7c0 con 0x7ff0b4136fe0 2023-10-01T07:59:29.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.459+0000 7ff0b0ff9700 1 -- 172.21.15.26:0/1967120375 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff0ac0413a0 con 0x7ff0b4136fe0 2023-10-01T07:59:29.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.460+0000 7f611d89e700 1 Processor -- start 2023-10-01T07:59:29.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.460+0000 7ff0ba8b4700 1 -- 172.21.15.26:0/1967120375 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0b4074ea0 con 0x7ff0b4136fe0 2023-10-01T07:59:29.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.460+0000 7f611d89e700 1 -- start start 2023-10-01T07:59:29.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.460+0000 7f611d89e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f611809e1d0 0x7f611813cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:29.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.460+0000 7f611d89e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f611813d480 0x7f611813f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:29.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.460+0000 7f611d89e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61180992c0 con 0x7f611809d6f0 2023-10-01T07:59:29.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.460+0000 7f611d89e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6118099520 con 0x7f611813d480 2023-10-01T07:59:29.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.460+0000 7f611d89e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61180997e0 con 0x7f611809e1d0 2023-10-01T07:59:29.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.461+0000 7f61167fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f611809e1d0 0x7f611813cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:29.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.461+0000 7f61167fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f611809e1d0 0x7f611813cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47256/0 (socket says 172.21.15.26:47256) 2023-10-01T07:59:29.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.461+0000 7f61167fc700 1 -- 172.21.15.26:0/3988233841 learned_addr learned my addr 172.21.15.26:0/3988233841 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:29.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.461+0000 7f61167fc700 1 -- 172.21.15.26:0/3988233841 >> v2:172.21.15.26:3300/0 conn(0x7f611813d480 msgr2=0x7f611813f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:29.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.461+0000 7f61167fc700 1 --2- 172.21.15.26:0/3988233841 >> v2:172.21.15.26:3300/0 conn(0x7f611813d480 0x7f611813f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:29.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.461+0000 7f61167fc700 1 -- 172.21.15.26:0/3988233841 >> v1:172.21.15.26:6789/0 conn(0x7f611809d6f0 legacy=0x7f611809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:29.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.461+0000 7f61167fc700 1 -- 172.21.15.26:0/3988233841 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6118099b30 con 0x7f611809e1d0 2023-10-01T07:59:29.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.461+0000 7f61167fc700 1 --2- 172.21.15.26:0/3988233841 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f611809e1d0 0x7f611813cf40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f61080098f0 tx=0x7f6108009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8af27707bd0198bc server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:29.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.466+0000 7f6115ffb700 1 -- 172.21.15.26:0/3988233841 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6108004230 con 0x7f611809e1d0 2023-10-01T07:59:29.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.466+0000 7f6115ffb700 1 -- 172.21.15.26:0/3988233841 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6108004390 con 0x7f611809e1d0 2023-10-01T07:59:29.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.466+0000 7f6115ffb700 1 -- 172.21.15.26:0/3988233841 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61080036a0 con 0x7f611809e1d0 2023-10-01T07:59:29.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.466+0000 7ff0b0ff9700 1 -- 172.21.15.26:0/1967120375 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff0ac023930 con 0x7ff0b4136fe0 2023-10-01T07:59:29.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.466+0000 7f611d89e700 1 -- 172.21.15.26:0/3988233841 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f611809e1d0 msgr2=0x7f611813cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:29.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.466+0000 7f611d89e700 1 --2- 172.21.15.26:0/3988233841 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f611809e1d0 0x7f611813cf40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f61080098f0 tx=0x7f6108009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:29.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.467+0000 7f611d89e700 1 -- 172.21.15.26:0/3988233841 shutdown_connections 2023-10-01T07:59:29.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.467+0000 7f611d89e700 1 --2- 172.21.15.26:0/3988233841 >> v2:172.21.15.26:3300/0 conn(0x7f611813d480 0x7f611813f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:29.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.467+0000 7f611d89e700 1 --2- 172.21.15.26:0/3988233841 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f611809e1d0 0x7f611813cf40 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:29.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.467+0000 7f611d89e700 1 -- 172.21.15.26:0/3988233841 >> 172.21.15.26:0/3988233841 conn(0x7f611809f470 msgr2=0x7f61180a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:29.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.467+0000 7f611d89e700 1 -- 172.21.15.26:0/3988233841 shutdown_connections 2023-10-01T07:59:29.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.467+0000 7f611d89e700 1 -- 172.21.15.26:0/3988233841 wait complete. 2023-10-01T07:59:29.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.468+0000 7f611d89e700 1 Processor -- start 2023-10-01T07:59:29.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.468+0000 7f611d89e700 1 -- start start 2023-10-01T07:59:29.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.469+0000 7f611d89e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f611809d6f0 0x7f611806f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:29.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.469+0000 7f611d89e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f611809e1d0 0x7f611806f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:29.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.469+0000 7f611d89e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f611813d480 0x7f611806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:29.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.469+0000 7f611d89e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61180707a0 con 0x7f611809d6f0 2023-10-01T07:59:29.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.469+0000 7f611d89e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61180a2100 con 0x7f611809e1d0 2023-10-01T07:59:29.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.469+0000 7f611d89e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f611808f790 con 0x7f611813d480 2023-10-01T07:59:29.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.469+0000 7f6116ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f611809d6f0 0x7f611806f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:29.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.469+0000 7f6116ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f611809d6f0 0x7f611806f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48880/0 (socket says 172.21.15.26:48880) 2023-10-01T07:59:29.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.469+0000 7f6116ffd700 1 -- 172.21.15.26:0/1850887593 learned_addr learned my addr 172.21.15.26:0/1850887593 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:29.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.469+0000 7f61177fe700 1 --2- 172.21.15.26:0/1850887593 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f611813d480 0x7f611806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:29.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.469+0000 7f61167fc700 1 --2- 172.21.15.26:0/1850887593 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f611809e1d0 0x7f611806f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:29.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.470+0000 7f61177fe700 1 -- 172.21.15.26:0/1850887593 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f611809e1d0 msgr2=0x7f611806f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:29.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.470+0000 7f61177fe700 1 --2- 172.21.15.26:0/1850887593 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f611809e1d0 0x7f611806f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:29.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.470+0000 7f61177fe700 1 -- 172.21.15.26:0/1850887593 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f611809d6f0 msgr2=0x7f611806f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:29.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.470+0000 7f61177fe700 1 --2- 172.21.15.26:0/1850887593 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f611809d6f0 0x7f611806f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:29.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.470+0000 7f61177fe700 1 -- 172.21.15.26:0/1850887593 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6108009550 con 0x7f611813d480 2023-10-01T07:59:29.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.470+0000 7f61177fe700 1 --2- 172.21.15.26:0/1850887593 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f611813d480 0x7f611806fd50 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f611000be50 tx=0x7f6110009ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:29.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.470+0000 7f60fffff700 1 -- 172.21.15.26:0/1850887593 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611000cb90 con 0x7f611813d480 2023-10-01T07:59:29.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.470+0000 7f60fffff700 1 -- 172.21.15.26:0/1850887593 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611000cd10 con 0x7f611813d480 2023-10-01T07:59:29.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.470+0000 7f60fffff700 1 -- 172.21.15.26:0/1850887593 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6110014680 con 0x7f611813d480 2023-10-01T07:59:29.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.470+0000 7f611d89e700 1 -- 172.21.15.26:0/1850887593 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6118071df0 con 0x7f611813d480 2023-10-01T07:59:29.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.470+0000 7f611d89e700 1 -- 172.21.15.26:0/1850887593 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61180716d0 con 0x7f611813d480 2023-10-01T07:59:29.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.471+0000 7f60fffff700 1 -- 172.21.15.26:0/1850887593 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f611001d3b0 con 0x7f611813d480 2023-10-01T07:59:29.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.471+0000 7f60fffff700 1 -- 172.21.15.26:0/1850887593 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6110006e40 con 0x7f611813d480 2023-10-01T07:59:29.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.471+0000 7f611d89e700 1 -- 172.21.15.26:0/1850887593 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6118071df0 con 0x7f611813d480 2023-10-01T07:59:29.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.472+0000 7f236d045700 1 Processor -- start 2023-10-01T07:59:29.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.472+0000 7f236d045700 1 -- start start 2023-10-01T07:59:29.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.473+0000 7f236d045700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f236809e1d0 0x7f2368138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:29.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.473+0000 7f236d045700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2368139170 0x7f236813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:29.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.473+0000 7f236d045700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f236809b120 con 0x7f236809d6f0 2023-10-01T07:59:29.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.473+0000 7f236d045700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f236806b460 con 0x7f2368139170 2023-10-01T07:59:29.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.473+0000 7f236d045700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f236809a7e0 con 0x7f236809e1d0 2023-10-01T07:59:29.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.473+0000 7f236659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f236809e1d0 0x7f2368138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:29.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.473+0000 7f236659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f236809e1d0 0x7f2368138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47288/0 (socket says 172.21.15.26:47288) 2023-10-01T07:59:29.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.473+0000 7f236659c700 1 -- 172.21.15.26:0/1195461122 learned_addr learned my addr 172.21.15.26:0/1195461122 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:29.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.473+0000 7f236659c700 1 -- 172.21.15.26:0/1195461122 >> v2:172.21.15.26:3300/0 conn(0x7f2368139170 msgr2=0x7f236813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:29.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.473+0000 7f236659c700 1 --2- 172.21.15.26:0/1195461122 >> v2:172.21.15.26:3300/0 conn(0x7f2368139170 0x7f236813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:29.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.473+0000 7f236659c700 1 -- 172.21.15.26:0/1195461122 >> v1:172.21.15.26:6789/0 conn(0x7f236809d6f0 legacy=0x7f236809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:29.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.473+0000 7f236659c700 1 -- 172.21.15.26:0/1195461122 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236809a500 con 0x7f236809e1d0 2023-10-01T07:59:29.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.474+0000 7f236659c700 1 --2- 172.21.15.26:0/1195461122 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f236809e1d0 0x7f2368138c30 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f235c009920 tx=0x7f235c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56bb29a2d86b5ba server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:29.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.477+0000 7f2365d9b700 1 -- 172.21.15.26:0/1195461122 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c004230 con 0x7f236809e1d0 2023-10-01T07:59:29.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.477+0000 7f2365d9b700 1 -- 172.21.15.26:0/1195461122 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235c004390 con 0x7f236809e1d0 2023-10-01T07:59:29.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.477+0000 7f2365d9b700 1 -- 172.21.15.26:0/1195461122 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c009e70 con 0x7f236809e1d0 2023-10-01T07:59:29.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.477+0000 7f60fffff700 1 -- 172.21.15.26:0/1850887593 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6118071df0 con 0x7f611813d480 2023-10-01T07:59:29.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.478+0000 7f236d045700 1 -- 172.21.15.26:0/1195461122 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f236809e1d0 msgr2=0x7f2368138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:29.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.478+0000 7f236d045700 1 --2- 172.21.15.26:0/1195461122 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f236809e1d0 0x7f2368138c30 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f235c009920 tx=0x7f235c009c30 comp rx=0 tx=0).stop 2023-10-01T07:59:29.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.478+0000 7f236d045700 1 -- 172.21.15.26:0/1195461122 shutdown_connections 2023-10-01T07:59:29.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.478+0000 7f236d045700 1 --2- 172.21.15.26:0/1195461122 >> v2:172.21.15.26:3300/0 conn(0x7f2368139170 0x7f236813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:29.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.478+0000 7f236d045700 1 --2- 172.21.15.26:0/1195461122 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f236809e1d0 0x7f2368138c30 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:29.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.478+0000 7f236d045700 1 -- 172.21.15.26:0/1195461122 >> 172.21.15.26:0/1195461122 conn(0x7f2368066f50 msgr2=0x7f236809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:29.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.478+0000 7f236d045700 1 -- 172.21.15.26:0/1195461122 shutdown_connections 2023-10-01T07:59:29.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.478+0000 7f236d045700 1 -- 172.21.15.26:0/1195461122 wait complete. 2023-10-01T07:59:29.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.480+0000 7f236d045700 1 Processor -- start 2023-10-01T07:59:29.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.481+0000 7f236d045700 1 -- start start 2023-10-01T07:59:29.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.481+0000 7f236d045700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f236809d6f0 0x7f236811e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:29.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.481+0000 7f236d045700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f236809e1d0 0x7f236811ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:29.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.481+0000 7f236d045700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2368139170 0x7f236811f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:29.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.481+0000 7f236d045700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2368120540 con 0x7f236809e1d0 2023-10-01T07:59:29.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.481+0000 7f236d045700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2368122690 con 0x7f2368139170 2023-10-01T07:59:29.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.481+0000 7f236d045700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2368134460 con 0x7f236809d6f0 2023-10-01T07:59:29.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.482+0000 7f2366d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f236809d6f0 0x7f236811e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:29.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.482+0000 7f236759e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2368139170 0x7f236811f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:29.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.482+0000 7f236659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f236809e1d0 0x7f236811ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:29.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.482+0000 7f2366d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f236809d6f0 0x7f236811e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47304/0 (socket says 172.21.15.26:47304) 2023-10-01T07:59:29.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.482+0000 7f2366d9d700 1 -- 172.21.15.26:0/4281287737 learned_addr learned my addr 172.21.15.26:0/4281287737 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:29.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.482+0000 7f236659c700 1 -- 172.21.15.26:0/4281287737 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f236809d6f0 msgr2=0x7f236811e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:29.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.482+0000 7f236659c700 1 --2- 172.21.15.26:0/4281287737 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f236809d6f0 0x7f236811e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:29.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.482+0000 7f236659c700 1 -- 172.21.15.26:0/4281287737 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2368139170 msgr2=0x7f236811f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:29.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.482+0000 7f236659c700 1 --2- 172.21.15.26:0/4281287737 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2368139170 0x7f236811f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:29.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.482+0000 7f236659c700 1 -- 172.21.15.26:0/4281287737 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235c009550 con 0x7f236809e1d0 2023-10-01T07:59:29.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.482+0000 7f236659c700 1 --2- 172.21.15.26:0/4281287737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f236809e1d0 0x7f236811ef00 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f235c015000 tx=0x7f235c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:29.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.483+0000 7f234f7fe700 1 -- 172.21.15.26:0/4281287737 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c00bd70 con 0x7f236809e1d0 2023-10-01T07:59:29.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.483+0000 7f234f7fe700 1 -- 172.21.15.26:0/4281287737 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235c00bed0 con 0x7f236809e1d0 2023-10-01T07:59:29.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.483+0000 7f234f7fe700 1 -- 172.21.15.26:0/4281287737 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c0038a0 con 0x7f236809e1d0 2023-10-01T07:59:29.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.483+0000 7f236d045700 1 -- 172.21.15.26:0/4281287737 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2368122170 con 0x7f236809e1d0 2023-10-01T07:59:29.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.483+0000 7f236d045700 1 -- 172.21.15.26:0/4281287737 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f236809c710 con 0x7f236809e1d0 2023-10-01T07:59:29.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.484+0000 7f236d045700 1 -- 172.21.15.26:0/4281287737 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2368072690 con 0x7f236809e1d0 2023-10-01T07:59:29.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.484+0000 7f234f7fe700 1 -- 172.21.15.26:0/4281287737 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f235c022070 con 0x7f236809e1d0 2023-10-01T07:59:29.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.484+0000 7f234f7fe700 1 -- 172.21.15.26:0/4281287737 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f235c0412e0 con 0x7f236809e1d0 2023-10-01T07:59:29.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.490+0000 7f234f7fe700 1 -- 172.21.15.26:0/4281287737 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f235c02f9e0 con 0x7f236809e1d0 2023-10-01T07:59:29.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.658+0000 7f99cea79700 1 -- 172.21.15.26:0/1745018868 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f99c8074ea0 con 0x7f99c809f410 2023-10-01T07:59:29.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.658+0000 7f99c57fa700 1 -- 172.21.15.26:0/1745018868 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f99b4035090 con 0x7f99c809f410 2023-10-01T07:59:29.659 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:29.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.661+0000 7f99cea79700 1 -- 172.21.15.26:0/1745018868 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f99c809f410 msgr2=0x7f99c81c8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:29.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.661+0000 7f99cea79700 1 --2- 172.21.15.26:0/1745018868 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f99c809f410 0x7f99c81c8830 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f99b40090b0 tx=0x7f99b4004750 comp rx=0 tx=0).stop 2023-10-01T07:59:29.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.661+0000 7f99cea79700 1 -- 172.21.15.26:0/1745018868 shutdown_connections 2023-10-01T07:59:29.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.661+0000 7f99cea79700 1 --2- 172.21.15.26:0/1745018868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99c8136fe0 0x7f99c81c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:29.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.661+0000 7f99cea79700 1 --2- 172.21.15.26:0/1745018868 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f99c809e930 0x7f99c81c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:29.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.661+0000 7f99cea79700 1 --2- 172.21.15.26:0/1745018868 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f99c809f410 0x7f99c81c8830 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:29.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.661+0000 7f99cea79700 1 -- 172.21.15.26:0/1745018868 >> 172.21.15.26:0/1745018868 conn(0x7f99c80a4210 msgr2=0x7f99c80a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:29.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.661+0000 7f99cea79700 1 -- 172.21.15.26:0/1745018868 shutdown_connections 2023-10-01T07:59:29.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.661+0000 7f99cea79700 1 -- 172.21.15.26:0/1745018868 wait complete. 2023-10-01T07:59:29.676 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:29.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.679+0000 7ff0ba8b4700 1 -- 172.21.15.26:0/1967120375 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff0b411d800 con 0x7ff0b4136fe0 2023-10-01T07:59:29.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.679+0000 7ff0b0ff9700 1 -- 172.21.15.26:0/1967120375 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff0ac034090 con 0x7ff0b4136fe0 2023-10-01T07:59:29.680 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:29.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.682+0000 7ff0ba8b4700 1 -- 172.21.15.26:0/1967120375 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0b4136fe0 msgr2=0x7ff0b411bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:29.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.682+0000 7ff0ba8b4700 1 --2- 172.21.15.26:0/1967120375 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0b4136fe0 0x7ff0b411bef0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac012000 tx=0x7ff0ac004ad0 comp rx=0 tx=0).stop 2023-10-01T07:59:29.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.682+0000 7ff0ba8b4700 1 -- 172.21.15.26:0/1967120375 shutdown_connections 2023-10-01T07:59:29.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.682+0000 7ff0ba8b4700 1 --2- 172.21.15.26:0/1967120375 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0b4136fe0 0x7ff0b411bef0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:29.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.682+0000 7ff0ba8b4700 1 --2- 172.21.15.26:0/1967120375 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0b409e930 0x7ff0b411b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:29.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.682+0000 7ff0ba8b4700 1 --2- 172.21.15.26:0/1967120375 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0b409f410 0x7ff0b411b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:29.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.682+0000 7ff0ba8b4700 1 -- 172.21.15.26:0/1967120375 >> 172.21.15.26:0/1967120375 conn(0x7ff0b40a4210 msgr2=0x7ff0b406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:29.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.683+0000 7ff0ba8b4700 1 -- 172.21.15.26:0/1967120375 shutdown_connections 2023-10-01T07:59:29.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.683+0000 7ff0ba8b4700 1 -- 172.21.15.26:0/1967120375 wait complete. 2023-10-01T07:59:29.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.686+0000 7f611d89e700 1 -- 172.21.15.26:0/1850887593 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6118071df0 con 0x7f611813d480 2023-10-01T07:59:29.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.686+0000 7f60fffff700 1 -- 172.21.15.26:0/1850887593 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6118071df0 con 0x7f611813d480 2023-10-01T07:59:29.686 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:29.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.688+0000 7f611d89e700 1 -- 172.21.15.26:0/1850887593 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f611813d480 msgr2=0x7f611806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:29.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.688+0000 7f611d89e700 1 --2- 172.21.15.26:0/1850887593 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f611813d480 0x7f611806fd50 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f611000be50 tx=0x7f6110009ed0 comp rx=0 tx=0).stop 2023-10-01T07:59:29.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.689+0000 7f611d89e700 1 -- 172.21.15.26:0/1850887593 shutdown_connections 2023-10-01T07:59:29.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.689+0000 7f611d89e700 1 --2- 172.21.15.26:0/1850887593 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f611813d480 0x7f611806fd50 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:29.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.689+0000 7f611d89e700 1 --2- 172.21.15.26:0/1850887593 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f611809d6f0 0x7f611806f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:29.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.689+0000 7f611d89e700 1 --2- 172.21.15.26:0/1850887593 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f611809e1d0 0x7f611806f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:29.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.689+0000 7f611d89e700 1 -- 172.21.15.26:0/1850887593 >> 172.21.15.26:0/1850887593 conn(0x7f611809f470 msgr2=0x7f61180a1810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:29.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.689+0000 7f611d89e700 1 -- 172.21.15.26:0/1850887593 shutdown_connections 2023-10-01T07:59:29.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.689+0000 7f611d89e700 1 -- 172.21.15.26:0/1850887593 wait complete. 2023-10-01T07:59:29.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.697+0000 7f236d045700 1 -- 172.21.15.26:0/4281287737 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2368074ea0 con 0x7f236809e1d0 2023-10-01T07:59:29.698 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:29.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.697+0000 7f234f7fe700 1 -- 172.21.15.26:0/4281287737 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f235c02a020 con 0x7f236809e1d0 2023-10-01T07:59:29.699 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:29.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.699+0000 7f236d045700 1 -- 172.21.15.26:0/4281287737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f236809e1d0 msgr2=0x7f236811ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:29.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.700+0000 7f236d045700 1 --2- 172.21.15.26:0/4281287737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f236809e1d0 0x7f236811ef00 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f235c015000 tx=0x7f235c004750 comp rx=0 tx=0).stop 2023-10-01T07:59:29.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.700+0000 7f236d045700 1 -- 172.21.15.26:0/4281287737 shutdown_connections 2023-10-01T07:59:29.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.700+0000 7f236d045700 1 --2- 172.21.15.26:0/4281287737 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2368139170 0x7f236811f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:29.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.700+0000 7f236d045700 1 --2- 172.21.15.26:0/4281287737 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f236809d6f0 0x7f236811e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:29.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.700+0000 7f236d045700 1 --2- 172.21.15.26:0/4281287737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f236809e1d0 0x7f236811ef00 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:29.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.700+0000 7f236d045700 1 -- 172.21.15.26:0/4281287737 >> 172.21.15.26:0/4281287737 conn(0x7f2368066f50 msgr2=0x7f23680a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:29.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.700+0000 7f236d045700 1 -- 172.21.15.26:0/4281287737 shutdown_connections 2023-10-01T07:59:29.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:29.700+0000 7f236d045700 1 -- 172.21.15.26:0/4281287737 wait complete. 2023-10-01T07:59:29.705 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:29.714 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:30.677 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:30.699 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:30.706 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:30.715 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:30.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.842+0000 7fbac8aa0700 1 Processor -- start 2023-10-01T07:59:30.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.842+0000 7fbac8aa0700 1 -- start start 2023-10-01T07:59:30.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.843+0000 7fbac8aa0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbac41337f0 0x7fbac4138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:30.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.844+0000 7fbac8aa0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbac4138dc0 0x7fbac413b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:30.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.844+0000 7fbac8aa0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac406b990 con 0x7fbac4133420 2023-10-01T07:59:30.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.844+0000 7fbac8aa0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac409b0e0 con 0x7fbac41337f0 2023-10-01T07:59:30.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.844+0000 7fbac8aa0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbac4133c20 con 0x7fbac4138dc0 2023-10-01T07:59:30.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.844+0000 7fbac1d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbac41337f0 0x7fbac4138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:30.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.844+0000 7fbac1d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbac41337f0 0x7fbac4138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48906/0 (socket says 172.21.15.26:48906) 2023-10-01T07:59:30.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.844+0000 7fbac1d9b700 1 -- 172.21.15.26:0/4264527578 learned_addr learned my addr 172.21.15.26:0/4264527578 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:30.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.844+0000 7fbac2d9d700 1 --2- 172.21.15.26:0/4264527578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbac4138dc0 0x7fbac413b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:30.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.844+0000 7fbac1d9b700 1 -- 172.21.15.26:0/4264527578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbac4138dc0 msgr2=0x7fbac413b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:30.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.844+0000 7fbac1d9b700 1 --2- 172.21.15.26:0/4264527578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbac4138dc0 0x7fbac413b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:30.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.844+0000 7fbac1d9b700 1 -- 172.21.15.26:0/4264527578 >> v1:172.21.15.26:6789/0 conn(0x7fbac4133420 legacy=0x7fbac4133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:30.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.844+0000 7fbac1d9b700 1 -- 172.21.15.26:0/4264527578 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac40a0590 con 0x7fbac41337f0 2023-10-01T07:59:30.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.844+0000 7fbac2d9d700 1 --2- 172.21.15.26:0/4264527578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbac4138dc0 0x7fbac413b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:30.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.845+0000 7fbac1d9b700 1 --2- 172.21.15.26:0/4264527578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbac41337f0 0x7fbac4138880 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fbab80098f0 tx=0x7fbab8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64cfeb9f89ae6a42 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:30.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.845+0000 7fbac159a700 1 -- 172.21.15.26:0/4264527578 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab8011830 con 0x7fbac41337f0 2023-10-01T07:59:30.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.845+0000 7fbac159a700 1 -- 172.21.15.26:0/4264527578 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab8011990 con 0x7fbac41337f0 2023-10-01T07:59:30.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.845+0000 7fbac159a700 1 -- 172.21.15.26:0/4264527578 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab8011d20 con 0x7fbac41337f0 2023-10-01T07:59:30.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.845+0000 7fbac8aa0700 1 -- 172.21.15.26:0/4264527578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbac41337f0 msgr2=0x7fbac4138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:30.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.845+0000 7fbac8aa0700 1 --2- 172.21.15.26:0/4264527578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbac41337f0 0x7fbac4138880 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fbab80098f0 tx=0x7fbab8009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:30.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.846+0000 7fbac8aa0700 1 -- 172.21.15.26:0/4264527578 shutdown_connections 2023-10-01T07:59:30.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.846+0000 7fbac8aa0700 1 --2- 172.21.15.26:0/4264527578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbac4138dc0 0x7fbac413b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:30.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.846+0000 7fbac8aa0700 1 --2- 172.21.15.26:0/4264527578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbac41337f0 0x7fbac4138880 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:30.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.846+0000 7fbac8aa0700 1 -- 172.21.15.26:0/4264527578 >> 172.21.15.26:0/4264527578 conn(0x7fbac40a4210 msgr2=0x7fbac40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:30.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.846+0000 7fbac8aa0700 1 -- 172.21.15.26:0/4264527578 shutdown_connections 2023-10-01T07:59:30.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.846+0000 7fbac8aa0700 1 -- 172.21.15.26:0/4264527578 wait complete. 2023-10-01T07:59:30.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.847+0000 7fbac8aa0700 1 Processor -- start 2023-10-01T07:59:30.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.847+0000 7fbac8aa0700 1 -- start start 2023-10-01T07:59:30.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.848+0000 7fbac8aa0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbac4133420 0x7fbac409c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:30.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.848+0000 7fbac8aa0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbac41337f0 0x7fbac409cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:30.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.848+0000 7fbac8aa0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbac4138dc0 0x7fbac409d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:30.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.848+0000 7fbac8aa0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac412df60 con 0x7fbac4133420 2023-10-01T07:59:30.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.848+0000 7fbac8aa0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac412f950 con 0x7fbac41337f0 2023-10-01T07:59:30.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.848+0000 7fbac8aa0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbac4130780 con 0x7fbac4138dc0 2023-10-01T07:59:30.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.848+0000 7fbac259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbac4133420 0x7fbac409c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:30.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.848+0000 7fbac259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbac4133420 0x7fbac409c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48912/0 (socket says 172.21.15.26:48912) 2023-10-01T07:59:30.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.848+0000 7fbac259c700 1 -- 172.21.15.26:0/633631034 learned_addr learned my addr 172.21.15.26:0/633631034 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:30.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.848+0000 7fbac2d9d700 1 --2- 172.21.15.26:0/633631034 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbac4138dc0 0x7fbac409d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:30.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.848+0000 7fbac259c700 1 -- 172.21.15.26:0/633631034 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbac4138dc0 msgr2=0x7fbac409d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:30.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.848+0000 7fbac259c700 1 --2- 172.21.15.26:0/633631034 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbac4138dc0 0x7fbac409d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:30.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.848+0000 7fbac259c700 1 -- 172.21.15.26:0/633631034 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbac41337f0 msgr2=0x7fbac409cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:30.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.848+0000 7fbac259c700 1 --2- 172.21.15.26:0/633631034 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbac41337f0 0x7fbac409cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:30.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.848+0000 7fbac259c700 1 -- 172.21.15.26:0/633631034 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbabc009a70 con 0x7fbac4133420 2023-10-01T07:59:30.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.848+0000 7fbac259c700 1 --2- 172.21.15.26:0/633631034 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbac4133420 0x7fbac409c9e0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fbab400c4e0 tx=0x7fbab400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:30.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.849+0000 7fbab2ffd700 1 -- 172.21.15.26:0/633631034 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab40052d0 con 0x7fbac4133420 2023-10-01T07:59:30.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.849+0000 7fbab2ffd700 1 -- 172.21.15.26:0/633631034 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab4005430 con 0x7fbac4133420 2023-10-01T07:59:30.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.849+0000 7fbac8aa0700 1 -- 172.21.15.26:0/633631034 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab8009550 con 0x7fbac4133420 2023-10-01T07:59:30.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.849+0000 7fbab2ffd700 1 -- 172.21.15.26:0/633631034 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab40038c0 con 0x7fbac4133420 2023-10-01T07:59:30.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.849+0000 7fbac8aa0700 1 -- 172.21.15.26:0/633631034 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac4130d40 con 0x7fbac4133420 2023-10-01T07:59:30.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.850+0000 7fbab2ffd700 1 -- 172.21.15.26:0/633631034 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbab4003a20 con 0x7fbac4133420 2023-10-01T07:59:30.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.850+0000 7fbab2ffd700 1 -- 172.21.15.26:0/633631034 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbab403eb30 con 0x7fbac4133420 2023-10-01T07:59:30.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.850+0000 7fbac8aa0700 1 -- 172.21.15.26:0/633631034 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac4074ea0 con 0x7fbac4133420 2023-10-01T07:59:30.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.860+0000 7fbab2ffd700 1 -- 172.21.15.26:0/633631034 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbab4018260 con 0x7fbac4133420 2023-10-01T07:59:30.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.871+0000 7fcb39e5d700 1 Processor -- start 2023-10-01T07:59:30.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.872+0000 7fcb39e5d700 1 -- start start 2023-10-01T07:59:30.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.872+0000 7fcb39e5d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcb340a0a30 0x7fcb340a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:30.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.872+0000 7fcb39e5d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb3409d630 0x7fcb340a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:30.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.872+0000 7fcb39e5d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb340a2a70 con 0x7fcb34133930 2023-10-01T07:59:30.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.872+0000 7fcb39e5d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb340a01d0 con 0x7fcb340a0a30 2023-10-01T07:59:30.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.872+0000 7fcb39e5d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3409e2b0 con 0x7fcb3409d630 2023-10-01T07:59:30.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.872+0000 7fcb337fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcb340a0a30 0x7fcb340a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:30.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.872+0000 7fcb33fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fcb34133930 0x7fcb34133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37868/0 (socket says 172.21.15.26:37868) 2023-10-01T07:59:30.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.872+0000 7fcb337fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcb340a0a30 0x7fcb340a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48924/0 (socket says 172.21.15.26:48924) 2023-10-01T07:59:30.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.872+0000 7fcb33fff700 1 -- 172.21.15.26:0/824928180 learned_addr learned my addr 172.21.15.26:0/824928180 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:59:30.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.872+0000 7fcb32ffd700 1 --2- 172.21.15.26:0/824928180 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb3409d630 0x7fcb340a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:30.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.873+0000 7fcb337fe700 1 -- 172.21.15.26:0/824928180 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb3409d630 msgr2=0x7fcb340a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:30.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.873+0000 7fcb337fe700 1 --2- 172.21.15.26:0/824928180 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb3409d630 0x7fcb340a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:30.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.873+0000 7fcb337fe700 1 -- 172.21.15.26:0/824928180 >> v1:172.21.15.26:6789/0 conn(0x7fcb34133930 legacy=0x7fcb34133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:30.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.873+0000 7fcb337fe700 1 -- 172.21.15.26:0/824928180 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3409dc50 con 0x7fcb340a0a30 2023-10-01T07:59:30.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.873+0000 7fcb337fe700 1 --2- 172.21.15.26:0/824928180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb340a0a30 0x7fcb340a0e00 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fcb24009840 tx=0x7fcb24009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c939aa9ab0a799 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:30.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.874+0000 7fcb327fc700 1 -- 172.21.15.26:0/824928180 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb24011830 con 0x7fcb340a0a30 2023-10-01T07:59:30.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.874+0000 7fcb327fc700 1 -- 172.21.15.26:0/824928180 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb24011990 con 0x7fcb340a0a30 2023-10-01T07:59:30.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.874+0000 7fcb327fc700 1 -- 172.21.15.26:0/824928180 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb24011d20 con 0x7fcb340a0a30 2023-10-01T07:59:30.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.874+0000 7fcb39e5d700 1 -- 172.21.15.26:0/824928180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb340a0a30 msgr2=0x7fcb340a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:30.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.874+0000 7fcb39e5d700 1 --2- 172.21.15.26:0/824928180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb340a0a30 0x7fcb340a0e00 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fcb24009840 tx=0x7fcb24009b50 comp rx=0 tx=0).stop 2023-10-01T07:59:30.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.874+0000 7fcb39e5d700 1 -- 172.21.15.26:0/824928180 shutdown_connections 2023-10-01T07:59:30.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.874+0000 7fcb39e5d700 1 --2- 172.21.15.26:0/824928180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb340a0a30 0x7fcb340a0e00 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:30.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.874+0000 7fcb39e5d700 1 --2- 172.21.15.26:0/824928180 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb3409d630 0x7fcb340a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:30.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.874+0000 7fcb39e5d700 1 -- 172.21.15.26:0/824928180 >> 172.21.15.26:0/824928180 conn(0x7fcb340a3050 msgr2=0x7fcb340a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:30.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.875+0000 7fcb39e5d700 1 -- 172.21.15.26:0/824928180 shutdown_connections 2023-10-01T07:59:30.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.875+0000 7fcb39e5d700 1 -- 172.21.15.26:0/824928180 wait complete. 2023-10-01T07:59:30.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.876+0000 7fcb39e5d700 1 Processor -- start 2023-10-01T07:59:30.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.876+0000 7fcb39e5d700 1 -- start start 2023-10-01T07:59:30.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.876+0000 7f034e5cf700 1 Processor -- start 2023-10-01T07:59:30.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.876+0000 7fcb39e5d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb3409d630 0x7fcb341c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:30.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.876+0000 7fcb39e5d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb340a0a30 0x7fcb341c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:30.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.876+0000 7fcb39e5d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb34133930 0x7fcb341c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:30.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.876+0000 7fcb39e5d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3411eea0 con 0x7fcb3409d630 2023-10-01T07:59:30.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.876+0000 7fcb39e5d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb341207f0 con 0x7fcb34133930 2023-10-01T07:59:30.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.876+0000 7fcb39e5d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb34120600 con 0x7fcb340a0a30 2023-10-01T07:59:30.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.877+0000 7fcb32ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb340a0a30 0x7fcb341c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:30.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.877+0000 7fcb33fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb34133930 0x7fcb341c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:30.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.877+0000 7fcb337fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb3409d630 0x7fcb341c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:30.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.877+0000 7fcb32ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb340a0a30 0x7fcb341c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47334/0 (socket says 172.21.15.26:47334) 2023-10-01T07:59:30.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.877+0000 7fcb32ffd700 1 -- 172.21.15.26:0/2091627403 learned_addr learned my addr 172.21.15.26:0/2091627403 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:30.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.877+0000 7fcb33fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb34133930 0x7fcb341c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47560/0 (socket says 172.21.15.26:47560) 2023-10-01T07:59:30.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.876+0000 7f034e5cf700 1 -- start start 2023-10-01T07:59:30.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.877+0000 7f034e5cf700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f034806a770 0x7f034809d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:30.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.877+0000 7f034e5cf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f034809dc30 0x7f034809e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:30.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.877+0000 7f034e5cf700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f034809a810 con 0x7f034813c1e0 2023-10-01T07:59:30.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.877+0000 7f034e5cf700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f034806ab40 con 0x7f034806a770 2023-10-01T07:59:30.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.877+0000 7f034e5cf700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f034809ebc0 con 0x7f034809dc30 2023-10-01T07:59:30.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.877+0000 7f03477fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f034809dc30 0x7f034809e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:30.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.877+0000 7f03477fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f034809dc30 0x7f034809e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47564/0 (socket says 172.21.15.26:47564) 2023-10-01T07:59:30.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.877+0000 7f03477fe700 1 -- 172.21.15.26:0/974188417 learned_addr learned my addr 172.21.15.26:0/974188417 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:30.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.877+0000 7fcb337fe700 1 -- 172.21.15.26:0/2091627403 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb340a0a30 msgr2=0x7fcb341c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:30.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.877+0000 7fcb337fe700 1 --2- 172.21.15.26:0/2091627403 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb340a0a30 0x7fcb341c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:30.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.877+0000 7fcb337fe700 1 -- 172.21.15.26:0/2091627403 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb34133930 msgr2=0x7fcb341c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:30.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.877+0000 7fcb337fe700 1 --2- 172.21.15.26:0/2091627403 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb34133930 0x7fcb341c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:30.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.877+0000 7fcb337fe700 1 -- 172.21.15.26:0/2091627403 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb240094a0 con 0x7fcb3409d630 2023-10-01T07:59:30.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.877+0000 7f03477fe700 1 -- 172.21.15.26:0/974188417 >> v2:172.21.15.26:3300/0 conn(0x7f034806a770 msgr2=0x7f034809d6f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-01T07:59:30.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.877+0000 7f03477fe700 1 --2- 172.21.15.26:0/974188417 >> v2:172.21.15.26:3300/0 conn(0x7f034806a770 0x7f034809d6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:30.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.877+0000 7f03477fe700 1 -- 172.21.15.26:0/974188417 >> v1:172.21.15.26:6789/0 conn(0x7f034813c1e0 legacy=0x7f034813e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:30.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.877+0000 7f03477fe700 1 -- 172.21.15.26:0/974188417 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f034809e920 con 0x7f034809dc30 2023-10-01T07:59:30.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.878+0000 7f03477fe700 1 --2- 172.21.15.26:0/974188417 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f034809dc30 0x7f034809e080 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f033c0098f0 tx=0x7f033c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16a1241b0010e89 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:30.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.878+0000 7fcb337fe700 1 --2- 172.21.15.26:0/2091627403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb3409d630 0x7fcb341c8120 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fcb24016000 tx=0x7fcb24004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:30.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.878+0000 7f0346ffd700 1 -- 172.21.15.26:0/974188417 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c00b8a0 con 0x7f034809dc30 2023-10-01T07:59:30.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.878+0000 7f0346ffd700 1 -- 172.21.15.26:0/974188417 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033c00ba00 con 0x7f034809dc30 2023-10-01T07:59:30.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.878+0000 7f0346ffd700 1 -- 172.21.15.26:0/974188417 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c00bd90 con 0x7f034809dc30 2023-10-01T07:59:30.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.878+0000 7fcb1bfff700 1 -- 172.21.15.26:0/2091627403 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb240036a0 con 0x7fcb3409d630 2023-10-01T07:59:30.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.878+0000 7fcb1bfff700 1 -- 172.21.15.26:0/2091627403 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb2401f070 con 0x7fcb3409d630 2023-10-01T07:59:30.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.878+0000 7fcb39e5d700 1 -- 172.21.15.26:0/2091627403 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb34122510 con 0x7fcb3409d630 2023-10-01T07:59:30.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.878+0000 7fcb1bfff700 1 -- 172.21.15.26:0/2091627403 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb24003a60 con 0x7fcb3409d630 2023-10-01T07:59:30.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.878+0000 7fcb39e5d700 1 -- 172.21.15.26:0/2091627403 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb340a0470 con 0x7fcb3409d630 2023-10-01T07:59:30.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.879+0000 7f034e5cf700 1 -- 172.21.15.26:0/974188417 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f034809dc30 msgr2=0x7f034809e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:30.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.879+0000 7f034e5cf700 1 --2- 172.21.15.26:0/974188417 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f034809dc30 0x7f034809e080 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f033c0098f0 tx=0x7f033c009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:30.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.879+0000 7f034e5cf700 1 -- 172.21.15.26:0/974188417 shutdown_connections 2023-10-01T07:59:30.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.879+0000 7f034e5cf700 1 --2- 172.21.15.26:0/974188417 >> v2:172.21.15.26:3300/0 conn(0x7f034806a770 0x7f034809d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:30.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.879+0000 7f034e5cf700 1 --2- 172.21.15.26:0/974188417 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f034809dc30 0x7f034809e080 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:30.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.879+0000 7f034e5cf700 1 -- 172.21.15.26:0/974188417 >> 172.21.15.26:0/974188417 conn(0x7f0348066f50 msgr2=0x7f034809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:30.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.879+0000 7f034e5cf700 1 -- 172.21.15.26:0/974188417 shutdown_connections 2023-10-01T07:59:30.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.879+0000 7f034e5cf700 1 -- 172.21.15.26:0/974188417 wait complete. 2023-10-01T07:59:30.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.879+0000 7fcb1bfff700 1 -- 172.21.15.26:0/2091627403 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcb24003bc0 con 0x7fcb3409d630 2023-10-01T07:59:30.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.879+0000 7fcb1bfff700 1 -- 172.21.15.26:0/2091627403 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcb24021070 con 0x7fcb3409d630 2023-10-01T07:59:30.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.880+0000 7f034e5cf700 1 Processor -- start 2023-10-01T07:59:30.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.880+0000 7fcb39e5d700 1 -- 172.21.15.26:0/2091627403 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb340747f0 con 0x7fcb3409d630 2023-10-01T07:59:30.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.880+0000 7f034e5cf700 1 -- start start 2023-10-01T07:59:30.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.881+0000 7f034e5cf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f034806a770 0x7f034813ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:30.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.881+0000 7f034e5cf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f034809dc30 0x7f034813a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:30.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.881+0000 7f034e5cf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f034813c1e0 0x7f034813ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:30.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.881+0000 7f034e5cf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034811e030 con 0x7f034806a770 2023-10-01T07:59:30.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.881+0000 7f034e5cf700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0348134e00 con 0x7f034809dc30 2023-10-01T07:59:30.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.881+0000 7f034e5cf700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f034813fb30 con 0x7f034813c1e0 2023-10-01T07:59:30.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.881+0000 7f03477fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f034809dc30 0x7f034813a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:30.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.881+0000 7f03477fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f034809dc30 0x7f034813a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47566/0 (socket says 172.21.15.26:47566) 2023-10-01T07:59:30.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.881+0000 7f03477fe700 1 -- 172.21.15.26:0/370059660 learned_addr learned my addr 172.21.15.26:0/370059660 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:30.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.881+0000 7f03477fe700 1 -- 172.21.15.26:0/370059660 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f034813c1e0 msgr2=0x7f034813ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:30.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.881+0000 7f03477fe700 1 --2- 172.21.15.26:0/370059660 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f034813c1e0 0x7f034813ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:30.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.881+0000 7f03477fe700 1 -- 172.21.15.26:0/370059660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f034806a770 msgr2=0x7f034813ba00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:59:30.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.881+0000 7f03477fe700 1 --2- 172.21.15.26:0/370059660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f034806a770 0x7f034813ba00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:30.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.881+0000 7f03477fe700 1 -- 172.21.15.26:0/370059660 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033c009550 con 0x7f034809dc30 2023-10-01T07:59:30.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.881+0000 7f03477fe700 1 --2- 172.21.15.26:0/370059660 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f034809dc30 0x7f034813a6c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f033c000c00 tx=0x7f033c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:30.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.882+0000 7f0344ff9700 1 -- 172.21.15.26:0/370059660 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c0036a0 con 0x7f034809dc30 2023-10-01T07:59:30.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.882+0000 7f0344ff9700 1 -- 172.21.15.26:0/370059660 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033c003800 con 0x7f034809dc30 2023-10-01T07:59:30.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.882+0000 7f0344ff9700 1 -- 172.21.15.26:0/370059660 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c003b70 con 0x7f034809dc30 2023-10-01T07:59:30.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.882+0000 7f034e5cf700 1 -- 172.21.15.26:0/370059660 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f034811da90 con 0x7f034809dc30 2023-10-01T07:59:30.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.882+0000 7f034e5cf700 1 -- 172.21.15.26:0/370059660 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f034813eec0 con 0x7f034809dc30 2023-10-01T07:59:30.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.883+0000 7f0344ff9700 1 -- 172.21.15.26:0/370059660 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f033c003cd0 con 0x7f034809dc30 2023-10-01T07:59:30.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.883+0000 7f034e5cf700 1 -- 172.21.15.26:0/370059660 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f034813bfa0 con 0x7f034809dc30 2023-10-01T07:59:30.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.883+0000 7f0344ff9700 1 -- 172.21.15.26:0/370059660 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f033c021030 con 0x7f034809dc30 2023-10-01T07:59:30.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.889+0000 7f0344ff9700 1 -- 172.21.15.26:0/370059660 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f033c046060 con 0x7f034809dc30 2023-10-01T07:59:30.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.889+0000 7fcb1bfff700 1 -- 172.21.15.26:0/2091627403 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcb2402b080 con 0x7fcb3409d630 2023-10-01T07:59:30.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.894+0000 7f5839d12700 1 Processor -- start 2023-10-01T07:59:30.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.894+0000 7f5839d12700 1 -- start start 2023-10-01T07:59:30.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.894+0000 7f5839d12700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f58340a1140 0x7f583413d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:30.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.894+0000 7f5839d12700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f58340a15b0 0x7f583413f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:30.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.894+0000 7f5839d12700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58340a1e00 con 0x7f583406cc90 2023-10-01T07:59:30.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.894+0000 7f5839d12700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58340a2550 con 0x7f58340a1140 2023-10-01T07:59:30.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.894+0000 7f5839d12700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f583409cfa0 con 0x7f58340a15b0 2023-10-01T07:59:30.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.894+0000 7f58337fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f583406cc90 0x7f58340a0a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37886/0 (socket says 172.21.15.26:37886) 2023-10-01T07:59:30.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.894+0000 7f58337fe700 1 -- 172.21.15.26:0/2608748202 learned_addr learned my addr 172.21.15.26:0/2608748202 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:59:30.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.894+0000 7f5832ffd700 1 --2- 172.21.15.26:0/2608748202 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f58340a1140 0x7f583413d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:30.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.895+0000 7f5833fff700 1 --2- 172.21.15.26:0/2608748202 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f58340a15b0 0x7f583413f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:30.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.895+0000 7f58327fc700 1 -- 172.21.15.26:0/2608748202 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4082024432 0 0) 0x7f58340a1e00 con 0x7f583406cc90 2023-10-01T07:59:30.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.895+0000 7f58327fc700 1 -- 172.21.15.26:0/2608748202 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f581c0035b0 con 0x7f583406cc90 2023-10-01T07:59:30.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.895+0000 7f5833fff700 1 -- 172.21.15.26:0/2608748202 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f58340a1140 msgr2=0x7f583413d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:30.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.895+0000 7f5833fff700 1 --2- 172.21.15.26:0/2608748202 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f58340a1140 0x7f583413d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:30.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.895+0000 7f5833fff700 1 -- 172.21.15.26:0/2608748202 >> v1:172.21.15.26:6789/0 conn(0x7f583406cc90 legacy=0x7f58340a0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:30.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.895+0000 7f5833fff700 1 -- 172.21.15.26:0/2608748202 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f583409d8e0 con 0x7f58340a15b0 2023-10-01T07:59:30.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.895+0000 7f5832ffd700 1 --2- 172.21.15.26:0/2608748202 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f58340a1140 0x7f583413d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:30.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.895+0000 7f5833fff700 1 --2- 172.21.15.26:0/2608748202 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f58340a15b0 0x7f583413f680 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f582c009dc0 tx=0x7f582c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aff41691c41dfde1 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:30.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.895+0000 7f58327fc700 1 -- 172.21.15.26:0/2608748202 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c00e070 con 0x7f58340a15b0 2023-10-01T07:59:30.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.896+0000 7f58327fc700 1 -- 172.21.15.26:0/2608748202 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582c00bb20 con 0x7f58340a15b0 2023-10-01T07:59:30.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.896+0000 7f58327fc700 1 -- 172.21.15.26:0/2608748202 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c012430 con 0x7f58340a15b0 2023-10-01T07:59:30.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.896+0000 7f5839d12700 1 -- 172.21.15.26:0/2608748202 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f58340a15b0 msgr2=0x7f583413f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:30.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.896+0000 7f5839d12700 1 --2- 172.21.15.26:0/2608748202 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f58340a15b0 0x7f583413f680 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f582c009dc0 tx=0x7f582c00b330 comp rx=0 tx=0).stop 2023-10-01T07:59:30.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.896+0000 7f5839d12700 1 -- 172.21.15.26:0/2608748202 shutdown_connections 2023-10-01T07:59:30.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.896+0000 7f5839d12700 1 --2- 172.21.15.26:0/2608748202 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f58340a15b0 0x7f583413f680 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:30.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.896+0000 7f5839d12700 1 --2- 172.21.15.26:0/2608748202 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f58340a1140 0x7f583413d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:30.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.896+0000 7f5839d12700 1 -- 172.21.15.26:0/2608748202 >> 172.21.15.26:0/2608748202 conn(0x7f58340a3050 msgr2=0x7f58340a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:30.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.896+0000 7f5839d12700 1 -- 172.21.15.26:0/2608748202 shutdown_connections 2023-10-01T07:59:30.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.896+0000 7f5839d12700 1 -- 172.21.15.26:0/2608748202 wait complete. 2023-10-01T07:59:30.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.898+0000 7f5839d12700 1 Processor -- start 2023-10-01T07:59:30.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.898+0000 7f5839d12700 1 -- start start 2023-10-01T07:59:30.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.899+0000 7f5839d12700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f583406cc90 0x7f58341334b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:30.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.899+0000 7f5839d12700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f58340a1140 0x7f58341339f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:30.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.899+0000 7f5839d12700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58340a15b0 0x7f5834133f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:30.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.899+0000 7f5839d12700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583409c550 con 0x7f58340a15b0 2023-10-01T07:59:30.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.899+0000 7f5839d12700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5834136210 con 0x7f583406cc90 2023-10-01T07:59:30.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.899+0000 7f5839d12700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5834135140 con 0x7f58340a1140 2023-10-01T07:59:30.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.899+0000 7f58337fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f583406cc90 0x7f58341334b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:30.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.899+0000 7f58337fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f583406cc90 0x7f58341334b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47580/0 (socket says 172.21.15.26:47580) 2023-10-01T07:59:30.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.899+0000 7f58337fe700 1 -- 172.21.15.26:0/2330453296 learned_addr learned my addr 172.21.15.26:0/2330453296 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:30.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.899+0000 7f5832ffd700 1 --2- 172.21.15.26:0/2330453296 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f58340a1140 0x7f58341339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:30.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.899+0000 7f5833fff700 1 --2- 172.21.15.26:0/2330453296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58340a15b0 0x7f5834133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:30.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.900+0000 7f58337fe700 1 -- 172.21.15.26:0/2330453296 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f58340a1140 msgr2=0x7f58341339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:30.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.900+0000 7f58337fe700 1 --2- 172.21.15.26:0/2330453296 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f58340a1140 0x7f58341339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:30.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.900+0000 7f58337fe700 1 -- 172.21.15.26:0/2330453296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58340a15b0 msgr2=0x7f5834133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:30.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.900+0000 7f58337fe700 1 --2- 172.21.15.26:0/2330453296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58340a15b0 0x7f5834133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:30.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.900+0000 7f58337fe700 1 -- 172.21.15.26:0/2330453296 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58280094a0 con 0x7f583406cc90 2023-10-01T07:59:30.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.900+0000 7f5832ffd700 1 --2- 172.21.15.26:0/2330453296 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f58340a1140 0x7f58341339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:59:30.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.900+0000 7f58337fe700 1 --2- 172.21.15.26:0/2330453296 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f583406cc90 0x7f58341334b0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f5824001eb0 tx=0x7f582400c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:30.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.900+0000 7f581bfff700 1 -- 172.21.15.26:0/2330453296 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5824005d70 con 0x7f583406cc90 2023-10-01T07:59:30.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.900+0000 7f581bfff700 1 -- 172.21.15.26:0/2330453296 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58240070d0 con 0x7f583406cc90 2023-10-01T07:59:30.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.900+0000 7f5839d12700 1 -- 172.21.15.26:0/2330453296 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f582c009a70 con 0x7f583406cc90 2023-10-01T07:59:30.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.900+0000 7f581bfff700 1 -- 172.21.15.26:0/2330453296 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5824007460 con 0x7f583406cc90 2023-10-01T07:59:30.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.900+0000 7f5839d12700 1 -- 172.21.15.26:0/2330453296 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5834136bf0 con 0x7f583406cc90 2023-10-01T07:59:30.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.901+0000 7f581bfff700 1 -- 172.21.15.26:0/2330453296 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f58240075c0 con 0x7f583406cc90 2023-10-01T07:59:30.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.902+0000 7f581bfff700 1 -- 172.21.15.26:0/2330453296 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5824011360 con 0x7f583406cc90 2023-10-01T07:59:30.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.902+0000 7f5839d12700 1 -- 172.21.15.26:0/2330453296 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5834071e20 con 0x7f583406cc90 2023-10-01T07:59:30.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:30.907+0000 7f581bfff700 1 -- 172.21.15.26:0/2330453296 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5824017070 con 0x7f583406cc90 2023-10-01T07:59:31.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.098+0000 7fbac8aa0700 1 -- 172.21.15.26:0/633631034 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbac406b250 con 0x7fbac4133420 2023-10-01T07:59:31.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.098+0000 7fbab2ffd700 1 -- 172.21.15.26:0/633631034 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbab4017030 con 0x7fbac4133420 2023-10-01T07:59:31.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.098+0000 7f034e5cf700 1 -- 172.21.15.26:0/370059660 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0348074ea0 con 0x7f034809dc30 2023-10-01T07:59:31.099 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:31.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.099+0000 7f0344ff9700 1 -- 172.21.15.26:0/370059660 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f033c010380 con 0x7f034809dc30 2023-10-01T07:59:31.100 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:31.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.099+0000 7fcb39e5d700 1 -- 172.21.15.26:0/2091627403 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcb34122000 con 0x7fcb3409d630 2023-10-01T07:59:31.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.100+0000 7fcb1bfff700 1 -- 172.21.15.26:0/2091627403 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcb24015020 con 0x7fcb3409d630 2023-10-01T07:59:31.101 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:31.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.101+0000 7fbac8aa0700 1 -- 172.21.15.26:0/633631034 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbac4133420 msgr2=0x7fbac409c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:31.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.101+0000 7fbac8aa0700 1 --2- 172.21.15.26:0/633631034 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbac4133420 0x7fbac409c9e0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fbab400c4e0 tx=0x7fbab400c8a0 comp rx=0 tx=0).stop 2023-10-01T07:59:31.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.102+0000 7f034e5cf700 1 -- 172.21.15.26:0/370059660 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f034809dc30 msgr2=0x7f034813a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:31.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.103+0000 7f034e5cf700 1 --2- 172.21.15.26:0/370059660 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f034809dc30 0x7f034813a6c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f033c000c00 tx=0x7f033c004750 comp rx=0 tx=0).stop 2023-10-01T07:59:31.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.103+0000 7fbac8aa0700 1 -- 172.21.15.26:0/633631034 shutdown_connections 2023-10-01T07:59:31.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.103+0000 7fbac8aa0700 1 --2- 172.21.15.26:0/633631034 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbac4138dc0 0x7fbac409d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:31.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.103+0000 7fbac8aa0700 1 --2- 172.21.15.26:0/633631034 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbac4133420 0x7fbac409c9e0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:31.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.103+0000 7fbac8aa0700 1 --2- 172.21.15.26:0/633631034 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbac41337f0 0x7fbac409cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:31.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.103+0000 7fbac8aa0700 1 -- 172.21.15.26:0/633631034 >> 172.21.15.26:0/633631034 conn(0x7fbac40a4210 msgr2=0x7fbac40a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:31.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.103+0000 7f034e5cf700 1 -- 172.21.15.26:0/370059660 shutdown_connections 2023-10-01T07:59:31.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.103+0000 7f034e5cf700 1 --2- 172.21.15.26:0/370059660 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f034813c1e0 0x7f034813ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:31.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.103+0000 7f034e5cf700 1 --2- 172.21.15.26:0/370059660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f034806a770 0x7f034813ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:31.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.103+0000 7f034e5cf700 1 --2- 172.21.15.26:0/370059660 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f034809dc30 0x7f034813a6c0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:31.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.103+0000 7f034e5cf700 1 -- 172.21.15.26:0/370059660 >> 172.21.15.26:0/370059660 conn(0x7f0348066f50 msgr2=0x7f034809bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:31.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.103+0000 7fbac8aa0700 1 -- 172.21.15.26:0/633631034 shutdown_connections 2023-10-01T07:59:31.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.103+0000 7fbac8aa0700 1 -- 172.21.15.26:0/633631034 wait complete. 2023-10-01T07:59:31.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.103+0000 7f034e5cf700 1 -- 172.21.15.26:0/370059660 shutdown_connections 2023-10-01T07:59:31.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.103+0000 7f034e5cf700 1 -- 172.21.15.26:0/370059660 wait complete. 2023-10-01T07:59:31.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.103+0000 7fcb39e5d700 1 -- 172.21.15.26:0/2091627403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb3409d630 msgr2=0x7fcb341c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:31.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.103+0000 7fcb39e5d700 1 --2- 172.21.15.26:0/2091627403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb3409d630 0x7fcb341c8120 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fcb24016000 tx=0x7fcb24004750 comp rx=0 tx=0).stop 2023-10-01T07:59:31.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.103+0000 7fcb39e5d700 1 -- 172.21.15.26:0/2091627403 shutdown_connections 2023-10-01T07:59:31.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.103+0000 7fcb39e5d700 1 --2- 172.21.15.26:0/2091627403 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb34133930 0x7fcb341c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:31.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.103+0000 7fcb39e5d700 1 --2- 172.21.15.26:0/2091627403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb3409d630 0x7fcb341c8120 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:31.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.103+0000 7fcb39e5d700 1 --2- 172.21.15.26:0/2091627403 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb340a0a30 0x7fcb341c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:31.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.103+0000 7fcb39e5d700 1 -- 172.21.15.26:0/2091627403 >> 172.21.15.26:0/2091627403 conn(0x7fcb340a3050 msgr2=0x7fcb3409ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:31.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.103+0000 7fcb39e5d700 1 -- 172.21.15.26:0/2091627403 shutdown_connections 2023-10-01T07:59:31.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.104+0000 7fcb39e5d700 1 -- 172.21.15.26:0/2091627403 wait complete. 2023-10-01T07:59:31.121 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:31.128 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:31.128 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:31.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.129+0000 7f5839d12700 1 -- 172.21.15.26:0/2330453296 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f583404f2a0 con 0x7f583406cc90 2023-10-01T07:59:31.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.129+0000 7f581bfff700 1 -- 172.21.15.26:0/2330453296 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5824018260 con 0x7f583406cc90 2023-10-01T07:59:31.130 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:31.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.131+0000 7f5839d12700 1 -- 172.21.15.26:0/2330453296 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f583406cc90 msgr2=0x7f58341334b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:31.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.131+0000 7f5839d12700 1 --2- 172.21.15.26:0/2330453296 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f583406cc90 0x7f58341334b0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f5824001eb0 tx=0x7f582400c7b0 comp rx=0 tx=0).stop 2023-10-01T07:59:31.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.131+0000 7f5839d12700 1 -- 172.21.15.26:0/2330453296 shutdown_connections 2023-10-01T07:59:31.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.131+0000 7f5839d12700 1 --2- 172.21.15.26:0/2330453296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58340a15b0 0x7f5834133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:31.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.131+0000 7f5839d12700 1 --2- 172.21.15.26:0/2330453296 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f583406cc90 0x7f58341334b0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:31.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.131+0000 7f5839d12700 1 --2- 172.21.15.26:0/2330453296 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f58340a1140 0x7f58341339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:31.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.131+0000 7f5839d12700 1 -- 172.21.15.26:0/2330453296 >> 172.21.15.26:0/2330453296 conn(0x7f58340a3050 msgr2=0x7f5834099a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:31.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.131+0000 7f5839d12700 1 -- 172.21.15.26:0/2330453296 shutdown_connections 2023-10-01T07:59:31.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:31.131+0000 7f5839d12700 1 -- 172.21.15.26:0/2330453296 wait complete. 2023-10-01T07:59:31.146 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:32.122 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:32.128 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:32.129 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:32.147 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:32.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.288+0000 7f5bf3836700 1 Processor -- start 2023-10-01T07:59:32.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.288+0000 7f5bf3836700 1 -- start start 2023-10-01T07:59:32.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.289+0000 7f5bf3836700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bec136710 0x7f5bec138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:32.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.289+0000 7f5bf3836700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bec139030 0x7f5bec13b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:32.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.289+0000 7f5bf3836700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bec06ef30 con 0x7f5bec1338a0 2023-10-01T07:59:32.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.289+0000 7f5bf3836700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec06fef0 con 0x7f5bec139030 2023-10-01T07:59:32.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.289+0000 7f5bf3836700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec1334b0 con 0x7f5bec136710 2023-10-01T07:59:32.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.289+0000 7f5bf1dd3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bec139030 0x7f5bec13b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:32.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.289+0000 7f5bf15d2700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5bec1338a0 0x7f5bec133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37898/0 (socket says 172.21.15.26:37898) 2023-10-01T07:59:32.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.289+0000 7f5bf15d2700 1 -- 172.21.15.26:0/968132969 learned_addr learned my addr 172.21.15.26:0/968132969 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:59:32.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.289+0000 7f5bf0dd1700 1 --2- 172.21.15.26:0/968132969 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bec136710 0x7f5bec138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:32.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.289+0000 7f5bf1dd3700 1 -- 172.21.15.26:0/968132969 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bec136710 msgr2=0x7f5bec138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:32.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.289+0000 7f5bf1dd3700 1 --2- 172.21.15.26:0/968132969 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bec136710 0x7f5bec138af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.289+0000 7f5bf1dd3700 1 -- 172.21.15.26:0/968132969 >> v1:172.21.15.26:6789/0 conn(0x7f5bec1338a0 legacy=0x7f5bec133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:32.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.289+0000 7f5be3fff700 1 -- 172.21.15.26:0/968132969 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1324679794 0 0) 0x7f5bec06ef30 con 0x7f5bec1338a0 2023-10-01T07:59:32.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.290+0000 7f5bf1dd3700 1 -- 172.21.15.26:0/968132969 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec06fc30 con 0x7f5bec139030 2023-10-01T07:59:32.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.290+0000 7f5bf1dd3700 1 --2- 172.21.15.26:0/968132969 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bec139030 0x7f5bec13b410 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f5be4009dc0 tx=0x7f5be400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=663c3c5fe0500337 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:32.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.290+0000 7f5be3fff700 1 -- 172.21.15.26:0/968132969 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be400e070 con 0x7f5bec139030 2023-10-01T07:59:32.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.290+0000 7f5be3fff700 1 -- 172.21.15.26:0/968132969 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be400bb20 con 0x7f5bec139030 2023-10-01T07:59:32.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.290+0000 7f5be3fff700 1 -- 172.21.15.26:0/968132969 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be4012430 con 0x7f5bec139030 2023-10-01T07:59:32.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.291+0000 7f5bf3836700 1 -- 172.21.15.26:0/968132969 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bec139030 msgr2=0x7f5bec13b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:32.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.291+0000 7f5bf3836700 1 --2- 172.21.15.26:0/968132969 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bec139030 0x7f5bec13b410 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f5be4009dc0 tx=0x7f5be400b330 comp rx=0 tx=0).stop 2023-10-01T07:59:32.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.291+0000 7f5bf3836700 1 -- 172.21.15.26:0/968132969 shutdown_connections 2023-10-01T07:59:32.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.291+0000 7f5bf3836700 1 --2- 172.21.15.26:0/968132969 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bec139030 0x7f5bec13b410 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.291+0000 7f5bf3836700 1 --2- 172.21.15.26:0/968132969 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bec136710 0x7f5bec138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.291+0000 7f5bf3836700 1 -- 172.21.15.26:0/968132969 >> 172.21.15.26:0/968132969 conn(0x7f5bec0a2aa0 msgr2=0x7f5bec0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:32.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.291+0000 7f5bf3836700 1 -- 172.21.15.26:0/968132969 shutdown_connections 2023-10-01T07:59:32.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.291+0000 7f5bf3836700 1 -- 172.21.15.26:0/968132969 wait complete. 2023-10-01T07:59:32.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.292+0000 7f5bf3836700 1 Processor -- start 2023-10-01T07:59:32.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.293+0000 7f5bf3836700 1 -- start start 2023-10-01T07:59:32.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.293+0000 7f5bf3836700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bec1338a0 0x7f5bec119d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:32.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.293+0000 7f5bf3836700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bec136710 0x7f5bec11a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:32.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.293+0000 7f5bf3836700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bec139030 0x7f5bec11a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:32.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.293+0000 7f5bf3836700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec11d4e0 con 0x7f5bec136710 2023-10-01T07:59:32.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.293+0000 7f5bf3836700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec11d6c0 con 0x7f5bec139030 2023-10-01T07:59:32.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.293+0000 7f5bf3836700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec138cb0 con 0x7f5bec1338a0 2023-10-01T07:59:32.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.293+0000 7f5bf1dd3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bec139030 0x7f5bec11a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:32.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.293+0000 7f5bf15d2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bec1338a0 0x7f5bec119d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:32.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.293+0000 7f5bf1dd3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bec139030 0x7f5bec11a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47596/0 (socket says 172.21.15.26:47596) 2023-10-01T07:59:32.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.293+0000 7f5bf1dd3700 1 -- 172.21.15.26:0/2605485637 learned_addr learned my addr 172.21.15.26:0/2605485637 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:32.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.293+0000 7f5bf0dd1700 1 --2- 172.21.15.26:0/2605485637 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bec136710 0x7f5bec11a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:32.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.294+0000 7f5bf15d2700 1 -- 172.21.15.26:0/2605485637 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bec139030 msgr2=0x7f5bec11a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:32.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.294+0000 7f5bf15d2700 1 --2- 172.21.15.26:0/2605485637 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bec139030 0x7f5bec11a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.294+0000 7f5bf15d2700 1 -- 172.21.15.26:0/2605485637 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bec136710 msgr2=0x7f5bec11a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:32.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.294+0000 7f5bf15d2700 1 --2- 172.21.15.26:0/2605485637 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bec136710 0x7f5bec11a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.294+0000 7f5bf15d2700 1 -- 172.21.15.26:0/2605485637 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be4009a70 con 0x7f5bec1338a0 2023-10-01T07:59:32.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.294+0000 7f5bf15d2700 1 --2- 172.21.15.26:0/2605485637 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bec1338a0 0x7f5bec119d20 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5be800c4a0 tx=0x7f5be800c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:32.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.294+0000 7f5be1ffb700 1 -- 172.21.15.26:0/2605485637 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be8004c80 con 0x7f5bec1338a0 2023-10-01T07:59:32.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.294+0000 7f5be1ffb700 1 -- 172.21.15.26:0/2605485637 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be8004de0 con 0x7f5bec1338a0 2023-10-01T07:59:32.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.294+0000 7f5bf3836700 1 -- 172.21.15.26:0/2605485637 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bec06f640 con 0x7f5bec1338a0 2023-10-01T07:59:32.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.294+0000 7f5be1ffb700 1 -- 172.21.15.26:0/2605485637 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be8007310 con 0x7f5bec1338a0 2023-10-01T07:59:32.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.295+0000 7f5bf3836700 1 -- 172.21.15.26:0/2605485637 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bec11de50 con 0x7f5bec1338a0 2023-10-01T07:59:32.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.295+0000 7f5be1ffb700 1 -- 172.21.15.26:0/2605485637 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5be8007470 con 0x7f5bec1338a0 2023-10-01T07:59:32.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.296+0000 7f5be1ffb700 1 -- 172.21.15.26:0/2605485637 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5be803f240 con 0x7f5bec1338a0 2023-10-01T07:59:32.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.297+0000 7f5bf3836700 1 -- 172.21.15.26:0/2605485637 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bec074ea0 con 0x7f5bec1338a0 2023-10-01T07:59:32.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.306+0000 7f5be1ffb700 1 -- 172.21.15.26:0/2605485637 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5be8007720 con 0x7f5bec1338a0 2023-10-01T07:59:32.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.319+0000 7feb964fc700 1 Processor -- start 2023-10-01T07:59:32.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.319+0000 7feb964fc700 1 -- start start 2023-10-01T07:59:32.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.320+0000 7f0d4f83c700 1 Processor -- start 2023-10-01T07:59:32.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.320+0000 7feb964fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb901337f0 0x7feb90138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:32.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.320+0000 7feb964fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feb90138dc0 0x7feb9013b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:32.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.320+0000 7feb964fc700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb9006b990 con 0x7feb90133420 2023-10-01T07:59:32.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.320+0000 7feb964fc700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb9009b0e0 con 0x7feb90138dc0 2023-10-01T07:59:32.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.320+0000 7feb964fc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb90133c20 con 0x7feb901337f0 2023-10-01T07:59:32.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.321+0000 7f0d4f83c700 1 -- start start 2023-10-01T07:59:32.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.321+0000 7feb8f7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb901337f0 0x7feb90138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:32.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.321+0000 7feb8f7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb901337f0 0x7feb90138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47376/0 (socket says 172.21.15.26:47376) 2023-10-01T07:59:32.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.321+0000 7feb8f7fe700 1 -- 172.21.15.26:0/2338634055 learned_addr learned my addr 172.21.15.26:0/2338634055 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:32.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.321+0000 7f0d4f83c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0d48133420 0x7f0d481337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:32.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.321+0000 7f0d4f83c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d48133e30 0x7f0d4812ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:32.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.321+0000 7f0d4f83c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d48134260 0x7f0d481304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:32.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.321+0000 7f0d4f83c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d4806b990 con 0x7f0d48133420 2023-10-01T07:59:32.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.322+0000 7f0d4f83c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d480a0590 con 0x7f0d48133e30 2023-10-01T07:59:32.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.322+0000 7f0d4f83c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4809fb80 con 0x7f0d48134260 2023-10-01T07:59:32.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.322+0000 7f0d4cdd7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d48133e30 0x7f0d4812ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:32.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.322+0000 7f0d4cdd7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d48133e30 0x7f0d4812ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47610/0 (socket says 172.21.15.26:47610) 2023-10-01T07:59:32.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.322+0000 7feb8f7fe700 1 -- 172.21.15.26:0/2338634055 >> v2:172.21.15.26:3300/0 conn(0x7feb90138dc0 msgr2=0x7feb9013b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:32.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.322+0000 7feb8f7fe700 1 --2- 172.21.15.26:0/2338634055 >> v2:172.21.15.26:3300/0 conn(0x7feb90138dc0 0x7feb9013b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.322+0000 7feb8f7fe700 1 -- 172.21.15.26:0/2338634055 >> v1:172.21.15.26:6789/0 conn(0x7feb90133420 legacy=0x7feb90133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:32.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.322+0000 7feb8f7fe700 1 -- 172.21.15.26:0/2338634055 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb900a0590 con 0x7feb901337f0 2023-10-01T07:59:32.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.322+0000 7f0d4cdd7700 1 -- 172.21.15.26:0/507612910 learned_addr learned my addr 172.21.15.26:0/507612910 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:32.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.322+0000 7f0d4d5d8700 1 --2- 172.21.15.26:0/507612910 >> v2:172.21.15.26:3300/0 conn(0x7f0d48133420 0x7f0d481337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:32.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.322+0000 7f0d4ddd9700 1 --2- 172.21.15.26:0/507612910 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d48134260 0x7f0d481304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:32.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.322+0000 7feb8f7fe700 1 --2- 172.21.15.26:0/2338634055 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb901337f0 0x7feb90138880 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7feb840098f0 tx=0x7feb84009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41ac00b3001516b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:32.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.322+0000 7f49e6ab5700 1 Processor -- start 2023-10-01T07:59:32.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.322+0000 7f0d4cdd7700 1 -- 172.21.15.26:0/507612910 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d48134260 msgr2=0x7f0d481304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:32.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.322+0000 7f0d4cdd7700 1 --2- 172.21.15.26:0/507612910 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d48134260 0x7f0d481304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.322+0000 7f0d4cdd7700 1 -- 172.21.15.26:0/507612910 >> v2:172.21.15.26:3300/0 conn(0x7f0d48133420 msgr2=0x7f0d481337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:32.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.322+0000 7f0d4cdd7700 1 --2- 172.21.15.26:0/507612910 >> v2:172.21.15.26:3300/0 conn(0x7f0d48133420 0x7f0d481337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.322+0000 7f0d4cdd7700 1 -- 172.21.15.26:0/507612910 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d480a0030 con 0x7f0d48133e30 2023-10-01T07:59:32.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.322+0000 7feb8effd700 1 -- 172.21.15.26:0/2338634055 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb84004230 con 0x7feb901337f0 2023-10-01T07:59:32.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.322+0000 7feb8effd700 1 -- 172.21.15.26:0/2338634055 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb84004390 con 0x7feb901337f0 2023-10-01T07:59:32.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.322+0000 7feb8effd700 1 -- 172.21.15.26:0/2338634055 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb840036a0 con 0x7feb901337f0 2023-10-01T07:59:32.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.323+0000 7f49e6ab5700 1 -- start start 2023-10-01T07:59:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.323+0000 7feb964fc700 1 -- 172.21.15.26:0/2338634055 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb901337f0 msgr2=0x7feb90138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.323+0000 7feb964fc700 1 --2- 172.21.15.26:0/2338634055 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb901337f0 0x7feb90138880 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7feb840098f0 tx=0x7feb84009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.323+0000 7feb964fc700 1 -- 172.21.15.26:0/2338634055 shutdown_connections 2023-10-01T07:59:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.323+0000 7feb964fc700 1 --2- 172.21.15.26:0/2338634055 >> v2:172.21.15.26:3300/0 conn(0x7feb90138dc0 0x7feb9013b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.323+0000 7feb964fc700 1 --2- 172.21.15.26:0/2338634055 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb901337f0 0x7feb90138880 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.323+0000 7feb964fc700 1 -- 172.21.15.26:0/2338634055 >> 172.21.15.26:0/2338634055 conn(0x7feb900a4210 msgr2=0x7feb900a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.323+0000 7f0d4cdd7700 1 --2- 172.21.15.26:0/507612910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d48133e30 0x7f0d4812ff90 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c0098f0 tx=0x7f0d3c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b36bc90e0521913 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.323+0000 7f0d3bfff700 1 -- 172.21.15.26:0/507612910 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c011830 con 0x7f0d48133e30 2023-10-01T07:59:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.323+0000 7f0d3bfff700 1 -- 172.21.15.26:0/507612910 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3c011990 con 0x7f0d48133e30 2023-10-01T07:59:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.323+0000 7f0d3bfff700 1 -- 172.21.15.26:0/507612910 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c011d20 con 0x7f0d48133e30 2023-10-01T07:59:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.324+0000 7f0d4f83c700 1 -- 172.21.15.26:0/507612910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d48133e30 msgr2=0x7f0d4812ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.324+0000 7f0d4f83c700 1 --2- 172.21.15.26:0/507612910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d48133e30 0x7f0d4812ff90 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c0098f0 tx=0x7f0d3c009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.324+0000 7f0d4f83c700 1 -- 172.21.15.26:0/507612910 shutdown_connections 2023-10-01T07:59:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.324+0000 7f0d4f83c700 1 --2- 172.21.15.26:0/507612910 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d48134260 0x7f0d481304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.324+0000 7f0d4f83c700 1 --2- 172.21.15.26:0/507612910 >> v2:172.21.15.26:3300/0 conn(0x7f0d48133420 0x7f0d481337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.324+0000 7f0d4f83c700 1 --2- 172.21.15.26:0/507612910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d48133e30 0x7f0d4812ff90 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.324+0000 7f0d4f83c700 1 -- 172.21.15.26:0/507612910 >> 172.21.15.26:0/507612910 conn(0x7f0d480a4210 msgr2=0x7f0d480a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.324+0000 7f0d4f83c700 1 -- 172.21.15.26:0/507612910 shutdown_connections 2023-10-01T07:59:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.324+0000 7f0d4f83c700 1 -- 172.21.15.26:0/507612910 wait complete. 2023-10-01T07:59:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.323+0000 7f49e6ab5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f49e009d6f0 0x7f49e009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.323+0000 7f49e6ab5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f49e009e000 0x7f49e0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.323+0000 7f49e6ab5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f49e009e410 0x7f49e0130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.323+0000 7f49e6ab5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e009f520 con 0x7f49e009e000 2023-10-01T07:59:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.323+0000 7f49e6ab5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e009f130 con 0x7f49e009e410 2023-10-01T07:59:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.323+0000 7f49e6ab5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49e009e930 con 0x7f49e009d6f0 2023-10-01T07:59:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.324+0000 7f49e5052700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f49e009e410 0x7f49e0130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.324+0000 7f49e5052700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f49e009e410 0x7f49e0130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47614/0 (socket says 172.21.15.26:47614) 2023-10-01T07:59:32.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.324+0000 7f49e5052700 1 -- 172.21.15.26:0/2819987616 learned_addr learned my addr 172.21.15.26:0/2819987616 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:32.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.324+0000 7f49e4851700 1 --2- 172.21.15.26:0/2819987616 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f49e009d6f0 0x7f49e009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:32.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.324+0000 7f49e5052700 1 -- 172.21.15.26:0/2819987616 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f49e009d6f0 msgr2=0x7f49e009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:32.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.324+0000 7f49e5052700 1 --2- 172.21.15.26:0/2819987616 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f49e009d6f0 0x7f49e009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.324+0000 7f49e5052700 1 -- 172.21.15.26:0/2819987616 >> v2:172.21.15.26:3300/0 conn(0x7f49e009e000 msgr2=0x7f49e0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:32.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.324+0000 7f49e5052700 1 --2- 172.21.15.26:0/2819987616 >> v2:172.21.15.26:3300/0 conn(0x7f49e009e000 0x7f49e0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.324+0000 7f49e5052700 1 -- 172.21.15.26:0/2819987616 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e009b2d0 con 0x7f49e009e410 2023-10-01T07:59:32.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.324+0000 7f49e4851700 1 --2- 172.21.15.26:0/2819987616 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f49e009d6f0 0x7f49e009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:59:32.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.324+0000 7f49e5052700 1 --2- 172.21.15.26:0/2819987616 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f49e009e410 0x7f49e0130ba0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f49d000bb90 tx=0x7f49d000bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=348cfe1856c8b5c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:32.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.324+0000 7feb964fc700 1 -- 172.21.15.26:0/2338634055 shutdown_connections 2023-10-01T07:59:32.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.324+0000 7feb964fc700 1 -- 172.21.15.26:0/2338634055 wait complete. 2023-10-01T07:59:32.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.325+0000 7f49df7fe700 1 -- 172.21.15.26:0/2819987616 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d000dd50 con 0x7f49e009e410 2023-10-01T07:59:32.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.325+0000 7f49df7fe700 1 -- 172.21.15.26:0/2819987616 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d0010470 con 0x7f49e009e410 2023-10-01T07:59:32.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.325+0000 7f49df7fe700 1 -- 172.21.15.26:0/2819987616 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d0010800 con 0x7f49e009e410 2023-10-01T07:59:32.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.325+0000 7f0d4f83c700 1 Processor -- start 2023-10-01T07:59:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.325+0000 7feb964fc700 1 Processor -- start 2023-10-01T07:59:32.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.325+0000 7f0d4f83c700 1 -- start start 2023-10-01T07:59:32.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.326+0000 7f0d4f83c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d48133420 0x7f0d4809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:32.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.326+0000 7f0d4f83c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d48133e30 0x7f0d4809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:32.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.326+0000 7f0d4f83c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d48134260 0x7f0d4809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:32.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.326+0000 7f0d4f83c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4809deb0 con 0x7f0d48133420 2023-10-01T07:59:32.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.326+0000 7f0d4f83c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d48131470 con 0x7f0d48133e30 2023-10-01T07:59:32.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.326+0000 7f0d4f83c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d481204b0 con 0x7f0d48134260 2023-10-01T07:59:32.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.326+0000 7f0d4ddd9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d48134260 0x7f0d4809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:32.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.326+0000 7f0d4ddd9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d48134260 0x7f0d4809cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47400/0 (socket says 172.21.15.26:47400) 2023-10-01T07:59:32.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.326+0000 7f0d4ddd9700 1 -- 172.21.15.26:0/4031420526 learned_addr learned my addr 172.21.15.26:0/4031420526 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:32.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.326+0000 7f0d4d5d8700 1 --2- 172.21.15.26:0/4031420526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d48133420 0x7f0d4809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:32.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.326+0000 7f0d4cdd7700 1 --2- 172.21.15.26:0/4031420526 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d48133e30 0x7f0d4809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:32.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.326+0000 7f49e6ab5700 1 -- 172.21.15.26:0/2819987616 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f49e009e410 msgr2=0x7f49e0130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:32.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.326+0000 7f49e6ab5700 1 --2- 172.21.15.26:0/2819987616 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f49e009e410 0x7f49e0130ba0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f49d000bb90 tx=0x7f49d000bea0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.325+0000 7feb964fc700 1 -- start start 2023-10-01T07:59:32.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.326+0000 7feb964fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb90133420 0x7feb9009bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:32.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.326+0000 7feb964fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb901337f0 0x7feb900709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:32.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.326+0000 7feb964fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb90138dc0 0x7feb90070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:32.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.326+0000 7feb964fc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9012d8e0 con 0x7feb90133420 2023-10-01T07:59:32.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.326+0000 7feb964fc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9009cdc0 con 0x7feb90138dc0 2023-10-01T07:59:32.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.326+0000 7feb964fc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb9009d4f0 con 0x7feb901337f0 2023-10-01T07:59:32.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.326+0000 7feb8ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb90133420 0x7feb9009bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:32.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.326+0000 7feb8ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb90133420 0x7feb9009bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48968/0 (socket says 172.21.15.26:48968) 2023-10-01T07:59:32.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.326+0000 7feb8ffff700 1 -- 172.21.15.26:0/2390882493 learned_addr learned my addr 172.21.15.26:0/2390882493 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:32.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.326+0000 7f0d4ddd9700 1 -- 172.21.15.26:0/4031420526 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d48133e30 msgr2=0x7f0d4809c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:32.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.326+0000 7f0d4ddd9700 1 --2- 172.21.15.26:0/4031420526 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d48133e30 0x7f0d4809c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.326+0000 7f0d4ddd9700 1 -- 172.21.15.26:0/4031420526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d48133420 msgr2=0x7f0d4809c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:32.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.326+0000 7f0d4ddd9700 1 --2- 172.21.15.26:0/4031420526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d48133420 0x7f0d4809c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.326+0000 7f0d4ddd9700 1 -- 172.21.15.26:0/4031420526 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d3c009550 con 0x7f0d48134260 2023-10-01T07:59:32.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.326+0000 7feb8f7fe700 1 --2- 172.21.15.26:0/2390882493 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb901337f0 0x7feb900709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:32.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.326+0000 7feb8ffff700 1 -- 172.21.15.26:0/2390882493 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb901337f0 msgr2=0x7feb900709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:32.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.326+0000 7feb8ffff700 1 --2- 172.21.15.26:0/2390882493 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb901337f0 0x7feb900709a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.326+0000 7feb8ffff700 1 -- 172.21.15.26:0/2390882493 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb90138dc0 msgr2=0x7feb90070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:32.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.326+0000 7feb8ffff700 1 --2- 172.21.15.26:0/2390882493 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb90138dc0 0x7feb90070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.326+0000 7feb8ffff700 1 -- 172.21.15.26:0/2390882493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb84009550 con 0x7feb90133420 2023-10-01T07:59:32.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.327+0000 7feb8ffff700 1 --2- 172.21.15.26:0/2390882493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb90133420 0x7feb9009bed0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7feb8000c4a0 tx=0x7feb8000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:32.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.327+0000 7f49e6ab5700 1 -- 172.21.15.26:0/2819987616 shutdown_connections 2023-10-01T07:59:32.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.327+0000 7f49e6ab5700 1 --2- 172.21.15.26:0/2819987616 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f49e009e410 0x7f49e0130ba0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.327+0000 7f49e6ab5700 1 --2- 172.21.15.26:0/2819987616 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f49e009d6f0 0x7f49e009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.327+0000 7f49e6ab5700 1 --2- 172.21.15.26:0/2819987616 >> v2:172.21.15.26:3300/0 conn(0x7f49e009e000 0x7f49e0130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.327+0000 7f49e6ab5700 1 -- 172.21.15.26:0/2819987616 >> 172.21.15.26:0/2819987616 conn(0x7f49e0066f50 msgr2=0x7f49e009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:32.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.327+0000 7feb8cff9700 1 -- 172.21.15.26:0/2390882493 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb800054e0 con 0x7feb90133420 2023-10-01T07:59:32.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.327+0000 7f0d4ddd9700 1 --2- 172.21.15.26:0/4031420526 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d48134260 0x7f0d4809cf00 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f0d4000efc0 tx=0x7f0d4000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:32.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.328+0000 7f49e6ab5700 1 -- 172.21.15.26:0/2819987616 shutdown_connections 2023-10-01T07:59:32.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.327+0000 7feb8cff9700 1 -- 172.21.15.26:0/2390882493 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb80003680 con 0x7feb90133420 2023-10-01T07:59:32.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.327+0000 7feb964fc700 1 -- 172.21.15.26:0/2390882493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb9009d8a0 con 0x7feb90133420 2023-10-01T07:59:32.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.327+0000 7feb8cff9700 1 -- 172.21.15.26:0/2390882493 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb80003a30 con 0x7feb90133420 2023-10-01T07:59:32.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.327+0000 7feb964fc700 1 -- 172.21.15.26:0/2390882493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb9009c410 con 0x7feb90133420 2023-10-01T07:59:32.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.328+0000 7f0d39ffb700 1 -- 172.21.15.26:0/4031420526 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4000cd40 con 0x7f0d48134260 2023-10-01T07:59:32.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.328+0000 7f0d39ffb700 1 -- 172.21.15.26:0/4031420526 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4000f040 con 0x7f0d48134260 2023-10-01T07:59:32.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.328+0000 7f0d39ffb700 1 -- 172.21.15.26:0/4031420526 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d400146c0 con 0x7f0d48134260 2023-10-01T07:59:32.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.328+0000 7f0d4f83c700 1 -- 172.21.15.26:0/4031420526 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d4812dab0 con 0x7f0d48134260 2023-10-01T07:59:32.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.328+0000 7feb8cff9700 1 -- 172.21.15.26:0/2390882493 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feb80003b90 con 0x7feb90133420 2023-10-01T07:59:32.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.328+0000 7f0d4f83c700 1 -- 172.21.15.26:0/4031420526 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d48120ad0 con 0x7f0d48134260 2023-10-01T07:59:32.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.328+0000 7f49e6ab5700 1 -- 172.21.15.26:0/2819987616 wait complete. 2023-10-01T07:59:32.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.329+0000 7f49e6ab5700 1 Processor -- start 2023-10-01T07:59:32.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.328+0000 7feb8cff9700 1 -- 172.21.15.26:0/2390882493 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7feb8003ed30 con 0x7feb90133420 2023-10-01T07:59:32.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.329+0000 7feb964fc700 1 -- 172.21.15.26:0/2390882493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb9009c600 con 0x7feb90133420 2023-10-01T07:59:32.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.329+0000 7f49e6ab5700 1 -- start start 2023-10-01T07:59:32.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.330+0000 7f49e6ab5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49e009d6f0 0x7f49e01d1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:32.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.330+0000 7f49e6ab5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f49e009e410 0x7f49e01d22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:32.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.330+0000 7f49e6ab5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f49e01b8cd0 0x7f49e01d4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:32.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.330+0000 7f49e6ab5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e01b6f00 con 0x7f49e009d6f0 2023-10-01T07:59:32.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.330+0000 7f49e6ab5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e009c770 con 0x7f49e009e410 2023-10-01T07:59:32.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.330+0000 7f49e6ab5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49e01d2800 con 0x7f49e01b8cd0 2023-10-01T07:59:32.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.330+0000 7f49e4851700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49e009d6f0 0x7f49e01d1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:32.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.330+0000 7f49e4851700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49e009d6f0 0x7f49e01d1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48984/0 (socket says 172.21.15.26:48984) 2023-10-01T07:59:32.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.330+0000 7f49e4851700 1 -- 172.21.15.26:0/228534731 learned_addr learned my addr 172.21.15.26:0/228534731 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:32.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.330+0000 7f49e5052700 1 --2- 172.21.15.26:0/228534731 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f49e01b8cd0 0x7f49e01d4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:32.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.331+0000 7f49dffff700 1 --2- 172.21.15.26:0/228534731 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f49e009e410 0x7f49e01d22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:32.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.331+0000 7f49e5052700 1 -- 172.21.15.26:0/228534731 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f49e009e410 msgr2=0x7f49e01d22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:32.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.331+0000 7f49e5052700 1 --2- 172.21.15.26:0/228534731 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f49e009e410 0x7f49e01d22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.331+0000 7f49e5052700 1 -- 172.21.15.26:0/228534731 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49e009d6f0 msgr2=0x7f49e01d1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:32.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.331+0000 7f49e5052700 1 --2- 172.21.15.26:0/228534731 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49e009d6f0 0x7f49e01d1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.331+0000 7f49e5052700 1 -- 172.21.15.26:0/228534731 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d000b7f0 con 0x7f49e01b8cd0 2023-10-01T07:59:32.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.331+0000 7f49e5052700 1 --2- 172.21.15.26:0/228534731 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f49e01b8cd0 0x7f49e01d4dc0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f49d0018000 tx=0x7f49d0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:32.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.329+0000 7f0d39ffb700 1 -- 172.21.15.26:0/4031420526 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0d40014820 con 0x7f0d48134260 2023-10-01T07:59:32.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.329+0000 7f0d39ffb700 1 -- 172.21.15.26:0/4031420526 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0d40040240 con 0x7f0d48134260 2023-10-01T07:59:32.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.329+0000 7f0d4f83c700 1 -- 172.21.15.26:0/4031420526 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d48133b50 con 0x7f0d48134260 2023-10-01T07:59:32.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.335+0000 7feb8cff9700 1 -- 172.21.15.26:0/2390882493 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feb80017030 con 0x7feb90133420 2023-10-01T07:59:32.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.343+0000 7f49dd7fa700 1 -- 172.21.15.26:0/228534731 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d0003bf0 con 0x7f49e01b8cd0 2023-10-01T07:59:32.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.343+0000 7f49dd7fa700 1 -- 172.21.15.26:0/228534731 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d0003d50 con 0x7f49e01b8cd0 2023-10-01T07:59:32.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.343+0000 7f49dd7fa700 1 -- 172.21.15.26:0/228534731 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d0010820 con 0x7f49e01b8cd0 2023-10-01T07:59:32.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.343+0000 7f49e6ab5700 1 -- 172.21.15.26:0/228534731 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e01b84f0 con 0x7f49e01b8cd0 2023-10-01T07:59:32.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.344+0000 7f49e6ab5700 1 -- 172.21.15.26:0/228534731 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e00a1d00 con 0x7f49e01b8cd0 2023-10-01T07:59:32.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.344+0000 7f0d39ffb700 1 -- 172.21.15.26:0/4031420526 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0d4001d400 con 0x7f0d48134260 2023-10-01T07:59:32.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.345+0000 7f49dd7fa700 1 -- 172.21.15.26:0/228534731 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f49d0019400 con 0x7f49e01b8cd0 2023-10-01T07:59:32.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.345+0000 7f49e6ab5700 1 -- 172.21.15.26:0/228534731 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e0074ea0 con 0x7f49e01b8cd0 2023-10-01T07:59:32.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.345+0000 7f49dd7fa700 1 -- 172.21.15.26:0/228534731 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f49d0040c60 con 0x7f49e01b8cd0 2023-10-01T07:59:32.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.350+0000 7f49dd7fa700 1 -- 172.21.15.26:0/228534731 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f49d000f3d0 con 0x7f49e01b8cd0 2023-10-01T07:59:32.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.522+0000 7f5bf3836700 1 -- 172.21.15.26:0/2605485637 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5bec06b9e0 con 0x7f5bec1338a0 2023-10-01T07:59:32.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.523+0000 7f5be1ffb700 1 -- 172.21.15.26:0/2605485637 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5be8011e80 con 0x7f5bec1338a0 2023-10-01T07:59:32.524 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:32.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.525+0000 7f5bf3836700 1 -- 172.21.15.26:0/2605485637 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bec1338a0 msgr2=0x7f5bec119d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:32.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.525+0000 7f5bf3836700 1 --2- 172.21.15.26:0/2605485637 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bec1338a0 0x7f5bec119d20 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5be800c4a0 tx=0x7f5be800c7b0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.526+0000 7f5bf3836700 1 -- 172.21.15.26:0/2605485637 shutdown_connections 2023-10-01T07:59:32.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.526+0000 7f5bf3836700 1 --2- 172.21.15.26:0/2605485637 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bec139030 0x7f5bec11a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.526+0000 7f5bf3836700 1 --2- 172.21.15.26:0/2605485637 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bec1338a0 0x7f5bec119d20 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.526+0000 7f5bf3836700 1 --2- 172.21.15.26:0/2605485637 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bec136710 0x7f5bec11a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.526+0000 7f5bf3836700 1 -- 172.21.15.26:0/2605485637 >> 172.21.15.26:0/2605485637 conn(0x7f5bec0a2aa0 msgr2=0x7f5bec130050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:32.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.526+0000 7f5bf3836700 1 -- 172.21.15.26:0/2605485637 shutdown_connections 2023-10-01T07:59:32.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.526+0000 7f5bf3836700 1 -- 172.21.15.26:0/2605485637 wait complete. 2023-10-01T07:59:32.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:32.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.558+0000 7f49e6ab5700 1 -- 172.21.15.26:0/228534731 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f49e01b70d0 con 0x7f49e01b8cd0 2023-10-01T07:59:32.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.558+0000 7f49dd7fa700 1 -- 172.21.15.26:0/228534731 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f49d0028310 con 0x7f49e01b8cd0 2023-10-01T07:59:32.561 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:32.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.561+0000 7f49e6ab5700 1 -- 172.21.15.26:0/228534731 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f49e01b8cd0 msgr2=0x7f49e01d4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:32.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.561+0000 7f49e6ab5700 1 --2- 172.21.15.26:0/228534731 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f49e01b8cd0 0x7f49e01d4dc0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f49d0018000 tx=0x7f49d0004750 comp rx=0 tx=0).stop 2023-10-01T07:59:32.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.561+0000 7f49e6ab5700 1 -- 172.21.15.26:0/228534731 shutdown_connections 2023-10-01T07:59:32.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.561+0000 7f49e6ab5700 1 --2- 172.21.15.26:0/228534731 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f49e01b8cd0 0x7f49e01d4dc0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.561+0000 7f49e6ab5700 1 --2- 172.21.15.26:0/228534731 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49e009d6f0 0x7f49e01d1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.561+0000 7f49e6ab5700 1 --2- 172.21.15.26:0/228534731 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f49e009e410 0x7f49e01d22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.561+0000 7f49e6ab5700 1 -- 172.21.15.26:0/228534731 >> 172.21.15.26:0/228534731 conn(0x7f49e0066f50 msgr2=0x7f49e006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:32.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.561+0000 7f49e6ab5700 1 -- 172.21.15.26:0/228534731 shutdown_connections 2023-10-01T07:59:32.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.561+0000 7f49e6ab5700 1 -- 172.21.15.26:0/228534731 wait complete. 2023-10-01T07:59:32.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.568+0000 7feb964fc700 1 -- 172.21.15.26:0/2390882493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7feb90074ea0 con 0x7feb90133420 2023-10-01T07:59:32.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.568+0000 7feb8cff9700 1 -- 172.21.15.26:0/2390882493 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feb80019b40 con 0x7feb90133420 2023-10-01T07:59:32.569 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:32.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.571+0000 7feb964fc700 1 -- 172.21.15.26:0/2390882493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb90133420 msgr2=0x7feb9009bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:32.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.571+0000 7feb964fc700 1 --2- 172.21.15.26:0/2390882493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb90133420 0x7feb9009bed0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7feb8000c4a0 tx=0x7feb8000c860 comp rx=0 tx=0).stop 2023-10-01T07:59:32.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.571+0000 7feb964fc700 1 -- 172.21.15.26:0/2390882493 shutdown_connections 2023-10-01T07:59:32.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.571+0000 7feb964fc700 1 --2- 172.21.15.26:0/2390882493 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb90138dc0 0x7feb90070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.571+0000 7feb964fc700 1 --2- 172.21.15.26:0/2390882493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb90133420 0x7feb9009bed0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.571+0000 7feb964fc700 1 --2- 172.21.15.26:0/2390882493 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb901337f0 0x7feb900709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.571+0000 7feb964fc700 1 -- 172.21.15.26:0/2390882493 >> 172.21.15.26:0/2390882493 conn(0x7feb900a4210 msgr2=0x7feb90131400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:32.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.571+0000 7feb964fc700 1 -- 172.21.15.26:0/2390882493 shutdown_connections 2023-10-01T07:59:32.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.571+0000 7feb964fc700 1 -- 172.21.15.26:0/2390882493 wait complete. 2023-10-01T07:59:32.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.574+0000 7f0d4f83c700 1 -- 172.21.15.26:0/4031420526 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0d481202a0 con 0x7f0d48134260 2023-10-01T07:59:32.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.575+0000 7f0d39ffb700 1 -- 172.21.15.26:0/4031420526 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0d4002c090 con 0x7f0d48134260 2023-10-01T07:59:32.575 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:32.576 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:32.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.579+0000 7f0d4f83c700 1 -- 172.21.15.26:0/4031420526 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d48134260 msgr2=0x7f0d4809cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:32.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.579+0000 7f0d4f83c700 1 --2- 172.21.15.26:0/4031420526 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d48134260 0x7f0d4809cf00 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f0d4000efc0 tx=0x7f0d4000c3a0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.579+0000 7f0d4f83c700 1 -- 172.21.15.26:0/4031420526 shutdown_connections 2023-10-01T07:59:32.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.579+0000 7f0d4f83c700 1 --2- 172.21.15.26:0/4031420526 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d48134260 0x7f0d4809cf00 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.579+0000 7f0d4f83c700 1 --2- 172.21.15.26:0/4031420526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d48133420 0x7f0d4809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.579+0000 7f0d4f83c700 1 --2- 172.21.15.26:0/4031420526 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d48133e30 0x7f0d4809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:32.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.579+0000 7f0d4f83c700 1 -- 172.21.15.26:0/4031420526 >> 172.21.15.26:0/4031420526 conn(0x7f0d480a4210 msgr2=0x7f0d480a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:32.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.579+0000 7f0d4f83c700 1 -- 172.21.15.26:0/4031420526 shutdown_connections 2023-10-01T07:59:32.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:32.579+0000 7f0d4f83c700 1 -- 172.21.15.26:0/4031420526 wait complete. 2023-10-01T07:59:32.592 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:32.596 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:33.541 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:33.577 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:33.593 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:33.598 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:33.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.710+0000 7f2d97de6700 1 Processor -- start 2023-10-01T07:59:33.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.710+0000 7f2d97de6700 1 -- start start 2023-10-01T07:59:33.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.711+0000 7f2d97de6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d90130540 0x7f2d90130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:33.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.711+0000 7f2d97de6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2d9006fcf0 0x7f2d90138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:33.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.711+0000 7f2d97de6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d900716a0 con 0x7f2d90130e50 2023-10-01T07:59:33.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.711+0000 7f2d97de6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d9009a390 con 0x7f2d9006fcf0 2023-10-01T07:59:33.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.711+0000 7f2d97de6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d90071290 con 0x7f2d90130540 2023-10-01T07:59:33.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.711+0000 7f2d96383700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2d9006fcf0 0x7f2d90138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:33.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.711+0000 7f2d95b82700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d90130540 0x7f2d90130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:33.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.711+0000 7f2d96383700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2d9006fcf0 0x7f2d90138570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36780/0 (socket says 172.21.15.26:36780) 2023-10-01T07:59:33.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.711+0000 7f2d96383700 1 -- 172.21.15.26:0/3382985795 learned_addr learned my addr 172.21.15.26:0/3382985795 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:33.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.711+0000 7f2d95b82700 1 -- 172.21.15.26:0/3382985795 >> v2:172.21.15.26:3300/0 conn(0x7f2d9006fcf0 msgr2=0x7f2d90138570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:33.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.712+0000 7f2d95b82700 1 --2- 172.21.15.26:0/3382985795 >> v2:172.21.15.26:3300/0 conn(0x7f2d9006fcf0 0x7f2d90138570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:33.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.712+0000 7f2d95b82700 1 -- 172.21.15.26:0/3382985795 >> v1:172.21.15.26:6789/0 conn(0x7f2d90130e50 legacy=0x7f2d9006f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:33.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.712+0000 7f2d95b82700 1 -- 172.21.15.26:0/3382985795 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d90130340 con 0x7f2d90130540 2023-10-01T07:59:33.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.712+0000 7f2d96383700 1 --2- 172.21.15.26:0/3382985795 >> v2:172.21.15.26:3300/0 conn(0x7f2d9006fcf0 0x7f2d90138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:33.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.712+0000 7f2d95b82700 1 --2- 172.21.15.26:0/3382985795 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d90130540 0x7f2d90130910 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c009870 tx=0x7f2d8c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2109ea389fb94305 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:33.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.712+0000 7f2d94b80700 1 -- 172.21.15.26:0/3382985795 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c011830 con 0x7f2d90130540 2023-10-01T07:59:33.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.712+0000 7f2d94b80700 1 -- 172.21.15.26:0/3382985795 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8c011990 con 0x7f2d90130540 2023-10-01T07:59:33.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.712+0000 7f2d94b80700 1 -- 172.21.15.26:0/3382985795 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c011d20 con 0x7f2d90130540 2023-10-01T07:59:33.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.713+0000 7f2d97de6700 1 -- 172.21.15.26:0/3382985795 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d90130540 msgr2=0x7f2d90130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:33.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.713+0000 7f2d97de6700 1 --2- 172.21.15.26:0/3382985795 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d90130540 0x7f2d90130910 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c009870 tx=0x7f2d8c009b80 comp rx=0 tx=0).stop 2023-10-01T07:59:33.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.713+0000 7f2d97de6700 1 -- 172.21.15.26:0/3382985795 shutdown_connections 2023-10-01T07:59:33.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.713+0000 7f2d97de6700 1 --2- 172.21.15.26:0/3382985795 >> v2:172.21.15.26:3300/0 conn(0x7f2d9006fcf0 0x7f2d90138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:33.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.713+0000 7f2d97de6700 1 --2- 172.21.15.26:0/3382985795 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d90130540 0x7f2d90130910 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:33.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.713+0000 7f2d97de6700 1 -- 172.21.15.26:0/3382985795 >> 172.21.15.26:0/3382985795 conn(0x7f2d900a2aa0 msgr2=0x7f2d900a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:33.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.713+0000 7f2d97de6700 1 -- 172.21.15.26:0/3382985795 shutdown_connections 2023-10-01T07:59:33.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.713+0000 7f2d97de6700 1 -- 172.21.15.26:0/3382985795 wait complete. 2023-10-01T07:59:33.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.714+0000 7f2d97de6700 1 Processor -- start 2023-10-01T07:59:33.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.714+0000 7f2d97de6700 1 -- start start 2023-10-01T07:59:33.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.715+0000 7f2d97de6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d9006fcf0 0x7f2d901c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:33.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.715+0000 7f2d97de6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d90130540 0x7f2d901c6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:33.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.715+0000 7f2d97de6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d90130e50 0x7f2d90128420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:33.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.715+0000 7f2d97de6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9012b9f0 con 0x7f2d90130540 2023-10-01T07:59:33.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.715+0000 7f2d97de6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d901c6e70 con 0x7f2d90130e50 2023-10-01T07:59:33.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.715+0000 7f2d97de6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9012a210 con 0x7f2d9006fcf0 2023-10-01T07:59:33.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.715+0000 7f2d95381700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d90130540 0x7f2d901c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:33.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.715+0000 7f2d96383700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d90130e50 0x7f2d90128420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:33.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.715+0000 7f2d95381700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d90130540 0x7f2d901c6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36786/0 (socket says 172.21.15.26:36786) 2023-10-01T07:59:33.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.715+0000 7f2d95381700 1 -- 172.21.15.26:0/168714249 learned_addr learned my addr 172.21.15.26:0/168714249 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:33.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.715+0000 7f2d95381700 1 -- 172.21.15.26:0/168714249 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d9006fcf0 msgr2=0x7f2d901c63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:33.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.715+0000 7f2d95b82700 1 --2- 172.21.15.26:0/168714249 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d9006fcf0 0x7f2d901c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:33.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.715+0000 7f2d95381700 1 --2- 172.21.15.26:0/168714249 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d9006fcf0 0x7f2d901c63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:33.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.715+0000 7f2d95381700 1 -- 172.21.15.26:0/168714249 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d90130e50 msgr2=0x7f2d90128420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:33.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.715+0000 7f2d95381700 1 --2- 172.21.15.26:0/168714249 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d90130e50 0x7f2d90128420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:33.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.715+0000 7f2d95381700 1 -- 172.21.15.26:0/168714249 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d88009b30 con 0x7f2d90130540 2023-10-01T07:59:33.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.715+0000 7f2d96383700 1 --2- 172.21.15.26:0/168714249 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d90130e50 0x7f2d90128420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:33.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.716+0000 7f2d95b82700 1 --2- 172.21.15.26:0/168714249 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d9006fcf0 0x7f2d901c63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:59:33.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.716+0000 7f2d95381700 1 --2- 172.21.15.26:0/168714249 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d90130540 0x7f2d901c6930 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000c4b0 tx=0x7f2d8000c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:33.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.716+0000 7f2d867fc700 1 -- 172.21.15.26:0/168714249 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d800052d0 con 0x7f2d90130540 2023-10-01T07:59:33.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.716+0000 7f2d867fc700 1 -- 172.21.15.26:0/168714249 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d80005430 con 0x7f2d90130540 2023-10-01T07:59:33.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.716+0000 7f2d97de6700 1 -- 172.21.15.26:0/168714249 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d8c0094a0 con 0x7f2d90130540 2023-10-01T07:59:33.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.716+0000 7f2d867fc700 1 -- 172.21.15.26:0/168714249 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d800038c0 con 0x7f2d90130540 2023-10-01T07:59:33.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.716+0000 7f2d97de6700 1 -- 172.21.15.26:0/168714249 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d9012aac0 con 0x7f2d90130540 2023-10-01T07:59:33.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.717+0000 7f2d867fc700 1 -- 172.21.15.26:0/168714249 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d80003a20 con 0x7f2d90130540 2023-10-01T07:59:33.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.717+0000 7f2d97de6700 1 -- 172.21.15.26:0/168714249 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d90074ea0 con 0x7f2d90130540 2023-10-01T07:59:33.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.717+0000 7f2d867fc700 1 -- 172.21.15.26:0/168714249 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2d8003eab0 con 0x7f2d90130540 2023-10-01T07:59:33.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.722+0000 7f2d867fc700 1 -- 172.21.15.26:0/168714249 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d80018260 con 0x7f2d90130540 2023-10-01T07:59:33.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.739+0000 7f41efddc700 1 Processor -- start 2023-10-01T07:59:33.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.739+0000 7f41efddc700 1 -- start start 2023-10-01T07:59:33.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.740+0000 7f41efddc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41e81316c0 0x7f41e8131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:33.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.740+0000 7f41efddc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41e809d9f0 0x7f41e806a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:33.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.740+0000 7f41efddc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f41e806acb0 0x7f41e806b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:33.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.740+0000 7f41efddc700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e809e130 con 0x7f41e806acb0 2023-10-01T07:59:33.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.740+0000 7f41efddc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e81312b0 con 0x7f41e809d9f0 2023-10-01T07:59:33.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.740+0000 7f41efddc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41e809f6e0 con 0x7f41e81316c0 2023-10-01T07:59:33.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.740+0000 7f41edb78700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41e81316c0 0x7f41e8131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:33.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.740+0000 7f41ed377700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41e809d9f0 0x7f41e806a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:33.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.740+0000 7f41edb78700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41e81316c0 0x7f41e8131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56590/0 (socket says 172.21.15.26:56590) 2023-10-01T07:59:33.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.740+0000 7f41edb78700 1 -- 172.21.15.26:0/646709431 learned_addr learned my addr 172.21.15.26:0/646709431 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:33.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.740+0000 7f41ee379700 1 --2- 172.21.15.26:0/646709431 >> v2:172.21.15.26:3300/0 conn(0x7f41e806acb0 0x7f41e806b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:33.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.741+0000 7f41ee379700 1 -- 172.21.15.26:0/646709431 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41e81316c0 msgr2=0x7f41e8131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:33.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.741+0000 7f41ee379700 1 --2- 172.21.15.26:0/646709431 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41e81316c0 0x7f41e8131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:33.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.741+0000 7f41ee379700 1 -- 172.21.15.26:0/646709431 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41e809d9f0 msgr2=0x7f41e806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:33.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.741+0000 7f41ee379700 1 --2- 172.21.15.26:0/646709431 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41e809d9f0 0x7f41e806a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:33.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.741+0000 7f41ee379700 1 -- 172.21.15.26:0/646709431 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e809e760 con 0x7f41e806acb0 2023-10-01T07:59:33.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.741+0000 7f41ed377700 1 --2- 172.21.15.26:0/646709431 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41e809d9f0 0x7f41e806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:33.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.741+0000 7f41ee379700 1 --2- 172.21.15.26:0/646709431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41e806acb0 0x7f41e806b110 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f41e0009d90 tx=0x7f41e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c9a4bc13960569d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:33.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.741+0000 7f41ecb76700 1 -- 172.21.15.26:0/646709431 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e000e070 con 0x7f41e806acb0 2023-10-01T07:59:33.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.741+0000 7f41ecb76700 1 -- 172.21.15.26:0/646709431 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e000bb20 con 0x7f41e806acb0 2023-10-01T07:59:33.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.741+0000 7f41ecb76700 1 -- 172.21.15.26:0/646709431 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e0012430 con 0x7f41e806acb0 2023-10-01T07:59:33.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.742+0000 7f41efddc700 1 -- 172.21.15.26:0/646709431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41e806acb0 msgr2=0x7f41e806b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:33.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.742+0000 7f41efddc700 1 --2- 172.21.15.26:0/646709431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41e806acb0 0x7f41e806b110 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f41e0009d90 tx=0x7f41e000b330 comp rx=0 tx=0).stop 2023-10-01T07:59:33.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.742+0000 7f41efddc700 1 -- 172.21.15.26:0/646709431 shutdown_connections 2023-10-01T07:59:33.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.742+0000 7f41efddc700 1 --2- 172.21.15.26:0/646709431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41e806acb0 0x7f41e806b110 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:33.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.742+0000 7f41efddc700 1 --2- 172.21.15.26:0/646709431 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41e81316c0 0x7f41e8131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:33.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.742+0000 7f41efddc700 1 --2- 172.21.15.26:0/646709431 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41e809d9f0 0x7f41e806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:33.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.742+0000 7f41efddc700 1 -- 172.21.15.26:0/646709431 >> 172.21.15.26:0/646709431 conn(0x7f41e8066f50 msgr2=0x7f41e809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:33.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.742+0000 7f41efddc700 1 -- 172.21.15.26:0/646709431 shutdown_connections 2023-10-01T07:59:33.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.742+0000 7f41efddc700 1 -- 172.21.15.26:0/646709431 wait complete. 2023-10-01T07:59:33.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.744+0000 7f41efddc700 1 Processor -- start 2023-10-01T07:59:33.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.744+0000 7f41efddc700 1 -- start start 2023-10-01T07:59:33.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.744+0000 7f41efddc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41e806acb0 0x7f41e806e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:33.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.744+0000 7f41efddc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41e809d9f0 0x7f41e806ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:33.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.744+0000 7f41efddc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41e81316c0 0x7f41e806f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:33.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.744+0000 7f41efddc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e812e6c0 con 0x7f41e81316c0 2023-10-01T07:59:33.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.744+0000 7f41efddc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e812e8b0 con 0x7f41e809d9f0 2023-10-01T07:59:33.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.744+0000 7f41efddc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41e812b900 con 0x7f41e806acb0 2023-10-01T07:59:33.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.745+0000 7f41edb78700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41e806acb0 0x7f41e806e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:33.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.745+0000 7f41edb78700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41e806acb0 0x7f41e806e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56594/0 (socket says 172.21.15.26:56594) 2023-10-01T07:59:33.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.745+0000 7f41edb78700 1 -- 172.21.15.26:0/3004001279 learned_addr learned my addr 172.21.15.26:0/3004001279 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:33.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.745+0000 7f41ee379700 1 --2- 172.21.15.26:0/3004001279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41e81316c0 0x7f41e806f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:33.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.745+0000 7f41ed377700 1 --2- 172.21.15.26:0/3004001279 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41e809d9f0 0x7f41e806ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:33.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.745+0000 7f41edb78700 1 -- 172.21.15.26:0/3004001279 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41e809d9f0 msgr2=0x7f41e806ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:33.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.745+0000 7f41edb78700 1 --2- 172.21.15.26:0/3004001279 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41e809d9f0 0x7f41e806ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:33.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.745+0000 7f41edb78700 1 -- 172.21.15.26:0/3004001279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41e81316c0 msgr2=0x7f41e806f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:33.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.745+0000 7f41edb78700 1 --2- 172.21.15.26:0/3004001279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41e81316c0 0x7f41e806f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:33.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.745+0000 7f41edb78700 1 -- 172.21.15.26:0/3004001279 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d80094a0 con 0x7f41e806acb0 2023-10-01T07:59:33.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.745+0000 7f41edb78700 1 --2- 172.21.15.26:0/3004001279 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41e806acb0 0x7f41e806e8e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f41e400e910 tx=0x7f41e400ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:33.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.745+0000 7f41de7fc700 1 -- 172.21.15.26:0/3004001279 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e40096a0 con 0x7f41e806acb0 2023-10-01T07:59:33.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.746+0000 7f41de7fc700 1 -- 172.21.15.26:0/3004001279 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e4013680 con 0x7f41e806acb0 2023-10-01T07:59:33.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.746+0000 7f41de7fc700 1 -- 172.21.15.26:0/3004001279 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e4013a30 con 0x7f41e806acb0 2023-10-01T07:59:33.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.747+0000 7f41efddc700 1 -- 172.21.15.26:0/3004001279 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e0009a70 con 0x7f41e806acb0 2023-10-01T07:59:33.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.747+0000 7f41efddc700 1 -- 172.21.15.26:0/3004001279 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e8072690 con 0x7f41e806acb0 2023-10-01T07:59:33.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.747+0000 7f41de7fc700 1 -- 172.21.15.26:0/3004001279 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f41e4013b90 con 0x7f41e806acb0 2023-10-01T07:59:33.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.748+0000 7f41de7fc700 1 -- 172.21.15.26:0/3004001279 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f41e403f580 con 0x7f41e806acb0 2023-10-01T07:59:33.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.748+0000 7f41efddc700 1 -- 172.21.15.26:0/3004001279 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e80a2490 con 0x7f41e806acb0 2023-10-01T07:59:33.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.753+0000 7f41de7fc700 1 -- 172.21.15.26:0/3004001279 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f41e40123d0 con 0x7f41e806acb0 2023-10-01T07:59:33.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.779+0000 7f67f2df7700 1 Processor -- start 2023-10-01T07:59:33.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.779+0000 7f67f2df7700 1 -- start start 2023-10-01T07:59:33.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.780+0000 7f7a76fec700 1 Processor -- start 2023-10-01T07:59:33.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.780+0000 7f7a76fec700 1 -- start start 2023-10-01T07:59:33.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.780+0000 7f7a76fec700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7a7009d6f0 0x7f7a7009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:33.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.780+0000 7f7a76fec700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7a7009e000 0x7f7a701339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:33.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.780+0000 7f7a76fec700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7a7009e410 0x7f7a70133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:33.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.780+0000 7f7a76fec700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a7006b460 con 0x7f7a7009d6f0 2023-10-01T07:59:33.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.780+0000 7f7a76fec700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7009b120 con 0x7f7a7009e410 2023-10-01T07:59:33.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.780+0000 7f7a76fec700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7009a7e0 con 0x7f7a7009e000 2023-10-01T07:59:33.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.780+0000 7f67f2df7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f67ec09d6f0 0x7f67ec09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:33.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.780+0000 7f67f2df7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f67ec09e000 0x7f67ec130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:33.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.780+0000 7f67f2df7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f67ec09e410 0x7f67ec130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:33.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.780+0000 7f67f2df7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67ec09f520 con 0x7f67ec09e410 2023-10-01T07:59:33.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.780+0000 7f67f2df7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67ec09f130 con 0x7f67ec09e000 2023-10-01T07:59:33.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.780+0000 7f67f2df7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67ec09e930 con 0x7f67ec09d6f0 2023-10-01T07:59:33.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.780+0000 7f7a75589700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7a7009e410 0x7f7a70133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:33.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.781+0000 7f7a75589700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7a7009e410 0x7f7a70133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33178/0 (socket says 172.21.15.26:33178) 2023-10-01T07:59:33.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.781+0000 7f7a75589700 1 -- 172.21.15.26:0/1723888809 learned_addr learned my addr 172.21.15.26:0/1723888809 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:33.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.781+0000 7f7a74d88700 1 --2- 172.21.15.26:0/1723888809 >> v2:172.21.15.26:3300/0 conn(0x7f7a7009d6f0 0x7f7a7009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:33.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.781+0000 7f7a6ffff700 1 --2- 172.21.15.26:0/1723888809 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7a7009e000 0x7f7a701339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:33.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.781+0000 7f67ebfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f67ec09e000 0x7f67ec130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:33.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.781+0000 7f67ebfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f67ec09e000 0x7f67ec130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33192/0 (socket says 172.21.15.26:33192) 2023-10-01T07:59:33.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.781+0000 7f67ebfff700 1 -- 172.21.15.26:0/1296949150 learned_addr learned my addr 172.21.15.26:0/1296949150 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:33.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.781+0000 7f67f1394700 1 --2- 172.21.15.26:0/1296949150 >> v2:172.21.15.26:3300/0 conn(0x7f67ec09e410 0x7f67ec130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:33.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.781+0000 7f67f0b93700 1 --2- 172.21.15.26:0/1296949150 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f67ec09d6f0 0x7f67ec09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:33.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.781+0000 7f67ebfff700 1 -- 172.21.15.26:0/1296949150 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f67ec09d6f0 msgr2=0x7f67ec09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:33.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.781+0000 7f67ebfff700 1 --2- 172.21.15.26:0/1296949150 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f67ec09d6f0 0x7f67ec09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:33.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.781+0000 7f67ebfff700 1 -- 172.21.15.26:0/1296949150 >> v2:172.21.15.26:3300/0 conn(0x7f67ec09e410 msgr2=0x7f67ec130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:33.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.781+0000 7f67ebfff700 1 --2- 172.21.15.26:0/1296949150 >> v2:172.21.15.26:3300/0 conn(0x7f67ec09e410 0x7f67ec130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:33.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.781+0000 7f67ebfff700 1 -- 172.21.15.26:0/1296949150 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67ec09b2d0 con 0x7f67ec09e000 2023-10-01T07:59:33.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.781+0000 7f7a74d88700 1 -- 172.21.15.26:0/1723888809 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7a7009e000 msgr2=0x7f7a701339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:33.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.781+0000 7f7a74d88700 1 --2- 172.21.15.26:0/1723888809 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7a7009e000 0x7f7a701339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:33.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.781+0000 7f7a74d88700 1 -- 172.21.15.26:0/1723888809 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7a7009e410 msgr2=0x7f7a70133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:33.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.781+0000 7f7a74d88700 1 --2- 172.21.15.26:0/1723888809 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7a7009e410 0x7f7a70133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:33.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.781+0000 7f7a74d88700 1 -- 172.21.15.26:0/1723888809 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7009a500 con 0x7f7a7009d6f0 2023-10-01T07:59:33.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.781+0000 7f67ebfff700 1 --2- 172.21.15.26:0/1296949150 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f67ec09e000 0x7f67ec130660 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f67d8009920 tx=0x7f67d8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9799fac51dd7b2fe server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:33.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.781+0000 7f7a75589700 1 --2- 172.21.15.26:0/1723888809 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7a7009e410 0x7f7a70133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:33.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.782+0000 7f67eb7fe700 1 -- 172.21.15.26:0/1296949150 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d800ba20 con 0x7f67ec09e000 2023-10-01T07:59:33.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.782+0000 7f67eb7fe700 1 -- 172.21.15.26:0/1296949150 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d800bb80 con 0x7f67ec09e000 2023-10-01T07:59:33.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.782+0000 7f67eb7fe700 1 -- 172.21.15.26:0/1296949150 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d8009e70 con 0x7f67ec09e000 2023-10-01T07:59:33.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.782+0000 7f7a74d88700 1 --2- 172.21.15.26:0/1723888809 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a7009d6f0 0x7f7a7009dac0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f7a64009840 tx=0x7f7a64009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fdc1a99973e49ea server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:33.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.782+0000 7f7a6f7fe700 1 -- 172.21.15.26:0/1723888809 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a64011830 con 0x7f7a7009d6f0 2023-10-01T07:59:33.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.782+0000 7f7a6f7fe700 1 -- 172.21.15.26:0/1723888809 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a64011990 con 0x7f7a7009d6f0 2023-10-01T07:59:33.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.782+0000 7f7a6f7fe700 1 -- 172.21.15.26:0/1723888809 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a64011d20 con 0x7f7a7009d6f0 2023-10-01T07:59:33.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.783+0000 7f67f2df7700 1 -- 172.21.15.26:0/1296949150 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f67ec09e000 msgr2=0x7f67ec130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:33.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.783+0000 7f67f2df7700 1 --2- 172.21.15.26:0/1296949150 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f67ec09e000 0x7f67ec130660 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f67d8009920 tx=0x7f67d8009c30 comp rx=0 tx=0).stop 2023-10-01T07:59:33.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.783+0000 7f7a76fec700 1 -- 172.21.15.26:0/1723888809 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a7009d6f0 msgr2=0x7f7a7009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:33.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.783+0000 7f7a76fec700 1 --2- 172.21.15.26:0/1723888809 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a7009d6f0 0x7f7a7009dac0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f7a64009840 tx=0x7f7a64009b50 comp rx=0 tx=0).stop 2023-10-01T07:59:33.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.783+0000 7f67f2df7700 1 -- 172.21.15.26:0/1296949150 shutdown_connections 2023-10-01T07:59:33.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.783+0000 7f67f2df7700 1 --2- 172.21.15.26:0/1296949150 >> v2:172.21.15.26:3300/0 conn(0x7f67ec09e410 0x7f67ec130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:33.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.783+0000 7f67f2df7700 1 --2- 172.21.15.26:0/1296949150 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f67ec09d6f0 0x7f67ec09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:33.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.783+0000 7f67f2df7700 1 --2- 172.21.15.26:0/1296949150 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f67ec09e000 0x7f67ec130660 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:33.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.783+0000 7f67f2df7700 1 -- 172.21.15.26:0/1296949150 >> 172.21.15.26:0/1296949150 conn(0x7f67ec066f50 msgr2=0x7f67ec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:33.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.783+0000 7f7a76fec700 1 -- 172.21.15.26:0/1723888809 shutdown_connections 2023-10-01T07:59:33.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.783+0000 7f7a76fec700 1 --2- 172.21.15.26:0/1723888809 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7a7009e410 0x7f7a70133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:33.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.783+0000 7f7a76fec700 1 --2- 172.21.15.26:0/1723888809 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a7009d6f0 0x7f7a7009dac0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:33.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.783+0000 7f7a76fec700 1 --2- 172.21.15.26:0/1723888809 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7a7009e000 0x7f7a701339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:33.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.783+0000 7f7a76fec700 1 -- 172.21.15.26:0/1723888809 >> 172.21.15.26:0/1723888809 conn(0x7f7a70066f50 msgr2=0x7f7a7009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:33.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.783+0000 7f67f2df7700 1 -- 172.21.15.26:0/1296949150 shutdown_connections 2023-10-01T07:59:33.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.783+0000 7f7a76fec700 1 -- 172.21.15.26:0/1723888809 shutdown_connections 2023-10-01T07:59:33.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.783+0000 7f67f2df7700 1 -- 172.21.15.26:0/1296949150 wait complete. 2023-10-01T07:59:33.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.783+0000 7f7a76fec700 1 -- 172.21.15.26:0/1723888809 wait complete. 2023-10-01T07:59:33.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.784+0000 7f7a76fec700 1 Processor -- start 2023-10-01T07:59:33.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.784+0000 7f7a76fec700 1 -- start start 2023-10-01T07:59:33.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.784+0000 7f67f2df7700 1 Processor -- start 2023-10-01T07:59:33.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.785+0000 7f67f2df7700 1 -- start start 2023-10-01T07:59:33.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.785+0000 7f7a76fec700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a7009d6f0 0x7f7a701a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:33.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.785+0000 7f7a76fec700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7a7009e000 0x7f7a701a57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:33.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.785+0000 7f7a76fec700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7a7009e410 0x7f7a701c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:33.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.785+0000 7f7a76fec700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a701b9240 con 0x7f7a7009d6f0 2023-10-01T07:59:33.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.785+0000 7f7a76fec700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a701a6cb0 con 0x7f7a7009e000 2023-10-01T07:59:33.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.785+0000 7f7a76fec700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a701a4de0 con 0x7f7a7009e410 2023-10-01T07:59:33.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.785+0000 7f7a74d88700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a7009d6f0 0x7f7a701a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:33.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.785+0000 7f7a74d88700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a7009d6f0 0x7f7a701a5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36838/0 (socket says 172.21.15.26:36838) 2023-10-01T07:59:33.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.785+0000 7f7a74d88700 1 -- 172.21.15.26:0/3537579837 learned_addr learned my addr 172.21.15.26:0/3537579837 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:33.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.785+0000 7f7a75589700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7a7009e410 0x7f7a701c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:33.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.786+0000 7f7a75589700 1 -- 172.21.15.26:0/3537579837 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7a7009e000 msgr2=0x7f7a701a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:33.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.786+0000 7f7a75589700 1 --2- 172.21.15.26:0/3537579837 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7a7009e000 0x7f7a701a57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:33.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.786+0000 7f7a75589700 1 -- 172.21.15.26:0/3537579837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a7009d6f0 msgr2=0x7f7a701a5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:33.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.786+0000 7f7a75589700 1 --2- 172.21.15.26:0/3537579837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a7009d6f0 0x7f7a701a5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:33.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.786+0000 7f7a75589700 1 -- 172.21.15.26:0/3537579837 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a68009b30 con 0x7f7a7009e410 2023-10-01T07:59:33.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.786+0000 7f7a74d88700 1 --2- 172.21.15.26:0/3537579837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a7009d6f0 0x7f7a701a5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:33.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.786+0000 7f67f2df7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f67ec09d6f0 0x7f67ec130820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:33.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.786+0000 7f67f2df7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67ec09e000 0x7f67ec136340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:33.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.786+0000 7f67f2df7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f67ec09e410 0x7f67ec136880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:33.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.786+0000 7f67f2df7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67ec139e60 con 0x7f67ec09e000 2023-10-01T07:59:33.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.786+0000 7f67f2df7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67ec137f50 con 0x7f67ec09e410 2023-10-01T07:59:33.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.786+0000 7f67f2df7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67ec0a3b60 con 0x7f67ec09d6f0 2023-10-01T07:59:33.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.786+0000 7f67f0b93700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f67ec09d6f0 0x7f67ec130820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:33.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.786+0000 7f67ebfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67ec09e000 0x7f67ec136340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:33.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.786+0000 7f67f0b93700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f67ec09d6f0 0x7f67ec130820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56622/0 (socket says 172.21.15.26:56622) 2023-10-01T07:59:33.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.786+0000 7f67f0b93700 1 -- 172.21.15.26:0/1970025849 learned_addr learned my addr 172.21.15.26:0/1970025849 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:33.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.786+0000 7f7a75589700 1 --2- 172.21.15.26:0/3537579837 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7a7009e410 0x7f7a701c80e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7a68009e50 tx=0x7f7a6800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:33.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.786+0000 7f7a6d7fa700 1 -- 172.21.15.26:0/3537579837 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a68018070 con 0x7f7a7009e410 2023-10-01T07:59:33.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.786+0000 7f7a6d7fa700 1 -- 172.21.15.26:0/3537579837 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6800f040 con 0x7f7a7009e410 2023-10-01T07:59:33.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.786+0000 7f7a6d7fa700 1 -- 172.21.15.26:0/3537579837 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a68003c40 con 0x7f7a7009e410 2023-10-01T07:59:33.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.786+0000 7f67ebfff700 1 -- 172.21.15.26:0/1970025849 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f67ec09d6f0 msgr2=0x7f67ec130820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:33.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.786+0000 7f67ebfff700 1 --2- 172.21.15.26:0/1970025849 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f67ec09d6f0 0x7f67ec130820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:33.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.786+0000 7f67ebfff700 1 -- 172.21.15.26:0/1970025849 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f67ec09e410 msgr2=0x7f67ec136880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:33.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.786+0000 7f67ebfff700 1 --2- 172.21.15.26:0/1970025849 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f67ec09e410 0x7f67ec136880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:33.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.786+0000 7f67ebfff700 1 -- 172.21.15.26:0/1970025849 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d8009550 con 0x7f67ec09e000 2023-10-01T07:59:33.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.787+0000 7f67ebfff700 1 --2- 172.21.15.26:0/1970025849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67ec09e000 0x7f67ec136340 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f67d8016000 tx=0x7f67d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:33.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.787+0000 7f67e97fa700 1 -- 172.21.15.26:0/1970025849 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d8004400 con 0x7f67ec09e000 2023-10-01T07:59:33.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.786+0000 7f7a76fec700 1 -- 172.21.15.26:0/3537579837 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a640094a0 con 0x7f7a7009e410 2023-10-01T07:59:33.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.786+0000 7f7a76fec700 1 -- 172.21.15.26:0/3537579837 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a701a6a70 con 0x7f7a7009e410 2023-10-01T07:59:33.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.787+0000 7f67e97fa700 1 -- 172.21.15.26:0/1970025849 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d801f070 con 0x7f67ec09e000 2023-10-01T07:59:33.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.787+0000 7f67e97fa700 1 -- 172.21.15.26:0/1970025849 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d80038e0 con 0x7f67ec09e000 2023-10-01T07:59:33.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.788+0000 7f67f2df7700 1 -- 172.21.15.26:0/1970025849 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67ec09c760 con 0x7f67ec09e000 2023-10-01T07:59:33.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.788+0000 7f7a6d7fa700 1 -- 172.21.15.26:0/3537579837 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7a6800c930 con 0x7f7a7009e410 2023-10-01T07:59:33.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.788+0000 7f7a6d7fa700 1 -- 172.21.15.26:0/3537579837 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7a6803f7f0 con 0x7f7a7009e410 2023-10-01T07:59:33.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.788+0000 7f7a76fec700 1 -- 172.21.15.26:0/3537579837 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a701a7d90 con 0x7f7a7009e410 2023-10-01T07:59:33.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.788+0000 7f67f2df7700 1 -- 172.21.15.26:0/1970025849 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67ec130d60 con 0x7f67ec09e000 2023-10-01T07:59:33.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.789+0000 7f67e97fa700 1 -- 172.21.15.26:0/1970025849 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f67d8021030 con 0x7f67ec09e000 2023-10-01T07:59:33.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.789+0000 7f67f2df7700 1 -- 172.21.15.26:0/1970025849 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67ec074ea0 con 0x7f67ec09e000 2023-10-01T07:59:33.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.789+0000 7f67e97fa700 1 -- 172.21.15.26:0/1970025849 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f67d8040a20 con 0x7f67ec09e000 2023-10-01T07:59:33.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.793+0000 7f7a6d7fa700 1 -- 172.21.15.26:0/3537579837 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7a701a7d90 con 0x7f7a7009e410 2023-10-01T07:59:33.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.794+0000 7f67e97fa700 1 -- 172.21.15.26:0/1970025849 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f67d8015080 con 0x7f67ec09e000 2023-10-01T07:59:33.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.996+0000 7f7a76fec700 1 -- 172.21.15.26:0/3537579837 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7a701a7d90 con 0x7f7a7009e410 2023-10-01T07:59:33.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:33.996+0000 7f7a6d7fa700 1 -- 172.21.15.26:0/3537579837 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7a701a7d90 con 0x7f7a7009e410 2023-10-01T07:59:33.997 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:34.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.000+0000 7f7a76fec700 1 -- 172.21.15.26:0/3537579837 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7a7009e410 msgr2=0x7f7a701c80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:34.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.000+0000 7f7a76fec700 1 --2- 172.21.15.26:0/3537579837 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7a7009e410 0x7f7a701c80e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7a68009e50 tx=0x7f7a6800c3a0 comp rx=0 tx=0).stop 2023-10-01T07:59:34.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.000+0000 7f7a76fec700 1 -- 172.21.15.26:0/3537579837 shutdown_connections 2023-10-01T07:59:34.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.000+0000 7f7a76fec700 1 --2- 172.21.15.26:0/3537579837 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7a7009e410 0x7f7a701c80e0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:34.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.000+0000 7f7a76fec700 1 --2- 172.21.15.26:0/3537579837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a7009d6f0 0x7f7a701a5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:34.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.000+0000 7f7a76fec700 1 --2- 172.21.15.26:0/3537579837 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7a7009e000 0x7f7a701a57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:34.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.000+0000 7f7a76fec700 1 -- 172.21.15.26:0/3537579837 >> 172.21.15.26:0/3537579837 conn(0x7f7a70066f50 msgr2=0x7f7a7006f390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:34.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.000+0000 7f7a76fec700 1 -- 172.21.15.26:0/3537579837 shutdown_connections 2023-10-01T07:59:34.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.000+0000 7f7a76fec700 1 -- 172.21.15.26:0/3537579837 wait complete. 2023-10-01T07:59:34.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.004+0000 7f67f2df7700 1 -- 172.21.15.26:0/1970025849 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f67ec131010 con 0x7f67ec09e000 2023-10-01T07:59:34.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.004+0000 7f67e97fa700 1 -- 172.21.15.26:0/1970025849 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f67d8019770 con 0x7f67ec09e000 2023-10-01T07:59:34.005 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:34.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.007+0000 7f67f2df7700 1 -- 172.21.15.26:0/1970025849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67ec09e000 msgr2=0x7f67ec136340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:34.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.007+0000 7f67f2df7700 1 --2- 172.21.15.26:0/1970025849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67ec09e000 0x7f67ec136340 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f67d8016000 tx=0x7f67d8004750 comp rx=0 tx=0).stop 2023-10-01T07:59:34.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.007+0000 7f67f2df7700 1 -- 172.21.15.26:0/1970025849 shutdown_connections 2023-10-01T07:59:34.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.007+0000 7f67f2df7700 1 --2- 172.21.15.26:0/1970025849 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f67ec09e410 0x7f67ec136880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:34.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.007+0000 7f67f2df7700 1 --2- 172.21.15.26:0/1970025849 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f67ec09d6f0 0x7f67ec130820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:34.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.007+0000 7f67f2df7700 1 --2- 172.21.15.26:0/1970025849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67ec09e000 0x7f67ec136340 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:34.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.007+0000 7f67f2df7700 1 -- 172.21.15.26:0/1970025849 >> 172.21.15.26:0/1970025849 conn(0x7f67ec066f50 msgr2=0x7f67ec0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:34.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.007+0000 7f67f2df7700 1 -- 172.21.15.26:0/1970025849 shutdown_connections 2023-10-01T07:59:34.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.007+0000 7f67f2df7700 1 -- 172.21.15.26:0/1970025849 wait complete. 2023-10-01T07:59:34.022 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:34.022 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:34.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.024+0000 7f2d97de6700 1 -- 172.21.15.26:0/168714249 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2d9012af70 con 0x7f2d90130540 2023-10-01T07:59:34.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.024+0000 7f2d867fc700 1 -- 172.21.15.26:0/168714249 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d80017070 con 0x7f2d90130540 2023-10-01T07:59:34.025 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:34.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.026+0000 7f2d97de6700 1 -- 172.21.15.26:0/168714249 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d90130540 msgr2=0x7f2d901c6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:34.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.026+0000 7f2d97de6700 1 --2- 172.21.15.26:0/168714249 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d90130540 0x7f2d901c6930 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000c4b0 tx=0x7f2d8000c7c0 comp rx=0 tx=0).stop 2023-10-01T07:59:34.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.027+0000 7f2d97de6700 1 -- 172.21.15.26:0/168714249 shutdown_connections 2023-10-01T07:59:34.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.027+0000 7f2d97de6700 1 --2- 172.21.15.26:0/168714249 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d90130e50 0x7f2d90128420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:34.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.027+0000 7f2d97de6700 1 --2- 172.21.15.26:0/168714249 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d9006fcf0 0x7f2d901c63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:34.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.027+0000 7f2d97de6700 1 --2- 172.21.15.26:0/168714249 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d90130540 0x7f2d901c6930 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:34.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.027+0000 7f2d97de6700 1 -- 172.21.15.26:0/168714249 >> 172.21.15.26:0/168714249 conn(0x7f2d900a2aa0 msgr2=0x7f2d901270e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:34.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.027+0000 7f2d97de6700 1 -- 172.21.15.26:0/168714249 shutdown_connections 2023-10-01T07:59:34.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.027+0000 7f2d97de6700 1 -- 172.21.15.26:0/168714249 wait complete. 2023-10-01T07:59:34.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:34.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.042+0000 7f41efddc700 1 -- 172.21.15.26:0/3004001279 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f41e8074ea0 con 0x7f41e806acb0 2023-10-01T07:59:34.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.042+0000 7f41de7fc700 1 -- 172.21.15.26:0/3004001279 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f41e4021030 con 0x7f41e806acb0 2023-10-01T07:59:34.043 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:34.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.044+0000 7f41efddc700 1 -- 172.21.15.26:0/3004001279 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41e806acb0 msgr2=0x7f41e806e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:34.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.044+0000 7f41efddc700 1 --2- 172.21.15.26:0/3004001279 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41e806acb0 0x7f41e806e8e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f41e400e910 tx=0x7f41e400ec20 comp rx=0 tx=0).stop 2023-10-01T07:59:34.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.044+0000 7f41efddc700 1 -- 172.21.15.26:0/3004001279 shutdown_connections 2023-10-01T07:59:34.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.044+0000 7f41efddc700 1 --2- 172.21.15.26:0/3004001279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41e81316c0 0x7f41e806f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:34.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.044+0000 7f41efddc700 1 --2- 172.21.15.26:0/3004001279 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41e806acb0 0x7f41e806e8e0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:34.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.044+0000 7f41efddc700 1 --2- 172.21.15.26:0/3004001279 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41e809d9f0 0x7f41e806ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:34.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.044+0000 7f41efddc700 1 -- 172.21.15.26:0/3004001279 >> 172.21.15.26:0/3004001279 conn(0x7f41e8066f50 msgr2=0x7f41e812b180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:34.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.044+0000 7f41efddc700 1 -- 172.21.15.26:0/3004001279 shutdown_connections 2023-10-01T07:59:34.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:34.044+0000 7f41efddc700 1 -- 172.21.15.26:0/3004001279 wait complete. 2023-10-01T07:59:34.058 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:35.023 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:35.026 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:35.042 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:35.059 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:35.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.187+0000 7fd07af0d700 1 Processor -- start 2023-10-01T07:59:35.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.188+0000 7fd07af0d700 1 -- start start 2023-10-01T07:59:35.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.188+0000 7fd07af0d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd07406b250 0x7fd074136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:35.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.188+0000 7fd07af0d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd074136d80 0x7fd074139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:35.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.188+0000 7fb40a7c1700 1 Processor -- start 2023-10-01T07:59:35.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.188+0000 7fd07af0d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd07409ece0 con 0x7fd07406a770 2023-10-01T07:59:35.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.188+0000 7fd07af0d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd07409e760 con 0x7fd07406b250 2023-10-01T07:59:35.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.188+0000 7fd07af0d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd07409e040 con 0x7fd074136d80 2023-10-01T07:59:35.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.188+0000 7fb40a7c1700 1 -- start start 2023-10-01T07:59:35.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.188+0000 7fd0794aa700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd074136d80 0x7fd074139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:35.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.188+0000 7fd0794aa700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd074136d80 0x7fd074139160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56630/0 (socket says 172.21.15.26:56630) 2023-10-01T07:59:35.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.188+0000 7fd0794aa700 1 -- 172.21.15.26:0/4208231781 learned_addr learned my addr 172.21.15.26:0/4208231781 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:35.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.189+0000 7fd073fff700 1 --2- 172.21.15.26:0/4208231781 >> v2:172.21.15.26:3300/0 conn(0x7fd07406b250 0x7fd074136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:35.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.189+0000 7fb40a7c1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb40406f5d0 0x7fb40412ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:35.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.189+0000 7fb40a7c1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb404135c20 0x7fb404138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:35.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.189+0000 7fb40a7c1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb40406fa40 con 0x7fb40412cf60 2023-10-01T07:59:35.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.189+0000 7fb40a7c1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb40412cd90 con 0x7fb40406f5d0 2023-10-01T07:59:35.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.189+0000 7fb40a7c1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb404071780 con 0x7fb404135c20 2023-10-01T07:59:35.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.189+0000 7fd0794aa700 1 -- 172.21.15.26:0/4208231781 >> v2:172.21.15.26:3300/0 conn(0x7fd07406b250 msgr2=0x7fd074136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:35.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.189+0000 7fd0794aa700 1 --2- 172.21.15.26:0/4208231781 >> v2:172.21.15.26:3300/0 conn(0x7fd07406b250 0x7fd074136840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:35.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.189+0000 7fd0794aa700 1 -- 172.21.15.26:0/4208231781 >> v1:172.21.15.26:6789/0 conn(0x7fd07406a770 legacy=0x7fd07406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:35.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.189+0000 7fd0794aa700 1 -- 172.21.15.26:0/4208231781 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd07409f630 con 0x7fd074136d80 2023-10-01T07:59:35.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.189+0000 7fb408d5e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb404135c20 0x7fb404138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:35.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.189+0000 7fb408d5e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb404135c20 0x7fb404138000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33210/0 (socket says 172.21.15.26:33210) 2023-10-01T07:59:35.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.189+0000 7fb408d5e700 1 -- 172.21.15.26:0/314316856 learned_addr learned my addr 172.21.15.26:0/314316856 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:35.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.189+0000 7fd0794aa700 1 --2- 172.21.15.26:0/4208231781 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd074136d80 0x7fd074139160 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd06c009e50 tx=0x7fd06c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf7631f1f3bcab3f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:35.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.189+0000 7fb4037fe700 1 --2- 172.21.15.26:0/314316856 >> v2:172.21.15.26:3300/0 conn(0x7fb40406f5d0 0x7fb40412ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:35.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.189+0000 7fb408d5e700 1 -- 172.21.15.26:0/314316856 >> v2:172.21.15.26:3300/0 conn(0x7fb40406f5d0 msgr2=0x7fb40412ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:35.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.189+0000 7fd0737fe700 1 -- 172.21.15.26:0/4208231781 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06c00e070 con 0x7fd074136d80 2023-10-01T07:59:35.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.190+0000 7fb408d5e700 1 --2- 172.21.15.26:0/314316856 >> v2:172.21.15.26:3300/0 conn(0x7fb40406f5d0 0x7fb40412ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:35.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.190+0000 7fb408d5e700 1 -- 172.21.15.26:0/314316856 >> v1:172.21.15.26:6789/0 conn(0x7fb40412cf60 legacy=0x7fb40412f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:35.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.190+0000 7fb408d5e700 1 -- 172.21.15.26:0/314316856 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb404071a40 con 0x7fb404135c20 2023-10-01T07:59:35.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.190+0000 7fb4037fe700 1 --2- 172.21.15.26:0/314316856 >> v2:172.21.15.26:3300/0 conn(0x7fb40406f5d0 0x7fb40412ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:59:35.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.190+0000 7fd0737fe700 1 -- 172.21.15.26:0/4208231781 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd06c00b910 con 0x7fd074136d80 2023-10-01T07:59:35.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.190+0000 7fd0737fe700 1 -- 172.21.15.26:0/4208231781 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06c00bcc0 con 0x7fd074136d80 2023-10-01T07:59:35.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.190+0000 7fb408d5e700 1 --2- 172.21.15.26:0/314316856 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb404135c20 0x7fb404138000 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc009e50 tx=0x7fb3fc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62a3a6d241ad5c20 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:35.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.190+0000 7fd07af0d700 1 -- 172.21.15.26:0/4208231781 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd074136d80 msgr2=0x7fd074139160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:35.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.190+0000 7fd07af0d700 1 --2- 172.21.15.26:0/4208231781 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd074136d80 0x7fd074139160 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd06c009e50 tx=0x7fd06c00b330 comp rx=0 tx=0).stop 2023-10-01T07:59:35.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.190+0000 7fd07af0d700 1 -- 172.21.15.26:0/4208231781 shutdown_connections 2023-10-01T07:59:35.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.190+0000 7fd07af0d700 1 --2- 172.21.15.26:0/4208231781 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd074136d80 0x7fd074139160 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:35.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.190+0000 7fd07af0d700 1 --2- 172.21.15.26:0/4208231781 >> v2:172.21.15.26:3300/0 conn(0x7fd07406b250 0x7fd074136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:35.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.191+0000 7fd07af0d700 1 -- 172.21.15.26:0/4208231781 >> 172.21.15.26:0/4208231781 conn(0x7fd074066f50 msgr2=0x7fd07409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:35.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.191+0000 7fd07af0d700 1 -- 172.21.15.26:0/4208231781 shutdown_connections 2023-10-01T07:59:35.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.191+0000 7fb402ffd700 1 -- 172.21.15.26:0/314316856 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc00e070 con 0x7fb404135c20 2023-10-01T07:59:35.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.191+0000 7fd07af0d700 1 -- 172.21.15.26:0/4208231781 wait complete. 2023-10-01T07:59:35.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.191+0000 7fb402ffd700 1 -- 172.21.15.26:0/314316856 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3fc003a20 con 0x7fb404135c20 2023-10-01T07:59:35.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.191+0000 7fb402ffd700 1 -- 172.21.15.26:0/314316856 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc003dd0 con 0x7fb404135c20 2023-10-01T07:59:35.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.192+0000 7fd07af0d700 1 Processor -- start 2023-10-01T07:59:35.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.192+0000 7fb40a7c1700 1 -- 172.21.15.26:0/314316856 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb404135c20 msgr2=0x7fb404138000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:35.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.192+0000 7fb40a7c1700 1 --2- 172.21.15.26:0/314316856 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb404135c20 0x7fb404138000 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc009e50 tx=0x7fb3fc00b330 comp rx=0 tx=0).stop 2023-10-01T07:59:35.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.192+0000 7fb40a7c1700 1 -- 172.21.15.26:0/314316856 shutdown_connections 2023-10-01T07:59:35.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.192+0000 7fb40a7c1700 1 --2- 172.21.15.26:0/314316856 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb404135c20 0x7fb404138000 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:35.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.192+0000 7fb40a7c1700 1 --2- 172.21.15.26:0/314316856 >> v2:172.21.15.26:3300/0 conn(0x7fb40406f5d0 0x7fb40412ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:35.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.192+0000 7fb40a7c1700 1 -- 172.21.15.26:0/314316856 >> 172.21.15.26:0/314316856 conn(0x7fb4040a2aa0 msgr2=0x7fb4040a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:35.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.192+0000 7fb40a7c1700 1 -- 172.21.15.26:0/314316856 shutdown_connections 2023-10-01T07:59:35.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.192+0000 7fb40a7c1700 1 -- 172.21.15.26:0/314316856 wait complete. 2023-10-01T07:59:35.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.192+0000 7fd07af0d700 1 -- start start 2023-10-01T07:59:35.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.192+0000 7fd07af0d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd07406a770 0x7fd07411d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:35.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.193+0000 7fd07af0d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd07406b250 0x7fd07411d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:35.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.193+0000 7fd07af0d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd074136d80 0x7fd0741c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:35.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.193+0000 7fd07af0d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07411cd50 con 0x7fd07406a770 2023-10-01T07:59:35.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.193+0000 7fd07af0d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd07411fbb0 con 0x7fd07406b250 2023-10-01T07:59:35.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.193+0000 7fd07af0d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd074071e60 con 0x7fd074136d80 2023-10-01T07:59:35.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.193+0000 7fb40a7c1700 1 Processor -- start 2023-10-01T07:59:35.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.194+0000 7fd073fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd07406b250 0x7fd07411d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:35.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.194+0000 7fd073fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd07406b250 0x7fd07411d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33212/0 (socket says 172.21.15.26:33212) 2023-10-01T07:59:35.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.194+0000 7fd073fff700 1 -- 172.21.15.26:0/3049005183 learned_addr learned my addr 172.21.15.26:0/3049005183 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:35.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.194+0000 7fb40a7c1700 1 -- start start 2023-10-01T07:59:35.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.194+0000 7fd073fff700 1 -- 172.21.15.26:0/3049005183 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd074136d80 msgr2=0x7fd0741c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:35.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.194+0000 7fd073fff700 1 --2- 172.21.15.26:0/3049005183 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd074136d80 0x7fd0741c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:35.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.194+0000 7fd073fff700 1 -- 172.21.15.26:0/3049005183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd07406a770 msgr2=0x7fd07411d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:35.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.194+0000 7fd073fff700 1 --2- 172.21.15.26:0/3049005183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd07406a770 0x7fd07411d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:35.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.194+0000 7fd073fff700 1 -- 172.21.15.26:0/3049005183 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06c009b30 con 0x7fd07406b250 2023-10-01T07:59:35.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.194+0000 7fd073fff700 1 --2- 172.21.15.26:0/3049005183 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd07406b250 0x7fd07411d5b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fd06000e9b0 tx=0x7fd06000ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:35.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.194+0000 7fb40a7c1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb40406f5d0 0x7fb404129120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:35.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.194+0000 7fb40a7c1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb40412cf60 0x7fb404129660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:35.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.194+0000 7fb40a7c1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb404135c20 0x7fb404138540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:35.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.194+0000 7fb40a7c1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4041397c0 con 0x7fb40412cf60 2023-10-01T07:59:35.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.194+0000 7fb40a7c1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb404133250 con 0x7fb404135c20 2023-10-01T07:59:35.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.194+0000 7fb40a7c1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb404133480 con 0x7fb40406f5d0 2023-10-01T07:59:35.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.195+0000 7fd0717fa700 1 -- 172.21.15.26:0/3049005183 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06000c850 con 0x7fd07406b250 2023-10-01T07:59:35.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.195+0000 7fd0717fa700 1 -- 172.21.15.26:0/3049005183 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd06000c9b0 con 0x7fd07406b250 2023-10-01T07:59:35.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.195+0000 7fd0717fa700 1 -- 172.21.15.26:0/3049005183 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06000cd20 con 0x7fd07406b250 2023-10-01T07:59:35.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.195+0000 7fd07af0d700 1 -- 172.21.15.26:0/3049005183 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd07411ee40 con 0x7fd07406b250 2023-10-01T07:59:35.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.195+0000 7fb408d5e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb404135c20 0x7fb404138540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:35.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.195+0000 7fb403fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb40406f5d0 0x7fb404129120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:35.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.195+0000 7fb408d5e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb404135c20 0x7fb404138540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33220/0 (socket says 172.21.15.26:33220) 2023-10-01T07:59:35.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.195+0000 7fb408d5e700 1 -- 172.21.15.26:0/3111192639 learned_addr learned my addr 172.21.15.26:0/3111192639 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:35.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.195+0000 7fd07af0d700 1 -- 172.21.15.26:0/3049005183 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd07411daf0 con 0x7fd07406b250 2023-10-01T07:59:35.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.195+0000 7fb408d5e700 1 -- 172.21.15.26:0/3111192639 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb40406f5d0 msgr2=0x7fb404129120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:35.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.195+0000 7fb408d5e700 1 --2- 172.21.15.26:0/3111192639 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb40406f5d0 0x7fb404129120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:35.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.195+0000 7fb408d5e700 1 -- 172.21.15.26:0/3111192639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb40412cf60 msgr2=0x7fb404129660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:35.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.195+0000 7fb408d5e700 1 --2- 172.21.15.26:0/3111192639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb40412cf60 0x7fb404129660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:35.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.195+0000 7fb408d5e700 1 -- 172.21.15.26:0/3111192639 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3fc009b30 con 0x7fb404135c20 2023-10-01T07:59:35.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.196+0000 7fb408d5e700 1 --2- 172.21.15.26:0/3111192639 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb404135c20 0x7fb404138540 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc004000 tx=0x7fb3fc004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:35.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.196+0000 7fd07af0d700 1 -- 172.21.15.26:0/3049005183 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd074074ea0 con 0x7fd07406b250 2023-10-01T07:59:35.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.196+0000 7fd0717fa700 1 -- 172.21.15.26:0/3049005183 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd060013470 con 0x7fd07406b250 2023-10-01T07:59:35.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.196+0000 7fd0717fa700 1 -- 172.21.15.26:0/3049005183 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd06003f900 con 0x7fd07406b250 2023-10-01T07:59:35.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.196+0000 7fb400ff9700 1 -- 172.21.15.26:0/3111192639 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc004240 con 0x7fb404135c20 2023-10-01T07:59:35.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.196+0000 7fb400ff9700 1 -- 172.21.15.26:0/3111192639 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3fc0043c0 con 0x7fb404135c20 2023-10-01T07:59:35.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.196+0000 7fb400ff9700 1 -- 172.21.15.26:0/3111192639 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc004770 con 0x7fb404135c20 2023-10-01T07:59:35.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.196+0000 7fb40a7c1700 1 -- 172.21.15.26:0/3111192639 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb404139980 con 0x7fb404135c20 2023-10-01T07:59:35.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.196+0000 7fb40a7c1700 1 -- 172.21.15.26:0/3111192639 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb404139bf0 con 0x7fb404135c20 2023-10-01T07:59:35.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.198+0000 7fb40a7c1700 1 -- 172.21.15.26:0/3111192639 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb40406d5a0 con 0x7fb404135c20 2023-10-01T07:59:35.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.202+0000 7fd0717fa700 1 -- 172.21.15.26:0/3049005183 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd0600232f0 con 0x7fd07406b250 2023-10-01T07:59:35.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.202+0000 7fb400ff9700 1 -- 172.21.15.26:0/3111192639 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb3fc019070 con 0x7fb404135c20 2023-10-01T07:59:35.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.203+0000 7fb400ff9700 1 -- 172.21.15.26:0/3111192639 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb3fc040910 con 0x7fb404135c20 2023-10-01T07:59:35.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.207+0000 7fb400ff9700 1 -- 172.21.15.26:0/3111192639 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb3fc019320 con 0x7fb404135c20 2023-10-01T07:59:35.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.220+0000 7f82b260e700 1 Processor -- start 2023-10-01T07:59:35.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.220+0000 7f82b260e700 1 -- start start 2023-10-01T07:59:35.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.221+0000 7f82b260e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82ac09e930 0x7f82ac09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:35.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.221+0000 7f82b260e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82ac09f650 0x7f82ac131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:35.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.221+0000 7f82b260e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82ac070940 con 0x7f82ac09f240 2023-10-01T07:59:35.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.221+0000 7f82b260e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82ac06fd60 con 0x7f82ac09e930 2023-10-01T07:59:35.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.221+0000 7f82b260e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82ac06fa80 con 0x7f82ac09f650 2023-10-01T07:59:35.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.221+0000 7f82ab7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f82ac09f240 0x7f82ac1317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56258/0 (socket says 172.21.15.26:56258) 2023-10-01T07:59:35.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.221+0000 7f82ab7fe700 1 -- 172.21.15.26:0/3400839098 learned_addr learned my addr 172.21.15.26:0/3400839098 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:59:35.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.221+0000 7f82b0bab700 1 --2- 172.21.15.26:0/3400839098 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82ac09f650 0x7f82ac131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:35.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.222+0000 7f82b0bab700 1 -- 172.21.15.26:0/3400839098 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82ac09e930 msgr2=0x7f82ac09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:35.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.222+0000 7f82b0bab700 1 --2- 172.21.15.26:0/3400839098 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82ac09e930 0x7f82ac09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:35.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.222+0000 7f82b0bab700 1 -- 172.21.15.26:0/3400839098 >> v1:172.21.15.26:6789/0 conn(0x7f82ac09f240 legacy=0x7f82ac1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:35.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.222+0000 7f82aaffd700 1 -- 172.21.15.26:0/3400839098 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2154575216 0 0) 0x7f82ac070940 con 0x7f82ac09f240 2023-10-01T07:59:35.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.222+0000 7f82b0bab700 1 -- 172.21.15.26:0/3400839098 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ac09fb60 con 0x7f82ac09f650 2023-10-01T07:59:35.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.222+0000 7f82b0bab700 1 --2- 172.21.15.26:0/3400839098 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82ac09f650 0x7f82ac131f00 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f82a4009dc0 tx=0x7f82a400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd55f1a1b5808e3b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:35.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.222+0000 7f82aaffd700 1 -- 172.21.15.26:0/3400839098 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a400e070 con 0x7f82ac09f650 2023-10-01T07:59:35.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.222+0000 7f82aaffd700 1 -- 172.21.15.26:0/3400839098 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a400bbd0 con 0x7f82ac09f650 2023-10-01T07:59:35.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.222+0000 7f82aaffd700 1 -- 172.21.15.26:0/3400839098 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a4012430 con 0x7f82ac09f650 2023-10-01T07:59:35.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.223+0000 7f82b260e700 1 -- 172.21.15.26:0/3400839098 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82ac09f650 msgr2=0x7f82ac131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:35.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.223+0000 7f82b260e700 1 --2- 172.21.15.26:0/3400839098 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82ac09f650 0x7f82ac131f00 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f82a4009dc0 tx=0x7f82a400b330 comp rx=0 tx=0).stop 2023-10-01T07:59:35.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.223+0000 7f82b260e700 1 -- 172.21.15.26:0/3400839098 shutdown_connections 2023-10-01T07:59:35.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.223+0000 7f82b260e700 1 --2- 172.21.15.26:0/3400839098 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82ac09f650 0x7f82ac131f00 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:35.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.223+0000 7f82b260e700 1 --2- 172.21.15.26:0/3400839098 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82ac09e930 0x7f82ac09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:35.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.223+0000 7f82b260e700 1 -- 172.21.15.26:0/3400839098 >> 172.21.15.26:0/3400839098 conn(0x7f82ac0a4210 msgr2=0x7f82ac0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:35.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.223+0000 7f82b260e700 1 -- 172.21.15.26:0/3400839098 shutdown_connections 2023-10-01T07:59:35.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.223+0000 7f82b260e700 1 -- 172.21.15.26:0/3400839098 wait complete. 2023-10-01T07:59:35.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.224+0000 7f82b260e700 1 Processor -- start 2023-10-01T07:59:35.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.224+0000 7f82b260e700 1 -- start start 2023-10-01T07:59:35.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.225+0000 7f82b260e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82ac09e930 0x7f82ac1c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:35.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.225+0000 7f82b260e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82ac09f240 0x7f82ac1c8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:35.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.225+0000 7f82b260e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82ac09f650 0x7f82ac1c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:35.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.225+0000 7f82b260e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82ac1a8350 con 0x7f82ac09e930 2023-10-01T07:59:35.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.225+0000 7f82b260e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82ac1a6640 con 0x7f82ac09f650 2023-10-01T07:59:35.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.225+0000 7f82b260e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82ac0a31d0 con 0x7f82ac09f240 2023-10-01T07:59:35.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.225+0000 7f82ab7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82ac09f240 0x7f82ac1c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:35.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.225+0000 7f82b0bab700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82ac09f650 0x7f82ac1c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:35.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.225+0000 7f82abfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82ac09e930 0x7f82ac1c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:35.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.225+0000 7f82ab7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82ac09f240 0x7f82ac1c8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56662/0 (socket says 172.21.15.26:56662) 2023-10-01T07:59:35.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.225+0000 7f82ab7fe700 1 -- 172.21.15.26:0/3859202176 learned_addr learned my addr 172.21.15.26:0/3859202176 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:35.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.225+0000 7f82b0bab700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82ac09f650 0x7f82ac1c8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33244/0 (socket says 172.21.15.26:33244) 2023-10-01T07:59:35.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.226+0000 7f82ab7fe700 1 -- 172.21.15.26:0/3859202176 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82ac09f650 msgr2=0x7f82ac1c8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:35.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.226+0000 7f82ab7fe700 1 --2- 172.21.15.26:0/3859202176 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82ac09f650 0x7f82ac1c8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:35.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.226+0000 7f82ab7fe700 1 -- 172.21.15.26:0/3859202176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82ac09e930 msgr2=0x7f82ac1c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:35.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.226+0000 7f82ab7fe700 1 --2- 172.21.15.26:0/3859202176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82ac09e930 0x7f82ac1c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:35.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.226+0000 7f82ab7fe700 1 -- 172.21.15.26:0/3859202176 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a4009a70 con 0x7f82ac09f240 2023-10-01T07:59:35.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.226+0000 7f82ab7fe700 1 --2- 172.21.15.26:0/3859202176 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82ac09f240 0x7f82ac1c8670 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f82a000c520 tx=0x7f82a000c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:35.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.226+0000 7f82a8ff9700 1 -- 172.21.15.26:0/3859202176 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a0004a80 con 0x7f82ac09f240 2023-10-01T07:59:35.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.226+0000 7f82a8ff9700 1 -- 172.21.15.26:0/3859202176 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a0004be0 con 0x7f82ac09f240 2023-10-01T07:59:35.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.226+0000 7f82b260e700 1 -- 172.21.15.26:0/3859202176 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82ac0a0190 con 0x7f82ac09f240 2023-10-01T07:59:35.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.226+0000 7f599ff04700 1 Processor -- start 2023-10-01T07:59:35.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.226+0000 7f82a8ff9700 1 -- 172.21.15.26:0/3859202176 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a00070d0 con 0x7f82ac09f240 2023-10-01T07:59:35.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.227+0000 7f599ff04700 1 -- start start 2023-10-01T07:59:35.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.226+0000 7f82b260e700 1 -- 172.21.15.26:0/3859202176 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82ac1a8ce0 con 0x7f82ac09f240 2023-10-01T07:59:35.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.227+0000 7f599ff04700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f599809a7a0 0x7f599812cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:35.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.227+0000 7f599ff04700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f599812d0a0 0x7f599812f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:35.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.227+0000 7f82b260e700 1 -- 172.21.15.26:0/3859202176 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82ac1a7eb0 con 0x7f82ac09f240 2023-10-01T07:59:35.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.227+0000 7f82a8ff9700 1 -- 172.21.15.26:0/3859202176 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f82a0007230 con 0x7f82ac09f240 2023-10-01T07:59:35.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.228+0000 7f82a8ff9700 1 -- 172.21.15.26:0/3859202176 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f82a00501b0 con 0x7f82ac09f240 2023-10-01T07:59:35.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.228+0000 7f599dca0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f599809a7a0 0x7f599812cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:35.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.228+0000 7f599ff04700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5998099ce0 con 0x7f599806fec0 2023-10-01T07:59:35.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.228+0000 7f599ff04700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f599809ab70 con 0x7f599809a7a0 2023-10-01T07:59:35.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.228+0000 7f599ff04700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5998068320 con 0x7f599812d0a0 2023-10-01T07:59:35.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.228+0000 7f599dca0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f599809a7a0 0x7f599812cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36912/0 (socket says 172.21.15.26:36912) 2023-10-01T07:59:35.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.228+0000 7f599dca0700 1 -- 172.21.15.26:0/3426529063 learned_addr learned my addr 172.21.15.26:0/3426529063 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:35.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.228+0000 7f599d49f700 1 --2- 172.21.15.26:0/3426529063 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f599812d0a0 0x7f599812f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:35.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.228+0000 7f599dca0700 1 -- 172.21.15.26:0/3426529063 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f599812d0a0 msgr2=0x7f599812f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:35.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.228+0000 7f599dca0700 1 --2- 172.21.15.26:0/3426529063 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f599812d0a0 0x7f599812f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:35.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.228+0000 7f599dca0700 1 -- 172.21.15.26:0/3426529063 >> v1:172.21.15.26:6789/0 conn(0x7f599806fec0 legacy=0x7f5998067c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:35.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.228+0000 7f599dca0700 1 -- 172.21.15.26:0/3426529063 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5998099fa0 con 0x7f599809a7a0 2023-10-01T07:59:35.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.228+0000 7f599dca0700 1 --2- 172.21.15.26:0/3426529063 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f599809a7a0 0x7f599812cb60 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f5988009920 tx=0x7f5988009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f404a77aeb1b2de server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:35.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.228+0000 7f599cc9e700 1 -- 172.21.15.26:0/3426529063 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5988004230 con 0x7f599809a7a0 2023-10-01T07:59:35.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.229+0000 7f599cc9e700 1 -- 172.21.15.26:0/3426529063 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5988004390 con 0x7f599809a7a0 2023-10-01T07:59:35.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.229+0000 7f599cc9e700 1 -- 172.21.15.26:0/3426529063 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5988009e70 con 0x7f599809a7a0 2023-10-01T07:59:35.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.230+0000 7f599ff04700 1 -- 172.21.15.26:0/3426529063 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f599809a7a0 msgr2=0x7f599812cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:35.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.230+0000 7f599ff04700 1 --2- 172.21.15.26:0/3426529063 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f599809a7a0 0x7f599812cb60 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f5988009920 tx=0x7f5988009c30 comp rx=0 tx=0).stop 2023-10-01T07:59:35.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.230+0000 7f599ff04700 1 -- 172.21.15.26:0/3426529063 shutdown_connections 2023-10-01T07:59:35.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.230+0000 7f599ff04700 1 --2- 172.21.15.26:0/3426529063 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f599809a7a0 0x7f599812cb60 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:35.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.230+0000 7f599ff04700 1 --2- 172.21.15.26:0/3426529063 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f599812d0a0 0x7f599812f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:35.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.230+0000 7f599ff04700 1 -- 172.21.15.26:0/3426529063 >> 172.21.15.26:0/3426529063 conn(0x7f59980a2610 msgr2=0x7f59980a2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:35.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.231+0000 7f599ff04700 1 -- 172.21.15.26:0/3426529063 shutdown_connections 2023-10-01T07:59:35.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.231+0000 7f599ff04700 1 -- 172.21.15.26:0/3426529063 wait complete. 2023-10-01T07:59:35.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.231+0000 7f599ff04700 1 Processor -- start 2023-10-01T07:59:35.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.232+0000 7f599ff04700 1 -- start start 2023-10-01T07:59:35.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.232+0000 7f599ff04700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f599806fec0 0x7f59981c9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:35.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.232+0000 7f599ff04700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f599809a7a0 0x7f59981c3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:35.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.232+0000 7f599ff04700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f599812d0a0 0x7f59981c4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:35.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.232+0000 7f599ff04700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599811aa80 con 0x7f599806fec0 2023-10-01T07:59:35.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.232+0000 7f599ff04700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5998129f30 con 0x7f599809a7a0 2023-10-01T07:59:35.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.232+0000 7f599ff04700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f599811b6e0 con 0x7f599812d0a0 2023-10-01T07:59:35.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.232+0000 7f599dca0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f599806fec0 0x7f59981c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:35.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.232+0000 7f599dca0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f599806fec0 0x7f59981c9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36924/0 (socket says 172.21.15.26:36924) 2023-10-01T07:59:35.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.232+0000 7f599dca0700 1 -- 172.21.15.26:0/3465861940 learned_addr learned my addr 172.21.15.26:0/3465861940 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:35.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.232+0000 7f599e4a1700 1 --2- 172.21.15.26:0/3465861940 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f599812d0a0 0x7f59981c4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:35.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.233+0000 7f599dca0700 1 -- 172.21.15.26:0/3465861940 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f599812d0a0 msgr2=0x7f59981c4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:35.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.233+0000 7f599dca0700 1 --2- 172.21.15.26:0/3465861940 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f599812d0a0 0x7f59981c4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:35.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.233+0000 7f599dca0700 1 -- 172.21.15.26:0/3465861940 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f599809a7a0 msgr2=0x7f59981c3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:35.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.233+0000 7f599dca0700 1 --2- 172.21.15.26:0/3465861940 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f599809a7a0 0x7f59981c3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:35.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.233+0000 7f599dca0700 1 -- 172.21.15.26:0/3465861940 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5988009550 con 0x7f599806fec0 2023-10-01T07:59:35.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.233+0000 7f599dca0700 1 --2- 172.21.15.26:0/3465861940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f599806fec0 0x7f59981c9580 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f5988009870 tx=0x7f5988004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:35.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.233+0000 7f598e7fc700 1 -- 172.21.15.26:0/3465861940 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598800bba0 con 0x7f599806fec0 2023-10-01T07:59:35.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.233+0000 7f598e7fc700 1 -- 172.21.15.26:0/3465861940 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598801f070 con 0x7f599806fec0 2023-10-01T07:59:35.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.233+0000 7f598e7fc700 1 -- 172.21.15.26:0/3465861940 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59880036a0 con 0x7f599806fec0 2023-10-01T07:59:35.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.233+0000 7f599ff04700 1 -- 172.21.15.26:0/3465861940 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59981299b0 con 0x7f599806fec0 2023-10-01T07:59:35.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.233+0000 7f599ff04700 1 -- 172.21.15.26:0/3465861940 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5998118cc0 con 0x7f599806fec0 2023-10-01T07:59:35.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.234+0000 7f82a8ff9700 1 -- 172.21.15.26:0/3859202176 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f82a00074e0 con 0x7f82ac09f240 2023-10-01T07:59:35.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.234+0000 7f598e7fc700 1 -- 172.21.15.26:0/3465861940 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5988021030 con 0x7f599806fec0 2023-10-01T07:59:35.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.234+0000 7f598e7fc700 1 -- 172.21.15.26:0/3465861940 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5988040a50 con 0x7f599806fec0 2023-10-01T07:59:35.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.235+0000 7f599ff04700 1 -- 172.21.15.26:0/3465861940 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5998071c70 con 0x7f599806fec0 2023-10-01T07:59:35.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.243+0000 7f598e7fc700 1 -- 172.21.15.26:0/3465861940 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5998071c70 con 0x7f599806fec0 2023-10-01T07:59:35.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.423+0000 7fd07af0d700 1 -- 172.21.15.26:0/3049005183 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd07406c360 con 0x7fd07406b250 2023-10-01T07:59:35.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.424+0000 7fd0717fa700 1 -- 172.21.15.26:0/3049005183 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd06001a360 con 0x7fd07406b250 2023-10-01T07:59:35.424 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:35.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.426+0000 7fd07af0d700 1 -- 172.21.15.26:0/3049005183 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd07406b250 msgr2=0x7fd07411d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:35.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.426+0000 7fd07af0d700 1 --2- 172.21.15.26:0/3049005183 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd07406b250 0x7fd07411d5b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fd06000e9b0 tx=0x7fd06000ed70 comp rx=0 tx=0).stop 2023-10-01T07:59:35.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.426+0000 7fd07af0d700 1 -- 172.21.15.26:0/3049005183 shutdown_connections 2023-10-01T07:59:35.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.426+0000 7fd07af0d700 1 --2- 172.21.15.26:0/3049005183 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd074136d80 0x7fd0741c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:35.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.426+0000 7fd07af0d700 1 --2- 172.21.15.26:0/3049005183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd07406a770 0x7fd07411d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:35.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.426+0000 7fd07af0d700 1 --2- 172.21.15.26:0/3049005183 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd07406b250 0x7fd07411d5b0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:35.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.426+0000 7fd07af0d700 1 -- 172.21.15.26:0/3049005183 >> 172.21.15.26:0/3049005183 conn(0x7fd074066f50 msgr2=0x7fd0740a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:35.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.426+0000 7fd07af0d700 1 -- 172.21.15.26:0/3049005183 shutdown_connections 2023-10-01T07:59:35.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.426+0000 7fd07af0d700 1 -- 172.21.15.26:0/3049005183 wait complete. 2023-10-01T07:59:35.442 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:35.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.444+0000 7f82b260e700 1 -- 172.21.15.26:0/3859202176 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f82ac074ea0 con 0x7f82ac09f240 2023-10-01T07:59:35.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.444+0000 7f82a8ff9700 1 -- 172.21.15.26:0/3859202176 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f82a002c340 con 0x7f82ac09f240 2023-10-01T07:59:35.445 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:35.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.447+0000 7f82b260e700 1 -- 172.21.15.26:0/3859202176 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82ac09f240 msgr2=0x7f82ac1c8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:35.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.447+0000 7f82b260e700 1 --2- 172.21.15.26:0/3859202176 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82ac09f240 0x7f82ac1c8670 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f82a000c520 tx=0x7f82a000c830 comp rx=0 tx=0).stop 2023-10-01T07:59:35.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.447+0000 7f82b260e700 1 -- 172.21.15.26:0/3859202176 shutdown_connections 2023-10-01T07:59:35.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.447+0000 7f82b260e700 1 --2- 172.21.15.26:0/3859202176 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82ac09f650 0x7f82ac1c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:35.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.447+0000 7f82b260e700 1 --2- 172.21.15.26:0/3859202176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82ac09e930 0x7f82ac1c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:35.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.447+0000 7f82b260e700 1 --2- 172.21.15.26:0/3859202176 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f82ac09f240 0x7f82ac1c8670 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:35.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.447+0000 7f82b260e700 1 -- 172.21.15.26:0/3859202176 >> 172.21.15.26:0/3859202176 conn(0x7f82ac0a4210 msgr2=0x7f82ac1bbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:35.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.447+0000 7f82b260e700 1 -- 172.21.15.26:0/3859202176 shutdown_connections 2023-10-01T07:59:35.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.447+0000 7f82b260e700 1 -- 172.21.15.26:0/3859202176 wait complete. 2023-10-01T07:59:35.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.449+0000 7fb40a7c1700 1 -- 172.21.15.26:0/3111192639 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb404070e90 con 0x7fb404135c20 2023-10-01T07:59:35.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.450+0000 7fb400ff9700 1 -- 172.21.15.26:0/3111192639 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb3fc017070 con 0x7fb404135c20 2023-10-01T07:59:35.450 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:35.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.452+0000 7fb40a7c1700 1 -- 172.21.15.26:0/3111192639 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb404135c20 msgr2=0x7fb404138540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:35.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.452+0000 7fb40a7c1700 1 --2- 172.21.15.26:0/3111192639 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb404135c20 0x7fb404138540 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc004000 tx=0x7fb3fc004ad0 comp rx=0 tx=0).stop 2023-10-01T07:59:35.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.452+0000 7fb40a7c1700 1 -- 172.21.15.26:0/3111192639 shutdown_connections 2023-10-01T07:59:35.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.452+0000 7fb40a7c1700 1 --2- 172.21.15.26:0/3111192639 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb404135c20 0x7fb404138540 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:35.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.452+0000 7fb40a7c1700 1 --2- 172.21.15.26:0/3111192639 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb40406f5d0 0x7fb404129120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:35.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.452+0000 7fb40a7c1700 1 --2- 172.21.15.26:0/3111192639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb40412cf60 0x7fb404129660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:35.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.452+0000 7fb40a7c1700 1 -- 172.21.15.26:0/3111192639 >> 172.21.15.26:0/3111192639 conn(0x7fb4040a2aa0 msgr2=0x7fb40412a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:35.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.452+0000 7fb40a7c1700 1 -- 172.21.15.26:0/3111192639 shutdown_connections 2023-10-01T07:59:35.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.452+0000 7fb40a7c1700 1 -- 172.21.15.26:0/3111192639 wait complete. 2023-10-01T07:59:35.463 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:35.468 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:35.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.475+0000 7f599ff04700 1 -- 172.21.15.26:0/3465861940 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5998071c70 con 0x7f599806fec0 2023-10-01T07:59:35.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.475+0000 7f598e7fc700 1 -- 172.21.15.26:0/3465861940 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5998071c70 con 0x7f599806fec0 2023-10-01T07:59:35.476 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:35.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.477+0000 7f599ff04700 1 -- 172.21.15.26:0/3465861940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f599806fec0 msgr2=0x7f59981c9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:35.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.477+0000 7f599ff04700 1 --2- 172.21.15.26:0/3465861940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f599806fec0 0x7f59981c9580 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f5988009870 tx=0x7f5988004750 comp rx=0 tx=0).stop 2023-10-01T07:59:35.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.477+0000 7f599ff04700 1 -- 172.21.15.26:0/3465861940 shutdown_connections 2023-10-01T07:59:35.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.477+0000 7f599ff04700 1 --2- 172.21.15.26:0/3465861940 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f599812d0a0 0x7f59981c4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:35.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.477+0000 7f599ff04700 1 --2- 172.21.15.26:0/3465861940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f599806fec0 0x7f59981c9580 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:35.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.477+0000 7f599ff04700 1 --2- 172.21.15.26:0/3465861940 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f599809a7a0 0x7f59981c3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:35.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.477+0000 7f599ff04700 1 -- 172.21.15.26:0/3465861940 >> 172.21.15.26:0/3465861940 conn(0x7f59980a2610 msgr2=0x7f599806ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:35.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.478+0000 7f599ff04700 1 -- 172.21.15.26:0/3465861940 shutdown_connections 2023-10-01T07:59:35.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:35.478+0000 7f599ff04700 1 -- 172.21.15.26:0/3465861940 wait complete. 2023-10-01T07:59:35.492 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:36.443 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:36.464 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:36.469 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:36.493 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:36.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.598+0000 7f56938af700 1 Processor -- start 2023-10-01T07:59:36.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.598+0000 7f56938af700 1 -- start start 2023-10-01T07:59:36.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.599+0000 7f56938af700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f568c12cf60 0x7f568c06f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:36.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.599+0000 7f56938af700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f568c130430 0x7f568c137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:36.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.599+0000 7f56938af700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f568c12cd90 con 0x7f568c12f8b0 2023-10-01T07:59:36.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.599+0000 7f56938af700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f568c12d330 con 0x7f568c12cf60 2023-10-01T07:59:36.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.599+0000 7f56938af700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f568c071780 con 0x7f568c130430 2023-10-01T07:59:36.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.599+0000 7f5691e4c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f568c130430 0x7f568c137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:36.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.600+0000 7f5691e4c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f568c130430 0x7f568c137c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56678/0 (socket says 172.21.15.26:56678) 2023-10-01T07:59:36.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.600+0000 7f5691e4c700 1 -- 172.21.15.26:0/2508212479 learned_addr learned my addr 172.21.15.26:0/2508212479 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:36.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.600+0000 7f569164b700 1 --2- 172.21.15.26:0/2508212479 >> v2:172.21.15.26:3300/0 conn(0x7f568c12cf60 0x7f568c06f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:36.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.600+0000 7f569164b700 1 -- 172.21.15.26:0/2508212479 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f568c130430 msgr2=0x7f568c137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:36.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.600+0000 7f569164b700 1 --2- 172.21.15.26:0/2508212479 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f568c130430 0x7f568c137c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:36.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.600+0000 7f569164b700 1 -- 172.21.15.26:0/2508212479 >> v1:172.21.15.26:6789/0 conn(0x7f568c12f8b0 legacy=0x7f568c12fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:36.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.600+0000 7f569164b700 1 -- 172.21.15.26:0/2508212479 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568c071a40 con 0x7f568c12cf60 2023-10-01T07:59:36.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.600+0000 7f569164b700 1 --2- 172.21.15.26:0/2508212479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f568c12cf60 0x7f568c06f5d0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f5688009840 tx=0x7f5688009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=889b93dc99a4eae8 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:36.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.600+0000 7f5683fff700 1 -- 172.21.15.26:0/2508212479 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5688011830 con 0x7f568c12cf60 2023-10-01T07:59:36.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.601+0000 7f5683fff700 1 -- 172.21.15.26:0/2508212479 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5688011990 con 0x7f568c12cf60 2023-10-01T07:59:36.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.601+0000 7f5683fff700 1 -- 172.21.15.26:0/2508212479 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5688011d20 con 0x7f568c12cf60 2023-10-01T07:59:36.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.601+0000 7f56938af700 1 -- 172.21.15.26:0/2508212479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f568c12cf60 msgr2=0x7f568c06f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:36.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.601+0000 7f56938af700 1 --2- 172.21.15.26:0/2508212479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f568c12cf60 0x7f568c06f5d0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f5688009840 tx=0x7f5688009b50 comp rx=0 tx=0).stop 2023-10-01T07:59:36.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.601+0000 7f56938af700 1 -- 172.21.15.26:0/2508212479 shutdown_connections 2023-10-01T07:59:36.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.601+0000 7f56938af700 1 --2- 172.21.15.26:0/2508212479 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f568c130430 0x7f568c137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:36.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.601+0000 7f56938af700 1 --2- 172.21.15.26:0/2508212479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f568c12cf60 0x7f568c06f5d0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:36.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.601+0000 7f56938af700 1 -- 172.21.15.26:0/2508212479 >> 172.21.15.26:0/2508212479 conn(0x7f568c0a2aa0 msgr2=0x7f568c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:36.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.601+0000 7f56938af700 1 -- 172.21.15.26:0/2508212479 shutdown_connections 2023-10-01T07:59:36.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.601+0000 7f56938af700 1 -- 172.21.15.26:0/2508212479 wait complete. 2023-10-01T07:59:36.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.603+0000 7f56938af700 1 Processor -- start 2023-10-01T07:59:36.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.603+0000 7f56938af700 1 -- start start 2023-10-01T07:59:36.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.604+0000 7f56938af700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f568c12cf60 0x7f568c1c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:36.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.604+0000 7f56938af700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f568c12f8b0 0x7f568c1c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:36.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.604+0000 7f56938af700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f568c130430 0x7f568c1c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:36.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.604+0000 7f56938af700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568c1331a0 con 0x7f568c12f8b0 2023-10-01T07:59:36.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.604+0000 7f56938af700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f568c12f520 con 0x7f568c12cf60 2023-10-01T07:59:36.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.604+0000 7f56938af700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f568c129fa0 con 0x7f568c130430 2023-10-01T07:59:36.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.604+0000 7f569164b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f568c12cf60 0x7f568c1c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:36.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.604+0000 7f569164b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f568c12cf60 0x7f568c1c88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33270/0 (socket says 172.21.15.26:33270) 2023-10-01T07:59:36.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.604+0000 7f5690e4a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f568c12f8b0 0x7f568c1c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:36.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.604+0000 7f569164b700 1 -- 172.21.15.26:0/2135282036 learned_addr learned my addr 172.21.15.26:0/2135282036 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:36.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.604+0000 7f5691e4c700 1 --2- 172.21.15.26:0/2135282036 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f568c130430 0x7f568c1c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:36.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.604+0000 7f5690e4a700 1 -- 172.21.15.26:0/2135282036 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f568c130430 msgr2=0x7f568c1c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:36.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.604+0000 7f5690e4a700 1 --2- 172.21.15.26:0/2135282036 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f568c130430 0x7f568c1c9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:36.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.604+0000 7f5690e4a700 1 -- 172.21.15.26:0/2135282036 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f568c12cf60 msgr2=0x7f568c1c88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:36.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.604+0000 7f5690e4a700 1 --2- 172.21.15.26:0/2135282036 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f568c12cf60 0x7f568c1c88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:36.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.604+0000 7f5690e4a700 1 -- 172.21.15.26:0/2135282036 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56880094a0 con 0x7f568c12f8b0 2023-10-01T07:59:36.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.604+0000 7f569164b700 1 --2- 172.21.15.26:0/2135282036 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f568c12cf60 0x7f568c1c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:36.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.605+0000 7f5690e4a700 1 --2- 172.21.15.26:0/2135282036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f568c12f8b0 0x7f568c1c8e20 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f567c000f60 tx=0x7f567c00c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:36.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.605+0000 7f5681ffb700 1 -- 172.21.15.26:0/2135282036 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567c0052d0 con 0x7f568c12f8b0 2023-10-01T07:59:36.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.605+0000 7f5681ffb700 1 -- 172.21.15.26:0/2135282036 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f567c005430 con 0x7f568c12f8b0 2023-10-01T07:59:36.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.605+0000 7f5681ffb700 1 -- 172.21.15.26:0/2135282036 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567c0038c0 con 0x7f568c12f8b0 2023-10-01T07:59:36.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.606+0000 7f56938af700 1 -- 172.21.15.26:0/2135282036 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f568c13b6d0 con 0x7f568c12f8b0 2023-10-01T07:59:36.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.606+0000 7f56938af700 1 -- 172.21.15.26:0/2135282036 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f568c133740 con 0x7f568c12f8b0 2023-10-01T07:59:36.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.607+0000 7f56938af700 1 -- 172.21.15.26:0/2135282036 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f568c070e80 con 0x7f568c12f8b0 2023-10-01T07:59:36.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.607+0000 7f5681ffb700 1 -- 172.21.15.26:0/2135282036 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f567c003a20 con 0x7f568c12f8b0 2023-10-01T07:59:36.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.607+0000 7f5681ffb700 1 -- 172.21.15.26:0/2135282036 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f567c03e970 con 0x7f568c12f8b0 2023-10-01T07:59:36.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.612+0000 7f5681ffb700 1 -- 172.21.15.26:0/2135282036 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f567c011590 con 0x7f568c12f8b0 2023-10-01T07:59:36.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.639+0000 7f4c8aedc700 1 Processor -- start 2023-10-01T07:59:36.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.639+0000 7f4c8aedc700 1 -- start start 2023-10-01T07:59:36.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.639+0000 7f4c8aedc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c8406a770 0x7f4c8409d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:36.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.639+0000 7f4c8aedc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c8413d1f0 0x7f4c8413f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:36.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.639+0000 7f4c8aedc700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c8409a810 con 0x7f4c8409dc30 2023-10-01T07:59:36.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.639+0000 7f4c8aedc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8406ab40 con 0x7f4c8406a770 2023-10-01T07:59:36.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.639+0000 7f4c8aedc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8409ebc0 con 0x7f4c8413d1f0 2023-10-01T07:59:36.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.640+0000 7f4c88c78700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c8406a770 0x7f4c8409d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:36.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.640+0000 7f4c89479700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c8413d1f0 0x7f4c8413f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:36.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.640+0000 7f4c88c78700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c8406a770 0x7f4c8409d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33284/0 (socket says 172.21.15.26:33284) 2023-10-01T07:59:36.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.640+0000 7f4c89479700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c8413d1f0 0x7f4c8413f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56706/0 (socket says 172.21.15.26:56706) 2023-10-01T07:59:36.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.640+0000 7f4c88c78700 1 -- 172.21.15.26:0/3754377982 learned_addr learned my addr 172.21.15.26:0/3754377982 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:36.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.640+0000 7f4c837fe700 1 -- 172.21.15.26:0/3754377982 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1626707097 0 0) 0x7f4c8409a810 con 0x7f4c8409dc30 2023-10-01T07:59:36.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.640+0000 7f4c89479700 1 -- 172.21.15.26:0/3754377982 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c8406a770 msgr2=0x7f4c8409d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:36.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.640+0000 7f4c89479700 1 --2- 172.21.15.26:0/3754377982 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c8406a770 0x7f4c8409d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:36.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.640+0000 7f4c89479700 1 -- 172.21.15.26:0/3754377982 >> v1:172.21.15.26:6789/0 conn(0x7f4c8409dc30 legacy=0x7f4c8409e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:36.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.640+0000 7f4c89479700 1 -- 172.21.15.26:0/3754377982 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8409e920 con 0x7f4c8413d1f0 2023-10-01T07:59:36.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.640+0000 7f4c88c78700 1 --2- 172.21.15.26:0/3754377982 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c8406a770 0x7f4c8409d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:36.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.640+0000 7f4c89479700 1 --2- 172.21.15.26:0/3754377982 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c8413d1f0 0x7f4c8413f5d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c009dc0 tx=0x7f4c7c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75f476cfb178895d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:36.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.640+0000 7f4c837fe700 1 -- 172.21.15.26:0/3754377982 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c00e070 con 0x7f4c8413d1f0 2023-10-01T07:59:36.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.641+0000 7f4c837fe700 1 -- 172.21.15.26:0/3754377982 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c7c00bb20 con 0x7f4c8413d1f0 2023-10-01T07:59:36.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.641+0000 7f4c837fe700 1 -- 172.21.15.26:0/3754377982 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c012430 con 0x7f4c8413d1f0 2023-10-01T07:59:36.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.641+0000 7f4c8aedc700 1 -- 172.21.15.26:0/3754377982 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c8413d1f0 msgr2=0x7f4c8413f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:36.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.641+0000 7f4c8aedc700 1 --2- 172.21.15.26:0/3754377982 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c8413d1f0 0x7f4c8413f5d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c009dc0 tx=0x7f4c7c00b330 comp rx=0 tx=0).stop 2023-10-01T07:59:36.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.641+0000 7f4c8aedc700 1 -- 172.21.15.26:0/3754377982 shutdown_connections 2023-10-01T07:59:36.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.641+0000 7f4c8aedc700 1 --2- 172.21.15.26:0/3754377982 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c8413d1f0 0x7f4c8413f5d0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:36.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.641+0000 7f4c8aedc700 1 --2- 172.21.15.26:0/3754377982 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c8406a770 0x7f4c8409d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:36.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.641+0000 7f4c8aedc700 1 -- 172.21.15.26:0/3754377982 >> 172.21.15.26:0/3754377982 conn(0x7f4c84066f50 msgr2=0x7f4c8409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:36.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.641+0000 7f4c8aedc700 1 -- 172.21.15.26:0/3754377982 shutdown_connections 2023-10-01T07:59:36.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.641+0000 7f4c8aedc700 1 -- 172.21.15.26:0/3754377982 wait complete. 2023-10-01T07:59:36.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.642+0000 7f4c8aedc700 1 Processor -- start 2023-10-01T07:59:36.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.642+0000 7f4c8aedc700 1 -- start start 2023-10-01T07:59:36.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.643+0000 7f4c8aedc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c8406a770 0x7f4c8411bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:36.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.643+0000 7f4c8aedc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c8409dc30 0x7f4c8413b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:36.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.643+0000 7f4c8aedc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c8413d1f0 0x7f4c8413ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:36.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.643+0000 7f4c8aedc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8413cc70 con 0x7f4c8406a770 2023-10-01T07:59:36.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.643+0000 7f4c8aedc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c84135c60 con 0x7f4c8409dc30 2023-10-01T07:59:36.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.643+0000 7f4c8aedc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8409f1a0 con 0x7f4c8413d1f0 2023-10-01T07:59:36.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.643+0000 7f4c89479700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c8413d1f0 0x7f4c8413ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:36.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.643+0000 7f4c88c78700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c8406a770 0x7f4c8411bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:36.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.643+0000 7f4c89479700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c8413d1f0 0x7f4c8413ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56716/0 (socket says 172.21.15.26:56716) 2023-10-01T07:59:36.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.643+0000 7f4c89479700 1 -- 172.21.15.26:0/3524801284 learned_addr learned my addr 172.21.15.26:0/3524801284 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:36.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.643+0000 7f4c83fff700 1 --2- 172.21.15.26:0/3524801284 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c8409dc30 0x7f4c8413b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:36.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.644+0000 7f4c89479700 1 -- 172.21.15.26:0/3524801284 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c8409dc30 msgr2=0x7f4c8413b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:36.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.644+0000 7f4c89479700 1 --2- 172.21.15.26:0/3524801284 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c8409dc30 0x7f4c8413b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:36.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.644+0000 7f4c89479700 1 -- 172.21.15.26:0/3524801284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c8406a770 msgr2=0x7f4c8411bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:36.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.644+0000 7f4c89479700 1 --2- 172.21.15.26:0/3524801284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c8406a770 0x7f4c8411bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:36.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.644+0000 7f4c89479700 1 -- 172.21.15.26:0/3524801284 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c78009550 con 0x7f4c8413d1f0 2023-10-01T07:59:36.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.644+0000 7f4c88c78700 1 --2- 172.21.15.26:0/3524801284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c8406a770 0x7f4c8411bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:36.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.644+0000 7f4c89479700 1 --2- 172.21.15.26:0/3524801284 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c8413d1f0 0x7f4c8413ba40 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c014040 tx=0x7f4c7c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:36.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.644+0000 7f4c817fa700 1 -- 172.21.15.26:0/3524801284 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c004930 con 0x7f4c8413d1f0 2023-10-01T07:59:36.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.644+0000 7f4c817fa700 1 -- 172.21.15.26:0/3524801284 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c7c020070 con 0x7f4c8413d1f0 2023-10-01T07:59:36.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.644+0000 7f4c8aedc700 1 -- 172.21.15.26:0/3524801284 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c7c009a70 con 0x7f4c8413d1f0 2023-10-01T07:59:36.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.644+0000 7f4c817fa700 1 -- 172.21.15.26:0/3524801284 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c0276c0 con 0x7f4c8413d1f0 2023-10-01T07:59:36.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.644+0000 7f4c8aedc700 1 -- 172.21.15.26:0/3524801284 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c8411cce0 con 0x7f4c8413d1f0 2023-10-01T07:59:36.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.645+0000 7f4c817fa700 1 -- 172.21.15.26:0/3524801284 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4c7c012430 con 0x7f4c8413d1f0 2023-10-01T07:59:36.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.645+0000 7f4c817fa700 1 -- 172.21.15.26:0/3524801284 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4c7c022070 con 0x7f4c8413d1f0 2023-10-01T07:59:36.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.646+0000 7fcb1c313700 1 Processor -- start 2023-10-01T07:59:36.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.646+0000 7f4c8aedc700 1 -- 172.21.15.26:0/3524801284 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c84074ea0 con 0x7f4c8413d1f0 2023-10-01T07:59:36.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.646+0000 7fcb1c313700 1 -- start start 2023-10-01T07:59:36.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.647+0000 7fcb1c313700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb140a0a30 0x7fcb140a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:36.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.647+0000 7fcb1c313700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb14134170 0x7fcb1413bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:36.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.647+0000 7fcb1c313700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb1409edd0 con 0x7fcb140a1340 2023-10-01T07:59:36.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.647+0000 7fcb1c313700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1409e1f0 con 0x7fcb14134170 2023-10-01T07:59:36.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.647+0000 7fcb1c313700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1409dc50 con 0x7fcb140a0a30 2023-10-01T07:59:36.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.647+0000 7fcb198ae700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fcb140a1340 0x7fcb14133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56296/0 (socket says 172.21.15.26:56296) 2023-10-01T07:59:36.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.647+0000 7fcb198ae700 1 -- 172.21.15.26:0/3539675234 learned_addr learned my addr 172.21.15.26:0/3539675234 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:59:36.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.647+0000 7fcb1a8b0700 1 --2- 172.21.15.26:0/3539675234 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb14134170 0x7fcb1413bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:36.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.647+0000 7fcb1a0af700 1 --2- 172.21.15.26:0/3539675234 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb140a0a30 0x7fcb140a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:36.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.648+0000 7fcb190ad700 1 -- 172.21.15.26:0/3539675234 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 698236983 0 0) 0x7fcb1409edd0 con 0x7fcb140a1340 2023-10-01T07:59:36.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.648+0000 7fcb190ad700 1 -- 172.21.15.26:0/3539675234 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb000035b0 con 0x7fcb140a1340 2023-10-01T07:59:36.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.648+0000 7fcb1a0af700 1 -- 172.21.15.26:0/3539675234 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb14134170 msgr2=0x7fcb1413bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:36.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.648+0000 7fcb1a0af700 1 --2- 172.21.15.26:0/3539675234 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb14134170 0x7fcb1413bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:36.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.648+0000 7fcb1a0af700 1 -- 172.21.15.26:0/3539675234 >> v1:172.21.15.26:6789/0 conn(0x7fcb140a1340 legacy=0x7fcb14133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:36.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.648+0000 7fcb1a0af700 1 -- 172.21.15.26:0/3539675234 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb140a1fe0 con 0x7fcb140a0a30 2023-10-01T07:59:36.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.648+0000 7fcb1a8b0700 1 --2- 172.21.15.26:0/3539675234 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb14134170 0x7fcb1413bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:36.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.648+0000 7fcb1a0af700 1 --2- 172.21.15.26:0/3539675234 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb140a0a30 0x7fcb140a0e00 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009870 tx=0x7fcb10009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22effe3368743ae0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:36.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.652+0000 7fcb190ad700 1 -- 172.21.15.26:0/3539675234 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb10011830 con 0x7fcb140a0a30 2023-10-01T07:59:36.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.652+0000 7fcb190ad700 1 -- 172.21.15.26:0/3539675234 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb10011990 con 0x7fcb140a0a30 2023-10-01T07:59:36.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.652+0000 7fcb190ad700 1 -- 172.21.15.26:0/3539675234 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb10011d20 con 0x7fcb140a0a30 2023-10-01T07:59:36.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.652+0000 7f4c817fa700 1 -- 172.21.15.26:0/3524801284 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4c7c046060 con 0x7f4c8413d1f0 2023-10-01T07:59:36.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.653+0000 7fcb1c313700 1 -- 172.21.15.26:0/3539675234 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb140a0a30 msgr2=0x7fcb140a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:36.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.653+0000 7fcb1c313700 1 --2- 172.21.15.26:0/3539675234 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb140a0a30 0x7fcb140a0e00 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009870 tx=0x7fcb10009b80 comp rx=0 tx=0).stop 2023-10-01T07:59:36.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.653+0000 7fcb1c313700 1 -- 172.21.15.26:0/3539675234 shutdown_connections 2023-10-01T07:59:36.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.653+0000 7fcb1c313700 1 --2- 172.21.15.26:0/3539675234 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb140a0a30 0x7fcb140a0e00 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:36.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.653+0000 7fcb1c313700 1 --2- 172.21.15.26:0/3539675234 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb14134170 0x7fcb1413bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:36.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.653+0000 7fcb1c313700 1 -- 172.21.15.26:0/3539675234 >> 172.21.15.26:0/3539675234 conn(0x7fcb140a6550 msgr2=0x7fcb140a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:36.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.653+0000 7fcb1c313700 1 -- 172.21.15.26:0/3539675234 shutdown_connections 2023-10-01T07:59:36.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.653+0000 7fcb1c313700 1 -- 172.21.15.26:0/3539675234 wait complete. 2023-10-01T07:59:36.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.654+0000 7fcb1c313700 1 Processor -- start 2023-10-01T07:59:36.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.655+0000 7fcb1c313700 1 -- start start 2023-10-01T07:59:36.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.655+0000 7fcb1c313700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb140a0a30 0x7fcb14122850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:36.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.655+0000 7fcb1c313700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb140a1340 0x7fcb14122d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:36.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.655+0000 7fcb1c313700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb14134170 0x7fcb141232d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:36.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.655+0000 7fcb1c313700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1409bd50 con 0x7fcb140a0a30 2023-10-01T07:59:36.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.655+0000 7fcb1c313700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb141332e0 con 0x7fcb14134170 2023-10-01T07:59:36.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.655+0000 7fcb1c313700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb141244e0 con 0x7fcb140a1340 2023-10-01T07:59:36.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.656+0000 7fcb198ae700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb140a1340 0x7fcb14122d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:36.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.656+0000 7fcb198ae700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb140a1340 0x7fcb14122d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56726/0 (socket says 172.21.15.26:56726) 2023-10-01T07:59:36.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.656+0000 7fcb198ae700 1 -- 172.21.15.26:0/3355796417 learned_addr learned my addr 172.21.15.26:0/3355796417 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:36.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.656+0000 7fcb1a8b0700 1 --2- 172.21.15.26:0/3355796417 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb14134170 0x7fcb141232d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:36.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.656+0000 7fcb198ae700 1 -- 172.21.15.26:0/3355796417 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb14134170 msgr2=0x7fcb141232d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:36.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.656+0000 7fcb198ae700 1 --2- 172.21.15.26:0/3355796417 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb14134170 0x7fcb141232d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:36.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.656+0000 7fcb198ae700 1 -- 172.21.15.26:0/3355796417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb140a0a30 msgr2=0x7fcb14122850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:36.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.656+0000 7fcb198ae700 1 --2- 172.21.15.26:0/3355796417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb140a0a30 0x7fcb14122850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:36.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.656+0000 7fcb198ae700 1 -- 172.21.15.26:0/3355796417 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0c009a70 con 0x7fcb140a1340 2023-10-01T07:59:36.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.656+0000 7fcb1a8b0700 1 --2- 172.21.15.26:0/3355796417 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb14134170 0x7fcb141232d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:36.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.656+0000 7fcb198ae700 1 --2- 172.21.15.26:0/3355796417 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb140a1340 0x7fcb14122d90 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fcb0400c700 tx=0x7fcb0400cac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:36.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.656+0000 7fcb0affd700 1 -- 172.21.15.26:0/3355796417 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb04005d70 con 0x7fcb140a1340 2023-10-01T07:59:36.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.657+0000 7fcb1c313700 1 -- 172.21.15.26:0/3355796417 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb100094a0 con 0x7fcb140a1340 2023-10-01T07:59:36.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.656+0000 7fcb0affd700 1 -- 172.21.15.26:0/3355796417 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb040070d0 con 0x7fcb140a1340 2023-10-01T07:59:36.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.657+0000 7fcb0affd700 1 -- 172.21.15.26:0/3355796417 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb04007460 con 0x7fcb140a1340 2023-10-01T07:59:36.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.657+0000 7fcb1c313700 1 -- 172.21.15.26:0/3355796417 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb140a25e0 con 0x7fcb140a1340 2023-10-01T07:59:36.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.658+0000 7fcb0affd700 1 -- 172.21.15.26:0/3355796417 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcb040075c0 con 0x7fcb140a1340 2023-10-01T07:59:36.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.658+0000 7fcb0affd700 1 -- 172.21.15.26:0/3355796417 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcb0403ed10 con 0x7fcb140a1340 2023-10-01T07:59:36.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.659+0000 7fcb1c313700 1 -- 172.21.15.26:0/3355796417 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb14074ea0 con 0x7fcb140a1340 2023-10-01T07:59:36.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.665+0000 7fcb0affd700 1 -- 172.21.15.26:0/3355796417 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcb04017080 con 0x7fcb140a1340 2023-10-01T07:59:36.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.680+0000 7fa0566ae700 1 Processor -- start 2023-10-01T07:59:36.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.680+0000 7fa0566ae700 1 -- start start 2023-10-01T07:59:36.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.680+0000 7fa0566ae700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa05009d6f0 0x7fa05009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:36.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.680+0000 7fa0566ae700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa05009e000 0x7fa050130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:36.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.680+0000 7fa0566ae700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa05009f130 con 0x7fa05009e410 2023-10-01T07:59:36.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.680+0000 7fa0566ae700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa05009f520 con 0x7fa05009d6f0 2023-10-01T07:59:36.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.681+0000 7fa0566ae700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa05009e930 con 0x7fa05009e000 2023-10-01T07:59:36.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.681+0000 7fa04f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa05009e000 0x7fa050130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:36.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.681+0000 7fa04f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa05009e000 0x7fa050130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33318/0 (socket says 172.21.15.26:33318) 2023-10-01T07:59:36.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.681+0000 7fa054c4b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa05009e410 0x7fa050130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56312/0 (socket says 172.21.15.26:56312) 2023-10-01T07:59:36.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.681+0000 7fa04f7fe700 1 -- 172.21.15.26:0/3158062512 learned_addr learned my addr 172.21.15.26:0/3158062512 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:36.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.681+0000 7fa04ffff700 1 --2- 172.21.15.26:0/3158062512 >> v2:172.21.15.26:3300/0 conn(0x7fa05009d6f0 0x7fa05009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:36.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.681+0000 7fa04f7fe700 1 -- 172.21.15.26:0/3158062512 >> v2:172.21.15.26:3300/0 conn(0x7fa05009d6f0 msgr2=0x7fa05009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:36.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.681+0000 7fa04f7fe700 1 --2- 172.21.15.26:0/3158062512 >> v2:172.21.15.26:3300/0 conn(0x7fa05009d6f0 0x7fa05009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:36.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.681+0000 7fa04f7fe700 1 -- 172.21.15.26:0/3158062512 >> v1:172.21.15.26:6789/0 conn(0x7fa05009e410 legacy=0x7fa050130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:36.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.681+0000 7fa04effd700 1 -- 172.21.15.26:0/3158062512 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2977136021 0 0) 0x7fa05009f130 con 0x7fa05009e410 2023-10-01T07:59:36.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.681+0000 7fa04f7fe700 1 -- 172.21.15.26:0/3158062512 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05009b2d0 con 0x7fa05009e000 2023-10-01T07:59:36.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.681+0000 7fa04f7fe700 1 --2- 172.21.15.26:0/3158062512 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa05009e000 0x7fa050130660 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa0440098f0 tx=0x7fa044009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b32f1165e184fe79 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:36.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.682+0000 7fa04effd700 1 -- 172.21.15.26:0/3158062512 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa044011830 con 0x7fa05009e000 2023-10-01T07:59:36.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.682+0000 7fa04effd700 1 -- 172.21.15.26:0/3158062512 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa044011990 con 0x7fa05009e000 2023-10-01T07:59:36.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.682+0000 7fa04effd700 1 -- 172.21.15.26:0/3158062512 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa044011d20 con 0x7fa05009e000 2023-10-01T07:59:36.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.683+0000 7fa0566ae700 1 -- 172.21.15.26:0/3158062512 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa05009e000 msgr2=0x7fa050130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:36.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.683+0000 7fa0566ae700 1 --2- 172.21.15.26:0/3158062512 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa05009e000 0x7fa050130660 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa0440098f0 tx=0x7fa044009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:36.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.683+0000 7fa0566ae700 1 -- 172.21.15.26:0/3158062512 shutdown_connections 2023-10-01T07:59:36.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.683+0000 7fa0566ae700 1 --2- 172.21.15.26:0/3158062512 >> v2:172.21.15.26:3300/0 conn(0x7fa05009d6f0 0x7fa05009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:36.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.683+0000 7fa0566ae700 1 --2- 172.21.15.26:0/3158062512 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa05009e000 0x7fa050130660 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:36.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.683+0000 7fa0566ae700 1 -- 172.21.15.26:0/3158062512 >> 172.21.15.26:0/3158062512 conn(0x7fa050066f50 msgr2=0x7fa05009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:36.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.683+0000 7fa0566ae700 1 -- 172.21.15.26:0/3158062512 shutdown_connections 2023-10-01T07:59:36.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.683+0000 7fa0566ae700 1 -- 172.21.15.26:0/3158062512 wait complete. 2023-10-01T07:59:36.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.684+0000 7fa0566ae700 1 Processor -- start 2023-10-01T07:59:36.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.685+0000 7fa0566ae700 1 -- start start 2023-10-01T07:59:36.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.685+0000 7fa0566ae700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa05009d6f0 0x7fa050127350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:36.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.685+0000 7fa0566ae700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa05009e000 0x7fa050127890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:36.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.685+0000 7fa0566ae700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa05009e410 0x7fa050127dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:36.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.685+0000 7fa0566ae700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05012a700 con 0x7fa05009d6f0 2023-10-01T07:59:36.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.685+0000 7fa0566ae700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0500a2090 con 0x7fa05009e410 2023-10-01T07:59:36.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.685+0000 7fa0566ae700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa05009c700 con 0x7fa05009e000 2023-10-01T07:59:36.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.685+0000 7fa054c4b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa05009e410 0x7fa050127dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:36.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.685+0000 7fa054c4b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa05009e410 0x7fa050127dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33326/0 (socket says 172.21.15.26:33326) 2023-10-01T07:59:36.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.685+0000 7fa054c4b700 1 -- 172.21.15.26:0/4014494548 learned_addr learned my addr 172.21.15.26:0/4014494548 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:36.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.685+0000 7fa04f7fe700 1 --2- 172.21.15.26:0/4014494548 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa05009e000 0x7fa050127890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:36.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.686+0000 7fa04f7fe700 1 -- 172.21.15.26:0/4014494548 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa05009e410 msgr2=0x7fa050127dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:36.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.686+0000 7fa04f7fe700 1 --2- 172.21.15.26:0/4014494548 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa05009e410 0x7fa050127dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:36.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.686+0000 7fa04f7fe700 1 -- 172.21.15.26:0/4014494548 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa05009d6f0 msgr2=0x7fa050127350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:36.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.686+0000 7fa04f7fe700 1 --2- 172.21.15.26:0/4014494548 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa05009d6f0 0x7fa050127350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:36.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.686+0000 7fa04f7fe700 1 -- 172.21.15.26:0/4014494548 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa044009550 con 0x7fa05009e000 2023-10-01T07:59:36.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.686+0000 7fa04f7fe700 1 --2- 172.21.15.26:0/4014494548 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa05009e000 0x7fa050127890 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fa044016000 tx=0x7fa044004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:36.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.686+0000 7fa04cff9700 1 -- 172.21.15.26:0/4014494548 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0440036a0 con 0x7fa05009e000 2023-10-01T07:59:36.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.686+0000 7fa04cff9700 1 -- 172.21.15.26:0/4014494548 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04401f070 con 0x7fa05009e000 2023-10-01T07:59:36.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.687+0000 7fa0566ae700 1 -- 172.21.15.26:0/4014494548 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa05012b570 con 0x7fa05009e000 2023-10-01T07:59:36.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.687+0000 7fa04cff9700 1 -- 172.21.15.26:0/4014494548 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa044003a00 con 0x7fa05009e000 2023-10-01T07:59:36.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.687+0000 7fa0566ae700 1 -- 172.21.15.26:0/4014494548 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa05012aca0 con 0x7fa05009e000 2023-10-01T07:59:36.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.688+0000 7fa04cff9700 1 -- 172.21.15.26:0/4014494548 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa044003b60 con 0x7fa05009e000 2023-10-01T07:59:36.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.689+0000 7fa0367fc700 1 -- 172.21.15.26:0/4014494548 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0280052e0 con 0x7fa05009e000 2023-10-01T07:59:36.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.689+0000 7fa04cff9700 1 -- 172.21.15.26:0/4014494548 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa044021070 con 0x7fa05009e000 2023-10-01T07:59:36.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.698+0000 7fa04cff9700 1 -- 172.21.15.26:0/4014494548 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa044015080 con 0x7fa05009e000 2023-10-01T07:59:36.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.835+0000 7f56938af700 1 -- 172.21.15.26:0/2135282036 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f568c074ea0 con 0x7f568c12f8b0 2023-10-01T07:59:36.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.836+0000 7f5681ffb700 1 -- 172.21.15.26:0/2135282036 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f567c017030 con 0x7f568c12f8b0 2023-10-01T07:59:36.837 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:36.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.838+0000 7f56938af700 1 -- 172.21.15.26:0/2135282036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f568c12f8b0 msgr2=0x7f568c1c8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:36.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.838+0000 7f56938af700 1 --2- 172.21.15.26:0/2135282036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f568c12f8b0 0x7f568c1c8e20 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f567c000f60 tx=0x7f567c00c730 comp rx=0 tx=0).stop 2023-10-01T07:59:36.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.838+0000 7f56938af700 1 -- 172.21.15.26:0/2135282036 shutdown_connections 2023-10-01T07:59:36.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.838+0000 7f56938af700 1 --2- 172.21.15.26:0/2135282036 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f568c130430 0x7f568c1c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:36.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.838+0000 7f56938af700 1 --2- 172.21.15.26:0/2135282036 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f568c12cf60 0x7f568c1c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:36.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.838+0000 7f56938af700 1 --2- 172.21.15.26:0/2135282036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f568c12f8b0 0x7f568c1c8e20 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:36.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.838+0000 7f56938af700 1 -- 172.21.15.26:0/2135282036 >> 172.21.15.26:0/2135282036 conn(0x7f568c0a2aa0 msgr2=0x7f568c06e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:36.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.839+0000 7f56938af700 1 -- 172.21.15.26:0/2135282036 shutdown_connections 2023-10-01T07:59:36.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.839+0000 7f56938af700 1 -- 172.21.15.26:0/2135282036 wait complete. 2023-10-01T07:59:36.853 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:36.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.863+0000 7f4c8aedc700 1 -- 172.21.15.26:0/3524801284 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4c8411e1d0 con 0x7f4c8413d1f0 2023-10-01T07:59:36.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.863+0000 7f4c817fa700 1 -- 172.21.15.26:0/3524801284 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4c7c0126e0 con 0x7f4c8413d1f0 2023-10-01T07:59:36.864 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:36.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.866+0000 7f4c8aedc700 1 -- 172.21.15.26:0/3524801284 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c8413d1f0 msgr2=0x7f4c8413ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:36.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.866+0000 7f4c8aedc700 1 --2- 172.21.15.26:0/3524801284 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c8413d1f0 0x7f4c8413ba40 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c014040 tx=0x7f4c7c004ad0 comp rx=0 tx=0).stop 2023-10-01T07:59:36.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.866+0000 7f4c8aedc700 1 -- 172.21.15.26:0/3524801284 shutdown_connections 2023-10-01T07:59:36.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.866+0000 7f4c8aedc700 1 --2- 172.21.15.26:0/3524801284 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c8413d1f0 0x7f4c8413ba40 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:36.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.866+0000 7f4c8aedc700 1 --2- 172.21.15.26:0/3524801284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c8406a770 0x7f4c8411bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:36.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.866+0000 7f4c8aedc700 1 --2- 172.21.15.26:0/3524801284 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c8409dc30 0x7f4c8413b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:36.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.866+0000 7f4c8aedc700 1 -- 172.21.15.26:0/3524801284 >> 172.21.15.26:0/3524801284 conn(0x7f4c84066f50 msgr2=0x7f4c840a2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:36.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.866+0000 7f4c8aedc700 1 -- 172.21.15.26:0/3524801284 shutdown_connections 2023-10-01T07:59:36.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.866+0000 7f4c8aedc700 1 -- 172.21.15.26:0/3524801284 wait complete. 2023-10-01T07:59:36.880 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:36.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.881+0000 7fcb1c313700 1 -- 172.21.15.26:0/3355796417 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcb140a28e0 con 0x7fcb140a1340 2023-10-01T07:59:36.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.881+0000 7fcb0affd700 1 -- 172.21.15.26:0/3355796417 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcb0400f260 con 0x7fcb140a1340 2023-10-01T07:59:36.882 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:36.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.883+0000 7fcb1c313700 1 -- 172.21.15.26:0/3355796417 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb140a1340 msgr2=0x7fcb14122d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:36.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.883+0000 7fcb1c313700 1 --2- 172.21.15.26:0/3355796417 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb140a1340 0x7fcb14122d90 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fcb0400c700 tx=0x7fcb0400cac0 comp rx=0 tx=0).stop 2023-10-01T07:59:36.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.883+0000 7fcb1c313700 1 -- 172.21.15.26:0/3355796417 shutdown_connections 2023-10-01T07:59:36.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.883+0000 7fcb1c313700 1 --2- 172.21.15.26:0/3355796417 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb14134170 0x7fcb141232d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:36.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.883+0000 7fcb1c313700 1 --2- 172.21.15.26:0/3355796417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb140a0a30 0x7fcb14122850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:36.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.883+0000 7fcb1c313700 1 --2- 172.21.15.26:0/3355796417 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcb140a1340 0x7fcb14122d90 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:36.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.884+0000 7fcb1c313700 1 -- 172.21.15.26:0/3355796417 >> 172.21.15.26:0/3355796417 conn(0x7fcb140a6550 msgr2=0x7fcb1409edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:36.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.884+0000 7fcb1c313700 1 -- 172.21.15.26:0/3355796417 shutdown_connections 2023-10-01T07:59:36.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.884+0000 7fcb1c313700 1 -- 172.21.15.26:0/3355796417 wait complete. 2023-10-01T07:59:36.899 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:36.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.910+0000 7fa0367fc700 1 -- 172.21.15.26:0/4014494548 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa028005590 con 0x7fa05009e000 2023-10-01T07:59:36.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.910+0000 7fa04cff9700 1 -- 172.21.15.26:0/4014494548 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa044003e10 con 0x7fa05009e000 2023-10-01T07:59:36.910 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:36.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.912+0000 7fa0367fc700 1 -- 172.21.15.26:0/4014494548 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa05009e000 msgr2=0x7fa050127890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:36.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.912+0000 7fa0367fc700 1 --2- 172.21.15.26:0/4014494548 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa05009e000 0x7fa050127890 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fa044016000 tx=0x7fa044004750 comp rx=0 tx=0).stop 2023-10-01T07:59:36.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.912+0000 7fa0367fc700 1 -- 172.21.15.26:0/4014494548 shutdown_connections 2023-10-01T07:59:36.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.912+0000 7fa0367fc700 1 --2- 172.21.15.26:0/4014494548 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa05009e410 0x7fa050127dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:36.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.912+0000 7fa0367fc700 1 --2- 172.21.15.26:0/4014494548 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa05009d6f0 0x7fa050127350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:36.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.912+0000 7fa0367fc700 1 --2- 172.21.15.26:0/4014494548 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa05009e000 0x7fa050127890 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:36.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.912+0000 7fa0367fc700 1 -- 172.21.15.26:0/4014494548 >> 172.21.15.26:0/4014494548 conn(0x7fa050066f50 msgr2=0x7fa050070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:36.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.912+0000 7fa0367fc700 1 -- 172.21.15.26:0/4014494548 shutdown_connections 2023-10-01T07:59:36.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:36.912+0000 7fa0367fc700 1 -- 172.21.15.26:0/4014494548 wait complete. 2023-10-01T07:59:36.926 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:37.854 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:37.881 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:37.900 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:37.928 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:38.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.007+0000 7efc1f6c2700 1 Processor -- start 2023-10-01T07:59:38.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.007+0000 7efc1f6c2700 1 -- start start 2023-10-01T07:59:38.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.008+0000 7efc1f6c2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efc1809f410 0x7efc18136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:38.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.008+0000 7efc1f6c2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc18136fe0 0x7efc181393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:38.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.008+0000 7efc1f6c2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc18070940 con 0x7efc1809e930 2023-10-01T07:59:38.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.008+0000 7efc1f6c2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc1806fd60 con 0x7efc1809f410 2023-10-01T07:59:38.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.008+0000 7efc1f6c2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc1806fa80 con 0x7efc18136fe0 2023-10-01T07:59:38.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.009+0000 7efc1dc5f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc18136fe0 0x7efc181393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:38.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.009+0000 7efc1cc5d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efc1809f410 0x7efc18136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:38.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.009+0000 7efc1cc5d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efc1809f410 0x7efc18136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37006/0 (socket says 172.21.15.26:37006) 2023-10-01T07:59:38.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.009+0000 7efc1dc5f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc18136fe0 0x7efc181393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56734/0 (socket says 172.21.15.26:56734) 2023-10-01T07:59:38.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.009+0000 7efc1cc5d700 1 -- 172.21.15.26:0/436429326 learned_addr learned my addr 172.21.15.26:0/436429326 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:38.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.009+0000 7efc1dc5f700 1 -- 172.21.15.26:0/436429326 >> v2:172.21.15.26:3300/0 conn(0x7efc1809f410 msgr2=0x7efc18136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:38.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.009+0000 7efc1dc5f700 1 --2- 172.21.15.26:0/436429326 >> v2:172.21.15.26:3300/0 conn(0x7efc1809f410 0x7efc18136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.009+0000 7efc1dc5f700 1 -- 172.21.15.26:0/436429326 >> v1:172.21.15.26:6789/0 conn(0x7efc1809e930 legacy=0x7efc1809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:38.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.009+0000 7efc1dc5f700 1 -- 172.21.15.26:0/436429326 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1809fb60 con 0x7efc18136fe0 2023-10-01T07:59:38.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.009+0000 7efc1cc5d700 1 --2- 172.21.15.26:0/436429326 >> v2:172.21.15.26:3300/0 conn(0x7efc1809f410 0x7efc18136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:38.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.009+0000 7efc1dc5f700 1 --2- 172.21.15.26:0/436429326 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc18136fe0 0x7efc181393c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7efc10009d90 tx=0x7efc1000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9286a148bf755bf2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:38.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.010+0000 7efc0ffff700 1 -- 172.21.15.26:0/436429326 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1000e070 con 0x7efc18136fe0 2023-10-01T07:59:38.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.010+0000 7efc0ffff700 1 -- 172.21.15.26:0/436429326 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1000bb20 con 0x7efc18136fe0 2023-10-01T07:59:38.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.010+0000 7efc0ffff700 1 -- 172.21.15.26:0/436429326 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc10012430 con 0x7efc18136fe0 2023-10-01T07:59:38.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.010+0000 7efc1f6c2700 1 -- 172.21.15.26:0/436429326 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc18136fe0 msgr2=0x7efc181393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:38.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.010+0000 7efc1f6c2700 1 --2- 172.21.15.26:0/436429326 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc18136fe0 0x7efc181393c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7efc10009d90 tx=0x7efc1000b330 comp rx=0 tx=0).stop 2023-10-01T07:59:38.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.011+0000 7efc1f6c2700 1 -- 172.21.15.26:0/436429326 shutdown_connections 2023-10-01T07:59:38.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.011+0000 7efc1f6c2700 1 --2- 172.21.15.26:0/436429326 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc18136fe0 0x7efc181393c0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.011+0000 7efc1f6c2700 1 --2- 172.21.15.26:0/436429326 >> v2:172.21.15.26:3300/0 conn(0x7efc1809f410 0x7efc18136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.011+0000 7efc1f6c2700 1 -- 172.21.15.26:0/436429326 >> 172.21.15.26:0/436429326 conn(0x7efc180a4210 msgr2=0x7efc180a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:38.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.011+0000 7efc1f6c2700 1 -- 172.21.15.26:0/436429326 shutdown_connections 2023-10-01T07:59:38.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.011+0000 7efc1f6c2700 1 -- 172.21.15.26:0/436429326 wait complete. 2023-10-01T07:59:38.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.012+0000 7efc1f6c2700 1 Processor -- start 2023-10-01T07:59:38.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.012+0000 7efc1f6c2700 1 -- start start 2023-10-01T07:59:38.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.013+0000 7efc1f6c2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc1809e930 0x7efc181c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:38.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.013+0000 7efc1f6c2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc1809f410 0x7efc181c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:38.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.013+0000 7efc1f6c2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efc18136fe0 0x7efc1806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:38.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.013+0000 7efc1f6c2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc181bc0c0 con 0x7efc1809e930 2023-10-01T07:59:38.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.013+0000 7efc1f6c2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc181224b0 con 0x7efc18136fe0 2023-10-01T07:59:38.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.013+0000 7efc1f6c2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc181320d0 con 0x7efc1809f410 2023-10-01T07:59:38.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.013+0000 7efc1d45e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc1809e930 0x7efc181c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:38.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.013+0000 7efc1d45e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc1809e930 0x7efc181c86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37016/0 (socket says 172.21.15.26:37016) 2023-10-01T07:59:38.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.013+0000 7efc1d45e700 1 -- 172.21.15.26:0/3902202287 learned_addr learned my addr 172.21.15.26:0/3902202287 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:38.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.013+0000 7efc1dc5f700 1 --2- 172.21.15.26:0/3902202287 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efc18136fe0 0x7efc1806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:38.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.013+0000 7efc1cc5d700 1 --2- 172.21.15.26:0/3902202287 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc1809f410 0x7efc181c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:38.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.013+0000 7efc1dc5f700 1 -- 172.21.15.26:0/3902202287 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc1809f410 msgr2=0x7efc181c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:38.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.013+0000 7efc1dc5f700 1 --2- 172.21.15.26:0/3902202287 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc1809f410 0x7efc181c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.013+0000 7efc1dc5f700 1 -- 172.21.15.26:0/3902202287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc1809e930 msgr2=0x7efc181c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:38.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.013+0000 7efc1dc5f700 1 --2- 172.21.15.26:0/3902202287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc1809e930 0x7efc181c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.013+0000 7efc1dc5f700 1 -- 172.21.15.26:0/3902202287 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc08009550 con 0x7efc18136fe0 2023-10-01T07:59:38.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.013+0000 7efc1cc5d700 1 --2- 172.21.15.26:0/3902202287 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc1809f410 0x7efc181c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:38.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.014+0000 7efc1dc5f700 1 --2- 172.21.15.26:0/3902202287 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efc18136fe0 0x7efc1806b8b0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7efc10016000 tx=0x7efc10004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:38.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.014+0000 7efc0dffb700 1 -- 172.21.15.26:0/3902202287 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc10012430 con 0x7efc18136fe0 2023-10-01T07:59:38.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.014+0000 7efc0dffb700 1 -- 172.21.15.26:0/3902202287 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc10020070 con 0x7efc18136fe0 2023-10-01T07:59:38.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.014+0000 7efc1f6c2700 1 -- 172.21.15.26:0/3902202287 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc10009a70 con 0x7efc18136fe0 2023-10-01T07:59:38.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.014+0000 7efc0dffb700 1 -- 172.21.15.26:0/3902202287 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc10004040 con 0x7efc18136fe0 2023-10-01T07:59:38.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.014+0000 7efc1f6c2700 1 -- 172.21.15.26:0/3902202287 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc18121d40 con 0x7efc18136fe0 2023-10-01T07:59:38.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.015+0000 7efc1f6c2700 1 -- 172.21.15.26:0/3902202287 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc18071d70 con 0x7efc18136fe0 2023-10-01T07:59:38.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.015+0000 7efc0dffb700 1 -- 172.21.15.26:0/3902202287 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efc100041a0 con 0x7efc18136fe0 2023-10-01T07:59:38.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.016+0000 7efc0dffb700 1 -- 172.21.15.26:0/3902202287 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efc10022070 con 0x7efc18136fe0 2023-10-01T07:59:38.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.025+0000 7efc0dffb700 1 -- 172.21.15.26:0/3902202287 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efc100263e0 con 0x7efc18136fe0 2023-10-01T07:59:38.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.048+0000 7fbae6b28700 1 Processor -- start 2023-10-01T07:59:38.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.049+0000 7fbae6b28700 1 -- start start 2023-10-01T07:59:38.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.049+0000 7fbae6b28700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbae006e570 0x7fbae006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:38.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.049+0000 7fbae6b28700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbae006ee80 0x7fbae0134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:38.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.049+0000 7fbae6b28700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbae0070ee0 con 0x7fbae009eca0 2023-10-01T07:59:38.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.049+0000 7fbae6b28700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae0071480 con 0x7fbae006e570 2023-10-01T07:59:38.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.049+0000 7fbae6b28700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbae0071b90 con 0x7fbae006ee80 2023-10-01T07:59:38.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.049+0000 7fbae50c5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbae006ee80 0x7fbae0134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:38.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.049+0000 7fbae50c5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbae006ee80 0x7fbae0134d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56748/0 (socket says 172.21.15.26:56748) 2023-10-01T07:59:38.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.049+0000 7fbae50c5700 1 -- 172.21.15.26:0/3483892741 learned_addr learned my addr 172.21.15.26:0/3483892741 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:38.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.049+0000 7fbae48c4700 1 --2- 172.21.15.26:0/3483892741 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbae006e570 0x7fbae006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:38.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.050+0000 7fbae48c4700 1 -- 172.21.15.26:0/3483892741 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbae006ee80 msgr2=0x7fbae0134d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:38.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.050+0000 7fbae48c4700 1 --2- 172.21.15.26:0/3483892741 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbae006ee80 0x7fbae0134d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.050+0000 7fbae48c4700 1 -- 172.21.15.26:0/3483892741 >> v1:172.21.15.26:6789/0 conn(0x7fbae009eca0 legacy=0x7fbae0134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:38.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.050+0000 7fbae48c4700 1 -- 172.21.15.26:0/3483892741 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae00711a0 con 0x7fbae006e570 2023-10-01T07:59:38.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.050+0000 7fbae48c4700 1 --2- 172.21.15.26:0/3483892741 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbae006e570 0x7fbae006e940 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fbad4009870 tx=0x7fbad4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96a448df1cc99386 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:38.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.050+0000 7fbadf7fe700 1 -- 172.21.15.26:0/3483892741 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad4011830 con 0x7fbae006e570 2023-10-01T07:59:38.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.050+0000 7fbadf7fe700 1 -- 172.21.15.26:0/3483892741 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad4011990 con 0x7fbae006e570 2023-10-01T07:59:38.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.050+0000 7fbadf7fe700 1 -- 172.21.15.26:0/3483892741 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad4011d20 con 0x7fbae006e570 2023-10-01T07:59:38.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.051+0000 7fbae6b28700 1 -- 172.21.15.26:0/3483892741 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbae006e570 msgr2=0x7fbae006e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:38.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.051+0000 7fbae6b28700 1 --2- 172.21.15.26:0/3483892741 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbae006e570 0x7fbae006e940 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fbad4009870 tx=0x7fbad4009b80 comp rx=0 tx=0).stop 2023-10-01T07:59:38.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.051+0000 7fbae6b28700 1 -- 172.21.15.26:0/3483892741 shutdown_connections 2023-10-01T07:59:38.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.051+0000 7fbae6b28700 1 --2- 172.21.15.26:0/3483892741 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbae006ee80 0x7fbae0134d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.051+0000 7fbae6b28700 1 --2- 172.21.15.26:0/3483892741 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbae006e570 0x7fbae006e940 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.051+0000 7fbae6b28700 1 -- 172.21.15.26:0/3483892741 >> 172.21.15.26:0/3483892741 conn(0x7fbae00a2aa0 msgr2=0x7fbae00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:38.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.051+0000 7fbae6b28700 1 -- 172.21.15.26:0/3483892741 shutdown_connections 2023-10-01T07:59:38.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.051+0000 7fbae6b28700 1 -- 172.21.15.26:0/3483892741 wait complete. 2023-10-01T07:59:38.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.052+0000 7fbae6b28700 1 Processor -- start 2023-10-01T07:59:38.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.053+0000 7fbae6b28700 1 -- start start 2023-10-01T07:59:38.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.053+0000 7fbae6b28700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbae006e570 0x7fbae013c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:38.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.053+0000 7fbae6b28700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbae006ee80 0x7fbae0133430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:38.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.053+0000 7fbae6b28700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbae013f080 0x7fbae0133970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:38.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.053+0000 7fbae6b28700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae0134c10 con 0x7fbae013f080 2023-10-01T07:59:38.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.053+0000 7fbae6b28700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae013cc00 con 0x7fbae006ee80 2023-10-01T07:59:38.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.053+0000 7fbae6b28700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbae0135b50 con 0x7fbae006e570 2023-10-01T07:59:38.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.053+0000 7fbadffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbae006ee80 0x7fbae0133430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:38.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.053+0000 7fbae48c4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbae006e570 0x7fbae013c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:38.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.053+0000 7fbadffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbae006ee80 0x7fbae0133430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33354/0 (socket says 172.21.15.26:33354) 2023-10-01T07:59:38.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.053+0000 7fbadffff700 1 -- 172.21.15.26:0/3746465413 learned_addr learned my addr 172.21.15.26:0/3746465413 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:38.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.054+0000 7fbae50c5700 1 --2- 172.21.15.26:0/3746465413 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbae013f080 0x7fbae0133970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:38.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.054+0000 7fbae48c4700 1 -- 172.21.15.26:0/3746465413 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbae006ee80 msgr2=0x7fbae0133430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:38.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.054+0000 7fbae48c4700 1 --2- 172.21.15.26:0/3746465413 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbae006ee80 0x7fbae0133430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.054+0000 7fbae48c4700 1 -- 172.21.15.26:0/3746465413 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbae013f080 msgr2=0x7fbae0133970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:38.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.054+0000 7fbae48c4700 1 --2- 172.21.15.26:0/3746465413 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbae013f080 0x7fbae0133970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.054+0000 7fbae48c4700 1 -- 172.21.15.26:0/3746465413 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad40094a0 con 0x7fbae006e570 2023-10-01T07:59:38.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.054+0000 7fbae50c5700 1 --2- 172.21.15.26:0/3746465413 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbae013f080 0x7fbae0133970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:59:38.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.054+0000 7f2a1c642700 1 Processor -- start 2023-10-01T07:59:38.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.054+0000 7f2a1c642700 1 -- start start 2023-10-01T07:59:38.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.054+0000 7fbae48c4700 1 --2- 172.21.15.26:0/3746465413 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbae006e570 0x7fbae013c0f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fbad4016000 tx=0x7fbad4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:38.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.054+0000 7fbadd7fa700 1 -- 172.21.15.26:0/3746465413 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad4004510 con 0x7fbae006e570 2023-10-01T07:59:38.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.054+0000 7fbadd7fa700 1 -- 172.21.15.26:0/3746465413 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad401f070 con 0x7fbae006e570 2023-10-01T07:59:38.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.054+0000 7fbae6b28700 1 -- 172.21.15.26:0/3746465413 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae0070610 con 0x7fbae006e570 2023-10-01T07:59:38.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.054+0000 7fbadd7fa700 1 -- 172.21.15.26:0/3746465413 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad40038e0 con 0x7fbae006e570 2023-10-01T07:59:38.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.055+0000 7fbae6b28700 1 -- 172.21.15.26:0/3746465413 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae013ec10 con 0x7fbae006e570 2023-10-01T07:59:38.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.056+0000 7fbadd7fa700 1 -- 172.21.15.26:0/3746465413 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbad4003a40 con 0x7fbae006e570 2023-10-01T07:59:38.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.056+0000 7fbadd7fa700 1 -- 172.21.15.26:0/3746465413 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbad4021070 con 0x7fbae006e570 2023-10-01T07:59:38.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.056+0000 7fbae6b28700 1 -- 172.21.15.26:0/3746465413 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbae0074ea0 con 0x7fbae006e570 2023-10-01T07:59:38.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.055+0000 7f2a1c642700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2a14071b40 0x7f2a14130420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:38.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.055+0000 7f2a1c642700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a14130960 0x7f2a14133570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:38.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.055+0000 7f2a1c642700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a14130d50 0x7f2a14133ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:38.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.055+0000 7f2a1c642700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a14099ef0 con 0x7f2a14071b40 2023-10-01T07:59:38.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.055+0000 7f2a1c642700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a14099500 con 0x7f2a14130d50 2023-10-01T07:59:38.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.055+0000 7f2a1c642700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a14099c10 con 0x7f2a14130960 2023-10-01T07:59:38.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.055+0000 7f2a1abdf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a14130d50 0x7f2a14133ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:38.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.055+0000 7f2a1abdf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a14130d50 0x7f2a14133ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33368/0 (socket says 172.21.15.26:33368) 2023-10-01T07:59:38.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.055+0000 7f2a1abdf700 1 -- 172.21.15.26:0/945933228 learned_addr learned my addr 172.21.15.26:0/945933228 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:38.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.056+0000 7f2a1abdf700 1 -- 172.21.15.26:0/945933228 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a14130960 msgr2=0x7f2a14133570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-01T07:59:38.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.056+0000 7f2a19bdd700 1 --2- 172.21.15.26:0/945933228 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a14130960 0x7f2a14133570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:38.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.056+0000 7f2a1abdf700 1 --2- 172.21.15.26:0/945933228 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a14130960 0x7f2a14133570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.056+0000 7f2a1abdf700 1 -- 172.21.15.26:0/945933228 >> v2:172.21.15.26:3300/0 conn(0x7f2a14071b40 msgr2=0x7f2a14130420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:38.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.056+0000 7f2a1abdf700 1 --2- 172.21.15.26:0/945933228 >> v2:172.21.15.26:3300/0 conn(0x7f2a14071b40 0x7f2a14130420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.056+0000 7f2a1abdf700 1 -- 172.21.15.26:0/945933228 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a1409e370 con 0x7f2a14130d50 2023-10-01T07:59:38.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.056+0000 7f2a19bdd700 1 --2- 172.21.15.26:0/945933228 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a14130960 0x7f2a14133570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:59:38.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.056+0000 7f2a1abdf700 1 --2- 172.21.15.26:0/945933228 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a14130d50 0x7f2a14133ab0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c009e50 tx=0x7f2a0c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4fa65bdd27417b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:38.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.057+0000 7f2a193dc700 1 -- 172.21.15.26:0/945933228 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c00e070 con 0x7f2a14130d50 2023-10-01T07:59:38.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.057+0000 7f2a193dc700 1 -- 172.21.15.26:0/945933228 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0c00b9c0 con 0x7f2a14130d50 2023-10-01T07:59:38.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.057+0000 7f2a193dc700 1 -- 172.21.15.26:0/945933228 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c00bd70 con 0x7f2a14130d50 2023-10-01T07:59:38.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.058+0000 7f2a1c642700 1 -- 172.21.15.26:0/945933228 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a14130d50 msgr2=0x7f2a14133ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:38.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.058+0000 7f2a1c642700 1 --2- 172.21.15.26:0/945933228 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a14130d50 0x7f2a14133ab0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c009e50 tx=0x7f2a0c00b330 comp rx=0 tx=0).stop 2023-10-01T07:59:38.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.058+0000 7f2a1c642700 1 -- 172.21.15.26:0/945933228 shutdown_connections 2023-10-01T07:59:38.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.058+0000 7f2a1c642700 1 --2- 172.21.15.26:0/945933228 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a14130d50 0x7f2a14133ab0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.058+0000 7f2a1c642700 1 --2- 172.21.15.26:0/945933228 >> v2:172.21.15.26:3300/0 conn(0x7f2a14071b40 0x7f2a14130420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.058+0000 7f2a1c642700 1 --2- 172.21.15.26:0/945933228 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a14130960 0x7f2a14133570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.058+0000 7f2a1c642700 1 -- 172.21.15.26:0/945933228 >> 172.21.15.26:0/945933228 conn(0x7f2a1409e7e0 msgr2=0x7f2a1409ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:38.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.058+0000 7f2a1c642700 1 -- 172.21.15.26:0/945933228 shutdown_connections 2023-10-01T07:59:38.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.058+0000 7f2a1c642700 1 -- 172.21.15.26:0/945933228 wait complete. 2023-10-01T07:59:38.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.060+0000 7f2a1c642700 1 Processor -- start 2023-10-01T07:59:38.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.060+0000 7f2a1c642700 1 -- start start 2023-10-01T07:59:38.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.060+0000 7f2a1c642700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a14071b40 0x7f2a1412ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:38.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.060+0000 7f2a1c642700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a14130960 0x7f2a1412d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:38.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.060+0000 7f2a1c642700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a14130d50 0x7f2a1412d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:38.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.060+0000 7f2a1c642700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1412ea20 con 0x7f2a14130d50 2023-10-01T07:59:38.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.060+0000 7f2a1c642700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1408b6f0 con 0x7f2a14130960 2023-10-01T07:59:38.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.060+0000 7f2a1c642700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1408b070 con 0x7f2a14071b40 2023-10-01T07:59:38.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.061+0000 7f2a1a3de700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a14071b40 0x7f2a1412ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:38.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.061+0000 7f2a1a3de700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a14071b40 0x7f2a1412ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56780/0 (socket says 172.21.15.26:56780) 2023-10-01T07:59:38.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.061+0000 7f2a1a3de700 1 -- 172.21.15.26:0/2017460643 learned_addr learned my addr 172.21.15.26:0/2017460643 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:38.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.061+0000 7f2a19bdd700 1 --2- 172.21.15.26:0/2017460643 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a14130960 0x7f2a1412d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:38.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.061+0000 7f2a19bdd700 1 -- 172.21.15.26:0/2017460643 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a14071b40 msgr2=0x7f2a1412ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:38.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.061+0000 7f2a19bdd700 1 --2- 172.21.15.26:0/2017460643 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a14071b40 0x7f2a1412ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.061+0000 7f2a19bdd700 1 -- 172.21.15.26:0/2017460643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a14130d50 msgr2=0x7f2a1412d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:38.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.061+0000 7f2a19bdd700 1 --2- 172.21.15.26:0/2017460643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a14130d50 0x7f2a1412d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.061+0000 7f2a19bdd700 1 -- 172.21.15.26:0/2017460643 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a0c009b30 con 0x7f2a14130960 2023-10-01T07:59:38.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.061+0000 7f2a1a3de700 1 --2- 172.21.15.26:0/2017460643 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a14071b40 0x7f2a1412ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:38.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.061+0000 7f2a19bdd700 1 --2- 172.21.15.26:0/2017460643 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a14130960 0x7f2a1412d230 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f2a0400c7f0 tx=0x7f2a0400cb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:38.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.062+0000 7f2a0affd700 1 -- 172.21.15.26:0/2017460643 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a04011800 con 0x7f2a14130960 2023-10-01T07:59:38.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.062+0000 7f2a0affd700 1 -- 172.21.15.26:0/2017460643 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a04011960 con 0x7f2a14130960 2023-10-01T07:59:38.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.062+0000 7f2a1c642700 1 -- 172.21.15.26:0/2017460643 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a1408b330 con 0x7f2a14130960 2023-10-01T07:59:38.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.062+0000 7f2a0affd700 1 -- 172.21.15.26:0/2017460643 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a04011cf0 con 0x7f2a14130960 2023-10-01T07:59:38.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.062+0000 7f2a1c642700 1 -- 172.21.15.26:0/2017460643 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a1408bda0 con 0x7f2a14130960 2023-10-01T07:59:38.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.063+0000 7f2a0affd700 1 -- 172.21.15.26:0/2017460643 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2a04018360 con 0x7f2a14130960 2023-10-01T07:59:38.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.063+0000 7f2a0affd700 1 -- 172.21.15.26:0/2017460643 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2a0403f6c0 con 0x7f2a14130960 2023-10-01T07:59:38.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.063+0000 7f2a1c642700 1 -- 172.21.15.26:0/2017460643 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a141295b0 con 0x7f2a14130960 2023-10-01T07:59:38.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.064+0000 7fbadd7fa700 1 -- 172.21.15.26:0/3746465413 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbad402b020 con 0x7fbae006e570 2023-10-01T07:59:38.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.069+0000 7f2a0affd700 1 -- 172.21.15.26:0/2017460643 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2a04018610 con 0x7f2a14130960 2023-10-01T07:59:38.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.095+0000 7f344cde2700 1 Processor -- start 2023-10-01T07:59:38.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.095+0000 7f344cde2700 1 -- start start 2023-10-01T07:59:38.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.096+0000 7f344cde2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3448133420 0x7f34481337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:38.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.096+0000 7f344cde2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3448133e30 0x7f344812ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:38.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.096+0000 7f344cde2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f344806b990 con 0x7f3448134260 2023-10-01T07:59:38.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.096+0000 7f344cde2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34480a0590 con 0x7f3448133e30 2023-10-01T07:59:38.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.096+0000 7f344cde2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f344809fb80 con 0x7f3448133420 2023-10-01T07:59:38.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.096+0000 7f3445d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3448133e30 0x7f344812ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:38.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.096+0000 7f3445d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3448133e30 0x7f344812ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37054/0 (socket says 172.21.15.26:37054) 2023-10-01T07:59:38.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.096+0000 7f3445d9b700 1 -- 172.21.15.26:0/3741172778 learned_addr learned my addr 172.21.15.26:0/3741172778 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:38.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.097+0000 7f3445d9b700 1 -- 172.21.15.26:0/3741172778 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3448133420 msgr2=0x7f34481337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:38.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.097+0000 7f3445d9b700 1 --2- 172.21.15.26:0/3741172778 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3448133420 0x7f34481337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.097+0000 7f3445d9b700 1 -- 172.21.15.26:0/3741172778 >> v1:172.21.15.26:6789/0 conn(0x7f3448134260 legacy=0x7f34481304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:38.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.097+0000 7f3445d9b700 1 -- 172.21.15.26:0/3741172778 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34480a0030 con 0x7f3448133e30 2023-10-01T07:59:38.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.097+0000 7f3445d9b700 1 --2- 172.21.15.26:0/3741172778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3448133e30 0x7f344812ff90 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f343c0098f0 tx=0x7f343c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af9f1080296f0655 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:38.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.097+0000 7f344559a700 1 -- 172.21.15.26:0/3741172778 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343c004230 con 0x7f3448133e30 2023-10-01T07:59:38.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.097+0000 7f344559a700 1 -- 172.21.15.26:0/3741172778 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343c004390 con 0x7f3448133e30 2023-10-01T07:59:38.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.097+0000 7f344559a700 1 -- 172.21.15.26:0/3741172778 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343c0036a0 con 0x7f3448133e30 2023-10-01T07:59:38.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.098+0000 7f344cde2700 1 -- 172.21.15.26:0/3741172778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3448133e30 msgr2=0x7f344812ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:38.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.098+0000 7f344cde2700 1 --2- 172.21.15.26:0/3741172778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3448133e30 0x7f344812ff90 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f343c0098f0 tx=0x7f343c009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:38.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.098+0000 7f344cde2700 1 -- 172.21.15.26:0/3741172778 shutdown_connections 2023-10-01T07:59:38.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.098+0000 7f344cde2700 1 --2- 172.21.15.26:0/3741172778 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3448133420 0x7f34481337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.098+0000 7f344cde2700 1 --2- 172.21.15.26:0/3741172778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3448133e30 0x7f344812ff90 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.098+0000 7f344cde2700 1 -- 172.21.15.26:0/3741172778 >> 172.21.15.26:0/3741172778 conn(0x7f34480a4210 msgr2=0x7f34480a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:38.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.098+0000 7f344cde2700 1 -- 172.21.15.26:0/3741172778 shutdown_connections 2023-10-01T07:59:38.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.098+0000 7f344cde2700 1 -- 172.21.15.26:0/3741172778 wait complete. 2023-10-01T07:59:38.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.099+0000 7f344cde2700 1 Processor -- start 2023-10-01T07:59:38.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.099+0000 7f344cde2700 1 -- start start 2023-10-01T07:59:38.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.100+0000 7f344cde2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3448133420 0x7f34481207d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:38.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.100+0000 7f344cde2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3448133e30 0x7f344809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:38.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.100+0000 7f344cde2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3448134260 0x7f344809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:38.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.100+0000 7f344cde2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3448120f70 con 0x7f3448134260 2023-10-01T07:59:38.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.100+0000 7f344cde2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f344811fff0 con 0x7f3448133420 2023-10-01T07:59:38.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.100+0000 7f344cde2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f344812d6e0 con 0x7f3448133e30 2023-10-01T07:59:38.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.100+0000 7f344659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3448133420 0x7f34481207d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:38.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.100+0000 7f3446d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3448134260 0x7f344809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:38.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.100+0000 7f344659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3448133420 0x7f34481207d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33398/0 (socket says 172.21.15.26:33398) 2023-10-01T07:59:38.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.100+0000 7f344659c700 1 -- 172.21.15.26:0/4238913012 learned_addr learned my addr 172.21.15.26:0/4238913012 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:38.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.100+0000 7f3446d9d700 1 -- 172.21.15.26:0/4238913012 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3448133e30 msgr2=0x7f344809c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:38.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.100+0000 7f3446d9d700 1 --2- 172.21.15.26:0/4238913012 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3448133e30 0x7f344809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.100+0000 7f3446d9d700 1 -- 172.21.15.26:0/4238913012 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3448133420 msgr2=0x7f34481207d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:38.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.100+0000 7f3446d9d700 1 --2- 172.21.15.26:0/4238913012 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3448133420 0x7f34481207d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.100+0000 7f3446d9d700 1 -- 172.21.15.26:0/4238913012 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343c009550 con 0x7f3448134260 2023-10-01T07:59:38.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.100+0000 7f3446d9d700 1 --2- 172.21.15.26:0/4238913012 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3448134260 0x7f344809c9c0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f344000c8b0 tx=0x7f344000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:38.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.101+0000 7f3436ffd700 1 -- 172.21.15.26:0/4238913012 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3440003e30 con 0x7f3448134260 2023-10-01T07:59:38.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.101+0000 7f3436ffd700 1 -- 172.21.15.26:0/4238913012 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3440005070 con 0x7f3448134260 2023-10-01T07:59:38.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.101+0000 7f3436ffd700 1 -- 172.21.15.26:0/4238913012 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3440005420 con 0x7f3448134260 2023-10-01T07:59:38.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.101+0000 7f344cde2700 1 -- 172.21.15.26:0/4238913012 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f344809e1c0 con 0x7f3448134260 2023-10-01T07:59:38.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.101+0000 7f344cde2700 1 -- 172.21.15.26:0/4238913012 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f344809cf00 con 0x7f3448134260 2023-10-01T07:59:38.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.102+0000 7f344cde2700 1 -- 172.21.15.26:0/4238913012 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f344812dc30 con 0x7f3448134260 2023-10-01T07:59:38.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.103+0000 7f3436ffd700 1 -- 172.21.15.26:0/4238913012 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3440005580 con 0x7f3448134260 2023-10-01T07:59:38.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.106+0000 7f3436ffd700 1 -- 172.21.15.26:0/4238913012 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3440005830 con 0x7f3448134260 2023-10-01T07:59:38.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.107+0000 7f3436ffd700 1 -- 172.21.15.26:0/4238913012 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3440025430 con 0x7f3448134260 2023-10-01T07:59:38.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.279+0000 7efc1f6c2700 1 -- 172.21.15.26:0/3902202287 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efc1806d4c0 con 0x7efc18136fe0 2023-10-01T07:59:38.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.280+0000 7efc0dffb700 1 -- 172.21.15.26:0/3902202287 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efc1001ab70 con 0x7efc18136fe0 2023-10-01T07:59:38.280 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:38.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.280+0000 7f2a1c642700 1 -- 172.21.15.26:0/2017460643 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2a140747f0 con 0x7f2a14130960 2023-10-01T07:59:38.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.280+0000 7f2a0affd700 1 -- 172.21.15.26:0/2017460643 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2a04019ed0 con 0x7f2a14130960 2023-10-01T07:59:38.281 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:38.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.283+0000 7f2a1c642700 1 -- 172.21.15.26:0/2017460643 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a14130960 msgr2=0x7f2a1412d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:38.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.283+0000 7f2a1c642700 1 --2- 172.21.15.26:0/2017460643 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a14130960 0x7f2a1412d230 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f2a0400c7f0 tx=0x7f2a0400cb00 comp rx=0 tx=0).stop 2023-10-01T07:59:38.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.283+0000 7f2a1c642700 1 -- 172.21.15.26:0/2017460643 shutdown_connections 2023-10-01T07:59:38.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.283+0000 7f2a1c642700 1 --2- 172.21.15.26:0/2017460643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a14130d50 0x7f2a1412d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.283+0000 7f2a1c642700 1 --2- 172.21.15.26:0/2017460643 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a14071b40 0x7f2a1412ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.283+0000 7f2a1c642700 1 --2- 172.21.15.26:0/2017460643 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a14130960 0x7f2a1412d230 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.283+0000 7f2a1c642700 1 -- 172.21.15.26:0/2017460643 >> 172.21.15.26:0/2017460643 conn(0x7f2a1409e7e0 msgr2=0x7f2a14133830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:38.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.283+0000 7efc1f6c2700 1 -- 172.21.15.26:0/3902202287 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efc18136fe0 msgr2=0x7efc1806b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:38.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.283+0000 7efc1f6c2700 1 --2- 172.21.15.26:0/3902202287 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efc18136fe0 0x7efc1806b8b0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7efc10016000 tx=0x7efc10004ad0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.283+0000 7efc1f6c2700 1 -- 172.21.15.26:0/3902202287 shutdown_connections 2023-10-01T07:59:38.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.283+0000 7efc1f6c2700 1 --2- 172.21.15.26:0/3902202287 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efc18136fe0 0x7efc1806b8b0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.283+0000 7efc1f6c2700 1 --2- 172.21.15.26:0/3902202287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc1809e930 0x7efc181c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.283+0000 7efc1f6c2700 1 --2- 172.21.15.26:0/3902202287 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc1809f410 0x7efc181c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.283+0000 7efc1f6c2700 1 -- 172.21.15.26:0/3902202287 >> 172.21.15.26:0/3902202287 conn(0x7efc180a4210 msgr2=0x7efc18135c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:38.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.283+0000 7f2a1c642700 1 -- 172.21.15.26:0/2017460643 shutdown_connections 2023-10-01T07:59:38.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.283+0000 7f2a1c642700 1 -- 172.21.15.26:0/2017460643 wait complete. 2023-10-01T07:59:38.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.284+0000 7efc1f6c2700 1 -- 172.21.15.26:0/3902202287 shutdown_connections 2023-10-01T07:59:38.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.284+0000 7efc1f6c2700 1 -- 172.21.15.26:0/3902202287 wait complete. 2023-10-01T07:59:38.302 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:38.303 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:38.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.318+0000 7fbae6b28700 1 -- 172.21.15.26:0/3746465413 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbae013d9d0 con 0x7fbae006e570 2023-10-01T07:59:38.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.318+0000 7fbadd7fa700 1 -- 172.21.15.26:0/3746465413 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbad402b020 con 0x7fbae006e570 2023-10-01T07:59:38.319 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:38.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.320+0000 7f344cde2700 1 -- 172.21.15.26:0/4238913012 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3448074ea0 con 0x7f3448134260 2023-10-01T07:59:38.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.320+0000 7f3436ffd700 1 -- 172.21.15.26:0/4238913012 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f34400243e0 con 0x7f3448134260 2023-10-01T07:59:38.321 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:38.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.321+0000 7fbae6b28700 1 -- 172.21.15.26:0/3746465413 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbae006e570 msgr2=0x7fbae013c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:38.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.321+0000 7fbae6b28700 1 --2- 172.21.15.26:0/3746465413 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbae006e570 0x7fbae013c0f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fbad4016000 tx=0x7fbad4004750 comp rx=0 tx=0).stop 2023-10-01T07:59:38.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.321+0000 7fbae6b28700 1 -- 172.21.15.26:0/3746465413 shutdown_connections 2023-10-01T07:59:38.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.321+0000 7fbae6b28700 1 --2- 172.21.15.26:0/3746465413 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbae013f080 0x7fbae0133970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.321+0000 7fbae6b28700 1 --2- 172.21.15.26:0/3746465413 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbae006e570 0x7fbae013c0f0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.321+0000 7fbae6b28700 1 --2- 172.21.15.26:0/3746465413 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbae006ee80 0x7fbae0133430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.321+0000 7fbae6b28700 1 -- 172.21.15.26:0/3746465413 >> 172.21.15.26:0/3746465413 conn(0x7fbae00a2aa0 msgr2=0x7fbae009e190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:38.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.321+0000 7fbae6b28700 1 -- 172.21.15.26:0/3746465413 shutdown_connections 2023-10-01T07:59:38.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.321+0000 7fbae6b28700 1 -- 172.21.15.26:0/3746465413 wait complete. 2023-10-01T07:59:38.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.323+0000 7f344cde2700 1 -- 172.21.15.26:0/4238913012 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3448134260 msgr2=0x7f344809c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:38.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.323+0000 7f344cde2700 1 --2- 172.21.15.26:0/4238913012 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3448134260 0x7f344809c9c0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f344000c8b0 tx=0x7f344000cbc0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.323+0000 7f344cde2700 1 -- 172.21.15.26:0/4238913012 shutdown_connections 2023-10-01T07:59:38.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.323+0000 7f344cde2700 1 --2- 172.21.15.26:0/4238913012 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3448134260 0x7f344809c9c0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.323+0000 7f344cde2700 1 --2- 172.21.15.26:0/4238913012 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3448133420 0x7f34481207d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.323+0000 7f344cde2700 1 --2- 172.21.15.26:0/4238913012 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3448133e30 0x7f344809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:38.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.323+0000 7f344cde2700 1 -- 172.21.15.26:0/4238913012 >> 172.21.15.26:0/4238913012 conn(0x7f34480a4210 msgr2=0x7f344812e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:38.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.323+0000 7f344cde2700 1 -- 172.21.15.26:0/4238913012 shutdown_connections 2023-10-01T07:59:38.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:38.323+0000 7f344cde2700 1 -- 172.21.15.26:0/4238913012 wait complete. 2023-10-01T07:59:38.337 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:38.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:39.303 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:39.304 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:39.338 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:39.338 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:39.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.457+0000 7f9903488700 1 Processor -- start 2023-10-01T07:59:39.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.457+0000 7f6f68ac1700 1 Processor -- start 2023-10-01T07:59:39.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.457+0000 7f6f68ac1700 1 -- start start 2023-10-01T07:59:39.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.458+0000 7f9903488700 1 -- start start 2023-10-01T07:59:39.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.458+0000 7f9903488700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f98fc06f5d0 0x7f98fc12ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:39.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.458+0000 7f9903488700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f98fc135c20 0x7f98fc138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:39.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.458+0000 7f9903488700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98fc06fa40 con 0x7f98fc12cf60 2023-10-01T07:59:39.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.458+0000 7f9903488700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98fc12cd90 con 0x7f98fc135c20 2023-10-01T07:59:39.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.458+0000 7f9903488700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc071780 con 0x7f98fc06f5d0 2023-10-01T07:59:39.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.458+0000 7f6f68ac1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f6409f330 0x7f6f64138f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:39.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.458+0000 7f6f68ac1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6f64139450 0x7f6f6413b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:39.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.458+0000 7f6f68ac1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f6406bec0 con 0x7f6f6409e850 2023-10-01T07:59:39.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.458+0000 7f6f68ac1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f640a0030 con 0x7f6f64139450 2023-10-01T07:59:39.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.458+0000 7f6f68ac1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f640a0830 con 0x7f6f6409f330 2023-10-01T07:59:39.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.458+0000 7f9900a23700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f98fc06f5d0 0x7f98fc12ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:39.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.458+0000 7f9900a23700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f98fc06f5d0 0x7f98fc12ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33412/0 (socket says 172.21.15.26:33412) 2023-10-01T07:59:39.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.459+0000 7f9900a23700 1 -- 172.21.15.26:0/3316054003 learned_addr learned my addr 172.21.15.26:0/3316054003 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:39.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.458+0000 7f6f62d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6f64139450 0x7f6f6413b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:39.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.458+0000 7f6f62d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6f64139450 0x7f6f6413b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37068/0 (socket says 172.21.15.26:37068) 2023-10-01T07:59:39.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.458+0000 7f6f62d9d700 1 -- 172.21.15.26:0/499293745 learned_addr learned my addr 172.21.15.26:0/499293745 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:39.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.459+0000 7f9901a25700 1 --2- 172.21.15.26:0/3316054003 >> v2:172.21.15.26:3300/0 conn(0x7f98fc135c20 0x7f98fc138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:39.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.459+0000 7f9900a23700 1 -- 172.21.15.26:0/3316054003 >> v2:172.21.15.26:3300/0 conn(0x7f98fc135c20 msgr2=0x7f98fc138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:39.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.459+0000 7f9900a23700 1 --2- 172.21.15.26:0/3316054003 >> v2:172.21.15.26:3300/0 conn(0x7f98fc135c20 0x7f98fc138000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.459+0000 7f9900a23700 1 -- 172.21.15.26:0/3316054003 >> v1:172.21.15.26:6789/0 conn(0x7f98fc12cf60 legacy=0x7f98fc12f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:39.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.459+0000 7f9900a23700 1 -- 172.21.15.26:0/3316054003 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98fc071a40 con 0x7f98fc06f5d0 2023-10-01T07:59:39.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.459+0000 7f9901a25700 1 --2- 172.21.15.26:0/3316054003 >> v2:172.21.15.26:3300/0 conn(0x7f98fc135c20 0x7f98fc138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:59:39.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.459+0000 7f6f61d9b700 1 --2- 172.21.15.26:0/499293745 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f6409f330 0x7f6f64138f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:39.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.459+0000 7f6f62d9d700 1 -- 172.21.15.26:0/499293745 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f6409f330 msgr2=0x7f6f64138f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:39.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.459+0000 7f6f62d9d700 1 --2- 172.21.15.26:0/499293745 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f6409f330 0x7f6f64138f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.459+0000 7f6f62d9d700 1 -- 172.21.15.26:0/499293745 >> v1:172.21.15.26:6789/0 conn(0x7f6f6409e850 legacy=0x7f6f6409ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:39.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.459+0000 7f6f62d9d700 1 -- 172.21.15.26:0/499293745 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6406caa0 con 0x7f6f64139450 2023-10-01T07:59:39.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.459+0000 7f6f61d9b700 1 --2- 172.21.15.26:0/499293745 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f6409f330 0x7f6f64138f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:59:39.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.459+0000 7f6f62d9d700 1 --2- 172.21.15.26:0/499293745 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f64139450 0x7f6f6413b830 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c009e50 tx=0x7f6f5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5171708697ab55 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:39.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.459+0000 7f9900a23700 1 --2- 172.21.15.26:0/3316054003 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f98fc06f5d0 0x7f98fc12ffc0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f98ec00bb90 tx=0x7f98ec00bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9da49194c84ae3c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:39.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.459+0000 7f6f6159a700 1 -- 172.21.15.26:0/499293745 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c00e070 con 0x7f6f64139450 2023-10-01T07:59:39.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.460+0000 7f98f3fff700 1 -- 172.21.15.26:0/3316054003 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ec00dc40 con 0x7f98fc06f5d0 2023-10-01T07:59:39.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.460+0000 7f98f3fff700 1 -- 172.21.15.26:0/3316054003 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ec00dda0 con 0x7f98fc06f5d0 2023-10-01T07:59:39.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.460+0000 7f98f3fff700 1 -- 172.21.15.26:0/3316054003 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ec017630 con 0x7f98fc06f5d0 2023-10-01T07:59:39.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.460+0000 7f6f6159a700 1 -- 172.21.15.26:0/499293745 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5c00b9c0 con 0x7f6f64139450 2023-10-01T07:59:39.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.460+0000 7f6f6159a700 1 -- 172.21.15.26:0/499293745 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c00bd70 con 0x7f6f64139450 2023-10-01T07:59:39.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.460+0000 7f9903488700 1 -- 172.21.15.26:0/3316054003 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f98fc06f5d0 msgr2=0x7f98fc12ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:39.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.460+0000 7f9903488700 1 --2- 172.21.15.26:0/3316054003 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f98fc06f5d0 0x7f98fc12ffc0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f98ec00bb90 tx=0x7f98ec00bea0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.460+0000 7f6f68ac1700 1 -- 172.21.15.26:0/499293745 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f64139450 msgr2=0x7f6f6413b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:39.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.460+0000 7f6f68ac1700 1 --2- 172.21.15.26:0/499293745 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f64139450 0x7f6f6413b830 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c009e50 tx=0x7f6f5c00b330 comp rx=0 tx=0).stop 2023-10-01T07:59:39.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.460+0000 7f9903488700 1 -- 172.21.15.26:0/3316054003 shutdown_connections 2023-10-01T07:59:39.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.460+0000 7f9903488700 1 --2- 172.21.15.26:0/3316054003 >> v2:172.21.15.26:3300/0 conn(0x7f98fc135c20 0x7f98fc138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.460+0000 7f9903488700 1 --2- 172.21.15.26:0/3316054003 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f98fc06f5d0 0x7f98fc12ffc0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.461+0000 7f9903488700 1 -- 172.21.15.26:0/3316054003 >> 172.21.15.26:0/3316054003 conn(0x7f98fc0a2aa0 msgr2=0x7f98fc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:39.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.461+0000 7f6f68ac1700 1 -- 172.21.15.26:0/499293745 shutdown_connections 2023-10-01T07:59:39.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.461+0000 7f6f68ac1700 1 --2- 172.21.15.26:0/499293745 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f64139450 0x7f6f6413b830 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.461+0000 7f6f68ac1700 1 --2- 172.21.15.26:0/499293745 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f6409f330 0x7f6f64138f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.461+0000 7f6f68ac1700 1 -- 172.21.15.26:0/499293745 >> 172.21.15.26:0/499293745 conn(0x7f6f640a3f70 msgr2=0x7f6f640a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:39.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.461+0000 7f9903488700 1 -- 172.21.15.26:0/3316054003 shutdown_connections 2023-10-01T07:59:39.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.461+0000 7f6f68ac1700 1 -- 172.21.15.26:0/499293745 shutdown_connections 2023-10-01T07:59:39.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.461+0000 7f9903488700 1 -- 172.21.15.26:0/3316054003 wait complete. 2023-10-01T07:59:39.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.461+0000 7f6f68ac1700 1 -- 172.21.15.26:0/499293745 wait complete. 2023-10-01T07:59:39.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.462+0000 7f6f68ac1700 1 Processor -- start 2023-10-01T07:59:39.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.462+0000 7f9903488700 1 Processor -- start 2023-10-01T07:59:39.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.462+0000 7f6f68ac1700 1 -- start start 2023-10-01T07:59:39.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.462+0000 7f6f68ac1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f6409e850 0x7f6f6411a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:39.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.462+0000 7f6f68ac1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f6409f330 0x7f6f6411add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:39.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.462+0000 7f6f68ac1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f64139450 0x7f6f641cc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:39.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.462+0000 7f6f68ac1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6411b9f0 con 0x7f6f6409f330 2023-10-01T07:59:39.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.463+0000 7f6f68ac1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f641346d0 con 0x7f6f6409e850 2023-10-01T07:59:39.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.463+0000 7f6f68ac1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6411e580 con 0x7f6f64139450 2023-10-01T07:59:39.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.463+0000 7f6f62d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f64139450 0x7f6f641cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:39.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.463+0000 7f6f61d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f6409f330 0x7f6f6411add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:39.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.463+0000 7f6f62d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f64139450 0x7f6f641cc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56798/0 (socket says 172.21.15.26:56798) 2023-10-01T07:59:39.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.463+0000 7f6f62d9d700 1 -- 172.21.15.26:0/3539179427 learned_addr learned my addr 172.21.15.26:0/3539179427 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:39.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.463+0000 7f6f62d9d700 1 -- 172.21.15.26:0/3539179427 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f6409e850 msgr2=0x7f6f6411a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:39.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.463+0000 7f6f62d9d700 1 --2- 172.21.15.26:0/3539179427 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f6409e850 0x7f6f6411a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.463+0000 7f6f62d9d700 1 -- 172.21.15.26:0/3539179427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f6409f330 msgr2=0x7f6f6411add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:39.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.463+0000 7f6f62d9d700 1 --2- 172.21.15.26:0/3539179427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f6409f330 0x7f6f6411add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.463+0000 7f6f62d9d700 1 -- 172.21.15.26:0/3539179427 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5c009b30 con 0x7f6f64139450 2023-10-01T07:59:39.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.462+0000 7f9903488700 1 -- start start 2023-10-01T07:59:39.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.463+0000 7f9903488700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98fc06f5d0 0x7f98fc1214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:39.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.463+0000 7f9903488700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98fc12cf60 0x7f98fc121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:39.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.463+0000 7f9903488700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f98fc135c20 0x7f98fc121f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:39.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.463+0000 7f9903488700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc12c130 con 0x7f98fc12cf60 2023-10-01T07:59:39.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.463+0000 7f9903488700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc124b30 con 0x7f98fc135c20 2023-10-01T07:59:39.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.463+0000 7f9903488700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc122fa0 con 0x7f98fc06f5d0 2023-10-01T07:59:39.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.463+0000 7f6f62d9d700 1 --2- 172.21.15.26:0/3539179427 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f64139450 0x7f6f641cc900 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c0042f0 tx=0x7f6f5c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:39.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.463+0000 7f9900a23700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98fc12cf60 0x7f98fc121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:39.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.463+0000 7f9900a23700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98fc12cf60 0x7f98fc121a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37094/0 (socket says 172.21.15.26:37094) 2023-10-01T07:59:39.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.463+0000 7f9900a23700 1 -- 172.21.15.26:0/2712829174 learned_addr learned my addr 172.21.15.26:0/2712829174 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:39.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.464+0000 7f6f52ffd700 1 -- 172.21.15.26:0/3539179427 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c0092e0 con 0x7f6f64139450 2023-10-01T07:59:39.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.464+0000 7f6f52ffd700 1 -- 172.21.15.26:0/3539179427 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5c0099b0 con 0x7f6f64139450 2023-10-01T07:59:39.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.464+0000 7f6f52ffd700 1 -- 172.21.15.26:0/3539179427 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c01c660 con 0x7f6f64139450 2023-10-01T07:59:39.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.464+0000 7f9901a25700 1 --2- 172.21.15.26:0/2712829174 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f98fc135c20 0x7f98fc121f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:39.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.464+0000 7f9901224700 1 --2- 172.21.15.26:0/2712829174 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98fc06f5d0 0x7f98fc1214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:39.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.464+0000 7f9900a23700 1 -- 172.21.15.26:0/2712829174 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98fc06f5d0 msgr2=0x7f98fc1214e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:39.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.464+0000 7f9900a23700 1 --2- 172.21.15.26:0/2712829174 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98fc06f5d0 0x7f98fc1214e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.464+0000 7f9900a23700 1 -- 172.21.15.26:0/2712829174 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f98fc135c20 msgr2=0x7f98fc121f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:39.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.464+0000 7f9900a23700 1 --2- 172.21.15.26:0/2712829174 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f98fc135c20 0x7f98fc121f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.464+0000 7f9900a23700 1 -- 172.21.15.26:0/2712829174 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ec00b7f0 con 0x7f98fc12cf60 2023-10-01T07:59:39.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.464+0000 7f6f68ac1700 1 -- 172.21.15.26:0/3539179427 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f6406ccc0 con 0x7f6f64139450 2023-10-01T07:59:39.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.464+0000 7f6f68ac1700 1 -- 172.21.15.26:0/3539179427 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f6411d0c0 con 0x7f6f64139450 2023-10-01T07:59:39.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.465+0000 7f9900a23700 1 --2- 172.21.15.26:0/2712829174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98fc12cf60 0x7f98fc121a20 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f98ec019040 tx=0x7f98ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:39.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.465+0000 7f98f1ffb700 1 -- 172.21.15.26:0/2712829174 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ec017590 con 0x7f98fc12cf60 2023-10-01T07:59:39.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.465+0000 7f98f1ffb700 1 -- 172.21.15.26:0/2712829174 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ec0179f0 con 0x7f98fc12cf60 2023-10-01T07:59:39.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.465+0000 7f98f1ffb700 1 -- 172.21.15.26:0/2712829174 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ec017da0 con 0x7f98fc12cf60 2023-10-01T07:59:39.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.465+0000 7f9903488700 1 -- 172.21.15.26:0/2712829174 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98fc129fa0 con 0x7f98fc12cf60 2023-10-01T07:59:39.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.465+0000 7f9903488700 1 -- 172.21.15.26:0/2712829174 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98fc123b70 con 0x7f98fc12cf60 2023-10-01T07:59:39.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.465+0000 7f6f52ffd700 1 -- 172.21.15.26:0/3539179427 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6f5c01c7c0 con 0x7f6f64139450 2023-10-01T07:59:39.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.465+0000 7f6f68ac1700 1 -- 172.21.15.26:0/3539179427 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f640747f0 con 0x7f6f64139450 2023-10-01T07:59:39.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.465+0000 7f6f52ffd700 1 -- 172.21.15.26:0/3539179427 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6f5c041540 con 0x7f6f64139450 2023-10-01T07:59:39.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.466+0000 7f9903488700 1 -- 172.21.15.26:0/2712829174 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98fc124010 con 0x7f98fc12cf60 2023-10-01T07:59:39.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.467+0000 7f98f1ffb700 1 -- 172.21.15.26:0/2712829174 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f98ec015070 con 0x7f98fc12cf60 2023-10-01T07:59:39.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.471+0000 7f98f1ffb700 1 -- 172.21.15.26:0/2712829174 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f98ec028580 con 0x7f98fc12cf60 2023-10-01T07:59:39.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.471+0000 7f6f52ffd700 1 -- 172.21.15.26:0/3539179427 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f5c0257d0 con 0x7f6f64139450 2023-10-01T07:59:39.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.476+0000 7f98f1ffb700 1 -- 172.21.15.26:0/2712829174 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f98ec01e950 con 0x7f98fc12cf60 2023-10-01T07:59:39.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.500+0000 7f705059a700 1 Processor -- start 2023-10-01T07:59:39.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.500+0000 7f705059a700 1 -- start start 2023-10-01T07:59:39.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.501+0000 7f705059a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f704809d9f0 0x7f7048136530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:39.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.501+0000 7f705059a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7048136a70 0x7f7048138e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:39.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.501+0000 7f705059a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f704809e130 con 0x7f70481316c0 2023-10-01T07:59:39.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.501+0000 7f705059a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70481321a0 con 0x7f704809d9f0 2023-10-01T07:59:39.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.501+0000 7f705059a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70481312b0 con 0x7f7048136a70 2023-10-01T07:59:39.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.501+0000 7f704db35700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f704809d9f0 0x7f7048136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:39.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.501+0000 7f704db35700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f704809d9f0 0x7f7048136530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37096/0 (socket says 172.21.15.26:37096) 2023-10-01T07:59:39.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.501+0000 7f704db35700 1 -- 172.21.15.26:0/1899757868 learned_addr learned my addr 172.21.15.26:0/1899757868 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:39.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.501+0000 7f704e336700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f70481316c0 0x7f7048131a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56368/0 (socket says 172.21.15.26:56368) 2023-10-01T07:59:39.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.501+0000 7f704eb37700 1 --2- 172.21.15.26:0/1899757868 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7048136a70 0x7f7048138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:39.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.502+0000 7f704d334700 1 -- 172.21.15.26:0/1899757868 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 173687117 0 0) 0x7f7044001110 con 0x7f70481316c0 2023-10-01T07:59:39.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.502+0000 7f704d334700 1 -- 172.21.15.26:0/1899757868 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70340035b0 con 0x7f70481316c0 2023-10-01T07:59:39.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.502+0000 7f704db35700 1 -- 172.21.15.26:0/1899757868 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7048136a70 msgr2=0x7f7048138e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:39.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.502+0000 7f704db35700 1 --2- 172.21.15.26:0/1899757868 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7048136a70 0x7f7048138e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.502+0000 7f704db35700 1 -- 172.21.15.26:0/1899757868 >> v1:172.21.15.26:6789/0 conn(0x7f70481316c0 legacy=0x7f7048131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:39.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.502+0000 7f704db35700 1 -- 172.21.15.26:0/1899757868 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f704809f6e0 con 0x7f704809d9f0 2023-10-01T07:59:39.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.502+0000 7f704db35700 1 --2- 172.21.15.26:0/1899757868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f704809d9f0 0x7f7048136530 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f70380098f0 tx=0x7f7038009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fdb644499babdb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:39.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.502+0000 7f704d334700 1 -- 172.21.15.26:0/1899757868 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7038011830 con 0x7f704809d9f0 2023-10-01T07:59:39.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.502+0000 7f704d334700 1 -- 172.21.15.26:0/1899757868 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7038011990 con 0x7f704809d9f0 2023-10-01T07:59:39.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.502+0000 7f704d334700 1 -- 172.21.15.26:0/1899757868 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7038011d20 con 0x7f704809d9f0 2023-10-01T07:59:39.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.503+0000 7f705059a700 1 -- 172.21.15.26:0/1899757868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f704809d9f0 msgr2=0x7f7048136530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:39.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.503+0000 7f705059a700 1 --2- 172.21.15.26:0/1899757868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f704809d9f0 0x7f7048136530 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f70380098f0 tx=0x7f7038009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:39.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.503+0000 7f705059a700 1 -- 172.21.15.26:0/1899757868 shutdown_connections 2023-10-01T07:59:39.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.503+0000 7f705059a700 1 --2- 172.21.15.26:0/1899757868 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7048136a70 0x7f7048138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.503+0000 7f705059a700 1 --2- 172.21.15.26:0/1899757868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f704809d9f0 0x7f7048136530 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.503+0000 7f705059a700 1 -- 172.21.15.26:0/1899757868 >> 172.21.15.26:0/1899757868 conn(0x7f7048066f50 msgr2=0x7f704809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:39.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.503+0000 7f705059a700 1 -- 172.21.15.26:0/1899757868 shutdown_connections 2023-10-01T07:59:39.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.503+0000 7f705059a700 1 -- 172.21.15.26:0/1899757868 wait complete. 2023-10-01T07:59:39.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.505+0000 7f705059a700 1 Processor -- start 2023-10-01T07:59:39.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.505+0000 7f705059a700 1 -- start start 2023-10-01T07:59:39.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.505+0000 7f705059a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f704809d9f0 0x7f70481c6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:39.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.505+0000 7f705059a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70481316c0 0x7f70481c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:39.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.505+0000 7f705059a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7048136a70 0x7f70481c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:39.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.505+0000 7f705059a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704806eb20 con 0x7f7048136a70 2023-10-01T07:59:39.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.505+0000 7f705059a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70480703d0 con 0x7f70481316c0 2023-10-01T07:59:39.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.505+0000 7f705059a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7048136550 con 0x7f704809d9f0 2023-10-01T07:59:39.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.506+0000 7f704e336700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f704809d9f0 0x7f70481c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:39.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.506+0000 7f704e336700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f704809d9f0 0x7f70481c6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56820/0 (socket says 172.21.15.26:56820) 2023-10-01T07:59:39.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.506+0000 7f704e336700 1 -- 172.21.15.26:0/203761575 learned_addr learned my addr 172.21.15.26:0/203761575 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:39.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.506+0000 7f704eb37700 1 --2- 172.21.15.26:0/203761575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7048136a70 0x7f70481c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:39.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.506+0000 7f704db35700 1 --2- 172.21.15.26:0/203761575 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70481316c0 0x7f70481c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:39.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.506+0000 7f704e336700 1 -- 172.21.15.26:0/203761575 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70481316c0 msgr2=0x7f70481c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:39.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.506+0000 7f704e336700 1 --2- 172.21.15.26:0/203761575 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70481316c0 0x7f70481c6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.506+0000 7f704e336700 1 -- 172.21.15.26:0/203761575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7048136a70 msgr2=0x7f70481c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:39.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.506+0000 7f704e336700 1 --2- 172.21.15.26:0/203761575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7048136a70 0x7f70481c6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.506+0000 7f704e336700 1 -- 172.21.15.26:0/203761575 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7038009550 con 0x7f704809d9f0 2023-10-01T07:59:39.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.506+0000 7f704eb37700 1 --2- 172.21.15.26:0/203761575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7048136a70 0x7f70481c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:39.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.506+0000 7f704e336700 1 --2- 172.21.15.26:0/203761575 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f704809d9f0 0x7f70481c6330 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f7044007fd0 tx=0x7f704400c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:39.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.507+0000 7f703effd700 1 -- 172.21.15.26:0/203761575 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7044005cb0 con 0x7f704809d9f0 2023-10-01T07:59:39.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.507+0000 7f703effd700 1 -- 172.21.15.26:0/203761575 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7044005e10 con 0x7f704809d9f0 2023-10-01T07:59:39.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.507+0000 7f703effd700 1 -- 172.21.15.26:0/203761575 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70440072d0 con 0x7f704809d9f0 2023-10-01T07:59:39.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.507+0000 7f705059a700 1 -- 172.21.15.26:0/203761575 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f704812b900 con 0x7f704809d9f0 2023-10-01T07:59:39.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.507+0000 7f705059a700 1 -- 172.21.15.26:0/203761575 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f704806ecb0 con 0x7f704809d9f0 2023-10-01T07:59:39.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.508+0000 7f705059a700 1 -- 172.21.15.26:0/203761575 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7048074ea0 con 0x7f704809d9f0 2023-10-01T07:59:39.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.508+0000 7f703effd700 1 -- 172.21.15.26:0/203761575 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7044007430 con 0x7f704809d9f0 2023-10-01T07:59:39.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.508+0000 7fb87f413700 1 Processor -- start 2023-10-01T07:59:39.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.509+0000 7f703effd700 1 -- 172.21.15.26:0/203761575 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f704403edf0 con 0x7f704809d9f0 2023-10-01T07:59:39.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.509+0000 7fb87f413700 1 -- start start 2023-10-01T07:59:39.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.510+0000 7fb87f413700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb87812cf60 0x7fb87806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:39.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.510+0000 7fb87f413700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb87812f8b0 0x7fb87812fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:39.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.510+0000 7fb87f413700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb878130260 0x7fb878136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:39.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.510+0000 7fb87f413700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb87812d330 con 0x7fb87812cf60 2023-10-01T07:59:39.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.510+0000 7fb87f413700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87812cd90 con 0x7fb878130260 2023-10-01T07:59:39.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.510+0000 7fb87f413700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8781306d0 con 0x7fb87812f8b0 2023-10-01T07:59:39.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.510+0000 7fb87d9b0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb878130260 0x7fb878136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:39.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.510+0000 7fb87c9ae700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb87812f8b0 0x7fb87812fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:39.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.510+0000 7fb87d1af700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb87812cf60 0x7fb87806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:39.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.510+0000 7fb87d9b0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb878130260 0x7fb878136c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33450/0 (socket says 172.21.15.26:33450) 2023-10-01T07:59:39.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.510+0000 7fb87d9b0700 1 -- 172.21.15.26:0/3427263951 learned_addr learned my addr 172.21.15.26:0/3427263951 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:39.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.510+0000 7fb87c9ae700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb87812f8b0 0x7fb87812fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56836/0 (socket says 172.21.15.26:56836) 2023-10-01T07:59:39.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.510+0000 7fb87d1af700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb87812cf60 0x7fb87806f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37106/0 (socket says 172.21.15.26:37106) 2023-10-01T07:59:39.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.510+0000 7fb87d1af700 1 -- 172.21.15.26:0/3427263951 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb87812f8b0 msgr2=0x7fb87812fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:39.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.510+0000 7fb87d1af700 1 --2- 172.21.15.26:0/3427263951 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb87812f8b0 0x7fb87812fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.510+0000 7fb87d1af700 1 -- 172.21.15.26:0/3427263951 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb878130260 msgr2=0x7fb878136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:39.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.510+0000 7fb87d1af700 1 --2- 172.21.15.26:0/3427263951 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb878130260 0x7fb878136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.510+0000 7fb87d1af700 1 -- 172.21.15.26:0/3427263951 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb878071780 con 0x7fb87812cf60 2023-10-01T07:59:39.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.510+0000 7fb87d9b0700 1 --2- 172.21.15.26:0/3427263951 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb878130260 0x7fb878136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:39.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.511+0000 7fb87d1af700 1 --2- 172.21.15.26:0/3427263951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb87812cf60 0x7fb87806f5d0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fb874009870 tx=0x7fb874009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf120e9178af7bbd server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:39.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.511+0000 7fb86ffff700 1 -- 172.21.15.26:0/3427263951 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb874011830 con 0x7fb87812cf60 2023-10-01T07:59:39.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.511+0000 7fb86ffff700 1 -- 172.21.15.26:0/3427263951 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb874011990 con 0x7fb87812cf60 2023-10-01T07:59:39.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.511+0000 7fb86ffff700 1 -- 172.21.15.26:0/3427263951 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb874011d20 con 0x7fb87812cf60 2023-10-01T07:59:39.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.511+0000 7fb87f413700 1 -- 172.21.15.26:0/3427263951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb87812cf60 msgr2=0x7fb87806f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:39.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.511+0000 7fb87f413700 1 --2- 172.21.15.26:0/3427263951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb87812cf60 0x7fb87806f5d0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fb874009870 tx=0x7fb874009b80 comp rx=0 tx=0).stop 2023-10-01T07:59:39.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.512+0000 7fb87f413700 1 -- 172.21.15.26:0/3427263951 shutdown_connections 2023-10-01T07:59:39.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.512+0000 7fb87f413700 1 --2- 172.21.15.26:0/3427263951 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb878130260 0x7fb878136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.512+0000 7fb87f413700 1 --2- 172.21.15.26:0/3427263951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb87812cf60 0x7fb87806f5d0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.512+0000 7fb87f413700 1 --2- 172.21.15.26:0/3427263951 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb87812f8b0 0x7fb87812fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.512+0000 7fb87f413700 1 -- 172.21.15.26:0/3427263951 >> 172.21.15.26:0/3427263951 conn(0x7fb8780a2aa0 msgr2=0x7fb8780a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:39.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.512+0000 7fb87f413700 1 -- 172.21.15.26:0/3427263951 shutdown_connections 2023-10-01T07:59:39.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.512+0000 7fb87f413700 1 -- 172.21.15.26:0/3427263951 wait complete. 2023-10-01T07:59:39.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.513+0000 7fb87f413700 1 Processor -- start 2023-10-01T07:59:39.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.513+0000 7fb87f413700 1 -- start start 2023-10-01T07:59:39.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.514+0000 7fb87f413700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb87812cf60 0x7fb87809bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:39.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.514+0000 7fb87f413700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb87812f8b0 0x7fb87809c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:39.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.514+0000 7fb87f413700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb878130260 0x7fb8781c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:39.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.514+0000 7fb87f413700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87809b6a0 con 0x7fb87812cf60 2023-10-01T07:59:39.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.514+0000 7fb87f413700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87809b920 con 0x7fb87812f8b0 2023-10-01T07:59:39.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.514+0000 7fb87f413700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb878129fa0 con 0x7fb878130260 2023-10-01T07:59:39.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.514+0000 7fb87d1af700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb87812cf60 0x7fb87809bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:39.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.514+0000 7fb87d1af700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb87812cf60 0x7fb87809bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37116/0 (socket says 172.21.15.26:37116) 2023-10-01T07:59:39.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.514+0000 7fb87d1af700 1 -- 172.21.15.26:0/3599100145 learned_addr learned my addr 172.21.15.26:0/3599100145 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:39.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.514+0000 7fb87c9ae700 1 --2- 172.21.15.26:0/3599100145 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb87812f8b0 0x7fb87809c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:39.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.514+0000 7fb87d9b0700 1 --2- 172.21.15.26:0/3599100145 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb878130260 0x7fb8781c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:39.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.514+0000 7fb87c9ae700 1 -- 172.21.15.26:0/3599100145 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb878130260 msgr2=0x7fb8781c3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:39.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.514+0000 7fb87c9ae700 1 --2- 172.21.15.26:0/3599100145 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb878130260 0x7fb8781c3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.514+0000 7fb87c9ae700 1 -- 172.21.15.26:0/3599100145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb87812cf60 msgr2=0x7fb87809bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:39.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.514+0000 7fb87c9ae700 1 --2- 172.21.15.26:0/3599100145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb87812cf60 0x7fb87809bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.514+0000 7fb87c9ae700 1 -- 172.21.15.26:0/3599100145 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb87000bd40 con 0x7fb87812f8b0 2023-10-01T07:59:39.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.515+0000 7fb87c9ae700 1 --2- 172.21.15.26:0/3599100145 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb87812f8b0 0x7fb87809c1f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb86800e900 tx=0x7fb86800ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:39.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.515+0000 7fb86dffb700 1 -- 172.21.15.26:0/3599100145 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb868013650 con 0x7fb87812f8b0 2023-10-01T07:59:39.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.515+0000 7fb86dffb700 1 -- 172.21.15.26:0/3599100145 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8680137b0 con 0x7fb87812f8b0 2023-10-01T07:59:39.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.515+0000 7fb87f413700 1 -- 172.21.15.26:0/3599100145 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8740094a0 con 0x7fb87812f8b0 2023-10-01T07:59:39.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.515+0000 7fb87f413700 1 -- 172.21.15.26:0/3599100145 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb87809e720 con 0x7fb87812f8b0 2023-10-01T07:59:39.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.517+0000 7fb86dffb700 1 -- 172.21.15.26:0/3599100145 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb868013b20 con 0x7fb87812f8b0 2023-10-01T07:59:39.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.517+0000 7fb86dffb700 1 -- 172.21.15.26:0/3599100145 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb868013d00 con 0x7fb87812f8b0 2023-10-01T07:59:39.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.517+0000 7fb86dffb700 1 -- 172.21.15.26:0/3599100145 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb8680436a0 con 0x7fb87812f8b0 2023-10-01T07:59:39.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.517+0000 7fb87f413700 1 -- 172.21.15.26:0/3599100145 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8580052e0 con 0x7fb87812f8b0 2023-10-01T07:59:39.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.518+0000 7f703effd700 1 -- 172.21.15.26:0/203761575 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f70440198b0 con 0x7f704809d9f0 2023-10-01T07:59:39.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.523+0000 7fb86dffb700 1 -- 172.21.15.26:0/3599100145 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb868020020 con 0x7fb87812f8b0 2023-10-01T07:59:39.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.697+0000 7f9903488700 1 -- 172.21.15.26:0/2712829174 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f98fc124010 con 0x7f98fc12cf60 2023-10-01T07:59:39.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.697+0000 7f98f1ffb700 1 -- 172.21.15.26:0/2712829174 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f98ec0283c0 con 0x7f98fc12cf60 2023-10-01T07:59:39.698 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:39.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.699+0000 7f9903488700 1 -- 172.21.15.26:0/2712829174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98fc12cf60 msgr2=0x7f98fc121a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:39.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.699+0000 7f9903488700 1 --2- 172.21.15.26:0/2712829174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98fc12cf60 0x7f98fc121a20 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f98ec019040 tx=0x7f98ec004750 comp rx=0 tx=0).stop 2023-10-01T07:59:39.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.700+0000 7f9903488700 1 -- 172.21.15.26:0/2712829174 shutdown_connections 2023-10-01T07:59:39.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.700+0000 7f9903488700 1 --2- 172.21.15.26:0/2712829174 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f98fc135c20 0x7f98fc121f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.700+0000 7f9903488700 1 --2- 172.21.15.26:0/2712829174 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98fc06f5d0 0x7f98fc1214e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.700+0000 7f9903488700 1 --2- 172.21.15.26:0/2712829174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98fc12cf60 0x7f98fc121a20 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.700+0000 7f9903488700 1 -- 172.21.15.26:0/2712829174 >> 172.21.15.26:0/2712829174 conn(0x7f98fc0a2aa0 msgr2=0x7f98fc06e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:39.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.700+0000 7f9903488700 1 -- 172.21.15.26:0/2712829174 shutdown_connections 2023-10-01T07:59:39.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.700+0000 7f9903488700 1 -- 172.21.15.26:0/2712829174 wait complete. 2023-10-01T07:59:39.714 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:39.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.726+0000 7f6f68ac1700 1 -- 172.21.15.26:0/3539179427 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6f64072820 con 0x7f6f64139450 2023-10-01T07:59:39.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.727+0000 7f6f52ffd700 1 -- 172.21.15.26:0/3539179427 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6f5c0237d0 con 0x7f6f64139450 2023-10-01T07:59:39.727 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:39.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.729+0000 7f6f68ac1700 1 -- 172.21.15.26:0/3539179427 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f64139450 msgr2=0x7f6f641cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:39.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.729+0000 7f6f68ac1700 1 --2- 172.21.15.26:0/3539179427 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f64139450 0x7f6f641cc900 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c0042f0 tx=0x7f6f5c004ad0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.729+0000 7f6f68ac1700 1 -- 172.21.15.26:0/3539179427 shutdown_connections 2023-10-01T07:59:39.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.729+0000 7f6f68ac1700 1 --2- 172.21.15.26:0/3539179427 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f64139450 0x7f6f641cc900 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.729+0000 7f6f68ac1700 1 --2- 172.21.15.26:0/3539179427 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f6409e850 0x7f6f6411a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.729+0000 7f6f68ac1700 1 --2- 172.21.15.26:0/3539179427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f6409f330 0x7f6f6411add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.729+0000 7f6f68ac1700 1 -- 172.21.15.26:0/3539179427 >> 172.21.15.26:0/3539179427 conn(0x7f6f640a3f70 msgr2=0x7f6f64070f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:39.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.729+0000 7f6f68ac1700 1 -- 172.21.15.26:0/3539179427 shutdown_connections 2023-10-01T07:59:39.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.729+0000 7f6f68ac1700 1 -- 172.21.15.26:0/3539179427 wait complete. 2023-10-01T07:59:39.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.732+0000 7fb87f413700 1 -- 172.21.15.26:0/3599100145 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb858005590 con 0x7fb87812f8b0 2023-10-01T07:59:39.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.732+0000 7fb86dffb700 1 -- 172.21.15.26:0/3599100145 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb86801a7b0 con 0x7fb87812f8b0 2023-10-01T07:59:39.733 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:39.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.735+0000 7fb87f413700 1 -- 172.21.15.26:0/3599100145 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb87812f8b0 msgr2=0x7fb87809c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:39.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.735+0000 7fb87f413700 1 --2- 172.21.15.26:0/3599100145 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb87812f8b0 0x7fb87809c1f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb86800e900 tx=0x7fb86800ec10 comp rx=0 tx=0).stop 2023-10-01T07:59:39.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.735+0000 7fb87f413700 1 -- 172.21.15.26:0/3599100145 shutdown_connections 2023-10-01T07:59:39.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.735+0000 7fb87f413700 1 --2- 172.21.15.26:0/3599100145 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb878130260 0x7fb8781c3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.735+0000 7fb87f413700 1 --2- 172.21.15.26:0/3599100145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb87812cf60 0x7fb87809bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.735+0000 7fb87f413700 1 --2- 172.21.15.26:0/3599100145 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb87812f8b0 0x7fb87809c1f0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.735+0000 7fb87f413700 1 -- 172.21.15.26:0/3599100145 >> 172.21.15.26:0/3599100145 conn(0x7fb8780a2aa0 msgr2=0x7fb8780a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:39.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.737+0000 7fb87f413700 1 -- 172.21.15.26:0/3599100145 shutdown_connections 2023-10-01T07:59:39.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.737+0000 7fb87f413700 1 -- 172.21.15.26:0/3599100145 wait complete. 2023-10-01T07:59:39.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:39.752 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:39.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.759+0000 7f705059a700 1 -- 172.21.15.26:0/203761575 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f704809e130 con 0x7f704809d9f0 2023-10-01T07:59:39.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.759+0000 7f703effd700 1 -- 172.21.15.26:0/203761575 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f704809e130 con 0x7f704809d9f0 2023-10-01T07:59:39.760 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:39.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.762+0000 7f705059a700 1 -- 172.21.15.26:0/203761575 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f704809d9f0 msgr2=0x7f70481c6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:39.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.762+0000 7f705059a700 1 --2- 172.21.15.26:0/203761575 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f704809d9f0 0x7f70481c6330 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f7044007fd0 tx=0x7f704400c9e0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.762+0000 7f705059a700 1 -- 172.21.15.26:0/203761575 shutdown_connections 2023-10-01T07:59:39.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.762+0000 7f705059a700 1 --2- 172.21.15.26:0/203761575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7048136a70 0x7f70481c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.762+0000 7f705059a700 1 --2- 172.21.15.26:0/203761575 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f704809d9f0 0x7f70481c6330 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.762+0000 7f705059a700 1 --2- 172.21.15.26:0/203761575 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70481316c0 0x7f70481c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:39.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.762+0000 7f705059a700 1 -- 172.21.15.26:0/203761575 >> 172.21.15.26:0/203761575 conn(0x7f7048066f50 msgr2=0x7f70480a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:39.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.762+0000 7f705059a700 1 -- 172.21.15.26:0/203761575 shutdown_connections 2023-10-01T07:59:39.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:39.762+0000 7f705059a700 1 -- 172.21.15.26:0/203761575 wait complete. 2023-10-01T07:59:39.776 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:40.715 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:40.746 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:40.753 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:40.777 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:40.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.866+0000 7f2c5d59d700 1 Processor -- start 2023-10-01T07:59:40.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.866+0000 7f2c5d59d700 1 -- start start 2023-10-01T07:59:40.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.867+0000 7f2c5d59d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2c5809d6f0 0x7f2c5809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:40.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.867+0000 7f2c5d59d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c5809e000 0x7f2c581339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:40.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.867+0000 7f2c5d59d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c5809e410 0x7f2c58133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:40.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.867+0000 7f2c5d59d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c5806b460 con 0x7f2c5809d6f0 2023-10-01T07:59:40.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.867+0000 7f2c5d59d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5809b120 con 0x7f2c5809e410 2023-10-01T07:59:40.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.867+0000 7f2c5d59d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5809a7e0 con 0x7f2c5809e000 2023-10-01T07:59:40.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.867+0000 7f2c577fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c5809e410 0x7f2c58133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:40.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.867+0000 7f2c577fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c5809e410 0x7f2c58133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33482/0 (socket says 172.21.15.26:33482) 2023-10-01T07:59:40.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.867+0000 7f2c577fe700 1 -- 172.21.15.26:0/2884272308 learned_addr learned my addr 172.21.15.26:0/2884272308 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:40.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.867+0000 7f2c56ffd700 1 --2- 172.21.15.26:0/2884272308 >> v2:172.21.15.26:3300/0 conn(0x7f2c5809d6f0 0x7f2c5809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:40.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.867+0000 7f2c567fc700 1 --2- 172.21.15.26:0/2884272308 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c5809e000 0x7f2c581339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:40.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.867+0000 7f2c577fe700 1 -- 172.21.15.26:0/2884272308 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c5809e000 msgr2=0x7f2c581339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:40.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.867+0000 7f2c577fe700 1 --2- 172.21.15.26:0/2884272308 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c5809e000 0x7f2c581339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:40.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.867+0000 7f2c577fe700 1 -- 172.21.15.26:0/2884272308 >> v2:172.21.15.26:3300/0 conn(0x7f2c5809d6f0 msgr2=0x7f2c5809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:40.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.867+0000 7f2c577fe700 1 --2- 172.21.15.26:0/2884272308 >> v2:172.21.15.26:3300/0 conn(0x7f2c5809d6f0 0x7f2c5809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:40.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.867+0000 7f2c577fe700 1 -- 172.21.15.26:0/2884272308 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c5809a500 con 0x7f2c5809e410 2023-10-01T07:59:40.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.867+0000 7f2c56ffd700 1 --2- 172.21.15.26:0/2884272308 >> v2:172.21.15.26:3300/0 conn(0x7f2c5809d6f0 0x7f2c5809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:40.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.868+0000 7f2c577fe700 1 --2- 172.21.15.26:0/2884272308 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c5809e410 0x7f2c58133f30 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f2c50009e80 tx=0x7f2c5000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcd105bf8a607d51 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:40.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.868+0000 7f2c55ffb700 1 -- 172.21.15.26:0/2884272308 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5000e070 con 0x7f2c5809e410 2023-10-01T07:59:40.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.868+0000 7f2c55ffb700 1 -- 172.21.15.26:0/2884272308 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5000b8d0 con 0x7f2c5809e410 2023-10-01T07:59:40.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.868+0000 7f2c55ffb700 1 -- 172.21.15.26:0/2884272308 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5000bc80 con 0x7f2c5809e410 2023-10-01T07:59:40.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.869+0000 7f2c5d59d700 1 -- 172.21.15.26:0/2884272308 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c5809e410 msgr2=0x7f2c58133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:40.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.869+0000 7f2c5d59d700 1 --2- 172.21.15.26:0/2884272308 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c5809e410 0x7f2c58133f30 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f2c50009e80 tx=0x7f2c5000b330 comp rx=0 tx=0).stop 2023-10-01T07:59:40.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.869+0000 7f2c5d59d700 1 -- 172.21.15.26:0/2884272308 shutdown_connections 2023-10-01T07:59:40.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.869+0000 7f2c5d59d700 1 --2- 172.21.15.26:0/2884272308 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c5809e410 0x7f2c58133f30 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:40.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.869+0000 7f2c5d59d700 1 --2- 172.21.15.26:0/2884272308 >> v2:172.21.15.26:3300/0 conn(0x7f2c5809d6f0 0x7f2c5809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:40.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.869+0000 7f2c5d59d700 1 --2- 172.21.15.26:0/2884272308 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c5809e000 0x7f2c581339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:40.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.869+0000 7f2c5d59d700 1 -- 172.21.15.26:0/2884272308 >> 172.21.15.26:0/2884272308 conn(0x7f2c58066f50 msgr2=0x7f2c5809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:40.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.869+0000 7f2c5d59d700 1 -- 172.21.15.26:0/2884272308 shutdown_connections 2023-10-01T07:59:40.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.869+0000 7f2c5d59d700 1 -- 172.21.15.26:0/2884272308 wait complete. 2023-10-01T07:59:40.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.870+0000 7f2c5d59d700 1 Processor -- start 2023-10-01T07:59:40.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.870+0000 7f2c5d59d700 1 -- start start 2023-10-01T07:59:40.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.871+0000 7f2c5d59d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c5809d6f0 0x7f2c581c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:40.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.871+0000 7f2c5d59d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c5809e000 0x7f2c581c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:40.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.871+0000 7f2c5d59d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c5809e410 0x7f2c581c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:40.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.871+0000 7f2c5d59d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c581a8a00 con 0x7f2c5809e410 2023-10-01T07:59:40.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.871+0000 7f2c5d59d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c581a85d0 con 0x7f2c5809e000 2023-10-01T07:59:40.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.871+0000 7f2c5d59d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c581a91f0 con 0x7f2c5809d6f0 2023-10-01T07:59:40.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.871+0000 7f2c567fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c5809e000 0x7f2c581c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:40.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.871+0000 7f2c567fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c5809e000 0x7f2c581c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33492/0 (socket says 172.21.15.26:33492) 2023-10-01T07:59:40.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.871+0000 7f2c567fc700 1 -- 172.21.15.26:0/634183835 learned_addr learned my addr 172.21.15.26:0/634183835 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:40.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.871+0000 7f2c577fe700 1 --2- 172.21.15.26:0/634183835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c5809e410 0x7f2c581c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:40.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.871+0000 7f2c56ffd700 1 --2- 172.21.15.26:0/634183835 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c5809d6f0 0x7f2c581c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:40.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.872+0000 7f2c577fe700 1 -- 172.21.15.26:0/634183835 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c5809d6f0 msgr2=0x7f2c581c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:40.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.872+0000 7f2c577fe700 1 --2- 172.21.15.26:0/634183835 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c5809d6f0 0x7f2c581c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:40.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.872+0000 7f2c577fe700 1 -- 172.21.15.26:0/634183835 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c5809e000 msgr2=0x7f2c581c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:40.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.872+0000 7f2c577fe700 1 --2- 172.21.15.26:0/634183835 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c5809e000 0x7f2c581c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:40.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.872+0000 7f2c577fe700 1 -- 172.21.15.26:0/634183835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c480094a0 con 0x7f2c5809e410 2023-10-01T07:59:40.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.872+0000 7f2c577fe700 1 --2- 172.21.15.26:0/634183835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c5809e410 0x7f2c581c49d0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f2c50015000 tx=0x7f2c50004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:40.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.872+0000 7f2c3f7fe700 1 -- 172.21.15.26:0/634183835 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c50004450 con 0x7f2c5809e410 2023-10-01T07:59:40.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.872+0000 7f2c3f7fe700 1 -- 172.21.15.26:0/634183835 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c500045b0 con 0x7f2c5809e410 2023-10-01T07:59:40.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.872+0000 7f2c3f7fe700 1 -- 172.21.15.26:0/634183835 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c50004960 con 0x7f2c5809e410 2023-10-01T07:59:40.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.872+0000 7f2c5d59d700 1 -- 172.21.15.26:0/634183835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c50009b30 con 0x7f2c5809e410 2023-10-01T07:59:40.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.872+0000 7f2c5d59d700 1 -- 172.21.15.26:0/634183835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c581a7880 con 0x7f2c5809e410 2023-10-01T07:59:40.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.874+0000 7f2c3f7fe700 1 -- 172.21.15.26:0/634183835 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2c50025460 con 0x7f2c5809e410 2023-10-01T07:59:40.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.874+0000 7f2c5d59d700 1 -- 172.21.15.26:0/634183835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c58074ea0 con 0x7f2c5809e410 2023-10-01T07:59:40.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.874+0000 7f2c3f7fe700 1 -- 172.21.15.26:0/634183835 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2c50025710 con 0x7f2c5809e410 2023-10-01T07:59:40.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.883+0000 7f2c3f7fe700 1 -- 172.21.15.26:0/634183835 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2c50046060 con 0x7f2c5809e410 2023-10-01T07:59:40.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.910+0000 7f5fdc0a1700 1 Processor -- start 2023-10-01T07:59:40.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.910+0000 7f5fdc0a1700 1 -- start start 2023-10-01T07:59:40.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.911+0000 7f5fdc0a1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5fd409d6f0 0x7f5fd409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:40.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.911+0000 7f5fdc0a1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5fd409e440 0x7f5fd4134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:40.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.911+0000 7f5fdc0a1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fd409b120 con 0x7f5fd409e000 2023-10-01T07:59:40.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.911+0000 7f5fdc0a1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fd406b460 con 0x7f5fd409d6f0 2023-10-01T07:59:40.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.911+0000 7f5fdc0a1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd409a7e0 con 0x7f5fd409e440 2023-10-01T07:59:40.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.911+0000 7f5fd9e3d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5fd409d6f0 0x7f5fd409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:40.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.911+0000 7f5fd9e3d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5fd409d6f0 0x7f5fd409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37130/0 (socket says 172.21.15.26:37130) 2023-10-01T07:59:40.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.911+0000 7f5fd9e3d700 1 -- 172.21.15.26:0/12977183 learned_addr learned my addr 172.21.15.26:0/12977183 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:40.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.911+0000 7f5fda63e700 1 --2- 172.21.15.26:0/12977183 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5fd409e440 0x7f5fd4134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:40.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.911+0000 7f5fd9e3d700 1 -- 172.21.15.26:0/12977183 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5fd409e440 msgr2=0x7f5fd4134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:40.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.911+0000 7f5fd9e3d700 1 --2- 172.21.15.26:0/12977183 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5fd409e440 0x7f5fd4134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:40.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.911+0000 7f5fd9e3d700 1 -- 172.21.15.26:0/12977183 >> v1:172.21.15.26:6789/0 conn(0x7f5fd409e000 legacy=0x7f5fd41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:40.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.911+0000 7f5fd9e3d700 1 -- 172.21.15.26:0/12977183 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd409a500 con 0x7f5fd409d6f0 2023-10-01T07:59:40.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.911+0000 7f5fda63e700 1 --2- 172.21.15.26:0/12977183 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5fd409e440 0x7f5fd4134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:40.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.912+0000 7f5fd9e3d700 1 --2- 172.21.15.26:0/12977183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fd409d6f0 0x7f5fd409dac0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009920 tx=0x7f5fd0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=416e4c6ddaff69dd server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:40.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.912+0000 7f5fd8e3b700 1 -- 172.21.15.26:0/12977183 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0011830 con 0x7f5fd409d6f0 2023-10-01T07:59:40.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.912+0000 7f5fd8e3b700 1 -- 172.21.15.26:0/12977183 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd0011990 con 0x7f5fd409d6f0 2023-10-01T07:59:40.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.912+0000 7f5fd8e3b700 1 -- 172.21.15.26:0/12977183 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0011d20 con 0x7f5fd409d6f0 2023-10-01T07:59:40.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.913+0000 7f5fdc0a1700 1 -- 172.21.15.26:0/12977183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fd409d6f0 msgr2=0x7f5fd409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:40.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.913+0000 7f5fdc0a1700 1 --2- 172.21.15.26:0/12977183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fd409d6f0 0x7f5fd409dac0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009920 tx=0x7f5fd0009c30 comp rx=0 tx=0).stop 2023-10-01T07:59:40.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.913+0000 7f5fdc0a1700 1 -- 172.21.15.26:0/12977183 shutdown_connections 2023-10-01T07:59:40.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.913+0000 7f5fdc0a1700 1 --2- 172.21.15.26:0/12977183 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5fd409e440 0x7f5fd4134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:40.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.913+0000 7f5fdc0a1700 1 --2- 172.21.15.26:0/12977183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fd409d6f0 0x7f5fd409dac0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:40.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.913+0000 7f5fdc0a1700 1 -- 172.21.15.26:0/12977183 >> 172.21.15.26:0/12977183 conn(0x7f5fd4066f50 msgr2=0x7f5fd409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:40.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.913+0000 7f5fdc0a1700 1 -- 172.21.15.26:0/12977183 shutdown_connections 2023-10-01T07:59:40.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.913+0000 7f5fdc0a1700 1 -- 172.21.15.26:0/12977183 wait complete. 2023-10-01T07:59:40.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.914+0000 7f5fdc0a1700 1 Processor -- start 2023-10-01T07:59:40.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.914+0000 7f5fdc0a1700 1 -- start start 2023-10-01T07:59:40.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.915+0000 7f5fdc0a1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5fd409d6f0 0x7f5fd41a5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:40.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.915+0000 7f5fdc0a1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fd409e000 0x7f5fd41a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:40.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.915+0000 7f5fdc0a1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5fd409e440 0x7f5fd41a68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:40.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.915+0000 7f5fdc0a1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd41a96f0 con 0x7f5fd409e000 2023-10-01T07:59:40.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.915+0000 7f5fdc0a1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd41a9940 con 0x7f5fd409d6f0 2023-10-01T07:59:40.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.915+0000 7f5fdc0a1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd41a8830 con 0x7f5fd409e440 2023-10-01T07:59:40.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.915+0000 7f5fda63e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5fd409e440 0x7f5fd41a68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:40.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.915+0000 7f5fda63e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5fd409e440 0x7f5fd41a68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56882/0 (socket says 172.21.15.26:56882) 2023-10-01T07:59:40.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.915+0000 7f5fda63e700 1 -- 172.21.15.26:0/3691588219 learned_addr learned my addr 172.21.15.26:0/3691588219 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:40.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.915+0000 7fe02e316700 1 Processor -- start 2023-10-01T07:59:40.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.915+0000 7f5fd9e3d700 1 --2- 172.21.15.26:0/3691588219 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5fd409d6f0 0x7f5fd41a5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:40.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.915+0000 7fe02e316700 1 -- start start 2023-10-01T07:59:40.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.915+0000 7f5fd963c700 1 --2- 172.21.15.26:0/3691588219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fd409e000 0x7f5fd41a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:40.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.915+0000 7f5fda63e700 1 -- 172.21.15.26:0/3691588219 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5fd409d6f0 msgr2=0x7f5fd41a5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:40.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.915+0000 7f5fda63e700 1 --2- 172.21.15.26:0/3691588219 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5fd409d6f0 0x7f5fd41a5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:40.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.915+0000 7f5fda63e700 1 -- 172.21.15.26:0/3691588219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fd409e000 msgr2=0x7f5fd41a63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:40.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.915+0000 7f5fda63e700 1 --2- 172.21.15.26:0/3691588219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fd409e000 0x7f5fd41a63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:40.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.915+0000 7f5fda63e700 1 -- 172.21.15.26:0/3691588219 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fcc009a70 con 0x7f5fd409e440 2023-10-01T07:59:40.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.915+0000 7f5fd963c700 1 --2- 172.21.15.26:0/3691588219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fd409e000 0x7f5fd41a63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:59:40.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.916+0000 7f5fda63e700 1 --2- 172.21.15.26:0/3691588219 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5fd409e440 0x7f5fd41a68e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc00efc0 tx=0x7f5fcc00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:40.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.916+0000 7fe02e316700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe02806e570 0x7fe02806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:40.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.916+0000 7f5fca7fc700 1 -- 172.21.15.26:0/3691588219 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc00cb40 con 0x7f5fd409e440 2023-10-01T07:59:40.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.916+0000 7fe02e316700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe02809eca0 0x7fe02806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:40.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.916+0000 7fe02e316700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe028134610 0x7fe028134ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:40.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.916+0000 7f5fca7fc700 1 -- 172.21.15.26:0/3691588219 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fcc00f040 con 0x7f5fd409e440 2023-10-01T07:59:40.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.916+0000 7f5fca7fc700 1 -- 172.21.15.26:0/3691588219 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc003a20 con 0x7f5fd409e440 2023-10-01T07:59:40.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.916+0000 7fe02e316700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe028070ee0 con 0x7fe028134610 2023-10-01T07:59:40.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.916+0000 7fe02e316700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe028071480 con 0x7fe02806e570 2023-10-01T07:59:40.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.916+0000 7fe02e316700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe02806f3c0 con 0x7fe02809eca0 2023-10-01T07:59:40.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.916+0000 7fe027fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe02806e570 0x7fe02806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:40.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.916+0000 7fe02c8b3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe028134610 0x7fe028134ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:40.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.916+0000 7fe027fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe02806e570 0x7fe02806e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33510/0 (socket says 172.21.15.26:33510) 2023-10-01T07:59:40.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.916+0000 7fe027fff700 1 -- 172.21.15.26:0/1706554035 learned_addr learned my addr 172.21.15.26:0/1706554035 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:40.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.917+0000 7fe02c8b3700 1 -- 172.21.15.26:0/1706554035 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe02809eca0 msgr2=0x7fe02806ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:40.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.917+0000 7fe02c8b3700 1 --2- 172.21.15.26:0/1706554035 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe02809eca0 0x7fe02806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:40.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.917+0000 7fe02c8b3700 1 -- 172.21.15.26:0/1706554035 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe02806e570 msgr2=0x7fe02806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:40.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.917+0000 7fe02c8b3700 1 --2- 172.21.15.26:0/1706554035 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe02806e570 0x7fe02806e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:40.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.917+0000 7fe02c8b3700 1 -- 172.21.15.26:0/1706554035 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe028071b90 con 0x7fe028134610 2023-10-01T07:59:40.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.917+0000 7fe02c8b3700 1 --2- 172.21.15.26:0/1706554035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe028134610 0x7fe028134ab0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fe020009d90 tx=0x7fe02000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c254141232965b06 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:40.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.917+0000 7fe026ffd700 1 -- 172.21.15.26:0/1706554035 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02000e070 con 0x7fe028134610 2023-10-01T07:59:40.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.917+0000 7fe026ffd700 1 -- 172.21.15.26:0/1706554035 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02000bbd0 con 0x7fe028134610 2023-10-01T07:59:40.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.917+0000 7fe026ffd700 1 -- 172.21.15.26:0/1706554035 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe020012430 con 0x7fe028134610 2023-10-01T07:59:40.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.916+0000 7f5fdc0a1700 1 -- 172.21.15.26:0/3691588219 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd0009550 con 0x7f5fd409e440 2023-10-01T07:59:40.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.917+0000 7f5fdc0a1700 1 -- 172.21.15.26:0/3691588219 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fd41a7ad0 con 0x7f5fd409e440 2023-10-01T07:59:40.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.918+0000 7f5fdc0a1700 1 -- 172.21.15.26:0/3691588219 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fd4074ea0 con 0x7f5fd409e440 2023-10-01T07:59:40.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.918+0000 7f5fca7fc700 1 -- 172.21.15.26:0/3691588219 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5fcc014480 con 0x7f5fd409e440 2023-10-01T07:59:40.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.918+0000 7fe027fff700 1 --2- 172.21.15.26:0/1706554035 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe02806e570 0x7fe02806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:59:40.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.918+0000 7fe02e316700 1 -- 172.21.15.26:0/1706554035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe028134610 msgr2=0x7fe028134ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:40.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.918+0000 7fe02e316700 1 --2- 172.21.15.26:0/1706554035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe028134610 0x7fe028134ab0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fe020009d90 tx=0x7fe02000b330 comp rx=0 tx=0).stop 2023-10-01T07:59:40.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.918+0000 7f5fca7fc700 1 -- 172.21.15.26:0/3691588219 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5fcc041920 con 0x7f5fd409e440 2023-10-01T07:59:40.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.920+0000 7fe02e316700 1 -- 172.21.15.26:0/1706554035 shutdown_connections 2023-10-01T07:59:40.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.920+0000 7fe02e316700 1 --2- 172.21.15.26:0/1706554035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe028134610 0x7fe028134ab0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:40.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.920+0000 7fe02e316700 1 --2- 172.21.15.26:0/1706554035 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe02806e570 0x7fe02806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:40.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.920+0000 7fe02e316700 1 --2- 172.21.15.26:0/1706554035 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe02809eca0 0x7fe02806ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:40.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.920+0000 7fe02e316700 1 -- 172.21.15.26:0/1706554035 >> 172.21.15.26:0/1706554035 conn(0x7fe0280a2aa0 msgr2=0x7fe0280a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:40.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.920+0000 7fe02e316700 1 -- 172.21.15.26:0/1706554035 shutdown_connections 2023-10-01T07:59:40.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.920+0000 7fe02e316700 1 -- 172.21.15.26:0/1706554035 wait complete. 2023-10-01T07:59:40.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.921+0000 7fe02e316700 1 Processor -- start 2023-10-01T07:59:40.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.921+0000 7fe02e316700 1 -- start start 2023-10-01T07:59:40.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.922+0000 7fe02e316700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe02806e570 0x7fe0281214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:40.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.922+0000 7fe02e316700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe028134610 0x7fe028121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:40.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.922+0000 7fe02e316700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe028121f60 0x7fe0281d2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:40.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.922+0000 7fe02e316700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe028122c30 con 0x7fe028134610 2023-10-01T07:59:40.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.922+0000 7fe02e316700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe028122a40 con 0x7fe028121f60 2023-10-01T07:59:40.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.922+0000 7fe02e316700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe028123c70 con 0x7fe02806e570 2023-10-01T07:59:40.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.922+0000 7fe02c8b3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe028121f60 0x7fe0281d2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:40.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.922+0000 7fe02c8b3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe028121f60 0x7fe0281d2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33526/0 (socket says 172.21.15.26:33526) 2023-10-01T07:59:40.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.922+0000 7fe02c8b3700 1 -- 172.21.15.26:0/413590428 learned_addr learned my addr 172.21.15.26:0/413590428 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:40.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.923+0000 7fe02c8b3700 1 -- 172.21.15.26:0/413590428 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe02806e570 msgr2=0x7fe0281214e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:40.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.923+0000 7fe02c8b3700 1 --2- 172.21.15.26:0/413590428 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe02806e570 0x7fe0281214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:40.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.923+0000 7fe02c8b3700 1 -- 172.21.15.26:0/413590428 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe028134610 msgr2=0x7fe028121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:40.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.923+0000 7fe02c8b3700 1 --2- 172.21.15.26:0/413590428 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe028134610 0x7fe028121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:40.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.923+0000 7fe02c8b3700 1 -- 172.21.15.26:0/413590428 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe020009a70 con 0x7fe028121f60 2023-10-01T07:59:40.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.923+0000 7fe02c8b3700 1 --2- 172.21.15.26:0/413590428 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe028121f60 0x7fe0281d2cb0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fe020014040 tx=0x7fe020004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:40.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.923+0000 7fe024ff9700 1 -- 172.21.15.26:0/413590428 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe020009410 con 0x7fe028121f60 2023-10-01T07:59:40.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.923+0000 7fe024ff9700 1 -- 172.21.15.26:0/413590428 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe020020070 con 0x7fe028121f60 2023-10-01T07:59:40.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.923+0000 7fe024ff9700 1 -- 172.21.15.26:0/413590428 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0200276c0 con 0x7fe028121f60 2023-10-01T07:59:40.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.923+0000 7fe02e316700 1 -- 172.21.15.26:0/413590428 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe028124950 con 0x7fe028121f60 2023-10-01T07:59:40.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.924+0000 7fe02e316700 1 -- 172.21.15.26:0/413590428 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0280a1e00 con 0x7fe028121f60 2023-10-01T07:59:40.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.925+0000 7fe02e316700 1 -- 172.21.15.26:0/413590428 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe02809b1e0 con 0x7fe028121f60 2023-10-01T07:59:40.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.926+0000 7f5fca7fc700 1 -- 172.21.15.26:0/3691588219 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5fcc045060 con 0x7f5fd409e440 2023-10-01T07:59:40.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.926+0000 7fe024ff9700 1 -- 172.21.15.26:0/413590428 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe020012430 con 0x7fe028121f60 2023-10-01T07:59:40.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.926+0000 7fe024ff9700 1 -- 172.21.15.26:0/413590428 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe020022070 con 0x7fe028121f60 2023-10-01T07:59:40.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.934+0000 7fe024ff9700 1 -- 172.21.15.26:0/413590428 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe02001a740 con 0x7fe028121f60 2023-10-01T07:59:40.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.957+0000 7f9fc1268700 1 Processor -- start 2023-10-01T07:59:40.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.957+0000 7f9fc1268700 1 -- start start 2023-10-01T07:59:40.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.958+0000 7f9fc1268700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fbc0a0a30 0x7f9fbc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:40.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.958+0000 7f9fc1268700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9fbc09d630 0x7f9fbc0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:40.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.958+0000 7f9fc1268700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9fbc133930 0x7f9fbc133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:40.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.958+0000 7f9fc1268700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fbc0a2a70 con 0x7f9fbc09d630 2023-10-01T07:59:40.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.958+0000 7f9fc1268700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc0a01d0 con 0x7f9fbc133930 2023-10-01T07:59:40.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.958+0000 7f9fc1268700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc09e2b0 con 0x7f9fbc0a0a30 2023-10-01T07:59:40.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.958+0000 7f9fbb7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9fbc133930 0x7f9fbc133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:40.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.958+0000 7f9fbb7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9fbc133930 0x7f9fbc133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33534/0 (socket says 172.21.15.26:33534) 2023-10-01T07:59:40.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.958+0000 7f9fbaffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fbc0a0a30 0x7f9fbc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:40.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.958+0000 7f9fbb7fe700 1 -- 172.21.15.26:0/1773359741 learned_addr learned my addr 172.21.15.26:0/1773359741 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:40.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.958+0000 7f9fb27fc700 1 --2- 172.21.15.26:0/1773359741 >> v2:172.21.15.26:3300/0 conn(0x7f9fbc09d630 0x7f9fbc0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:40.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.958+0000 7f9fbb7fe700 1 -- 172.21.15.26:0/1773359741 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fbc0a0a30 msgr2=0x7f9fbc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:40.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.958+0000 7f9fbb7fe700 1 --2- 172.21.15.26:0/1773359741 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fbc0a0a30 0x7f9fbc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:40.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.958+0000 7f9fbb7fe700 1 -- 172.21.15.26:0/1773359741 >> v2:172.21.15.26:3300/0 conn(0x7f9fbc09d630 msgr2=0x7f9fbc0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:40.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.958+0000 7f9fbb7fe700 1 --2- 172.21.15.26:0/1773359741 >> v2:172.21.15.26:3300/0 conn(0x7f9fbc09d630 0x7f9fbc0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:40.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.959+0000 7f9fbb7fe700 1 -- 172.21.15.26:0/1773359741 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fbc09dc50 con 0x7f9fbc133930 2023-10-01T07:59:40.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.959+0000 7f9fbaffd700 1 --2- 172.21.15.26:0/1773359741 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fbc0a0a30 0x7f9fbc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:40.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.959+0000 7f9fbb7fe700 1 --2- 172.21.15.26:0/1773359741 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9fbc133930 0x7f9fbc133dd0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4009e50 tx=0x7f9fb400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40ffcf18b0ecafda server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:40.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.959+0000 7f9fba7fc700 1 -- 172.21.15.26:0/1773359741 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb400e070 con 0x7f9fbc133930 2023-10-01T07:59:40.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.959+0000 7f9fba7fc700 1 -- 172.21.15.26:0/1773359741 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb400b910 con 0x7f9fbc133930 2023-10-01T07:59:40.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.959+0000 7f9fba7fc700 1 -- 172.21.15.26:0/1773359741 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb400bcc0 con 0x7f9fbc133930 2023-10-01T07:59:40.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.960+0000 7f9fc1268700 1 -- 172.21.15.26:0/1773359741 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9fbc133930 msgr2=0x7f9fbc133dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:40.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.960+0000 7f9fc1268700 1 --2- 172.21.15.26:0/1773359741 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9fbc133930 0x7f9fbc133dd0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4009e50 tx=0x7f9fb400b330 comp rx=0 tx=0).stop 2023-10-01T07:59:40.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.960+0000 7f9fc1268700 1 -- 172.21.15.26:0/1773359741 shutdown_connections 2023-10-01T07:59:40.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.960+0000 7f9fc1268700 1 --2- 172.21.15.26:0/1773359741 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9fbc133930 0x7f9fbc133dd0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:40.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.960+0000 7f9fc1268700 1 --2- 172.21.15.26:0/1773359741 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fbc0a0a30 0x7f9fbc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:40.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.960+0000 7f9fc1268700 1 --2- 172.21.15.26:0/1773359741 >> v2:172.21.15.26:3300/0 conn(0x7f9fbc09d630 0x7f9fbc0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:40.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.960+0000 7f9fc1268700 1 -- 172.21.15.26:0/1773359741 >> 172.21.15.26:0/1773359741 conn(0x7f9fbc0a3050 msgr2=0x7f9fbc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:40.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.960+0000 7f9fc1268700 1 -- 172.21.15.26:0/1773359741 shutdown_connections 2023-10-01T07:59:40.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.960+0000 7f9fc1268700 1 -- 172.21.15.26:0/1773359741 wait complete. 2023-10-01T07:59:40.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.961+0000 7f9fc1268700 1 Processor -- start 2023-10-01T07:59:40.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.961+0000 7f9fc1268700 1 -- start start 2023-10-01T07:59:40.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.962+0000 7f9fc1268700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9fbc09d630 0x7f9fbc11f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:40.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.962+0000 7f9fc1268700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fbc0a0a30 0x7f9fbc11f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:40.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.962+0000 7f9fc1268700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fbc133930 0x7f9fbc1c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:40.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.962+0000 7f9fc1268700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc121e70 con 0x7f9fbc0a0a30 2023-10-01T07:59:40.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.962+0000 7f9fc1268700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc11eea0 con 0x7f9fbc09d630 2023-10-01T07:59:40.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.962+0000 7f9fc1268700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc1211e0 con 0x7f9fbc133930 2023-10-01T07:59:40.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.962+0000 7f9fb27fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fbc0a0a30 0x7f9fbc11f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:40.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.962+0000 7f9fb27fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fbc0a0a30 0x7f9fbc11f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37158/0 (socket says 172.21.15.26:37158) 2023-10-01T07:59:40.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.962+0000 7f9fb27fc700 1 -- 172.21.15.26:0/2050406729 learned_addr learned my addr 172.21.15.26:0/2050406729 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:40.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.962+0000 7f9fbaffd700 1 --2- 172.21.15.26:0/2050406729 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9fbc09d630 0x7f9fbc11f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:40.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.962+0000 7f9fbb7fe700 1 --2- 172.21.15.26:0/2050406729 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fbc133930 0x7f9fbc1c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:40.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.962+0000 7f9fb27fc700 1 -- 172.21.15.26:0/2050406729 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fbc133930 msgr2=0x7f9fbc1c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:40.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.962+0000 7f9fb27fc700 1 --2- 172.21.15.26:0/2050406729 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fbc133930 0x7f9fbc1c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:40.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.962+0000 7f9fb27fc700 1 -- 172.21.15.26:0/2050406729 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9fbc09d630 msgr2=0x7f9fbc11f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:40.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.962+0000 7f9fb27fc700 1 --2- 172.21.15.26:0/2050406729 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9fbc09d630 0x7f9fbc11f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:40.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.962+0000 7f9fb27fc700 1 -- 172.21.15.26:0/2050406729 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fac0094a0 con 0x7f9fbc0a0a30 2023-10-01T07:59:40.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.963+0000 7f9fb27fc700 1 --2- 172.21.15.26:0/2050406729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fbc0a0a30 0x7f9fbc11f810 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f9fa400e980 tx=0x7f9fa400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:40.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.963+0000 7f9fb3fff700 1 -- 172.21.15.26:0/2050406729 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa4009710 con 0x7f9fbc0a0a30 2023-10-01T07:59:40.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.963+0000 7f9fb3fff700 1 -- 172.21.15.26:0/2050406729 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa400eed0 con 0x7f9fbc0a0a30 2023-10-01T07:59:40.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.963+0000 7f9fc1268700 1 -- 172.21.15.26:0/2050406729 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fb4009b30 con 0x7f9fbc0a0a30 2023-10-01T07:59:40.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.963+0000 7f9fb3fff700 1 -- 172.21.15.26:0/2050406729 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa400ca70 con 0x7f9fbc0a0a30 2023-10-01T07:59:40.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.963+0000 7f9fc1268700 1 -- 172.21.15.26:0/2050406729 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fbc122ba0 con 0x7f9fbc0a0a30 2023-10-01T07:59:40.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.964+0000 7f9fb3fff700 1 -- 172.21.15.26:0/2050406729 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9fa400cbd0 con 0x7f9fbc0a0a30 2023-10-01T07:59:40.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.964+0000 7f9fb3fff700 1 -- 172.21.15.26:0/2050406729 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9fa40421c0 con 0x7f9fbc0a0a30 2023-10-01T07:59:40.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.965+0000 7f9fc1268700 1 -- 172.21.15.26:0/2050406729 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fbc0747f0 con 0x7f9fbc0a0a30 2023-10-01T07:59:40.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:40.970+0000 7f9fb3fff700 1 -- 172.21.15.26:0/2050406729 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9fa4017020 con 0x7f9fbc0a0a30 2023-10-01T07:59:41.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.127+0000 7f2c5d59d700 1 -- 172.21.15.26:0/634183835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2c5806c360 con 0x7f2c5809e410 2023-10-01T07:59:41.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.127+0000 7f2c3f7fe700 1 -- 172.21.15.26:0/634183835 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2c500249b0 con 0x7f2c5809e410 2023-10-01T07:59:41.128 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:41.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.130+0000 7f2c5d59d700 1 -- 172.21.15.26:0/634183835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c5809e410 msgr2=0x7f2c581c49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:41.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.130+0000 7f2c5d59d700 1 --2- 172.21.15.26:0/634183835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c5809e410 0x7f2c581c49d0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f2c50015000 tx=0x7f2c50004ad0 comp rx=0 tx=0).stop 2023-10-01T07:59:41.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.130+0000 7f2c5d59d700 1 -- 172.21.15.26:0/634183835 shutdown_connections 2023-10-01T07:59:41.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.130+0000 7f2c5d59d700 1 --2- 172.21.15.26:0/634183835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c5809e410 0x7f2c581c49d0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:41.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.130+0000 7f2c5d59d700 1 --2- 172.21.15.26:0/634183835 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c5809d6f0 0x7f2c581c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:41.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.130+0000 7f2c5d59d700 1 --2- 172.21.15.26:0/634183835 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c5809e000 0x7f2c581c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:41.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.130+0000 7f2c5d59d700 1 -- 172.21.15.26:0/634183835 >> 172.21.15.26:0/634183835 conn(0x7f2c58066f50 msgr2=0x7f2c581bacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:41.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.130+0000 7f2c5d59d700 1 -- 172.21.15.26:0/634183835 shutdown_connections 2023-10-01T07:59:41.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.130+0000 7f2c5d59d700 1 -- 172.21.15.26:0/634183835 wait complete. 2023-10-01T07:59:41.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.134+0000 7f5fdc0a1700 1 -- 172.21.15.26:0/3691588219 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5fd41a9300 con 0x7f5fd409e440 2023-10-01T07:59:41.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.134+0000 7f5fca7fc700 1 -- 172.21.15.26:0/3691588219 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5fcc045070 con 0x7f5fd409e440 2023-10-01T07:59:41.135 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:41.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.136+0000 7f5fdc0a1700 1 -- 172.21.15.26:0/3691588219 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5fd409e440 msgr2=0x7f5fd41a68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:41.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.136+0000 7f5fdc0a1700 1 --2- 172.21.15.26:0/3691588219 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5fd409e440 0x7f5fd41a68e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc00efc0 tx=0x7f5fcc00c3a0 comp rx=0 tx=0).stop 2023-10-01T07:59:41.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.137+0000 7f5fdc0a1700 1 -- 172.21.15.26:0/3691588219 shutdown_connections 2023-10-01T07:59:41.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.137+0000 7f5fdc0a1700 1 --2- 172.21.15.26:0/3691588219 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5fd409e440 0x7f5fd41a68e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:41.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.137+0000 7f5fdc0a1700 1 --2- 172.21.15.26:0/3691588219 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5fd409d6f0 0x7f5fd41a5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:41.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.137+0000 7f5fdc0a1700 1 --2- 172.21.15.26:0/3691588219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fd409e000 0x7f5fd41a63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:41.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.137+0000 7f5fdc0a1700 1 -- 172.21.15.26:0/3691588219 >> 172.21.15.26:0/3691588219 conn(0x7f5fd4066f50 msgr2=0x7f5fd41bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:41.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.138+0000 7f5fdc0a1700 1 -- 172.21.15.26:0/3691588219 shutdown_connections 2023-10-01T07:59:41.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.138+0000 7f5fdc0a1700 1 -- 172.21.15.26:0/3691588219 wait complete. 2023-10-01T07:59:41.146 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:41.153 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:41.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.171+0000 7fe02e316700 1 -- 172.21.15.26:0/413590428 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe028074ea0 con 0x7fe028121f60 2023-10-01T07:59:41.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.171+0000 7fe024ff9700 1 -- 172.21.15.26:0/413590428 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe02001a380 con 0x7fe028121f60 2023-10-01T07:59:41.172 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:41.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.174+0000 7fe02e316700 1 -- 172.21.15.26:0/413590428 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe028121f60 msgr2=0x7fe0281d2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:41.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.174+0000 7fe02e316700 1 --2- 172.21.15.26:0/413590428 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe028121f60 0x7fe0281d2cb0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fe020014040 tx=0x7fe020004ad0 comp rx=0 tx=0).stop 2023-10-01T07:59:41.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.174+0000 7fe02e316700 1 -- 172.21.15.26:0/413590428 shutdown_connections 2023-10-01T07:59:41.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.174+0000 7fe02e316700 1 --2- 172.21.15.26:0/413590428 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe028121f60 0x7fe0281d2cb0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:41.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.174+0000 7fe02e316700 1 --2- 172.21.15.26:0/413590428 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe02806e570 0x7fe0281214e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:41.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.174+0000 7fe02e316700 1 --2- 172.21.15.26:0/413590428 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe028134610 0x7fe028121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:41.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.174+0000 7fe02e316700 1 -- 172.21.15.26:0/413590428 >> 172.21.15.26:0/413590428 conn(0x7fe0280a2aa0 msgr2=0x7fe0281bf040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:41.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.174+0000 7fe02e316700 1 -- 172.21.15.26:0/413590428 shutdown_connections 2023-10-01T07:59:41.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.174+0000 7fe02e316700 1 -- 172.21.15.26:0/413590428 wait complete. 2023-10-01T07:59:41.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.177+0000 7f9fc1268700 1 -- 172.21.15.26:0/2050406729 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9fbc072980 con 0x7f9fbc0a0a30 2023-10-01T07:59:41.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.177+0000 7f9fb3fff700 1 -- 172.21.15.26:0/2050406729 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9fa4044060 con 0x7f9fbc0a0a30 2023-10-01T07:59:41.178 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:41.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.180+0000 7f9fc1268700 1 -- 172.21.15.26:0/2050406729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fbc0a0a30 msgr2=0x7f9fbc11f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:41.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.180+0000 7f9fc1268700 1 --2- 172.21.15.26:0/2050406729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fbc0a0a30 0x7f9fbc11f810 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f9fa400e980 tx=0x7f9fa400ec90 comp rx=0 tx=0).stop 2023-10-01T07:59:41.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.180+0000 7f9fc1268700 1 -- 172.21.15.26:0/2050406729 shutdown_connections 2023-10-01T07:59:41.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.180+0000 7f9fc1268700 1 --2- 172.21.15.26:0/2050406729 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fbc133930 0x7f9fbc1c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:41.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.180+0000 7f9fc1268700 1 --2- 172.21.15.26:0/2050406729 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9fbc09d630 0x7f9fbc11f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:41.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.180+0000 7f9fc1268700 1 --2- 172.21.15.26:0/2050406729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fbc0a0a30 0x7f9fbc11f810 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:41.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.180+0000 7f9fc1268700 1 -- 172.21.15.26:0/2050406729 >> 172.21.15.26:0/2050406729 conn(0x7f9fbc0a3050 msgr2=0x7f9fbc09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:41.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.181+0000 7f9fc1268700 1 -- 172.21.15.26:0/2050406729 shutdown_connections 2023-10-01T07:59:41.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:41.181+0000 7f9fc1268700 1 -- 172.21.15.26:0/2050406729 wait complete. 2023-10-01T07:59:41.190 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:41.195 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:42.146 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:42.154 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:42.191 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:42.196 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:42.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.305+0000 7fd66986a700 1 Processor -- start 2023-10-01T07:59:42.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.306+0000 7fd66986a700 1 -- start start 2023-10-01T07:59:42.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.306+0000 7fd66986a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd66406b250 0x7fd664136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:42.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.306+0000 7fd66986a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd664136d80 0x7fd664139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:42.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.306+0000 7fd66986a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd66409ece0 con 0x7fd66406a770 2023-10-01T07:59:42.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.306+0000 7fd66986a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd66406b640 con 0x7fd664136d80 2023-10-01T07:59:42.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.306+0000 7fd66986a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd66409e760 con 0x7fd66406b250 2023-10-01T07:59:42.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.306+0000 7fd6637fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd664136d80 0x7fd664139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:42.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.306+0000 7fd6637fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd664136d80 0x7fd664139160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37170/0 (socket says 172.21.15.26:37170) 2023-10-01T07:59:42.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.306+0000 7fd6637fe700 1 -- 172.21.15.26:0/1472963786 learned_addr learned my addr 172.21.15.26:0/1472963786 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:42.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.307+0000 7fd6627fc700 1 --2- 172.21.15.26:0/1472963786 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd66406b250 0x7fd664136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:42.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.307+0000 7fd6637fe700 1 -- 172.21.15.26:0/1472963786 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd66406b250 msgr2=0x7fd664136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:42.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.307+0000 7fd6637fe700 1 --2- 172.21.15.26:0/1472963786 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd66406b250 0x7fd664136840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:42.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.307+0000 7fd6637fe700 1 -- 172.21.15.26:0/1472963786 >> v1:172.21.15.26:6789/0 conn(0x7fd66406a770 legacy=0x7fd66406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:42.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.307+0000 7fd6637fe700 1 -- 172.21.15.26:0/1472963786 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd66409e040 con 0x7fd664136d80 2023-10-01T07:59:42.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.307+0000 7fd6627fc700 1 --2- 172.21.15.26:0/1472963786 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd66406b250 0x7fd664136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:42.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.307+0000 7fd6637fe700 1 --2- 172.21.15.26:0/1472963786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd664136d80 0x7fd664139160 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fd65c009e50 tx=0x7fd65c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd17a38301a5933 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:42.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.307+0000 7fd661ffb700 1 -- 172.21.15.26:0/1472963786 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65c00e070 con 0x7fd664136d80 2023-10-01T07:59:42.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.307+0000 7fd661ffb700 1 -- 172.21.15.26:0/1472963786 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd65c00b910 con 0x7fd664136d80 2023-10-01T07:59:42.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.307+0000 7fd661ffb700 1 -- 172.21.15.26:0/1472963786 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65c00bcc0 con 0x7fd664136d80 2023-10-01T07:59:42.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.308+0000 7fd66986a700 1 -- 172.21.15.26:0/1472963786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd664136d80 msgr2=0x7fd664139160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:42.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.308+0000 7fd66986a700 1 --2- 172.21.15.26:0/1472963786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd664136d80 0x7fd664139160 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fd65c009e50 tx=0x7fd65c00b330 comp rx=0 tx=0).stop 2023-10-01T07:59:42.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.308+0000 7fd66986a700 1 -- 172.21.15.26:0/1472963786 shutdown_connections 2023-10-01T07:59:42.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.308+0000 7fd66986a700 1 --2- 172.21.15.26:0/1472963786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd664136d80 0x7fd664139160 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:42.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.308+0000 7fd66986a700 1 --2- 172.21.15.26:0/1472963786 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd66406b250 0x7fd664136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:42.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.308+0000 7fd66986a700 1 -- 172.21.15.26:0/1472963786 >> 172.21.15.26:0/1472963786 conn(0x7fd664066f50 msgr2=0x7fd66409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:42.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.308+0000 7fd66986a700 1 -- 172.21.15.26:0/1472963786 shutdown_connections 2023-10-01T07:59:42.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.308+0000 7fd66986a700 1 -- 172.21.15.26:0/1472963786 wait complete. 2023-10-01T07:59:42.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.309+0000 7fd66986a700 1 Processor -- start 2023-10-01T07:59:42.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.310+0000 7fd66986a700 1 -- start start 2023-10-01T07:59:42.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.310+0000 7fd66986a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd66406a770 0x7fd664132ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:42.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.310+0000 7fd66986a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd66406b250 0x7fd664133020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:42.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.310+0000 7fd66986a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd664136d80 0x7fd664133560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:42.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.310+0000 7fd66986a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6641303e0 con 0x7fd664136d80 2023-10-01T07:59:42.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.310+0000 7fd66986a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd66413a4a0 con 0x7fd66406b250 2023-10-01T07:59:42.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.310+0000 7fd66986a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6641347d0 con 0x7fd66406a770 2023-10-01T07:59:42.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.310+0000 7fd6627fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd66406b250 0x7fd664133020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:42.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.310+0000 7fd6627fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd66406b250 0x7fd664133020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33540/0 (socket says 172.21.15.26:33540) 2023-10-01T07:59:42.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.310+0000 7fd6627fc700 1 -- 172.21.15.26:0/1793857538 learned_addr learned my addr 172.21.15.26:0/1793857538 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:42.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.310+0000 7fd662ffd700 1 --2- 172.21.15.26:0/1793857538 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd66406a770 0x7fd664132ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:42.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.311+0000 7fd6637fe700 1 --2- 172.21.15.26:0/1793857538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd664136d80 0x7fd664133560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:42.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.311+0000 7fd662ffd700 1 -- 172.21.15.26:0/1793857538 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd66406b250 msgr2=0x7fd664133020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:42.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.311+0000 7fd662ffd700 1 --2- 172.21.15.26:0/1793857538 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd66406b250 0x7fd664133020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:42.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.311+0000 7fd662ffd700 1 -- 172.21.15.26:0/1793857538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd664136d80 msgr2=0x7fd664133560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:42.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.311+0000 7fd662ffd700 1 --2- 172.21.15.26:0/1793857538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd664136d80 0x7fd664133560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:42.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.311+0000 7fd662ffd700 1 -- 172.21.15.26:0/1793857538 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6580094a0 con 0x7fd66406a770 2023-10-01T07:59:42.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.311+0000 7fd6637fe700 1 --2- 172.21.15.26:0/1793857538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd664136d80 0x7fd664133560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:42.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.311+0000 7fd6627fc700 1 --2- 172.21.15.26:0/1793857538 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd66406b250 0x7fd664133020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:42.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.311+0000 7fd662ffd700 1 --2- 172.21.15.26:0/1793857538 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd66406a770 0x7fd664132ae0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fd654000f60 tx=0x7fd65400c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:42.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.311+0000 7fd64bfff700 1 -- 172.21.15.26:0/1793857538 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6540052d0 con 0x7fd66406a770 2023-10-01T07:59:42.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.311+0000 7fd64bfff700 1 -- 172.21.15.26:0/1793857538 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd654005430 con 0x7fd66406a770 2023-10-01T07:59:42.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.311+0000 7fd64bfff700 1 -- 172.21.15.26:0/1793857538 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6540038c0 con 0x7fd66406a770 2023-10-01T07:59:42.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.311+0000 7fd66986a700 1 -- 172.21.15.26:0/1793857538 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd65c009b30 con 0x7fd66406a770 2023-10-01T07:59:42.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.312+0000 7fd66986a700 1 -- 172.21.15.26:0/1793857538 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd664135b20 con 0x7fd66406a770 2023-10-01T07:59:42.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.313+0000 7fd66986a700 1 -- 172.21.15.26:0/1793857538 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd664134cd0 con 0x7fd66406a770 2023-10-01T07:59:42.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.314+0000 7fd64bfff700 1 -- 172.21.15.26:0/1793857538 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd654003a20 con 0x7fd66406a770 2023-10-01T07:59:42.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.314+0000 7fd64bfff700 1 -- 172.21.15.26:0/1793857538 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd65403ef90 con 0x7fd66406a770 2023-10-01T07:59:42.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.322+0000 7fd64bfff700 1 -- 172.21.15.26:0/1793857538 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd654011590 con 0x7fd66406a770 2023-10-01T07:59:42.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.341+0000 7f7271b1a700 1 Processor -- start 2023-10-01T07:59:42.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.341+0000 7f7271b1a700 1 -- start start 2023-10-01T07:59:42.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.342+0000 7f7271b1a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f726c09f410 0x7f726c136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:42.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.342+0000 7f7271b1a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f726c136fe0 0x7f726c1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:42.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.342+0000 7f7271b1a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f726c070940 con 0x7f726c09e930 2023-10-01T07:59:42.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.342+0000 7f7271b1a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f726c06fd60 con 0x7f726c136fe0 2023-10-01T07:59:42.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.342+0000 7f7271b1a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f726c06fa80 con 0x7f726c09f410 2023-10-01T07:59:42.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.342+0000 7f726bfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f726c136fe0 0x7f726c1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:42.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.342+0000 7f726bfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f726c136fe0 0x7f726c1393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37176/0 (socket says 172.21.15.26:37176) 2023-10-01T07:59:42.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.342+0000 7f726bfff700 1 -- 172.21.15.26:0/3204266119 learned_addr learned my addr 172.21.15.26:0/3204266119 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:42.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.343+0000 7f726bfff700 1 -- 172.21.15.26:0/3204266119 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f726c09f410 msgr2=0x7f726c136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:42.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.343+0000 7f726bfff700 1 --2- 172.21.15.26:0/3204266119 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f726c09f410 0x7f726c136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:42.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.343+0000 7f726bfff700 1 -- 172.21.15.26:0/3204266119 >> v1:172.21.15.26:6789/0 conn(0x7f726c09e930 legacy=0x7f726c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:42.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.343+0000 7f726a7fc700 1 -- 172.21.15.26:0/3204266119 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2104320212 0 0) 0x7f726c070940 con 0x7f726c09e930 2023-10-01T07:59:42.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.343+0000 7f726bfff700 1 -- 172.21.15.26:0/3204266119 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726c09fb60 con 0x7f726c136fe0 2023-10-01T07:59:42.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.343+0000 7f726bfff700 1 --2- 172.21.15.26:0/3204266119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f726c136fe0 0x7f726c1393c0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f7264009e50 tx=0x7f726400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec133f631703bfe8 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:42.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.343+0000 7f726a7fc700 1 -- 172.21.15.26:0/3204266119 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726400e070 con 0x7f726c136fe0 2023-10-01T07:59:42.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.343+0000 7f726a7fc700 1 -- 172.21.15.26:0/3204266119 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726400b9c0 con 0x7f726c136fe0 2023-10-01T07:59:42.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.343+0000 7f726a7fc700 1 -- 172.21.15.26:0/3204266119 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726400bd70 con 0x7f726c136fe0 2023-10-01T07:59:42.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.344+0000 7f7271b1a700 1 -- 172.21.15.26:0/3204266119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f726c136fe0 msgr2=0x7f726c1393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:42.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.344+0000 7f7271b1a700 1 --2- 172.21.15.26:0/3204266119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f726c136fe0 0x7f726c1393c0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f7264009e50 tx=0x7f726400b330 comp rx=0 tx=0).stop 2023-10-01T07:59:42.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.344+0000 7f7271b1a700 1 -- 172.21.15.26:0/3204266119 shutdown_connections 2023-10-01T07:59:42.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.344+0000 7f7271b1a700 1 --2- 172.21.15.26:0/3204266119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f726c136fe0 0x7f726c1393c0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:42.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.344+0000 7f7271b1a700 1 --2- 172.21.15.26:0/3204266119 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f726c09f410 0x7f726c136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:42.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.344+0000 7f7271b1a700 1 -- 172.21.15.26:0/3204266119 >> 172.21.15.26:0/3204266119 conn(0x7f726c0a4210 msgr2=0x7f726c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:42.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.344+0000 7f7271b1a700 1 -- 172.21.15.26:0/3204266119 shutdown_connections 2023-10-01T07:59:42.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.344+0000 7f7271b1a700 1 -- 172.21.15.26:0/3204266119 wait complete. 2023-10-01T07:59:42.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.345+0000 7f7271b1a700 1 Processor -- start 2023-10-01T07:59:42.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.345+0000 7f7271b1a700 1 -- start start 2023-10-01T07:59:42.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.346+0000 7f7271b1a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f726c09e930 0x7f726c122b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:42.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.346+0000 7f7271b1a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f726c09f410 0x7f726c123060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:42.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.346+0000 7f7271b1a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f726c136fe0 0x7f726c1235a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:42.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.346+0000 7f7271b1a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726c124fd0 con 0x7f726c09e930 2023-10-01T07:59:42.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.346+0000 7f7271b1a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726c071d90 con 0x7f726c09f410 2023-10-01T07:59:42.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.346+0000 7f7271b1a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f726c126640 con 0x7f726c136fe0 2023-10-01T07:59:42.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.346+0000 7f726affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f726c09f410 0x7f726c123060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:42.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.346+0000 7f726affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f726c09f410 0x7f726c123060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33556/0 (socket says 172.21.15.26:33556) 2023-10-01T07:59:42.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.346+0000 7f726affd700 1 -- 172.21.15.26:0/2101973568 learned_addr learned my addr 172.21.15.26:0/2101973568 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:42.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.346+0000 7f726bfff700 1 --2- 172.21.15.26:0/2101973568 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f726c136fe0 0x7f726c1235a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:42.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.346+0000 7f726b7fe700 1 --2- 172.21.15.26:0/2101973568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f726c09e930 0x7f726c122b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:42.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.347+0000 7f726b7fe700 1 -- 172.21.15.26:0/2101973568 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f726c136fe0 msgr2=0x7f726c1235a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:42.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.347+0000 7f726b7fe700 1 --2- 172.21.15.26:0/2101973568 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f726c136fe0 0x7f726c1235a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:42.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.347+0000 7f726b7fe700 1 -- 172.21.15.26:0/2101973568 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f726c09f410 msgr2=0x7f726c123060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:42.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.347+0000 7f726b7fe700 1 --2- 172.21.15.26:0/2101973568 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f726c09f410 0x7f726c123060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:42.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.347+0000 7f726b7fe700 1 -- 172.21.15.26:0/2101973568 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7264009b30 con 0x7f726c09e930 2023-10-01T07:59:42.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.347+0000 7f726bfff700 1 --2- 172.21.15.26:0/2101973568 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f726c136fe0 0x7f726c1235a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:42.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.347+0000 7f726b7fe700 1 --2- 172.21.15.26:0/2101973568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f726c09e930 0x7f726c122b20 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f725c00c430 tx=0x7f725c00c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:42.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.347+0000 7f7253fff700 1 -- 172.21.15.26:0/2101973568 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c0054e0 con 0x7f726c09e930 2023-10-01T07:59:42.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.347+0000 7f7253fff700 1 -- 172.21.15.26:0/2101973568 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725c00ce40 con 0x7f726c09e930 2023-10-01T07:59:42.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.347+0000 7f7271b1a700 1 -- 172.21.15.26:0/2101973568 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f726c1248b0 con 0x7f726c09e930 2023-10-01T07:59:42.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.347+0000 7f7253fff700 1 -- 172.21.15.26:0/2101973568 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c0038c0 con 0x7f726c09e930 2023-10-01T07:59:42.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.347+0000 7f7271b1a700 1 -- 172.21.15.26:0/2101973568 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f726c126360 con 0x7f726c09e930 2023-10-01T07:59:42.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.348+0000 7f7271b1a700 1 -- 172.21.15.26:0/2101973568 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f726c074ea0 con 0x7f726c09e930 2023-10-01T07:59:42.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.349+0000 7f7253fff700 1 -- 172.21.15.26:0/2101973568 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f725c003a20 con 0x7f726c09e930 2023-10-01T07:59:42.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.349+0000 7f7253fff700 1 -- 172.21.15.26:0/2101973568 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f725c03ee50 con 0x7f726c09e930 2023-10-01T07:59:42.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.350+0000 7fe1a5f86700 1 Processor -- start 2023-10-01T07:59:42.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.350+0000 7fe1a5f86700 1 -- start start 2023-10-01T07:59:42.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.351+0000 7fe1a5f86700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe1a009d6f0 0x7fe1a009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:42.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.351+0000 7fe1a5f86700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe1a009e000 0x7fe1a01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:42.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.351+0000 7fe1a5f86700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a009b120 con 0x7fe1a009e410 2023-10-01T07:59:42.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.351+0000 7fe1a5f86700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a006b460 con 0x7fe1a009d6f0 2023-10-01T07:59:42.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.351+0000 7fe1a5f86700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a009a7e0 con 0x7fe1a009e000 2023-10-01T07:59:42.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.351+0000 7fe19f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe1a009d6f0 0x7fe1a009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:42.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.351+0000 7fe19f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe1a009d6f0 0x7fe1a009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33564/0 (socket says 172.21.15.26:33564) 2023-10-01T07:59:42.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.351+0000 7fe19f7fe700 1 -- 172.21.15.26:0/3677072647 learned_addr learned my addr 172.21.15.26:0/3677072647 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:42.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.351+0000 7fe19effd700 1 --2- 172.21.15.26:0/3677072647 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe1a009e000 0x7fe1a01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:42.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.352+0000 7fe19f7fe700 1 -- 172.21.15.26:0/3677072647 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe1a009e000 msgr2=0x7fe1a01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:42.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.352+0000 7fe19f7fe700 1 --2- 172.21.15.26:0/3677072647 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe1a009e000 0x7fe1a01339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:42.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.352+0000 7fe19f7fe700 1 -- 172.21.15.26:0/3677072647 >> v1:172.21.15.26:6789/0 conn(0x7fe1a009e410 legacy=0x7fe1a0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:42.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.352+0000 7fe19f7fe700 1 -- 172.21.15.26:0/3677072647 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a009a500 con 0x7fe1a009d6f0 2023-10-01T07:59:42.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.352+0000 7fe19effd700 1 --2- 172.21.15.26:0/3677072647 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe1a009e000 0x7fe1a01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:42.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.352+0000 7fe19f7fe700 1 --2- 172.21.15.26:0/3677072647 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe1a009d6f0 0x7fe1a009dac0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fe190009920 tx=0x7fe190009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=872a984a5e403994 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:42.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.352+0000 7fe19e7fc700 1 -- 172.21.15.26:0/3677072647 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe190011830 con 0x7fe1a009d6f0 2023-10-01T07:59:42.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.352+0000 7fe19e7fc700 1 -- 172.21.15.26:0/3677072647 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe190011990 con 0x7fe1a009d6f0 2023-10-01T07:59:42.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.352+0000 7fe19e7fc700 1 -- 172.21.15.26:0/3677072647 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe190011d20 con 0x7fe1a009d6f0 2023-10-01T07:59:42.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.353+0000 7fe1a5f86700 1 -- 172.21.15.26:0/3677072647 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe1a009d6f0 msgr2=0x7fe1a009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:42.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.353+0000 7fe1a5f86700 1 --2- 172.21.15.26:0/3677072647 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe1a009d6f0 0x7fe1a009dac0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fe190009920 tx=0x7fe190009c30 comp rx=0 tx=0).stop 2023-10-01T07:59:42.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.353+0000 7fe1a5f86700 1 -- 172.21.15.26:0/3677072647 shutdown_connections 2023-10-01T07:59:42.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.353+0000 7fe1a5f86700 1 --2- 172.21.15.26:0/3677072647 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe1a009d6f0 0x7fe1a009dac0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:42.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.353+0000 7fe1a5f86700 1 --2- 172.21.15.26:0/3677072647 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe1a009e000 0x7fe1a01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:42.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.353+0000 7fe1a5f86700 1 -- 172.21.15.26:0/3677072647 >> 172.21.15.26:0/3677072647 conn(0x7fe1a0066f50 msgr2=0x7fe1a009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:42.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.353+0000 7fe1a5f86700 1 -- 172.21.15.26:0/3677072647 shutdown_connections 2023-10-01T07:59:42.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.353+0000 7fe1a5f86700 1 -- 172.21.15.26:0/3677072647 wait complete. 2023-10-01T07:59:42.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.355+0000 7fe1a5f86700 1 Processor -- start 2023-10-01T07:59:42.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.355+0000 7f7253fff700 1 -- 172.21.15.26:0/2101973568 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f725c019b40 con 0x7f726c09e930 2023-10-01T07:59:42.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.355+0000 7fe1a5f86700 1 -- start start 2023-10-01T07:59:42.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.355+0000 7fe1a5f86700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe1a009d6f0 0x7fe1a0122580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:42.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.355+0000 7fe1a5f86700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe1a009e000 0x7fe1a0122ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:42.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.355+0000 7fe1a5f86700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1a009e410 0x7fe1a0123000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:42.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.355+0000 7fe1a5f86700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a0126030 con 0x7fe1a009e410 2023-10-01T07:59:42.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.355+0000 7fe1a5f86700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a009c780 con 0x7fe1a009e000 2023-10-01T07:59:42.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.355+0000 7fe1a5f86700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a00a2eb0 con 0x7fe1a009d6f0 2023-10-01T07:59:42.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.356+0000 7fe19ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1a009e410 0x7fe1a0123000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:42.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.356+0000 7fe19f7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe1a009d6f0 0x7fe1a0122580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:42.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.356+0000 7fe19ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1a009e410 0x7fe1a0123000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37196/0 (socket says 172.21.15.26:37196) 2023-10-01T07:59:42.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.356+0000 7fe19ffff700 1 -- 172.21.15.26:0/1797226600 learned_addr learned my addr 172.21.15.26:0/1797226600 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:42.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.356+0000 7fe19effd700 1 --2- 172.21.15.26:0/1797226600 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe1a009e000 0x7fe1a0122ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:42.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.356+0000 7fe19f7fe700 1 -- 172.21.15.26:0/1797226600 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe1a009e000 msgr2=0x7fe1a0122ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:42.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.356+0000 7fe19f7fe700 1 --2- 172.21.15.26:0/1797226600 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe1a009e000 0x7fe1a0122ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:42.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.356+0000 7fe19f7fe700 1 -- 172.21.15.26:0/1797226600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1a009e410 msgr2=0x7fe1a0123000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:42.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.356+0000 7fe19f7fe700 1 --2- 172.21.15.26:0/1797226600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1a009e410 0x7fe1a0123000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:42.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.356+0000 7fe19f7fe700 1 -- 172.21.15.26:0/1797226600 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1940094a0 con 0x7fe1a009d6f0 2023-10-01T07:59:42.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.356+0000 7fe19ffff700 1 --2- 172.21.15.26:0/1797226600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1a009e410 0x7fe1a0123000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:59:42.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.356+0000 7fe19f7fe700 1 --2- 172.21.15.26:0/1797226600 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe1a009d6f0 0x7fe1a0122580 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fe190009920 tx=0x7fe190004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:42.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.357+0000 7fe187fff700 1 -- 172.21.15.26:0/1797226600 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe190004510 con 0x7fe1a009d6f0 2023-10-01T07:59:42.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.357+0000 7fe187fff700 1 -- 172.21.15.26:0/1797226600 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1900036a0 con 0x7fe1a009d6f0 2023-10-01T07:59:42.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.357+0000 7fe1a5f86700 1 -- 172.21.15.26:0/1797226600 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe190009550 con 0x7fe1a009d6f0 2023-10-01T07:59:42.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.357+0000 7fe187fff700 1 -- 172.21.15.26:0/1797226600 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe190003a10 con 0x7fe1a009d6f0 2023-10-01T07:59:42.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.357+0000 7fe1a5f86700 1 -- 172.21.15.26:0/1797226600 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a0124f40 con 0x7fe1a009d6f0 2023-10-01T07:59:42.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.358+0000 7fe187fff700 1 -- 172.21.15.26:0/1797226600 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe190003b70 con 0x7fe1a009d6f0 2023-10-01T07:59:42.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.358+0000 7fe1a5f86700 1 -- 172.21.15.26:0/1797226600 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1800052e0 con 0x7fe1a009d6f0 2023-10-01T07:59:42.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.358+0000 7fe187fff700 1 -- 172.21.15.26:0/1797226600 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe190021030 con 0x7fe1a009d6f0 2023-10-01T07:59:42.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.363+0000 7fe187fff700 1 -- 172.21.15.26:0/1797226600 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe19001a430 con 0x7fe1a009d6f0 2023-10-01T07:59:42.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.387+0000 7fedf8445700 1 Processor -- start 2023-10-01T07:59:42.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.388+0000 7fedf8445700 1 -- start start 2023-10-01T07:59:42.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.388+0000 7fedf8445700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedf009e850 0x7fedf009ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:42.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.388+0000 7fedf8445700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fedf009f160 0x7fedf0133bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:42.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.388+0000 7fedf8445700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedf009f5b0 0x7fedf0134130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:42.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.388+0000 7fedf8445700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf006bf30 con 0x7fedf009f160 2023-10-01T07:59:42.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.388+0000 7fedf8445700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf009ffb0 con 0x7fedf009e850 2023-10-01T07:59:42.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.388+0000 7fedf8445700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fedf006cb10 con 0x7fedf009f5b0 2023-10-01T07:59:42.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.388+0000 7fedf61e1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedf009e850 0x7fedf009ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:42.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.389+0000 7fedf69e2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedf009f5b0 0x7fedf0134130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:42.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.389+0000 7fedf61e1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedf009e850 0x7fedf009ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33584/0 (socket says 172.21.15.26:33584) 2023-10-01T07:59:42.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.389+0000 7fedf61e1700 1 -- 172.21.15.26:0/1998320578 learned_addr learned my addr 172.21.15.26:0/1998320578 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:42.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.389+0000 7fedf59e0700 1 --2- 172.21.15.26:0/1998320578 >> v2:172.21.15.26:3300/0 conn(0x7fedf009f160 0x7fedf0133bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:42.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.389+0000 7fedf61e1700 1 -- 172.21.15.26:0/1998320578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedf009f5b0 msgr2=0x7fedf0134130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:42.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.389+0000 7fedf61e1700 1 --2- 172.21.15.26:0/1998320578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedf009f5b0 0x7fedf0134130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:42.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.389+0000 7fedf61e1700 1 -- 172.21.15.26:0/1998320578 >> v2:172.21.15.26:3300/0 conn(0x7fedf009f160 msgr2=0x7fedf0133bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:42.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.389+0000 7fedf61e1700 1 --2- 172.21.15.26:0/1998320578 >> v2:172.21.15.26:3300/0 conn(0x7fedf009f160 0x7fedf0133bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:42.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.389+0000 7fedf61e1700 1 -- 172.21.15.26:0/1998320578 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf00a0270 con 0x7fedf009e850 2023-10-01T07:59:42.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.389+0000 7fedf59e0700 1 --2- 172.21.15.26:0/1998320578 >> v2:172.21.15.26:3300/0 conn(0x7fedf009f160 0x7fedf0133bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:42.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.389+0000 7fedf61e1700 1 --2- 172.21.15.26:0/1998320578 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedf009e850 0x7fedf009ec20 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fedec0098f0 tx=0x7fedec009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89c34c69c2906bd9 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:42.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.389+0000 7fedf51df700 1 -- 172.21.15.26:0/1998320578 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedec011830 con 0x7fedf009e850 2023-10-01T07:59:42.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.389+0000 7fedf51df700 1 -- 172.21.15.26:0/1998320578 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedec011990 con 0x7fedf009e850 2023-10-01T07:59:42.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.389+0000 7fedf51df700 1 -- 172.21.15.26:0/1998320578 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedec011d20 con 0x7fedf009e850 2023-10-01T07:59:42.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.390+0000 7fedf8445700 1 -- 172.21.15.26:0/1998320578 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedf009e850 msgr2=0x7fedf009ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:42.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.390+0000 7fedf8445700 1 --2- 172.21.15.26:0/1998320578 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedf009e850 0x7fedf009ec20 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fedec0098f0 tx=0x7fedec009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:42.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.390+0000 7fedf8445700 1 -- 172.21.15.26:0/1998320578 shutdown_connections 2023-10-01T07:59:42.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.390+0000 7fedf8445700 1 --2- 172.21.15.26:0/1998320578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedf009f5b0 0x7fedf0134130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:42.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.390+0000 7fedf8445700 1 --2- 172.21.15.26:0/1998320578 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedf009e850 0x7fedf009ec20 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:42.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.390+0000 7fedf8445700 1 --2- 172.21.15.26:0/1998320578 >> v2:172.21.15.26:3300/0 conn(0x7fedf009f160 0x7fedf0133bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:42.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.390+0000 7fedf8445700 1 -- 172.21.15.26:0/1998320578 >> 172.21.15.26:0/1998320578 conn(0x7fedf00a3f70 msgr2=0x7fedf00a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:42.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.390+0000 7fedf8445700 1 -- 172.21.15.26:0/1998320578 shutdown_connections 2023-10-01T07:59:42.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.390+0000 7fedf8445700 1 -- 172.21.15.26:0/1998320578 wait complete. 2023-10-01T07:59:42.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.392+0000 7fedf8445700 1 Processor -- start 2023-10-01T07:59:42.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.392+0000 7fedf8445700 1 -- start start 2023-10-01T07:59:42.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.392+0000 7fedf8445700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedf009e850 0x7fedf0122960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:42.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.392+0000 7fedf8445700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedf009f160 0x7fedf0122ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:42.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.392+0000 7fedf8445700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedf009f5b0 0x7fedf01233e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:42.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.393+0000 7fedf8445700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf0124530 con 0x7fedf009e850 2023-10-01T07:59:42.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.393+0000 7fedf8445700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf0125b20 con 0x7fedf009f5b0 2023-10-01T07:59:42.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.393+0000 7fedf8445700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fedf006f810 con 0x7fedf009f160 2023-10-01T07:59:42.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.393+0000 7fedf69e2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedf009f5b0 0x7fedf01233e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:42.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.393+0000 7fedf69e2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedf009f5b0 0x7fedf01233e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33596/0 (socket says 172.21.15.26:33596) 2023-10-01T07:59:42.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.393+0000 7fedf69e2700 1 -- 172.21.15.26:0/1835186257 learned_addr learned my addr 172.21.15.26:0/1835186257 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:42.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.393+0000 7fedf61e1700 1 --2- 172.21.15.26:0/1835186257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedf009e850 0x7fedf0122960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:42.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.393+0000 7fedf59e0700 1 --2- 172.21.15.26:0/1835186257 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedf009f160 0x7fedf0122ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:42.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.393+0000 7fedf69e2700 1 -- 172.21.15.26:0/1835186257 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedf009f160 msgr2=0x7fedf0122ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:42.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.393+0000 7fedf69e2700 1 --2- 172.21.15.26:0/1835186257 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedf009f160 0x7fedf0122ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:42.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.393+0000 7fedf69e2700 1 -- 172.21.15.26:0/1835186257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedf009e850 msgr2=0x7fedf0122960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:42.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.393+0000 7fedf69e2700 1 --2- 172.21.15.26:0/1835186257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedf009e850 0x7fedf0122960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:42.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.393+0000 7fedf69e2700 1 -- 172.21.15.26:0/1835186257 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede00094a0 con 0x7fedf009f5b0 2023-10-01T07:59:42.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.393+0000 7fedf61e1700 1 --2- 172.21.15.26:0/1835186257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedf009e850 0x7fedf0122960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:42.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.394+0000 7fedf69e2700 1 --2- 172.21.15.26:0/1835186257 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedf009f5b0 0x7fedf01233e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fede8007e30 tx=0x7fede800e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:42.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.394+0000 7fede6ffd700 1 -- 172.21.15.26:0/1835186257 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede800ed30 con 0x7fedf009f5b0 2023-10-01T07:59:42.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.394+0000 7fede6ffd700 1 -- 172.21.15.26:0/1835186257 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede800ee90 con 0x7fedf009f5b0 2023-10-01T07:59:42.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.394+0000 7fedf8445700 1 -- 172.21.15.26:0/1835186257 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedec009550 con 0x7fedf009f5b0 2023-10-01T07:59:42.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.394+0000 7fede6ffd700 1 -- 172.21.15.26:0/1835186257 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede8014660 con 0x7fedf009f5b0 2023-10-01T07:59:42.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.394+0000 7fedf8445700 1 -- 172.21.15.26:0/1835186257 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf006cd30 con 0x7fedf009f5b0 2023-10-01T07:59:42.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.395+0000 7fedf8445700 1 -- 172.21.15.26:0/1835186257 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf00747f0 con 0x7fedf009f5b0 2023-10-01T07:59:42.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.396+0000 7fede6ffd700 1 -- 172.21.15.26:0/1835186257 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fede80147c0 con 0x7fedf009f5b0 2023-10-01T07:59:42.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.396+0000 7fede6ffd700 1 -- 172.21.15.26:0/1835186257 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fede80408f0 con 0x7fedf009f5b0 2023-10-01T07:59:42.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.400+0000 7fede6ffd700 1 -- 172.21.15.26:0/1835186257 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fede8014a70 con 0x7fedf009f5b0 2023-10-01T07:59:42.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.570+0000 7fe1a5f86700 1 -- 172.21.15.26:0/1797226600 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe180005590 con 0x7fe1a009d6f0 2023-10-01T07:59:42.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.570+0000 7fe187fff700 1 -- 172.21.15.26:0/1797226600 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe190015070 con 0x7fe1a009d6f0 2023-10-01T07:59:42.571 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:42.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.571+0000 7fd66986a700 1 -- 172.21.15.26:0/1793857538 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd664071e60 con 0x7fd66406a770 2023-10-01T07:59:42.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.571+0000 7fd64bfff700 1 -- 172.21.15.26:0/1793857538 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd654017070 con 0x7fd66406a770 2023-10-01T07:59:42.572 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:42.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.574+0000 7fe1a5f86700 1 -- 172.21.15.26:0/1797226600 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe1a009d6f0 msgr2=0x7fe1a0122580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:42.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.574+0000 7fe1a5f86700 1 --2- 172.21.15.26:0/1797226600 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe1a009d6f0 0x7fe1a0122580 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fe190009920 tx=0x7fe190004750 comp rx=0 tx=0).stop 2023-10-01T07:59:42.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.574+0000 7fd66986a700 1 -- 172.21.15.26:0/1793857538 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd66406a770 msgr2=0x7fd664132ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:42.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.574+0000 7fd66986a700 1 --2- 172.21.15.26:0/1793857538 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd66406a770 0x7fd664132ae0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fd654000f60 tx=0x7fd65400c730 comp rx=0 tx=0).stop 2023-10-01T07:59:42.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.574+0000 7fd66986a700 1 -- 172.21.15.26:0/1793857538 shutdown_connections 2023-10-01T07:59:42.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.574+0000 7fd66986a700 1 --2- 172.21.15.26:0/1793857538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd664136d80 0x7fd664133560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:42.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.574+0000 7fd66986a700 1 --2- 172.21.15.26:0/1793857538 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd66406a770 0x7fd664132ae0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:42.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.574+0000 7fd66986a700 1 --2- 172.21.15.26:0/1793857538 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd66406b250 0x7fd664133020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:42.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.574+0000 7fd66986a700 1 -- 172.21.15.26:0/1793857538 >> 172.21.15.26:0/1793857538 conn(0x7fd664066f50 msgr2=0x7fd6640a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:42.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.574+0000 7fd66986a700 1 -- 172.21.15.26:0/1793857538 shutdown_connections 2023-10-01T07:59:42.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.574+0000 7fd66986a700 1 -- 172.21.15.26:0/1793857538 wait complete. 2023-10-01T07:59:42.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.575+0000 7fe1a5f86700 1 -- 172.21.15.26:0/1797226600 shutdown_connections 2023-10-01T07:59:42.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.575+0000 7fe1a5f86700 1 --2- 172.21.15.26:0/1797226600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1a009e410 0x7fe1a0123000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:42.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.575+0000 7fe1a5f86700 1 --2- 172.21.15.26:0/1797226600 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe1a009d6f0 0x7fe1a0122580 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:42.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.575+0000 7fe1a5f86700 1 --2- 172.21.15.26:0/1797226600 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe1a009e000 0x7fe1a0122ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:42.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.575+0000 7fe1a5f86700 1 -- 172.21.15.26:0/1797226600 >> 172.21.15.26:0/1797226600 conn(0x7fe1a0066f50 msgr2=0x7fe1a00a1580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:42.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.575+0000 7fe1a5f86700 1 -- 172.21.15.26:0/1797226600 shutdown_connections 2023-10-01T07:59:42.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.575+0000 7fe1a5f86700 1 -- 172.21.15.26:0/1797226600 wait complete. 2023-10-01T07:59:42.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:42.594 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:42.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.595+0000 7f7271b1a700 1 -- 172.21.15.26:0/2101973568 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f726c06b250 con 0x7f726c09e930 2023-10-01T07:59:42.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.595+0000 7f7253fff700 1 -- 172.21.15.26:0/2101973568 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f725c017030 con 0x7f726c09e930 2023-10-01T07:59:42.596 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:42.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.597+0000 7f7271b1a700 1 -- 172.21.15.26:0/2101973568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f726c09e930 msgr2=0x7f726c122b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:42.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.597+0000 7f7271b1a700 1 --2- 172.21.15.26:0/2101973568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f726c09e930 0x7f726c122b20 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f725c00c430 tx=0x7f725c00c740 comp rx=0 tx=0).stop 2023-10-01T07:59:42.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.598+0000 7f7271b1a700 1 -- 172.21.15.26:0/2101973568 shutdown_connections 2023-10-01T07:59:42.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.598+0000 7f7271b1a700 1 --2- 172.21.15.26:0/2101973568 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f726c136fe0 0x7f726c1235a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:42.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.598+0000 7f7271b1a700 1 --2- 172.21.15.26:0/2101973568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f726c09e930 0x7f726c122b20 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:42.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.598+0000 7f7271b1a700 1 --2- 172.21.15.26:0/2101973568 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f726c09f410 0x7f726c123060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:42.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.598+0000 7f7271b1a700 1 -- 172.21.15.26:0/2101973568 >> 172.21.15.26:0/2101973568 conn(0x7f726c0a4210 msgr2=0x7f726c06bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:42.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.598+0000 7f7271b1a700 1 -- 172.21.15.26:0/2101973568 shutdown_connections 2023-10-01T07:59:42.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.598+0000 7f7271b1a700 1 -- 172.21.15.26:0/2101973568 wait complete. 2023-10-01T07:59:42.612 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:42.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.614+0000 7fedf8445700 1 -- 172.21.15.26:0/1835186257 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fedf006bbb0 con 0x7fedf009f5b0 2023-10-01T07:59:42.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.614+0000 7fede6ffd700 1 -- 172.21.15.26:0/1835186257 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fede802c090 con 0x7fedf009f5b0 2023-10-01T07:59:42.615 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:42.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.617+0000 7fedf8445700 1 -- 172.21.15.26:0/1835186257 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedf009f5b0 msgr2=0x7fedf01233e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:42.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.617+0000 7fedf8445700 1 --2- 172.21.15.26:0/1835186257 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedf009f5b0 0x7fedf01233e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fede8007e30 tx=0x7fede800e3c0 comp rx=0 tx=0).stop 2023-10-01T07:59:42.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.617+0000 7fedf8445700 1 -- 172.21.15.26:0/1835186257 shutdown_connections 2023-10-01T07:59:42.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.617+0000 7fedf8445700 1 --2- 172.21.15.26:0/1835186257 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fedf009f5b0 0x7fedf01233e0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:42.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.617+0000 7fedf8445700 1 --2- 172.21.15.26:0/1835186257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedf009e850 0x7fedf0122960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:42.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.617+0000 7fedf8445700 1 --2- 172.21.15.26:0/1835186257 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fedf009f160 0x7fedf0122ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:42.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.617+0000 7fedf8445700 1 -- 172.21.15.26:0/1835186257 >> 172.21.15.26:0/1835186257 conn(0x7fedf00a3f70 msgr2=0x7fedf00a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:42.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.617+0000 7fedf8445700 1 -- 172.21.15.26:0/1835186257 shutdown_connections 2023-10-01T07:59:42.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:42.617+0000 7fedf8445700 1 -- 172.21.15.26:0/1835186257 wait complete. 2023-10-01T07:59:42.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:43.591 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:43.594 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:43.614 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:43.632 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:43.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.752+0000 7fae92e4e700 1 Processor -- start 2023-10-01T07:59:43.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.752+0000 7fae92e4e700 1 -- start start 2023-10-01T07:59:43.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.753+0000 7fae92e4e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fae8c09d630 0x7fae8c0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:43.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.753+0000 7fae92e4e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae8c138d80 0x7fae8c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:43.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.753+0000 7fae92e4e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae8c0a2a70 con 0x7fae8c0a0a30 2023-10-01T07:59:43.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.753+0000 7fae92e4e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae8c0a01d0 con 0x7fae8c09d630 2023-10-01T07:59:43.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.753+0000 7fae92e4e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c09e2b0 con 0x7fae8c138d80 2023-10-01T07:59:43.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.754+0000 7f028c1c0700 1 Processor -- start 2023-10-01T07:59:43.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.754+0000 7fae913eb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae8c138d80 0x7fae8c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:43.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.754+0000 7fae913eb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae8c138d80 0x7fae8c13b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57424/0 (socket says 172.21.15.26:57424) 2023-10-01T07:59:43.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.754+0000 7fae913eb700 1 -- 172.21.15.26:0/3550404635 learned_addr learned my addr 172.21.15.26:0/3550404635 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:43.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.754+0000 7fae8bfff700 1 --2- 172.21.15.26:0/3550404635 >> v2:172.21.15.26:3300/0 conn(0x7fae8c09d630 0x7fae8c0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:43.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.754+0000 7f028c1c0700 1 -- start start 2023-10-01T07:59:43.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.754+0000 7fae913eb700 1 -- 172.21.15.26:0/3550404635 >> v2:172.21.15.26:3300/0 conn(0x7fae8c09d630 msgr2=0x7fae8c0a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:43.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.754+0000 7fae913eb700 1 --2- 172.21.15.26:0/3550404635 >> v2:172.21.15.26:3300/0 conn(0x7fae8c09d630 0x7fae8c0a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:43.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.754+0000 7fae913eb700 1 -- 172.21.15.26:0/3550404635 >> v1:172.21.15.26:6789/0 conn(0x7fae8c0a0a30 legacy=0x7fae8c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:43.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.754+0000 7fae913eb700 1 -- 172.21.15.26:0/3550404635 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8c09dc50 con 0x7fae8c138d80 2023-10-01T07:59:43.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.754+0000 7fae913eb700 1 --2- 172.21.15.26:0/3550404635 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae8c138d80 0x7fae8c13b160 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fae84009e50 tx=0x7fae8400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86c996ed9e837ef4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:43.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.755+0000 7fae8b7fe700 1 -- 172.21.15.26:0/3550404635 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8400e070 con 0x7fae8c138d80 2023-10-01T07:59:43.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.755+0000 7fae8b7fe700 1 -- 172.21.15.26:0/3550404635 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8400b9c0 con 0x7fae8c138d80 2023-10-01T07:59:43.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.755+0000 7fae8b7fe700 1 -- 172.21.15.26:0/3550404635 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8400bd70 con 0x7fae8c138d80 2023-10-01T07:59:43.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.755+0000 7f028c1c0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f028412cf60 0x7f028406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:43.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.755+0000 7f028c1c0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f028412f8b0 0x7f028412fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:43.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.755+0000 7f028c1c0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0284130260 0x7f0284136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:43.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.755+0000 7f028c1c0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f028412d330 con 0x7f028412cf60 2023-10-01T07:59:43.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.755+0000 7f028c1c0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f028412cd90 con 0x7f0284130260 2023-10-01T07:59:43.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.755+0000 7f028c1c0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02841306d0 con 0x7f028412f8b0 2023-10-01T07:59:43.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.755+0000 7f028a75d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0284130260 0x7f0284136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:43.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.755+0000 7f0289f5c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f028412cf60 0x7f028406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:43.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.755+0000 7f028975b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f028412f8b0 0x7f028412fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:43.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.755+0000 7f0289f5c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f028412cf60 0x7f028406f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56858/0 (socket says 172.21.15.26:56858) 2023-10-01T07:59:43.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.755+0000 7f028a75d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0284130260 0x7f0284136c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43690/0 (socket says 172.21.15.26:43690) 2023-10-01T07:59:43.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.755+0000 7f0289f5c700 1 -- 172.21.15.26:0/3748002021 learned_addr learned my addr 172.21.15.26:0/3748002021 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:43.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.755+0000 7f028975b700 1 -- 172.21.15.26:0/3748002021 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0284130260 msgr2=0x7f0284136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:43.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.755+0000 7f028975b700 1 --2- 172.21.15.26:0/3748002021 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0284130260 0x7f0284136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:43.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.755+0000 7f028975b700 1 -- 172.21.15.26:0/3748002021 >> v2:172.21.15.26:3300/0 conn(0x7f028412cf60 msgr2=0x7f028406f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:43.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.755+0000 7f028975b700 1 --2- 172.21.15.26:0/3748002021 >> v2:172.21.15.26:3300/0 conn(0x7f028412cf60 0x7f028406f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:43.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.755+0000 7f028975b700 1 -- 172.21.15.26:0/3748002021 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0284071780 con 0x7f028412f8b0 2023-10-01T07:59:43.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.755+0000 7f0289f5c700 1 --2- 172.21.15.26:0/3748002021 >> v2:172.21.15.26:3300/0 conn(0x7f028412cf60 0x7f028406f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:59:43.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.756+0000 7f028975b700 1 --2- 172.21.15.26:0/3748002021 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f028412f8b0 0x7f028412fd20 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f0274009870 tx=0x7f0274009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f2f77100da7a6fa server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:43.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.756+0000 7fae92e4e700 1 -- 172.21.15.26:0/3550404635 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae8c138d80 msgr2=0x7fae8c13b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:43.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.756+0000 7fae92e4e700 1 --2- 172.21.15.26:0/3550404635 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae8c138d80 0x7fae8c13b160 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fae84009e50 tx=0x7fae8400b330 comp rx=0 tx=0).stop 2023-10-01T07:59:43.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.756+0000 7fae92e4e700 1 -- 172.21.15.26:0/3550404635 shutdown_connections 2023-10-01T07:59:43.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.756+0000 7fae92e4e700 1 --2- 172.21.15.26:0/3550404635 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae8c138d80 0x7fae8c13b160 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:43.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.756+0000 7fae92e4e700 1 --2- 172.21.15.26:0/3550404635 >> v2:172.21.15.26:3300/0 conn(0x7fae8c09d630 0x7fae8c0a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:43.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.756+0000 7fae92e4e700 1 -- 172.21.15.26:0/3550404635 >> 172.21.15.26:0/3550404635 conn(0x7fae8c0a3050 msgr2=0x7fae8c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:43.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.756+0000 7f0288f5a700 1 -- 172.21.15.26:0/3748002021 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0274017070 con 0x7f028412f8b0 2023-10-01T07:59:43.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.756+0000 7f0288f5a700 1 -- 172.21.15.26:0/3748002021 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027400d040 con 0x7f028412f8b0 2023-10-01T07:59:43.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.756+0000 7f0288f5a700 1 -- 172.21.15.26:0/3748002021 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0274006d50 con 0x7f028412f8b0 2023-10-01T07:59:43.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.756+0000 7fae92e4e700 1 -- 172.21.15.26:0/3550404635 shutdown_connections 2023-10-01T07:59:43.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.756+0000 7fae92e4e700 1 -- 172.21.15.26:0/3550404635 wait complete. 2023-10-01T07:59:43.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.757+0000 7f028c1c0700 1 -- 172.21.15.26:0/3748002021 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f028412f8b0 msgr2=0x7f028412fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:43.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.757+0000 7f028c1c0700 1 --2- 172.21.15.26:0/3748002021 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f028412f8b0 0x7f028412fd20 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f0274009870 tx=0x7f0274009b80 comp rx=0 tx=0).stop 2023-10-01T07:59:43.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.757+0000 7f028c1c0700 1 -- 172.21.15.26:0/3748002021 shutdown_connections 2023-10-01T07:59:43.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.757+0000 7f028c1c0700 1 --2- 172.21.15.26:0/3748002021 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0284130260 0x7f0284136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:43.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.757+0000 7f028c1c0700 1 --2- 172.21.15.26:0/3748002021 >> v2:172.21.15.26:3300/0 conn(0x7f028412cf60 0x7f028406f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:43.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.757+0000 7f028c1c0700 1 --2- 172.21.15.26:0/3748002021 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f028412f8b0 0x7f028412fd20 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:43.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.757+0000 7f028c1c0700 1 -- 172.21.15.26:0/3748002021 >> 172.21.15.26:0/3748002021 conn(0x7f02840a2aa0 msgr2=0x7f02840a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:43.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.757+0000 7fae92e4e700 1 Processor -- start 2023-10-01T07:59:43.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.758+0000 7fae92e4e700 1 -- start start 2023-10-01T07:59:43.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.758+0000 7f028c1c0700 1 -- 172.21.15.26:0/3748002021 shutdown_connections 2023-10-01T07:59:43.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.759+0000 7fae92e4e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae8c09d630 0x7fae8c133810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:43.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.759+0000 7fae92e4e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae8c0a0a30 0x7fae8c133d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:43.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.759+0000 7fae92e4e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae8c138d80 0x7fae8c134290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:43.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.759+0000 7fae92e4e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c136fd0 con 0x7fae8c0a0a30 2023-10-01T07:59:43.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.759+0000 7fae92e4e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c13ad00 con 0x7fae8c09d630 2023-10-01T07:59:43.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.759+0000 7fae92e4e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c0a0410 con 0x7fae8c138d80 2023-10-01T07:59:43.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.759+0000 7f028c1c0700 1 -- 172.21.15.26:0/3748002021 wait complete. 2023-10-01T07:59:43.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.759+0000 7fae90bea700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae8c09d630 0x7fae8c133810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:43.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.759+0000 7fae90bea700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae8c09d630 0x7fae8c133810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43698/0 (socket says 172.21.15.26:43698) 2023-10-01T07:59:43.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.759+0000 7fae90bea700 1 -- 172.21.15.26:0/3631618527 learned_addr learned my addr 172.21.15.26:0/3631618527 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:43.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.759+0000 7fae913eb700 1 --2- 172.21.15.26:0/3631618527 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae8c138d80 0x7fae8c134290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:43.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.759+0000 7fae8bfff700 1 --2- 172.21.15.26:0/3631618527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae8c0a0a30 0x7fae8c133d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:43.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.759+0000 7fae90bea700 1 -- 172.21.15.26:0/3631618527 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae8c138d80 msgr2=0x7fae8c134290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:43.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.759+0000 7fae90bea700 1 --2- 172.21.15.26:0/3631618527 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae8c138d80 0x7fae8c134290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:43.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.759+0000 7fae90bea700 1 -- 172.21.15.26:0/3631618527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae8c0a0a30 msgr2=0x7fae8c133d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:43.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.759+0000 7fae90bea700 1 --2- 172.21.15.26:0/3631618527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae8c0a0a30 0x7fae8c133d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:43.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.759+0000 7fae90bea700 1 -- 172.21.15.26:0/3631618527 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae84009b30 con 0x7fae8c09d630 2023-10-01T07:59:43.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.759+0000 7fae90bea700 1 --2- 172.21.15.26:0/3631618527 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae8c09d630 0x7fae8c133810 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fae8000c4e0 tx=0x7fae8000c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:43.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.760+0000 7fae897fa700 1 -- 172.21.15.26:0/3631618527 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae800052d0 con 0x7fae8c09d630 2023-10-01T07:59:43.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.760+0000 7fae897fa700 1 -- 172.21.15.26:0/3631618527 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae80005430 con 0x7fae8c09d630 2023-10-01T07:59:43.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.760+0000 7fae897fa700 1 -- 172.21.15.26:0/3631618527 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae800038c0 con 0x7fae8c09d630 2023-10-01T07:59:43.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.760+0000 7f028c1c0700 1 Processor -- start 2023-10-01T07:59:43.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.760+0000 7f028c1c0700 1 -- start start 2023-10-01T07:59:43.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.761+0000 7f028c1c0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f028412cf60 0x7f028409be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:43.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.761+0000 7f028c1c0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f028412f8b0 0x7f02841c3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:43.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.761+0000 7f028c1c0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0284130260 0x7f02841c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:43.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.761+0000 7f028c1c0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028409b9e0 con 0x7f028412cf60 2023-10-01T07:59:43.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.761+0000 7f028c1c0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f028409e740 con 0x7f0284130260 2023-10-01T07:59:43.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.761+0000 7f028c1c0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f028409ece0 con 0x7f028412f8b0 2023-10-01T07:59:43.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.761+0000 7fae92e4e700 1 -- 172.21.15.26:0/3631618527 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae8c137a40 con 0x7fae8c09d630 2023-10-01T07:59:43.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.761+0000 7fae92e4e700 1 -- 172.21.15.26:0/3631618527 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae8c1372b0 con 0x7fae8c09d630 2023-10-01T07:59:43.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.761+0000 7f028975b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f028412f8b0 0x7f02841c3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:43.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.761+0000 7f028975b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f028412f8b0 0x7f02841c3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57456/0 (socket says 172.21.15.26:57456) 2023-10-01T07:59:43.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.761+0000 7f028975b700 1 -- 172.21.15.26:0/2955159630 learned_addr learned my addr 172.21.15.26:0/2955159630 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:43.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.761+0000 7f028975b700 1 -- 172.21.15.26:0/2955159630 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0284130260 msgr2=0x7f02841c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:43.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.761+0000 7f028975b700 1 --2- 172.21.15.26:0/2955159630 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0284130260 0x7f02841c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:43.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.761+0000 7f028975b700 1 -- 172.21.15.26:0/2955159630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f028412cf60 msgr2=0x7f028409be10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:59:43.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.761+0000 7f028975b700 1 --2- 172.21.15.26:0/2955159630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f028412cf60 0x7f028409be10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:43.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.761+0000 7f028975b700 1 -- 172.21.15.26:0/2955159630 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02740094a0 con 0x7f028412f8b0 2023-10-01T07:59:43.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.762+0000 7f028975b700 1 --2- 172.21.15.26:0/2955159630 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f028412f8b0 0x7f02841c3d60 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0274009ed0 tx=0x7f02740047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:43.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.762+0000 7f027a7fc700 1 -- 172.21.15.26:0/2955159630 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0274017050 con 0x7f028412f8b0 2023-10-01T07:59:43.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.762+0000 7f027a7fc700 1 -- 172.21.15.26:0/2955159630 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0274018040 con 0x7f028412f8b0 2023-10-01T07:59:43.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.762+0000 7f027a7fc700 1 -- 172.21.15.26:0/2955159630 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0274006af0 con 0x7f028412f8b0 2023-10-01T07:59:43.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.762+0000 7f028c1c0700 1 -- 172.21.15.26:0/2955159630 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0284129fa0 con 0x7f028412f8b0 2023-10-01T07:59:43.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.762+0000 7f028c1c0700 1 -- 172.21.15.26:0/2955159630 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f028409ce60 con 0x7f028412f8b0 2023-10-01T07:59:43.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.762+0000 7fae897fa700 1 -- 172.21.15.26:0/3631618527 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fae80003a20 con 0x7fae8c09d630 2023-10-01T07:59:43.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.762+0000 7fae897fa700 1 -- 172.21.15.26:0/3631618527 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fae8003eba0 con 0x7fae8c09d630 2023-10-01T07:59:43.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.763+0000 7f028c1c0700 1 -- 172.21.15.26:0/2955159630 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f028409e960 con 0x7f028412f8b0 2023-10-01T07:59:43.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.763+0000 7f027a7fc700 1 -- 172.21.15.26:0/2955159630 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0274006c50 con 0x7f028412f8b0 2023-10-01T07:59:43.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.763+0000 7f027a7fc700 1 -- 172.21.15.26:0/2955159630 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f027403ff10 con 0x7f028412f8b0 2023-10-01T07:59:43.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.765+0000 7fae92e4e700 1 -- 172.21.15.26:0/3631618527 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae8c13b620 con 0x7fae8c09d630 2023-10-01T07:59:43.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.772+0000 7f027a7fc700 1 -- 172.21.15.26:0/2955159630 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0274005e00 con 0x7f028412f8b0 2023-10-01T07:59:43.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.775+0000 7fae897fa700 1 -- 172.21.15.26:0/3631618527 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fae80017080 con 0x7fae8c09d630 2023-10-01T07:59:43.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.789+0000 7ff2f5685700 1 Processor -- start 2023-10-01T07:59:43.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.790+0000 7ff2f5685700 1 -- start start 2023-10-01T07:59:43.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.790+0000 7fee11e09700 1 Processor -- start 2023-10-01T07:59:43.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.790+0000 7fee11e09700 1 -- start start 2023-10-01T07:59:43.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.790+0000 7ff2f5685700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff2f0133540 0x7ff2f0135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:43.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.790+0000 7ff2f5685700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff2f0135e60 0x7ff2f0138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:43.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.790+0000 7ff2f5685700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f00716a0 con 0x7ff2f0130540 2023-10-01T07:59:43.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.790+0000 7ff2f5685700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f0071290 con 0x7ff2f0135e60 2023-10-01T07:59:43.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.790+0000 7ff2f5685700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f0130340 con 0x7ff2f0133540 2023-10-01T07:59:43.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.790+0000 7fee11e09700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee0c09d6f0 0x7fee0c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:43.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.790+0000 7fee11e09700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fee0c09e000 0x7fee0c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:43.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.790+0000 7fee11e09700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee0c09b120 con 0x7fee0c09e410 2023-10-01T07:59:43.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.790+0000 7fee11e09700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee0c06b460 con 0x7fee0c09e000 2023-10-01T07:59:43.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.790+0000 7fee11e09700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c09a7e0 con 0x7fee0c09d6f0 2023-10-01T07:59:43.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.790+0000 7fee0b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee0c09d6f0 0x7fee0c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:43.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.790+0000 7fee0b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee0c09d6f0 0x7fee0c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57474/0 (socket says 172.21.15.26:57474) 2023-10-01T07:59:43.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.790+0000 7fee0b7fe700 1 -- 172.21.15.26:0/3678595165 learned_addr learned my addr 172.21.15.26:0/3678595165 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:43.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.790+0000 7ff2ef7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff2f0135e60 0x7ff2f0138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:43.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.790+0000 7ff2eeffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff2f0130540 0x7ff2f0130910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47478/0 (socket says 172.21.15.26:47478) 2023-10-01T07:59:43.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.791+0000 7ff2eeffd700 1 -- 172.21.15.26:0/2049918095 learned_addr learned my addr 172.21.15.26:0/2049918095 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:59:43.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.791+0000 7fee0b7fe700 1 -- 172.21.15.26:0/3678595165 >> v2:172.21.15.26:3300/0 conn(0x7fee0c09e000 msgr2=0x7fee0c1339f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-01T07:59:43.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.791+0000 7fee0b7fe700 1 --2- 172.21.15.26:0/3678595165 >> v2:172.21.15.26:3300/0 conn(0x7fee0c09e000 0x7fee0c1339f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:43.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.791+0000 7fee0b7fe700 1 -- 172.21.15.26:0/3678595165 >> v1:172.21.15.26:6789/0 conn(0x7fee0c09e410 legacy=0x7fee0c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:43.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.791+0000 7ff2ef7fe700 1 -- 172.21.15.26:0/2049918095 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff2f0133540 msgr2=0x7ff2f0135920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:43.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.791+0000 7ff2ef7fe700 1 --2- 172.21.15.26:0/2049918095 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff2f0133540 0x7ff2f0135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:43.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.791+0000 7ff2edffb700 1 -- 172.21.15.26:0/2049918095 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1541230133 0 0) 0x7ff2f00716a0 con 0x7ff2f0130540 2023-10-01T07:59:43.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.791+0000 7ff2ef7fe700 1 -- 172.21.15.26:0/2049918095 >> v1:172.21.15.26:6789/0 conn(0x7ff2f0130540 legacy=0x7ff2f0130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:43.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.791+0000 7ff2ef7fe700 1 -- 172.21.15.26:0/2049918095 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f0070b80 con 0x7ff2f0135e60 2023-10-01T07:59:43.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.791+0000 7fee0b7fe700 1 -- 172.21.15.26:0/3678595165 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0c09a500 con 0x7fee0c09d6f0 2023-10-01T07:59:43.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.791+0000 7ff2ef7fe700 1 --2- 172.21.15.26:0/2049918095 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff2f0135e60 0x7ff2f0138240 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8009dc0 tx=0x7ff2e800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eeebe3db45ccf729 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:43.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.791+0000 7fee0b7fe700 1 --2- 172.21.15.26:0/3678595165 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee0c09d6f0 0x7fee0c09dac0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fee00009920 tx=0x7fee00009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11e5cd12c45e5481 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:43.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.792+0000 7ff2edffb700 1 -- 172.21.15.26:0/2049918095 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e800e070 con 0x7ff2f0135e60 2023-10-01T07:59:43.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.792+0000 7ff2edffb700 1 -- 172.21.15.26:0/2049918095 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e800bbd0 con 0x7ff2f0135e60 2023-10-01T07:59:43.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.792+0000 7ff2edffb700 1 -- 172.21.15.26:0/2049918095 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8012430 con 0x7ff2f0135e60 2023-10-01T07:59:43.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.792+0000 7fee0a7fc700 1 -- 172.21.15.26:0/3678595165 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0000ba20 con 0x7fee0c09d6f0 2023-10-01T07:59:43.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.792+0000 7fee0a7fc700 1 -- 172.21.15.26:0/3678595165 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0000bb80 con 0x7fee0c09d6f0 2023-10-01T07:59:43.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.792+0000 7fee0a7fc700 1 -- 172.21.15.26:0/3678595165 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee00009e70 con 0x7fee0c09d6f0 2023-10-01T07:59:43.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.792+0000 7fee11e09700 1 -- 172.21.15.26:0/3678595165 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee0c09d6f0 msgr2=0x7fee0c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:43.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.792+0000 7fee11e09700 1 --2- 172.21.15.26:0/3678595165 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee0c09d6f0 0x7fee0c09dac0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fee00009920 tx=0x7fee00009c30 comp rx=0 tx=0).stop 2023-10-01T07:59:43.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.793+0000 7fee11e09700 1 -- 172.21.15.26:0/3678595165 shutdown_connections 2023-10-01T07:59:43.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.793+0000 7fee11e09700 1 --2- 172.21.15.26:0/3678595165 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee0c09d6f0 0x7fee0c09dac0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:43.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.793+0000 7fee11e09700 1 --2- 172.21.15.26:0/3678595165 >> v2:172.21.15.26:3300/0 conn(0x7fee0c09e000 0x7fee0c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:43.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.793+0000 7fee11e09700 1 -- 172.21.15.26:0/3678595165 >> 172.21.15.26:0/3678595165 conn(0x7fee0c066f50 msgr2=0x7fee0c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:43.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.793+0000 7fee11e09700 1 -- 172.21.15.26:0/3678595165 shutdown_connections 2023-10-01T07:59:43.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.793+0000 7ff2f5685700 1 -- 172.21.15.26:0/2049918095 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff2f0135e60 msgr2=0x7ff2f0138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:43.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.793+0000 7ff2f5685700 1 --2- 172.21.15.26:0/2049918095 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff2f0135e60 0x7ff2f0138240 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8009dc0 tx=0x7ff2e800b330 comp rx=0 tx=0).stop 2023-10-01T07:59:43.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.793+0000 7fee11e09700 1 -- 172.21.15.26:0/3678595165 wait complete. 2023-10-01T07:59:43.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.794+0000 7fee11e09700 1 Processor -- start 2023-10-01T07:59:43.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.793+0000 7ff2f5685700 1 -- 172.21.15.26:0/2049918095 shutdown_connections 2023-10-01T07:59:43.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.793+0000 7ff2f5685700 1 --2- 172.21.15.26:0/2049918095 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff2f0135e60 0x7ff2f0138240 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:43.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.793+0000 7ff2f5685700 1 --2- 172.21.15.26:0/2049918095 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff2f0133540 0x7ff2f0135920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:43.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.793+0000 7ff2f5685700 1 -- 172.21.15.26:0/2049918095 >> 172.21.15.26:0/2049918095 conn(0x7ff2f00a2aa0 msgr2=0x7ff2f00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:43.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.793+0000 7ff2f5685700 1 -- 172.21.15.26:0/2049918095 shutdown_connections 2023-10-01T07:59:43.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.793+0000 7ff2f5685700 1 -- 172.21.15.26:0/2049918095 wait complete. 2023-10-01T07:59:43.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.794+0000 7fee11e09700 1 -- start start 2023-10-01T07:59:43.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.794+0000 7fee11e09700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee0c09d6f0 0x7fee0c122580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:43.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.794+0000 7fee11e09700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee0c09e000 0x7fee0c122ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:43.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.794+0000 7fee11e09700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee0c09e410 0x7fee0c123000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:43.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.794+0000 7fee11e09700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c124960 con 0x7fee0c09e410 2023-10-01T07:59:43.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.794+0000 7fee11e09700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c126010 con 0x7fee0c09e000 2023-10-01T07:59:43.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.794+0000 7fee11e09700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c0a2ef0 con 0x7fee0c09d6f0 2023-10-01T07:59:43.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.794+0000 7ff2f5685700 1 Processor -- start 2023-10-01T07:59:43.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.795+0000 7fee0b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee0c09d6f0 0x7fee0c122580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:43.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.795+0000 7fee0b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee0c09d6f0 0x7fee0c122580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57482/0 (socket says 172.21.15.26:57482) 2023-10-01T07:59:43.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.795+0000 7fee0b7fe700 1 -- 172.21.15.26:0/1374773650 learned_addr learned my addr 172.21.15.26:0/1374773650 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:43.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.795+0000 7fee0b7fe700 1 -- 172.21.15.26:0/1374773650 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee0c09e000 msgr2=0x7fee0c122ac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T07:59:43.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.795+0000 7fee0b7fe700 1 --2- 172.21.15.26:0/1374773650 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee0c09e000 0x7fee0c122ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:43.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.795+0000 7fee0b7fe700 1 -- 172.21.15.26:0/1374773650 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee0c09e410 msgr2=0x7fee0c123000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:43.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.795+0000 7fee0b7fe700 1 --2- 172.21.15.26:0/1374773650 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee0c09e410 0x7fee0c123000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:43.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.795+0000 7fee0b7fe700 1 -- 172.21.15.26:0/1374773650 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee00009550 con 0x7fee0c09d6f0 2023-10-01T07:59:43.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.795+0000 7fee0b7fe700 1 --2- 172.21.15.26:0/1374773650 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee0c09d6f0 0x7fee0c122580 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fee00009870 tx=0x7fee00004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:43.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.795+0000 7ff2f5685700 1 -- start start 2023-10-01T07:59:43.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.795+0000 7ff2f5685700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2f0130540 0x7ff2f01c9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:43.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.795+0000 7ff2f5685700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff2f0133540 0x7ff2f01c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:43.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.795+0000 7ff2f5685700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff2f0135e60 0x7ff2f01cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:43.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.795+0000 7ff2f5685700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f011c4e0 con 0x7ff2f0130540 2023-10-01T07:59:43.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.795+0000 7ff2f5685700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f009af40 con 0x7ff2f0133540 2023-10-01T07:59:43.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.795+0000 7ff2f5685700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f011c2e0 con 0x7ff2f0135e60 2023-10-01T07:59:43.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.795+0000 7ff2ee7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff2f0133540 0x7ff2f01c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:43.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.795+0000 7ff2ee7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff2f0133540 0x7ff2f01c9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43730/0 (socket says 172.21.15.26:43730) 2023-10-01T07:59:43.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.795+0000 7ff2ee7fc700 1 -- 172.21.15.26:0/1146599605 learned_addr learned my addr 172.21.15.26:0/1146599605 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:43.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.796+0000 7ff2ef7fe700 1 --2- 172.21.15.26:0/1146599605 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff2f0135e60 0x7ff2f01cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:43.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.796+0000 7ff2ee7fc700 1 -- 172.21.15.26:0/1146599605 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff2f0135e60 msgr2=0x7ff2f01cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:43.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.796+0000 7ff2ee7fc700 1 --2- 172.21.15.26:0/1146599605 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff2f0135e60 0x7ff2f01cc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:43.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.796+0000 7ff2ee7fc700 1 -- 172.21.15.26:0/1146599605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2f0130540 msgr2=0x7ff2f01c9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:43.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.796+0000 7ff2ee7fc700 1 --2- 172.21.15.26:0/1146599605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2f0130540 0x7ff2f01c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:43.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.796+0000 7ff2ee7fc700 1 -- 172.21.15.26:0/1146599605 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e8009a70 con 0x7ff2f0133540 2023-10-01T07:59:43.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.796+0000 7ff2ee7fc700 1 --2- 172.21.15.26:0/1146599605 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff2f0133540 0x7ff2f01c9a40 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400b530 tx=0x7ff2e400b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:43.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.796+0000 7fedf3fff700 1 -- 172.21.15.26:0/1374773650 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee000036a0 con 0x7fee0c09d6f0 2023-10-01T07:59:43.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.796+0000 7fedf3fff700 1 -- 172.21.15.26:0/1374773650 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee00003800 con 0x7fee0c09d6f0 2023-10-01T07:59:43.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.796+0000 7fedf3fff700 1 -- 172.21.15.26:0/1374773650 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee00003bb0 con 0x7fee0c09d6f0 2023-10-01T07:59:43.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.796+0000 7fee11e09700 1 -- 172.21.15.26:0/1374773650 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee0c09c710 con 0x7fee0c09d6f0 2023-10-01T07:59:43.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.796+0000 7fee11e09700 1 -- 172.21.15.26:0/1374773650 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee0c1267a0 con 0x7fee0c09d6f0 2023-10-01T07:59:43.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.796+0000 7ff2d77fe700 1 -- 172.21.15.26:0/1146599605 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e40118f0 con 0x7ff2f0133540 2023-10-01T07:59:43.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.796+0000 7ff2d77fe700 1 -- 172.21.15.26:0/1146599605 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e4011a50 con 0x7ff2f0133540 2023-10-01T07:59:43.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.796+0000 7ff2d77fe700 1 -- 172.21.15.26:0/1146599605 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4011e00 con 0x7ff2f0133540 2023-10-01T07:59:43.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.797+0000 7fedf3fff700 1 -- 172.21.15.26:0/1374773650 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fee00003d10 con 0x7fee0c09d6f0 2023-10-01T07:59:43.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.798+0000 7fee11e09700 1 -- 172.21.15.26:0/1374773650 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee0c074ea0 con 0x7fee0c09d6f0 2023-10-01T07:59:43.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.798+0000 7ff2f5685700 1 -- 172.21.15.26:0/1146599605 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f00a0580 con 0x7ff2f0133540 2023-10-01T07:59:43.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.798+0000 7ff2f5685700 1 -- 172.21.15.26:0/1146599605 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f011c6d0 con 0x7ff2f0133540 2023-10-01T07:59:43.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.798+0000 7fedf3fff700 1 -- 172.21.15.26:0/1374773650 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fee00040b70 con 0x7fee0c09d6f0 2023-10-01T07:59:43.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.799+0000 7ff2f5685700 1 -- 172.21.15.26:0/1146599605 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f0074ea0 con 0x7ff2f0133540 2023-10-01T07:59:43.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.799+0000 7ff2d77fe700 1 -- 172.21.15.26:0/1146599605 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff2e401a400 con 0x7ff2f0133540 2023-10-01T07:59:43.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.799+0000 7ff2d77fe700 1 -- 172.21.15.26:0/1146599605 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff2e403f830 con 0x7ff2f0133540 2023-10-01T07:59:43.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.803+0000 7fedf3fff700 1 -- 172.21.15.26:0/1374773650 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fee00028080 con 0x7fee0c09d6f0 2023-10-01T07:59:43.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.809+0000 7ff2d77fe700 1 -- 172.21.15.26:0/1146599605 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff2e400f8d0 con 0x7ff2f0133540 2023-10-01T07:59:43.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.987+0000 7fae92e4e700 1 -- 172.21.15.26:0/3631618527 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fae8c0747f0 con 0x7fae8c09d630 2023-10-01T07:59:43.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.988+0000 7fae897fa700 1 -- 172.21.15.26:0/3631618527 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fae80018260 con 0x7fae8c09d630 2023-10-01T07:59:43.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.988+0000 7f028c1c0700 1 -- 172.21.15.26:0/2955159630 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0284074ea0 con 0x7f028412f8b0 2023-10-01T07:59:43.989 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:43.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.988+0000 7f027a7fc700 1 -- 172.21.15.26:0/2955159630 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f027401cc20 con 0x7f028412f8b0 2023-10-01T07:59:43.989 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:43.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.990+0000 7fae92e4e700 1 -- 172.21.15.26:0/3631618527 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae8c09d630 msgr2=0x7fae8c133810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:43.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.990+0000 7fae92e4e700 1 --2- 172.21.15.26:0/3631618527 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae8c09d630 0x7fae8c133810 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fae8000c4e0 tx=0x7fae8000c7f0 comp rx=0 tx=0).stop 2023-10-01T07:59:43.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.991+0000 7fae92e4e700 1 -- 172.21.15.26:0/3631618527 shutdown_connections 2023-10-01T07:59:43.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.991+0000 7fae92e4e700 1 --2- 172.21.15.26:0/3631618527 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae8c138d80 0x7fae8c134290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:43.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.991+0000 7fae92e4e700 1 --2- 172.21.15.26:0/3631618527 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae8c09d630 0x7fae8c133810 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:43.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.991+0000 7fae92e4e700 1 --2- 172.21.15.26:0/3631618527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae8c0a0a30 0x7fae8c133d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:43.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.991+0000 7fae92e4e700 1 -- 172.21.15.26:0/3631618527 >> 172.21.15.26:0/3631618527 conn(0x7fae8c0a3050 msgr2=0x7fae8c09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:43.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.991+0000 7fae92e4e700 1 -- 172.21.15.26:0/3631618527 shutdown_connections 2023-10-01T07:59:43.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.991+0000 7fae92e4e700 1 -- 172.21.15.26:0/3631618527 wait complete. 2023-10-01T07:59:43.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.992+0000 7f028c1c0700 1 -- 172.21.15.26:0/2955159630 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f028412f8b0 msgr2=0x7f02841c3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:43.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.992+0000 7f028c1c0700 1 --2- 172.21.15.26:0/2955159630 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f028412f8b0 0x7f02841c3d60 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0274009ed0 tx=0x7f02740047c0 comp rx=0 tx=0).stop 2023-10-01T07:59:43.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.992+0000 7f028c1c0700 1 -- 172.21.15.26:0/2955159630 shutdown_connections 2023-10-01T07:59:43.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.992+0000 7f028c1c0700 1 --2- 172.21.15.26:0/2955159630 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0284130260 0x7f02841c42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:43.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.992+0000 7f028c1c0700 1 --2- 172.21.15.26:0/2955159630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f028412cf60 0x7f028409be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:43.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.992+0000 7f028c1c0700 1 --2- 172.21.15.26:0/2955159630 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f028412f8b0 0x7f02841c3d60 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:43.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.992+0000 7f028c1c0700 1 -- 172.21.15.26:0/2955159630 >> 172.21.15.26:0/2955159630 conn(0x7f02840a2aa0 msgr2=0x7f02840a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:43.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.993+0000 7f028c1c0700 1 -- 172.21.15.26:0/2955159630 shutdown_connections 2023-10-01T07:59:43.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:43.993+0000 7f028c1c0700 1 -- 172.21.15.26:0/2955159630 wait complete. 2023-10-01T07:59:44.006 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:44.008 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:44.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:44.011+0000 7fee11e09700 1 -- 172.21.15.26:0/1374773650 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fee0c06c360 con 0x7fee0c09d6f0 2023-10-01T07:59:44.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:44.011+0000 7fedf3fff700 1 -- 172.21.15.26:0/1374773650 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fee00015020 con 0x7fee0c09d6f0 2023-10-01T07:59:44.012 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:44.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:44.013+0000 7fee11e09700 1 -- 172.21.15.26:0/1374773650 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee0c09d6f0 msgr2=0x7fee0c122580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:44.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:44.014+0000 7fee11e09700 1 --2- 172.21.15.26:0/1374773650 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee0c09d6f0 0x7fee0c122580 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fee00009870 tx=0x7fee00004750 comp rx=0 tx=0).stop 2023-10-01T07:59:44.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:44.014+0000 7fee11e09700 1 -- 172.21.15.26:0/1374773650 shutdown_connections 2023-10-01T07:59:44.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:44.014+0000 7fee11e09700 1 --2- 172.21.15.26:0/1374773650 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee0c09e410 0x7fee0c123000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:44.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:44.014+0000 7fee11e09700 1 --2- 172.21.15.26:0/1374773650 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fee0c09d6f0 0x7fee0c122580 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:44.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:44.014+0000 7fee11e09700 1 --2- 172.21.15.26:0/1374773650 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fee0c09e000 0x7fee0c122ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:44.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:44.014+0000 7fee11e09700 1 -- 172.21.15.26:0/1374773650 >> 172.21.15.26:0/1374773650 conn(0x7fee0c066f50 msgr2=0x7fee0c0711b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:44.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:44.014+0000 7fee11e09700 1 -- 172.21.15.26:0/1374773650 shutdown_connections 2023-10-01T07:59:44.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:44.014+0000 7fee11e09700 1 -- 172.21.15.26:0/1374773650 wait complete. 2023-10-01T07:59:44.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:44.021+0000 7ff2f5685700 1 -- 172.21.15.26:0/1146599605 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff2f009b160 con 0x7ff2f0133540 2023-10-01T07:59:44.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:44.022+0000 7ff2d77fe700 1 -- 172.21.15.26:0/1146599605 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff2e4015030 con 0x7ff2f0133540 2023-10-01T07:59:44.022 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:44.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:44.024+0000 7ff2f5685700 1 -- 172.21.15.26:0/1146599605 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff2f0133540 msgr2=0x7ff2f01c9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:44.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:44.024+0000 7ff2f5685700 1 --2- 172.21.15.26:0/1146599605 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff2f0133540 0x7ff2f01c9a40 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400b530 tx=0x7ff2e400b840 comp rx=0 tx=0).stop 2023-10-01T07:59:44.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:44.024+0000 7ff2f5685700 1 -- 172.21.15.26:0/1146599605 shutdown_connections 2023-10-01T07:59:44.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:44.024+0000 7ff2f5685700 1 --2- 172.21.15.26:0/1146599605 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff2f0135e60 0x7ff2f01cc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:44.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:44.024+0000 7ff2f5685700 1 --2- 172.21.15.26:0/1146599605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2f0130540 0x7ff2f01c9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:44.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:44.024+0000 7ff2f5685700 1 --2- 172.21.15.26:0/1146599605 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff2f0133540 0x7ff2f01c9a40 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:44.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:44.024+0000 7ff2f5685700 1 -- 172.21.15.26:0/1146599605 >> 172.21.15.26:0/1146599605 conn(0x7ff2f00a2aa0 msgr2=0x7ff2f0131320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:44.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:44.025+0000 7ff2f5685700 1 -- 172.21.15.26:0/1146599605 shutdown_connections 2023-10-01T07:59:44.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:44.025+0000 7ff2f5685700 1 -- 172.21.15.26:0/1146599605 wait complete. 2023-10-01T07:59:44.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:44.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:45.008 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:45.008 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:45.029 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:45.042 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:45.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.163+0000 7f081b960700 1 Processor -- start 2023-10-01T07:59:45.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.163+0000 7f081b960700 1 -- start start 2023-10-01T07:59:45.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.164+0000 7f487a7be700 1 Processor -- start 2023-10-01T07:59:45.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.164+0000 7f487a7be700 1 -- start start 2023-10-01T07:59:45.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.164+0000 7f081b960700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0814133420 0x7f08141337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:45.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.164+0000 7f081b960700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0814133e30 0x7f081412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:45.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.164+0000 7f081b960700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f081406b990 con 0x7f0814134260 2023-10-01T07:59:45.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.164+0000 7f081b960700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08140a0590 con 0x7f0814133e30 2023-10-01T07:59:45.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.164+0000 7f081b960700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f081409fb80 con 0x7f0814133420 2023-10-01T07:59:45.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.164+0000 7f487a7be700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f487409d6f0 0x7f487409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:45.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.164+0000 7f487a7be700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f487409e000 0x7f48741339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:45.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.164+0000 7f487a7be700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f487409b120 con 0x7f487409e410 2023-10-01T07:59:45.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.165+0000 7f487a7be700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487406b460 con 0x7f487409d6f0 2023-10-01T07:59:45.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.165+0000 7f487a7be700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f487409a7e0 con 0x7f487409e000 2023-10-01T07:59:45.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.165+0000 7f4873fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f487409d6f0 0x7f487409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:45.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.165+0000 7f4873fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f487409d6f0 0x7f487409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43752/0 (socket says 172.21.15.26:43752) 2023-10-01T07:59:45.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.165+0000 7f4873fff700 1 -- 172.21.15.26:0/3848409434 learned_addr learned my addr 172.21.15.26:0/3848409434 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:45.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.165+0000 7f08196fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0814133420 0x7f08141337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:45.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.165+0000 7f08196fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0814133420 0x7f08141337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43740/0 (socket says 172.21.15.26:43740) 2023-10-01T07:59:45.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.165+0000 7f08196fc700 1 -- 172.21.15.26:0/1847033047 learned_addr learned my addr 172.21.15.26:0/1847033047 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:45.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.165+0000 7f0818efb700 1 --2- 172.21.15.26:0/1847033047 >> v2:172.21.15.26:3300/0 conn(0x7f0814133e30 0x7f081412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:45.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.165+0000 7f4873fff700 1 -- 172.21.15.26:0/3848409434 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f487409e000 msgr2=0x7f48741339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:45.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.165+0000 7f4873fff700 1 --2- 172.21.15.26:0/3848409434 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f487409e000 0x7f48741339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:45.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.165+0000 7f4873fff700 1 -- 172.21.15.26:0/3848409434 >> v1:172.21.15.26:6789/0 conn(0x7f487409e410 legacy=0x7f4874133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:45.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.165+0000 7f4873fff700 1 -- 172.21.15.26:0/3848409434 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487409a500 con 0x7f487409d6f0 2023-10-01T07:59:45.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.165+0000 7f08196fc700 1 -- 172.21.15.26:0/1847033047 >> v2:172.21.15.26:3300/0 conn(0x7f0814133e30 msgr2=0x7f081412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:45.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.165+0000 7f08196fc700 1 --2- 172.21.15.26:0/1847033047 >> v2:172.21.15.26:3300/0 conn(0x7f0814133e30 0x7f081412ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:45.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.165+0000 7f08196fc700 1 -- 172.21.15.26:0/1847033047 >> v1:172.21.15.26:6789/0 conn(0x7f0814134260 legacy=0x7f08141304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:45.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.165+0000 7f08196fc700 1 -- 172.21.15.26:0/1847033047 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08140a0030 con 0x7f0814133420 2023-10-01T07:59:45.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.165+0000 7f4873fff700 1 --2- 172.21.15.26:0/3848409434 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f487409d6f0 0x7f487409dac0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f4864009920 tx=0x7f4864009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa028302edc72372 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:45.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.166+0000 7f08196fc700 1 --2- 172.21.15.26:0/1847033047 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0814133420 0x7f08141337f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f08100098f0 tx=0x7f0810009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f400d35374649d0f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:45.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.166+0000 7f4872ffd700 1 -- 172.21.15.26:0/3848409434 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486400ba60 con 0x7f487409d6f0 2023-10-01T07:59:45.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.166+0000 7f4872ffd700 1 -- 172.21.15.26:0/3848409434 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486400bbc0 con 0x7f487409d6f0 2023-10-01T07:59:45.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.166+0000 7f4872ffd700 1 -- 172.21.15.26:0/3848409434 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4864009e70 con 0x7f487409d6f0 2023-10-01T07:59:45.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.166+0000 7f080bfff700 1 -- 172.21.15.26:0/1847033047 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0810011830 con 0x7f0814133420 2023-10-01T07:59:45.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.166+0000 7f080bfff700 1 -- 172.21.15.26:0/1847033047 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0810011990 con 0x7f0814133420 2023-10-01T07:59:45.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.166+0000 7f080bfff700 1 -- 172.21.15.26:0/1847033047 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0810011d00 con 0x7f0814133420 2023-10-01T07:59:45.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.167+0000 7f487a7be700 1 -- 172.21.15.26:0/3848409434 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f487409d6f0 msgr2=0x7f487409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:45.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.167+0000 7f487a7be700 1 --2- 172.21.15.26:0/3848409434 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f487409d6f0 0x7f487409dac0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f4864009920 tx=0x7f4864009c30 comp rx=0 tx=0).stop 2023-10-01T07:59:45.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.167+0000 7f081b960700 1 -- 172.21.15.26:0/1847033047 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0814133420 msgr2=0x7f08141337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:45.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.167+0000 7f081b960700 1 --2- 172.21.15.26:0/1847033047 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0814133420 0x7f08141337f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f08100098f0 tx=0x7f0810009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:45.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.167+0000 7f487a7be700 1 -- 172.21.15.26:0/3848409434 shutdown_connections 2023-10-01T07:59:45.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.167+0000 7f487a7be700 1 --2- 172.21.15.26:0/3848409434 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f487409d6f0 0x7f487409dac0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:45.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.167+0000 7f487a7be700 1 --2- 172.21.15.26:0/3848409434 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f487409e000 0x7f48741339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:45.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.167+0000 7f487a7be700 1 -- 172.21.15.26:0/3848409434 >> 172.21.15.26:0/3848409434 conn(0x7f4874066f50 msgr2=0x7f487409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:45.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.167+0000 7f081b960700 1 -- 172.21.15.26:0/1847033047 shutdown_connections 2023-10-01T07:59:45.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.167+0000 7f081b960700 1 --2- 172.21.15.26:0/1847033047 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0814133420 0x7f08141337f0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:45.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.167+0000 7f081b960700 1 --2- 172.21.15.26:0/1847033047 >> v2:172.21.15.26:3300/0 conn(0x7f0814133e30 0x7f081412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:45.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.167+0000 7f081b960700 1 -- 172.21.15.26:0/1847033047 >> 172.21.15.26:0/1847033047 conn(0x7f08140a4210 msgr2=0x7f08140a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:45.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.167+0000 7f487a7be700 1 -- 172.21.15.26:0/3848409434 shutdown_connections 2023-10-01T07:59:45.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.167+0000 7f487a7be700 1 -- 172.21.15.26:0/3848409434 wait complete. 2023-10-01T07:59:45.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.167+0000 7f081b960700 1 -- 172.21.15.26:0/1847033047 shutdown_connections 2023-10-01T07:59:45.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.167+0000 7f081b960700 1 -- 172.21.15.26:0/1847033047 wait complete. 2023-10-01T07:59:45.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.168+0000 7f487a7be700 1 Processor -- start 2023-10-01T07:59:45.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.168+0000 7f081b960700 1 Processor -- start 2023-10-01T07:59:45.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.168+0000 7f081b960700 1 -- start start 2023-10-01T07:59:45.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.168+0000 7f487a7be700 1 -- start start 2023-10-01T07:59:45.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.169+0000 7f081b960700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0814133420 0x7f08140709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:45.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.169+0000 7f081b960700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0814133e30 0x7f0814070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:45.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.169+0000 7f081b960700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0814134260 0x7f0814071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:45.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.169+0000 7f081b960700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081412dc60 con 0x7f0814134260 2023-10-01T07:59:45.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.169+0000 7f081b960700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0814131a00 con 0x7f0814133e30 2023-10-01T07:59:45.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.169+0000 7f081b960700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0814071de0 con 0x7f0814133420 2023-10-01T07:59:45.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.169+0000 7f487a7be700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f487409d6f0 0x7f4874122540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:45.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.169+0000 7f487a7be700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f487409e000 0x7f4874122a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:45.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.169+0000 7f487a7be700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f487409e410 0x7f4874122fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:45.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.169+0000 7f487a7be700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4874125a30 con 0x7f487409e000 2023-10-01T07:59:45.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.169+0000 7f487a7be700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4874125fd0 con 0x7f487409e410 2023-10-01T07:59:45.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.169+0000 7f487a7be700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48741248f0 con 0x7f487409d6f0 2023-10-01T07:59:45.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.169+0000 7f4873fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f487409d6f0 0x7f4874122540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:45.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.169+0000 7f4873fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f487409d6f0 0x7f4874122540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57510/0 (socket says 172.21.15.26:57510) 2023-10-01T07:59:45.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.169+0000 7f4873fff700 1 -- 172.21.15.26:0/2777886436 learned_addr learned my addr 172.21.15.26:0/2777886436 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:45.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.169+0000 7f08196fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0814133420 0x7f08140709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:45.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.169+0000 7f0819efd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0814134260 0x7f0814071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:45.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.169+0000 7f08196fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0814133420 0x7f08140709a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57506/0 (socket says 172.21.15.26:57506) 2023-10-01T07:59:45.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.169+0000 7f0819efd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0814134260 0x7f0814071420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56926/0 (socket says 172.21.15.26:56926) 2023-10-01T07:59:45.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.169+0000 7f08196fc700 1 -- 172.21.15.26:0/583364813 learned_addr learned my addr 172.21.15.26:0/583364813 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:45.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.169+0000 7f0818efb700 1 --2- 172.21.15.26:0/583364813 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0814133e30 0x7f0814070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:45.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.169+0000 7f4878d5b700 1 --2- 172.21.15.26:0/2777886436 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f487409e410 0x7f4874122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:45.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.169+0000 7f08196fc700 1 -- 172.21.15.26:0/583364813 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0814133e30 msgr2=0x7f0814070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:45.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.169+0000 7f08196fc700 1 --2- 172.21.15.26:0/583364813 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0814133e30 0x7f0814070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:45.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.169+0000 7f08196fc700 1 -- 172.21.15.26:0/583364813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0814134260 msgr2=0x7f0814071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:45.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.169+0000 7f08196fc700 1 --2- 172.21.15.26:0/583364813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0814134260 0x7f0814071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:45.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.169+0000 7f08196fc700 1 -- 172.21.15.26:0/583364813 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0810009550 con 0x7f0814133420 2023-10-01T07:59:45.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.170+0000 7f48737fe700 1 --2- 172.21.15.26:0/2777886436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f487409e000 0x7f4874122a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:45.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.170+0000 7f4873fff700 1 -- 172.21.15.26:0/2777886436 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f487409e410 msgr2=0x7f4874122fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:45.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.170+0000 7f4873fff700 1 --2- 172.21.15.26:0/2777886436 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f487409e410 0x7f4874122fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:45.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.170+0000 7f4873fff700 1 -- 172.21.15.26:0/2777886436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f487409e000 msgr2=0x7f4874122a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:45.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.170+0000 7f4873fff700 1 --2- 172.21.15.26:0/2777886436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f487409e000 0x7f4874122a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:45.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.170+0000 7f4873fff700 1 -- 172.21.15.26:0/2777886436 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4864009550 con 0x7f487409d6f0 2023-10-01T07:59:45.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.170+0000 7f48737fe700 1 --2- 172.21.15.26:0/2777886436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f487409e000 0x7f4874122a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:59:45.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.170+0000 7f4873fff700 1 --2- 172.21.15.26:0/2777886436 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f487409d6f0 0x7f4874122540 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f4864009c70 tx=0x7f4864004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:45.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.170+0000 7f4870ff9700 1 -- 172.21.15.26:0/2777886436 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4864004480 con 0x7f487409d6f0 2023-10-01T07:59:45.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.170+0000 7f4870ff9700 1 -- 172.21.15.26:0/2777886436 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486401f070 con 0x7f487409d6f0 2023-10-01T07:59:45.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.170+0000 7f487a7be700 1 -- 172.21.15.26:0/2777886436 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48740a2f80 con 0x7f487409d6f0 2023-10-01T07:59:45.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.170+0000 7f4870ff9700 1 -- 172.21.15.26:0/2777886436 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48640038c0 con 0x7f487409d6f0 2023-10-01T07:59:45.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.170+0000 7f487a7be700 1 -- 172.21.15.26:0/2777886436 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4874125cf0 con 0x7f487409d6f0 2023-10-01T07:59:45.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.172+0000 7f487a7be700 1 -- 172.21.15.26:0/2777886436 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4874074ea0 con 0x7f487409d6f0 2023-10-01T07:59:45.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.172+0000 7f4870ff9700 1 -- 172.21.15.26:0/2777886436 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4864021030 con 0x7f487409d6f0 2023-10-01T07:59:45.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.172+0000 7f4870ff9700 1 -- 172.21.15.26:0/2777886436 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4864041020 con 0x7f487409d6f0 2023-10-01T07:59:45.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.170+0000 7f08196fc700 1 --2- 172.21.15.26:0/583364813 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0814133420 0x7f08140709a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f0810009c40 tx=0x7f0810004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:45.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.170+0000 7f0809ffb700 1 -- 172.21.15.26:0/583364813 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0810004590 con 0x7f0814133420 2023-10-01T07:59:45.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.170+0000 7f0809ffb700 1 -- 172.21.15.26:0/583364813 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081001f070 con 0x7f0814133420 2023-10-01T07:59:45.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.170+0000 7f0809ffb700 1 -- 172.21.15.26:0/583364813 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08100038e0 con 0x7f0814133420 2023-10-01T07:59:45.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.170+0000 7f081b960700 1 -- 172.21.15.26:0/583364813 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0814072410 con 0x7f0814133420 2023-10-01T07:59:45.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.171+0000 7f081b960700 1 -- 172.21.15.26:0/583364813 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f081411ff20 con 0x7f0814133420 2023-10-01T07:59:45.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.172+0000 7f081b960700 1 -- 172.21.15.26:0/583364813 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0814074ea0 con 0x7f0814133420 2023-10-01T07:59:45.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.172+0000 7f0809ffb700 1 -- 172.21.15.26:0/583364813 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0810003a40 con 0x7f0814133420 2023-10-01T07:59:45.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.177+0000 7f0809ffb700 1 -- 172.21.15.26:0/583364813 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0810021070 con 0x7f0814133420 2023-10-01T07:59:45.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.177+0000 7f4870ff9700 1 -- 172.21.15.26:0/2777886436 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f48640239c0 con 0x7f487409d6f0 2023-10-01T07:59:45.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.185+0000 7f0809ffb700 1 -- 172.21.15.26:0/583364813 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0810019e10 con 0x7f0814133420 2023-10-01T07:59:45.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.236+0000 7ff64dfaa700 1 Processor -- start 2023-10-01T07:59:45.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.236+0000 7ff64dfaa700 1 -- start start 2023-10-01T07:59:45.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.237+0000 7ff64dfaa700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff64809d6f0 0x7ff64809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:45.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.237+0000 7ff64dfaa700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff64809e000 0x7ff6481339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:45.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.237+0000 7ff64dfaa700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff64809e410 0x7ff648133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:45.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.237+0000 7ff64dfaa700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff64806b460 con 0x7ff64809e410 2023-10-01T07:59:45.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.237+0000 7ff64dfaa700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff64809b120 con 0x7ff64809d6f0 2023-10-01T07:59:45.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.237+0000 7ff64dfaa700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff64809a7e0 con 0x7ff64809e000 2023-10-01T07:59:45.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.237+0000 7ff646ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff64809e000 0x7ff6481339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:45.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.237+0000 7ff646ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff64809e000 0x7ff6481339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57514/0 (socket says 172.21.15.26:57514) 2023-10-01T07:59:45.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.237+0000 7ff646ffd700 1 -- 172.21.15.26:0/1392660630 learned_addr learned my addr 172.21.15.26:0/1392660630 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:45.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.237+0000 7ff646ffd700 1 -- 172.21.15.26:0/1392660630 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff64809d6f0 msgr2=0x7ff64809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:45.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.237+0000 7ff646ffd700 1 --2- 172.21.15.26:0/1392660630 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff64809d6f0 0x7ff64809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:45.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.237+0000 7ff646ffd700 1 -- 172.21.15.26:0/1392660630 >> v2:172.21.15.26:3300/0 conn(0x7ff64809e410 msgr2=0x7ff648133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:45.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.237+0000 7ff646ffd700 1 --2- 172.21.15.26:0/1392660630 >> v2:172.21.15.26:3300/0 conn(0x7ff64809e410 0x7ff648133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:45.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.237+0000 7ff646ffd700 1 -- 172.21.15.26:0/1392660630 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff64809a500 con 0x7ff64809e000 2023-10-01T07:59:45.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.237+0000 7ff646ffd700 1 --2- 172.21.15.26:0/1392660630 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff64809e000 0x7ff6481339f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff63c009920 tx=0x7ff63c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b57e305c094c3f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:45.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.238+0000 7ff6467fc700 1 -- 172.21.15.26:0/1392660630 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c00ba20 con 0x7ff64809e000 2023-10-01T07:59:45.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.238+0000 7ff6467fc700 1 -- 172.21.15.26:0/1392660630 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63c00bb80 con 0x7ff64809e000 2023-10-01T07:59:45.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.238+0000 7ff6467fc700 1 -- 172.21.15.26:0/1392660630 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c009e70 con 0x7ff64809e000 2023-10-01T07:59:45.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.239+0000 7ff64dfaa700 1 -- 172.21.15.26:0/1392660630 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff64809e000 msgr2=0x7ff6481339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:45.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.239+0000 7ff64dfaa700 1 --2- 172.21.15.26:0/1392660630 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff64809e000 0x7ff6481339f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff63c009920 tx=0x7ff63c009c30 comp rx=0 tx=0).stop 2023-10-01T07:59:45.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.239+0000 7ff64dfaa700 1 -- 172.21.15.26:0/1392660630 shutdown_connections 2023-10-01T07:59:45.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.239+0000 7ff64dfaa700 1 --2- 172.21.15.26:0/1392660630 >> v2:172.21.15.26:3300/0 conn(0x7ff64809e410 0x7ff648133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:45.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.239+0000 7ff64dfaa700 1 --2- 172.21.15.26:0/1392660630 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff64809d6f0 0x7ff64809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:45.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.239+0000 7ff64dfaa700 1 --2- 172.21.15.26:0/1392660630 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff64809e000 0x7ff6481339f0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:45.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.239+0000 7ff64dfaa700 1 -- 172.21.15.26:0/1392660630 >> 172.21.15.26:0/1392660630 conn(0x7ff648066f50 msgr2=0x7ff64809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:45.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.239+0000 7ff64dfaa700 1 -- 172.21.15.26:0/1392660630 shutdown_connections 2023-10-01T07:59:45.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.239+0000 7ff64dfaa700 1 -- 172.21.15.26:0/1392660630 wait complete. 2023-10-01T07:59:45.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.240+0000 7ff64dfaa700 1 Processor -- start 2023-10-01T07:59:45.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.241+0000 7ff64dfaa700 1 -- start start 2023-10-01T07:59:45.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.241+0000 7ff64dfaa700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff64809d6f0 0x7ff6481a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:45.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.241+0000 7ff64dfaa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff64809e000 0x7ff6481a6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:45.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.241+0000 7ff64dfaa700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff64809e410 0x7ff6481a69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:45.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.241+0000 7ff64dfaa700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64809c710 con 0x7ff64809e000 2023-10-01T07:59:45.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.241+0000 7ff64dfaa700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6481a81a0 con 0x7ff64809e410 2023-10-01T07:59:45.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.241+0000 7ff64dfaa700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6481a7b50 con 0x7ff64809d6f0 2023-10-01T07:59:45.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.241+0000 7ff6477fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff64809d6f0 0x7ff6481a5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:45.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.241+0000 7ff6477fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff64809d6f0 0x7ff6481a5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57518/0 (socket says 172.21.15.26:57518) 2023-10-01T07:59:45.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.241+0000 7ff647fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff64809e410 0x7ff6481a69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:45.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.241+0000 7ff6477fe700 1 -- 172.21.15.26:0/1563001764 learned_addr learned my addr 172.21.15.26:0/1563001764 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:45.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.242+0000 7ff646ffd700 1 --2- 172.21.15.26:0/1563001764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff64809e000 0x7ff6481a6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:45.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.242+0000 7ff6477fe700 1 -- 172.21.15.26:0/1563001764 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff64809e410 msgr2=0x7ff6481a69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:45.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.242+0000 7ff6477fe700 1 --2- 172.21.15.26:0/1563001764 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff64809e410 0x7ff6481a69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:45.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.242+0000 7ff6477fe700 1 -- 172.21.15.26:0/1563001764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff64809e000 msgr2=0x7ff6481a6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:45.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.242+0000 7ff6477fe700 1 --2- 172.21.15.26:0/1563001764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff64809e000 0x7ff6481a6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:45.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.242+0000 7ff6477fe700 1 -- 172.21.15.26:0/1563001764 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63c009550 con 0x7ff64809d6f0 2023-10-01T07:59:45.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.242+0000 7ff647fff700 1 --2- 172.21.15.26:0/1563001764 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff64809e410 0x7ff6481a69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:45.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.242+0000 7ff6477fe700 1 --2- 172.21.15.26:0/1563001764 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff64809d6f0 0x7ff6481a5f40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff63800b530 tx=0x7ff63800b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:45.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.243+0000 7ff62ffff700 1 -- 172.21.15.26:0/1563001764 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff638011830 con 0x7ff64809d6f0 2023-10-01T07:59:45.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.243+0000 7ff62ffff700 1 -- 172.21.15.26:0/1563001764 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff638011990 con 0x7ff64809d6f0 2023-10-01T07:59:45.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.243+0000 7ff64dfaa700 1 -- 172.21.15.26:0/1563001764 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6480a3140 con 0x7ff64809d6f0 2023-10-01T07:59:45.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.243+0000 7ff62ffff700 1 -- 172.21.15.26:0/1563001764 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff638011d40 con 0x7ff64809d6f0 2023-10-01T07:59:45.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.243+0000 7ff64dfaa700 1 -- 172.21.15.26:0/1563001764 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6481a9780 con 0x7ff64809d6f0 2023-10-01T07:59:45.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.244+0000 7ff62ffff700 1 -- 172.21.15.26:0/1563001764 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff63801a400 con 0x7ff64809d6f0 2023-10-01T07:59:45.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.244+0000 7ff64dfaa700 1 -- 172.21.15.26:0/1563001764 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff648074ea0 con 0x7ff64809d6f0 2023-10-01T07:59:45.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.244+0000 7ff62ffff700 1 -- 172.21.15.26:0/1563001764 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff63803f630 con 0x7ff64809d6f0 2023-10-01T07:59:45.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.248+0000 7fcf7a784700 1 Processor -- start 2023-10-01T07:59:45.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.248+0000 7fcf7a784700 1 -- start start 2023-10-01T07:59:45.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.248+0000 7fcf7a784700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf7409d6f0 0x7fcf7409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:45.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.248+0000 7fcf7a784700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf7409e000 0x7fcf74130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:45.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.248+0000 7fcf7a784700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf7409f130 con 0x7fcf7409e410 2023-10-01T07:59:45.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.248+0000 7fcf7a784700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7409f520 con 0x7fcf7409d6f0 2023-10-01T07:59:45.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.248+0000 7fcf7a784700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7409e930 con 0x7fcf7409e000 2023-10-01T07:59:45.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.248+0000 7fcf73fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf7409d6f0 0x7fcf7409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:45.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.248+0000 7fcf73fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf7409d6f0 0x7fcf7409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43798/0 (socket says 172.21.15.26:43798) 2023-10-01T07:59:45.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.249+0000 7fcf73fff700 1 -- 172.21.15.26:0/3490617640 learned_addr learned my addr 172.21.15.26:0/3490617640 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:45.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.249+0000 7fcf73fff700 1 -- 172.21.15.26:0/3490617640 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf7409e000 msgr2=0x7fcf74130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:45.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.249+0000 7fcf73fff700 1 --2- 172.21.15.26:0/3490617640 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf7409e000 0x7fcf74130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:45.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.249+0000 7fcf73fff700 1 -- 172.21.15.26:0/3490617640 >> v1:172.21.15.26:6789/0 conn(0x7fcf7409e410 legacy=0x7fcf74130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:45.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.249+0000 7fcf73fff700 1 -- 172.21.15.26:0/3490617640 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf7409b2d0 con 0x7fcf7409d6f0 2023-10-01T07:59:45.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.249+0000 7fcf73fff700 1 --2- 172.21.15.26:0/3490617640 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf7409d6f0 0x7fcf7409dac0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fcf64009920 tx=0x7fcf64009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a34d7bb7dada802 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:45.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.249+0000 7fcf72ffd700 1 -- 172.21.15.26:0/3490617640 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf64004230 con 0x7fcf7409d6f0 2023-10-01T07:59:45.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.249+0000 7fcf72ffd700 1 -- 172.21.15.26:0/3490617640 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf64004390 con 0x7fcf7409d6f0 2023-10-01T07:59:45.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.249+0000 7fcf72ffd700 1 -- 172.21.15.26:0/3490617640 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf64009e70 con 0x7fcf7409d6f0 2023-10-01T07:59:45.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.249+0000 7ff62ffff700 1 -- 172.21.15.26:0/1563001764 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff63800f8d0 con 0x7ff64809d6f0 2023-10-01T07:59:45.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.250+0000 7fcf7a784700 1 -- 172.21.15.26:0/3490617640 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf7409d6f0 msgr2=0x7fcf7409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:45.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.250+0000 7fcf7a784700 1 --2- 172.21.15.26:0/3490617640 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf7409d6f0 0x7fcf7409dac0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fcf64009920 tx=0x7fcf64009c30 comp rx=0 tx=0).stop 2023-10-01T07:59:45.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.250+0000 7fcf7a784700 1 -- 172.21.15.26:0/3490617640 shutdown_connections 2023-10-01T07:59:45.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.250+0000 7fcf7a784700 1 --2- 172.21.15.26:0/3490617640 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf7409d6f0 0x7fcf7409dac0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:45.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.250+0000 7fcf7a784700 1 --2- 172.21.15.26:0/3490617640 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf7409e000 0x7fcf74130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:45.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.250+0000 7fcf7a784700 1 -- 172.21.15.26:0/3490617640 >> 172.21.15.26:0/3490617640 conn(0x7fcf74066f50 msgr2=0x7fcf7409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:45.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.251+0000 7fcf7a784700 1 -- 172.21.15.26:0/3490617640 shutdown_connections 2023-10-01T07:59:45.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.251+0000 7fcf7a784700 1 -- 172.21.15.26:0/3490617640 wait complete. 2023-10-01T07:59:45.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.252+0000 7fcf7a784700 1 Processor -- start 2023-10-01T07:59:45.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.252+0000 7fcf7a784700 1 -- start start 2023-10-01T07:59:45.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.253+0000 7fcf7a784700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf7409d6f0 0x7fcf7411f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:45.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.253+0000 7fcf7a784700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf7409e000 0x7fcf7411f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:45.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.253+0000 7fcf7a784700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf7409e410 0x7fcf7411fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:45.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.253+0000 7fcf7a784700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf74122dd0 con 0x7fcf7409d6f0 2023-10-01T07:59:45.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.253+0000 7fcf7a784700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf74120ec0 con 0x7fcf7409e000 2023-10-01T07:59:45.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.253+0000 7fcf7a784700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7406e840 con 0x7fcf7409e410 2023-10-01T07:59:45.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.253+0000 7fcf737fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf7409e000 0x7fcf7411f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:45.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.253+0000 7fcf737fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf7409e000 0x7fcf7411f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43810/0 (socket says 172.21.15.26:43810) 2023-10-01T07:59:45.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.253+0000 7fcf737fe700 1 -- 172.21.15.26:0/4243026719 learned_addr learned my addr 172.21.15.26:0/4243026719 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:45.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.253+0000 7fcf73fff700 1 --2- 172.21.15.26:0/4243026719 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf7409d6f0 0x7fcf7411f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:45.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.253+0000 7fcf78d21700 1 --2- 172.21.15.26:0/4243026719 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf7409e410 0x7fcf7411fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:45.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.254+0000 7fcf78d21700 1 -- 172.21.15.26:0/4243026719 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf7409e000 msgr2=0x7fcf7411f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:45.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.254+0000 7fcf78d21700 1 --2- 172.21.15.26:0/4243026719 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf7409e000 0x7fcf7411f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:45.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.254+0000 7fcf78d21700 1 -- 172.21.15.26:0/4243026719 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf7409d6f0 msgr2=0x7fcf7411f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:45.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.254+0000 7fcf78d21700 1 --2- 172.21.15.26:0/4243026719 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf7409d6f0 0x7fcf7411f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:45.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.254+0000 7fcf78d21700 1 -- 172.21.15.26:0/4243026719 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf64009550 con 0x7fcf7409e410 2023-10-01T07:59:45.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.254+0000 7fcf73fff700 1 --2- 172.21.15.26:0/4243026719 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf7409d6f0 0x7fcf7411f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:45.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.254+0000 7fcf78d21700 1 --2- 172.21.15.26:0/4243026719 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf7409e410 0x7fcf7411fdc0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c001e30 tx=0x7fcf6c002140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:45.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.254+0000 7fcf70ff9700 1 -- 172.21.15.26:0/4243026719 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c00c070 con 0x7fcf7409e410 2023-10-01T07:59:45.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.254+0000 7fcf70ff9700 1 -- 172.21.15.26:0/4243026719 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf6c00e2f0 con 0x7fcf7409e410 2023-10-01T07:59:45.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.254+0000 7fcf70ff9700 1 -- 172.21.15.26:0/4243026719 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c003e30 con 0x7fcf7409e410 2023-10-01T07:59:45.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.254+0000 7fcf7a784700 1 -- 172.21.15.26:0/4243026719 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf7409c700 con 0x7fcf7409e410 2023-10-01T07:59:45.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.254+0000 7fcf7a784700 1 -- 172.21.15.26:0/4243026719 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf74130260 con 0x7fcf7409e410 2023-10-01T07:59:45.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.255+0000 7fcf70ff9700 1 -- 172.21.15.26:0/4243026719 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcf6c017850 con 0x7fcf7409e410 2023-10-01T07:59:45.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.255+0000 7fcf70ff9700 1 -- 172.21.15.26:0/4243026719 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcf6c0475f0 con 0x7fcf7409e410 2023-10-01T07:59:45.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.256+0000 7fcf7a784700 1 -- 172.21.15.26:0/4243026719 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf74074ea0 con 0x7fcf7409e410 2023-10-01T07:59:45.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.261+0000 7fcf70ff9700 1 -- 172.21.15.26:0/4243026719 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcf6c01b080 con 0x7fcf7409e410 2023-10-01T07:59:45.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.394+0000 7f487a7be700 1 -- 172.21.15.26:0/2777886436 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f487406c360 con 0x7f487409d6f0 2023-10-01T07:59:45.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.395+0000 7f4870ff9700 1 -- 172.21.15.26:0/2777886436 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f486401b430 con 0x7f487409d6f0 2023-10-01T07:59:45.396 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:45.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.397+0000 7f487a7be700 1 -- 172.21.15.26:0/2777886436 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f487409d6f0 msgr2=0x7f4874122540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:45.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.397+0000 7f487a7be700 1 --2- 172.21.15.26:0/2777886436 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f487409d6f0 0x7f4874122540 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f4864009c70 tx=0x7f4864004750 comp rx=0 tx=0).stop 2023-10-01T07:59:45.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.397+0000 7f487a7be700 1 -- 172.21.15.26:0/2777886436 shutdown_connections 2023-10-01T07:59:45.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.397+0000 7f487a7be700 1 --2- 172.21.15.26:0/2777886436 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f487409e410 0x7f4874122fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:45.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.397+0000 7f487a7be700 1 --2- 172.21.15.26:0/2777886436 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f487409d6f0 0x7f4874122540 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:45.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.397+0000 7f487a7be700 1 --2- 172.21.15.26:0/2777886436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f487409e000 0x7f4874122a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:45.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.397+0000 7f487a7be700 1 -- 172.21.15.26:0/2777886436 >> 172.21.15.26:0/2777886436 conn(0x7f4874066f50 msgr2=0x7f48740a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:45.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.397+0000 7f487a7be700 1 -- 172.21.15.26:0/2777886436 shutdown_connections 2023-10-01T07:59:45.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.397+0000 7f487a7be700 1 -- 172.21.15.26:0/2777886436 wait complete. 2023-10-01T07:59:45.414 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:45.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.445+0000 7f081b960700 1 -- 172.21.15.26:0/583364813 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f081406b250 con 0x7f0814133420 2023-10-01T07:59:45.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.445+0000 7f0809ffb700 1 -- 172.21.15.26:0/583364813 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f081002a020 con 0x7f0814133420 2023-10-01T07:59:45.446 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:45.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.448+0000 7f081b960700 1 -- 172.21.15.26:0/583364813 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0814133420 msgr2=0x7f08140709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:45.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.448+0000 7f081b960700 1 --2- 172.21.15.26:0/583364813 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0814133420 0x7f08140709a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f0810009c40 tx=0x7f0810004750 comp rx=0 tx=0).stop 2023-10-01T07:59:45.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.449+0000 7f081b960700 1 -- 172.21.15.26:0/583364813 shutdown_connections 2023-10-01T07:59:45.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.449+0000 7f081b960700 1 --2- 172.21.15.26:0/583364813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0814134260 0x7f0814071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:45.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.449+0000 7f081b960700 1 --2- 172.21.15.26:0/583364813 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0814133420 0x7f08140709a0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:45.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.449+0000 7f081b960700 1 --2- 172.21.15.26:0/583364813 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0814133e30 0x7f0814070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:45.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.449+0000 7f081b960700 1 -- 172.21.15.26:0/583364813 >> 172.21.15.26:0/583364813 conn(0x7f08140a4210 msgr2=0x7f08140a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:45.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.450+0000 7f081b960700 1 -- 172.21.15.26:0/583364813 shutdown_connections 2023-10-01T07:59:45.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.450+0000 7f081b960700 1 -- 172.21.15.26:0/583364813 wait complete. 2023-10-01T07:59:45.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.460+0000 7ff64dfaa700 1 -- 172.21.15.26:0/1563001764 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff6481a9310 con 0x7ff64809d6f0 2023-10-01T07:59:45.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.461+0000 7ff62ffff700 1 -- 172.21.15.26:0/1563001764 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff638015030 con 0x7ff64809d6f0 2023-10-01T07:59:45.461 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:45.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.463+0000 7ff64dfaa700 1 -- 172.21.15.26:0/1563001764 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff64809d6f0 msgr2=0x7ff6481a5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:45.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.463+0000 7ff64dfaa700 1 --2- 172.21.15.26:0/1563001764 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff64809d6f0 0x7ff6481a5f40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff63800b530 tx=0x7ff63800b840 comp rx=0 tx=0).stop 2023-10-01T07:59:45.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.463+0000 7ff64dfaa700 1 -- 172.21.15.26:0/1563001764 shutdown_connections 2023-10-01T07:59:45.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.463+0000 7ff64dfaa700 1 --2- 172.21.15.26:0/1563001764 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff64809e410 0x7ff6481a69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:45.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.463+0000 7ff64dfaa700 1 --2- 172.21.15.26:0/1563001764 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff64809d6f0 0x7ff6481a5f40 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:45.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.463+0000 7ff64dfaa700 1 --2- 172.21.15.26:0/1563001764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff64809e000 0x7ff6481a6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:45.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.463+0000 7ff64dfaa700 1 -- 172.21.15.26:0/1563001764 >> 172.21.15.26:0/1563001764 conn(0x7ff648066f50 msgr2=0x7ff6481bacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:45.465 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:45.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.463+0000 7ff64dfaa700 1 -- 172.21.15.26:0/1563001764 shutdown_connections 2023-10-01T07:59:45.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.463+0000 7ff64dfaa700 1 -- 172.21.15.26:0/1563001764 wait complete. 2023-10-01T07:59:45.478 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:45.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.503+0000 7fcf7a784700 1 -- 172.21.15.26:0/4243026719 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcf74123590 con 0x7fcf7409e410 2023-10-01T07:59:45.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.503+0000 7fcf70ff9700 1 -- 172.21.15.26:0/4243026719 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcf6c005070 con 0x7fcf7409e410 2023-10-01T07:59:45.504 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:45.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.505+0000 7fcf7a784700 1 -- 172.21.15.26:0/4243026719 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf7409e410 msgr2=0x7fcf7411fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:45.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.506+0000 7fcf7a784700 1 --2- 172.21.15.26:0/4243026719 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf7409e410 0x7fcf7411fdc0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c001e30 tx=0x7fcf6c002140 comp rx=0 tx=0).stop 2023-10-01T07:59:45.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.506+0000 7fcf7a784700 1 -- 172.21.15.26:0/4243026719 shutdown_connections 2023-10-01T07:59:45.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.506+0000 7fcf7a784700 1 --2- 172.21.15.26:0/4243026719 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fcf7409e410 0x7fcf7411fdc0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:45.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.506+0000 7fcf7a784700 1 --2- 172.21.15.26:0/4243026719 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf7409d6f0 0x7fcf7411f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:45.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.506+0000 7fcf7a784700 1 --2- 172.21.15.26:0/4243026719 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcf7409e000 0x7fcf7411f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:45.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.506+0000 7fcf7a784700 1 -- 172.21.15.26:0/4243026719 >> 172.21.15.26:0/4243026719 conn(0x7fcf74066f50 msgr2=0x7fcf740713d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:45.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.506+0000 7fcf7a784700 1 -- 172.21.15.26:0/4243026719 shutdown_connections 2023-10-01T07:59:45.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:45.506+0000 7fcf7a784700 1 -- 172.21.15.26:0/4243026719 wait complete. 2023-10-01T07:59:45.520 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:46.415 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:46.466 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:46.479 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:46.521 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:46.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.566+0000 7fdf9facb700 1 Processor -- start 2023-10-01T07:59:46.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.566+0000 7fdf9facb700 1 -- start start 2023-10-01T07:59:46.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.567+0000 7fdf9facb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf98136710 0x7fdf98138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:46.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.567+0000 7fdf9facb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdf98139030 0x7fdf9813b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:46.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.567+0000 7fdf9facb700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf9806ef30 con 0x7fdf981338a0 2023-10-01T07:59:46.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.567+0000 7fdf9facb700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf9806fef0 con 0x7fdf98139030 2023-10-01T07:59:46.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.567+0000 7fdf9facb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf981334b0 con 0x7fdf98136710 2023-10-01T07:59:46.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.567+0000 7fdf9d066700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf98136710 0x7fdf98138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:46.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.567+0000 7fdf9d066700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf98136710 0x7fdf98138af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43822/0 (socket says 172.21.15.26:43822) 2023-10-01T07:59:46.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.567+0000 7fdf9d066700 1 -- 172.21.15.26:0/2617490100 learned_addr learned my addr 172.21.15.26:0/2617490100 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:46.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.567+0000 7fdf9e068700 1 --2- 172.21.15.26:0/2617490100 >> v2:172.21.15.26:3300/0 conn(0x7fdf98139030 0x7fdf9813b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:46.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.567+0000 7fdf9d066700 1 -- 172.21.15.26:0/2617490100 >> v2:172.21.15.26:3300/0 conn(0x7fdf98139030 msgr2=0x7fdf9813b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:46.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.567+0000 7fdf9d066700 1 --2- 172.21.15.26:0/2617490100 >> v2:172.21.15.26:3300/0 conn(0x7fdf98139030 0x7fdf9813b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:46.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.567+0000 7fdf9d066700 1 -- 172.21.15.26:0/2617490100 >> v1:172.21.15.26:6789/0 conn(0x7fdf981338a0 legacy=0x7fdf98133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:46.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.567+0000 7fdf9d066700 1 -- 172.21.15.26:0/2617490100 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf9806fc30 con 0x7fdf98136710 2023-10-01T07:59:46.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.568+0000 7fdf9d066700 1 --2- 172.21.15.26:0/2617490100 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf98136710 0x7fdf98138af0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fdf880098f0 tx=0x7fdf88009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=670e34670eed8cba server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:46.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.568+0000 7fdf9c865700 1 -- 172.21.15.26:0/2617490100 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8800b8a0 con 0x7fdf98136710 2023-10-01T07:59:46.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.568+0000 7fdf9c865700 1 -- 172.21.15.26:0/2617490100 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8800ba00 con 0x7fdf98136710 2023-10-01T07:59:46.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.568+0000 7fdf9c865700 1 -- 172.21.15.26:0/2617490100 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8800bd90 con 0x7fdf98136710 2023-10-01T07:59:46.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.569+0000 7fdf9facb700 1 -- 172.21.15.26:0/2617490100 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf98136710 msgr2=0x7fdf98138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:46.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.569+0000 7fdf9facb700 1 --2- 172.21.15.26:0/2617490100 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf98136710 0x7fdf98138af0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fdf880098f0 tx=0x7fdf88009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:46.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.569+0000 7fdf9facb700 1 -- 172.21.15.26:0/2617490100 shutdown_connections 2023-10-01T07:59:46.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.569+0000 7fdf9facb700 1 --2- 172.21.15.26:0/2617490100 >> v2:172.21.15.26:3300/0 conn(0x7fdf98139030 0x7fdf9813b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:46.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.569+0000 7fdf9facb700 1 --2- 172.21.15.26:0/2617490100 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf98136710 0x7fdf98138af0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:46.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.569+0000 7fdf9facb700 1 -- 172.21.15.26:0/2617490100 >> 172.21.15.26:0/2617490100 conn(0x7fdf980a2aa0 msgr2=0x7fdf980a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:46.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.569+0000 7fdf9facb700 1 -- 172.21.15.26:0/2617490100 shutdown_connections 2023-10-01T07:59:46.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.569+0000 7fdf9facb700 1 -- 172.21.15.26:0/2617490100 wait complete. 2023-10-01T07:59:46.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.570+0000 7fdf9facb700 1 Processor -- start 2023-10-01T07:59:46.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.570+0000 7fdf9facb700 1 -- start start 2023-10-01T07:59:46.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.571+0000 7fdf9facb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf981338a0 0x7fdf98099ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:46.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.571+0000 7fdf9facb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdf98136710 0x7fdf9809a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:46.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.571+0000 7fdf9facb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf98139030 0x7fdf981cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:46.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.571+0000 7fdf9facb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9809da00 con 0x7fdf98139030 2023-10-01T07:59:46.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.571+0000 7fdf9facb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf98130d10 con 0x7fdf981338a0 2023-10-01T07:59:46.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.571+0000 7fdf9facb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9806f640 con 0x7fdf98136710 2023-10-01T07:59:46.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.571+0000 7fdf9d066700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdf98136710 0x7fdf9809a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:46.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.571+0000 7fdf9d066700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdf98136710 0x7fdf9809a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57552/0 (socket says 172.21.15.26:57552) 2023-10-01T07:59:46.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.571+0000 7fdf9d066700 1 -- 172.21.15.26:0/136520883 learned_addr learned my addr 172.21.15.26:0/136520883 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:46.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.571+0000 7fdf9e068700 1 --2- 172.21.15.26:0/136520883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf98139030 0x7fdf981cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:46.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.571+0000 7fdf9d066700 1 -- 172.21.15.26:0/136520883 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf981338a0 msgr2=0x7fdf98099ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:46.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.571+0000 7fdf9d066700 1 --2- 172.21.15.26:0/136520883 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf981338a0 0x7fdf98099ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:46.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.571+0000 7fdf9d066700 1 -- 172.21.15.26:0/136520883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf98139030 msgr2=0x7fdf981cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:46.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.571+0000 7fdf9d066700 1 --2- 172.21.15.26:0/136520883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf98139030 0x7fdf981cc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:46.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.571+0000 7fdf9d066700 1 -- 172.21.15.26:0/136520883 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf88009550 con 0x7fdf98136710 2023-10-01T07:59:46.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.571+0000 7fdf9e068700 1 --2- 172.21.15.26:0/136520883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf98139030 0x7fdf981cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:46.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.572+0000 7fdf9d066700 1 --2- 172.21.15.26:0/136520883 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdf98136710 0x7fdf9809a220 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fdf88009c40 tx=0x7fdf88004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:46.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.572+0000 7fdf8e7fc700 1 -- 172.21.15.26:0/136520883 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf880043c0 con 0x7fdf98136710 2023-10-01T07:59:46.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.572+0000 7fdf8e7fc700 1 -- 172.21.15.26:0/136520883 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8801f070 con 0x7fdf98136710 2023-10-01T07:59:46.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.572+0000 7fdf9facb700 1 -- 172.21.15.26:0/136520883 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf98138b60 con 0x7fdf98136710 2023-10-01T07:59:46.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.572+0000 7fdf8e7fc700 1 -- 172.21.15.26:0/136520883 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf880036a0 con 0x7fdf98136710 2023-10-01T07:59:46.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.572+0000 7fdf9facb700 1 -- 172.21.15.26:0/136520883 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf9809ae40 con 0x7fdf98136710 2023-10-01T07:59:46.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.573+0000 7fdf8e7fc700 1 -- 172.21.15.26:0/136520883 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdf88021030 con 0x7fdf98136710 2023-10-01T07:59:46.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.573+0000 7fdf8e7fc700 1 -- 172.21.15.26:0/136520883 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdf880409f0 con 0x7fdf98136710 2023-10-01T07:59:46.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.573+0000 7fdf9facb700 1 -- 172.21.15.26:0/136520883 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf9804ea50 con 0x7fdf98136710 2023-10-01T07:59:46.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.578+0000 7fdf8e7fc700 1 -- 172.21.15.26:0/136520883 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdf88015080 con 0x7fdf98136710 2023-10-01T07:59:46.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.612+0000 7ffab6567700 1 Processor -- start 2023-10-01T07:59:46.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.612+0000 7ffab6567700 1 -- start start 2023-10-01T07:59:46.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.613+0000 7ffab6567700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffab0130540 0x7ffab0130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:46.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.613+0000 7ffab6567700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffab0130e50 0x7ffab006f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:46.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.613+0000 7ffab6567700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffab006fb20 0x7ffab006ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:46.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.613+0000 7ffab6567700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab00704b0 con 0x7ffab0130e50 2023-10-01T07:59:46.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.613+0000 7ffab6567700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab009a390 con 0x7ffab0130540 2023-10-01T07:59:46.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.613+0000 7ffab6567700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffab00716a0 con 0x7ffab006fb20 2023-10-01T07:59:46.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.613+0000 7ffaaf7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffab0130e50 0x7ffab006f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:46.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.613+0000 7ffaaf7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffab0130e50 0x7ffab006f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56990/0 (socket says 172.21.15.26:56990) 2023-10-01T07:59:46.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.613+0000 7ffaaf7fe700 1 -- 172.21.15.26:0/1103461049 learned_addr learned my addr 172.21.15.26:0/1103461049 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:46.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.613+0000 7ffaaffff700 1 --2- 172.21.15.26:0/1103461049 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffab0130540 0x7ffab0130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:46.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.613+0000 7ffab4b04700 1 --2- 172.21.15.26:0/1103461049 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffab006fb20 0x7ffab006ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:46.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.613+0000 7ffaaffff700 1 -- 172.21.15.26:0/1103461049 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffab006fb20 msgr2=0x7ffab006ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:46.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.613+0000 7ffaaffff700 1 --2- 172.21.15.26:0/1103461049 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffab006fb20 0x7ffab006ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:46.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.613+0000 7ffaaffff700 1 -- 172.21.15.26:0/1103461049 >> v2:172.21.15.26:3300/0 conn(0x7ffab0130e50 msgr2=0x7ffab006f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:46.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.613+0000 7ffaaffff700 1 --2- 172.21.15.26:0/1103461049 >> v2:172.21.15.26:3300/0 conn(0x7ffab0130e50 0x7ffab006f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:46.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.614+0000 7ffaaffff700 1 -- 172.21.15.26:0/1103461049 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab0071290 con 0x7ffab0130540 2023-10-01T07:59:46.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.614+0000 7ffaaffff700 1 --2- 172.21.15.26:0/1103461049 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffab0130540 0x7ffab0130910 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0009840 tx=0x7ffaa0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de58c06bb02257c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:46.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.614+0000 7ffaaeffd700 1 -- 172.21.15.26:0/1103461049 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0011830 con 0x7ffab0130540 2023-10-01T07:59:46.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.614+0000 7ffaaeffd700 1 -- 172.21.15.26:0/1103461049 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa0011990 con 0x7ffab0130540 2023-10-01T07:59:46.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.614+0000 7ffaaeffd700 1 -- 172.21.15.26:0/1103461049 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0011d20 con 0x7ffab0130540 2023-10-01T07:59:46.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.615+0000 7ffab6567700 1 -- 172.21.15.26:0/1103461049 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffab0130540 msgr2=0x7ffab0130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:46.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.615+0000 7ffab6567700 1 --2- 172.21.15.26:0/1103461049 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffab0130540 0x7ffab0130910 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0009840 tx=0x7ffaa0009b50 comp rx=0 tx=0).stop 2023-10-01T07:59:46.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.615+0000 7ffab6567700 1 -- 172.21.15.26:0/1103461049 shutdown_connections 2023-10-01T07:59:46.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.615+0000 7ffab6567700 1 --2- 172.21.15.26:0/1103461049 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffab006fb20 0x7ffab006ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:46.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.615+0000 7ffab6567700 1 --2- 172.21.15.26:0/1103461049 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffab0130540 0x7ffab0130910 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:46.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.615+0000 7ffab6567700 1 --2- 172.21.15.26:0/1103461049 >> v2:172.21.15.26:3300/0 conn(0x7ffab0130e50 0x7ffab006f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:46.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.615+0000 7ffab6567700 1 -- 172.21.15.26:0/1103461049 >> 172.21.15.26:0/1103461049 conn(0x7ffab00a2aa0 msgr2=0x7ffab00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:46.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.615+0000 7ffab6567700 1 -- 172.21.15.26:0/1103461049 shutdown_connections 2023-10-01T07:59:46.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.615+0000 7ffab6567700 1 -- 172.21.15.26:0/1103461049 wait complete. 2023-10-01T07:59:46.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.616+0000 7ffab6567700 1 Processor -- start 2023-10-01T07:59:46.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.616+0000 7ffab6567700 1 -- start start 2023-10-01T07:59:46.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.617+0000 7ffab6567700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffab006fb20 0x7ffab0118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:46.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.617+0000 7ffab6567700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffab0130540 0x7ffab0119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:46.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.617+0000 7ffab6567700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffab0130e50 0x7ffab0119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:46.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.617+0000 7ffab6567700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab011ba20 con 0x7ffab0130540 2023-10-01T07:59:46.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.617+0000 7ffab6567700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab011b370 con 0x7ffab0130e50 2023-10-01T07:59:46.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.617+0000 7ffab6567700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffab00718e0 con 0x7ffab006fb20 2023-10-01T07:59:46.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.617+0000 7ffaaffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffab006fb20 0x7ffab0118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:46.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.617+0000 7ffaaf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffab0130540 0x7ffab0119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:46.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.617+0000 7ffaaf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffab0130540 0x7ffab0119210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57002/0 (socket says 172.21.15.26:57002) 2023-10-01T07:59:46.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.617+0000 7ffaaffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffab006fb20 0x7ffab0118cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57564/0 (socket says 172.21.15.26:57564) 2023-10-01T07:59:46.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.617+0000 7ffaaf7fe700 1 -- 172.21.15.26:0/4039072796 learned_addr learned my addr 172.21.15.26:0/4039072796 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:46.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.617+0000 7ffab4b04700 1 --2- 172.21.15.26:0/4039072796 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffab0130e50 0x7ffab0119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:46.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.617+0000 7ffaaffff700 1 -- 172.21.15.26:0/4039072796 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffab0130e50 msgr2=0x7ffab0119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:46.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.617+0000 7ffaaffff700 1 --2- 172.21.15.26:0/4039072796 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffab0130e50 0x7ffab0119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:46.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.617+0000 7ffaaffff700 1 -- 172.21.15.26:0/4039072796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffab0130540 msgr2=0x7ffab0119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:46.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.617+0000 7ffaaffff700 1 --2- 172.21.15.26:0/4039072796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffab0130540 0x7ffab0119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:46.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.617+0000 7ffaaffff700 1 -- 172.21.15.26:0/4039072796 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa00094a0 con 0x7ffab006fb20 2023-10-01T07:59:46.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.617+0000 7ffaaf7fe700 1 --2- 172.21.15.26:0/4039072796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffab0130540 0x7ffab0119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:46.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.618+0000 7ffaaffff700 1 --2- 172.21.15.26:0/4039072796 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffab006fb20 0x7ffab0118cd0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0009840 tx=0x7ffaa0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:46.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.618+0000 7ffaacff9700 1 -- 172.21.15.26:0/4039072796 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa001d2f0 con 0x7ffab006fb20 2023-10-01T07:59:46.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.618+0000 7ffaacff9700 1 -- 172.21.15.26:0/4039072796 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa001d450 con 0x7ffab006fb20 2023-10-01T07:59:46.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.618+0000 7ffab6567700 1 -- 172.21.15.26:0/4039072796 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab011a1c0 con 0x7ffab006fb20 2023-10-01T07:59:46.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.618+0000 7ffaacff9700 1 -- 172.21.15.26:0/4039072796 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0021c70 con 0x7ffab006fb20 2023-10-01T07:59:46.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.618+0000 7ffab6567700 1 -- 172.21.15.26:0/4039072796 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab011bfc0 con 0x7ffab006fb20 2023-10-01T07:59:46.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.619+0000 7ffaacff9700 1 -- 172.21.15.26:0/4039072796 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffaa0004040 con 0x7ffab006fb20 2023-10-01T07:59:46.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.619+0000 7ffab6567700 1 -- 172.21.15.26:0/4039072796 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab0074ea0 con 0x7ffab006fb20 2023-10-01T07:59:46.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.619+0000 7ffaacff9700 1 -- 172.21.15.26:0/4039072796 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ffaa0044830 con 0x7ffab006fb20 2023-10-01T07:59:46.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.628+0000 7ffaacff9700 1 -- 172.21.15.26:0/4039072796 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffaa002f020 con 0x7ffab006fb20 2023-10-01T07:59:46.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.671+0000 7f21c0569700 1 Processor -- start 2023-10-01T07:59:46.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.672+0000 7f21c0569700 1 -- start start 2023-10-01T07:59:46.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.673+0000 7f21c0569700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f21b809f410 0x7f21b8136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:46.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.673+0000 7f21c0569700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21b8136fe0 0x7f21b81393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:46.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.673+0000 7f21c0569700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b8070940 con 0x7f21b809e930 2023-10-01T07:59:46.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.673+0000 7f21c0569700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b806fd60 con 0x7f21b8136fe0 2023-10-01T07:59:46.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.673+0000 7f21c0569700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21b806fa80 con 0x7f21b809f410 2023-10-01T07:59:46.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.673+0000 7f21bdb04700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f21b809f410 0x7f21b8136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:46.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.673+0000 7f21bdb04700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f21b809f410 0x7f21b8136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57572/0 (socket says 172.21.15.26:57572) 2023-10-01T07:59:46.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.673+0000 7f21bdb04700 1 -- 172.21.15.26:0/2993292356 learned_addr learned my addr 172.21.15.26:0/2993292356 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:46.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.673+0000 7f21be305700 1 --1- 172.21.15.26:0/2993292356 >> v1:172.21.15.26:6789/0 conn(0x7f21b809e930 0x7f21b809ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47526/0 (socket says 172.21.15.26:47526) 2023-10-01T07:59:46.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.673+0000 7f21beb06700 1 --2- 172.21.15.26:0/2993292356 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21b8136fe0 0x7f21b81393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:46.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.673+0000 7f21bdb04700 1 -- 172.21.15.26:0/2993292356 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21b8136fe0 msgr2=0x7f21b81393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:46.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.673+0000 7f21bdb04700 1 --2- 172.21.15.26:0/2993292356 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21b8136fe0 0x7f21b81393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:46.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.673+0000 7f21bdb04700 1 -- 172.21.15.26:0/2993292356 >> v1:172.21.15.26:6789/0 conn(0x7f21b809e930 legacy=0x7f21b809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:46.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.673+0000 7f21bdb04700 1 -- 172.21.15.26:0/2993292356 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b809fb60 con 0x7f21b809f410 2023-10-01T07:59:46.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.674+0000 7f21bdb04700 1 --2- 172.21.15.26:0/2993292356 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f21b809f410 0x7f21b8136aa0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f21a8009920 tx=0x7f21a8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c28a0e08e131995 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:46.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.674+0000 7f21bd303700 1 -- 172.21.15.26:0/2993292356 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a8004230 con 0x7f21b809f410 2023-10-01T07:59:46.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.674+0000 7f21bd303700 1 -- 172.21.15.26:0/2993292356 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a8004390 con 0x7f21b809f410 2023-10-01T07:59:46.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.674+0000 7f21bd303700 1 -- 172.21.15.26:0/2993292356 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a80036a0 con 0x7f21b809f410 2023-10-01T07:59:46.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.675+0000 7f21c0569700 1 -- 172.21.15.26:0/2993292356 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f21b809f410 msgr2=0x7f21b8136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:46.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.675+0000 7f21c0569700 1 --2- 172.21.15.26:0/2993292356 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f21b809f410 0x7f21b8136aa0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f21a8009920 tx=0x7f21a8009c30 comp rx=0 tx=0).stop 2023-10-01T07:59:46.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.675+0000 7f21c0569700 1 -- 172.21.15.26:0/2993292356 shutdown_connections 2023-10-01T07:59:46.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.675+0000 7f21c0569700 1 --2- 172.21.15.26:0/2993292356 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21b8136fe0 0x7f21b81393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:46.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.675+0000 7f21c0569700 1 --2- 172.21.15.26:0/2993292356 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f21b809f410 0x7f21b8136aa0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:46.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.675+0000 7f21c0569700 1 -- 172.21.15.26:0/2993292356 >> 172.21.15.26:0/2993292356 conn(0x7f21b80a4210 msgr2=0x7f21b80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:46.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.675+0000 7f21c0569700 1 -- 172.21.15.26:0/2993292356 shutdown_connections 2023-10-01T07:59:46.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.675+0000 7f21c0569700 1 -- 172.21.15.26:0/2993292356 wait complete. 2023-10-01T07:59:46.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.676+0000 7f21c0569700 1 Processor -- start 2023-10-01T07:59:46.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.677+0000 7f21c0569700 1 -- start start 2023-10-01T07:59:46.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.677+0000 7f21c0569700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21b809e930 0x7f21b811c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:46.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.677+0000 7f21c0569700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21b809f410 0x7f21b811cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:46.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.677+0000 7f21c0569700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f21b8136fe0 0x7f21b811d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:46.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.677+0000 7f21c0569700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b8132670 con 0x7f21b809e930 2023-10-01T07:59:46.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.677+0000 7f21c0569700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b811e3c0 con 0x7f21b809f410 2023-10-01T07:59:46.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.677+0000 7f21c0569700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21b80a3060 con 0x7f21b8136fe0 2023-10-01T07:59:46.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.677+0000 7f21bdb04700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21b809f410 0x7f21b811cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:46.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.678+0000 7f21bdb04700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21b809f410 0x7f21b811cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43864/0 (socket says 172.21.15.26:43864) 2023-10-01T07:59:46.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.678+0000 7f21bdb04700 1 -- 172.21.15.26:0/1648519170 learned_addr learned my addr 172.21.15.26:0/1648519170 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:46.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.678+0000 7f21be305700 1 --2- 172.21.15.26:0/1648519170 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21b809e930 0x7f21b811c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:46.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.678+0000 7f21beb06700 1 --2- 172.21.15.26:0/1648519170 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f21b8136fe0 0x7f21b811d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:46.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.678+0000 7f21bdb04700 1 -- 172.21.15.26:0/1648519170 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f21b8136fe0 msgr2=0x7f21b811d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:46.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.678+0000 7f21bdb04700 1 --2- 172.21.15.26:0/1648519170 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f21b8136fe0 0x7f21b811d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:46.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.678+0000 7f21bdb04700 1 -- 172.21.15.26:0/1648519170 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21b809e930 msgr2=0x7f21b811c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:46.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.678+0000 7f21bdb04700 1 --2- 172.21.15.26:0/1648519170 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21b809e930 0x7f21b811c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:46.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.678+0000 7f21bdb04700 1 -- 172.21.15.26:0/1648519170 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a8009550 con 0x7f21b809f410 2023-10-01T07:59:46.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.678+0000 7f21bdb04700 1 --2- 172.21.15.26:0/1648519170 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21b809f410 0x7f21b811cbe0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f21a8000c00 tx=0x7f21a8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:46.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.678+0000 7f21aeffd700 1 -- 172.21.15.26:0/1648519170 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a8003a60 con 0x7f21b809f410 2023-10-01T07:59:46.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.678+0000 7f21aeffd700 1 -- 172.21.15.26:0/1648519170 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a8020070 con 0x7f21b809f410 2023-10-01T07:59:46.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.678+0000 7f21aeffd700 1 -- 172.21.15.26:0/1648519170 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a8003e00 con 0x7f21b809f410 2023-10-01T07:59:46.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.678+0000 7f21c0569700 1 -- 172.21.15.26:0/1648519170 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21b811fc80 con 0x7f21b809f410 2023-10-01T07:59:46.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.679+0000 7f21c0569700 1 -- 172.21.15.26:0/1648519170 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b811e800 con 0x7f21b809f410 2023-10-01T07:59:46.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.680+0000 7f21c0569700 1 -- 172.21.15.26:0/1648519170 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21b811fe40 con 0x7f21b809f410 2023-10-01T07:59:46.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.680+0000 7f21aeffd700 1 -- 172.21.15.26:0/1648519170 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f21a8022030 con 0x7f21b809f410 2023-10-01T07:59:46.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.680+0000 7f21aeffd700 1 -- 172.21.15.26:0/1648519170 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f21a8040d70 con 0x7f21b809f410 2023-10-01T07:59:46.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.690+0000 7f21aeffd700 1 -- 172.21.15.26:0/1648519170 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f21a8011630 con 0x7f21b809f410 2023-10-01T07:59:46.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.707+0000 7fbaa1094700 1 Processor -- start 2023-10-01T07:59:46.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.707+0000 7fbaa1094700 1 -- start start 2023-10-01T07:59:46.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.708+0000 7fbaa1094700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fba9c09e930 0x7fba9c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:46.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.708+0000 7fbaa1094700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fba9c09f650 0x7fba9c131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:46.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.708+0000 7fbaa1094700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba9c070940 con 0x7fba9c09f240 2023-10-01T07:59:46.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.708+0000 7fbaa1094700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba9c06fd60 con 0x7fba9c09f650 2023-10-01T07:59:46.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.708+0000 7fbaa1094700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c06fa80 con 0x7fba9c09e930 2023-10-01T07:59:46.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.708+0000 7fba9ad9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fba9c09e930 0x7fba9c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:46.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.708+0000 7fba9ad9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fba9c09e930 0x7fba9c09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57598/0 (socket says 172.21.15.26:57598) 2023-10-01T07:59:46.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.708+0000 7fba9ad9d700 1 -- 172.21.15.26:0/3989424089 learned_addr learned my addr 172.21.15.26:0/3989424089 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:46.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.708+0000 7fba9b59e700 1 --2- 172.21.15.26:0/3989424089 >> v2:172.21.15.26:3300/0 conn(0x7fba9c09f650 0x7fba9c131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:46.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.708+0000 7fba9ad9d700 1 -- 172.21.15.26:0/3989424089 >> v2:172.21.15.26:3300/0 conn(0x7fba9c09f650 msgr2=0x7fba9c131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:46.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.708+0000 7fba9ad9d700 1 --2- 172.21.15.26:0/3989424089 >> v2:172.21.15.26:3300/0 conn(0x7fba9c09f650 0x7fba9c131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:46.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.708+0000 7fba9ad9d700 1 -- 172.21.15.26:0/3989424089 >> v1:172.21.15.26:6789/0 conn(0x7fba9c09f240 legacy=0x7fba9c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:46.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.708+0000 7fba9ad9d700 1 -- 172.21.15.26:0/3989424089 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9c09fb60 con 0x7fba9c09e930 2023-10-01T07:59:46.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.708+0000 7fba9b59e700 1 --2- 172.21.15.26:0/3989424089 >> v2:172.21.15.26:3300/0 conn(0x7fba9c09f650 0x7fba9c131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:46.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.709+0000 7fba9ad9d700 1 --2- 172.21.15.26:0/3989424089 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fba9c09e930 0x7fba9c09ed00 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fba8c0098f0 tx=0x7fba8c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=283aaa58a62133a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:46.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.709+0000 7fba99d9b700 1 -- 172.21.15.26:0/3989424089 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c011830 con 0x7fba9c09e930 2023-10-01T07:59:46.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.709+0000 7fba99d9b700 1 -- 172.21.15.26:0/3989424089 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8c011990 con 0x7fba9c09e930 2023-10-01T07:59:46.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.709+0000 7fba99d9b700 1 -- 172.21.15.26:0/3989424089 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c011d20 con 0x7fba9c09e930 2023-10-01T07:59:46.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.710+0000 7fbaa1094700 1 -- 172.21.15.26:0/3989424089 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fba9c09e930 msgr2=0x7fba9c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:46.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.710+0000 7fbaa1094700 1 --2- 172.21.15.26:0/3989424089 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fba9c09e930 0x7fba9c09ed00 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fba8c0098f0 tx=0x7fba8c009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:46.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.710+0000 7fbaa1094700 1 -- 172.21.15.26:0/3989424089 shutdown_connections 2023-10-01T07:59:46.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.710+0000 7fbaa1094700 1 --2- 172.21.15.26:0/3989424089 >> v2:172.21.15.26:3300/0 conn(0x7fba9c09f650 0x7fba9c131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:46.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.710+0000 7fbaa1094700 1 --2- 172.21.15.26:0/3989424089 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fba9c09e930 0x7fba9c09ed00 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:46.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.710+0000 7fbaa1094700 1 -- 172.21.15.26:0/3989424089 >> 172.21.15.26:0/3989424089 conn(0x7fba9c0a4210 msgr2=0x7fba9c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:46.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.710+0000 7fbaa1094700 1 -- 172.21.15.26:0/3989424089 shutdown_connections 2023-10-01T07:59:46.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.710+0000 7fbaa1094700 1 -- 172.21.15.26:0/3989424089 wait complete. 2023-10-01T07:59:46.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.712+0000 7fbaa1094700 1 Processor -- start 2023-10-01T07:59:46.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.712+0000 7fbaa1094700 1 -- start start 2023-10-01T07:59:46.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.713+0000 7fbaa1094700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fba9c09e930 0x7fba9c12d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:46.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.713+0000 7fbaa1094700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba9c09f240 0x7fba9c12d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:46.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.713+0000 7fbaa1094700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fba9c09f650 0x7fba9c12dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:46.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.713+0000 7fbaa1094700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c130990 con 0x7fba9c09f240 2023-10-01T07:59:46.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.713+0000 7fbaa1094700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c0a34c0 con 0x7fba9c09f650 2023-10-01T07:59:46.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.713+0000 7fbaa1094700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c071d20 con 0x7fba9c09e930 2023-10-01T07:59:46.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.713+0000 7fba9ad9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fba9c09e930 0x7fba9c12d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:46.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.713+0000 7fba9ad9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fba9c09e930 0x7fba9c12d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57614/0 (socket says 172.21.15.26:57614) 2023-10-01T07:59:46.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.713+0000 7fba9ad9d700 1 -- 172.21.15.26:0/3881344946 learned_addr learned my addr 172.21.15.26:0/3881344946 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:46.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.713+0000 7fba9a59c700 1 --2- 172.21.15.26:0/3881344946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba9c09f240 0x7fba9c12d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:46.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.713+0000 7fba9b59e700 1 --2- 172.21.15.26:0/3881344946 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fba9c09f650 0x7fba9c12dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:46.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.713+0000 7fba9ad9d700 1 -- 172.21.15.26:0/3881344946 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fba9c09f650 msgr2=0x7fba9c12dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:46.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.713+0000 7fba9ad9d700 1 --2- 172.21.15.26:0/3881344946 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fba9c09f650 0x7fba9c12dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:46.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.713+0000 7fba9ad9d700 1 -- 172.21.15.26:0/3881344946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba9c09f240 msgr2=0x7fba9c12d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:46.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.713+0000 7fba9ad9d700 1 --2- 172.21.15.26:0/3881344946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba9c09f240 0x7fba9c12d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:46.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.713+0000 7fba9ad9d700 1 -- 172.21.15.26:0/3881344946 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba94009a70 con 0x7fba9c09e930 2023-10-01T07:59:46.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.714+0000 7fba9ad9d700 1 --2- 172.21.15.26:0/3881344946 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fba9c09e930 0x7fba9c12d220 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fba8c000c00 tx=0x7fba8c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:46.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.714+0000 7fba837fe700 1 -- 172.21.15.26:0/3881344946 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c004570 con 0x7fba9c09e930 2023-10-01T07:59:46.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.714+0000 7fba837fe700 1 -- 172.21.15.26:0/3881344946 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8c01f070 con 0x7fba9c09e930 2023-10-01T07:59:46.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.714+0000 7fba837fe700 1 -- 172.21.15.26:0/3881344946 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c0038a0 con 0x7fba9c09e930 2023-10-01T07:59:46.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.714+0000 7fbaa1094700 1 -- 172.21.15.26:0/3881344946 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba8c009550 con 0x7fba9c09e930 2023-10-01T07:59:46.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.714+0000 7fbaa1094700 1 -- 172.21.15.26:0/3881344946 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba9c0a0190 con 0x7fba9c09e930 2023-10-01T07:59:46.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.715+0000 7fbaa1094700 1 -- 172.21.15.26:0/3881344946 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba9c074ea0 con 0x7fba9c09e930 2023-10-01T07:59:46.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.716+0000 7fba837fe700 1 -- 172.21.15.26:0/3881344946 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fba8c021030 con 0x7fba9c09e930 2023-10-01T07:59:46.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.716+0000 7fba837fe700 1 -- 172.21.15.26:0/3881344946 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fba8c040f50 con 0x7fba9c09e930 2023-10-01T07:59:46.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.725+0000 7fba837fe700 1 -- 172.21.15.26:0/3881344946 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fba8c0199a0 con 0x7fba9c09e930 2023-10-01T07:59:46.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.801+0000 7fdf9facb700 1 -- 172.21.15.26:0/136520883 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdf9809cec0 con 0x7fdf98136710 2023-10-01T07:59:46.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.801+0000 7fdf8e7fc700 1 -- 172.21.15.26:0/136520883 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdf88023790 con 0x7fdf98136710 2023-10-01T07:59:46.802 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:46.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.805+0000 7fdf9facb700 1 -- 172.21.15.26:0/136520883 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdf98136710 msgr2=0x7fdf9809a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:46.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.805+0000 7fdf9facb700 1 --2- 172.21.15.26:0/136520883 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdf98136710 0x7fdf9809a220 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fdf88009c40 tx=0x7fdf88004750 comp rx=0 tx=0).stop 2023-10-01T07:59:46.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.805+0000 7fdf9facb700 1 -- 172.21.15.26:0/136520883 shutdown_connections 2023-10-01T07:59:46.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.805+0000 7fdf9facb700 1 --2- 172.21.15.26:0/136520883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf98139030 0x7fdf981cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:46.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.805+0000 7fdf9facb700 1 --2- 172.21.15.26:0/136520883 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf981338a0 0x7fdf98099ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:46.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.805+0000 7fdf9facb700 1 --2- 172.21.15.26:0/136520883 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdf98136710 0x7fdf9809a220 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:46.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.805+0000 7fdf9facb700 1 -- 172.21.15.26:0/136520883 >> 172.21.15.26:0/136520883 conn(0x7fdf980a2aa0 msgr2=0x7fdf981344f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:46.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.805+0000 7fdf9facb700 1 -- 172.21.15.26:0/136520883 shutdown_connections 2023-10-01T07:59:46.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.805+0000 7fdf9facb700 1 -- 172.21.15.26:0/136520883 wait complete. 2023-10-01T07:59:46.825 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:46.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.859+0000 7ffab6567700 1 -- 172.21.15.26:0/4039072796 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ffab006b9e0 con 0x7ffab006fb20 2023-10-01T07:59:46.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.860+0000 7ffaacff9700 1 -- 172.21.15.26:0/4039072796 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffaa0015070 con 0x7ffab006fb20 2023-10-01T07:59:46.861 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:46.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.862+0000 7ffab6567700 1 -- 172.21.15.26:0/4039072796 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffab006fb20 msgr2=0x7ffab0118cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:46.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.862+0000 7ffab6567700 1 --2- 172.21.15.26:0/4039072796 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffab006fb20 0x7ffab0118cd0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0009840 tx=0x7ffaa0004750 comp rx=0 tx=0).stop 2023-10-01T07:59:46.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.862+0000 7ffab6567700 1 -- 172.21.15.26:0/4039072796 shutdown_connections 2023-10-01T07:59:46.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.862+0000 7ffab6567700 1 --2- 172.21.15.26:0/4039072796 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffab0130e50 0x7ffab0119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:46.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.862+0000 7ffab6567700 1 --2- 172.21.15.26:0/4039072796 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffab006fb20 0x7ffab0118cd0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:46.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.862+0000 7ffab6567700 1 --2- 172.21.15.26:0/4039072796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffab0130540 0x7ffab0119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:46.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.862+0000 7ffab6567700 1 -- 172.21.15.26:0/4039072796 >> 172.21.15.26:0/4039072796 conn(0x7ffab00a2aa0 msgr2=0x7ffab012d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:46.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.862+0000 7ffab6567700 1 -- 172.21.15.26:0/4039072796 shutdown_connections 2023-10-01T07:59:46.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.862+0000 7ffab6567700 1 -- 172.21.15.26:0/4039072796 wait complete. 2023-10-01T07:59:46.877 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:46.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.900+0000 7f21c0569700 1 -- 172.21.15.26:0/1648519170 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f21b811fe10 con 0x7f21b809f410 2023-10-01T07:59:46.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.900+0000 7f21aeffd700 1 -- 172.21.15.26:0/1648519170 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f21a80243d0 con 0x7f21b809f410 2023-10-01T07:59:46.901 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:46.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.902+0000 7f21c0569700 1 -- 172.21.15.26:0/1648519170 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21b809f410 msgr2=0x7f21b811cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:46.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.902+0000 7f21c0569700 1 --2- 172.21.15.26:0/1648519170 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21b809f410 0x7f21b811cbe0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f21a8000c00 tx=0x7f21a8004750 comp rx=0 tx=0).stop 2023-10-01T07:59:46.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.902+0000 7f21c0569700 1 -- 172.21.15.26:0/1648519170 shutdown_connections 2023-10-01T07:59:46.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.902+0000 7f21c0569700 1 --2- 172.21.15.26:0/1648519170 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f21b8136fe0 0x7f21b811d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:46.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.902+0000 7f21c0569700 1 --2- 172.21.15.26:0/1648519170 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21b809e930 0x7f21b811c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:46.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.902+0000 7f21c0569700 1 --2- 172.21.15.26:0/1648519170 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21b809f410 0x7f21b811cbe0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:46.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.902+0000 7f21c0569700 1 -- 172.21.15.26:0/1648519170 >> 172.21.15.26:0/1648519170 conn(0x7f21b80a4210 msgr2=0x7f21b809be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:46.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.903+0000 7f21c0569700 1 -- 172.21.15.26:0/1648519170 shutdown_connections 2023-10-01T07:59:46.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.903+0000 7f21c0569700 1 -- 172.21.15.26:0/1648519170 wait complete. 2023-10-01T07:59:46.917 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:46.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.944+0000 7fbaa1094700 1 -- 172.21.15.26:0/3881344946 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fba9c1318c0 con 0x7fba9c09e930 2023-10-01T07:59:46.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.944+0000 7fba837fe700 1 -- 172.21.15.26:0/3881344946 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fba8c01b430 con 0x7fba9c09e930 2023-10-01T07:59:46.945 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:46.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.947+0000 7fbaa1094700 1 -- 172.21.15.26:0/3881344946 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fba9c09e930 msgr2=0x7fba9c12d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:46.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.947+0000 7fbaa1094700 1 --2- 172.21.15.26:0/3881344946 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fba9c09e930 0x7fba9c12d220 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fba8c000c00 tx=0x7fba8c004750 comp rx=0 tx=0).stop 2023-10-01T07:59:46.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.947+0000 7fbaa1094700 1 -- 172.21.15.26:0/3881344946 shutdown_connections 2023-10-01T07:59:46.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.947+0000 7fbaa1094700 1 --2- 172.21.15.26:0/3881344946 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fba9c09f650 0x7fba9c12dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:46.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.947+0000 7fbaa1094700 1 --2- 172.21.15.26:0/3881344946 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fba9c09e930 0x7fba9c12d220 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:46.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.947+0000 7fbaa1094700 1 --2- 172.21.15.26:0/3881344946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba9c09f240 0x7fba9c12d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:46.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.947+0000 7fbaa1094700 1 -- 172.21.15.26:0/3881344946 >> 172.21.15.26:0/3881344946 conn(0x7fba9c0a4210 msgr2=0x7fba9c12aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:46.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.947+0000 7fbaa1094700 1 -- 172.21.15.26:0/3881344946 shutdown_connections 2023-10-01T07:59:46.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:46.947+0000 7fbaa1094700 1 -- 172.21.15.26:0/3881344946 wait complete. 2023-10-01T07:59:46.963 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:47.826 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:47.878 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:47.918 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:47.964 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:47.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.976+0000 7f86bfc8c700 1 Processor -- start 2023-10-01T07:59:47.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.977+0000 7f86bfc8c700 1 -- start start 2023-10-01T07:59:47.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.977+0000 7f86bfc8c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f86b809d6f0 0x7f86b809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:47.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.977+0000 7f86bfc8c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f86b809e000 0x7f86b81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:47.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.978+0000 7f86bfc8c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86b809b120 con 0x7f86b809e410 2023-10-01T07:59:47.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.978+0000 7f86bfc8c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86b806b460 con 0x7f86b809d6f0 2023-10-01T07:59:47.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.978+0000 7f86bfc8c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b809a7e0 con 0x7f86b809e000 2023-10-01T07:59:47.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.978+0000 7f86bd227700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f86b809e000 0x7f86b81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:47.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.978+0000 7f86bd227700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f86b809e000 0x7f86b81339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43878/0 (socket says 172.21.15.26:43878) 2023-10-01T07:59:47.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.978+0000 7f86bd227700 1 -- 172.21.15.26:0/3941860861 learned_addr learned my addr 172.21.15.26:0/3941860861 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:47.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.978+0000 7f86bd227700 1 -- 172.21.15.26:0/3941860861 >> v2:172.21.15.26:3300/0 conn(0x7f86b809d6f0 msgr2=0x7f86b809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:47.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.978+0000 7f86bd227700 1 --2- 172.21.15.26:0/3941860861 >> v2:172.21.15.26:3300/0 conn(0x7f86b809d6f0 0x7f86b809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:47.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.978+0000 7f86bd227700 1 -- 172.21.15.26:0/3941860861 >> v1:172.21.15.26:6789/0 conn(0x7f86b809e410 legacy=0x7f86b8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:47.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.978+0000 7f86bd227700 1 -- 172.21.15.26:0/3941860861 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b809a500 con 0x7f86b809e000 2023-10-01T07:59:47.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.978+0000 7f86bd227700 1 --2- 172.21.15.26:0/3941860861 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f86b809e000 0x7f86b81339f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f86a8009920 tx=0x7f86a8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1ff06d9543bb915 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:47.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.979+0000 7f86bca26700 1 -- 172.21.15.26:0/3941860861 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a8004230 con 0x7f86b809e000 2023-10-01T07:59:47.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.979+0000 7f86bca26700 1 -- 172.21.15.26:0/3941860861 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a8004390 con 0x7f86b809e000 2023-10-01T07:59:47.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.979+0000 7f86bca26700 1 -- 172.21.15.26:0/3941860861 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a8009e70 con 0x7f86b809e000 2023-10-01T07:59:47.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.980+0000 7f86bfc8c700 1 -- 172.21.15.26:0/3941860861 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f86b809e000 msgr2=0x7f86b81339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:47.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.980+0000 7f86bfc8c700 1 --2- 172.21.15.26:0/3941860861 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f86b809e000 0x7f86b81339f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f86a8009920 tx=0x7f86a8009c30 comp rx=0 tx=0).stop 2023-10-01T07:59:47.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.980+0000 7f86bfc8c700 1 -- 172.21.15.26:0/3941860861 shutdown_connections 2023-10-01T07:59:47.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.980+0000 7f86bfc8c700 1 --2- 172.21.15.26:0/3941860861 >> v2:172.21.15.26:3300/0 conn(0x7f86b809d6f0 0x7f86b809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:47.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.980+0000 7f86bfc8c700 1 --2- 172.21.15.26:0/3941860861 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f86b809e000 0x7f86b81339f0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:47.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.980+0000 7f86bfc8c700 1 -- 172.21.15.26:0/3941860861 >> 172.21.15.26:0/3941860861 conn(0x7f86b8066f50 msgr2=0x7f86b809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:47.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.980+0000 7f86bfc8c700 1 -- 172.21.15.26:0/3941860861 shutdown_connections 2023-10-01T07:59:47.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.980+0000 7f86bfc8c700 1 -- 172.21.15.26:0/3941860861 wait complete. 2023-10-01T07:59:47.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.982+0000 7f86bfc8c700 1 Processor -- start 2023-10-01T07:59:47.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.982+0000 7f86bfc8c700 1 -- start start 2023-10-01T07:59:47.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.983+0000 7f86bfc8c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86b809d6f0 0x7f86b81a6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:47.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.983+0000 7f86bfc8c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f86b809e000 0x7f86b81a6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:47.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.983+0000 7f86bfc8c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f86b809e410 0x7f86b81a6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:47.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.983+0000 7f86bfc8c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b81a9290 con 0x7f86b809d6f0 2023-10-01T07:59:47.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.983+0000 7f86bfc8c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b809c710 con 0x7f86b809e410 2023-10-01T07:59:47.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.983+0000 7f86bfc8c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86b80a21f0 con 0x7f86b809e000 2023-10-01T07:59:47.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.983+0000 7f86bda28700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86b809d6f0 0x7f86b81a6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:47.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.983+0000 7f86bda28700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86b809d6f0 0x7f86b81a6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57044/0 (socket says 172.21.15.26:57044) 2023-10-01T07:59:47.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.983+0000 7f86bda28700 1 -- 172.21.15.26:0/2829707352 learned_addr learned my addr 172.21.15.26:0/2829707352 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:47.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.983+0000 7f86be229700 1 --2- 172.21.15.26:0/2829707352 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f86b809e410 0x7f86b81a6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:47.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.983+0000 7f86bda28700 1 -- 172.21.15.26:0/2829707352 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f86b809e000 msgr2=0x7f86b81a6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:47.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.983+0000 7f86bda28700 1 --2- 172.21.15.26:0/2829707352 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f86b809e000 0x7f86b81a6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:47.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.983+0000 7f86bda28700 1 -- 172.21.15.26:0/2829707352 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f86b809e410 msgr2=0x7f86b81a6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:47.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.983+0000 7f86bda28700 1 --2- 172.21.15.26:0/2829707352 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f86b809e410 0x7f86b81a6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:47.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.983+0000 7f86bda28700 1 -- 172.21.15.26:0/2829707352 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a8009550 con 0x7f86b809d6f0 2023-10-01T07:59:47.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.983+0000 7f86bda28700 1 --2- 172.21.15.26:0/2829707352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86b809d6f0 0x7f86b81a6030 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f86b400b530 tx=0x7f86b400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:47.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.984+0000 7f86ae7fc700 1 -- 172.21.15.26:0/2829707352 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b4011830 con 0x7f86b809d6f0 2023-10-01T07:59:47.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.984+0000 7f86ae7fc700 1 -- 172.21.15.26:0/2829707352 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b4011990 con 0x7f86b809d6f0 2023-10-01T07:59:47.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.984+0000 7f86bfc8c700 1 -- 172.21.15.26:0/2829707352 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b81a7bf0 con 0x7f86b809d6f0 2023-10-01T07:59:47.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.984+0000 7f86ae7fc700 1 -- 172.21.15.26:0/2829707352 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b4011d20 con 0x7f86b809d6f0 2023-10-01T07:59:47.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.984+0000 7f86bfc8c700 1 -- 172.21.15.26:0/2829707352 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b81aa000 con 0x7f86b809d6f0 2023-10-01T07:59:47.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.985+0000 7f86ae7fc700 1 -- 172.21.15.26:0/2829707352 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f86b401a400 con 0x7f86b809d6f0 2023-10-01T07:59:47.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.985+0000 7f86ae7fc700 1 -- 172.21.15.26:0/2829707352 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f86b403f760 con 0x7f86b809d6f0 2023-10-01T07:59:47.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.985+0000 7f86bfc8c700 1 -- 172.21.15.26:0/2829707352 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86a00052e0 con 0x7f86b809d6f0 2023-10-01T07:59:47.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:47.995+0000 7f86ae7fc700 1 -- 172.21.15.26:0/2829707352 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f86b4015020 con 0x7f86b809d6f0 2023-10-01T07:59:48.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.037+0000 7f1bd0c31700 1 Processor -- start 2023-10-01T07:59:48.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.037+0000 7f1bd0c31700 1 -- start start 2023-10-01T07:59:48.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.038+0000 7f1bd0c31700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1bcc09e1d0 0x7f1bcc138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:48.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.038+0000 7f1bd0c31700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1bcc139170 0x7f1bcc13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:48.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.038+0000 7f1bd0c31700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bcc09b120 con 0x7f1bcc09d6f0 2023-10-01T07:59:48.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.038+0000 7f1bd0c31700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bcc06b460 con 0x7f1bcc139170 2023-10-01T07:59:48.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.038+0000 7f1bd0c31700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc09a7e0 con 0x7f1bcc09e1d0 2023-10-01T07:59:48.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.038+0000 7f1bca59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1bcc09d6f0 0x7f1bcc09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47552/0 (socket says 172.21.15.26:47552) 2023-10-01T07:59:48.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.038+0000 7f1bca59c700 1 -- 172.21.15.26:0/307493751 learned_addr learned my addr 172.21.15.26:0/307493751 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:59:48.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.038+0000 7f1bc3fff700 1 --2- 172.21.15.26:0/307493751 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1bcc09e1d0 0x7f1bcc138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:48.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.038+0000 7f1bcad9d700 1 --2- 172.21.15.26:0/307493751 >> v2:172.21.15.26:3300/0 conn(0x7f1bcc139170 0x7f1bcc13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:48.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.038+0000 7f1bcad9d700 1 -- 172.21.15.26:0/307493751 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1bcc09e1d0 msgr2=0x7f1bcc138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:48.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.038+0000 7f1bcad9d700 1 --2- 172.21.15.26:0/307493751 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1bcc09e1d0 0x7f1bcc138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:48.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.038+0000 7f1bcad9d700 1 -- 172.21.15.26:0/307493751 >> v1:172.21.15.26:6789/0 conn(0x7f1bcc09d6f0 legacy=0x7f1bcc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:48.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.038+0000 7f1bcad9d700 1 -- 172.21.15.26:0/307493751 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bcc09a500 con 0x7f1bcc139170 2023-10-01T07:59:48.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.038+0000 7f1bc3fff700 1 --2- 172.21.15.26:0/307493751 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1bcc09e1d0 0x7f1bcc138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:48.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.039+0000 7f1bcad9d700 1 --2- 172.21.15.26:0/307493751 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bcc139170 0x7f1bcc13b550 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4009d90 tx=0x7f1bc400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be6c77590c701ce4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:48.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.039+0000 7f1bc9d9b700 1 -- 172.21.15.26:0/307493751 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc400e070 con 0x7f1bcc139170 2023-10-01T07:59:48.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.039+0000 7f1bc9d9b700 1 -- 172.21.15.26:0/307493751 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc400bb20 con 0x7f1bcc139170 2023-10-01T07:59:48.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.039+0000 7f1bc9d9b700 1 -- 172.21.15.26:0/307493751 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4012430 con 0x7f1bcc139170 2023-10-01T07:59:48.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.040+0000 7f1bd0c31700 1 -- 172.21.15.26:0/307493751 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bcc139170 msgr2=0x7f1bcc13b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:48.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.040+0000 7f1bd0c31700 1 --2- 172.21.15.26:0/307493751 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bcc139170 0x7f1bcc13b550 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4009d90 tx=0x7f1bc400b330 comp rx=0 tx=0).stop 2023-10-01T07:59:48.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.040+0000 7f1bd0c31700 1 -- 172.21.15.26:0/307493751 shutdown_connections 2023-10-01T07:59:48.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.040+0000 7f1bd0c31700 1 --2- 172.21.15.26:0/307493751 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bcc139170 0x7f1bcc13b550 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:48.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.040+0000 7f1bd0c31700 1 --2- 172.21.15.26:0/307493751 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1bcc09e1d0 0x7f1bcc138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:48.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.040+0000 7f1bd0c31700 1 -- 172.21.15.26:0/307493751 >> 172.21.15.26:0/307493751 conn(0x7f1bcc066f50 msgr2=0x7f1bcc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:48.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.040+0000 7f1bd0c31700 1 -- 172.21.15.26:0/307493751 shutdown_connections 2023-10-01T07:59:48.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.040+0000 7f1bd0c31700 1 -- 172.21.15.26:0/307493751 wait complete. 2023-10-01T07:59:48.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.042+0000 7f1bd0c31700 1 Processor -- start 2023-10-01T07:59:48.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.042+0000 7f1bd0c31700 1 -- start start 2023-10-01T07:59:48.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.043+0000 7f1bd0c31700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bcc09d6f0 0x7f1bcc1c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:48.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.043+0000 7f1bd0c31700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1bcc09e1d0 0x7f1bcc1c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:48.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.043+0000 7f1bd0c31700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1bcc139170 0x7f1bcc11e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:48.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.043+0000 7f1bd0c31700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc120560 con 0x7f1bcc09d6f0 2023-10-01T07:59:48.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.043+0000 7f1bd0c31700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc120370 con 0x7f1bcc139170 2023-10-01T07:59:48.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.043+0000 7f1bd0c31700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc121ad0 con 0x7f1bcc09e1d0 2023-10-01T07:59:48.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.043+0000 7f1bca59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bcc09d6f0 0x7f1bcc1c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:48.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.043+0000 7f1bcad9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1bcc139170 0x7f1bcc11e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:48.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.043+0000 7f1bca59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bcc09d6f0 0x7f1bcc1c8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57062/0 (socket says 172.21.15.26:57062) 2023-10-01T07:59:48.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.043+0000 7f1bca59c700 1 -- 172.21.15.26:0/4288237991 learned_addr learned my addr 172.21.15.26:0/4288237991 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:48.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.043+0000 7f1bc3fff700 1 --2- 172.21.15.26:0/4288237991 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1bcc09e1d0 0x7f1bcc1c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:48.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.043+0000 7f1bca59c700 1 -- 172.21.15.26:0/4288237991 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1bcc09e1d0 msgr2=0x7f1bcc1c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:48.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.043+0000 7f1bca59c700 1 --2- 172.21.15.26:0/4288237991 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1bcc09e1d0 0x7f1bcc1c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:48.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.043+0000 7f1bca59c700 1 -- 172.21.15.26:0/4288237991 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1bcc139170 msgr2=0x7f1bcc11e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:48.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.043+0000 7f1bca59c700 1 --2- 172.21.15.26:0/4288237991 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1bcc139170 0x7f1bcc11e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:48.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.043+0000 7f1bca59c700 1 -- 172.21.15.26:0/4288237991 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb40094a0 con 0x7f1bcc09d6f0 2023-10-01T07:59:48.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.043+0000 7f1bcad9d700 1 --2- 172.21.15.26:0/4288237991 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1bcc139170 0x7f1bcc11e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:48.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.044+0000 7f1bca59c700 1 --2- 172.21.15.26:0/4288237991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bcc09d6f0 0x7f1bcc1c8560 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc00c520 tx=0x7f1bbc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:48.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.044+0000 7f1bc2ffd700 1 -- 172.21.15.26:0/4288237991 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc005d70 con 0x7f1bcc09d6f0 2023-10-01T07:59:48.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.044+0000 7f1bc2ffd700 1 -- 172.21.15.26:0/4288237991 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bbc0070d0 con 0x7f1bcc09d6f0 2023-10-01T07:59:48.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.044+0000 7f1bd0c31700 1 -- 172.21.15.26:0/4288237991 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc4009a70 con 0x7f1bcc09d6f0 2023-10-01T07:59:48.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.044+0000 7f1bc2ffd700 1 -- 172.21.15.26:0/4288237991 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc007440 con 0x7f1bcc09d6f0 2023-10-01T07:59:48.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.044+0000 7f1bd0c31700 1 -- 172.21.15.26:0/4288237991 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bcc121fa0 con 0x7f1bcc09d6f0 2023-10-01T07:59:48.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.045+0000 7f1bc2ffd700 1 -- 172.21.15.26:0/4288237991 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1bbc0075a0 con 0x7f1bcc09d6f0 2023-10-01T07:59:48.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.045+0000 7f1bd0c31700 1 -- 172.21.15.26:0/4288237991 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bcc074ea0 con 0x7f1bcc09d6f0 2023-10-01T07:59:48.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.045+0000 7f1bc2ffd700 1 -- 172.21.15.26:0/4288237991 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1bbc03ea20 con 0x7f1bcc09d6f0 2023-10-01T07:59:48.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.050+0000 7f1bc2ffd700 1 -- 172.21.15.26:0/4288237991 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1bbc019b40 con 0x7f1bcc09d6f0 2023-10-01T07:59:48.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.083+0000 7f33b5973700 1 Processor -- start 2023-10-01T07:59:48.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.084+0000 7f33b5973700 1 -- start start 2023-10-01T07:59:48.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.084+0000 7f33b5973700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33b009f410 0x7f33b0136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:48.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.084+0000 7f33b5973700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33b0136fe0 0x7f33b01393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:48.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.084+0000 7f33b5973700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b0070940 con 0x7f33b009e930 2023-10-01T07:59:48.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.084+0000 7f33b5973700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b006fd60 con 0x7f33b0136fe0 2023-10-01T07:59:48.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.084+0000 7f33b5973700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33b006fa80 con 0x7f33b009f410 2023-10-01T07:59:48.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.084+0000 7f33ae7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33b009f410 0x7f33b0136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:48.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.084+0000 7f33ae7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33b009f410 0x7f33b0136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57632/0 (socket says 172.21.15.26:57632) 2023-10-01T07:59:48.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.084+0000 7f33ae7fc700 1 -- 172.21.15.26:0/2190204862 learned_addr learned my addr 172.21.15.26:0/2190204862 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:48.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.084+0000 7f33af7fe700 1 --2- 172.21.15.26:0/2190204862 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33b0136fe0 0x7f33b01393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:48.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.085+0000 7f33af7fe700 1 -- 172.21.15.26:0/2190204862 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33b009f410 msgr2=0x7f33b0136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:48.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.085+0000 7f33af7fe700 1 --2- 172.21.15.26:0/2190204862 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33b009f410 0x7f33b0136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:48.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.085+0000 7f33af7fe700 1 -- 172.21.15.26:0/2190204862 >> v1:172.21.15.26:6789/0 conn(0x7f33b009e930 legacy=0x7f33b009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:48.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.085+0000 7f33af7fe700 1 -- 172.21.15.26:0/2190204862 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b009fb60 con 0x7f33b0136fe0 2023-10-01T07:59:48.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.085+0000 7f33ae7fc700 1 --2- 172.21.15.26:0/2190204862 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33b009f410 0x7f33b0136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:48.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.085+0000 7f33af7fe700 1 --2- 172.21.15.26:0/2190204862 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33b0136fe0 0x7f33b01393c0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f33a8009dc0 tx=0x7f33a800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae1fa0c00469774c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:48.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.085+0000 7f33adffb700 1 -- 172.21.15.26:0/2190204862 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a800e070 con 0x7f33b0136fe0 2023-10-01T07:59:48.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.085+0000 7f33adffb700 1 -- 172.21.15.26:0/2190204862 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a800bb20 con 0x7f33b0136fe0 2023-10-01T07:59:48.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.085+0000 7f33adffb700 1 -- 172.21.15.26:0/2190204862 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a8012430 con 0x7f33b0136fe0 2023-10-01T07:59:48.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.086+0000 7f33b5973700 1 -- 172.21.15.26:0/2190204862 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33b0136fe0 msgr2=0x7f33b01393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:48.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.086+0000 7f33b5973700 1 --2- 172.21.15.26:0/2190204862 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33b0136fe0 0x7f33b01393c0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f33a8009dc0 tx=0x7f33a800b330 comp rx=0 tx=0).stop 2023-10-01T07:59:48.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.086+0000 7f33b5973700 1 -- 172.21.15.26:0/2190204862 shutdown_connections 2023-10-01T07:59:48.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.086+0000 7f33b5973700 1 --2- 172.21.15.26:0/2190204862 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33b0136fe0 0x7f33b01393c0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:48.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.086+0000 7f33b5973700 1 --2- 172.21.15.26:0/2190204862 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33b009f410 0x7f33b0136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:48.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.086+0000 7f33b5973700 1 -- 172.21.15.26:0/2190204862 >> 172.21.15.26:0/2190204862 conn(0x7f33b00a4210 msgr2=0x7f33b00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:48.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.086+0000 7f33b5973700 1 -- 172.21.15.26:0/2190204862 shutdown_connections 2023-10-01T07:59:48.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.086+0000 7f33b5973700 1 -- 172.21.15.26:0/2190204862 wait complete. 2023-10-01T07:59:48.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.087+0000 7f33b5973700 1 Processor -- start 2023-10-01T07:59:48.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.088+0000 7f33b5973700 1 -- start start 2023-10-01T07:59:48.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.088+0000 7f33b5973700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33b009e930 0x7f33b01c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:48.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.088+0000 7f33b5973700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33b009f410 0x7f33b01c8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:48.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.088+0000 7f33b5973700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33b0136fe0 0x7f33b01c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:48.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.088+0000 7f33b5973700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b006d560 con 0x7f33b009f410 2023-10-01T07:59:48.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.088+0000 7f33b5973700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b0121040 con 0x7f33b009e930 2023-10-01T07:59:48.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.088+0000 7f33b5973700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33b0121d40 con 0x7f33b0136fe0 2023-10-01T07:59:48.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.088+0000 7f33aeffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33b009e930 0x7f33b01c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:48.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.088+0000 7f33aeffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33b009e930 0x7f33b01c81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43894/0 (socket says 172.21.15.26:43894) 2023-10-01T07:59:48.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.088+0000 7f33aeffd700 1 -- 172.21.15.26:0/4060905228 learned_addr learned my addr 172.21.15.26:0/4060905228 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:48.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.088+0000 7f33ae7fc700 1 --2- 172.21.15.26:0/4060905228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33b009f410 0x7f33b01c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:48.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.088+0000 7f33af7fe700 1 --2- 172.21.15.26:0/4060905228 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33b0136fe0 0x7f33b01c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:48.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.089+0000 7f33ae7fc700 1 -- 172.21.15.26:0/4060905228 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33b0136fe0 msgr2=0x7f33b01c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:48.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.089+0000 7f33ae7fc700 1 --2- 172.21.15.26:0/4060905228 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33b0136fe0 0x7f33b01c8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:48.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.089+0000 7f33ae7fc700 1 -- 172.21.15.26:0/4060905228 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33b009e930 msgr2=0x7f33b01c81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:48.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.089+0000 7f33ae7fc700 1 --2- 172.21.15.26:0/4060905228 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33b009e930 0x7f33b01c81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:48.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.089+0000 7f33ae7fc700 1 -- 172.21.15.26:0/4060905228 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a4009550 con 0x7f33b009f410 2023-10-01T07:59:48.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.089+0000 7f33aeffd700 1 --2- 172.21.15.26:0/4060905228 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33b009e930 0x7f33b01c81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:48.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.089+0000 7f33ae7fc700 1 --2- 172.21.15.26:0/4060905228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33b009f410 0x7f33b01c8730 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f33a400e9a0 tx=0x7f33a400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:48.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.089+0000 7f3397fff700 1 -- 172.21.15.26:0/4060905228 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a4004030 con 0x7f33b009f410 2023-10-01T07:59:48.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.089+0000 7f3397fff700 1 -- 172.21.15.26:0/4060905228 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a4004190 con 0x7f33b009f410 2023-10-01T07:59:48.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.089+0000 7f3397fff700 1 -- 172.21.15.26:0/4060905228 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a4004520 con 0x7f33b009f410 2023-10-01T07:59:48.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.090+0000 7f33b5973700 1 -- 172.21.15.26:0/4060905228 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a8009a70 con 0x7f33b009f410 2023-10-01T07:59:48.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.090+0000 7f33b5973700 1 -- 172.21.15.26:0/4060905228 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b00a2f00 con 0x7f33b009f410 2023-10-01T07:59:48.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.090+0000 7f3397fff700 1 -- 172.21.15.26:0/4060905228 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f33a40036a0 con 0x7f33b009f410 2023-10-01T07:59:48.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.091+0000 7f3397fff700 1 -- 172.21.15.26:0/4060905228 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f33a403f8e0 con 0x7f33b009f410 2023-10-01T07:59:48.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.091+0000 7f33b5973700 1 -- 172.21.15.26:0/4060905228 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33b0074ea0 con 0x7f33b009f410 2023-10-01T07:59:48.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.096+0000 7f3397fff700 1 -- 172.21.15.26:0/4060905228 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f33a4011db0 con 0x7f33b009f410 2023-10-01T07:59:48.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.115+0000 7f2a0dd7c700 1 Processor -- start 2023-10-01T07:59:48.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.115+0000 7f2a0dd7c700 1 -- start start 2023-10-01T07:59:48.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.116+0000 7f2a0dd7c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a0806a770 0x7f2a0809d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:48.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.116+0000 7f2a0dd7c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2a0809dc30 0x7f2a0809e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:48.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.116+0000 7f2a0dd7c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a0813c1e0 0x7f2a0813e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:48.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.116+0000 7f2a0dd7c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a0806ab40 con 0x7f2a0809dc30 2023-10-01T07:59:48.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.116+0000 7f2a0dd7c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0809ebc0 con 0x7f2a0806a770 2023-10-01T07:59:48.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.116+0000 7f2a0dd7c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0809a810 con 0x7f2a0813c1e0 2023-10-01T07:59:48.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.116+0000 7f2a077fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a0806a770 0x7f2a0809d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:48.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.116+0000 7f2a077fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a0806a770 0x7f2a0809d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43898/0 (socket says 172.21.15.26:43898) 2023-10-01T07:59:48.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.116+0000 7f2a06ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2a0809dc30 0x7f2a0809e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:48.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.116+0000 7f2a077fe700 1 -- 172.21.15.26:0/3077518559 learned_addr learned my addr 172.21.15.26:0/3077518559 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:48.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.116+0000 7f2a07fff700 1 --2- 172.21.15.26:0/3077518559 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a0813c1e0 0x7f2a0813e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:48.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.116+0000 7f2a077fe700 1 -- 172.21.15.26:0/3077518559 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a0813c1e0 msgr2=0x7f2a0813e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:48.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.116+0000 7f2a077fe700 1 --2- 172.21.15.26:0/3077518559 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a0813c1e0 0x7f2a0813e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:48.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.116+0000 7f2a077fe700 1 -- 172.21.15.26:0/3077518559 >> v2:172.21.15.26:3300/0 conn(0x7f2a0809dc30 msgr2=0x7f2a0809e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:48.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.116+0000 7f2a077fe700 1 --2- 172.21.15.26:0/3077518559 >> v2:172.21.15.26:3300/0 conn(0x7f2a0809dc30 0x7f2a0809e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:48.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.116+0000 7f2a077fe700 1 -- 172.21.15.26:0/3077518559 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a0809e920 con 0x7f2a0806a770 2023-10-01T07:59:48.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.116+0000 7f2a06ffd700 1 --2- 172.21.15.26:0/3077518559 >> v2:172.21.15.26:3300/0 conn(0x7f2a0809dc30 0x7f2a0809e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:48.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.117+0000 7f2a077fe700 1 --2- 172.21.15.26:0/3077518559 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a0806a770 0x7f2a0809d6f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f29f80098f0 tx=0x7f29f8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9530297fc52ae393 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:48.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.117+0000 7f2a067fc700 1 -- 172.21.15.26:0/3077518559 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f8011830 con 0x7f2a0806a770 2023-10-01T07:59:48.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.117+0000 7f2a067fc700 1 -- 172.21.15.26:0/3077518559 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f8011990 con 0x7f2a0806a770 2023-10-01T07:59:48.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.117+0000 7f2a067fc700 1 -- 172.21.15.26:0/3077518559 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f8011d20 con 0x7f2a0806a770 2023-10-01T07:59:48.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.117+0000 7f2a0dd7c700 1 -- 172.21.15.26:0/3077518559 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a0806a770 msgr2=0x7f2a0809d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:48.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.117+0000 7f2a0dd7c700 1 --2- 172.21.15.26:0/3077518559 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a0806a770 0x7f2a0809d6f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f29f80098f0 tx=0x7f29f8009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:48.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.117+0000 7f2a0dd7c700 1 -- 172.21.15.26:0/3077518559 shutdown_connections 2023-10-01T07:59:48.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.117+0000 7f2a0dd7c700 1 --2- 172.21.15.26:0/3077518559 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a0813c1e0 0x7f2a0813e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:48.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.117+0000 7f2a0dd7c700 1 --2- 172.21.15.26:0/3077518559 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a0806a770 0x7f2a0809d6f0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:48.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.117+0000 7f2a0dd7c700 1 --2- 172.21.15.26:0/3077518559 >> v2:172.21.15.26:3300/0 conn(0x7f2a0809dc30 0x7f2a0809e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:48.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.118+0000 7f2a0dd7c700 1 -- 172.21.15.26:0/3077518559 >> 172.21.15.26:0/3077518559 conn(0x7f2a08066f50 msgr2=0x7f2a0809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:48.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.118+0000 7f2a0dd7c700 1 -- 172.21.15.26:0/3077518559 shutdown_connections 2023-10-01T07:59:48.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.118+0000 7f2a0dd7c700 1 -- 172.21.15.26:0/3077518559 wait complete. 2023-10-01T07:59:48.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.119+0000 7f2a0dd7c700 1 Processor -- start 2023-10-01T07:59:48.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.119+0000 7f2a0dd7c700 1 -- start start 2023-10-01T07:59:48.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.119+0000 7f2a0dd7c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a0806a770 0x7f2a081cc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:48.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.119+0000 7f2a0dd7c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a0809dc30 0x7f2a081ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:48.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.119+0000 7f2a0dd7c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a0813c1e0 0x7f2a08126170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:48.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.119+0000 7f2a0dd7c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0813ac20 con 0x7f2a0809dc30 2023-10-01T07:59:48.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.119+0000 7f2a0dd7c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a080a3880 con 0x7f2a0806a770 2023-10-01T07:59:48.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.119+0000 7f2a0dd7c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a08128460 con 0x7f2a0813c1e0 2023-10-01T07:59:48.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.120+0000 7f2a06ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a0809dc30 0x7f2a081ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:48.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.120+0000 7f2a07fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a0813c1e0 0x7f2a08126170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:48.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.120+0000 7f2a06ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a0809dc30 0x7f2a081ccbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57102/0 (socket says 172.21.15.26:57102) 2023-10-01T07:59:48.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.120+0000 7f2a06ffd700 1 -- 172.21.15.26:0/96963438 learned_addr learned my addr 172.21.15.26:0/96963438 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:48.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.120+0000 7f2a077fe700 1 --2- 172.21.15.26:0/96963438 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a0806a770 0x7f2a081cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:48.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.120+0000 7f2a07fff700 1 -- 172.21.15.26:0/96963438 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a0806a770 msgr2=0x7f2a081cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:48.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.120+0000 7f2a07fff700 1 --2- 172.21.15.26:0/96963438 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a0806a770 0x7f2a081cc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:48.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.120+0000 7f2a07fff700 1 -- 172.21.15.26:0/96963438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a0809dc30 msgr2=0x7f2a081ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:48.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.120+0000 7f2a07fff700 1 --2- 172.21.15.26:0/96963438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a0809dc30 0x7f2a081ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:48.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.120+0000 7f2a07fff700 1 -- 172.21.15.26:0/96963438 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29fc0094a0 con 0x7f2a0813c1e0 2023-10-01T07:59:48.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.120+0000 7f2a07fff700 1 --2- 172.21.15.26:0/96963438 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a0813c1e0 0x7f2a08126170 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f2a0000efc0 tx=0x7f2a0000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:48.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.120+0000 7f29effff700 1 -- 172.21.15.26:0/96963438 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0000cd40 con 0x7f2a0813c1e0 2023-10-01T07:59:48.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.120+0000 7f29effff700 1 -- 172.21.15.26:0/96963438 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0000f040 con 0x7f2a0813c1e0 2023-10-01T07:59:48.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.120+0000 7f2a0dd7c700 1 -- 172.21.15.26:0/96963438 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f8009550 con 0x7f2a0813c1e0 2023-10-01T07:59:48.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.120+0000 7f29effff700 1 -- 172.21.15.26:0/96963438 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0000cea0 con 0x7f2a0813c1e0 2023-10-01T07:59:48.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.121+0000 7f2a0dd7c700 1 -- 172.21.15.26:0/96963438 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a081c1310 con 0x7f2a0813c1e0 2023-10-01T07:59:48.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.122+0000 7f2a0dd7c700 1 -- 172.21.15.26:0/96963438 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a08074ea0 con 0x7f2a0813c1e0 2023-10-01T07:59:48.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.122+0000 7f29effff700 1 -- 172.21.15.26:0/96963438 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2a000146c0 con 0x7f2a0813c1e0 2023-10-01T07:59:48.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.122+0000 7f29effff700 1 -- 172.21.15.26:0/96963438 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2a00040810 con 0x7f2a0813c1e0 2023-10-01T07:59:48.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.127+0000 7f29effff700 1 -- 172.21.15.26:0/96963438 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2a00012930 con 0x7f2a0813c1e0 2023-10-01T07:59:48.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.222+0000 7f86bfc8c700 1 -- 172.21.15.26:0/2829707352 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f86a0005590 con 0x7f86b809d6f0 2023-10-01T07:59:48.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.223+0000 7f86ae7fc700 1 -- 172.21.15.26:0/2829707352 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f86b4029090 con 0x7f86b809d6f0 2023-10-01T07:59:48.224 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:48.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.225+0000 7f86bfc8c700 1 -- 172.21.15.26:0/2829707352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86b809d6f0 msgr2=0x7f86b81a6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:48.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.225+0000 7f86bfc8c700 1 --2- 172.21.15.26:0/2829707352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86b809d6f0 0x7f86b81a6030 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f86b400b530 tx=0x7f86b400b840 comp rx=0 tx=0).stop 2023-10-01T07:59:48.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.225+0000 7f86bfc8c700 1 -- 172.21.15.26:0/2829707352 shutdown_connections 2023-10-01T07:59:48.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.225+0000 7f86bfc8c700 1 --2- 172.21.15.26:0/2829707352 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f86b809e410 0x7f86b81a6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:48.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.225+0000 7f86bfc8c700 1 --2- 172.21.15.26:0/2829707352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86b809d6f0 0x7f86b81a6030 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:48.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.225+0000 7f86bfc8c700 1 --2- 172.21.15.26:0/2829707352 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f86b809e000 0x7f86b81a6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:48.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.225+0000 7f86bfc8c700 1 -- 172.21.15.26:0/2829707352 >> 172.21.15.26:0/2829707352 conn(0x7f86b8066f50 msgr2=0x7f86b81baf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:48.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.225+0000 7f86bfc8c700 1 -- 172.21.15.26:0/2829707352 shutdown_connections 2023-10-01T07:59:48.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.225+0000 7f86bfc8c700 1 -- 172.21.15.26:0/2829707352 wait complete. 2023-10-01T07:59:48.240 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:48.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.318+0000 7f1bd0c31700 1 -- 172.21.15.26:0/4288237991 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1bcc120b60 con 0x7f1bcc09d6f0 2023-10-01T07:59:48.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.318+0000 7f1bc2ffd700 1 -- 172.21.15.26:0/4288237991 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1bbc017030 con 0x7f1bcc09d6f0 2023-10-01T07:59:48.319 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:48.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.320+0000 7f1bd0c31700 1 -- 172.21.15.26:0/4288237991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bcc09d6f0 msgr2=0x7f1bcc1c8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:48.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.320+0000 7f1bd0c31700 1 --2- 172.21.15.26:0/4288237991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bcc09d6f0 0x7f1bcc1c8560 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc00c520 tx=0x7f1bbc00c830 comp rx=0 tx=0).stop 2023-10-01T07:59:48.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.320+0000 7f1bd0c31700 1 -- 172.21.15.26:0/4288237991 shutdown_connections 2023-10-01T07:59:48.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.320+0000 7f1bd0c31700 1 --2- 172.21.15.26:0/4288237991 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1bcc139170 0x7f1bcc11e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:48.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.320+0000 7f1bd0c31700 1 --2- 172.21.15.26:0/4288237991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bcc09d6f0 0x7f1bcc1c8560 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:48.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.320+0000 7f1bd0c31700 1 --2- 172.21.15.26:0/4288237991 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1bcc09e1d0 0x7f1bcc1c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:48.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.320+0000 7f1bd0c31700 1 -- 172.21.15.26:0/4288237991 >> 172.21.15.26:0/4288237991 conn(0x7f1bcc066f50 msgr2=0x7f1bcc0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:48.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.321+0000 7f1bd0c31700 1 -- 172.21.15.26:0/4288237991 shutdown_connections 2023-10-01T07:59:48.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.321+0000 7f1bd0c31700 1 -- 172.21.15.26:0/4288237991 wait complete. 2023-10-01T07:59:48.335 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:48.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.337+0000 7f2a0dd7c700 1 -- 172.21.15.26:0/96963438 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2a081296a0 con 0x7f2a0813c1e0 2023-10-01T07:59:48.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.338+0000 7f29effff700 1 -- 172.21.15.26:0/96963438 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2a0002a070 con 0x7f2a0813c1e0 2023-10-01T07:59:48.338 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:48.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.340+0000 7f2a0dd7c700 1 -- 172.21.15.26:0/96963438 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a0813c1e0 msgr2=0x7f2a08126170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:48.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.340+0000 7f2a0dd7c700 1 --2- 172.21.15.26:0/96963438 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a0813c1e0 0x7f2a08126170 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f2a0000efc0 tx=0x7f2a0000c3a0 comp rx=0 tx=0).stop 2023-10-01T07:59:48.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.340+0000 7f2a0dd7c700 1 -- 172.21.15.26:0/96963438 shutdown_connections 2023-10-01T07:59:48.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.340+0000 7f2a0dd7c700 1 --2- 172.21.15.26:0/96963438 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a0813c1e0 0x7f2a08126170 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:48.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.340+0000 7f2a0dd7c700 1 --2- 172.21.15.26:0/96963438 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a0806a770 0x7f2a081cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:48.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.340+0000 7f2a0dd7c700 1 --2- 172.21.15.26:0/96963438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a0809dc30 0x7f2a081ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:48.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.340+0000 7f2a0dd7c700 1 -- 172.21.15.26:0/96963438 >> 172.21.15.26:0/96963438 conn(0x7f2a08066f50 msgr2=0x7f2a0813b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:48.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.340+0000 7f2a0dd7c700 1 -- 172.21.15.26:0/96963438 shutdown_connections 2023-10-01T07:59:48.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.340+0000 7f2a0dd7c700 1 -- 172.21.15.26:0/96963438 wait complete. 2023-10-01T07:59:48.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.352+0000 7f33b5973700 1 -- 172.21.15.26:0/4060905228 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f33b006b250 con 0x7f33b009f410 2023-10-01T07:59:48.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.352+0000 7f3397fff700 1 -- 172.21.15.26:0/4060905228 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f33a4011350 con 0x7f33b009f410 2023-10-01T07:59:48.352 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:48.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:48.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.354+0000 7f33b5973700 1 -- 172.21.15.26:0/4060905228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33b009f410 msgr2=0x7f33b01c8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:48.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.354+0000 7f33b5973700 1 --2- 172.21.15.26:0/4060905228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33b009f410 0x7f33b01c8730 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f33a400e9a0 tx=0x7f33a400ecb0 comp rx=0 tx=0).stop 2023-10-01T07:59:48.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.354+0000 7f33b5973700 1 -- 172.21.15.26:0/4060905228 shutdown_connections 2023-10-01T07:59:48.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.354+0000 7f33b5973700 1 --2- 172.21.15.26:0/4060905228 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33b0136fe0 0x7f33b01c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:48.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.354+0000 7f33b5973700 1 --2- 172.21.15.26:0/4060905228 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33b009e930 0x7f33b01c81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:48.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.354+0000 7f33b5973700 1 --2- 172.21.15.26:0/4060905228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33b009f410 0x7f33b01c8730 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:48.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.354+0000 7f33b5973700 1 -- 172.21.15.26:0/4060905228 >> 172.21.15.26:0/4060905228 conn(0x7f33b00a4210 msgr2=0x7f33b0134ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:48.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.355+0000 7f33b5973700 1 -- 172.21.15.26:0/4060905228 shutdown_connections 2023-10-01T07:59:48.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:48.355+0000 7f33b5973700 1 -- 172.21.15.26:0/4060905228 wait complete. 2023-10-01T07:59:48.368 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:49.241 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:49.336 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:49.355 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:49.369 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:49.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.389+0000 7f69ea504700 1 Processor -- start 2023-10-01T07:59:49.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.389+0000 7f69ea504700 1 -- start start 2023-10-01T07:59:49.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.390+0000 7f69ea504700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f69e406f5d0 0x7f69e412ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:49.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.390+0000 7f69ea504700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69e4135c20 0x7f69e4138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:49.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.390+0000 7f69ea504700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e406fa40 con 0x7f69e412cf60 2023-10-01T07:59:49.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.390+0000 7f69ea504700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e412cd90 con 0x7f69e4135c20 2023-10-01T07:59:49.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.390+0000 7f69ea504700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69e4071780 con 0x7f69e406f5d0 2023-10-01T07:59:49.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.390+0000 7f69e3fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f69e412cf60 0x7f69e412f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47568/0 (socket says 172.21.15.26:47568) 2023-10-01T07:59:49.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.390+0000 7f69e3fff700 1 -- 172.21.15.26:0/189726115 learned_addr learned my addr 172.21.15.26:0/189726115 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:59:49.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.390+0000 7f69e37fe700 1 --2- 172.21.15.26:0/189726115 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f69e406f5d0 0x7f69e412ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:49.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.390+0000 7f69e8aa1700 1 --2- 172.21.15.26:0/189726115 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69e4135c20 0x7f69e4138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:49.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.391+0000 7f69e37fe700 1 -- 172.21.15.26:0/189726115 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69e4135c20 msgr2=0x7f69e4138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:49.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.391+0000 7f69e37fe700 1 --2- 172.21.15.26:0/189726115 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69e4135c20 0x7f69e4138000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.391+0000 7f69e37fe700 1 -- 172.21.15.26:0/189726115 >> v1:172.21.15.26:6789/0 conn(0x7f69e412cf60 legacy=0x7f69e412f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:49.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.391+0000 7f69e37fe700 1 -- 172.21.15.26:0/189726115 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e4071a40 con 0x7f69e406f5d0 2023-10-01T07:59:49.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.391+0000 7f69e37fe700 1 --2- 172.21.15.26:0/189726115 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f69e406f5d0 0x7f69e412ffc0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f69d800bb30 tx=0x7f69d800be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afa80a9043fdc0a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:49.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.391+0000 7f69e2ffd700 1 -- 172.21.15.26:0/189726115 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d8004230 con 0x7f69e406f5d0 2023-10-01T07:59:49.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.391+0000 7f69e2ffd700 1 -- 172.21.15.26:0/189726115 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d8004390 con 0x7f69e406f5d0 2023-10-01T07:59:49.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.391+0000 7f69e2ffd700 1 -- 172.21.15.26:0/189726115 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d800d960 con 0x7f69e406f5d0 2023-10-01T07:59:49.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.392+0000 7f69ea504700 1 -- 172.21.15.26:0/189726115 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f69e406f5d0 msgr2=0x7f69e412ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:49.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.392+0000 7f69ea504700 1 --2- 172.21.15.26:0/189726115 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f69e406f5d0 0x7f69e412ffc0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f69d800bb30 tx=0x7f69d800be40 comp rx=0 tx=0).stop 2023-10-01T07:59:49.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.392+0000 7f69ea504700 1 -- 172.21.15.26:0/189726115 shutdown_connections 2023-10-01T07:59:49.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.392+0000 7f69ea504700 1 --2- 172.21.15.26:0/189726115 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69e4135c20 0x7f69e4138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.392+0000 7f69ea504700 1 --2- 172.21.15.26:0/189726115 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f69e406f5d0 0x7f69e412ffc0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.392+0000 7f69ea504700 1 -- 172.21.15.26:0/189726115 >> 172.21.15.26:0/189726115 conn(0x7f69e40a2aa0 msgr2=0x7f69e40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:49.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.393+0000 7f69ea504700 1 -- 172.21.15.26:0/189726115 shutdown_connections 2023-10-01T07:59:49.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.393+0000 7f69ea504700 1 -- 172.21.15.26:0/189726115 wait complete. 2023-10-01T07:59:49.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.394+0000 7f69ea504700 1 Processor -- start 2023-10-01T07:59:49.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.394+0000 7f69ea504700 1 -- start start 2023-10-01T07:59:49.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.395+0000 7f69ea504700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69e406f5d0 0x7f69e41c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:49.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.395+0000 7f69ea504700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69e412cf60 0x7f69e41c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:49.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.395+0000 7f69ea504700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f69e4135c20 0x7f69e41c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:49.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.395+0000 7f69ea504700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e4129fa0 con 0x7f69e406f5d0 2023-10-01T07:59:49.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.395+0000 7f69ea504700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e412c130 con 0x7f69e412cf60 2023-10-01T07:59:49.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.395+0000 7f69ea504700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69e4133b60 con 0x7f69e4135c20 2023-10-01T07:59:49.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.395+0000 7f69e3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69e406f5d0 0x7f69e41c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:49.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.395+0000 7f69e3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69e406f5d0 0x7f69e41c8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57112/0 (socket says 172.21.15.26:57112) 2023-10-01T07:59:49.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.395+0000 7f69e3fff700 1 -- 172.21.15.26:0/3693145727 learned_addr learned my addr 172.21.15.26:0/3693145727 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:49.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.395+0000 7f69e37fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69e412cf60 0x7f69e41c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:49.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.395+0000 7f69e8aa1700 1 --2- 172.21.15.26:0/3693145727 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f69e4135c20 0x7f69e41c4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:49.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.396+0000 7f69e3fff700 1 -- 172.21.15.26:0/3693145727 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f69e4135c20 msgr2=0x7f69e41c4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:49.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.396+0000 7f69e3fff700 1 --2- 172.21.15.26:0/3693145727 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f69e4135c20 0x7f69e41c4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.396+0000 7f69e3fff700 1 -- 172.21.15.26:0/3693145727 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69e412cf60 msgr2=0x7f69e41c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:49.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.396+0000 7f69e3fff700 1 --2- 172.21.15.26:0/3693145727 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69e412cf60 0x7f69e41c8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.396+0000 7f69e3fff700 1 -- 172.21.15.26:0/3693145727 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d800b730 con 0x7f69e406f5d0 2023-10-01T07:59:49.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.396+0000 7f69e37fe700 1 --2- 172.21.15.26:0/3693145727 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69e412cf60 0x7f69e41c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:49.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.396+0000 7f69e3fff700 1 --2- 172.21.15.26:0/3693145727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69e406f5d0 0x7f69e41c8770 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f69d400c780 tx=0x7f69d400ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:49.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.397+0000 7f69e0ff9700 1 -- 172.21.15.26:0/3693145727 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d4004c80 con 0x7f69e406f5d0 2023-10-01T07:59:49.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.397+0000 7f69e0ff9700 1 -- 172.21.15.26:0/3693145727 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d4004de0 con 0x7f69e406f5d0 2023-10-01T07:59:49.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.397+0000 7f69ea504700 1 -- 172.21.15.26:0/3693145727 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e41c91f0 con 0x7f69e406f5d0 2023-10-01T07:59:49.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.397+0000 7f69e0ff9700 1 -- 172.21.15.26:0/3693145727 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d4007310 con 0x7f69e406f5d0 2023-10-01T07:59:49.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.397+0000 7f69ea504700 1 -- 172.21.15.26:0/3693145727 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e4118ee0 con 0x7f69e406f5d0 2023-10-01T07:59:49.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.398+0000 7f69ea504700 1 -- 172.21.15.26:0/3693145727 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69c40052e0 con 0x7f69e406f5d0 2023-10-01T07:59:49.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.398+0000 7f69e0ff9700 1 -- 172.21.15.26:0/3693145727 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f69d4007470 con 0x7f69e406f5d0 2023-10-01T07:59:49.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.399+0000 7f69e0ff9700 1 -- 172.21.15.26:0/3693145727 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f69d403f4c0 con 0x7f69e406f5d0 2023-10-01T07:59:49.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.404+0000 7f69e0ff9700 1 -- 172.21.15.26:0/3693145727 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f69d4007720 con 0x7f69e406f5d0 2023-10-01T07:59:49.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.484+0000 7fbc831da700 1 Processor -- start 2023-10-01T07:59:49.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.485+0000 7fbc831da700 1 -- start start 2023-10-01T07:59:49.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.485+0000 7fbc831da700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc7c09e930 0x7fbc7c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:49.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.485+0000 7fbc831da700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc7c09f650 0x7fbc7c131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:49.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.485+0000 7fbc831da700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc7c070940 con 0x7fbc7c09f240 2023-10-01T07:59:49.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.485+0000 7fbc831da700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c06fd60 con 0x7fbc7c09f650 2023-10-01T07:59:49.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.485+0000 7fbc831da700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c06fa80 con 0x7fbc7c09e930 2023-10-01T07:59:49.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.485+0000 7fbc7bfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbc7c09f240 0x7fbc7c1317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47572/0 (socket says 172.21.15.26:47572) 2023-10-01T07:59:49.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.485+0000 7fbc7bfff700 1 -- 172.21.15.26:0/918515130 learned_addr learned my addr 172.21.15.26:0/918515130 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:59:49.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.485+0000 7fbc81777700 1 --2- 172.21.15.26:0/918515130 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc7c09f650 0x7fbc7c131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:49.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.486+0000 7fbc80f76700 1 --2- 172.21.15.26:0/918515130 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc7c09e930 0x7fbc7c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:49.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.486+0000 7fbc81777700 1 -- 172.21.15.26:0/918515130 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc7c09e930 msgr2=0x7fbc7c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:49.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.486+0000 7fbc81777700 1 --2- 172.21.15.26:0/918515130 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc7c09e930 0x7fbc7c09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.486+0000 7fbc81777700 1 -- 172.21.15.26:0/918515130 >> v1:172.21.15.26:6789/0 conn(0x7fbc7c09f240 legacy=0x7fbc7c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:49.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.486+0000 7fbc7b7fe700 1 -- 172.21.15.26:0/918515130 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3116821045 0 0) 0x7fbc7c070940 con 0x7fbc7c09f240 2023-10-01T07:59:49.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.486+0000 7fbc81777700 1 -- 172.21.15.26:0/918515130 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc7c09fb60 con 0x7fbc7c09f650 2023-10-01T07:59:49.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.486+0000 7fbc81777700 1 --2- 172.21.15.26:0/918515130 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc7c09f650 0x7fbc7c131f00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fbc74009dc0 tx=0x7fbc7400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aafccda74a52a3da server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:49.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.486+0000 7fbc7b7fe700 1 -- 172.21.15.26:0/918515130 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7400e070 con 0x7fbc7c09f650 2023-10-01T07:59:49.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.486+0000 7fbc7b7fe700 1 -- 172.21.15.26:0/918515130 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7400bbd0 con 0x7fbc7c09f650 2023-10-01T07:59:49.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.486+0000 7fbc7b7fe700 1 -- 172.21.15.26:0/918515130 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc74012430 con 0x7fbc7c09f650 2023-10-01T07:59:49.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.487+0000 7fbc831da700 1 -- 172.21.15.26:0/918515130 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc7c09f650 msgr2=0x7fbc7c131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:49.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.487+0000 7fbc831da700 1 --2- 172.21.15.26:0/918515130 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc7c09f650 0x7fbc7c131f00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fbc74009dc0 tx=0x7fbc7400b330 comp rx=0 tx=0).stop 2023-10-01T07:59:49.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.487+0000 7fbc831da700 1 -- 172.21.15.26:0/918515130 shutdown_connections 2023-10-01T07:59:49.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.487+0000 7fbc831da700 1 --2- 172.21.15.26:0/918515130 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc7c09e930 0x7fbc7c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.487+0000 7fbc831da700 1 --2- 172.21.15.26:0/918515130 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc7c09f650 0x7fbc7c131f00 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.487+0000 7fbc831da700 1 -- 172.21.15.26:0/918515130 >> 172.21.15.26:0/918515130 conn(0x7fbc7c0a4210 msgr2=0x7fbc7c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:49.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.487+0000 7fbc831da700 1 -- 172.21.15.26:0/918515130 shutdown_connections 2023-10-01T07:59:49.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.487+0000 7fbc831da700 1 -- 172.21.15.26:0/918515130 wait complete. 2023-10-01T07:59:49.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.488+0000 7fbc831da700 1 Processor -- start 2023-10-01T07:59:49.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.488+0000 7fbc831da700 1 -- start start 2023-10-01T07:59:49.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.489+0000 7fbc831da700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc7c09e930 0x7fbc7c1a3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:49.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.489+0000 7fbc831da700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc7c09f240 0x7fbc7c1a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:49.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.489+0000 7fbc831da700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc7c09f650 0x7fbc7c1c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:49.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.489+0000 7fbc831da700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c1a2d60 con 0x7fbc7c09f240 2023-10-01T07:59:49.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.489+0000 7fbc831da700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c1b71e0 con 0x7fbc7c09f650 2023-10-01T07:59:49.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.489+0000 7fbc831da700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c1a6140 con 0x7fbc7c09e930 2023-10-01T07:59:49.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.489+0000 7fbc80f76700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc7c09e930 0x7fbc7c1a3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:49.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.489+0000 7fbc80f76700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc7c09e930 0x7fbc7c1a3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57716/0 (socket says 172.21.15.26:57716) 2023-10-01T07:59:49.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.489+0000 7fbc80f76700 1 -- 172.21.15.26:0/4175169780 learned_addr learned my addr 172.21.15.26:0/4175169780 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:49.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.489+0000 7fbc81777700 1 --2- 172.21.15.26:0/4175169780 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc7c09f650 0x7fbc7c1c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:49.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.489+0000 7fbc7bfff700 1 --2- 172.21.15.26:0/4175169780 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc7c09f240 0x7fbc7c1a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:49.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.490+0000 7fbc81777700 1 -- 172.21.15.26:0/4175169780 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc7c09e930 msgr2=0x7fbc7c1a3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:49.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.490+0000 7fbc81777700 1 --2- 172.21.15.26:0/4175169780 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc7c09e930 0x7fbc7c1a3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.490+0000 7fbc81777700 1 -- 172.21.15.26:0/4175169780 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc7c09f240 msgr2=0x7fbc7c1a3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:49.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.490+0000 7fbc81777700 1 --2- 172.21.15.26:0/4175169780 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc7c09f240 0x7fbc7c1a3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.490+0000 7fbc81777700 1 -- 172.21.15.26:0/4175169780 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc74009a70 con 0x7fbc7c09f650 2023-10-01T07:59:49.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.490+0000 7fbc80f76700 1 --2- 172.21.15.26:0/4175169780 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc7c09e930 0x7fbc7c1a3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:49.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.490+0000 7fbc81777700 1 --2- 172.21.15.26:0/4175169780 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc7c09f650 0x7fbc7c1c5e40 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fbc74016000 tx=0x7fbc74004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:49.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.490+0000 7fbc797fa700 1 -- 172.21.15.26:0/4175169780 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc74004880 con 0x7fbc7c09f650 2023-10-01T07:59:49.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.490+0000 7fbc797fa700 1 -- 172.21.15.26:0/4175169780 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc74020070 con 0x7fbc7c09f650 2023-10-01T07:59:49.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.490+0000 7fbc797fa700 1 -- 172.21.15.26:0/4175169780 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc740276c0 con 0x7fbc7c09f650 2023-10-01T07:59:49.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.491+0000 7fbc831da700 1 -- 172.21.15.26:0/4175169780 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc7c0a0190 con 0x7fbc7c09f650 2023-10-01T07:59:49.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.491+0000 7fbc831da700 1 -- 172.21.15.26:0/4175169780 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc7c1a4a20 con 0x7fbc7c09f650 2023-10-01T07:59:49.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.492+0000 7fbc797fa700 1 -- 172.21.15.26:0/4175169780 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbc74012430 con 0x7fbc7c09f650 2023-10-01T07:59:49.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.492+0000 7fbc797fa700 1 -- 172.21.15.26:0/4175169780 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbc74022070 con 0x7fbc7c09f650 2023-10-01T07:59:49.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.492+0000 7fbc831da700 1 -- 172.21.15.26:0/4175169780 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc7c074ea0 con 0x7fbc7c09f650 2023-10-01T07:59:49.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.497+0000 7fbc797fa700 1 -- 172.21.15.26:0/4175169780 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbc7401b400 con 0x7fbc7c09f650 2023-10-01T07:59:49.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.527+0000 7f474de37700 1 Processor -- start 2023-10-01T07:59:49.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.528+0000 7f474de37700 1 -- start start 2023-10-01T07:59:49.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.528+0000 7f474de37700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f474809d6f0 0x7f474809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:49.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.528+0000 7f474de37700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f474809e000 0x7f4748130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:49.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.528+0000 7f474de37700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f474809f130 con 0x7f474809e410 2023-10-01T07:59:49.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.528+0000 7f474de37700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f474809f520 con 0x7f474809e000 2023-10-01T07:59:49.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.528+0000 7f474de37700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f474809e930 con 0x7f474809d6f0 2023-10-01T07:59:49.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.528+0000 7f47477fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f474809d6f0 0x7f474809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:49.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.528+0000 7f47477fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f474809d6f0 0x7f474809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57724/0 (socket says 172.21.15.26:57724) 2023-10-01T07:59:49.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.528+0000 7f47477fe700 1 -- 172.21.15.26:0/2055059676 learned_addr learned my addr 172.21.15.26:0/2055059676 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:49.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.529+0000 7f4746ffd700 1 --2- 172.21.15.26:0/2055059676 >> v2:172.21.15.26:3300/0 conn(0x7f474809e000 0x7f4748130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:49.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.529+0000 7f47477fe700 1 -- 172.21.15.26:0/2055059676 >> v2:172.21.15.26:3300/0 conn(0x7f474809e000 msgr2=0x7f4748130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:49.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.529+0000 7f47477fe700 1 --2- 172.21.15.26:0/2055059676 >> v2:172.21.15.26:3300/0 conn(0x7f474809e000 0x7f4748130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.529+0000 7f47477fe700 1 -- 172.21.15.26:0/2055059676 >> v1:172.21.15.26:6789/0 conn(0x7f474809e410 legacy=0x7f4748130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:49.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.529+0000 7f47477fe700 1 -- 172.21.15.26:0/2055059676 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f474809b2d0 con 0x7f474809d6f0 2023-10-01T07:59:49.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.529+0000 7f4746ffd700 1 --2- 172.21.15.26:0/2055059676 >> v2:172.21.15.26:3300/0 conn(0x7f474809e000 0x7f4748130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:59:49.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.529+0000 7f47477fe700 1 --2- 172.21.15.26:0/2055059676 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f474809d6f0 0x7f474809dac0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f47380098f0 tx=0x7f4738009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fee8983cb54bbc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:49.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.529+0000 7f47467fc700 1 -- 172.21.15.26:0/2055059676 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4738004230 con 0x7f474809d6f0 2023-10-01T07:59:49.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.529+0000 7f47467fc700 1 -- 172.21.15.26:0/2055059676 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4738004390 con 0x7f474809d6f0 2023-10-01T07:59:49.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.529+0000 7f47467fc700 1 -- 172.21.15.26:0/2055059676 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47380036a0 con 0x7f474809d6f0 2023-10-01T07:59:49.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.530+0000 7f474de37700 1 -- 172.21.15.26:0/2055059676 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f474809d6f0 msgr2=0x7f474809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:49.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.530+0000 7f474de37700 1 --2- 172.21.15.26:0/2055059676 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f474809d6f0 0x7f474809dac0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f47380098f0 tx=0x7f4738009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:49.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.530+0000 7f474de37700 1 -- 172.21.15.26:0/2055059676 shutdown_connections 2023-10-01T07:59:49.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.530+0000 7f474de37700 1 --2- 172.21.15.26:0/2055059676 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f474809d6f0 0x7f474809dac0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.530+0000 7f474de37700 1 --2- 172.21.15.26:0/2055059676 >> v2:172.21.15.26:3300/0 conn(0x7f474809e000 0x7f4748130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.530+0000 7f474de37700 1 -- 172.21.15.26:0/2055059676 >> 172.21.15.26:0/2055059676 conn(0x7f4748066f50 msgr2=0x7f474809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:49.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.530+0000 7f474de37700 1 -- 172.21.15.26:0/2055059676 shutdown_connections 2023-10-01T07:59:49.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.530+0000 7f474de37700 1 -- 172.21.15.26:0/2055059676 wait complete. 2023-10-01T07:59:49.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.531+0000 7f474de37700 1 Processor -- start 2023-10-01T07:59:49.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.531+0000 7f474de37700 1 -- start start 2023-10-01T07:59:49.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.532+0000 7f474de37700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f474809d6f0 0x7f474811e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:49.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.532+0000 7f474de37700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f474809e000 0x7f474811e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:49.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.532+0000 7f474de37700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f474809e410 0x7f474811edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:49.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.532+0000 7f474de37700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47481217f0 con 0x7f474809e000 2023-10-01T07:59:49.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.532+0000 7f474de37700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47480a1d90 con 0x7f474809e410 2023-10-01T07:59:49.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.532+0000 7f474de37700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f474809c700 con 0x7f474809d6f0 2023-10-01T07:59:49.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.532+0000 7f4746ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f474809e000 0x7f474811e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:49.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.532+0000 7f47477fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f474809d6f0 0x7f474811e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:49.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.532+0000 7f4746ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f474809e000 0x7f474811e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57142/0 (socket says 172.21.15.26:57142) 2023-10-01T07:59:49.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.532+0000 7f47477fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f474809d6f0 0x7f474811e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57738/0 (socket says 172.21.15.26:57738) 2023-10-01T07:59:49.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.532+0000 7f4746ffd700 1 -- 172.21.15.26:0/2271924692 learned_addr learned my addr 172.21.15.26:0/2271924692 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:49.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.533+0000 7f4747fff700 1 --2- 172.21.15.26:0/2271924692 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f474809e410 0x7f474811edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:49.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.533+0000 7f47477fe700 1 -- 172.21.15.26:0/2271924692 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f474809e410 msgr2=0x7f474811edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:49.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.533+0000 7f47477fe700 1 --2- 172.21.15.26:0/2271924692 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f474809e410 0x7f474811edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.533+0000 7f47477fe700 1 -- 172.21.15.26:0/2271924692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f474809e000 msgr2=0x7f474811e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:49.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.533+0000 7f47477fe700 1 --2- 172.21.15.26:0/2271924692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f474809e000 0x7f474811e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.533+0000 7f47477fe700 1 -- 172.21.15.26:0/2271924692 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4738009550 con 0x7f474809d6f0 2023-10-01T07:59:49.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.533+0000 7f47477fe700 1 --2- 172.21.15.26:0/2271924692 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f474809d6f0 0x7f474811e340 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f4738015000 tx=0x7f4738004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:49.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.533+0000 7f472ffff700 1 -- 172.21.15.26:0/2271924692 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4738011630 con 0x7f474809d6f0 2023-10-01T07:59:49.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.533+0000 7f472ffff700 1 -- 172.21.15.26:0/2271924692 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47380117b0 con 0x7f474809d6f0 2023-10-01T07:59:49.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.533+0000 7f472ffff700 1 -- 172.21.15.26:0/2271924692 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4738011b60 con 0x7f474809d6f0 2023-10-01T07:59:49.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.534+0000 7f474de37700 1 -- 172.21.15.26:0/2271924692 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4748121440 con 0x7f474809d6f0 2023-10-01T07:59:49.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.534+0000 7f474de37700 1 -- 172.21.15.26:0/2271924692 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4748120750 con 0x7f474809d6f0 2023-10-01T07:59:49.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.535+0000 7f472ffff700 1 -- 172.21.15.26:0/2271924692 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4738021070 con 0x7f474809d6f0 2023-10-01T07:59:49.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.535+0000 7f474de37700 1 -- 172.21.15.26:0/2271924692 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4748074ea0 con 0x7f474809d6f0 2023-10-01T07:59:49.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.535+0000 7f472ffff700 1 -- 172.21.15.26:0/2271924692 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4738040b90 con 0x7f474809d6f0 2023-10-01T07:59:49.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.539+0000 7f15efc9b700 1 Processor -- start 2023-10-01T07:59:49.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.539+0000 7f15efc9b700 1 -- start start 2023-10-01T07:59:49.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.540+0000 7f15efc9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f15e809d6f0 0x7f15e809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:49.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.540+0000 7f15efc9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f15e809e000 0x7f15e81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:49.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.540+0000 7f15efc9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f15e809e410 0x7f15e8133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:49.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.540+0000 7f15efc9b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e806b460 con 0x7f15e809e410 2023-10-01T07:59:49.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.540+0000 7f15efc9b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e809b120 con 0x7f15e809d6f0 2023-10-01T07:59:49.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.540+0000 7f15efc9b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15e809a7e0 con 0x7f15e809e000 2023-10-01T07:59:49.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.540+0000 7f15ed236700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f15e809e000 0x7f15e81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:49.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.540+0000 7f15ed236700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f15e809e000 0x7f15e81339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57742/0 (socket says 172.21.15.26:57742) 2023-10-01T07:59:49.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.540+0000 7f15eda37700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f15e809d6f0 0x7f15e809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:49.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.540+0000 7f15ed236700 1 -- 172.21.15.26:0/3907700554 learned_addr learned my addr 172.21.15.26:0/3907700554 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:49.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.540+0000 7f15ee238700 1 --2- 172.21.15.26:0/3907700554 >> v2:172.21.15.26:3300/0 conn(0x7f15e809e410 0x7f15e8133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:49.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.540+0000 7f15ed236700 1 -- 172.21.15.26:0/3907700554 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f15e809d6f0 msgr2=0x7f15e809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:49.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.540+0000 7f15ed236700 1 --2- 172.21.15.26:0/3907700554 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f15e809d6f0 0x7f15e809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.540+0000 7f15ed236700 1 -- 172.21.15.26:0/3907700554 >> v2:172.21.15.26:3300/0 conn(0x7f15e809e410 msgr2=0x7f15e8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:49.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.540+0000 7f15ed236700 1 --2- 172.21.15.26:0/3907700554 >> v2:172.21.15.26:3300/0 conn(0x7f15e809e410 0x7f15e8133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.540+0000 7f15ed236700 1 -- 172.21.15.26:0/3907700554 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e809a500 con 0x7f15e809e000 2023-10-01T07:59:49.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.541+0000 7f15ed236700 1 --2- 172.21.15.26:0/3907700554 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f15e809e000 0x7f15e81339f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f15d8009920 tx=0x7f15d8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dee024211f4b0b4a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:49.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.542+0000 7f15eca35700 1 -- 172.21.15.26:0/3907700554 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d8011830 con 0x7f15e809e000 2023-10-01T07:59:49.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.542+0000 7f15eca35700 1 -- 172.21.15.26:0/3907700554 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d8011990 con 0x7f15e809e000 2023-10-01T07:59:49.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.542+0000 7f15eca35700 1 -- 172.21.15.26:0/3907700554 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d8011d20 con 0x7f15e809e000 2023-10-01T07:59:49.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.542+0000 7f472ffff700 1 -- 172.21.15.26:0/2271924692 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f473802d3a0 con 0x7f474809d6f0 2023-10-01T07:59:49.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.543+0000 7f15efc9b700 1 -- 172.21.15.26:0/3907700554 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f15e809e000 msgr2=0x7f15e81339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:49.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.543+0000 7f15efc9b700 1 --2- 172.21.15.26:0/3907700554 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f15e809e000 0x7f15e81339f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f15d8009920 tx=0x7f15d8009c30 comp rx=0 tx=0).stop 2023-10-01T07:59:49.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.543+0000 7f15efc9b700 1 -- 172.21.15.26:0/3907700554 shutdown_connections 2023-10-01T07:59:49.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.543+0000 7f15efc9b700 1 --2- 172.21.15.26:0/3907700554 >> v2:172.21.15.26:3300/0 conn(0x7f15e809e410 0x7f15e8133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.543+0000 7f15efc9b700 1 --2- 172.21.15.26:0/3907700554 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f15e809d6f0 0x7f15e809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.543+0000 7f15efc9b700 1 --2- 172.21.15.26:0/3907700554 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f15e809e000 0x7f15e81339f0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.543+0000 7f15efc9b700 1 -- 172.21.15.26:0/3907700554 >> 172.21.15.26:0/3907700554 conn(0x7f15e8066f50 msgr2=0x7f15e809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:49.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.543+0000 7f15efc9b700 1 -- 172.21.15.26:0/3907700554 shutdown_connections 2023-10-01T07:59:49.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.543+0000 7f15efc9b700 1 -- 172.21.15.26:0/3907700554 wait complete. 2023-10-01T07:59:49.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.544+0000 7f15efc9b700 1 Processor -- start 2023-10-01T07:59:49.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.544+0000 7f15efc9b700 1 -- start start 2023-10-01T07:59:49.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.545+0000 7f15efc9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f15e809d6f0 0x7f15e81225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:49.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.545+0000 7f15efc9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f15e809e000 0x7f15e8122ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:49.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.545+0000 7f15efc9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15e809e410 0x7f15e8123020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:49.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.545+0000 7f15efc9b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e8123a00 con 0x7f15e809e410 2023-10-01T07:59:49.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.545+0000 7f15efc9b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e809c710 con 0x7f15e809e000 2023-10-01T07:59:49.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.545+0000 7f15efc9b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15e8124a10 con 0x7f15e809d6f0 2023-10-01T07:59:49.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.545+0000 7f15eda37700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f15e809d6f0 0x7f15e81225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:49.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.545+0000 7f15eda37700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f15e809d6f0 0x7f15e81225a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57756/0 (socket says 172.21.15.26:57756) 2023-10-01T07:59:49.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.545+0000 7f15eda37700 1 -- 172.21.15.26:0/2414756356 learned_addr learned my addr 172.21.15.26:0/2414756356 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:49.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.545+0000 7f15ee238700 1 --2- 172.21.15.26:0/2414756356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15e809e410 0x7f15e8123020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:49.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.546+0000 7f15eda37700 1 -- 172.21.15.26:0/2414756356 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f15e809e000 msgr2=0x7f15e8122ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:49.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.546+0000 7f15eda37700 1 --2- 172.21.15.26:0/2414756356 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f15e809e000 0x7f15e8122ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.546+0000 7f15eda37700 1 -- 172.21.15.26:0/2414756356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15e809e410 msgr2=0x7f15e8123020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:49.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.546+0000 7f15eda37700 1 --2- 172.21.15.26:0/2414756356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15e809e410 0x7f15e8123020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.546+0000 7f15eda37700 1 -- 172.21.15.26:0/2414756356 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d8009550 con 0x7f15e809d6f0 2023-10-01T07:59:49.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.546+0000 7f15eda37700 1 --2- 172.21.15.26:0/2414756356 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f15e809d6f0 0x7f15e81225a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f15e400e9e0 tx=0x7f15e400ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:49.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.546+0000 7f15de7fc700 1 -- 172.21.15.26:0/2414756356 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e4009710 con 0x7f15e809d6f0 2023-10-01T07:59:49.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.546+0000 7f15de7fc700 1 -- 172.21.15.26:0/2414756356 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e400c850 con 0x7f15e809d6f0 2023-10-01T07:59:49.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.546+0000 7f15de7fc700 1 -- 172.21.15.26:0/2414756356 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e400cbc0 con 0x7f15e809d6f0 2023-10-01T07:59:49.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.546+0000 7f15efc9b700 1 -- 172.21.15.26:0/2414756356 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e81241b0 con 0x7f15e809d6f0 2023-10-01T07:59:49.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.546+0000 7f15efc9b700 1 -- 172.21.15.26:0/2414756356 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e81334f0 con 0x7f15e809d6f0 2023-10-01T07:59:49.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.547+0000 7f15de7fc700 1 -- 172.21.15.26:0/2414756356 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f15e400cd20 con 0x7f15e809d6f0 2023-10-01T07:59:49.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.547+0000 7f15de7fc700 1 -- 172.21.15.26:0/2414756356 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f15e403fb30 con 0x7f15e809d6f0 2023-10-01T07:59:49.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.548+0000 7f15efc9b700 1 -- 172.21.15.26:0/2414756356 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15e8074ea0 con 0x7f15e809d6f0 2023-10-01T07:59:49.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.557+0000 7f15de7fc700 1 -- 172.21.15.26:0/2414756356 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f15e4017080 con 0x7f15e809d6f0 2023-10-01T07:59:49.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.622+0000 7f69ea504700 1 -- 172.21.15.26:0/3693145727 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f69c4005590 con 0x7f69e406f5d0 2023-10-01T07:59:49.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.622+0000 7f69e0ff9700 1 -- 172.21.15.26:0/3693145727 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f69d4011360 con 0x7f69e406f5d0 2023-10-01T07:59:49.623 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:49.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.626+0000 7f69ea504700 1 -- 172.21.15.26:0/3693145727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69e406f5d0 msgr2=0x7f69e41c8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:49.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.626+0000 7f69ea504700 1 --2- 172.21.15.26:0/3693145727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69e406f5d0 0x7f69e41c8770 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f69d400c780 tx=0x7f69d400ca90 comp rx=0 tx=0).stop 2023-10-01T07:59:49.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.626+0000 7f69ea504700 1 -- 172.21.15.26:0/3693145727 shutdown_connections 2023-10-01T07:59:49.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.626+0000 7f69ea504700 1 --2- 172.21.15.26:0/3693145727 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f69e4135c20 0x7f69e41c4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.626+0000 7f69ea504700 1 --2- 172.21.15.26:0/3693145727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69e406f5d0 0x7f69e41c8770 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.626+0000 7f69ea504700 1 --2- 172.21.15.26:0/3693145727 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69e412cf60 0x7f69e41c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.626+0000 7f69ea504700 1 -- 172.21.15.26:0/3693145727 >> 172.21.15.26:0/3693145727 conn(0x7f69e40a2aa0 msgr2=0x7f69e406e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:49.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.626+0000 7f69ea504700 1 -- 172.21.15.26:0/3693145727 shutdown_connections 2023-10-01T07:59:49.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.626+0000 7f69ea504700 1 -- 172.21.15.26:0/3693145727 wait complete. 2023-10-01T07:59:49.646 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:49.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.731+0000 7fbc831da700 1 -- 172.21.15.26:0/4175169780 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbc7c06b250 con 0x7fbc7c09f650 2023-10-01T07:59:49.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.731+0000 7fbc797fa700 1 -- 172.21.15.26:0/4175169780 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbc740263e0 con 0x7fbc7c09f650 2023-10-01T07:59:49.732 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:49.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.734+0000 7fbc831da700 1 -- 172.21.15.26:0/4175169780 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc7c09f650 msgr2=0x7fbc7c1c5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:49.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.734+0000 7fbc831da700 1 --2- 172.21.15.26:0/4175169780 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc7c09f650 0x7fbc7c1c5e40 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fbc74016000 tx=0x7fbc74004ad0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.734+0000 7fbc831da700 1 -- 172.21.15.26:0/4175169780 shutdown_connections 2023-10-01T07:59:49.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.734+0000 7fbc831da700 1 --2- 172.21.15.26:0/4175169780 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc7c09f650 0x7fbc7c1c5e40 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.734+0000 7fbc831da700 1 --2- 172.21.15.26:0/4175169780 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc7c09e930 0x7fbc7c1a3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.734+0000 7fbc831da700 1 --2- 172.21.15.26:0/4175169780 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc7c09f240 0x7fbc7c1a3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.734+0000 7fbc831da700 1 -- 172.21.15.26:0/4175169780 >> 172.21.15.26:0/4175169780 conn(0x7fbc7c0a4210 msgr2=0x7fbc7c09bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:49.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.734+0000 7fbc831da700 1 -- 172.21.15.26:0/4175169780 shutdown_connections 2023-10-01T07:59:49.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.734+0000 7fbc831da700 1 -- 172.21.15.26:0/4175169780 wait complete. 2023-10-01T07:59:49.748 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:49.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.763+0000 7f474de37700 1 -- 172.21.15.26:0/2271924692 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f47481215d0 con 0x7f474809d6f0 2023-10-01T07:59:49.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.763+0000 7f472ffff700 1 -- 172.21.15.26:0/2271924692 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4738029030 con 0x7f474809d6f0 2023-10-01T07:59:49.764 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:49.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.765+0000 7f474de37700 1 -- 172.21.15.26:0/2271924692 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f474809d6f0 msgr2=0x7f474811e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:49.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.765+0000 7f474de37700 1 --2- 172.21.15.26:0/2271924692 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f474809d6f0 0x7f474811e340 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f4738015000 tx=0x7f4738004750 comp rx=0 tx=0).stop 2023-10-01T07:59:49.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.766+0000 7f474de37700 1 -- 172.21.15.26:0/2271924692 shutdown_connections 2023-10-01T07:59:49.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.766+0000 7f474de37700 1 --2- 172.21.15.26:0/2271924692 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f474809e410 0x7f474811edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.766+0000 7f474de37700 1 --2- 172.21.15.26:0/2271924692 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f474809d6f0 0x7f474811e340 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.766+0000 7f474de37700 1 --2- 172.21.15.26:0/2271924692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f474809e000 0x7f474811e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.766+0000 7f474de37700 1 -- 172.21.15.26:0/2271924692 >> 172.21.15.26:0/2271924692 conn(0x7f4748066f50 msgr2=0x7f474806f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:49.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.766+0000 7f474de37700 1 -- 172.21.15.26:0/2271924692 shutdown_connections 2023-10-01T07:59:49.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.766+0000 7f474de37700 1 -- 172.21.15.26:0/2271924692 wait complete. 2023-10-01T07:59:49.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.771+0000 7f15efc9b700 1 -- 172.21.15.26:0/2414756356 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f15e806c360 con 0x7f15e809d6f0 2023-10-01T07:59:49.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.771+0000 7f15de7fc700 1 -- 172.21.15.26:0/2414756356 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f15e401ab10 con 0x7f15e809d6f0 2023-10-01T07:59:49.772 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:49.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.774+0000 7f15efc9b700 1 -- 172.21.15.26:0/2414756356 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f15e809d6f0 msgr2=0x7f15e81225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:49.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.774+0000 7f15efc9b700 1 --2- 172.21.15.26:0/2414756356 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f15e809d6f0 0x7f15e81225a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f15e400e9e0 tx=0x7f15e400ecf0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.774+0000 7f15efc9b700 1 -- 172.21.15.26:0/2414756356 shutdown_connections 2023-10-01T07:59:49.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.774+0000 7f15efc9b700 1 --2- 172.21.15.26:0/2414756356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15e809e410 0x7f15e8123020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.774+0000 7f15efc9b700 1 --2- 172.21.15.26:0/2414756356 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f15e809d6f0 0x7f15e81225a0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.774+0000 7f15efc9b700 1 --2- 172.21.15.26:0/2414756356 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f15e809e000 0x7f15e8122ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:49.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.774+0000 7f15efc9b700 1 -- 172.21.15.26:0/2414756356 >> 172.21.15.26:0/2414756356 conn(0x7f15e8066f50 msgr2=0x7f15e80a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:49.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.774+0000 7f15efc9b700 1 -- 172.21.15.26:0/2414756356 shutdown_connections 2023-10-01T07:59:49.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:49.774+0000 7f15efc9b700 1 -- 172.21.15.26:0/2414756356 wait complete. 2023-10-01T07:59:49.781 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:49.789 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:50.647 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:50.749 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:50.783 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:50.790 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:50.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.794+0000 7f6608e99700 1 Processor -- start 2023-10-01T07:59:50.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.794+0000 7f6608e99700 1 -- start start 2023-10-01T07:59:50.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.795+0000 7f6608e99700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f660406a770 0x7f660406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:50.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.795+0000 7f6608e99700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f660406b080 0x7f6604131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:50.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.795+0000 7f6608e99700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6604131b40 0x7f6604131fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:50.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.795+0000 7f6608e99700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f660409ece0 con 0x7f6604131b40 2023-10-01T07:59:50.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.795+0000 7f6608e99700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f660409e760 con 0x7f660406a770 2023-10-01T07:59:50.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.795+0000 7f6608e99700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f660409e040 con 0x7f660406b080 2023-10-01T07:59:50.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.795+0000 7f660259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f660406a770 0x7f660406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:50.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.795+0000 7f660259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f660406a770 0x7f660406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44002/0 (socket says 172.21.15.26:44002) 2023-10-01T07:59:50.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.795+0000 7f660259c700 1 -- 172.21.15.26:0/468812120 learned_addr learned my addr 172.21.15.26:0/468812120 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:50.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.795+0000 7f6602d9d700 1 --2- 172.21.15.26:0/468812120 >> v2:172.21.15.26:3300/0 conn(0x7f6604131b40 0x7f6604131fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:50.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.795+0000 7f660259c700 1 -- 172.21.15.26:0/468812120 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f660406b080 msgr2=0x7f6604131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:50.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.795+0000 7f660259c700 1 --2- 172.21.15.26:0/468812120 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f660406b080 0x7f6604131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:50.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.795+0000 7f660259c700 1 -- 172.21.15.26:0/468812120 >> v2:172.21.15.26:3300/0 conn(0x7f6604131b40 msgr2=0x7f6604131fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:50.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.795+0000 7f660259c700 1 --2- 172.21.15.26:0/468812120 >> v2:172.21.15.26:3300/0 conn(0x7f6604131b40 0x7f6604131fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:50.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.795+0000 7f660259c700 1 -- 172.21.15.26:0/468812120 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f660409f630 con 0x7f660406a770 2023-10-01T07:59:50.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.796+0000 7f660259c700 1 --2- 172.21.15.26:0/468812120 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f660406a770 0x7f660406ab40 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f65f40098f0 tx=0x7f65f4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1fde6964069723 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:50.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.796+0000 7f660159a700 1 -- 172.21.15.26:0/468812120 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f4011830 con 0x7f660406a770 2023-10-01T07:59:50.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.796+0000 7f660159a700 1 -- 172.21.15.26:0/468812120 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f4011990 con 0x7f660406a770 2023-10-01T07:59:50.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.796+0000 7f660159a700 1 -- 172.21.15.26:0/468812120 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f4011d20 con 0x7f660406a770 2023-10-01T07:59:50.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.797+0000 7f6608e99700 1 -- 172.21.15.26:0/468812120 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f660406a770 msgr2=0x7f660406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:50.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.797+0000 7f6608e99700 1 --2- 172.21.15.26:0/468812120 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f660406a770 0x7f660406ab40 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f65f40098f0 tx=0x7f65f4009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:50.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.797+0000 7f6608e99700 1 -- 172.21.15.26:0/468812120 shutdown_connections 2023-10-01T07:59:50.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.797+0000 7f6608e99700 1 --2- 172.21.15.26:0/468812120 >> v2:172.21.15.26:3300/0 conn(0x7f6604131b40 0x7f6604131fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:50.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.797+0000 7f6608e99700 1 --2- 172.21.15.26:0/468812120 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f660406a770 0x7f660406ab40 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:50.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.797+0000 7f6608e99700 1 --2- 172.21.15.26:0/468812120 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f660406b080 0x7f6604131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:50.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.797+0000 7f6608e99700 1 -- 172.21.15.26:0/468812120 >> 172.21.15.26:0/468812120 conn(0x7f6604066f50 msgr2=0x7f660409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:50.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.797+0000 7f6608e99700 1 -- 172.21.15.26:0/468812120 shutdown_connections 2023-10-01T07:59:50.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.797+0000 7f6608e99700 1 -- 172.21.15.26:0/468812120 wait complete. 2023-10-01T07:59:50.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.799+0000 7f6608e99700 1 Processor -- start 2023-10-01T07:59:50.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.799+0000 7f6608e99700 1 -- start start 2023-10-01T07:59:50.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.799+0000 7f6608e99700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f660406a770 0x7f66041c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:50.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.799+0000 7f6608e99700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f660406b080 0x7f66041c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:50.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.799+0000 7f6608e99700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6604131b40 0x7f660409a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:50.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.799+0000 7f6608e99700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6604126a70 con 0x7f660406a770 2023-10-01T07:59:50.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.799+0000 7f6608e99700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6604125c40 con 0x7f660406b080 2023-10-01T07:59:50.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.799+0000 7f6608e99700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66040a38f0 con 0x7f6604131b40 2023-10-01T07:59:50.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.800+0000 7f660259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f660406a770 0x7f66041c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:50.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.800+0000 7f660259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f660406a770 0x7f66041c8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57172/0 (socket says 172.21.15.26:57172) 2023-10-01T07:59:50.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.800+0000 7f660259c700 1 -- 172.21.15.26:0/3157500907 learned_addr learned my addr 172.21.15.26:0/3157500907 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:50.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.800+0000 7f6602d9d700 1 --2- 172.21.15.26:0/3157500907 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6604131b40 0x7f660409a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:50.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.800+0000 7f6601d9b700 1 --2- 172.21.15.26:0/3157500907 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f660406b080 0x7f66041c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:50.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.800+0000 7f660259c700 1 -- 172.21.15.26:0/3157500907 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6604131b40 msgr2=0x7f660409a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:50.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.800+0000 7f660259c700 1 --2- 172.21.15.26:0/3157500907 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6604131b40 0x7f660409a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:50.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.800+0000 7f660259c700 1 -- 172.21.15.26:0/3157500907 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f660406b080 msgr2=0x7f66041c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:50.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.800+0000 7f660259c700 1 --2- 172.21.15.26:0/3157500907 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f660406b080 0x7f66041c8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:50.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.800+0000 7f660259c700 1 -- 172.21.15.26:0/3157500907 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f4009550 con 0x7f660406a770 2023-10-01T07:59:50.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.800+0000 7f6602d9d700 1 --2- 172.21.15.26:0/3157500907 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6604131b40 0x7f660409a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:50.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.801+0000 7f660259c700 1 --2- 172.21.15.26:0/3157500907 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f660406a770 0x7f66041c8720 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f65f4000c00 tx=0x7f65f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:50.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.801+0000 7f65f2ffd700 1 -- 172.21.15.26:0/3157500907 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f4004300 con 0x7f660406a770 2023-10-01T07:59:50.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.801+0000 7f65f2ffd700 1 -- 172.21.15.26:0/3157500907 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f401f070 con 0x7f660406a770 2023-10-01T07:59:50.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.801+0000 7f65f2ffd700 1 -- 172.21.15.26:0/3157500907 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f40036a0 con 0x7f660406a770 2023-10-01T07:59:50.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.801+0000 7f6608e99700 1 -- 172.21.15.26:0/3157500907 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f660409bfc0 con 0x7f660406a770 2023-10-01T07:59:50.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.801+0000 7f6608e99700 1 -- 172.21.15.26:0/3157500907 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66041258f0 con 0x7f660406a770 2023-10-01T07:59:50.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.803+0000 7f6608e99700 1 -- 172.21.15.26:0/3157500907 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6604131330 con 0x7f660406a770 2023-10-01T07:59:50.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.804+0000 7f65f2ffd700 1 -- 172.21.15.26:0/3157500907 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f65f4021030 con 0x7f660406a770 2023-10-01T07:59:50.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.804+0000 7f65f2ffd700 1 -- 172.21.15.26:0/3157500907 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f65f4040c40 con 0x7f660406a770 2023-10-01T07:59:50.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.809+0000 7f65f2ffd700 1 -- 172.21.15.26:0/3157500907 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f65f40199a0 con 0x7f660406a770 2023-10-01T07:59:50.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.898+0000 7f609e3ae700 1 Processor -- start 2023-10-01T07:59:50.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.898+0000 7f609e3ae700 1 -- start start 2023-10-01T07:59:50.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.899+0000 7f609e3ae700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6098133a80 0x7f6098133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:50.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.899+0000 7f609e3ae700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6098130a70 0x7f609813b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:50.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.899+0000 7f609e3ae700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f609806bc00 con 0x7f609812ff20 2023-10-01T07:59:50.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.899+0000 7f609e3ae700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f609806c570 con 0x7f6098133a80 2023-10-01T07:59:50.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.899+0000 7f609e3ae700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60980a0040 con 0x7f6098130a70 2023-10-01T07:59:50.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.899+0000 7f609c94b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6098130a70 0x7f609813b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:50.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.899+0000 7f6097fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6098133a80 0x7f6098133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:50.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.899+0000 7f60977fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f609812ff20 0x7f6098130360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47588/0 (socket says 172.21.15.26:47588) 2023-10-01T07:59:50.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.899+0000 7f60977fe700 1 -- 172.21.15.26:0/2121057780 learned_addr learned my addr 172.21.15.26:0/2121057780 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:59:50.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.899+0000 7f6096ffd700 1 -- 172.21.15.26:0/2121057780 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2554324457 0 0) 0x7f609806bc00 con 0x7f609812ff20 2023-10-01T07:59:50.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.899+0000 7f6096ffd700 1 -- 172.21.15.26:0/2121057780 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60800035b0 con 0x7f609812ff20 2023-10-01T07:59:50.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.899+0000 7f609c94b700 1 -- 172.21.15.26:0/2121057780 >> v2:172.21.15.26:3300/0 conn(0x7f6098133a80 msgr2=0x7f6098133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:50.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.899+0000 7f609c94b700 1 --2- 172.21.15.26:0/2121057780 >> v2:172.21.15.26:3300/0 conn(0x7f6098133a80 0x7f6098133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:50.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.900+0000 7f609c94b700 1 -- 172.21.15.26:0/2121057780 >> v1:172.21.15.26:6789/0 conn(0x7f609812ff20 legacy=0x7f6098130360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:50.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.900+0000 7f609c94b700 1 -- 172.21.15.26:0/2121057780 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6098133860 con 0x7f6098130a70 2023-10-01T07:59:50.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.900+0000 7f609c94b700 1 --2- 172.21.15.26:0/2121057780 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6098130a70 0x7f609813b850 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f6090009d90 tx=0x7f609000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=277dc8f9c834706d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:50.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.900+0000 7f6096ffd700 1 -- 172.21.15.26:0/2121057780 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609000e070 con 0x7f6098130a70 2023-10-01T07:59:50.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.900+0000 7f6096ffd700 1 -- 172.21.15.26:0/2121057780 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609000bb20 con 0x7f6098130a70 2023-10-01T07:59:50.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.900+0000 7f6096ffd700 1 -- 172.21.15.26:0/2121057780 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6090012430 con 0x7f6098130a70 2023-10-01T07:59:50.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.901+0000 7f609e3ae700 1 -- 172.21.15.26:0/2121057780 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6098130a70 msgr2=0x7f609813b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:50.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.901+0000 7f609e3ae700 1 --2- 172.21.15.26:0/2121057780 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6098130a70 0x7f609813b850 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f6090009d90 tx=0x7f609000b330 comp rx=0 tx=0).stop 2023-10-01T07:59:50.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.901+0000 7f609e3ae700 1 -- 172.21.15.26:0/2121057780 shutdown_connections 2023-10-01T07:59:50.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.901+0000 7f609e3ae700 1 --2- 172.21.15.26:0/2121057780 >> v2:172.21.15.26:3300/0 conn(0x7f6098133a80 0x7f6098133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:50.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.901+0000 7f609e3ae700 1 --2- 172.21.15.26:0/2121057780 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6098130a70 0x7f609813b850 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:50.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.901+0000 7f609e3ae700 1 -- 172.21.15.26:0/2121057780 >> 172.21.15.26:0/2121057780 conn(0x7f60980a4210 msgr2=0x7f60980a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:50.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.901+0000 7f609e3ae700 1 -- 172.21.15.26:0/2121057780 shutdown_connections 2023-10-01T07:59:50.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.901+0000 7f609e3ae700 1 -- 172.21.15.26:0/2121057780 wait complete. 2023-10-01T07:59:50.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.902+0000 7f609e3ae700 1 Processor -- start 2023-10-01T07:59:50.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.903+0000 7f609e3ae700 1 -- start start 2023-10-01T07:59:50.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.903+0000 7f609e3ae700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f609812ff20 0x7f60980709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:50.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.903+0000 7f609e3ae700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6098130a70 0x7f6098070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:50.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.903+0000 7f609e3ae700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6098133a80 0x7f6098071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:50.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.903+0000 7f609e3ae700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6098120280 con 0x7f6098133a80 2023-10-01T07:59:50.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.903+0000 7f609e3ae700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609811ff00 con 0x7f6098130a70 2023-10-01T07:59:50.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.903+0000 7f609e3ae700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6098072140 con 0x7f609812ff20 2023-10-01T07:59:50.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.903+0000 7f60977fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6098130a70 0x7f6098070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:50.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.903+0000 7f6097fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f609812ff20 0x7f60980709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:50.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.903+0000 7f60977fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6098130a70 0x7f6098070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44024/0 (socket says 172.21.15.26:44024) 2023-10-01T07:59:50.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.903+0000 7f60977fe700 1 -- 172.21.15.26:0/4116945359 learned_addr learned my addr 172.21.15.26:0/4116945359 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:50.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.903+0000 7f609c94b700 1 --2- 172.21.15.26:0/4116945359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6098133a80 0x7f6098071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:50.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.904+0000 7f60977fe700 1 -- 172.21.15.26:0/4116945359 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f609812ff20 msgr2=0x7f60980709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:50.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.904+0000 7f60977fe700 1 --2- 172.21.15.26:0/4116945359 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f609812ff20 0x7f60980709a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:50.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.904+0000 7f60977fe700 1 -- 172.21.15.26:0/4116945359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6098133a80 msgr2=0x7f6098071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:50.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.904+0000 7f60977fe700 1 --2- 172.21.15.26:0/4116945359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6098133a80 0x7f6098071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:50.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.904+0000 7f60977fe700 1 -- 172.21.15.26:0/4116945359 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6090009a70 con 0x7f6098130a70 2023-10-01T07:59:50.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.904+0000 7f60977fe700 1 --2- 172.21.15.26:0/4116945359 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6098130a70 0x7f6098070ee0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f608c00c700 tx=0x7f608c00ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:50.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.904+0000 7f6094ff9700 1 -- 172.21.15.26:0/4116945359 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c005d70 con 0x7f6098130a70 2023-10-01T07:59:50.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.904+0000 7f6094ff9700 1 -- 172.21.15.26:0/4116945359 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608c0070d0 con 0x7f6098130a70 2023-10-01T07:59:50.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.904+0000 7f609e3ae700 1 -- 172.21.15.26:0/4116945359 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60980a2050 con 0x7f6098130a70 2023-10-01T07:59:50.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.904+0000 7f609e3ae700 1 -- 172.21.15.26:0/4116945359 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609811fb60 con 0x7f6098130a70 2023-10-01T07:59:50.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.904+0000 7f6094ff9700 1 -- 172.21.15.26:0/4116945359 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c007460 con 0x7f6098130a70 2023-10-01T07:59:50.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.905+0000 7f6094ff9700 1 -- 172.21.15.26:0/4116945359 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f608c0075c0 con 0x7f6098130a70 2023-10-01T07:59:50.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.906+0000 7f609e3ae700 1 -- 172.21.15.26:0/4116945359 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60780052e0 con 0x7f6098130a70 2023-10-01T07:59:50.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.906+0000 7f6094ff9700 1 -- 172.21.15.26:0/4116945359 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f608c011e50 con 0x7f6098130a70 2023-10-01T07:59:50.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.915+0000 7f6094ff9700 1 -- 172.21.15.26:0/4116945359 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f608c017070 con 0x7f6098130a70 2023-10-01T07:59:50.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.938+0000 7fc47201c700 1 Processor -- start 2023-10-01T07:59:50.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.938+0000 7fc47201c700 1 -- start start 2023-10-01T07:59:50.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.939+0000 7fc47201c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc46c06c0e0 0x7fc46c09ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:50.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.939+0000 7fc47201c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc46c134ec0 0x7fc46c1379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:50.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.939+0000 7fc47201c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc46c134980 con 0x7fc46c137f20 2023-10-01T07:59:50.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.939+0000 7fc47201c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc46c06c4b0 con 0x7fc46c06c0e0 2023-10-01T07:59:50.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.939+0000 7fc47201c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc46c0a09c0 con 0x7fc46c134ec0 2023-10-01T07:59:50.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.939+0000 7fc46affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc46c134ec0 0x7fc46c1379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:50.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.939+0000 7fc46affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc46c134ec0 0x7fc46c1379e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57782/0 (socket says 172.21.15.26:57782) 2023-10-01T07:59:50.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.939+0000 7fc46affd700 1 -- 172.21.15.26:0/56615374 learned_addr learned my addr 172.21.15.26:0/56615374 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:50.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.939+0000 7fc46bfff700 1 --1- 172.21.15.26:0/56615374 >> v1:172.21.15.26:6789/0 conn(0x7fc46c137f20 0x7fc46c13ed10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47600/0 (socket says 172.21.15.26:47600) 2023-10-01T07:59:50.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.939+0000 7fc46b7fe700 1 --2- 172.21.15.26:0/56615374 >> v2:172.21.15.26:3300/0 conn(0x7fc46c06c0e0 0x7fc46c09ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:50.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.939+0000 7fc46affd700 1 -- 172.21.15.26:0/56615374 >> v2:172.21.15.26:3300/0 conn(0x7fc46c06c0e0 msgr2=0x7fc46c09ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:50.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.939+0000 7fc46affd700 1 --2- 172.21.15.26:0/56615374 >> v2:172.21.15.26:3300/0 conn(0x7fc46c06c0e0 0x7fc46c09ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:50.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.939+0000 7fc46affd700 1 -- 172.21.15.26:0/56615374 >> v1:172.21.15.26:6789/0 conn(0x7fc46c137f20 legacy=0x7fc46c13ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:50.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.939+0000 7fc46affd700 1 -- 172.21.15.26:0/56615374 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc46c0a0600 con 0x7fc46c134ec0 2023-10-01T07:59:50.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.940+0000 7fc46affd700 1 --2- 172.21.15.26:0/56615374 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc46c134ec0 0x7fc46c1379e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc4600098f0 tx=0x7fc460009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c5f96101d6e3e37 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:50.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.940+0000 7fc46a7fc700 1 -- 172.21.15.26:0/56615374 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc460011830 con 0x7fc46c134ec0 2023-10-01T07:59:50.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.940+0000 7fc46a7fc700 1 -- 172.21.15.26:0/56615374 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc460011990 con 0x7fc46c134ec0 2023-10-01T07:59:50.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.940+0000 7fc46a7fc700 1 -- 172.21.15.26:0/56615374 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc460011d20 con 0x7fc46c134ec0 2023-10-01T07:59:50.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.940+0000 7fc47201c700 1 -- 172.21.15.26:0/56615374 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc46c134ec0 msgr2=0x7fc46c1379e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:50.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.940+0000 7fc47201c700 1 --2- 172.21.15.26:0/56615374 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc46c134ec0 0x7fc46c1379e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc4600098f0 tx=0x7fc460009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:50.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.941+0000 7fc47201c700 1 -- 172.21.15.26:0/56615374 shutdown_connections 2023-10-01T07:59:50.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.941+0000 7fc47201c700 1 --2- 172.21.15.26:0/56615374 >> v2:172.21.15.26:3300/0 conn(0x7fc46c06c0e0 0x7fc46c09ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:50.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.941+0000 7fc47201c700 1 --2- 172.21.15.26:0/56615374 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc46c134ec0 0x7fc46c1379e0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:50.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.941+0000 7fc47201c700 1 -- 172.21.15.26:0/56615374 >> 172.21.15.26:0/56615374 conn(0x7fc46c0a4210 msgr2=0x7fc46c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:50.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.941+0000 7fc47201c700 1 -- 172.21.15.26:0/56615374 shutdown_connections 2023-10-01T07:59:50.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.941+0000 7fc47201c700 1 -- 172.21.15.26:0/56615374 wait complete. 2023-10-01T07:59:50.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.942+0000 7fc47201c700 1 Processor -- start 2023-10-01T07:59:50.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.942+0000 7fc47201c700 1 -- start start 2023-10-01T07:59:50.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.942+0000 7fc47201c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc46c06c0e0 0x7fc46c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:50.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.942+0000 7fc47201c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc46c134ec0 0x7fc46c133f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:50.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.942+0000 7fc47201c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc46c137f20 0x7fc46c132280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:50.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.942+0000 7fc47201c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46c11c440 con 0x7fc46c137f20 2023-10-01T07:59:50.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.942+0000 7fc47201c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc46c11c250 con 0x7fc46c134ec0 2023-10-01T07:59:50.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.942+0000 7fc47201c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc46c0a03f0 con 0x7fc46c06c0e0 2023-10-01T07:59:50.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.942+0000 7fc46b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc46c06c0e0 0x7fc46c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:50.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.942+0000 7fc46b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc46c06c0e0 0x7fc46c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57788/0 (socket says 172.21.15.26:57788) 2023-10-01T07:59:50.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.942+0000 7fc46b7fe700 1 -- 172.21.15.26:0/2864716981 learned_addr learned my addr 172.21.15.26:0/2864716981 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:50.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.942+0000 7fc46affd700 1 --2- 172.21.15.26:0/2864716981 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc46c134ec0 0x7fc46c133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:50.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.943+0000 7fc46affd700 1 -- 172.21.15.26:0/2864716981 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc46c06c0e0 msgr2=0x7fc46c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:50.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.943+0000 7fc46affd700 1 --2- 172.21.15.26:0/2864716981 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc46c06c0e0 0x7fc46c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:50.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.943+0000 7fc46affd700 1 -- 172.21.15.26:0/2864716981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc46c137f20 msgr2=0x7fc46c132280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:50.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.943+0000 7fc46affd700 1 --2- 172.21.15.26:0/2864716981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc46c137f20 0x7fc46c132280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:50.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.943+0000 7fc46affd700 1 -- 172.21.15.26:0/2864716981 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc460009550 con 0x7fc46c134ec0 2023-10-01T07:59:50.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.943+0000 7fc46b7fe700 1 --2- 172.21.15.26:0/2864716981 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc46c06c0e0 0x7fc46c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:50.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.943+0000 7f41c4a77700 1 Processor -- start 2023-10-01T07:59:50.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.943+0000 7fc46affd700 1 --2- 172.21.15.26:0/2864716981 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc46c134ec0 0x7fc46c133f30 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fc46c09fe90 tx=0x7fc460004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:50.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.943+0000 7fc453fff700 1 -- 172.21.15.26:0/2864716981 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc460004480 con 0x7fc46c134ec0 2023-10-01T07:59:50.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.943+0000 7fc453fff700 1 -- 172.21.15.26:0/2864716981 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc46001f070 con 0x7fc46c134ec0 2023-10-01T07:59:50.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.943+0000 7fc453fff700 1 -- 172.21.15.26:0/2864716981 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4600038e0 con 0x7fc46c134ec0 2023-10-01T07:59:50.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.944+0000 7fc47201c700 1 -- 172.21.15.26:0/2864716981 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc46c11e160 con 0x7fc46c134ec0 2023-10-01T07:59:50.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.944+0000 7fc47201c700 1 -- 172.21.15.26:0/2864716981 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc46c11de80 con 0x7fc46c134ec0 2023-10-01T07:59:50.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.943+0000 7f41c4a77700 1 -- start start 2023-10-01T07:59:50.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.944+0000 7f41c4a77700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f41c012cf60 0x7f41c006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:50.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.944+0000 7f41c4a77700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41c0130430 0x7f41c0137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:50.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.944+0000 7f41c4a77700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41c012cd90 con 0x7f41c012f8b0 2023-10-01T07:59:50.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.944+0000 7f41c4a77700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c012d330 con 0x7f41c012cf60 2023-10-01T07:59:50.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.944+0000 7f41c4a77700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c0071780 con 0x7f41c0130430 2023-10-01T07:59:50.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.944+0000 7f41be59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f41c012cf60 0x7f41c006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:50.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.944+0000 7f41be59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f41c012cf60 0x7f41c006f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57220/0 (socket says 172.21.15.26:57220) 2023-10-01T07:59:50.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.944+0000 7f41be59c700 1 -- 172.21.15.26:0/2421123874 learned_addr learned my addr 172.21.15.26:0/2421123874 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:50.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.945+0000 7f41be59c700 1 -- 172.21.15.26:0/2421123874 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41c0130430 msgr2=0x7f41c0137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:50.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.945+0000 7f41be59c700 1 --2- 172.21.15.26:0/2421123874 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41c0130430 0x7f41c0137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:50.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.945+0000 7f41be59c700 1 -- 172.21.15.26:0/2421123874 >> v1:172.21.15.26:6789/0 conn(0x7f41c012f8b0 legacy=0x7f41c012fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:50.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.945+0000 7f41be59c700 1 -- 172.21.15.26:0/2421123874 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c0071a40 con 0x7f41c012cf60 2023-10-01T07:59:50.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.945+0000 7f41be59c700 1 --2- 172.21.15.26:0/2421123874 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41c012cf60 0x7f41c006f5d0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f41b400bb90 tx=0x7f41b400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d11605f9356f8bef server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:50.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.945+0000 7fc47201c700 1 -- 172.21.15.26:0/2864716981 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc46c074ea0 con 0x7fc46c134ec0 2023-10-01T07:59:50.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.945+0000 7fc453fff700 1 -- 172.21.15.26:0/2864716981 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc460021030 con 0x7fc46c134ec0 2023-10-01T07:59:50.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.945+0000 7f41bd59a700 1 -- 172.21.15.26:0/2421123874 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b400dc40 con 0x7f41c012cf60 2023-10-01T07:59:50.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.945+0000 7fc453fff700 1 -- 172.21.15.26:0/2864716981 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc460040a70 con 0x7fc46c134ec0 2023-10-01T07:59:50.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.945+0000 7f41bd59a700 1 -- 172.21.15.26:0/2421123874 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b400dda0 con 0x7f41c012cf60 2023-10-01T07:59:50.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.945+0000 7f41bd59a700 1 -- 172.21.15.26:0/2421123874 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b4017630 con 0x7f41c012cf60 2023-10-01T07:59:50.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.947+0000 7f41c4a77700 1 -- 172.21.15.26:0/2421123874 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41c012cf60 msgr2=0x7f41c006f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:50.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.947+0000 7f41c4a77700 1 --2- 172.21.15.26:0/2421123874 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41c012cf60 0x7f41c006f5d0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f41b400bb90 tx=0x7f41b400bea0 comp rx=0 tx=0).stop 2023-10-01T07:59:50.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.947+0000 7f41c4a77700 1 -- 172.21.15.26:0/2421123874 shutdown_connections 2023-10-01T07:59:50.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.947+0000 7f41c4a77700 1 --2- 172.21.15.26:0/2421123874 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41c012cf60 0x7f41c006f5d0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:50.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.947+0000 7f41c4a77700 1 --2- 172.21.15.26:0/2421123874 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41c0130430 0x7f41c0137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:50.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.947+0000 7f41c4a77700 1 -- 172.21.15.26:0/2421123874 >> 172.21.15.26:0/2421123874 conn(0x7f41c00a2aa0 msgr2=0x7f41c00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:50.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.947+0000 7f41c4a77700 1 -- 172.21.15.26:0/2421123874 shutdown_connections 2023-10-01T07:59:50.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.947+0000 7f41c4a77700 1 -- 172.21.15.26:0/2421123874 wait complete. 2023-10-01T07:59:50.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.948+0000 7f41c4a77700 1 Processor -- start 2023-10-01T07:59:50.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.948+0000 7f41c4a77700 1 -- start start 2023-10-01T07:59:50.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.948+0000 7f41c4a77700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41c012cf60 0x7f41c009b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:50.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.948+0000 7f41c4a77700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41c012f8b0 0x7f41c009b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:50.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.949+0000 7f41c4a77700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41c0130430 0x7f41c009be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:50.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.949+0000 7f41c4a77700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c009e740 con 0x7f41c012f8b0 2023-10-01T07:59:50.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.949+0000 7f41c4a77700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c011d390 con 0x7f41c012cf60 2023-10-01T07:59:50.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.949+0000 7f41c4a77700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41c009d5b0 con 0x7f41c0130430 2023-10-01T07:59:50.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.949+0000 7f41bdd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41c012f8b0 0x7f41c009b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:50.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.949+0000 7f41bed9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41c0130430 0x7f41c009be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:50.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.949+0000 7f41bdd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41c012f8b0 0x7f41c009b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57230/0 (socket says 172.21.15.26:57230) 2023-10-01T07:59:50.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.949+0000 7f41bed9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41c0130430 0x7f41c009be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57804/0 (socket says 172.21.15.26:57804) 2023-10-01T07:59:50.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.949+0000 7f41bdd9b700 1 -- 172.21.15.26:0/3384860478 learned_addr learned my addr 172.21.15.26:0/3384860478 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:50.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.949+0000 7f41bdd9b700 1 -- 172.21.15.26:0/3384860478 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41c0130430 msgr2=0x7f41c009be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:50.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.949+0000 7f41bdd9b700 1 --2- 172.21.15.26:0/3384860478 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41c0130430 0x7f41c009be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:50.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.949+0000 7f41bdd9b700 1 -- 172.21.15.26:0/3384860478 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41c012cf60 msgr2=0x7f41c009b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:50.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.949+0000 7f41bdd9b700 1 --2- 172.21.15.26:0/3384860478 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41c012cf60 0x7f41c009b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:50.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.949+0000 7f41bdd9b700 1 -- 172.21.15.26:0/3384860478 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b400b7f0 con 0x7f41c012f8b0 2023-10-01T07:59:50.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.949+0000 7f41bdd9b700 1 --2- 172.21.15.26:0/3384860478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41c012f8b0 0x7f41c009b940 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f41b000c510 tx=0x7f41b000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:50.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.949+0000 7f41aeffd700 1 -- 172.21.15.26:0/3384860478 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b00052d0 con 0x7f41c012f8b0 2023-10-01T07:59:50.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.950+0000 7f41aeffd700 1 -- 172.21.15.26:0/3384860478 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b0005430 con 0x7f41c012f8b0 2023-10-01T07:59:50.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.950+0000 7f41c4a77700 1 -- 172.21.15.26:0/3384860478 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c012f490 con 0x7f41c012f8b0 2023-10-01T07:59:50.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.950+0000 7f41aeffd700 1 -- 172.21.15.26:0/3384860478 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b00038c0 con 0x7f41c012f8b0 2023-10-01T07:59:50.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.950+0000 7f41c4a77700 1 -- 172.21.15.26:0/3384860478 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c009d7f0 con 0x7f41c012f8b0 2023-10-01T07:59:50.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.951+0000 7f41c4a77700 1 -- 172.21.15.26:0/3384860478 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41c009e8b0 con 0x7f41c012f8b0 2023-10-01T07:59:50.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.951+0000 7f41aeffd700 1 -- 172.21.15.26:0/3384860478 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f41b0003a20 con 0x7f41c012f8b0 2023-10-01T07:59:50.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.951+0000 7f41aeffd700 1 -- 172.21.15.26:0/3384860478 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f41b003ecb0 con 0x7f41c012f8b0 2023-10-01T07:59:50.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.955+0000 7fc453fff700 1 -- 172.21.15.26:0/2864716981 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc460015070 con 0x7fc46c134ec0 2023-10-01T07:59:50.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:50.960+0000 7f41aeffd700 1 -- 172.21.15.26:0/3384860478 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f41b0011590 con 0x7f41c012f8b0 2023-10-01T07:59:51.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.032+0000 7f6608e99700 1 -- 172.21.15.26:0/3157500907 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6604074ea0 con 0x7f660406a770 2023-10-01T07:59:51.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.032+0000 7f65f2ffd700 1 -- 172.21.15.26:0/3157500907 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f65f4015070 con 0x7f660406a770 2023-10-01T07:59:51.033 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:51.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.038+0000 7f6608e99700 1 -- 172.21.15.26:0/3157500907 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f660406a770 msgr2=0x7f66041c8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:51.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.038+0000 7f6608e99700 1 --2- 172.21.15.26:0/3157500907 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f660406a770 0x7f66041c8720 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f65f4000c00 tx=0x7f65f4004750 comp rx=0 tx=0).stop 2023-10-01T07:59:51.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.039+0000 7f6608e99700 1 -- 172.21.15.26:0/3157500907 shutdown_connections 2023-10-01T07:59:51.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.039+0000 7f6608e99700 1 --2- 172.21.15.26:0/3157500907 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6604131b40 0x7f660409a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:51.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.039+0000 7f6608e99700 1 --2- 172.21.15.26:0/3157500907 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f660406a770 0x7f66041c8720 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:51.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.039+0000 7f6608e99700 1 --2- 172.21.15.26:0/3157500907 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f660406b080 0x7f66041c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:51.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.039+0000 7f6608e99700 1 -- 172.21.15.26:0/3157500907 >> 172.21.15.26:0/3157500907 conn(0x7f6604066f50 msgr2=0x7f66040715f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:51.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.039+0000 7f6608e99700 1 -- 172.21.15.26:0/3157500907 shutdown_connections 2023-10-01T07:59:51.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.039+0000 7f6608e99700 1 -- 172.21.15.26:0/3157500907 wait complete. 2023-10-01T07:59:51.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:51.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.133+0000 7f609e3ae700 1 -- 172.21.15.26:0/4116945359 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6078005590 con 0x7f6098130a70 2023-10-01T07:59:51.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.134+0000 7f6094ff9700 1 -- 172.21.15.26:0/4116945359 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f608c017030 con 0x7f6098130a70 2023-10-01T07:59:51.134 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:51.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.136+0000 7f609e3ae700 1 -- 172.21.15.26:0/4116945359 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6098130a70 msgr2=0x7f6098070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:51.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.136+0000 7f609e3ae700 1 --2- 172.21.15.26:0/4116945359 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6098130a70 0x7f6098070ee0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f608c00c700 tx=0x7f608c00ca10 comp rx=0 tx=0).stop 2023-10-01T07:59:51.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.136+0000 7f609e3ae700 1 -- 172.21.15.26:0/4116945359 shutdown_connections 2023-10-01T07:59:51.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.136+0000 7f609e3ae700 1 --2- 172.21.15.26:0/4116945359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6098133a80 0x7f6098071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:51.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.136+0000 7f609e3ae700 1 --2- 172.21.15.26:0/4116945359 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f609812ff20 0x7f60980709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:51.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.136+0000 7f609e3ae700 1 --2- 172.21.15.26:0/4116945359 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6098130a70 0x7f6098070ee0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:51.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.136+0000 7f609e3ae700 1 -- 172.21.15.26:0/4116945359 >> 172.21.15.26:0/4116945359 conn(0x7f60980a4210 msgr2=0x7f609809e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:51.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.136+0000 7f609e3ae700 1 -- 172.21.15.26:0/4116945359 shutdown_connections 2023-10-01T07:59:51.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.136+0000 7f609e3ae700 1 -- 172.21.15.26:0/4116945359 wait complete. 2023-10-01T07:59:51.151 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:51.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.164+0000 7fc47201c700 1 -- 172.21.15.26:0/2864716981 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc46c11dc50 con 0x7fc46c134ec0 2023-10-01T07:59:51.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.164+0000 7fc453fff700 1 -- 172.21.15.26:0/2864716981 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc46001a450 con 0x7fc46c134ec0 2023-10-01T07:59:51.165 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:51.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.167+0000 7fc47201c700 1 -- 172.21.15.26:0/2864716981 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc46c134ec0 msgr2=0x7fc46c133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:51.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.167+0000 7fc47201c700 1 --2- 172.21.15.26:0/2864716981 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc46c134ec0 0x7fc46c133f30 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fc46c09fe90 tx=0x7fc460004750 comp rx=0 tx=0).stop 2023-10-01T07:59:51.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.167+0000 7fc47201c700 1 -- 172.21.15.26:0/2864716981 shutdown_connections 2023-10-01T07:59:51.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.167+0000 7fc47201c700 1 --2- 172.21.15.26:0/2864716981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc46c137f20 0x7fc46c132280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:51.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.167+0000 7fc47201c700 1 --2- 172.21.15.26:0/2864716981 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc46c06c0e0 0x7fc46c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:51.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.167+0000 7fc47201c700 1 --2- 172.21.15.26:0/2864716981 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc46c134ec0 0x7fc46c133f30 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:51.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.167+0000 7fc47201c700 1 -- 172.21.15.26:0/2864716981 >> 172.21.15.26:0/2864716981 conn(0x7fc46c0a4210 msgr2=0x7fc46c06c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:51.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.167+0000 7fc47201c700 1 -- 172.21.15.26:0/2864716981 shutdown_connections 2023-10-01T07:59:51.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.167+0000 7fc47201c700 1 -- 172.21.15.26:0/2864716981 wait complete. 2023-10-01T07:59:51.181 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:51.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.181+0000 7f41c4a77700 1 -- 172.21.15.26:0/3384860478 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f41c009e8b0 con 0x7f41c012f8b0 2023-10-01T07:59:51.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.182+0000 7f41aeffd700 1 -- 172.21.15.26:0/3384860478 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f41c009e8b0 con 0x7f41c012f8b0 2023-10-01T07:59:51.182 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:51.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.184+0000 7f41c4a77700 1 -- 172.21.15.26:0/3384860478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41c012f8b0 msgr2=0x7f41c009b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:51.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.184+0000 7f41c4a77700 1 --2- 172.21.15.26:0/3384860478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41c012f8b0 0x7f41c009b940 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f41b000c510 tx=0x7f41b000c820 comp rx=0 tx=0).stop 2023-10-01T07:59:51.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.184+0000 7f41c4a77700 1 -- 172.21.15.26:0/3384860478 shutdown_connections 2023-10-01T07:59:51.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.184+0000 7f41c4a77700 1 --2- 172.21.15.26:0/3384860478 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41c0130430 0x7f41c009be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:51.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.184+0000 7f41c4a77700 1 --2- 172.21.15.26:0/3384860478 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41c012cf60 0x7f41c009b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:51.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.184+0000 7f41c4a77700 1 --2- 172.21.15.26:0/3384860478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41c012f8b0 0x7f41c009b940 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:51.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.184+0000 7f41c4a77700 1 -- 172.21.15.26:0/3384860478 >> 172.21.15.26:0/3384860478 conn(0x7f41c00a2aa0 msgr2=0x7f41c006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:51.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.184+0000 7f41c4a77700 1 -- 172.21.15.26:0/3384860478 shutdown_connections 2023-10-01T07:59:51.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:51.184+0000 7f41c4a77700 1 -- 172.21.15.26:0/3384860478 wait complete. 2023-10-01T07:59:51.198 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:52.059 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:52.152 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:52.182 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:52.199 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:52.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.206+0000 7f8e9720e700 1 Processor -- start 2023-10-01T07:59:52.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.206+0000 7f8e9720e700 1 -- start start 2023-10-01T07:59:52.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.207+0000 7f8e9720e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e90130670 0x7f8e90130a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:52.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.207+0000 7f8e9720e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e900701a0 0x7f8e90138540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:52.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.207+0000 7f8e9720e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e90130260 con 0x7f8e9006f680 2023-10-01T07:59:52.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.207+0000 7f8e9720e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9009a350 con 0x7f8e90130670 2023-10-01T07:59:52.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.207+0000 7f8e9720e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e90071ff0 con 0x7f8e900701a0 2023-10-01T07:59:52.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.207+0000 7f8e8ffff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8e9006f680 0x7f8e9006fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47618/0 (socket says 172.21.15.26:47618) 2023-10-01T07:59:52.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.207+0000 7f8e8ffff700 1 -- 172.21.15.26:0/136316795 learned_addr learned my addr 172.21.15.26:0/136316795 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:59:52.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.207+0000 7f8e94faa700 1 --2- 172.21.15.26:0/136316795 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e90130670 0x7f8e90130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:52.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.207+0000 7f8e957ab700 1 --2- 172.21.15.26:0/136316795 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e900701a0 0x7f8e90138540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:52.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.208+0000 7f8e8f7fe700 1 -- 172.21.15.26:0/136316795 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3905046407 0 0) 0x7f8e90130260 con 0x7f8e9006f680 2023-10-01T07:59:52.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.208+0000 7f8e8f7fe700 1 -- 172.21.15.26:0/136316795 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e800035b0 con 0x7f8e9006f680 2023-10-01T07:59:52.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.208+0000 7f8e94faa700 1 -- 172.21.15.26:0/136316795 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e900701a0 msgr2=0x7f8e90138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:52.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.208+0000 7f8e94faa700 1 --2- 172.21.15.26:0/136316795 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e900701a0 0x7f8e90138540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.208+0000 7f8e94faa700 1 -- 172.21.15.26:0/136316795 >> v1:172.21.15.26:6789/0 conn(0x7f8e9006f680 legacy=0x7f8e9006fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:52.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.208+0000 7f8e94faa700 1 -- 172.21.15.26:0/136316795 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9009ecf0 con 0x7f8e90130670 2023-10-01T07:59:52.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.208+0000 7f8e957ab700 1 --2- 172.21.15.26:0/136316795 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e900701a0 0x7f8e90138540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:52.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.208+0000 7f8e94faa700 1 --2- 172.21.15.26:0/136316795 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e90130670 0x7f8e90130a40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f8e84009870 tx=0x7f8e84009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38f51e6de56dd385 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:52.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.208+0000 7f8e8f7fe700 1 -- 172.21.15.26:0/136316795 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e84011830 con 0x7f8e90130670 2023-10-01T07:59:52.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.208+0000 7f8e8f7fe700 1 -- 172.21.15.26:0/136316795 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e84011990 con 0x7f8e90130670 2023-10-01T07:59:52.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.208+0000 7f8e8f7fe700 1 -- 172.21.15.26:0/136316795 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e84011d20 con 0x7f8e90130670 2023-10-01T07:59:52.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.209+0000 7f8e9720e700 1 -- 172.21.15.26:0/136316795 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e90130670 msgr2=0x7f8e90130a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:52.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.209+0000 7f8e9720e700 1 --2- 172.21.15.26:0/136316795 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e90130670 0x7f8e90130a40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f8e84009870 tx=0x7f8e84009b80 comp rx=0 tx=0).stop 2023-10-01T07:59:52.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.210+0000 7f8e9720e700 1 -- 172.21.15.26:0/136316795 shutdown_connections 2023-10-01T07:59:52.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.210+0000 7f8e9720e700 1 --2- 172.21.15.26:0/136316795 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e900701a0 0x7f8e90138540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.210+0000 7f8e9720e700 1 --2- 172.21.15.26:0/136316795 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e90130670 0x7f8e90130a40 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.210+0000 7f8e9720e700 1 -- 172.21.15.26:0/136316795 >> 172.21.15.26:0/136316795 conn(0x7f8e900a2aa0 msgr2=0x7f8e900a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:52.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.210+0000 7f8e9720e700 1 -- 172.21.15.26:0/136316795 shutdown_connections 2023-10-01T07:59:52.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.210+0000 7f8e9720e700 1 -- 172.21.15.26:0/136316795 wait complete. 2023-10-01T07:59:52.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.211+0000 7f8e9720e700 1 Processor -- start 2023-10-01T07:59:52.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.211+0000 7f8e9720e700 1 -- start start 2023-10-01T07:59:52.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.211+0000 7f8e9720e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e9006f680 0x7f8e9011c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:52.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.211+0000 7f8e9720e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e900701a0 0x7f8e9011cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:52.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.211+0000 7f8e9720e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e90130670 0x7f8e9011d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:52.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.211+0000 7f8e9720e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e90120320 con 0x7f8e9006f680 2023-10-01T07:59:52.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.211+0000 7f8e9720e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9012dc90 con 0x7f8e900701a0 2023-10-01T07:59:52.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.211+0000 7f8e9720e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9009fa60 con 0x7f8e90130670 2023-10-01T07:59:52.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.212+0000 7f8e8ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e900701a0 0x7f8e9011cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:52.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.212+0000 7f8e94faa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e9006f680 0x7f8e9011c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:52.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.212+0000 7f8e8ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e900701a0 0x7f8e9011cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44076/0 (socket says 172.21.15.26:44076) 2023-10-01T07:59:52.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.212+0000 7f8e94faa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e9006f680 0x7f8e9011c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57232/0 (socket says 172.21.15.26:57232) 2023-10-01T07:59:52.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.212+0000 7f8e8ffff700 1 -- 172.21.15.26:0/537979176 learned_addr learned my addr 172.21.15.26:0/537979176 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:52.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.212+0000 7f8e957ab700 1 --2- 172.21.15.26:0/537979176 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e90130670 0x7f8e9011d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:52.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.212+0000 7f8e94faa700 1 -- 172.21.15.26:0/537979176 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e90130670 msgr2=0x7f8e9011d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:52.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.212+0000 7f8e94faa700 1 --2- 172.21.15.26:0/537979176 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e90130670 0x7f8e9011d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.212+0000 7f8e94faa700 1 -- 172.21.15.26:0/537979176 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e900701a0 msgr2=0x7f8e9011cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:52.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.212+0000 7f8e94faa700 1 --2- 172.21.15.26:0/537979176 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e900701a0 0x7f8e9011cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.212+0000 7f8e94faa700 1 -- 172.21.15.26:0/537979176 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e88009a70 con 0x7f8e9006f680 2023-10-01T07:59:52.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.212+0000 7f8e8ffff700 1 --2- 172.21.15.26:0/537979176 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e900701a0 0x7f8e9011cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:52.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.212+0000 7f8e94faa700 1 --2- 172.21.15.26:0/537979176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e9006f680 0x7f8e9011c800 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f8e84009870 tx=0x7f8e84004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:52.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.212+0000 7f8e8d7fa700 1 -- 172.21.15.26:0/537979176 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e84004510 con 0x7f8e9006f680 2023-10-01T07:59:52.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.213+0000 7f8e8d7fa700 1 -- 172.21.15.26:0/537979176 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e840036a0 con 0x7f8e9006f680 2023-10-01T07:59:52.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.213+0000 7f8e9720e700 1 -- 172.21.15.26:0/537979176 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e840094a0 con 0x7f8e9006f680 2023-10-01T07:59:52.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.213+0000 7f8e8d7fa700 1 -- 172.21.15.26:0/537979176 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e84003a50 con 0x7f8e9006f680 2023-10-01T07:59:52.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.213+0000 7f8e9720e700 1 -- 172.21.15.26:0/537979176 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e90120ab0 con 0x7f8e9006f680 2023-10-01T07:59:52.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.213+0000 7f8e8d7fa700 1 -- 172.21.15.26:0/537979176 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e84003bb0 con 0x7f8e9006f680 2023-10-01T07:59:52.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.214+0000 7f8e8d7fa700 1 -- 172.21.15.26:0/537979176 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8e84040990 con 0x7f8e9006f680 2023-10-01T07:59:52.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.214+0000 7f8e9720e700 1 -- 172.21.15.26:0/537979176 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e90074ea0 con 0x7f8e9006f680 2023-10-01T07:59:52.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.219+0000 7f8e8d7fa700 1 -- 172.21.15.26:0/537979176 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e8401a420 con 0x7f8e9006f680 2023-10-01T07:59:52.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.304+0000 7fdae8bc2700 1 Processor -- start 2023-10-01T07:59:52.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.304+0000 7fdae8bc2700 1 -- start start 2023-10-01T07:59:52.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.305+0000 7fdae8bc2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdae409e1d0 0x7fdae4135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:52.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.305+0000 7fdae8bc2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdae4135e50 0x7fdae4138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:52.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.305+0000 7fdae8bc2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae409f130 con 0x7fdae409d6f0 2023-10-01T07:59:52.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.305+0000 7fdae8bc2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae409f520 con 0x7fdae4135e50 2023-10-01T07:59:52.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.305+0000 7fdae8bc2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdae409e930 con 0x7fdae409e1d0 2023-10-01T07:59:52.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.305+0000 7fdae2d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdae4135e50 0x7fdae4138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:52.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.305+0000 7fdae2d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdae4135e50 0x7fdae4138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44086/0 (socket says 172.21.15.26:44086) 2023-10-01T07:59:52.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.305+0000 7fdae2d9d700 1 -- 172.21.15.26:0/2455006997 learned_addr learned my addr 172.21.15.26:0/2455006997 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:52.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.305+0000 7fdae1d9b700 1 --2- 172.21.15.26:0/2455006997 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdae409e1d0 0x7fdae4135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:52.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.306+0000 7fdae2d9d700 1 -- 172.21.15.26:0/2455006997 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdae409e1d0 msgr2=0x7fdae4135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:52.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.306+0000 7fdae2d9d700 1 --2- 172.21.15.26:0/2455006997 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdae409e1d0 0x7fdae4135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.306+0000 7fdae2d9d700 1 -- 172.21.15.26:0/2455006997 >> v1:172.21.15.26:6789/0 conn(0x7fdae409d6f0 legacy=0x7fdae409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:52.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.306+0000 7fdae2d9d700 1 -- 172.21.15.26:0/2455006997 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae409b2d0 con 0x7fdae4135e50 2023-10-01T07:59:52.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.306+0000 7fdae1d9b700 1 --2- 172.21.15.26:0/2455006997 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdae409e1d0 0x7fdae4135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:52.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.306+0000 7fdae2d9d700 1 --2- 172.21.15.26:0/2455006997 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdae4135e50 0x7fdae4138230 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fdadc009e80 tx=0x7fdadc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f29d51e6a28a51f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:52.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.306+0000 7fdae159a700 1 -- 172.21.15.26:0/2455006997 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdadc00e070 con 0x7fdae4135e50 2023-10-01T07:59:52.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.306+0000 7fdae159a700 1 -- 172.21.15.26:0/2455006997 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdadc00b910 con 0x7fdae4135e50 2023-10-01T07:59:52.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.306+0000 7fdae159a700 1 -- 172.21.15.26:0/2455006997 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdadc00bcc0 con 0x7fdae4135e50 2023-10-01T07:59:52.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.307+0000 7fdae8bc2700 1 -- 172.21.15.26:0/2455006997 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdae4135e50 msgr2=0x7fdae4138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:52.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.307+0000 7fdae8bc2700 1 --2- 172.21.15.26:0/2455006997 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdae4135e50 0x7fdae4138230 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fdadc009e80 tx=0x7fdadc00b330 comp rx=0 tx=0).stop 2023-10-01T07:59:52.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.307+0000 7fdae8bc2700 1 -- 172.21.15.26:0/2455006997 shutdown_connections 2023-10-01T07:59:52.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.307+0000 7fdae8bc2700 1 --2- 172.21.15.26:0/2455006997 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdae4135e50 0x7fdae4138230 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.307+0000 7fdae8bc2700 1 --2- 172.21.15.26:0/2455006997 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdae409e1d0 0x7fdae4135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.307+0000 7fdae8bc2700 1 -- 172.21.15.26:0/2455006997 >> 172.21.15.26:0/2455006997 conn(0x7fdae4066f50 msgr2=0x7fdae409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:52.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.307+0000 7fdae8bc2700 1 -- 172.21.15.26:0/2455006997 shutdown_connections 2023-10-01T07:59:52.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.307+0000 7fdae8bc2700 1 -- 172.21.15.26:0/2455006997 wait complete. 2023-10-01T07:59:52.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.309+0000 7fdae8bc2700 1 Processor -- start 2023-10-01T07:59:52.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.309+0000 7fdae8bc2700 1 -- start start 2023-10-01T07:59:52.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.310+0000 7fdae8bc2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdae409d6f0 0x7fdae41c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:52.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.310+0000 7fdae8bc2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdae409e1d0 0x7fdae41c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:52.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.310+0000 7fdae8bc2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdae4135e50 0x7fdae41260a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:52.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.310+0000 7fdae8bc2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae41c9fb0 con 0x7fdae409e1d0 2023-10-01T07:59:52.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.310+0000 7fdae8bc2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae41c9120 con 0x7fdae409d6f0 2023-10-01T07:59:52.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.310+0000 7fdae8bc2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdae409c700 con 0x7fdae4135e50 2023-10-01T07:59:52.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.310+0000 7fdae259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdae409d6f0 0x7fdae41c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:52.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.310+0000 7fdae2d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdae4135e50 0x7fdae41260a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:52.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.310+0000 7fdae2d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdae4135e50 0x7fdae41260a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57838/0 (socket says 172.21.15.26:57838) 2023-10-01T07:59:52.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.310+0000 7fdae259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdae409d6f0 0x7fdae41c9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44094/0 (socket says 172.21.15.26:44094) 2023-10-01T07:59:52.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.310+0000 7fdae2d9d700 1 -- 172.21.15.26:0/1348033573 learned_addr learned my addr 172.21.15.26:0/1348033573 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:52.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.310+0000 7fdae1d9b700 1 --2- 172.21.15.26:0/1348033573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdae409e1d0 0x7fdae41c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:52.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.311+0000 7fdae2d9d700 1 -- 172.21.15.26:0/1348033573 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdae409d6f0 msgr2=0x7fdae41c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:52.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.311+0000 7fdae2d9d700 1 --2- 172.21.15.26:0/1348033573 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdae409d6f0 0x7fdae41c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.311+0000 7fdae2d9d700 1 -- 172.21.15.26:0/1348033573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdae409e1d0 msgr2=0x7fdae41c9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:52.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.311+0000 7fdae2d9d700 1 --2- 172.21.15.26:0/1348033573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdae409e1d0 0x7fdae41c9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.311+0000 7fdae2d9d700 1 -- 172.21.15.26:0/1348033573 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad80094a0 con 0x7fdae4135e50 2023-10-01T07:59:52.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.311+0000 7fdae259c700 1 --2- 172.21.15.26:0/1348033573 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdae409d6f0 0x7fdae41c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:52.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.311+0000 7fdae2d9d700 1 --2- 172.21.15.26:0/1348033573 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdae4135e50 0x7fdae41260a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fdadc012000 tx=0x7fdadc004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:52.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.311+0000 7fdad2ffd700 1 -- 172.21.15.26:0/1348033573 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdadc004450 con 0x7fdae4135e50 2023-10-01T07:59:52.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.311+0000 7fdad2ffd700 1 -- 172.21.15.26:0/1348033573 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdadc0092e0 con 0x7fdae4135e50 2023-10-01T07:59:52.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.311+0000 7fdae8bc2700 1 -- 172.21.15.26:0/1348033573 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdadc009b30 con 0x7fdae4135e50 2023-10-01T07:59:52.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.311+0000 7fdad2ffd700 1 -- 172.21.15.26:0/1348033573 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdadc004830 con 0x7fdae4135e50 2023-10-01T07:59:52.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.311+0000 7fdae8bc2700 1 -- 172.21.15.26:0/1348033573 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae411ce80 con 0x7fdae4135e50 2023-10-01T07:59:52.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.312+0000 7fdad2ffd700 1 -- 172.21.15.26:0/1348033573 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdadc01c410 con 0x7fdae4135e50 2023-10-01T07:59:52.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.312+0000 7fdae8bc2700 1 -- 172.21.15.26:0/1348033573 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae4074ea0 con 0x7fdae4135e50 2023-10-01T07:59:52.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.313+0000 7fdad2ffd700 1 -- 172.21.15.26:0/1348033573 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdadc041260 con 0x7fdae4135e50 2023-10-01T07:59:52.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.318+0000 7fdad2ffd700 1 -- 172.21.15.26:0/1348033573 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdadc01bb90 con 0x7fdae4135e50 2023-10-01T07:59:52.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.343+0000 7fac19349700 1 Processor -- start 2023-10-01T07:59:52.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.343+0000 7fac19349700 1 -- start start 2023-10-01T07:59:52.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.344+0000 7fac19349700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac141338c0 0x7fac14133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:52.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.344+0000 7fac19349700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fac141341d0 0x7fac1409de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:52.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.344+0000 7fac19349700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac1409e390 0x7fac1409e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:52.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.344+0000 7fac19349700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac14070c80 con 0x7fac141341d0 2023-10-01T07:59:52.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.344+0000 7fac19349700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac1409ed20 con 0x7fac1409e390 2023-10-01T07:59:52.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.344+0000 7fac19349700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac1406f720 con 0x7fac141338c0 2023-10-01T07:59:52.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.344+0000 7fac127fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fac141341d0 0x7fac1409de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:52.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.344+0000 7fac127fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fac141341d0 0x7fac1409de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57252/0 (socket says 172.21.15.26:57252) 2023-10-01T07:59:52.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.344+0000 7fac127fc700 1 -- 172.21.15.26:0/2252740986 learned_addr learned my addr 172.21.15.26:0/2252740986 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:52.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.345+0000 7fac12ffd700 1 --2- 172.21.15.26:0/2252740986 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac141338c0 0x7fac14133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:52.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.345+0000 7fac127fc700 1 -- 172.21.15.26:0/2252740986 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac141338c0 msgr2=0x7fac14133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:52.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.345+0000 7fac127fc700 1 --2- 172.21.15.26:0/2252740986 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac141338c0 0x7fac14133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.345+0000 7fac127fc700 1 -- 172.21.15.26:0/2252740986 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac1409e390 msgr2=0x7fac1409e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:52.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.345+0000 7fac127fc700 1 --2- 172.21.15.26:0/2252740986 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac1409e390 0x7fac1409e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.345+0000 7fac127fc700 1 -- 172.21.15.26:0/2252740986 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac1406fce0 con 0x7fac141341d0 2023-10-01T07:59:52.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.346+0000 7fac127fc700 1 --2- 172.21.15.26:0/2252740986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac141341d0 0x7fac1409de50 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fac080098f0 tx=0x7fac08009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f61f79b3435335 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:52.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.346+0000 7fac11ffb700 1 -- 172.21.15.26:0/2252740986 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac08011830 con 0x7fac141341d0 2023-10-01T07:59:52.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.346+0000 7fac11ffb700 1 -- 172.21.15.26:0/2252740986 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac08011990 con 0x7fac141341d0 2023-10-01T07:59:52.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.346+0000 7fac11ffb700 1 -- 172.21.15.26:0/2252740986 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac08011d20 con 0x7fac141341d0 2023-10-01T07:59:52.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.347+0000 7fac19349700 1 -- 172.21.15.26:0/2252740986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac141341d0 msgr2=0x7fac1409de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:52.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.347+0000 7fac19349700 1 --2- 172.21.15.26:0/2252740986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac141341d0 0x7fac1409de50 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fac080098f0 tx=0x7fac08009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:52.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.347+0000 7fac19349700 1 -- 172.21.15.26:0/2252740986 shutdown_connections 2023-10-01T07:59:52.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.347+0000 7fac19349700 1 --2- 172.21.15.26:0/2252740986 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac1409e390 0x7fac1409e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.347+0000 7fac19349700 1 --2- 172.21.15.26:0/2252740986 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac141338c0 0x7fac14133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.347+0000 7fac19349700 1 --2- 172.21.15.26:0/2252740986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac141341d0 0x7fac1409de50 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.347+0000 7fac19349700 1 -- 172.21.15.26:0/2252740986 >> 172.21.15.26:0/2252740986 conn(0x7fac140a2aa0 msgr2=0x7fac140a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:52.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.347+0000 7fac19349700 1 -- 172.21.15.26:0/2252740986 shutdown_connections 2023-10-01T07:59:52.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.347+0000 7fac19349700 1 -- 172.21.15.26:0/2252740986 wait complete. 2023-10-01T07:59:52.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.349+0000 7fac19349700 1 Processor -- start 2023-10-01T07:59:52.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.349+0000 7fac19349700 1 -- start start 2023-10-01T07:59:52.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.350+0000 7fac19349700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac1409e390 0x7fac1409b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:52.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.350+0000 7fac19349700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac141338c0 0x7fac1409be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:52.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.350+0000 7fac19349700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac141341d0 0x7fac1409c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:52.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.350+0000 7fac19349700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac14122b90 con 0x7fac141338c0 2023-10-01T07:59:52.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.350+0000 7fac19349700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac14122de0 con 0x7fac141341d0 2023-10-01T07:59:52.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.350+0000 7fac19349700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac141224e0 con 0x7fac1409e390 2023-10-01T07:59:52.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.350+0000 7fac127fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac141338c0 0x7fac1409be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:52.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.350+0000 7fac127fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac141338c0 0x7fac1409be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57262/0 (socket says 172.21.15.26:57262) 2023-10-01T07:59:52.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.350+0000 7fac127fc700 1 -- 172.21.15.26:0/508584891 learned_addr learned my addr 172.21.15.26:0/508584891 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:52.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.350+0000 7fac127fc700 1 -- 172.21.15.26:0/508584891 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac1409e390 msgr2=0x7fac1409b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:52.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.350+0000 7fac127fc700 1 --2- 172.21.15.26:0/508584891 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac1409e390 0x7fac1409b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.350+0000 7fac127fc700 1 -- 172.21.15.26:0/508584891 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac141341d0 msgr2=0x7fac1409c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:52.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.350+0000 7fac127fc700 1 --2- 172.21.15.26:0/508584891 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac141341d0 0x7fac1409c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.350+0000 7fac127fc700 1 -- 172.21.15.26:0/508584891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac08009550 con 0x7fac141338c0 2023-10-01T07:59:52.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.351+0000 7fac127fc700 1 --2- 172.21.15.26:0/508584891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac141338c0 0x7fac1409be30 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fac08013000 tx=0x7fac08004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:52.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.351+0000 7fabfb7fe700 1 -- 172.21.15.26:0/508584891 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac08004510 con 0x7fac141338c0 2023-10-01T07:59:52.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.351+0000 7fabfb7fe700 1 -- 172.21.15.26:0/508584891 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac080036a0 con 0x7fac141338c0 2023-10-01T07:59:52.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.351+0000 7fabfb7fe700 1 -- 172.21.15.26:0/508584891 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac08003a30 con 0x7fac141338c0 2023-10-01T07:59:52.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.352+0000 7fac19349700 1 -- 172.21.15.26:0/508584891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac1409d470 con 0x7fac141338c0 2023-10-01T07:59:52.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.352+0000 7fac19349700 1 -- 172.21.15.26:0/508584891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac14130d60 con 0x7fac141338c0 2023-10-01T07:59:52.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.352+0000 7fabfb7fe700 1 -- 172.21.15.26:0/508584891 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fac08003b90 con 0x7fac141338c0 2023-10-01T07:59:52.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.352+0000 7fac19349700 1 -- 172.21.15.26:0/508584891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac14074ea0 con 0x7fac141338c0 2023-10-01T07:59:52.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.353+0000 7fabfb7fe700 1 -- 172.21.15.26:0/508584891 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fac0801a7a0 con 0x7fac141338c0 2023-10-01T07:59:52.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.358+0000 7fabfb7fe700 1 -- 172.21.15.26:0/508584891 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fac08015020 con 0x7fac141338c0 2023-10-01T07:59:52.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.433+0000 7f868b776700 1 Processor -- start 2023-10-01T07:59:52.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.433+0000 7f868b776700 1 -- start start 2023-10-01T07:59:52.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.434+0000 7f868b776700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8684130670 0x7f8684130a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:52.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.434+0000 7f868b776700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f868406f680 0x7f868406fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:52.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.434+0000 7f868b776700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f868406ffd0 0x7f8684137530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:52.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.434+0000 7f868b776700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f868409a350 con 0x7f868406f680 2023-10-01T07:59:52.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.434+0000 7f868b776700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8684130260 con 0x7f8684130670 2023-10-01T07:59:52.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.434+0000 7f868b776700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8684071ff0 con 0x7f868406ffd0 2023-10-01T07:59:52.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.434+0000 7f8689512700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8684130670 0x7f8684130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:52.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.434+0000 7f8689512700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8684130670 0x7f8684130a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44112/0 (socket says 172.21.15.26:44112) 2023-10-01T07:59:52.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.434+0000 7f8688d11700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f868406f680 0x7f868406fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:52.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.434+0000 7f8689512700 1 -- 172.21.15.26:0/1665168135 learned_addr learned my addr 172.21.15.26:0/1665168135 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:52.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.434+0000 7f8689d13700 1 --2- 172.21.15.26:0/1665168135 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f868406ffd0 0x7f8684137530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:52.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.435+0000 7f8689512700 1 -- 172.21.15.26:0/1665168135 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f868406ffd0 msgr2=0x7f8684137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:52.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.435+0000 7f8689512700 1 --2- 172.21.15.26:0/1665168135 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f868406ffd0 0x7f8684137530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.435+0000 7f8689512700 1 -- 172.21.15.26:0/1665168135 >> v2:172.21.15.26:3300/0 conn(0x7f868406f680 msgr2=0x7f868406fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:52.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.435+0000 7f8689512700 1 --2- 172.21.15.26:0/1665168135 >> v2:172.21.15.26:3300/0 conn(0x7f868406f680 0x7f868406fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.435+0000 7f8689512700 1 -- 172.21.15.26:0/1665168135 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8684070470 con 0x7f8684130670 2023-10-01T07:59:52.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.435+0000 7f8688d11700 1 --2- 172.21.15.26:0/1665168135 >> v2:172.21.15.26:3300/0 conn(0x7f868406f680 0x7f868406fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:52.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.435+0000 7f8689512700 1 --2- 172.21.15.26:0/1665168135 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8684130670 0x7f8684130a40 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f868000dd40 tx=0x7f868000f330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f73f4b64dbf785a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:52.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.435+0000 7f867bfff700 1 -- 172.21.15.26:0/1665168135 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8680012070 con 0x7f8684130670 2023-10-01T07:59:52.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.435+0000 7f867bfff700 1 -- 172.21.15.26:0/1665168135 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868000de90 con 0x7f8684130670 2023-10-01T07:59:52.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.435+0000 7f867bfff700 1 -- 172.21.15.26:0/1665168135 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868000faf0 con 0x7f8684130670 2023-10-01T07:59:52.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.436+0000 7f868b776700 1 -- 172.21.15.26:0/1665168135 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8684130670 msgr2=0x7f8684130a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:52.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.436+0000 7f868b776700 1 --2- 172.21.15.26:0/1665168135 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8684130670 0x7f8684130a40 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f868000dd40 tx=0x7f868000f330 comp rx=0 tx=0).stop 2023-10-01T07:59:52.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.436+0000 7f868b776700 1 -- 172.21.15.26:0/1665168135 shutdown_connections 2023-10-01T07:59:52.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.436+0000 7f868b776700 1 --2- 172.21.15.26:0/1665168135 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f868406ffd0 0x7f8684137530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.436+0000 7f868b776700 1 --2- 172.21.15.26:0/1665168135 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8684130670 0x7f8684130a40 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.436+0000 7f868b776700 1 --2- 172.21.15.26:0/1665168135 >> v2:172.21.15.26:3300/0 conn(0x7f868406f680 0x7f868406fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.436+0000 7f868b776700 1 -- 172.21.15.26:0/1665168135 >> 172.21.15.26:0/1665168135 conn(0x7f86840a2aa0 msgr2=0x7f86840a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:52.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.436+0000 7f868b776700 1 -- 172.21.15.26:0/1665168135 shutdown_connections 2023-10-01T07:59:52.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.436+0000 7f868b776700 1 -- 172.21.15.26:0/1665168135 wait complete. 2023-10-01T07:59:52.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.437+0000 7f868b776700 1 Processor -- start 2023-10-01T07:59:52.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.438+0000 7f868b776700 1 -- start start 2023-10-01T07:59:52.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.438+0000 7f868b776700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f868406f680 0x7f8684118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:52.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.438+0000 7f868b776700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f868406ffd0 0x7f8684119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:52.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.438+0000 7f868b776700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8684130670 0x7f8684119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:52.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.438+0000 7f868b776700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868411caf0 con 0x7f8684130670 2023-10-01T07:59:52.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.438+0000 7f868b776700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868411c130 con 0x7f868406f680 2023-10-01T07:59:52.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.438+0000 7f868b776700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f868411b500 con 0x7f868406ffd0 2023-10-01T07:59:52.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.438+0000 7f8689d13700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8684130670 0x7f8684119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:52.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.438+0000 7f8689d13700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8684130670 0x7f8684119750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57270/0 (socket says 172.21.15.26:57270) 2023-10-01T07:59:52.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.438+0000 7f8689d13700 1 -- 172.21.15.26:0/1383767470 learned_addr learned my addr 172.21.15.26:0/1383767470 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:52.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.438+0000 7f8689512700 1 --2- 172.21.15.26:0/1383767470 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f868406f680 0x7f8684118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:52.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.438+0000 7f8688d11700 1 --2- 172.21.15.26:0/1383767470 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f868406ffd0 0x7f8684119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:52.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.439+0000 7f8689d13700 1 -- 172.21.15.26:0/1383767470 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f868406ffd0 msgr2=0x7f8684119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:52.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.439+0000 7f8689d13700 1 --2- 172.21.15.26:0/1383767470 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f868406ffd0 0x7f8684119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.439+0000 7f8689d13700 1 -- 172.21.15.26:0/1383767470 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f868406f680 msgr2=0x7f8684118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:52.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.439+0000 7f8689d13700 1 --2- 172.21.15.26:0/1383767470 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f868406f680 0x7f8684118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.439+0000 7f8689d13700 1 -- 172.21.15.26:0/1383767470 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86740094a0 con 0x7f8684130670 2023-10-01T07:59:52.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.439+0000 7f8689512700 1 --2- 172.21.15.26:0/1383767470 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f868406f680 0x7f8684118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:52.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.439+0000 7f8689d13700 1 --2- 172.21.15.26:0/1383767470 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8684130670 0x7f8684119750 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f867c009dd0 tx=0x7f867c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:52.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.439+0000 7f8679ffb700 1 -- 172.21.15.26:0/1383767470 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c009c40 con 0x7f8684130670 2023-10-01T07:59:52.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.439+0000 7f8679ffb700 1 -- 172.21.15.26:0/1383767470 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867c00f040 con 0x7f8684130670 2023-10-01T07:59:52.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.439+0000 7f868b776700 1 -- 172.21.15.26:0/1383767470 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f868000d9f0 con 0x7f8684130670 2023-10-01T07:59:52.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.439+0000 7f8679ffb700 1 -- 172.21.15.26:0/1383767470 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c00ceb0 con 0x7f8684130670 2023-10-01T07:59:52.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.439+0000 7f868b776700 1 -- 172.21.15.26:0/1383767470 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f868412ead0 con 0x7f8684130670 2023-10-01T07:59:52.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.440+0000 7f8679ffb700 1 -- 172.21.15.26:0/1383767470 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f867c014480 con 0x7f8684130670 2023-10-01T07:59:52.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.440+0000 7f8679ffb700 1 -- 172.21.15.26:0/1383767470 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f867c040160 con 0x7f8684130670 2023-10-01T07:59:52.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.441+0000 7f868b776700 1 -- 172.21.15.26:0/1383767470 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f868411baf0 con 0x7f8684130670 2023-10-01T07:59:52.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.446+0000 7f8679ffb700 1 -- 172.21.15.26:0/1383767470 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f868411baf0 con 0x7f8684130670 2023-10-01T07:59:52.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.511+0000 7f8e9720e700 1 -- 172.21.15.26:0/537979176 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8e90072210 con 0x7f8e9006f680 2023-10-01T07:59:52.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.511+0000 7f8e8d7fa700 1 -- 172.21.15.26:0/537979176 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8e84015020 con 0x7f8e9006f680 2023-10-01T07:59:52.512 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:52.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.513+0000 7f8e9720e700 1 -- 172.21.15.26:0/537979176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e9006f680 msgr2=0x7f8e9011c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:52.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.513+0000 7f8e9720e700 1 --2- 172.21.15.26:0/537979176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e9006f680 0x7f8e9011c800 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f8e84009870 tx=0x7f8e84004750 comp rx=0 tx=0).stop 2023-10-01T07:59:52.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.514+0000 7f8e9720e700 1 -- 172.21.15.26:0/537979176 shutdown_connections 2023-10-01T07:59:52.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.514+0000 7f8e9720e700 1 --2- 172.21.15.26:0/537979176 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e90130670 0x7f8e9011d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.514+0000 7f8e9720e700 1 --2- 172.21.15.26:0/537979176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e9006f680 0x7f8e9011c800 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.514+0000 7f8e9720e700 1 --2- 172.21.15.26:0/537979176 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e900701a0 0x7f8e9011cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.514+0000 7f8e9720e700 1 -- 172.21.15.26:0/537979176 >> 172.21.15.26:0/537979176 conn(0x7f8e900a2aa0 msgr2=0x7f8e9012efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:52.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.514+0000 7f8e9720e700 1 -- 172.21.15.26:0/537979176 shutdown_connections 2023-10-01T07:59:52.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.514+0000 7f8e9720e700 1 -- 172.21.15.26:0/537979176 wait complete. 2023-10-01T07:59:52.528 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:52.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.601+0000 7fdae8bc2700 1 -- 172.21.15.26:0/1348033573 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdae406c360 con 0x7fdae4135e50 2023-10-01T07:59:52.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.602+0000 7fdad2ffd700 1 -- 172.21.15.26:0/1348033573 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdadc02a070 con 0x7fdae4135e50 2023-10-01T07:59:52.602 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:52.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.604+0000 7fdae8bc2700 1 -- 172.21.15.26:0/1348033573 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdae4135e50 msgr2=0x7fdae41260a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:52.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.604+0000 7fdae8bc2700 1 --2- 172.21.15.26:0/1348033573 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdae4135e50 0x7fdae41260a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fdadc012000 tx=0x7fdadc004ad0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.604+0000 7fdae8bc2700 1 -- 172.21.15.26:0/1348033573 shutdown_connections 2023-10-01T07:59:52.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.604+0000 7fdae8bc2700 1 --2- 172.21.15.26:0/1348033573 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdae4135e50 0x7fdae41260a0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.604+0000 7fdae8bc2700 1 --2- 172.21.15.26:0/1348033573 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdae409d6f0 0x7fdae41c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.604+0000 7fdae8bc2700 1 --2- 172.21.15.26:0/1348033573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdae409e1d0 0x7fdae41c9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.604+0000 7fdae8bc2700 1 -- 172.21.15.26:0/1348033573 >> 172.21.15.26:0/1348033573 conn(0x7fdae4066f50 msgr2=0x7fdae40712a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:52.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.604+0000 7fdae8bc2700 1 -- 172.21.15.26:0/1348033573 shutdown_connections 2023-10-01T07:59:52.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.604+0000 7fdae8bc2700 1 -- 172.21.15.26:0/1348033573 wait complete. 2023-10-01T07:59:52.618 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:52.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.628+0000 7fac19349700 1 -- 172.21.15.26:0/508584891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fac14122950 con 0x7fac141338c0 2023-10-01T07:59:52.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.628+0000 7fabfb7fe700 1 -- 172.21.15.26:0/508584891 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fac0802b030 con 0x7fac141338c0 2023-10-01T07:59:52.629 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:52.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.630+0000 7fac19349700 1 -- 172.21.15.26:0/508584891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac141338c0 msgr2=0x7fac1409be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:52.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.630+0000 7fac19349700 1 --2- 172.21.15.26:0/508584891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac141338c0 0x7fac1409be30 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fac08013000 tx=0x7fac08004750 comp rx=0 tx=0).stop 2023-10-01T07:59:52.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.630+0000 7fac19349700 1 -- 172.21.15.26:0/508584891 shutdown_connections 2023-10-01T07:59:52.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.630+0000 7fac19349700 1 --2- 172.21.15.26:0/508584891 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac141341d0 0x7fac1409c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.630+0000 7fac19349700 1 --2- 172.21.15.26:0/508584891 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fac1409e390 0x7fac1409b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.630+0000 7fac19349700 1 --2- 172.21.15.26:0/508584891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac141338c0 0x7fac1409be30 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.630+0000 7fac19349700 1 -- 172.21.15.26:0/508584891 >> 172.21.15.26:0/508584891 conn(0x7fac140a2aa0 msgr2=0x7fac1412ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:52.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.630+0000 7fac19349700 1 -- 172.21.15.26:0/508584891 shutdown_connections 2023-10-01T07:59:52.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.630+0000 7fac19349700 1 -- 172.21.15.26:0/508584891 wait complete. 2023-10-01T07:59:52.647 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:52.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.701+0000 7f868b776700 1 -- 172.21.15.26:0/1383767470 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f868411baf0 con 0x7f8684130670 2023-10-01T07:59:52.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.701+0000 7f8679ffb700 1 -- 172.21.15.26:0/1383767470 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f868411baf0 con 0x7f8684130670 2023-10-01T07:59:52.702 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:52.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.704+0000 7f868b776700 1 -- 172.21.15.26:0/1383767470 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8684130670 msgr2=0x7f8684119750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:52.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.704+0000 7f868b776700 1 --2- 172.21.15.26:0/1383767470 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8684130670 0x7f8684119750 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f867c009dd0 tx=0x7f867c00c3a0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.704+0000 7f868b776700 1 -- 172.21.15.26:0/1383767470 shutdown_connections 2023-10-01T07:59:52.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.704+0000 7f868b776700 1 --2- 172.21.15.26:0/1383767470 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8684130670 0x7f8684119750 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.704+0000 7f868b776700 1 --2- 172.21.15.26:0/1383767470 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f868406f680 0x7f8684118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.704+0000 7f868b776700 1 --2- 172.21.15.26:0/1383767470 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f868406ffd0 0x7f8684119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:52.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.704+0000 7f868b776700 1 -- 172.21.15.26:0/1383767470 >> 172.21.15.26:0/1383767470 conn(0x7f86840a2aa0 msgr2=0x7f868412d690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:52.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.704+0000 7f868b776700 1 -- 172.21.15.26:0/1383767470 shutdown_connections 2023-10-01T07:59:52.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:52.704+0000 7f868b776700 1 -- 172.21.15.26:0/1383767470 wait complete. 2023-10-01T07:59:52.718 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:53.529 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:53.619 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:53.648 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:53.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.678+0000 7f6c21c4f700 1 Processor -- start 2023-10-01T07:59:53.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.678+0000 7f6c21c4f700 1 -- start start 2023-10-01T07:59:53.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.678+0000 7f6c21c4f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6c1c09d6f0 0x7f6c1c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:53.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.678+0000 7f6c21c4f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6c1c09e000 0x7f6c1c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:53.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.678+0000 7f6c21c4f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c1c09f130 con 0x7f6c1c09e410 2023-10-01T07:59:53.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.678+0000 7f6c21c4f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c1c09f520 con 0x7f6c1c09d6f0 2023-10-01T07:59:53.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.678+0000 7f6c21c4f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c09e930 con 0x7f6c1c09e000 2023-10-01T07:59:53.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.679+0000 7f6c1b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6c1c09d6f0 0x7f6c1c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:53.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.679+0000 7f6c1b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6c1c09d6f0 0x7f6c1c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35200/0 (socket says 172.21.15.26:35200) 2023-10-01T07:59:53.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.679+0000 7f6c1b7fe700 1 -- 172.21.15.26:0/705380197 learned_addr learned my addr 172.21.15.26:0/705380197 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:53.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.679+0000 7f6c1affd700 1 --2- 172.21.15.26:0/705380197 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6c1c09e000 0x7f6c1c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:53.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.679+0000 7f6c1b7fe700 1 -- 172.21.15.26:0/705380197 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6c1c09e000 msgr2=0x7f6c1c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:53.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.679+0000 7f6c1b7fe700 1 --2- 172.21.15.26:0/705380197 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6c1c09e000 0x7f6c1c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:53.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.679+0000 7f6c1b7fe700 1 -- 172.21.15.26:0/705380197 >> v1:172.21.15.26:6789/0 conn(0x7f6c1c09e410 legacy=0x7f6c1c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:53.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.679+0000 7f6c1b7fe700 1 -- 172.21.15.26:0/705380197 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1c09b2d0 con 0x7f6c1c09d6f0 2023-10-01T07:59:53.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.679+0000 7f6c1b7fe700 1 --2- 172.21.15.26:0/705380197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c1c09d6f0 0x7f6c1c09dac0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c0098f0 tx=0x7f6c0c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8edef5c1e437ae2c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:53.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.679+0000 7f6c1a7fc700 1 -- 172.21.15.26:0/705380197 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c011830 con 0x7f6c1c09d6f0 2023-10-01T07:59:53.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.680+0000 7f6c1a7fc700 1 -- 172.21.15.26:0/705380197 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0c011990 con 0x7f6c1c09d6f0 2023-10-01T07:59:53.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.680+0000 7f6c1a7fc700 1 -- 172.21.15.26:0/705380197 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c011d20 con 0x7f6c1c09d6f0 2023-10-01T07:59:53.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.680+0000 7f6c21c4f700 1 -- 172.21.15.26:0/705380197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c1c09d6f0 msgr2=0x7f6c1c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:53.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.680+0000 7f6c21c4f700 1 --2- 172.21.15.26:0/705380197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c1c09d6f0 0x7f6c1c09dac0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c0098f0 tx=0x7f6c0c009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:53.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.680+0000 7f6c21c4f700 1 -- 172.21.15.26:0/705380197 shutdown_connections 2023-10-01T07:59:53.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.680+0000 7f6c21c4f700 1 --2- 172.21.15.26:0/705380197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c1c09d6f0 0x7f6c1c09dac0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:53.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.680+0000 7f6c21c4f700 1 --2- 172.21.15.26:0/705380197 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6c1c09e000 0x7f6c1c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:53.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.680+0000 7f6c21c4f700 1 -- 172.21.15.26:0/705380197 >> 172.21.15.26:0/705380197 conn(0x7f6c1c066f50 msgr2=0x7f6c1c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:53.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.681+0000 7f6c21c4f700 1 -- 172.21.15.26:0/705380197 shutdown_connections 2023-10-01T07:59:53.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.681+0000 7f6c21c4f700 1 -- 172.21.15.26:0/705380197 wait complete. 2023-10-01T07:59:53.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.682+0000 7f6c21c4f700 1 Processor -- start 2023-10-01T07:59:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.682+0000 7f6c21c4f700 1 -- start start 2023-10-01T07:59:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.683+0000 7f6c21c4f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c1c09d6f0 0x7f6c1c122340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.683+0000 7f6c21c4f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6c1c09e000 0x7f6c1c122880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.683+0000 7f6c21c4f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c1c09e410 0x7f6c1c122dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.683+0000 7f6c21c4f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c123ee0 con 0x7f6c1c09d6f0 2023-10-01T07:59:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.683+0000 7f6c21c4f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c125b80 con 0x7f6c1c09e410 2023-10-01T07:59:53.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.683+0000 7f6c21c4f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c125df0 con 0x7f6c1c09e000 2023-10-01T07:59:53.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.683+0000 7f6c1affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6c1c09e000 0x7f6c1c122880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:53.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.683+0000 7f6c1affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6c1c09e000 0x7f6c1c122880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55812/0 (socket says 172.21.15.26:55812) 2023-10-01T07:59:53.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.683+0000 7f6c1affd700 1 -- 172.21.15.26:0/1053446135 learned_addr learned my addr 172.21.15.26:0/1053446135 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:53.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.683+0000 7f6c1bfff700 1 --2- 172.21.15.26:0/1053446135 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c1c09e410 0x7f6c1c122dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:53.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.684+0000 7f6c1affd700 1 -- 172.21.15.26:0/1053446135 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c1c09e410 msgr2=0x7f6c1c122dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:53.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.684+0000 7f6c1affd700 1 --2- 172.21.15.26:0/1053446135 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c1c09e410 0x7f6c1c122dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:53.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.684+0000 7f6c1affd700 1 -- 172.21.15.26:0/1053446135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c1c09d6f0 msgr2=0x7f6c1c122340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:53.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.684+0000 7f6c1affd700 1 --2- 172.21.15.26:0/1053446135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c1c09d6f0 0x7f6c1c122340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:53.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.684+0000 7f6c1affd700 1 -- 172.21.15.26:0/1053446135 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0c009550 con 0x7f6c1c09e000 2023-10-01T07:59:53.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.684+0000 7f6c1affd700 1 --2- 172.21.15.26:0/1053446135 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6c1c09e000 0x7f6c1c122880 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f6c1000e9e0 tx=0x7f6c1000ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:53.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.684+0000 7f6c03fff700 1 -- 172.21.15.26:0/1053446135 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c10009710 con 0x7f6c1c09e000 2023-10-01T07:59:53.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.684+0000 7f6c03fff700 1 -- 172.21.15.26:0/1053446135 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1000c850 con 0x7f6c1c09e000 2023-10-01T07:59:53.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.684+0000 7f6c21c4f700 1 -- 172.21.15.26:0/1053446135 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c1c125460 con 0x7f6c1c09e000 2023-10-01T07:59:53.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.684+0000 7f6c03fff700 1 -- 172.21.15.26:0/1053446135 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1000cbc0 con 0x7f6c1c09e000 2023-10-01T07:59:53.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.684+0000 7f6c21c4f700 1 -- 172.21.15.26:0/1053446135 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c1c0a1d50 con 0x7f6c1c09e000 2023-10-01T07:59:53.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.685+0000 7f6c03fff700 1 -- 172.21.15.26:0/1053446135 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6c1000cd20 con 0x7f6c1c09e000 2023-10-01T07:59:53.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.686+0000 7f6c03fff700 1 -- 172.21.15.26:0/1053446135 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6c1003fb90 con 0x7f6c1c09e000 2023-10-01T07:59:53.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.686+0000 7f6c21c4f700 1 -- 172.21.15.26:0/1053446135 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c1c1301f0 con 0x7f6c1c09e000 2023-10-01T07:59:53.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.691+0000 7f6c03fff700 1 -- 172.21.15.26:0/1053446135 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6c1001b3b0 con 0x7f6c1c09e000 2023-10-01T07:59:53.719 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:53.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.779+0000 7f740f2af700 1 Processor -- start 2023-10-01T07:59:53.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.780+0000 7f740f2af700 1 -- start start 2023-10-01T07:59:53.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.780+0000 7f740f2af700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f74081338a0 0x7f7408133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:53.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.780+0000 7f740f2af700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f740809e930 0x7f740813b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:53.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.780+0000 7f740f2af700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f740806ef30 con 0x7f740809de50 2023-10-01T07:59:53.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.780+0000 7f740f2af700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f740806fef0 con 0x7f74081338a0 2023-10-01T07:59:53.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.780+0000 7f740f2af700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74081334b0 con 0x7f740809e930 2023-10-01T07:59:53.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.781+0000 7f740c84a700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f740809de50 0x7f740809e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36956/0 (socket says 172.21.15.26:36956) 2023-10-01T07:59:53.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.781+0000 7f740c84a700 1 -- 172.21.15.26:0/3180406662 learned_addr learned my addr 172.21.15.26:0/3180406662 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:59:53.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.781+0000 7f740d04b700 1 --2- 172.21.15.26:0/3180406662 >> v2:172.21.15.26:3300/0 conn(0x7f74081338a0 0x7f7408133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:53.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.781+0000 7f740d84c700 1 --2- 172.21.15.26:0/3180406662 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f740809e930 0x7f740813b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:53.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.781+0000 7f740d04b700 1 -- 172.21.15.26:0/3180406662 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f740809e930 msgr2=0x7f740813b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:53.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.781+0000 7f740d04b700 1 --2- 172.21.15.26:0/3180406662 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f740809e930 0x7f740813b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:53.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.781+0000 7f740d04b700 1 -- 172.21.15.26:0/3180406662 >> v1:172.21.15.26:6789/0 conn(0x7f740809de50 legacy=0x7f740809e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:53.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.781+0000 7f740d04b700 1 -- 172.21.15.26:0/3180406662 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f740806fc30 con 0x7f74081338a0 2023-10-01T07:59:53.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.781+0000 7f740d84c700 1 --2- 172.21.15.26:0/3180406662 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f740809e930 0x7f740813b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:53.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.781+0000 7f740d04b700 1 --2- 172.21.15.26:0/3180406662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74081338a0 0x7f7408133c70 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f7404009840 tx=0x7f7404009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86bc0fd8ae7ab3d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:53.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.781+0000 7f73fffff700 1 -- 172.21.15.26:0/3180406662 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7404011830 con 0x7f74081338a0 2023-10-01T07:59:53.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.782+0000 7f73fffff700 1 -- 172.21.15.26:0/3180406662 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7404011990 con 0x7f74081338a0 2023-10-01T07:59:53.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.782+0000 7f73fffff700 1 -- 172.21.15.26:0/3180406662 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7404011d20 con 0x7f74081338a0 2023-10-01T07:59:53.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.782+0000 7f740f2af700 1 -- 172.21.15.26:0/3180406662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74081338a0 msgr2=0x7f7408133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:53.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.782+0000 7f740f2af700 1 --2- 172.21.15.26:0/3180406662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74081338a0 0x7f7408133c70 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f7404009840 tx=0x7f7404009b50 comp rx=0 tx=0).stop 2023-10-01T07:59:53.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.782+0000 7f740f2af700 1 -- 172.21.15.26:0/3180406662 shutdown_connections 2023-10-01T07:59:53.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.782+0000 7f740f2af700 1 --2- 172.21.15.26:0/3180406662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74081338a0 0x7f7408133c70 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:53.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.782+0000 7f740f2af700 1 --2- 172.21.15.26:0/3180406662 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f740809e930 0x7f740813b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:53.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.782+0000 7f740f2af700 1 -- 172.21.15.26:0/3180406662 >> 172.21.15.26:0/3180406662 conn(0x7f74080a2aa0 msgr2=0x7f74080a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:53.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.783+0000 7f740f2af700 1 -- 172.21.15.26:0/3180406662 shutdown_connections 2023-10-01T07:59:53.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.783+0000 7f740f2af700 1 -- 172.21.15.26:0/3180406662 wait complete. 2023-10-01T07:59:53.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.784+0000 7f740f2af700 1 Processor -- start 2023-10-01T07:59:53.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.784+0000 7f740f2af700 1 -- start start 2023-10-01T07:59:53.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.784+0000 7f740f2af700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f740809de50 0x7f740811ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:53.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.784+0000 7f740f2af700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f740809e930 0x7f740811f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:53.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.784+0000 7f740f2af700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f74081338a0 0x7f740811f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:53.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.784+0000 7f740f2af700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740812f740 con 0x7f740809de50 2023-10-01T07:59:53.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.784+0000 7f740f2af700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7408121d60 con 0x7f74081338a0 2023-10-01T07:59:53.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.784+0000 7f740f2af700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7408120750 con 0x7f740809e930 2023-10-01T07:59:53.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.784+0000 7f740d04b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f740809de50 0x7f740811ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:53.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.784+0000 7f740d04b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f740809de50 0x7f740811ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35232/0 (socket says 172.21.15.26:35232) 2023-10-01T07:59:53.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.784+0000 7f740d04b700 1 -- 172.21.15.26:0/611870003 learned_addr learned my addr 172.21.15.26:0/611870003 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:53.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.785+0000 7f740d84c700 1 --2- 172.21.15.26:0/611870003 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f74081338a0 0x7f740811f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:53.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.785+0000 7f740d04b700 1 -- 172.21.15.26:0/611870003 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f740809e930 msgr2=0x7f740811f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:53.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.785+0000 7f740d04b700 1 --2- 172.21.15.26:0/611870003 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f740809e930 0x7f740811f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:53.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.785+0000 7f740d04b700 1 -- 172.21.15.26:0/611870003 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f74081338a0 msgr2=0x7f740811f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:53.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.785+0000 7f740d04b700 1 --2- 172.21.15.26:0/611870003 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f74081338a0 0x7f740811f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:53.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.785+0000 7f740d04b700 1 -- 172.21.15.26:0/611870003 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7400009a70 con 0x7f740809de50 2023-10-01T07:59:53.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.785+0000 7f740d84c700 1 --2- 172.21.15.26:0/611870003 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f74081338a0 0x7f740811f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:59:53.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.785+0000 7f740d04b700 1 --2- 172.21.15.26:0/611870003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f740809de50 0x7f740811ec70 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f7404009fd0 tx=0x7f7404004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:53.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.785+0000 7f73fdffb700 1 -- 172.21.15.26:0/611870003 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74040036a0 con 0x7f740809de50 2023-10-01T07:59:53.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.785+0000 7f73fdffb700 1 -- 172.21.15.26:0/611870003 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740401f070 con 0x7f740809de50 2023-10-01T07:59:53.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.785+0000 7f73fdffb700 1 -- 172.21.15.26:0/611870003 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7404003a60 con 0x7f740809de50 2023-10-01T07:59:53.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.785+0000 7f740f2af700 1 -- 172.21.15.26:0/611870003 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74040094a0 con 0x7f740809de50 2023-10-01T07:59:53.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.786+0000 7f740f2af700 1 -- 172.21.15.26:0/611870003 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f740806f640 con 0x7f740809de50 2023-10-01T07:59:53.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.787+0000 7f73fdffb700 1 -- 172.21.15.26:0/611870003 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7404003bc0 con 0x7f740809de50 2023-10-01T07:59:53.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.787+0000 7f740f2af700 1 -- 172.21.15.26:0/611870003 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7408074ea0 con 0x7f740809de50 2023-10-01T07:59:53.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.787+0000 7f73fdffb700 1 -- 172.21.15.26:0/611870003 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7404021070 con 0x7f740809de50 2023-10-01T07:59:53.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.796+0000 7f73fdffb700 1 -- 172.21.15.26:0/611870003 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7404010d50 con 0x7f740809de50 2023-10-01T07:59:53.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.816+0000 7fd78225c700 1 Processor -- start 2023-10-01T07:59:53.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.816+0000 7fd78225c700 1 -- start start 2023-10-01T07:59:53.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.817+0000 7fd78225c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd77c0a0a30 0x7fd77c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:53.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.817+0000 7fd78225c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd77c0a1340 0x7fd77c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:53.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.817+0000 7fd78225c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd77c09edd0 con 0x7fd77c133fa0 2023-10-01T07:59:53.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.817+0000 7fd78225c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c09e1f0 con 0x7fd77c0a0a30 2023-10-01T07:59:53.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.817+0000 7fd78225c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c09dc50 con 0x7fd77c0a1340 2023-10-01T07:59:53.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.817+0000 7fd77affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd77c0a1340 0x7fd77c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:53.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.818+0000 7fd77affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd77c0a1340 0x7fd77c133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55820/0 (socket says 172.21.15.26:55820) 2023-10-01T07:59:53.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.818+0000 7fd77affd700 1 -- 172.21.15.26:0/3275773745 learned_addr learned my addr 172.21.15.26:0/3275773745 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:53.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.818+0000 7fd77b7fe700 1 --2- 172.21.15.26:0/3275773745 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd77c0a0a30 0x7fd77c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:53.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.818+0000 7fd77affd700 1 -- 172.21.15.26:0/3275773745 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd77c0a0a30 msgr2=0x7fd77c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:53.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.818+0000 7fd77affd700 1 --2- 172.21.15.26:0/3275773745 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd77c0a0a30 0x7fd77c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:53.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.818+0000 7fd77affd700 1 -- 172.21.15.26:0/3275773745 >> v1:172.21.15.26:6789/0 conn(0x7fd77c133fa0 legacy=0x7fd77c13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:53.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.818+0000 7fd77affd700 1 -- 172.21.15.26:0/3275773745 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd77c0a1fe0 con 0x7fd77c0a1340 2023-10-01T07:59:53.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.818+0000 7fd77affd700 1 --2- 172.21.15.26:0/3275773745 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd77c0a1340 0x7fd77c133a60 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fd770009920 tx=0x7fd770009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84438b934bf4e4b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:53.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.818+0000 7fd77a7fc700 1 -- 172.21.15.26:0/3275773745 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77000ba60 con 0x7fd77c0a1340 2023-10-01T07:59:53.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.818+0000 7fd77a7fc700 1 -- 172.21.15.26:0/3275773745 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77000bbc0 con 0x7fd77c0a1340 2023-10-01T07:59:53.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.818+0000 7fd77a7fc700 1 -- 172.21.15.26:0/3275773745 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd770009e70 con 0x7fd77c0a1340 2023-10-01T07:59:53.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.819+0000 7fd78225c700 1 -- 172.21.15.26:0/3275773745 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd77c0a1340 msgr2=0x7fd77c133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:53.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.819+0000 7fd78225c700 1 --2- 172.21.15.26:0/3275773745 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd77c0a1340 0x7fd77c133a60 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fd770009920 tx=0x7fd770009c30 comp rx=0 tx=0).stop 2023-10-01T07:59:53.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.819+0000 7fd78225c700 1 -- 172.21.15.26:0/3275773745 shutdown_connections 2023-10-01T07:59:53.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.819+0000 7fd78225c700 1 --2- 172.21.15.26:0/3275773745 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd77c0a0a30 0x7fd77c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:53.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.819+0000 7fd78225c700 1 --2- 172.21.15.26:0/3275773745 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd77c0a1340 0x7fd77c133a60 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:53.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.819+0000 7fd78225c700 1 -- 172.21.15.26:0/3275773745 >> 172.21.15.26:0/3275773745 conn(0x7fd77c0a6550 msgr2=0x7fd77c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:53.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.819+0000 7fd78225c700 1 -- 172.21.15.26:0/3275773745 shutdown_connections 2023-10-01T07:59:53.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.819+0000 7fd78225c700 1 -- 172.21.15.26:0/3275773745 wait complete. 2023-10-01T07:59:53.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.821+0000 7fd78225c700 1 Processor -- start 2023-10-01T07:59:53.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.821+0000 7fd78225c700 1 -- start start 2023-10-01T07:59:53.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.822+0000 7fd78225c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd77c0a0a30 0x7fd77c11e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:53.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.822+0000 7fd78225c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd77c0a1340 0x7fd77c11eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:53.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.822+0000 7fd78225c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd77c133fa0 0x7fd77c11f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:53.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.822+0000 7fd78225c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c1203e0 con 0x7fd77c0a0a30 2023-10-01T07:59:53.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.822+0000 7fd78225c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c121f00 con 0x7fd77c0a1340 2023-10-01T07:59:53.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.822+0000 7fd78225c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c0a38a0 con 0x7fd77c133fa0 2023-10-01T07:59:53.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.822+0000 7fd77b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd77c0a0a30 0x7fd77c11e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:53.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.822+0000 7fd77b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd77c0a0a30 0x7fd77c11e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35234/0 (socket says 172.21.15.26:35234) 2023-10-01T07:59:53.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.822+0000 7fd77b7fe700 1 -- 172.21.15.26:0/1588103593 learned_addr learned my addr 172.21.15.26:0/1588103593 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:53.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.822+0000 7fd77bfff700 1 --2- 172.21.15.26:0/1588103593 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd77c133fa0 0x7fd77c11f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:53.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.822+0000 7fd77affd700 1 --2- 172.21.15.26:0/1588103593 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd77c0a1340 0x7fd77c11eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:53.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.822+0000 7fd77b7fe700 1 -- 172.21.15.26:0/1588103593 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd77c133fa0 msgr2=0x7fd77c11f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:53.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.822+0000 7fd77b7fe700 1 --2- 172.21.15.26:0/1588103593 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd77c133fa0 0x7fd77c11f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:53.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.823+0000 7fd77b7fe700 1 -- 172.21.15.26:0/1588103593 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd77c0a1340 msgr2=0x7fd77c11eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:53.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.823+0000 7fd77b7fe700 1 --2- 172.21.15.26:0/1588103593 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd77c0a1340 0x7fd77c11eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:53.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.823+0000 7fd77b7fe700 1 -- 172.21.15.26:0/1588103593 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd770009550 con 0x7fd77c0a0a30 2023-10-01T07:59:53.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.823+0000 7fd77affd700 1 --2- 172.21.15.26:0/1588103593 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd77c0a1340 0x7fd77c11eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:59:53.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.823+0000 7fd77bfff700 1 --2- 172.21.15.26:0/1588103593 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd77c133fa0 0x7fd77c11f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:53.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.823+0000 7fd77b7fe700 1 --2- 172.21.15.26:0/1588103593 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd77c0a0a30 0x7fd77c11e760 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fd76c00e810 tx=0x7fd76c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:53.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.823+0000 7fd763fff700 1 -- 172.21.15.26:0/1588103593 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c013610 con 0x7fd77c0a0a30 2023-10-01T07:59:53.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.823+0000 7fd763fff700 1 -- 172.21.15.26:0/1588103593 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76c013770 con 0x7fd77c0a0a30 2023-10-01T07:59:53.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.823+0000 7fd78225c700 1 -- 172.21.15.26:0/1588103593 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd77c0a25e0 con 0x7fd77c0a0a30 2023-10-01T07:59:53.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.823+0000 7fd763fff700 1 -- 172.21.15.26:0/1588103593 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c013b20 con 0x7fd77c0a0a30 2023-10-01T07:59:53.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.823+0000 7fd78225c700 1 -- 172.21.15.26:0/1588103593 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd77c1221e0 con 0x7fd77c0a0a30 2023-10-01T07:59:53.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.825+0000 7fd763fff700 1 -- 172.21.15.26:0/1588103593 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd76c013c80 con 0x7fd77c0a0a30 2023-10-01T07:59:53.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.825+0000 7fd78225c700 1 -- 172.21.15.26:0/1588103593 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd77c074ea0 con 0x7fd77c0a0a30 2023-10-01T07:59:53.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.825+0000 7fd763fff700 1 -- 172.21.15.26:0/1588103593 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd76c03f480 con 0x7fd77c0a0a30 2023-10-01T07:59:53.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.830+0000 7fd763fff700 1 -- 172.21.15.26:0/1588103593 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd76c021080 con 0x7fd77c0a0a30 2023-10-01T07:59:53.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.871+0000 7ff145118700 1 Processor -- start 2023-10-01T07:59:53.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.871+0000 7ff145118700 1 -- start start 2023-10-01T07:59:53.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.872+0000 7ff145118700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff14009d6f0 0x7ff14009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:53.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.872+0000 7ff145118700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff14009e410 0x7ff140134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:53.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.872+0000 7ff145118700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff14009b120 con 0x7ff14009e000 2023-10-01T07:59:53.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.872+0000 7ff145118700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14006b460 con 0x7ff14009e410 2023-10-01T07:59:53.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.872+0000 7ff145118700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff14009a7e0 con 0x7ff14009d6f0 2023-10-01T07:59:53.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.872+0000 7ff13f59e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff14009e410 0x7ff140134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:53.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.873+0000 7ff13ed9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff14009d6f0 0x7ff14009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:53.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.873+0000 7ff13f59e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff14009e410 0x7ff140134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44496/0 (socket says 172.21.15.26:44496) 2023-10-01T07:59:53.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.873+0000 7ff13f59e700 1 -- 172.21.15.26:0/40029475 learned_addr learned my addr 172.21.15.26:0/40029475 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:53.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.873+0000 7ff13ed9d700 1 -- 172.21.15.26:0/40029475 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff14009e410 msgr2=0x7ff140134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:53.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.873+0000 7ff13ed9d700 1 --2- 172.21.15.26:0/40029475 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff14009e410 0x7ff140134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:53.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.873+0000 7ff13ed9d700 1 -- 172.21.15.26:0/40029475 >> v1:172.21.15.26:6789/0 conn(0x7ff14009e000 legacy=0x7ff1401339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:53.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.873+0000 7ff13ed9d700 1 -- 172.21.15.26:0/40029475 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14009a500 con 0x7ff14009d6f0 2023-10-01T07:59:53.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.873+0000 7ff13ed9d700 1 --2- 172.21.15.26:0/40029475 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff14009d6f0 0x7ff14009dac0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff1300098a0 tx=0x7ff130009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d48ca197e75ae873 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:53.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.873+0000 7ff13dd9b700 1 -- 172.21.15.26:0/40029475 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff130004230 con 0x7ff14009d6f0 2023-10-01T07:59:53.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.873+0000 7ff13dd9b700 1 -- 172.21.15.26:0/40029475 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff130004390 con 0x7ff14009d6f0 2023-10-01T07:59:53.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.873+0000 7ff13dd9b700 1 -- 172.21.15.26:0/40029475 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1300036a0 con 0x7ff14009d6f0 2023-10-01T07:59:53.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.874+0000 7ff145118700 1 -- 172.21.15.26:0/40029475 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff14009d6f0 msgr2=0x7ff14009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:53.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.874+0000 7ff145118700 1 --2- 172.21.15.26:0/40029475 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff14009d6f0 0x7ff14009dac0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff1300098a0 tx=0x7ff130009bb0 comp rx=0 tx=0).stop 2023-10-01T07:59:53.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.874+0000 7ff145118700 1 -- 172.21.15.26:0/40029475 shutdown_connections 2023-10-01T07:59:53.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.874+0000 7ff145118700 1 --2- 172.21.15.26:0/40029475 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff14009d6f0 0x7ff14009dac0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:53.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.874+0000 7ff145118700 1 --2- 172.21.15.26:0/40029475 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff14009e410 0x7ff140134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:53.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.874+0000 7ff145118700 1 -- 172.21.15.26:0/40029475 >> 172.21.15.26:0/40029475 conn(0x7ff140066f50 msgr2=0x7ff14009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:53.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.874+0000 7ff145118700 1 -- 172.21.15.26:0/40029475 shutdown_connections 2023-10-01T07:59:53.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.874+0000 7ff145118700 1 -- 172.21.15.26:0/40029475 wait complete. 2023-10-01T07:59:53.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.876+0000 7ff145118700 1 Processor -- start 2023-10-01T07:59:53.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.876+0000 7ff145118700 1 -- start start 2023-10-01T07:59:53.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.877+0000 7ff145118700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff14009d6f0 0x7ff1401226b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:53.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.877+0000 7ff145118700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff14009e000 0x7ff140122bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:53.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.877+0000 7ff145118700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff14009e410 0x7ff140123130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:53.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.877+0000 7ff145118700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1400a1e20 con 0x7ff14009e000 2023-10-01T07:59:53.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.877+0000 7ff145118700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14009c710 con 0x7ff14009d6f0 2023-10-01T07:59:53.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.877+0000 7ff145118700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff140125050 con 0x7ff14009e410 2023-10-01T07:59:53.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.877+0000 7ff13e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff14009e000 0x7ff140122bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:53.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.877+0000 7ff13ed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff14009d6f0 0x7ff1401226b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:53.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.877+0000 7ff13e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff14009e000 0x7ff140122bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35246/0 (socket says 172.21.15.26:35246) 2023-10-01T07:59:53.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.877+0000 7ff13ed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff14009d6f0 0x7ff1401226b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44500/0 (socket says 172.21.15.26:44500) 2023-10-01T07:59:53.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.877+0000 7ff13e59c700 1 -- 172.21.15.26:0/3289523709 learned_addr learned my addr 172.21.15.26:0/3289523709 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:53.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.877+0000 7ff13f59e700 1 --2- 172.21.15.26:0/3289523709 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff14009e410 0x7ff140123130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:53.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.878+0000 7ff13e59c700 1 -- 172.21.15.26:0/3289523709 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff14009e410 msgr2=0x7ff140123130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:53.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.878+0000 7ff13e59c700 1 --2- 172.21.15.26:0/3289523709 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff14009e410 0x7ff140123130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:53.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.878+0000 7ff13e59c700 1 -- 172.21.15.26:0/3289523709 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff14009d6f0 msgr2=0x7ff1401226b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:53.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.878+0000 7ff13e59c700 1 --2- 172.21.15.26:0/3289523709 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff14009d6f0 0x7ff1401226b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:53.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.878+0000 7ff13e59c700 1 -- 172.21.15.26:0/3289523709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1300094a0 con 0x7ff14009e000 2023-10-01T07:59:53.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.878+0000 7ff13f59e700 1 --2- 172.21.15.26:0/3289523709 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff14009e410 0x7ff140123130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:53.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.878+0000 7ff13e59c700 1 --2- 172.21.15.26:0/3289523709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff14009e000 0x7ff140122bf0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7ff13400c780 tx=0x7ff13400ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:53.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.878+0000 7ff1277fe700 1 -- 172.21.15.26:0/3289523709 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1340054e0 con 0x7ff14009e000 2023-10-01T07:59:53.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.878+0000 7ff1277fe700 1 -- 172.21.15.26:0/3289523709 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff134003680 con 0x7ff14009e000 2023-10-01T07:59:53.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.878+0000 7ff145118700 1 -- 172.21.15.26:0/3289523709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1401258d0 con 0x7ff14009e000 2023-10-01T07:59:53.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.878+0000 7ff145118700 1 -- 172.21.15.26:0/3289523709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1401268d0 con 0x7ff14009e000 2023-10-01T07:59:53.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.879+0000 7ff1277fe700 1 -- 172.21.15.26:0/3289523709 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff134003a30 con 0x7ff14009e000 2023-10-01T07:59:53.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.879+0000 7ff1277fe700 1 -- 172.21.15.26:0/3289523709 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff134003c10 con 0x7ff14009e000 2023-10-01T07:59:53.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.879+0000 7ff1277fe700 1 -- 172.21.15.26:0/3289523709 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff13403edd0 con 0x7ff14009e000 2023-10-01T07:59:53.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.880+0000 7ff145118700 1 -- 172.21.15.26:0/3289523709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff140074ea0 con 0x7ff14009e000 2023-10-01T07:59:53.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.885+0000 7ff1277fe700 1 -- 172.21.15.26:0/3289523709 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff134017070 con 0x7ff14009e000 2023-10-01T07:59:53.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.936+0000 7f6c21c4f700 1 -- 172.21.15.26:0/1053446135 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6c1c074ea0 con 0x7f6c1c09e000 2023-10-01T07:59:53.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.937+0000 7f6c03fff700 1 -- 172.21.15.26:0/1053446135 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6c10021030 con 0x7f6c1c09e000 2023-10-01T07:59:53.938 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:53.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.939+0000 7f6c21c4f700 1 -- 172.21.15.26:0/1053446135 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6c1c09e000 msgr2=0x7f6c1c122880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:53.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.939+0000 7f6c21c4f700 1 --2- 172.21.15.26:0/1053446135 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6c1c09e000 0x7f6c1c122880 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f6c1000e9e0 tx=0x7f6c1000ecf0 comp rx=0 tx=0).stop 2023-10-01T07:59:53.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.939+0000 7f6c21c4f700 1 -- 172.21.15.26:0/1053446135 shutdown_connections 2023-10-01T07:59:53.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.939+0000 7f6c21c4f700 1 --2- 172.21.15.26:0/1053446135 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c1c09e410 0x7f6c1c122dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:53.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.939+0000 7f6c21c4f700 1 --2- 172.21.15.26:0/1053446135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c1c09d6f0 0x7f6c1c122340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:53.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.939+0000 7f6c21c4f700 1 --2- 172.21.15.26:0/1053446135 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6c1c09e000 0x7f6c1c122880 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:53.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.939+0000 7f6c21c4f700 1 -- 172.21.15.26:0/1053446135 >> 172.21.15.26:0/1053446135 conn(0x7f6c1c066f50 msgr2=0x7f6c1c130b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:53.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.940+0000 7f6c21c4f700 1 -- 172.21.15.26:0/1053446135 shutdown_connections 2023-10-01T07:59:53.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:53.940+0000 7f6c21c4f700 1 -- 172.21.15.26:0/1053446135 wait complete. 2023-10-01T07:59:53.954 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:54.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:54.031+0000 7f740f2af700 1 -- 172.21.15.26:0/611870003 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f740806b9e0 con 0x7f740809de50 2023-10-01T07:59:54.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:54.031+0000 7f73fdffb700 1 -- 172.21.15.26:0/611870003 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7404015030 con 0x7f740809de50 2023-10-01T07:59:54.032 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:54.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:54.034+0000 7f740f2af700 1 -- 172.21.15.26:0/611870003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f740809de50 msgr2=0x7f740811ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:54.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:54.034+0000 7f740f2af700 1 --2- 172.21.15.26:0/611870003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f740809de50 0x7f740811ec70 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f7404009fd0 tx=0x7f7404004750 comp rx=0 tx=0).stop 2023-10-01T07:59:54.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:54.034+0000 7f740f2af700 1 -- 172.21.15.26:0/611870003 shutdown_connections 2023-10-01T07:59:54.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:54.034+0000 7f740f2af700 1 --2- 172.21.15.26:0/611870003 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f74081338a0 0x7f740811f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:54.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:54.034+0000 7f740f2af700 1 --2- 172.21.15.26:0/611870003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f740809de50 0x7f740811ec70 secure :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f7404009fd0 tx=0x7f7404004750 comp rx=0 tx=0).stop 2023-10-01T07:59:54.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:54.034+0000 7f740f2af700 1 --2- 172.21.15.26:0/611870003 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f740809e930 0x7f740811f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:54.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:54.034+0000 7f740f2af700 1 -- 172.21.15.26:0/611870003 >> 172.21.15.26:0/611870003 conn(0x7f74080a2aa0 msgr2=0x7f740809ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:54.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:54.034+0000 7f740f2af700 1 -- 172.21.15.26:0/611870003 shutdown_connections 2023-10-01T07:59:54.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:54.034+0000 7f740f2af700 1 -- 172.21.15.26:0/611870003 wait complete. 2023-10-01T07:59:54.050 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:54.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:54.078+0000 7fd78225c700 1 -- 172.21.15.26:0/1588103593 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd77c121ba0 con 0x7fd77c0a0a30 2023-10-01T07:59:54.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:54.079+0000 7fd763fff700 1 -- 172.21.15.26:0/1588103593 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd77c121ba0 con 0x7fd77c0a0a30 2023-10-01T07:59:54.080 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:54.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:54.081+0000 7fd78225c700 1 -- 172.21.15.26:0/1588103593 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd77c0a0a30 msgr2=0x7fd77c11e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:54.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:54.081+0000 7fd78225c700 1 --2- 172.21.15.26:0/1588103593 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd77c0a0a30 0x7fd77c11e760 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fd76c00e810 tx=0x7fd76c00eb20 comp rx=0 tx=0).stop 2023-10-01T07:59:54.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:54.081+0000 7fd78225c700 1 -- 172.21.15.26:0/1588103593 shutdown_connections 2023-10-01T07:59:54.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:54.081+0000 7fd78225c700 1 --2- 172.21.15.26:0/1588103593 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd77c133fa0 0x7fd77c11f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:54.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:54.081+0000 7fd78225c700 1 --2- 172.21.15.26:0/1588103593 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd77c0a0a30 0x7fd77c11e760 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:54.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:54.081+0000 7fd78225c700 1 --2- 172.21.15.26:0/1588103593 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd77c0a1340 0x7fd77c11eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:54.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:54.081+0000 7fd78225c700 1 -- 172.21.15.26:0/1588103593 >> 172.21.15.26:0/1588103593 conn(0x7fd77c0a6550 msgr2=0x7fd77c0a5550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:54.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:54.081+0000 7fd78225c700 1 -- 172.21.15.26:0/1588103593 shutdown_connections 2023-10-01T07:59:54.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:54.081+0000 7fd78225c700 1 -- 172.21.15.26:0/1588103593 wait complete. 2023-10-01T07:59:54.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:54.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:54.106+0000 7ff145118700 1 -- 172.21.15.26:0/3289523709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff14006c360 con 0x7ff14009e000 2023-10-01T07:59:54.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:54.107+0000 7ff1277fe700 1 -- 172.21.15.26:0/3289523709 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff13400e280 con 0x7ff14009e000 2023-10-01T07:59:54.107 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:54.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:54.109+0000 7ff145118700 1 -- 172.21.15.26:0/3289523709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff14009e000 msgr2=0x7ff140122bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:54.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:54.109+0000 7ff145118700 1 --2- 172.21.15.26:0/3289523709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff14009e000 0x7ff140122bf0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7ff13400c780 tx=0x7ff13400ca90 comp rx=0 tx=0).stop 2023-10-01T07:59:54.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:54.109+0000 7ff145118700 1 -- 172.21.15.26:0/3289523709 shutdown_connections 2023-10-01T07:59:54.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:54.109+0000 7ff145118700 1 --2- 172.21.15.26:0/3289523709 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff14009e410 0x7ff140123130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:54.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:54.109+0000 7ff145118700 1 --2- 172.21.15.26:0/3289523709 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff14009d6f0 0x7ff1401226b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:54.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:54.109+0000 7ff145118700 1 --2- 172.21.15.26:0/3289523709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff14009e000 0x7ff140122bf0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:54.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:54.109+0000 7ff145118700 1 -- 172.21.15.26:0/3289523709 >> 172.21.15.26:0/3289523709 conn(0x7ff140066f50 msgr2=0x7ff14006f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:54.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:54.109+0000 7ff145118700 1 -- 172.21.15.26:0/3289523709 shutdown_connections 2023-10-01T07:59:54.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:54.109+0000 7ff145118700 1 -- 172.21.15.26:0/3289523709 wait complete. 2023-10-01T07:59:54.123 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:54.955 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:55.051 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:55.096 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:55.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.104+0000 7f4c906c4700 1 Processor -- start 2023-10-01T07:59:55.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.104+0000 7f4c906c4700 1 -- start start 2023-10-01T07:59:55.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.105+0000 7f4c906c4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c88134630 0x7f4c88136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:55.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.105+0000 7f4c906c4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c88136f50 0x7f4c88139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:55.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.105+0000 7f4c906c4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c8809b4f0 con 0x7f4c88131810 2023-10-01T07:59:55.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.105+0000 7f4c906c4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c881313c0 con 0x7f4c88136f50 2023-10-01T07:59:55.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.105+0000 7f4c906c4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8806e8c0 con 0x7f4c88134630 2023-10-01T07:59:55.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.105+0000 7f4c8dc5f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c88134630 0x7f4c88136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:55.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.105+0000 7f4c8dc5f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c88134630 0x7f4c88136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55860/0 (socket says 172.21.15.26:55860) 2023-10-01T07:59:55.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.105+0000 7f4c8e460700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4c88131810 0x7f4c88131be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36978/0 (socket says 172.21.15.26:36978) 2023-10-01T07:59:55.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.105+0000 7f4c8dc5f700 1 -- 172.21.15.26:0/3395826780 learned_addr learned my addr 172.21.15.26:0/3395826780 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:55.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.105+0000 7f4c8ec61700 1 --2- 172.21.15.26:0/3395826780 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c88136f50 0x7f4c88139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:55.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.105+0000 7f4c8dc5f700 1 -- 172.21.15.26:0/3395826780 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c88136f50 msgr2=0x7f4c88139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:55.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.105+0000 7f4c8dc5f700 1 --2- 172.21.15.26:0/3395826780 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c88136f50 0x7f4c88139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:55.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.105+0000 7f4c8dc5f700 1 -- 172.21.15.26:0/3395826780 >> v1:172.21.15.26:6789/0 conn(0x7f4c88131810 legacy=0x7f4c88131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:55.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.105+0000 7f4c8dc5f700 1 -- 172.21.15.26:0/3395826780 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c88071d20 con 0x7f4c88134630 2023-10-01T07:59:55.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.106+0000 7f4c8dc5f700 1 --2- 172.21.15.26:0/3395826780 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c88134630 0x7f4c88136a10 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f4c78009920 tx=0x7f4c78009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4e5ee9b3393f652 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:55.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.106+0000 7f4c8d45e700 1 -- 172.21.15.26:0/3395826780 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c78011830 con 0x7f4c88134630 2023-10-01T07:59:55.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.106+0000 7f4c8d45e700 1 -- 172.21.15.26:0/3395826780 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c78011990 con 0x7f4c88134630 2023-10-01T07:59:55.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.106+0000 7f4c8d45e700 1 -- 172.21.15.26:0/3395826780 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c78011d20 con 0x7f4c88134630 2023-10-01T07:59:55.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.107+0000 7f4c906c4700 1 -- 172.21.15.26:0/3395826780 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c88134630 msgr2=0x7f4c88136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:55.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.107+0000 7f4c906c4700 1 --2- 172.21.15.26:0/3395826780 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c88134630 0x7f4c88136a10 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f4c78009920 tx=0x7f4c78009c30 comp rx=0 tx=0).stop 2023-10-01T07:59:55.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.107+0000 7f4c906c4700 1 -- 172.21.15.26:0/3395826780 shutdown_connections 2023-10-01T07:59:55.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.107+0000 7f4c906c4700 1 --2- 172.21.15.26:0/3395826780 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c88136f50 0x7f4c88139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:55.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.107+0000 7f4c906c4700 1 --2- 172.21.15.26:0/3395826780 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c88134630 0x7f4c88136a10 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:55.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.107+0000 7f4c906c4700 1 -- 172.21.15.26:0/3395826780 >> 172.21.15.26:0/3395826780 conn(0x7f4c880a2aa0 msgr2=0x7f4c880a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:55.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.107+0000 7f4c906c4700 1 -- 172.21.15.26:0/3395826780 shutdown_connections 2023-10-01T07:59:55.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.107+0000 7f4c906c4700 1 -- 172.21.15.26:0/3395826780 wait complete. 2023-10-01T07:59:55.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.108+0000 7f4c906c4700 1 Processor -- start 2023-10-01T07:59:55.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.108+0000 7f4c906c4700 1 -- start start 2023-10-01T07:59:55.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.108+0000 7f4c906c4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c88131810 0x7f4c8809d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:55.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.108+0000 7f4c906c4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c88134630 0x7f4c8809d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:55.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.108+0000 7f4c906c4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c88136f50 0x7f4c881c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:55.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.108+0000 7f4c906c4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8809cb70 con 0x7f4c88136f50 2023-10-01T07:59:55.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.108+0000 7f4c906c4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8812e910 con 0x7f4c88131810 2023-10-01T07:59:55.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.108+0000 7f4c906c4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8806eb00 con 0x7f4c88134630 2023-10-01T07:59:55.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.109+0000 7f4c8dc5f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c88134630 0x7f4c8809d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:55.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.109+0000 7f4c8ec61700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c88136f50 0x7f4c881c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:55.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.109+0000 7f4c8dc5f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c88134630 0x7f4c8809d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55862/0 (socket says 172.21.15.26:55862) 2023-10-01T07:59:55.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.109+0000 7f4c8dc5f700 1 -- 172.21.15.26:0/1903405784 learned_addr learned my addr 172.21.15.26:0/1903405784 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:55.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.109+0000 7f4c8e460700 1 --2- 172.21.15.26:0/1903405784 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c88131810 0x7f4c8809d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:55.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.109+0000 7f4c8dc5f700 1 -- 172.21.15.26:0/1903405784 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c88131810 msgr2=0x7f4c8809d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:55.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.109+0000 7f4c8dc5f700 1 --2- 172.21.15.26:0/1903405784 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c88131810 0x7f4c8809d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:55.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.109+0000 7f4c8dc5f700 1 -- 172.21.15.26:0/1903405784 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c88136f50 msgr2=0x7f4c881c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:55.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.109+0000 7f4c8dc5f700 1 --2- 172.21.15.26:0/1903405784 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c88136f50 0x7f4c881c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:55.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.109+0000 7f4c8dc5f700 1 -- 172.21.15.26:0/1903405784 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c78009550 con 0x7f4c88134630 2023-10-01T07:59:55.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.109+0000 7f4c8e460700 1 --2- 172.21.15.26:0/1903405784 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c88131810 0x7f4c8809d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:55.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.109+0000 7f4c8dc5f700 1 --2- 172.21.15.26:0/1903405784 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c88134630 0x7f4c8809d560 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f4c780098f0 tx=0x7f4c78004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:55.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.110+0000 7f4c7effd700 1 -- 172.21.15.26:0/1903405784 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c78004450 con 0x7f4c88134630 2023-10-01T07:59:55.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.110+0000 7f4c7effd700 1 -- 172.21.15.26:0/1903405784 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c780045b0 con 0x7f4c88134630 2023-10-01T07:59:55.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.110+0000 7f4c906c4700 1 -- 172.21.15.26:0/1903405784 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c8811e510 con 0x7f4c88134630 2023-10-01T07:59:55.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.110+0000 7f4c7effd700 1 -- 172.21.15.26:0/1903405784 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c780038c0 con 0x7f4c88134630 2023-10-01T07:59:55.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.110+0000 7f4c906c4700 1 -- 172.21.15.26:0/1903405784 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c8809db00 con 0x7f4c88134630 2023-10-01T07:59:55.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.111+0000 7f4c7effd700 1 -- 172.21.15.26:0/1903405784 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4c78003a20 con 0x7f4c88134630 2023-10-01T07:59:55.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.111+0000 7f4c7effd700 1 -- 172.21.15.26:0/1903405784 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4c78021030 con 0x7f4c88134630 2023-10-01T07:59:55.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.111+0000 7f4c906c4700 1 -- 172.21.15.26:0/1903405784 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c88074ea0 con 0x7f4c88134630 2023-10-01T07:59:55.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.116+0000 7f4c7effd700 1 -- 172.21.15.26:0/1903405784 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4c78003cd0 con 0x7f4c88134630 2023-10-01T07:59:55.127 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:55.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.199+0000 7fc4bdfe4700 1 Processor -- start 2023-10-01T07:59:55.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.199+0000 7fc4bdfe4700 1 -- start start 2023-10-01T07:59:55.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.200+0000 7fc4bdfe4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4b809d6f0 0x7fc4b809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:55.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.200+0000 7fc4bdfe4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4b809e000 0x7fc4b8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:55.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.200+0000 7fc4bdfe4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc4b809e410 0x7fc4b8130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:55.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.200+0000 7fc4bdfe4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4b809f520 con 0x7fc4b809e410 2023-10-01T07:59:55.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.200+0000 7fc4bdfe4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b809f130 con 0x7fc4b809d6f0 2023-10-01T07:59:55.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.200+0000 7fc4bdfe4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b809e930 con 0x7fc4b809e000 2023-10-01T07:59:55.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.200+0000 7fc4b7fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc4b809e410 0x7fc4b8130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:55.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.200+0000 7fc4b77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4b809d6f0 0x7fc4b809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:55.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.200+0000 7fc4b6ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4b809e000 0x7fc4b8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:55.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.200+0000 7fc4b77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4b809d6f0 0x7fc4b809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44516/0 (socket says 172.21.15.26:44516) 2023-10-01T07:59:55.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.200+0000 7fc4b7fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc4b809e410 0x7fc4b8130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35260/0 (socket says 172.21.15.26:35260) 2023-10-01T07:59:55.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.200+0000 7fc4b77fe700 1 -- 172.21.15.26:0/642436486 learned_addr learned my addr 172.21.15.26:0/642436486 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:55.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.201+0000 7fc4b6ffd700 1 -- 172.21.15.26:0/642436486 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4b809d6f0 msgr2=0x7fc4b809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:55.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.201+0000 7fc4b6ffd700 1 --2- 172.21.15.26:0/642436486 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4b809d6f0 0x7fc4b809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:55.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.201+0000 7fc4b6ffd700 1 -- 172.21.15.26:0/642436486 >> v2:172.21.15.26:3300/0 conn(0x7fc4b809e410 msgr2=0x7fc4b8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:55.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.201+0000 7fc4b6ffd700 1 --2- 172.21.15.26:0/642436486 >> v2:172.21.15.26:3300/0 conn(0x7fc4b809e410 0x7fc4b8130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:55.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.201+0000 7fc4b6ffd700 1 -- 172.21.15.26:0/642436486 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b809b2d0 con 0x7fc4b809e000 2023-10-01T07:59:55.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.201+0000 7fc4b7fff700 1 --2- 172.21.15.26:0/642436486 >> v2:172.21.15.26:3300/0 conn(0x7fc4b809e410 0x7fc4b8130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:55.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.201+0000 7fc4b6ffd700 1 --2- 172.21.15.26:0/642436486 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4b809e000 0x7fc4b8130660 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac009870 tx=0x7fc4ac009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95e47909bdfd8030 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:55.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.201+0000 7fc4b67fc700 1 -- 172.21.15.26:0/642436486 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac011830 con 0x7fc4b809e000 2023-10-01T07:59:55.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.201+0000 7fc4b67fc700 1 -- 172.21.15.26:0/642436486 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ac011990 con 0x7fc4b809e000 2023-10-01T07:59:55.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.201+0000 7fc4b67fc700 1 -- 172.21.15.26:0/642436486 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac011d20 con 0x7fc4b809e000 2023-10-01T07:59:55.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.202+0000 7fc4bdfe4700 1 -- 172.21.15.26:0/642436486 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4b809e000 msgr2=0x7fc4b8130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:55.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.202+0000 7fc4bdfe4700 1 --2- 172.21.15.26:0/642436486 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4b809e000 0x7fc4b8130660 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac009870 tx=0x7fc4ac009b80 comp rx=0 tx=0).stop 2023-10-01T07:59:55.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.202+0000 7fc4bdfe4700 1 -- 172.21.15.26:0/642436486 shutdown_connections 2023-10-01T07:59:55.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.202+0000 7fc4bdfe4700 1 --2- 172.21.15.26:0/642436486 >> v2:172.21.15.26:3300/0 conn(0x7fc4b809e410 0x7fc4b8130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:55.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.202+0000 7fc4bdfe4700 1 --2- 172.21.15.26:0/642436486 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4b809d6f0 0x7fc4b809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:55.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.202+0000 7fc4bdfe4700 1 --2- 172.21.15.26:0/642436486 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4b809e000 0x7fc4b8130660 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:55.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.202+0000 7fc4bdfe4700 1 -- 172.21.15.26:0/642436486 >> 172.21.15.26:0/642436486 conn(0x7fc4b8066f50 msgr2=0x7fc4b809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:55.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.202+0000 7fc4bdfe4700 1 -- 172.21.15.26:0/642436486 shutdown_connections 2023-10-01T07:59:55.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.202+0000 7fc4bdfe4700 1 -- 172.21.15.26:0/642436486 wait complete. 2023-10-01T07:59:55.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.203+0000 7fc4bdfe4700 1 Processor -- start 2023-10-01T07:59:55.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.203+0000 7fc4bdfe4700 1 -- start start 2023-10-01T07:59:55.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.204+0000 7fc4bdfe4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4b809d6f0 0x7fc4b81c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:55.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.204+0000 7fc4bdfe4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4b809e000 0x7fc4b81c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:55.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.204+0000 7fc4bdfe4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4b809e410 0x7fc4b8131490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:55.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.204+0000 7fc4bdfe4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b81c8210 con 0x7fc4b809d6f0 2023-10-01T07:59:55.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.204+0000 7fc4bdfe4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b8133860 con 0x7fc4b809e410 2023-10-01T07:59:55.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.204+0000 7fc4bdfe4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b8134fd0 con 0x7fc4b809e000 2023-10-01T07:59:55.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.204+0000 7fc4b6ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4b809e000 0x7fc4b81c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:55.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.204+0000 7fc4b6ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4b809e000 0x7fc4b81c8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55880/0 (socket says 172.21.15.26:55880) 2023-10-01T07:59:55.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.204+0000 7fc4b6ffd700 1 -- 172.21.15.26:0/2562865083 learned_addr learned my addr 172.21.15.26:0/2562865083 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:55.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.204+0000 7fc4b77fe700 1 --2- 172.21.15.26:0/2562865083 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4b809d6f0 0x7fc4b81c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:55.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.204+0000 7fc4b7fff700 1 --2- 172.21.15.26:0/2562865083 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4b809e410 0x7fc4b8131490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:55.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.205+0000 7fc4b6ffd700 1 -- 172.21.15.26:0/2562865083 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4b809e410 msgr2=0x7fc4b8131490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:55.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.205+0000 7fc4b6ffd700 1 --2- 172.21.15.26:0/2562865083 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4b809e410 0x7fc4b8131490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:55.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.205+0000 7fc4b6ffd700 1 -- 172.21.15.26:0/2562865083 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4b809d6f0 msgr2=0x7fc4b81c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:55.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.205+0000 7fc4b6ffd700 1 --2- 172.21.15.26:0/2562865083 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4b809d6f0 0x7fc4b81c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:55.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.205+0000 7fc4b6ffd700 1 -- 172.21.15.26:0/2562865083 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b0009a70 con 0x7fc4b809e000 2023-10-01T07:59:55.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.205+0000 7fc4b77fe700 1 --2- 172.21.15.26:0/2562865083 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4b809d6f0 0x7fc4b81c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:55.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.205+0000 7fc4b6ffd700 1 --2- 172.21.15.26:0/2562865083 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4b809e000 0x7fc4b81c8b10 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac0090b0 tx=0x7fc4ac004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:55.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.205+0000 7fc49ffff700 1 -- 172.21.15.26:0/2562865083 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac004450 con 0x7fc4b809e000 2023-10-01T07:59:55.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.205+0000 7fc49ffff700 1 -- 172.21.15.26:0/2562865083 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ac01f070 con 0x7fc4b809e000 2023-10-01T07:59:55.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.205+0000 7fc4bdfe4700 1 -- 172.21.15.26:0/2562865083 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4ac0094a0 con 0x7fc4b809e000 2023-10-01T07:59:55.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.205+0000 7fc49ffff700 1 -- 172.21.15.26:0/2562865083 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac0038c0 con 0x7fc4b809e000 2023-10-01T07:59:55.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.206+0000 7fc49ffff700 1 -- 172.21.15.26:0/2562865083 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc4ac003a20 con 0x7fc4b809e000 2023-10-01T07:59:55.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.206+0000 7fc4bdfe4700 1 -- 172.21.15.26:0/2562865083 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4b809c700 con 0x7fc4b809e000 2023-10-01T07:59:55.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.208+0000 7fc49ffff700 1 -- 172.21.15.26:0/2562865083 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc4ac021070 con 0x7fc4b809e000 2023-10-01T07:59:55.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.208+0000 7fc4bdfe4700 1 -- 172.21.15.26:0/2562865083 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4b81c9050 con 0x7fc4b809e000 2023-10-01T07:59:55.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.217+0000 7fc49ffff700 1 -- 172.21.15.26:0/2562865083 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc4ac015030 con 0x7fc4b809e000 2023-10-01T07:59:55.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.254+0000 7ff7cd0b4700 1 Processor -- start 2023-10-01T07:59:55.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.254+0000 7ff7cd0b4700 1 -- start start 2023-10-01T07:59:55.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.255+0000 7ff7cd0b4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff7c809e1d0 0x7ff7c8138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:55.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.255+0000 7ff7cd0b4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7c8139170 0x7ff7c813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:55.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.255+0000 7ff7cd0b4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c809b120 con 0x7ff7c809d6f0 2023-10-01T07:59:55.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.255+0000 7ff7cd0b4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c806b460 con 0x7ff7c809e1d0 2023-10-01T07:59:55.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.255+0000 7ff7cd0b4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c809a7e0 con 0x7ff7c8139170 2023-10-01T07:59:55.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.255+0000 7ff7bffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff7c809e1d0 0x7ff7c8138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:55.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.255+0000 7ff7c759e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7c8139170 0x7ff7c813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:55.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.256+0000 7ff7bffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff7c809e1d0 0x7ff7c8138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35272/0 (socket says 172.21.15.26:35272) 2023-10-01T07:59:55.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.256+0000 7ff7bffff700 1 -- 172.21.15.26:0/1129438983 learned_addr learned my addr 172.21.15.26:0/1129438983 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:55.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.256+0000 7ff7c759e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7c8139170 0x7ff7c813b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44528/0 (socket says 172.21.15.26:44528) 2023-10-01T07:59:55.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.256+0000 7ff7bffff700 1 -- 172.21.15.26:0/1129438983 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7c8139170 msgr2=0x7ff7c813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:55.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.256+0000 7ff7bffff700 1 --2- 172.21.15.26:0/1129438983 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7c8139170 0x7ff7c813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:55.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.256+0000 7ff7bffff700 1 -- 172.21.15.26:0/1129438983 >> v1:172.21.15.26:6789/0 conn(0x7ff7c809d6f0 legacy=0x7ff7c809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:55.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.256+0000 7ff7bffff700 1 -- 172.21.15.26:0/1129438983 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c809a500 con 0x7ff7c809e1d0 2023-10-01T07:59:55.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.256+0000 7ff7c659c700 1 -- 172.21.15.26:0/1129438983 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 590765571 0 0) 0x7ff7c809b120 con 0x7ff7c809d6f0 2023-10-01T07:59:55.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.256+0000 7ff7c759e700 1 --2- 172.21.15.26:0/1129438983 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7c8139170 0x7ff7c813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:55.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.256+0000 7ff7bffff700 1 --2- 172.21.15.26:0/1129438983 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7c809e1d0 0x7ff7c8138c30 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0009920 tx=0x7ff7b0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31ded861736063f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:55.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.256+0000 7ff7c659c700 1 -- 172.21.15.26:0/1129438983 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b0011830 con 0x7ff7c809e1d0 2023-10-01T07:59:55.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.256+0000 7ff7c659c700 1 -- 172.21.15.26:0/1129438983 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b0011990 con 0x7ff7c809e1d0 2023-10-01T07:59:55.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.256+0000 7ff7c659c700 1 -- 172.21.15.26:0/1129438983 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b0011d20 con 0x7ff7c809e1d0 2023-10-01T07:59:55.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.257+0000 7ff7cd0b4700 1 -- 172.21.15.26:0/1129438983 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7c809e1d0 msgr2=0x7ff7c8138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:55.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.257+0000 7ff7cd0b4700 1 --2- 172.21.15.26:0/1129438983 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7c809e1d0 0x7ff7c8138c30 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0009920 tx=0x7ff7b0009c30 comp rx=0 tx=0).stop 2023-10-01T07:59:55.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.257+0000 7ff7cd0b4700 1 -- 172.21.15.26:0/1129438983 shutdown_connections 2023-10-01T07:59:55.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.257+0000 7ff7cd0b4700 1 --2- 172.21.15.26:0/1129438983 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7c8139170 0x7ff7c813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:55.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.258+0000 7ff7cd0b4700 1 --2- 172.21.15.26:0/1129438983 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7c809e1d0 0x7ff7c8138c30 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:55.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.258+0000 7ff7cd0b4700 1 -- 172.21.15.26:0/1129438983 >> 172.21.15.26:0/1129438983 conn(0x7ff7c8066f50 msgr2=0x7ff7c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:55.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.258+0000 7ff7cd0b4700 1 -- 172.21.15.26:0/1129438983 shutdown_connections 2023-10-01T07:59:55.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.258+0000 7ff7cd0b4700 1 -- 172.21.15.26:0/1129438983 wait complete. 2023-10-01T07:59:55.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.259+0000 7ff7cd0b4700 1 Processor -- start 2023-10-01T07:59:55.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.259+0000 7ff7cd0b4700 1 -- start start 2023-10-01T07:59:55.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.260+0000 7ff7cd0b4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7c809d6f0 0x7ff7c811e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:55.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.260+0000 7ff7cd0b4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7c809e1d0 0x7ff7c811ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:55.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.260+0000 7ff7cd0b4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff7c8139170 0x7ff7c811f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:55.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.260+0000 7ff7cd0b4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c8120480 con 0x7ff7c809d6f0 2023-10-01T07:59:55.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.260+0000 7ff7cd0b4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c8134580 con 0x7ff7c809e1d0 2023-10-01T07:59:55.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.260+0000 7ff7cd0b4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c809c710 con 0x7ff7c8139170 2023-10-01T07:59:55.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.260+0000 7ff7c6d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7c809d6f0 0x7ff7c811e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:55.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.260+0000 7ff7c6d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7c809d6f0 0x7ff7c811e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35284/0 (socket says 172.21.15.26:35284) 2023-10-01T07:59:55.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.260+0000 7ff7c6d9d700 1 -- 172.21.15.26:0/1774844707 learned_addr learned my addr 172.21.15.26:0/1774844707 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:55.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.260+0000 7ff7c759e700 1 --2- 172.21.15.26:0/1774844707 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff7c8139170 0x7ff7c811f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:55.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.260+0000 7ff7bffff700 1 --2- 172.21.15.26:0/1774844707 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7c809e1d0 0x7ff7c811ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:55.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.261+0000 7ff7c759e700 1 -- 172.21.15.26:0/1774844707 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7c809e1d0 msgr2=0x7ff7c811ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:55.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.261+0000 7ff7c759e700 1 --2- 172.21.15.26:0/1774844707 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7c809e1d0 0x7ff7c811ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:55.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.261+0000 7ff7c759e700 1 -- 172.21.15.26:0/1774844707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7c809d6f0 msgr2=0x7ff7c811e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:55.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.261+0000 7ff7c759e700 1 --2- 172.21.15.26:0/1774844707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7c809d6f0 0x7ff7c811e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:55.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.261+0000 7ff7c759e700 1 -- 172.21.15.26:0/1774844707 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c0009a70 con 0x7ff7c8139170 2023-10-01T07:59:55.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.261+0000 7ff7c759e700 1 --2- 172.21.15.26:0/1774844707 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff7c8139170 0x7ff7c811f360 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff7c000ef90 tx=0x7ff7c000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:55.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.261+0000 7ff7bf7fe700 1 -- 172.21.15.26:0/1774844707 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c000cc90 con 0x7ff7c8139170 2023-10-01T07:59:55.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.262+0000 7ff7bf7fe700 1 -- 172.21.15.26:0/1774844707 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c000f040 con 0x7ff7c8139170 2023-10-01T07:59:55.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.262+0000 7ff7bf7fe700 1 -- 172.21.15.26:0/1774844707 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c00146c0 con 0x7ff7c8139170 2023-10-01T07:59:55.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.262+0000 7ff7cd0b4700 1 -- 172.21.15.26:0/1774844707 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b0009550 con 0x7ff7c8139170 2023-10-01T07:59:55.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.262+0000 7ff7cd0b4700 1 -- 172.21.15.26:0/1774844707 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c81218c0 con 0x7ff7c8139170 2023-10-01T07:59:55.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.263+0000 7ff7cd0b4700 1 -- 172.21.15.26:0/1774844707 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c8121e10 con 0x7ff7c8139170 2023-10-01T07:59:55.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.263+0000 7ff7bf7fe700 1 -- 172.21.15.26:0/1774844707 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff7c0014820 con 0x7ff7c8139170 2023-10-01T07:59:55.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.264+0000 7ff7bf7fe700 1 -- 172.21.15.26:0/1774844707 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff7c0040430 con 0x7ff7c8139170 2023-10-01T07:59:55.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.269+0000 7ff7bf7fe700 1 -- 172.21.15.26:0/1774844707 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff7c0012930 con 0x7ff7c8139170 2023-10-01T07:59:55.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.281+0000 7fb35ccb8700 1 Processor -- start 2023-10-01T07:59:55.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.281+0000 7fb35ccb8700 1 -- start start 2023-10-01T07:59:55.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.282+0000 7fb35ccb8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb35809e930 0x7fb35809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:55.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.282+0000 7fb35ccb8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb35809f240 0x7fb3581317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:55.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.282+0000 7fb35ccb8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb358070940 con 0x7fb35809f650 2023-10-01T07:59:55.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.282+0000 7fb35ccb8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb35806fd60 con 0x7fb35809f240 2023-10-01T07:59:55.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.282+0000 7fb35ccb8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb35806fa80 con 0x7fb35809e930 2023-10-01T07:59:55.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.282+0000 7fb35659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb35809e930 0x7fb35809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:55.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.282+0000 7fb355d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb35809f240 0x7fb3581317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:55.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.282+0000 7fb355d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb35809f240 0x7fb3581317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44540/0 (socket says 172.21.15.26:44540) 2023-10-01T07:59:55.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.282+0000 7fb35659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb35809e930 0x7fb35809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55908/0 (socket says 172.21.15.26:55908) 2023-10-01T07:59:55.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.282+0000 7fb355d9b700 1 -- 172.21.15.26:0/1800405266 learned_addr learned my addr 172.21.15.26:0/1800405266 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:55.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.283+0000 7fb35559a700 1 -- 172.21.15.26:0/1800405266 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3333257392 0 0) 0x7fb358070940 con 0x7fb35809f650 2023-10-01T07:59:55.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.283+0000 7fb35559a700 1 -- 172.21.15.26:0/1800405266 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3400035b0 con 0x7fb35809f650 2023-10-01T07:59:55.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.283+0000 7fb35659c700 1 -- 172.21.15.26:0/1800405266 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb35809f240 msgr2=0x7fb3581317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:55.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.283+0000 7fb35659c700 1 --2- 172.21.15.26:0/1800405266 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb35809f240 0x7fb3581317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:55.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.283+0000 7fb35659c700 1 -- 172.21.15.26:0/1800405266 >> v1:172.21.15.26:6789/0 conn(0x7fb35809f650 legacy=0x7fb358131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:55.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.283+0000 7fb35659c700 1 -- 172.21.15.26:0/1800405266 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35809fb60 con 0x7fb35809e930 2023-10-01T07:59:55.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.283+0000 7fb355d9b700 1 --2- 172.21.15.26:0/1800405266 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb35809f240 0x7fb3581317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:55.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.283+0000 7fb35659c700 1 --2- 172.21.15.26:0/1800405266 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb35809e930 0x7fb35809ed00 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fb348009870 tx=0x7fb348009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67cc2b4c7b2e5c54 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:55.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.283+0000 7fb35559a700 1 -- 172.21.15.26:0/1800405266 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb348011830 con 0x7fb35809e930 2023-10-01T07:59:55.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.283+0000 7fb35559a700 1 -- 172.21.15.26:0/1800405266 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb348011990 con 0x7fb35809e930 2023-10-01T07:59:55.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.283+0000 7fb35559a700 1 -- 172.21.15.26:0/1800405266 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb348011d20 con 0x7fb35809e930 2023-10-01T07:59:55.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.284+0000 7fb35ccb8700 1 -- 172.21.15.26:0/1800405266 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb35809e930 msgr2=0x7fb35809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:55.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.284+0000 7fb35ccb8700 1 --2- 172.21.15.26:0/1800405266 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb35809e930 0x7fb35809ed00 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fb348009870 tx=0x7fb348009b80 comp rx=0 tx=0).stop 2023-10-01T07:59:55.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.285+0000 7fb35ccb8700 1 -- 172.21.15.26:0/1800405266 shutdown_connections 2023-10-01T07:59:55.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.285+0000 7fb35ccb8700 1 --2- 172.21.15.26:0/1800405266 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb35809e930 0x7fb35809ed00 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:55.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.285+0000 7fb35ccb8700 1 --2- 172.21.15.26:0/1800405266 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb35809f240 0x7fb3581317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:55.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.285+0000 7fb35ccb8700 1 -- 172.21.15.26:0/1800405266 >> 172.21.15.26:0/1800405266 conn(0x7fb3580a4210 msgr2=0x7fb3580a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:55.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.285+0000 7fb35ccb8700 1 -- 172.21.15.26:0/1800405266 shutdown_connections 2023-10-01T07:59:55.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.285+0000 7fb35ccb8700 1 -- 172.21.15.26:0/1800405266 wait complete. 2023-10-01T07:59:55.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.286+0000 7fb35ccb8700 1 Processor -- start 2023-10-01T07:59:55.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.286+0000 7fb35ccb8700 1 -- start start 2023-10-01T07:59:55.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.287+0000 7fb35ccb8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb35809e930 0x7fb35806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:55.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.287+0000 7fb35ccb8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb35809f240 0x7fb35806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:55.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.287+0000 7fb35ccb8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb35809f650 0x7fb35806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:55.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.287+0000 7fb35ccb8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3581a8760 con 0x7fb35809f240 2023-10-01T07:59:55.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.287+0000 7fb35ccb8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3581a97a0 con 0x7fb35809f650 2023-10-01T07:59:55.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.287+0000 7fb35ccb8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3580a32d0 con 0x7fb35809e930 2023-10-01T07:59:55.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.287+0000 7fb356d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb35809f650 0x7fb35806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:55.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.287+0000 7fb356d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb35809f650 0x7fb35806c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44548/0 (socket says 172.21.15.26:44548) 2023-10-01T07:59:55.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.287+0000 7fb356d9d700 1 -- 172.21.15.26:0/1784018903 learned_addr learned my addr 172.21.15.26:0/1784018903 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:55.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.287+0000 7fb355d9b700 1 --2- 172.21.15.26:0/1784018903 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb35809f240 0x7fb35806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:55.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.287+0000 7fb35659c700 1 --2- 172.21.15.26:0/1784018903 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb35809e930 0x7fb35806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:55.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.288+0000 7fb355d9b700 1 -- 172.21.15.26:0/1784018903 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb35809e930 msgr2=0x7fb35806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:55.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.288+0000 7fb355d9b700 1 --2- 172.21.15.26:0/1784018903 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb35809e930 0x7fb35806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:55.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.288+0000 7fb355d9b700 1 -- 172.21.15.26:0/1784018903 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb35809f650 msgr2=0x7fb35806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:55.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.288+0000 7fb355d9b700 1 --2- 172.21.15.26:0/1784018903 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb35809f650 0x7fb35806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:55.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.288+0000 7fb355d9b700 1 -- 172.21.15.26:0/1784018903 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34c009550 con 0x7fb35809f240 2023-10-01T07:59:55.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.288+0000 7fb356d9d700 1 --2- 172.21.15.26:0/1784018903 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb35809f650 0x7fb35806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:55.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.288+0000 7fb35659c700 1 --2- 172.21.15.26:0/1784018903 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb35809e930 0x7fb35806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:59:55.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.288+0000 7fb355d9b700 1 --2- 172.21.15.26:0/1784018903 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb35809f240 0x7fb35806bdf0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fb35806e6c0 tx=0x7fb34c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:55.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.288+0000 7fb346ffd700 1 -- 172.21.15.26:0/1784018903 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c00eec0 con 0x7fb35809f240 2023-10-01T07:59:55.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.288+0000 7fb346ffd700 1 -- 172.21.15.26:0/1784018903 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34c004240 con 0x7fb35809f240 2023-10-01T07:59:55.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.288+0000 7fb35ccb8700 1 -- 172.21.15.26:0/1784018903 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3480094a0 con 0x7fb35809f240 2023-10-01T07:59:55.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.288+0000 7fb346ffd700 1 -- 172.21.15.26:0/1784018903 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c0045b0 con 0x7fb35809f240 2023-10-01T07:59:55.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.288+0000 7fb35ccb8700 1 -- 172.21.15.26:0/1784018903 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3580a0190 con 0x7fb35809f240 2023-10-01T07:59:55.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.289+0000 7fb346ffd700 1 -- 172.21.15.26:0/1784018903 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb34c0036a0 con 0x7fb35809f240 2023-10-01T07:59:55.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.289+0000 7fb35ccb8700 1 -- 172.21.15.26:0/1784018903 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3581a0b30 con 0x7fb35809f240 2023-10-01T07:59:55.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.290+0000 7fb346ffd700 1 -- 172.21.15.26:0/1784018903 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb34c03f7f0 con 0x7fb35809f240 2023-10-01T07:59:55.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.294+0000 7fb346ffd700 1 -- 172.21.15.26:0/1784018903 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb34c01be10 con 0x7fb35809f240 2023-10-01T07:59:55.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.352+0000 7f4c906c4700 1 -- 172.21.15.26:0/1903405784 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4c8811e960 con 0x7f4c88134630 2023-10-01T07:59:55.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.352+0000 7f4c7effd700 1 -- 172.21.15.26:0/1903405784 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4c7802b030 con 0x7f4c88134630 2023-10-01T07:59:55.353 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:55.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.354+0000 7f4c906c4700 1 -- 172.21.15.26:0/1903405784 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c88134630 msgr2=0x7f4c8809d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:55.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.354+0000 7f4c906c4700 1 --2- 172.21.15.26:0/1903405784 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c88134630 0x7f4c8809d560 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f4c780098f0 tx=0x7f4c78004750 comp rx=0 tx=0).stop 2023-10-01T07:59:55.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.354+0000 7f4c906c4700 1 -- 172.21.15.26:0/1903405784 shutdown_connections 2023-10-01T07:59:55.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.354+0000 7f4c906c4700 1 --2- 172.21.15.26:0/1903405784 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c88136f50 0x7f4c881c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:55.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.355+0000 7f4c906c4700 1 --2- 172.21.15.26:0/1903405784 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c88131810 0x7f4c8809d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:55.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.355+0000 7f4c906c4700 1 --2- 172.21.15.26:0/1903405784 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c88134630 0x7f4c8809d560 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:55.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.355+0000 7f4c906c4700 1 -- 172.21.15.26:0/1903405784 >> 172.21.15.26:0/1903405784 conn(0x7f4c880a2aa0 msgr2=0x7f4c88133250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:55.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.355+0000 7f4c906c4700 1 -- 172.21.15.26:0/1903405784 shutdown_connections 2023-10-01T07:59:55.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.355+0000 7f4c906c4700 1 -- 172.21.15.26:0/1903405784 wait complete. 2023-10-01T07:59:55.369 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:55.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.432+0000 7fc4bdfe4700 1 -- 172.21.15.26:0/2562865083 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc4b8074ea0 con 0x7fc4b809e000 2023-10-01T07:59:55.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.433+0000 7fc49ffff700 1 -- 172.21.15.26:0/2562865083 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc4ac01a430 con 0x7fc4b809e000 2023-10-01T07:59:55.434 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:55.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.439+0000 7fc4bdfe4700 1 -- 172.21.15.26:0/2562865083 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4b809e000 msgr2=0x7fc4b81c8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:55.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.439+0000 7fc4bdfe4700 1 --2- 172.21.15.26:0/2562865083 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4b809e000 0x7fc4b81c8b10 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac0090b0 tx=0x7fc4ac004750 comp rx=0 tx=0).stop 2023-10-01T07:59:55.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.439+0000 7fc4bdfe4700 1 -- 172.21.15.26:0/2562865083 shutdown_connections 2023-10-01T07:59:55.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.439+0000 7fc4bdfe4700 1 --2- 172.21.15.26:0/2562865083 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4b809e410 0x7fc4b8131490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:55.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.439+0000 7fc4bdfe4700 1 --2- 172.21.15.26:0/2562865083 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4b809d6f0 0x7fc4b81c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:55.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.439+0000 7fc4bdfe4700 1 --2- 172.21.15.26:0/2562865083 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc4b809e000 0x7fc4b81c8b10 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:55.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.439+0000 7fc4bdfe4700 1 -- 172.21.15.26:0/2562865083 >> 172.21.15.26:0/2562865083 conn(0x7fc4b8066f50 msgr2=0x7fc4b806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:55.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.439+0000 7fc4bdfe4700 1 -- 172.21.15.26:0/2562865083 shutdown_connections 2023-10-01T07:59:55.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.439+0000 7fc4bdfe4700 1 -- 172.21.15.26:0/2562865083 wait complete. 2023-10-01T07:59:55.459 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:55.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.490+0000 7ff7cd0b4700 1 -- 172.21.15.26:0/1774844707 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff7c8074ea0 con 0x7ff7c8139170 2023-10-01T07:59:55.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.490+0000 7ff7bf7fe700 1 -- 172.21.15.26:0/1774844707 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff7c0012340 con 0x7ff7c8139170 2023-10-01T07:59:55.491 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:55.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.492+0000 7ff7cd0b4700 1 -- 172.21.15.26:0/1774844707 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff7c8139170 msgr2=0x7ff7c811f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:55.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.492+0000 7ff7cd0b4700 1 --2- 172.21.15.26:0/1774844707 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff7c8139170 0x7ff7c811f360 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff7c000ef90 tx=0x7ff7c000c3a0 comp rx=0 tx=0).stop 2023-10-01T07:59:55.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.492+0000 7ff7cd0b4700 1 -- 172.21.15.26:0/1774844707 shutdown_connections 2023-10-01T07:59:55.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.492+0000 7ff7cd0b4700 1 --2- 172.21.15.26:0/1774844707 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff7c8139170 0x7ff7c811f360 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:55.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.492+0000 7ff7cd0b4700 1 --2- 172.21.15.26:0/1774844707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7c809d6f0 0x7ff7c811e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:55.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.492+0000 7ff7cd0b4700 1 --2- 172.21.15.26:0/1774844707 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7c809e1d0 0x7ff7c811ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:55.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.492+0000 7ff7cd0b4700 1 -- 172.21.15.26:0/1774844707 >> 172.21.15.26:0/1774844707 conn(0x7ff7c8066f50 msgr2=0x7ff7c8136c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:55.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.492+0000 7ff7cd0b4700 1 -- 172.21.15.26:0/1774844707 shutdown_connections 2023-10-01T07:59:55.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.493+0000 7ff7cd0b4700 1 -- 172.21.15.26:0/1774844707 wait complete. 2023-10-01T07:59:55.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.505+0000 7fb35ccb8700 1 -- 172.21.15.26:0/1784018903 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb358074ea0 con 0x7fb35809f240 2023-10-01T07:59:55.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.506+0000 7fb346ffd700 1 -- 172.21.15.26:0/1784018903 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb34c01b3b0 con 0x7fb35809f240 2023-10-01T07:59:55.507 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:55.508 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:55.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.508+0000 7fb35ccb8700 1 -- 172.21.15.26:0/1784018903 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb35809f240 msgr2=0x7fb35806bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:55.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.508+0000 7fb35ccb8700 1 --2- 172.21.15.26:0/1784018903 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb35809f240 0x7fb35806bdf0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fb35806e6c0 tx=0x7fb34c00ec80 comp rx=0 tx=0).stop 2023-10-01T07:59:55.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.508+0000 7fb35ccb8700 1 -- 172.21.15.26:0/1784018903 shutdown_connections 2023-10-01T07:59:55.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.508+0000 7fb35ccb8700 1 --2- 172.21.15.26:0/1784018903 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb35809f650 0x7fb35806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:55.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.508+0000 7fb35ccb8700 1 --2- 172.21.15.26:0/1784018903 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb35809e930 0x7fb35806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:55.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.508+0000 7fb35ccb8700 1 --2- 172.21.15.26:0/1784018903 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb35809f240 0x7fb35806bdf0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:55.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.508+0000 7fb35ccb8700 1 -- 172.21.15.26:0/1784018903 >> 172.21.15.26:0/1784018903 conn(0x7fb3580a4210 msgr2=0x7fb3581b8a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:55.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.508+0000 7fb35ccb8700 1 -- 172.21.15.26:0/1784018903 shutdown_connections 2023-10-01T07:59:55.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:55.508+0000 7fb35ccb8700 1 -- 172.21.15.26:0/1784018903 wait complete. 2023-10-01T07:59:55.522 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:56.371 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:56.459 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:56.509 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:56.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.519+0000 7f29de31f700 1 Processor -- start 2023-10-01T07:59:56.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.519+0000 7f29de31f700 1 -- start start 2023-10-01T07:59:56.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.520+0000 7f29de31f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f29d81305f0 0x7f29d81309c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:56.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.520+0000 7f29de31f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29d806f660 0x7f29d806fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:56.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.520+0000 7f29de31f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29d806ff90 0x7f29d8137530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:56.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.520+0000 7f29de31f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29d81301c0 con 0x7f29d81305f0 2023-10-01T07:59:56.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.520+0000 7f29de31f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d8071ff0 con 0x7f29d806ff90 2023-10-01T07:59:56.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.520+0000 7f29de31f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29d8070e70 con 0x7f29d806f660 2023-10-01T07:59:56.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.520+0000 7f29d77fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29d806f660 0x7f29d806fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:56.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.520+0000 7f29d7fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f29d81305f0 0x7f29d81309c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:56.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.520+0000 7f29d77fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29d806f660 0x7f29d806fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55918/0 (socket says 172.21.15.26:55918) 2023-10-01T07:59:56.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.520+0000 7f29d7fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f29d81305f0 0x7f29d81309c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35298/0 (socket says 172.21.15.26:35298) 2023-10-01T07:59:56.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.520+0000 7f29d77fe700 1 -- 172.21.15.26:0/1556181045 learned_addr learned my addr 172.21.15.26:0/1556181045 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:56.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.520+0000 7f29dc8bc700 1 --2- 172.21.15.26:0/1556181045 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29d806ff90 0x7f29d8137530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:56.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.521+0000 7f29d7fff700 1 -- 172.21.15.26:0/1556181045 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29d806f660 msgr2=0x7f29d806fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:56.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.521+0000 7f29d7fff700 1 --2- 172.21.15.26:0/1556181045 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29d806f660 0x7f29d806fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:56.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.521+0000 7f29d7fff700 1 -- 172.21.15.26:0/1556181045 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29d806ff90 msgr2=0x7f29d8137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:56.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.521+0000 7f29d7fff700 1 --2- 172.21.15.26:0/1556181045 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29d806ff90 0x7f29d8137530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:56.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.521+0000 7f29d7fff700 1 -- 172.21.15.26:0/1556181045 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d80722b0 con 0x7f29d81305f0 2023-10-01T07:59:56.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.521+0000 7f29d7fff700 1 --2- 172.21.15.26:0/1556181045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29d81305f0 0x7f29d81309c0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f29c800bae0 tx=0x7f29c800bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1c9daa04f3c6984 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:56.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.521+0000 7f29d6ffd700 1 -- 172.21.15.26:0/1556181045 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c800dc70 con 0x7f29d81305f0 2023-10-01T07:59:56.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.521+0000 7f29d6ffd700 1 -- 172.21.15.26:0/1556181045 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c800ddd0 con 0x7f29d81305f0 2023-10-01T07:59:56.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.521+0000 7f29d6ffd700 1 -- 172.21.15.26:0/1556181045 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c8010690 con 0x7f29d81305f0 2023-10-01T07:59:56.524 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:56.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.522+0000 7f29de31f700 1 -- 172.21.15.26:0/1556181045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29d81305f0 msgr2=0x7f29d81309c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:56.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.522+0000 7f29de31f700 1 --2- 172.21.15.26:0/1556181045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29d81305f0 0x7f29d81309c0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f29c800bae0 tx=0x7f29c800bdf0 comp rx=0 tx=0).stop 2023-10-01T07:59:56.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.522+0000 7f29de31f700 1 -- 172.21.15.26:0/1556181045 shutdown_connections 2023-10-01T07:59:56.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.522+0000 7f29de31f700 1 --2- 172.21.15.26:0/1556181045 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29d806ff90 0x7f29d8137530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:56.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.522+0000 7f29de31f700 1 --2- 172.21.15.26:0/1556181045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29d81305f0 0x7f29d81309c0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:56.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.522+0000 7f29de31f700 1 --2- 172.21.15.26:0/1556181045 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29d806f660 0x7f29d806fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:56.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.522+0000 7f29de31f700 1 -- 172.21.15.26:0/1556181045 >> 172.21.15.26:0/1556181045 conn(0x7f29d80a2aa0 msgr2=0x7f29d80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:56.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.522+0000 7f29de31f700 1 -- 172.21.15.26:0/1556181045 shutdown_connections 2023-10-01T07:59:56.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.522+0000 7f29de31f700 1 -- 172.21.15.26:0/1556181045 wait complete. 2023-10-01T07:59:56.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.523+0000 7f29de31f700 1 Processor -- start 2023-10-01T07:59:56.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.523+0000 7f29de31f700 1 -- start start 2023-10-01T07:59:56.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.524+0000 7f29de31f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29d806f660 0x7f29d812d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:56.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.524+0000 7f29de31f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29d806ff90 0x7f29d811a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:56.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.524+0000 7f29de31f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29d81305f0 0x7f29d811aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:56.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.524+0000 7f29de31f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d811e9d0 con 0x7f29d806ff90 2023-10-01T07:59:56.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.524+0000 7f29de31f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d811e010 con 0x7f29d806f660 2023-10-01T07:59:56.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.524+0000 7f29de31f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29d811d7a0 con 0x7f29d81305f0 2023-10-01T07:59:56.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.524+0000 7f29d7fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29d806f660 0x7f29d812d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:56.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.524+0000 7f29d7fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29d806f660 0x7f29d812d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44566/0 (socket says 172.21.15.26:44566) 2023-10-01T07:59:56.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.524+0000 7f29d7fff700 1 -- 172.21.15.26:0/2936461783 learned_addr learned my addr 172.21.15.26:0/2936461783 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:56.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.524+0000 7f29dc8bc700 1 --2- 172.21.15.26:0/2936461783 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29d81305f0 0x7f29d811aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:56.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.524+0000 7f29d77fe700 1 --2- 172.21.15.26:0/2936461783 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29d806ff90 0x7f29d811a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:56.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.524+0000 7f29d7fff700 1 -- 172.21.15.26:0/2936461783 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29d81305f0 msgr2=0x7f29d811aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:56.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.524+0000 7f29d7fff700 1 --2- 172.21.15.26:0/2936461783 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29d81305f0 0x7f29d811aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:56.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.524+0000 7f29d7fff700 1 -- 172.21.15.26:0/2936461783 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29d806ff90 msgr2=0x7f29d811a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:56.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.524+0000 7f29d7fff700 1 --2- 172.21.15.26:0/2936461783 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29d806ff90 0x7f29d811a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:56.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.525+0000 7f29d7fff700 1 -- 172.21.15.26:0/2936461783 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c800b740 con 0x7f29d806f660 2023-10-01T07:59:56.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.525+0000 7f29d77fe700 1 --2- 172.21.15.26:0/2936461783 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29d806ff90 0x7f29d811a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T07:59:56.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.525+0000 7f29d7fff700 1 --2- 172.21.15.26:0/2936461783 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29d806f660 0x7f29d812d8e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f29c800be30 tx=0x7f29c8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:56.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.525+0000 7f29d4ff9700 1 -- 172.21.15.26:0/2936461783 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c801d070 con 0x7f29d806f660 2023-10-01T07:59:56.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.525+0000 7f29d4ff9700 1 -- 172.21.15.26:0/2936461783 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c801e040 con 0x7f29d806f660 2023-10-01T07:59:56.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.525+0000 7f29d4ff9700 1 -- 172.21.15.26:0/2936461783 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c8003cd0 con 0x7f29d806f660 2023-10-01T07:59:56.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.525+0000 7f29de31f700 1 -- 172.21.15.26:0/2936461783 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d811d350 con 0x7f29d806f660 2023-10-01T07:59:56.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.525+0000 7f29de31f700 1 -- 172.21.15.26:0/2936461783 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d812ebd0 con 0x7f29d806f660 2023-10-01T07:59:56.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.526+0000 7f29d4ff9700 1 -- 172.21.15.26:0/2936461783 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f29c8023460 con 0x7f29d806f660 2023-10-01T07:59:56.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.526+0000 7f29d4ff9700 1 -- 172.21.15.26:0/2936461783 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f29c8040be0 con 0x7f29d806f660 2023-10-01T07:59:56.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.526+0000 7f29de31f700 1 -- 172.21.15.26:0/2936461783 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29d8074ea0 con 0x7f29d806f660 2023-10-01T07:59:56.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.533+0000 7f29d4ff9700 1 -- 172.21.15.26:0/2936461783 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f29c802b960 con 0x7f29d806f660 2023-10-01T07:59:56.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.615+0000 7f830cdea700 1 Processor -- start 2023-10-01T07:59:56.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.615+0000 7f830cdea700 1 -- start start 2023-10-01T07:59:56.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.616+0000 7f830cdea700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f830809d6f0 0x7f830809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:56.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.616+0000 7f830cdea700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f830809e440 0x7f8308134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:56.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.616+0000 7f830cdea700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f830809b120 con 0x7f830809e000 2023-10-01T07:59:56.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.616+0000 7f830cdea700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f830806b460 con 0x7f830809d6f0 2023-10-01T07:59:56.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.616+0000 7f830cdea700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f830809a7e0 con 0x7f830809e440 2023-10-01T07:59:56.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.616+0000 7f830659c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f830809d6f0 0x7f830809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:56.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.616+0000 7f830659c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f830809d6f0 0x7f830809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35328/0 (socket says 172.21.15.26:35328) 2023-10-01T07:59:56.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.616+0000 7f830659c700 1 -- 172.21.15.26:0/4137289863 learned_addr learned my addr 172.21.15.26:0/4137289863 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:56.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.616+0000 7f8306d9d700 1 --2- 172.21.15.26:0/4137289863 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f830809e440 0x7f8308134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:56.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.617+0000 7f830659c700 1 -- 172.21.15.26:0/4137289863 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f830809e440 msgr2=0x7f8308134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:56.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.617+0000 7f830659c700 1 --2- 172.21.15.26:0/4137289863 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f830809e440 0x7f8308134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:56.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.617+0000 7f830659c700 1 -- 172.21.15.26:0/4137289863 >> v1:172.21.15.26:6789/0 conn(0x7f830809e000 legacy=0x7f83081339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:56.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.617+0000 7f830659c700 1 -- 172.21.15.26:0/4137289863 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f830809a500 con 0x7f830809d6f0 2023-10-01T07:59:56.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.617+0000 7f830659c700 1 --2- 172.21.15.26:0/4137289863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f830809d6f0 0x7f830809dac0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f82f8009920 tx=0x7f82f8009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f68ab3c43e228eb server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:56.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.617+0000 7f830559a700 1 -- 172.21.15.26:0/4137289863 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f800ba20 con 0x7f830809d6f0 2023-10-01T07:59:56.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.617+0000 7f830559a700 1 -- 172.21.15.26:0/4137289863 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f800bb80 con 0x7f830809d6f0 2023-10-01T07:59:56.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.617+0000 7f830559a700 1 -- 172.21.15.26:0/4137289863 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f8009e70 con 0x7f830809d6f0 2023-10-01T07:59:56.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.618+0000 7f830cdea700 1 -- 172.21.15.26:0/4137289863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f830809d6f0 msgr2=0x7f830809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:56.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.618+0000 7f830cdea700 1 --2- 172.21.15.26:0/4137289863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f830809d6f0 0x7f830809dac0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f82f8009920 tx=0x7f82f8009c30 comp rx=0 tx=0).stop 2023-10-01T07:59:56.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.618+0000 7f830cdea700 1 -- 172.21.15.26:0/4137289863 shutdown_connections 2023-10-01T07:59:56.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.618+0000 7f830cdea700 1 --2- 172.21.15.26:0/4137289863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f830809d6f0 0x7f830809dac0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:56.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.618+0000 7f830cdea700 1 --2- 172.21.15.26:0/4137289863 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f830809e440 0x7f8308134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:56.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.618+0000 7f830cdea700 1 -- 172.21.15.26:0/4137289863 >> 172.21.15.26:0/4137289863 conn(0x7f8308066f50 msgr2=0x7f830809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:56.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.618+0000 7f830cdea700 1 -- 172.21.15.26:0/4137289863 shutdown_connections 2023-10-01T07:59:56.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.618+0000 7f830cdea700 1 -- 172.21.15.26:0/4137289863 wait complete. 2023-10-01T07:59:56.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.619+0000 7f830cdea700 1 Processor -- start 2023-10-01T07:59:56.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.620+0000 7f830cdea700 1 -- start start 2023-10-01T07:59:56.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.620+0000 7f830cdea700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f830809d6f0 0x7f83081a5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:56.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.620+0000 7f830cdea700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f830809e000 0x7f83081a6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:56.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.620+0000 7f830cdea700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f830809e440 0x7f83081a6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:56.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.620+0000 7f830cdea700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83081a9790 con 0x7f830809e000 2023-10-01T07:59:56.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.620+0000 7f830cdea700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83081a9970 con 0x7f830809d6f0 2023-10-01T07:59:56.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.620+0000 7f830cdea700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83081a7340 con 0x7f830809e440 2023-10-01T07:59:56.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.620+0000 7f830659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f830809d6f0 0x7f83081a5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:56.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.621+0000 7f830659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f830809d6f0 0x7f83081a5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44582/0 (socket says 172.21.15.26:44582) 2023-10-01T07:59:56.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.621+0000 7f830659c700 1 -- 172.21.15.26:0/1839694964 learned_addr learned my addr 172.21.15.26:0/1839694964 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:56.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.621+0000 7f8305d9b700 1 --2- 172.21.15.26:0/1839694964 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f830809e000 0x7f83081a6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:56.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.621+0000 7f8306d9d700 1 --2- 172.21.15.26:0/1839694964 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f830809e440 0x7f83081a6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:56.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.621+0000 7f830659c700 1 -- 172.21.15.26:0/1839694964 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f830809e440 msgr2=0x7f83081a6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:56.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.621+0000 7f830659c700 1 --2- 172.21.15.26:0/1839694964 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f830809e440 0x7f83081a6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:56.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.621+0000 7f830659c700 1 -- 172.21.15.26:0/1839694964 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f830809e000 msgr2=0x7f83081a6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:56.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.621+0000 7f830659c700 1 --2- 172.21.15.26:0/1839694964 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f830809e000 0x7f83081a6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:56.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.621+0000 7f830659c700 1 -- 172.21.15.26:0/1839694964 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f8009550 con 0x7f830809d6f0 2023-10-01T07:59:56.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.621+0000 7f830659c700 1 --2- 172.21.15.26:0/1839694964 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f830809d6f0 0x7f83081a5ee0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f82f800c010 tx=0x7f82f8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:56.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.621+0000 7f82f6ffd700 1 -- 172.21.15.26:0/1839694964 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f8004300 con 0x7f830809d6f0 2023-10-01T07:59:56.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.622+0000 7f830cdea700 1 -- 172.21.15.26:0/1839694964 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83081a7b00 con 0x7f830809d6f0 2023-10-01T07:59:56.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.622+0000 7f82f6ffd700 1 -- 172.21.15.26:0/1839694964 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f801f070 con 0x7f830809d6f0 2023-10-01T07:59:56.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.622+0000 7f82f6ffd700 1 -- 172.21.15.26:0/1839694964 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f80036a0 con 0x7f830809d6f0 2023-10-01T07:59:56.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.622+0000 7f830cdea700 1 -- 172.21.15.26:0/1839694964 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f830809c710 con 0x7f830809d6f0 2023-10-01T07:59:56.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.623+0000 7f82f6ffd700 1 -- 172.21.15.26:0/1839694964 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f82f8021030 con 0x7f830809d6f0 2023-10-01T07:59:56.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.623+0000 7f82f4ff9700 1 -- 172.21.15.26:0/1839694964 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8308074ea0 con 0x7f830809d6f0 2023-10-01T07:59:56.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.623+0000 7f82f6ffd700 1 -- 172.21.15.26:0/1839694964 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f82f80409f0 con 0x7f830809d6f0 2023-10-01T07:59:56.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.629+0000 7f82f6ffd700 1 -- 172.21.15.26:0/1839694964 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f82f8042e60 con 0x7f830809d6f0 2023-10-01T07:59:56.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.676+0000 7f1ad5558700 1 Processor -- start 2023-10-01T07:59:56.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.677+0000 7f1ad5558700 1 -- start start 2023-10-01T07:59:56.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.677+0000 7f1ad5558700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1ad00a0a30 0x7f1ad00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:56.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.677+0000 7f1ad5558700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ad009d630 0x7f1ad00a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:56.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.677+0000 7f1ad5558700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad00a2a70 con 0x7f1ad0133930 2023-10-01T07:59:56.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.677+0000 7f1ad5558700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad00a01d0 con 0x7f1ad00a0a30 2023-10-01T07:59:56.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.677+0000 7f1ad5558700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad009e2b0 con 0x7f1ad009d630 2023-10-01T07:59:56.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.678+0000 7f1aceffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1ad00a0a30 0x7f1ad00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:56.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.678+0000 7f1aceffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1ad00a0a30 0x7f1ad00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35346/0 (socket says 172.21.15.26:35346) 2023-10-01T07:59:56.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.678+0000 7f1aceffd700 1 -- 172.21.15.26:0/1958511295 learned_addr learned my addr 172.21.15.26:0/1958511295 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:56.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.678+0000 7f1ace7fc700 1 --2- 172.21.15.26:0/1958511295 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ad009d630 0x7f1ad00a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:56.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.678+0000 7f1aceffd700 1 -- 172.21.15.26:0/1958511295 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ad009d630 msgr2=0x7f1ad00a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:56.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.678+0000 7f1aceffd700 1 --2- 172.21.15.26:0/1958511295 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ad009d630 0x7f1ad00a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:56.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.678+0000 7f1aceffd700 1 -- 172.21.15.26:0/1958511295 >> v1:172.21.15.26:6789/0 conn(0x7f1ad0133930 legacy=0x7f1ad0133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:56.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.678+0000 7f1aceffd700 1 -- 172.21.15.26:0/1958511295 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad009dc50 con 0x7f1ad00a0a30 2023-10-01T07:59:56.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.678+0000 7f1ace7fc700 1 --2- 172.21.15.26:0/1958511295 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ad009d630 0x7f1ad00a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:56.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.678+0000 7f1aceffd700 1 --2- 172.21.15.26:0/1958511295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ad00a0a30 0x7f1ad00a0e00 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f1ac00098f0 tx=0x7f1ac0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b2b7614583a27 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:56.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.678+0000 7f1acdffb700 1 -- 172.21.15.26:0/1958511295 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac0011830 con 0x7f1ad00a0a30 2023-10-01T07:59:56.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.679+0000 7f1acdffb700 1 -- 172.21.15.26:0/1958511295 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac0011990 con 0x7f1ad00a0a30 2023-10-01T07:59:56.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.679+0000 7f1acdffb700 1 -- 172.21.15.26:0/1958511295 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac0011d20 con 0x7f1ad00a0a30 2023-10-01T07:59:56.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.679+0000 7f1ad5558700 1 -- 172.21.15.26:0/1958511295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ad00a0a30 msgr2=0x7f1ad00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:56.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.679+0000 7f1ad5558700 1 --2- 172.21.15.26:0/1958511295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ad00a0a30 0x7f1ad00a0e00 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f1ac00098f0 tx=0x7f1ac0009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:56.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.679+0000 7f1ad5558700 1 -- 172.21.15.26:0/1958511295 shutdown_connections 2023-10-01T07:59:56.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.679+0000 7f1ad5558700 1 --2- 172.21.15.26:0/1958511295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ad00a0a30 0x7f1ad00a0e00 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:56.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.679+0000 7f1ad5558700 1 --2- 172.21.15.26:0/1958511295 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ad009d630 0x7f1ad00a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:56.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.679+0000 7f1ad5558700 1 -- 172.21.15.26:0/1958511295 >> 172.21.15.26:0/1958511295 conn(0x7f1ad00a3050 msgr2=0x7f1ad00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:56.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.679+0000 7f1ad5558700 1 -- 172.21.15.26:0/1958511295 shutdown_connections 2023-10-01T07:59:56.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.679+0000 7f1ad5558700 1 -- 172.21.15.26:0/1958511295 wait complete. 2023-10-01T07:59:56.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.681+0000 7fdcfa7ea700 1 Processor -- start 2023-10-01T07:59:56.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.681+0000 7f1ad5558700 1 Processor -- start 2023-10-01T07:59:56.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.681+0000 7f1ad5558700 1 -- start start 2023-10-01T07:59:56.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.681+0000 7fdcfa7ea700 1 -- start start 2023-10-01T07:59:56.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.681+0000 7fdcfa7ea700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdcf409d6f0 0x7fdcf409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:56.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.681+0000 7fdcfa7ea700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdcf409e000 0x7fdcf4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:56.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.681+0000 7fdcfa7ea700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf409f130 con 0x7fdcf409e410 2023-10-01T07:59:56.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.681+0000 7fdcfa7ea700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf409f520 con 0x7fdcf409e000 2023-10-01T07:59:56.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.681+0000 7fdcfa7ea700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf409e930 con 0x7fdcf409d6f0 2023-10-01T07:59:56.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.681+0000 7fdcf3fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdcf409d6f0 0x7fdcf409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:56.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.682+0000 7fdcf37fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdcf409e000 0x7fdcf4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:56.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.682+0000 7fdcf37fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdcf409e000 0x7fdcf4130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44594/0 (socket says 172.21.15.26:44594) 2023-10-01T07:59:56.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.682+0000 7fdcf37fe700 1 -- 172.21.15.26:0/2099269347 learned_addr learned my addr 172.21.15.26:0/2099269347 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:56.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.682+0000 7fdcf3fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdcf409d6f0 0x7fdcf409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:55950/0 (socket says 172.21.15.26:55950) 2023-10-01T07:59:56.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.682+0000 7f1ad5558700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ad009d630 0x7f1ad01c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:56.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.682+0000 7f1ad5558700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ad00a0a30 0x7f1ad01c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:56.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.682+0000 7f1ad5558700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ad0133930 0x7f1ad01c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:56.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.682+0000 7f1ad5558700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad011eea0 con 0x7f1ad009d630 2023-10-01T07:59:56.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.682+0000 7f1ad5558700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad01207f0 con 0x7f1ad0133930 2023-10-01T07:59:56.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.682+0000 7f1ad5558700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad0120600 con 0x7f1ad00a0a30 2023-10-01T07:59:56.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.682+0000 7f1aceffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ad009d630 0x7f1ad01c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:56.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.682+0000 7f1ace7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ad00a0a30 0x7f1ad01c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:56.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.682+0000 7f1acf7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ad0133930 0x7f1ad01c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:56.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.682+0000 7f1aceffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ad009d630 0x7f1ad01c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35354/0 (socket says 172.21.15.26:35354) 2023-10-01T07:59:56.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.682+0000 7f1aceffd700 1 -- 172.21.15.26:0/3847967530 learned_addr learned my addr 172.21.15.26:0/3847967530 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:56.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.682+0000 7f1ace7fc700 1 -- 172.21.15.26:0/3847967530 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ad0133930 msgr2=0x7f1ad01c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:56.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.683+0000 7f1ace7fc700 1 --2- 172.21.15.26:0/3847967530 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ad0133930 0x7f1ad01c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:56.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.683+0000 7f1ace7fc700 1 -- 172.21.15.26:0/3847967530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ad009d630 msgr2=0x7f1ad01c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:56.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.683+0000 7f1ace7fc700 1 --2- 172.21.15.26:0/3847967530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ad009d630 0x7f1ad01c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:56.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.683+0000 7f1ace7fc700 1 -- 172.21.15.26:0/3847967530 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac40094a0 con 0x7f1ad00a0a30 2023-10-01T07:59:56.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.682+0000 7fdcf2ffd700 1 -- 172.21.15.26:0/2099269347 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3813301095 0 0) 0x7fdcf409f130 con 0x7fdcf409e410 2023-10-01T07:59:56.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.682+0000 7fdcf2ffd700 1 -- 172.21.15.26:0/2099269347 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcdc0079c0 con 0x7fdcf409e410 2023-10-01T07:59:56.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.682+0000 7fdcf37fe700 1 -- 172.21.15.26:0/2099269347 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdcf409d6f0 msgr2=0x7fdcf409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:56.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.682+0000 7fdcf37fe700 1 --2- 172.21.15.26:0/2099269347 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdcf409d6f0 0x7fdcf409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:56.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.682+0000 7fdcf37fe700 1 -- 172.21.15.26:0/2099269347 >> v1:172.21.15.26:6789/0 conn(0x7fdcf409e410 legacy=0x7fdcf4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:56.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.682+0000 7fdcf37fe700 1 -- 172.21.15.26:0/2099269347 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf409b2d0 con 0x7fdcf409e000 2023-10-01T07:59:56.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.683+0000 7f1acf7fe700 1 --2- 172.21.15.26:0/3847967530 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ad0133930 0x7f1ad01c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:59:56.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.683+0000 7fdcf37fe700 1 --2- 172.21.15.26:0/2099269347 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdcf409e000 0x7fdcf4130660 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fdce8009920 tx=0x7fdce8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=292ae3c258f2c99a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:56.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.683+0000 7f1ace7fc700 1 --2- 172.21.15.26:0/3847967530 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ad00a0a30 0x7f1ad01c8660 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f1ac400e9b0 tx=0x7f1ac400ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:56.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.683+0000 7fdcf2ffd700 1 -- 172.21.15.26:0/2099269347 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce8011830 con 0x7fdcf409e000 2023-10-01T07:59:56.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.683+0000 7fdcf2ffd700 1 -- 172.21.15.26:0/2099269347 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce8011990 con 0x7fdcf409e000 2023-10-01T07:59:56.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.683+0000 7fdcf2ffd700 1 -- 172.21.15.26:0/2099269347 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce8011d00 con 0x7fdcf409e000 2023-10-01T07:59:56.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.683+0000 7f1ab77fe700 1 -- 172.21.15.26:0/3847967530 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac400c850 con 0x7f1ad00a0a30 2023-10-01T07:59:56.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.683+0000 7f1ab77fe700 1 -- 172.21.15.26:0/3847967530 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac400c9b0 con 0x7f1ad00a0a30 2023-10-01T07:59:56.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.683+0000 7f1ad5558700 1 -- 172.21.15.26:0/3847967530 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ac0009550 con 0x7f1ad00a0a30 2023-10-01T07:59:56.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.683+0000 7f1ad5558700 1 -- 172.21.15.26:0/3847967530 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad0122230 con 0x7f1ad00a0a30 2023-10-01T07:59:56.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.683+0000 7f1ab77fe700 1 -- 172.21.15.26:0/3847967530 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac400cd60 con 0x7f1ad00a0a30 2023-10-01T07:59:56.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.684+0000 7fdcfa7ea700 1 -- 172.21.15.26:0/2099269347 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdcf409e000 msgr2=0x7fdcf4130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:56.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.684+0000 7fdcfa7ea700 1 --2- 172.21.15.26:0/2099269347 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdcf409e000 0x7fdcf4130660 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fdce8009920 tx=0x7fdce8009c30 comp rx=0 tx=0).stop 2023-10-01T07:59:56.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.684+0000 7fdcfa7ea700 1 -- 172.21.15.26:0/2099269347 shutdown_connections 2023-10-01T07:59:56.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.684+0000 7fdcfa7ea700 1 --2- 172.21.15.26:0/2099269347 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdcf409d6f0 0x7fdcf409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:56.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.684+0000 7fdcfa7ea700 1 --2- 172.21.15.26:0/2099269347 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdcf409e000 0x7fdcf4130660 secure :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fdce8009920 tx=0x7fdce8009c30 comp rx=0 tx=0).stop 2023-10-01T07:59:56.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.684+0000 7fdcfa7ea700 1 -- 172.21.15.26:0/2099269347 >> 172.21.15.26:0/2099269347 conn(0x7fdcf4066f50 msgr2=0x7fdcf409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:56.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.684+0000 7f1ab77fe700 1 -- 172.21.15.26:0/3847967530 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1ac4013470 con 0x7f1ad00a0a30 2023-10-01T07:59:56.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.684+0000 7f1ab77fe700 1 -- 172.21.15.26:0/3847967530 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1ac40421c0 con 0x7f1ad00a0a30 2023-10-01T07:59:56.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.685+0000 7fdcfa7ea700 1 -- 172.21.15.26:0/2099269347 shutdown_connections 2023-10-01T07:59:56.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.685+0000 7fdcfa7ea700 1 -- 172.21.15.26:0/2099269347 wait complete. 2023-10-01T07:59:56.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.685+0000 7f1ad5558700 1 -- 172.21.15.26:0/3847967530 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab00052e0 con 0x7f1ad00a0a30 2023-10-01T07:59:56.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.686+0000 7fdcfa7ea700 1 Processor -- start 2023-10-01T07:59:56.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.686+0000 7fdcfa7ea700 1 -- start start 2023-10-01T07:59:56.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.687+0000 7fdcfa7ea700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdcf409d6f0 0x7fdcf411df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:56.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.687+0000 7fdcfa7ea700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdcf409e410 0x7fdcf411e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:56.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.687+0000 7fdcfa7ea700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdcf411e9d0 0x7fdcf41ca490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:56.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.687+0000 7fdcfa7ea700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf411f420 con 0x7fdcf409d6f0 2023-10-01T07:59:56.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.687+0000 7fdcfa7ea700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf4130330 con 0x7fdcf409e410 2023-10-01T07:59:56.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.687+0000 7fdcfa7ea700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf4120db0 con 0x7fdcf411e9d0 2023-10-01T07:59:56.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.687+0000 7fdcf3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdcf409d6f0 0x7fdcf411df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:56.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.687+0000 7fdcf3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdcf409d6f0 0x7fdcf411df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35362/0 (socket says 172.21.15.26:35362) 2023-10-01T07:59:56.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.687+0000 7fdcf8d87700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdcf411e9d0 0x7fdcf41ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:56.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.687+0000 7fdcf3fff700 1 -- 172.21.15.26:0/53375191 learned_addr learned my addr 172.21.15.26:0/53375191 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:56.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.688+0000 7fdcf3fff700 1 -- 172.21.15.26:0/53375191 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdcf411e9d0 msgr2=0x7fdcf41ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:56.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.688+0000 7fdcf3fff700 1 --2- 172.21.15.26:0/53375191 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdcf411e9d0 0x7fdcf41ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:56.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.688+0000 7fdcf3fff700 1 -- 172.21.15.26:0/53375191 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdcf409e410 msgr2=0x7fdcf411e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:56.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.688+0000 7fdcf3fff700 1 --2- 172.21.15.26:0/53375191 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdcf409e410 0x7fdcf411e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:56.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.688+0000 7fdcf3fff700 1 -- 172.21.15.26:0/53375191 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce8009550 con 0x7fdcf409d6f0 2023-10-01T07:59:56.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.688+0000 7fdcf8d87700 1 --2- 172.21.15.26:0/53375191 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdcf411e9d0 0x7fdcf41ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:56.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.688+0000 7fdcf3fff700 1 --2- 172.21.15.26:0/53375191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdcf409d6f0 0x7fdcf411df50 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fdce400fb10 tx=0x7fdce400fe20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:56.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.688+0000 7fdcf0ff9700 1 -- 172.21.15.26:0/53375191 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce400c070 con 0x7fdcf409d6f0 2023-10-01T07:59:56.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.688+0000 7fdcf0ff9700 1 -- 172.21.15.26:0/53375191 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce400db20 con 0x7fdcf409d6f0 2023-10-01T07:59:56.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.688+0000 7fdcfa7ea700 1 -- 172.21.15.26:0/53375191 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf4121790 con 0x7fdcf409d6f0 2023-10-01T07:59:56.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.688+0000 7fdcfa7ea700 1 -- 172.21.15.26:0/53375191 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf4121200 con 0x7fdcf409d6f0 2023-10-01T07:59:56.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.688+0000 7fdcf0ff9700 1 -- 172.21.15.26:0/53375191 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce4009710 con 0x7fdcf409d6f0 2023-10-01T07:59:56.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.689+0000 7fdcf0ff9700 1 -- 172.21.15.26:0/53375191 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdce4011450 con 0x7fdcf409d6f0 2023-10-01T07:59:56.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.690+0000 7fdcf0ff9700 1 -- 172.21.15.26:0/53375191 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdce4015070 con 0x7fdcf409d6f0 2023-10-01T07:59:56.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.692+0000 7fdcfa7ea700 1 -- 172.21.15.26:0/53375191 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcd40052e0 con 0x7fdcf409d6f0 2023-10-01T07:59:56.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.692+0000 7f1ab77fe700 1 -- 172.21.15.26:0/3847967530 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1ac4017020 con 0x7f1ad00a0a30 2023-10-01T07:59:56.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.697+0000 7fdcf0ff9700 1 -- 172.21.15.26:0/53375191 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdce4016880 con 0x7fdcf409d6f0 2023-10-01T07:59:56.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.752+0000 7f29de31f700 1 -- 172.21.15.26:0/2936461783 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f29d811c100 con 0x7f29d806f660 2023-10-01T07:59:56.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.753+0000 7f29d4ff9700 1 -- 172.21.15.26:0/2936461783 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f29c802b370 con 0x7f29d806f660 2023-10-01T07:59:56.753 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:56.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.756+0000 7f29de31f700 1 -- 172.21.15.26:0/2936461783 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29d806f660 msgr2=0x7f29d812d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:56.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.756+0000 7f29de31f700 1 --2- 172.21.15.26:0/2936461783 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29d806f660 0x7f29d812d8e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f29c800be30 tx=0x7f29c8004750 comp rx=0 tx=0).stop 2023-10-01T07:59:56.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.756+0000 7f29de31f700 1 -- 172.21.15.26:0/2936461783 shutdown_connections 2023-10-01T07:59:56.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.756+0000 7f29de31f700 1 --2- 172.21.15.26:0/2936461783 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29d81305f0 0x7f29d811aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:56.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.756+0000 7f29de31f700 1 --2- 172.21.15.26:0/2936461783 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29d806f660 0x7f29d812d8e0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:56.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.756+0000 7f29de31f700 1 --2- 172.21.15.26:0/2936461783 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29d806ff90 0x7f29d811a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:56.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.756+0000 7f29de31f700 1 -- 172.21.15.26:0/2936461783 >> 172.21.15.26:0/2936461783 conn(0x7f29d80a2aa0 msgr2=0x7f29d80a1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:56.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.757+0000 7f29de31f700 1 -- 172.21.15.26:0/2936461783 shutdown_connections 2023-10-01T07:59:56.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.757+0000 7f29de31f700 1 -- 172.21.15.26:0/2936461783 wait complete. 2023-10-01T07:59:56.771 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:56.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.867+0000 7f82f4ff9700 1 -- 172.21.15.26:0/1839694964 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f830809f420 con 0x7f830809d6f0 2023-10-01T07:59:56.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.868+0000 7f82f6ffd700 1 -- 172.21.15.26:0/1839694964 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f82f8015030 con 0x7f830809d6f0 2023-10-01T07:59:56.869 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:56.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.870+0000 7f82f4ff9700 1 -- 172.21.15.26:0/1839694964 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f830809d6f0 msgr2=0x7f83081a5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:56.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.870+0000 7f82f4ff9700 1 --2- 172.21.15.26:0/1839694964 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f830809d6f0 0x7f83081a5ee0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f82f800c010 tx=0x7f82f8004750 comp rx=0 tx=0).stop 2023-10-01T07:59:56.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.870+0000 7f82f4ff9700 1 -- 172.21.15.26:0/1839694964 shutdown_connections 2023-10-01T07:59:56.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.870+0000 7f82f4ff9700 1 --2- 172.21.15.26:0/1839694964 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f830809e440 0x7f83081a6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:56.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.870+0000 7f82f4ff9700 1 --2- 172.21.15.26:0/1839694964 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f830809d6f0 0x7f83081a5ee0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:56.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.870+0000 7f82f4ff9700 1 --2- 172.21.15.26:0/1839694964 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f830809e000 0x7f83081a6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:56.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.870+0000 7f82f4ff9700 1 -- 172.21.15.26:0/1839694964 >> 172.21.15.26:0/1839694964 conn(0x7f8308066f50 msgr2=0x7f83081badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:56.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.870+0000 7f82f4ff9700 1 -- 172.21.15.26:0/1839694964 shutdown_connections 2023-10-01T07:59:56.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.870+0000 7f82f4ff9700 1 -- 172.21.15.26:0/1839694964 wait complete. 2023-10-01T07:59:56.885 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:56.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.907+0000 7fdcfa7ea700 1 -- 172.21.15.26:0/53375191 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdcd4005590 con 0x7fdcf409d6f0 2023-10-01T07:59:56.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.908+0000 7fdcf0ff9700 1 -- 172.21.15.26:0/53375191 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdce4016290 con 0x7fdcf409d6f0 2023-10-01T07:59:56.908 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:56.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.910+0000 7fdcfa7ea700 1 -- 172.21.15.26:0/53375191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdcf409d6f0 msgr2=0x7fdcf411df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:56.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.910+0000 7fdcfa7ea700 1 --2- 172.21.15.26:0/53375191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdcf409d6f0 0x7fdcf411df50 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fdce400fb10 tx=0x7fdce400fe20 comp rx=0 tx=0).stop 2023-10-01T07:59:56.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.910+0000 7fdcfa7ea700 1 -- 172.21.15.26:0/53375191 shutdown_connections 2023-10-01T07:59:56.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.910+0000 7fdcfa7ea700 1 --2- 172.21.15.26:0/53375191 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdcf411e9d0 0x7fdcf41ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:56.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.910+0000 7fdcfa7ea700 1 --2- 172.21.15.26:0/53375191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdcf409d6f0 0x7fdcf411df50 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:56.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.910+0000 7fdcfa7ea700 1 --2- 172.21.15.26:0/53375191 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdcf409e410 0x7fdcf411e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:56.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.910+0000 7fdcfa7ea700 1 -- 172.21.15.26:0/53375191 >> 172.21.15.26:0/53375191 conn(0x7fdcf4066f50 msgr2=0x7fdcf4130ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:56.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.910+0000 7fdcfa7ea700 1 -- 172.21.15.26:0/53375191 shutdown_connections 2023-10-01T07:59:56.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.910+0000 7fdcfa7ea700 1 -- 172.21.15.26:0/53375191 wait complete. 2023-10-01T07:59:56.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.919+0000 7f1ad5558700 1 -- 172.21.15.26:0/3847967530 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1ab0005590 con 0x7f1ad00a0a30 2023-10-01T07:59:56.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.919+0000 7f1ab77fe700 1 -- 172.21.15.26:0/3847967530 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1ac4044060 con 0x7f1ad00a0a30 2023-10-01T07:59:56.920 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:56.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.921+0000 7f1ad5558700 1 -- 172.21.15.26:0/3847967530 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ad00a0a30 msgr2=0x7f1ad01c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:56.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.921+0000 7f1ad5558700 1 --2- 172.21.15.26:0/3847967530 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ad00a0a30 0x7f1ad01c8660 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f1ac400e9b0 tx=0x7f1ac400ecc0 comp rx=0 tx=0).stop 2023-10-01T07:59:56.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.921+0000 7f1ad5558700 1 -- 172.21.15.26:0/3847967530 shutdown_connections 2023-10-01T07:59:56.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.921+0000 7f1ad5558700 1 --2- 172.21.15.26:0/3847967530 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ad0133930 0x7f1ad01c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:56.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.921+0000 7f1ad5558700 1 --2- 172.21.15.26:0/3847967530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ad009d630 0x7f1ad01c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:56.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.921+0000 7f1ad5558700 1 --2- 172.21.15.26:0/3847967530 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ad00a0a30 0x7f1ad01c8660 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:56.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.921+0000 7f1ad5558700 1 -- 172.21.15.26:0/3847967530 >> 172.21.15.26:0/3847967530 conn(0x7f1ad00a3050 msgr2=0x7f1ad009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:56.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.921+0000 7f1ad5558700 1 -- 172.21.15.26:0/3847967530 shutdown_connections 2023-10-01T07:59:56.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:56.922+0000 7f1ad5558700 1 -- 172.21.15.26:0/3847967530 wait complete. 2023-10-01T07:59:56.926 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:56.936 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:57.772 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:57.886 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:57.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.919+0000 7f245ef7e700 1 Processor -- start 2023-10-01T07:59:57.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.919+0000 7f245ef7e700 1 -- start start 2023-10-01T07:59:57.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.919+0000 7f245ef7e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f245806a770 0x7f245806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:57.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.919+0000 7f245ef7e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f245806b080 0x7f2458131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:57.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.919+0000 7f245ef7e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f245809ece0 con 0x7f2458131b40 2023-10-01T07:59:57.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.919+0000 7f245ef7e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245809e760 con 0x7f245806a770 2023-10-01T07:59:57.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.919+0000 7f245ef7e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f245809e040 con 0x7f245806b080 2023-10-01T07:59:57.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.920+0000 7f2457fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f245806b080 0x7f2458131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:57.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.920+0000 7f245d51b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2458131b40 0x7f2458138850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37052/0 (socket says 172.21.15.26:37052) 2023-10-01T07:59:57.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.920+0000 7f245d51b700 1 -- 172.21.15.26:0/3736442638 learned_addr learned my addr 172.21.15.26:0/3736442638 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:59:57.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.920+0000 7f245cd1a700 1 --2- 172.21.15.26:0/3736442638 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f245806a770 0x7f245806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:57.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.920+0000 7f24577fe700 1 -- 172.21.15.26:0/3736442638 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937816681 0 0) 0x7f245809ece0 con 0x7f2458131b40 2023-10-01T07:59:57.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.920+0000 7f24577fe700 1 -- 172.21.15.26:0/3736442638 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24480035b0 con 0x7f2458131b40 2023-10-01T07:59:57.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.920+0000 7f2457fff700 1 -- 172.21.15.26:0/3736442638 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f245806a770 msgr2=0x7f245806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:57.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.920+0000 7f2457fff700 1 --2- 172.21.15.26:0/3736442638 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f245806a770 0x7f245806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:57.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.920+0000 7f2457fff700 1 -- 172.21.15.26:0/3736442638 >> v1:172.21.15.26:6789/0 conn(0x7f2458131b40 legacy=0x7f2458138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:57.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.920+0000 7f2457fff700 1 -- 172.21.15.26:0/3736442638 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245809f630 con 0x7f245806b080 2023-10-01T07:59:57.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.920+0000 7f245cd1a700 1 --2- 172.21.15.26:0/3736442638 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f245806a770 0x7f245806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:57.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.920+0000 7f2457fff700 1 --2- 172.21.15.26:0/3736442638 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f245806b080 0x7f2458131600 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f2444009870 tx=0x7f2444009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6fcb7e6b72b26aa server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:57.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.920+0000 7f24577fe700 1 -- 172.21.15.26:0/3736442638 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2444011830 con 0x7f245806b080 2023-10-01T07:59:57.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.920+0000 7f24577fe700 1 -- 172.21.15.26:0/3736442638 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2444011990 con 0x7f245806b080 2023-10-01T07:59:57.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.920+0000 7f24577fe700 1 -- 172.21.15.26:0/3736442638 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2444011d20 con 0x7f245806b080 2023-10-01T07:59:57.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.921+0000 7f245ef7e700 1 -- 172.21.15.26:0/3736442638 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f245806b080 msgr2=0x7f2458131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:57.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.921+0000 7f245ef7e700 1 --2- 172.21.15.26:0/3736442638 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f245806b080 0x7f2458131600 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f2444009870 tx=0x7f2444009b80 comp rx=0 tx=0).stop 2023-10-01T07:59:57.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.921+0000 7f245ef7e700 1 -- 172.21.15.26:0/3736442638 shutdown_connections 2023-10-01T07:59:57.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.921+0000 7f245ef7e700 1 --2- 172.21.15.26:0/3736442638 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f245806a770 0x7f245806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:57.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.921+0000 7f245ef7e700 1 --2- 172.21.15.26:0/3736442638 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f245806b080 0x7f2458131600 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:57.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.921+0000 7f245ef7e700 1 -- 172.21.15.26:0/3736442638 >> 172.21.15.26:0/3736442638 conn(0x7f2458066f50 msgr2=0x7f245809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:57.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.921+0000 7f245ef7e700 1 -- 172.21.15.26:0/3736442638 shutdown_connections 2023-10-01T07:59:57.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.921+0000 7f245ef7e700 1 -- 172.21.15.26:0/3736442638 wait complete. 2023-10-01T07:59:57.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.922+0000 7f245ef7e700 1 Processor -- start 2023-10-01T07:59:57.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.922+0000 7f245ef7e700 1 -- start start 2023-10-01T07:59:57.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.923+0000 7f245ef7e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f245806a770 0x7f24581c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:57.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.923+0000 7f245ef7e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f245806b080 0x7f24581c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:57.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.923+0000 7f245ef7e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2458131b40 0x7f24581c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:57.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.923+0000 7f245ef7e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2458125700 con 0x7f245806b080 2023-10-01T07:59:57.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.923+0000 7f245ef7e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2458071e60 con 0x7f245806a770 2023-10-01T07:59:57.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.923+0000 7f245ef7e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2458126200 con 0x7f2458131b40 2023-10-01T07:59:57.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.923+0000 7f245cd1a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f245806a770 0x7f24581c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:57.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.923+0000 7f245d51b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2458131b40 0x7f24581c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:57.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.923+0000 7f245cd1a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f245806a770 0x7f24581c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44628/0 (socket says 172.21.15.26:44628) 2023-10-01T07:59:57.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.923+0000 7f245cd1a700 1 -- 172.21.15.26:0/2753044058 learned_addr learned my addr 172.21.15.26:0/2753044058 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:57.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.923+0000 7f2457fff700 1 --2- 172.21.15.26:0/2753044058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f245806b080 0x7f24581c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:57.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.923+0000 7f245cd1a700 1 -- 172.21.15.26:0/2753044058 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2458131b40 msgr2=0x7f24581c8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:57.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.923+0000 7f245cd1a700 1 --2- 172.21.15.26:0/2753044058 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2458131b40 0x7f24581c8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:57.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.924+0000 7f245cd1a700 1 -- 172.21.15.26:0/2753044058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f245806b080 msgr2=0x7f24581c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:57.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.924+0000 7f245cd1a700 1 --2- 172.21.15.26:0/2753044058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f245806b080 0x7f24581c87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:57.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.924+0000 7f245cd1a700 1 -- 172.21.15.26:0/2753044058 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f244c0094a0 con 0x7f245806a770 2023-10-01T07:59:57.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.924+0000 7f245d51b700 1 --2- 172.21.15.26:0/2753044058 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2458131b40 0x7f24581c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:57.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.924+0000 7f245cd1a700 1 --2- 172.21.15.26:0/2753044058 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f245806a770 0x7f24581c8260 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f244c00ebe0 tx=0x7f244c00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:57.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.924+0000 7f24557fa700 1 -- 172.21.15.26:0/2753044058 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c00c850 con 0x7f245806a770 2023-10-01T07:59:57.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.924+0000 7f24557fa700 1 -- 172.21.15.26:0/2753044058 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244c00c9b0 con 0x7f245806a770 2023-10-01T07:59:57.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.924+0000 7f24557fa700 1 -- 172.21.15.26:0/2753044058 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c00cd40 con 0x7f245806a770 2023-10-01T07:59:57.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.924+0000 7f245ef7e700 1 -- 172.21.15.26:0/2753044058 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24440094a0 con 0x7f245806a770 2023-10-01T07:59:57.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.924+0000 7f245ef7e700 1 -- 172.21.15.26:0/2753044058 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f245809bfc0 con 0x7f245806a770 2023-10-01T07:59:57.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.925+0000 7f24557fa700 1 -- 172.21.15.26:0/2753044058 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f244c013470 con 0x7f245806a770 2023-10-01T07:59:57.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.925+0000 7f245ef7e700 1 -- 172.21.15.26:0/2753044058 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2458074ea0 con 0x7f245806a770 2023-10-01T07:59:57.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.925+0000 7f24557fa700 1 -- 172.21.15.26:0/2753044058 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f244c03fb50 con 0x7f245806a770 2023-10-01T07:59:57.931 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:57.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:57.930+0000 7f24557fa700 1 -- 172.21.15.26:0/2753044058 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f244c013720 con 0x7f245806a770 2023-10-01T07:59:57.936 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:58.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.029+0000 7efc1dd3f700 1 Processor -- start 2023-10-01T07:59:58.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.029+0000 7efc1dd3f700 1 -- start start 2023-10-01T07:59:58.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.030+0000 7efc1dd3f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efc1809e1d0 0x7efc18138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:58.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.030+0000 7efc1dd3f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc18139170 0x7efc1813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:58.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.030+0000 7efc1dd3f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc1809b120 con 0x7efc1809d6f0 2023-10-01T07:59:58.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.030+0000 7efc1dd3f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc1806b460 con 0x7efc1809e1d0 2023-10-01T07:59:58.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.030+0000 7efc1dd3f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc1809a7e0 con 0x7efc18139170 2023-10-01T07:59:58.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.030+0000 7efc177fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7efc1809d6f0 0x7efc1809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37066/0 (socket says 172.21.15.26:37066) 2023-10-01T07:59:58.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.030+0000 7efc16ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efc1809e1d0 0x7efc18138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:58.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.030+0000 7efc177fe700 1 -- 172.21.15.26:0/1997284112 learned_addr learned my addr 172.21.15.26:0/1997284112 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T07:59:58.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.030+0000 7efc17fff700 1 --2- 172.21.15.26:0/1997284112 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc18139170 0x7efc1813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:58.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.031+0000 7efc16ffd700 1 -- 172.21.15.26:0/1997284112 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc18139170 msgr2=0x7efc1813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:58.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.031+0000 7efc16ffd700 1 --2- 172.21.15.26:0/1997284112 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc18139170 0x7efc1813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:58.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.031+0000 7efc16ffd700 1 -- 172.21.15.26:0/1997284112 >> v1:172.21.15.26:6789/0 conn(0x7efc1809d6f0 legacy=0x7efc1809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:58.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.031+0000 7efc16ffd700 1 -- 172.21.15.26:0/1997284112 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1809a500 con 0x7efc1809e1d0 2023-10-01T07:59:58.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.031+0000 7efc16ffd700 1 --2- 172.21.15.26:0/1997284112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc1809e1d0 0x7efc18138c30 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7efc0c009870 tx=0x7efc0c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f2feab389070e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:58.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.031+0000 7efc167fc700 1 -- 172.21.15.26:0/1997284112 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c011830 con 0x7efc1809e1d0 2023-10-01T07:59:58.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.031+0000 7efc167fc700 1 -- 172.21.15.26:0/1997284112 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0c011990 con 0x7efc1809e1d0 2023-10-01T07:59:58.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.031+0000 7efc167fc700 1 -- 172.21.15.26:0/1997284112 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c011d20 con 0x7efc1809e1d0 2023-10-01T07:59:58.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.032+0000 7efc1dd3f700 1 -- 172.21.15.26:0/1997284112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc1809e1d0 msgr2=0x7efc18138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:58.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.032+0000 7efc1dd3f700 1 --2- 172.21.15.26:0/1997284112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc1809e1d0 0x7efc18138c30 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7efc0c009870 tx=0x7efc0c009b80 comp rx=0 tx=0).stop 2023-10-01T07:59:58.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.032+0000 7efc1dd3f700 1 -- 172.21.15.26:0/1997284112 shutdown_connections 2023-10-01T07:59:58.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.032+0000 7efc1dd3f700 1 --2- 172.21.15.26:0/1997284112 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc18139170 0x7efc1813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:58.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.032+0000 7efc1dd3f700 1 --2- 172.21.15.26:0/1997284112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc1809e1d0 0x7efc18138c30 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:58.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.032+0000 7efc1dd3f700 1 -- 172.21.15.26:0/1997284112 >> 172.21.15.26:0/1997284112 conn(0x7efc18066f50 msgr2=0x7efc1809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:58.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.032+0000 7efc1dd3f700 1 -- 172.21.15.26:0/1997284112 shutdown_connections 2023-10-01T07:59:58.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.032+0000 7efc1dd3f700 1 -- 172.21.15.26:0/1997284112 wait complete. 2023-10-01T07:59:58.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.033+0000 7efc1dd3f700 1 Processor -- start 2023-10-01T07:59:58.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.033+0000 7efc1dd3f700 1 -- start start 2023-10-01T07:59:58.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.034+0000 7efc1dd3f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc1809d6f0 0x7efc181c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:58.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.034+0000 7efc1dd3f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc1809e1d0 0x7efc181c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:58.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.034+0000 7efc1dd3f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efc18139170 0x7efc181c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:58.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.034+0000 7efc1dd3f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc18120800 con 0x7efc1809e1d0 2023-10-01T07:59:58.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.034+0000 7efc1dd3f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc18121ff0 con 0x7efc18139170 2023-10-01T07:59:58.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.034+0000 7efc1dd3f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc18121d20 con 0x7efc1809d6f0 2023-10-01T07:59:58.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.034+0000 7efc16ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc1809e1d0 0x7efc181c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:58.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.034+0000 7efc16ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc1809e1d0 0x7efc181c89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35388/0 (socket says 172.21.15.26:35388) 2023-10-01T07:59:58.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.034+0000 7efc16ffd700 1 -- 172.21.15.26:0/1850499761 learned_addr learned my addr 172.21.15.26:0/1850499761 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:58.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.034+0000 7efc177fe700 1 --2- 172.21.15.26:0/1850499761 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc1809d6f0 0x7efc181c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:58.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.034+0000 7efc17fff700 1 --2- 172.21.15.26:0/1850499761 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efc18139170 0x7efc181c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:58.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.035+0000 7efc16ffd700 1 -- 172.21.15.26:0/1850499761 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc1809d6f0 msgr2=0x7efc181c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:58.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.035+0000 7efc16ffd700 1 --2- 172.21.15.26:0/1850499761 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc1809d6f0 0x7efc181c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:58.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.035+0000 7efc16ffd700 1 -- 172.21.15.26:0/1850499761 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efc18139170 msgr2=0x7efc181c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:58.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.035+0000 7efc16ffd700 1 --2- 172.21.15.26:0/1850499761 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efc18139170 0x7efc181c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:58.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.035+0000 7efc16ffd700 1 -- 172.21.15.26:0/1850499761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0c0094a0 con 0x7efc1809e1d0 2023-10-01T07:59:58.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.035+0000 7efc16ffd700 1 --2- 172.21.15.26:0/1850499761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc1809e1d0 0x7efc181c89a0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7efc0c0090b0 tx=0x7efc0c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:58.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.035+0000 7efbfffff700 1 -- 172.21.15.26:0/1850499761 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c004510 con 0x7efc1809e1d0 2023-10-01T07:59:58.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.035+0000 7efbfffff700 1 -- 172.21.15.26:0/1850499761 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0c01f070 con 0x7efc1809e1d0 2023-10-01T07:59:58.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.035+0000 7efc1dd3f700 1 -- 172.21.15.26:0/1850499761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc1809c710 con 0x7efc1809e1d0 2023-10-01T07:59:58.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.035+0000 7efbfffff700 1 -- 172.21.15.26:0/1850499761 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c0038e0 con 0x7efc1809e1d0 2023-10-01T07:59:58.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.035+0000 7efc1dd3f700 1 -- 172.21.15.26:0/1850499761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc18122d20 con 0x7efc1809e1d0 2023-10-01T07:59:58.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.036+0000 7efbfffff700 1 -- 172.21.15.26:0/1850499761 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efc0c003a40 con 0x7efc1809e1d0 2023-10-01T07:59:58.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.036+0000 7efbfffff700 1 -- 172.21.15.26:0/1850499761 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efc0c021070 con 0x7efc1809e1d0 2023-10-01T07:59:58.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.037+0000 7efbfdffb700 1 -- 172.21.15.26:0/1850499761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbf00052e0 con 0x7efc1809e1d0 2023-10-01T07:59:58.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.042+0000 7efbfffff700 1 -- 172.21.15.26:0/1850499761 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efc0c02b080 con 0x7efc1809e1d0 2023-10-01T07:59:58.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.084+0000 7fdd57547700 1 Processor -- start 2023-10-01T07:59:58.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.085+0000 7fdd57547700 1 -- start start 2023-10-01T07:59:58.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.085+0000 7fdd57547700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd5009d6f0 0x7fdd5009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:58.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.085+0000 7fdd57547700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdd5009e000 0x7fdd501339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:58.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.085+0000 7fdd57547700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd5009e410 0x7fdd50133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:58.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.085+0000 7fdd57547700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd5006b460 con 0x7fdd5009e000 2023-10-01T07:59:58.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.085+0000 7fdd57547700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5009b120 con 0x7fdd5009e410 2023-10-01T07:59:58.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.085+0000 7fdd57547700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5009a7e0 con 0x7fdd5009d6f0 2023-10-01T07:59:58.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.086+0000 7fdd552e3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd5009d6f0 0x7fdd5009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:58.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.086+0000 7fdd55ae4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd5009e410 0x7fdd50133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:58.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.086+0000 7fdd55ae4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd5009e410 0x7fdd50133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44654/0 (socket says 172.21.15.26:44654) 2023-10-01T07:59:58.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.086+0000 7fdd552e3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd5009d6f0 0x7fdd5009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56010/0 (socket says 172.21.15.26:56010) 2023-10-01T07:59:58.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.086+0000 7fdd55ae4700 1 -- 172.21.15.26:0/2050362726 learned_addr learned my addr 172.21.15.26:0/2050362726 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:58.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.086+0000 7fdd54ae2700 1 --2- 172.21.15.26:0/2050362726 >> v2:172.21.15.26:3300/0 conn(0x7fdd5009e000 0x7fdd501339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:58.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.086+0000 7fdd55ae4700 1 -- 172.21.15.26:0/2050362726 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd5009d6f0 msgr2=0x7fdd5009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:58.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.086+0000 7fdd55ae4700 1 --2- 172.21.15.26:0/2050362726 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd5009d6f0 0x7fdd5009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:58.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.086+0000 7fdd55ae4700 1 -- 172.21.15.26:0/2050362726 >> v2:172.21.15.26:3300/0 conn(0x7fdd5009e000 msgr2=0x7fdd501339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:58.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.086+0000 7fdd55ae4700 1 --2- 172.21.15.26:0/2050362726 >> v2:172.21.15.26:3300/0 conn(0x7fdd5009e000 0x7fdd501339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:58.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.086+0000 7fdd55ae4700 1 -- 172.21.15.26:0/2050362726 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd5009a500 con 0x7fdd5009e410 2023-10-01T07:59:58.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.086+0000 7fdd54ae2700 1 --2- 172.21.15.26:0/2050362726 >> v2:172.21.15.26:3300/0 conn(0x7fdd5009e000 0x7fdd501339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:58.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.086+0000 7fdd55ae4700 1 --2- 172.21.15.26:0/2050362726 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd5009e410 0x7fdd50133f30 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fdd48009e80 tx=0x7fdd4800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1173875aa9a8c336 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:58.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.087+0000 7fdd47fff700 1 -- 172.21.15.26:0/2050362726 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4800e070 con 0x7fdd5009e410 2023-10-01T07:59:58.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.087+0000 7fdd47fff700 1 -- 172.21.15.26:0/2050362726 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4800b8d0 con 0x7fdd5009e410 2023-10-01T07:59:58.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.087+0000 7fdd47fff700 1 -- 172.21.15.26:0/2050362726 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4800bc80 con 0x7fdd5009e410 2023-10-01T07:59:58.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.088+0000 7fdd57547700 1 -- 172.21.15.26:0/2050362726 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd5009e410 msgr2=0x7fdd50133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:58.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.088+0000 7fdd57547700 1 --2- 172.21.15.26:0/2050362726 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd5009e410 0x7fdd50133f30 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fdd48009e80 tx=0x7fdd4800b330 comp rx=0 tx=0).stop 2023-10-01T07:59:58.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.088+0000 7fdd57547700 1 -- 172.21.15.26:0/2050362726 shutdown_connections 2023-10-01T07:59:58.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.088+0000 7fdd57547700 1 --2- 172.21.15.26:0/2050362726 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd5009e410 0x7fdd50133f30 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:58.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.088+0000 7fdd57547700 1 --2- 172.21.15.26:0/2050362726 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd5009d6f0 0x7fdd5009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:58.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.088+0000 7fdd57547700 1 --2- 172.21.15.26:0/2050362726 >> v2:172.21.15.26:3300/0 conn(0x7fdd5009e000 0x7fdd501339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:58.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.088+0000 7fdd57547700 1 -- 172.21.15.26:0/2050362726 >> 172.21.15.26:0/2050362726 conn(0x7fdd50066f50 msgr2=0x7fdd5009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:58.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.088+0000 7fdd57547700 1 -- 172.21.15.26:0/2050362726 shutdown_connections 2023-10-01T07:59:58.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.088+0000 7fdd57547700 1 -- 172.21.15.26:0/2050362726 wait complete. 2023-10-01T07:59:58.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.089+0000 7fdd57547700 1 Processor -- start 2023-10-01T07:59:58.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.089+0000 7fdd57547700 1 -- start start 2023-10-01T07:59:58.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.090+0000 7fdd57547700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd5009d6f0 0x7fdd501c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:58.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.090+0000 7fdd57547700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd5009e000 0x7fdd501c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:58.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.090+0000 7fdd57547700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd5009e410 0x7fdd501c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:58.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.090+0000 7fdd57547700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd501a6420 con 0x7fdd5009d6f0 2023-10-01T07:59:58.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.090+0000 7fdd57547700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd501a7c10 con 0x7fdd5009e000 2023-10-01T07:59:58.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.090+0000 7fdd57547700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5009c710 con 0x7fdd5009e410 2023-10-01T07:59:58.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.090+0000 7fdd54ae2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd5009e000 0x7fdd501c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:58.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.090+0000 7fdd54ae2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd5009e000 0x7fdd501c84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44662/0 (socket says 172.21.15.26:44662) 2023-10-01T07:59:58.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.090+0000 7fdd54ae2700 1 -- 172.21.15.26:0/3569729216 learned_addr learned my addr 172.21.15.26:0/3569729216 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:58.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.090+0000 7fdd55ae4700 1 --2- 172.21.15.26:0/3569729216 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd5009e410 0x7fdd501c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:58.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.090+0000 7fdd552e3700 1 --2- 172.21.15.26:0/3569729216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd5009d6f0 0x7fdd501c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:58.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.091+0000 7fdd55ae4700 1 -- 172.21.15.26:0/3569729216 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd5009e000 msgr2=0x7fdd501c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:58.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.091+0000 7fdd55ae4700 1 --2- 172.21.15.26:0/3569729216 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd5009e000 0x7fdd501c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:58.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.091+0000 7fdd55ae4700 1 -- 172.21.15.26:0/3569729216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd5009d6f0 msgr2=0x7fdd501c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:58.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.091+0000 7fdd55ae4700 1 --2- 172.21.15.26:0/3569729216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd5009d6f0 0x7fdd501c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:58.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.091+0000 7fdd55ae4700 1 -- 172.21.15.26:0/3569729216 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd400094a0 con 0x7fdd5009e410 2023-10-01T07:59:58.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.091+0000 7fdd552e3700 1 --2- 172.21.15.26:0/3569729216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd5009d6f0 0x7fdd501c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:58.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.091+0000 7fdd55ae4700 1 --2- 172.21.15.26:0/3569729216 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd5009e410 0x7fdd501c8a30 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fdd48015000 tx=0x7fdd48004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:58.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.091+0000 7fdd45ffb700 1 -- 172.21.15.26:0/3569729216 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd48004450 con 0x7fdd5009e410 2023-10-01T07:59:58.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.091+0000 7fdd45ffb700 1 -- 172.21.15.26:0/3569729216 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd480045f0 con 0x7fdd5009e410 2023-10-01T07:59:58.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.091+0000 7fdd45ffb700 1 -- 172.21.15.26:0/3569729216 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd48003e10 con 0x7fdd5009e410 2023-10-01T07:59:58.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.092+0000 7fdd57547700 1 -- 172.21.15.26:0/3569729216 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd48009b30 con 0x7fdd5009e410 2023-10-01T07:59:58.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.092+0000 7fdd57547700 1 -- 172.21.15.26:0/3569729216 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd501a6f10 con 0x7fdd5009e410 2023-10-01T07:59:58.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.093+0000 7fdd45ffb700 1 -- 172.21.15.26:0/3569729216 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdd4801c410 con 0x7fdd5009e410 2023-10-01T07:59:58.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.093+0000 7fdd45ffb700 1 -- 172.21.15.26:0/3569729216 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdd48041170 con 0x7fdd5009e410 2023-10-01T07:59:58.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.093+0000 7fdd57547700 1 -- 172.21.15.26:0/3569729216 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd50074ea0 con 0x7fdd5009e410 2023-10-01T07:59:58.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.098+0000 7fdd45ffb700 1 -- 172.21.15.26:0/3569729216 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdd4801a7d0 con 0x7fdd5009e410 2023-10-01T07:59:58.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.120+0000 7f8315acc700 1 Processor -- start 2023-10-01T07:59:58.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.120+0000 7f8315acc700 1 -- start start 2023-10-01T07:59:58.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.120+0000 7f8315acc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f831009e930 0x7f831009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:58.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.120+0000 7f8315acc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f831009f240 0x7f83101317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:58.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.120+0000 7f8315acc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f831009f650 0x7f8310131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:58.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.120+0000 7f8315acc700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8310070940 con 0x7f831009f240 2023-10-01T07:59:58.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.120+0000 7f8315acc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831006fd60 con 0x7f831009e930 2023-10-01T07:59:58.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.120+0000 7f8315acc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f831006fa80 con 0x7f831009f650 2023-10-01T07:59:58.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.120+0000 7f830f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f831009e930 0x7f831009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:58.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.120+0000 7f830f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f831009e930 0x7f831009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44668/0 (socket says 172.21.15.26:44668) 2023-10-01T07:59:58.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.120+0000 7f830f7fe700 1 -- 172.21.15.26:0/3761918037 learned_addr learned my addr 172.21.15.26:0/3761918037 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:58.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.121+0000 7f830ffff700 1 --2- 172.21.15.26:0/3761918037 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f831009f650 0x7f8310131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:58.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.121+0000 7f830effd700 1 --2- 172.21.15.26:0/3761918037 >> v2:172.21.15.26:3300/0 conn(0x7f831009f240 0x7f83101317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:58.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.121+0000 7f830f7fe700 1 -- 172.21.15.26:0/3761918037 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f831009f650 msgr2=0x7f8310131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:58.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.121+0000 7f830f7fe700 1 --2- 172.21.15.26:0/3761918037 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f831009f650 0x7f8310131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:58.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.121+0000 7f830f7fe700 1 -- 172.21.15.26:0/3761918037 >> v2:172.21.15.26:3300/0 conn(0x7f831009f240 msgr2=0x7f83101317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:58.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.121+0000 7f830f7fe700 1 --2- 172.21.15.26:0/3761918037 >> v2:172.21.15.26:3300/0 conn(0x7f831009f240 0x7f83101317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:58.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.121+0000 7f830f7fe700 1 -- 172.21.15.26:0/3761918037 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831009fb60 con 0x7f831009e930 2023-10-01T07:59:58.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.121+0000 7f830f7fe700 1 --2- 172.21.15.26:0/3761918037 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f831009e930 0x7f831009ed00 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f83000098f0 tx=0x7f8300009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea3c4c219066e896 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:58.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.121+0000 7f830e7fc700 1 -- 172.21.15.26:0/3761918037 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8300011830 con 0x7f831009e930 2023-10-01T07:59:58.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.121+0000 7f830e7fc700 1 -- 172.21.15.26:0/3761918037 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8300011990 con 0x7f831009e930 2023-10-01T07:59:58.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.121+0000 7f830e7fc700 1 -- 172.21.15.26:0/3761918037 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8300011d20 con 0x7f831009e930 2023-10-01T07:59:58.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.122+0000 7f8315acc700 1 -- 172.21.15.26:0/3761918037 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f831009e930 msgr2=0x7f831009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:58.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.122+0000 7f8315acc700 1 --2- 172.21.15.26:0/3761918037 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f831009e930 0x7f831009ed00 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f83000098f0 tx=0x7f8300009c00 comp rx=0 tx=0).stop 2023-10-01T07:59:58.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.122+0000 7f8315acc700 1 -- 172.21.15.26:0/3761918037 shutdown_connections 2023-10-01T07:59:58.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.122+0000 7f8315acc700 1 --2- 172.21.15.26:0/3761918037 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f831009f650 0x7f8310131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:58.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.122+0000 7f8315acc700 1 --2- 172.21.15.26:0/3761918037 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f831009e930 0x7f831009ed00 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:58.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.122+0000 7f8315acc700 1 --2- 172.21.15.26:0/3761918037 >> v2:172.21.15.26:3300/0 conn(0x7f831009f240 0x7f83101317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:58.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.122+0000 7f8315acc700 1 -- 172.21.15.26:0/3761918037 >> 172.21.15.26:0/3761918037 conn(0x7f83100a4210 msgr2=0x7f83100a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:58.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.122+0000 7f8315acc700 1 -- 172.21.15.26:0/3761918037 shutdown_connections 2023-10-01T07:59:58.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.122+0000 7f8315acc700 1 -- 172.21.15.26:0/3761918037 wait complete. 2023-10-01T07:59:58.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.123+0000 7f8315acc700 1 Processor -- start 2023-10-01T07:59:58.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.124+0000 7f8315acc700 1 -- start start 2023-10-01T07:59:58.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.124+0000 7f8315acc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f831009e930 0x7f83101a4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:58.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.124+0000 7f8315acc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f831009f240 0x7f83101a4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:58.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.124+0000 7f8315acc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f831009f650 0x7f83101a4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:58.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.124+0000 7f8315acc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83101a7b70 con 0x7f831009e930 2023-10-01T07:59:58.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.124+0000 7f8315acc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83101a6490 con 0x7f831009f240 2023-10-01T07:59:58.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.124+0000 7f8315acc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83100a3550 con 0x7f831009f650 2023-10-01T07:59:58.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.124+0000 7f830f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f831009e930 0x7f83101a4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:58.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.124+0000 7f830f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f831009e930 0x7f83101a4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35412/0 (socket says 172.21.15.26:35412) 2023-10-01T07:59:58.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.124+0000 7f830f7fe700 1 -- 172.21.15.26:0/4096284870 learned_addr learned my addr 172.21.15.26:0/4096284870 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:58.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.124+0000 7f830ffff700 1 --2- 172.21.15.26:0/4096284870 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f831009f650 0x7f83101a4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:58.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.124+0000 7f830effd700 1 --2- 172.21.15.26:0/4096284870 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f831009f240 0x7f83101a4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:58.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.124+0000 7f830f7fe700 1 -- 172.21.15.26:0/4096284870 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f831009f650 msgr2=0x7f83101a4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:58.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.124+0000 7f830f7fe700 1 --2- 172.21.15.26:0/4096284870 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f831009f650 0x7f83101a4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:58.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.125+0000 7f830f7fe700 1 -- 172.21.15.26:0/4096284870 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f831009f240 msgr2=0x7f83101a4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:58.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.125+0000 7f830f7fe700 1 --2- 172.21.15.26:0/4096284870 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f831009f240 0x7f83101a4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:58.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.125+0000 7f830f7fe700 1 -- 172.21.15.26:0/4096284870 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8300009550 con 0x7f831009e930 2023-10-01T07:59:58.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.125+0000 7f830f7fe700 1 --2- 172.21.15.26:0/4096284870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f831009e930 0x7f83101a4020 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f8300009c40 tx=0x7f8300004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:58.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.125+0000 7f82f7fff700 1 -- 172.21.15.26:0/4096284870 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8300004240 con 0x7f831009e930 2023-10-01T07:59:58.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.125+0000 7f82f7fff700 1 -- 172.21.15.26:0/4096284870 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830001f070 con 0x7f831009e930 2023-10-01T07:59:58.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.125+0000 7f82f7fff700 1 -- 172.21.15.26:0/4096284870 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83000045e0 con 0x7f831009e930 2023-10-01T07:59:58.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.126+0000 7f8315acc700 1 -- 172.21.15.26:0/4096284870 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83100a0190 con 0x7f831009e930 2023-10-01T07:59:58.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.126+0000 7f8315acc700 1 -- 172.21.15.26:0/4096284870 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83101a6130 con 0x7f831009e930 2023-10-01T07:59:58.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.127+0000 7f82f7fff700 1 -- 172.21.15.26:0/4096284870 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8300021030 con 0x7f831009e930 2023-10-01T07:59:58.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.127+0000 7f8315acc700 1 -- 172.21.15.26:0/4096284870 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83101a0b30 con 0x7f831009e930 2023-10-01T07:59:58.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.127+0000 7f82f7fff700 1 -- 172.21.15.26:0/4096284870 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8300040780 con 0x7f831009e930 2023-10-01T07:59:58.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.132+0000 7f82f7fff700 1 -- 172.21.15.26:0/4096284870 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f83000197f0 con 0x7f831009e930 2023-10-01T07:59:58.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.196+0000 7f245ef7e700 1 -- 172.21.15.26:0/2753044058 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f24580a3a70 con 0x7f245806a770 2023-10-01T07:59:58.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.197+0000 7f24557fa700 1 -- 172.21.15.26:0/2753044058 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f244c017070 con 0x7f245806a770 2023-10-01T07:59:58.197 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:58.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.200+0000 7f245ef7e700 1 -- 172.21.15.26:0/2753044058 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f245806a770 msgr2=0x7f24581c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:58.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.200+0000 7f245ef7e700 1 --2- 172.21.15.26:0/2753044058 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f245806a770 0x7f24581c8260 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f244c00ebe0 tx=0x7f244c00eef0 comp rx=0 tx=0).stop 2023-10-01T07:59:58.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.200+0000 7f245ef7e700 1 -- 172.21.15.26:0/2753044058 shutdown_connections 2023-10-01T07:59:58.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.200+0000 7f245ef7e700 1 --2- 172.21.15.26:0/2753044058 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2458131b40 0x7f24581c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:58.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.200+0000 7f245ef7e700 1 --2- 172.21.15.26:0/2753044058 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f245806a770 0x7f24581c8260 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:58.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.200+0000 7f245ef7e700 1 --2- 172.21.15.26:0/2753044058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f245806b080 0x7f24581c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:58.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.200+0000 7f245ef7e700 1 -- 172.21.15.26:0/2753044058 >> 172.21.15.26:0/2753044058 conn(0x7f2458066f50 msgr2=0x7f2458070010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:58.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.200+0000 7f245ef7e700 1 -- 172.21.15.26:0/2753044058 shutdown_connections 2023-10-01T07:59:58.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.200+0000 7f245ef7e700 1 -- 172.21.15.26:0/2753044058 wait complete. 2023-10-01T07:59:58.221 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:58.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.277+0000 7efbfdffb700 1 -- 172.21.15.26:0/1850499761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efbf0005590 con 0x7efc1809e1d0 2023-10-01T07:59:58.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.278+0000 7efbfffff700 1 -- 172.21.15.26:0/1850499761 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efc0c015020 con 0x7efc1809e1d0 2023-10-01T07:59:58.278 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:58.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.280+0000 7efbfdffb700 1 -- 172.21.15.26:0/1850499761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc1809e1d0 msgr2=0x7efc181c89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:58.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.280+0000 7efbfdffb700 1 --2- 172.21.15.26:0/1850499761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc1809e1d0 0x7efc181c89a0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7efc0c0090b0 tx=0x7efc0c004750 comp rx=0 tx=0).stop 2023-10-01T07:59:58.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.280+0000 7efbfdffb700 1 -- 172.21.15.26:0/1850499761 shutdown_connections 2023-10-01T07:59:58.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.280+0000 7efbfdffb700 1 --2- 172.21.15.26:0/1850499761 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efc18139170 0x7efc181c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:58.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.280+0000 7efbfdffb700 1 --2- 172.21.15.26:0/1850499761 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efc1809d6f0 0x7efc181c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:58.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.280+0000 7efbfdffb700 1 --2- 172.21.15.26:0/1850499761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc1809e1d0 0x7efc181c89a0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:58.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.280+0000 7efbfdffb700 1 -- 172.21.15.26:0/1850499761 >> 172.21.15.26:0/1850499761 conn(0x7efc18066f50 msgr2=0x7efc18136c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:58.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.280+0000 7efbfdffb700 1 -- 172.21.15.26:0/1850499761 shutdown_connections 2023-10-01T07:59:58.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.280+0000 7efbfdffb700 1 -- 172.21.15.26:0/1850499761 wait complete. 2023-10-01T07:59:58.295 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:58.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.340+0000 7f8315acc700 1 -- 172.21.15.26:0/4096284870 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8310074ea0 con 0x7f831009e930 2023-10-01T07:59:58.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.340+0000 7f82f7fff700 1 -- 172.21.15.26:0/4096284870 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f830001b430 con 0x7f831009e930 2023-10-01T07:59:58.341 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:58.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.342+0000 7f8315acc700 1 -- 172.21.15.26:0/4096284870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f831009e930 msgr2=0x7f83101a4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:58.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.342+0000 7f8315acc700 1 --2- 172.21.15.26:0/4096284870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f831009e930 0x7f83101a4020 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f8300009c40 tx=0x7f8300004750 comp rx=0 tx=0).stop 2023-10-01T07:59:58.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.342+0000 7f8315acc700 1 -- 172.21.15.26:0/4096284870 shutdown_connections 2023-10-01T07:59:58.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.342+0000 7f8315acc700 1 --2- 172.21.15.26:0/4096284870 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f831009f650 0x7f83101a4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:58.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.342+0000 7f8315acc700 1 --2- 172.21.15.26:0/4096284870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f831009e930 0x7f83101a4020 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:58.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.342+0000 7f8315acc700 1 --2- 172.21.15.26:0/4096284870 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f831009f240 0x7f83101a4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:58.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.343+0000 7f8315acc700 1 -- 172.21.15.26:0/4096284870 >> 172.21.15.26:0/4096284870 conn(0x7f83100a4210 msgr2=0x7f83101b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:58.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.343+0000 7f8315acc700 1 -- 172.21.15.26:0/4096284870 shutdown_connections 2023-10-01T07:59:58.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.343+0000 7f8315acc700 1 -- 172.21.15.26:0/4096284870 wait complete. 2023-10-01T07:59:58.357 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:58.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.357+0000 7fdd57547700 1 -- 172.21.15.26:0/3569729216 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdd5006c360 con 0x7fdd5009e410 2023-10-01T07:59:58.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.358+0000 7fdd45ffb700 1 -- 172.21.15.26:0/3569729216 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdd4802a020 con 0x7fdd5009e410 2023-10-01T07:59:58.358 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:58.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.360+0000 7fdd57547700 1 -- 172.21.15.26:0/3569729216 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd5009e410 msgr2=0x7fdd501c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:58.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.360+0000 7fdd57547700 1 --2- 172.21.15.26:0/3569729216 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd5009e410 0x7fdd501c8a30 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fdd48015000 tx=0x7fdd48004ad0 comp rx=0 tx=0).stop 2023-10-01T07:59:58.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.360+0000 7fdd57547700 1 -- 172.21.15.26:0/3569729216 shutdown_connections 2023-10-01T07:59:58.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.360+0000 7fdd57547700 1 --2- 172.21.15.26:0/3569729216 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd5009e410 0x7fdd501c8a30 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:58.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.360+0000 7fdd57547700 1 --2- 172.21.15.26:0/3569729216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd5009d6f0 0x7fdd501c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:58.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.360+0000 7fdd57547700 1 --2- 172.21.15.26:0/3569729216 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd5009e000 0x7fdd501c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:58.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.360+0000 7fdd57547700 1 -- 172.21.15.26:0/3569729216 >> 172.21.15.26:0/3569729216 conn(0x7fdd50066f50 msgr2=0x7fdd501bbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:58.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.360+0000 7fdd57547700 1 -- 172.21.15.26:0/3569729216 shutdown_connections 2023-10-01T07:59:58.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:58.360+0000 7fdd57547700 1 -- 172.21.15.26:0/3569729216 wait complete. 2023-10-01T07:59:58.374 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T07:59:59.222 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T07:59:59.296 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T07:59:59.357 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T07:59:59.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.370+0000 7f99452ab700 1 Processor -- start 2023-10-01T07:59:59.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.370+0000 7f99452ab700 1 -- start start 2023-10-01T07:59:59.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.371+0000 7f99452ab700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9940130540 0x7f9940130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:59.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.371+0000 7f99452ab700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9940130e50 0x7f994006f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:59.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.371+0000 7f99452ab700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f994006fb20 0x7f994006ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:59.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.371+0000 7f99452ab700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f994009a390 con 0x7f9940130540 2023-10-01T07:59:59.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.371+0000 7f99452ab700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99400716a0 con 0x7f994006fb20 2023-10-01T07:59:59.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.371+0000 7f99452ab700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9940071290 con 0x7f9940130e50 2023-10-01T07:59:59.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.371+0000 7f993e7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9940130e50 0x7f994006f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:59.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.371+0000 7f993e7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9940130e50 0x7f994006f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56050/0 (socket says 172.21.15.26:56050) 2023-10-01T07:59:59.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.371+0000 7f993e7fc700 1 -- 172.21.15.26:0/3449395718 learned_addr learned my addr 172.21.15.26:0/3449395718 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:59.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.371+0000 7f993effd700 1 --2- 172.21.15.26:0/3449395718 >> v2:172.21.15.26:3300/0 conn(0x7f9940130540 0x7f9940130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:59.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.371+0000 7f993f7fe700 1 --2- 172.21.15.26:0/3449395718 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f994006fb20 0x7f994006ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:59.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.371+0000 7f993e7fc700 1 -- 172.21.15.26:0/3449395718 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f994006fb20 msgr2=0x7f994006ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:59.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.371+0000 7f993e7fc700 1 --2- 172.21.15.26:0/3449395718 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f994006fb20 0x7f994006ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.371+0000 7f993e7fc700 1 -- 172.21.15.26:0/3449395718 >> v2:172.21.15.26:3300/0 conn(0x7f9940130540 msgr2=0x7f9940130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:59.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.371+0000 7f993e7fc700 1 --2- 172.21.15.26:0/3449395718 >> v2:172.21.15.26:3300/0 conn(0x7f9940130540 0x7f9940130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.371+0000 7f993e7fc700 1 -- 172.21.15.26:0/3449395718 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9940130340 con 0x7f9940130e50 2023-10-01T07:59:59.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.371+0000 7f993f7fe700 1 --2- 172.21.15.26:0/3449395718 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f994006fb20 0x7f994006ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T07:59:59.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.371+0000 7f993e7fc700 1 --2- 172.21.15.26:0/3449395718 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9940130e50 0x7f994006f5e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f993400bb90 tx=0x7f993400bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=782949abdca41338 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:59.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.372+0000 7f993dffb700 1 -- 172.21.15.26:0/3449395718 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993400dd30 con 0x7f9940130e50 2023-10-01T07:59:59.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.372+0000 7f993dffb700 1 -- 172.21.15.26:0/3449395718 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993400de90 con 0x7f9940130e50 2023-10-01T07:59:59.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.372+0000 7f993dffb700 1 -- 172.21.15.26:0/3449395718 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9934010690 con 0x7f9940130e50 2023-10-01T07:59:59.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.372+0000 7f99452ab700 1 -- 172.21.15.26:0/3449395718 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9940130e50 msgr2=0x7f994006f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:59.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.372+0000 7f99452ab700 1 --2- 172.21.15.26:0/3449395718 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9940130e50 0x7f994006f5e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f993400bb90 tx=0x7f993400bea0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.372+0000 7f99452ab700 1 -- 172.21.15.26:0/3449395718 shutdown_connections 2023-10-01T07:59:59.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.372+0000 7f99452ab700 1 --2- 172.21.15.26:0/3449395718 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f994006fb20 0x7f994006ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.372+0000 7f99452ab700 1 --2- 172.21.15.26:0/3449395718 >> v2:172.21.15.26:3300/0 conn(0x7f9940130540 0x7f9940130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.372+0000 7f99452ab700 1 --2- 172.21.15.26:0/3449395718 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9940130e50 0x7f994006f5e0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.372+0000 7f99452ab700 1 -- 172.21.15.26:0/3449395718 >> 172.21.15.26:0/3449395718 conn(0x7f99400a2aa0 msgr2=0x7f99400a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:59.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.373+0000 7f99452ab700 1 -- 172.21.15.26:0/3449395718 shutdown_connections 2023-10-01T07:59:59.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.373+0000 7f99452ab700 1 -- 172.21.15.26:0/3449395718 wait complete. 2023-10-01T07:59:59.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.374+0000 7f99452ab700 1 Processor -- start 2023-10-01T07:59:59.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.374+0000 7f99452ab700 1 -- start start 2023-10-01T07:59:59.376 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T07:59:59.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.375+0000 7f99452ab700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f994006fb20 0x7f994011a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:59.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.375+0000 7f99452ab700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9940130540 0x7f994011aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:59.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.375+0000 7f99452ab700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9940130e50 0x7f994011b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:59.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.375+0000 7f99452ab700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99400718e0 con 0x7f9940130e50 2023-10-01T07:59:59.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.375+0000 7f99452ab700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f994011c1e0 con 0x7f994006fb20 2023-10-01T07:59:59.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.375+0000 7f99452ab700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f994011dd70 con 0x7f9940130540 2023-10-01T07:59:59.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.375+0000 7f993e7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9940130540 0x7f994011aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:59.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.375+0000 7f993e7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9940130540 0x7f994011aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56060/0 (socket says 172.21.15.26:56060) 2023-10-01T07:59:59.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.375+0000 7f993effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f994006fb20 0x7f994011a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:59.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.375+0000 7f993e7fc700 1 -- 172.21.15.26:0/1263409134 learned_addr learned my addr 172.21.15.26:0/1263409134 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:59.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.375+0000 7f993f7fe700 1 --2- 172.21.15.26:0/1263409134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9940130e50 0x7f994011b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:59.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.376+0000 7f993e7fc700 1 -- 172.21.15.26:0/1263409134 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f994006fb20 msgr2=0x7f994011a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:59.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.376+0000 7f993e7fc700 1 --2- 172.21.15.26:0/1263409134 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f994006fb20 0x7f994011a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.376+0000 7f993e7fc700 1 -- 172.21.15.26:0/1263409134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9940130e50 msgr2=0x7f994011b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:59.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.376+0000 7f993e7fc700 1 --2- 172.21.15.26:0/1263409134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9940130e50 0x7f994011b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.376+0000 7f993e7fc700 1 -- 172.21.15.26:0/1263409134 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f993400b7f0 con 0x7f9940130540 2023-10-01T07:59:59.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.376+0000 7f993f7fe700 1 --2- 172.21.15.26:0/1263409134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9940130e50 0x7f994011b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:59.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.376+0000 7f993e7fc700 1 --2- 172.21.15.26:0/1263409134 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9940130540 0x7f994011aaf0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f9934000c00 tx=0x7f9934004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:59.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.376+0000 7f99277fe700 1 -- 172.21.15.26:0/1263409134 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993401f070 con 0x7f9940130540 2023-10-01T07:59:59.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.376+0000 7f99277fe700 1 -- 172.21.15.26:0/1263409134 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9934003970 con 0x7f9940130540 2023-10-01T07:59:59.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.376+0000 7f99452ab700 1 -- 172.21.15.26:0/1263409134 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99400a0aa0 con 0x7f9940130540 2023-10-01T07:59:59.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.376+0000 7f99277fe700 1 -- 172.21.15.26:0/1263409134 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9934003d20 con 0x7f9940130540 2023-10-01T07:59:59.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.376+0000 7f99452ab700 1 -- 172.21.15.26:0/1263409134 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f994011e050 con 0x7f9940130540 2023-10-01T07:59:59.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.377+0000 7f99277fe700 1 -- 172.21.15.26:0/1263409134 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9934023410 con 0x7f9940130540 2023-10-01T07:59:59.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.377+0000 7f99277fe700 1 -- 172.21.15.26:0/1263409134 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9934042a00 con 0x7f9940130540 2023-10-01T07:59:59.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.378+0000 7f99452ab700 1 -- 172.21.15.26:0/1263409134 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f994009cd40 con 0x7f9940130540 2023-10-01T07:59:59.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.383+0000 7f99277fe700 1 -- 172.21.15.26:0/1263409134 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9934019400 con 0x7f9940130540 2023-10-01T07:59:59.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.443+0000 7f9c240b6700 1 Processor -- start 2023-10-01T07:59:59.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.443+0000 7f9c240b6700 1 -- start start 2023-10-01T07:59:59.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.444+0000 7f9c240b6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c1c134630 0x7f9c1c136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:59.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.444+0000 7f9c240b6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c1c136f50 0x7f9c1c139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:59.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.444+0000 7f9c240b6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c1c09b4f0 con 0x7f9c1c131810 2023-10-01T07:59:59.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.444+0000 7f9c240b6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c1313c0 con 0x7f9c1c136f50 2023-10-01T07:59:59.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.444+0000 7f9c240b6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c06e8c0 con 0x7f9c1c134630 2023-10-01T07:59:59.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.444+0000 7f9c22653700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c1c136f50 0x7f9c1c139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:59.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.444+0000 7f9c21651700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c1c134630 0x7f9c1c136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:59.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.444+0000 7f9c22653700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c1c136f50 0x7f9c1c139330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44712/0 (socket says 172.21.15.26:44712) 2023-10-01T07:59:59.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.444+0000 7f9c22653700 1 -- 172.21.15.26:0/3655953312 learned_addr learned my addr 172.21.15.26:0/3655953312 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:59.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.445+0000 7f9c22653700 1 -- 172.21.15.26:0/3655953312 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c1c134630 msgr2=0x7f9c1c136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:59.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.445+0000 7f9c22653700 1 --2- 172.21.15.26:0/3655953312 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c1c134630 0x7f9c1c136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.445+0000 7f9c22653700 1 -- 172.21.15.26:0/3655953312 >> v1:172.21.15.26:6789/0 conn(0x7f9c1c131810 legacy=0x7f9c1c131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:59.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.445+0000 7f9c22653700 1 -- 172.21.15.26:0/3655953312 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c1c071d20 con 0x7f9c1c136f50 2023-10-01T07:59:59.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.445+0000 7f9c21651700 1 --2- 172.21.15.26:0/3655953312 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c1c134630 0x7f9c1c136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:59.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.445+0000 7f9c22653700 1 --2- 172.21.15.26:0/3655953312 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c1c136f50 0x7f9c1c139330 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f9c14009e80 tx=0x7f9c1400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73d7eac0798c1c37 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:59.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.445+0000 7f9c20e50700 1 -- 172.21.15.26:0/3655953312 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1400e070 con 0x7f9c1c136f50 2023-10-01T07:59:59.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.445+0000 7f9c20e50700 1 -- 172.21.15.26:0/3655953312 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1400b910 con 0x7f9c1c136f50 2023-10-01T07:59:59.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.445+0000 7f9c20e50700 1 -- 172.21.15.26:0/3655953312 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1400bcc0 con 0x7f9c1c136f50 2023-10-01T07:59:59.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.446+0000 7f9c240b6700 1 -- 172.21.15.26:0/3655953312 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c1c136f50 msgr2=0x7f9c1c139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:59.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.446+0000 7f9c240b6700 1 --2- 172.21.15.26:0/3655953312 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c1c136f50 0x7f9c1c139330 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f9c14009e80 tx=0x7f9c1400b330 comp rx=0 tx=0).stop 2023-10-01T07:59:59.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.446+0000 7f9c240b6700 1 -- 172.21.15.26:0/3655953312 shutdown_connections 2023-10-01T07:59:59.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.446+0000 7f9c240b6700 1 --2- 172.21.15.26:0/3655953312 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c1c136f50 0x7f9c1c139330 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.446+0000 7f9c240b6700 1 --2- 172.21.15.26:0/3655953312 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c1c134630 0x7f9c1c136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.446+0000 7f9c240b6700 1 -- 172.21.15.26:0/3655953312 >> 172.21.15.26:0/3655953312 conn(0x7f9c1c0a2aa0 msgr2=0x7f9c1c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:59.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.446+0000 7f9c240b6700 1 -- 172.21.15.26:0/3655953312 shutdown_connections 2023-10-01T07:59:59.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.447+0000 7f9c240b6700 1 -- 172.21.15.26:0/3655953312 wait complete. 2023-10-01T07:59:59.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.448+0000 7f9c240b6700 1 Processor -- start 2023-10-01T07:59:59.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.448+0000 7f9c240b6700 1 -- start start 2023-10-01T07:59:59.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.449+0000 7f9c240b6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c1c131810 0x7f9c1c137f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:59.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.449+0000 7f9c240b6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c1c134630 0x7f9c1c138470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:59.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.449+0000 7f9c240b6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c1c136f50 0x7f9c1c1389b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:59.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.449+0000 7f9c240b6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c09bb50 con 0x7f9c1c134630 2023-10-01T07:59:59.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.449+0000 7f9c240b6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c136a20 con 0x7f9c1c131810 2023-10-01T07:59:59.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.449+0000 7f9c240b6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c09cd60 con 0x7f9c1c136f50 2023-10-01T07:59:59.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.449+0000 7f9c21e52700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c1c131810 0x7f9c1c137f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:59.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.449+0000 7f9c22653700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c1c136f50 0x7f9c1c1389b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:59.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.449+0000 7f9c21e52700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c1c131810 0x7f9c1c137f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44724/0 (socket says 172.21.15.26:44724) 2023-10-01T07:59:59.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.449+0000 7f9c21e52700 1 -- 172.21.15.26:0/886351786 learned_addr learned my addr 172.21.15.26:0/886351786 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:59.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.449+0000 7f9c21651700 1 --2- 172.21.15.26:0/886351786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c1c134630 0x7f9c1c138470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:59.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.449+0000 7f9c22653700 1 -- 172.21.15.26:0/886351786 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c1c131810 msgr2=0x7f9c1c137f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:59.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.449+0000 7f9c22653700 1 --2- 172.21.15.26:0/886351786 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c1c131810 0x7f9c1c137f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.449+0000 7f9c22653700 1 -- 172.21.15.26:0/886351786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c1c134630 msgr2=0x7f9c1c138470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:59.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.449+0000 7f9c22653700 1 --2- 172.21.15.26:0/886351786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c1c134630 0x7f9c1c138470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.449+0000 7f9c22653700 1 -- 172.21.15.26:0/886351786 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0c0094a0 con 0x7f9c1c136f50 2023-10-01T07:59:59.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.449+0000 7f9c21e52700 1 --2- 172.21.15.26:0/886351786 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c1c131810 0x7f9c1c137f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:59.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.450+0000 7f9c22653700 1 --2- 172.21.15.26:0/886351786 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c1c136f50 0x7f9c1c1389b0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f9c14015000 tx=0x7f9c14004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:59.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.450+0000 7f9c127fc700 1 -- 172.21.15.26:0/886351786 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c140048c0 con 0x7f9c1c136f50 2023-10-01T07:59:59.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.450+0000 7f9c127fc700 1 -- 172.21.15.26:0/886351786 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c140092e0 con 0x7f9c1c136f50 2023-10-01T07:59:59.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.450+0000 7f9c240b6700 1 -- 172.21.15.26:0/886351786 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c14009b30 con 0x7f9c1c136f50 2023-10-01T07:59:59.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.450+0000 7f9c127fc700 1 -- 172.21.15.26:0/886351786 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1401c650 con 0x7f9c1c136f50 2023-10-01T07:59:59.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.450+0000 7f9c240b6700 1 -- 172.21.15.26:0/886351786 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c1c072250 con 0x7f9c1c136f50 2023-10-01T07:59:59.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.451+0000 7f9c127fc700 1 -- 172.21.15.26:0/886351786 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9c1401c7b0 con 0x7f9c1c136f50 2023-10-01T07:59:59.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.451+0000 7f9c240b6700 1 -- 172.21.15.26:0/886351786 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c1c0a1d20 con 0x7f9c1c136f50 2023-10-01T07:59:59.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.452+0000 7f9c127fc700 1 -- 172.21.15.26:0/886351786 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9c140415b0 con 0x7f9c1c136f50 2023-10-01T07:59:59.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.461+0000 7f9c127fc700 1 -- 172.21.15.26:0/886351786 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c1401ca60 con 0x7f9c1c136f50 2023-10-01T07:59:59.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.506+0000 7f0715f68700 1 Processor -- start 2023-10-01T07:59:59.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.507+0000 7f0715f68700 1 -- start start 2023-10-01T07:59:59.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.507+0000 7f0715f68700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f071009d6f0 0x7f071009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:59.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.507+0000 7f0715f68700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f071009e000 0x7f0710130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:59.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.507+0000 7f0715f68700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f071009e410 0x7f0710130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:59.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.507+0000 7f0715f68700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f071009f520 con 0x7f071009e000 2023-10-01T07:59:59.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.507+0000 7f0715f68700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f071009f130 con 0x7f071009e410 2023-10-01T07:59:59.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.507+0000 7f0715f68700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f071009e930 con 0x7f071009d6f0 2023-10-01T07:59:59.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.507+0000 7f070f7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f071009d6f0 0x7f071009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:59.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.507+0000 7f070effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f071009e000 0x7f0710130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:59.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.507+0000 7f070f7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f071009d6f0 0x7f071009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56086/0 (socket says 172.21.15.26:56086) 2023-10-01T07:59:59.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.507+0000 7f070f7fe700 1 -- 172.21.15.26:0/2589827164 learned_addr learned my addr 172.21.15.26:0/2589827164 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:59.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.507+0000 7f070ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f071009e410 0x7f0710130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:59.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.508+0000 7f070f7fe700 1 -- 172.21.15.26:0/2589827164 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f071009e410 msgr2=0x7f0710130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:59.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.508+0000 7f070f7fe700 1 --2- 172.21.15.26:0/2589827164 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f071009e410 0x7f0710130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.508+0000 7f070f7fe700 1 -- 172.21.15.26:0/2589827164 >> v2:172.21.15.26:3300/0 conn(0x7f071009e000 msgr2=0x7f0710130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:59.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.508+0000 7f070f7fe700 1 --2- 172.21.15.26:0/2589827164 >> v2:172.21.15.26:3300/0 conn(0x7f071009e000 0x7f0710130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.508+0000 7f070f7fe700 1 -- 172.21.15.26:0/2589827164 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071009b2d0 con 0x7f071009d6f0 2023-10-01T07:59:59.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.508+0000 7f070f7fe700 1 --2- 172.21.15.26:0/2589827164 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f071009d6f0 0x7f071009dac0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0700009920 tx=0x7f0700009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82eb69ce4f335161 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:59.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.508+0000 7f070e7fc700 1 -- 172.21.15.26:0/2589827164 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0700011830 con 0x7f071009d6f0 2023-10-01T07:59:59.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.508+0000 7f070e7fc700 1 -- 172.21.15.26:0/2589827164 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0700011990 con 0x7f071009d6f0 2023-10-01T07:59:59.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.508+0000 7f070e7fc700 1 -- 172.21.15.26:0/2589827164 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0700011d20 con 0x7f071009d6f0 2023-10-01T07:59:59.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.509+0000 7f0715f68700 1 -- 172.21.15.26:0/2589827164 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f071009d6f0 msgr2=0x7f071009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:59.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.509+0000 7f0715f68700 1 --2- 172.21.15.26:0/2589827164 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f071009d6f0 0x7f071009dac0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0700009920 tx=0x7f0700009c30 comp rx=0 tx=0).stop 2023-10-01T07:59:59.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.509+0000 7f0715f68700 1 -- 172.21.15.26:0/2589827164 shutdown_connections 2023-10-01T07:59:59.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.509+0000 7f0715f68700 1 --2- 172.21.15.26:0/2589827164 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f071009e410 0x7f0710130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.510+0000 7f0715f68700 1 --2- 172.21.15.26:0/2589827164 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f071009d6f0 0x7f071009dac0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.510+0000 7f0715f68700 1 --2- 172.21.15.26:0/2589827164 >> v2:172.21.15.26:3300/0 conn(0x7f071009e000 0x7f0710130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.510+0000 7f0715f68700 1 -- 172.21.15.26:0/2589827164 >> 172.21.15.26:0/2589827164 conn(0x7f0710066f50 msgr2=0x7f071009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:59.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.510+0000 7f0715f68700 1 -- 172.21.15.26:0/2589827164 shutdown_connections 2023-10-01T07:59:59.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.510+0000 7f0715f68700 1 -- 172.21.15.26:0/2589827164 wait complete. 2023-10-01T07:59:59.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.511+0000 7f0715f68700 1 Processor -- start 2023-10-01T07:59:59.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.511+0000 7f0715f68700 1 -- start start 2023-10-01T07:59:59.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.512+0000 7f0715f68700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f071009d6f0 0x7f07101c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:59.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.512+0000 7f0715f68700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f071009e000 0x7f07101c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:59.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.512+0000 7f0715f68700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f071009e410 0x7f07101c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:59.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.512+0000 7f0715f68700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0710138310 con 0x7f071009e410 2023-10-01T07:59:59.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.512+0000 7f0715f68700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0710138be0 con 0x7f071009e000 2023-10-01T07:59:59.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.512+0000 7f0715f68700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0710119fd0 con 0x7f071009d6f0 2023-10-01T07:59:59.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.512+0000 7f070f7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f071009d6f0 0x7f07101c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:59.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.512+0000 7f070f7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f071009d6f0 0x7f07101c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56088/0 (socket says 172.21.15.26:56088) 2023-10-01T07:59:59.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.512+0000 7f070f7fe700 1 -- 172.21.15.26:0/2373387441 learned_addr learned my addr 172.21.15.26:0/2373387441 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:59.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.512+0000 7f070ffff700 1 --2- 172.21.15.26:0/2373387441 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f071009e410 0x7f07101c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:59.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.512+0000 7f070effd700 1 --2- 172.21.15.26:0/2373387441 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f071009e000 0x7f07101c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:59.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.513+0000 7f070ffff700 1 -- 172.21.15.26:0/2373387441 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f071009d6f0 msgr2=0x7f07101c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:59.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.513+0000 7f070ffff700 1 --2- 172.21.15.26:0/2373387441 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f071009d6f0 0x7f07101c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.513+0000 7f070ffff700 1 -- 172.21.15.26:0/2373387441 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f071009e000 msgr2=0x7f07101c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:59.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.513+0000 7f070ffff700 1 --2- 172.21.15.26:0/2373387441 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f071009e000 0x7f07101c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.513+0000 7f070ffff700 1 -- 172.21.15.26:0/2373387441 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0700009550 con 0x7f071009e410 2023-10-01T07:59:59.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.513+0000 7f070f7fe700 1 --2- 172.21.15.26:0/2373387441 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f071009d6f0 0x7f07101c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:59.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.513+0000 7f070ffff700 1 --2- 172.21.15.26:0/2373387441 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f071009e410 0x7f07101c8b80 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f0708009d90 tx=0x7f070800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:59.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.513+0000 7f06f7fff700 1 -- 172.21.15.26:0/2373387441 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0708009c00 con 0x7f071009e410 2023-10-01T07:59:59.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.513+0000 7f06f7fff700 1 -- 172.21.15.26:0/2373387441 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070800f040 con 0x7f071009e410 2023-10-01T07:59:59.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.513+0000 7f0715f68700 1 -- 172.21.15.26:0/2373387441 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0710072470 con 0x7f071009e410 2023-10-01T07:59:59.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.513+0000 7f06f7fff700 1 -- 172.21.15.26:0/2373387441 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0708014480 con 0x7f071009e410 2023-10-01T07:59:59.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.513+0000 7f0715f68700 1 -- 172.21.15.26:0/2373387441 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07101394c0 con 0x7f071009e410 2023-10-01T07:59:59.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.514+0000 7f0715f68700 1 -- 172.21.15.26:0/2373387441 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f071009c760 con 0x7f071009e410 2023-10-01T07:59:59.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.515+0000 7f06f7fff700 1 -- 172.21.15.26:0/2373387441 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f07080145e0 con 0x7f071009e410 2023-10-01T07:59:59.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.515+0000 7f06f7fff700 1 -- 172.21.15.26:0/2373387441 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0708040790 con 0x7f071009e410 2023-10-01T07:59:59.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.520+0000 7f06f7fff700 1 -- 172.21.15.26:0/2373387441 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0708012930 con 0x7f071009e410 2023-10-01T07:59:59.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.527+0000 7f06b15bb700 1 Processor -- start 2023-10-01T07:59:59.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.527+0000 7f06b15bb700 1 -- start start 2023-10-01T07:59:59.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.528+0000 7f06b15bb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f06ac09d6f0 0x7f06ac09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:59.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.528+0000 7f06b15bb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f06ac09e410 0x7f06ac134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:59.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.528+0000 7f06b15bb700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06ac09b120 con 0x7f06ac09e000 2023-10-01T07:59:59.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.528+0000 7f06b15bb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac06b460 con 0x7f06ac09e410 2023-10-01T07:59:59.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.528+0000 7f06b15bb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac09a7e0 con 0x7f06ac09d6f0 2023-10-01T07:59:59.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.528+0000 7f06ab7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f06ac09e410 0x7f06ac134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:59.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.528+0000 7f06ab7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f06ac09e410 0x7f06ac134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44736/0 (socket says 172.21.15.26:44736) 2023-10-01T07:59:59.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.528+0000 7f06ab7fe700 1 -- 172.21.15.26:0/3469216912 learned_addr learned my addr 172.21.15.26:0/3469216912 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:59.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.528+0000 7f06aaffd700 1 --2- 172.21.15.26:0/3469216912 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f06ac09d6f0 0x7f06ac09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:59.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.528+0000 7f06ab7fe700 1 -- 172.21.15.26:0/3469216912 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f06ac09d6f0 msgr2=0x7f06ac09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:59.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.528+0000 7f06ab7fe700 1 --2- 172.21.15.26:0/3469216912 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f06ac09d6f0 0x7f06ac09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.528+0000 7f06ab7fe700 1 -- 172.21.15.26:0/3469216912 >> v1:172.21.15.26:6789/0 conn(0x7f06ac09e000 legacy=0x7f06ac1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T07:59:59.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.529+0000 7f06ab7fe700 1 -- 172.21.15.26:0/3469216912 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ac09a500 con 0x7f06ac09e410 2023-10-01T07:59:59.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.529+0000 7f06ab7fe700 1 --2- 172.21.15.26:0/3469216912 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f06ac09e410 0x7f06ac134100 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009e80 tx=0x7f06a400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0788fda547978ee server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:59.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.529+0000 7f06a9ffb700 1 -- 172.21.15.26:0/3469216912 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a400e070 con 0x7f06ac09e410 2023-10-01T07:59:59.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.529+0000 7f06a9ffb700 1 -- 172.21.15.26:0/3469216912 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a4003a20 con 0x7f06ac09e410 2023-10-01T07:59:59.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.529+0000 7f06a9ffb700 1 -- 172.21.15.26:0/3469216912 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a4003dd0 con 0x7f06ac09e410 2023-10-01T07:59:59.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.530+0000 7f06b15bb700 1 -- 172.21.15.26:0/3469216912 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f06ac09e410 msgr2=0x7f06ac134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:59.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.530+0000 7f06b15bb700 1 --2- 172.21.15.26:0/3469216912 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f06ac09e410 0x7f06ac134100 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009e80 tx=0x7f06a400b330 comp rx=0 tx=0).stop 2023-10-01T07:59:59.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.530+0000 7f06b15bb700 1 -- 172.21.15.26:0/3469216912 shutdown_connections 2023-10-01T07:59:59.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.530+0000 7f06b15bb700 1 --2- 172.21.15.26:0/3469216912 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f06ac09d6f0 0x7f06ac09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.530+0000 7f06b15bb700 1 --2- 172.21.15.26:0/3469216912 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f06ac09e410 0x7f06ac134100 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.530+0000 7f06b15bb700 1 -- 172.21.15.26:0/3469216912 >> 172.21.15.26:0/3469216912 conn(0x7f06ac066f50 msgr2=0x7f06ac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:59.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.530+0000 7f06b15bb700 1 -- 172.21.15.26:0/3469216912 shutdown_connections 2023-10-01T07:59:59.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.530+0000 7f06b15bb700 1 -- 172.21.15.26:0/3469216912 wait complete. 2023-10-01T07:59:59.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.531+0000 7f06b15bb700 1 Processor -- start 2023-10-01T07:59:59.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.532+0000 7f06b15bb700 1 -- start start 2023-10-01T07:59:59.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.532+0000 7f06b15bb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f06ac09d6f0 0x7f06ac1225e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:59.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.532+0000 7f06b15bb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f06ac09e000 0x7f06ac122b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:59.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.532+0000 7f06b15bb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06ac09e410 0x7f06ac123060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T07:59:59.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.532+0000 7f06b15bb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac126110 con 0x7f06ac09e410 2023-10-01T07:59:59.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.532+0000 7f06b15bb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac124a30 con 0x7f06ac09d6f0 2023-10-01T07:59:59.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.532+0000 7f06b15bb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac0721a0 con 0x7f06ac09e000 2023-10-01T07:59:59.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.532+0000 7f06aa7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f06ac09e000 0x7f06ac122b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:59.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.532+0000 7f06aa7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f06ac09e000 0x7f06ac122b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56110/0 (socket says 172.21.15.26:56110) 2023-10-01T07:59:59.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.532+0000 7f06aa7fc700 1 -- 172.21.15.26:0/3998924231 learned_addr learned my addr 172.21.15.26:0/3998924231 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T07:59:59.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.532+0000 7f06aaffd700 1 --2- 172.21.15.26:0/3998924231 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f06ac09d6f0 0x7f06ac1225e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:59.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.532+0000 7f06ab7fe700 1 --2- 172.21.15.26:0/3998924231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06ac09e410 0x7f06ac123060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T07:59:59.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.533+0000 7f06aa7fc700 1 -- 172.21.15.26:0/3998924231 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f06ac09d6f0 msgr2=0x7f06ac1225e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:59.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.533+0000 7f06aa7fc700 1 --2- 172.21.15.26:0/3998924231 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f06ac09d6f0 0x7f06ac1225e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.533+0000 7f06aa7fc700 1 -- 172.21.15.26:0/3998924231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06ac09e410 msgr2=0x7f06ac123060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:59.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.533+0000 7f06aa7fc700 1 --2- 172.21.15.26:0/3998924231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06ac09e410 0x7f06ac123060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.533+0000 7f06aa7fc700 1 -- 172.21.15.26:0/3998924231 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a4009b30 con 0x7f06ac09e000 2023-10-01T07:59:59.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.533+0000 7f06aaffd700 1 --2- 172.21.15.26:0/3998924231 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f06ac09d6f0 0x7f06ac1225e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T07:59:59.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.533+0000 7f06aa7fc700 1 --2- 172.21.15.26:0/3998924231 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f06ac09e000 0x7f06ac122b20 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f06a000c4d0 tx=0x7f06a000c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T07:59:59.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.533+0000 7f06937fe700 1 -- 172.21.15.26:0/3998924231 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a000cea0 con 0x7f06ac09e000 2023-10-01T07:59:59.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.533+0000 7f06937fe700 1 -- 172.21.15.26:0/3998924231 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a00054e0 con 0x7f06ac09e000 2023-10-01T07:59:59.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.533+0000 7f06b15bb700 1 -- 172.21.15.26:0/3998924231 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06ac124f80 con 0x7f06ac09e000 2023-10-01T07:59:59.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.533+0000 7f06937fe700 1 -- 172.21.15.26:0/3998924231 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a00038a0 con 0x7f06ac09e000 2023-10-01T07:59:59.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.533+0000 7f06b15bb700 1 -- 172.21.15.26:0/3998924231 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ac125d90 con 0x7f06ac09e000 2023-10-01T07:59:59.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.534+0000 7f06937fe700 1 -- 172.21.15.26:0/3998924231 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f06a0003a00 con 0x7f06ac09e000 2023-10-01T07:59:59.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.535+0000 7f06937fe700 1 -- 172.21.15.26:0/3998924231 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f06a003ea80 con 0x7f06ac09e000 2023-10-01T07:59:59.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.535+0000 7f06b15bb700 1 -- 172.21.15.26:0/3998924231 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06ac074ea0 con 0x7f06ac09e000 2023-10-01T07:59:59.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.540+0000 7f06937fe700 1 -- 172.21.15.26:0/3998924231 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f06a0017030 con 0x7f06ac09e000 2023-10-01T07:59:59.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.620+0000 7f99452ab700 1 -- 172.21.15.26:0/1263409134 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9940074ea0 con 0x7f9940130540 2023-10-01T07:59:59.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.621+0000 7f99277fe700 1 -- 172.21.15.26:0/1263409134 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9934028020 con 0x7f9940130540 2023-10-01T07:59:59.621 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T07:59:59.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.624+0000 7f99452ab700 1 -- 172.21.15.26:0/1263409134 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9940130540 msgr2=0x7f994011aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:59.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.624+0000 7f99452ab700 1 --2- 172.21.15.26:0/1263409134 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9940130540 0x7f994011aaf0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f9934000c00 tx=0x7f9934004750 comp rx=0 tx=0).stop 2023-10-01T07:59:59.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.624+0000 7f99452ab700 1 -- 172.21.15.26:0/1263409134 shutdown_connections 2023-10-01T07:59:59.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.624+0000 7f99452ab700 1 --2- 172.21.15.26:0/1263409134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9940130e50 0x7f994011b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.624+0000 7f99452ab700 1 --2- 172.21.15.26:0/1263409134 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f994006fb20 0x7f994011a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.624+0000 7f99452ab700 1 --2- 172.21.15.26:0/1263409134 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9940130540 0x7f994011aaf0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.624+0000 7f99452ab700 1 -- 172.21.15.26:0/1263409134 >> 172.21.15.26:0/1263409134 conn(0x7f99400a2aa0 msgr2=0x7f994012d600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:59.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.624+0000 7f99452ab700 1 -- 172.21.15.26:0/1263409134 shutdown_connections 2023-10-01T07:59:59.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.624+0000 7f99452ab700 1 -- 172.21.15.26:0/1263409134 wait complete. 2023-10-01T07:59:59.645 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T07:59:59.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.693+0000 7f9c240b6700 1 -- 172.21.15.26:0/886351786 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9c1c09c880 con 0x7f9c1c136f50 2023-10-01T07:59:59.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.694+0000 7f9c127fc700 1 -- 172.21.15.26:0/886351786 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9c1402cb80 con 0x7f9c1c136f50 2023-10-01T07:59:59.695 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T07:59:59.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.696+0000 7f9c240b6700 1 -- 172.21.15.26:0/886351786 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c1c136f50 msgr2=0x7f9c1c1389b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:59.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.696+0000 7f9c240b6700 1 --2- 172.21.15.26:0/886351786 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c1c136f50 0x7f9c1c1389b0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f9c14015000 tx=0x7f9c14004ad0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.696+0000 7f9c240b6700 1 -- 172.21.15.26:0/886351786 shutdown_connections 2023-10-01T07:59:59.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.696+0000 7f9c240b6700 1 --2- 172.21.15.26:0/886351786 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c1c136f50 0x7f9c1c1389b0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.696+0000 7f9c240b6700 1 --2- 172.21.15.26:0/886351786 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c1c131810 0x7f9c1c137f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.696+0000 7f9c240b6700 1 --2- 172.21.15.26:0/886351786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c1c134630 0x7f9c1c138470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.696+0000 7f9c240b6700 1 -- 172.21.15.26:0/886351786 >> 172.21.15.26:0/886351786 conn(0x7f9c1c0a2aa0 msgr2=0x7f9c1c09f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:59.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.696+0000 7f9c240b6700 1 -- 172.21.15.26:0/886351786 shutdown_connections 2023-10-01T07:59:59.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.696+0000 7f9c240b6700 1 -- 172.21.15.26:0/886351786 wait complete. 2023-10-01T07:59:59.711 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T07:59:59.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.758+0000 7f0715f68700 1 -- 172.21.15.26:0/2373387441 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0710074ea0 con 0x7f071009e410 2023-10-01T07:59:59.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.758+0000 7f06f7fff700 1 -- 172.21.15.26:0/2373387441 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f070802a020 con 0x7f071009e410 2023-10-01T07:59:59.759 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T07:59:59.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.761+0000 7f0715f68700 1 -- 172.21.15.26:0/2373387441 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f071009e410 msgr2=0x7f07101c8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:59.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.761+0000 7f0715f68700 1 --2- 172.21.15.26:0/2373387441 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f071009e410 0x7f07101c8b80 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f0708009d90 tx=0x7f070800c3a0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.761+0000 7f0715f68700 1 -- 172.21.15.26:0/2373387441 shutdown_connections 2023-10-01T07:59:59.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.761+0000 7f0715f68700 1 --2- 172.21.15.26:0/2373387441 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f071009e410 0x7f07101c8b80 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.761+0000 7f0715f68700 1 --2- 172.21.15.26:0/2373387441 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f071009d6f0 0x7f07101c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.761+0000 7f0715f68700 1 --2- 172.21.15.26:0/2373387441 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f071009e000 0x7f07101c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.761+0000 7f0715f68700 1 -- 172.21.15.26:0/2373387441 >> 172.21.15.26:0/2373387441 conn(0x7f0710066f50 msgr2=0x7f071006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:59.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.761+0000 7f0715f68700 1 -- 172.21.15.26:0/2373387441 shutdown_connections 2023-10-01T07:59:59.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.761+0000 7f0715f68700 1 -- 172.21.15.26:0/2373387441 wait complete. 2023-10-01T07:59:59.775 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T07:59:59.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.783+0000 7f06b15bb700 1 -- 172.21.15.26:0/3998924231 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f06ac06c360 con 0x7f06ac09e000 2023-10-01T07:59:59.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.783+0000 7f06937fe700 1 -- 172.21.15.26:0/3998924231 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f06a0003cb0 con 0x7f06ac09e000 2023-10-01T07:59:59.783 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T07:59:59.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.785+0000 7f06b15bb700 1 -- 172.21.15.26:0/3998924231 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f06ac09e000 msgr2=0x7f06ac122b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T07:59:59.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.785+0000 7f06b15bb700 1 --2- 172.21.15.26:0/3998924231 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f06ac09e000 0x7f06ac122b20 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f06a000c4d0 tx=0x7f06a000c7e0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.785+0000 7f06b15bb700 1 -- 172.21.15.26:0/3998924231 shutdown_connections 2023-10-01T07:59:59.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.785+0000 7f06b15bb700 1 --2- 172.21.15.26:0/3998924231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06ac09e410 0x7f06ac123060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.785+0000 7f06b15bb700 1 --2- 172.21.15.26:0/3998924231 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f06ac09d6f0 0x7f06ac1225e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.785+0000 7f06b15bb700 1 --2- 172.21.15.26:0/3998924231 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f06ac09e000 0x7f06ac122b20 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T07:59:59.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.785+0000 7f06b15bb700 1 -- 172.21.15.26:0/3998924231 >> 172.21.15.26:0/3998924231 conn(0x7f06ac066f50 msgr2=0x7f06ac070f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T07:59:59.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.785+0000 7f06b15bb700 1 -- 172.21.15.26:0/3998924231 shutdown_connections 2023-10-01T07:59:59.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T07:59:59.785+0000 7f06b15bb700 1 -- 172.21.15.26:0/3998924231 wait complete. 2023-10-01T07:59:59.799 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:00.646 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:00.711 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:00.777 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:00.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.792+0000 7fe4790fc700 1 Processor -- start 2023-10-01T08:00:00.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.793+0000 7fe4790fc700 1 -- start start 2023-10-01T08:00:00.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.793+0000 7fe4790fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe4741345a0 0x7fe474136980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:00.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.793+0000 7fe4790fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe474136ec0 0x7fe4741392a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:00.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.793+0000 7fe4790fc700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe474099620 con 0x7fe4740984f0 2023-10-01T08:00:00.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.793+0000 7fe4790fc700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe47409a9e0 con 0x7fe4741345a0 2023-10-01T08:00:00.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.793+0000 7fe4790fc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe47409bce0 con 0x7fe474136ec0 2023-10-01T08:00:00.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.793+0000 7fe47259c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe4741345a0 0x7fe474136980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:00.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.793+0000 7fe47259c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe4741345a0 0x7fe474136980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35476/0 (socket says 172.21.15.26:35476) 2023-10-01T08:00:00.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.793+0000 7fe47259c700 1 -- 172.21.15.26:0/1775665451 learned_addr learned my addr 172.21.15.26:0/1775665451 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:00.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.793+0000 7fe47359e700 1 --2- 172.21.15.26:0/1775665451 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe474136ec0 0x7fe4741392a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:00.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.794+0000 7fe47259c700 1 -- 172.21.15.26:0/1775665451 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe474136ec0 msgr2=0x7fe4741392a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:00.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.794+0000 7fe47259c700 1 --2- 172.21.15.26:0/1775665451 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe474136ec0 0x7fe4741392a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:00.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.794+0000 7fe47259c700 1 -- 172.21.15.26:0/1775665451 >> v1:172.21.15.26:6789/0 conn(0x7fe4740984f0 legacy=0x7fe4740988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:00.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.794+0000 7fe47259c700 1 -- 172.21.15.26:0/1775665451 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47409aca0 con 0x7fe4741345a0 2023-10-01T08:00:00.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.794+0000 7fe47259c700 1 --2- 172.21.15.26:0/1775665451 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4741345a0 0x7fe474136980 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fe4680098f0 tx=0x7fe468009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dfe7363c09ba274 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:00.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.794+0000 7fe471d9b700 1 -- 172.21.15.26:0/1775665451 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe468011830 con 0x7fe4741345a0 2023-10-01T08:00:00.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.794+0000 7fe471d9b700 1 -- 172.21.15.26:0/1775665451 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe468011990 con 0x7fe4741345a0 2023-10-01T08:00:00.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.794+0000 7fe471d9b700 1 -- 172.21.15.26:0/1775665451 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe468011d20 con 0x7fe4741345a0 2023-10-01T08:00:00.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.795+0000 7fe4790fc700 1 -- 172.21.15.26:0/1775665451 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4741345a0 msgr2=0x7fe474136980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:00.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.795+0000 7fe4790fc700 1 --2- 172.21.15.26:0/1775665451 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4741345a0 0x7fe474136980 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fe4680098f0 tx=0x7fe468009c00 comp rx=0 tx=0).stop 2023-10-01T08:00:00.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.795+0000 7fe4790fc700 1 -- 172.21.15.26:0/1775665451 shutdown_connections 2023-10-01T08:00:00.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.795+0000 7fe4790fc700 1 --2- 172.21.15.26:0/1775665451 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe474136ec0 0x7fe4741392a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:00.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.795+0000 7fe4790fc700 1 --2- 172.21.15.26:0/1775665451 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4741345a0 0x7fe474136980 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:00.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.795+0000 7fe4790fc700 1 -- 172.21.15.26:0/1775665451 >> 172.21.15.26:0/1775665451 conn(0x7fe47409f470 msgr2=0x7fe4740a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:00.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.795+0000 7fe4790fc700 1 -- 172.21.15.26:0/1775665451 shutdown_connections 2023-10-01T08:00:00.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.795+0000 7fe4790fc700 1 -- 172.21.15.26:0/1775665451 wait complete. 2023-10-01T08:00:00.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.797+0000 7fe4790fc700 1 Processor -- start 2023-10-01T08:00:00.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.798+0000 7fe4790fc700 1 -- start start 2023-10-01T08:00:00.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.798+0000 7fe4790fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe4740984f0 0x7fe474126e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:00.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.798+0000 7fe4790fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4741345a0 0x7fe474127340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:00.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.798+0000 7fe4790fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe474136ec0 0x7fe474127880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:00.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.798+0000 7fe4790fc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe474131f90 con 0x7fe4741345a0 2023-10-01T08:00:00.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.798+0000 7fe4790fc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47412a640 con 0x7fe474136ec0 2023-10-01T08:00:00.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.798+0000 7fe4790fc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4740a1d20 con 0x7fe4740984f0 2023-10-01T08:00:00.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.798+0000 7fe472d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe4740984f0 0x7fe474126e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:00.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.799+0000 7fe47359e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe474136ec0 0x7fe474127880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:00.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.799+0000 7fe472d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe4740984f0 0x7fe474126e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56124/0 (socket says 172.21.15.26:56124) 2023-10-01T08:00:00.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.799+0000 7fe472d9d700 1 -- 172.21.15.26:0/1936569503 learned_addr learned my addr 172.21.15.26:0/1936569503 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:00.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.799+0000 7fe47259c700 1 --2- 172.21.15.26:0/1936569503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4741345a0 0x7fe474127340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:00.801 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:00.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.799+0000 7fe472d9d700 1 -- 172.21.15.26:0/1936569503 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe474136ec0 msgr2=0x7fe474127880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:00.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.799+0000 7fe472d9d700 1 --2- 172.21.15.26:0/1936569503 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe474136ec0 0x7fe474127880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:00.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.799+0000 7fe472d9d700 1 -- 172.21.15.26:0/1936569503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4741345a0 msgr2=0x7fe474127340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:00.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.799+0000 7fe472d9d700 1 --2- 172.21.15.26:0/1936569503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4741345a0 0x7fe474127340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:00.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.799+0000 7fe472d9d700 1 -- 172.21.15.26:0/1936569503 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe468009550 con 0x7fe4740984f0 2023-10-01T08:00:00.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.799+0000 7fe47359e700 1 --2- 172.21.15.26:0/1936569503 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe474136ec0 0x7fe474127880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:00.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.799+0000 7fe472d9d700 1 --2- 172.21.15.26:0/1936569503 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe4740984f0 0x7fe474126e00 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe46400c4e0 tx=0x7fe46400c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:00.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.799+0000 7fe45b7fe700 1 -- 172.21.15.26:0/1936569503 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4640052d0 con 0x7fe4740984f0 2023-10-01T08:00:00.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.799+0000 7fe45b7fe700 1 -- 172.21.15.26:0/1936569503 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe464005430 con 0x7fe4740984f0 2023-10-01T08:00:00.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.799+0000 7fe4790fc700 1 -- 172.21.15.26:0/1936569503 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe474129a60 con 0x7fe4740984f0 2023-10-01T08:00:00.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.799+0000 7fe45b7fe700 1 -- 172.21.15.26:0/1936569503 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4640038c0 con 0x7fe4740984f0 2023-10-01T08:00:00.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.800+0000 7fe4790fc700 1 -- 172.21.15.26:0/1936569503 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe474128340 con 0x7fe4740984f0 2023-10-01T08:00:00.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.801+0000 7fe45b7fe700 1 -- 172.21.15.26:0/1936569503 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe464003a20 con 0x7fe4740984f0 2023-10-01T08:00:00.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.801+0000 7fe4790fc700 1 -- 172.21.15.26:0/1936569503 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4741293f0 con 0x7fe4740984f0 2023-10-01T08:00:00.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.801+0000 7fe45b7fe700 1 -- 172.21.15.26:0/1936569503 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe46403ea80 con 0x7fe4740984f0 2023-10-01T08:00:00.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.810+0000 7fe45b7fe700 1 -- 172.21.15.26:0/1936569503 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe464019e60 con 0x7fe4740984f0 2023-10-01T08:00:00.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.864+0000 7fa883091700 1 Processor -- start 2023-10-01T08:00:00.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.864+0000 7fa883091700 1 -- start start 2023-10-01T08:00:00.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.865+0000 7fa883091700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa87c09d6f0 0x7fa87c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:00.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.865+0000 7fa883091700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa87c09e000 0x7fa87c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:00.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.865+0000 7fa883091700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa87c09e410 0x7fa87c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:00.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.865+0000 7fa883091700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa87c09f520 con 0x7fa87c09e000 2023-10-01T08:00:00.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.865+0000 7fa883091700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c09f130 con 0x7fa87c09e410 2023-10-01T08:00:00.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.865+0000 7fa883091700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c09e930 con 0x7fa87c09d6f0 2023-10-01T08:00:00.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.865+0000 7fa87bfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa87c09e000 0x7fa87c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:00.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.865+0000 7fa88162e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa87c09e410 0x7fa87c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:00.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.865+0000 7fa87bfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa87c09e000 0x7fa87c130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35486/0 (socket says 172.21.15.26:35486) 2023-10-01T08:00:00.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.865+0000 7fa87bfff700 1 -- 172.21.15.26:0/3478646796 learned_addr learned my addr 172.21.15.26:0/3478646796 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:00.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.865+0000 7fa880e2d700 1 --2- 172.21.15.26:0/3478646796 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa87c09d6f0 0x7fa87c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:00.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.866+0000 7fa87bfff700 1 -- 172.21.15.26:0/3478646796 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa87c09d6f0 msgr2=0x7fa87c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:00.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.866+0000 7fa87bfff700 1 --2- 172.21.15.26:0/3478646796 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa87c09d6f0 0x7fa87c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:00.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.866+0000 7fa87bfff700 1 -- 172.21.15.26:0/3478646796 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa87c09e410 msgr2=0x7fa87c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:00.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.866+0000 7fa87bfff700 1 --2- 172.21.15.26:0/3478646796 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa87c09e410 0x7fa87c130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:00.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.866+0000 7fa87bfff700 1 -- 172.21.15.26:0/3478646796 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87c09b2d0 con 0x7fa87c09e000 2023-10-01T08:00:00.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.866+0000 7fa880e2d700 1 --2- 172.21.15.26:0/3478646796 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa87c09d6f0 0x7fa87c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T08:00:00.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.866+0000 7fa88162e700 1 --2- 172.21.15.26:0/3478646796 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa87c09e410 0x7fa87c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:00.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.866+0000 7fa87bfff700 1 --2- 172.21.15.26:0/3478646796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa87c09e000 0x7fa87c130660 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fa868009920 tx=0x7fa868009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15e610688ee68fd2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:00.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.866+0000 7fa87b7fe700 1 -- 172.21.15.26:0/3478646796 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa868011830 con 0x7fa87c09e000 2023-10-01T08:00:00.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.866+0000 7fa87b7fe700 1 -- 172.21.15.26:0/3478646796 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa868011990 con 0x7fa87c09e000 2023-10-01T08:00:00.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.866+0000 7fa87b7fe700 1 -- 172.21.15.26:0/3478646796 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa868011d20 con 0x7fa87c09e000 2023-10-01T08:00:00.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.867+0000 7fa883091700 1 -- 172.21.15.26:0/3478646796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa87c09e000 msgr2=0x7fa87c130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:00.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.867+0000 7fa883091700 1 --2- 172.21.15.26:0/3478646796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa87c09e000 0x7fa87c130660 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fa868009920 tx=0x7fa868009c30 comp rx=0 tx=0).stop 2023-10-01T08:00:00.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.867+0000 7fa883091700 1 -- 172.21.15.26:0/3478646796 shutdown_connections 2023-10-01T08:00:00.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.867+0000 7fa883091700 1 --2- 172.21.15.26:0/3478646796 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa87c09e410 0x7fa87c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:00.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.867+0000 7fa883091700 1 --2- 172.21.15.26:0/3478646796 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa87c09d6f0 0x7fa87c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:00.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.867+0000 7fa883091700 1 --2- 172.21.15.26:0/3478646796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa87c09e000 0x7fa87c130660 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:00.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.867+0000 7fa883091700 1 -- 172.21.15.26:0/3478646796 >> 172.21.15.26:0/3478646796 conn(0x7fa87c066f50 msgr2=0x7fa87c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:00.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.867+0000 7fa883091700 1 -- 172.21.15.26:0/3478646796 shutdown_connections 2023-10-01T08:00:00.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.867+0000 7fa883091700 1 -- 172.21.15.26:0/3478646796 wait complete. 2023-10-01T08:00:00.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.869+0000 7fa883091700 1 Processor -- start 2023-10-01T08:00:00.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.869+0000 7fa883091700 1 -- start start 2023-10-01T08:00:00.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.870+0000 7fa883091700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa87c09d6f0 0x7fa87c1c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:00.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.870+0000 7fa883091700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa87c09e000 0x7fa87c1c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:00.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.870+0000 7fa883091700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa87c09e410 0x7fa87c1c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:00.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.870+0000 7fa883091700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c126880 con 0x7fa87c09e410 2023-10-01T08:00:00.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.870+0000 7fa883091700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c06b380 con 0x7fa87c09e000 2023-10-01T08:00:00.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.870+0000 7fa883091700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c09c770 con 0x7fa87c09d6f0 2023-10-01T08:00:00.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.870+0000 7fa87bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa87c09e000 0x7fa87c1c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:00.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.870+0000 7fa87bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa87c09e000 0x7fa87c1c89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44784/0 (socket says 172.21.15.26:44784) 2023-10-01T08:00:00.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.870+0000 7fa87bfff700 1 -- 172.21.15.26:0/1252174916 learned_addr learned my addr 172.21.15.26:0/1252174916 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:00.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.870+0000 7fa88162e700 1 --2- 172.21.15.26:0/1252174916 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa87c09e410 0x7fa87c1c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:00.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.870+0000 7fa880e2d700 1 --2- 172.21.15.26:0/1252174916 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa87c09d6f0 0x7fa87c1c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:00.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.871+0000 7fa88162e700 1 -- 172.21.15.26:0/1252174916 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa87c09d6f0 msgr2=0x7fa87c1c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:00.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.871+0000 7fa88162e700 1 --2- 172.21.15.26:0/1252174916 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa87c09d6f0 0x7fa87c1c8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:00.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.871+0000 7fa88162e700 1 -- 172.21.15.26:0/1252174916 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa87c09e000 msgr2=0x7fa87c1c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:00.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.871+0000 7fa88162e700 1 --2- 172.21.15.26:0/1252174916 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa87c09e000 0x7fa87c1c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:00.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.871+0000 7fa88162e700 1 -- 172.21.15.26:0/1252174916 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa874009a70 con 0x7fa87c09e410 2023-10-01T08:00:00.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.871+0000 7fa880e2d700 1 --2- 172.21.15.26:0/1252174916 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa87c09d6f0 0x7fa87c1c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:00.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.871+0000 7fa87bfff700 1 --2- 172.21.15.26:0/1252174916 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa87c09e000 0x7fa87c1c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:00.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.871+0000 7fa88162e700 1 --2- 172.21.15.26:0/1252174916 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa87c09e410 0x7fa87c1c8f00 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fa874009e50 tx=0x7fa87400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:00.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.871+0000 7fa8797fa700 1 -- 172.21.15.26:0/1252174916 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa874003a20 con 0x7fa87c09e410 2023-10-01T08:00:00.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.871+0000 7fa8797fa700 1 -- 172.21.15.26:0/1252174916 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87400f040 con 0x7fa87c09e410 2023-10-01T08:00:00.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.871+0000 7fa883091700 1 -- 172.21.15.26:0/1252174916 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa868009550 con 0x7fa87c09e410 2023-10-01T08:00:00.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.871+0000 7fa8797fa700 1 -- 172.21.15.26:0/1252174916 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa874003de0 con 0x7fa87c09e410 2023-10-01T08:00:00.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.871+0000 7fa883091700 1 -- 172.21.15.26:0/1252174916 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa87c06eb60 con 0x7fa87c09e410 2023-10-01T08:00:00.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.872+0000 7fa8797fa700 1 -- 172.21.15.26:0/1252174916 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa87400ca30 con 0x7fa87c09e410 2023-10-01T08:00:00.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.872+0000 7fa8797fa700 1 -- 172.21.15.26:0/1252174916 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa87403feb0 con 0x7fa87c09e410 2023-10-01T08:00:00.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.873+0000 7fa883091700 1 -- 172.21.15.26:0/1252174916 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa87c074ea0 con 0x7fa87c09e410 2023-10-01T08:00:00.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.878+0000 7fa8797fa700 1 -- 172.21.15.26:0/1252174916 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa87401b360 con 0x7fa87c09e410 2023-10-01T08:00:00.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.924+0000 7f6a55942700 1 Processor -- start 2023-10-01T08:00:00.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.924+0000 7f6a55942700 1 -- start start 2023-10-01T08:00:00.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.924+0000 7f6a55942700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6a5009d6f0 0x7f6a5009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:00.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.924+0000 7f6a55942700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6a5009e000 0x7f6a50130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:00.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.924+0000 7f6a55942700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a5009f130 con 0x7f6a5009e410 2023-10-01T08:00:00.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.924+0000 7f6a55942700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a5009f520 con 0x7f6a5009e000 2023-10-01T08:00:00.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.924+0000 7f6a55942700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5009e930 con 0x7f6a5009d6f0 2023-10-01T08:00:00.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.924+0000 7f6a4f7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6a5009e410 0x7f6a50130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37096/0 (socket says 172.21.15.26:37096) 2023-10-01T08:00:00.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.924+0000 7f6a4f7fe700 1 -- 172.21.15.26:0/1269187081 learned_addr learned my addr 172.21.15.26:0/1269187081 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:00.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.925+0000 7f6a4effd700 1 --2- 172.21.15.26:0/1269187081 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6a5009d6f0 0x7f6a5009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:00.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.925+0000 7f6a4dffb700 1 -- 172.21.15.26:0/1269187081 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 445155630 0 0) 0x7f6a5009f130 con 0x7f6a5009e410 2023-10-01T08:00:00.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.925+0000 7f6a4e7fc700 1 --2- 172.21.15.26:0/1269187081 >> v2:172.21.15.26:3300/0 conn(0x7f6a5009e000 0x7f6a50130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:00.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.925+0000 7f6a4dffb700 1 -- 172.21.15.26:0/1269187081 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a380035b0 con 0x7f6a5009e410 2023-10-01T08:00:00.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.925+0000 7f6a4effd700 1 -- 172.21.15.26:0/1269187081 >> v2:172.21.15.26:3300/0 conn(0x7f6a5009e000 msgr2=0x7f6a50130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:00.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.925+0000 7f6a4effd700 1 --2- 172.21.15.26:0/1269187081 >> v2:172.21.15.26:3300/0 conn(0x7f6a5009e000 0x7f6a50130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:00.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.925+0000 7f6a4effd700 1 -- 172.21.15.26:0/1269187081 >> v1:172.21.15.26:6789/0 conn(0x7f6a5009e410 legacy=0x7f6a50130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:00.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.925+0000 7f6a4effd700 1 -- 172.21.15.26:0/1269187081 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5009b2d0 con 0x7f6a5009d6f0 2023-10-01T08:00:00.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.925+0000 7f6a4e7fc700 1 --2- 172.21.15.26:0/1269187081 >> v2:172.21.15.26:3300/0 conn(0x7f6a5009e000 0x7f6a50130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:00.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.925+0000 7f6a4effd700 1 --2- 172.21.15.26:0/1269187081 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6a5009d6f0 0x7f6a5009dac0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f6a4000bb40 tx=0x7f6a4000be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f919ccebb555d1df server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:00.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.925+0000 7f6a4dffb700 1 -- 172.21.15.26:0/1269187081 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a480019f0 con 0x7f6a5009d6f0 2023-10-01T08:00:00.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.926+0000 7f6a4dffb700 1 -- 172.21.15.26:0/1269187081 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4000bec0 con 0x7f6a5009d6f0 2023-10-01T08:00:00.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.926+0000 7f6a4dffb700 1 -- 172.21.15.26:0/1269187081 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a40012ba0 con 0x7f6a5009d6f0 2023-10-01T08:00:00.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.926+0000 7f6a55942700 1 -- 172.21.15.26:0/1269187081 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6a5009d6f0 msgr2=0x7f6a5009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:00.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.926+0000 7f6a55942700 1 --2- 172.21.15.26:0/1269187081 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6a5009d6f0 0x7f6a5009dac0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f6a4000bb40 tx=0x7f6a4000be50 comp rx=0 tx=0).stop 2023-10-01T08:00:00.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.926+0000 7f6a55942700 1 -- 172.21.15.26:0/1269187081 shutdown_connections 2023-10-01T08:00:00.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.926+0000 7f6a55942700 1 --2- 172.21.15.26:0/1269187081 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6a5009d6f0 0x7f6a5009dac0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:00.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.926+0000 7f6a55942700 1 --2- 172.21.15.26:0/1269187081 >> v2:172.21.15.26:3300/0 conn(0x7f6a5009e000 0x7f6a50130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:00.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.926+0000 7f6a55942700 1 -- 172.21.15.26:0/1269187081 >> 172.21.15.26:0/1269187081 conn(0x7f6a50066f50 msgr2=0x7f6a5009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:00.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.926+0000 7f6a55942700 1 -- 172.21.15.26:0/1269187081 shutdown_connections 2023-10-01T08:00:00.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.926+0000 7f6a55942700 1 -- 172.21.15.26:0/1269187081 wait complete. 2023-10-01T08:00:00.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.927+0000 7f6a55942700 1 Processor -- start 2023-10-01T08:00:00.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.928+0000 7f6a55942700 1 -- start start 2023-10-01T08:00:00.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.928+0000 7f6a55942700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6a5009d6f0 0x7f6a5011e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:00.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.928+0000 7f6a55942700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a5009e000 0x7f6a5011e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:00.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.928+0000 7f6a55942700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6a5009e410 0x7f6a5011ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:00.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.928+0000 7f6a55942700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a50121d20 con 0x7f6a5009e000 2023-10-01T08:00:00.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.928+0000 7f6a55942700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5011f640 con 0x7f6a5009d6f0 2023-10-01T08:00:00.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.928+0000 7f6a55942700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5011fe10 con 0x7f6a5009e410 2023-10-01T08:00:00.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.928+0000 7f6a4effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6a5009d6f0 0x7f6a5011e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:00.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.928+0000 7f6a4effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6a5009d6f0 0x7f6a5011e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44816/0 (socket says 172.21.15.26:44816) 2023-10-01T08:00:00.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.928+0000 7f6a4effd700 1 -- 172.21.15.26:0/1998660681 learned_addr learned my addr 172.21.15.26:0/1998660681 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:00.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.928+0000 7f6a4e7fc700 1 --2- 172.21.15.26:0/1998660681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a5009e000 0x7f6a5011e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:00.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.928+0000 7f6a4f7fe700 1 --2- 172.21.15.26:0/1998660681 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6a5009e410 0x7f6a5011ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:00.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.929+0000 7f6a4effd700 1 -- 172.21.15.26:0/1998660681 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6a5009e410 msgr2=0x7f6a5011ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:00.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.929+0000 7f6a4effd700 1 --2- 172.21.15.26:0/1998660681 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6a5009e410 0x7f6a5011ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:00.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.929+0000 7f6a4effd700 1 -- 172.21.15.26:0/1998660681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a5009e000 msgr2=0x7f6a5011e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:00.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.929+0000 7f6a4effd700 1 --2- 172.21.15.26:0/1998660681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a5009e000 0x7f6a5011e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:00.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.929+0000 7f6a4effd700 1 -- 172.21.15.26:0/1998660681 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a440094a0 con 0x7f6a5009d6f0 2023-10-01T08:00:00.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.929+0000 7f6a4f7fe700 1 --2- 172.21.15.26:0/1998660681 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6a5009e410 0x7f6a5011ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T08:00:00.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.929+0000 7f6a4effd700 1 --2- 172.21.15.26:0/1998660681 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6a5009d6f0 0x7f6a5011e200 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f6a40008010 tx=0x7f6a40004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:00.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.929+0000 7f6a37fff700 1 -- 172.21.15.26:0/1998660681 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a40021070 con 0x7f6a5009d6f0 2023-10-01T08:00:00.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.929+0000 7f6a37fff700 1 -- 172.21.15.26:0/1998660681 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a40004560 con 0x7f6a5009d6f0 2023-10-01T08:00:00.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.929+0000 7f6a55942700 1 -- 172.21.15.26:0/1998660681 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a4000b740 con 0x7f6a5009d6f0 2023-10-01T08:00:00.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.929+0000 7f6a37fff700 1 -- 172.21.15.26:0/1998660681 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4000db90 con 0x7f6a5009d6f0 2023-10-01T08:00:00.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.929+0000 7f6a55942700 1 -- 172.21.15.26:0/1998660681 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a5009c700 con 0x7f6a5009d6f0 2023-10-01T08:00:00.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.931+0000 7f6a37fff700 1 -- 172.21.15.26:0/1998660681 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6a4000b040 con 0x7f6a5009d6f0 2023-10-01T08:00:00.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.931+0000 7f6a37fff700 1 -- 172.21.15.26:0/1998660681 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6a40044770 con 0x7f6a5009d6f0 2023-10-01T08:00:00.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.931+0000 7f6a55942700 1 -- 172.21.15.26:0/1998660681 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a50074ea0 con 0x7f6a5009d6f0 2023-10-01T08:00:00.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.936+0000 7f6a37fff700 1 -- 172.21.15.26:0/1998660681 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a4002e770 con 0x7f6a5009d6f0 2023-10-01T08:00:00.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.948+0000 7f6f39ef6700 1 Processor -- start 2023-10-01T08:00:00.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.948+0000 7f6f39ef6700 1 -- start start 2023-10-01T08:00:00.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.948+0000 7f6f39ef6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f340984f0 0x7f6f340988c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:00.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.948+0000 7f6f39ef6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6f3409d6f0 0x7f6f3409db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:00.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.948+0000 7f6f39ef6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f3409e040 0x7f6f341385c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:00.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.948+0000 7f6f39ef6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f34099620 con 0x7f6f3409d6f0 2023-10-01T08:00:00.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.948+0000 7f6f39ef6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3409aca0 con 0x7f6f340984f0 2023-10-01T08:00:00.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.948+0000 7f6f39ef6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3409a9e0 con 0x7f6f3409e040 2023-10-01T08:00:00.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.949+0000 7f6f337fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f340984f0 0x7f6f340988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:00.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.949+0000 7f6f337fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f340984f0 0x7f6f340988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44832/0 (socket says 172.21.15.26:44832) 2023-10-01T08:00:00.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.949+0000 7f6f337fe700 1 -- 172.21.15.26:0/854512759 learned_addr learned my addr 172.21.15.26:0/854512759 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:00.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.949+0000 7f6f337fe700 1 -- 172.21.15.26:0/854512759 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f3409e040 msgr2=0x7f6f341385c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:00.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.949+0000 7f6f337fe700 1 --2- 172.21.15.26:0/854512759 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f3409e040 0x7f6f341385c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:00.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.949+0000 7f6f337fe700 1 -- 172.21.15.26:0/854512759 >> v2:172.21.15.26:3300/0 conn(0x7f6f3409d6f0 msgr2=0x7f6f3409db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:00.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.949+0000 7f6f337fe700 1 --2- 172.21.15.26:0/854512759 >> v2:172.21.15.26:3300/0 conn(0x7f6f3409d6f0 0x7f6f3409db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:00.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.949+0000 7f6f337fe700 1 -- 172.21.15.26:0/854512759 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3409bce0 con 0x7f6f340984f0 2023-10-01T08:00:00.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.949+0000 7f6f337fe700 1 --2- 172.21.15.26:0/854512759 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f340984f0 0x7f6f340988c0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f6f24009920 tx=0x7f6f24009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f5362d379ae967c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:00.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.949+0000 7f6f32ffd700 1 -- 172.21.15.26:0/854512759 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2400ba20 con 0x7f6f340984f0 2023-10-01T08:00:00.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.949+0000 7f6f32ffd700 1 -- 172.21.15.26:0/854512759 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2400bb80 con 0x7f6f340984f0 2023-10-01T08:00:00.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.949+0000 7f6f32ffd700 1 -- 172.21.15.26:0/854512759 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f24009e70 con 0x7f6f340984f0 2023-10-01T08:00:00.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.950+0000 7f6f39ef6700 1 -- 172.21.15.26:0/854512759 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f340984f0 msgr2=0x7f6f340988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:00.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.950+0000 7f6f39ef6700 1 --2- 172.21.15.26:0/854512759 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f340984f0 0x7f6f340988c0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f6f24009920 tx=0x7f6f24009c30 comp rx=0 tx=0).stop 2023-10-01T08:00:00.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.950+0000 7f6f39ef6700 1 -- 172.21.15.26:0/854512759 shutdown_connections 2023-10-01T08:00:00.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.950+0000 7f6f39ef6700 1 --2- 172.21.15.26:0/854512759 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f3409e040 0x7f6f341385c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:00.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.950+0000 7f6f39ef6700 1 --2- 172.21.15.26:0/854512759 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f340984f0 0x7f6f340988c0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:00.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.950+0000 7f6f39ef6700 1 --2- 172.21.15.26:0/854512759 >> v2:172.21.15.26:3300/0 conn(0x7f6f3409d6f0 0x7f6f3409db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:00.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.950+0000 7f6f39ef6700 1 -- 172.21.15.26:0/854512759 >> 172.21.15.26:0/854512759 conn(0x7f6f3409f470 msgr2=0x7f6f340a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:00.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.950+0000 7f6f39ef6700 1 -- 172.21.15.26:0/854512759 shutdown_connections 2023-10-01T08:00:00.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.950+0000 7f6f39ef6700 1 -- 172.21.15.26:0/854512759 wait complete. 2023-10-01T08:00:00.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.951+0000 7f6f39ef6700 1 Processor -- start 2023-10-01T08:00:00.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.951+0000 7f6f39ef6700 1 -- start start 2023-10-01T08:00:00.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.952+0000 7f6f39ef6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f340984f0 0x7f6f3412af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:00.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.952+0000 7f6f39ef6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f3409d6f0 0x7f6f3412b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:00.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.952+0000 7f6f39ef6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f3409e040 0x7f6f3412b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:00.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.952+0000 7f6f39ef6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f340a1b50 con 0x7f6f3409e040 2023-10-01T08:00:00.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.952+0000 7f6f39ef6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3409a2b0 con 0x7f6f3409d6f0 2023-10-01T08:00:00.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.952+0000 7f6f39ef6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3412e390 con 0x7f6f340984f0 2023-10-01T08:00:00.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.952+0000 7f6f2bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f3409d6f0 0x7f6f3412b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:00.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.952+0000 7f6f337fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f340984f0 0x7f6f3412af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:00.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.952+0000 7f6f2bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f3409d6f0 0x7f6f3412b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44848/0 (socket says 172.21.15.26:44848) 2023-10-01T08:00:00.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.952+0000 7f6f2bfff700 1 -- 172.21.15.26:0/2159267476 learned_addr learned my addr 172.21.15.26:0/2159267476 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:00.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.952+0000 7f6f337fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f340984f0 0x7f6f3412af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56162/0 (socket says 172.21.15.26:56162) 2023-10-01T08:00:00.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.952+0000 7f6f33fff700 1 --2- 172.21.15.26:0/2159267476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f3409e040 0x7f6f3412b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:00.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.952+0000 7f6f2bfff700 1 -- 172.21.15.26:0/2159267476 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f340984f0 msgr2=0x7f6f3412af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:00.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.952+0000 7f6f2bfff700 1 --2- 172.21.15.26:0/2159267476 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f340984f0 0x7f6f3412af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:00.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.952+0000 7f6f2bfff700 1 -- 172.21.15.26:0/2159267476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f3409e040 msgr2=0x7f6f3412b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:00.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.952+0000 7f6f2bfff700 1 --2- 172.21.15.26:0/2159267476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f3409e040 0x7f6f3412b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:00.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.952+0000 7f6f2bfff700 1 -- 172.21.15.26:0/2159267476 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f24009550 con 0x7f6f3409d6f0 2023-10-01T08:00:00.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.953+0000 7f6f2bfff700 1 --2- 172.21.15.26:0/2159267476 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f3409d6f0 0x7f6f3412b440 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c00b500 tx=0x7f6f1c00b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:00.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.953+0000 7f6f30ff9700 1 -- 172.21.15.26:0/2159267476 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c011830 con 0x7f6f3409d6f0 2023-10-01T08:00:00.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.953+0000 7f6f30ff9700 1 -- 172.21.15.26:0/2159267476 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1c0119b0 con 0x7f6f3409d6f0 2023-10-01T08:00:00.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.953+0000 7f6f39ef6700 1 -- 172.21.15.26:0/2159267476 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f3412cf50 con 0x7f6f3409d6f0 2023-10-01T08:00:00.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.953+0000 7f6f30ff9700 1 -- 172.21.15.26:0/2159267476 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c011d60 con 0x7f6f3409d6f0 2023-10-01T08:00:00.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.953+0000 7f6f39ef6700 1 -- 172.21.15.26:0/2159267476 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f3412bec0 con 0x7f6f3409d6f0 2023-10-01T08:00:00.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.954+0000 7f6f30ff9700 1 -- 172.21.15.26:0/2159267476 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6f1c01a400 con 0x7f6f3409d6f0 2023-10-01T08:00:00.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.954+0000 7f6f30ff9700 1 -- 172.21.15.26:0/2159267476 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6f1c03f760 con 0x7f6f3409d6f0 2023-10-01T08:00:00.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.954+0000 7f6f39ef6700 1 -- 172.21.15.26:0/2159267476 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f340747f0 con 0x7f6f3409d6f0 2023-10-01T08:00:00.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:00.959+0000 7f6f30ff9700 1 -- 172.21.15.26:0/2159267476 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f1c015020 con 0x7f6f3409d6f0 2023-10-01T08:00:01.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.073+0000 7fe4790fc700 1 -- 172.21.15.26:0/1936569503 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe4740747f0 con 0x7fe4740984f0 2023-10-01T08:00:01.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.074+0000 7fe45b7fe700 1 -- 172.21.15.26:0/1936569503 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe464017030 con 0x7fe4740984f0 2023-10-01T08:00:01.075 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:01.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.076+0000 7fe4790fc700 1 -- 172.21.15.26:0/1936569503 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe4740984f0 msgr2=0x7fe474126e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:01.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.076+0000 7fe4790fc700 1 --2- 172.21.15.26:0/1936569503 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe4740984f0 0x7fe474126e00 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe46400c4e0 tx=0x7fe46400c7f0 comp rx=0 tx=0).stop 2023-10-01T08:00:01.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.076+0000 7fe4790fc700 1 -- 172.21.15.26:0/1936569503 shutdown_connections 2023-10-01T08:00:01.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.076+0000 7fe4790fc700 1 --2- 172.21.15.26:0/1936569503 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe474136ec0 0x7fe474127880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:01.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.076+0000 7fe4790fc700 1 --2- 172.21.15.26:0/1936569503 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe4740984f0 0x7fe474126e00 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:01.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.076+0000 7fe4790fc700 1 --2- 172.21.15.26:0/1936569503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4741345a0 0x7fe474127340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:01.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.076+0000 7fe4790fc700 1 -- 172.21.15.26:0/1936569503 >> 172.21.15.26:0/1936569503 conn(0x7fe47409f470 msgr2=0x7fe474135970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:01.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.076+0000 7fe4790fc700 1 -- 172.21.15.26:0/1936569503 shutdown_connections 2023-10-01T08:00:01.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.076+0000 7fe4790fc700 1 -- 172.21.15.26:0/1936569503 wait complete. 2023-10-01T08:00:01.092 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:01.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.135+0000 7fa883091700 1 -- 172.21.15.26:0/1252174916 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa87c1204f0 con 0x7fa87c09e410 2023-10-01T08:00:01.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.136+0000 7fa8797fa700 1 -- 172.21.15.26:0/1252174916 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa87402b090 con 0x7fa87c09e410 2023-10-01T08:00:01.136 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:01.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.138+0000 7fa883091700 1 -- 172.21.15.26:0/1252174916 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa87c09e410 msgr2=0x7fa87c1c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:01.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.138+0000 7fa883091700 1 --2- 172.21.15.26:0/1252174916 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa87c09e410 0x7fa87c1c8f00 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fa874009e50 tx=0x7fa87400c3a0 comp rx=0 tx=0).stop 2023-10-01T08:00:01.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.138+0000 7fa883091700 1 -- 172.21.15.26:0/1252174916 shutdown_connections 2023-10-01T08:00:01.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.138+0000 7fa883091700 1 --2- 172.21.15.26:0/1252174916 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa87c09e410 0x7fa87c1c8f00 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:01.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.138+0000 7fa883091700 1 --2- 172.21.15.26:0/1252174916 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa87c09d6f0 0x7fa87c1c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:01.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.138+0000 7fa883091700 1 --2- 172.21.15.26:0/1252174916 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa87c09e000 0x7fa87c1c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:01.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.138+0000 7fa883091700 1 -- 172.21.15.26:0/1252174916 >> 172.21.15.26:0/1252174916 conn(0x7fa87c066f50 msgr2=0x7fa87c119480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:01.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.138+0000 7fa883091700 1 -- 172.21.15.26:0/1252174916 shutdown_connections 2023-10-01T08:00:01.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.138+0000 7fa883091700 1 -- 172.21.15.26:0/1252174916 wait complete. 2023-10-01T08:00:01.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.146+0000 7f6a55942700 1 -- 172.21.15.26:0/1998660681 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6a50071f30 con 0x7f6a5009d6f0 2023-10-01T08:00:01.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.146+0000 7f6a37fff700 1 -- 172.21.15.26:0/1998660681 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6a4002b020 con 0x7f6a5009d6f0 2023-10-01T08:00:01.147 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:01.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.149+0000 7f6a55942700 1 -- 172.21.15.26:0/1998660681 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6a5009d6f0 msgr2=0x7f6a5011e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:01.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.149+0000 7f6a55942700 1 --2- 172.21.15.26:0/1998660681 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6a5009d6f0 0x7f6a5011e200 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f6a40008010 tx=0x7f6a40004750 comp rx=0 tx=0).stop 2023-10-01T08:00:01.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.150+0000 7f6a55942700 1 -- 172.21.15.26:0/1998660681 shutdown_connections 2023-10-01T08:00:01.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.150+0000 7f6a55942700 1 --2- 172.21.15.26:0/1998660681 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6a5009e410 0x7f6a5011ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:01.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.150+0000 7f6a55942700 1 --2- 172.21.15.26:0/1998660681 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6a5009d6f0 0x7f6a5011e200 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:01.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.150+0000 7f6a55942700 1 --2- 172.21.15.26:0/1998660681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a5009e000 0x7f6a5011e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:01.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.150+0000 7f6a55942700 1 -- 172.21.15.26:0/1998660681 >> 172.21.15.26:0/1998660681 conn(0x7f6a50066f50 msgr2=0x7f6a50130b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:01.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.150+0000 7f6a55942700 1 -- 172.21.15.26:0/1998660681 shutdown_connections 2023-10-01T08:00:01.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.150+0000 7f6a55942700 1 -- 172.21.15.26:0/1998660681 wait complete. 2023-10-01T08:00:01.153 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:01.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:01.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.176+0000 7f6f39ef6700 1 -- 172.21.15.26:0/2159267476 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6f3406b250 con 0x7f6f3409d6f0 2023-10-01T08:00:01.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.176+0000 7f6f30ff9700 1 -- 172.21.15.26:0/2159267476 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6f1c029090 con 0x7f6f3409d6f0 2023-10-01T08:00:01.177 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:01.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.179+0000 7f6f39ef6700 1 -- 172.21.15.26:0/2159267476 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f3409d6f0 msgr2=0x7f6f3412b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:01.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.179+0000 7f6f39ef6700 1 --2- 172.21.15.26:0/2159267476 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f3409d6f0 0x7f6f3412b440 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c00b500 tx=0x7f6f1c00b810 comp rx=0 tx=0).stop 2023-10-01T08:00:01.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.179+0000 7f6f39ef6700 1 -- 172.21.15.26:0/2159267476 shutdown_connections 2023-10-01T08:00:01.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.179+0000 7f6f39ef6700 1 --2- 172.21.15.26:0/2159267476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f3409e040 0x7f6f3412b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:01.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.179+0000 7f6f39ef6700 1 --2- 172.21.15.26:0/2159267476 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f340984f0 0x7f6f3412af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:01.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.179+0000 7f6f39ef6700 1 --2- 172.21.15.26:0/2159267476 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f3409d6f0 0x7f6f3412b440 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:01.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.179+0000 7f6f39ef6700 1 -- 172.21.15.26:0/2159267476 >> 172.21.15.26:0/2159267476 conn(0x7f6f3409f470 msgr2=0x7f6f340711c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:01.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.179+0000 7f6f39ef6700 1 -- 172.21.15.26:0/2159267476 shutdown_connections 2023-10-01T08:00:01.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:01.179+0000 7f6f39ef6700 1 -- 172.21.15.26:0/2159267476 wait complete. 2023-10-01T08:00:01.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:02.093 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:02.153 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:02.168 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:02.194 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:02.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.244+0000 7f49840ab700 1 Processor -- start 2023-10-01T08:00:02.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.245+0000 7f49840ab700 1 -- start start 2023-10-01T08:00:02.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.245+0000 7f49840ab700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f497c09d6f0 0x7f497c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:02.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.245+0000 7f49840ab700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f497c09e000 0x7f497c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:02.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.245+0000 7f49840ab700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f497c09f130 con 0x7f497c09e410 2023-10-01T08:00:02.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.246+0000 7f49840ab700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f497c09f520 con 0x7f497c09d6f0 2023-10-01T08:00:02.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.246+0000 7f49840ab700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f497c09e930 con 0x7f497c09e000 2023-10-01T08:00:02.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.246+0000 7f4981646700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f497c09e000 0x7f497c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:02.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.246+0000 7f4981e47700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f497c09d6f0 0x7f497c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:02.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.246+0000 7f4981e47700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f497c09d6f0 0x7f497c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35538/0 (socket says 172.21.15.26:35538) 2023-10-01T08:00:02.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.246+0000 7f4981646700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f497c09e000 0x7f497c130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44864/0 (socket says 172.21.15.26:44864) 2023-10-01T08:00:02.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.246+0000 7f4981e47700 1 -- 172.21.15.26:0/96391341 learned_addr learned my addr 172.21.15.26:0/96391341 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:02.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.246+0000 7f4981e47700 1 -- 172.21.15.26:0/96391341 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f497c09e000 msgr2=0x7f497c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:02.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.246+0000 7f4981e47700 1 --2- 172.21.15.26:0/96391341 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f497c09e000 0x7f497c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:02.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.246+0000 7f4981e47700 1 -- 172.21.15.26:0/96391341 >> v1:172.21.15.26:6789/0 conn(0x7f497c09e410 legacy=0x7f497c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:02.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.246+0000 7f4981e47700 1 -- 172.21.15.26:0/96391341 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497c09b2d0 con 0x7f497c09d6f0 2023-10-01T08:00:02.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.247+0000 7f4981e47700 1 --2- 172.21.15.26:0/96391341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f497c09d6f0 0x7f497c09dac0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f49780098f0 tx=0x7f4978009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61fb8af00ad0a620 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:02.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.247+0000 7f4980e45700 1 -- 172.21.15.26:0/96391341 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4978011830 con 0x7f497c09d6f0 2023-10-01T08:00:02.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.247+0000 7f4980e45700 1 -- 172.21.15.26:0/96391341 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4978011990 con 0x7f497c09d6f0 2023-10-01T08:00:02.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.247+0000 7f4980e45700 1 -- 172.21.15.26:0/96391341 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4978011d20 con 0x7f497c09d6f0 2023-10-01T08:00:02.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.248+0000 7f49840ab700 1 -- 172.21.15.26:0/96391341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f497c09d6f0 msgr2=0x7f497c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:02.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.248+0000 7f49840ab700 1 --2- 172.21.15.26:0/96391341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f497c09d6f0 0x7f497c09dac0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f49780098f0 tx=0x7f4978009c00 comp rx=0 tx=0).stop 2023-10-01T08:00:02.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.248+0000 7f49840ab700 1 -- 172.21.15.26:0/96391341 shutdown_connections 2023-10-01T08:00:02.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.248+0000 7f49840ab700 1 --2- 172.21.15.26:0/96391341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f497c09d6f0 0x7f497c09dac0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:02.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.248+0000 7f49840ab700 1 --2- 172.21.15.26:0/96391341 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f497c09e000 0x7f497c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:02.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.248+0000 7f49840ab700 1 -- 172.21.15.26:0/96391341 >> 172.21.15.26:0/96391341 conn(0x7f497c066f50 msgr2=0x7f497c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:02.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.248+0000 7f49840ab700 1 -- 172.21.15.26:0/96391341 shutdown_connections 2023-10-01T08:00:02.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.248+0000 7f49840ab700 1 -- 172.21.15.26:0/96391341 wait complete. 2023-10-01T08:00:02.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.250+0000 7f49840ab700 1 Processor -- start 2023-10-01T08:00:02.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.250+0000 7f49840ab700 1 -- start start 2023-10-01T08:00:02.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.250+0000 7f49840ab700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f497c09d6f0 0x7f497c06e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:02.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.250+0000 7f49840ab700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f497c09e000 0x7f497c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:02.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.251+0000 7f49840ab700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f497c09e410 0x7f497c06f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:02.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.251+0000 7f49840ab700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497c06fcd0 con 0x7f497c09e410 2023-10-01T08:00:02.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.251+0000 7f49840ab700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f497c125e30 con 0x7f497c09e000 2023-10-01T08:00:02.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.251+0000 7f49840ab700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f497c125890 con 0x7f497c09d6f0 2023-10-01T08:00:02.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.251+0000 7f4981e47700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f497c09d6f0 0x7f497c06e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:02.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.251+0000 7f4981e47700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f497c09d6f0 0x7f497c06e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56176/0 (socket says 172.21.15.26:56176) 2023-10-01T08:00:02.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.251+0000 7f4981e47700 1 -- 172.21.15.26:0/3783663625 learned_addr learned my addr 172.21.15.26:0/3783663625 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:02.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.251+0000 7f4981646700 1 --2- 172.21.15.26:0/3783663625 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f497c09e000 0x7f497c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:02.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.251+0000 7f4982648700 1 --2- 172.21.15.26:0/3783663625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f497c09e410 0x7f497c06f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:02.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.251+0000 7f4981e47700 1 -- 172.21.15.26:0/3783663625 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f497c09e000 msgr2=0x7f497c06edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:02.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.251+0000 7f4981e47700 1 --2- 172.21.15.26:0/3783663625 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f497c09e000 0x7f497c06edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:02.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.251+0000 7f4981e47700 1 -- 172.21.15.26:0/3783663625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f497c09e410 msgr2=0x7f497c06f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:02.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.251+0000 7f4981e47700 1 --2- 172.21.15.26:0/3783663625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f497c09e410 0x7f497c06f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:02.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.251+0000 7f4981e47700 1 -- 172.21.15.26:0/3783663625 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4978009550 con 0x7f497c09d6f0 2023-10-01T08:00:02.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.251+0000 7f4981646700 1 --2- 172.21.15.26:0/3783663625 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f497c09e000 0x7f497c06edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T08:00:02.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.251+0000 7f4982648700 1 --2- 172.21.15.26:0/3783663625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f497c09e410 0x7f497c06f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T08:00:02.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.252+0000 7f4981e47700 1 --2- 172.21.15.26:0/3783663625 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f497c09d6f0 0x7f497c06e870 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f4978000c00 tx=0x7f4978004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:02.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.252+0000 7f49727fc700 1 -- 172.21.15.26:0/3783663625 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4978004570 con 0x7f497c09d6f0 2023-10-01T08:00:02.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.252+0000 7f49727fc700 1 -- 172.21.15.26:0/3783663625 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497801f070 con 0x7f497c09d6f0 2023-10-01T08:00:02.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.252+0000 7f49727fc700 1 -- 172.21.15.26:0/3783663625 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49780038c0 con 0x7f497c09d6f0 2023-10-01T08:00:02.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.252+0000 7f49840ab700 1 -- 172.21.15.26:0/3783663625 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f497c0a1ca0 con 0x7f497c09d6f0 2023-10-01T08:00:02.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.252+0000 7f49840ab700 1 -- 172.21.15.26:0/3783663625 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f497c125b50 con 0x7f497c09d6f0 2023-10-01T08:00:02.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.253+0000 7f49840ab700 1 -- 172.21.15.26:0/3783663625 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f497c074ea0 con 0x7f497c09d6f0 2023-10-01T08:00:02.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.253+0000 7f49727fc700 1 -- 172.21.15.26:0/3783663625 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4978021030 con 0x7f497c09d6f0 2023-10-01T08:00:02.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.253+0000 7f49727fc700 1 -- 172.21.15.26:0/3783663625 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4978040dd0 con 0x7f497c09d6f0 2023-10-01T08:00:02.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.258+0000 7f49727fc700 1 -- 172.21.15.26:0/3783663625 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f497801a450 con 0x7f497c09d6f0 2023-10-01T08:00:02.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.305+0000 7fd2bf9f9700 1 Processor -- start 2023-10-01T08:00:02.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.305+0000 7fd2bf9f9700 1 -- start start 2023-10-01T08:00:02.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.306+0000 7fd2bf9f9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd2b8133420 0x7fd2b81337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:02.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.306+0000 7fd2bf9f9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2b8133e30 0x7fd2b812ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:02.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.306+0000 7fd2bf9f9700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2b806b990 con 0x7fd2b8134260 2023-10-01T08:00:02.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.306+0000 7fd2bf9f9700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b80a0590 con 0x7fd2b8133420 2023-10-01T08:00:02.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.306+0000 7fd2bf9f9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b809fb80 con 0x7fd2b8133e30 2023-10-01T08:00:02.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.306+0000 7fd2bcf94700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2b8133e30 0x7fd2b812ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:02.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.307+0000 7fd2bdf96700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd2b8134260 0x7fd2b81304d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37124/0 (socket says 172.21.15.26:37124) 2023-10-01T08:00:02.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.307+0000 7fd2bd795700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd2b8133420 0x7fd2b81337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:02.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.307+0000 7fd2bdf96700 1 -- 172.21.15.26:0/2175347877 learned_addr learned my addr 172.21.15.26:0/2175347877 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:02.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.307+0000 7fd2bcf94700 1 -- 172.21.15.26:0/2175347877 >> v2:172.21.15.26:3300/0 conn(0x7fd2b8133420 msgr2=0x7fd2b81337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:02.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.307+0000 7fd2bcf94700 1 --2- 172.21.15.26:0/2175347877 >> v2:172.21.15.26:3300/0 conn(0x7fd2b8133420 0x7fd2b81337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:02.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.307+0000 7fd2bcf94700 1 -- 172.21.15.26:0/2175347877 >> v1:172.21.15.26:6789/0 conn(0x7fd2b8134260 legacy=0x7fd2b81304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:02.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.307+0000 7fd2affff700 1 -- 172.21.15.26:0/2175347877 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 844088595 0 0) 0x7fd2b806b990 con 0x7fd2b8134260 2023-10-01T08:00:02.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.307+0000 7fd2bcf94700 1 -- 172.21.15.26:0/2175347877 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b80a0030 con 0x7fd2b8133e30 2023-10-01T08:00:02.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.307+0000 7fd2bcf94700 1 --2- 172.21.15.26:0/2175347877 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2b8133e30 0x7fd2b812ff90 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8009840 tx=0x7fd2a8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa27849ae84a6188 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:02.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.307+0000 7fd2affff700 1 -- 172.21.15.26:0/2175347877 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8011830 con 0x7fd2b8133e30 2023-10-01T08:00:02.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.308+0000 7fd2affff700 1 -- 172.21.15.26:0/2175347877 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a8011990 con 0x7fd2b8133e30 2023-10-01T08:00:02.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.308+0000 7fd2affff700 1 -- 172.21.15.26:0/2175347877 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8011d20 con 0x7fd2b8133e30 2023-10-01T08:00:02.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.309+0000 7fd2bf9f9700 1 -- 172.21.15.26:0/2175347877 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2b8133e30 msgr2=0x7fd2b812ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:02.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.309+0000 7fd2bf9f9700 1 --2- 172.21.15.26:0/2175347877 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2b8133e30 0x7fd2b812ff90 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8009840 tx=0x7fd2a8009b50 comp rx=0 tx=0).stop 2023-10-01T08:00:02.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.309+0000 7fd2bf9f9700 1 -- 172.21.15.26:0/2175347877 shutdown_connections 2023-10-01T08:00:02.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.309+0000 7fd2bf9f9700 1 --2- 172.21.15.26:0/2175347877 >> v2:172.21.15.26:3300/0 conn(0x7fd2b8133420 0x7fd2b81337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:02.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.309+0000 7fd2bf9f9700 1 --2- 172.21.15.26:0/2175347877 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2b8133e30 0x7fd2b812ff90 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:02.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.309+0000 7fd2bf9f9700 1 -- 172.21.15.26:0/2175347877 >> 172.21.15.26:0/2175347877 conn(0x7fd2b80a4210 msgr2=0x7fd2b80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:02.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.309+0000 7fd2bf9f9700 1 -- 172.21.15.26:0/2175347877 shutdown_connections 2023-10-01T08:00:02.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.309+0000 7fd2bf9f9700 1 -- 172.21.15.26:0/2175347877 wait complete. 2023-10-01T08:00:02.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.310+0000 7fd2bf9f9700 1 Processor -- start 2023-10-01T08:00:02.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.310+0000 7fd2bf9f9700 1 -- start start 2023-10-01T08:00:02.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.310+0000 7fd2bf9f9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2b8133420 0x7fd2b809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:02.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.311+0000 7fd2bf9f9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2b8133e30 0x7fd2b809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:02.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.311+0000 7fd2bf9f9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2b8134260 0x7fd2b809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:02.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.311+0000 7fd2bf9f9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b811fd00 con 0x7fd2b8134260 2023-10-01T08:00:02.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.311+0000 7fd2bf9f9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b8131500 con 0x7fd2b8133e30 2023-10-01T08:00:02.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.311+0000 7fd2bf9f9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b811fa40 con 0x7fd2b8133420 2023-10-01T08:00:02.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.311+0000 7fd2bdf96700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2b8134260 0x7fd2b809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:02.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.311+0000 7fd2bdf96700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2b8134260 0x7fd2b809cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35566/0 (socket says 172.21.15.26:35566) 2023-10-01T08:00:02.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.311+0000 7fd2bdf96700 1 -- 172.21.15.26:0/4250466455 learned_addr learned my addr 172.21.15.26:0/4250466455 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:02.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.311+0000 7fd2bcf94700 1 --2- 172.21.15.26:0/4250466455 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2b8133e30 0x7fd2b809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:02.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.311+0000 7fd2bdf96700 1 -- 172.21.15.26:0/4250466455 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2b8133420 msgr2=0x7fd2b809c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:02.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.311+0000 7fd2bdf96700 1 --2- 172.21.15.26:0/4250466455 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2b8133420 0x7fd2b809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:02.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.311+0000 7fd2bdf96700 1 -- 172.21.15.26:0/4250466455 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2b8133e30 msgr2=0x7fd2b809c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:02.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.311+0000 7fd2bdf96700 1 --2- 172.21.15.26:0/4250466455 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2b8133e30 0x7fd2b809c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:02.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.311+0000 7fd2bdf96700 1 -- 172.21.15.26:0/4250466455 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a80094a0 con 0x7fd2b8134260 2023-10-01T08:00:02.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.311+0000 7fd2bdf96700 1 --2- 172.21.15.26:0/4250466455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2b8134260 0x7fd2b809cf00 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fd2b000cc70 tx=0x7fd2b000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:02.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.312+0000 7fd2adffb700 1 -- 172.21.15.26:0/4250466455 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b000ad80 con 0x7fd2b8134260 2023-10-01T08:00:02.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.312+0000 7fd2adffb700 1 -- 172.21.15.26:0/4250466455 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b000ce70 con 0x7fd2b8134260 2023-10-01T08:00:02.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.312+0000 7fd2bf9f9700 1 -- 172.21.15.26:0/4250466455 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2b811ee10 con 0x7fd2b8134260 2023-10-01T08:00:02.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.312+0000 7fd2adffb700 1 -- 172.21.15.26:0/4250466455 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b00072f0 con 0x7fd2b8134260 2023-10-01T08:00:02.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.312+0000 7fd2bf9f9700 1 -- 172.21.15.26:0/4250466455 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b809db30 con 0x7fd2b8134260 2023-10-01T08:00:02.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.313+0000 7fd2bf9f9700 1 -- 172.21.15.26:0/4250466455 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2b8074ea0 con 0x7fd2b8134260 2023-10-01T08:00:02.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.313+0000 7fd2adffb700 1 -- 172.21.15.26:0/4250466455 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd2b0007450 con 0x7fd2b8134260 2023-10-01T08:00:02.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.313+0000 7fd2adffb700 1 -- 172.21.15.26:0/4250466455 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd2b003f240 con 0x7fd2b8134260 2023-10-01T08:00:02.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.323+0000 7fd2adffb700 1 -- 172.21.15.26:0/4250466455 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd2b001b360 con 0x7fd2b8134260 2023-10-01T08:00:02.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.350+0000 7f17c891b700 1 Processor -- start 2023-10-01T08:00:02.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.350+0000 7f17c891b700 1 -- start start 2023-10-01T08:00:02.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.351+0000 7f17c891b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f17c409d6f0 0x7f17c409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:02.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.351+0000 7f17c891b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f17c409e000 0x7f17c41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:02.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.351+0000 7f17c891b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17c409e410 0x7f17c4133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:02.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.351+0000 7f17c891b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c406b460 con 0x7f17c409d6f0 2023-10-01T08:00:02.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.351+0000 7f17c891b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c409b120 con 0x7f17c409e410 2023-10-01T08:00:02.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.351+0000 7f17c891b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17c409a7e0 con 0x7f17c409e000 2023-10-01T08:00:02.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.351+0000 7f17c259c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f17c409d6f0 0x7f17c409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:02.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.351+0000 7f17c259c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f17c409d6f0 0x7f17c409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35572/0 (socket says 172.21.15.26:35572) 2023-10-01T08:00:02.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.351+0000 7f17c259c700 1 -- 172.21.15.26:0/1447786660 learned_addr learned my addr 172.21.15.26:0/1447786660 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:02.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.351+0000 7f17c1d9b700 1 --2- 172.21.15.26:0/1447786660 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f17c409e000 0x7f17c41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:02.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.351+0000 7f17c2d9d700 1 --2- 172.21.15.26:0/1447786660 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17c409e410 0x7f17c4133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:02.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.352+0000 7f17c1d9b700 1 -- 172.21.15.26:0/1447786660 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17c409e410 msgr2=0x7f17c4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:02.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.352+0000 7f17c1d9b700 1 --2- 172.21.15.26:0/1447786660 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17c409e410 0x7f17c4133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:02.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.352+0000 7f17c1d9b700 1 -- 172.21.15.26:0/1447786660 >> v2:172.21.15.26:3300/0 conn(0x7f17c409d6f0 msgr2=0x7f17c409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:02.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.352+0000 7f17c1d9b700 1 --2- 172.21.15.26:0/1447786660 >> v2:172.21.15.26:3300/0 conn(0x7f17c409d6f0 0x7f17c409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:02.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.352+0000 7f17c1d9b700 1 -- 172.21.15.26:0/1447786660 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c409a500 con 0x7f17c409e000 2023-10-01T08:00:02.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.352+0000 7f17c259c700 1 --2- 172.21.15.26:0/1447786660 >> v2:172.21.15.26:3300/0 conn(0x7f17c409d6f0 0x7f17c409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:02.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.352+0000 7f17c1d9b700 1 --2- 172.21.15.26:0/1447786660 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f17c409e000 0x7f17c41339f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f17b8009870 tx=0x7f17b8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=300e1b991c33f9d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:02.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.352+0000 7f17c159a700 1 -- 172.21.15.26:0/1447786660 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b8011830 con 0x7f17c409e000 2023-10-01T08:00:02.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.352+0000 7f17c159a700 1 -- 172.21.15.26:0/1447786660 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b8011990 con 0x7f17c409e000 2023-10-01T08:00:02.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.352+0000 7f17c159a700 1 -- 172.21.15.26:0/1447786660 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b8011d20 con 0x7f17c409e000 2023-10-01T08:00:02.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.353+0000 7f17c891b700 1 -- 172.21.15.26:0/1447786660 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f17c409e000 msgr2=0x7f17c41339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:02.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.353+0000 7f17c891b700 1 --2- 172.21.15.26:0/1447786660 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f17c409e000 0x7f17c41339f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f17b8009870 tx=0x7f17b8009b80 comp rx=0 tx=0).stop 2023-10-01T08:00:02.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.353+0000 7f17c891b700 1 -- 172.21.15.26:0/1447786660 shutdown_connections 2023-10-01T08:00:02.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.353+0000 7f17c891b700 1 --2- 172.21.15.26:0/1447786660 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17c409e410 0x7f17c4133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:02.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.353+0000 7f17c891b700 1 --2- 172.21.15.26:0/1447786660 >> v2:172.21.15.26:3300/0 conn(0x7f17c409d6f0 0x7f17c409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:02.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.353+0000 7f17c891b700 1 --2- 172.21.15.26:0/1447786660 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f17c409e000 0x7f17c41339f0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:02.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.353+0000 7f17c891b700 1 -- 172.21.15.26:0/1447786660 >> 172.21.15.26:0/1447786660 conn(0x7f17c4066f50 msgr2=0x7f17c409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:02.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.353+0000 7f17c891b700 1 -- 172.21.15.26:0/1447786660 shutdown_connections 2023-10-01T08:00:02.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.354+0000 7f17c891b700 1 -- 172.21.15.26:0/1447786660 wait complete. 2023-10-01T08:00:02.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.355+0000 7f17c891b700 1 Processor -- start 2023-10-01T08:00:02.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.355+0000 7f17c891b700 1 -- start start 2023-10-01T08:00:02.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.355+0000 7f17c891b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17c409d6f0 0x7f17c41a5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:02.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.355+0000 7f17c891b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f17c409e000 0x7f17c41a62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:02.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.355+0000 7f17c891b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17c409e410 0x7f17c41a67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:02.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.355+0000 7f17c891b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c41aa200 con 0x7f17c409e410 2023-10-01T08:00:02.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.355+0000 7f17c891b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c41a9840 con 0x7f17c409d6f0 2023-10-01T08:00:02.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.355+0000 7f17c891b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17c41a8c10 con 0x7f17c409e000 2023-10-01T08:00:02.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.355+0000 7f17c259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17c409d6f0 0x7f17c41a5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:02.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.355+0000 7f17c259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17c409d6f0 0x7f17c41a5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44926/0 (socket says 172.21.15.26:44926) 2023-10-01T08:00:02.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.355+0000 7f17c259c700 1 -- 172.21.15.26:0/258764307 learned_addr learned my addr 172.21.15.26:0/258764307 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:02.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.355+0000 7f17c2d9d700 1 --2- 172.21.15.26:0/258764307 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17c409e410 0x7f17c41a67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:02.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.356+0000 7f17c1d9b700 1 --2- 172.21.15.26:0/258764307 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f17c409e000 0x7f17c41a62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:02.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.356+0000 7f17c259c700 1 -- 172.21.15.26:0/258764307 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f17c409e000 msgr2=0x7f17c41a62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:02.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.356+0000 7f17c259c700 1 --2- 172.21.15.26:0/258764307 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f17c409e000 0x7f17c41a62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:02.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.356+0000 7f17c259c700 1 -- 172.21.15.26:0/258764307 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17c409e410 msgr2=0x7f17c41a67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:02.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.356+0000 7f17c259c700 1 --2- 172.21.15.26:0/258764307 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17c409e410 0x7f17c41a67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:02.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.356+0000 7f17c259c700 1 -- 172.21.15.26:0/258764307 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b4009550 con 0x7f17c409d6f0 2023-10-01T08:00:02.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.356+0000 7f17c2d9d700 1 --2- 172.21.15.26:0/258764307 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17c409e410 0x7f17c41a67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:02.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.356+0000 7f17c259c700 1 --2- 172.21.15.26:0/258764307 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17c409d6f0 0x7f17c41a5d70 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f17b400ec40 tx=0x7f17b400ef50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:02.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.356+0000 7f17b2ffd700 1 -- 172.21.15.26:0/258764307 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b400c910 con 0x7f17c409d6f0 2023-10-01T08:00:02.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.357+0000 7fb578768700 1 Processor -- start 2023-10-01T08:00:02.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.357+0000 7fb578768700 1 -- start start 2023-10-01T08:00:02.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.356+0000 7f17b2ffd700 1 -- 172.21.15.26:0/258764307 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b400ca70 con 0x7f17c409d6f0 2023-10-01T08:00:02.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.356+0000 7f17b2ffd700 1 -- 172.21.15.26:0/258764307 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b400cde0 con 0x7f17c409d6f0 2023-10-01T08:00:02.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.356+0000 7f17c891b700 1 -- 172.21.15.26:0/258764307 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b80094a0 con 0x7f17c409d6f0 2023-10-01T08:00:02.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.356+0000 7f17c891b700 1 -- 172.21.15.26:0/258764307 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c41a7f10 con 0x7f17c409d6f0 2023-10-01T08:00:02.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.357+0000 7f17b2ffd700 1 -- 172.21.15.26:0/258764307 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f17b4013470 con 0x7f17c409d6f0 2023-10-01T08:00:02.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.358+0000 7f17b2ffd700 1 -- 172.21.15.26:0/258764307 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f17b403f920 con 0x7f17c409d6f0 2023-10-01T08:00:02.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.358+0000 7f17c891b700 1 -- 172.21.15.26:0/258764307 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a80052e0 con 0x7f17c409d6f0 2023-10-01T08:00:02.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.358+0000 7fb578768700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb57009d6f0 0x7fb57009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:02.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.358+0000 7fb578768700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb57009e410 0x7fb570134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:02.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.358+0000 7fb578768700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57009b120 con 0x7fb57009e000 2023-10-01T08:00:02.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.358+0000 7fb578768700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb57006b460 con 0x7fb57009e410 2023-10-01T08:00:02.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.358+0000 7fb578768700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb57009a7e0 con 0x7fb57009d6f0 2023-10-01T08:00:02.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.359+0000 7fb575d03700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb57009e000 0x7fb5701339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37134/0 (socket says 172.21.15.26:37134) 2023-10-01T08:00:02.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.359+0000 7fb575d03700 1 -- 172.21.15.26:0/1109923427 learned_addr learned my addr 172.21.15.26:0/1109923427 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:02.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.359+0000 7fb576504700 1 --2- 172.21.15.26:0/1109923427 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb57009d6f0 0x7fb57009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:02.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.359+0000 7fb576d05700 1 --2- 172.21.15.26:0/1109923427 >> v2:172.21.15.26:3300/0 conn(0x7fb57009e410 0x7fb570134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:02.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.359+0000 7fb576504700 1 -- 172.21.15.26:0/1109923427 >> v2:172.21.15.26:3300/0 conn(0x7fb57009e410 msgr2=0x7fb570134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:02.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.359+0000 7fb576504700 1 --2- 172.21.15.26:0/1109923427 >> v2:172.21.15.26:3300/0 conn(0x7fb57009e410 0x7fb570134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:02.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.359+0000 7fb576504700 1 -- 172.21.15.26:0/1109923427 >> v1:172.21.15.26:6789/0 conn(0x7fb57009e000 legacy=0x7fb5701339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:02.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.359+0000 7fb576504700 1 -- 172.21.15.26:0/1109923427 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57009a500 con 0x7fb57009d6f0 2023-10-01T08:00:02.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.359+0000 7fb576504700 1 --2- 172.21.15.26:0/1109923427 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb57009d6f0 0x7fb57009dac0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fb560009870 tx=0x7fb560009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab1c6de102762cb server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:02.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.359+0000 7fb575502700 1 -- 172.21.15.26:0/1109923427 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb560004230 con 0x7fb57009d6f0 2023-10-01T08:00:02.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.360+0000 7fb575502700 1 -- 172.21.15.26:0/1109923427 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb560004390 con 0x7fb57009d6f0 2023-10-01T08:00:02.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.360+0000 7fb575502700 1 -- 172.21.15.26:0/1109923427 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5600036a0 con 0x7fb57009d6f0 2023-10-01T08:00:02.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.360+0000 7fb578768700 1 -- 172.21.15.26:0/1109923427 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb57009d6f0 msgr2=0x7fb57009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:02.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.360+0000 7fb578768700 1 --2- 172.21.15.26:0/1109923427 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb57009d6f0 0x7fb57009dac0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fb560009870 tx=0x7fb560009b80 comp rx=0 tx=0).stop 2023-10-01T08:00:02.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.360+0000 7fb578768700 1 -- 172.21.15.26:0/1109923427 shutdown_connections 2023-10-01T08:00:02.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.360+0000 7fb578768700 1 --2- 172.21.15.26:0/1109923427 >> v2:172.21.15.26:3300/0 conn(0x7fb57009e410 0x7fb570134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:02.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.360+0000 7fb578768700 1 --2- 172.21.15.26:0/1109923427 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb57009d6f0 0x7fb57009dac0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:02.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.360+0000 7fb578768700 1 -- 172.21.15.26:0/1109923427 >> 172.21.15.26:0/1109923427 conn(0x7fb570066f50 msgr2=0x7fb57009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:02.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.361+0000 7fb578768700 1 -- 172.21.15.26:0/1109923427 shutdown_connections 2023-10-01T08:00:02.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.361+0000 7fb578768700 1 -- 172.21.15.26:0/1109923427 wait complete. 2023-10-01T08:00:02.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.362+0000 7fb578768700 1 Processor -- start 2023-10-01T08:00:02.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.362+0000 7fb578768700 1 -- start start 2023-10-01T08:00:02.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.363+0000 7fb578768700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb57009d6f0 0x7fb5701a5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:02.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.363+0000 7fb578768700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb57009e000 0x7fb5701a63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:02.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.363+0000 7f17b2ffd700 1 -- 172.21.15.26:0/258764307 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f17b4017070 con 0x7f17c409d6f0 2023-10-01T08:00:02.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.363+0000 7fb578768700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb57009e410 0x7fb5701a6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:02.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.363+0000 7fb578768700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5701a7340 con 0x7fb57009e000 2023-10-01T08:00:02.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.363+0000 7fb578768700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5701a7ac0 con 0x7fb57009d6f0 2023-10-01T08:00:02.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.363+0000 7fb578768700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5701a80e0 con 0x7fb57009e410 2023-10-01T08:00:02.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.363+0000 7fb575d03700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb57009e000 0x7fb5701a63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:02.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.363+0000 7fb575d03700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb57009e000 0x7fb5701a63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35590/0 (socket says 172.21.15.26:35590) 2023-10-01T08:00:02.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.363+0000 7fb575d03700 1 -- 172.21.15.26:0/4063304997 learned_addr learned my addr 172.21.15.26:0/4063304997 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:02.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.363+0000 7fb576d05700 1 --2- 172.21.15.26:0/4063304997 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb57009e410 0x7fb5701a6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:02.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.364+0000 7fb575d03700 1 -- 172.21.15.26:0/4063304997 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb57009e410 msgr2=0x7fb5701a6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:02.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.364+0000 7fb575d03700 1 --2- 172.21.15.26:0/4063304997 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb57009e410 0x7fb5701a6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:02.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.364+0000 7fb575d03700 1 -- 172.21.15.26:0/4063304997 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb57009d6f0 msgr2=0x7fb5701a5eb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T08:00:02.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.364+0000 7fb575d03700 1 --2- 172.21.15.26:0/4063304997 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb57009d6f0 0x7fb5701a5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:02.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.364+0000 7fb575d03700 1 -- 172.21.15.26:0/4063304997 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5600094a0 con 0x7fb57009e000 2023-10-01T08:00:02.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.364+0000 7fb576d05700 1 --2- 172.21.15.26:0/4063304997 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb57009e410 0x7fb5701a6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T08:00:02.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.364+0000 7fb575d03700 1 --2- 172.21.15.26:0/4063304997 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb57009e000 0x7fb5701a63f0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fb56c00c580 tx=0x7fb56c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:02.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.365+0000 7fb566ffd700 1 -- 172.21.15.26:0/4063304997 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c005d70 con 0x7fb57009e000 2023-10-01T08:00:02.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.365+0000 7fb566ffd700 1 -- 172.21.15.26:0/4063304997 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56c0070d0 con 0x7fb57009e000 2023-10-01T08:00:02.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.365+0000 7fb578768700 1 -- 172.21.15.26:0/4063304997 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5701a96f0 con 0x7fb57009e000 2023-10-01T08:00:02.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.365+0000 7fb566ffd700 1 -- 172.21.15.26:0/4063304997 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c007480 con 0x7fb57009e000 2023-10-01T08:00:02.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.365+0000 7fb578768700 1 -- 172.21.15.26:0/4063304997 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb57009c710 con 0x7fb57009e000 2023-10-01T08:00:02.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.366+0000 7fb566ffd700 1 -- 172.21.15.26:0/4063304997 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb56c0075e0 con 0x7fb57009e000 2023-10-01T08:00:02.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.366+0000 7fb578768700 1 -- 172.21.15.26:0/4063304997 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb570074ea0 con 0x7fb57009e000 2023-10-01T08:00:02.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.366+0000 7fb566ffd700 1 -- 172.21.15.26:0/4063304997 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb56c03ebc0 con 0x7fb57009e000 2023-10-01T08:00:02.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.375+0000 7fb566ffd700 1 -- 172.21.15.26:0/4063304997 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb56c00e280 con 0x7fb57009e000 2023-10-01T08:00:02.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.480+0000 7f49840ab700 1 -- 172.21.15.26:0/3783663625 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f497c06c360 con 0x7f497c09d6f0 2023-10-01T08:00:02.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.481+0000 7f49727fc700 1 -- 172.21.15.26:0/3783663625 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4978015030 con 0x7f497c09d6f0 2023-10-01T08:00:02.483 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:02.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.483+0000 7f49840ab700 1 -- 172.21.15.26:0/3783663625 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f497c09d6f0 msgr2=0x7f497c06e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:02.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.483+0000 7f49840ab700 1 --2- 172.21.15.26:0/3783663625 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f497c09d6f0 0x7f497c06e870 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f4978000c00 tx=0x7f4978004750 comp rx=0 tx=0).stop 2023-10-01T08:00:02.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.483+0000 7f49840ab700 1 -- 172.21.15.26:0/3783663625 shutdown_connections 2023-10-01T08:00:02.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.483+0000 7f49840ab700 1 --2- 172.21.15.26:0/3783663625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f497c09e410 0x7f497c06f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:02.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.483+0000 7f49840ab700 1 --2- 172.21.15.26:0/3783663625 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f497c09d6f0 0x7f497c06e870 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:02.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.483+0000 7f49840ab700 1 --2- 172.21.15.26:0/3783663625 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f497c09e000 0x7f497c06edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:02.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.483+0000 7f49840ab700 1 -- 172.21.15.26:0/3783663625 >> 172.21.15.26:0/3783663625 conn(0x7f497c066f50 msgr2=0x7f497c071180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:02.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.483+0000 7f49840ab700 1 -- 172.21.15.26:0/3783663625 shutdown_connections 2023-10-01T08:00:02.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.483+0000 7f49840ab700 1 -- 172.21.15.26:0/3783663625 wait complete. 2023-10-01T08:00:02.499 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:02.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.582+0000 7fb578768700 1 -- 172.21.15.26:0/4063304997 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb57006c360 con 0x7fb57009e000 2023-10-01T08:00:02.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.582+0000 7fb566ffd700 1 -- 172.21.15.26:0/4063304997 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb56c017070 con 0x7fb57009e000 2023-10-01T08:00:02.587 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:02.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.585+0000 7fb578768700 1 -- 172.21.15.26:0/4063304997 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb57009e000 msgr2=0x7fb5701a63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:02.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.585+0000 7fb578768700 1 --2- 172.21.15.26:0/4063304997 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb57009e000 0x7fb5701a63f0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fb56c00c580 tx=0x7fb56c00c940 comp rx=0 tx=0).stop 2023-10-01T08:00:02.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.585+0000 7fb578768700 1 -- 172.21.15.26:0/4063304997 shutdown_connections 2023-10-01T08:00:02.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.585+0000 7fb578768700 1 --2- 172.21.15.26:0/4063304997 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb57009e410 0x7fb5701a6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:02.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.585+0000 7fb578768700 1 --2- 172.21.15.26:0/4063304997 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb57009d6f0 0x7fb5701a5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:02.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.585+0000 7fb578768700 1 --2- 172.21.15.26:0/4063304997 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb57009e000 0x7fb5701a63f0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:02.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.585+0000 7fb578768700 1 -- 172.21.15.26:0/4063304997 >> 172.21.15.26:0/4063304997 conn(0x7fb570066f50 msgr2=0x7fb5701bacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:02.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.585+0000 7fb578768700 1 -- 172.21.15.26:0/4063304997 shutdown_connections 2023-10-01T08:00:02.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.585+0000 7fb578768700 1 -- 172.21.15.26:0/4063304997 wait complete. 2023-10-01T08:00:02.601 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:02.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.601+0000 7fd2bf9f9700 1 -- 172.21.15.26:0/4250466455 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd2b806b250 con 0x7fd2b8134260 2023-10-01T08:00:02.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.601+0000 7fd2adffb700 1 -- 172.21.15.26:0/4250466455 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd2b0018020 con 0x7fd2b8134260 2023-10-01T08:00:02.602 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:02.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.604+0000 7fd2bf9f9700 1 -- 172.21.15.26:0/4250466455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2b8134260 msgr2=0x7fd2b809cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:02.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.604+0000 7fd2bf9f9700 1 --2- 172.21.15.26:0/4250466455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2b8134260 0x7fd2b809cf00 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fd2b000cc70 tx=0x7fd2b000a340 comp rx=0 tx=0).stop 2023-10-01T08:00:02.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.604+0000 7fd2bf9f9700 1 -- 172.21.15.26:0/4250466455 shutdown_connections 2023-10-01T08:00:02.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.604+0000 7fd2bf9f9700 1 --2- 172.21.15.26:0/4250466455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2b8134260 0x7fd2b809cf00 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:02.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.604+0000 7fd2bf9f9700 1 --2- 172.21.15.26:0/4250466455 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2b8133420 0x7fd2b809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:02.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.604+0000 7fd2bf9f9700 1 --2- 172.21.15.26:0/4250466455 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2b8133e30 0x7fd2b809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:02.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.604+0000 7fd2bf9f9700 1 -- 172.21.15.26:0/4250466455 >> 172.21.15.26:0/4250466455 conn(0x7fd2b80a4210 msgr2=0x7fd2b80a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:02.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.604+0000 7fd2bf9f9700 1 -- 172.21.15.26:0/4250466455 shutdown_connections 2023-10-01T08:00:02.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.604+0000 7fd2bf9f9700 1 -- 172.21.15.26:0/4250466455 wait complete. 2023-10-01T08:00:02.619 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:02.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.626+0000 7f17c891b700 1 -- 172.21.15.26:0/258764307 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f17a8005590 con 0x7f17c409d6f0 2023-10-01T08:00:02.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.626+0000 7f17b2ffd700 1 -- 172.21.15.26:0/258764307 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f17b40232f0 con 0x7f17c409d6f0 2023-10-01T08:00:02.628 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:02.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.628+0000 7f17c891b700 1 -- 172.21.15.26:0/258764307 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17c409d6f0 msgr2=0x7f17c41a5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:02.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.629+0000 7f17c891b700 1 --2- 172.21.15.26:0/258764307 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17c409d6f0 0x7f17c41a5d70 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f17b400ec40 tx=0x7f17b400ef50 comp rx=0 tx=0).stop 2023-10-01T08:00:02.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.629+0000 7f17c891b700 1 -- 172.21.15.26:0/258764307 shutdown_connections 2023-10-01T08:00:02.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.629+0000 7f17c891b700 1 --2- 172.21.15.26:0/258764307 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17c409e410 0x7f17c41a67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:02.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.629+0000 7f17c891b700 1 --2- 172.21.15.26:0/258764307 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17c409d6f0 0x7f17c41a5d70 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:02.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.629+0000 7f17c891b700 1 --2- 172.21.15.26:0/258764307 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f17c409e000 0x7f17c41a62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:02.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.629+0000 7f17c891b700 1 -- 172.21.15.26:0/258764307 >> 172.21.15.26:0/258764307 conn(0x7f17c4066f50 msgr2=0x7f17c41bac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:02.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.629+0000 7f17c891b700 1 -- 172.21.15.26:0/258764307 shutdown_connections 2023-10-01T08:00:02.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:02.629+0000 7f17c891b700 1 -- 172.21.15.26:0/258764307 wait complete. 2023-10-01T08:00:02.643 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:03.500 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:03.602 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:03.620 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:03.644 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:03.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.649+0000 7fbfbcd87700 1 Processor -- start 2023-10-01T08:00:03.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.649+0000 7fbfbcd87700 1 -- start start 2023-10-01T08:00:03.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.650+0000 7fbfbcd87700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbfb809d6f0 0x7fbfb809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:03.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.650+0000 7fbfbcd87700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbfb809e000 0x7fbfb8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:03.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.650+0000 7fbfbcd87700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb809f130 con 0x7fbfb809e410 2023-10-01T08:00:03.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.650+0000 7fbfbcd87700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb809f520 con 0x7fbfb809e000 2023-10-01T08:00:03.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.650+0000 7fbfbcd87700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb809e930 con 0x7fbfb809d6f0 2023-10-01T08:00:03.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.650+0000 7fbfb659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbfb809d6f0 0x7fbfb809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:03.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.650+0000 7fbfb659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbfb809d6f0 0x7fbfb809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:38340/0 (socket says 172.21.15.26:38340) 2023-10-01T08:00:03.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.650+0000 7fbfb659c700 1 -- 172.21.15.26:0/3524318466 learned_addr learned my addr 172.21.15.26:0/3524318466 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:03.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.650+0000 7fbfb5d9b700 1 --2- 172.21.15.26:0/3524318466 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbfb809e000 0x7fbfb8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:03.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.651+0000 7fbfb659c700 1 -- 172.21.15.26:0/3524318466 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbfb809e000 msgr2=0x7fbfb8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:03.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.651+0000 7fbfb659c700 1 --2- 172.21.15.26:0/3524318466 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbfb809e000 0x7fbfb8130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:03.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.651+0000 7fbfb659c700 1 -- 172.21.15.26:0/3524318466 >> v1:172.21.15.26:6789/0 conn(0x7fbfb809e410 legacy=0x7fbfb8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:03.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.651+0000 7fbfb659c700 1 -- 172.21.15.26:0/3524318466 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb809b2d0 con 0x7fbfb809d6f0 2023-10-01T08:00:03.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.651+0000 7fbfb5d9b700 1 --2- 172.21.15.26:0/3524318466 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbfb809e000 0x7fbfb8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:03.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.651+0000 7fbfb659c700 1 --2- 172.21.15.26:0/3524318466 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbfb809d6f0 0x7fbfb809dac0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8009950 tx=0x7fbfa8009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0961d799c7d1811 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:03.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.651+0000 7fbfb559a700 1 -- 172.21.15.26:0/3524318466 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8011830 con 0x7fbfb809d6f0 2023-10-01T08:00:03.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.651+0000 7fbfb559a700 1 -- 172.21.15.26:0/3524318466 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa8011990 con 0x7fbfb809d6f0 2023-10-01T08:00:03.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.651+0000 7fbfb559a700 1 -- 172.21.15.26:0/3524318466 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8011d40 con 0x7fbfb809d6f0 2023-10-01T08:00:03.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.652+0000 7fbfbcd87700 1 -- 172.21.15.26:0/3524318466 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbfb809d6f0 msgr2=0x7fbfb809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:03.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.652+0000 7fbfbcd87700 1 --2- 172.21.15.26:0/3524318466 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbfb809d6f0 0x7fbfb809dac0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8009950 tx=0x7fbfa8009c60 comp rx=0 tx=0).stop 2023-10-01T08:00:03.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.652+0000 7fbfbcd87700 1 -- 172.21.15.26:0/3524318466 shutdown_connections 2023-10-01T08:00:03.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.652+0000 7fbfbcd87700 1 --2- 172.21.15.26:0/3524318466 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbfb809d6f0 0x7fbfb809dac0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:03.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.652+0000 7fbfbcd87700 1 --2- 172.21.15.26:0/3524318466 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbfb809e000 0x7fbfb8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:03.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.652+0000 7fbfbcd87700 1 -- 172.21.15.26:0/3524318466 >> 172.21.15.26:0/3524318466 conn(0x7fbfb8066f50 msgr2=0x7fbfb809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:03.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.652+0000 7fbfbcd87700 1 -- 172.21.15.26:0/3524318466 shutdown_connections 2023-10-01T08:00:03.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.652+0000 7fbfbcd87700 1 -- 172.21.15.26:0/3524318466 wait complete. 2023-10-01T08:00:03.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.654+0000 7fbfbcd87700 1 Processor -- start 2023-10-01T08:00:03.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.654+0000 7fbfbcd87700 1 -- start start 2023-10-01T08:00:03.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.655+0000 7fbfbcd87700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbfb809d6f0 0x7fbfb81201d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:03.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.655+0000 7fbfbcd87700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbfb809e000 0x7fbfb8120710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:03.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.655+0000 7fbfbcd87700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfb809e410 0x7fbfb8120c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:03.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.655+0000 7fbfbcd87700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb8123cf0 con 0x7fbfb809e410 2023-10-01T08:00:03.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.655+0000 7fbfbcd87700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb8121de0 con 0x7fbfb809e000 2023-10-01T08:00:03.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.655+0000 7fbfbcd87700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb80a1ea0 con 0x7fbfb809d6f0 2023-10-01T08:00:03.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.655+0000 7fbfb659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbfb809d6f0 0x7fbfb81201d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:03.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.655+0000 7fbfb659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbfb809d6f0 0x7fbfb81201d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:38354/0 (socket says 172.21.15.26:38354) 2023-10-01T08:00:03.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.655+0000 7fbfb659c700 1 -- 172.21.15.26:0/3620132211 learned_addr learned my addr 172.21.15.26:0/3620132211 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:03.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.655+0000 7fbfb5d9b700 1 --2- 172.21.15.26:0/3620132211 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbfb809e000 0x7fbfb8120710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:03.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.656+0000 7fbfb6d9d700 1 --2- 172.21.15.26:0/3620132211 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfb809e410 0x7fbfb8120c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:03.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.656+0000 7fbfb659c700 1 -- 172.21.15.26:0/3620132211 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbfb809e000 msgr2=0x7fbfb8120710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:03.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.656+0000 7fbfb659c700 1 --2- 172.21.15.26:0/3620132211 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbfb809e000 0x7fbfb8120710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:03.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.656+0000 7fbfb659c700 1 -- 172.21.15.26:0/3620132211 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfb809e410 msgr2=0x7fbfb8120c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:03.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.656+0000 7fbfb659c700 1 --2- 172.21.15.26:0/3620132211 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfb809e410 0x7fbfb8120c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:03.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.656+0000 7fbfb659c700 1 -- 172.21.15.26:0/3620132211 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfac0094a0 con 0x7fbfb809d6f0 2023-10-01T08:00:03.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.656+0000 7fbfb6d9d700 1 --2- 172.21.15.26:0/3620132211 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfb809e410 0x7fbfb8120c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T08:00:03.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.656+0000 7fbfb659c700 1 --2- 172.21.15.26:0/3620132211 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbfb809d6f0 0x7fbfb81201d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8014040 tx=0x7fbfa8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:03.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.656+0000 7fbfa6ffd700 1 -- 172.21.15.26:0/3620132211 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8004450 con 0x7fbfb809d6f0 2023-10-01T08:00:03.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.656+0000 7fbfa6ffd700 1 -- 172.21.15.26:0/3620132211 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa801f070 con 0x7fbfb809d6f0 2023-10-01T08:00:03.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.656+0000 7fbfbcd87700 1 -- 172.21.15.26:0/3620132211 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfa8009550 con 0x7fbfb809d6f0 2023-10-01T08:00:03.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.656+0000 7fbfa6ffd700 1 -- 172.21.15.26:0/3620132211 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa80038e0 con 0x7fbfb809d6f0 2023-10-01T08:00:03.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.656+0000 7fbfbcd87700 1 -- 172.21.15.26:0/3620132211 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfb8130110 con 0x7fbfb809d6f0 2023-10-01T08:00:03.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.657+0000 7fbfa6ffd700 1 -- 172.21.15.26:0/3620132211 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbfa8003a40 con 0x7fbfb809d6f0 2023-10-01T08:00:03.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.658+0000 7fbfa6ffd700 1 -- 172.21.15.26:0/3620132211 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbfa8021070 con 0x7fbfb809d6f0 2023-10-01T08:00:03.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.658+0000 7fbfbcd87700 1 -- 172.21.15.26:0/3620132211 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfb8074ea0 con 0x7fbfb809d6f0 2023-10-01T08:00:03.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.664+0000 7fbfa6ffd700 1 -- 172.21.15.26:0/3620132211 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbfa8015080 con 0x7fbfb809d6f0 2023-10-01T08:00:03.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.783+0000 7f128d4dd700 1 Processor -- start 2023-10-01T08:00:03.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.783+0000 7f128d4dd700 1 -- start start 2023-10-01T08:00:03.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.784+0000 7f128d4dd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1288130540 0x7f1288130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:03.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.784+0000 7f128d4dd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f128806fcf0 0x7f1288138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:03.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.784+0000 7f128d4dd700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12880716a0 con 0x7f1288130e50 2023-10-01T08:00:03.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.784+0000 7f128d4dd700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f128809a390 con 0x7f128806fcf0 2023-10-01T08:00:03.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.784+0000 7f128d4dd700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1288071290 con 0x7f1288130540 2023-10-01T08:00:03.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.784+0000 7f12877fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f128806fcf0 0x7f1288138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:03.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.784+0000 7f12877fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f128806fcf0 0x7f1288138570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56602/0 (socket says 172.21.15.26:56602) 2023-10-01T08:00:03.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.784+0000 7f12877fe700 1 -- 172.21.15.26:0/2433472687 learned_addr learned my addr 172.21.15.26:0/2433472687 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:03.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.785+0000 7f12877fe700 1 -- 172.21.15.26:0/2433472687 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1288130540 msgr2=0x7f1288130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:03.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.785+0000 7f12877fe700 1 --2- 172.21.15.26:0/2433472687 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1288130540 0x7f1288130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:03.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.785+0000 7f12877fe700 1 -- 172.21.15.26:0/2433472687 >> v1:172.21.15.26:6789/0 conn(0x7f1288130e50 legacy=0x7f128806f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:03.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.785+0000 7f12877fe700 1 -- 172.21.15.26:0/2433472687 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1288130340 con 0x7f128806fcf0 2023-10-01T08:00:03.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.785+0000 7f12877fe700 1 --2- 172.21.15.26:0/2433472687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f128806fcf0 0x7f1288138570 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f128000f370 tx=0x7f128000f680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50eb0ea92c741173 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:03.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.785+0000 7f1285ffb700 1 -- 172.21.15.26:0/2433472687 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1280012070 con 0x7f128806fcf0 2023-10-01T08:00:03.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.785+0000 7f1285ffb700 1 -- 172.21.15.26:0/2433472687 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128000d0d0 con 0x7f128806fcf0 2023-10-01T08:00:03.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.785+0000 7f1285ffb700 1 -- 172.21.15.26:0/2433472687 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128000d460 con 0x7f128806fcf0 2023-10-01T08:00:03.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.786+0000 7f128d4dd700 1 -- 172.21.15.26:0/2433472687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f128806fcf0 msgr2=0x7f1288138570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:03.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.786+0000 7f128d4dd700 1 --2- 172.21.15.26:0/2433472687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f128806fcf0 0x7f1288138570 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f128000f370 tx=0x7f128000f680 comp rx=0 tx=0).stop 2023-10-01T08:00:03.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.786+0000 7f128d4dd700 1 -- 172.21.15.26:0/2433472687 shutdown_connections 2023-10-01T08:00:03.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.786+0000 7f128d4dd700 1 --2- 172.21.15.26:0/2433472687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f128806fcf0 0x7f1288138570 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:03.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.786+0000 7f128d4dd700 1 --2- 172.21.15.26:0/2433472687 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1288130540 0x7f1288130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:03.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.786+0000 7f128d4dd700 1 -- 172.21.15.26:0/2433472687 >> 172.21.15.26:0/2433472687 conn(0x7f12880a2aa0 msgr2=0x7f12880a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:03.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.786+0000 7f128d4dd700 1 -- 172.21.15.26:0/2433472687 shutdown_connections 2023-10-01T08:00:03.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.786+0000 7f128d4dd700 1 -- 172.21.15.26:0/2433472687 wait complete. 2023-10-01T08:00:03.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.787+0000 7f128d4dd700 1 Processor -- start 2023-10-01T08:00:03.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.787+0000 7f128d4dd700 1 -- start start 2023-10-01T08:00:03.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.788+0000 7f128d4dd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f128806fcf0 0x7f128811a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:03.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.788+0000 7f128d4dd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1288130540 0x7f128811ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:03.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.788+0000 7f128d4dd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1288130e50 0x7f128811b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:03.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.788+0000 7f128d4dd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128811c200 con 0x7f1288130540 2023-10-01T08:00:03.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.788+0000 7f128d4dd700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12880718e0 con 0x7f128806fcf0 2023-10-01T08:00:03.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.788+0000 7f128d4dd700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f128811de30 con 0x7f1288130e50 2023-10-01T08:00:03.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.788+0000 7f1286ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f128806fcf0 0x7f128811a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:03.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.788+0000 7f1286ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f128806fcf0 0x7f128811a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44772/0 (socket says 172.21.15.26:44772) 2023-10-01T08:00:03.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.788+0000 7f1286ffd700 1 -- 172.21.15.26:0/386152591 learned_addr learned my addr 172.21.15.26:0/386152591 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:03.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.788+0000 7f12867fc700 1 --2- 172.21.15.26:0/386152591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1288130540 0x7f128811ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:03.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.788+0000 7f1286ffd700 1 -- 172.21.15.26:0/386152591 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1288130e50 msgr2=0x7f128811b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:03.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.788+0000 7f1286ffd700 1 --2- 172.21.15.26:0/386152591 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1288130e50 0x7f128811b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:03.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.788+0000 7f1286ffd700 1 -- 172.21.15.26:0/386152591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1288130540 msgr2=0x7f128811ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:03.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.788+0000 7f1286ffd700 1 --2- 172.21.15.26:0/386152591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1288130540 0x7f128811ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:03.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.788+0000 7f1286ffd700 1 -- 172.21.15.26:0/386152591 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128000f050 con 0x7f128806fcf0 2023-10-01T08:00:03.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.789+0000 7f1286ffd700 1 --2- 172.21.15.26:0/386152591 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f128806fcf0 0x7f128811a750 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f127800b530 tx=0x7f127800b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:03.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.789+0000 7f126f7fe700 1 -- 172.21.15.26:0/386152591 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1278011830 con 0x7f128806fcf0 2023-10-01T08:00:03.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.789+0000 7fceb2c43700 1 Processor -- start 2023-10-01T08:00:03.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.789+0000 7f126f7fe700 1 -- 172.21.15.26:0/386152591 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1278011990 con 0x7f128806fcf0 2023-10-01T08:00:03.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.789+0000 7f128d4dd700 1 -- 172.21.15.26:0/386152591 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12880a0d20 con 0x7f128806fcf0 2023-10-01T08:00:03.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.789+0000 7fceb2c43700 1 -- start start 2023-10-01T08:00:03.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.789+0000 7f126f7fe700 1 -- 172.21.15.26:0/386152591 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1278011d20 con 0x7f128806fcf0 2023-10-01T08:00:03.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.789+0000 7f128d4dd700 1 -- 172.21.15.26:0/386152591 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f128811d8a0 con 0x7f128806fcf0 2023-10-01T08:00:03.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.790+0000 7fceb2c43700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fceac1338a0 0x7fceac133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:03.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.790+0000 7fceb2c43700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fceac09e930 0x7fceac13b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:03.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.790+0000 7fceb2c43700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceac06ef30 con 0x7fceac09de50 2023-10-01T08:00:03.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.790+0000 7fceb2c43700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceac06fef0 con 0x7fceac1338a0 2023-10-01T08:00:03.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.790+0000 7fceb2c43700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceac1334b0 con 0x7fceac09e930 2023-10-01T08:00:03.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.790+0000 7f126f7fe700 1 -- 172.21.15.26:0/386152591 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f127801a400 con 0x7f128806fcf0 2023-10-01T08:00:03.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.790+0000 7fceb11e0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fceac09e930 0x7fceac13b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:03.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.790+0000 7f126f7fe700 1 -- 172.21.15.26:0/386152591 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f127803f720 con 0x7f128806fcf0 2023-10-01T08:00:03.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.790+0000 7fceb11e0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fceac09e930 0x7fceac13b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44780/0 (socket says 172.21.15.26:44780) 2023-10-01T08:00:03.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.790+0000 7fceb11e0700 1 -- 172.21.15.26:0/4147141910 learned_addr learned my addr 172.21.15.26:0/4147141910 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:03.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.791+0000 7f128d4dd700 1 -- 172.21.15.26:0/386152591 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1288074ea0 con 0x7f128806fcf0 2023-10-01T08:00:03.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.791+0000 7fceb11e0700 1 -- 172.21.15.26:0/4147141910 >> v2:172.21.15.26:3300/0 conn(0x7fceac1338a0 msgr2=0x7fceac133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:03.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.791+0000 7fceb11e0700 1 --2- 172.21.15.26:0/4147141910 >> v2:172.21.15.26:3300/0 conn(0x7fceac1338a0 0x7fceac133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:03.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.791+0000 7fceb11e0700 1 -- 172.21.15.26:0/4147141910 >> v1:172.21.15.26:6789/0 conn(0x7fceac09de50 legacy=0x7fceac09e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:03.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.791+0000 7fceb11e0700 1 -- 172.21.15.26:0/4147141910 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac06fc30 con 0x7fceac09e930 2023-10-01T08:00:03.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.791+0000 7fceb11e0700 1 --2- 172.21.15.26:0/4147141910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fceac09e930 0x7fceac13b740 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fcea4009e50 tx=0x7fcea400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=434023e042e74a54 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:03.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.794+0000 7f7dc94e0700 1 Processor -- start 2023-10-01T08:00:03.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.794+0000 7f7dc94e0700 1 -- start start 2023-10-01T08:00:03.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.795+0000 7f7dc94e0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7dc4131810 0x7f7dc4131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:03.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.795+0000 7f7dc94e0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7dc4099a40 0x7f7dc4099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:03.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.795+0000 7f7dc94e0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc409a850 con 0x7f7dc409a3b0 2023-10-01T08:00:03.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.795+0000 7f7dc94e0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc409b580 con 0x7f7dc4099a40 2023-10-01T08:00:03.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.795+0000 7f7dc94e0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc41313c0 con 0x7f7dc4131810 2023-10-01T08:00:03.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.795+0000 7f7dc27fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7dc4099a40 0x7f7dc4099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:03.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.795+0000 7f7dc27fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7dc4099a40 0x7f7dc4099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56630/0 (socket says 172.21.15.26:56630) 2023-10-01T08:00:03.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.795+0000 7f7dc27fc700 1 -- 172.21.15.26:0/2185618008 learned_addr learned my addr 172.21.15.26:0/2185618008 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:03.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.795+0000 7f7dc2ffd700 1 --2- 172.21.15.26:0/2185618008 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7dc4131810 0x7f7dc4131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:03.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.795+0000 7f7dc27fc700 1 -- 172.21.15.26:0/2185618008 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7dc4131810 msgr2=0x7f7dc4131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:03.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.795+0000 7f7dc27fc700 1 --2- 172.21.15.26:0/2185618008 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7dc4131810 0x7f7dc4131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:03.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.795+0000 7f7dc27fc700 1 -- 172.21.15.26:0/2185618008 >> v1:172.21.15.26:6789/0 conn(0x7f7dc409a3b0 legacy=0x7f7dc4138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:03.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.795+0000 7f7dc27fc700 1 -- 172.21.15.26:0/2185618008 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc406e8c0 con 0x7f7dc4099a40 2023-10-01T08:00:03.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.795+0000 7f7dc27fc700 1 --2- 172.21.15.26:0/2185618008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dc4099a40 0x7f7dc4099e70 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f7db8009920 tx=0x7f7db8009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94db2c62af13e1da server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:03.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.796+0000 7f7dc1ffb700 1 -- 172.21.15.26:0/2185618008 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db800ba20 con 0x7f7dc4099a40 2023-10-01T08:00:03.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.796+0000 7f7dc1ffb700 1 -- 172.21.15.26:0/2185618008 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db800bb80 con 0x7f7dc4099a40 2023-10-01T08:00:03.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.796+0000 7f7dc1ffb700 1 -- 172.21.15.26:0/2185618008 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db8009e70 con 0x7f7dc4099a40 2023-10-01T08:00:03.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.796+0000 7fceab7fe700 1 -- 172.21.15.26:0/4147141910 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea400e070 con 0x7fceac09e930 2023-10-01T08:00:03.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.796+0000 7fceab7fe700 1 -- 172.21.15.26:0/4147141910 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea4003a20 con 0x7fceac09e930 2023-10-01T08:00:03.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.796+0000 7fceab7fe700 1 -- 172.21.15.26:0/4147141910 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea4003dd0 con 0x7fceac09e930 2023-10-01T08:00:03.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.796+0000 7f126f7fe700 1 -- 172.21.15.26:0/386152591 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f12780193b0 con 0x7f128806fcf0 2023-10-01T08:00:03.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.796+0000 7f7dc94e0700 1 -- 172.21.15.26:0/2185618008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dc4099a40 msgr2=0x7f7dc4099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:03.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.796+0000 7f7dc94e0700 1 --2- 172.21.15.26:0/2185618008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dc4099a40 0x7f7dc4099e70 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f7db8009920 tx=0x7f7db8009c30 comp rx=0 tx=0).stop 2023-10-01T08:00:03.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.796+0000 7f7dc94e0700 1 -- 172.21.15.26:0/2185618008 shutdown_connections 2023-10-01T08:00:03.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.796+0000 7f7dc94e0700 1 --2- 172.21.15.26:0/2185618008 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7dc4131810 0x7f7dc4131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:03.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.796+0000 7f7dc94e0700 1 --2- 172.21.15.26:0/2185618008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dc4099a40 0x7f7dc4099e70 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:03.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.796+0000 7f7dc94e0700 1 -- 172.21.15.26:0/2185618008 >> 172.21.15.26:0/2185618008 conn(0x7f7dc40a2aa0 msgr2=0x7f7dc40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:03.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.797+0000 7f7dc94e0700 1 -- 172.21.15.26:0/2185618008 shutdown_connections 2023-10-01T08:00:03.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.797+0000 7f7dc94e0700 1 -- 172.21.15.26:0/2185618008 wait complete. 2023-10-01T08:00:03.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.797+0000 7fceb2c43700 1 -- 172.21.15.26:0/4147141910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fceac09e930 msgr2=0x7fceac13b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:03.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.797+0000 7fceb2c43700 1 --2- 172.21.15.26:0/4147141910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fceac09e930 0x7fceac13b740 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fcea4009e50 tx=0x7fcea400b330 comp rx=0 tx=0).stop 2023-10-01T08:00:03.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.797+0000 7fceb2c43700 1 -- 172.21.15.26:0/4147141910 shutdown_connections 2023-10-01T08:00:03.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.797+0000 7fceb2c43700 1 --2- 172.21.15.26:0/4147141910 >> v2:172.21.15.26:3300/0 conn(0x7fceac1338a0 0x7fceac133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:03.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.797+0000 7fceb2c43700 1 --2- 172.21.15.26:0/4147141910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fceac09e930 0x7fceac13b740 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:03.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.797+0000 7fceb2c43700 1 -- 172.21.15.26:0/4147141910 >> 172.21.15.26:0/4147141910 conn(0x7fceac0a2aa0 msgr2=0x7fceac0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:03.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.798+0000 7f7dc94e0700 1 Processor -- start 2023-10-01T08:00:03.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.798+0000 7f7dc94e0700 1 -- start start 2023-10-01T08:00:03.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.798+0000 7f7dc94e0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7dc4099a40 0x7f7dc411b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:03.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.798+0000 7f7dc94e0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dc409a3b0 0x7f7dc411bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:03.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.798+0000 7f7dc94e0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7dc4131810 0x7f7dc411c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:03.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.798+0000 7f7dc94e0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc411f060 con 0x7f7dc409a3b0 2023-10-01T08:00:03.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.798+0000 7f7dc94e0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc412eb70 con 0x7f7dc4099a40 2023-10-01T08:00:03.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.798+0000 7f7dc94e0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc411e5e0 con 0x7f7dc4131810 2023-10-01T08:00:03.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.798+0000 7fceb2c43700 1 -- 172.21.15.26:0/4147141910 shutdown_connections 2023-10-01T08:00:03.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.799+0000 7f7dc27fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dc409a3b0 0x7f7dc411bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:03.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.799+0000 7f7dc37fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7dc4131810 0x7f7dc411c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:03.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.799+0000 7f7dc27fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dc409a3b0 0x7f7dc411bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56646/0 (socket says 172.21.15.26:56646) 2023-10-01T08:00:03.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.799+0000 7f7dc27fc700 1 -- 172.21.15.26:0/3953237056 learned_addr learned my addr 172.21.15.26:0/3953237056 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:03.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.799+0000 7f7dc2ffd700 1 --2- 172.21.15.26:0/3953237056 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7dc4099a40 0x7f7dc411b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:03.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.799+0000 7f7dc27fc700 1 -- 172.21.15.26:0/3953237056 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7dc4131810 msgr2=0x7f7dc411c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:03.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.799+0000 7f7dc27fc700 1 --2- 172.21.15.26:0/3953237056 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7dc4131810 0x7f7dc411c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:03.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.799+0000 7f7dc27fc700 1 -- 172.21.15.26:0/3953237056 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7dc4099a40 msgr2=0x7f7dc411b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:03.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.799+0000 7f7dc27fc700 1 --2- 172.21.15.26:0/3953237056 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7dc4099a40 0x7f7dc411b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:03.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.799+0000 7f7dc27fc700 1 -- 172.21.15.26:0/3953237056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db8009550 con 0x7f7dc409a3b0 2023-10-01T08:00:03.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.799+0000 7f7dc2ffd700 1 --2- 172.21.15.26:0/3953237056 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7dc4099a40 0x7f7dc411b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T08:00:03.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.799+0000 7f7dc27fc700 1 --2- 172.21.15.26:0/3953237056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dc409a3b0 0x7f7dc411bd10 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f7db801b040 tx=0x7f7db8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:03.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.799+0000 7f7dab7fe700 1 -- 172.21.15.26:0/3953237056 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db80038a0 con 0x7f7dc409a3b0 2023-10-01T08:00:03.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.800+0000 7f7dab7fe700 1 -- 172.21.15.26:0/3953237056 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db8003a00 con 0x7f7dc409a3b0 2023-10-01T08:00:03.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.800+0000 7f7dab7fe700 1 -- 172.21.15.26:0/3953237056 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db8003db0 con 0x7f7dc409a3b0 2023-10-01T08:00:03.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.800+0000 7f7dc94e0700 1 -- 172.21.15.26:0/3953237056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc411ea30 con 0x7f7dc409a3b0 2023-10-01T08:00:03.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.800+0000 7f7dc94e0700 1 -- 172.21.15.26:0/3953237056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc406eb00 con 0x7f7dc409a3b0 2023-10-01T08:00:03.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.799+0000 7fceb2c43700 1 -- 172.21.15.26:0/4147141910 wait complete. 2023-10-01T08:00:03.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.800+0000 7fceb2c43700 1 Processor -- start 2023-10-01T08:00:03.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.800+0000 7fceb2c43700 1 -- start start 2023-10-01T08:00:03.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.801+0000 7f7dc94e0700 1 -- 172.21.15.26:0/3953237056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc4074ea0 con 0x7f7dc409a3b0 2023-10-01T08:00:03.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.801+0000 7f7dab7fe700 1 -- 172.21.15.26:0/3953237056 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7db801f070 con 0x7f7dc409a3b0 2023-10-01T08:00:03.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.801+0000 7fceb2c43700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fceac09de50 0x7fceac1d1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:03.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.801+0000 7fceb2c43700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fceac09e930 0x7fceac1d2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:03.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.801+0000 7fceb2c43700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fceac1338a0 0x7fceac1d4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:03.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.801+0000 7fceb2c43700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac06f6b0 con 0x7fceac09de50 2023-10-01T08:00:03.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.801+0000 7fceb2c43700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceac1d28c0 con 0x7fceac1338a0 2023-10-01T08:00:03.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.801+0000 7fceb2c43700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fceac12efc0 con 0x7fceac09e930 2023-10-01T08:00:03.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.801+0000 7f7dab7fe700 1 -- 172.21.15.26:0/3953237056 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7db8044cb0 con 0x7f7dc409a3b0 2023-10-01T08:00:03.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.802+0000 7fceb11e0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fceac1338a0 0x7fceac1d4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:03.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.802+0000 7fceabfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fceac09e930 0x7fceac1d2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:03.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.802+0000 7fceabfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fceac09e930 0x7fceac1d2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:38396/0 (socket says 172.21.15.26:38396) 2023-10-01T08:00:03.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.802+0000 7fceabfff700 1 -- 172.21.15.26:0/330111341 learned_addr learned my addr 172.21.15.26:0/330111341 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:03.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.802+0000 7fceb09df700 1 --2- 172.21.15.26:0/330111341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fceac09de50 0x7fceac1d1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:03.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.802+0000 7fceb11e0700 1 -- 172.21.15.26:0/330111341 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fceac09e930 msgr2=0x7fceac1d2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:03.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.802+0000 7fceb11e0700 1 --2- 172.21.15.26:0/330111341 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fceac09e930 0x7fceac1d2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:03.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.802+0000 7fceb11e0700 1 -- 172.21.15.26:0/330111341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fceac09de50 msgr2=0x7fceac1d1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:03.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.802+0000 7fceb11e0700 1 --2- 172.21.15.26:0/330111341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fceac09de50 0x7fceac1d1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:03.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.802+0000 7fceb11e0700 1 -- 172.21.15.26:0/330111341 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea4009b30 con 0x7fceac1338a0 2023-10-01T08:00:03.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.802+0000 7fceb11e0700 1 --2- 172.21.15.26:0/330111341 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fceac1338a0 0x7fceac1d4e60 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fcea4014000 tx=0x7fcea4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:03.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.803+0000 7fcea97fa700 1 -- 172.21.15.26:0/330111341 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea4004440 con 0x7fceac1338a0 2023-10-01T08:00:03.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.803+0000 7fcea97fa700 1 -- 172.21.15.26:0/330111341 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea40045a0 con 0x7fceac1338a0 2023-10-01T08:00:03.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.803+0000 7fceb2c43700 1 -- 172.21.15.26:0/330111341 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceac0a11f0 con 0x7fceac1338a0 2023-10-01T08:00:03.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.803+0000 7fcea97fa700 1 -- 172.21.15.26:0/330111341 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea4004950 con 0x7fceac1338a0 2023-10-01T08:00:03.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.803+0000 7fceb2c43700 1 -- 172.21.15.26:0/330111341 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceac12ed00 con 0x7fceac1338a0 2023-10-01T08:00:03.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.804+0000 7fcea97fa700 1 -- 172.21.15.26:0/330111341 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcea4012430 con 0x7fceac1338a0 2023-10-01T08:00:03.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.804+0000 7fcea97fa700 1 -- 172.21.15.26:0/330111341 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcea4040d30 con 0x7fceac1338a0 2023-10-01T08:00:03.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.805+0000 7fceb2c43700 1 -- 172.21.15.26:0/330111341 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceac074ea0 con 0x7fceac1338a0 2023-10-01T08:00:03.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.810+0000 7fcea97fa700 1 -- 172.21.15.26:0/330111341 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcea4017080 con 0x7fceac1338a0 2023-10-01T08:00:03.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.811+0000 7f7dab7fe700 1 -- 172.21.15.26:0/3953237056 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7db8020b70 con 0x7f7dc409a3b0 2023-10-01T08:00:03.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.923+0000 7fbfbcd87700 1 -- 172.21.15.26:0/3620132211 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbfb81237e0 con 0x7fbfb809d6f0 2023-10-01T08:00:03.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.924+0000 7fbfa6ffd700 1 -- 172.21.15.26:0/3620132211 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbfa80045b0 con 0x7fbfb809d6f0 2023-10-01T08:00:03.925 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:03.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.928+0000 7fbfbcd87700 1 -- 172.21.15.26:0/3620132211 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbfb809d6f0 msgr2=0x7fbfb81201d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:03.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.928+0000 7fbfbcd87700 1 --2- 172.21.15.26:0/3620132211 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbfb809d6f0 0x7fbfb81201d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8014040 tx=0x7fbfa8004750 comp rx=0 tx=0).stop 2023-10-01T08:00:03.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.928+0000 7fbfbcd87700 1 -- 172.21.15.26:0/3620132211 shutdown_connections 2023-10-01T08:00:03.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.928+0000 7fbfbcd87700 1 --2- 172.21.15.26:0/3620132211 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfb809e410 0x7fbfb8120c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:03.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.928+0000 7fbfbcd87700 1 --2- 172.21.15.26:0/3620132211 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbfb809d6f0 0x7fbfb81201d0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:03.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.928+0000 7fbfbcd87700 1 --2- 172.21.15.26:0/3620132211 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbfb809e000 0x7fbfb8120710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:03.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.928+0000 7fbfbcd87700 1 -- 172.21.15.26:0/3620132211 >> 172.21.15.26:0/3620132211 conn(0x7fbfb8066f50 msgr2=0x7fbfb806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:03.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.928+0000 7fbfbcd87700 1 -- 172.21.15.26:0/3620132211 shutdown_connections 2023-10-01T08:00:03.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:03.928+0000 7fbfbcd87700 1 -- 172.21.15.26:0/3620132211 wait complete. 2023-10-01T08:00:03.943 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:04.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:04.011+0000 7f128d4dd700 1 -- 172.21.15.26:0/386152591 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f128806b9e0 con 0x7f128806fcf0 2023-10-01T08:00:04.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:04.011+0000 7f126f7fe700 1 -- 172.21.15.26:0/386152591 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1278028020 con 0x7f128806fcf0 2023-10-01T08:00:04.012 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:04.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:04.014+0000 7f128d4dd700 1 -- 172.21.15.26:0/386152591 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f128806fcf0 msgr2=0x7f128811a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:04.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:04.014+0000 7f128d4dd700 1 --2- 172.21.15.26:0/386152591 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f128806fcf0 0x7f128811a750 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f127800b530 tx=0x7f127800b840 comp rx=0 tx=0).stop 2023-10-01T08:00:04.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:04.014+0000 7f128d4dd700 1 -- 172.21.15.26:0/386152591 shutdown_connections 2023-10-01T08:00:04.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:04.014+0000 7f128d4dd700 1 --2- 172.21.15.26:0/386152591 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1288130e50 0x7f128811b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:04.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:04.014+0000 7f128d4dd700 1 --2- 172.21.15.26:0/386152591 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f128806fcf0 0x7f128811a750 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:04.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:04.014+0000 7f128d4dd700 1 --2- 172.21.15.26:0/386152591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1288130540 0x7f128811ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:04.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:04.014+0000 7f128d4dd700 1 -- 172.21.15.26:0/386152591 >> 172.21.15.26:0/386152591 conn(0x7f12880a2aa0 msgr2=0x7f128812fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:04.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:04.014+0000 7f128d4dd700 1 -- 172.21.15.26:0/386152591 shutdown_connections 2023-10-01T08:00:04.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:04.014+0000 7f128d4dd700 1 -- 172.21.15.26:0/386152591 wait complete. 2023-10-01T08:00:04.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:04.018+0000 7fceb2c43700 1 -- 172.21.15.26:0/330111341 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fceac12f100 con 0x7fceac1338a0 2023-10-01T08:00:04.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:04.018+0000 7fcea97fa700 1 -- 172.21.15.26:0/330111341 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcea4011390 con 0x7fceac1338a0 2023-10-01T08:00:04.019 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:04.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:04.019+0000 7f7dc94e0700 1 -- 172.21.15.26:0/3953237056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7dc4071db0 con 0x7f7dc409a3b0 2023-10-01T08:00:04.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:04.020+0000 7f7dab7fe700 1 -- 172.21.15.26:0/3953237056 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7db801d020 con 0x7f7dc409a3b0 2023-10-01T08:00:04.020 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:04.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:04.021+0000 7fceb2c43700 1 -- 172.21.15.26:0/330111341 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fceac1338a0 msgr2=0x7fceac1d4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:04.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:04.021+0000 7fceb2c43700 1 --2- 172.21.15.26:0/330111341 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fceac1338a0 0x7fceac1d4e60 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fcea4014000 tx=0x7fcea4004ad0 comp rx=0 tx=0).stop 2023-10-01T08:00:04.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:04.021+0000 7fceb2c43700 1 -- 172.21.15.26:0/330111341 shutdown_connections 2023-10-01T08:00:04.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:04.021+0000 7fceb2c43700 1 --2- 172.21.15.26:0/330111341 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fceac1338a0 0x7fceac1d4e60 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:04.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:04.021+0000 7fceb2c43700 1 --2- 172.21.15.26:0/330111341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fceac09de50 0x7fceac1d1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:04.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:04.021+0000 7fceb2c43700 1 --2- 172.21.15.26:0/330111341 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fceac09e930 0x7fceac1d2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:04.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:04.021+0000 7fceb2c43700 1 -- 172.21.15.26:0/330111341 >> 172.21.15.26:0/330111341 conn(0x7fceac0a2aa0 msgr2=0x7fceac09ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:04.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:04.021+0000 7fceb2c43700 1 -- 172.21.15.26:0/330111341 shutdown_connections 2023-10-01T08:00:04.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:04.021+0000 7fceb2c43700 1 -- 172.21.15.26:0/330111341 wait complete. 2023-10-01T08:00:04.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:04.022+0000 7f7dc94e0700 1 -- 172.21.15.26:0/3953237056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dc409a3b0 msgr2=0x7f7dc411bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:04.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:04.022+0000 7f7dc94e0700 1 --2- 172.21.15.26:0/3953237056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dc409a3b0 0x7f7dc411bd10 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f7db801b040 tx=0x7f7db8004750 comp rx=0 tx=0).stop 2023-10-01T08:00:04.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:04.022+0000 7f7dc94e0700 1 -- 172.21.15.26:0/3953237056 shutdown_connections 2023-10-01T08:00:04.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:04.022+0000 7f7dc94e0700 1 --2- 172.21.15.26:0/3953237056 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7dc4131810 0x7f7dc411c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:04.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:04.022+0000 7f7dc94e0700 1 --2- 172.21.15.26:0/3953237056 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7dc4099a40 0x7f7dc411b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:04.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:04.022+0000 7f7dc94e0700 1 --2- 172.21.15.26:0/3953237056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dc409a3b0 0x7f7dc411bd10 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:04.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:04.022+0000 7f7dc94e0700 1 -- 172.21.15.26:0/3953237056 >> 172.21.15.26:0/3953237056 conn(0x7f7dc40a2aa0 msgr2=0x7f7dc4070d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:04.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:04.022+0000 7f7dc94e0700 1 -- 172.21.15.26:0/3953237056 shutdown_connections 2023-10-01T08:00:04.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:04.022+0000 7f7dc94e0700 1 -- 172.21.15.26:0/3953237056 wait complete. 2023-10-01T08:00:04.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:04.039 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:04.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:04.943 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:05.034 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:05.040 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:05.042 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:05.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.096+0000 7feb69880700 1 Processor -- start 2023-10-01T08:00:05.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.096+0000 7feb69880700 1 -- start start 2023-10-01T08:00:05.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.097+0000 7feb69880700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb6409d6f0 0x7feb6409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:05.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.097+0000 7feb69880700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb6409e000 0x7feb64130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:05.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.097+0000 7feb69880700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb6409f130 con 0x7feb6409e410 2023-10-01T08:00:05.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.097+0000 7feb69880700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb6409f520 con 0x7feb6409d6f0 2023-10-01T08:00:05.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.097+0000 7feb69880700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb6409e930 con 0x7feb6409e000 2023-10-01T08:00:05.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.097+0000 7feb62ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb6409d6f0 0x7feb6409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:05.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.097+0000 7feb627fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb6409e000 0x7feb64130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:05.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.097+0000 7feb62ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb6409d6f0 0x7feb6409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44796/0 (socket says 172.21.15.26:44796) 2023-10-01T08:00:05.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.097+0000 7feb62ffd700 1 -- 172.21.15.26:0/3828090697 learned_addr learned my addr 172.21.15.26:0/3828090697 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:05.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.097+0000 7feb62ffd700 1 -- 172.21.15.26:0/3828090697 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb6409e000 msgr2=0x7feb64130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:05.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.097+0000 7feb62ffd700 1 --2- 172.21.15.26:0/3828090697 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb6409e000 0x7feb64130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.097+0000 7feb62ffd700 1 -- 172.21.15.26:0/3828090697 >> v1:172.21.15.26:6789/0 conn(0x7feb6409e410 legacy=0x7feb64130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:05.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.097+0000 7feb62ffd700 1 -- 172.21.15.26:0/3828090697 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb6409b2d0 con 0x7feb6409d6f0 2023-10-01T08:00:05.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.098+0000 7feb62ffd700 1 --2- 172.21.15.26:0/3828090697 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb6409d6f0 0x7feb6409dac0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7feb5400b9d0 tx=0x7feb5400bce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8234cd5fa85d8d35 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:05.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.098+0000 7feb61ffb700 1 -- 172.21.15.26:0/3828090697 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5400cc20 con 0x7feb6409d6f0 2023-10-01T08:00:05.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.098+0000 7feb61ffb700 1 -- 172.21.15.26:0/3828090697 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5400cd80 con 0x7feb6409d6f0 2023-10-01T08:00:05.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.098+0000 7feb61ffb700 1 -- 172.21.15.26:0/3828090697 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb54004230 con 0x7feb6409d6f0 2023-10-01T08:00:05.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.099+0000 7feb69880700 1 -- 172.21.15.26:0/3828090697 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb6409d6f0 msgr2=0x7feb6409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:05.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.099+0000 7feb69880700 1 --2- 172.21.15.26:0/3828090697 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb6409d6f0 0x7feb6409dac0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7feb5400b9d0 tx=0x7feb5400bce0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.099+0000 7feb69880700 1 -- 172.21.15.26:0/3828090697 shutdown_connections 2023-10-01T08:00:05.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.099+0000 7feb69880700 1 --2- 172.21.15.26:0/3828090697 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb6409d6f0 0x7feb6409dac0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.099+0000 7feb69880700 1 --2- 172.21.15.26:0/3828090697 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb6409e000 0x7feb64130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.099+0000 7feb69880700 1 -- 172.21.15.26:0/3828090697 >> 172.21.15.26:0/3828090697 conn(0x7feb64066f50 msgr2=0x7feb6409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:05.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.099+0000 7feb69880700 1 -- 172.21.15.26:0/3828090697 shutdown_connections 2023-10-01T08:00:05.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.099+0000 7feb69880700 1 -- 172.21.15.26:0/3828090697 wait complete. 2023-10-01T08:00:05.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.101+0000 7feb69880700 1 Processor -- start 2023-10-01T08:00:05.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.101+0000 7feb69880700 1 -- start start 2023-10-01T08:00:05.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.102+0000 7feb69880700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb6409d6f0 0x7feb6411df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:05.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.102+0000 7feb69880700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb6409e000 0x7feb6411e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:05.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.102+0000 7feb69880700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb6409e410 0x7feb6411e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:05.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.102+0000 7feb69880700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb64130310 con 0x7feb6409e410 2023-10-01T08:00:05.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.102+0000 7feb69880700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb6411f390 con 0x7feb6409e000 2023-10-01T08:00:05.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.102+0000 7feb69880700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb64120d90 con 0x7feb6409d6f0 2023-10-01T08:00:05.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.102+0000 7feb627fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb6409e000 0x7feb6411e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:05.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.102+0000 7feb62ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb6409d6f0 0x7feb6411df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:05.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.102+0000 7feb627fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb6409e000 0x7feb6411e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44812/0 (socket says 172.21.15.26:44812) 2023-10-01T08:00:05.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.102+0000 7feb627fc700 1 -- 172.21.15.26:0/297170668 learned_addr learned my addr 172.21.15.26:0/297170668 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:05.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.102+0000 7feb637fe700 1 --2- 172.21.15.26:0/297170668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb6409e410 0x7feb6411e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:05.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.102+0000 7feb627fc700 1 -- 172.21.15.26:0/297170668 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb6409d6f0 msgr2=0x7feb6411df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:05.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.102+0000 7feb627fc700 1 --2- 172.21.15.26:0/297170668 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb6409d6f0 0x7feb6411df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.102+0000 7feb627fc700 1 -- 172.21.15.26:0/297170668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb6409e410 msgr2=0x7feb6411e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:05.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.102+0000 7feb627fc700 1 --2- 172.21.15.26:0/297170668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb6409e410 0x7feb6411e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.102+0000 7feb627fc700 1 -- 172.21.15.26:0/297170668 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb5400b600 con 0x7feb6409e000 2023-10-01T08:00:05.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.103+0000 7feb627fc700 1 --2- 172.21.15.26:0/297170668 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb6409e000 0x7feb6411e470 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7feb5800bad0 tx=0x7feb5800bde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:05.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.103+0000 7feb4bfff700 1 -- 172.21.15.26:0/297170668 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb580119d0 con 0x7feb6409e000 2023-10-01T08:00:05.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.103+0000 7feb4bfff700 1 -- 172.21.15.26:0/297170668 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb58013040 con 0x7feb6409e000 2023-10-01T08:00:05.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.103+0000 7feb4bfff700 1 -- 172.21.15.26:0/297170668 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb58011d30 con 0x7feb6409e000 2023-10-01T08:00:05.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.103+0000 7feb69880700 1 -- 172.21.15.26:0/297170668 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb64120120 con 0x7feb6409e000 2023-10-01T08:00:05.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.103+0000 7feb69880700 1 -- 172.21.15.26:0/297170668 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb640a1d00 con 0x7feb6409e000 2023-10-01T08:00:05.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.104+0000 7feb4bfff700 1 -- 172.21.15.26:0/297170668 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feb58019400 con 0x7feb6409e000 2023-10-01T08:00:05.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.104+0000 7feb69880700 1 -- 172.21.15.26:0/297170668 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb6409c700 con 0x7feb6409e000 2023-10-01T08:00:05.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.104+0000 7feb4bfff700 1 -- 172.21.15.26:0/297170668 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7feb58043310 con 0x7feb6409e000 2023-10-01T08:00:05.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.111+0000 7feb4bfff700 1 -- 172.21.15.26:0/297170668 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feb5801e020 con 0x7feb6409e000 2023-10-01T08:00:05.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.182+0000 7f248eafc700 1 Processor -- start 2023-10-01T08:00:05.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.182+0000 7f248eafc700 1 -- start start 2023-10-01T08:00:05.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.183+0000 7f248eafc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f24881305f0 0x7f24881309c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:05.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.183+0000 7f248eafc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f248806f660 0x7f248806fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:05.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.183+0000 7f248eafc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f248806ff90 0x7f2488137530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:05.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.183+0000 7f248eafc700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24881301c0 con 0x7f24881305f0 2023-10-01T08:00:05.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.183+0000 7f248eafc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2488071ff0 con 0x7f248806ff90 2023-10-01T08:00:05.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.183+0000 7f248eafc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2488070e70 con 0x7f248806f660 2023-10-01T08:00:05.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.184+0000 7f248d099700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f248806ff90 0x7f2488137530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:05.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.184+0000 7f248d099700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f248806ff90 0x7f2488137530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44820/0 (socket says 172.21.15.26:44820) 2023-10-01T08:00:05.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.184+0000 7f248c898700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f24881305f0 0x7f24881309c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:05.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.184+0000 7f248d099700 1 -- 172.21.15.26:0/4102949137 learned_addr learned my addr 172.21.15.26:0/4102949137 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:05.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.184+0000 7f2487fff700 1 --2- 172.21.15.26:0/4102949137 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f248806f660 0x7f248806fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:05.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.184+0000 7f248d099700 1 -- 172.21.15.26:0/4102949137 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f248806f660 msgr2=0x7f248806fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:05.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.184+0000 7f248d099700 1 --2- 172.21.15.26:0/4102949137 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f248806f660 0x7f248806fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.184+0000 7f248d099700 1 -- 172.21.15.26:0/4102949137 >> v2:172.21.15.26:3300/0 conn(0x7f24881305f0 msgr2=0x7f24881309c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:05.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.184+0000 7f248d099700 1 --2- 172.21.15.26:0/4102949137 >> v2:172.21.15.26:3300/0 conn(0x7f24881305f0 0x7f24881309c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.184+0000 7f248d099700 1 -- 172.21.15.26:0/4102949137 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24880722b0 con 0x7f248806ff90 2023-10-01T08:00:05.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.184+0000 7f2487fff700 1 --2- 172.21.15.26:0/4102949137 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f248806f660 0x7f248806fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:05.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.184+0000 7f248d099700 1 --2- 172.21.15.26:0/4102949137 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f248806ff90 0x7f2488137530 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f2480009e50 tx=0x7f248000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=729b4ab5181ff51f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:05.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.185+0000 7f24877fe700 1 -- 172.21.15.26:0/4102949137 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248000e070 con 0x7f248806ff90 2023-10-01T08:00:05.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.185+0000 7f24877fe700 1 -- 172.21.15.26:0/4102949137 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f248000b910 con 0x7f248806ff90 2023-10-01T08:00:05.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.185+0000 7f24877fe700 1 -- 172.21.15.26:0/4102949137 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248000bcc0 con 0x7f248806ff90 2023-10-01T08:00:05.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.186+0000 7f248eafc700 1 -- 172.21.15.26:0/4102949137 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f248806ff90 msgr2=0x7f2488137530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:05.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.186+0000 7f248eafc700 1 --2- 172.21.15.26:0/4102949137 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f248806ff90 0x7f2488137530 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f2480009e50 tx=0x7f248000b330 comp rx=0 tx=0).stop 2023-10-01T08:00:05.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.186+0000 7f248eafc700 1 -- 172.21.15.26:0/4102949137 shutdown_connections 2023-10-01T08:00:05.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.186+0000 7f248eafc700 1 --2- 172.21.15.26:0/4102949137 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f248806ff90 0x7f2488137530 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.186+0000 7f248eafc700 1 --2- 172.21.15.26:0/4102949137 >> v2:172.21.15.26:3300/0 conn(0x7f24881305f0 0x7f24881309c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.186+0000 7f248eafc700 1 --2- 172.21.15.26:0/4102949137 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f248806f660 0x7f248806fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.186+0000 7f248eafc700 1 -- 172.21.15.26:0/4102949137 >> 172.21.15.26:0/4102949137 conn(0x7f24880a2aa0 msgr2=0x7f24880a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:05.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.186+0000 7f248eafc700 1 -- 172.21.15.26:0/4102949137 shutdown_connections 2023-10-01T08:00:05.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.186+0000 7f248eafc700 1 -- 172.21.15.26:0/4102949137 wait complete. 2023-10-01T08:00:05.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.187+0000 7f248eafc700 1 Processor -- start 2023-10-01T08:00:05.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.187+0000 7f248eafc700 1 -- start start 2023-10-01T08:00:05.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.188+0000 7f248eafc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f248806f660 0x7f248811dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:05.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.188+0000 7f248eafc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f248806ff90 0x7f248811e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:05.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.188+0000 7f248eafc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f24881305f0 0x7f248811e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:05.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.188+0000 7f248eafc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2488120e80 con 0x7f248806ff90 2023-10-01T08:00:05.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.188+0000 7f248eafc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2488121200 con 0x7f24881305f0 2023-10-01T08:00:05.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.188+0000 7f248eafc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2488120090 con 0x7f248806f660 2023-10-01T08:00:05.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.188+0000 7f2487fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f248806ff90 0x7f248811e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:05.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.188+0000 7f2487fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f248806ff90 0x7f248811e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56686/0 (socket says 172.21.15.26:56686) 2023-10-01T08:00:05.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.188+0000 7f2487fff700 1 -- 172.21.15.26:0/2890303747 learned_addr learned my addr 172.21.15.26:0/2890303747 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:05.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.188+0000 7f248d099700 1 --2- 172.21.15.26:0/2890303747 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f24881305f0 0x7f248811e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:05.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.188+0000 7f248c898700 1 --2- 172.21.15.26:0/2890303747 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f248806f660 0x7f248811dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:05.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.188+0000 7f2487fff700 1 -- 172.21.15.26:0/2890303747 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f248806f660 msgr2=0x7f248811dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:05.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.188+0000 7f2487fff700 1 --2- 172.21.15.26:0/2890303747 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f248806f660 0x7f248811dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.188+0000 7f2487fff700 1 -- 172.21.15.26:0/2890303747 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f24881305f0 msgr2=0x7f248811e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:05.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.188+0000 7f2487fff700 1 --2- 172.21.15.26:0/2890303747 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f24881305f0 0x7f248811e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.188+0000 7f2487fff700 1 -- 172.21.15.26:0/2890303747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24740094a0 con 0x7f248806ff90 2023-10-01T08:00:05.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.189+0000 7f248c898700 1 --2- 172.21.15.26:0/2890303747 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f248806f660 0x7f248811dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:05.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.189+0000 7f2487fff700 1 --2- 172.21.15.26:0/2890303747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f248806ff90 0x7f248811e130 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f247400ebe0 tx=0x7f247400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:05.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.189+0000 7f24857fa700 1 -- 172.21.15.26:0/2890303747 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2474009760 con 0x7f248806ff90 2023-10-01T08:00:05.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.189+0000 7f24857fa700 1 -- 172.21.15.26:0/2890303747 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247400c7f0 con 0x7f248806ff90 2023-10-01T08:00:05.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.189+0000 7f248eafc700 1 -- 172.21.15.26:0/2890303747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2480009b30 con 0x7f248806ff90 2023-10-01T08:00:05.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.189+0000 7f248eafc700 1 -- 172.21.15.26:0/2890303747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2488071820 con 0x7f248806ff90 2023-10-01T08:00:05.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.189+0000 7f24857fa700 1 -- 172.21.15.26:0/2890303747 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247400cb80 con 0x7f248806ff90 2023-10-01T08:00:05.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.190+0000 7f24857fa700 1 -- 172.21.15.26:0/2890303747 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f247400cce0 con 0x7f248806ff90 2023-10-01T08:00:05.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.190+0000 7f248eafc700 1 -- 172.21.15.26:0/2890303747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24680052e0 con 0x7f248806ff90 2023-10-01T08:00:05.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.190+0000 7f24857fa700 1 -- 172.21.15.26:0/2890303747 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f247403f860 con 0x7f248806ff90 2023-10-01T08:00:05.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.200+0000 7f24857fa700 1 -- 172.21.15.26:0/2890303747 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f247401be10 con 0x7f248806ff90 2023-10-01T08:00:05.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.223+0000 7f7083c1c700 1 Processor -- start 2023-10-01T08:00:05.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.224+0000 7f7083c1c700 1 -- start start 2023-10-01T08:00:05.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.224+0000 7f7083c1c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f707c06a770 0x7f707c09d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:05.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.224+0000 7f7083c1c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f707c09dc30 0x7f707c09e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:05.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.224+0000 7f7083c1c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f707c09a810 con 0x7f707c13c1e0 2023-10-01T08:00:05.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.224+0000 7f7083c1c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f707c06ab40 con 0x7f707c09dc30 2023-10-01T08:00:05.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.224+0000 7f7083c1c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f707c09ebc0 con 0x7f707c06a770 2023-10-01T08:00:05.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.224+0000 7f70811b7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f707c09dc30 0x7f707c09e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:05.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.224+0000 7f70811b7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f707c09dc30 0x7f707c09e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44836/0 (socket says 172.21.15.26:44836) 2023-10-01T08:00:05.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.224+0000 7f70811b7700 1 -- 172.21.15.26:0/964769723 learned_addr learned my addr 172.21.15.26:0/964769723 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:05.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.224+0000 7f70819b8700 1 --2- 172.21.15.26:0/964769723 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f707c06a770 0x7f707c09d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:05.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.225+0000 7f70819b8700 1 -- 172.21.15.26:0/964769723 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f707c09dc30 msgr2=0x7f707c09e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:05.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.225+0000 7f70819b8700 1 --2- 172.21.15.26:0/964769723 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f707c09dc30 0x7f707c09e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.225+0000 7f70819b8700 1 -- 172.21.15.26:0/964769723 >> v1:172.21.15.26:6789/0 conn(0x7f707c13c1e0 legacy=0x7f707c13e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:05.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.225+0000 7f70819b8700 1 -- 172.21.15.26:0/964769723 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f707c09e920 con 0x7f707c06a770 2023-10-01T08:00:05.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.225+0000 7f70819b8700 1 --2- 172.21.15.26:0/964769723 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f707c06a770 0x7f707c09d6f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f70780098a0 tx=0x7f7078009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c03daaf920542ca8 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:05.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.225+0000 7f70809b6700 1 -- 172.21.15.26:0/964769723 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7078011830 con 0x7f707c06a770 2023-10-01T08:00:05.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.225+0000 7f70809b6700 1 -- 172.21.15.26:0/964769723 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7078011990 con 0x7f707c06a770 2023-10-01T08:00:05.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.225+0000 7f70809b6700 1 -- 172.21.15.26:0/964769723 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7078011d20 con 0x7f707c06a770 2023-10-01T08:00:05.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.226+0000 7f7083c1c700 1 -- 172.21.15.26:0/964769723 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f707c06a770 msgr2=0x7f707c09d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:05.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.226+0000 7f7083c1c700 1 --2- 172.21.15.26:0/964769723 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f707c06a770 0x7f707c09d6f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f70780098a0 tx=0x7f7078009bb0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.226+0000 7f7083c1c700 1 -- 172.21.15.26:0/964769723 shutdown_connections 2023-10-01T08:00:05.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.226+0000 7f7083c1c700 1 --2- 172.21.15.26:0/964769723 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f707c06a770 0x7f707c09d6f0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.226+0000 7f7083c1c700 1 --2- 172.21.15.26:0/964769723 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f707c09dc30 0x7f707c09e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.226+0000 7f7083c1c700 1 -- 172.21.15.26:0/964769723 >> 172.21.15.26:0/964769723 conn(0x7f707c066f50 msgr2=0x7f707c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:05.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.226+0000 7f7083c1c700 1 -- 172.21.15.26:0/964769723 shutdown_connections 2023-10-01T08:00:05.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.226+0000 7f7083c1c700 1 -- 172.21.15.26:0/964769723 wait complete. 2023-10-01T08:00:05.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.227+0000 7f7083c1c700 1 Processor -- start 2023-10-01T08:00:05.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.227+0000 7f7083c1c700 1 -- start start 2023-10-01T08:00:05.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.228+0000 7f7083c1c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f707c06a770 0x7f707c13e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:05.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.228+0000 7f7083c1c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f707c09dc30 0x7f707c13a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:05.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.228+0000 7f7083c1c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f707c13c1e0 0x7f707c13a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:05.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.228+0000 7f7083c1c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707c134bc0 con 0x7f707c13c1e0 2023-10-01T08:00:05.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.228+0000 7f7083c1c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f707c13bd70 con 0x7f707c06a770 2023-10-01T08:00:05.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.228+0000 7f7083c1c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f707c071ec0 con 0x7f707c09dc30 2023-10-01T08:00:05.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.228+0000 7f70811b7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f707c09dc30 0x7f707c13a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:05.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.228+0000 7f70819b8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f707c06a770 0x7f707c13e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:05.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.228+0000 7f70811b7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f707c09dc30 0x7f707c13a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:38470/0 (socket says 172.21.15.26:38470) 2023-10-01T08:00:05.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.228+0000 7f70811b7700 1 -- 172.21.15.26:0/1842102940 learned_addr learned my addr 172.21.15.26:0/1842102940 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:05.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.228+0000 7f70821b9700 1 --2- 172.21.15.26:0/1842102940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f707c13c1e0 0x7f707c13a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:05.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.228+0000 7f70811b7700 1 -- 172.21.15.26:0/1842102940 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f707c06a770 msgr2=0x7f707c13e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:05.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.228+0000 7f70811b7700 1 --2- 172.21.15.26:0/1842102940 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f707c06a770 0x7f707c13e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.228+0000 7f70811b7700 1 -- 172.21.15.26:0/1842102940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f707c13c1e0 msgr2=0x7f707c13a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:05.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.228+0000 7f70811b7700 1 --2- 172.21.15.26:0/1842102940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f707c13c1e0 0x7f707c13a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.228+0000 7f70811b7700 1 -- 172.21.15.26:0/1842102940 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70780094a0 con 0x7f707c09dc30 2023-10-01T08:00:05.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.229+0000 7f70811b7700 1 --2- 172.21.15.26:0/1842102940 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f707c09dc30 0x7f707c13a480 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f706c00e910 tx=0x7f706c00ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:05.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.229+0000 7f17d5f4e700 1 Processor -- start 2023-10-01T08:00:05.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.229+0000 7f70727fc700 1 -- 172.21.15.26:0/1842102940 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c013680 con 0x7f707c09dc30 2023-10-01T08:00:05.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.229+0000 7f70727fc700 1 -- 172.21.15.26:0/1842102940 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706c0137e0 con 0x7f707c09dc30 2023-10-01T08:00:05.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.229+0000 7f70727fc700 1 -- 172.21.15.26:0/1842102940 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c013b70 con 0x7f707c09dc30 2023-10-01T08:00:05.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.229+0000 7f7083c1c700 1 -- 172.21.15.26:0/1842102940 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f707c13fb40 con 0x7f707c09dc30 2023-10-01T08:00:05.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.229+0000 7f7083c1c700 1 -- 172.21.15.26:0/1842102940 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f707c09f1a0 con 0x7f707c09dc30 2023-10-01T08:00:05.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.230+0000 7f70727fc700 1 -- 172.21.15.26:0/1842102940 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f706c013cd0 con 0x7f707c09dc30 2023-10-01T08:00:05.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.230+0000 7f17d5f4e700 1 -- start start 2023-10-01T08:00:05.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.230+0000 7f17d5f4e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f17d012f640 0x7f17d012fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:05.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.230+0000 7f17d5f4e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17d012ff50 0x7f17d0095070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:05.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.230+0000 7f17d5f4e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17d009b180 con 0x7f17d00955b0 2023-10-01T08:00:05.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.230+0000 7f17d5f4e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17d009eb40 con 0x7f17d012f640 2023-10-01T08:00:05.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.230+0000 7f17d5f4e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d009c580 con 0x7f17d012ff50 2023-10-01T08:00:05.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.230+0000 7f70727fc700 1 -- 172.21.15.26:0/1842102940 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f706c03f9c0 con 0x7f707c09dc30 2023-10-01T08:00:05.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.230+0000 7f17ceffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17d012ff50 0x7f17d0095070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:05.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.230+0000 7f17cffff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f17d00955b0 0x7f17d0136b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48820/0 (socket says 172.21.15.26:48820) 2023-10-01T08:00:05.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.230+0000 7f17cffff700 1 -- 172.21.15.26:0/3175978139 learned_addr learned my addr 172.21.15.26:0/3175978139 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:05.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.231+0000 7f17cf7fe700 1 --2- 172.21.15.26:0/3175978139 >> v2:172.21.15.26:3300/0 conn(0x7f17d012f640 0x7f17d012fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:05.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.231+0000 7f17cf7fe700 1 -- 172.21.15.26:0/3175978139 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17d012ff50 msgr2=0x7f17d0095070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:05.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.231+0000 7f17cf7fe700 1 --2- 172.21.15.26:0/3175978139 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17d012ff50 0x7f17d0095070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.231+0000 7f17cf7fe700 1 -- 172.21.15.26:0/3175978139 >> v1:172.21.15.26:6789/0 conn(0x7f17d00955b0 legacy=0x7f17d0136b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:05.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.231+0000 7f17cf7fe700 1 -- 172.21.15.26:0/3175978139 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d009aca0 con 0x7f17d012f640 2023-10-01T08:00:05.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.231+0000 7f17cf7fe700 1 --2- 172.21.15.26:0/3175978139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17d012f640 0x7f17d012fa10 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f17c8009d90 tx=0x7f17c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b99895eabaec76e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:05.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.231+0000 7f17ce7fc700 1 -- 172.21.15.26:0/3175978139 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c800e070 con 0x7f17d012f640 2023-10-01T08:00:05.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.231+0000 7f17ce7fc700 1 -- 172.21.15.26:0/3175978139 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c800bb20 con 0x7f17d012f640 2023-10-01T08:00:05.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.231+0000 7f17ce7fc700 1 -- 172.21.15.26:0/3175978139 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c8012430 con 0x7f17d012f640 2023-10-01T08:00:05.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.232+0000 7f17d5f4e700 1 -- 172.21.15.26:0/3175978139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17d012f640 msgr2=0x7f17d012fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:05.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.232+0000 7f17d5f4e700 1 --2- 172.21.15.26:0/3175978139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17d012f640 0x7f17d012fa10 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f17c8009d90 tx=0x7f17c800b330 comp rx=0 tx=0).stop 2023-10-01T08:00:05.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.232+0000 7f17d5f4e700 1 -- 172.21.15.26:0/3175978139 shutdown_connections 2023-10-01T08:00:05.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.232+0000 7f17d5f4e700 1 --2- 172.21.15.26:0/3175978139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17d012f640 0x7f17d012fa10 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.232+0000 7f17d5f4e700 1 --2- 172.21.15.26:0/3175978139 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17d012ff50 0x7f17d0095070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.232+0000 7f17d5f4e700 1 -- 172.21.15.26:0/3175978139 >> 172.21.15.26:0/3175978139 conn(0x7f17d00a2360 msgr2=0x7f17d00a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:05.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.232+0000 7f17d5f4e700 1 -- 172.21.15.26:0/3175978139 shutdown_connections 2023-10-01T08:00:05.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.232+0000 7f17d5f4e700 1 -- 172.21.15.26:0/3175978139 wait complete. 2023-10-01T08:00:05.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.234+0000 7f17d5f4e700 1 Processor -- start 2023-10-01T08:00:05.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.234+0000 7f17d5f4e700 1 -- start start 2023-10-01T08:00:05.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.234+0000 7f17d5f4e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f17d00955b0 0x7f17d00937e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:05.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.234+0000 7f17d5f4e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17d012f640 0x7f17d0093d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:05.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.234+0000 7f17d5f4e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17d012ff50 0x7f17d0094260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:05.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.234+0000 7f17d5f4e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d00a1e60 con 0x7f17d012ff50 2023-10-01T08:00:05.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.234+0000 7f17d5f4e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d0094e40 con 0x7f17d012f640 2023-10-01T08:00:05.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.234+0000 7f17d5f4e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17d0127cb0 con 0x7f17d00955b0 2023-10-01T08:00:05.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.235+0000 7f17cf7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f17d00955b0 0x7f17d00937e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:05.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.235+0000 7f17ceffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17d012f640 0x7f17d0093d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.235+0000 7f17cf7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f17d00955b0 0x7f17d00937e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:38486/0 (socket says 172.21.15.26:38486) 2023-10-01T08:00:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.235+0000 7f17ceffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17d012f640 0x7f17d0093d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44862/0 (socket says 172.21.15.26:44862) 2023-10-01T08:00:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.235+0000 7f17cffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17d012ff50 0x7f17d0094260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.235+0000 7f17cf7fe700 1 -- 172.21.15.26:0/1581967584 learned_addr learned my addr 172.21.15.26:0/1581967584 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.235+0000 7f17cf7fe700 1 -- 172.21.15.26:0/1581967584 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17d012f640 msgr2=0x7f17d0093d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.235+0000 7f17cf7fe700 1 --2- 172.21.15.26:0/1581967584 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17d012f640 0x7f17d0093d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.235+0000 7f17cf7fe700 1 -- 172.21.15.26:0/1581967584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17d012ff50 msgr2=0x7f17d0094260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.235+0000 7f17cf7fe700 1 --2- 172.21.15.26:0/1581967584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17d012ff50 0x7f17d0094260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.235+0000 7f17cf7fe700 1 -- 172.21.15.26:0/1581967584 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c8009a70 con 0x7f17d00955b0 2023-10-01T08:00:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.235+0000 7f17cf7fe700 1 --2- 172.21.15.26:0/1581967584 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f17d00955b0 0x7f17d00937e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f17c8014040 tx=0x7f17c8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.235+0000 7f17c7fff700 1 -- 172.21.15.26:0/1581967584 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c8012430 con 0x7f17d00955b0 2023-10-01T08:00:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.235+0000 7f17c7fff700 1 -- 172.21.15.26:0/1581967584 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c8020070 con 0x7f17d00955b0 2023-10-01T08:00:05.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.235+0000 7f17d5f4e700 1 -- 172.21.15.26:0/1581967584 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17d0127240 con 0x7f17d00955b0 2023-10-01T08:00:05.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.235+0000 7f17d5f4e700 1 -- 172.21.15.26:0/1581967584 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17d0071a00 con 0x7f17d00955b0 2023-10-01T08:00:05.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.236+0000 7f17c7fff700 1 -- 172.21.15.26:0/1581967584 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c8004280 con 0x7f17d00955b0 2023-10-01T08:00:05.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.236+0000 7f17c7fff700 1 -- 172.21.15.26:0/1581967584 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f17c80043e0 con 0x7f17d00955b0 2023-10-01T08:00:05.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.237+0000 7f17c7fff700 1 -- 172.21.15.26:0/1581967584 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f17c8022070 con 0x7f17d00955b0 2023-10-01T08:00:05.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.237+0000 7f17d5f4e700 1 -- 172.21.15.26:0/1581967584 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17d012ecb0 con 0x7f17d00955b0 2023-10-01T08:00:05.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.240+0000 7f7083c1c700 1 -- 172.21.15.26:0/1842102940 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f707c11da70 con 0x7f707c09dc30 2023-10-01T08:00:05.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.247+0000 7f17c7fff700 1 -- 172.21.15.26:0/1581967584 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f17c801b400 con 0x7f17d00955b0 2023-10-01T08:00:05.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.256+0000 7f70727fc700 1 -- 172.21.15.26:0/1842102940 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f706c017080 con 0x7f707c09dc30 2023-10-01T08:00:05.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.329+0000 7feb69880700 1 -- 172.21.15.26:0/297170668 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7feb64074ea0 con 0x7feb6409e000 2023-10-01T08:00:05.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.330+0000 7feb4bfff700 1 -- 172.21.15.26:0/297170668 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feb580196b0 con 0x7feb6409e000 2023-10-01T08:00:05.331 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:05.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.332+0000 7feb69880700 1 -- 172.21.15.26:0/297170668 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb6409e000 msgr2=0x7feb6411e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:05.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.332+0000 7feb69880700 1 --2- 172.21.15.26:0/297170668 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb6409e000 0x7feb6411e470 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7feb5800bad0 tx=0x7feb5800bde0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.333+0000 7feb69880700 1 -- 172.21.15.26:0/297170668 shutdown_connections 2023-10-01T08:00:05.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.333+0000 7feb69880700 1 --2- 172.21.15.26:0/297170668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb6409e410 0x7feb6411e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.333+0000 7feb69880700 1 --2- 172.21.15.26:0/297170668 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb6409d6f0 0x7feb6411df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.333+0000 7feb69880700 1 --2- 172.21.15.26:0/297170668 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb6409e000 0x7feb6411e470 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.333+0000 7feb69880700 1 -- 172.21.15.26:0/297170668 >> 172.21.15.26:0/297170668 conn(0x7feb64066f50 msgr2=0x7feb64070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:05.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.333+0000 7feb69880700 1 -- 172.21.15.26:0/297170668 shutdown_connections 2023-10-01T08:00:05.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.333+0000 7feb69880700 1 -- 172.21.15.26:0/297170668 wait complete. 2023-10-01T08:00:05.348 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:05.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.419+0000 7f248eafc700 1 -- 172.21.15.26:0/2890303747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2468005590 con 0x7f248806ff90 2023-10-01T08:00:05.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.420+0000 7f24857fa700 1 -- 172.21.15.26:0/2890303747 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f247401b3b0 con 0x7f248806ff90 2023-10-01T08:00:05.421 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:05.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.422+0000 7f248eafc700 1 -- 172.21.15.26:0/2890303747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f248806ff90 msgr2=0x7f248811e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:05.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.422+0000 7f248eafc700 1 --2- 172.21.15.26:0/2890303747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f248806ff90 0x7f248811e130 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f247400ebe0 tx=0x7f247400eef0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.422+0000 7f248eafc700 1 -- 172.21.15.26:0/2890303747 shutdown_connections 2023-10-01T08:00:05.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.422+0000 7f248eafc700 1 --2- 172.21.15.26:0/2890303747 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f24881305f0 0x7f248811e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.422+0000 7f248eafc700 1 --2- 172.21.15.26:0/2890303747 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f248806f660 0x7f248811dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.422+0000 7f248eafc700 1 --2- 172.21.15.26:0/2890303747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f248806ff90 0x7f248811e130 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.422+0000 7f248eafc700 1 -- 172.21.15.26:0/2890303747 >> 172.21.15.26:0/2890303747 conn(0x7f24880a2aa0 msgr2=0x7f248812e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:05.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.422+0000 7f248eafc700 1 -- 172.21.15.26:0/2890303747 shutdown_connections 2023-10-01T08:00:05.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.422+0000 7f248eafc700 1 -- 172.21.15.26:0/2890303747 wait complete. 2023-10-01T08:00:05.437 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:05.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.456+0000 7f17d5f4e700 1 -- 172.21.15.26:0/1581967584 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f17d0074ea0 con 0x7f17d00955b0 2023-10-01T08:00:05.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.457+0000 7f17c7fff700 1 -- 172.21.15.26:0/1581967584 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f17c8011e00 con 0x7f17d00955b0 2023-10-01T08:00:05.458 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:05.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.459+0000 7f17d5f4e700 1 -- 172.21.15.26:0/1581967584 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f17d00955b0 msgr2=0x7f17d00937e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:05.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.459+0000 7f17d5f4e700 1 --2- 172.21.15.26:0/1581967584 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f17d00955b0 0x7f17d00937e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f17c8014040 tx=0x7f17c8004ad0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.459+0000 7f17d5f4e700 1 -- 172.21.15.26:0/1581967584 shutdown_connections 2023-10-01T08:00:05.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.459+0000 7f17d5f4e700 1 --2- 172.21.15.26:0/1581967584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17d012ff50 0x7f17d0094260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.459+0000 7f17d5f4e700 1 --2- 172.21.15.26:0/1581967584 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f17d00955b0 0x7f17d00937e0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.459+0000 7f17d5f4e700 1 --2- 172.21.15.26:0/1581967584 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17d012f640 0x7f17d0093d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.459+0000 7f17d5f4e700 1 -- 172.21.15.26:0/1581967584 >> 172.21.15.26:0/1581967584 conn(0x7f17d00a2360 msgr2=0x7f17d0097a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:05.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.459+0000 7f17d5f4e700 1 -- 172.21.15.26:0/1581967584 shutdown_connections 2023-10-01T08:00:05.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.459+0000 7f17d5f4e700 1 -- 172.21.15.26:0/1581967584 wait complete. 2023-10-01T08:00:05.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.466+0000 7f7083c1c700 1 -- 172.21.15.26:0/1842102940 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f707c11dc90 con 0x7f707c09dc30 2023-10-01T08:00:05.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.466+0000 7f70727fc700 1 -- 172.21.15.26:0/1842102940 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f706c021020 con 0x7f707c09dc30 2023-10-01T08:00:05.467 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:05.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.469+0000 7f7083c1c700 1 -- 172.21.15.26:0/1842102940 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f707c09dc30 msgr2=0x7f707c13a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:05.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.469+0000 7f7083c1c700 1 --2- 172.21.15.26:0/1842102940 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f707c09dc30 0x7f707c13a480 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f706c00e910 tx=0x7f706c00ec20 comp rx=0 tx=0).stop 2023-10-01T08:00:05.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.469+0000 7f7083c1c700 1 -- 172.21.15.26:0/1842102940 shutdown_connections 2023-10-01T08:00:05.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.469+0000 7f7083c1c700 1 --2- 172.21.15.26:0/1842102940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f707c13c1e0 0x7f707c13a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.469+0000 7f7083c1c700 1 --2- 172.21.15.26:0/1842102940 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f707c06a770 0x7f707c13e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.469+0000 7f7083c1c700 1 --2- 172.21.15.26:0/1842102940 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f707c09dc30 0x7f707c13a480 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:05.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.469+0000 7f7083c1c700 1 -- 172.21.15.26:0/1842102940 >> 172.21.15.26:0/1842102940 conn(0x7f707c066f50 msgr2=0x7f707c0a15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:05.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.469+0000 7f7083c1c700 1 -- 172.21.15.26:0/1842102940 shutdown_connections 2023-10-01T08:00:05.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:05.469+0000 7f7083c1c700 1 -- 172.21.15.26:0/1842102940 wait complete. 2023-10-01T08:00:05.474 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:05.483 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:06.349 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:06.437 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:06.475 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:06.484 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:06.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.496+0000 7f4c18b40700 1 Processor -- start 2023-10-01T08:00:06.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.496+0000 7f4c18b40700 1 -- start start 2023-10-01T08:00:06.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.497+0000 7f4c18b40700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c14134630 0x7f4c14136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:06.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.497+0000 7f4c18b40700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c14136f50 0x7f4c14139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:06.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.497+0000 7f4c18b40700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c1409b4f0 con 0x7f4c14131810 2023-10-01T08:00:06.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.497+0000 7f4c18b40700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c141313c0 con 0x7f4c14134630 2023-10-01T08:00:06.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.497+0000 7f4c18b40700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1406e8c0 con 0x7f4c14136f50 2023-10-01T08:00:06.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.497+0000 7f4c1259c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4c14131810 0x7f4c14131be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48834/0 (socket says 172.21.15.26:48834) 2023-10-01T08:00:06.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.497+0000 7f4c1259c700 1 -- 172.21.15.26:0/465674458 learned_addr learned my addr 172.21.15.26:0/465674458 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:06.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.497+0000 7f4c11d9b700 1 --2- 172.21.15.26:0/465674458 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c14134630 0x7f4c14136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:06.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.497+0000 7f4c12d9d700 1 --2- 172.21.15.26:0/465674458 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c14136f50 0x7f4c14139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:06.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.498+0000 7f4c1159a700 1 -- 172.21.15.26:0/465674458 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4195217952 0 0) 0x7f4c1409b4f0 con 0x7f4c14131810 2023-10-01T08:00:06.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.498+0000 7f4c11d9b700 1 -- 172.21.15.26:0/465674458 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c14136f50 msgr2=0x7f4c14139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:06.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.498+0000 7f4c11d9b700 1 --2- 172.21.15.26:0/465674458 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c14136f50 0x7f4c14139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:06.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.498+0000 7f4c11d9b700 1 -- 172.21.15.26:0/465674458 >> v1:172.21.15.26:6789/0 conn(0x7f4c14131810 legacy=0x7f4c14131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:06.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.498+0000 7f4c11d9b700 1 -- 172.21.15.26:0/465674458 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c14071d20 con 0x7f4c14134630 2023-10-01T08:00:06.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.498+0000 7f4c12d9d700 1 --2- 172.21.15.26:0/465674458 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c14136f50 0x7f4c14139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:06.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.498+0000 7f4c11d9b700 1 --2- 172.21.15.26:0/465674458 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c14134630 0x7f4c14136a10 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f4c08009870 tx=0x7f4c08009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa1711bf18c3f286 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:06.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.498+0000 7f4c1159a700 1 -- 172.21.15.26:0/465674458 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c08011830 con 0x7f4c14134630 2023-10-01T08:00:06.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.498+0000 7f4c1159a700 1 -- 172.21.15.26:0/465674458 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c08011990 con 0x7f4c14134630 2023-10-01T08:00:06.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.498+0000 7f4c1159a700 1 -- 172.21.15.26:0/465674458 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c08011d20 con 0x7f4c14134630 2023-10-01T08:00:06.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.499+0000 7f4c18b40700 1 -- 172.21.15.26:0/465674458 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c14134630 msgr2=0x7f4c14136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:06.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.499+0000 7f4c18b40700 1 --2- 172.21.15.26:0/465674458 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c14134630 0x7f4c14136a10 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f4c08009870 tx=0x7f4c08009b80 comp rx=0 tx=0).stop 2023-10-01T08:00:06.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.500+0000 7f4c18b40700 1 -- 172.21.15.26:0/465674458 shutdown_connections 2023-10-01T08:00:06.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.500+0000 7f4c18b40700 1 --2- 172.21.15.26:0/465674458 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c14136f50 0x7f4c14139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:06.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.500+0000 7f4c18b40700 1 --2- 172.21.15.26:0/465674458 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c14134630 0x7f4c14136a10 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:06.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.500+0000 7f4c18b40700 1 -- 172.21.15.26:0/465674458 >> 172.21.15.26:0/465674458 conn(0x7f4c140a2aa0 msgr2=0x7f4c140a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:06.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.500+0000 7f4c18b40700 1 -- 172.21.15.26:0/465674458 shutdown_connections 2023-10-01T08:00:06.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.500+0000 7f4c18b40700 1 -- 172.21.15.26:0/465674458 wait complete. 2023-10-01T08:00:06.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.502+0000 7f4c18b40700 1 Processor -- start 2023-10-01T08:00:06.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.502+0000 7f4c18b40700 1 -- start start 2023-10-01T08:00:06.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.502+0000 7f4c18b40700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c14131810 0x7f4c14118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:06.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.502+0000 7f4c18b40700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c14134630 0x7f4c14119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:06.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.502+0000 7f4c18b40700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c14136f50 0x7f4c14119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:06.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.502+0000 7f4c18b40700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1411c6a0 con 0x7f4c14131810 2023-10-01T08:00:06.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.502+0000 7f4c18b40700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1411a830 con 0x7f4c14136f50 2023-10-01T08:00:06.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.502+0000 7f4c18b40700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c140a1e40 con 0x7f4c14134630 2023-10-01T08:00:06.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.503+0000 7f4c12d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c14136f50 0x7f4c14119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:06.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.503+0000 7f4c12d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c14136f50 0x7f4c14119750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44876/0 (socket says 172.21.15.26:44876) 2023-10-01T08:00:06.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.503+0000 7f4c12d9d700 1 -- 172.21.15.26:0/1475434402 learned_addr learned my addr 172.21.15.26:0/1475434402 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:06.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.503+0000 7f4c11d9b700 1 --2- 172.21.15.26:0/1475434402 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c14134630 0x7f4c14119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:06.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.503+0000 7f4c1259c700 1 --2- 172.21.15.26:0/1475434402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c14131810 0x7f4c14118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:06.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.503+0000 7f4c12d9d700 1 -- 172.21.15.26:0/1475434402 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c14134630 msgr2=0x7f4c14119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:06.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.503+0000 7f4c12d9d700 1 --2- 172.21.15.26:0/1475434402 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c14134630 0x7f4c14119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:06.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.503+0000 7f4c12d9d700 1 -- 172.21.15.26:0/1475434402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c14131810 msgr2=0x7f4c14118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:06.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.503+0000 7f4c12d9d700 1 --2- 172.21.15.26:0/1475434402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c14131810 0x7f4c14118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:06.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.503+0000 7f4c12d9d700 1 -- 172.21.15.26:0/1475434402 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0c009a70 con 0x7f4c14136f50 2023-10-01T08:00:06.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.503+0000 7f4c12d9d700 1 --2- 172.21.15.26:0/1475434402 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c14136f50 0x7f4c14119750 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c00efc0 tx=0x7f4c0c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:06.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.504+0000 7f4c1259c700 1 --2- 172.21.15.26:0/1475434402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c14131810 0x7f4c14118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T08:00:06.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.504+0000 7f4c02ffd700 1 -- 172.21.15.26:0/1475434402 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c00cb40 con 0x7f4c14136f50 2023-10-01T08:00:06.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.504+0000 7f4c02ffd700 1 -- 172.21.15.26:0/1475434402 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0c00f040 con 0x7f4c14136f50 2023-10-01T08:00:06.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.504+0000 7f4c02ffd700 1 -- 172.21.15.26:0/1475434402 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c003a20 con 0x7f4c14136f50 2023-10-01T08:00:06.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.504+0000 7f4c18b40700 1 -- 172.21.15.26:0/1475434402 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c080094a0 con 0x7f4c14136f50 2023-10-01T08:00:06.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.504+0000 7f4c18b40700 1 -- 172.21.15.26:0/1475434402 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c1411bd80 con 0x7f4c14136f50 2023-10-01T08:00:06.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.505+0000 7f4c02ffd700 1 -- 172.21.15.26:0/1475434402 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4c0c003b80 con 0x7f4c14136f50 2023-10-01T08:00:06.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.505+0000 7f4c02ffd700 1 -- 172.21.15.26:0/1475434402 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4c0c03fff0 con 0x7f4c14136f50 2023-10-01T08:00:06.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.505+0000 7f4c18b40700 1 -- 172.21.15.26:0/1475434402 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c1411bf70 con 0x7f4c14136f50 2023-10-01T08:00:06.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.511+0000 7f4c02ffd700 1 -- 172.21.15.26:0/1475434402 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4c0c003e30 con 0x7f4c14136f50 2023-10-01T08:00:06.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.594+0000 7f81d9b8f700 1 Processor -- start 2023-10-01T08:00:06.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.594+0000 7f81d9b8f700 1 -- start start 2023-10-01T08:00:06.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.595+0000 7f81d9b8f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f81d409e930 0x7f81d409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:06.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.595+0000 7f81d9b8f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f81d409f240 0x7f81d41317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:06.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.595+0000 7f81d9b8f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d4070940 con 0x7f81d409f650 2023-10-01T08:00:06.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.595+0000 7f81d9b8f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81d406fd60 con 0x7f81d409e930 2023-10-01T08:00:06.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.595+0000 7f81d9b8f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81d406fa80 con 0x7f81d409f240 2023-10-01T08:00:06.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.595+0000 7f81d2ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f81d409f240 0x7f81d41317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:06.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.595+0000 7f81d2ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f81d409f240 0x7f81d41317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:38522/0 (socket says 172.21.15.26:38522) 2023-10-01T08:00:06.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.595+0000 7f81d2ffd700 1 -- 172.21.15.26:0/2787631287 learned_addr learned my addr 172.21.15.26:0/2787631287 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:06.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.595+0000 7f81d37fe700 1 --2- 172.21.15.26:0/2787631287 >> v2:172.21.15.26:3300/0 conn(0x7f81d409e930 0x7f81d409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:06.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.596+0000 7f81d37fe700 1 -- 172.21.15.26:0/2787631287 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f81d409f240 msgr2=0x7f81d41317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:06.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.596+0000 7f81d37fe700 1 --2- 172.21.15.26:0/2787631287 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f81d409f240 0x7f81d41317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:06.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.596+0000 7f81d37fe700 1 -- 172.21.15.26:0/2787631287 >> v1:172.21.15.26:6789/0 conn(0x7f81d409f650 legacy=0x7f81d4131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:06.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.596+0000 7f81d37fe700 1 -- 172.21.15.26:0/2787631287 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d409fb60 con 0x7f81d409e930 2023-10-01T08:00:06.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.596+0000 7f81d2ffd700 1 --2- 172.21.15.26:0/2787631287 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f81d409f240 0x7f81d41317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:06.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.596+0000 7f81d37fe700 1 --2- 172.21.15.26:0/2787631287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81d409e930 0x7f81d409ed00 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f81c4009840 tx=0x7f81c4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d84fa40d47fbc2c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:06.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.597+0000 7f81d27fc700 1 -- 172.21.15.26:0/2787631287 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c4011830 con 0x7f81d409e930 2023-10-01T08:00:06.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.597+0000 7f81d27fc700 1 -- 172.21.15.26:0/2787631287 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c4011990 con 0x7f81d409e930 2023-10-01T08:00:06.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.597+0000 7f81d27fc700 1 -- 172.21.15.26:0/2787631287 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c4011d20 con 0x7f81d409e930 2023-10-01T08:00:06.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.598+0000 7f81d9b8f700 1 -- 172.21.15.26:0/2787631287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81d409e930 msgr2=0x7f81d409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:06.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.598+0000 7f81d9b8f700 1 --2- 172.21.15.26:0/2787631287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81d409e930 0x7f81d409ed00 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f81c4009840 tx=0x7f81c4009b50 comp rx=0 tx=0).stop 2023-10-01T08:00:06.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.598+0000 7f81d9b8f700 1 -- 172.21.15.26:0/2787631287 shutdown_connections 2023-10-01T08:00:06.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.598+0000 7f81d9b8f700 1 --2- 172.21.15.26:0/2787631287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81d409e930 0x7f81d409ed00 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:06.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.598+0000 7f81d9b8f700 1 --2- 172.21.15.26:0/2787631287 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f81d409f240 0x7f81d41317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:06.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.598+0000 7f81d9b8f700 1 -- 172.21.15.26:0/2787631287 >> 172.21.15.26:0/2787631287 conn(0x7f81d40a4210 msgr2=0x7f81d40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:06.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.598+0000 7f81d9b8f700 1 -- 172.21.15.26:0/2787631287 shutdown_connections 2023-10-01T08:00:06.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.598+0000 7f81d9b8f700 1 -- 172.21.15.26:0/2787631287 wait complete. 2023-10-01T08:00:06.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.600+0000 7f81d9b8f700 1 Processor -- start 2023-10-01T08:00:06.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.600+0000 7f81d9b8f700 1 -- start start 2023-10-01T08:00:06.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.601+0000 7f81d9b8f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f81d409e930 0x7f81d41a3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:06.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.601+0000 7f81d9b8f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81d409f240 0x7f81d41a41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:06.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.601+0000 7f81d9b8f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81d409f650 0x7f81d41a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:06.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.601+0000 7f81d9b8f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d41a5120 con 0x7f81d409f650 2023-10-01T08:00:06.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.601+0000 7f81d9b8f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d41a5880 con 0x7f81d409f240 2023-10-01T08:00:06.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.601+0000 7f81d9b8f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81d41a6ad0 con 0x7f81d409e930 2023-10-01T08:00:06.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.601+0000 7f81d3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81d409f650 0x7f81d41a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:06.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.601+0000 7f81d37fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f81d409e930 0x7f81d41a3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:06.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.601+0000 7f81d2ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81d409f240 0x7f81d41a41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:06.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.601+0000 7f81d37fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f81d409e930 0x7f81d41a3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:38536/0 (socket says 172.21.15.26:38536) 2023-10-01T08:00:06.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.601+0000 7f81d37fe700 1 -- 172.21.15.26:0/1470822266 learned_addr learned my addr 172.21.15.26:0/1470822266 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:06.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.601+0000 7f81d3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81d409f650 0x7f81d41a46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56744/0 (socket says 172.21.15.26:56744) 2023-10-01T08:00:06.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.601+0000 7f81d37fe700 1 -- 172.21.15.26:0/1470822266 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81d409f240 msgr2=0x7f81d41a41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:06.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.601+0000 7f81d37fe700 1 --2- 172.21.15.26:0/1470822266 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81d409f240 0x7f81d41a41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:06.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.601+0000 7f81d37fe700 1 -- 172.21.15.26:0/1470822266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81d409f650 msgr2=0x7f81d41a46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:06.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.601+0000 7f81d37fe700 1 --2- 172.21.15.26:0/1470822266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81d409f650 0x7f81d41a46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:06.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.601+0000 7f81d37fe700 1 -- 172.21.15.26:0/1470822266 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c8009550 con 0x7f81d409e930 2023-10-01T08:00:06.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.601+0000 7f81d2ffd700 1 --2- 172.21.15.26:0/1470822266 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81d409f240 0x7f81d41a41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:06.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.602+0000 7f81d37fe700 1 --2- 172.21.15.26:0/1470822266 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f81d409e930 0x7f81d41a3c70 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f81c40090b0 tx=0x7f81c4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:06.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.602+0000 7f81bbfff700 1 -- 172.21.15.26:0/1470822266 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c40036a0 con 0x7f81d409e930 2023-10-01T08:00:06.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.602+0000 7f81bbfff700 1 -- 172.21.15.26:0/1470822266 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c401f070 con 0x7f81d409e930 2023-10-01T08:00:06.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.602+0000 7f81d9b8f700 1 -- 172.21.15.26:0/1470822266 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c40094a0 con 0x7f81d409e930 2023-10-01T08:00:06.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.602+0000 7f81bbfff700 1 -- 172.21.15.26:0/1470822266 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c4003a60 con 0x7f81d409e930 2023-10-01T08:00:06.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.602+0000 7f81d9b8f700 1 -- 172.21.15.26:0/1470822266 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d40a0190 con 0x7f81d409e930 2023-10-01T08:00:06.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.603+0000 7f81bbfff700 1 -- 172.21.15.26:0/1470822266 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f81c4003bc0 con 0x7f81d409e930 2023-10-01T08:00:06.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.603+0000 7f81bbfff700 1 -- 172.21.15.26:0/1470822266 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f81c4021070 con 0x7f81d409e930 2023-10-01T08:00:06.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.604+0000 7f81d9b8f700 1 -- 172.21.15.26:0/1470822266 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81d40a3510 con 0x7f81d409e930 2023-10-01T08:00:06.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.609+0000 7f81bbfff700 1 -- 172.21.15.26:0/1470822266 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f81c4015080 con 0x7f81d409e930 2023-10-01T08:00:06.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.629+0000 7fc49a5b4700 1 Processor -- start 2023-10-01T08:00:06.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.629+0000 7fc49a5b4700 1 -- start start 2023-10-01T08:00:06.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.630+0000 7fc49a5b4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4941338a0 0x7fc494133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:06.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.630+0000 7fc49a5b4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc49409e930 0x7fc49413b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:06.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.630+0000 7fc49a5b4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc49406ef30 con 0x7fc49409de50 2023-10-01T08:00:06.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.630+0000 7fc49a5b4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc49406fef0 con 0x7fc49409e930 2023-10-01T08:00:06.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.630+0000 7fc49a5b4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4941334b0 con 0x7fc4941338a0 2023-10-01T08:00:06.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.630+0000 7fc493fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4941338a0 0x7fc494133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:06.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.631+0000 7fc4937fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc49409de50 0x7fc49409e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48858/0 (socket says 172.21.15.26:48858) 2023-10-01T08:00:06.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.631+0000 7fc493fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4941338a0 0x7fc494133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44888/0 (socket says 172.21.15.26:44888) 2023-10-01T08:00:06.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.631+0000 7fc4937fe700 1 -- 172.21.15.26:0/1133661578 learned_addr learned my addr 172.21.15.26:0/1133661578 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:06.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.631+0000 7fc498b51700 1 --2- 172.21.15.26:0/1133661578 >> v2:172.21.15.26:3300/0 conn(0x7fc49409e930 0x7fc49413b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:06.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.631+0000 7fc493fff700 1 -- 172.21.15.26:0/1133661578 >> v2:172.21.15.26:3300/0 conn(0x7fc49409e930 msgr2=0x7fc49413b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:06.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.631+0000 7fc493fff700 1 --2- 172.21.15.26:0/1133661578 >> v2:172.21.15.26:3300/0 conn(0x7fc49409e930 0x7fc49413b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:06.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.631+0000 7fc493fff700 1 -- 172.21.15.26:0/1133661578 >> v1:172.21.15.26:6789/0 conn(0x7fc49409de50 legacy=0x7fc49409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:06.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.631+0000 7fc493fff700 1 -- 172.21.15.26:0/1133661578 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc49406fc30 con 0x7fc4941338a0 2023-10-01T08:00:06.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.631+0000 7fc492ffd700 1 -- 172.21.15.26:0/1133661578 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319259256 0 0) 0x7fc49406ef30 con 0x7fc49409de50 2023-10-01T08:00:06.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.631+0000 7fc498b51700 1 --2- 172.21.15.26:0/1133661578 >> v2:172.21.15.26:3300/0 conn(0x7fc49409e930 0x7fc49413b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:06.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.631+0000 7fc493fff700 1 --2- 172.21.15.26:0/1133661578 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4941338a0 0x7fc494133c70 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fc484009840 tx=0x7fc484009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a8e023eb833f4a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:06.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.631+0000 7fc492ffd700 1 -- 172.21.15.26:0/1133661578 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc484011830 con 0x7fc4941338a0 2023-10-01T08:00:06.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.632+0000 7fc492ffd700 1 -- 172.21.15.26:0/1133661578 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc484011990 con 0x7fc4941338a0 2023-10-01T08:00:06.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.632+0000 7fc492ffd700 1 -- 172.21.15.26:0/1133661578 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc484011d20 con 0x7fc4941338a0 2023-10-01T08:00:06.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.633+0000 7fc49a5b4700 1 -- 172.21.15.26:0/1133661578 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4941338a0 msgr2=0x7fc494133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:06.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.633+0000 7fc49a5b4700 1 --2- 172.21.15.26:0/1133661578 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4941338a0 0x7fc494133c70 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fc484009840 tx=0x7fc484009b50 comp rx=0 tx=0).stop 2023-10-01T08:00:06.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.633+0000 7fc49a5b4700 1 -- 172.21.15.26:0/1133661578 shutdown_connections 2023-10-01T08:00:06.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.633+0000 7fc49a5b4700 1 --2- 172.21.15.26:0/1133661578 >> v2:172.21.15.26:3300/0 conn(0x7fc49409e930 0x7fc49413b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:06.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.633+0000 7fc49a5b4700 1 --2- 172.21.15.26:0/1133661578 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc4941338a0 0x7fc494133c70 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:06.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.633+0000 7fc49a5b4700 1 -- 172.21.15.26:0/1133661578 >> 172.21.15.26:0/1133661578 conn(0x7fc4940a2aa0 msgr2=0x7fc4940a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:06.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.633+0000 7fc49a5b4700 1 -- 172.21.15.26:0/1133661578 shutdown_connections 2023-10-01T08:00:06.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.633+0000 7fc49a5b4700 1 -- 172.21.15.26:0/1133661578 wait complete. 2023-10-01T08:00:06.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.634+0000 7fc49a5b4700 1 Processor -- start 2023-10-01T08:00:06.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.635+0000 7fc49a5b4700 1 -- start start 2023-10-01T08:00:06.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.635+0000 7fc49a5b4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc49409de50 0x7fc49411a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:06.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.635+0000 7fc49a5b4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc49409e930 0x7fc49411ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:06.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.635+0000 7fc49a5b4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4941338a0 0x7fc49411b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:06.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.635+0000 7fc49a5b4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49411e0f0 con 0x7fc4941338a0 2023-10-01T08:00:06.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.635+0000 7fc49a5b4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4940a0eb0 con 0x7fc49409de50 2023-10-01T08:00:06.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.635+0000 7fc49a5b4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc49411d880 con 0x7fc49409e930 2023-10-01T08:00:06.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.636+0000 7fc493fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc49409de50 0x7fc49411a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:06.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.636+0000 7fc493fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc49409de50 0x7fc49411a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44902/0 (socket says 172.21.15.26:44902) 2023-10-01T08:00:06.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.636+0000 7fc493fff700 1 -- 172.21.15.26:0/2848304813 learned_addr learned my addr 172.21.15.26:0/2848304813 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:06.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.636+0000 7fc498b51700 1 --2- 172.21.15.26:0/2848304813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4941338a0 0x7fc49411b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:06.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.636+0000 7fc4937fe700 1 --2- 172.21.15.26:0/2848304813 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc49409e930 0x7fc49411ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:06.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.636+0000 7fc493fff700 1 -- 172.21.15.26:0/2848304813 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc49409e930 msgr2=0x7fc49411ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:06.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.636+0000 7fc493fff700 1 --2- 172.21.15.26:0/2848304813 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc49409e930 0x7fc49411ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:06.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.636+0000 7fc493fff700 1 -- 172.21.15.26:0/2848304813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4941338a0 msgr2=0x7fc49411b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:06.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.636+0000 7fc493fff700 1 --2- 172.21.15.26:0/2848304813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4941338a0 0x7fc49411b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:06.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.636+0000 7fc493fff700 1 -- 172.21.15.26:0/2848304813 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48c009a70 con 0x7fc49409de50 2023-10-01T08:00:06.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.636+0000 7fc498b51700 1 --2- 172.21.15.26:0/2848304813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4941338a0 0x7fc49411b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:06.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.636+0000 7fc493fff700 1 --2- 172.21.15.26:0/2848304813 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc49409de50 0x7fc49411a5d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fc484009fd0 tx=0x7fc484004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:06.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.636+0000 7fc490ff9700 1 -- 172.21.15.26:0/2848304813 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4840036a0 con 0x7fc49409de50 2023-10-01T08:00:06.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.636+0000 7fc490ff9700 1 -- 172.21.15.26:0/2848304813 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48401f070 con 0x7fc49409de50 2023-10-01T08:00:06.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.636+0000 7fc49a5b4700 1 -- 172.21.15.26:0/2848304813 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4840094a0 con 0x7fc49409de50 2023-10-01T08:00:06.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.637+0000 7fc490ff9700 1 -- 172.21.15.26:0/2848304813 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc484003a40 con 0x7fc49409de50 2023-10-01T08:00:06.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.637+0000 7fc49a5b4700 1 -- 172.21.15.26:0/2848304813 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc49406f690 con 0x7fc49409de50 2023-10-01T08:00:06.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.638+0000 7fc490ff9700 1 -- 172.21.15.26:0/2848304813 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc484003ba0 con 0x7fc49409de50 2023-10-01T08:00:06.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.638+0000 7fc49a5b4700 1 -- 172.21.15.26:0/2848304813 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc494074ea0 con 0x7fc49409de50 2023-10-01T08:00:06.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.638+0000 7fc490ff9700 1 -- 172.21.15.26:0/2848304813 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc484021070 con 0x7fc49409de50 2023-10-01T08:00:06.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.647+0000 7fc490ff9700 1 -- 172.21.15.26:0/2848304813 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc484019d80 con 0x7fc49409de50 2023-10-01T08:00:06.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.648+0000 7fc11e3ea700 1 Processor -- start 2023-10-01T08:00:06.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.648+0000 7fc11e3ea700 1 -- start start 2023-10-01T08:00:06.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.649+0000 7fc11e3ea700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc11809eca0 0x7fc11813cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:06.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.649+0000 7fc11e3ea700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc11806f050 0x7fc11813f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:06.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.649+0000 7fc11e3ea700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc118070ee0 con 0x7fc11806e570 2023-10-01T08:00:06.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.649+0000 7fc11e3ea700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc118071980 con 0x7fc11809eca0 2023-10-01T08:00:06.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.649+0000 7fc11e3ea700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc118071480 con 0x7fc11806f050 2023-10-01T08:00:06.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.649+0000 7fc117fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc11806e570 0x7fc11806e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48860/0 (socket says 172.21.15.26:48860) 2023-10-01T08:00:06.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.649+0000 7fc117fff700 1 -- 172.21.15.26:0/914324778 learned_addr learned my addr 172.21.15.26:0/914324778 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:06.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.649+0000 7fc1177fe700 1 --2- 172.21.15.26:0/914324778 >> v2:172.21.15.26:3300/0 conn(0x7fc11809eca0 0x7fc11813cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:06.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.649+0000 7fc11c987700 1 --2- 172.21.15.26:0/914324778 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc11806f050 0x7fc11813f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:06.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.650+0000 7fc1177fe700 1 -- 172.21.15.26:0/914324778 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc11806f050 msgr2=0x7fc11813f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:06.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.650+0000 7fc116ffd700 1 -- 172.21.15.26:0/914324778 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2892497148 0 0) 0x7fc118070ee0 con 0x7fc11806e570 2023-10-01T08:00:06.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.650+0000 7fc1177fe700 1 --2- 172.21.15.26:0/914324778 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc11806f050 0x7fc11813f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:06.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.650+0000 7fc1177fe700 1 -- 172.21.15.26:0/914324778 >> v1:172.21.15.26:6789/0 conn(0x7fc11806e570 legacy=0x7fc11806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:06.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.650+0000 7fc1177fe700 1 -- 172.21.15.26:0/914324778 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc118071b90 con 0x7fc11809eca0 2023-10-01T08:00:06.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.650+0000 7fc1177fe700 1 --2- 172.21.15.26:0/914324778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc11809eca0 0x7fc11813cea0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fc10c009840 tx=0x7fc10c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2611511cdd83b215 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:06.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.650+0000 7fc116ffd700 1 -- 172.21.15.26:0/914324778 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c011830 con 0x7fc11809eca0 2023-10-01T08:00:06.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.650+0000 7fc116ffd700 1 -- 172.21.15.26:0/914324778 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10c011990 con 0x7fc11809eca0 2023-10-01T08:00:06.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.650+0000 7fc116ffd700 1 -- 172.21.15.26:0/914324778 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c011d20 con 0x7fc11809eca0 2023-10-01T08:00:06.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.651+0000 7fc11e3ea700 1 -- 172.21.15.26:0/914324778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc11809eca0 msgr2=0x7fc11813cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:06.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.651+0000 7fc11e3ea700 1 --2- 172.21.15.26:0/914324778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc11809eca0 0x7fc11813cea0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fc10c009840 tx=0x7fc10c009b50 comp rx=0 tx=0).stop 2023-10-01T08:00:06.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.651+0000 7fc11e3ea700 1 -- 172.21.15.26:0/914324778 shutdown_connections 2023-10-01T08:00:06.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.651+0000 7fc11e3ea700 1 --2- 172.21.15.26:0/914324778 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc11806f050 0x7fc11813f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:06.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.651+0000 7fc11e3ea700 1 --2- 172.21.15.26:0/914324778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc11809eca0 0x7fc11813cea0 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:06.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.651+0000 7fc11e3ea700 1 -- 172.21.15.26:0/914324778 >> 172.21.15.26:0/914324778 conn(0x7fc1180a2aa0 msgr2=0x7fc1180a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:06.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.651+0000 7fc11e3ea700 1 -- 172.21.15.26:0/914324778 shutdown_connections 2023-10-01T08:00:06.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.652+0000 7fc11e3ea700 1 -- 172.21.15.26:0/914324778 wait complete. 2023-10-01T08:00:06.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.653+0000 7fc11e3ea700 1 Processor -- start 2023-10-01T08:00:06.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.653+0000 7fc11e3ea700 1 -- start start 2023-10-01T08:00:06.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.654+0000 7fc11e3ea700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc11806e570 0x7fc1181266e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:06.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.654+0000 7fc11e3ea700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc11806f050 0x7fc118126c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:06.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.654+0000 7fc11e3ea700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc118127160 0x7fc1181cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:06.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.654+0000 7fc11e3ea700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1181288b0 con 0x7fc11806e570 2023-10-01T08:00:06.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.654+0000 7fc11e3ea700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11809a0e0 con 0x7fc118127160 2023-10-01T08:00:06.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.654+0000 7fc11e3ea700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc118070610 con 0x7fc11806f050 2023-10-01T08:00:06.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.654+0000 7fc117fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc11806e570 0x7fc1181266e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:06.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.654+0000 7fc117fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc11806e570 0x7fc1181266e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56784/0 (socket says 172.21.15.26:56784) 2023-10-01T08:00:06.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.654+0000 7fc117fff700 1 -- 172.21.15.26:0/2539004272 learned_addr learned my addr 172.21.15.26:0/2539004272 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:06.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.654+0000 7fc1177fe700 1 --2- 172.21.15.26:0/2539004272 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc11806f050 0x7fc118126c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:06.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.654+0000 7fc11c987700 1 --2- 172.21.15.26:0/2539004272 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc118127160 0x7fc1181cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:06.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.654+0000 7fc1177fe700 1 -- 172.21.15.26:0/2539004272 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc118127160 msgr2=0x7fc1181cc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:06.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.654+0000 7fc1177fe700 1 --2- 172.21.15.26:0/2539004272 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc118127160 0x7fc1181cc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:06.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.655+0000 7fc1177fe700 1 -- 172.21.15.26:0/2539004272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc11806e570 msgr2=0x7fc1181266e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:06.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.655+0000 7fc1177fe700 1 --2- 172.21.15.26:0/2539004272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc11806e570 0x7fc1181266e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:06.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.655+0000 7fc1177fe700 1 -- 172.21.15.26:0/2539004272 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10c0094a0 con 0x7fc11806f050 2023-10-01T08:00:06.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.655+0000 7fc117fff700 1 --2- 172.21.15.26:0/2539004272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc11806e570 0x7fc1181266e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:06.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.655+0000 7fc1177fe700 1 --2- 172.21.15.26:0/2539004272 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc11806f050 0x7fc118126c20 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc10c016000 tx=0x7fc10c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:06.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.655+0000 7fc114ff9700 1 -- 172.21.15.26:0/2539004272 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c0036a0 con 0x7fc11806f050 2023-10-01T08:00:06.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.655+0000 7fc114ff9700 1 -- 172.21.15.26:0/2539004272 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10c01f070 con 0x7fc11806f050 2023-10-01T08:00:06.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.655+0000 7fc114ff9700 1 -- 172.21.15.26:0/2539004272 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c003a40 con 0x7fc11806f050 2023-10-01T08:00:06.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.655+0000 7fc11e3ea700 1 -- 172.21.15.26:0/2539004272 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc118129990 con 0x7fc11806f050 2023-10-01T08:00:06.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.655+0000 7fc11e3ea700 1 -- 172.21.15.26:0/2539004272 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc118128ae0 con 0x7fc11806f050 2023-10-01T08:00:06.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.657+0000 7fc11e3ea700 1 -- 172.21.15.26:0/2539004272 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc118129b80 con 0x7fc11806f050 2023-10-01T08:00:06.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.657+0000 7fc114ff9700 1 -- 172.21.15.26:0/2539004272 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc10c003ba0 con 0x7fc11806f050 2023-10-01T08:00:06.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.657+0000 7fc114ff9700 1 -- 172.21.15.26:0/2539004272 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc10c021070 con 0x7fc11806f050 2023-10-01T08:00:06.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.667+0000 7fc114ff9700 1 -- 172.21.15.26:0/2539004272 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc10c075750 con 0x7fc11806f050 2023-10-01T08:00:06.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.747+0000 7f4c18b40700 1 -- 172.21.15.26:0/1475434402 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4c1411c320 con 0x7f4c14136f50 2023-10-01T08:00:06.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.748+0000 7f4c02ffd700 1 -- 172.21.15.26:0/1475434402 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4c1411c320 con 0x7f4c14136f50 2023-10-01T08:00:06.749 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:06.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.750+0000 7f4c18b40700 1 -- 172.21.15.26:0/1475434402 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c14136f50 msgr2=0x7f4c14119750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:06.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.750+0000 7f4c18b40700 1 --2- 172.21.15.26:0/1475434402 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c14136f50 0x7f4c14119750 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c00efc0 tx=0x7f4c0c00c3a0 comp rx=0 tx=0).stop 2023-10-01T08:00:06.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.750+0000 7f4c18b40700 1 -- 172.21.15.26:0/1475434402 shutdown_connections 2023-10-01T08:00:06.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.750+0000 7f4c18b40700 1 --2- 172.21.15.26:0/1475434402 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c14136f50 0x7f4c14119750 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:06.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.750+0000 7f4c18b40700 1 --2- 172.21.15.26:0/1475434402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c14131810 0x7f4c14118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:06.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.750+0000 7f4c18b40700 1 --2- 172.21.15.26:0/1475434402 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c14134630 0x7f4c14119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:06.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.750+0000 7f4c18b40700 1 -- 172.21.15.26:0/1475434402 >> 172.21.15.26:0/1475434402 conn(0x7f4c140a2aa0 msgr2=0x7f4c140a0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:06.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.750+0000 7f4c18b40700 1 -- 172.21.15.26:0/1475434402 shutdown_connections 2023-10-01T08:00:06.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.750+0000 7f4c18b40700 1 -- 172.21.15.26:0/1475434402 wait complete. 2023-10-01T08:00:06.767 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:06.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.828+0000 7f81d9b8f700 1 -- 172.21.15.26:0/1470822266 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f81d4071d20 con 0x7f81d409e930 2023-10-01T08:00:06.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.828+0000 7f81bbfff700 1 -- 172.21.15.26:0/1470822266 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f81c4035090 con 0x7f81d409e930 2023-10-01T08:00:06.830 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:06.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.831+0000 7f81d9b8f700 1 -- 172.21.15.26:0/1470822266 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f81d409e930 msgr2=0x7f81d41a3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:06.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.831+0000 7f81d9b8f700 1 --2- 172.21.15.26:0/1470822266 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f81d409e930 0x7f81d41a3c70 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f81c40090b0 tx=0x7f81c4004750 comp rx=0 tx=0).stop 2023-10-01T08:00:06.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.832+0000 7f81d9b8f700 1 -- 172.21.15.26:0/1470822266 shutdown_connections 2023-10-01T08:00:06.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.832+0000 7f81d9b8f700 1 --2- 172.21.15.26:0/1470822266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81d409f650 0x7f81d41a46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:06.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.832+0000 7f81d9b8f700 1 --2- 172.21.15.26:0/1470822266 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f81d409e930 0x7f81d41a3c70 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:06.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.832+0000 7f81d9b8f700 1 --2- 172.21.15.26:0/1470822266 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81d409f240 0x7f81d41a41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:06.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.832+0000 7f81d9b8f700 1 -- 172.21.15.26:0/1470822266 >> 172.21.15.26:0/1470822266 conn(0x7f81d40a4210 msgr2=0x7f81d41b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:06.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.832+0000 7f81d9b8f700 1 -- 172.21.15.26:0/1470822266 shutdown_connections 2023-10-01T08:00:06.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.832+0000 7f81d9b8f700 1 -- 172.21.15.26:0/1470822266 wait complete. 2023-10-01T08:00:06.852 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:06.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.911+0000 7fc49a5b4700 1 -- 172.21.15.26:0/2848304813 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc49406b9e0 con 0x7fc49409de50 2023-10-01T08:00:06.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.912+0000 7fc490ff9700 1 -- 172.21.15.26:0/2848304813 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc484034020 con 0x7fc49409de50 2023-10-01T08:00:06.914 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:06.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.914+0000 7fc49a5b4700 1 -- 172.21.15.26:0/2848304813 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc49409de50 msgr2=0x7fc49411a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:06.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.914+0000 7fc49a5b4700 1 --2- 172.21.15.26:0/2848304813 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc49409de50 0x7fc49411a5d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fc484009fd0 tx=0x7fc484004750 comp rx=0 tx=0).stop 2023-10-01T08:00:06.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.914+0000 7fc49a5b4700 1 -- 172.21.15.26:0/2848304813 shutdown_connections 2023-10-01T08:00:06.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.914+0000 7fc49a5b4700 1 --2- 172.21.15.26:0/2848304813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4941338a0 0x7fc49411b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:06.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.914+0000 7fc49a5b4700 1 --2- 172.21.15.26:0/2848304813 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc49409de50 0x7fc49411a5d0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:06.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.914+0000 7fc49a5b4700 1 --2- 172.21.15.26:0/2848304813 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc49409e930 0x7fc49411ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:06.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.914+0000 7fc49a5b4700 1 -- 172.21.15.26:0/2848304813 >> 172.21.15.26:0/2848304813 conn(0x7fc4940a2aa0 msgr2=0x7fc494130730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:06.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.914+0000 7fc49a5b4700 1 -- 172.21.15.26:0/2848304813 shutdown_connections 2023-10-01T08:00:06.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.914+0000 7fc49a5b4700 1 -- 172.21.15.26:0/2848304813 wait complete. 2023-10-01T08:00:06.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.916+0000 7fc11e3ea700 1 -- 172.21.15.26:0/2539004272 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc118074ea0 con 0x7fc11806f050 2023-10-01T08:00:06.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.916+0000 7fc114ff9700 1 -- 172.21.15.26:0/2539004272 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc10c015070 con 0x7fc11806f050 2023-10-01T08:00:06.918 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:06.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.919+0000 7fc11e3ea700 1 -- 172.21.15.26:0/2539004272 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc11806f050 msgr2=0x7fc118126c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:06.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.919+0000 7fc11e3ea700 1 --2- 172.21.15.26:0/2539004272 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc11806f050 0x7fc118126c20 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc10c016000 tx=0x7fc10c004750 comp rx=0 tx=0).stop 2023-10-01T08:00:06.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.919+0000 7fc11e3ea700 1 -- 172.21.15.26:0/2539004272 shutdown_connections 2023-10-01T08:00:06.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.919+0000 7fc11e3ea700 1 --2- 172.21.15.26:0/2539004272 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc118127160 0x7fc1181cc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:06.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.919+0000 7fc11e3ea700 1 --2- 172.21.15.26:0/2539004272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc11806e570 0x7fc1181266e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:06.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.919+0000 7fc11e3ea700 1 --2- 172.21.15.26:0/2539004272 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc11806f050 0x7fc118126c20 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:06.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.919+0000 7fc11e3ea700 1 -- 172.21.15.26:0/2539004272 >> 172.21.15.26:0/2539004272 conn(0x7fc1180a2aa0 msgr2=0x7fc1180a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:06.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.919+0000 7fc11e3ea700 1 -- 172.21.15.26:0/2539004272 shutdown_connections 2023-10-01T08:00:06.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:06.919+0000 7fc11e3ea700 1 -- 172.21.15.26:0/2539004272 wait complete. 2023-10-01T08:00:06.930 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:06.935 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:07.768 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:07.853 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:07.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.914+0000 7f79e473b700 1 Processor -- start 2023-10-01T08:00:07.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.914+0000 7f79e473b700 1 -- start start 2023-10-01T08:00:07.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.915+0000 7f79e473b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79dc0a0a30 0x7f79dc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:07.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.915+0000 7f79e473b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79dc0a1340 0x7f79dc133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:07.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.915+0000 7f79e473b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f79dc133fa0 0x7f79dc134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:07.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.915+0000 7f79e473b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79dc09edd0 con 0x7f79dc133fa0 2023-10-01T08:00:07.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.915+0000 7f79e473b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc09e1f0 con 0x7f79dc0a1340 2023-10-01T08:00:07.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.915+0000 7f79e473b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc09dc50 con 0x7f79dc0a0a30 2023-10-01T08:00:07.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.915+0000 7f79e1cd6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79dc0a1340 0x7f79dc133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:07.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.915+0000 7f79e24d7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79dc0a0a30 0x7f79dc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:07.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.915+0000 7f79e2cd8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f79dc133fa0 0x7f79dc134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:07.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.915+0000 7f79e24d7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79dc0a0a30 0x7f79dc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:38570/0 (socket says 172.21.15.26:38570) 2023-10-01T08:00:07.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.915+0000 7f79e1cd6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79dc0a1340 0x7f79dc133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44922/0 (socket says 172.21.15.26:44922) 2023-10-01T08:00:07.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.915+0000 7f79e24d7700 1 -- 172.21.15.26:0/3129665132 learned_addr learned my addr 172.21.15.26:0/3129665132 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:07.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.916+0000 7f79e1cd6700 1 -- 172.21.15.26:0/3129665132 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79dc0a0a30 msgr2=0x7f79dc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:07.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.916+0000 7f79e1cd6700 1 --2- 172.21.15.26:0/3129665132 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79dc0a0a30 0x7f79dc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:07.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.916+0000 7f79e1cd6700 1 -- 172.21.15.26:0/3129665132 >> v2:172.21.15.26:3300/0 conn(0x7f79dc133fa0 msgr2=0x7f79dc134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:07.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.916+0000 7f79e1cd6700 1 --2- 172.21.15.26:0/3129665132 >> v2:172.21.15.26:3300/0 conn(0x7f79dc133fa0 0x7f79dc134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:07.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.916+0000 7f79e1cd6700 1 -- 172.21.15.26:0/3129665132 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc0a1fe0 con 0x7f79dc0a1340 2023-10-01T08:00:07.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.916+0000 7f79e2cd8700 1 --2- 172.21.15.26:0/3129665132 >> v2:172.21.15.26:3300/0 conn(0x7f79dc133fa0 0x7f79dc134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:07.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.916+0000 7f79e1cd6700 1 --2- 172.21.15.26:0/3129665132 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79dc0a1340 0x7f79dc133a60 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f79d0009840 tx=0x7f79d0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a66d322f7c418822 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:07.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.916+0000 7f79e14d5700 1 -- 172.21.15.26:0/3129665132 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d0011830 con 0x7f79dc0a1340 2023-10-01T08:00:07.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.916+0000 7f79e14d5700 1 -- 172.21.15.26:0/3129665132 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d0011990 con 0x7f79dc0a1340 2023-10-01T08:00:07.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.916+0000 7f79e14d5700 1 -- 172.21.15.26:0/3129665132 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d0011d20 con 0x7f79dc0a1340 2023-10-01T08:00:07.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.917+0000 7f79e473b700 1 -- 172.21.15.26:0/3129665132 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79dc0a1340 msgr2=0x7f79dc133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:07.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.917+0000 7f79e473b700 1 --2- 172.21.15.26:0/3129665132 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79dc0a1340 0x7f79dc133a60 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f79d0009840 tx=0x7f79d0009b50 comp rx=0 tx=0).stop 2023-10-01T08:00:07.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.917+0000 7f79e473b700 1 -- 172.21.15.26:0/3129665132 shutdown_connections 2023-10-01T08:00:07.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.917+0000 7f79e473b700 1 --2- 172.21.15.26:0/3129665132 >> v2:172.21.15.26:3300/0 conn(0x7f79dc133fa0 0x7f79dc134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:07.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.917+0000 7f79e473b700 1 --2- 172.21.15.26:0/3129665132 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79dc0a0a30 0x7f79dc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:07.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.917+0000 7f79e473b700 1 --2- 172.21.15.26:0/3129665132 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79dc0a1340 0x7f79dc133a60 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:07.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.917+0000 7f79e473b700 1 -- 172.21.15.26:0/3129665132 >> 172.21.15.26:0/3129665132 conn(0x7f79dc0a6550 msgr2=0x7f79dc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:07.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.917+0000 7f79e473b700 1 -- 172.21.15.26:0/3129665132 shutdown_connections 2023-10-01T08:00:07.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.917+0000 7f79e473b700 1 -- 172.21.15.26:0/3129665132 wait complete. 2023-10-01T08:00:07.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.918+0000 7f79e473b700 1 Processor -- start 2023-10-01T08:00:07.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.918+0000 7f79e473b700 1 -- start start 2023-10-01T08:00:07.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.918+0000 7f79e473b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79dc0a0a30 0x7f79dc120130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:07.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.918+0000 7f79e473b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79dc0a1340 0x7f79dc120670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:07.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.918+0000 7f79e473b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79dc133fa0 0x7f79dc120bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:07.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.918+0000 7f79e473b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc123c50 con 0x7f79dc133fa0 2023-10-01T08:00:07.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.918+0000 7f79e473b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc0a3530 con 0x7f79dc0a1340 2023-10-01T08:00:07.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.918+0000 7f79e473b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc1233e0 con 0x7f79dc0a0a30 2023-10-01T08:00:07.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.919+0000 7f79e1cd6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79dc0a1340 0x7f79dc120670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:07.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.919+0000 7f79e24d7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79dc0a0a30 0x7f79dc120130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:07.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.919+0000 7f79e1cd6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79dc0a1340 0x7f79dc120670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44932/0 (socket says 172.21.15.26:44932) 2023-10-01T08:00:07.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.919+0000 7f79e24d7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79dc0a0a30 0x7f79dc120130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:38578/0 (socket says 172.21.15.26:38578) 2023-10-01T08:00:07.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.919+0000 7f79e1cd6700 1 -- 172.21.15.26:0/296747764 learned_addr learned my addr 172.21.15.26:0/296747764 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:07.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.919+0000 7f79e2cd8700 1 --2- 172.21.15.26:0/296747764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79dc133fa0 0x7f79dc120bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:07.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.919+0000 7f79e1cd6700 1 -- 172.21.15.26:0/296747764 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79dc0a0a30 msgr2=0x7f79dc120130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:07.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.919+0000 7f79e1cd6700 1 --2- 172.21.15.26:0/296747764 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79dc0a0a30 0x7f79dc120130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:07.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.919+0000 7f79e1cd6700 1 -- 172.21.15.26:0/296747764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79dc133fa0 msgr2=0x7f79dc120bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:07.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.919+0000 7f79e1cd6700 1 --2- 172.21.15.26:0/296747764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79dc133fa0 0x7f79dc120bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:07.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.919+0000 7f79e1cd6700 1 -- 172.21.15.26:0/296747764 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79cc009a70 con 0x7f79dc0a1340 2023-10-01T08:00:07.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.919+0000 7f79e2cd8700 1 --2- 172.21.15.26:0/296747764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79dc133fa0 0x7f79dc120bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T08:00:07.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.919+0000 7f79e24d7700 1 --2- 172.21.15.26:0/296747764 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79dc0a0a30 0x7f79dc120130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:07.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.919+0000 7f79e1cd6700 1 --2- 172.21.15.26:0/296747764 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79dc0a1340 0x7f79dc120670 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f79d00090b0 tx=0x7f79d0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:07.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.919+0000 7f79daffd700 1 -- 172.21.15.26:0/296747764 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d0004510 con 0x7f79dc0a1340 2023-10-01T08:00:07.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.919+0000 7f79daffd700 1 -- 172.21.15.26:0/296747764 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d001f070 con 0x7f79dc0a1340 2023-10-01T08:00:07.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.919+0000 7f79e473b700 1 -- 172.21.15.26:0/296747764 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d00094a0 con 0x7f79dc0a1340 2023-10-01T08:00:07.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.919+0000 7f79daffd700 1 -- 172.21.15.26:0/296747764 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d00038e0 con 0x7f79dc0a1340 2023-10-01T08:00:07.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.919+0000 7f79e473b700 1 -- 172.21.15.26:0/296747764 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79dc121d40 con 0x7f79dc0a1340 2023-10-01T08:00:07.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.920+0000 7f79daffd700 1 -- 172.21.15.26:0/296747764 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f79d0003a40 con 0x7f79dc0a1340 2023-10-01T08:00:07.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.920+0000 7f79daffd700 1 -- 172.21.15.26:0/296747764 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f79d0021070 con 0x7f79dc0a1340 2023-10-01T08:00:07.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.921+0000 7f79e473b700 1 -- 172.21.15.26:0/296747764 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79dc1237d0 con 0x7f79dc0a1340 2023-10-01T08:00:07.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:07.925+0000 7f79daffd700 1 -- 172.21.15.26:0/296747764 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f79d0040e60 con 0x7f79dc0a1340 2023-10-01T08:00:07.931 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:07.935 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:08.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.017+0000 7f2d9bbd3700 1 Processor -- start 2023-10-01T08:00:08.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.018+0000 7f2d9bbd3700 1 -- start start 2023-10-01T08:00:08.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.018+0000 7f2d9bbd3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2d9409d630 0x7f2d940a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:08.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.018+0000 7f2d9bbd3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d94138d80 0x7f2d9413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:08.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.018+0000 7f2d9bbd3700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d940a2a70 con 0x7f2d940a0a30 2023-10-01T08:00:08.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.018+0000 7f2d9bbd3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d940a01d0 con 0x7f2d9409d630 2023-10-01T08:00:08.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.018+0000 7f2d9bbd3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9409e2b0 con 0x7f2d94138d80 2023-10-01T08:00:08.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.019+0000 7f2d9a170700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d94138d80 0x7f2d9413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:08.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.019+0000 7f2d9916e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2d9409d630 0x7f2d940a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:08.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.019+0000 7f2d9916e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2d9409d630 0x7f2d940a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56822/0 (socket says 172.21.15.26:56822) 2023-10-01T08:00:08.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.019+0000 7f2d9a170700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d94138d80 0x7f2d9413b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44946/0 (socket says 172.21.15.26:44946) 2023-10-01T08:00:08.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.019+0000 7f2d9916e700 1 -- 172.21.15.26:0/1034397636 learned_addr learned my addr 172.21.15.26:0/1034397636 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:08.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.019+0000 7f2d9a170700 1 -- 172.21.15.26:0/1034397636 >> v2:172.21.15.26:3300/0 conn(0x7f2d9409d630 msgr2=0x7f2d940a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:08.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.019+0000 7f2d9a170700 1 --2- 172.21.15.26:0/1034397636 >> v2:172.21.15.26:3300/0 conn(0x7f2d9409d630 0x7f2d940a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:08.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.019+0000 7f2d9a170700 1 -- 172.21.15.26:0/1034397636 >> v1:172.21.15.26:6789/0 conn(0x7f2d940a0a30 legacy=0x7f2d940a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:08.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.019+0000 7f2d9a170700 1 -- 172.21.15.26:0/1034397636 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d9409dc50 con 0x7f2d94138d80 2023-10-01T08:00:08.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.019+0000 7f2d9896d700 1 -- 172.21.15.26:0/1034397636 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 978091575 0 0) 0x7f2d940a2a70 con 0x7f2d940a0a30 2023-10-01T08:00:08.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.019+0000 7f2d9916e700 1 --2- 172.21.15.26:0/1034397636 >> v2:172.21.15.26:3300/0 conn(0x7f2d9409d630 0x7f2d940a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:08.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.019+0000 7f2d9a170700 1 --2- 172.21.15.26:0/1034397636 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d94138d80 0x7f2d9413b160 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c009d90 tx=0x7f2d8c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e76e0f9ab7d051af server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:08.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.020+0000 7f2d9896d700 1 -- 172.21.15.26:0/1034397636 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c00e070 con 0x7f2d94138d80 2023-10-01T08:00:08.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.020+0000 7f2d9896d700 1 -- 172.21.15.26:0/1034397636 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8c00bb20 con 0x7f2d94138d80 2023-10-01T08:00:08.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.020+0000 7f2d9896d700 1 -- 172.21.15.26:0/1034397636 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c012430 con 0x7f2d94138d80 2023-10-01T08:00:08.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.020+0000 7f2d9bbd3700 1 -- 172.21.15.26:0/1034397636 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d94138d80 msgr2=0x7f2d9413b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:08.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.020+0000 7f2d9bbd3700 1 --2- 172.21.15.26:0/1034397636 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d94138d80 0x7f2d9413b160 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c009d90 tx=0x7f2d8c00b330 comp rx=0 tx=0).stop 2023-10-01T08:00:08.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.020+0000 7f2d9bbd3700 1 -- 172.21.15.26:0/1034397636 shutdown_connections 2023-10-01T08:00:08.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.020+0000 7f2d9bbd3700 1 --2- 172.21.15.26:0/1034397636 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d94138d80 0x7f2d9413b160 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:08.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.020+0000 7f2d9bbd3700 1 --2- 172.21.15.26:0/1034397636 >> v2:172.21.15.26:3300/0 conn(0x7f2d9409d630 0x7f2d940a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:08.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.020+0000 7f2d9bbd3700 1 -- 172.21.15.26:0/1034397636 >> 172.21.15.26:0/1034397636 conn(0x7f2d940a3050 msgr2=0x7f2d940a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:08.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.021+0000 7f2d9bbd3700 1 -- 172.21.15.26:0/1034397636 shutdown_connections 2023-10-01T08:00:08.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.021+0000 7f2d9bbd3700 1 -- 172.21.15.26:0/1034397636 wait complete. 2023-10-01T08:00:08.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.022+0000 7f2d9bbd3700 1 Processor -- start 2023-10-01T08:00:08.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.022+0000 7f2d9bbd3700 1 -- start start 2023-10-01T08:00:08.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.023+0000 7f2d9bbd3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d9409d630 0x7f2d94133700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:08.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.023+0000 7f2d9bbd3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d940a0a30 0x7f2d94133c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:08.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.023+0000 7f2d9bbd3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d94138d80 0x7f2d94134180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:08.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.023+0000 7f2d9bbd3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d94137180 con 0x7f2d940a0a30 2023-10-01T08:00:08.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.023+0000 7f2d9bbd3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d94136070 con 0x7f2d94138d80 2023-10-01T08:00:08.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.023+0000 7f2d9bbd3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d94136530 con 0x7f2d9409d630 2023-10-01T08:00:08.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.023+0000 7f2d9a170700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d94138d80 0x7f2d94134180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:08.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.023+0000 7f2d9996f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d9409d630 0x7f2d94133700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:08.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.023+0000 7f2d9a170700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d94138d80 0x7f2d94134180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44950/0 (socket says 172.21.15.26:44950) 2023-10-01T08:00:08.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.023+0000 7f2d9a170700 1 -- 172.21.15.26:0/3111888900 learned_addr learned my addr 172.21.15.26:0/3111888900 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:08.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.023+0000 7f2d9916e700 1 --2- 172.21.15.26:0/3111888900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d940a0a30 0x7f2d94133c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:08.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.024+0000 7f2d9916e700 1 -- 172.21.15.26:0/3111888900 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d9409d630 msgr2=0x7f2d94133700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:08.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.024+0000 7f2d9916e700 1 --2- 172.21.15.26:0/3111888900 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d9409d630 0x7f2d94133700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:08.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.024+0000 7f2d9916e700 1 -- 172.21.15.26:0/3111888900 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d94138d80 msgr2=0x7f2d94134180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:08.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.024+0000 7f2d9916e700 1 --2- 172.21.15.26:0/3111888900 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d94138d80 0x7f2d94134180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:08.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.024+0000 7f2d9916e700 1 -- 172.21.15.26:0/3111888900 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d84009550 con 0x7f2d940a0a30 2023-10-01T08:00:08.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.024+0000 7f2d9a170700 1 --2- 172.21.15.26:0/3111888900 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d94138d80 0x7f2d94134180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T08:00:08.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.024+0000 7f2d9916e700 1 --2- 172.21.15.26:0/3111888900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d940a0a30 0x7f2d94133c40 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f2d8400e9a0 tx=0x7f2d8400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:08.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.024+0000 7f2d8a7fc700 1 -- 172.21.15.26:0/3111888900 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d84004030 con 0x7f2d940a0a30 2023-10-01T08:00:08.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.024+0000 7f2d8a7fc700 1 -- 172.21.15.26:0/3111888900 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d84004190 con 0x7f2d940a0a30 2023-10-01T08:00:08.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.024+0000 7f2d9bbd3700 1 -- 172.21.15.26:0/3111888900 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d8c009a70 con 0x7f2d940a0a30 2023-10-01T08:00:08.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.024+0000 7f2d8a7fc700 1 -- 172.21.15.26:0/3111888900 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d84004520 con 0x7f2d940a0a30 2023-10-01T08:00:08.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.024+0000 7f2d9bbd3700 1 -- 172.21.15.26:0/3111888900 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d94136be0 con 0x7f2d940a0a30 2023-10-01T08:00:08.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.025+0000 7f2d8a7fc700 1 -- 172.21.15.26:0/3111888900 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d8400c850 con 0x7f2d940a0a30 2023-10-01T08:00:08.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.026+0000 7f2d8a7fc700 1 -- 172.21.15.26:0/3111888900 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2d8403f990 con 0x7f2d940a0a30 2023-10-01T08:00:08.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.026+0000 7f2d9bbd3700 1 -- 172.21.15.26:0/3111888900 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d940747f0 con 0x7f2d940a0a30 2023-10-01T08:00:08.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.031+0000 7f2d8a7fc700 1 -- 172.21.15.26:0/3111888900 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d84020020 con 0x7f2d940a0a30 2023-10-01T08:00:08.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.084+0000 7f2a32ef6700 1 Processor -- start 2023-10-01T08:00:08.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.084+0000 7f2a32ef6700 1 -- start start 2023-10-01T08:00:08.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.085+0000 7f2a32ef6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a2c09d6f0 0x7f2a2c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:08.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.085+0000 7f2a32ef6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a2c09e410 0x7f2a2c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:08.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.085+0000 7f2a32ef6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a2c09b120 con 0x7f2a2c09e000 2023-10-01T08:00:08.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.085+0000 7f2a32ef6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c06b460 con 0x7f2a2c09e410 2023-10-01T08:00:08.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.085+0000 7f2a32ef6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c09a7e0 con 0x7f2a2c09d6f0 2023-10-01T08:00:08.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.085+0000 7f2a30c92700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a2c09d6f0 0x7f2a2c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:08.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.085+0000 7f2a30c92700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a2c09d6f0 0x7f2a2c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:38596/0 (socket says 172.21.15.26:38596) 2023-10-01T08:00:08.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.085+0000 7f2a2bfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2a2c09e000 0x7f2a2c1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48890/0 (socket says 172.21.15.26:48890) 2023-10-01T08:00:08.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.085+0000 7f2a30c92700 1 -- 172.21.15.26:0/3388754732 learned_addr learned my addr 172.21.15.26:0/3388754732 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:08.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.085+0000 7f2a31493700 1 --2- 172.21.15.26:0/3388754732 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a2c09e410 0x7f2a2c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:08.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.085+0000 7f2a30c92700 1 -- 172.21.15.26:0/3388754732 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a2c09e410 msgr2=0x7f2a2c134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:08.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.085+0000 7f2a30c92700 1 --2- 172.21.15.26:0/3388754732 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a2c09e410 0x7f2a2c134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:08.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.085+0000 7f2a30c92700 1 -- 172.21.15.26:0/3388754732 >> v1:172.21.15.26:6789/0 conn(0x7f2a2c09e000 legacy=0x7f2a2c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:08.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.086+0000 7f2a30c92700 1 -- 172.21.15.26:0/3388754732 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c09a500 con 0x7f2a2c09d6f0 2023-10-01T08:00:08.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.086+0000 7f2a30c92700 1 --2- 172.21.15.26:0/3388754732 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a2c09d6f0 0x7f2a2c09dac0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f2a20009950 tx=0x7f2a20009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2a8c45e41488764 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:08.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.086+0000 7f2a2b7fe700 1 -- 172.21.15.26:0/3388754732 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a20004230 con 0x7f2a2c09d6f0 2023-10-01T08:00:08.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.086+0000 7f2a2b7fe700 1 -- 172.21.15.26:0/3388754732 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a20004390 con 0x7f2a2c09d6f0 2023-10-01T08:00:08.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.086+0000 7f2a2b7fe700 1 -- 172.21.15.26:0/3388754732 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a200036a0 con 0x7f2a2c09d6f0 2023-10-01T08:00:08.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.087+0000 7f2a32ef6700 1 -- 172.21.15.26:0/3388754732 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a2c09d6f0 msgr2=0x7f2a2c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:08.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.087+0000 7f2a32ef6700 1 --2- 172.21.15.26:0/3388754732 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a2c09d6f0 0x7f2a2c09dac0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f2a20009950 tx=0x7f2a20009c60 comp rx=0 tx=0).stop 2023-10-01T08:00:08.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.087+0000 7f2a32ef6700 1 -- 172.21.15.26:0/3388754732 shutdown_connections 2023-10-01T08:00:08.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.087+0000 7f2a32ef6700 1 --2- 172.21.15.26:0/3388754732 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a2c09d6f0 0x7f2a2c09dac0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:08.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.087+0000 7f2a32ef6700 1 --2- 172.21.15.26:0/3388754732 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a2c09e410 0x7f2a2c134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:08.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.087+0000 7f2a32ef6700 1 -- 172.21.15.26:0/3388754732 >> 172.21.15.26:0/3388754732 conn(0x7f2a2c066f50 msgr2=0x7f2a2c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:08.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.087+0000 7f2a32ef6700 1 -- 172.21.15.26:0/3388754732 shutdown_connections 2023-10-01T08:00:08.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.087+0000 7f2a32ef6700 1 -- 172.21.15.26:0/3388754732 wait complete. 2023-10-01T08:00:08.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.088+0000 7f2a32ef6700 1 Processor -- start 2023-10-01T08:00:08.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.088+0000 7f2a32ef6700 1 -- start start 2023-10-01T08:00:08.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.089+0000 7f2a32ef6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a2c09d6f0 0x7f2a2c1225c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:08.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.089+0000 7f2a32ef6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a2c09e000 0x7f2a2c122b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:08.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.089+0000 7f2a32ef6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a2c09e410 0x7f2a2c123040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:08.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.089+0000 7f2a32ef6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c1257e0 con 0x7f2a2c09d6f0 2023-10-01T08:00:08.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.089+0000 7f2a32ef6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c0a1eb0 con 0x7f2a2c09e000 2023-10-01T08:00:08.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.089+0000 7f2a32ef6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c09c710 con 0x7f2a2c09e410 2023-10-01T08:00:08.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.089+0000 7f2a30c92700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a2c09d6f0 0x7f2a2c1225c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:08.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.089+0000 7f2a30c92700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a2c09d6f0 0x7f2a2c1225c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56846/0 (socket says 172.21.15.26:56846) 2023-10-01T08:00:08.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.089+0000 7f2a30c92700 1 -- 172.21.15.26:0/2293428578 learned_addr learned my addr 172.21.15.26:0/2293428578 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:08.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.090+0000 7f2a2bfff700 1 --2- 172.21.15.26:0/2293428578 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a2c09e000 0x7f2a2c122b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:08.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.090+0000 7f2a31493700 1 --2- 172.21.15.26:0/2293428578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a2c09e410 0x7f2a2c123040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:08.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.090+0000 7f2a2bfff700 1 -- 172.21.15.26:0/2293428578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a2c09e410 msgr2=0x7f2a2c123040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:08.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.090+0000 7f2a2bfff700 1 --2- 172.21.15.26:0/2293428578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a2c09e410 0x7f2a2c123040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:08.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.090+0000 7f2a2bfff700 1 -- 172.21.15.26:0/2293428578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a2c09d6f0 msgr2=0x7f2a2c1225c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:08.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.090+0000 7f2a2bfff700 1 --2- 172.21.15.26:0/2293428578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a2c09d6f0 0x7f2a2c1225c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:08.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.090+0000 7f2a2bfff700 1 -- 172.21.15.26:0/2293428578 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a20009550 con 0x7f2a2c09e000 2023-10-01T08:00:08.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.090+0000 7f2a31493700 1 --2- 172.21.15.26:0/2293428578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a2c09e410 0x7f2a2c123040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:08.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.090+0000 7f2a30c92700 1 --2- 172.21.15.26:0/2293428578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a2c09d6f0 0x7f2a2c1225c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:08.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.090+0000 7f2a2bfff700 1 --2- 172.21.15.26:0/2293428578 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a2c09e000 0x7f2a2c122b00 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f2a1800c750 tx=0x7f2a1800ca60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:08.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.090+0000 7f2a297fa700 1 -- 172.21.15.26:0/2293428578 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a18004c80 con 0x7f2a2c09e000 2023-10-01T08:00:08.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.090+0000 7f2a297fa700 1 -- 172.21.15.26:0/2293428578 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a18004de0 con 0x7f2a2c09e000 2023-10-01T08:00:08.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.090+0000 7f2a297fa700 1 -- 172.21.15.26:0/2293428578 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a18007310 con 0x7f2a2c09e000 2023-10-01T08:00:08.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.091+0000 7f2a32ef6700 1 -- 172.21.15.26:0/2293428578 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a2c124f60 con 0x7f2a2c09e000 2023-10-01T08:00:08.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.091+0000 7f2a32ef6700 1 -- 172.21.15.26:0/2293428578 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a2c125d70 con 0x7f2a2c09e000 2023-10-01T08:00:08.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.092+0000 7f2a297fa700 1 -- 172.21.15.26:0/2293428578 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2a18007470 con 0x7f2a2c09e000 2023-10-01T08:00:08.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.092+0000 7f2a32ef6700 1 -- 172.21.15.26:0/2293428578 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a2c074ea0 con 0x7f2a2c09e000 2023-10-01T08:00:08.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.092+0000 7f2a297fa700 1 -- 172.21.15.26:0/2293428578 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2a1803f450 con 0x7f2a2c09e000 2023-10-01T08:00:08.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.097+0000 7f2a297fa700 1 -- 172.21.15.26:0/2293428578 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2a18007720 con 0x7f2a2c09e000 2023-10-01T08:00:08.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.127+0000 7fb49a538700 1 Processor -- start 2023-10-01T08:00:08.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.127+0000 7fb49a538700 1 -- start start 2023-10-01T08:00:08.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.128+0000 7fb49a538700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb49409d6f0 0x7fb49409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:08.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.128+0000 7fb49a538700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb49409e410 0x7fb494130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:08.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.128+0000 7fb49a538700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb49409f130 con 0x7fb49409e000 2023-10-01T08:00:08.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.128+0000 7fb49a538700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb49409f520 con 0x7fb49409e410 2023-10-01T08:00:08.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.128+0000 7fb49a538700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb49409e930 con 0x7fb49409d6f0 2023-10-01T08:00:08.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.128+0000 7fb4937fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb49409e000 0x7fb494130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48892/0 (socket says 172.21.15.26:48892) 2023-10-01T08:00:08.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.128+0000 7fb498ad5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb49409e410 0x7fb494130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:08.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.128+0000 7fb4937fe700 1 -- 172.21.15.26:0/1874566232 learned_addr learned my addr 172.21.15.26:0/1874566232 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:08.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.128+0000 7fb493fff700 1 --2- 172.21.15.26:0/1874566232 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb49409d6f0 0x7fb49409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:08.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.128+0000 7fb492ffd700 1 -- 172.21.15.26:0/1874566232 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3642045894 0 0) 0x7fb49409f130 con 0x7fb49409e000 2023-10-01T08:00:08.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.128+0000 7fb492ffd700 1 -- 172.21.15.26:0/1874566232 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb47c0035b0 con 0x7fb49409e000 2023-10-01T08:00:08.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.128+0000 7fb498ad5700 1 -- 172.21.15.26:0/1874566232 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb49409d6f0 msgr2=0x7fb49409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:08.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.128+0000 7fb498ad5700 1 --2- 172.21.15.26:0/1874566232 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb49409d6f0 0x7fb49409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:08.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.128+0000 7fb498ad5700 1 -- 172.21.15.26:0/1874566232 >> v1:172.21.15.26:6789/0 conn(0x7fb49409e000 legacy=0x7fb494130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:08.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.128+0000 7fb498ad5700 1 -- 172.21.15.26:0/1874566232 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb49409b2d0 con 0x7fb49409e410 2023-10-01T08:00:08.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.129+0000 7fb498ad5700 1 --2- 172.21.15.26:0/1874566232 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb49409e410 0x7fb494130d70 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fb48c009dc0 tx=0x7fb48c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac9e7cceffb34fa server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:08.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.129+0000 7fb492ffd700 1 -- 172.21.15.26:0/1874566232 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c00e070 con 0x7fb49409e410 2023-10-01T08:00:08.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.129+0000 7fb492ffd700 1 -- 172.21.15.26:0/1874566232 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48c00bb20 con 0x7fb49409e410 2023-10-01T08:00:08.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.129+0000 7fb492ffd700 1 -- 172.21.15.26:0/1874566232 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c012430 con 0x7fb49409e410 2023-10-01T08:00:08.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.130+0000 7fb49a538700 1 -- 172.21.15.26:0/1874566232 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb49409e410 msgr2=0x7fb494130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:08.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.130+0000 7fb49a538700 1 --2- 172.21.15.26:0/1874566232 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb49409e410 0x7fb494130d70 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fb48c009dc0 tx=0x7fb48c00b330 comp rx=0 tx=0).stop 2023-10-01T08:00:08.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.130+0000 7fb49a538700 1 -- 172.21.15.26:0/1874566232 shutdown_connections 2023-10-01T08:00:08.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.130+0000 7fb49a538700 1 --2- 172.21.15.26:0/1874566232 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb49409d6f0 0x7fb49409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:08.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.130+0000 7fb49a538700 1 --2- 172.21.15.26:0/1874566232 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb49409e410 0x7fb494130d70 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:08.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.130+0000 7fb49a538700 1 -- 172.21.15.26:0/1874566232 >> 172.21.15.26:0/1874566232 conn(0x7fb494066f50 msgr2=0x7fb49409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:08.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.130+0000 7fb49a538700 1 -- 172.21.15.26:0/1874566232 shutdown_connections 2023-10-01T08:00:08.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.130+0000 7fb49a538700 1 -- 172.21.15.26:0/1874566232 wait complete. 2023-10-01T08:00:08.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.131+0000 7fb49a538700 1 Processor -- start 2023-10-01T08:00:08.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.132+0000 7fb49a538700 1 -- start start 2023-10-01T08:00:08.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.132+0000 7fb49a538700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb49409d6f0 0x7fb494122330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:08.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.132+0000 7fb49a538700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb49409e000 0x7fb494122870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:08.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.132+0000 7fb49a538700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb49409e410 0x7fb494122db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:08.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.132+0000 7fb49a538700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb494123f40 con 0x7fb49409e410 2023-10-01T08:00:08.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.132+0000 7fb49a538700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4941258b0 con 0x7fb49409e000 2023-10-01T08:00:08.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.132+0000 7fb49a538700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb494125e50 con 0x7fb49409d6f0 2023-10-01T08:00:08.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.132+0000 7fb493fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb49409d6f0 0x7fb494122330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:08.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.133+0000 7fb493fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb49409d6f0 0x7fb494122330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:38630/0 (socket says 172.21.15.26:38630) 2023-10-01T08:00:08.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.133+0000 7fb493fff700 1 -- 172.21.15.26:0/895612679 learned_addr learned my addr 172.21.15.26:0/895612679 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:08.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.133+0000 7fb4937fe700 1 --2- 172.21.15.26:0/895612679 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb49409e000 0x7fb494122870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:08.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.133+0000 7fb498ad5700 1 --2- 172.21.15.26:0/895612679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb49409e410 0x7fb494122db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:08.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.133+0000 7fb493fff700 1 -- 172.21.15.26:0/895612679 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb49409e000 msgr2=0x7fb494122870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:08.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.133+0000 7fb493fff700 1 --2- 172.21.15.26:0/895612679 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb49409e000 0x7fb494122870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:08.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.133+0000 7fb493fff700 1 -- 172.21.15.26:0/895612679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb49409e410 msgr2=0x7fb494122db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:08.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.133+0000 7fb493fff700 1 --2- 172.21.15.26:0/895612679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb49409e410 0x7fb494122db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:08.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.133+0000 7fb493fff700 1 -- 172.21.15.26:0/895612679 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48c009a70 con 0x7fb49409d6f0 2023-10-01T08:00:08.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.133+0000 7fb493fff700 1 --2- 172.21.15.26:0/895612679 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb49409d6f0 0x7fb494122330 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb48400ed70 tx=0x7fb48400d630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:08.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.133+0000 7fb490ff9700 1 -- 172.21.15.26:0/895612679 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb484010640 con 0x7fb49409d6f0 2023-10-01T08:00:08.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.133+0000 7fb490ff9700 1 -- 172.21.15.26:0/895612679 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4840107a0 con 0x7fb49409d6f0 2023-10-01T08:00:08.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.133+0000 7fb49a538700 1 -- 172.21.15.26:0/895612679 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb494124760 con 0x7fb49409d6f0 2023-10-01T08:00:08.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.133+0000 7fb490ff9700 1 -- 172.21.15.26:0/895612679 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb484010b10 con 0x7fb49409d6f0 2023-10-01T08:00:08.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.133+0000 7fb49a538700 1 -- 172.21.15.26:0/895612679 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb494125b70 con 0x7fb49409d6f0 2023-10-01T08:00:08.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.135+0000 7fb49a538700 1 -- 172.21.15.26:0/895612679 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb494074ea0 con 0x7fb49409d6f0 2023-10-01T08:00:08.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.135+0000 7fb490ff9700 1 -- 172.21.15.26:0/895612679 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb484010c70 con 0x7fb49409d6f0 2023-10-01T08:00:08.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.136+0000 7fb490ff9700 1 -- 172.21.15.26:0/895612679 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb48403ff50 con 0x7fb49409d6f0 2023-10-01T08:00:08.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.140+0000 7fb490ff9700 1 -- 172.21.15.26:0/895612679 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb48400ee50 con 0x7fb49409d6f0 2023-10-01T08:00:08.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.144+0000 7f79e473b700 1 -- 172.21.15.26:0/296747764 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f79dc122ff0 con 0x7f79dc0a1340 2023-10-01T08:00:08.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.144+0000 7f79daffd700 1 -- 172.21.15.26:0/296747764 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f79d0015020 con 0x7f79dc0a1340 2023-10-01T08:00:08.146 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:08.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.146+0000 7f79e473b700 1 -- 172.21.15.26:0/296747764 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79dc0a1340 msgr2=0x7f79dc120670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:08.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.146+0000 7f79e473b700 1 --2- 172.21.15.26:0/296747764 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79dc0a1340 0x7f79dc120670 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f79d00090b0 tx=0x7f79d0004750 comp rx=0 tx=0).stop 2023-10-01T08:00:08.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.147+0000 7f79e473b700 1 -- 172.21.15.26:0/296747764 shutdown_connections 2023-10-01T08:00:08.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.147+0000 7f79e473b700 1 --2- 172.21.15.26:0/296747764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79dc133fa0 0x7f79dc120bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:08.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.147+0000 7f79e473b700 1 --2- 172.21.15.26:0/296747764 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f79dc0a0a30 0x7f79dc120130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:08.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.147+0000 7f79e473b700 1 --2- 172.21.15.26:0/296747764 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f79dc0a1340 0x7f79dc120670 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:08.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.147+0000 7f79e473b700 1 -- 172.21.15.26:0/296747764 >> 172.21.15.26:0/296747764 conn(0x7f79dc0a6550 msgr2=0x7f79dc1bb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:08.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.147+0000 7f79e473b700 1 -- 172.21.15.26:0/296747764 shutdown_connections 2023-10-01T08:00:08.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.147+0000 7f79e473b700 1 -- 172.21.15.26:0/296747764 wait complete. 2023-10-01T08:00:08.167 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:08.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.309+0000 7f2d9bbd3700 1 -- 172.21.15.26:0/3111888900 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2d94137970 con 0x7f2d940a0a30 2023-10-01T08:00:08.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.310+0000 7f2d8a7fc700 1 -- 172.21.15.26:0/3111888900 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d840036a0 con 0x7f2d940a0a30 2023-10-01T08:00:08.312 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:08.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.312+0000 7f2d9bbd3700 1 -- 172.21.15.26:0/3111888900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d940a0a30 msgr2=0x7f2d94133c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:08.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.312+0000 7f2d9bbd3700 1 --2- 172.21.15.26:0/3111888900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d940a0a30 0x7f2d94133c40 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f2d8400e9a0 tx=0x7f2d8400ecb0 comp rx=0 tx=0).stop 2023-10-01T08:00:08.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.312+0000 7f2d9bbd3700 1 -- 172.21.15.26:0/3111888900 shutdown_connections 2023-10-01T08:00:08.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.312+0000 7f2d9bbd3700 1 --2- 172.21.15.26:0/3111888900 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d94138d80 0x7f2d94134180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:08.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.312+0000 7f2d9bbd3700 1 --2- 172.21.15.26:0/3111888900 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d9409d630 0x7f2d94133700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:08.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.312+0000 7f2d9bbd3700 1 --2- 172.21.15.26:0/3111888900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d940a0a30 0x7f2d94133c40 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:08.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.312+0000 7f2d9bbd3700 1 -- 172.21.15.26:0/3111888900 >> 172.21.15.26:0/3111888900 conn(0x7f2d940a3050 msgr2=0x7f2d9409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:08.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.312+0000 7f2d9bbd3700 1 -- 172.21.15.26:0/3111888900 shutdown_connections 2023-10-01T08:00:08.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.312+0000 7f2d9bbd3700 1 -- 172.21.15.26:0/3111888900 wait complete. 2023-10-01T08:00:08.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.314+0000 7f2a32ef6700 1 -- 172.21.15.26:0/2293428578 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2a2c06c360 con 0x7f2a2c09e000 2023-10-01T08:00:08.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.315+0000 7f2a297fa700 1 -- 172.21.15.26:0/2293428578 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2a18011360 con 0x7f2a2c09e000 2023-10-01T08:00:08.317 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:08.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.318+0000 7f2a32ef6700 1 -- 172.21.15.26:0/2293428578 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a2c09e000 msgr2=0x7f2a2c122b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:08.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.318+0000 7f2a32ef6700 1 --2- 172.21.15.26:0/2293428578 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a2c09e000 0x7f2a2c122b00 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f2a1800c750 tx=0x7f2a1800ca60 comp rx=0 tx=0).stop 2023-10-01T08:00:08.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.318+0000 7f2a32ef6700 1 -- 172.21.15.26:0/2293428578 shutdown_connections 2023-10-01T08:00:08.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.318+0000 7f2a32ef6700 1 --2- 172.21.15.26:0/2293428578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2a2c09e410 0x7f2a2c123040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:08.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.318+0000 7f2a32ef6700 1 --2- 172.21.15.26:0/2293428578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a2c09d6f0 0x7f2a2c1225c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:08.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.318+0000 7f2a32ef6700 1 --2- 172.21.15.26:0/2293428578 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2a2c09e000 0x7f2a2c122b00 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:08.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.318+0000 7f2a32ef6700 1 -- 172.21.15.26:0/2293428578 >> 172.21.15.26:0/2293428578 conn(0x7f2a2c066f50 msgr2=0x7f2a2c0a1580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:08.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.318+0000 7f2a32ef6700 1 -- 172.21.15.26:0/2293428578 shutdown_connections 2023-10-01T08:00:08.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.318+0000 7f2a32ef6700 1 -- 172.21.15.26:0/2293428578 wait complete. 2023-10-01T08:00:08.329 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:08.335 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:08.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.375+0000 7fb49a538700 1 -- 172.21.15.26:0/895612679 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb4940a3c00 con 0x7fb49409d6f0 2023-10-01T08:00:08.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.375+0000 7fb490ff9700 1 -- 172.21.15.26:0/895612679 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb48401d020 con 0x7fb49409d6f0 2023-10-01T08:00:08.377 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:08.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.377+0000 7fb49a538700 1 -- 172.21.15.26:0/895612679 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb49409d6f0 msgr2=0x7fb494122330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:08.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.377+0000 7fb49a538700 1 --2- 172.21.15.26:0/895612679 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb49409d6f0 0x7fb494122330 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb48400ed70 tx=0x7fb48400d630 comp rx=0 tx=0).stop 2023-10-01T08:00:08.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.377+0000 7fb49a538700 1 -- 172.21.15.26:0/895612679 shutdown_connections 2023-10-01T08:00:08.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.377+0000 7fb49a538700 1 --2- 172.21.15.26:0/895612679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb49409e410 0x7fb494122db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:08.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.377+0000 7fb49a538700 1 --2- 172.21.15.26:0/895612679 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb49409d6f0 0x7fb494122330 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:08.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.377+0000 7fb49a538700 1 --2- 172.21.15.26:0/895612679 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb49409e000 0x7fb494122870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:08.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.377+0000 7fb49a538700 1 -- 172.21.15.26:0/895612679 >> 172.21.15.26:0/895612679 conn(0x7fb494066f50 msgr2=0x7fb494130a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:08.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.377+0000 7fb49a538700 1 -- 172.21.15.26:0/895612679 shutdown_connections 2023-10-01T08:00:08.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:08.377+0000 7fb49a538700 1 -- 172.21.15.26:0/895612679 wait complete. 2023-10-01T08:00:08.392 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:09.168 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:09.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.313+0000 7f792883a700 1 Processor -- start 2023-10-01T08:00:09.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.314+0000 7f792883a700 1 -- start start 2023-10-01T08:00:09.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.314+0000 7f792883a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f792406a770 0x7f792406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:09.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.314+0000 7f792883a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f792406b080 0x7f7924131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:09.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.314+0000 7f792883a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7924131b40 0x7f7924131fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:09.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.314+0000 7f792883a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f792409ece0 con 0x7f792406b080 2023-10-01T08:00:09.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.314+0000 7f792883a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792409e760 con 0x7f7924131b40 2023-10-01T08:00:09.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.314+0000 7f792883a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f792409e040 con 0x7f792406a770 2023-10-01T08:00:09.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.314+0000 7f792259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f792406a770 0x7f792406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:09.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.314+0000 7f7922d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7924131b40 0x7f7924131fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:09.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.314+0000 7f7921d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f792406b080 0x7f7924131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:09.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.314+0000 7f7922d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7924131b40 0x7f7924131fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44992/0 (socket says 172.21.15.26:44992) 2023-10-01T08:00:09.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.314+0000 7f7921d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f792406b080 0x7f7924131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56866/0 (socket says 172.21.15.26:56866) 2023-10-01T08:00:09.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.314+0000 7f7922d9d700 1 -- 172.21.15.26:0/1214325860 learned_addr learned my addr 172.21.15.26:0/1214325860 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:09.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.314+0000 7f792259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f792406a770 0x7f792406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:38632/0 (socket says 172.21.15.26:38632) 2023-10-01T08:00:09.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.315+0000 7f7921d9b700 1 -- 172.21.15.26:0/1214325860 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f792406a770 msgr2=0x7f792406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:09.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.315+0000 7f7921d9b700 1 --2- 172.21.15.26:0/1214325860 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f792406a770 0x7f792406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.315+0000 7f7921d9b700 1 -- 172.21.15.26:0/1214325860 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7924131b40 msgr2=0x7f7924131fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:09.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.315+0000 7f7921d9b700 1 --2- 172.21.15.26:0/1214325860 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7924131b40 0x7f7924131fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.315+0000 7f7921d9b700 1 -- 172.21.15.26:0/1214325860 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792409f630 con 0x7f792406b080 2023-10-01T08:00:09.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.315+0000 7f792259c700 1 --2- 172.21.15.26:0/1214325860 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f792406a770 0x7f792406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:09.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.315+0000 7f7922d9d700 1 --2- 172.21.15.26:0/1214325860 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7924131b40 0x7f7924131fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:09.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.315+0000 7f7921d9b700 1 --2- 172.21.15.26:0/1214325860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f792406b080 0x7f7924131600 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f790c00dc60 tx=0x7f790c00df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60cc43250169033b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:09.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.315+0000 7f792159a700 1 -- 172.21.15.26:0/1214325860 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790c012070 con 0x7f792406b080 2023-10-01T08:00:09.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.315+0000 7f792159a700 1 -- 172.21.15.26:0/1214325860 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790c00d2e0 con 0x7f792406b080 2023-10-01T08:00:09.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.315+0000 7f792159a700 1 -- 172.21.15.26:0/1214325860 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790c00f900 con 0x7f792406b080 2023-10-01T08:00:09.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.316+0000 7f792883a700 1 -- 172.21.15.26:0/1214325860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f792406b080 msgr2=0x7f7924131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:09.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.316+0000 7f792883a700 1 --2- 172.21.15.26:0/1214325860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f792406b080 0x7f7924131600 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f790c00dc60 tx=0x7f790c00df70 comp rx=0 tx=0).stop 2023-10-01T08:00:09.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.316+0000 7f792883a700 1 -- 172.21.15.26:0/1214325860 shutdown_connections 2023-10-01T08:00:09.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.316+0000 7f792883a700 1 --2- 172.21.15.26:0/1214325860 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7924131b40 0x7f7924131fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.316+0000 7f792883a700 1 --2- 172.21.15.26:0/1214325860 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f792406a770 0x7f792406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.316+0000 7f792883a700 1 --2- 172.21.15.26:0/1214325860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f792406b080 0x7f7924131600 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.316+0000 7f792883a700 1 -- 172.21.15.26:0/1214325860 >> 172.21.15.26:0/1214325860 conn(0x7f7924066f50 msgr2=0x7f792409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:09.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.316+0000 7f792883a700 1 -- 172.21.15.26:0/1214325860 shutdown_connections 2023-10-01T08:00:09.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.316+0000 7f792883a700 1 -- 172.21.15.26:0/1214325860 wait complete. 2023-10-01T08:00:09.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.317+0000 7f792883a700 1 Processor -- start 2023-10-01T08:00:09.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.317+0000 7f792883a700 1 -- start start 2023-10-01T08:00:09.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.318+0000 7f792883a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f792406a770 0x7f79241270a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:09.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.318+0000 7f792883a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f792406b080 0x7f79241275e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:09.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.318+0000 7f792883a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7924131b40 0x7f79241cc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:09.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.318+0000 7f792883a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7924128400 con 0x7f7924131b40 2023-10-01T08:00:09.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.318+0000 7f792883a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7924128cd0 con 0x7f792406a770 2023-10-01T08:00:09.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.318+0000 7f792883a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7924126cd0 con 0x7f792406b080 2023-10-01T08:00:09.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.318+0000 7f792259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f792406a770 0x7f79241270a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:09.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.318+0000 7f7921d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f792406b080 0x7f79241275e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:09.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.318+0000 7f7922d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7924131b40 0x7f79241cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:09.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.318+0000 7f792259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f792406a770 0x7f79241270a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44994/0 (socket says 172.21.15.26:44994) 2023-10-01T08:00:09.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.318+0000 7f7922d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7924131b40 0x7f79241cc560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56872/0 (socket says 172.21.15.26:56872) 2023-10-01T08:00:09.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.318+0000 7f792259c700 1 -- 172.21.15.26:0/2446000183 learned_addr learned my addr 172.21.15.26:0/2446000183 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:09.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.318+0000 7f7921d9b700 1 -- 172.21.15.26:0/2446000183 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f792406a770 msgr2=0x7f79241270a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:09.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.318+0000 7f7921d9b700 1 --2- 172.21.15.26:0/2446000183 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f792406a770 0x7f79241270a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.318+0000 7f7921d9b700 1 -- 172.21.15.26:0/2446000183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7924131b40 msgr2=0x7f79241cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:09.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.318+0000 7f7921d9b700 1 --2- 172.21.15.26:0/2446000183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7924131b40 0x7f79241cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.318+0000 7f7921d9b700 1 -- 172.21.15.26:0/2446000183 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79140094a0 con 0x7f792406b080 2023-10-01T08:00:09.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.318+0000 7f7922d9d700 1 --2- 172.21.15.26:0/2446000183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7924131b40 0x7f79241cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:09.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.318+0000 7f7921d9b700 1 --2- 172.21.15.26:0/2446000183 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f792406b080 0x7f79241275e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f792406b830 tx=0x7f790c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:09.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.318+0000 7f791affd700 1 -- 172.21.15.26:0/2446000183 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790c00b070 con 0x7f792406b080 2023-10-01T08:00:09.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.319+0000 7f791affd700 1 -- 172.21.15.26:0/2446000183 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790c00d7c0 con 0x7f792406b080 2023-10-01T08:00:09.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.319+0000 7f792883a700 1 -- 172.21.15.26:0/2446000183 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f791c009b30 con 0x7f792406b080 2023-10-01T08:00:09.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.319+0000 7f791affd700 1 -- 172.21.15.26:0/2446000183 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790c0036a0 con 0x7f792406b080 2023-10-01T08:00:09.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.319+0000 7f792883a700 1 -- 172.21.15.26:0/2446000183 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f790c00d940 con 0x7f792406b080 2023-10-01T08:00:09.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.319+0000 7f791affd700 1 -- 172.21.15.26:0/2446000183 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f790c003800 con 0x7f792406b080 2023-10-01T08:00:09.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.319+0000 7f791affd700 1 -- 172.21.15.26:0/2446000183 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f790c03fd40 con 0x7f792406b080 2023-10-01T08:00:09.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.320+0000 7f792883a700 1 -- 172.21.15.26:0/2446000183 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7924129cb0 con 0x7f792406b080 2023-10-01T08:00:09.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.325+0000 7f791affd700 1 -- 172.21.15.26:0/2446000183 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7924129cb0 con 0x7f792406b080 2023-10-01T08:00:09.330 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:09.336 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:09.393 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:09.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.470+0000 7fbdfda5b700 1 Processor -- start 2023-10-01T08:00:09.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.470+0000 7fbdfda5b700 1 -- start start 2023-10-01T08:00:09.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.470+0000 7fbdfda5b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbdf80a0a30 0x7fbdf80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:09.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.470+0000 7fbdfda5b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdf8134170 0x7fbdf813bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:09.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.470+0000 7fbdfda5b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf809edd0 con 0x7fbdf80a1340 2023-10-01T08:00:09.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.470+0000 7fbdfda5b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf809e1f0 con 0x7fbdf80a0a30 2023-10-01T08:00:09.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.470+0000 7fbdfda5b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf809dc50 con 0x7fbdf8134170 2023-10-01T08:00:09.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.471+0000 7fbdf67fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbdf80a1340 0x7fbdf8133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48904/0 (socket says 172.21.15.26:48904) 2023-10-01T08:00:09.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.471+0000 7fbdf67fc700 1 -- 172.21.15.26:0/2892601456 learned_addr learned my addr 172.21.15.26:0/2892601456 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:09.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.471+0000 7fbdf6ffd700 1 --2- 172.21.15.26:0/2892601456 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbdf80a0a30 0x7fbdf80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:09.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.471+0000 7fbdf77fe700 1 --2- 172.21.15.26:0/2892601456 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdf8134170 0x7fbdf813bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:09.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.471+0000 7fbdf5ffb700 1 -- 172.21.15.26:0/2892601456 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2474671648 0 0) 0x7fbdf809edd0 con 0x7fbdf80a1340 2023-10-01T08:00:09.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.471+0000 7fbdf5ffb700 1 -- 172.21.15.26:0/2892601456 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbde00035b0 con 0x7fbdf80a1340 2023-10-01T08:00:09.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.471+0000 7fbdf77fe700 1 -- 172.21.15.26:0/2892601456 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbdf80a0a30 msgr2=0x7fbdf80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:09.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.471+0000 7fbdf77fe700 1 --2- 172.21.15.26:0/2892601456 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbdf80a0a30 0x7fbdf80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.471+0000 7fbdf77fe700 1 -- 172.21.15.26:0/2892601456 >> v1:172.21.15.26:6789/0 conn(0x7fbdf80a1340 legacy=0x7fbdf8133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:09.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.471+0000 7fbdf77fe700 1 -- 172.21.15.26:0/2892601456 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf80a1fe0 con 0x7fbdf8134170 2023-10-01T08:00:09.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.471+0000 7fbdf6ffd700 1 --2- 172.21.15.26:0/2892601456 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbdf80a0a30 0x7fbdf80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:09.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.471+0000 7fbdf77fe700 1 --2- 172.21.15.26:0/2892601456 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdf8134170 0x7fbdf813bd30 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0009dc0 tx=0x7fbdf000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b574c2a0b35b6cdc server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:09.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.472+0000 7fbdf5ffb700 1 -- 172.21.15.26:0/2892601456 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf000e070 con 0x7fbdf8134170 2023-10-01T08:00:09.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.472+0000 7fbdf5ffb700 1 -- 172.21.15.26:0/2892601456 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf000bb20 con 0x7fbdf8134170 2023-10-01T08:00:09.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.472+0000 7fbdf5ffb700 1 -- 172.21.15.26:0/2892601456 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0012430 con 0x7fbdf8134170 2023-10-01T08:00:09.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.472+0000 7fbdfda5b700 1 -- 172.21.15.26:0/2892601456 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdf8134170 msgr2=0x7fbdf813bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:09.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.472+0000 7fbdfda5b700 1 --2- 172.21.15.26:0/2892601456 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdf8134170 0x7fbdf813bd30 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0009dc0 tx=0x7fbdf000b330 comp rx=0 tx=0).stop 2023-10-01T08:00:09.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.473+0000 7fbdfda5b700 1 -- 172.21.15.26:0/2892601456 shutdown_connections 2023-10-01T08:00:09.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.473+0000 7fbdfda5b700 1 --2- 172.21.15.26:0/2892601456 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdf8134170 0x7fbdf813bd30 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.473+0000 7fbdfda5b700 1 --2- 172.21.15.26:0/2892601456 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbdf80a0a30 0x7fbdf80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.473+0000 7fbdfda5b700 1 -- 172.21.15.26:0/2892601456 >> 172.21.15.26:0/2892601456 conn(0x7fbdf80a6550 msgr2=0x7fbdf80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:09.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.473+0000 7fbdfda5b700 1 -- 172.21.15.26:0/2892601456 shutdown_connections 2023-10-01T08:00:09.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.473+0000 7fbdfda5b700 1 -- 172.21.15.26:0/2892601456 wait complete. 2023-10-01T08:00:09.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.474+0000 7fbdfda5b700 1 Processor -- start 2023-10-01T08:00:09.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.474+0000 7fbdfda5b700 1 -- start start 2023-10-01T08:00:09.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.474+0000 7fbdfda5b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdf80a0a30 0x7fbdf81c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:09.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.474+0000 7fbdfda5b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbdf80a1340 0x7fbdf81c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:09.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.475+0000 7fbdfda5b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdf8134170 0x7fbdf81c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:09.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.475+0000 7fbdfda5b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf8124810 con 0x7fbdf8134170 2023-10-01T08:00:09.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.475+0000 7fbdfda5b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf8124620 con 0x7fbdf80a1340 2023-10-01T08:00:09.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.475+0000 7fbdfda5b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf8126530 con 0x7fbdf80a0a30 2023-10-01T08:00:09.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.475+0000 7fbdf67fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbdf80a1340 0x7fbdf81c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:09.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.475+0000 7fbdf67fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbdf80a1340 0x7fbdf81c89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45010/0 (socket says 172.21.15.26:45010) 2023-10-01T08:00:09.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.475+0000 7fbdf67fc700 1 -- 172.21.15.26:0/1784652734 learned_addr learned my addr 172.21.15.26:0/1784652734 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:09.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.475+0000 7fbdf6ffd700 1 --2- 172.21.15.26:0/1784652734 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdf80a0a30 0x7fbdf81c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:09.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.475+0000 7fbdf77fe700 1 --2- 172.21.15.26:0/1784652734 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdf8134170 0x7fbdf81c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:09.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.475+0000 7fbdf6ffd700 1 -- 172.21.15.26:0/1784652734 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbdf80a1340 msgr2=0x7fbdf81c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:09.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.475+0000 7fbdf6ffd700 1 --2- 172.21.15.26:0/1784652734 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbdf80a1340 0x7fbdf81c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.475+0000 7fbdf6ffd700 1 -- 172.21.15.26:0/1784652734 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdf8134170 msgr2=0x7fbdf81c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:09.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.475+0000 7fbdf6ffd700 1 --2- 172.21.15.26:0/1784652734 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdf8134170 0x7fbdf81c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.475+0000 7fbdf6ffd700 1 -- 172.21.15.26:0/1784652734 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde80094a0 con 0x7fbdf80a0a30 2023-10-01T08:00:09.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.475+0000 7fbdf77fe700 1 --2- 172.21.15.26:0/1784652734 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdf8134170 0x7fbdf81c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T08:00:09.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.475+0000 7fbdf67fc700 1 --2- 172.21.15.26:0/1784652734 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbdf80a1340 0x7fbdf81c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:09.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.476+0000 7fbdf6ffd700 1 --2- 172.21.15.26:0/1784652734 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdf80a0a30 0x7fbdf81c84b0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fbde800e9b0 tx=0x7fbde800ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:09.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.476+0000 7fbddffff700 1 -- 172.21.15.26:0/1784652734 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde800c850 con 0x7fbdf80a0a30 2023-10-01T08:00:09.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.476+0000 7fbddffff700 1 -- 172.21.15.26:0/1784652734 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde800c9b0 con 0x7fbdf80a0a30 2023-10-01T08:00:09.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.476+0000 7fbddffff700 1 -- 172.21.15.26:0/1784652734 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde800cd60 con 0x7fbdf80a0a30 2023-10-01T08:00:09.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.476+0000 7fbdfda5b700 1 -- 172.21.15.26:0/1784652734 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf0009a70 con 0x7fbdf80a0a30 2023-10-01T08:00:09.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.476+0000 7fbdfda5b700 1 -- 172.21.15.26:0/1784652734 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf80a25e0 con 0x7fbdf80a0a30 2023-10-01T08:00:09.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.477+0000 7fbdfda5b700 1 -- 172.21.15.26:0/1784652734 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf80a0280 con 0x7fbdf80a0a30 2023-10-01T08:00:09.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.477+0000 7fbddffff700 1 -- 172.21.15.26:0/1784652734 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbde8013470 con 0x7fbdf80a0a30 2023-10-01T08:00:09.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.478+0000 7fbddffff700 1 -- 172.21.15.26:0/1784652734 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbde803fb30 con 0x7fbdf80a0a30 2023-10-01T08:00:09.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.486+0000 7fbddffff700 1 -- 172.21.15.26:0/1784652734 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbde801b3b0 con 0x7fbdf80a0a30 2023-10-01T08:00:09.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.520+0000 7f572f62c700 1 Processor -- start 2023-10-01T08:00:09.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.520+0000 7f572f62c700 1 -- start start 2023-10-01T08:00:09.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.521+0000 7f572f62c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f572809e930 0x7f572809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:09.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.521+0000 7f572f62c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f572809f240 0x7f57281317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:09.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.521+0000 7f572f62c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5728070940 con 0x7f572809f650 2023-10-01T08:00:09.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.521+0000 7f572f62c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572806fd60 con 0x7f572809e930 2023-10-01T08:00:09.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.521+0000 7f572f62c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f572806fa80 con 0x7f572809f240 2023-10-01T08:00:09.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.521+0000 7f572d3c8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f572809e930 0x7f572809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:09.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.521+0000 7f572d3c8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f572809e930 0x7f572809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45024/0 (socket says 172.21.15.26:45024) 2023-10-01T08:00:09.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.521+0000 7f572d3c8700 1 -- 172.21.15.26:0/1377212427 learned_addr learned my addr 172.21.15.26:0/1377212427 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:09.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.521+0000 7f572d3c8700 1 -- 172.21.15.26:0/1377212427 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f572809f240 msgr2=0x7f57281317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:09.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.521+0000 7f572cbc7700 1 --2- 172.21.15.26:0/1377212427 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f572809f240 0x7f57281317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:09.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.522+0000 7f572d3c8700 1 --2- 172.21.15.26:0/1377212427 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f572809f240 0x7f57281317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.522+0000 7f572d3c8700 1 -- 172.21.15.26:0/1377212427 >> v1:172.21.15.26:6789/0 conn(0x7f572809f650 legacy=0x7f5728131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:09.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.522+0000 7f571ffff700 1 -- 172.21.15.26:0/1377212427 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1531252169 0 0) 0x7f5728070940 con 0x7f572809f650 2023-10-01T08:00:09.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.522+0000 7f572d3c8700 1 -- 172.21.15.26:0/1377212427 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572809fb60 con 0x7f572809e930 2023-10-01T08:00:09.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.522+0000 7f572cbc7700 1 --2- 172.21.15.26:0/1377212427 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f572809f240 0x7f57281317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T08:00:09.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.522+0000 7f572d3c8700 1 --2- 172.21.15.26:0/1377212427 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f572809e930 0x7f572809ed00 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f5724009920 tx=0x7f5724009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28c87997602c596d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:09.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.522+0000 7f571ffff700 1 -- 172.21.15.26:0/1377212427 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572400ba60 con 0x7f572809e930 2023-10-01T08:00:09.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.522+0000 7f571ffff700 1 -- 172.21.15.26:0/1377212427 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572400bbc0 con 0x7f572809e930 2023-10-01T08:00:09.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.522+0000 7f571ffff700 1 -- 172.21.15.26:0/1377212427 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5724009e70 con 0x7f572809e930 2023-10-01T08:00:09.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.523+0000 7f572f62c700 1 -- 172.21.15.26:0/1377212427 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f572809e930 msgr2=0x7f572809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:09.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.523+0000 7f572f62c700 1 --2- 172.21.15.26:0/1377212427 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f572809e930 0x7f572809ed00 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f5724009920 tx=0x7f5724009c30 comp rx=0 tx=0).stop 2023-10-01T08:00:09.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.523+0000 7f572f62c700 1 -- 172.21.15.26:0/1377212427 shutdown_connections 2023-10-01T08:00:09.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.523+0000 7f572f62c700 1 --2- 172.21.15.26:0/1377212427 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f572809e930 0x7f572809ed00 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.523+0000 7f572f62c700 1 --2- 172.21.15.26:0/1377212427 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f572809f240 0x7f57281317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.523+0000 7f572f62c700 1 -- 172.21.15.26:0/1377212427 >> 172.21.15.26:0/1377212427 conn(0x7f57280a4210 msgr2=0x7f57280a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:09.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.523+0000 7f572f62c700 1 -- 172.21.15.26:0/1377212427 shutdown_connections 2023-10-01T08:00:09.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.523+0000 7f572f62c700 1 -- 172.21.15.26:0/1377212427 wait complete. 2023-10-01T08:00:09.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.525+0000 7f572f62c700 1 Processor -- start 2023-10-01T08:00:09.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.525+0000 7f572f62c700 1 -- start start 2023-10-01T08:00:09.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.525+0000 7f572f62c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f572809e930 0x7f57281c8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:09.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.525+0000 7f572f62c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f572809f240 0x7f57281c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:09.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.525+0000 7f572f62c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f572809f650 0x7f57281c4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:09.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.525+0000 7f572f62c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5728071d20 con 0x7f572809f240 2023-10-01T08:00:09.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.525+0000 7f572f62c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572806cd20 con 0x7f572809f650 2023-10-01T08:00:09.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.525+0000 7f572f62c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f57281c90a0 con 0x7f572809e930 2023-10-01T08:00:09.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.526+0000 7f572cbc7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f572809f240 0x7f57281c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:09.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.526+0000 7f572d3c8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f572809e930 0x7f57281c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:09.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.526+0000 7f572d3c8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f572809e930 0x7f57281c8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:38680/0 (socket says 172.21.15.26:38680) 2023-10-01T08:00:09.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.526+0000 7f572cbc7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f572809f240 0x7f57281c8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56890/0 (socket says 172.21.15.26:56890) 2023-10-01T08:00:09.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.526+0000 7f572d3c8700 1 -- 172.21.15.26:0/2792284615 learned_addr learned my addr 172.21.15.26:0/2792284615 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:09.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.526+0000 7f572dbc9700 1 --2- 172.21.15.26:0/2792284615 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f572809f650 0x7f57281c4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:09.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.526+0000 7f572cbc7700 1 -- 172.21.15.26:0/2792284615 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f572809e930 msgr2=0x7f57281c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:09.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.526+0000 7f572cbc7700 1 --2- 172.21.15.26:0/2792284615 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f572809e930 0x7f57281c8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.526+0000 7f572cbc7700 1 -- 172.21.15.26:0/2792284615 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f572809f650 msgr2=0x7f57281c4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:09.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.526+0000 7f572cbc7700 1 --2- 172.21.15.26:0/2792284615 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f572809f650 0x7f57281c4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.526+0000 7f572cbc7700 1 -- 172.21.15.26:0/2792284615 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5724009550 con 0x7f572809f240 2023-10-01T08:00:09.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.526+0000 7f572cbc7700 1 --2- 172.21.15.26:0/2792284615 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f572809f240 0x7f57281c8b60 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f571800c7c0 tx=0x7f571800cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:09.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.527+0000 7f571dffb700 1 -- 172.21.15.26:0/2792284615 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5718004290 con 0x7f572809f240 2023-10-01T08:00:09.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.527+0000 7f571dffb700 1 -- 172.21.15.26:0/2792284615 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57180043f0 con 0x7f572809f240 2023-10-01T08:00:09.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.527+0000 7f571dffb700 1 -- 172.21.15.26:0/2792284615 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57180038c0 con 0x7f572809f240 2023-10-01T08:00:09.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.527+0000 7f572f62c700 1 -- 172.21.15.26:0/2792284615 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57280a0190 con 0x7f572809f240 2023-10-01T08:00:09.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.527+0000 7f572f62c700 1 -- 172.21.15.26:0/2792284615 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57280a3240 con 0x7f572809f240 2023-10-01T08:00:09.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.528+0000 7f571dffb700 1 -- 172.21.15.26:0/2792284615 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5718003a20 con 0x7f572809f240 2023-10-01T08:00:09.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.528+0000 7f572f62c700 1 -- 172.21.15.26:0/2792284615 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57281a7f70 con 0x7f572809f240 2023-10-01T08:00:09.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.528+0000 7f571dffb700 1 -- 172.21.15.26:0/2792284615 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f571803f3a0 con 0x7f572809f240 2023-10-01T08:00:09.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.539+0000 7f571dffb700 1 -- 172.21.15.26:0/2792284615 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f57281a7f70 con 0x7f572809f240 2023-10-01T08:00:09.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.557+0000 7f792883a700 1 -- 172.21.15.26:0/2446000183 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7924129cb0 con 0x7f792406b080 2023-10-01T08:00:09.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.558+0000 7f791affd700 1 -- 172.21.15.26:0/2446000183 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7924129cb0 con 0x7f792406b080 2023-10-01T08:00:09.559 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:09.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.560+0000 7f792883a700 1 -- 172.21.15.26:0/2446000183 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f792406b080 msgr2=0x7f79241275e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:09.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.560+0000 7f792883a700 1 --2- 172.21.15.26:0/2446000183 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f792406b080 0x7f79241275e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f792406b830 tx=0x7f790c004750 comp rx=0 tx=0).stop 2023-10-01T08:00:09.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.560+0000 7f792883a700 1 -- 172.21.15.26:0/2446000183 shutdown_connections 2023-10-01T08:00:09.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.560+0000 7f792883a700 1 --2- 172.21.15.26:0/2446000183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7924131b40 0x7f79241cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.560+0000 7f792883a700 1 --2- 172.21.15.26:0/2446000183 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f792406a770 0x7f79241270a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.560+0000 7f792883a700 1 --2- 172.21.15.26:0/2446000183 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f792406b080 0x7f79241275e0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.560+0000 7f792883a700 1 -- 172.21.15.26:0/2446000183 >> 172.21.15.26:0/2446000183 conn(0x7f7924066f50 msgr2=0x7f79240a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:09.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.563+0000 7f792883a700 1 -- 172.21.15.26:0/2446000183 shutdown_connections 2023-10-01T08:00:09.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.563+0000 7f792883a700 1 -- 172.21.15.26:0/2446000183 wait complete. 2023-10-01T08:00:09.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.565+0000 7fa67fac6700 1 Processor -- start 2023-10-01T08:00:09.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.566+0000 7fa67fac6700 1 -- start start 2023-10-01T08:00:09.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.566+0000 7fa67fac6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa678134630 0x7fa678136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:09.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.566+0000 7fa67fac6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa678136f50 0x7fa678139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:09.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.566+0000 7fa67fac6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa67809b4f0 con 0x7fa678131810 2023-10-01T08:00:09.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.566+0000 7fa67fac6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6781313c0 con 0x7fa678136f50 2023-10-01T08:00:09.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.566+0000 7fa67fac6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa67806e8c0 con 0x7fa678134630 2023-10-01T08:00:09.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.566+0000 7fa67d061700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa678134630 0x7fa678136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:09.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.566+0000 7fa67d061700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa678134630 0x7fa678136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45046/0 (socket says 172.21.15.26:45046) 2023-10-01T08:00:09.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.566+0000 7fa67d061700 1 -- 172.21.15.26:0/2908760475 learned_addr learned my addr 172.21.15.26:0/2908760475 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:09.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.566+0000 7fa67e063700 1 --2- 172.21.15.26:0/2908760475 >> v2:172.21.15.26:3300/0 conn(0x7fa678136f50 0x7fa678139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:09.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.567+0000 7fa67d061700 1 -- 172.21.15.26:0/2908760475 >> v2:172.21.15.26:3300/0 conn(0x7fa678136f50 msgr2=0x7fa678139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:09.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.567+0000 7fa67d061700 1 --2- 172.21.15.26:0/2908760475 >> v2:172.21.15.26:3300/0 conn(0x7fa678136f50 0x7fa678139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.567+0000 7fa67d061700 1 -- 172.21.15.26:0/2908760475 >> v1:172.21.15.26:6789/0 conn(0x7fa678131810 legacy=0x7fa678131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:09.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.567+0000 7fa67d061700 1 -- 172.21.15.26:0/2908760475 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa678071d20 con 0x7fa678134630 2023-10-01T08:00:09.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.567+0000 7fa67d061700 1 --2- 172.21.15.26:0/2908760475 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa678134630 0x7fa678136a10 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fa6680098f0 tx=0x7fa668009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=890a4c0361e21ba0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:09.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.567+0000 7fa67c860700 1 -- 172.21.15.26:0/2908760475 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa668011830 con 0x7fa678134630 2023-10-01T08:00:09.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.567+0000 7fa67c860700 1 -- 172.21.15.26:0/2908760475 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa668011990 con 0x7fa678134630 2023-10-01T08:00:09.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.567+0000 7fa67c860700 1 -- 172.21.15.26:0/2908760475 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa668011d20 con 0x7fa678134630 2023-10-01T08:00:09.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.568+0000 7fa67fac6700 1 -- 172.21.15.26:0/2908760475 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa678134630 msgr2=0x7fa678136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:09.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.568+0000 7fa67fac6700 1 --2- 172.21.15.26:0/2908760475 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa678134630 0x7fa678136a10 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fa6680098f0 tx=0x7fa668009c00 comp rx=0 tx=0).stop 2023-10-01T08:00:09.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.568+0000 7fa67fac6700 1 -- 172.21.15.26:0/2908760475 shutdown_connections 2023-10-01T08:00:09.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.568+0000 7fa67fac6700 1 --2- 172.21.15.26:0/2908760475 >> v2:172.21.15.26:3300/0 conn(0x7fa678136f50 0x7fa678139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.568+0000 7fa67fac6700 1 --2- 172.21.15.26:0/2908760475 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa678134630 0x7fa678136a10 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.568+0000 7fa67fac6700 1 -- 172.21.15.26:0/2908760475 >> 172.21.15.26:0/2908760475 conn(0x7fa6780a2aa0 msgr2=0x7fa6780a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:09.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.568+0000 7fa67fac6700 1 -- 172.21.15.26:0/2908760475 shutdown_connections 2023-10-01T08:00:09.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.568+0000 7fa67fac6700 1 -- 172.21.15.26:0/2908760475 wait complete. 2023-10-01T08:00:09.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.569+0000 7fa67fac6700 1 Processor -- start 2023-10-01T08:00:09.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.569+0000 7fa67fac6700 1 -- start start 2023-10-01T08:00:09.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.570+0000 7fa67fac6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa678131810 0x7fa6781c6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:09.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.570+0000 7fa67fac6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa678134630 0x7fa6781c6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:09.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.570+0000 7fa67fac6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa678136f50 0x7fa6781c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:09.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.570+0000 7fa67fac6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67811b6b0 con 0x7fa678131810 2023-10-01T08:00:09.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.570+0000 7fa67fac6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa67811abc0 con 0x7fa678136f50 2023-10-01T08:00:09.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.570+0000 7fa67fac6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa67811b2a0 con 0x7fa678134630 2023-10-01T08:00:09.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.570+0000 7fa67e063700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa678136f50 0x7fa6781c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:09.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.570+0000 7fa67d061700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa678134630 0x7fa6781c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:09.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.570+0000 7fa67e063700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa678136f50 0x7fa6781c6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45050/0 (socket says 172.21.15.26:45050) 2023-10-01T08:00:09.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.570+0000 7fa67d061700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa678134630 0x7fa6781c6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:38682/0 (socket says 172.21.15.26:38682) 2023-10-01T08:00:09.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.570+0000 7fa67e063700 1 -- 172.21.15.26:0/2645241885 learned_addr learned my addr 172.21.15.26:0/2645241885 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:09.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.570+0000 7fa67d862700 1 --2- 172.21.15.26:0/2645241885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa678131810 0x7fa6781c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:09.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.571+0000 7fa67d862700 1 -- 172.21.15.26:0/2645241885 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa678134630 msgr2=0x7fa6781c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:09.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.571+0000 7fa67d862700 1 --2- 172.21.15.26:0/2645241885 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa678134630 0x7fa6781c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.571+0000 7fa67d862700 1 -- 172.21.15.26:0/2645241885 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa678136f50 msgr2=0x7fa6781c6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:09.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.571+0000 7fa67d862700 1 --2- 172.21.15.26:0/2645241885 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa678136f50 0x7fa6781c6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.571+0000 7fa67d862700 1 -- 172.21.15.26:0/2645241885 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa668009550 con 0x7fa678131810 2023-10-01T08:00:09.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.571+0000 7fa67d061700 1 --2- 172.21.15.26:0/2645241885 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa678134630 0x7fa6781c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:09.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.571+0000 7fa67d862700 1 --2- 172.21.15.26:0/2645241885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa678131810 0x7fa6781c6140 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fa67400c400 tx=0x7fa67400c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:09.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.571+0000 7fa66e7fc700 1 -- 172.21.15.26:0/2645241885 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6740052d0 con 0x7fa678131810 2023-10-01T08:00:09.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.571+0000 7fa66e7fc700 1 -- 172.21.15.26:0/2645241885 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa674005430 con 0x7fa678131810 2023-10-01T08:00:09.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.571+0000 7fa67fac6700 1 -- 172.21.15.26:0/2645241885 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa67811c950 con 0x7fa678131810 2023-10-01T08:00:09.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.571+0000 7fa66e7fc700 1 -- 172.21.15.26:0/2645241885 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6740038a0 con 0x7fa678131810 2023-10-01T08:00:09.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.571+0000 7fa67fac6700 1 -- 172.21.15.26:0/2645241885 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa67811c670 con 0x7fa678131810 2023-10-01T08:00:09.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.573+0000 7fa67fac6700 1 -- 172.21.15.26:0/2645241885 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa678074ea0 con 0x7fa678131810 2023-10-01T08:00:09.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.573+0000 7fa66e7fc700 1 -- 172.21.15.26:0/2645241885 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa674003a00 con 0x7fa678131810 2023-10-01T08:00:09.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.573+0000 7fa66e7fc700 1 -- 172.21.15.26:0/2645241885 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa67403ed70 con 0x7fa678131810 2023-10-01T08:00:09.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.578+0000 7fa66e7fc700 1 -- 172.21.15.26:0/2645241885 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa674019d20 con 0x7fa678131810 2023-10-01T08:00:09.587 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:09.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.725+0000 7fbdfda5b700 1 -- 172.21.15.26:0/1784652734 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbdf8125ef0 con 0x7fbdf80a0a30 2023-10-01T08:00:09.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.725+0000 7fbddffff700 1 -- 172.21.15.26:0/1784652734 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbde8011b00 con 0x7fbdf80a0a30 2023-10-01T08:00:09.727 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:09.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.728+0000 7fbdfda5b700 1 -- 172.21.15.26:0/1784652734 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdf80a0a30 msgr2=0x7fbdf81c84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:09.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.728+0000 7fbdfda5b700 1 --2- 172.21.15.26:0/1784652734 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdf80a0a30 0x7fbdf81c84b0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fbde800e9b0 tx=0x7fbde800ecc0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.728+0000 7fbdfda5b700 1 -- 172.21.15.26:0/1784652734 shutdown_connections 2023-10-01T08:00:09.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.728+0000 7fbdfda5b700 1 --2- 172.21.15.26:0/1784652734 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbdf8134170 0x7fbdf81c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.728+0000 7fbdfda5b700 1 --2- 172.21.15.26:0/1784652734 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbdf80a0a30 0x7fbdf81c84b0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.728+0000 7fbdfda5b700 1 --2- 172.21.15.26:0/1784652734 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbdf80a1340 0x7fbdf81c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.728+0000 7fbdfda5b700 1 -- 172.21.15.26:0/1784652734 >> 172.21.15.26:0/1784652734 conn(0x7fbdf80a6550 msgr2=0x7fbdf809c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:09.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.728+0000 7fbdfda5b700 1 -- 172.21.15.26:0/1784652734 shutdown_connections 2023-10-01T08:00:09.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.728+0000 7fbdfda5b700 1 -- 172.21.15.26:0/1784652734 wait complete. 2023-10-01T08:00:09.744 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:09.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.764+0000 7f572f62c700 1 -- 172.21.15.26:0/2792284615 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f57281a7f70 con 0x7f572809f240 2023-10-01T08:00:09.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.765+0000 7f571dffb700 1 -- 172.21.15.26:0/2792284615 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f57281a7f70 con 0x7f572809f240 2023-10-01T08:00:09.766 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:09.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.767+0000 7f572f62c700 1 -- 172.21.15.26:0/2792284615 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f572809f240 msgr2=0x7f57281c8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:09.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.767+0000 7f572f62c700 1 --2- 172.21.15.26:0/2792284615 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f572809f240 0x7f57281c8b60 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f571800c7c0 tx=0x7f571800cad0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.767+0000 7f572f62c700 1 -- 172.21.15.26:0/2792284615 shutdown_connections 2023-10-01T08:00:09.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.767+0000 7f572f62c700 1 --2- 172.21.15.26:0/2792284615 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f572809f650 0x7f57281c4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.767+0000 7f572f62c700 1 --2- 172.21.15.26:0/2792284615 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f572809e930 0x7f57281c8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.767+0000 7f572f62c700 1 --2- 172.21.15.26:0/2792284615 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f572809f240 0x7f57281c8b60 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.767+0000 7f572f62c700 1 -- 172.21.15.26:0/2792284615 >> 172.21.15.26:0/2792284615 conn(0x7f57280a4210 msgr2=0x7f57281b9820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:09.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.767+0000 7f572f62c700 1 -- 172.21.15.26:0/2792284615 shutdown_connections 2023-10-01T08:00:09.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.767+0000 7f572f62c700 1 -- 172.21.15.26:0/2792284615 wait complete. 2023-10-01T08:00:09.782 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:09.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.798+0000 7fa67fac6700 1 -- 172.21.15.26:0/2645241885 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa67806b9e0 con 0x7fa678131810 2023-10-01T08:00:09.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.799+0000 7fa66e7fc700 1 -- 172.21.15.26:0/2645241885 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa674017030 con 0x7fa678131810 2023-10-01T08:00:09.800 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:09.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.801+0000 7fa67fac6700 1 -- 172.21.15.26:0/2645241885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa678131810 msgr2=0x7fa6781c6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:09.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.801+0000 7fa67fac6700 1 --2- 172.21.15.26:0/2645241885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa678131810 0x7fa6781c6140 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fa67400c400 tx=0x7fa67400c710 comp rx=0 tx=0).stop 2023-10-01T08:00:09.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.801+0000 7fa67fac6700 1 -- 172.21.15.26:0/2645241885 shutdown_connections 2023-10-01T08:00:09.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.801+0000 7fa67fac6700 1 --2- 172.21.15.26:0/2645241885 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa678136f50 0x7fa6781c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.801+0000 7fa67fac6700 1 --2- 172.21.15.26:0/2645241885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa678131810 0x7fa6781c6140 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.801+0000 7fa67fac6700 1 --2- 172.21.15.26:0/2645241885 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa678134630 0x7fa6781c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:09.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.801+0000 7fa67fac6700 1 -- 172.21.15.26:0/2645241885 >> 172.21.15.26:0/2645241885 conn(0x7fa6780a2aa0 msgr2=0x7fa6781331f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:09.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.801+0000 7fa67fac6700 1 -- 172.21.15.26:0/2645241885 shutdown_connections 2023-10-01T08:00:09.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:09.801+0000 7fa67fac6700 1 -- 172.21.15.26:0/2645241885 wait complete. 2023-10-01T08:00:09.816 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:10.587 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:10.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.733+0000 7f832efe1700 1 Processor -- start 2023-10-01T08:00:10.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.733+0000 7f832efe1700 1 -- start start 2023-10-01T08:00:10.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.734+0000 7f832efe1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f832809e930 0x7f832809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:10.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.734+0000 7f832efe1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f832809f240 0x7f83281317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:10.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.734+0000 7f832efe1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8328070940 con 0x7f832809f650 2023-10-01T08:00:10.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.734+0000 7f832efe1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f832806fd60 con 0x7f832809e930 2023-10-01T08:00:10.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.734+0000 7f832efe1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832806fa80 con 0x7f832809f240 2023-10-01T08:00:10.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.734+0000 7f8327fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f832809f240 0x7f83281317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:10.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.734+0000 7f832cd7d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f832809e930 0x7f832809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:10.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.734+0000 7f8327fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f832809f240 0x7f83281317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45066/0 (socket says 172.21.15.26:45066) 2023-10-01T08:00:10.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.734+0000 7f832cd7d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f832809e930 0x7f832809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56914/0 (socket says 172.21.15.26:56914) 2023-10-01T08:00:10.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.734+0000 7f8327fff700 1 -- 172.21.15.26:0/2982370415 learned_addr learned my addr 172.21.15.26:0/2982370415 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:10.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.734+0000 7f8327fff700 1 -- 172.21.15.26:0/2982370415 >> v2:172.21.15.26:3300/0 conn(0x7f832809e930 msgr2=0x7f832809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:10.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.734+0000 7f8327fff700 1 --2- 172.21.15.26:0/2982370415 >> v2:172.21.15.26:3300/0 conn(0x7f832809e930 0x7f832809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:10.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.734+0000 7f8327fff700 1 -- 172.21.15.26:0/2982370415 >> v1:172.21.15.26:6789/0 conn(0x7f832809f650 legacy=0x7f8328131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:10.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.734+0000 7f8327fff700 1 -- 172.21.15.26:0/2982370415 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832809fb60 con 0x7f832809f240 2023-10-01T08:00:10.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.734+0000 7f832cd7d700 1 --2- 172.21.15.26:0/2982370415 >> v2:172.21.15.26:3300/0 conn(0x7f832809e930 0x7f832809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:10.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.734+0000 7f8327fff700 1 --2- 172.21.15.26:0/2982370415 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f832809f240 0x7f83281317f0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f83100098f0 tx=0x7f8310009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba1fde599c012020 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:10.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.735+0000 7f83277fe700 1 -- 172.21.15.26:0/2982370415 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8310011830 con 0x7f832809f240 2023-10-01T08:00:10.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.735+0000 7f83277fe700 1 -- 172.21.15.26:0/2982370415 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8310011990 con 0x7f832809f240 2023-10-01T08:00:10.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.735+0000 7f83277fe700 1 -- 172.21.15.26:0/2982370415 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8310011d20 con 0x7f832809f240 2023-10-01T08:00:10.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.735+0000 7f832efe1700 1 -- 172.21.15.26:0/2982370415 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f832809f240 msgr2=0x7f83281317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:10.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.735+0000 7f832efe1700 1 --2- 172.21.15.26:0/2982370415 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f832809f240 0x7f83281317f0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f83100098f0 tx=0x7f8310009c00 comp rx=0 tx=0).stop 2023-10-01T08:00:10.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.735+0000 7f832efe1700 1 -- 172.21.15.26:0/2982370415 shutdown_connections 2023-10-01T08:00:10.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.735+0000 7f832efe1700 1 --2- 172.21.15.26:0/2982370415 >> v2:172.21.15.26:3300/0 conn(0x7f832809e930 0x7f832809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:10.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.735+0000 7f832efe1700 1 --2- 172.21.15.26:0/2982370415 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f832809f240 0x7f83281317f0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:10.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.735+0000 7f832efe1700 1 -- 172.21.15.26:0/2982370415 >> 172.21.15.26:0/2982370415 conn(0x7f83280a4210 msgr2=0x7f83280a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:10.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.735+0000 7f832efe1700 1 -- 172.21.15.26:0/2982370415 shutdown_connections 2023-10-01T08:00:10.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.735+0000 7f832efe1700 1 -- 172.21.15.26:0/2982370415 wait complete. 2023-10-01T08:00:10.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.736+0000 7f832efe1700 1 Processor -- start 2023-10-01T08:00:10.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.736+0000 7f832efe1700 1 -- start start 2023-10-01T08:00:10.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.737+0000 7f832efe1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f832809e930 0x7f832806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:10.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.737+0000 7f832efe1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f832809f240 0x7f832806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:10.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.737+0000 7f832efe1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f832809f650 0x7f832806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:10.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.737+0000 7f832efe1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83281ab110 con 0x7f832809f650 2023-10-01T08:00:10.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.737+0000 7f832efe1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83280a34f0 con 0x7f832809e930 2023-10-01T08:00:10.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.737+0000 7f832efe1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8328071d20 con 0x7f832809f240 2023-10-01T08:00:10.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.737+0000 7f832cd7d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f832809e930 0x7f832806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:10.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.737+0000 7f832cd7d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f832809e930 0x7f832806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45068/0 (socket says 172.21.15.26:45068) 2023-10-01T08:00:10.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.737+0000 7f832cd7d700 1 -- 172.21.15.26:0/3763541218 learned_addr learned my addr 172.21.15.26:0/3763541218 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:10.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.737+0000 7f832d57e700 1 --2- 172.21.15.26:0/3763541218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f832809f650 0x7f832806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:10.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.737+0000 7f8327fff700 1 --2- 172.21.15.26:0/3763541218 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f832809f240 0x7f832806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:10.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.738+0000 7f832cd7d700 1 -- 172.21.15.26:0/3763541218 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f832809f240 msgr2=0x7f832806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:10.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.738+0000 7f832cd7d700 1 --2- 172.21.15.26:0/3763541218 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f832809f240 0x7f832806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:10.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.738+0000 7f832cd7d700 1 -- 172.21.15.26:0/3763541218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f832809f650 msgr2=0x7f832806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:10.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.738+0000 7f832cd7d700 1 --2- 172.21.15.26:0/3763541218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f832809f650 0x7f832806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:10.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.738+0000 7f832cd7d700 1 -- 172.21.15.26:0/3763541218 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83180094a0 con 0x7f832809e930 2023-10-01T08:00:10.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.738+0000 7f832cd7d700 1 --2- 172.21.15.26:0/3763541218 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f832809e930 0x7f832806b8b0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f831800ebe0 tx=0x7f831800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:10.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.738+0000 7f83257fa700 1 -- 172.21.15.26:0/3763541218 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831800c850 con 0x7f832809e930 2023-10-01T08:00:10.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.738+0000 7f83257fa700 1 -- 172.21.15.26:0/3763541218 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831800c9b0 con 0x7f832809e930 2023-10-01T08:00:10.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.738+0000 7f832efe1700 1 -- 172.21.15.26:0/3763541218 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8310009550 con 0x7f832809e930 2023-10-01T08:00:10.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.738+0000 7f83257fa700 1 -- 172.21.15.26:0/3763541218 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831800cd40 con 0x7f832809e930 2023-10-01T08:00:10.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.738+0000 7f832efe1700 1 -- 172.21.15.26:0/3763541218 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83280a0190 con 0x7f832809e930 2023-10-01T08:00:10.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.739+0000 7f83257fa700 1 -- 172.21.15.26:0/3763541218 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8318013470 con 0x7f832809e930 2023-10-01T08:00:10.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.739+0000 7f83257fa700 1 -- 172.21.15.26:0/3763541218 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f831803fb50 con 0x7f832809e930 2023-10-01T08:00:10.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.739+0000 7f832efe1700 1 -- 172.21.15.26:0/3763541218 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83281a2b40 con 0x7f832809e930 2023-10-01T08:00:10.744 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:10.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.744+0000 7f83257fa700 1 -- 172.21.15.26:0/3763541218 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8318013720 con 0x7f832809e930 2023-10-01T08:00:10.784 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:10.817 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:10.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.888+0000 7f0fb71a3700 1 Processor -- start 2023-10-01T08:00:10.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.888+0000 7f0fb71a3700 1 -- start start 2023-10-01T08:00:10.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.889+0000 7f0fb71a3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0fb009d6f0 0x7f0fb009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:10.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.889+0000 7f0fb71a3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0fb009e410 0x7f0fb0130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:10.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.889+0000 7f0fb71a3700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fb009f130 con 0x7f0fb009e000 2023-10-01T08:00:10.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.889+0000 7f0fb71a3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fb009f520 con 0x7f0fb009d6f0 2023-10-01T08:00:10.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.889+0000 7f0fb71a3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb009e930 con 0x7f0fb009e410 2023-10-01T08:00:10.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.889+0000 7f0fb5740700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0fb009e410 0x7f0fb0130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:10.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.889+0000 7f0faffff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0fb009e000 0x7f0fb0130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48940/0 (socket says 172.21.15.26:48940) 2023-10-01T08:00:10.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.889+0000 7f0faffff700 1 -- 172.21.15.26:0/1756587224 learned_addr learned my addr 172.21.15.26:0/1756587224 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:10.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.889+0000 7f0fb4f3f700 1 --2- 172.21.15.26:0/1756587224 >> v2:172.21.15.26:3300/0 conn(0x7f0fb009d6f0 0x7f0fb009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:10.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.890+0000 7f0faf7fe700 1 -- 172.21.15.26:0/1756587224 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 733004475 0 0) 0x7f0fb009f130 con 0x7f0fb009e000 2023-10-01T08:00:10.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.890+0000 7f0faf7fe700 1 -- 172.21.15.26:0/1756587224 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fa00035b0 con 0x7f0fb009e000 2023-10-01T08:00:10.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.890+0000 7f0fb5740700 1 -- 172.21.15.26:0/1756587224 >> v2:172.21.15.26:3300/0 conn(0x7f0fb009d6f0 msgr2=0x7f0fb009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:10.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.890+0000 7f0fb5740700 1 --2- 172.21.15.26:0/1756587224 >> v2:172.21.15.26:3300/0 conn(0x7f0fb009d6f0 0x7f0fb009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:10.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.890+0000 7f0fb5740700 1 -- 172.21.15.26:0/1756587224 >> v1:172.21.15.26:6789/0 conn(0x7f0fb009e000 legacy=0x7f0fb0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:10.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.890+0000 7f0fb5740700 1 -- 172.21.15.26:0/1756587224 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb009b2d0 con 0x7f0fb009e410 2023-10-01T08:00:10.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.890+0000 7f0fb5740700 1 --2- 172.21.15.26:0/1756587224 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0fb009e410 0x7f0fb0130d70 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8009d90 tx=0x7f0fa800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bb7111610ab8d37 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:10.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.890+0000 7f0faf7fe700 1 -- 172.21.15.26:0/1756587224 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa800e070 con 0x7f0fb009e410 2023-10-01T08:00:10.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.890+0000 7f0faf7fe700 1 -- 172.21.15.26:0/1756587224 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa800bb20 con 0x7f0fb009e410 2023-10-01T08:00:10.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.890+0000 7f0faf7fe700 1 -- 172.21.15.26:0/1756587224 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa800be90 con 0x7f0fb009e410 2023-10-01T08:00:10.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.891+0000 7f0fb71a3700 1 -- 172.21.15.26:0/1756587224 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0fb009e410 msgr2=0x7f0fb0130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:10.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.891+0000 7f0fb71a3700 1 --2- 172.21.15.26:0/1756587224 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0fb009e410 0x7f0fb0130d70 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8009d90 tx=0x7f0fa800b330 comp rx=0 tx=0).stop 2023-10-01T08:00:10.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.891+0000 7f0fb71a3700 1 -- 172.21.15.26:0/1756587224 shutdown_connections 2023-10-01T08:00:10.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.891+0000 7f0fb71a3700 1 --2- 172.21.15.26:0/1756587224 >> v2:172.21.15.26:3300/0 conn(0x7f0fb009d6f0 0x7f0fb009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:10.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.891+0000 7f0fb71a3700 1 --2- 172.21.15.26:0/1756587224 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0fb009e410 0x7f0fb0130d70 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:10.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.891+0000 7f0fb71a3700 1 -- 172.21.15.26:0/1756587224 >> 172.21.15.26:0/1756587224 conn(0x7f0fb0066f50 msgr2=0x7f0fb009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:10.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.891+0000 7f0fb71a3700 1 -- 172.21.15.26:0/1756587224 shutdown_connections 2023-10-01T08:00:10.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.891+0000 7f0fb71a3700 1 -- 172.21.15.26:0/1756587224 wait complete. 2023-10-01T08:00:10.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.892+0000 7f0fb71a3700 1 Processor -- start 2023-10-01T08:00:10.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.893+0000 7f0fb71a3700 1 -- start start 2023-10-01T08:00:10.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.893+0000 7f0fb71a3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fb009d6f0 0x7f0fb0139970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:10.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.893+0000 7f0fb71a3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0fb009e000 0x7f0fb0139eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:10.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.893+0000 7f0fb71a3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0fb009e410 0x7f0fb013a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:10.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.893+0000 7f0fb71a3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb0136b20 con 0x7f0fb009d6f0 2023-10-01T08:00:10.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.893+0000 7f0fb71a3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb0138d20 con 0x7f0fb009e000 2023-10-01T08:00:10.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.893+0000 7f0fb71a3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb0138140 con 0x7f0fb009e410 2023-10-01T08:00:10.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.893+0000 7f0fb4f3f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fb009d6f0 0x7f0fb0139970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:10.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.894+0000 7f0fb4f3f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fb009d6f0 0x7f0fb0139970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56942/0 (socket says 172.21.15.26:56942) 2023-10-01T08:00:10.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.894+0000 7f0fb4f3f700 1 -- 172.21.15.26:0/1810303724 learned_addr learned my addr 172.21.15.26:0/1810303724 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:10.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.894+0000 7f0faffff700 1 --2- 172.21.15.26:0/1810303724 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0fb009e000 0x7f0fb0139eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:10.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.894+0000 7f0fb5740700 1 --2- 172.21.15.26:0/1810303724 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0fb009e410 0x7f0fb013a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:10.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.894+0000 7f0faffff700 1 -- 172.21.15.26:0/1810303724 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0fb009e410 msgr2=0x7f0fb013a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:10.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.894+0000 7f0faffff700 1 --2- 172.21.15.26:0/1810303724 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0fb009e410 0x7f0fb013a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:10.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.894+0000 7f0faffff700 1 -- 172.21.15.26:0/1810303724 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fb009d6f0 msgr2=0x7f0fb0139970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:10.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.894+0000 7f0faffff700 1 --2- 172.21.15.26:0/1810303724 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fb009d6f0 0x7f0fb0139970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:10.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.894+0000 7f0faffff700 1 -- 172.21.15.26:0/1810303724 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa8009a70 con 0x7f0fb009e000 2023-10-01T08:00:10.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.894+0000 7f0faffff700 1 --2- 172.21.15.26:0/1810303724 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0fb009e000 0x7f0fb0139eb0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c00c490 tx=0x7f0f9c00c7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:10.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.895+0000 7f0fad7fa700 1 -- 172.21.15.26:0/1810303724 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c005d70 con 0x7f0fb009e000 2023-10-01T08:00:10.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.895+0000 7f0fad7fa700 1 -- 172.21.15.26:0/1810303724 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9c0070d0 con 0x7f0fb009e000 2023-10-01T08:00:10.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.895+0000 7f0fb71a3700 1 -- 172.21.15.26:0/1810303724 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fb00a39f0 con 0x7f0fb009e000 2023-10-01T08:00:10.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.895+0000 7f0fad7fa700 1 -- 172.21.15.26:0/1810303724 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c007440 con 0x7f0fb009e000 2023-10-01T08:00:10.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.895+0000 7f0fb71a3700 1 -- 172.21.15.26:0/1810303724 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb0137e60 con 0x7f0fb009e000 2023-10-01T08:00:10.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.896+0000 7f0fb71a3700 1 -- 172.21.15.26:0/1810303724 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fb0132db0 con 0x7f0fb009e000 2023-10-01T08:00:10.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.896+0000 7f0fad7fa700 1 -- 172.21.15.26:0/1810303724 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f9c0075a0 con 0x7f0fb009e000 2023-10-01T08:00:10.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.896+0000 7f0fad7fa700 1 -- 172.21.15.26:0/1810303724 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0f9c03eb00 con 0x7f0fb009e000 2023-10-01T08:00:10.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.905+0000 7f0fad7fa700 1 -- 172.21.15.26:0/1810303724 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f9c01bb10 con 0x7f0fb009e000 2023-10-01T08:00:10.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.932+0000 7f45b2acb700 1 Processor -- start 2023-10-01T08:00:10.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.932+0000 7f45b2acb700 1 -- start start 2023-10-01T08:00:10.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.932+0000 7f45b2acb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45ac09d6f0 0x7f45ac09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:10.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.932+0000 7f45b2acb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f45ac09e410 0x7f45ac130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:10.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.932+0000 7f45b2acb700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45ac09f130 con 0x7f45ac09e000 2023-10-01T08:00:10.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.932+0000 7f45b2acb700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45ac09f520 con 0x7f45ac09e410 2023-10-01T08:00:10.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.932+0000 7f45b2acb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac09e930 con 0x7f45ac09d6f0 2023-10-01T08:00:10.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.933+0000 7f45abfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f45ac09e000 0x7f45ac130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48950/0 (socket says 172.21.15.26:48950) 2023-10-01T08:00:10.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.933+0000 7f45abfff700 1 -- 172.21.15.26:0/946029594 learned_addr learned my addr 172.21.15.26:0/946029594 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:10.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.933+0000 7f45b0867700 1 --2- 172.21.15.26:0/946029594 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45ac09d6f0 0x7f45ac09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:10.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.933+0000 7f45b1068700 1 --2- 172.21.15.26:0/946029594 >> v2:172.21.15.26:3300/0 conn(0x7f45ac09e410 0x7f45ac130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:10.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.933+0000 7f45ab7fe700 1 -- 172.21.15.26:0/946029594 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1071133957 0 0) 0x7f45ac09f130 con 0x7f45ac09e000 2023-10-01T08:00:10.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.933+0000 7f45b0867700 1 -- 172.21.15.26:0/946029594 >> v2:172.21.15.26:3300/0 conn(0x7f45ac09e410 msgr2=0x7f45ac130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:10.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.933+0000 7f45b0867700 1 --2- 172.21.15.26:0/946029594 >> v2:172.21.15.26:3300/0 conn(0x7f45ac09e410 0x7f45ac130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:10.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.933+0000 7f45b0867700 1 -- 172.21.15.26:0/946029594 >> v1:172.21.15.26:6789/0 conn(0x7f45ac09e000 legacy=0x7f45ac130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:10.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.933+0000 7f45b0867700 1 -- 172.21.15.26:0/946029594 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ac09b2d0 con 0x7f45ac09d6f0 2023-10-01T08:00:10.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.934+0000 7f45b0867700 1 --2- 172.21.15.26:0/946029594 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45ac09d6f0 0x7f45ac09dac0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f45a0009840 tx=0x7f45a0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a13776d7fbdea8d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:10.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.934+0000 7f45ab7fe700 1 -- 172.21.15.26:0/946029594 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a000f8a0 con 0x7f45ac09d6f0 2023-10-01T08:00:10.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.934+0000 7f45ab7fe700 1 -- 172.21.15.26:0/946029594 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a000fa00 con 0x7f45ac09d6f0 2023-10-01T08:00:10.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.934+0000 7f45ab7fe700 1 -- 172.21.15.26:0/946029594 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a000fd90 con 0x7f45ac09d6f0 2023-10-01T08:00:10.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.934+0000 7f45b2acb700 1 -- 172.21.15.26:0/946029594 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45ac09d6f0 msgr2=0x7f45ac09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:10.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.934+0000 7f45b2acb700 1 --2- 172.21.15.26:0/946029594 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45ac09d6f0 0x7f45ac09dac0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f45a0009840 tx=0x7f45a0009b50 comp rx=0 tx=0).stop 2023-10-01T08:00:10.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.935+0000 7f45b2acb700 1 -- 172.21.15.26:0/946029594 shutdown_connections 2023-10-01T08:00:10.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.935+0000 7f45b2acb700 1 --2- 172.21.15.26:0/946029594 >> v2:172.21.15.26:3300/0 conn(0x7f45ac09e410 0x7f45ac130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:10.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.935+0000 7f45b2acb700 1 --2- 172.21.15.26:0/946029594 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45ac09d6f0 0x7f45ac09dac0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:10.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.935+0000 7f45b2acb700 1 -- 172.21.15.26:0/946029594 >> 172.21.15.26:0/946029594 conn(0x7f45ac066f50 msgr2=0x7f45ac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:10.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.935+0000 7f45b2acb700 1 -- 172.21.15.26:0/946029594 shutdown_connections 2023-10-01T08:00:10.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.935+0000 7f45b2acb700 1 -- 172.21.15.26:0/946029594 wait complete. 2023-10-01T08:00:10.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.936+0000 7f45b2acb700 1 Processor -- start 2023-10-01T08:00:10.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.936+0000 7f45b2acb700 1 -- start start 2023-10-01T08:00:10.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.936+0000 7f45b2acb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45ac09d6f0 0x7f45ac1222b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:10.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.936+0000 7f45b2acb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45ac09e000 0x7f45ac1227f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:10.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.936+0000 7f45b2acb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45ac09e410 0x7f45ac122d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:10.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.936+0000 7f45b2acb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac125830 con 0x7f45ac09e410 2023-10-01T08:00:10.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.936+0000 7f45b2acb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac125dd0 con 0x7f45ac09e000 2023-10-01T08:00:10.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.936+0000 7f45b2acb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac1246e0 con 0x7f45ac09d6f0 2023-10-01T08:00:10.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.937+0000 7f45b1068700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45ac09e410 0x7f45ac122d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:10.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.937+0000 7f45b1068700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45ac09e410 0x7f45ac122d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56958/0 (socket says 172.21.15.26:56958) 2023-10-01T08:00:10.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.937+0000 7f45b1068700 1 -- 172.21.15.26:0/1388937757 learned_addr learned my addr 172.21.15.26:0/1388937757 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:10.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.937+0000 7f45b0867700 1 --2- 172.21.15.26:0/1388937757 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45ac09d6f0 0x7f45ac1222b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:10.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.937+0000 7f45b1068700 1 -- 172.21.15.26:0/1388937757 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45ac09d6f0 msgr2=0x7f45ac1222b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:10.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.937+0000 7f45b1068700 1 --2- 172.21.15.26:0/1388937757 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45ac09d6f0 0x7f45ac1222b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:10.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.937+0000 7f45b1068700 1 -- 172.21.15.26:0/1388937757 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45ac09e000 msgr2=0x7f45ac1227f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:10.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.937+0000 7f45b1068700 1 --2- 172.21.15.26:0/1388937757 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45ac09e000 0x7f45ac1227f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:10.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.937+0000 7f45b1068700 1 -- 172.21.15.26:0/1388937757 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a00094a0 con 0x7f45ac09e410 2023-10-01T08:00:10.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.937+0000 7f45b1068700 1 --2- 172.21.15.26:0/1388937757 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45ac09e410 0x7f45ac122d30 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f45a400efc0 tx=0x7f45a400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:10.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.938+0000 7f45a97fa700 1 -- 172.21.15.26:0/1388937757 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a400cd40 con 0x7f45ac09e410 2023-10-01T08:00:10.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.938+0000 7f45a97fa700 1 -- 172.21.15.26:0/1388937757 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a400f040 con 0x7f45ac09e410 2023-10-01T08:00:10.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.938+0000 7f45b2acb700 1 -- 172.21.15.26:0/1388937757 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45ac072150 con 0x7f45ac09e410 2023-10-01T08:00:10.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.938+0000 7f45b2acb700 1 -- 172.21.15.26:0/1388937757 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45ac125af0 con 0x7f45ac09e410 2023-10-01T08:00:10.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.938+0000 7f45a97fa700 1 -- 172.21.15.26:0/1388937757 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a40146c0 con 0x7f45ac09e410 2023-10-01T08:00:10.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.939+0000 7f45b2acb700 1 -- 172.21.15.26:0/1388937757 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f458c0052e0 con 0x7f45ac09e410 2023-10-01T08:00:10.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.939+0000 7f45a97fa700 1 -- 172.21.15.26:0/1388937757 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f45a4014820 con 0x7f45ac09e410 2023-10-01T08:00:10.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.939+0000 7f45a97fa700 1 -- 172.21.15.26:0/1388937757 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f45a4040300 con 0x7f45ac09e410 2023-10-01T08:00:10.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.944+0000 7f45a97fa700 1 -- 172.21.15.26:0/1388937757 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f45a4007920 con 0x7f45ac09e410 2023-10-01T08:00:10.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.960+0000 7f832efe1700 1 -- 172.21.15.26:0/3763541218 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8328074ea0 con 0x7f832809e930 2023-10-01T08:00:10.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.960+0000 7f83257fa700 1 -- 172.21.15.26:0/3763541218 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8318017020 con 0x7f832809e930 2023-10-01T08:00:10.961 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:10.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.963+0000 7f832efe1700 1 -- 172.21.15.26:0/3763541218 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f832809e930 msgr2=0x7f832806b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:10.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.963+0000 7f832efe1700 1 --2- 172.21.15.26:0/3763541218 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f832809e930 0x7f832806b8b0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f831800ebe0 tx=0x7f831800eef0 comp rx=0 tx=0).stop 2023-10-01T08:00:10.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.963+0000 7f832efe1700 1 -- 172.21.15.26:0/3763541218 shutdown_connections 2023-10-01T08:00:10.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.963+0000 7f832efe1700 1 --2- 172.21.15.26:0/3763541218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f832809f650 0x7f832806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:10.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.963+0000 7f832efe1700 1 --2- 172.21.15.26:0/3763541218 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f832809e930 0x7f832806b8b0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:10.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.963+0000 7f832efe1700 1 --2- 172.21.15.26:0/3763541218 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f832809f240 0x7f832806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:10.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.963+0000 7f832efe1700 1 -- 172.21.15.26:0/3763541218 >> 172.21.15.26:0/3763541218 conn(0x7f83280a4210 msgr2=0x7f832809dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:10.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.963+0000 7f832efe1700 1 -- 172.21.15.26:0/3763541218 shutdown_connections 2023-10-01T08:00:10.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.963+0000 7f832efe1700 1 -- 172.21.15.26:0/3763541218 wait complete. 2023-10-01T08:00:10.978 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:10.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.990+0000 7f3e4aedf700 1 Processor -- start 2023-10-01T08:00:10.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.990+0000 7f3e4aedf700 1 -- start start 2023-10-01T08:00:10.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.990+0000 7f3e4aedf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e4409e1d0 0x7f3e44138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:10.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.990+0000 7f3e4aedf700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3e44139170 0x7f3e4413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:10.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.990+0000 7f3e4aedf700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e4409b120 con 0x7f3e4409d6f0 2023-10-01T08:00:10.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.990+0000 7f3e4aedf700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e4406b460 con 0x7f3e44139170 2023-10-01T08:00:10.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.990+0000 7f3e4aedf700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4409a7e0 con 0x7f3e4409e1d0 2023-10-01T08:00:10.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.990+0000 7f3e43fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e4409e1d0 0x7f3e44138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:10.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.990+0000 7f3e48c7b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3e4409d6f0 0x7f3e4409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48958/0 (socket says 172.21.15.26:48958) 2023-10-01T08:00:10.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.990+0000 7f3e48c7b700 1 -- 172.21.15.26:0/375677991 learned_addr learned my addr 172.21.15.26:0/375677991 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:10.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.991+0000 7f3e4947c700 1 --2- 172.21.15.26:0/375677991 >> v2:172.21.15.26:3300/0 conn(0x7f3e44139170 0x7f3e4413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:10.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.991+0000 7f3e437fe700 1 -- 172.21.15.26:0/375677991 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371802613 0 0) 0x7f3e4409b120 con 0x7f3e4409d6f0 2023-10-01T08:00:10.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.991+0000 7f3e43fff700 1 -- 172.21.15.26:0/375677991 >> v2:172.21.15.26:3300/0 conn(0x7f3e44139170 msgr2=0x7f3e4413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:10.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.991+0000 7f3e43fff700 1 --2- 172.21.15.26:0/375677991 >> v2:172.21.15.26:3300/0 conn(0x7f3e44139170 0x7f3e4413b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:10.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.991+0000 7f3e43fff700 1 -- 172.21.15.26:0/375677991 >> v1:172.21.15.26:6789/0 conn(0x7f3e4409d6f0 legacy=0x7f3e4409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:10.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.991+0000 7f3e43fff700 1 -- 172.21.15.26:0/375677991 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4409a500 con 0x7f3e4409e1d0 2023-10-01T08:00:10.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.991+0000 7f3e43fff700 1 --2- 172.21.15.26:0/375677991 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e4409e1d0 0x7f3e44138c30 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3e30009870 tx=0x7f3e30009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74574b3a4cbc6dfe server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:10.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.991+0000 7f3e437fe700 1 -- 172.21.15.26:0/375677991 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e30011830 con 0x7f3e4409e1d0 2023-10-01T08:00:10.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.991+0000 7f3e437fe700 1 -- 172.21.15.26:0/375677991 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e30011990 con 0x7f3e4409e1d0 2023-10-01T08:00:10.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.991+0000 7f3e437fe700 1 -- 172.21.15.26:0/375677991 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e30011d20 con 0x7f3e4409e1d0 2023-10-01T08:00:10.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.992+0000 7f3e4aedf700 1 -- 172.21.15.26:0/375677991 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e4409e1d0 msgr2=0x7f3e44138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:10.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.992+0000 7f3e4aedf700 1 --2- 172.21.15.26:0/375677991 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e4409e1d0 0x7f3e44138c30 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3e30009870 tx=0x7f3e30009b80 comp rx=0 tx=0).stop 2023-10-01T08:00:10.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.992+0000 7f3e4aedf700 1 -- 172.21.15.26:0/375677991 shutdown_connections 2023-10-01T08:00:10.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.992+0000 7f3e4aedf700 1 --2- 172.21.15.26:0/375677991 >> v2:172.21.15.26:3300/0 conn(0x7f3e44139170 0x7f3e4413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:10.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.992+0000 7f3e4aedf700 1 --2- 172.21.15.26:0/375677991 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e4409e1d0 0x7f3e44138c30 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:10.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.992+0000 7f3e4aedf700 1 -- 172.21.15.26:0/375677991 >> 172.21.15.26:0/375677991 conn(0x7f3e44066f50 msgr2=0x7f3e4409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:10.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.992+0000 7f3e4aedf700 1 -- 172.21.15.26:0/375677991 shutdown_connections 2023-10-01T08:00:10.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.992+0000 7f3e4aedf700 1 -- 172.21.15.26:0/375677991 wait complete. 2023-10-01T08:00:10.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.993+0000 7f3e4aedf700 1 Processor -- start 2023-10-01T08:00:10.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.993+0000 7f3e4aedf700 1 -- start start 2023-10-01T08:00:10.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.994+0000 7f3e4aedf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e4409d6f0 0x7f3e441215b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:10.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.994+0000 7f3e4aedf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e4409e1d0 0x7f3e44121af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:10.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.994+0000 7f3e4aedf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e44139170 0x7f3e44122030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:10.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.994+0000 7f3e4aedf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e44123fc0 con 0x7f3e4409d6f0 2023-10-01T08:00:10.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.994+0000 7f3e4aedf700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e44123260 con 0x7f3e4409e1d0 2023-10-01T08:00:10.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.994+0000 7f3e4aedf700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e44124b30 con 0x7f3e44139170 2023-10-01T08:00:10.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.994+0000 7f3e43fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e4409e1d0 0x7f3e44121af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:10.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.994+0000 7f3e43fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e4409e1d0 0x7f3e44121af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45100/0 (socket says 172.21.15.26:45100) 2023-10-01T08:00:10.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.994+0000 7f3e43fff700 1 -- 172.21.15.26:0/4026713465 learned_addr learned my addr 172.21.15.26:0/4026713465 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:10.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.994+0000 7f3e48c7b700 1 --2- 172.21.15.26:0/4026713465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e4409d6f0 0x7f3e441215b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:10.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.994+0000 7f3e4947c700 1 --2- 172.21.15.26:0/4026713465 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e44139170 0x7f3e44122030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:10.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.994+0000 7f3e43fff700 1 -- 172.21.15.26:0/4026713465 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e44139170 msgr2=0x7f3e44122030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:10.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.994+0000 7f3e43fff700 1 --2- 172.21.15.26:0/4026713465 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e44139170 0x7f3e44122030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:10.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.994+0000 7f3e43fff700 1 -- 172.21.15.26:0/4026713465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e4409d6f0 msgr2=0x7f3e441215b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:10.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.994+0000 7f3e43fff700 1 --2- 172.21.15.26:0/4026713465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e4409d6f0 0x7f3e441215b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:10.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.994+0000 7f3e43fff700 1 -- 172.21.15.26:0/4026713465 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e300094a0 con 0x7f3e4409e1d0 2023-10-01T08:00:10.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.994+0000 7f3e48c7b700 1 --2- 172.21.15.26:0/4026713465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e4409d6f0 0x7f3e441215b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:10.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.995+0000 7f3e43fff700 1 --2- 172.21.15.26:0/4026713465 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e4409e1d0 0x7f3e44121af0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f3e30000c00 tx=0x7f3e30004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:10.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.995+0000 7f3e417fa700 1 -- 172.21.15.26:0/4026713465 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e300036a0 con 0x7f3e4409e1d0 2023-10-01T08:00:10.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.995+0000 7f3e417fa700 1 -- 172.21.15.26:0/4026713465 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3001f070 con 0x7f3e4409e1d0 2023-10-01T08:00:10.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.995+0000 7f3e4aedf700 1 -- 172.21.15.26:0/4026713465 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e441251b0 con 0x7f3e4409e1d0 2023-10-01T08:00:10.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.995+0000 7f3e417fa700 1 -- 172.21.15.26:0/4026713465 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e30003a20 con 0x7f3e4409e1d0 2023-10-01T08:00:10.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.995+0000 7f3e4aedf700 1 -- 172.21.15.26:0/4026713465 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e44124480 con 0x7f3e4409e1d0 2023-10-01T08:00:10.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.996+0000 7f3e417fa700 1 -- 172.21.15.26:0/4026713465 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3e30003b80 con 0x7f3e4409e1d0 2023-10-01T08:00:10.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.996+0000 7f3e4aedf700 1 -- 172.21.15.26:0/4026713465 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e44074ea0 con 0x7f3e4409e1d0 2023-10-01T08:00:10.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:10.996+0000 7f3e417fa700 1 -- 172.21.15.26:0/4026713465 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3e30021070 con 0x7f3e4409e1d0 2023-10-01T08:00:11.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:11.001+0000 7f3e417fa700 1 -- 172.21.15.26:0/4026713465 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3e3001a430 con 0x7f3e4409e1d0 2023-10-01T08:00:11.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:11.122+0000 7f0fb71a3700 1 -- 172.21.15.26:0/1810303724 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0fb0074ea0 con 0x7f0fb009e000 2023-10-01T08:00:11.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:11.122+0000 7f0fad7fa700 1 -- 172.21.15.26:0/1810303724 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0f9c0192c0 con 0x7f0fb009e000 2023-10-01T08:00:11.123 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:11.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:11.124+0000 7f0fb71a3700 1 -- 172.21.15.26:0/1810303724 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0fb009e000 msgr2=0x7f0fb0139eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:11.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:11.124+0000 7f0fb71a3700 1 --2- 172.21.15.26:0/1810303724 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0fb009e000 0x7f0fb0139eb0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c00c490 tx=0x7f0f9c00c7a0 comp rx=0 tx=0).stop 2023-10-01T08:00:11.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:11.125+0000 7f0fb71a3700 1 -- 172.21.15.26:0/1810303724 shutdown_connections 2023-10-01T08:00:11.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:11.125+0000 7f0fb71a3700 1 --2- 172.21.15.26:0/1810303724 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0fb009e410 0x7f0fb013a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:11.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:11.125+0000 7f0fb71a3700 1 --2- 172.21.15.26:0/1810303724 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fb009d6f0 0x7f0fb0139970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:11.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:11.125+0000 7f0fb71a3700 1 --2- 172.21.15.26:0/1810303724 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0fb009e000 0x7f0fb0139eb0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:11.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:11.125+0000 7f0fb71a3700 1 -- 172.21.15.26:0/1810303724 >> 172.21.15.26:0/1810303724 conn(0x7f0fb0066f50 msgr2=0x7f0fb00a21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:11.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:11.125+0000 7f0fb71a3700 1 -- 172.21.15.26:0/1810303724 shutdown_connections 2023-10-01T08:00:11.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:11.125+0000 7f0fb71a3700 1 -- 172.21.15.26:0/1810303724 wait complete. 2023-10-01T08:00:11.140 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:11.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:11.168+0000 7f45b2acb700 1 -- 172.21.15.26:0/1388937757 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f458c005590 con 0x7f45ac09e410 2023-10-01T08:00:11.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:11.168+0000 7f45a97fa700 1 -- 172.21.15.26:0/1388937757 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f45a4009ca0 con 0x7f45ac09e410 2023-10-01T08:00:11.169 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:11.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:11.170+0000 7f45b2acb700 1 -- 172.21.15.26:0/1388937757 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45ac09e410 msgr2=0x7f45ac122d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:11.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:11.170+0000 7f45b2acb700 1 --2- 172.21.15.26:0/1388937757 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45ac09e410 0x7f45ac122d30 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f45a400efc0 tx=0x7f45a400c3a0 comp rx=0 tx=0).stop 2023-10-01T08:00:11.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:11.171+0000 7f45b2acb700 1 -- 172.21.15.26:0/1388937757 shutdown_connections 2023-10-01T08:00:11.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:11.171+0000 7f45b2acb700 1 --2- 172.21.15.26:0/1388937757 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45ac09e410 0x7f45ac122d30 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:11.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:11.171+0000 7f45b2acb700 1 --2- 172.21.15.26:0/1388937757 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f45ac09d6f0 0x7f45ac1222b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:11.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:11.171+0000 7f45b2acb700 1 --2- 172.21.15.26:0/1388937757 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45ac09e000 0x7f45ac1227f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:11.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:11.171+0000 7f45b2acb700 1 -- 172.21.15.26:0/1388937757 >> 172.21.15.26:0/1388937757 conn(0x7f45ac066f50 msgr2=0x7f45ac070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:11.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:11.171+0000 7f45b2acb700 1 -- 172.21.15.26:0/1388937757 shutdown_connections 2023-10-01T08:00:11.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:11.171+0000 7f45b2acb700 1 -- 172.21.15.26:0/1388937757 wait complete. 2023-10-01T08:00:11.185 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:11.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:11.210+0000 7f3e4aedf700 1 -- 172.21.15.26:0/4026713465 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3e4406c360 con 0x7f3e4409e1d0 2023-10-01T08:00:11.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:11.210+0000 7f3e417fa700 1 -- 172.21.15.26:0/4026713465 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3e3002b030 con 0x7f3e4409e1d0 2023-10-01T08:00:11.211 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:11.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:11.212+0000 7f3e4aedf700 1 -- 172.21.15.26:0/4026713465 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e4409e1d0 msgr2=0x7f3e44121af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:11.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:11.212+0000 7f3e4aedf700 1 --2- 172.21.15.26:0/4026713465 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e4409e1d0 0x7f3e44121af0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f3e30000c00 tx=0x7f3e30004750 comp rx=0 tx=0).stop 2023-10-01T08:00:11.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:11.212+0000 7f3e4aedf700 1 -- 172.21.15.26:0/4026713465 shutdown_connections 2023-10-01T08:00:11.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:11.212+0000 7f3e4aedf700 1 --2- 172.21.15.26:0/4026713465 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e44139170 0x7f3e44122030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:11.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:11.212+0000 7f3e4aedf700 1 --2- 172.21.15.26:0/4026713465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e4409d6f0 0x7f3e441215b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:11.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:11.212+0000 7f3e4aedf700 1 --2- 172.21.15.26:0/4026713465 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e4409e1d0 0x7f3e44121af0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:11.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:11.212+0000 7f3e4aedf700 1 -- 172.21.15.26:0/4026713465 >> 172.21.15.26:0/4026713465 conn(0x7f3e44066f50 msgr2=0x7f3e44070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:11.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:11.212+0000 7f3e4aedf700 1 -- 172.21.15.26:0/4026713465 shutdown_connections 2023-10-01T08:00:11.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:11.212+0000 7f3e4aedf700 1 -- 172.21.15.26:0/4026713465 wait complete. 2023-10-01T08:00:11.226 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:11.979 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:12.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.129+0000 7f4479081700 1 Processor -- start 2023-10-01T08:00:12.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.129+0000 7f4479081700 1 -- start start 2023-10-01T08:00:12.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.130+0000 7f4479081700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f447409e1d0 0x7f4474135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:12.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.130+0000 7f4479081700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4474135e50 0x7f4474138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:12.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.130+0000 7f4479081700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f447409f130 con 0x7f447409d6f0 2023-10-01T08:00:12.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.130+0000 7f4479081700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f447409f520 con 0x7f447409e1d0 2023-10-01T08:00:12.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.130+0000 7f4479081700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f447409e930 con 0x7f4474135e50 2023-10-01T08:00:12.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.130+0000 7f447359e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4474135e50 0x7f4474138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:12.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.130+0000 7f447359e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4474135e50 0x7f4474138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45116/0 (socket says 172.21.15.26:45116) 2023-10-01T08:00:12.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.130+0000 7f447359e700 1 -- 172.21.15.26:0/2851075080 learned_addr learned my addr 172.21.15.26:0/2851075080 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:12.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.130+0000 7f447259c700 1 --2- 172.21.15.26:0/2851075080 >> v2:172.21.15.26:3300/0 conn(0x7f447409e1d0 0x7f4474135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:12.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.130+0000 7f447359e700 1 -- 172.21.15.26:0/2851075080 >> v2:172.21.15.26:3300/0 conn(0x7f447409e1d0 msgr2=0x7f4474135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:12.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.130+0000 7f447359e700 1 --2- 172.21.15.26:0/2851075080 >> v2:172.21.15.26:3300/0 conn(0x7f447409e1d0 0x7f4474135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:12.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.130+0000 7f447359e700 1 -- 172.21.15.26:0/2851075080 >> v1:172.21.15.26:6789/0 conn(0x7f447409d6f0 legacy=0x7f447409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:12.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.130+0000 7f447359e700 1 -- 172.21.15.26:0/2851075080 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f447409b2d0 con 0x7f4474135e50 2023-10-01T08:00:12.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.130+0000 7f447259c700 1 --2- 172.21.15.26:0/2851075080 >> v2:172.21.15.26:3300/0 conn(0x7f447409e1d0 0x7f4474135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:12.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.130+0000 7f447359e700 1 --2- 172.21.15.26:0/2851075080 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4474135e50 0x7f4474138230 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f446c00d150 tx=0x7f446c00d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0bf307fed18477d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:12.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.130+0000 7f4471d9b700 1 -- 172.21.15.26:0/2851075080 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446c010070 con 0x7f4474135e50 2023-10-01T08:00:12.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.130+0000 7f4471d9b700 1 -- 172.21.15.26:0/2851075080 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446c00dd10 con 0x7f4474135e50 2023-10-01T08:00:12.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.131+0000 7f4471d9b700 1 -- 172.21.15.26:0/2851075080 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446c00b310 con 0x7f4474135e50 2023-10-01T08:00:12.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.131+0000 7f4479081700 1 -- 172.21.15.26:0/2851075080 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4474135e50 msgr2=0x7f4474138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:12.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.131+0000 7f4479081700 1 --2- 172.21.15.26:0/2851075080 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4474135e50 0x7f4474138230 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f446c00d150 tx=0x7f446c00d460 comp rx=0 tx=0).stop 2023-10-01T08:00:12.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.131+0000 7f4479081700 1 -- 172.21.15.26:0/2851075080 shutdown_connections 2023-10-01T08:00:12.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.131+0000 7f4479081700 1 --2- 172.21.15.26:0/2851075080 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4474135e50 0x7f4474138230 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:12.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.131+0000 7f4479081700 1 --2- 172.21.15.26:0/2851075080 >> v2:172.21.15.26:3300/0 conn(0x7f447409e1d0 0x7f4474135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:12.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.131+0000 7f4479081700 1 -- 172.21.15.26:0/2851075080 >> 172.21.15.26:0/2851075080 conn(0x7f4474066f50 msgr2=0x7f447409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:12.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.131+0000 7f4479081700 1 -- 172.21.15.26:0/2851075080 shutdown_connections 2023-10-01T08:00:12.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.131+0000 7f4479081700 1 -- 172.21.15.26:0/2851075080 wait complete. 2023-10-01T08:00:12.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.133+0000 7f4479081700 1 Processor -- start 2023-10-01T08:00:12.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.133+0000 7f4479081700 1 -- start start 2023-10-01T08:00:12.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.134+0000 7f4479081700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f447409d6f0 0x7f447411b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:12.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.134+0000 7f4479081700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f447409e1d0 0x7f447411b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:12.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.134+0000 7f4479081700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4474135e50 0x7f447411bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:12.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.134+0000 7f4479081700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447411d100 con 0x7f447409d6f0 2023-10-01T08:00:12.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.134+0000 7f4479081700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f447411ec20 con 0x7f4474135e50 2023-10-01T08:00:12.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.134+0000 7f4479081700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44740a1e20 con 0x7f447409e1d0 2023-10-01T08:00:12.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.134+0000 7f4472d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f447409d6f0 0x7f447411b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:12.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.134+0000 7f447259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f447409e1d0 0x7f447411b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:12.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.134+0000 7f4472d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f447409d6f0 0x7f447411b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56992/0 (socket says 172.21.15.26:56992) 2023-10-01T08:00:12.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.134+0000 7f4472d9d700 1 -- 172.21.15.26:0/2344086435 learned_addr learned my addr 172.21.15.26:0/2344086435 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:12.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.134+0000 7f447359e700 1 --2- 172.21.15.26:0/2344086435 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4474135e50 0x7f447411bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:12.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.134+0000 7f447359e700 1 -- 172.21.15.26:0/2344086435 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f447409e1d0 msgr2=0x7f447411b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:12.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.134+0000 7f447359e700 1 --2- 172.21.15.26:0/2344086435 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f447409e1d0 0x7f447411b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:12.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.134+0000 7f447359e700 1 -- 172.21.15.26:0/2344086435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f447409d6f0 msgr2=0x7f447411b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:12.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.134+0000 7f447359e700 1 --2- 172.21.15.26:0/2344086435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f447409d6f0 0x7f447411b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:12.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.134+0000 7f447359e700 1 -- 172.21.15.26:0/2344086435 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445c0094a0 con 0x7f4474135e50 2023-10-01T08:00:12.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.134+0000 7f4472d9d700 1 --2- 172.21.15.26:0/2344086435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f447409d6f0 0x7f447411b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:12.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.134+0000 7f447359e700 1 --2- 172.21.15.26:0/2344086435 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4474135e50 0x7f447411bf00 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f446c017000 tx=0x7f446c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:12.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.135+0000 7f446b7fe700 1 -- 172.21.15.26:0/2344086435 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446c009e40 con 0x7f4474135e50 2023-10-01T08:00:12.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.135+0000 7f446b7fe700 1 -- 172.21.15.26:0/2344086435 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446c00b4c0 con 0x7f4474135e50 2023-10-01T08:00:12.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.135+0000 7f4479081700 1 -- 172.21.15.26:0/2344086435 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f446c00bd40 con 0x7f4474135e50 2023-10-01T08:00:12.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.135+0000 7f446b7fe700 1 -- 172.21.15.26:0/2344086435 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446c004280 con 0x7f4474135e50 2023-10-01T08:00:12.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.135+0000 7f4479081700 1 -- 172.21.15.26:0/2344086435 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f447411d7a0 con 0x7f4474135e50 2023-10-01T08:00:12.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.135+0000 7f446b7fe700 1 -- 172.21.15.26:0/2344086435 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f446c0043e0 con 0x7f4474135e50 2023-10-01T08:00:12.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.136+0000 7f446b7fe700 1 -- 172.21.15.26:0/2344086435 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f446c0434e0 con 0x7f4474135e50 2023-10-01T08:00:12.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.136+0000 7f4479081700 1 -- 172.21.15.26:0/2344086435 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4474074ea0 con 0x7f4474135e50 2023-10-01T08:00:12.141 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:12.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.141+0000 7f446b7fe700 1 -- 172.21.15.26:0/2344086435 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f446c01e410 con 0x7f4474135e50 2023-10-01T08:00:12.186 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:12.227 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:12.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.284+0000 7fefa804b700 1 Processor -- start 2023-10-01T08:00:12.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.284+0000 7fefa804b700 1 -- start start 2023-10-01T08:00:12.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.285+0000 7fefa804b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fefa0131810 0x7fefa0131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:12.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.285+0000 7fefa804b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fefa009a580 0x7fefa0139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:12.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.285+0000 7fefa804b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefa01313c0 con 0x7fefa0099a40 2023-10-01T08:00:12.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.285+0000 7fefa804b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa006e8c0 con 0x7fefa009a580 2023-10-01T08:00:12.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.285+0000 7fefa804b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fefa0071d20 con 0x7fefa0131810 2023-10-01T08:00:12.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.285+0000 7fefa65e8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fefa009a580 0x7fefa0139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:12.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.285+0000 7fefa5de7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fefa0131810 0x7fefa0131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:12.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.286+0000 7fefa55e6700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fefa0099a40 0x7fefa0099e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48970/0 (socket says 172.21.15.26:48970) 2023-10-01T08:00:12.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.286+0000 7fefa55e6700 1 -- 172.21.15.26:0/3830598274 learned_addr learned my addr 172.21.15.26:0/3830598274 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:12.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.286+0000 7fefa5de7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fefa0131810 0x7fefa0131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:38738/0 (socket says 172.21.15.26:38738) 2023-10-01T08:00:12.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.286+0000 7fefa65e8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fefa009a580 0x7fefa0139660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45140/0 (socket says 172.21.15.26:45140) 2023-10-01T08:00:12.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.286+0000 7fefa65e8700 1 -- 172.21.15.26:0/3830598274 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fefa0131810 msgr2=0x7fefa0131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:12.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.286+0000 7fefa65e8700 1 --2- 172.21.15.26:0/3830598274 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fefa0131810 0x7fefa0131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:12.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.286+0000 7fefa65e8700 1 -- 172.21.15.26:0/3830598274 >> v1:172.21.15.26:6789/0 conn(0x7fefa0099a40 legacy=0x7fefa0099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:12.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.286+0000 7fefa65e8700 1 -- 172.21.15.26:0/3830598274 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa00721a0 con 0x7fefa009a580 2023-10-01T08:00:12.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.286+0000 7fefa65e8700 1 --2- 172.21.15.26:0/3830598274 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fefa009a580 0x7fefa0139660 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fef98009dc0 tx=0x7fef9800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecb771f6cc5bd9b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:12.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.286+0000 7fefa4de5700 1 -- 172.21.15.26:0/3830598274 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9800e070 con 0x7fefa009a580 2023-10-01T08:00:12.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.287+0000 7fefa4de5700 1 -- 172.21.15.26:0/3830598274 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef98003a20 con 0x7fefa009a580 2023-10-01T08:00:12.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.287+0000 7fefa4de5700 1 -- 172.21.15.26:0/3830598274 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef98003dd0 con 0x7fefa009a580 2023-10-01T08:00:12.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.288+0000 7fefa804b700 1 -- 172.21.15.26:0/3830598274 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fefa009a580 msgr2=0x7fefa0139660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:12.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.288+0000 7fefa804b700 1 --2- 172.21.15.26:0/3830598274 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fefa009a580 0x7fefa0139660 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fef98009dc0 tx=0x7fef9800b330 comp rx=0 tx=0).stop 2023-10-01T08:00:12.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.288+0000 7fefa804b700 1 -- 172.21.15.26:0/3830598274 shutdown_connections 2023-10-01T08:00:12.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.288+0000 7fefa804b700 1 --2- 172.21.15.26:0/3830598274 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fefa0131810 0x7fefa0131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:12.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.288+0000 7fefa804b700 1 --2- 172.21.15.26:0/3830598274 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fefa009a580 0x7fefa0139660 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:12.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.288+0000 7fefa804b700 1 -- 172.21.15.26:0/3830598274 >> 172.21.15.26:0/3830598274 conn(0x7fefa00a2aa0 msgr2=0x7fefa00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:12.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.288+0000 7fefa804b700 1 -- 172.21.15.26:0/3830598274 shutdown_connections 2023-10-01T08:00:12.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.288+0000 7fefa804b700 1 -- 172.21.15.26:0/3830598274 wait complete. 2023-10-01T08:00:12.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.289+0000 7fefa804b700 1 Processor -- start 2023-10-01T08:00:12.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.290+0000 7fefa804b700 1 -- start start 2023-10-01T08:00:12.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.290+0000 7fefa804b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fefa0099a40 0x7fefa011b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:12.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.290+0000 7fefa804b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefa009a580 0x7fefa011bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:12.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.290+0000 7fefa804b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fefa0131810 0x7fefa011c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:12.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.290+0000 7fefa804b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa011cd20 con 0x7fefa009a580 2023-10-01T08:00:12.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.290+0000 7fefa804b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa012ebb0 con 0x7fefa0131810 2023-10-01T08:00:12.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.290+0000 7fefa804b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fefa011e620 con 0x7fefa0099a40 2023-10-01T08:00:12.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.290+0000 7fefa5de7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fefa0099a40 0x7fefa011b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:12.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.290+0000 7fefa65e8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fefa0131810 0x7fefa011c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:12.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.290+0000 7fefa5de7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fefa0099a40 0x7fefa011b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:38740/0 (socket says 172.21.15.26:38740) 2023-10-01T08:00:12.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.290+0000 7fefa5de7700 1 -- 172.21.15.26:0/3155630481 learned_addr learned my addr 172.21.15.26:0/3155630481 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:12.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.290+0000 7fefa55e6700 1 --2- 172.21.15.26:0/3155630481 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefa009a580 0x7fefa011bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:12.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.291+0000 7fefa65e8700 1 -- 172.21.15.26:0/3155630481 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fefa0099a40 msgr2=0x7fefa011b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:12.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.291+0000 7fefa65e8700 1 --2- 172.21.15.26:0/3155630481 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fefa0099a40 0x7fefa011b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:12.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.291+0000 7fefa65e8700 1 -- 172.21.15.26:0/3155630481 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefa009a580 msgr2=0x7fefa011bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:12.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.291+0000 7fefa65e8700 1 --2- 172.21.15.26:0/3155630481 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefa009a580 0x7fefa011bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:12.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.291+0000 7fefa65e8700 1 -- 172.21.15.26:0/3155630481 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef98009a70 con 0x7fefa0131810 2023-10-01T08:00:12.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.291+0000 7fefa5de7700 1 --2- 172.21.15.26:0/3155630481 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fefa0099a40 0x7fefa011b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:12.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.291+0000 7fefa55e6700 1 --2- 172.21.15.26:0/3155630481 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefa009a580 0x7fefa011bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T08:00:12.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.291+0000 7fefa65e8700 1 --2- 172.21.15.26:0/3155630481 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fefa0131810 0x7fefa011c2d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fef98015000 tx=0x7fef98004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:12.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.291+0000 7fef967fc700 1 -- 172.21.15.26:0/3155630481 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef98009430 con 0x7fefa0131810 2023-10-01T08:00:12.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.291+0000 7fef967fc700 1 -- 172.21.15.26:0/3155630481 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef98004610 con 0x7fefa0131810 2023-10-01T08:00:12.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.291+0000 7fefa804b700 1 -- 172.21.15.26:0/3155630481 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefa011f000 con 0x7fefa0131810 2023-10-01T08:00:12.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.291+0000 7fef967fc700 1 -- 172.21.15.26:0/3155630481 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef98012430 con 0x7fefa0131810 2023-10-01T08:00:12.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.291+0000 7fefa804b700 1 -- 172.21.15.26:0/3155630481 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa011ea70 con 0x7fefa0131810 2023-10-01T08:00:12.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.292+0000 7fef967fc700 1 -- 172.21.15.26:0/3155630481 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fef98012590 con 0x7fefa0131810 2023-10-01T08:00:12.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.292+0000 7fef967fc700 1 -- 172.21.15.26:0/3155630481 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fef98041310 con 0x7fefa0131810 2023-10-01T08:00:12.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.293+0000 7fefa804b700 1 -- 172.21.15.26:0/3155630481 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa00a1c30 con 0x7fefa0131810 2023-10-01T08:00:12.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.302+0000 7fef967fc700 1 -- 172.21.15.26:0/3155630481 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef98024950 con 0x7fefa0131810 2023-10-01T08:00:12.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.345+0000 7f4b0a16b700 1 Processor -- start 2023-10-01T08:00:12.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.345+0000 7f4b0a16b700 1 -- start start 2023-10-01T08:00:12.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.345+0000 7f4b0a16b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4b0409d6f0 0x7f4b0409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:12.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.345+0000 7f4b0a16b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b0409e000 0x7f4b041339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:12.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.346+0000 7f4b0a16b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b0409b120 con 0x7f4b0409e410 2023-10-01T08:00:12.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.346+0000 7f4b0a16b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b0406b460 con 0x7f4b0409d6f0 2023-10-01T08:00:12.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.346+0000 7f4b0a16b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0409a7e0 con 0x7f4b0409e000 2023-10-01T08:00:12.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.346+0000 7f4b037fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4b0409d6f0 0x7f4b0409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:12.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.346+0000 7f4b037fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4b0409d6f0 0x7f4b0409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57006/0 (socket says 172.21.15.26:57006) 2023-10-01T08:00:12.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.346+0000 7f4b037fe700 1 -- 172.21.15.26:0/1086440587 learned_addr learned my addr 172.21.15.26:0/1086440587 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:12.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.346+0000 7f4b02ffd700 1 --2- 172.21.15.26:0/1086440587 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b0409e000 0x7f4b041339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:12.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.346+0000 7f4b02ffd700 1 -- 172.21.15.26:0/1086440587 >> v2:172.21.15.26:3300/0 conn(0x7f4b0409d6f0 msgr2=0x7f4b0409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:12.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.346+0000 7f4b02ffd700 1 --2- 172.21.15.26:0/1086440587 >> v2:172.21.15.26:3300/0 conn(0x7f4b0409d6f0 0x7f4b0409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:12.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.346+0000 7f4b02ffd700 1 -- 172.21.15.26:0/1086440587 >> v1:172.21.15.26:6789/0 conn(0x7f4b0409e410 legacy=0x7f4b04133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:12.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.346+0000 7f4b02ffd700 1 -- 172.21.15.26:0/1086440587 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0409a500 con 0x7f4b0409e000 2023-10-01T08:00:12.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.347+0000 7f4b02ffd700 1 --2- 172.21.15.26:0/1086440587 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b0409e000 0x7f4b041339f0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f4af8009870 tx=0x7f4af8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da011f61976566ca server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:12.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.347+0000 7f4b027fc700 1 -- 172.21.15.26:0/1086440587 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af8011830 con 0x7f4b0409e000 2023-10-01T08:00:12.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.347+0000 7f4b027fc700 1 -- 172.21.15.26:0/1086440587 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af8011990 con 0x7f4b0409e000 2023-10-01T08:00:12.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.347+0000 7f4b027fc700 1 -- 172.21.15.26:0/1086440587 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af8011d20 con 0x7f4b0409e000 2023-10-01T08:00:12.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.348+0000 7f4b0a16b700 1 -- 172.21.15.26:0/1086440587 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b0409e000 msgr2=0x7f4b041339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:12.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.348+0000 7f4b0a16b700 1 --2- 172.21.15.26:0/1086440587 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b0409e000 0x7f4b041339f0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f4af8009870 tx=0x7f4af8009b80 comp rx=0 tx=0).stop 2023-10-01T08:00:12.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.348+0000 7f4b0a16b700 1 -- 172.21.15.26:0/1086440587 shutdown_connections 2023-10-01T08:00:12.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.348+0000 7f4b0a16b700 1 --2- 172.21.15.26:0/1086440587 >> v2:172.21.15.26:3300/0 conn(0x7f4b0409d6f0 0x7f4b0409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:12.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.348+0000 7f4b0a16b700 1 --2- 172.21.15.26:0/1086440587 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b0409e000 0x7f4b041339f0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:12.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.348+0000 7f4b0a16b700 1 -- 172.21.15.26:0/1086440587 >> 172.21.15.26:0/1086440587 conn(0x7f4b04066f50 msgr2=0x7f4b0409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:12.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.348+0000 7f4b0a16b700 1 -- 172.21.15.26:0/1086440587 shutdown_connections 2023-10-01T08:00:12.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.348+0000 7f4b0a16b700 1 -- 172.21.15.26:0/1086440587 wait complete. 2023-10-01T08:00:12.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.349+0000 7f4b0a16b700 1 Processor -- start 2023-10-01T08:00:12.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.350+0000 7f4b0a16b700 1 -- start start 2023-10-01T08:00:12.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.350+0000 7f4b0a16b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4b0409d6f0 0x7f4b041a5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:12.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.351+0000 7f4b0a16b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b0409e000 0x7f4b041a63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:12.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.351+0000 7f4b0a16b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b0409e410 0x7f4b041a6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:12.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.351+0000 7f4b0a16b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b041a7340 con 0x7f4b0409e000 2023-10-01T08:00:12.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.351+0000 7f4b0a16b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b041a9920 con 0x7f4b0409d6f0 2023-10-01T08:00:12.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.351+0000 7f4b0a16b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b041a8cd0 con 0x7f4b0409e410 2023-10-01T08:00:12.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.351+0000 7f4b03fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b0409e410 0x7f4b041a6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:12.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.351+0000 7f4b03fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b0409e410 0x7f4b041a6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:38748/0 (socket says 172.21.15.26:38748) 2023-10-01T08:00:12.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.351+0000 7f4b03fff700 1 -- 172.21.15.26:0/4263717394 learned_addr learned my addr 172.21.15.26:0/4263717394 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:12.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.351+0000 7f4b037fe700 1 --2- 172.21.15.26:0/4263717394 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4b0409d6f0 0x7f4b041a5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:12.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.351+0000 7f4b02ffd700 1 --2- 172.21.15.26:0/4263717394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b0409e000 0x7f4b041a63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:12.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.351+0000 7f4b03fff700 1 -- 172.21.15.26:0/4263717394 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4b0409d6f0 msgr2=0x7f4b041a5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:12.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.351+0000 7f4b03fff700 1 --2- 172.21.15.26:0/4263717394 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4b0409d6f0 0x7f4b041a5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:12.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.351+0000 7f4b03fff700 1 -- 172.21.15.26:0/4263717394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b0409e000 msgr2=0x7f4b041a63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:12.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.351+0000 7f4b03fff700 1 --2- 172.21.15.26:0/4263717394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b0409e000 0x7f4b041a63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:12.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.351+0000 7f4b03fff700 1 -- 172.21.15.26:0/4263717394 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af80094a0 con 0x7f4b0409e410 2023-10-01T08:00:12.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.351+0000 7f4b03fff700 1 --2- 172.21.15.26:0/4263717394 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b0409e410 0x7f4b041a6910 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f4afc00cc80 tx=0x7f4afc00cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:12.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.352+0000 7f4aebfff700 1 -- 172.21.15.26:0/4263717394 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc00ab10 con 0x7f4b0409e410 2023-10-01T08:00:12.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.352+0000 7f4b0a16b700 1 -- 172.21.15.26:0/4263717394 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b041a7b10 con 0x7f4b0409e410 2023-10-01T08:00:12.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.352+0000 7f4aebfff700 1 -- 172.21.15.26:0/4263717394 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4afc00ac70 con 0x7f4b0409e410 2023-10-01T08:00:12.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.352+0000 7f4aebfff700 1 -- 172.21.15.26:0/4263717394 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc012420 con 0x7f4b0409e410 2023-10-01T08:00:12.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.352+0000 7f4b0a16b700 1 -- 172.21.15.26:0/4263717394 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b041a8810 con 0x7f4b0409e410 2023-10-01T08:00:12.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.353+0000 7f4aebfff700 1 -- 172.21.15.26:0/4263717394 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4afc005080 con 0x7f4b0409e410 2023-10-01T08:00:12.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.353+0000 7f4b0a16b700 1 -- 172.21.15.26:0/4263717394 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b04074ea0 con 0x7f4b0409e410 2023-10-01T08:00:12.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.353+0000 7f4aebfff700 1 -- 172.21.15.26:0/4263717394 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4afc03f5a0 con 0x7f4b0409e410 2023-10-01T08:00:12.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.363+0000 7f4aebfff700 1 -- 172.21.15.26:0/4263717394 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4afc0108d0 con 0x7f4b0409e410 2023-10-01T08:00:12.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.363+0000 7f4479081700 1 -- 172.21.15.26:0/2344086435 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f447406c360 con 0x7f4474135e50 2023-10-01T08:00:12.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.364+0000 7f446b7fe700 1 -- 172.21.15.26:0/2344086435 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f446c01db90 con 0x7f4474135e50 2023-10-01T08:00:12.364 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:12.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.366+0000 7f4479081700 1 -- 172.21.15.26:0/2344086435 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4474135e50 msgr2=0x7f447411bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:12.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.366+0000 7f4479081700 1 --2- 172.21.15.26:0/2344086435 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4474135e50 0x7f447411bf00 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f446c017000 tx=0x7f446c004ad0 comp rx=0 tx=0).stop 2023-10-01T08:00:12.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.366+0000 7f4479081700 1 -- 172.21.15.26:0/2344086435 shutdown_connections 2023-10-01T08:00:12.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.366+0000 7f4479081700 1 --2- 172.21.15.26:0/2344086435 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4474135e50 0x7f447411bf00 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:12.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.366+0000 7f4479081700 1 --2- 172.21.15.26:0/2344086435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f447409d6f0 0x7f447411b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:12.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.366+0000 7f4479081700 1 --2- 172.21.15.26:0/2344086435 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f447409e1d0 0x7f447411b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:12.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.366+0000 7f4479081700 1 -- 172.21.15.26:0/2344086435 >> 172.21.15.26:0/2344086435 conn(0x7f4474066f50 msgr2=0x7f44740a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:12.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.366+0000 7f4479081700 1 -- 172.21.15.26:0/2344086435 shutdown_connections 2023-10-01T08:00:12.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.366+0000 7f4479081700 1 -- 172.21.15.26:0/2344086435 wait complete. 2023-10-01T08:00:12.381 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:12.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.384+0000 7f538bf4c700 1 Processor -- start 2023-10-01T08:00:12.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.384+0000 7f538bf4c700 1 -- start start 2023-10-01T08:00:12.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.385+0000 7f538bf4c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f538409d6f0 0x7f538409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:12.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.385+0000 7f538bf4c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f538409e410 0x7f5384130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:12.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.385+0000 7f538bf4c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f538409f130 con 0x7f538409e000 2023-10-01T08:00:12.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.385+0000 7f538bf4c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f538409f520 con 0x7f538409e410 2023-10-01T08:00:12.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.385+0000 7f538bf4c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f538409e930 con 0x7f538409d6f0 2023-10-01T08:00:12.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.385+0000 7f538a4e9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f538409e410 0x7f5384130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:12.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.385+0000 7f538a4e9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f538409e410 0x7f5384130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45162/0 (socket says 172.21.15.26:45162) 2023-10-01T08:00:12.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.385+0000 7f538a4e9700 1 -- 172.21.15.26:0/1301357705 learned_addr learned my addr 172.21.15.26:0/1301357705 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:12.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.385+0000 7f5389ce8700 1 --2- 172.21.15.26:0/1301357705 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f538409d6f0 0x7f538409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:12.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.385+0000 7f5389ce8700 1 -- 172.21.15.26:0/1301357705 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f538409e410 msgr2=0x7f5384130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:12.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.385+0000 7f5389ce8700 1 --2- 172.21.15.26:0/1301357705 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f538409e410 0x7f5384130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:12.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.385+0000 7f5389ce8700 1 -- 172.21.15.26:0/1301357705 >> v1:172.21.15.26:6789/0 conn(0x7f538409e000 legacy=0x7f5384130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:12.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.385+0000 7f5389ce8700 1 -- 172.21.15.26:0/1301357705 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f538409b2d0 con 0x7f538409d6f0 2023-10-01T08:00:12.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.386+0000 7f5389ce8700 1 --2- 172.21.15.26:0/1301357705 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f538409d6f0 0x7f538409dac0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f5380009870 tx=0x7f5380009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3a81e5bf624a011 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:12.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.386+0000 7f5388ce6700 1 -- 172.21.15.26:0/1301357705 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5380011830 con 0x7f538409d6f0 2023-10-01T08:00:12.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.386+0000 7f5388ce6700 1 -- 172.21.15.26:0/1301357705 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5380011990 con 0x7f538409d6f0 2023-10-01T08:00:12.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.386+0000 7f5388ce6700 1 -- 172.21.15.26:0/1301357705 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5380011d20 con 0x7f538409d6f0 2023-10-01T08:00:12.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.386+0000 7f538bf4c700 1 -- 172.21.15.26:0/1301357705 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f538409d6f0 msgr2=0x7f538409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:12.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.386+0000 7f538bf4c700 1 --2- 172.21.15.26:0/1301357705 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f538409d6f0 0x7f538409dac0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f5380009870 tx=0x7f5380009b80 comp rx=0 tx=0).stop 2023-10-01T08:00:12.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.387+0000 7f538bf4c700 1 -- 172.21.15.26:0/1301357705 shutdown_connections 2023-10-01T08:00:12.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.387+0000 7f538bf4c700 1 --2- 172.21.15.26:0/1301357705 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f538409d6f0 0x7f538409dac0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:12.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.387+0000 7f538bf4c700 1 --2- 172.21.15.26:0/1301357705 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f538409e410 0x7f5384130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:12.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.387+0000 7f538bf4c700 1 -- 172.21.15.26:0/1301357705 >> 172.21.15.26:0/1301357705 conn(0x7f5384066f50 msgr2=0x7f538409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:12.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.387+0000 7f538bf4c700 1 -- 172.21.15.26:0/1301357705 shutdown_connections 2023-10-01T08:00:12.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.387+0000 7f538bf4c700 1 -- 172.21.15.26:0/1301357705 wait complete. 2023-10-01T08:00:12.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.388+0000 7f538bf4c700 1 Processor -- start 2023-10-01T08:00:12.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.388+0000 7f538bf4c700 1 -- start start 2023-10-01T08:00:12.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.388+0000 7f538bf4c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f538409d6f0 0x7f538406e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:12.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.388+0000 7f538bf4c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f538409e000 0x7f538406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:12.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.388+0000 7f538bf4c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f538409e410 0x7f538406f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:12.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.388+0000 7f538bf4c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5384125f00 con 0x7f538409d6f0 2023-10-01T08:00:12.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.388+0000 7f538bf4c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5384070480 con 0x7f538409e000 2023-10-01T08:00:12.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.388+0000 7f538bf4c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53840a1ea0 con 0x7f538409e410 2023-10-01T08:00:12.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.388+0000 7f538a4e9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f538409e410 0x7f538406f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:12.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.388+0000 7f5389ce8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f538409d6f0 0x7f538406e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:12.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.388+0000 7f53894e7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f538409e000 0x7f538406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:12.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.388+0000 7f538a4e9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f538409e410 0x7f538406f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:38768/0 (socket says 172.21.15.26:38768) 2023-10-01T08:00:12.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.388+0000 7f5389ce8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f538409d6f0 0x7f538406e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57032/0 (socket says 172.21.15.26:57032) 2023-10-01T08:00:12.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.388+0000 7f538a4e9700 1 -- 172.21.15.26:0/1266832590 learned_addr learned my addr 172.21.15.26:0/1266832590 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:12.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.388+0000 7f53894e7700 1 --2- 172.21.15.26:0/1266832590 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f538409e000 0x7f538406edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45178/0 (socket says 172.21.15.26:45178) 2023-10-01T08:00:12.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.389+0000 7f538a4e9700 1 -- 172.21.15.26:0/1266832590 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f538409e000 msgr2=0x7f538406edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:12.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.389+0000 7f538a4e9700 1 --2- 172.21.15.26:0/1266832590 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f538409e000 0x7f538406edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:12.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.389+0000 7f538a4e9700 1 -- 172.21.15.26:0/1266832590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f538409d6f0 msgr2=0x7f538406e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:12.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.389+0000 7f538a4e9700 1 --2- 172.21.15.26:0/1266832590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f538409d6f0 0x7f538406e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:12.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.389+0000 7f538a4e9700 1 -- 172.21.15.26:0/1266832590 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53800094a0 con 0x7f538409e410 2023-10-01T08:00:12.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.389+0000 7f538a4e9700 1 --2- 172.21.15.26:0/1266832590 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f538409e410 0x7f538406f2f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f537c00efc0 tx=0x7f537c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:12.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.389+0000 7f537a7fc700 1 -- 172.21.15.26:0/1266832590 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537c003c20 con 0x7f538409e410 2023-10-01T08:00:12.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.389+0000 7f537a7fc700 1 -- 172.21.15.26:0/1266832590 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537c00f040 con 0x7f538409e410 2023-10-01T08:00:12.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.389+0000 7f537a7fc700 1 -- 172.21.15.26:0/1266832590 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537c009e60 con 0x7f538409e410 2023-10-01T08:00:12.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.389+0000 7f538bf4c700 1 -- 172.21.15.26:0/1266832590 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f538409c700 con 0x7f538409e410 2023-10-01T08:00:12.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.389+0000 7f538bf4c700 1 -- 172.21.15.26:0/1266832590 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53841247e0 con 0x7f538409e410 2023-10-01T08:00:12.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.390+0000 7f538bf4c700 1 -- 172.21.15.26:0/1266832590 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5384074ea0 con 0x7f538409e410 2023-10-01T08:00:12.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.391+0000 7f537a7fc700 1 -- 172.21.15.26:0/1266832590 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f537c00c880 con 0x7f538409e410 2023-10-01T08:00:12.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.391+0000 7f537a7fc700 1 -- 172.21.15.26:0/1266832590 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f537c0406a0 con 0x7f538409e410 2023-10-01T08:00:12.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.395+0000 7f537a7fc700 1 -- 172.21.15.26:0/1266832590 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f537c013b80 con 0x7f538409e410 2023-10-01T08:00:12.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.558+0000 7fefa804b700 1 -- 172.21.15.26:0/3155630481 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fefa006eb00 con 0x7fefa0131810 2023-10-01T08:00:12.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.559+0000 7fef967fc700 1 -- 172.21.15.26:0/3155630481 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fef98024360 con 0x7fefa0131810 2023-10-01T08:00:12.559 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:12.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.561+0000 7fefa804b700 1 -- 172.21.15.26:0/3155630481 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fefa0131810 msgr2=0x7fefa011c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:12.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.561+0000 7fefa804b700 1 --2- 172.21.15.26:0/3155630481 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fefa0131810 0x7fefa011c2d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fef98015000 tx=0x7fef98004ad0 comp rx=0 tx=0).stop 2023-10-01T08:00:12.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.561+0000 7fefa804b700 1 -- 172.21.15.26:0/3155630481 shutdown_connections 2023-10-01T08:00:12.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.561+0000 7fefa804b700 1 --2- 172.21.15.26:0/3155630481 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fefa0131810 0x7fefa011c2d0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:12.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.561+0000 7fefa804b700 1 --2- 172.21.15.26:0/3155630481 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fefa0099a40 0x7fefa011b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:12.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.561+0000 7fefa804b700 1 --2- 172.21.15.26:0/3155630481 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefa009a580 0x7fefa011bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:12.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.561+0000 7fefa804b700 1 -- 172.21.15.26:0/3155630481 >> 172.21.15.26:0/3155630481 conn(0x7fefa00a2aa0 msgr2=0x7fefa01b7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:12.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.561+0000 7fefa804b700 1 -- 172.21.15.26:0/3155630481 shutdown_connections 2023-10-01T08:00:12.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.561+0000 7fefa804b700 1 -- 172.21.15.26:0/3155630481 wait complete. 2023-10-01T08:00:12.575 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:12.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.598+0000 7f4b0a16b700 1 -- 172.21.15.26:0/4263717394 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4b041a7b10 con 0x7f4b0409e410 2023-10-01T08:00:12.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.598+0000 7f4aebfff700 1 -- 172.21.15.26:0/4263717394 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4afc01a3b0 con 0x7f4b0409e410 2023-10-01T08:00:12.599 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:12.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.600+0000 7f4b0a16b700 1 -- 172.21.15.26:0/4263717394 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b0409e410 msgr2=0x7f4b041a6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:12.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.600+0000 7f4b0a16b700 1 --2- 172.21.15.26:0/4263717394 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b0409e410 0x7f4b041a6910 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f4afc00cc80 tx=0x7f4afc00cf90 comp rx=0 tx=0).stop 2023-10-01T08:00:12.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.600+0000 7f4b0a16b700 1 -- 172.21.15.26:0/4263717394 shutdown_connections 2023-10-01T08:00:12.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.600+0000 7f4b0a16b700 1 --2- 172.21.15.26:0/4263717394 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b0409e410 0x7f4b041a6910 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:12.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.600+0000 7f4b0a16b700 1 --2- 172.21.15.26:0/4263717394 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4b0409d6f0 0x7f4b041a5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:12.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.600+0000 7f4b0a16b700 1 --2- 172.21.15.26:0/4263717394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b0409e000 0x7f4b041a63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:12.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.600+0000 7f4b0a16b700 1 -- 172.21.15.26:0/4263717394 >> 172.21.15.26:0/4263717394 conn(0x7f4b04066f50 msgr2=0x7f4b041badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:12.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.600+0000 7f4b0a16b700 1 -- 172.21.15.26:0/4263717394 shutdown_connections 2023-10-01T08:00:12.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.601+0000 7f4b0a16b700 1 -- 172.21.15.26:0/4263717394 wait complete. 2023-10-01T08:00:12.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.602+0000 7f538bf4c700 1 -- 172.21.15.26:0/1266832590 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f538406c360 con 0x7f538409e410 2023-10-01T08:00:12.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.602+0000 7f537a7fc700 1 -- 172.21.15.26:0/1266832590 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f537c02c090 con 0x7f538409e410 2023-10-01T08:00:12.603 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:12.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.605+0000 7f538bf4c700 1 -- 172.21.15.26:0/1266832590 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f538409e410 msgr2=0x7f538406f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:12.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.605+0000 7f538bf4c700 1 --2- 172.21.15.26:0/1266832590 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f538409e410 0x7f538406f2f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f537c00efc0 tx=0x7f537c00c3a0 comp rx=0 tx=0).stop 2023-10-01T08:00:12.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.605+0000 7f538bf4c700 1 -- 172.21.15.26:0/1266832590 shutdown_connections 2023-10-01T08:00:12.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.605+0000 7f538bf4c700 1 --2- 172.21.15.26:0/1266832590 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f538409e410 0x7f538406f2f0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:12.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.605+0000 7f538bf4c700 1 --2- 172.21.15.26:0/1266832590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f538409d6f0 0x7f538406e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:12.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.605+0000 7f538bf4c700 1 --2- 172.21.15.26:0/1266832590 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f538409e000 0x7f538406edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:12.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.605+0000 7f538bf4c700 1 -- 172.21.15.26:0/1266832590 >> 172.21.15.26:0/1266832590 conn(0x7f5384066f50 msgr2=0x7f538406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:12.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.605+0000 7f538bf4c700 1 -- 172.21.15.26:0/1266832590 shutdown_connections 2023-10-01T08:00:12.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:12.605+0000 7f538bf4c700 1 -- 172.21.15.26:0/1266832590 wait complete. 2023-10-01T08:00:12.616 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:12.620 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:13.383 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:13.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.529+0000 7f437519d700 1 Processor -- start 2023-10-01T08:00:13.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.529+0000 7f437519d700 1 -- start start 2023-10-01T08:00:13.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.529+0000 7f437519d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f437009e1d0 0x7f4370138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:13.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.529+0000 7f437519d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4370139170 0x7f437013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:13.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.529+0000 7f437519d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f437009b120 con 0x7f437009d6f0 2023-10-01T08:00:13.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.529+0000 7f437519d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f437006b460 con 0x7f4370139170 2023-10-01T08:00:13.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.529+0000 7f437519d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f437009a7e0 con 0x7f437009e1d0 2023-10-01T08:00:13.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.530+0000 7f436e59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f437009e1d0 0x7f4370138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:13.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.530+0000 7f436f59e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4370139170 0x7f437013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:13.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.530+0000 7f436e59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f437009e1d0 0x7f4370138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46862/0 (socket says 172.21.15.26:46862) 2023-10-01T08:00:13.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.530+0000 7f436f59e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4370139170 0x7f437013b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48760/0 (socket says 172.21.15.26:48760) 2023-10-01T08:00:13.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.530+0000 7f436e59c700 1 -- 172.21.15.26:0/1026026133 learned_addr learned my addr 172.21.15.26:0/1026026133 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:13.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.530+0000 7f436e59c700 1 -- 172.21.15.26:0/1026026133 >> v2:172.21.15.26:3300/0 conn(0x7f4370139170 msgr2=0x7f437013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:13.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.530+0000 7f436e59c700 1 --2- 172.21.15.26:0/1026026133 >> v2:172.21.15.26:3300/0 conn(0x7f4370139170 0x7f437013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:13.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.530+0000 7f436e59c700 1 -- 172.21.15.26:0/1026026133 >> v1:172.21.15.26:6789/0 conn(0x7f437009d6f0 legacy=0x7f437009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:13.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.530+0000 7f436e59c700 1 -- 172.21.15.26:0/1026026133 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f437009a500 con 0x7f437009e1d0 2023-10-01T08:00:13.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.530+0000 7f436f59e700 1 --2- 172.21.15.26:0/1026026133 >> v2:172.21.15.26:3300/0 conn(0x7f4370139170 0x7f437013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:13.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.530+0000 7f436e59c700 1 --2- 172.21.15.26:0/1026026133 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f437009e1d0 0x7f4370138c30 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f4360009920 tx=0x7f4360009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a9d5a9b56db790e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:13.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.530+0000 7f436dd9b700 1 -- 172.21.15.26:0/1026026133 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4360011830 con 0x7f437009e1d0 2023-10-01T08:00:13.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.530+0000 7f436dd9b700 1 -- 172.21.15.26:0/1026026133 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4360011990 con 0x7f437009e1d0 2023-10-01T08:00:13.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.530+0000 7f436dd9b700 1 -- 172.21.15.26:0/1026026133 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4360011d20 con 0x7f437009e1d0 2023-10-01T08:00:13.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.531+0000 7f437519d700 1 -- 172.21.15.26:0/1026026133 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f437009e1d0 msgr2=0x7f4370138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:13.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.531+0000 7f437519d700 1 --2- 172.21.15.26:0/1026026133 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f437009e1d0 0x7f4370138c30 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f4360009920 tx=0x7f4360009c30 comp rx=0 tx=0).stop 2023-10-01T08:00:13.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.531+0000 7f437519d700 1 -- 172.21.15.26:0/1026026133 shutdown_connections 2023-10-01T08:00:13.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.531+0000 7f437519d700 1 --2- 172.21.15.26:0/1026026133 >> v2:172.21.15.26:3300/0 conn(0x7f4370139170 0x7f437013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:13.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.531+0000 7f437519d700 1 --2- 172.21.15.26:0/1026026133 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f437009e1d0 0x7f4370138c30 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:13.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.531+0000 7f437519d700 1 -- 172.21.15.26:0/1026026133 >> 172.21.15.26:0/1026026133 conn(0x7f4370066f50 msgr2=0x7f437009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:13.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.531+0000 7f437519d700 1 -- 172.21.15.26:0/1026026133 shutdown_connections 2023-10-01T08:00:13.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.531+0000 7f437519d700 1 -- 172.21.15.26:0/1026026133 wait complete. 2023-10-01T08:00:13.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.532+0000 7f437519d700 1 Processor -- start 2023-10-01T08:00:13.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.532+0000 7f437519d700 1 -- start start 2023-10-01T08:00:13.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.533+0000 7f437519d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f437009d6f0 0x7f4370122470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:13.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.533+0000 7f437519d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f437009e1d0 0x7f43701229b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:13.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.533+0000 7f437519d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4370139170 0x7f43701c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:13.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.533+0000 7f437519d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4370122000 con 0x7f437009e1d0 2023-10-01T08:00:13.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.533+0000 7f437519d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4370124fd0 con 0x7f4370139170 2023-10-01T08:00:13.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.533+0000 7f437519d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43700a2a90 con 0x7f437009d6f0 2023-10-01T08:00:13.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.533+0000 7f436f59e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4370139170 0x7f43701c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:13.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.533+0000 7f436ed9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f437009d6f0 0x7f4370122470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:13.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.533+0000 7f436f59e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4370139170 0x7f43701c8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46876/0 (socket says 172.21.15.26:46876) 2023-10-01T08:00:13.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.533+0000 7f436f59e700 1 -- 172.21.15.26:0/2111233763 learned_addr learned my addr 172.21.15.26:0/2111233763 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:13.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.533+0000 7f436e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f437009e1d0 0x7f43701229b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:13.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.533+0000 7f436f59e700 1 -- 172.21.15.26:0/2111233763 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f437009d6f0 msgr2=0x7f4370122470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:13.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.533+0000 7f436f59e700 1 --2- 172.21.15.26:0/2111233763 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f437009d6f0 0x7f4370122470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:13.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.533+0000 7f436f59e700 1 -- 172.21.15.26:0/2111233763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f437009e1d0 msgr2=0x7f43701229b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:13.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.533+0000 7f436f59e700 1 --2- 172.21.15.26:0/2111233763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f437009e1d0 0x7f43701229b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:13.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.533+0000 7f436f59e700 1 -- 172.21.15.26:0/2111233763 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4368009a70 con 0x7f4370139170 2023-10-01T08:00:13.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.533+0000 7f436ed9d700 1 --2- 172.21.15.26:0/2111233763 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f437009d6f0 0x7f4370122470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:13.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.533+0000 7f436e59c700 1 --2- 172.21.15.26:0/2111233763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f437009e1d0 0x7f43701229b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:13.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.533+0000 7f436f59e700 1 --2- 172.21.15.26:0/2111233763 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4370139170 0x7f43701c8360 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f436800efc0 tx=0x7f436800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:13.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.534+0000 7f43677fe700 1 -- 172.21.15.26:0/2111233763 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436800ca90 con 0x7f4370139170 2023-10-01T08:00:13.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.534+0000 7f43677fe700 1 -- 172.21.15.26:0/2111233763 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436800f040 con 0x7f4370139170 2023-10-01T08:00:13.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.534+0000 7f437519d700 1 -- 172.21.15.26:0/2111233763 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4360009550 con 0x7f4370139170 2023-10-01T08:00:13.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.534+0000 7f43677fe700 1 -- 172.21.15.26:0/2111233763 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436800ce10 con 0x7f4370139170 2023-10-01T08:00:13.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.534+0000 7f437519d700 1 -- 172.21.15.26:0/2111233763 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4370125d00 con 0x7f4370139170 2023-10-01T08:00:13.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.535+0000 7f43677fe700 1 -- 172.21.15.26:0/2111233763 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4368014480 con 0x7f4370139170 2023-10-01T08:00:13.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.535+0000 7f43677fe700 1 -- 172.21.15.26:0/2111233763 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f436803fd80 con 0x7f4370139170 2023-10-01T08:00:13.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.535+0000 7f437519d700 1 -- 172.21.15.26:0/2111233763 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4370074ea0 con 0x7f4370139170 2023-10-01T08:00:13.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.540+0000 7f43677fe700 1 -- 172.21.15.26:0/2111233763 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4368012930 con 0x7f4370139170 2023-10-01T08:00:13.576 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:13.617 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:13.620 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:13.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.723+0000 7f924d986700 1 Processor -- start 2023-10-01T08:00:13.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.723+0000 7f924d986700 1 -- start start 2023-10-01T08:00:13.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.723+0000 7f924d986700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9248130540 0x7f9248130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:13.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.723+0000 7f924d986700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f924806fcf0 0x7f9248138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:13.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.723+0000 7f924d986700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92480716a0 con 0x7f9248130e50 2023-10-01T08:00:13.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.723+0000 7f924d986700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f924809a390 con 0x7f924806fcf0 2023-10-01T08:00:13.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.723+0000 7f924d986700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9248071290 con 0x7f9248130540 2023-10-01T08:00:13.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.724+0000 7f92467fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9248130e50 0x7f924806f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44570/0 (socket says 172.21.15.26:44570) 2023-10-01T08:00:13.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.724+0000 7f9246ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9248130540 0x7f9248130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:13.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.724+0000 7f92467fc700 1 -- 172.21.15.26:0/2511876007 learned_addr learned my addr 172.21.15.26:0/2511876007 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:13.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.724+0000 7f92477fe700 1 --2- 172.21.15.26:0/2511876007 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f924806fcf0 0x7f9248138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:13.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.724+0000 7f92477fe700 1 -- 172.21.15.26:0/2511876007 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9248130540 msgr2=0x7f9248130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:13.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.724+0000 7f92477fe700 1 --2- 172.21.15.26:0/2511876007 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9248130540 0x7f9248130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:13.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.724+0000 7f92477fe700 1 -- 172.21.15.26:0/2511876007 >> v1:172.21.15.26:6789/0 conn(0x7f9248130e50 legacy=0x7f924806f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:13.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.724+0000 7f92477fe700 1 -- 172.21.15.26:0/2511876007 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9248130340 con 0x7f924806fcf0 2023-10-01T08:00:13.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.724+0000 7f92477fe700 1 --2- 172.21.15.26:0/2511876007 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f924806fcf0 0x7f9248138570 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f9240009dc0 tx=0x7f924000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=886bc42d948c5521 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:13.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.724+0000 7f9245ffb700 1 -- 172.21.15.26:0/2511876007 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924000e070 con 0x7f924806fcf0 2023-10-01T08:00:13.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.725+0000 7f9245ffb700 1 -- 172.21.15.26:0/2511876007 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9240003a20 con 0x7f924806fcf0 2023-10-01T08:00:13.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.725+0000 7f9245ffb700 1 -- 172.21.15.26:0/2511876007 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9240003dd0 con 0x7f924806fcf0 2023-10-01T08:00:13.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.725+0000 7f924d986700 1 -- 172.21.15.26:0/2511876007 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f924806fcf0 msgr2=0x7f9248138570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:13.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.725+0000 7f924d986700 1 --2- 172.21.15.26:0/2511876007 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f924806fcf0 0x7f9248138570 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f9240009dc0 tx=0x7f924000b330 comp rx=0 tx=0).stop 2023-10-01T08:00:13.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.725+0000 7f924d986700 1 -- 172.21.15.26:0/2511876007 shutdown_connections 2023-10-01T08:00:13.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.725+0000 7f924d986700 1 --2- 172.21.15.26:0/2511876007 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9248130540 0x7f9248130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:13.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.725+0000 7f924d986700 1 --2- 172.21.15.26:0/2511876007 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f924806fcf0 0x7f9248138570 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:13.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.725+0000 7f924d986700 1 -- 172.21.15.26:0/2511876007 >> 172.21.15.26:0/2511876007 conn(0x7f92480a2aa0 msgr2=0x7f92480a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:13.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.725+0000 7f924d986700 1 -- 172.21.15.26:0/2511876007 shutdown_connections 2023-10-01T08:00:13.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.725+0000 7f924d986700 1 -- 172.21.15.26:0/2511876007 wait complete. 2023-10-01T08:00:13.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.726+0000 7f924d986700 1 Processor -- start 2023-10-01T08:00:13.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.727+0000 7f924d986700 1 -- start start 2023-10-01T08:00:13.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.727+0000 7f924d986700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f924806fcf0 0x7f92481287e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:13.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.727+0000 7f924d986700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9248130540 0x7f9248128d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:13.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.727+0000 7f924d986700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9248130e50 0x7f92481c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:13.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.727+0000 7f924d986700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924812ad70 con 0x7f9248130e50 2023-10-01T08:00:13.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.727+0000 7f924d986700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92480a0780 con 0x7f924806fcf0 2023-10-01T08:00:13.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.727+0000 7f924d986700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9248128390 con 0x7f9248130540 2023-10-01T08:00:13.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.727+0000 7f9246ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f924806fcf0 0x7f92481287e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:13.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.727+0000 7f9246ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f924806fcf0 0x7f92481287e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46892/0 (socket says 172.21.15.26:46892) 2023-10-01T08:00:13.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.727+0000 7f9246ffd700 1 -- 172.21.15.26:0/106464954 learned_addr learned my addr 172.21.15.26:0/106464954 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:13.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.728+0000 7f92467fc700 1 --2- 172.21.15.26:0/106464954 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9248130540 0x7f9248128d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:13.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.728+0000 7f92477fe700 1 --2- 172.21.15.26:0/106464954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9248130e50 0x7f92481c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:13.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.728+0000 7f92467fc700 1 -- 172.21.15.26:0/106464954 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f924806fcf0 msgr2=0x7f92481287e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:13.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.728+0000 7f92467fc700 1 --2- 172.21.15.26:0/106464954 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f924806fcf0 0x7f92481287e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:13.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.728+0000 7f92467fc700 1 -- 172.21.15.26:0/106464954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9248130e50 msgr2=0x7f92481c5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:13.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.728+0000 7f92467fc700 1 --2- 172.21.15.26:0/106464954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9248130e50 0x7f92481c5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:13.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.728+0000 7f92467fc700 1 -- 172.21.15.26:0/106464954 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9240009a70 con 0x7f9248130540 2023-10-01T08:00:13.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.728+0000 7f9246ffd700 1 --2- 172.21.15.26:0/106464954 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f924806fcf0 0x7f92481287e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:13.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.728+0000 7f92467fc700 1 --2- 172.21.15.26:0/106464954 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9248130540 0x7f9248128d20 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f923c00c750 tx=0x7f923c00ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:13.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.728+0000 7f922ffff700 1 -- 172.21.15.26:0/106464954 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923c004c80 con 0x7f9248130540 2023-10-01T08:00:13.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.728+0000 7f922ffff700 1 -- 172.21.15.26:0/106464954 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923c004de0 con 0x7f9248130540 2023-10-01T08:00:13.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.729+0000 7f924d986700 1 -- 172.21.15.26:0/106464954 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f924812aa20 con 0x7f9248130540 2023-10-01T08:00:13.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.729+0000 7f922ffff700 1 -- 172.21.15.26:0/106464954 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923c007310 con 0x7f9248130540 2023-10-01T08:00:13.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.729+0000 7f924d986700 1 -- 172.21.15.26:0/106464954 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f924809dcd0 con 0x7f9248130540 2023-10-01T08:00:13.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.730+0000 7f924d986700 1 -- 172.21.15.26:0/106464954 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9248074ea0 con 0x7f9248130540 2023-10-01T08:00:13.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.731+0000 7f922ffff700 1 -- 172.21.15.26:0/106464954 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f923c007470 con 0x7f9248130540 2023-10-01T08:00:13.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.731+0000 7f922ffff700 1 -- 172.21.15.26:0/106464954 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f923c0133c0 con 0x7f9248130540 2023-10-01T08:00:13.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.740+0000 7f922ffff700 1 -- 172.21.15.26:0/106464954 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f923c007720 con 0x7f9248130540 2023-10-01T08:00:13.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.766+0000 7f3604c68700 1 Processor -- start 2023-10-01T08:00:13.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.766+0000 7f3604c68700 1 -- start start 2023-10-01T08:00:13.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.767+0000 7f3604c68700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f360012cf60 0x7f360006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:13.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.767+0000 7f3604c68700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3600130430 0x7f3600137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:13.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.767+0000 7f3604c68700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f360012cd90 con 0x7f360012f8b0 2023-10-01T08:00:13.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.767+0000 7f3604c68700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f360012d330 con 0x7f3600130430 2023-10-01T08:00:13.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.767+0000 7f3604c68700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3600071780 con 0x7f360012cf60 2023-10-01T08:00:13.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.767+0000 7f35fe59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f360012cf60 0x7f360006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:13.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.767+0000 7f35fe59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f360012cf60 0x7f360006f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:46988/0 (socket says 172.21.15.26:46988) 2023-10-01T08:00:13.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.767+0000 7f35fe59c700 1 -- 172.21.15.26:0/3987496771 learned_addr learned my addr 172.21.15.26:0/3987496771 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:13.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.767+0000 7f35fed9d700 1 --2- 172.21.15.26:0/3987496771 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3600130430 0x7f3600137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.768+0000 7f35fe59c700 1 -- 172.21.15.26:0/3987496771 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3600130430 msgr2=0x7f3600137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.768+0000 7f35fe59c700 1 --2- 172.21.15.26:0/3987496771 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3600130430 0x7f3600137c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.768+0000 7f35fe59c700 1 -- 172.21.15.26:0/3987496771 >> v1:172.21.15.26:6789/0 conn(0x7f360012f8b0 legacy=0x7f360012fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.768+0000 7f35fe59c700 1 -- 172.21.15.26:0/3987496771 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3600071a40 con 0x7f360012cf60 2023-10-01T08:00:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.768+0000 7f35fe59c700 1 --2- 172.21.15.26:0/3987496771 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f360012cf60 0x7f360006f5d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f35f0009920 tx=0x7f35f0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4a40e374ab59b17 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.768+0000 7f7f95aaf700 1 Processor -- start 2023-10-01T08:00:13.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.768+0000 7f35fd59a700 1 -- 172.21.15.26:0/3987496771 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f0011830 con 0x7f360012cf60 2023-10-01T08:00:13.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.768+0000 7f35fd59a700 1 -- 172.21.15.26:0/3987496771 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f0011990 con 0x7f360012cf60 2023-10-01T08:00:13.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.768+0000 7f35fd59a700 1 -- 172.21.15.26:0/3987496771 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f0011d20 con 0x7f360012cf60 2023-10-01T08:00:13.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.768+0000 7f7f95aaf700 1 -- start start 2023-10-01T08:00:13.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.769+0000 7f7f95aaf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7f900a0a30 0x7f7f900a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:13.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.769+0000 7f7f95aaf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f9009d630 0x7f7f900a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:13.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.769+0000 7f7f95aaf700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7f90133930 0x7f7f90133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:13.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.769+0000 7f7f95aaf700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f900a2a70 con 0x7f7f90133930 2023-10-01T08:00:13.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.769+0000 7f7f95aaf700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f900a01d0 con 0x7f7f9009d630 2023-10-01T08:00:13.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.769+0000 7f7f95aaf700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9009e2b0 con 0x7f7f900a0a30 2023-10-01T08:00:13.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.769+0000 7f7f8effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f9009d630 0x7f7f900a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:13.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.769+0000 7f7f8effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f9009d630 0x7f7f900a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46912/0 (socket says 172.21.15.26:46912) 2023-10-01T08:00:13.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.769+0000 7f7f8ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7f90133930 0x7f7f90133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:13.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.769+0000 7f7f8effd700 1 -- 172.21.15.26:0/2402419536 learned_addr learned my addr 172.21.15.26:0/2402419536 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:13.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.769+0000 7f7f8f7fe700 1 --2- 172.21.15.26:0/2402419536 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7f900a0a30 0x7f7f900a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:13.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.769+0000 7f3604c68700 1 -- 172.21.15.26:0/3987496771 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f360012cf60 msgr2=0x7f360006f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:13.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.769+0000 7f3604c68700 1 --2- 172.21.15.26:0/3987496771 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f360012cf60 0x7f360006f5d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f35f0009920 tx=0x7f35f0009c30 comp rx=0 tx=0).stop 2023-10-01T08:00:13.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.770+0000 7f7f8effd700 1 -- 172.21.15.26:0/2402419536 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7f900a0a30 msgr2=0x7f7f900a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:13.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.770+0000 7f7f8effd700 1 --2- 172.21.15.26:0/2402419536 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7f900a0a30 0x7f7f900a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:13.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.770+0000 7f7f8effd700 1 -- 172.21.15.26:0/2402419536 >> v2:172.21.15.26:3300/0 conn(0x7f7f90133930 msgr2=0x7f7f90133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:13.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.770+0000 7f7f8effd700 1 --2- 172.21.15.26:0/2402419536 >> v2:172.21.15.26:3300/0 conn(0x7f7f90133930 0x7f7f90133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:13.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.770+0000 7f7f8effd700 1 -- 172.21.15.26:0/2402419536 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f9009dc50 con 0x7f7f9009d630 2023-10-01T08:00:13.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.770+0000 7f3604c68700 1 -- 172.21.15.26:0/3987496771 shutdown_connections 2023-10-01T08:00:13.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.770+0000 7f3604c68700 1 --2- 172.21.15.26:0/3987496771 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f360012cf60 0x7f360006f5d0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:13.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.770+0000 7f3604c68700 1 --2- 172.21.15.26:0/3987496771 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3600130430 0x7f3600137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:13.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.770+0000 7f3604c68700 1 -- 172.21.15.26:0/3987496771 >> 172.21.15.26:0/3987496771 conn(0x7f36000a2aa0 msgr2=0x7f36000a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:13.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.770+0000 7f3604c68700 1 -- 172.21.15.26:0/3987496771 shutdown_connections 2023-10-01T08:00:13.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.770+0000 7f3604c68700 1 -- 172.21.15.26:0/3987496771 wait complete. 2023-10-01T08:00:13.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.770+0000 7f7f8effd700 1 --2- 172.21.15.26:0/2402419536 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f9009d630 0x7f7f900a1340 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f7f800098f0 tx=0x7f7f80009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e8bef012fc19e64 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:13.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.770+0000 7f7f8e7fc700 1 -- 172.21.15.26:0/2402419536 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f80011830 con 0x7f7f9009d630 2023-10-01T08:00:13.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.770+0000 7f7f8e7fc700 1 -- 172.21.15.26:0/2402419536 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f80011990 con 0x7f7f9009d630 2023-10-01T08:00:13.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.770+0000 7f7f8e7fc700 1 -- 172.21.15.26:0/2402419536 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f80011d20 con 0x7f7f9009d630 2023-10-01T08:00:13.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.771+0000 7f7f95aaf700 1 -- 172.21.15.26:0/2402419536 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f9009d630 msgr2=0x7f7f900a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:13.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.771+0000 7f7f95aaf700 1 --2- 172.21.15.26:0/2402419536 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f9009d630 0x7f7f900a1340 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f7f800098f0 tx=0x7f7f80009c00 comp rx=0 tx=0).stop 2023-10-01T08:00:13.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.771+0000 7f7f95aaf700 1 -- 172.21.15.26:0/2402419536 shutdown_connections 2023-10-01T08:00:13.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.771+0000 7f7f95aaf700 1 --2- 172.21.15.26:0/2402419536 >> v2:172.21.15.26:3300/0 conn(0x7f7f90133930 0x7f7f90133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:13.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.771+0000 7f7f95aaf700 1 --2- 172.21.15.26:0/2402419536 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7f900a0a30 0x7f7f900a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:13.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.771+0000 7f7f95aaf700 1 --2- 172.21.15.26:0/2402419536 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f9009d630 0x7f7f900a1340 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:13.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.771+0000 7f7f95aaf700 1 -- 172.21.15.26:0/2402419536 >> 172.21.15.26:0/2402419536 conn(0x7f7f900a3050 msgr2=0x7f7f900a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:13.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.771+0000 7f7f95aaf700 1 -- 172.21.15.26:0/2402419536 shutdown_connections 2023-10-01T08:00:13.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.771+0000 7f3604c68700 1 Processor -- start 2023-10-01T08:00:13.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.771+0000 7f7f95aaf700 1 -- 172.21.15.26:0/2402419536 wait complete. 2023-10-01T08:00:13.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.772+0000 7f3604c68700 1 -- start start 2023-10-01T08:00:13.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.772+0000 7f3604c68700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f360012f8b0 0x7f3600118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:13.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.772+0000 7f3604c68700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3600130430 0x7f3600119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:13.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.772+0000 7f3604c68700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3600119750 0x7f36001caa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:13.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.772+0000 7f3604c68700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360011cb40 con 0x7f3600119750 2023-10-01T08:00:13.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.772+0000 7f3604c68700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3600119b80 con 0x7f360012f8b0 2023-10-01T08:00:13.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.772+0000 7f3604c68700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f360011c160 con 0x7f3600130430 2023-10-01T08:00:13.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.772+0000 7f35fe59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f360012f8b0 0x7f3600118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:13.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.772+0000 7f35fe59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f360012f8b0 0x7f3600118cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46920/0 (socket says 172.21.15.26:46920) 2023-10-01T08:00:13.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.772+0000 7f35fe59c700 1 -- 172.21.15.26:0/1770890435 learned_addr learned my addr 172.21.15.26:0/1770890435 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:13.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.772+0000 7f35fdd9b700 1 --2- 172.21.15.26:0/1770890435 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3600130430 0x7f3600119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:13.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.773+0000 7f7f95aaf700 1 Processor -- start 2023-10-01T08:00:13.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.773+0000 7f35fe59c700 1 -- 172.21.15.26:0/1770890435 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3600130430 msgr2=0x7f3600119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:13.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.773+0000 7f35fe59c700 1 --2- 172.21.15.26:0/1770890435 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3600130430 0x7f3600119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:13.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.773+0000 7f35fe59c700 1 -- 172.21.15.26:0/1770890435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3600119750 msgr2=0x7f36001caa20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T08:00:13.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.773+0000 7f35fe59c700 1 --2- 172.21.15.26:0/1770890435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3600119750 0x7f36001caa20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:13.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.773+0000 7f35fe59c700 1 -- 172.21.15.26:0/1770890435 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f0009550 con 0x7f360012f8b0 2023-10-01T08:00:13.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.773+0000 7f35fe59c700 1 --2- 172.21.15.26:0/1770890435 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f360012f8b0 0x7f3600118cd0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f35f0013000 tx=0x7f35f0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:13.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.773+0000 7f35eeffd700 1 -- 172.21.15.26:0/1770890435 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f0026070 con 0x7f360012f8b0 2023-10-01T08:00:13.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.773+0000 7f35eeffd700 1 -- 172.21.15.26:0/1770890435 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f0012b90 con 0x7f360012f8b0 2023-10-01T08:00:13.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.773+0000 7f3604c68700 1 -- 172.21.15.26:0/1770890435 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f360011a2f0 con 0x7f360012f8b0 2023-10-01T08:00:13.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.773+0000 7f3604c68700 1 -- 172.21.15.26:0/1770890435 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f360012d940 con 0x7f360012f8b0 2023-10-01T08:00:13.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.773+0000 7f35eeffd700 1 -- 172.21.15.26:0/1770890435 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f0004040 con 0x7f360012f8b0 2023-10-01T08:00:13.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.775+0000 7f437519d700 1 -- 172.21.15.26:0/2111233763 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f43701251d0 con 0x7f4370139170 2023-10-01T08:00:13.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.773+0000 7f7f95aaf700 1 -- start start 2023-10-01T08:00:13.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.774+0000 7f7f95aaf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f9009d630 0x7f7f9006dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:13.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.774+0000 7f7f95aaf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f900a0a30 0x7f7f9006e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:13.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.774+0000 7f7f95aaf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7f90133930 0x7f7f9006e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:13.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.774+0000 7f7f95aaf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9006f740 con 0x7f7f900a0a30 2023-10-01T08:00:13.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.774+0000 7f7f95aaf700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f90070fa0 con 0x7f7f9009d630 2023-10-01T08:00:13.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.774+0000 7f7f95aaf700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9006fbe0 con 0x7f7f90133930 2023-10-01T08:00:13.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.774+0000 7f7f8effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f900a0a30 0x7f7f9006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:13.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.774+0000 7f7f8f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f9009d630 0x7f7f9006dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:13.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.774+0000 7f7f8f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f9009d630 0x7f7f9006dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46928/0 (socket says 172.21.15.26:46928) 2023-10-01T08:00:13.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.774+0000 7f7f8effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f900a0a30 0x7f7f9006e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48796/0 (socket says 172.21.15.26:48796) 2023-10-01T08:00:13.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.774+0000 7f7f8f7fe700 1 -- 172.21.15.26:0/2652708575 learned_addr learned my addr 172.21.15.26:0/2652708575 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:13.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.774+0000 7f7f8effd700 1 -- 172.21.15.26:0/2652708575 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7f90133930 msgr2=0x7f7f9006e540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T08:00:13.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.774+0000 7f7f8effd700 1 --2- 172.21.15.26:0/2652708575 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7f90133930 0x7f7f9006e540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:13.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.774+0000 7f7f8effd700 1 -- 172.21.15.26:0/2652708575 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f9009d630 msgr2=0x7f7f9006dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:13.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.774+0000 7f7f8effd700 1 --2- 172.21.15.26:0/2652708575 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f9009d630 0x7f7f9006dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:13.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.774+0000 7f7f8effd700 1 -- 172.21.15.26:0/2652708575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f80009550 con 0x7f7f900a0a30 2023-10-01T08:00:13.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.774+0000 7f7f8f7fe700 1 --2- 172.21.15.26:0/2652708575 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f9009d630 0x7f7f9006dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:13.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.774+0000 7f7f8effd700 1 --2- 172.21.15.26:0/2652708575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f900a0a30 0x7f7f9006e000 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f7f80016000 tx=0x7f7f80004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:13.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.775+0000 7f7f87fff700 1 -- 172.21.15.26:0/2652708575 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f80004450 con 0x7f7f900a0a30 2023-10-01T08:00:13.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.775+0000 7f7f87fff700 1 -- 172.21.15.26:0/2652708575 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f800045b0 con 0x7f7f900a0a30 2023-10-01T08:00:13.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.775+0000 7f7f87fff700 1 -- 172.21.15.26:0/2652708575 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f800038c0 con 0x7f7f900a0a30 2023-10-01T08:00:13.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.775+0000 7f7f95aaf700 1 -- 172.21.15.26:0/2652708575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f90071260 con 0x7f7f900a0a30 2023-10-01T08:00:13.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.775+0000 7f35eeffd700 1 -- 172.21.15.26:0/1770890435 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f35f002a070 con 0x7f360012f8b0 2023-10-01T08:00:13.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.775+0000 7f7f95aaf700 1 -- 172.21.15.26:0/2652708575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f901cc5c0 con 0x7f7f900a0a30 2023-10-01T08:00:13.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.775+0000 7f43677fe700 1 -- 172.21.15.26:0/2111233763 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f43701251d0 con 0x7f4370139170 2023-10-01T08:00:13.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.775+0000 7f35eeffd700 1 -- 172.21.15.26:0/1770890435 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f35f00036a0 con 0x7f360012f8b0 2023-10-01T08:00:13.788 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:13.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.776+0000 7f7f87fff700 1 -- 172.21.15.26:0/2652708575 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7f80043070 con 0x7f7f900a0a30 2023-10-01T08:00:13.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.776+0000 7f7f87fff700 1 -- 172.21.15.26:0/2652708575 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7f80062a30 con 0x7f7f900a0a30 2023-10-01T08:00:13.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.776+0000 7f7f95aaf700 1 -- 172.21.15.26:0/2652708575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f90071e20 con 0x7f7f900a0a30 2023-10-01T08:00:13.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.776+0000 7f3604c68700 1 -- 172.21.15.26:0/1770890435 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35e40052e0 con 0x7f360012f8b0 2023-10-01T08:00:13.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.781+0000 7f35eeffd700 1 -- 172.21.15.26:0/1770890435 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f35f0031080 con 0x7f360012f8b0 2023-10-01T08:00:13.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.781+0000 7f437519d700 1 -- 172.21.15.26:0/2111233763 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4370139170 msgr2=0x7f43701c8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:13.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.781+0000 7f437519d700 1 --2- 172.21.15.26:0/2111233763 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4370139170 0x7f43701c8360 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f436800efc0 tx=0x7f436800c3a0 comp rx=0 tx=0).stop 2023-10-01T08:00:13.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.781+0000 7f7f87fff700 1 -- 172.21.15.26:0/2652708575 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7f8004b020 con 0x7f7f900a0a30 2023-10-01T08:00:13.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.782+0000 7f437519d700 1 -- 172.21.15.26:0/2111233763 shutdown_connections 2023-10-01T08:00:13.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.782+0000 7f437519d700 1 --2- 172.21.15.26:0/2111233763 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4370139170 0x7f43701c8360 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:13.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.782+0000 7f437519d700 1 --2- 172.21.15.26:0/2111233763 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f437009d6f0 0x7f4370122470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:13.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.782+0000 7f437519d700 1 --2- 172.21.15.26:0/2111233763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f437009e1d0 0x7f43701229b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:13.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.782+0000 7f437519d700 1 -- 172.21.15.26:0/2111233763 >> 172.21.15.26:0/2111233763 conn(0x7f4370066f50 msgr2=0x7f43700a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:13.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.786+0000 7f437519d700 1 -- 172.21.15.26:0/2111233763 shutdown_connections 2023-10-01T08:00:13.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.786+0000 7f437519d700 1 -- 172.21.15.26:0/2111233763 wait complete. 2023-10-01T08:00:13.802 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:13.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.989+0000 7f924d986700 1 -- 172.21.15.26:0/106464954 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f924806b9e0 con 0x7f9248130540 2023-10-01T08:00:13.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.989+0000 7f922ffff700 1 -- 172.21.15.26:0/106464954 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f923c019260 con 0x7f9248130540 2023-10-01T08:00:13.990 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:13.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.989+0000 7f7f95aaf700 1 -- 172.21.15.26:0/2652708575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7f900747f0 con 0x7f7f900a0a30 2023-10-01T08:00:13.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.990+0000 7f7f87fff700 1 -- 172.21.15.26:0/2652708575 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7f80015070 con 0x7f7f900a0a30 2023-10-01T08:00:13.991 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:13.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.992+0000 7f924d986700 1 -- 172.21.15.26:0/106464954 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9248130540 msgr2=0x7f9248128d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:13.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.992+0000 7f924d986700 1 --2- 172.21.15.26:0/106464954 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9248130540 0x7f9248128d20 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f923c00c750 tx=0x7f923c00ca60 comp rx=0 tx=0).stop 2023-10-01T08:00:13.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.992+0000 7f924d986700 1 -- 172.21.15.26:0/106464954 shutdown_connections 2023-10-01T08:00:13.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.992+0000 7f924d986700 1 --2- 172.21.15.26:0/106464954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9248130e50 0x7f92481c5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:13.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.992+0000 7f924d986700 1 --2- 172.21.15.26:0/106464954 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f924806fcf0 0x7f92481287e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:13.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.992+0000 7f924d986700 1 --2- 172.21.15.26:0/106464954 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9248130540 0x7f9248128d20 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:13.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.992+0000 7f924d986700 1 -- 172.21.15.26:0/106464954 >> 172.21.15.26:0/106464954 conn(0x7f92480a2aa0 msgr2=0x7f924806e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:13.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.992+0000 7f924d986700 1 -- 172.21.15.26:0/106464954 shutdown_connections 2023-10-01T08:00:13.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.992+0000 7f924d986700 1 -- 172.21.15.26:0/106464954 wait complete. 2023-10-01T08:00:13.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.993+0000 7f7f95aaf700 1 -- 172.21.15.26:0/2652708575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f900a0a30 msgr2=0x7f7f9006e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:13.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.993+0000 7f7f95aaf700 1 --2- 172.21.15.26:0/2652708575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f900a0a30 0x7f7f9006e000 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f7f80016000 tx=0x7f7f80004750 comp rx=0 tx=0).stop 2023-10-01T08:00:13.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.993+0000 7f7f95aaf700 1 -- 172.21.15.26:0/2652708575 shutdown_connections 2023-10-01T08:00:13.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.993+0000 7f7f95aaf700 1 --2- 172.21.15.26:0/2652708575 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7f90133930 0x7f7f9006e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:13.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.993+0000 7f7f95aaf700 1 --2- 172.21.15.26:0/2652708575 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f9009d630 0x7f7f9006dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:13.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.993+0000 7f7f95aaf700 1 --2- 172.21.15.26:0/2652708575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f900a0a30 0x7f7f9006e000 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:13.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.993+0000 7f7f95aaf700 1 -- 172.21.15.26:0/2652708575 >> 172.21.15.26:0/2652708575 conn(0x7f7f900a3050 msgr2=0x7f7f9009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:13.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.993+0000 7f7f95aaf700 1 -- 172.21.15.26:0/2652708575 shutdown_connections 2023-10-01T08:00:13.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:13.993+0000 7f7f95aaf700 1 -- 172.21.15.26:0/2652708575 wait complete. 2023-10-01T08:00:14.008 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:14.009 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:14.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.014+0000 7f3604c68700 1 -- 172.21.15.26:0/1770890435 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f35e4005590 con 0x7f360012f8b0 2023-10-01T08:00:14.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.014+0000 7f35eeffd700 1 -- 172.21.15.26:0/1770890435 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f35f0015020 con 0x7f360012f8b0 2023-10-01T08:00:14.016 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:14.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.017+0000 7f3604c68700 1 -- 172.21.15.26:0/1770890435 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f360012f8b0 msgr2=0x7f3600118cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:14.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.017+0000 7f3604c68700 1 --2- 172.21.15.26:0/1770890435 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f360012f8b0 0x7f3600118cd0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f35f0013000 tx=0x7f35f0004750 comp rx=0 tx=0).stop 2023-10-01T08:00:14.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.017+0000 7f3604c68700 1 -- 172.21.15.26:0/1770890435 shutdown_connections 2023-10-01T08:00:14.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.017+0000 7f3604c68700 1 --2- 172.21.15.26:0/1770890435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3600119750 0x7f36001caa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:14.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.017+0000 7f3604c68700 1 --2- 172.21.15.26:0/1770890435 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f360012f8b0 0x7f3600118cd0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:14.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.017+0000 7f3604c68700 1 --2- 172.21.15.26:0/1770890435 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3600130430 0x7f3600119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:14.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.017+0000 7f3604c68700 1 -- 172.21.15.26:0/1770890435 >> 172.21.15.26:0/1770890435 conn(0x7f36000a2aa0 msgr2=0x7f36000a1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:14.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.017+0000 7f3604c68700 1 -- 172.21.15.26:0/1770890435 shutdown_connections 2023-10-01T08:00:14.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.017+0000 7f3604c68700 1 -- 172.21.15.26:0/1770890435 wait complete. 2023-10-01T08:00:14.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:14.803 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:14.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.949+0000 7f5234e20700 1 Processor -- start 2023-10-01T08:00:14.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.949+0000 7f5234e20700 1 -- start start 2023-10-01T08:00:14.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.949+0000 7f5234e20700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f523009d6f0 0x7f523009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:14.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.949+0000 7f5234e20700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f523009e410 0x7f5230130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:14.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.950+0000 7f5234e20700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f523009f130 con 0x7f523009e000 2023-10-01T08:00:14.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.950+0000 7f5234e20700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523009f520 con 0x7f523009e410 2023-10-01T08:00:14.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.950+0000 7f5234e20700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f523009e930 con 0x7f523009d6f0 2023-10-01T08:00:14.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.950+0000 7f522ed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f523009e410 0x7f5230130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:14.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.950+0000 7f522dd9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f523009e000 0x7f5230130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44582/0 (socket says 172.21.15.26:44582) 2023-10-01T08:00:14.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.950+0000 7f522dd9b700 1 -- 172.21.15.26:0/3985390481 learned_addr learned my addr 172.21.15.26:0/3985390481 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:14.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.950+0000 7f522e59c700 1 --2- 172.21.15.26:0/3985390481 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f523009d6f0 0x7f523009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:14.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.950+0000 7f522d59a700 1 -- 172.21.15.26:0/3985390481 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 966500793 0 0) 0x7f523009f130 con 0x7f523009e000 2023-10-01T08:00:14.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.950+0000 7f522e59c700 1 -- 172.21.15.26:0/3985390481 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f523009e410 msgr2=0x7f5230130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:14.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.950+0000 7f522e59c700 1 --2- 172.21.15.26:0/3985390481 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f523009e410 0x7f5230130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:14.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.950+0000 7f522e59c700 1 -- 172.21.15.26:0/3985390481 >> v1:172.21.15.26:6789/0 conn(0x7f523009e000 legacy=0x7f5230130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:14.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.950+0000 7f522e59c700 1 -- 172.21.15.26:0/3985390481 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523009b2d0 con 0x7f523009d6f0 2023-10-01T08:00:14.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.950+0000 7f522ed9d700 1 --2- 172.21.15.26:0/3985390481 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f523009e410 0x7f5230130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:14.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.950+0000 7f522e59c700 1 --2- 172.21.15.26:0/3985390481 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f523009d6f0 0x7f523009dac0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f5220009870 tx=0x7f5220009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e0cc15b36a2176d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:14.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.950+0000 7f522d59a700 1 -- 172.21.15.26:0/3985390481 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220011830 con 0x7f523009d6f0 2023-10-01T08:00:14.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.950+0000 7f522d59a700 1 -- 172.21.15.26:0/3985390481 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5220011990 con 0x7f523009d6f0 2023-10-01T08:00:14.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.950+0000 7f522d59a700 1 -- 172.21.15.26:0/3985390481 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220011d20 con 0x7f523009d6f0 2023-10-01T08:00:14.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.951+0000 7f5234e20700 1 -- 172.21.15.26:0/3985390481 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f523009d6f0 msgr2=0x7f523009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:14.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.951+0000 7f5234e20700 1 --2- 172.21.15.26:0/3985390481 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f523009d6f0 0x7f523009dac0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f5220009870 tx=0x7f5220009b80 comp rx=0 tx=0).stop 2023-10-01T08:00:14.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.951+0000 7f5234e20700 1 -- 172.21.15.26:0/3985390481 shutdown_connections 2023-10-01T08:00:14.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.951+0000 7f5234e20700 1 --2- 172.21.15.26:0/3985390481 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f523009d6f0 0x7f523009dac0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:14.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.951+0000 7f5234e20700 1 --2- 172.21.15.26:0/3985390481 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f523009e410 0x7f5230130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:14.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.951+0000 7f5234e20700 1 -- 172.21.15.26:0/3985390481 >> 172.21.15.26:0/3985390481 conn(0x7f5230066f50 msgr2=0x7f523009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:14.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.951+0000 7f5234e20700 1 -- 172.21.15.26:0/3985390481 shutdown_connections 2023-10-01T08:00:14.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.951+0000 7f5234e20700 1 -- 172.21.15.26:0/3985390481 wait complete. 2023-10-01T08:00:14.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.952+0000 7f5234e20700 1 Processor -- start 2023-10-01T08:00:14.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.952+0000 7f5234e20700 1 -- start start 2023-10-01T08:00:14.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.953+0000 7f5234e20700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f523009d6f0 0x7f52301c6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:14.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.953+0000 7f5234e20700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f523009e000 0x7f52301c6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:14.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.953+0000 7f5234e20700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f523009e410 0x7f52301c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:14.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.953+0000 7f5234e20700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5230123590 con 0x7f523009e000 2023-10-01T08:00:14.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.953+0000 7f5234e20700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523006b400 con 0x7f523009e410 2023-10-01T08:00:14.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.953+0000 7f5234e20700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f523009c700 con 0x7f523009d6f0 2023-10-01T08:00:14.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.953+0000 7f522ed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f523009e410 0x7f52301c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:14.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.953+0000 7f522dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f523009e000 0x7f52301c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:14.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.953+0000 7f522ed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f523009e410 0x7f52301c6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46948/0 (socket says 172.21.15.26:46948) 2023-10-01T08:00:14.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.953+0000 7f522e59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f523009d6f0 0x7f52301c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:14.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.953+0000 7f522ed9d700 1 -- 172.21.15.26:0/2581720917 learned_addr learned my addr 172.21.15.26:0/2581720917 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:14.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.953+0000 7f522dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f523009e000 0x7f52301c6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48810/0 (socket says 172.21.15.26:48810) 2023-10-01T08:00:14.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.953+0000 7f522e59c700 1 -- 172.21.15.26:0/2581720917 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f523009e410 msgr2=0x7f52301c6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:14.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.953+0000 7f522e59c700 1 --2- 172.21.15.26:0/2581720917 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f523009e410 0x7f52301c6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:14.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.953+0000 7f522e59c700 1 -- 172.21.15.26:0/2581720917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f523009e000 msgr2=0x7f52301c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:14.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.953+0000 7f522e59c700 1 --2- 172.21.15.26:0/2581720917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f523009e000 0x7f52301c6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:14.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.953+0000 7f522e59c700 1 -- 172.21.15.26:0/2581720917 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5228009a70 con 0x7f523009d6f0 2023-10-01T08:00:14.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.953+0000 7f522ed9d700 1 --2- 172.21.15.26:0/2581720917 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f523009e410 0x7f52301c6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:14.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.953+0000 7f522e59c700 1 --2- 172.21.15.26:0/2581720917 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f523009d6f0 0x7f52301c6450 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f5220016000 tx=0x7f5220004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:14.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.954+0000 7f521effd700 1 -- 172.21.15.26:0/2581720917 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220004510 con 0x7f523009d6f0 2023-10-01T08:00:14.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.954+0000 7f521effd700 1 -- 172.21.15.26:0/2581720917 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522001f070 con 0x7f523009d6f0 2023-10-01T08:00:14.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.954+0000 7f5234e20700 1 -- 172.21.15.26:0/2581720917 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52200094a0 con 0x7f523009d6f0 2023-10-01T08:00:14.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.954+0000 7f521effd700 1 -- 172.21.15.26:0/2581720917 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52200038c0 con 0x7f523009d6f0 2023-10-01T08:00:14.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.954+0000 7f5234e20700 1 -- 172.21.15.26:0/2581720917 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5230123910 con 0x7f523009d6f0 2023-10-01T08:00:14.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.954+0000 7f521effd700 1 -- 172.21.15.26:0/2581720917 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5220003a20 con 0x7f523009d6f0 2023-10-01T08:00:14.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.955+0000 7f521effd700 1 -- 172.21.15.26:0/2581720917 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5220021070 con 0x7f523009d6f0 2023-10-01T08:00:14.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.955+0000 7f5234e20700 1 -- 172.21.15.26:0/2581720917 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5230074ea0 con 0x7f523009d6f0 2023-10-01T08:00:14.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:14.960+0000 7f521effd700 1 -- 172.21.15.26:0/2581720917 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f52200253e0 con 0x7f523009d6f0 2023-10-01T08:00:15.009 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:15.010 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:15.032 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:15.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.153+0000 7f7ad33d6700 1 Processor -- start 2023-10-01T08:00:15.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.153+0000 7f7ad33d6700 1 -- start start 2023-10-01T08:00:15.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.154+0000 7f7ad33d6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7acc1338a0 0x7f7acc133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:15.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.154+0000 7f7ad33d6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7acc09e930 0x7f7acc13b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:15.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.154+0000 7f7ad33d6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7acc06ef30 con 0x7f7acc09de50 2023-10-01T08:00:15.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.154+0000 7f7ad33d6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7acc06fef0 con 0x7f7acc1338a0 2023-10-01T08:00:15.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.154+0000 7f7ad33d6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc1334b0 con 0x7f7acc09e930 2023-10-01T08:00:15.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.154+0000 7f7ad1172700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7acc1338a0 0x7f7acc133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:15.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.154+0000 7f7ad1973700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7acc09e930 0x7f7acc13b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:15.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.154+0000 7f7ad1172700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7acc1338a0 0x7f7acc133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48820/0 (socket says 172.21.15.26:48820) 2023-10-01T08:00:15.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.154+0000 7f7ad1973700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7acc09e930 0x7f7acc13b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47052/0 (socket says 172.21.15.26:47052) 2023-10-01T08:00:15.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.154+0000 7f7ad1172700 1 -- 172.21.15.26:0/2494332301 learned_addr learned my addr 172.21.15.26:0/2494332301 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:15.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.154+0000 7f7ad1973700 1 -- 172.21.15.26:0/2494332301 >> v2:172.21.15.26:3300/0 conn(0x7f7acc1338a0 msgr2=0x7f7acc133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:15.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.154+0000 7f7ad1973700 1 --2- 172.21.15.26:0/2494332301 >> v2:172.21.15.26:3300/0 conn(0x7f7acc1338a0 0x7f7acc133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:15.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.154+0000 7f7ad1973700 1 -- 172.21.15.26:0/2494332301 >> v1:172.21.15.26:6789/0 conn(0x7f7acc09de50 legacy=0x7f7acc09e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:15.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.154+0000 7f7ad1973700 1 -- 172.21.15.26:0/2494332301 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7acc06fc30 con 0x7f7acc09e930 2023-10-01T08:00:15.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.154+0000 7f7ad1172700 1 --2- 172.21.15.26:0/2494332301 >> v2:172.21.15.26:3300/0 conn(0x7f7acc1338a0 0x7f7acc133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:15.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.155+0000 7f7ad1973700 1 --2- 172.21.15.26:0/2494332301 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7acc09e930 0x7f7acc13b740 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4009d90 tx=0x7f7ac400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d02ad58617c1d25 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:15.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.155+0000 7f7ac3fff700 1 -- 172.21.15.26:0/2494332301 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac400e070 con 0x7f7acc09e930 2023-10-01T08:00:15.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.155+0000 7f7ac3fff700 1 -- 172.21.15.26:0/2494332301 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac400bb20 con 0x7f7acc09e930 2023-10-01T08:00:15.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.155+0000 7f7ac3fff700 1 -- 172.21.15.26:0/2494332301 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac4012430 con 0x7f7acc09e930 2023-10-01T08:00:15.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.156+0000 7f7ad33d6700 1 -- 172.21.15.26:0/2494332301 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7acc09e930 msgr2=0x7f7acc13b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:15.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.156+0000 7f7ad33d6700 1 --2- 172.21.15.26:0/2494332301 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7acc09e930 0x7f7acc13b740 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4009d90 tx=0x7f7ac400b330 comp rx=0 tx=0).stop 2023-10-01T08:00:15.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.156+0000 7f7ad33d6700 1 -- 172.21.15.26:0/2494332301 shutdown_connections 2023-10-01T08:00:15.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.156+0000 7f7ad33d6700 1 --2- 172.21.15.26:0/2494332301 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7acc09e930 0x7f7acc13b740 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:15.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.156+0000 7f7ad33d6700 1 --2- 172.21.15.26:0/2494332301 >> v2:172.21.15.26:3300/0 conn(0x7f7acc1338a0 0x7f7acc133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:15.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.156+0000 7f7ad33d6700 1 -- 172.21.15.26:0/2494332301 >> 172.21.15.26:0/2494332301 conn(0x7f7acc0a2aa0 msgr2=0x7f7acc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:15.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.156+0000 7f7ad33d6700 1 -- 172.21.15.26:0/2494332301 shutdown_connections 2023-10-01T08:00:15.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.156+0000 7f7ad33d6700 1 -- 172.21.15.26:0/2494332301 wait complete. 2023-10-01T08:00:15.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.157+0000 7f7ad33d6700 1 Processor -- start 2023-10-01T08:00:15.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.157+0000 7f7ad33d6700 1 -- start start 2023-10-01T08:00:15.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.158+0000 7f7ad33d6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7acc09de50 0x7f7acc11d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:15.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.158+0000 7f7ad33d6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7acc09e930 0x7f7acc11dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:15.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.158+0000 7f7ad33d6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7acc1338a0 0x7f7acc11e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:15.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.158+0000 7f7ad33d6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc121260 con 0x7f7acc09de50 2023-10-01T08:00:15.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.158+0000 7f7ad33d6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc11f930 con 0x7f7acc09e930 2023-10-01T08:00:15.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.158+0000 7f7ad33d6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc1209f0 con 0x7f7acc1338a0 2023-10-01T08:00:15.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.158+0000 7f7ad1973700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7acc1338a0 0x7f7acc11e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:15.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.158+0000 7f7ad1172700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7acc09de50 0x7f7acc11d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:15.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.158+0000 7f7ad1973700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7acc1338a0 0x7f7acc11e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47060/0 (socket says 172.21.15.26:47060) 2023-10-01T08:00:15.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.158+0000 7f7ad1973700 1 -- 172.21.15.26:0/3011911055 learned_addr learned my addr 172.21.15.26:0/3011911055 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:15.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.158+0000 7f7ad1172700 1 -- 172.21.15.26:0/3011911055 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7acc1338a0 msgr2=0x7f7acc11e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:15.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.158+0000 7f7ad1172700 1 --2- 172.21.15.26:0/3011911055 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7acc1338a0 0x7f7acc11e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:15.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.158+0000 7f7ad1172700 1 -- 172.21.15.26:0/3011911055 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7acc09e930 msgr2=0x7f7acc11dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:15.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.158+0000 7f7ad1172700 1 --2- 172.21.15.26:0/3011911055 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7acc09e930 0x7f7acc11dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:15.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.158+0000 7f7ad1172700 1 -- 172.21.15.26:0/3011911055 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac8009550 con 0x7f7acc09de50 2023-10-01T08:00:15.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.158+0000 7f7ad1973700 1 --2- 172.21.15.26:0/3011911055 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7acc1338a0 0x7f7acc11e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:15.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.159+0000 7f7ad1172700 1 --2- 172.21.15.26:0/3011911055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7acc09de50 0x7f7acc11d790 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800e9d0 tx=0x7f7ac800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:15.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.159+0000 7f7ac1ffb700 1 -- 172.21.15.26:0/3011911055 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8004030 con 0x7f7acc09de50 2023-10-01T08:00:15.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.159+0000 7f7ac1ffb700 1 -- 172.21.15.26:0/3011911055 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac8004190 con 0x7f7acc09de50 2023-10-01T08:00:15.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.159+0000 7f7ad33d6700 1 -- 172.21.15.26:0/3011911055 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac4009a70 con 0x7f7acc09de50 2023-10-01T08:00:15.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.159+0000 7f7ac1ffb700 1 -- 172.21.15.26:0/3011911055 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8004520 con 0x7f7acc09de50 2023-10-01T08:00:15.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.159+0000 7f7ad33d6700 1 -- 172.21.15.26:0/3011911055 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7acc06f690 con 0x7f7acc09de50 2023-10-01T08:00:15.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.160+0000 7f7ac1ffb700 1 -- 172.21.15.26:0/3011911055 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7ac800c850 con 0x7f7acc09de50 2023-10-01T08:00:15.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.160+0000 7f7ac1ffb700 1 -- 172.21.15.26:0/3011911055 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7ac803f940 con 0x7f7acc09de50 2023-10-01T08:00:15.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.160+0000 7f7ad33d6700 1 -- 172.21.15.26:0/3011911055 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7acc11a470 con 0x7f7acc09de50 2023-10-01T08:00:15.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.161+0000 7f8d47bf3700 1 Processor -- start 2023-10-01T08:00:15.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.162+0000 7f8d47bf3700 1 -- start start 2023-10-01T08:00:15.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.162+0000 7f8d47bf3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8d401338c0 0x7f8d40133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:15.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.162+0000 7f8d47bf3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d401341d0 0x7f8d4009de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:15.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.162+0000 7f8d47bf3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d4009e390 0x7f8d4009e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:15.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.162+0000 7f8d47bf3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d40070c80 con 0x7f8d401338c0 2023-10-01T08:00:15.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.162+0000 7f8d47bf3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4009ed20 con 0x7f8d4009e390 2023-10-01T08:00:15.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.163+0000 7f8d47bf3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4006f720 con 0x7f8d401341d0 2023-10-01T08:00:15.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.163+0000 7f8d46190700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d4009e390 0x7f8d4009e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:15.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.163+0000 7f8d46190700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d4009e390 0x7f8d4009e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:46968/0 (socket says 172.21.15.26:46968) 2023-10-01T08:00:15.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.163+0000 7f8d46190700 1 -- 172.21.15.26:0/1489844449 learned_addr learned my addr 172.21.15.26:0/1489844449 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:15.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.163+0000 7f8d4598f700 1 --2- 172.21.15.26:0/1489844449 >> v2:172.21.15.26:3300/0 conn(0x7f8d401338c0 0x7f8d40133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:15.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.163+0000 7f8d4518e700 1 --2- 172.21.15.26:0/1489844449 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d401341d0 0x7f8d4009de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:15.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.163+0000 7f8d4598f700 1 -- 172.21.15.26:0/1489844449 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d401341d0 msgr2=0x7f8d4009de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:15.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.163+0000 7f8d4598f700 1 --2- 172.21.15.26:0/1489844449 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d401341d0 0x7f8d4009de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:15.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.163+0000 7f8d4598f700 1 -- 172.21.15.26:0/1489844449 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d4009e390 msgr2=0x7f8d4009e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:15.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.163+0000 7f8d4598f700 1 --2- 172.21.15.26:0/1489844449 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d4009e390 0x7f8d4009e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:15.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.163+0000 7f8d4598f700 1 -- 172.21.15.26:0/1489844449 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d4006fce0 con 0x7f8d401338c0 2023-10-01T08:00:15.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.163+0000 7f8d46190700 1 --2- 172.21.15.26:0/1489844449 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d4009e390 0x7f8d4009e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:15.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.163+0000 7f8d4598f700 1 --2- 172.21.15.26:0/1489844449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d401338c0 0x7f8d40133c90 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c009840 tx=0x7f8d3c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=448ff9ecfe83d26f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:15.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.166+0000 7f8d4498d700 1 -- 172.21.15.26:0/1489844449 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c011830 con 0x7f8d401338c0 2023-10-01T08:00:15.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.166+0000 7f8d4498d700 1 -- 172.21.15.26:0/1489844449 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3c011990 con 0x7f8d401338c0 2023-10-01T08:00:15.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.166+0000 7f8d4498d700 1 -- 172.21.15.26:0/1489844449 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c011d20 con 0x7f8d401338c0 2023-10-01T08:00:15.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.166+0000 7f7ac1ffb700 1 -- 172.21.15.26:0/3011911055 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7ac80036a0 con 0x7f7acc09de50 2023-10-01T08:00:15.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.167+0000 7f8d47bf3700 1 -- 172.21.15.26:0/1489844449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d401338c0 msgr2=0x7f8d40133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:15.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.167+0000 7f8d47bf3700 1 --2- 172.21.15.26:0/1489844449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d401338c0 0x7f8d40133c90 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c009840 tx=0x7f8d3c009b50 comp rx=0 tx=0).stop 2023-10-01T08:00:15.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.167+0000 7f8d47bf3700 1 -- 172.21.15.26:0/1489844449 shutdown_connections 2023-10-01T08:00:15.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.167+0000 7f8d47bf3700 1 --2- 172.21.15.26:0/1489844449 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d4009e390 0x7f8d4009e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:15.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.167+0000 7f8d47bf3700 1 --2- 172.21.15.26:0/1489844449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d401338c0 0x7f8d40133c90 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:15.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.167+0000 7f8d47bf3700 1 --2- 172.21.15.26:0/1489844449 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d401341d0 0x7f8d4009de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:15.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.167+0000 7f8d47bf3700 1 -- 172.21.15.26:0/1489844449 >> 172.21.15.26:0/1489844449 conn(0x7f8d400a2aa0 msgr2=0x7f8d400a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:15.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.167+0000 7f8d47bf3700 1 -- 172.21.15.26:0/1489844449 shutdown_connections 2023-10-01T08:00:15.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.167+0000 7f8d47bf3700 1 -- 172.21.15.26:0/1489844449 wait complete. 2023-10-01T08:00:15.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.168+0000 7f8d47bf3700 1 Processor -- start 2023-10-01T08:00:15.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.168+0000 7f8d47bf3700 1 -- start start 2023-10-01T08:00:15.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.169+0000 7f8d47bf3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d4009e390 0x7f8d401ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:15.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.169+0000 7f8d47bf3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d401338c0 0x7f8d401cd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:15.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.169+0000 7f8d47bf3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d401341d0 0x7f8d40099a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:15.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.169+0000 7f8d47bf3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4009cfd0 con 0x7f8d401338c0 2023-10-01T08:00:15.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.169+0000 7f8d47bf3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4009be50 con 0x7f8d401341d0 2023-10-01T08:00:15.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.169+0000 7f8d47bf3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d40130d20 con 0x7f8d4009e390 2023-10-01T08:00:15.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.169+0000 7f8d4518e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d401338c0 0x7f8d401cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:15.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.169+0000 7f8d4518e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d401338c0 0x7f8d401cd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48842/0 (socket says 172.21.15.26:48842) 2023-10-01T08:00:15.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.169+0000 7f8d46190700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d401341d0 0x7f8d40099a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:15.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.169+0000 7f8d4518e700 1 -- 172.21.15.26:0/1326907598 learned_addr learned my addr 172.21.15.26:0/1326907598 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:15.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.169+0000 7f8d4598f700 1 --2- 172.21.15.26:0/1326907598 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d4009e390 0x7f8d401ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:15.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.169+0000 7f8d46190700 1 -- 172.21.15.26:0/1326907598 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d4009e390 msgr2=0x7f8d401ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:15.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.169+0000 7f8d46190700 1 --2- 172.21.15.26:0/1326907598 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d4009e390 0x7f8d401ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:15.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.169+0000 7f8d46190700 1 -- 172.21.15.26:0/1326907598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d401338c0 msgr2=0x7f8d401cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:15.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.169+0000 7f8d46190700 1 --2- 172.21.15.26:0/1326907598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d401338c0 0x7f8d401cd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:15.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.169+0000 7f8d46190700 1 -- 172.21.15.26:0/1326907598 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d38009b30 con 0x7f8d401341d0 2023-10-01T08:00:15.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.170+0000 7f8d46190700 1 --2- 172.21.15.26:0/1326907598 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d401341d0 0x7f8d40099a70 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f8d3800efc0 tx=0x7f8d3800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:15.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.170+0000 7f8d367fc700 1 -- 172.21.15.26:0/1326907598 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d38018070 con 0x7f8d401341d0 2023-10-01T08:00:15.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.170+0000 7f8d367fc700 1 -- 172.21.15.26:0/1326907598 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3800f040 con 0x7f8d401341d0 2023-10-01T08:00:15.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.170+0000 7f8d367fc700 1 -- 172.21.15.26:0/1326907598 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d38003c60 con 0x7f8d401341d0 2023-10-01T08:00:15.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.171+0000 7f8d47bf3700 1 -- 172.21.15.26:0/1326907598 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d3c0094a0 con 0x7f8d401341d0 2023-10-01T08:00:15.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.171+0000 7f8d47bf3700 1 -- 172.21.15.26:0/1326907598 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d4009bab0 con 0x7f8d401341d0 2023-10-01T08:00:15.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.172+0000 7f8d367fc700 1 -- 172.21.15.26:0/1326907598 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8d3800c880 con 0x7f8d401341d0 2023-10-01T08:00:15.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.172+0000 7f8d367fc700 1 -- 172.21.15.26:0/1326907598 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8d3803f6f0 con 0x7f8d401341d0 2023-10-01T08:00:15.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.172+0000 7f8d47bf3700 1 -- 172.21.15.26:0/1326907598 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d40074ea0 con 0x7f8d401341d0 2023-10-01T08:00:15.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.181+0000 7f8d367fc700 1 -- 172.21.15.26:0/1326907598 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8d38003dc0 con 0x7f8d401341d0 2023-10-01T08:00:15.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.189+0000 7f5234e20700 1 -- 172.21.15.26:0/2581720917 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5230072660 con 0x7f523009d6f0 2023-10-01T08:00:15.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.190+0000 7f521effd700 1 -- 172.21.15.26:0/2581720917 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5220010b70 con 0x7f523009d6f0 2023-10-01T08:00:15.190 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:15.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.192+0000 7f5234e20700 1 -- 172.21.15.26:0/2581720917 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f523009d6f0 msgr2=0x7f52301c6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:15.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.192+0000 7f5234e20700 1 --2- 172.21.15.26:0/2581720917 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f523009d6f0 0x7f52301c6450 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f5220016000 tx=0x7f5220004750 comp rx=0 tx=0).stop 2023-10-01T08:00:15.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.192+0000 7f5234e20700 1 -- 172.21.15.26:0/2581720917 shutdown_connections 2023-10-01T08:00:15.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.192+0000 7f5234e20700 1 --2- 172.21.15.26:0/2581720917 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f523009e410 0x7f52301c6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:15.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.192+0000 7f5234e20700 1 --2- 172.21.15.26:0/2581720917 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f523009d6f0 0x7f52301c6450 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:15.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.192+0000 7f5234e20700 1 --2- 172.21.15.26:0/2581720917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f523009e000 0x7f52301c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:15.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.192+0000 7f5234e20700 1 -- 172.21.15.26:0/2581720917 >> 172.21.15.26:0/2581720917 conn(0x7f5230066f50 msgr2=0x7f5230070130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:15.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.192+0000 7f5234e20700 1 -- 172.21.15.26:0/2581720917 shutdown_connections 2023-10-01T08:00:15.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.192+0000 7f5234e20700 1 -- 172.21.15.26:0/2581720917 wait complete. 2023-10-01T08:00:15.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.203+0000 7f9676cc4700 1 Processor -- start 2023-10-01T08:00:15.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.203+0000 7f9676cc4700 1 -- start start 2023-10-01T08:00:15.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.204+0000 7f9676cc4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96700a1510 0x7f9670138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:15.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.204+0000 7f9676cc4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9670139250 0x7f967013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:15.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.204+0000 7f9676cc4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f967009edd0 con 0x7f96700a0a30 2023-10-01T08:00:15.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.204+0000 7f9676cc4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96700a18e0 con 0x7f9670139250 2023-10-01T08:00:15.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.204+0000 7f9676cc4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f967009e1f0 con 0x7f96700a1510 2023-10-01T08:00:15.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.204+0000 7f9675261700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9670139250 0x7f967013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:15.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.204+0000 7f9675261700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9670139250 0x7f967013b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48850/0 (socket says 172.21.15.26:48850) 2023-10-01T08:00:15.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.204+0000 7f9674a60700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f96700a0a30 0x7f96700a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44610/0 (socket says 172.21.15.26:44610) 2023-10-01T08:00:15.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.204+0000 7f9675261700 1 -- 172.21.15.26:0/531371940 learned_addr learned my addr 172.21.15.26:0/531371940 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:15.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.204+0000 7f9675261700 1 -- 172.21.15.26:0/531371940 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96700a1510 msgr2=0x7f9670138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:15.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.204+0000 7f966ffff700 1 --2- 172.21.15.26:0/531371940 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96700a1510 0x7f9670138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:15.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.205+0000 7f966f7fe700 1 -- 172.21.15.26:0/531371940 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1712537514 0 0) 0x7f967009edd0 con 0x7f96700a0a30 2023-10-01T08:00:15.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.205+0000 7f9675261700 1 --2- 172.21.15.26:0/531371940 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96700a1510 0x7f9670138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:15.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.205+0000 7f9675261700 1 -- 172.21.15.26:0/531371940 >> v1:172.21.15.26:6789/0 conn(0x7f96700a0a30 legacy=0x7f96700a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:15.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.205+0000 7f9675261700 1 -- 172.21.15.26:0/531371940 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f967009dc50 con 0x7f9670139250 2023-10-01T08:00:15.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.205+0000 7f966ffff700 1 --2- 172.21.15.26:0/531371940 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96700a1510 0x7f9670138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T08:00:15.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.205+0000 7f9675261700 1 --2- 172.21.15.26:0/531371940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9670139250 0x7f967013b630 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f9668009e80 tx=0x7f966800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51e8cb84cd713e10 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:15.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.205+0000 7f966f7fe700 1 -- 172.21.15.26:0/531371940 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966800e070 con 0x7f9670139250 2023-10-01T08:00:15.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.205+0000 7f966f7fe700 1 -- 172.21.15.26:0/531371940 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966800b980 con 0x7f9670139250 2023-10-01T08:00:15.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.205+0000 7f966f7fe700 1 -- 172.21.15.26:0/531371940 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966800bd30 con 0x7f9670139250 2023-10-01T08:00:15.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.206+0000 7f9676cc4700 1 -- 172.21.15.26:0/531371940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9670139250 msgr2=0x7f967013b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:15.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.206+0000 7f9676cc4700 1 --2- 172.21.15.26:0/531371940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9670139250 0x7f967013b630 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f9668009e80 tx=0x7f966800b330 comp rx=0 tx=0).stop 2023-10-01T08:00:15.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.206+0000 7f9676cc4700 1 -- 172.21.15.26:0/531371940 shutdown_connections 2023-10-01T08:00:15.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.206+0000 7f9676cc4700 1 --2- 172.21.15.26:0/531371940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9670139250 0x7f967013b630 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:15.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.206+0000 7f9676cc4700 1 --2- 172.21.15.26:0/531371940 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96700a1510 0x7f9670138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:15.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.206+0000 7f9676cc4700 1 -- 172.21.15.26:0/531371940 >> 172.21.15.26:0/531371940 conn(0x7f96700a6550 msgr2=0x7f96700a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:15.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.206+0000 7f9676cc4700 1 -- 172.21.15.26:0/531371940 shutdown_connections 2023-10-01T08:00:15.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.206+0000 7f9676cc4700 1 -- 172.21.15.26:0/531371940 wait complete. 2023-10-01T08:00:15.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.207+0000 7f9676cc4700 1 Processor -- start 2023-10-01T08:00:15.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.208+0000 7f9676cc4700 1 -- start start 2023-10-01T08:00:15.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.208+0000 7f9676cc4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96700a0a30 0x7f96701226b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:15.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.208+0000 7f9676cc4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96700a1510 0x7f9670122bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:15.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.208+0000 7f9676cc4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9670139250 0x7f9670123130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:15.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.209+0000 7f9676cc4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9670125f80 con 0x7f9670139250 2023-10-01T08:00:15.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.209+0000 7f9676cc4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9670126d60 con 0x7f96700a1510 2023-10-01T08:00:15.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.209+0000 7f9676cc4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96700a0220 con 0x7f96700a0a30 2023-10-01T08:00:15.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.209+0000 7f9674a60700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96700a0a30 0x7f96701226b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:15.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.209+0000 7f9674a60700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96700a0a30 0x7f96701226b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47096/0 (socket says 172.21.15.26:47096) 2023-10-01T08:00:15.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.209+0000 7f9674a60700 1 -- 172.21.15.26:0/801111566 learned_addr learned my addr 172.21.15.26:0/801111566 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:15.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.209+0000 7f9675261700 1 --2- 172.21.15.26:0/801111566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9670139250 0x7f9670123130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:15.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.209+0000 7f9674a60700 1 -- 172.21.15.26:0/801111566 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96700a1510 msgr2=0x7f9670122bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:15.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.209+0000 7f9674a60700 1 --2- 172.21.15.26:0/801111566 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96700a1510 0x7f9670122bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:15.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.209+0000 7f9674a60700 1 -- 172.21.15.26:0/801111566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9670139250 msgr2=0x7f9670123130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:15.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.209+0000 7f9674a60700 1 --2- 172.21.15.26:0/801111566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9670139250 0x7f9670123130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:15.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.209+0000 7f9674a60700 1 -- 172.21.15.26:0/801111566 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9668009b30 con 0x7f96700a0a30 2023-10-01T08:00:15.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.210+0000 7f9674a60700 1 --2- 172.21.15.26:0/801111566 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96700a0a30 0x7f96701226b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f966400c550 tx=0x7f966400c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:15.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.210+0000 7f966d7fa700 1 -- 172.21.15.26:0/801111566 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9664004c80 con 0x7f96700a0a30 2023-10-01T08:00:15.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.210+0000 7f966d7fa700 1 -- 172.21.15.26:0/801111566 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9664004e00 con 0x7f96700a0a30 2023-10-01T08:00:15.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.210+0000 7f966d7fa700 1 -- 172.21.15.26:0/801111566 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9664007310 con 0x7f96700a0a30 2023-10-01T08:00:15.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.210+0000 7f9676cc4700 1 -- 172.21.15.26:0/801111566 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9670124270 con 0x7f96700a0a30 2023-10-01T08:00:15.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.210+0000 7f9676cc4700 1 -- 172.21.15.26:0/801111566 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9670124a60 con 0x7f96700a0a30 2023-10-01T08:00:15.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.211+0000 7f966d7fa700 1 -- 172.21.15.26:0/801111566 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9664007470 con 0x7f96700a0a30 2023-10-01T08:00:15.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.211+0000 7f9676cc4700 1 -- 172.21.15.26:0/801111566 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9670074ea0 con 0x7f96700a0a30 2023-10-01T08:00:15.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.211+0000 7f966d7fa700 1 -- 172.21.15.26:0/801111566 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f966403f3c0 con 0x7f96700a0a30 2023-10-01T08:00:15.217 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:15.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.221+0000 7f966d7fa700 1 -- 172.21.15.26:0/801111566 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f96640123b0 con 0x7f96700a0a30 2023-10-01T08:00:15.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.384+0000 7f7ad33d6700 1 -- 172.21.15.26:0/3011911055 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7acc120de0 con 0x7f7acc09de50 2023-10-01T08:00:15.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.384+0000 7f7ac1ffb700 1 -- 172.21.15.26:0/3011911055 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7acc120de0 con 0x7f7acc09de50 2023-10-01T08:00:15.385 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:15.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.386+0000 7f7ad33d6700 1 -- 172.21.15.26:0/3011911055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7acc09de50 msgr2=0x7f7acc11d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:15.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.386+0000 7f7ad33d6700 1 --2- 172.21.15.26:0/3011911055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7acc09de50 0x7f7acc11d790 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800e9d0 tx=0x7f7ac800ece0 comp rx=0 tx=0).stop 2023-10-01T08:00:15.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.387+0000 7f7ad33d6700 1 -- 172.21.15.26:0/3011911055 shutdown_connections 2023-10-01T08:00:15.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.387+0000 7f7ad33d6700 1 --2- 172.21.15.26:0/3011911055 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7acc1338a0 0x7f7acc11e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:15.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.387+0000 7f7ad33d6700 1 --2- 172.21.15.26:0/3011911055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7acc09de50 0x7f7acc11d790 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:15.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.387+0000 7f7ad33d6700 1 --2- 172.21.15.26:0/3011911055 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7acc09e930 0x7f7acc11dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:15.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.387+0000 7f7ad33d6700 1 -- 172.21.15.26:0/3011911055 >> 172.21.15.26:0/3011911055 conn(0x7f7acc0a2aa0 msgr2=0x7f7acc1b9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:15.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.387+0000 7f7ad33d6700 1 -- 172.21.15.26:0/3011911055 shutdown_connections 2023-10-01T08:00:15.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.387+0000 7f7ad33d6700 1 -- 172.21.15.26:0/3011911055 wait complete. 2023-10-01T08:00:15.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.400+0000 7f8d47bf3700 1 -- 172.21.15.26:0/1326907598 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8d4006b9e0 con 0x7f8d401341d0 2023-10-01T08:00:15.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.400+0000 7f8d367fc700 1 -- 172.21.15.26:0/1326907598 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8d3801de00 con 0x7f8d401341d0 2023-10-01T08:00:15.401 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:15.402 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:15.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.403+0000 7f8d47bf3700 1 -- 172.21.15.26:0/1326907598 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d401341d0 msgr2=0x7f8d40099a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:15.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.403+0000 7f8d47bf3700 1 --2- 172.21.15.26:0/1326907598 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d401341d0 0x7f8d40099a70 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f8d3800efc0 tx=0x7f8d3800c3a0 comp rx=0 tx=0).stop 2023-10-01T08:00:15.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.403+0000 7f8d47bf3700 1 -- 172.21.15.26:0/1326907598 shutdown_connections 2023-10-01T08:00:15.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.403+0000 7f8d47bf3700 1 --2- 172.21.15.26:0/1326907598 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d401341d0 0x7f8d40099a70 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:15.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.403+0000 7f8d47bf3700 1 --2- 172.21.15.26:0/1326907598 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d4009e390 0x7f8d401ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:15.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.403+0000 7f8d47bf3700 1 --2- 172.21.15.26:0/1326907598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d401338c0 0x7f8d401cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:15.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.403+0000 7f8d47bf3700 1 -- 172.21.15.26:0/1326907598 >> 172.21.15.26:0/1326907598 conn(0x7f8d400a2aa0 msgr2=0x7f8d40132db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:15.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.403+0000 7f8d47bf3700 1 -- 172.21.15.26:0/1326907598 shutdown_connections 2023-10-01T08:00:15.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.403+0000 7f8d47bf3700 1 -- 172.21.15.26:0/1326907598 wait complete. 2023-10-01T08:00:15.417 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:15.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.432+0000 7f9676cc4700 1 -- 172.21.15.26:0/801111566 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9670125800 con 0x7f96700a0a30 2023-10-01T08:00:15.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.432+0000 7f966d7fa700 1 -- 172.21.15.26:0/801111566 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9664011360 con 0x7f96700a0a30 2023-10-01T08:00:15.433 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:15.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.434+0000 7f9676cc4700 1 -- 172.21.15.26:0/801111566 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96700a0a30 msgr2=0x7f96701226b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:15.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.434+0000 7f9676cc4700 1 --2- 172.21.15.26:0/801111566 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96700a0a30 0x7f96701226b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f966400c550 tx=0x7f966400c860 comp rx=0 tx=0).stop 2023-10-01T08:00:15.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.435+0000 7f9676cc4700 1 -- 172.21.15.26:0/801111566 shutdown_connections 2023-10-01T08:00:15.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.435+0000 7f9676cc4700 1 --2- 172.21.15.26:0/801111566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9670139250 0x7f9670123130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:15.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.435+0000 7f9676cc4700 1 --2- 172.21.15.26:0/801111566 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96700a0a30 0x7f96701226b0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:15.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.435+0000 7f9676cc4700 1 --2- 172.21.15.26:0/801111566 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96700a1510 0x7f9670122bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:15.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.435+0000 7f9676cc4700 1 -- 172.21.15.26:0/801111566 >> 172.21.15.26:0/801111566 conn(0x7f96700a6550 msgr2=0x7f967011c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:15.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.435+0000 7f9676cc4700 1 -- 172.21.15.26:0/801111566 shutdown_connections 2023-10-01T08:00:15.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:15.435+0000 7f9676cc4700 1 -- 172.21.15.26:0/801111566 wait complete. 2023-10-01T08:00:15.449 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:16.218 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:16.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.365+0000 7f8fbb283700 1 Processor -- start 2023-10-01T08:00:16.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.365+0000 7f8fbb283700 1 -- start start 2023-10-01T08:00:16.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.366+0000 7f8fbb283700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fb4133420 0x7f8fb41337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:16.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.366+0000 7f8fbb283700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fb4133e30 0x7f8fb412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:16.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.366+0000 7f8fbb283700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb406b990 con 0x7f8fb4134260 2023-10-01T08:00:16.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.366+0000 7f8fbb283700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb40a0590 con 0x7f8fb4133420 2023-10-01T08:00:16.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.366+0000 7f8fbb283700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb409fb80 con 0x7f8fb4133e30 2023-10-01T08:00:16.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.366+0000 7f8fb901f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fb4133420 0x7f8fb41337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:16.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.366+0000 7f8fb9820700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8fb4134260 0x7f8fb41304d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44614/0 (socket says 172.21.15.26:44614) 2023-10-01T08:00:16.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.366+0000 7f8fb881e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fb4133e30 0x7f8fb412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:16.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.366+0000 7f8fb9820700 1 -- 172.21.15.26:0/1006629983 learned_addr learned my addr 172.21.15.26:0/1006629983 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:16.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.366+0000 7f8fa7fff700 1 -- 172.21.15.26:0/1006629983 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463275796 0 0) 0x7f8fb406b990 con 0x7f8fb4134260 2023-10-01T08:00:16.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.367+0000 7f8fb901f700 1 -- 172.21.15.26:0/1006629983 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fb4133e30 msgr2=0x7f8fb412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:16.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.367+0000 7f8fb901f700 1 --2- 172.21.15.26:0/1006629983 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fb4133e30 0x7f8fb412ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:16.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.367+0000 7f8fb901f700 1 -- 172.21.15.26:0/1006629983 >> v1:172.21.15.26:6789/0 conn(0x7f8fb4134260 legacy=0x7f8fb41304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:16.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.367+0000 7f8fb901f700 1 -- 172.21.15.26:0/1006629983 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb40a0030 con 0x7f8fb4133420 2023-10-01T08:00:16.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.367+0000 7f8fb881e700 1 --2- 172.21.15.26:0/1006629983 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fb4133e30 0x7f8fb412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:16.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.367+0000 7f8fb901f700 1 --2- 172.21.15.26:0/1006629983 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fb4133420 0x7f8fb41337f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0009870 tx=0x7f8fb0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2a494ee9bcc80ff server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:16.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.367+0000 7f8fa7fff700 1 -- 172.21.15.26:0/1006629983 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0011830 con 0x7f8fb4133420 2023-10-01T08:00:16.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.367+0000 7f8fa7fff700 1 -- 172.21.15.26:0/1006629983 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb0011990 con 0x7f8fb4133420 2023-10-01T08:00:16.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.367+0000 7f8fa7fff700 1 -- 172.21.15.26:0/1006629983 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0011d20 con 0x7f8fb4133420 2023-10-01T08:00:16.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.367+0000 7f8fbb283700 1 -- 172.21.15.26:0/1006629983 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fb4133420 msgr2=0x7f8fb41337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:16.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.368+0000 7f8fbb283700 1 --2- 172.21.15.26:0/1006629983 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fb4133420 0x7f8fb41337f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0009870 tx=0x7f8fb0009b80 comp rx=0 tx=0).stop 2023-10-01T08:00:16.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.368+0000 7f8fbb283700 1 -- 172.21.15.26:0/1006629983 shutdown_connections 2023-10-01T08:00:16.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.368+0000 7f8fbb283700 1 --2- 172.21.15.26:0/1006629983 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fb4133420 0x7f8fb41337f0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:16.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.368+0000 7f8fbb283700 1 --2- 172.21.15.26:0/1006629983 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fb4133e30 0x7f8fb412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:16.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.368+0000 7f8fbb283700 1 -- 172.21.15.26:0/1006629983 >> 172.21.15.26:0/1006629983 conn(0x7f8fb40a4210 msgr2=0x7f8fb40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:16.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.368+0000 7f8fbb283700 1 -- 172.21.15.26:0/1006629983 shutdown_connections 2023-10-01T08:00:16.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.368+0000 7f8fbb283700 1 -- 172.21.15.26:0/1006629983 wait complete. 2023-10-01T08:00:16.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.369+0000 7f8fbb283700 1 Processor -- start 2023-10-01T08:00:16.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.369+0000 7f8fbb283700 1 -- start start 2023-10-01T08:00:16.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.369+0000 7f8fbb283700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fb4133420 0x7f8fb409c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:16.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.369+0000 7f8fbb283700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fb4133e30 0x7f8fb409cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:16.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.369+0000 7f8fbb283700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8fb4134260 0x7f8fb409d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:16.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.369+0000 7f8fbb283700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb411fe10 con 0x7f8fb4134260 2023-10-01T08:00:16.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.369+0000 7f8fbb283700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb411fae0 con 0x7f8fb4133e30 2023-10-01T08:00:16.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.369+0000 7f8fbb283700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb4131490 con 0x7f8fb4133420 2023-10-01T08:00:16.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.369+0000 7f8fb901f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fb4133420 0x7f8fb409c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:16.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.369+0000 7f8fb901f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fb4133420 0x7f8fb409c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47110/0 (socket says 172.21.15.26:47110) 2023-10-01T08:00:16.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.369+0000 7f8fb9820700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8fb4134260 0x7f8fb409d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:16.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.369+0000 7f8fb901f700 1 -- 172.21.15.26:0/123311325 learned_addr learned my addr 172.21.15.26:0/123311325 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:16.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.369+0000 7f8fb881e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fb4133e30 0x7f8fb409cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:16.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.370+0000 7f8fb881e700 1 -- 172.21.15.26:0/123311325 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fb4133420 msgr2=0x7f8fb409c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:16.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.370+0000 7f8fb881e700 1 --2- 172.21.15.26:0/123311325 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fb4133420 0x7f8fb409c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:16.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.370+0000 7f8fb881e700 1 -- 172.21.15.26:0/123311325 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8fb4134260 msgr2=0x7f8fb409d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:16.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.370+0000 7f8fb881e700 1 --2- 172.21.15.26:0/123311325 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8fb4134260 0x7f8fb409d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:16.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.370+0000 7f8fb881e700 1 -- 172.21.15.26:0/123311325 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa80094a0 con 0x7f8fb4133e30 2023-10-01T08:00:16.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.370+0000 7f8fb881e700 1 --2- 172.21.15.26:0/123311325 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fb4133e30 0x7f8fb409cc20 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f8fa800e980 tx=0x7f8fa800ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:16.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.370+0000 7f8fa5ffb700 1 -- 172.21.15.26:0/123311325 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa800c690 con 0x7f8fb4133e30 2023-10-01T08:00:16.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.370+0000 7f8fa5ffb700 1 -- 172.21.15.26:0/123311325 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa800c7f0 con 0x7f8fb4133e30 2023-10-01T08:00:16.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.370+0000 7f8fa5ffb700 1 -- 172.21.15.26:0/123311325 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa800cb80 con 0x7f8fb4133e30 2023-10-01T08:00:16.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.370+0000 7f8fbb283700 1 -- 172.21.15.26:0/123311325 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb00094a0 con 0x7f8fb4133e30 2023-10-01T08:00:16.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.370+0000 7f8fbb283700 1 -- 172.21.15.26:0/123311325 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb409e180 con 0x7f8fb4133e30 2023-10-01T08:00:16.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.371+0000 7f8fa5ffb700 1 -- 172.21.15.26:0/123311325 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8fa800cce0 con 0x7f8fb4133e30 2023-10-01T08:00:16.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.371+0000 7f8fa5ffb700 1 -- 172.21.15.26:0/123311325 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8fa803f6e0 con 0x7f8fb4133e30 2023-10-01T08:00:16.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.371+0000 7f8fbb283700 1 -- 172.21.15.26:0/123311325 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb412dc70 con 0x7f8fb4133e30 2023-10-01T08:00:16.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.376+0000 7f8fa5ffb700 1 -- 172.21.15.26:0/123311325 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8fa801bba0 con 0x7f8fb4133e30 2023-10-01T08:00:16.402 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:16.418 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:16.450 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:16.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.546+0000 7f8c92db9700 1 Processor -- start 2023-10-01T08:00:16.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.546+0000 7f8c92db9700 1 -- start start 2023-10-01T08:00:16.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.546+0000 7f8c92db9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8c8c06e570 0x7f8c8c06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:16.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.546+0000 7f8c92db9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8c8c09eca0 0x7f8c8c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:16.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.546+0000 7f8c92db9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8c8c134610 0x7f8c8c134a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:16.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.546+0000 7f8c92db9700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c8c070ee0 con 0x7f8c8c09eca0 2023-10-01T08:00:16.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.546+0000 7f8c92db9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8c071480 con 0x7f8c8c134610 2023-10-01T08:00:16.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.546+0000 7f8c92db9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8c06f3c0 con 0x7f8c8c06e570 2023-10-01T08:00:16.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.547+0000 7f8c91356700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8c8c134610 0x7f8c8c134a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:16.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.547+0000 7f8c8bfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8c8c09eca0 0x7f8c8c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:16.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.547+0000 7f8c90b55700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8c8c06e570 0x7f8c8c06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:16.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.547+0000 7f8c91356700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8c8c134610 0x7f8c8c134a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47026/0 (socket says 172.21.15.26:47026) 2023-10-01T08:00:16.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.547+0000 7f8c8bfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8c8c09eca0 0x7f8c8c06ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48864/0 (socket says 172.21.15.26:48864) 2023-10-01T08:00:16.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.547+0000 7f8c91356700 1 -- 172.21.15.26:0/54263864 learned_addr learned my addr 172.21.15.26:0/54263864 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:16.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.547+0000 7f8c91356700 1 -- 172.21.15.26:0/54263864 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8c8c06e570 msgr2=0x7f8c8c06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:16.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.547+0000 7f8c91356700 1 --2- 172.21.15.26:0/54263864 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8c8c06e570 0x7f8c8c06e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:16.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.547+0000 7f8c91356700 1 -- 172.21.15.26:0/54263864 >> v2:172.21.15.26:3300/0 conn(0x7f8c8c09eca0 msgr2=0x7f8c8c06ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:16.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.547+0000 7f8c91356700 1 --2- 172.21.15.26:0/54263864 >> v2:172.21.15.26:3300/0 conn(0x7f8c8c09eca0 0x7f8c8c06ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:16.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.547+0000 7f8c91356700 1 -- 172.21.15.26:0/54263864 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c8c071b90 con 0x7f8c8c134610 2023-10-01T08:00:16.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.547+0000 7f8c90b55700 1 --2- 172.21.15.26:0/54263864 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8c8c06e570 0x7f8c8c06e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:16.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.547+0000 7f8c8bfff700 1 --2- 172.21.15.26:0/54263864 >> v2:172.21.15.26:3300/0 conn(0x7f8c8c09eca0 0x7f8c8c06ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:16.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.547+0000 7f8c91356700 1 --2- 172.21.15.26:0/54263864 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8c8c134610 0x7f8c8c134a40 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f8c84009e50 tx=0x7f8c8400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7c2164eef87a984 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:16.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.548+0000 7f8c8b7fe700 1 -- 172.21.15.26:0/54263864 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8400e070 con 0x7f8c8c134610 2023-10-01T08:00:16.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.548+0000 7f8c8b7fe700 1 -- 172.21.15.26:0/54263864 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8400b910 con 0x7f8c8c134610 2023-10-01T08:00:16.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.548+0000 7f8c8b7fe700 1 -- 172.21.15.26:0/54263864 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8400bcc0 con 0x7f8c8c134610 2023-10-01T08:00:16.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.548+0000 7f8c92db9700 1 -- 172.21.15.26:0/54263864 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8c8c134610 msgr2=0x7f8c8c134a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:16.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.548+0000 7f8c92db9700 1 --2- 172.21.15.26:0/54263864 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8c8c134610 0x7f8c8c134a40 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f8c84009e50 tx=0x7f8c8400b330 comp rx=0 tx=0).stop 2023-10-01T08:00:16.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.548+0000 7f8c92db9700 1 -- 172.21.15.26:0/54263864 shutdown_connections 2023-10-01T08:00:16.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.548+0000 7f8c92db9700 1 --2- 172.21.15.26:0/54263864 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8c8c134610 0x7f8c8c134a40 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:16.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.548+0000 7f8c92db9700 1 --2- 172.21.15.26:0/54263864 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8c8c06e570 0x7f8c8c06e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:16.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.548+0000 7f8c92db9700 1 --2- 172.21.15.26:0/54263864 >> v2:172.21.15.26:3300/0 conn(0x7f8c8c09eca0 0x7f8c8c06ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:16.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.548+0000 7f8c92db9700 1 -- 172.21.15.26:0/54263864 >> 172.21.15.26:0/54263864 conn(0x7f8c8c0a2aa0 msgr2=0x7f8c8c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:16.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.549+0000 7f8c92db9700 1 -- 172.21.15.26:0/54263864 shutdown_connections 2023-10-01T08:00:16.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.549+0000 7f8c92db9700 1 -- 172.21.15.26:0/54263864 wait complete. 2023-10-01T08:00:16.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.550+0000 7f8c92db9700 1 Processor -- start 2023-10-01T08:00:16.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.550+0000 7f8c92db9700 1 -- start start 2023-10-01T08:00:16.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.551+0000 7f8c92db9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8c8c06e570 0x7f8c8c127410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:16.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.551+0000 7f8c92db9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c8c134610 0x7f8c8c139e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:16.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.551+0000 7f8c92db9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8c8c127950 0x7f8c8c13a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:16.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.551+0000 7f8c92db9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8c13bf70 con 0x7f8c8c134610 2023-10-01T08:00:16.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.551+0000 7f8c92db9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8c13e5b0 con 0x7f8c8c127950 2023-10-01T08:00:16.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.551+0000 7f8c92db9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8c0a1f70 con 0x7f8c8c06e570 2023-10-01T08:00:16.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.551+0000 7f8c90b55700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8c8c06e570 0x7f8c8c127410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:16.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.551+0000 7f8c90b55700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8c8c06e570 0x7f8c8c127410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47130/0 (socket says 172.21.15.26:47130) 2023-10-01T08:00:16.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.551+0000 7f8c90b55700 1 -- 172.21.15.26:0/1376149538 learned_addr learned my addr 172.21.15.26:0/1376149538 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:16.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.551+0000 7f8c91356700 1 --2- 172.21.15.26:0/1376149538 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8c8c127950 0x7f8c8c13a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:16.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.551+0000 7f8c8bfff700 1 --2- 172.21.15.26:0/1376149538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c8c134610 0x7f8c8c139e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:16.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.551+0000 7f8c90b55700 1 -- 172.21.15.26:0/1376149538 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8c8c127950 msgr2=0x7f8c8c13a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:16.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.551+0000 7f8c90b55700 1 --2- 172.21.15.26:0/1376149538 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8c8c127950 0x7f8c8c13a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:16.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.551+0000 7f8c90b55700 1 -- 172.21.15.26:0/1376149538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c8c134610 msgr2=0x7f8c8c139e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:16.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.551+0000 7f8c90b55700 1 --2- 172.21.15.26:0/1376149538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c8c134610 0x7f8c8c139e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:16.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.551+0000 7f8c90b55700 1 -- 172.21.15.26:0/1376149538 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c800094a0 con 0x7f8c8c06e570 2023-10-01T08:00:16.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.551+0000 7f8c90b55700 1 --2- 172.21.15.26:0/1376149538 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8c8c06e570 0x7f8c8c127410 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f8c8000ec10 tx=0x7f8c8000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:16.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.552+0000 7f8c897fa700 1 -- 172.21.15.26:0/1376149538 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8000c850 con 0x7f8c8c06e570 2023-10-01T08:00:16.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.552+0000 7f8c897fa700 1 -- 172.21.15.26:0/1376149538 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8000c9b0 con 0x7f8c8c06e570 2023-10-01T08:00:16.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.552+0000 7f8c897fa700 1 -- 172.21.15.26:0/1376149538 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8000cd20 con 0x7f8c8c06e570 2023-10-01T08:00:16.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.552+0000 7f8c92db9700 1 -- 172.21.15.26:0/1376149538 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c780094a0 con 0x7f8c8c06e570 2023-10-01T08:00:16.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.552+0000 7f8c92db9700 1 -- 172.21.15.26:0/1376149538 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c84009b30 con 0x7f8c8c06e570 2023-10-01T08:00:16.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.553+0000 7f8c897fa700 1 -- 172.21.15.26:0/1376149538 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8c80013470 con 0x7f8c8c06e570 2023-10-01T08:00:16.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.553+0000 7f8c897fa700 1 -- 172.21.15.26:0/1376149538 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8c8003fb90 con 0x7f8c8c06e570 2023-10-01T08:00:16.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.554+0000 7f8c92db9700 1 -- 172.21.15.26:0/1376149538 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c8c13c610 con 0x7f8c8c06e570 2023-10-01T08:00:16.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.563+0000 7f8c897fa700 1 -- 172.21.15.26:0/1376149538 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c80017080 con 0x7f8c8c06e570 2023-10-01T08:00:16.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.588+0000 7f8fbb283700 1 -- 172.21.15.26:0/123311325 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8fb40a2360 con 0x7f8fb4133e30 2023-10-01T08:00:16.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.589+0000 7f8fa5ffb700 1 -- 172.21.15.26:0/123311325 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8fa8021020 con 0x7f8fb4133e30 2023-10-01T08:00:16.590 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:16.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.591+0000 7f8fbb283700 1 -- 172.21.15.26:0/123311325 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fb4133e30 msgr2=0x7f8fb409cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:16.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.591+0000 7f8fbb283700 1 --2- 172.21.15.26:0/123311325 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fb4133e30 0x7f8fb409cc20 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f8fa800e980 tx=0x7f8fa800ec90 comp rx=0 tx=0).stop 2023-10-01T08:00:16.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.591+0000 7f8fbb283700 1 -- 172.21.15.26:0/123311325 shutdown_connections 2023-10-01T08:00:16.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.591+0000 7f8fbb283700 1 --2- 172.21.15.26:0/123311325 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8fb4134260 0x7f8fb409d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:16.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.591+0000 7f8fbb283700 1 --2- 172.21.15.26:0/123311325 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fb4133420 0x7f8fb409c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:16.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.591+0000 7f8fbb283700 1 --2- 172.21.15.26:0/123311325 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fb4133e30 0x7f8fb409cc20 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:16.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.591+0000 7f8fbb283700 1 -- 172.21.15.26:0/123311325 >> 172.21.15.26:0/123311325 conn(0x7f8fb40a4210 msgr2=0x7f8fb40a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:16.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.591+0000 7f8fbb283700 1 -- 172.21.15.26:0/123311325 shutdown_connections 2023-10-01T08:00:16.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.591+0000 7f8fbb283700 1 -- 172.21.15.26:0/123311325 wait complete. 2023-10-01T08:00:16.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.592+0000 7fbcd2f01700 1 Processor -- start 2023-10-01T08:00:16.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.593+0000 7fbcd2f01700 1 -- start start 2023-10-01T08:00:16.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.593+0000 7fbcd2f01700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbccc12fea0 0x7fbccc130270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:16.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.593+0000 7fbcd2f01700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbccc0992c0 0x7fbccc0996d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:16.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.593+0000 7fbcd2f01700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbccc09b3b0 con 0x7fbccc099c10 2023-10-01T08:00:16.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.593+0000 7fbcd2f01700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc09c090 con 0x7fbccc0992c0 2023-10-01T08:00:16.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.593+0000 7fbcd2f01700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc12fa70 con 0x7fbccc12fea0 2023-10-01T08:00:16.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.594+0000 7fbcd149e700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbccc099c10 0x7fbccc136c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44626/0 (socket says 172.21.15.26:44626) 2023-10-01T08:00:16.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.594+0000 7fbcd149e700 1 -- 172.21.15.26:0/2617715302 learned_addr learned my addr 172.21.15.26:0/2617715302 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:16.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.594+0000 7fbcd0c9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbccc12fea0 0x7fbccc130270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:16.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.594+0000 7fbccbfff700 1 --2- 172.21.15.26:0/2617715302 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbccc0992c0 0x7fbccc0996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:16.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.594+0000 7fbcd0c9d700 1 -- 172.21.15.26:0/2617715302 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbccc0992c0 msgr2=0x7fbccc0996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:16.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.594+0000 7fbcd0c9d700 1 --2- 172.21.15.26:0/2617715302 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbccc0992c0 0x7fbccc0996d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:16.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.594+0000 7fbcd0c9d700 1 -- 172.21.15.26:0/2617715302 >> v1:172.21.15.26:6789/0 conn(0x7fbccc099c10 legacy=0x7fbccc136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:16.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.594+0000 7fbcd0c9d700 1 -- 172.21.15.26:0/2617715302 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbccc09b0f0 con 0x7fbccc12fea0 2023-10-01T08:00:16.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.594+0000 7fbcd0c9d700 1 --2- 172.21.15.26:0/2617715302 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbccc12fea0 0x7fbccc130270 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fbcc000aa40 tx=0x7fbcc000ad50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa0f170c012ba01a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:16.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.595+0000 7fbccb7fe700 1 -- 172.21.15.26:0/2617715302 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc000cb30 con 0x7fbccc12fea0 2023-10-01T08:00:16.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.595+0000 7fbccb7fe700 1 -- 172.21.15.26:0/2617715302 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc000cc90 con 0x7fbccc12fea0 2023-10-01T08:00:16.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.595+0000 7fbccb7fe700 1 -- 172.21.15.26:0/2617715302 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc0018400 con 0x7fbccc12fea0 2023-10-01T08:00:16.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.596+0000 7fbcd2f01700 1 -- 172.21.15.26:0/2617715302 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbccc12fea0 msgr2=0x7fbccc130270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:16.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.596+0000 7fbcd2f01700 1 --2- 172.21.15.26:0/2617715302 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbccc12fea0 0x7fbccc130270 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fbcc000aa40 tx=0x7fbcc000ad50 comp rx=0 tx=0).stop 2023-10-01T08:00:16.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.596+0000 7fbcd2f01700 1 -- 172.21.15.26:0/2617715302 shutdown_connections 2023-10-01T08:00:16.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.596+0000 7fbcd2f01700 1 --2- 172.21.15.26:0/2617715302 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbccc12fea0 0x7fbccc130270 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:16.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.596+0000 7fbcd2f01700 1 --2- 172.21.15.26:0/2617715302 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbccc0992c0 0x7fbccc0996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:16.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.596+0000 7fbcd2f01700 1 -- 172.21.15.26:0/2617715302 >> 172.21.15.26:0/2617715302 conn(0x7fbccc09e7e0 msgr2=0x7fbccc09ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:16.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.596+0000 7fbcd2f01700 1 -- 172.21.15.26:0/2617715302 shutdown_connections 2023-10-01T08:00:16.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.596+0000 7fbcd2f01700 1 -- 172.21.15.26:0/2617715302 wait complete. 2023-10-01T08:00:16.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.597+0000 7fbcd2f01700 1 Processor -- start 2023-10-01T08:00:16.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.597+0000 7fbcd2f01700 1 -- start start 2023-10-01T08:00:16.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.598+0000 7fbcd2f01700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbccc0992c0 0x7fbccc128a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:16.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.598+0000 7fbcd2f01700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbccc099c10 0x7fbccc128f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:16.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.598+0000 7fbcd2f01700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbccc12fea0 0x7fbccc1c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:16.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.599+0000 7fbcd2f01700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc06ef10 con 0x7fbccc099c10 2023-10-01T08:00:16.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.599+0000 7fbcd2f01700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc129f80 con 0x7fbccc12fea0 2023-10-01T08:00:16.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.599+0000 7fbcd2f01700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc128770 con 0x7fbccc0992c0 2023-10-01T08:00:16.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.599+0000 7fbcd0c9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbccc0992c0 0x7fbccc128a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:16.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.599+0000 7fbccbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbccc099c10 0x7fbccc128f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:16.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.599+0000 7fbcd0c9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbccc0992c0 0x7fbccc128a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47146/0 (socket says 172.21.15.26:47146) 2023-10-01T08:00:16.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.599+0000 7fbcd0c9d700 1 -- 172.21.15.26:0/3541086244 learned_addr learned my addr 172.21.15.26:0/3541086244 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:16.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.599+0000 7fbccbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbccc099c10 0x7fbccc128f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48890/0 (socket says 172.21.15.26:48890) 2023-10-01T08:00:16.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.599+0000 7fbcd149e700 1 --2- 172.21.15.26:0/3541086244 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbccc12fea0 0x7fbccc1c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:16.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.599+0000 7fbcd0c9d700 1 -- 172.21.15.26:0/3541086244 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbccc12fea0 msgr2=0x7fbccc1c3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:16.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.599+0000 7fbcd0c9d700 1 --2- 172.21.15.26:0/3541086244 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbccc12fea0 0x7fbccc1c3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:16.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.599+0000 7fbcd0c9d700 1 -- 172.21.15.26:0/3541086244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbccc099c10 msgr2=0x7fbccc128f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:16.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.599+0000 7fbcd0c9d700 1 --2- 172.21.15.26:0/3541086244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbccc099c10 0x7fbccc128f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:16.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.599+0000 7fbcd0c9d700 1 -- 172.21.15.26:0/3541086244 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc000a640 con 0x7fbccc0992c0 2023-10-01T08:00:16.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.599+0000 7fbccbfff700 1 --2- 172.21.15.26:0/3541086244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbccc099c10 0x7fbccc128f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:16.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.599+0000 7fbcd0c9d700 1 --2- 172.21.15.26:0/3541086244 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbccc0992c0 0x7fbccc128a40 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fbcc000a1c0 tx=0x7fbcc0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:16.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.600+0000 7fbcc97fa700 1 -- 172.21.15.26:0/3541086244 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc0003ab0 con 0x7fbccc0992c0 2023-10-01T08:00:16.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.600+0000 7fbcd2f01700 1 -- 172.21.15.26:0/3541086244 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbccc06d730 con 0x7fbccc0992c0 2023-10-01T08:00:16.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.600+0000 7fbcc97fa700 1 -- 172.21.15.26:0/3541086244 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc0003c30 con 0x7fbccc0992c0 2023-10-01T08:00:16.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.600+0000 7fbcc97fa700 1 -- 172.21.15.26:0/3541086244 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc00204d0 con 0x7fbccc0992c0 2023-10-01T08:00:16.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.600+0000 7fbcd2f01700 1 -- 172.21.15.26:0/3541086244 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbccc1296a0 con 0x7fbccc0992c0 2023-10-01T08:00:16.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.601+0000 7fbcc97fa700 1 -- 172.21.15.26:0/3541086244 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbcc0020650 con 0x7fbccc0992c0 2023-10-01T08:00:16.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.601+0000 7fbcc97fa700 1 -- 172.21.15.26:0/3541086244 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbcc00450d0 con 0x7fbccc0992c0 2023-10-01T08:00:16.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.604+0000 7fbcd2f01700 1 -- 172.21.15.26:0/3541086244 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbccc130730 con 0x7fbccc0992c0 2023-10-01T08:00:16.610 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:16.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.611+0000 7fbcc97fa700 1 -- 172.21.15.26:0/3541086244 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbcc002e080 con 0x7fbccc0992c0 2023-10-01T08:00:16.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.634+0000 7f8d5214b700 1 Processor -- start 2023-10-01T08:00:16.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.634+0000 7f8d5214b700 1 -- start start 2023-10-01T08:00:16.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.635+0000 7f8d5214b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d4c09d6f0 0x7f8d4c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:16.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.635+0000 7f8d5214b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8d4c09e410 0x7f8d4c130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:16.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.635+0000 7f8d5214b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d4c09f130 con 0x7f8d4c09e000 2023-10-01T08:00:16.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.635+0000 7f8d5214b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d4c09f520 con 0x7f8d4c09e410 2023-10-01T08:00:16.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.635+0000 7f8d5214b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c09e930 con 0x7f8d4c09d6f0 2023-10-01T08:00:16.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.635+0000 7f8d4b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d4c09d6f0 0x7f8d4c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:16.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.635+0000 7f8d4affd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8d4c09e000 0x7f8d4c130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44642/0 (socket says 172.21.15.26:44642) 2023-10-01T08:00:16.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.635+0000 7f8d4affd700 1 -- 172.21.15.26:0/3302281611 learned_addr learned my addr 172.21.15.26:0/3302281611 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:16.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.635+0000 7f8d4bfff700 1 --2- 172.21.15.26:0/3302281611 >> v2:172.21.15.26:3300/0 conn(0x7f8d4c09e410 0x7f8d4c130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:16.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.635+0000 7f8d4a7fc700 1 -- 172.21.15.26:0/3302281611 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4017735295 0 0) 0x7f8d4c09f130 con 0x7f8d4c09e000 2023-10-01T08:00:16.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.636+0000 7f8d4a7fc700 1 -- 172.21.15.26:0/3302281611 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d340035b0 con 0x7f8d4c09e000 2023-10-01T08:00:16.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.636+0000 7f8d4bfff700 1 -- 172.21.15.26:0/3302281611 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d4c09d6f0 msgr2=0x7f8d4c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:16.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.636+0000 7f8d4bfff700 1 --2- 172.21.15.26:0/3302281611 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d4c09d6f0 0x7f8d4c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:16.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.636+0000 7f8d4bfff700 1 -- 172.21.15.26:0/3302281611 >> v1:172.21.15.26:6789/0 conn(0x7f8d4c09e000 legacy=0x7f8d4c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:16.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.636+0000 7f8d4bfff700 1 -- 172.21.15.26:0/3302281611 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d4c09b2d0 con 0x7f8d4c09e410 2023-10-01T08:00:16.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.636+0000 7f8d4bfff700 1 --2- 172.21.15.26:0/3302281611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d4c09e410 0x7f8d4c130d70 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f8d44009d90 tx=0x7f8d4400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8240aebd401f8ac8 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:16.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.636+0000 7f8d4a7fc700 1 -- 172.21.15.26:0/3302281611 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4400e070 con 0x7f8d4c09e410 2023-10-01T08:00:16.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.636+0000 7f8d4a7fc700 1 -- 172.21.15.26:0/3302281611 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4400bb20 con 0x7f8d4c09e410 2023-10-01T08:00:16.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.636+0000 7f8d4a7fc700 1 -- 172.21.15.26:0/3302281611 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d44012430 con 0x7f8d4c09e410 2023-10-01T08:00:16.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.637+0000 7f8d5214b700 1 -- 172.21.15.26:0/3302281611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d4c09e410 msgr2=0x7f8d4c130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:16.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.637+0000 7f8d5214b700 1 --2- 172.21.15.26:0/3302281611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d4c09e410 0x7f8d4c130d70 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f8d44009d90 tx=0x7f8d4400b330 comp rx=0 tx=0).stop 2023-10-01T08:00:16.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.637+0000 7f8d5214b700 1 -- 172.21.15.26:0/3302281611 shutdown_connections 2023-10-01T08:00:16.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.637+0000 7f8d5214b700 1 --2- 172.21.15.26:0/3302281611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d4c09e410 0x7f8d4c130d70 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:16.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.637+0000 7f8d5214b700 1 --2- 172.21.15.26:0/3302281611 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d4c09d6f0 0x7f8d4c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:16.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.637+0000 7f8d5214b700 1 -- 172.21.15.26:0/3302281611 >> 172.21.15.26:0/3302281611 conn(0x7f8d4c066f50 msgr2=0x7f8d4c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:16.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.637+0000 7f8d5214b700 1 -- 172.21.15.26:0/3302281611 shutdown_connections 2023-10-01T08:00:16.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.637+0000 7f8d5214b700 1 -- 172.21.15.26:0/3302281611 wait complete. 2023-10-01T08:00:16.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.638+0000 7f8d5214b700 1 Processor -- start 2023-10-01T08:00:16.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.638+0000 7f8d5214b700 1 -- start start 2023-10-01T08:00:16.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.639+0000 7f8d5214b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d4c09d6f0 0x7f8d4c11e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:16.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.639+0000 7f8d5214b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d4c09e000 0x7f8d4c11e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:16.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.639+0000 7f8d5214b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d4c09e410 0x7f8d4c11eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:16.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.639+0000 7f8d5214b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c121df0 con 0x7f8d4c09e410 2023-10-01T08:00:16.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.639+0000 7f8d5214b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c1216a0 con 0x7f8d4c09e000 2023-10-01T08:00:16.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.639+0000 7f8d5214b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c11f4c0 con 0x7f8d4c09d6f0 2023-10-01T08:00:16.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.639+0000 7f8d4affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d4c09e000 0x7f8d4c11e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:16.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.639+0000 7f8d4b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d4c09d6f0 0x7f8d4c11e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:16.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.639+0000 7f8d4b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d4c09d6f0 0x7f8d4c11e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47176/0 (socket says 172.21.15.26:47176) 2023-10-01T08:00:16.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.639+0000 7f8d4b7fe700 1 -- 172.21.15.26:0/2892080306 learned_addr learned my addr 172.21.15.26:0/2892080306 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:16.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.639+0000 7f8d4affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d4c09e000 0x7f8d4c11e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47064/0 (socket says 172.21.15.26:47064) 2023-10-01T08:00:16.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.639+0000 7f8d4bfff700 1 --2- 172.21.15.26:0/2892080306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d4c09e410 0x7f8d4c11eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:16.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.640+0000 7f8d4affd700 1 -- 172.21.15.26:0/2892080306 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d4c09d6f0 msgr2=0x7f8d4c11e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:16.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.640+0000 7f8d4affd700 1 --2- 172.21.15.26:0/2892080306 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d4c09d6f0 0x7f8d4c11e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:16.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.640+0000 7f8d4affd700 1 -- 172.21.15.26:0/2892080306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d4c09e410 msgr2=0x7f8d4c11eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:16.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.640+0000 7f8d4affd700 1 --2- 172.21.15.26:0/2892080306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d4c09e410 0x7f8d4c11eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:16.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.640+0000 7f8d4affd700 1 -- 172.21.15.26:0/2892080306 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d44009a70 con 0x7f8d4c09e000 2023-10-01T08:00:16.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.640+0000 7f8d4affd700 1 --2- 172.21.15.26:0/2892080306 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d4c09e000 0x7f8d4c11e5a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f8d400018d0 tx=0x7f8d40001be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:16.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.640+0000 7f8d33fff700 1 -- 172.21.15.26:0/2892080306 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d40013070 con 0x7f8d4c09e000 2023-10-01T08:00:16.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.640+0000 7f8d33fff700 1 -- 172.21.15.26:0/2892080306 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d40001d10 con 0x7f8d4c09e000 2023-10-01T08:00:16.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.640+0000 7f8d5214b700 1 -- 172.21.15.26:0/2892080306 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d4c11f970 con 0x7f8d4c09e000 2023-10-01T08:00:16.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.640+0000 7f8d33fff700 1 -- 172.21.15.26:0/2892080306 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d40005940 con 0x7f8d4c09e000 2023-10-01T08:00:16.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.640+0000 7f8d5214b700 1 -- 172.21.15.26:0/2892080306 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d4c09c700 con 0x7f8d4c09e000 2023-10-01T08:00:16.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.641+0000 7f8d33fff700 1 -- 172.21.15.26:0/2892080306 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8d40005aa0 con 0x7f8d4c09e000 2023-10-01T08:00:16.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.641+0000 7f8d5214b700 1 -- 172.21.15.26:0/2892080306 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d4c11ac20 con 0x7f8d4c09e000 2023-10-01T08:00:16.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.641+0000 7f8d33fff700 1 -- 172.21.15.26:0/2892080306 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8d40042c30 con 0x7f8d4c09e000 2023-10-01T08:00:16.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.646+0000 7f8d33fff700 1 -- 172.21.15.26:0/2892080306 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8d40005d50 con 0x7f8d4c09e000 2023-10-01T08:00:16.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.779+0000 7f8c92db9700 1 -- 172.21.15.26:0/1376149538 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8c8c074ea0 con 0x7f8c8c06e570 2023-10-01T08:00:16.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.779+0000 7f8c897fa700 1 -- 172.21.15.26:0/1376149538 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8c80021020 con 0x7f8c8c06e570 2023-10-01T08:00:16.780 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:16.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.782+0000 7f8c92db9700 1 -- 172.21.15.26:0/1376149538 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8c8c06e570 msgr2=0x7f8c8c127410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:16.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.782+0000 7f8c92db9700 1 --2- 172.21.15.26:0/1376149538 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8c8c06e570 0x7f8c8c127410 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f8c8000ec10 tx=0x7f8c8000ef20 comp rx=0 tx=0).stop 2023-10-01T08:00:16.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.782+0000 7f8c92db9700 1 -- 172.21.15.26:0/1376149538 shutdown_connections 2023-10-01T08:00:16.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.782+0000 7f8c92db9700 1 --2- 172.21.15.26:0/1376149538 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8c8c127950 0x7f8c8c13a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:16.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.782+0000 7f8c92db9700 1 --2- 172.21.15.26:0/1376149538 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8c8c06e570 0x7f8c8c127410 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:16.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.782+0000 7f8c92db9700 1 --2- 172.21.15.26:0/1376149538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c8c134610 0x7f8c8c139e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:16.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.782+0000 7f8c92db9700 1 -- 172.21.15.26:0/1376149538 >> 172.21.15.26:0/1376149538 conn(0x7f8c8c0a2aa0 msgr2=0x7f8c8c1379c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:16.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.782+0000 7f8c92db9700 1 -- 172.21.15.26:0/1376149538 shutdown_connections 2023-10-01T08:00:16.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.782+0000 7f8c92db9700 1 -- 172.21.15.26:0/1376149538 wait complete. 2023-10-01T08:00:16.796 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:16.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.819+0000 7fbcd2f01700 1 -- 172.21.15.26:0/3541086244 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbccc0747f0 con 0x7fbccc0992c0 2023-10-01T08:00:16.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.820+0000 7fbcc97fa700 1 -- 172.21.15.26:0/3541086244 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbcc0024020 con 0x7fbccc0992c0 2023-10-01T08:00:16.820 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:16.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.823+0000 7fbcd2f01700 1 -- 172.21.15.26:0/3541086244 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbccc0992c0 msgr2=0x7fbccc128a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:16.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.823+0000 7fbcd2f01700 1 --2- 172.21.15.26:0/3541086244 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbccc0992c0 0x7fbccc128a40 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fbcc000a1c0 tx=0x7fbcc0004750 comp rx=0 tx=0).stop 2023-10-01T08:00:16.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.823+0000 7fbcd2f01700 1 -- 172.21.15.26:0/3541086244 shutdown_connections 2023-10-01T08:00:16.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.823+0000 7fbcd2f01700 1 --2- 172.21.15.26:0/3541086244 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbccc12fea0 0x7fbccc1c3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:16.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.823+0000 7fbcd2f01700 1 --2- 172.21.15.26:0/3541086244 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbccc0992c0 0x7fbccc128a40 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:16.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.823+0000 7fbcd2f01700 1 --2- 172.21.15.26:0/3541086244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbccc099c10 0x7fbccc128f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:16.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.823+0000 7fbcd2f01700 1 -- 172.21.15.26:0/3541086244 >> 172.21.15.26:0/3541086244 conn(0x7fbccc09e7e0 msgr2=0x7fbccc12e680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:16.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.823+0000 7fbcd2f01700 1 -- 172.21.15.26:0/3541086244 shutdown_connections 2023-10-01T08:00:16.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.823+0000 7fbcd2f01700 1 -- 172.21.15.26:0/3541086244 wait complete. 2023-10-01T08:00:16.842 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:16.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.862+0000 7f8d5214b700 1 -- 172.21.15.26:0/2892080306 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8d4c074ea0 con 0x7f8d4c09e000 2023-10-01T08:00:16.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.862+0000 7f8d33fff700 1 -- 172.21.15.26:0/2892080306 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8d40016370 con 0x7f8d4c09e000 2023-10-01T08:00:16.863 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:16.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.865+0000 7f8d5214b700 1 -- 172.21.15.26:0/2892080306 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d4c09e000 msgr2=0x7f8d4c11e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:16.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.865+0000 7f8d5214b700 1 --2- 172.21.15.26:0/2892080306 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d4c09e000 0x7f8d4c11e5a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f8d400018d0 tx=0x7f8d40001be0 comp rx=0 tx=0).stop 2023-10-01T08:00:16.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.865+0000 7f8d5214b700 1 -- 172.21.15.26:0/2892080306 shutdown_connections 2023-10-01T08:00:16.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.865+0000 7f8d5214b700 1 --2- 172.21.15.26:0/2892080306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d4c09e410 0x7f8d4c11eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:16.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.865+0000 7f8d5214b700 1 --2- 172.21.15.26:0/2892080306 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d4c09d6f0 0x7f8d4c11e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:16.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.865+0000 7f8d5214b700 1 --2- 172.21.15.26:0/2892080306 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d4c09e000 0x7f8d4c11e5a0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:16.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.865+0000 7f8d5214b700 1 -- 172.21.15.26:0/2892080306 >> 172.21.15.26:0/2892080306 conn(0x7f8d4c066f50 msgr2=0x7f8d4c130990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:16.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.865+0000 7f8d5214b700 1 -- 172.21.15.26:0/2892080306 shutdown_connections 2023-10-01T08:00:16.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:16.865+0000 7f8d5214b700 1 -- 172.21.15.26:0/2892080306 wait complete. 2023-10-01T08:00:16.879 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:17.611 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:17.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.755+0000 7f25bcc6f700 1 Processor -- start 2023-10-01T08:00:17.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.755+0000 7f25bcc6f700 1 -- start start 2023-10-01T08:00:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.756+0000 7f25bcc6f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25b809d6f0 0x7f25b809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.756+0000 7f25bcc6f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f25b809e000 0x7f25b81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.756+0000 7f25bcc6f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25b809e410 0x7f25b8133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.756+0000 7f25bcc6f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b806b460 con 0x7f25b809e000 2023-10-01T08:00:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.756+0000 7f25bcc6f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b809b120 con 0x7f25b809e410 2023-10-01T08:00:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.756+0000 7f25bcc6f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25b809a7e0 con 0x7f25b809d6f0 2023-10-01T08:00:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.756+0000 7f25b5d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f25b809e000 0x7f25b81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:17.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.756+0000 7f25b6d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25b809e410 0x7f25b8133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:17.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.756+0000 7f25b659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25b809d6f0 0x7f25b809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:17.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.756+0000 7f25b5d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f25b809e000 0x7f25b81339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48926/0 (socket says 172.21.15.26:48926) 2023-10-01T08:00:17.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.756+0000 7f25b5d9b700 1 -- 172.21.15.26:0/382825224 learned_addr learned my addr 172.21.15.26:0/382825224 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:17.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.757+0000 7f25b6d9d700 1 -- 172.21.15.26:0/382825224 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25b809d6f0 msgr2=0x7f25b809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:17.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.757+0000 7f25b6d9d700 1 --2- 172.21.15.26:0/382825224 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25b809d6f0 0x7f25b809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:17.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.757+0000 7f25b6d9d700 1 -- 172.21.15.26:0/382825224 >> v2:172.21.15.26:3300/0 conn(0x7f25b809e000 msgr2=0x7f25b81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:17.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.757+0000 7f25b6d9d700 1 --2- 172.21.15.26:0/382825224 >> v2:172.21.15.26:3300/0 conn(0x7f25b809e000 0x7f25b81339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:17.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.757+0000 7f25b6d9d700 1 -- 172.21.15.26:0/382825224 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b809a500 con 0x7f25b809e410 2023-10-01T08:00:17.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.757+0000 7f25b659c700 1 --2- 172.21.15.26:0/382825224 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25b809d6f0 0x7f25b809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:17.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.757+0000 7f25b5d9b700 1 --2- 172.21.15.26:0/382825224 >> v2:172.21.15.26:3300/0 conn(0x7f25b809e000 0x7f25b81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:17.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.757+0000 7f25b6d9d700 1 --2- 172.21.15.26:0/382825224 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25b809e410 0x7f25b8133f30 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f25b0009dc0 tx=0x7f25b000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15ba4c6a9cf4ee39 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:17.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.757+0000 7f25b559a700 1 -- 172.21.15.26:0/382825224 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b000e070 con 0x7f25b809e410 2023-10-01T08:00:17.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.757+0000 7f25b559a700 1 -- 172.21.15.26:0/382825224 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b000bae0 con 0x7f25b809e410 2023-10-01T08:00:17.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.757+0000 7f25b559a700 1 -- 172.21.15.26:0/382825224 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b000be90 con 0x7f25b809e410 2023-10-01T08:00:17.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.758+0000 7f25bcc6f700 1 -- 172.21.15.26:0/382825224 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25b809e410 msgr2=0x7f25b8133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:17.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.758+0000 7f25bcc6f700 1 --2- 172.21.15.26:0/382825224 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25b809e410 0x7f25b8133f30 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f25b0009dc0 tx=0x7f25b000b330 comp rx=0 tx=0).stop 2023-10-01T08:00:17.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.758+0000 7f25bcc6f700 1 -- 172.21.15.26:0/382825224 shutdown_connections 2023-10-01T08:00:17.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.758+0000 7f25bcc6f700 1 --2- 172.21.15.26:0/382825224 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25b809e410 0x7f25b8133f30 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:17.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.758+0000 7f25bcc6f700 1 --2- 172.21.15.26:0/382825224 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25b809d6f0 0x7f25b809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:17.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.758+0000 7f25bcc6f700 1 --2- 172.21.15.26:0/382825224 >> v2:172.21.15.26:3300/0 conn(0x7f25b809e000 0x7f25b81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:17.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.758+0000 7f25bcc6f700 1 -- 172.21.15.26:0/382825224 >> 172.21.15.26:0/382825224 conn(0x7f25b8066f50 msgr2=0x7f25b809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:17.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.758+0000 7f25bcc6f700 1 -- 172.21.15.26:0/382825224 shutdown_connections 2023-10-01T08:00:17.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.758+0000 7f25bcc6f700 1 -- 172.21.15.26:0/382825224 wait complete. 2023-10-01T08:00:17.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.759+0000 7f25bcc6f700 1 Processor -- start 2023-10-01T08:00:17.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.759+0000 7f25bcc6f700 1 -- start start 2023-10-01T08:00:17.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.759+0000 7f25bcc6f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25b809d6f0 0x7f25b81a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:17.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.759+0000 7f25bcc6f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25b809e000 0x7f25b81a5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:17.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.759+0000 7f25bcc6f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25b809e410 0x7f25b81c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:17.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.759+0000 7f25bcc6f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b81a8250 con 0x7f25b809e410 2023-10-01T08:00:17.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.759+0000 7f25bcc6f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b81a8430 con 0x7f25b809d6f0 2023-10-01T08:00:17.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.759+0000 7f25bcc6f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25b81b92a0 con 0x7f25b809e000 2023-10-01T08:00:17.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.760+0000 7f25b659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25b809d6f0 0x7f25b81a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:17.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.760+0000 7f25b5d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25b809e000 0x7f25b81a5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:17.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.760+0000 7f25b659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25b809d6f0 0x7f25b81a52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47092/0 (socket says 172.21.15.26:47092) 2023-10-01T08:00:17.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.760+0000 7f25b659c700 1 -- 172.21.15.26:0/4084592455 learned_addr learned my addr 172.21.15.26:0/4084592455 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:17.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.760+0000 7f25b6d9d700 1 --2- 172.21.15.26:0/4084592455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25b809e410 0x7f25b81c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:17.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.760+0000 7f25b659c700 1 -- 172.21.15.26:0/4084592455 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25b809e000 msgr2=0x7f25b81a5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:17.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.760+0000 7f25b659c700 1 --2- 172.21.15.26:0/4084592455 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25b809e000 0x7f25b81a5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:17.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.760+0000 7f25b659c700 1 -- 172.21.15.26:0/4084592455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25b809e410 msgr2=0x7f25b81c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:17.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.760+0000 7f25b659c700 1 --2- 172.21.15.26:0/4084592455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25b809e410 0x7f25b81c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:17.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.760+0000 7f25b659c700 1 -- 172.21.15.26:0/4084592455 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a80094a0 con 0x7f25b809d6f0 2023-10-01T08:00:17.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.760+0000 7f25b5d9b700 1 --2- 172.21.15.26:0/4084592455 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25b809e000 0x7f25b81a5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:17.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.760+0000 7f25b6d9d700 1 --2- 172.21.15.26:0/4084592455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25b809e410 0x7f25b81c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:17.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.760+0000 7f25b659c700 1 --2- 172.21.15.26:0/4084592455 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25b809d6f0 0x7f25b81a52e0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f25a800ec40 tx=0x7f25a800ef50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:17.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.760+0000 7f25a6ffd700 1 -- 172.21.15.26:0/4084592455 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a800c850 con 0x7f25b809d6f0 2023-10-01T08:00:17.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.760+0000 7f25a6ffd700 1 -- 172.21.15.26:0/4084592455 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a800c9b0 con 0x7f25b809d6f0 2023-10-01T08:00:17.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.760+0000 7f25a6ffd700 1 -- 172.21.15.26:0/4084592455 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a800cd20 con 0x7f25b809d6f0 2023-10-01T08:00:17.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.760+0000 7f25bcc6f700 1 -- 172.21.15.26:0/4084592455 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25ac009550 con 0x7f25b809d6f0 2023-10-01T08:00:17.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.760+0000 7f25bcc6f700 1 -- 172.21.15.26:0/4084592455 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b0009a70 con 0x7f25b809d6f0 2023-10-01T08:00:17.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.761+0000 7f25a6ffd700 1 -- 172.21.15.26:0/4084592455 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f25a8013470 con 0x7f25b809d6f0 2023-10-01T08:00:17.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.761+0000 7f25a6ffd700 1 -- 172.21.15.26:0/4084592455 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f25a803f7f0 con 0x7f25b809d6f0 2023-10-01T08:00:17.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.761+0000 7f25bcc6f700 1 -- 172.21.15.26:0/4084592455 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b809c710 con 0x7f25b809d6f0 2023-10-01T08:00:17.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.766+0000 7f25a6ffd700 1 -- 172.21.15.26:0/4084592455 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25a8017080 con 0x7f25b809d6f0 2023-10-01T08:00:17.797 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:17.843 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:17.880 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:17.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.949+0000 7f7a65296700 1 Processor -- start 2023-10-01T08:00:17.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.949+0000 7f7a65296700 1 -- start start 2023-10-01T08:00:17.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.950+0000 7f7a65296700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7a6009d6f0 0x7f7a6009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:17.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.950+0000 7f7a65296700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7a6009e000 0x7f7a60130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:17.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.950+0000 7f7a65296700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a6009f130 con 0x7f7a6009e410 2023-10-01T08:00:17.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.950+0000 7f7a65296700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a6009f520 con 0x7f7a6009d6f0 2023-10-01T08:00:17.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.950+0000 7f7a65296700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6009e930 con 0x7f7a6009e000 2023-10-01T08:00:17.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.950+0000 7f7a5effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7a6009d6f0 0x7f7a6009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:17.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.950+0000 7f7a5e7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7a6009e000 0x7f7a60130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:17.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.950+0000 7f7a5effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7a6009d6f0 0x7f7a6009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48942/0 (socket says 172.21.15.26:48942) 2023-10-01T08:00:17.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.950+0000 7f7a5e7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7a6009e000 0x7f7a60130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47186/0 (socket says 172.21.15.26:47186) 2023-10-01T08:00:17.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.950+0000 7f7a5effd700 1 -- 172.21.15.26:0/3175046329 learned_addr learned my addr 172.21.15.26:0/3175046329 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:17.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.951+0000 7f7a5dffb700 1 -- 172.21.15.26:0/3175046329 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3951647049 0 0) 0x7f7a6009f130 con 0x7f7a6009e410 2023-10-01T08:00:17.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.951+0000 7f7a5dffb700 1 -- 172.21.15.26:0/3175046329 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a480035b0 con 0x7f7a6009e410 2023-10-01T08:00:17.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.951+0000 7f7a5effd700 1 -- 172.21.15.26:0/3175046329 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7a6009e000 msgr2=0x7f7a60130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:17.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.951+0000 7f7a5effd700 1 --2- 172.21.15.26:0/3175046329 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7a6009e000 0x7f7a60130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:17.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.951+0000 7f7a5effd700 1 -- 172.21.15.26:0/3175046329 >> v1:172.21.15.26:6789/0 conn(0x7f7a6009e410 legacy=0x7f7a60130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:17.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.951+0000 7f7a5effd700 1 -- 172.21.15.26:0/3175046329 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a6009b2d0 con 0x7f7a6009d6f0 2023-10-01T08:00:17.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.951+0000 7f7a5e7fc700 1 --2- 172.21.15.26:0/3175046329 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7a6009e000 0x7f7a60130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:17.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.951+0000 7f7a5effd700 1 --2- 172.21.15.26:0/3175046329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a6009d6f0 0x7f7a6009dac0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f7a500098f0 tx=0x7f7a50009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a577d6d6279652c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:17.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.951+0000 7f7a5dffb700 1 -- 172.21.15.26:0/3175046329 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a50011830 con 0x7f7a6009d6f0 2023-10-01T08:00:17.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.951+0000 7f7a5dffb700 1 -- 172.21.15.26:0/3175046329 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a50011990 con 0x7f7a6009d6f0 2023-10-01T08:00:17.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.951+0000 7f7a5dffb700 1 -- 172.21.15.26:0/3175046329 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a50011d20 con 0x7f7a6009d6f0 2023-10-01T08:00:17.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.952+0000 7f7a65296700 1 -- 172.21.15.26:0/3175046329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a6009d6f0 msgr2=0x7f7a6009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:17.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.952+0000 7f7a65296700 1 --2- 172.21.15.26:0/3175046329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a6009d6f0 0x7f7a6009dac0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f7a500098f0 tx=0x7f7a50009c00 comp rx=0 tx=0).stop 2023-10-01T08:00:17.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.952+0000 7f7a65296700 1 -- 172.21.15.26:0/3175046329 shutdown_connections 2023-10-01T08:00:17.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.952+0000 7f7a65296700 1 --2- 172.21.15.26:0/3175046329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a6009d6f0 0x7f7a6009dac0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:17.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.952+0000 7f7a65296700 1 --2- 172.21.15.26:0/3175046329 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7a6009e000 0x7f7a60130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:17.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.952+0000 7f7a65296700 1 -- 172.21.15.26:0/3175046329 >> 172.21.15.26:0/3175046329 conn(0x7f7a60066f50 msgr2=0x7f7a6009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:17.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.952+0000 7f7a65296700 1 -- 172.21.15.26:0/3175046329 shutdown_connections 2023-10-01T08:00:17.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.952+0000 7f7a65296700 1 -- 172.21.15.26:0/3175046329 wait complete. 2023-10-01T08:00:17.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.954+0000 7f7a65296700 1 Processor -- start 2023-10-01T08:00:17.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.954+0000 7f7a65296700 1 -- start start 2023-10-01T08:00:17.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.955+0000 7f7a65296700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7a6009d6f0 0x7f7a6011dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:17.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.955+0000 7f7a65296700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a6009e000 0x7f7a6011e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:17.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.955+0000 7f7a65296700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7a6009e410 0x7f7a6011e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:17.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.955+0000 7f7a65296700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6011f370 con 0x7f7a6009e000 2023-10-01T08:00:17.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.955+0000 7f7a65296700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a601219c0 con 0x7f7a6009d6f0 2023-10-01T08:00:17.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.955+0000 7f7a65296700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a601200d0 con 0x7f7a6009e410 2023-10-01T08:00:17.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.955+0000 7f7a5effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7a6009d6f0 0x7f7a6011dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:17.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.955+0000 7f7a5effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7a6009d6f0 0x7f7a6011dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47104/0 (socket says 172.21.15.26:47104) 2023-10-01T08:00:17.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.955+0000 7f7a5effd700 1 -- 172.21.15.26:0/2975942437 learned_addr learned my addr 172.21.15.26:0/2975942437 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:17.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.955+0000 7f7a5e7fc700 1 --2- 172.21.15.26:0/2975942437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a6009e000 0x7f7a6011e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:17.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.956+0000 7f7a5e7fc700 1 -- 172.21.15.26:0/2975942437 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7a6009e410 msgr2=0x7f7a6011e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:17.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.956+0000 7f7a5e7fc700 1 --2- 172.21.15.26:0/2975942437 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7a6009e410 0x7f7a6011e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:17.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.956+0000 7f7a5e7fc700 1 -- 172.21.15.26:0/2975942437 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7a6009d6f0 msgr2=0x7f7a6011dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:17.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.956+0000 7f7a5e7fc700 1 --2- 172.21.15.26:0/2975942437 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7a6009d6f0 0x7f7a6011dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:17.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.956+0000 7f7a5e7fc700 1 -- 172.21.15.26:0/2975942437 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a540094a0 con 0x7f7a6009e000 2023-10-01T08:00:17.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.956+0000 7f7a5effd700 1 --2- 172.21.15.26:0/2975942437 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7a6009d6f0 0x7f7a6011dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:17.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.956+0000 7f7a5e7fc700 1 --2- 172.21.15.26:0/2975942437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a6009e000 0x7f7a6011e3e0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f7a54010cf0 tx=0x7f7a5400b140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:17.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.956+0000 7f7a477fe700 1 -- 172.21.15.26:0/2975942437 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a54015070 con 0x7f7a6009e000 2023-10-01T08:00:17.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.956+0000 7f7a477fe700 1 -- 172.21.15.26:0/2975942437 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a5400ba80 con 0x7f7a6009e000 2023-10-01T08:00:17.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.956+0000 7f7a65296700 1 -- 172.21.15.26:0/2975942437 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a50009550 con 0x7f7a6009e000 2023-10-01T08:00:17.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.956+0000 7f7a477fe700 1 -- 172.21.15.26:0/2975942437 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5400be10 con 0x7f7a6009e000 2023-10-01T08:00:17.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.956+0000 7f7a65296700 1 -- 172.21.15.26:0/2975942437 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a600a1fb0 con 0x7f7a6009e000 2023-10-01T08:00:17.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.957+0000 7f7a477fe700 1 -- 172.21.15.26:0/2975942437 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7a54019410 con 0x7f7a6009e000 2023-10-01T08:00:17.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.957+0000 7f7a477fe700 1 -- 172.21.15.26:0/2975942437 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7a54042fc0 con 0x7f7a6009e000 2023-10-01T08:00:17.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.958+0000 7f7a65296700 1 -- 172.21.15.26:0/2975942437 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a6011ac20 con 0x7f7a6009e000 2023-10-01T08:00:17.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.963+0000 7f7a477fe700 1 -- 172.21.15.26:0/2975942437 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7a5401e020 con 0x7f7a6009e000 2023-10-01T08:00:17.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.998+0000 7f500533a700 1 Processor -- start 2023-10-01T08:00:17.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.999+0000 7f500533a700 1 -- start start 2023-10-01T08:00:18.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.999+0000 7f500533a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5000133540 0x7f5000135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:18.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.999+0000 7f500533a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5000135e60 0x7f5000138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:18.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.999+0000 7f500533a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50000716a0 con 0x7f5000130540 2023-10-01T08:00:18.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.999+0000 7f500533a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5000071290 con 0x7f5000133540 2023-10-01T08:00:18.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.999+0000 7f500533a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5000130340 con 0x7f5000135e60 2023-10-01T08:00:18.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.999+0000 7f4fff7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5000135e60 0x7f5000138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:18.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.999+0000 7f4fff7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5000135e60 0x7f5000138240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47204/0 (socket says 172.21.15.26:47204) 2023-10-01T08:00:18.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.999+0000 7f4fff7fe700 1 -- 172.21.15.26:0/1912301885 learned_addr learned my addr 172.21.15.26:0/1912301885 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:18.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:17.999+0000 7f4ffe7fc700 1 --2- 172.21.15.26:0/1912301885 >> v2:172.21.15.26:3300/0 conn(0x7f5000133540 0x7f5000135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:18.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.000+0000 7f4fff7fe700 1 -- 172.21.15.26:0/1912301885 >> v2:172.21.15.26:3300/0 conn(0x7f5000133540 msgr2=0x7f5000135920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:18.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.000+0000 7f4fff7fe700 1 --2- 172.21.15.26:0/1912301885 >> v2:172.21.15.26:3300/0 conn(0x7f5000133540 0x7f5000135920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:18.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.000+0000 7f4fff7fe700 1 -- 172.21.15.26:0/1912301885 >> v1:172.21.15.26:6789/0 conn(0x7f5000130540 legacy=0x7f5000130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:18.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.000+0000 7f4fff7fe700 1 -- 172.21.15.26:0/1912301885 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5000070b80 con 0x7f5000135e60 2023-10-01T08:00:18.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.000+0000 7f4ffe7fc700 1 --2- 172.21.15.26:0/1912301885 >> v2:172.21.15.26:3300/0 conn(0x7f5000133540 0x7f5000135920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T08:00:18.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.000+0000 7f4fff7fe700 1 --2- 172.21.15.26:0/1912301885 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5000135e60 0x7f5000138240 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8009e50 tx=0x7f4ff800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=295540a112b7bf3c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:18.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.000+0000 7f4ffdffb700 1 -- 172.21.15.26:0/1912301885 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff800e070 con 0x7f5000135e60 2023-10-01T08:00:18.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.000+0000 7f4ffdffb700 1 -- 172.21.15.26:0/1912301885 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff800b9c0 con 0x7f5000135e60 2023-10-01T08:00:18.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.000+0000 7f4ffdffb700 1 -- 172.21.15.26:0/1912301885 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff800bd70 con 0x7f5000135e60 2023-10-01T08:00:18.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.001+0000 7f500533a700 1 -- 172.21.15.26:0/1912301885 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5000135e60 msgr2=0x7f5000138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:18.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.001+0000 7f500533a700 1 --2- 172.21.15.26:0/1912301885 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5000135e60 0x7f5000138240 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8009e50 tx=0x7f4ff800b330 comp rx=0 tx=0).stop 2023-10-01T08:00:18.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.001+0000 7f500533a700 1 -- 172.21.15.26:0/1912301885 shutdown_connections 2023-10-01T08:00:18.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.001+0000 7f500533a700 1 --2- 172.21.15.26:0/1912301885 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5000135e60 0x7f5000138240 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:18.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.001+0000 7f500533a700 1 --2- 172.21.15.26:0/1912301885 >> v2:172.21.15.26:3300/0 conn(0x7f5000133540 0x7f5000135920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:18.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.001+0000 7f500533a700 1 -- 172.21.15.26:0/1912301885 >> 172.21.15.26:0/1912301885 conn(0x7f50000a2aa0 msgr2=0x7f50000a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:18.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.001+0000 7f500533a700 1 -- 172.21.15.26:0/1912301885 shutdown_connections 2023-10-01T08:00:18.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.001+0000 7f500533a700 1 -- 172.21.15.26:0/1912301885 wait complete. 2023-10-01T08:00:18.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.003+0000 7f500533a700 1 Processor -- start 2023-10-01T08:00:18.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.003+0000 7f500533a700 1 -- start start 2023-10-01T08:00:18.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.003+0000 7f500533a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5000130540 0x7f500009d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:18.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.003+0000 7f500533a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5000133540 0x7f500009d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:18.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.003+0000 7f500533a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5000135e60 0x7f50001c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:18.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.003+0000 7f500533a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500011ea90 con 0x7f5000133540 2023-10-01T08:00:18.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.003+0000 7f500533a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f500009dae0 con 0x7f5000135e60 2023-10-01T08:00:18.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.003+0000 7f500533a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f500011ec70 con 0x7f5000130540 2023-10-01T08:00:18.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.003+0000 7f4ffeffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5000130540 0x7f500009d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:18.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.003+0000 7f4ffeffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5000130540 0x7f500009d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47212/0 (socket says 172.21.15.26:47212) 2023-10-01T08:00:18.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.003+0000 7f4ffeffd700 1 -- 172.21.15.26:0/2944457496 learned_addr learned my addr 172.21.15.26:0/2944457496 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:18.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.003+0000 7f4ffe7fc700 1 --2- 172.21.15.26:0/2944457496 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5000133540 0x7f500009d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:18.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.004+0000 7f4fff7fe700 1 --2- 172.21.15.26:0/2944457496 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5000135e60 0x7f50001c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:18.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.004+0000 7f4ffeffd700 1 -- 172.21.15.26:0/2944457496 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5000135e60 msgr2=0x7f50001c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:18.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.004+0000 7f4ffeffd700 1 --2- 172.21.15.26:0/2944457496 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5000135e60 0x7f50001c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:18.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.004+0000 7f4ffeffd700 1 -- 172.21.15.26:0/2944457496 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5000133540 msgr2=0x7f500009d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:18.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.004+0000 7f4ffeffd700 1 --2- 172.21.15.26:0/2944457496 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5000133540 0x7f500009d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:18.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.004+0000 7f4ffeffd700 1 -- 172.21.15.26:0/2944457496 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff8009b30 con 0x7f5000130540 2023-10-01T08:00:18.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.004+0000 7f4ffeffd700 1 --2- 172.21.15.26:0/2944457496 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5000130540 0x7f500009d060 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f4ff000c450 tx=0x7f4ff000c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:18.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.004+0000 7f4fe77fe700 1 -- 172.21.15.26:0/2944457496 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff00052d0 con 0x7f5000130540 2023-10-01T08:00:18.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.004+0000 7f4fe77fe700 1 -- 172.21.15.26:0/2944457496 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff0005430 con 0x7f5000130540 2023-10-01T08:00:18.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.004+0000 7f4fe77fe700 1 -- 172.21.15.26:0/2944457496 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff00038c0 con 0x7f5000130540 2023-10-01T08:00:18.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.004+0000 7f500533a700 1 -- 172.21.15.26:0/2944457496 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f500012dac0 con 0x7f5000130540 2023-10-01T08:00:18.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.004+0000 7f500533a700 1 -- 172.21.15.26:0/2944457496 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f500009e200 con 0x7f5000130540 2023-10-01T08:00:18.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.006+0000 7f4fe77fe700 1 -- 172.21.15.26:0/2944457496 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4ff0003a20 con 0x7f5000130540 2023-10-01T08:00:18.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.006+0000 7f500533a700 1 -- 172.21.15.26:0/2944457496 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f500011e8f0 con 0x7f5000130540 2023-10-01T08:00:18.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.006+0000 7f4fe77fe700 1 -- 172.21.15.26:0/2944457496 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4ff003eb40 con 0x7f5000130540 2023-10-01T08:00:18.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.011+0000 7f4fe77fe700 1 -- 172.21.15.26:0/2944457496 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f500011e8f0 con 0x7f5000130540 2023-10-01T08:00:18.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.013+0000 7f25bcc6f700 1 -- 172.21.15.26:0/4084592455 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f25b8074ea0 con 0x7f25b809d6f0 2023-10-01T08:00:18.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.014+0000 7f25a6ffd700 1 -- 172.21.15.26:0/4084592455 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f25a8013720 con 0x7f25b809d6f0 2023-10-01T08:00:18.015 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:18.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.018+0000 7f25bcc6f700 1 -- 172.21.15.26:0/4084592455 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25b809d6f0 msgr2=0x7f25b81a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:18.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.018+0000 7f25bcc6f700 1 --2- 172.21.15.26:0/4084592455 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25b809d6f0 0x7f25b81a52e0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f25a800ec40 tx=0x7f25a800ef50 comp rx=0 tx=0).stop 2023-10-01T08:00:18.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.018+0000 7f25bcc6f700 1 -- 172.21.15.26:0/4084592455 shutdown_connections 2023-10-01T08:00:18.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.018+0000 7f25bcc6f700 1 --2- 172.21.15.26:0/4084592455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25b809e410 0x7f25b81c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:18.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.018+0000 7f25bcc6f700 1 --2- 172.21.15.26:0/4084592455 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25b809d6f0 0x7f25b81a52e0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:18.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.018+0000 7f25bcc6f700 1 --2- 172.21.15.26:0/4084592455 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25b809e000 0x7f25b81a5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:18.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.018+0000 7f25bcc6f700 1 -- 172.21.15.26:0/4084592455 >> 172.21.15.26:0/4084592455 conn(0x7f25b8066f50 msgr2=0x7f25b81bba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:18.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.018+0000 7f25bcc6f700 1 -- 172.21.15.26:0/4084592455 shutdown_connections 2023-10-01T08:00:18.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.018+0000 7f25bcc6f700 1 -- 172.21.15.26:0/4084592455 wait complete. 2023-10-01T08:00:18.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.033+0000 7f41e62f7700 1 Processor -- start 2023-10-01T08:00:18.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.033+0000 7f41e62f7700 1 -- start start 2023-10-01T08:00:18.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.034+0000 7f41e62f7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41e009d6f0 0x7f41e009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:18.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.034+0000 7f41e62f7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f41e009e410 0x7f41e0134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:18.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.034+0000 7f41e62f7700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e009b120 con 0x7f41e009e000 2023-10-01T08:00:18.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.034+0000 7f41e62f7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e006b460 con 0x7f41e009e410 2023-10-01T08:00:18.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.034+0000 7f41e62f7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e009a7e0 con 0x7f41e009d6f0 2023-10-01T08:00:18.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.034+0000 7f41dffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41e009d6f0 0x7f41e009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:18.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.035+0000 7f41dffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41e009d6f0 0x7f41e009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47122/0 (socket says 172.21.15.26:47122) 2023-10-01T08:00:18.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.035+0000 7f41dffff700 1 -- 172.21.15.26:0/1991398144 learned_addr learned my addr 172.21.15.26:0/1991398144 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:18.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.035+0000 7f41e4894700 1 --2- 172.21.15.26:0/1991398144 >> v2:172.21.15.26:3300/0 conn(0x7f41e009e410 0x7f41e0134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:18.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.035+0000 7f41dffff700 1 -- 172.21.15.26:0/1991398144 >> v2:172.21.15.26:3300/0 conn(0x7f41e009e410 msgr2=0x7f41e0134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:18.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.035+0000 7f41dffff700 1 --2- 172.21.15.26:0/1991398144 >> v2:172.21.15.26:3300/0 conn(0x7f41e009e410 0x7f41e0134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:18.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.035+0000 7f41dffff700 1 -- 172.21.15.26:0/1991398144 >> v1:172.21.15.26:6789/0 conn(0x7f41e009e000 legacy=0x7f41e01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:18.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.035+0000 7f41dffff700 1 -- 172.21.15.26:0/1991398144 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e009a500 con 0x7f41e009d6f0 2023-10-01T08:00:18.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.035+0000 7f41e4894700 1 --2- 172.21.15.26:0/1991398144 >> v2:172.21.15.26:3300/0 conn(0x7f41e009e410 0x7f41e0134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T08:00:18.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.035+0000 7f41dffff700 1 --2- 172.21.15.26:0/1991398144 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41e009d6f0 0x7f41e009dac0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f41d0009920 tx=0x7f41d0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=680637e3c0674535 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:18.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.035+0000 7f41deffd700 1 -- 172.21.15.26:0/1991398144 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d0004230 con 0x7f41e009d6f0 2023-10-01T08:00:18.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.035+0000 7f41deffd700 1 -- 172.21.15.26:0/1991398144 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d0004390 con 0x7f41e009d6f0 2023-10-01T08:00:18.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.035+0000 7f41deffd700 1 -- 172.21.15.26:0/1991398144 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d0009e70 con 0x7f41e009d6f0 2023-10-01T08:00:18.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.036+0000 7f41e62f7700 1 -- 172.21.15.26:0/1991398144 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41e009d6f0 msgr2=0x7f41e009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:18.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.036+0000 7f41e62f7700 1 --2- 172.21.15.26:0/1991398144 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41e009d6f0 0x7f41e009dac0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f41d0009920 tx=0x7f41d0009c30 comp rx=0 tx=0).stop 2023-10-01T08:00:18.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.036+0000 7f41e62f7700 1 -- 172.21.15.26:0/1991398144 shutdown_connections 2023-10-01T08:00:18.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.036+0000 7f41e62f7700 1 --2- 172.21.15.26:0/1991398144 >> v2:172.21.15.26:3300/0 conn(0x7f41e009e410 0x7f41e0134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:18.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.036+0000 7f41e62f7700 1 --2- 172.21.15.26:0/1991398144 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41e009d6f0 0x7f41e009dac0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:18.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.036+0000 7f41e62f7700 1 -- 172.21.15.26:0/1991398144 >> 172.21.15.26:0/1991398144 conn(0x7f41e0066f50 msgr2=0x7f41e009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:18.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.036+0000 7f41e62f7700 1 -- 172.21.15.26:0/1991398144 shutdown_connections 2023-10-01T08:00:18.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.036+0000 7f41e62f7700 1 -- 172.21.15.26:0/1991398144 wait complete. 2023-10-01T08:00:18.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.037+0000 7f41e62f7700 1 Processor -- start 2023-10-01T08:00:18.040 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:18.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.038+0000 7f41e62f7700 1 -- start start 2023-10-01T08:00:18.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.038+0000 7f41e62f7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41e009d6f0 0x7f41e01ab9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:18.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.038+0000 7f41e62f7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41e009e000 0x7f41e01abef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:18.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.038+0000 7f41e62f7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41e009e410 0x7f41e01ac430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:18.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.038+0000 7f41e62f7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e01adbe0 con 0x7f41e009d6f0 2023-10-01T08:00:18.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.038+0000 7f41e62f7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e009c780 con 0x7f41e009e410 2023-10-01T08:00:18.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.038+0000 7f41e62f7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41e00a3130 con 0x7f41e009e000 2023-10-01T08:00:18.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.038+0000 7f41e4894700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41e009e410 0x7f41e01ac430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:18.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.038+0000 7f41e4894700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41e009e410 0x7f41e01ac430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47124/0 (socket says 172.21.15.26:47124) 2023-10-01T08:00:18.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.038+0000 7f41e4894700 1 -- 172.21.15.26:0/3039254750 learned_addr learned my addr 172.21.15.26:0/3039254750 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:18.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.039+0000 7f41dffff700 1 --2- 172.21.15.26:0/3039254750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41e009d6f0 0x7f41e01ab9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:18.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.039+0000 7f41e4894700 1 -- 172.21.15.26:0/3039254750 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41e009e000 msgr2=0x7f41e01abef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:18.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.039+0000 7f41e4894700 1 --2- 172.21.15.26:0/3039254750 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41e009e000 0x7f41e01abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:18.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.039+0000 7f41e4894700 1 -- 172.21.15.26:0/3039254750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41e009d6f0 msgr2=0x7f41e01ab9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:18.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.039+0000 7f41e4894700 1 --2- 172.21.15.26:0/3039254750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41e009d6f0 0x7f41e01ab9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:18.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.039+0000 7f41e4894700 1 -- 172.21.15.26:0/3039254750 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d0009550 con 0x7f41e009e410 2023-10-01T08:00:18.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.039+0000 7f41e4894700 1 --2- 172.21.15.26:0/3039254750 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41e009e410 0x7f41e01ac430 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f41d800cef0 tx=0x7f41d800cf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:18.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.039+0000 7f41dcff9700 1 -- 172.21.15.26:0/3039254750 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d800adb0 con 0x7f41e009e410 2023-10-01T08:00:18.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.039+0000 7f41dcff9700 1 -- 172.21.15.26:0/3039254750 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d8015440 con 0x7f41e009e410 2023-10-01T08:00:18.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.039+0000 7f41e62f7700 1 -- 172.21.15.26:0/3039254750 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e01ae810 con 0x7f41e009e410 2023-10-01T08:00:18.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.039+0000 7f41dcff9700 1 -- 172.21.15.26:0/3039254750 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d80157f0 con 0x7f41e009e410 2023-10-01T08:00:18.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.039+0000 7f41e62f7700 1 -- 172.21.15.26:0/3039254750 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e01addb0 con 0x7f41e009e410 2023-10-01T08:00:18.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.040+0000 7f41e62f7700 1 -- 172.21.15.26:0/3039254750 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e0074ea0 con 0x7f41e009e410 2023-10-01T08:00:18.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.041+0000 7f41dcff9700 1 -- 172.21.15.26:0/3039254750 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f41d800d430 con 0x7f41e009e410 2023-10-01T08:00:18.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.041+0000 7f41dcff9700 1 -- 172.21.15.26:0/3039254750 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f41d8040140 con 0x7f41e009e410 2023-10-01T08:00:18.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.050+0000 7f41dcff9700 1 -- 172.21.15.26:0/3039254750 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f41d8008910 con 0x7f41e009e410 2023-10-01T08:00:18.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.206+0000 7f7a65296700 1 -- 172.21.15.26:0/2975942437 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7a60121380 con 0x7f7a6009e000 2023-10-01T08:00:18.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.206+0000 7f7a477fe700 1 -- 172.21.15.26:0/2975942437 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7a60121380 con 0x7f7a6009e000 2023-10-01T08:00:18.207 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:18.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.208+0000 7f7a65296700 1 -- 172.21.15.26:0/2975942437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a6009e000 msgr2=0x7f7a6011e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:18.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.208+0000 7f7a65296700 1 --2- 172.21.15.26:0/2975942437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a6009e000 0x7f7a6011e3e0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f7a54010cf0 tx=0x7f7a5400b140 comp rx=0 tx=0).stop 2023-10-01T08:00:18.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.209+0000 7f7a65296700 1 -- 172.21.15.26:0/2975942437 shutdown_connections 2023-10-01T08:00:18.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.209+0000 7f7a65296700 1 --2- 172.21.15.26:0/2975942437 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7a6009e410 0x7f7a6011e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:18.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.209+0000 7f7a65296700 1 --2- 172.21.15.26:0/2975942437 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7a6009d6f0 0x7f7a6011dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:18.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.209+0000 7f7a65296700 1 --2- 172.21.15.26:0/2975942437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a6009e000 0x7f7a6011e3e0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:18.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.209+0000 7f7a65296700 1 -- 172.21.15.26:0/2975942437 >> 172.21.15.26:0/2975942437 conn(0x7f7a60066f50 msgr2=0x7f7a60130b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:18.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.209+0000 7f7a65296700 1 -- 172.21.15.26:0/2975942437 shutdown_connections 2023-10-01T08:00:18.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.209+0000 7f7a65296700 1 -- 172.21.15.26:0/2975942437 wait complete. 2023-10-01T08:00:18.229 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:18.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.235+0000 7f500533a700 1 -- 172.21.15.26:0/2944457496 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f500011e8f0 con 0x7f5000130540 2023-10-01T08:00:18.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.236+0000 7f4fe77fe700 1 -- 172.21.15.26:0/2944457496 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f500011e8f0 con 0x7f5000130540 2023-10-01T08:00:18.237 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:18.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.238+0000 7f500533a700 1 -- 172.21.15.26:0/2944457496 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5000130540 msgr2=0x7f500009d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:18.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.238+0000 7f500533a700 1 --2- 172.21.15.26:0/2944457496 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5000130540 0x7f500009d060 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f4ff000c450 tx=0x7f4ff000c760 comp rx=0 tx=0).stop 2023-10-01T08:00:18.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.238+0000 7f500533a700 1 -- 172.21.15.26:0/2944457496 shutdown_connections 2023-10-01T08:00:18.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.238+0000 7f500533a700 1 --2- 172.21.15.26:0/2944457496 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5000135e60 0x7f50001c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:18.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.238+0000 7f500533a700 1 --2- 172.21.15.26:0/2944457496 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5000130540 0x7f500009d060 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:18.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.238+0000 7f500533a700 1 --2- 172.21.15.26:0/2944457496 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5000133540 0x7f500009d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:18.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.238+0000 7f500533a700 1 -- 172.21.15.26:0/2944457496 >> 172.21.15.26:0/2944457496 conn(0x7f50000a2aa0 msgr2=0x7f50000a0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:18.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.238+0000 7f500533a700 1 -- 172.21.15.26:0/2944457496 shutdown_connections 2023-10-01T08:00:18.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.238+0000 7f500533a700 1 -- 172.21.15.26:0/2944457496 wait complete. 2023-10-01T08:00:18.254 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:18.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.257+0000 7f41e62f7700 1 -- 172.21.15.26:0/3039254750 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f41e01aefe0 con 0x7f41e009e410 2023-10-01T08:00:18.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.258+0000 7f41dcff9700 1 -- 172.21.15.26:0/3039254750 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f41d801a030 con 0x7f41e009e410 2023-10-01T08:00:18.259 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:18.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.260+0000 7f41e62f7700 1 -- 172.21.15.26:0/3039254750 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41e009e410 msgr2=0x7f41e01ac430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:18.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.260+0000 7f41e62f7700 1 --2- 172.21.15.26:0/3039254750 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41e009e410 0x7f41e01ac430 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f41d800cef0 tx=0x7f41d800cf20 comp rx=0 tx=0).stop 2023-10-01T08:00:18.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.260+0000 7f41e62f7700 1 -- 172.21.15.26:0/3039254750 shutdown_connections 2023-10-01T08:00:18.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.260+0000 7f41e62f7700 1 --2- 172.21.15.26:0/3039254750 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41e009e410 0x7f41e01ac430 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:18.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.260+0000 7f41e62f7700 1 --2- 172.21.15.26:0/3039254750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41e009d6f0 0x7f41e01ab9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:18.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.260+0000 7f41e62f7700 1 --2- 172.21.15.26:0/3039254750 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41e009e000 0x7f41e01abef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:18.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.260+0000 7f41e62f7700 1 -- 172.21.15.26:0/3039254750 >> 172.21.15.26:0/3039254750 conn(0x7f41e0066f50 msgr2=0x7f41e00713a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:18.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.260+0000 7f41e62f7700 1 -- 172.21.15.26:0/3039254750 shutdown_connections 2023-10-01T08:00:18.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:18.260+0000 7f41e62f7700 1 -- 172.21.15.26:0/3039254750 wait complete. 2023-10-01T08:00:18.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:19.041 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:19.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.188+0000 7f30fcc8b700 1 Processor -- start 2023-10-01T08:00:19.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.188+0000 7f30fcc8b700 1 -- start start 2023-10-01T08:00:19.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.189+0000 7f30fcc8b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f30f8133420 0x7f30f81337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:19.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.189+0000 7f30fcc8b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f30f8133e30 0x7f30f812ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:19.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.189+0000 7f30fcc8b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f30f8134260 0x7f30f81304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:19.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.189+0000 7f30fcc8b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f806b990 con 0x7f30f8134260 2023-10-01T08:00:19.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.189+0000 7f30fcc8b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f80a0590 con 0x7f30f8133e30 2023-10-01T08:00:19.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.189+0000 7f30fcc8b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30f809fb80 con 0x7f30f8133420 2023-10-01T08:00:19.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.189+0000 7f30f6d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f30f8134260 0x7f30f81304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:19.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.189+0000 7f30f5d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f30f8133e30 0x7f30f812ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:19.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.189+0000 7f30f659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f30f8133420 0x7f30f81337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:19.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.189+0000 7f30f6d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f30f8134260 0x7f30f81304d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48996/0 (socket says 172.21.15.26:48996) 2023-10-01T08:00:19.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.189+0000 7f30f5d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f30f8133e30 0x7f30f812ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47130/0 (socket says 172.21.15.26:47130) 2023-10-01T08:00:19.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.189+0000 7f30f6d9d700 1 -- 172.21.15.26:0/2590399916 learned_addr learned my addr 172.21.15.26:0/2590399916 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:19.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.189+0000 7f30f659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f30f8133420 0x7f30f81337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47236/0 (socket says 172.21.15.26:47236) 2023-10-01T08:00:19.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.189+0000 7f30f6d9d700 1 -- 172.21.15.26:0/2590399916 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f30f8133420 msgr2=0x7f30f81337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:19.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.189+0000 7f30f6d9d700 1 --2- 172.21.15.26:0/2590399916 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f30f8133420 0x7f30f81337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.189+0000 7f30f6d9d700 1 -- 172.21.15.26:0/2590399916 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f30f8133e30 msgr2=0x7f30f812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:19.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.189+0000 7f30f6d9d700 1 --2- 172.21.15.26:0/2590399916 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f30f8133e30 0x7f30f812ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.189+0000 7f30f6d9d700 1 -- 172.21.15.26:0/2590399916 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f80a0030 con 0x7f30f8134260 2023-10-01T08:00:19.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.189+0000 7f30f5d9b700 1 --2- 172.21.15.26:0/2590399916 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f30f8133e30 0x7f30f812ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:19.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.189+0000 7f30f659c700 1 --2- 172.21.15.26:0/2590399916 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f30f8133420 0x7f30f81337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:19.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.190+0000 7f30f6d9d700 1 --2- 172.21.15.26:0/2590399916 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30f8134260 0x7f30f81304d0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f30f0009e50 tx=0x7f30f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baff5665b707f87d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:19.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.190+0000 7f30f559a700 1 -- 172.21.15.26:0/2590399916 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f000e070 con 0x7f30f8134260 2023-10-01T08:00:19.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.190+0000 7f30f559a700 1 -- 172.21.15.26:0/2590399916 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f000b910 con 0x7f30f8134260 2023-10-01T08:00:19.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.190+0000 7f30f559a700 1 -- 172.21.15.26:0/2590399916 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f000bcc0 con 0x7f30f8134260 2023-10-01T08:00:19.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.190+0000 7f30fcc8b700 1 -- 172.21.15.26:0/2590399916 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30f8134260 msgr2=0x7f30f81304d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:19.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.190+0000 7f30fcc8b700 1 --2- 172.21.15.26:0/2590399916 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30f8134260 0x7f30f81304d0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f30f0009e50 tx=0x7f30f000b330 comp rx=0 tx=0).stop 2023-10-01T08:00:19.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.190+0000 7f30fcc8b700 1 -- 172.21.15.26:0/2590399916 shutdown_connections 2023-10-01T08:00:19.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.190+0000 7f30fcc8b700 1 --2- 172.21.15.26:0/2590399916 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30f8134260 0x7f30f81304d0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.190+0000 7f30fcc8b700 1 --2- 172.21.15.26:0/2590399916 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f30f8133420 0x7f30f81337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.190+0000 7f30fcc8b700 1 --2- 172.21.15.26:0/2590399916 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f30f8133e30 0x7f30f812ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.190+0000 7f30fcc8b700 1 -- 172.21.15.26:0/2590399916 >> 172.21.15.26:0/2590399916 conn(0x7f30f80a4210 msgr2=0x7f30f80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:19.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.190+0000 7f30fcc8b700 1 -- 172.21.15.26:0/2590399916 shutdown_connections 2023-10-01T08:00:19.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.191+0000 7f30fcc8b700 1 -- 172.21.15.26:0/2590399916 wait complete. 2023-10-01T08:00:19.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.192+0000 7f30fcc8b700 1 Processor -- start 2023-10-01T08:00:19.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.192+0000 7f30fcc8b700 1 -- start start 2023-10-01T08:00:19.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.192+0000 7f30fcc8b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30f8133420 0x7f30f809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:19.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.192+0000 7f30fcc8b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f30f8133e30 0x7f30f809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:19.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.192+0000 7f30fcc8b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f30f8134260 0x7f30f809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:19.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.192+0000 7f30fcc8b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f8120e40 con 0x7f30f8133420 2023-10-01T08:00:19.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.192+0000 7f30fcc8b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f809df10 con 0x7f30f8134260 2023-10-01T08:00:19.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.192+0000 7f30fcc8b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30f812d670 con 0x7f30f8133e30 2023-10-01T08:00:19.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.192+0000 7f30f659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30f8133420 0x7f30f809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:19.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.192+0000 7f30f6d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f30f8134260 0x7f30f809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:19.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.192+0000 7f30f659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30f8133420 0x7f30f809c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49004/0 (socket says 172.21.15.26:49004) 2023-10-01T08:00:19.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.192+0000 7f30f659c700 1 -- 172.21.15.26:0/4240208043 learned_addr learned my addr 172.21.15.26:0/4240208043 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:19.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.192+0000 7f30f5d9b700 1 --2- 172.21.15.26:0/4240208043 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f30f8133e30 0x7f30f809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:19.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.193+0000 7f30f659c700 1 -- 172.21.15.26:0/4240208043 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f30f8133e30 msgr2=0x7f30f809c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:19.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.193+0000 7f30f659c700 1 --2- 172.21.15.26:0/4240208043 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f30f8133e30 0x7f30f809c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.193+0000 7f30f659c700 1 -- 172.21.15.26:0/4240208043 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f30f8134260 msgr2=0x7f30f809cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:19.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.193+0000 7f30f659c700 1 --2- 172.21.15.26:0/4240208043 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f30f8134260 0x7f30f809cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.193+0000 7f30f659c700 1 -- 172.21.15.26:0/4240208043 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e80094a0 con 0x7f30f8133420 2023-10-01T08:00:19.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.193+0000 7f30f6d9d700 1 --2- 172.21.15.26:0/4240208043 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f30f8134260 0x7f30f809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:19.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.193+0000 7f30f659c700 1 --2- 172.21.15.26:0/4240208043 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30f8133420 0x7f30f809c480 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f30e800ebe0 tx=0x7f30e800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:19.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.193+0000 7f30eeffd700 1 -- 172.21.15.26:0/4240208043 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e800c850 con 0x7f30f8133420 2023-10-01T08:00:19.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.193+0000 7f30eeffd700 1 -- 172.21.15.26:0/4240208043 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e800c9b0 con 0x7f30f8133420 2023-10-01T08:00:19.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.193+0000 7f30fcc8b700 1 -- 172.21.15.26:0/4240208043 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30e00094a0 con 0x7f30f8133420 2023-10-01T08:00:19.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.193+0000 7f30eeffd700 1 -- 172.21.15.26:0/4240208043 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e800cd40 con 0x7f30f8133420 2023-10-01T08:00:19.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.193+0000 7f30fcc8b700 1 -- 172.21.15.26:0/4240208043 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f0009b30 con 0x7f30f8133420 2023-10-01T08:00:19.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.194+0000 7f30eeffd700 1 -- 172.21.15.26:0/4240208043 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f30e8013470 con 0x7f30f8133420 2023-10-01T08:00:19.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.194+0000 7f30fcc8b700 1 -- 172.21.15.26:0/4240208043 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f806d2b0 con 0x7f30f8133420 2023-10-01T08:00:19.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.194+0000 7f30eeffd700 1 -- 172.21.15.26:0/4240208043 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f30e803f8b0 con 0x7f30f8133420 2023-10-01T08:00:19.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.199+0000 7f30eeffd700 1 -- 172.21.15.26:0/4240208043 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f30e8021020 con 0x7f30f8133420 2023-10-01T08:00:19.230 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:19.255 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:19.275 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:19.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.384+0000 7ff3945cc700 1 Processor -- start 2023-10-01T08:00:19.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.384+0000 7ff3945cc700 1 -- start start 2023-10-01T08:00:19.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.385+0000 7ff3945cc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff38c1337f0 0x7ff38c138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:19.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.385+0000 7ff3945cc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff38c138dc0 0x7ff38c13b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:19.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.385+0000 7ff3945cc700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff38c06b990 con 0x7ff38c133420 2023-10-01T08:00:19.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.385+0000 7ff3945cc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c09b0e0 con 0x7ff38c1337f0 2023-10-01T08:00:19.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.385+0000 7ff3945cc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c133c20 con 0x7ff38c138dc0 2023-10-01T08:00:19.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.386+0000 7ff392368700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff38c133420 0x7ff38c133e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44684/0 (socket says 172.21.15.26:44684) 2023-10-01T08:00:19.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.386+0000 7ff392368700 1 -- 172.21.15.26:0/3927968960 learned_addr learned my addr 172.21.15.26:0/3927968960 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:19.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.386+0000 7ff392b69700 1 --2- 172.21.15.26:0/3927968960 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff38c138dc0 0x7ff38c13b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:19.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.386+0000 7ff391b67700 1 --2- 172.21.15.26:0/3927968960 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff38c1337f0 0x7ff38c138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:19.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.386+0000 7ff391b67700 1 -- 172.21.15.26:0/3927968960 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff38c138dc0 msgr2=0x7ff38c13b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:19.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.386+0000 7ff391b67700 1 --2- 172.21.15.26:0/3927968960 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff38c138dc0 0x7ff38c13b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.386+0000 7ff391b67700 1 -- 172.21.15.26:0/3927968960 >> v1:172.21.15.26:6789/0 conn(0x7ff38c133420 legacy=0x7ff38c133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:19.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.386+0000 7ff391366700 1 -- 172.21.15.26:0/3927968960 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2159014978 0 0) 0x7ff38c06b990 con 0x7ff38c133420 2023-10-01T08:00:19.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.386+0000 7ff391b67700 1 -- 172.21.15.26:0/3927968960 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff38c0a0590 con 0x7ff38c1337f0 2023-10-01T08:00:19.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.386+0000 7ff392b69700 1 --2- 172.21.15.26:0/3927968960 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff38c138dc0 0x7ff38c13b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:19.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.386+0000 7ff391b67700 1 --2- 172.21.15.26:0/3927968960 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff38c1337f0 0x7ff38c138880 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7ff37c009870 tx=0x7ff37c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27c5695b83faf30b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:19.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.387+0000 7ff391366700 1 -- 172.21.15.26:0/3927968960 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37c011830 con 0x7ff38c1337f0 2023-10-01T08:00:19.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.387+0000 7ff391366700 1 -- 172.21.15.26:0/3927968960 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37c011990 con 0x7ff38c1337f0 2023-10-01T08:00:19.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.387+0000 7ff391366700 1 -- 172.21.15.26:0/3927968960 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37c011d20 con 0x7ff38c1337f0 2023-10-01T08:00:19.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.388+0000 7ff3945cc700 1 -- 172.21.15.26:0/3927968960 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff38c1337f0 msgr2=0x7ff38c138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:19.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.388+0000 7ff3945cc700 1 --2- 172.21.15.26:0/3927968960 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff38c1337f0 0x7ff38c138880 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7ff37c009870 tx=0x7ff37c009b80 comp rx=0 tx=0).stop 2023-10-01T08:00:19.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.388+0000 7ff3945cc700 1 -- 172.21.15.26:0/3927968960 shutdown_connections 2023-10-01T08:00:19.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.388+0000 7ff3945cc700 1 --2- 172.21.15.26:0/3927968960 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff38c138dc0 0x7ff38c13b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.388+0000 7ff3945cc700 1 --2- 172.21.15.26:0/3927968960 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff38c1337f0 0x7ff38c138880 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.388+0000 7ff3945cc700 1 -- 172.21.15.26:0/3927968960 >> 172.21.15.26:0/3927968960 conn(0x7ff38c0a4210 msgr2=0x7ff38c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:19.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.388+0000 7ff3945cc700 1 -- 172.21.15.26:0/3927968960 shutdown_connections 2023-10-01T08:00:19.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.388+0000 7ff3945cc700 1 -- 172.21.15.26:0/3927968960 wait complete. 2023-10-01T08:00:19.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.389+0000 7ff3945cc700 1 Processor -- start 2023-10-01T08:00:19.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.390+0000 7ff3945cc700 1 -- start start 2023-10-01T08:00:19.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.390+0000 7ff3945cc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff38c133420 0x7ff38c12ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:19.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.390+0000 7ff3945cc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff38c1337f0 0x7ff38c12f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:19.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.390+0000 7ff3945cc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff38c138dc0 0x7ff38c12f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:19.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.390+0000 7ff3945cc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c09c640 con 0x7ff38c1337f0 2023-10-01T08:00:19.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.390+0000 7ff3945cc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c09c870 con 0x7ff38c133420 2023-10-01T08:00:19.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.390+0000 7ff3945cc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c09e340 con 0x7ff38c138dc0 2023-10-01T08:00:19.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.390+0000 7ff392b69700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff38c138dc0 0x7ff38c12f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:19.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.390+0000 7ff392b69700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff38c138dc0 0x7ff38c12f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47266/0 (socket says 172.21.15.26:47266) 2023-10-01T08:00:19.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.391+0000 7ff392b69700 1 -- 172.21.15.26:0/2847721421 learned_addr learned my addr 172.21.15.26:0/2847721421 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:19.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.391+0000 7ff392368700 1 --2- 172.21.15.26:0/2847721421 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff38c133420 0x7ff38c12ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:19.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.391+0000 7ff391b67700 1 --2- 172.21.15.26:0/2847721421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff38c1337f0 0x7ff38c12f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:19.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.391+0000 7ff392b69700 1 -- 172.21.15.26:0/2847721421 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff38c133420 msgr2=0x7ff38c12ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:19.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.391+0000 7ff392b69700 1 --2- 172.21.15.26:0/2847721421 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff38c133420 0x7ff38c12ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.391+0000 7ff392b69700 1 -- 172.21.15.26:0/2847721421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff38c1337f0 msgr2=0x7ff38c12f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:19.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.391+0000 7ff392b69700 1 --2- 172.21.15.26:0/2847721421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff38c1337f0 0x7ff38c12f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.391+0000 7ff392b69700 1 -- 172.21.15.26:0/2847721421 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff384009a70 con 0x7ff38c138dc0 2023-10-01T08:00:19.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.391+0000 7ff392b69700 1 --2- 172.21.15.26:0/2847721421 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff38c138dc0 0x7ff38c12f640 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ff384009eb0 tx=0x7ff38400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:19.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.391+0000 7ff382ffd700 1 -- 172.21.15.26:0/2847721421 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff384009d50 con 0x7ff38c138dc0 2023-10-01T08:00:19.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.391+0000 7ff382ffd700 1 -- 172.21.15.26:0/2847721421 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38400f040 con 0x7ff38c138dc0 2023-10-01T08:00:19.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.391+0000 7ff3945cc700 1 -- 172.21.15.26:0/2847721421 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff37c0094a0 con 0x7ff38c138dc0 2023-10-01T08:00:19.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.391+0000 7ff382ffd700 1 -- 172.21.15.26:0/2847721421 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38400ceb0 con 0x7ff38c138dc0 2023-10-01T08:00:19.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.392+0000 7ff3945cc700 1 -- 172.21.15.26:0/2847721421 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff38c09c2e0 con 0x7ff38c138dc0 2023-10-01T08:00:19.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.393+0000 7ff3945cc700 1 -- 172.21.15.26:0/2847721421 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff38c074ea0 con 0x7ff38c138dc0 2023-10-01T08:00:19.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.393+0000 7ff382ffd700 1 -- 172.21.15.26:0/2847721421 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff384014480 con 0x7ff38c138dc0 2023-10-01T08:00:19.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.394+0000 7ff382ffd700 1 -- 172.21.15.26:0/2847721421 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff3840408a0 con 0x7ff38c138dc0 2023-10-01T08:00:19.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.399+0000 7ff382ffd700 1 -- 172.21.15.26:0/2847721421 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff384012930 con 0x7ff38c138dc0 2023-10-01T08:00:19.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.413+0000 7f30fcc8b700 1 -- 172.21.15.26:0/4240208043 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f30f8074ea0 con 0x7f30f8133420 2023-10-01T08:00:19.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.413+0000 7f30eeffd700 1 -- 172.21.15.26:0/4240208043 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f30e800cea0 con 0x7f30f8133420 2023-10-01T08:00:19.414 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:19.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.416+0000 7f30fcc8b700 1 -- 172.21.15.26:0/4240208043 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30f8133420 msgr2=0x7f30f809c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:19.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.416+0000 7f30fcc8b700 1 --2- 172.21.15.26:0/4240208043 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30f8133420 0x7f30f809c480 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f30e800ebe0 tx=0x7f30e800eef0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.416+0000 7f30fcc8b700 1 -- 172.21.15.26:0/4240208043 shutdown_connections 2023-10-01T08:00:19.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.416+0000 7f30fcc8b700 1 --2- 172.21.15.26:0/4240208043 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f30f8134260 0x7f30f809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.416+0000 7f30fcc8b700 1 --2- 172.21.15.26:0/4240208043 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30f8133420 0x7f30f809c480 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.416+0000 7f30fcc8b700 1 --2- 172.21.15.26:0/4240208043 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f30f8133e30 0x7f30f809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.416+0000 7f30fcc8b700 1 -- 172.21.15.26:0/4240208043 >> 172.21.15.26:0/4240208043 conn(0x7f30f80a4210 msgr2=0x7f30f80a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:19.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.420+0000 7f30fcc8b700 1 -- 172.21.15.26:0/4240208043 shutdown_connections 2023-10-01T08:00:19.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.420+0000 7f30fcc8b700 1 -- 172.21.15.26:0/4240208043 wait complete. 2023-10-01T08:00:19.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.426+0000 7f3771acc700 1 Processor -- start 2023-10-01T08:00:19.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.426+0000 7f3771acc700 1 -- start start 2023-10-01T08:00:19.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.427+0000 7f3771acc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f376c09e1d0 0x7f376c138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:19.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.427+0000 7f3771acc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f376c139170 0x7f376c13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:19.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.427+0000 7f3771acc700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f376c09b120 con 0x7f376c09d6f0 2023-10-01T08:00:19.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.427+0000 7f3771acc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376c06b460 con 0x7f376c09e1d0 2023-10-01T08:00:19.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.427+0000 7f3771acc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f376c09a7e0 con 0x7f376c139170 2023-10-01T08:00:19.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.427+0000 7f376bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f376c139170 0x7f376c13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:19.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.427+0000 7f376b7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f376c09d6f0 0x7f376c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44698/0 (socket says 172.21.15.26:44698) 2023-10-01T08:00:19.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.427+0000 7f376b7fe700 1 -- 172.21.15.26:0/383729043 learned_addr learned my addr 172.21.15.26:0/383729043 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:19.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.427+0000 7f376bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f376c139170 0x7f376c13b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47274/0 (socket says 172.21.15.26:47274) 2023-10-01T08:00:19.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.427+0000 7f376affd700 1 --2- 172.21.15.26:0/383729043 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f376c09e1d0 0x7f376c138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:19.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.427+0000 7f376affd700 1 -- 172.21.15.26:0/383729043 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f376c139170 msgr2=0x7f376c13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:19.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.427+0000 7f376affd700 1 --2- 172.21.15.26:0/383729043 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f376c139170 0x7f376c13b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.427+0000 7f376affd700 1 -- 172.21.15.26:0/383729043 >> v1:172.21.15.26:6789/0 conn(0x7f376c09d6f0 legacy=0x7f376c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:19.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.427+0000 7f376affd700 1 -- 172.21.15.26:0/383729043 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376c09a500 con 0x7f376c09e1d0 2023-10-01T08:00:19.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.428+0000 7f376affd700 1 --2- 172.21.15.26:0/383729043 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f376c09e1d0 0x7f376c138c30 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f3760009870 tx=0x7f3760009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f67895faf39e9a82 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:19.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.428+0000 7f376a7fc700 1 -- 172.21.15.26:0/383729043 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3760011830 con 0x7f376c09e1d0 2023-10-01T08:00:19.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.428+0000 7f376a7fc700 1 -- 172.21.15.26:0/383729043 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3760011990 con 0x7f376c09e1d0 2023-10-01T08:00:19.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.428+0000 7f376a7fc700 1 -- 172.21.15.26:0/383729043 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3760011d20 con 0x7f376c09e1d0 2023-10-01T08:00:19.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.429+0000 7f3771acc700 1 -- 172.21.15.26:0/383729043 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f376c09e1d0 msgr2=0x7f376c138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:19.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.429+0000 7f3771acc700 1 --2- 172.21.15.26:0/383729043 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f376c09e1d0 0x7f376c138c30 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f3760009870 tx=0x7f3760009b80 comp rx=0 tx=0).stop 2023-10-01T08:00:19.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.429+0000 7f3771acc700 1 -- 172.21.15.26:0/383729043 shutdown_connections 2023-10-01T08:00:19.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.429+0000 7f3771acc700 1 --2- 172.21.15.26:0/383729043 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f376c139170 0x7f376c13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.429+0000 7f3771acc700 1 --2- 172.21.15.26:0/383729043 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f376c09e1d0 0x7f376c138c30 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.429+0000 7f3771acc700 1 -- 172.21.15.26:0/383729043 >> 172.21.15.26:0/383729043 conn(0x7f376c066f50 msgr2=0x7f376c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:19.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.429+0000 7f3771acc700 1 -- 172.21.15.26:0/383729043 shutdown_connections 2023-10-01T08:00:19.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.429+0000 7f3771acc700 1 -- 172.21.15.26:0/383729043 wait complete. 2023-10-01T08:00:19.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.430+0000 7f3771acc700 1 Processor -- start 2023-10-01T08:00:19.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.431+0000 7f3771acc700 1 -- start start 2023-10-01T08:00:19.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.431+0000 7f3771acc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f376c09d6f0 0x7f376c119720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:19.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.431+0000 7f3771acc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f376c09e1d0 0x7f376c119c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:19.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.431+0000 7f3771acc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f376c139170 0x7f376c1cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:19.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.431+0000 7f3771acc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376c11cdd0 con 0x7f376c09e1d0 2023-10-01T08:00:19.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.431+0000 7f3771acc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376c11b0c0 con 0x7f376c139170 2023-10-01T08:00:19.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.431+0000 7f3771acc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f376c11a920 con 0x7f376c09d6f0 2023-10-01T08:00:19.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.431+0000 7f376bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f376c139170 0x7f376c1cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:19.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.432+0000 7f376bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f376c139170 0x7f376c1cc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47188/0 (socket says 172.21.15.26:47188) 2023-10-01T08:00:19.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.432+0000 7f376bfff700 1 -- 172.21.15.26:0/2896391880 learned_addr learned my addr 172.21.15.26:0/2896391880 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:19.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.432+0000 7f376affd700 1 --2- 172.21.15.26:0/2896391880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f376c09e1d0 0x7f376c119c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:19.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.432+0000 7f376b7fe700 1 --2- 172.21.15.26:0/2896391880 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f376c09d6f0 0x7f376c119720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:19.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.432+0000 7f376affd700 1 -- 172.21.15.26:0/2896391880 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f376c09d6f0 msgr2=0x7f376c119720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:19.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.432+0000 7f376affd700 1 --2- 172.21.15.26:0/2896391880 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f376c09d6f0 0x7f376c119720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.432+0000 7f376affd700 1 -- 172.21.15.26:0/2896391880 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f376c139170 msgr2=0x7f376c1cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:19.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.432+0000 7f376affd700 1 --2- 172.21.15.26:0/2896391880 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f376c139170 0x7f376c1cc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.432+0000 7f376affd700 1 -- 172.21.15.26:0/2896391880 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37600094a0 con 0x7f376c09e1d0 2023-10-01T08:00:19.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.432+0000 7f376affd700 1 --2- 172.21.15.26:0/2896391880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f376c09e1d0 0x7f376c119c60 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f3760009870 tx=0x7f3760004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:19.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.432+0000 7f3753fff700 1 -- 172.21.15.26:0/2896391880 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3760004510 con 0x7f376c09e1d0 2023-10-01T08:00:19.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.433+0000 7f3753fff700 1 -- 172.21.15.26:0/2896391880 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376001f070 con 0x7f376c09e1d0 2023-10-01T08:00:19.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.433+0000 7f3753fff700 1 -- 172.21.15.26:0/2896391880 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37600038e0 con 0x7f376c09e1d0 2023-10-01T08:00:19.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.433+0000 7f3771acc700 1 -- 172.21.15.26:0/2896391880 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f376c09c710 con 0x7f376c09e1d0 2023-10-01T08:00:19.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.433+0000 7f3771acc700 1 -- 172.21.15.26:0/2896391880 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f376c11d030 con 0x7f376c09e1d0 2023-10-01T08:00:19.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.434+0000 7f3753fff700 1 -- 172.21.15.26:0/2896391880 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3760003a40 con 0x7f376c09e1d0 2023-10-01T08:00:19.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.435+0000 7f3753fff700 1 -- 172.21.15.26:0/2896391880 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3760021070 con 0x7f376c09e1d0 2023-10-01T08:00:19.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.435+0000 7f3771acc700 1 -- 172.21.15.26:0/2896391880 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f376c074ea0 con 0x7f376c09e1d0 2023-10-01T08:00:19.437 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:19.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.438+0000 7ff0d0643700 1 Processor -- start 2023-10-01T08:00:19.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.438+0000 7ff0d0643700 1 -- start start 2023-10-01T08:00:19.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.439+0000 7ff0d0643700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0c81316c0 0x7ff0c8131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:19.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.439+0000 7ff0d0643700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0c809d9f0 0x7ff0c806a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:19.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.439+0000 7ff0d0643700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff0c806acb0 0x7ff0c806b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:19.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.439+0000 7ff0d0643700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0c809e130 con 0x7ff0c806acb0 2023-10-01T08:00:19.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.439+0000 7ff0d0643700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c81312b0 con 0x7ff0c809d9f0 2023-10-01T08:00:19.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.440+0000 7ff0d0643700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c809f6e0 con 0x7ff0c81316c0 2023-10-01T08:00:19.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.440+0000 7ff0cdbde700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0c809d9f0 0x7ff0c806a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:19.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.440+0000 7ff0cdbde700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0c809d9f0 0x7ff0c806a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47196/0 (socket says 172.21.15.26:47196) 2023-10-01T08:00:19.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.440+0000 7ff0cdbde700 1 -- 172.21.15.26:0/100423871 learned_addr learned my addr 172.21.15.26:0/100423871 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:19.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.440+0000 7ff0ce3df700 1 --2- 172.21.15.26:0/100423871 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0c81316c0 0x7ff0c8131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:19.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.440+0000 7ff0cebe0700 1 --2- 172.21.15.26:0/100423871 >> v2:172.21.15.26:3300/0 conn(0x7ff0c806acb0 0x7ff0c806b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:19.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.440+0000 7ff0cdbde700 1 -- 172.21.15.26:0/100423871 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0c81316c0 msgr2=0x7ff0c8131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:19.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.440+0000 7ff0cdbde700 1 --2- 172.21.15.26:0/100423871 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0c81316c0 0x7ff0c8131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.440+0000 7ff0cdbde700 1 -- 172.21.15.26:0/100423871 >> v2:172.21.15.26:3300/0 conn(0x7ff0c806acb0 msgr2=0x7ff0c806b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:19.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.440+0000 7ff0cdbde700 1 --2- 172.21.15.26:0/100423871 >> v2:172.21.15.26:3300/0 conn(0x7ff0c806acb0 0x7ff0c806b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.440+0000 7ff0cdbde700 1 -- 172.21.15.26:0/100423871 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c809e760 con 0x7ff0c809d9f0 2023-10-01T08:00:19.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.440+0000 7ff0cdbde700 1 --2- 172.21.15.26:0/100423871 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0c809d9f0 0x7ff0c806a770 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff0b80098f0 tx=0x7ff0b8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3bad970314a83a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:19.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.440+0000 7ff0cd3dd700 1 -- 172.21.15.26:0/100423871 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8011830 con 0x7ff0c809d9f0 2023-10-01T08:00:19.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.441+0000 7ff0cd3dd700 1 -- 172.21.15.26:0/100423871 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b8011990 con 0x7ff0c809d9f0 2023-10-01T08:00:19.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.441+0000 7ff0cd3dd700 1 -- 172.21.15.26:0/100423871 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8011d20 con 0x7ff0c809d9f0 2023-10-01T08:00:19.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.441+0000 7f3753fff700 1 -- 172.21.15.26:0/2896391880 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3760015020 con 0x7f376c09e1d0 2023-10-01T08:00:19.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.441+0000 7ff0d0643700 1 -- 172.21.15.26:0/100423871 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0c809d9f0 msgr2=0x7ff0c806a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:19.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.441+0000 7ff0d0643700 1 --2- 172.21.15.26:0/100423871 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0c809d9f0 0x7ff0c806a770 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff0b80098f0 tx=0x7ff0b8009c00 comp rx=0 tx=0).stop 2023-10-01T08:00:19.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.441+0000 7ff0d0643700 1 -- 172.21.15.26:0/100423871 shutdown_connections 2023-10-01T08:00:19.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.441+0000 7ff0d0643700 1 --2- 172.21.15.26:0/100423871 >> v2:172.21.15.26:3300/0 conn(0x7ff0c806acb0 0x7ff0c806b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.441+0000 7ff0d0643700 1 --2- 172.21.15.26:0/100423871 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0c81316c0 0x7ff0c8131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.441+0000 7ff0d0643700 1 --2- 172.21.15.26:0/100423871 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0c809d9f0 0x7ff0c806a770 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.441+0000 7ff0d0643700 1 -- 172.21.15.26:0/100423871 >> 172.21.15.26:0/100423871 conn(0x7ff0c8066f50 msgr2=0x7ff0c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:19.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.442+0000 7ff0d0643700 1 -- 172.21.15.26:0/100423871 shutdown_connections 2023-10-01T08:00:19.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.442+0000 7ff0d0643700 1 -- 172.21.15.26:0/100423871 wait complete. 2023-10-01T08:00:19.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.443+0000 7ff0d0643700 1 Processor -- start 2023-10-01T08:00:19.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.443+0000 7ff0d0643700 1 -- start start 2023-10-01T08:00:19.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.443+0000 7ff0d0643700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0c806acb0 0x7ff0c8070a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:19.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.443+0000 7ff0d0643700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0c809d9f0 0x7ff0c8070f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:19.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.443+0000 7ff0d0643700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0c81316c0 0x7ff0c80714d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:19.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.443+0000 7ff0d0643700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c811bae0 con 0x7ff0c809d9f0 2023-10-01T08:00:19.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.443+0000 7ff0d0643700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c811acb0 con 0x7ff0c81316c0 2023-10-01T08:00:19.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.443+0000 7ff0d0643700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c812b900 con 0x7ff0c806acb0 2023-10-01T08:00:19.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.443+0000 7ff0ce3df700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0c806acb0 0x7ff0c8070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:19.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.443+0000 7ff0ce3df700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0c806acb0 0x7ff0c8070a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47292/0 (socket says 172.21.15.26:47292) 2023-10-01T08:00:19.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.443+0000 7ff0ce3df700 1 -- 172.21.15.26:0/1133873349 learned_addr learned my addr 172.21.15.26:0/1133873349 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:19.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.443+0000 7ff0cebe0700 1 --2- 172.21.15.26:0/1133873349 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0c81316c0 0x7ff0c80714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:19.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.443+0000 7ff0cdbde700 1 --2- 172.21.15.26:0/1133873349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0c809d9f0 0x7ff0c8070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:19.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.444+0000 7ff0ce3df700 1 -- 172.21.15.26:0/1133873349 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0c81316c0 msgr2=0x7ff0c80714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:19.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.444+0000 7ff0ce3df700 1 --2- 172.21.15.26:0/1133873349 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0c81316c0 0x7ff0c80714d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.444+0000 7ff0ce3df700 1 -- 172.21.15.26:0/1133873349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0c809d9f0 msgr2=0x7ff0c8070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:19.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.444+0000 7ff0ce3df700 1 --2- 172.21.15.26:0/1133873349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0c809d9f0 0x7ff0c8070f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.444+0000 7ff0ce3df700 1 -- 172.21.15.26:0/1133873349 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b8009550 con 0x7ff0c806acb0 2023-10-01T08:00:19.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.444+0000 7ff0cdbde700 1 --2- 172.21.15.26:0/1133873349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0c809d9f0 0x7ff0c8070f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:19.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.444+0000 7ff0ce3df700 1 --2- 172.21.15.26:0/1133873349 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0c806acb0 0x7ff0c8070a50 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ff0c400e9b0 tx=0x7ff0c400ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:19.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.444+0000 7ff0beffd700 1 -- 172.21.15.26:0/1133873349 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c4009710 con 0x7ff0c806acb0 2023-10-01T08:00:19.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.444+0000 7ff0beffd700 1 -- 172.21.15.26:0/1133873349 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c400ee50 con 0x7ff0c806acb0 2023-10-01T08:00:19.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.444+0000 7ff0beffd700 1 -- 172.21.15.26:0/1133873349 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c400ca50 con 0x7ff0c806acb0 2023-10-01T08:00:19.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.444+0000 7ff0d0643700 1 -- 172.21.15.26:0/1133873349 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0c811af00 con 0x7ff0c806acb0 2023-10-01T08:00:19.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.444+0000 7ff0d0643700 1 -- 172.21.15.26:0/1133873349 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0c8119530 con 0x7ff0c806acb0 2023-10-01T08:00:19.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.445+0000 7ff0beffd700 1 -- 172.21.15.26:0/1133873349 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff0c400cbb0 con 0x7ff0c806acb0 2023-10-01T08:00:19.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.445+0000 7ff0beffd700 1 -- 172.21.15.26:0/1133873349 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff0c403f9e0 con 0x7ff0c806acb0 2023-10-01T08:00:19.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.446+0000 7ff0d0643700 1 -- 172.21.15.26:0/1133873349 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0c8074ea0 con 0x7ff0c806acb0 2023-10-01T08:00:19.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.450+0000 7ff0beffd700 1 -- 172.21.15.26:0/1133873349 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff0c4017080 con 0x7ff0c806acb0 2023-10-01T08:00:19.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.632+0000 7ff3945cc700 1 -- 172.21.15.26:0/2847721421 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff38c09cbf0 con 0x7ff38c138dc0 2023-10-01T08:00:19.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.632+0000 7ff382ffd700 1 -- 172.21.15.26:0/2847721421 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff38402a070 con 0x7ff38c138dc0 2023-10-01T08:00:19.633 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:19.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.635+0000 7ff3945cc700 1 -- 172.21.15.26:0/2847721421 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff38c138dc0 msgr2=0x7ff38c12f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:19.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.636+0000 7ff3945cc700 1 --2- 172.21.15.26:0/2847721421 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff38c138dc0 0x7ff38c12f640 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ff384009eb0 tx=0x7ff38400c3a0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.636+0000 7ff3945cc700 1 -- 172.21.15.26:0/2847721421 shutdown_connections 2023-10-01T08:00:19.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.636+0000 7ff3945cc700 1 --2- 172.21.15.26:0/2847721421 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff38c138dc0 0x7ff38c12f640 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.636+0000 7ff3945cc700 1 --2- 172.21.15.26:0/2847721421 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff38c133420 0x7ff38c12ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.636+0000 7ff3945cc700 1 --2- 172.21.15.26:0/2847721421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff38c1337f0 0x7ff38c12f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.636+0000 7ff3945cc700 1 -- 172.21.15.26:0/2847721421 >> 172.21.15.26:0/2847721421 conn(0x7ff38c0a4210 msgr2=0x7ff38c0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:19.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.636+0000 7ff3945cc700 1 -- 172.21.15.26:0/2847721421 shutdown_connections 2023-10-01T08:00:19.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.636+0000 7ff3945cc700 1 -- 172.21.15.26:0/2847721421 wait complete. 2023-10-01T08:00:19.655 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:19.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.664+0000 7f3771acc700 1 -- 172.21.15.26:0/2896391880 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f376c06c360 con 0x7f376c09e1d0 2023-10-01T08:00:19.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.665+0000 7f3753fff700 1 -- 172.21.15.26:0/2896391880 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f376001a430 con 0x7f376c09e1d0 2023-10-01T08:00:19.665 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:19.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.667+0000 7f3771acc700 1 -- 172.21.15.26:0/2896391880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f376c09e1d0 msgr2=0x7f376c119c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:19.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.667+0000 7f3771acc700 1 --2- 172.21.15.26:0/2896391880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f376c09e1d0 0x7f376c119c60 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f3760009870 tx=0x7f3760004750 comp rx=0 tx=0).stop 2023-10-01T08:00:19.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.667+0000 7f3771acc700 1 -- 172.21.15.26:0/2896391880 shutdown_connections 2023-10-01T08:00:19.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.667+0000 7f3771acc700 1 --2- 172.21.15.26:0/2896391880 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f376c139170 0x7f376c1cc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.667+0000 7f3771acc700 1 --2- 172.21.15.26:0/2896391880 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f376c09d6f0 0x7f376c119720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.667+0000 7f3771acc700 1 --2- 172.21.15.26:0/2896391880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f376c09e1d0 0x7f376c119c60 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.667+0000 7f3771acc700 1 -- 172.21.15.26:0/2896391880 >> 172.21.15.26:0/2896391880 conn(0x7f376c066f50 msgr2=0x7f376c09b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:19.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.667+0000 7f3771acc700 1 -- 172.21.15.26:0/2896391880 shutdown_connections 2023-10-01T08:00:19.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.667+0000 7f3771acc700 1 -- 172.21.15.26:0/2896391880 wait complete. 2023-10-01T08:00:19.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.667+0000 7ff0d0643700 1 -- 172.21.15.26:0/1133873349 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff0c809e980 con 0x7ff0c806acb0 2023-10-01T08:00:19.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.668+0000 7ff0beffd700 1 -- 172.21.15.26:0/1133873349 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff0c4021020 con 0x7ff0c806acb0 2023-10-01T08:00:19.669 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:19.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.670+0000 7ff0d0643700 1 -- 172.21.15.26:0/1133873349 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0c806acb0 msgr2=0x7ff0c8070a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:19.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.670+0000 7ff0d0643700 1 --2- 172.21.15.26:0/1133873349 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0c806acb0 0x7ff0c8070a50 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ff0c400e9b0 tx=0x7ff0c400ecc0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.670+0000 7ff0d0643700 1 -- 172.21.15.26:0/1133873349 shutdown_connections 2023-10-01T08:00:19.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.670+0000 7ff0d0643700 1 --2- 172.21.15.26:0/1133873349 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0c81316c0 0x7ff0c80714d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.670+0000 7ff0d0643700 1 --2- 172.21.15.26:0/1133873349 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0c806acb0 0x7ff0c8070a50 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.670+0000 7ff0d0643700 1 --2- 172.21.15.26:0/1133873349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0c809d9f0 0x7ff0c8070f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:19.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.670+0000 7ff0d0643700 1 -- 172.21.15.26:0/1133873349 >> 172.21.15.26:0/1133873349 conn(0x7ff0c8066f50 msgr2=0x7ff0c80a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:19.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.670+0000 7ff0d0643700 1 -- 172.21.15.26:0/1133873349 shutdown_connections 2023-10-01T08:00:19.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:19.670+0000 7ff0d0643700 1 -- 172.21.15.26:0/1133873349 wait complete. 2023-10-01T08:00:19.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:19.685 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:20.438 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:20.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.583+0000 7fae6ac7b700 1 Processor -- start 2023-10-01T08:00:20.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.583+0000 7fae6ac7b700 1 -- start start 2023-10-01T08:00:20.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.583+0000 7fae6ac7b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae6409d6f0 0x7fae6409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:20.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.583+0000 7fae6ac7b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae6409e410 0x7fae64134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:20.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.583+0000 7fae6ac7b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae6409b120 con 0x7fae6409e000 2023-10-01T08:00:20.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.583+0000 7fae6ac7b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6406b460 con 0x7fae6409d6f0 2023-10-01T08:00:20.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.583+0000 7fae6ac7b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae6409a7e0 con 0x7fae6409e410 2023-10-01T08:00:20.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.584+0000 7fae68a17700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae6409d6f0 0x7fae6409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:20.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.584+0000 7fae63fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fae6409e000 0x7fae641339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44700/0 (socket says 172.21.15.26:44700) 2023-10-01T08:00:20.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.584+0000 7fae63fff700 1 -- 172.21.15.26:0/1674396126 learned_addr learned my addr 172.21.15.26:0/1674396126 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:20.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.584+0000 7fae69218700 1 --2- 172.21.15.26:0/1674396126 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae6409e410 0x7fae64134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:20.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.584+0000 7fae69218700 1 -- 172.21.15.26:0/1674396126 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae6409d6f0 msgr2=0x7fae6409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:20.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.584+0000 7fae69218700 1 --2- 172.21.15.26:0/1674396126 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae6409d6f0 0x7fae6409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:20.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.584+0000 7fae69218700 1 -- 172.21.15.26:0/1674396126 >> v1:172.21.15.26:6789/0 conn(0x7fae6409e000 legacy=0x7fae641339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:20.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.584+0000 7fae637fe700 1 -- 172.21.15.26:0/1674396126 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2541144311 0 0) 0x7fae6409b120 con 0x7fae6409e000 2023-10-01T08:00:20.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.584+0000 7fae69218700 1 -- 172.21.15.26:0/1674396126 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6409a500 con 0x7fae6409e410 2023-10-01T08:00:20.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.584+0000 7fae68a17700 1 --2- 172.21.15.26:0/1674396126 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae6409d6f0 0x7fae6409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:20.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.584+0000 7fae69218700 1 --2- 172.21.15.26:0/1674396126 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae6409e410 0x7fae64134100 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fae5c009df0 tx=0x7fae5c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=465cb0f7c55b1cd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:20.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.584+0000 7fae637fe700 1 -- 172.21.15.26:0/1674396126 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c00e070 con 0x7fae6409e410 2023-10-01T08:00:20.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.584+0000 7fae637fe700 1 -- 172.21.15.26:0/1674396126 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5c00bae0 con 0x7fae6409e410 2023-10-01T08:00:20.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.584+0000 7fae637fe700 1 -- 172.21.15.26:0/1674396126 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c00be90 con 0x7fae6409e410 2023-10-01T08:00:20.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.585+0000 7fae6ac7b700 1 -- 172.21.15.26:0/1674396126 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae6409e410 msgr2=0x7fae64134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:20.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.585+0000 7fae6ac7b700 1 --2- 172.21.15.26:0/1674396126 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae6409e410 0x7fae64134100 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fae5c009df0 tx=0x7fae5c00b330 comp rx=0 tx=0).stop 2023-10-01T08:00:20.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.585+0000 7fae6ac7b700 1 -- 172.21.15.26:0/1674396126 shutdown_connections 2023-10-01T08:00:20.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.585+0000 7fae6ac7b700 1 --2- 172.21.15.26:0/1674396126 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae6409e410 0x7fae64134100 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:20.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.585+0000 7fae6ac7b700 1 --2- 172.21.15.26:0/1674396126 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae6409d6f0 0x7fae6409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:20.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.585+0000 7fae6ac7b700 1 -- 172.21.15.26:0/1674396126 >> 172.21.15.26:0/1674396126 conn(0x7fae64066f50 msgr2=0x7fae6409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:20.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.585+0000 7fae6ac7b700 1 -- 172.21.15.26:0/1674396126 shutdown_connections 2023-10-01T08:00:20.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.585+0000 7fae6ac7b700 1 -- 172.21.15.26:0/1674396126 wait complete. 2023-10-01T08:00:20.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.586+0000 7fae6ac7b700 1 Processor -- start 2023-10-01T08:00:20.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.586+0000 7fae6ac7b700 1 -- start start 2023-10-01T08:00:20.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.587+0000 7fae6ac7b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae6409d6f0 0x7fae64122320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:20.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.587+0000 7fae6ac7b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae6409e000 0x7fae64122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:20.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.587+0000 7fae6ac7b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae6409e410 0x7fae64122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:20.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.587+0000 7fae6ac7b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae641237f0 con 0x7fae6409e410 2023-10-01T08:00:20.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.587+0000 7fae6ac7b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae64124e00 con 0x7fae6409e000 2023-10-01T08:00:20.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.587+0000 7fae6ac7b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae64125e40 con 0x7fae6409d6f0 2023-10-01T08:00:20.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.587+0000 7fae68a17700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae6409d6f0 0x7fae64122320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:20.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.587+0000 7fae68a17700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae6409d6f0 0x7fae64122320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47308/0 (socket says 172.21.15.26:47308) 2023-10-01T08:00:20.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.587+0000 7fae68a17700 1 -- 172.21.15.26:0/1481486572 learned_addr learned my addr 172.21.15.26:0/1481486572 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:20.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.587+0000 7fae69218700 1 --2- 172.21.15.26:0/1481486572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae6409e410 0x7fae64122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:20.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.587+0000 7fae63fff700 1 --2- 172.21.15.26:0/1481486572 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae6409e000 0x7fae64122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:20.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.587+0000 7fae68a17700 1 -- 172.21.15.26:0/1481486572 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae6409e000 msgr2=0x7fae64122860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:20.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.587+0000 7fae68a17700 1 --2- 172.21.15.26:0/1481486572 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae6409e000 0x7fae64122860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:20.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.587+0000 7fae68a17700 1 -- 172.21.15.26:0/1481486572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae6409e410 msgr2=0x7fae64122da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:20.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.587+0000 7fae68a17700 1 --2- 172.21.15.26:0/1481486572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae6409e410 0x7fae64122da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:20.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.587+0000 7fae68a17700 1 -- 172.21.15.26:0/1481486572 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae580094a0 con 0x7fae6409d6f0 2023-10-01T08:00:20.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.587+0000 7fae68a17700 1 --2- 172.21.15.26:0/1481486572 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae6409d6f0 0x7fae64122320 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fae5800ebe0 tx=0x7fae5800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:20.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.588+0000 7fae617fa700 1 -- 172.21.15.26:0/1481486572 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5800c850 con 0x7fae6409d6f0 2023-10-01T08:00:20.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.588+0000 7fae617fa700 1 -- 172.21.15.26:0/1481486572 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5800c9b0 con 0x7fae6409d6f0 2023-10-01T08:00:20.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.588+0000 7fae6ac7b700 1 -- 172.21.15.26:0/1481486572 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae5c009a70 con 0x7fae6409d6f0 2023-10-01T08:00:20.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.588+0000 7fae617fa700 1 -- 172.21.15.26:0/1481486572 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5800cd40 con 0x7fae6409d6f0 2023-10-01T08:00:20.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.588+0000 7fae6ac7b700 1 -- 172.21.15.26:0/1481486572 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae640a2020 con 0x7fae6409d6f0 2023-10-01T08:00:20.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.589+0000 7fae617fa700 1 -- 172.21.15.26:0/1481486572 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fae58013470 con 0x7fae6409d6f0 2023-10-01T08:00:20.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.589+0000 7fae617fa700 1 -- 172.21.15.26:0/1481486572 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fae5803f7f0 con 0x7fae6409d6f0 2023-10-01T08:00:20.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.589+0000 7fae6ac7b700 1 -- 172.21.15.26:0/1481486572 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae6411f030 con 0x7fae6409d6f0 2023-10-01T08:00:20.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.594+0000 7fae617fa700 1 -- 172.21.15.26:0/1481486572 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fae58013720 con 0x7fae6409d6f0 2023-10-01T08:00:20.656 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:20.684 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:20.686 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:20.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.798+0000 7fd9b7c51700 1 Processor -- start 2023-10-01T08:00:20.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.799+0000 7fd9b7c51700 1 -- start start 2023-10-01T08:00:20.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.799+0000 7fd9b7c51700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9b006f5d0 0x7fd9b012ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:20.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.799+0000 7fd9b7c51700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9b0135c20 0x7fd9b0138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:20.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.799+0000 7fd9b7c51700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b006fa40 con 0x7fd9b012cf60 2023-10-01T08:00:20.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.799+0000 7fd9b7c51700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b012cd90 con 0x7fd9b0135c20 2023-10-01T08:00:20.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.799+0000 7fd9b7c51700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b0071780 con 0x7fd9b006f5d0 2023-10-01T08:00:20.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.800+0000 7fd9b51ec700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9b006f5d0 0x7fd9b012ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:20.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.800+0000 7fd9b51ec700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9b006f5d0 0x7fd9b012ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47318/0 (socket says 172.21.15.26:47318) 2023-10-01T08:00:20.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.800+0000 7fd9b59ed700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd9b012cf60 0x7fd9b012f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44708/0 (socket says 172.21.15.26:44708) 2023-10-01T08:00:20.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.800+0000 7fd9b51ec700 1 -- 172.21.15.26:0/3991498414 learned_addr learned my addr 172.21.15.26:0/3991498414 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:20.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.800+0000 7fd9b61ee700 1 --2- 172.21.15.26:0/3991498414 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9b0135c20 0x7fd9b0138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:20.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.800+0000 7fd9b51ec700 1 -- 172.21.15.26:0/3991498414 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9b0135c20 msgr2=0x7fd9b0138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:20.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.800+0000 7fd9b51ec700 1 --2- 172.21.15.26:0/3991498414 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9b0135c20 0x7fd9b0138000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:20.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.800+0000 7fd9b51ec700 1 -- 172.21.15.26:0/3991498414 >> v1:172.21.15.26:6789/0 conn(0x7fd9b012cf60 legacy=0x7fd9b012f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:20.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.800+0000 7fd9b51ec700 1 -- 172.21.15.26:0/3991498414 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b0071a40 con 0x7fd9b006f5d0 2023-10-01T08:00:20.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.800+0000 7fd9b49eb700 1 -- 172.21.15.26:0/3991498414 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 692162242 0 0) 0x7fd9b006fa40 con 0x7fd9b012cf60 2023-10-01T08:00:20.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.800+0000 7fd9b61ee700 1 --2- 172.21.15.26:0/3991498414 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9b0135c20 0x7fd9b0138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T08:00:20.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.800+0000 7fd9b51ec700 1 --2- 172.21.15.26:0/3991498414 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9b006f5d0 0x7fd9b012ffc0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0009950 tx=0x7fd9a0009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6f258dfc58bce22 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:20.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.800+0000 7fd9b49eb700 1 -- 172.21.15.26:0/3991498414 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a000ba20 con 0x7fd9b006f5d0 2023-10-01T08:00:20.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.801+0000 7fd9b49eb700 1 -- 172.21.15.26:0/3991498414 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a000bb80 con 0x7fd9b006f5d0 2023-10-01T08:00:20.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.801+0000 7fd9b49eb700 1 -- 172.21.15.26:0/3991498414 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a0009e40 con 0x7fd9b006f5d0 2023-10-01T08:00:20.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.801+0000 7fd9b7c51700 1 -- 172.21.15.26:0/3991498414 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9b006f5d0 msgr2=0x7fd9b012ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:20.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.801+0000 7fd9b7c51700 1 --2- 172.21.15.26:0/3991498414 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9b006f5d0 0x7fd9b012ffc0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0009950 tx=0x7fd9a0009c60 comp rx=0 tx=0).stop 2023-10-01T08:00:20.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.801+0000 7fd9b7c51700 1 -- 172.21.15.26:0/3991498414 shutdown_connections 2023-10-01T08:00:20.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.801+0000 7fd9b7c51700 1 --2- 172.21.15.26:0/3991498414 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9b0135c20 0x7fd9b0138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:20.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.801+0000 7fd9b7c51700 1 --2- 172.21.15.26:0/3991498414 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9b006f5d0 0x7fd9b012ffc0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:20.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.801+0000 7fd9b7c51700 1 -- 172.21.15.26:0/3991498414 >> 172.21.15.26:0/3991498414 conn(0x7fd9b00a2aa0 msgr2=0x7fd9b00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:20.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.802+0000 7fd9b7c51700 1 -- 172.21.15.26:0/3991498414 shutdown_connections 2023-10-01T08:00:20.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.802+0000 7fd9b7c51700 1 -- 172.21.15.26:0/3991498414 wait complete. 2023-10-01T08:00:20.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.803+0000 7fd9b7c51700 1 Processor -- start 2023-10-01T08:00:20.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.803+0000 7fd9b7c51700 1 -- start start 2023-10-01T08:00:20.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.803+0000 7fd9b7c51700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9b006f5d0 0x7fd9b0132e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:20.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.803+0000 7fd9b7c51700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9b012cf60 0x7fd9b01333d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:20.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.803+0000 7fd9b7c51700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9b0135c20 0x7fd9b0133910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:20.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.803+0000 7fd9b7c51700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b0127c30 con 0x7fd9b0135c20 2023-10-01T08:00:20.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.803+0000 7fd9b7c51700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b0135730 con 0x7fd9b012cf60 2023-10-01T08:00:20.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.803+0000 7fd9b7c51700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b0118f20 con 0x7fd9b006f5d0 2023-10-01T08:00:20.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.803+0000 7fd9b51ec700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9b012cf60 0x7fd9b01333d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:20.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.803+0000 7fd9b51ec700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9b012cf60 0x7fd9b01333d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47242/0 (socket says 172.21.15.26:47242) 2023-10-01T08:00:20.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.803+0000 7fd9b51ec700 1 -- 172.21.15.26:0/3798099842 learned_addr learned my addr 172.21.15.26:0/3798099842 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:20.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.804+0000 7fd9b59ed700 1 --2- 172.21.15.26:0/3798099842 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9b006f5d0 0x7fd9b0132e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:20.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.804+0000 7fd9b61ee700 1 --2- 172.21.15.26:0/3798099842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9b0135c20 0x7fd9b0133910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:20.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.804+0000 7fd9b59ed700 1 -- 172.21.15.26:0/3798099842 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9b012cf60 msgr2=0x7fd9b01333d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:20.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.804+0000 7fd9b59ed700 1 --2- 172.21.15.26:0/3798099842 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9b012cf60 0x7fd9b01333d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:20.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.804+0000 7fd9b59ed700 1 -- 172.21.15.26:0/3798099842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9b0135c20 msgr2=0x7fd9b0133910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:20.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.804+0000 7fd9b59ed700 1 --2- 172.21.15.26:0/3798099842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9b0135c20 0x7fd9b0133910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:20.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.804+0000 7fd9b59ed700 1 -- 172.21.15.26:0/3798099842 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a0009550 con 0x7fd9b006f5d0 2023-10-01T08:00:20.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.804+0000 7fd9b59ed700 1 --2- 172.21.15.26:0/3798099842 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9b006f5d0 0x7fd9b0132e90 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac00c470 tx=0x7fd9ac00c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:20.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.804+0000 7fd9a67fc700 1 -- 172.21.15.26:0/3798099842 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac004c80 con 0x7fd9b006f5d0 2023-10-01T08:00:20.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.805+0000 7fd9a67fc700 1 -- 172.21.15.26:0/3798099842 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9ac004de0 con 0x7fd9b006f5d0 2023-10-01T08:00:20.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.805+0000 7fd9a67fc700 1 -- 172.21.15.26:0/3798099842 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac007310 con 0x7fd9b006f5d0 2023-10-01T08:00:20.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.805+0000 7fd9b7c51700 1 -- 172.21.15.26:0/3798099842 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b00a15d0 con 0x7fd9b006f5d0 2023-10-01T08:00:20.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.805+0000 7fd9b7c51700 1 -- 172.21.15.26:0/3798099842 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b01353d0 con 0x7fd9b006f5d0 2023-10-01T08:00:20.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.806+0000 7fd9a67fc700 1 -- 172.21.15.26:0/3798099842 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd9ac007470 con 0x7fd9b006f5d0 2023-10-01T08:00:20.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.806+0000 7fd9a67fc700 1 -- 172.21.15.26:0/3798099842 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd9ac013c10 con 0x7fd9b006f5d0 2023-10-01T08:00:20.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.806+0000 7fd9b7c51700 1 -- 172.21.15.26:0/3798099842 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b0074ea0 con 0x7fd9b006f5d0 2023-10-01T08:00:20.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.811+0000 7fae6ac7b700 1 -- 172.21.15.26:0/1481486572 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fae64074ea0 con 0x7fae6409d6f0 2023-10-01T08:00:20.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.811+0000 7fae617fa700 1 -- 172.21.15.26:0/1481486572 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fae5802a090 con 0x7fae6409d6f0 2023-10-01T08:00:20.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.811+0000 7fd9a67fc700 1 -- 172.21.15.26:0/3798099842 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd9ac044060 con 0x7fd9b006f5d0 2023-10-01T08:00:20.812 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:20.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.814+0000 7fae6ac7b700 1 -- 172.21.15.26:0/1481486572 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae6409d6f0 msgr2=0x7fae64122320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:20.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.814+0000 7fae6ac7b700 1 --2- 172.21.15.26:0/1481486572 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae6409d6f0 0x7fae64122320 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fae5800ebe0 tx=0x7fae5800eef0 comp rx=0 tx=0).stop 2023-10-01T08:00:20.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.814+0000 7fae6ac7b700 1 -- 172.21.15.26:0/1481486572 shutdown_connections 2023-10-01T08:00:20.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.814+0000 7fae6ac7b700 1 --2- 172.21.15.26:0/1481486572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae6409e410 0x7fae64122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:20.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.814+0000 7fae6ac7b700 1 --2- 172.21.15.26:0/1481486572 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fae6409d6f0 0x7fae64122320 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:20.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.814+0000 7fae6ac7b700 1 --2- 172.21.15.26:0/1481486572 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fae6409e000 0x7fae64122860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:20.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.814+0000 7fae6ac7b700 1 -- 172.21.15.26:0/1481486572 >> 172.21.15.26:0/1481486572 conn(0x7fae64066f50 msgr2=0x7fae64133de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:20.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.814+0000 7fae6ac7b700 1 -- 172.21.15.26:0/1481486572 shutdown_connections 2023-10-01T08:00:20.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.814+0000 7fae6ac7b700 1 -- 172.21.15.26:0/1481486572 wait complete. 2023-10-01T08:00:20.829 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:20.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.845+0000 7f8e8bbd9700 1 Processor -- start 2023-10-01T08:00:20.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.845+0000 7f8e8bbd9700 1 -- start start 2023-10-01T08:00:20.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.846+0000 7f8e8bbd9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e840a0a30 0x7f8e840a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:20.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.846+0000 7f8e8bbd9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8e840a1340 0x7f8e84133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:20.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.846+0000 7f8e8bbd9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e84133fa0 0x7f8e84134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:20.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.846+0000 7f8e8bbd9700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e8409edd0 con 0x7f8e840a1340 2023-10-01T08:00:20.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.846+0000 7f8e8bbd9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8409e1f0 con 0x7f8e84133fa0 2023-10-01T08:00:20.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.846+0000 7f8e8bbd9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8409dc50 con 0x7f8e840a0a30 2023-10-01T08:00:20.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.846+0000 7f8e89174700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8e840a1340 0x7f8e84133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:20.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.846+0000 7f8e89174700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8e840a1340 0x7f8e84133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49062/0 (socket says 172.21.15.26:49062) 2023-10-01T08:00:20.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.846+0000 7f8e8a176700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e84133fa0 0x7f8e84134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:20.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.846+0000 7f8e89174700 1 -- 172.21.15.26:0/3268016546 learned_addr learned my addr 172.21.15.26:0/3268016546 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:20.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.846+0000 7f8e89975700 1 --2- 172.21.15.26:0/3268016546 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e840a0a30 0x7f8e840a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:20.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.846+0000 7f8e89975700 1 -- 172.21.15.26:0/3268016546 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e84133fa0 msgr2=0x7f8e84134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:20.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.846+0000 7f8e89975700 1 --2- 172.21.15.26:0/3268016546 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e84133fa0 0x7f8e84134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:20.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.846+0000 7f8e89975700 1 -- 172.21.15.26:0/3268016546 >> v2:172.21.15.26:3300/0 conn(0x7f8e840a1340 msgr2=0x7f8e84133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:20.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.846+0000 7f8e89975700 1 --2- 172.21.15.26:0/3268016546 >> v2:172.21.15.26:3300/0 conn(0x7f8e840a1340 0x7f8e84133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:20.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.846+0000 7f8e89975700 1 -- 172.21.15.26:0/3268016546 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e840a1fe0 con 0x7f8e840a0a30 2023-10-01T08:00:20.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.846+0000 7f8e89174700 1 --2- 172.21.15.26:0/3268016546 >> v2:172.21.15.26:3300/0 conn(0x7f8e840a1340 0x7f8e84133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:20.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.846+0000 7f8e8a176700 1 --2- 172.21.15.26:0/3268016546 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e84133fa0 0x7f8e84134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:20.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.847+0000 7f8e89975700 1 --2- 172.21.15.26:0/3268016546 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e840a0a30 0x7f8e840a0e00 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f8e74009dc0 tx=0x7f8e7400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f30971fe1613b8da server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:20.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.847+0000 7f8e88973700 1 -- 172.21.15.26:0/3268016546 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7400e070 con 0x7f8e840a0a30 2023-10-01T08:00:20.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.847+0000 7f8e88973700 1 -- 172.21.15.26:0/3268016546 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7400bae0 con 0x7f8e840a0a30 2023-10-01T08:00:20.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.847+0000 7f8e88973700 1 -- 172.21.15.26:0/3268016546 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7400be90 con 0x7f8e840a0a30 2023-10-01T08:00:20.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.848+0000 7f8e8bbd9700 1 -- 172.21.15.26:0/3268016546 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e840a0a30 msgr2=0x7f8e840a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:20.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.848+0000 7f8e8bbd9700 1 --2- 172.21.15.26:0/3268016546 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e840a0a30 0x7f8e840a0e00 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f8e74009dc0 tx=0x7f8e7400b330 comp rx=0 tx=0).stop 2023-10-01T08:00:20.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.848+0000 7f8e8bbd9700 1 -- 172.21.15.26:0/3268016546 shutdown_connections 2023-10-01T08:00:20.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.848+0000 7f8e8bbd9700 1 --2- 172.21.15.26:0/3268016546 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e84133fa0 0x7f8e84134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:20.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.848+0000 7f8e8bbd9700 1 --2- 172.21.15.26:0/3268016546 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e840a0a30 0x7f8e840a0e00 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:20.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.848+0000 7f8e8bbd9700 1 --2- 172.21.15.26:0/3268016546 >> v2:172.21.15.26:3300/0 conn(0x7f8e840a1340 0x7f8e84133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:20.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.848+0000 7f8e8bbd9700 1 -- 172.21.15.26:0/3268016546 >> 172.21.15.26:0/3268016546 conn(0x7f8e840a6550 msgr2=0x7f8e840a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:20.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.848+0000 7f8e8bbd9700 1 -- 172.21.15.26:0/3268016546 shutdown_connections 2023-10-01T08:00:20.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.848+0000 7f8e8bbd9700 1 -- 172.21.15.26:0/3268016546 wait complete. 2023-10-01T08:00:20.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.849+0000 7f8e8bbd9700 1 Processor -- start 2023-10-01T08:00:20.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.849+0000 7f8e8bbd9700 1 -- start start 2023-10-01T08:00:20.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.849+0000 7f8e8bbd9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e840a0a30 0x7f8e8406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:20.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.849+0000 7f8e8bbd9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e840a1340 0x7f8e8406e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:20.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.849+0000 7f8e8bbd9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e84133fa0 0x7f8e8406e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:20.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.849+0000 7f8e8bbd9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e84070b60 con 0x7f8e840a0a30 2023-10-01T08:00:20.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.849+0000 7f8e8bbd9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e840a3610 con 0x7f8e84133fa0 2023-10-01T08:00:20.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.849+0000 7f8e8bbd9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e840a0220 con 0x7f8e840a1340 2023-10-01T08:00:20.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.849+0000 7f8e89975700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e840a0a30 0x7f8e8406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:20.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.849+0000 7f8e89975700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e840a0a30 0x7f8e8406dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49068/0 (socket says 172.21.15.26:49068) 2023-10-01T08:00:20.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.849+0000 7f8e89975700 1 -- 172.21.15.26:0/1862665219 learned_addr learned my addr 172.21.15.26:0/1862665219 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:20.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.850+0000 7f8e8a176700 1 --2- 172.21.15.26:0/1862665219 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e84133fa0 0x7f8e8406e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:20.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.850+0000 7f8e89174700 1 --2- 172.21.15.26:0/1862665219 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e840a1340 0x7f8e8406e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:20.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.850+0000 7f8e89975700 1 -- 172.21.15.26:0/1862665219 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e840a1340 msgr2=0x7f8e8406e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:20.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.850+0000 7f8e89975700 1 --2- 172.21.15.26:0/1862665219 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e840a1340 0x7f8e8406e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:20.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.850+0000 7f8e89975700 1 -- 172.21.15.26:0/1862665219 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e84133fa0 msgr2=0x7f8e8406e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:20.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.850+0000 7f8e89975700 1 --2- 172.21.15.26:0/1862665219 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e84133fa0 0x7f8e8406e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:20.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.850+0000 7f8e89975700 1 -- 172.21.15.26:0/1862665219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e78009550 con 0x7f8e840a0a30 2023-10-01T08:00:20.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.850+0000 7f8e89975700 1 --2- 172.21.15.26:0/1862665219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e840a0a30 0x7f8e8406dd00 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f8e74000f80 tx=0x7f8e74004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:20.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.850+0000 7f8e827fc700 1 -- 172.21.15.26:0/1862665219 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e74004680 con 0x7f8e840a0a30 2023-10-01T08:00:20.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.850+0000 7f8e827fc700 1 -- 172.21.15.26:0/1862665219 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e74020070 con 0x7f8e840a0a30 2023-10-01T08:00:20.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.850+0000 7f8e827fc700 1 -- 172.21.15.26:0/1862665219 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e74027480 con 0x7f8e840a0a30 2023-10-01T08:00:20.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.850+0000 7f8e8bbd9700 1 -- 172.21.15.26:0/1862665219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e7c0094a0 con 0x7f8e840a0a30 2023-10-01T08:00:20.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.850+0000 7f8e8bbd9700 1 -- 172.21.15.26:0/1862665219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e74009a70 con 0x7f8e840a0a30 2023-10-01T08:00:20.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.851+0000 7f8e827fc700 1 -- 172.21.15.26:0/1862665219 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e74012430 con 0x7f8e840a0a30 2023-10-01T08:00:20.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.852+0000 7f8e8bbd9700 1 -- 172.21.15.26:0/1862665219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e8409b1e0 con 0x7f8e840a0a30 2023-10-01T08:00:20.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.852+0000 7f8e827fc700 1 -- 172.21.15.26:0/1862665219 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8e74022070 con 0x7f8e840a0a30 2023-10-01T08:00:20.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.857+0000 7f8e827fc700 1 -- 172.21.15.26:0/1862665219 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e7401c400 con 0x7f8e840a0a30 2023-10-01T08:00:20.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.860+0000 7f127e7e6700 1 Processor -- start 2023-10-01T08:00:20.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.860+0000 7f127e7e6700 1 -- start start 2023-10-01T08:00:20.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.860+0000 7f127e7e6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f127809d6f0 0x7f127809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:20.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.860+0000 7f127e7e6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f127809e000 0x7f12781339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:20.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.860+0000 7f127e7e6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f127809e410 0x7f1278133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:20.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.860+0000 7f127e7e6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f127806b460 con 0x7f127809e000 2023-10-01T08:00:20.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.860+0000 7f127e7e6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f127809b120 con 0x7f127809e410 2023-10-01T08:00:20.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.860+0000 7f127e7e6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f127809a7e0 con 0x7f127809d6f0 2023-10-01T08:00:20.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.860+0000 7f127cd83700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f127809e410 0x7f1278133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:20.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.860+0000 7f12777fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f127809e000 0x7f12781339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:20.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.861+0000 7f1277fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f127809d6f0 0x7f127809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:20.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.861+0000 7f12777fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f127809e000 0x7f12781339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49082/0 (socket says 172.21.15.26:49082) 2023-10-01T08:00:20.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.861+0000 7f127cd83700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f127809e410 0x7f1278133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47276/0 (socket says 172.21.15.26:47276) 2023-10-01T08:00:20.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.861+0000 7f12777fe700 1 -- 172.21.15.26:0/209600599 learned_addr learned my addr 172.21.15.26:0/209600599 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:20.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.861+0000 7f12777fe700 1 -- 172.21.15.26:0/209600599 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f127809d6f0 msgr2=0x7f127809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:20.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.861+0000 7f12777fe700 1 --2- 172.21.15.26:0/209600599 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f127809d6f0 0x7f127809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:20.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.861+0000 7f12777fe700 1 -- 172.21.15.26:0/209600599 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f127809e410 msgr2=0x7f1278133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:20.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.861+0000 7f12777fe700 1 --2- 172.21.15.26:0/209600599 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f127809e410 0x7f1278133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:20.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.861+0000 7f12777fe700 1 -- 172.21.15.26:0/209600599 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f127809a500 con 0x7f127809e000 2023-10-01T08:00:20.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.861+0000 7f12777fe700 1 --2- 172.21.15.26:0/209600599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f127809e000 0x7f12781339f0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f126c0098f0 tx=0x7f126c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e08a4bb7acbc8200 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:20.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.861+0000 7f1276ffd700 1 -- 172.21.15.26:0/209600599 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c011830 con 0x7f127809e000 2023-10-01T08:00:20.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.861+0000 7f1276ffd700 1 -- 172.21.15.26:0/209600599 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126c011990 con 0x7f127809e000 2023-10-01T08:00:20.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.861+0000 7f1276ffd700 1 -- 172.21.15.26:0/209600599 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c011d00 con 0x7f127809e000 2023-10-01T08:00:20.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.862+0000 7f127e7e6700 1 -- 172.21.15.26:0/209600599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f127809e000 msgr2=0x7f12781339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:20.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.862+0000 7f127e7e6700 1 --2- 172.21.15.26:0/209600599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f127809e000 0x7f12781339f0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f126c0098f0 tx=0x7f126c009c00 comp rx=0 tx=0).stop 2023-10-01T08:00:20.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.862+0000 7f127e7e6700 1 -- 172.21.15.26:0/209600599 shutdown_connections 2023-10-01T08:00:20.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.862+0000 7f127e7e6700 1 --2- 172.21.15.26:0/209600599 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f127809e410 0x7f1278133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:20.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.862+0000 7f127e7e6700 1 --2- 172.21.15.26:0/209600599 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f127809d6f0 0x7f127809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:20.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.862+0000 7f127e7e6700 1 --2- 172.21.15.26:0/209600599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f127809e000 0x7f12781339f0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:20.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.862+0000 7f127e7e6700 1 -- 172.21.15.26:0/209600599 >> 172.21.15.26:0/209600599 conn(0x7f1278066f50 msgr2=0x7f127809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:20.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.862+0000 7f127e7e6700 1 -- 172.21.15.26:0/209600599 shutdown_connections 2023-10-01T08:00:20.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.863+0000 7f127e7e6700 1 -- 172.21.15.26:0/209600599 wait complete. 2023-10-01T08:00:20.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.864+0000 7f127e7e6700 1 Processor -- start 2023-10-01T08:00:20.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.864+0000 7f127e7e6700 1 -- start start 2023-10-01T08:00:20.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.865+0000 7f127e7e6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f127809d6f0 0x7f12781c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:20.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.865+0000 7f127e7e6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f127809e000 0x7f12781c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:20.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.865+0000 7f127e7e6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f127809e410 0x7f12781c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:20.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.865+0000 7f127e7e6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12781a86d0 con 0x7f127809e000 2023-10-01T08:00:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.865+0000 7f127e7e6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12781a8b90 con 0x7f127809d6f0 2023-10-01T08:00:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.865+0000 7f127e7e6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12781c8f80 con 0x7f127809e410 2023-10-01T08:00:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.865+0000 7f1277fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f127809d6f0 0x7f12781c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.865+0000 7f1277fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f127809d6f0 0x7f12781c8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47284/0 (socket says 172.21.15.26:47284) 2023-10-01T08:00:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.865+0000 7f1277fff700 1 -- 172.21.15.26:0/4064246937 learned_addr learned my addr 172.21.15.26:0/4064246937 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.865+0000 7f127cd83700 1 --2- 172.21.15.26:0/4064246937 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f127809e410 0x7f12781c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.865+0000 7f12777fe700 1 --2- 172.21.15.26:0/4064246937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f127809e000 0x7f12781c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.866+0000 7f127cd83700 1 -- 172.21.15.26:0/4064246937 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f127809d6f0 msgr2=0x7f12781c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.866+0000 7f127cd83700 1 --2- 172.21.15.26:0/4064246937 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f127809d6f0 0x7f12781c8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.866+0000 7f127cd83700 1 -- 172.21.15.26:0/4064246937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f127809e000 msgr2=0x7f12781c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.866+0000 7f127cd83700 1 --2- 172.21.15.26:0/4064246937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f127809e000 0x7f12781c8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.866+0000 7f127cd83700 1 -- 172.21.15.26:0/4064246937 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126c009550 con 0x7f127809e410 2023-10-01T08:00:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.866+0000 7f1277fff700 1 --2- 172.21.15.26:0/4064246937 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f127809d6f0 0x7f12781c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T08:00:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.866+0000 7f127cd83700 1 --2- 172.21.15.26:0/4064246937 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f127809e410 0x7f12781c4ad0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f1270009d90 tx=0x7f127000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.866+0000 7f1274ff9700 1 -- 172.21.15.26:0/4064246937 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127000cd40 con 0x7f127809e410 2023-10-01T08:00:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.866+0000 7f1274ff9700 1 -- 172.21.15.26:0/4064246937 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127000f040 con 0x7f127809e410 2023-10-01T08:00:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.866+0000 7f127e7e6700 1 -- 172.21.15.26:0/4064246937 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12781a78f0 con 0x7f127809e410 2023-10-01T08:00:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.866+0000 7f1274ff9700 1 -- 172.21.15.26:0/4064246937 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12700146c0 con 0x7f127809e410 2023-10-01T08:00:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.866+0000 7f127e7e6700 1 -- 172.21.15.26:0/4064246937 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f127809c710 con 0x7f127809e410 2023-10-01T08:00:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.867+0000 7f1274ff9700 1 -- 172.21.15.26:0/4064246937 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1270014820 con 0x7f127809e410 2023-10-01T08:00:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.867+0000 7f1274ff9700 1 -- 172.21.15.26:0/4064246937 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1270040440 con 0x7f127809e410 2023-10-01T08:00:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.868+0000 7f127e7e6700 1 -- 172.21.15.26:0/4064246937 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1278074ea0 con 0x7f127809e410 2023-10-01T08:00:20.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:20.878+0000 7f1274ff9700 1 -- 172.21.15.26:0/4064246937 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f127001d400 con 0x7f127809e410 2023-10-01T08:00:21.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.068+0000 7f8e8bbd9700 1 -- 172.21.15.26:0/1862665219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8e84131490 con 0x7f8e840a0a30 2023-10-01T08:00:21.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.068+0000 7f8e827fc700 1 -- 172.21.15.26:0/1862665219 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8e7402c020 con 0x7f8e840a0a30 2023-10-01T08:00:21.069 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:21.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.072+0000 7f8e8bbd9700 1 -- 172.21.15.26:0/1862665219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e840a0a30 msgr2=0x7f8e8406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:21.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.072+0000 7f8e8bbd9700 1 --2- 172.21.15.26:0/1862665219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e840a0a30 0x7f8e8406dd00 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f8e74000f80 tx=0x7f8e74004ad0 comp rx=0 tx=0).stop 2023-10-01T08:00:21.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.072+0000 7f8e8bbd9700 1 -- 172.21.15.26:0/1862665219 shutdown_connections 2023-10-01T08:00:21.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.072+0000 7f8e8bbd9700 1 --2- 172.21.15.26:0/1862665219 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e84133fa0 0x7f8e8406e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:21.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.072+0000 7f8e8bbd9700 1 --2- 172.21.15.26:0/1862665219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e840a0a30 0x7f8e8406dd00 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:21.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.072+0000 7f8e8bbd9700 1 --2- 172.21.15.26:0/1862665219 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e840a1340 0x7f8e8406e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:21.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.072+0000 7f8e8bbd9700 1 -- 172.21.15.26:0/1862665219 >> 172.21.15.26:0/1862665219 conn(0x7f8e840a6550 msgr2=0x7f8e841331f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:21.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.072+0000 7f8e8bbd9700 1 -- 172.21.15.26:0/1862665219 shutdown_connections 2023-10-01T08:00:21.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.072+0000 7f8e8bbd9700 1 -- 172.21.15.26:0/1862665219 wait complete. 2023-10-01T08:00:21.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.072+0000 7fd9b7c51700 1 -- 172.21.15.26:0/3798099842 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd9b0135a00 con 0x7fd9b006f5d0 2023-10-01T08:00:21.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.073+0000 7fd9a67fc700 1 -- 172.21.15.26:0/3798099842 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd9ac007720 con 0x7fd9b006f5d0 2023-10-01T08:00:21.074 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:21.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.075+0000 7fd9b7c51700 1 -- 172.21.15.26:0/3798099842 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9b006f5d0 msgr2=0x7fd9b0132e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:21.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.075+0000 7fd9b7c51700 1 --2- 172.21.15.26:0/3798099842 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9b006f5d0 0x7fd9b0132e90 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac00c470 tx=0x7fd9ac00c780 comp rx=0 tx=0).stop 2023-10-01T08:00:21.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.075+0000 7fd9b7c51700 1 -- 172.21.15.26:0/3798099842 shutdown_connections 2023-10-01T08:00:21.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.075+0000 7fd9b7c51700 1 --2- 172.21.15.26:0/3798099842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9b0135c20 0x7fd9b0133910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:21.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.075+0000 7fd9b7c51700 1 --2- 172.21.15.26:0/3798099842 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd9b006f5d0 0x7fd9b0132e90 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:21.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.075+0000 7fd9b7c51700 1 --2- 172.21.15.26:0/3798099842 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9b012cf60 0x7fd9b01333d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:21.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.075+0000 7fd9b7c51700 1 -- 172.21.15.26:0/3798099842 >> 172.21.15.26:0/3798099842 conn(0x7fd9b00a2aa0 msgr2=0x7fd9b006eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:21.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.075+0000 7fd9b7c51700 1 -- 172.21.15.26:0/3798099842 shutdown_connections 2023-10-01T08:00:21.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.075+0000 7fd9b7c51700 1 -- 172.21.15.26:0/3798099842 wait complete. 2023-10-01T08:00:21.091 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:21.093 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:21.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.122+0000 7f127e7e6700 1 -- 172.21.15.26:0/4064246937 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f127806c360 con 0x7f127809e410 2023-10-01T08:00:21.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.122+0000 7f1274ff9700 1 -- 172.21.15.26:0/4064246937 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f127002c090 con 0x7f127809e410 2023-10-01T08:00:21.123 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:21.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.124+0000 7f127e7e6700 1 -- 172.21.15.26:0/4064246937 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f127809e410 msgr2=0x7f12781c4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:21.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.124+0000 7f127e7e6700 1 --2- 172.21.15.26:0/4064246937 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f127809e410 0x7f12781c4ad0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f1270009d90 tx=0x7f127000c3a0 comp rx=0 tx=0).stop 2023-10-01T08:00:21.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.124+0000 7f127e7e6700 1 -- 172.21.15.26:0/4064246937 shutdown_connections 2023-10-01T08:00:21.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.124+0000 7f127e7e6700 1 --2- 172.21.15.26:0/4064246937 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f127809e410 0x7f12781c4ad0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:21.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.124+0000 7f127e7e6700 1 --2- 172.21.15.26:0/4064246937 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f127809d6f0 0x7f12781c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:21.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.124+0000 7f127e7e6700 1 --2- 172.21.15.26:0/4064246937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f127809e000 0x7f12781c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:21.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.124+0000 7f127e7e6700 1 -- 172.21.15.26:0/4064246937 >> 172.21.15.26:0/4064246937 conn(0x7f1278066f50 msgr2=0x7f12781badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:21.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.124+0000 7f127e7e6700 1 -- 172.21.15.26:0/4064246937 shutdown_connections 2023-10-01T08:00:21.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.125+0000 7f127e7e6700 1 -- 172.21.15.26:0/4064246937 wait complete. 2023-10-01T08:00:21.139 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:21.830 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:21.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.975+0000 7feb807a2700 1 Processor -- start 2023-10-01T08:00:21.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.975+0000 7feb807a2700 1 -- start start 2023-10-01T08:00:21.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.976+0000 7feb807a2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feb7809d6f0 0x7feb7809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:21.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.976+0000 7feb807a2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb7809e000 0x7feb78130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:21.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.976+0000 7feb807a2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb7809e410 0x7feb78130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:21.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.976+0000 7feb807a2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb7809f520 con 0x7feb7809d6f0 2023-10-01T08:00:21.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.976+0000 7feb807a2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7809f130 con 0x7feb7809e000 2023-10-01T08:00:21.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.976+0000 7feb807a2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb7809e930 con 0x7feb7809e410 2023-10-01T08:00:21.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.976+0000 7feb7dd3d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb7809e000 0x7feb78130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:21.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.976+0000 7feb7ed3f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb7809e410 0x7feb78130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:21.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.976+0000 7feb7e53e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feb7809d6f0 0x7feb7809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:21.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.976+0000 7feb7dd3d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb7809e000 0x7feb78130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47290/0 (socket says 172.21.15.26:47290) 2023-10-01T08:00:21.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.976+0000 7feb7ed3f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb7809e410 0x7feb78130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47374/0 (socket says 172.21.15.26:47374) 2023-10-01T08:00:21.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.976+0000 7feb7dd3d700 1 -- 172.21.15.26:0/2044053833 learned_addr learned my addr 172.21.15.26:0/2044053833 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:21.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.976+0000 7feb7dd3d700 1 -- 172.21.15.26:0/2044053833 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb7809e410 msgr2=0x7feb78130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:21.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.976+0000 7feb7dd3d700 1 --2- 172.21.15.26:0/2044053833 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb7809e410 0x7feb78130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:21.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.976+0000 7feb7dd3d700 1 -- 172.21.15.26:0/2044053833 >> v2:172.21.15.26:3300/0 conn(0x7feb7809d6f0 msgr2=0x7feb7809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:21.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.976+0000 7feb7dd3d700 1 --2- 172.21.15.26:0/2044053833 >> v2:172.21.15.26:3300/0 conn(0x7feb7809d6f0 0x7feb7809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:21.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.976+0000 7feb7dd3d700 1 -- 172.21.15.26:0/2044053833 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7809b2d0 con 0x7feb7809e000 2023-10-01T08:00:21.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.976+0000 7feb7ed3f700 1 --2- 172.21.15.26:0/2044053833 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb7809e410 0x7feb78130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:21.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.976+0000 7feb7e53e700 1 --2- 172.21.15.26:0/2044053833 >> v2:172.21.15.26:3300/0 conn(0x7feb7809d6f0 0x7feb7809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:21.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.977+0000 7feb7dd3d700 1 --2- 172.21.15.26:0/2044053833 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb7809e000 0x7feb78130660 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7feb7400bb90 tx=0x7feb7400bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=885c125e0805c096 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:21.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.977+0000 7feb7d53c700 1 -- 172.21.15.26:0/2044053833 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7400dd30 con 0x7feb7809e000 2023-10-01T08:00:21.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.977+0000 7feb7d53c700 1 -- 172.21.15.26:0/2044053833 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7400de90 con 0x7feb7809e000 2023-10-01T08:00:21.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.977+0000 7feb7d53c700 1 -- 172.21.15.26:0/2044053833 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb74010690 con 0x7feb7809e000 2023-10-01T08:00:21.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.977+0000 7feb807a2700 1 -- 172.21.15.26:0/2044053833 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb7809e000 msgr2=0x7feb78130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:21.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.977+0000 7feb807a2700 1 --2- 172.21.15.26:0/2044053833 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb7809e000 0x7feb78130660 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7feb7400bb90 tx=0x7feb7400bea0 comp rx=0 tx=0).stop 2023-10-01T08:00:21.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.977+0000 7feb807a2700 1 -- 172.21.15.26:0/2044053833 shutdown_connections 2023-10-01T08:00:21.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.977+0000 7feb807a2700 1 --2- 172.21.15.26:0/2044053833 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb7809e410 0x7feb78130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:21.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.978+0000 7feb807a2700 1 --2- 172.21.15.26:0/2044053833 >> v2:172.21.15.26:3300/0 conn(0x7feb7809d6f0 0x7feb7809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:21.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.978+0000 7feb807a2700 1 --2- 172.21.15.26:0/2044053833 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb7809e000 0x7feb78130660 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:21.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.978+0000 7feb807a2700 1 -- 172.21.15.26:0/2044053833 >> 172.21.15.26:0/2044053833 conn(0x7feb78066f50 msgr2=0x7feb7809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:21.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.978+0000 7feb807a2700 1 -- 172.21.15.26:0/2044053833 shutdown_connections 2023-10-01T08:00:21.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.978+0000 7feb807a2700 1 -- 172.21.15.26:0/2044053833 wait complete. 2023-10-01T08:00:21.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.979+0000 7feb807a2700 1 Processor -- start 2023-10-01T08:00:21.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.979+0000 7feb807a2700 1 -- start start 2023-10-01T08:00:21.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.979+0000 7feb807a2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb7809d6f0 0x7feb7811e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:21.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.979+0000 7feb807a2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb7809e000 0x7feb7811e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:21.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.979+0000 7feb807a2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb7809e410 0x7feb7811eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:21.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.979+0000 7feb807a2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb78121b60 con 0x7feb7809e000 2023-10-01T08:00:21.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.979+0000 7feb807a2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7809c770 con 0x7feb7809d6f0 2023-10-01T08:00:21.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.979+0000 7feb807a2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb780a1ad0 con 0x7feb7809e410 2023-10-01T08:00:21.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.979+0000 7feb7e53e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb7809d6f0 0x7feb7811e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:21.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.979+0000 7feb7ed3f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb7809e410 0x7feb7811eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:21.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.979+0000 7feb7e53e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb7809d6f0 0x7feb7811e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47298/0 (socket says 172.21.15.26:47298) 2023-10-01T08:00:21.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.979+0000 7feb7e53e700 1 -- 172.21.15.26:0/3771623602 learned_addr learned my addr 172.21.15.26:0/3771623602 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:21.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.979+0000 7feb7dd3d700 1 --2- 172.21.15.26:0/3771623602 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb7809e000 0x7feb7811e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:21.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.979+0000 7feb7e53e700 1 -- 172.21.15.26:0/3771623602 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb7809e410 msgr2=0x7feb7811eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:21.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.980+0000 7feb7e53e700 1 --2- 172.21.15.26:0/3771623602 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb7809e410 0x7feb7811eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:21.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.980+0000 7feb7e53e700 1 -- 172.21.15.26:0/3771623602 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb7809e000 msgr2=0x7feb7811e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:21.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.980+0000 7feb7e53e700 1 --2- 172.21.15.26:0/3771623602 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb7809e000 0x7feb7811e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:21.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.980+0000 7feb7e53e700 1 -- 172.21.15.26:0/3771623602 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb680094a0 con 0x7feb7809d6f0 2023-10-01T08:00:21.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.980+0000 7feb7ed3f700 1 --2- 172.21.15.26:0/3771623602 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb7809e410 0x7feb7811eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:21.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.980+0000 7feb7e53e700 1 --2- 172.21.15.26:0/3771623602 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb7809d6f0 0x7feb7811e040 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7feb6800ebe0 tx=0x7feb6800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:21.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.980+0000 7feb6effd700 1 -- 172.21.15.26:0/3771623602 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb68009780 con 0x7feb7809d6f0 2023-10-01T08:00:21.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.980+0000 7feb6effd700 1 -- 172.21.15.26:0/3771623602 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6800c850 con 0x7feb7809d6f0 2023-10-01T08:00:21.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.980+0000 7feb807a2700 1 -- 172.21.15.26:0/3771623602 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb70009a70 con 0x7feb7809d6f0 2023-10-01T08:00:21.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.980+0000 7feb6effd700 1 -- 172.21.15.26:0/3771623602 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6800cbe0 con 0x7feb7809d6f0 2023-10-01T08:00:21.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.980+0000 7feb807a2700 1 -- 172.21.15.26:0/3771623602 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb7400b7f0 con 0x7feb7809d6f0 2023-10-01T08:00:21.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.981+0000 7feb6effd700 1 -- 172.21.15.26:0/3771623602 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feb6800cd40 con 0x7feb7809d6f0 2023-10-01T08:00:21.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.981+0000 7feb6effd700 1 -- 172.21.15.26:0/3771623602 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7feb6803fb30 con 0x7feb7809d6f0 2023-10-01T08:00:21.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.981+0000 7feb807a2700 1 -- 172.21.15.26:0/3771623602 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb78074ea0 con 0x7feb7809d6f0 2023-10-01T08:00:21.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:21.986+0000 7feb6effd700 1 -- 172.21.15.26:0/3771623602 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feb68011b00 con 0x7feb7809d6f0 2023-10-01T08:00:22.091 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:22.093 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:22.139 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:22.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.198+0000 7feb807a2700 1 -- 172.21.15.26:0/3771623602 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7feb7806c360 con 0x7feb7809d6f0 2023-10-01T08:00:22.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.198+0000 7feb6effd700 1 -- 172.21.15.26:0/3771623602 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feb68021020 con 0x7feb7809d6f0 2023-10-01T08:00:22.200 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:22.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.201+0000 7feb807a2700 1 -- 172.21.15.26:0/3771623602 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb7809d6f0 msgr2=0x7feb7811e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:22.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.201+0000 7feb807a2700 1 --2- 172.21.15.26:0/3771623602 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb7809d6f0 0x7feb7811e040 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7feb6800ebe0 tx=0x7feb6800eef0 comp rx=0 tx=0).stop 2023-10-01T08:00:22.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.201+0000 7feb807a2700 1 -- 172.21.15.26:0/3771623602 shutdown_connections 2023-10-01T08:00:22.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.201+0000 7feb807a2700 1 --2- 172.21.15.26:0/3771623602 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feb7809e410 0x7feb7811eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:22.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.201+0000 7feb807a2700 1 --2- 172.21.15.26:0/3771623602 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feb7809d6f0 0x7feb7811e040 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:22.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.201+0000 7feb807a2700 1 --2- 172.21.15.26:0/3771623602 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb7809e000 0x7feb7811e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:22.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.201+0000 7feb807a2700 1 -- 172.21.15.26:0/3771623602 >> 172.21.15.26:0/3771623602 conn(0x7feb78066f50 msgr2=0x7feb7806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:22.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.201+0000 7feb807a2700 1 -- 172.21.15.26:0/3771623602 shutdown_connections 2023-10-01T08:00:22.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.201+0000 7feb807a2700 1 -- 172.21.15.26:0/3771623602 wait complete. 2023-10-01T08:00:22.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:22.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.236+0000 7f6f63c89700 1 Processor -- start 2023-10-01T08:00:22.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.236+0000 7f6f63c89700 1 -- start start 2023-10-01T08:00:22.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.236+0000 7f667d92b700 1 Processor -- start 2023-10-01T08:00:22.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.236+0000 7f667d92b700 1 -- start start 2023-10-01T08:00:22.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.237+0000 7f6f63c89700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f5c133a80 0x7f6f5c133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:22.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.237+0000 7f6f63c89700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6f5c12ff20 0x7f6f5c130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:22.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.237+0000 7f6f63c89700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f5c130870 0x7f6f5c13a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:22.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.237+0000 7f6f63c89700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5c06c570 con 0x7f6f5c12ff20 2023-10-01T08:00:22.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.237+0000 7f6f63c89700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c06bc00 con 0x7f6f5c133a80 2023-10-01T08:00:22.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.237+0000 7f6f63c89700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c0a0040 con 0x7f6f5c130870 2023-10-01T08:00:22.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.237+0000 7f667d92b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6678130540 0x7f6678130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:22.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.237+0000 7f667d92b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6678136e70 0x7f6678139250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:22.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.237+0000 7f667d92b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66780716a0 con 0x7f6678130e50 2023-10-01T08:00:22.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.237+0000 7f667d92b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f667809a390 con 0x7f6678136e70 2023-10-01T08:00:22.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.237+0000 7f667d92b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6678071290 con 0x7f6678130540 2023-10-01T08:00:22.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.237+0000 7f6676ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6678130540 0x7f6678130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:22.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.237+0000 7f6676ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6678130540 0x7f6678130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47324/0 (socket says 172.21.15.26:47324) 2023-10-01T08:00:22.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.237+0000 7f6676ffd700 1 -- 172.21.15.26:0/1730000702 learned_addr learned my addr 172.21.15.26:0/1730000702 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:22.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.237+0000 7f66777fe700 1 --2- 172.21.15.26:0/1730000702 >> v2:172.21.15.26:3300/0 conn(0x7f6678136e70 0x7f6678139250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:22.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.237+0000 7f6f61a25700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f5c133a80 0x7f6f5c133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:22.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.237+0000 7f6f61a25700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f5c133a80 0x7f6f5c133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47308/0 (socket says 172.21.15.26:47308) 2023-10-01T08:00:22.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.237+0000 7f6f61a25700 1 -- 172.21.15.26:0/3337803169 learned_addr learned my addr 172.21.15.26:0/3337803169 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:22.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.237+0000 7f6f61224700 1 --2- 172.21.15.26:0/3337803169 >> v2:172.21.15.26:3300/0 conn(0x7f6f5c12ff20 0x7f6f5c130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:22.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.237+0000 7f6f62226700 1 --2- 172.21.15.26:0/3337803169 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f5c130870 0x7f6f5c13a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:22.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.238+0000 7f6f61224700 1 -- 172.21.15.26:0/3337803169 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f5c130870 msgr2=0x7f6f5c13a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:22.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.238+0000 7f6f61224700 1 --2- 172.21.15.26:0/3337803169 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f5c130870 0x7f6f5c13a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:22.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.238+0000 7f6f61224700 1 -- 172.21.15.26:0/3337803169 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f5c133a80 msgr2=0x7f6f5c133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:22.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.238+0000 7f6f61224700 1 --2- 172.21.15.26:0/3337803169 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f5c133a80 0x7f6f5c133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:22.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.238+0000 7f6f61224700 1 -- 172.21.15.26:0/3337803169 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5c133860 con 0x7f6f5c12ff20 2023-10-01T08:00:22.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.238+0000 7f6676ffd700 1 -- 172.21.15.26:0/1730000702 >> v2:172.21.15.26:3300/0 conn(0x7f6678136e70 msgr2=0x7f6678139250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:22.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.238+0000 7f6676ffd700 1 --2- 172.21.15.26:0/1730000702 >> v2:172.21.15.26:3300/0 conn(0x7f6678136e70 0x7f6678139250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:22.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.238+0000 7f6676ffd700 1 -- 172.21.15.26:0/1730000702 >> v1:172.21.15.26:6789/0 conn(0x7f6678130e50 legacy=0x7f6678135750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:22.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.238+0000 7f6676ffd700 1 -- 172.21.15.26:0/1730000702 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6678130340 con 0x7f6678130540 2023-10-01T08:00:22.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.238+0000 7f6f61224700 1 --2- 172.21.15.26:0/3337803169 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f5c12ff20 0x7f6f5c130330 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c009840 tx=0x7f6f4c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a619e38b4305b32 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:22.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.238+0000 7f6676ffd700 1 --2- 172.21.15.26:0/1730000702 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6678130540 0x7f6678130910 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f66680098f0 tx=0x7f6668009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbc43abe30cc4af4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:22.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.238+0000 7f6f60a23700 1 -- 172.21.15.26:0/3337803169 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c011830 con 0x7f6f5c12ff20 2023-10-01T08:00:22.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.238+0000 7f6f60a23700 1 -- 172.21.15.26:0/3337803169 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4c011990 con 0x7f6f5c12ff20 2023-10-01T08:00:22.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.238+0000 7f6675ffb700 1 -- 172.21.15.26:0/1730000702 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668011830 con 0x7f6678130540 2023-10-01T08:00:22.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.238+0000 7f6675ffb700 1 -- 172.21.15.26:0/1730000702 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6668011990 con 0x7f6678130540 2023-10-01T08:00:22.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.238+0000 7f6f60a23700 1 -- 172.21.15.26:0/3337803169 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c011d20 con 0x7f6f5c12ff20 2023-10-01T08:00:22.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.238+0000 7f6675ffb700 1 -- 172.21.15.26:0/1730000702 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668011d20 con 0x7f6678130540 2023-10-01T08:00:22.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.239+0000 7f6f63c89700 1 -- 172.21.15.26:0/3337803169 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f5c12ff20 msgr2=0x7f6f5c130330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:22.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.239+0000 7f6f63c89700 1 --2- 172.21.15.26:0/3337803169 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f5c12ff20 0x7f6f5c130330 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c009840 tx=0x7f6f4c009b50 comp rx=0 tx=0).stop 2023-10-01T08:00:22.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.239+0000 7f667d92b700 1 -- 172.21.15.26:0/1730000702 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6678130540 msgr2=0x7f6678130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:22.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.239+0000 7f667d92b700 1 --2- 172.21.15.26:0/1730000702 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6678130540 0x7f6678130910 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f66680098f0 tx=0x7f6668009c00 comp rx=0 tx=0).stop 2023-10-01T08:00:22.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.239+0000 7f6f63c89700 1 -- 172.21.15.26:0/3337803169 shutdown_connections 2023-10-01T08:00:22.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.239+0000 7f6f63c89700 1 --2- 172.21.15.26:0/3337803169 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f5c130870 0x7f6f5c13a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:22.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.239+0000 7f6f63c89700 1 --2- 172.21.15.26:0/3337803169 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f5c133a80 0x7f6f5c133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:22.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.239+0000 7f6f63c89700 1 --2- 172.21.15.26:0/3337803169 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f5c12ff20 0x7f6f5c130330 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:22.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.239+0000 7f6f63c89700 1 -- 172.21.15.26:0/3337803169 >> 172.21.15.26:0/3337803169 conn(0x7f6f5c0a4210 msgr2=0x7f6f5c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:22.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.239+0000 7f667d92b700 1 -- 172.21.15.26:0/1730000702 shutdown_connections 2023-10-01T08:00:22.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.239+0000 7f667d92b700 1 --2- 172.21.15.26:0/1730000702 >> v2:172.21.15.26:3300/0 conn(0x7f6678136e70 0x7f6678139250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:22.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.239+0000 7f667d92b700 1 --2- 172.21.15.26:0/1730000702 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6678130540 0x7f6678130910 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:22.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.239+0000 7f667d92b700 1 -- 172.21.15.26:0/1730000702 >> 172.21.15.26:0/1730000702 conn(0x7f66780a2aa0 msgr2=0x7f66780a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:22.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.239+0000 7f6f63c89700 1 -- 172.21.15.26:0/3337803169 shutdown_connections 2023-10-01T08:00:22.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.239+0000 7f667d92b700 1 -- 172.21.15.26:0/1730000702 shutdown_connections 2023-10-01T08:00:22.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.239+0000 7f667d92b700 1 -- 172.21.15.26:0/1730000702 wait complete. 2023-10-01T08:00:22.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.239+0000 7f6f63c89700 1 -- 172.21.15.26:0/3337803169 wait complete. 2023-10-01T08:00:22.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.240+0000 7f667d92b700 1 Processor -- start 2023-10-01T08:00:22.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.240+0000 7f667d92b700 1 -- start start 2023-10-01T08:00:22.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.241+0000 7f6f63c89700 1 Processor -- start 2023-10-01T08:00:22.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.241+0000 7f6f63c89700 1 -- start start 2023-10-01T08:00:22.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.241+0000 7f667d92b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6678130540 0x7f6678131320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:22.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.241+0000 7f667d92b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6678130e50 0x7f6678131860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:22.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.241+0000 7f667d92b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6678136e70 0x7f6678131da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:22.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.241+0000 7f667d92b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6678133110 con 0x7f6678130540 2023-10-01T08:00:22.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.241+0000 7f667d92b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66781339f0 con 0x7f6678130e50 2023-10-01T08:00:22.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.241+0000 7f667d92b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6678135ff0 con 0x7f6678136e70 2023-10-01T08:00:22.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.241+0000 7f6676ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6678130540 0x7f6678131320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:22.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.241+0000 7f6676ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6678130540 0x7f6678131320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49138/0 (socket says 172.21.15.26:49138) 2023-10-01T08:00:22.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.241+0000 7f6676ffd700 1 -- 172.21.15.26:0/3313795790 learned_addr learned my addr 172.21.15.26:0/3313795790 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:22.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.241+0000 7f66777fe700 1 --2- 172.21.15.26:0/3313795790 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6678136e70 0x7f6678131da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:22.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.241+0000 7f66767fc700 1 --2- 172.21.15.26:0/3313795790 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6678130e50 0x7f6678131860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:22.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.241+0000 7f6f63c89700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f5c12ff20 0x7f6f5c09c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:22.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.241+0000 7f6f63c89700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f5c130870 0x7f6f5c09c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:22.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.241+0000 7f6f63c89700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f5c133a80 0x7f6f5c09cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:22.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.241+0000 7f6f63c89700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c09e490 con 0x7f6f5c133a80 2023-10-01T08:00:22.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.241+0000 7f6f63c89700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c11bab0 con 0x7f6f5c130870 2023-10-01T08:00:22.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.241+0000 7f6f63c89700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c0a1fc0 con 0x7f6f5c12ff20 2023-10-01T08:00:22.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.242+0000 7f6f61a25700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f5c12ff20 0x7f6f5c09c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:22.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.242+0000 7f6f61a25700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f5c12ff20 0x7f6f5c09c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47406/0 (socket says 172.21.15.26:47406) 2023-10-01T08:00:22.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.242+0000 7f6f61a25700 1 -- 172.21.15.26:0/2027153111 learned_addr learned my addr 172.21.15.26:0/2027153111 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:22.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.242+0000 7f6f62226700 1 --2- 172.21.15.26:0/2027153111 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f5c133a80 0x7f6f5c09cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:22.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.242+0000 7f6f61a25700 1 -- 172.21.15.26:0/2027153111 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f5c130870 msgr2=0x7f6f5c09c580 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T08:00:22.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.242+0000 7f6f61a25700 1 --2- 172.21.15.26:0/2027153111 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f5c130870 0x7f6f5c09c580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:22.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.242+0000 7f6f61a25700 1 -- 172.21.15.26:0/2027153111 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f5c133a80 msgr2=0x7f6f5c09cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:22.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.242+0000 7f6f61a25700 1 --2- 172.21.15.26:0/2027153111 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f5c133a80 0x7f6f5c09cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:22.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.242+0000 7f6f61a25700 1 -- 172.21.15.26:0/2027153111 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4c0094a0 con 0x7f6f5c12ff20 2023-10-01T08:00:22.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.242+0000 7f6676ffd700 1 -- 172.21.15.26:0/3313795790 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6678136e70 msgr2=0x7f6678131da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:22.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.242+0000 7f6676ffd700 1 --2- 172.21.15.26:0/3313795790 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6678136e70 0x7f6678131da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:22.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.242+0000 7f6676ffd700 1 -- 172.21.15.26:0/3313795790 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6678130e50 msgr2=0x7f6678131860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:22.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.242+0000 7f6676ffd700 1 --2- 172.21.15.26:0/3313795790 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6678130e50 0x7f6678131860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:22.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.242+0000 7f6676ffd700 1 -- 172.21.15.26:0/3313795790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6668009550 con 0x7f6678130540 2023-10-01T08:00:22.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.242+0000 7f6676ffd700 1 --2- 172.21.15.26:0/3313795790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6678130540 0x7f6678131320 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f6668009c40 tx=0x7f6668004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:22.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.242+0000 7f6f61a25700 1 --2- 172.21.15.26:0/2027153111 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f5c12ff20 0x7f6f5c09c040 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f6f5800e940 tx=0x7f6f5800ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:22.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.242+0000 7f665ffff700 1 -- 172.21.15.26:0/3313795790 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66680036a0 con 0x7f6678130540 2023-10-01T08:00:22.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.242+0000 7f665ffff700 1 -- 172.21.15.26:0/3313795790 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6668003800 con 0x7f6678130540 2023-10-01T08:00:22.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.242+0000 7f667d92b700 1 -- 172.21.15.26:0/3313795790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6678133450 con 0x7f6678130540 2023-10-01T08:00:22.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.242+0000 7f665ffff700 1 -- 172.21.15.26:0/3313795790 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668003bb0 con 0x7f6678130540 2023-10-01T08:00:22.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.242+0000 7f667d92b700 1 -- 172.21.15.26:0/3313795790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f667809de80 con 0x7f6678130540 2023-10-01T08:00:22.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.243+0000 7f665ffff700 1 -- 172.21.15.26:0/3313795790 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6668021070 con 0x7f6678130540 2023-10-01T08:00:22.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.243+0000 7f6f527fc700 1 -- 172.21.15.26:0/2027153111 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f580096a0 con 0x7f6f5c12ff20 2023-10-01T08:00:22.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.244+0000 7f6f527fc700 1 -- 172.21.15.26:0/2027153111 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5800ee90 con 0x7f6f5c12ff20 2023-10-01T08:00:22.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.244+0000 7f665ffff700 1 -- 172.21.15.26:0/3313795790 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6668040be0 con 0x7f6678130540 2023-10-01T08:00:22.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.244+0000 7f6f63c89700 1 -- 172.21.15.26:0/2027153111 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f5c11b240 con 0x7f6f5c12ff20 2023-10-01T08:00:22.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.244+0000 7f667d92b700 1 -- 172.21.15.26:0/3313795790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6678074ea0 con 0x7f6678130540 2023-10-01T08:00:22.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.244+0000 7f6f63c89700 1 -- 172.21.15.26:0/2027153111 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f5c11adf0 con 0x7f6f5c12ff20 2023-10-01T08:00:22.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.244+0000 7f6f527fc700 1 -- 172.21.15.26:0/2027153111 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5800ca90 con 0x7f6f5c12ff20 2023-10-01T08:00:22.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.244+0000 7f6f527fc700 1 -- 172.21.15.26:0/2027153111 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6f5800cc50 con 0x7f6f5c12ff20 2023-10-01T08:00:22.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.245+0000 7f6f527fc700 1 -- 172.21.15.26:0/2027153111 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6f5803f5e0 con 0x7f6f5c12ff20 2023-10-01T08:00:22.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.245+0000 7f6f63c89700 1 -- 172.21.15.26:0/2027153111 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f440052e0 con 0x7f6f5c12ff20 2023-10-01T08:00:22.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.249+0000 7f665ffff700 1 -- 172.21.15.26:0/3313795790 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6668029080 con 0x7f6678130540 2023-10-01T08:00:22.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.250+0000 7f6f527fc700 1 -- 172.21.15.26:0/2027153111 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f580232f0 con 0x7f6f5c12ff20 2023-10-01T08:00:22.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.290+0000 7fdd07930700 1 Processor -- start 2023-10-01T08:00:22.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.290+0000 7fdd07930700 1 -- start start 2023-10-01T08:00:22.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.291+0000 7fdd07930700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd000a0a30 0x7fdd000a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:22.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.291+0000 7fdd07930700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdd0009d630 0x7fdd000a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:22.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.291+0000 7fdd07930700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd000a2a70 con 0x7fdd00133930 2023-10-01T08:00:22.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.291+0000 7fdd07930700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd000a01d0 con 0x7fdd0009d630 2023-10-01T08:00:22.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.291+0000 7fdd07930700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0009e2b0 con 0x7fdd000a0a30 2023-10-01T08:00:22.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.291+0000 7fdd05ecd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fdd00133930 0x7fdd00133db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44724/0 (socket says 172.21.15.26:44724) 2023-10-01T08:00:22.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.291+0000 7fdd056cc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd000a0a30 0x7fdd000a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:22.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.291+0000 7fdd05ecd700 1 -- 172.21.15.26:0/3301123650 learned_addr learned my addr 172.21.15.26:0/3301123650 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:22.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.291+0000 7fdd04ecb700 1 --2- 172.21.15.26:0/3301123650 >> v2:172.21.15.26:3300/0 conn(0x7fdd0009d630 0x7fdd000a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:22.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.291+0000 7fdcf7fff700 1 -- 172.21.15.26:0/3301123650 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3508878928 0 0) 0x7fdd000a2a70 con 0x7fdd00133930 2023-10-01T08:00:22.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.291+0000 7fdd056cc700 1 -- 172.21.15.26:0/3301123650 >> v2:172.21.15.26:3300/0 conn(0x7fdd0009d630 msgr2=0x7fdd000a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:22.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.291+0000 7fdd056cc700 1 --2- 172.21.15.26:0/3301123650 >> v2:172.21.15.26:3300/0 conn(0x7fdd0009d630 0x7fdd000a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:22.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.291+0000 7fdd056cc700 1 -- 172.21.15.26:0/3301123650 >> v1:172.21.15.26:6789/0 conn(0x7fdd00133930 legacy=0x7fdd00133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:22.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.291+0000 7fdd056cc700 1 -- 172.21.15.26:0/3301123650 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0009dc50 con 0x7fdd000a0a30 2023-10-01T08:00:22.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.291+0000 7fdd056cc700 1 --2- 172.21.15.26:0/3301123650 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd000a0a30 0x7fdd000a0e00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc009840 tx=0x7fdcfc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70ab3d3d31d7a672 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:22.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.292+0000 7fdcf7fff700 1 -- 172.21.15.26:0/3301123650 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc011830 con 0x7fdd000a0a30 2023-10-01T08:00:22.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.292+0000 7fdcf7fff700 1 -- 172.21.15.26:0/3301123650 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcfc011990 con 0x7fdd000a0a30 2023-10-01T08:00:22.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.292+0000 7fdcf7fff700 1 -- 172.21.15.26:0/3301123650 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc011d20 con 0x7fdd000a0a30 2023-10-01T08:00:22.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.292+0000 7fdd07930700 1 -- 172.21.15.26:0/3301123650 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd000a0a30 msgr2=0x7fdd000a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:22.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.292+0000 7fdd07930700 1 --2- 172.21.15.26:0/3301123650 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd000a0a30 0x7fdd000a0e00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc009840 tx=0x7fdcfc009b50 comp rx=0 tx=0).stop 2023-10-01T08:00:22.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.292+0000 7fdd07930700 1 -- 172.21.15.26:0/3301123650 shutdown_connections 2023-10-01T08:00:22.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.292+0000 7fdd07930700 1 --2- 172.21.15.26:0/3301123650 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd000a0a30 0x7fdd000a0e00 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:22.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.292+0000 7fdd07930700 1 --2- 172.21.15.26:0/3301123650 >> v2:172.21.15.26:3300/0 conn(0x7fdd0009d630 0x7fdd000a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:22.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.292+0000 7fdd07930700 1 -- 172.21.15.26:0/3301123650 >> 172.21.15.26:0/3301123650 conn(0x7fdd000a3050 msgr2=0x7fdd000a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:22.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.292+0000 7fdd07930700 1 -- 172.21.15.26:0/3301123650 shutdown_connections 2023-10-01T08:00:22.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.292+0000 7fdd07930700 1 -- 172.21.15.26:0/3301123650 wait complete. 2023-10-01T08:00:22.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.293+0000 7fdd07930700 1 Processor -- start 2023-10-01T08:00:22.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.293+0000 7fdd07930700 1 -- start start 2023-10-01T08:00:22.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.294+0000 7fdd07930700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd0009d630 0x7fdd001c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:22.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.294+0000 7fdd07930700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd000a0a30 0x7fdd001c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:22.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.294+0000 7fdd07930700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd00133930 0x7fdd001c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:22.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.294+0000 7fdd07930700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd00120a00 con 0x7fdd0009d630 2023-10-01T08:00:22.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.294+0000 7fdd07930700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd00120810 con 0x7fdd00133930 2023-10-01T08:00:22.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.294+0000 7fdd07930700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd001210e0 con 0x7fdd000a0a30 2023-10-01T08:00:22.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.294+0000 7fdd056cc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd0009d630 0x7fdd001c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:22.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.294+0000 7fdd056cc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd0009d630 0x7fdd001c8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49166/0 (socket says 172.21.15.26:49166) 2023-10-01T08:00:22.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.294+0000 7fdd056cc700 1 -- 172.21.15.26:0/3549110702 learned_addr learned my addr 172.21.15.26:0/3549110702 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:22.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.294+0000 7fdd04ecb700 1 --2- 172.21.15.26:0/3549110702 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd000a0a30 0x7fdd001c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:22.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.294+0000 7fdd05ecd700 1 --2- 172.21.15.26:0/3549110702 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd00133930 0x7fdd001c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:22.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.294+0000 7fdd04ecb700 1 -- 172.21.15.26:0/3549110702 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd00133930 msgr2=0x7fdd001c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:22.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.294+0000 7fdd04ecb700 1 --2- 172.21.15.26:0/3549110702 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd00133930 0x7fdd001c8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:22.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.294+0000 7fdd04ecb700 1 -- 172.21.15.26:0/3549110702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd0009d630 msgr2=0x7fdd001c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:22.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.294+0000 7fdd04ecb700 1 --2- 172.21.15.26:0/3549110702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd0009d630 0x7fdd001c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:22.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.294+0000 7fdd04ecb700 1 -- 172.21.15.26:0/3549110702 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcfc0094a0 con 0x7fdd000a0a30 2023-10-01T08:00:22.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.295+0000 7fdd04ecb700 1 --2- 172.21.15.26:0/3549110702 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd000a0a30 0x7fdd001c8770 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fdcf000e8d0 tx=0x7fdcf000ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:22.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.295+0000 7fdcf5ffb700 1 -- 172.21.15.26:0/3549110702 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf0013680 con 0x7fdd000a0a30 2023-10-01T08:00:22.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.295+0000 7fdcf5ffb700 1 -- 172.21.15.26:0/3549110702 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf00137e0 con 0x7fdd000a0a30 2023-10-01T08:00:22.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.295+0000 7fdd07930700 1 -- 172.21.15.26:0/3549110702 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd000a5360 con 0x7fdd000a0a30 2023-10-01T08:00:22.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.295+0000 7fdcf5ffb700 1 -- 172.21.15.26:0/3549110702 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf0013b50 con 0x7fdd000a0a30 2023-10-01T08:00:22.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.295+0000 7fdd07930700 1 -- 172.21.15.26:0/3549110702 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd00122440 con 0x7fdd000a0a30 2023-10-01T08:00:22.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.296+0000 7fdcf5ffb700 1 -- 172.21.15.26:0/3549110702 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdcf0013cb0 con 0x7fdd000a0a30 2023-10-01T08:00:22.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.296+0000 7fdcf5ffb700 1 -- 172.21.15.26:0/3549110702 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdcf003f650 con 0x7fdd000a0a30 2023-10-01T08:00:22.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.297+0000 7fdd07930700 1 -- 172.21.15.26:0/3549110702 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd00122630 con 0x7fdd000a0a30 2023-10-01T08:00:22.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.302+0000 7fdcf5ffb700 1 -- 172.21.15.26:0/3549110702 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdcf001bde0 con 0x7fdd000a0a30 2023-10-01T08:00:22.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.472+0000 7f667d92b700 1 -- 172.21.15.26:0/3313795790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f667806b9e0 con 0x7f6678130540 2023-10-01T08:00:22.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.472+0000 7f665ffff700 1 -- 172.21.15.26:0/3313795790 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6668015020 con 0x7f6678130540 2023-10-01T08:00:22.473 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:22.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.474+0000 7f667d92b700 1 -- 172.21.15.26:0/3313795790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6678130540 msgr2=0x7f6678131320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:22.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.474+0000 7f667d92b700 1 --2- 172.21.15.26:0/3313795790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6678130540 0x7f6678131320 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f6668009c40 tx=0x7f6668004750 comp rx=0 tx=0).stop 2023-10-01T08:00:22.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.474+0000 7f667d92b700 1 -- 172.21.15.26:0/3313795790 shutdown_connections 2023-10-01T08:00:22.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.474+0000 7f667d92b700 1 --2- 172.21.15.26:0/3313795790 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6678136e70 0x7f6678131da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:22.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.474+0000 7f667d92b700 1 --2- 172.21.15.26:0/3313795790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6678130540 0x7f6678131320 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:22.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.474+0000 7f667d92b700 1 --2- 172.21.15.26:0/3313795790 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6678130e50 0x7f6678131860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:22.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.474+0000 7f667d92b700 1 -- 172.21.15.26:0/3313795790 >> 172.21.15.26:0/3313795790 conn(0x7f66780a2aa0 msgr2=0x7f66781366a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:22.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.475+0000 7f667d92b700 1 -- 172.21.15.26:0/3313795790 shutdown_connections 2023-10-01T08:00:22.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.475+0000 7f667d92b700 1 -- 172.21.15.26:0/3313795790 wait complete. 2023-10-01T08:00:22.489 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:22.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.491+0000 7f6f63c89700 1 -- 172.21.15.26:0/2027153111 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6f44005590 con 0x7f6f5c12ff20 2023-10-01T08:00:22.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.492+0000 7f6f527fc700 1 -- 172.21.15.26:0/2027153111 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6f58021020 con 0x7f6f5c12ff20 2023-10-01T08:00:22.492 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:22.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.494+0000 7f6f63c89700 1 -- 172.21.15.26:0/2027153111 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f5c12ff20 msgr2=0x7f6f5c09c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:22.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.494+0000 7f6f63c89700 1 --2- 172.21.15.26:0/2027153111 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f5c12ff20 0x7f6f5c09c040 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f6f5800e940 tx=0x7f6f5800ec50 comp rx=0 tx=0).stop 2023-10-01T08:00:22.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.494+0000 7f6f63c89700 1 -- 172.21.15.26:0/2027153111 shutdown_connections 2023-10-01T08:00:22.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.494+0000 7f6f63c89700 1 --2- 172.21.15.26:0/2027153111 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f5c133a80 0x7f6f5c09cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:22.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.494+0000 7f6f63c89700 1 --2- 172.21.15.26:0/2027153111 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6f5c12ff20 0x7f6f5c09c040 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:22.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.494+0000 7f6f63c89700 1 --2- 172.21.15.26:0/2027153111 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f5c130870 0x7f6f5c09c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:22.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.494+0000 7f6f63c89700 1 -- 172.21.15.26:0/2027153111 >> 172.21.15.26:0/2027153111 conn(0x7f6f5c0a4210 msgr2=0x7f6f5c132bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:22.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.494+0000 7f6f63c89700 1 -- 172.21.15.26:0/2027153111 shutdown_connections 2023-10-01T08:00:22.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.494+0000 7f6f63c89700 1 -- 172.21.15.26:0/2027153111 wait complete. 2023-10-01T08:00:22.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:22.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.526+0000 7fdd07930700 1 -- 172.21.15.26:0/3549110702 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdd000747f0 con 0x7fdd000a0a30 2023-10-01T08:00:22.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.526+0000 7fdcf5ffb700 1 -- 172.21.15.26:0/3549110702 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdcf0021020 con 0x7fdd000a0a30 2023-10-01T08:00:22.527 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:22.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.529+0000 7fdd07930700 1 -- 172.21.15.26:0/3549110702 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd000a0a30 msgr2=0x7fdd001c8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:22.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.529+0000 7fdd07930700 1 --2- 172.21.15.26:0/3549110702 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd000a0a30 0x7fdd001c8770 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fdcf000e8d0 tx=0x7fdcf000ebe0 comp rx=0 tx=0).stop 2023-10-01T08:00:22.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.529+0000 7fdd07930700 1 -- 172.21.15.26:0/3549110702 shutdown_connections 2023-10-01T08:00:22.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.529+0000 7fdd07930700 1 --2- 172.21.15.26:0/3549110702 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd00133930 0x7fdd001c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:22.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.529+0000 7fdd07930700 1 --2- 172.21.15.26:0/3549110702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd0009d630 0x7fdd001c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:22.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.529+0000 7fdd07930700 1 --2- 172.21.15.26:0/3549110702 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdd000a0a30 0x7fdd001c8770 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:22.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.529+0000 7fdd07930700 1 -- 172.21.15.26:0/3549110702 >> 172.21.15.26:0/3549110702 conn(0x7fdd000a3050 msgr2=0x7fdd001bbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:22.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.529+0000 7fdd07930700 1 -- 172.21.15.26:0/3549110702 shutdown_connections 2023-10-01T08:00:22.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:22.529+0000 7fdd07930700 1 -- 172.21.15.26:0/3549110702 wait complete. 2023-10-01T08:00:22.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:23.219 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:23.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.364+0000 7f8774bbf700 1 Processor -- start 2023-10-01T08:00:23.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.364+0000 7f8774bbf700 1 -- start start 2023-10-01T08:00:23.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.365+0000 7f8774bbf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f877009e1d0 0x7f8770138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:23.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.365+0000 7f8774bbf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8770139170 0x7f877013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:23.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.365+0000 7f8774bbf700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f877009b120 con 0x7f877009d6f0 2023-10-01T08:00:23.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.365+0000 7f8774bbf700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877006b460 con 0x7f8770139170 2023-10-01T08:00:23.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.365+0000 7f8774bbf700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f877009a7e0 con 0x7f877009e1d0 2023-10-01T08:00:23.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.365+0000 7f876dd9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f877009e1d0 0x7f8770138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:23.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.365+0000 7f876ed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8770139170 0x7f877013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:23.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.365+0000 7f876e59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f877009d6f0 0x7f877009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44736/0 (socket says 172.21.15.26:44736) 2023-10-01T08:00:23.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.365+0000 7f876ed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8770139170 0x7f877013b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:47352/0 (socket says 172.21.15.26:47352) 2023-10-01T08:00:23.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.365+0000 7f876dd9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f877009e1d0 0x7f8770138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47428/0 (socket says 172.21.15.26:47428) 2023-10-01T08:00:23.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.365+0000 7f876e59c700 1 -- 172.21.15.26:0/3279982715 learned_addr learned my addr 172.21.15.26:0/3279982715 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:23.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.366+0000 7f876d59a700 1 -- 172.21.15.26:0/3279982715 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1042352976 0 0) 0x7f877009b120 con 0x7f877009d6f0 2023-10-01T08:00:23.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.366+0000 7f876dd9b700 1 -- 172.21.15.26:0/3279982715 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8770139170 msgr2=0x7f877013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:23.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.366+0000 7f876dd9b700 1 --2- 172.21.15.26:0/3279982715 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8770139170 0x7f877013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.366+0000 7f876dd9b700 1 -- 172.21.15.26:0/3279982715 >> v1:172.21.15.26:6789/0 conn(0x7f877009d6f0 legacy=0x7f877009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:23.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.366+0000 7f876dd9b700 1 -- 172.21.15.26:0/3279982715 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877009a500 con 0x7f877009e1d0 2023-10-01T08:00:23.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.366+0000 7f876ed9d700 1 --2- 172.21.15.26:0/3279982715 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8770139170 0x7f877013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:23.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.366+0000 7f876dd9b700 1 --2- 172.21.15.26:0/3279982715 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f877009e1d0 0x7f8770138c30 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f87640098a0 tx=0x7f8764009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7fefdc22b92aba6 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:23.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.366+0000 7f876d59a700 1 -- 172.21.15.26:0/3279982715 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8764011830 con 0x7f877009e1d0 2023-10-01T08:00:23.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.366+0000 7f876d59a700 1 -- 172.21.15.26:0/3279982715 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8764011990 con 0x7f877009e1d0 2023-10-01T08:00:23.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.366+0000 7f876d59a700 1 -- 172.21.15.26:0/3279982715 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8764011d20 con 0x7f877009e1d0 2023-10-01T08:00:23.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.367+0000 7f8774bbf700 1 -- 172.21.15.26:0/3279982715 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f877009e1d0 msgr2=0x7f8770138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:23.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.367+0000 7f8774bbf700 1 --2- 172.21.15.26:0/3279982715 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f877009e1d0 0x7f8770138c30 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f87640098a0 tx=0x7f8764009bb0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.367+0000 7f8774bbf700 1 -- 172.21.15.26:0/3279982715 shutdown_connections 2023-10-01T08:00:23.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.367+0000 7f8774bbf700 1 --2- 172.21.15.26:0/3279982715 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8770139170 0x7f877013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.367+0000 7f8774bbf700 1 --2- 172.21.15.26:0/3279982715 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f877009e1d0 0x7f8770138c30 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.367+0000 7f8774bbf700 1 -- 172.21.15.26:0/3279982715 >> 172.21.15.26:0/3279982715 conn(0x7f8770066f50 msgr2=0x7f877009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:23.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.367+0000 7f8774bbf700 1 -- 172.21.15.26:0/3279982715 shutdown_connections 2023-10-01T08:00:23.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.367+0000 7f8774bbf700 1 -- 172.21.15.26:0/3279982715 wait complete. 2023-10-01T08:00:23.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.368+0000 7f8774bbf700 1 Processor -- start 2023-10-01T08:00:23.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.368+0000 7f8774bbf700 1 -- start start 2023-10-01T08:00:23.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.369+0000 7f8774bbf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f877009d6f0 0x7f87701c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:23.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.369+0000 7f8774bbf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f877009e1d0 0x7f87701c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:23.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.369+0000 7f8774bbf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8770139170 0x7f87701c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:23.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.369+0000 7f8774bbf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8770072210 con 0x7f877009d6f0 2023-10-01T08:00:23.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.369+0000 7f8774bbf700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8770120680 con 0x7f8770139170 2023-10-01T08:00:23.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.369+0000 7f8774bbf700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8770121d20 con 0x7f877009e1d0 2023-10-01T08:00:23.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.369+0000 7f876e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f877009d6f0 0x7f87701c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:23.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.369+0000 7f876dd9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f877009e1d0 0x7f87701c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:23.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.369+0000 7f876dd9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f877009e1d0 0x7f87701c89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:47438/0 (socket says 172.21.15.26:47438) 2023-10-01T08:00:23.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.369+0000 7f876e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f877009d6f0 0x7f87701c8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49178/0 (socket says 172.21.15.26:49178) 2023-10-01T08:00:23.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.369+0000 7f876ed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8770139170 0x7f87701c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:23.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.369+0000 7f876dd9b700 1 -- 172.21.15.26:0/1300648436 learned_addr learned my addr 172.21.15.26:0/1300648436 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:23.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.369+0000 7f876dd9b700 1 -- 172.21.15.26:0/1300648436 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8770139170 msgr2=0x7f87701c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:23.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.369+0000 7f876dd9b700 1 --2- 172.21.15.26:0/1300648436 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8770139170 0x7f87701c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.369+0000 7f876dd9b700 1 -- 172.21.15.26:0/1300648436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f877009d6f0 msgr2=0x7f87701c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:23.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.369+0000 7f876dd9b700 1 --2- 172.21.15.26:0/1300648436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f877009d6f0 0x7f87701c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.369+0000 7f876dd9b700 1 -- 172.21.15.26:0/1300648436 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8768009a70 con 0x7f877009e1d0 2023-10-01T08:00:23.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.369+0000 7f876dd9b700 1 --2- 172.21.15.26:0/1300648436 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f877009e1d0 0x7f87701c89a0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f8764000c00 tx=0x7f8764004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:23.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.369+0000 7f875effd700 1 -- 172.21.15.26:0/1300648436 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8764004550 con 0x7f877009e1d0 2023-10-01T08:00:23.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.370+0000 7f875effd700 1 -- 172.21.15.26:0/1300648436 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876401f070 con 0x7f877009e1d0 2023-10-01T08:00:23.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.370+0000 7f8774bbf700 1 -- 172.21.15.26:0/1300648436 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87640094a0 con 0x7f877009e1d0 2023-10-01T08:00:23.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.370+0000 7f875effd700 1 -- 172.21.15.26:0/1300648436 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87640038e0 con 0x7f877009e1d0 2023-10-01T08:00:23.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.370+0000 7f8774bbf700 1 -- 172.21.15.26:0/1300648436 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87701222b0 con 0x7f877009e1d0 2023-10-01T08:00:23.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.370+0000 7f875effd700 1 -- 172.21.15.26:0/1300648436 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8764003a40 con 0x7f877009e1d0 2023-10-01T08:00:23.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.370+0000 7f875effd700 1 -- 172.21.15.26:0/1300648436 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8764021070 con 0x7f877009e1d0 2023-10-01T08:00:23.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.371+0000 7f8774bbf700 1 -- 172.21.15.26:0/1300648436 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87701224d0 con 0x7f877009e1d0 2023-10-01T08:00:23.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.376+0000 7f875effd700 1 -- 172.21.15.26:0/1300648436 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f87701224d0 con 0x7f877009e1d0 2023-10-01T08:00:23.491 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:23.510 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:23.544 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:23.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.581+0000 7f8774bbf700 1 -- 172.21.15.26:0/1300648436 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f87701224d0 con 0x7f877009e1d0 2023-10-01T08:00:23.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.582+0000 7f875effd700 1 -- 172.21.15.26:0/1300648436 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f87701224d0 con 0x7f877009e1d0 2023-10-01T08:00:23.584 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:23.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.586+0000 7f8774bbf700 1 -- 172.21.15.26:0/1300648436 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f877009e1d0 msgr2=0x7f87701c89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:23.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.586+0000 7f8774bbf700 1 --2- 172.21.15.26:0/1300648436 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f877009e1d0 0x7f87701c89a0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f8764000c00 tx=0x7f8764004750 comp rx=0 tx=0).stop 2023-10-01T08:00:23.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.586+0000 7f8774bbf700 1 -- 172.21.15.26:0/1300648436 shutdown_connections 2023-10-01T08:00:23.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.586+0000 7f8774bbf700 1 --2- 172.21.15.26:0/1300648436 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8770139170 0x7f87701c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.586+0000 7f8774bbf700 1 --2- 172.21.15.26:0/1300648436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f877009d6f0 0x7f87701c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.586+0000 7f8774bbf700 1 --2- 172.21.15.26:0/1300648436 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f877009e1d0 0x7f87701c89a0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.586+0000 7f8774bbf700 1 -- 172.21.15.26:0/1300648436 >> 172.21.15.26:0/1300648436 conn(0x7f8770066f50 msgr2=0x7f8770136b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:23.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.586+0000 7f8774bbf700 1 -- 172.21.15.26:0/1300648436 shutdown_connections 2023-10-01T08:00:23.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.586+0000 7f8774bbf700 1 -- 172.21.15.26:0/1300648436 wait complete. 2023-10-01T08:00:23.604 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:23.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.635+0000 7fdab256e700 1 Processor -- start 2023-10-01T08:00:23.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.635+0000 7fdab256e700 1 -- start start 2023-10-01T08:00:23.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.635+0000 7fdab256e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdaac09d6f0 0x7fdaac09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:23.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.635+0000 7fdab256e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdaac09e410 0x7fdaac130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:23.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.635+0000 7fdab256e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaac09f130 con 0x7fdaac09e000 2023-10-01T08:00:23.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.635+0000 7fdab256e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac09f520 con 0x7fdaac09e410 2023-10-01T08:00:23.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.635+0000 7fdab256e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac09e930 con 0x7fdaac09d6f0 2023-10-01T08:00:23.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.636+0000 7fdab0b0b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdaac09e410 0x7fdaac130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:23.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.636+0000 7fdaab7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fdaac09e000 0x7fdaac130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46596/0 (socket says 172.21.15.26:46596) 2023-10-01T08:00:23.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.636+0000 7fdaabfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdaac09d6f0 0x7fdaac09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:23.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.636+0000 7fdaab7fe700 1 -- 172.21.15.26:0/710077062 learned_addr learned my addr 172.21.15.26:0/710077062 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:23.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.636+0000 7fdab0b0b700 1 --2- 172.21.15.26:0/710077062 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdaac09e410 0x7fdaac130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38148/0 (socket says 172.21.15.26:38148) 2023-10-01T08:00:23.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.636+0000 7fdaabfff700 1 -- 172.21.15.26:0/710077062 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdaac09e410 msgr2=0x7fdaac130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:23.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.636+0000 7fdaabfff700 1 --2- 172.21.15.26:0/710077062 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdaac09e410 0x7fdaac130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.636+0000 7fdaabfff700 1 -- 172.21.15.26:0/710077062 >> v1:172.21.15.26:6789/0 conn(0x7fdaac09e000 legacy=0x7fdaac130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:23.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.636+0000 7fdaabfff700 1 -- 172.21.15.26:0/710077062 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaac09b2d0 con 0x7fdaac09d6f0 2023-10-01T08:00:23.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.636+0000 7fdaaaffd700 1 -- 172.21.15.26:0/710077062 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3992389062 0 0) 0x7fdaac09f130 con 0x7fdaac09e000 2023-10-01T08:00:23.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.636+0000 7fdaabfff700 1 --2- 172.21.15.26:0/710077062 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdaac09d6f0 0x7fdaac09dac0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fda9c009870 tx=0x7fda9c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b853c0f3a3f56ccc server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:23.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.636+0000 7fdaaaffd700 1 -- 172.21.15.26:0/710077062 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9c011830 con 0x7fdaac09d6f0 2023-10-01T08:00:23.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.636+0000 7fdaaaffd700 1 -- 172.21.15.26:0/710077062 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9c011990 con 0x7fdaac09d6f0 2023-10-01T08:00:23.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.637+0000 7fdaaaffd700 1 -- 172.21.15.26:0/710077062 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9c011d20 con 0x7fdaac09d6f0 2023-10-01T08:00:23.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.637+0000 7fdab256e700 1 -- 172.21.15.26:0/710077062 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdaac09d6f0 msgr2=0x7fdaac09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:23.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.637+0000 7fdab256e700 1 --2- 172.21.15.26:0/710077062 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdaac09d6f0 0x7fdaac09dac0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fda9c009870 tx=0x7fda9c009b80 comp rx=0 tx=0).stop 2023-10-01T08:00:23.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.637+0000 7fdab256e700 1 -- 172.21.15.26:0/710077062 shutdown_connections 2023-10-01T08:00:23.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.637+0000 7fdab256e700 1 --2- 172.21.15.26:0/710077062 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdaac09d6f0 0x7fdaac09dac0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.637+0000 7fdab256e700 1 --2- 172.21.15.26:0/710077062 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdaac09e410 0x7fdaac130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.637+0000 7fdab256e700 1 -- 172.21.15.26:0/710077062 >> 172.21.15.26:0/710077062 conn(0x7fdaac066f50 msgr2=0x7fdaac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:23.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.637+0000 7fdab256e700 1 -- 172.21.15.26:0/710077062 shutdown_connections 2023-10-01T08:00:23.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.637+0000 7fdab256e700 1 -- 172.21.15.26:0/710077062 wait complete. 2023-10-01T08:00:23.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.639+0000 7fdab256e700 1 Processor -- start 2023-10-01T08:00:23.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.639+0000 7fdab256e700 1 -- start start 2023-10-01T08:00:23.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.640+0000 7fdab256e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdaac09d6f0 0x7fdaac1c2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:23.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.640+0000 7fdab256e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdaac09e000 0x7fdaac1c3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:23.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.640+0000 7fdab256e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdaac09e410 0x7fdaac1c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:23.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.640+0000 7fdab256e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac1338d0 con 0x7fdaac09e000 2023-10-01T08:00:23.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.640+0000 7fdab256e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac1c3850 con 0x7fdaac09d6f0 2023-10-01T08:00:23.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.640+0000 7fdab256e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac0a1e90 con 0x7fdaac09e410 2023-10-01T08:00:23.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.640+0000 7fdaabfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdaac09d6f0 0x7fdaac1c2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:23.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.640+0000 7fdaabfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdaac09d6f0 0x7fdaac1c2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38160/0 (socket says 172.21.15.26:38160) 2023-10-01T08:00:23.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.640+0000 7fdaabfff700 1 -- 172.21.15.26:0/3889200244 learned_addr learned my addr 172.21.15.26:0/3889200244 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:23.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.640+0000 7fdab0b0b700 1 --2- 172.21.15.26:0/3889200244 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdaac09e410 0x7fdaac1c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:23.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.640+0000 7fdaabfff700 1 -- 172.21.15.26:0/3889200244 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdaac09e410 msgr2=0x7fdaac1c5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:23.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.640+0000 7fdaabfff700 1 --2- 172.21.15.26:0/3889200244 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdaac09e410 0x7fdaac1c5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.640+0000 7fdaabfff700 1 -- 172.21.15.26:0/3889200244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdaac09e000 msgr2=0x7fdaac1c3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:23.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.640+0000 7fdaabfff700 1 --2- 172.21.15.26:0/3889200244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdaac09e000 0x7fdaac1c3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.640+0000 7fdaabfff700 1 -- 172.21.15.26:0/3889200244 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c0094a0 con 0x7fdaac09d6f0 2023-10-01T08:00:23.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.640+0000 7fdab0b0b700 1 --2- 172.21.15.26:0/3889200244 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdaac09e410 0x7fdaac1c5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:23.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.641+0000 7fdaabfff700 1 --2- 172.21.15.26:0/3889200244 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdaac09d6f0 0x7fdaac1c2dd0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fda9c000c00 tx=0x7fda9c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:23.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.641+0000 7fdaa8ff9700 1 -- 172.21.15.26:0/3889200244 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9c01a6e0 con 0x7fdaac09d6f0 2023-10-01T08:00:23.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.641+0000 7fdaa8ff9700 1 -- 172.21.15.26:0/3889200244 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9c01a840 con 0x7fdaac09d6f0 2023-10-01T08:00:23.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.641+0000 7fdaa8ff9700 1 -- 172.21.15.26:0/3889200244 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9c01abb0 con 0x7fdaac09d6f0 2023-10-01T08:00:23.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.641+0000 7fdab256e700 1 -- 172.21.15.26:0/3889200244 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaac09c700 con 0x7fdaac09d6f0 2023-10-01T08:00:23.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.641+0000 7fdab256e700 1 -- 172.21.15.26:0/3889200244 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaac132150 con 0x7fdaac09d6f0 2023-10-01T08:00:23.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.642+0000 7fdaa8ff9700 1 -- 172.21.15.26:0/3889200244 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fda9c022070 con 0x7fdaac09d6f0 2023-10-01T08:00:23.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.642+0000 7fdaa8ff9700 1 -- 172.21.15.26:0/3889200244 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fda9c0406c0 con 0x7fdaac09d6f0 2023-10-01T08:00:23.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.643+0000 7fdab256e700 1 -- 172.21.15.26:0/3889200244 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaac074ea0 con 0x7fdaac09d6f0 2023-10-01T08:00:23.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.648+0000 7fdaa8ff9700 1 -- 172.21.15.26:0/3889200244 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fda9c01ad10 con 0x7fdaac09d6f0 2023-10-01T08:00:23.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.680+0000 7fe4b0d45700 1 Processor -- start 2023-10-01T08:00:23.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.680+0000 7fe4b0d45700 1 -- start start 2023-10-01T08:00:23.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.681+0000 7fe4b0d45700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe4ac09d6f0 0x7fe4ac09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:23.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.681+0000 7fe4b0d45700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe4ac09e410 0x7fe4ac130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:23.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.681+0000 7fe4b0d45700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4ac09f130 con 0x7fe4ac09e000 2023-10-01T08:00:23.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.681+0000 7fe4b0d45700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4ac09f520 con 0x7fe4ac09d6f0 2023-10-01T08:00:23.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.681+0000 7fe4b0d45700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac09e930 con 0x7fe4ac09e410 2023-10-01T08:00:23.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.681+0000 7fe4aa59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe4ac09d6f0 0x7fe4ac09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:23.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.681+0000 7fe4aa59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe4ac09d6f0 0x7fe4ac09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47022/0 (socket says 172.21.15.26:47022) 2023-10-01T08:00:23.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.681+0000 7fe4aa59c700 1 -- 172.21.15.26:0/838989092 learned_addr learned my addr 172.21.15.26:0/838989092 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:23.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.681+0000 7fe4aad9d700 1 --2- 172.21.15.26:0/838989092 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe4ac09e410 0x7fe4ac130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:23.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.682+0000 7fe4aa59c700 1 -- 172.21.15.26:0/838989092 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe4ac09e410 msgr2=0x7fe4ac130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:23.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.682+0000 7fe4aa59c700 1 --2- 172.21.15.26:0/838989092 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe4ac09e410 0x7fe4ac130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.682+0000 7fe4aa59c700 1 -- 172.21.15.26:0/838989092 >> v1:172.21.15.26:6789/0 conn(0x7fe4ac09e000 legacy=0x7fe4ac130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:23.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.682+0000 7fe4a959a700 1 -- 172.21.15.26:0/838989092 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2017893486 0 0) 0x7fe4ac09f130 con 0x7fe4ac09e000 2023-10-01T08:00:23.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.682+0000 7fe4aa59c700 1 -- 172.21.15.26:0/838989092 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ac09b2d0 con 0x7fe4ac09d6f0 2023-10-01T08:00:23.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.682+0000 7fe4aa59c700 1 --2- 172.21.15.26:0/838989092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4ac09d6f0 0x7fe4ac09dac0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fe49c00bb90 tx=0x7fe49c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a79a768e7fa27f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:23.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.682+0000 7fe4a959a700 1 -- 172.21.15.26:0/838989092 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c00dd30 con 0x7fe4ac09d6f0 2023-10-01T08:00:23.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.682+0000 7fe4a959a700 1 -- 172.21.15.26:0/838989092 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49c00de90 con 0x7fe4ac09d6f0 2023-10-01T08:00:23.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.682+0000 7fe4a959a700 1 -- 172.21.15.26:0/838989092 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c010690 con 0x7fe4ac09d6f0 2023-10-01T08:00:23.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.683+0000 7fe4b0d45700 1 -- 172.21.15.26:0/838989092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4ac09d6f0 msgr2=0x7fe4ac09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:23.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.683+0000 7fe4b0d45700 1 --2- 172.21.15.26:0/838989092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4ac09d6f0 0x7fe4ac09dac0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fe49c00bb90 tx=0x7fe49c00bea0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.683+0000 7fe4b0d45700 1 -- 172.21.15.26:0/838989092 shutdown_connections 2023-10-01T08:00:23.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.683+0000 7fe4b0d45700 1 --2- 172.21.15.26:0/838989092 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe4ac09e410 0x7fe4ac130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.683+0000 7fe4b0d45700 1 --2- 172.21.15.26:0/838989092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4ac09d6f0 0x7fe4ac09dac0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.683+0000 7fe4b0d45700 1 -- 172.21.15.26:0/838989092 >> 172.21.15.26:0/838989092 conn(0x7fe4ac066f50 msgr2=0x7fe4ac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:23.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.683+0000 7fe4b0d45700 1 -- 172.21.15.26:0/838989092 shutdown_connections 2023-10-01T08:00:23.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.683+0000 7fe4b0d45700 1 -- 172.21.15.26:0/838989092 wait complete. 2023-10-01T08:00:23.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.684+0000 7fe4b0d45700 1 Processor -- start 2023-10-01T08:00:23.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.685+0000 7fe4b0d45700 1 -- start start 2023-10-01T08:00:23.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.685+0000 7fe4b0d45700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe4ac09d6f0 0x7fe4ac11dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:23.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.685+0000 7fe4b0d45700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe4ac09e000 0x7fe4ac11e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:23.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.685+0000 7fe4b0d45700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4ac09e410 0x7fe4ac11e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:23.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.685+0000 7fe4b0d45700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac1221e0 con 0x7fe4ac09e410 2023-10-01T08:00:23.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.685+0000 7fe4b0d45700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac121820 con 0x7fe4ac09d6f0 2023-10-01T08:00:23.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.685+0000 7fe4b0d45700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac120b60 con 0x7fe4ac09e000 2023-10-01T08:00:23.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.685+0000 7fe4aa59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe4ac09d6f0 0x7fe4ac11dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:23.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.685+0000 7fe4a9d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe4ac09e000 0x7fe4ac11e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:23.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.685+0000 7fe4aa59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe4ac09d6f0 0x7fe4ac11dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38166/0 (socket says 172.21.15.26:38166) 2023-10-01T08:00:23.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.685+0000 7fe4aa59c700 1 -- 172.21.15.26:0/1385441443 learned_addr learned my addr 172.21.15.26:0/1385441443 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:23.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.685+0000 7fe4aad9d700 1 --2- 172.21.15.26:0/1385441443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4ac09e410 0x7fe4ac11e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:23.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.686+0000 7fe4aad9d700 1 -- 172.21.15.26:0/1385441443 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe4ac09e000 msgr2=0x7fe4ac11e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:23.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.686+0000 7fe4aad9d700 1 --2- 172.21.15.26:0/1385441443 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe4ac09e000 0x7fe4ac11e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.686+0000 7fe4aad9d700 1 -- 172.21.15.26:0/1385441443 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe4ac09d6f0 msgr2=0x7fe4ac11dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:23.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.686+0000 7fe4aad9d700 1 --2- 172.21.15.26:0/1385441443 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe4ac09d6f0 0x7fe4ac11dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.686+0000 7fe4aad9d700 1 -- 172.21.15.26:0/1385441443 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c00b7f0 con 0x7fe4ac09e410 2023-10-01T08:00:23.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.686+0000 7fe4aad9d700 1 --2- 172.21.15.26:0/1385441443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4ac09e410 0x7fe4ac11e780 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fe4a400efc0 tx=0x7fe4a400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:23.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.686+0000 7fe49affd700 1 -- 172.21.15.26:0/1385441443 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a400cc90 con 0x7fe4ac09e410 2023-10-01T08:00:23.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.686+0000 7fe49affd700 1 -- 172.21.15.26:0/1385441443 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a400f040 con 0x7fe4ac09e410 2023-10-01T08:00:23.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.686+0000 7fe4b0d45700 1 -- 172.21.15.26:0/1385441443 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4ac0a3c20 con 0x7fe4ac09e410 2023-10-01T08:00:23.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.686+0000 7fe49affd700 1 -- 172.21.15.26:0/1385441443 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a4013800 con 0x7fe4ac09e410 2023-10-01T08:00:23.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.686+0000 7fe4b0d45700 1 -- 172.21.15.26:0/1385441443 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4ac09c750 con 0x7fe4ac09e410 2023-10-01T08:00:23.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.687+0000 7fe4b0d45700 1 -- 172.21.15.26:0/1385441443 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4ac11ac20 con 0x7fe4ac09e410 2023-10-01T08:00:23.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.688+0000 7fe49affd700 1 -- 172.21.15.26:0/1385441443 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe4a4013960 con 0x7fe4ac09e410 2023-10-01T08:00:23.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.688+0000 7fe49affd700 1 -- 172.21.15.26:0/1385441443 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe4a4043b40 con 0x7fe4ac09e410 2023-10-01T08:00:23.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.693+0000 7fe49affd700 1 -- 172.21.15.26:0/1385441443 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe4a4013c10 con 0x7fe4ac09e410 2023-10-01T08:00:23.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.723+0000 7f70653d6700 1 Processor -- start 2023-10-01T08:00:23.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.723+0000 7f70653d6700 1 -- start start 2023-10-01T08:00:23.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.724+0000 7f70653d6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7060130540 0x7f7060130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:23.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.724+0000 7f70653d6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7060130e50 0x7f706006f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:23.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.724+0000 7f70653d6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f706006fb20 0x7f706006ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:23.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.724+0000 7f70653d6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70600704b0 con 0x7f7060130e50 2023-10-01T08:00:23.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.724+0000 7f70653d6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f706009a390 con 0x7f706006fb20 2023-10-01T08:00:23.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.724+0000 7f70653d6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70600716a0 con 0x7f7060130540 2023-10-01T08:00:23.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.724+0000 7f705effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7060130540 0x7f7060130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:23.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.724+0000 7f705effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7060130540 0x7f7060130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:34006/0 (socket says 172.21.15.26:34006) 2023-10-01T08:00:23.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.724+0000 7f705effd700 1 -- 172.21.15.26:0/4239316136 learned_addr learned my addr 172.21.15.26:0/4239316136 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:23.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.724+0000 7f705f7fe700 1 --2- 172.21.15.26:0/4239316136 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f706006fb20 0x7f706006ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:23.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.724+0000 7f705e7fc700 1 --2- 172.21.15.26:0/4239316136 >> v2:172.21.15.26:3300/0 conn(0x7f7060130e50 0x7f706006f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:23.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.724+0000 7f705effd700 1 -- 172.21.15.26:0/4239316136 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f706006fb20 msgr2=0x7f706006ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:23.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.724+0000 7f705effd700 1 --2- 172.21.15.26:0/4239316136 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f706006fb20 0x7f706006ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.724+0000 7f705effd700 1 -- 172.21.15.26:0/4239316136 >> v2:172.21.15.26:3300/0 conn(0x7f7060130e50 msgr2=0x7f706006f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:23.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.724+0000 7f705effd700 1 --2- 172.21.15.26:0/4239316136 >> v2:172.21.15.26:3300/0 conn(0x7f7060130e50 0x7f706006f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.724+0000 7f705effd700 1 -- 172.21.15.26:0/4239316136 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7060071290 con 0x7f7060130540 2023-10-01T08:00:23.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.725+0000 7f705effd700 1 --2- 172.21.15.26:0/4239316136 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7060130540 0x7f7060130910 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f7050009920 tx=0x7f7050009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcd855274a1ea2d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:23.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.725+0000 7f705dffb700 1 -- 172.21.15.26:0/4239316136 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7050011830 con 0x7f7060130540 2023-10-01T08:00:23.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.725+0000 7f705dffb700 1 -- 172.21.15.26:0/4239316136 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7050011990 con 0x7f7060130540 2023-10-01T08:00:23.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.725+0000 7f705dffb700 1 -- 172.21.15.26:0/4239316136 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7050011d20 con 0x7f7060130540 2023-10-01T08:00:23.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.726+0000 7f70653d6700 1 -- 172.21.15.26:0/4239316136 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7060130540 msgr2=0x7f7060130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:23.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.726+0000 7f70653d6700 1 --2- 172.21.15.26:0/4239316136 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7060130540 0x7f7060130910 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f7050009920 tx=0x7f7050009c30 comp rx=0 tx=0).stop 2023-10-01T08:00:23.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.726+0000 7f70653d6700 1 -- 172.21.15.26:0/4239316136 shutdown_connections 2023-10-01T08:00:23.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.726+0000 7f70653d6700 1 --2- 172.21.15.26:0/4239316136 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f706006fb20 0x7f706006ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.726+0000 7f70653d6700 1 --2- 172.21.15.26:0/4239316136 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7060130540 0x7f7060130910 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.726+0000 7f70653d6700 1 --2- 172.21.15.26:0/4239316136 >> v2:172.21.15.26:3300/0 conn(0x7f7060130e50 0x7f706006f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.726+0000 7f70653d6700 1 -- 172.21.15.26:0/4239316136 >> 172.21.15.26:0/4239316136 conn(0x7f70600a2aa0 msgr2=0x7f70600a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:23.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.726+0000 7f70653d6700 1 -- 172.21.15.26:0/4239316136 shutdown_connections 2023-10-01T08:00:23.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.726+0000 7f70653d6700 1 -- 172.21.15.26:0/4239316136 wait complete. 2023-10-01T08:00:23.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.727+0000 7f70653d6700 1 Processor -- start 2023-10-01T08:00:23.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.727+0000 7f70653d6700 1 -- start start 2023-10-01T08:00:23.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.727+0000 7f70653d6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f706006fb20 0x7f7060118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:23.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.728+0000 7f70653d6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7060130540 0x7f7060119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:23.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.728+0000 7f70653d6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7060130e50 0x7f7060119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:23.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.728+0000 7f70653d6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706011a390 con 0x7f7060130e50 2023-10-01T08:00:23.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.728+0000 7f70653d6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f706011a1a0 con 0x7f706006fb20 2023-10-01T08:00:23.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.728+0000 7f70653d6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70600a0c00 con 0x7f7060130540 2023-10-01T08:00:23.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.728+0000 7f705effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f706006fb20 0x7f7060118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:23.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.728+0000 7f705f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7060130e50 0x7f7060119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:23.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.728+0000 7f705effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f706006fb20 0x7f7060118cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38188/0 (socket says 172.21.15.26:38188) 2023-10-01T08:00:23.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.728+0000 7f705f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7060130e50 0x7f7060119750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47032/0 (socket says 172.21.15.26:47032) 2023-10-01T08:00:23.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.728+0000 7f705effd700 1 -- 172.21.15.26:0/1883953929 learned_addr learned my addr 172.21.15.26:0/1883953929 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:23.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.728+0000 7f705e7fc700 1 --2- 172.21.15.26:0/1883953929 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7060130540 0x7f7060119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:23.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.728+0000 7f705e7fc700 1 -- 172.21.15.26:0/1883953929 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f706006fb20 msgr2=0x7f7060118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:23.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.728+0000 7f705e7fc700 1 --2- 172.21.15.26:0/1883953929 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f706006fb20 0x7f7060118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.728+0000 7f705e7fc700 1 -- 172.21.15.26:0/1883953929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7060130e50 msgr2=0x7f7060119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:23.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.728+0000 7f705e7fc700 1 --2- 172.21.15.26:0/1883953929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7060130e50 0x7f7060119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.728+0000 7f705e7fc700 1 -- 172.21.15.26:0/1883953929 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7050009550 con 0x7f7060130540 2023-10-01T08:00:23.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.728+0000 7f705e7fc700 1 --2- 172.21.15.26:0/1883953929 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7060130540 0x7f7060119210 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f705400e900 tx=0x7f705400ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:23.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.729+0000 7f70477fe700 1 -- 172.21.15.26:0/1883953929 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7054013680 con 0x7f7060130540 2023-10-01T08:00:23.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.729+0000 7f70477fe700 1 -- 172.21.15.26:0/1883953929 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70540137e0 con 0x7f7060130540 2023-10-01T08:00:23.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.729+0000 7f70653d6700 1 -- 172.21.15.26:0/1883953929 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70600718e0 con 0x7f7060130540 2023-10-01T08:00:23.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.729+0000 7f70477fe700 1 -- 172.21.15.26:0/1883953929 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7054013b50 con 0x7f7060130540 2023-10-01T08:00:23.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.729+0000 7f70653d6700 1 -- 172.21.15.26:0/1883953929 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f706012b880 con 0x7f7060130540 2023-10-01T08:00:23.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.730+0000 7f70653d6700 1 -- 172.21.15.26:0/1883953929 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f706011ba70 con 0x7f7060130540 2023-10-01T08:00:23.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.730+0000 7f70477fe700 1 -- 172.21.15.26:0/1883953929 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7054013cb0 con 0x7f7060130540 2023-10-01T08:00:23.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.730+0000 7f70477fe700 1 -- 172.21.15.26:0/1883953929 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f705403f5c0 con 0x7f7060130540 2023-10-01T08:00:23.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.735+0000 7f70477fe700 1 -- 172.21.15.26:0/1883953929 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f705401bbf0 con 0x7f7060130540 2023-10-01T08:00:23.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.856+0000 7fdab256e700 1 -- 172.21.15.26:0/3889200244 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdaac133210 con 0x7fdaac09d6f0 2023-10-01T08:00:23.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.857+0000 7fdaa8ff9700 1 -- 172.21.15.26:0/3889200244 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fda9c029030 con 0x7fdaac09d6f0 2023-10-01T08:00:23.869 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:23.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.859+0000 7fdab256e700 1 -- 172.21.15.26:0/3889200244 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdaac09d6f0 msgr2=0x7fdaac1c2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:23.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.859+0000 7fdab256e700 1 --2- 172.21.15.26:0/3889200244 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdaac09d6f0 0x7fdaac1c2dd0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fda9c000c00 tx=0x7fda9c004750 comp rx=0 tx=0).stop 2023-10-01T08:00:23.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.859+0000 7fdab256e700 1 -- 172.21.15.26:0/3889200244 shutdown_connections 2023-10-01T08:00:23.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.859+0000 7fdab256e700 1 --2- 172.21.15.26:0/3889200244 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdaac09e410 0x7fdaac1c5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.859+0000 7fdab256e700 1 --2- 172.21.15.26:0/3889200244 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdaac09d6f0 0x7fdaac1c2dd0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.859+0000 7fdab256e700 1 --2- 172.21.15.26:0/3889200244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdaac09e000 0x7fdaac1c3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.859+0000 7fdab256e700 1 -- 172.21.15.26:0/3889200244 >> 172.21.15.26:0/3889200244 conn(0x7fdaac066f50 msgr2=0x7fdaac070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:23.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.859+0000 7fdab256e700 1 -- 172.21.15.26:0/3889200244 shutdown_connections 2023-10-01T08:00:23.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.859+0000 7fdab256e700 1 -- 172.21.15.26:0/3889200244 wait complete. 2023-10-01T08:00:23.873 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:23.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.899+0000 7fe4b0d45700 1 -- 172.21.15.26:0/1385441443 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe4ac1213c0 con 0x7fe4ac09e410 2023-10-01T08:00:23.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.900+0000 7fe49affd700 1 -- 172.21.15.26:0/1385441443 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe4a4020020 con 0x7fe4ac09e410 2023-10-01T08:00:23.900 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:23.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.902+0000 7fe4b0d45700 1 -- 172.21.15.26:0/1385441443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4ac09e410 msgr2=0x7fe4ac11e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:23.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.902+0000 7fe4b0d45700 1 --2- 172.21.15.26:0/1385441443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4ac09e410 0x7fe4ac11e780 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fe4a400efc0 tx=0x7fe4a400c3a0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.902+0000 7fe4b0d45700 1 -- 172.21.15.26:0/1385441443 shutdown_connections 2023-10-01T08:00:23.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.902+0000 7fe4b0d45700 1 --2- 172.21.15.26:0/1385441443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4ac09e410 0x7fe4ac11e780 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.902+0000 7fe4b0d45700 1 --2- 172.21.15.26:0/1385441443 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe4ac09d6f0 0x7fe4ac11dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.902+0000 7fe4b0d45700 1 --2- 172.21.15.26:0/1385441443 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe4ac09e000 0x7fe4ac11e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.902+0000 7fe4b0d45700 1 -- 172.21.15.26:0/1385441443 >> 172.21.15.26:0/1385441443 conn(0x7fe4ac066f50 msgr2=0x7fe4ac130ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:23.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.902+0000 7fe4b0d45700 1 -- 172.21.15.26:0/1385441443 shutdown_connections 2023-10-01T08:00:23.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.902+0000 7fe4b0d45700 1 -- 172.21.15.26:0/1385441443 wait complete. 2023-10-01T08:00:23.916 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:23.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.942+0000 7f70653d6700 1 -- 172.21.15.26:0/1883953929 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7060074ea0 con 0x7f7060130540 2023-10-01T08:00:23.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.942+0000 7f70477fe700 1 -- 172.21.15.26:0/1883953929 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7054017070 con 0x7f7060130540 2023-10-01T08:00:23.943 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:23.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.945+0000 7f70653d6700 1 -- 172.21.15.26:0/1883953929 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7060130540 msgr2=0x7f7060119210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:23.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.945+0000 7f70653d6700 1 --2- 172.21.15.26:0/1883953929 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7060130540 0x7f7060119210 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f705400e900 tx=0x7f705400ec10 comp rx=0 tx=0).stop 2023-10-01T08:00:23.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.945+0000 7f70653d6700 1 -- 172.21.15.26:0/1883953929 shutdown_connections 2023-10-01T08:00:23.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.945+0000 7f70653d6700 1 --2- 172.21.15.26:0/1883953929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7060130e50 0x7f7060119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.945+0000 7f70653d6700 1 --2- 172.21.15.26:0/1883953929 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f706006fb20 0x7f7060118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.945+0000 7f70653d6700 1 --2- 172.21.15.26:0/1883953929 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7060130540 0x7f7060119210 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:23.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.945+0000 7f70653d6700 1 -- 172.21.15.26:0/1883953929 >> 172.21.15.26:0/1883953929 conn(0x7f70600a2aa0 msgr2=0x7f706012d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:23.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.945+0000 7f70653d6700 1 -- 172.21.15.26:0/1883953929 shutdown_connections 2023-10-01T08:00:23.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:23.945+0000 7f70653d6700 1 -- 172.21.15.26:0/1883953929 wait complete. 2023-10-01T08:00:23.959 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:24.605 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:24.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.751+0000 7fd87dd09700 1 Processor -- start 2023-10-01T08:00:24.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.751+0000 7fd87dd09700 1 -- start start 2023-10-01T08:00:24.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.751+0000 7fd87dd09700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd87809e930 0x7fd87809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:24.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.751+0000 7fd87dd09700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd87809f240 0x7fd8781317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:24.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.751+0000 7fd87dd09700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd878070940 con 0x7fd87809f650 2023-10-01T08:00:24.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.752+0000 7fd87dd09700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd87806fd60 con 0x7fd87809f240 2023-10-01T08:00:24.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.752+0000 7fd87dd09700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87806fa80 con 0x7fd87809e930 2023-10-01T08:00:24.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.752+0000 7fd876ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd87809f240 0x7fd8781317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:24.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.752+0000 7fd8777fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd87809e930 0x7fd87809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:24.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.752+0000 7fd876ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd87809f240 0x7fd8781317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47046/0 (socket says 172.21.15.26:47046) 2023-10-01T08:00:24.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.752+0000 7fd876ffd700 1 -- 172.21.15.26:0/3189294363 learned_addr learned my addr 172.21.15.26:0/3189294363 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:24.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.752+0000 7fd8777fe700 1 -- 172.21.15.26:0/3189294363 >> v2:172.21.15.26:3300/0 conn(0x7fd87809f240 msgr2=0x7fd8781317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:24.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.752+0000 7fd8777fe700 1 --2- 172.21.15.26:0/3189294363 >> v2:172.21.15.26:3300/0 conn(0x7fd87809f240 0x7fd8781317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:24.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.752+0000 7fd8777fe700 1 -- 172.21.15.26:0/3189294363 >> v1:172.21.15.26:6789/0 conn(0x7fd87809f650 legacy=0x7fd878131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:24.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.752+0000 7fd8777fe700 1 -- 172.21.15.26:0/3189294363 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd87809fb60 con 0x7fd87809e930 2023-10-01T08:00:24.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.752+0000 7fd876ffd700 1 --2- 172.21.15.26:0/3189294363 >> v2:172.21.15.26:3300/0 conn(0x7fd87809f240 0x7fd8781317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:24.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.752+0000 7fd8777fe700 1 --2- 172.21.15.26:0/3189294363 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd87809e930 0x7fd87809ed00 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fd868009840 tx=0x7fd868009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=891de6c9efc06c95 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:24.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.752+0000 7fd8767fc700 1 -- 172.21.15.26:0/3189294363 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd868011830 con 0x7fd87809e930 2023-10-01T08:00:24.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.752+0000 7fd8767fc700 1 -- 172.21.15.26:0/3189294363 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd868011990 con 0x7fd87809e930 2023-10-01T08:00:24.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.752+0000 7fd8767fc700 1 -- 172.21.15.26:0/3189294363 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd868011d20 con 0x7fd87809e930 2023-10-01T08:00:24.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.753+0000 7fd87dd09700 1 -- 172.21.15.26:0/3189294363 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd87809e930 msgr2=0x7fd87809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:24.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.753+0000 7fd87dd09700 1 --2- 172.21.15.26:0/3189294363 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd87809e930 0x7fd87809ed00 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fd868009840 tx=0x7fd868009b50 comp rx=0 tx=0).stop 2023-10-01T08:00:24.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.753+0000 7fd87dd09700 1 -- 172.21.15.26:0/3189294363 shutdown_connections 2023-10-01T08:00:24.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.753+0000 7fd87dd09700 1 --2- 172.21.15.26:0/3189294363 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd87809e930 0x7fd87809ed00 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:24.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.753+0000 7fd87dd09700 1 --2- 172.21.15.26:0/3189294363 >> v2:172.21.15.26:3300/0 conn(0x7fd87809f240 0x7fd8781317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:24.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.753+0000 7fd87dd09700 1 -- 172.21.15.26:0/3189294363 >> 172.21.15.26:0/3189294363 conn(0x7fd8780a4210 msgr2=0x7fd8780a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:24.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.753+0000 7fd87dd09700 1 -- 172.21.15.26:0/3189294363 shutdown_connections 2023-10-01T08:00:24.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.753+0000 7fd87dd09700 1 -- 172.21.15.26:0/3189294363 wait complete. 2023-10-01T08:00:24.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.754+0000 7fd87dd09700 1 Processor -- start 2023-10-01T08:00:24.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.754+0000 7fd87dd09700 1 -- start start 2023-10-01T08:00:24.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.755+0000 7fd87dd09700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd87809e930 0x7fd8781a3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:24.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.755+0000 7fd87dd09700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd87809f240 0x7fd8781a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:24.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.755+0000 7fd87dd09700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd87809f650 0x7fd8781a4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:24.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.755+0000 7fd87dd09700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8781a51b0 con 0x7fd87809e930 2023-10-01T08:00:24.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.755+0000 7fd87dd09700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8781a5910 con 0x7fd87809f650 2023-10-01T08:00:24.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.755+0000 7fd87dd09700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8781a6b60 con 0x7fd87809f240 2023-10-01T08:00:24.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.755+0000 7fd8777fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd87809e930 0x7fd8781a3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:24.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.755+0000 7fd8777fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd87809e930 0x7fd8781a3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47050/0 (socket says 172.21.15.26:47050) 2023-10-01T08:00:24.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.755+0000 7fd8777fe700 1 -- 172.21.15.26:0/468597283 learned_addr learned my addr 172.21.15.26:0/468597283 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:24.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.755+0000 7fd876ffd700 1 --2- 172.21.15.26:0/468597283 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd87809f240 0x7fd8781a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:24.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.755+0000 7fd877fff700 1 --2- 172.21.15.26:0/468597283 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd87809f650 0x7fd8781a4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:24.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.755+0000 7fd876ffd700 1 -- 172.21.15.26:0/468597283 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd87809f650 msgr2=0x7fd8781a4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:24.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.755+0000 7fd876ffd700 1 --2- 172.21.15.26:0/468597283 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd87809f650 0x7fd8781a4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:24.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.755+0000 7fd876ffd700 1 -- 172.21.15.26:0/468597283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd87809e930 msgr2=0x7fd8781a3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:24.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.755+0000 7fd876ffd700 1 --2- 172.21.15.26:0/468597283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd87809e930 0x7fd8781a3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:24.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.755+0000 7fd876ffd700 1 -- 172.21.15.26:0/468597283 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd860009550 con 0x7fd87809f240 2023-10-01T08:00:24.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.755+0000 7fd8777fe700 1 --2- 172.21.15.26:0/468597283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd87809e930 0x7fd8781a3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:24.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.755+0000 7fd876ffd700 1 --2- 172.21.15.26:0/468597283 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd87809f240 0x7fd8781a4240 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd86000e9a0 tx=0x7fd86000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:24.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.756+0000 7fd86ffff700 1 -- 172.21.15.26:0/468597283 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd860004240 con 0x7fd87809f240 2023-10-01T08:00:24.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.756+0000 7fd86ffff700 1 -- 172.21.15.26:0/468597283 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8600043a0 con 0x7fd87809f240 2023-10-01T08:00:24.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.756+0000 7fd86ffff700 1 -- 172.21.15.26:0/468597283 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8600036a0 con 0x7fd87809f240 2023-10-01T08:00:24.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.756+0000 7fd87dd09700 1 -- 172.21.15.26:0/468597283 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8680094a0 con 0x7fd87809f240 2023-10-01T08:00:24.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.756+0000 7fd87dd09700 1 -- 172.21.15.26:0/468597283 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8780a0190 con 0x7fd87809f240 2023-10-01T08:00:24.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.756+0000 7fd86ffff700 1 -- 172.21.15.26:0/468597283 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd860003800 con 0x7fd87809f240 2023-10-01T08:00:24.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.757+0000 7fd86ffff700 1 -- 172.21.15.26:0/468597283 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd86003f7c0 con 0x7fd87809f240 2023-10-01T08:00:24.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.757+0000 7fd87dd09700 1 -- 172.21.15.26:0/468597283 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8781a0b30 con 0x7fd87809f240 2023-10-01T08:00:24.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.762+0000 7fd86ffff700 1 -- 172.21.15.26:0/468597283 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd860013470 con 0x7fd87809f240 2023-10-01T08:00:24.874 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:24.917 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:24.960 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:24.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.979+0000 7fd87dd09700 1 -- 172.21.15.26:0/468597283 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd8780a34c0 con 0x7fd87809f240 2023-10-01T08:00:24.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.979+0000 7fd86ffff700 1 -- 172.21.15.26:0/468597283 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd860029070 con 0x7fd87809f240 2023-10-01T08:00:24.981 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:24.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.982+0000 7fd87dd09700 1 -- 172.21.15.26:0/468597283 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd87809f240 msgr2=0x7fd8781a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:24.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.982+0000 7fd87dd09700 1 --2- 172.21.15.26:0/468597283 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd87809f240 0x7fd8781a4240 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd86000e9a0 tx=0x7fd86000ecb0 comp rx=0 tx=0).stop 2023-10-01T08:00:24.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.982+0000 7fd87dd09700 1 -- 172.21.15.26:0/468597283 shutdown_connections 2023-10-01T08:00:24.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.982+0000 7fd87dd09700 1 --2- 172.21.15.26:0/468597283 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd87809f650 0x7fd8781a4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:24.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.982+0000 7fd87dd09700 1 --2- 172.21.15.26:0/468597283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd87809e930 0x7fd8781a3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:24.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.982+0000 7fd87dd09700 1 --2- 172.21.15.26:0/468597283 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd87809f240 0x7fd8781a4240 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:24.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.982+0000 7fd87dd09700 1 -- 172.21.15.26:0/468597283 >> 172.21.15.26:0/468597283 conn(0x7fd8780a4210 msgr2=0x7fd8781b8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:24.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.982+0000 7fd87dd09700 1 -- 172.21.15.26:0/468597283 shutdown_connections 2023-10-01T08:00:24.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:24.982+0000 7fd87dd09700 1 -- 172.21.15.26:0/468597283 wait complete. 2023-10-01T08:00:25.001 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:25.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.018+0000 7fdc5c979700 1 Processor -- start 2023-10-01T08:00:25.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.019+0000 7fdc5c979700 1 -- start start 2023-10-01T08:00:25.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.020+0000 7fdc5c979700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc5809d6f0 0x7fdc5809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:25.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.020+0000 7fdc5c979700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdc5809e410 0x7fdc58134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:25.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.020+0000 7fdc5c979700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc5809b120 con 0x7fdc5809e000 2023-10-01T08:00:25.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.020+0000 7fdc5c979700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc5806b460 con 0x7fdc5809e410 2023-10-01T08:00:25.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.020+0000 7fdc5c979700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5809a7e0 con 0x7fdc5809d6f0 2023-10-01T08:00:25.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.020+0000 7fdc5659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc5809d6f0 0x7fdc5809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:25.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.020+0000 7fdc56d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdc5809e410 0x7fdc58134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:25.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.020+0000 7fdc55d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fdc5809e000 0x7fdc581339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46630/0 (socket says 172.21.15.26:46630) 2023-10-01T08:00:25.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.020+0000 7fdc55d9b700 1 -- 172.21.15.26:0/1328508562 learned_addr learned my addr 172.21.15.26:0/1328508562 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:25.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.020+0000 7fdc5659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc5809d6f0 0x7fdc5809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38214/0 (socket says 172.21.15.26:38214) 2023-10-01T08:00:25.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.020+0000 7fdc56d9d700 1 -- 172.21.15.26:0/1328508562 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc5809d6f0 msgr2=0x7fdc5809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:25.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.020+0000 7fdc56d9d700 1 --2- 172.21.15.26:0/1328508562 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc5809d6f0 0x7fdc5809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:25.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.020+0000 7fdc56d9d700 1 -- 172.21.15.26:0/1328508562 >> v1:172.21.15.26:6789/0 conn(0x7fdc5809e000 legacy=0x7fdc581339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:25.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.020+0000 7fdc5559a700 1 -- 172.21.15.26:0/1328508562 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3290695523 0 0) 0x7fdc5809b120 con 0x7fdc5809e000 2023-10-01T08:00:25.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.020+0000 7fdc56d9d700 1 -- 172.21.15.26:0/1328508562 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc5809a500 con 0x7fdc5809e410 2023-10-01T08:00:25.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.021+0000 7fdc56d9d700 1 --2- 172.21.15.26:0/1328508562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc5809e410 0x7fdc58134100 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fdc50009d90 tx=0x7fdc5000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d381be5407e969b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:25.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.021+0000 7fdc5559a700 1 -- 172.21.15.26:0/1328508562 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5000e070 con 0x7fdc5809e410 2023-10-01T08:00:25.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.021+0000 7fdc5559a700 1 -- 172.21.15.26:0/1328508562 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5000bb20 con 0x7fdc5809e410 2023-10-01T08:00:25.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.021+0000 7fdc5559a700 1 -- 172.21.15.26:0/1328508562 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc50012430 con 0x7fdc5809e410 2023-10-01T08:00:25.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.021+0000 7fdc5c979700 1 -- 172.21.15.26:0/1328508562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc5809e410 msgr2=0x7fdc58134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:25.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.021+0000 7fdc5c979700 1 --2- 172.21.15.26:0/1328508562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc5809e410 0x7fdc58134100 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fdc50009d90 tx=0x7fdc5000b330 comp rx=0 tx=0).stop 2023-10-01T08:00:25.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.022+0000 7fdc5c979700 1 -- 172.21.15.26:0/1328508562 shutdown_connections 2023-10-01T08:00:25.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.022+0000 7fdc5c979700 1 --2- 172.21.15.26:0/1328508562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc5809e410 0x7fdc58134100 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:25.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.022+0000 7fdc5c979700 1 --2- 172.21.15.26:0/1328508562 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc5809d6f0 0x7fdc5809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:25.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.022+0000 7fdc5c979700 1 -- 172.21.15.26:0/1328508562 >> 172.21.15.26:0/1328508562 conn(0x7fdc58066f50 msgr2=0x7fdc5809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:25.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.022+0000 7fdc5c979700 1 -- 172.21.15.26:0/1328508562 shutdown_connections 2023-10-01T08:00:25.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.022+0000 7fdc5c979700 1 -- 172.21.15.26:0/1328508562 wait complete. 2023-10-01T08:00:25.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.023+0000 7fdc5c979700 1 Processor -- start 2023-10-01T08:00:25.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.023+0000 7fdc5c979700 1 -- start start 2023-10-01T08:00:25.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.024+0000 7fdc5c979700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc5809d6f0 0x7fdc581a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:25.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.024+0000 7fdc5c979700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdc5809e000 0x7fdc581a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:25.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.024+0000 7fdc5c979700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc5809e410 0x7fdc581c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:25.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.024+0000 7fdc5c979700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc581a8120 con 0x7fdc5809e410 2023-10-01T08:00:25.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.024+0000 7fdc5c979700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc581a8300 con 0x7fdc5809d6f0 2023-10-01T08:00:25.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.024+0000 7fdc5c979700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc581b9170 con 0x7fdc5809e000 2023-10-01T08:00:25.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.024+0000 7fdc56d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc5809e410 0x7fdc581c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:25.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.024+0000 7fdc5659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc5809d6f0 0x7fdc581a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:25.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.024+0000 7fdc56d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc5809e410 0x7fdc581c8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47080/0 (socket says 172.21.15.26:47080) 2023-10-01T08:00:25.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.024+0000 7fdc56d9d700 1 -- 172.21.15.26:0/3259149257 learned_addr learned my addr 172.21.15.26:0/3259149257 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:25.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.024+0000 7fdc55d9b700 1 --2- 172.21.15.26:0/3259149257 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdc5809e000 0x7fdc581a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:25.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.024+0000 7fdc56d9d700 1 -- 172.21.15.26:0/3259149257 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdc5809e000 msgr2=0x7fdc581a5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:25.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.024+0000 7fdc56d9d700 1 --2- 172.21.15.26:0/3259149257 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdc5809e000 0x7fdc581a5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:25.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.024+0000 7fdc56d9d700 1 -- 172.21.15.26:0/3259149257 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc5809d6f0 msgr2=0x7fdc581a5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:25.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.024+0000 7fdc56d9d700 1 --2- 172.21.15.26:0/3259149257 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc5809d6f0 0x7fdc581a5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:25.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.024+0000 7fdc56d9d700 1 -- 172.21.15.26:0/3259149257 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc50009a70 con 0x7fdc5809e410 2023-10-01T08:00:25.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.024+0000 7fdc56d9d700 1 --2- 172.21.15.26:0/3259149257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc5809e410 0x7fdc581c8040 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000b680 tx=0x7fdc50004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:25.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.025+0000 7fdc46ffd700 1 -- 172.21.15.26:0/3259149257 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5001b810 con 0x7fdc5809e410 2023-10-01T08:00:25.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.025+0000 7fdc46ffd700 1 -- 172.21.15.26:0/3259149257 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc50020070 con 0x7fdc5809e410 2023-10-01T08:00:25.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.025+0000 7fdc5c979700 1 -- 172.21.15.26:0/3259149257 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc581a4ca0 con 0x7fdc5809e410 2023-10-01T08:00:25.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.025+0000 7fdc46ffd700 1 -- 172.21.15.26:0/3259149257 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5001bb90 con 0x7fdc5809e410 2023-10-01T08:00:25.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.025+0000 7fdc5c979700 1 -- 172.21.15.26:0/3259149257 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc5809c710 con 0x7fdc5809e410 2023-10-01T08:00:25.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.026+0000 7fdc46ffd700 1 -- 172.21.15.26:0/3259149257 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdc5001bcf0 con 0x7fdc5809e410 2023-10-01T08:00:25.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.026+0000 7fdc5c979700 1 -- 172.21.15.26:0/3259149257 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc581a7b60 con 0x7fdc5809e410 2023-10-01T08:00:25.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.026+0000 7fdc46ffd700 1 -- 172.21.15.26:0/3259149257 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdc50022070 con 0x7fdc5809e410 2023-10-01T08:00:25.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.031+0000 7fdc46ffd700 1 -- 172.21.15.26:0/3259149257 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdc500267f0 con 0x7fdc5809e410 2023-10-01T08:00:25.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.062+0000 7fd96aad4700 1 Processor -- start 2023-10-01T08:00:25.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.062+0000 7fd96aad4700 1 -- start start 2023-10-01T08:00:25.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.063+0000 7fd96aad4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd96406a770 0x7fd96406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:25.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.063+0000 7fd96aad4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd96406b080 0x7fd964131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:25.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.063+0000 7fd96aad4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd964131b40 0x7fd964131fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:25.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.063+0000 7fd96aad4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd96409ece0 con 0x7fd96406a770 2023-10-01T08:00:25.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.063+0000 7fd96aad4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96409e760 con 0x7fd964131b40 2023-10-01T08:00:25.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.063+0000 7fd96aad4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd96409e040 con 0x7fd96406b080 2023-10-01T08:00:25.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.063+0000 7fd963fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd96406b080 0x7fd964131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:25.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.063+0000 7fd963fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd96406b080 0x7fd964131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:34052/0 (socket says 172.21.15.26:34052) 2023-10-01T08:00:25.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.063+0000 7fd963fff700 1 -- 172.21.15.26:0/313183392 learned_addr learned my addr 172.21.15.26:0/313183392 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:25.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.063+0000 7fd968870700 1 --2- 172.21.15.26:0/313183392 >> v2:172.21.15.26:3300/0 conn(0x7fd96406a770 0x7fd96406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:25.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.063+0000 7fd969071700 1 --2- 172.21.15.26:0/313183392 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd964131b40 0x7fd964131fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:25.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.063+0000 7fd963fff700 1 -- 172.21.15.26:0/313183392 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd964131b40 msgr2=0x7fd964131fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:25.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.063+0000 7fd963fff700 1 --2- 172.21.15.26:0/313183392 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd964131b40 0x7fd964131fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:25.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.063+0000 7fd963fff700 1 -- 172.21.15.26:0/313183392 >> v2:172.21.15.26:3300/0 conn(0x7fd96406a770 msgr2=0x7fd96406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:25.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.064+0000 7fd963fff700 1 --2- 172.21.15.26:0/313183392 >> v2:172.21.15.26:3300/0 conn(0x7fd96406a770 0x7fd96406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:25.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.064+0000 7fd963fff700 1 -- 172.21.15.26:0/313183392 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96409f630 con 0x7fd96406b080 2023-10-01T08:00:25.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.064+0000 7fd963fff700 1 --2- 172.21.15.26:0/313183392 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd96406b080 0x7fd964131600 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd950013db0 tx=0x7fd950009710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9f6a94359ee3a23 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:25.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.064+0000 7fd9637fe700 1 -- 172.21.15.26:0/313183392 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd950012ae0 con 0x7fd96406b080 2023-10-01T08:00:25.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.064+0000 7fd9637fe700 1 -- 172.21.15.26:0/313183392 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd950012c40 con 0x7fd96406b080 2023-10-01T08:00:25.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.064+0000 7fd9637fe700 1 -- 172.21.15.26:0/313183392 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd950013050 con 0x7fd96406b080 2023-10-01T08:00:25.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.065+0000 7fd96aad4700 1 -- 172.21.15.26:0/313183392 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd96406b080 msgr2=0x7fd964131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:25.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.065+0000 7fd96aad4700 1 --2- 172.21.15.26:0/313183392 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd96406b080 0x7fd964131600 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd950013db0 tx=0x7fd950009710 comp rx=0 tx=0).stop 2023-10-01T08:00:25.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.065+0000 7fd96aad4700 1 -- 172.21.15.26:0/313183392 shutdown_connections 2023-10-01T08:00:25.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.065+0000 7fd96aad4700 1 --2- 172.21.15.26:0/313183392 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd964131b40 0x7fd964131fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:25.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.065+0000 7fd96aad4700 1 --2- 172.21.15.26:0/313183392 >> v2:172.21.15.26:3300/0 conn(0x7fd96406a770 0x7fd96406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:25.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.065+0000 7fd96aad4700 1 --2- 172.21.15.26:0/313183392 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd96406b080 0x7fd964131600 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:25.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.065+0000 7fd96aad4700 1 -- 172.21.15.26:0/313183392 >> 172.21.15.26:0/313183392 conn(0x7fd964066f50 msgr2=0x7fd96409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:25.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.065+0000 7fd96aad4700 1 -- 172.21.15.26:0/313183392 shutdown_connections 2023-10-01T08:00:25.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.065+0000 7fd96aad4700 1 -- 172.21.15.26:0/313183392 wait complete. 2023-10-01T08:00:25.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.066+0000 7fd96aad4700 1 Processor -- start 2023-10-01T08:00:25.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.066+0000 7fd96aad4700 1 -- start start 2023-10-01T08:00:25.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.067+0000 7fd96aad4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd96406a770 0x7fd9641c4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:25.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.067+0000 7fd96aad4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd96406b080 0x7fd9641c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:25.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.067+0000 7fd96aad4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd964131b40 0x7fd96411e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:25.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.067+0000 7fd96aad4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd964130db0 con 0x7fd96406b080 2023-10-01T08:00:25.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.067+0000 7fd96aad4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd964120050 con 0x7fd96406a770 2023-10-01T08:00:25.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.067+0000 7fd96aad4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd964071e60 con 0x7fd964131b40 2023-10-01T08:00:25.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.067+0000 7fd968870700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd96406a770 0x7fd9641c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:25.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.067+0000 7fd968870700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd96406a770 0x7fd9641c4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38242/0 (socket says 172.21.15.26:38242) 2023-10-01T08:00:25.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.067+0000 7fd963fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd96406b080 0x7fd9641c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:25.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.067+0000 7fd968870700 1 -- 172.21.15.26:0/4070289563 learned_addr learned my addr 172.21.15.26:0/4070289563 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:25.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.067+0000 7fd969071700 1 --2- 172.21.15.26:0/4070289563 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd964131b40 0x7fd96411e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:25.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.067+0000 7fd969071700 1 -- 172.21.15.26:0/4070289563 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd96406a770 msgr2=0x7fd9641c4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:25.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.067+0000 7fd969071700 1 --2- 172.21.15.26:0/4070289563 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd96406a770 0x7fd9641c4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:25.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.067+0000 7fd969071700 1 -- 172.21.15.26:0/4070289563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd96406b080 msgr2=0x7fd9641c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:25.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.067+0000 7fd969071700 1 --2- 172.21.15.26:0/4070289563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd96406b080 0x7fd9641c46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:25.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.067+0000 7fd969071700 1 -- 172.21.15.26:0/4070289563 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd950013a10 con 0x7fd964131b40 2023-10-01T08:00:25.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.067+0000 7fd968870700 1 --2- 172.21.15.26:0/4070289563 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd96406a770 0x7fd9641c4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:25.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.067+0000 7fd969071700 1 --2- 172.21.15.26:0/4070289563 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd964131b40 0x7fd96411e440 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd95c00efc0 tx=0x7fd95c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:25.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.068+0000 7fd9617fa700 1 -- 172.21.15.26:0/4070289563 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c00cc90 con 0x7fd964131b40 2023-10-01T08:00:25.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.068+0000 7fd9617fa700 1 -- 172.21.15.26:0/4070289563 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95c00f040 con 0x7fd964131b40 2023-10-01T08:00:25.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.068+0000 7fd96aad4700 1 -- 172.21.15.26:0/4070289563 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9641c4c10 con 0x7fd964131b40 2023-10-01T08:00:25.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.068+0000 7fd9617fa700 1 -- 172.21.15.26:0/4070289563 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c0146c0 con 0x7fd964131b40 2023-10-01T08:00:25.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.068+0000 7fd96aad4700 1 -- 172.21.15.26:0/4070289563 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd964120840 con 0x7fd964131b40 2023-10-01T08:00:25.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.069+0000 7fd96aad4700 1 -- 172.21.15.26:0/4070289563 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd964074ea0 con 0x7fd964131b40 2023-10-01T08:00:25.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.069+0000 7fd9617fa700 1 -- 172.21.15.26:0/4070289563 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd95c014820 con 0x7fd964131b40 2023-10-01T08:00:25.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.069+0000 7fd9617fa700 1 -- 172.21.15.26:0/4070289563 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd95c040730 con 0x7fd964131b40 2023-10-01T08:00:25.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.074+0000 7fd9617fa700 1 -- 172.21.15.26:0/4070289563 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd95c014ad0 con 0x7fd964131b40 2023-10-01T08:00:25.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.105+0000 7f7f9c8e9700 1 Processor -- start 2023-10-01T08:00:25.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.105+0000 7f7f9c8e9700 1 -- start start 2023-10-01T08:00:25.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.106+0000 7f7f9c8e9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7f9809d6f0 0x7f7f9809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:25.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.106+0000 7f7f9c8e9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f9809e000 0x7f7f981339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:25.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.106+0000 7f7f9c8e9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7f9809e410 0x7f7f98133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:25.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.106+0000 7f7f9c8e9700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f9806b460 con 0x7f7f9809e410 2023-10-01T08:00:25.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.106+0000 7f7f9c8e9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9809b120 con 0x7f7f9809e000 2023-10-01T08:00:25.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.106+0000 7f7f9c8e9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9809a7e0 con 0x7f7f9809d6f0 2023-10-01T08:00:25.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.106+0000 7f7f95d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f9809e000 0x7f7f981339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:25.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.106+0000 7f7f9659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7f9809d6f0 0x7f7f9809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:25.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.106+0000 7f7f95d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f9809e000 0x7f7f981339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38244/0 (socket says 172.21.15.26:38244) 2023-10-01T08:00:25.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.106+0000 7f7f9659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7f9809d6f0 0x7f7f9809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:34060/0 (socket says 172.21.15.26:34060) 2023-10-01T08:00:25.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.106+0000 7f7f95d9b700 1 -- 172.21.15.26:0/997007176 learned_addr learned my addr 172.21.15.26:0/997007176 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:25.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.106+0000 7f7f96d9d700 1 --2- 172.21.15.26:0/997007176 >> v2:172.21.15.26:3300/0 conn(0x7f7f9809e410 0x7f7f98133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:25.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.107+0000 7f7f95d9b700 1 -- 172.21.15.26:0/997007176 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7f9809d6f0 msgr2=0x7f7f9809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:25.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.107+0000 7f7f95d9b700 1 --2- 172.21.15.26:0/997007176 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7f9809d6f0 0x7f7f9809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:25.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.107+0000 7f7f95d9b700 1 -- 172.21.15.26:0/997007176 >> v2:172.21.15.26:3300/0 conn(0x7f7f9809e410 msgr2=0x7f7f98133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:25.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.107+0000 7f7f95d9b700 1 --2- 172.21.15.26:0/997007176 >> v2:172.21.15.26:3300/0 conn(0x7f7f9809e410 0x7f7f98133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:25.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.107+0000 7f7f95d9b700 1 -- 172.21.15.26:0/997007176 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f9809a500 con 0x7f7f9809e000 2023-10-01T08:00:25.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.107+0000 7f7f9659c700 1 --2- 172.21.15.26:0/997007176 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7f9809d6f0 0x7f7f9809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:25.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.107+0000 7f7f95d9b700 1 --2- 172.21.15.26:0/997007176 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f9809e000 0x7f7f981339f0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c009920 tx=0x7f7f8c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30f5ecdd7f4c860c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:25.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.107+0000 7f7f9559a700 1 -- 172.21.15.26:0/997007176 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c011830 con 0x7f7f9809e000 2023-10-01T08:00:25.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.107+0000 7f7f9559a700 1 -- 172.21.15.26:0/997007176 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8c011990 con 0x7f7f9809e000 2023-10-01T08:00:25.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.107+0000 7f7f9559a700 1 -- 172.21.15.26:0/997007176 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c011d20 con 0x7f7f9809e000 2023-10-01T08:00:25.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.108+0000 7f7f9c8e9700 1 -- 172.21.15.26:0/997007176 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f9809e000 msgr2=0x7f7f981339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:25.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.108+0000 7f7f9c8e9700 1 --2- 172.21.15.26:0/997007176 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f9809e000 0x7f7f981339f0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c009920 tx=0x7f7f8c009c30 comp rx=0 tx=0).stop 2023-10-01T08:00:25.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.108+0000 7f7f9c8e9700 1 -- 172.21.15.26:0/997007176 shutdown_connections 2023-10-01T08:00:25.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.108+0000 7f7f9c8e9700 1 --2- 172.21.15.26:0/997007176 >> v2:172.21.15.26:3300/0 conn(0x7f7f9809e410 0x7f7f98133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:25.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.108+0000 7f7f9c8e9700 1 --2- 172.21.15.26:0/997007176 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7f9809d6f0 0x7f7f9809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:25.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.108+0000 7f7f9c8e9700 1 --2- 172.21.15.26:0/997007176 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f9809e000 0x7f7f981339f0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:25.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.108+0000 7f7f9c8e9700 1 -- 172.21.15.26:0/997007176 >> 172.21.15.26:0/997007176 conn(0x7f7f98066f50 msgr2=0x7f7f9809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:25.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.108+0000 7f7f9c8e9700 1 -- 172.21.15.26:0/997007176 shutdown_connections 2023-10-01T08:00:25.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.108+0000 7f7f9c8e9700 1 -- 172.21.15.26:0/997007176 wait complete. 2023-10-01T08:00:25.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.110+0000 7f7f9c8e9700 1 Processor -- start 2023-10-01T08:00:25.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.110+0000 7f7f9c8e9700 1 -- start start 2023-10-01T08:00:25.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.110+0000 7f7f9c8e9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f9809d6f0 0x7f7f981a5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:25.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.110+0000 7f7f9c8e9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f9809e000 0x7f7f981a6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:25.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.110+0000 7f7f9c8e9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7f9809e410 0x7f7f981a69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:25.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.110+0000 7f7f9c8e9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f981a8090 con 0x7f7f9809e000 2023-10-01T08:00:25.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.110+0000 7f7f9c8e9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f981a9150 con 0x7f7f9809d6f0 2023-10-01T08:00:25.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.110+0000 7f7f9c8e9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9809c710 con 0x7f7f9809e410 2023-10-01T08:00:25.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.111+0000 7f7f95d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f9809e000 0x7f7f981a6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:25.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.111+0000 7f7f95d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f9809e000 0x7f7f981a6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47126/0 (socket says 172.21.15.26:47126) 2023-10-01T08:00:25.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.111+0000 7f7f96d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7f9809e410 0x7f7f981a69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:25.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.111+0000 7f7f95d9b700 1 -- 172.21.15.26:0/1876397541 learned_addr learned my addr 172.21.15.26:0/1876397541 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:25.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.111+0000 7f7f9659c700 1 --2- 172.21.15.26:0/1876397541 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f9809d6f0 0x7f7f981a5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:25.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.111+0000 7f7f95d9b700 1 -- 172.21.15.26:0/1876397541 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7f9809e410 msgr2=0x7f7f981a69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:25.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.111+0000 7f7f95d9b700 1 --2- 172.21.15.26:0/1876397541 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7f9809e410 0x7f7f981a69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:25.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.111+0000 7f7f95d9b700 1 -- 172.21.15.26:0/1876397541 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f9809d6f0 msgr2=0x7f7f981a5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:25.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.111+0000 7f7f95d9b700 1 --2- 172.21.15.26:0/1876397541 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f9809d6f0 0x7f7f981a5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:25.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.111+0000 7f7f95d9b700 1 -- 172.21.15.26:0/1876397541 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f880094a0 con 0x7f7f9809e000 2023-10-01T08:00:25.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.111+0000 7f7f96d9d700 1 --2- 172.21.15.26:0/1876397541 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7f9809e410 0x7f7f981a69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:25.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.111+0000 7f7f9659c700 1 --2- 172.21.15.26:0/1876397541 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f9809d6f0 0x7f7f981a5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:25.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.111+0000 7f7f95d9b700 1 --2- 172.21.15.26:0/1876397541 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f9809e000 0x7f7f981a6470 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c000c00 tx=0x7f7f8c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:25.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.111+0000 7f7f86ffd700 1 -- 172.21.15.26:0/1876397541 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c004240 con 0x7f7f9809e000 2023-10-01T08:00:25.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.112+0000 7f7f86ffd700 1 -- 172.21.15.26:0/1876397541 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8c01f070 con 0x7f7f9809e000 2023-10-01T08:00:25.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.112+0000 7f7f9c8e9700 1 -- 172.21.15.26:0/1876397541 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f8c009550 con 0x7f7f9809e000 2023-10-01T08:00:25.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.112+0000 7f7f86ffd700 1 -- 172.21.15.26:0/1876397541 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c0036a0 con 0x7f7f9809e000 2023-10-01T08:00:25.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.112+0000 7f7f9c8e9700 1 -- 172.21.15.26:0/1876397541 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f981a7ab0 con 0x7f7f9809e000 2023-10-01T08:00:25.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.112+0000 7f7f86ffd700 1 -- 172.21.15.26:0/1876397541 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7f8c021030 con 0x7f7f9809e000 2023-10-01T08:00:25.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.113+0000 7f7f86ffd700 1 -- 172.21.15.26:0/1876397541 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7f8c040780 con 0x7f7f9809e000 2023-10-01T08:00:25.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.113+0000 7f7f9c8e9700 1 -- 172.21.15.26:0/1876397541 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f981a9540 con 0x7f7f9809e000 2023-10-01T08:00:25.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.118+0000 7f7f86ffd700 1 -- 172.21.15.26:0/1876397541 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7f981a9540 con 0x7f7f9809e000 2023-10-01T08:00:25.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.241+0000 7fdc5c979700 1 -- 172.21.15.26:0/3259149257 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdc58074ea0 con 0x7fdc5809e410 2023-10-01T08:00:25.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.241+0000 7fdc46ffd700 1 -- 172.21.15.26:0/3259149257 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdc50025380 con 0x7fdc5809e410 2023-10-01T08:00:25.242 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:25.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.244+0000 7fdc5c979700 1 -- 172.21.15.26:0/3259149257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc5809e410 msgr2=0x7fdc581c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:25.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.244+0000 7fdc5c979700 1 --2- 172.21.15.26:0/3259149257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc5809e410 0x7fdc581c8040 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000b680 tx=0x7fdc50004ad0 comp rx=0 tx=0).stop 2023-10-01T08:00:25.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.244+0000 7fdc5c979700 1 -- 172.21.15.26:0/3259149257 shutdown_connections 2023-10-01T08:00:25.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.244+0000 7fdc5c979700 1 --2- 172.21.15.26:0/3259149257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc5809e410 0x7fdc581c8040 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:25.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.244+0000 7fdc5c979700 1 --2- 172.21.15.26:0/3259149257 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc5809d6f0 0x7fdc581a5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:25.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.244+0000 7fdc5c979700 1 --2- 172.21.15.26:0/3259149257 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdc5809e000 0x7fdc581a5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:25.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.244+0000 7fdc5c979700 1 -- 172.21.15.26:0/3259149257 >> 172.21.15.26:0/3259149257 conn(0x7fdc58066f50 msgr2=0x7fdc5806f070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:25.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.244+0000 7fdc5c979700 1 -- 172.21.15.26:0/3259149257 shutdown_connections 2023-10-01T08:00:25.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.244+0000 7fdc5c979700 1 -- 172.21.15.26:0/3259149257 wait complete. 2023-10-01T08:00:25.259 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:25.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.288+0000 7fd96aad4700 1 -- 172.21.15.26:0/4070289563 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd964130f60 con 0x7fd964131b40 2023-10-01T08:00:25.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.288+0000 7fd9617fa700 1 -- 172.21.15.26:0/4070289563 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd95c02a070 con 0x7fd964131b40 2023-10-01T08:00:25.289 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:25.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.291+0000 7fd96aad4700 1 -- 172.21.15.26:0/4070289563 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd964131b40 msgr2=0x7fd96411e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:25.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.291+0000 7fd96aad4700 1 --2- 172.21.15.26:0/4070289563 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd964131b40 0x7fd96411e440 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd95c00efc0 tx=0x7fd95c00c3a0 comp rx=0 tx=0).stop 2023-10-01T08:00:25.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.291+0000 7fd96aad4700 1 -- 172.21.15.26:0/4070289563 shutdown_connections 2023-10-01T08:00:25.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.291+0000 7fd96aad4700 1 --2- 172.21.15.26:0/4070289563 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd964131b40 0x7fd96411e440 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:25.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.291+0000 7fd96aad4700 1 --2- 172.21.15.26:0/4070289563 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd96406a770 0x7fd9641c4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:25.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.291+0000 7fd96aad4700 1 --2- 172.21.15.26:0/4070289563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd96406b080 0x7fd9641c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:25.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.291+0000 7fd96aad4700 1 -- 172.21.15.26:0/4070289563 >> 172.21.15.26:0/4070289563 conn(0x7fd964066f50 msgr2=0x7fd9640a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:25.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.292+0000 7fd96aad4700 1 -- 172.21.15.26:0/4070289563 shutdown_connections 2023-10-01T08:00:25.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.292+0000 7fd96aad4700 1 -- 172.21.15.26:0/4070289563 wait complete. 2023-10-01T08:00:25.306 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:25.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.327+0000 7f7f9c8e9700 1 -- 172.21.15.26:0/1876397541 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7f981a9540 con 0x7f7f9809e000 2023-10-01T08:00:25.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.328+0000 7f7f86ffd700 1 -- 172.21.15.26:0/1876397541 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7f981a9540 con 0x7f7f9809e000 2023-10-01T08:00:25.329 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:25.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.330+0000 7f7f9c8e9700 1 -- 172.21.15.26:0/1876397541 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f9809e000 msgr2=0x7f7f981a6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:25.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.330+0000 7f7f9c8e9700 1 --2- 172.21.15.26:0/1876397541 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f9809e000 0x7f7f981a6470 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c000c00 tx=0x7f7f8c004750 comp rx=0 tx=0).stop 2023-10-01T08:00:25.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.330+0000 7f7f9c8e9700 1 -- 172.21.15.26:0/1876397541 shutdown_connections 2023-10-01T08:00:25.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.330+0000 7f7f9c8e9700 1 --2- 172.21.15.26:0/1876397541 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7f9809e410 0x7f7f981a69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:25.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.330+0000 7f7f9c8e9700 1 --2- 172.21.15.26:0/1876397541 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7f9809d6f0 0x7f7f981a5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:25.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.330+0000 7f7f9c8e9700 1 --2- 172.21.15.26:0/1876397541 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f9809e000 0x7f7f981a6470 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:25.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.330+0000 7f7f9c8e9700 1 -- 172.21.15.26:0/1876397541 >> 172.21.15.26:0/1876397541 conn(0x7f7f98066f50 msgr2=0x7f7f981baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:25.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.330+0000 7f7f9c8e9700 1 -- 172.21.15.26:0/1876397541 shutdown_connections 2023-10-01T08:00:25.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:25.330+0000 7f7f9c8e9700 1 -- 172.21.15.26:0/1876397541 wait complete. 2023-10-01T08:00:25.344 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:26.002 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:26.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.150+0000 7f6efb9ea700 1 Processor -- start 2023-10-01T08:00:26.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.150+0000 7f6efb9ea700 1 -- start start 2023-10-01T08:00:26.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.151+0000 7f6efb9ea700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ef409d6f0 0x7f6ef409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:26.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.151+0000 7f6efb9ea700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6ef409e000 0x7f6ef4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:26.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.151+0000 7f6efb9ea700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ef409f130 con 0x7f6ef409e410 2023-10-01T08:00:26.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.151+0000 7f6efb9ea700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef409f520 con 0x7f6ef409e000 2023-10-01T08:00:26.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.151+0000 7f6efb9ea700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef409e930 con 0x7f6ef409d6f0 2023-10-01T08:00:26.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.151+0000 7f6ef9786700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ef409d6f0 0x7f6ef409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:26.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.151+0000 7f6ef8f85700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6ef409e000 0x7f6ef4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:26.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.151+0000 7f6ef9786700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ef409d6f0 0x7f6ef409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38260/0 (socket says 172.21.15.26:38260) 2023-10-01T08:00:26.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.151+0000 7f6ef8f85700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6ef409e000 0x7f6ef4130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47132/0 (socket says 172.21.15.26:47132) 2023-10-01T08:00:26.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.151+0000 7f6ef9786700 1 -- 172.21.15.26:0/1174404089 learned_addr learned my addr 172.21.15.26:0/1174404089 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:26.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.151+0000 7f6ef8f85700 1 -- 172.21.15.26:0/1174404089 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ef409d6f0 msgr2=0x7f6ef409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:26.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.151+0000 7f6ef8f85700 1 --2- 172.21.15.26:0/1174404089 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ef409d6f0 0x7f6ef409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.151+0000 7f6ef8f85700 1 -- 172.21.15.26:0/1174404089 >> v1:172.21.15.26:6789/0 conn(0x7f6ef409e410 legacy=0x7f6ef4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:26.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.151+0000 7f6ef8f85700 1 -- 172.21.15.26:0/1174404089 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef409b2d0 con 0x7f6ef409e000 2023-10-01T08:00:26.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.151+0000 7f6ef9786700 1 --2- 172.21.15.26:0/1174404089 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ef409d6f0 0x7f6ef409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:26.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.151+0000 7f6ef8f85700 1 --2- 172.21.15.26:0/1174404089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ef409e000 0x7f6ef4130660 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4009840 tx=0x7f6ee4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afbf2d24a15f7b83 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:26.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.151+0000 7f6eebfff700 1 -- 172.21.15.26:0/1174404089 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee4011830 con 0x7f6ef409e000 2023-10-01T08:00:26.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.152+0000 7f6eebfff700 1 -- 172.21.15.26:0/1174404089 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee4011990 con 0x7f6ef409e000 2023-10-01T08:00:26.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.152+0000 7f6eebfff700 1 -- 172.21.15.26:0/1174404089 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee4011d20 con 0x7f6ef409e000 2023-10-01T08:00:26.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.152+0000 7f6efb9ea700 1 -- 172.21.15.26:0/1174404089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ef409e000 msgr2=0x7f6ef4130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:26.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.152+0000 7f6efb9ea700 1 --2- 172.21.15.26:0/1174404089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ef409e000 0x7f6ef4130660 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4009840 tx=0x7f6ee4009b50 comp rx=0 tx=0).stop 2023-10-01T08:00:26.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.152+0000 7f6efb9ea700 1 -- 172.21.15.26:0/1174404089 shutdown_connections 2023-10-01T08:00:26.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.152+0000 7f6efb9ea700 1 --2- 172.21.15.26:0/1174404089 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ef409d6f0 0x7f6ef409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.152+0000 7f6efb9ea700 1 --2- 172.21.15.26:0/1174404089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ef409e000 0x7f6ef4130660 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.152+0000 7f6efb9ea700 1 -- 172.21.15.26:0/1174404089 >> 172.21.15.26:0/1174404089 conn(0x7f6ef4066f50 msgr2=0x7f6ef409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:26.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.152+0000 7f6efb9ea700 1 -- 172.21.15.26:0/1174404089 shutdown_connections 2023-10-01T08:00:26.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.152+0000 7f6efb9ea700 1 -- 172.21.15.26:0/1174404089 wait complete. 2023-10-01T08:00:26.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.154+0000 7f6efb9ea700 1 Processor -- start 2023-10-01T08:00:26.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.154+0000 7f6efb9ea700 1 -- start start 2023-10-01T08:00:26.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.154+0000 7f6efb9ea700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ef409d6f0 0x7f6ef4121280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:26.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.154+0000 7f6efb9ea700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ef409e000 0x7f6ef41217c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:26.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.154+0000 7f6efb9ea700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6ef409e410 0x7f6ef4121d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:26.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.154+0000 7f6efb9ea700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef406b3a0 con 0x7f6ef409e000 2023-10-01T08:00:26.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.154+0000 7f6efb9ea700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef409c770 con 0x7f6ef409d6f0 2023-10-01T08:00:26.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.154+0000 7f6efb9ea700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef41223d0 con 0x7f6ef409e410 2023-10-01T08:00:26.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.154+0000 7f6ef9786700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ef409d6f0 0x7f6ef4121280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:26.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.155+0000 7f6ef9786700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ef409d6f0 0x7f6ef4121280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38270/0 (socket says 172.21.15.26:38270) 2023-10-01T08:00:26.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.155+0000 7f6ef9786700 1 -- 172.21.15.26:0/1598481471 learned_addr learned my addr 172.21.15.26:0/1598481471 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:26.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.155+0000 7f6ef9f87700 1 --2- 172.21.15.26:0/1598481471 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6ef409e410 0x7f6ef4121d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:26.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.155+0000 7f6ef8f85700 1 --2- 172.21.15.26:0/1598481471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ef409e000 0x7f6ef41217c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:26.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.155+0000 7f6ef9786700 1 -- 172.21.15.26:0/1598481471 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6ef409e410 msgr2=0x7f6ef4121d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:26.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.155+0000 7f6ef9786700 1 --2- 172.21.15.26:0/1598481471 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6ef409e410 0x7f6ef4121d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.155+0000 7f6ef9786700 1 -- 172.21.15.26:0/1598481471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ef409e000 msgr2=0x7f6ef41217c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:26.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.155+0000 7f6ef9786700 1 --2- 172.21.15.26:0/1598481471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ef409e000 0x7f6ef41217c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.155+0000 7f6ef9786700 1 -- 172.21.15.26:0/1598481471 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef0009550 con 0x7f6ef409d6f0 2023-10-01T08:00:26.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.155+0000 7f6ef9786700 1 --2- 172.21.15.26:0/1598481471 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ef409d6f0 0x7f6ef4121280 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6ef000e9e0 tx=0x7f6ef000ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:26.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.155+0000 7f6ee9ffb700 1 -- 172.21.15.26:0/1598481471 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef000ee80 con 0x7f6ef409d6f0 2023-10-01T08:00:26.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.155+0000 7f6ee9ffb700 1 -- 172.21.15.26:0/1598481471 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef000c850 con 0x7f6ef409d6f0 2023-10-01T08:00:26.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.155+0000 7f6efb9ea700 1 -- 172.21.15.26:0/1598481471 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee40094a0 con 0x7f6ef409d6f0 2023-10-01T08:00:26.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.155+0000 7f6ee9ffb700 1 -- 172.21.15.26:0/1598481471 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef000cbc0 con 0x7f6ef409d6f0 2023-10-01T08:00:26.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.156+0000 7f6efb9ea700 1 -- 172.21.15.26:0/1598481471 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef406ea40 con 0x7f6ef409d6f0 2023-10-01T08:00:26.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.156+0000 7f6ee9ffb700 1 -- 172.21.15.26:0/1598481471 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6ef000cd20 con 0x7f6ef409d6f0 2023-10-01T08:00:26.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.156+0000 7f6efb9ea700 1 -- 172.21.15.26:0/1598481471 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef4074ea0 con 0x7f6ef409d6f0 2023-10-01T08:00:26.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.157+0000 7f6ee9ffb700 1 -- 172.21.15.26:0/1598481471 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6ef003fb10 con 0x7f6ef409d6f0 2023-10-01T08:00:26.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.162+0000 7f6ee9ffb700 1 -- 172.21.15.26:0/1598481471 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6ef0017070 con 0x7f6ef409d6f0 2023-10-01T08:00:26.261 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:26.307 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:26.345 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:26.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.373+0000 7f6efb9ea700 1 -- 172.21.15.26:0/1598481471 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6ef41225f0 con 0x7f6ef409d6f0 2023-10-01T08:00:26.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.373+0000 7f6ee9ffb700 1 -- 172.21.15.26:0/1598481471 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6ef001b3b0 con 0x7f6ef409d6f0 2023-10-01T08:00:26.374 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:26.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.376+0000 7f6efb9ea700 1 -- 172.21.15.26:0/1598481471 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ef409d6f0 msgr2=0x7f6ef4121280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:26.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.376+0000 7f6efb9ea700 1 --2- 172.21.15.26:0/1598481471 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ef409d6f0 0x7f6ef4121280 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6ef000e9e0 tx=0x7f6ef000ecf0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.376+0000 7f6efb9ea700 1 -- 172.21.15.26:0/1598481471 shutdown_connections 2023-10-01T08:00:26.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.376+0000 7f6efb9ea700 1 --2- 172.21.15.26:0/1598481471 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6ef409e410 0x7f6ef4121d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.376+0000 7f6efb9ea700 1 --2- 172.21.15.26:0/1598481471 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ef409d6f0 0x7f6ef4121280 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.376+0000 7f6efb9ea700 1 --2- 172.21.15.26:0/1598481471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ef409e000 0x7f6ef41217c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.376+0000 7f6efb9ea700 1 -- 172.21.15.26:0/1598481471 >> 172.21.15.26:0/1598481471 conn(0x7f6ef4066f50 msgr2=0x7f6ef40a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:26.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.376+0000 7f6efb9ea700 1 -- 172.21.15.26:0/1598481471 shutdown_connections 2023-10-01T08:00:26.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.376+0000 7f6efb9ea700 1 -- 172.21.15.26:0/1598481471 wait complete. 2023-10-01T08:00:26.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:26.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.404+0000 7f0e94c40700 1 Processor -- start 2023-10-01T08:00:26.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.404+0000 7f0e94c40700 1 -- start start 2023-10-01T08:00:26.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.405+0000 7f0e94c40700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0e9009d6f0 0x7f0e9009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:26.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.405+0000 7f0e94c40700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0e9009e000 0x7f0e901339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:26.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.405+0000 7f0e94c40700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e9009e410 0x7f0e90133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:26.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.405+0000 7f0e94c40700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e9006b460 con 0x7f0e9009e000 2023-10-01T08:00:26.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.405+0000 7f0e94c40700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9009b120 con 0x7f0e9009d6f0 2023-10-01T08:00:26.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.405+0000 7f0e94c40700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9009a7e0 con 0x7f0e9009e410 2023-10-01T08:00:26.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.405+0000 7f0e8dd9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0e9009e000 0x7f0e901339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:26.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.405+0000 7f0e8e59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0e9009d6f0 0x7f0e9009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:26.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.405+0000 7f0e8ed9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e9009e410 0x7f0e90133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:26.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.405+0000 7f0e8dd9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0e9009e000 0x7f0e901339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47150/0 (socket says 172.21.15.26:47150) 2023-10-01T08:00:26.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.405+0000 7f0e8dd9b700 1 -- 172.21.15.26:0/2262470879 learned_addr learned my addr 172.21.15.26:0/2262470879 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:26.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.406+0000 7f0e8ed9d700 1 -- 172.21.15.26:0/2262470879 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0e9009d6f0 msgr2=0x7f0e9009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:26.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.406+0000 7f0e8ed9d700 1 --2- 172.21.15.26:0/2262470879 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0e9009d6f0 0x7f0e9009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.406+0000 7f0e8ed9d700 1 -- 172.21.15.26:0/2262470879 >> v2:172.21.15.26:3300/0 conn(0x7f0e9009e000 msgr2=0x7f0e901339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:26.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.406+0000 7f0e8ed9d700 1 --2- 172.21.15.26:0/2262470879 >> v2:172.21.15.26:3300/0 conn(0x7f0e9009e000 0x7f0e901339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.406+0000 7f0e8ed9d700 1 -- 172.21.15.26:0/2262470879 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9009a500 con 0x7f0e9009e410 2023-10-01T08:00:26.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.406+0000 7f0e8e59c700 1 --2- 172.21.15.26:0/2262470879 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0e9009d6f0 0x7f0e9009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:26.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.406+0000 7f0e8ed9d700 1 --2- 172.21.15.26:0/2262470879 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e9009e410 0x7f0e90133f30 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f0e88009dc0 tx=0x7f0e8800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db87fc340b60f4b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:26.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.406+0000 7f0e8d59a700 1 -- 172.21.15.26:0/2262470879 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8800e070 con 0x7f0e9009e410 2023-10-01T08:00:26.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.406+0000 7f0e8d59a700 1 -- 172.21.15.26:0/2262470879 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8800bae0 con 0x7f0e9009e410 2023-10-01T08:00:26.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.406+0000 7f0e8d59a700 1 -- 172.21.15.26:0/2262470879 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8800be90 con 0x7f0e9009e410 2023-10-01T08:00:26.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.407+0000 7f0e94c40700 1 -- 172.21.15.26:0/2262470879 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e9009e410 msgr2=0x7f0e90133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:26.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.407+0000 7f0e94c40700 1 --2- 172.21.15.26:0/2262470879 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e9009e410 0x7f0e90133f30 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f0e88009dc0 tx=0x7f0e8800b330 comp rx=0 tx=0).stop 2023-10-01T08:00:26.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.407+0000 7f0e94c40700 1 -- 172.21.15.26:0/2262470879 shutdown_connections 2023-10-01T08:00:26.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.407+0000 7f0e94c40700 1 --2- 172.21.15.26:0/2262470879 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e9009e410 0x7f0e90133f30 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.407+0000 7f0e94c40700 1 --2- 172.21.15.26:0/2262470879 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0e9009d6f0 0x7f0e9009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.407+0000 7f0e94c40700 1 --2- 172.21.15.26:0/2262470879 >> v2:172.21.15.26:3300/0 conn(0x7f0e9009e000 0x7f0e901339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.407+0000 7f0e94c40700 1 -- 172.21.15.26:0/2262470879 >> 172.21.15.26:0/2262470879 conn(0x7f0e90066f50 msgr2=0x7f0e9009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:26.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.407+0000 7f0e94c40700 1 -- 172.21.15.26:0/2262470879 shutdown_connections 2023-10-01T08:00:26.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.407+0000 7f0e94c40700 1 -- 172.21.15.26:0/2262470879 wait complete. 2023-10-01T08:00:26.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.408+0000 7f0e94c40700 1 Processor -- start 2023-10-01T08:00:26.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.408+0000 7f0e94c40700 1 -- start start 2023-10-01T08:00:26.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.409+0000 7f0e94c40700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e9009d6f0 0x7f0e901c4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:26.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.409+0000 7f0e94c40700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0e9009e000 0x7f0e901c5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:26.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.409+0000 7f0e94c40700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e9009e410 0x7f0e901c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:26.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.409+0000 7f0e94c40700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e901a97b0 con 0x7f0e9009e410 2023-10-01T08:00:26.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.409+0000 7f0e94c40700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e901c59a0 con 0x7f0e9009e000 2023-10-01T08:00:26.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.409+0000 7f0e94c40700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e900a2020 con 0x7f0e9009d6f0 2023-10-01T08:00:26.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.409+0000 7f0e8e59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e9009d6f0 0x7f0e901c4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:26.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.409+0000 7f0e8e59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e9009d6f0 0x7f0e901c4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:34106/0 (socket says 172.21.15.26:34106) 2023-10-01T08:00:26.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.409+0000 7f0e8e59c700 1 -- 172.21.15.26:0/2040202035 learned_addr learned my addr 172.21.15.26:0/2040202035 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:26.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.409+0000 7f0e8ed9d700 1 --2- 172.21.15.26:0/2040202035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e9009e410 0x7f0e901c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:26.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.409+0000 7f0e8dd9b700 1 --2- 172.21.15.26:0/2040202035 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0e9009e000 0x7f0e901c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:26.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.409+0000 7f0e8e59c700 1 -- 172.21.15.26:0/2040202035 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0e9009e000 msgr2=0x7f0e901c5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:26.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.409+0000 7f0e8e59c700 1 --2- 172.21.15.26:0/2040202035 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0e9009e000 0x7f0e901c5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.409+0000 7f0e8e59c700 1 -- 172.21.15.26:0/2040202035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e9009e410 msgr2=0x7f0e901c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:26.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.409+0000 7f0e8e59c700 1 --2- 172.21.15.26:0/2040202035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e9009e410 0x7f0e901c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.409+0000 7f0e8e59c700 1 -- 172.21.15.26:0/2040202035 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e800094a0 con 0x7f0e9009d6f0 2023-10-01T08:00:26.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.409+0000 7f0e8ed9d700 1 --2- 172.21.15.26:0/2040202035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e9009e410 0x7f0e901c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:26.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.410+0000 7f0e8e59c700 1 --2- 172.21.15.26:0/2040202035 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e9009d6f0 0x7f0e901c4f20 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f0e8000ebe0 tx=0x7f0e8000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:26.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.410+0000 7f0e7effd700 1 -- 172.21.15.26:0/2040202035 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e80009800 con 0x7f0e9009d6f0 2023-10-01T08:00:26.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.410+0000 7f0e7effd700 1 -- 172.21.15.26:0/2040202035 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8000c910 con 0x7f0e9009d6f0 2023-10-01T08:00:26.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.410+0000 7f0e7effd700 1 -- 172.21.15.26:0/2040202035 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8000cc80 con 0x7f0e9009d6f0 2023-10-01T08:00:26.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.410+0000 7f0e94c40700 1 -- 172.21.15.26:0/2040202035 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e88009a70 con 0x7f0e9009d6f0 2023-10-01T08:00:26.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.410+0000 7f0e94c40700 1 -- 172.21.15.26:0/2040202035 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e901a78a0 con 0x7f0e9009d6f0 2023-10-01T08:00:26.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.411+0000 7f0e7effd700 1 -- 172.21.15.26:0/2040202035 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0e80013470 con 0x7f0e9009d6f0 2023-10-01T08:00:26.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.411+0000 7f0e94c40700 1 -- 172.21.15.26:0/2040202035 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e90074ea0 con 0x7f0e9009d6f0 2023-10-01T08:00:26.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.411+0000 7f0e7effd700 1 -- 172.21.15.26:0/2040202035 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0e8003fc20 con 0x7f0e9009d6f0 2023-10-01T08:00:26.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.420+0000 7f0e7effd700 1 -- 172.21.15.26:0/2040202035 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0e8000ce80 con 0x7f0e9009d6f0 2023-10-01T08:00:26.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.455+0000 7f076e357700 1 Processor -- start 2023-10-01T08:00:26.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.455+0000 7f076e357700 1 -- start start 2023-10-01T08:00:26.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.455+0000 7f076e357700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f076809e930 0x7f076809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:26.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.455+0000 7f076e357700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f076809f240 0x7f07681317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:26.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.455+0000 7f076e357700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0768070940 con 0x7f076809f650 2023-10-01T08:00:26.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.455+0000 7f076e357700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076806fd60 con 0x7f076809e930 2023-10-01T08:00:26.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.456+0000 7f076e357700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f076806fa80 con 0x7f076809f240 2023-10-01T08:00:26.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.456+0000 7f0767fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f076809e930 0x7f076809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:26.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.456+0000 7f076c8f4700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f076809f650 0x7f0768131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46644/0 (socket says 172.21.15.26:46644) 2023-10-01T08:00:26.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.456+0000 7f076c8f4700 1 -- 172.21.15.26:0/2187660221 learned_addr learned my addr 172.21.15.26:0/2187660221 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:26.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.456+0000 7f07677fe700 1 --2- 172.21.15.26:0/2187660221 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f076809f240 0x7f07681317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:26.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.456+0000 7f0766ffd700 1 -- 172.21.15.26:0/2187660221 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 427482608 0 0) 0x7f0768070940 con 0x7f076809f650 2023-10-01T08:00:26.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.456+0000 7f0767fff700 1 -- 172.21.15.26:0/2187660221 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f076809f240 msgr2=0x7f07681317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:26.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.456+0000 7f0767fff700 1 --2- 172.21.15.26:0/2187660221 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f076809f240 0x7f07681317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.456+0000 7f0767fff700 1 -- 172.21.15.26:0/2187660221 >> v1:172.21.15.26:6789/0 conn(0x7f076809f650 legacy=0x7f0768131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:26.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.456+0000 7f0767fff700 1 -- 172.21.15.26:0/2187660221 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076809fb60 con 0x7f076809e930 2023-10-01T08:00:26.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.456+0000 7f0767fff700 1 --2- 172.21.15.26:0/2187660221 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f076809e930 0x7f076809ed00 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f0758009870 tx=0x7f0758009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27ac9cd54c270090 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:26.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.457+0000 7f0766ffd700 1 -- 172.21.15.26:0/2187660221 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0758011830 con 0x7f076809e930 2023-10-01T08:00:26.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.457+0000 7f0766ffd700 1 -- 172.21.15.26:0/2187660221 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0758011990 con 0x7f076809e930 2023-10-01T08:00:26.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.457+0000 7f0766ffd700 1 -- 172.21.15.26:0/2187660221 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0758011d20 con 0x7f076809e930 2023-10-01T08:00:26.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.458+0000 7f076e357700 1 -- 172.21.15.26:0/2187660221 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f076809e930 msgr2=0x7f076809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:26.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.458+0000 7f076e357700 1 --2- 172.21.15.26:0/2187660221 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f076809e930 0x7f076809ed00 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f0758009870 tx=0x7f0758009b80 comp rx=0 tx=0).stop 2023-10-01T08:00:26.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.458+0000 7f076e357700 1 -- 172.21.15.26:0/2187660221 shutdown_connections 2023-10-01T08:00:26.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.458+0000 7f076e357700 1 --2- 172.21.15.26:0/2187660221 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f076809e930 0x7f076809ed00 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.458+0000 7f076e357700 1 --2- 172.21.15.26:0/2187660221 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f076809f240 0x7f07681317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.458+0000 7f076e357700 1 -- 172.21.15.26:0/2187660221 >> 172.21.15.26:0/2187660221 conn(0x7f07680a4210 msgr2=0x7f07680a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:26.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.458+0000 7f076e357700 1 -- 172.21.15.26:0/2187660221 shutdown_connections 2023-10-01T08:00:26.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.458+0000 7f076e357700 1 -- 172.21.15.26:0/2187660221 wait complete. 2023-10-01T08:00:26.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.459+0000 7f076e357700 1 Processor -- start 2023-10-01T08:00:26.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.460+0000 7f076e357700 1 -- start start 2023-10-01T08:00:26.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.460+0000 7f076e357700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f076809e930 0x7f07681a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:26.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.460+0000 7f076e357700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f076809f240 0x7f07681a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:26.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.460+0000 7f076e357700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f076809f650 0x7f07681a45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:26.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.460+0000 7f076e357700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07681a7640 con 0x7f076809f650 2023-10-01T08:00:26.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.460+0000 7f076e357700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07681a6a10 con 0x7f076809f240 2023-10-01T08:00:26.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.460+0000 7f076e357700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07681a5d10 con 0x7f076809e930 2023-10-01T08:00:26.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.460+0000 7f07677fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f076809f240 0x7f07681a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:26.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.460+0000 7f0767fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f076809e930 0x7f07681a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:26.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.460+0000 7f07677fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f076809f240 0x7f07681a4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38326/0 (socket says 172.21.15.26:38326) 2023-10-01T08:00:26.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.460+0000 7f07677fe700 1 -- 172.21.15.26:0/1306380159 learned_addr learned my addr 172.21.15.26:0/1306380159 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:26.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.461+0000 7f076c8f4700 1 --2- 172.21.15.26:0/1306380159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f076809f650 0x7f07681a45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:26.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.461+0000 7f076c8f4700 1 -- 172.21.15.26:0/1306380159 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f076809e930 msgr2=0x7f07681a3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:26.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.461+0000 7f076c8f4700 1 --2- 172.21.15.26:0/1306380159 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f076809e930 0x7f07681a3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.461+0000 7f076c8f4700 1 -- 172.21.15.26:0/1306380159 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f076809f240 msgr2=0x7f07681a4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:26.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.461+0000 7f076c8f4700 1 --2- 172.21.15.26:0/1306380159 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f076809f240 0x7f07681a4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.461+0000 7f076c8f4700 1 -- 172.21.15.26:0/1306380159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07580094a0 con 0x7f076809f650 2023-10-01T08:00:26.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.461+0000 7f0767fff700 1 --2- 172.21.15.26:0/1306380159 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f076809e930 0x7f07681a3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:26.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.461+0000 7f07677fe700 1 --2- 172.21.15.26:0/1306380159 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f076809f240 0x7f07681a4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:26.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.461+0000 7f076c8f4700 1 --2- 172.21.15.26:0/1306380159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f076809f650 0x7f07681a45a0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f076809faf0 tx=0x7f076000cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:26.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.461+0000 7f0764ff9700 1 -- 172.21.15.26:0/1306380159 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076000aa40 con 0x7f076809f650 2023-10-01T08:00:26.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.461+0000 7f0764ff9700 1 -- 172.21.15.26:0/1306380159 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076000abc0 con 0x7f076809f650 2023-10-01T08:00:26.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.461+0000 7f076e357700 1 -- 172.21.15.26:0/1306380159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07680a0190 con 0x7f076809f650 2023-10-01T08:00:26.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.461+0000 7f0764ff9700 1 -- 172.21.15.26:0/1306380159 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07600070d0 con 0x7f076809f650 2023-10-01T08:00:26.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.462+0000 7f076e357700 1 -- 172.21.15.26:0/1306380159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0768071d20 con 0x7f076809f650 2023-10-01T08:00:26.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.462+0000 7f0764ff9700 1 -- 172.21.15.26:0/1306380159 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0760007230 con 0x7f076809f650 2023-10-01T08:00:26.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.463+0000 7f0764ff9700 1 -- 172.21.15.26:0/1306380159 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f076003f4c0 con 0x7f076809f650 2023-10-01T08:00:26.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.463+0000 7f076e357700 1 -- 172.21.15.26:0/1306380159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07681a0b30 con 0x7f076809f650 2023-10-01T08:00:26.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.468+0000 7f0764ff9700 1 -- 172.21.15.26:0/1306380159 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0760018020 con 0x7f076809f650 2023-10-01T08:00:26.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.500+0000 7fa92ffd2700 1 Processor -- start 2023-10-01T08:00:26.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.500+0000 7fa92ffd2700 1 -- start start 2023-10-01T08:00:26.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.501+0000 7fa92ffd2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa928133a80 0x7fa928133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:26.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.501+0000 7fa92ffd2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa92812ff20 0x7fa928130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:26.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.501+0000 7fa92ffd2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa928130870 0x7fa92813a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.501+0000 7fa92ffd2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa92806c570 con 0x7fa92812ff20 2023-10-01T08:00:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.501+0000 7fa92ffd2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa92806bc00 con 0x7fa928133a80 2023-10-01T08:00:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.501+0000 7fa92ffd2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9280a0040 con 0x7fa928130870 2023-10-01T08:00:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.501+0000 7fa92dd6e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa928133a80 0x7fa928133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.501+0000 7fa92e56f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa928130870 0x7fa92813a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.501+0000 7fa92d56d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa92812ff20 0x7fa928130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.501+0000 7fa92dd6e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa928133a80 0x7fa928133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38336/0 (socket says 172.21.15.26:38336) 2023-10-01T08:00:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.501+0000 7fa92dd6e700 1 -- 172.21.15.26:0/3638743844 learned_addr learned my addr 172.21.15.26:0/3638743844 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.502+0000 7fa92d56d700 1 -- 172.21.15.26:0/3638743844 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa928130870 msgr2=0x7fa92813a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.502+0000 7fa92d56d700 1 --2- 172.21.15.26:0/3638743844 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa928130870 0x7fa92813a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.502+0000 7fa92d56d700 1 -- 172.21.15.26:0/3638743844 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa928133a80 msgr2=0x7fa928133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:26.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.502+0000 7fa92d56d700 1 --2- 172.21.15.26:0/3638743844 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa928133a80 0x7fa928133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.502+0000 7fa92d56d700 1 -- 172.21.15.26:0/3638743844 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa928133860 con 0x7fa92812ff20 2023-10-01T08:00:26.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.502+0000 7fa92e56f700 1 --2- 172.21.15.26:0/3638743844 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa928130870 0x7fa92813a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:26.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.502+0000 7fa92dd6e700 1 --2- 172.21.15.26:0/3638743844 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa928133a80 0x7fa928133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:26.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.502+0000 7fa92d56d700 1 --2- 172.21.15.26:0/3638743844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa92812ff20 0x7fa928130330 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fa918009840 tx=0x7fa918009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3350f1bb4151b3b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:26.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.502+0000 7fa92cd6c700 1 -- 172.21.15.26:0/3638743844 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa918011830 con 0x7fa92812ff20 2023-10-01T08:00:26.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.502+0000 7fa92cd6c700 1 -- 172.21.15.26:0/3638743844 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa918011990 con 0x7fa92812ff20 2023-10-01T08:00:26.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.502+0000 7fa92cd6c700 1 -- 172.21.15.26:0/3638743844 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa918011d20 con 0x7fa92812ff20 2023-10-01T08:00:26.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.503+0000 7fa92ffd2700 1 -- 172.21.15.26:0/3638743844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa92812ff20 msgr2=0x7fa928130330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:26.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.503+0000 7fa92ffd2700 1 --2- 172.21.15.26:0/3638743844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa92812ff20 0x7fa928130330 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fa918009840 tx=0x7fa918009b50 comp rx=0 tx=0).stop 2023-10-01T08:00:26.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.503+0000 7fa92ffd2700 1 -- 172.21.15.26:0/3638743844 shutdown_connections 2023-10-01T08:00:26.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.503+0000 7fa92ffd2700 1 --2- 172.21.15.26:0/3638743844 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa928130870 0x7fa92813a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.503+0000 7fa92ffd2700 1 --2- 172.21.15.26:0/3638743844 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa928133a80 0x7fa928133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.503+0000 7fa92ffd2700 1 --2- 172.21.15.26:0/3638743844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa92812ff20 0x7fa928130330 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.503+0000 7fa92ffd2700 1 -- 172.21.15.26:0/3638743844 >> 172.21.15.26:0/3638743844 conn(0x7fa9280a4210 msgr2=0x7fa9280a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:26.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.503+0000 7fa92ffd2700 1 -- 172.21.15.26:0/3638743844 shutdown_connections 2023-10-01T08:00:26.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.503+0000 7fa92ffd2700 1 -- 172.21.15.26:0/3638743844 wait complete. 2023-10-01T08:00:26.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.504+0000 7fa92ffd2700 1 Processor -- start 2023-10-01T08:00:26.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.504+0000 7fa92ffd2700 1 -- start start 2023-10-01T08:00:26.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.504+0000 7fa92ffd2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa92812ff20 0x7fa92809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:26.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.504+0000 7fa92ffd2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa928130870 0x7fa92809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:26.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.504+0000 7fa92ffd2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa928133a80 0x7fa92809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:26.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.504+0000 7fa92ffd2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92809e050 con 0x7fa928130870 2023-10-01T08:00:26.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.504+0000 7fa92ffd2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa92812daa0 con 0x7fa92812ff20 2023-10-01T08:00:26.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.504+0000 7fa92ffd2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9281201c0 con 0x7fa928133a80 2023-10-01T08:00:26.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.504+0000 7fa92dd6e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa92812ff20 0x7fa92809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:26.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.504+0000 7fa92dd6e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa92812ff20 0x7fa92809c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38342/0 (socket says 172.21.15.26:38342) 2023-10-01T08:00:26.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.504+0000 7fa92dd6e700 1 -- 172.21.15.26:0/1258363455 learned_addr learned my addr 172.21.15.26:0/1258363455 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:26.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.504+0000 7fa92d56d700 1 --2- 172.21.15.26:0/1258363455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa928130870 0x7fa92809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:26.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.505+0000 7fa92e56f700 1 --2- 172.21.15.26:0/1258363455 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa928133a80 0x7fa92809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:26.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.505+0000 7fa92dd6e700 1 -- 172.21.15.26:0/1258363455 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa928133a80 msgr2=0x7fa92809cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:26.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.505+0000 7fa92dd6e700 1 --2- 172.21.15.26:0/1258363455 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa928133a80 0x7fa92809cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.505+0000 7fa92dd6e700 1 -- 172.21.15.26:0/1258363455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa928130870 msgr2=0x7fa92809c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:26.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.505+0000 7fa92dd6e700 1 --2- 172.21.15.26:0/1258363455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa928130870 0x7fa92809c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.505+0000 7fa92dd6e700 1 -- 172.21.15.26:0/1258363455 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa920009a70 con 0x7fa92812ff20 2023-10-01T08:00:26.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.505+0000 7fa92dd6e700 1 --2- 172.21.15.26:0/1258363455 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa92812ff20 0x7fa92809c480 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fa92400ebe0 tx=0x7fa92400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:26.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.505+0000 7fa91e7fc700 1 -- 172.21.15.26:0/1258363455 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92400c850 con 0x7fa92812ff20 2023-10-01T08:00:26.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.505+0000 7fa91e7fc700 1 -- 172.21.15.26:0/1258363455 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa92400c9b0 con 0x7fa92812ff20 2023-10-01T08:00:26.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.505+0000 7fa92ffd2700 1 -- 172.21.15.26:0/1258363455 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa924009550 con 0x7fa92812ff20 2023-10-01T08:00:26.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.505+0000 7fa91e7fc700 1 -- 172.21.15.26:0/1258363455 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92400cd20 con 0x7fa92812ff20 2023-10-01T08:00:26.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.505+0000 7fa92ffd2700 1 -- 172.21.15.26:0/1258363455 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9180094a0 con 0x7fa92812ff20 2023-10-01T08:00:26.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.506+0000 7fa91e7fc700 1 -- 172.21.15.26:0/1258363455 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa924013470 con 0x7fa92812ff20 2023-10-01T08:00:26.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.506+0000 7fa91e7fc700 1 -- 172.21.15.26:0/1258363455 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa92403fae0 con 0x7fa92812ff20 2023-10-01T08:00:26.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.507+0000 7fa92ffd2700 1 -- 172.21.15.26:0/1258363455 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9280a2130 con 0x7fa92812ff20 2023-10-01T08:00:26.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.512+0000 7fa91e7fc700 1 -- 172.21.15.26:0/1258363455 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa92401b3b0 con 0x7fa92812ff20 2023-10-01T08:00:26.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.636+0000 7f0e94c40700 1 -- 172.21.15.26:0/2040202035 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0e9006c360 con 0x7f0e9009d6f0 2023-10-01T08:00:26.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.637+0000 7f0e7effd700 1 -- 172.21.15.26:0/2040202035 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0e80021030 con 0x7f0e9009d6f0 2023-10-01T08:00:26.637 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:26.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.639+0000 7f0e94c40700 1 -- 172.21.15.26:0/2040202035 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e9009d6f0 msgr2=0x7f0e901c4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:26.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.639+0000 7f0e94c40700 1 --2- 172.21.15.26:0/2040202035 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e9009d6f0 0x7f0e901c4f20 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f0e8000ebe0 tx=0x7f0e8000eef0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.639+0000 7f0e94c40700 1 -- 172.21.15.26:0/2040202035 shutdown_connections 2023-10-01T08:00:26.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.639+0000 7f0e94c40700 1 --2- 172.21.15.26:0/2040202035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e9009e410 0x7f0e901c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.639+0000 7f0e94c40700 1 --2- 172.21.15.26:0/2040202035 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e9009d6f0 0x7f0e901c4f20 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.639+0000 7f0e94c40700 1 --2- 172.21.15.26:0/2040202035 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0e9009e000 0x7f0e901c5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.639+0000 7f0e94c40700 1 -- 172.21.15.26:0/2040202035 >> 172.21.15.26:0/2040202035 conn(0x7f0e90066f50 msgr2=0x7f0e901bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:26.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.639+0000 7f0e94c40700 1 -- 172.21.15.26:0/2040202035 shutdown_connections 2023-10-01T08:00:26.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.639+0000 7f0e94c40700 1 -- 172.21.15.26:0/2040202035 wait complete. 2023-10-01T08:00:26.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:26.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.676+0000 7f076e357700 1 -- 172.21.15.26:0/1306380159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f07681a71e0 con 0x7f076809f650 2023-10-01T08:00:26.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.676+0000 7f0764ff9700 1 -- 172.21.15.26:0/1306380159 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f07600074e0 con 0x7f076809f650 2023-10-01T08:00:26.677 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:26.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.678+0000 7f076e357700 1 -- 172.21.15.26:0/1306380159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f076809f650 msgr2=0x7f07681a45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:26.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.678+0000 7f076e357700 1 --2- 172.21.15.26:0/1306380159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f076809f650 0x7f07681a45a0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f076809faf0 tx=0x7f076000cec0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.678+0000 7f076e357700 1 -- 172.21.15.26:0/1306380159 shutdown_connections 2023-10-01T08:00:26.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.678+0000 7f076e357700 1 --2- 172.21.15.26:0/1306380159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f076809f650 0x7f07681a45a0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.678+0000 7f076e357700 1 --2- 172.21.15.26:0/1306380159 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f076809e930 0x7f07681a3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.678+0000 7f076e357700 1 --2- 172.21.15.26:0/1306380159 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f076809f240 0x7f07681a4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.678+0000 7f076e357700 1 -- 172.21.15.26:0/1306380159 >> 172.21.15.26:0/1306380159 conn(0x7f07680a4210 msgr2=0x7f07681b8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:26.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.679+0000 7f076e357700 1 -- 172.21.15.26:0/1306380159 shutdown_connections 2023-10-01T08:00:26.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.679+0000 7f076e357700 1 -- 172.21.15.26:0/1306380159 wait complete. 2023-10-01T08:00:26.693 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:26.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.722+0000 7fa92ffd2700 1 -- 172.21.15.26:0/1258363455 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa928074ea0 con 0x7fa92812ff20 2023-10-01T08:00:26.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.722+0000 7fa91e7fc700 1 -- 172.21.15.26:0/1258363455 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa924017020 con 0x7fa92812ff20 2023-10-01T08:00:26.723 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:26.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.725+0000 7fa92ffd2700 1 -- 172.21.15.26:0/1258363455 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa92812ff20 msgr2=0x7fa92809c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:26.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.725+0000 7fa92ffd2700 1 --2- 172.21.15.26:0/1258363455 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa92812ff20 0x7fa92809c480 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fa92400ebe0 tx=0x7fa92400eef0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.725+0000 7fa92ffd2700 1 -- 172.21.15.26:0/1258363455 shutdown_connections 2023-10-01T08:00:26.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.725+0000 7fa92ffd2700 1 --2- 172.21.15.26:0/1258363455 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa928133a80 0x7fa92809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.725+0000 7fa92ffd2700 1 --2- 172.21.15.26:0/1258363455 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa92812ff20 0x7fa92809c480 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.725+0000 7fa92ffd2700 1 --2- 172.21.15.26:0/1258363455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa928130870 0x7fa92809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:26.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.725+0000 7fa92ffd2700 1 -- 172.21.15.26:0/1258363455 >> 172.21.15.26:0/1258363455 conn(0x7fa9280a4210 msgr2=0x7fa9280a0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:26.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.725+0000 7fa92ffd2700 1 -- 172.21.15.26:0/1258363455 shutdown_connections 2023-10-01T08:00:26.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:26.725+0000 7fa92ffd2700 1 -- 172.21.15.26:0/1258363455 wait complete. 2023-10-01T08:00:26.739 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:27.395 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:27.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.541+0000 7f7e37e55700 1 Processor -- start 2023-10-01T08:00:27.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.541+0000 7f7e37e55700 1 -- start start 2023-10-01T08:00:27.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.542+0000 7f7e37e55700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7e30133570 0x7f7e30135950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:27.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.542+0000 7f7e37e55700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7e30135e90 0x7f7e30138270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:27.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.542+0000 7f7e37e55700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e3009c280 con 0x7f7e300954c0 2023-10-01T08:00:27.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.542+0000 7f7e37e55700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3009aaf0 con 0x7f7e30133570 2023-10-01T08:00:27.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.542+0000 7f7e37e55700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3009b960 con 0x7f7e30135e90 2023-10-01T08:00:27.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.542+0000 7f7e35bf1700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7e300954c0 0x7f7e30095890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46660/0 (socket says 172.21.15.26:46660) 2023-10-01T08:00:27.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.542+0000 7f7e353f0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7e30133570 0x7f7e30135950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:27.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.542+0000 7f7e35bf1700 1 -- 172.21.15.26:0/4094288967 learned_addr learned my addr 172.21.15.26:0/4094288967 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:27.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.542+0000 7f7e363f2700 1 --2- 172.21.15.26:0/4094288967 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7e30135e90 0x7f7e30138270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:27.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.542+0000 7f7e34bef700 1 -- 172.21.15.26:0/4094288967 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 598346778 0 0) 0x7f7e3009c280 con 0x7f7e300954c0 2023-10-01T08:00:27.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.542+0000 7f7e353f0700 1 -- 172.21.15.26:0/4094288967 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7e30135e90 msgr2=0x7f7e30138270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:27.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.542+0000 7f7e353f0700 1 --2- 172.21.15.26:0/4094288967 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7e30135e90 0x7f7e30138270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:27.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.542+0000 7f7e353f0700 1 -- 172.21.15.26:0/4094288967 >> v1:172.21.15.26:6789/0 conn(0x7f7e300954c0 legacy=0x7f7e30095890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:27.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.542+0000 7f7e353f0700 1 -- 172.21.15.26:0/4094288967 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3009a7b0 con 0x7f7e30133570 2023-10-01T08:00:27.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.543+0000 7f7e353f0700 1 --2- 172.21.15.26:0/4094288967 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7e30133570 0x7f7e30135950 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f7e2000ddc0 tx=0x7f7e2000f330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83d7026422622faf server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:27.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.543+0000 7f7e34bef700 1 -- 172.21.15.26:0/4094288967 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e20012070 con 0x7f7e30133570 2023-10-01T08:00:27.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.543+0000 7f7e34bef700 1 -- 172.21.15.26:0/4094288967 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e2000fb20 con 0x7f7e30133570 2023-10-01T08:00:27.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.543+0000 7f7e34bef700 1 -- 172.21.15.26:0/4094288967 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e20016430 con 0x7f7e30133570 2023-10-01T08:00:27.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.543+0000 7f7e37e55700 1 -- 172.21.15.26:0/4094288967 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7e30133570 msgr2=0x7f7e30135950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:27.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.543+0000 7f7e37e55700 1 --2- 172.21.15.26:0/4094288967 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7e30133570 0x7f7e30135950 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f7e2000ddc0 tx=0x7f7e2000f330 comp rx=0 tx=0).stop 2023-10-01T08:00:27.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.543+0000 7f7e37e55700 1 -- 172.21.15.26:0/4094288967 shutdown_connections 2023-10-01T08:00:27.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.543+0000 7f7e37e55700 1 --2- 172.21.15.26:0/4094288967 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7e30135e90 0x7f7e30138270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:27.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.543+0000 7f7e37e55700 1 --2- 172.21.15.26:0/4094288967 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7e30133570 0x7f7e30135950 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:27.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.543+0000 7f7e37e55700 1 -- 172.21.15.26:0/4094288967 >> 172.21.15.26:0/4094288967 conn(0x7f7e300a2360 msgr2=0x7f7e300a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:27.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.543+0000 7f7e37e55700 1 -- 172.21.15.26:0/4094288967 shutdown_connections 2023-10-01T08:00:27.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.543+0000 7f7e37e55700 1 -- 172.21.15.26:0/4094288967 wait complete. 2023-10-01T08:00:27.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.544+0000 7f7e37e55700 1 Processor -- start 2023-10-01T08:00:27.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.544+0000 7f7e37e55700 1 -- start start 2023-10-01T08:00:27.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.545+0000 7f7e37e55700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e300954c0 0x7f7e30070e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:27.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.545+0000 7f7e37e55700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7e30133570 0x7f7e30071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:27.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.545+0000 7f7e37e55700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7e30135e90 0x7f7e300718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:27.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.545+0000 7f7e37e55700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3008b2c0 con 0x7f7e300954c0 2023-10-01T08:00:27.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.545+0000 7f7e37e55700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e300729d0 con 0x7f7e30133570 2023-10-01T08:00:27.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.545+0000 7f7e37e55700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e30099f60 con 0x7f7e30135e90 2023-10-01T08:00:27.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.545+0000 7f7e35bf1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e300954c0 0x7f7e30070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:27.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.545+0000 7f7e353f0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7e30133570 0x7f7e30071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:27.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.545+0000 7f7e353f0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7e30133570 0x7f7e30071380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38358/0 (socket says 172.21.15.26:38358) 2023-10-01T08:00:27.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.545+0000 7f7e35bf1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e300954c0 0x7f7e30070e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47194/0 (socket says 172.21.15.26:47194) 2023-10-01T08:00:27.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.545+0000 7f7e353f0700 1 -- 172.21.15.26:0/53176393 learned_addr learned my addr 172.21.15.26:0/53176393 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:27.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.545+0000 7f7e363f2700 1 --2- 172.21.15.26:0/53176393 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7e30135e90 0x7f7e300718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:27.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.545+0000 7f7e353f0700 1 -- 172.21.15.26:0/53176393 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7e30135e90 msgr2=0x7f7e300718c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:27.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.545+0000 7f7e353f0700 1 --2- 172.21.15.26:0/53176393 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7e30135e90 0x7f7e300718c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:27.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.545+0000 7f7e353f0700 1 -- 172.21.15.26:0/53176393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e300954c0 msgr2=0x7f7e30070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:27.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.545+0000 7f7e353f0700 1 --2- 172.21.15.26:0/53176393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e300954c0 0x7f7e30070e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:27.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.545+0000 7f7e353f0700 1 -- 172.21.15.26:0/53176393 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e2000da70 con 0x7f7e30133570 2023-10-01T08:00:27.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.545+0000 7f7e363f2700 1 --2- 172.21.15.26:0/53176393 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7e30135e90 0x7f7e300718c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:27.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.545+0000 7f7e35bf1700 1 --2- 172.21.15.26:0/53176393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e300954c0 0x7f7e30070e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:27.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.546+0000 7f7e353f0700 1 --2- 172.21.15.26:0/53176393 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7e30133570 0x7f7e30071380 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f7e20018040 tx=0x7f7e20004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:27.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.546+0000 7f7e267fc700 1 -- 172.21.15.26:0/53176393 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e20003ab0 con 0x7f7e30133570 2023-10-01T08:00:27.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.546+0000 7f7e267fc700 1 -- 172.21.15.26:0/53176393 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e20024070 con 0x7f7e30133570 2023-10-01T08:00:27.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.546+0000 7f7e267fc700 1 -- 172.21.15.26:0/53176393 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e20003e90 con 0x7f7e30133570 2023-10-01T08:00:27.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.546+0000 7f7e37e55700 1 -- 172.21.15.26:0/53176393 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e3008c940 con 0x7f7e30133570 2023-10-01T08:00:27.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.546+0000 7f7e37e55700 1 -- 172.21.15.26:0/53176393 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e3008d3b0 con 0x7f7e30133570 2023-10-01T08:00:27.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.547+0000 7f7e267fc700 1 -- 172.21.15.26:0/53176393 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7e20016430 con 0x7f7e30133570 2023-10-01T08:00:27.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.547+0000 7f7e267fc700 1 -- 172.21.15.26:0/53176393 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7e20026070 con 0x7f7e30133570 2023-10-01T08:00:27.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.547+0000 7f7e37e55700 1 -- 172.21.15.26:0/53176393 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e3009b000 con 0x7f7e30133570 2023-10-01T08:00:27.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.552+0000 7f7e267fc700 1 -- 172.21.15.26:0/53176393 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e2001f400 con 0x7f7e30133570 2023-10-01T08:00:27.654 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:27.693 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:27.740 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:27.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.760+0000 7f7e37e55700 1 -- 172.21.15.26:0/53176393 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7e30074ea0 con 0x7f7e30133570 2023-10-01T08:00:27.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.760+0000 7f7e267fc700 1 -- 172.21.15.26:0/53176393 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7e200343a0 con 0x7f7e30133570 2023-10-01T08:00:27.762 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:27.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.763+0000 7f7e37e55700 1 -- 172.21.15.26:0/53176393 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7e30133570 msgr2=0x7f7e30071380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:27.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.763+0000 7f7e37e55700 1 --2- 172.21.15.26:0/53176393 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7e30133570 0x7f7e30071380 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f7e20018040 tx=0x7f7e20004750 comp rx=0 tx=0).stop 2023-10-01T08:00:27.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.763+0000 7f7e37e55700 1 -- 172.21.15.26:0/53176393 shutdown_connections 2023-10-01T08:00:27.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.763+0000 7f7e37e55700 1 --2- 172.21.15.26:0/53176393 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7e30135e90 0x7f7e300718c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:27.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.763+0000 7f7e37e55700 1 --2- 172.21.15.26:0/53176393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e300954c0 0x7f7e30070e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:27.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.763+0000 7f7e37e55700 1 --2- 172.21.15.26:0/53176393 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7e30133570 0x7f7e30071380 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:27.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.763+0000 7f7e37e55700 1 -- 172.21.15.26:0/53176393 >> 172.21.15.26:0/53176393 conn(0x7f7e300a2360 msgr2=0x7f7e300a0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:27.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.764+0000 7f7e37e55700 1 -- 172.21.15.26:0/53176393 shutdown_connections 2023-10-01T08:00:27.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.764+0000 7f7e37e55700 1 -- 172.21.15.26:0/53176393 wait complete. 2023-10-01T08:00:27.782 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:27.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.798+0000 7f74882e7700 1 Processor -- start 2023-10-01T08:00:27.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.798+0000 7f74882e7700 1 -- start start 2023-10-01T08:00:27.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.799+0000 7f74882e7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f74801338a0 0x7f7480133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:27.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.799+0000 7f74882e7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f748009e930 0x7f748013b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:27.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.799+0000 7f74882e7700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f748006ef30 con 0x7f748009de50 2023-10-01T08:00:27.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.799+0000 7f74882e7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748006fef0 con 0x7f74801338a0 2023-10-01T08:00:27.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.799+0000 7f74882e7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74801334b0 con 0x7f748009e930 2023-10-01T08:00:27.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.799+0000 7f7486083700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f74801338a0 0x7f7480133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:27.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.799+0000 7f7485882700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f748009de50 0x7f748009e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46672/0 (socket says 172.21.15.26:46672) 2023-10-01T08:00:27.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.799+0000 7f7485882700 1 -- 172.21.15.26:0/1775900321 learned_addr learned my addr 172.21.15.26:0/1775900321 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:27.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.799+0000 7f7486884700 1 --2- 172.21.15.26:0/1775900321 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f748009e930 0x7f748013b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:27.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.799+0000 7f7485081700 1 -- 172.21.15.26:0/1775900321 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2586505183 0 0) 0x7f748006ef30 con 0x7f748009de50 2023-10-01T08:00:27.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.799+0000 7f7485081700 1 -- 172.21.15.26:0/1775900321 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f746c0035b0 con 0x7f748009de50 2023-10-01T08:00:27.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.799+0000 7f7486884700 1 -- 172.21.15.26:0/1775900321 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f74801338a0 msgr2=0x7f7480133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:27.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.799+0000 7f7486884700 1 --2- 172.21.15.26:0/1775900321 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f74801338a0 0x7f7480133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:27.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.799+0000 7f7486884700 1 -- 172.21.15.26:0/1775900321 >> v1:172.21.15.26:6789/0 conn(0x7f748009de50 legacy=0x7f748009e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:27.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.799+0000 7f7486884700 1 -- 172.21.15.26:0/1775900321 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748006fc30 con 0x7f748009e930 2023-10-01T08:00:27.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.799+0000 7f7486083700 1 --2- 172.21.15.26:0/1775900321 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f74801338a0 0x7f7480133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:27.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.800+0000 7f7486884700 1 --2- 172.21.15.26:0/1775900321 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f748009e930 0x7f748013b740 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f7478009dc0 tx=0x7f747800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56fe4401c24e0e69 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:27.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.800+0000 7f7485081700 1 -- 172.21.15.26:0/1775900321 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747800e070 con 0x7f748009e930 2023-10-01T08:00:27.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.800+0000 7f7485081700 1 -- 172.21.15.26:0/1775900321 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747800bb20 con 0x7f748009e930 2023-10-01T08:00:27.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.800+0000 7f7485081700 1 -- 172.21.15.26:0/1775900321 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7478012430 con 0x7f748009e930 2023-10-01T08:00:27.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.801+0000 7f74882e7700 1 -- 172.21.15.26:0/1775900321 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f748009e930 msgr2=0x7f748013b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:27.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.801+0000 7f74882e7700 1 --2- 172.21.15.26:0/1775900321 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f748009e930 0x7f748013b740 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f7478009dc0 tx=0x7f747800b330 comp rx=0 tx=0).stop 2023-10-01T08:00:27.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.801+0000 7f74882e7700 1 -- 172.21.15.26:0/1775900321 shutdown_connections 2023-10-01T08:00:27.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.801+0000 7f74882e7700 1 --2- 172.21.15.26:0/1775900321 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f748009e930 0x7f748013b740 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:27.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.801+0000 7f74882e7700 1 --2- 172.21.15.26:0/1775900321 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f74801338a0 0x7f7480133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:27.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.801+0000 7f74882e7700 1 -- 172.21.15.26:0/1775900321 >> 172.21.15.26:0/1775900321 conn(0x7f74800a2aa0 msgr2=0x7f74800a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:27.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.801+0000 7f74882e7700 1 -- 172.21.15.26:0/1775900321 shutdown_connections 2023-10-01T08:00:27.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.801+0000 7f74882e7700 1 -- 172.21.15.26:0/1775900321 wait complete. 2023-10-01T08:00:27.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.802+0000 7f74882e7700 1 Processor -- start 2023-10-01T08:00:27.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.802+0000 7f74882e7700 1 -- start start 2023-10-01T08:00:27.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.802+0000 7f74882e7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f748009de50 0x7f748011b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:27.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.802+0000 7f74882e7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f748009e930 0x7f748011bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:27.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.802+0000 7f74882e7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f74801338a0 0x7f748011c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:27.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.802+0000 7f74882e7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748011e0a0 con 0x7f748009e930 2023-10-01T08:00:27.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.802+0000 7f74882e7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748011d220 con 0x7f74801338a0 2023-10-01T08:00:27.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.802+0000 7f74882e7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f748006f640 con 0x7f748009de50 2023-10-01T08:00:27.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.802+0000 7f7486083700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f748009de50 0x7f748011b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:27.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.802+0000 7f7486083700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f748009de50 0x7f748011b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:34184/0 (socket says 172.21.15.26:34184) 2023-10-01T08:00:27.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.802+0000 7f7486083700 1 -- 172.21.15.26:0/2878171015 learned_addr learned my addr 172.21.15.26:0/2878171015 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:27.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.803+0000 7f7486884700 1 --2- 172.21.15.26:0/2878171015 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f74801338a0 0x7f748011c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:27.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.803+0000 7f7485882700 1 --2- 172.21.15.26:0/2878171015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f748009e930 0x7f748011bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:27.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.803+0000 7f7486083700 1 -- 172.21.15.26:0/2878171015 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f74801338a0 msgr2=0x7f748011c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:27.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.803+0000 7f7486083700 1 --2- 172.21.15.26:0/2878171015 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f74801338a0 0x7f748011c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:27.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.803+0000 7f7486083700 1 -- 172.21.15.26:0/2878171015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f748009e930 msgr2=0x7f748011bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:27.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.803+0000 7f7486083700 1 --2- 172.21.15.26:0/2878171015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f748009e930 0x7f748011bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:27.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.803+0000 7f7486083700 1 -- 172.21.15.26:0/2878171015 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747c0094a0 con 0x7f748009de50 2023-10-01T08:00:27.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.803+0000 7f7485882700 1 --2- 172.21.15.26:0/2878171015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f748009e930 0x7f748011bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T08:00:27.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.803+0000 7f7486083700 1 --2- 172.21.15.26:0/2878171015 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f748009de50 0x7f748011b850 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f747c00ec10 tx=0x7f747c00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:27.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.803+0000 7f7476ffd700 1 -- 172.21.15.26:0/2878171015 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747c00c910 con 0x7f748009de50 2023-10-01T08:00:27.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.803+0000 7f7476ffd700 1 -- 172.21.15.26:0/2878171015 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747c00ca70 con 0x7f748009de50 2023-10-01T08:00:27.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.803+0000 7f74882e7700 1 -- 172.21.15.26:0/2878171015 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7478009a70 con 0x7f748009de50 2023-10-01T08:00:27.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.803+0000 7f7476ffd700 1 -- 172.21.15.26:0/2878171015 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747c00cde0 con 0x7f748009de50 2023-10-01T08:00:27.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.803+0000 7f74882e7700 1 -- 172.21.15.26:0/2878171015 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f748011ee40 con 0x7f748009de50 2023-10-01T08:00:27.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.804+0000 7f74882e7700 1 -- 172.21.15.26:0/2878171015 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74801babb0 con 0x7f748009de50 2023-10-01T08:00:27.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.805+0000 7f7476ffd700 1 -- 172.21.15.26:0/2878171015 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f747c013470 con 0x7f748009de50 2023-10-01T08:00:27.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.805+0000 7f7476ffd700 1 -- 172.21.15.26:0/2878171015 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f747c040200 con 0x7f748009de50 2023-10-01T08:00:27.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.814+0000 7f7476ffd700 1 -- 172.21.15.26:0/2878171015 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f747c011350 con 0x7f748009de50 2023-10-01T08:00:27.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.843+0000 7fd59f555700 1 Processor -- start 2023-10-01T08:00:27.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.843+0000 7fd59f555700 1 -- start start 2023-10-01T08:00:27.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.843+0000 7fd59f555700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd5980a0a30 0x7fd5980a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:27.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.843+0000 7fd59f555700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd5980a1340 0x7fd598133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:27.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.843+0000 7fd59f555700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd598133fa0 0x7fd598134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:27.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.843+0000 7fd59f555700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd59809edd0 con 0x7fd5980a0a30 2023-10-01T08:00:27.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.843+0000 7fd59f555700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd59809e1f0 con 0x7fd598133fa0 2023-10-01T08:00:27.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.843+0000 7fd59f555700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd59809dc50 con 0x7fd5980a1340 2023-10-01T08:00:27.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.844+0000 7fd59caf0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd5980a1340 0x7fd598133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:27.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.844+0000 7fd59d2f1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd5980a0a30 0x7fd5980a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:27.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.844+0000 7fd59caf0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd5980a1340 0x7fd598133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:34200/0 (socket says 172.21.15.26:34200) 2023-10-01T08:00:27.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.844+0000 7fd59d2f1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd5980a0a30 0x7fd5980a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47208/0 (socket says 172.21.15.26:47208) 2023-10-01T08:00:27.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.844+0000 7fd59caf0700 1 -- 172.21.15.26:0/3037766904 learned_addr learned my addr 172.21.15.26:0/3037766904 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:27.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.844+0000 7fd59daf2700 1 --2- 172.21.15.26:0/3037766904 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd598133fa0 0x7fd598134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:27.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.844+0000 7fd59d2f1700 1 -- 172.21.15.26:0/3037766904 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd5980a1340 msgr2=0x7fd598133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:27.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.844+0000 7fd59d2f1700 1 --2- 172.21.15.26:0/3037766904 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd5980a1340 0x7fd598133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:27.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.844+0000 7fd59d2f1700 1 -- 172.21.15.26:0/3037766904 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd598133fa0 msgr2=0x7fd598134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:27.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.844+0000 7fd59d2f1700 1 --2- 172.21.15.26:0/3037766904 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd598133fa0 0x7fd598134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:27.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.844+0000 7fd59d2f1700 1 -- 172.21.15.26:0/3037766904 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5980a1fe0 con 0x7fd5980a0a30 2023-10-01T08:00:27.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.844+0000 7fd59daf2700 1 --2- 172.21.15.26:0/3037766904 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd598133fa0 0x7fd598134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:27.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.844+0000 7fd59caf0700 1 --2- 172.21.15.26:0/3037766904 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd5980a1340 0x7fd598133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:27.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.844+0000 7fd59d2f1700 1 --2- 172.21.15.26:0/3037766904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5980a0a30 0x7fd5980a0e00 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fd594009840 tx=0x7fd594009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61bacbaed66fac1 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:27.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.845+0000 7fd58ffff700 1 -- 172.21.15.26:0/3037766904 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd594011830 con 0x7fd5980a0a30 2023-10-01T08:00:27.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.845+0000 7fd58ffff700 1 -- 172.21.15.26:0/3037766904 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd594011990 con 0x7fd5980a0a30 2023-10-01T08:00:27.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.845+0000 7fd58ffff700 1 -- 172.21.15.26:0/3037766904 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd594011d20 con 0x7fd5980a0a30 2023-10-01T08:00:27.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.845+0000 7fd59f555700 1 -- 172.21.15.26:0/3037766904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5980a0a30 msgr2=0x7fd5980a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:27.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.845+0000 7fd59f555700 1 --2- 172.21.15.26:0/3037766904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5980a0a30 0x7fd5980a0e00 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fd594009840 tx=0x7fd594009b50 comp rx=0 tx=0).stop 2023-10-01T08:00:27.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.845+0000 7fd59f555700 1 -- 172.21.15.26:0/3037766904 shutdown_connections 2023-10-01T08:00:27.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.845+0000 7fd59f555700 1 --2- 172.21.15.26:0/3037766904 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd598133fa0 0x7fd598134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:27.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.845+0000 7fd59f555700 1 --2- 172.21.15.26:0/3037766904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5980a0a30 0x7fd5980a0e00 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:27.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.845+0000 7fd59f555700 1 --2- 172.21.15.26:0/3037766904 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd5980a1340 0x7fd598133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:27.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.845+0000 7fd59f555700 1 -- 172.21.15.26:0/3037766904 >> 172.21.15.26:0/3037766904 conn(0x7fd5980a6550 msgr2=0x7fd5980a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:27.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.845+0000 7fd59f555700 1 -- 172.21.15.26:0/3037766904 shutdown_connections 2023-10-01T08:00:27.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.846+0000 7fd59f555700 1 -- 172.21.15.26:0/3037766904 wait complete. 2023-10-01T08:00:27.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.847+0000 7fd59f555700 1 Processor -- start 2023-10-01T08:00:27.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.847+0000 7fd59f555700 1 -- start start 2023-10-01T08:00:27.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.848+0000 7fd59f555700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5980a0a30 0x7fd598120400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:27.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.848+0000 7fd59f555700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd5980a1340 0x7fd598120940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:27.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.848+0000 7fd59f555700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd598133fa0 0x7fd598120e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:27.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.848+0000 7fd59f555700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5981337a0 con 0x7fd5980a0a30 2023-10-01T08:00:27.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.848+0000 7fd59f555700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd598123210 con 0x7fd598133fa0 2023-10-01T08:00:27.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.848+0000 7fd59f555700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd598123bf0 con 0x7fd5980a1340 2023-10-01T08:00:27.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.848+0000 7fd59d2f1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5980a0a30 0x7fd598120400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:27.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.848+0000 7fd59d2f1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5980a0a30 0x7fd598120400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47212/0 (socket says 172.21.15.26:47212) 2023-10-01T08:00:27.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.848+0000 7fd59d2f1700 1 -- 172.21.15.26:0/4163262189 learned_addr learned my addr 172.21.15.26:0/4163262189 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:27.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.848+0000 7fd59caf0700 1 --2- 172.21.15.26:0/4163262189 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd5980a1340 0x7fd598120940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:27.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.848+0000 7fd59daf2700 1 --2- 172.21.15.26:0/4163262189 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd598133fa0 0x7fd598120e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:27.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.848+0000 7fd59d2f1700 1 -- 172.21.15.26:0/4163262189 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd5980a1340 msgr2=0x7fd598120940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:27.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.848+0000 7fd59d2f1700 1 --2- 172.21.15.26:0/4163262189 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd5980a1340 0x7fd598120940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:27.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.848+0000 7fd59d2f1700 1 -- 172.21.15.26:0/4163262189 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd598133fa0 msgr2=0x7fd598120e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:27.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.848+0000 7fd59d2f1700 1 --2- 172.21.15.26:0/4163262189 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd598133fa0 0x7fd598120e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:27.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.848+0000 7fd59d2f1700 1 -- 172.21.15.26:0/4163262189 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd588009550 con 0x7fd5980a0a30 2023-10-01T08:00:27.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.848+0000 7fd59d2f1700 1 --2- 172.21.15.26:0/4163262189 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5980a0a30 0x7fd598120400 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fd594009fd0 tx=0x7fd594004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:27.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.849+0000 7fd58dffb700 1 -- 172.21.15.26:0/4163262189 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd594004510 con 0x7fd5980a0a30 2023-10-01T08:00:27.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.849+0000 7fd58dffb700 1 -- 172.21.15.26:0/4163262189 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59401f070 con 0x7fd5980a0a30 2023-10-01T08:00:27.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.849+0000 7fd58dffb700 1 -- 172.21.15.26:0/4163262189 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5940038e0 con 0x7fd5980a0a30 2023-10-01T08:00:27.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.849+0000 7fd59f555700 1 -- 172.21.15.26:0/4163262189 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd590009a70 con 0x7fd5980a0a30 2023-10-01T08:00:27.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.849+0000 7fd59f555700 1 -- 172.21.15.26:0/4163262189 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5940094a0 con 0x7fd5980a0a30 2023-10-01T08:00:27.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.850+0000 7fd58dffb700 1 -- 172.21.15.26:0/4163262189 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd594003a40 con 0x7fd5980a0a30 2023-10-01T08:00:27.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.850+0000 7fd58dffb700 1 -- 172.21.15.26:0/4163262189 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd594021070 con 0x7fd5980a0a30 2023-10-01T08:00:27.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.850+0000 7fd59f555700 1 -- 172.21.15.26:0/4163262189 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5980a5360 con 0x7fd5980a0a30 2023-10-01T08:00:27.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.855+0000 7fd58dffb700 1 -- 172.21.15.26:0/4163262189 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd59402b080 con 0x7fd5980a0a30 2023-10-01T08:00:27.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.890+0000 7f781aada700 1 Processor -- start 2023-10-01T08:00:27.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.890+0000 7f781aada700 1 -- start start 2023-10-01T08:00:27.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.890+0000 7f781aada700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f781409d6f0 0x7f781409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:27.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.890+0000 7f781aada700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f781409e410 0x7f7814130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:27.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.890+0000 7f781aada700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f781409f130 con 0x7f781409e000 2023-10-01T08:00:27.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.890+0000 7f781aada700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781409f520 con 0x7f781409d6f0 2023-10-01T08:00:27.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.890+0000 7f781aada700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f781409e930 con 0x7f781409e410 2023-10-01T08:00:27.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.890+0000 7f7813fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f781409e000 0x7f7814130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46676/0 (socket says 172.21.15.26:46676) 2023-10-01T08:00:27.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.891+0000 7f7813fff700 1 -- 172.21.15.26:0/3294399065 learned_addr learned my addr 172.21.15.26:0/3294399065 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:27.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.891+0000 7f7818876700 1 --2- 172.21.15.26:0/3294399065 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f781409d6f0 0x7f781409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:27.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.891+0000 7f7819077700 1 --2- 172.21.15.26:0/3294399065 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f781409e410 0x7f7814130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:27.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.891+0000 7f7819077700 1 -- 172.21.15.26:0/3294399065 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f781409d6f0 msgr2=0x7f781409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:27.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.891+0000 7f7819077700 1 --2- 172.21.15.26:0/3294399065 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f781409d6f0 0x7f781409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:27.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.891+0000 7f78137fe700 1 -- 172.21.15.26:0/3294399065 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2926932000 0 0) 0x7f781409f130 con 0x7f781409e000 2023-10-01T08:00:27.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.891+0000 7f7819077700 1 -- 172.21.15.26:0/3294399065 >> v1:172.21.15.26:6789/0 conn(0x7f781409e000 legacy=0x7f7814130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:27.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.891+0000 7f7819077700 1 -- 172.21.15.26:0/3294399065 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781409b2d0 con 0x7f781409e410 2023-10-01T08:00:27.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.891+0000 7f7818876700 1 --2- 172.21.15.26:0/3294399065 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f781409d6f0 0x7f781409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:27.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.891+0000 7f7819077700 1 --2- 172.21.15.26:0/3294399065 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f781409e410 0x7f7814130d70 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f780c009dc0 tx=0x7f780c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de8b66df29f38fdf server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:27.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.891+0000 7f78137fe700 1 -- 172.21.15.26:0/3294399065 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c00e070 con 0x7f781409e410 2023-10-01T08:00:27.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.891+0000 7f78137fe700 1 -- 172.21.15.26:0/3294399065 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780c00bb20 con 0x7f781409e410 2023-10-01T08:00:27.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.891+0000 7f78137fe700 1 -- 172.21.15.26:0/3294399065 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c012430 con 0x7f781409e410 2023-10-01T08:00:27.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.892+0000 7f781aada700 1 -- 172.21.15.26:0/3294399065 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f781409e410 msgr2=0x7f7814130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:27.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.892+0000 7f781aada700 1 --2- 172.21.15.26:0/3294399065 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f781409e410 0x7f7814130d70 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f780c009dc0 tx=0x7f780c00b330 comp rx=0 tx=0).stop 2023-10-01T08:00:27.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.892+0000 7f781aada700 1 -- 172.21.15.26:0/3294399065 shutdown_connections 2023-10-01T08:00:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.892+0000 7f781aada700 1 --2- 172.21.15.26:0/3294399065 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f781409e410 0x7f7814130d70 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.892+0000 7f781aada700 1 --2- 172.21.15.26:0/3294399065 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f781409d6f0 0x7f781409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.892+0000 7f781aada700 1 -- 172.21.15.26:0/3294399065 >> 172.21.15.26:0/3294399065 conn(0x7f7814066f50 msgr2=0x7f781409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.892+0000 7f781aada700 1 -- 172.21.15.26:0/3294399065 shutdown_connections 2023-10-01T08:00:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.892+0000 7f781aada700 1 -- 172.21.15.26:0/3294399065 wait complete. 2023-10-01T08:00:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.893+0000 7f781aada700 1 Processor -- start 2023-10-01T08:00:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.893+0000 7f781aada700 1 -- start start 2023-10-01T08:00:27.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.894+0000 7f781aada700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f781409d6f0 0x7f7814139940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:27.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.894+0000 7f781aada700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f781409e000 0x7f7814139e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:27.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.894+0000 7f781aada700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f781409e410 0x7f781413a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:27.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.894+0000 7f781aada700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7814136670 con 0x7f781409d6f0 2023-10-01T08:00:27.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.894+0000 7f781aada700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7814136860 con 0x7f781409e000 2023-10-01T08:00:27.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.894+0000 7f781aada700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f781409c700 con 0x7f781409e410 2023-10-01T08:00:27.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.894+0000 7f7813fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f781409e000 0x7f7814139e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:27.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.894+0000 7f7818876700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f781409d6f0 0x7f7814139940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:27.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.894+0000 7f7818876700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f781409d6f0 0x7f7814139940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47226/0 (socket says 172.21.15.26:47226) 2023-10-01T08:00:27.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.894+0000 7f7818876700 1 -- 172.21.15.26:0/1463564324 learned_addr learned my addr 172.21.15.26:0/1463564324 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:27.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.894+0000 7f7819077700 1 --2- 172.21.15.26:0/1463564324 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f781409e410 0x7f781413a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:27.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.895+0000 7f7818876700 1 -- 172.21.15.26:0/1463564324 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f781409e410 msgr2=0x7f781413a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:27.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.895+0000 7f7818876700 1 --2- 172.21.15.26:0/1463564324 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f781409e410 0x7f781413a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:27.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.895+0000 7f7818876700 1 -- 172.21.15.26:0/1463564324 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f781409e000 msgr2=0x7f7814139e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:27.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.895+0000 7f7818876700 1 --2- 172.21.15.26:0/1463564324 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f781409e000 0x7f7814139e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:27.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.895+0000 7f7818876700 1 -- 172.21.15.26:0/1463564324 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78080094a0 con 0x7f781409d6f0 2023-10-01T08:00:27.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.895+0000 7f7819077700 1 --2- 172.21.15.26:0/1463564324 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f781409e410 0x7f781413a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:27.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.895+0000 7f7818876700 1 --2- 172.21.15.26:0/1463564324 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f781409d6f0 0x7f7814139940 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f780800ec10 tx=0x7f780800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:27.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.895+0000 7f78117fa700 1 -- 172.21.15.26:0/1463564324 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780800c850 con 0x7f781409d6f0 2023-10-01T08:00:27.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.895+0000 7f78117fa700 1 -- 172.21.15.26:0/1463564324 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780800c9b0 con 0x7f781409d6f0 2023-10-01T08:00:27.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.895+0000 7f781aada700 1 -- 172.21.15.26:0/1463564324 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f780c009a70 con 0x7f781409d6f0 2023-10-01T08:00:27.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.895+0000 7f78117fa700 1 -- 172.21.15.26:0/1463564324 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780800cd20 con 0x7f781409d6f0 2023-10-01T08:00:27.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.895+0000 7f781aada700 1 -- 172.21.15.26:0/1463564324 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7814136300 con 0x7f781409d6f0 2023-10-01T08:00:27.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.896+0000 7f781aada700 1 -- 172.21.15.26:0/1463564324 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7814074ea0 con 0x7f781409d6f0 2023-10-01T08:00:27.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.897+0000 7f78117fa700 1 -- 172.21.15.26:0/1463564324 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7808013470 con 0x7f781409d6f0 2023-10-01T08:00:27.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.897+0000 7f78117fa700 1 -- 172.21.15.26:0/1463564324 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7808040000 con 0x7f781409d6f0 2023-10-01T08:00:27.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:27.902+0000 7f78117fa700 1 -- 172.21.15.26:0/1463564324 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7808013720 con 0x7f781409d6f0 2023-10-01T08:00:28.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.027+0000 7f74882e7700 1 -- 172.21.15.26:0/2878171015 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7480074ea0 con 0x7f748009de50 2023-10-01T08:00:28.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.028+0000 7f7476ffd700 1 -- 172.21.15.26:0/2878171015 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f747c017070 con 0x7f748009de50 2023-10-01T08:00:28.029 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:28.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.030+0000 7f74882e7700 1 -- 172.21.15.26:0/2878171015 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f748009de50 msgr2=0x7f748011b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:28.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.030+0000 7f74882e7700 1 --2- 172.21.15.26:0/2878171015 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f748009de50 0x7f748011b850 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f747c00ec10 tx=0x7f747c00ef20 comp rx=0 tx=0).stop 2023-10-01T08:00:28.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.030+0000 7f74882e7700 1 -- 172.21.15.26:0/2878171015 shutdown_connections 2023-10-01T08:00:28.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.030+0000 7f74882e7700 1 --2- 172.21.15.26:0/2878171015 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f74801338a0 0x7f748011c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:28.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.030+0000 7f74882e7700 1 --2- 172.21.15.26:0/2878171015 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f748009de50 0x7f748011b850 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:28.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.030+0000 7f74882e7700 1 --2- 172.21.15.26:0/2878171015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f748009e930 0x7f748011bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:28.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.030+0000 7f74882e7700 1 -- 172.21.15.26:0/2878171015 >> 172.21.15.26:0/2878171015 conn(0x7f74800a2aa0 msgr2=0x7f74801305a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:28.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.030+0000 7f74882e7700 1 -- 172.21.15.26:0/2878171015 shutdown_connections 2023-10-01T08:00:28.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.030+0000 7f74882e7700 1 -- 172.21.15.26:0/2878171015 wait complete. 2023-10-01T08:00:28.045 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:28.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.063+0000 7fd59f555700 1 -- 172.21.15.26:0/4163262189 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd5980a3410 con 0x7fd5980a0a30 2023-10-01T08:00:28.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.063+0000 7fd58dffb700 1 -- 172.21.15.26:0/4163262189 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd594015020 con 0x7fd5980a0a30 2023-10-01T08:00:28.064 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:28.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.066+0000 7fd59f555700 1 -- 172.21.15.26:0/4163262189 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5980a0a30 msgr2=0x7fd598120400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:28.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.066+0000 7fd59f555700 1 --2- 172.21.15.26:0/4163262189 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5980a0a30 0x7fd598120400 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fd594009fd0 tx=0x7fd594004750 comp rx=0 tx=0).stop 2023-10-01T08:00:28.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.066+0000 7fd59f555700 1 -- 172.21.15.26:0/4163262189 shutdown_connections 2023-10-01T08:00:28.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.066+0000 7fd59f555700 1 --2- 172.21.15.26:0/4163262189 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd598133fa0 0x7fd598120e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:28.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.066+0000 7fd59f555700 1 --2- 172.21.15.26:0/4163262189 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5980a0a30 0x7fd598120400 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:28.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.066+0000 7fd59f555700 1 --2- 172.21.15.26:0/4163262189 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd5980a1340 0x7fd598120940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:28.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.066+0000 7fd59f555700 1 -- 172.21.15.26:0/4163262189 >> 172.21.15.26:0/4163262189 conn(0x7fd5980a6550 msgr2=0x7fd5981bafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:28.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.066+0000 7fd59f555700 1 -- 172.21.15.26:0/4163262189 shutdown_connections 2023-10-01T08:00:28.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.066+0000 7fd59f555700 1 -- 172.21.15.26:0/4163262189 wait complete. 2023-10-01T08:00:28.082 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:28.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.112+0000 7f781aada700 1 -- 172.21.15.26:0/1463564324 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f78141369a0 con 0x7f781409d6f0 2023-10-01T08:00:28.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.113+0000 7f78117fa700 1 -- 172.21.15.26:0/1463564324 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f78141369a0 con 0x7f781409d6f0 2023-10-01T08:00:28.113 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:28.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.115+0000 7f781aada700 1 -- 172.21.15.26:0/1463564324 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f781409d6f0 msgr2=0x7f7814139940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:28.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.115+0000 7f781aada700 1 --2- 172.21.15.26:0/1463564324 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f781409d6f0 0x7f7814139940 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f780800ec10 tx=0x7f780800ef20 comp rx=0 tx=0).stop 2023-10-01T08:00:28.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.115+0000 7f781aada700 1 -- 172.21.15.26:0/1463564324 shutdown_connections 2023-10-01T08:00:28.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.115+0000 7f781aada700 1 --2- 172.21.15.26:0/1463564324 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f781409e410 0x7f781413a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:28.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.115+0000 7f781aada700 1 --2- 172.21.15.26:0/1463564324 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f781409d6f0 0x7f7814139940 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:28.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.115+0000 7f781aada700 1 --2- 172.21.15.26:0/1463564324 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f781409e000 0x7f7814139e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:28.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.115+0000 7f781aada700 1 -- 172.21.15.26:0/1463564324 >> 172.21.15.26:0/1463564324 conn(0x7f7814066f50 msgr2=0x7f7814070e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:28.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.115+0000 7f781aada700 1 -- 172.21.15.26:0/1463564324 shutdown_connections 2023-10-01T08:00:28.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.115+0000 7f781aada700 1 -- 172.21.15.26:0/1463564324 wait complete. 2023-10-01T08:00:28.129 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:28.783 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:28.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.928+0000 7fb5d473c700 1 Processor -- start 2023-10-01T08:00:28.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.928+0000 7fb5d473c700 1 -- start start 2023-10-01T08:00:28.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.929+0000 7fb5d473c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb5cc06a770 0x7fb5cc06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:28.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.929+0000 7fb5d473c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5cc06b080 0x7fb5cc131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:28.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.929+0000 7fb5d473c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb5cc131b40 0x7fb5cc131fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:28.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.929+0000 7fb5d473c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5cc09ece0 con 0x7fb5cc131b40 2023-10-01T08:00:28.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.929+0000 7fb5d473c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc09e760 con 0x7fb5cc06b080 2023-10-01T08:00:28.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.929+0000 7fb5d473c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc09e040 con 0x7fb5cc06a770 2023-10-01T08:00:28.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.929+0000 7fb5d1cd7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5cc06b080 0x7fb5cc131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:28.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.929+0000 7fb5d2cd9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb5cc131b40 0x7fb5cc131fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:28.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.929+0000 7fb5d24d8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb5cc06a770 0x7fb5cc06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:28.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.929+0000 7fb5d24d8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb5cc06a770 0x7fb5cc06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:34262/0 (socket says 172.21.15.26:34262) 2023-10-01T08:00:28.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.929+0000 7fb5d1cd7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5cc06b080 0x7fb5cc131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38430/0 (socket says 172.21.15.26:38430) 2023-10-01T08:00:28.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.929+0000 7fb5d2cd9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb5cc131b40 0x7fb5cc131fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47238/0 (socket says 172.21.15.26:47238) 2023-10-01T08:00:28.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.929+0000 7fb5d24d8700 1 -- 172.21.15.26:0/419476096 learned_addr learned my addr 172.21.15.26:0/419476096 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:28.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.929+0000 7fb5d24d8700 1 -- 172.21.15.26:0/419476096 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5cc06b080 msgr2=0x7fb5cc131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:28.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.929+0000 7fb5d24d8700 1 --2- 172.21.15.26:0/419476096 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5cc06b080 0x7fb5cc131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:28.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.929+0000 7fb5d24d8700 1 -- 172.21.15.26:0/419476096 >> v2:172.21.15.26:3300/0 conn(0x7fb5cc131b40 msgr2=0x7fb5cc131fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:28.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.929+0000 7fb5d24d8700 1 --2- 172.21.15.26:0/419476096 >> v2:172.21.15.26:3300/0 conn(0x7fb5cc131b40 0x7fb5cc131fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:28.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.929+0000 7fb5d24d8700 1 -- 172.21.15.26:0/419476096 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5cc09f630 con 0x7fb5cc06a770 2023-10-01T08:00:28.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.929+0000 7fb5d1cd7700 1 --2- 172.21.15.26:0/419476096 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5cc06b080 0x7fb5cc131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:28.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.929+0000 7fb5d2cd9700 1 --2- 172.21.15.26:0/419476096 >> v2:172.21.15.26:3300/0 conn(0x7fb5cc131b40 0x7fb5cc131fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:28.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.930+0000 7fb5d24d8700 1 --2- 172.21.15.26:0/419476096 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb5cc06a770 0x7fb5cc06ab40 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fb5c80098f0 tx=0x7fb5c8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e93edc991711d09d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:28.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.930+0000 7fb5d14d6700 1 -- 172.21.15.26:0/419476096 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c8011830 con 0x7fb5cc06a770 2023-10-01T08:00:28.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.930+0000 7fb5d14d6700 1 -- 172.21.15.26:0/419476096 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c8011990 con 0x7fb5cc06a770 2023-10-01T08:00:28.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.930+0000 7fb5d14d6700 1 -- 172.21.15.26:0/419476096 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c8011d20 con 0x7fb5cc06a770 2023-10-01T08:00:28.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.930+0000 7fb5d473c700 1 -- 172.21.15.26:0/419476096 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb5cc06a770 msgr2=0x7fb5cc06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:28.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.930+0000 7fb5d473c700 1 --2- 172.21.15.26:0/419476096 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb5cc06a770 0x7fb5cc06ab40 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fb5c80098f0 tx=0x7fb5c8009c00 comp rx=0 tx=0).stop 2023-10-01T08:00:28.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.930+0000 7fb5d473c700 1 -- 172.21.15.26:0/419476096 shutdown_connections 2023-10-01T08:00:28.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.931+0000 7fb5d473c700 1 --2- 172.21.15.26:0/419476096 >> v2:172.21.15.26:3300/0 conn(0x7fb5cc131b40 0x7fb5cc131fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:28.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.931+0000 7fb5d473c700 1 --2- 172.21.15.26:0/419476096 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb5cc06a770 0x7fb5cc06ab40 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:28.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.931+0000 7fb5d473c700 1 --2- 172.21.15.26:0/419476096 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5cc06b080 0x7fb5cc131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:28.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.931+0000 7fb5d473c700 1 -- 172.21.15.26:0/419476096 >> 172.21.15.26:0/419476096 conn(0x7fb5cc066f50 msgr2=0x7fb5cc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:28.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.931+0000 7fb5d473c700 1 -- 172.21.15.26:0/419476096 shutdown_connections 2023-10-01T08:00:28.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.931+0000 7fb5d473c700 1 -- 172.21.15.26:0/419476096 wait complete. 2023-10-01T08:00:28.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.932+0000 7fb5d473c700 1 Processor -- start 2023-10-01T08:00:28.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.932+0000 7fb5d473c700 1 -- start start 2023-10-01T08:00:28.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.932+0000 7fb5d473c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5cc06a770 0x7fb5cc122700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:28.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.932+0000 7fb5d473c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb5cc06b080 0x7fb5cc122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:28.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.932+0000 7fb5d473c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5cc131b40 0x7fb5cc123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:28.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.932+0000 7fb5d473c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc125be0 con 0x7fb5cc06a770 2023-10-01T08:00:28.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.932+0000 7fb5d473c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc126280 con 0x7fb5cc131b40 2023-10-01T08:00:28.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.932+0000 7fb5d473c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc124270 con 0x7fb5cc06b080 2023-10-01T08:00:28.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.932+0000 7fb5d2cd9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5cc131b40 0x7fb5cc123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:28.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.932+0000 7fb5d24d8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5cc06a770 0x7fb5cc122700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:28.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.932+0000 7fb5d1cd7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb5cc06b080 0x7fb5cc122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:28.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.932+0000 7fb5d24d8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5cc06a770 0x7fb5cc122700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47240/0 (socket says 172.21.15.26:47240) 2023-10-01T08:00:28.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.932+0000 7fb5d2cd9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5cc131b40 0x7fb5cc123180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38442/0 (socket says 172.21.15.26:38442) 2023-10-01T08:00:28.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.932+0000 7fb5d24d8700 1 -- 172.21.15.26:0/1869914493 learned_addr learned my addr 172.21.15.26:0/1869914493 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:28.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.932+0000 7fb5d24d8700 1 -- 172.21.15.26:0/1869914493 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb5cc06b080 msgr2=0x7fb5cc122c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:28.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.933+0000 7fb5d24d8700 1 --2- 172.21.15.26:0/1869914493 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb5cc06b080 0x7fb5cc122c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:28.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.933+0000 7fb5d24d8700 1 -- 172.21.15.26:0/1869914493 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5cc131b40 msgr2=0x7fb5cc123180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:28.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.933+0000 7fb5d24d8700 1 --2- 172.21.15.26:0/1869914493 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5cc131b40 0x7fb5cc123180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:28.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.933+0000 7fb5d24d8700 1 -- 172.21.15.26:0/1869914493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c00094a0 con 0x7fb5cc06a770 2023-10-01T08:00:28.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.933+0000 7fb5d24d8700 1 --2- 172.21.15.26:0/1869914493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5cc06a770 0x7fb5cc122700 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8000c00 tx=0x7fb5c8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:28.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.933+0000 7fb5beffd700 1 -- 172.21.15.26:0/1869914493 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c8004240 con 0x7fb5cc06a770 2023-10-01T08:00:28.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.933+0000 7fb5beffd700 1 -- 172.21.15.26:0/1869914493 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c801f070 con 0x7fb5cc06a770 2023-10-01T08:00:28.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.933+0000 7fb5d473c700 1 -- 172.21.15.26:0/1869914493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c4009a70 con 0x7fb5cc06a770 2023-10-01T08:00:28.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.933+0000 7fb5beffd700 1 -- 172.21.15.26:0/1869914493 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c80045c0 con 0x7fb5cc06a770 2023-10-01T08:00:28.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.933+0000 7fb5d473c700 1 -- 172.21.15.26:0/1869914493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c8009550 con 0x7fb5cc06a770 2023-10-01T08:00:28.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.934+0000 7fb5beffd700 1 -- 172.21.15.26:0/1869914493 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb5c8021030 con 0x7fb5cc06a770 2023-10-01T08:00:28.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.934+0000 7fb5beffd700 1 -- 172.21.15.26:0/1869914493 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb5c80407c0 con 0x7fb5cc06a770 2023-10-01T08:00:28.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.934+0000 7fb5d473c700 1 -- 172.21.15.26:0/1869914493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5cc071ec0 con 0x7fb5cc06a770 2023-10-01T08:00:28.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:28.939+0000 7fb5beffd700 1 -- 172.21.15.26:0/1869914493 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb5c801a450 con 0x7fb5cc06a770 2023-10-01T08:00:29.046 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:29.083 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:29.130 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:29.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.149+0000 7fb5d473c700 1 -- 172.21.15.26:0/1869914493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb5cc074ea0 con 0x7fb5cc06a770 2023-10-01T08:00:29.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.149+0000 7fb5beffd700 1 -- 172.21.15.26:0/1869914493 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb5c80233d0 con 0x7fb5cc06a770 2023-10-01T08:00:29.151 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:29.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.153+0000 7fb5d473c700 1 -- 172.21.15.26:0/1869914493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5cc06a770 msgr2=0x7fb5cc122700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:29.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.153+0000 7fb5d473c700 1 --2- 172.21.15.26:0/1869914493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5cc06a770 0x7fb5cc122700 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8000c00 tx=0x7fb5c8004750 comp rx=0 tx=0).stop 2023-10-01T08:00:29.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.153+0000 7fb5d473c700 1 -- 172.21.15.26:0/1869914493 shutdown_connections 2023-10-01T08:00:29.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.153+0000 7fb5d473c700 1 --2- 172.21.15.26:0/1869914493 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb5cc131b40 0x7fb5cc123180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:29.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.153+0000 7fb5d473c700 1 --2- 172.21.15.26:0/1869914493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5cc06a770 0x7fb5cc122700 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:29.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.153+0000 7fb5d473c700 1 --2- 172.21.15.26:0/1869914493 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb5cc06b080 0x7fb5cc122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:29.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.153+0000 7fb5d473c700 1 -- 172.21.15.26:0/1869914493 >> 172.21.15.26:0/1869914493 conn(0x7fb5cc066f50 msgr2=0x7fb5cc0a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:29.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.154+0000 7fb5d473c700 1 -- 172.21.15.26:0/1869914493 shutdown_connections 2023-10-01T08:00:29.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.154+0000 7fb5d473c700 1 -- 172.21.15.26:0/1869914493 wait complete. 2023-10-01T08:00:29.171 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:29.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.193+0000 7f156eb28700 1 Processor -- start 2023-10-01T08:00:29.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.193+0000 7f156eb28700 1 -- start start 2023-10-01T08:00:29.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.193+0000 7f156eb28700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f156809d6f0 0x7f156809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:29.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.193+0000 7f156eb28700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f156809e000 0x7f15681339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:29.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.193+0000 7f156eb28700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f156809b120 con 0x7f156809e410 2023-10-01T08:00:29.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.193+0000 7f156eb28700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f156806b460 con 0x7f156809d6f0 2023-10-01T08:00:29.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.193+0000 7f156eb28700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f156809a7e0 con 0x7f156809e000 2023-10-01T08:00:29.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.193+0000 7f1567fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f156809e000 0x7f15681339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:29.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.193+0000 7f156c8c4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f156809d6f0 0x7f156809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:29.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.193+0000 7f1567fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f156809e000 0x7f15681339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:34282/0 (socket says 172.21.15.26:34282) 2023-10-01T08:00:29.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.193+0000 7f156c8c4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f156809d6f0 0x7f156809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47248/0 (socket says 172.21.15.26:47248) 2023-10-01T08:00:29.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.193+0000 7f1567fff700 1 -- 172.21.15.26:0/2555460633 learned_addr learned my addr 172.21.15.26:0/2555460633 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:29.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.194+0000 7f1567fff700 1 -- 172.21.15.26:0/2555460633 >> v2:172.21.15.26:3300/0 conn(0x7f156809d6f0 msgr2=0x7f156809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:29.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.194+0000 7f1567fff700 1 --2- 172.21.15.26:0/2555460633 >> v2:172.21.15.26:3300/0 conn(0x7f156809d6f0 0x7f156809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:29.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.194+0000 7f1567fff700 1 -- 172.21.15.26:0/2555460633 >> v1:172.21.15.26:6789/0 conn(0x7f156809e410 legacy=0x7f1568133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:29.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.194+0000 7f1567fff700 1 -- 172.21.15.26:0/2555460633 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156809a500 con 0x7f156809e000 2023-10-01T08:00:29.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.194+0000 7f156c8c4700 1 --2- 172.21.15.26:0/2555460633 >> v2:172.21.15.26:3300/0 conn(0x7f156809d6f0 0x7f156809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:29.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.194+0000 7f1567fff700 1 --2- 172.21.15.26:0/2555460633 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f156809e000 0x7f15681339f0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f1554009920 tx=0x7f1554009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3080e355f9c40cc server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:29.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.194+0000 7f15677fe700 1 -- 172.21.15.26:0/2555460633 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1554011830 con 0x7f156809e000 2023-10-01T08:00:29.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.194+0000 7f15677fe700 1 -- 172.21.15.26:0/2555460633 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1554011990 con 0x7f156809e000 2023-10-01T08:00:29.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.194+0000 7f15677fe700 1 -- 172.21.15.26:0/2555460633 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1554011d20 con 0x7f156809e000 2023-10-01T08:00:29.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.195+0000 7f156eb28700 1 -- 172.21.15.26:0/2555460633 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f156809e000 msgr2=0x7f15681339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:29.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.195+0000 7f156eb28700 1 --2- 172.21.15.26:0/2555460633 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f156809e000 0x7f15681339f0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f1554009920 tx=0x7f1554009c30 comp rx=0 tx=0).stop 2023-10-01T08:00:29.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.195+0000 7f156eb28700 1 -- 172.21.15.26:0/2555460633 shutdown_connections 2023-10-01T08:00:29.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.195+0000 7f156eb28700 1 --2- 172.21.15.26:0/2555460633 >> v2:172.21.15.26:3300/0 conn(0x7f156809d6f0 0x7f156809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:29.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.195+0000 7f156eb28700 1 --2- 172.21.15.26:0/2555460633 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f156809e000 0x7f15681339f0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:29.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.195+0000 7f156eb28700 1 -- 172.21.15.26:0/2555460633 >> 172.21.15.26:0/2555460633 conn(0x7f1568066f50 msgr2=0x7f156809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:29.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.195+0000 7f156eb28700 1 -- 172.21.15.26:0/2555460633 shutdown_connections 2023-10-01T08:00:29.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.195+0000 7f156eb28700 1 -- 172.21.15.26:0/2555460633 wait complete. 2023-10-01T08:00:29.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.196+0000 7f156eb28700 1 Processor -- start 2023-10-01T08:00:29.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.196+0000 7f156eb28700 1 -- start start 2023-10-01T08:00:29.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.197+0000 7f156eb28700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f156809d6f0 0x7f15681a4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:29.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.197+0000 7f156eb28700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f156809e000 0x7f15681a54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:29.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.197+0000 7f156eb28700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f156809e410 0x7f15681a59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:29.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.197+0000 7f156eb28700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15681a8720 con 0x7f156809e000 2023-10-01T08:00:29.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.197+0000 7f156eb28700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15681a6330 con 0x7f156809d6f0 2023-10-01T08:00:29.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.197+0000 7f156eb28700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15680a3240 con 0x7f156809e410 2023-10-01T08:00:29.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.197+0000 7f156d0c5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f156809e410 0x7f15681a59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:29.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.197+0000 7f156d0c5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f156809e410 0x7f15681a59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:34290/0 (socket says 172.21.15.26:34290) 2023-10-01T08:00:29.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.197+0000 7f156d0c5700 1 -- 172.21.15.26:0/3576529457 learned_addr learned my addr 172.21.15.26:0/3576529457 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:29.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.197+0000 7f1567fff700 1 --2- 172.21.15.26:0/3576529457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f156809e000 0x7f15681a54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:29.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.197+0000 7f156c8c4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f156809d6f0 0x7f15681a4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:29.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.198+0000 7f1567fff700 1 -- 172.21.15.26:0/3576529457 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f156809e410 msgr2=0x7f15681a59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:29.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.198+0000 7f1567fff700 1 --2- 172.21.15.26:0/3576529457 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f156809e410 0x7f15681a59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:29.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.198+0000 7f1567fff700 1 -- 172.21.15.26:0/3576529457 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f156809d6f0 msgr2=0x7f15681a4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:29.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.198+0000 7f1567fff700 1 --2- 172.21.15.26:0/3576529457 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f156809d6f0 0x7f15681a4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:29.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.198+0000 7f1567fff700 1 -- 172.21.15.26:0/3576529457 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155c0094a0 con 0x7f156809e000 2023-10-01T08:00:29.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.198+0000 7f156d0c5700 1 --2- 172.21.15.26:0/3576529457 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f156809e410 0x7f15681a59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:29.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.198+0000 7f156c8c4700 1 --2- 172.21.15.26:0/3576529457 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f156809d6f0 0x7f15681a4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:29.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.198+0000 7f1567fff700 1 --2- 172.21.15.26:0/3576529457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f156809e000 0x7f15681a54a0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f1554016000 tx=0x7f1554004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:29.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.198+0000 7f15657fa700 1 -- 172.21.15.26:0/3576529457 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1554004510 con 0x7f156809e000 2023-10-01T08:00:29.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.198+0000 7f15657fa700 1 -- 172.21.15.26:0/3576529457 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15540036a0 con 0x7f156809e000 2023-10-01T08:00:29.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.198+0000 7f156eb28700 1 -- 172.21.15.26:0/3576529457 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1554009550 con 0x7f156809e000 2023-10-01T08:00:29.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.198+0000 7f15657fa700 1 -- 172.21.15.26:0/3576529457 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1554003a50 con 0x7f156809e000 2023-10-01T08:00:29.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.198+0000 7f156eb28700 1 -- 172.21.15.26:0/3576529457 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156809c710 con 0x7f156809e000 2023-10-01T08:00:29.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.199+0000 7f156eb28700 1 -- 172.21.15.26:0/3576529457 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f156809f3b0 con 0x7f156809e000 2023-10-01T08:00:29.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.199+0000 7f15657fa700 1 -- 172.21.15.26:0/3576529457 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1554003bb0 con 0x7f156809e000 2023-10-01T08:00:29.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.199+0000 7f15657fa700 1 -- 172.21.15.26:0/3576529457 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1554021030 con 0x7f156809e000 2023-10-01T08:00:29.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.209+0000 7f15657fa700 1 -- 172.21.15.26:0/3576529457 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f156809f3b0 con 0x7f156809e000 2023-10-01T08:00:29.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.237+0000 7f0784c19700 1 Processor -- start 2023-10-01T08:00:29.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.237+0000 7f0784c19700 1 -- start start 2023-10-01T08:00:29.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.238+0000 7f0784c19700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f078009e1d0 0x7f0780138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:29.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.238+0000 7f0784c19700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0780139170 0x7f078013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:29.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.238+0000 7f0784c19700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f078009b120 con 0x7f078009d6f0 2023-10-01T08:00:29.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.238+0000 7f0784c19700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f078006b460 con 0x7f078009e1d0 2023-10-01T08:00:29.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.238+0000 7f0784c19700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f078009a7e0 con 0x7f0780139170 2023-10-01T08:00:29.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.238+0000 7f077ed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0780139170 0x7f078013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:29.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.238+0000 7f077e59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f078009d6f0 0x7f078009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46688/0 (socket says 172.21.15.26:46688) 2023-10-01T08:00:29.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.238+0000 7f077e59c700 1 -- 172.21.15.26:0/1079412944 learned_addr learned my addr 172.21.15.26:0/1079412944 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:29.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.238+0000 7f077dd9b700 1 --2- 172.21.15.26:0/1079412944 >> v2:172.21.15.26:3300/0 conn(0x7f078009e1d0 0x7f0780138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:29.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.238+0000 7f077d59a700 1 -- 172.21.15.26:0/1079412944 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1444771786 0 0) 0x7f078009b120 con 0x7f078009d6f0 2023-10-01T08:00:29.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.238+0000 7f077ed9d700 1 -- 172.21.15.26:0/1079412944 >> v2:172.21.15.26:3300/0 conn(0x7f078009e1d0 msgr2=0x7f0780138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:29.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.238+0000 7f077ed9d700 1 --2- 172.21.15.26:0/1079412944 >> v2:172.21.15.26:3300/0 conn(0x7f078009e1d0 0x7f0780138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:29.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.239+0000 7f077ed9d700 1 -- 172.21.15.26:0/1079412944 >> v1:172.21.15.26:6789/0 conn(0x7f078009d6f0 legacy=0x7f078009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:29.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.239+0000 7f077ed9d700 1 -- 172.21.15.26:0/1079412944 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f078009a500 con 0x7f0780139170 2023-10-01T08:00:29.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.239+0000 7f077dd9b700 1 --2- 172.21.15.26:0/1079412944 >> v2:172.21.15.26:3300/0 conn(0x7f078009e1d0 0x7f0780138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:29.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.239+0000 7f077ed9d700 1 --2- 172.21.15.26:0/1079412944 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0780139170 0x7f078013b550 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f0778009dc0 tx=0x7f077800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4ea7834274c1162 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:29.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.239+0000 7f077d59a700 1 -- 172.21.15.26:0/1079412944 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077800e070 con 0x7f0780139170 2023-10-01T08:00:29.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.239+0000 7f077d59a700 1 -- 172.21.15.26:0/1079412944 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077800bae0 con 0x7f0780139170 2023-10-01T08:00:29.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.239+0000 7f077d59a700 1 -- 172.21.15.26:0/1079412944 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077800be90 con 0x7f0780139170 2023-10-01T08:00:29.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.240+0000 7f0784c19700 1 -- 172.21.15.26:0/1079412944 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0780139170 msgr2=0x7f078013b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:29.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.240+0000 7f0784c19700 1 --2- 172.21.15.26:0/1079412944 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0780139170 0x7f078013b550 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f0778009dc0 tx=0x7f077800b330 comp rx=0 tx=0).stop 2023-10-01T08:00:29.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.240+0000 7f0784c19700 1 -- 172.21.15.26:0/1079412944 shutdown_connections 2023-10-01T08:00:29.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.240+0000 7f0784c19700 1 --2- 172.21.15.26:0/1079412944 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0780139170 0x7f078013b550 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:29.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.240+0000 7f0784c19700 1 --2- 172.21.15.26:0/1079412944 >> v2:172.21.15.26:3300/0 conn(0x7f078009e1d0 0x7f0780138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:29.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.240+0000 7f0784c19700 1 -- 172.21.15.26:0/1079412944 >> 172.21.15.26:0/1079412944 conn(0x7f0780066f50 msgr2=0x7f078009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:29.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.240+0000 7f0784c19700 1 -- 172.21.15.26:0/1079412944 shutdown_connections 2023-10-01T08:00:29.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.240+0000 7f0784c19700 1 -- 172.21.15.26:0/1079412944 wait complete. 2023-10-01T08:00:29.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.241+0000 7f0784c19700 1 Processor -- start 2023-10-01T08:00:29.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.241+0000 7f0784c19700 1 -- start start 2023-10-01T08:00:29.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.242+0000 7f0784c19700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f078009d6f0 0x7f07801217a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:29.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.242+0000 7f0784c19700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f078009e1d0 0x7f0780121ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:29.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.242+0000 7f0784c19700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0780139170 0x7f0780122220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:29.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.242+0000 7f0784c19700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0780124fe0 con 0x7f078009d6f0 2023-10-01T08:00:29.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.242+0000 7f0784c19700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0780124ac0 con 0x7f0780139170 2023-10-01T08:00:29.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.242+0000 7f0784c19700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07800a2000 con 0x7f078009e1d0 2023-10-01T08:00:29.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.242+0000 7f077ed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0780139170 0x7f0780122220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:29.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.242+0000 7f077ed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0780139170 0x7f0780122220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38464/0 (socket says 172.21.15.26:38464) 2023-10-01T08:00:29.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.242+0000 7f077ed9d700 1 -- 172.21.15.26:0/3443521829 learned_addr learned my addr 172.21.15.26:0/3443521829 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:29.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.242+0000 7f077e59c700 1 --2- 172.21.15.26:0/3443521829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f078009d6f0 0x7f07801217a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:29.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.242+0000 7f077dd9b700 1 --2- 172.21.15.26:0/3443521829 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f078009e1d0 0x7f0780121ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:29.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.242+0000 7f077ed9d700 1 -- 172.21.15.26:0/3443521829 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f078009e1d0 msgr2=0x7f0780121ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:29.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.242+0000 7f077ed9d700 1 --2- 172.21.15.26:0/3443521829 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f078009e1d0 0x7f0780121ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:29.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.242+0000 7f077ed9d700 1 -- 172.21.15.26:0/3443521829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f078009d6f0 msgr2=0x7f07801217a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:29.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.242+0000 7f077ed9d700 1 --2- 172.21.15.26:0/3443521829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f078009d6f0 0x7f07801217a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:29.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.242+0000 7f077ed9d700 1 -- 172.21.15.26:0/3443521829 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07740094a0 con 0x7f0780139170 2023-10-01T08:00:29.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.242+0000 7f077e59c700 1 --2- 172.21.15.26:0/3443521829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f078009d6f0 0x7f07801217a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:29.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.242+0000 7f077ed9d700 1 --2- 172.21.15.26:0/3443521829 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0780139170 0x7f0780122220 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f0778014040 tx=0x7f0778004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:29.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.243+0000 7f076effd700 1 -- 172.21.15.26:0/3443521829 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07780045d0 con 0x7f0780139170 2023-10-01T08:00:29.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.243+0000 7f076effd700 1 -- 172.21.15.26:0/3443521829 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0778020070 con 0x7f0780139170 2023-10-01T08:00:29.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.243+0000 7f076effd700 1 -- 172.21.15.26:0/3443521829 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0778004970 con 0x7f0780139170 2023-10-01T08:00:29.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.243+0000 7f0784c19700 1 -- 172.21.15.26:0/3443521829 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0778009a70 con 0x7f0780139170 2023-10-01T08:00:29.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.243+0000 7f0784c19700 1 -- 172.21.15.26:0/3443521829 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0780125a50 con 0x7f0780139170 2023-10-01T08:00:29.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.244+0000 7f0784c19700 1 -- 172.21.15.26:0/3443521829 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0780074ea0 con 0x7f0780139170 2023-10-01T08:00:29.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.245+0000 7f076effd700 1 -- 172.21.15.26:0/3443521829 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0778031430 con 0x7f0780139170 2023-10-01T08:00:29.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.245+0000 7f076effd700 1 -- 172.21.15.26:0/3443521829 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0778022070 con 0x7f0780139170 2023-10-01T08:00:29.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.249+0000 7f076effd700 1 -- 172.21.15.26:0/3443521829 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0778012430 con 0x7f0780139170 2023-10-01T08:00:29.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.297+0000 7f3e850ec700 1 Processor -- start 2023-10-01T08:00:29.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.297+0000 7f3e850ec700 1 -- start start 2023-10-01T08:00:29.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.297+0000 7f3e850ec700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3e8009e930 0x7f3e8009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:29.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.297+0000 7f3e850ec700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e8009f240 0x7f3e801317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:29.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.297+0000 7f3e850ec700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e80070940 con 0x7f3e8009f650 2023-10-01T08:00:29.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.297+0000 7f3e850ec700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e8006fd60 con 0x7f3e8009e930 2023-10-01T08:00:29.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.297+0000 7f3e850ec700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8006fa80 con 0x7f3e8009f240 2023-10-01T08:00:29.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.298+0000 7f3e7ed9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3e8009e930 0x7f3e8009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:29.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.298+0000 7f3e7f59e700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3e8009f650 0x7f3e80131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46704/0 (socket says 172.21.15.26:46704) 2023-10-01T08:00:29.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.298+0000 7f3e7f59e700 1 -- 172.21.15.26:0/1298800347 learned_addr learned my addr 172.21.15.26:0/1298800347 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:29.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.298+0000 7f3e7e59c700 1 --2- 172.21.15.26:0/1298800347 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e8009f240 0x7f3e801317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:29.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.298+0000 7f3e7e59c700 1 -- 172.21.15.26:0/1298800347 >> v2:172.21.15.26:3300/0 conn(0x7f3e8009e930 msgr2=0x7f3e8009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:29.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.298+0000 7f3e7e59c700 1 --2- 172.21.15.26:0/1298800347 >> v2:172.21.15.26:3300/0 conn(0x7f3e8009e930 0x7f3e8009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:29.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.298+0000 7f3e7e59c700 1 -- 172.21.15.26:0/1298800347 >> v1:172.21.15.26:6789/0 conn(0x7f3e8009f650 legacy=0x7f3e80131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:29.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.298+0000 7f3e7e59c700 1 -- 172.21.15.26:0/1298800347 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e8009fb60 con 0x7f3e8009f240 2023-10-01T08:00:29.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.298+0000 7f3e7dd9b700 1 -- 172.21.15.26:0/1298800347 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1198719080 0 0) 0x7f3e80070940 con 0x7f3e8009f650 2023-10-01T08:00:29.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.298+0000 7f3e7ed9d700 1 --2- 172.21.15.26:0/1298800347 >> v2:172.21.15.26:3300/0 conn(0x7f3e8009e930 0x7f3e8009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:29.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.298+0000 7f3e7e59c700 1 --2- 172.21.15.26:0/1298800347 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e8009f240 0x7f3e801317f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f3e74009840 tx=0x7f3e74009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf2d9d033a8b50de server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:29.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.298+0000 7f3e7dd9b700 1 -- 172.21.15.26:0/1298800347 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e74011830 con 0x7f3e8009f240 2023-10-01T08:00:29.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.298+0000 7f3e7dd9b700 1 -- 172.21.15.26:0/1298800347 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e74011990 con 0x7f3e8009f240 2023-10-01T08:00:29.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.299+0000 7f3e7dd9b700 1 -- 172.21.15.26:0/1298800347 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e74011d20 con 0x7f3e8009f240 2023-10-01T08:00:29.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.299+0000 7f3e850ec700 1 -- 172.21.15.26:0/1298800347 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e8009f240 msgr2=0x7f3e801317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:29.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.299+0000 7f3e850ec700 1 --2- 172.21.15.26:0/1298800347 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e8009f240 0x7f3e801317f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f3e74009840 tx=0x7f3e74009b50 comp rx=0 tx=0).stop 2023-10-01T08:00:29.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.299+0000 7f3e850ec700 1 -- 172.21.15.26:0/1298800347 shutdown_connections 2023-10-01T08:00:29.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.299+0000 7f3e850ec700 1 --2- 172.21.15.26:0/1298800347 >> v2:172.21.15.26:3300/0 conn(0x7f3e8009e930 0x7f3e8009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:29.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.299+0000 7f3e850ec700 1 --2- 172.21.15.26:0/1298800347 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e8009f240 0x7f3e801317f0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:29.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.299+0000 7f3e850ec700 1 -- 172.21.15.26:0/1298800347 >> 172.21.15.26:0/1298800347 conn(0x7f3e800a4210 msgr2=0x7f3e800a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:29.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.299+0000 7f3e850ec700 1 -- 172.21.15.26:0/1298800347 shutdown_connections 2023-10-01T08:00:29.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.299+0000 7f3e850ec700 1 -- 172.21.15.26:0/1298800347 wait complete. 2023-10-01T08:00:29.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.301+0000 7f3e850ec700 1 Processor -- start 2023-10-01T08:00:29.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.301+0000 7f3e850ec700 1 -- start start 2023-10-01T08:00:29.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.302+0000 7f3e850ec700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e8009e930 0x7f3e801b4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:29.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.302+0000 7f3e850ec700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e8009f240 0x7f3e801b4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:29.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.302+0000 7f3e850ec700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e8009f650 0x7f3e801a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:29.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.302+0000 7f3e850ec700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e801a2040 con 0x7f3e8009e930 2023-10-01T08:00:29.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.302+0000 7f3e850ec700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e800a30d0 con 0x7f3e8009f650 2023-10-01T08:00:29.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.302+0000 7f3e850ec700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e801a4170 con 0x7f3e8009f240 2023-10-01T08:00:29.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.302+0000 7f3e7f59e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e8009f650 0x7f3e801a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:29.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.302+0000 7f3e7e59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e8009f240 0x7f3e801b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:29.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.302+0000 7f3e7f59e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e8009f650 0x7f3e801a0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38488/0 (socket says 172.21.15.26:38488) 2023-10-01T08:00:29.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.302+0000 7f3e7f59e700 1 -- 172.21.15.26:0/3949408764 learned_addr learned my addr 172.21.15.26:0/3949408764 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:29.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.302+0000 7f3e7e59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e8009f240 0x7f3e801b4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:34310/0 (socket says 172.21.15.26:34310) 2023-10-01T08:00:29.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.302+0000 7f3e7ed9d700 1 --2- 172.21.15.26:0/3949408764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e8009e930 0x7f3e801b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:29.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.302+0000 7f3e7f59e700 1 -- 172.21.15.26:0/3949408764 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e8009f240 msgr2=0x7f3e801b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:29.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.302+0000 7f3e7f59e700 1 --2- 172.21.15.26:0/3949408764 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e8009f240 0x7f3e801b4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:29.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.302+0000 7f3e7f59e700 1 -- 172.21.15.26:0/3949408764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e8009e930 msgr2=0x7f3e801b4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:29.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.302+0000 7f3e7f59e700 1 --2- 172.21.15.26:0/3949408764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e8009e930 0x7f3e801b4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:29.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.302+0000 7f3e7f59e700 1 -- 172.21.15.26:0/3949408764 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7000f610 con 0x7f3e8009f650 2023-10-01T08:00:29.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.302+0000 7f3e7e59c700 1 --2- 172.21.15.26:0/3949408764 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e8009f240 0x7f3e801b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:29.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.303+0000 7f3e7f59e700 1 --2- 172.21.15.26:0/3949408764 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e8009f650 0x7f3e801a0430 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f3e78002230 tx=0x7f3e7800cf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:29.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.303+0000 7f3e677fe700 1 -- 172.21.15.26:0/3949408764 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7800ab70 con 0x7f3e8009f650 2023-10-01T08:00:29.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.303+0000 7f3e677fe700 1 -- 172.21.15.26:0/3949408764 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7800acf0 con 0x7f3e8009f650 2023-10-01T08:00:29.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.303+0000 7f3e850ec700 1 -- 172.21.15.26:0/3949408764 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e740094a0 con 0x7f3e8009f650 2023-10-01T08:00:29.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.303+0000 7f3e677fe700 1 -- 172.21.15.26:0/3949408764 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e78007310 con 0x7f3e8009f650 2023-10-01T08:00:29.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.303+0000 7f3e850ec700 1 -- 172.21.15.26:0/3949408764 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e800a0190 con 0x7f3e8009f650 2023-10-01T08:00:29.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.304+0000 7f3e677fe700 1 -- 172.21.15.26:0/3949408764 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3e78007470 con 0x7f3e8009f650 2023-10-01T08:00:29.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.304+0000 7f3e677fe700 1 -- 172.21.15.26:0/3949408764 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3e7803f300 con 0x7f3e8009f650 2023-10-01T08:00:29.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.305+0000 7f3e850ec700 1 -- 172.21.15.26:0/3949408764 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e80074ea0 con 0x7f3e8009f650 2023-10-01T08:00:29.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.310+0000 7f3e677fe700 1 -- 172.21.15.26:0/3949408764 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3e78018080 con 0x7f3e8009f650 2023-10-01T08:00:29.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.417+0000 7f156eb28700 1 -- 172.21.15.26:0/3576529457 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f156809f3b0 con 0x7f156809e000 2023-10-01T08:00:29.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.417+0000 7f15657fa700 1 -- 172.21.15.26:0/3576529457 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f156809f3b0 con 0x7f156809e000 2023-10-01T08:00:29.418 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:29.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.419+0000 7f156eb28700 1 -- 172.21.15.26:0/3576529457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f156809e000 msgr2=0x7f15681a54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:29.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.419+0000 7f156eb28700 1 --2- 172.21.15.26:0/3576529457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f156809e000 0x7f15681a54a0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f1554016000 tx=0x7f1554004750 comp rx=0 tx=0).stop 2023-10-01T08:00:29.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.419+0000 7f156eb28700 1 -- 172.21.15.26:0/3576529457 shutdown_connections 2023-10-01T08:00:29.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.419+0000 7f156eb28700 1 --2- 172.21.15.26:0/3576529457 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f156809e410 0x7f15681a59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:29.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.419+0000 7f156eb28700 1 --2- 172.21.15.26:0/3576529457 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f156809d6f0 0x7f15681a4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:29.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.419+0000 7f156eb28700 1 --2- 172.21.15.26:0/3576529457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f156809e000 0x7f15681a54a0 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:29.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.419+0000 7f156eb28700 1 -- 172.21.15.26:0/3576529457 >> 172.21.15.26:0/3576529457 conn(0x7f1568066f50 msgr2=0x7f15681bb010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:29.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.419+0000 7f156eb28700 1 -- 172.21.15.26:0/3576529457 shutdown_connections 2023-10-01T08:00:29.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.419+0000 7f156eb28700 1 -- 172.21.15.26:0/3576529457 wait complete. 2023-10-01T08:00:29.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:29.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.492+0000 7f0784c19700 1 -- 172.21.15.26:0/3443521829 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f078009f420 con 0x7f0780139170 2023-10-01T08:00:29.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.492+0000 7f076effd700 1 -- 172.21.15.26:0/3443521829 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f077802c030 con 0x7f0780139170 2023-10-01T08:00:29.493 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:29.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.495+0000 7f0784c19700 1 -- 172.21.15.26:0/3443521829 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0780139170 msgr2=0x7f0780122220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:29.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.495+0000 7f0784c19700 1 --2- 172.21.15.26:0/3443521829 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0780139170 0x7f0780122220 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f0778014040 tx=0x7f0778004ad0 comp rx=0 tx=0).stop 2023-10-01T08:00:29.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.495+0000 7f0784c19700 1 -- 172.21.15.26:0/3443521829 shutdown_connections 2023-10-01T08:00:29.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.495+0000 7f0784c19700 1 --2- 172.21.15.26:0/3443521829 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0780139170 0x7f0780122220 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:29.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.495+0000 7f0784c19700 1 --2- 172.21.15.26:0/3443521829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f078009d6f0 0x7f07801217a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:29.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.495+0000 7f0784c19700 1 --2- 172.21.15.26:0/3443521829 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f078009e1d0 0x7f0780121ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:29.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.495+0000 7f0784c19700 1 -- 172.21.15.26:0/3443521829 >> 172.21.15.26:0/3443521829 conn(0x7f0780066f50 msgr2=0x7f0780070ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:29.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.495+0000 7f0784c19700 1 -- 172.21.15.26:0/3443521829 shutdown_connections 2023-10-01T08:00:29.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.495+0000 7f0784c19700 1 -- 172.21.15.26:0/3443521829 wait complete. 2023-10-01T08:00:29.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:29.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.536+0000 7f3e850ec700 1 -- 172.21.15.26:0/3949408764 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3e801a2830 con 0x7f3e8009f650 2023-10-01T08:00:29.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.536+0000 7f3e677fe700 1 -- 172.21.15.26:0/3949408764 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3e7800ae60 con 0x7f3e8009f650 2023-10-01T08:00:29.537 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:29.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.538+0000 7f3e850ec700 1 -- 172.21.15.26:0/3949408764 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e8009f650 msgr2=0x7f3e801a0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:29.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.538+0000 7f3e850ec700 1 --2- 172.21.15.26:0/3949408764 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e8009f650 0x7f3e801a0430 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f3e78002230 tx=0x7f3e7800cf50 comp rx=0 tx=0).stop 2023-10-01T08:00:29.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.538+0000 7f3e850ec700 1 -- 172.21.15.26:0/3949408764 shutdown_connections 2023-10-01T08:00:29.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.538+0000 7f3e850ec700 1 --2- 172.21.15.26:0/3949408764 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e8009f650 0x7f3e801a0430 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:29.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.538+0000 7f3e850ec700 1 --2- 172.21.15.26:0/3949408764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e8009e930 0x7f3e801b4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:29.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.538+0000 7f3e850ec700 1 --2- 172.21.15.26:0/3949408764 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e8009f240 0x7f3e801b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:29.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.538+0000 7f3e850ec700 1 -- 172.21.15.26:0/3949408764 >> 172.21.15.26:0/3949408764 conn(0x7f3e800a4210 msgr2=0x7f3e801b7890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:29.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.539+0000 7f3e850ec700 1 -- 172.21.15.26:0/3949408764 shutdown_connections 2023-10-01T08:00:29.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:29.539+0000 7f3e850ec700 1 -- 172.21.15.26:0/3949408764 wait complete. 2023-10-01T08:00:29.553 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:30.172 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:30.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.317+0000 7f2365c2c700 1 Processor -- start 2023-10-01T08:00:30.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.317+0000 7f2365c2c700 1 -- start start 2023-10-01T08:00:30.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.318+0000 7f2365c2c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f236009d6f0 0x7f236009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:30.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.318+0000 7f2365c2c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f236009e000 0x7f2360130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:30.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.318+0000 7f2365c2c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f236009f130 con 0x7f236009e410 2023-10-01T08:00:30.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.318+0000 7f2365c2c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f236009f520 con 0x7f236009d6f0 2023-10-01T08:00:30.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.318+0000 7f2365c2c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f236009e930 con 0x7f236009e000 2023-10-01T08:00:30.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.318+0000 7f235f7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f236009d6f0 0x7f236009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:30.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.318+0000 7f235effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f236009e000 0x7f2360130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:30.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.318+0000 7f235f7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f236009d6f0 0x7f236009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47298/0 (socket says 172.21.15.26:47298) 2023-10-01T08:00:30.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.318+0000 7f235effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f236009e000 0x7f2360130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:34316/0 (socket says 172.21.15.26:34316) 2023-10-01T08:00:30.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.318+0000 7f235f7fe700 1 -- 172.21.15.26:0/3126524468 learned_addr learned my addr 172.21.15.26:0/3126524468 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:30.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.318+0000 7f235f7fe700 1 -- 172.21.15.26:0/3126524468 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f236009e000 msgr2=0x7f2360130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:30.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.318+0000 7f235f7fe700 1 --2- 172.21.15.26:0/3126524468 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f236009e000 0x7f2360130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.318+0000 7f235f7fe700 1 -- 172.21.15.26:0/3126524468 >> v1:172.21.15.26:6789/0 conn(0x7f236009e410 legacy=0x7f2360130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:30.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.318+0000 7f235f7fe700 1 -- 172.21.15.26:0/3126524468 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236009b2d0 con 0x7f236009d6f0 2023-10-01T08:00:30.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.318+0000 7f235e7fc700 1 -- 172.21.15.26:0/3126524468 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4283927672 0 0) 0x7f236009f130 con 0x7f236009e410 2023-10-01T08:00:30.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.318+0000 7f235effd700 1 --2- 172.21.15.26:0/3126524468 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f236009e000 0x7f2360130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:30.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.318+0000 7f235f7fe700 1 --2- 172.21.15.26:0/3126524468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f236009d6f0 0x7f236009dac0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f23480098f0 tx=0x7f2348009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4814b7666fd7c7aa server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:30.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.318+0000 7f235e7fc700 1 -- 172.21.15.26:0/3126524468 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2348011830 con 0x7f236009d6f0 2023-10-01T08:00:30.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.319+0000 7f235e7fc700 1 -- 172.21.15.26:0/3126524468 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2348011990 con 0x7f236009d6f0 2023-10-01T08:00:30.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.319+0000 7f235e7fc700 1 -- 172.21.15.26:0/3126524468 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2348011d20 con 0x7f236009d6f0 2023-10-01T08:00:30.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.319+0000 7f2365c2c700 1 -- 172.21.15.26:0/3126524468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f236009d6f0 msgr2=0x7f236009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:30.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.319+0000 7f2365c2c700 1 --2- 172.21.15.26:0/3126524468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f236009d6f0 0x7f236009dac0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f23480098f0 tx=0x7f2348009c00 comp rx=0 tx=0).stop 2023-10-01T08:00:30.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.319+0000 7f2365c2c700 1 -- 172.21.15.26:0/3126524468 shutdown_connections 2023-10-01T08:00:30.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.319+0000 7f2365c2c700 1 --2- 172.21.15.26:0/3126524468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f236009d6f0 0x7f236009dac0 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.319+0000 7f2365c2c700 1 --2- 172.21.15.26:0/3126524468 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f236009e000 0x7f2360130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.319+0000 7f2365c2c700 1 -- 172.21.15.26:0/3126524468 >> 172.21.15.26:0/3126524468 conn(0x7f2360066f50 msgr2=0x7f236009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:30.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.319+0000 7f2365c2c700 1 -- 172.21.15.26:0/3126524468 shutdown_connections 2023-10-01T08:00:30.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.319+0000 7f2365c2c700 1 -- 172.21.15.26:0/3126524468 wait complete. 2023-10-01T08:00:30.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.321+0000 7f2365c2c700 1 Processor -- start 2023-10-01T08:00:30.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.321+0000 7f2365c2c700 1 -- start start 2023-10-01T08:00:30.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.321+0000 7f2365c2c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f236009d6f0 0x7f2360131630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:30.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.321+0000 7f2365c2c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f236009e000 0x7f2360131b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:30.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.321+0000 7f2365c2c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f236009e410 0x7f23601320b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:30.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.322+0000 7f2365c2c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23600a1e00 con 0x7f236009e000 2023-10-01T08:00:30.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.322+0000 7f2365c2c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236009c700 con 0x7f236009d6f0 2023-10-01T08:00:30.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.322+0000 7f2365c2c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2360134410 con 0x7f236009e410 2023-10-01T08:00:30.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.322+0000 7f235f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f236009d6f0 0x7f2360131630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:30.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.322+0000 7f235ffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f236009e410 0x7f23601320b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:30.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.322+0000 7f235f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f236009d6f0 0x7f2360131630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38498/0 (socket says 172.21.15.26:38498) 2023-10-01T08:00:30.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.322+0000 7f235f7fe700 1 -- 172.21.15.26:0/891893657 learned_addr learned my addr 172.21.15.26:0/891893657 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:30.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.322+0000 7f235effd700 1 --2- 172.21.15.26:0/891893657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f236009e000 0x7f2360131b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:30.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.322+0000 7f235f7fe700 1 -- 172.21.15.26:0/891893657 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f236009e410 msgr2=0x7f23601320b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:30.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.322+0000 7f235f7fe700 1 --2- 172.21.15.26:0/891893657 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f236009e410 0x7f23601320b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.322+0000 7f235f7fe700 1 -- 172.21.15.26:0/891893657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f236009e000 msgr2=0x7f2360131b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:30.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.322+0000 7f235f7fe700 1 --2- 172.21.15.26:0/891893657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f236009e000 0x7f2360131b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.322+0000 7f235f7fe700 1 -- 172.21.15.26:0/891893657 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23500094a0 con 0x7f236009d6f0 2023-10-01T08:00:30.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.322+0000 7f235ffff700 1 --2- 172.21.15.26:0/891893657 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f236009e410 0x7f23601320b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:30.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.322+0000 7f235f7fe700 1 --2- 172.21.15.26:0/891893657 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f236009d6f0 0x7f2360131630 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f236009b9e0 tx=0x7f2348004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:30.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.322+0000 7f2357fff700 1 -- 172.21.15.26:0/891893657 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2348004300 con 0x7f236009d6f0 2023-10-01T08:00:30.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.322+0000 7f2357fff700 1 -- 172.21.15.26:0/891893657 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f234801f070 con 0x7f236009d6f0 2023-10-01T08:00:30.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.322+0000 7f2365c2c700 1 -- 172.21.15.26:0/891893657 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2348009550 con 0x7f236009d6f0 2023-10-01T08:00:30.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.322+0000 7f2357fff700 1 -- 172.21.15.26:0/891893657 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23480036a0 con 0x7f236009d6f0 2023-10-01T08:00:30.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.322+0000 7f2365c2c700 1 -- 172.21.15.26:0/891893657 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2360130db0 con 0x7f236009d6f0 2023-10-01T08:00:30.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.323+0000 7f2357fff700 1 -- 172.21.15.26:0/891893657 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2348021030 con 0x7f236009d6f0 2023-10-01T08:00:30.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.323+0000 7f2357fff700 1 -- 172.21.15.26:0/891893657 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2348040a20 con 0x7f236009d6f0 2023-10-01T08:00:30.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.323+0000 7f2365c2c700 1 -- 172.21.15.26:0/891893657 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2360134580 con 0x7f236009d6f0 2023-10-01T08:00:30.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.328+0000 7f2357fff700 1 -- 172.21.15.26:0/891893657 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2348015070 con 0x7f236009d6f0 2023-10-01T08:00:30.435 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:30.510 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:30.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.537+0000 7f2365c2c700 1 -- 172.21.15.26:0/891893657 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2360132be0 con 0x7f236009d6f0 2023-10-01T08:00:30.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.538+0000 7f2357fff700 1 -- 172.21.15.26:0/891893657 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2348019770 con 0x7f236009d6f0 2023-10-01T08:00:30.538 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:30.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.540+0000 7f2365c2c700 1 -- 172.21.15.26:0/891893657 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f236009d6f0 msgr2=0x7f2360131630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:30.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.540+0000 7f2365c2c700 1 --2- 172.21.15.26:0/891893657 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f236009d6f0 0x7f2360131630 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f236009b9e0 tx=0x7f2348004750 comp rx=0 tx=0).stop 2023-10-01T08:00:30.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.540+0000 7f2365c2c700 1 -- 172.21.15.26:0/891893657 shutdown_connections 2023-10-01T08:00:30.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.540+0000 7f2365c2c700 1 --2- 172.21.15.26:0/891893657 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f236009e410 0x7f23601320b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.540+0000 7f2365c2c700 1 --2- 172.21.15.26:0/891893657 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f236009d6f0 0x7f2360131630 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.540+0000 7f2365c2c700 1 --2- 172.21.15.26:0/891893657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f236009e000 0x7f2360131b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.540+0000 7f2365c2c700 1 -- 172.21.15.26:0/891893657 >> 172.21.15.26:0/891893657 conn(0x7f2360066f50 msgr2=0x7f2360070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:30.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.540+0000 7f2365c2c700 1 -- 172.21.15.26:0/891893657 shutdown_connections 2023-10-01T08:00:30.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.540+0000 7f2365c2c700 1 -- 172.21.15.26:0/891893657 wait complete. 2023-10-01T08:00:30.554 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:30.556 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:30.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.575+0000 7f9c6debc700 1 Processor -- start 2023-10-01T08:00:30.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.575+0000 7f9c6debc700 1 -- start start 2023-10-01T08:00:30.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.575+0000 7f9c6debc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9c68131810 0x7f9c68131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:30.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.575+0000 7f9c6debc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c68099a40 0x7f9c68099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:30.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.575+0000 7f9c6debc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c6809a3b0 0x7f9c68138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:30.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.575+0000 7f9c6debc700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c681313c0 con 0x7f9c68131810 2023-10-01T08:00:30.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.575+0000 7f9c6debc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6806e8c0 con 0x7f9c6809a3b0 2023-10-01T08:00:30.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.575+0000 7f9c6debc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c68071d20 con 0x7f9c68099a40 2023-10-01T08:00:30.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.576+0000 7f9c67fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c6809a3b0 0x7f9c68138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:30.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.576+0000 7f9c66ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c68099a40 0x7f9c68099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:30.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.576+0000 7f9c677fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9c68131810 0x7f9c68131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:30.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.576+0000 7f9c67fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c6809a3b0 0x7f9c68138650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38512/0 (socket says 172.21.15.26:38512) 2023-10-01T08:00:30.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.576+0000 7f9c66ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c68099a40 0x7f9c68099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:34336/0 (socket says 172.21.15.26:34336) 2023-10-01T08:00:30.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.576+0000 7f9c67fff700 1 -- 172.21.15.26:0/2788528548 learned_addr learned my addr 172.21.15.26:0/2788528548 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:30.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.576+0000 7f9c66ffd700 1 -- 172.21.15.26:0/2788528548 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c6809a3b0 msgr2=0x7f9c68138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:30.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.576+0000 7f9c66ffd700 1 --2- 172.21.15.26:0/2788528548 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c6809a3b0 0x7f9c68138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.576+0000 7f9c66ffd700 1 -- 172.21.15.26:0/2788528548 >> v2:172.21.15.26:3300/0 conn(0x7f9c68131810 msgr2=0x7f9c68131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:30.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.576+0000 7f9c66ffd700 1 --2- 172.21.15.26:0/2788528548 >> v2:172.21.15.26:3300/0 conn(0x7f9c68131810 0x7f9c68131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.576+0000 7f9c66ffd700 1 -- 172.21.15.26:0/2788528548 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c680721a0 con 0x7f9c68099a40 2023-10-01T08:00:30.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.576+0000 7f9c67fff700 1 --2- 172.21.15.26:0/2788528548 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c6809a3b0 0x7f9c68138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:30.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.576+0000 7f9c677fe700 1 --2- 172.21.15.26:0/2788528548 >> v2:172.21.15.26:3300/0 conn(0x7f9c68131810 0x7f9c68131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:30.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.576+0000 7f9c66ffd700 1 --2- 172.21.15.26:0/2788528548 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c68099a40 0x7f9c68099e70 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c009840 tx=0x7f9c5c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5a32536fd393ef server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:30.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.577+0000 7f9c667fc700 1 -- 172.21.15.26:0/2788528548 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c011830 con 0x7f9c68099a40 2023-10-01T08:00:30.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.577+0000 7f9c667fc700 1 -- 172.21.15.26:0/2788528548 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5c011990 con 0x7f9c68099a40 2023-10-01T08:00:30.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.577+0000 7f9c667fc700 1 -- 172.21.15.26:0/2788528548 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c011d20 con 0x7f9c68099a40 2023-10-01T08:00:30.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.577+0000 7f9c6debc700 1 -- 172.21.15.26:0/2788528548 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c68099a40 msgr2=0x7f9c68099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:30.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.577+0000 7f9c6debc700 1 --2- 172.21.15.26:0/2788528548 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c68099a40 0x7f9c68099e70 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c009840 tx=0x7f9c5c009b50 comp rx=0 tx=0).stop 2023-10-01T08:00:30.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.577+0000 7f9c6debc700 1 -- 172.21.15.26:0/2788528548 shutdown_connections 2023-10-01T08:00:30.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.577+0000 7f9c6debc700 1 --2- 172.21.15.26:0/2788528548 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c6809a3b0 0x7f9c68138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.577+0000 7f9c6debc700 1 --2- 172.21.15.26:0/2788528548 >> v2:172.21.15.26:3300/0 conn(0x7f9c68131810 0x7f9c68131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.577+0000 7f9c6debc700 1 --2- 172.21.15.26:0/2788528548 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c68099a40 0x7f9c68099e70 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.577+0000 7f9c6debc700 1 -- 172.21.15.26:0/2788528548 >> 172.21.15.26:0/2788528548 conn(0x7f9c680a2aa0 msgr2=0x7f9c680a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:30.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.578+0000 7f9c6debc700 1 -- 172.21.15.26:0/2788528548 shutdown_connections 2023-10-01T08:00:30.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.578+0000 7f9c6debc700 1 -- 172.21.15.26:0/2788528548 wait complete. 2023-10-01T08:00:30.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.579+0000 7f9c6debc700 1 Processor -- start 2023-10-01T08:00:30.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.579+0000 7f9c6debc700 1 -- start start 2023-10-01T08:00:30.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.580+0000 7f9c6debc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c68099a40 0x7f9c681c6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:30.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.580+0000 7f9c6debc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c6809a3b0 0x7f9c681c6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:30.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.580+0000 7f9c6debc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c68131810 0x7f9c681c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:30.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.580+0000 7f9c6debc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c681c6c80 con 0x7f9c68099a40 2023-10-01T08:00:30.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.580+0000 7f9c6debc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6811d080 con 0x7f9c68131810 2023-10-01T08:00:30.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.580+0000 7f9c6debc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c680a1d50 con 0x7f9c6809a3b0 2023-10-01T08:00:30.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.580+0000 7f9c66ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c6809a3b0 0x7f9c681c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:30.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.580+0000 7f9c66ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c6809a3b0 0x7f9c681c6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:34342/0 (socket says 172.21.15.26:34342) 2023-10-01T08:00:30.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.580+0000 7f9c66ffd700 1 -- 172.21.15.26:0/1492011968 learned_addr learned my addr 172.21.15.26:0/1492011968 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:30.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.580+0000 7f9c67fff700 1 --2- 172.21.15.26:0/1492011968 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c68131810 0x7f9c681c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:30.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.580+0000 7f9c677fe700 1 --2- 172.21.15.26:0/1492011968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c68099a40 0x7f9c681c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:30.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.581+0000 7f9c66ffd700 1 -- 172.21.15.26:0/1492011968 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c68131810 msgr2=0x7f9c681c27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:30.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.581+0000 7f9c66ffd700 1 --2- 172.21.15.26:0/1492011968 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c68131810 0x7f9c681c27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.581+0000 7f9c66ffd700 1 -- 172.21.15.26:0/1492011968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c68099a40 msgr2=0x7f9c681c6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:30.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.581+0000 7f9c66ffd700 1 --2- 172.21.15.26:0/1492011968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c68099a40 0x7f9c681c6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.581+0000 7f9c66ffd700 1 -- 172.21.15.26:0/1492011968 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c60009b30 con 0x7f9c6809a3b0 2023-10-01T08:00:30.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.581+0000 7f9c66ffd700 1 --2- 172.21.15.26:0/1492011968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c6809a3b0 0x7f9c681c6740 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c0090b0 tx=0x7f9c5c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:30.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.581+0000 7f9c4ffff700 1 -- 172.21.15.26:0/1492011968 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c004510 con 0x7f9c6809a3b0 2023-10-01T08:00:30.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.581+0000 7f9c4ffff700 1 -- 172.21.15.26:0/1492011968 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5c01f070 con 0x7f9c6809a3b0 2023-10-01T08:00:30.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.581+0000 7f9c6debc700 1 -- 172.21.15.26:0/1492011968 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c580094a0 con 0x7f9c6809a3b0 2023-10-01T08:00:30.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.581+0000 7f9c4ffff700 1 -- 172.21.15.26:0/1492011968 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c0038e0 con 0x7f9c6809a3b0 2023-10-01T08:00:30.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.581+0000 7f9c6debc700 1 -- 172.21.15.26:0/1492011968 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c5c0094a0 con 0x7f9c6809a3b0 2023-10-01T08:00:30.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.582+0000 7f9c4ffff700 1 -- 172.21.15.26:0/1492011968 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9c5c003a40 con 0x7f9c6809a3b0 2023-10-01T08:00:30.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.582+0000 7f9c4ffff700 1 -- 172.21.15.26:0/1492011968 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9c5c021070 con 0x7f9c6809a3b0 2023-10-01T08:00:30.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.582+0000 7f9c6debc700 1 -- 172.21.15.26:0/1492011968 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c68074ea0 con 0x7f9c6809a3b0 2023-10-01T08:00:30.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.588+0000 7f9c4ffff700 1 -- 172.21.15.26:0/1492011968 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c5c01a7b0 con 0x7f9c6809a3b0 2023-10-01T08:00:30.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.652+0000 7f7bee616700 1 Processor -- start 2023-10-01T08:00:30.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.652+0000 7f7bee616700 1 -- start start 2023-10-01T08:00:30.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.653+0000 7f7bee616700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7be809d6f0 0x7f7be809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:30.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.653+0000 7f7bee616700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7be809e000 0x7f7be8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:30.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.653+0000 7f7bee616700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7be809e410 0x7f7be8130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:30.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.653+0000 7f7bee616700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be809f520 con 0x7f7be809e000 2023-10-01T08:00:30.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.653+0000 7f7bee616700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be809f130 con 0x7f7be809d6f0 2023-10-01T08:00:30.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.653+0000 7f7bee616700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7be809e930 con 0x7f7be809e410 2023-10-01T08:00:30.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.653+0000 7f7be7fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7be809d6f0 0x7f7be809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:30.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.653+0000 7f7be7fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7be809d6f0 0x7f7be809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38534/0 (socket says 172.21.15.26:38534) 2023-10-01T08:00:30.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.653+0000 7f7be7fff700 1 -- 172.21.15.26:0/4041621708 learned_addr learned my addr 172.21.15.26:0/4041621708 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:30.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.653+0000 7f7becbb3700 1 --2- 172.21.15.26:0/4041621708 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7be809e410 0x7f7be8130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:30.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.653+0000 7f7be77fe700 1 --2- 172.21.15.26:0/4041621708 >> v2:172.21.15.26:3300/0 conn(0x7f7be809e000 0x7f7be8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:30.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.653+0000 7f7be7fff700 1 -- 172.21.15.26:0/4041621708 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7be809e410 msgr2=0x7f7be8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:30.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.653+0000 7f7be7fff700 1 --2- 172.21.15.26:0/4041621708 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7be809e410 0x7f7be8130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.653+0000 7f7be7fff700 1 -- 172.21.15.26:0/4041621708 >> v2:172.21.15.26:3300/0 conn(0x7f7be809e000 msgr2=0x7f7be8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:30.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.653+0000 7f7be7fff700 1 --2- 172.21.15.26:0/4041621708 >> v2:172.21.15.26:3300/0 conn(0x7f7be809e000 0x7f7be8130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.653+0000 7f7be7fff700 1 -- 172.21.15.26:0/4041621708 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be809b2d0 con 0x7f7be809d6f0 2023-10-01T08:00:30.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.653+0000 7f7becbb3700 1 --2- 172.21.15.26:0/4041621708 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7be809e410 0x7f7be8130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:30.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.653+0000 7f7be77fe700 1 --2- 172.21.15.26:0/4041621708 >> v2:172.21.15.26:3300/0 conn(0x7f7be809e000 0x7f7be8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T08:00:30.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.654+0000 7f7be7fff700 1 --2- 172.21.15.26:0/4041621708 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7be809d6f0 0x7f7be809dac0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800bb90 tx=0x7f7bd800bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcbbd9a2eeaec506 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:30.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.654+0000 7f7be6ffd700 1 -- 172.21.15.26:0/4041621708 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd800dd30 con 0x7f7be809d6f0 2023-10-01T08:00:30.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.654+0000 7f7be6ffd700 1 -- 172.21.15.26:0/4041621708 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd800de90 con 0x7f7be809d6f0 2023-10-01T08:00:30.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.654+0000 7f7be6ffd700 1 -- 172.21.15.26:0/4041621708 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8010690 con 0x7f7be809d6f0 2023-10-01T08:00:30.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.655+0000 7f7bee616700 1 -- 172.21.15.26:0/4041621708 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7be809d6f0 msgr2=0x7f7be809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:30.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.655+0000 7f7bee616700 1 --2- 172.21.15.26:0/4041621708 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7be809d6f0 0x7f7be809dac0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800bb90 tx=0x7f7bd800bea0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.655+0000 7f7bee616700 1 -- 172.21.15.26:0/4041621708 shutdown_connections 2023-10-01T08:00:30.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.655+0000 7f7bee616700 1 --2- 172.21.15.26:0/4041621708 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7be809e410 0x7f7be8130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.655+0000 7f7bee616700 1 --2- 172.21.15.26:0/4041621708 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7be809d6f0 0x7f7be809dac0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.655+0000 7f7bee616700 1 --2- 172.21.15.26:0/4041621708 >> v2:172.21.15.26:3300/0 conn(0x7f7be809e000 0x7f7be8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.655+0000 7f7bee616700 1 -- 172.21.15.26:0/4041621708 >> 172.21.15.26:0/4041621708 conn(0x7f7be8066f50 msgr2=0x7f7be809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:30.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.655+0000 7f7bee616700 1 -- 172.21.15.26:0/4041621708 shutdown_connections 2023-10-01T08:00:30.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.655+0000 7f7bee616700 1 -- 172.21.15.26:0/4041621708 wait complete. 2023-10-01T08:00:30.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.656+0000 7f7bee616700 1 Processor -- start 2023-10-01T08:00:30.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.656+0000 7f7bee616700 1 -- start start 2023-10-01T08:00:30.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.656+0000 7f7bee616700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7be809d6f0 0x7f7be811e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:30.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.656+0000 7f7bee616700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7be809e000 0x7f7be811e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:30.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.656+0000 7f7bee616700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7be809e410 0x7f7be811eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:30.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.657+0000 7f7bee616700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be8120230 con 0x7f7be809d6f0 2023-10-01T08:00:30.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.657+0000 7f7bee616700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be80a1a50 con 0x7f7be809e000 2023-10-01T08:00:30.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.657+0000 7f7bee616700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7be8121320 con 0x7f7be809e410 2023-10-01T08:00:30.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.657+0000 7f7be7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7be809d6f0 0x7f7be811e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:30.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.657+0000 7f7be7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7be809d6f0 0x7f7be811e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47348/0 (socket says 172.21.15.26:47348) 2023-10-01T08:00:30.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.657+0000 7f7be7fff700 1 -- 172.21.15.26:0/4091265419 learned_addr learned my addr 172.21.15.26:0/4091265419 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:30.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.657+0000 7f7becbb3700 1 --2- 172.21.15.26:0/4091265419 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7be809e410 0x7f7be811eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:30.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.657+0000 7f7be77fe700 1 --2- 172.21.15.26:0/4091265419 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7be809e000 0x7f7be811e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:30.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.657+0000 7f7be77fe700 1 -- 172.21.15.26:0/4091265419 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7be809e410 msgr2=0x7f7be811eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:30.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.657+0000 7f7be77fe700 1 --2- 172.21.15.26:0/4091265419 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7be809e410 0x7f7be811eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.657+0000 7f7be77fe700 1 -- 172.21.15.26:0/4091265419 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7be809d6f0 msgr2=0x7f7be811e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:30.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.657+0000 7f7be77fe700 1 --2- 172.21.15.26:0/4091265419 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7be809d6f0 0x7f7be811e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.657+0000 7f7be77fe700 1 -- 172.21.15.26:0/4091265419 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be0009a70 con 0x7f7be809e000 2023-10-01T08:00:30.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.657+0000 7f7becbb3700 1 --2- 172.21.15.26:0/4091265419 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7be809e410 0x7f7be811eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:30.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.657+0000 7f7be7fff700 1 --2- 172.21.15.26:0/4091265419 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7be809d6f0 0x7f7be811e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:30.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.657+0000 7f7be77fe700 1 --2- 172.21.15.26:0/4091265419 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7be809e000 0x7f7be811e5b0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc00d7d0 tx=0x7f7bdc00dae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:30.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.658+0000 7f7be4ff9700 1 -- 172.21.15.26:0/4091265419 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc0125f0 con 0x7f7be809e000 2023-10-01T08:00:30.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.658+0000 7f7be4ff9700 1 -- 172.21.15.26:0/4091265419 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bdc012750 con 0x7f7be809e000 2023-10-01T08:00:30.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.658+0000 7f7bee616700 1 -- 172.21.15.26:0/4091265419 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bd800b7f0 con 0x7f7be809e000 2023-10-01T08:00:30.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.658+0000 7f7be4ff9700 1 -- 172.21.15.26:0/4091265419 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc012b00 con 0x7f7be809e000 2023-10-01T08:00:30.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.658+0000 7f7bee616700 1 -- 172.21.15.26:0/4091265419 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be8122320 con 0x7f7be809e000 2023-10-01T08:00:30.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.659+0000 7f7be4ff9700 1 -- 172.21.15.26:0/4091265419 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7bdc012c60 con 0x7f7be809e000 2023-10-01T08:00:30.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.659+0000 7f7be4ff9700 1 -- 172.21.15.26:0/4091265419 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7bdc03f7c0 con 0x7f7be809e000 2023-10-01T08:00:30.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.659+0000 7f7bee616700 1 -- 172.21.15.26:0/4091265419 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7be8120ed0 con 0x7f7be809e000 2023-10-01T08:00:30.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.668+0000 7f7be4ff9700 1 -- 172.21.15.26:0/4091265419 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7bdc014430 con 0x7f7be809e000 2023-10-01T08:00:30.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.699+0000 7f6227f36700 1 Processor -- start 2023-10-01T08:00:30.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.700+0000 7f6227f36700 1 -- start start 2023-10-01T08:00:30.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.700+0000 7f6227f36700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62200a0a30 0x7f62200a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:30.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.700+0000 7f6227f36700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6220134170 0x7f622013bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:30.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.700+0000 7f6227f36700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f622009edd0 con 0x7f62200a1340 2023-10-01T08:00:30.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.700+0000 7f6227f36700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f622009e1f0 con 0x7f6220134170 2023-10-01T08:00:30.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.700+0000 7f6227f36700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f622009dc50 con 0x7f62200a0a30 2023-10-01T08:00:30.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.700+0000 7f62254d1700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f62200a1340 0x7f6220133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46720/0 (socket says 172.21.15.26:46720) 2023-10-01T08:00:30.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.700+0000 7f62254d1700 1 -- 172.21.15.26:0/253167537 learned_addr learned my addr 172.21.15.26:0/253167537 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:30.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.700+0000 7f6225cd2700 1 --2- 172.21.15.26:0/253167537 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62200a0a30 0x7f62200a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:30.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.700+0000 7f62264d3700 1 --2- 172.21.15.26:0/253167537 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6220134170 0x7f622013bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:30.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.701+0000 7f6224cd0700 1 -- 172.21.15.26:0/253167537 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4010946233 0 0) 0x7f622009edd0 con 0x7f62200a1340 2023-10-01T08:00:30.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.701+0000 7f6224cd0700 1 -- 172.21.15.26:0/253167537 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f620c0035b0 con 0x7f62200a1340 2023-10-01T08:00:30.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.701+0000 7f6225cd2700 1 -- 172.21.15.26:0/253167537 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6220134170 msgr2=0x7f622013bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:30.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.701+0000 7f6225cd2700 1 --2- 172.21.15.26:0/253167537 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6220134170 0x7f622013bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.701+0000 7f6225cd2700 1 -- 172.21.15.26:0/253167537 >> v1:172.21.15.26:6789/0 conn(0x7f62200a1340 legacy=0x7f6220133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:30.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.701+0000 7f6225cd2700 1 -- 172.21.15.26:0/253167537 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62200a1fe0 con 0x7f62200a0a30 2023-10-01T08:00:30.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.701+0000 7f6225cd2700 1 --2- 172.21.15.26:0/253167537 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62200a0a30 0x7f62200a0e00 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f621c009dc0 tx=0x7f621c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=648b770e6e3e8512 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:30.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.701+0000 7f6224cd0700 1 -- 172.21.15.26:0/253167537 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c00e070 con 0x7f62200a0a30 2023-10-01T08:00:30.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.701+0000 7f6224cd0700 1 -- 172.21.15.26:0/253167537 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621c00bb20 con 0x7f62200a0a30 2023-10-01T08:00:30.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.701+0000 7f6224cd0700 1 -- 172.21.15.26:0/253167537 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c012430 con 0x7f62200a0a30 2023-10-01T08:00:30.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.702+0000 7f6227f36700 1 -- 172.21.15.26:0/253167537 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62200a0a30 msgr2=0x7f62200a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:30.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.702+0000 7f6227f36700 1 --2- 172.21.15.26:0/253167537 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62200a0a30 0x7f62200a0e00 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f621c009dc0 tx=0x7f621c00b330 comp rx=0 tx=0).stop 2023-10-01T08:00:30.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.702+0000 7f6227f36700 1 -- 172.21.15.26:0/253167537 shutdown_connections 2023-10-01T08:00:30.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.702+0000 7f6227f36700 1 --2- 172.21.15.26:0/253167537 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62200a0a30 0x7f62200a0e00 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.702+0000 7f6227f36700 1 --2- 172.21.15.26:0/253167537 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6220134170 0x7f622013bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.702+0000 7f6227f36700 1 -- 172.21.15.26:0/253167537 >> 172.21.15.26:0/253167537 conn(0x7f62200a6550 msgr2=0x7f62200a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:30.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.702+0000 7f6227f36700 1 -- 172.21.15.26:0/253167537 shutdown_connections 2023-10-01T08:00:30.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.702+0000 7f6227f36700 1 -- 172.21.15.26:0/253167537 wait complete. 2023-10-01T08:00:30.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.703+0000 7f6227f36700 1 Processor -- start 2023-10-01T08:00:30.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.703+0000 7f6227f36700 1 -- start start 2023-10-01T08:00:30.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.703+0000 7f6227f36700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62200a0a30 0x7f6220122680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:30.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.703+0000 7f6227f36700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62200a1340 0x7f6220122bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:30.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.704+0000 7f6227f36700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6220134170 0x7f6220123100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:30.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.704+0000 7f6227f36700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6220125b70 con 0x7f62200a1340 2023-10-01T08:00:30.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.704+0000 7f6227f36700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62201335b0 con 0x7f6220134170 2023-10-01T08:00:30.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.704+0000 7f6227f36700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6220125860 con 0x7f62200a0a30 2023-10-01T08:00:30.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.704+0000 7f62264d3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6220134170 0x7f6220123100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:30.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.704+0000 7f62264d3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6220134170 0x7f6220123100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38564/0 (socket says 172.21.15.26:38564) 2023-10-01T08:00:30.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.704+0000 7f62264d3700 1 -- 172.21.15.26:0/2347907681 learned_addr learned my addr 172.21.15.26:0/2347907681 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:30.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.704+0000 7f62254d1700 1 --2- 172.21.15.26:0/2347907681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62200a1340 0x7f6220122bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:30.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.704+0000 7f62264d3700 1 -- 172.21.15.26:0/2347907681 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62200a0a30 msgr2=0x7f6220122680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:30.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.704+0000 7f62264d3700 1 --2- 172.21.15.26:0/2347907681 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62200a0a30 0x7f6220122680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.704+0000 7f62264d3700 1 -- 172.21.15.26:0/2347907681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62200a1340 msgr2=0x7f6220122bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:30.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.704+0000 7f62264d3700 1 --2- 172.21.15.26:0/2347907681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62200a1340 0x7f6220122bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.704+0000 7f62264d3700 1 -- 172.21.15.26:0/2347907681 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f621c009a70 con 0x7f6220134170 2023-10-01T08:00:30.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.704+0000 7f62264d3700 1 --2- 172.21.15.26:0/2347907681 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6220134170 0x7f6220123100 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f621800e950 tx=0x7f621800ec60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:30.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.704+0000 7f62167fc700 1 -- 172.21.15.26:0/2347907681 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6218009730 con 0x7f6220134170 2023-10-01T08:00:30.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.705+0000 7f62167fc700 1 -- 172.21.15.26:0/2347907681 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621800eea0 con 0x7f6220134170 2023-10-01T08:00:30.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.705+0000 7f6227f36700 1 -- 172.21.15.26:0/2347907681 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62200a25e0 con 0x7f6220134170 2023-10-01T08:00:30.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.705+0000 7f62167fc700 1 -- 172.21.15.26:0/2347907681 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621800ca70 con 0x7f6220134170 2023-10-01T08:00:30.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.705+0000 7f6227f36700 1 -- 172.21.15.26:0/2347907681 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6220133150 con 0x7f6220134170 2023-10-01T08:00:30.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.706+0000 7f62167fc700 1 -- 172.21.15.26:0/2347907681 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f621800cbf0 con 0x7f6220134170 2023-10-01T08:00:30.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.706+0000 7f6227f36700 1 -- 172.21.15.26:0/2347907681 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6220074ea0 con 0x7f6220134170 2023-10-01T08:00:30.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.706+0000 7f62167fc700 1 -- 172.21.15.26:0/2347907681 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f621803f990 con 0x7f6220134170 2023-10-01T08:00:30.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.711+0000 7f62167fc700 1 -- 172.21.15.26:0/2347907681 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f62180137f0 con 0x7f6220134170 2023-10-01T08:00:30.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.802+0000 7f9c6debc700 1 -- 172.21.15.26:0/1492011968 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9c6811de60 con 0x7f9c6809a3b0 2023-10-01T08:00:30.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.803+0000 7f9c4ffff700 1 -- 172.21.15.26:0/1492011968 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9c5c02b030 con 0x7f9c6809a3b0 2023-10-01T08:00:30.804 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:30.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.805+0000 7f9c6debc700 1 -- 172.21.15.26:0/1492011968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c6809a3b0 msgr2=0x7f9c681c6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:30.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.805+0000 7f9c6debc700 1 --2- 172.21.15.26:0/1492011968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c6809a3b0 0x7f9c681c6740 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c0090b0 tx=0x7f9c5c004750 comp rx=0 tx=0).stop 2023-10-01T08:00:30.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.805+0000 7f9c6debc700 1 -- 172.21.15.26:0/1492011968 shutdown_connections 2023-10-01T08:00:30.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.805+0000 7f9c6debc700 1 --2- 172.21.15.26:0/1492011968 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9c68131810 0x7f9c681c27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.805+0000 7f9c6debc700 1 --2- 172.21.15.26:0/1492011968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c68099a40 0x7f9c681c6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.805+0000 7f9c6debc700 1 --2- 172.21.15.26:0/1492011968 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9c6809a3b0 0x7f9c681c6740 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.805+0000 7f9c6debc700 1 -- 172.21.15.26:0/1492011968 >> 172.21.15.26:0/1492011968 conn(0x7f9c680a2aa0 msgr2=0x7f9c681b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:30.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.806+0000 7f9c6debc700 1 -- 172.21.15.26:0/1492011968 shutdown_connections 2023-10-01T08:00:30.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.806+0000 7f9c6debc700 1 -- 172.21.15.26:0/1492011968 wait complete. 2023-10-01T08:00:30.821 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:30.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.879+0000 7f7bee616700 1 -- 172.21.15.26:0/4091265419 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7be8074ea0 con 0x7f7be809e000 2023-10-01T08:00:30.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.879+0000 7f7be4ff9700 1 -- 172.21.15.26:0/4091265419 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7bdc011340 con 0x7f7be809e000 2023-10-01T08:00:30.880 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:30.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.882+0000 7f7bee616700 1 -- 172.21.15.26:0/4091265419 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7be809e000 msgr2=0x7f7be811e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:30.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.882+0000 7f7bee616700 1 --2- 172.21.15.26:0/4091265419 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7be809e000 0x7f7be811e5b0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc00d7d0 tx=0x7f7bdc00dae0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.882+0000 7f7bee616700 1 -- 172.21.15.26:0/4091265419 shutdown_connections 2023-10-01T08:00:30.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.882+0000 7f7bee616700 1 --2- 172.21.15.26:0/4091265419 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7be809e410 0x7f7be811eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.882+0000 7f7bee616700 1 --2- 172.21.15.26:0/4091265419 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7be809d6f0 0x7f7be811e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.882+0000 7f7bee616700 1 --2- 172.21.15.26:0/4091265419 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7be809e000 0x7f7be811e5b0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.882+0000 7f7bee616700 1 -- 172.21.15.26:0/4091265419 >> 172.21.15.26:0/4091265419 conn(0x7f7be8066f50 msgr2=0x7f7be806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:30.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.882+0000 7f7bee616700 1 -- 172.21.15.26:0/4091265419 shutdown_connections 2023-10-01T08:00:30.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.882+0000 7f7bee616700 1 -- 172.21.15.26:0/4091265419 wait complete. 2023-10-01T08:00:30.896 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:30.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.919+0000 7f6227f36700 1 -- 172.21.15.26:0/2347907681 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6220133150 con 0x7f6220134170 2023-10-01T08:00:30.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.919+0000 7f62167fc700 1 -- 172.21.15.26:0/2347907681 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6220133150 con 0x7f6220134170 2023-10-01T08:00:30.920 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:30.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.922+0000 7f6227f36700 1 -- 172.21.15.26:0/2347907681 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6220134170 msgr2=0x7f6220123100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:30.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.922+0000 7f6227f36700 1 --2- 172.21.15.26:0/2347907681 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6220134170 0x7f6220123100 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f621800e950 tx=0x7f621800ec60 comp rx=0 tx=0).stop 2023-10-01T08:00:30.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.922+0000 7f6227f36700 1 -- 172.21.15.26:0/2347907681 shutdown_connections 2023-10-01T08:00:30.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.922+0000 7f6227f36700 1 --2- 172.21.15.26:0/2347907681 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6220134170 0x7f6220123100 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.922+0000 7f6227f36700 1 --2- 172.21.15.26:0/2347907681 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f62200a0a30 0x7f6220122680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.922+0000 7f6227f36700 1 --2- 172.21.15.26:0/2347907681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62200a1340 0x7f6220122bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:30.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.922+0000 7f6227f36700 1 -- 172.21.15.26:0/2347907681 >> 172.21.15.26:0/2347907681 conn(0x7f62200a6550 msgr2=0x7f622009edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:30.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.922+0000 7f6227f36700 1 -- 172.21.15.26:0/2347907681 shutdown_connections 2023-10-01T08:00:30.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:30.922+0000 7f6227f36700 1 -- 172.21.15.26:0/2347907681 wait complete. 2023-10-01T08:00:30.936 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:31.557 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:31.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.702+0000 7fbc0b5e0700 1 Processor -- start 2023-10-01T08:00:31.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.702+0000 7fbc0b5e0700 1 -- start start 2023-10-01T08:00:31.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.703+0000 7fbc0b5e0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc0409d6f0 0x7fbc0409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:31.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.703+0000 7fbc0b5e0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc0409e000 0x7fbc041339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:31.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.703+0000 7fbc0b5e0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbc0409e410 0x7fbc04133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:31.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.703+0000 7fbc0b5e0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc0406b460 con 0x7fbc0409e410 2023-10-01T08:00:31.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.703+0000 7fbc0b5e0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0409b120 con 0x7fbc0409e000 2023-10-01T08:00:31.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.703+0000 7fbc0b5e0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0409a7e0 con 0x7fbc0409d6f0 2023-10-01T08:00:31.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.703+0000 7fbc09b7d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbc0409e410 0x7fbc04133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:31.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.703+0000 7fbc0937c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc0409d6f0 0x7fbc0409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:31.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.703+0000 7fbc08b7b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc0409e000 0x7fbc041339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:31.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.703+0000 7fbc09b7d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbc0409e410 0x7fbc04133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47360/0 (socket says 172.21.15.26:47360) 2023-10-01T08:00:31.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.703+0000 7fbc0937c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc0409d6f0 0x7fbc0409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:34366/0 (socket says 172.21.15.26:34366) 2023-10-01T08:00:31.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.703+0000 7fbc09b7d700 1 -- 172.21.15.26:0/2094440153 learned_addr learned my addr 172.21.15.26:0/2094440153 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:31.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.703+0000 7fbc08b7b700 1 -- 172.21.15.26:0/2094440153 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc0409d6f0 msgr2=0x7fbc0409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:31.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.703+0000 7fbc08b7b700 1 --2- 172.21.15.26:0/2094440153 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc0409d6f0 0x7fbc0409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:31.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.703+0000 7fbc08b7b700 1 -- 172.21.15.26:0/2094440153 >> v2:172.21.15.26:3300/0 conn(0x7fbc0409e410 msgr2=0x7fbc04133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:31.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.703+0000 7fbc08b7b700 1 --2- 172.21.15.26:0/2094440153 >> v2:172.21.15.26:3300/0 conn(0x7fbc0409e410 0x7fbc04133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:31.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.703+0000 7fbc08b7b700 1 -- 172.21.15.26:0/2094440153 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc0409a500 con 0x7fbc0409e000 2023-10-01T08:00:31.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.703+0000 7fbc09b7d700 1 --2- 172.21.15.26:0/2094440153 >> v2:172.21.15.26:3300/0 conn(0x7fbc0409e410 0x7fbc04133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:31.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.703+0000 7fbc0937c700 1 --2- 172.21.15.26:0/2094440153 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc0409d6f0 0x7fbc0409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:31.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.703+0000 7fbc08b7b700 1 --2- 172.21.15.26:0/2094440153 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc0409e000 0x7fbc041339f0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8009870 tx=0x7fbbf8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11b9d11eb5b96226 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:31.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.704+0000 7fbbf7fff700 1 -- 172.21.15.26:0/2094440153 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf8011830 con 0x7fbc0409e000 2023-10-01T08:00:31.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.704+0000 7fbbf7fff700 1 -- 172.21.15.26:0/2094440153 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf8011990 con 0x7fbc0409e000 2023-10-01T08:00:31.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.704+0000 7fbbf7fff700 1 -- 172.21.15.26:0/2094440153 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf8011d20 con 0x7fbc0409e000 2023-10-01T08:00:31.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.704+0000 7fbc0b5e0700 1 -- 172.21.15.26:0/2094440153 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc0409e000 msgr2=0x7fbc041339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:31.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.704+0000 7fbc0b5e0700 1 --2- 172.21.15.26:0/2094440153 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc0409e000 0x7fbc041339f0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8009870 tx=0x7fbbf8009b80 comp rx=0 tx=0).stop 2023-10-01T08:00:31.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.704+0000 7fbc0b5e0700 1 -- 172.21.15.26:0/2094440153 shutdown_connections 2023-10-01T08:00:31.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.704+0000 7fbc0b5e0700 1 --2- 172.21.15.26:0/2094440153 >> v2:172.21.15.26:3300/0 conn(0x7fbc0409e410 0x7fbc04133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:31.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.704+0000 7fbc0b5e0700 1 --2- 172.21.15.26:0/2094440153 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc0409d6f0 0x7fbc0409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:31.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.704+0000 7fbc0b5e0700 1 --2- 172.21.15.26:0/2094440153 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc0409e000 0x7fbc041339f0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:31.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.704+0000 7fbc0b5e0700 1 -- 172.21.15.26:0/2094440153 >> 172.21.15.26:0/2094440153 conn(0x7fbc04066f50 msgr2=0x7fbc0409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:31.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.704+0000 7fbc0b5e0700 1 -- 172.21.15.26:0/2094440153 shutdown_connections 2023-10-01T08:00:31.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.704+0000 7fbc0b5e0700 1 -- 172.21.15.26:0/2094440153 wait complete. 2023-10-01T08:00:31.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.705+0000 7fbc0b5e0700 1 Processor -- start 2023-10-01T08:00:31.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.705+0000 7fbc0b5e0700 1 -- start start 2023-10-01T08:00:31.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.706+0000 7fbc0b5e0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc0409d6f0 0x7fbc041a5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:31.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.706+0000 7fbc0b5e0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc0409e000 0x7fbc041a62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:31.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.706+0000 7fbc0b5e0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc0409e410 0x7fbc041a6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:31.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.706+0000 7fbc0b5e0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc041aa270 con 0x7fbc0409e410 2023-10-01T08:00:31.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.706+0000 7fbc0b5e0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc041a79a0 con 0x7fbc0409d6f0 2023-10-01T08:00:31.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.706+0000 7fbc0b5e0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc041a7fc0 con 0x7fbc0409e000 2023-10-01T08:00:31.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.706+0000 7fbc0937c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc0409d6f0 0x7fbc041a5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:31.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.706+0000 7fbc0937c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc0409d6f0 0x7fbc041a5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38586/0 (socket says 172.21.15.26:38586) 2023-10-01T08:00:31.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.706+0000 7fbc08b7b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc0409e000 0x7fbc041a62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:31.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.706+0000 7fbc0937c700 1 -- 172.21.15.26:0/2918352373 learned_addr learned my addr 172.21.15.26:0/2918352373 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:31.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.706+0000 7fbc09b7d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc0409e410 0x7fbc041a6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:31.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.706+0000 7fbc0937c700 1 -- 172.21.15.26:0/2918352373 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc0409e000 msgr2=0x7fbc041a62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:31.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.706+0000 7fbc0937c700 1 --2- 172.21.15.26:0/2918352373 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc0409e000 0x7fbc041a62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:31.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.706+0000 7fbc0937c700 1 -- 172.21.15.26:0/2918352373 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc0409e410 msgr2=0x7fbc041a6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:31.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.706+0000 7fbc0937c700 1 --2- 172.21.15.26:0/2918352373 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc0409e410 0x7fbc041a6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:31.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.706+0000 7fbc0937c700 1 -- 172.21.15.26:0/2918352373 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc000094a0 con 0x7fbc0409d6f0 2023-10-01T08:00:31.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.706+0000 7fbc0937c700 1 --2- 172.21.15.26:0/2918352373 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc0409d6f0 0x7fbc041a5d90 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fbc0000ec40 tx=0x7fbc0000ef50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:31.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.707+0000 7fbbf5ffb700 1 -- 172.21.15.26:0/2918352373 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0000c850 con 0x7fbc0409d6f0 2023-10-01T08:00:31.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.707+0000 7fbbf5ffb700 1 -- 172.21.15.26:0/2918352373 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0000c9b0 con 0x7fbc0409d6f0 2023-10-01T08:00:31.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.707+0000 7fbc0b5e0700 1 -- 172.21.15.26:0/2918352373 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbfc009b30 con 0x7fbc0409d6f0 2023-10-01T08:00:31.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.707+0000 7fbbf5ffb700 1 -- 172.21.15.26:0/2918352373 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0000cd20 con 0x7fbc0409d6f0 2023-10-01T08:00:31.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.707+0000 7fbc0b5e0700 1 -- 172.21.15.26:0/2918352373 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbf80094a0 con 0x7fbc0409d6f0 2023-10-01T08:00:31.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.708+0000 7fbbf5ffb700 1 -- 172.21.15.26:0/2918352373 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbc00013470 con 0x7fbc0409d6f0 2023-10-01T08:00:31.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.708+0000 7fbbf5ffb700 1 -- 172.21.15.26:0/2918352373 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbc0003f7d0 con 0x7fbc0409d6f0 2023-10-01T08:00:31.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.708+0000 7fbc0b5e0700 1 -- 172.21.15.26:0/2918352373 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc040a2fc0 con 0x7fbc0409d6f0 2023-10-01T08:00:31.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.713+0000 7fbbf5ffb700 1 -- 172.21.15.26:0/2918352373 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbc00013720 con 0x7fbc0409d6f0 2023-10-01T08:00:31.821 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:31.897 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:31.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.915+0000 7fbc0b5e0700 1 -- 172.21.15.26:0/2918352373 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbc0409c710 con 0x7fbc0409d6f0 2023-10-01T08:00:31.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.915+0000 7fbbf5ffb700 1 -- 172.21.15.26:0/2918352373 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbc00021020 con 0x7fbc0409d6f0 2023-10-01T08:00:31.916 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:31.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.919+0000 7fbc0b5e0700 1 -- 172.21.15.26:0/2918352373 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc0409d6f0 msgr2=0x7fbc041a5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:31.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.919+0000 7fbc0b5e0700 1 --2- 172.21.15.26:0/2918352373 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc0409d6f0 0x7fbc041a5d90 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fbc0000ec40 tx=0x7fbc0000ef50 comp rx=0 tx=0).stop 2023-10-01T08:00:31.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.919+0000 7fbc0b5e0700 1 -- 172.21.15.26:0/2918352373 shutdown_connections 2023-10-01T08:00:31.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.919+0000 7fbc0b5e0700 1 --2- 172.21.15.26:0/2918352373 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc0409e410 0x7fbc041a6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:31.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.919+0000 7fbc0b5e0700 1 --2- 172.21.15.26:0/2918352373 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbc0409d6f0 0x7fbc041a5d90 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:31.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.919+0000 7fbc0b5e0700 1 --2- 172.21.15.26:0/2918352373 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbc0409e000 0x7fbc041a62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:31.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.919+0000 7fbc0b5e0700 1 -- 172.21.15.26:0/2918352373 >> 172.21.15.26:0/2918352373 conn(0x7fbc04066f50 msgr2=0x7fbc041bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:31.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.919+0000 7fbc0b5e0700 1 -- 172.21.15.26:0/2918352373 shutdown_connections 2023-10-01T08:00:31.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.919+0000 7fbc0b5e0700 1 -- 172.21.15.26:0/2918352373 wait complete. 2023-10-01T08:00:31.936 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:31.937 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:31.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.961+0000 7fbb8f9a0700 1 Processor -- start 2023-10-01T08:00:31.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.962+0000 7fbb8f9a0700 1 -- start start 2023-10-01T08:00:31.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.962+0000 7fbb8f9a0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbb880a09c0 0x7fbb8806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:31.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.963+0000 7fbb8f9a0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbb88138cf0 0x7fbb8813b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:31.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.963+0000 7fbb8f9a0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb880a2a20 con 0x7fbb880a0d90 2023-10-01T08:00:31.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.963+0000 7fbb8f9a0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8809e690 con 0x7fbb88138cf0 2023-10-01T08:00:31.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.963+0000 7fbb8f9a0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb880a1cc0 con 0x7fbb880a09c0 2023-10-01T08:00:31.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.963+0000 7fbb8d73c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbb880a09c0 0x7fbb8806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:31.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.963+0000 7fbb8cf3b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbb880a0d90 0x7fbb880a11c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46732/0 (socket says 172.21.15.26:46732) 2023-10-01T08:00:31.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.963+0000 7fbb8df3d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbb88138cf0 0x7fbb8813b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:31.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.963+0000 7fbb8cf3b700 1 -- 172.21.15.26:0/2644505728 learned_addr learned my addr 172.21.15.26:0/2644505728 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:31.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.963+0000 7fbb7ffff700 1 -- 172.21.15.26:0/2644505728 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 27815373 0 0) 0x7fbb78001110 con 0x7fbb880a0d90 2023-10-01T08:00:31.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.963+0000 7fbb7ffff700 1 -- 172.21.15.26:0/2644505728 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb740035b0 con 0x7fbb880a0d90 2023-10-01T08:00:31.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.963+0000 7fbb8d73c700 1 -- 172.21.15.26:0/2644505728 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbb88138cf0 msgr2=0x7fbb8813b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:31.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.963+0000 7fbb8d73c700 1 --2- 172.21.15.26:0/2644505728 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbb88138cf0 0x7fbb8813b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:31.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.963+0000 7fbb8d73c700 1 -- 172.21.15.26:0/2644505728 >> v1:172.21.15.26:6789/0 conn(0x7fbb880a0d90 legacy=0x7fbb880a11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:31.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.963+0000 7fbb8d73c700 1 -- 172.21.15.26:0/2644505728 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb880a1f40 con 0x7fbb880a09c0 2023-10-01T08:00:31.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.963+0000 7fbb8df3d700 1 --2- 172.21.15.26:0/2644505728 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbb88138cf0 0x7fbb8813b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:31.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.963+0000 7fbb8d73c700 1 --2- 172.21.15.26:0/2644505728 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbb880a09c0 0x7fbb8806c5d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fbb84009870 tx=0x7fbb84009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4f20c9a8a6d6a8b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:31.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.964+0000 7fbb7ffff700 1 -- 172.21.15.26:0/2644505728 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb84011830 con 0x7fbb880a09c0 2023-10-01T08:00:31.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.964+0000 7fbb7ffff700 1 -- 172.21.15.26:0/2644505728 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb84011990 con 0x7fbb880a09c0 2023-10-01T08:00:31.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.964+0000 7fbb7ffff700 1 -- 172.21.15.26:0/2644505728 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb84011d20 con 0x7fbb880a09c0 2023-10-01T08:00:31.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.964+0000 7fbb8f9a0700 1 -- 172.21.15.26:0/2644505728 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbb880a09c0 msgr2=0x7fbb8806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:31.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.964+0000 7fbb8f9a0700 1 --2- 172.21.15.26:0/2644505728 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbb880a09c0 0x7fbb8806c5d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fbb84009870 tx=0x7fbb84009b80 comp rx=0 tx=0).stop 2023-10-01T08:00:31.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.964+0000 7fbb8f9a0700 1 -- 172.21.15.26:0/2644505728 shutdown_connections 2023-10-01T08:00:31.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.964+0000 7fbb8f9a0700 1 --2- 172.21.15.26:0/2644505728 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbb880a09c0 0x7fbb8806c5d0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:31.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.964+0000 7fbb8f9a0700 1 --2- 172.21.15.26:0/2644505728 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbb88138cf0 0x7fbb8813b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:31.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.964+0000 7fbb8f9a0700 1 -- 172.21.15.26:0/2644505728 >> 172.21.15.26:0/2644505728 conn(0x7fbb880a60c0 msgr2=0x7fbb880a64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:31.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.965+0000 7fbb8f9a0700 1 -- 172.21.15.26:0/2644505728 shutdown_connections 2023-10-01T08:00:31.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.965+0000 7fbb8f9a0700 1 -- 172.21.15.26:0/2644505728 wait complete. 2023-10-01T08:00:31.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.966+0000 7fbb8f9a0700 1 Processor -- start 2023-10-01T08:00:31.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.966+0000 7fbb8f9a0700 1 -- start start 2023-10-01T08:00:31.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.966+0000 7fbb8f9a0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbb880a09c0 0x7fbb881c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:31.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.966+0000 7fbb8f9a0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbb880a0d90 0x7fbb881c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:31.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.966+0000 7fbb8f9a0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb88138cf0 0x7fbb881c9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:31.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.966+0000 7fbb8f9a0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb88135280 con 0x7fbb88138cf0 2023-10-01T08:00:31.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.966+0000 7fbb8f9a0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb88137640 con 0x7fbb880a0d90 2023-10-01T08:00:31.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.966+0000 7fbb8f9a0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb88135930 con 0x7fbb880a09c0 2023-10-01T08:00:31.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.966+0000 7fbb8d73c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbb880a09c0 0x7fbb881c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:31.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.966+0000 7fbb8df3d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb88138cf0 0x7fbb881c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:31.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.966+0000 7fbb8d73c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbb880a09c0 0x7fbb881c86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:34386/0 (socket says 172.21.15.26:34386) 2023-10-01T08:00:31.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.966+0000 7fbb8d73c700 1 -- 172.21.15.26:0/158004100 learned_addr learned my addr 172.21.15.26:0/158004100 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:31.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.966+0000 7fbb8cf3b700 1 --2- 172.21.15.26:0/158004100 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbb880a0d90 0x7fbb881c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:31.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.967+0000 7fbb8d73c700 1 -- 172.21.15.26:0/158004100 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbb880a0d90 msgr2=0x7fbb881c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:31.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.967+0000 7fbb8d73c700 1 --2- 172.21.15.26:0/158004100 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbb880a0d90 0x7fbb881c8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:31.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.967+0000 7fbb8d73c700 1 -- 172.21.15.26:0/158004100 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb88138cf0 msgr2=0x7fbb881c9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:31.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.967+0000 7fbb8d73c700 1 --2- 172.21.15.26:0/158004100 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb88138cf0 0x7fbb881c9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:31.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.967+0000 7fbb8d73c700 1 -- 172.21.15.26:0/158004100 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb80009a70 con 0x7fbb880a09c0 2023-10-01T08:00:31.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.967+0000 7fbb8d73c700 1 --2- 172.21.15.26:0/158004100 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbb880a09c0 0x7fbb881c86b0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fbb840090b0 tx=0x7fbb84004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:31.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.967+0000 7fbb7dffb700 1 -- 172.21.15.26:0/158004100 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb84004450 con 0x7fbb880a09c0 2023-10-01T08:00:31.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.967+0000 7fbb7dffb700 1 -- 172.21.15.26:0/158004100 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8401f070 con 0x7fbb880a09c0 2023-10-01T08:00:31.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.967+0000 7fbb8f9a0700 1 -- 172.21.15.26:0/158004100 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb840094a0 con 0x7fbb880a09c0 2023-10-01T08:00:31.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.967+0000 7fbb7dffb700 1 -- 172.21.15.26:0/158004100 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb840038e0 con 0x7fbb880a09c0 2023-10-01T08:00:31.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.968+0000 7fbb8f9a0700 1 -- 172.21.15.26:0/158004100 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb88137890 con 0x7fbb880a09c0 2023-10-01T08:00:31.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.968+0000 7fbb7dffb700 1 -- 172.21.15.26:0/158004100 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbb84003a40 con 0x7fbb880a09c0 2023-10-01T08:00:31.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.969+0000 7fbb8f9a0700 1 -- 172.21.15.26:0/158004100 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb880a1a80 con 0x7fbb880a09c0 2023-10-01T08:00:31.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.969+0000 7fbb7dffb700 1 -- 172.21.15.26:0/158004100 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbb84021070 con 0x7fbb880a09c0 2023-10-01T08:00:31.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:31.978+0000 7fbb7dffb700 1 -- 172.21.15.26:0/158004100 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbb84010970 con 0x7fbb880a09c0 2023-10-01T08:00:32.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.044+0000 7ff4b5f97700 1 Processor -- start 2023-10-01T08:00:32.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.044+0000 7ff4b5f97700 1 -- start start 2023-10-01T08:00:32.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.045+0000 7ff4b5f97700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff4b0130b30 0x7ff4b0138890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:32.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.045+0000 7ff4b5f97700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4b0138dd0 0x7ff4b013b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:32.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.045+0000 7ff4b5f97700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b0099ef0 con 0x7ff4b0071b40 2023-10-01T08:00:32.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.045+0000 7ff4b5f97700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b0099500 con 0x7ff4b0130b30 2023-10-01T08:00:32.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.045+0000 7ff4b5f97700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b0130f50 con 0x7ff4b0138dd0 2023-10-01T08:00:32.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.045+0000 7ff4affff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4b0138dd0 0x7ff4b013b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:32.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.045+0000 7ff4affff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4b0138dd0 0x7ff4b013b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:34392/0 (socket says 172.21.15.26:34392) 2023-10-01T08:00:32.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.045+0000 7ff4affff700 1 -- 172.21.15.26:0/4102691949 learned_addr learned my addr 172.21.15.26:0/4102691949 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:32.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.046+0000 7ff4aeffd700 1 --2- 172.21.15.26:0/4102691949 >> v2:172.21.15.26:3300/0 conn(0x7ff4b0130b30 0x7ff4b0138890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:32.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.046+0000 7ff4affff700 1 -- 172.21.15.26:0/4102691949 >> v2:172.21.15.26:3300/0 conn(0x7ff4b0130b30 msgr2=0x7ff4b0138890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:32.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.046+0000 7ff4affff700 1 --2- 172.21.15.26:0/4102691949 >> v2:172.21.15.26:3300/0 conn(0x7ff4b0130b30 0x7ff4b0138890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:32.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.046+0000 7ff4affff700 1 -- 172.21.15.26:0/4102691949 >> v1:172.21.15.26:6789/0 conn(0x7ff4b0071b40 legacy=0x7ff4b0130420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:32.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.046+0000 7ff4affff700 1 -- 172.21.15.26:0/4102691949 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b0099c10 con 0x7ff4b0138dd0 2023-10-01T08:00:32.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.046+0000 7ff4aeffd700 1 --2- 172.21.15.26:0/4102691949 >> v2:172.21.15.26:3300/0 conn(0x7ff4b0130b30 0x7ff4b0138890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T08:00:32.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.046+0000 7ff4affff700 1 --2- 172.21.15.26:0/4102691949 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4b0138dd0 0x7ff4b013b1b0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8009e50 tx=0x7ff4a800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f6a1ced217bb018 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:32.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.046+0000 7ff4ae7fc700 1 -- 172.21.15.26:0/4102691949 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a800e070 con 0x7ff4b0138dd0 2023-10-01T08:00:32.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.046+0000 7ff4ae7fc700 1 -- 172.21.15.26:0/4102691949 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a800b9c0 con 0x7ff4b0138dd0 2023-10-01T08:00:32.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.046+0000 7ff4ae7fc700 1 -- 172.21.15.26:0/4102691949 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a800bd70 con 0x7ff4b0138dd0 2023-10-01T08:00:32.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.047+0000 7ff4b5f97700 1 -- 172.21.15.26:0/4102691949 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4b0138dd0 msgr2=0x7ff4b013b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:32.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.047+0000 7ff4b5f97700 1 --2- 172.21.15.26:0/4102691949 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4b0138dd0 0x7ff4b013b1b0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8009e50 tx=0x7ff4a800b330 comp rx=0 tx=0).stop 2023-10-01T08:00:32.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.047+0000 7ff4b5f97700 1 -- 172.21.15.26:0/4102691949 shutdown_connections 2023-10-01T08:00:32.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.047+0000 7ff4b5f97700 1 --2- 172.21.15.26:0/4102691949 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4b0138dd0 0x7ff4b013b1b0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:32.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.047+0000 7ff4b5f97700 1 --2- 172.21.15.26:0/4102691949 >> v2:172.21.15.26:3300/0 conn(0x7ff4b0130b30 0x7ff4b0138890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:32.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.047+0000 7ff4b5f97700 1 -- 172.21.15.26:0/4102691949 >> 172.21.15.26:0/4102691949 conn(0x7ff4b009e7e0 msgr2=0x7ff4b009ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:32.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.047+0000 7ff4b5f97700 1 -- 172.21.15.26:0/4102691949 shutdown_connections 2023-10-01T08:00:32.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.047+0000 7ff4b5f97700 1 -- 172.21.15.26:0/4102691949 wait complete. 2023-10-01T08:00:32.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.049+0000 7ff4b5f97700 1 Processor -- start 2023-10-01T08:00:32.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.049+0000 7ff4b5f97700 1 -- start start 2023-10-01T08:00:32.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.050+0000 7ff4b5f97700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4b0071b40 0x7ff4b0126e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:32.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.050+0000 7ff4b5f97700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4b0130b30 0x7ff4b0127340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:32.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.050+0000 7ff4b5f97700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4b0138dd0 0x7ff4b0127880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:32.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.050+0000 7ff4b5f97700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b01292c0 con 0x7ff4b0130b30 2023-10-01T08:00:32.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.050+0000 7ff4b5f97700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b0127eb0 con 0x7ff4b0071b40 2023-10-01T08:00:32.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.050+0000 7ff4b5f97700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b009c150 con 0x7ff4b0138dd0 2023-10-01T08:00:32.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.050+0000 7ff4af7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4b0071b40 0x7ff4b0126e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:32.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.050+0000 7ff4af7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4b0071b40 0x7ff4b0126e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38614/0 (socket says 172.21.15.26:38614) 2023-10-01T08:00:32.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.050+0000 7ff4af7fe700 1 -- 172.21.15.26:0/1410969777 learned_addr learned my addr 172.21.15.26:0/1410969777 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:32.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.050+0000 7ff4affff700 1 --2- 172.21.15.26:0/1410969777 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4b0138dd0 0x7ff4b0127880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:32.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.050+0000 7ff4aeffd700 1 --2- 172.21.15.26:0/1410969777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4b0130b30 0x7ff4b0127340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:32.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.050+0000 7ff4af7fe700 1 -- 172.21.15.26:0/1410969777 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4b0138dd0 msgr2=0x7ff4b0127880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:32.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.050+0000 7ff4af7fe700 1 --2- 172.21.15.26:0/1410969777 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4b0138dd0 0x7ff4b0127880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:32.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.050+0000 7ff4af7fe700 1 -- 172.21.15.26:0/1410969777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4b0130b30 msgr2=0x7ff4b0127340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:32.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.050+0000 7ff4af7fe700 1 --2- 172.21.15.26:0/1410969777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4b0130b30 0x7ff4b0127340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:32.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.051+0000 7ff4af7fe700 1 -- 172.21.15.26:0/1410969777 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a8009b30 con 0x7ff4b0071b40 2023-10-01T08:00:32.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.051+0000 7ff4af7fe700 1 --2- 172.21.15.26:0/1410969777 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4b0071b40 0x7ff4b0126e00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7ff4a000c4e0 tx=0x7ff4a000c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:32.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.051+0000 7ff4a7fff700 1 -- 172.21.15.26:0/1410969777 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a00052d0 con 0x7ff4b0071b40 2023-10-01T08:00:32.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.051+0000 7ff4a7fff700 1 -- 172.21.15.26:0/1410969777 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a0005430 con 0x7ff4b0071b40 2023-10-01T08:00:32.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.051+0000 7ff4b5f97700 1 -- 172.21.15.26:0/1410969777 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b012fde0 con 0x7ff4b0071b40 2023-10-01T08:00:32.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.051+0000 7ff4a7fff700 1 -- 172.21.15.26:0/1410969777 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a00038c0 con 0x7ff4b0071b40 2023-10-01T08:00:32.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.051+0000 7ff4b5f97700 1 -- 172.21.15.26:0/1410969777 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b01378b0 con 0x7ff4b0071b40 2023-10-01T08:00:32.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.052+0000 7ff4a7fff700 1 -- 172.21.15.26:0/1410969777 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff4a0003a20 con 0x7ff4b0071b40 2023-10-01T08:00:32.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.052+0000 7ff4a7fff700 1 -- 172.21.15.26:0/1410969777 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff4a003ea90 con 0x7ff4b0071b40 2023-10-01T08:00:32.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.052+0000 7ff4b5f97700 1 -- 172.21.15.26:0/1410969777 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b00747f0 con 0x7ff4b0071b40 2023-10-01T08:00:32.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.057+0000 7ff4a7fff700 1 -- 172.21.15.26:0/1410969777 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff4a0018260 con 0x7ff4b0071b40 2023-10-01T08:00:32.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.105+0000 7f1fd6206700 1 Processor -- start 2023-10-01T08:00:32.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.105+0000 7f1fd6206700 1 -- start start 2023-10-01T08:00:32.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.105+0000 7f1fd6206700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1fd00a0a30 0x7f1fd00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:32.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.105+0000 7f1fd6206700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1fd00a1340 0x7f1fd0133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:32.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.105+0000 7f1fd6206700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fd0133fa0 0x7f1fd0134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:32.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.105+0000 7f1fd6206700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fd009edd0 con 0x7f1fd00a1340 2023-10-01T08:00:32.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.105+0000 7f1fd6206700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd009e1f0 con 0x7f1fd0133fa0 2023-10-01T08:00:32.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.105+0000 7f1fd6206700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd009dc50 con 0x7f1fd00a0a30 2023-10-01T08:00:32.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.105+0000 7f1fcf7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1fd00a0a30 0x7f1fd00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:32.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.105+0000 7f1fcffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fd0133fa0 0x7f1fd0134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:32.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.105+0000 7f1fcf7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1fd00a0a30 0x7f1fd00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:34414/0 (socket says 172.21.15.26:34414) 2023-10-01T08:00:32.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.105+0000 7f1fcf7fe700 1 -- 172.21.15.26:0/517195580 learned_addr learned my addr 172.21.15.26:0/517195580 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:32.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.105+0000 7f1fceffd700 1 --2- 172.21.15.26:0/517195580 >> v2:172.21.15.26:3300/0 conn(0x7f1fd00a1340 0x7f1fd0133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:32.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.106+0000 7f1fcf7fe700 1 -- 172.21.15.26:0/517195580 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fd0133fa0 msgr2=0x7f1fd0134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:32.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.106+0000 7f1fcf7fe700 1 --2- 172.21.15.26:0/517195580 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fd0133fa0 0x7f1fd0134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:32.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.106+0000 7f1fcf7fe700 1 -- 172.21.15.26:0/517195580 >> v2:172.21.15.26:3300/0 conn(0x7f1fd00a1340 msgr2=0x7f1fd0133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:32.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.106+0000 7f1fcf7fe700 1 --2- 172.21.15.26:0/517195580 >> v2:172.21.15.26:3300/0 conn(0x7f1fd00a1340 0x7f1fd0133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:32.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.106+0000 7f1fcf7fe700 1 -- 172.21.15.26:0/517195580 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd00a1fe0 con 0x7f1fd00a0a30 2023-10-01T08:00:32.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.106+0000 7f1fcf7fe700 1 --2- 172.21.15.26:0/517195580 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1fd00a0a30 0x7f1fd00a0e00 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f1fc0009920 tx=0x7f1fc0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8b12f642e7b3d41 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:32.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.106+0000 7f1fce7fc700 1 -- 172.21.15.26:0/517195580 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc0011830 con 0x7f1fd00a0a30 2023-10-01T08:00:32.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.106+0000 7f1fce7fc700 1 -- 172.21.15.26:0/517195580 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc0011990 con 0x7f1fd00a0a30 2023-10-01T08:00:32.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.106+0000 7f1fce7fc700 1 -- 172.21.15.26:0/517195580 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc0011d20 con 0x7f1fd00a0a30 2023-10-01T08:00:32.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.107+0000 7f1fd6206700 1 -- 172.21.15.26:0/517195580 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1fd00a0a30 msgr2=0x7f1fd00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:32.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.107+0000 7f1fd6206700 1 --2- 172.21.15.26:0/517195580 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1fd00a0a30 0x7f1fd00a0e00 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f1fc0009920 tx=0x7f1fc0009c30 comp rx=0 tx=0).stop 2023-10-01T08:00:32.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.107+0000 7f1fd6206700 1 -- 172.21.15.26:0/517195580 shutdown_connections 2023-10-01T08:00:32.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.107+0000 7f1fd6206700 1 --2- 172.21.15.26:0/517195580 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fd0133fa0 0x7f1fd0134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:32.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.107+0000 7f1fd6206700 1 --2- 172.21.15.26:0/517195580 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1fd00a0a30 0x7f1fd00a0e00 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:32.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.107+0000 7f1fd6206700 1 --2- 172.21.15.26:0/517195580 >> v2:172.21.15.26:3300/0 conn(0x7f1fd00a1340 0x7f1fd0133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:32.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.107+0000 7f1fd6206700 1 -- 172.21.15.26:0/517195580 >> 172.21.15.26:0/517195580 conn(0x7f1fd00a6550 msgr2=0x7f1fd00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:32.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.107+0000 7f1fd6206700 1 -- 172.21.15.26:0/517195580 shutdown_connections 2023-10-01T08:00:32.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.107+0000 7f1fd6206700 1 -- 172.21.15.26:0/517195580 wait complete. 2023-10-01T08:00:32.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.108+0000 7f1fd6206700 1 Processor -- start 2023-10-01T08:00:32.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.108+0000 7f1fd6206700 1 -- start start 2023-10-01T08:00:32.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.109+0000 7f1fd6206700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1fd00a0a30 0x7f1fd011e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:32.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.109+0000 7f1fd6206700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fd00a1340 0x7f1fd011e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:32.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.109+0000 7f1fd6206700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fd0133fa0 0x7f1fd011ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:32.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.109+0000 7f1fd6206700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd00a0290 con 0x7f1fd0133fa0 2023-10-01T08:00:32.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.109+0000 7f1fd6206700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd00a37e0 con 0x7f1fd00a1340 2023-10-01T08:00:32.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.109+0000 7f1fd6206700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd0120740 con 0x7f1fd00a0a30 2023-10-01T08:00:32.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.109+0000 7f1fceffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fd00a1340 0x7f1fd011e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:32.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.109+0000 7f1fcf7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1fd00a0a30 0x7f1fd011e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:32.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.109+0000 7f1fceffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fd00a1340 0x7f1fd011e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38632/0 (socket says 172.21.15.26:38632) 2023-10-01T08:00:32.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.109+0000 7f1fceffd700 1 -- 172.21.15.26:0/2760101845 learned_addr learned my addr 172.21.15.26:0/2760101845 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:32.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.109+0000 7f1fcffff700 1 --2- 172.21.15.26:0/2760101845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fd0133fa0 0x7f1fd011ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:32.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.109+0000 7f1fceffd700 1 -- 172.21.15.26:0/2760101845 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1fd00a0a30 msgr2=0x7f1fd011e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:32.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.109+0000 7f1fceffd700 1 --2- 172.21.15.26:0/2760101845 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1fd00a0a30 0x7f1fd011e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:32.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.109+0000 7f1fceffd700 1 -- 172.21.15.26:0/2760101845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fd0133fa0 msgr2=0x7f1fd011ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:32.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.109+0000 7f1fceffd700 1 --2- 172.21.15.26:0/2760101845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fd0133fa0 0x7f1fd011ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:32.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.109+0000 7f1fceffd700 1 -- 172.21.15.26:0/2760101845 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc0009550 con 0x7f1fd00a1340 2023-10-01T08:00:32.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.109+0000 7f1fcffff700 1 --2- 172.21.15.26:0/2760101845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fd0133fa0 0x7f1fd011ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T08:00:32.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.109+0000 7f1fceffd700 1 --2- 172.21.15.26:0/2760101845 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fd00a1340 0x7f1fd011e850 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400e9b0 tx=0x7f1fc400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:32.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.110+0000 7f1fb7fff700 1 -- 172.21.15.26:0/2760101845 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc4009710 con 0x7f1fd00a1340 2023-10-01T08:00:32.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.110+0000 7f1fb7fff700 1 -- 172.21.15.26:0/2760101845 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc400c850 con 0x7f1fd00a1340 2023-10-01T08:00:32.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.110+0000 7f1fd6206700 1 -- 172.21.15.26:0/2760101845 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd0121170 con 0x7f1fd00a1340 2023-10-01T08:00:32.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.110+0000 7f1fb7fff700 1 -- 172.21.15.26:0/2760101845 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc400cbc0 con 0x7f1fd00a1340 2023-10-01T08:00:32.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.110+0000 7f1fd6206700 1 -- 172.21.15.26:0/2760101845 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd01215c0 con 0x7f1fd00a1340 2023-10-01T08:00:32.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.111+0000 7f1fb7fff700 1 -- 172.21.15.26:0/2760101845 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1fc400cd20 con 0x7f1fd00a1340 2023-10-01T08:00:32.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.111+0000 7f1fd6206700 1 -- 172.21.15.26:0/2760101845 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fd0074ea0 con 0x7f1fd00a1340 2023-10-01T08:00:32.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.111+0000 7f1fb7fff700 1 -- 172.21.15.26:0/2760101845 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1fc403f7f0 con 0x7f1fd00a1340 2023-10-01T08:00:32.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.120+0000 7f1fb7fff700 1 -- 172.21.15.26:0/2760101845 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1fc40232f0 con 0x7f1fd00a1340 2023-10-01T08:00:32.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.207+0000 7fbb8f9a0700 1 -- 172.21.15.26:0/158004100 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbb88137890 con 0x7fbb880a09c0 2023-10-01T08:00:32.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.208+0000 7fbb7dffb700 1 -- 172.21.15.26:0/158004100 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbb88137890 con 0x7fbb880a09c0 2023-10-01T08:00:32.209 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:32.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.210+0000 7fbb8f9a0700 1 -- 172.21.15.26:0/158004100 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbb880a09c0 msgr2=0x7fbb881c86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:32.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.210+0000 7fbb8f9a0700 1 --2- 172.21.15.26:0/158004100 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbb880a09c0 0x7fbb881c86b0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fbb840090b0 tx=0x7fbb84004750 comp rx=0 tx=0).stop 2023-10-01T08:00:32.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.210+0000 7fbb8f9a0700 1 -- 172.21.15.26:0/158004100 shutdown_connections 2023-10-01T08:00:32.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.210+0000 7fbb8f9a0700 1 --2- 172.21.15.26:0/158004100 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb88138cf0 0x7fbb881c9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:32.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.210+0000 7fbb8f9a0700 1 --2- 172.21.15.26:0/158004100 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbb880a09c0 0x7fbb881c86b0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:32.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.210+0000 7fbb8f9a0700 1 --2- 172.21.15.26:0/158004100 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbb880a0d90 0x7fbb881c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:32.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.210+0000 7fbb8f9a0700 1 -- 172.21.15.26:0/158004100 >> 172.21.15.26:0/158004100 conn(0x7fbb880a60c0 msgr2=0x7fbb8809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:32.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.210+0000 7fbb8f9a0700 1 -- 172.21.15.26:0/158004100 shutdown_connections 2023-10-01T08:00:32.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.210+0000 7fbb8f9a0700 1 -- 172.21.15.26:0/158004100 wait complete. 2023-10-01T08:00:32.225 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:32.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.281+0000 7ff4b5f97700 1 -- 172.21.15.26:0/1410969777 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff4b006b250 con 0x7ff4b0071b40 2023-10-01T08:00:32.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.282+0000 7ff4a7fff700 1 -- 172.21.15.26:0/1410969777 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff4a0017020 con 0x7ff4b0071b40 2023-10-01T08:00:32.283 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:32.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.284+0000 7ff4b5f97700 1 -- 172.21.15.26:0/1410969777 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4b0071b40 msgr2=0x7ff4b0126e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:32.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.284+0000 7ff4b5f97700 1 --2- 172.21.15.26:0/1410969777 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4b0071b40 0x7ff4b0126e00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7ff4a000c4e0 tx=0x7ff4a000c7f0 comp rx=0 tx=0).stop 2023-10-01T08:00:32.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.284+0000 7ff4b5f97700 1 -- 172.21.15.26:0/1410969777 shutdown_connections 2023-10-01T08:00:32.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.284+0000 7ff4b5f97700 1 --2- 172.21.15.26:0/1410969777 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff4b0138dd0 0x7ff4b0127880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:32.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.284+0000 7ff4b5f97700 1 --2- 172.21.15.26:0/1410969777 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4b0071b40 0x7ff4b0126e00 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:32.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.284+0000 7ff4b5f97700 1 --2- 172.21.15.26:0/1410969777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4b0130b30 0x7ff4b0127340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:32.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.284+0000 7ff4b5f97700 1 -- 172.21.15.26:0/1410969777 >> 172.21.15.26:0/1410969777 conn(0x7ff4b009e7e0 msgr2=0x7ff4b009fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:32.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.284+0000 7ff4b5f97700 1 -- 172.21.15.26:0/1410969777 shutdown_connections 2023-10-01T08:00:32.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.284+0000 7ff4b5f97700 1 -- 172.21.15.26:0/1410969777 wait complete. 2023-10-01T08:00:32.299 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:32.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.329+0000 7f1fd6206700 1 -- 172.21.15.26:0/2760101845 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1fd00a28e0 con 0x7f1fd00a1340 2023-10-01T08:00:32.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.329+0000 7f1fb7fff700 1 -- 172.21.15.26:0/2760101845 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1fc401ae80 con 0x7f1fd00a1340 2023-10-01T08:00:32.330 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.331+0000 7f1fd6206700 1 -- 172.21.15.26:0/2760101845 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fd00a1340 msgr2=0x7f1fd011e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.331+0000 7f1fd6206700 1 --2- 172.21.15.26:0/2760101845 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fd00a1340 0x7f1fd011e850 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400e9b0 tx=0x7f1fc400ecc0 comp rx=0 tx=0).stop 2023-10-01T08:00:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.331+0000 7f1fd6206700 1 -- 172.21.15.26:0/2760101845 shutdown_connections 2023-10-01T08:00:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.331+0000 7f1fd6206700 1 --2- 172.21.15.26:0/2760101845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fd0133fa0 0x7f1fd011ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.331+0000 7f1fd6206700 1 --2- 172.21.15.26:0/2760101845 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1fd00a0a30 0x7f1fd011e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.331+0000 7f1fd6206700 1 --2- 172.21.15.26:0/2760101845 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fd00a1340 0x7f1fd011e850 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.331+0000 7f1fd6206700 1 -- 172.21.15.26:0/2760101845 >> 172.21.15.26:0/2760101845 conn(0x7f1fd00a6550 msgr2=0x7f1fd00a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.331+0000 7f1fd6206700 1 -- 172.21.15.26:0/2760101845 shutdown_connections 2023-10-01T08:00:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:32.331+0000 7f1fd6206700 1 -- 172.21.15.26:0/2760101845 wait complete. 2023-10-01T08:00:32.346 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:32.937 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:33.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.082+0000 7f9d2c926700 1 Processor -- start 2023-10-01T08:00:33.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.082+0000 7f9d2c926700 1 -- start start 2023-10-01T08:00:33.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.082+0000 7f9d2c926700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d2809d6f0 0x7f9d2809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:33.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.082+0000 7f9d2c926700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d2809e000 0x7f9d281339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:33.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.082+0000 7f9d2c926700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d2809b120 con 0x7f9d2809e410 2023-10-01T08:00:33.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.082+0000 7f9d2c926700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2806b460 con 0x7f9d2809e000 2023-10-01T08:00:33.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.082+0000 7f9d2c926700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2809a7e0 con 0x7f9d2809d6f0 2023-10-01T08:00:33.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.083+0000 7f9d25d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d2809e000 0x7f9d281339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:33.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.083+0000 7f9d26d9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9d2809e410 0x7f9d28133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46754/0 (socket says 172.21.15.26:46754) 2023-10-01T08:00:33.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.083+0000 7f9d26d9d700 1 -- 172.21.15.26:0/1018036621 learned_addr learned my addr 172.21.15.26:0/1018036621 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:33.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.083+0000 7f9d2659c700 1 --2- 172.21.15.26:0/1018036621 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d2809d6f0 0x7f9d2809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:33.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.083+0000 7f9d25d9b700 1 -- 172.21.15.26:0/1018036621 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d2809d6f0 msgr2=0x7f9d2809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:33.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.083+0000 7f9d25d9b700 1 --2- 172.21.15.26:0/1018036621 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d2809d6f0 0x7f9d2809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.083+0000 7f9d25d9b700 1 -- 172.21.15.26:0/1018036621 >> v1:172.21.15.26:6789/0 conn(0x7f9d2809e410 legacy=0x7f9d28133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:33.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.083+0000 7f9d2559a700 1 -- 172.21.15.26:0/1018036621 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1876755784 0 0) 0x7f9d2809b120 con 0x7f9d2809e410 2023-10-01T08:00:33.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.083+0000 7f9d25d9b700 1 -- 172.21.15.26:0/1018036621 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d2809a500 con 0x7f9d2809e000 2023-10-01T08:00:33.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.083+0000 7f9d2659c700 1 --2- 172.21.15.26:0/1018036621 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d2809d6f0 0x7f9d2809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:33.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.083+0000 7f9d25d9b700 1 --2- 172.21.15.26:0/1018036621 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d2809e000 0x7f9d281339f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f9d18009870 tx=0x7f9d18009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d82fc11b6da252b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:33.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.083+0000 7f9d2559a700 1 -- 172.21.15.26:0/1018036621 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d18011830 con 0x7f9d2809e000 2023-10-01T08:00:33.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.083+0000 7f9d2559a700 1 -- 172.21.15.26:0/1018036621 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d18011990 con 0x7f9d2809e000 2023-10-01T08:00:33.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.083+0000 7f9d2559a700 1 -- 172.21.15.26:0/1018036621 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d18011d20 con 0x7f9d2809e000 2023-10-01T08:00:33.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.084+0000 7f9d2c926700 1 -- 172.21.15.26:0/1018036621 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d2809e000 msgr2=0x7f9d281339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:33.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.084+0000 7f9d2c926700 1 --2- 172.21.15.26:0/1018036621 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d2809e000 0x7f9d281339f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f9d18009870 tx=0x7f9d18009b80 comp rx=0 tx=0).stop 2023-10-01T08:00:33.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.084+0000 7f9d2c926700 1 -- 172.21.15.26:0/1018036621 shutdown_connections 2023-10-01T08:00:33.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.084+0000 7f9d2c926700 1 --2- 172.21.15.26:0/1018036621 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d2809d6f0 0x7f9d2809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.084+0000 7f9d2c926700 1 --2- 172.21.15.26:0/1018036621 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d2809e000 0x7f9d281339f0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.084+0000 7f9d2c926700 1 -- 172.21.15.26:0/1018036621 >> 172.21.15.26:0/1018036621 conn(0x7f9d28066f50 msgr2=0x7f9d2809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:33.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.084+0000 7f9d2c926700 1 -- 172.21.15.26:0/1018036621 shutdown_connections 2023-10-01T08:00:33.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.084+0000 7f9d2c926700 1 -- 172.21.15.26:0/1018036621 wait complete. 2023-10-01T08:00:33.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.085+0000 7f9d2c926700 1 Processor -- start 2023-10-01T08:00:33.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.085+0000 7f9d2c926700 1 -- start start 2023-10-01T08:00:33.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.086+0000 7f9d2c926700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d2809d6f0 0x7f9d28122330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:33.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.086+0000 7f9d2c926700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d2809e000 0x7f9d28122870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:33.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.086+0000 7f9d2c926700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d2809e410 0x7f9d28122db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:33.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.086+0000 7f9d2c926700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d28123800 con 0x7f9d2809e410 2023-10-01T08:00:33.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.086+0000 7f9d2c926700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d28133700 con 0x7f9d2809d6f0 2023-10-01T08:00:33.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.086+0000 7f9d2c926700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d28124dd0 con 0x7f9d2809e000 2023-10-01T08:00:33.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.086+0000 7f9d2659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d2809d6f0 0x7f9d28122330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:33.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.086+0000 7f9d2659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d2809d6f0 0x7f9d28122330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38660/0 (socket says 172.21.15.26:38660) 2023-10-01T08:00:33.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.086+0000 7f9d2659c700 1 -- 172.21.15.26:0/1038127957 learned_addr learned my addr 172.21.15.26:0/1038127957 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:33.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.086+0000 7f9d26d9d700 1 --2- 172.21.15.26:0/1038127957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d2809e410 0x7f9d28122db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:33.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.086+0000 7f9d25d9b700 1 --2- 172.21.15.26:0/1038127957 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d2809e000 0x7f9d28122870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:33.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.086+0000 7f9d2659c700 1 -- 172.21.15.26:0/1038127957 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d2809e000 msgr2=0x7f9d28122870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:33.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.086+0000 7f9d2659c700 1 --2- 172.21.15.26:0/1038127957 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d2809e000 0x7f9d28122870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.086+0000 7f9d2659c700 1 -- 172.21.15.26:0/1038127957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d2809e410 msgr2=0x7f9d28122db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:33.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.086+0000 7f9d2659c700 1 --2- 172.21.15.26:0/1038127957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d2809e410 0x7f9d28122db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.086+0000 7f9d2659c700 1 -- 172.21.15.26:0/1038127957 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d100094a0 con 0x7f9d2809d6f0 2023-10-01T08:00:33.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.086+0000 7f9d2659c700 1 --2- 172.21.15.26:0/1038127957 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d2809d6f0 0x7f9d28122330 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000ec40 tx=0x7f9d1000ef50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:33.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.087+0000 7f9d1effd700 1 -- 172.21.15.26:0/1038127957 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1000c850 con 0x7f9d2809d6f0 2023-10-01T08:00:33.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.087+0000 7f9d1effd700 1 -- 172.21.15.26:0/1038127957 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1000c9b0 con 0x7f9d2809d6f0 2023-10-01T08:00:33.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.087+0000 7f9d2c926700 1 -- 172.21.15.26:0/1038127957 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d180094a0 con 0x7f9d2809d6f0 2023-10-01T08:00:33.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.087+0000 7f9d1effd700 1 -- 172.21.15.26:0/1038127957 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1000cd20 con 0x7f9d2809d6f0 2023-10-01T08:00:33.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.087+0000 7f9d2c926700 1 -- 172.21.15.26:0/1038127957 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d281255e0 con 0x7f9d2809d6f0 2023-10-01T08:00:33.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.087+0000 7f9d1effd700 1 -- 172.21.15.26:0/1038127957 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d10013470 con 0x7f9d2809d6f0 2023-10-01T08:00:33.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.088+0000 7f9d1effd700 1 -- 172.21.15.26:0/1038127957 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9d1003f900 con 0x7f9d2809d6f0 2023-10-01T08:00:33.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.088+0000 7f9d2c926700 1 -- 172.21.15.26:0/1038127957 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d28125190 con 0x7f9d2809d6f0 2023-10-01T08:00:33.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.092+0000 7f9d1effd700 1 -- 172.21.15.26:0/1038127957 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d10017080 con 0x7f9d2809d6f0 2023-10-01T08:00:33.226 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:33.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.298+0000 7f9d2c926700 1 -- 172.21.15.26:0/1038127957 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9d2811f030 con 0x7f9d2809d6f0 2023-10-01T08:00:33.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.298+0000 7f9d1effd700 1 -- 172.21.15.26:0/1038127957 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9d10013720 con 0x7f9d2809d6f0 2023-10-01T08:00:33.299 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:33.299 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:33.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.301+0000 7f9d2c926700 1 -- 172.21.15.26:0/1038127957 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d2809d6f0 msgr2=0x7f9d28122330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:33.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.301+0000 7f9d2c926700 1 --2- 172.21.15.26:0/1038127957 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d2809d6f0 0x7f9d28122330 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000ec40 tx=0x7f9d1000ef50 comp rx=0 tx=0).stop 2023-10-01T08:00:33.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.301+0000 7f9d2c926700 1 -- 172.21.15.26:0/1038127957 shutdown_connections 2023-10-01T08:00:33.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.301+0000 7f9d2c926700 1 --2- 172.21.15.26:0/1038127957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d2809e410 0x7f9d28122db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.301+0000 7f9d2c926700 1 --2- 172.21.15.26:0/1038127957 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d2809d6f0 0x7f9d28122330 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.301+0000 7f9d2c926700 1 --2- 172.21.15.26:0/1038127957 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d2809e000 0x7f9d28122870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.301+0000 7f9d2c926700 1 -- 172.21.15.26:0/1038127957 >> 172.21.15.26:0/1038127957 conn(0x7f9d28066f50 msgr2=0x7f9d28133f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:33.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.301+0000 7f9d2c926700 1 -- 172.21.15.26:0/1038127957 shutdown_connections 2023-10-01T08:00:33.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.301+0000 7f9d2c926700 1 -- 172.21.15.26:0/1038127957 wait complete. 2023-10-01T08:00:33.321 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:33.347 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:33.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.370+0000 7efe885ea700 1 Processor -- start 2023-10-01T08:00:33.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.370+0000 7efe885ea700 1 -- start start 2023-10-01T08:00:33.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.371+0000 7efe885ea700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe801338c0 0x7efe80133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:33.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.371+0000 7efe885ea700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe801341d0 0x7efe8009de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:33.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.371+0000 7efe885ea700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efe8009e390 0x7efe8009e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:33.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.371+0000 7efe885ea700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe80070c80 con 0x7efe8009e390 2023-10-01T08:00:33.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.371+0000 7efe885ea700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe8006f720 con 0x7efe801341d0 2023-10-01T08:00:33.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.371+0000 7efe885ea700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe8006fce0 con 0x7efe801338c0 2023-10-01T08:00:33.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.371+0000 7efe85b85700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe801341d0 0x7efe8009de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:33.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.371+0000 7efe86386700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe801338c0 0x7efe80133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:33.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.371+0000 7efe86386700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe801338c0 0x7efe80133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:34448/0 (socket says 172.21.15.26:34448) 2023-10-01T08:00:33.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.371+0000 7efe85b85700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe801341d0 0x7efe8009de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38670/0 (socket says 172.21.15.26:38670) 2023-10-01T08:00:33.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.371+0000 7efe86386700 1 -- 172.21.15.26:0/1482879535 learned_addr learned my addr 172.21.15.26:0/1482879535 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:33.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.371+0000 7efe86b87700 1 --2- 172.21.15.26:0/1482879535 >> v2:172.21.15.26:3300/0 conn(0x7efe8009e390 0x7efe8009e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:33.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.372+0000 7efe86b87700 1 -- 172.21.15.26:0/1482879535 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe801338c0 msgr2=0x7efe80133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:33.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.372+0000 7efe86b87700 1 --2- 172.21.15.26:0/1482879535 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe801338c0 0x7efe80133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.372+0000 7efe86b87700 1 -- 172.21.15.26:0/1482879535 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe801341d0 msgr2=0x7efe8009de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:33.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.372+0000 7efe86b87700 1 --2- 172.21.15.26:0/1482879535 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe801341d0 0x7efe8009de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.372+0000 7efe86b87700 1 -- 172.21.15.26:0/1482879535 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe801336a0 con 0x7efe8009e390 2023-10-01T08:00:33.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.372+0000 7efe85b85700 1 --2- 172.21.15.26:0/1482879535 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe801341d0 0x7efe8009de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:33.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.372+0000 7efe86b87700 1 --2- 172.21.15.26:0/1482879535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe8009e390 0x7efe8009e800 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7efe78009d90 tx=0x7efe7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=130de7b69f97b373 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:33.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.372+0000 7efe85384700 1 -- 172.21.15.26:0/1482879535 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7800e070 con 0x7efe8009e390 2023-10-01T08:00:33.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.372+0000 7efe85384700 1 -- 172.21.15.26:0/1482879535 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7800bb20 con 0x7efe8009e390 2023-10-01T08:00:33.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.372+0000 7efe85384700 1 -- 172.21.15.26:0/1482879535 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe78012430 con 0x7efe8009e390 2023-10-01T08:00:33.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.373+0000 7efe885ea700 1 -- 172.21.15.26:0/1482879535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe8009e390 msgr2=0x7efe8009e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:33.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.373+0000 7efe885ea700 1 --2- 172.21.15.26:0/1482879535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe8009e390 0x7efe8009e800 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7efe78009d90 tx=0x7efe7800b330 comp rx=0 tx=0).stop 2023-10-01T08:00:33.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.373+0000 7efe885ea700 1 -- 172.21.15.26:0/1482879535 shutdown_connections 2023-10-01T08:00:33.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.373+0000 7efe885ea700 1 --2- 172.21.15.26:0/1482879535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe8009e390 0x7efe8009e800 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.373+0000 7efe885ea700 1 --2- 172.21.15.26:0/1482879535 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe801338c0 0x7efe80133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.373+0000 7efe885ea700 1 --2- 172.21.15.26:0/1482879535 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe801341d0 0x7efe8009de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.373+0000 7efe885ea700 1 -- 172.21.15.26:0/1482879535 >> 172.21.15.26:0/1482879535 conn(0x7efe800a2aa0 msgr2=0x7efe800a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:33.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.373+0000 7efe885ea700 1 -- 172.21.15.26:0/1482879535 shutdown_connections 2023-10-01T08:00:33.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.373+0000 7efe885ea700 1 -- 172.21.15.26:0/1482879535 wait complete. 2023-10-01T08:00:33.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.374+0000 7efe885ea700 1 Processor -- start 2023-10-01T08:00:33.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.374+0000 7efe885ea700 1 -- start start 2023-10-01T08:00:33.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.375+0000 7efe885ea700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe8009e390 0x7efe8011e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:33.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.375+0000 7efe885ea700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe801338c0 0x7efe8011ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:33.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.375+0000 7efe885ea700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe801341d0 0x7efe8011f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:33.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.375+0000 7efe885ea700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8011fda0 con 0x7efe801341d0 2023-10-01T08:00:33.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.375+0000 7efe885ea700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe8012fc10 con 0x7efe8009e390 2023-10-01T08:00:33.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.375+0000 7efe885ea700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe801212e0 con 0x7efe801338c0 2023-10-01T08:00:33.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.375+0000 7efe86386700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe8009e390 0x7efe8011e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:33.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.375+0000 7efe86386700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe8009e390 0x7efe8011e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38678/0 (socket says 172.21.15.26:38678) 2023-10-01T08:00:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.375+0000 7efe86386700 1 -- 172.21.15.26:0/2810810014 learned_addr learned my addr 172.21.15.26:0/2810810014 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.375+0000 7efe86b87700 1 --2- 172.21.15.26:0/2810810014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe801341d0 0x7efe8011f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.375+0000 7efe85b85700 1 --2- 172.21.15.26:0/2810810014 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe801338c0 0x7efe8011ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.375+0000 7efe86386700 1 -- 172.21.15.26:0/2810810014 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe801338c0 msgr2=0x7efe8011ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.375+0000 7efe86386700 1 --2- 172.21.15.26:0/2810810014 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe801338c0 0x7efe8011ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.375+0000 7efe86386700 1 -- 172.21.15.26:0/2810810014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe801341d0 msgr2=0x7efe8011f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.375+0000 7efe86386700 1 --2- 172.21.15.26:0/2810810014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe801341d0 0x7efe8011f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.375+0000 7efe86386700 1 -- 172.21.15.26:0/2810810014 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe700094a0 con 0x7efe8009e390 2023-10-01T08:00:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.375+0000 7efe86b87700 1 --2- 172.21.15.26:0/2810810014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe801341d0 0x7efe8011f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.376+0000 7efe86386700 1 --2- 172.21.15.26:0/2810810014 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe8009e390 0x7efe8011e8d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7efe7c00e910 tx=0x7efe7c00ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.376+0000 7efe76ffd700 1 -- 172.21.15.26:0/2810810014 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c0096a0 con 0x7efe8009e390 2023-10-01T08:00:33.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.376+0000 7efe885ea700 1 -- 172.21.15.26:0/2810810014 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe78009a70 con 0x7efe8009e390 2023-10-01T08:00:33.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.376+0000 7efe76ffd700 1 -- 172.21.15.26:0/2810810014 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7c013680 con 0x7efe8009e390 2023-10-01T08:00:33.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.376+0000 7efe76ffd700 1 -- 172.21.15.26:0/2810810014 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c013a30 con 0x7efe8009e390 2023-10-01T08:00:33.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.376+0000 7efe885ea700 1 -- 172.21.15.26:0/2810810014 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe80131fe0 con 0x7efe8009e390 2023-10-01T08:00:33.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.377+0000 7efe76ffd700 1 -- 172.21.15.26:0/2810810014 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efe7c013b90 con 0x7efe8009e390 2023-10-01T08:00:33.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.377+0000 7efe76ffd700 1 -- 172.21.15.26:0/2810810014 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efe7c03fa30 con 0x7efe8009e390 2023-10-01T08:00:33.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.377+0000 7efe885ea700 1 -- 172.21.15.26:0/2810810014 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe801216a0 con 0x7efe8009e390 2023-10-01T08:00:33.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.386+0000 7efe76ffd700 1 -- 172.21.15.26:0/2810810014 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efe7c017080 con 0x7efe8009e390 2023-10-01T08:00:33.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.445+0000 7f9a21867700 1 Processor -- start 2023-10-01T08:00:33.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.445+0000 7f9a21867700 1 -- start start 2023-10-01T08:00:33.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.446+0000 7f9a21867700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a1c130540 0x7f9a1c130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:33.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.446+0000 7f9a21867700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9a1c130e50 0x7f9a1c06f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:33.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.446+0000 7f9a21867700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a1c06fb20 0x7f9a1c06ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:33.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.446+0000 7f9a21867700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a1c0704b0 con 0x7f9a1c130e50 2023-10-01T08:00:33.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.446+0000 7f9a21867700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c09a390 con 0x7f9a1c130540 2023-10-01T08:00:33.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.446+0000 7f9a21867700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c0716a0 con 0x7f9a1c06fb20 2023-10-01T08:00:33.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.446+0000 7f9a1a7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9a1c130e50 0x7f9a1c06f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:33.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.446+0000 7f9a1b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a1c06fb20 0x7f9a1c06ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:33.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.446+0000 7f9a1affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a1c130540 0x7f9a1c130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:33.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.446+0000 7f9a1a7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9a1c130e50 0x7f9a1c06f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53150/0 (socket says 172.21.15.26:53150) 2023-10-01T08:00:33.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.446+0000 7f9a1b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a1c06fb20 0x7f9a1c06ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44350/0 (socket says 172.21.15.26:44350) 2023-10-01T08:00:33.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.446+0000 7f9a1affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a1c130540 0x7f9a1c130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42262/0 (socket says 172.21.15.26:42262) 2023-10-01T08:00:33.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.446+0000 7f9a1a7fc700 1 -- 172.21.15.26:0/4248300586 learned_addr learned my addr 172.21.15.26:0/4248300586 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:33.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.446+0000 7f9a1b7fe700 1 -- 172.21.15.26:0/4248300586 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a1c130540 msgr2=0x7f9a1c130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:33.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.446+0000 7f9a1b7fe700 1 --2- 172.21.15.26:0/4248300586 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a1c130540 0x7f9a1c130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.446+0000 7f9a1b7fe700 1 -- 172.21.15.26:0/4248300586 >> v2:172.21.15.26:3300/0 conn(0x7f9a1c130e50 msgr2=0x7f9a1c06f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:33.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.446+0000 7f9a1b7fe700 1 --2- 172.21.15.26:0/4248300586 >> v2:172.21.15.26:3300/0 conn(0x7f9a1c130e50 0x7f9a1c06f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.446+0000 7f9a1b7fe700 1 -- 172.21.15.26:0/4248300586 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1c071290 con 0x7f9a1c06fb20 2023-10-01T08:00:33.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.446+0000 7f9a1a7fc700 1 --2- 172.21.15.26:0/4248300586 >> v2:172.21.15.26:3300/0 conn(0x7f9a1c130e50 0x7f9a1c06f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:33.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.447+0000 7f9a1b7fe700 1 --2- 172.21.15.26:0/4248300586 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a1c06fb20 0x7f9a1c06ff70 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f9a14009dc0 tx=0x7f9a1400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f979208418aac430 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:33.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.447+0000 7f9a19ffb700 1 -- 172.21.15.26:0/4248300586 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1400e070 con 0x7f9a1c06fb20 2023-10-01T08:00:33.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.447+0000 7f9a19ffb700 1 -- 172.21.15.26:0/4248300586 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1400bae0 con 0x7f9a1c06fb20 2023-10-01T08:00:33.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.447+0000 7f9a19ffb700 1 -- 172.21.15.26:0/4248300586 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1400be90 con 0x7f9a1c06fb20 2023-10-01T08:00:33.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.448+0000 7f9a21867700 1 -- 172.21.15.26:0/4248300586 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a1c06fb20 msgr2=0x7f9a1c06ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:33.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.448+0000 7f9a21867700 1 --2- 172.21.15.26:0/4248300586 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a1c06fb20 0x7f9a1c06ff70 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f9a14009dc0 tx=0x7f9a1400b330 comp rx=0 tx=0).stop 2023-10-01T08:00:33.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.448+0000 7f9a21867700 1 -- 172.21.15.26:0/4248300586 shutdown_connections 2023-10-01T08:00:33.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.448+0000 7f9a21867700 1 --2- 172.21.15.26:0/4248300586 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a1c06fb20 0x7f9a1c06ff70 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.448+0000 7f9a21867700 1 --2- 172.21.15.26:0/4248300586 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a1c130540 0x7f9a1c130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.448+0000 7f9a21867700 1 --2- 172.21.15.26:0/4248300586 >> v2:172.21.15.26:3300/0 conn(0x7f9a1c130e50 0x7f9a1c06f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.448+0000 7f9a21867700 1 -- 172.21.15.26:0/4248300586 >> 172.21.15.26:0/4248300586 conn(0x7f9a1c0a2aa0 msgr2=0x7f9a1c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:33.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.448+0000 7f9a21867700 1 -- 172.21.15.26:0/4248300586 shutdown_connections 2023-10-01T08:00:33.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.448+0000 7f9a21867700 1 -- 172.21.15.26:0/4248300586 wait complete. 2023-10-01T08:00:33.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.449+0000 7f9a21867700 1 Processor -- start 2023-10-01T08:00:33.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.449+0000 7f9a21867700 1 -- start start 2023-10-01T08:00:33.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.450+0000 7f9a21867700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a1c06fb20 0x7f9a1c118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:33.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.450+0000 7f9a21867700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a1c130540 0x7f9a1c119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:33.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.450+0000 7f9a21867700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a1c130e50 0x7f9a1c119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:33.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.450+0000 7f9a21867700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c0718e0 con 0x7f9a1c130e50 2023-10-01T08:00:33.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.450+0000 7f9a21867700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c11c410 con 0x7f9a1c06fb20 2023-10-01T08:00:33.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.450+0000 7f9a21867700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c1267a0 con 0x7f9a1c130540 2023-10-01T08:00:33.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.450+0000 7f9a1b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a1c130e50 0x7f9a1c119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:33.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.450+0000 7f9a1affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a1c06fb20 0x7f9a1c118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:33.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.450+0000 7f9a1b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a1c130e50 0x7f9a1c119750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53152/0 (socket says 172.21.15.26:53152) 2023-10-01T08:00:33.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.450+0000 7f9a1affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a1c06fb20 0x7f9a1c118cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42264/0 (socket says 172.21.15.26:42264) 2023-10-01T08:00:33.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.450+0000 7f9a1b7fe700 1 -- 172.21.15.26:0/2240807229 learned_addr learned my addr 172.21.15.26:0/2240807229 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:33.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.450+0000 7f9a1a7fc700 1 --2- 172.21.15.26:0/2240807229 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a1c130540 0x7f9a1c119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:33.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.450+0000 7f9a1a7fc700 1 -- 172.21.15.26:0/2240807229 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a1c06fb20 msgr2=0x7f9a1c118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:33.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.450+0000 7f9a1a7fc700 1 --2- 172.21.15.26:0/2240807229 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a1c06fb20 0x7f9a1c118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.450+0000 7f9a1a7fc700 1 -- 172.21.15.26:0/2240807229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a1c130e50 msgr2=0x7f9a1c119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:33.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.450+0000 7f9a1a7fc700 1 --2- 172.21.15.26:0/2240807229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a1c130e50 0x7f9a1c119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.450+0000 7f9a1a7fc700 1 -- 172.21.15.26:0/2240807229 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a10009550 con 0x7f9a1c130540 2023-10-01T08:00:33.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.450+0000 7f9a1b7fe700 1 --2- 172.21.15.26:0/2240807229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a1c130e50 0x7f9a1c119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:33.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.450+0000 7f9a1a7fc700 1 --2- 172.21.15.26:0/2240807229 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a1c130540 0x7f9a1c119210 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c0a35d0 tx=0x7f9a1000ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:33.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.451+0000 7f9a03fff700 1 -- 172.21.15.26:0/2240807229 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1000eec0 con 0x7f9a1c130540 2023-10-01T08:00:33.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.451+0000 7f9a03fff700 1 -- 172.21.15.26:0/2240807229 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a10004240 con 0x7f9a1c130540 2023-10-01T08:00:33.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.451+0000 7f9a21867700 1 -- 172.21.15.26:0/2240807229 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a14009a70 con 0x7f9a1c130540 2023-10-01T08:00:33.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.451+0000 7f9a03fff700 1 -- 172.21.15.26:0/2240807229 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a100045b0 con 0x7f9a1c130540 2023-10-01T08:00:33.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.451+0000 7f9a21867700 1 -- 172.21.15.26:0/2240807229 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a1c11a310 con 0x7f9a1c130540 2023-10-01T08:00:33.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.452+0000 7f9a03fff700 1 -- 172.21.15.26:0/2240807229 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9a100036a0 con 0x7f9a1c130540 2023-10-01T08:00:33.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.452+0000 7f9a03fff700 1 -- 172.21.15.26:0/2240807229 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9a1003f840 con 0x7f9a1c130540 2023-10-01T08:00:33.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.452+0000 7f9a21867700 1 -- 172.21.15.26:0/2240807229 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a1c074ea0 con 0x7f9a1c130540 2023-10-01T08:00:33.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.457+0000 7f9a03fff700 1 -- 172.21.15.26:0/2240807229 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9a1001be10 con 0x7f9a1c130540 2023-10-01T08:00:33.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.503+0000 7fa333531700 1 Processor -- start 2023-10-01T08:00:33.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.503+0000 7fa333531700 1 -- start start 2023-10-01T08:00:33.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.504+0000 7fa333531700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa32c09e930 0x7fa32c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:33.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.504+0000 7fa333531700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa32c09f240 0x7fa32c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:33.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.504+0000 7fa333531700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa32c09f650 0x7fa32c131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:33.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.504+0000 7fa333531700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa32c070940 con 0x7fa32c09e930 2023-10-01T08:00:33.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.504+0000 7fa333531700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c06fd60 con 0x7fa32c09f240 2023-10-01T08:00:33.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.504+0000 7fa333531700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c06fa80 con 0x7fa32c09f650 2023-10-01T08:00:33.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.504+0000 7fa331ace700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa32c09f650 0x7fa32c131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:33.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.504+0000 7fa3312cd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa32c09e930 0x7fa32c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:33.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.504+0000 7fa331ace700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa32c09f650 0x7fa32c131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44366/0 (socket says 172.21.15.26:44366) 2023-10-01T08:00:33.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.504+0000 7fa3312cd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa32c09e930 0x7fa32c09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53154/0 (socket says 172.21.15.26:53154) 2023-10-01T08:00:33.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.504+0000 7fa3312cd700 1 -- 172.21.15.26:0/19706848 learned_addr learned my addr 172.21.15.26:0/19706848 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:33.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.504+0000 7fa330acc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa32c09f240 0x7fa32c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:33.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.504+0000 7fa3312cd700 1 -- 172.21.15.26:0/19706848 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa32c09f650 msgr2=0x7fa32c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:33.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.504+0000 7fa3312cd700 1 --2- 172.21.15.26:0/19706848 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa32c09f650 0x7fa32c131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.504+0000 7fa3312cd700 1 -- 172.21.15.26:0/19706848 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa32c09f240 msgr2=0x7fa32c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:33.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.504+0000 7fa3312cd700 1 --2- 172.21.15.26:0/19706848 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa32c09f240 0x7fa32c1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.504+0000 7fa3312cd700 1 -- 172.21.15.26:0/19706848 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa32c09fb60 con 0x7fa32c09e930 2023-10-01T08:00:33.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.505+0000 7fa3312cd700 1 --2- 172.21.15.26:0/19706848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c09e930 0x7fa32c09ed00 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fa3280098f0 tx=0x7fa328009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=382ce612b6b6f76a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:33.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.505+0000 7fa323fff700 1 -- 172.21.15.26:0/19706848 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa328011830 con 0x7fa32c09e930 2023-10-01T08:00:33.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.505+0000 7fa323fff700 1 -- 172.21.15.26:0/19706848 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa328011990 con 0x7fa32c09e930 2023-10-01T08:00:33.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.505+0000 7fa323fff700 1 -- 172.21.15.26:0/19706848 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa328011d00 con 0x7fa32c09e930 2023-10-01T08:00:33.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.505+0000 7fa333531700 1 -- 172.21.15.26:0/19706848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c09e930 msgr2=0x7fa32c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:33.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.505+0000 7fa333531700 1 --2- 172.21.15.26:0/19706848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c09e930 0x7fa32c09ed00 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fa3280098f0 tx=0x7fa328009c00 comp rx=0 tx=0).stop 2023-10-01T08:00:33.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.506+0000 7fa333531700 1 -- 172.21.15.26:0/19706848 shutdown_connections 2023-10-01T08:00:33.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.506+0000 7fa333531700 1 --2- 172.21.15.26:0/19706848 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa32c09f650 0x7fa32c131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.506+0000 7fa333531700 1 --2- 172.21.15.26:0/19706848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c09e930 0x7fa32c09ed00 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.506+0000 7fa333531700 1 --2- 172.21.15.26:0/19706848 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa32c09f240 0x7fa32c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.506+0000 7fa333531700 1 -- 172.21.15.26:0/19706848 >> 172.21.15.26:0/19706848 conn(0x7fa32c0a4210 msgr2=0x7fa32c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:33.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.506+0000 7fa333531700 1 -- 172.21.15.26:0/19706848 shutdown_connections 2023-10-01T08:00:33.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.506+0000 7fa333531700 1 -- 172.21.15.26:0/19706848 wait complete. 2023-10-01T08:00:33.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.507+0000 7fa333531700 1 Processor -- start 2023-10-01T08:00:33.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.507+0000 7fa333531700 1 -- start start 2023-10-01T08:00:33.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.507+0000 7fa333531700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c09e930 0x7fa32c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:33.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.507+0000 7fa333531700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa32c09f240 0x7fa32c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:33.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.507+0000 7fa333531700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa32c09f650 0x7fa32c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:33.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.507+0000 7fa333531700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c0a3510 con 0x7fa32c09e930 2023-10-01T08:00:33.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.507+0000 7fa333531700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c071d20 con 0x7fa32c09f650 2023-10-01T08:00:33.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.507+0000 7fa333531700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c06cca0 con 0x7fa32c09f240 2023-10-01T08:00:33.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.507+0000 7fa330acc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa32c09f240 0x7fa32c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:33.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.507+0000 7fa330acc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa32c09f240 0x7fa32c06bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44376/0 (socket says 172.21.15.26:44376) 2023-10-01T08:00:33.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.507+0000 7fa330acc700 1 -- 172.21.15.26:0/1354012186 learned_addr learned my addr 172.21.15.26:0/1354012186 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:33.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.508+0000 7fa331ace700 1 --2- 172.21.15.26:0/1354012186 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa32c09f650 0x7fa32c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:33.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.508+0000 7fa3312cd700 1 --2- 172.21.15.26:0/1354012186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c09e930 0x7fa32c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:33.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.508+0000 7fa330acc700 1 -- 172.21.15.26:0/1354012186 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa32c09f650 msgr2=0x7fa32c06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:33.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.508+0000 7fa330acc700 1 --2- 172.21.15.26:0/1354012186 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa32c09f650 0x7fa32c06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.508+0000 7fa330acc700 1 -- 172.21.15.26:0/1354012186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c09e930 msgr2=0x7fa32c06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:33.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.508+0000 7fa330acc700 1 --2- 172.21.15.26:0/1354012186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c09e930 0x7fa32c06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.508+0000 7fa330acc700 1 -- 172.21.15.26:0/1354012186 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa328009550 con 0x7fa32c09f240 2023-10-01T08:00:33.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.508+0000 7fa330acc700 1 --2- 172.21.15.26:0/1354012186 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa32c09f240 0x7fa32c06bdf0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fa31c00e930 tx=0x7fa31c00ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:33.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.508+0000 7fa321ffb700 1 -- 172.21.15.26:0/1354012186 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31c013680 con 0x7fa32c09f240 2023-10-01T08:00:33.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.508+0000 7fa321ffb700 1 -- 172.21.15.26:0/1354012186 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31c0137e0 con 0x7fa32c09f240 2023-10-01T08:00:33.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.508+0000 7fa333531700 1 -- 172.21.15.26:0/1354012186 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa32c0a0190 con 0x7fa32c09f240 2023-10-01T08:00:33.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.508+0000 7fa321ffb700 1 -- 172.21.15.26:0/1354012186 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31c013b70 con 0x7fa32c09f240 2023-10-01T08:00:33.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.509+0000 7fa333531700 1 -- 172.21.15.26:0/1354012186 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa32c1a92e0 con 0x7fa32c09f240 2023-10-01T08:00:33.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.510+0000 7fa321ffb700 1 -- 172.21.15.26:0/1354012186 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa31c013cd0 con 0x7fa32c09f240 2023-10-01T08:00:33.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.510+0000 7fa333531700 1 -- 172.21.15.26:0/1354012186 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa32c1a8e90 con 0x7fa32c09f240 2023-10-01T08:00:33.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.510+0000 7fa321ffb700 1 -- 172.21.15.26:0/1354012186 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa31c03f650 con 0x7fa32c09f240 2023-10-01T08:00:33.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.515+0000 7fa321ffb700 1 -- 172.21.15.26:0/1354012186 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa31c00c970 con 0x7fa32c09f240 2023-10-01T08:00:33.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.597+0000 7efe885ea700 1 -- 172.21.15.26:0/2810810014 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efe8011bb90 con 0x7efe8009e390 2023-10-01T08:00:33.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.597+0000 7efe76ffd700 1 -- 172.21.15.26:0/2810810014 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efe7c021020 con 0x7efe8009e390 2023-10-01T08:00:33.598 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:33.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.601+0000 7efe885ea700 1 -- 172.21.15.26:0/2810810014 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe8009e390 msgr2=0x7efe8011e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:33.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.601+0000 7efe885ea700 1 --2- 172.21.15.26:0/2810810014 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe8009e390 0x7efe8011e8d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7efe7c00e910 tx=0x7efe7c00ec20 comp rx=0 tx=0).stop 2023-10-01T08:00:33.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.601+0000 7efe885ea700 1 -- 172.21.15.26:0/2810810014 shutdown_connections 2023-10-01T08:00:33.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.601+0000 7efe885ea700 1 --2- 172.21.15.26:0/2810810014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe801341d0 0x7efe8011f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.601+0000 7efe885ea700 1 --2- 172.21.15.26:0/2810810014 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efe8009e390 0x7efe8011e8d0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.601+0000 7efe885ea700 1 --2- 172.21.15.26:0/2810810014 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7efe801338c0 0x7efe8011ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.601+0000 7efe885ea700 1 -- 172.21.15.26:0/2810810014 >> 172.21.15.26:0/2810810014 conn(0x7efe800a2aa0 msgr2=0x7efe80118cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:33.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.601+0000 7efe885ea700 1 -- 172.21.15.26:0/2810810014 shutdown_connections 2023-10-01T08:00:33.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.601+0000 7efe885ea700 1 -- 172.21.15.26:0/2810810014 wait complete. 2023-10-01T08:00:33.620 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:33.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.675+0000 7f9a21867700 1 -- 172.21.15.26:0/2240807229 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9a1c06b9e0 con 0x7f9a1c130540 2023-10-01T08:00:33.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.675+0000 7f9a03fff700 1 -- 172.21.15.26:0/2240807229 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9a1001b3b0 con 0x7f9a1c130540 2023-10-01T08:00:33.676 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:33.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.677+0000 7f9a21867700 1 -- 172.21.15.26:0/2240807229 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a1c130540 msgr2=0x7f9a1c119210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:33.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.677+0000 7f9a21867700 1 --2- 172.21.15.26:0/2240807229 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a1c130540 0x7f9a1c119210 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c0a35d0 tx=0x7f9a1000ec80 comp rx=0 tx=0).stop 2023-10-01T08:00:33.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.677+0000 7f9a21867700 1 -- 172.21.15.26:0/2240807229 shutdown_connections 2023-10-01T08:00:33.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.677+0000 7f9a21867700 1 --2- 172.21.15.26:0/2240807229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a1c130e50 0x7f9a1c119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.677+0000 7f9a21867700 1 --2- 172.21.15.26:0/2240807229 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a1c06fb20 0x7f9a1c118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.677+0000 7f9a21867700 1 --2- 172.21.15.26:0/2240807229 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a1c130540 0x7f9a1c119210 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.677+0000 7f9a21867700 1 -- 172.21.15.26:0/2240807229 >> 172.21.15.26:0/2240807229 conn(0x7f9a1c0a2aa0 msgr2=0x7f9a1c11feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:33.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.677+0000 7f9a21867700 1 -- 172.21.15.26:0/2240807229 shutdown_connections 2023-10-01T08:00:33.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.677+0000 7f9a21867700 1 -- 172.21.15.26:0/2240807229 wait complete. 2023-10-01T08:00:33.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:33.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.723+0000 7fa333531700 1 -- 172.21.15.26:0/1354012186 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa32c09b430 con 0x7fa32c09f240 2023-10-01T08:00:33.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.724+0000 7fa321ffb700 1 -- 172.21.15.26:0/1354012186 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa31c021030 con 0x7fa32c09f240 2023-10-01T08:00:33.724 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:33.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.726+0000 7fa333531700 1 -- 172.21.15.26:0/1354012186 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa32c09f240 msgr2=0x7fa32c06bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:33.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.726+0000 7fa333531700 1 --2- 172.21.15.26:0/1354012186 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa32c09f240 0x7fa32c06bdf0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fa31c00e930 tx=0x7fa31c00ec40 comp rx=0 tx=0).stop 2023-10-01T08:00:33.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.726+0000 7fa333531700 1 -- 172.21.15.26:0/1354012186 shutdown_connections 2023-10-01T08:00:33.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.726+0000 7fa333531700 1 --2- 172.21.15.26:0/1354012186 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa32c09f650 0x7fa32c06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.726+0000 7fa333531700 1 --2- 172.21.15.26:0/1354012186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c09e930 0x7fa32c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.726+0000 7fa333531700 1 --2- 172.21.15.26:0/1354012186 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa32c09f240 0x7fa32c06bdf0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:33.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.726+0000 7fa333531700 1 -- 172.21.15.26:0/1354012186 >> 172.21.15.26:0/1354012186 conn(0x7fa32c0a4210 msgr2=0x7fa32c1b8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:33.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.726+0000 7fa333531700 1 -- 172.21.15.26:0/1354012186 shutdown_connections 2023-10-01T08:00:33.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:33.726+0000 7fa333531700 1 -- 172.21.15.26:0/1354012186 wait complete. 2023-10-01T08:00:33.740 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:34.322 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:34.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.467+0000 7f9e4868e700 1 Processor -- start 2023-10-01T08:00:34.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.468+0000 7f9e4868e700 1 -- start start 2023-10-01T08:00:34.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.468+0000 7f9e4868e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e4009f410 0x7f9e40136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:34.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.468+0000 7f9e4868e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9e40136fe0 0x7f9e401393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:34.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.468+0000 7f9e4868e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e40070940 con 0x7f9e4009e930 2023-10-01T08:00:34.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.468+0000 7f9e4868e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e4006fd60 con 0x7f9e40136fe0 2023-10-01T08:00:34.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.468+0000 7f9e4868e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4006fa80 con 0x7f9e4009f410 2023-10-01T08:00:34.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.468+0000 7f9e45c29700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e4009f410 0x7f9e40136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:34.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.468+0000 7f9e46c2b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9e40136fe0 0x7f9e401393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:34.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.468+0000 7f9e45c29700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e4009f410 0x7f9e40136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42302/0 (socket says 172.21.15.26:42302) 2023-10-01T08:00:34.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.468+0000 7f9e45c29700 1 -- 172.21.15.26:0/1682358244 learned_addr learned my addr 172.21.15.26:0/1682358244 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:34.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.469+0000 7f9e45c29700 1 -- 172.21.15.26:0/1682358244 >> v2:172.21.15.26:3300/0 conn(0x7f9e40136fe0 msgr2=0x7f9e401393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:34.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.469+0000 7f9e45c29700 1 --2- 172.21.15.26:0/1682358244 >> v2:172.21.15.26:3300/0 conn(0x7f9e40136fe0 0x7f9e401393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:34.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.469+0000 7f9e45c29700 1 -- 172.21.15.26:0/1682358244 >> v1:172.21.15.26:6789/0 conn(0x7f9e4009e930 legacy=0x7f9e4009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:34.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.469+0000 7f9e45c29700 1 -- 172.21.15.26:0/1682358244 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e4009fb60 con 0x7f9e4009f410 2023-10-01T08:00:34.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.469+0000 7f9e46c2b700 1 --2- 172.21.15.26:0/1682358244 >> v2:172.21.15.26:3300/0 conn(0x7f9e40136fe0 0x7f9e401393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:34.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.469+0000 7f9e45c29700 1 --2- 172.21.15.26:0/1682358244 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e4009f410 0x7f9e40136aa0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f9e300098f0 tx=0x7f9e30009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7476c698f1f772ef server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:34.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.469+0000 7f9e45428700 1 -- 172.21.15.26:0/1682358244 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e30011830 con 0x7f9e4009f410 2023-10-01T08:00:34.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.469+0000 7f9e45428700 1 -- 172.21.15.26:0/1682358244 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e30011990 con 0x7f9e4009f410 2023-10-01T08:00:34.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.469+0000 7f9e45428700 1 -- 172.21.15.26:0/1682358244 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e30011d20 con 0x7f9e4009f410 2023-10-01T08:00:34.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.470+0000 7f9e4868e700 1 -- 172.21.15.26:0/1682358244 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e4009f410 msgr2=0x7f9e40136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:34.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.470+0000 7f9e4868e700 1 --2- 172.21.15.26:0/1682358244 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e4009f410 0x7f9e40136aa0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f9e300098f0 tx=0x7f9e30009c00 comp rx=0 tx=0).stop 2023-10-01T08:00:34.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.470+0000 7f9e4868e700 1 -- 172.21.15.26:0/1682358244 shutdown_connections 2023-10-01T08:00:34.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.470+0000 7f9e4868e700 1 --2- 172.21.15.26:0/1682358244 >> v2:172.21.15.26:3300/0 conn(0x7f9e40136fe0 0x7f9e401393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:34.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.470+0000 7f9e4868e700 1 --2- 172.21.15.26:0/1682358244 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e4009f410 0x7f9e40136aa0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:34.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.470+0000 7f9e4868e700 1 -- 172.21.15.26:0/1682358244 >> 172.21.15.26:0/1682358244 conn(0x7f9e400a4210 msgr2=0x7f9e400a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:34.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.470+0000 7f9e4868e700 1 -- 172.21.15.26:0/1682358244 shutdown_connections 2023-10-01T08:00:34.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.470+0000 7f9e4868e700 1 -- 172.21.15.26:0/1682358244 wait complete. 2023-10-01T08:00:34.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.471+0000 7f9e4868e700 1 Processor -- start 2023-10-01T08:00:34.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.471+0000 7f9e4868e700 1 -- start start 2023-10-01T08:00:34.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.471+0000 7f9e4868e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e4009e930 0x7f9e4006c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:34.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.471+0000 7f9e4868e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e4009f410 0x7f9e4006c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:34.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.471+0000 7f9e4868e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9e40136fe0 0x7f9e401c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:34.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.471+0000 7f9e4868e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4006bd70 con 0x7f9e4009f410 2023-10-01T08:00:34.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.471+0000 7f9e4868e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e40122080 con 0x7f9e4009e930 2023-10-01T08:00:34.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.471+0000 7f9e4868e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e40132420 con 0x7f9e40136fe0 2023-10-01T08:00:34.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.472+0000 7f9e4642a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e4009e930 0x7f9e4006c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:34.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.472+0000 7f9e45c29700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e4009f410 0x7f9e4006c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:34.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.472+0000 7f9e4642a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e4009e930 0x7f9e4006c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42304/0 (socket says 172.21.15.26:42304) 2023-10-01T08:00:34.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.472+0000 7f9e4642a700 1 -- 172.21.15.26:0/3636617070 learned_addr learned my addr 172.21.15.26:0/3636617070 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:34.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.472+0000 7f9e46c2b700 1 --2- 172.21.15.26:0/3636617070 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9e40136fe0 0x7f9e401c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:34.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.472+0000 7f9e4642a700 1 -- 172.21.15.26:0/3636617070 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9e40136fe0 msgr2=0x7f9e401c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:34.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.472+0000 7f9e4642a700 1 --2- 172.21.15.26:0/3636617070 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9e40136fe0 0x7f9e401c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:34.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.472+0000 7f9e4642a700 1 -- 172.21.15.26:0/3636617070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e4009f410 msgr2=0x7f9e4006c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:34.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.472+0000 7f9e4642a700 1 --2- 172.21.15.26:0/3636617070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e4009f410 0x7f9e4006c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:34.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.472+0000 7f9e4642a700 1 -- 172.21.15.26:0/3636617070 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e38009a70 con 0x7f9e4009e930 2023-10-01T08:00:34.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.472+0000 7f9e45c29700 1 --2- 172.21.15.26:0/3636617070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e4009f410 0x7f9e4006c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:34.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.472+0000 7f9e46c2b700 1 --2- 172.21.15.26:0/3636617070 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9e40136fe0 0x7f9e401c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:34.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.472+0000 7f9e4642a700 1 --2- 172.21.15.26:0/3636617070 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e4009e930 0x7f9e4006c0e0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00c4e0 tx=0x7f9e3c00c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:34.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.472+0000 7f9e36ffd700 1 -- 172.21.15.26:0/3636617070 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c0052d0 con 0x7f9e4009e930 2023-10-01T08:00:34.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.472+0000 7f9e36ffd700 1 -- 172.21.15.26:0/3636617070 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3c005430 con 0x7f9e4009e930 2023-10-01T08:00:34.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.472+0000 7f9e36ffd700 1 -- 172.21.15.26:0/3636617070 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c0038c0 con 0x7f9e4009e930 2023-10-01T08:00:34.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.472+0000 7f9e4868e700 1 -- 172.21.15.26:0/3636617070 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e30009550 con 0x7f9e4009e930 2023-10-01T08:00:34.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.472+0000 7f9e4868e700 1 -- 172.21.15.26:0/3636617070 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e4006d470 con 0x7f9e4009e930 2023-10-01T08:00:34.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.473+0000 7f9e36ffd700 1 -- 172.21.15.26:0/3636617070 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9e3c003a20 con 0x7f9e4009e930 2023-10-01T08:00:34.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.473+0000 7f9e36ffd700 1 -- 172.21.15.26:0/3636617070 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9e3c03ea90 con 0x7f9e4009e930 2023-10-01T08:00:34.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.473+0000 7f9e4868e700 1 -- 172.21.15.26:0/3636617070 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e40121ec0 con 0x7f9e4009e930 2023-10-01T08:00:34.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.478+0000 7f9e36ffd700 1 -- 172.21.15.26:0/3636617070 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9e3c018260 con 0x7f9e4009e930 2023-10-01T08:00:34.621 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:34.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.684+0000 7f9e4868e700 1 -- 172.21.15.26:0/3636617070 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9e40074ea0 con 0x7f9e4009e930 2023-10-01T08:00:34.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.684+0000 7f9e36ffd700 1 -- 172.21.15.26:0/3636617070 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9e3c017020 con 0x7f9e4009e930 2023-10-01T08:00:34.685 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:34.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.687+0000 7f9e4868e700 1 -- 172.21.15.26:0/3636617070 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e4009e930 msgr2=0x7f9e4006c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:34.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.687+0000 7f9e4868e700 1 --2- 172.21.15.26:0/3636617070 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e4009e930 0x7f9e4006c0e0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00c4e0 tx=0x7f9e3c00c7f0 comp rx=0 tx=0).stop 2023-10-01T08:00:34.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.687+0000 7f9e4868e700 1 -- 172.21.15.26:0/3636617070 shutdown_connections 2023-10-01T08:00:34.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.687+0000 7f9e4868e700 1 --2- 172.21.15.26:0/3636617070 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9e40136fe0 0x7f9e401c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:34.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.687+0000 7f9e4868e700 1 --2- 172.21.15.26:0/3636617070 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e4009e930 0x7f9e4006c0e0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:34.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.687+0000 7f9e4868e700 1 --2- 172.21.15.26:0/3636617070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e4009f410 0x7f9e4006c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:34.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.687+0000 7f9e4868e700 1 -- 172.21.15.26:0/3636617070 >> 172.21.15.26:0/3636617070 conn(0x7f9e400a4210 msgr2=0x7f9e400a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:34.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.687+0000 7f9e4868e700 1 -- 172.21.15.26:0/3636617070 shutdown_connections 2023-10-01T08:00:34.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.687+0000 7f9e4868e700 1 -- 172.21.15.26:0/3636617070 wait complete. 2023-10-01T08:00:34.692 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:34.702 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:34.741 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:34.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.760+0000 7fab7124a700 1 Processor -- start 2023-10-01T08:00:34.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.760+0000 7fab7124a700 1 -- start start 2023-10-01T08:00:34.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.760+0000 7fab7124a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab6c09d6f0 0x7fab6c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:34.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.760+0000 7fab7124a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab6c09e000 0x7fab6c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:34.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.760+0000 7fab7124a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab6c09b120 con 0x7fab6c09e410 2023-10-01T08:00:34.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.760+0000 7fab7124a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c06b460 con 0x7fab6c09d6f0 2023-10-01T08:00:34.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.760+0000 7fab7124a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c09a7e0 con 0x7fab6c09e000 2023-10-01T08:00:34.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.761+0000 7fab6a59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab6c09e000 0x7fab6c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:34.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.761+0000 7fab6b59e700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fab6c09e410 0x7fab6c133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33774/0 (socket says 172.21.15.26:33774) 2023-10-01T08:00:34.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.761+0000 7fab6a59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab6c09e000 0x7fab6c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44392/0 (socket says 172.21.15.26:44392) 2023-10-01T08:00:34.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.761+0000 7fab6b59e700 1 -- 172.21.15.26:0/1282083006 learned_addr learned my addr 172.21.15.26:0/1282083006 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:34.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.761+0000 7fab6ad9d700 1 --2- 172.21.15.26:0/1282083006 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab6c09d6f0 0x7fab6c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:34.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.761+0000 7fab69d9b700 1 -- 172.21.15.26:0/1282083006 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1109688257 0 0) 0x7fab6c09b120 con 0x7fab6c09e410 2023-10-01T08:00:34.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.761+0000 7fab6a59c700 1 -- 172.21.15.26:0/1282083006 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab6c09d6f0 msgr2=0x7fab6c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:34.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.761+0000 7fab6a59c700 1 --2- 172.21.15.26:0/1282083006 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab6c09d6f0 0x7fab6c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:34.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.761+0000 7fab6a59c700 1 -- 172.21.15.26:0/1282083006 >> v1:172.21.15.26:6789/0 conn(0x7fab6c09e410 legacy=0x7fab6c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:34.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.761+0000 7fab6a59c700 1 -- 172.21.15.26:0/1282083006 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6c09a500 con 0x7fab6c09e000 2023-10-01T08:00:34.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.761+0000 7fab6ad9d700 1 --2- 172.21.15.26:0/1282083006 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab6c09d6f0 0x7fab6c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:34.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.761+0000 7fab6a59c700 1 --2- 172.21.15.26:0/1282083006 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab6c09e000 0x7fab6c1339f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fab600098a0 tx=0x7fab60009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a918b5c28629cc5d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:34.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.762+0000 7fab69d9b700 1 -- 172.21.15.26:0/1282083006 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab60011830 con 0x7fab6c09e000 2023-10-01T08:00:34.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.762+0000 7fab69d9b700 1 -- 172.21.15.26:0/1282083006 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab60011990 con 0x7fab6c09e000 2023-10-01T08:00:34.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.762+0000 7fab69d9b700 1 -- 172.21.15.26:0/1282083006 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab60011d20 con 0x7fab6c09e000 2023-10-01T08:00:34.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.763+0000 7fab7124a700 1 -- 172.21.15.26:0/1282083006 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab6c09e000 msgr2=0x7fab6c1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:34.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.763+0000 7fab7124a700 1 --2- 172.21.15.26:0/1282083006 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab6c09e000 0x7fab6c1339f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fab600098a0 tx=0x7fab60009bb0 comp rx=0 tx=0).stop 2023-10-01T08:00:34.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.763+0000 7fab7124a700 1 -- 172.21.15.26:0/1282083006 shutdown_connections 2023-10-01T08:00:34.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.763+0000 7fab7124a700 1 --2- 172.21.15.26:0/1282083006 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab6c09d6f0 0x7fab6c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:34.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.763+0000 7fab7124a700 1 --2- 172.21.15.26:0/1282083006 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab6c09e000 0x7fab6c1339f0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:34.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.763+0000 7fab7124a700 1 -- 172.21.15.26:0/1282083006 >> 172.21.15.26:0/1282083006 conn(0x7fab6c066f50 msgr2=0x7fab6c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:34.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.763+0000 7fab7124a700 1 -- 172.21.15.26:0/1282083006 shutdown_connections 2023-10-01T08:00:34.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.763+0000 7fab7124a700 1 -- 172.21.15.26:0/1282083006 wait complete. 2023-10-01T08:00:34.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.764+0000 7fab7124a700 1 Processor -- start 2023-10-01T08:00:34.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.764+0000 7fab7124a700 1 -- start start 2023-10-01T08:00:34.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.765+0000 7fab7124a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab6c09d6f0 0x7fab6c1a5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:34.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.765+0000 7fab7124a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab6c09e000 0x7fab6c1a6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:34.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.765+0000 7fab7124a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab6c09e410 0x7fab6c1a6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:34.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.765+0000 7fab7124a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c1a9630 con 0x7fab6c09e000 2023-10-01T08:00:34.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.765+0000 7fab7124a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c1a7b10 con 0x7fab6c09e410 2023-10-01T08:00:34.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.765+0000 7fab7124a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c0a2e40 con 0x7fab6c09d6f0 2023-10-01T08:00:34.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.765+0000 7fab6ad9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab6c09d6f0 0x7fab6c1a5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:34.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.765+0000 7fab6ad9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab6c09d6f0 0x7fab6c1a5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44398/0 (socket says 172.21.15.26:44398) 2023-10-01T08:00:34.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.765+0000 7fab6ad9d700 1 -- 172.21.15.26:0/587022170 learned_addr learned my addr 172.21.15.26:0/587022170 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:34.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.765+0000 7fab6b59e700 1 --2- 172.21.15.26:0/587022170 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab6c09e410 0x7fab6c1a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:34.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.765+0000 7fab6a59c700 1 --2- 172.21.15.26:0/587022170 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab6c09e000 0x7fab6c1a6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:34.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.765+0000 7fab6b59e700 1 -- 172.21.15.26:0/587022170 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab6c09d6f0 msgr2=0x7fab6c1a5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:34.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.765+0000 7fab6b59e700 1 --2- 172.21.15.26:0/587022170 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab6c09d6f0 0x7fab6c1a5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:34.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.765+0000 7fab6b59e700 1 -- 172.21.15.26:0/587022170 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab6c09e000 msgr2=0x7fab6c1a6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:34.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.765+0000 7fab6b59e700 1 --2- 172.21.15.26:0/587022170 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab6c09e000 0x7fab6c1a6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:34.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.765+0000 7fab6b59e700 1 -- 172.21.15.26:0/587022170 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab5c0094a0 con 0x7fab6c09e410 2023-10-01T08:00:34.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.765+0000 7fab6b59e700 1 --2- 172.21.15.26:0/587022170 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab6c09e410 0x7fab6c1a6870 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fab6c09e8b0 tx=0x7fab6400cec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:34.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.766+0000 7fab537fe700 1 -- 172.21.15.26:0/587022170 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6400a9e0 con 0x7fab6c09e410 2023-10-01T08:00:34.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.766+0000 7fab537fe700 1 -- 172.21.15.26:0/587022170 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6400ab40 con 0x7fab6c09e410 2023-10-01T08:00:34.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.766+0000 7fab7124a700 1 -- 172.21.15.26:0/587022170 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab600094a0 con 0x7fab6c09e410 2023-10-01T08:00:34.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.766+0000 7fab537fe700 1 -- 172.21.15.26:0/587022170 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab640070d0 con 0x7fab6c09e410 2023-10-01T08:00:34.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.766+0000 7fab7124a700 1 -- 172.21.15.26:0/587022170 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab6c1a8c50 con 0x7fab6c09e410 2023-10-01T08:00:34.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.767+0000 7fab537fe700 1 -- 172.21.15.26:0/587022170 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab64007230 con 0x7fab6c09e410 2023-10-01T08:00:34.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.767+0000 7fab537fe700 1 -- 172.21.15.26:0/587022170 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fab6403f550 con 0x7fab6c09e410 2023-10-01T08:00:34.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.767+0000 7fab7124a700 1 -- 172.21.15.26:0/587022170 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab6c074ea0 con 0x7fab6c09e410 2023-10-01T08:00:34.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.772+0000 7fab537fe700 1 -- 172.21.15.26:0/587022170 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab640074e0 con 0x7fab6c09e410 2023-10-01T08:00:34.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.842+0000 7f8192fb2700 1 Processor -- start 2023-10-01T08:00:34.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.842+0000 7f8192fb2700 1 -- start start 2023-10-01T08:00:34.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.842+0000 7f8192fb2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f818c09e850 0x7f818c09ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:34.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.843+0000 7f8192fb2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f818c134300 0x7f818c13bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:34.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.843+0000 7f8192fb2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818c09f960 con 0x7f818c09f160 2023-10-01T08:00:34.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.843+0000 7f8192fb2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f818c09ae60 con 0x7f818c134300 2023-10-01T08:00:34.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.843+0000 7f8192fb2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f818c06cb10 con 0x7f818c09e850 2023-10-01T08:00:34.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.843+0000 7f818bfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f818c09f160 0x7f818c133bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33790/0 (socket says 172.21.15.26:33790) 2023-10-01T08:00:34.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.843+0000 7f818bfff700 1 -- 172.21.15.26:0/3753979763 learned_addr learned my addr 172.21.15.26:0/3753979763 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:34.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.843+0000 7f819154f700 1 --2- 172.21.15.26:0/3753979763 >> v2:172.21.15.26:3300/0 conn(0x7f818c134300 0x7f818c13bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:34.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.843+0000 7f8190d4e700 1 --2- 172.21.15.26:0/3753979763 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f818c09e850 0x7f818c09ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:34.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.843+0000 7f819154f700 1 -- 172.21.15.26:0/3753979763 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f818c09e850 msgr2=0x7f818c09ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:34.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.843+0000 7f819154f700 1 --2- 172.21.15.26:0/3753979763 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f818c09e850 0x7f818c09ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:34.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.843+0000 7f819154f700 1 -- 172.21.15.26:0/3753979763 >> v1:172.21.15.26:6789/0 conn(0x7f818c09f160 legacy=0x7f818c133bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:34.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.843+0000 7f819154f700 1 -- 172.21.15.26:0/3753979763 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818c06b990 con 0x7f818c134300 2023-10-01T08:00:34.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.843+0000 7f819154f700 1 --2- 172.21.15.26:0/3753979763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f818c134300 0x7f818c13bec0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f8184009d90 tx=0x7f818400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db670485235755 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:34.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.843+0000 7f818b7fe700 1 -- 172.21.15.26:0/3753979763 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818400e070 con 0x7f818c134300 2023-10-01T08:00:34.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.844+0000 7f818b7fe700 1 -- 172.21.15.26:0/3753979763 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818400bb20 con 0x7f818c134300 2023-10-01T08:00:34.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.844+0000 7f818b7fe700 1 -- 172.21.15.26:0/3753979763 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8184012430 con 0x7f818c134300 2023-10-01T08:00:34.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.845+0000 7f8192fb2700 1 -- 172.21.15.26:0/3753979763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f818c134300 msgr2=0x7f818c13bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:34.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.845+0000 7f8192fb2700 1 --2- 172.21.15.26:0/3753979763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f818c134300 0x7f818c13bec0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f8184009d90 tx=0x7f818400b330 comp rx=0 tx=0).stop 2023-10-01T08:00:34.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.845+0000 7f8192fb2700 1 -- 172.21.15.26:0/3753979763 shutdown_connections 2023-10-01T08:00:34.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.845+0000 7f8192fb2700 1 --2- 172.21.15.26:0/3753979763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f818c134300 0x7f818c13bec0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:34.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.845+0000 7f8192fb2700 1 --2- 172.21.15.26:0/3753979763 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f818c09e850 0x7f818c09ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:34.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.845+0000 7f8192fb2700 1 -- 172.21.15.26:0/3753979763 >> 172.21.15.26:0/3753979763 conn(0x7f818c0a3f70 msgr2=0x7f818c0a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:34.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.845+0000 7f8192fb2700 1 -- 172.21.15.26:0/3753979763 shutdown_connections 2023-10-01T08:00:34.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.845+0000 7f8192fb2700 1 -- 172.21.15.26:0/3753979763 wait complete. 2023-10-01T08:00:34.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.846+0000 7f8192fb2700 1 Processor -- start 2023-10-01T08:00:34.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.846+0000 7f8192fb2700 1 -- start start 2023-10-01T08:00:34.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.847+0000 7f8192fb2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f818c09e850 0x7f818c122a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:34.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.847+0000 7f8192fb2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f818c09f160 0x7f818c122fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:34.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.847+0000 7f8192fb2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f818c134300 0x7f818c123510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:34.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.847+0000 7f8192fb2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818c124820 con 0x7f818c09f160 2023-10-01T08:00:34.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.847+0000 7f8192fb2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818c06f810 con 0x7f818c134300 2023-10-01T08:00:34.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.847+0000 7f8192fb2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f818c1265b0 con 0x7f818c09e850 2023-10-01T08:00:34.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.848+0000 7f8190d4e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f818c09e850 0x7f818c122a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:34.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.848+0000 7f8190d4e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f818c09e850 0x7f818c122a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44414/0 (socket says 172.21.15.26:44414) 2023-10-01T08:00:34.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.848+0000 7f8190d4e700 1 -- 172.21.15.26:0/2294443487 learned_addr learned my addr 172.21.15.26:0/2294443487 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:34.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.848+0000 7f818bfff700 1 --2- 172.21.15.26:0/2294443487 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f818c09f160 0x7f818c122fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:34.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.848+0000 7f819154f700 1 --2- 172.21.15.26:0/2294443487 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f818c134300 0x7f818c123510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:34.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.848+0000 7f8190d4e700 1 -- 172.21.15.26:0/2294443487 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f818c134300 msgr2=0x7f818c123510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:34.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.848+0000 7f8190d4e700 1 --2- 172.21.15.26:0/2294443487 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f818c134300 0x7f818c123510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:34.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.848+0000 7f8190d4e700 1 -- 172.21.15.26:0/2294443487 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f818c09f160 msgr2=0x7f818c122fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:34.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.848+0000 7f8190d4e700 1 --2- 172.21.15.26:0/2294443487 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f818c09f160 0x7f818c122fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:34.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.848+0000 7f8190d4e700 1 -- 172.21.15.26:0/2294443487 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8184009a70 con 0x7f818c09e850 2023-10-01T08:00:34.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.848+0000 7f8190d4e700 1 --2- 172.21.15.26:0/2294443487 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f818c09e850 0x7f818c122a90 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f818000e9b0 tx=0x7f818000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:34.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.848+0000 7f81897fa700 1 -- 172.21.15.26:0/2294443487 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8180009710 con 0x7f818c09e850 2023-10-01T08:00:34.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.848+0000 7f81897fa700 1 -- 172.21.15.26:0/2294443487 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818000ee50 con 0x7f818c09e850 2023-10-01T08:00:34.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.848+0000 7f8192fb2700 1 -- 172.21.15.26:0/2294443487 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f818c124ec0 con 0x7f818c09e850 2023-10-01T08:00:34.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.848+0000 7f81897fa700 1 -- 172.21.15.26:0/2294443487 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818000ca50 con 0x7f818c09e850 2023-10-01T08:00:34.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.849+0000 7f8192fb2700 1 -- 172.21.15.26:0/2294443487 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f818c1262d0 con 0x7f818c09e850 2023-10-01T08:00:34.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.849+0000 7f8192fb2700 1 -- 172.21.15.26:0/2294443487 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f818c0747f0 con 0x7f818c09e850 2023-10-01T08:00:34.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.850+0000 7f81897fa700 1 -- 172.21.15.26:0/2294443487 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f818000cbb0 con 0x7f818c09e850 2023-10-01T08:00:34.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.850+0000 7f81897fa700 1 -- 172.21.15.26:0/2294443487 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f818003ff00 con 0x7f818c09e850 2023-10-01T08:00:34.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.859+0000 7f81897fa700 1 -- 172.21.15.26:0/2294443487 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8180011350 con 0x7f818c09e850 2023-10-01T08:00:34.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.888+0000 7fa821521700 1 Processor -- start 2023-10-01T08:00:34.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.888+0000 7fa821521700 1 -- start start 2023-10-01T08:00:34.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.889+0000 7fa821521700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa81c09d6f0 0x7fa81c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:34.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.889+0000 7fa821521700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa81c09e410 0x7fa81c130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:34.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.889+0000 7fa821521700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa81c09f130 con 0x7fa81c09e000 2023-10-01T08:00:34.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.889+0000 7fa821521700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c09f520 con 0x7fa81c09d6f0 2023-10-01T08:00:34.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.889+0000 7fa821521700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c09e930 con 0x7fa81c09e410 2023-10-01T08:00:34.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.889+0000 7fa81affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa81c09d6f0 0x7fa81c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:34.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.889+0000 7fa81affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa81c09d6f0 0x7fa81c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42338/0 (socket says 172.21.15.26:42338) 2023-10-01T08:00:34.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.889+0000 7fa81affd700 1 -- 172.21.15.26:0/3854959164 learned_addr learned my addr 172.21.15.26:0/3854959164 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:34.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.889+0000 7fa81b7fe700 1 --2- 172.21.15.26:0/3854959164 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa81c09e410 0x7fa81c130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:34.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.889+0000 7fa819ffb700 1 -- 172.21.15.26:0/3854959164 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 500236799 0 0) 0x7fa81c09f130 con 0x7fa81c09e000 2023-10-01T08:00:34.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.889+0000 7fa819ffb700 1 -- 172.21.15.26:0/3854959164 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8040035b0 con 0x7fa81c09e000 2023-10-01T08:00:34.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.889+0000 7fa81affd700 1 -- 172.21.15.26:0/3854959164 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa81c09e410 msgr2=0x7fa81c130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:34.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.889+0000 7fa81affd700 1 --2- 172.21.15.26:0/3854959164 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa81c09e410 0x7fa81c130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:34.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.889+0000 7fa81affd700 1 -- 172.21.15.26:0/3854959164 >> v1:172.21.15.26:6789/0 conn(0x7fa81c09e000 legacy=0x7fa81c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:34.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.890+0000 7fa81affd700 1 -- 172.21.15.26:0/3854959164 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c09b2d0 con 0x7fa81c09d6f0 2023-10-01T08:00:34.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.890+0000 7fa81b7fe700 1 --2- 172.21.15.26:0/3854959164 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa81c09e410 0x7fa81c130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:34.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.890+0000 7fa81affd700 1 --2- 172.21.15.26:0/3854959164 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa81c09d6f0 0x7fa81c09dac0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fa80c009920 tx=0x7fa80c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e2a2b79ac721afd server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:34.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.890+0000 7fa819ffb700 1 -- 172.21.15.26:0/3854959164 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c011830 con 0x7fa81c09d6f0 2023-10-01T08:00:34.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.890+0000 7fa819ffb700 1 -- 172.21.15.26:0/3854959164 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80c011990 con 0x7fa81c09d6f0 2023-10-01T08:00:34.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.890+0000 7fa819ffb700 1 -- 172.21.15.26:0/3854959164 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c011d20 con 0x7fa81c09d6f0 2023-10-01T08:00:34.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.891+0000 7fa821521700 1 -- 172.21.15.26:0/3854959164 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa81c09d6f0 msgr2=0x7fa81c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:34.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.891+0000 7fa821521700 1 --2- 172.21.15.26:0/3854959164 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa81c09d6f0 0x7fa81c09dac0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fa80c009920 tx=0x7fa80c009c30 comp rx=0 tx=0).stop 2023-10-01T08:00:34.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.891+0000 7fa821521700 1 -- 172.21.15.26:0/3854959164 shutdown_connections 2023-10-01T08:00:34.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.891+0000 7fa821521700 1 --2- 172.21.15.26:0/3854959164 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa81c09e410 0x7fa81c130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:34.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.891+0000 7fa821521700 1 --2- 172.21.15.26:0/3854959164 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa81c09d6f0 0x7fa81c09dac0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:34.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.891+0000 7fa821521700 1 -- 172.21.15.26:0/3854959164 >> 172.21.15.26:0/3854959164 conn(0x7fa81c066f50 msgr2=0x7fa81c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:34.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.891+0000 7fa821521700 1 -- 172.21.15.26:0/3854959164 shutdown_connections 2023-10-01T08:00:34.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.891+0000 7fa821521700 1 -- 172.21.15.26:0/3854959164 wait complete. 2023-10-01T08:00:34.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.892+0000 7fa821521700 1 Processor -- start 2023-10-01T08:00:34.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.892+0000 7fa821521700 1 -- start start 2023-10-01T08:00:34.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.892+0000 7fa821521700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa81c09d6f0 0x7fa81c120310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:34.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.892+0000 7fa821521700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa81c09e000 0x7fa81c120850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:34.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.893+0000 7fa821521700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa81c09e410 0x7fa81c120d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:34.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.893+0000 7fa821521700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c123890 con 0x7fa81c09d6f0 2023-10-01T08:00:34.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.893+0000 7fa821521700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c123e30 con 0x7fa81c09e000 2023-10-01T08:00:34.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.893+0000 7fa821521700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c122740 con 0x7fa81c09e410 2023-10-01T08:00:34.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.893+0000 7fa81affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa81c09d6f0 0x7fa81c120310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:34.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.893+0000 7fa81a7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa81c09e000 0x7fa81c120850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:34.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.893+0000 7fa81affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa81c09d6f0 0x7fa81c120310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53220/0 (socket says 172.21.15.26:53220) 2023-10-01T08:00:34.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.893+0000 7fa81affd700 1 -- 172.21.15.26:0/2468525640 learned_addr learned my addr 172.21.15.26:0/2468525640 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:34.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.893+0000 7fa81b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa81c09e410 0x7fa81c120d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:34.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.893+0000 7fa81affd700 1 -- 172.21.15.26:0/2468525640 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa81c09e410 msgr2=0x7fa81c120d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:34.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.893+0000 7fa81affd700 1 --2- 172.21.15.26:0/2468525640 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa81c09e410 0x7fa81c120d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:34.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.893+0000 7fa81affd700 1 -- 172.21.15.26:0/2468525640 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa81c09e000 msgr2=0x7fa81c120850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:34.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.893+0000 7fa81affd700 1 --2- 172.21.15.26:0/2468525640 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa81c09e000 0x7fa81c120850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:34.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.893+0000 7fa81affd700 1 -- 172.21.15.26:0/2468525640 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa814009a70 con 0x7fa81c09d6f0 2023-10-01T08:00:34.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.893+0000 7fa81b7fe700 1 --2- 172.21.15.26:0/2468525640 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa81c09e410 0x7fa81c120d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:34.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.893+0000 7fa81a7fc700 1 --2- 172.21.15.26:0/2468525640 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa81c09e000 0x7fa81c120850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:34.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.893+0000 7fa81affd700 1 --2- 172.21.15.26:0/2468525640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa81c09d6f0 0x7fa81c120310 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fa80c000c00 tx=0x7fa80c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:34.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.894+0000 7fa8037fe700 1 -- 172.21.15.26:0/2468525640 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c004450 con 0x7fa81c09d6f0 2023-10-01T08:00:34.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.894+0000 7fa8037fe700 1 -- 172.21.15.26:0/2468525640 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80c0045b0 con 0x7fa81c09d6f0 2023-10-01T08:00:34.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.894+0000 7fa821521700 1 -- 172.21.15.26:0/2468525640 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa80c009550 con 0x7fa81c09d6f0 2023-10-01T08:00:34.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.894+0000 7fa8037fe700 1 -- 172.21.15.26:0/2468525640 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c0038c0 con 0x7fa81c09d6f0 2023-10-01T08:00:34.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.894+0000 7fa821521700 1 -- 172.21.15.26:0/2468525640 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa81c09c700 con 0x7fa81c09d6f0 2023-10-01T08:00:34.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.895+0000 7fa8037fe700 1 -- 172.21.15.26:0/2468525640 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa80c003a20 con 0x7fa81c09d6f0 2023-10-01T08:00:34.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.895+0000 7fa821521700 1 -- 172.21.15.26:0/2468525640 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa81c074ea0 con 0x7fa81c09d6f0 2023-10-01T08:00:34.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.895+0000 7fa8037fe700 1 -- 172.21.15.26:0/2468525640 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa80c021030 con 0x7fa81c09d6f0 2023-10-01T08:00:34.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:34.900+0000 7fa8037fe700 1 -- 172.21.15.26:0/2468525640 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa80c01a430 con 0x7fa81c09d6f0 2023-10-01T08:00:35.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.004+0000 7fab7124a700 1 -- 172.21.15.26:0/587022170 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fab6c06c360 con 0x7fab6c09e410 2023-10-01T08:00:35.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.004+0000 7fab537fe700 1 -- 172.21.15.26:0/587022170 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fab64018020 con 0x7fab6c09e410 2023-10-01T08:00:35.005 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:35.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.006+0000 7fab7124a700 1 -- 172.21.15.26:0/587022170 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab6c09e410 msgr2=0x7fab6c1a6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:35.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.006+0000 7fab7124a700 1 --2- 172.21.15.26:0/587022170 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab6c09e410 0x7fab6c1a6870 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fab6c09e8b0 tx=0x7fab6400cec0 comp rx=0 tx=0).stop 2023-10-01T08:00:35.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.006+0000 7fab7124a700 1 -- 172.21.15.26:0/587022170 shutdown_connections 2023-10-01T08:00:35.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.006+0000 7fab7124a700 1 --2- 172.21.15.26:0/587022170 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab6c09e410 0x7fab6c1a6870 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:35.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.006+0000 7fab7124a700 1 --2- 172.21.15.26:0/587022170 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab6c09d6f0 0x7fab6c1a5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:35.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.006+0000 7fab7124a700 1 --2- 172.21.15.26:0/587022170 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab6c09e000 0x7fab6c1a6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:35.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.006+0000 7fab7124a700 1 -- 172.21.15.26:0/587022170 >> 172.21.15.26:0/587022170 conn(0x7fab6c066f50 msgr2=0x7fab6c1bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:35.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.007+0000 7fab7124a700 1 -- 172.21.15.26:0/587022170 shutdown_connections 2023-10-01T08:00:35.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.007+0000 7fab7124a700 1 -- 172.21.15.26:0/587022170 wait complete. 2023-10-01T08:00:35.021 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:35.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.079+0000 7f8192fb2700 1 -- 172.21.15.26:0/2294443487 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f818c1260c0 con 0x7f818c09e850 2023-10-01T08:00:35.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.079+0000 7f81897fa700 1 -- 172.21.15.26:0/2294443487 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f818002a090 con 0x7f818c09e850 2023-10-01T08:00:35.080 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:35.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.082+0000 7f8192fb2700 1 -- 172.21.15.26:0/2294443487 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f818c09e850 msgr2=0x7f818c122a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:35.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.082+0000 7f8192fb2700 1 --2- 172.21.15.26:0/2294443487 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f818c09e850 0x7f818c122a90 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f818000e9b0 tx=0x7f818000ecc0 comp rx=0 tx=0).stop 2023-10-01T08:00:35.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.082+0000 7f8192fb2700 1 -- 172.21.15.26:0/2294443487 shutdown_connections 2023-10-01T08:00:35.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.082+0000 7f8192fb2700 1 --2- 172.21.15.26:0/2294443487 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f818c134300 0x7f818c123510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:35.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.082+0000 7f8192fb2700 1 --2- 172.21.15.26:0/2294443487 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f818c09e850 0x7f818c122a90 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:35.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.082+0000 7f8192fb2700 1 --2- 172.21.15.26:0/2294443487 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f818c09f160 0x7f818c122fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:35.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.082+0000 7f8192fb2700 1 -- 172.21.15.26:0/2294443487 >> 172.21.15.26:0/2294443487 conn(0x7f818c0a3f70 msgr2=0x7f818c070fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:35.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.082+0000 7f8192fb2700 1 -- 172.21.15.26:0/2294443487 shutdown_connections 2023-10-01T08:00:35.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.082+0000 7f8192fb2700 1 -- 172.21.15.26:0/2294443487 wait complete. 2023-10-01T08:00:35.096 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:35.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.110+0000 7fa821521700 1 -- 172.21.15.26:0/2468525640 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa81c09ad10 con 0x7fa81c09d6f0 2023-10-01T08:00:35.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.110+0000 7fa8037fe700 1 -- 172.21.15.26:0/2468525640 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa80c015030 con 0x7fa81c09d6f0 2023-10-01T08:00:35.111 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:35.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.112+0000 7fa821521700 1 -- 172.21.15.26:0/2468525640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa81c09d6f0 msgr2=0x7fa81c120310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:35.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.112+0000 7fa821521700 1 --2- 172.21.15.26:0/2468525640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa81c09d6f0 0x7fa81c120310 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fa80c000c00 tx=0x7fa80c004750 comp rx=0 tx=0).stop 2023-10-01T08:00:35.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.112+0000 7fa821521700 1 -- 172.21.15.26:0/2468525640 shutdown_connections 2023-10-01T08:00:35.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.112+0000 7fa821521700 1 --2- 172.21.15.26:0/2468525640 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa81c09e410 0x7fa81c120d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:35.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.112+0000 7fa821521700 1 --2- 172.21.15.26:0/2468525640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa81c09d6f0 0x7fa81c120310 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:35.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.112+0000 7fa821521700 1 --2- 172.21.15.26:0/2468525640 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa81c09e000 0x7fa81c120850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:35.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.112+0000 7fa821521700 1 -- 172.21.15.26:0/2468525640 >> 172.21.15.26:0/2468525640 conn(0x7fa81c066f50 msgr2=0x7fa81c06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:35.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.113+0000 7fa821521700 1 -- 172.21.15.26:0/2468525640 shutdown_connections 2023-10-01T08:00:35.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.113+0000 7fa821521700 1 -- 172.21.15.26:0/2468525640 wait complete. 2023-10-01T08:00:35.127 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:35.704 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:35.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.849+0000 7f43d076c700 1 Processor -- start 2023-10-01T08:00:35.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.849+0000 7f43d076c700 1 -- start start 2023-10-01T08:00:35.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.850+0000 7f43d076c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f43c809e1d0 0x7f43c8135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:35.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.850+0000 7f43d076c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43c8135e50 0x7f43c8138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:35.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.850+0000 7f43d076c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c809f130 con 0x7f43c809d6f0 2023-10-01T08:00:35.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.850+0000 7f43d076c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c809f520 con 0x7f43c8135e50 2023-10-01T08:00:35.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.850+0000 7f43d076c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43c809e930 con 0x7f43c809e1d0 2023-10-01T08:00:35.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.850+0000 7f43ce508700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f43c809d6f0 0x7f43c809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33806/0 (socket says 172.21.15.26:33806) 2023-10-01T08:00:35.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.850+0000 7f43ced09700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43c8135e50 0x7f43c8138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:35.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.850+0000 7f43ce508700 1 -- 172.21.15.26:0/3222236072 learned_addr learned my addr 172.21.15.26:0/3222236072 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:35.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.850+0000 7f43cdd07700 1 --2- 172.21.15.26:0/3222236072 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f43c809e1d0 0x7f43c8135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:35.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.851+0000 7f43cd506700 1 -- 172.21.15.26:0/3222236072 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1465244381 0 0) 0x7f43c809f130 con 0x7f43c809d6f0 2023-10-01T08:00:35.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.851+0000 7f43cd506700 1 -- 172.21.15.26:0/3222236072 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43b40035b0 con 0x7f43c809d6f0 2023-10-01T08:00:35.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.851+0000 7f43cdd07700 1 -- 172.21.15.26:0/3222236072 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43c8135e50 msgr2=0x7f43c8138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:35.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.851+0000 7f43cdd07700 1 --2- 172.21.15.26:0/3222236072 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43c8135e50 0x7f43c8138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:35.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.851+0000 7f43cdd07700 1 -- 172.21.15.26:0/3222236072 >> v1:172.21.15.26:6789/0 conn(0x7f43c809d6f0 legacy=0x7f43c809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:35.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.851+0000 7f43cdd07700 1 -- 172.21.15.26:0/3222236072 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c809b2d0 con 0x7f43c809e1d0 2023-10-01T08:00:35.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.851+0000 7f43ced09700 1 --2- 172.21.15.26:0/3222236072 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43c8135e50 0x7f43c8138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:35.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.851+0000 7f43cdd07700 1 --2- 172.21.15.26:0/3222236072 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f43c809e1d0 0x7f43c8135910 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f43b8009870 tx=0x7f43b8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa197219b0c0c38a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:35.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.851+0000 7f43cd506700 1 -- 172.21.15.26:0/3222236072 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b8011830 con 0x7f43c809e1d0 2023-10-01T08:00:35.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.851+0000 7f43cd506700 1 -- 172.21.15.26:0/3222236072 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b8011990 con 0x7f43c809e1d0 2023-10-01T08:00:35.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.851+0000 7f43cd506700 1 -- 172.21.15.26:0/3222236072 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b8011d20 con 0x7f43c809e1d0 2023-10-01T08:00:35.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.852+0000 7f43d076c700 1 -- 172.21.15.26:0/3222236072 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f43c809e1d0 msgr2=0x7f43c8135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:35.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.852+0000 7f43d076c700 1 --2- 172.21.15.26:0/3222236072 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f43c809e1d0 0x7f43c8135910 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f43b8009870 tx=0x7f43b8009b80 comp rx=0 tx=0).stop 2023-10-01T08:00:35.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.852+0000 7f43d076c700 1 -- 172.21.15.26:0/3222236072 shutdown_connections 2023-10-01T08:00:35.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.852+0000 7f43d076c700 1 --2- 172.21.15.26:0/3222236072 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43c8135e50 0x7f43c8138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:35.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.852+0000 7f43d076c700 1 --2- 172.21.15.26:0/3222236072 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f43c809e1d0 0x7f43c8135910 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:35.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.852+0000 7f43d076c700 1 -- 172.21.15.26:0/3222236072 >> 172.21.15.26:0/3222236072 conn(0x7f43c8066f50 msgr2=0x7f43c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:35.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.852+0000 7f43d076c700 1 -- 172.21.15.26:0/3222236072 shutdown_connections 2023-10-01T08:00:35.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.852+0000 7f43d076c700 1 -- 172.21.15.26:0/3222236072 wait complete. 2023-10-01T08:00:35.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.853+0000 7f43d076c700 1 Processor -- start 2023-10-01T08:00:35.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.853+0000 7f43d076c700 1 -- start start 2023-10-01T08:00:35.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.853+0000 7f43d076c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43c809d6f0 0x7f43c8120310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:35.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.853+0000 7f43d076c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f43c809e1d0 0x7f43c81c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:35.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.853+0000 7f43d076c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43c8135e50 0x7f43c81c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:35.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.853+0000 7f43d076c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c8122010 con 0x7f43c8135e50 2023-10-01T08:00:35.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.853+0000 7f43d076c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c8134020 con 0x7f43c809d6f0 2023-10-01T08:00:35.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.853+0000 7f43d076c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43c8122c10 con 0x7f43c809e1d0 2023-10-01T08:00:35.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.853+0000 7f43ce508700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43c809d6f0 0x7f43c8120310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:35.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.853+0000 7f43cdd07700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f43c809e1d0 0x7f43c81c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:35.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.853+0000 7f43ced09700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43c8135e50 0x7f43c81c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:35.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.853+0000 7f43cdd07700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f43c809e1d0 0x7f43c81c60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44454/0 (socket says 172.21.15.26:44454) 2023-10-01T08:00:35.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.853+0000 7f43cdd07700 1 -- 172.21.15.26:0/1704122282 learned_addr learned my addr 172.21.15.26:0/1704122282 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:35.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.854+0000 7f43ce508700 1 -- 172.21.15.26:0/1704122282 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f43c809e1d0 msgr2=0x7f43c81c60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:35.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.854+0000 7f43ce508700 1 --2- 172.21.15.26:0/1704122282 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f43c809e1d0 0x7f43c81c60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:35.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.854+0000 7f43ce508700 1 -- 172.21.15.26:0/1704122282 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43c8135e50 msgr2=0x7f43c81c6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:35.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.854+0000 7f43ce508700 1 --2- 172.21.15.26:0/1704122282 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43c8135e50 0x7f43c81c6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:35.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.854+0000 7f43ce508700 1 -- 172.21.15.26:0/1704122282 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c0009a70 con 0x7f43c809d6f0 2023-10-01T08:00:35.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.854+0000 7f43cdd07700 1 --2- 172.21.15.26:0/1704122282 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f43c809e1d0 0x7f43c81c60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:35.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.854+0000 7f43ced09700 1 --2- 172.21.15.26:0/1704122282 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43c8135e50 0x7f43c81c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:35.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.854+0000 7f43ce508700 1 --2- 172.21.15.26:0/1704122282 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43c809d6f0 0x7f43c8120310 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f43c400c430 tx=0x7f43c400c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:35.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.854+0000 7f43beffd700 1 -- 172.21.15.26:0/1704122282 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4005d70 con 0x7f43c809d6f0 2023-10-01T08:00:35.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.854+0000 7f43beffd700 1 -- 172.21.15.26:0/1704122282 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c40070d0 con 0x7f43c809d6f0 2023-10-01T08:00:35.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.854+0000 7f43d076c700 1 -- 172.21.15.26:0/1704122282 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b80094a0 con 0x7f43c809d6f0 2023-10-01T08:00:35.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.854+0000 7f43beffd700 1 -- 172.21.15.26:0/1704122282 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4007460 con 0x7f43c809d6f0 2023-10-01T08:00:35.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.854+0000 7f43d076c700 1 -- 172.21.15.26:0/1704122282 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c811fd00 con 0x7f43c809d6f0 2023-10-01T08:00:35.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.855+0000 7f43beffd700 1 -- 172.21.15.26:0/1704122282 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f43c40075c0 con 0x7f43c809d6f0 2023-10-01T08:00:35.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.855+0000 7f43beffd700 1 -- 172.21.15.26:0/1704122282 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f43c403e8e0 con 0x7f43c809d6f0 2023-10-01T08:00:35.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.855+0000 7f43d076c700 1 -- 172.21.15.26:0/1704122282 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c8074ea0 con 0x7f43c809d6f0 2023-10-01T08:00:35.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:35.860+0000 7f43beffd700 1 -- 172.21.15.26:0/1704122282 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f43c401bb10 con 0x7f43c809d6f0 2023-10-01T08:00:36.022 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:36.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.073+0000 7f43d076c700 1 -- 172.21.15.26:0/1704122282 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f43c8134410 con 0x7f43c809d6f0 2023-10-01T08:00:36.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.074+0000 7f43beffd700 1 -- 172.21.15.26:0/1704122282 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f43c4017020 con 0x7f43c809d6f0 2023-10-01T08:00:36.075 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:36.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.077+0000 7f43d076c700 1 -- 172.21.15.26:0/1704122282 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43c809d6f0 msgr2=0x7f43c8120310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:36.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.077+0000 7f43d076c700 1 --2- 172.21.15.26:0/1704122282 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43c809d6f0 0x7f43c8120310 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f43c400c430 tx=0x7f43c400c740 comp rx=0 tx=0).stop 2023-10-01T08:00:36.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.077+0000 7f43d076c700 1 -- 172.21.15.26:0/1704122282 shutdown_connections 2023-10-01T08:00:36.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.077+0000 7f43d076c700 1 --2- 172.21.15.26:0/1704122282 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43c8135e50 0x7f43c81c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:36.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.077+0000 7f43d076c700 1 --2- 172.21.15.26:0/1704122282 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43c809d6f0 0x7f43c8120310 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:36.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.077+0000 7f43d076c700 1 --2- 172.21.15.26:0/1704122282 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f43c809e1d0 0x7f43c81c60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:36.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.077+0000 7f43d076c700 1 -- 172.21.15.26:0/1704122282 >> 172.21.15.26:0/1704122282 conn(0x7f43c8066f50 msgr2=0x7f43c8134840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:36.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.077+0000 7f43d076c700 1 -- 172.21.15.26:0/1704122282 shutdown_connections 2023-10-01T08:00:36.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.077+0000 7f43d076c700 1 -- 172.21.15.26:0/1704122282 wait complete. 2023-10-01T08:00:36.092 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:36.098 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:36.128 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:36.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.170+0000 7f74461d6700 1 Processor -- start 2023-10-01T08:00:36.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.170+0000 7f74461d6700 1 -- start start 2023-10-01T08:00:36.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.170+0000 7f74461d6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f744009e1b0 0x7f7440138a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:36.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.170+0000 7f74461d6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7440138f50 0x7f744013b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:36.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.170+0000 7f74461d6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f744009a570 con 0x7f744009d6d0 2023-10-01T08:00:36.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.170+0000 7f74461d6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f744009e5a0 con 0x7f7440138f50 2023-10-01T08:00:36.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.170+0000 7f74461d6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f744009b1c0 con 0x7f744009e1b0 2023-10-01T08:00:36.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.170+0000 7f743ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7440138f50 0x7f744013b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:36.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.170+0000 7f743ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7440138f50 0x7f744013b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53244/0 (socket says 172.21.15.26:53244) 2023-10-01T08:00:36.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.170+0000 7f743effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f744009e1b0 0x7f7440138a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:36.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.170+0000 7f743ffff700 1 -- 172.21.15.26:0/255927693 learned_addr learned my addr 172.21.15.26:0/255927693 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:36.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.171+0000 7f743ffff700 1 -- 172.21.15.26:0/255927693 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f744009e1b0 msgr2=0x7f7440138a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:36.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.171+0000 7f743ffff700 1 --2- 172.21.15.26:0/255927693 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f744009e1b0 0x7f7440138a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:36.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.171+0000 7f743ffff700 1 -- 172.21.15.26:0/255927693 >> v1:172.21.15.26:6789/0 conn(0x7f744009d6d0 legacy=0x7f744009daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:36.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.171+0000 7f743ffff700 1 -- 172.21.15.26:0/255927693 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744009f240 con 0x7f7440138f50 2023-10-01T08:00:36.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.171+0000 7f743effd700 1 --2- 172.21.15.26:0/255927693 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f744009e1b0 0x7f7440138a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:36.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.171+0000 7f743ffff700 1 --2- 172.21.15.26:0/255927693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7440138f50 0x7f744013b330 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f7438009e50 tx=0x7f743800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a55f744ba7a510 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:36.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.171+0000 7f743e7fc700 1 -- 172.21.15.26:0/255927693 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743800e070 con 0x7f7440138f50 2023-10-01T08:00:36.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.171+0000 7f743e7fc700 1 -- 172.21.15.26:0/255927693 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743800b910 con 0x7f7440138f50 2023-10-01T08:00:36.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.171+0000 7f743e7fc700 1 -- 172.21.15.26:0/255927693 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743800bcc0 con 0x7f7440138f50 2023-10-01T08:00:36.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.172+0000 7f74461d6700 1 -- 172.21.15.26:0/255927693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7440138f50 msgr2=0x7f744013b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:36.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.172+0000 7f74461d6700 1 --2- 172.21.15.26:0/255927693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7440138f50 0x7f744013b330 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f7438009e50 tx=0x7f743800b330 comp rx=0 tx=0).stop 2023-10-01T08:00:36.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.172+0000 7f74461d6700 1 -- 172.21.15.26:0/255927693 shutdown_connections 2023-10-01T08:00:36.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.172+0000 7f74461d6700 1 --2- 172.21.15.26:0/255927693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7440138f50 0x7f744013b330 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:36.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.172+0000 7f74461d6700 1 --2- 172.21.15.26:0/255927693 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f744009e1b0 0x7f7440138a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:36.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.172+0000 7f74461d6700 1 -- 172.21.15.26:0/255927693 >> 172.21.15.26:0/255927693 conn(0x7f7440099c20 msgr2=0x7f74400a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:36.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.172+0000 7f74461d6700 1 -- 172.21.15.26:0/255927693 shutdown_connections 2023-10-01T08:00:36.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.172+0000 7f74461d6700 1 -- 172.21.15.26:0/255927693 wait complete. 2023-10-01T08:00:36.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.173+0000 7f74461d6700 1 Processor -- start 2023-10-01T08:00:36.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.174+0000 7f74461d6700 1 -- start start 2023-10-01T08:00:36.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.174+0000 7f74461d6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f744009d6d0 0x7f74401c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:36.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.174+0000 7f74461d6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f744009e1b0 0x7f74401c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:36.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.174+0000 7f74461d6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7440138f50 0x7f744011a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:36.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.174+0000 7f74461d6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74400a2820 con 0x7f744009d6d0 2023-10-01T08:00:36.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.174+0000 7f74461d6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f744011da90 con 0x7f7440138f50 2023-10-01T08:00:36.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.174+0000 7f74461d6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74401be0d0 con 0x7f744009e1b0 2023-10-01T08:00:36.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.174+0000 7f743ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7440138f50 0x7f744011a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:36.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.174+0000 7f743ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7440138f50 0x7f744011a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42380/0 (socket says 172.21.15.26:42380) 2023-10-01T08:00:36.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.174+0000 7f743ffff700 1 -- 172.21.15.26:0/798527468 learned_addr learned my addr 172.21.15.26:0/798527468 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:36.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.174+0000 7f743f7fe700 1 --2- 172.21.15.26:0/798527468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f744009d6d0 0x7f74401c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:36.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.175+0000 7f743effd700 1 --2- 172.21.15.26:0/798527468 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f744009e1b0 0x7f74401c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:36.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.175+0000 7f743ffff700 1 -- 172.21.15.26:0/798527468 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f744009e1b0 msgr2=0x7f74401c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:36.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.175+0000 7f743ffff700 1 --2- 172.21.15.26:0/798527468 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f744009e1b0 0x7f74401c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:36.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.175+0000 7f743ffff700 1 -- 172.21.15.26:0/798527468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f744009d6d0 msgr2=0x7f74401c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:36.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.175+0000 7f743ffff700 1 --2- 172.21.15.26:0/798527468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f744009d6d0 0x7f74401c84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:36.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.175+0000 7f743ffff700 1 -- 172.21.15.26:0/798527468 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74340094a0 con 0x7f7440138f50 2023-10-01T08:00:36.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.175+0000 7f743f7fe700 1 --2- 172.21.15.26:0/798527468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f744009d6d0 0x7f74401c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:36.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.175+0000 7f743ffff700 1 --2- 172.21.15.26:0/798527468 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7440138f50 0x7f744011a510 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f7438012000 tx=0x7f7438004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:36.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.175+0000 7f7427fff700 1 -- 172.21.15.26:0/798527468 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7438004800 con 0x7f7440138f50 2023-10-01T08:00:36.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.175+0000 7f7427fff700 1 -- 172.21.15.26:0/798527468 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7438004960 con 0x7f7440138f50 2023-10-01T08:00:36.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.175+0000 7f74461d6700 1 -- 172.21.15.26:0/798527468 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7438009b30 con 0x7f7440138f50 2023-10-01T08:00:36.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.175+0000 7f7427fff700 1 -- 172.21.15.26:0/798527468 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743801c680 con 0x7f7440138f50 2023-10-01T08:00:36.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.175+0000 7f74461d6700 1 -- 172.21.15.26:0/798527468 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f744009c900 con 0x7f7440138f50 2023-10-01T08:00:36.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.176+0000 7f7427fff700 1 -- 172.21.15.26:0/798527468 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f743801c7e0 con 0x7f7440138f50 2023-10-01T08:00:36.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.176+0000 7f7427fff700 1 -- 172.21.15.26:0/798527468 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7438041240 con 0x7f7440138f50 2023-10-01T08:00:36.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.177+0000 7f74461d6700 1 -- 172.21.15.26:0/798527468 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74401c8f90 con 0x7f7440138f50 2023-10-01T08:00:36.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.182+0000 7f7427fff700 1 -- 172.21.15.26:0/798527468 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f74380257d0 con 0x7f7440138f50 2023-10-01T08:00:36.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.240+0000 7f4b524c5700 1 Processor -- start 2023-10-01T08:00:36.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.240+0000 7f4b524c5700 1 -- start start 2023-10-01T08:00:36.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.240+0000 7f4b524c5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b4c09e930 0x7f4b4c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:36.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.240+0000 7f4b524c5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4b4c09f240 0x7f4b4c133be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:36.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.240+0000 7f4b524c5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b4c06c9f0 con 0x7f4b4c134120 2023-10-01T08:00:36.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.240+0000 7f4b524c5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b4c06c670 con 0x7f4b4c09f240 2023-10-01T08:00:36.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.240+0000 7f4b524c5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c06bc90 con 0x7f4b4c09e930 2023-10-01T08:00:36.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.240+0000 7f4b4b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4b4c09f240 0x7f4b4c133be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:36.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.240+0000 7f4b4bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b4c09e930 0x7f4b4c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:36.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.240+0000 7f4b4b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4b4c09f240 0x7f4b4c133be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53260/0 (socket says 172.21.15.26:53260) 2023-10-01T08:00:36.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.240+0000 7f4b4b7fe700 1 -- 172.21.15.26:0/2359906854 learned_addr learned my addr 172.21.15.26:0/2359906854 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:36.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.241+0000 7f4b4bfff700 1 -- 172.21.15.26:0/2359906854 >> v2:172.21.15.26:3300/0 conn(0x7f4b4c09f240 msgr2=0x7f4b4c133be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:36.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.241+0000 7f4b4bfff700 1 --2- 172.21.15.26:0/2359906854 >> v2:172.21.15.26:3300/0 conn(0x7f4b4c09f240 0x7f4b4c133be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:36.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.241+0000 7f4b4bfff700 1 -- 172.21.15.26:0/2359906854 >> v1:172.21.15.26:6789/0 conn(0x7f4b4c134120 legacy=0x7f4b4c13ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:36.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.241+0000 7f4b4bfff700 1 -- 172.21.15.26:0/2359906854 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4c06d860 con 0x7f4b4c09e930 2023-10-01T08:00:36.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.241+0000 7f4b4b7fe700 1 --2- 172.21.15.26:0/2359906854 >> v2:172.21.15.26:3300/0 conn(0x7f4b4c09f240 0x7f4b4c133be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:36.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.241+0000 7f4b4bfff700 1 --2- 172.21.15.26:0/2359906854 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b4c09e930 0x7f4b4c09ed00 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c009840 tx=0x7f4b3c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27bded68ad63c5c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:36.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.241+0000 7f4b4affd700 1 -- 172.21.15.26:0/2359906854 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c011830 con 0x7f4b4c09e930 2023-10-01T08:00:36.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.241+0000 7f4b4affd700 1 -- 172.21.15.26:0/2359906854 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b3c011990 con 0x7f4b4c09e930 2023-10-01T08:00:36.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.241+0000 7f4b4affd700 1 -- 172.21.15.26:0/2359906854 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c011d20 con 0x7f4b4c09e930 2023-10-01T08:00:36.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.242+0000 7f4b524c5700 1 -- 172.21.15.26:0/2359906854 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b4c09e930 msgr2=0x7f4b4c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:36.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.242+0000 7f4b524c5700 1 --2- 172.21.15.26:0/2359906854 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b4c09e930 0x7f4b4c09ed00 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c009840 tx=0x7f4b3c009b50 comp rx=0 tx=0).stop 2023-10-01T08:00:36.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.242+0000 7f4b524c5700 1 -- 172.21.15.26:0/2359906854 shutdown_connections 2023-10-01T08:00:36.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.242+0000 7f4b524c5700 1 --2- 172.21.15.26:0/2359906854 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b4c09e930 0x7f4b4c09ed00 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:36.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.242+0000 7f4b524c5700 1 --2- 172.21.15.26:0/2359906854 >> v2:172.21.15.26:3300/0 conn(0x7f4b4c09f240 0x7f4b4c133be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:36.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.242+0000 7f4b524c5700 1 -- 172.21.15.26:0/2359906854 >> 172.21.15.26:0/2359906854 conn(0x7f4b4c0a4210 msgr2=0x7f4b4c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:36.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.242+0000 7f4b524c5700 1 -- 172.21.15.26:0/2359906854 shutdown_connections 2023-10-01T08:00:36.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.242+0000 7f4b524c5700 1 -- 172.21.15.26:0/2359906854 wait complete. 2023-10-01T08:00:36.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.244+0000 7f4b524c5700 1 Processor -- start 2023-10-01T08:00:36.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.244+0000 7f4b524c5700 1 -- start start 2023-10-01T08:00:36.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.244+0000 7f4b524c5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b4c09e930 0x7f4b4c123520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:36.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.245+0000 7f4b524c5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4b4c09f240 0x7f4b4c123a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:36.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.245+0000 7f4b524c5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b4c134120 0x7f4b4c1c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:36.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.245+0000 7f4b524c5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c126210 con 0x7f4b4c09e930 2023-10-01T08:00:36.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.245+0000 7f4b524c5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c1250a0 con 0x7f4b4c09f240 2023-10-01T08:00:36.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.245+0000 7f4b524c5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c123130 con 0x7f4b4c134120 2023-10-01T08:00:36.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.245+0000 7f4b4bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b4c09e930 0x7f4b4c123520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:36.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.245+0000 7f4b4b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4b4c09f240 0x7f4b4c123a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:36.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.245+0000 7f4b50a62700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b4c134120 0x7f4b4c1c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:36.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.245+0000 7f4b4bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b4c09e930 0x7f4b4c123520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53268/0 (socket says 172.21.15.26:53268) 2023-10-01T08:00:36.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.245+0000 7f4b4bfff700 1 -- 172.21.15.26:0/977703559 learned_addr learned my addr 172.21.15.26:0/977703559 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:36.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.245+0000 7f4b4b7fe700 1 --2- 172.21.15.26:0/977703559 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4b4c09f240 0x7f4b4c123a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42394/0 (socket says 172.21.15.26:42394) 2023-10-01T08:00:36.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.245+0000 7f4b50a62700 1 -- 172.21.15.26:0/977703559 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4b4c09f240 msgr2=0x7f4b4c123a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:36.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.245+0000 7f4b50a62700 1 --2- 172.21.15.26:0/977703559 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4b4c09f240 0x7f4b4c123a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:36.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.245+0000 7f4b50a62700 1 -- 172.21.15.26:0/977703559 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b4c09e930 msgr2=0x7f4b4c123520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:36.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.245+0000 7f4b50a62700 1 --2- 172.21.15.26:0/977703559 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b4c09e930 0x7f4b4c123520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:36.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.245+0000 7f4b50a62700 1 -- 172.21.15.26:0/977703559 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b40009550 con 0x7f4b4c134120 2023-10-01T08:00:36.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.245+0000 7f4b4b7fe700 1 --2- 172.21.15.26:0/977703559 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4b4c09f240 0x7f4b4c123a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:36.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.245+0000 7f4b4bfff700 1 --2- 172.21.15.26:0/977703559 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b4c09e930 0x7f4b4c123520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:36.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.245+0000 7f4b50a62700 1 --2- 172.21.15.26:0/977703559 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b4c134120 0x7f4b4c1c8430 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f4b4400cb90 tx=0x7f4b4400cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:36.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.246+0000 7f4b48ff9700 1 -- 172.21.15.26:0/977703559 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b44003c00 con 0x7f4b4c134120 2023-10-01T08:00:36.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.246+0000 7f4b48ff9700 1 -- 172.21.15.26:0/977703559 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b44003d60 con 0x7f4b4c134120 2023-10-01T08:00:36.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.246+0000 7f4b48ff9700 1 -- 172.21.15.26:0/977703559 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4400aa80 con 0x7f4b4c134120 2023-10-01T08:00:36.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.246+0000 7f4b524c5700 1 -- 172.21.15.26:0/977703559 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b3c0094a0 con 0x7f4b4c134120 2023-10-01T08:00:36.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.246+0000 7f4b524c5700 1 -- 172.21.15.26:0/977703559 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b4c126490 con 0x7f4b4c134120 2023-10-01T08:00:36.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.247+0000 7f4b48ff9700 1 -- 172.21.15.26:0/977703559 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4b4400abe0 con 0x7f4b4c134120 2023-10-01T08:00:36.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.247+0000 7f4b524c5700 1 -- 172.21.15.26:0/977703559 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b4c126060 con 0x7f4b4c134120 2023-10-01T08:00:36.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.247+0000 7f4b48ff9700 1 -- 172.21.15.26:0/977703559 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4b4403f280 con 0x7f4b4c134120 2023-10-01T08:00:36.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.256+0000 7f4b48ff9700 1 -- 172.21.15.26:0/977703559 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b4401ad30 con 0x7f4b4c134120 2023-10-01T08:00:36.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.287+0000 7fbda3cf4700 1 Processor -- start 2023-10-01T08:00:36.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.287+0000 7fbda3cf4700 1 -- start start 2023-10-01T08:00:36.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.288+0000 7fbda3cf4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbd9c0a0a30 0x7fbd9c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:36.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.288+0000 7fbda3cf4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd9c09d630 0x7fbd9c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:36.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.288+0000 7fbda3cf4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd9c133930 0x7fbd9c133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:36.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.288+0000 7fbda3cf4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd9c0a2a70 con 0x7fbd9c0a0a30 2023-10-01T08:00:36.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.288+0000 7fbda3cf4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c0a01d0 con 0x7fbd9c09d630 2023-10-01T08:00:36.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.288+0000 7fbda3cf4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c09e2b0 con 0x7fbd9c133930 2023-10-01T08:00:36.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.288+0000 7fbda1a90700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbd9c0a0a30 0x7fbd9c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:36.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.288+0000 7fbda1a90700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbd9c0a0a30 0x7fbd9c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53272/0 (socket says 172.21.15.26:53272) 2023-10-01T08:00:36.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.288+0000 7fbda1a90700 1 -- 172.21.15.26:0/3390039670 learned_addr learned my addr 172.21.15.26:0/3390039670 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:36.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.288+0000 7fbda128f700 1 --2- 172.21.15.26:0/3390039670 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd9c09d630 0x7fbd9c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:36.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.288+0000 7fbda2291700 1 --2- 172.21.15.26:0/3390039670 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd9c133930 0x7fbd9c133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:36.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.289+0000 7fbda1a90700 1 -- 172.21.15.26:0/3390039670 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd9c133930 msgr2=0x7fbd9c133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:36.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.289+0000 7fbda1a90700 1 --2- 172.21.15.26:0/3390039670 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd9c133930 0x7fbd9c133db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:36.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.289+0000 7fbda1a90700 1 -- 172.21.15.26:0/3390039670 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd9c09d630 msgr2=0x7fbd9c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:36.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.289+0000 7fbda1a90700 1 --2- 172.21.15.26:0/3390039670 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd9c09d630 0x7fbd9c0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:36.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.289+0000 7fbda1a90700 1 -- 172.21.15.26:0/3390039670 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9c09dc50 con 0x7fbd9c0a0a30 2023-10-01T08:00:36.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.289+0000 7fbda128f700 1 --2- 172.21.15.26:0/3390039670 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd9c09d630 0x7fbd9c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:36.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.289+0000 7fbda1a90700 1 --2- 172.21.15.26:0/3390039670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd9c0a0a30 0x7fbd9c0a0e00 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fbd980098f0 tx=0x7fbd98009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b90d2e3a3c7a176b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:36.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.289+0000 7fbda0a8e700 1 -- 172.21.15.26:0/3390039670 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd98011830 con 0x7fbd9c0a0a30 2023-10-01T08:00:36.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.289+0000 7fbda0a8e700 1 -- 172.21.15.26:0/3390039670 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd98011990 con 0x7fbd9c0a0a30 2023-10-01T08:00:36.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.289+0000 7fbda0a8e700 1 -- 172.21.15.26:0/3390039670 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd98011d20 con 0x7fbd9c0a0a30 2023-10-01T08:00:36.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.290+0000 7fbda3cf4700 1 -- 172.21.15.26:0/3390039670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd9c0a0a30 msgr2=0x7fbd9c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:36.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.290+0000 7fbda3cf4700 1 --2- 172.21.15.26:0/3390039670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd9c0a0a30 0x7fbd9c0a0e00 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fbd980098f0 tx=0x7fbd98009c00 comp rx=0 tx=0).stop 2023-10-01T08:00:36.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.290+0000 7fbda3cf4700 1 -- 172.21.15.26:0/3390039670 shutdown_connections 2023-10-01T08:00:36.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.290+0000 7fbda3cf4700 1 --2- 172.21.15.26:0/3390039670 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd9c133930 0x7fbd9c133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:36.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.290+0000 7fbda3cf4700 1 --2- 172.21.15.26:0/3390039670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd9c0a0a30 0x7fbd9c0a0e00 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:36.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.290+0000 7fbda3cf4700 1 --2- 172.21.15.26:0/3390039670 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd9c09d630 0x7fbd9c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:36.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.290+0000 7fbda3cf4700 1 -- 172.21.15.26:0/3390039670 >> 172.21.15.26:0/3390039670 conn(0x7fbd9c0a3050 msgr2=0x7fbd9c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:36.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.290+0000 7fbda3cf4700 1 -- 172.21.15.26:0/3390039670 shutdown_connections 2023-10-01T08:00:36.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.290+0000 7fbda3cf4700 1 -- 172.21.15.26:0/3390039670 wait complete. 2023-10-01T08:00:36.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.291+0000 7fbda3cf4700 1 Processor -- start 2023-10-01T08:00:36.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.292+0000 7fbda3cf4700 1 -- start start 2023-10-01T08:00:36.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.292+0000 7fbda3cf4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd9c09d630 0x7fbd9c11f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:36.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.292+0000 7fbda3cf4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd9c0a0a30 0x7fbd9c11f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:36.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.292+0000 7fbda3cf4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd9c133930 0x7fbd9c1c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:36.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.292+0000 7fbda3cf4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c11edd0 con 0x7fbd9c0a0a30 2023-10-01T08:00:36.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.292+0000 7fbda3cf4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c11fd40 con 0x7fbd9c133930 2023-10-01T08:00:36.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.292+0000 7fbda3cf4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c121de0 con 0x7fbd9c09d630 2023-10-01T08:00:36.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.292+0000 7fbda128f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd9c0a0a30 0x7fbd9c11f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:36.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.292+0000 7fbda128f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd9c0a0a30 0x7fbd9c11f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53286/0 (socket says 172.21.15.26:53286) 2023-10-01T08:00:36.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.292+0000 7fbda128f700 1 -- 172.21.15.26:0/1225487709 learned_addr learned my addr 172.21.15.26:0/1225487709 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:36.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.292+0000 7fbda1a90700 1 --2- 172.21.15.26:0/1225487709 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd9c09d630 0x7fbd9c11f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:36.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.293+0000 7fbda2291700 1 --2- 172.21.15.26:0/1225487709 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd9c133930 0x7fbd9c1c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:36.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.293+0000 7fbda128f700 1 -- 172.21.15.26:0/1225487709 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd9c09d630 msgr2=0x7fbd9c11f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:36.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.293+0000 7fbda128f700 1 --2- 172.21.15.26:0/1225487709 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd9c09d630 0x7fbd9c11f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:36.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.293+0000 7fbda128f700 1 -- 172.21.15.26:0/1225487709 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd9c133930 msgr2=0x7fbd9c1c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:36.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.293+0000 7fbda128f700 1 --2- 172.21.15.26:0/1225487709 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd9c133930 0x7fbd9c1c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:36.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.293+0000 7fbda128f700 1 -- 172.21.15.26:0/1225487709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8c0094a0 con 0x7fbd9c0a0a30 2023-10-01T08:00:36.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.293+0000 7fbda2291700 1 --2- 172.21.15.26:0/1225487709 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd9c133930 0x7fbd9c1c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T08:00:36.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.293+0000 7fbda128f700 1 --2- 172.21.15.26:0/1225487709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd9c0a0a30 0x7fbd9c11f800 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c00ebe0 tx=0x7fbd8c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:36.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.293+0000 7fbd927fc700 1 -- 172.21.15.26:0/1225487709 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c009800 con 0x7fbd9c0a0a30 2023-10-01T08:00:36.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.293+0000 7fbd927fc700 1 -- 172.21.15.26:0/1225487709 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8c00c910 con 0x7fbd9c0a0a30 2023-10-01T08:00:36.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.293+0000 7fbda3cf4700 1 -- 172.21.15.26:0/1225487709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd98009550 con 0x7fbd9c0a0a30 2023-10-01T08:00:36.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.293+0000 7fbd927fc700 1 -- 172.21.15.26:0/1225487709 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c00cc80 con 0x7fbd9c0a0a30 2023-10-01T08:00:36.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.293+0000 7fbda3cf4700 1 -- 172.21.15.26:0/1225487709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd9c0a0410 con 0x7fbd9c0a0a30 2023-10-01T08:00:36.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.294+0000 7fbd927fc700 1 -- 172.21.15.26:0/1225487709 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbd8c013470 con 0x7fbd9c0a0a30 2023-10-01T08:00:36.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.294+0000 7fbd927fc700 1 -- 172.21.15.26:0/1225487709 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbd8c03f860 con 0x7fbd9c0a0a30 2023-10-01T08:00:36.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.294+0000 7fbda3cf4700 1 -- 172.21.15.26:0/1225487709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd9c1222c0 con 0x7fbd9c0a0a30 2023-10-01T08:00:36.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.299+0000 7fbd927fc700 1 -- 172.21.15.26:0/1225487709 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbd9c1222c0 con 0x7fbd9c0a0a30 2023-10-01T08:00:36.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.400+0000 7f74461d6700 1 -- 172.21.15.26:0/798527468 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f744011df70 con 0x7f7440138f50 2023-10-01T08:00:36.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.400+0000 7f7427fff700 1 -- 172.21.15.26:0/798527468 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7438034090 con 0x7f7440138f50 2023-10-01T08:00:36.401 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:36.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.402+0000 7f74461d6700 1 -- 172.21.15.26:0/798527468 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7440138f50 msgr2=0x7f744011a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:36.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.402+0000 7f74461d6700 1 --2- 172.21.15.26:0/798527468 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7440138f50 0x7f744011a510 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f7438012000 tx=0x7f7438004ad0 comp rx=0 tx=0).stop 2023-10-01T08:00:36.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.403+0000 7f74461d6700 1 -- 172.21.15.26:0/798527468 shutdown_connections 2023-10-01T08:00:36.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.403+0000 7f74461d6700 1 --2- 172.21.15.26:0/798527468 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7440138f50 0x7f744011a510 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:36.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.403+0000 7f74461d6700 1 --2- 172.21.15.26:0/798527468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f744009d6d0 0x7f74401c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:36.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.403+0000 7f74461d6700 1 --2- 172.21.15.26:0/798527468 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f744009e1b0 0x7f74401c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:36.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.403+0000 7f74461d6700 1 -- 172.21.15.26:0/798527468 >> 172.21.15.26:0/798527468 conn(0x7f7440099c20 msgr2=0x7f74400a29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:36.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.403+0000 7f74461d6700 1 -- 172.21.15.26:0/798527468 shutdown_connections 2023-10-01T08:00:36.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.403+0000 7f74461d6700 1 -- 172.21.15.26:0/798527468 wait complete. 2023-10-01T08:00:36.418 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:36.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.467+0000 7f4b524c5700 1 -- 172.21.15.26:0/977703559 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4b4c06c9f0 con 0x7f4b4c134120 2023-10-01T08:00:36.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.467+0000 7f4b48ff9700 1 -- 172.21.15.26:0/977703559 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4b4c06c9f0 con 0x7f4b4c134120 2023-10-01T08:00:36.468 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:36.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.470+0000 7f4b524c5700 1 -- 172.21.15.26:0/977703559 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b4c134120 msgr2=0x7f4b4c1c8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:36.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.470+0000 7f4b524c5700 1 --2- 172.21.15.26:0/977703559 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b4c134120 0x7f4b4c1c8430 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f4b4400cb90 tx=0x7f4b4400cea0 comp rx=0 tx=0).stop 2023-10-01T08:00:36.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.470+0000 7f4b524c5700 1 -- 172.21.15.26:0/977703559 shutdown_connections 2023-10-01T08:00:36.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.470+0000 7f4b524c5700 1 --2- 172.21.15.26:0/977703559 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4b4c134120 0x7f4b4c1c8430 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:36.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.470+0000 7f4b524c5700 1 --2- 172.21.15.26:0/977703559 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b4c09e930 0x7f4b4c123520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:36.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.470+0000 7f4b524c5700 1 --2- 172.21.15.26:0/977703559 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4b4c09f240 0x7f4b4c123a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:36.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.470+0000 7f4b524c5700 1 -- 172.21.15.26:0/977703559 >> 172.21.15.26:0/977703559 conn(0x7f4b4c0a4210 msgr2=0x7f4b4c09d440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:36.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.470+0000 7f4b524c5700 1 -- 172.21.15.26:0/977703559 shutdown_connections 2023-10-01T08:00:36.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.470+0000 7f4b524c5700 1 -- 172.21.15.26:0/977703559 wait complete. 2023-10-01T08:00:36.484 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:36.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.508+0000 7fbda3cf4700 1 -- 172.21.15.26:0/1225487709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbd9c1222c0 con 0x7fbd9c0a0a30 2023-10-01T08:00:36.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.509+0000 7fbd927fc700 1 -- 172.21.15.26:0/1225487709 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbd9c1222c0 con 0x7fbd9c0a0a30 2023-10-01T08:00:36.510 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:36.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.511+0000 7fbda3cf4700 1 -- 172.21.15.26:0/1225487709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd9c0a0a30 msgr2=0x7fbd9c11f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:36.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.511+0000 7fbda3cf4700 1 --2- 172.21.15.26:0/1225487709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd9c0a0a30 0x7fbd9c11f800 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c00ebe0 tx=0x7fbd8c00eef0 comp rx=0 tx=0).stop 2023-10-01T08:00:36.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.511+0000 7fbda3cf4700 1 -- 172.21.15.26:0/1225487709 shutdown_connections 2023-10-01T08:00:36.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.511+0000 7fbda3cf4700 1 --2- 172.21.15.26:0/1225487709 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd9c133930 0x7fbd9c1c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:36.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.511+0000 7fbda3cf4700 1 --2- 172.21.15.26:0/1225487709 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbd9c09d630 0x7fbd9c11f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:36.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.511+0000 7fbda3cf4700 1 --2- 172.21.15.26:0/1225487709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd9c0a0a30 0x7fbd9c11f800 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:36.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.511+0000 7fbda3cf4700 1 -- 172.21.15.26:0/1225487709 >> 172.21.15.26:0/1225487709 conn(0x7fbd9c0a3050 msgr2=0x7fbd9c1bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:36.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.511+0000 7fbda3cf4700 1 -- 172.21.15.26:0/1225487709 shutdown_connections 2023-10-01T08:00:36.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:36.511+0000 7fbda3cf4700 1 -- 172.21.15.26:0/1225487709 wait complete. 2023-10-01T08:00:36.525 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:37.094 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:37.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.239+0000 7fea63b11700 1 Processor -- start 2023-10-01T08:00:37.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.240+0000 7fea63b11700 1 -- start start 2023-10-01T08:00:37.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.240+0000 7fea63b11700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea5c09f410 0x7fea5c136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:37.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.240+0000 7fea63b11700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fea5c136fe0 0x7fea5c1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:37.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.240+0000 7fea63b11700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea5c070940 con 0x7fea5c09e930 2023-10-01T08:00:37.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.240+0000 7fea63b11700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea5c06fd60 con 0x7fea5c136fe0 2023-10-01T08:00:37.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.240+0000 7fea63b11700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c06fa80 con 0x7fea5c09f410 2023-10-01T08:00:37.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.240+0000 7fea620ae700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fea5c136fe0 0x7fea5c1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:37.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.240+0000 7fea610ac700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea5c09f410 0x7fea5c136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:37.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.240+0000 7fea620ae700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fea5c136fe0 0x7fea5c1393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53290/0 (socket says 172.21.15.26:53290) 2023-10-01T08:00:37.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.240+0000 7fea610ac700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea5c09f410 0x7fea5c136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42428/0 (socket says 172.21.15.26:42428) 2023-10-01T08:00:37.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.240+0000 7fea620ae700 1 -- 172.21.15.26:0/624877819 learned_addr learned my addr 172.21.15.26:0/624877819 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:37.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.241+0000 7fea620ae700 1 -- 172.21.15.26:0/624877819 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea5c09f410 msgr2=0x7fea5c136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:37.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.241+0000 7fea620ae700 1 --2- 172.21.15.26:0/624877819 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea5c09f410 0x7fea5c136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:37.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.241+0000 7fea620ae700 1 -- 172.21.15.26:0/624877819 >> v1:172.21.15.26:6789/0 conn(0x7fea5c09e930 legacy=0x7fea5c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:37.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.241+0000 7fea620ae700 1 -- 172.21.15.26:0/624877819 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c09fb60 con 0x7fea5c136fe0 2023-10-01T08:00:37.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.241+0000 7fea610ac700 1 --2- 172.21.15.26:0/624877819 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea5c09f410 0x7fea5c136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:37.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.241+0000 7fea620ae700 1 --2- 172.21.15.26:0/624877819 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea5c136fe0 0x7fea5c1393c0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fea54009e50 tx=0x7fea5400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb93f4ceef37098 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:37.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.241+0000 7fea608ab700 1 -- 172.21.15.26:0/624877819 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5400e070 con 0x7fea5c136fe0 2023-10-01T08:00:37.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.241+0000 7fea608ab700 1 -- 172.21.15.26:0/624877819 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5400b910 con 0x7fea5c136fe0 2023-10-01T08:00:37.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.241+0000 7fea608ab700 1 -- 172.21.15.26:0/624877819 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5400bcc0 con 0x7fea5c136fe0 2023-10-01T08:00:37.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.242+0000 7fea63b11700 1 -- 172.21.15.26:0/624877819 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea5c136fe0 msgr2=0x7fea5c1393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:37.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.242+0000 7fea63b11700 1 --2- 172.21.15.26:0/624877819 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea5c136fe0 0x7fea5c1393c0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fea54009e50 tx=0x7fea5400b330 comp rx=0 tx=0).stop 2023-10-01T08:00:37.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.242+0000 7fea63b11700 1 -- 172.21.15.26:0/624877819 shutdown_connections 2023-10-01T08:00:37.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.242+0000 7fea63b11700 1 --2- 172.21.15.26:0/624877819 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea5c136fe0 0x7fea5c1393c0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:37.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.242+0000 7fea63b11700 1 --2- 172.21.15.26:0/624877819 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea5c09f410 0x7fea5c136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:37.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.242+0000 7fea63b11700 1 -- 172.21.15.26:0/624877819 >> 172.21.15.26:0/624877819 conn(0x7fea5c0a4210 msgr2=0x7fea5c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:37.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.242+0000 7fea63b11700 1 -- 172.21.15.26:0/624877819 shutdown_connections 2023-10-01T08:00:37.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.242+0000 7fea63b11700 1 -- 172.21.15.26:0/624877819 wait complete. 2023-10-01T08:00:37.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.243+0000 7fea63b11700 1 Processor -- start 2023-10-01T08:00:37.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.243+0000 7fea63b11700 1 -- start start 2023-10-01T08:00:37.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.243+0000 7fea63b11700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fea5c09e930 0x7fea5c1c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:37.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.243+0000 7fea63b11700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea5c09f410 0x7fea5c1c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:37.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.243+0000 7fea63b11700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea5c136fe0 0x7fea5c1c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:37.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.243+0000 7fea63b11700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c136980 con 0x7fea5c136fe0 2023-10-01T08:00:37.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.243+0000 7fea63b11700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c06d780 con 0x7fea5c09f410 2023-10-01T08:00:37.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.243+0000 7fea63b11700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c126600 con 0x7fea5c09e930 2023-10-01T08:00:37.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.243+0000 7fea610ac700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea5c09f410 0x7fea5c1c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:37.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.243+0000 7fea620ae700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea5c136fe0 0x7fea5c1c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:37.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.243+0000 7fea618ad700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fea5c09e930 0x7fea5c1c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:37.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.243+0000 7fea610ac700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea5c09f410 0x7fea5c1c8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42434/0 (socket says 172.21.15.26:42434) 2023-10-01T08:00:37.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.243+0000 7fea620ae700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea5c136fe0 0x7fea5c1c8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53300/0 (socket says 172.21.15.26:53300) 2023-10-01T08:00:37.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.243+0000 7fea610ac700 1 -- 172.21.15.26:0/481879704 learned_addr learned my addr 172.21.15.26:0/481879704 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:37.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.243+0000 7fea618ad700 1 --2- 172.21.15.26:0/481879704 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fea5c09e930 0x7fea5c1c8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44504/0 (socket says 172.21.15.26:44504) 2023-10-01T08:00:37.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.244+0000 7fea610ac700 1 -- 172.21.15.26:0/481879704 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fea5c09e930 msgr2=0x7fea5c1c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:37.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.244+0000 7fea610ac700 1 --2- 172.21.15.26:0/481879704 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fea5c09e930 0x7fea5c1c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:37.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.244+0000 7fea610ac700 1 -- 172.21.15.26:0/481879704 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea5c136fe0 msgr2=0x7fea5c1c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:37.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.244+0000 7fea610ac700 1 --2- 172.21.15.26:0/481879704 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea5c136fe0 0x7fea5c1c8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:37.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.244+0000 7fea610ac700 1 -- 172.21.15.26:0/481879704 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4c0094a0 con 0x7fea5c09f410 2023-10-01T08:00:37.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.244+0000 7fea610ac700 1 --2- 172.21.15.26:0/481879704 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea5c09f410 0x7fea5c1c8940 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00ebe0 tx=0x7fea4c00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:37.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.244+0000 7fea527fc700 1 -- 172.21.15.26:0/481879704 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c00c850 con 0x7fea5c09f410 2023-10-01T08:00:37.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.244+0000 7fea527fc700 1 -- 172.21.15.26:0/481879704 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4c00c9b0 con 0x7fea5c09f410 2023-10-01T08:00:37.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.244+0000 7fea63b11700 1 -- 172.21.15.26:0/481879704 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea54009b30 con 0x7fea5c09f410 2023-10-01T08:00:37.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.244+0000 7fea527fc700 1 -- 172.21.15.26:0/481879704 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c00cd40 con 0x7fea5c09f410 2023-10-01T08:00:37.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.244+0000 7fea63b11700 1 -- 172.21.15.26:0/481879704 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea5c127070 con 0x7fea5c09f410 2023-10-01T08:00:37.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.245+0000 7fea527fc700 1 -- 172.21.15.26:0/481879704 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fea4c013470 con 0x7fea5c09f410 2023-10-01T08:00:37.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.245+0000 7fea63b11700 1 -- 172.21.15.26:0/481879704 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea5c074ea0 con 0x7fea5c09f410 2023-10-01T08:00:37.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.245+0000 7fea527fc700 1 -- 172.21.15.26:0/481879704 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fea4c03f8a0 con 0x7fea5c09f410 2023-10-01T08:00:37.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.250+0000 7fea527fc700 1 -- 172.21.15.26:0/481879704 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fea4c021020 con 0x7fea5c09f410 2023-10-01T08:00:37.418 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:37.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.459+0000 7fea63b11700 1 -- 172.21.15.26:0/481879704 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fea5c06d200 con 0x7fea5c09f410 2023-10-01T08:00:37.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.460+0000 7fea527fc700 1 -- 172.21.15.26:0/481879704 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fea4c00cea0 con 0x7fea5c09f410 2023-10-01T08:00:37.460 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:37.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.462+0000 7fea63b11700 1 -- 172.21.15.26:0/481879704 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea5c09f410 msgr2=0x7fea5c1c8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:37.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.462+0000 7fea63b11700 1 --2- 172.21.15.26:0/481879704 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea5c09f410 0x7fea5c1c8940 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00ebe0 tx=0x7fea4c00eef0 comp rx=0 tx=0).stop 2023-10-01T08:00:37.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.462+0000 7fea63b11700 1 -- 172.21.15.26:0/481879704 shutdown_connections 2023-10-01T08:00:37.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.462+0000 7fea63b11700 1 --2- 172.21.15.26:0/481879704 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea5c136fe0 0x7fea5c1c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:37.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.462+0000 7fea63b11700 1 --2- 172.21.15.26:0/481879704 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fea5c09e930 0x7fea5c1c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:37.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.462+0000 7fea63b11700 1 --2- 172.21.15.26:0/481879704 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fea5c09f410 0x7fea5c1c8940 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:37.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.462+0000 7fea63b11700 1 -- 172.21.15.26:0/481879704 >> 172.21.15.26:0/481879704 conn(0x7fea5c0a4210 msgr2=0x7fea5c0a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:37.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.462+0000 7fea63b11700 1 -- 172.21.15.26:0/481879704 shutdown_connections 2023-10-01T08:00:37.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.462+0000 7fea63b11700 1 -- 172.21.15.26:0/481879704 wait complete. 2023-10-01T08:00:37.476 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:37.485 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:37.526 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:37.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.557+0000 7f742101d700 1 Processor -- start 2023-10-01T08:00:37.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.557+0000 7f742101d700 1 -- start start 2023-10-01T08:00:37.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.557+0000 7f742101d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f741c1337f0 0x7f741c138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:37.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.557+0000 7f742101d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f741c138dc0 0x7f741c13b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:37.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.557+0000 7f742101d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f741c06b990 con 0x7f741c133420 2023-10-01T08:00:37.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.557+0000 7f742101d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f741c09b0e0 con 0x7f741c1337f0 2023-10-01T08:00:37.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.557+0000 7f742101d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f741c133c20 con 0x7f741c138dc0 2023-10-01T08:00:37.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.558+0000 7f741b59e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f741c138dc0 0x7f741c13b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:37.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.558+0000 7f741a59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f741c1337f0 0x7f741c138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:37.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.558+0000 7f741b59e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f741c138dc0 0x7f741c13b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44510/0 (socket says 172.21.15.26:44510) 2023-10-01T08:00:37.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.558+0000 7f741b59e700 1 -- 172.21.15.26:0/1178605506 learned_addr learned my addr 172.21.15.26:0/1178605506 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:37.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.558+0000 7f741b59e700 1 -- 172.21.15.26:0/1178605506 >> v2:172.21.15.26:3300/0 conn(0x7f741c1337f0 msgr2=0x7f741c138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:37.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.558+0000 7f741b59e700 1 --2- 172.21.15.26:0/1178605506 >> v2:172.21.15.26:3300/0 conn(0x7f741c1337f0 0x7f741c138880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:37.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.558+0000 7f741b59e700 1 -- 172.21.15.26:0/1178605506 >> v1:172.21.15.26:6789/0 conn(0x7f741c133420 legacy=0x7f741c133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:37.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.558+0000 7f741b59e700 1 -- 172.21.15.26:0/1178605506 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741c0a0590 con 0x7f741c138dc0 2023-10-01T08:00:37.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.558+0000 7f741a59c700 1 --2- 172.21.15.26:0/1178605506 >> v2:172.21.15.26:3300/0 conn(0x7f741c1337f0 0x7f741c138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:37.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.558+0000 7f741b59e700 1 --2- 172.21.15.26:0/1178605506 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f741c138dc0 0x7f741c13b1a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7414009e50 tx=0x7f741400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9d26f37e5c1a094 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:37.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.558+0000 7f7419d9b700 1 -- 172.21.15.26:0/1178605506 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741400e070 con 0x7f741c138dc0 2023-10-01T08:00:37.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.558+0000 7f7419d9b700 1 -- 172.21.15.26:0/1178605506 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f741400b910 con 0x7f741c138dc0 2023-10-01T08:00:37.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.559+0000 7f7419d9b700 1 -- 172.21.15.26:0/1178605506 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741400bcc0 con 0x7f741c138dc0 2023-10-01T08:00:37.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.559+0000 7f742101d700 1 -- 172.21.15.26:0/1178605506 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f741c138dc0 msgr2=0x7f741c13b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:37.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.559+0000 7f742101d700 1 --2- 172.21.15.26:0/1178605506 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f741c138dc0 0x7f741c13b1a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7414009e50 tx=0x7f741400b330 comp rx=0 tx=0).stop 2023-10-01T08:00:37.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.559+0000 7f742101d700 1 -- 172.21.15.26:0/1178605506 shutdown_connections 2023-10-01T08:00:37.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.559+0000 7f742101d700 1 --2- 172.21.15.26:0/1178605506 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f741c138dc0 0x7f741c13b1a0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:37.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.559+0000 7f742101d700 1 --2- 172.21.15.26:0/1178605506 >> v2:172.21.15.26:3300/0 conn(0x7f741c1337f0 0x7f741c138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:37.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.559+0000 7f742101d700 1 -- 172.21.15.26:0/1178605506 >> 172.21.15.26:0/1178605506 conn(0x7f741c0a4210 msgr2=0x7f741c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:37.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.559+0000 7f742101d700 1 -- 172.21.15.26:0/1178605506 shutdown_connections 2023-10-01T08:00:37.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.559+0000 7f742101d700 1 -- 172.21.15.26:0/1178605506 wait complete. 2023-10-01T08:00:37.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.561+0000 7f742101d700 1 Processor -- start 2023-10-01T08:00:37.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.561+0000 7f742101d700 1 -- start start 2023-10-01T08:00:37.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.561+0000 7f742101d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f741c133420 0x7f741c0709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:37.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.561+0000 7f742101d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f741c1337f0 0x7f741c070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:37.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.561+0000 7f742101d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f741c138dc0 0x7f741c071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:37.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.561+0000 7f742101d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c09bde0 con 0x7f741c138dc0 2023-10-01T08:00:37.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.561+0000 7f742101d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741c09d900 con 0x7f741c1337f0 2023-10-01T08:00:37.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.561+0000 7f742101d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f741c09c600 con 0x7f741c133420 2023-10-01T08:00:37.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.561+0000 7f741a59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f741c1337f0 0x7f741c070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:37.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.561+0000 7f741ad9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f741c133420 0x7f741c0709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:37.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.562+0000 7f741a59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f741c1337f0 0x7f741c070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42442/0 (socket says 172.21.15.26:42442) 2023-10-01T08:00:37.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.562+0000 7f741a59c700 1 -- 172.21.15.26:0/1793479995 learned_addr learned my addr 172.21.15.26:0/1793479995 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:37.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.562+0000 7f741b59e700 1 --2- 172.21.15.26:0/1793479995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f741c138dc0 0x7f741c071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:37.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.562+0000 7f741ad9d700 1 -- 172.21.15.26:0/1793479995 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f741c1337f0 msgr2=0x7f741c070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:37.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.562+0000 7f741ad9d700 1 --2- 172.21.15.26:0/1793479995 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f741c1337f0 0x7f741c070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:37.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.562+0000 7f741ad9d700 1 -- 172.21.15.26:0/1793479995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f741c138dc0 msgr2=0x7f741c071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:37.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.562+0000 7f741ad9d700 1 --2- 172.21.15.26:0/1793479995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f741c138dc0 0x7f741c071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:37.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.562+0000 7f741ad9d700 1 -- 172.21.15.26:0/1793479995 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74100094a0 con 0x7f741c133420 2023-10-01T08:00:37.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.562+0000 7f741a59c700 1 --2- 172.21.15.26:0/1793479995 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f741c1337f0 0x7f741c070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:37.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.562+0000 7f741ad9d700 1 --2- 172.21.15.26:0/1793479995 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f741c133420 0x7f741c0709a0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f740c000f60 tx=0x7f740c00c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:37.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.562+0000 7f74037fe700 1 -- 172.21.15.26:0/1793479995 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c0052d0 con 0x7f741c133420 2023-10-01T08:00:37.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.562+0000 7f74037fe700 1 -- 172.21.15.26:0/1793479995 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740c005430 con 0x7f741c133420 2023-10-01T08:00:37.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.562+0000 7f742101d700 1 -- 172.21.15.26:0/1793479995 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7414009b30 con 0x7f741c133420 2023-10-01T08:00:37.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.562+0000 7f74037fe700 1 -- 172.21.15.26:0/1793479995 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c0038a0 con 0x7f741c133420 2023-10-01T08:00:37.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.563+0000 7f742101d700 1 -- 172.21.15.26:0/1793479995 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741c09cc30 con 0x7f741c133420 2023-10-01T08:00:37.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.563+0000 7f74037fe700 1 -- 172.21.15.26:0/1793479995 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f740c003a00 con 0x7f741c133420 2023-10-01T08:00:37.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.564+0000 7f74037fe700 1 -- 172.21.15.26:0/1793479995 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f740c03ead0 con 0x7f741c133420 2023-10-01T08:00:37.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.564+0000 7f742101d700 1 -- 172.21.15.26:0/1793479995 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f741c074ea0 con 0x7f741c133420 2023-10-01T08:00:37.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.569+0000 7f74037fe700 1 -- 172.21.15.26:0/1793479995 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f740c017030 con 0x7f741c133420 2023-10-01T08:00:37.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.658+0000 7f4bc0aea700 1 Processor -- start 2023-10-01T08:00:37.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.658+0000 7f4bc0aea700 1 -- start start 2023-10-01T08:00:37.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.659+0000 7f4bc0aea700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4bbc09e930 0x7f4bbc09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:37.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.659+0000 7f4bc0aea700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bbc09f240 0x7f4bbc133be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:37.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.659+0000 7f4bc0aea700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bbc06c9f0 con 0x7f4bbc134120 2023-10-01T08:00:37.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.659+0000 7f4bc0aea700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bbc06c670 con 0x7f4bbc09e930 2023-10-01T08:00:37.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.659+0000 7f4bc0aea700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc06bc90 con 0x7f4bbc09f240 2023-10-01T08:00:37.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.659+0000 7f4bb9d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bbc09f240 0x7f4bbc133be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:37.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.659+0000 7f4bb9d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bbc09f240 0x7f4bbc133be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44530/0 (socket says 172.21.15.26:44530) 2023-10-01T08:00:37.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.659+0000 7f4bb9d9b700 1 -- 172.21.15.26:0/708844652 learned_addr learned my addr 172.21.15.26:0/708844652 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:37.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.659+0000 7f4bba59c700 1 --2- 172.21.15.26:0/708844652 >> v2:172.21.15.26:3300/0 conn(0x7f4bbc09e930 0x7f4bbc09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:37.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.660+0000 7f4bb9d9b700 1 -- 172.21.15.26:0/708844652 >> v2:172.21.15.26:3300/0 conn(0x7f4bbc09e930 msgr2=0x7f4bbc09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:37.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.660+0000 7f4bb9d9b700 1 --2- 172.21.15.26:0/708844652 >> v2:172.21.15.26:3300/0 conn(0x7f4bbc09e930 0x7f4bbc09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:37.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.660+0000 7f4bb9d9b700 1 -- 172.21.15.26:0/708844652 >> v1:172.21.15.26:6789/0 conn(0x7f4bbc134120 legacy=0x7f4bbc13ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:37.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.660+0000 7f4bb9d9b700 1 -- 172.21.15.26:0/708844652 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bbc06d860 con 0x7f4bbc09f240 2023-10-01T08:00:37.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.660+0000 7f4bb9d9b700 1 --2- 172.21.15.26:0/708844652 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bbc09f240 0x7f4bbc133be0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f4bb00098f0 tx=0x7f4bb0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9389035342511384 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:37.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.660+0000 7f4bb959a700 1 -- 172.21.15.26:0/708844652 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0011830 con 0x7f4bbc09f240 2023-10-01T08:00:37.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.660+0000 7f4bb959a700 1 -- 172.21.15.26:0/708844652 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb0011990 con 0x7f4bbc09f240 2023-10-01T08:00:37.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.660+0000 7f4bb959a700 1 -- 172.21.15.26:0/708844652 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0011d20 con 0x7f4bbc09f240 2023-10-01T08:00:37.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.661+0000 7f4bc0aea700 1 -- 172.21.15.26:0/708844652 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bbc09f240 msgr2=0x7f4bbc133be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:37.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.661+0000 7f4bc0aea700 1 --2- 172.21.15.26:0/708844652 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bbc09f240 0x7f4bbc133be0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f4bb00098f0 tx=0x7f4bb0009c00 comp rx=0 tx=0).stop 2023-10-01T08:00:37.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.661+0000 7f4bc0aea700 1 -- 172.21.15.26:0/708844652 shutdown_connections 2023-10-01T08:00:37.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.661+0000 7f4bc0aea700 1 --2- 172.21.15.26:0/708844652 >> v2:172.21.15.26:3300/0 conn(0x7f4bbc09e930 0x7f4bbc09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:37.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.661+0000 7f4bc0aea700 1 --2- 172.21.15.26:0/708844652 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bbc09f240 0x7f4bbc133be0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:37.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.661+0000 7f4bc0aea700 1 -- 172.21.15.26:0/708844652 >> 172.21.15.26:0/708844652 conn(0x7f4bbc0a4210 msgr2=0x7f4bbc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:37.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.661+0000 7f4bc0aea700 1 -- 172.21.15.26:0/708844652 shutdown_connections 2023-10-01T08:00:37.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.661+0000 7f4bc0aea700 1 -- 172.21.15.26:0/708844652 wait complete. 2023-10-01T08:00:37.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.662+0000 7f4bc0aea700 1 Processor -- start 2023-10-01T08:00:37.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.662+0000 7f4bc0aea700 1 -- start start 2023-10-01T08:00:37.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.662+0000 7f4bc0aea700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bbc09e930 0x7f4bbc1c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:37.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.663+0000 7f4bc0aea700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4bbc09f240 0x7f4bbc1c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:37.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.663+0000 7f4bc0aea700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bbc134120 0x7f4bbc1c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:37.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.663+0000 7f4bc0aea700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc124990 con 0x7f4bbc134120 2023-10-01T08:00:37.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.663+0000 7f4bc0aea700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc1247a0 con 0x7f4bbc09f240 2023-10-01T08:00:37.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.663+0000 7f4bc0aea700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc125070 con 0x7f4bbc09e930 2023-10-01T08:00:37.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.663+0000 7f4bb9d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4bbc09f240 0x7f4bbc1c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:37.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.663+0000 7f4bba59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bbc09e930 0x7f4bbc1c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:37.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.663+0000 7f4bb9d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4bbc09f240 0x7f4bbc1c8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42450/0 (socket says 172.21.15.26:42450) 2023-10-01T08:00:37.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.663+0000 7f4bb9d9b700 1 -- 172.21.15.26:0/2324031917 learned_addr learned my addr 172.21.15.26:0/2324031917 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:37.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.663+0000 7f4bba59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bbc09e930 0x7f4bbc1c83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44542/0 (socket says 172.21.15.26:44542) 2023-10-01T08:00:37.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.663+0000 7f4bbad9d700 1 --2- 172.21.15.26:0/2324031917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bbc134120 0x7f4bbc1c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:37.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.663+0000 7f4bba59c700 1 -- 172.21.15.26:0/2324031917 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4bbc09f240 msgr2=0x7f4bbc1c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:37.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.663+0000 7f4bba59c700 1 --2- 172.21.15.26:0/2324031917 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4bbc09f240 0x7f4bbc1c8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:37.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.663+0000 7f4bba59c700 1 -- 172.21.15.26:0/2324031917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bbc134120 msgr2=0x7f4bbc1c8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:37.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.663+0000 7f4bba59c700 1 --2- 172.21.15.26:0/2324031917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bbc134120 0x7f4bbc1c8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:37.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.663+0000 7f4bba59c700 1 -- 172.21.15.26:0/2324031917 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb0009550 con 0x7f4bbc09e930 2023-10-01T08:00:37.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.663+0000 7f4bba59c700 1 --2- 172.21.15.26:0/2324031917 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bbc09e930 0x7f4bbc1c83c0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00e900 tx=0x7f4bac00ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:37.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.663+0000 7f4baaffd700 1 -- 172.21.15.26:0/2324031917 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac013680 con 0x7f4bbc09e930 2023-10-01T08:00:37.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.664+0000 7f4baaffd700 1 -- 172.21.15.26:0/2324031917 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bac0137e0 con 0x7f4bbc09e930 2023-10-01T08:00:37.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.664+0000 7f4bc0aea700 1 -- 172.21.15.26:0/2324031917 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bbc124d50 con 0x7f4bbc09e930 2023-10-01T08:00:37.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.664+0000 7f4baaffd700 1 -- 172.21.15.26:0/2324031917 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac013b50 con 0x7f4bbc09e930 2023-10-01T08:00:37.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.664+0000 7f4bc0aea700 1 -- 172.21.15.26:0/2324031917 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bbc1263d0 con 0x7f4bbc09e930 2023-10-01T08:00:37.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.664+0000 7f4baaffd700 1 -- 172.21.15.26:0/2324031917 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4bac013cb0 con 0x7f4bbc09e930 2023-10-01T08:00:37.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.665+0000 7f4baaffd700 1 -- 172.21.15.26:0/2324031917 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4bac03f910 con 0x7f4bbc09e930 2023-10-01T08:00:37.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.665+0000 7f4bc0aea700 1 -- 172.21.15.26:0/2324031917 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bbc074ea0 con 0x7f4bbc09e930 2023-10-01T08:00:37.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.674+0000 7f4baaffd700 1 -- 172.21.15.26:0/2324031917 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4bac017080 con 0x7f4bbc09e930 2023-10-01T08:00:37.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.701+0000 7f1100756700 1 Processor -- start 2023-10-01T08:00:37.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.701+0000 7f1100756700 1 -- start start 2023-10-01T08:00:37.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.702+0000 7f1100756700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f10f8136820 0x7f10f8138c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:37.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.702+0000 7f1100756700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10f8139140 0x7f10f813b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:37.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.702+0000 7f1100756700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f806bc00 con 0x7f10f8133a80 2023-10-01T08:00:37.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.702+0000 7f1100756700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f806c570 con 0x7f10f8136820 2023-10-01T08:00:37.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.702+0000 7f1100756700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f80a0040 con 0x7f10f8139140 2023-10-01T08:00:37.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.702+0000 7f10fecf3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10f8139140 0x7f10f813b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:37.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.702+0000 7f10fdcf1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f10f8136820 0x7f10f8138c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:37.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.702+0000 7f10fecf3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10f8139140 0x7f10f813b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42462/0 (socket says 172.21.15.26:42462) 2023-10-01T08:00:37.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.702+0000 7f10fecf3700 1 -- 172.21.15.26:0/1154862743 learned_addr learned my addr 172.21.15.26:0/1154862743 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:37.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.702+0000 7f10fdcf1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f10f8136820 0x7f10f8138c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53338/0 (socket says 172.21.15.26:53338) 2023-10-01T08:00:37.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.703+0000 7f10fecf3700 1 -- 172.21.15.26:0/1154862743 >> v2:172.21.15.26:3300/0 conn(0x7f10f8136820 msgr2=0x7f10f8138c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:37.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.703+0000 7f10fecf3700 1 --2- 172.21.15.26:0/1154862743 >> v2:172.21.15.26:3300/0 conn(0x7f10f8136820 0x7f10f8138c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:37.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.703+0000 7f10fecf3700 1 -- 172.21.15.26:0/1154862743 >> v1:172.21.15.26:6789/0 conn(0x7f10f8133a80 legacy=0x7f10f8133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:37.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.703+0000 7f10fecf3700 1 -- 172.21.15.26:0/1154862743 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f8133860 con 0x7f10f8139140 2023-10-01T08:00:37.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.703+0000 7f10fd4f0700 1 -- 172.21.15.26:0/1154862743 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3626602553 0 0) 0x7f10f806bc00 con 0x7f10f8133a80 2023-10-01T08:00:37.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.703+0000 7f10fdcf1700 1 --2- 172.21.15.26:0/1154862743 >> v2:172.21.15.26:3300/0 conn(0x7f10f8136820 0x7f10f8138c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:37.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.703+0000 7f10fecf3700 1 --2- 172.21.15.26:0/1154862743 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10f8139140 0x7f10f813b520 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f10f0009e50 tx=0x7f10f000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc91e16c28887d7b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:37.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.703+0000 7f10fd4f0700 1 -- 172.21.15.26:0/1154862743 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f000e070 con 0x7f10f8139140 2023-10-01T08:00:37.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.703+0000 7f10fd4f0700 1 -- 172.21.15.26:0/1154862743 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f000b910 con 0x7f10f8139140 2023-10-01T08:00:37.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.703+0000 7f10fd4f0700 1 -- 172.21.15.26:0/1154862743 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f000bc80 con 0x7f10f8139140 2023-10-01T08:00:37.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.704+0000 7f1100756700 1 -- 172.21.15.26:0/1154862743 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10f8139140 msgr2=0x7f10f813b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:37.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.704+0000 7f1100756700 1 --2- 172.21.15.26:0/1154862743 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10f8139140 0x7f10f813b520 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f10f0009e50 tx=0x7f10f000b330 comp rx=0 tx=0).stop 2023-10-01T08:00:37.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.704+0000 7f1100756700 1 -- 172.21.15.26:0/1154862743 shutdown_connections 2023-10-01T08:00:37.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.704+0000 7f1100756700 1 --2- 172.21.15.26:0/1154862743 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10f8139140 0x7f10f813b520 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:37.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.704+0000 7f1100756700 1 --2- 172.21.15.26:0/1154862743 >> v2:172.21.15.26:3300/0 conn(0x7f10f8136820 0x7f10f8138c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:37.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.704+0000 7f1100756700 1 -- 172.21.15.26:0/1154862743 >> 172.21.15.26:0/1154862743 conn(0x7f10f80a4210 msgr2=0x7f10f80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:37.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.704+0000 7f1100756700 1 -- 172.21.15.26:0/1154862743 shutdown_connections 2023-10-01T08:00:37.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.704+0000 7f1100756700 1 -- 172.21.15.26:0/1154862743 wait complete. 2023-10-01T08:00:37.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.705+0000 7f1100756700 1 Processor -- start 2023-10-01T08:00:37.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.706+0000 7f1100756700 1 -- start start 2023-10-01T08:00:37.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.706+0000 7f1100756700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f10f8133a80 0x7f10f812cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:37.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.706+0000 7f1100756700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10f8136820 0x7f10f812d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:37.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.706+0000 7f1100756700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10f8139140 0x7f10f812d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:37.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.706+0000 7f1100756700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f812e790 con 0x7f10f8136820 2023-10-01T08:00:37.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.706+0000 7f1100756700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f809dd40 con 0x7f10f8139140 2023-10-01T08:00:37.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.706+0000 7f1100756700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10f809e000 con 0x7f10f8133a80 2023-10-01T08:00:37.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.706+0000 7f10fdcf1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10f8136820 0x7f10f812d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:37.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.706+0000 7f10fdcf1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10f8136820 0x7f10f812d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53354/0 (socket says 172.21.15.26:53354) 2023-10-01T08:00:37.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.706+0000 7f10fecf3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10f8139140 0x7f10f812d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:37.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.706+0000 7f10fdcf1700 1 -- 172.21.15.26:0/1961218899 learned_addr learned my addr 172.21.15.26:0/1961218899 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:37.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.707+0000 7f10fe4f2700 1 --2- 172.21.15.26:0/1961218899 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f10f8133a80 0x7f10f812cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:37.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.707+0000 7f10fdcf1700 1 -- 172.21.15.26:0/1961218899 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f10f8133a80 msgr2=0x7f10f812cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:37.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.707+0000 7f10fdcf1700 1 --2- 172.21.15.26:0/1961218899 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f10f8133a80 0x7f10f812cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:37.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.707+0000 7f10fdcf1700 1 -- 172.21.15.26:0/1961218899 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10f8139140 msgr2=0x7f10f812d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:37.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.707+0000 7f10fdcf1700 1 --2- 172.21.15.26:0/1961218899 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10f8139140 0x7f10f812d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:37.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.707+0000 7f10fdcf1700 1 -- 172.21.15.26:0/1961218899 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e80094a0 con 0x7f10f8136820 2023-10-01T08:00:37.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.707+0000 7f10fecf3700 1 --2- 172.21.15.26:0/1961218899 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10f8139140 0x7f10f812d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:37.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.707+0000 7f10fdcf1700 1 --2- 172.21.15.26:0/1961218899 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10f8136820 0x7f10f812d2b0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f10e800ebe0 tx=0x7f10e800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:37.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.707+0000 7f10eeffd700 1 -- 172.21.15.26:0/1961218899 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e80097a0 con 0x7f10f8136820 2023-10-01T08:00:37.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.707+0000 7f10eeffd700 1 -- 172.21.15.26:0/1961218899 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e800c850 con 0x7f10f8136820 2023-10-01T08:00:37.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.707+0000 7f1100756700 1 -- 172.21.15.26:0/1961218899 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f0009b30 con 0x7f10f8136820 2023-10-01T08:00:37.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.707+0000 7f10eeffd700 1 -- 172.21.15.26:0/1961218899 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e800cbe0 con 0x7f10f8136820 2023-10-01T08:00:37.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.707+0000 7f1100756700 1 -- 172.21.15.26:0/1961218899 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f8072100 con 0x7f10f8136820 2023-10-01T08:00:37.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.708+0000 7f1100756700 1 -- 172.21.15.26:0/1961218899 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f8138c40 con 0x7f10f8136820 2023-10-01T08:00:37.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.709+0000 7f10eeffd700 1 -- 172.21.15.26:0/1961218899 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f10e800cd40 con 0x7f10f8136820 2023-10-01T08:00:37.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.709+0000 7f10eeffd700 1 -- 172.21.15.26:0/1961218899 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f10e803f820 con 0x7f10f8136820 2023-10-01T08:00:37.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.714+0000 7f10eeffd700 1 -- 172.21.15.26:0/1961218899 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f10e801be10 con 0x7f10f8136820 2023-10-01T08:00:37.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.780+0000 7f742101d700 1 -- 172.21.15.26:0/1793479995 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f741c0a0000 con 0x7f741c133420 2023-10-01T08:00:37.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.780+0000 7f74037fe700 1 -- 172.21.15.26:0/1793479995 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f740c019d20 con 0x7f741c133420 2023-10-01T08:00:37.781 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:37.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.782+0000 7f742101d700 1 -- 172.21.15.26:0/1793479995 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f741c133420 msgr2=0x7f741c0709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:37.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.782+0000 7f742101d700 1 --2- 172.21.15.26:0/1793479995 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f741c133420 0x7f741c0709a0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f740c000f60 tx=0x7f740c00c730 comp rx=0 tx=0).stop 2023-10-01T08:00:37.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.782+0000 7f742101d700 1 -- 172.21.15.26:0/1793479995 shutdown_connections 2023-10-01T08:00:37.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.782+0000 7f742101d700 1 --2- 172.21.15.26:0/1793479995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f741c138dc0 0x7f741c071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:37.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.782+0000 7f742101d700 1 --2- 172.21.15.26:0/1793479995 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f741c133420 0x7f741c0709a0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:37.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.782+0000 7f742101d700 1 --2- 172.21.15.26:0/1793479995 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f741c1337f0 0x7f741c070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:37.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.782+0000 7f742101d700 1 -- 172.21.15.26:0/1793479995 >> 172.21.15.26:0/1793479995 conn(0x7f741c0a4210 msgr2=0x7f741c131400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:37.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.782+0000 7f742101d700 1 -- 172.21.15.26:0/1793479995 shutdown_connections 2023-10-01T08:00:37.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.783+0000 7f742101d700 1 -- 172.21.15.26:0/1793479995 wait complete. 2023-10-01T08:00:37.797 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:37.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.882+0000 7f4bc0aea700 1 -- 172.21.15.26:0/2324031917 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4bbc06b8f0 con 0x7f4bbc09e930 2023-10-01T08:00:37.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.883+0000 7f4baaffd700 1 -- 172.21.15.26:0/2324031917 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4bac01b590 con 0x7f4bbc09e930 2023-10-01T08:00:37.884 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:37.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.885+0000 7f4bc0aea700 1 -- 172.21.15.26:0/2324031917 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bbc09e930 msgr2=0x7f4bbc1c83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:37.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.885+0000 7f4bc0aea700 1 --2- 172.21.15.26:0/2324031917 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bbc09e930 0x7f4bbc1c83c0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00e900 tx=0x7f4bac00ec10 comp rx=0 tx=0).stop 2023-10-01T08:00:37.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.885+0000 7f4bc0aea700 1 -- 172.21.15.26:0/2324031917 shutdown_connections 2023-10-01T08:00:37.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.885+0000 7f4bc0aea700 1 --2- 172.21.15.26:0/2324031917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bbc134120 0x7f4bbc1c8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:37.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.885+0000 7f4bc0aea700 1 --2- 172.21.15.26:0/2324031917 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bbc09e930 0x7f4bbc1c83c0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:37.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.885+0000 7f4bc0aea700 1 --2- 172.21.15.26:0/2324031917 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4bbc09f240 0x7f4bbc1c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:37.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.885+0000 7f4bc0aea700 1 -- 172.21.15.26:0/2324031917 >> 172.21.15.26:0/2324031917 conn(0x7f4bbc0a4210 msgr2=0x7f4bbc071960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:37.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.885+0000 7f4bc0aea700 1 -- 172.21.15.26:0/2324031917 shutdown_connections 2023-10-01T08:00:37.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.885+0000 7f4bc0aea700 1 -- 172.21.15.26:0/2324031917 wait complete. 2023-10-01T08:00:37.899 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:37.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.918+0000 7f1100756700 1 -- 172.21.15.26:0/1961218899 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f10f8074ea0 con 0x7f10f8136820 2023-10-01T08:00:37.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.919+0000 7f10eeffd700 1 -- 172.21.15.26:0/1961218899 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f10e8021070 con 0x7f10f8136820 2023-10-01T08:00:37.919 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.921+0000 7f1100756700 1 -- 172.21.15.26:0/1961218899 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10f8136820 msgr2=0x7f10f812d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.921+0000 7f1100756700 1 --2- 172.21.15.26:0/1961218899 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10f8136820 0x7f10f812d2b0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f10e800ebe0 tx=0x7f10e800eef0 comp rx=0 tx=0).stop 2023-10-01T08:00:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.921+0000 7f1100756700 1 -- 172.21.15.26:0/1961218899 shutdown_connections 2023-10-01T08:00:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.921+0000 7f1100756700 1 --2- 172.21.15.26:0/1961218899 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f10f8139140 0x7f10f812d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.921+0000 7f1100756700 1 --2- 172.21.15.26:0/1961218899 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f10f8133a80 0x7f10f812cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.921+0000 7f1100756700 1 --2- 172.21.15.26:0/1961218899 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10f8136820 0x7f10f812d2b0 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.921+0000 7f1100756700 1 -- 172.21.15.26:0/1961218899 >> 172.21.15.26:0/1961218899 conn(0x7f10f80a4210 msgr2=0x7f10f81345c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.921+0000 7f1100756700 1 -- 172.21.15.26:0/1961218899 shutdown_connections 2023-10-01T08:00:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:37.921+0000 7f1100756700 1 -- 172.21.15.26:0/1961218899 wait complete. 2023-10-01T08:00:37.935 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:38.477 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:38.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.623+0000 7fb7dbbaa700 1 Processor -- start 2023-10-01T08:00:38.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.623+0000 7fb7dbbaa700 1 -- start start 2023-10-01T08:00:38.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.624+0000 7fb7dbbaa700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb7d409d6f0 0x7fb7d409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:38.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.624+0000 7fb7dbbaa700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7d409e000 0x7fb7d41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:38.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.624+0000 7fb7dbbaa700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7d4133f30 0x7fb7d4134390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:38.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.624+0000 7fb7dbbaa700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7d409b0f0 con 0x7fb7d409d6f0 2023-10-01T08:00:38.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.624+0000 7fb7dbbaa700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d409d2f0 con 0x7fb7d4133f30 2023-10-01T08:00:38.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.624+0000 7fb7dbbaa700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d409a810 con 0x7fb7d409e000 2023-10-01T08:00:38.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.624+0000 7fb7d9145700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7d409e000 0x7fb7d41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:38.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.624+0000 7fb7d9946700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb7d409d6f0 0x7fb7d409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:38.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.624+0000 7fb7da147700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7d4133f30 0x7fb7d4134390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:38.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.624+0000 7fb7d9145700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7d409e000 0x7fb7d41339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44560/0 (socket says 172.21.15.26:44560) 2023-10-01T08:00:38.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.624+0000 7fb7da147700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7d4133f30 0x7fb7d4134390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42476/0 (socket says 172.21.15.26:42476) 2023-10-01T08:00:38.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.624+0000 7fb7d9145700 1 -- 172.21.15.26:0/1514661333 learned_addr learned my addr 172.21.15.26:0/1514661333 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:38.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.624+0000 7fb7d9946700 1 -- 172.21.15.26:0/1514661333 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7d409e000 msgr2=0x7fb7d41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:38.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.624+0000 7fb7d9946700 1 --2- 172.21.15.26:0/1514661333 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7d409e000 0x7fb7d41339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:38.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.624+0000 7fb7d9946700 1 -- 172.21.15.26:0/1514661333 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7d4133f30 msgr2=0x7fb7d4134390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:38.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.624+0000 7fb7d9946700 1 --2- 172.21.15.26:0/1514661333 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7d4133f30 0x7fb7d4134390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:38.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.624+0000 7fb7d9946700 1 -- 172.21.15.26:0/1514661333 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d409a470 con 0x7fb7d409d6f0 2023-10-01T08:00:38.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.624+0000 7fb7da147700 1 --2- 172.21.15.26:0/1514661333 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7d4133f30 0x7fb7d4134390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:38.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.624+0000 7fb7d9145700 1 --2- 172.21.15.26:0/1514661333 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7d409e000 0x7fb7d41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:38.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.625+0000 7fb7d9946700 1 --2- 172.21.15.26:0/1514661333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7d409d6f0 0x7fb7d409dac0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0009840 tx=0x7fb7d0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b4d9296f670f87d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:38.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.625+0000 7fb7d8944700 1 -- 172.21.15.26:0/1514661333 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0011830 con 0x7fb7d409d6f0 2023-10-01T08:00:38.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.625+0000 7fb7d8944700 1 -- 172.21.15.26:0/1514661333 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d0011990 con 0x7fb7d409d6f0 2023-10-01T08:00:38.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.625+0000 7fb7d8944700 1 -- 172.21.15.26:0/1514661333 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0011d20 con 0x7fb7d409d6f0 2023-10-01T08:00:38.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.625+0000 7fb7dbbaa700 1 -- 172.21.15.26:0/1514661333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7d409d6f0 msgr2=0x7fb7d409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:38.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.625+0000 7fb7dbbaa700 1 --2- 172.21.15.26:0/1514661333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7d409d6f0 0x7fb7d409dac0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0009840 tx=0x7fb7d0009b50 comp rx=0 tx=0).stop 2023-10-01T08:00:38.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.626+0000 7fb7dbbaa700 1 -- 172.21.15.26:0/1514661333 shutdown_connections 2023-10-01T08:00:38.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.626+0000 7fb7dbbaa700 1 --2- 172.21.15.26:0/1514661333 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7d4133f30 0x7fb7d4134390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:38.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.626+0000 7fb7dbbaa700 1 --2- 172.21.15.26:0/1514661333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7d409d6f0 0x7fb7d409dac0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:38.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.626+0000 7fb7dbbaa700 1 --2- 172.21.15.26:0/1514661333 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7d409e000 0x7fb7d41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:38.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.626+0000 7fb7dbbaa700 1 -- 172.21.15.26:0/1514661333 >> 172.21.15.26:0/1514661333 conn(0x7fb7d4066f50 msgr2=0x7fb7d409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:38.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.626+0000 7fb7dbbaa700 1 -- 172.21.15.26:0/1514661333 shutdown_connections 2023-10-01T08:00:38.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.626+0000 7fb7dbbaa700 1 -- 172.21.15.26:0/1514661333 wait complete. 2023-10-01T08:00:38.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.627+0000 7fb7dbbaa700 1 Processor -- start 2023-10-01T08:00:38.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.627+0000 7fb7dbbaa700 1 -- start start 2023-10-01T08:00:38.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.627+0000 7fb7dbbaa700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7d409d6f0 0x7fb7d4121280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:38.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.627+0000 7fb7dbbaa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7d409e000 0x7fb7d41217c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:38.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.627+0000 7fb7dbbaa700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7d4133f30 0x7fb7d4121d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:38.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.627+0000 7fb7dbbaa700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d4124ba0 con 0x7fb7d409e000 2023-10-01T08:00:38.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.627+0000 7fb7dbbaa700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d4124800 con 0x7fb7d409d6f0 2023-10-01T08:00:38.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.627+0000 7fb7dbbaa700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d4124da0 con 0x7fb7d4133f30 2023-10-01T08:00:38.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.627+0000 7fb7d9946700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7d409d6f0 0x7fb7d4121280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:38.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.627+0000 7fb7d9946700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7d409d6f0 0x7fb7d4121280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42490/0 (socket says 172.21.15.26:42490) 2023-10-01T08:00:38.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.627+0000 7fb7d9946700 1 -- 172.21.15.26:0/4207669947 learned_addr learned my addr 172.21.15.26:0/4207669947 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:38.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.627+0000 7fb7d9145700 1 --2- 172.21.15.26:0/4207669947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7d409e000 0x7fb7d41217c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:38.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.627+0000 7fb7da147700 1 --2- 172.21.15.26:0/4207669947 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7d4133f30 0x7fb7d4121d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:38.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.628+0000 7fb7d9946700 1 -- 172.21.15.26:0/4207669947 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7d4133f30 msgr2=0x7fb7d4121d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:38.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.628+0000 7fb7d9946700 1 --2- 172.21.15.26:0/4207669947 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7d4133f30 0x7fb7d4121d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:38.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.628+0000 7fb7d9946700 1 -- 172.21.15.26:0/4207669947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7d409e000 msgr2=0x7fb7d41217c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:38.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.628+0000 7fb7d9946700 1 --2- 172.21.15.26:0/4207669947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7d409e000 0x7fb7d41217c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:38.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.628+0000 7fb7d9946700 1 -- 172.21.15.26:0/4207669947 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c8009550 con 0x7fb7d409d6f0 2023-10-01T08:00:38.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.628+0000 7fb7d9946700 1 --2- 172.21.15.26:0/4207669947 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7d409d6f0 0x7fb7d4121280 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0000c00 tx=0x7fb7d0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:38.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.628+0000 7fb7c67fc700 1 -- 172.21.15.26:0/4207669947 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0004450 con 0x7fb7d409d6f0 2023-10-01T08:00:38.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.628+0000 7fb7c67fc700 1 -- 172.21.15.26:0/4207669947 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d001f070 con 0x7fb7d409d6f0 2023-10-01T08:00:38.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.628+0000 7fb7dbbaa700 1 -- 172.21.15.26:0/4207669947 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7cc009a70 con 0x7fb7d409d6f0 2023-10-01T08:00:38.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.628+0000 7fb7c67fc700 1 -- 172.21.15.26:0/4207669947 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d00038e0 con 0x7fb7d409d6f0 2023-10-01T08:00:38.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.628+0000 7fb7dbbaa700 1 -- 172.21.15.26:0/4207669947 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7d00094a0 con 0x7fb7d409d6f0 2023-10-01T08:00:38.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.629+0000 7fb7c67fc700 1 -- 172.21.15.26:0/4207669947 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb7d0003a40 con 0x7fb7d409d6f0 2023-10-01T08:00:38.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.629+0000 7fb7c67fc700 1 -- 172.21.15.26:0/4207669947 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb7d0021070 con 0x7fb7d409d6f0 2023-10-01T08:00:38.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.629+0000 7fb7dbbaa700 1 -- 172.21.15.26:0/4207669947 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7d409c640 con 0x7fb7d409d6f0 2023-10-01T08:00:38.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.634+0000 7fb7c67fc700 1 -- 172.21.15.26:0/4207669947 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb7d0015070 con 0x7fb7d409d6f0 2023-10-01T08:00:38.798 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:38.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.842+0000 7fb7dbbaa700 1 -- 172.21.15.26:0/4207669947 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb7d4074ea0 con 0x7fb7d409d6f0 2023-10-01T08:00:38.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.843+0000 7fb7c67fc700 1 -- 172.21.15.26:0/4207669947 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb7d0024380 con 0x7fb7d409d6f0 2023-10-01T08:00:38.844 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:38.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.845+0000 7fb7dbbaa700 1 -- 172.21.15.26:0/4207669947 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7d409d6f0 msgr2=0x7fb7d4121280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:38.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.845+0000 7fb7dbbaa700 1 --2- 172.21.15.26:0/4207669947 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7d409d6f0 0x7fb7d4121280 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0000c00 tx=0x7fb7d0004750 comp rx=0 tx=0).stop 2023-10-01T08:00:38.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.845+0000 7fb7dbbaa700 1 -- 172.21.15.26:0/4207669947 shutdown_connections 2023-10-01T08:00:38.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.845+0000 7fb7dbbaa700 1 --2- 172.21.15.26:0/4207669947 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7d4133f30 0x7fb7d4121d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:38.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.845+0000 7fb7dbbaa700 1 --2- 172.21.15.26:0/4207669947 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7d409d6f0 0x7fb7d4121280 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:38.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.845+0000 7fb7dbbaa700 1 --2- 172.21.15.26:0/4207669947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7d409e000 0x7fb7d41217c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:38.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.845+0000 7fb7dbbaa700 1 -- 172.21.15.26:0/4207669947 >> 172.21.15.26:0/4207669947 conn(0x7fb7d4066f50 msgr2=0x7fb7d4133200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:38.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.845+0000 7fb7dbbaa700 1 -- 172.21.15.26:0/4207669947 shutdown_connections 2023-10-01T08:00:38.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.845+0000 7fb7dbbaa700 1 -- 172.21.15.26:0/4207669947 wait complete. 2023-10-01T08:00:38.860 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:38.900 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:38.936 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:38.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.937+0000 7f452fdd1700 1 Processor -- start 2023-10-01T08:00:38.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.937+0000 7f452fdd1700 1 -- start start 2023-10-01T08:00:38.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.938+0000 7f452fdd1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f452809f410 0x7f4528136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:38.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.938+0000 7f452fdd1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4528136fe0 0x7f45281393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:38.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.938+0000 7f452fdd1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4528070940 con 0x7f452809e930 2023-10-01T08:00:38.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.938+0000 7f452fdd1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f452806fd60 con 0x7f4528136fe0 2023-10-01T08:00:38.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.938+0000 7f452fdd1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f452806fa80 con 0x7f452809f410 2023-10-01T08:00:38.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.938+0000 7f452d36c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f452809f410 0x7f4528136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:38.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.938+0000 7f452d36c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f452809f410 0x7f4528136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44584/0 (socket says 172.21.15.26:44584) 2023-10-01T08:00:38.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.938+0000 7f452d36c700 1 -- 172.21.15.26:0/2814101859 learned_addr learned my addr 172.21.15.26:0/2814101859 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:38.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.938+0000 7f452db6d700 1 --1- 172.21.15.26:0/2814101859 >> v1:172.21.15.26:6789/0 conn(0x7f452809e930 0x7f452809ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33860/0 (socket says 172.21.15.26:33860) 2023-10-01T08:00:38.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.938+0000 7f452e36e700 1 --2- 172.21.15.26:0/2814101859 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4528136fe0 0x7f45281393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:38.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.939+0000 7f452d36c700 1 -- 172.21.15.26:0/2814101859 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4528136fe0 msgr2=0x7f45281393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:38.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.939+0000 7f452d36c700 1 --2- 172.21.15.26:0/2814101859 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4528136fe0 0x7f45281393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:38.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.939+0000 7f452d36c700 1 -- 172.21.15.26:0/2814101859 >> v1:172.21.15.26:6789/0 conn(0x7f452809e930 legacy=0x7f452809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:38.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.939+0000 7f452d36c700 1 -- 172.21.15.26:0/2814101859 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f452809fb60 con 0x7f452809f410 2023-10-01T08:00:38.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.939+0000 7f452cb6b700 1 -- 172.21.15.26:0/2814101859 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3401588053 0 0) 0x7f4528070940 con 0x7f452809e930 2023-10-01T08:00:38.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.939+0000 7f452d36c700 1 --2- 172.21.15.26:0/2814101859 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f452809f410 0x7f4528136aa0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f451c009920 tx=0x7f451c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0349c8c3b5395fd server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:38.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.939+0000 7f452cb6b700 1 -- 172.21.15.26:0/2814101859 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451c011830 con 0x7f452809f410 2023-10-01T08:00:38.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.939+0000 7f452cb6b700 1 -- 172.21.15.26:0/2814101859 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451c011990 con 0x7f452809f410 2023-10-01T08:00:38.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.939+0000 7f452cb6b700 1 -- 172.21.15.26:0/2814101859 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451c011d20 con 0x7f452809f410 2023-10-01T08:00:38.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.940+0000 7f452fdd1700 1 -- 172.21.15.26:0/2814101859 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f452809f410 msgr2=0x7f4528136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:38.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.940+0000 7f452fdd1700 1 --2- 172.21.15.26:0/2814101859 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f452809f410 0x7f4528136aa0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f451c009920 tx=0x7f451c009c30 comp rx=0 tx=0).stop 2023-10-01T08:00:38.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.940+0000 7f452fdd1700 1 -- 172.21.15.26:0/2814101859 shutdown_connections 2023-10-01T08:00:38.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.940+0000 7f452fdd1700 1 --2- 172.21.15.26:0/2814101859 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4528136fe0 0x7f45281393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:38.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.940+0000 7f452fdd1700 1 --2- 172.21.15.26:0/2814101859 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f452809f410 0x7f4528136aa0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:38.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.940+0000 7f452fdd1700 1 -- 172.21.15.26:0/2814101859 >> 172.21.15.26:0/2814101859 conn(0x7f45280a4210 msgr2=0x7f45280a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:38.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.940+0000 7f452fdd1700 1 -- 172.21.15.26:0/2814101859 shutdown_connections 2023-10-01T08:00:38.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.940+0000 7f452fdd1700 1 -- 172.21.15.26:0/2814101859 wait complete. 2023-10-01T08:00:38.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.941+0000 7f452fdd1700 1 Processor -- start 2023-10-01T08:00:38.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.941+0000 7f452fdd1700 1 -- start start 2023-10-01T08:00:38.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.942+0000 7f452fdd1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f452809e930 0x7f452811c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:38.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.942+0000 7f452fdd1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f452809f410 0x7f452811cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:38.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.942+0000 7f452fdd1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4528136fe0 0x7f452811d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:38.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.942+0000 7f452fdd1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4528071d20 con 0x7f452809e930 2023-10-01T08:00:38.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.942+0000 7f452fdd1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45280a2f40 con 0x7f452809f410 2023-10-01T08:00:38.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.942+0000 7f452fdd1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f452811e2e0 con 0x7f4528136fe0 2023-10-01T08:00:38.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.942+0000 7f452d36c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f452809f410 0x7f452811cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:38.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.942+0000 7f452e36e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4528136fe0 0x7f452811d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:38.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.942+0000 7f452d36c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f452809f410 0x7f452811cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42510/0 (socket says 172.21.15.26:42510) 2023-10-01T08:00:38.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.942+0000 7f452d36c700 1 -- 172.21.15.26:0/3275464764 learned_addr learned my addr 172.21.15.26:0/3275464764 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:38.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.942+0000 7f452e36e700 1 -- 172.21.15.26:0/3275464764 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f452809f410 msgr2=0x7f452811cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:38.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.942+0000 7f452e36e700 1 --2- 172.21.15.26:0/3275464764 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f452809f410 0x7f452811cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:38.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.942+0000 7f452e36e700 1 -- 172.21.15.26:0/3275464764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f452809e930 msgr2=0x7f452811c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:38.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.942+0000 7f452db6d700 1 --2- 172.21.15.26:0/3275464764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f452809e930 0x7f452811c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:38.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.943+0000 7f452e36e700 1 --2- 172.21.15.26:0/3275464764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f452809e930 0x7f452811c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:38.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.943+0000 7f452e36e700 1 -- 172.21.15.26:0/3275464764 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f451c009550 con 0x7f4528136fe0 2023-10-01T08:00:38.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.943+0000 7f452d36c700 1 --2- 172.21.15.26:0/3275464764 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f452809f410 0x7f452811cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:38.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.943+0000 7f452db6d700 1 --2- 172.21.15.26:0/3275464764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f452809e930 0x7f452811c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T08:00:38.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.943+0000 7f452e36e700 1 --2- 172.21.15.26:0/3275464764 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4528136fe0 0x7f452811d0b0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f45280a07c0 tx=0x7f4520009ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:38.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.943+0000 7f45267fc700 1 -- 172.21.15.26:0/3275464764 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4520015070 con 0x7f4528136fe0 2023-10-01T08:00:38.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.943+0000 7f45267fc700 1 -- 172.21.15.26:0/3275464764 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452000b8e0 con 0x7f4528136fe0 2023-10-01T08:00:38.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.943+0000 7f452fdd1700 1 -- 172.21.15.26:0/3275464764 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f452811f8e0 con 0x7f4528136fe0 2023-10-01T08:00:38.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.943+0000 7f45267fc700 1 -- 172.21.15.26:0/3275464764 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452000bc70 con 0x7f4528136fe0 2023-10-01T08:00:38.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.943+0000 7f452fdd1700 1 -- 172.21.15.26:0/3275464764 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f452811fe70 con 0x7f4528136fe0 2023-10-01T08:00:38.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.944+0000 7f45267fc700 1 -- 172.21.15.26:0/3275464764 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f45200223b0 con 0x7f4528136fe0 2023-10-01T08:00:38.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.944+0000 7f452fdd1700 1 -- 172.21.15.26:0/3275464764 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f452811fad0 con 0x7f4528136fe0 2023-10-01T08:00:38.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.944+0000 7f45267fc700 1 -- 172.21.15.26:0/3275464764 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4520042df0 con 0x7f4528136fe0 2023-10-01T08:00:38.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:38.949+0000 7f45267fc700 1 -- 172.21.15.26:0/3275464764 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f452001e080 con 0x7f4528136fe0 2023-10-01T08:00:39.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.041+0000 7fd63cb0d700 1 Processor -- start 2023-10-01T08:00:39.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.042+0000 7fd63cb0d700 1 -- start start 2023-10-01T08:00:39.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.043+0000 7fd63cb0d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd63809de00 0x7fd63809e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:39.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.043+0000 7fd63cb0d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd63813d1f0 0x7fd63813f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:39.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.043+0000 7fd63cb0d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd63809a810 con 0x7fd63806a770 2023-10-01T08:00:39.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.043+0000 7fd63cb0d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd63806ab40 con 0x7fd63809de00 2023-10-01T08:00:39.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.043+0000 7fd63cb0d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd63809ebc0 con 0x7fd63813d1f0 2023-10-01T08:00:39.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.043+0000 7fd636d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd63813d1f0 0x7fd63813f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:39.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.043+0000 7fd635d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd63809de00 0x7fd63809e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:39.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.043+0000 7fd636d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd63813d1f0 0x7fd63813f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42524/0 (socket says 172.21.15.26:42524) 2023-10-01T08:00:39.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.043+0000 7fd636d9d700 1 -- 172.21.15.26:0/3318805231 learned_addr learned my addr 172.21.15.26:0/3318805231 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:39.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.043+0000 7fd635d9b700 1 -- 172.21.15.26:0/3318805231 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd63813d1f0 msgr2=0x7fd63813f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:39.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.043+0000 7fd635d9b700 1 --2- 172.21.15.26:0/3318805231 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd63813d1f0 0x7fd63813f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:39.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.043+0000 7fd635d9b700 1 -- 172.21.15.26:0/3318805231 >> v1:172.21.15.26:6789/0 conn(0x7fd63806a770 legacy=0x7fd63809d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:39.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.043+0000 7fd635d9b700 1 -- 172.21.15.26:0/3318805231 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63809e920 con 0x7fd63809de00 2023-10-01T08:00:39.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.044+0000 7fd635d9b700 1 --2- 172.21.15.26:0/3318805231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd63809de00 0x7fd63809e250 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fd62c009840 tx=0x7fd62c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2795e91aa79e9d10 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:39.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.044+0000 7fd63559a700 1 -- 172.21.15.26:0/3318805231 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c004230 con 0x7fd63809de00 2023-10-01T08:00:39.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.044+0000 7fd63559a700 1 -- 172.21.15.26:0/3318805231 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62c004390 con 0x7fd63809de00 2023-10-01T08:00:39.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.044+0000 7fd63559a700 1 -- 172.21.15.26:0/3318805231 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c0036a0 con 0x7fd63809de00 2023-10-01T08:00:39.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.045+0000 7fd63cb0d700 1 -- 172.21.15.26:0/3318805231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd63809de00 msgr2=0x7fd63809e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:39.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.045+0000 7fd63cb0d700 1 --2- 172.21.15.26:0/3318805231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd63809de00 0x7fd63809e250 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fd62c009840 tx=0x7fd62c009b50 comp rx=0 tx=0).stop 2023-10-01T08:00:39.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.045+0000 7fd63cb0d700 1 -- 172.21.15.26:0/3318805231 shutdown_connections 2023-10-01T08:00:39.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.045+0000 7fd63cb0d700 1 --2- 172.21.15.26:0/3318805231 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd63813d1f0 0x7fd63813f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:39.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.045+0000 7fd63cb0d700 1 --2- 172.21.15.26:0/3318805231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd63809de00 0x7fd63809e250 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:39.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.045+0000 7fd63cb0d700 1 -- 172.21.15.26:0/3318805231 >> 172.21.15.26:0/3318805231 conn(0x7fd638066f50 msgr2=0x7fd63809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:39.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.045+0000 7fd63cb0d700 1 -- 172.21.15.26:0/3318805231 shutdown_connections 2023-10-01T08:00:39.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.045+0000 7fd63cb0d700 1 -- 172.21.15.26:0/3318805231 wait complete. 2023-10-01T08:00:39.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.046+0000 7fd63cb0d700 1 Processor -- start 2023-10-01T08:00:39.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.046+0000 7fd63cb0d700 1 -- start start 2023-10-01T08:00:39.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.047+0000 7fd63cb0d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd63806a770 0x7fd6381260a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:39.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.047+0000 7fd63cb0d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd63809de00 0x7fd6381265e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:39.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.047+0000 7fd63cb0d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd63813d1f0 0x7fd638126b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:39.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.047+0000 7fd63cb0d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd638128640 con 0x7fd63813d1f0 2023-10-01T08:00:39.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.047+0000 7fd63cb0d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd63811cf30 con 0x7fd63806a770 2023-10-01T08:00:39.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.047+0000 7fd63cb0d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd638127410 con 0x7fd63809de00 2023-10-01T08:00:39.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.047+0000 7fd635d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd63809de00 0x7fd6381265e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:39.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.047+0000 7fd636d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd63813d1f0 0x7fd638126b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:39.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.047+0000 7fd635d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd63809de00 0x7fd6381265e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44608/0 (socket says 172.21.15.26:44608) 2023-10-01T08:00:39.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.047+0000 7fd635d9b700 1 -- 172.21.15.26:0/3399637173 learned_addr learned my addr 172.21.15.26:0/3399637173 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:39.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.047+0000 7fd63659c700 1 --2- 172.21.15.26:0/3399637173 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd63806a770 0x7fd6381260a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:39.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.047+0000 7fd635d9b700 1 -- 172.21.15.26:0/3399637173 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd63806a770 msgr2=0x7fd6381260a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:39.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.048+0000 7fd635d9b700 1 --2- 172.21.15.26:0/3399637173 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd63806a770 0x7fd6381260a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:39.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.048+0000 7fd635d9b700 1 -- 172.21.15.26:0/3399637173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd63813d1f0 msgr2=0x7fd638126b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:39.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.048+0000 7fd635d9b700 1 --2- 172.21.15.26:0/3399637173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd63813d1f0 0x7fd638126b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:39.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.048+0000 7fd635d9b700 1 -- 172.21.15.26:0/3399637173 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62c0094a0 con 0x7fd63809de00 2023-10-01T08:00:39.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.048+0000 7fd63659c700 1 --2- 172.21.15.26:0/3399637173 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd63806a770 0x7fd6381260a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:39.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.048+0000 7fd636d9d700 1 --2- 172.21.15.26:0/3399637173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd63813d1f0 0x7fd638126b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:39.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.048+0000 7fd635d9b700 1 --2- 172.21.15.26:0/3399637173 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd63809de00 0x7fd6381265e0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fd62c000c00 tx=0x7fd62c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:39.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.048+0000 7fd626ffd700 1 -- 172.21.15.26:0/3399637173 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c003c30 con 0x7fd63809de00 2023-10-01T08:00:39.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.048+0000 7fd626ffd700 1 -- 172.21.15.26:0/3399637173 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62c003db0 con 0x7fd63809de00 2023-10-01T08:00:39.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.048+0000 7fd626ffd700 1 -- 172.21.15.26:0/3399637173 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c011870 con 0x7fd63809de00 2023-10-01T08:00:39.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.048+0000 7fd63cb0d700 1 -- 172.21.15.26:0/3399637173 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd638128010 con 0x7fd63809de00 2023-10-01T08:00:39.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.048+0000 7fd63cb0d700 1 -- 172.21.15.26:0/3399637173 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd63809f1a0 con 0x7fd63809de00 2023-10-01T08:00:39.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.049+0000 7fd63cb0d700 1 -- 172.21.15.26:0/3399637173 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd638074ea0 con 0x7fd63809de00 2023-10-01T08:00:39.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.049+0000 7fd626ffd700 1 -- 172.21.15.26:0/3399637173 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd62c018040 con 0x7fd63809de00 2023-10-01T08:00:39.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.049+0000 7fd626ffd700 1 -- 172.21.15.26:0/3399637173 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd62c03fec0 con 0x7fd63809de00 2023-10-01T08:00:39.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.057+0000 7fd626ffd700 1 -- 172.21.15.26:0/3399637173 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd62c01a400 con 0x7fd63809de00 2023-10-01T08:00:39.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.089+0000 7f41e4641700 1 Processor -- start 2023-10-01T08:00:39.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.089+0000 7f41e4641700 1 -- start start 2023-10-01T08:00:39.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.090+0000 7f41e4641700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41dc09d630 0x7f41dc0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:39.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.090+0000 7f41e4641700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41dc138d80 0x7f41dc13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:39.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.090+0000 7f41e4641700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41dc0a2a70 con 0x7f41dc0a0a30 2023-10-01T08:00:39.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.090+0000 7f41e4641700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc0a01d0 con 0x7f41dc138d80 2023-10-01T08:00:39.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.090+0000 7f41e4641700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc09e2b0 con 0x7f41dc09d630 2023-10-01T08:00:39.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.090+0000 7f41e2bde700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41dc138d80 0x7f41dc13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:39.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.090+0000 7f41e1bdc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41dc09d630 0x7f41dc0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:39.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.090+0000 7f41e2bde700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41dc138d80 0x7f41dc13b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42554/0 (socket says 172.21.15.26:42554) 2023-10-01T08:00:39.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.090+0000 7f41e1bdc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41dc09d630 0x7f41dc0a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44622/0 (socket says 172.21.15.26:44622) 2023-10-01T08:00:39.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.090+0000 7f41e2bde700 1 -- 172.21.15.26:0/343837862 learned_addr learned my addr 172.21.15.26:0/343837862 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:39.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.091+0000 7f41e1bdc700 1 -- 172.21.15.26:0/343837862 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41dc138d80 msgr2=0x7f41dc13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:39.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.091+0000 7f41e1bdc700 1 --2- 172.21.15.26:0/343837862 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41dc138d80 0x7f41dc13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:39.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.091+0000 7f41e1bdc700 1 -- 172.21.15.26:0/343837862 >> v1:172.21.15.26:6789/0 conn(0x7f41dc0a0a30 legacy=0x7f41dc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:39.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.091+0000 7f41e1bdc700 1 -- 172.21.15.26:0/343837862 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41dc09dc50 con 0x7f41dc09d630 2023-10-01T08:00:39.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.091+0000 7f41e13db700 1 -- 172.21.15.26:0/343837862 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 211364155 0 0) 0x7f41dc0a2a70 con 0x7f41dc0a0a30 2023-10-01T08:00:39.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.091+0000 7f41e2bde700 1 --2- 172.21.15.26:0/343837862 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41dc138d80 0x7f41dc13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:39.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.091+0000 7f41e1bdc700 1 --2- 172.21.15.26:0/343837862 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41dc09d630 0x7f41dc0a1510 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f41cc009870 tx=0x7f41cc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e48eb377172bb71 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:39.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.091+0000 7f41e13db700 1 -- 172.21.15.26:0/343837862 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc011830 con 0x7f41dc09d630 2023-10-01T08:00:39.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.091+0000 7f41e13db700 1 -- 172.21.15.26:0/343837862 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41cc011990 con 0x7f41dc09d630 2023-10-01T08:00:39.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.091+0000 7f41e13db700 1 -- 172.21.15.26:0/343837862 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc011d20 con 0x7f41dc09d630 2023-10-01T08:00:39.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.092+0000 7f41e4641700 1 -- 172.21.15.26:0/343837862 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41dc09d630 msgr2=0x7f41dc0a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:39.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.092+0000 7f41e4641700 1 --2- 172.21.15.26:0/343837862 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41dc09d630 0x7f41dc0a1510 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f41cc009870 tx=0x7f41cc009b80 comp rx=0 tx=0).stop 2023-10-01T08:00:39.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.092+0000 7f41e4641700 1 -- 172.21.15.26:0/343837862 shutdown_connections 2023-10-01T08:00:39.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.092+0000 7f41e4641700 1 --2- 172.21.15.26:0/343837862 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41dc138d80 0x7f41dc13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:39.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.092+0000 7f41e4641700 1 --2- 172.21.15.26:0/343837862 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41dc09d630 0x7f41dc0a1510 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:39.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.092+0000 7f41e4641700 1 -- 172.21.15.26:0/343837862 >> 172.21.15.26:0/343837862 conn(0x7f41dc0a3050 msgr2=0x7f41dc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:39.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.092+0000 7f41e4641700 1 -- 172.21.15.26:0/343837862 shutdown_connections 2023-10-01T08:00:39.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.092+0000 7f41e4641700 1 -- 172.21.15.26:0/343837862 wait complete. 2023-10-01T08:00:39.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.094+0000 7f41e4641700 1 Processor -- start 2023-10-01T08:00:39.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.094+0000 7f41e4641700 1 -- start start 2023-10-01T08:00:39.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.095+0000 7f41e4641700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41dc09d630 0x7f41dc1337c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:39.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.095+0000 7f41e4641700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41dc0a0a30 0x7f41dc133d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:39.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.095+0000 7f41e4641700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41dc138d80 0x7f41dc134240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:39.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.095+0000 7f41e4641700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc134c90 con 0x7f41dc138d80 2023-10-01T08:00:39.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.095+0000 7f41e4641700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc137310 con 0x7f41dc09d630 2023-10-01T08:00:39.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.095+0000 7f41e4641700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc136c60 con 0x7f41dc0a0a30 2023-10-01T08:00:39.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.095+0000 7f41e23dd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41dc09d630 0x7f41dc1337c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:39.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.095+0000 7f41e1bdc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41dc0a0a30 0x7f41dc133d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:39.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.095+0000 7f41e23dd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41dc09d630 0x7f41dc1337c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42558/0 (socket says 172.21.15.26:42558) 2023-10-01T08:00:39.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.095+0000 7f41e2bde700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41dc138d80 0x7f41dc134240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:39.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.095+0000 7f41e23dd700 1 -- 172.21.15.26:0/1549054605 learned_addr learned my addr 172.21.15.26:0/1549054605 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:39.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.095+0000 7f41e1bdc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41dc0a0a30 0x7f41dc133d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44626/0 (socket says 172.21.15.26:44626) 2023-10-01T08:00:39.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.095+0000 7f41e23dd700 1 -- 172.21.15.26:0/1549054605 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41dc0a0a30 msgr2=0x7f41dc133d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:39.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.095+0000 7f41e23dd700 1 --2- 172.21.15.26:0/1549054605 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41dc0a0a30 0x7f41dc133d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:39.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.095+0000 7f41e23dd700 1 -- 172.21.15.26:0/1549054605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41dc138d80 msgr2=0x7f41dc134240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:39.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.095+0000 7f41e23dd700 1 --2- 172.21.15.26:0/1549054605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41dc138d80 0x7f41dc134240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:39.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.095+0000 7f41e23dd700 1 -- 172.21.15.26:0/1549054605 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d4009550 con 0x7f41dc09d630 2023-10-01T08:00:39.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.095+0000 7f41e1bdc700 1 --2- 172.21.15.26:0/1549054605 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41dc0a0a30 0x7f41dc133d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:39.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.095+0000 7f41e23dd700 1 --2- 172.21.15.26:0/1549054605 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41dc09d630 0x7f41dc1337c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f41d800c8c0 tx=0x7f41d800cbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:39.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.096+0000 7f41d2ffd700 1 -- 172.21.15.26:0/1549054605 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d8003e30 con 0x7f41dc09d630 2023-10-01T08:00:39.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.096+0000 7f41d2ffd700 1 -- 172.21.15.26:0/1549054605 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d8005070 con 0x7f41dc09d630 2023-10-01T08:00:39.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.096+0000 7f41e4641700 1 -- 172.21.15.26:0/1549054605 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41cc0094a0 con 0x7f41dc09d630 2023-10-01T08:00:39.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.096+0000 7f41d2ffd700 1 -- 172.21.15.26:0/1549054605 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d8005400 con 0x7f41dc09d630 2023-10-01T08:00:39.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.096+0000 7f41e4641700 1 -- 172.21.15.26:0/1549054605 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41dc136f20 con 0x7f41dc09d630 2023-10-01T08:00:39.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.096+0000 7f41d2ffd700 1 -- 172.21.15.26:0/1549054605 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f41d8005560 con 0x7f41dc09d630 2023-10-01T08:00:39.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.097+0000 7f41d2ffd700 1 -- 172.21.15.26:0/1549054605 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f41d803ed60 con 0x7f41dc09d630 2023-10-01T08:00:39.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.097+0000 7f41e4641700 1 -- 172.21.15.26:0/1549054605 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41dc0747f0 con 0x7f41dc09d630 2023-10-01T08:00:39.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.102+0000 7f41d2ffd700 1 -- 172.21.15.26:0/1549054605 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f41d8017020 con 0x7f41dc09d630 2023-10-01T08:00:39.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.185+0000 7f452fdd1700 1 -- 172.21.15.26:0/3275464764 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4528074ea0 con 0x7f4528136fe0 2023-10-01T08:00:39.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.186+0000 7f45267fc700 1 -- 172.21.15.26:0/3275464764 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4520016270 con 0x7f4528136fe0 2023-10-01T08:00:39.187 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:39.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.189+0000 7f452fdd1700 1 -- 172.21.15.26:0/3275464764 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4528136fe0 msgr2=0x7f452811d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:39.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.189+0000 7f452fdd1700 1 --2- 172.21.15.26:0/3275464764 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4528136fe0 0x7f452811d0b0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f45280a07c0 tx=0x7f4520009ea0 comp rx=0 tx=0).stop 2023-10-01T08:00:39.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.189+0000 7f452fdd1700 1 -- 172.21.15.26:0/3275464764 shutdown_connections 2023-10-01T08:00:39.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.189+0000 7f452fdd1700 1 --2- 172.21.15.26:0/3275464764 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4528136fe0 0x7f452811d0b0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:39.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.189+0000 7f452fdd1700 1 --2- 172.21.15.26:0/3275464764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f452809e930 0x7f452811c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:39.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.189+0000 7f452fdd1700 1 --2- 172.21.15.26:0/3275464764 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f452809f410 0x7f452811cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:39.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.189+0000 7f452fdd1700 1 -- 172.21.15.26:0/3275464764 >> 172.21.15.26:0/3275464764 conn(0x7f45280a4210 msgr2=0x7f4528134ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:39.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.189+0000 7f452fdd1700 1 -- 172.21.15.26:0/3275464764 shutdown_connections 2023-10-01T08:00:39.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.189+0000 7f452fdd1700 1 -- 172.21.15.26:0/3275464764 wait complete. 2023-10-01T08:00:39.208 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:39.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.281+0000 7fd63cb0d700 1 -- 172.21.15.26:0/3399637173 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd63809a3d0 con 0x7fd63809de00 2023-10-01T08:00:39.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.281+0000 7fd626ffd700 1 -- 172.21.15.26:0/3399637173 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd62c016030 con 0x7fd63809de00 2023-10-01T08:00:39.282 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:39.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.283+0000 7fd63cb0d700 1 -- 172.21.15.26:0/3399637173 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd63809de00 msgr2=0x7fd6381265e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:39.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.283+0000 7fd63cb0d700 1 --2- 172.21.15.26:0/3399637173 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd63809de00 0x7fd6381265e0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fd62c000c00 tx=0x7fd62c004750 comp rx=0 tx=0).stop 2023-10-01T08:00:39.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.283+0000 7fd63cb0d700 1 -- 172.21.15.26:0/3399637173 shutdown_connections 2023-10-01T08:00:39.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.283+0000 7fd63cb0d700 1 --2- 172.21.15.26:0/3399637173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd63813d1f0 0x7fd638126b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:39.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.283+0000 7fd63cb0d700 1 --2- 172.21.15.26:0/3399637173 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd63806a770 0x7fd6381260a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:39.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.283+0000 7fd63cb0d700 1 --2- 172.21.15.26:0/3399637173 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd63809de00 0x7fd6381265e0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:39.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.283+0000 7fd63cb0d700 1 -- 172.21.15.26:0/3399637173 >> 172.21.15.26:0/3399637173 conn(0x7fd638066f50 msgr2=0x7fd6380a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:39.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.283+0000 7fd63cb0d700 1 -- 172.21.15.26:0/3399637173 shutdown_connections 2023-10-01T08:00:39.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.283+0000 7fd63cb0d700 1 -- 172.21.15.26:0/3399637173 wait complete. 2023-10-01T08:00:39.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:39.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.340+0000 7f41e4641700 1 -- 172.21.15.26:0/1549054605 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f41dc072980 con 0x7f41dc09d630 2023-10-01T08:00:39.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.340+0000 7f41d2ffd700 1 -- 172.21.15.26:0/1549054605 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f41d8017020 con 0x7f41dc09d630 2023-10-01T08:00:39.341 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:39.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.342+0000 7f41e4641700 1 -- 172.21.15.26:0/1549054605 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41dc09d630 msgr2=0x7f41dc1337c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:39.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.342+0000 7f41e4641700 1 --2- 172.21.15.26:0/1549054605 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41dc09d630 0x7f41dc1337c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f41d800c8c0 tx=0x7f41d800cbd0 comp rx=0 tx=0).stop 2023-10-01T08:00:39.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.342+0000 7f41e4641700 1 -- 172.21.15.26:0/1549054605 shutdown_connections 2023-10-01T08:00:39.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.342+0000 7f41e4641700 1 --2- 172.21.15.26:0/1549054605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41dc138d80 0x7f41dc134240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:39.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.342+0000 7f41e4641700 1 --2- 172.21.15.26:0/1549054605 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41dc09d630 0x7f41dc1337c0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:39.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.342+0000 7f41e4641700 1 --2- 172.21.15.26:0/1549054605 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41dc0a0a30 0x7f41dc133d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:39.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.342+0000 7f41e4641700 1 -- 172.21.15.26:0/1549054605 >> 172.21.15.26:0/1549054605 conn(0x7f41dc0a3050 msgr2=0x7f41dc09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.342+0000 7f41e4641700 1 -- 172.21.15.26:0/1549054605 shutdown_connections 2023-10-01T08:00:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:39.342+0000 7f41e4641700 1 -- 172.21.15.26:0/1549054605 wait complete. 2023-10-01T08:00:39.356 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:39.862 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:40.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.007+0000 7f274eb62700 1 Processor -- start 2023-10-01T08:00:40.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.007+0000 7f274eb62700 1 -- start start 2023-10-01T08:00:40.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.008+0000 7f274eb62700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f274809d6f0 0x7f274809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:40.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.008+0000 7f274eb62700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f274809e000 0x7f27481339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:40.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.008+0000 7f274eb62700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274809b120 con 0x7f274809e410 2023-10-01T08:00:40.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.008+0000 7f274eb62700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274806b460 con 0x7f274809e000 2023-10-01T08:00:40.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.008+0000 7f274eb62700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f274809a7e0 con 0x7f274809d6f0 2023-10-01T08:00:40.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.008+0000 7f274d0ff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f274809e410 0x7f2748133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33886/0 (socket says 172.21.15.26:33886) 2023-10-01T08:00:40.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.008+0000 7f2747fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f274809e000 0x7f27481339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:40.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.008+0000 7f274c8fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f274809d6f0 0x7f274809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:40.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.008+0000 7f274d0ff700 1 -- 172.21.15.26:0/1235196914 learned_addr learned my addr 172.21.15.26:0/1235196914 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:40.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.009+0000 7f27477fe700 1 -- 172.21.15.26:0/1235196914 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1759716536 0 0) 0x7f274809b120 con 0x7f274809e410 2023-10-01T08:00:40.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.009+0000 7f274c8fe700 1 -- 172.21.15.26:0/1235196914 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f274809e000 msgr2=0x7f27481339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:40.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.009+0000 7f274c8fe700 1 --2- 172.21.15.26:0/1235196914 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f274809e000 0x7f27481339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.009+0000 7f274c8fe700 1 -- 172.21.15.26:0/1235196914 >> v1:172.21.15.26:6789/0 conn(0x7f274809e410 legacy=0x7f2748133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:40.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.009+0000 7f274c8fe700 1 -- 172.21.15.26:0/1235196914 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274809a500 con 0x7f274809d6f0 2023-10-01T08:00:40.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.009+0000 7f2747fff700 1 --2- 172.21.15.26:0/1235196914 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f274809e000 0x7f27481339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:40.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.009+0000 7f274c8fe700 1 --2- 172.21.15.26:0/1235196914 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f274809d6f0 0x7f274809dac0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f27380098a0 tx=0x7f2738009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b294d9654a488c36 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:40.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.009+0000 7f27477fe700 1 -- 172.21.15.26:0/1235196914 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2738011830 con 0x7f274809d6f0 2023-10-01T08:00:40.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.009+0000 7f27477fe700 1 -- 172.21.15.26:0/1235196914 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2738011990 con 0x7f274809d6f0 2023-10-01T08:00:40.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.009+0000 7f27477fe700 1 -- 172.21.15.26:0/1235196914 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2738011d20 con 0x7f274809d6f0 2023-10-01T08:00:40.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.010+0000 7f274eb62700 1 -- 172.21.15.26:0/1235196914 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f274809d6f0 msgr2=0x7f274809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:40.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.010+0000 7f274eb62700 1 --2- 172.21.15.26:0/1235196914 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f274809d6f0 0x7f274809dac0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f27380098a0 tx=0x7f2738009bb0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.010+0000 7f274eb62700 1 -- 172.21.15.26:0/1235196914 shutdown_connections 2023-10-01T08:00:40.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.010+0000 7f274eb62700 1 --2- 172.21.15.26:0/1235196914 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f274809d6f0 0x7f274809dac0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.010+0000 7f274eb62700 1 --2- 172.21.15.26:0/1235196914 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f274809e000 0x7f27481339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.010+0000 7f274eb62700 1 -- 172.21.15.26:0/1235196914 >> 172.21.15.26:0/1235196914 conn(0x7f2748066f50 msgr2=0x7f274809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:40.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.010+0000 7f274eb62700 1 -- 172.21.15.26:0/1235196914 shutdown_connections 2023-10-01T08:00:40.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.010+0000 7f274eb62700 1 -- 172.21.15.26:0/1235196914 wait complete. 2023-10-01T08:00:40.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.011+0000 7f274eb62700 1 Processor -- start 2023-10-01T08:00:40.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.011+0000 7f274eb62700 1 -- start start 2023-10-01T08:00:40.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.012+0000 7f274eb62700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f274809d6f0 0x7f27481c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:40.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.012+0000 7f274eb62700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f274809e000 0x7f27481c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:40.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.012+0000 7f274eb62700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f274809e410 0x7f27481c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:40.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.012+0000 7f274eb62700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27481a7020 con 0x7f274809d6f0 2023-10-01T08:00:40.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.012+0000 7f274eb62700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27481a64a0 con 0x7f274809e410 2023-10-01T08:00:40.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.012+0000 7f274eb62700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27481a7c90 con 0x7f274809e000 2023-10-01T08:00:40.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.012+0000 7f274d0ff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f274809e410 0x7f27481c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:40.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.012+0000 7f2747fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f274809e000 0x7f27481c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:40.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.012+0000 7f274c8fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f274809d6f0 0x7f27481c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:40.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.012+0000 7f274d0ff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f274809e410 0x7f27481c8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42582/0 (socket says 172.21.15.26:42582) 2023-10-01T08:00:40.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.012+0000 7f274d0ff700 1 -- 172.21.15.26:0/1334075965 learned_addr learned my addr 172.21.15.26:0/1334075965 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:40.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.012+0000 7f2747fff700 1 -- 172.21.15.26:0/1334075965 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f274809e410 msgr2=0x7f27481c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:40.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.012+0000 7f2747fff700 1 --2- 172.21.15.26:0/1334075965 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f274809e410 0x7f27481c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.012+0000 7f2747fff700 1 -- 172.21.15.26:0/1334075965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f274809d6f0 msgr2=0x7f27481c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:40.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.012+0000 7f2747fff700 1 --2- 172.21.15.26:0/1334075965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f274809d6f0 0x7f27481c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.012+0000 7f2747fff700 1 -- 172.21.15.26:0/1334075965 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27300094a0 con 0x7f274809e000 2023-10-01T08:00:40.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.012+0000 7f274c8fe700 1 --2- 172.21.15.26:0/1334075965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f274809d6f0 0x7f27481c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:40.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.012+0000 7f2747fff700 1 --2- 172.21.15.26:0/1334075965 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f274809e000 0x7f27481c8560 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f273000e980 tx=0x7f273000ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:40.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.012+0000 7f27457fa700 1 -- 172.21.15.26:0/1334075965 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273000c690 con 0x7f274809e000 2023-10-01T08:00:40.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.012+0000 7f27457fa700 1 -- 172.21.15.26:0/1334075965 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273000c7f0 con 0x7f274809e000 2023-10-01T08:00:40.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.012+0000 7f274eb62700 1 -- 172.21.15.26:0/1334075965 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27380094a0 con 0x7f274809e000 2023-10-01T08:00:40.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.012+0000 7f27457fa700 1 -- 172.21.15.26:0/1334075965 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273000cb80 con 0x7f274809e000 2023-10-01T08:00:40.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.013+0000 7f274eb62700 1 -- 172.21.15.26:0/1334075965 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f274809c710 con 0x7f274809e000 2023-10-01T08:00:40.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.013+0000 7f27457fa700 1 -- 172.21.15.26:0/1334075965 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f273000cce0 con 0x7f274809e000 2023-10-01T08:00:40.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.013+0000 7f27457fa700 1 -- 172.21.15.26:0/1334075965 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f273003fa40 con 0x7f274809e000 2023-10-01T08:00:40.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.013+0000 7f274eb62700 1 -- 172.21.15.26:0/1334075965 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27481b9280 con 0x7f274809e000 2023-10-01T08:00:40.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.018+0000 7f27457fa700 1 -- 172.21.15.26:0/1334075965 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f273001b3b0 con 0x7f274809e000 2023-10-01T08:00:40.209 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:40.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.226+0000 7f274eb62700 1 -- 172.21.15.26:0/1334075965 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2748074ea0 con 0x7f274809e000 2023-10-01T08:00:40.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.226+0000 7f27457fa700 1 -- 172.21.15.26:0/1334075965 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2730017020 con 0x7f274809e000 2023-10-01T08:00:40.227 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:40.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.229+0000 7f274eb62700 1 -- 172.21.15.26:0/1334075965 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f274809e000 msgr2=0x7f27481c8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:40.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.229+0000 7f274eb62700 1 --2- 172.21.15.26:0/1334075965 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f274809e000 0x7f27481c8560 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f273000e980 tx=0x7f273000ec90 comp rx=0 tx=0).stop 2023-10-01T08:00:40.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.229+0000 7f274eb62700 1 -- 172.21.15.26:0/1334075965 shutdown_connections 2023-10-01T08:00:40.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.229+0000 7f274eb62700 1 --2- 172.21.15.26:0/1334075965 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f274809e410 0x7f27481c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.229+0000 7f274eb62700 1 --2- 172.21.15.26:0/1334075965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f274809d6f0 0x7f27481c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.229+0000 7f274eb62700 1 --2- 172.21.15.26:0/1334075965 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f274809e000 0x7f27481c8560 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.229+0000 7f274eb62700 1 -- 172.21.15.26:0/1334075965 >> 172.21.15.26:0/1334075965 conn(0x7f2748066f50 msgr2=0x7f27481bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:40.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.229+0000 7f274eb62700 1 -- 172.21.15.26:0/1334075965 shutdown_connections 2023-10-01T08:00:40.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.229+0000 7f274eb62700 1 -- 172.21.15.26:0/1334075965 wait complete. 2023-10-01T08:00:40.244 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:40.298 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:40.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.347+0000 7fb208434700 1 Processor -- start 2023-10-01T08:00:40.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.347+0000 7fb208434700 1 -- start start 2023-10-01T08:00:40.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.348+0000 7fb208434700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb2001337f0 0x7fb200138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:40.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.348+0000 7fb208434700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb200138dc0 0x7fb20013b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:40.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.348+0000 7fb208434700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb20006b990 con 0x7fb200133420 2023-10-01T08:00:40.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.348+0000 7fb208434700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20009b0e0 con 0x7fb2001337f0 2023-10-01T08:00:40.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.348+0000 7fb208434700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb200133c20 con 0x7fb200138dc0 2023-10-01T08:00:40.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.348+0000 7fb2059cf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb2001337f0 0x7fb200138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:40.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.348+0000 7fb2069d1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb200138dc0 0x7fb20013b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:40.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.348+0000 7fb2069d1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb200138dc0 0x7fb20013b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44668/0 (socket says 172.21.15.26:44668) 2023-10-01T08:00:40.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.348+0000 7fb2061d0700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb200133420 0x7fb200133e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33900/0 (socket says 172.21.15.26:33900) 2023-10-01T08:00:40.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.348+0000 7fb2059cf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb2001337f0 0x7fb200138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42586/0 (socket says 172.21.15.26:42586) 2023-10-01T08:00:40.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.348+0000 7fb2061d0700 1 -- 172.21.15.26:0/1192107863 learned_addr learned my addr 172.21.15.26:0/1192107863 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:40.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.349+0000 7fb2051ce700 1 -- 172.21.15.26:0/1192107863 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2717375884 0 0) 0x7fb20006b990 con 0x7fb200133420 2023-10-01T08:00:40.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.349+0000 7fb2051ce700 1 -- 172.21.15.26:0/1192107863 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1ec0035b0 con 0x7fb200133420 2023-10-01T08:00:40.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.349+0000 7fb2059cf700 1 -- 172.21.15.26:0/1192107863 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb200138dc0 msgr2=0x7fb20013b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:40.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.349+0000 7fb2059cf700 1 --2- 172.21.15.26:0/1192107863 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb200138dc0 0x7fb20013b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.349+0000 7fb2059cf700 1 -- 172.21.15.26:0/1192107863 >> v1:172.21.15.26:6789/0 conn(0x7fb200133420 legacy=0x7fb200133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:40.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.349+0000 7fb2059cf700 1 -- 172.21.15.26:0/1192107863 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2000a0590 con 0x7fb2001337f0 2023-10-01T08:00:40.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.349+0000 7fb2069d1700 1 --2- 172.21.15.26:0/1192107863 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb200138dc0 0x7fb20013b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:40.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.349+0000 7fb2059cf700 1 --2- 172.21.15.26:0/1192107863 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb2001337f0 0x7fb200138880 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0009870 tx=0x7fb1f0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be0fcba185c75154 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:40.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.349+0000 7fb2051ce700 1 -- 172.21.15.26:0/1192107863 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0011830 con 0x7fb2001337f0 2023-10-01T08:00:40.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.349+0000 7fb2051ce700 1 -- 172.21.15.26:0/1192107863 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f0011990 con 0x7fb2001337f0 2023-10-01T08:00:40.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.349+0000 7fb2051ce700 1 -- 172.21.15.26:0/1192107863 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0011d20 con 0x7fb2001337f0 2023-10-01T08:00:40.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.350+0000 7fb208434700 1 -- 172.21.15.26:0/1192107863 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb2001337f0 msgr2=0x7fb200138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:40.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.350+0000 7fb208434700 1 --2- 172.21.15.26:0/1192107863 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb2001337f0 0x7fb200138880 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0009870 tx=0x7fb1f0009b80 comp rx=0 tx=0).stop 2023-10-01T08:00:40.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.350+0000 7fb208434700 1 -- 172.21.15.26:0/1192107863 shutdown_connections 2023-10-01T08:00:40.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.350+0000 7fb208434700 1 --2- 172.21.15.26:0/1192107863 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb200138dc0 0x7fb20013b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.350+0000 7fb208434700 1 --2- 172.21.15.26:0/1192107863 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb2001337f0 0x7fb200138880 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.350+0000 7fb208434700 1 -- 172.21.15.26:0/1192107863 >> 172.21.15.26:0/1192107863 conn(0x7fb2000a4210 msgr2=0x7fb2000a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:40.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.350+0000 7fb208434700 1 -- 172.21.15.26:0/1192107863 shutdown_connections 2023-10-01T08:00:40.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.350+0000 7fb208434700 1 -- 172.21.15.26:0/1192107863 wait complete. 2023-10-01T08:00:40.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.351+0000 7fb208434700 1 Processor -- start 2023-10-01T08:00:40.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.351+0000 7fb208434700 1 -- start start 2023-10-01T08:00:40.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.351+0000 7fb208434700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb200133420 0x7fb200137810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:40.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.351+0000 7fb208434700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb2001337f0 0x7fb200137d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:40.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.351+0000 7fb208434700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb200138dc0 0x7fb20009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:40.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.351+0000 7fb208434700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb200138b30 con 0x7fb200133420 2023-10-01T08:00:40.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.351+0000 7fb208434700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20012f480 con 0x7fb2001337f0 2023-10-01T08:00:40.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.351+0000 7fb208434700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb200134650 con 0x7fb200138dc0 2023-10-01T08:00:40.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.351+0000 7fb2059cf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb2001337f0 0x7fb200137d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:40.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.352+0000 7fb2069d1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb200138dc0 0x7fb20009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:40.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.352+0000 7fb2059cf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb2001337f0 0x7fb200137d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42600/0 (socket says 172.21.15.26:42600) 2023-10-01T08:00:40.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.352+0000 7fb2059cf700 1 -- 172.21.15.26:0/1722926619 learned_addr learned my addr 172.21.15.26:0/1722926619 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:40.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.352+0000 7fb2061d0700 1 --2- 172.21.15.26:0/1722926619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb200133420 0x7fb200137810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:40.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.352+0000 7fb2069d1700 1 -- 172.21.15.26:0/1722926619 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb2001337f0 msgr2=0x7fb200137d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:40.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.352+0000 7fb2069d1700 1 --2- 172.21.15.26:0/1722926619 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb2001337f0 0x7fb200137d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.352+0000 7fb2069d1700 1 -- 172.21.15.26:0/1722926619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb200133420 msgr2=0x7fb200137810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:40.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.352+0000 7fb2069d1700 1 --2- 172.21.15.26:0/1722926619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb200133420 0x7fb200137810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.352+0000 7fb2069d1700 1 -- 172.21.15.26:0/1722926619 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f8009a70 con 0x7fb200138dc0 2023-10-01T08:00:40.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.352+0000 7fb2059cf700 1 --2- 172.21.15.26:0/1722926619 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb2001337f0 0x7fb200137d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:40.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.352+0000 7fb2069d1700 1 --2- 172.21.15.26:0/1722926619 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb200138dc0 0x7fb20009c480 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fb1f800efc0 tx=0x7fb1f800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:40.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.352+0000 7fb1f6ffd700 1 -- 172.21.15.26:0/1722926619 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f800ca90 con 0x7fb200138dc0 2023-10-01T08:00:40.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.352+0000 7fb1f6ffd700 1 -- 172.21.15.26:0/1722926619 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f800f040 con 0x7fb200138dc0 2023-10-01T08:00:40.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.352+0000 7fb208434700 1 -- 172.21.15.26:0/1722926619 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1f00094a0 con 0x7fb200138dc0 2023-10-01T08:00:40.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.352+0000 7fb1f6ffd700 1 -- 172.21.15.26:0/1722926619 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f800ce30 con 0x7fb200138dc0 2023-10-01T08:00:40.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.352+0000 7fb208434700 1 -- 172.21.15.26:0/1722926619 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb20012f220 con 0x7fb200138dc0 2023-10-01T08:00:40.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.353+0000 7fb1f6ffd700 1 -- 172.21.15.26:0/1722926619 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb1f8014480 con 0x7fb200138dc0 2023-10-01T08:00:40.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.353+0000 7fb1f6ffd700 1 -- 172.21.15.26:0/1722926619 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb1f803fbc0 con 0x7fb200138dc0 2023-10-01T08:00:40.357 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:40.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.354+0000 7fb208434700 1 -- 172.21.15.26:0/1722926619 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb20006d620 con 0x7fb200138dc0 2023-10-01T08:00:40.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.359+0000 7fb1f6ffd700 1 -- 172.21.15.26:0/1722926619 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb1f8012930 con 0x7fb200138dc0 2023-10-01T08:00:40.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.442+0000 7f03ec897700 1 Processor -- start 2023-10-01T08:00:40.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.442+0000 7f03ec897700 1 -- start start 2023-10-01T08:00:40.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.443+0000 7f03ec897700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03e809d6f0 0x7f03e809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:40.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.443+0000 7f03ec897700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03e809e410 0x7f03e8130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:40.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.443+0000 7f03ec897700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03e809f130 con 0x7f03e809e000 2023-10-01T08:00:40.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.443+0000 7f03ec897700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e809f520 con 0x7f03e809d6f0 2023-10-01T08:00:40.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.443+0000 7f03ec897700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03e809e930 con 0x7f03e809e410 2023-10-01T08:00:40.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.443+0000 7f03e6d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03e809e410 0x7f03e8130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:40.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.443+0000 7f03e5d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f03e809e000 0x7f03e8130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33914/0 (socket says 172.21.15.26:33914) 2023-10-01T08:00:40.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.443+0000 7f03e5d9b700 1 -- 172.21.15.26:0/3312709396 learned_addr learned my addr 172.21.15.26:0/3312709396 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:40.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.443+0000 7f03e659c700 1 --2- 172.21.15.26:0/3312709396 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03e809d6f0 0x7f03e809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:40.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.444+0000 7f03e559a700 1 -- 172.21.15.26:0/3312709396 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1223532112 0 0) 0x7f03e809f130 con 0x7f03e809e000 2023-10-01T08:00:40.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.444+0000 7f03e559a700 1 -- 172.21.15.26:0/3312709396 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03d00035b0 con 0x7f03e809e000 2023-10-01T08:00:40.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.444+0000 7f03e6d9d700 1 -- 172.21.15.26:0/3312709396 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03e809d6f0 msgr2=0x7f03e809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:40.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.444+0000 7f03e6d9d700 1 --2- 172.21.15.26:0/3312709396 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03e809d6f0 0x7f03e809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.444+0000 7f03e6d9d700 1 -- 172.21.15.26:0/3312709396 >> v1:172.21.15.26:6789/0 conn(0x7f03e809e000 legacy=0x7f03e8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:40.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.444+0000 7f03e6d9d700 1 -- 172.21.15.26:0/3312709396 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e809b2d0 con 0x7f03e809e410 2023-10-01T08:00:40.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.444+0000 7f03e6d9d700 1 --2- 172.21.15.26:0/3312709396 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03e809e410 0x7f03e8130d70 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f03e0009dc0 tx=0x7f03e000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9f739c524093d7a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:40.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.444+0000 7f03e559a700 1 -- 172.21.15.26:0/3312709396 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e000e070 con 0x7f03e809e410 2023-10-01T08:00:40.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.444+0000 7f03e559a700 1 -- 172.21.15.26:0/3312709396 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e000bae0 con 0x7f03e809e410 2023-10-01T08:00:40.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.444+0000 7f03e559a700 1 -- 172.21.15.26:0/3312709396 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e000be90 con 0x7f03e809e410 2023-10-01T08:00:40.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.445+0000 7f03ec897700 1 -- 172.21.15.26:0/3312709396 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03e809e410 msgr2=0x7f03e8130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:40.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.445+0000 7f03ec897700 1 --2- 172.21.15.26:0/3312709396 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03e809e410 0x7f03e8130d70 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f03e0009dc0 tx=0x7f03e000b330 comp rx=0 tx=0).stop 2023-10-01T08:00:40.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.445+0000 7f03ec897700 1 -- 172.21.15.26:0/3312709396 shutdown_connections 2023-10-01T08:00:40.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.445+0000 7f03ec897700 1 --2- 172.21.15.26:0/3312709396 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03e809e410 0x7f03e8130d70 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.445+0000 7f03ec897700 1 --2- 172.21.15.26:0/3312709396 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03e809d6f0 0x7f03e809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.445+0000 7f03ec897700 1 -- 172.21.15.26:0/3312709396 >> 172.21.15.26:0/3312709396 conn(0x7f03e8066f50 msgr2=0x7f03e809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:40.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.445+0000 7f03ec897700 1 -- 172.21.15.26:0/3312709396 shutdown_connections 2023-10-01T08:00:40.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.445+0000 7f03ec897700 1 -- 172.21.15.26:0/3312709396 wait complete. 2023-10-01T08:00:40.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.446+0000 7f03ec897700 1 Processor -- start 2023-10-01T08:00:40.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.446+0000 7f03ec897700 1 -- start start 2023-10-01T08:00:40.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.447+0000 7f03ec897700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03e809d6f0 0x7f03e811ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:40.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.447+0000 7f03ec897700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03e809e000 0x7f03e81204c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:40.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.447+0000 7f03ec897700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03e809e410 0x7f03e8120a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:40.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.447+0000 7f03ec897700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e8123a10 con 0x7f03e809d6f0 2023-10-01T08:00:40.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.447+0000 7f03ec897700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e8122360 con 0x7f03e809e000 2023-10-01T08:00:40.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.447+0000 7f03ec897700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03e81231a0 con 0x7f03e809e410 2023-10-01T08:00:40.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.447+0000 7f03e5d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03e809e000 0x7f03e81204c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:40.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.447+0000 7f03e5d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03e809e000 0x7f03e81204c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42620/0 (socket says 172.21.15.26:42620) 2023-10-01T08:00:40.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.447+0000 7f03e5d9b700 1 -- 172.21.15.26:0/2510438643 learned_addr learned my addr 172.21.15.26:0/2510438643 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:40.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.447+0000 7f03e6d9d700 1 --2- 172.21.15.26:0/2510438643 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03e809e410 0x7f03e8120a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:40.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.447+0000 7f03e659c700 1 --2- 172.21.15.26:0/2510438643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03e809d6f0 0x7f03e811ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:40.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.447+0000 7f03e6d9d700 1 -- 172.21.15.26:0/2510438643 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03e809e000 msgr2=0x7f03e81204c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:40.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.447+0000 7f03e6d9d700 1 --2- 172.21.15.26:0/2510438643 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03e809e000 0x7f03e81204c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.447+0000 7f03e6d9d700 1 -- 172.21.15.26:0/2510438643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03e809d6f0 msgr2=0x7f03e811ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:40.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.447+0000 7f03e6d9d700 1 --2- 172.21.15.26:0/2510438643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03e809d6f0 0x7f03e811ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.447+0000 7f03e6d9d700 1 -- 172.21.15.26:0/2510438643 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e0009a70 con 0x7f03e809e410 2023-10-01T08:00:40.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.447+0000 7f03e659c700 1 --2- 172.21.15.26:0/2510438643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03e809d6f0 0x7f03e811ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T08:00:40.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.447+0000 7f03e6d9d700 1 --2- 172.21.15.26:0/2510438643 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03e809e410 0x7f03e8120a00 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f03e0015000 tx=0x7f03e0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:40.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.448+0000 7f03d6ffd700 1 -- 172.21.15.26:0/2510438643 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e00045c0 con 0x7f03e809e410 2023-10-01T08:00:40.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.448+0000 7f03d6ffd700 1 -- 172.21.15.26:0/2510438643 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e0004740 con 0x7f03e809e410 2023-10-01T08:00:40.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.448+0000 7f03ec897700 1 -- 172.21.15.26:0/2510438643 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e809c700 con 0x7f03e809e410 2023-10-01T08:00:40.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.448+0000 7f03d6ffd700 1 -- 172.21.15.26:0/2510438643 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e0012430 con 0x7f03e809e410 2023-10-01T08:00:40.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.448+0000 7f03ec897700 1 -- 172.21.15.26:0/2510438643 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03e81302b0 con 0x7f03e809e410 2023-10-01T08:00:40.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.448+0000 7f03d6ffd700 1 -- 172.21.15.26:0/2510438643 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f03e0012590 con 0x7f03e809e410 2023-10-01T08:00:40.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.449+0000 7f03d6ffd700 1 -- 172.21.15.26:0/2510438643 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f03e0041660 con 0x7f03e809e410 2023-10-01T08:00:40.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.449+0000 7f03ec897700 1 -- 172.21.15.26:0/2510438643 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03e8123530 con 0x7f03e809e410 2023-10-01T08:00:40.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.454+0000 7f03d6ffd700 1 -- 172.21.15.26:0/2510438643 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f03e0011980 con 0x7f03e809e410 2023-10-01T08:00:40.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.499+0000 7f0f350be700 1 Processor -- start 2023-10-01T08:00:40.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.499+0000 7f0f350be700 1 -- start start 2023-10-01T08:00:40.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.500+0000 7f0f350be700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f3009d6f0 0x7f0f3009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:40.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.500+0000 7f0f350be700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0f3009e000 0x7f0f301339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:40.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.500+0000 7f0f350be700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f3009b120 con 0x7f0f3009e410 2023-10-01T08:00:40.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.500+0000 7f0f350be700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f3006b460 con 0x7f0f3009e000 2023-10-01T08:00:40.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.500+0000 7f0f350be700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3009a7e0 con 0x7f0f3009d6f0 2023-10-01T08:00:40.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.500+0000 7f0f2ed9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f3009d6f0 0x7f0f3009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:40.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.500+0000 7f0f2e59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0f3009e000 0x7f0f301339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:40.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.500+0000 7f0f2ed9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f3009d6f0 0x7f0f3009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44718/0 (socket says 172.21.15.26:44718) 2023-10-01T08:00:40.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.500+0000 7f0f2ed9d700 1 -- 172.21.15.26:0/792743871 learned_addr learned my addr 172.21.15.26:0/792743871 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:40.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.501+0000 7f0f2e59c700 1 -- 172.21.15.26:0/792743871 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f3009d6f0 msgr2=0x7f0f3009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:40.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.501+0000 7f0f2e59c700 1 --2- 172.21.15.26:0/792743871 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f3009d6f0 0x7f0f3009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.501+0000 7f0f2e59c700 1 -- 172.21.15.26:0/792743871 >> v1:172.21.15.26:6789/0 conn(0x7f0f3009e410 legacy=0x7f0f30133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:40.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.501+0000 7f0f2e59c700 1 -- 172.21.15.26:0/792743871 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3009a500 con 0x7f0f3009e000 2023-10-01T08:00:40.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.501+0000 7f0f2ed9d700 1 --2- 172.21.15.26:0/792743871 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f3009d6f0 0x7f0f3009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:40.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.501+0000 7f0f2e59c700 1 --2- 172.21.15.26:0/792743871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f3009e000 0x7f0f301339f0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f0f24009840 tx=0x7f0f24009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a57fb6dc3196b7a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:40.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.501+0000 7f0f2dd9b700 1 -- 172.21.15.26:0/792743871 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f24011830 con 0x7f0f3009e000 2023-10-01T08:00:40.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.501+0000 7f0f2dd9b700 1 -- 172.21.15.26:0/792743871 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f24011990 con 0x7f0f3009e000 2023-10-01T08:00:40.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.501+0000 7f0f2dd9b700 1 -- 172.21.15.26:0/792743871 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f24011d20 con 0x7f0f3009e000 2023-10-01T08:00:40.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.502+0000 7f0f350be700 1 -- 172.21.15.26:0/792743871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f3009e000 msgr2=0x7f0f301339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:40.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.502+0000 7f0f350be700 1 --2- 172.21.15.26:0/792743871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f3009e000 0x7f0f301339f0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f0f24009840 tx=0x7f0f24009b50 comp rx=0 tx=0).stop 2023-10-01T08:00:40.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.502+0000 7f0f350be700 1 -- 172.21.15.26:0/792743871 shutdown_connections 2023-10-01T08:00:40.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.502+0000 7f0f350be700 1 --2- 172.21.15.26:0/792743871 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f3009d6f0 0x7f0f3009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.502+0000 7f0f350be700 1 --2- 172.21.15.26:0/792743871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f3009e000 0x7f0f301339f0 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.502+0000 7f0f350be700 1 -- 172.21.15.26:0/792743871 >> 172.21.15.26:0/792743871 conn(0x7f0f30066f50 msgr2=0x7f0f3009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:40.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.502+0000 7f0f350be700 1 -- 172.21.15.26:0/792743871 shutdown_connections 2023-10-01T08:00:40.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.502+0000 7f0f350be700 1 -- 172.21.15.26:0/792743871 wait complete. 2023-10-01T08:00:40.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.504+0000 7f0f350be700 1 Processor -- start 2023-10-01T08:00:40.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.504+0000 7f0f350be700 1 -- start start 2023-10-01T08:00:40.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.505+0000 7f0f350be700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f3009d6f0 0x7f0f301a5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:40.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.505+0000 7f0f350be700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f3009e000 0x7f0f301a6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:40.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.505+0000 7f0f350be700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f3009e410 0x7f0f301a6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:40.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.505+0000 7f0f350be700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f301a93e0 con 0x7f0f3009e000 2023-10-01T08:00:40.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.505+0000 7f0f350be700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f301a7b80 con 0x7f0f3009e410 2023-10-01T08:00:40.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.505+0000 7f0f350be700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3009c710 con 0x7f0f3009d6f0 2023-10-01T08:00:40.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.505+0000 7f0f2ed9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f3009d6f0 0x7f0f301a5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:40.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.505+0000 7f0f2ed9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f3009d6f0 0x7f0f301a5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44724/0 (socket says 172.21.15.26:44724) 2023-10-01T08:00:40.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.505+0000 7f0f2ed9d700 1 -- 172.21.15.26:0/1141303651 learned_addr learned my addr 172.21.15.26:0/1141303651 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:40.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.505+0000 7f0f2e59c700 1 --2- 172.21.15.26:0/1141303651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f3009e000 0x7f0f301a6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:40.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.505+0000 7f0f2ed9d700 1 -- 172.21.15.26:0/1141303651 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f3009e410 msgr2=0x7f0f301a6970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T08:00:40.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.505+0000 7f0f2ed9d700 1 --2- 172.21.15.26:0/1141303651 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f3009e410 0x7f0f301a6970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.505+0000 7f0f2ed9d700 1 -- 172.21.15.26:0/1141303651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f3009e000 msgr2=0x7f0f301a6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:40.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.505+0000 7f0f2ed9d700 1 --2- 172.21.15.26:0/1141303651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f3009e000 0x7f0f301a6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.505+0000 7f0f2ed9d700 1 -- 172.21.15.26:0/1141303651 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f20009550 con 0x7f0f3009d6f0 2023-10-01T08:00:40.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.505+0000 7f0f2ed9d700 1 --2- 172.21.15.26:0/1141303651 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f3009d6f0 0x7f0f301a5ef0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f0f2000ebe0 tx=0x7f0f2000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:40.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.506+0000 7f0f177fe700 1 -- 172.21.15.26:0/1141303651 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2000c850 con 0x7f0f3009d6f0 2023-10-01T08:00:40.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.506+0000 7f0f177fe700 1 -- 172.21.15.26:0/1141303651 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2000c9b0 con 0x7f0f3009d6f0 2023-10-01T08:00:40.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.506+0000 7f0f177fe700 1 -- 172.21.15.26:0/1141303651 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2000cd20 con 0x7f0f3009d6f0 2023-10-01T08:00:40.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.506+0000 7f0f350be700 1 -- 172.21.15.26:0/1141303651 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f240094a0 con 0x7f0f3009d6f0 2023-10-01T08:00:40.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.506+0000 7f0f350be700 1 -- 172.21.15.26:0/1141303651 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f301a8870 con 0x7f0f3009d6f0 2023-10-01T08:00:40.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.507+0000 7f0f177fe700 1 -- 172.21.15.26:0/1141303651 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f20013470 con 0x7f0f3009d6f0 2023-10-01T08:00:40.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.507+0000 7f0f177fe700 1 -- 172.21.15.26:0/1141303651 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0f2003fc30 con 0x7f0f3009d6f0 2023-10-01T08:00:40.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.507+0000 7f0f350be700 1 -- 172.21.15.26:0/1141303651 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f30074ea0 con 0x7f0f3009d6f0 2023-10-01T08:00:40.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.517+0000 7f0f177fe700 1 -- 172.21.15.26:0/1141303651 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f2001b3b0 con 0x7f0f3009d6f0 2023-10-01T08:00:40.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.573+0000 7fb208434700 1 -- 172.21.15.26:0/1722926619 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb200074ea0 con 0x7fb200138dc0 2023-10-01T08:00:40.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.573+0000 7fb1f6ffd700 1 -- 172.21.15.26:0/1722926619 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb1f8012340 con 0x7fb200138dc0 2023-10-01T08:00:40.574 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:40.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.576+0000 7fb208434700 1 -- 172.21.15.26:0/1722926619 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb200138dc0 msgr2=0x7fb20009c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:40.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.576+0000 7fb208434700 1 --2- 172.21.15.26:0/1722926619 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb200138dc0 0x7fb20009c480 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fb1f800efc0 tx=0x7fb1f800c3a0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.576+0000 7fb208434700 1 -- 172.21.15.26:0/1722926619 shutdown_connections 2023-10-01T08:00:40.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.576+0000 7fb208434700 1 --2- 172.21.15.26:0/1722926619 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb200138dc0 0x7fb20009c480 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.576+0000 7fb208434700 1 --2- 172.21.15.26:0/1722926619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb200133420 0x7fb200137810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.576+0000 7fb208434700 1 --2- 172.21.15.26:0/1722926619 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb2001337f0 0x7fb200137d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.576+0000 7fb208434700 1 -- 172.21.15.26:0/1722926619 >> 172.21.15.26:0/1722926619 conn(0x7fb2000a4210 msgr2=0x7fb2000a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:40.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.576+0000 7fb208434700 1 -- 172.21.15.26:0/1722926619 shutdown_connections 2023-10-01T08:00:40.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.576+0000 7fb208434700 1 -- 172.21.15.26:0/1722926619 wait complete. 2023-10-01T08:00:40.591 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:40.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.668+0000 7f03ec897700 1 -- 172.21.15.26:0/2510438643 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f03e8074ea0 con 0x7f03e809e410 2023-10-01T08:00:40.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.668+0000 7f03d6ffd700 1 -- 172.21.15.26:0/2510438643 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f03e0034090 con 0x7f03e809e410 2023-10-01T08:00:40.669 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:40.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.670+0000 7f03ec897700 1 -- 172.21.15.26:0/2510438643 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03e809e410 msgr2=0x7f03e8120a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:40.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.670+0000 7f03ec897700 1 --2- 172.21.15.26:0/2510438643 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03e809e410 0x7f03e8120a00 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f03e0015000 tx=0x7f03e0004ad0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.670+0000 7f03ec897700 1 -- 172.21.15.26:0/2510438643 shutdown_connections 2023-10-01T08:00:40.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.670+0000 7f03ec897700 1 --2- 172.21.15.26:0/2510438643 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f03e809e410 0x7f03e8120a00 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.670+0000 7f03ec897700 1 --2- 172.21.15.26:0/2510438643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03e809d6f0 0x7f03e811ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.670+0000 7f03ec897700 1 --2- 172.21.15.26:0/2510438643 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03e809e000 0x7f03e81204c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.670+0000 7f03ec897700 1 -- 172.21.15.26:0/2510438643 >> 172.21.15.26:0/2510438643 conn(0x7f03e8066f50 msgr2=0x7f03e806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:40.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.671+0000 7f03ec897700 1 -- 172.21.15.26:0/2510438643 shutdown_connections 2023-10-01T08:00:40.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.671+0000 7f03ec897700 1 -- 172.21.15.26:0/2510438643 wait complete. 2023-10-01T08:00:40.685 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:40.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.722+0000 7f0f350be700 1 -- 172.21.15.26:0/1141303651 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0f301a9550 con 0x7f0f3009d6f0 2023-10-01T08:00:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.722+0000 7f0f177fe700 1 -- 172.21.15.26:0/1141303651 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0f20017030 con 0x7f0f3009d6f0 2023-10-01T08:00:40.723 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:40.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.724+0000 7f0f350be700 1 -- 172.21.15.26:0/1141303651 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f3009d6f0 msgr2=0x7f0f301a5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:40.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.724+0000 7f0f350be700 1 --2- 172.21.15.26:0/1141303651 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f3009d6f0 0x7f0f301a5ef0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f0f2000ebe0 tx=0x7f0f2000eef0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.725+0000 7f0f350be700 1 -- 172.21.15.26:0/1141303651 shutdown_connections 2023-10-01T08:00:40.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.725+0000 7f0f350be700 1 --2- 172.21.15.26:0/1141303651 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f3009e410 0x7f0f301a6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.725+0000 7f0f350be700 1 --2- 172.21.15.26:0/1141303651 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f3009d6f0 0x7f0f301a5ef0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.725+0000 7f0f350be700 1 --2- 172.21.15.26:0/1141303651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f3009e000 0x7f0f301a6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:40.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.725+0000 7f0f350be700 1 -- 172.21.15.26:0/1141303651 >> 172.21.15.26:0/1141303651 conn(0x7f0f30066f50 msgr2=0x7f0f301baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:40.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.725+0000 7f0f350be700 1 -- 172.21.15.26:0/1141303651 shutdown_connections 2023-10-01T08:00:40.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:40.725+0000 7f0f350be700 1 -- 172.21.15.26:0/1141303651 wait complete. 2023-10-01T08:00:40.739 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:41.246 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:41.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.391+0000 7f7dd9224700 1 Processor -- start 2023-10-01T08:00:41.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.391+0000 7f7dd9224700 1 -- start start 2023-10-01T08:00:41.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.392+0000 7f7dd9224700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7dd406a770 0x7f7dd406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:41.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.392+0000 7f7dd9224700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7dd406b080 0x7f7dd4131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:41.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.392+0000 7f7dd9224700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd409ece0 con 0x7f7dd4131b40 2023-10-01T08:00:41.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.392+0000 7f7dd9224700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd409e760 con 0x7f7dd406a770 2023-10-01T08:00:41.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.392+0000 7f7dd9224700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd409e040 con 0x7f7dd406b080 2023-10-01T08:00:41.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.392+0000 7f7dd2d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7dd406a770 0x7f7dd406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:41.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.392+0000 7f7dd259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7dd406b080 0x7f7dd4131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:41.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.392+0000 7f7dd2d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7dd406a770 0x7f7dd406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53484/0 (socket says 172.21.15.26:53484) 2023-10-01T08:00:41.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.392+0000 7f7dd259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7dd406b080 0x7f7dd4131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42634/0 (socket says 172.21.15.26:42634) 2023-10-01T08:00:41.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.392+0000 7f7dd2d9d700 1 -- 172.21.15.26:0/2993880298 learned_addr learned my addr 172.21.15.26:0/2993880298 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:41.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.392+0000 7f7dd259c700 1 -- 172.21.15.26:0/2993880298 >> v2:172.21.15.26:3300/0 conn(0x7f7dd406a770 msgr2=0x7f7dd406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:41.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.392+0000 7f7dd259c700 1 --2- 172.21.15.26:0/2993880298 >> v2:172.21.15.26:3300/0 conn(0x7f7dd406a770 0x7f7dd406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:41.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.392+0000 7f7dd259c700 1 -- 172.21.15.26:0/2993880298 >> v1:172.21.15.26:6789/0 conn(0x7f7dd4131b40 legacy=0x7f7dd4138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:41.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.392+0000 7f7dd259c700 1 -- 172.21.15.26:0/2993880298 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd409f630 con 0x7f7dd406b080 2023-10-01T08:00:41.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.392+0000 7f7dd2d9d700 1 --2- 172.21.15.26:0/2993880298 >> v2:172.21.15.26:3300/0 conn(0x7f7dd406a770 0x7f7dd406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:41.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.393+0000 7f7dd259c700 1 --2- 172.21.15.26:0/2993880298 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7dd406b080 0x7f7dd4131600 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8009840 tx=0x7f7dc8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49103595ea1c90e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:41.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.393+0000 7f7dd1d9b700 1 -- 172.21.15.26:0/2993880298 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8011830 con 0x7f7dd406b080 2023-10-01T08:00:41.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.393+0000 7f7dd1d9b700 1 -- 172.21.15.26:0/2993880298 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc8011990 con 0x7f7dd406b080 2023-10-01T08:00:41.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.393+0000 7f7dd1d9b700 1 -- 172.21.15.26:0/2993880298 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8011d20 con 0x7f7dd406b080 2023-10-01T08:00:41.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.393+0000 7f7dd9224700 1 -- 172.21.15.26:0/2993880298 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7dd406b080 msgr2=0x7f7dd4131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:41.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.393+0000 7f7dd9224700 1 --2- 172.21.15.26:0/2993880298 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7dd406b080 0x7f7dd4131600 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8009840 tx=0x7f7dc8009b50 comp rx=0 tx=0).stop 2023-10-01T08:00:41.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.393+0000 7f7dd9224700 1 -- 172.21.15.26:0/2993880298 shutdown_connections 2023-10-01T08:00:41.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.393+0000 7f7dd9224700 1 --2- 172.21.15.26:0/2993880298 >> v2:172.21.15.26:3300/0 conn(0x7f7dd406a770 0x7f7dd406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:41.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.393+0000 7f7dd9224700 1 --2- 172.21.15.26:0/2993880298 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7dd406b080 0x7f7dd4131600 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:41.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.393+0000 7f7dd9224700 1 -- 172.21.15.26:0/2993880298 >> 172.21.15.26:0/2993880298 conn(0x7f7dd4066f50 msgr2=0x7f7dd409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:41.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.393+0000 7f7dd9224700 1 -- 172.21.15.26:0/2993880298 shutdown_connections 2023-10-01T08:00:41.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.393+0000 7f7dd9224700 1 -- 172.21.15.26:0/2993880298 wait complete. 2023-10-01T08:00:41.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.395+0000 7f7dd9224700 1 Processor -- start 2023-10-01T08:00:41.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.395+0000 7f7dd9224700 1 -- start start 2023-10-01T08:00:41.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.395+0000 7f7dd9224700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7dd406a770 0x7f7dd41c6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:41.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.395+0000 7f7dd9224700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7dd406b080 0x7f7dd41c6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:41.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.395+0000 7f7dd9224700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dd4131b40 0x7f7dd41c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:41.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.395+0000 7f7dd9224700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd411ee10 con 0x7f7dd4131b40 2023-10-01T08:00:41.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.395+0000 7f7dd9224700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd4131140 con 0x7f7dd406a770 2023-10-01T08:00:41.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.395+0000 7f7dd9224700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd411e320 con 0x7f7dd406b080 2023-10-01T08:00:41.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.395+0000 7f7dd359e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dd4131b40 0x7f7dd41c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:41.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.395+0000 7f7dd259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7dd406b080 0x7f7dd41c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:41.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.396+0000 7f7dd259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7dd406b080 0x7f7dd41c6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44730/0 (socket says 172.21.15.26:44730) 2023-10-01T08:00:41.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.396+0000 7f7dd259c700 1 -- 172.21.15.26:0/3971926184 learned_addr learned my addr 172.21.15.26:0/3971926184 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:41.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.396+0000 7f7dd2d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7dd406a770 0x7f7dd41c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:41.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.396+0000 7f7dd259c700 1 -- 172.21.15.26:0/3971926184 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7dd406a770 msgr2=0x7f7dd41c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:41.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.396+0000 7f7dd259c700 1 --2- 172.21.15.26:0/3971926184 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7dd406a770 0x7f7dd41c6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:41.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.396+0000 7f7dd259c700 1 -- 172.21.15.26:0/3971926184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dd4131b40 msgr2=0x7f7dd41c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:41.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.396+0000 7f7dd259c700 1 --2- 172.21.15.26:0/3971926184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dd4131b40 0x7f7dd41c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:41.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.396+0000 7f7dd259c700 1 -- 172.21.15.26:0/3971926184 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc4009550 con 0x7f7dd406b080 2023-10-01T08:00:41.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.396+0000 7f7dd359e700 1 --2- 172.21.15.26:0/3971926184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dd4131b40 0x7f7dd41c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:41.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.396+0000 7f7dd259c700 1 --2- 172.21.15.26:0/3971926184 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7dd406b080 0x7f7dd41c6580 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f7dc80090b0 tx=0x7f7dc8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:41.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.396+0000 7f7dbb7fe700 1 -- 172.21.15.26:0/3971926184 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc80036a0 con 0x7f7dd406b080 2023-10-01T08:00:41.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.396+0000 7f7dbb7fe700 1 -- 172.21.15.26:0/3971926184 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc801f070 con 0x7f7dd406b080 2023-10-01T08:00:41.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.396+0000 7f7dbb7fe700 1 -- 172.21.15.26:0/3971926184 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8003a60 con 0x7f7dd406b080 2023-10-01T08:00:41.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.396+0000 7f7dd9224700 1 -- 172.21.15.26:0/3971926184 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc80094a0 con 0x7f7dd406b080 2023-10-01T08:00:41.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.396+0000 7f7dd9224700 1 -- 172.21.15.26:0/3971926184 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd411fdd0 con 0x7f7dd406b080 2023-10-01T08:00:41.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.397+0000 7f7dbb7fe700 1 -- 172.21.15.26:0/3971926184 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7dc8003bc0 con 0x7f7dd406b080 2023-10-01T08:00:41.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.397+0000 7f7dbb7fe700 1 -- 172.21.15.26:0/3971926184 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7dc8021070 con 0x7f7dd406b080 2023-10-01T08:00:41.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.398+0000 7f7dd9224700 1 -- 172.21.15.26:0/3971926184 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd4074ea0 con 0x7f7dd406b080 2023-10-01T08:00:41.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.402+0000 7f7dbb7fe700 1 -- 172.21.15.26:0/3971926184 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7dc801a950 con 0x7f7dd406b080 2023-10-01T08:00:41.592 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:41.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.608+0000 7f7dd9224700 1 -- 172.21.15.26:0/3971926184 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7dd406c360 con 0x7f7dd406b080 2023-10-01T08:00:41.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.609+0000 7f7dbb7fe700 1 -- 172.21.15.26:0/3971926184 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7dc8015020 con 0x7f7dd406b080 2023-10-01T08:00:41.610 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:41.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.611+0000 7f7dd9224700 1 -- 172.21.15.26:0/3971926184 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7dd406b080 msgr2=0x7f7dd41c6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:41.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.611+0000 7f7dd9224700 1 --2- 172.21.15.26:0/3971926184 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7dd406b080 0x7f7dd41c6580 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f7dc80090b0 tx=0x7f7dc8004750 comp rx=0 tx=0).stop 2023-10-01T08:00:41.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.611+0000 7f7dd9224700 1 -- 172.21.15.26:0/3971926184 shutdown_connections 2023-10-01T08:00:41.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.611+0000 7f7dd9224700 1 --2- 172.21.15.26:0/3971926184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dd4131b40 0x7f7dd41c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:41.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.611+0000 7f7dd9224700 1 --2- 172.21.15.26:0/3971926184 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7dd406a770 0x7f7dd41c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:41.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.611+0000 7f7dd9224700 1 --2- 172.21.15.26:0/3971926184 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7dd406b080 0x7f7dd41c6580 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:41.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.611+0000 7f7dd9224700 1 -- 172.21.15.26:0/3971926184 >> 172.21.15.26:0/3971926184 conn(0x7f7dd4066f50 msgr2=0x7f7dd4070200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:41.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.612+0000 7f7dd9224700 1 -- 172.21.15.26:0/3971926184 shutdown_connections 2023-10-01T08:00:41.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.612+0000 7f7dd9224700 1 -- 172.21.15.26:0/3971926184 wait complete. 2023-10-01T08:00:41.628 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:41.685 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:41.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.730+0000 7f7b243b2700 1 Processor -- start 2023-10-01T08:00:41.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.730+0000 7f7b243b2700 1 -- start start 2023-10-01T08:00:41.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.730+0000 7f7b243b2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7b1c0a0a30 0x7f7b1c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:41.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.730+0000 7f7b243b2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7b1c0a1340 0x7f7b1c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:41.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.730+0000 7f7b243b2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7b1c133fa0 0x7f7b1c134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:41.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.730+0000 7f7b243b2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b1c09edd0 con 0x7f7b1c0a1340 2023-10-01T08:00:41.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.730+0000 7f7b243b2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c09e1f0 con 0x7f7b1c133fa0 2023-10-01T08:00:41.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.730+0000 7f7b243b2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c09dc50 con 0x7f7b1c0a0a30 2023-10-01T08:00:41.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.731+0000 7f7b2194d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7b1c0a1340 0x7f7b1c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:41.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.731+0000 7f7b2214e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7b1c0a0a30 0x7f7b1c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:41.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.731+0000 7f7b2294f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7b1c133fa0 0x7f7b1c134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:41.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.731+0000 7f7b2214e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7b1c0a0a30 0x7f7b1c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44742/0 (socket says 172.21.15.26:44742) 2023-10-01T08:00:41.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.731+0000 7f7b2194d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7b1c0a1340 0x7f7b1c133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53512/0 (socket says 172.21.15.26:53512) 2023-10-01T08:00:41.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.731+0000 7f7b2214e700 1 -- 172.21.15.26:0/2373737275 learned_addr learned my addr 172.21.15.26:0/2373737275 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:41.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.731+0000 7f7b2294f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7b1c133fa0 0x7f7b1c134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42654/0 (socket says 172.21.15.26:42654) 2023-10-01T08:00:41.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.731+0000 7f7b2214e700 1 -- 172.21.15.26:0/2373737275 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7b1c133fa0 msgr2=0x7f7b1c134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:41.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.731+0000 7f7b2214e700 1 --2- 172.21.15.26:0/2373737275 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7b1c133fa0 0x7f7b1c134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:41.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.731+0000 7f7b2214e700 1 -- 172.21.15.26:0/2373737275 >> v2:172.21.15.26:3300/0 conn(0x7f7b1c0a1340 msgr2=0x7f7b1c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:41.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.731+0000 7f7b2214e700 1 --2- 172.21.15.26:0/2373737275 >> v2:172.21.15.26:3300/0 conn(0x7f7b1c0a1340 0x7f7b1c133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:41.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.731+0000 7f7b2214e700 1 -- 172.21.15.26:0/2373737275 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1c0a1fe0 con 0x7f7b1c0a0a30 2023-10-01T08:00:41.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.731+0000 7f7b2294f700 1 --2- 172.21.15.26:0/2373737275 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7b1c133fa0 0x7f7b1c134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:41.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.731+0000 7f7b2194d700 1 --2- 172.21.15.26:0/2373737275 >> v2:172.21.15.26:3300/0 conn(0x7f7b1c0a1340 0x7f7b1c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:41.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.731+0000 7f7b2214e700 1 --2- 172.21.15.26:0/2373737275 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7b1c0a0a30 0x7f7b1c0a0e00 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c009920 tx=0x7f7b0c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1e5083f7f709ab4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:41.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.731+0000 7f7b2114c700 1 -- 172.21.15.26:0/2373737275 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c011830 con 0x7f7b1c0a0a30 2023-10-01T08:00:41.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.731+0000 7f7b2114c700 1 -- 172.21.15.26:0/2373737275 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0c011990 con 0x7f7b1c0a0a30 2023-10-01T08:00:41.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.731+0000 7f7b2114c700 1 -- 172.21.15.26:0/2373737275 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c011d20 con 0x7f7b1c0a0a30 2023-10-01T08:00:41.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.732+0000 7f7b243b2700 1 -- 172.21.15.26:0/2373737275 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7b1c0a0a30 msgr2=0x7f7b1c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:41.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.732+0000 7f7b243b2700 1 --2- 172.21.15.26:0/2373737275 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7b1c0a0a30 0x7f7b1c0a0e00 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c009920 tx=0x7f7b0c009c30 comp rx=0 tx=0).stop 2023-10-01T08:00:41.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.732+0000 7f7b243b2700 1 -- 172.21.15.26:0/2373737275 shutdown_connections 2023-10-01T08:00:41.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.732+0000 7f7b243b2700 1 --2- 172.21.15.26:0/2373737275 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7b1c133fa0 0x7f7b1c134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:41.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.732+0000 7f7b243b2700 1 --2- 172.21.15.26:0/2373737275 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7b1c0a0a30 0x7f7b1c0a0e00 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:41.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.732+0000 7f7b243b2700 1 --2- 172.21.15.26:0/2373737275 >> v2:172.21.15.26:3300/0 conn(0x7f7b1c0a1340 0x7f7b1c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:41.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.732+0000 7f7b243b2700 1 -- 172.21.15.26:0/2373737275 >> 172.21.15.26:0/2373737275 conn(0x7f7b1c0a6550 msgr2=0x7f7b1c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:41.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.732+0000 7f7b243b2700 1 -- 172.21.15.26:0/2373737275 shutdown_connections 2023-10-01T08:00:41.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.732+0000 7f7b243b2700 1 -- 172.21.15.26:0/2373737275 wait complete. 2023-10-01T08:00:41.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.733+0000 7f7b243b2700 1 Processor -- start 2023-10-01T08:00:41.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.733+0000 7f7b243b2700 1 -- start start 2023-10-01T08:00:41.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.734+0000 7f7b243b2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7b1c0a0a30 0x7f7b1c120760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:41.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.734+0000 7f7b243b2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b1c0a1340 0x7f7b1c120ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:41.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.734+0000 7f7b243b2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7b1c133fa0 0x7f7b1c1211e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:41.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.734+0000 7f7b243b2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c122370 con 0x7f7b1c0a1340 2023-10-01T08:00:41.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.734+0000 7f7b243b2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c122990 con 0x7f7b1c133fa0 2023-10-01T08:00:41.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.734+0000 7f7b243b2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c1235c0 con 0x7f7b1c0a0a30 2023-10-01T08:00:41.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.734+0000 7f7b2214e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7b1c0a0a30 0x7f7b1c120760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:41.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.734+0000 7f7b2214e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7b1c0a0a30 0x7f7b1c120760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44744/0 (socket says 172.21.15.26:44744) 2023-10-01T08:00:41.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.734+0000 7f7b2214e700 1 -- 172.21.15.26:0/1941885026 learned_addr learned my addr 172.21.15.26:0/1941885026 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:41.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.734+0000 7f7b2294f700 1 --2- 172.21.15.26:0/1941885026 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7b1c133fa0 0x7f7b1c1211e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:41.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.734+0000 7f7b2194d700 1 --2- 172.21.15.26:0/1941885026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b1c0a1340 0x7f7b1c120ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:41.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.734+0000 7f7b2214e700 1 -- 172.21.15.26:0/1941885026 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7b1c133fa0 msgr2=0x7f7b1c1211e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:41.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.734+0000 7f7b2214e700 1 --2- 172.21.15.26:0/1941885026 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7b1c133fa0 0x7f7b1c1211e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:41.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.734+0000 7f7b2214e700 1 -- 172.21.15.26:0/1941885026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b1c0a1340 msgr2=0x7f7b1c120ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:41.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.734+0000 7f7b2214e700 1 --2- 172.21.15.26:0/1941885026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b1c0a1340 0x7f7b1c120ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:41.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.734+0000 7f7b2214e700 1 -- 172.21.15.26:0/1941885026 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b100094a0 con 0x7f7b1c0a0a30 2023-10-01T08:00:41.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.734+0000 7f7b2294f700 1 --2- 172.21.15.26:0/1941885026 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7b1c133fa0 0x7f7b1c1211e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:41.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.735+0000 7f7b2214e700 1 --2- 172.21.15.26:0/1941885026 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7b1c0a0a30 0x7f7b1c120760 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0098f0 tx=0x7f7b0c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:41.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.735+0000 7f7b1affd700 1 -- 172.21.15.26:0/1941885026 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c004240 con 0x7f7b1c0a0a30 2023-10-01T08:00:41.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.735+0000 7f7b1affd700 1 -- 172.21.15.26:0/1941885026 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0c01f070 con 0x7f7b1c0a0a30 2023-10-01T08:00:41.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.735+0000 7f7b243b2700 1 -- 172.21.15.26:0/1941885026 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b14009a70 con 0x7f7b1c0a0a30 2023-10-01T08:00:41.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.735+0000 7f7b1affd700 1 -- 172.21.15.26:0/1941885026 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c0045e0 con 0x7f7b1c0a0a30 2023-10-01T08:00:41.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.735+0000 7f7b243b2700 1 -- 172.21.15.26:0/1941885026 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b0c009550 con 0x7f7b1c0a0a30 2023-10-01T08:00:41.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.736+0000 7f7b1affd700 1 -- 172.21.15.26:0/1941885026 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7b0c021030 con 0x7f7b1c0a0a30 2023-10-01T08:00:41.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.736+0000 7f7b243b2700 1 -- 172.21.15.26:0/1941885026 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b1c0a3600 con 0x7f7b1c0a0a30 2023-10-01T08:00:41.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.736+0000 7f7b1affd700 1 -- 172.21.15.26:0/1941885026 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7b0c040870 con 0x7f7b1c0a0a30 2023-10-01T08:00:41.740 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:41.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.741+0000 7f7b1affd700 1 -- 172.21.15.26:0/1941885026 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7b0c01a450 con 0x7f7b1c0a0a30 2023-10-01T08:00:41.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.827+0000 7f6c1879a700 1 Processor -- start 2023-10-01T08:00:41.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.827+0000 7f6c1879a700 1 -- start start 2023-10-01T08:00:41.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.827+0000 7f6c1879a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6c100a1510 0x7f6c10138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:41.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.827+0000 7f6c1879a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c10139250 0x7f6c1013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:41.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.827+0000 7f6c1879a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c1009edd0 con 0x7f6c100a0a30 2023-10-01T08:00:41.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.827+0000 7f6c1879a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c100a18e0 con 0x7f6c100a1510 2023-10-01T08:00:41.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.828+0000 7f6c1879a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1009e1f0 con 0x7f6c10139250 2023-10-01T08:00:41.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.828+0000 7f6c15d35700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6c100a1510 0x7f6c10138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:41.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.828+0000 7f6c15d35700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6c100a1510 0x7f6c10138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53526/0 (socket says 172.21.15.26:53526) 2023-10-01T08:00:41.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.828+0000 7f6c15d35700 1 -- 172.21.15.26:0/2780512483 learned_addr learned my addr 172.21.15.26:0/2780512483 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:41.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.828+0000 7f6c16d37700 1 --2- 172.21.15.26:0/2780512483 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c10139250 0x7f6c1013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:41.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.828+0000 7f6c15d35700 1 -- 172.21.15.26:0/2780512483 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c10139250 msgr2=0x7f6c1013b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:41.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.828+0000 7f6c15d35700 1 --2- 172.21.15.26:0/2780512483 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c10139250 0x7f6c1013b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:41.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.828+0000 7f6c15d35700 1 -- 172.21.15.26:0/2780512483 >> v1:172.21.15.26:6789/0 conn(0x7f6c100a0a30 legacy=0x7f6c100a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:41.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.828+0000 7f6c15d35700 1 -- 172.21.15.26:0/2780512483 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1009dc50 con 0x7f6c100a1510 2023-10-01T08:00:41.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.828+0000 7f6c15d35700 1 --2- 172.21.15.26:0/2780512483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c100a1510 0x7f6c10138d10 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f6c000098f0 tx=0x7f6c00009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98bda4d9b22f9d3c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:41.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.828+0000 7f6c15534700 1 -- 172.21.15.26:0/2780512483 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c00011830 con 0x7f6c100a1510 2023-10-01T08:00:41.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.828+0000 7f6c15534700 1 -- 172.21.15.26:0/2780512483 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c00011990 con 0x7f6c100a1510 2023-10-01T08:00:41.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.829+0000 7f6c15534700 1 -- 172.21.15.26:0/2780512483 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c00011d20 con 0x7f6c100a1510 2023-10-01T08:00:41.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.829+0000 7f6c1879a700 1 -- 172.21.15.26:0/2780512483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c100a1510 msgr2=0x7f6c10138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:41.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.829+0000 7f6c1879a700 1 --2- 172.21.15.26:0/2780512483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c100a1510 0x7f6c10138d10 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f6c000098f0 tx=0x7f6c00009c00 comp rx=0 tx=0).stop 2023-10-01T08:00:41.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.829+0000 7f6c1879a700 1 -- 172.21.15.26:0/2780512483 shutdown_connections 2023-10-01T08:00:41.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.829+0000 7f6c1879a700 1 --2- 172.21.15.26:0/2780512483 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c10139250 0x7f6c1013b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:41.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.829+0000 7f6c1879a700 1 --2- 172.21.15.26:0/2780512483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c100a1510 0x7f6c10138d10 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:41.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.829+0000 7f6c1879a700 1 -- 172.21.15.26:0/2780512483 >> 172.21.15.26:0/2780512483 conn(0x7f6c100a6550 msgr2=0x7f6c100a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:41.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.829+0000 7f6c1879a700 1 -- 172.21.15.26:0/2780512483 shutdown_connections 2023-10-01T08:00:41.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.829+0000 7f6c1879a700 1 -- 172.21.15.26:0/2780512483 wait complete. 2023-10-01T08:00:41.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.830+0000 7f6c1879a700 1 Processor -- start 2023-10-01T08:00:41.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.830+0000 7f6c1879a700 1 -- start start 2023-10-01T08:00:41.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.831+0000 7f6c1879a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c100a0a30 0x7f6c10137880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:41.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.831+0000 7f6c1879a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6c100a1510 0x7f6c10137dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:41.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.831+0000 7f6c1879a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c10139250 0x7f6c10122a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:41.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.831+0000 7f6c1879a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c10124800 con 0x7f6c100a0a30 2023-10-01T08:00:41.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.831+0000 7f6c1879a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c101267b0 con 0x7f6c10139250 2023-10-01T08:00:41.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.831+0000 7f6c1879a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c10138cb0 con 0x7f6c100a1510 2023-10-01T08:00:41.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.831+0000 7f6c16536700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c100a0a30 0x7f6c10137880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:41.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.831+0000 7f6c16536700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c100a0a30 0x7f6c10137880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53530/0 (socket says 172.21.15.26:53530) 2023-10-01T08:00:41.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.831+0000 7f6c16536700 1 -- 172.21.15.26:0/157445355 learned_addr learned my addr 172.21.15.26:0/157445355 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:41.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.831+0000 7f6c16d37700 1 --2- 172.21.15.26:0/157445355 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c10139250 0x7f6c10122a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:41.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.831+0000 7f6c15d35700 1 --2- 172.21.15.26:0/157445355 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6c100a1510 0x7f6c10137dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:41.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.831+0000 7f6c16d37700 1 -- 172.21.15.26:0/157445355 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6c100a1510 msgr2=0x7f6c10137dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:41.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.831+0000 7f6c16d37700 1 --2- 172.21.15.26:0/157445355 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6c100a1510 0x7f6c10137dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:41.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.831+0000 7f6c16d37700 1 -- 172.21.15.26:0/157445355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c100a0a30 msgr2=0x7f6c10137880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:41.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.831+0000 7f6c16d37700 1 --2- 172.21.15.26:0/157445355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c100a0a30 0x7f6c10137880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:41.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.831+0000 7f6c16d37700 1 -- 172.21.15.26:0/157445355 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c00009550 con 0x7f6c10139250 2023-10-01T08:00:41.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.832+0000 7f6c16d37700 1 --2- 172.21.15.26:0/157445355 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c10139250 0x7f6c10122a70 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800ef90 tx=0x7f6c0800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:41.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.832+0000 7f6c06ffd700 1 -- 172.21.15.26:0/157445355 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0800cc90 con 0x7f6c10139250 2023-10-01T08:00:41.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.832+0000 7f6c06ffd700 1 -- 172.21.15.26:0/157445355 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0800f040 con 0x7f6c10139250 2023-10-01T08:00:41.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.832+0000 7f6c1879a700 1 -- 172.21.15.26:0/157445355 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c10124c40 con 0x7f6c10139250 2023-10-01T08:00:41.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.832+0000 7f6c06ffd700 1 -- 172.21.15.26:0/157445355 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c080146c0 con 0x7f6c10139250 2023-10-01T08:00:41.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.832+0000 7f6c1879a700 1 -- 172.21.15.26:0/157445355 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c10138300 con 0x7f6c10139250 2023-10-01T08:00:41.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.833+0000 7f6c06ffd700 1 -- 172.21.15.26:0/157445355 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6c08014820 con 0x7f6c10139250 2023-10-01T08:00:41.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.833+0000 7f6c1879a700 1 -- 172.21.15.26:0/157445355 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c10074ea0 con 0x7f6c10139250 2023-10-01T08:00:41.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.833+0000 7f6c06ffd700 1 -- 172.21.15.26:0/157445355 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6c08040220 con 0x7f6c10139250 2023-10-01T08:00:41.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.842+0000 7f6c06ffd700 1 -- 172.21.15.26:0/157445355 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6c08007920 con 0x7f6c10139250 2023-10-01T08:00:41.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.883+0000 7f7c80bd4700 1 Processor -- start 2023-10-01T08:00:41.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.883+0000 7f7c80bd4700 1 -- start start 2023-10-01T08:00:41.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.884+0000 7f7c80bd4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c7c0a0a30 0x7f7c7c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:41.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.884+0000 7f7c80bd4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7c7c09d630 0x7f7c7c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:41.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.884+0000 7f7c80bd4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c7c0a2a70 con 0x7f7c7c133930 2023-10-01T08:00:41.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.884+0000 7f7c80bd4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c0a01d0 con 0x7f7c7c0a0a30 2023-10-01T08:00:41.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.884+0000 7f7c80bd4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c09e2b0 con 0x7f7c7c09d630 2023-10-01T08:00:41.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.884+0000 7f7c79d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7c7c09d630 0x7f7c7c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:41.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.884+0000 7f7c7a59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c7c0a0a30 0x7f7c7c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:41.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.884+0000 7f7c79d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7c7c09d630 0x7f7c7c0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44764/0 (socket says 172.21.15.26:44764) 2023-10-01T08:00:41.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.884+0000 7f7c7a59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c7c0a0a30 0x7f7c7c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42696/0 (socket says 172.21.15.26:42696) 2023-10-01T08:00:41.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.884+0000 7f7c79d9b700 1 -- 172.21.15.26:0/395252231 learned_addr learned my addr 172.21.15.26:0/395252231 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:41.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.884+0000 7f7c7ad9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7c7c133930 0x7f7c7c133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:33958/0 (socket says 172.21.15.26:33958) 2023-10-01T08:00:41.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.885+0000 7f7c79d9b700 1 -- 172.21.15.26:0/395252231 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c7c0a0a30 msgr2=0x7f7c7c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:41.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.885+0000 7f7c79d9b700 1 --2- 172.21.15.26:0/395252231 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c7c0a0a30 0x7f7c7c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:41.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.885+0000 7f7c79d9b700 1 -- 172.21.15.26:0/395252231 >> v1:172.21.15.26:6789/0 conn(0x7f7c7c133930 legacy=0x7f7c7c133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:41.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.885+0000 7f7c79d9b700 1 -- 172.21.15.26:0/395252231 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7c09dc50 con 0x7f7c7c09d630 2023-10-01T08:00:41.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.885+0000 7f7c79d9b700 1 --2- 172.21.15.26:0/395252231 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7c7c09d630 0x7f7c7c0a1340 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f7c70009920 tx=0x7f7c70009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b1f35452f490899 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:41.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.885+0000 7f7c7959a700 1 -- 172.21.15.26:0/395252231 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c70011830 con 0x7f7c7c09d630 2023-10-01T08:00:41.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.885+0000 7f7c7959a700 1 -- 172.21.15.26:0/395252231 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c70011990 con 0x7f7c7c09d630 2023-10-01T08:00:41.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.885+0000 7f7c7959a700 1 -- 172.21.15.26:0/395252231 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c70011d20 con 0x7f7c7c09d630 2023-10-01T08:00:41.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.886+0000 7f7c80bd4700 1 -- 172.21.15.26:0/395252231 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7c7c09d630 msgr2=0x7f7c7c0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:41.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.886+0000 7f7c80bd4700 1 --2- 172.21.15.26:0/395252231 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7c7c09d630 0x7f7c7c0a1340 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f7c70009920 tx=0x7f7c70009c30 comp rx=0 tx=0).stop 2023-10-01T08:00:41.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.886+0000 7f7c80bd4700 1 -- 172.21.15.26:0/395252231 shutdown_connections 2023-10-01T08:00:41.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.886+0000 7f7c80bd4700 1 --2- 172.21.15.26:0/395252231 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c7c0a0a30 0x7f7c7c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:41.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.886+0000 7f7c80bd4700 1 --2- 172.21.15.26:0/395252231 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7c7c09d630 0x7f7c7c0a1340 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:41.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.886+0000 7f7c80bd4700 1 -- 172.21.15.26:0/395252231 >> 172.21.15.26:0/395252231 conn(0x7f7c7c0a3050 msgr2=0x7f7c7c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:41.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.886+0000 7f7c80bd4700 1 -- 172.21.15.26:0/395252231 shutdown_connections 2023-10-01T08:00:41.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.886+0000 7f7c80bd4700 1 -- 172.21.15.26:0/395252231 wait complete. 2023-10-01T08:00:41.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.887+0000 7f7c80bd4700 1 Processor -- start 2023-10-01T08:00:41.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.887+0000 7f7c80bd4700 1 -- start start 2023-10-01T08:00:41.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.888+0000 7f7c80bd4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c7c09d630 0x7f7c7c11f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:41.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.888+0000 7f7c80bd4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c7c0a0a30 0x7f7c7c11fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:41.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.888+0000 7f7c80bd4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7c7c133930 0x7f7c7c1c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:41.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.888+0000 7f7c80bd4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c133510 con 0x7f7c7c09d630 2023-10-01T08:00:41.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.888+0000 7f7c80bd4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c11f060 con 0x7f7c7c0a0a30 2023-10-01T08:00:41.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.888+0000 7f7c80bd4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c0a4030 con 0x7f7c7c133930 2023-10-01T08:00:41.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.888+0000 7f7c7a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c7c09d630 0x7f7c7c11f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:41.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.888+0000 7f7c7a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c7c09d630 0x7f7c7c11f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53532/0 (socket says 172.21.15.26:53532) 2023-10-01T08:00:41.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.888+0000 7f7c7a59c700 1 -- 172.21.15.26:0/3907193535 learned_addr learned my addr 172.21.15.26:0/3907193535 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:41.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.888+0000 7f7c79d9b700 1 --2- 172.21.15.26:0/3907193535 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c7c0a0a30 0x7f7c7c11fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:41.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.888+0000 7f7c7ad9d700 1 --2- 172.21.15.26:0/3907193535 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7c7c133930 0x7f7c7c1c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:41.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.889+0000 7f7c79d9b700 1 -- 172.21.15.26:0/3907193535 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7c7c133930 msgr2=0x7f7c7c1c8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:41.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.889+0000 7f7c79d9b700 1 --2- 172.21.15.26:0/3907193535 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7c7c133930 0x7f7c7c1c8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:41.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.889+0000 7f7c79d9b700 1 -- 172.21.15.26:0/3907193535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c7c09d630 msgr2=0x7f7c7c11f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:41.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.889+0000 7f7c79d9b700 1 --2- 172.21.15.26:0/3907193535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c7c09d630 0x7f7c7c11f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:41.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.889+0000 7f7c79d9b700 1 -- 172.21.15.26:0/3907193535 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c70009550 con 0x7f7c7c0a0a30 2023-10-01T08:00:41.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.889+0000 7f7c79d9b700 1 --2- 172.21.15.26:0/3907193535 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c7c0a0a30 0x7f7c7c11fa20 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f7c70016000 tx=0x7f7c70004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:41.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.889+0000 7f7c6affd700 1 -- 172.21.15.26:0/3907193535 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c70004450 con 0x7f7c7c0a0a30 2023-10-01T08:00:41.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.889+0000 7f7c6affd700 1 -- 172.21.15.26:0/3907193535 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c700045b0 con 0x7f7c7c0a0a30 2023-10-01T08:00:41.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.889+0000 7f7c80bd4700 1 -- 172.21.15.26:0/3907193535 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c7c1223c0 con 0x7f7c7c0a0a30 2023-10-01T08:00:41.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.889+0000 7f7c6affd700 1 -- 172.21.15.26:0/3907193535 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c700038e0 con 0x7f7c7c0a0a30 2023-10-01T08:00:41.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.889+0000 7f7c80bd4700 1 -- 172.21.15.26:0/3907193535 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7c0a0460 con 0x7f7c7c0a0a30 2023-10-01T08:00:41.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.890+0000 7f7c6affd700 1 -- 172.21.15.26:0/3907193535 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7c70021030 con 0x7f7c7c0a0a30 2023-10-01T08:00:41.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.890+0000 7f7c6affd700 1 -- 172.21.15.26:0/3907193535 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7c700405f0 con 0x7f7c7c0a0a30 2023-10-01T08:00:41.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.891+0000 7f7c80bd4700 1 -- 172.21.15.26:0/3907193535 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c7c122200 con 0x7f7c7c0a0a30 2023-10-01T08:00:41.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.895+0000 7f7c6affd700 1 -- 172.21.15.26:0/3907193535 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7c70022970 con 0x7f7c7c0a0a30 2023-10-01T08:00:41.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.952+0000 7f7b243b2700 1 -- 172.21.15.26:0/1941885026 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7b1c0a0220 con 0x7f7b1c0a0a30 2023-10-01T08:00:41.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.952+0000 7f7b1affd700 1 -- 172.21.15.26:0/1941885026 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7b0c0233d0 con 0x7f7b1c0a0a30 2023-10-01T08:00:41.953 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:41.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.954+0000 7f7b243b2700 1 -- 172.21.15.26:0/1941885026 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7b1c0a0a30 msgr2=0x7f7b1c120760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:41.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.954+0000 7f7b243b2700 1 --2- 172.21.15.26:0/1941885026 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7b1c0a0a30 0x7f7b1c120760 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0098f0 tx=0x7f7b0c004750 comp rx=0 tx=0).stop 2023-10-01T08:00:41.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.954+0000 7f7b243b2700 1 -- 172.21.15.26:0/1941885026 shutdown_connections 2023-10-01T08:00:41.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.954+0000 7f7b243b2700 1 --2- 172.21.15.26:0/1941885026 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7b1c133fa0 0x7f7b1c1211e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:41.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.954+0000 7f7b243b2700 1 --2- 172.21.15.26:0/1941885026 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7b1c0a0a30 0x7f7b1c120760 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:41.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.954+0000 7f7b243b2700 1 --2- 172.21.15.26:0/1941885026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b1c0a1340 0x7f7b1c120ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:41.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.954+0000 7f7b243b2700 1 -- 172.21.15.26:0/1941885026 >> 172.21.15.26:0/1941885026 conn(0x7f7b1c0a6550 msgr2=0x7f7b1c09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:41.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.955+0000 7f7b243b2700 1 -- 172.21.15.26:0/1941885026 shutdown_connections 2023-10-01T08:00:41.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:41.955+0000 7f7b243b2700 1 -- 172.21.15.26:0/1941885026 wait complete. 2023-10-01T08:00:41.969 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:42.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.049+0000 7f6c1879a700 1 -- 172.21.15.26:0/157445355 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6c100a28e0 con 0x7f6c10139250 2023-10-01T08:00:42.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.050+0000 7f6c06ffd700 1 -- 172.21.15.26:0/157445355 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6c08018020 con 0x7f6c10139250 2023-10-01T08:00:42.051 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:42.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.052+0000 7f6c1879a700 1 -- 172.21.15.26:0/157445355 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c10139250 msgr2=0x7f6c10122a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:42.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.052+0000 7f6c1879a700 1 --2- 172.21.15.26:0/157445355 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c10139250 0x7f6c10122a70 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800ef90 tx=0x7f6c0800c3a0 comp rx=0 tx=0).stop 2023-10-01T08:00:42.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.052+0000 7f6c1879a700 1 -- 172.21.15.26:0/157445355 shutdown_connections 2023-10-01T08:00:42.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.052+0000 7f6c1879a700 1 --2- 172.21.15.26:0/157445355 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c10139250 0x7f6c10122a70 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:42.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.052+0000 7f6c1879a700 1 --2- 172.21.15.26:0/157445355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c100a0a30 0x7f6c10137880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:42.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.052+0000 7f6c1879a700 1 --2- 172.21.15.26:0/157445355 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6c100a1510 0x7f6c10137dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:42.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.052+0000 7f6c1879a700 1 -- 172.21.15.26:0/157445355 >> 172.21.15.26:0/157445355 conn(0x7f6c100a6550 msgr2=0x7f6c100a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:42.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.052+0000 7f6c1879a700 1 -- 172.21.15.26:0/157445355 shutdown_connections 2023-10-01T08:00:42.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.052+0000 7f6c1879a700 1 -- 172.21.15.26:0/157445355 wait complete. 2023-10-01T08:00:42.067 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:42.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.105+0000 7f7c80bd4700 1 -- 172.21.15.26:0/3907193535 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7c7c0747f0 con 0x7f7c7c0a0a30 2023-10-01T08:00:42.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.105+0000 7f7c6affd700 1 -- 172.21.15.26:0/3907193535 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7c70015020 con 0x7f7c7c0a0a30 2023-10-01T08:00:42.106 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:42.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.107+0000 7f7c80bd4700 1 -- 172.21.15.26:0/3907193535 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c7c0a0a30 msgr2=0x7f7c7c11fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:42.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.107+0000 7f7c80bd4700 1 --2- 172.21.15.26:0/3907193535 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c7c0a0a30 0x7f7c7c11fa20 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f7c70016000 tx=0x7f7c70004750 comp rx=0 tx=0).stop 2023-10-01T08:00:42.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.107+0000 7f7c80bd4700 1 -- 172.21.15.26:0/3907193535 shutdown_connections 2023-10-01T08:00:42.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.107+0000 7f7c80bd4700 1 --2- 172.21.15.26:0/3907193535 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7c7c133930 0x7f7c7c1c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:42.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.107+0000 7f7c80bd4700 1 --2- 172.21.15.26:0/3907193535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c7c09d630 0x7f7c7c11f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:42.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.107+0000 7f7c80bd4700 1 --2- 172.21.15.26:0/3907193535 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c7c0a0a30 0x7f7c7c11fa20 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:42.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.107+0000 7f7c80bd4700 1 -- 172.21.15.26:0/3907193535 >> 172.21.15.26:0/3907193535 conn(0x7f7c7c0a3050 msgr2=0x7f7c7c09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:42.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.108+0000 7f7c80bd4700 1 -- 172.21.15.26:0/3907193535 shutdown_connections 2023-10-01T08:00:42.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.108+0000 7f7c80bd4700 1 -- 172.21.15.26:0/3907193535 wait complete. 2023-10-01T08:00:42.121 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:42.628 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:42.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.773+0000 7f5384a6f700 1 Processor -- start 2023-10-01T08:00:42.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.773+0000 7f5384a6f700 1 -- start start 2023-10-01T08:00:42.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.774+0000 7f5384a6f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f538009d6f0 0x7f538009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:42.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.774+0000 7f5384a6f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f538009e410 0x7f5380130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:42.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.774+0000 7f5384a6f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f538009f130 con 0x7f538009e000 2023-10-01T08:00:42.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.774+0000 7f5384a6f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f538009f520 con 0x7f538009e410 2023-10-01T08:00:42.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.774+0000 7f5384a6f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f538009e930 con 0x7f538009d6f0 2023-10-01T08:00:42.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.774+0000 7f537e59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f538009d6f0 0x7f538009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:42.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.774+0000 7f537ed9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f538009e410 0x7f5380130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:42.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.774+0000 7f537ed9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f538009e410 0x7f5380130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53542/0 (socket says 172.21.15.26:53542) 2023-10-01T08:00:42.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.774+0000 7f537e59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f538009d6f0 0x7f538009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44786/0 (socket says 172.21.15.26:44786) 2023-10-01T08:00:42.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.774+0000 7f537ed9d700 1 -- 172.21.15.26:0/3154335956 learned_addr learned my addr 172.21.15.26:0/3154335956 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:42.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.775+0000 7f537ed9d700 1 -- 172.21.15.26:0/3154335956 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f538009d6f0 msgr2=0x7f538009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:42.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.775+0000 7f537ed9d700 1 --2- 172.21.15.26:0/3154335956 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f538009d6f0 0x7f538009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:42.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.775+0000 7f537ed9d700 1 -- 172.21.15.26:0/3154335956 >> v1:172.21.15.26:6789/0 conn(0x7f538009e000 legacy=0x7f5380130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:42.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.775+0000 7f537ed9d700 1 -- 172.21.15.26:0/3154335956 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f538009b2d0 con 0x7f538009e410 2023-10-01T08:00:42.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.775+0000 7f537e59c700 1 --2- 172.21.15.26:0/3154335956 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f538009d6f0 0x7f538009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:42.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.775+0000 7f537ed9d700 1 --2- 172.21.15.26:0/3154335956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f538009e410 0x7f5380130d70 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f5378009e50 tx=0x7f537800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c8d8dff1096e46d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:42.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.775+0000 7f537d59a700 1 -- 172.21.15.26:0/3154335956 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537800e070 con 0x7f538009e410 2023-10-01T08:00:42.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.775+0000 7f537d59a700 1 -- 172.21.15.26:0/3154335956 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537800b910 con 0x7f538009e410 2023-10-01T08:00:42.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.775+0000 7f537d59a700 1 -- 172.21.15.26:0/3154335956 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537800bcc0 con 0x7f538009e410 2023-10-01T08:00:42.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.775+0000 7f5384a6f700 1 -- 172.21.15.26:0/3154335956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f538009e410 msgr2=0x7f5380130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:42.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.775+0000 7f5384a6f700 1 --2- 172.21.15.26:0/3154335956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f538009e410 0x7f5380130d70 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f5378009e50 tx=0x7f537800b330 comp rx=0 tx=0).stop 2023-10-01T08:00:42.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.776+0000 7f5384a6f700 1 -- 172.21.15.26:0/3154335956 shutdown_connections 2023-10-01T08:00:42.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.776+0000 7f5384a6f700 1 --2- 172.21.15.26:0/3154335956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f538009e410 0x7f5380130d70 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:42.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.776+0000 7f5384a6f700 1 --2- 172.21.15.26:0/3154335956 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f538009d6f0 0x7f538009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:42.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.776+0000 7f5384a6f700 1 -- 172.21.15.26:0/3154335956 >> 172.21.15.26:0/3154335956 conn(0x7f5380066f50 msgr2=0x7f538009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:42.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.776+0000 7f5384a6f700 1 -- 172.21.15.26:0/3154335956 shutdown_connections 2023-10-01T08:00:42.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.776+0000 7f5384a6f700 1 -- 172.21.15.26:0/3154335956 wait complete. 2023-10-01T08:00:42.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.777+0000 7f5384a6f700 1 Processor -- start 2023-10-01T08:00:42.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.777+0000 7f5384a6f700 1 -- start start 2023-10-01T08:00:42.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.777+0000 7f5384a6f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f538009d6f0 0x7f538006e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:42.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.777+0000 7f5384a6f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f538009e000 0x7f538006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:42.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.777+0000 7f5384a6f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f538009e410 0x7f538006f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:42.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.777+0000 7f5384a6f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5380130340 con 0x7f538009d6f0 2023-10-01T08:00:42.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.777+0000 7f5384a6f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5380070520 con 0x7f538009e000 2023-10-01T08:00:42.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.777+0000 7f5384a6f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5380125bf0 con 0x7f538009e410 2023-10-01T08:00:42.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.777+0000 7f537e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f538009d6f0 0x7f538006e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:42.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.777+0000 7f537e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f538009d6f0 0x7f538006e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53546/0 (socket says 172.21.15.26:53546) 2023-10-01T08:00:42.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.778+0000 7f537e59c700 1 -- 172.21.15.26:0/4049844635 learned_addr learned my addr 172.21.15.26:0/4049844635 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:42.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.778+0000 7f537ed9d700 1 --2- 172.21.15.26:0/4049844635 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f538009e410 0x7f538006f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:42.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.778+0000 7f537dd9b700 1 --2- 172.21.15.26:0/4049844635 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f538009e000 0x7f538006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:42.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.778+0000 7f537e59c700 1 -- 172.21.15.26:0/4049844635 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f538009e410 msgr2=0x7f538006f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:42.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.778+0000 7f537e59c700 1 --2- 172.21.15.26:0/4049844635 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f538009e410 0x7f538006f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:42.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.778+0000 7f537e59c700 1 -- 172.21.15.26:0/4049844635 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f538009e000 msgr2=0x7f538006edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:42.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.778+0000 7f537e59c700 1 --2- 172.21.15.26:0/4049844635 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f538009e000 0x7f538006edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:42.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.778+0000 7f537e59c700 1 -- 172.21.15.26:0/4049844635 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53700094a0 con 0x7f538009d6f0 2023-10-01T08:00:42.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.778+0000 7f537e59c700 1 --2- 172.21.15.26:0/4049844635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f538009d6f0 0x7f538006e870 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f537000ec10 tx=0x7f537000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:42.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.778+0000 7f5376ffd700 1 -- 172.21.15.26:0/4049844635 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5370009760 con 0x7f538009d6f0 2023-10-01T08:00:42.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.778+0000 7f5376ffd700 1 -- 172.21.15.26:0/4049844635 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537000c850 con 0x7f538009d6f0 2023-10-01T08:00:42.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.778+0000 7f5384a6f700 1 -- 172.21.15.26:0/4049844635 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5378009b30 con 0x7f538009d6f0 2023-10-01T08:00:42.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.778+0000 7f5376ffd700 1 -- 172.21.15.26:0/4049844635 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537000cbe0 con 0x7f538009d6f0 2023-10-01T08:00:42.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.778+0000 7f5384a6f700 1 -- 172.21.15.26:0/4049844635 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53801247b0 con 0x7f538009d6f0 2023-10-01T08:00:42.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.779+0000 7f5376ffd700 1 -- 172.21.15.26:0/4049844635 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f537000cd40 con 0x7f538009d6f0 2023-10-01T08:00:42.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.779+0000 7f5376ffd700 1 -- 172.21.15.26:0/4049844635 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f537003faa0 con 0x7f538009d6f0 2023-10-01T08:00:42.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.779+0000 7f5384a6f700 1 -- 172.21.15.26:0/4049844635 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5380074ea0 con 0x7f538009d6f0 2023-10-01T08:00:42.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.784+0000 7f5376ffd700 1 -- 172.21.15.26:0/4049844635 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f537001b3b0 con 0x7f538009d6f0 2023-10-01T08:00:42.970 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:42.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.989+0000 7f5384a6f700 1 -- 172.21.15.26:0/4049844635 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f538006c360 con 0x7f538009d6f0 2023-10-01T08:00:42.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.990+0000 7f5376ffd700 1 -- 172.21.15.26:0/4049844635 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f537002b090 con 0x7f538009d6f0 2023-10-01T08:00:42.990 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:42.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.992+0000 7f5384a6f700 1 -- 172.21.15.26:0/4049844635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f538009d6f0 msgr2=0x7f538006e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:42.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.992+0000 7f5384a6f700 1 --2- 172.21.15.26:0/4049844635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f538009d6f0 0x7f538006e870 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f537000ec10 tx=0x7f537000ef20 comp rx=0 tx=0).stop 2023-10-01T08:00:42.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.992+0000 7f5384a6f700 1 -- 172.21.15.26:0/4049844635 shutdown_connections 2023-10-01T08:00:42.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.992+0000 7f5384a6f700 1 --2- 172.21.15.26:0/4049844635 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f538009e410 0x7f538006f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:42.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.992+0000 7f5384a6f700 1 --2- 172.21.15.26:0/4049844635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f538009d6f0 0x7f538006e870 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:42.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.992+0000 7f5384a6f700 1 --2- 172.21.15.26:0/4049844635 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f538009e000 0x7f538006edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:42.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.992+0000 7f5384a6f700 1 -- 172.21.15.26:0/4049844635 >> 172.21.15.26:0/4049844635 conn(0x7f5380066f50 msgr2=0x7f538006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:42.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.992+0000 7f5384a6f700 1 -- 172.21.15.26:0/4049844635 shutdown_connections 2023-10-01T08:00:42.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:42.992+0000 7f5384a6f700 1 -- 172.21.15.26:0/4049844635 wait complete. 2023-10-01T08:00:43.008 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:43.068 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:43.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.112+0000 7f0b8c0c6700 1 Processor -- start 2023-10-01T08:00:43.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.112+0000 7f0b8c0c6700 1 -- start start 2023-10-01T08:00:43.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.113+0000 7f0b8c0c6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0b841338a0 0x7f0b84133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:43.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.113+0000 7f0b8c0c6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0b8409de50 0x7f0b8409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:43.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.113+0000 7f0b8c0c6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b8406ef30 con 0x7f0b8409e760 2023-10-01T08:00:43.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.113+0000 7f0b8c0c6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b8406fef0 con 0x7f0b8409de50 2023-10-01T08:00:43.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.113+0000 7f0b8c0c6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b841334b0 con 0x7f0b841338a0 2023-10-01T08:00:43.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.113+0000 7f0b89e62700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0b841338a0 0x7f0b84133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:43.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.113+0000 7f0b89661700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0b8409de50 0x7f0b8409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:43.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.113+0000 7f0b89e62700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0b841338a0 0x7f0b84133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42712/0 (socket says 172.21.15.26:42712) 2023-10-01T08:00:43.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.113+0000 7f0b89e62700 1 -- 172.21.15.26:0/3459388330 learned_addr learned my addr 172.21.15.26:0/3459388330 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:43.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.113+0000 7f0b89e62700 1 -- 172.21.15.26:0/3459388330 >> v2:172.21.15.26:3300/0 conn(0x7f0b8409de50 msgr2=0x7f0b8409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:43.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.113+0000 7f0b89e62700 1 --2- 172.21.15.26:0/3459388330 >> v2:172.21.15.26:3300/0 conn(0x7f0b8409de50 0x7f0b8409e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:43.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.113+0000 7f0b89e62700 1 -- 172.21.15.26:0/3459388330 >> v1:172.21.15.26:6789/0 conn(0x7f0b8409e760 legacy=0x7f0b8413a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:43.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.113+0000 7f0b89e62700 1 -- 172.21.15.26:0/3459388330 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8406fc30 con 0x7f0b841338a0 2023-10-01T08:00:43.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.113+0000 7f0b89661700 1 --2- 172.21.15.26:0/3459388330 >> v2:172.21.15.26:3300/0 conn(0x7f0b8409de50 0x7f0b8409e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:43.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.114+0000 7f0b89e62700 1 --2- 172.21.15.26:0/3459388330 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0b841338a0 0x7f0b84133c70 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f0b74009e50 tx=0x7f0b7400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=363443c369c95be9 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:43.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.114+0000 7f0b88e60700 1 -- 172.21.15.26:0/3459388330 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7400e070 con 0x7f0b841338a0 2023-10-01T08:00:43.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.114+0000 7f0b88e60700 1 -- 172.21.15.26:0/3459388330 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7400b910 con 0x7f0b841338a0 2023-10-01T08:00:43.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.114+0000 7f0b88e60700 1 -- 172.21.15.26:0/3459388330 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7400bcc0 con 0x7f0b841338a0 2023-10-01T08:00:43.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.114+0000 7f0b8c0c6700 1 -- 172.21.15.26:0/3459388330 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0b841338a0 msgr2=0x7f0b84133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:43.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.114+0000 7f0b8c0c6700 1 --2- 172.21.15.26:0/3459388330 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0b841338a0 0x7f0b84133c70 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f0b74009e50 tx=0x7f0b7400b330 comp rx=0 tx=0).stop 2023-10-01T08:00:43.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.114+0000 7f0b8c0c6700 1 -- 172.21.15.26:0/3459388330 shutdown_connections 2023-10-01T08:00:43.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.114+0000 7f0b8c0c6700 1 --2- 172.21.15.26:0/3459388330 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0b841338a0 0x7f0b84133c70 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:43.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.114+0000 7f0b8c0c6700 1 --2- 172.21.15.26:0/3459388330 >> v2:172.21.15.26:3300/0 conn(0x7f0b8409de50 0x7f0b8409e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:43.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.114+0000 7f0b8c0c6700 1 -- 172.21.15.26:0/3459388330 >> 172.21.15.26:0/3459388330 conn(0x7f0b840a2aa0 msgr2=0x7f0b840a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:43.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.115+0000 7f0b8c0c6700 1 -- 172.21.15.26:0/3459388330 shutdown_connections 2023-10-01T08:00:43.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.115+0000 7f0b8c0c6700 1 -- 172.21.15.26:0/3459388330 wait complete. 2023-10-01T08:00:43.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.116+0000 7f0b8c0c6700 1 Processor -- start 2023-10-01T08:00:43.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.116+0000 7f0b8c0c6700 1 -- start start 2023-10-01T08:00:43.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.116+0000 7f0b8c0c6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0b8409de50 0x7f0b8411ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:43.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.116+0000 7f0b8c0c6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0b8409e760 0x7f0b8411f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:43.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.116+0000 7f0b8c0c6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b841338a0 0x7f0b8411f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:43.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.116+0000 7f0b8c0c6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b84120830 con 0x7f0b841338a0 2023-10-01T08:00:43.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.116+0000 7f0b8c0c6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b840a1000 con 0x7f0b8409e760 2023-10-01T08:00:43.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.116+0000 7f0b8c0c6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8406f640 con 0x7f0b8409de50 2023-10-01T08:00:43.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.116+0000 7f0b89661700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0b8409e760 0x7f0b8411f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:43.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.116+0000 7f0b89661700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0b8409e760 0x7f0b8411f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42714/0 (socket says 172.21.15.26:42714) 2023-10-01T08:00:43.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.116+0000 7f0b89661700 1 -- 172.21.15.26:0/3390723472 learned_addr learned my addr 172.21.15.26:0/3390723472 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:43.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.116+0000 7f0b89e62700 1 --2- 172.21.15.26:0/3390723472 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0b8409de50 0x7f0b8411ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:43.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.116+0000 7f0b8a663700 1 --2- 172.21.15.26:0/3390723472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b841338a0 0x7f0b8411f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:43.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.117+0000 7f0b89661700 1 -- 172.21.15.26:0/3390723472 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0b8409de50 msgr2=0x7f0b8411ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:43.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.117+0000 7f0b89661700 1 --2- 172.21.15.26:0/3390723472 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0b8409de50 0x7f0b8411ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:43.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.117+0000 7f0b89661700 1 -- 172.21.15.26:0/3390723472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b841338a0 msgr2=0x7f0b8411f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:43.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.117+0000 7f0b89661700 1 --2- 172.21.15.26:0/3390723472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b841338a0 0x7f0b8411f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:43.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.117+0000 7f0b89661700 1 -- 172.21.15.26:0/3390723472 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b780094a0 con 0x7f0b8409e760 2023-10-01T08:00:43.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.117+0000 7f0b89e62700 1 --2- 172.21.15.26:0/3390723472 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0b8409de50 0x7f0b8411ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:43.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.117+0000 7f0b89661700 1 --2- 172.21.15.26:0/3390723472 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0b8409e760 0x7f0b8411f160 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f0b7800ebb0 tx=0x7f0b7800eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:43.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.117+0000 7f0b827fc700 1 -- 172.21.15.26:0/3390723472 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7800c850 con 0x7f0b8409e760 2023-10-01T08:00:43.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.117+0000 7f0b827fc700 1 -- 172.21.15.26:0/3390723472 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7800c9b0 con 0x7f0b8409e760 2023-10-01T08:00:43.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.117+0000 7f0b8c0c6700 1 -- 172.21.15.26:0/3390723472 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b74009b30 con 0x7f0b8409e760 2023-10-01T08:00:43.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.117+0000 7f0b827fc700 1 -- 172.21.15.26:0/3390723472 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7800cd40 con 0x7f0b8409e760 2023-10-01T08:00:43.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.117+0000 7f0b8c0c6700 1 -- 172.21.15.26:0/3390723472 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b8412f740 con 0x7f0b8409e760 2023-10-01T08:00:43.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.118+0000 7f0b827fc700 1 -- 172.21.15.26:0/3390723472 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0b78013470 con 0x7f0b8409e760 2023-10-01T08:00:43.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.118+0000 7f0b8c0c6700 1 -- 172.21.15.26:0/3390723472 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b84130730 con 0x7f0b8409e760 2023-10-01T08:00:43.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.118+0000 7f0b827fc700 1 -- 172.21.15.26:0/3390723472 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0b7803f740 con 0x7f0b8409e760 2023-10-01T08:00:43.122 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:43.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.123+0000 7f0b827fc700 1 -- 172.21.15.26:0/3390723472 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0b780232f0 con 0x7f0b8409e760 2023-10-01T08:00:43.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.213+0000 7f72d4f13700 1 Processor -- start 2023-10-01T08:00:43.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.213+0000 7f72d4f13700 1 -- start start 2023-10-01T08:00:43.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.214+0000 7f72d4f13700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f72d00a0a30 0x7f72d00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:43.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.214+0000 7f72d4f13700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f72d009d630 0x7f72d00a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:43.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.214+0000 7f72d4f13700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72d00a2a70 con 0x7f72d0133930 2023-10-01T08:00:43.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.214+0000 7f72d4f13700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72d00a01d0 con 0x7f72d009d630 2023-10-01T08:00:43.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.214+0000 7f72d4f13700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72d009e2b0 con 0x7f72d00a0a30 2023-10-01T08:00:43.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.214+0000 7f72ce59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f72d00a0a30 0x7f72d00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:43.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.214+0000 7f72cdd9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f72d009d630 0x7f72d00a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:43.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.214+0000 7f72cdd9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f72d009d630 0x7f72d00a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53584/0 (socket says 172.21.15.26:53584) 2023-10-01T08:00:43.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.214+0000 7f72ce59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f72d00a0a30 0x7f72d00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44810/0 (socket says 172.21.15.26:44810) 2023-10-01T08:00:43.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.214+0000 7f72cdd9b700 1 -- 172.21.15.26:0/3085848089 learned_addr learned my addr 172.21.15.26:0/3085848089 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:43.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.214+0000 7f72cdd9b700 1 -- 172.21.15.26:0/3085848089 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f72d00a0a30 msgr2=0x7f72d00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:43.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.214+0000 7f72cdd9b700 1 --2- 172.21.15.26:0/3085848089 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f72d00a0a30 0x7f72d00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:43.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.214+0000 7f72cdd9b700 1 -- 172.21.15.26:0/3085848089 >> v1:172.21.15.26:6789/0 conn(0x7f72d0133930 legacy=0x7f72d0133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:43.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.214+0000 7f72cdd9b700 1 -- 172.21.15.26:0/3085848089 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d009dc50 con 0x7f72d009d630 2023-10-01T08:00:43.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.214+0000 7f72cdd9b700 1 --2- 172.21.15.26:0/3085848089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72d009d630 0x7f72d00a1340 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f72c40098f0 tx=0x7f72c4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c55f7356e5b9dbf server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:43.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.214+0000 7f72cd59a700 1 -- 172.21.15.26:0/3085848089 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c4011830 con 0x7f72d009d630 2023-10-01T08:00:43.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.215+0000 7f72cd59a700 1 -- 172.21.15.26:0/3085848089 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c4011990 con 0x7f72d009d630 2023-10-01T08:00:43.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.215+0000 7f72cd59a700 1 -- 172.21.15.26:0/3085848089 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c4011d20 con 0x7f72d009d630 2023-10-01T08:00:43.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.215+0000 7f72d4f13700 1 -- 172.21.15.26:0/3085848089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72d009d630 msgr2=0x7f72d00a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:43.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.215+0000 7f72d4f13700 1 --2- 172.21.15.26:0/3085848089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72d009d630 0x7f72d00a1340 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f72c40098f0 tx=0x7f72c4009c00 comp rx=0 tx=0).stop 2023-10-01T08:00:43.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.215+0000 7f72d4f13700 1 -- 172.21.15.26:0/3085848089 shutdown_connections 2023-10-01T08:00:43.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.215+0000 7f72d4f13700 1 --2- 172.21.15.26:0/3085848089 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f72d00a0a30 0x7f72d00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:43.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.215+0000 7f72d4f13700 1 --2- 172.21.15.26:0/3085848089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72d009d630 0x7f72d00a1340 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:43.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.215+0000 7f72d4f13700 1 -- 172.21.15.26:0/3085848089 >> 172.21.15.26:0/3085848089 conn(0x7f72d00a3050 msgr2=0x7f72d00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:43.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.215+0000 7f72d4f13700 1 -- 172.21.15.26:0/3085848089 shutdown_connections 2023-10-01T08:00:43.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.215+0000 7f72d4f13700 1 -- 172.21.15.26:0/3085848089 wait complete. 2023-10-01T08:00:43.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.217+0000 7f72d4f13700 1 Processor -- start 2023-10-01T08:00:43.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.217+0000 7f72d4f13700 1 -- start start 2023-10-01T08:00:43.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.217+0000 7f72d4f13700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f72d009d630 0x7f72d011f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:43.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.217+0000 7f72d4f13700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72d00a0a30 0x7f72d011f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:43.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.217+0000 7f72d4f13700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f72d0133930 0x7f72d011fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:43.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.217+0000 7f72d4f13700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d0122de0 con 0x7f72d00a0a30 2023-10-01T08:00:43.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.217+0000 7f72d4f13700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72d01228d0 con 0x7f72d009d630 2023-10-01T08:00:43.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.217+0000 7f72d4f13700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72d0121d70 con 0x7f72d0133930 2023-10-01T08:00:43.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.217+0000 7f72cdd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72d00a0a30 0x7f72d011f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:43.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.217+0000 7f72cdd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72d00a0a30 0x7f72d011f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53590/0 (socket says 172.21.15.26:53590) 2023-10-01T08:00:43.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.217+0000 7f72cdd9b700 1 -- 172.21.15.26:0/1027946808 learned_addr learned my addr 172.21.15.26:0/1027946808 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:43.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.217+0000 7f72ced9d700 1 --2- 172.21.15.26:0/1027946808 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f72d0133930 0x7f72d011fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:43.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.217+0000 7f72ce59c700 1 --2- 172.21.15.26:0/1027946808 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f72d009d630 0x7f72d011f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:43.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.218+0000 7f72cdd9b700 1 -- 172.21.15.26:0/1027946808 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f72d0133930 msgr2=0x7f72d011fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:43.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.218+0000 7f72cdd9b700 1 --2- 172.21.15.26:0/1027946808 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f72d0133930 0x7f72d011fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:43.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.218+0000 7f72cdd9b700 1 -- 172.21.15.26:0/1027946808 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f72d009d630 msgr2=0x7f72d011f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:43.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.218+0000 7f72cdd9b700 1 --2- 172.21.15.26:0/1027946808 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f72d009d630 0x7f72d011f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:43.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.218+0000 7f72cdd9b700 1 -- 172.21.15.26:0/1027946808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c4009550 con 0x7f72d00a0a30 2023-10-01T08:00:43.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.218+0000 7f72cdd9b700 1 --2- 172.21.15.26:0/1027946808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72d00a0a30 0x7f72d011f800 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f72c4000c00 tx=0x7f72c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:43.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.218+0000 7f72beffd700 1 -- 172.21.15.26:0/1027946808 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c40036a0 con 0x7f72d00a0a30 2023-10-01T08:00:43.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.218+0000 7f72beffd700 1 -- 172.21.15.26:0/1027946808 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c4003800 con 0x7f72d00a0a30 2023-10-01T08:00:43.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.218+0000 7f72d4f13700 1 -- 172.21.15.26:0/1027946808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72d0122570 con 0x7f72d00a0a30 2023-10-01T08:00:43.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.218+0000 7f72beffd700 1 -- 172.21.15.26:0/1027946808 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c4003bb0 con 0x7f72d00a0a30 2023-10-01T08:00:43.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.218+0000 7f72d4f13700 1 -- 172.21.15.26:0/1027946808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72d0130690 con 0x7f72d00a0a30 2023-10-01T08:00:43.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.219+0000 7f72beffd700 1 -- 172.21.15.26:0/1027946808 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f72c4021070 con 0x7f72d00a0a30 2023-10-01T08:00:43.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.219+0000 7f72beffd700 1 -- 172.21.15.26:0/1027946808 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f72c4040b10 con 0x7f72d00a0a30 2023-10-01T08:00:43.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.220+0000 7f72d4f13700 1 -- 172.21.15.26:0/1027946808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72d009c900 con 0x7f72d00a0a30 2023-10-01T08:00:43.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.229+0000 7f72beffd700 1 -- 172.21.15.26:0/1027946808 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f72c4015020 con 0x7f72d00a0a30 2023-10-01T08:00:43.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.265+0000 7f87f0553700 1 Processor -- start 2023-10-01T08:00:43.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.265+0000 7f87f0553700 1 -- start start 2023-10-01T08:00:43.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.266+0000 7f87f0553700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f87e80a0a30 0x7f87e80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:43.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.266+0000 7f87f0553700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f87e8134170 0x7f87e813bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:43.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.266+0000 7f87f0553700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e809edd0 con 0x7f87e80a1340 2023-10-01T08:00:43.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.266+0000 7f87f0553700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e809e1f0 con 0x7f87e8134170 2023-10-01T08:00:43.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.266+0000 7f87f0553700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87e809dc50 con 0x7f87e80a0a30 2023-10-01T08:00:43.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.266+0000 7f87ee2ef700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f87e80a0a30 0x7f87e80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:43.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.266+0000 7f87edaee700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f87e80a1340 0x7f87e8133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34004/0 (socket says 172.21.15.26:34004) 2023-10-01T08:00:43.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.266+0000 7f87edaee700 1 -- 172.21.15.26:0/2864184491 learned_addr learned my addr 172.21.15.26:0/2864184491 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:43.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.266+0000 7f87eeaf0700 1 --2- 172.21.15.26:0/2864184491 >> v2:172.21.15.26:3300/0 conn(0x7f87e8134170 0x7f87e813bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:43.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.266+0000 7f87ed2ed700 1 -- 172.21.15.26:0/2864184491 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3088825189 0 0) 0x7f87e809edd0 con 0x7f87e80a1340 2023-10-01T08:00:43.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.266+0000 7f87ed2ed700 1 -- 172.21.15.26:0/2864184491 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87d40035b0 con 0x7f87e80a1340 2023-10-01T08:00:43.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.266+0000 7f87eeaf0700 1 -- 172.21.15.26:0/2864184491 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f87e80a0a30 msgr2=0x7f87e80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:43.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.266+0000 7f87eeaf0700 1 --2- 172.21.15.26:0/2864184491 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f87e80a0a30 0x7f87e80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:43.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.266+0000 7f87eeaf0700 1 -- 172.21.15.26:0/2864184491 >> v1:172.21.15.26:6789/0 conn(0x7f87e80a1340 legacy=0x7f87e8133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:43.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.266+0000 7f87ed2ed700 1 -- 172.21.15.26:0/2864184491 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3377211973 0 0) 0x7f87d40035b0 con 0x7f87e80a1340 2023-10-01T08:00:43.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.266+0000 7f87eeaf0700 1 -- 172.21.15.26:0/2864184491 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e80a1fe0 con 0x7f87e8134170 2023-10-01T08:00:43.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.267+0000 7f87eeaf0700 1 --2- 172.21.15.26:0/2864184491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87e8134170 0x7f87e813bd30 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f87e0009840 tx=0x7f87e0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee32140d7ac07ade server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:43.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.267+0000 7f87ed2ed700 1 -- 172.21.15.26:0/2864184491 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d8001670 con 0x7f87e8134170 2023-10-01T08:00:43.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.267+0000 7f87ed2ed700 1 -- 172.21.15.26:0/2864184491 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e0004030 con 0x7f87e8134170 2023-10-01T08:00:43.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.267+0000 7f87ed2ed700 1 -- 172.21.15.26:0/2864184491 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e00043c0 con 0x7f87e8134170 2023-10-01T08:00:43.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.267+0000 7f87f0553700 1 -- 172.21.15.26:0/2864184491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87e8134170 msgr2=0x7f87e813bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:43.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.267+0000 7f87f0553700 1 --2- 172.21.15.26:0/2864184491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87e8134170 0x7f87e813bd30 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f87e0009840 tx=0x7f87e0009b50 comp rx=0 tx=0).stop 2023-10-01T08:00:43.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.268+0000 7f87f0553700 1 -- 172.21.15.26:0/2864184491 shutdown_connections 2023-10-01T08:00:43.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.268+0000 7f87f0553700 1 --2- 172.21.15.26:0/2864184491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87e8134170 0x7f87e813bd30 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:43.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.268+0000 7f87f0553700 1 --2- 172.21.15.26:0/2864184491 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f87e80a0a30 0x7f87e80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:43.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.268+0000 7f87f0553700 1 -- 172.21.15.26:0/2864184491 >> 172.21.15.26:0/2864184491 conn(0x7f87e80a6550 msgr2=0x7f87e80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:43.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.268+0000 7f87f0553700 1 -- 172.21.15.26:0/2864184491 shutdown_connections 2023-10-01T08:00:43.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.268+0000 7f87f0553700 1 -- 172.21.15.26:0/2864184491 wait complete. 2023-10-01T08:00:43.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.269+0000 7f87f0553700 1 Processor -- start 2023-10-01T08:00:43.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.269+0000 7f87f0553700 1 -- start start 2023-10-01T08:00:43.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.269+0000 7f87f0553700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f87e80a0a30 0x7f87e81c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:43.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.269+0000 7f87f0553700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f87e80a1340 0x7f87e81c8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:43.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.269+0000 7f87f0553700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87e8134170 0x7f87e81c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:43.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.269+0000 7f87f0553700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e8124520 con 0x7f87e8134170 2023-10-01T08:00:43.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.269+0000 7f87f0553700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e8124df0 con 0x7f87e80a1340 2023-10-01T08:00:43.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.269+0000 7f87f0553700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87e8126430 con 0x7f87e80a0a30 2023-10-01T08:00:43.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.269+0000 7f87ee2ef700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f87e80a0a30 0x7f87e81c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:43.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.270+0000 7f87ee2ef700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f87e80a0a30 0x7f87e81c83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44852/0 (socket says 172.21.15.26:44852) 2023-10-01T08:00:43.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.270+0000 7f87ee2ef700 1 -- 172.21.15.26:0/2369167684 learned_addr learned my addr 172.21.15.26:0/2369167684 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:43.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.270+0000 7f87edaee700 1 --2- 172.21.15.26:0/2369167684 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f87e80a1340 0x7f87e81c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:43.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.270+0000 7f87ee2ef700 1 -- 172.21.15.26:0/2369167684 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f87e80a1340 msgr2=0x7f87e81c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:43.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.270+0000 7f87ee2ef700 1 --2- 172.21.15.26:0/2369167684 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f87e80a1340 0x7f87e81c8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:43.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.270+0000 7f87ee2ef700 1 -- 172.21.15.26:0/2369167684 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87e8134170 msgr2=0x7f87e81c8e60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T08:00:43.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.270+0000 7f87ee2ef700 1 --2- 172.21.15.26:0/2369167684 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87e8134170 0x7f87e81c8e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:43.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.270+0000 7f87ee2ef700 1 -- 172.21.15.26:0/2369167684 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e00094a0 con 0x7f87e80a0a30 2023-10-01T08:00:43.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.270+0000 7f87ee2ef700 1 --2- 172.21.15.26:0/2369167684 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f87e80a0a30 0x7f87e81c83e0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f87e4009db0 tx=0x7f87e400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:43.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.270+0000 7f87deffd700 1 -- 172.21.15.26:0/2369167684 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e4009c20 con 0x7f87e80a0a30 2023-10-01T08:00:43.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.270+0000 7f87deffd700 1 -- 172.21.15.26:0/2369167684 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e400f040 con 0x7f87e80a0a30 2023-10-01T08:00:43.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.270+0000 7f87f0553700 1 -- 172.21.15.26:0/2369167684 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e8124ad0 con 0x7f87e80a0a30 2023-10-01T08:00:43.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.270+0000 7f87deffd700 1 -- 172.21.15.26:0/2369167684 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e4014480 con 0x7f87e80a0a30 2023-10-01T08:00:43.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.270+0000 7f87f0553700 1 -- 172.21.15.26:0/2369167684 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e8126150 con 0x7f87e80a0a30 2023-10-01T08:00:43.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.271+0000 7f87deffd700 1 -- 172.21.15.26:0/2369167684 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f87e40145e0 con 0x7f87e80a0a30 2023-10-01T08:00:43.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.271+0000 7f87deffd700 1 -- 172.21.15.26:0/2369167684 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f87e4040100 con 0x7f87e80a0a30 2023-10-01T08:00:43.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.272+0000 7f87f0553700 1 -- 172.21.15.26:0/2369167684 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e80a1980 con 0x7f87e80a0a30 2023-10-01T08:00:43.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.277+0000 7f87deffd700 1 -- 172.21.15.26:0/2369167684 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f87e4014890 con 0x7f87e80a0a30 2023-10-01T08:00:43.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.335+0000 7f0b8c0c6700 1 -- 172.21.15.26:0/3390723472 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0b84074ea0 con 0x7f0b8409e760 2023-10-01T08:00:43.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.335+0000 7f0b827fc700 1 -- 172.21.15.26:0/3390723472 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0b78021070 con 0x7f0b8409e760 2023-10-01T08:00:43.336 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:43.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.339+0000 7f0b8c0c6700 1 -- 172.21.15.26:0/3390723472 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0b8409e760 msgr2=0x7f0b8411f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:43.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.339+0000 7f0b8c0c6700 1 --2- 172.21.15.26:0/3390723472 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0b8409e760 0x7f0b8411f160 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f0b7800ebb0 tx=0x7f0b7800eec0 comp rx=0 tx=0).stop 2023-10-01T08:00:43.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.339+0000 7f0b8c0c6700 1 -- 172.21.15.26:0/3390723472 shutdown_connections 2023-10-01T08:00:43.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.339+0000 7f0b8c0c6700 1 --2- 172.21.15.26:0/3390723472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b841338a0 0x7f0b8411f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:43.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.339+0000 7f0b8c0c6700 1 --2- 172.21.15.26:0/3390723472 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0b8409de50 0x7f0b8411ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:43.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.339+0000 7f0b8c0c6700 1 --2- 172.21.15.26:0/3390723472 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0b8409e760 0x7f0b8411f160 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:43.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.339+0000 7f0b8c0c6700 1 -- 172.21.15.26:0/3390723472 >> 172.21.15.26:0/3390723472 conn(0x7f0b840a2aa0 msgr2=0x7f0b8409edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:43.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.339+0000 7f0b8c0c6700 1 -- 172.21.15.26:0/3390723472 shutdown_connections 2023-10-01T08:00:43.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.339+0000 7f0b8c0c6700 1 -- 172.21.15.26:0/3390723472 wait complete. 2023-10-01T08:00:43.358 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:43.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.439+0000 7f72d4f13700 1 -- 172.21.15.26:0/1027946808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f72d0134120 con 0x7f72d00a0a30 2023-10-01T08:00:43.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.439+0000 7f72beffd700 1 -- 172.21.15.26:0/1027946808 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f72c400b3e0 con 0x7f72d00a0a30 2023-10-01T08:00:43.440 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:43.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.441+0000 7f72d4f13700 1 -- 172.21.15.26:0/1027946808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72d00a0a30 msgr2=0x7f72d011f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:43.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.441+0000 7f72d4f13700 1 --2- 172.21.15.26:0/1027946808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72d00a0a30 0x7f72d011f800 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f72c4000c00 tx=0x7f72c4004750 comp rx=0 tx=0).stop 2023-10-01T08:00:43.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.441+0000 7f72d4f13700 1 -- 172.21.15.26:0/1027946808 shutdown_connections 2023-10-01T08:00:43.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.441+0000 7f72d4f13700 1 --2- 172.21.15.26:0/1027946808 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f72d0133930 0x7f72d011fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:43.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.441+0000 7f72d4f13700 1 --2- 172.21.15.26:0/1027946808 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f72d009d630 0x7f72d011f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:43.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.441+0000 7f72d4f13700 1 --2- 172.21.15.26:0/1027946808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72d00a0a30 0x7f72d011f800 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:43.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.441+0000 7f72d4f13700 1 -- 172.21.15.26:0/1027946808 >> 172.21.15.26:0/1027946808 conn(0x7f72d00a3050 msgr2=0x7f72d0099a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:43.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.441+0000 7f72d4f13700 1 -- 172.21.15.26:0/1027946808 shutdown_connections 2023-10-01T08:00:43.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.441+0000 7f72d4f13700 1 -- 172.21.15.26:0/1027946808 wait complete. 2023-10-01T08:00:43.456 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:43.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.493+0000 7f87f0553700 1 -- 172.21.15.26:0/2369167684 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f87e80a1d40 con 0x7f87e80a0a30 2023-10-01T08:00:43.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.494+0000 7f87deffd700 1 -- 172.21.15.26:0/2369167684 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f87e402b090 con 0x7f87e80a0a30 2023-10-01T08:00:43.494 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:43.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.496+0000 7f87f0553700 1 -- 172.21.15.26:0/2369167684 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f87e80a0a30 msgr2=0x7f87e81c83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:43.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.496+0000 7f87f0553700 1 --2- 172.21.15.26:0/2369167684 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f87e80a0a30 0x7f87e81c83e0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f87e4009db0 tx=0x7f87e400c3a0 comp rx=0 tx=0).stop 2023-10-01T08:00:43.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.496+0000 7f87f0553700 1 -- 172.21.15.26:0/2369167684 shutdown_connections 2023-10-01T08:00:43.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.496+0000 7f87f0553700 1 --2- 172.21.15.26:0/2369167684 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87e8134170 0x7f87e81c8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:43.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.496+0000 7f87f0553700 1 --2- 172.21.15.26:0/2369167684 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f87e80a0a30 0x7f87e81c83e0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:43.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.496+0000 7f87f0553700 1 --2- 172.21.15.26:0/2369167684 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f87e80a1340 0x7f87e81c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:43.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.496+0000 7f87f0553700 1 -- 172.21.15.26:0/2369167684 >> 172.21.15.26:0/2369167684 conn(0x7f87e80a6550 msgr2=0x7f87e809edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:43.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.496+0000 7f87f0553700 1 -- 172.21.15.26:0/2369167684 shutdown_connections 2023-10-01T08:00:43.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:43.496+0000 7f87f0553700 1 -- 172.21.15.26:0/2369167684 wait complete. 2023-10-01T08:00:43.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:44.009 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:44.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.160+0000 7ff297d49700 1 Processor -- start 2023-10-01T08:00:44.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.160+0000 7ff297d49700 1 -- start start 2023-10-01T08:00:44.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.160+0000 7ff297d49700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff29009e930 0x7ff29009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:44.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.160+0000 7ff297d49700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff29009f240 0x7ff2901317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:44.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.160+0000 7ff297d49700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff29009f650 0x7ff290131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:44.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.160+0000 7ff297d49700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff290070940 con 0x7ff29009f240 2023-10-01T08:00:44.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.160+0000 7ff297d49700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff29006fd60 con 0x7ff29009f650 2023-10-01T08:00:44.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.160+0000 7ff297d49700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff29006fa80 con 0x7ff29009e930 2023-10-01T08:00:44.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.161+0000 7ff2962e6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff29009f650 0x7ff290131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:44.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.161+0000 7ff2952e4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff29009f240 0x7ff2901317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:44.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.161+0000 7ff295ae5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff29009e930 0x7ff29009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:44.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.161+0000 7ff2952e4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff29009f240 0x7ff2901317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59174/0 (socket says 172.21.15.26:59174) 2023-10-01T08:00:44.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.161+0000 7ff2962e6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff29009f650 0x7ff290131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:32842/0 (socket says 172.21.15.26:32842) 2023-10-01T08:00:44.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.161+0000 7ff2952e4700 1 -- 172.21.15.26:0/2903247038 learned_addr learned my addr 172.21.15.26:0/2903247038 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:44.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.161+0000 7ff2952e4700 1 -- 172.21.15.26:0/2903247038 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff29009e930 msgr2=0x7ff29009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:44.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.161+0000 7ff2952e4700 1 --2- 172.21.15.26:0/2903247038 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff29009e930 0x7ff29009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.161+0000 7ff2952e4700 1 -- 172.21.15.26:0/2903247038 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff29009f650 msgr2=0x7ff290131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:44.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.161+0000 7ff2952e4700 1 --2- 172.21.15.26:0/2903247038 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff29009f650 0x7ff290131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.161+0000 7ff2952e4700 1 -- 172.21.15.26:0/2903247038 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29009fb60 con 0x7ff29009f240 2023-10-01T08:00:44.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.161+0000 7ff2962e6700 1 --2- 172.21.15.26:0/2903247038 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff29009f650 0x7ff290131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:44.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.161+0000 7ff295ae5700 1 --2- 172.21.15.26:0/2903247038 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff29009e930 0x7ff29009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:44.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.161+0000 7ff2952e4700 1 --2- 172.21.15.26:0/2903247038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff29009f240 0x7ff2901317f0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7ff2800098f0 tx=0x7ff280009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c51ea46028fbfe6f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:44.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.161+0000 7ff294ae3700 1 -- 172.21.15.26:0/2903247038 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff280011830 con 0x7ff29009f240 2023-10-01T08:00:44.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.161+0000 7ff294ae3700 1 -- 172.21.15.26:0/2903247038 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff280011990 con 0x7ff29009f240 2023-10-01T08:00:44.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.161+0000 7ff294ae3700 1 -- 172.21.15.26:0/2903247038 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff280011d20 con 0x7ff29009f240 2023-10-01T08:00:44.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.162+0000 7ff297d49700 1 -- 172.21.15.26:0/2903247038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff29009f240 msgr2=0x7ff2901317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:44.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.162+0000 7ff297d49700 1 --2- 172.21.15.26:0/2903247038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff29009f240 0x7ff2901317f0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7ff2800098f0 tx=0x7ff280009c00 comp rx=0 tx=0).stop 2023-10-01T08:00:44.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.162+0000 7ff297d49700 1 -- 172.21.15.26:0/2903247038 shutdown_connections 2023-10-01T08:00:44.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.162+0000 7ff297d49700 1 --2- 172.21.15.26:0/2903247038 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff29009f650 0x7ff290131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.162+0000 7ff297d49700 1 --2- 172.21.15.26:0/2903247038 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff29009e930 0x7ff29009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.162+0000 7ff297d49700 1 --2- 172.21.15.26:0/2903247038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff29009f240 0x7ff2901317f0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.162+0000 7ff297d49700 1 -- 172.21.15.26:0/2903247038 >> 172.21.15.26:0/2903247038 conn(0x7ff2900a4210 msgr2=0x7ff2900a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:44.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.162+0000 7ff297d49700 1 -- 172.21.15.26:0/2903247038 shutdown_connections 2023-10-01T08:00:44.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.162+0000 7ff297d49700 1 -- 172.21.15.26:0/2903247038 wait complete. 2023-10-01T08:00:44.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.163+0000 7ff297d49700 1 Processor -- start 2023-10-01T08:00:44.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.163+0000 7ff297d49700 1 -- start start 2023-10-01T08:00:44.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.163+0000 7ff297d49700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff29009e930 0x7ff29006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:44.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.163+0000 7ff297d49700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff29009f240 0x7ff29006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:44.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.164+0000 7ff297d49700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff29009f650 0x7ff29006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:44.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.164+0000 7ff297d49700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2901a7840 con 0x7ff29009f650 2023-10-01T08:00:44.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.164+0000 7ff297d49700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2901a8880 con 0x7ff29009e930 2023-10-01T08:00:44.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.164+0000 7ff297d49700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff29006cd10 con 0x7ff29009f240 2023-10-01T08:00:44.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.164+0000 7ff295ae5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff29009e930 0x7ff29006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:44.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.164+0000 7ff2962e6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff29009f650 0x7ff29006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:44.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.164+0000 7ff295ae5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff29009e930 0x7ff29006b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:32854/0 (socket says 172.21.15.26:32854) 2023-10-01T08:00:44.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.164+0000 7ff295ae5700 1 -- 172.21.15.26:0/2680290099 learned_addr learned my addr 172.21.15.26:0/2680290099 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:44.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.164+0000 7ff2952e4700 1 --2- 172.21.15.26:0/2680290099 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff29009f240 0x7ff29006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:44.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.164+0000 7ff295ae5700 1 -- 172.21.15.26:0/2680290099 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff29009f240 msgr2=0x7ff29006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:44.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.164+0000 7ff295ae5700 1 --2- 172.21.15.26:0/2680290099 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff29009f240 0x7ff29006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.164+0000 7ff295ae5700 1 -- 172.21.15.26:0/2680290099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff29009f650 msgr2=0x7ff29006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:44.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.164+0000 7ff295ae5700 1 --2- 172.21.15.26:0/2680290099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff29009f650 0x7ff29006c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.164+0000 7ff295ae5700 1 -- 172.21.15.26:0/2680290099 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff28c0094a0 con 0x7ff29009e930 2023-10-01T08:00:44.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.164+0000 7ff2962e6700 1 --2- 172.21.15.26:0/2680290099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff29009f650 0x7ff29006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:44.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.164+0000 7ff295ae5700 1 --2- 172.21.15.26:0/2680290099 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff29009e930 0x7ff29006b8b0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7ff28c00ec10 tx=0x7ff28c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:44.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.164+0000 7ff2867fc700 1 -- 172.21.15.26:0/2680290099 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c009780 con 0x7ff29009e930 2023-10-01T08:00:44.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.164+0000 7ff2867fc700 1 -- 172.21.15.26:0/2680290099 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28c00c850 con 0x7ff29009e930 2023-10-01T08:00:44.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.164+0000 7ff297d49700 1 -- 172.21.15.26:0/2680290099 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff288009a70 con 0x7ff29009e930 2023-10-01T08:00:44.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.164+0000 7ff2867fc700 1 -- 172.21.15.26:0/2680290099 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c00cbe0 con 0x7ff29009e930 2023-10-01T08:00:44.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.164+0000 7ff297d49700 1 -- 172.21.15.26:0/2680290099 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff280009550 con 0x7ff29009e930 2023-10-01T08:00:44.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.165+0000 7ff2867fc700 1 -- 172.21.15.26:0/2680290099 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff28c00cd40 con 0x7ff29009e930 2023-10-01T08:00:44.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.165+0000 7ff2867fc700 1 -- 172.21.15.26:0/2680290099 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff28c03f6e0 con 0x7ff29009e930 2023-10-01T08:00:44.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.166+0000 7ff297d49700 1 -- 172.21.15.26:0/2680290099 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff29006d520 con 0x7ff29009e930 2023-10-01T08:00:44.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.171+0000 7ff2867fc700 1 -- 172.21.15.26:0/2680290099 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff28c01bb50 con 0x7ff29009e930 2023-10-01T08:00:44.359 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:44.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.378+0000 7ff297d49700 1 -- 172.21.15.26:0/2680290099 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff290074ea0 con 0x7ff29009e930 2023-10-01T08:00:44.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.379+0000 7ff2867fc700 1 -- 172.21.15.26:0/2680290099 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff28c021030 con 0x7ff29009e930 2023-10-01T08:00:44.379 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:44.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.381+0000 7ff297d49700 1 -- 172.21.15.26:0/2680290099 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff29009e930 msgr2=0x7ff29006b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:44.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.381+0000 7ff297d49700 1 --2- 172.21.15.26:0/2680290099 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff29009e930 0x7ff29006b8b0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7ff28c00ec10 tx=0x7ff28c00ef20 comp rx=0 tx=0).stop 2023-10-01T08:00:44.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.381+0000 7ff297d49700 1 -- 172.21.15.26:0/2680290099 shutdown_connections 2023-10-01T08:00:44.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.381+0000 7ff297d49700 1 --2- 172.21.15.26:0/2680290099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff29009f650 0x7ff29006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.381+0000 7ff297d49700 1 --2- 172.21.15.26:0/2680290099 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff29009e930 0x7ff29006b8b0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.381+0000 7ff297d49700 1 --2- 172.21.15.26:0/2680290099 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff29009f240 0x7ff29006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.381+0000 7ff297d49700 1 -- 172.21.15.26:0/2680290099 >> 172.21.15.26:0/2680290099 conn(0x7ff2900a4210 msgr2=0x7ff2901b7ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:44.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.381+0000 7ff297d49700 1 -- 172.21.15.26:0/2680290099 shutdown_connections 2023-10-01T08:00:44.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.381+0000 7ff297d49700 1 -- 172.21.15.26:0/2680290099 wait complete. 2023-10-01T08:00:44.397 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:44.457 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:44.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.498+0000 7f92178ef700 1 Processor -- start 2023-10-01T08:00:44.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.498+0000 7f92178ef700 1 -- start start 2023-10-01T08:00:44.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.498+0000 7f92178ef700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f921006a770 0x7f921006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:44.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.498+0000 7f92178ef700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f921006b080 0x7f9210131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:44.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.498+0000 7f92178ef700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9210131b40 0x7f9210131fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:44.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.498+0000 7f92178ef700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f921009ece0 con 0x7f921006a770 2023-10-01T08:00:44.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.499+0000 7f92178ef700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f921009e760 con 0x7f9210131b40 2023-10-01T08:00:44.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.499+0000 7f92178ef700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f921009e040 con 0x7f921006b080 2023-10-01T08:00:44.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.499+0000 7f9214e8a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f921006b080 0x7f9210131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:44.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.499+0000 7f921568b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f921006a770 0x7f921006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:44.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.499+0000 7f9215e8c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9210131b40 0x7f9210131fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:44.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.499+0000 7f9215e8c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9210131b40 0x7f9210131fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:32866/0 (socket says 172.21.15.26:32866) 2023-10-01T08:00:44.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.499+0000 7f9214e8a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f921006b080 0x7f9210131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44422/0 (socket says 172.21.15.26:44422) 2023-10-01T08:00:44.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.499+0000 7f9214e8a700 1 -- 172.21.15.26:0/96372514 learned_addr learned my addr 172.21.15.26:0/96372514 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:44.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.499+0000 7f921568b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f921006a770 0x7f921006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59192/0 (socket says 172.21.15.26:59192) 2023-10-01T08:00:44.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.499+0000 7f9214e8a700 1 -- 172.21.15.26:0/96372514 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9210131b40 msgr2=0x7f9210131fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:44.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.499+0000 7f9214e8a700 1 --2- 172.21.15.26:0/96372514 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9210131b40 0x7f9210131fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.499+0000 7f9214e8a700 1 -- 172.21.15.26:0/96372514 >> v2:172.21.15.26:3300/0 conn(0x7f921006a770 msgr2=0x7f921006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:44.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.499+0000 7f9214e8a700 1 --2- 172.21.15.26:0/96372514 >> v2:172.21.15.26:3300/0 conn(0x7f921006a770 0x7f921006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.499+0000 7f9214e8a700 1 -- 172.21.15.26:0/96372514 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f921009f630 con 0x7f921006b080 2023-10-01T08:00:44.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.499+0000 7f9215e8c700 1 --2- 172.21.15.26:0/96372514 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9210131b40 0x7f9210131fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:44.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.499+0000 7f921568b700 1 --2- 172.21.15.26:0/96372514 >> v2:172.21.15.26:3300/0 conn(0x7f921006a770 0x7f921006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:44.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.499+0000 7f9214e8a700 1 --2- 172.21.15.26:0/96372514 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f921006b080 0x7f9210131600 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f920000dd10 tx=0x7f920000f330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=646014902e4d50d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:44.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.499+0000 7f9207fff700 1 -- 172.21.15.26:0/96372514 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9200012070 con 0x7f921006b080 2023-10-01T08:00:44.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.500+0000 7f9207fff700 1 -- 172.21.15.26:0/96372514 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920000d2e0 con 0x7f921006b080 2023-10-01T08:00:44.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.500+0000 7f9207fff700 1 -- 172.21.15.26:0/96372514 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920000fb10 con 0x7f921006b080 2023-10-01T08:00:44.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.500+0000 7f92178ef700 1 -- 172.21.15.26:0/96372514 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f921006b080 msgr2=0x7f9210131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:44.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.500+0000 7f92178ef700 1 --2- 172.21.15.26:0/96372514 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f921006b080 0x7f9210131600 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f920000dd10 tx=0x7f920000f330 comp rx=0 tx=0).stop 2023-10-01T08:00:44.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.500+0000 7f92178ef700 1 -- 172.21.15.26:0/96372514 shutdown_connections 2023-10-01T08:00:44.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.500+0000 7f92178ef700 1 --2- 172.21.15.26:0/96372514 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9210131b40 0x7f9210131fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.500+0000 7f92178ef700 1 --2- 172.21.15.26:0/96372514 >> v2:172.21.15.26:3300/0 conn(0x7f921006a770 0x7f921006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.500+0000 7f92178ef700 1 --2- 172.21.15.26:0/96372514 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f921006b080 0x7f9210131600 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.500+0000 7f92178ef700 1 -- 172.21.15.26:0/96372514 >> 172.21.15.26:0/96372514 conn(0x7f9210066f50 msgr2=0x7f921009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:44.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.500+0000 7f92178ef700 1 -- 172.21.15.26:0/96372514 shutdown_connections 2023-10-01T08:00:44.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.500+0000 7f92178ef700 1 -- 172.21.15.26:0/96372514 wait complete. 2023-10-01T08:00:44.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.501+0000 7f92178ef700 1 Processor -- start 2023-10-01T08:00:44.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.501+0000 7f92178ef700 1 -- start start 2023-10-01T08:00:44.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.502+0000 7f92178ef700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f921006a770 0x7f92101c4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:44.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.502+0000 7f92178ef700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f921006b080 0x7f92101c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:44.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.502+0000 7f92178ef700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9210131b40 0x7f921011e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:44.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.502+0000 7f92178ef700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9210130e40 con 0x7f921006a770 2023-10-01T08:00:44.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.502+0000 7f92178ef700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92101b6cb0 con 0x7f9210131b40 2023-10-01T08:00:44.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.502+0000 7f92178ef700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f921009a6f0 con 0x7f921006b080 2023-10-01T08:00:44.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.502+0000 7f9214e8a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f921006b080 0x7f92101c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:44.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.502+0000 7f9215e8c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9210131b40 0x7f921011e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:44.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.502+0000 7f9214e8a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f921006b080 0x7f92101c48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44426/0 (socket says 172.21.15.26:44426) 2023-10-01T08:00:44.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.502+0000 7f9214e8a700 1 -- 172.21.15.26:0/1961169776 learned_addr learned my addr 172.21.15.26:0/1961169776 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:44.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.502+0000 7f921568b700 1 --2- 172.21.15.26:0/1961169776 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f921006a770 0x7f92101c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:44.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.502+0000 7f9214e8a700 1 -- 172.21.15.26:0/1961169776 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9210131b40 msgr2=0x7f921011e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:44.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.502+0000 7f9214e8a700 1 --2- 172.21.15.26:0/1961169776 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9210131b40 0x7f921011e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.502+0000 7f9214e8a700 1 -- 172.21.15.26:0/1961169776 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f921006a770 msgr2=0x7f92101c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:44.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.502+0000 7f9214e8a700 1 --2- 172.21.15.26:0/1961169776 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f921006a770 0x7f92101c4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.502+0000 7f9214e8a700 1 -- 172.21.15.26:0/1961169776 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f920c0094a0 con 0x7f921006b080 2023-10-01T08:00:44.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.502+0000 7f9215e8c700 1 --2- 172.21.15.26:0/1961169776 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9210131b40 0x7f921011e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:44.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.503+0000 7f9214e8a700 1 --2- 172.21.15.26:0/1961169776 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f921006b080 0x7f92101c48b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f920000f370 tx=0x7f9200004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:44.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.503+0000 7f9205ffb700 1 -- 172.21.15.26:0/1961169776 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920000d870 con 0x7f921006b080 2023-10-01T08:00:44.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.503+0000 7f9205ffb700 1 -- 172.21.15.26:0/1961169776 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920000de60 con 0x7f921006b080 2023-10-01T08:00:44.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.503+0000 7f92178ef700 1 -- 172.21.15.26:0/1961169776 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9208009a70 con 0x7f921006b080 2023-10-01T08:00:44.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.503+0000 7f9205ffb700 1 -- 172.21.15.26:0/1961169776 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92000038e0 con 0x7f921006b080 2023-10-01T08:00:44.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.503+0000 7f92178ef700 1 -- 172.21.15.26:0/1961169776 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f920000d9f0 con 0x7f921006b080 2023-10-01T08:00:44.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.504+0000 7f9205ffb700 1 -- 172.21.15.26:0/1961169776 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9200003a40 con 0x7f921006b080 2023-10-01T08:00:44.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.504+0000 7f92178ef700 1 -- 172.21.15.26:0/1961169776 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9210071e60 con 0x7f921006b080 2023-10-01T08:00:44.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.504+0000 7f9205ffb700 1 -- 172.21.15.26:0/1961169776 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9200044a80 con 0x7f921006b080 2023-10-01T08:00:44.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.509+0000 7f9205ffb700 1 -- 172.21.15.26:0/1961169776 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f920000b450 con 0x7f921006b080 2023-10-01T08:00:44.511 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:44.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.601+0000 7f340d39c700 1 Processor -- start 2023-10-01T08:00:44.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.601+0000 7f340d39c700 1 -- start start 2023-10-01T08:00:44.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.602+0000 7f340d39c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3408136710 0x7f3408138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:44.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.602+0000 7f340d39c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3408139030 0x7f340813b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:44.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.602+0000 7f340d39c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f340806ef30 con 0x7f34081338a0 2023-10-01T08:00:44.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.602+0000 7f340d39c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f340806fef0 con 0x7f3408136710 2023-10-01T08:00:44.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.602+0000 7f340d39c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34081334b0 con 0x7f3408139030 2023-10-01T08:00:44.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.602+0000 7f34067fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3408136710 0x7f3408138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:44.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.602+0000 7f34077fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3408139030 0x7f340813b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:44.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.602+0000 7f34067fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3408136710 0x7f3408138af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:32870/0 (socket says 172.21.15.26:32870) 2023-10-01T08:00:44.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.602+0000 7f34067fc700 1 -- 172.21.15.26:0/2539936122 learned_addr learned my addr 172.21.15.26:0/2539936122 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:44.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.603+0000 7f34067fc700 1 -- 172.21.15.26:0/2539936122 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3408139030 msgr2=0x7f340813b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:44.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.603+0000 7f34067fc700 1 --2- 172.21.15.26:0/2539936122 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3408139030 0x7f340813b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.603+0000 7f34067fc700 1 -- 172.21.15.26:0/2539936122 >> v1:172.21.15.26:6789/0 conn(0x7f34081338a0 legacy=0x7f3408133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:44.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.603+0000 7f34067fc700 1 -- 172.21.15.26:0/2539936122 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f340806fc30 con 0x7f3408136710 2023-10-01T08:00:44.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.603+0000 7f34077fe700 1 --2- 172.21.15.26:0/2539936122 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3408139030 0x7f340813b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:44.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.603+0000 7f34067fc700 1 --2- 172.21.15.26:0/2539936122 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3408136710 0x7f3408138af0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f33fc009920 tx=0x7f33fc009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20adb916d7eea8d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:44.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.603+0000 7f3405ffb700 1 -- 172.21.15.26:0/2539936122 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33fc004230 con 0x7f3408136710 2023-10-01T08:00:44.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.603+0000 7f3405ffb700 1 -- 172.21.15.26:0/2539936122 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33fc004390 con 0x7f3408136710 2023-10-01T08:00:44.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.603+0000 7f3405ffb700 1 -- 172.21.15.26:0/2539936122 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33fc0036a0 con 0x7f3408136710 2023-10-01T08:00:44.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.604+0000 7f340d39c700 1 -- 172.21.15.26:0/2539936122 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3408136710 msgr2=0x7f3408138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:44.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.604+0000 7f340d39c700 1 --2- 172.21.15.26:0/2539936122 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3408136710 0x7f3408138af0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f33fc009920 tx=0x7f33fc009c30 comp rx=0 tx=0).stop 2023-10-01T08:00:44.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.604+0000 7f340d39c700 1 -- 172.21.15.26:0/2539936122 shutdown_connections 2023-10-01T08:00:44.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.604+0000 7f340d39c700 1 --2- 172.21.15.26:0/2539936122 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3408139030 0x7f340813b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.604+0000 7f340d39c700 1 --2- 172.21.15.26:0/2539936122 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3408136710 0x7f3408138af0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.604+0000 7f340d39c700 1 -- 172.21.15.26:0/2539936122 >> 172.21.15.26:0/2539936122 conn(0x7f34080a2aa0 msgr2=0x7f34080a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:44.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.604+0000 7f340d39c700 1 -- 172.21.15.26:0/2539936122 shutdown_connections 2023-10-01T08:00:44.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.604+0000 7f340d39c700 1 -- 172.21.15.26:0/2539936122 wait complete. 2023-10-01T08:00:44.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.605+0000 7f340d39c700 1 Processor -- start 2023-10-01T08:00:44.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.605+0000 7f340d39c700 1 -- start start 2023-10-01T08:00:44.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.606+0000 7f340d39c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34081338a0 0x7f3408119fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:44.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.606+0000 7f340d39c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3408136710 0x7f340811a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:44.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.606+0000 7f340d39c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3408139030 0x7f340811aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:44.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.606+0000 7f340d39c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340811bb00 con 0x7f34081338a0 2023-10-01T08:00:44.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.606+0000 7f340d39c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f340811bf40 con 0x7f3408139030 2023-10-01T08:00:44.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.606+0000 7f340d39c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f340811d020 con 0x7f3408136710 2023-10-01T08:00:44.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.606+0000 7f34077fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3408139030 0x7f340811aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:44.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.606+0000 7f34067fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3408136710 0x7f340811a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:44.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.606+0000 7f34077fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3408139030 0x7f340811aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:32880/0 (socket says 172.21.15.26:32880) 2023-10-01T08:00:44.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.606+0000 7f34067fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3408136710 0x7f340811a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44442/0 (socket says 172.21.15.26:44442) 2023-10-01T08:00:44.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.606+0000 7f34077fe700 1 -- 172.21.15.26:0/3284309883 learned_addr learned my addr 172.21.15.26:0/3284309883 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:44.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.606+0000 7f3406ffd700 1 --2- 172.21.15.26:0/3284309883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34081338a0 0x7f3408119fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:44.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.606+0000 7f34077fe700 1 -- 172.21.15.26:0/3284309883 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3408136710 msgr2=0x7f340811a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:44.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.606+0000 7f34077fe700 1 --2- 172.21.15.26:0/3284309883 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3408136710 0x7f340811a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.606+0000 7f34077fe700 1 -- 172.21.15.26:0/3284309883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34081338a0 msgr2=0x7f3408119fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:44.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.606+0000 7f34077fe700 1 --2- 172.21.15.26:0/3284309883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34081338a0 0x7f3408119fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.606+0000 7f34077fe700 1 -- 172.21.15.26:0/3284309883 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3400009a70 con 0x7f3408139030 2023-10-01T08:00:44.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.606+0000 7f3406ffd700 1 --2- 172.21.15.26:0/3284309883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34081338a0 0x7f3408119fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:44.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.606+0000 7f34067fc700 1 --2- 172.21.15.26:0/3284309883 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3408136710 0x7f340811a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:44.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.606+0000 7f34077fe700 1 --2- 172.21.15.26:0/3284309883 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3408139030 0x7f340811aa40 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f340000efc0 tx=0x7f340000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:44.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.607+0000 7f33ef7fe700 1 -- 172.21.15.26:0/3284309883 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340000ca90 con 0x7f3408139030 2023-10-01T08:00:44.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.607+0000 7f33ef7fe700 1 -- 172.21.15.26:0/3284309883 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340000f040 con 0x7f3408139030 2023-10-01T08:00:44.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.607+0000 7f340d39c700 1 -- 172.21.15.26:0/3284309883 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33fc009550 con 0x7f3408139030 2023-10-01T08:00:44.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.607+0000 7f33ef7fe700 1 -- 172.21.15.26:0/3284309883 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340000ce10 con 0x7f3408139030 2023-10-01T08:00:44.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.607+0000 7f340d39c700 1 -- 172.21.15.26:0/3284309883 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f340811dab0 con 0x7f3408139030 2023-10-01T08:00:44.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.608+0000 7f33ef7fe700 1 -- 172.21.15.26:0/3284309883 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3400014480 con 0x7f3408139030 2023-10-01T08:00:44.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.608+0000 7f33ef7fe700 1 -- 172.21.15.26:0/3284309883 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f340003fcb0 con 0x7f3408139030 2023-10-01T08:00:44.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.608+0000 7f340d39c700 1 -- 172.21.15.26:0/3284309883 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f340811d6d0 con 0x7f3408139030 2023-10-01T08:00:44.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.613+0000 7f33ef7fe700 1 -- 172.21.15.26:0/3284309883 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3400012910 con 0x7f3408139030 2023-10-01T08:00:44.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.652+0000 7fca5acbe700 1 Processor -- start 2023-10-01T08:00:44.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.652+0000 7fca5acbe700 1 -- start start 2023-10-01T08:00:44.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.653+0000 7fca5acbe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fca5409d630 0x7fca540a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:44.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.653+0000 7fca5acbe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fca54138d80 0x7fca5413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:44.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.653+0000 7fca5acbe700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca540a2a70 con 0x7fca540a0a30 2023-10-01T08:00:44.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.653+0000 7fca5acbe700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca540a01d0 con 0x7fca54138d80 2023-10-01T08:00:44.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.653+0000 7fca5acbe700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca5409e2b0 con 0x7fca5409d630 2023-10-01T08:00:44.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.653+0000 7fca58a5a700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fca540a0a30 0x7fca540a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38754/0 (socket says 172.21.15.26:38754) 2023-10-01T08:00:44.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.653+0000 7fca58a5a700 1 -- 172.21.15.26:0/1502930055 learned_addr learned my addr 172.21.15.26:0/1502930055 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:44.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.653+0000 7fca53fff700 1 --2- 172.21.15.26:0/1502930055 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fca5409d630 0x7fca540a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:44.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.653+0000 7fca5925b700 1 --2- 172.21.15.26:0/1502930055 >> v2:172.21.15.26:3300/0 conn(0x7fca54138d80 0x7fca5413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:44.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.653+0000 7fca53fff700 1 -- 172.21.15.26:0/1502930055 >> v2:172.21.15.26:3300/0 conn(0x7fca54138d80 msgr2=0x7fca5413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:44.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.653+0000 7fca53fff700 1 --2- 172.21.15.26:0/1502930055 >> v2:172.21.15.26:3300/0 conn(0x7fca54138d80 0x7fca5413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.653+0000 7fca53fff700 1 -- 172.21.15.26:0/1502930055 >> v1:172.21.15.26:6789/0 conn(0x7fca540a0a30 legacy=0x7fca540a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:44.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.653+0000 7fca53fff700 1 -- 172.21.15.26:0/1502930055 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5409dc50 con 0x7fca5409d630 2023-10-01T08:00:44.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.654+0000 7fca53fff700 1 --2- 172.21.15.26:0/1502930055 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fca5409d630 0x7fca540a1510 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fca48009840 tx=0x7fca48009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a33b2bcc76a273a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:44.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.654+0000 7fca537fe700 1 -- 172.21.15.26:0/1502930055 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca48011830 con 0x7fca5409d630 2023-10-01T08:00:44.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.654+0000 7fca537fe700 1 -- 172.21.15.26:0/1502930055 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca48011990 con 0x7fca5409d630 2023-10-01T08:00:44.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.654+0000 7fca537fe700 1 -- 172.21.15.26:0/1502930055 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca48011d20 con 0x7fca5409d630 2023-10-01T08:00:44.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.655+0000 7fca5acbe700 1 -- 172.21.15.26:0/1502930055 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fca5409d630 msgr2=0x7fca540a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:44.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.655+0000 7fca5acbe700 1 --2- 172.21.15.26:0/1502930055 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fca5409d630 0x7fca540a1510 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fca48009840 tx=0x7fca48009b50 comp rx=0 tx=0).stop 2023-10-01T08:00:44.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.655+0000 7fca5acbe700 1 -- 172.21.15.26:0/1502930055 shutdown_connections 2023-10-01T08:00:44.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.655+0000 7fca5acbe700 1 --2- 172.21.15.26:0/1502930055 >> v2:172.21.15.26:3300/0 conn(0x7fca54138d80 0x7fca5413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.655+0000 7fca5acbe700 1 --2- 172.21.15.26:0/1502930055 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fca5409d630 0x7fca540a1510 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.655+0000 7fca5acbe700 1 -- 172.21.15.26:0/1502930055 >> 172.21.15.26:0/1502930055 conn(0x7fca540a3050 msgr2=0x7fca540a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:44.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.655+0000 7fca5acbe700 1 -- 172.21.15.26:0/1502930055 shutdown_connections 2023-10-01T08:00:44.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.655+0000 7fca5acbe700 1 -- 172.21.15.26:0/1502930055 wait complete. 2023-10-01T08:00:44.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.656+0000 7fca5acbe700 1 Processor -- start 2023-10-01T08:00:44.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.656+0000 7fca5acbe700 1 -- start start 2023-10-01T08:00:44.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.657+0000 7fca5acbe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca5409d630 0x7fca541c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:44.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.657+0000 7fca5acbe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fca540a0a30 0x7fca541c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:44.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.657+0000 7fca5acbe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fca54138d80 0x7fca541c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:44.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.657+0000 7fca5acbe700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca541381b0 con 0x7fca5409d630 2023-10-01T08:00:44.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.657+0000 7fca5acbe700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca541361d0 con 0x7fca54138d80 2023-10-01T08:00:44.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.657+0000 7fca5acbe700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca5413b030 con 0x7fca540a0a30 2023-10-01T08:00:44.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.657+0000 7fca58a5a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca5409d630 0x7fca541c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:44.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.657+0000 7fca58a5a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca5409d630 0x7fca541c8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59224/0 (socket says 172.21.15.26:59224) 2023-10-01T08:00:44.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.657+0000 7fca58a5a700 1 -- 172.21.15.26:0/4065835759 learned_addr learned my addr 172.21.15.26:0/4065835759 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:44.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.657+0000 7fca53fff700 1 --2- 172.21.15.26:0/4065835759 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fca540a0a30 0x7fca541c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:44.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.657+0000 7fca5925b700 1 --2- 172.21.15.26:0/4065835759 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fca54138d80 0x7fca541c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:44.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.658+0000 7fca58a5a700 1 -- 172.21.15.26:0/4065835759 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fca540a0a30 msgr2=0x7fca541c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:44.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.658+0000 7fca58a5a700 1 --2- 172.21.15.26:0/4065835759 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fca540a0a30 0x7fca541c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.658+0000 7fca58a5a700 1 -- 172.21.15.26:0/4065835759 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fca54138d80 msgr2=0x7fca541c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:44.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.658+0000 7fca58a5a700 1 --2- 172.21.15.26:0/4065835759 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fca54138d80 0x7fca541c9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.658+0000 7fca58a5a700 1 -- 172.21.15.26:0/4065835759 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca480094a0 con 0x7fca5409d630 2023-10-01T08:00:44.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.658+0000 7fca53fff700 1 --2- 172.21.15.26:0/4065835759 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fca540a0a30 0x7fca541c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:44.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.658+0000 7fca58a5a700 1 --2- 172.21.15.26:0/4065835759 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca5409d630 0x7fca541c8600 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fca4400c520 tx=0x7fca4400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:44.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.658+0000 7fca517fa700 1 -- 172.21.15.26:0/4065835759 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca44005d70 con 0x7fca5409d630 2023-10-01T08:00:44.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.658+0000 7fca517fa700 1 -- 172.21.15.26:0/4065835759 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca440070d0 con 0x7fca5409d630 2023-10-01T08:00:44.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.658+0000 7fca5acbe700 1 -- 172.21.15.26:0/4065835759 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca540a0410 con 0x7fca5409d630 2023-10-01T08:00:44.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.658+0000 7fca517fa700 1 -- 172.21.15.26:0/4065835759 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca44007440 con 0x7fca5409d630 2023-10-01T08:00:44.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.658+0000 7fca5acbe700 1 -- 172.21.15.26:0/4065835759 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca54136c40 con 0x7fca5409d630 2023-10-01T08:00:44.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.659+0000 7fca517fa700 1 -- 172.21.15.26:0/4065835759 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fca440075a0 con 0x7fca5409d630 2023-10-01T08:00:44.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.659+0000 7fca5acbe700 1 -- 172.21.15.26:0/4065835759 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca54136010 con 0x7fca5409d630 2023-10-01T08:00:44.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.660+0000 7fca517fa700 1 -- 172.21.15.26:0/4065835759 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fca4403ea20 con 0x7fca5409d630 2023-10-01T08:00:44.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.665+0000 7fca517fa700 1 -- 172.21.15.26:0/4065835759 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fca44019b40 con 0x7fca5409d630 2023-10-01T08:00:44.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.721+0000 7f92178ef700 1 -- 172.21.15.26:0/1961169776 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9210074ea0 con 0x7f921006b080 2023-10-01T08:00:44.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.722+0000 7f9205ffb700 1 -- 172.21.15.26:0/1961169776 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f92000283c0 con 0x7f921006b080 2023-10-01T08:00:44.722 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:44.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.724+0000 7f92178ef700 1 -- 172.21.15.26:0/1961169776 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f921006b080 msgr2=0x7f92101c48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:44.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.724+0000 7f92178ef700 1 --2- 172.21.15.26:0/1961169776 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f921006b080 0x7f92101c48b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f920000f370 tx=0x7f9200004750 comp rx=0 tx=0).stop 2023-10-01T08:00:44.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.724+0000 7f92178ef700 1 -- 172.21.15.26:0/1961169776 shutdown_connections 2023-10-01T08:00:44.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.724+0000 7f92178ef700 1 --2- 172.21.15.26:0/1961169776 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9210131b40 0x7f921011e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.724+0000 7f92178ef700 1 --2- 172.21.15.26:0/1961169776 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f921006a770 0x7f92101c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.724+0000 7f92178ef700 1 --2- 172.21.15.26:0/1961169776 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f921006b080 0x7f92101c48b0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.724+0000 7f92178ef700 1 -- 172.21.15.26:0/1961169776 >> 172.21.15.26:0/1961169776 conn(0x7f9210066f50 msgr2=0x7f92100a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:44.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.724+0000 7f92178ef700 1 -- 172.21.15.26:0/1961169776 shutdown_connections 2023-10-01T08:00:44.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.724+0000 7f92178ef700 1 -- 172.21.15.26:0/1961169776 wait complete. 2023-10-01T08:00:44.739 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:44.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.820+0000 7f340d39c700 1 -- 172.21.15.26:0/3284309883 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3408074ea0 con 0x7f3408139030 2023-10-01T08:00:44.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.821+0000 7f33ef7fe700 1 -- 172.21.15.26:0/3284309883 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3400012340 con 0x7f3408139030 2023-10-01T08:00:44.822 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:44.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.823+0000 7f340d39c700 1 -- 172.21.15.26:0/3284309883 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3408139030 msgr2=0x7f340811aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:44.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.823+0000 7f340d39c700 1 --2- 172.21.15.26:0/3284309883 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3408139030 0x7f340811aa40 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f340000efc0 tx=0x7f340000c3a0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.823+0000 7f340d39c700 1 -- 172.21.15.26:0/3284309883 shutdown_connections 2023-10-01T08:00:44.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.823+0000 7f340d39c700 1 --2- 172.21.15.26:0/3284309883 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3408139030 0x7f340811aa40 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.823+0000 7f340d39c700 1 --2- 172.21.15.26:0/3284309883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34081338a0 0x7f3408119fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.823+0000 7f340d39c700 1 --2- 172.21.15.26:0/3284309883 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3408136710 0x7f340811a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.823+0000 7f340d39c700 1 -- 172.21.15.26:0/3284309883 >> 172.21.15.26:0/3284309883 conn(0x7f34080a2aa0 msgr2=0x7f3408130050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:44.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.823+0000 7f340d39c700 1 -- 172.21.15.26:0/3284309883 shutdown_connections 2023-10-01T08:00:44.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.823+0000 7f340d39c700 1 -- 172.21.15.26:0/3284309883 wait complete. 2023-10-01T08:00:44.838 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:44.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.871+0000 7fca5acbe700 1 -- 172.21.15.26:0/4065835759 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fca540747f0 con 0x7fca5409d630 2023-10-01T08:00:44.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.872+0000 7fca517fa700 1 -- 172.21.15.26:0/4065835759 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fca44017030 con 0x7fca5409d630 2023-10-01T08:00:44.873 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:44.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.874+0000 7fca5acbe700 1 -- 172.21.15.26:0/4065835759 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca5409d630 msgr2=0x7fca541c8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:44.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.874+0000 7fca5acbe700 1 --2- 172.21.15.26:0/4065835759 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca5409d630 0x7fca541c8600 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fca4400c520 tx=0x7fca4400c830 comp rx=0 tx=0).stop 2023-10-01T08:00:44.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.874+0000 7fca5acbe700 1 -- 172.21.15.26:0/4065835759 shutdown_connections 2023-10-01T08:00:44.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.874+0000 7fca5acbe700 1 --2- 172.21.15.26:0/4065835759 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fca54138d80 0x7fca541c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.874+0000 7fca5acbe700 1 --2- 172.21.15.26:0/4065835759 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca5409d630 0x7fca541c8600 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.874+0000 7fca5acbe700 1 --2- 172.21.15.26:0/4065835759 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fca540a0a30 0x7fca541c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:44.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.874+0000 7fca5acbe700 1 -- 172.21.15.26:0/4065835759 >> 172.21.15.26:0/4065835759 conn(0x7fca540a3050 msgr2=0x7fca5409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:44.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.874+0000 7fca5acbe700 1 -- 172.21.15.26:0/4065835759 shutdown_connections 2023-10-01T08:00:44.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:44.874+0000 7fca5acbe700 1 -- 172.21.15.26:0/4065835759 wait complete. 2023-10-01T08:00:44.888 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:45.398 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:45.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.544+0000 7f5e5d08a700 1 Processor -- start 2023-10-01T08:00:45.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.544+0000 7f5e5d08a700 1 -- start start 2023-10-01T08:00:45.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.544+0000 7f5e5d08a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5e5809e930 0x7f5e5809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:45.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.544+0000 7f5e5d08a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5e5809f650 0x7f5e58131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:45.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.544+0000 7f5e5d08a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e58070940 con 0x7f5e5809f240 2023-10-01T08:00:45.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.544+0000 7f5e5d08a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e5806fd60 con 0x7f5e5809f650 2023-10-01T08:00:45.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.544+0000 7f5e5d08a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5806fa80 con 0x7f5e5809e930 2023-10-01T08:00:45.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.544+0000 7f5e56d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5e5809e930 0x7f5e5809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:45.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.544+0000 7f5e5659c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5e5809f240 0x7f5e581317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38768/0 (socket says 172.21.15.26:38768) 2023-10-01T08:00:45.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.545+0000 7f5e5659c700 1 -- 172.21.15.26:0/1648919777 learned_addr learned my addr 172.21.15.26:0/1648919777 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:45.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.545+0000 7f5e5759e700 1 --2- 172.21.15.26:0/1648919777 >> v2:172.21.15.26:3300/0 conn(0x7f5e5809f650 0x7f5e58131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:45.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.545+0000 7f5e56d9d700 1 -- 172.21.15.26:0/1648919777 >> v2:172.21.15.26:3300/0 conn(0x7f5e5809f650 msgr2=0x7f5e58131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:45.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.545+0000 7f5e56d9d700 1 --2- 172.21.15.26:0/1648919777 >> v2:172.21.15.26:3300/0 conn(0x7f5e5809f650 0x7f5e58131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:45.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.545+0000 7f5e56d9d700 1 -- 172.21.15.26:0/1648919777 >> v1:172.21.15.26:6789/0 conn(0x7f5e5809f240 legacy=0x7f5e581317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:45.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.545+0000 7f5e56d9d700 1 -- 172.21.15.26:0/1648919777 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e5809fb60 con 0x7f5e5809e930 2023-10-01T08:00:45.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.545+0000 7f5e5759e700 1 --2- 172.21.15.26:0/1648919777 >> v2:172.21.15.26:3300/0 conn(0x7f5e5809f650 0x7f5e58131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:45.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.545+0000 7f5e56d9d700 1 --2- 172.21.15.26:0/1648919777 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5e5809e930 0x7f5e5809ed00 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f5e48009840 tx=0x7f5e48009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcef071a6dbd6c26 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:45.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.545+0000 7f5e55d9b700 1 -- 172.21.15.26:0/1648919777 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e48011830 con 0x7f5e5809e930 2023-10-01T08:00:45.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.545+0000 7f5e55d9b700 1 -- 172.21.15.26:0/1648919777 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e48011990 con 0x7f5e5809e930 2023-10-01T08:00:45.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.545+0000 7f5e55d9b700 1 -- 172.21.15.26:0/1648919777 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e48011d20 con 0x7f5e5809e930 2023-10-01T08:00:45.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.546+0000 7f5e5d08a700 1 -- 172.21.15.26:0/1648919777 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5e5809e930 msgr2=0x7f5e5809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:45.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.546+0000 7f5e5d08a700 1 --2- 172.21.15.26:0/1648919777 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5e5809e930 0x7f5e5809ed00 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f5e48009840 tx=0x7f5e48009b50 comp rx=0 tx=0).stop 2023-10-01T08:00:45.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.546+0000 7f5e5d08a700 1 -- 172.21.15.26:0/1648919777 shutdown_connections 2023-10-01T08:00:45.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.546+0000 7f5e5d08a700 1 --2- 172.21.15.26:0/1648919777 >> v2:172.21.15.26:3300/0 conn(0x7f5e5809f650 0x7f5e58131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:45.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.546+0000 7f5e5d08a700 1 --2- 172.21.15.26:0/1648919777 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5e5809e930 0x7f5e5809ed00 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:45.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.546+0000 7f5e5d08a700 1 -- 172.21.15.26:0/1648919777 >> 172.21.15.26:0/1648919777 conn(0x7f5e580a4210 msgr2=0x7f5e580a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:45.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.546+0000 7f5e5d08a700 1 -- 172.21.15.26:0/1648919777 shutdown_connections 2023-10-01T08:00:45.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.546+0000 7f5e5d08a700 1 -- 172.21.15.26:0/1648919777 wait complete. 2023-10-01T08:00:45.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.547+0000 7f5e5d08a700 1 Processor -- start 2023-10-01T08:00:45.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.547+0000 7f5e5d08a700 1 -- start start 2023-10-01T08:00:45.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.548+0000 7f5e5d08a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e5809e930 0x7f5e581a3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:45.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.548+0000 7f5e5d08a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5e5809f240 0x7f5e581a4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:45.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.548+0000 7f5e5d08a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5e5809f650 0x7f5e581a47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:45.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.548+0000 7f5e5d08a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e581a6c10 con 0x7f5e5809e930 2023-10-01T08:00:45.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.548+0000 7f5e5d08a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e581a51f0 con 0x7f5e5809f650 2023-10-01T08:00:45.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.548+0000 7f5e5d08a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e581a7660 con 0x7f5e5809f240 2023-10-01T08:00:45.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.548+0000 7f5e56d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e5809e930 0x7f5e581a3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:45.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.548+0000 7f5e5759e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5e5809f650 0x7f5e581a47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:45.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.548+0000 7f5e56d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e5809e930 0x7f5e581a3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59236/0 (socket says 172.21.15.26:59236) 2023-10-01T08:00:45.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.548+0000 7f5e56d9d700 1 -- 172.21.15.26:0/2329182422 learned_addr learned my addr 172.21.15.26:0/2329182422 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:45.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.548+0000 7f5e5659c700 1 --2- 172.21.15.26:0/2329182422 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5e5809f240 0x7f5e581a4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:45.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.548+0000 7f5e56d9d700 1 -- 172.21.15.26:0/2329182422 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5e5809f240 msgr2=0x7f5e581a4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:45.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.548+0000 7f5e56d9d700 1 --2- 172.21.15.26:0/2329182422 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5e5809f240 0x7f5e581a4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:45.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.548+0000 7f5e56d9d700 1 -- 172.21.15.26:0/2329182422 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5e5809f650 msgr2=0x7f5e581a47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:45.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.548+0000 7f5e56d9d700 1 --2- 172.21.15.26:0/2329182422 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5e5809f650 0x7f5e581a47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:45.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.548+0000 7f5e56d9d700 1 -- 172.21.15.26:0/2329182422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e50009a70 con 0x7f5e5809e930 2023-10-01T08:00:45.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.548+0000 7f5e5759e700 1 --2- 172.21.15.26:0/2329182422 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5e5809f650 0x7f5e581a47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:45.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.548+0000 7f5e5659c700 1 --2- 172.21.15.26:0/2329182422 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5e5809f240 0x7f5e581a4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:45.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.548+0000 7f5e56d9d700 1 --2- 172.21.15.26:0/2329182422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e5809e930 0x7f5e581a3d40 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f5e48009fd0 tx=0x7f5e48004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:45.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.549+0000 7f5e3f7fe700 1 -- 172.21.15.26:0/2329182422 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e480045d0 con 0x7f5e5809e930 2023-10-01T08:00:45.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.549+0000 7f5e3f7fe700 1 -- 172.21.15.26:0/2329182422 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4801f070 con 0x7f5e5809e930 2023-10-01T08:00:45.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.549+0000 7f5e3f7fe700 1 -- 172.21.15.26:0/2329182422 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e480038e0 con 0x7f5e5809e930 2023-10-01T08:00:45.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.549+0000 7f5e5d08a700 1 -- 172.21.15.26:0/2329182422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e480094a0 con 0x7f5e5809e930 2023-10-01T08:00:45.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.549+0000 7f5e5d08a700 1 -- 172.21.15.26:0/2329182422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e580a0190 con 0x7f5e5809e930 2023-10-01T08:00:45.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.549+0000 7f5e3f7fe700 1 -- 172.21.15.26:0/2329182422 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5e48003a40 con 0x7f5e5809e930 2023-10-01T08:00:45.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.550+0000 7f5e3f7fe700 1 -- 172.21.15.26:0/2329182422 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5e48021070 con 0x7f5e5809e930 2023-10-01T08:00:45.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.550+0000 7f5e5d08a700 1 -- 172.21.15.26:0/2329182422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e581a0b30 con 0x7f5e5809e930 2023-10-01T08:00:45.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.555+0000 7f5e3f7fe700 1 -- 172.21.15.26:0/2329182422 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5e48015080 con 0x7f5e5809e930 2023-10-01T08:00:45.740 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:45.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.758+0000 7f5e5d08a700 1 -- 172.21.15.26:0/2329182422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5e580a3580 con 0x7f5e5809e930 2023-10-01T08:00:45.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.759+0000 7f5e3f7fe700 1 -- 172.21.15.26:0/2329182422 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5e4801a430 con 0x7f5e5809e930 2023-10-01T08:00:45.759 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:45.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.761+0000 7f5e5d08a700 1 -- 172.21.15.26:0/2329182422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e5809e930 msgr2=0x7f5e581a3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:45.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.761+0000 7f5e5d08a700 1 --2- 172.21.15.26:0/2329182422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e5809e930 0x7f5e581a3d40 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f5e48009fd0 tx=0x7f5e48004750 comp rx=0 tx=0).stop 2023-10-01T08:00:45.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.761+0000 7f5e5d08a700 1 -- 172.21.15.26:0/2329182422 shutdown_connections 2023-10-01T08:00:45.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.761+0000 7f5e5d08a700 1 --2- 172.21.15.26:0/2329182422 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5e5809f650 0x7f5e581a47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:45.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.761+0000 7f5e5d08a700 1 --2- 172.21.15.26:0/2329182422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e5809e930 0x7f5e581a3d40 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:45.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.761+0000 7f5e5d08a700 1 --2- 172.21.15.26:0/2329182422 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5e5809f240 0x7f5e581a4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:45.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.761+0000 7f5e5d08a700 1 -- 172.21.15.26:0/2329182422 >> 172.21.15.26:0/2329182422 conn(0x7f5e580a4210 msgr2=0x7f5e581b8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:45.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.761+0000 7f5e5d08a700 1 -- 172.21.15.26:0/2329182422 shutdown_connections 2023-10-01T08:00:45.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.761+0000 7f5e5d08a700 1 -- 172.21.15.26:0/2329182422 wait complete. 2023-10-01T08:00:45.776 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:45.839 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:45.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.878+0000 7f9a51df7700 1 Processor -- start 2023-10-01T08:00:45.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.878+0000 7f9a51df7700 1 -- start start 2023-10-01T08:00:45.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.879+0000 7f9a51df7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9a4c09d6d0 0x7f9a4c09daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:45.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.879+0000 7f9a51df7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a4c09dfe0 0x7f9a4c1335c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:45.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.879+0000 7f9a51df7700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a4c09a570 con 0x7f9a4c133b00 2023-10-01T08:00:45.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.879+0000 7f9a51df7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a4c09b1c0 con 0x7f9a4c09d6d0 2023-10-01T08:00:45.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.879+0000 7f9a51df7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c09f240 con 0x7f9a4c09dfe0 2023-10-01T08:00:45.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.879+0000 7f9a4b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9a4c09d6d0 0x7f9a4c09daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:45.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.879+0000 7f9a4affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a4c09dfe0 0x7f9a4c1335c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:45.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.879+0000 7f9a4b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9a4c09d6d0 0x7f9a4c09daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59248/0 (socket says 172.21.15.26:59248) 2023-10-01T08:00:45.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.879+0000 7f9a4b7fe700 1 -- 172.21.15.26:0/3242502027 learned_addr learned my addr 172.21.15.26:0/3242502027 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:45.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.879+0000 7f9a4b7fe700 1 -- 172.21.15.26:0/3242502027 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a4c09dfe0 msgr2=0x7f9a4c1335c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:45.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.879+0000 7f9a4b7fe700 1 --2- 172.21.15.26:0/3242502027 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a4c09dfe0 0x7f9a4c1335c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:45.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.879+0000 7f9a4b7fe700 1 -- 172.21.15.26:0/3242502027 >> v1:172.21.15.26:6789/0 conn(0x7f9a4c133b00 legacy=0x7f9a4c13aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:45.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.880+0000 7f9a4b7fe700 1 -- 172.21.15.26:0/3242502027 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a4c09a2d0 con 0x7f9a4c09d6d0 2023-10-01T08:00:45.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.880+0000 7f9a4a7fc700 1 -- 172.21.15.26:0/3242502027 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2971675317 0 0) 0x7f9a4c09a570 con 0x7f9a4c133b00 2023-10-01T08:00:45.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.880+0000 7f9a4affd700 1 --2- 172.21.15.26:0/3242502027 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a4c09dfe0 0x7f9a4c1335c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:45.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.880+0000 7f9a4b7fe700 1 --2- 172.21.15.26:0/3242502027 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a4c09d6d0 0x7f9a4c09daa0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c009e50 tx=0x7f9a3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b18fde9df283f6ff server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:45.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.880+0000 7f9a4a7fc700 1 -- 172.21.15.26:0/3242502027 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c00e070 con 0x7f9a4c09d6d0 2023-10-01T08:00:45.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.880+0000 7f9a4a7fc700 1 -- 172.21.15.26:0/3242502027 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3c00b910 con 0x7f9a4c09d6d0 2023-10-01T08:00:45.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.880+0000 7f9a4a7fc700 1 -- 172.21.15.26:0/3242502027 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c00bcc0 con 0x7f9a4c09d6d0 2023-10-01T08:00:45.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.880+0000 7f9a51df7700 1 -- 172.21.15.26:0/3242502027 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a4c09d6d0 msgr2=0x7f9a4c09daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:45.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.880+0000 7f9a51df7700 1 --2- 172.21.15.26:0/3242502027 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a4c09d6d0 0x7f9a4c09daa0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c009e50 tx=0x7f9a3c00b330 comp rx=0 tx=0).stop 2023-10-01T08:00:45.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.880+0000 7f9a51df7700 1 -- 172.21.15.26:0/3242502027 shutdown_connections 2023-10-01T08:00:45.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.881+0000 7f9a51df7700 1 --2- 172.21.15.26:0/3242502027 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a4c09d6d0 0x7f9a4c09daa0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:45.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.881+0000 7f9a51df7700 1 --2- 172.21.15.26:0/3242502027 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a4c09dfe0 0x7f9a4c1335c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:45.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.881+0000 7f9a51df7700 1 -- 172.21.15.26:0/3242502027 >> 172.21.15.26:0/3242502027 conn(0x7f9a4c099c20 msgr2=0x7f9a4c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:45.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.881+0000 7f9a51df7700 1 -- 172.21.15.26:0/3242502027 shutdown_connections 2023-10-01T08:00:45.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.881+0000 7f9a51df7700 1 -- 172.21.15.26:0/3242502027 wait complete. 2023-10-01T08:00:45.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.882+0000 7f9a51df7700 1 Processor -- start 2023-10-01T08:00:45.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.882+0000 7f9a51df7700 1 -- start start 2023-10-01T08:00:45.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.882+0000 7f9a51df7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a4c09d6d0 0x7f9a4c11ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:45.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.882+0000 7f9a51df7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a4c09dfe0 0x7f9a4c11d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:45.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.882+0000 7f9a51df7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a4c133b00 0x7f9a4c11d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:45.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.882+0000 7f9a51df7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c11e270 con 0x7f9a4c09dfe0 2023-10-01T08:00:45.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.882+0000 7f9a51df7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c11f000 con 0x7f9a4c09d6d0 2023-10-01T08:00:45.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.882+0000 7f9a51df7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c1200c0 con 0x7f9a4c133b00 2023-10-01T08:00:45.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.882+0000 7f9a4affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a4c09dfe0 0x7f9a4c11d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:45.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.882+0000 7f9a4b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a4c09d6d0 0x7f9a4c11ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:45.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.882+0000 7f9a4affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a4c09dfe0 0x7f9a4c11d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59256/0 (socket says 172.21.15.26:59256) 2023-10-01T08:00:45.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.883+0000 7f9a4affd700 1 -- 172.21.15.26:0/3307438508 learned_addr learned my addr 172.21.15.26:0/3307438508 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:45.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.883+0000 7f9a4bfff700 1 --2- 172.21.15.26:0/3307438508 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a4c133b00 0x7f9a4c11d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:45.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.883+0000 7f9a4affd700 1 -- 172.21.15.26:0/3307438508 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a4c133b00 msgr2=0x7f9a4c11d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:45.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.883+0000 7f9a4affd700 1 --2- 172.21.15.26:0/3307438508 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a4c133b00 0x7f9a4c11d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:45.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.883+0000 7f9a4affd700 1 -- 172.21.15.26:0/3307438508 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a4c09d6d0 msgr2=0x7f9a4c11ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:45.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.883+0000 7f9a4affd700 1 --2- 172.21.15.26:0/3307438508 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a4c09d6d0 0x7f9a4c11ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:45.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.883+0000 7f9a4affd700 1 -- 172.21.15.26:0/3307438508 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a400094a0 con 0x7f9a4c09dfe0 2023-10-01T08:00:45.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.883+0000 7f9a4b7fe700 1 --2- 172.21.15.26:0/3307438508 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a4c09d6d0 0x7f9a4c11ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:45.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.883+0000 7f9a4affd700 1 --2- 172.21.15.26:0/3307438508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a4c09dfe0 0x7f9a4c11d350 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000ec10 tx=0x7f9a4000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:45.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.883+0000 7f9a33fff700 1 -- 172.21.15.26:0/3307438508 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a40009760 con 0x7f9a4c09dfe0 2023-10-01T08:00:45.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.883+0000 7f9a33fff700 1 -- 172.21.15.26:0/3307438508 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4000c850 con 0x7f9a4c09dfe0 2023-10-01T08:00:45.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.883+0000 7f9a51df7700 1 -- 172.21.15.26:0/3307438508 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a3c009b30 con 0x7f9a4c09dfe0 2023-10-01T08:00:45.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.883+0000 7f9a33fff700 1 -- 172.21.15.26:0/3307438508 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4000cbe0 con 0x7f9a4c09dfe0 2023-10-01T08:00:45.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.883+0000 7f9a51df7700 1 -- 172.21.15.26:0/3307438508 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a4c0a1f50 con 0x7f9a4c09dfe0 2023-10-01T08:00:45.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.884+0000 7f9a33fff700 1 -- 172.21.15.26:0/3307438508 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9a4000cd40 con 0x7f9a4c09dfe0 2023-10-01T08:00:45.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.884+0000 7f9a33fff700 1 -- 172.21.15.26:0/3307438508 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9a4003fae0 con 0x7f9a4c09dfe0 2023-10-01T08:00:45.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.884+0000 7f9a51df7700 1 -- 172.21.15.26:0/3307438508 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a4c1204b0 con 0x7f9a4c09dfe0 2023-10-01T08:00:45.889 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:45.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.889+0000 7f9a33fff700 1 -- 172.21.15.26:0/3307438508 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9a4c1204b0 con 0x7f9a4c09dfe0 2023-10-01T08:00:45.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.982+0000 7f1496316700 1 Processor -- start 2023-10-01T08:00:45.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.982+0000 7f1496316700 1 -- start start 2023-10-01T08:00:45.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.982+0000 7f1496316700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f14900a0090 0x7f1490136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:45.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.982+0000 7f1496316700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f149009d130 0x7f1490139170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:45.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.982+0000 7f1496316700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f149009ba70 con 0x7f149009c650 2023-10-01T08:00:45.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.982+0000 7f1496316700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f149009e8f0 con 0x7f149009d130 2023-10-01T08:00:45.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.982+0000 7f1496316700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14900a0760 con 0x7f14900a0090 2023-10-01T08:00:45.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.982+0000 7f148ffff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f149009c650 0x7f149009ca20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38780/0 (socket says 172.21.15.26:38780) 2023-10-01T08:00:45.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.982+0000 7f148ffff700 1 -- 172.21.15.26:0/1279837658 learned_addr learned my addr 172.21.15.26:0/1279837658 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:45.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.982+0000 7f148f7fe700 1 --2- 172.21.15.26:0/1279837658 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f14900a0090 0x7f1490136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:45.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.983+0000 7f14948b3700 1 --2- 172.21.15.26:0/1279837658 >> v2:172.21.15.26:3300/0 conn(0x7f149009d130 0x7f1490139170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:45.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.983+0000 7f148f7fe700 1 -- 172.21.15.26:0/1279837658 >> v2:172.21.15.26:3300/0 conn(0x7f149009d130 msgr2=0x7f1490139170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:45.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.983+0000 7f148f7fe700 1 --2- 172.21.15.26:0/1279837658 >> v2:172.21.15.26:3300/0 conn(0x7f149009d130 0x7f1490139170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:45.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.983+0000 7f148f7fe700 1 -- 172.21.15.26:0/1279837658 >> v1:172.21.15.26:6789/0 conn(0x7f149009c650 legacy=0x7f149009ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:45.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.983+0000 7f148effd700 1 -- 172.21.15.26:0/1279837658 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 884636954 0 0) 0x7f149009ba70 con 0x7f149009c650 2023-10-01T08:00:45.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.983+0000 7f148f7fe700 1 -- 172.21.15.26:0/1279837658 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149009a080 con 0x7f14900a0090 2023-10-01T08:00:45.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.983+0000 7f14948b3700 1 --2- 172.21.15.26:0/1279837658 >> v2:172.21.15.26:3300/0 conn(0x7f149009d130 0x7f1490139170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:45.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.983+0000 7f148f7fe700 1 --2- 172.21.15.26:0/1279837658 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f14900a0090 0x7f1490136c20 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f1484009840 tx=0x7f1484009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a76708ad1d3bc1e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:45.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.983+0000 7f148effd700 1 -- 172.21.15.26:0/1279837658 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1484011830 con 0x7f14900a0090 2023-10-01T08:00:45.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.983+0000 7f148effd700 1 -- 172.21.15.26:0/1279837658 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1484011990 con 0x7f14900a0090 2023-10-01T08:00:45.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.983+0000 7f148effd700 1 -- 172.21.15.26:0/1279837658 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1484011d20 con 0x7f14900a0090 2023-10-01T08:00:45.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.984+0000 7f1496316700 1 -- 172.21.15.26:0/1279837658 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f14900a0090 msgr2=0x7f1490136c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:45.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.984+0000 7f1496316700 1 --2- 172.21.15.26:0/1279837658 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f14900a0090 0x7f1490136c20 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f1484009840 tx=0x7f1484009b50 comp rx=0 tx=0).stop 2023-10-01T08:00:45.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.984+0000 7f1496316700 1 -- 172.21.15.26:0/1279837658 shutdown_connections 2023-10-01T08:00:45.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.984+0000 7f1496316700 1 --2- 172.21.15.26:0/1279837658 >> v2:172.21.15.26:3300/0 conn(0x7f149009d130 0x7f1490139170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:45.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.984+0000 7f1496316700 1 --2- 172.21.15.26:0/1279837658 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f14900a0090 0x7f1490136c20 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:45.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.984+0000 7f1496316700 1 -- 172.21.15.26:0/1279837658 >> 172.21.15.26:0/1279837658 conn(0x7f14900a3f70 msgr2=0x7f14900a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:45.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.985+0000 7f1496316700 1 -- 172.21.15.26:0/1279837658 shutdown_connections 2023-10-01T08:00:45.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.985+0000 7f1496316700 1 -- 172.21.15.26:0/1279837658 wait complete. 2023-10-01T08:00:45.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.985+0000 7f1496316700 1 Processor -- start 2023-10-01T08:00:45.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.986+0000 7f1496316700 1 -- start start 2023-10-01T08:00:45.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.986+0000 7f1496316700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f149009c650 0x7f1490135230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:45.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.986+0000 7f1496316700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f149009d130 0x7f1490135770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:45.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.986+0000 7f1496316700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f14900a0090 0x7f1490135cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:45.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.986+0000 7f1496316700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1490136700 con 0x7f149009c650 2023-10-01T08:00:45.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.986+0000 7f1496316700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149011aaa0 con 0x7f14900a0090 2023-10-01T08:00:45.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.986+0000 7f1496316700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1490137d80 con 0x7f149009d130 2023-10-01T08:00:45.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.986+0000 7f14948b3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f14900a0090 0x7f1490135cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:45.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.986+0000 7f14948b3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f14900a0090 0x7f1490135cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:32936/0 (socket says 172.21.15.26:32936) 2023-10-01T08:00:45.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.986+0000 7f14948b3700 1 -- 172.21.15.26:0/755811668 learned_addr learned my addr 172.21.15.26:0/755811668 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:45.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.986+0000 7f148ffff700 1 --2- 172.21.15.26:0/755811668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f149009c650 0x7f1490135230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:45.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.987+0000 7f148f7fe700 1 --2- 172.21.15.26:0/755811668 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f149009d130 0x7f1490135770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:45.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.987+0000 7f14948b3700 1 -- 172.21.15.26:0/755811668 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f149009d130 msgr2=0x7f1490135770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:45.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.987+0000 7f14948b3700 1 --2- 172.21.15.26:0/755811668 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f149009d130 0x7f1490135770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:45.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.987+0000 7f14948b3700 1 -- 172.21.15.26:0/755811668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f149009c650 msgr2=0x7f1490135230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:45.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.987+0000 7f14948b3700 1 --2- 172.21.15.26:0/755811668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f149009c650 0x7f1490135230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:45.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.987+0000 7f14948b3700 1 -- 172.21.15.26:0/755811668 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1488009a70 con 0x7f14900a0090 2023-10-01T08:00:45.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.987+0000 7f148ffff700 1 --2- 172.21.15.26:0/755811668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f149009c650 0x7f1490135230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:45.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.987+0000 7f14948b3700 1 --2- 172.21.15.26:0/755811668 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f14900a0090 0x7f1490135cb0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f148800efc0 tx=0x7f148800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:45.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.987+0000 7f148cff9700 1 -- 172.21.15.26:0/755811668 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148800ca90 con 0x7f14900a0090 2023-10-01T08:00:45.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.987+0000 7f148cff9700 1 -- 172.21.15.26:0/755811668 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148800f040 con 0x7f14900a0090 2023-10-01T08:00:45.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.987+0000 7f1496316700 1 -- 172.21.15.26:0/755811668 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14840094a0 con 0x7f14900a0090 2023-10-01T08:00:45.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.987+0000 7f148cff9700 1 -- 172.21.15.26:0/755811668 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148800ce10 con 0x7f14900a0090 2023-10-01T08:00:45.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.987+0000 7f1496316700 1 -- 172.21.15.26:0/755811668 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f149009d980 con 0x7f14900a0090 2023-10-01T08:00:45.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.988+0000 7f148cff9700 1 -- 172.21.15.26:0/755811668 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1488014480 con 0x7f14900a0090 2023-10-01T08:00:45.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.989+0000 7f148cff9700 1 -- 172.21.15.26:0/755811668 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f148803fd70 con 0x7f14900a0090 2023-10-01T08:00:45.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.989+0000 7f1496316700 1 -- 172.21.15.26:0/755811668 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1490137b10 con 0x7f14900a0090 2023-10-01T08:00:45.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:45.998+0000 7f148cff9700 1 -- 172.21.15.26:0/755811668 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1488012930 con 0x7f14900a0090 2023-10-01T08:00:46.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.030+0000 7f8711a4f700 1 Processor -- start 2023-10-01T08:00:46.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.030+0000 7f8711a4f700 1 -- start start 2023-10-01T08:00:46.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.030+0000 7f8711a4f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f870c130750 0x7f870c130b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:46.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.030+0000 7f8711a4f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f870c09e250 0x7f870c1384c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:46.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.030+0000 7f8711a4f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f870c09c190 con 0x7f870c09d6f0 2023-10-01T08:00:46.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.030+0000 7f8711a4f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870c09b090 con 0x7f870c09e250 2023-10-01T08:00:46.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.030+0000 7f8711a4f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f870c09a6c0 con 0x7f870c130750 2023-10-01T08:00:46.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.031+0000 7f8703fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f870c09d6f0 0x7f870c09db40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38788/0 (socket says 172.21.15.26:38788) 2023-10-01T08:00:46.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.031+0000 7f8703fff700 1 -- 172.21.15.26:0/1646296389 learned_addr learned my addr 172.21.15.26:0/1646296389 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:46.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.031+0000 7f870affd700 1 --2- 172.21.15.26:0/1646296389 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f870c130750 0x7f870c130b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:46.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.031+0000 7f870b7fe700 1 --2- 172.21.15.26:0/1646296389 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f870c09e250 0x7f870c1384c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:46.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.031+0000 7f870affd700 1 -- 172.21.15.26:0/1646296389 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f870c09e250 msgr2=0x7f870c1384c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:46.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.031+0000 7f870affd700 1 --2- 172.21.15.26:0/1646296389 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f870c09e250 0x7f870c1384c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:46.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.031+0000 7f870affd700 1 -- 172.21.15.26:0/1646296389 >> v1:172.21.15.26:6789/0 conn(0x7f870c09d6f0 legacy=0x7f870c09db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:46.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.031+0000 7f870affd700 1 -- 172.21.15.26:0/1646296389 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870c131060 con 0x7f870c130750 2023-10-01T08:00:46.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.031+0000 7f870a7fc700 1 -- 172.21.15.26:0/1646296389 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1885203609 0 0) 0x7f870c09c190 con 0x7f870c09d6f0 2023-10-01T08:00:46.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.031+0000 7f870affd700 1 --2- 172.21.15.26:0/1646296389 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f870c130750 0x7f870c130b20 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f86fc009870 tx=0x7f86fc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bcf4f8abfa18dc5 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:46.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.032+0000 7f870a7fc700 1 -- 172.21.15.26:0/1646296389 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc011830 con 0x7f870c130750 2023-10-01T08:00:46.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.032+0000 7f870a7fc700 1 -- 172.21.15.26:0/1646296389 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86fc011990 con 0x7f870c130750 2023-10-01T08:00:46.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.032+0000 7f870a7fc700 1 -- 172.21.15.26:0/1646296389 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc011d20 con 0x7f870c130750 2023-10-01T08:00:46.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.032+0000 7f8711a4f700 1 -- 172.21.15.26:0/1646296389 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f870c130750 msgr2=0x7f870c130b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:46.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.032+0000 7f8711a4f700 1 --2- 172.21.15.26:0/1646296389 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f870c130750 0x7f870c130b20 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f86fc009870 tx=0x7f86fc009b80 comp rx=0 tx=0).stop 2023-10-01T08:00:46.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.032+0000 7f8711a4f700 1 -- 172.21.15.26:0/1646296389 shutdown_connections 2023-10-01T08:00:46.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.032+0000 7f8711a4f700 1 --2- 172.21.15.26:0/1646296389 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f870c130750 0x7f870c130b20 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:46.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.032+0000 7f8711a4f700 1 --2- 172.21.15.26:0/1646296389 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f870c09e250 0x7f870c1384c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:46.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.032+0000 7f8711a4f700 1 -- 172.21.15.26:0/1646296389 >> 172.21.15.26:0/1646296389 conn(0x7f870c09f470 msgr2=0x7f870c0a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:46.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.032+0000 7f8711a4f700 1 -- 172.21.15.26:0/1646296389 shutdown_connections 2023-10-01T08:00:46.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.032+0000 7f8711a4f700 1 -- 172.21.15.26:0/1646296389 wait complete. 2023-10-01T08:00:46.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.033+0000 7f8711a4f700 1 Processor -- start 2023-10-01T08:00:46.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.033+0000 7f8711a4f700 1 -- start start 2023-10-01T08:00:46.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.034+0000 7f8711a4f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f870c09d6f0 0x7f870c08c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:46.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.034+0000 7f8711a4f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f870c09e250 0x7f870c08c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:46.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.034+0000 7f8711a4f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f870c130750 0x7f870c08caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:46.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.034+0000 7f8711a4f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870c12ee70 con 0x7f870c09e250 2023-10-01T08:00:46.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.034+0000 7f8711a4f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870c08d350 con 0x7f870c130750 2023-10-01T08:00:46.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.034+0000 7f8711a4f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f870c0a04a0 con 0x7f870c09d6f0 2023-10-01T08:00:46.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.034+0000 7f870affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f870c09d6f0 0x7f870c08c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:46.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.034+0000 7f8703fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f870c09e250 0x7f870c08c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:46.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.034+0000 7f870affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f870c09d6f0 0x7f870c08c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44526/0 (socket says 172.21.15.26:44526) 2023-10-01T08:00:46.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.034+0000 7f8703fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f870c09e250 0x7f870c08c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59288/0 (socket says 172.21.15.26:59288) 2023-10-01T08:00:46.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.034+0000 7f870affd700 1 -- 172.21.15.26:0/2284118201 learned_addr learned my addr 172.21.15.26:0/2284118201 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:46.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.034+0000 7f870b7fe700 1 --2- 172.21.15.26:0/2284118201 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f870c130750 0x7f870c08caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:46.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.035+0000 7f870b7fe700 1 -- 172.21.15.26:0/2284118201 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f870c09d6f0 msgr2=0x7f870c08c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:46.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.035+0000 7f870b7fe700 1 --2- 172.21.15.26:0/2284118201 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f870c09d6f0 0x7f870c08c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:46.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.035+0000 7f870b7fe700 1 -- 172.21.15.26:0/2284118201 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f870c09e250 msgr2=0x7f870c08c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:46.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.035+0000 7f870b7fe700 1 --2- 172.21.15.26:0/2284118201 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f870c09e250 0x7f870c08c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:46.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.035+0000 7f870b7fe700 1 -- 172.21.15.26:0/2284118201 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86fc0094a0 con 0x7f870c130750 2023-10-01T08:00:46.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.035+0000 7f8703fff700 1 --2- 172.21.15.26:0/2284118201 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f870c09e250 0x7f870c08c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:46.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.035+0000 7f870b7fe700 1 --2- 172.21.15.26:0/2284118201 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f870c130750 0x7f870c08caa0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f870400ef90 tx=0x7f870400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:46.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.035+0000 7f8708ff9700 1 -- 172.21.15.26:0/2284118201 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870400cc90 con 0x7f870c130750 2023-10-01T08:00:46.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.035+0000 7f8708ff9700 1 -- 172.21.15.26:0/2284118201 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870400f040 con 0x7f870c130750 2023-10-01T08:00:46.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.035+0000 7f8708ff9700 1 -- 172.21.15.26:0/2284118201 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87040146c0 con 0x7f870c130750 2023-10-01T08:00:46.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.035+0000 7f8711a4f700 1 -- 172.21.15.26:0/2284118201 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f870c09b2b0 con 0x7f870c130750 2023-10-01T08:00:46.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.035+0000 7f8711a4f700 1 -- 172.21.15.26:0/2284118201 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f870c12e6e0 con 0x7f870c130750 2023-10-01T08:00:46.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.036+0000 7f8708ff9700 1 -- 172.21.15.26:0/2284118201 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8704014820 con 0x7f870c130750 2023-10-01T08:00:46.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.036+0000 7f8708ff9700 1 -- 172.21.15.26:0/2284118201 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f87040401a0 con 0x7f870c130750 2023-10-01T08:00:46.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.036+0000 7f8711a4f700 1 -- 172.21.15.26:0/2284118201 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f870c0747f0 con 0x7f870c130750 2023-10-01T08:00:46.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.041+0000 7f8708ff9700 1 -- 172.21.15.26:0/2284118201 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f870401d400 con 0x7f870c130750 2023-10-01T08:00:46.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.110+0000 7f9a51df7700 1 -- 172.21.15.26:0/3307438508 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9a4c1204b0 con 0x7f9a4c09dfe0 2023-10-01T08:00:46.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.110+0000 7f9a33fff700 1 -- 172.21.15.26:0/3307438508 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9a4c1204b0 con 0x7f9a4c09dfe0 2023-10-01T08:00:46.111 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:46.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.113+0000 7f9a51df7700 1 -- 172.21.15.26:0/3307438508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a4c09dfe0 msgr2=0x7f9a4c11d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:46.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.113+0000 7f9a51df7700 1 --2- 172.21.15.26:0/3307438508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a4c09dfe0 0x7f9a4c11d350 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000ec10 tx=0x7f9a4000ef20 comp rx=0 tx=0).stop 2023-10-01T08:00:46.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.113+0000 7f9a51df7700 1 -- 172.21.15.26:0/3307438508 shutdown_connections 2023-10-01T08:00:46.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.113+0000 7f9a51df7700 1 --2- 172.21.15.26:0/3307438508 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a4c133b00 0x7f9a4c11d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:46.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.113+0000 7f9a51df7700 1 --2- 172.21.15.26:0/3307438508 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a4c09d6d0 0x7f9a4c11ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:46.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.113+0000 7f9a51df7700 1 --2- 172.21.15.26:0/3307438508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a4c09dfe0 0x7f9a4c11d350 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:46.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.113+0000 7f9a51df7700 1 -- 172.21.15.26:0/3307438508 >> 172.21.15.26:0/3307438508 conn(0x7f9a4c099c20 msgr2=0x7f9a4c131d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:46.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.113+0000 7f9a51df7700 1 -- 172.21.15.26:0/3307438508 shutdown_connections 2023-10-01T08:00:46.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.113+0000 7f9a51df7700 1 -- 172.21.15.26:0/3307438508 wait complete. 2023-10-01T08:00:46.127 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:46.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.209+0000 7f1496316700 1 -- 172.21.15.26:0/755811668 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f14900747f0 con 0x7f14900a0090 2023-10-01T08:00:46.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.210+0000 7f148cff9700 1 -- 172.21.15.26:0/755811668 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1488012340 con 0x7f14900a0090 2023-10-01T08:00:46.210 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:46.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.212+0000 7f1496316700 1 -- 172.21.15.26:0/755811668 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f14900a0090 msgr2=0x7f1490135cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:46.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.212+0000 7f1496316700 1 --2- 172.21.15.26:0/755811668 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f14900a0090 0x7f1490135cb0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f148800efc0 tx=0x7f148800c3a0 comp rx=0 tx=0).stop 2023-10-01T08:00:46.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.212+0000 7f1496316700 1 -- 172.21.15.26:0/755811668 shutdown_connections 2023-10-01T08:00:46.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.212+0000 7f1496316700 1 --2- 172.21.15.26:0/755811668 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f14900a0090 0x7f1490135cb0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:46.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.212+0000 7f1496316700 1 --2- 172.21.15.26:0/755811668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f149009c650 0x7f1490135230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:46.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.212+0000 7f1496316700 1 --2- 172.21.15.26:0/755811668 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f149009d130 0x7f1490135770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:46.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.212+0000 7f1496316700 1 -- 172.21.15.26:0/755811668 >> 172.21.15.26:0/755811668 conn(0x7f14900a3f70 msgr2=0x7f1490138f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:46.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.212+0000 7f1496316700 1 -- 172.21.15.26:0/755811668 shutdown_connections 2023-10-01T08:00:46.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.212+0000 7f1496316700 1 -- 172.21.15.26:0/755811668 wait complete. 2023-10-01T08:00:46.226 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:46.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.252+0000 7f8711a4f700 1 -- 172.21.15.26:0/2284118201 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f870c06b250 con 0x7f870c130750 2023-10-01T08:00:46.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.253+0000 7f8708ff9700 1 -- 172.21.15.26:0/2284118201 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8704007330 con 0x7f870c130750 2023-10-01T08:00:46.254 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:46.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.255+0000 7f8711a4f700 1 -- 172.21.15.26:0/2284118201 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f870c130750 msgr2=0x7f870c08caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:46.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.255+0000 7f8711a4f700 1 --2- 172.21.15.26:0/2284118201 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f870c130750 0x7f870c08caa0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f870400ef90 tx=0x7f870400c3a0 comp rx=0 tx=0).stop 2023-10-01T08:00:46.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.255+0000 7f8711a4f700 1 -- 172.21.15.26:0/2284118201 shutdown_connections 2023-10-01T08:00:46.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.255+0000 7f8711a4f700 1 --2- 172.21.15.26:0/2284118201 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f870c130750 0x7f870c08caa0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:46.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.255+0000 7f8711a4f700 1 --2- 172.21.15.26:0/2284118201 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f870c09d6f0 0x7f870c08c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:46.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.255+0000 7f8711a4f700 1 --2- 172.21.15.26:0/2284118201 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f870c09e250 0x7f870c08c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:46.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.255+0000 7f8711a4f700 1 -- 172.21.15.26:0/2284118201 >> 172.21.15.26:0/2284118201 conn(0x7f870c09f470 msgr2=0x7f870c0992c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:46.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.255+0000 7f8711a4f700 1 -- 172.21.15.26:0/2284118201 shutdown_connections 2023-10-01T08:00:46.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.255+0000 7f8711a4f700 1 -- 172.21.15.26:0/2284118201 wait complete. 2023-10-01T08:00:46.269 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:46.777 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:46.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.922+0000 7f676b612700 1 Processor -- start 2023-10-01T08:00:46.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.922+0000 7f676b612700 1 -- start start 2023-10-01T08:00:46.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.923+0000 7f676b612700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f676409d6f0 0x7f676409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:46.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.923+0000 7f676b612700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f676409e410 0x7f6764130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:46.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.923+0000 7f676b612700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f676409f130 con 0x7f676409e000 2023-10-01T08:00:46.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.923+0000 7f676b612700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f676409f520 con 0x7f676409d6f0 2023-10-01T08:00:46.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.923+0000 7f676b612700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f676409e930 con 0x7f676409e410 2023-10-01T08:00:46.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.923+0000 7f6769baf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f676409e410 0x7f6764130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:46.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.923+0000 7f67693ae700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f676409d6f0 0x7f676409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:46.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.923+0000 7f67693ae700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f676409d6f0 0x7f676409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59300/0 (socket says 172.21.15.26:59300) 2023-10-01T08:00:46.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.923+0000 7f6769baf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f676409e410 0x7f6764130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:32968/0 (socket says 172.21.15.26:32968) 2023-10-01T08:00:46.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.923+0000 7f67693ae700 1 -- 172.21.15.26:0/3663331483 learned_addr learned my addr 172.21.15.26:0/3663331483 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:46.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.923+0000 7f6768bad700 1 --1- 172.21.15.26:0/3663331483 >> v1:172.21.15.26:6789/0 conn(0x7f676409e000 0x7f6764130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38800/0 (socket says 172.21.15.26:38800) 2023-10-01T08:00:46.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.923+0000 7f67693ae700 1 -- 172.21.15.26:0/3663331483 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f676409e410 msgr2=0x7f6764130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:46.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.923+0000 7f67693ae700 1 --2- 172.21.15.26:0/3663331483 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f676409e410 0x7f6764130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:46.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.923+0000 7f67693ae700 1 -- 172.21.15.26:0/3663331483 >> v1:172.21.15.26:6789/0 conn(0x7f676409e000 legacy=0x7f6764130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:46.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.923+0000 7f67693ae700 1 -- 172.21.15.26:0/3663331483 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f676409b2d0 con 0x7f676409d6f0 2023-10-01T08:00:46.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.923+0000 7f675bfff700 1 -- 172.21.15.26:0/3663331483 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046901923 0 0) 0x7f676409f130 con 0x7f676409e000 2023-10-01T08:00:46.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.923+0000 7f6769baf700 1 --2- 172.21.15.26:0/3663331483 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f676409e410 0x7f6764130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:46.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.923+0000 7f67693ae700 1 --2- 172.21.15.26:0/3663331483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f676409d6f0 0x7f676409dac0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f67600098f0 tx=0x7f6760009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78add0ccd419064a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:46.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.923+0000 7f675bfff700 1 -- 172.21.15.26:0/3663331483 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6760011830 con 0x7f676409d6f0 2023-10-01T08:00:46.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.924+0000 7f675bfff700 1 -- 172.21.15.26:0/3663331483 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6760011990 con 0x7f676409d6f0 2023-10-01T08:00:46.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.924+0000 7f675bfff700 1 -- 172.21.15.26:0/3663331483 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6760011d20 con 0x7f676409d6f0 2023-10-01T08:00:46.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.924+0000 7f676b612700 1 -- 172.21.15.26:0/3663331483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f676409d6f0 msgr2=0x7f676409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:46.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.924+0000 7f676b612700 1 --2- 172.21.15.26:0/3663331483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f676409d6f0 0x7f676409dac0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f67600098f0 tx=0x7f6760009c00 comp rx=0 tx=0).stop 2023-10-01T08:00:46.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.924+0000 7f676b612700 1 -- 172.21.15.26:0/3663331483 shutdown_connections 2023-10-01T08:00:46.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.924+0000 7f676b612700 1 --2- 172.21.15.26:0/3663331483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f676409d6f0 0x7f676409dac0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:46.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.924+0000 7f676b612700 1 --2- 172.21.15.26:0/3663331483 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f676409e410 0x7f6764130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:46.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.924+0000 7f676b612700 1 -- 172.21.15.26:0/3663331483 >> 172.21.15.26:0/3663331483 conn(0x7f6764066f50 msgr2=0x7f676409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:46.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.924+0000 7f676b612700 1 -- 172.21.15.26:0/3663331483 shutdown_connections 2023-10-01T08:00:46.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.924+0000 7f676b612700 1 -- 172.21.15.26:0/3663331483 wait complete. 2023-10-01T08:00:46.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.925+0000 7f676b612700 1 Processor -- start 2023-10-01T08:00:46.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.925+0000 7f676b612700 1 -- start start 2023-10-01T08:00:46.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.926+0000 7f676b612700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f676409d6f0 0x7f6764120030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:46.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.926+0000 7f676b612700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f676409e000 0x7f6764120570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:46.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.926+0000 7f676b612700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f676409e410 0x7f6764120ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:46.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.926+0000 7f676b612700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6764123b00 con 0x7f676409d6f0 2023-10-01T08:00:46.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.926+0000 7f676b612700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6764123290 con 0x7f676409e410 2023-10-01T08:00:46.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.926+0000 7f676b612700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6764122420 con 0x7f676409e000 2023-10-01T08:00:46.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.926+0000 7f67693ae700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f676409d6f0 0x7f6764120030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:46.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.926+0000 7f6769baf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f676409e410 0x7f6764120ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:46.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.926+0000 7f67693ae700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f676409d6f0 0x7f6764120030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59316/0 (socket says 172.21.15.26:59316) 2023-10-01T08:00:46.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.926+0000 7f67693ae700 1 -- 172.21.15.26:0/4216306405 learned_addr learned my addr 172.21.15.26:0/4216306405 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:46.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.926+0000 7f6768bad700 1 --2- 172.21.15.26:0/4216306405 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f676409e000 0x7f6764120570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:46.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.926+0000 7f67693ae700 1 -- 172.21.15.26:0/4216306405 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f676409e000 msgr2=0x7f6764120570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:46.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.926+0000 7f67693ae700 1 --2- 172.21.15.26:0/4216306405 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f676409e000 0x7f6764120570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:46.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.926+0000 7f67693ae700 1 -- 172.21.15.26:0/4216306405 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f676409e410 msgr2=0x7f6764120ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:46.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.926+0000 7f67693ae700 1 --2- 172.21.15.26:0/4216306405 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f676409e410 0x7f6764120ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:46.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.926+0000 7f67693ae700 1 -- 172.21.15.26:0/4216306405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f675c009a70 con 0x7f676409d6f0 2023-10-01T08:00:46.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.926+0000 7f6769baf700 1 --2- 172.21.15.26:0/4216306405 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f676409e410 0x7f6764120ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:46.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.926+0000 7f67693ae700 1 --2- 172.21.15.26:0/4216306405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f676409d6f0 0x7f6764120030 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f6760009c40 tx=0x7f6760004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:46.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.927+0000 7f6759ffb700 1 -- 172.21.15.26:0/4216306405 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6760004340 con 0x7f676409d6f0 2023-10-01T08:00:46.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.927+0000 7f6759ffb700 1 -- 172.21.15.26:0/4216306405 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676001f070 con 0x7f676409d6f0 2023-10-01T08:00:46.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.927+0000 7f676b612700 1 -- 172.21.15.26:0/4216306405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6760009550 con 0x7f676409d6f0 2023-10-01T08:00:46.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.927+0000 7f6759ffb700 1 -- 172.21.15.26:0/4216306405 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67600036a0 con 0x7f676409d6f0 2023-10-01T08:00:46.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.927+0000 7f676b612700 1 -- 172.21.15.26:0/4216306405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67641303a0 con 0x7f676409d6f0 2023-10-01T08:00:46.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.928+0000 7f6759ffb700 1 -- 172.21.15.26:0/4216306405 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6760021030 con 0x7f676409d6f0 2023-10-01T08:00:46.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.928+0000 7f676b612700 1 -- 172.21.15.26:0/4216306405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6764122ed0 con 0x7f676409d6f0 2023-10-01T08:00:46.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.928+0000 7f6759ffb700 1 -- 172.21.15.26:0/4216306405 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6760040970 con 0x7f676409d6f0 2023-10-01T08:00:46.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:46.933+0000 7f6759ffb700 1 -- 172.21.15.26:0/4216306405 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6760015070 con 0x7f676409d6f0 2023-10-01T08:00:47.128 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:47.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.136+0000 7f676b612700 1 -- 172.21.15.26:0/4216306405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6764074ea0 con 0x7f676409d6f0 2023-10-01T08:00:47.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.136+0000 7f6759ffb700 1 -- 172.21.15.26:0/4216306405 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6760019770 con 0x7f676409d6f0 2023-10-01T08:00:47.137 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:47.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.138+0000 7f676b612700 1 -- 172.21.15.26:0/4216306405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f676409d6f0 msgr2=0x7f6764120030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:47.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.138+0000 7f676b612700 1 --2- 172.21.15.26:0/4216306405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f676409d6f0 0x7f6764120030 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f6760009c40 tx=0x7f6760004750 comp rx=0 tx=0).stop 2023-10-01T08:00:47.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.139+0000 7f676b612700 1 -- 172.21.15.26:0/4216306405 shutdown_connections 2023-10-01T08:00:47.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.139+0000 7f676b612700 1 --2- 172.21.15.26:0/4216306405 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f676409e410 0x7f6764120ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:47.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.139+0000 7f676b612700 1 --2- 172.21.15.26:0/4216306405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f676409d6f0 0x7f6764120030 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:47.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.139+0000 7f676b612700 1 --2- 172.21.15.26:0/4216306405 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f676409e000 0x7f6764120570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:47.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.139+0000 7f676b612700 1 -- 172.21.15.26:0/4216306405 >> 172.21.15.26:0/4216306405 conn(0x7f6764066f50 msgr2=0x7f6764071110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:47.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.139+0000 7f676b612700 1 -- 172.21.15.26:0/4216306405 shutdown_connections 2023-10-01T08:00:47.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.139+0000 7f676b612700 1 -- 172.21.15.26:0/4216306405 wait complete. 2023-10-01T08:00:47.154 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:47.227 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:47.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.266+0000 7f3c00a4c700 1 Processor -- start 2023-10-01T08:00:47.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.266+0000 7f3c00a4c700 1 -- start start 2023-10-01T08:00:47.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.267+0000 7f3c00a4c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3bfc09d6f0 0x7f3bfc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:47.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.267+0000 7f3c00a4c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3bfc09e410 0x7f3bfc130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:47.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.267+0000 7f3c00a4c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bfc09f130 con 0x7f3bfc09e000 2023-10-01T08:00:47.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.267+0000 7f3c00a4c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc09f520 con 0x7f3bfc09d6f0 2023-10-01T08:00:47.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.267+0000 7f3c00a4c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc09e930 con 0x7f3bfc09e410 2023-10-01T08:00:47.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.267+0000 7f3bf9d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3bfc09e000 0x7f3bfc130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38808/0 (socket says 172.21.15.26:38808) 2023-10-01T08:00:47.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.267+0000 7f3bfad9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3bfc09e410 0x7f3bfc130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:47.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.267+0000 7f3bf9d9b700 1 -- 172.21.15.26:0/3178784452 learned_addr learned my addr 172.21.15.26:0/3178784452 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:47.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.267+0000 7f3bfa59c700 1 --2- 172.21.15.26:0/3178784452 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3bfc09d6f0 0x7f3bfc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:47.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.268+0000 7f3bf959a700 1 -- 172.21.15.26:0/3178784452 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 456308946 0 0) 0x7f3bfc09f130 con 0x7f3bfc09e000 2023-10-01T08:00:47.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.268+0000 7f3bf959a700 1 -- 172.21.15.26:0/3178784452 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3be40035b0 con 0x7f3bfc09e000 2023-10-01T08:00:47.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.268+0000 7f3bfa59c700 1 -- 172.21.15.26:0/3178784452 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3bfc09e410 msgr2=0x7f3bfc130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:47.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.268+0000 7f3bfa59c700 1 --2- 172.21.15.26:0/3178784452 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3bfc09e410 0x7f3bfc130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:47.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.268+0000 7f3bfa59c700 1 -- 172.21.15.26:0/3178784452 >> v1:172.21.15.26:6789/0 conn(0x7f3bfc09e000 legacy=0x7f3bfc130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:47.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.268+0000 7f3bfa59c700 1 -- 172.21.15.26:0/3178784452 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bfc09b2d0 con 0x7f3bfc09d6f0 2023-10-01T08:00:47.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.268+0000 7f3bfad9d700 1 --2- 172.21.15.26:0/3178784452 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3bfc09e410 0x7f3bfc130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:47.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.268+0000 7f3bfa59c700 1 --2- 172.21.15.26:0/3178784452 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3bfc09d6f0 0x7f3bfc09dac0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f3bec009870 tx=0x7f3bec009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4fbd75b100287ba server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:47.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.268+0000 7f3bf959a700 1 -- 172.21.15.26:0/3178784452 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec011830 con 0x7f3bfc09d6f0 2023-10-01T08:00:47.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.268+0000 7f3bf959a700 1 -- 172.21.15.26:0/3178784452 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bec011990 con 0x7f3bfc09d6f0 2023-10-01T08:00:47.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.268+0000 7f3bf959a700 1 -- 172.21.15.26:0/3178784452 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec011d20 con 0x7f3bfc09d6f0 2023-10-01T08:00:47.271 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:47.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.269+0000 7f3c00a4c700 1 -- 172.21.15.26:0/3178784452 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3bfc09d6f0 msgr2=0x7f3bfc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:47.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.269+0000 7f3c00a4c700 1 --2- 172.21.15.26:0/3178784452 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3bfc09d6f0 0x7f3bfc09dac0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f3bec009870 tx=0x7f3bec009b80 comp rx=0 tx=0).stop 2023-10-01T08:00:47.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.269+0000 7f3c00a4c700 1 -- 172.21.15.26:0/3178784452 shutdown_connections 2023-10-01T08:00:47.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.269+0000 7f3c00a4c700 1 --2- 172.21.15.26:0/3178784452 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3bfc09e410 0x7f3bfc130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:47.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.269+0000 7f3c00a4c700 1 --2- 172.21.15.26:0/3178784452 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3bfc09d6f0 0x7f3bfc09dac0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:47.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.269+0000 7f3c00a4c700 1 -- 172.21.15.26:0/3178784452 >> 172.21.15.26:0/3178784452 conn(0x7f3bfc066f50 msgr2=0x7f3bfc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:47.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.269+0000 7f3c00a4c700 1 -- 172.21.15.26:0/3178784452 shutdown_connections 2023-10-01T08:00:47.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.269+0000 7f3c00a4c700 1 -- 172.21.15.26:0/3178784452 wait complete. 2023-10-01T08:00:47.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.270+0000 7f3c00a4c700 1 Processor -- start 2023-10-01T08:00:47.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.270+0000 7f3c00a4c700 1 -- start start 2023-10-01T08:00:47.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.271+0000 7f3c00a4c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bfc09d6f0 0x7f3bfc11e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:47.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.271+0000 7f3c00a4c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3bfc09e000 0x7f3bfc11e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:47.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.271+0000 7f3c00a4c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3bfc09e410 0x7f3bfc11eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:47.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.271+0000 7f3c00a4c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc130440 con 0x7f3bfc09d6f0 2023-10-01T08:00:47.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.271+0000 7f3c00a4c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc120ec0 con 0x7f3bfc09e410 2023-10-01T08:00:47.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.271+0000 7f3c00a4c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc11f4c0 con 0x7f3bfc09e000 2023-10-01T08:00:47.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.271+0000 7f3bf9d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3bfc09e000 0x7f3bfc11e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:47.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.271+0000 7f3bfa59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bfc09d6f0 0x7f3bfc11e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:47.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.271+0000 7f3bf9d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3bfc09e000 0x7f3bfc11e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44556/0 (socket says 172.21.15.26:44556) 2023-10-01T08:00:47.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.271+0000 7f3bfa59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bfc09d6f0 0x7f3bfc11e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59326/0 (socket says 172.21.15.26:59326) 2023-10-01T08:00:47.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.271+0000 7f3bf9d9b700 1 -- 172.21.15.26:0/1091759644 learned_addr learned my addr 172.21.15.26:0/1091759644 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:47.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.271+0000 7f3bfad9d700 1 --2- 172.21.15.26:0/1091759644 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3bfc09e410 0x7f3bfc11eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:47.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.271+0000 7f3bfa59c700 1 -- 172.21.15.26:0/1091759644 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3bfc09e000 msgr2=0x7f3bfc11e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:47.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.271+0000 7f3bfa59c700 1 --2- 172.21.15.26:0/1091759644 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3bfc09e000 0x7f3bfc11e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:47.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.271+0000 7f3bfa59c700 1 -- 172.21.15.26:0/1091759644 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3bfc09e410 msgr2=0x7f3bfc11eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:47.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.271+0000 7f3bfa59c700 1 --2- 172.21.15.26:0/1091759644 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3bfc09e410 0x7f3bfc11eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:47.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.271+0000 7f3bfa59c700 1 -- 172.21.15.26:0/1091759644 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf4009a70 con 0x7f3bfc09d6f0 2023-10-01T08:00:47.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.271+0000 7f3bf9d9b700 1 --2- 172.21.15.26:0/1091759644 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3bfc09e000 0x7f3bfc11e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:47.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.271+0000 7f3bfad9d700 1 --2- 172.21.15.26:0/1091759644 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3bfc09e410 0x7f3bfc11eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:47.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.272+0000 7f3bfa59c700 1 --2- 172.21.15.26:0/1091759644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bfc09d6f0 0x7f3bfc11e060 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f3bec016000 tx=0x7f3bec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:47.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.272+0000 7f3beaffd700 1 -- 172.21.15.26:0/1091759644 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec004450 con 0x7f3bfc09d6f0 2023-10-01T08:00:47.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.272+0000 7f3beaffd700 1 -- 172.21.15.26:0/1091759644 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bec01f070 con 0x7f3bfc09d6f0 2023-10-01T08:00:47.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.272+0000 7f3beaffd700 1 -- 172.21.15.26:0/1091759644 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec0038e0 con 0x7f3bfc09d6f0 2023-10-01T08:00:47.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.272+0000 7f3c00a4c700 1 -- 172.21.15.26:0/1091759644 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bec0094a0 con 0x7f3bfc09d6f0 2023-10-01T08:00:47.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.272+0000 7f3c00a4c700 1 -- 172.21.15.26:0/1091759644 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bfc09c700 con 0x7f3bfc09d6f0 2023-10-01T08:00:47.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.273+0000 7f3beaffd700 1 -- 172.21.15.26:0/1091759644 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3bec003a40 con 0x7f3bfc09d6f0 2023-10-01T08:00:47.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.273+0000 7f3beaffd700 1 -- 172.21.15.26:0/1091759644 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3bec021070 con 0x7f3bfc09d6f0 2023-10-01T08:00:47.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.273+0000 7f3c00a4c700 1 -- 172.21.15.26:0/1091759644 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bfc11ac20 con 0x7f3bfc09d6f0 2023-10-01T08:00:47.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.278+0000 7f3beaffd700 1 -- 172.21.15.26:0/1091759644 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3bec015080 con 0x7f3bfc09d6f0 2023-10-01T08:00:47.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.372+0000 7f07d0244700 1 Processor -- start 2023-10-01T08:00:47.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.372+0000 7f07d0244700 1 -- start start 2023-10-01T08:00:47.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.373+0000 7f07d0244700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f07c809c650 0x7f07c809ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:47.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.373+0000 7f07d0244700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f07c80a0090 0x7f07c809cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:47.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.373+0000 7f07d0244700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f07c8131970 0x7f07c8131df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:47.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.373+0000 7f07d0244700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07c809ba70 con 0x7f07c809c650 2023-10-01T08:00:47.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.373+0000 7f07d0244700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c809d4a0 con 0x7f07c80a0090 2023-10-01T08:00:47.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.373+0000 7f07d0244700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07c809e8f0 con 0x7f07c8131970 2023-10-01T08:00:47.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.373+0000 7f07cd7df700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f07c80a0090 0x7f07c809cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:47.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.373+0000 7f07cd7df700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f07c80a0090 0x7f07c809cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33002/0 (socket says 172.21.15.26:33002) 2023-10-01T08:00:47.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.373+0000 7f07cd7df700 1 -- 172.21.15.26:0/282838918 learned_addr learned my addr 172.21.15.26:0/282838918 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:47.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.373+0000 7f07cdfe0700 1 --2- 172.21.15.26:0/282838918 >> v2:172.21.15.26:3300/0 conn(0x7f07c809c650 0x7f07c809ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:47.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.373+0000 7f07ce7e1700 1 --2- 172.21.15.26:0/282838918 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f07c8131970 0x7f07c8131df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:47.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.374+0000 7f07cd7df700 1 -- 172.21.15.26:0/282838918 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f07c8131970 msgr2=0x7f07c8131df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:47.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.374+0000 7f07cd7df700 1 --2- 172.21.15.26:0/282838918 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f07c8131970 0x7f07c8131df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:47.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.374+0000 7f07cd7df700 1 -- 172.21.15.26:0/282838918 >> v2:172.21.15.26:3300/0 conn(0x7f07c809c650 msgr2=0x7f07c809ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:47.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.374+0000 7f07cd7df700 1 --2- 172.21.15.26:0/282838918 >> v2:172.21.15.26:3300/0 conn(0x7f07c809c650 0x7f07c809ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:47.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.374+0000 7f07cd7df700 1 -- 172.21.15.26:0/282838918 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c80a0760 con 0x7f07c80a0090 2023-10-01T08:00:47.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.374+0000 7f07cdfe0700 1 --2- 172.21.15.26:0/282838918 >> v2:172.21.15.26:3300/0 conn(0x7f07c809c650 0x7f07c809ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:47.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.374+0000 7f07cd7df700 1 --2- 172.21.15.26:0/282838918 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f07c80a0090 0x7f07c809cf60 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f07b80098f0 tx=0x7f07b8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7e00d05ad715412 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:47.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.374+0000 7f07ccfde700 1 -- 172.21.15.26:0/282838918 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b8011830 con 0x7f07c80a0090 2023-10-01T08:00:47.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.374+0000 7f07ccfde700 1 -- 172.21.15.26:0/282838918 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b8011990 con 0x7f07c80a0090 2023-10-01T08:00:47.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.374+0000 7f07ccfde700 1 -- 172.21.15.26:0/282838918 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b8011d20 con 0x7f07c80a0090 2023-10-01T08:00:47.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.375+0000 7f07d0244700 1 -- 172.21.15.26:0/282838918 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f07c80a0090 msgr2=0x7f07c809cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:47.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.375+0000 7f07d0244700 1 --2- 172.21.15.26:0/282838918 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f07c80a0090 0x7f07c809cf60 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f07b80098f0 tx=0x7f07b8009c00 comp rx=0 tx=0).stop 2023-10-01T08:00:47.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.375+0000 7f07d0244700 1 -- 172.21.15.26:0/282838918 shutdown_connections 2023-10-01T08:00:47.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.375+0000 7f07d0244700 1 --2- 172.21.15.26:0/282838918 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f07c8131970 0x7f07c8131df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:47.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.375+0000 7f07d0244700 1 --2- 172.21.15.26:0/282838918 >> v2:172.21.15.26:3300/0 conn(0x7f07c809c650 0x7f07c809ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:47.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.375+0000 7f07d0244700 1 --2- 172.21.15.26:0/282838918 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f07c80a0090 0x7f07c809cf60 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:47.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.375+0000 7f07d0244700 1 -- 172.21.15.26:0/282838918 >> 172.21.15.26:0/282838918 conn(0x7f07c80a3f70 msgr2=0x7f07c80a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:47.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.375+0000 7f07d0244700 1 -- 172.21.15.26:0/282838918 shutdown_connections 2023-10-01T08:00:47.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.375+0000 7f07d0244700 1 -- 172.21.15.26:0/282838918 wait complete. 2023-10-01T08:00:47.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.376+0000 7f07d0244700 1 Processor -- start 2023-10-01T08:00:47.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.376+0000 7f07d0244700 1 -- start start 2023-10-01T08:00:47.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.377+0000 7f07d0244700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07c809c650 0x7f07c806b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:47.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.377+0000 7f07d0244700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f07c80a0090 0x7f07c806bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:47.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.377+0000 7f07d0244700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f07c8131970 0x7f07c806c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:47.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.377+0000 7f07d0244700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c812d540 con 0x7f07c809c650 2023-10-01T08:00:47.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.377+0000 7f07d0244700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c812ff80 con 0x7f07c80a0090 2023-10-01T08:00:47.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.377+0000 7f07d0244700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07c809d980 con 0x7f07c8131970 2023-10-01T08:00:47.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.377+0000 7f07cdfe0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07c809c650 0x7f07c806b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:47.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.377+0000 7f07cdfe0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07c809c650 0x7f07c806b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59354/0 (socket says 172.21.15.26:59354) 2023-10-01T08:00:47.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.377+0000 7f07cdfe0700 1 -- 172.21.15.26:0/448032442 learned_addr learned my addr 172.21.15.26:0/448032442 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:47.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.377+0000 7f07ce7e1700 1 --2- 172.21.15.26:0/448032442 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f07c8131970 0x7f07c806c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:47.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.377+0000 7f07cd7df700 1 --2- 172.21.15.26:0/448032442 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f07c80a0090 0x7f07c806bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:47.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.377+0000 7f07cdfe0700 1 -- 172.21.15.26:0/448032442 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f07c8131970 msgr2=0x7f07c806c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:47.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.378+0000 7f07cdfe0700 1 --2- 172.21.15.26:0/448032442 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f07c8131970 0x7f07c806c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:47.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.378+0000 7f07cdfe0700 1 -- 172.21.15.26:0/448032442 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f07c80a0090 msgr2=0x7f07c806bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:47.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.378+0000 7f07cdfe0700 1 --2- 172.21.15.26:0/448032442 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f07c80a0090 0x7f07c806bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:47.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.378+0000 7f07cdfe0700 1 -- 172.21.15.26:0/448032442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c40094a0 con 0x7f07c809c650 2023-10-01T08:00:47.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.378+0000 7f07cdfe0700 1 --2- 172.21.15.26:0/448032442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07c809c650 0x7f07c806b880 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f07c400ebe0 tx=0x7f07c400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:47.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.378+0000 7f07be7fc700 1 -- 172.21.15.26:0/448032442 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c4009800 con 0x7f07c809c650 2023-10-01T08:00:47.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.378+0000 7f07be7fc700 1 -- 172.21.15.26:0/448032442 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07c400c910 con 0x7f07c809c650 2023-10-01T08:00:47.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.378+0000 7f07d0244700 1 -- 172.21.15.26:0/448032442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b8009550 con 0x7f07c809c650 2023-10-01T08:00:47.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.378+0000 7f07be7fc700 1 -- 172.21.15.26:0/448032442 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c400cc80 con 0x7f07c809c650 2023-10-01T08:00:47.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.378+0000 7f07d0244700 1 -- 172.21.15.26:0/448032442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c806d1f0 con 0x7f07c809c650 2023-10-01T08:00:47.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.379+0000 7f07be7fc700 1 -- 172.21.15.26:0/448032442 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f07c4013470 con 0x7f07c809c650 2023-10-01T08:00:47.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.379+0000 7f07d0244700 1 -- 172.21.15.26:0/448032442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c80a3610 con 0x7f07c809c650 2023-10-01T08:00:47.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.379+0000 7f07be7fc700 1 -- 172.21.15.26:0/448032442 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f07c403fc10 con 0x7f07c809c650 2023-10-01T08:00:47.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.389+0000 7f07be7fc700 1 -- 172.21.15.26:0/448032442 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f07c400ce80 con 0x7f07c809c650 2023-10-01T08:00:47.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.417+0000 7f2e7f235700 1 Processor -- start 2023-10-01T08:00:47.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.417+0000 7f2e7f235700 1 -- start start 2023-10-01T08:00:47.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.417+0000 7f2e7f235700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e780a0a30 0x7f2e780a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:47.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.417+0000 7f2e7f235700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2e780a1340 0x7f2e78133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:47.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.417+0000 7f2e7f235700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e7809edd0 con 0x7f2e78133fa0 2023-10-01T08:00:47.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.417+0000 7f2e7f235700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e7809e1f0 con 0x7f2e780a1340 2023-10-01T08:00:47.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.417+0000 7f2e7f235700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7809dc50 con 0x7f2e780a0a30 2023-10-01T08:00:47.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.417+0000 7f2e7d7d2700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2e78133fa0 0x7f2e7813ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38810/0 (socket says 172.21.15.26:38810) 2023-10-01T08:00:47.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.417+0000 7f2e7d7d2700 1 -- 172.21.15.26:0/3441886701 learned_addr learned my addr 172.21.15.26:0/3441886701 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:47.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.417+0000 7f2e7cfd1700 1 --2- 172.21.15.26:0/3441886701 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e780a0a30 0x7f2e780a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:47.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.418+0000 7f2e77fff700 1 --2- 172.21.15.26:0/3441886701 >> v2:172.21.15.26:3300/0 conn(0x7f2e780a1340 0x7f2e78133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:47.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.418+0000 7f2e7cfd1700 1 -- 172.21.15.26:0/3441886701 >> v2:172.21.15.26:3300/0 conn(0x7f2e780a1340 msgr2=0x7f2e78133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:47.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.418+0000 7f2e7cfd1700 1 --2- 172.21.15.26:0/3441886701 >> v2:172.21.15.26:3300/0 conn(0x7f2e780a1340 0x7f2e78133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:47.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.418+0000 7f2e7cfd1700 1 -- 172.21.15.26:0/3441886701 >> v1:172.21.15.26:6789/0 conn(0x7f2e78133fa0 legacy=0x7f2e7813ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:47.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.418+0000 7f2e7cfd1700 1 -- 172.21.15.26:0/3441886701 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e780a1fe0 con 0x7f2e780a0a30 2023-10-01T08:00:47.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.418+0000 7f2e777fe700 1 -- 172.21.15.26:0/3441886701 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1682161805 0 0) 0x7f2e7809edd0 con 0x7f2e78133fa0 2023-10-01T08:00:47.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.418+0000 7f2e77fff700 1 --2- 172.21.15.26:0/3441886701 >> v2:172.21.15.26:3300/0 conn(0x7f2e780a1340 0x7f2e78133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:47.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.418+0000 7f2e7cfd1700 1 --2- 172.21.15.26:0/3441886701 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e780a0a30 0x7f2e780a0e00 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f2e68009d90 tx=0x7f2e6800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=613f6c3190b446ce server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:47.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.418+0000 7f2e777fe700 1 -- 172.21.15.26:0/3441886701 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6800e070 con 0x7f2e780a0a30 2023-10-01T08:00:47.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.418+0000 7f2e777fe700 1 -- 172.21.15.26:0/3441886701 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6800bb20 con 0x7f2e780a0a30 2023-10-01T08:00:47.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.418+0000 7f2e777fe700 1 -- 172.21.15.26:0/3441886701 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68012430 con 0x7f2e780a0a30 2023-10-01T08:00:47.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.419+0000 7f2e7f235700 1 -- 172.21.15.26:0/3441886701 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e780a0a30 msgr2=0x7f2e780a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:47.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.419+0000 7f2e7f235700 1 --2- 172.21.15.26:0/3441886701 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e780a0a30 0x7f2e780a0e00 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f2e68009d90 tx=0x7f2e6800b330 comp rx=0 tx=0).stop 2023-10-01T08:00:47.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.419+0000 7f2e7f235700 1 -- 172.21.15.26:0/3441886701 shutdown_connections 2023-10-01T08:00:47.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.419+0000 7f2e7f235700 1 --2- 172.21.15.26:0/3441886701 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e780a0a30 0x7f2e780a0e00 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:47.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.419+0000 7f2e7f235700 1 --2- 172.21.15.26:0/3441886701 >> v2:172.21.15.26:3300/0 conn(0x7f2e780a1340 0x7f2e78133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:47.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.419+0000 7f2e7f235700 1 -- 172.21.15.26:0/3441886701 >> 172.21.15.26:0/3441886701 conn(0x7f2e780a6550 msgr2=0x7f2e780a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:47.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.419+0000 7f2e7f235700 1 -- 172.21.15.26:0/3441886701 shutdown_connections 2023-10-01T08:00:47.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.419+0000 7f2e7f235700 1 -- 172.21.15.26:0/3441886701 wait complete. 2023-10-01T08:00:47.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.420+0000 7f2e7f235700 1 Processor -- start 2023-10-01T08:00:47.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.421+0000 7f2e7f235700 1 -- start start 2023-10-01T08:00:47.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.421+0000 7f2e7f235700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e780a0a30 0x7f2e78122790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:47.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.421+0000 7f2e7f235700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e780a1340 0x7f2e78122cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:47.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.421+0000 7f2e7f235700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e78133fa0 0x7f2e78123210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:47.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.421+0000 7f2e7f235700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e78125c80 con 0x7f2e78133fa0 2023-10-01T08:00:47.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.421+0000 7f2e7f235700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e78123b80 con 0x7f2e780a0a30 2023-10-01T08:00:47.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.422+0000 7f2e7f235700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e781243b0 con 0x7f2e780a1340 2023-10-01T08:00:47.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.422+0000 7f2e7d7d2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e78133fa0 0x7f2e78123210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:47.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.422+0000 7f2e7d7d2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e78133fa0 0x7f2e78123210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59372/0 (socket says 172.21.15.26:59372) 2023-10-01T08:00:47.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.422+0000 7f2e7d7d2700 1 -- 172.21.15.26:0/1338016361 learned_addr learned my addr 172.21.15.26:0/1338016361 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:47.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.422+0000 7f2e7cfd1700 1 --2- 172.21.15.26:0/1338016361 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e780a0a30 0x7f2e78122790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:47.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.422+0000 7f2e77fff700 1 --2- 172.21.15.26:0/1338016361 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e780a1340 0x7f2e78122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:47.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.422+0000 7f2e7d7d2700 1 -- 172.21.15.26:0/1338016361 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e780a1340 msgr2=0x7f2e78122cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:47.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.422+0000 7f2e7d7d2700 1 --2- 172.21.15.26:0/1338016361 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e780a1340 0x7f2e78122cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:47.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.422+0000 7f2e7d7d2700 1 -- 172.21.15.26:0/1338016361 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e780a0a30 msgr2=0x7f2e78122790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:47.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.422+0000 7f2e7d7d2700 1 --2- 172.21.15.26:0/1338016361 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e780a0a30 0x7f2e78122790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:47.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.422+0000 7f2e7d7d2700 1 -- 172.21.15.26:0/1338016361 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6c0094a0 con 0x7f2e78133fa0 2023-10-01T08:00:47.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.422+0000 7f2e7d7d2700 1 --2- 172.21.15.26:0/1338016361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e78133fa0 0x7f2e78123210 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f2e700011e0 tx=0x7f2e7000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:47.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.422+0000 7f2e757fa700 1 -- 172.21.15.26:0/1338016361 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7000cea0 con 0x7f2e78133fa0 2023-10-01T08:00:47.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.423+0000 7f2e757fa700 1 -- 172.21.15.26:0/1338016361 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e70004c80 con 0x7f2e78133fa0 2023-10-01T08:00:47.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.423+0000 7f2e7f235700 1 -- 172.21.15.26:0/1338016361 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e68009a70 con 0x7f2e78133fa0 2023-10-01T08:00:47.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.423+0000 7f2e757fa700 1 -- 172.21.15.26:0/1338016361 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e700070d0 con 0x7f2e78133fa0 2023-10-01T08:00:47.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.423+0000 7f2e7f235700 1 -- 172.21.15.26:0/1338016361 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e780a0270 con 0x7f2e78133fa0 2023-10-01T08:00:47.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.424+0000 7f2e757fa700 1 -- 172.21.15.26:0/1338016361 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2e70007230 con 0x7f2e78133fa0 2023-10-01T08:00:47.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.424+0000 7f2e757fa700 1 -- 172.21.15.26:0/1338016361 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2e7003f290 con 0x7f2e78133fa0 2023-10-01T08:00:47.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.424+0000 7f2e7f235700 1 -- 172.21.15.26:0/1338016361 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e780a1d40 con 0x7f2e78133fa0 2023-10-01T08:00:47.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.433+0000 7f2e757fa700 1 -- 172.21.15.26:0/1338016361 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e700074e0 con 0x7f2e78133fa0 2023-10-01T08:00:47.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.489+0000 7f3c00a4c700 1 -- 172.21.15.26:0/1091759644 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3bfc120260 con 0x7f3bfc09d6f0 2023-10-01T08:00:47.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.489+0000 7f3beaffd700 1 -- 172.21.15.26:0/1091759644 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3bec035090 con 0x7f3bfc09d6f0 2023-10-01T08:00:47.490 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:47.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.491+0000 7f3c00a4c700 1 -- 172.21.15.26:0/1091759644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bfc09d6f0 msgr2=0x7f3bfc11e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:47.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.491+0000 7f3c00a4c700 1 --2- 172.21.15.26:0/1091759644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bfc09d6f0 0x7f3bfc11e060 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f3bec016000 tx=0x7f3bec004750 comp rx=0 tx=0).stop 2023-10-01T08:00:47.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.492+0000 7f3c00a4c700 1 -- 172.21.15.26:0/1091759644 shutdown_connections 2023-10-01T08:00:47.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.492+0000 7f3c00a4c700 1 --2- 172.21.15.26:0/1091759644 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3bfc09e410 0x7f3bfc11eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:47.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.492+0000 7f3c00a4c700 1 --2- 172.21.15.26:0/1091759644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bfc09d6f0 0x7f3bfc11e060 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:47.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.492+0000 7f3c00a4c700 1 --2- 172.21.15.26:0/1091759644 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3bfc09e000 0x7f3bfc11e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:47.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.492+0000 7f3c00a4c700 1 -- 172.21.15.26:0/1091759644 >> 172.21.15.26:0/1091759644 conn(0x7f3bfc066f50 msgr2=0x7f3bfc130a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:47.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.492+0000 7f3c00a4c700 1 -- 172.21.15.26:0/1091759644 shutdown_connections 2023-10-01T08:00:47.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.492+0000 7f3c00a4c700 1 -- 172.21.15.26:0/1091759644 wait complete. 2023-10-01T08:00:47.507 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:47.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.600+0000 7f07d0244700 1 -- 172.21.15.26:0/448032442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f07c80747f0 con 0x7f07c809c650 2023-10-01T08:00:47.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.601+0000 7f07be7fc700 1 -- 172.21.15.26:0/448032442 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f07c4011350 con 0x7f07c809c650 2023-10-01T08:00:47.601 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:47.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.603+0000 7f07d0244700 1 -- 172.21.15.26:0/448032442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07c809c650 msgr2=0x7f07c806b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:47.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.603+0000 7f07d0244700 1 --2- 172.21.15.26:0/448032442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07c809c650 0x7f07c806b880 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f07c400ebe0 tx=0x7f07c400eef0 comp rx=0 tx=0).stop 2023-10-01T08:00:47.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.603+0000 7f07d0244700 1 -- 172.21.15.26:0/448032442 shutdown_connections 2023-10-01T08:00:47.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.603+0000 7f07d0244700 1 --2- 172.21.15.26:0/448032442 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f07c8131970 0x7f07c806c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:47.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.603+0000 7f07d0244700 1 --2- 172.21.15.26:0/448032442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07c809c650 0x7f07c806b880 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:47.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.603+0000 7f07d0244700 1 --2- 172.21.15.26:0/448032442 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f07c80a0090 0x7f07c806bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:47.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.603+0000 7f07d0244700 1 -- 172.21.15.26:0/448032442 >> 172.21.15.26:0/448032442 conn(0x7f07c80a3f70 msgr2=0x7f07c812eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:47.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.603+0000 7f07d0244700 1 -- 172.21.15.26:0/448032442 shutdown_connections 2023-10-01T08:00:47.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.603+0000 7f07d0244700 1 -- 172.21.15.26:0/448032442 wait complete. 2023-10-01T08:00:47.617 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:47.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.643+0000 7f2e7f235700 1 -- 172.21.15.26:0/1338016361 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2e78074ea0 con 0x7f2e78133fa0 2023-10-01T08:00:47.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.643+0000 7f2e757fa700 1 -- 172.21.15.26:0/1338016361 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2e7001b340 con 0x7f2e78133fa0 2023-10-01T08:00:47.644 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:47.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.646+0000 7f2e7f235700 1 -- 172.21.15.26:0/1338016361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e78133fa0 msgr2=0x7f2e78123210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:47.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.646+0000 7f2e7f235700 1 --2- 172.21.15.26:0/1338016361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e78133fa0 0x7f2e78123210 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f2e700011e0 tx=0x7f2e7000c800 comp rx=0 tx=0).stop 2023-10-01T08:00:47.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.646+0000 7f2e7f235700 1 -- 172.21.15.26:0/1338016361 shutdown_connections 2023-10-01T08:00:47.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.646+0000 7f2e7f235700 1 --2- 172.21.15.26:0/1338016361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e78133fa0 0x7f2e78123210 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:47.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.646+0000 7f2e7f235700 1 --2- 172.21.15.26:0/1338016361 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2e780a0a30 0x7f2e78122790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:47.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.646+0000 7f2e7f235700 1 --2- 172.21.15.26:0/1338016361 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2e780a1340 0x7f2e78122cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:47.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.646+0000 7f2e7f235700 1 -- 172.21.15.26:0/1338016361 >> 172.21.15.26:0/1338016361 conn(0x7f2e780a6550 msgr2=0x7f2e780a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:47.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.646+0000 7f2e7f235700 1 -- 172.21.15.26:0/1338016361 shutdown_connections 2023-10-01T08:00:47.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:47.646+0000 7f2e7f235700 1 -- 172.21.15.26:0/1338016361 wait complete. 2023-10-01T08:00:47.660 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:48.155 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:48.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.302+0000 7fecf2ec1700 1 Processor -- start 2023-10-01T08:00:48.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.302+0000 7fecf2ec1700 1 -- start start 2023-10-01T08:00:48.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.302+0000 7fecf2ec1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fecec09e1d0 0x7fecec138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:48.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.302+0000 7fecf2ec1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fecec139170 0x7fecec13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:48.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.302+0000 7fecf2ec1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecec09b120 con 0x7fecec09d6f0 2023-10-01T08:00:48.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.302+0000 7fecf2ec1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecec06b460 con 0x7fecec09e1d0 2023-10-01T08:00:48.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.302+0000 7fecf2ec1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecec09a7e0 con 0x7fecec139170 2023-10-01T08:00:48.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.302+0000 7fece3fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fecec09e1d0 0x7fecec138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:48.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.303+0000 7fecf145e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fecec139170 0x7fecec13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:48.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.303+0000 7fecf145e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fecec139170 0x7fecec13b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44600/0 (socket says 172.21.15.26:44600) 2023-10-01T08:00:48.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.303+0000 7fece3fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fecec09e1d0 0x7fecec138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59384/0 (socket says 172.21.15.26:59384) 2023-10-01T08:00:48.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.303+0000 7fecf145e700 1 -- 172.21.15.26:0/4031070059 learned_addr learned my addr 172.21.15.26:0/4031070059 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:48.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.303+0000 7fecf145e700 1 -- 172.21.15.26:0/4031070059 >> v2:172.21.15.26:3300/0 conn(0x7fecec09e1d0 msgr2=0x7fecec138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:48.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.303+0000 7fecf145e700 1 --2- 172.21.15.26:0/4031070059 >> v2:172.21.15.26:3300/0 conn(0x7fecec09e1d0 0x7fecec138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:48.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.303+0000 7fecf145e700 1 -- 172.21.15.26:0/4031070059 >> v1:172.21.15.26:6789/0 conn(0x7fecec09d6f0 legacy=0x7fecec09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:48.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.303+0000 7fecf145e700 1 -- 172.21.15.26:0/4031070059 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecec09a500 con 0x7fecec139170 2023-10-01T08:00:48.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.303+0000 7fece3fff700 1 --2- 172.21.15.26:0/4031070059 >> v2:172.21.15.26:3300/0 conn(0x7fecec09e1d0 0x7fecec138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:48.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.303+0000 7fecf145e700 1 --2- 172.21.15.26:0/4031070059 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fecec139170 0x7fecec13b550 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fece4009e80 tx=0x7fece400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e626c4205da6814 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:48.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.303+0000 7fece37fe700 1 -- 172.21.15.26:0/4031070059 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece400e070 con 0x7fecec139170 2023-10-01T08:00:48.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.303+0000 7fece37fe700 1 -- 172.21.15.26:0/4031070059 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece400b8d0 con 0x7fecec139170 2023-10-01T08:00:48.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.303+0000 7fece37fe700 1 -- 172.21.15.26:0/4031070059 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece400bc80 con 0x7fecec139170 2023-10-01T08:00:48.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.304+0000 7fecf2ec1700 1 -- 172.21.15.26:0/4031070059 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fecec139170 msgr2=0x7fecec13b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:48.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.304+0000 7fecf2ec1700 1 --2- 172.21.15.26:0/4031070059 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fecec139170 0x7fecec13b550 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fece4009e80 tx=0x7fece400b330 comp rx=0 tx=0).stop 2023-10-01T08:00:48.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.304+0000 7fecf2ec1700 1 -- 172.21.15.26:0/4031070059 shutdown_connections 2023-10-01T08:00:48.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.304+0000 7fecf2ec1700 1 --2- 172.21.15.26:0/4031070059 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fecec139170 0x7fecec13b550 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:48.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.304+0000 7fecf2ec1700 1 --2- 172.21.15.26:0/4031070059 >> v2:172.21.15.26:3300/0 conn(0x7fecec09e1d0 0x7fecec138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:48.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.304+0000 7fecf2ec1700 1 -- 172.21.15.26:0/4031070059 >> 172.21.15.26:0/4031070059 conn(0x7fecec066f50 msgr2=0x7fecec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:48.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.304+0000 7fecf2ec1700 1 -- 172.21.15.26:0/4031070059 shutdown_connections 2023-10-01T08:00:48.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.304+0000 7fecf2ec1700 1 -- 172.21.15.26:0/4031070059 wait complete. 2023-10-01T08:00:48.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.305+0000 7fecf2ec1700 1 Processor -- start 2023-10-01T08:00:48.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.305+0000 7fecf2ec1700 1 -- start start 2023-10-01T08:00:48.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.306+0000 7fecf2ec1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fecec09d6f0 0x7fecec1c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:48.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.306+0000 7fecf2ec1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecec09e1d0 0x7fecec1c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:48.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.306+0000 7fecf2ec1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fecec139170 0x7fecec11e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:48.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.306+0000 7fecf2ec1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecec122110 con 0x7fecec09e1d0 2023-10-01T08:00:48.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.306+0000 7fecf2ec1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecec120400 con 0x7fecec09d6f0 2023-10-01T08:00:48.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.306+0000 7fecf2ec1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecec121d70 con 0x7fecec139170 2023-10-01T08:00:48.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.306+0000 7fece3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecec09e1d0 0x7fecec1c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:48.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.306+0000 7fecf0c5d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fecec09d6f0 0x7fecec1c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:48.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.306+0000 7fece3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecec09e1d0 0x7fecec1c8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59394/0 (socket says 172.21.15.26:59394) 2023-10-01T08:00:48.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.306+0000 7fece3fff700 1 -- 172.21.15.26:0/336792937 learned_addr learned my addr 172.21.15.26:0/336792937 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:48.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.306+0000 7fecf145e700 1 --2- 172.21.15.26:0/336792937 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fecec139170 0x7fecec11e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:48.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.306+0000 7fece3fff700 1 -- 172.21.15.26:0/336792937 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fecec139170 msgr2=0x7fecec11e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:48.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.306+0000 7fece3fff700 1 --2- 172.21.15.26:0/336792937 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fecec139170 0x7fecec11e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:48.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.306+0000 7fece3fff700 1 -- 172.21.15.26:0/336792937 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fecec09d6f0 msgr2=0x7fecec1c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:48.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.306+0000 7fece3fff700 1 --2- 172.21.15.26:0/336792937 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fecec09d6f0 0x7fecec1c84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:48.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.306+0000 7fece3fff700 1 -- 172.21.15.26:0/336792937 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecdc0094a0 con 0x7fecec09e1d0 2023-10-01T08:00:48.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.306+0000 7fece3fff700 1 --2- 172.21.15.26:0/336792937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecec09e1d0 0x7fecec1c8a10 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fecdc00ebe0 tx=0x7fecdc00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:48.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.307+0000 7fece17fa700 1 -- 172.21.15.26:0/336792937 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc00c850 con 0x7fecec09e1d0 2023-10-01T08:00:48.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.307+0000 7fece17fa700 1 -- 172.21.15.26:0/336792937 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecdc00c9b0 con 0x7fecec09e1d0 2023-10-01T08:00:48.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.307+0000 7fece17fa700 1 -- 172.21.15.26:0/336792937 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc00cd40 con 0x7fecec09e1d0 2023-10-01T08:00:48.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.307+0000 7fecf2ec1700 1 -- 172.21.15.26:0/336792937 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece4009b30 con 0x7fecec09e1d0 2023-10-01T08:00:48.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.307+0000 7fecf2ec1700 1 -- 172.21.15.26:0/336792937 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecec122aa0 con 0x7fecec09e1d0 2023-10-01T08:00:48.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.307+0000 7fece17fa700 1 -- 172.21.15.26:0/336792937 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fecdc013470 con 0x7fecec09e1d0 2023-10-01T08:00:48.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.308+0000 7fece17fa700 1 -- 172.21.15.26:0/336792937 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fecdc03fc60 con 0x7fecec09e1d0 2023-10-01T08:00:48.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.308+0000 7fecf2ec1700 1 -- 172.21.15.26:0/336792937 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecec074ea0 con 0x7fecec09e1d0 2023-10-01T08:00:48.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.313+0000 7fece17fa700 1 -- 172.21.15.26:0/336792937 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fecdc017080 con 0x7fecec09e1d0 2023-10-01T08:00:48.508 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:48.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.518+0000 7fecf2ec1700 1 -- 172.21.15.26:0/336792937 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fecec09f420 con 0x7fecec09e1d0 2023-10-01T08:00:48.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.518+0000 7fece17fa700 1 -- 172.21.15.26:0/336792937 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fecdc021020 con 0x7fecec09e1d0 2023-10-01T08:00:48.519 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:48.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.521+0000 7fecf2ec1700 1 -- 172.21.15.26:0/336792937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecec09e1d0 msgr2=0x7fecec1c8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:48.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.521+0000 7fecf2ec1700 1 --2- 172.21.15.26:0/336792937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecec09e1d0 0x7fecec1c8a10 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fecdc00ebe0 tx=0x7fecdc00eef0 comp rx=0 tx=0).stop 2023-10-01T08:00:48.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.521+0000 7fecf2ec1700 1 -- 172.21.15.26:0/336792937 shutdown_connections 2023-10-01T08:00:48.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.521+0000 7fecf2ec1700 1 --2- 172.21.15.26:0/336792937 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fecec139170 0x7fecec11e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:48.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.521+0000 7fecf2ec1700 1 --2- 172.21.15.26:0/336792937 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fecec09d6f0 0x7fecec1c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:48.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.521+0000 7fecf2ec1700 1 --2- 172.21.15.26:0/336792937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecec09e1d0 0x7fecec1c8a10 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:48.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.521+0000 7fecf2ec1700 1 -- 172.21.15.26:0/336792937 >> 172.21.15.26:0/336792937 conn(0x7fecec066f50 msgr2=0x7fecec0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:48.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.521+0000 7fecf2ec1700 1 -- 172.21.15.26:0/336792937 shutdown_connections 2023-10-01T08:00:48.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.521+0000 7fecf2ec1700 1 -- 172.21.15.26:0/336792937 wait complete. 2023-10-01T08:00:48.536 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:48.619 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:48.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.646+0000 7f3d672f1700 1 Processor -- start 2023-10-01T08:00:48.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.646+0000 7f3d672f1700 1 -- start start 2023-10-01T08:00:48.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.647+0000 7f3d672f1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3d600a0a30 0x7f3d600a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:48.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.647+0000 7f3d672f1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d6009d630 0x7f3d600a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:48.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.647+0000 7f3d672f1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d600a2a70 con 0x7f3d60133930 2023-10-01T08:00:48.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.647+0000 7f3d672f1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d600a01d0 con 0x7f3d600a0a30 2023-10-01T08:00:48.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.647+0000 7f3d672f1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6009e2b0 con 0x7f3d6009d630 2023-10-01T08:00:48.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.647+0000 7f3d6488c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d6009d630 0x7f3d600a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:48.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.647+0000 7f3d6488c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d6009d630 0x7f3d600a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33040/0 (socket says 172.21.15.26:33040) 2023-10-01T08:00:48.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.647+0000 7f3d6488c700 1 -- 172.21.15.26:0/2923422276 learned_addr learned my addr 172.21.15.26:0/2923422276 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:48.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.647+0000 7f3d6508d700 1 --2- 172.21.15.26:0/2923422276 >> v2:172.21.15.26:3300/0 conn(0x7f3d600a0a30 0x7f3d600a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:48.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.648+0000 7f3d6488c700 1 -- 172.21.15.26:0/2923422276 >> v2:172.21.15.26:3300/0 conn(0x7f3d600a0a30 msgr2=0x7f3d600a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:48.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.648+0000 7f3d6488c700 1 --2- 172.21.15.26:0/2923422276 >> v2:172.21.15.26:3300/0 conn(0x7f3d600a0a30 0x7f3d600a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:48.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.648+0000 7f3d6488c700 1 -- 172.21.15.26:0/2923422276 >> v1:172.21.15.26:6789/0 conn(0x7f3d60133930 legacy=0x7f3d60133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:48.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.648+0000 7f3d6488c700 1 -- 172.21.15.26:0/2923422276 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6009dc50 con 0x7f3d6009d630 2023-10-01T08:00:48.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.648+0000 7f3d6508d700 1 --2- 172.21.15.26:0/2923422276 >> v2:172.21.15.26:3300/0 conn(0x7f3d600a0a30 0x7f3d600a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:48.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.648+0000 7f3d6488c700 1 --2- 172.21.15.26:0/2923422276 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d6009d630 0x7f3d600a1340 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f3d500098f0 tx=0x7f3d50009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49888b1ca0a91dc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:48.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.648+0000 7f3d57fff700 1 -- 172.21.15.26:0/2923422276 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d50011830 con 0x7f3d6009d630 2023-10-01T08:00:48.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.648+0000 7f3d57fff700 1 -- 172.21.15.26:0/2923422276 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d50011990 con 0x7f3d6009d630 2023-10-01T08:00:48.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.648+0000 7f3d57fff700 1 -- 172.21.15.26:0/2923422276 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d50011d20 con 0x7f3d6009d630 2023-10-01T08:00:48.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.649+0000 7f3d672f1700 1 -- 172.21.15.26:0/2923422276 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d6009d630 msgr2=0x7f3d600a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:48.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.649+0000 7f3d672f1700 1 --2- 172.21.15.26:0/2923422276 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d6009d630 0x7f3d600a1340 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f3d500098f0 tx=0x7f3d50009c00 comp rx=0 tx=0).stop 2023-10-01T08:00:48.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.649+0000 7f3d672f1700 1 -- 172.21.15.26:0/2923422276 shutdown_connections 2023-10-01T08:00:48.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.649+0000 7f3d672f1700 1 --2- 172.21.15.26:0/2923422276 >> v2:172.21.15.26:3300/0 conn(0x7f3d600a0a30 0x7f3d600a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:48.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.649+0000 7f3d672f1700 1 --2- 172.21.15.26:0/2923422276 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d6009d630 0x7f3d600a1340 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:48.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.649+0000 7f3d672f1700 1 -- 172.21.15.26:0/2923422276 >> 172.21.15.26:0/2923422276 conn(0x7f3d600a3050 msgr2=0x7f3d600a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:48.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.649+0000 7f3d672f1700 1 -- 172.21.15.26:0/2923422276 shutdown_connections 2023-10-01T08:00:48.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.649+0000 7f3d672f1700 1 -- 172.21.15.26:0/2923422276 wait complete. 2023-10-01T08:00:48.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.650+0000 7f3d672f1700 1 Processor -- start 2023-10-01T08:00:48.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.650+0000 7f3d672f1700 1 -- start start 2023-10-01T08:00:48.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.650+0000 7f3d672f1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3d6009d630 0x7f3d60121100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:48.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.650+0000 7f3d672f1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d600a0a30 0x7f3d60121640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:48.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.650+0000 7f3d672f1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d60133930 0x7f3d60121b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:48.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.650+0000 7f3d672f1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d601225b0 con 0x7f3d60133930 2023-10-01T08:00:48.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.650+0000 7f3d672f1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d60124bd0 con 0x7f3d600a0a30 2023-10-01T08:00:48.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.650+0000 7f3d672f1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d60124630 con 0x7f3d6009d630 2023-10-01T08:00:48.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.651+0000 7f3d6488c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d600a0a30 0x7f3d60121640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:48.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.651+0000 7f3d6488c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d600a0a30 0x7f3d60121640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33054/0 (socket says 172.21.15.26:33054) 2023-10-01T08:00:48.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.651+0000 7f3d6588e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d60133930 0x7f3d60121b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:48.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.651+0000 7f3d6488c700 1 -- 172.21.15.26:0/934235971 learned_addr learned my addr 172.21.15.26:0/934235971 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:48.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.651+0000 7f3d6508d700 1 --2- 172.21.15.26:0/934235971 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3d6009d630 0x7f3d60121100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:48.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.651+0000 7f3d6488c700 1 -- 172.21.15.26:0/934235971 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3d6009d630 msgr2=0x7f3d60121100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:48.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.651+0000 7f3d6488c700 1 --2- 172.21.15.26:0/934235971 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3d6009d630 0x7f3d60121100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:48.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.651+0000 7f3d6488c700 1 -- 172.21.15.26:0/934235971 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d60133930 msgr2=0x7f3d60121b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:48.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.651+0000 7f3d6488c700 1 --2- 172.21.15.26:0/934235971 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d60133930 0x7f3d60121b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:48.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.651+0000 7f3d6488c700 1 -- 172.21.15.26:0/934235971 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5c0094a0 con 0x7f3d600a0a30 2023-10-01T08:00:48.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.651+0000 7f3d6488c700 1 --2- 172.21.15.26:0/934235971 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d600a0a30 0x7f3d60121640 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f3d50000c00 tx=0x7f3d50004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:48.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.651+0000 7f3d55ffb700 1 -- 172.21.15.26:0/934235971 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d500036a0 con 0x7f3d600a0a30 2023-10-01T08:00:48.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.651+0000 7f3d55ffb700 1 -- 172.21.15.26:0/934235971 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d50003800 con 0x7f3d600a0a30 2023-10-01T08:00:48.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.651+0000 7f3d55ffb700 1 -- 172.21.15.26:0/934235971 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d50003bb0 con 0x7f3d600a0a30 2023-10-01T08:00:48.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.651+0000 7f3d672f1700 1 -- 172.21.15.26:0/934235971 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d50009550 con 0x7f3d600a0a30 2023-10-01T08:00:48.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.652+0000 7f3d672f1700 1 -- 172.21.15.26:0/934235971 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d600a0410 con 0x7f3d600a0a30 2023-10-01T08:00:48.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.653+0000 7f3d672f1700 1 -- 172.21.15.26:0/934235971 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d6011df60 con 0x7f3d600a0a30 2023-10-01T08:00:48.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.653+0000 7f3d55ffb700 1 -- 172.21.15.26:0/934235971 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3d50021070 con 0x7f3d600a0a30 2023-10-01T08:00:48.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.653+0000 7f3d55ffb700 1 -- 172.21.15.26:0/934235971 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3d50040bf0 con 0x7f3d600a0a30 2023-10-01T08:00:48.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.658+0000 7f3d55ffb700 1 -- 172.21.15.26:0/934235971 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3d5002d3a0 con 0x7f3d600a0a30 2023-10-01T08:00:48.661 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:48.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.760+0000 7f214e501700 1 Processor -- start 2023-10-01T08:00:48.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.760+0000 7f214e501700 1 -- start start 2023-10-01T08:00:48.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.761+0000 7f214e501700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21480a0a30 0x7f21480a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:48.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.761+0000 7f214e501700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2148134170 0x7f214813bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:48.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.761+0000 7f214e501700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f214809edd0 con 0x7f21480a1340 2023-10-01T08:00:48.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.761+0000 7f214e501700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f214809e1f0 con 0x7f21480a0a30 2023-10-01T08:00:48.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.761+0000 7f214e501700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f214809dc50 con 0x7f2148134170 2023-10-01T08:00:48.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.761+0000 7f2147fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21480a0a30 0x7f21480a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:48.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.761+0000 7f2147fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21480a0a30 0x7f21480a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33068/0 (socket says 172.21.15.26:33068) 2023-10-01T08:00:48.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.761+0000 7f2147fff700 1 -- 172.21.15.26:0/2745699013 learned_addr learned my addr 172.21.15.26:0/2745699013 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:48.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.761+0000 7f21477fe700 1 --1- 172.21.15.26:0/2745699013 >> v1:172.21.15.26:6789/0 conn(0x7f21480a1340 0x7f2148133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38844/0 (socket says 172.21.15.26:38844) 2023-10-01T08:00:48.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.761+0000 7f214ca9e700 1 --2- 172.21.15.26:0/2745699013 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2148134170 0x7f214813bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:48.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.761+0000 7f2147fff700 1 -- 172.21.15.26:0/2745699013 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2148134170 msgr2=0x7f214813bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:48.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.761+0000 7f2147fff700 1 --2- 172.21.15.26:0/2745699013 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2148134170 0x7f214813bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:48.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.762+0000 7f2147fff700 1 -- 172.21.15.26:0/2745699013 >> v1:172.21.15.26:6789/0 conn(0x7f21480a1340 legacy=0x7f2148133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:48.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.762+0000 7f2147fff700 1 -- 172.21.15.26:0/2745699013 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21480a1fe0 con 0x7f21480a0a30 2023-10-01T08:00:48.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.762+0000 7f2147fff700 1 --2- 172.21.15.26:0/2745699013 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21480a0a30 0x7f21480a0e00 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f2138009920 tx=0x7f2138009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5ee8e82a9e60945 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:48.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.762+0000 7f2146ffd700 1 -- 172.21.15.26:0/2745699013 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2138011830 con 0x7f21480a0a30 2023-10-01T08:00:48.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.762+0000 7f2146ffd700 1 -- 172.21.15.26:0/2745699013 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2138011990 con 0x7f21480a0a30 2023-10-01T08:00:48.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.762+0000 7f2146ffd700 1 -- 172.21.15.26:0/2745699013 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2138011d20 con 0x7f21480a0a30 2023-10-01T08:00:48.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.763+0000 7f214e501700 1 -- 172.21.15.26:0/2745699013 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21480a0a30 msgr2=0x7f21480a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:48.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.763+0000 7f214e501700 1 --2- 172.21.15.26:0/2745699013 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21480a0a30 0x7f21480a0e00 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f2138009920 tx=0x7f2138009c30 comp rx=0 tx=0).stop 2023-10-01T08:00:48.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.763+0000 7f214e501700 1 -- 172.21.15.26:0/2745699013 shutdown_connections 2023-10-01T08:00:48.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.763+0000 7f214e501700 1 --2- 172.21.15.26:0/2745699013 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2148134170 0x7f214813bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:48.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.763+0000 7f214e501700 1 --2- 172.21.15.26:0/2745699013 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21480a0a30 0x7f21480a0e00 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:48.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.763+0000 7f214e501700 1 -- 172.21.15.26:0/2745699013 >> 172.21.15.26:0/2745699013 conn(0x7f21480a6550 msgr2=0x7f21480a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:48.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.763+0000 7f214e501700 1 -- 172.21.15.26:0/2745699013 shutdown_connections 2023-10-01T08:00:48.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.763+0000 7f214e501700 1 -- 172.21.15.26:0/2745699013 wait complete. 2023-10-01T08:00:48.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.764+0000 7f214e501700 1 Processor -- start 2023-10-01T08:00:48.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.764+0000 7f214e501700 1 -- start start 2023-10-01T08:00:48.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.765+0000 7f214e501700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21480a0a30 0x7f21481c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:48.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.765+0000 7f214e501700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f21480a1340 0x7f21481c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:48.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.765+0000 7f214e501700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2148134170 0x7f21481c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:48.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.765+0000 7f214e501700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2148124700 con 0x7f2148134170 2023-10-01T08:00:48.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.765+0000 7f214e501700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2148125ef0 con 0x7f21480a0a30 2023-10-01T08:00:48.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.765+0000 7f214e501700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21480a0220 con 0x7f21480a1340 2023-10-01T08:00:48.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.765+0000 7f21477fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f21480a1340 0x7f21481c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:48.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.765+0000 7f214ca9e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2148134170 0x7f21481c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:48.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.765+0000 7f2147fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21480a0a30 0x7f21481c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:48.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.765+0000 7f21477fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f21480a1340 0x7f21481c8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44632/0 (socket says 172.21.15.26:44632) 2023-10-01T08:00:48.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.765+0000 7f21477fe700 1 -- 172.21.15.26:0/121958136 learned_addr learned my addr 172.21.15.26:0/121958136 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:48.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.765+0000 7f21477fe700 1 -- 172.21.15.26:0/121958136 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21480a0a30 msgr2=0x7f21481c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:48.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.765+0000 7f21477fe700 1 --2- 172.21.15.26:0/121958136 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21480a0a30 0x7f21481c8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:48.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.765+0000 7f21477fe700 1 -- 172.21.15.26:0/121958136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2148134170 msgr2=0x7f21481c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:48.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.765+0000 7f21477fe700 1 --2- 172.21.15.26:0/121958136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2148134170 0x7f21481c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:48.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.765+0000 7f21477fe700 1 -- 172.21.15.26:0/121958136 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2138009550 con 0x7f21480a1340 2023-10-01T08:00:48.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.765+0000 7f21477fe700 1 --2- 172.21.15.26:0/121958136 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f21480a1340 0x7f21481c8a90 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f213c00c520 tx=0x7f213c00c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:48.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.766+0000 7f2144ff9700 1 -- 172.21.15.26:0/121958136 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c005cb0 con 0x7f21480a1340 2023-10-01T08:00:48.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.766+0000 7f2144ff9700 1 -- 172.21.15.26:0/121958136 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213c005e10 con 0x7f21480a1340 2023-10-01T08:00:48.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.766+0000 7f214e501700 1 -- 172.21.15.26:0/121958136 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21480a25e0 con 0x7f21480a1340 2023-10-01T08:00:48.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.766+0000 7f2144ff9700 1 -- 172.21.15.26:0/121958136 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c0072d0 con 0x7f21480a1340 2023-10-01T08:00:48.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.766+0000 7f214e501700 1 -- 172.21.15.26:0/121958136 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2148133700 con 0x7f21480a1340 2023-10-01T08:00:48.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.767+0000 7f2144ff9700 1 -- 172.21.15.26:0/121958136 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f213c007430 con 0x7f21480a1340 2023-10-01T08:00:48.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.767+0000 7f214e501700 1 -- 172.21.15.26:0/121958136 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2148074ea0 con 0x7f21480a1340 2023-10-01T08:00:48.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.767+0000 7f2144ff9700 1 -- 172.21.15.26:0/121958136 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f213c03ea80 con 0x7f21480a1340 2023-10-01T08:00:48.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.776+0000 7f2144ff9700 1 -- 172.21.15.26:0/121958136 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f213c01b3b0 con 0x7f21480a1340 2023-10-01T08:00:48.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.804+0000 7fdc9334c700 1 Processor -- start 2023-10-01T08:00:48.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.804+0000 7fdc9334c700 1 -- start start 2023-10-01T08:00:48.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.804+0000 7fdc9334c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdc8c0a0a30 0x7fdc8c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:48.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.804+0000 7fdc9334c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdc8c0a1340 0x7fdc8c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:48.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.804+0000 7fdc9334c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc8c133fa0 0x7fdc8c134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:48.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.804+0000 7fdc9334c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc8c09edd0 con 0x7fdc8c0a1340 2023-10-01T08:00:48.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.804+0000 7fdc9334c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c09e1f0 con 0x7fdc8c133fa0 2023-10-01T08:00:48.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.804+0000 7fdc9334c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c09dc50 con 0x7fdc8c0a0a30 2023-10-01T08:00:48.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.805+0000 7fdc910e8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdc8c0a0a30 0x7fdc8c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:48.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.805+0000 7fdc910e8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdc8c0a0a30 0x7fdc8c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44644/0 (socket says 172.21.15.26:44644) 2023-10-01T08:00:48.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.805+0000 7fdc908e7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdc8c0a1340 0x7fdc8c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:48.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.805+0000 7fdc910e8700 1 -- 172.21.15.26:0/1102018794 learned_addr learned my addr 172.21.15.26:0/1102018794 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:48.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.805+0000 7fdc918e9700 1 --2- 172.21.15.26:0/1102018794 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc8c133fa0 0x7fdc8c134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:48.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.805+0000 7fdc908e7700 1 -- 172.21.15.26:0/1102018794 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdc8c0a0a30 msgr2=0x7fdc8c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:48.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.805+0000 7fdc908e7700 1 --2- 172.21.15.26:0/1102018794 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdc8c0a0a30 0x7fdc8c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:48.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.805+0000 7fdc908e7700 1 -- 172.21.15.26:0/1102018794 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc8c133fa0 msgr2=0x7fdc8c134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:48.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.805+0000 7fdc908e7700 1 --2- 172.21.15.26:0/1102018794 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc8c133fa0 0x7fdc8c134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:48.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.805+0000 7fdc908e7700 1 -- 172.21.15.26:0/1102018794 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8c0a1fe0 con 0x7fdc8c0a1340 2023-10-01T08:00:48.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.805+0000 7fdc910e8700 1 --2- 172.21.15.26:0/1102018794 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdc8c0a0a30 0x7fdc8c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:48.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.805+0000 7fdc918e9700 1 --2- 172.21.15.26:0/1102018794 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc8c133fa0 0x7fdc8c134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:48.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.805+0000 7fdc908e7700 1 --2- 172.21.15.26:0/1102018794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc8c0a1340 0x7fdc8c133a60 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c009840 tx=0x7fdc7c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53b36b590206e3c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:48.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.805+0000 7fdc83fff700 1 -- 172.21.15.26:0/1102018794 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c011830 con 0x7fdc8c0a1340 2023-10-01T08:00:48.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.806+0000 7fdc83fff700 1 -- 172.21.15.26:0/1102018794 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc7c011990 con 0x7fdc8c0a1340 2023-10-01T08:00:48.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.806+0000 7fdc83fff700 1 -- 172.21.15.26:0/1102018794 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c011d20 con 0x7fdc8c0a1340 2023-10-01T08:00:48.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.806+0000 7fdc9334c700 1 -- 172.21.15.26:0/1102018794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc8c0a1340 msgr2=0x7fdc8c133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:48.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.806+0000 7fdc9334c700 1 --2- 172.21.15.26:0/1102018794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc8c0a1340 0x7fdc8c133a60 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c009840 tx=0x7fdc7c009b50 comp rx=0 tx=0).stop 2023-10-01T08:00:48.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.806+0000 7fdc9334c700 1 -- 172.21.15.26:0/1102018794 shutdown_connections 2023-10-01T08:00:48.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.806+0000 7fdc9334c700 1 --2- 172.21.15.26:0/1102018794 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc8c133fa0 0x7fdc8c134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:48.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.806+0000 7fdc9334c700 1 --2- 172.21.15.26:0/1102018794 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdc8c0a0a30 0x7fdc8c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:48.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.806+0000 7fdc9334c700 1 --2- 172.21.15.26:0/1102018794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc8c0a1340 0x7fdc8c133a60 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:48.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.806+0000 7fdc9334c700 1 -- 172.21.15.26:0/1102018794 >> 172.21.15.26:0/1102018794 conn(0x7fdc8c0a6550 msgr2=0x7fdc8c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:48.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.806+0000 7fdc9334c700 1 -- 172.21.15.26:0/1102018794 shutdown_connections 2023-10-01T08:00:48.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.806+0000 7fdc9334c700 1 -- 172.21.15.26:0/1102018794 wait complete. 2023-10-01T08:00:48.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.808+0000 7fdc9334c700 1 Processor -- start 2023-10-01T08:00:48.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.808+0000 7fdc9334c700 1 -- start start 2023-10-01T08:00:48.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.809+0000 7fdc9334c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc8c0a0a30 0x7fdc8c120270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:48.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.809+0000 7fdc9334c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc8c0a1340 0x7fdc8c1207b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:48.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.809+0000 7fdc9334c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdc8c133fa0 0x7fdc8c120cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:48.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.809+0000 7fdc9334c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c121740 con 0x7fdc8c0a0a30 2023-10-01T08:00:48.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.809+0000 7fdc9334c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c133660 con 0x7fdc8c0a1340 2023-10-01T08:00:48.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.809+0000 7fdc9334c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c1230d0 con 0x7fdc8c133fa0 2023-10-01T08:00:48.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.809+0000 7fdc910e8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc8c0a0a30 0x7fdc8c120270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:48.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.809+0000 7fdc910e8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc8c0a0a30 0x7fdc8c120270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59438/0 (socket says 172.21.15.26:59438) 2023-10-01T08:00:48.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.809+0000 7fdc910e8700 1 -- 172.21.15.26:0/3988668910 learned_addr learned my addr 172.21.15.26:0/3988668910 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:48.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.809+0000 7fdc908e7700 1 --2- 172.21.15.26:0/3988668910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc8c0a1340 0x7fdc8c1207b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:48.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.809+0000 7fdc918e9700 1 --2- 172.21.15.26:0/3988668910 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdc8c133fa0 0x7fdc8c120cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:48.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.809+0000 7fdc910e8700 1 -- 172.21.15.26:0/3988668910 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdc8c133fa0 msgr2=0x7fdc8c120cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:48.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.809+0000 7fdc910e8700 1 --2- 172.21.15.26:0/3988668910 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdc8c133fa0 0x7fdc8c120cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:48.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.809+0000 7fdc910e8700 1 -- 172.21.15.26:0/3988668910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc8c0a1340 msgr2=0x7fdc8c1207b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:48.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.809+0000 7fdc910e8700 1 --2- 172.21.15.26:0/3988668910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc8c0a1340 0x7fdc8c1207b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:48.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.809+0000 7fdc910e8700 1 -- 172.21.15.26:0/3988668910 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc88009550 con 0x7fdc8c0a0a30 2023-10-01T08:00:48.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.809+0000 7fdc908e7700 1 --2- 172.21.15.26:0/3988668910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc8c0a1340 0x7fdc8c1207b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:48.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.809+0000 7fdc910e8700 1 --2- 172.21.15.26:0/3988668910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc8c0a0a30 0x7fdc8c120270 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fdc8800ec10 tx=0x7fdc8800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:48.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.810+0000 7fdc81ffb700 1 -- 172.21.15.26:0/3988668910 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8800c850 con 0x7fdc8c0a0a30 2023-10-01T08:00:48.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.810+0000 7fdc81ffb700 1 -- 172.21.15.26:0/3988668910 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8800c9b0 con 0x7fdc8c0a0a30 2023-10-01T08:00:48.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.810+0000 7fdc9334c700 1 -- 172.21.15.26:0/3988668910 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc84009a70 con 0x7fdc8c0a0a30 2023-10-01T08:00:48.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.810+0000 7fdc81ffb700 1 -- 172.21.15.26:0/3988668910 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8800cd20 con 0x7fdc8c0a0a30 2023-10-01T08:00:48.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.810+0000 7fdc9334c700 1 -- 172.21.15.26:0/3988668910 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc7c0094a0 con 0x7fdc8c0a0a30 2023-10-01T08:00:48.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.811+0000 7fdc81ffb700 1 -- 172.21.15.26:0/3988668910 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdc88013470 con 0x7fdc8c0a0a30 2023-10-01T08:00:48.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.811+0000 7fdc81ffb700 1 -- 172.21.15.26:0/3988668910 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdc8803fc60 con 0x7fdc8c0a0a30 2023-10-01T08:00:48.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.812+0000 7fdc9334c700 1 -- 172.21.15.26:0/3988668910 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc8c0a0220 con 0x7fdc8c0a0a30 2023-10-01T08:00:48.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.816+0000 7fdc81ffb700 1 -- 172.21.15.26:0/3988668910 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdc88013720 con 0x7fdc8c0a0a30 2023-10-01T08:00:48.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.877+0000 7f3d672f1700 1 -- 172.21.15.26:0/934235971 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3d600747f0 con 0x7f3d600a0a30 2023-10-01T08:00:48.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.877+0000 7f3d55ffb700 1 -- 172.21.15.26:0/934235971 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3d50029030 con 0x7f3d600a0a30 2023-10-01T08:00:48.878 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:48.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.880+0000 7f3d672f1700 1 -- 172.21.15.26:0/934235971 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d600a0a30 msgr2=0x7f3d60121640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:48.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.880+0000 7f3d672f1700 1 --2- 172.21.15.26:0/934235971 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d600a0a30 0x7f3d60121640 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f3d50000c00 tx=0x7f3d50004750 comp rx=0 tx=0).stop 2023-10-01T08:00:48.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.880+0000 7f3d672f1700 1 -- 172.21.15.26:0/934235971 shutdown_connections 2023-10-01T08:00:48.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.880+0000 7f3d672f1700 1 --2- 172.21.15.26:0/934235971 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d60133930 0x7f3d60121b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:48.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.880+0000 7f3d672f1700 1 --2- 172.21.15.26:0/934235971 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3d6009d630 0x7f3d60121100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:48.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.880+0000 7f3d672f1700 1 --2- 172.21.15.26:0/934235971 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d600a0a30 0x7f3d60121640 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:48.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.880+0000 7f3d672f1700 1 -- 172.21.15.26:0/934235971 >> 172.21.15.26:0/934235971 conn(0x7f3d600a3050 msgr2=0x7f3d60133210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:48.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.880+0000 7f3d672f1700 1 -- 172.21.15.26:0/934235971 shutdown_connections 2023-10-01T08:00:48.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.880+0000 7f3d672f1700 1 -- 172.21.15.26:0/934235971 wait complete. 2023-10-01T08:00:48.895 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:48.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.984+0000 7f214e501700 1 -- 172.21.15.26:0/121958136 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f21480a28e0 con 0x7f21480a1340 2023-10-01T08:00:48.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.984+0000 7f2144ff9700 1 -- 172.21.15.26:0/121958136 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f213c017030 con 0x7f21480a1340 2023-10-01T08:00:48.985 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:48.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.986+0000 7f214e501700 1 -- 172.21.15.26:0/121958136 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f21480a1340 msgr2=0x7f21481c8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:48.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.986+0000 7f214e501700 1 --2- 172.21.15.26:0/121958136 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f21480a1340 0x7f21481c8a90 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f213c00c520 tx=0x7f213c00c830 comp rx=0 tx=0).stop 2023-10-01T08:00:48.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.986+0000 7f214e501700 1 -- 172.21.15.26:0/121958136 shutdown_connections 2023-10-01T08:00:48.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.986+0000 7f214e501700 1 --2- 172.21.15.26:0/121958136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2148134170 0x7f21481c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:48.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.986+0000 7f214e501700 1 --2- 172.21.15.26:0/121958136 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21480a0a30 0x7f21481c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:48.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.986+0000 7f214e501700 1 --2- 172.21.15.26:0/121958136 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f21480a1340 0x7f21481c8a90 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:48.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.986+0000 7f214e501700 1 -- 172.21.15.26:0/121958136 >> 172.21.15.26:0/121958136 conn(0x7f21480a6550 msgr2=0x7f214809ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:48.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.986+0000 7f214e501700 1 -- 172.21.15.26:0/121958136 shutdown_connections 2023-10-01T08:00:48.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:48.986+0000 7f214e501700 1 -- 172.21.15.26:0/121958136 wait complete. 2023-10-01T08:00:49.000 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:49.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.027+0000 7fdc9334c700 1 -- 172.21.15.26:0/3988668910 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdc8c074ea0 con 0x7fdc8c0a0a30 2023-10-01T08:00:49.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.027+0000 7fdc81ffb700 1 -- 172.21.15.26:0/3988668910 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdc8802b090 con 0x7fdc8c0a0a30 2023-10-01T08:00:49.028 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:49.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.030+0000 7fdc9334c700 1 -- 172.21.15.26:0/3988668910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc8c0a0a30 msgr2=0x7fdc8c120270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:49.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.030+0000 7fdc9334c700 1 --2- 172.21.15.26:0/3988668910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc8c0a0a30 0x7fdc8c120270 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fdc8800ec10 tx=0x7fdc8800ef20 comp rx=0 tx=0).stop 2023-10-01T08:00:49.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.030+0000 7fdc9334c700 1 -- 172.21.15.26:0/3988668910 shutdown_connections 2023-10-01T08:00:49.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.030+0000 7fdc9334c700 1 --2- 172.21.15.26:0/3988668910 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdc8c133fa0 0x7fdc8c120cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:49.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.030+0000 7fdc9334c700 1 --2- 172.21.15.26:0/3988668910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc8c0a0a30 0x7fdc8c120270 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:49.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.030+0000 7fdc9334c700 1 --2- 172.21.15.26:0/3988668910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdc8c0a1340 0x7fdc8c1207b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:49.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.030+0000 7fdc9334c700 1 -- 172.21.15.26:0/3988668910 >> 172.21.15.26:0/3988668910 conn(0x7fdc8c0a6550 msgr2=0x7fdc8c1baf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:49.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.030+0000 7fdc9334c700 1 -- 172.21.15.26:0/3988668910 shutdown_connections 2023-10-01T08:00:49.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.030+0000 7fdc9334c700 1 -- 172.21.15.26:0/3988668910 wait complete. 2023-10-01T08:00:49.045 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:49.537 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:49.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.682+0000 7fb80e3a4700 1 Processor -- start 2023-10-01T08:00:49.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.683+0000 7fb80e3a4700 1 -- start start 2023-10-01T08:00:49.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.683+0000 7fb80e3a4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb80809e930 0x7fb80809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:49.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.683+0000 7fb80e3a4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb80809f650 0x7fb808131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:49.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.683+0000 7fb80e3a4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb808070940 con 0x7fb80809f240 2023-10-01T08:00:49.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.683+0000 7fb80e3a4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb80806fd60 con 0x7fb80809f650 2023-10-01T08:00:49.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.683+0000 7fb80e3a4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb80806fa80 con 0x7fb80809e930 2023-10-01T08:00:49.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.683+0000 7fb80c941700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb80809f650 0x7fb808131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:49.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.683+0000 7fb807fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb80809e930 0x7fb80809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:49.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.683+0000 7fb80c941700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb80809f650 0x7fb808131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59442/0 (socket says 172.21.15.26:59442) 2023-10-01T08:00:49.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.683+0000 7fb80c941700 1 -- 172.21.15.26:0/4026086619 learned_addr learned my addr 172.21.15.26:0/4026086619 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:49.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.683+0000 7fb807fff700 1 --2- 172.21.15.26:0/4026086619 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb80809e930 0x7fb80809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44654/0 (socket says 172.21.15.26:44654) 2023-10-01T08:00:49.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.684+0000 7fb807fff700 1 -- 172.21.15.26:0/4026086619 >> v2:172.21.15.26:3300/0 conn(0x7fb80809f650 msgr2=0x7fb808131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.684+0000 7fb807fff700 1 --2- 172.21.15.26:0/4026086619 >> v2:172.21.15.26:3300/0 conn(0x7fb80809f650 0x7fb808131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.684+0000 7fb807fff700 1 -- 172.21.15.26:0/4026086619 >> v1:172.21.15.26:6789/0 conn(0x7fb80809f240 legacy=0x7fb8081317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.684+0000 7fb807fff700 1 -- 172.21.15.26:0/4026086619 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80809fb60 con 0x7fb80809e930 2023-10-01T08:00:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.684+0000 7fb80c941700 1 --2- 172.21.15.26:0/4026086619 >> v2:172.21.15.26:3300/0 conn(0x7fb80809f650 0x7fb808131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.684+0000 7fb807fff700 1 --2- 172.21.15.26:0/4026086619 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb80809e930 0x7fb80809ed00 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8009840 tx=0x7fb7f8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50a9595df9b04882 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.684+0000 7fb806ffd700 1 -- 172.21.15.26:0/4026086619 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8011830 con 0x7fb80809e930 2023-10-01T08:00:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.684+0000 7fb806ffd700 1 -- 172.21.15.26:0/4026086619 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f8011990 con 0x7fb80809e930 2023-10-01T08:00:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.684+0000 7fb806ffd700 1 -- 172.21.15.26:0/4026086619 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8011d20 con 0x7fb80809e930 2023-10-01T08:00:49.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.684+0000 7fb80e3a4700 1 -- 172.21.15.26:0/4026086619 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb80809e930 msgr2=0x7fb80809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:49.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.684+0000 7fb80e3a4700 1 --2- 172.21.15.26:0/4026086619 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb80809e930 0x7fb80809ed00 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8009840 tx=0x7fb7f8009b50 comp rx=0 tx=0).stop 2023-10-01T08:00:49.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.685+0000 7fb80e3a4700 1 -- 172.21.15.26:0/4026086619 shutdown_connections 2023-10-01T08:00:49.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.685+0000 7fb80e3a4700 1 --2- 172.21.15.26:0/4026086619 >> v2:172.21.15.26:3300/0 conn(0x7fb80809f650 0x7fb808131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:49.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.685+0000 7fb80e3a4700 1 --2- 172.21.15.26:0/4026086619 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb80809e930 0x7fb80809ed00 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:49.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.685+0000 7fb80e3a4700 1 -- 172.21.15.26:0/4026086619 >> 172.21.15.26:0/4026086619 conn(0x7fb8080a4210 msgr2=0x7fb8080a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:49.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.685+0000 7fb80e3a4700 1 -- 172.21.15.26:0/4026086619 shutdown_connections 2023-10-01T08:00:49.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.685+0000 7fb80e3a4700 1 -- 172.21.15.26:0/4026086619 wait complete. 2023-10-01T08:00:49.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.686+0000 7fb80e3a4700 1 Processor -- start 2023-10-01T08:00:49.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.686+0000 7fb80e3a4700 1 -- start start 2023-10-01T08:00:49.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.687+0000 7fb80e3a4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb80809e930 0x7fb80806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:49.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.687+0000 7fb80e3a4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb80809f240 0x7fb80806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:49.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.687+0000 7fb80e3a4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb80809f650 0x7fb80806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:49.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.687+0000 7fb80e3a4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8081b7240 con 0x7fb80809f650 2023-10-01T08:00:49.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.687+0000 7fb80e3a4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8081a93f0 con 0x7fb80809f240 2023-10-01T08:00:49.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.687+0000 7fb80e3a4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8081a8910 con 0x7fb80809e930 2023-10-01T08:00:49.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.687+0000 7fb807fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb80809e930 0x7fb80806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:49.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.687+0000 7fb80c941700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb80809f650 0x7fb80806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:49.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.687+0000 7fb8077fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb80809f240 0x7fb80806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:49.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.687+0000 7fb807fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb80809e930 0x7fb80806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44666/0 (socket says 172.21.15.26:44666) 2023-10-01T08:00:49.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.687+0000 7fb807fff700 1 -- 172.21.15.26:0/3485255238 learned_addr learned my addr 172.21.15.26:0/3485255238 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:49.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.687+0000 7fb80c941700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb80809f650 0x7fb80806c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59444/0 (socket says 172.21.15.26:59444) 2023-10-01T08:00:49.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.687+0000 7fb807fff700 1 -- 172.21.15.26:0/3485255238 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb80809f240 msgr2=0x7fb80806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:49.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.687+0000 7fb807fff700 1 --2- 172.21.15.26:0/3485255238 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb80809f240 0x7fb80806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:49.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.687+0000 7fb807fff700 1 -- 172.21.15.26:0/3485255238 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb80809f650 msgr2=0x7fb80806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:49.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.687+0000 7fb807fff700 1 --2- 172.21.15.26:0/3485255238 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb80809f650 0x7fb80806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:49.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.687+0000 7fb807fff700 1 -- 172.21.15.26:0/3485255238 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb800009b30 con 0x7fb80809e930 2023-10-01T08:00:49.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.687+0000 7fb80c941700 1 --2- 172.21.15.26:0/3485255238 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb80809f650 0x7fb80806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:49.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.687+0000 7fb807fff700 1 --2- 172.21.15.26:0/3485255238 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb80809e930 0x7fb80806b8b0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8009fd0 tx=0x7fb7f8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:49.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.687+0000 7fb804ff9700 1 -- 172.21.15.26:0/3485255238 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f80036a0 con 0x7fb80809e930 2023-10-01T08:00:49.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.688+0000 7fb804ff9700 1 -- 172.21.15.26:0/3485255238 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f801f070 con 0x7fb80809e930 2023-10-01T08:00:49.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.688+0000 7fb804ff9700 1 -- 172.21.15.26:0/3485255238 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8003a60 con 0x7fb80809e930 2023-10-01T08:00:49.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.688+0000 7fb80e3a4700 1 -- 172.21.15.26:0/3485255238 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7f80094a0 con 0x7fb80809e930 2023-10-01T08:00:49.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.688+0000 7fb80e3a4700 1 -- 172.21.15.26:0/3485255238 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8080a0190 con 0x7fb80809e930 2023-10-01T08:00:49.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.688+0000 7fb804ff9700 1 -- 172.21.15.26:0/3485255238 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb7f8003bc0 con 0x7fb80809e930 2023-10-01T08:00:49.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.689+0000 7fb804ff9700 1 -- 172.21.15.26:0/3485255238 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb7f8021070 con 0x7fb80809e930 2023-10-01T08:00:49.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.689+0000 7fb80e3a4700 1 -- 172.21.15.26:0/3485255238 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8081a9180 con 0x7fb80809e930 2023-10-01T08:00:49.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.694+0000 7fb804ff9700 1 -- 172.21.15.26:0/3485255238 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb8081a9180 con 0x7fb80809e930 2023-10-01T08:00:49.896 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:49.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.900+0000 7fb80e3a4700 1 -- 172.21.15.26:0/3485255238 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb8081a9180 con 0x7fb80809e930 2023-10-01T08:00:49.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.900+0000 7fb804ff9700 1 -- 172.21.15.26:0/3485255238 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb8081a9180 con 0x7fb80809e930 2023-10-01T08:00:49.901 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:49.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.903+0000 7fb80e3a4700 1 -- 172.21.15.26:0/3485255238 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb80809e930 msgr2=0x7fb80806b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:49.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.903+0000 7fb80e3a4700 1 --2- 172.21.15.26:0/3485255238 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb80809e930 0x7fb80806b8b0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8009fd0 tx=0x7fb7f8004750 comp rx=0 tx=0).stop 2023-10-01T08:00:49.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.903+0000 7fb80e3a4700 1 -- 172.21.15.26:0/3485255238 shutdown_connections 2023-10-01T08:00:49.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.903+0000 7fb80e3a4700 1 --2- 172.21.15.26:0/3485255238 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb80809f650 0x7fb80806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:49.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.903+0000 7fb80e3a4700 1 --2- 172.21.15.26:0/3485255238 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb80809e930 0x7fb80806b8b0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:49.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.903+0000 7fb80e3a4700 1 --2- 172.21.15.26:0/3485255238 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb80809f240 0x7fb80806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:49.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.903+0000 7fb80e3a4700 1 -- 172.21.15.26:0/3485255238 >> 172.21.15.26:0/3485255238 conn(0x7fb8080a4210 msgr2=0x7fb8081b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:49.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.903+0000 7fb80e3a4700 1 -- 172.21.15.26:0/3485255238 shutdown_connections 2023-10-01T08:00:49.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:49.903+0000 7fb80e3a4700 1 -- 172.21.15.26:0/3485255238 wait complete. 2023-10-01T08:00:49.920 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:50.001 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:50.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.035+0000 7fb934b7f700 1 Processor -- start 2023-10-01T08:00:50.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.036+0000 7fb934b7f700 1 -- start start 2023-10-01T08:00:50.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.037+0000 7fb934b7f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb9300a09c0 0x7fb93006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:50.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.037+0000 7fb934b7f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb930138cf0 0x7fb93013b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:50.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.037+0000 7fb934b7f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9300a2a20 con 0x7fb9300a0d90 2023-10-01T08:00:50.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.037+0000 7fb934b7f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93009e690 con 0x7fb9300a09c0 2023-10-01T08:00:50.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.037+0000 7fb934b7f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9300a1cc0 con 0x7fb930138cf0 2023-10-01T08:00:50.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.037+0000 7fb92e59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb9300a09c0 0x7fb93006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:50.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.037+0000 7fb92dd9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb9300a0d90 0x7fb9300a11c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38860/0 (socket says 172.21.15.26:38860) 2023-10-01T08:00:50.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.037+0000 7fb92dd9b700 1 -- 172.21.15.26:0/1174372186 learned_addr learned my addr 172.21.15.26:0/1174372186 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:50.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.037+0000 7fb92ed9d700 1 --2- 172.21.15.26:0/1174372186 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb930138cf0 0x7fb93013b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:50.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.037+0000 7fb92e59c700 1 -- 172.21.15.26:0/1174372186 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb930138cf0 msgr2=0x7fb93013b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:50.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.037+0000 7fb92e59c700 1 --2- 172.21.15.26:0/1174372186 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb930138cf0 0x7fb93013b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:50.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.037+0000 7fb92d59a700 1 -- 172.21.15.26:0/1174372186 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1495907775 0 0) 0x7fb924001110 con 0x7fb9300a0d90 2023-10-01T08:00:50.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.037+0000 7fb92e59c700 1 -- 172.21.15.26:0/1174372186 >> v1:172.21.15.26:6789/0 conn(0x7fb9300a0d90 legacy=0x7fb9300a11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:50.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.037+0000 7fb92e59c700 1 -- 172.21.15.26:0/1174372186 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9300a1f40 con 0x7fb9300a09c0 2023-10-01T08:00:50.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.037+0000 7fb92ed9d700 1 --2- 172.21.15.26:0/1174372186 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb930138cf0 0x7fb93013b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:50.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.037+0000 7fb92e59c700 1 --2- 172.21.15.26:0/1174372186 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb9300a09c0 0x7fb93006c5d0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fb920009dc0 tx=0x7fb92000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3616a5a0394dbcad server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:50.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.038+0000 7fb92d59a700 1 -- 172.21.15.26:0/1174372186 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92000e070 con 0x7fb9300a09c0 2023-10-01T08:00:50.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.038+0000 7fb92d59a700 1 -- 172.21.15.26:0/1174372186 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92000bb20 con 0x7fb9300a09c0 2023-10-01T08:00:50.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.038+0000 7fb92d59a700 1 -- 172.21.15.26:0/1174372186 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb920012430 con 0x7fb9300a09c0 2023-10-01T08:00:50.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.038+0000 7fb934b7f700 1 -- 172.21.15.26:0/1174372186 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb9300a09c0 msgr2=0x7fb93006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:50.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.038+0000 7fb934b7f700 1 --2- 172.21.15.26:0/1174372186 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb9300a09c0 0x7fb93006c5d0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fb920009dc0 tx=0x7fb92000b330 comp rx=0 tx=0).stop 2023-10-01T08:00:50.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.038+0000 7fb934b7f700 1 -- 172.21.15.26:0/1174372186 shutdown_connections 2023-10-01T08:00:50.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.038+0000 7fb934b7f700 1 --2- 172.21.15.26:0/1174372186 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb930138cf0 0x7fb93013b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:50.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.038+0000 7fb934b7f700 1 --2- 172.21.15.26:0/1174372186 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb9300a09c0 0x7fb93006c5d0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:50.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.038+0000 7fb934b7f700 1 -- 172.21.15.26:0/1174372186 >> 172.21.15.26:0/1174372186 conn(0x7fb9300a60c0 msgr2=0x7fb9300a64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:50.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.039+0000 7fb934b7f700 1 -- 172.21.15.26:0/1174372186 shutdown_connections 2023-10-01T08:00:50.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.039+0000 7fb934b7f700 1 -- 172.21.15.26:0/1174372186 wait complete. 2023-10-01T08:00:50.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.040+0000 7fb934b7f700 1 Processor -- start 2023-10-01T08:00:50.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.040+0000 7fb934b7f700 1 -- start start 2023-10-01T08:00:50.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.041+0000 7fb934b7f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9300a09c0 0x7fb930137030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:50.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.041+0000 7fb934b7f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb9300a0d90 0x7fb930137570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:50.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.041+0000 7fb934b7f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb930138cf0 0x7fb930137ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:50.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.041+0000 7fb934b7f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb930136170 con 0x7fb9300a09c0 2023-10-01T08:00:50.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.041+0000 7fb934b7f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9301380e0 con 0x7fb930138cf0 2023-10-01T08:00:50.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.041+0000 7fb934b7f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb930138840 con 0x7fb9300a0d90 2023-10-01T08:00:50.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.041+0000 7fb92dd9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb9300a0d90 0x7fb930137570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:50.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.041+0000 7fb92ed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb930138cf0 0x7fb930137ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:50.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.041+0000 7fb92dd9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb9300a0d90 0x7fb930137570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44672/0 (socket says 172.21.15.26:44672) 2023-10-01T08:00:50.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.041+0000 7fb92dd9b700 1 -- 172.21.15.26:0/350846593 learned_addr learned my addr 172.21.15.26:0/350846593 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:50.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.041+0000 7fb92e59c700 1 --2- 172.21.15.26:0/350846593 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9300a09c0 0x7fb930137030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:50.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.041+0000 7fb92dd9b700 1 -- 172.21.15.26:0/350846593 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb930138cf0 msgr2=0x7fb930137ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:50.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.041+0000 7fb92dd9b700 1 --2- 172.21.15.26:0/350846593 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb930138cf0 0x7fb930137ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:50.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.041+0000 7fb92dd9b700 1 -- 172.21.15.26:0/350846593 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9300a09c0 msgr2=0x7fb930137030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:50.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.041+0000 7fb92dd9b700 1 --2- 172.21.15.26:0/350846593 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9300a09c0 0x7fb930137030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:50.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.041+0000 7fb92dd9b700 1 -- 172.21.15.26:0/350846593 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9280094a0 con 0x7fb9300a0d90 2023-10-01T08:00:50.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.041+0000 7fb92ed9d700 1 --2- 172.21.15.26:0/350846593 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb930138cf0 0x7fb930137ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:50.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.042+0000 7fb92dd9b700 1 --2- 172.21.15.26:0/350846593 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb9300a0d90 0x7fb930137570 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fb924001eb0 tx=0x7fb92400c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:50.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.042+0000 7fb91effd700 1 -- 172.21.15.26:0/350846593 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb924004c80 con 0x7fb9300a0d90 2023-10-01T08:00:50.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.042+0000 7fb91effd700 1 -- 172.21.15.26:0/350846593 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb924004de0 con 0x7fb9300a0d90 2023-10-01T08:00:50.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.042+0000 7fb934b7f700 1 -- 172.21.15.26:0/350846593 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb920009a70 con 0x7fb9300a0d90 2023-10-01T08:00:50.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.042+0000 7fb91effd700 1 -- 172.21.15.26:0/350846593 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb924007310 con 0x7fb9300a0d90 2023-10-01T08:00:50.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.042+0000 7fb934b7f700 1 -- 172.21.15.26:0/350846593 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb930135b50 con 0x7fb9300a0d90 2023-10-01T08:00:50.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.043+0000 7fb91effd700 1 -- 172.21.15.26:0/350846593 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb924007470 con 0x7fb9300a0d90 2023-10-01T08:00:50.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.043+0000 7fb91effd700 1 -- 172.21.15.26:0/350846593 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb92403f0d0 con 0x7fb9300a0d90 2023-10-01T08:00:50.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.043+0000 7fb934b7f700 1 -- 172.21.15.26:0/350846593 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9300a2a20 con 0x7fb9300a0d90 2023-10-01T08:00:50.047 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:50.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.048+0000 7fb91effd700 1 -- 172.21.15.26:0/350846593 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb9300a2a20 con 0x7fb9300a0d90 2023-10-01T08:00:50.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.146+0000 7f75b9e22700 1 Processor -- start 2023-10-01T08:00:50.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.146+0000 7f75b9e22700 1 -- start start 2023-10-01T08:00:50.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.146+0000 7f75b9e22700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f75b40a0a30 0x7f75b40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:50.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.146+0000 7f75b9e22700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f75b409d630 0x7f75b40a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:50.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.147+0000 7f75b9e22700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f75b4133930 0x7f75b4133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:50.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.147+0000 7f75b9e22700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b40a2a70 con 0x7f75b409d630 2023-10-01T08:00:50.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.147+0000 7f75b9e22700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b40a01d0 con 0x7f75b40a0a30 2023-10-01T08:00:50.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.147+0000 7f75b9e22700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75b409e2b0 con 0x7f75b4133930 2023-10-01T08:00:50.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.147+0000 7f75b37fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f75b40a0a30 0x7f75b40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:50.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.147+0000 7f75aaffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f75b409d630 0x7f75b40a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:50.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.147+0000 7f75b37fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f75b40a0a30 0x7f75b40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33154/0 (socket says 172.21.15.26:33154) 2023-10-01T08:00:50.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.147+0000 7f75aaffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f75b409d630 0x7f75b40a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59454/0 (socket says 172.21.15.26:59454) 2023-10-01T08:00:50.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.147+0000 7f75b37fe700 1 -- 172.21.15.26:0/3983472622 learned_addr learned my addr 172.21.15.26:0/3983472622 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:50.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.147+0000 7f75b3fff700 1 --2- 172.21.15.26:0/3983472622 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f75b4133930 0x7f75b4133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:50.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.147+0000 7f75aaffd700 1 -- 172.21.15.26:0/3983472622 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f75b4133930 msgr2=0x7f75b4133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:50.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.147+0000 7f75aaffd700 1 --2- 172.21.15.26:0/3983472622 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f75b4133930 0x7f75b4133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:50.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.147+0000 7f75aaffd700 1 -- 172.21.15.26:0/3983472622 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f75b40a0a30 msgr2=0x7f75b40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:50.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.147+0000 7f75aaffd700 1 --2- 172.21.15.26:0/3983472622 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f75b40a0a30 0x7f75b40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:50.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.147+0000 7f75aaffd700 1 -- 172.21.15.26:0/3983472622 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b409dc50 con 0x7f75b409d630 2023-10-01T08:00:50.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.147+0000 7f75b37fe700 1 --2- 172.21.15.26:0/3983472622 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f75b40a0a30 0x7f75b40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:50.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.147+0000 7f75aaffd700 1 --2- 172.21.15.26:0/3983472622 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75b409d630 0x7f75b40a1340 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f759c009840 tx=0x7f759c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d7e2a6b962de720 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:50.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.148+0000 7f75b2ffd700 1 -- 172.21.15.26:0/3983472622 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759c011830 con 0x7f75b409d630 2023-10-01T08:00:50.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.148+0000 7f75b2ffd700 1 -- 172.21.15.26:0/3983472622 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759c011990 con 0x7f75b409d630 2023-10-01T08:00:50.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.148+0000 7f75b2ffd700 1 -- 172.21.15.26:0/3983472622 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759c011d20 con 0x7f75b409d630 2023-10-01T08:00:50.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.148+0000 7f75b9e22700 1 -- 172.21.15.26:0/3983472622 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75b409d630 msgr2=0x7f75b40a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:50.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.148+0000 7f75b9e22700 1 --2- 172.21.15.26:0/3983472622 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75b409d630 0x7f75b40a1340 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f759c009840 tx=0x7f759c009b50 comp rx=0 tx=0).stop 2023-10-01T08:00:50.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.148+0000 7f75b9e22700 1 -- 172.21.15.26:0/3983472622 shutdown_connections 2023-10-01T08:00:50.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.148+0000 7f75b9e22700 1 --2- 172.21.15.26:0/3983472622 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f75b4133930 0x7f75b4133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:50.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.148+0000 7f75b9e22700 1 --2- 172.21.15.26:0/3983472622 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f75b40a0a30 0x7f75b40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:50.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.148+0000 7f75b9e22700 1 --2- 172.21.15.26:0/3983472622 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75b409d630 0x7f75b40a1340 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:50.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.148+0000 7f75b9e22700 1 -- 172.21.15.26:0/3983472622 >> 172.21.15.26:0/3983472622 conn(0x7f75b40a3050 msgr2=0x7f75b40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:50.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.148+0000 7f75b9e22700 1 -- 172.21.15.26:0/3983472622 shutdown_connections 2023-10-01T08:00:50.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.148+0000 7f75b9e22700 1 -- 172.21.15.26:0/3983472622 wait complete. 2023-10-01T08:00:50.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.149+0000 7f75b9e22700 1 Processor -- start 2023-10-01T08:00:50.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.150+0000 7f75b9e22700 1 -- start start 2023-10-01T08:00:50.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.150+0000 7f75b9e22700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75b409d630 0x7f75b41210d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:50.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.150+0000 7f75b9e22700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f75b40a0a30 0x7f75b4121610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:50.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.150+0000 7f75b9e22700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f75b4133930 0x7f75b4121b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:50.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.150+0000 7f75b9e22700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b4124410 con 0x7f75b409d630 2023-10-01T08:00:50.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.150+0000 7f75b9e22700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b4125560 con 0x7f75b40a0a30 2023-10-01T08:00:50.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.150+0000 7f75b9e22700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75b4122d30 con 0x7f75b4133930 2023-10-01T08:00:50.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.150+0000 7f75b37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75b409d630 0x7f75b41210d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:50.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.150+0000 7f75b37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75b409d630 0x7f75b41210d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59470/0 (socket says 172.21.15.26:59470) 2023-10-01T08:00:50.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.150+0000 7f75b37fe700 1 -- 172.21.15.26:0/4249832607 learned_addr learned my addr 172.21.15.26:0/4249832607 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:50.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.150+0000 7f75aaffd700 1 --2- 172.21.15.26:0/4249832607 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f75b40a0a30 0x7f75b4121610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:50.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.150+0000 7f75b3fff700 1 --2- 172.21.15.26:0/4249832607 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f75b4133930 0x7f75b4121b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:50.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.151+0000 7f75aaffd700 1 -- 172.21.15.26:0/4249832607 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f75b4133930 msgr2=0x7f75b4121b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:50.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.151+0000 7f75aaffd700 1 --2- 172.21.15.26:0/4249832607 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f75b4133930 0x7f75b4121b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:50.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.151+0000 7f75aaffd700 1 -- 172.21.15.26:0/4249832607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75b409d630 msgr2=0x7f75b41210d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:50.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.151+0000 7f75aaffd700 1 --2- 172.21.15.26:0/4249832607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75b409d630 0x7f75b41210d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:50.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.151+0000 7f75aaffd700 1 -- 172.21.15.26:0/4249832607 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a4009550 con 0x7f75b40a0a30 2023-10-01T08:00:50.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.151+0000 7f75b3fff700 1 --2- 172.21.15.26:0/4249832607 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f75b4133930 0x7f75b4121b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:50.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.151+0000 7f75aaffd700 1 --2- 172.21.15.26:0/4249832607 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f75b40a0a30 0x7f75b4121610 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f75b40672b0 tx=0x7f759c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:50.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.151+0000 7f75b0ff9700 1 -- 172.21.15.26:0/4249832607 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759c004240 con 0x7f75b40a0a30 2023-10-01T08:00:50.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.151+0000 7f75b0ff9700 1 -- 172.21.15.26:0/4249832607 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759c01f070 con 0x7f75b40a0a30 2023-10-01T08:00:50.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.151+0000 7f75b9e22700 1 -- 172.21.15.26:0/4249832607 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f759c0094a0 con 0x7f75b40a0a30 2023-10-01T08:00:50.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.151+0000 7f75b0ff9700 1 -- 172.21.15.26:0/4249832607 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759c0045c0 con 0x7f75b40a0a30 2023-10-01T08:00:50.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.152+0000 7f75b9e22700 1 -- 172.21.15.26:0/4249832607 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b4124920 con 0x7f75b40a0a30 2023-10-01T08:00:50.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.153+0000 7f75b9e22700 1 -- 172.21.15.26:0/4249832607 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b40a0470 con 0x7f75b40a0a30 2023-10-01T08:00:50.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.153+0000 7f75b0ff9700 1 -- 172.21.15.26:0/4249832607 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f759c021030 con 0x7f75b40a0a30 2023-10-01T08:00:50.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.153+0000 7f75b0ff9700 1 -- 172.21.15.26:0/4249832607 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f759c040ca0 con 0x7f75b40a0a30 2023-10-01T08:00:50.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.158+0000 7f75b0ff9700 1 -- 172.21.15.26:0/4249832607 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f759c003e00 con 0x7f75b40a0a30 2023-10-01T08:00:50.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.202+0000 7fab5eaf6700 1 Processor -- start 2023-10-01T08:00:50.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.202+0000 7fab5eaf6700 1 -- start start 2023-10-01T08:00:50.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.202+0000 7fab5eaf6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab5809d6f0 0x7fab5809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:50.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.202+0000 7fab5eaf6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fab5809e410 0x7fab58134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:50.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.202+0000 7fab5eaf6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab5809b120 con 0x7fab5809e000 2023-10-01T08:00:50.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.202+0000 7fab5eaf6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab5806b460 con 0x7fab5809e410 2023-10-01T08:00:50.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.202+0000 7fab5eaf6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5809a7e0 con 0x7fab5809d6f0 2023-10-01T08:00:50.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.203+0000 7fab5c892700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab5809d6f0 0x7fab5809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:50.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.203+0000 7fab5d093700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fab5809e410 0x7fab58134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:50.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.203+0000 7fab5c892700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab5809d6f0 0x7fab5809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33170/0 (socket says 172.21.15.26:33170) 2023-10-01T08:00:50.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.203+0000 7fab5c892700 1 -- 172.21.15.26:0/3376448166 learned_addr learned my addr 172.21.15.26:0/3376448166 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:50.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.203+0000 7fab5c892700 1 -- 172.21.15.26:0/3376448166 >> v2:172.21.15.26:3300/0 conn(0x7fab5809e410 msgr2=0x7fab58134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:50.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.203+0000 7fab5c892700 1 --2- 172.21.15.26:0/3376448166 >> v2:172.21.15.26:3300/0 conn(0x7fab5809e410 0x7fab58134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:50.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.203+0000 7fab5c892700 1 -- 172.21.15.26:0/3376448166 >> v1:172.21.15.26:6789/0 conn(0x7fab5809e000 legacy=0x7fab581339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:50.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.203+0000 7fab5c892700 1 -- 172.21.15.26:0/3376448166 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab5809a500 con 0x7fab5809d6f0 2023-10-01T08:00:50.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.203+0000 7fab5c892700 1 --2- 172.21.15.26:0/3376448166 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab5809d6f0 0x7fab5809dac0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fab4c009920 tx=0x7fab4c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9de15afbf4dcea9 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:50.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.203+0000 7fab577fe700 1 -- 172.21.15.26:0/3376448166 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c011830 con 0x7fab5809d6f0 2023-10-01T08:00:50.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.203+0000 7fab577fe700 1 -- 172.21.15.26:0/3376448166 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4c011990 con 0x7fab5809d6f0 2023-10-01T08:00:50.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.203+0000 7fab577fe700 1 -- 172.21.15.26:0/3376448166 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c011d20 con 0x7fab5809d6f0 2023-10-01T08:00:50.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.204+0000 7fab5eaf6700 1 -- 172.21.15.26:0/3376448166 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab5809d6f0 msgr2=0x7fab5809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:50.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.204+0000 7fab5eaf6700 1 --2- 172.21.15.26:0/3376448166 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab5809d6f0 0x7fab5809dac0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fab4c009920 tx=0x7fab4c009c30 comp rx=0 tx=0).stop 2023-10-01T08:00:50.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.204+0000 7fab5eaf6700 1 -- 172.21.15.26:0/3376448166 shutdown_connections 2023-10-01T08:00:50.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.204+0000 7fab5eaf6700 1 --2- 172.21.15.26:0/3376448166 >> v2:172.21.15.26:3300/0 conn(0x7fab5809e410 0x7fab58134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:50.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.204+0000 7fab5eaf6700 1 --2- 172.21.15.26:0/3376448166 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab5809d6f0 0x7fab5809dac0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:50.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.204+0000 7fab5eaf6700 1 -- 172.21.15.26:0/3376448166 >> 172.21.15.26:0/3376448166 conn(0x7fab58066f50 msgr2=0x7fab5809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:50.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.204+0000 7fab5eaf6700 1 -- 172.21.15.26:0/3376448166 shutdown_connections 2023-10-01T08:00:50.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.204+0000 7fab5eaf6700 1 -- 172.21.15.26:0/3376448166 wait complete. 2023-10-01T08:00:50.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.205+0000 7fab5eaf6700 1 Processor -- start 2023-10-01T08:00:50.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.205+0000 7fab5eaf6700 1 -- start start 2023-10-01T08:00:50.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.206+0000 7fab5eaf6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab5809d6f0 0x7fab581a1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:50.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.206+0000 7fab5eaf6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab5809e000 0x7fab581a2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:50.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.206+0000 7fab5eaf6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab5809e410 0x7fab581a25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:50.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.206+0000 7fab5eaf6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab581a4990 con 0x7fab5809d6f0 2023-10-01T08:00:50.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.206+0000 7fab5eaf6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab581a3000 con 0x7fab5809e410 2023-10-01T08:00:50.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.206+0000 7fab5eaf6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab581a53e0 con 0x7fab5809e000 2023-10-01T08:00:50.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.206+0000 7fab57fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab5809e000 0x7fab581a2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:50.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.206+0000 7fab5c892700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab5809d6f0 0x7fab581a1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:50.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.206+0000 7fab57fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab5809e000 0x7fab581a2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44694/0 (socket says 172.21.15.26:44694) 2023-10-01T08:00:50.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.206+0000 7fab5d093700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab5809e410 0x7fab581a25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:50.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.206+0000 7fab57fff700 1 -- 172.21.15.26:0/168455218 learned_addr learned my addr 172.21.15.26:0/168455218 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:50.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.206+0000 7fab5c892700 1 -- 172.21.15.26:0/168455218 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab5809e000 msgr2=0x7fab581a2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:50.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.206+0000 7fab5c892700 1 --2- 172.21.15.26:0/168455218 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab5809e000 0x7fab581a2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:50.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.206+0000 7fab5c892700 1 -- 172.21.15.26:0/168455218 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab5809e410 msgr2=0x7fab581a25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:50.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.206+0000 7fab5c892700 1 --2- 172.21.15.26:0/168455218 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab5809e410 0x7fab581a25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:50.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.207+0000 7fab5c892700 1 -- 172.21.15.26:0/168455218 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4c009550 con 0x7fab5809d6f0 2023-10-01T08:00:50.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.207+0000 7fab5d093700 1 --2- 172.21.15.26:0/168455218 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab5809e410 0x7fab581a25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:50.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.207+0000 7fab5c892700 1 --2- 172.21.15.26:0/168455218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab5809d6f0 0x7fab581a1b50 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fab4c016000 tx=0x7fab4c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:50.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.207+0000 7fab557fa700 1 -- 172.21.15.26:0/168455218 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c004510 con 0x7fab5809d6f0 2023-10-01T08:00:50.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.207+0000 7fab557fa700 1 -- 172.21.15.26:0/168455218 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4c0036a0 con 0x7fab5809d6f0 2023-10-01T08:00:50.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.207+0000 7fab5eaf6700 1 -- 172.21.15.26:0/168455218 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab581a44d0 con 0x7fab5809d6f0 2023-10-01T08:00:50.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.207+0000 7fab557fa700 1 -- 172.21.15.26:0/168455218 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c003a50 con 0x7fab5809d6f0 2023-10-01T08:00:50.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.207+0000 7fab5eaf6700 1 -- 172.21.15.26:0/168455218 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab5809c710 con 0x7fab5809d6f0 2023-10-01T08:00:50.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.208+0000 7fab5eaf6700 1 -- 172.21.15.26:0/168455218 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab58074ea0 con 0x7fab5809d6f0 2023-10-01T08:00:50.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.208+0000 7fab557fa700 1 -- 172.21.15.26:0/168455218 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab4c003bb0 con 0x7fab5809d6f0 2023-10-01T08:00:50.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.209+0000 7fab557fa700 1 -- 172.21.15.26:0/168455218 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fab4c021030 con 0x7fab5809d6f0 2023-10-01T08:00:50.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.214+0000 7fab557fa700 1 -- 172.21.15.26:0/168455218 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab4c01a7b0 con 0x7fab5809d6f0 2023-10-01T08:00:50.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.265+0000 7fb934b7f700 1 -- 172.21.15.26:0/350846593 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb9300a2a20 con 0x7fb9300a0d90 2023-10-01T08:00:50.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.266+0000 7fb91effd700 1 -- 172.21.15.26:0/350846593 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb9300a2a20 con 0x7fb9300a0d90 2023-10-01T08:00:50.266 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:50.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.268+0000 7fb934b7f700 1 -- 172.21.15.26:0/350846593 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb9300a0d90 msgr2=0x7fb930137570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:50.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.268+0000 7fb934b7f700 1 --2- 172.21.15.26:0/350846593 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb9300a0d90 0x7fb930137570 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fb924001eb0 tx=0x7fb92400c800 comp rx=0 tx=0).stop 2023-10-01T08:00:50.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.268+0000 7fb934b7f700 1 -- 172.21.15.26:0/350846593 shutdown_connections 2023-10-01T08:00:50.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.268+0000 7fb934b7f700 1 --2- 172.21.15.26:0/350846593 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb930138cf0 0x7fb930137ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:50.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.268+0000 7fb934b7f700 1 --2- 172.21.15.26:0/350846593 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9300a09c0 0x7fb930137030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:50.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.268+0000 7fb934b7f700 1 --2- 172.21.15.26:0/350846593 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb9300a0d90 0x7fb930137570 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:50.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.268+0000 7fb934b7f700 1 -- 172.21.15.26:0/350846593 >> 172.21.15.26:0/350846593 conn(0x7fb9300a60c0 msgr2=0x7fb9300a3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:50.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.268+0000 7fb934b7f700 1 -- 172.21.15.26:0/350846593 shutdown_connections 2023-10-01T08:00:50.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.268+0000 7fb934b7f700 1 -- 172.21.15.26:0/350846593 wait complete. 2023-10-01T08:00:50.284 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:50.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.383+0000 7f75b9e22700 1 -- 172.21.15.26:0/4249832607 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f75b40747f0 con 0x7f75b40a0a30 2023-10-01T08:00:50.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.384+0000 7f75b0ff9700 1 -- 172.21.15.26:0/4249832607 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f759c015070 con 0x7f75b40a0a30 2023-10-01T08:00:50.385 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:50.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.386+0000 7f75b9e22700 1 -- 172.21.15.26:0/4249832607 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f75b40a0a30 msgr2=0x7f75b4121610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:50.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.386+0000 7f75b9e22700 1 --2- 172.21.15.26:0/4249832607 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f75b40a0a30 0x7f75b4121610 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f75b40672b0 tx=0x7f759c004750 comp rx=0 tx=0).stop 2023-10-01T08:00:50.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.386+0000 7f75b9e22700 1 -- 172.21.15.26:0/4249832607 shutdown_connections 2023-10-01T08:00:50.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.386+0000 7f75b9e22700 1 --2- 172.21.15.26:0/4249832607 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f75b4133930 0x7f75b4121b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:50.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.386+0000 7f75b9e22700 1 --2- 172.21.15.26:0/4249832607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75b409d630 0x7f75b41210d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:50.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.386+0000 7f75b9e22700 1 --2- 172.21.15.26:0/4249832607 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f75b40a0a30 0x7f75b4121610 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:50.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.386+0000 7f75b9e22700 1 -- 172.21.15.26:0/4249832607 >> 172.21.15.26:0/4249832607 conn(0x7f75b40a3050 msgr2=0x7f75b409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:50.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.386+0000 7f75b9e22700 1 -- 172.21.15.26:0/4249832607 shutdown_connections 2023-10-01T08:00:50.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.386+0000 7f75b9e22700 1 -- 172.21.15.26:0/4249832607 wait complete. 2023-10-01T08:00:50.401 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:50.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.419+0000 7fab5eaf6700 1 -- 172.21.15.26:0/168455218 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fab5806c360 con 0x7fab5809d6f0 2023-10-01T08:00:50.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.419+0000 7fab557fa700 1 -- 172.21.15.26:0/168455218 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fab4c015070 con 0x7fab5809d6f0 2023-10-01T08:00:50.420 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:50.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.422+0000 7fab5eaf6700 1 -- 172.21.15.26:0/168455218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab5809d6f0 msgr2=0x7fab581a1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:50.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.422+0000 7fab5eaf6700 1 --2- 172.21.15.26:0/168455218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab5809d6f0 0x7fab581a1b50 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fab4c016000 tx=0x7fab4c004750 comp rx=0 tx=0).stop 2023-10-01T08:00:50.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.422+0000 7fab5eaf6700 1 -- 172.21.15.26:0/168455218 shutdown_connections 2023-10-01T08:00:50.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.422+0000 7fab5eaf6700 1 --2- 172.21.15.26:0/168455218 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab5809e410 0x7fab581a25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:50.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.422+0000 7fab5eaf6700 1 --2- 172.21.15.26:0/168455218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab5809d6f0 0x7fab581a1b50 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:50.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.422+0000 7fab5eaf6700 1 --2- 172.21.15.26:0/168455218 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab5809e000 0x7fab581a2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:50.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.422+0000 7fab5eaf6700 1 -- 172.21.15.26:0/168455218 >> 172.21.15.26:0/168455218 conn(0x7fab58066f50 msgr2=0x7fab581b6ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:50.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.422+0000 7fab5eaf6700 1 -- 172.21.15.26:0/168455218 shutdown_connections 2023-10-01T08:00:50.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:50.422+0000 7fab5eaf6700 1 -- 172.21.15.26:0/168455218 wait complete. 2023-10-01T08:00:50.436 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:50.920 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:51.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.070+0000 7f5870193700 1 Processor -- start 2023-10-01T08:00:51.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.070+0000 7f5870193700 1 -- start start 2023-10-01T08:00:51.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.071+0000 7f5870193700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f586809d6f0 0x7f586809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:51.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.071+0000 7f5870193700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5868134100 0x7f586813bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:51.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.071+0000 7f5870193700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f586809d2f0 con 0x7f586809e000 2023-10-01T08:00:51.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.071+0000 7f5870193700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f586809a810 con 0x7f586809d6f0 2023-10-01T08:00:51.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.071+0000 7f5870193700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f586809a470 con 0x7f5868134100 2023-10-01T08:00:51.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.071+0000 7f586df2f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f586809d6f0 0x7f586809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:51.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.071+0000 7f586df2f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f586809d6f0 0x7f586809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59490/0 (socket says 172.21.15.26:59490) 2023-10-01T08:00:51.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.071+0000 7f586df2f700 1 -- 172.21.15.26:0/1809526230 learned_addr learned my addr 172.21.15.26:0/1809526230 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:51.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.071+0000 7f586e730700 1 --2- 172.21.15.26:0/1809526230 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5868134100 0x7f586813bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:51.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.071+0000 7f586d72e700 1 --1- 172.21.15.26:0/1809526230 >> v1:172.21.15.26:6789/0 conn(0x7f586809e000 0x7f58681339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38872/0 (socket says 172.21.15.26:38872) 2023-10-01T08:00:51.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.071+0000 7f586e730700 1 -- 172.21.15.26:0/1809526230 >> v2:172.21.15.26:3300/0 conn(0x7f586809d6f0 msgr2=0x7f586809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:51.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.071+0000 7f586e730700 1 --2- 172.21.15.26:0/1809526230 >> v2:172.21.15.26:3300/0 conn(0x7f586809d6f0 0x7f586809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:51.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.071+0000 7f586e730700 1 -- 172.21.15.26:0/1809526230 >> v1:172.21.15.26:6789/0 conn(0x7f586809e000 legacy=0x7f58681339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:51.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.071+0000 7f586cf2d700 1 -- 172.21.15.26:0/1809526230 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 180008207 0 0) 0x7f586809d2f0 con 0x7f586809e000 2023-10-01T08:00:51.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.071+0000 7f586e730700 1 -- 172.21.15.26:0/1809526230 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f586809ec40 con 0x7f5868134100 2023-10-01T08:00:51.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.071+0000 7f586df2f700 1 --2- 172.21.15.26:0/1809526230 >> v2:172.21.15.26:3300/0 conn(0x7f586809d6f0 0x7f586809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:51.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.071+0000 7f586e730700 1 --2- 172.21.15.26:0/1809526230 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5868134100 0x7f586813bc50 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f5860009d90 tx=0x7f586000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e3bc7c33482e4ce server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:51.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.072+0000 7f586cf2d700 1 -- 172.21.15.26:0/1809526230 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586000e070 con 0x7f5868134100 2023-10-01T08:00:51.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.072+0000 7f586cf2d700 1 -- 172.21.15.26:0/1809526230 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586000bb20 con 0x7f5868134100 2023-10-01T08:00:51.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.072+0000 7f586cf2d700 1 -- 172.21.15.26:0/1809526230 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5860012430 con 0x7f5868134100 2023-10-01T08:00:51.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.072+0000 7f5870193700 1 -- 172.21.15.26:0/1809526230 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5868134100 msgr2=0x7f586813bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:51.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.072+0000 7f5870193700 1 --2- 172.21.15.26:0/1809526230 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5868134100 0x7f586813bc50 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f5860009d90 tx=0x7f586000b330 comp rx=0 tx=0).stop 2023-10-01T08:00:51.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.072+0000 7f5870193700 1 -- 172.21.15.26:0/1809526230 shutdown_connections 2023-10-01T08:00:51.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.072+0000 7f5870193700 1 --2- 172.21.15.26:0/1809526230 >> v2:172.21.15.26:3300/0 conn(0x7f586809d6f0 0x7f586809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:51.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.072+0000 7f5870193700 1 --2- 172.21.15.26:0/1809526230 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5868134100 0x7f586813bc50 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:51.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.072+0000 7f5870193700 1 -- 172.21.15.26:0/1809526230 >> 172.21.15.26:0/1809526230 conn(0x7f5868066f50 msgr2=0x7f586809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:51.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.072+0000 7f5870193700 1 -- 172.21.15.26:0/1809526230 shutdown_connections 2023-10-01T08:00:51.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.072+0000 7f5870193700 1 -- 172.21.15.26:0/1809526230 wait complete. 2023-10-01T08:00:51.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.074+0000 7f5870193700 1 Processor -- start 2023-10-01T08:00:51.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.074+0000 7f5870193700 1 -- start start 2023-10-01T08:00:51.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.074+0000 7f5870193700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f586809d6f0 0x7f5868122640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:51.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.074+0000 7f5870193700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f586809e000 0x7f5868122b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:51.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.074+0000 7f5870193700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5868134100 0x7f58681230c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:51.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.074+0000 7f5870193700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58681259e0 con 0x7f5868134100 2023-10-01T08:00:51.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.074+0000 7f5870193700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58681331e0 con 0x7f586809d6f0 2023-10-01T08:00:51.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.074+0000 7f5870193700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5868133600 con 0x7f586809e000 2023-10-01T08:00:51.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.074+0000 7f586df2f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f586809d6f0 0x7f5868122640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:51.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.074+0000 7f586df2f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f586809d6f0 0x7f5868122640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33206/0 (socket says 172.21.15.26:33206) 2023-10-01T08:00:51.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.074+0000 7f586d72e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f586809e000 0x7f5868122b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:51.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.074+0000 7f586df2f700 1 -- 172.21.15.26:0/3710540923 learned_addr learned my addr 172.21.15.26:0/3710540923 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:51.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.074+0000 7f586e730700 1 --2- 172.21.15.26:0/3710540923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5868134100 0x7f58681230c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:51.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.075+0000 7f586df2f700 1 -- 172.21.15.26:0/3710540923 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f586809e000 msgr2=0x7f5868122b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:51.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.075+0000 7f586df2f700 1 --2- 172.21.15.26:0/3710540923 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f586809e000 0x7f5868122b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:51.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.075+0000 7f586df2f700 1 -- 172.21.15.26:0/3710540923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5868134100 msgr2=0x7f58681230c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:51.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.075+0000 7f586df2f700 1 --2- 172.21.15.26:0/3710540923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5868134100 0x7f58681230c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:51.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.075+0000 7f586df2f700 1 -- 172.21.15.26:0/3710540923 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5858009550 con 0x7f586809d6f0 2023-10-01T08:00:51.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.075+0000 7f586df2f700 1 --2- 172.21.15.26:0/3710540923 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f586809d6f0 0x7f5868122640 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f585800ebe0 tx=0x7f585800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:51.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.075+0000 7f585e7fc700 1 -- 172.21.15.26:0/3710540923 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585800c850 con 0x7f586809d6f0 2023-10-01T08:00:51.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.075+0000 7f585e7fc700 1 -- 172.21.15.26:0/3710540923 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585800c9b0 con 0x7f586809d6f0 2023-10-01T08:00:51.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.075+0000 7f5870193700 1 -- 172.21.15.26:0/3710540923 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5860009a70 con 0x7f586809d6f0 2023-10-01T08:00:51.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.075+0000 7f585e7fc700 1 -- 172.21.15.26:0/3710540923 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585800cd40 con 0x7f586809d6f0 2023-10-01T08:00:51.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.075+0000 7f5870193700 1 -- 172.21.15.26:0/3710540923 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5868126160 con 0x7f586809d6f0 2023-10-01T08:00:51.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.076+0000 7f585e7fc700 1 -- 172.21.15.26:0/3710540923 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5858013470 con 0x7f586809d6f0 2023-10-01T08:00:51.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.076+0000 7f585e7fc700 1 -- 172.21.15.26:0/3710540923 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f585803fd30 con 0x7f586809d6f0 2023-10-01T08:00:51.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.076+0000 7f5870193700 1 -- 172.21.15.26:0/3710540923 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5868125da0 con 0x7f586809d6f0 2023-10-01T08:00:51.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.081+0000 7f585e7fc700 1 -- 172.21.15.26:0/3710540923 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f585801b3b0 con 0x7f586809d6f0 2023-10-01T08:00:51.285 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:51.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.287+0000 7f5870193700 1 -- 172.21.15.26:0/3710540923 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5868074ea0 con 0x7f586809d6f0 2023-10-01T08:00:51.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.287+0000 7f585e7fc700 1 -- 172.21.15.26:0/3710540923 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5858024350 con 0x7f586809d6f0 2023-10-01T08:00:51.288 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:51.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.289+0000 7f5870193700 1 -- 172.21.15.26:0/3710540923 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f586809d6f0 msgr2=0x7f5868122640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:51.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.289+0000 7f5870193700 1 --2- 172.21.15.26:0/3710540923 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f586809d6f0 0x7f5868122640 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f585800ebe0 tx=0x7f585800eef0 comp rx=0 tx=0).stop 2023-10-01T08:00:51.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.289+0000 7f5870193700 1 -- 172.21.15.26:0/3710540923 shutdown_connections 2023-10-01T08:00:51.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.289+0000 7f5870193700 1 --2- 172.21.15.26:0/3710540923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5868134100 0x7f58681230c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:51.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.289+0000 7f5870193700 1 --2- 172.21.15.26:0/3710540923 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f586809d6f0 0x7f5868122640 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:51.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.289+0000 7f5870193700 1 --2- 172.21.15.26:0/3710540923 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f586809e000 0x7f5868122b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:51.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.289+0000 7f5870193700 1 -- 172.21.15.26:0/3710540923 >> 172.21.15.26:0/3710540923 conn(0x7f5868066f50 msgr2=0x7f58680a2010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:51.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.290+0000 7f5870193700 1 -- 172.21.15.26:0/3710540923 shutdown_connections 2023-10-01T08:00:51.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.290+0000 7f5870193700 1 -- 172.21.15.26:0/3710540923 wait complete. 2023-10-01T08:00:51.305 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:51.401 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:51.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.422+0000 7fd237ad2700 1 Processor -- start 2023-10-01T08:00:51.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.422+0000 7fd237ad2700 1 -- start start 2023-10-01T08:00:51.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.422+0000 7fd237ad2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd230130540 0x7fd230130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:51.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.422+0000 7fd237ad2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd23006fcf0 0x7fd230138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:51.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.422+0000 7fd237ad2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2300716a0 con 0x7fd230130e50 2023-10-01T08:00:51.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.422+0000 7fd237ad2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23009a390 con 0x7fd23006fcf0 2023-10-01T08:00:51.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.422+0000 7fd237ad2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd230071290 con 0x7fd230130540 2023-10-01T08:00:51.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.423+0000 7fd23606f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd23006fcf0 0x7fd230138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:51.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.423+0000 7fd23586e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd230130540 0x7fd230130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:51.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.423+0000 7fd23606f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd23006fcf0 0x7fd230138570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59504/0 (socket says 172.21.15.26:59504) 2023-10-01T08:00:51.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.423+0000 7fd23606f700 1 -- 172.21.15.26:0/3046044683 learned_addr learned my addr 172.21.15.26:0/3046044683 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:51.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.423+0000 7fd23606f700 1 -- 172.21.15.26:0/3046044683 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd230130540 msgr2=0x7fd230130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:51.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.423+0000 7fd23606f700 1 --2- 172.21.15.26:0/3046044683 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd230130540 0x7fd230130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:51.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.423+0000 7fd23606f700 1 -- 172.21.15.26:0/3046044683 >> v1:172.21.15.26:6789/0 conn(0x7fd230130e50 legacy=0x7fd23006f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:51.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.423+0000 7fd23606f700 1 -- 172.21.15.26:0/3046044683 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd230130340 con 0x7fd23006fcf0 2023-10-01T08:00:51.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.423+0000 7fd23586e700 1 --2- 172.21.15.26:0/3046044683 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd230130540 0x7fd230130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:51.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.423+0000 7fd23606f700 1 --2- 172.21.15.26:0/3046044683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd23006fcf0 0x7fd230138570 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fd228009e50 tx=0x7fd22800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcbb3f8f5fa99cc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:51.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.423+0000 7fd23486c700 1 -- 172.21.15.26:0/3046044683 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22800e070 con 0x7fd23006fcf0 2023-10-01T08:00:51.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.423+0000 7fd23486c700 1 -- 172.21.15.26:0/3046044683 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22800b910 con 0x7fd23006fcf0 2023-10-01T08:00:51.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.423+0000 7fd23486c700 1 -- 172.21.15.26:0/3046044683 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22800bcc0 con 0x7fd23006fcf0 2023-10-01T08:00:51.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.424+0000 7fd237ad2700 1 -- 172.21.15.26:0/3046044683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd23006fcf0 msgr2=0x7fd230138570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:51.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.424+0000 7fd237ad2700 1 --2- 172.21.15.26:0/3046044683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd23006fcf0 0x7fd230138570 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fd228009e50 tx=0x7fd22800b330 comp rx=0 tx=0).stop 2023-10-01T08:00:51.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.424+0000 7fd237ad2700 1 -- 172.21.15.26:0/3046044683 shutdown_connections 2023-10-01T08:00:51.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.424+0000 7fd237ad2700 1 --2- 172.21.15.26:0/3046044683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd23006fcf0 0x7fd230138570 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:51.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.424+0000 7fd237ad2700 1 --2- 172.21.15.26:0/3046044683 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd230130540 0x7fd230130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:51.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.424+0000 7fd237ad2700 1 -- 172.21.15.26:0/3046044683 >> 172.21.15.26:0/3046044683 conn(0x7fd2300a2aa0 msgr2=0x7fd2300a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:51.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.424+0000 7fd237ad2700 1 -- 172.21.15.26:0/3046044683 shutdown_connections 2023-10-01T08:00:51.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.424+0000 7fd237ad2700 1 -- 172.21.15.26:0/3046044683 wait complete. 2023-10-01T08:00:51.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.425+0000 7fd237ad2700 1 Processor -- start 2023-10-01T08:00:51.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.425+0000 7fd237ad2700 1 -- start start 2023-10-01T08:00:51.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.426+0000 7fd237ad2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd23006fcf0 0x7fd230118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:51.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.426+0000 7fd237ad2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd230130540 0x7fd230119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:51.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.426+0000 7fd237ad2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd230130e50 0x7fd230119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:51.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.426+0000 7fd237ad2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23011a280 con 0x7fd230130540 2023-10-01T08:00:51.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.426+0000 7fd237ad2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23011b4b0 con 0x7fd23006fcf0 2023-10-01T08:00:51.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.426+0000 7fd237ad2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd23009e520 con 0x7fd230130e50 2023-10-01T08:00:51.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.426+0000 7fd23506d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd230130540 0x7fd230119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:51.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.426+0000 7fd23506d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd230130540 0x7fd230119210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59506/0 (socket says 172.21.15.26:59506) 2023-10-01T08:00:51.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.426+0000 7fd23506d700 1 -- 172.21.15.26:0/62272078 learned_addr learned my addr 172.21.15.26:0/62272078 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:51.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.426+0000 7fd23586e700 1 --2- 172.21.15.26:0/62272078 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd23006fcf0 0x7fd230118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:51.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.426+0000 7fd23606f700 1 --2- 172.21.15.26:0/62272078 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd230130e50 0x7fd230119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:51.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.426+0000 7fd23506d700 1 -- 172.21.15.26:0/62272078 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd230130e50 msgr2=0x7fd230119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:51.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.426+0000 7fd23506d700 1 --2- 172.21.15.26:0/62272078 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd230130e50 0x7fd230119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:51.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.426+0000 7fd23506d700 1 -- 172.21.15.26:0/62272078 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd23006fcf0 msgr2=0x7fd230118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:51.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.426+0000 7fd23506d700 1 --2- 172.21.15.26:0/62272078 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd23006fcf0 0x7fd230118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:51.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.426+0000 7fd23506d700 1 -- 172.21.15.26:0/62272078 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22c0094a0 con 0x7fd230130540 2023-10-01T08:00:51.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.426+0000 7fd23606f700 1 --2- 172.21.15.26:0/62272078 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd230130e50 0x7fd230119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:51.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.427+0000 7fd23506d700 1 --2- 172.21.15.26:0/62272078 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd230130540 0x7fd230119210 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fd22000e940 tx=0x7fd22000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:51.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.427+0000 7fd2267fc700 1 -- 172.21.15.26:0/62272078 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2200052d0 con 0x7fd230130540 2023-10-01T08:00:51.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.427+0000 7fd2267fc700 1 -- 172.21.15.26:0/62272078 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd220005430 con 0x7fd230130540 2023-10-01T08:00:51.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.427+0000 7fd237ad2700 1 -- 172.21.15.26:0/62272078 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd228009b30 con 0x7fd230130540 2023-10-01T08:00:51.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.427+0000 7fd2267fc700 1 -- 172.21.15.26:0/62272078 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2200108e0 con 0x7fd230130540 2023-10-01T08:00:51.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.427+0000 7fd237ad2700 1 -- 172.21.15.26:0/62272078 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2300a1e30 con 0x7fd230130540 2023-10-01T08:00:51.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.428+0000 7fd2267fc700 1 -- 172.21.15.26:0/62272078 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd220010a40 con 0x7fd230130540 2023-10-01T08:00:51.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.428+0000 7fd2267fc700 1 -- 172.21.15.26:0/62272078 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd2200416e0 con 0x7fd230130540 2023-10-01T08:00:51.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.428+0000 7fd237ad2700 1 -- 172.21.15.26:0/62272078 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23011bb50 con 0x7fd230130540 2023-10-01T08:00:51.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.434+0000 7fd2267fc700 1 -- 172.21.15.26:0/62272078 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd23011bb50 con 0x7fd230130540 2023-10-01T08:00:51.437 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:51.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.542+0000 7f2538e9b700 1 Processor -- start 2023-10-01T08:00:51.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.542+0000 7f2538e9b700 1 -- start start 2023-10-01T08:00:51.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.543+0000 7f2538e9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f253406a770 0x7f253406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:51.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.543+0000 7f2538e9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f253406b080 0x7f2534131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:51.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.543+0000 7f2538e9b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f253409ece0 con 0x7f2534131b40 2023-10-01T08:00:51.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.543+0000 7f2538e9b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253409e760 con 0x7f253406b080 2023-10-01T08:00:51.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.543+0000 7f2538e9b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f253409e040 con 0x7f253406a770 2023-10-01T08:00:51.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.543+0000 7f2531d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f253406b080 0x7f2534131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:51.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.543+0000 7f2532d9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2534131b40 0x7f2534138850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38900/0 (socket says 172.21.15.26:38900) 2023-10-01T08:00:51.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.543+0000 7f2532d9d700 1 -- 172.21.15.26:0/936052915 learned_addr learned my addr 172.21.15.26:0/936052915 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:51.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.543+0000 7f253259c700 1 --2- 172.21.15.26:0/936052915 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f253406a770 0x7f253406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:51.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.543+0000 7f253159a700 1 -- 172.21.15.26:0/936052915 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 443775060 0 0) 0x7f253409ece0 con 0x7f2534131b40 2023-10-01T08:00:51.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.543+0000 7f253159a700 1 -- 172.21.15.26:0/936052915 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f251c0035b0 con 0x7f2534131b40 2023-10-01T08:00:51.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.544+0000 7f2531d9b700 1 -- 172.21.15.26:0/936052915 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f253406a770 msgr2=0x7f253406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:51.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.544+0000 7f2531d9b700 1 --2- 172.21.15.26:0/936052915 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f253406a770 0x7f253406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:51.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.544+0000 7f2531d9b700 1 -- 172.21.15.26:0/936052915 >> v1:172.21.15.26:6789/0 conn(0x7f2534131b40 legacy=0x7f2534138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:51.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.544+0000 7f2531d9b700 1 -- 172.21.15.26:0/936052915 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253409f630 con 0x7f253406b080 2023-10-01T08:00:51.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.544+0000 7f2531d9b700 1 --2- 172.21.15.26:0/936052915 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f253406b080 0x7f2534131600 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f2528009870 tx=0x7f2528009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f54dcb2bb782901 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:51.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.544+0000 7f253159a700 1 -- 172.21.15.26:0/936052915 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2528011830 con 0x7f253406b080 2023-10-01T08:00:51.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.544+0000 7f253159a700 1 -- 172.21.15.26:0/936052915 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2528011990 con 0x7f253406b080 2023-10-01T08:00:51.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.544+0000 7f253159a700 1 -- 172.21.15.26:0/936052915 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2528011d20 con 0x7f253406b080 2023-10-01T08:00:51.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.545+0000 7f2538e9b700 1 -- 172.21.15.26:0/936052915 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f253406b080 msgr2=0x7f2534131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:51.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.545+0000 7f2538e9b700 1 --2- 172.21.15.26:0/936052915 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f253406b080 0x7f2534131600 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f2528009870 tx=0x7f2528009b80 comp rx=0 tx=0).stop 2023-10-01T08:00:51.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.545+0000 7f2538e9b700 1 -- 172.21.15.26:0/936052915 shutdown_connections 2023-10-01T08:00:51.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.545+0000 7f2538e9b700 1 --2- 172.21.15.26:0/936052915 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f253406a770 0x7f253406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:51.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.545+0000 7f2538e9b700 1 --2- 172.21.15.26:0/936052915 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f253406b080 0x7f2534131600 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:51.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.545+0000 7f2538e9b700 1 -- 172.21.15.26:0/936052915 >> 172.21.15.26:0/936052915 conn(0x7f2534066f50 msgr2=0x7f253409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:51.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.545+0000 7f2538e9b700 1 -- 172.21.15.26:0/936052915 shutdown_connections 2023-10-01T08:00:51.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.545+0000 7f2538e9b700 1 -- 172.21.15.26:0/936052915 wait complete. 2023-10-01T08:00:51.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.546+0000 7f2538e9b700 1 Processor -- start 2023-10-01T08:00:51.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.547+0000 7f2538e9b700 1 -- start start 2023-10-01T08:00:51.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.547+0000 7f2538e9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f253406a770 0x7f25341c6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:51.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.547+0000 7f2538e9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f253406b080 0x7f25341c7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:51.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.547+0000 7f2538e9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2534131b40 0x7f25341c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:51.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.547+0000 7f2538e9b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253409c240 con 0x7f253406a770 2023-10-01T08:00:51.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.547+0000 7f2538e9b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2534124f50 con 0x7f253406b080 2023-10-01T08:00:51.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.547+0000 7f2538e9b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f253409c010 con 0x7f2534131b40 2023-10-01T08:00:51.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.547+0000 7f2531d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f253406b080 0x7f25341c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:51.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.547+0000 7f253259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f253406a770 0x7f25341c6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:51.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.547+0000 7f2531d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f253406b080 0x7f25341c7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33224/0 (socket says 172.21.15.26:33224) 2023-10-01T08:00:51.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.547+0000 7f2531d9b700 1 -- 172.21.15.26:0/206362915 learned_addr learned my addr 172.21.15.26:0/206362915 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:51.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.547+0000 7f253259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f253406a770 0x7f25341c6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59508/0 (socket says 172.21.15.26:59508) 2023-10-01T08:00:51.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.547+0000 7f2532d9d700 1 --2- 172.21.15.26:0/206362915 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2534131b40 0x7f25341c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:51.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.548+0000 7f2531d9b700 1 -- 172.21.15.26:0/206362915 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2534131b40 msgr2=0x7f25341c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:51.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.548+0000 7f2531d9b700 1 --2- 172.21.15.26:0/206362915 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2534131b40 0x7f25341c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:51.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.548+0000 7f2531d9b700 1 -- 172.21.15.26:0/206362915 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f253406a770 msgr2=0x7f25341c6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:51.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.548+0000 7f2531d9b700 1 --2- 172.21.15.26:0/206362915 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f253406a770 0x7f25341c6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:51.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.548+0000 7f2531d9b700 1 -- 172.21.15.26:0/206362915 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25280094a0 con 0x7f253406b080 2023-10-01T08:00:51.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.548+0000 7f2531d9b700 1 --2- 172.21.15.26:0/206362915 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f253406b080 0x7f25341c7310 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f25280090b0 tx=0x7f2528004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:51.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.548+0000 7f2522ffd700 1 -- 172.21.15.26:0/206362915 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2528004510 con 0x7f253406b080 2023-10-01T08:00:51.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.548+0000 7f2522ffd700 1 -- 172.21.15.26:0/206362915 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252801f070 con 0x7f253406b080 2023-10-01T08:00:51.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.548+0000 7f2538e9b700 1 -- 172.21.15.26:0/206362915 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2534125b70 con 0x7f253406b080 2023-10-01T08:00:51.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.548+0000 7f2522ffd700 1 -- 172.21.15.26:0/206362915 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25280038e0 con 0x7f253406b080 2023-10-01T08:00:51.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.548+0000 7f2538e9b700 1 -- 172.21.15.26:0/206362915 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25341310d0 con 0x7f253406b080 2023-10-01T08:00:51.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.549+0000 7f2538e9b700 1 -- 172.21.15.26:0/206362915 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2534074ea0 con 0x7f253406b080 2023-10-01T08:00:51.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.550+0000 7f2522ffd700 1 -- 172.21.15.26:0/206362915 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2528003a40 con 0x7f253406b080 2023-10-01T08:00:51.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.550+0000 7f2522ffd700 1 -- 172.21.15.26:0/206362915 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2528021070 con 0x7f253406b080 2023-10-01T08:00:51.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.558+0000 7f2522ffd700 1 -- 172.21.15.26:0/206362915 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2528010380 con 0x7f253406b080 2023-10-01T08:00:51.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.580+0000 7f3e60726700 1 Processor -- start 2023-10-01T08:00:51.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.580+0000 7f3e60726700 1 -- start start 2023-10-01T08:00:51.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.581+0000 7f3e60726700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e581337f0 0x7f3e58138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:51.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.581+0000 7f3e60726700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3e58138dc0 0x7f3e5813b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:51.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.581+0000 7f3e60726700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e5806b990 con 0x7f3e58133420 2023-10-01T08:00:51.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.581+0000 7f3e60726700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e5809b0e0 con 0x7f3e58138dc0 2023-10-01T08:00:51.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.581+0000 7f3e60726700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e58133c20 con 0x7f3e581337f0 2023-10-01T08:00:51.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.581+0000 7f3e5dcc1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e581337f0 0x7f3e58138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:51.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.581+0000 7f3e5dcc1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e581337f0 0x7f3e58138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33230/0 (socket says 172.21.15.26:33230) 2023-10-01T08:00:51.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.581+0000 7f3e5dcc1700 1 -- 172.21.15.26:0/146152238 learned_addr learned my addr 172.21.15.26:0/146152238 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:51.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.581+0000 7f3e5ecc3700 1 --2- 172.21.15.26:0/146152238 >> v2:172.21.15.26:3300/0 conn(0x7f3e58138dc0 0x7f3e5813b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:51.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.582+0000 7f3e5dcc1700 1 -- 172.21.15.26:0/146152238 >> v2:172.21.15.26:3300/0 conn(0x7f3e58138dc0 msgr2=0x7f3e5813b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:51.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.582+0000 7f3e5dcc1700 1 --2- 172.21.15.26:0/146152238 >> v2:172.21.15.26:3300/0 conn(0x7f3e58138dc0 0x7f3e5813b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:51.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.582+0000 7f3e5dcc1700 1 -- 172.21.15.26:0/146152238 >> v1:172.21.15.26:6789/0 conn(0x7f3e58133420 legacy=0x7f3e58133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:51.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.582+0000 7f3e5dcc1700 1 -- 172.21.15.26:0/146152238 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e580a0590 con 0x7f3e581337f0 2023-10-01T08:00:51.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.582+0000 7f3e5ecc3700 1 --2- 172.21.15.26:0/146152238 >> v2:172.21.15.26:3300/0 conn(0x7f3e58138dc0 0x7f3e5813b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:51.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.582+0000 7f3e5dcc1700 1 --2- 172.21.15.26:0/146152238 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e581337f0 0x7f3e58138880 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f3e480098f0 tx=0x7f3e48009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc9550d68b8a83d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:51.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.582+0000 7f3e5d4c0700 1 -- 172.21.15.26:0/146152238 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e48011830 con 0x7f3e581337f0 2023-10-01T08:00:51.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.582+0000 7f3e5d4c0700 1 -- 172.21.15.26:0/146152238 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e48011990 con 0x7f3e581337f0 2023-10-01T08:00:51.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.582+0000 7f3e5d4c0700 1 -- 172.21.15.26:0/146152238 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e48011d20 con 0x7f3e581337f0 2023-10-01T08:00:51.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.583+0000 7f3e60726700 1 -- 172.21.15.26:0/146152238 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e581337f0 msgr2=0x7f3e58138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:51.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.583+0000 7f3e60726700 1 --2- 172.21.15.26:0/146152238 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e581337f0 0x7f3e58138880 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f3e480098f0 tx=0x7f3e48009c00 comp rx=0 tx=0).stop 2023-10-01T08:00:51.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.583+0000 7f3e60726700 1 -- 172.21.15.26:0/146152238 shutdown_connections 2023-10-01T08:00:51.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.583+0000 7f3e60726700 1 --2- 172.21.15.26:0/146152238 >> v2:172.21.15.26:3300/0 conn(0x7f3e58138dc0 0x7f3e5813b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:51.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.583+0000 7f3e60726700 1 --2- 172.21.15.26:0/146152238 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e581337f0 0x7f3e58138880 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:51.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.583+0000 7f3e60726700 1 -- 172.21.15.26:0/146152238 >> 172.21.15.26:0/146152238 conn(0x7f3e580a4210 msgr2=0x7f3e580a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:51.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.583+0000 7f3e60726700 1 -- 172.21.15.26:0/146152238 shutdown_connections 2023-10-01T08:00:51.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.583+0000 7f3e60726700 1 -- 172.21.15.26:0/146152238 wait complete. 2023-10-01T08:00:51.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.584+0000 7f3e60726700 1 Processor -- start 2023-10-01T08:00:51.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.584+0000 7f3e60726700 1 -- start start 2023-10-01T08:00:51.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.584+0000 7f3e60726700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e58133420 0x7f3e580709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:51.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.584+0000 7f3e60726700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e581337f0 0x7f3e58070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:51.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.584+0000 7f3e60726700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e58138dc0 0x7f3e58071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:51.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.584+0000 7f3e60726700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5809ca90 con 0x7f3e58138dc0 2023-10-01T08:00:51.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.584+0000 7f3e60726700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5809d640 con 0x7f3e581337f0 2023-10-01T08:00:51.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.584+0000 7f3e60726700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5809c7d0 con 0x7f3e58133420 2023-10-01T08:00:51.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.585+0000 7f3e5ecc3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e58138dc0 0x7f3e58071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:51.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.585+0000 7f3e5e4c2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e58133420 0x7f3e580709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:51.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.585+0000 7f3e5dcc1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e581337f0 0x7f3e58070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:51.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.585+0000 7f3e5ecc3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e58138dc0 0x7f3e58071420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59532/0 (socket says 172.21.15.26:59532) 2023-10-01T08:00:51.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.585+0000 7f3e5ecc3700 1 -- 172.21.15.26:0/3976085310 learned_addr learned my addr 172.21.15.26:0/3976085310 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:51.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.585+0000 7f3e5ecc3700 1 -- 172.21.15.26:0/3976085310 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e58133420 msgr2=0x7f3e580709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:51.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.585+0000 7f3e5ecc3700 1 --2- 172.21.15.26:0/3976085310 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e58133420 0x7f3e580709a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:51.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.585+0000 7f3e5ecc3700 1 -- 172.21.15.26:0/3976085310 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e581337f0 msgr2=0x7f3e58070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:51.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.585+0000 7f3e5ecc3700 1 --2- 172.21.15.26:0/3976085310 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e581337f0 0x7f3e58070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:51.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.585+0000 7f3e5ecc3700 1 -- 172.21.15.26:0/3976085310 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e50009a70 con 0x7f3e58138dc0 2023-10-01T08:00:51.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.585+0000 7f3e5ecc3700 1 --2- 172.21.15.26:0/3976085310 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e58138dc0 0x7f3e58071420 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f3e5000efb0 tx=0x7f3e5000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:51.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.585+0000 7f3e4effd700 1 -- 172.21.15.26:0/3976085310 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5000cc90 con 0x7f3e58138dc0 2023-10-01T08:00:51.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.585+0000 7f3e4effd700 1 -- 172.21.15.26:0/3976085310 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5000f040 con 0x7f3e58138dc0 2023-10-01T08:00:51.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.585+0000 7f3e60726700 1 -- 172.21.15.26:0/3976085310 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e48009550 con 0x7f3e58138dc0 2023-10-01T08:00:51.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.586+0000 7f3e4effd700 1 -- 172.21.15.26:0/3976085310 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e50014480 con 0x7f3e58138dc0 2023-10-01T08:00:51.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.586+0000 7f3e60726700 1 -- 172.21.15.26:0/3976085310 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e580724f0 con 0x7f3e58138dc0 2023-10-01T08:00:51.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.586+0000 7f3e4effd700 1 -- 172.21.15.26:0/3976085310 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3e500145e0 con 0x7f3e58138dc0 2023-10-01T08:00:51.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.587+0000 7f3e4effd700 1 -- 172.21.15.26:0/3976085310 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3e500402e0 con 0x7f3e58138dc0 2023-10-01T08:00:51.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.587+0000 7f3e60726700 1 -- 172.21.15.26:0/3976085310 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e5809cbe0 con 0x7f3e58138dc0 2023-10-01T08:00:51.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.592+0000 7f3e4effd700 1 -- 172.21.15.26:0/3976085310 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3e500076f0 con 0x7f3e58138dc0 2023-10-01T08:00:51.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.645+0000 7fd237ad2700 1 -- 172.21.15.26:0/62272078 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd23011bb50 con 0x7fd230130540 2023-10-01T08:00:51.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.645+0000 7fd2267fc700 1 -- 172.21.15.26:0/62272078 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd220029090 con 0x7fd230130540 2023-10-01T08:00:51.646 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:51.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.648+0000 7fd237ad2700 1 -- 172.21.15.26:0/62272078 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd230130540 msgr2=0x7fd230119210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:51.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.648+0000 7fd237ad2700 1 --2- 172.21.15.26:0/62272078 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd230130540 0x7fd230119210 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fd22000e940 tx=0x7fd22000ec50 comp rx=0 tx=0).stop 2023-10-01T08:00:51.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.648+0000 7fd237ad2700 1 -- 172.21.15.26:0/62272078 shutdown_connections 2023-10-01T08:00:51.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.648+0000 7fd237ad2700 1 --2- 172.21.15.26:0/62272078 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd230130e50 0x7fd230119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:51.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.648+0000 7fd237ad2700 1 --2- 172.21.15.26:0/62272078 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd23006fcf0 0x7fd230118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:51.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.648+0000 7fd237ad2700 1 --2- 172.21.15.26:0/62272078 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd230130540 0x7fd230119210 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:51.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.648+0000 7fd237ad2700 1 -- 172.21.15.26:0/62272078 >> 172.21.15.26:0/62272078 conn(0x7fd2300a2aa0 msgr2=0x7fd23012d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:51.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.648+0000 7fd237ad2700 1 -- 172.21.15.26:0/62272078 shutdown_connections 2023-10-01T08:00:51.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.648+0000 7fd237ad2700 1 -- 172.21.15.26:0/62272078 wait complete. 2023-10-01T08:00:51.663 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:51.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.767+0000 7f2538e9b700 1 -- 172.21.15.26:0/206362915 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f253406c360 con 0x7f253406b080 2023-10-01T08:00:51.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.767+0000 7f2522ffd700 1 -- 172.21.15.26:0/206362915 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2528015020 con 0x7f253406b080 2023-10-01T08:00:51.768 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:51.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.769+0000 7f2538e9b700 1 -- 172.21.15.26:0/206362915 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f253406b080 msgr2=0x7f25341c7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:51.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.769+0000 7f2538e9b700 1 --2- 172.21.15.26:0/206362915 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f253406b080 0x7f25341c7310 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f25280090b0 tx=0x7f2528004750 comp rx=0 tx=0).stop 2023-10-01T08:00:51.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.769+0000 7f2538e9b700 1 -- 172.21.15.26:0/206362915 shutdown_connections 2023-10-01T08:00:51.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.769+0000 7f2538e9b700 1 --2- 172.21.15.26:0/206362915 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2534131b40 0x7f25341c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:51.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.769+0000 7f2538e9b700 1 --2- 172.21.15.26:0/206362915 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f253406a770 0x7f25341c6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:51.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.769+0000 7f2538e9b700 1 --2- 172.21.15.26:0/206362915 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f253406b080 0x7f25341c7310 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:51.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.769+0000 7f2538e9b700 1 -- 172.21.15.26:0/206362915 >> 172.21.15.26:0/206362915 conn(0x7f2534066f50 msgr2=0x7f253406fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:51.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.770+0000 7f2538e9b700 1 -- 172.21.15.26:0/206362915 shutdown_connections 2023-10-01T08:00:51.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.770+0000 7f2538e9b700 1 -- 172.21.15.26:0/206362915 wait complete. 2023-10-01T08:00:51.784 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:51.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.799+0000 7f3e60726700 1 -- 172.21.15.26:0/3976085310 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3e58074ea0 con 0x7f3e58138dc0 2023-10-01T08:00:51.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.800+0000 7f3e4effd700 1 -- 172.21.15.26:0/3976085310 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3e5002c090 con 0x7f3e58138dc0 2023-10-01T08:00:51.801 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:51.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.802+0000 7f3e60726700 1 -- 172.21.15.26:0/3976085310 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e58138dc0 msgr2=0x7f3e58071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:51.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.802+0000 7f3e60726700 1 --2- 172.21.15.26:0/3976085310 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e58138dc0 0x7f3e58071420 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f3e5000efb0 tx=0x7f3e5000c3a0 comp rx=0 tx=0).stop 2023-10-01T08:00:51.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.802+0000 7f3e60726700 1 -- 172.21.15.26:0/3976085310 shutdown_connections 2023-10-01T08:00:51.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.802+0000 7f3e60726700 1 --2- 172.21.15.26:0/3976085310 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e58138dc0 0x7f3e58071420 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:51.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.802+0000 7f3e60726700 1 --2- 172.21.15.26:0/3976085310 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3e58133420 0x7f3e580709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:51.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.802+0000 7f3e60726700 1 --2- 172.21.15.26:0/3976085310 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e581337f0 0x7f3e58070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:51.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.802+0000 7f3e60726700 1 -- 172.21.15.26:0/3976085310 >> 172.21.15.26:0/3976085310 conn(0x7f3e580a4210 msgr2=0x7f3e58131400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:51.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.802+0000 7f3e60726700 1 -- 172.21.15.26:0/3976085310 shutdown_connections 2023-10-01T08:00:51.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:51.802+0000 7f3e60726700 1 -- 172.21.15.26:0/3976085310 wait complete. 2023-10-01T08:00:51.816 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:52.306 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:52.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.450+0000 7f5506210700 1 Processor -- start 2023-10-01T08:00:52.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.450+0000 7f5506210700 1 -- start start 2023-10-01T08:00:52.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.451+0000 7f5506210700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f550009d6f0 0x7f550009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:52.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.451+0000 7f5506210700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f550009e410 0x7f5500134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:52.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.451+0000 7f5506210700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f550009b120 con 0x7f550009e000 2023-10-01T08:00:52.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.451+0000 7f5506210700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f550006b460 con 0x7f550009e410 2023-10-01T08:00:52.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.451+0000 7f5506210700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f550009a7e0 con 0x7f550009d6f0 2023-10-01T08:00:52.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.451+0000 7f54feffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f550009e000 0x7f55001339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38916/0 (socket says 172.21.15.26:38916) 2023-10-01T08:00:52.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.451+0000 7f54feffd700 1 -- 172.21.15.26:0/2672391092 learned_addr learned my addr 172.21.15.26:0/2672391092 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:52.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.451+0000 7f54ff7fe700 1 --2- 172.21.15.26:0/2672391092 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f550009d6f0 0x7f550009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:52.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.451+0000 7f54fffff700 1 --2- 172.21.15.26:0/2672391092 >> v2:172.21.15.26:3300/0 conn(0x7f550009e410 0x7f5500134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:52.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.451+0000 7f54ff7fe700 1 -- 172.21.15.26:0/2672391092 >> v2:172.21.15.26:3300/0 conn(0x7f550009e410 msgr2=0x7f5500134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:52.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.451+0000 7f54ff7fe700 1 --2- 172.21.15.26:0/2672391092 >> v2:172.21.15.26:3300/0 conn(0x7f550009e410 0x7f5500134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:52.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.451+0000 7f54ff7fe700 1 -- 172.21.15.26:0/2672391092 >> v1:172.21.15.26:6789/0 conn(0x7f550009e000 legacy=0x7f55001339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:52.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.451+0000 7f54ff7fe700 1 -- 172.21.15.26:0/2672391092 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550009a500 con 0x7f550009d6f0 2023-10-01T08:00:52.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.451+0000 7f54fffff700 1 --2- 172.21.15.26:0/2672391092 >> v2:172.21.15.26:3300/0 conn(0x7f550009e410 0x7f5500134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:52.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.451+0000 7f54ff7fe700 1 --2- 172.21.15.26:0/2672391092 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f550009d6f0 0x7f550009dac0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f54f0009870 tx=0x7f54f0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7554fbd76771d364 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:52.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.452+0000 7f54fe7fc700 1 -- 172.21.15.26:0/2672391092 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f0011830 con 0x7f550009d6f0 2023-10-01T08:00:52.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.452+0000 7f54fe7fc700 1 -- 172.21.15.26:0/2672391092 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f0011990 con 0x7f550009d6f0 2023-10-01T08:00:52.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.452+0000 7f54fe7fc700 1 -- 172.21.15.26:0/2672391092 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f0011d20 con 0x7f550009d6f0 2023-10-01T08:00:52.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.452+0000 7f5506210700 1 -- 172.21.15.26:0/2672391092 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f550009d6f0 msgr2=0x7f550009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:52.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.452+0000 7f5506210700 1 --2- 172.21.15.26:0/2672391092 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f550009d6f0 0x7f550009dac0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f54f0009870 tx=0x7f54f0009b80 comp rx=0 tx=0).stop 2023-10-01T08:00:52.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.452+0000 7f5506210700 1 -- 172.21.15.26:0/2672391092 shutdown_connections 2023-10-01T08:00:52.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.452+0000 7f5506210700 1 --2- 172.21.15.26:0/2672391092 >> v2:172.21.15.26:3300/0 conn(0x7f550009e410 0x7f5500134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:52.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.452+0000 7f5506210700 1 --2- 172.21.15.26:0/2672391092 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f550009d6f0 0x7f550009dac0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:52.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.452+0000 7f5506210700 1 -- 172.21.15.26:0/2672391092 >> 172.21.15.26:0/2672391092 conn(0x7f5500066f50 msgr2=0x7f550009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:52.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.452+0000 7f5506210700 1 -- 172.21.15.26:0/2672391092 shutdown_connections 2023-10-01T08:00:52.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.452+0000 7f5506210700 1 -- 172.21.15.26:0/2672391092 wait complete. 2023-10-01T08:00:52.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.453+0000 7f5506210700 1 Processor -- start 2023-10-01T08:00:52.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.454+0000 7f5506210700 1 -- start start 2023-10-01T08:00:52.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.454+0000 7f5506210700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f550009d6f0 0x7f55001a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:52.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.454+0000 7f5506210700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f550009e000 0x7f55001a65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:52.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.454+0000 7f5506210700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f550009e410 0x7f55001a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:52.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.454+0000 7f5506210700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55001a9b00 con 0x7f550009e410 2023-10-01T08:00:52.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.454+0000 7f5506210700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55001a81d0 con 0x7f550009e000 2023-10-01T08:00:52.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.454+0000 7f5506210700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55001a9290 con 0x7f550009d6f0 2023-10-01T08:00:52.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.454+0000 7f54feffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f550009e000 0x7f55001a65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:52.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.454+0000 7f54fffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f550009e410 0x7f55001a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:52.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.454+0000 7f54feffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f550009e000 0x7f55001a65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33250/0 (socket says 172.21.15.26:33250) 2023-10-01T08:00:52.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.454+0000 7f54feffd700 1 -- 172.21.15.26:0/1744958090 learned_addr learned my addr 172.21.15.26:0/1744958090 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:52.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.454+0000 7f54ff7fe700 1 --2- 172.21.15.26:0/1744958090 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f550009d6f0 0x7f55001a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:52.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.454+0000 7f54feffd700 1 -- 172.21.15.26:0/1744958090 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f550009d6f0 msgr2=0x7f55001a6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:52.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.454+0000 7f54feffd700 1 --2- 172.21.15.26:0/1744958090 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f550009d6f0 0x7f55001a6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:52.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.454+0000 7f54feffd700 1 -- 172.21.15.26:0/1744958090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f550009e410 msgr2=0x7f55001a6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:52.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.454+0000 7f54feffd700 1 --2- 172.21.15.26:0/1744958090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f550009e410 0x7f55001a6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:52.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.454+0000 7f54feffd700 1 -- 172.21.15.26:0/1744958090 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f8009a70 con 0x7f550009e000 2023-10-01T08:00:52.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.454+0000 7f54fffff700 1 --2- 172.21.15.26:0/1744958090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f550009e410 0x7f55001a6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:52.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.455+0000 7f54feffd700 1 --2- 172.21.15.26:0/1744958090 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f550009e000 0x7f55001a65b0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f54f400c500 tx=0x7f54f400c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:52.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.455+0000 7f54e7fff700 1 -- 172.21.15.26:0/1744958090 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f4005d70 con 0x7f550009e000 2023-10-01T08:00:52.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.455+0000 7f54e7fff700 1 -- 172.21.15.26:0/1744958090 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f40070d0 con 0x7f550009e000 2023-10-01T08:00:52.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.455+0000 7f5506210700 1 -- 172.21.15.26:0/1744958090 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f00094a0 con 0x7f550009e000 2023-10-01T08:00:52.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.455+0000 7f54e7fff700 1 -- 172.21.15.26:0/1744958090 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f4007440 con 0x7f550009e000 2023-10-01T08:00:52.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.455+0000 7f5506210700 1 -- 172.21.15.26:0/1744958090 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f550009c760 con 0x7f550009e000 2023-10-01T08:00:52.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.456+0000 7f54e7fff700 1 -- 172.21.15.26:0/1744958090 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f54f40075a0 con 0x7f550009e000 2023-10-01T08:00:52.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.456+0000 7f5506210700 1 -- 172.21.15.26:0/1744958090 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5500074ea0 con 0x7f550009e000 2023-10-01T08:00:52.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.456+0000 7f54e7fff700 1 -- 172.21.15.26:0/1744958090 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f54f403ea20 con 0x7f550009e000 2023-10-01T08:00:52.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.461+0000 7f54e7fff700 1 -- 172.21.15.26:0/1744958090 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f54f4017030 con 0x7f550009e000 2023-10-01T08:00:52.663 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:52.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.664+0000 7f5506210700 1 -- 172.21.15.26:0/1744958090 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f55001a94c0 con 0x7f550009e000 2023-10-01T08:00:52.666 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:52.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.664+0000 7f54e7fff700 1 -- 172.21.15.26:0/1744958090 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f55001a94c0 con 0x7f550009e000 2023-10-01T08:00:52.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.667+0000 7f5506210700 1 -- 172.21.15.26:0/1744958090 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f550009e000 msgr2=0x7f55001a65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:52.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.667+0000 7f5506210700 1 --2- 172.21.15.26:0/1744958090 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f550009e000 0x7f55001a65b0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f54f400c500 tx=0x7f54f400c810 comp rx=0 tx=0).stop 2023-10-01T08:00:52.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.667+0000 7f5506210700 1 -- 172.21.15.26:0/1744958090 shutdown_connections 2023-10-01T08:00:52.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.667+0000 7f5506210700 1 --2- 172.21.15.26:0/1744958090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f550009e410 0x7f55001a6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:52.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.667+0000 7f5506210700 1 --2- 172.21.15.26:0/1744958090 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f550009d6f0 0x7f55001a6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:52.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.667+0000 7f5506210700 1 --2- 172.21.15.26:0/1744958090 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f550009e000 0x7f55001a65b0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:52.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.667+0000 7f5506210700 1 -- 172.21.15.26:0/1744958090 >> 172.21.15.26:0/1744958090 conn(0x7f5500066f50 msgr2=0x7f55001baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:52.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.667+0000 7f5506210700 1 -- 172.21.15.26:0/1744958090 shutdown_connections 2023-10-01T08:00:52.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.667+0000 7f5506210700 1 -- 172.21.15.26:0/1744958090 wait complete. 2023-10-01T08:00:52.682 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:52.785 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:52.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.800+0000 7ffbc832a700 1 Processor -- start 2023-10-01T08:00:52.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.800+0000 7ffbc832a700 1 -- start start 2023-10-01T08:00:52.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.801+0000 7ffbc832a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffbc009d9f0 0x7ffbc0136530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:52.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.801+0000 7ffbc832a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffbc0136a70 0x7ffbc0138e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:52.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.801+0000 7ffbc832a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbc009e130 con 0x7ffbc01316c0 2023-10-01T08:00:52.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.801+0000 7ffbc832a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc01321a0 con 0x7ffbc009d9f0 2023-10-01T08:00:52.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.801+0000 7ffbc832a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc01312b0 con 0x7ffbc0136a70 2023-10-01T08:00:52.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.801+0000 7ffbc58c5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffbc009d9f0 0x7ffbc0136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:52.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.801+0000 7ffbc68c7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffbc0136a70 0x7ffbc0138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:52.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.801+0000 7ffbc68c7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffbc0136a70 0x7ffbc0138e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44760/0 (socket says 172.21.15.26:44760) 2023-10-01T08:00:52.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.801+0000 7ffbc58c5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffbc009d9f0 0x7ffbc0136530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33262/0 (socket says 172.21.15.26:33262) 2023-10-01T08:00:52.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.801+0000 7ffbc68c7700 1 -- 172.21.15.26:0/3965230157 learned_addr learned my addr 172.21.15.26:0/3965230157 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:52.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.801+0000 7ffbc60c6700 1 --1- 172.21.15.26:0/3965230157 >> v1:172.21.15.26:6789/0 conn(0x7ffbc01316c0 0x7ffbc0131a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38926/0 (socket says 172.21.15.26:38926) 2023-10-01T08:00:52.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.801+0000 7ffbc50c4700 1 -- 172.21.15.26:0/3965230157 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 59822965 0 0) 0x7ffbbc001110 con 0x7ffbc01316c0 2023-10-01T08:00:52.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.801+0000 7ffbc68c7700 1 -- 172.21.15.26:0/3965230157 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffbc009d9f0 msgr2=0x7ffbc0136530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:52.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.801+0000 7ffbc68c7700 1 --2- 172.21.15.26:0/3965230157 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffbc009d9f0 0x7ffbc0136530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:52.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.801+0000 7ffbc68c7700 1 -- 172.21.15.26:0/3965230157 >> v1:172.21.15.26:6789/0 conn(0x7ffbc01316c0 legacy=0x7ffbc0131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:52.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.801+0000 7ffbc68c7700 1 -- 172.21.15.26:0/3965230157 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc009f6e0 con 0x7ffbc0136a70 2023-10-01T08:00:52.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.801+0000 7ffbc58c5700 1 --2- 172.21.15.26:0/3965230157 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffbc009d9f0 0x7ffbc0136530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:52.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.802+0000 7ffbc68c7700 1 --2- 172.21.15.26:0/3965230157 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffbc0136a70 0x7ffbc0138e50 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8009eb0 tx=0x7ffbb800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54a7e05860558084 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:52.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.802+0000 7ffbc50c4700 1 -- 172.21.15.26:0/3965230157 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb800e070 con 0x7ffbc0136a70 2023-10-01T08:00:52.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.802+0000 7ffbc50c4700 1 -- 172.21.15.26:0/3965230157 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb800b8d0 con 0x7ffbc0136a70 2023-10-01T08:00:52.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.802+0000 7ffbc50c4700 1 -- 172.21.15.26:0/3965230157 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb800bc80 con 0x7ffbc0136a70 2023-10-01T08:00:52.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.802+0000 7ffbc832a700 1 -- 172.21.15.26:0/3965230157 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffbc0136a70 msgr2=0x7ffbc0138e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:52.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.802+0000 7ffbc832a700 1 --2- 172.21.15.26:0/3965230157 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffbc0136a70 0x7ffbc0138e50 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8009eb0 tx=0x7ffbb800b330 comp rx=0 tx=0).stop 2023-10-01T08:00:52.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.803+0000 7ffbc832a700 1 -- 172.21.15.26:0/3965230157 shutdown_connections 2023-10-01T08:00:52.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.803+0000 7ffbc832a700 1 --2- 172.21.15.26:0/3965230157 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffbc0136a70 0x7ffbc0138e50 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:52.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.803+0000 7ffbc832a700 1 --2- 172.21.15.26:0/3965230157 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffbc009d9f0 0x7ffbc0136530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:52.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.803+0000 7ffbc832a700 1 -- 172.21.15.26:0/3965230157 >> 172.21.15.26:0/3965230157 conn(0x7ffbc0066f50 msgr2=0x7ffbc009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:52.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.803+0000 7ffbc832a700 1 -- 172.21.15.26:0/3965230157 shutdown_connections 2023-10-01T08:00:52.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.803+0000 7ffbc832a700 1 -- 172.21.15.26:0/3965230157 wait complete. 2023-10-01T08:00:52.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.804+0000 7ffbc832a700 1 Processor -- start 2023-10-01T08:00:52.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.804+0000 7ffbc832a700 1 -- start start 2023-10-01T08:00:52.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.804+0000 7ffbc832a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffbc009d9f0 0x7ffbc0070da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:52.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.804+0000 7ffbc832a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbc01316c0 0x7ffbc00712e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:52.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.804+0000 7ffbc832a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffbc0136a70 0x7ffbc0071820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:52.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.804+0000 7ffbc832a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc0135d80 con 0x7ffbc01316c0 2023-10-01T08:00:52.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.804+0000 7ffbc832a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc006fc20 con 0x7ffbc0136a70 2023-10-01T08:00:52.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.804+0000 7ffbc832a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc006fee0 con 0x7ffbc009d9f0 2023-10-01T08:00:52.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.804+0000 7ffbc58c5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbc01316c0 0x7ffbc00712e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:52.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.804+0000 7ffbc68c7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffbc0136a70 0x7ffbc0071820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:52.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.804+0000 7ffbc58c5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbc01316c0 0x7ffbc00712e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59544/0 (socket says 172.21.15.26:59544) 2023-10-01T08:00:52.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.804+0000 7ffbc58c5700 1 -- 172.21.15.26:0/194629079 learned_addr learned my addr 172.21.15.26:0/194629079 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:52.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.804+0000 7ffbc68c7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffbc0136a70 0x7ffbc0071820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33274/0 (socket says 172.21.15.26:33274) 2023-10-01T08:00:52.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.804+0000 7ffbc60c6700 1 --2- 172.21.15.26:0/194629079 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffbc009d9f0 0x7ffbc0070da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:52.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.805+0000 7ffbc68c7700 1 -- 172.21.15.26:0/194629079 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffbc009d9f0 msgr2=0x7ffbc0070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:52.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.805+0000 7ffbc68c7700 1 --2- 172.21.15.26:0/194629079 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffbc009d9f0 0x7ffbc0070da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:52.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.805+0000 7ffbc68c7700 1 -- 172.21.15.26:0/194629079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbc01316c0 msgr2=0x7ffbc00712e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:52.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.805+0000 7ffbc68c7700 1 --2- 172.21.15.26:0/194629079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbc01316c0 0x7ffbc00712e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:52.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.805+0000 7ffbc68c7700 1 -- 172.21.15.26:0/194629079 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb00094a0 con 0x7ffbc0136a70 2023-10-01T08:00:52.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.805+0000 7ffbc68c7700 1 --2- 172.21.15.26:0/194629079 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffbc0136a70 0x7ffbc0071820 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8015000 tx=0x7ffbb8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:52.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.805+0000 7ffbb6ffd700 1 -- 172.21.15.26:0/194629079 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8004450 con 0x7ffbc0136a70 2023-10-01T08:00:52.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.805+0000 7ffbb6ffd700 1 -- 172.21.15.26:0/194629079 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb80045b0 con 0x7ffbc0136a70 2023-10-01T08:00:52.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.805+0000 7ffbc832a700 1 -- 172.21.15.26:0/194629079 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbb8009b30 con 0x7ffbc0136a70 2023-10-01T08:00:52.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.805+0000 7ffbb6ffd700 1 -- 172.21.15.26:0/194629079 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8004920 con 0x7ffbc0136a70 2023-10-01T08:00:52.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.805+0000 7ffbc832a700 1 -- 172.21.15.26:0/194629079 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc0070950 con 0x7ffbc0136a70 2023-10-01T08:00:52.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.806+0000 7ffbc832a700 1 -- 172.21.15.26:0/194629079 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbc0074ea0 con 0x7ffbc0136a70 2023-10-01T08:00:52.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.806+0000 7ffbb6ffd700 1 -- 172.21.15.26:0/194629079 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffbb801c410 con 0x7ffbc0136a70 2023-10-01T08:00:52.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.807+0000 7ffbb6ffd700 1 -- 172.21.15.26:0/194629079 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ffbb8041210 con 0x7ffbc0136a70 2023-10-01T08:00:52.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.815+0000 7ffbb6ffd700 1 -- 172.21.15.26:0/194629079 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffbb801c6c0 con 0x7ffbc0136a70 2023-10-01T08:00:52.817 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:52.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.928+0000 7f4bfe8ea700 1 Processor -- start 2023-10-01T08:00:52.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.928+0000 7f4bfe8ea700 1 -- start start 2023-10-01T08:00:52.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.928+0000 7f4bfe8ea700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4bf80a0a30 0x7f4bf80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:52.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.928+0000 7f4bfe8ea700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bf8134170 0x7f4bf813bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:52.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.928+0000 7f4bfe8ea700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf809edd0 con 0x7f4bf80a1340 2023-10-01T08:00:52.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.928+0000 7f4bfe8ea700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bf809e1f0 con 0x7f4bf80a0a30 2023-10-01T08:00:52.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.928+0000 7f4bfe8ea700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf809dc50 con 0x7f4bf8134170 2023-10-01T08:00:52.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.929+0000 7f4bf7fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4bf80a0a30 0x7f4bf80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:52.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.929+0000 7f4bfce87700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bf8134170 0x7f4bf813bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:52.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.929+0000 7f4bf7fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4bf80a0a30 0x7f4bf80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59552/0 (socket says 172.21.15.26:59552) 2023-10-01T08:00:52.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.929+0000 7f4bf7fff700 1 -- 172.21.15.26:0/3104207755 learned_addr learned my addr 172.21.15.26:0/3104207755 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:52.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.929+0000 7f4bfce87700 1 -- 172.21.15.26:0/3104207755 >> v2:172.21.15.26:3300/0 conn(0x7f4bf80a0a30 msgr2=0x7f4bf80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:52.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.929+0000 7f4bfce87700 1 --2- 172.21.15.26:0/3104207755 >> v2:172.21.15.26:3300/0 conn(0x7f4bf80a0a30 0x7f4bf80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:52.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.929+0000 7f4bfce87700 1 -- 172.21.15.26:0/3104207755 >> v1:172.21.15.26:6789/0 conn(0x7f4bf80a1340 legacy=0x7f4bf8133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:52.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.929+0000 7f4bfce87700 1 -- 172.21.15.26:0/3104207755 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf80a1fe0 con 0x7f4bf8134170 2023-10-01T08:00:52.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.929+0000 7f4bfce87700 1 --2- 172.21.15.26:0/3104207755 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bf8134170 0x7f4bf813bd30 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0009d90 tx=0x7f4bf000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a196853cbbbe32d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:52.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.929+0000 7f4bf6ffd700 1 -- 172.21.15.26:0/3104207755 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf000e070 con 0x7f4bf8134170 2023-10-01T08:00:52.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.929+0000 7f4bf6ffd700 1 -- 172.21.15.26:0/3104207755 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf000bb20 con 0x7f4bf8134170 2023-10-01T08:00:52.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.929+0000 7f4bf6ffd700 1 -- 172.21.15.26:0/3104207755 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0012430 con 0x7f4bf8134170 2023-10-01T08:00:52.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.930+0000 7f4bfe8ea700 1 -- 172.21.15.26:0/3104207755 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bf8134170 msgr2=0x7f4bf813bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:52.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.930+0000 7f4bfe8ea700 1 --2- 172.21.15.26:0/3104207755 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bf8134170 0x7f4bf813bd30 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0009d90 tx=0x7f4bf000b330 comp rx=0 tx=0).stop 2023-10-01T08:00:52.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.930+0000 7f4bfe8ea700 1 -- 172.21.15.26:0/3104207755 shutdown_connections 2023-10-01T08:00:52.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.930+0000 7f4bfe8ea700 1 --2- 172.21.15.26:0/3104207755 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bf8134170 0x7f4bf813bd30 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:52.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.930+0000 7f4bfe8ea700 1 --2- 172.21.15.26:0/3104207755 >> v2:172.21.15.26:3300/0 conn(0x7f4bf80a0a30 0x7f4bf80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:52.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.930+0000 7f4bfe8ea700 1 -- 172.21.15.26:0/3104207755 >> 172.21.15.26:0/3104207755 conn(0x7f4bf80a6550 msgr2=0x7f4bf80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:52.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.930+0000 7f4bfe8ea700 1 -- 172.21.15.26:0/3104207755 shutdown_connections 2023-10-01T08:00:52.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.930+0000 7f4bfe8ea700 1 -- 172.21.15.26:0/3104207755 wait complete. 2023-10-01T08:00:52.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.931+0000 7f4bfe8ea700 1 Processor -- start 2023-10-01T08:00:52.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.931+0000 7f4bfe8ea700 1 -- start start 2023-10-01T08:00:52.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.932+0000 7f4bfe8ea700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4bf80a0a30 0x7f4bf811e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:52.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.932+0000 7f4bfe8ea700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bf80a1340 0x7f4bf811ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:52.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.932+0000 7f4bfe8ea700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bf8134170 0x7f4bf811f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:52.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.932+0000 7f4bfe8ea700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf8122190 con 0x7f4bf80a1340 2023-10-01T08:00:52.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.932+0000 7f4bfe8ea700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf8120280 con 0x7f4bf80a0a30 2023-10-01T08:00:52.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.932+0000 7f4bfe8ea700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf80a4f50 con 0x7f4bf8134170 2023-10-01T08:00:52.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.932+0000 7f4bf7fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4bf80a0a30 0x7f4bf811e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:52.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.932+0000 7f4bfce87700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bf8134170 0x7f4bf811f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:52.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.932+0000 7f4bf7fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4bf80a0a30 0x7f4bf811e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33278/0 (socket says 172.21.15.26:33278) 2023-10-01T08:00:52.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.932+0000 7f4bfce87700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bf8134170 0x7f4bf811f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44782/0 (socket says 172.21.15.26:44782) 2023-10-01T08:00:52.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.932+0000 7f4bf7fff700 1 -- 172.21.15.26:0/1262416546 learned_addr learned my addr 172.21.15.26:0/1262416546 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:52.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.932+0000 7f4bf77fe700 1 --2- 172.21.15.26:0/1262416546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bf80a1340 0x7f4bf811ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:52.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.933+0000 7f4bfce87700 1 -- 172.21.15.26:0/1262416546 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4bf80a0a30 msgr2=0x7f4bf811e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:52.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.933+0000 7f4bfce87700 1 --2- 172.21.15.26:0/1262416546 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4bf80a0a30 0x7f4bf811e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:52.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.933+0000 7f4bfce87700 1 -- 172.21.15.26:0/1262416546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bf80a1340 msgr2=0x7f4bf811ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:52.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.933+0000 7f4bfce87700 1 --2- 172.21.15.26:0/1262416546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bf80a1340 0x7f4bf811ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:52.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.933+0000 7f4bfce87700 1 -- 172.21.15.26:0/1262416546 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf0009a70 con 0x7f4bf8134170 2023-10-01T08:00:52.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.933+0000 7f4bfce87700 1 --2- 172.21.15.26:0/1262416546 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bf8134170 0x7f4bf811f180 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0016000 tx=0x7f4bf0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:52.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.933+0000 7f4bf4ff9700 1 -- 172.21.15.26:0/1262416546 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0012430 con 0x7f4bf8134170 2023-10-01T08:00:52.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.933+0000 7f4bf4ff9700 1 -- 172.21.15.26:0/1262416546 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf0020070 con 0x7f4bf8134170 2023-10-01T08:00:52.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.933+0000 7f4bf4ff9700 1 -- 172.21.15.26:0/1262416546 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0004280 con 0x7f4bf8134170 2023-10-01T08:00:52.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.933+0000 7f4bfe8ea700 1 -- 172.21.15.26:0/1262416546 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf80a25e0 con 0x7f4bf8134170 2023-10-01T08:00:52.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.933+0000 7f4bfe8ea700 1 -- 172.21.15.26:0/1262416546 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf8121bf0 con 0x7f4bf8134170 2023-10-01T08:00:52.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.934+0000 7f4bf4ff9700 1 -- 172.21.15.26:0/1262416546 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4bf00043e0 con 0x7f4bf8134170 2023-10-01T08:00:52.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.934+0000 7f4bf4ff9700 1 -- 172.21.15.26:0/1262416546 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4bf0022070 con 0x7f4bf8134170 2023-10-01T08:00:52.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.934+0000 7f4bfe8ea700 1 -- 172.21.15.26:0/1262416546 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf8074ea0 con 0x7f4bf8134170 2023-10-01T08:00:52.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.939+0000 7f4bf4ff9700 1 -- 172.21.15.26:0/1262416546 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4bf0012e40 con 0x7f4bf8134170 2023-10-01T08:00:52.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.958+0000 7f179cc3e700 1 Processor -- start 2023-10-01T08:00:52.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.958+0000 7f179cc3e700 1 -- start start 2023-10-01T08:00:52.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.959+0000 7f179cc3e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f179809d6f0 0x7f179809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:52.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.959+0000 7f179cc3e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f179809e000 0x7f17981339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:52.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.959+0000 7f179cc3e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f179809b120 con 0x7f179809e410 2023-10-01T08:00:52.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.959+0000 7f179cc3e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f179806b460 con 0x7f179809e000 2023-10-01T08:00:52.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.959+0000 7f179cc3e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f179809a7e0 con 0x7f179809d6f0 2023-10-01T08:00:52.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.959+0000 7f179659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f179809d6f0 0x7f179809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:52.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.960+0000 7f179659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f179809d6f0 0x7f179809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33288/0 (socket says 172.21.15.26:33288) 2023-10-01T08:00:52.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.960+0000 7f179659c700 1 -- 172.21.15.26:0/1420392531 learned_addr learned my addr 172.21.15.26:0/1420392531 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:52.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.960+0000 7f1795d9b700 1 --2- 172.21.15.26:0/1420392531 >> v2:172.21.15.26:3300/0 conn(0x7f179809e000 0x7f17981339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:52.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.960+0000 7f1795d9b700 1 -- 172.21.15.26:0/1420392531 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f179809d6f0 msgr2=0x7f179809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:52.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.960+0000 7f1795d9b700 1 --2- 172.21.15.26:0/1420392531 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f179809d6f0 0x7f179809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:52.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.960+0000 7f1795d9b700 1 -- 172.21.15.26:0/1420392531 >> v1:172.21.15.26:6789/0 conn(0x7f179809e410 legacy=0x7f1798133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:52.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.960+0000 7f1795d9b700 1 -- 172.21.15.26:0/1420392531 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f179809a500 con 0x7f179809e000 2023-10-01T08:00:52.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.960+0000 7f179659c700 1 --2- 172.21.15.26:0/1420392531 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f179809d6f0 0x7f179809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:52.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.960+0000 7f1795d9b700 1 --2- 172.21.15.26:0/1420392531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f179809e000 0x7f17981339f0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f178c009840 tx=0x7f178c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e986d230fe8b96d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:52.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.960+0000 7f179559a700 1 -- 172.21.15.26:0/1420392531 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c011830 con 0x7f179809e000 2023-10-01T08:00:52.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.960+0000 7f179559a700 1 -- 172.21.15.26:0/1420392531 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178c011990 con 0x7f179809e000 2023-10-01T08:00:52.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.960+0000 7f179559a700 1 -- 172.21.15.26:0/1420392531 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c011d20 con 0x7f179809e000 2023-10-01T08:00:52.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.961+0000 7f179cc3e700 1 -- 172.21.15.26:0/1420392531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f179809e000 msgr2=0x7f17981339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:52.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.961+0000 7f179cc3e700 1 --2- 172.21.15.26:0/1420392531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f179809e000 0x7f17981339f0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f178c009840 tx=0x7f178c009b50 comp rx=0 tx=0).stop 2023-10-01T08:00:52.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.961+0000 7f179cc3e700 1 -- 172.21.15.26:0/1420392531 shutdown_connections 2023-10-01T08:00:52.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.961+0000 7f179cc3e700 1 --2- 172.21.15.26:0/1420392531 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f179809d6f0 0x7f179809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:52.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.961+0000 7f179cc3e700 1 --2- 172.21.15.26:0/1420392531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f179809e000 0x7f17981339f0 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:52.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.961+0000 7f179cc3e700 1 -- 172.21.15.26:0/1420392531 >> 172.21.15.26:0/1420392531 conn(0x7f1798066f50 msgr2=0x7f179809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:52.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.961+0000 7f179cc3e700 1 -- 172.21.15.26:0/1420392531 shutdown_connections 2023-10-01T08:00:52.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.961+0000 7f179cc3e700 1 -- 172.21.15.26:0/1420392531 wait complete. 2023-10-01T08:00:52.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.963+0000 7f179cc3e700 1 Processor -- start 2023-10-01T08:00:52.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.963+0000 7f179cc3e700 1 -- start start 2023-10-01T08:00:52.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.964+0000 7f179cc3e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f179809d6f0 0x7f17981a5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:52.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.964+0000 7f179cc3e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f179809e000 0x7f17981a6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:52.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.964+0000 7f179cc3e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f179809e410 0x7f17981a6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:52.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.964+0000 7f179cc3e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17981a91f0 con 0x7f179809e410 2023-10-01T08:00:52.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.964+0000 7f179cc3e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f179809c710 con 0x7f179809e000 2023-10-01T08:00:52.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.964+0000 7f179cc3e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17980a3160 con 0x7f179809d6f0 2023-10-01T08:00:52.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.964+0000 7f179659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f179809d6f0 0x7f17981a5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:52.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.964+0000 7f1795d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f179809e000 0x7f17981a6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:52.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.964+0000 7f179659c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f179809d6f0 0x7f17981a5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:44792/0 (socket says 172.21.15.26:44792) 2023-10-01T08:00:52.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.964+0000 7f179659c700 1 -- 172.21.15.26:0/3689409509 learned_addr learned my addr 172.21.15.26:0/3689409509 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:52.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.964+0000 7f1795d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f179809e000 0x7f17981a6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33298/0 (socket says 172.21.15.26:33298) 2023-10-01T08:00:52.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.964+0000 7f1796d9d700 1 --2- 172.21.15.26:0/3689409509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f179809e410 0x7f17981a6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:52.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.964+0000 7f1795d9b700 1 -- 172.21.15.26:0/3689409509 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f179809d6f0 msgr2=0x7f17981a5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:52.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.964+0000 7f1795d9b700 1 --2- 172.21.15.26:0/3689409509 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f179809d6f0 0x7f17981a5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:52.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.964+0000 7f1795d9b700 1 -- 172.21.15.26:0/3689409509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f179809e410 msgr2=0x7f17981a6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:52.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.964+0000 7f1795d9b700 1 --2- 172.21.15.26:0/3689409509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f179809e410 0x7f17981a6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:52.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.964+0000 7f1795d9b700 1 -- 172.21.15.26:0/3689409509 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1788009550 con 0x7f179809e000 2023-10-01T08:00:52.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.964+0000 7f179659c700 1 --2- 172.21.15.26:0/3689409509 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f179809d6f0 0x7f17981a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:52.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.964+0000 7f1796d9d700 1 --2- 172.21.15.26:0/3689409509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f179809e410 0x7f17981a6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:52.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.965+0000 7f1795d9b700 1 --2- 172.21.15.26:0/3689409509 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f179809e000 0x7f17981a6510 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f179806e510 tx=0x7f178c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:52.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.965+0000 7f1786ffd700 1 -- 172.21.15.26:0/3689409509 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c0036a0 con 0x7f179809e000 2023-10-01T08:00:52.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.965+0000 7f1786ffd700 1 -- 172.21.15.26:0/3689409509 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178c01f070 con 0x7f179809e000 2023-10-01T08:00:52.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.965+0000 7f1786ffd700 1 -- 172.21.15.26:0/3689409509 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c003a20 con 0x7f179809e000 2023-10-01T08:00:52.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.965+0000 7f179cc3e700 1 -- 172.21.15.26:0/3689409509 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f178c0094a0 con 0x7f179809e000 2023-10-01T08:00:52.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.965+0000 7f179cc3e700 1 -- 172.21.15.26:0/3689409509 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17981a8da0 con 0x7f179809e000 2023-10-01T08:00:52.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.966+0000 7f1786ffd700 1 -- 172.21.15.26:0/3689409509 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f178c003b80 con 0x7f179809e000 2023-10-01T08:00:52.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.966+0000 7f1786ffd700 1 -- 172.21.15.26:0/3689409509 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f178c021070 con 0x7f179809e000 2023-10-01T08:00:52.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.966+0000 7f179cc3e700 1 -- 172.21.15.26:0/3689409509 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1798074ea0 con 0x7f179809e000 2023-10-01T08:00:52.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:52.976+0000 7f1786ffd700 1 -- 172.21.15.26:0/3689409509 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f178c02b020 con 0x7f179809e000 2023-10-01T08:00:53.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.030+0000 7ffbc832a700 1 -- 172.21.15.26:0/194629079 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ffbc009e980 con 0x7ffbc0136a70 2023-10-01T08:00:53.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.030+0000 7ffbb6ffd700 1 -- 172.21.15.26:0/194629079 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffbb802a030 con 0x7ffbc0136a70 2023-10-01T08:00:53.031 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:53.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.033+0000 7ffbc832a700 1 -- 172.21.15.26:0/194629079 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffbc0136a70 msgr2=0x7ffbc0071820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:53.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.033+0000 7ffbc832a700 1 --2- 172.21.15.26:0/194629079 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffbc0136a70 0x7ffbc0071820 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8015000 tx=0x7ffbb8004ad0 comp rx=0 tx=0).stop 2023-10-01T08:00:53.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.033+0000 7ffbc832a700 1 -- 172.21.15.26:0/194629079 shutdown_connections 2023-10-01T08:00:53.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.033+0000 7ffbc832a700 1 --2- 172.21.15.26:0/194629079 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffbc0136a70 0x7ffbc0071820 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:53.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.033+0000 7ffbc832a700 1 --2- 172.21.15.26:0/194629079 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffbc009d9f0 0x7ffbc0070da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:53.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.033+0000 7ffbc832a700 1 --2- 172.21.15.26:0/194629079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbc01316c0 0x7ffbc00712e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:53.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.033+0000 7ffbc832a700 1 -- 172.21.15.26:0/194629079 >> 172.21.15.26:0/194629079 conn(0x7ffbc0066f50 msgr2=0x7ffbc0136e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:53.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.034+0000 7ffbc832a700 1 -- 172.21.15.26:0/194629079 shutdown_connections 2023-10-01T08:00:53.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.034+0000 7ffbc832a700 1 -- 172.21.15.26:0/194629079 wait complete. 2023-10-01T08:00:53.049 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:53.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.155+0000 7f4bfe8ea700 1 -- 172.21.15.26:0/1262416546 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4bf80a28e0 con 0x7f4bf8134170 2023-10-01T08:00:53.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.155+0000 7f4bf4ff9700 1 -- 172.21.15.26:0/1262416546 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4bf002c020 con 0x7f4bf8134170 2023-10-01T08:00:53.156 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:53.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.157+0000 7f4bfe8ea700 1 -- 172.21.15.26:0/1262416546 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bf8134170 msgr2=0x7f4bf811f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:53.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.157+0000 7f4bfe8ea700 1 --2- 172.21.15.26:0/1262416546 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bf8134170 0x7f4bf811f180 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0016000 tx=0x7f4bf0004ad0 comp rx=0 tx=0).stop 2023-10-01T08:00:53.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.158+0000 7f4bfe8ea700 1 -- 172.21.15.26:0/1262416546 shutdown_connections 2023-10-01T08:00:53.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.158+0000 7f4bfe8ea700 1 --2- 172.21.15.26:0/1262416546 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4bf8134170 0x7f4bf811f180 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:53.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.158+0000 7f4bfe8ea700 1 --2- 172.21.15.26:0/1262416546 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4bf80a0a30 0x7f4bf811e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:53.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.158+0000 7f4bfe8ea700 1 --2- 172.21.15.26:0/1262416546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bf80a1340 0x7f4bf811ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:53.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.158+0000 7f4bfe8ea700 1 -- 172.21.15.26:0/1262416546 >> 172.21.15.26:0/1262416546 conn(0x7f4bf80a6550 msgr2=0x7f4bf809ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:53.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.158+0000 7f4bfe8ea700 1 -- 172.21.15.26:0/1262416546 shutdown_connections 2023-10-01T08:00:53.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.158+0000 7f4bfe8ea700 1 -- 172.21.15.26:0/1262416546 wait complete. 2023-10-01T08:00:53.172 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:53.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.184+0000 7f179cc3e700 1 -- 172.21.15.26:0/3689409509 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f179806c360 con 0x7f179809e000 2023-10-01T08:00:53.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.184+0000 7f1786ffd700 1 -- 172.21.15.26:0/3689409509 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f178c034070 con 0x7f179809e000 2023-10-01T08:00:53.185 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:53.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.187+0000 7f179cc3e700 1 -- 172.21.15.26:0/3689409509 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f179809e000 msgr2=0x7f17981a6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:53.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.187+0000 7f179cc3e700 1 --2- 172.21.15.26:0/3689409509 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f179809e000 0x7f17981a6510 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f179806e510 tx=0x7f178c004750 comp rx=0 tx=0).stop 2023-10-01T08:00:53.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.187+0000 7f179cc3e700 1 -- 172.21.15.26:0/3689409509 shutdown_connections 2023-10-01T08:00:53.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.187+0000 7f179cc3e700 1 --2- 172.21.15.26:0/3689409509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f179809e410 0x7f17981a6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:53.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.187+0000 7f179cc3e700 1 --2- 172.21.15.26:0/3689409509 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f179809d6f0 0x7f17981a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:53.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.187+0000 7f179cc3e700 1 --2- 172.21.15.26:0/3689409509 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f179809e000 0x7f17981a6510 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:53.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.187+0000 7f179cc3e700 1 -- 172.21.15.26:0/3689409509 >> 172.21.15.26:0/3689409509 conn(0x7f1798066f50 msgr2=0x7f17981baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:53.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.187+0000 7f179cc3e700 1 -- 172.21.15.26:0/3689409509 shutdown_connections 2023-10-01T08:00:53.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.187+0000 7f179cc3e700 1 -- 172.21.15.26:0/3689409509 wait complete. 2023-10-01T08:00:53.201 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:53.684 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:53.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.829+0000 7f8f635b0700 1 Processor -- start 2023-10-01T08:00:53.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.829+0000 7f8f635b0700 1 -- start start 2023-10-01T08:00:53.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.830+0000 7f8f635b0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f5c09e930 0x7f8f5c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:53.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.830+0000 7f8f635b0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f5c09f240 0x7f8f5c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:53.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.830+0000 7f8f635b0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f5c070940 con 0x7f8f5c09f650 2023-10-01T08:00:53.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.830+0000 7f8f635b0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c06fd60 con 0x7f8f5c09f240 2023-10-01T08:00:53.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.830+0000 7f8f635b0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c06fa80 con 0x7f8f5c09e930 2023-10-01T08:00:53.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.830+0000 7f8f6134c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f5c09e930 0x7f8f5c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:53.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.830+0000 7f8f60b4b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f5c09f240 0x7f8f5c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:53.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.830+0000 7f8f61b4d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8f5c09f650 0x7f8f5c131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39518/0 (socket says 172.21.15.26:39518) 2023-10-01T08:00:53.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.830+0000 7f8f61b4d700 1 -- 172.21.15.26:0/3916767066 learned_addr learned my addr 172.21.15.26:0/3916767066 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:53.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.830+0000 7f8f4ffff700 1 -- 172.21.15.26:0/3916767066 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1974894909 0 0) 0x7f8f5c070940 con 0x7f8f5c09f650 2023-10-01T08:00:53.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.830+0000 7f8f4ffff700 1 -- 172.21.15.26:0/3916767066 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f480035b0 con 0x7f8f5c09f650 2023-10-01T08:00:53.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.830+0000 7f8f60b4b700 1 -- 172.21.15.26:0/3916767066 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f5c09e930 msgr2=0x7f8f5c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:53.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.830+0000 7f8f60b4b700 1 --2- 172.21.15.26:0/3916767066 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f5c09e930 0x7f8f5c09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:53.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.830+0000 7f8f60b4b700 1 -- 172.21.15.26:0/3916767066 >> v1:172.21.15.26:6789/0 conn(0x7f8f5c09f650 legacy=0x7f8f5c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:53.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.830+0000 7f8f60b4b700 1 -- 172.21.15.26:0/3916767066 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5c09fb60 con 0x7f8f5c09f240 2023-10-01T08:00:53.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.830+0000 7f8f6134c700 1 --2- 172.21.15.26:0/3916767066 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f5c09e930 0x7f8f5c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:53.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.830+0000 7f8f60b4b700 1 --2- 172.21.15.26:0/3916767066 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f5c09f240 0x7f8f5c1317f0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f8f50009870 tx=0x7f8f50009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5222731e5edf3d2a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:53.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.831+0000 7f8f4ffff700 1 -- 172.21.15.26:0/3916767066 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f50011830 con 0x7f8f5c09f240 2023-10-01T08:00:53.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.831+0000 7f8f4ffff700 1 -- 172.21.15.26:0/3916767066 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f50011990 con 0x7f8f5c09f240 2023-10-01T08:00:53.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.831+0000 7f8f4ffff700 1 -- 172.21.15.26:0/3916767066 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f50011d20 con 0x7f8f5c09f240 2023-10-01T08:00:53.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.831+0000 7f8f635b0700 1 -- 172.21.15.26:0/3916767066 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f5c09f240 msgr2=0x7f8f5c1317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:53.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.831+0000 7f8f635b0700 1 --2- 172.21.15.26:0/3916767066 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f5c09f240 0x7f8f5c1317f0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f8f50009870 tx=0x7f8f50009b80 comp rx=0 tx=0).stop 2023-10-01T08:00:53.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.831+0000 7f8f635b0700 1 -- 172.21.15.26:0/3916767066 shutdown_connections 2023-10-01T08:00:53.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.831+0000 7f8f635b0700 1 --2- 172.21.15.26:0/3916767066 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f5c09e930 0x7f8f5c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:53.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.831+0000 7f8f635b0700 1 --2- 172.21.15.26:0/3916767066 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f5c09f240 0x7f8f5c1317f0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:53.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.831+0000 7f8f635b0700 1 -- 172.21.15.26:0/3916767066 >> 172.21.15.26:0/3916767066 conn(0x7f8f5c0a4210 msgr2=0x7f8f5c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:53.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.831+0000 7f8f635b0700 1 -- 172.21.15.26:0/3916767066 shutdown_connections 2023-10-01T08:00:53.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.831+0000 7f8f635b0700 1 -- 172.21.15.26:0/3916767066 wait complete. 2023-10-01T08:00:53.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.833+0000 7f8f635b0700 1 Processor -- start 2023-10-01T08:00:53.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.833+0000 7f8f635b0700 1 -- start start 2023-10-01T08:00:53.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.833+0000 7f8f635b0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f5c09e930 0x7f8f5c1a3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:53.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.833+0000 7f8f635b0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f5c09f240 0x7f8f5c1a41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:53.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.833+0000 7f8f635b0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f5c09f650 0x7f8f5c1a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:53.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.833+0000 7f8f635b0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c1a6f90 con 0x7f8f5c09f650 2023-10-01T08:00:53.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.834+0000 7f8f635b0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c1a80e0 con 0x7f8f5c09e930 2023-10-01T08:00:53.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.834+0000 7f8f635b0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c1a6a60 con 0x7f8f5c09f240 2023-10-01T08:00:53.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.834+0000 7f8f6134c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f5c09e930 0x7f8f5c1a3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:53.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.834+0000 7f8f6134c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f5c09e930 0x7f8f5c1a3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42848/0 (socket says 172.21.15.26:42848) 2023-10-01T08:00:53.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.834+0000 7f8f60b4b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f5c09f240 0x7f8f5c1a41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:53.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.834+0000 7f8f6134c700 1 -- 172.21.15.26:0/3293692610 learned_addr learned my addr 172.21.15.26:0/3293692610 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:53.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.834+0000 7f8f61b4d700 1 --2- 172.21.15.26:0/3293692610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f5c09f650 0x7f8f5c1a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:53.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.834+0000 7f8f6134c700 1 -- 172.21.15.26:0/3293692610 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f5c09f240 msgr2=0x7f8f5c1a41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:53.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.834+0000 7f8f6134c700 1 --2- 172.21.15.26:0/3293692610 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f5c09f240 0x7f8f5c1a41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:53.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.834+0000 7f8f6134c700 1 -- 172.21.15.26:0/3293692610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f5c09f650 msgr2=0x7f8f5c1a4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:53.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.834+0000 7f8f6134c700 1 --2- 172.21.15.26:0/3293692610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f5c09f650 0x7f8f5c1a4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:53.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.834+0000 7f8f6134c700 1 -- 172.21.15.26:0/3293692610 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f580094a0 con 0x7f8f5c09e930 2023-10-01T08:00:53.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.834+0000 7f8f60b4b700 1 --2- 172.21.15.26:0/3293692610 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f5c09f240 0x7f8f5c1a41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:53.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.834+0000 7f8f6134c700 1 --2- 172.21.15.26:0/3293692610 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f5c09e930 0x7f8f5c1a3c80 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f8f5800ebe0 tx=0x7f8f5800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:53.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.834+0000 7f8f4dffb700 1 -- 172.21.15.26:0/3293692610 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5800c850 con 0x7f8f5c09e930 2023-10-01T08:00:53.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.834+0000 7f8f4dffb700 1 -- 172.21.15.26:0/3293692610 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5800c9b0 con 0x7f8f5c09e930 2023-10-01T08:00:53.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.834+0000 7f8f4dffb700 1 -- 172.21.15.26:0/3293692610 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5800cd40 con 0x7f8f5c09e930 2023-10-01T08:00:53.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.834+0000 7f8f635b0700 1 -- 172.21.15.26:0/3293692610 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f500094a0 con 0x7f8f5c09e930 2023-10-01T08:00:53.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.835+0000 7f8f635b0700 1 -- 172.21.15.26:0/3293692610 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f5c0a0190 con 0x7f8f5c09e930 2023-10-01T08:00:53.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.836+0000 7f8f635b0700 1 -- 172.21.15.26:0/3293692610 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f5c1a0b30 con 0x7f8f5c09e930 2023-10-01T08:00:53.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.836+0000 7f8f4dffb700 1 -- 172.21.15.26:0/3293692610 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8f58013470 con 0x7f8f5c09e930 2023-10-01T08:00:53.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.836+0000 7f8f4dffb700 1 -- 172.21.15.26:0/3293692610 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8f5803ff60 con 0x7f8f5c09e930 2023-10-01T08:00:53.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:53.840+0000 7f8f4dffb700 1 -- 172.21.15.26:0/3293692610 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8f5806b750 con 0x7f8f5c09e930 2023-10-01T08:00:54.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.047+0000 7f8f635b0700 1 -- 172.21.15.26:0/3293692610 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8f5c071d20 con 0x7f8f5c09e930 2023-10-01T08:00:54.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.047+0000 7f8f4dffb700 1 -- 172.21.15.26:0/3293692610 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8f58021030 con 0x7f8f5c09e930 2023-10-01T08:00:54.048 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:54.050 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:54.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.050+0000 7f8f635b0700 1 -- 172.21.15.26:0/3293692610 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f5c09e930 msgr2=0x7f8f5c1a3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:54.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.050+0000 7f8f635b0700 1 --2- 172.21.15.26:0/3293692610 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f5c09e930 0x7f8f5c1a3c80 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f8f5800ebe0 tx=0x7f8f5800eef0 comp rx=0 tx=0).stop 2023-10-01T08:00:54.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.050+0000 7f8f635b0700 1 -- 172.21.15.26:0/3293692610 shutdown_connections 2023-10-01T08:00:54.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.050+0000 7f8f635b0700 1 --2- 172.21.15.26:0/3293692610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f5c09f650 0x7f8f5c1a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:54.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.050+0000 7f8f635b0700 1 --2- 172.21.15.26:0/3293692610 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8f5c09e930 0x7f8f5c1a3c80 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:54.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.050+0000 7f8f635b0700 1 --2- 172.21.15.26:0/3293692610 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8f5c09f240 0x7f8f5c1a41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:54.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.050+0000 7f8f635b0700 1 -- 172.21.15.26:0/3293692610 >> 172.21.15.26:0/3293692610 conn(0x7f8f5c0a4210 msgr2=0x7f8f5c1b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:54.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.050+0000 7f8f635b0700 1 -- 172.21.15.26:0/3293692610 shutdown_connections 2023-10-01T08:00:54.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.050+0000 7f8f635b0700 1 -- 172.21.15.26:0/3293692610 wait complete. 2023-10-01T08:00:54.066 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:54.173 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:54.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.187+0000 7ffb88044700 1 Processor -- start 2023-10-01T08:00:54.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.187+0000 7ffb88044700 1 -- start start 2023-10-01T08:00:54.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.188+0000 7ffb88044700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb8009d6f0 0x7ffb8009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:54.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.188+0000 7ffb88044700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffb8009e410 0x7ffb80130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:54.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.188+0000 7ffb88044700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8009f130 con 0x7ffb8009e000 2023-10-01T08:00:54.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.188+0000 7ffb88044700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb8009f520 con 0x7ffb8009e410 2023-10-01T08:00:54.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.188+0000 7ffb88044700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8009e930 con 0x7ffb8009d6f0 2023-10-01T08:00:54.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.188+0000 7ffb85de0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb8009d6f0 0x7ffb8009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:54.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.188+0000 7ffb865e1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffb8009e410 0x7ffb80130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:54.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.188+0000 7ffb85de0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb8009d6f0 0x7ffb8009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42850/0 (socket says 172.21.15.26:42850) 2023-10-01T08:00:54.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.188+0000 7ffb85de0700 1 -- 172.21.15.26:0/758864831 learned_addr learned my addr 172.21.15.26:0/758864831 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:54.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.188+0000 7ffb855df700 1 --1- 172.21.15.26:0/758864831 >> v1:172.21.15.26:6789/0 conn(0x7ffb8009e000 0x7ffb80130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39522/0 (socket says 172.21.15.26:39522) 2023-10-01T08:00:54.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.188+0000 7ffb865e1700 1 -- 172.21.15.26:0/758864831 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb8009d6f0 msgr2=0x7ffb8009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:54.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.188+0000 7ffb865e1700 1 --2- 172.21.15.26:0/758864831 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb8009d6f0 0x7ffb8009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:54.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.188+0000 7ffb865e1700 1 -- 172.21.15.26:0/758864831 >> v1:172.21.15.26:6789/0 conn(0x7ffb8009e000 legacy=0x7ffb80130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:54.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.188+0000 7ffb865e1700 1 -- 172.21.15.26:0/758864831 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8009b2d0 con 0x7ffb8009e410 2023-10-01T08:00:54.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.188+0000 7ffb84dde700 1 -- 172.21.15.26:0/758864831 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3892202347 0 0) 0x7ffb8009f130 con 0x7ffb8009e000 2023-10-01T08:00:54.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.189+0000 7ffb865e1700 1 --2- 172.21.15.26:0/758864831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb8009e410 0x7ffb80130d70 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800e350 tx=0x7ffb7800e660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4229c2c6febf6cfd server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:54.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.189+0000 7ffb84dde700 1 -- 172.21.15.26:0/758864831 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb78011680 con 0x7ffb8009e410 2023-10-01T08:00:54.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.189+0000 7ffb84dde700 1 -- 172.21.15.26:0/758864831 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb780117e0 con 0x7ffb8009e410 2023-10-01T08:00:54.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.189+0000 7ffb84dde700 1 -- 172.21.15.26:0/758864831 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb78011b70 con 0x7ffb8009e410 2023-10-01T08:00:54.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.189+0000 7ffb88044700 1 -- 172.21.15.26:0/758864831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb8009e410 msgr2=0x7ffb80130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:54.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.189+0000 7ffb88044700 1 --2- 172.21.15.26:0/758864831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb8009e410 0x7ffb80130d70 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800e350 tx=0x7ffb7800e660 comp rx=0 tx=0).stop 2023-10-01T08:00:54.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.190+0000 7ffb88044700 1 -- 172.21.15.26:0/758864831 shutdown_connections 2023-10-01T08:00:54.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.190+0000 7ffb88044700 1 --2- 172.21.15.26:0/758864831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb8009e410 0x7ffb80130d70 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:54.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.190+0000 7ffb88044700 1 --2- 172.21.15.26:0/758864831 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb8009d6f0 0x7ffb8009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:54.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.190+0000 7ffb88044700 1 -- 172.21.15.26:0/758864831 >> 172.21.15.26:0/758864831 conn(0x7ffb80066f50 msgr2=0x7ffb8009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:54.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.190+0000 7ffb88044700 1 -- 172.21.15.26:0/758864831 shutdown_connections 2023-10-01T08:00:54.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.190+0000 7ffb88044700 1 -- 172.21.15.26:0/758864831 wait complete. 2023-10-01T08:00:54.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.191+0000 7ffb88044700 1 Processor -- start 2023-10-01T08:00:54.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.191+0000 7ffb88044700 1 -- start start 2023-10-01T08:00:54.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.191+0000 7ffb88044700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb8009d6f0 0x7ffb8011dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:54.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.191+0000 7ffb88044700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb8009e000 0x7ffb8011e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:54.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.191+0000 7ffb88044700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffb8009e410 0x7ffb8011e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:54.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.191+0000 7ffb88044700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8011f960 con 0x7ffb8009d6f0 2023-10-01T08:00:54.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.191+0000 7ffb88044700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8011ff10 con 0x7ffb8009e000 2023-10-01T08:00:54.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.191+0000 7ffb88044700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb80120b40 con 0x7ffb8009e410 2023-10-01T08:00:54.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.191+0000 7ffb855df700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb8009e000 0x7ffb8011e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:54.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.192+0000 7ffb855df700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb8009e000 0x7ffb8011e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42858/0 (socket says 172.21.15.26:42858) 2023-10-01T08:00:54.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.192+0000 7ffb855df700 1 -- 172.21.15.26:0/1233044775 learned_addr learned my addr 172.21.15.26:0/1233044775 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:54.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.192+0000 7ffb85de0700 1 --2- 172.21.15.26:0/1233044775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb8009d6f0 0x7ffb8011dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:54.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.192+0000 7ffb865e1700 1 --2- 172.21.15.26:0/1233044775 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffb8009e410 0x7ffb8011e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:54.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.192+0000 7ffb855df700 1 -- 172.21.15.26:0/1233044775 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffb8009e410 msgr2=0x7ffb8011e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:54.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.192+0000 7ffb855df700 1 --2- 172.21.15.26:0/1233044775 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffb8009e410 0x7ffb8011e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:54.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.192+0000 7ffb855df700 1 -- 172.21.15.26:0/1233044775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb8009d6f0 msgr2=0x7ffb8011dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:54.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.192+0000 7ffb855df700 1 --2- 172.21.15.26:0/1233044775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb8009d6f0 0x7ffb8011dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:54.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.192+0000 7ffb855df700 1 -- 172.21.15.26:0/1233044775 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7800bc50 con 0x7ffb8009e000 2023-10-01T08:00:54.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.192+0000 7ffb855df700 1 --2- 172.21.15.26:0/1233044775 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb8009e000 0x7ffb8011e2e0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7ffb7000c520 tx=0x7ffb7000c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:54.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.192+0000 7ffb767fc700 1 -- 172.21.15.26:0/1233044775 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb70004c80 con 0x7ffb8009e000 2023-10-01T08:00:54.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.192+0000 7ffb767fc700 1 -- 172.21.15.26:0/1233044775 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb70004de0 con 0x7ffb8009e000 2023-10-01T08:00:54.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.192+0000 7ffb767fc700 1 -- 172.21.15.26:0/1233044775 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb70007310 con 0x7ffb8009e000 2023-10-01T08:00:54.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.192+0000 7ffb88044700 1 -- 172.21.15.26:0/1233044775 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb80120f90 con 0x7ffb8009e000 2023-10-01T08:00:54.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.192+0000 7ffb88044700 1 -- 172.21.15.26:0/1233044775 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb8009c700 con 0x7ffb8009e000 2023-10-01T08:00:54.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.193+0000 7ffb767fc700 1 -- 172.21.15.26:0/1233044775 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffb70007470 con 0x7ffb8009e000 2023-10-01T08:00:54.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.193+0000 7ffb88044700 1 -- 172.21.15.26:0/1233044775 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb80074ea0 con 0x7ffb8009e000 2023-10-01T08:00:54.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.193+0000 7ffb767fc700 1 -- 172.21.15.26:0/1233044775 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ffb7003f320 con 0x7ffb8009e000 2023-10-01T08:00:54.202 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:54.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.202+0000 7ffb767fc700 1 -- 172.21.15.26:0/1233044775 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb700133c0 con 0x7ffb8009e000 2023-10-01T08:00:54.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.319+0000 7fbe6ea3b700 1 Processor -- start 2023-10-01T08:00:54.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.319+0000 7fbe6ea3b700 1 -- start start 2023-10-01T08:00:54.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.319+0000 7fbe6ea3b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbe680a1510 0x7fbe68138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:54.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.319+0000 7fbe6ea3b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe68139250 0x7fbe6813b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:54.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.319+0000 7fbe6ea3b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe6809edd0 con 0x7fbe680a0a30 2023-10-01T08:00:54.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.319+0000 7fbe6ea3b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe680a18e0 con 0x7fbe680a1510 2023-10-01T08:00:54.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.319+0000 7fbe6ea3b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6809e1f0 con 0x7fbe68139250 2023-10-01T08:00:54.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.319+0000 7fbe5ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbe680a1510 0x7fbe68138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:54.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.320+0000 7fbe5ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbe680a1510 0x7fbe68138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58332/0 (socket says 172.21.15.26:58332) 2023-10-01T08:00:54.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.320+0000 7fbe6cfd8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe68139250 0x7fbe6813b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:54.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.320+0000 7fbe5ffff700 1 -- 172.21.15.26:0/1732927734 learned_addr learned my addr 172.21.15.26:0/1732927734 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:54.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.320+0000 7fbe67fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbe680a0a30 0x7fbe680a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39532/0 (socket says 172.21.15.26:39532) 2023-10-01T08:00:54.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.320+0000 7fbe5ffff700 1 -- 172.21.15.26:0/1732927734 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe68139250 msgr2=0x7fbe6813b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:54.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.320+0000 7fbe5ffff700 1 --2- 172.21.15.26:0/1732927734 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe68139250 0x7fbe6813b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:54.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.320+0000 7fbe5ffff700 1 -- 172.21.15.26:0/1732927734 >> v1:172.21.15.26:6789/0 conn(0x7fbe680a0a30 legacy=0x7fbe680a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:54.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.320+0000 7fbe5ffff700 1 -- 172.21.15.26:0/1732927734 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6809dc50 con 0x7fbe680a1510 2023-10-01T08:00:54.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.320+0000 7fbe6cfd8700 1 --2- 172.21.15.26:0/1732927734 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe68139250 0x7fbe6813b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:54.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.320+0000 7fbe5ffff700 1 --2- 172.21.15.26:0/1732927734 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe680a1510 0x7fbe68138d10 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fbe500098f0 tx=0x7fbe50009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a99e6afc988cddaa server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:54.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.320+0000 7fbe677fe700 1 -- 172.21.15.26:0/1732927734 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe50011830 con 0x7fbe680a1510 2023-10-01T08:00:54.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.321+0000 7fbe677fe700 1 -- 172.21.15.26:0/1732927734 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe50011990 con 0x7fbe680a1510 2023-10-01T08:00:54.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.321+0000 7fbe677fe700 1 -- 172.21.15.26:0/1732927734 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe50011d20 con 0x7fbe680a1510 2023-10-01T08:00:54.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.321+0000 7fbe6ea3b700 1 -- 172.21.15.26:0/1732927734 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe680a1510 msgr2=0x7fbe68138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:54.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.321+0000 7fbe6ea3b700 1 --2- 172.21.15.26:0/1732927734 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe680a1510 0x7fbe68138d10 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fbe500098f0 tx=0x7fbe50009c00 comp rx=0 tx=0).stop 2023-10-01T08:00:54.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.322+0000 7fbe6ea3b700 1 -- 172.21.15.26:0/1732927734 shutdown_connections 2023-10-01T08:00:54.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.322+0000 7fbe6ea3b700 1 --2- 172.21.15.26:0/1732927734 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe68139250 0x7fbe6813b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:54.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.322+0000 7fbe6ea3b700 1 --2- 172.21.15.26:0/1732927734 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe680a1510 0x7fbe68138d10 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:54.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.322+0000 7fbe6ea3b700 1 -- 172.21.15.26:0/1732927734 >> 172.21.15.26:0/1732927734 conn(0x7fbe680a6550 msgr2=0x7fbe680a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:54.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.322+0000 7fbe6ea3b700 1 -- 172.21.15.26:0/1732927734 shutdown_connections 2023-10-01T08:00:54.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.322+0000 7fbe6ea3b700 1 -- 172.21.15.26:0/1732927734 wait complete. 2023-10-01T08:00:54.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.323+0000 7fbe6ea3b700 1 Processor -- start 2023-10-01T08:00:54.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.323+0000 7fbe6ea3b700 1 -- start start 2023-10-01T08:00:54.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.323+0000 7fbe6ea3b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe680a0a30 0x7fbe681c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:54.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.323+0000 7fbe6ea3b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe680a1510 0x7fbe681c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:54.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.323+0000 7fbe6ea3b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe68139250 0x7fbe68121840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:54.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.323+0000 7fbe6ea3b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe681c92f0 con 0x7fbe680a0a30 2023-10-01T08:00:54.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.323+0000 7fbe6ea3b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe68123450 con 0x7fbe68139250 2023-10-01T08:00:54.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.323+0000 7fbe6ea3b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe68123a70 con 0x7fbe680a1510 2023-10-01T08:00:54.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.323+0000 7fbe5ffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe680a1510 0x7fbe681c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:54.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.323+0000 7fbe5ffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe680a1510 0x7fbe681c8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41036/0 (socket says 172.21.15.26:41036) 2023-10-01T08:00:54.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.323+0000 7fbe5ffff700 1 -- 172.21.15.26:0/3033483781 learned_addr learned my addr 172.21.15.26:0/3033483781 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:54.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.323+0000 7fbe67fff700 1 --2- 172.21.15.26:0/3033483781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe680a0a30 0x7fbe681c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:54.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.324+0000 7fbe67fff700 1 -- 172.21.15.26:0/3033483781 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe680a1510 msgr2=0x7fbe681c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:54.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.324+0000 7fbe67fff700 1 --2- 172.21.15.26:0/3033483781 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe680a1510 0x7fbe681c8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:54.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.324+0000 7fbe67fff700 1 -- 172.21.15.26:0/3033483781 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe68139250 msgr2=0x7fbe68121840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:54.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.324+0000 7fbe67fff700 1 --2- 172.21.15.26:0/3033483781 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe68139250 0x7fbe68121840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:54.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.324+0000 7fbe67fff700 1 -- 172.21.15.26:0/3033483781 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe60009a70 con 0x7fbe680a0a30 2023-10-01T08:00:54.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.324+0000 7fbe5ffff700 1 --2- 172.21.15.26:0/3033483781 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe680a1510 0x7fbe681c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:54.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.324+0000 7fbe67fff700 1 --2- 172.21.15.26:0/3033483781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe680a0a30 0x7fbe681c8870 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7fbe5800c480 tx=0x7fbe5800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:54.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.324+0000 7fbe657fa700 1 -- 172.21.15.26:0/3033483781 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe58005cb0 con 0x7fbe680a0a30 2023-10-01T08:00:54.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.324+0000 7fbe657fa700 1 -- 172.21.15.26:0/3033483781 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe58005e10 con 0x7fbe680a0a30 2023-10-01T08:00:54.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.324+0000 7fbe6ea3b700 1 -- 172.21.15.26:0/3033483781 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe50009550 con 0x7fbe680a0a30 2023-10-01T08:00:54.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.324+0000 7fbe657fa700 1 -- 172.21.15.26:0/3033483781 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe580072d0 con 0x7fbe680a0a30 2023-10-01T08:00:54.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.324+0000 7fbe6ea3b700 1 -- 172.21.15.26:0/3033483781 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe680a0220 con 0x7fbe680a0a30 2023-10-01T08:00:54.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.325+0000 7fbe6ea3b700 1 -- 172.21.15.26:0/3033483781 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe681377c0 con 0x7fbe680a0a30 2023-10-01T08:00:54.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.326+0000 7fbe657fa700 1 -- 172.21.15.26:0/3033483781 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbe58007430 con 0x7fbe680a0a30 2023-10-01T08:00:54.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.326+0000 7fbe657fa700 1 -- 172.21.15.26:0/3033483781 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbe5803eeb0 con 0x7fbe680a0a30 2023-10-01T08:00:54.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.330+0000 7fbe657fa700 1 -- 172.21.15.26:0/3033483781 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe5801b3b0 con 0x7fbe680a0a30 2023-10-01T08:00:54.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.345+0000 7f1846619700 1 Processor -- start 2023-10-01T08:00:54.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.345+0000 7f1846619700 1 -- start start 2023-10-01T08:00:54.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.345+0000 7f1846619700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f184009d6f0 0x7f184009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:54.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.345+0000 7f1846619700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f184009e000 0x7f18401339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:54.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.345+0000 7f1846619700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f184009e410 0x7f1840133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:54.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.345+0000 7f1846619700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f184006b460 con 0x7f184009d6f0 2023-10-01T08:00:54.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.345+0000 7f1846619700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184009b120 con 0x7f184009e000 2023-10-01T08:00:54.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.345+0000 7f1846619700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f184009a7e0 con 0x7f184009e410 2023-10-01T08:00:54.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.345+0000 7f183f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f184009e000 0x7f18401339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:54.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.345+0000 7f183ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f184009d6f0 0x7f184009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:54.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.346+0000 7f183f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f184009e000 0x7f18401339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42870/0 (socket says 172.21.15.26:42870) 2023-10-01T08:00:54.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.346+0000 7f183f7fe700 1 -- 172.21.15.26:0/404726290 learned_addr learned my addr 172.21.15.26:0/404726290 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:54.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.346+0000 7f183ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f184009d6f0 0x7f184009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58346/0 (socket says 172.21.15.26:58346) 2023-10-01T08:00:54.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.346+0000 7f1844bb6700 1 --2- 172.21.15.26:0/404726290 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f184009e410 0x7f1840133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:54.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.346+0000 7f183f7fe700 1 -- 172.21.15.26:0/404726290 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f184009e410 msgr2=0x7f1840133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:54.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.346+0000 7f183f7fe700 1 --2- 172.21.15.26:0/404726290 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f184009e410 0x7f1840133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:54.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.346+0000 7f183f7fe700 1 -- 172.21.15.26:0/404726290 >> v2:172.21.15.26:3300/0 conn(0x7f184009d6f0 msgr2=0x7f184009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:54.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.346+0000 7f183f7fe700 1 --2- 172.21.15.26:0/404726290 >> v2:172.21.15.26:3300/0 conn(0x7f184009d6f0 0x7f184009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:54.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.346+0000 7f183f7fe700 1 -- 172.21.15.26:0/404726290 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184009a500 con 0x7f184009e000 2023-10-01T08:00:54.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.346+0000 7f183ffff700 1 --2- 172.21.15.26:0/404726290 >> v2:172.21.15.26:3300/0 conn(0x7f184009d6f0 0x7f184009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:54.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.346+0000 7f183f7fe700 1 --2- 172.21.15.26:0/404726290 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f184009e000 0x7f18401339f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f1834009920 tx=0x7f1834009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40d8f4c8c3faa492 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:54.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.346+0000 7f183effd700 1 -- 172.21.15.26:0/404726290 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1834011830 con 0x7f184009e000 2023-10-01T08:00:54.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.346+0000 7f183effd700 1 -- 172.21.15.26:0/404726290 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1834011990 con 0x7f184009e000 2023-10-01T08:00:54.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.346+0000 7f183effd700 1 -- 172.21.15.26:0/404726290 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1834011d20 con 0x7f184009e000 2023-10-01T08:00:54.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.347+0000 7f1846619700 1 -- 172.21.15.26:0/404726290 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f184009e000 msgr2=0x7f18401339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:54.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.347+0000 7f1846619700 1 --2- 172.21.15.26:0/404726290 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f184009e000 0x7f18401339f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f1834009920 tx=0x7f1834009c30 comp rx=0 tx=0).stop 2023-10-01T08:00:54.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.347+0000 7f1846619700 1 -- 172.21.15.26:0/404726290 shutdown_connections 2023-10-01T08:00:54.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.347+0000 7f1846619700 1 --2- 172.21.15.26:0/404726290 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f184009e410 0x7f1840133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:54.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.347+0000 7f1846619700 1 --2- 172.21.15.26:0/404726290 >> v2:172.21.15.26:3300/0 conn(0x7f184009d6f0 0x7f184009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:54.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.347+0000 7f1846619700 1 --2- 172.21.15.26:0/404726290 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f184009e000 0x7f18401339f0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:54.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.347+0000 7f1846619700 1 -- 172.21.15.26:0/404726290 >> 172.21.15.26:0/404726290 conn(0x7f1840066f50 msgr2=0x7f184009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:54.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.347+0000 7f1846619700 1 -- 172.21.15.26:0/404726290 shutdown_connections 2023-10-01T08:00:54.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.348+0000 7f1846619700 1 -- 172.21.15.26:0/404726290 wait complete. 2023-10-01T08:00:54.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.348+0000 7f1846619700 1 Processor -- start 2023-10-01T08:00:54.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.349+0000 7f1846619700 1 -- start start 2023-10-01T08:00:54.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.349+0000 7f1846619700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f184009d6f0 0x7f18401a5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:54.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.349+0000 7f1846619700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f184009e000 0x7f18401a64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:54.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.349+0000 7f1846619700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f184009e410 0x7f18401a6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:54.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.349+0000 7f1846619700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18401a7470 con 0x7f184009d6f0 2023-10-01T08:00:54.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.349+0000 7f1846619700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18401a9ac0 con 0x7f184009e410 2023-10-01T08:00:54.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.349+0000 7f1846619700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18401a81d0 con 0x7f184009e000 2023-10-01T08:00:54.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.349+0000 7f1844bb6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f184009e410 0x7f18401a6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:54.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.349+0000 7f1844bb6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f184009e410 0x7f18401a6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42872/0 (socket says 172.21.15.26:42872) 2023-10-01T08:00:54.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.349+0000 7f1844bb6700 1 -- 172.21.15.26:0/1366811745 learned_addr learned my addr 172.21.15.26:0/1366811745 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:54.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.349+0000 7f183ffff700 1 --2- 172.21.15.26:0/1366811745 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f184009d6f0 0x7f18401a5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:54.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.350+0000 7f183f7fe700 1 --2- 172.21.15.26:0/1366811745 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f184009e000 0x7f18401a64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:54.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.350+0000 7f1844bb6700 1 -- 172.21.15.26:0/1366811745 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f184009e000 msgr2=0x7f18401a64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:54.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.350+0000 7f1844bb6700 1 --2- 172.21.15.26:0/1366811745 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f184009e000 0x7f18401a64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:54.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.350+0000 7f1844bb6700 1 -- 172.21.15.26:0/1366811745 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f184009d6f0 msgr2=0x7f18401a5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:54.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.350+0000 7f1844bb6700 1 --2- 172.21.15.26:0/1366811745 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f184009d6f0 0x7f18401a5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:54.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.350+0000 7f1844bb6700 1 -- 172.21.15.26:0/1366811745 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18300094a0 con 0x7f184009e410 2023-10-01T08:00:54.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.350+0000 7f1844bb6700 1 --2- 172.21.15.26:0/1366811745 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f184009e410 0x7f18401a6a20 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f183800efc0 tx=0x7f183800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:54.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.350+0000 7f183cff9700 1 -- 172.21.15.26:0/1366811745 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1838009ea0 con 0x7f184009e410 2023-10-01T08:00:54.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.350+0000 7f183cff9700 1 -- 172.21.15.26:0/1366811745 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183800f040 con 0x7f184009e410 2023-10-01T08:00:54.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.350+0000 7f183cff9700 1 -- 172.21.15.26:0/1366811745 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183800ced0 con 0x7f184009e410 2023-10-01T08:00:54.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.350+0000 7f1846619700 1 -- 172.21.15.26:0/1366811745 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1834009550 con 0x7f184009e410 2023-10-01T08:00:54.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.350+0000 7f1846619700 1 -- 172.21.15.26:0/1366811745 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18400a1f20 con 0x7f184009e410 2023-10-01T08:00:54.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.351+0000 7f183cff9700 1 -- 172.21.15.26:0/1366811745 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1838014480 con 0x7f184009e410 2023-10-01T08:00:54.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.352+0000 7f183cff9700 1 -- 172.21.15.26:0/1366811745 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f18380402e0 con 0x7f184009e410 2023-10-01T08:00:54.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.352+0000 7f1846619700 1 -- 172.21.15.26:0/1366811745 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f184009c770 con 0x7f184009e410 2023-10-01T08:00:54.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.357+0000 7f183cff9700 1 -- 172.21.15.26:0/1366811745 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1838018030 con 0x7f184009e410 2023-10-01T08:00:54.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.415+0000 7ffb88044700 1 -- 172.21.15.26:0/1233044775 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ffb801211c0 con 0x7ffb8009e000 2023-10-01T08:00:54.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.415+0000 7ffb767fc700 1 -- 172.21.15.26:0/1233044775 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffb70011360 con 0x7ffb8009e000 2023-10-01T08:00:54.416 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:54.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.417+0000 7ffb88044700 1 -- 172.21.15.26:0/1233044775 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb8009e000 msgr2=0x7ffb8011e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:54.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.417+0000 7ffb88044700 1 --2- 172.21.15.26:0/1233044775 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb8009e000 0x7ffb8011e2e0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7ffb7000c520 tx=0x7ffb7000c830 comp rx=0 tx=0).stop 2023-10-01T08:00:54.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.418+0000 7ffb88044700 1 -- 172.21.15.26:0/1233044775 shutdown_connections 2023-10-01T08:00:54.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.418+0000 7ffb88044700 1 --2- 172.21.15.26:0/1233044775 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffb8009e410 0x7ffb8011e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:54.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.418+0000 7ffb88044700 1 --2- 172.21.15.26:0/1233044775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb8009d6f0 0x7ffb8011dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:54.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.418+0000 7ffb88044700 1 --2- 172.21.15.26:0/1233044775 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffb8009e000 0x7ffb8011e2e0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:54.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.418+0000 7ffb88044700 1 -- 172.21.15.26:0/1233044775 >> 172.21.15.26:0/1233044775 conn(0x7ffb80066f50 msgr2=0x7ffb80070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:54.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.418+0000 7ffb88044700 1 -- 172.21.15.26:0/1233044775 shutdown_connections 2023-10-01T08:00:54.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.418+0000 7ffb88044700 1 -- 172.21.15.26:0/1233044775 wait complete. 2023-10-01T08:00:54.432 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:54.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.588+0000 7fbe6ea3b700 1 -- 172.21.15.26:0/3033483781 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbe68074ea0 con 0x7fbe680a0a30 2023-10-01T08:00:54.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.589+0000 7fbe657fa700 1 -- 172.21.15.26:0/3033483781 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbe580192c0 con 0x7fbe680a0a30 2023-10-01T08:00:54.590 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:54.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.591+0000 7fbe6ea3b700 1 -- 172.21.15.26:0/3033483781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe680a0a30 msgr2=0x7fbe681c8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:54.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.591+0000 7fbe6ea3b700 1 --2- 172.21.15.26:0/3033483781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe680a0a30 0x7fbe681c8870 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7fbe5800c480 tx=0x7fbe5800c790 comp rx=0 tx=0).stop 2023-10-01T08:00:54.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.591+0000 7fbe6ea3b700 1 -- 172.21.15.26:0/3033483781 shutdown_connections 2023-10-01T08:00:54.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.591+0000 7fbe6ea3b700 1 --2- 172.21.15.26:0/3033483781 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe68139250 0x7fbe68121840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:54.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.591+0000 7fbe6ea3b700 1 --2- 172.21.15.26:0/3033483781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe680a0a30 0x7fbe681c8870 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:54.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.591+0000 7fbe6ea3b700 1 --2- 172.21.15.26:0/3033483781 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbe680a1510 0x7fbe681c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:54.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.591+0000 7fbe6ea3b700 1 -- 172.21.15.26:0/3033483781 >> 172.21.15.26:0/3033483781 conn(0x7fbe680a6550 msgr2=0x7fbe68137b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:54.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.591+0000 7fbe6ea3b700 1 -- 172.21.15.26:0/3033483781 shutdown_connections 2023-10-01T08:00:54.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.591+0000 7fbe6ea3b700 1 -- 172.21.15.26:0/3033483781 wait complete. 2023-10-01T08:00:54.605 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:54.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.609+0000 7f1846619700 1 -- 172.21.15.26:0/1366811745 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f18401a9480 con 0x7f184009e410 2023-10-01T08:00:54.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.610+0000 7f183cff9700 1 -- 172.21.15.26:0/1366811745 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1838007920 con 0x7f184009e410 2023-10-01T08:00:54.610 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:54.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.612+0000 7f1846619700 1 -- 172.21.15.26:0/1366811745 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f184009e410 msgr2=0x7f18401a6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:54.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.612+0000 7f1846619700 1 --2- 172.21.15.26:0/1366811745 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f184009e410 0x7f18401a6a20 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f183800efc0 tx=0x7f183800c3a0 comp rx=0 tx=0).stop 2023-10-01T08:00:54.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.612+0000 7f1846619700 1 -- 172.21.15.26:0/1366811745 shutdown_connections 2023-10-01T08:00:54.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.612+0000 7f1846619700 1 --2- 172.21.15.26:0/1366811745 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f184009e410 0x7f18401a6a20 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:54.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.612+0000 7f1846619700 1 --2- 172.21.15.26:0/1366811745 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f184009d6f0 0x7f18401a5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:54.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.612+0000 7f1846619700 1 --2- 172.21.15.26:0/1366811745 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f184009e000 0x7f18401a64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:54.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.612+0000 7f1846619700 1 -- 172.21.15.26:0/1366811745 >> 172.21.15.26:0/1366811745 conn(0x7f1840066f50 msgr2=0x7f18401babc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:54.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.612+0000 7f1846619700 1 -- 172.21.15.26:0/1366811745 shutdown_connections 2023-10-01T08:00:54.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:54.613+0000 7f1846619700 1 -- 172.21.15.26:0/1366811745 wait complete. 2023-10-01T08:00:54.627 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:55.067 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:55.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.214+0000 7faa0eb2b700 1 Processor -- start 2023-10-01T08:00:55.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.214+0000 7faa0eb2b700 1 -- start start 2023-10-01T08:00:55.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.215+0000 7faa0eb2b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa081338a0 0x7faa08133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:55.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.215+0000 7faa0eb2b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa0809de50 0x7faa0809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:55.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.215+0000 7faa0eb2b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7faa0809e760 0x7faa0813a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:55.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.215+0000 7faa0eb2b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa0806fef0 con 0x7faa0809e760 2023-10-01T08:00:55.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.215+0000 7faa0eb2b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0806ef30 con 0x7faa0809de50 2023-10-01T08:00:55.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.215+0000 7faa0eb2b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa081334b0 con 0x7faa081338a0 2023-10-01T08:00:55.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.215+0000 7faa0d0c8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7faa0809e760 0x7faa0813a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:55.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.215+0000 7faa0c8c7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa081338a0 0x7faa08133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:55.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.215+0000 7faa0d0c8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7faa0809e760 0x7faa0813a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58364/0 (socket says 172.21.15.26:58364) 2023-10-01T08:00:55.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.215+0000 7faa0c8c7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa081338a0 0x7faa08133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41058/0 (socket says 172.21.15.26:41058) 2023-10-01T08:00:55.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.215+0000 7faa0d0c8700 1 -- 172.21.15.26:0/3263370982 learned_addr learned my addr 172.21.15.26:0/3263370982 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:55.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.215+0000 7faa07fff700 1 --2- 172.21.15.26:0/3263370982 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa0809de50 0x7faa0809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:55.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.216+0000 7faa0c8c7700 1 -- 172.21.15.26:0/3263370982 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa0809de50 msgr2=0x7faa0809e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:55.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.216+0000 7faa0c8c7700 1 --2- 172.21.15.26:0/3263370982 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa0809de50 0x7faa0809e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:55.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.216+0000 7faa0c8c7700 1 -- 172.21.15.26:0/3263370982 >> v2:172.21.15.26:3300/0 conn(0x7faa0809e760 msgr2=0x7faa0813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:55.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.216+0000 7faa0c8c7700 1 --2- 172.21.15.26:0/3263370982 >> v2:172.21.15.26:3300/0 conn(0x7faa0809e760 0x7faa0813a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:55.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.216+0000 7faa0c8c7700 1 -- 172.21.15.26:0/3263370982 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0806fc30 con 0x7faa081338a0 2023-10-01T08:00:55.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.216+0000 7faa0d0c8700 1 --2- 172.21.15.26:0/3263370982 >> v2:172.21.15.26:3300/0 conn(0x7faa0809e760 0x7faa0813a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:55.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.216+0000 7faa07fff700 1 --2- 172.21.15.26:0/3263370982 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa0809de50 0x7faa0809e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:55.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.216+0000 7faa0c8c7700 1 --2- 172.21.15.26:0/3263370982 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa081338a0 0x7faa08133c70 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0009870 tx=0x7fa9f0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c0cb4241bdc2512 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:55.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.216+0000 7faa077fe700 1 -- 172.21.15.26:0/3263370982 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f0011830 con 0x7faa081338a0 2023-10-01T08:00:55.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.216+0000 7faa077fe700 1 -- 172.21.15.26:0/3263370982 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f0011990 con 0x7faa081338a0 2023-10-01T08:00:55.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.216+0000 7faa077fe700 1 -- 172.21.15.26:0/3263370982 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f0011d20 con 0x7faa081338a0 2023-10-01T08:00:55.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.217+0000 7faa0eb2b700 1 -- 172.21.15.26:0/3263370982 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa081338a0 msgr2=0x7faa08133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:55.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.217+0000 7faa0eb2b700 1 --2- 172.21.15.26:0/3263370982 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa081338a0 0x7faa08133c70 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0009870 tx=0x7fa9f0009b80 comp rx=0 tx=0).stop 2023-10-01T08:00:55.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.217+0000 7faa0eb2b700 1 -- 172.21.15.26:0/3263370982 shutdown_connections 2023-10-01T08:00:55.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.217+0000 7faa0eb2b700 1 --2- 172.21.15.26:0/3263370982 >> v2:172.21.15.26:3300/0 conn(0x7faa0809e760 0x7faa0813a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:55.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.217+0000 7faa0eb2b700 1 --2- 172.21.15.26:0/3263370982 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa081338a0 0x7faa08133c70 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:55.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.217+0000 7faa0eb2b700 1 --2- 172.21.15.26:0/3263370982 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa0809de50 0x7faa0809e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:55.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.217+0000 7faa0eb2b700 1 -- 172.21.15.26:0/3263370982 >> 172.21.15.26:0/3263370982 conn(0x7faa080a2aa0 msgr2=0x7faa080a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:55.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.217+0000 7faa0eb2b700 1 -- 172.21.15.26:0/3263370982 shutdown_connections 2023-10-01T08:00:55.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.217+0000 7faa0eb2b700 1 -- 172.21.15.26:0/3263370982 wait complete. 2023-10-01T08:00:55.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.218+0000 7faa0eb2b700 1 Processor -- start 2023-10-01T08:00:55.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.218+0000 7faa0eb2b700 1 -- start start 2023-10-01T08:00:55.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.218+0000 7faa0eb2b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa0809de50 0x7faa0811d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:55.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.218+0000 7faa0eb2b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa0809e760 0x7faa0811dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:55.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.218+0000 7faa0eb2b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa081338a0 0x7faa0811e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:55.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.218+0000 7faa0eb2b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa08120920 con 0x7faa0809e760 2023-10-01T08:00:55.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.218+0000 7faa0eb2b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0806f640 con 0x7faa081338a0 2023-10-01T08:00:55.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.218+0000 7faa0eb2b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa080a0f90 con 0x7faa0809de50 2023-10-01T08:00:55.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.218+0000 7faa0c8c7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa0809de50 0x7faa0811d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:55.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.218+0000 7faa0d0c8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa081338a0 0x7faa0811e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:55.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.218+0000 7faa07fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa0809e760 0x7faa0811dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:55.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.218+0000 7faa0d0c8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa081338a0 0x7faa0811e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42884/0 (socket says 172.21.15.26:42884) 2023-10-01T08:00:55.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.218+0000 7faa0c8c7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa0809de50 0x7faa0811d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41074/0 (socket says 172.21.15.26:41074) 2023-10-01T08:00:55.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.218+0000 7faa07fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa0809e760 0x7faa0811dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58378/0 (socket says 172.21.15.26:58378) 2023-10-01T08:00:55.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.218+0000 7faa0d0c8700 1 -- 172.21.15.26:0/3736575937 learned_addr learned my addr 172.21.15.26:0/3736575937 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:55.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.219+0000 7faa0d0c8700 1 -- 172.21.15.26:0/3736575937 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa0809de50 msgr2=0x7faa0811d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:55.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.219+0000 7faa0d0c8700 1 --2- 172.21.15.26:0/3736575937 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa0809de50 0x7faa0811d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:55.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.219+0000 7faa0d0c8700 1 -- 172.21.15.26:0/3736575937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa0809e760 msgr2=0x7faa0811dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:55.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.219+0000 7faa0d0c8700 1 --2- 172.21.15.26:0/3736575937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa0809e760 0x7faa0811dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:55.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.219+0000 7faa0d0c8700 1 -- 172.21.15.26:0/3736575937 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f80094a0 con 0x7faa081338a0 2023-10-01T08:00:55.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.219+0000 7faa07fff700 1 --2- 172.21.15.26:0/3736575937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa0809e760 0x7faa0811dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:55.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.219+0000 7faa0d0c8700 1 --2- 172.21.15.26:0/3736575937 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa081338a0 0x7faa0811e250 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7faa0000efc0 tx=0x7faa0000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:55.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.219+0000 7faa057fa700 1 -- 172.21.15.26:0/3736575937 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa00018070 con 0x7faa081338a0 2023-10-01T08:00:55.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.219+0000 7faa057fa700 1 -- 172.21.15.26:0/3736575937 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0000f040 con 0x7faa081338a0 2023-10-01T08:00:55.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.219+0000 7faa057fa700 1 -- 172.21.15.26:0/3736575937 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa00003c20 con 0x7faa081338a0 2023-10-01T08:00:55.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.219+0000 7faa0eb2b700 1 -- 172.21.15.26:0/3736575937 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa00009b30 con 0x7faa081338a0 2023-10-01T08:00:55.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.219+0000 7faa0eb2b700 1 -- 172.21.15.26:0/3736575937 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f00094a0 con 0x7faa081338a0 2023-10-01T08:00:55.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.220+0000 7faa057fa700 1 -- 172.21.15.26:0/3736575937 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faa0000c880 con 0x7faa081338a0 2023-10-01T08:00:55.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.220+0000 7faa057fa700 1 -- 172.21.15.26:0/3736575937 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faa0003f760 con 0x7faa081338a0 2023-10-01T08:00:55.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.220+0000 7faa0eb2b700 1 -- 172.21.15.26:0/3736575937 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa08074ea0 con 0x7faa081338a0 2023-10-01T08:00:55.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.225+0000 7faa057fa700 1 -- 172.21.15.26:0/3736575937 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faa00014480 con 0x7faa081338a0 2023-10-01T08:00:55.433 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:55.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.433+0000 7faa0eb2b700 1 -- 172.21.15.26:0/3736575937 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7faa08120d10 con 0x7faa081338a0 2023-10-01T08:00:55.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.433+0000 7faa057fa700 1 -- 172.21.15.26:0/3736575937 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faa0001cbb0 con 0x7faa081338a0 2023-10-01T08:00:55.434 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:55.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.435+0000 7faa0eb2b700 1 -- 172.21.15.26:0/3736575937 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa081338a0 msgr2=0x7faa0811e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:55.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.435+0000 7faa0eb2b700 1 --2- 172.21.15.26:0/3736575937 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa081338a0 0x7faa0811e250 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7faa0000efc0 tx=0x7faa0000c3a0 comp rx=0 tx=0).stop 2023-10-01T08:00:55.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.435+0000 7faa0eb2b700 1 -- 172.21.15.26:0/3736575937 shutdown_connections 2023-10-01T08:00:55.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.435+0000 7faa0eb2b700 1 --2- 172.21.15.26:0/3736575937 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa081338a0 0x7faa0811e250 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:55.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.435+0000 7faa0eb2b700 1 --2- 172.21.15.26:0/3736575937 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa0809de50 0x7faa0811d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:55.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.435+0000 7faa0eb2b700 1 --2- 172.21.15.26:0/3736575937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa0809e760 0x7faa0811dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:55.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.435+0000 7faa0eb2b700 1 -- 172.21.15.26:0/3736575937 >> 172.21.15.26:0/3736575937 conn(0x7faa080a2aa0 msgr2=0x7faa081b9410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:55.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.435+0000 7faa0eb2b700 1 -- 172.21.15.26:0/3736575937 shutdown_connections 2023-10-01T08:00:55.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.435+0000 7faa0eb2b700 1 -- 172.21.15.26:0/3736575937 wait complete. 2023-10-01T08:00:55.451 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:55.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.571+0000 7f3aee59a700 1 Processor -- start 2023-10-01T08:00:55.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.571+0000 7f3aee59a700 1 -- start start 2023-10-01T08:00:55.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.571+0000 7f3aee59a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3ae806b250 0x7f3ae8136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:55.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.571+0000 7f3aee59a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ae8136d80 0x7f3ae8139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:55.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.571+0000 7f3aee59a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ae809ece0 con 0x7f3ae806a770 2023-10-01T08:00:55.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.571+0000 7f3aee59a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ae809e760 con 0x7f3ae806b250 2023-10-01T08:00:55.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.571+0000 7f3aee59a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae809e040 con 0x7f3ae8136d80 2023-10-01T08:00:55.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.571+0000 7f3aecb37700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ae8136d80 0x7f3ae8139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:55.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.571+0000 7f3ae77fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3ae806b250 0x7f3ae8136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:55.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.571+0000 7f3aecb37700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ae8136d80 0x7f3ae8139160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42886/0 (socket says 172.21.15.26:42886) 2023-10-01T08:00:55.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.571+0000 7f3ae77fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3ae806b250 0x7f3ae8136840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58386/0 (socket says 172.21.15.26:58386) 2023-10-01T08:00:55.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.571+0000 7f3aecb37700 1 -- 172.21.15.26:0/3726213843 learned_addr learned my addr 172.21.15.26:0/3726213843 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:55.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.572+0000 7f3ae77fe700 1 -- 172.21.15.26:0/3726213843 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ae8136d80 msgr2=0x7f3ae8139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:55.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.572+0000 7f3ae77fe700 1 --2- 172.21.15.26:0/3726213843 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ae8136d80 0x7f3ae8139160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:55.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.572+0000 7f3ae77fe700 1 -- 172.21.15.26:0/3726213843 >> v1:172.21.15.26:6789/0 conn(0x7f3ae806a770 legacy=0x7f3ae806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:55.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.572+0000 7f3ae6ffd700 1 -- 172.21.15.26:0/3726213843 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 297493789 0 0) 0x7f3ae809ece0 con 0x7f3ae806a770 2023-10-01T08:00:55.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.572+0000 7f3ae77fe700 1 -- 172.21.15.26:0/3726213843 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae809f630 con 0x7f3ae806b250 2023-10-01T08:00:55.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.572+0000 7f3aecb37700 1 --2- 172.21.15.26:0/3726213843 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ae8136d80 0x7f3ae8139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:55.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.572+0000 7f3ae77fe700 1 --2- 172.21.15.26:0/3726213843 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ae806b250 0x7f3ae8136840 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f3adc009840 tx=0x7f3adc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3925d342e034201 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:55.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.572+0000 7f3ae6ffd700 1 -- 172.21.15.26:0/3726213843 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3adc011830 con 0x7f3ae806b250 2023-10-01T08:00:55.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.572+0000 7f3ae6ffd700 1 -- 172.21.15.26:0/3726213843 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3adc011990 con 0x7f3ae806b250 2023-10-01T08:00:55.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.572+0000 7f3ae6ffd700 1 -- 172.21.15.26:0/3726213843 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3adc011d20 con 0x7f3ae806b250 2023-10-01T08:00:55.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.573+0000 7f3aee59a700 1 -- 172.21.15.26:0/3726213843 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ae806b250 msgr2=0x7f3ae8136840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:55.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.573+0000 7f3aee59a700 1 --2- 172.21.15.26:0/3726213843 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ae806b250 0x7f3ae8136840 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f3adc009840 tx=0x7f3adc009b50 comp rx=0 tx=0).stop 2023-10-01T08:00:55.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.573+0000 7f3aee59a700 1 -- 172.21.15.26:0/3726213843 shutdown_connections 2023-10-01T08:00:55.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.573+0000 7f3aee59a700 1 --2- 172.21.15.26:0/3726213843 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ae8136d80 0x7f3ae8139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:55.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.573+0000 7f3aee59a700 1 --2- 172.21.15.26:0/3726213843 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ae806b250 0x7f3ae8136840 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:55.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.573+0000 7f3aee59a700 1 -- 172.21.15.26:0/3726213843 >> 172.21.15.26:0/3726213843 conn(0x7f3ae8066f50 msgr2=0x7f3ae809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:55.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.573+0000 7f3aee59a700 1 -- 172.21.15.26:0/3726213843 shutdown_connections 2023-10-01T08:00:55.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.573+0000 7f3aee59a700 1 -- 172.21.15.26:0/3726213843 wait complete. 2023-10-01T08:00:55.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.574+0000 7f3aee59a700 1 Processor -- start 2023-10-01T08:00:55.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.574+0000 7f3aee59a700 1 -- start start 2023-10-01T08:00:55.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.575+0000 7f3aee59a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ae806a770 0x7f3ae81c6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:55.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.575+0000 7f3aee59a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ae806b250 0x7f3ae81c6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:55.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.575+0000 7f3aee59a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ae8136d80 0x7f3ae811c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:55.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.575+0000 7f3aee59a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae811fd00 con 0x7f3ae806b250 2023-10-01T08:00:55.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.575+0000 7f3aee59a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae811f670 con 0x7f3ae806a770 2023-10-01T08:00:55.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.575+0000 7f3aee59a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae811e010 con 0x7f3ae8136d80 2023-10-01T08:00:55.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.575+0000 7f3ae7fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ae806a770 0x7f3ae81c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:55.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.575+0000 7f3ae77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ae806b250 0x7f3ae81c6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:55.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.575+0000 7f3ae7fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ae806a770 0x7f3ae81c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42898/0 (socket says 172.21.15.26:42898) 2023-10-01T08:00:55.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.575+0000 7f3ae7fff700 1 -- 172.21.15.26:0/157900458 learned_addr learned my addr 172.21.15.26:0/157900458 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:55.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.575+0000 7f3aecb37700 1 --2- 172.21.15.26:0/157900458 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ae8136d80 0x7f3ae811c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:55.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.576+0000 7f3ae7fff700 1 -- 172.21.15.26:0/157900458 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ae8136d80 msgr2=0x7f3ae811c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:55.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.576+0000 7f3ae7fff700 1 --2- 172.21.15.26:0/157900458 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ae8136d80 0x7f3ae811c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:55.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.576+0000 7f3ae7fff700 1 -- 172.21.15.26:0/157900458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ae806b250 msgr2=0x7f3ae81c6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:55.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.576+0000 7f3ae7fff700 1 --2- 172.21.15.26:0/157900458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ae806b250 0x7f3ae81c6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:55.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.576+0000 7f3ae7fff700 1 -- 172.21.15.26:0/157900458 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae0009b30 con 0x7f3ae806a770 2023-10-01T08:00:55.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.576+0000 7f3ae77fe700 1 --2- 172.21.15.26:0/157900458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ae806b250 0x7f3ae81c6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:55.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.576+0000 7f3ae7fff700 1 --2- 172.21.15.26:0/157900458 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ae806a770 0x7f3ae81c6150 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8001eb0 tx=0x7f3ad800c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:55.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.576+0000 7f3ae4ff9700 1 -- 172.21.15.26:0/157900458 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad80054e0 con 0x7f3ae806a770 2023-10-01T08:00:55.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.576+0000 7f3ae4ff9700 1 -- 172.21.15.26:0/157900458 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad800ce80 con 0x7f3ae806a770 2023-10-01T08:00:55.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.576+0000 7f3aee59a700 1 -- 172.21.15.26:0/157900458 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3adc0094a0 con 0x7f3ae806a770 2023-10-01T08:00:55.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.576+0000 7f3ae4ff9700 1 -- 172.21.15.26:0/157900458 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8003880 con 0x7f3ae806a770 2023-10-01T08:00:55.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.576+0000 7f3aee59a700 1 -- 172.21.15.26:0/157900458 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae8071290 con 0x7f3ae806a770 2023-10-01T08:00:55.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.577+0000 7f3ae4ff9700 1 -- 172.21.15.26:0/157900458 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3ad80039e0 con 0x7f3ae806a770 2023-10-01T08:00:55.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.577+0000 7f3ae4ff9700 1 -- 172.21.15.26:0/157900458 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3ad803ea00 con 0x7f3ae806a770 2023-10-01T08:00:55.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.577+0000 7f3aee59a700 1 -- 172.21.15.26:0/157900458 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ae8074ea0 con 0x7f3ae806a770 2023-10-01T08:00:55.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.582+0000 7f3ae4ff9700 1 -- 172.21.15.26:0/157900458 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ad8017020 con 0x7f3ae806a770 2023-10-01T08:00:55.606 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:55.628 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:55.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.748+0000 7f7048310700 1 Processor -- start 2023-10-01T08:00:55.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.748+0000 7f7048310700 1 -- start start 2023-10-01T08:00:55.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.749+0000 7f7048310700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70400a0a30 0x7f70400a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:55.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.749+0000 7f7048310700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f704009d630 0x7f70400a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:55.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.749+0000 7f7048310700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70400a2a70 con 0x7f7040133930 2023-10-01T08:00:55.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.749+0000 7f7048310700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70400a01d0 con 0x7f70400a0a30 2023-10-01T08:00:55.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.749+0000 7f7048310700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f704009e2b0 con 0x7f704009d630 2023-10-01T08:00:55.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.749+0000 7f70458ab700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f704009d630 0x7f70400a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:55.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.749+0000 7f70460ac700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70400a0a30 0x7f70400a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:55.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.749+0000 7f70458ab700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f704009d630 0x7f70400a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41088/0 (socket says 172.21.15.26:41088) 2023-10-01T08:00:55.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.749+0000 7f70460ac700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70400a0a30 0x7f70400a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42902/0 (socket says 172.21.15.26:42902) 2023-10-01T08:00:55.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.749+0000 7f70468ad700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7040133930 0x7f7040133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39540/0 (socket says 172.21.15.26:39540) 2023-10-01T08:00:55.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.749+0000 7f70458ab700 1 -- 172.21.15.26:0/2839332910 learned_addr learned my addr 172.21.15.26:0/2839332910 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:55.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.749+0000 7f70458ab700 1 -- 172.21.15.26:0/2839332910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70400a0a30 msgr2=0x7f70400a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:55.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.749+0000 7f70458ab700 1 --2- 172.21.15.26:0/2839332910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70400a0a30 0x7f70400a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:55.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.749+0000 7f70458ab700 1 -- 172.21.15.26:0/2839332910 >> v1:172.21.15.26:6789/0 conn(0x7f7040133930 legacy=0x7f7040133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:55.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.749+0000 7f70458ab700 1 -- 172.21.15.26:0/2839332910 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f704009dc50 con 0x7f704009d630 2023-10-01T08:00:55.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.749+0000 7f70460ac700 1 --2- 172.21.15.26:0/2839332910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70400a0a30 0x7f70400a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:55.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.750+0000 7f70458ab700 1 --2- 172.21.15.26:0/2839332910 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f704009d630 0x7f70400a1340 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f7030009920 tx=0x7f7030009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f54550355e317f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:55.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.750+0000 7f70450aa700 1 -- 172.21.15.26:0/2839332910 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7030011830 con 0x7f704009d630 2023-10-01T08:00:55.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.750+0000 7f70450aa700 1 -- 172.21.15.26:0/2839332910 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7030011990 con 0x7f704009d630 2023-10-01T08:00:55.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.750+0000 7f70450aa700 1 -- 172.21.15.26:0/2839332910 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7030011d20 con 0x7f704009d630 2023-10-01T08:00:55.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.751+0000 7f7048310700 1 -- 172.21.15.26:0/2839332910 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f704009d630 msgr2=0x7f70400a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:55.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.751+0000 7f7048310700 1 --2- 172.21.15.26:0/2839332910 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f704009d630 0x7f70400a1340 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f7030009920 tx=0x7f7030009c30 comp rx=0 tx=0).stop 2023-10-01T08:00:55.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.751+0000 7f7048310700 1 -- 172.21.15.26:0/2839332910 shutdown_connections 2023-10-01T08:00:55.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.751+0000 7f7048310700 1 --2- 172.21.15.26:0/2839332910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70400a0a30 0x7f70400a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:55.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.751+0000 7f7048310700 1 --2- 172.21.15.26:0/2839332910 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f704009d630 0x7f70400a1340 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:55.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.751+0000 7f7048310700 1 -- 172.21.15.26:0/2839332910 >> 172.21.15.26:0/2839332910 conn(0x7f70400a3050 msgr2=0x7f70400a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:55.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.751+0000 7f7048310700 1 -- 172.21.15.26:0/2839332910 shutdown_connections 2023-10-01T08:00:55.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.751+0000 7f7048310700 1 -- 172.21.15.26:0/2839332910 wait complete. 2023-10-01T08:00:55.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.752+0000 7f7048310700 1 Processor -- start 2023-10-01T08:00:55.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.752+0000 7f7048310700 1 -- start start 2023-10-01T08:00:55.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.752+0000 7f7048310700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f704009d630 0x7f704011f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:55.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.752+0000 7f7048310700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f70400a0a30 0x7f704011fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:55.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.752+0000 7f7048310700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7040133930 0x7f70401c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:55.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.752+0000 7f7048310700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7040133510 con 0x7f7040133930 2023-10-01T08:00:55.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.752+0000 7f7048310700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704011f060 con 0x7f704009d630 2023-10-01T08:00:55.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.752+0000 7f7048310700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70400a4030 con 0x7f70400a0a30 2023-10-01T08:00:55.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.752+0000 7f70458ab700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f70400a0a30 0x7f704011fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:55.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.752+0000 7f70460ac700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f704009d630 0x7f704011f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:55.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.752+0000 7f70458ab700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f70400a0a30 0x7f704011fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41100/0 (socket says 172.21.15.26:41100) 2023-10-01T08:00:55.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.752+0000 7f70458ab700 1 -- 172.21.15.26:0/3797396710 learned_addr learned my addr 172.21.15.26:0/3797396710 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:55.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.752+0000 7f70468ad700 1 --2- 172.21.15.26:0/3797396710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7040133930 0x7f70401c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:55.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.753+0000 7f70458ab700 1 -- 172.21.15.26:0/3797396710 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f704009d630 msgr2=0x7f704011f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:55.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.753+0000 7f70458ab700 1 --2- 172.21.15.26:0/3797396710 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f704009d630 0x7f704011f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:55.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.753+0000 7f70458ab700 1 -- 172.21.15.26:0/3797396710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7040133930 msgr2=0x7f70401c8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:55.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.753+0000 7f70458ab700 1 --2- 172.21.15.26:0/3797396710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7040133930 0x7f70401c8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:55.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.753+0000 7f70458ab700 1 -- 172.21.15.26:0/3797396710 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703c0094a0 con 0x7f70400a0a30 2023-10-01T08:00:55.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.753+0000 7f70458ab700 1 --2- 172.21.15.26:0/3797396710 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f70400a0a30 0x7f704011fa20 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f7030000c00 tx=0x7f7030004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:55.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.753+0000 7f7036ffd700 1 -- 172.21.15.26:0/3797396710 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7030004450 con 0x7f70400a0a30 2023-10-01T08:00:55.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.753+0000 7f7036ffd700 1 -- 172.21.15.26:0/3797396710 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70300045b0 con 0x7f70400a0a30 2023-10-01T08:00:55.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.753+0000 7f7048310700 1 -- 172.21.15.26:0/3797396710 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7030009550 con 0x7f70400a0a30 2023-10-01T08:00:55.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.753+0000 7f7036ffd700 1 -- 172.21.15.26:0/3797396710 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70300038a0 con 0x7f70400a0a30 2023-10-01T08:00:55.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.753+0000 7f7048310700 1 -- 172.21.15.26:0/3797396710 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f704011ff60 con 0x7f70400a0a30 2023-10-01T08:00:55.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.754+0000 7f7036ffd700 1 -- 172.21.15.26:0/3797396710 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7030021070 con 0x7f70400a0a30 2023-10-01T08:00:55.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.754+0000 7f7036ffd700 1 -- 172.21.15.26:0/3797396710 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f70300409b0 con 0x7f70400a0a30 2023-10-01T08:00:55.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.754+0000 7f7048310700 1 -- 172.21.15.26:0/3797396710 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70401222f0 con 0x7f70400a0a30 2023-10-01T08:00:55.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.764+0000 7f7036ffd700 1 -- 172.21.15.26:0/3797396710 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7030015080 con 0x7f70400a0a30 2023-10-01T08:00:55.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.795+0000 7f86be184700 1 Processor -- start 2023-10-01T08:00:55.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.795+0000 7f86be184700 1 -- start start 2023-10-01T08:00:55.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.795+0000 7f86be184700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f86b809e850 0x7f86b809ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:55.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.795+0000 7f86be184700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f86b809f160 0x7f86b8133bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:55.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.796+0000 7f86be184700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f86b8134130 0x7f86b81345d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:55.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.796+0000 7f86be184700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86b809ae60 con 0x7f86b809f160 2023-10-01T08:00:55.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.796+0000 7f86be184700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b809f960 con 0x7f86b8134130 2023-10-01T08:00:55.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.796+0000 7f86be184700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86b806cb10 con 0x7f86b809e850 2023-10-01T08:00:55.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.796+0000 7f86b7fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f86b8134130 0x7f86b81345d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:55.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.796+0000 7f86b77fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f86b809e850 0x7f86b809ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:55.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.796+0000 7f86b7fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f86b8134130 0x7f86b81345d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42926/0 (socket says 172.21.15.26:42926) 2023-10-01T08:00:55.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.796+0000 7f86b77fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f86b809e850 0x7f86b809ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41112/0 (socket says 172.21.15.26:41112) 2023-10-01T08:00:55.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.796+0000 7f86b7fff700 1 -- 172.21.15.26:0/3607859323 learned_addr learned my addr 172.21.15.26:0/3607859323 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:55.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.796+0000 7f86b6ffd700 1 --2- 172.21.15.26:0/3607859323 >> v2:172.21.15.26:3300/0 conn(0x7f86b809f160 0x7f86b8133bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:55.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.796+0000 7f86b77fe700 1 -- 172.21.15.26:0/3607859323 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f86b8134130 msgr2=0x7f86b81345d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:55.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.796+0000 7f86b77fe700 1 --2- 172.21.15.26:0/3607859323 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f86b8134130 0x7f86b81345d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:55.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.796+0000 7f86b77fe700 1 -- 172.21.15.26:0/3607859323 >> v2:172.21.15.26:3300/0 conn(0x7f86b809f160 msgr2=0x7f86b8133bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:55.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.796+0000 7f86b77fe700 1 --2- 172.21.15.26:0/3607859323 >> v2:172.21.15.26:3300/0 conn(0x7f86b809f160 0x7f86b8133bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:55.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.796+0000 7f86b77fe700 1 -- 172.21.15.26:0/3607859323 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b806b990 con 0x7f86b809e850 2023-10-01T08:00:55.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.796+0000 7f86b7fff700 1 --2- 172.21.15.26:0/3607859323 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f86b8134130 0x7f86b81345d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:55.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.796+0000 7f86b6ffd700 1 --2- 172.21.15.26:0/3607859323 >> v2:172.21.15.26:3300/0 conn(0x7f86b809f160 0x7f86b8133bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:55.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.796+0000 7f86b77fe700 1 --2- 172.21.15.26:0/3607859323 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f86b809e850 0x7f86b809ec20 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f86a8009870 tx=0x7f86a8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e0d0d9c1dbdc7b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:55.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.797+0000 7f86b67fc700 1 -- 172.21.15.26:0/3607859323 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a8011830 con 0x7f86b809e850 2023-10-01T08:00:55.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.797+0000 7f86b67fc700 1 -- 172.21.15.26:0/3607859323 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a8011990 con 0x7f86b809e850 2023-10-01T08:00:55.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.797+0000 7f86b67fc700 1 -- 172.21.15.26:0/3607859323 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a8011d20 con 0x7f86b809e850 2023-10-01T08:00:55.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.797+0000 7f86be184700 1 -- 172.21.15.26:0/3607859323 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f86b809e850 msgr2=0x7f86b809ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:55.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.797+0000 7f86be184700 1 --2- 172.21.15.26:0/3607859323 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f86b809e850 0x7f86b809ec20 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f86a8009870 tx=0x7f86a8009b80 comp rx=0 tx=0).stop 2023-10-01T08:00:55.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.797+0000 7f86be184700 1 -- 172.21.15.26:0/3607859323 shutdown_connections 2023-10-01T08:00:55.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.797+0000 7f86be184700 1 --2- 172.21.15.26:0/3607859323 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f86b8134130 0x7f86b81345d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:55.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.797+0000 7f86be184700 1 --2- 172.21.15.26:0/3607859323 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f86b809e850 0x7f86b809ec20 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:55.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.797+0000 7f86be184700 1 --2- 172.21.15.26:0/3607859323 >> v2:172.21.15.26:3300/0 conn(0x7f86b809f160 0x7f86b8133bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:55.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.797+0000 7f86be184700 1 -- 172.21.15.26:0/3607859323 >> 172.21.15.26:0/3607859323 conn(0x7f86b80a3f70 msgr2=0x7f86b80a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:55.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.798+0000 7f86be184700 1 -- 172.21.15.26:0/3607859323 shutdown_connections 2023-10-01T08:00:55.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.798+0000 7f86be184700 1 -- 172.21.15.26:0/3607859323 wait complete. 2023-10-01T08:00:55.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.798+0000 7f86be184700 1 Processor -- start 2023-10-01T08:00:55.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.799+0000 7f86be184700 1 -- start start 2023-10-01T08:00:55.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.799+0000 7f86be184700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86b809e850 0x7f86b8122580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:55.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.799+0000 7f86be184700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f86b809f160 0x7f86b8122ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:55.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.799+0000 7f86be184700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f86b8134130 0x7f86b8123000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:55.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.799+0000 7f86be184700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b81253e0 con 0x7f86b809e850 2023-10-01T08:00:55.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.799+0000 7f86be184700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b81239e0 con 0x7f86b809f160 2023-10-01T08:00:55.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.799+0000 7f86be184700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86b8124310 con 0x7f86b8134130 2023-10-01T08:00:55.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.799+0000 7f86b6ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f86b809f160 0x7f86b8122ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:55.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.799+0000 7f86b77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86b809e850 0x7f86b8122580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:55.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.799+0000 7f86b6ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f86b809f160 0x7f86b8122ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42930/0 (socket says 172.21.15.26:42930) 2023-10-01T08:00:55.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.799+0000 7f86b6ffd700 1 -- 172.21.15.26:0/1907282036 learned_addr learned my addr 172.21.15.26:0/1907282036 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:55.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.799+0000 7f86b77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86b809e850 0x7f86b8122580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58428/0 (socket says 172.21.15.26:58428) 2023-10-01T08:00:55.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.799+0000 7f86b7fff700 1 --2- 172.21.15.26:0/1907282036 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f86b8134130 0x7f86b8123000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:55.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.800+0000 7f86b6ffd700 1 -- 172.21.15.26:0/1907282036 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f86b8134130 msgr2=0x7f86b8123000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:55.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.800+0000 7f86b6ffd700 1 --2- 172.21.15.26:0/1907282036 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f86b8134130 0x7f86b8123000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:55.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.800+0000 7f86b6ffd700 1 -- 172.21.15.26:0/1907282036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86b809e850 msgr2=0x7f86b8122580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:55.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.800+0000 7f86b6ffd700 1 --2- 172.21.15.26:0/1907282036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86b809e850 0x7f86b8122580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:55.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.800+0000 7f86b6ffd700 1 -- 172.21.15.26:0/1907282036 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ac0094a0 con 0x7f86b809f160 2023-10-01T08:00:55.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.800+0000 7f86b6ffd700 1 --2- 172.21.15.26:0/1907282036 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f86b809f160 0x7f86b8122ac0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00ebe0 tx=0x7f86ac00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:55.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.800+0000 7f869ffff700 1 -- 172.21.15.26:0/1907282036 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac00c910 con 0x7f86b809f160 2023-10-01T08:00:55.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.800+0000 7f869ffff700 1 -- 172.21.15.26:0/1907282036 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ac00ca70 con 0x7f86b809f160 2023-10-01T08:00:55.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.800+0000 7f86be184700 1 -- 172.21.15.26:0/1907282036 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b0009b30 con 0x7f86b809f160 2023-10-01T08:00:55.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.800+0000 7f869ffff700 1 -- 172.21.15.26:0/1907282036 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac00cde0 con 0x7f86b809f160 2023-10-01T08:00:55.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.800+0000 7f86be184700 1 -- 172.21.15.26:0/1907282036 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a80094a0 con 0x7f86b809f160 2023-10-01T08:00:55.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.801+0000 7f3aee59a700 1 -- 172.21.15.26:0/157900458 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3ae806c360 con 0x7f3ae806a770 2023-10-01T08:00:55.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.801+0000 7f3ae4ff9700 1 -- 172.21.15.26:0/157900458 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3ad80196d0 con 0x7f3ae806a770 2023-10-01T08:00:55.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.801+0000 7f869ffff700 1 -- 172.21.15.26:0/1907282036 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f86ac013470 con 0x7f86b809f160 2023-10-01T08:00:55.805 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:55.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.801+0000 7f869ffff700 1 -- 172.21.15.26:0/1907282036 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f86ac03f910 con 0x7f86b809f160 2023-10-01T08:00:55.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.801+0000 7f86be184700 1 -- 172.21.15.26:0/1907282036 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86b8125020 con 0x7f86b809f160 2023-10-01T08:00:55.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.803+0000 7f3aee59a700 1 -- 172.21.15.26:0/157900458 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ae806a770 msgr2=0x7f3ae81c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:55.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.803+0000 7f3aee59a700 1 --2- 172.21.15.26:0/157900458 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ae806a770 0x7f3ae81c6150 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8001eb0 tx=0x7f3ad800c800 comp rx=0 tx=0).stop 2023-10-01T08:00:55.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.803+0000 7f3aee59a700 1 -- 172.21.15.26:0/157900458 shutdown_connections 2023-10-01T08:00:55.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.803+0000 7f3aee59a700 1 --2- 172.21.15.26:0/157900458 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ae8136d80 0x7f3ae811c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:55.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.803+0000 7f3aee59a700 1 --2- 172.21.15.26:0/157900458 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ae806a770 0x7f3ae81c6150 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:55.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.804+0000 7f3aee59a700 1 --2- 172.21.15.26:0/157900458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ae806b250 0x7f3ae81c6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:55.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.804+0000 7f3aee59a700 1 -- 172.21.15.26:0/157900458 >> 172.21.15.26:0/157900458 conn(0x7f3ae8066f50 msgr2=0x7f3ae806eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:55.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.804+0000 7f3aee59a700 1 -- 172.21.15.26:0/157900458 shutdown_connections 2023-10-01T08:00:55.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.804+0000 7f3aee59a700 1 -- 172.21.15.26:0/157900458 wait complete. 2023-10-01T08:00:55.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.807+0000 7f869ffff700 1 -- 172.21.15.26:0/1907282036 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f86ac017070 con 0x7f86b809f160 2023-10-01T08:00:55.819 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:55.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.972+0000 7f7048310700 1 -- 172.21.15.26:0/3797396710 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f70400747f0 con 0x7f70400a0a30 2023-10-01T08:00:55.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.972+0000 7f7036ffd700 1 -- 172.21.15.26:0/3797396710 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f703000b600 con 0x7f70400a0a30 2023-10-01T08:00:55.974 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:55.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.975+0000 7f7048310700 1 -- 172.21.15.26:0/3797396710 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f70400a0a30 msgr2=0x7f704011fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:55.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.975+0000 7f7048310700 1 --2- 172.21.15.26:0/3797396710 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f70400a0a30 0x7f704011fa20 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f7030000c00 tx=0x7f7030004750 comp rx=0 tx=0).stop 2023-10-01T08:00:55.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.975+0000 7f7048310700 1 -- 172.21.15.26:0/3797396710 shutdown_connections 2023-10-01T08:00:55.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.975+0000 7f7048310700 1 --2- 172.21.15.26:0/3797396710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7040133930 0x7f70401c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:55.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.975+0000 7f7048310700 1 --2- 172.21.15.26:0/3797396710 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f704009d630 0x7f704011f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:55.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.975+0000 7f7048310700 1 --2- 172.21.15.26:0/3797396710 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f70400a0a30 0x7f704011fa20 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:55.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.975+0000 7f7048310700 1 -- 172.21.15.26:0/3797396710 >> 172.21.15.26:0/3797396710 conn(0x7f70400a3050 msgr2=0x7f704009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:55.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.975+0000 7f7048310700 1 -- 172.21.15.26:0/3797396710 shutdown_connections 2023-10-01T08:00:55.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:55.975+0000 7f7048310700 1 -- 172.21.15.26:0/3797396710 wait complete. 2023-10-01T08:00:55.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:56.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.014+0000 7f86be184700 1 -- 172.21.15.26:0/1907282036 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f86b80747f0 con 0x7f86b809f160 2023-10-01T08:00:56.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.015+0000 7f869ffff700 1 -- 172.21.15.26:0/1907282036 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f86ac0232f0 con 0x7f86b809f160 2023-10-01T08:00:56.016 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:56.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.017+0000 7f86be184700 1 -- 172.21.15.26:0/1907282036 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f86b809f160 msgr2=0x7f86b8122ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:56.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.017+0000 7f86be184700 1 --2- 172.21.15.26:0/1907282036 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f86b809f160 0x7f86b8122ac0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00ebe0 tx=0x7f86ac00eef0 comp rx=0 tx=0).stop 2023-10-01T08:00:56.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.017+0000 7f86be184700 1 -- 172.21.15.26:0/1907282036 shutdown_connections 2023-10-01T08:00:56.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.017+0000 7f86be184700 1 --2- 172.21.15.26:0/1907282036 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f86b8134130 0x7f86b8123000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:56.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.017+0000 7f86be184700 1 --2- 172.21.15.26:0/1907282036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86b809e850 0x7f86b8122580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:56.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.017+0000 7f86be184700 1 --2- 172.21.15.26:0/1907282036 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f86b809f160 0x7f86b8122ac0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:56.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.017+0000 7f86be184700 1 -- 172.21.15.26:0/1907282036 >> 172.21.15.26:0/1907282036 conn(0x7f86b80a3f70 msgr2=0x7f86b8070930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:56.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.018+0000 7f86be184700 1 -- 172.21.15.26:0/1907282036 shutdown_connections 2023-10-01T08:00:56.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.018+0000 7f86be184700 1 -- 172.21.15.26:0/1907282036 wait complete. 2023-10-01T08:00:56.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:56.452 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:56.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.597+0000 7f13207da700 1 Processor -- start 2023-10-01T08:00:56.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.597+0000 7f13207da700 1 -- start start 2023-10-01T08:00:56.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.598+0000 7f13207da700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13181338c0 0x7f1318133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:56.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.598+0000 7f13207da700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f131809e560 0x7f131813b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:56.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.598+0000 7f13207da700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f131806f720 con 0x7f13181341d0 2023-10-01T08:00:56.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.598+0000 7f13207da700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1318070c80 con 0x7f131809e560 2023-10-01T08:00:56.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.598+0000 7f13207da700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f131806fce0 con 0x7f13181338c0 2023-10-01T08:00:56.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.598+0000 7f131e576700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13181338c0 0x7f1318133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:56.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.598+0000 7f131ed77700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f131809e560 0x7f131813b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:56.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.598+0000 7f131e576700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13181338c0 0x7f1318133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42942/0 (socket says 172.21.15.26:42942) 2023-10-01T08:00:56.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.598+0000 7f131ed77700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f131809e560 0x7f131813b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58444/0 (socket says 172.21.15.26:58444) 2023-10-01T08:00:56.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.598+0000 7f131e576700 1 -- 172.21.15.26:0/1307171785 learned_addr learned my addr 172.21.15.26:0/1307171785 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:56.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.598+0000 7f131ed77700 1 -- 172.21.15.26:0/1307171785 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13181338c0 msgr2=0x7f1318133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:56.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.598+0000 7f131ed77700 1 --2- 172.21.15.26:0/1307171785 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13181338c0 0x7f1318133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:56.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.598+0000 7f131ed77700 1 -- 172.21.15.26:0/1307171785 >> v1:172.21.15.26:6789/0 conn(0x7f13181341d0 legacy=0x7f131809de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:56.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.598+0000 7f131ed77700 1 -- 172.21.15.26:0/1307171785 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13181336a0 con 0x7f131809e560 2023-10-01T08:00:56.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.598+0000 7f131d574700 1 -- 172.21.15.26:0/1307171785 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2649099722 0 0) 0x7f131806f720 con 0x7f13181341d0 2023-10-01T08:00:56.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.598+0000 7f131e576700 1 --2- 172.21.15.26:0/1307171785 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13181338c0 0x7f1318133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:56.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.599+0000 7f131ed77700 1 --2- 172.21.15.26:0/1307171785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f131809e560 0x7f131813b860 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f1310009d90 tx=0x7f131000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c0561e43abd9bf server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:56.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.599+0000 7f131d574700 1 -- 172.21.15.26:0/1307171785 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131000e070 con 0x7f131809e560 2023-10-01T08:00:56.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.599+0000 7f131d574700 1 -- 172.21.15.26:0/1307171785 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f131000bb20 con 0x7f131809e560 2023-10-01T08:00:56.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.599+0000 7f131d574700 1 -- 172.21.15.26:0/1307171785 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1310012430 con 0x7f131809e560 2023-10-01T08:00:56.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.599+0000 7f13207da700 1 -- 172.21.15.26:0/1307171785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f131809e560 msgr2=0x7f131813b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:56.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.599+0000 7f13207da700 1 --2- 172.21.15.26:0/1307171785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f131809e560 0x7f131813b860 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f1310009d90 tx=0x7f131000b330 comp rx=0 tx=0).stop 2023-10-01T08:00:56.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.599+0000 7f13207da700 1 -- 172.21.15.26:0/1307171785 shutdown_connections 2023-10-01T08:00:56.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.599+0000 7f13207da700 1 --2- 172.21.15.26:0/1307171785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f131809e560 0x7f131813b860 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:56.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.599+0000 7f13207da700 1 --2- 172.21.15.26:0/1307171785 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13181338c0 0x7f1318133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:56.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.599+0000 7f13207da700 1 -- 172.21.15.26:0/1307171785 >> 172.21.15.26:0/1307171785 conn(0x7f13180a2aa0 msgr2=0x7f13180a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:56.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.600+0000 7f13207da700 1 -- 172.21.15.26:0/1307171785 shutdown_connections 2023-10-01T08:00:56.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.600+0000 7f13207da700 1 -- 172.21.15.26:0/1307171785 wait complete. 2023-10-01T08:00:56.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.600+0000 7f13207da700 1 Processor -- start 2023-10-01T08:00:56.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.601+0000 7f13207da700 1 -- start start 2023-10-01T08:00:56.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.601+0000 7f13207da700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f131809e560 0x7f131811f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:56.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.601+0000 7f13207da700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13181338c0 0x7f131811fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:56.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.601+0000 7f13207da700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f13181341d0 0x7f1318120140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:56.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.601+0000 7f13207da700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1318120b20 con 0x7f131809e560 2023-10-01T08:00:56.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.601+0000 7f13207da700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1318123190 con 0x7f13181338c0 2023-10-01T08:00:56.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.601+0000 7f13207da700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1318121320 con 0x7f13181341d0 2023-10-01T08:00:56.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.601+0000 7f131e576700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f131809e560 0x7f131811f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:56.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.601+0000 7f131e576700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f131809e560 0x7f131811f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58446/0 (socket says 172.21.15.26:58446) 2023-10-01T08:00:56.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.601+0000 7f131e576700 1 -- 172.21.15.26:0/2544374674 learned_addr learned my addr 172.21.15.26:0/2544374674 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:56.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.601+0000 7f131dd75700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13181338c0 0x7f131811fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:56.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.601+0000 7f131ed77700 1 --2- 172.21.15.26:0/2544374674 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f13181341d0 0x7f1318120140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:56.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.601+0000 7f131e576700 1 -- 172.21.15.26:0/2544374674 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f13181341d0 msgr2=0x7f1318120140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:56.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.601+0000 7f131e576700 1 --2- 172.21.15.26:0/2544374674 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f13181341d0 0x7f1318120140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:56.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.601+0000 7f131e576700 1 -- 172.21.15.26:0/2544374674 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13181338c0 msgr2=0x7f131811fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:56.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.601+0000 7f131e576700 1 --2- 172.21.15.26:0/2544374674 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13181338c0 0x7f131811fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:56.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.601+0000 7f131e576700 1 -- 172.21.15.26:0/2544374674 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1314009550 con 0x7f131809e560 2023-10-01T08:00:56.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.602+0000 7f131e576700 1 --2- 172.21.15.26:0/2544374674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f131809e560 0x7f131811f6c0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f131400ebe0 tx=0x7f131400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:56.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.602+0000 7f130affd700 1 -- 172.21.15.26:0/2544374674 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131400c850 con 0x7f131809e560 2023-10-01T08:00:56.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.602+0000 7f130affd700 1 -- 172.21.15.26:0/2544374674 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f131400c9b0 con 0x7f131809e560 2023-10-01T08:00:56.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.602+0000 7f130affd700 1 -- 172.21.15.26:0/2544374674 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131400cd40 con 0x7f131809e560 2023-10-01T08:00:56.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.602+0000 7f13207da700 1 -- 172.21.15.26:0/2544374674 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1310009a70 con 0x7f131809e560 2023-10-01T08:00:56.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.602+0000 7f13207da700 1 -- 172.21.15.26:0/2544374674 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13180a0fe0 con 0x7f131809e560 2023-10-01T08:00:56.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.603+0000 7f130affd700 1 -- 172.21.15.26:0/2544374674 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1314013470 con 0x7f131809e560 2023-10-01T08:00:56.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.603+0000 7f130affd700 1 -- 172.21.15.26:0/2544374674 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f131403fc00 con 0x7f131809e560 2023-10-01T08:00:56.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.603+0000 7f13207da700 1 -- 172.21.15.26:0/2544374674 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1318122e10 con 0x7f131809e560 2023-10-01T08:00:56.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.608+0000 7f130affd700 1 -- 172.21.15.26:0/2544374674 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f131401b3b0 con 0x7f131809e560 2023-10-01T08:00:56.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.810+0000 7f13207da700 1 -- 172.21.15.26:0/2544374674 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1318074ea0 con 0x7f131809e560 2023-10-01T08:00:56.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.810+0000 7f130affd700 1 -- 172.21.15.26:0/2544374674 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1314011b00 con 0x7f131809e560 2023-10-01T08:00:56.811 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:56.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.813+0000 7f13207da700 1 -- 172.21.15.26:0/2544374674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f131809e560 msgr2=0x7f131811f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:56.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.813+0000 7f13207da700 1 --2- 172.21.15.26:0/2544374674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f131809e560 0x7f131811f6c0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f131400ebe0 tx=0x7f131400eef0 comp rx=0 tx=0).stop 2023-10-01T08:00:56.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.813+0000 7f13207da700 1 -- 172.21.15.26:0/2544374674 shutdown_connections 2023-10-01T08:00:56.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.813+0000 7f13207da700 1 --2- 172.21.15.26:0/2544374674 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f13181341d0 0x7f1318120140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:56.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.813+0000 7f13207da700 1 --2- 172.21.15.26:0/2544374674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f131809e560 0x7f131811f6c0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:56.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.813+0000 7f13207da700 1 --2- 172.21.15.26:0/2544374674 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f13181338c0 0x7f131811fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:56.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.813+0000 7f13207da700 1 -- 172.21.15.26:0/2544374674 >> 172.21.15.26:0/2544374674 conn(0x7f13180a2aa0 msgr2=0x7f1318131420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:56.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.813+0000 7f13207da700 1 -- 172.21.15.26:0/2544374674 shutdown_connections 2023-10-01T08:00:56.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.813+0000 7f13207da700 1 -- 172.21.15.26:0/2544374674 wait complete. 2023-10-01T08:00:56.820 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:56.827 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:56.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.956+0000 7f22d5aef700 1 Processor -- start 2023-10-01T08:00:56.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.956+0000 7f22d5aef700 1 -- start start 2023-10-01T08:00:56.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.957+0000 7f22d5aef700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f22d009d6f0 0x7f22d009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:56.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.957+0000 7f22d5aef700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22d009e440 0x7f22d0134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:56.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.957+0000 7f22d5aef700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22d009b120 con 0x7f22d009e000 2023-10-01T08:00:56.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.957+0000 7f22d5aef700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22d006b460 con 0x7f22d009d6f0 2023-10-01T08:00:56.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.957+0000 7f22d5aef700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d009a7e0 con 0x7f22d009e440 2023-10-01T08:00:56.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.957+0000 7f22cf7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f22d009d6f0 0x7f22d009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:56.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.957+0000 7f22cffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22d009e440 0x7f22d0134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:56.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.957+0000 7f22cf7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f22d009d6f0 0x7f22d009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58452/0 (socket says 172.21.15.26:58452) 2023-10-01T08:00:56.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.957+0000 7f22cffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22d009e440 0x7f22d0134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42952/0 (socket says 172.21.15.26:42952) 2023-10-01T08:00:56.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.957+0000 7f22cf7fe700 1 -- 172.21.15.26:0/3052221014 learned_addr learned my addr 172.21.15.26:0/3052221014 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:56.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.957+0000 7f22cffff700 1 -- 172.21.15.26:0/3052221014 >> v2:172.21.15.26:3300/0 conn(0x7f22d009d6f0 msgr2=0x7f22d009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:56.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.957+0000 7f22cffff700 1 --2- 172.21.15.26:0/3052221014 >> v2:172.21.15.26:3300/0 conn(0x7f22d009d6f0 0x7f22d009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:56.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.957+0000 7f22cffff700 1 -- 172.21.15.26:0/3052221014 >> v1:172.21.15.26:6789/0 conn(0x7f22d009e000 legacy=0x7f22d01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:56.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.957+0000 7f22cffff700 1 -- 172.21.15.26:0/3052221014 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d009a500 con 0x7f22d009e440 2023-10-01T08:00:56.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.957+0000 7f22cf7fe700 1 --2- 172.21.15.26:0/3052221014 >> v2:172.21.15.26:3300/0 conn(0x7f22d009d6f0 0x7f22d009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:56.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.957+0000 7f22cffff700 1 --2- 172.21.15.26:0/3052221014 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22d009e440 0x7f22d0134100 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f22c8009dc0 tx=0x7f22c800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca7d0a8f048f9a87 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:56.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.957+0000 7f22ce7fc700 1 -- 172.21.15.26:0/3052221014 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c800e070 con 0x7f22d009e440 2023-10-01T08:00:56.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.957+0000 7f22ce7fc700 1 -- 172.21.15.26:0/3052221014 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c800bae0 con 0x7f22d009e440 2023-10-01T08:00:56.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.957+0000 7f22ce7fc700 1 -- 172.21.15.26:0/3052221014 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c800be90 con 0x7f22d009e440 2023-10-01T08:00:56.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.958+0000 7f22d5aef700 1 -- 172.21.15.26:0/3052221014 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22d009e440 msgr2=0x7f22d0134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:56.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.958+0000 7f22d5aef700 1 --2- 172.21.15.26:0/3052221014 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22d009e440 0x7f22d0134100 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f22c8009dc0 tx=0x7f22c800b330 comp rx=0 tx=0).stop 2023-10-01T08:00:56.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.958+0000 7f22d5aef700 1 -- 172.21.15.26:0/3052221014 shutdown_connections 2023-10-01T08:00:56.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.958+0000 7f22d5aef700 1 --2- 172.21.15.26:0/3052221014 >> v2:172.21.15.26:3300/0 conn(0x7f22d009d6f0 0x7f22d009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:56.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.958+0000 7f22d5aef700 1 --2- 172.21.15.26:0/3052221014 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22d009e440 0x7f22d0134100 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:56.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.958+0000 7f22d5aef700 1 -- 172.21.15.26:0/3052221014 >> 172.21.15.26:0/3052221014 conn(0x7f22d0066f50 msgr2=0x7f22d009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:56.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.958+0000 7f22d5aef700 1 -- 172.21.15.26:0/3052221014 shutdown_connections 2023-10-01T08:00:56.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.958+0000 7f22d5aef700 1 -- 172.21.15.26:0/3052221014 wait complete. 2023-10-01T08:00:56.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.959+0000 7f22d5aef700 1 Processor -- start 2023-10-01T08:00:56.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.959+0000 7f22d5aef700 1 -- start start 2023-10-01T08:00:56.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.960+0000 7f22d5aef700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22d009d6f0 0x7f22d01a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:56.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.960+0000 7f22d5aef700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f22d009e000 0x7f22d01a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:56.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.960+0000 7f22d5aef700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22d009e440 0x7f22d01a6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:56.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.960+0000 7f22d5aef700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d01aa360 con 0x7f22d009d6f0 2023-10-01T08:00:56.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.960+0000 7f22d5aef700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d01a99a0 con 0x7f22d009e440 2023-10-01T08:00:56.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.960+0000 7f22d5aef700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22d01a8ce0 con 0x7f22d009e000 2023-10-01T08:00:56.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.960+0000 7f22cf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22d009d6f0 0x7f22d01a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:56.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.960+0000 7f22cffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22d009e440 0x7f22d01a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:56.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.960+0000 7f22ceffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f22d009e000 0x7f22d01a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:56.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.960+0000 7f22cf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22d009d6f0 0x7f22d01a5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58462/0 (socket says 172.21.15.26:58462) 2023-10-01T08:00:56.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.960+0000 7f22cf7fe700 1 -- 172.21.15.26:0/392367554 learned_addr learned my addr 172.21.15.26:0/392367554 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:56.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.960+0000 7f22cffff700 1 --2- 172.21.15.26:0/392367554 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22d009e440 0x7f22d01a6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42968/0 (socket says 172.21.15.26:42968) 2023-10-01T08:00:56.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.960+0000 7f22cf7fe700 1 -- 172.21.15.26:0/392367554 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f22d009e000 msgr2=0x7f22d01a6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:56.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.960+0000 7f22cf7fe700 1 --2- 172.21.15.26:0/392367554 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f22d009e000 0x7f22d01a6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:56.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.960+0000 7f22cf7fe700 1 -- 172.21.15.26:0/392367554 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22d009e440 msgr2=0x7f22d01a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:56.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.960+0000 7f22cf7fe700 1 --2- 172.21.15.26:0/392367554 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22d009e440 0x7f22d01a6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:56.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.960+0000 7f22cf7fe700 1 -- 172.21.15.26:0/392367554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c0009550 con 0x7f22d009d6f0 2023-10-01T08:00:56.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.961+0000 7f22cf7fe700 1 --2- 172.21.15.26:0/392367554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22d009d6f0 0x7f22d01a5ed0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f22c000ebe0 tx=0x7f22c000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:56.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.961+0000 7f22c7fff700 1 -- 172.21.15.26:0/392367554 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c000c850 con 0x7f22d009d6f0 2023-10-01T08:00:56.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.961+0000 7f22c7fff700 1 -- 172.21.15.26:0/392367554 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c000c9b0 con 0x7f22d009d6f0 2023-10-01T08:00:56.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.961+0000 7f22d5aef700 1 -- 172.21.15.26:0/392367554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22c8009a70 con 0x7f22d009d6f0 2023-10-01T08:00:56.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.961+0000 7f22c7fff700 1 -- 172.21.15.26:0/392367554 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c000cd40 con 0x7f22d009d6f0 2023-10-01T08:00:56.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.961+0000 7f22d5aef700 1 -- 172.21.15.26:0/392367554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22d00a2050 con 0x7f22d009d6f0 2023-10-01T08:00:56.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.962+0000 7f22c7fff700 1 -- 172.21.15.26:0/392367554 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f22c0013470 con 0x7f22d009d6f0 2023-10-01T08:00:56.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.962+0000 7f22c7fff700 1 -- 172.21.15.26:0/392367554 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f22c003fc50 con 0x7f22d009d6f0 2023-10-01T08:00:56.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.962+0000 7f22d5aef700 1 -- 172.21.15.26:0/392367554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22d01a9540 con 0x7f22d009d6f0 2023-10-01T08:00:56.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:56.967+0000 7f22c7fff700 1 -- 172.21.15.26:0/392367554 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f22c001b3b0 con 0x7f22d009d6f0 2023-10-01T08:00:56.990 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:57.033 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:57.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.130+0000 7f4eab9db700 1 Processor -- start 2023-10-01T08:00:57.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.130+0000 7f4eab9db700 1 -- start start 2023-10-01T08:00:57.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.130+0000 7f4eab9db700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ea40a0a30 0x7f4ea40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:57.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.130+0000 7f4eab9db700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4ea40a1340 0x7f4ea4133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:57.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.130+0000 7f4eab9db700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4ea4133fa0 0x7f4ea4134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:57.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.130+0000 7f4eab9db700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ea409edd0 con 0x7f4ea4133fa0 2023-10-01T08:00:57.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.130+0000 7f4eab9db700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea409e1f0 con 0x7f4ea40a0a30 2023-10-01T08:00:57.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.131+0000 7f4eab9db700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea409dc50 con 0x7f4ea40a1340 2023-10-01T08:00:57.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.131+0000 7f4ea8f76700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4ea40a1340 0x7f4ea4133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:57.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.131+0000 7f4ea8f76700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4ea40a1340 0x7f4ea4133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41144/0 (socket says 172.21.15.26:41144) 2023-10-01T08:00:57.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.131+0000 7f4ea8f76700 1 -- 172.21.15.26:0/4177625484 learned_addr learned my addr 172.21.15.26:0/4177625484 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:57.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.131+0000 7f4ea9777700 1 --2- 172.21.15.26:0/4177625484 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ea40a0a30 0x7f4ea40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:57.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.131+0000 7f4ea9f78700 1 --2- 172.21.15.26:0/4177625484 >> v2:172.21.15.26:3300/0 conn(0x7f4ea4133fa0 0x7f4ea4134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:57.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.131+0000 7f4ea8f76700 1 -- 172.21.15.26:0/4177625484 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ea40a0a30 msgr2=0x7f4ea40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:57.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.131+0000 7f4ea8f76700 1 --2- 172.21.15.26:0/4177625484 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ea40a0a30 0x7f4ea40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:57.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.131+0000 7f4ea8f76700 1 -- 172.21.15.26:0/4177625484 >> v2:172.21.15.26:3300/0 conn(0x7f4ea4133fa0 msgr2=0x7f4ea4134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:57.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.131+0000 7f4ea8f76700 1 --2- 172.21.15.26:0/4177625484 >> v2:172.21.15.26:3300/0 conn(0x7f4ea4133fa0 0x7f4ea4134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:57.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.131+0000 7f4ea8f76700 1 -- 172.21.15.26:0/4177625484 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea40a1fe0 con 0x7f4ea40a1340 2023-10-01T08:00:57.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.131+0000 7f4ea9777700 1 --2- 172.21.15.26:0/4177625484 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ea40a0a30 0x7f4ea40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:57.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.131+0000 7f4ea8f76700 1 --2- 172.21.15.26:0/4177625484 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4ea40a1340 0x7f4ea4133a60 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f4e940098f0 tx=0x7f4e94009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dd18f30dadbe497 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:57.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.132+0000 7f4e9bfff700 1 -- 172.21.15.26:0/4177625484 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e94011830 con 0x7f4ea40a1340 2023-10-01T08:00:57.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.132+0000 7f4e9bfff700 1 -- 172.21.15.26:0/4177625484 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e94011990 con 0x7f4ea40a1340 2023-10-01T08:00:57.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.132+0000 7f4e9bfff700 1 -- 172.21.15.26:0/4177625484 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e94011d20 con 0x7f4ea40a1340 2023-10-01T08:00:57.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.132+0000 7f4eab9db700 1 -- 172.21.15.26:0/4177625484 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4ea40a1340 msgr2=0x7f4ea4133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:57.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.132+0000 7f4eab9db700 1 --2- 172.21.15.26:0/4177625484 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4ea40a1340 0x7f4ea4133a60 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f4e940098f0 tx=0x7f4e94009c00 comp rx=0 tx=0).stop 2023-10-01T08:00:57.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.132+0000 7f4eab9db700 1 -- 172.21.15.26:0/4177625484 shutdown_connections 2023-10-01T08:00:57.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.132+0000 7f4eab9db700 1 --2- 172.21.15.26:0/4177625484 >> v2:172.21.15.26:3300/0 conn(0x7f4ea4133fa0 0x7f4ea4134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:57.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.132+0000 7f4eab9db700 1 --2- 172.21.15.26:0/4177625484 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ea40a0a30 0x7f4ea40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:57.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.132+0000 7f4eab9db700 1 --2- 172.21.15.26:0/4177625484 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4ea40a1340 0x7f4ea4133a60 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:57.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.132+0000 7f4eab9db700 1 -- 172.21.15.26:0/4177625484 >> 172.21.15.26:0/4177625484 conn(0x7f4ea40a6550 msgr2=0x7f4ea40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:57.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.132+0000 7f4eab9db700 1 -- 172.21.15.26:0/4177625484 shutdown_connections 2023-10-01T08:00:57.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.133+0000 7f4eab9db700 1 -- 172.21.15.26:0/4177625484 wait complete. 2023-10-01T08:00:57.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.133+0000 7f4eab9db700 1 Processor -- start 2023-10-01T08:00:57.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.134+0000 7f4eab9db700 1 -- start start 2023-10-01T08:00:57.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.134+0000 7f4eab9db700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ea40a0a30 0x7f4ea411e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:57.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.134+0000 7f4eab9db700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ea40a1340 0x7f4ea411e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:57.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.134+0000 7f4eab9db700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4ea4133fa0 0x7f4ea411ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:57.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.134+0000 7f4eab9db700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea41203f0 con 0x7f4ea40a0a30 2023-10-01T08:00:57.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.134+0000 7f4eab9db700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea4121b40 con 0x7f4ea40a1340 2023-10-01T08:00:57.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.134+0000 7f4eab9db700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea40a3630 con 0x7f4ea4133fa0 2023-10-01T08:00:57.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.134+0000 7f4ea8f76700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ea40a1340 0x7f4ea411e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:57.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.134+0000 7f4ea8f76700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ea40a1340 0x7f4ea411e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:42992/0 (socket says 172.21.15.26:42992) 2023-10-01T08:00:57.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.134+0000 7f4ea8f76700 1 -- 172.21.15.26:0/977222394 learned_addr learned my addr 172.21.15.26:0/977222394 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:57.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.134+0000 7f4ea9777700 1 --2- 172.21.15.26:0/977222394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ea40a0a30 0x7f4ea411e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:57.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.134+0000 7f4ea9f78700 1 --2- 172.21.15.26:0/977222394 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4ea4133fa0 0x7f4ea411ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:57.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.135+0000 7f4ea9777700 1 -- 172.21.15.26:0/977222394 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4ea4133fa0 msgr2=0x7f4ea411ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:57.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.135+0000 7f4ea9777700 1 --2- 172.21.15.26:0/977222394 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4ea4133fa0 0x7f4ea411ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:57.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.135+0000 7f4ea9777700 1 -- 172.21.15.26:0/977222394 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ea40a1340 msgr2=0x7f4ea411e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:57.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.135+0000 7f4ea9777700 1 --2- 172.21.15.26:0/977222394 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ea40a1340 0x7f4ea411e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:57.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.135+0000 7f4ea9777700 1 -- 172.21.15.26:0/977222394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea00094a0 con 0x7f4ea40a0a30 2023-10-01T08:00:57.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.135+0000 7f4ea9f78700 1 --2- 172.21.15.26:0/977222394 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4ea4133fa0 0x7f4ea411ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:57.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.135+0000 7f4ea9777700 1 --2- 172.21.15.26:0/977222394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ea40a0a30 0x7f4ea411e3a0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000e9b0 tx=0x7f4ea000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:57.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.135+0000 7f4e99ffb700 1 -- 172.21.15.26:0/977222394 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea000ee50 con 0x7f4ea40a0a30 2023-10-01T08:00:57.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.135+0000 7f4e99ffb700 1 -- 172.21.15.26:0/977222394 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea000c850 con 0x7f4ea40a0a30 2023-10-01T08:00:57.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.135+0000 7f4eab9db700 1 -- 172.21.15.26:0/977222394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e94009550 con 0x7f4ea40a0a30 2023-10-01T08:00:57.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.135+0000 7f4e99ffb700 1 -- 172.21.15.26:0/977222394 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea000cc00 con 0x7f4ea40a0a30 2023-10-01T08:00:57.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.135+0000 7f4eab9db700 1 -- 172.21.15.26:0/977222394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ea4121880 con 0x7f4ea40a0a30 2023-10-01T08:00:57.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.136+0000 7f4e99ffb700 1 -- 172.21.15.26:0/977222394 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4ea0013470 con 0x7f4ea40a0a30 2023-10-01T08:00:57.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.136+0000 7f4eab9db700 1 -- 172.21.15.26:0/977222394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ea4074ea0 con 0x7f4ea40a0a30 2023-10-01T08:00:57.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.137+0000 7f4e99ffb700 1 -- 172.21.15.26:0/977222394 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4ea003f6d0 con 0x7f4ea40a0a30 2023-10-01T08:00:57.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.141+0000 7f4e99ffb700 1 -- 172.21.15.26:0/977222394 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4ea0013720 con 0x7f4ea40a0a30 2023-10-01T08:00:57.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.174+0000 7ff7735e5700 1 Processor -- start 2023-10-01T08:00:57.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.175+0000 7f22d5aef700 1 -- 172.21.15.26:0/392367554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f22d009f420 con 0x7f22d009d6f0 2023-10-01T08:00:57.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.175+0000 7ff7735e5700 1 -- start start 2023-10-01T08:00:57.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.175+0000 7ff7735e5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff76c06a770 0x7ff76c09d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:57.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.175+0000 7ff7735e5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff76c09dc30 0x7ff76c09e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:57.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.175+0000 7ff7735e5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff76c13c1e0 0x7ff76c13e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:57.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.175+0000 7ff7735e5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff76c06ab40 con 0x7ff76c13c1e0 2023-10-01T08:00:57.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.175+0000 7ff7735e5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c09ebc0 con 0x7ff76c09dc30 2023-10-01T08:00:57.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.175+0000 7ff7735e5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c09a810 con 0x7ff76c06a770 2023-10-01T08:00:57.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.175+0000 7ff771381700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff76c06a770 0x7ff76c09d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:57.177 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:57.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.175+0000 7f22c7fff700 1 -- 172.21.15.26:0/392367554 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f22c0011b40 con 0x7f22d009d6f0 2023-10-01T08:00:57.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.175+0000 7ff771381700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff76c06a770 0x7ff76c09d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41172/0 (socket says 172.21.15.26:41172) 2023-10-01T08:00:57.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.175+0000 7ff771381700 1 -- 172.21.15.26:0/1957710801 learned_addr learned my addr 172.21.15.26:0/1957710801 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:57.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.176+0000 7ff770b80700 1 --2- 172.21.15.26:0/1957710801 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff76c09dc30 0x7ff76c09e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:57.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.176+0000 7ff771b82700 1 --2- 172.21.15.26:0/1957710801 >> v2:172.21.15.26:3300/0 conn(0x7ff76c13c1e0 0x7ff76c13e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:57.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.176+0000 7ff770b80700 1 -- 172.21.15.26:0/1957710801 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff76c06a770 msgr2=0x7ff76c09d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:57.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.176+0000 7ff770b80700 1 --2- 172.21.15.26:0/1957710801 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff76c06a770 0x7ff76c09d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:57.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.176+0000 7ff770b80700 1 -- 172.21.15.26:0/1957710801 >> v2:172.21.15.26:3300/0 conn(0x7ff76c13c1e0 msgr2=0x7ff76c13e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:57.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.176+0000 7ff770b80700 1 --2- 172.21.15.26:0/1957710801 >> v2:172.21.15.26:3300/0 conn(0x7ff76c13c1e0 0x7ff76c13e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:57.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.176+0000 7ff770b80700 1 -- 172.21.15.26:0/1957710801 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76c09e920 con 0x7ff76c09dc30 2023-10-01T08:00:57.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.176+0000 7ff771b82700 1 --2- 172.21.15.26:0/1957710801 >> v2:172.21.15.26:3300/0 conn(0x7ff76c13c1e0 0x7ff76c13e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:57.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.176+0000 7ff770b80700 1 --2- 172.21.15.26:0/1957710801 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff76c09dc30 0x7ff76c09e080 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7ff75c009870 tx=0x7ff75c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=641571d267730b9b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:57.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.176+0000 7ff763fff700 1 -- 172.21.15.26:0/1957710801 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c011830 con 0x7ff76c09dc30 2023-10-01T08:00:57.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.176+0000 7ff763fff700 1 -- 172.21.15.26:0/1957710801 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75c011990 con 0x7ff76c09dc30 2023-10-01T08:00:57.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.176+0000 7ff763fff700 1 -- 172.21.15.26:0/1957710801 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c011d20 con 0x7ff76c09dc30 2023-10-01T08:00:57.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.177+0000 7ff7735e5700 1 -- 172.21.15.26:0/1957710801 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff76c09dc30 msgr2=0x7ff76c09e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:57.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.177+0000 7ff7735e5700 1 --2- 172.21.15.26:0/1957710801 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff76c09dc30 0x7ff76c09e080 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7ff75c009870 tx=0x7ff75c009b80 comp rx=0 tx=0).stop 2023-10-01T08:00:57.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.177+0000 7ff7735e5700 1 -- 172.21.15.26:0/1957710801 shutdown_connections 2023-10-01T08:00:57.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.177+0000 7ff7735e5700 1 --2- 172.21.15.26:0/1957710801 >> v2:172.21.15.26:3300/0 conn(0x7ff76c13c1e0 0x7ff76c13e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:57.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.177+0000 7ff7735e5700 1 --2- 172.21.15.26:0/1957710801 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff76c06a770 0x7ff76c09d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:57.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.177+0000 7ff7735e5700 1 --2- 172.21.15.26:0/1957710801 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff76c09dc30 0x7ff76c09e080 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:57.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.177+0000 7ff7735e5700 1 -- 172.21.15.26:0/1957710801 >> 172.21.15.26:0/1957710801 conn(0x7ff76c066f50 msgr2=0x7ff76c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:57.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.177+0000 7ff7735e5700 1 -- 172.21.15.26:0/1957710801 shutdown_connections 2023-10-01T08:00:57.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.177+0000 7ff7735e5700 1 -- 172.21.15.26:0/1957710801 wait complete. 2023-10-01T08:00:57.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.178+0000 7ff7735e5700 1 Processor -- start 2023-10-01T08:00:57.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.178+0000 7ff7735e5700 1 -- start start 2023-10-01T08:00:57.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.179+0000 7f22d5aef700 1 -- 172.21.15.26:0/392367554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22d009d6f0 msgr2=0x7f22d01a5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:57.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.179+0000 7f22d5aef700 1 --2- 172.21.15.26:0/392367554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22d009d6f0 0x7f22d01a5ed0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f22c000ebe0 tx=0x7f22c000eef0 comp rx=0 tx=0).stop 2023-10-01T08:00:57.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.179+0000 7f22d5aef700 1 -- 172.21.15.26:0/392367554 shutdown_connections 2023-10-01T08:00:57.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.179+0000 7f22d5aef700 1 --2- 172.21.15.26:0/392367554 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22d009e440 0x7f22d01a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:57.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.179+0000 7f22d5aef700 1 --2- 172.21.15.26:0/392367554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22d009d6f0 0x7f22d01a5ed0 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:57.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.179+0000 7f22d5aef700 1 --2- 172.21.15.26:0/392367554 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f22d009e000 0x7f22d01a6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:57.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.179+0000 7f22d5aef700 1 -- 172.21.15.26:0/392367554 >> 172.21.15.26:0/392367554 conn(0x7f22d0066f50 msgr2=0x7f22d01baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:57.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.179+0000 7ff7735e5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff76c06a770 0x7ff76c1cc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:57.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.179+0000 7ff7735e5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff76c09dc30 0x7ff76c1cc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:57.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.179+0000 7ff7735e5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff76c13c1e0 0x7ff76c1cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:57.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.179+0000 7ff7735e5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c128070 con 0x7ff76c06a770 2023-10-01T08:00:57.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.179+0000 7ff7735e5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c127e40 con 0x7ff76c09dc30 2023-10-01T08:00:57.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.179+0000 7ff7735e5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c0a3860 con 0x7ff76c13c1e0 2023-10-01T08:00:57.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.179+0000 7ff770b80700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff76c09dc30 0x7ff76c1cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:57.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.179+0000 7ff771b82700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff76c13c1e0 0x7ff76c1cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:57.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.179+0000 7ff770b80700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff76c09dc30 0x7ff76c1cc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43010/0 (socket says 172.21.15.26:43010) 2023-10-01T08:00:57.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.179+0000 7ff770b80700 1 -- 172.21.15.26:0/2764854310 learned_addr learned my addr 172.21.15.26:0/2764854310 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:57.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.179+0000 7ff771381700 1 --2- 172.21.15.26:0/2764854310 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff76c06a770 0x7ff76c1cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:57.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.179+0000 7ff771b82700 1 -- 172.21.15.26:0/2764854310 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff76c09dc30 msgr2=0x7ff76c1cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:57.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.179+0000 7ff771b82700 1 --2- 172.21.15.26:0/2764854310 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff76c09dc30 0x7ff76c1cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:57.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.179+0000 7ff771b82700 1 -- 172.21.15.26:0/2764854310 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff76c06a770 msgr2=0x7ff76c1cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:57.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.179+0000 7ff771b82700 1 --2- 172.21.15.26:0/2764854310 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff76c06a770 0x7ff76c1cc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:57.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.179+0000 7ff771b82700 1 -- 172.21.15.26:0/2764854310 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff764009a70 con 0x7ff76c13c1e0 2023-10-01T08:00:57.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.180+0000 7ff771b82700 1 --2- 172.21.15.26:0/2764854310 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff76c13c1e0 0x7ff76c1cced0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7ff76400efc0 tx=0x7ff76400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:57.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.180+0000 7f22d5aef700 1 -- 172.21.15.26:0/392367554 shutdown_connections 2023-10-01T08:00:57.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.180+0000 7f22d5aef700 1 -- 172.21.15.26:0/392367554 wait complete. 2023-10-01T08:00:57.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.180+0000 7ff761ffb700 1 -- 172.21.15.26:0/2764854310 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76400ca90 con 0x7ff76c13c1e0 2023-10-01T08:00:57.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.180+0000 7ff761ffb700 1 -- 172.21.15.26:0/2764854310 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76400f040 con 0x7ff76c13c1e0 2023-10-01T08:00:57.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.180+0000 7ff761ffb700 1 -- 172.21.15.26:0/2764854310 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76400ce30 con 0x7ff76c13c1e0 2023-10-01T08:00:57.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.180+0000 7ff7735e5700 1 -- 172.21.15.26:0/2764854310 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff75c0094a0 con 0x7ff76c13c1e0 2023-10-01T08:00:57.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.180+0000 7ff7735e5700 1 -- 172.21.15.26:0/2764854310 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff76c129dc0 con 0x7ff76c13c1e0 2023-10-01T08:00:57.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.181+0000 7ff761ffb700 1 -- 172.21.15.26:0/2764854310 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff764014480 con 0x7ff76c13c1e0 2023-10-01T08:00:57.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.181+0000 7ff761ffb700 1 -- 172.21.15.26:0/2764854310 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff76403fc10 con 0x7ff76c13c1e0 2023-10-01T08:00:57.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.181+0000 7ff7735e5700 1 -- 172.21.15.26:0/2764854310 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff76c074ea0 con 0x7ff76c13c1e0 2023-10-01T08:00:57.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.186+0000 7ff761ffb700 1 -- 172.21.15.26:0/2764854310 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff764012930 con 0x7ff76c13c1e0 2023-10-01T08:00:57.198 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:57.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.368+0000 7f4eab9db700 1 -- 172.21.15.26:0/977222394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4ea40a28e0 con 0x7f4ea40a0a30 2023-10-01T08:00:57.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.368+0000 7f4e99ffb700 1 -- 172.21.15.26:0/977222394 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4ea0021070 con 0x7f4ea40a0a30 2023-10-01T08:00:57.369 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:57.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.370+0000 7f4eab9db700 1 -- 172.21.15.26:0/977222394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ea40a0a30 msgr2=0x7f4ea411e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:57.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.370+0000 7f4eab9db700 1 --2- 172.21.15.26:0/977222394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ea40a0a30 0x7f4ea411e3a0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000e9b0 tx=0x7f4ea000ecc0 comp rx=0 tx=0).stop 2023-10-01T08:00:57.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.370+0000 7f4eab9db700 1 -- 172.21.15.26:0/977222394 shutdown_connections 2023-10-01T08:00:57.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.370+0000 7f4eab9db700 1 --2- 172.21.15.26:0/977222394 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4ea4133fa0 0x7f4ea411ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:57.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.370+0000 7f4eab9db700 1 --2- 172.21.15.26:0/977222394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ea40a0a30 0x7f4ea411e3a0 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:57.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.371+0000 7f4eab9db700 1 --2- 172.21.15.26:0/977222394 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ea40a1340 0x7f4ea411e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:57.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.371+0000 7f4eab9db700 1 -- 172.21.15.26:0/977222394 >> 172.21.15.26:0/977222394 conn(0x7f4ea40a6550 msgr2=0x7f4ea40a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:57.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.371+0000 7f4eab9db700 1 -- 172.21.15.26:0/977222394 shutdown_connections 2023-10-01T08:00:57.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.371+0000 7f4eab9db700 1 -- 172.21.15.26:0/977222394 wait complete. 2023-10-01T08:00:57.385 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:57.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.408+0000 7ff7735e5700 1 -- 172.21.15.26:0/2764854310 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff76c129c20 con 0x7ff76c13c1e0 2023-10-01T08:00:57.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.408+0000 7ff761ffb700 1 -- 172.21.15.26:0/2764854310 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff76c129c20 con 0x7ff76c13c1e0 2023-10-01T08:00:57.409 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:57.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.410+0000 7ff7735e5700 1 -- 172.21.15.26:0/2764854310 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff76c13c1e0 msgr2=0x7ff76c1cced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:57.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.410+0000 7ff7735e5700 1 --2- 172.21.15.26:0/2764854310 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff76c13c1e0 0x7ff76c1cced0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7ff76400efc0 tx=0x7ff76400c3a0 comp rx=0 tx=0).stop 2023-10-01T08:00:57.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.411+0000 7ff7735e5700 1 -- 172.21.15.26:0/2764854310 shutdown_connections 2023-10-01T08:00:57.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.411+0000 7ff7735e5700 1 --2- 172.21.15.26:0/2764854310 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff76c13c1e0 0x7ff76c1cced0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:57.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.411+0000 7ff7735e5700 1 --2- 172.21.15.26:0/2764854310 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff76c06a770 0x7ff76c1cc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:57.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.411+0000 7ff7735e5700 1 --2- 172.21.15.26:0/2764854310 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff76c09dc30 0x7ff76c1cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:57.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.411+0000 7ff7735e5700 1 -- 172.21.15.26:0/2764854310 >> 172.21.15.26:0/2764854310 conn(0x7ff76c066f50 msgr2=0x7ff76c13b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:57.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.411+0000 7ff7735e5700 1 -- 172.21.15.26:0/2764854310 shutdown_connections 2023-10-01T08:00:57.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.411+0000 7ff7735e5700 1 -- 172.21.15.26:0/2764854310 wait complete. 2023-10-01T08:00:57.425 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:57.827 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:57.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.972+0000 7f9a431b0700 1 Processor -- start 2023-10-01T08:00:57.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.972+0000 7f9a431b0700 1 -- start start 2023-10-01T08:00:57.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.973+0000 7f9a431b0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a3c09d6f0 0x7f9a3c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:57.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.973+0000 7f9a431b0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a3c09e410 0x7f9a3c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:57.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.973+0000 7f9a431b0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a3c09b120 con 0x7f9a3c09e000 2023-10-01T08:00:57.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.973+0000 7f9a431b0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c06b460 con 0x7f9a3c09d6f0 2023-10-01T08:00:57.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.973+0000 7f9a431b0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c09a7e0 con 0x7f9a3c09e410 2023-10-01T08:00:57.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.973+0000 7f9a40f4c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a3c09d6f0 0x7f9a3c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:57.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.973+0000 7f9a4174d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a3c09e410 0x7f9a3c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:57.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.973+0000 7f9a40f4c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a3c09d6f0 0x7f9a3c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43024/0 (socket says 172.21.15.26:43024) 2023-10-01T08:00:57.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.973+0000 7f9a4174d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a3c09e410 0x7f9a3c134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41192/0 (socket says 172.21.15.26:41192) 2023-10-01T08:00:57.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.973+0000 7f9a40f4c700 1 -- 172.21.15.26:0/72796903 learned_addr learned my addr 172.21.15.26:0/72796903 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:57.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.973+0000 7f9a3bfff700 1 --1- 172.21.15.26:0/72796903 >> v1:172.21.15.26:6789/0 conn(0x7f9a3c09e000 0x7f9a3c1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39578/0 (socket says 172.21.15.26:39578) 2023-10-01T08:00:57.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.973+0000 7f9a4174d700 1 -- 172.21.15.26:0/72796903 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a3c09d6f0 msgr2=0x7f9a3c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:57.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.973+0000 7f9a4174d700 1 --2- 172.21.15.26:0/72796903 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a3c09d6f0 0x7f9a3c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:57.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.973+0000 7f9a4174d700 1 -- 172.21.15.26:0/72796903 >> v1:172.21.15.26:6789/0 conn(0x7f9a3c09e000 legacy=0x7f9a3c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:57.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.973+0000 7f9a3b7fe700 1 -- 172.21.15.26:0/72796903 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2354315205 0 0) 0x7f9a3c09b120 con 0x7f9a3c09e000 2023-10-01T08:00:57.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.973+0000 7f9a4174d700 1 -- 172.21.15.26:0/72796903 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3c09a500 con 0x7f9a3c09e410 2023-10-01T08:00:57.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.973+0000 7f9a40f4c700 1 --2- 172.21.15.26:0/72796903 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a3c09d6f0 0x7f9a3c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:57.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.973+0000 7f9a4174d700 1 --2- 172.21.15.26:0/72796903 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a3c09e410 0x7f9a3c134100 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f9a34009df0 tx=0x7f9a3400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1842848d0d37152 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:57.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.974+0000 7f9a3b7fe700 1 -- 172.21.15.26:0/72796903 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3400e070 con 0x7f9a3c09e410 2023-10-01T08:00:57.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.974+0000 7f9a3b7fe700 1 -- 172.21.15.26:0/72796903 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3400bae0 con 0x7f9a3c09e410 2023-10-01T08:00:57.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.974+0000 7f9a3b7fe700 1 -- 172.21.15.26:0/72796903 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3400be90 con 0x7f9a3c09e410 2023-10-01T08:00:57.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.974+0000 7f9a431b0700 1 -- 172.21.15.26:0/72796903 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a3c09e410 msgr2=0x7f9a3c134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:57.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.974+0000 7f9a431b0700 1 --2- 172.21.15.26:0/72796903 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a3c09e410 0x7f9a3c134100 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f9a34009df0 tx=0x7f9a3400b330 comp rx=0 tx=0).stop 2023-10-01T08:00:57.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.974+0000 7f9a431b0700 1 -- 172.21.15.26:0/72796903 shutdown_connections 2023-10-01T08:00:57.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.974+0000 7f9a431b0700 1 --2- 172.21.15.26:0/72796903 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a3c09e410 0x7f9a3c134100 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:57.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.974+0000 7f9a431b0700 1 --2- 172.21.15.26:0/72796903 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a3c09d6f0 0x7f9a3c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:57.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.974+0000 7f9a431b0700 1 -- 172.21.15.26:0/72796903 >> 172.21.15.26:0/72796903 conn(0x7f9a3c066f50 msgr2=0x7f9a3c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:57.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.974+0000 7f9a431b0700 1 -- 172.21.15.26:0/72796903 shutdown_connections 2023-10-01T08:00:57.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.974+0000 7f9a431b0700 1 -- 172.21.15.26:0/72796903 wait complete. 2023-10-01T08:00:57.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.975+0000 7f9a431b0700 1 Processor -- start 2023-10-01T08:00:57.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.975+0000 7f9a431b0700 1 -- start start 2023-10-01T08:00:57.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.976+0000 7f9a431b0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a3c09d6f0 0x7f9a3c122320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:57.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.976+0000 7f9a431b0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a3c09e000 0x7f9a3c122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:57.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.976+0000 7f9a431b0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a3c09e410 0x7f9a3c122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:57.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.976+0000 7f9a431b0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c1237f0 con 0x7f9a3c09e000 2023-10-01T08:00:57.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.976+0000 7f9a431b0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c124e00 con 0x7f9a3c09d6f0 2023-10-01T08:00:57.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.976+0000 7f9a431b0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c125e40 con 0x7f9a3c09e410 2023-10-01T08:00:57.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.976+0000 7f9a40f4c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a3c09d6f0 0x7f9a3c122320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:57.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.976+0000 7f9a3bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a3c09e000 0x7f9a3c122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:57.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.976+0000 7f9a40f4c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a3c09d6f0 0x7f9a3c122320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43030/0 (socket says 172.21.15.26:43030) 2023-10-01T08:00:57.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.976+0000 7f9a3bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a3c09e000 0x7f9a3c122860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58514/0 (socket says 172.21.15.26:58514) 2023-10-01T08:00:57.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.976+0000 7f9a40f4c700 1 -- 172.21.15.26:0/2662096907 learned_addr learned my addr 172.21.15.26:0/2662096907 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:57.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.976+0000 7f9a4174d700 1 --2- 172.21.15.26:0/2662096907 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a3c09e410 0x7f9a3c122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:57.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.976+0000 7f9a40f4c700 1 -- 172.21.15.26:0/2662096907 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a3c09e410 msgr2=0x7f9a3c122da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:57.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.976+0000 7f9a40f4c700 1 --2- 172.21.15.26:0/2662096907 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a3c09e410 0x7f9a3c122da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:57.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.976+0000 7f9a40f4c700 1 -- 172.21.15.26:0/2662096907 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a3c09e000 msgr2=0x7f9a3c122860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:57.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.976+0000 7f9a40f4c700 1 --2- 172.21.15.26:0/2662096907 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a3c09e000 0x7f9a3c122860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:57.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.976+0000 7f9a40f4c700 1 -- 172.21.15.26:0/2662096907 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2c009550 con 0x7f9a3c09d6f0 2023-10-01T08:00:57.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.977+0000 7f9a40f4c700 1 --2- 172.21.15.26:0/2662096907 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a3c09d6f0 0x7f9a3c122320 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00ec10 tx=0x7f9a2c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:57.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.977+0000 7f9a397fa700 1 -- 172.21.15.26:0/2662096907 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c00c850 con 0x7f9a3c09d6f0 2023-10-01T08:00:57.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.977+0000 7f9a397fa700 1 -- 172.21.15.26:0/2662096907 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2c00c9b0 con 0x7f9a3c09d6f0 2023-10-01T08:00:57.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.977+0000 7f9a431b0700 1 -- 172.21.15.26:0/2662096907 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a34009a70 con 0x7f9a3c09d6f0 2023-10-01T08:00:57.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.977+0000 7f9a397fa700 1 -- 172.21.15.26:0/2662096907 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c00cd40 con 0x7f9a3c09d6f0 2023-10-01T08:00:57.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.977+0000 7f9a431b0700 1 -- 172.21.15.26:0/2662096907 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a3c0a2020 con 0x7f9a3c09d6f0 2023-10-01T08:00:57.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.978+0000 7f9a431b0700 1 -- 172.21.15.26:0/2662096907 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a3c11f030 con 0x7f9a3c09d6f0 2023-10-01T08:00:57.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.978+0000 7f9a397fa700 1 -- 172.21.15.26:0/2662096907 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9a2c013470 con 0x7f9a3c09d6f0 2023-10-01T08:00:57.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.978+0000 7f9a397fa700 1 -- 172.21.15.26:0/2662096907 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9a2c040090 con 0x7f9a3c09d6f0 2023-10-01T08:00:57.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:57.983+0000 7f9a397fa700 1 -- 172.21.15.26:0/2662096907 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9a2c013720 con 0x7f9a3c09d6f0 2023-10-01T08:00:58.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.193+0000 7f9a431b0700 1 -- 172.21.15.26:0/2662096907 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9a3c074ea0 con 0x7f9a3c09d6f0 2023-10-01T08:00:58.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.193+0000 7f9a397fa700 1 -- 172.21.15.26:0/2662096907 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9a2c017030 con 0x7f9a3c09d6f0 2023-10-01T08:00:58.194 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:58.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.196+0000 7f9a431b0700 1 -- 172.21.15.26:0/2662096907 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a3c09d6f0 msgr2=0x7f9a3c122320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:58.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.196+0000 7f9a431b0700 1 --2- 172.21.15.26:0/2662096907 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a3c09d6f0 0x7f9a3c122320 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00ec10 tx=0x7f9a2c00ef20 comp rx=0 tx=0).stop 2023-10-01T08:00:58.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.196+0000 7f9a431b0700 1 -- 172.21.15.26:0/2662096907 shutdown_connections 2023-10-01T08:00:58.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.196+0000 7f9a431b0700 1 --2- 172.21.15.26:0/2662096907 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a3c09e410 0x7f9a3c122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:58.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.196+0000 7f9a431b0700 1 --2- 172.21.15.26:0/2662096907 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a3c09d6f0 0x7f9a3c122320 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:58.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.196+0000 7f9a431b0700 1 --2- 172.21.15.26:0/2662096907 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a3c09e000 0x7f9a3c122860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:58.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.196+0000 7f9a431b0700 1 -- 172.21.15.26:0/2662096907 >> 172.21.15.26:0/2662096907 conn(0x7f9a3c066f50 msgr2=0x7f9a3c133de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:58.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.196+0000 7f9a431b0700 1 -- 172.21.15.26:0/2662096907 shutdown_connections 2023-10-01T08:00:58.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.196+0000 7f9a431b0700 1 -- 172.21.15.26:0/2662096907 wait complete. 2023-10-01T08:00:58.199 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:58.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:58.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.335+0000 7f9d8ad90700 1 Processor -- start 2023-10-01T08:00:58.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.335+0000 7f9d8ad90700 1 -- start start 2023-10-01T08:00:58.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.335+0000 7f9d8ad90700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9d8409d6f0 0x7f9d8409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:58.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.335+0000 7f9d8ad90700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d8409e000 0x7f9d84130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:58.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.335+0000 7f9d8ad90700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d8409e410 0x7f9d84130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:58.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.336+0000 7f9d8ad90700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d8409f520 con 0x7f9d8409d6f0 2023-10-01T08:00:58.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.336+0000 7f9d8ad90700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8409f130 con 0x7f9d8409e410 2023-10-01T08:00:58.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.336+0000 7f9d8ad90700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8409e930 con 0x7f9d8409e000 2023-10-01T08:00:58.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.336+0000 7f9d83fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d8409e000 0x7f9d84130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:58.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.336+0000 7f9d88b2c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9d8409d6f0 0x7f9d8409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:58.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.336+0000 7f9d8932d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d8409e410 0x7f9d84130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:58.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.336+0000 7f9d8932d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d8409e410 0x7f9d84130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43044/0 (socket says 172.21.15.26:43044) 2023-10-01T08:00:58.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.336+0000 7f9d88b2c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9d8409d6f0 0x7f9d8409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58526/0 (socket says 172.21.15.26:58526) 2023-10-01T08:00:58.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.336+0000 7f9d83fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d8409e000 0x7f9d84130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41214/0 (socket says 172.21.15.26:41214) 2023-10-01T08:00:58.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.336+0000 7f9d8932d700 1 -- 172.21.15.26:0/3024310072 learned_addr learned my addr 172.21.15.26:0/3024310072 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:58.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.336+0000 7f9d88b2c700 1 -- 172.21.15.26:0/3024310072 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d8409e000 msgr2=0x7f9d84130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:58.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.336+0000 7f9d88b2c700 1 --2- 172.21.15.26:0/3024310072 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d8409e000 0x7f9d84130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:58.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.336+0000 7f9d88b2c700 1 -- 172.21.15.26:0/3024310072 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d8409e410 msgr2=0x7f9d84130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:58.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.336+0000 7f9d88b2c700 1 --2- 172.21.15.26:0/3024310072 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d8409e410 0x7f9d84130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:58.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.336+0000 7f9d88b2c700 1 -- 172.21.15.26:0/3024310072 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8409b2d0 con 0x7f9d8409d6f0 2023-10-01T08:00:58.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.336+0000 7f9d8932d700 1 --2- 172.21.15.26:0/3024310072 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d8409e410 0x7f9d84130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:58.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.336+0000 7f9d88b2c700 1 --2- 172.21.15.26:0/3024310072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d8409d6f0 0x7f9d8409dac0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f9d7800bb10 tx=0x7f9d7800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f124be5d8220a9a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:58.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.336+0000 7f9d837fe700 1 -- 172.21.15.26:0/3024310072 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7800dc30 con 0x7f9d8409d6f0 2023-10-01T08:00:58.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.336+0000 7f9d837fe700 1 -- 172.21.15.26:0/3024310072 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7800dd90 con 0x7f9d8409d6f0 2023-10-01T08:00:58.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.336+0000 7f9d837fe700 1 -- 172.21.15.26:0/3024310072 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d78010690 con 0x7f9d8409d6f0 2023-10-01T08:00:58.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.337+0000 7f9d8ad90700 1 -- 172.21.15.26:0/3024310072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d8409d6f0 msgr2=0x7f9d8409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:58.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.337+0000 7f9d8ad90700 1 --2- 172.21.15.26:0/3024310072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d8409d6f0 0x7f9d8409dac0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f9d7800bb10 tx=0x7f9d7800be20 comp rx=0 tx=0).stop 2023-10-01T08:00:58.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.337+0000 7f9d8ad90700 1 -- 172.21.15.26:0/3024310072 shutdown_connections 2023-10-01T08:00:58.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.337+0000 7f9d8ad90700 1 --2- 172.21.15.26:0/3024310072 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d8409e410 0x7f9d84130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:58.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.337+0000 7f9d8ad90700 1 --2- 172.21.15.26:0/3024310072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d8409d6f0 0x7f9d8409dac0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:58.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.337+0000 7f9d8ad90700 1 --2- 172.21.15.26:0/3024310072 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d8409e000 0x7f9d84130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:58.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.337+0000 7f9d8ad90700 1 -- 172.21.15.26:0/3024310072 >> 172.21.15.26:0/3024310072 conn(0x7f9d84066f50 msgr2=0x7f9d8409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:58.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.337+0000 7f9d8ad90700 1 -- 172.21.15.26:0/3024310072 shutdown_connections 2023-10-01T08:00:58.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.337+0000 7f9d8ad90700 1 -- 172.21.15.26:0/3024310072 wait complete. 2023-10-01T08:00:58.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.338+0000 7f9d8ad90700 1 Processor -- start 2023-10-01T08:00:58.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.338+0000 7f9d8ad90700 1 -- start start 2023-10-01T08:00:58.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.339+0000 7f9d8ad90700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d8409d6f0 0x7f9d84122540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:58.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.339+0000 7f9d8ad90700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d8409e000 0x7f9d84122a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:58.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.339+0000 7f9d8ad90700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d8409e410 0x7f9d84122fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:58.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.339+0000 7f9d8ad90700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d84125b00 con 0x7f9d8409e410 2023-10-01T08:00:58.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.339+0000 7f9d8ad90700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d84126bf0 con 0x7f9d8409e000 2023-10-01T08:00:58.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.339+0000 7f9d8ad90700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d84130050 con 0x7f9d8409d6f0 2023-10-01T08:00:58.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.339+0000 7f9d83fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d8409e000 0x7f9d84122a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:58.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.339+0000 7f9d8932d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d8409e410 0x7f9d84122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:58.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.339+0000 7f9d83fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d8409e000 0x7f9d84122a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43046/0 (socket says 172.21.15.26:43046) 2023-10-01T08:00:58.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.339+0000 7f9d83fff700 1 -- 172.21.15.26:0/127959088 learned_addr learned my addr 172.21.15.26:0/127959088 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:58.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.339+0000 7f9d8932d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d8409e410 0x7f9d84122fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58540/0 (socket says 172.21.15.26:58540) 2023-10-01T08:00:58.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.339+0000 7f9d88b2c700 1 --2- 172.21.15.26:0/127959088 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d8409d6f0 0x7f9d84122540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:58.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.339+0000 7f9d83fff700 1 -- 172.21.15.26:0/127959088 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d8409d6f0 msgr2=0x7f9d84122540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:58.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.339+0000 7f9d83fff700 1 --2- 172.21.15.26:0/127959088 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d8409d6f0 0x7f9d84122540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:58.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.339+0000 7f9d83fff700 1 -- 172.21.15.26:0/127959088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d8409e410 msgr2=0x7f9d84122fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:58.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.339+0000 7f9d83fff700 1 --2- 172.21.15.26:0/127959088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d8409e410 0x7f9d84122fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:58.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.339+0000 7f9d83fff700 1 -- 172.21.15.26:0/127959088 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7c009b30 con 0x7f9d8409e000 2023-10-01T08:00:58.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.340+0000 7f9d83fff700 1 --2- 172.21.15.26:0/127959088 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d8409e000 0x7f9d84122a80 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f9d7000e960 tx=0x7f9d7000ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:58.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.340+0000 7f9d817fa700 1 -- 172.21.15.26:0/127959088 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d70013680 con 0x7f9d8409e000 2023-10-01T08:00:58.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.340+0000 7f9d817fa700 1 -- 172.21.15.26:0/127959088 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d700137e0 con 0x7f9d8409e000 2023-10-01T08:00:58.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.340+0000 7f9d8ad90700 1 -- 172.21.15.26:0/127959088 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d7800b740 con 0x7f9d8409e000 2023-10-01T08:00:58.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.340+0000 7f9d817fa700 1 -- 172.21.15.26:0/127959088 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d70013b70 con 0x7f9d8409e000 2023-10-01T08:00:58.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.340+0000 7f9d8ad90700 1 -- 172.21.15.26:0/127959088 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d841246b0 con 0x7f9d8409e000 2023-10-01T08:00:58.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.341+0000 7f9d817fa700 1 -- 172.21.15.26:0/127959088 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d70013cd0 con 0x7f9d8409e000 2023-10-01T08:00:58.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.341+0000 7f9d817fa700 1 -- 172.21.15.26:0/127959088 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9d7003f7f0 con 0x7f9d8409e000 2023-10-01T08:00:58.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.341+0000 7f9d8ad90700 1 -- 172.21.15.26:0/127959088 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d84074ea0 con 0x7f9d8409e000 2023-10-01T08:00:58.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.346+0000 7f9d817fa700 1 -- 172.21.15.26:0/127959088 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d7001be10 con 0x7f9d8409e000 2023-10-01T08:00:58.386 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:58.426 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:58.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.524+0000 7f7410e47700 1 Processor -- start 2023-10-01T08:00:58.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.525+0000 7f7410e47700 1 -- start start 2023-10-01T08:00:58.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.526+0000 7f7410e47700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f740c0a0090 0x7f740c136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:58.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.526+0000 7f7410e47700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f740c09d130 0x7f740c139170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:58.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.526+0000 7f7410e47700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f740c09ba70 con 0x7f740c09c650 2023-10-01T08:00:58.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.526+0000 7f7410e47700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f740c09e8f0 con 0x7f740c0a0090 2023-10-01T08:00:58.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.526+0000 7f7410e47700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f740c0a0760 con 0x7f740c09d130 2023-10-01T08:00:58.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.526+0000 7f740a59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f740c09c650 0x7f740c09ca20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39592/0 (socket says 172.21.15.26:39592) 2023-10-01T08:00:58.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.526+0000 7f740a59c700 1 -- 172.21.15.26:0/558803304 learned_addr learned my addr 172.21.15.26:0/558803304 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:00:58.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.526+0000 7f7409d9b700 1 --2- 172.21.15.26:0/558803304 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f740c0a0090 0x7f740c136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:58.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.526+0000 7f740ad9d700 1 --2- 172.21.15.26:0/558803304 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f740c09d130 0x7f740c139170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:58.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.526+0000 7f740959a700 1 -- 172.21.15.26:0/558803304 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 767735499 0 0) 0x7f740c09ba70 con 0x7f740c09c650 2023-10-01T08:00:58.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.526+0000 7f740959a700 1 -- 172.21.15.26:0/558803304 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73f40035b0 con 0x7f740c09c650 2023-10-01T08:00:58.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.526+0000 7f740ad9d700 1 -- 172.21.15.26:0/558803304 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f740c0a0090 msgr2=0x7f740c136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:58.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.526+0000 7f740ad9d700 1 --2- 172.21.15.26:0/558803304 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f740c0a0090 0x7f740c136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:58.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.526+0000 7f740ad9d700 1 -- 172.21.15.26:0/558803304 >> v1:172.21.15.26:6789/0 conn(0x7f740c09c650 legacy=0x7f740c09ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:58.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.526+0000 7f740ad9d700 1 -- 172.21.15.26:0/558803304 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f740c09a080 con 0x7f740c09d130 2023-10-01T08:00:58.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.526+0000 7f7409d9b700 1 --2- 172.21.15.26:0/558803304 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f740c0a0090 0x7f740c136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:58.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.527+0000 7f740ad9d700 1 --2- 172.21.15.26:0/558803304 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f740c09d130 0x7f740c139170 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f7404009dc0 tx=0x7f740400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3aab958fc322ab1b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:58.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.527+0000 7f740959a700 1 -- 172.21.15.26:0/558803304 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740400e070 con 0x7f740c09d130 2023-10-01T08:00:58.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.527+0000 7f740959a700 1 -- 172.21.15.26:0/558803304 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740400bb20 con 0x7f740c09d130 2023-10-01T08:00:58.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.527+0000 7f740959a700 1 -- 172.21.15.26:0/558803304 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740400be90 con 0x7f740c09d130 2023-10-01T08:00:58.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.527+0000 7f7410e47700 1 -- 172.21.15.26:0/558803304 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f740c09d130 msgr2=0x7f740c139170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:58.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.528+0000 7f7410e47700 1 --2- 172.21.15.26:0/558803304 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f740c09d130 0x7f740c139170 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f7404009dc0 tx=0x7f740400b330 comp rx=0 tx=0).stop 2023-10-01T08:00:58.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.528+0000 7f7410e47700 1 -- 172.21.15.26:0/558803304 shutdown_connections 2023-10-01T08:00:58.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.528+0000 7f7410e47700 1 --2- 172.21.15.26:0/558803304 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f740c09d130 0x7f740c139170 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:58.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.528+0000 7f7410e47700 1 --2- 172.21.15.26:0/558803304 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f740c0a0090 0x7f740c136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:58.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.528+0000 7f7410e47700 1 -- 172.21.15.26:0/558803304 >> 172.21.15.26:0/558803304 conn(0x7f740c0a3f70 msgr2=0x7f740c0a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:58.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.528+0000 7f7410e47700 1 -- 172.21.15.26:0/558803304 shutdown_connections 2023-10-01T08:00:58.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.528+0000 7f7410e47700 1 -- 172.21.15.26:0/558803304 wait complete. 2023-10-01T08:00:58.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.529+0000 7f7410e47700 1 Processor -- start 2023-10-01T08:00:58.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.529+0000 7f7410e47700 1 -- start start 2023-10-01T08:00:58.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.529+0000 7f7410e47700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f740c09c650 0x7f740c11bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:58.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.529+0000 7f7410e47700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f740c09d130 0x7f740c11c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:58.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.529+0000 7f7410e47700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f740c0a0090 0x7f740c11c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:58.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.529+0000 7f7410e47700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740c11e7d0 con 0x7f740c09d130 2023-10-01T08:00:58.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.529+0000 7f7410e47700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f740c11da70 con 0x7f740c09c650 2023-10-01T08:00:58.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.529+0000 7f7410e47700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f740c06c9a0 con 0x7f740c0a0090 2023-10-01T08:00:58.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.530+0000 7f740a59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f740c09c650 0x7f740c11bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:58.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.530+0000 7f740a59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f740c09c650 0x7f740c11bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43058/0 (socket says 172.21.15.26:43058) 2023-10-01T08:00:58.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.530+0000 7f740a59c700 1 -- 172.21.15.26:0/110291449 learned_addr learned my addr 172.21.15.26:0/110291449 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:58.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.530+0000 7f7409d9b700 1 --2- 172.21.15.26:0/110291449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f740c09d130 0x7f740c11c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:58.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.530+0000 7f740ad9d700 1 --2- 172.21.15.26:0/110291449 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f740c0a0090 0x7f740c11c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:58.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.530+0000 7f740a59c700 1 -- 172.21.15.26:0/110291449 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f740c0a0090 msgr2=0x7f740c11c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:58.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.530+0000 7f740a59c700 1 --2- 172.21.15.26:0/110291449 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f740c0a0090 0x7f740c11c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:58.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.530+0000 7f740a59c700 1 -- 172.21.15.26:0/110291449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f740c09d130 msgr2=0x7f740c11c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:58.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.530+0000 7f740a59c700 1 --2- 172.21.15.26:0/110291449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f740c09d130 0x7f740c11c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:58.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.530+0000 7f740a59c700 1 -- 172.21.15.26:0/110291449 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74000094a0 con 0x7f740c09c650 2023-10-01T08:00:58.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.530+0000 7f7409d9b700 1 --2- 172.21.15.26:0/110291449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f740c09d130 0x7f740c11c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:58.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.530+0000 7f740a59c700 1 --2- 172.21.15.26:0/110291449 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f740c09c650 0x7f740c11bdc0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f73fc00c700 tx=0x7f73fc00ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:58.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.530+0000 7f73faffd700 1 -- 172.21.15.26:0/110291449 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc005d70 con 0x7f740c09c650 2023-10-01T08:00:58.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.530+0000 7f73faffd700 1 -- 172.21.15.26:0/110291449 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73fc0070d0 con 0x7f740c09c650 2023-10-01T08:00:58.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.531+0000 7f7410e47700 1 -- 172.21.15.26:0/110291449 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7404009a70 con 0x7f740c09c650 2023-10-01T08:00:58.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.531+0000 7f73faffd700 1 -- 172.21.15.26:0/110291449 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc007460 con 0x7f740c09c650 2023-10-01T08:00:58.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.531+0000 7f7410e47700 1 -- 172.21.15.26:0/110291449 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f740c11ec90 con 0x7f740c09c650 2023-10-01T08:00:58.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.532+0000 7f7410e47700 1 -- 172.21.15.26:0/110291449 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f740c070fb0 con 0x7f740c09c650 2023-10-01T08:00:58.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.532+0000 7f73faffd700 1 -- 172.21.15.26:0/110291449 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f73fc0075c0 con 0x7f740c09c650 2023-10-01T08:00:58.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.532+0000 7f73faffd700 1 -- 172.21.15.26:0/110291449 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f73fc03eae0 con 0x7f740c09c650 2023-10-01T08:00:58.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.541+0000 7f73faffd700 1 -- 172.21.15.26:0/110291449 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f73fc018260 con 0x7f740c09c650 2023-10-01T08:00:58.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.556+0000 7f9d8ad90700 1 -- 172.21.15.26:0/127959088 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9d841248f0 con 0x7f9d8409e000 2023-10-01T08:00:58.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.557+0000 7f9d817fa700 1 -- 172.21.15.26:0/127959088 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9d7002a090 con 0x7f9d8409e000 2023-10-01T08:00:58.558 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:58.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.559+0000 7f9d8ad90700 1 -- 172.21.15.26:0/127959088 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d8409e000 msgr2=0x7f9d84122a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:58.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.559+0000 7f9d8ad90700 1 --2- 172.21.15.26:0/127959088 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d8409e000 0x7f9d84122a80 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f9d7000e960 tx=0x7f9d7000ec70 comp rx=0 tx=0).stop 2023-10-01T08:00:58.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.559+0000 7f9d8ad90700 1 -- 172.21.15.26:0/127959088 shutdown_connections 2023-10-01T08:00:58.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.559+0000 7f9d8ad90700 1 --2- 172.21.15.26:0/127959088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d8409e410 0x7f9d84122fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:58.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.559+0000 7f9d8ad90700 1 --2- 172.21.15.26:0/127959088 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d8409d6f0 0x7f9d84122540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:58.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.559+0000 7f9d8ad90700 1 --2- 172.21.15.26:0/127959088 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d8409e000 0x7f9d84122a80 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:58.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.559+0000 7f9d8ad90700 1 -- 172.21.15.26:0/127959088 >> 172.21.15.26:0/127959088 conn(0x7f9d84066f50 msgr2=0x7f9d8406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:58.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.560+0000 7f9d8ad90700 1 -- 172.21.15.26:0/127959088 shutdown_connections 2023-10-01T08:00:58.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.560+0000 7f9d8ad90700 1 -- 172.21.15.26:0/127959088 wait complete. 2023-10-01T08:00:58.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.568+0000 7f7118130700 1 Processor -- start 2023-10-01T08:00:58.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.569+0000 7f7118130700 1 -- start start 2023-10-01T08:00:58.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.570+0000 7f7118130700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f711009e930 0x7f711009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:58.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.570+0000 7f7118130700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f711009f240 0x7f71101317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:58.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.570+0000 7f7118130700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f711009f650 0x7f7110131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:58.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.570+0000 7f7118130700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7110070940 con 0x7f711009f240 2023-10-01T08:00:58.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.570+0000 7f7118130700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711006fd60 con 0x7f711009f650 2023-10-01T08:00:58.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.570+0000 7f7118130700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f711006fa80 con 0x7f711009e930 2023-10-01T08:00:58.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.570+0000 7f71156cb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f711009f240 0x7f71101317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:58.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.570+0000 7f7115ecc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f711009e930 0x7f711009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:58.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.570+0000 7f71156cb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f711009f240 0x7f71101317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58562/0 (socket says 172.21.15.26:58562) 2023-10-01T08:00:58.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.570+0000 7f71156cb700 1 -- 172.21.15.26:0/4294236682 learned_addr learned my addr 172.21.15.26:0/4294236682 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:58.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.570+0000 7f71166cd700 1 --2- 172.21.15.26:0/4294236682 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f711009f650 0x7f7110131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:58.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.570+0000 7f71156cb700 1 -- 172.21.15.26:0/4294236682 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f711009e930 msgr2=0x7f711009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:58.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.570+0000 7f71156cb700 1 --2- 172.21.15.26:0/4294236682 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f711009e930 0x7f711009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:58.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.570+0000 7f71156cb700 1 -- 172.21.15.26:0/4294236682 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f711009f650 msgr2=0x7f7110131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:58.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.570+0000 7f71156cb700 1 --2- 172.21.15.26:0/4294236682 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f711009f650 0x7f7110131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:58.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.570+0000 7f71156cb700 1 -- 172.21.15.26:0/4294236682 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711009fb60 con 0x7f711009f240 2023-10-01T08:00:58.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.570+0000 7f7115ecc700 1 --2- 172.21.15.26:0/4294236682 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f711009e930 0x7f711009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:58.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.571+0000 7f71156cb700 1 --2- 172.21.15.26:0/4294236682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f711009f240 0x7f71101317f0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f71000098f0 tx=0x7f7100009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=942212d0417e928 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:58.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.571+0000 7f7114eca700 1 -- 172.21.15.26:0/4294236682 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7100011830 con 0x7f711009f240 2023-10-01T08:00:58.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.571+0000 7f7114eca700 1 -- 172.21.15.26:0/4294236682 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7100011990 con 0x7f711009f240 2023-10-01T08:00:58.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.571+0000 7f7114eca700 1 -- 172.21.15.26:0/4294236682 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7100011d20 con 0x7f711009f240 2023-10-01T08:00:58.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.571+0000 7f7118130700 1 -- 172.21.15.26:0/4294236682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f711009f240 msgr2=0x7f71101317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:58.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.571+0000 7f7118130700 1 --2- 172.21.15.26:0/4294236682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f711009f240 0x7f71101317f0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f71000098f0 tx=0x7f7100009c00 comp rx=0 tx=0).stop 2023-10-01T08:00:58.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.572+0000 7f7118130700 1 -- 172.21.15.26:0/4294236682 shutdown_connections 2023-10-01T08:00:58.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.572+0000 7f7118130700 1 --2- 172.21.15.26:0/4294236682 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f711009f650 0x7f7110131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:58.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.572+0000 7f7118130700 1 --2- 172.21.15.26:0/4294236682 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f711009e930 0x7f711009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:58.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.572+0000 7f7118130700 1 --2- 172.21.15.26:0/4294236682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f711009f240 0x7f71101317f0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:58.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.572+0000 7f7118130700 1 -- 172.21.15.26:0/4294236682 >> 172.21.15.26:0/4294236682 conn(0x7f71100a4210 msgr2=0x7f71100a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:58.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.572+0000 7f7118130700 1 -- 172.21.15.26:0/4294236682 shutdown_connections 2023-10-01T08:00:58.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.572+0000 7f7118130700 1 -- 172.21.15.26:0/4294236682 wait complete. 2023-10-01T08:00:58.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.573+0000 7f7118130700 1 Processor -- start 2023-10-01T08:00:58.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.573+0000 7f7118130700 1 -- start start 2023-10-01T08:00:58.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.573+0000 7f7118130700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f711009e930 0x7f71101a2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:58.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.573+0000 7f7118130700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f711009f240 0x7f71101a30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:58.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.573+0000 7f7118130700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f711009f650 0x7f71101a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:58.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.573+0000 7f7118130700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71101a7040 con 0x7f711009f650 2023-10-01T08:00:58.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.573+0000 7f7118130700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71101a6680 con 0x7f711009e930 2023-10-01T08:00:58.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.573+0000 7f7118130700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71101a5a50 con 0x7f711009f240 2023-10-01T08:00:58.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.573+0000 7f7115ecc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f711009e930 0x7f71101a2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:58.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.573+0000 7f7115ecc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f711009e930 0x7f71101a2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43072/0 (socket says 172.21.15.26:43072) 2023-10-01T08:00:58.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.573+0000 7f7115ecc700 1 -- 172.21.15.26:0/3568944209 learned_addr learned my addr 172.21.15.26:0/3568944209 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:58.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.573+0000 7f71166cd700 1 --2- 172.21.15.26:0/3568944209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f711009f650 0x7f71101a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:58.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.573+0000 7f71156cb700 1 --2- 172.21.15.26:0/3568944209 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f711009f240 0x7f71101a30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:58.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.574+0000 7f71166cd700 1 -- 172.21.15.26:0/3568944209 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f711009f240 msgr2=0x7f71101a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:58.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.574+0000 7f71166cd700 1 --2- 172.21.15.26:0/3568944209 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f711009f240 0x7f71101a30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:58.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.574+0000 7f71166cd700 1 -- 172.21.15.26:0/3568944209 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f711009e930 msgr2=0x7f71101a2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:58.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.574+0000 7f71166cd700 1 --2- 172.21.15.26:0/3568944209 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f711009e930 0x7f71101a2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:58.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.574+0000 7f71166cd700 1 -- 172.21.15.26:0/3568944209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710c0094a0 con 0x7f711009f650 2023-10-01T08:00:58.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.574+0000 7f7115ecc700 1 --2- 172.21.15.26:0/3568944209 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f711009e930 0x7f71101a2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:58.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.574+0000 7f71166cd700 1 --2- 172.21.15.26:0/3568944209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f711009f650 0x7f71101a35e0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f7108007d60 tx=0x7f710800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:58.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.574+0000 7f71067fc700 1 -- 172.21.15.26:0/3568944209 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7108018070 con 0x7f711009f650 2023-10-01T08:00:58.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.574+0000 7f71067fc700 1 -- 172.21.15.26:0/3568944209 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710800eb30 con 0x7f711009f650 2023-10-01T08:00:58.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.574+0000 7f7118130700 1 -- 172.21.15.26:0/3568944209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7100009550 con 0x7f711009f650 2023-10-01T08:00:58.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.574+0000 7f7118130700 1 -- 172.21.15.26:0/3568944209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71100a0190 con 0x7f711009f650 2023-10-01T08:00:58.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.574+0000 7f71067fc700 1 -- 172.21.15.26:0/3568944209 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7108003a20 con 0x7f711009f650 2023-10-01T08:00:58.584 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:00:58.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.576+0000 7f7118130700 1 -- 172.21.15.26:0/3568944209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70f80052e0 con 0x7f711009f650 2023-10-01T08:00:58.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.576+0000 7f71067fc700 1 -- 172.21.15.26:0/3568944209 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7108014420 con 0x7f711009f650 2023-10-01T08:00:58.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.576+0000 7f71067fc700 1 -- 172.21.15.26:0/3568944209 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f710803f600 con 0x7f711009f650 2023-10-01T08:00:58.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.581+0000 7f71067fc700 1 -- 172.21.15.26:0/3568944209 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f71080126a0 con 0x7f711009f650 2023-10-01T08:00:58.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.752+0000 7f7410e47700 1 -- 172.21.15.26:0/110291449 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f740c0747f0 con 0x7f740c09c650 2023-10-01T08:00:58.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.753+0000 7f73faffd700 1 -- 172.21.15.26:0/110291449 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f73fc017070 con 0x7f740c09c650 2023-10-01T08:00:58.754 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:00:58.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.755+0000 7f7410e47700 1 -- 172.21.15.26:0/110291449 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f740c09c650 msgr2=0x7f740c11bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:58.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.755+0000 7f7410e47700 1 --2- 172.21.15.26:0/110291449 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f740c09c650 0x7f740c11bdc0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f73fc00c700 tx=0x7f73fc00ca10 comp rx=0 tx=0).stop 2023-10-01T08:00:58.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.755+0000 7f7410e47700 1 -- 172.21.15.26:0/110291449 shutdown_connections 2023-10-01T08:00:58.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.755+0000 7f7410e47700 1 --2- 172.21.15.26:0/110291449 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f740c0a0090 0x7f740c11c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:58.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.755+0000 7f7410e47700 1 --2- 172.21.15.26:0/110291449 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f740c09c650 0x7f740c11bdc0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:58.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.755+0000 7f7410e47700 1 --2- 172.21.15.26:0/110291449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f740c09d130 0x7f740c11c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:58.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.755+0000 7f7410e47700 1 -- 172.21.15.26:0/110291449 >> 172.21.15.26:0/110291449 conn(0x7f740c0a3f70 msgr2=0x7f740c12eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:58.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.755+0000 7f7410e47700 1 -- 172.21.15.26:0/110291449 shutdown_connections 2023-10-01T08:00:58.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.755+0000 7f7410e47700 1 -- 172.21.15.26:0/110291449 wait complete. 2023-10-01T08:00:58.769 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:00:58.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.786+0000 7f7118130700 1 -- 172.21.15.26:0/3568944209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f70f8005590 con 0x7f711009f650 2023-10-01T08:00:58.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.786+0000 7f71067fc700 1 -- 172.21.15.26:0/3568944209 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f71080122e0 con 0x7f711009f650 2023-10-01T08:00:58.787 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:00:58.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.788+0000 7f7118130700 1 -- 172.21.15.26:0/3568944209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f711009f650 msgr2=0x7f71101a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:58.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.788+0000 7f7118130700 1 --2- 172.21.15.26:0/3568944209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f711009f650 0x7f71101a35e0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f7108007d60 tx=0x7f710800e3c0 comp rx=0 tx=0).stop 2023-10-01T08:00:58.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.788+0000 7f7118130700 1 -- 172.21.15.26:0/3568944209 shutdown_connections 2023-10-01T08:00:58.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.788+0000 7f7118130700 1 --2- 172.21.15.26:0/3568944209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f711009f650 0x7f71101a35e0 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:58.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.788+0000 7f7118130700 1 --2- 172.21.15.26:0/3568944209 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f711009e930 0x7f71101a2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:58.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.788+0000 7f7118130700 1 --2- 172.21.15.26:0/3568944209 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f711009f240 0x7f71101a30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:58.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.788+0000 7f7118130700 1 -- 172.21.15.26:0/3568944209 >> 172.21.15.26:0/3568944209 conn(0x7f71100a4210 msgr2=0x7f71101b7ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:58.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.788+0000 7f7118130700 1 -- 172.21.15.26:0/3568944209 shutdown_connections 2023-10-01T08:00:58.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:58.788+0000 7f7118130700 1 -- 172.21.15.26:0/3568944209 wait complete. 2023-10-01T08:00:58.802 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:00:59.212 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:00:59.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.357+0000 7fb7f432b700 1 Processor -- start 2023-10-01T08:00:59.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.357+0000 7fb7f432b700 1 -- start start 2023-10-01T08:00:59.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.358+0000 7fb7f432b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb7ec09e930 0x7fb7ec09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:59.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.358+0000 7fb7f432b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7ec09f650 0x7fb7ec131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:59.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.358+0000 7fb7f432b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7ec070940 con 0x7fb7ec09f240 2023-10-01T08:00:59.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.358+0000 7fb7f432b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7ec06fd60 con 0x7fb7ec09e930 2023-10-01T08:00:59.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.358+0000 7fb7f432b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec06fa80 con 0x7fb7ec09f650 2023-10-01T08:00:59.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.358+0000 7fb7f20c7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb7ec09e930 0x7fb7ec09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:59.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.358+0000 7fb7f28c8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7ec09f650 0x7fb7ec131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:59.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.358+0000 7fb7f20c7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb7ec09e930 0x7fb7ec09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58570/0 (socket says 172.21.15.26:58570) 2023-10-01T08:00:59.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.358+0000 7fb7f20c7700 1 -- 172.21.15.26:0/3307427320 learned_addr learned my addr 172.21.15.26:0/3307427320 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:59.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.358+0000 7fb7f28c8700 1 -- 172.21.15.26:0/3307427320 >> v2:172.21.15.26:3300/0 conn(0x7fb7ec09e930 msgr2=0x7fb7ec09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:59.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.358+0000 7fb7f28c8700 1 --2- 172.21.15.26:0/3307427320 >> v2:172.21.15.26:3300/0 conn(0x7fb7ec09e930 0x7fb7ec09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:59.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.358+0000 7fb7f28c8700 1 -- 172.21.15.26:0/3307427320 >> v1:172.21.15.26:6789/0 conn(0x7fb7ec09f240 legacy=0x7fb7ec1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:59.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.359+0000 7fb7f28c8700 1 -- 172.21.15.26:0/3307427320 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ec09fb60 con 0x7fb7ec09f650 2023-10-01T08:00:59.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.359+0000 7fb7f28c8700 1 --2- 172.21.15.26:0/3307427320 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7ec09f650 0x7fb7ec131f00 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4009d90 tx=0x7fb7e400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe5c8efee3f1a9c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:59.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.359+0000 7fb7f10c5700 1 -- 172.21.15.26:0/3307427320 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e400e070 con 0x7fb7ec09f650 2023-10-01T08:00:59.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.359+0000 7fb7f10c5700 1 -- 172.21.15.26:0/3307427320 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e400bb20 con 0x7fb7ec09f650 2023-10-01T08:00:59.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.359+0000 7fb7f10c5700 1 -- 172.21.15.26:0/3307427320 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e4012430 con 0x7fb7ec09f650 2023-10-01T08:00:59.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.359+0000 7fb7f432b700 1 -- 172.21.15.26:0/3307427320 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7ec09f650 msgr2=0x7fb7ec131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:59.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.359+0000 7fb7f432b700 1 --2- 172.21.15.26:0/3307427320 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7ec09f650 0x7fb7ec131f00 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4009d90 tx=0x7fb7e400b330 comp rx=0 tx=0).stop 2023-10-01T08:00:59.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.360+0000 7fb7f432b700 1 -- 172.21.15.26:0/3307427320 shutdown_connections 2023-10-01T08:00:59.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.360+0000 7fb7f432b700 1 --2- 172.21.15.26:0/3307427320 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7ec09f650 0x7fb7ec131f00 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:59.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.360+0000 7fb7f432b700 1 --2- 172.21.15.26:0/3307427320 >> v2:172.21.15.26:3300/0 conn(0x7fb7ec09e930 0x7fb7ec09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:59.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.360+0000 7fb7f432b700 1 -- 172.21.15.26:0/3307427320 >> 172.21.15.26:0/3307427320 conn(0x7fb7ec0a4210 msgr2=0x7fb7ec0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:59.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.360+0000 7fb7f432b700 1 -- 172.21.15.26:0/3307427320 shutdown_connections 2023-10-01T08:00:59.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.360+0000 7fb7f432b700 1 -- 172.21.15.26:0/3307427320 wait complete. 2023-10-01T08:00:59.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.361+0000 7fb7f432b700 1 Processor -- start 2023-10-01T08:00:59.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.361+0000 7fb7f432b700 1 -- start start 2023-10-01T08:00:59.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.361+0000 7fb7f432b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7ec09e930 0x7fb7ec1c2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:59.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.361+0000 7fb7f432b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7ec09f240 0x7fb7ec1c3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:59.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.361+0000 7fb7f432b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7ec09f650 0x7fb7ec1c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:59.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.361+0000 7fb7f432b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec1a7420 con 0x7fb7ec09f650 2023-10-01T08:00:59.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.361+0000 7fb7f432b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec1a6960 con 0x7fb7ec09e930 2023-10-01T08:00:59.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.361+0000 7fb7f432b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec1c3980 con 0x7fb7ec09f240 2023-10-01T08:00:59.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.361+0000 7fb7f20c7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7ec09e930 0x7fb7ec1c2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:59.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.361+0000 7fb7f18c6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7ec09f240 0x7fb7ec1c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:59.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.361+0000 7fb7f28c8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7ec09f650 0x7fb7ec1c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:59.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.361+0000 7fb7f20c7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7ec09e930 0x7fb7ec1c2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43074/0 (socket says 172.21.15.26:43074) 2023-10-01T08:00:59.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.361+0000 7fb7f28c8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7ec09f650 0x7fb7ec1c5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58580/0 (socket says 172.21.15.26:58580) 2023-10-01T08:00:59.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.361+0000 7fb7f20c7700 1 -- 172.21.15.26:0/3169724544 learned_addr learned my addr 172.21.15.26:0/3169724544 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:59.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.361+0000 7fb7f18c6700 1 --2- 172.21.15.26:0/3169724544 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7ec09f240 0x7fb7ec1c3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41272/0 (socket says 172.21.15.26:41272) 2023-10-01T08:00:59.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.362+0000 7fb7f28c8700 1 -- 172.21.15.26:0/3169724544 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7ec09f240 msgr2=0x7fb7ec1c3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:59.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.362+0000 7fb7f28c8700 1 --2- 172.21.15.26:0/3169724544 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7ec09f240 0x7fb7ec1c3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:59.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.362+0000 7fb7f28c8700 1 -- 172.21.15.26:0/3169724544 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7ec09e930 msgr2=0x7fb7ec1c2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:59.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.362+0000 7fb7f28c8700 1 --2- 172.21.15.26:0/3169724544 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7ec09e930 0x7fb7ec1c2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:59.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.362+0000 7fb7f28c8700 1 -- 172.21.15.26:0/3169724544 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e4009a70 con 0x7fb7ec09f650 2023-10-01T08:00:59.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.362+0000 7fb7f18c6700 1 --2- 172.21.15.26:0/3169724544 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7ec09f240 0x7fb7ec1c3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:59.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.362+0000 7fb7f20c7700 1 --2- 172.21.15.26:0/3169724544 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7ec09e930 0x7fb7ec1c2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:59.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.362+0000 7fb7f28c8700 1 --2- 172.21.15.26:0/3169724544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7ec09f650 0x7fb7ec1c5f20 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4016000 tx=0x7fb7e4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:59.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.362+0000 7fb7e2ffd700 1 -- 172.21.15.26:0/3169724544 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e4012430 con 0x7fb7ec09f650 2023-10-01T08:00:59.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.362+0000 7fb7e2ffd700 1 -- 172.21.15.26:0/3169724544 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e4020070 con 0x7fb7ec09f650 2023-10-01T08:00:59.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.362+0000 7fb7f432b700 1 -- 172.21.15.26:0/3169724544 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7ec0a0190 con 0x7fb7ec09f650 2023-10-01T08:00:59.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.362+0000 7fb7e2ffd700 1 -- 172.21.15.26:0/3169724544 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e4004040 con 0x7fb7ec09f650 2023-10-01T08:00:59.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.362+0000 7fb7f432b700 1 -- 172.21.15.26:0/3169724544 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7ec1a5000 con 0x7fb7ec09f650 2023-10-01T08:00:59.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.363+0000 7fb7e2ffd700 1 -- 172.21.15.26:0/3169724544 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb7e40041a0 con 0x7fb7ec09f650 2023-10-01T08:00:59.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.363+0000 7fb7e2ffd700 1 -- 172.21.15.26:0/3169724544 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb7e4022070 con 0x7fb7ec09f650 2023-10-01T08:00:59.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.363+0000 7fb7f432b700 1 -- 172.21.15.26:0/3169724544 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7ec0a3690 con 0x7fb7ec09f650 2023-10-01T08:00:59.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.368+0000 7fb7e2ffd700 1 -- 172.21.15.26:0/3169724544 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb7e4004450 con 0x7fb7ec09f650 2023-10-01T08:00:59.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.573+0000 7fb7f432b700 1 -- 172.21.15.26:0/3169724544 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb7ec1a5000 con 0x7fb7ec09f650 2023-10-01T08:00:59.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.574+0000 7fb7e2ffd700 1 -- 172.21.15.26:0/3169724544 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb7e4035090 con 0x7fb7ec09f650 2023-10-01T08:00:59.575 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:00:59.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.576+0000 7fb7f432b700 1 -- 172.21.15.26:0/3169724544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7ec09f650 msgr2=0x7fb7ec1c5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:59.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.576+0000 7fb7f432b700 1 --2- 172.21.15.26:0/3169724544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7ec09f650 0x7fb7ec1c5f20 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4016000 tx=0x7fb7e4004ad0 comp rx=0 tx=0).stop 2023-10-01T08:00:59.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.576+0000 7fb7f432b700 1 -- 172.21.15.26:0/3169724544 shutdown_connections 2023-10-01T08:00:59.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.576+0000 7fb7f432b700 1 --2- 172.21.15.26:0/3169724544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7ec09f650 0x7fb7ec1c5f20 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:59.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.576+0000 7fb7f432b700 1 --2- 172.21.15.26:0/3169724544 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7ec09e930 0x7fb7ec1c2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:59.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.576+0000 7fb7f432b700 1 --2- 172.21.15.26:0/3169724544 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7ec09f240 0x7fb7ec1c3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:59.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.576+0000 7fb7f432b700 1 -- 172.21.15.26:0/3169724544 >> 172.21.15.26:0/3169724544 conn(0x7fb7ec0a4210 msgr2=0x7fb7ec1b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:59.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.576+0000 7fb7f432b700 1 -- 172.21.15.26:0/3169724544 shutdown_connections 2023-10-01T08:00:59.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.576+0000 7fb7f432b700 1 -- 172.21.15.26:0/3169724544 wait complete. 2023-10-01T08:00:59.585 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:00:59.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:00:59.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.720+0000 7f32b415c700 1 Processor -- start 2023-10-01T08:00:59.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.721+0000 7f32b415c700 1 -- start start 2023-10-01T08:00:59.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.721+0000 7f32b415c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f32ac09e930 0x7f32ac09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:59.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.721+0000 7f32b415c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f32ac09f240 0x7f32ac1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:59.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.721+0000 7f32b415c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f32ac09f650 0x7f32ac131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:59.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.721+0000 7f32b415c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32ac070940 con 0x7f32ac09e930 2023-10-01T08:00:59.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.721+0000 7f32b415c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac06fd60 con 0x7f32ac09f240 2023-10-01T08:00:59.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.721+0000 7f32b415c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac06fa80 con 0x7f32ac09f650 2023-10-01T08:00:59.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.721+0000 7f32b16f7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f32ac09f240 0x7f32ac1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:59.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.721+0000 7f32b1ef8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f32ac09e930 0x7f32ac09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:59.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.721+0000 7f32b26f9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f32ac09f650 0x7f32ac131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:59.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.721+0000 7f32b1ef8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f32ac09e930 0x7f32ac09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58592/0 (socket says 172.21.15.26:58592) 2023-10-01T08:00:59.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.721+0000 7f32b16f7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f32ac09f240 0x7f32ac1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43084/0 (socket says 172.21.15.26:43084) 2023-10-01T08:00:59.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.721+0000 7f32b1ef8700 1 -- 172.21.15.26:0/4288573817 learned_addr learned my addr 172.21.15.26:0/4288573817 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:59.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.722+0000 7f32b26f9700 1 -- 172.21.15.26:0/4288573817 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f32ac09f240 msgr2=0x7f32ac1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:59.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.722+0000 7f32b26f9700 1 --2- 172.21.15.26:0/4288573817 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f32ac09f240 0x7f32ac1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:59.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.722+0000 7f32b26f9700 1 -- 172.21.15.26:0/4288573817 >> v2:172.21.15.26:3300/0 conn(0x7f32ac09e930 msgr2=0x7f32ac09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:59.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.722+0000 7f32b26f9700 1 --2- 172.21.15.26:0/4288573817 >> v2:172.21.15.26:3300/0 conn(0x7f32ac09e930 0x7f32ac09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:59.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.722+0000 7f32b26f9700 1 -- 172.21.15.26:0/4288573817 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ac09fb60 con 0x7f32ac09f650 2023-10-01T08:00:59.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.722+0000 7f32b1ef8700 1 --2- 172.21.15.26:0/4288573817 >> v2:172.21.15.26:3300/0 conn(0x7f32ac09e930 0x7f32ac09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:59.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.722+0000 7f32b26f9700 1 --2- 172.21.15.26:0/4288573817 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f32ac09f650 0x7f32ac131d30 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f32a4009d90 tx=0x7f32a400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=104396e949c36e55 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:59.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.722+0000 7f32b0ef6700 1 -- 172.21.15.26:0/4288573817 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a400e070 con 0x7f32ac09f650 2023-10-01T08:00:59.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.722+0000 7f32b0ef6700 1 -- 172.21.15.26:0/4288573817 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a400bb20 con 0x7f32ac09f650 2023-10-01T08:00:59.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.722+0000 7f32b0ef6700 1 -- 172.21.15.26:0/4288573817 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a4012430 con 0x7f32ac09f650 2023-10-01T08:00:59.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.723+0000 7f32b415c700 1 -- 172.21.15.26:0/4288573817 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f32ac09f650 msgr2=0x7f32ac131d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:59.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.723+0000 7f32b415c700 1 --2- 172.21.15.26:0/4288573817 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f32ac09f650 0x7f32ac131d30 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f32a4009d90 tx=0x7f32a400b330 comp rx=0 tx=0).stop 2023-10-01T08:00:59.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.723+0000 7f32b415c700 1 -- 172.21.15.26:0/4288573817 shutdown_connections 2023-10-01T08:00:59.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.723+0000 7f32b415c700 1 --2- 172.21.15.26:0/4288573817 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f32ac09f650 0x7f32ac131d30 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:59.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.723+0000 7f32b415c700 1 --2- 172.21.15.26:0/4288573817 >> v2:172.21.15.26:3300/0 conn(0x7f32ac09e930 0x7f32ac09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:59.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.723+0000 7f32b415c700 1 --2- 172.21.15.26:0/4288573817 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f32ac09f240 0x7f32ac1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:59.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.723+0000 7f32b415c700 1 -- 172.21.15.26:0/4288573817 >> 172.21.15.26:0/4288573817 conn(0x7f32ac0a4210 msgr2=0x7f32ac0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:59.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.723+0000 7f32b415c700 1 -- 172.21.15.26:0/4288573817 shutdown_connections 2023-10-01T08:00:59.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.723+0000 7f32b415c700 1 -- 172.21.15.26:0/4288573817 wait complete. 2023-10-01T08:00:59.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.724+0000 7f32b415c700 1 Processor -- start 2023-10-01T08:00:59.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.724+0000 7f32b415c700 1 -- start start 2023-10-01T08:00:59.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.724+0000 7f32b415c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f32ac09e930 0x7f32ac1c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:59.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.724+0000 7f32b415c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f32ac09f240 0x7f32ac1c4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:59.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.724+0000 7f32b415c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32ac09f650 0x7f32ac1c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:59.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.724+0000 7f32b415c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac1a22b0 con 0x7f32ac09f650 2023-10-01T08:00:59.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.724+0000 7f32b415c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac1a20c0 con 0x7f32ac09f240 2023-10-01T08:00:59.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.724+0000 7f32b415c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac1a3fd0 con 0x7f32ac09e930 2023-10-01T08:00:59.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.724+0000 7f32b26f9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32ac09f650 0x7f32ac1c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:59.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.724+0000 7f32b1ef8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f32ac09e930 0x7f32ac1c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:59.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.724+0000 7f32b16f7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f32ac09f240 0x7f32ac1c4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:59.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.725+0000 7f32b26f9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32ac09f650 0x7f32ac1c47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58596/0 (socket says 172.21.15.26:58596) 2023-10-01T08:00:59.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.725+0000 7f32b1ef8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f32ac09e930 0x7f32ac1c3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41276/0 (socket says 172.21.15.26:41276) 2023-10-01T08:00:59.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.725+0000 7f32b26f9700 1 -- 172.21.15.26:0/944484625 learned_addr learned my addr 172.21.15.26:0/944484625 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:59.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.725+0000 7f32b26f9700 1 -- 172.21.15.26:0/944484625 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f32ac09e930 msgr2=0x7f32ac1c3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:59.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.725+0000 7f32b26f9700 1 --2- 172.21.15.26:0/944484625 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f32ac09e930 0x7f32ac1c3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:59.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.725+0000 7f32b26f9700 1 -- 172.21.15.26:0/944484625 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f32ac09f240 msgr2=0x7f32ac1c4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:59.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.725+0000 7f32b26f9700 1 --2- 172.21.15.26:0/944484625 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f32ac09f240 0x7f32ac1c4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:59.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.725+0000 7f32b26f9700 1 -- 172.21.15.26:0/944484625 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a800d9f0 con 0x7f32ac09f650 2023-10-01T08:00:59.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.725+0000 7f32b1ef8700 1 --2- 172.21.15.26:0/944484625 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f32ac09e930 0x7f32ac1c3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:59.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.725+0000 7f32b26f9700 1 --2- 172.21.15.26:0/944484625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32ac09f650 0x7f32ac1c47a0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f32a4014040 tx=0x7f32a4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:59.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.725+0000 7f32a27fc700 1 -- 172.21.15.26:0/944484625 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a40044d0 con 0x7f32ac09f650 2023-10-01T08:00:59.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.725+0000 7f32a27fc700 1 -- 172.21.15.26:0/944484625 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a4020070 con 0x7f32ac09f650 2023-10-01T08:00:59.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.725+0000 7f32b415c700 1 -- 172.21.15.26:0/944484625 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32a4009a70 con 0x7f32ac09f650 2023-10-01T08:00:59.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.725+0000 7f32a27fc700 1 -- 172.21.15.26:0/944484625 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a4004890 con 0x7f32ac09f650 2023-10-01T08:00:59.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.725+0000 7f32b415c700 1 -- 172.21.15.26:0/944484625 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32ac0a0190 con 0x7f32ac09f650 2023-10-01T08:00:59.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.726+0000 7f32a27fc700 1 -- 172.21.15.26:0/944484625 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f32a4012430 con 0x7f32ac09f650 2023-10-01T08:00:59.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.726+0000 7f32a27fc700 1 -- 172.21.15.26:0/944484625 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f32a4022070 con 0x7f32ac09f650 2023-10-01T08:00:59.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.726+0000 7f32b415c700 1 -- 172.21.15.26:0/944484625 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32ac074ea0 con 0x7f32ac09f650 2023-10-01T08:00:59.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.731+0000 7f32a27fc700 1 -- 172.21.15.26:0/944484625 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f32a4011980 con 0x7f32ac09f650 2023-10-01T08:00:59.770 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:00:59.803 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:00:59.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.908+0000 7fc656abf700 1 Processor -- start 2023-10-01T08:00:59.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.909+0000 7fc656abf700 1 -- start start 2023-10-01T08:00:59.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.909+0000 7fc656abf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc65009d6f0 0x7fc65009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:59.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.909+0000 7fc656abf700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc65009e000 0x7fc6501339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:59.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.909+0000 7fc656abf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc65009e410 0x7fc650133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:59.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.909+0000 7fc656abf700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc65006b460 con 0x7fc65009e000 2023-10-01T08:00:59.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.909+0000 7fc656abf700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65009b120 con 0x7fc65009d6f0 2023-10-01T08:00:59.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.909+0000 7fc656abf700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc65009a7e0 con 0x7fc65009e410 2023-10-01T08:00:59.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.909+0000 7fc65485b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc65009d6f0 0x7fc65009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:59.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.909+0000 7fc65485b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc65009d6f0 0x7fc65009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43094/0 (socket says 172.21.15.26:43094) 2023-10-01T08:00:59.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.909+0000 7fc65485b700 1 -- 172.21.15.26:0/705198214 learned_addr learned my addr 172.21.15.26:0/705198214 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:59.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.909+0000 7fc64ffff700 1 --2- 172.21.15.26:0/705198214 >> v2:172.21.15.26:3300/0 conn(0x7fc65009e000 0x7fc6501339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:59.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.909+0000 7fc65505c700 1 --2- 172.21.15.26:0/705198214 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc65009e410 0x7fc650133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:59.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.910+0000 7fc65485b700 1 -- 172.21.15.26:0/705198214 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc65009e410 msgr2=0x7fc650133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:59.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.910+0000 7fc65485b700 1 --2- 172.21.15.26:0/705198214 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc65009e410 0x7fc650133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:59.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.910+0000 7fc65485b700 1 -- 172.21.15.26:0/705198214 >> v2:172.21.15.26:3300/0 conn(0x7fc65009e000 msgr2=0x7fc6501339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:59.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.910+0000 7fc65485b700 1 --2- 172.21.15.26:0/705198214 >> v2:172.21.15.26:3300/0 conn(0x7fc65009e000 0x7fc6501339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:59.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.910+0000 7fc65485b700 1 -- 172.21.15.26:0/705198214 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc65009a500 con 0x7fc65009d6f0 2023-10-01T08:00:59.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.910+0000 7fc64ffff700 1 --2- 172.21.15.26:0/705198214 >> v2:172.21.15.26:3300/0 conn(0x7fc65009e000 0x7fc6501339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:59.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.910+0000 7fc65485b700 1 --2- 172.21.15.26:0/705198214 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc65009d6f0 0x7fc65009dac0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fc644009920 tx=0x7fc644009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=457c9a11d8dccb6e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:59.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.910+0000 7fc64f7fe700 1 -- 172.21.15.26:0/705198214 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc644011830 con 0x7fc65009d6f0 2023-10-01T08:00:59.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.910+0000 7fc64f7fe700 1 -- 172.21.15.26:0/705198214 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc644011990 con 0x7fc65009d6f0 2023-10-01T08:00:59.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.910+0000 7fc64f7fe700 1 -- 172.21.15.26:0/705198214 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc644011d20 con 0x7fc65009d6f0 2023-10-01T08:00:59.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.911+0000 7fc656abf700 1 -- 172.21.15.26:0/705198214 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc65009d6f0 msgr2=0x7fc65009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:59.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.911+0000 7fc656abf700 1 --2- 172.21.15.26:0/705198214 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc65009d6f0 0x7fc65009dac0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fc644009920 tx=0x7fc644009c30 comp rx=0 tx=0).stop 2023-10-01T08:00:59.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.911+0000 7fc656abf700 1 -- 172.21.15.26:0/705198214 shutdown_connections 2023-10-01T08:00:59.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.911+0000 7fc656abf700 1 --2- 172.21.15.26:0/705198214 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc65009e410 0x7fc650133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:59.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.911+0000 7fc656abf700 1 --2- 172.21.15.26:0/705198214 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc65009d6f0 0x7fc65009dac0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:59.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.911+0000 7fc656abf700 1 --2- 172.21.15.26:0/705198214 >> v2:172.21.15.26:3300/0 conn(0x7fc65009e000 0x7fc6501339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:59.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.911+0000 7fc656abf700 1 -- 172.21.15.26:0/705198214 >> 172.21.15.26:0/705198214 conn(0x7fc650066f50 msgr2=0x7fc65009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:59.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.911+0000 7fc656abf700 1 -- 172.21.15.26:0/705198214 shutdown_connections 2023-10-01T08:00:59.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.911+0000 7fc656abf700 1 -- 172.21.15.26:0/705198214 wait complete. 2023-10-01T08:00:59.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.912+0000 7fc656abf700 1 Processor -- start 2023-10-01T08:00:59.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.912+0000 7fc656abf700 1 -- start start 2023-10-01T08:00:59.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.913+0000 7fc656abf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc65009d6f0 0x7fc6501c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:59.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.913+0000 7fc656abf700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc65009e000 0x7fc6501c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:59.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.913+0000 7fc656abf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc65009e410 0x7fc6501c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:59.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.913+0000 7fc656abf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6501aaa00 con 0x7fc65009d6f0 2023-10-01T08:00:59.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.913+0000 7fc656abf700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6500a2090 con 0x7fc65009e000 2023-10-01T08:00:59.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.913+0000 7fc656abf700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc65009c710 con 0x7fc65009e410 2023-10-01T08:00:59.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.913+0000 7fc64ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc65009e000 0x7fc6501c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:59.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.913+0000 7fc64ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc65009e000 0x7fc6501c8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43110/0 (socket says 172.21.15.26:43110) 2023-10-01T08:00:59.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.913+0000 7fc64ffff700 1 -- 172.21.15.26:0/3233832459 learned_addr learned my addr 172.21.15.26:0/3233832459 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:59.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.913+0000 7fc65505c700 1 --2- 172.21.15.26:0/3233832459 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc65009e410 0x7fc6501c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:59.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.913+0000 7fc65485b700 1 --2- 172.21.15.26:0/3233832459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc65009d6f0 0x7fc6501c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:59.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.913+0000 7fc64ffff700 1 -- 172.21.15.26:0/3233832459 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc65009e410 msgr2=0x7fc6501c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:59.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.913+0000 7fc64ffff700 1 --2- 172.21.15.26:0/3233832459 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc65009e410 0x7fc6501c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:59.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.913+0000 7fc64ffff700 1 -- 172.21.15.26:0/3233832459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc65009d6f0 msgr2=0x7fc6501c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:59.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.913+0000 7fc64ffff700 1 --2- 172.21.15.26:0/3233832459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc65009d6f0 0x7fc6501c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:59.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.913+0000 7fc64ffff700 1 -- 172.21.15.26:0/3233832459 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63c0094a0 con 0x7fc65009e000 2023-10-01T08:00:59.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.913+0000 7fc65505c700 1 --2- 172.21.15.26:0/3233832459 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc65009e410 0x7fc6501c49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:59.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.914+0000 7fc64ffff700 1 --2- 172.21.15.26:0/3233832459 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc65009e000 0x7fc6501c8c40 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fc63c00ebb0 tx=0x7fc63c00eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:59.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.914+0000 7fc64d7fa700 1 -- 172.21.15.26:0/3233832459 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63c00c850 con 0x7fc65009e000 2023-10-01T08:00:59.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.914+0000 7fc64d7fa700 1 -- 172.21.15.26:0/3233832459 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63c00c9b0 con 0x7fc65009e000 2023-10-01T08:00:59.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.914+0000 7fc64d7fa700 1 -- 172.21.15.26:0/3233832459 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63c00cd40 con 0x7fc65009e000 2023-10-01T08:00:59.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.914+0000 7fc656abf700 1 -- 172.21.15.26:0/3233832459 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc644009550 con 0x7fc65009e000 2023-10-01T08:00:59.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.914+0000 7fc656abf700 1 -- 172.21.15.26:0/3233832459 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6501a9dc0 con 0x7fc65009e000 2023-10-01T08:00:59.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.915+0000 7fc64d7fa700 1 -- 172.21.15.26:0/3233832459 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc63c013470 con 0x7fc65009e000 2023-10-01T08:00:59.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.915+0000 7fc656abf700 1 -- 172.21.15.26:0/3233832459 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc650074ea0 con 0x7fc65009e000 2023-10-01T08:00:59.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.915+0000 7fc64d7fa700 1 -- 172.21.15.26:0/3233832459 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc63c03f600 con 0x7fc65009e000 2023-10-01T08:00:59.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.925+0000 7fc64d7fa700 1 -- 172.21.15.26:0/3233832459 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc63c013720 con 0x7fc65009e000 2023-10-01T08:00:59.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.949+0000 7f32b415c700 1 -- 172.21.15.26:0/944484625 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f32ac1a28b0 con 0x7f32ac09f650 2023-10-01T08:00:59.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.949+0000 7f32a27fc700 1 -- 172.21.15.26:0/944484625 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f32a4011390 con 0x7f32ac09f650 2023-10-01T08:00:59.950 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:00:59.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.951+0000 7f32b415c700 1 -- 172.21.15.26:0/944484625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32ac09f650 msgr2=0x7f32ac1c47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:59.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.951+0000 7f32b415c700 1 --2- 172.21.15.26:0/944484625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32ac09f650 0x7f32ac1c47a0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f32a4014040 tx=0x7f32a4004ad0 comp rx=0 tx=0).stop 2023-10-01T08:00:59.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.951+0000 7f32b415c700 1 -- 172.21.15.26:0/944484625 shutdown_connections 2023-10-01T08:00:59.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.951+0000 7f32b415c700 1 --2- 172.21.15.26:0/944484625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32ac09f650 0x7f32ac1c47a0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:59.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.951+0000 7f32b415c700 1 --2- 172.21.15.26:0/944484625 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f32ac09e930 0x7f32ac1c3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:59.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.951+0000 7f32b415c700 1 --2- 172.21.15.26:0/944484625 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f32ac09f240 0x7f32ac1c4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:59.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.951+0000 7f32b415c700 1 -- 172.21.15.26:0/944484625 >> 172.21.15.26:0/944484625 conn(0x7f32ac0a4210 msgr2=0x7f32ac06c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:59.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.951+0000 7f32b415c700 1 -- 172.21.15.26:0/944484625 shutdown_connections 2023-10-01T08:00:59.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.952+0000 7f32b415c700 1 -- 172.21.15.26:0/944484625 wait complete. 2023-10-01T08:00:59.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.953+0000 7f41fff15700 1 Processor -- start 2023-10-01T08:00:59.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.953+0000 7f41fff15700 1 -- start start 2023-10-01T08:00:59.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.954+0000 7f41fff15700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f41f8133420 0x7f41f81337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:59.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.954+0000 7f41fff15700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41f8133e30 0x7f41f812ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:59.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.954+0000 7f41fff15700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f806b990 con 0x7f41f8134260 2023-10-01T08:00:59.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.954+0000 7f41fff15700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f80a0590 con 0x7f41f8133420 2023-10-01T08:00:59.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.954+0000 7f41fff15700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f809fb80 con 0x7f41f8133e30 2023-10-01T08:00:59.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.954+0000 7f41fdcb1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f41f8133420 0x7f41f81337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:59.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.954+0000 7f41fdcb1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f41f8133420 0x7f41f81337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58622/0 (socket says 172.21.15.26:58622) 2023-10-01T08:00:59.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.954+0000 7f41fdcb1700 1 -- 172.21.15.26:0/703417954 learned_addr learned my addr 172.21.15.26:0/703417954 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:59.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.954+0000 7f41fd4b0700 1 --2- 172.21.15.26:0/703417954 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41f8133e30 0x7f41f812ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:59.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.954+0000 7f41fdcb1700 1 -- 172.21.15.26:0/703417954 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41f8133e30 msgr2=0x7f41f812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:00:59.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.954+0000 7f41fdcb1700 1 --2- 172.21.15.26:0/703417954 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41f8133e30 0x7f41f812ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:59.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.954+0000 7f41fdcb1700 1 -- 172.21.15.26:0/703417954 >> v1:172.21.15.26:6789/0 conn(0x7f41f8134260 legacy=0x7f41f81304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:59.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.954+0000 7f41fdcb1700 1 -- 172.21.15.26:0/703417954 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f80a0030 con 0x7f41f8133420 2023-10-01T08:00:59.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.955+0000 7f41fdcb1700 1 --2- 172.21.15.26:0/703417954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41f8133420 0x7f41f81337f0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f41f40098f0 tx=0x7f41f4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96be5ec1fd87103f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:59.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.955+0000 7f41fccaf700 1 -- 172.21.15.26:0/703417954 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f4011830 con 0x7f41f8133420 2023-10-01T08:00:59.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.955+0000 7f41fccaf700 1 -- 172.21.15.26:0/703417954 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f4011990 con 0x7f41f8133420 2023-10-01T08:00:59.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.955+0000 7f41fccaf700 1 -- 172.21.15.26:0/703417954 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f4011d20 con 0x7f41f8133420 2023-10-01T08:00:59.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.956+0000 7f41fff15700 1 -- 172.21.15.26:0/703417954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41f8133420 msgr2=0x7f41f81337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:59.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.956+0000 7f41fff15700 1 --2- 172.21.15.26:0/703417954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41f8133420 0x7f41f81337f0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f41f40098f0 tx=0x7f41f4009c00 comp rx=0 tx=0).stop 2023-10-01T08:00:59.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.956+0000 7f41fff15700 1 -- 172.21.15.26:0/703417954 shutdown_connections 2023-10-01T08:00:59.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.956+0000 7f41fff15700 1 --2- 172.21.15.26:0/703417954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41f8133420 0x7f41f81337f0 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:59.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.956+0000 7f41fff15700 1 --2- 172.21.15.26:0/703417954 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41f8133e30 0x7f41f812ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:59.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.956+0000 7f41fff15700 1 -- 172.21.15.26:0/703417954 >> 172.21.15.26:0/703417954 conn(0x7f41f80a4210 msgr2=0x7f41f80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:00:59.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.956+0000 7f41fff15700 1 -- 172.21.15.26:0/703417954 shutdown_connections 2023-10-01T08:00:59.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.956+0000 7f41fff15700 1 -- 172.21.15.26:0/703417954 wait complete. 2023-10-01T08:00:59.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.957+0000 7f41fff15700 1 Processor -- start 2023-10-01T08:00:59.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.957+0000 7f41fff15700 1 -- start start 2023-10-01T08:00:59.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.958+0000 7f41fff15700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41f8133420 0x7f41f809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:59.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.958+0000 7f41fff15700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41f8133e30 0x7f41f809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:59.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.958+0000 7f41fff15700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41f8134260 0x7f41f809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:00:59.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.958+0000 7f41fff15700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f8120710 con 0x7f41f8134260 2023-10-01T08:00:59.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.958+0000 7f41fff15700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f811fbb0 con 0x7f41f8133e30 2023-10-01T08:00:59.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.958+0000 7f41fff15700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41f811f8e0 con 0x7f41f8133420 2023-10-01T08:00:59.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.958+0000 7f41fd4b0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41f8133e30 0x7f41f809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:59.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.958+0000 7f41fe4b2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41f8134260 0x7f41f809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:00:59.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.958+0000 7f41fd4b0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41f8133e30 0x7f41f809c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43130/0 (socket says 172.21.15.26:43130) 2023-10-01T08:00:59.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.958+0000 7f41fd4b0700 1 -- 172.21.15.26:0/2707778265 learned_addr learned my addr 172.21.15.26:0/2707778265 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:00:59.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.959+0000 7f41fe4b2700 1 -- 172.21.15.26:0/2707778265 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41f8133420 msgr2=0x7f41f809c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:59.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.959+0000 7f41fe4b2700 1 --2- 172.21.15.26:0/2707778265 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41f8133420 0x7f41f809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:59.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.959+0000 7f41fe4b2700 1 -- 172.21.15.26:0/2707778265 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41f8133e30 msgr2=0x7f41f809c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:00:59.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.959+0000 7f41fe4b2700 1 --2- 172.21.15.26:0/2707778265 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41f8133e30 0x7f41f809c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:00:59.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.959+0000 7f41fe4b2700 1 -- 172.21.15.26:0/2707778265 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f4009550 con 0x7f41f8134260 2023-10-01T08:00:59.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.959+0000 7f41fd4b0700 1 --2- 172.21.15.26:0/2707778265 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41f8133e30 0x7f41f809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:00:59.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.959+0000 7f41fe4b2700 1 --2- 172.21.15.26:0/2707778265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41f8134260 0x7f41f809cf00 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f41f809f3e0 tx=0x7f41f000ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:00:59.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.959+0000 7f41ee7fc700 1 -- 172.21.15.26:0/2707778265 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f0003c00 con 0x7f41f8134260 2023-10-01T08:00:59.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.959+0000 7f41ee7fc700 1 -- 172.21.15.26:0/2707778265 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f0003d60 con 0x7f41f8134260 2023-10-01T08:00:59.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.959+0000 7f41fff15700 1 -- 172.21.15.26:0/2707778265 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f8120230 con 0x7f41f8134260 2023-10-01T08:00:59.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.959+0000 7f41ee7fc700 1 -- 172.21.15.26:0/2707778265 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f000aa80 con 0x7f41f8134260 2023-10-01T08:00:59.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.959+0000 7f41fff15700 1 -- 172.21.15.26:0/2707778265 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f809dfc0 con 0x7f41f8134260 2023-10-01T08:00:59.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.960+0000 7f41ee7fc700 1 -- 172.21.15.26:0/2707778265 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f41f000abe0 con 0x7f41f8134260 2023-10-01T08:00:59.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.960+0000 7f41fff15700 1 -- 172.21.15.26:0/2707778265 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f8074ea0 con 0x7f41f8134260 2023-10-01T08:00:59.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.960+0000 7f41ee7fc700 1 -- 172.21.15.26:0/2707778265 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f41f003f040 con 0x7f41f8134260 2023-10-01T08:00:59.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:00:59.969+0000 7f41ee7fc700 1 -- 172.21.15.26:0/2707778265 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f41f0019c50 con 0x7f41f8134260 2023-10-01T08:00:59.971 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:00.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.138+0000 7fc656abf700 1 -- 172.21.15.26:0/3233832459 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc6501a9dc0 con 0x7fc65009e000 2023-10-01T08:01:00.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.139+0000 7fc64d7fa700 1 -- 172.21.15.26:0/3233832459 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc6501a9dc0 con 0x7fc65009e000 2023-10-01T08:01:00.140 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:00.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.141+0000 7fc656abf700 1 -- 172.21.15.26:0/3233832459 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc65009e000 msgr2=0x7fc6501c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:00.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.141+0000 7fc656abf700 1 --2- 172.21.15.26:0/3233832459 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc65009e000 0x7fc6501c8c40 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fc63c00ebb0 tx=0x7fc63c00eec0 comp rx=0 tx=0).stop 2023-10-01T08:01:00.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.141+0000 7fc656abf700 1 -- 172.21.15.26:0/3233832459 shutdown_connections 2023-10-01T08:01:00.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.141+0000 7fc656abf700 1 --2- 172.21.15.26:0/3233832459 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc65009e410 0x7fc6501c49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:00.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.141+0000 7fc656abf700 1 --2- 172.21.15.26:0/3233832459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc65009d6f0 0x7fc6501c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:00.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.141+0000 7fc656abf700 1 --2- 172.21.15.26:0/3233832459 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc65009e000 0x7fc6501c8c40 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:00.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.141+0000 7fc656abf700 1 -- 172.21.15.26:0/3233832459 >> 172.21.15.26:0/3233832459 conn(0x7fc650066f50 msgr2=0x7fc650071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:00.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.141+0000 7fc656abf700 1 -- 172.21.15.26:0/3233832459 shutdown_connections 2023-10-01T08:01:00.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.141+0000 7fc656abf700 1 -- 172.21.15.26:0/3233832459 wait complete. 2023-10-01T08:01:00.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:00.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.180+0000 7f41fff15700 1 -- 172.21.15.26:0/2707778265 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f41f806b250 con 0x7f41f8134260 2023-10-01T08:01:00.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.181+0000 7f41ee7fc700 1 -- 172.21.15.26:0/2707778265 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f41f0017070 con 0x7f41f8134260 2023-10-01T08:01:00.182 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:00.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.183+0000 7f41fff15700 1 -- 172.21.15.26:0/2707778265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41f8134260 msgr2=0x7f41f809cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:00.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.183+0000 7f41fff15700 1 --2- 172.21.15.26:0/2707778265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41f8134260 0x7f41f809cf00 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f41f809f3e0 tx=0x7f41f000ce70 comp rx=0 tx=0).stop 2023-10-01T08:01:00.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.183+0000 7f41fff15700 1 -- 172.21.15.26:0/2707778265 shutdown_connections 2023-10-01T08:01:00.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.183+0000 7f41fff15700 1 --2- 172.21.15.26:0/2707778265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41f8134260 0x7f41f809cf00 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:00.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.183+0000 7f41fff15700 1 --2- 172.21.15.26:0/2707778265 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f41f8133420 0x7f41f809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:00.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.183+0000 7f41fff15700 1 --2- 172.21.15.26:0/2707778265 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41f8133e30 0x7f41f809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:00.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.183+0000 7f41fff15700 1 -- 172.21.15.26:0/2707778265 >> 172.21.15.26:0/2707778265 conn(0x7f41f80a4210 msgr2=0x7f41f812de00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:00.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.183+0000 7f41fff15700 1 -- 172.21.15.26:0/2707778265 shutdown_connections 2023-10-01T08:01:00.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.183+0000 7f41fff15700 1 -- 172.21.15.26:0/2707778265 wait complete. 2023-10-01T08:01:00.197 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:00.591 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:00.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.737+0000 7fa902aa6700 1 Processor -- start 2023-10-01T08:01:00.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.737+0000 7fa902aa6700 1 -- start start 2023-10-01T08:01:00.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.738+0000 7fa902aa6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa8fc09d6f0 0x7fa8fc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:00.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.738+0000 7fa902aa6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa8fc09e410 0x7fa8fc130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:00.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.738+0000 7fa902aa6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8fc09f130 con 0x7fa8fc09e000 2023-10-01T08:01:00.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.738+0000 7fa902aa6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc09f520 con 0x7fa8fc09e410 2023-10-01T08:01:00.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.738+0000 7fa902aa6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc09e930 con 0x7fa8fc09d6f0 2023-10-01T08:01:00.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.738+0000 7fa900842700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa8fc09d6f0 0x7fa8fc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:00.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.738+0000 7fa8fbfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa8fc09e000 0x7fa8fc130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39626/0 (socket says 172.21.15.26:39626) 2023-10-01T08:01:00.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.738+0000 7fa8fbfff700 1 -- 172.21.15.26:0/2791097984 learned_addr learned my addr 172.21.15.26:0/2791097984 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:01:00.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.738+0000 7fa901043700 1 --2- 172.21.15.26:0/2791097984 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa8fc09e410 0x7fa8fc130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:00.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.739+0000 7fa8fb7fe700 1 -- 172.21.15.26:0/2791097984 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 424190162 0 0) 0x7fa8fc09f130 con 0x7fa8fc09e000 2023-10-01T08:01:00.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.739+0000 7fa901043700 1 -- 172.21.15.26:0/2791097984 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa8fc09d6f0 msgr2=0x7fa8fc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:00.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.739+0000 7fa901043700 1 --2- 172.21.15.26:0/2791097984 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa8fc09d6f0 0x7fa8fc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:00.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.739+0000 7fa901043700 1 -- 172.21.15.26:0/2791097984 >> v1:172.21.15.26:6789/0 conn(0x7fa8fc09e000 legacy=0x7fa8fc130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:00.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.739+0000 7fa901043700 1 -- 172.21.15.26:0/2791097984 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8fc09b2d0 con 0x7fa8fc09e410 2023-10-01T08:01:00.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.739+0000 7fa900842700 1 --2- 172.21.15.26:0/2791097984 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa8fc09d6f0 0x7fa8fc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:00.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.739+0000 7fa901043700 1 --2- 172.21.15.26:0/2791097984 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa8fc09e410 0x7fa8fc130d70 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4009dc0 tx=0x7fa8f400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e666f03946c3887 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:00.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.739+0000 7fa8fb7fe700 1 -- 172.21.15.26:0/2791097984 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f400bd20 con 0x7fa8fc09e410 2023-10-01T08:01:00.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.739+0000 7fa8fb7fe700 1 -- 172.21.15.26:0/2791097984 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f400be80 con 0x7fa8fc09e410 2023-10-01T08:01:00.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.739+0000 7fa8fb7fe700 1 -- 172.21.15.26:0/2791097984 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f40116a0 con 0x7fa8fc09e410 2023-10-01T08:01:00.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.740+0000 7fa902aa6700 1 -- 172.21.15.26:0/2791097984 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa8fc09e410 msgr2=0x7fa8fc130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:00.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.740+0000 7fa902aa6700 1 --2- 172.21.15.26:0/2791097984 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa8fc09e410 0x7fa8fc130d70 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4009dc0 tx=0x7fa8f400b330 comp rx=0 tx=0).stop 2023-10-01T08:01:00.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.740+0000 7fa902aa6700 1 -- 172.21.15.26:0/2791097984 shutdown_connections 2023-10-01T08:01:00.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.740+0000 7fa902aa6700 1 --2- 172.21.15.26:0/2791097984 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa8fc09d6f0 0x7fa8fc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:00.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.740+0000 7fa902aa6700 1 --2- 172.21.15.26:0/2791097984 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa8fc09e410 0x7fa8fc130d70 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:00.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.740+0000 7fa902aa6700 1 -- 172.21.15.26:0/2791097984 >> 172.21.15.26:0/2791097984 conn(0x7fa8fc066f50 msgr2=0x7fa8fc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:00.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.740+0000 7fa902aa6700 1 -- 172.21.15.26:0/2791097984 shutdown_connections 2023-10-01T08:01:00.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.740+0000 7fa902aa6700 1 -- 172.21.15.26:0/2791097984 wait complete. 2023-10-01T08:01:00.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.741+0000 7fa902aa6700 1 Processor -- start 2023-10-01T08:01:00.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.741+0000 7fa902aa6700 1 -- start start 2023-10-01T08:01:00.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.741+0000 7fa902aa6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8fc09d6f0 0x7fa8fc1c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:00.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.741+0000 7fa902aa6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa8fc09e000 0x7fa8fc1c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:00.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.741+0000 7fa902aa6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa8fc09e410 0x7fa8fc1c9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:00.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.741+0000 7fa902aa6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc126080 con 0x7fa8fc09d6f0 2023-10-01T08:01:00.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.741+0000 7fa902aa6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc124370 con 0x7fa8fc09e000 2023-10-01T08:01:00.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.741+0000 7fa902aa6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc0a20d0 con 0x7fa8fc09e410 2023-10-01T08:01:00.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.742+0000 7fa900842700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8fc09d6f0 0x7fa8fc1c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:00.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.742+0000 7fa901043700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa8fc09e410 0x7fa8fc1c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:00.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.742+0000 7fa900842700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8fc09d6f0 0x7fa8fc1c85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58634/0 (socket says 172.21.15.26:58634) 2023-10-01T08:01:00.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.742+0000 7fa8fbfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa8fc09e000 0x7fa8fc1c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:00.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.742+0000 7fa900842700 1 -- 172.21.15.26:0/1932205253 learned_addr learned my addr 172.21.15.26:0/1932205253 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:00.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.742+0000 7fa901043700 1 -- 172.21.15.26:0/1932205253 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa8fc09e000 msgr2=0x7fa8fc1c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:00.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.742+0000 7fa901043700 1 --2- 172.21.15.26:0/1932205253 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa8fc09e000 0x7fa8fc1c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:00.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.742+0000 7fa901043700 1 -- 172.21.15.26:0/1932205253 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8fc09d6f0 msgr2=0x7fa8fc1c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:00.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.742+0000 7fa901043700 1 --2- 172.21.15.26:0/1932205253 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8fc09d6f0 0x7fa8fc1c85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:00.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.742+0000 7fa901043700 1 -- 172.21.15.26:0/1932205253 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ec0094a0 con 0x7fa8fc09e410 2023-10-01T08:01:00.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.742+0000 7fa900842700 1 --2- 172.21.15.26:0/1932205253 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8fc09d6f0 0x7fa8fc1c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:00.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.742+0000 7fa901043700 1 --2- 172.21.15.26:0/1932205253 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa8fc09e410 0x7fa8fc1c9020 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4018000 tx=0x7fa8f4004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:00.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.742+0000 7fa8f97fa700 1 -- 172.21.15.26:0/1932205253 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f4004880 con 0x7fa8fc09e410 2023-10-01T08:01:00.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.742+0000 7fa8f97fa700 1 -- 172.21.15.26:0/1932205253 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f4011460 con 0x7fa8fc09e410 2023-10-01T08:01:00.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.742+0000 7fa902aa6700 1 -- 172.21.15.26:0/1932205253 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f4009a70 con 0x7fa8fc09e410 2023-10-01T08:01:00.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.742+0000 7fa8f97fa700 1 -- 172.21.15.26:0/1932205253 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f4011810 con 0x7fa8fc09e410 2023-10-01T08:01:00.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.742+0000 7fa902aa6700 1 -- 172.21.15.26:0/1932205253 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8fc124b60 con 0x7fa8fc09e410 2023-10-01T08:01:00.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.743+0000 7fa8f97fa700 1 -- 172.21.15.26:0/1932205253 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa8f4011970 con 0x7fa8fc09e410 2023-10-01T08:01:00.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.743+0000 7fa902aa6700 1 -- 172.21.15.26:0/1932205253 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8fc09a520 con 0x7fa8fc09e410 2023-10-01T08:01:00.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.744+0000 7fa8f97fa700 1 -- 172.21.15.26:0/1932205253 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa8f4041080 con 0x7fa8fc09e410 2023-10-01T08:01:00.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.749+0000 7fa8f97fa700 1 -- 172.21.15.26:0/1932205253 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa8f402b7d0 con 0x7fa8fc09e410 2023-10-01T08:01:00.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.949+0000 7fa902aa6700 1 -- 172.21.15.26:0/1932205253 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa8fc074ea0 con 0x7fa8fc09e410 2023-10-01T08:01:00.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.950+0000 7fa8f97fa700 1 -- 172.21.15.26:0/1932205253 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa8f402aba0 con 0x7fa8fc09e410 2023-10-01T08:01:00.951 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:00.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.952+0000 7fa902aa6700 1 -- 172.21.15.26:0/1932205253 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa8fc09e410 msgr2=0x7fa8fc1c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:00.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.952+0000 7fa902aa6700 1 --2- 172.21.15.26:0/1932205253 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa8fc09e410 0x7fa8fc1c9020 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4018000 tx=0x7fa8f4004b40 comp rx=0 tx=0).stop 2023-10-01T08:01:00.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.952+0000 7fa902aa6700 1 -- 172.21.15.26:0/1932205253 shutdown_connections 2023-10-01T08:01:00.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.952+0000 7fa902aa6700 1 --2- 172.21.15.26:0/1932205253 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa8fc09e410 0x7fa8fc1c9020 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:00.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.952+0000 7fa902aa6700 1 --2- 172.21.15.26:0/1932205253 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8fc09d6f0 0x7fa8fc1c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:00.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.952+0000 7fa902aa6700 1 --2- 172.21.15.26:0/1932205253 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa8fc09e000 0x7fa8fc1c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:00.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.952+0000 7fa902aa6700 1 -- 172.21.15.26:0/1932205253 >> 172.21.15.26:0/1932205253 conn(0x7fa8fc066f50 msgr2=0x7fa8fc130b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:00.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.952+0000 7fa902aa6700 1 -- 172.21.15.26:0/1932205253 shutdown_connections 2023-10-01T08:01:00.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:00.952+0000 7fa902aa6700 1 -- 172.21.15.26:0/1932205253 wait complete. 2023-10-01T08:01:00.967 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:00.972 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:01.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.110+0000 7f333c007700 1 Processor -- start 2023-10-01T08:01:01.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.110+0000 7f333c007700 1 -- start start 2023-10-01T08:01:01.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.111+0000 7f333c007700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f333409d6f0 0x7f333409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:01.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.111+0000 7f333c007700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f333409e000 0x7f33341339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:01.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.111+0000 7f333c007700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f333409e410 0x7f3334133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:01.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.111+0000 7f333c007700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f333406b460 con 0x7f333409d6f0 2023-10-01T08:01:01.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.111+0000 7f333c007700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333409b120 con 0x7f333409e000 2023-10-01T08:01:01.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.111+0000 7f333c007700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f333409a7e0 con 0x7f333409e410 2023-10-01T08:01:01.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.111+0000 7f3339da3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f333409d6f0 0x7f333409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:01.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.111+0000 7f33395a2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f333409e000 0x7f33341339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:01.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.111+0000 7f3339da3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f333409d6f0 0x7f333409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58642/0 (socket says 172.21.15.26:58642) 2023-10-01T08:01:01.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.111+0000 7f33395a2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f333409e000 0x7f33341339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43154/0 (socket says 172.21.15.26:43154) 2023-10-01T08:01:01.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.111+0000 7f333a5a4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f333409e410 0x7f3334133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:01.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.111+0000 7f3339da3700 1 -- 172.21.15.26:0/204226432 learned_addr learned my addr 172.21.15.26:0/204226432 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:01.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.111+0000 7f33395a2700 1 -- 172.21.15.26:0/204226432 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f333409e410 msgr2=0x7f3334133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:01.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.111+0000 7f33395a2700 1 --2- 172.21.15.26:0/204226432 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f333409e410 0x7f3334133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:01.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.111+0000 7f33395a2700 1 -- 172.21.15.26:0/204226432 >> v2:172.21.15.26:3300/0 conn(0x7f333409d6f0 msgr2=0x7f333409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:01.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.111+0000 7f33395a2700 1 --2- 172.21.15.26:0/204226432 >> v2:172.21.15.26:3300/0 conn(0x7f333409d6f0 0x7f333409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:01.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.111+0000 7f33395a2700 1 -- 172.21.15.26:0/204226432 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f333409a500 con 0x7f333409e000 2023-10-01T08:01:01.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.111+0000 7f3339da3700 1 --2- 172.21.15.26:0/204226432 >> v2:172.21.15.26:3300/0 conn(0x7f333409d6f0 0x7f333409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:01.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.111+0000 7f33395a2700 1 --2- 172.21.15.26:0/204226432 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f333409e000 0x7f33341339f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f3324009870 tx=0x7f3324009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70e44ea1763d1b3a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:01.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.112+0000 7f3338da1700 1 -- 172.21.15.26:0/204226432 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3324011830 con 0x7f333409e000 2023-10-01T08:01:01.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.112+0000 7f3338da1700 1 -- 172.21.15.26:0/204226432 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3324011990 con 0x7f333409e000 2023-10-01T08:01:01.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.112+0000 7f3338da1700 1 -- 172.21.15.26:0/204226432 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3324011d20 con 0x7f333409e000 2023-10-01T08:01:01.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.112+0000 7f333c007700 1 -- 172.21.15.26:0/204226432 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f333409e000 msgr2=0x7f33341339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:01.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.112+0000 7f333c007700 1 --2- 172.21.15.26:0/204226432 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f333409e000 0x7f33341339f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f3324009870 tx=0x7f3324009b80 comp rx=0 tx=0).stop 2023-10-01T08:01:01.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.112+0000 7f333c007700 1 -- 172.21.15.26:0/204226432 shutdown_connections 2023-10-01T08:01:01.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.112+0000 7f333c007700 1 --2- 172.21.15.26:0/204226432 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f333409e410 0x7f3334133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:01.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.112+0000 7f333c007700 1 --2- 172.21.15.26:0/204226432 >> v2:172.21.15.26:3300/0 conn(0x7f333409d6f0 0x7f333409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:01.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.112+0000 7f333c007700 1 --2- 172.21.15.26:0/204226432 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f333409e000 0x7f33341339f0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:01.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.112+0000 7f333c007700 1 -- 172.21.15.26:0/204226432 >> 172.21.15.26:0/204226432 conn(0x7f3334066f50 msgr2=0x7f333409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:01.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.112+0000 7f333c007700 1 -- 172.21.15.26:0/204226432 shutdown_connections 2023-10-01T08:01:01.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.112+0000 7f333c007700 1 -- 172.21.15.26:0/204226432 wait complete. 2023-10-01T08:01:01.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.113+0000 7f333c007700 1 Processor -- start 2023-10-01T08:01:01.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.113+0000 7f333c007700 1 -- start start 2023-10-01T08:01:01.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.114+0000 7f333c007700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f333409d6f0 0x7f33341a5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:01.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.114+0000 7f333c007700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f333409e000 0x7f33341a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:01.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.114+0000 7f333c007700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f333409e410 0x7f33341a6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:01.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.114+0000 7f333c007700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33341aa210 con 0x7f333409d6f0 2023-10-01T08:01:01.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.114+0000 7f333c007700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33341a7f70 con 0x7f333409e000 2023-10-01T08:01:01.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.114+0000 7f333c007700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33341a7940 con 0x7f333409e410 2023-10-01T08:01:01.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.114+0000 7f3339da3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f333409d6f0 0x7f33341a5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:01.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.114+0000 7f33395a2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f333409e000 0x7f33341a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:01.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.114+0000 7f333a5a4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f333409e410 0x7f33341a6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:01.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.114+0000 7f3339da3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f333409d6f0 0x7f33341a5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58650/0 (socket says 172.21.15.26:58650) 2023-10-01T08:01:01.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.114+0000 7f33395a2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f333409e000 0x7f33341a6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43166/0 (socket says 172.21.15.26:43166) 2023-10-01T08:01:01.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.114+0000 7f3339da3700 1 -- 172.21.15.26:0/4118121513 learned_addr learned my addr 172.21.15.26:0/4118121513 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:01.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.114+0000 7f33395a2700 1 -- 172.21.15.26:0/4118121513 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f333409e410 msgr2=0x7f33341a6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:01.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.114+0000 7f33395a2700 1 --2- 172.21.15.26:0/4118121513 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f333409e410 0x7f33341a6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:01.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.114+0000 7f33395a2700 1 -- 172.21.15.26:0/4118121513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f333409d6f0 msgr2=0x7f33341a5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:01.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.114+0000 7f33395a2700 1 --2- 172.21.15.26:0/4118121513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f333409d6f0 0x7f33341a5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:01.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.114+0000 7f33395a2700 1 -- 172.21.15.26:0/4118121513 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3330009550 con 0x7f333409e000 2023-10-01T08:01:01.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.114+0000 7f333a5a4700 1 --2- 172.21.15.26:0/4118121513 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f333409e410 0x7f33341a6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:01.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.114+0000 7f3339da3700 1 --2- 172.21.15.26:0/4118121513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f333409d6f0 0x7f33341a5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:01.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.114+0000 7f33395a2700 1 --2- 172.21.15.26:0/4118121513 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f333409e000 0x7f33341a6300 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f333406b640 tx=0x7f3324004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:01.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.115+0000 7f332a7fc700 1 -- 172.21.15.26:0/4118121513 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3324004450 con 0x7f333409e000 2023-10-01T08:01:01.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.115+0000 7f332a7fc700 1 -- 172.21.15.26:0/4118121513 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332401f070 con 0x7f333409e000 2023-10-01T08:01:01.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.115+0000 7f332a7fc700 1 -- 172.21.15.26:0/4118121513 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33240038c0 con 0x7f333409e000 2023-10-01T08:01:01.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.115+0000 7f333c007700 1 -- 172.21.15.26:0/4118121513 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33240094a0 con 0x7f333409e000 2023-10-01T08:01:01.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.115+0000 7f333c007700 1 -- 172.21.15.26:0/4118121513 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33341a8b90 con 0x7f333409e000 2023-10-01T08:01:01.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.115+0000 7f332a7fc700 1 -- 172.21.15.26:0/4118121513 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3324003a20 con 0x7f333409e000 2023-10-01T08:01:01.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.116+0000 7f332a7fc700 1 -- 172.21.15.26:0/4118121513 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3324021070 con 0x7f333409e000 2023-10-01T08:01:01.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.116+0000 7f333c007700 1 -- 172.21.15.26:0/4118121513 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3334074ea0 con 0x7f333409e000 2023-10-01T08:01:01.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.120+0000 7f332a7fc700 1 -- 172.21.15.26:0/4118121513 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3324040e60 con 0x7f333409e000 2023-10-01T08:01:01.156 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:01.198 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:01.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.303+0000 7fb7cd495700 1 Processor -- start 2023-10-01T08:01:01.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.303+0000 7fb7cd495700 1 -- start start 2023-10-01T08:01:01.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.304+0000 7fb7cd495700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7c809d6f0 0x7fb7c809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:01.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.304+0000 7fb7cd495700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb7c809e410 0x7fb7c8130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:01.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.304+0000 7fb7cd495700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7c809f130 con 0x7fb7c809e000 2023-10-01T08:01:01.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.304+0000 7fb7cd495700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7c809f520 con 0x7fb7c809e410 2023-10-01T08:01:01.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.304+0000 7fb7cd495700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c809e930 con 0x7fb7c809d6f0 2023-10-01T08:01:01.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.304+0000 7fb7c77fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb7c809e410 0x7fb7c8130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:01.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.304+0000 7fb7c6ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7c809d6f0 0x7fb7c809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:01.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.304+0000 7fb7c77fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb7c809e410 0x7fb7c8130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58656/0 (socket says 172.21.15.26:58656) 2023-10-01T08:01:01.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.304+0000 7fb7c77fe700 1 -- 172.21.15.26:0/1120317405 learned_addr learned my addr 172.21.15.26:0/1120317405 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:01.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.304+0000 7fb7c6ffd700 1 -- 172.21.15.26:0/1120317405 >> v2:172.21.15.26:3300/0 conn(0x7fb7c809e410 msgr2=0x7fb7c8130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:01.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.304+0000 7fb7c6ffd700 1 --2- 172.21.15.26:0/1120317405 >> v2:172.21.15.26:3300/0 conn(0x7fb7c809e410 0x7fb7c8130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:01.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.304+0000 7fb7c6ffd700 1 -- 172.21.15.26:0/1120317405 >> v1:172.21.15.26:6789/0 conn(0x7fb7c809e000 legacy=0x7fb7c8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:01.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.304+0000 7fb7c6ffd700 1 -- 172.21.15.26:0/1120317405 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c809b2d0 con 0x7fb7c809d6f0 2023-10-01T08:01:01.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.304+0000 7fb7c77fe700 1 --2- 172.21.15.26:0/1120317405 >> v2:172.21.15.26:3300/0 conn(0x7fb7c809e410 0x7fb7c8130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:01.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.305+0000 7fb7c6ffd700 1 --2- 172.21.15.26:0/1120317405 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7c809d6f0 0x7fb7c809dac0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8009840 tx=0x7fb7b8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=680e95f98af7b99a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:01.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.305+0000 7fb7c5ffb700 1 -- 172.21.15.26:0/1120317405 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b8011830 con 0x7fb7c809d6f0 2023-10-01T08:01:01.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.305+0000 7fb7c5ffb700 1 -- 172.21.15.26:0/1120317405 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b8011990 con 0x7fb7c809d6f0 2023-10-01T08:01:01.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.305+0000 7fb7c5ffb700 1 -- 172.21.15.26:0/1120317405 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b8011d20 con 0x7fb7c809d6f0 2023-10-01T08:01:01.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.305+0000 7fb7cd495700 1 -- 172.21.15.26:0/1120317405 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7c809d6f0 msgr2=0x7fb7c809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:01.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.305+0000 7fb7cd495700 1 --2- 172.21.15.26:0/1120317405 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7c809d6f0 0x7fb7c809dac0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8009840 tx=0x7fb7b8009b50 comp rx=0 tx=0).stop 2023-10-01T08:01:01.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.306+0000 7fb7cd495700 1 -- 172.21.15.26:0/1120317405 shutdown_connections 2023-10-01T08:01:01.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.306+0000 7fb7cd495700 1 --2- 172.21.15.26:0/1120317405 >> v2:172.21.15.26:3300/0 conn(0x7fb7c809e410 0x7fb7c8130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:01.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.306+0000 7fb7cd495700 1 --2- 172.21.15.26:0/1120317405 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7c809d6f0 0x7fb7c809dac0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:01.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.306+0000 7fb7cd495700 1 -- 172.21.15.26:0/1120317405 >> 172.21.15.26:0/1120317405 conn(0x7fb7c8066f50 msgr2=0x7fb7c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:01.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.306+0000 7fb7cd495700 1 -- 172.21.15.26:0/1120317405 shutdown_connections 2023-10-01T08:01:01.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.306+0000 7fb7cd495700 1 -- 172.21.15.26:0/1120317405 wait complete. 2023-10-01T08:01:01.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.307+0000 7fb7cd495700 1 Processor -- start 2023-10-01T08:01:01.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.307+0000 7fb7cd495700 1 -- start start 2023-10-01T08:01:01.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.307+0000 7fb7cd495700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7c809d6f0 0x7fb7c8122800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:01.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.307+0000 7fb7cd495700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7c809e000 0x7fb7c8122d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:01.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.307+0000 7fb7cd495700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7c809e410 0x7fb7c8123280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:01.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.307+0000 7fb7cd495700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c8124380 con 0x7fb7c809d6f0 2023-10-01T08:01:01.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.307+0000 7fb7cd495700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c809c770 con 0x7fb7c809e410 2023-10-01T08:01:01.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.307+0000 7fb7cd495700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c8124980 con 0x7fb7c809e000 2023-10-01T08:01:01.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.308+0000 7fb7c6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7c809d6f0 0x7fb7c8122800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:01.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.308+0000 7fb7c6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7c809d6f0 0x7fb7c8122800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58658/0 (socket says 172.21.15.26:58658) 2023-10-01T08:01:01.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.308+0000 7fb7c6ffd700 1 -- 172.21.15.26:0/2694056650 learned_addr learned my addr 172.21.15.26:0/2694056650 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:01.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.308+0000 7fb7c77fe700 1 --2- 172.21.15.26:0/2694056650 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7c809e410 0x7fb7c8123280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:01.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.308+0000 7fb7c67fc700 1 --2- 172.21.15.26:0/2694056650 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7c809e000 0x7fb7c8122d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:01.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.308+0000 7fb7c6ffd700 1 -- 172.21.15.26:0/2694056650 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7c809e000 msgr2=0x7fb7c8122d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:01.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.308+0000 7fb7c6ffd700 1 --2- 172.21.15.26:0/2694056650 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7c809e000 0x7fb7c8122d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:01.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.308+0000 7fb7c6ffd700 1 -- 172.21.15.26:0/2694056650 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7c809e410 msgr2=0x7fb7c8123280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:01.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.308+0000 7fb7c6ffd700 1 --2- 172.21.15.26:0/2694056650 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7c809e410 0x7fb7c8123280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:01.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.308+0000 7fb7c6ffd700 1 -- 172.21.15.26:0/2694056650 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c0009b30 con 0x7fb7c809d6f0 2023-10-01T08:01:01.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.308+0000 7fb7c77fe700 1 --2- 172.21.15.26:0/2694056650 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7c809e410 0x7fb7c8123280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:01.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.308+0000 7fb7c6ffd700 1 --2- 172.21.15.26:0/2694056650 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7c809d6f0 0x7fb7c8122800 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8009fd0 tx=0x7fb7b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:01.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.309+0000 7fb7af7fe700 1 -- 172.21.15.26:0/2694056650 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b80036a0 con 0x7fb7c809d6f0 2023-10-01T08:01:01.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.309+0000 7fb7af7fe700 1 -- 172.21.15.26:0/2694056650 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b801e070 con 0x7fb7c809d6f0 2023-10-01T08:01:01.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.309+0000 7fb7cd495700 1 -- 172.21.15.26:0/2694056650 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b80094a0 con 0x7fb7c809d6f0 2023-10-01T08:01:01.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.309+0000 7fb7af7fe700 1 -- 172.21.15.26:0/2694056650 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b8003a40 con 0x7fb7c809d6f0 2023-10-01T08:01:01.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.309+0000 7fb7cd495700 1 -- 172.21.15.26:0/2694056650 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7c80a1ee0 con 0x7fb7c809d6f0 2023-10-01T08:01:01.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.310+0000 7fb7af7fe700 1 -- 172.21.15.26:0/2694056650 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb7b8003ba0 con 0x7fb7c809d6f0 2023-10-01T08:01:01.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.310+0000 7fb7af7fe700 1 -- 172.21.15.26:0/2694056650 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb7b80405a0 con 0x7fb7c809d6f0 2023-10-01T08:01:01.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.310+0000 7fb7cd495700 1 -- 172.21.15.26:0/2694056650 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7c81260d0 con 0x7fb7c809d6f0 2023-10-01T08:01:01.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.315+0000 7fb7af7fe700 1 -- 172.21.15.26:0/2694056650 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb7b8015020 con 0x7fb7c809d6f0 2023-10-01T08:01:01.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.328+0000 7f333c007700 1 -- 172.21.15.26:0/4118121513 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f333406c360 con 0x7f333409e000 2023-10-01T08:01:01.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.329+0000 7f332a7fc700 1 -- 172.21.15.26:0/4118121513 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3324034070 con 0x7f333409e000 2023-10-01T08:01:01.330 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:01.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.331+0000 7f333c007700 1 -- 172.21.15.26:0/4118121513 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f333409e000 msgr2=0x7f33341a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:01.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.331+0000 7f333c007700 1 --2- 172.21.15.26:0/4118121513 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f333409e000 0x7f33341a6300 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f333406b640 tx=0x7f3324004750 comp rx=0 tx=0).stop 2023-10-01T08:01:01.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.331+0000 7f333c007700 1 -- 172.21.15.26:0/4118121513 shutdown_connections 2023-10-01T08:01:01.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.331+0000 7f333c007700 1 --2- 172.21.15.26:0/4118121513 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f333409e410 0x7f33341a6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:01.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.331+0000 7f333c007700 1 --2- 172.21.15.26:0/4118121513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f333409d6f0 0x7f33341a5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:01.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.331+0000 7f333c007700 1 --2- 172.21.15.26:0/4118121513 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f333409e000 0x7f33341a6300 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:01.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.331+0000 7f333c007700 1 -- 172.21.15.26:0/4118121513 >> 172.21.15.26:0/4118121513 conn(0x7f3334066f50 msgr2=0x7f333406f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:01.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.331+0000 7f333c007700 1 -- 172.21.15.26:0/4118121513 shutdown_connections 2023-10-01T08:01:01.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.331+0000 7f333c007700 1 -- 172.21.15.26:0/4118121513 wait complete. 2023-10-01T08:01:01.346 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:01.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.348+0000 7f0d236af700 1 Processor -- start 2023-10-01T08:01:01.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.348+0000 7f0d236af700 1 -- start start 2023-10-01T08:01:01.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.349+0000 7f0d236af700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0d1c1337f0 0x7f0d1c138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:01.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.349+0000 7f0d236af700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d1c138dc0 0x7f0d1c13b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:01.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.349+0000 7f0d236af700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d1c06b990 con 0x7f0d1c133420 2023-10-01T08:01:01.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.349+0000 7f0d236af700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d1c09b0e0 con 0x7f0d1c1337f0 2023-10-01T08:01:01.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.349+0000 7f0d236af700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c133c20 con 0x7f0d1c138dc0 2023-10-01T08:01:01.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.349+0000 7f0d21c4c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d1c138dc0 0x7f0d1c13b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:01.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.349+0000 7f0d20c4a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0d1c1337f0 0x7f0d1c138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:01.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.349+0000 7f0d21c4c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d1c138dc0 0x7f0d1c13b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43194/0 (socket says 172.21.15.26:43194) 2023-10-01T08:01:01.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.349+0000 7f0d21c4c700 1 -- 172.21.15.26:0/701739514 learned_addr learned my addr 172.21.15.26:0/701739514 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:01.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.349+0000 7f0d2144b700 1 --1- 172.21.15.26:0/701739514 >> v1:172.21.15.26:6789/0 conn(0x7f0d1c133420 0x7f0d1c133e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39654/0 (socket says 172.21.15.26:39654) 2023-10-01T08:01:01.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.349+0000 7f0d21c4c700 1 -- 172.21.15.26:0/701739514 >> v2:172.21.15.26:3300/0 conn(0x7f0d1c1337f0 msgr2=0x7f0d1c138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:01.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.349+0000 7f0d21c4c700 1 --2- 172.21.15.26:0/701739514 >> v2:172.21.15.26:3300/0 conn(0x7f0d1c1337f0 0x7f0d1c138880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:01.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.349+0000 7f0d21c4c700 1 -- 172.21.15.26:0/701739514 >> v1:172.21.15.26:6789/0 conn(0x7f0d1c133420 legacy=0x7f0d1c133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:01.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.349+0000 7f0d21c4c700 1 -- 172.21.15.26:0/701739514 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d1c0a0590 con 0x7f0d1c138dc0 2023-10-01T08:01:01.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.349+0000 7f0d21c4c700 1 --2- 172.21.15.26:0/701739514 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d1c138dc0 0x7f0d1c13b1a0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c009e50 tx=0x7f0d0c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60197c0051d382d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:01.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.350+0000 7f0d1bfff700 1 -- 172.21.15.26:0/701739514 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c00e070 con 0x7f0d1c138dc0 2023-10-01T08:01:01.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.350+0000 7f0d1bfff700 1 -- 172.21.15.26:0/701739514 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0c00b910 con 0x7f0d1c138dc0 2023-10-01T08:01:01.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.350+0000 7f0d1bfff700 1 -- 172.21.15.26:0/701739514 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c00bcc0 con 0x7f0d1c138dc0 2023-10-01T08:01:01.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.350+0000 7f0d236af700 1 -- 172.21.15.26:0/701739514 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d1c138dc0 msgr2=0x7f0d1c13b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:01.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.350+0000 7f0d236af700 1 --2- 172.21.15.26:0/701739514 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d1c138dc0 0x7f0d1c13b1a0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c009e50 tx=0x7f0d0c00b330 comp rx=0 tx=0).stop 2023-10-01T08:01:01.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.350+0000 7f0d236af700 1 -- 172.21.15.26:0/701739514 shutdown_connections 2023-10-01T08:01:01.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.350+0000 7f0d236af700 1 --2- 172.21.15.26:0/701739514 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d1c138dc0 0x7f0d1c13b1a0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:01.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.350+0000 7f0d236af700 1 --2- 172.21.15.26:0/701739514 >> v2:172.21.15.26:3300/0 conn(0x7f0d1c1337f0 0x7f0d1c138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:01.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.350+0000 7f0d236af700 1 -- 172.21.15.26:0/701739514 >> 172.21.15.26:0/701739514 conn(0x7f0d1c0a4210 msgr2=0x7f0d1c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:01.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.350+0000 7f0d236af700 1 -- 172.21.15.26:0/701739514 shutdown_connections 2023-10-01T08:01:01.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.350+0000 7f0d236af700 1 -- 172.21.15.26:0/701739514 wait complete. 2023-10-01T08:01:01.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.351+0000 7f0d236af700 1 Processor -- start 2023-10-01T08:01:01.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.351+0000 7f0d236af700 1 -- start start 2023-10-01T08:01:01.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.352+0000 7f0d236af700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d1c133420 0x7f0d1c0709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:01.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.352+0000 7f0d236af700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d1c1337f0 0x7f0d1c070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:01.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.352+0000 7f0d236af700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d1c138dc0 0x7f0d1c071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:01.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.352+0000 7f0d236af700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c072460 con 0x7f0d1c138dc0 2023-10-01T08:01:01.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.352+0000 7f0d236af700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c09b430 con 0x7f0d1c133420 2023-10-01T08:01:01.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.352+0000 7f0d236af700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c09b6a0 con 0x7f0d1c1337f0 2023-10-01T08:01:01.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.352+0000 7f0d20c4a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d1c1337f0 0x7f0d1c070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:01.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.352+0000 7f0d2144b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d1c133420 0x7f0d1c0709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:01.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.352+0000 7f0d20c4a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d1c1337f0 0x7f0d1c070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41364/0 (socket says 172.21.15.26:41364) 2023-10-01T08:01:01.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.352+0000 7f0d20c4a700 1 -- 172.21.15.26:0/3854581577 learned_addr learned my addr 172.21.15.26:0/3854581577 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:01.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.352+0000 7f0d21c4c700 1 --2- 172.21.15.26:0/3854581577 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d1c138dc0 0x7f0d1c071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:01.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.352+0000 7f0d2144b700 1 -- 172.21.15.26:0/3854581577 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d1c1337f0 msgr2=0x7f0d1c070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:01.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.352+0000 7f0d2144b700 1 --2- 172.21.15.26:0/3854581577 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d1c1337f0 0x7f0d1c070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:01.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.352+0000 7f0d2144b700 1 -- 172.21.15.26:0/3854581577 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d1c138dc0 msgr2=0x7f0d1c071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:01.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.352+0000 7f0d2144b700 1 --2- 172.21.15.26:0/3854581577 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d1c138dc0 0x7f0d1c071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:01.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.352+0000 7f0d2144b700 1 -- 172.21.15.26:0/3854581577 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0c009b30 con 0x7f0d1c133420 2023-10-01T08:01:01.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.352+0000 7f0d21c4c700 1 --2- 172.21.15.26:0/3854581577 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d1c138dc0 0x7f0d1c071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:01.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.353+0000 7f0d2144b700 1 --2- 172.21.15.26:0/3854581577 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d1c133420 0x7f0d1c0709a0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f0d1400c450 tx=0x7f0d1400c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:01.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.353+0000 7f0d19ffb700 1 -- 172.21.15.26:0/3854581577 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d14005cb0 con 0x7f0d1c133420 2023-10-01T08:01:01.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.353+0000 7f0d19ffb700 1 -- 172.21.15.26:0/3854581577 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d14005e10 con 0x7f0d1c133420 2023-10-01T08:01:01.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.353+0000 7f0d236af700 1 -- 172.21.15.26:0/3854581577 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d1c1388a0 con 0x7f0d1c133420 2023-10-01T08:01:01.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.353+0000 7f0d19ffb700 1 -- 172.21.15.26:0/3854581577 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d140072d0 con 0x7f0d1c133420 2023-10-01T08:01:01.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.353+0000 7f0d236af700 1 -- 172.21.15.26:0/3854581577 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d1c09cab0 con 0x7f0d1c133420 2023-10-01T08:01:01.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.354+0000 7f0d19ffb700 1 -- 172.21.15.26:0/3854581577 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0d14007430 con 0x7f0d1c133420 2023-10-01T08:01:01.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.354+0000 7f0d19ffb700 1 -- 172.21.15.26:0/3854581577 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0d1403eae0 con 0x7f0d1c133420 2023-10-01T08:01:01.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.354+0000 7f0d236af700 1 -- 172.21.15.26:0/3854581577 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d1c09cca0 con 0x7f0d1c133420 2023-10-01T08:01:01.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.359+0000 7f0d19ffb700 1 -- 172.21.15.26:0/3854581577 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0d14017020 con 0x7f0d1c133420 2023-10-01T08:01:01.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.524+0000 7fb7cd495700 1 -- 172.21.15.26:0/2694056650 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb7c8074ea0 con 0x7fb7c809d6f0 2023-10-01T08:01:01.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.524+0000 7fb7af7fe700 1 -- 172.21.15.26:0/2694056650 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb7b802d7d0 con 0x7fb7c809d6f0 2023-10-01T08:01:01.525 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:01.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.526+0000 7fb7cd495700 1 -- 172.21.15.26:0/2694056650 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7c809d6f0 msgr2=0x7fb7c8122800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:01.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.526+0000 7fb7cd495700 1 --2- 172.21.15.26:0/2694056650 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7c809d6f0 0x7fb7c8122800 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8009fd0 tx=0x7fb7b8004750 comp rx=0 tx=0).stop 2023-10-01T08:01:01.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.527+0000 7fb7cd495700 1 -- 172.21.15.26:0/2694056650 shutdown_connections 2023-10-01T08:01:01.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.527+0000 7fb7cd495700 1 --2- 172.21.15.26:0/2694056650 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7c809e410 0x7fb7c8123280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:01.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.527+0000 7fb7cd495700 1 --2- 172.21.15.26:0/2694056650 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7c809d6f0 0x7fb7c8122800 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:01.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.527+0000 7fb7cd495700 1 --2- 172.21.15.26:0/2694056650 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7c809e000 0x7fb7c8122d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:01.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.527+0000 7fb7cd495700 1 -- 172.21.15.26:0/2694056650 >> 172.21.15.26:0/2694056650 conn(0x7fb7c8066f50 msgr2=0x7fb7c80a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:01.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.527+0000 7fb7cd495700 1 -- 172.21.15.26:0/2694056650 shutdown_connections 2023-10-01T08:01:01.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.527+0000 7fb7cd495700 1 -- 172.21.15.26:0/2694056650 wait complete. 2023-10-01T08:01:01.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:01.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.565+0000 7f0d236af700 1 -- 172.21.15.26:0/3854581577 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0d1c09c040 con 0x7f0d1c133420 2023-10-01T08:01:01.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.566+0000 7f0d19ffb700 1 -- 172.21.15.26:0/3854581577 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0d140076e0 con 0x7f0d1c133420 2023-10-01T08:01:01.567 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:01.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.568+0000 7f0d236af700 1 -- 172.21.15.26:0/3854581577 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d1c133420 msgr2=0x7f0d1c0709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:01.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.568+0000 7f0d236af700 1 --2- 172.21.15.26:0/3854581577 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d1c133420 0x7f0d1c0709a0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f0d1400c450 tx=0x7f0d1400c760 comp rx=0 tx=0).stop 2023-10-01T08:01:01.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.568+0000 7f0d236af700 1 -- 172.21.15.26:0/3854581577 shutdown_connections 2023-10-01T08:01:01.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.568+0000 7f0d236af700 1 --2- 172.21.15.26:0/3854581577 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d1c138dc0 0x7f0d1c071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:01.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.568+0000 7f0d236af700 1 --2- 172.21.15.26:0/3854581577 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d1c133420 0x7f0d1c0709a0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:01.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.568+0000 7f0d236af700 1 --2- 172.21.15.26:0/3854581577 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d1c1337f0 0x7f0d1c070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:01.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.568+0000 7f0d236af700 1 -- 172.21.15.26:0/3854581577 >> 172.21.15.26:0/3854581577 conn(0x7f0d1c0a4210 msgr2=0x7f0d1c131400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:01.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.568+0000 7f0d236af700 1 -- 172.21.15.26:0/3854581577 shutdown_connections 2023-10-01T08:01:01.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:01.568+0000 7f0d236af700 1 -- 172.21.15.26:0/3854581577 wait complete. 2023-10-01T08:01:01.582 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:01.968 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:02.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.114+0000 7fe419f1e700 1 Processor -- start 2023-10-01T08:01:02.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.114+0000 7fe419f1e700 1 -- start start 2023-10-01T08:01:02.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.115+0000 7fe419f1e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe41406a770 0x7fe41406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:02.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.115+0000 7fe419f1e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41406b080 0x7fe414131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:02.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.115+0000 7fe419f1e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe414131b40 0x7fe414131fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:02.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.115+0000 7fe419f1e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe41409ece0 con 0x7fe414131b40 2023-10-01T08:01:02.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.115+0000 7fe419f1e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41409e760 con 0x7fe41406b080 2023-10-01T08:01:02.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.115+0000 7fe419f1e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe41409e040 con 0x7fe41406a770 2023-10-01T08:01:02.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.115+0000 7fe413fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe414131b40 0x7fe414131fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:02.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.115+0000 7fe412ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41406b080 0x7fe414131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:02.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.115+0000 7fe4137fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe41406a770 0x7fe41406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:02.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.115+0000 7fe412ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41406b080 0x7fe414131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43216/0 (socket says 172.21.15.26:43216) 2023-10-01T08:01:02.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.115+0000 7fe412ffd700 1 -- 172.21.15.26:0/1719242169 learned_addr learned my addr 172.21.15.26:0/1719242169 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:02.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.115+0000 7fe413fff700 1 --2- 172.21.15.26:0/1719242169 >> v2:172.21.15.26:3300/0 conn(0x7fe414131b40 0x7fe414131fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58678/0 (socket says 172.21.15.26:58678) 2023-10-01T08:01:02.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.115+0000 7fe412ffd700 1 -- 172.21.15.26:0/1719242169 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe41406a770 msgr2=0x7fe41406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:02.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.115+0000 7fe412ffd700 1 --2- 172.21.15.26:0/1719242169 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe41406a770 0x7fe41406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.115+0000 7fe412ffd700 1 -- 172.21.15.26:0/1719242169 >> v2:172.21.15.26:3300/0 conn(0x7fe414131b40 msgr2=0x7fe414131fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:02.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.115+0000 7fe412ffd700 1 --2- 172.21.15.26:0/1719242169 >> v2:172.21.15.26:3300/0 conn(0x7fe414131b40 0x7fe414131fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.115+0000 7fe412ffd700 1 -- 172.21.15.26:0/1719242169 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41409f630 con 0x7fe41406b080 2023-10-01T08:01:02.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.115+0000 7fe413fff700 1 --2- 172.21.15.26:0/1719242169 >> v2:172.21.15.26:3300/0 conn(0x7fe414131b40 0x7fe414131fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:02.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.115+0000 7fe4137fe700 1 --2- 172.21.15.26:0/1719242169 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe41406a770 0x7fe41406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:02.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.116+0000 7fe412ffd700 1 --2- 172.21.15.26:0/1719242169 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41406b080 0x7fe414131600 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fe4080098f0 tx=0x7fe408009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b99dbbb45ea86b43 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:02.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.116+0000 7fe4127fc700 1 -- 172.21.15.26:0/1719242169 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe408011830 con 0x7fe41406b080 2023-10-01T08:01:02.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.116+0000 7fe4127fc700 1 -- 172.21.15.26:0/1719242169 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe408011990 con 0x7fe41406b080 2023-10-01T08:01:02.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.116+0000 7fe4127fc700 1 -- 172.21.15.26:0/1719242169 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe408011d20 con 0x7fe41406b080 2023-10-01T08:01:02.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.116+0000 7fe419f1e700 1 -- 172.21.15.26:0/1719242169 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41406b080 msgr2=0x7fe414131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:02.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.116+0000 7fe419f1e700 1 --2- 172.21.15.26:0/1719242169 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41406b080 0x7fe414131600 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fe4080098f0 tx=0x7fe408009c00 comp rx=0 tx=0).stop 2023-10-01T08:01:02.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.116+0000 7fe419f1e700 1 -- 172.21.15.26:0/1719242169 shutdown_connections 2023-10-01T08:01:02.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.117+0000 7fe419f1e700 1 --2- 172.21.15.26:0/1719242169 >> v2:172.21.15.26:3300/0 conn(0x7fe414131b40 0x7fe414131fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.117+0000 7fe419f1e700 1 --2- 172.21.15.26:0/1719242169 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe41406a770 0x7fe41406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.117+0000 7fe419f1e700 1 --2- 172.21.15.26:0/1719242169 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41406b080 0x7fe414131600 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.117+0000 7fe419f1e700 1 -- 172.21.15.26:0/1719242169 >> 172.21.15.26:0/1719242169 conn(0x7fe414066f50 msgr2=0x7fe41409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:02.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.117+0000 7fe419f1e700 1 -- 172.21.15.26:0/1719242169 shutdown_connections 2023-10-01T08:01:02.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.117+0000 7fe419f1e700 1 -- 172.21.15.26:0/1719242169 wait complete. 2023-10-01T08:01:02.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.118+0000 7fe419f1e700 1 Processor -- start 2023-10-01T08:01:02.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.118+0000 7fe419f1e700 1 -- start start 2023-10-01T08:01:02.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.118+0000 7fe419f1e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe41406a770 0x7fe41409a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:02.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.118+0000 7fe419f1e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41406b080 0x7fe41409a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:02.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.118+0000 7fe419f1e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe414131b40 0x7fe41409ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:02.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.118+0000 7fe419f1e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe414125cc0 con 0x7fe414131b40 2023-10-01T08:01:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.118+0000 7fe419f1e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe414130c80 con 0x7fe41406b080 2023-10-01T08:01:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.118+0000 7fe419f1e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe41409c0b0 con 0x7fe41406a770 2023-10-01T08:01:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.119+0000 7fe412ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41406b080 0x7fe41409a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.119+0000 7fe413fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe414131b40 0x7fe41409ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.119+0000 7fe4137fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe41406a770 0x7fe41409a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.119+0000 7fe412ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41406b080 0x7fe41409a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43232/0 (socket says 172.21.15.26:43232) 2023-10-01T08:01:02.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.119+0000 7fe413fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe414131b40 0x7fe41409ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58680/0 (socket says 172.21.15.26:58680) 2023-10-01T08:01:02.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.119+0000 7fe4137fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe41406a770 0x7fe41409a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41372/0 (socket says 172.21.15.26:41372) 2023-10-01T08:01:02.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.119+0000 7fe412ffd700 1 -- 172.21.15.26:0/1560950517 learned_addr learned my addr 172.21.15.26:0/1560950517 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:02.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.119+0000 7fe413fff700 1 -- 172.21.15.26:0/1560950517 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe41406a770 msgr2=0x7fe41409a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:02.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.119+0000 7fe413fff700 1 --2- 172.21.15.26:0/1560950517 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe41406a770 0x7fe41409a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.119+0000 7fe413fff700 1 -- 172.21.15.26:0/1560950517 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41406b080 msgr2=0x7fe41409a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:02.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.119+0000 7fe413fff700 1 --2- 172.21.15.26:0/1560950517 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41406b080 0x7fe41409a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.119+0000 7fe413fff700 1 -- 172.21.15.26:0/1560950517 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4040094a0 con 0x7fe414131b40 2023-10-01T08:01:02.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.119+0000 7fe412ffd700 1 --2- 172.21.15.26:0/1560950517 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41406b080 0x7fe41409a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:02.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.119+0000 7fe413fff700 1 --2- 172.21.15.26:0/1560950517 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe414131b40 0x7fe41409ae80 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fe40c00efc0 tx=0x7fe40c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:02.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.119+0000 7fe3fbfff700 1 -- 172.21.15.26:0/1560950517 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c00ca90 con 0x7fe414131b40 2023-10-01T08:01:02.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.119+0000 7fe3fbfff700 1 -- 172.21.15.26:0/1560950517 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40c00f040 con 0x7fe414131b40 2023-10-01T08:01:02.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.119+0000 7fe419f1e700 1 -- 172.21.15.26:0/1560950517 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe40c009a70 con 0x7fe414131b40 2023-10-01T08:01:02.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.119+0000 7fe3fbfff700 1 -- 172.21.15.26:0/1560950517 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c00ce30 con 0x7fe414131b40 2023-10-01T08:01:02.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.119+0000 7fe419f1e700 1 -- 172.21.15.26:0/1560950517 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe408009550 con 0x7fe414131b40 2023-10-01T08:01:02.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.120+0000 7fe3fbfff700 1 -- 172.21.15.26:0/1560950517 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe40c014480 con 0x7fe414131b40 2023-10-01T08:01:02.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.120+0000 7fe419f1e700 1 -- 172.21.15.26:0/1560950517 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe414071e60 con 0x7fe414131b40 2023-10-01T08:01:02.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.120+0000 7fe3fbfff700 1 -- 172.21.15.26:0/1560950517 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe40c03fd50 con 0x7fe414131b40 2023-10-01T08:01:02.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.125+0000 7fe3fbfff700 1 -- 172.21.15.26:0/1560950517 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe40c012910 con 0x7fe414131b40 2023-10-01T08:01:02.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.331+0000 7fe419f1e700 1 -- 172.21.15.26:0/1560950517 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe414125900 con 0x7fe414131b40 2023-10-01T08:01:02.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.331+0000 7fe3fbfff700 1 -- 172.21.15.26:0/1560950517 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe40c009cc0 con 0x7fe414131b40 2023-10-01T08:01:02.332 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:02.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.333+0000 7fe419f1e700 1 -- 172.21.15.26:0/1560950517 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe414131b40 msgr2=0x7fe41409ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:02.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.333+0000 7fe419f1e700 1 --2- 172.21.15.26:0/1560950517 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe414131b40 0x7fe41409ae80 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fe40c00efc0 tx=0x7fe40c00c3a0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.333+0000 7fe419f1e700 1 -- 172.21.15.26:0/1560950517 shutdown_connections 2023-10-01T08:01:02.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.333+0000 7fe419f1e700 1 --2- 172.21.15.26:0/1560950517 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe414131b40 0x7fe41409ae80 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.333+0000 7fe419f1e700 1 --2- 172.21.15.26:0/1560950517 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe41406a770 0x7fe41409a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.333+0000 7fe419f1e700 1 --2- 172.21.15.26:0/1560950517 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41406b080 0x7fe41409a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.333+0000 7fe419f1e700 1 -- 172.21.15.26:0/1560950517 >> 172.21.15.26:0/1560950517 conn(0x7fe414066f50 msgr2=0x7fe4140714d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:02.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.333+0000 7fe419f1e700 1 -- 172.21.15.26:0/1560950517 shutdown_connections 2023-10-01T08:01:02.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.333+0000 7fe419f1e700 1 -- 172.21.15.26:0/1560950517 wait complete. 2023-10-01T08:01:02.347 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:02.348 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:02.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.527+0000 7fed557c6700 1 Processor -- start 2023-10-01T08:01:02.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.527+0000 7fed557c6700 1 -- start start 2023-10-01T08:01:02.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.528+0000 7fed557c6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fed5009f410 0x7fed50136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:02.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.528+0000 7fed557c6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fed50136fe0 0x7fed501393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:02.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.528+0000 7fed557c6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed50070940 con 0x7fed5009e930 2023-10-01T08:01:02.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.528+0000 7fed557c6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed5006fd60 con 0x7fed5009f410 2023-10-01T08:01:02.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.528+0000 7fed557c6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed5006fa80 con 0x7fed50136fe0 2023-10-01T08:01:02.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.528+0000 7fed4e7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fed5009f410 0x7fed50136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:02.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.528+0000 7fed4f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fed50136fe0 0x7fed501393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:02.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.528+0000 7fed4f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fed50136fe0 0x7fed501393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43234/0 (socket says 172.21.15.26:43234) 2023-10-01T08:01:02.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.528+0000 7fed4e7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fed5009f410 0x7fed50136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58686/0 (socket says 172.21.15.26:58686) 2023-10-01T08:01:02.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.528+0000 7fed4f7fe700 1 -- 172.21.15.26:0/1259682880 learned_addr learned my addr 172.21.15.26:0/1259682880 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:02.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.528+0000 7fed4e7fc700 1 -- 172.21.15.26:0/1259682880 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fed50136fe0 msgr2=0x7fed501393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:02.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.528+0000 7fed4e7fc700 1 --2- 172.21.15.26:0/1259682880 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fed50136fe0 0x7fed501393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.528+0000 7fed4e7fc700 1 -- 172.21.15.26:0/1259682880 >> v1:172.21.15.26:6789/0 conn(0x7fed5009e930 legacy=0x7fed5009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:02.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.528+0000 7fed4e7fc700 1 -- 172.21.15.26:0/1259682880 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5009fb60 con 0x7fed5009f410 2023-10-01T08:01:02.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.528+0000 7fed4f7fe700 1 --2- 172.21.15.26:0/1259682880 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fed50136fe0 0x7fed501393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:02.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.528+0000 7fed4e7fc700 1 --2- 172.21.15.26:0/1259682880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed5009f410 0x7fed50136aa0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fed38009840 tx=0x7fed38009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814dd9173699d5d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:02.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.528+0000 7fed4dffb700 1 -- 172.21.15.26:0/1259682880 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed38011830 con 0x7fed5009f410 2023-10-01T08:01:02.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.529+0000 7fed4dffb700 1 -- 172.21.15.26:0/1259682880 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed38011990 con 0x7fed5009f410 2023-10-01T08:01:02.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.529+0000 7fed4dffb700 1 -- 172.21.15.26:0/1259682880 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed38011d20 con 0x7fed5009f410 2023-10-01T08:01:02.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.529+0000 7fed557c6700 1 -- 172.21.15.26:0/1259682880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed5009f410 msgr2=0x7fed50136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:02.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.529+0000 7fed557c6700 1 --2- 172.21.15.26:0/1259682880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed5009f410 0x7fed50136aa0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fed38009840 tx=0x7fed38009b50 comp rx=0 tx=0).stop 2023-10-01T08:01:02.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.529+0000 7fed557c6700 1 -- 172.21.15.26:0/1259682880 shutdown_connections 2023-10-01T08:01:02.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.529+0000 7fed557c6700 1 --2- 172.21.15.26:0/1259682880 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fed50136fe0 0x7fed501393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.529+0000 7fed557c6700 1 --2- 172.21.15.26:0/1259682880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed5009f410 0x7fed50136aa0 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.529+0000 7fed557c6700 1 -- 172.21.15.26:0/1259682880 >> 172.21.15.26:0/1259682880 conn(0x7fed500a4210 msgr2=0x7fed500a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:02.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.529+0000 7fed557c6700 1 -- 172.21.15.26:0/1259682880 shutdown_connections 2023-10-01T08:01:02.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.529+0000 7fed557c6700 1 -- 172.21.15.26:0/1259682880 wait complete. 2023-10-01T08:01:02.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.530+0000 7fed557c6700 1 Processor -- start 2023-10-01T08:01:02.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.530+0000 7fed557c6700 1 -- start start 2023-10-01T08:01:02.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.531+0000 7fed557c6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fed5009e930 0x7fed501319f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:02.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.531+0000 7fed557c6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed5009f410 0x7fed50131f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:02.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.531+0000 7fed557c6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fed50136fe0 0x7fed501c6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:02.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.531+0000 7fed557c6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed50120520 con 0x7fed5009f410 2023-10-01T08:01:02.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.531+0000 7fed557c6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed5011e7a0 con 0x7fed50136fe0 2023-10-01T08:01:02.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.531+0000 7fed557c6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed5011f840 con 0x7fed5009e930 2023-10-01T08:01:02.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.531+0000 7fed4f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fed50136fe0 0x7fed501c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:02.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.531+0000 7fed4effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fed5009e930 0x7fed501319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:02.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.531+0000 7fed4f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fed50136fe0 0x7fed501c6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:43248/0 (socket says 172.21.15.26:43248) 2023-10-01T08:01:02.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.531+0000 7fed4f7fe700 1 -- 172.21.15.26:0/2446309037 learned_addr learned my addr 172.21.15.26:0/2446309037 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:02.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.531+0000 7fed4e7fc700 1 --2- 172.21.15.26:0/2446309037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed5009f410 0x7fed50131f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:02.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.531+0000 7fed4effd700 1 -- 172.21.15.26:0/2446309037 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fed50136fe0 msgr2=0x7fed501c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:02.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.531+0000 7fed4effd700 1 --2- 172.21.15.26:0/2446309037 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fed50136fe0 0x7fed501c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.531+0000 7fed4effd700 1 -- 172.21.15.26:0/2446309037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed5009f410 msgr2=0x7fed50131f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:02.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.531+0000 7fed4effd700 1 --2- 172.21.15.26:0/2446309037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed5009f410 0x7fed50131f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.531+0000 7fed4effd700 1 -- 172.21.15.26:0/2446309037 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed48009b30 con 0x7fed5009e930 2023-10-01T08:01:02.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.532+0000 7fed4effd700 1 --2- 172.21.15.26:0/2446309037 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fed5009e930 0x7fed501319f0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fed40000f60 tx=0x7fed4000c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:02.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.532+0000 7fed477fe700 1 -- 172.21.15.26:0/2446309037 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed400052d0 con 0x7fed5009e930 2023-10-01T08:01:02.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.532+0000 7fed477fe700 1 -- 172.21.15.26:0/2446309037 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed40005430 con 0x7fed5009e930 2023-10-01T08:01:02.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.532+0000 7fed557c6700 1 -- 172.21.15.26:0/2446309037 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed380094a0 con 0x7fed5009e930 2023-10-01T08:01:02.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.532+0000 7fed477fe700 1 -- 172.21.15.26:0/2446309037 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed400038c0 con 0x7fed5009e930 2023-10-01T08:01:02.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.532+0000 7fed557c6700 1 -- 172.21.15.26:0/2446309037 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed5011f410 con 0x7fed5009e930 2023-10-01T08:01:02.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.533+0000 7fed477fe700 1 -- 172.21.15.26:0/2446309037 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fed40003a20 con 0x7fed5009e930 2023-10-01T08:01:02.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.533+0000 7fed557c6700 1 -- 172.21.15.26:0/2446309037 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed501324d0 con 0x7fed5009e930 2023-10-01T08:01:02.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.533+0000 7fed477fe700 1 -- 172.21.15.26:0/2446309037 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fed4003e9b0 con 0x7fed5009e930 2023-10-01T08:01:02.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.538+0000 7fed477fe700 1 -- 172.21.15.26:0/2446309037 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fed40019b40 con 0x7fed5009e930 2023-10-01T08:01:02.542 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:02.583 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:02.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.684+0000 7f388812a700 1 Processor -- start 2023-10-01T08:01:02.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.684+0000 7f388812a700 1 -- start start 2023-10-01T08:01:02.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.684+0000 7f388812a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f38800a0a30 0x7f38800a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:02.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.684+0000 7f388812a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3880138d80 0x7f388013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:02.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.684+0000 7f388812a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38800a2a70 con 0x7f388009d630 2023-10-01T08:01:02.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.684+0000 7f388812a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38800a01d0 con 0x7f3880138d80 2023-10-01T08:01:02.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.684+0000 7f388812a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f388009e2b0 con 0x7f38800a0a30 2023-10-01T08:01:02.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.685+0000 7f38856c5700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f388009d630 0x7f38800a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39670/0 (socket says 172.21.15.26:39670) 2023-10-01T08:01:02.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.685+0000 7f38856c5700 1 -- 172.21.15.26:0/2196843997 learned_addr learned my addr 172.21.15.26:0/2196843997 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:01:02.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.685+0000 7f3885ec6700 1 --2- 172.21.15.26:0/2196843997 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f38800a0a30 0x7f38800a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:02.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.685+0000 7f38866c7700 1 --2- 172.21.15.26:0/2196843997 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3880138d80 0x7f388013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:02.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.685+0000 7f3885ec6700 1 -- 172.21.15.26:0/2196843997 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3880138d80 msgr2=0x7f388013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:02.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.685+0000 7f3885ec6700 1 --2- 172.21.15.26:0/2196843997 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3880138d80 0x7f388013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.685+0000 7f3885ec6700 1 -- 172.21.15.26:0/2196843997 >> v1:172.21.15.26:6789/0 conn(0x7f388009d630 legacy=0x7f38800a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:02.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.685+0000 7f3884ec4700 1 -- 172.21.15.26:0/2196843997 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4135316307 0 0) 0x7f38800a2a70 con 0x7f388009d630 2023-10-01T08:01:02.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.685+0000 7f3885ec6700 1 -- 172.21.15.26:0/2196843997 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f388009dc50 con 0x7f38800a0a30 2023-10-01T08:01:02.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.685+0000 7f38866c7700 1 --2- 172.21.15.26:0/2196843997 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3880138d80 0x7f388013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:02.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.685+0000 7f3885ec6700 1 --2- 172.21.15.26:0/2196843997 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f38800a0a30 0x7f38800a0e00 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f387c009870 tx=0x7f387c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e9b827f6cbc5eff server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:02.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.685+0000 7f3884ec4700 1 -- 172.21.15.26:0/2196843997 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387c011830 con 0x7f38800a0a30 2023-10-01T08:01:02.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.686+0000 7f3884ec4700 1 -- 172.21.15.26:0/2196843997 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f387c011990 con 0x7f38800a0a30 2023-10-01T08:01:02.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.686+0000 7f3884ec4700 1 -- 172.21.15.26:0/2196843997 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387c011d20 con 0x7f38800a0a30 2023-10-01T08:01:02.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.686+0000 7f388812a700 1 -- 172.21.15.26:0/2196843997 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f38800a0a30 msgr2=0x7f38800a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:02.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.686+0000 7f388812a700 1 --2- 172.21.15.26:0/2196843997 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f38800a0a30 0x7f38800a0e00 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f387c009870 tx=0x7f387c009b80 comp rx=0 tx=0).stop 2023-10-01T08:01:02.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.686+0000 7f388812a700 1 -- 172.21.15.26:0/2196843997 shutdown_connections 2023-10-01T08:01:02.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.686+0000 7f388812a700 1 --2- 172.21.15.26:0/2196843997 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f38800a0a30 0x7f38800a0e00 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.686+0000 7f388812a700 1 --2- 172.21.15.26:0/2196843997 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3880138d80 0x7f388013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.686+0000 7f388812a700 1 -- 172.21.15.26:0/2196843997 >> 172.21.15.26:0/2196843997 conn(0x7f38800a3050 msgr2=0x7f38800a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:02.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.686+0000 7f388812a700 1 -- 172.21.15.26:0/2196843997 shutdown_connections 2023-10-01T08:01:02.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.687+0000 7f388812a700 1 -- 172.21.15.26:0/2196843997 wait complete. 2023-10-01T08:01:02.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.687+0000 7f388812a700 1 Processor -- start 2023-10-01T08:01:02.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.688+0000 7f388812a700 1 -- start start 2023-10-01T08:01:02.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.688+0000 7f388812a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f388009d630 0x7f3880133790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:02.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.688+0000 7f388812a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38800a0a30 0x7f3880133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:02.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.688+0000 7f388812a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3880138d80 0x7f3880134210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:02.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.688+0000 7f388812a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38800a0410 con 0x7f38800a0a30 2023-10-01T08:01:02.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.688+0000 7f388812a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3880136ec0 con 0x7f3880138d80 2023-10-01T08:01:02.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.688+0000 7f388812a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f388013ac70 con 0x7f388009d630 2023-10-01T08:01:02.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.688+0000 7f3885ec6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f388009d630 0x7f3880133790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:02.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.688+0000 7f3885ec6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f388009d630 0x7f3880133790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:41382/0 (socket says 172.21.15.26:41382) 2023-10-01T08:01:02.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.688+0000 7f3885ec6700 1 -- 172.21.15.26:0/3552365227 learned_addr learned my addr 172.21.15.26:0/3552365227 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:02.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.688+0000 7f38866c7700 1 --2- 172.21.15.26:0/3552365227 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3880138d80 0x7f3880134210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:02.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.688+0000 7f38856c5700 1 --2- 172.21.15.26:0/3552365227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38800a0a30 0x7f3880133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:02.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.688+0000 7f3885ec6700 1 -- 172.21.15.26:0/3552365227 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3880138d80 msgr2=0x7f3880134210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:02.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.689+0000 7f3885ec6700 1 --2- 172.21.15.26:0/3552365227 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3880138d80 0x7f3880134210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.689+0000 7f3885ec6700 1 -- 172.21.15.26:0/3552365227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38800a0a30 msgr2=0x7f3880133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:02.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.689+0000 7f3885ec6700 1 --2- 172.21.15.26:0/3552365227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38800a0a30 0x7f3880133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.689+0000 7f3885ec6700 1 -- 172.21.15.26:0/3552365227 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3878009a70 con 0x7f388009d630 2023-10-01T08:01:02.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.689+0000 7f38856c5700 1 --2- 172.21.15.26:0/3552365227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38800a0a30 0x7f3880133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T08:01:02.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.689+0000 7f3885ec6700 1 --2- 172.21.15.26:0/3552365227 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f388009d630 0x7f3880133790 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f387c009840 tx=0x7f387c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:02.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.689+0000 7f38767fc700 1 -- 172.21.15.26:0/3552365227 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387c004380 con 0x7f388009d630 2023-10-01T08:01:02.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.689+0000 7f38767fc700 1 -- 172.21.15.26:0/3552365227 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f387c01f070 con 0x7f388009d630 2023-10-01T08:01:02.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.689+0000 7f38767fc700 1 -- 172.21.15.26:0/3552365227 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387c0036a0 con 0x7f388009d630 2023-10-01T08:01:02.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.689+0000 7f388812a700 1 -- 172.21.15.26:0/3552365227 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f387c0094a0 con 0x7f388009d630 2023-10-01T08:01:02.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.689+0000 7f388812a700 1 -- 172.21.15.26:0/3552365227 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38801371a0 con 0x7f388009d630 2023-10-01T08:01:02.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.690+0000 7f38767fc700 1 -- 172.21.15.26:0/3552365227 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f387c021030 con 0x7f388009d630 2023-10-01T08:01:02.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.690+0000 7f388812a700 1 -- 172.21.15.26:0/3552365227 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38800747f0 con 0x7f388009d630 2023-10-01T08:01:02.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.690+0000 7f38767fc700 1 -- 172.21.15.26:0/3552365227 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f387c040960 con 0x7f388009d630 2023-10-01T08:01:02.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.695+0000 7f38767fc700 1 -- 172.21.15.26:0/3552365227 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f387c010740 con 0x7f388009d630 2023-10-01T08:01:02.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.727+0000 7fe71ea9f700 1 Processor -- start 2023-10-01T08:01:02.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.727+0000 7fe71ea9f700 1 -- start start 2023-10-01T08:01:02.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.728+0000 7fe71ea9f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe7180a0090 0x7fe718136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:02.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.728+0000 7fe71ea9f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe71809d130 0x7fe718139170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:02.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.728+0000 7fe71ea9f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe71809ba70 con 0x7fe71809c650 2023-10-01T08:01:02.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.728+0000 7fe71ea9f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe71809e8f0 con 0x7fe71809d130 2023-10-01T08:01:02.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.728+0000 7fe71ea9f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7180a0760 con 0x7fe7180a0090 2023-10-01T08:01:02.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.728+0000 7fe717fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe7180a0090 0x7fe718136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:02.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.728+0000 7fe71c83b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe71809c650 0x7fe71809ca20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39686/0 (socket says 172.21.15.26:39686) 2023-10-01T08:01:02.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.728+0000 7fe71c83b700 1 -- 172.21.15.26:0/2496874785 learned_addr learned my addr 172.21.15.26:0/2496874785 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:01:02.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.728+0000 7fe71d03c700 1 --2- 172.21.15.26:0/2496874785 >> v2:172.21.15.26:3300/0 conn(0x7fe71809d130 0x7fe718139170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:02.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.728+0000 7fe717fff700 1 -- 172.21.15.26:0/2496874785 >> v2:172.21.15.26:3300/0 conn(0x7fe71809d130 msgr2=0x7fe718139170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:02.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.728+0000 7fe717fff700 1 --2- 172.21.15.26:0/2496874785 >> v2:172.21.15.26:3300/0 conn(0x7fe71809d130 0x7fe718139170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.728+0000 7fe717fff700 1 -- 172.21.15.26:0/2496874785 >> v1:172.21.15.26:6789/0 conn(0x7fe71809c650 legacy=0x7fe71809ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:02.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.728+0000 7fe717fff700 1 -- 172.21.15.26:0/2496874785 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe71809a080 con 0x7fe7180a0090 2023-10-01T08:01:02.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.729+0000 7fe717fff700 1 --2- 172.21.15.26:0/2496874785 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe7180a0090 0x7fe718136c20 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fe704009840 tx=0x7fe704009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=796b35b4f57b2bd server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:02.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.729+0000 7fe7177fe700 1 -- 172.21.15.26:0/2496874785 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe704011830 con 0x7fe7180a0090 2023-10-01T08:01:02.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.729+0000 7fe7177fe700 1 -- 172.21.15.26:0/2496874785 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe704011990 con 0x7fe7180a0090 2023-10-01T08:01:02.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.729+0000 7fe7177fe700 1 -- 172.21.15.26:0/2496874785 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe704011d20 con 0x7fe7180a0090 2023-10-01T08:01:02.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.729+0000 7fe71ea9f700 1 -- 172.21.15.26:0/2496874785 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe7180a0090 msgr2=0x7fe718136c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:02.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.729+0000 7fe71ea9f700 1 --2- 172.21.15.26:0/2496874785 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe7180a0090 0x7fe718136c20 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fe704009840 tx=0x7fe704009b50 comp rx=0 tx=0).stop 2023-10-01T08:01:02.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.729+0000 7fe71ea9f700 1 -- 172.21.15.26:0/2496874785 shutdown_connections 2023-10-01T08:01:02.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.729+0000 7fe71ea9f700 1 --2- 172.21.15.26:0/2496874785 >> v2:172.21.15.26:3300/0 conn(0x7fe71809d130 0x7fe718139170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.729+0000 7fe71ea9f700 1 --2- 172.21.15.26:0/2496874785 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe7180a0090 0x7fe718136c20 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.729+0000 7fe71ea9f700 1 -- 172.21.15.26:0/2496874785 >> 172.21.15.26:0/2496874785 conn(0x7fe7180a3f70 msgr2=0x7fe7180a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:02.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.730+0000 7fe71ea9f700 1 -- 172.21.15.26:0/2496874785 shutdown_connections 2023-10-01T08:01:02.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.730+0000 7fe71ea9f700 1 -- 172.21.15.26:0/2496874785 wait complete. 2023-10-01T08:01:02.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.730+0000 7fe71ea9f700 1 Processor -- start 2023-10-01T08:01:02.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.731+0000 7fe71ea9f700 1 -- start start 2023-10-01T08:01:02.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.731+0000 7fe71ea9f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe71809c650 0x7fe718135460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:02.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.731+0000 7fe71ea9f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe71809d130 0x7fe7181359a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:02.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.731+0000 7fe71ea9f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe7180a0090 0x7fe718135ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:02.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.731+0000 7fe71ea9f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71811a930 con 0x7fe71809d130 2023-10-01T08:01:02.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.731+0000 7fe71ea9f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe71809d980 con 0x7fe71809c650 2023-10-01T08:01:02.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.731+0000 7fe71ea9f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe71811ab30 con 0x7fe7180a0090 2023-10-01T08:01:02.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.731+0000 7fe717fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe71809d130 0x7fe7181359a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:02.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.731+0000 7fe717fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe71809d130 0x7fe7181359a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58722/0 (socket says 172.21.15.26:58722) 2023-10-01T08:01:02.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.731+0000 7fe717fff700 1 -- 172.21.15.26:0/2957182523 learned_addr learned my addr 172.21.15.26:0/2957182523 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:02.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.731+0000 7fe71c83b700 1 --2- 172.21.15.26:0/2957182523 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe71809c650 0x7fe718135460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:02.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.731+0000 7fe71d03c700 1 --2- 172.21.15.26:0/2957182523 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe7180a0090 0x7fe718135ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:02.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.732+0000 7fe71d03c700 1 -- 172.21.15.26:0/2957182523 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe71809c650 msgr2=0x7fe718135460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:02.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.732+0000 7fe71d03c700 1 --2- 172.21.15.26:0/2957182523 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe71809c650 0x7fe718135460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.732+0000 7fe71d03c700 1 -- 172.21.15.26:0/2957182523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe71809d130 msgr2=0x7fe7181359a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:02.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.732+0000 7fe71d03c700 1 --2- 172.21.15.26:0/2957182523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe71809d130 0x7fe7181359a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.732+0000 7fe71d03c700 1 -- 172.21.15.26:0/2957182523 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7040094a0 con 0x7fe7180a0090 2023-10-01T08:01:02.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.732+0000 7fe717fff700 1 --2- 172.21.15.26:0/2957182523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe71809d130 0x7fe7181359a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:02.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.732+0000 7fe71c83b700 1 --2- 172.21.15.26:0/2957182523 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe71809c650 0x7fe718135460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:02.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.732+0000 7fe71d03c700 1 --2- 172.21.15.26:0/2957182523 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe7180a0090 0x7fe718135ee0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fe710009d90 tx=0x7fe71000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:02.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.732+0000 7fe7157fa700 1 -- 172.21.15.26:0/2957182523 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe710009c00 con 0x7fe7180a0090 2023-10-01T08:01:02.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.732+0000 7fe7157fa700 1 -- 172.21.15.26:0/2957182523 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71000f040 con 0x7fe7180a0090 2023-10-01T08:01:02.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.732+0000 7fe71ea9f700 1 -- 172.21.15.26:0/2957182523 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe718137d40 con 0x7fe7180a0090 2023-10-01T08:01:02.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.732+0000 7fe7157fa700 1 -- 172.21.15.26:0/2957182523 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe710014480 con 0x7fe7180a0090 2023-10-01T08:01:02.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.732+0000 7fe71ea9f700 1 -- 172.21.15.26:0/2957182523 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe718137730 con 0x7fe7180a0090 2023-10-01T08:01:02.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.733+0000 7fe7157fa700 1 -- 172.21.15.26:0/2957182523 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe7100145e0 con 0x7fe7180a0090 2023-10-01T08:01:02.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.733+0000 7fe7157fa700 1 -- 172.21.15.26:0/2957182523 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe7100402d0 con 0x7fe7180a0090 2023-10-01T08:01:02.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.734+0000 7fe71ea9f700 1 -- 172.21.15.26:0/2957182523 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe71812f570 con 0x7fe7180a0090 2023-10-01T08:01:02.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.738+0000 7fe7157fa700 1 -- 172.21.15.26:0/2957182523 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe710007900 con 0x7fe7180a0090 2023-10-01T08:01:02.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.750+0000 7fed557c6700 1 -- 172.21.15.26:0/2446309037 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fed5009e190 con 0x7fed5009e930 2023-10-01T08:01:02.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.750+0000 7fed477fe700 1 -- 172.21.15.26:0/2446309037 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fed40019730 con 0x7fed5009e930 2023-10-01T08:01:02.751 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:02.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.753+0000 7fed557c6700 1 -- 172.21.15.26:0/2446309037 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fed5009e930 msgr2=0x7fed501319f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:02.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.753+0000 7fed557c6700 1 --2- 172.21.15.26:0/2446309037 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fed5009e930 0x7fed501319f0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fed40000f60 tx=0x7fed4000c730 comp rx=0 tx=0).stop 2023-10-01T08:01:02.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.753+0000 7fed557c6700 1 -- 172.21.15.26:0/2446309037 shutdown_connections 2023-10-01T08:01:02.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.753+0000 7fed557c6700 1 --2- 172.21.15.26:0/2446309037 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fed50136fe0 0x7fed501c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.753+0000 7fed557c6700 1 --2- 172.21.15.26:0/2446309037 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fed5009e930 0x7fed501319f0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.753+0000 7fed557c6700 1 --2- 172.21.15.26:0/2446309037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed5009f410 0x7fed50131f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.753+0000 7fed557c6700 1 -- 172.21.15.26:0/2446309037 >> 172.21.15.26:0/2446309037 conn(0x7fed500a4210 msgr2=0x7fed50134b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:02.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.753+0000 7fed557c6700 1 -- 172.21.15.26:0/2446309037 shutdown_connections 2023-10-01T08:01:02.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.753+0000 7fed557c6700 1 -- 172.21.15.26:0/2446309037 wait complete. 2023-10-01T08:01:02.768 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:02.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.908+0000 7f388812a700 1 -- 172.21.15.26:0/3552365227 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3880072980 con 0x7f388009d630 2023-10-01T08:01:02.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.908+0000 7f38767fc700 1 -- 172.21.15.26:0/3552365227 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f387c015020 con 0x7f388009d630 2023-10-01T08:01:02.909 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:02.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.910+0000 7f388812a700 1 -- 172.21.15.26:0/3552365227 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f388009d630 msgr2=0x7f3880133790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:02.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.910+0000 7f388812a700 1 --2- 172.21.15.26:0/3552365227 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f388009d630 0x7f3880133790 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f387c009840 tx=0x7f387c004750 comp rx=0 tx=0).stop 2023-10-01T08:01:02.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.910+0000 7f388812a700 1 -- 172.21.15.26:0/3552365227 shutdown_connections 2023-10-01T08:01:02.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.910+0000 7f388812a700 1 --2- 172.21.15.26:0/3552365227 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3880138d80 0x7f3880134210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.910+0000 7f388812a700 1 --2- 172.21.15.26:0/3552365227 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f388009d630 0x7f3880133790 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.910+0000 7f388812a700 1 --2- 172.21.15.26:0/3552365227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38800a0a30 0x7f3880133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.910+0000 7f388812a700 1 -- 172.21.15.26:0/3552365227 >> 172.21.15.26:0/3552365227 conn(0x7f38800a3050 msgr2=0x7f388009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:02.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.911+0000 7f388812a700 1 -- 172.21.15.26:0/3552365227 shutdown_connections 2023-10-01T08:01:02.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.911+0000 7f388812a700 1 -- 172.21.15.26:0/3552365227 wait complete. 2023-10-01T08:01:02.926 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:02.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.945+0000 7fe71ea9f700 1 -- 172.21.15.26:0/2957182523 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe7180747f0 con 0x7fe7180a0090 2023-10-01T08:01:02.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.945+0000 7fe7157fa700 1 -- 172.21.15.26:0/2957182523 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe710007330 con 0x7fe7180a0090 2023-10-01T08:01:02.946 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:02.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.947+0000 7fe71ea9f700 1 -- 172.21.15.26:0/2957182523 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe7180a0090 msgr2=0x7fe718135ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:02.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.947+0000 7fe71ea9f700 1 --2- 172.21.15.26:0/2957182523 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe7180a0090 0x7fe718135ee0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fe710009d90 tx=0x7fe71000c3a0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.947+0000 7fe71ea9f700 1 -- 172.21.15.26:0/2957182523 shutdown_connections 2023-10-01T08:01:02.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.947+0000 7fe71ea9f700 1 --2- 172.21.15.26:0/2957182523 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe7180a0090 0x7fe718135ee0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.947+0000 7fe71ea9f700 1 --2- 172.21.15.26:0/2957182523 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe71809c650 0x7fe718135460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.947+0000 7fe71ea9f700 1 --2- 172.21.15.26:0/2957182523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe71809d130 0x7fe7181359a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:02.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.947+0000 7fe71ea9f700 1 -- 172.21.15.26:0/2957182523 >> 172.21.15.26:0/2957182523 conn(0x7fe7180a3f70 msgr2=0x7fe718071820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:02.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.947+0000 7fe71ea9f700 1 -- 172.21.15.26:0/2957182523 shutdown_connections 2023-10-01T08:01:02.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:02.947+0000 7fe71ea9f700 1 -- 172.21.15.26:0/2957182523 wait complete. 2023-10-01T08:01:02.961 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:03.349 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:03.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.495+0000 7ffab49ab700 1 Processor -- start 2023-10-01T08:01:03.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.495+0000 7ffab49ab700 1 -- start start 2023-10-01T08:01:03.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.496+0000 7ffab49ab700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffab0133a80 0x7ffab0133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:03.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.496+0000 7ffab49ab700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffab012ff20 0x7ffab0130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:03.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.496+0000 7ffab49ab700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffab0130870 0x7ffab013a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:03.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.496+0000 7ffab49ab700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab006c570 con 0x7ffab0133a80 2023-10-01T08:01:03.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.496+0000 7ffab49ab700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab006bc00 con 0x7ffab0130870 2023-10-01T08:01:03.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.496+0000 7ffab49ab700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffab00a0040 con 0x7ffab012ff20 2023-10-01T08:01:03.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.496+0000 7ffaaed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffab0130870 0x7ffab013a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:03.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.496+0000 7ffaae59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffab0133a80 0x7ffab0133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:03.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.496+0000 7ffaaed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffab0130870 0x7ffab013a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51160/0 (socket says 172.21.15.26:51160) 2023-10-01T08:01:03.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.496+0000 7ffaae59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffab0133a80 0x7ffab0133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54960/0 (socket says 172.21.15.26:54960) 2023-10-01T08:01:03.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.496+0000 7ffaaed9d700 1 -- 172.21.15.26:0/2148644951 learned_addr learned my addr 172.21.15.26:0/2148644951 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:03.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.496+0000 7ffaadd9b700 1 --2- 172.21.15.26:0/2148644951 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffab012ff20 0x7ffab0130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:03.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.497+0000 7ffaaed9d700 1 -- 172.21.15.26:0/2148644951 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffab012ff20 msgr2=0x7ffab0130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:03.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.497+0000 7ffaaed9d700 1 --2- 172.21.15.26:0/2148644951 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffab012ff20 0x7ffab0130330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:03.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.497+0000 7ffaaed9d700 1 -- 172.21.15.26:0/2148644951 >> v2:172.21.15.26:3300/0 conn(0x7ffab0133a80 msgr2=0x7ffab0133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:03.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.497+0000 7ffaaed9d700 1 --2- 172.21.15.26:0/2148644951 >> v2:172.21.15.26:3300/0 conn(0x7ffab0133a80 0x7ffab0133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:03.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.497+0000 7ffaaed9d700 1 -- 172.21.15.26:0/2148644951 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab0133860 con 0x7ffab0130870 2023-10-01T08:01:03.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.497+0000 7ffaae59c700 1 --2- 172.21.15.26:0/2148644951 >> v2:172.21.15.26:3300/0 conn(0x7ffab0133a80 0x7ffab0133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:03.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.497+0000 7ffaadd9b700 1 --2- 172.21.15.26:0/2148644951 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffab012ff20 0x7ffab0130330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:03.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.497+0000 7ffaaed9d700 1 --2- 172.21.15.26:0/2148644951 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffab0130870 0x7ffab013a840 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8009e50 tx=0x7ffaa800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=deac0bd4e7ccdf77 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:03.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.497+0000 7ffaad59a700 1 -- 172.21.15.26:0/2148644951 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa800e070 con 0x7ffab0130870 2023-10-01T08:01:03.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.497+0000 7ffaad59a700 1 -- 172.21.15.26:0/2148644951 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa800b910 con 0x7ffab0130870 2023-10-01T08:01:03.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.497+0000 7ffaad59a700 1 -- 172.21.15.26:0/2148644951 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa800bcc0 con 0x7ffab0130870 2023-10-01T08:01:03.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.497+0000 7ffab49ab700 1 -- 172.21.15.26:0/2148644951 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffab0130870 msgr2=0x7ffab013a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:03.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.497+0000 7ffab49ab700 1 --2- 172.21.15.26:0/2148644951 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffab0130870 0x7ffab013a840 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8009e50 tx=0x7ffaa800b330 comp rx=0 tx=0).stop 2023-10-01T08:01:03.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.498+0000 7ffab49ab700 1 -- 172.21.15.26:0/2148644951 shutdown_connections 2023-10-01T08:01:03.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.498+0000 7ffab49ab700 1 --2- 172.21.15.26:0/2148644951 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffab0130870 0x7ffab013a840 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:03.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.498+0000 7ffab49ab700 1 --2- 172.21.15.26:0/2148644951 >> v2:172.21.15.26:3300/0 conn(0x7ffab0133a80 0x7ffab0133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:03.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.498+0000 7ffab49ab700 1 --2- 172.21.15.26:0/2148644951 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffab012ff20 0x7ffab0130330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:03.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.498+0000 7ffab49ab700 1 -- 172.21.15.26:0/2148644951 >> 172.21.15.26:0/2148644951 conn(0x7ffab00a4210 msgr2=0x7ffab00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:03.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.498+0000 7ffab49ab700 1 -- 172.21.15.26:0/2148644951 shutdown_connections 2023-10-01T08:01:03.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.498+0000 7ffab49ab700 1 -- 172.21.15.26:0/2148644951 wait complete. 2023-10-01T08:01:03.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.499+0000 7ffab49ab700 1 Processor -- start 2023-10-01T08:01:03.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.499+0000 7ffab49ab700 1 -- start start 2023-10-01T08:01:03.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.499+0000 7ffab49ab700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffab012ff20 0x7ffab009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:03.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.499+0000 7ffab49ab700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffab0130870 0x7ffab009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:03.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.499+0000 7ffab49ab700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffab0133a80 0x7ffab009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:03.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.499+0000 7ffab49ab700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab011f9b0 con 0x7ffab0130870 2023-10-01T08:01:03.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.499+0000 7ffab49ab700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab00a2050 con 0x7ffab012ff20 2023-10-01T08:01:03.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.499+0000 7ffab49ab700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffab009de30 con 0x7ffab0133a80 2023-10-01T08:01:03.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.499+0000 7ffaae59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffab012ff20 0x7ffab009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:03.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.500+0000 7ffaae59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffab012ff20 0x7ffab009c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51172/0 (socket says 172.21.15.26:51172) 2023-10-01T08:01:03.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.500+0000 7ffaadd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffab0130870 0x7ffab009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:03.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.500+0000 7ffaae59c700 1 -- 172.21.15.26:0/4138272207 learned_addr learned my addr 172.21.15.26:0/4138272207 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:03.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.500+0000 7ffaaed9d700 1 --2- 172.21.15.26:0/4138272207 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffab0133a80 0x7ffab009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:03.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.500+0000 7ffaae59c700 1 -- 172.21.15.26:0/4138272207 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffab0133a80 msgr2=0x7ffab009cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:03.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.500+0000 7ffaae59c700 1 --2- 172.21.15.26:0/4138272207 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffab0133a80 0x7ffab009cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:03.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.500+0000 7ffaae59c700 1 -- 172.21.15.26:0/4138272207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffab0130870 msgr2=0x7ffab009c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:03.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.500+0000 7ffaae59c700 1 --2- 172.21.15.26:0/4138272207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffab0130870 0x7ffab009c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:03.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.500+0000 7ffaae59c700 1 -- 172.21.15.26:0/4138272207 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa980094a0 con 0x7ffab012ff20 2023-10-01T08:01:03.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.500+0000 7ffaadd9b700 1 --2- 172.21.15.26:0/4138272207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffab0130870 0x7ffab009c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:03.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.500+0000 7ffaaed9d700 1 --2- 172.21.15.26:0/4138272207 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffab0133a80 0x7ffab009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:03.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.500+0000 7ffaae59c700 1 --2- 172.21.15.26:0/4138272207 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffab012ff20 0x7ffab009c480 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7ffaa000ec10 tx=0x7ffaa000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:03.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.500+0000 7ffaa6ffd700 1 -- 172.21.15.26:0/4138272207 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa000c850 con 0x7ffab012ff20 2023-10-01T08:01:03.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.500+0000 7ffaa6ffd700 1 -- 172.21.15.26:0/4138272207 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa000c9b0 con 0x7ffab012ff20 2023-10-01T08:01:03.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.500+0000 7ffab49ab700 1 -- 172.21.15.26:0/4138272207 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa00094a0 con 0x7ffab012ff20 2023-10-01T08:01:03.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.500+0000 7ffaa6ffd700 1 -- 172.21.15.26:0/4138272207 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa000cd20 con 0x7ffab012ff20 2023-10-01T08:01:03.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.500+0000 7ffab49ab700 1 -- 172.21.15.26:0/4138272207 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa8009b30 con 0x7ffab012ff20 2023-10-01T08:01:03.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.501+0000 7ffaa6ffd700 1 -- 172.21.15.26:0/4138272207 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffaa0013470 con 0x7ffab012ff20 2023-10-01T08:01:03.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.501+0000 7ffab49ab700 1 -- 172.21.15.26:0/4138272207 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab0074ea0 con 0x7ffab012ff20 2023-10-01T08:01:03.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.501+0000 7ffaa6ffd700 1 -- 172.21.15.26:0/4138272207 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ffaa003f760 con 0x7ffab012ff20 2023-10-01T08:01:03.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.506+0000 7ffaa6ffd700 1 -- 172.21.15.26:0/4138272207 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffaa0013720 con 0x7ffab012ff20 2023-10-01T08:01:03.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.714+0000 7ffab49ab700 1 -- 172.21.15.26:0/4138272207 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffab006b250 con 0x7ffab012ff20 2023-10-01T08:01:03.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.714+0000 7ffaa6ffd700 1 -- 172.21.15.26:0/4138272207 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffaa001bb60 con 0x7ffab012ff20 2023-10-01T08:01:03.716 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:03.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.716+0000 7ffab49ab700 1 -- 172.21.15.26:0/4138272207 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffab012ff20 msgr2=0x7ffab009c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:03.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.716+0000 7ffab49ab700 1 --2- 172.21.15.26:0/4138272207 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffab012ff20 0x7ffab009c480 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7ffaa000ec10 tx=0x7ffaa000ef20 comp rx=0 tx=0).stop 2023-10-01T08:01:03.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.717+0000 7ffab49ab700 1 -- 172.21.15.26:0/4138272207 shutdown_connections 2023-10-01T08:01:03.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.717+0000 7ffab49ab700 1 --2- 172.21.15.26:0/4138272207 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffab0133a80 0x7ffab009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:03.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.717+0000 7ffab49ab700 1 --2- 172.21.15.26:0/4138272207 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffab012ff20 0x7ffab009c480 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:03.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.717+0000 7ffab49ab700 1 --2- 172.21.15.26:0/4138272207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffab0130870 0x7ffab009c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:03.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.717+0000 7ffab49ab700 1 -- 172.21.15.26:0/4138272207 >> 172.21.15.26:0/4138272207 conn(0x7ffab00a4210 msgr2=0x7ffab009e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:03.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.717+0000 7ffab49ab700 1 -- 172.21.15.26:0/4138272207 shutdown_connections 2023-10-01T08:01:03.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.717+0000 7ffab49ab700 1 -- 172.21.15.26:0/4138272207 wait complete. 2023-10-01T08:01:03.731 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:03.769 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:03.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.908+0000 7fb646b41700 1 Processor -- start 2023-10-01T08:01:03.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.908+0000 7fb646b41700 1 -- start start 2023-10-01T08:01:03.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.909+0000 7fb646b41700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb6400a0a30 0x7fb6400a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:03.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.909+0000 7fb646b41700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb6400a1340 0x7fb640133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:03.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.909+0000 7fb646b41700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb64009edd0 con 0x7fb640133fa0 2023-10-01T08:01:03.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.909+0000 7fb646b41700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb64009e1f0 con 0x7fb6400a0a30 2023-10-01T08:01:03.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.909+0000 7fb646b41700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb64009dc50 con 0x7fb6400a1340 2023-10-01T08:01:03.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.909+0000 7fb63ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb6400a1340 0x7fb640133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:03.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.909+0000 7fb6448dd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb6400a0a30 0x7fb6400a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:03.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.909+0000 7fb63ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb6400a1340 0x7fb640133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51186/0 (socket says 172.21.15.26:51186) 2023-10-01T08:01:03.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.909+0000 7fb63ffff700 1 -- 172.21.15.26:0/470390557 learned_addr learned my addr 172.21.15.26:0/470390557 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:03.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.910+0000 7fb6448dd700 1 -- 172.21.15.26:0/470390557 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb6400a1340 msgr2=0x7fb640133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:03.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.910+0000 7fb6448dd700 1 --2- 172.21.15.26:0/470390557 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb6400a1340 0x7fb640133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:03.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.910+0000 7fb6448dd700 1 -- 172.21.15.26:0/470390557 >> v1:172.21.15.26:6789/0 conn(0x7fb640133fa0 legacy=0x7fb64013ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:03.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.910+0000 7fb6448dd700 1 -- 172.21.15.26:0/470390557 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6400a1fe0 con 0x7fb6400a0a30 2023-10-01T08:01:03.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.910+0000 7fb63ffff700 1 --2- 172.21.15.26:0/470390557 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb6400a1340 0x7fb640133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:03.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.910+0000 7fb6448dd700 1 --2- 172.21.15.26:0/470390557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6400a0a30 0x7fb6400a0e00 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fb630009840 tx=0x7fb630009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb31630ee203164 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:03.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.910+0000 7fb63f7fe700 1 -- 172.21.15.26:0/470390557 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb630011830 con 0x7fb6400a0a30 2023-10-01T08:01:03.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.910+0000 7fb63f7fe700 1 -- 172.21.15.26:0/470390557 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb630011990 con 0x7fb6400a0a30 2023-10-01T08:01:03.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.910+0000 7fb63f7fe700 1 -- 172.21.15.26:0/470390557 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb630011d20 con 0x7fb6400a0a30 2023-10-01T08:01:03.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.911+0000 7fb646b41700 1 -- 172.21.15.26:0/470390557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6400a0a30 msgr2=0x7fb6400a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:03.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.911+0000 7fb646b41700 1 --2- 172.21.15.26:0/470390557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6400a0a30 0x7fb6400a0e00 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fb630009840 tx=0x7fb630009b50 comp rx=0 tx=0).stop 2023-10-01T08:01:03.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.911+0000 7fb646b41700 1 -- 172.21.15.26:0/470390557 shutdown_connections 2023-10-01T08:01:03.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.911+0000 7fb646b41700 1 --2- 172.21.15.26:0/470390557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6400a0a30 0x7fb6400a0e00 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:03.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.911+0000 7fb646b41700 1 --2- 172.21.15.26:0/470390557 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb6400a1340 0x7fb640133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:03.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.911+0000 7fb646b41700 1 -- 172.21.15.26:0/470390557 >> 172.21.15.26:0/470390557 conn(0x7fb6400a6550 msgr2=0x7fb6400a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:03.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.911+0000 7fb646b41700 1 -- 172.21.15.26:0/470390557 shutdown_connections 2023-10-01T08:01:03.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.911+0000 7fb646b41700 1 -- 172.21.15.26:0/470390557 wait complete. 2023-10-01T08:01:03.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.912+0000 7fb646b41700 1 Processor -- start 2023-10-01T08:01:03.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.912+0000 7fb646b41700 1 -- start start 2023-10-01T08:01:03.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.912+0000 7fb646b41700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb6400a0a30 0x7fb64011e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:03.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.912+0000 7fb646b41700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6400a1340 0x7fb64011ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:03.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.912+0000 7fb646b41700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb640133fa0 0x7fb64011f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:03.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.912+0000 7fb646b41700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb640121f50 con 0x7fb6400a1340 2023-10-01T08:01:03.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.912+0000 7fb646b41700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb640120430 con 0x7fb640133fa0 2023-10-01T08:01:03.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.912+0000 7fb646b41700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6400a37e0 con 0x7fb6400a0a30 2023-10-01T08:01:03.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.913+0000 7fb6448dd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb6400a0a30 0x7fb64011e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:03.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.913+0000 7fb63ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6400a1340 0x7fb64011ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:03.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.913+0000 7fb6450de700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb640133fa0 0x7fb64011f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:03.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.913+0000 7fb63ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6400a1340 0x7fb64011ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54982/0 (socket says 172.21.15.26:54982) 2023-10-01T08:01:03.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.913+0000 7fb6448dd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb6400a0a30 0x7fb64011e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56704/0 (socket says 172.21.15.26:56704) 2023-10-01T08:01:03.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.913+0000 7fb63ffff700 1 -- 172.21.15.26:0/1056834787 learned_addr learned my addr 172.21.15.26:0/1056834787 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:03.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.913+0000 7fb6450de700 1 -- 172.21.15.26:0/1056834787 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb6400a0a30 msgr2=0x7fb64011e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:03.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.913+0000 7fb6450de700 1 --2- 172.21.15.26:0/1056834787 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb6400a0a30 0x7fb64011e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:03.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.913+0000 7fb6450de700 1 -- 172.21.15.26:0/1056834787 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6400a1340 msgr2=0x7fb64011ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:03.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.913+0000 7fb6450de700 1 --2- 172.21.15.26:0/1056834787 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6400a1340 0x7fb64011ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:03.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.913+0000 7fb6450de700 1 -- 172.21.15.26:0/1056834787 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb628009550 con 0x7fb640133fa0 2023-10-01T08:01:03.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.913+0000 7fb63ffff700 1 --2- 172.21.15.26:0/1056834787 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6400a1340 0x7fb64011ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:03.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.913+0000 7fb6448dd700 1 --2- 172.21.15.26:0/1056834787 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb6400a0a30 0x7fb64011e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:03.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.913+0000 7fb6450de700 1 --2- 172.21.15.26:0/1056834787 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb640133fa0 0x7fb64011f220 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb638014620 tx=0x7fb638014930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:03.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.913+0000 7fb63d7fa700 1 -- 172.21.15.26:0/1056834787 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb638017070 con 0x7fb640133fa0 2023-10-01T08:01:03.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.913+0000 7fb63d7fa700 1 -- 172.21.15.26:0/1056834787 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb638003a00 con 0x7fb640133fa0 2023-10-01T08:01:03.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.913+0000 7fb646b41700 1 -- 172.21.15.26:0/1056834787 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6300094a0 con 0x7fb640133fa0 2023-10-01T08:01:03.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.913+0000 7fb63d7fa700 1 -- 172.21.15.26:0/1056834787 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb638003db0 con 0x7fb640133fa0 2023-10-01T08:01:03.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.913+0000 7fb646b41700 1 -- 172.21.15.26:0/1056834787 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6400a0270 con 0x7fb640133fa0 2023-10-01T08:01:03.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.914+0000 7fb63d7fa700 1 -- 172.21.15.26:0/1056834787 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb6380120d0 con 0x7fb640133fa0 2023-10-01T08:01:03.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.914+0000 7fb63d7fa700 1 -- 172.21.15.26:0/1056834787 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb638047770 con 0x7fb640133fa0 2023-10-01T08:01:03.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.914+0000 7fb646b41700 1 -- 172.21.15.26:0/1056834787 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb640122a80 con 0x7fb640133fa0 2023-10-01T08:01:03.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:03.919+0000 7fb63d7fa700 1 -- 172.21.15.26:0/1056834787 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb6380050d0 con 0x7fb640133fa0 2023-10-01T08:01:03.927 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:03.963 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:04.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.066+0000 7f3bf46cb700 1 Processor -- start 2023-10-01T08:01:04.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.067+0000 7f3bf46cb700 1 -- start start 2023-10-01T08:01:04.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.068+0000 7f3bf46cb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3bec09d630 0x7f3bec0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:04.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.068+0000 7f3bf46cb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3bec138d80 0x7f3bec13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:04.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.068+0000 7f3bf46cb700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bec0a2a70 con 0x7f3bec0a0a30 2023-10-01T08:01:04.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.068+0000 7f3bf46cb700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bec0a01d0 con 0x7f3bec09d630 2023-10-01T08:01:04.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.068+0000 7f3bf46cb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec09e2b0 con 0x7f3bec138d80 2023-10-01T08:01:04.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.068+0000 7f3bf1c66700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3bec09d630 0x7f3bec0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:04.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.068+0000 7f3bf1c66700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3bec09d630 0x7f3bec0a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54984/0 (socket says 172.21.15.26:54984) 2023-10-01T08:01:04.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.068+0000 7f3bf1c66700 1 -- 172.21.15.26:0/1939548578 learned_addr learned my addr 172.21.15.26:0/1939548578 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:04.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.068+0000 7f3bf2c68700 1 --2- 172.21.15.26:0/1939548578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3bec138d80 0x7f3bec13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:04.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.068+0000 7f3bf2c68700 1 -- 172.21.15.26:0/1939548578 >> v2:172.21.15.26:3300/0 conn(0x7f3bec09d630 msgr2=0x7f3bec0a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:04.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.068+0000 7f3bf2c68700 1 --2- 172.21.15.26:0/1939548578 >> v2:172.21.15.26:3300/0 conn(0x7f3bec09d630 0x7f3bec0a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:04.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.068+0000 7f3bf2c68700 1 -- 172.21.15.26:0/1939548578 >> v1:172.21.15.26:6789/0 conn(0x7f3bec0a0a30 legacy=0x7f3bec0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:04.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.068+0000 7f3bf2c68700 1 -- 172.21.15.26:0/1939548578 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bec09dc50 con 0x7f3bec138d80 2023-10-01T08:01:04.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.068+0000 7f3bf1c66700 1 --2- 172.21.15.26:0/1939548578 >> v2:172.21.15.26:3300/0 conn(0x7f3bec09d630 0x7f3bec0a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:04.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.068+0000 7f3bf2c68700 1 --2- 172.21.15.26:0/1939548578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3bec138d80 0x7f3bec13b160 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f3be4009d90 tx=0x7f3be400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21b2b887321711e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:04.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.069+0000 7f3bf1465700 1 -- 172.21.15.26:0/1939548578 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be400e070 con 0x7f3bec138d80 2023-10-01T08:01:04.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.069+0000 7f3bf1465700 1 -- 172.21.15.26:0/1939548578 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be400bb20 con 0x7f3bec138d80 2023-10-01T08:01:04.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.069+0000 7f3bf1465700 1 -- 172.21.15.26:0/1939548578 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be4012430 con 0x7f3bec138d80 2023-10-01T08:01:04.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.069+0000 7f3bf46cb700 1 -- 172.21.15.26:0/1939548578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3bec138d80 msgr2=0x7f3bec13b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:04.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.069+0000 7f3bf46cb700 1 --2- 172.21.15.26:0/1939548578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3bec138d80 0x7f3bec13b160 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f3be4009d90 tx=0x7f3be400b330 comp rx=0 tx=0).stop 2023-10-01T08:01:04.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.069+0000 7f3bf46cb700 1 -- 172.21.15.26:0/1939548578 shutdown_connections 2023-10-01T08:01:04.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.069+0000 7f3bf46cb700 1 --2- 172.21.15.26:0/1939548578 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3bec138d80 0x7f3bec13b160 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:04.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.070+0000 7f3bf46cb700 1 --2- 172.21.15.26:0/1939548578 >> v2:172.21.15.26:3300/0 conn(0x7f3bec09d630 0x7f3bec0a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:04.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.070+0000 7f3bf46cb700 1 -- 172.21.15.26:0/1939548578 >> 172.21.15.26:0/1939548578 conn(0x7f3bec0a3050 msgr2=0x7f3bec0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:04.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.070+0000 7f3bf46cb700 1 -- 172.21.15.26:0/1939548578 shutdown_connections 2023-10-01T08:01:04.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.070+0000 7f3bf46cb700 1 -- 172.21.15.26:0/1939548578 wait complete. 2023-10-01T08:01:04.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.071+0000 7f3bf46cb700 1 Processor -- start 2023-10-01T08:01:04.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.071+0000 7f3bf46cb700 1 -- start start 2023-10-01T08:01:04.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.071+0000 7f3bf46cb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3bec09d630 0x7f3bec120670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:04.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.071+0000 7f3bf46cb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bec0a0a30 0x7f3bec120bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:04.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.071+0000 7f3bf46cb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3bec138d80 0x7f3bec1210f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:04.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.071+0000 7f3bf46cb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec124190 con 0x7f3bec0a0a30 2023-10-01T08:01:04.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.071+0000 7f3bf46cb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec121ad0 con 0x7f3bec138d80 2023-10-01T08:01:04.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.071+0000 7f3bf46cb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec123120 con 0x7f3bec09d630 2023-10-01T08:01:04.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.071+0000 7f3bf2467700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3bec09d630 0x7f3bec120670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:04.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.071+0000 7f3bf2467700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3bec09d630 0x7f3bec120670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56724/0 (socket says 172.21.15.26:56724) 2023-10-01T08:01:04.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.071+0000 7f3bf2467700 1 -- 172.21.15.26:0/2725199461 learned_addr learned my addr 172.21.15.26:0/2725199461 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:04.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.071+0000 7f3bf2c68700 1 --2- 172.21.15.26:0/2725199461 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3bec138d80 0x7f3bec1210f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:04.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.071+0000 7f3bf1c66700 1 --2- 172.21.15.26:0/2725199461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bec0a0a30 0x7f3bec120bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:04.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.072+0000 7f3bf2467700 1 -- 172.21.15.26:0/2725199461 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3bec138d80 msgr2=0x7f3bec1210f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:04.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.072+0000 7f3bf2467700 1 --2- 172.21.15.26:0/2725199461 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3bec138d80 0x7f3bec1210f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:04.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.072+0000 7f3bf2467700 1 -- 172.21.15.26:0/2725199461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bec0a0a30 msgr2=0x7f3bec120bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:04.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.072+0000 7f3bf2467700 1 --2- 172.21.15.26:0/2725199461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bec0a0a30 0x7f3bec120bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:04.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.072+0000 7f3bf2467700 1 -- 172.21.15.26:0/2725199461 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bdc009550 con 0x7f3bec09d630 2023-10-01T08:01:04.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.072+0000 7f3bf2c68700 1 --2- 172.21.15.26:0/2725199461 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3bec138d80 0x7f3bec1210f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:04.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.072+0000 7f3bf2467700 1 --2- 172.21.15.26:0/2725199461 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3bec09d630 0x7f3bec120670 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f3be800c4e0 tx=0x7f3be800c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:04.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.072+0000 7f3be2ffd700 1 -- 172.21.15.26:0/2725199461 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be80052d0 con 0x7f3bec09d630 2023-10-01T08:01:04.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.072+0000 7f3be2ffd700 1 -- 172.21.15.26:0/2725199461 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be8005430 con 0x7f3bec09d630 2023-10-01T08:01:04.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.072+0000 7f3bf46cb700 1 -- 172.21.15.26:0/2725199461 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be4009a70 con 0x7f3bec09d630 2023-10-01T08:01:04.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.072+0000 7f3be2ffd700 1 -- 172.21.15.26:0/2725199461 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be80038c0 con 0x7f3bec09d630 2023-10-01T08:01:04.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.072+0000 7f3bf46cb700 1 -- 172.21.15.26:0/2725199461 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bec13afb0 con 0x7f3bec09d630 2023-10-01T08:01:04.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.073+0000 7f3be2ffd700 1 -- 172.21.15.26:0/2725199461 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3be8003a20 con 0x7f3bec09d630 2023-10-01T08:01:04.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.073+0000 7f3be2ffd700 1 -- 172.21.15.26:0/2725199461 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3be803ea30 con 0x7f3bec09d630 2023-10-01T08:01:04.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.073+0000 7f3bf46cb700 1 -- 172.21.15.26:0/2725199461 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bec0747f0 con 0x7f3bec09d630 2023-10-01T08:01:04.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.078+0000 7f3be2ffd700 1 -- 172.21.15.26:0/2725199461 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3be8017080 con 0x7f3bec09d630 2023-10-01T08:01:04.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.112+0000 7f89edf4c700 1 Processor -- start 2023-10-01T08:01:04.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.112+0000 7f89edf4c700 1 -- start start 2023-10-01T08:01:04.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.113+0000 7f89edf4c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f89e80a0a30 0x7f89e80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:04.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.113+0000 7f89edf4c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89e80a1340 0x7f89e8133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:04.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.113+0000 7f89edf4c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89e8133fa0 0x7f89e8134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:04.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.113+0000 7f89edf4c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e809edd0 con 0x7f89e80a0a30 2023-10-01T08:01:04.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.113+0000 7f89edf4c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e809e1f0 con 0x7f89e80a1340 2023-10-01T08:01:04.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.113+0000 7f89edf4c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89e809dc50 con 0x7f89e8133fa0 2023-10-01T08:01:04.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.113+0000 7f89e77fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f89e80a0a30 0x7f89e80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:04.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.113+0000 7f89e6ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89e80a1340 0x7f89e8133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:04.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.113+0000 7f89e77fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f89e80a0a30 0x7f89e80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55016/0 (socket says 172.21.15.26:55016) 2023-10-01T08:01:04.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.113+0000 7f89e77fe700 1 -- 172.21.15.26:0/3322459073 learned_addr learned my addr 172.21.15.26:0/3322459073 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:04.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.113+0000 7f89e7fff700 1 --2- 172.21.15.26:0/3322459073 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89e8133fa0 0x7f89e8134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:04.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.113+0000 7f89e77fe700 1 -- 172.21.15.26:0/3322459073 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89e8133fa0 msgr2=0x7f89e8134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:04.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.113+0000 7f89e77fe700 1 --2- 172.21.15.26:0/3322459073 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89e8133fa0 0x7f89e8134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:04.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.113+0000 7f89e77fe700 1 -- 172.21.15.26:0/3322459073 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89e80a1340 msgr2=0x7f89e8133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:04.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.113+0000 7f89e77fe700 1 --2- 172.21.15.26:0/3322459073 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89e80a1340 0x7f89e8133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:04.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.113+0000 7f89e77fe700 1 -- 172.21.15.26:0/3322459073 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e80a1fe0 con 0x7f89e80a0a30 2023-10-01T08:01:04.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.113+0000 7f89e6ffd700 1 --2- 172.21.15.26:0/3322459073 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89e80a1340 0x7f89e8133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:04.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.113+0000 7f89e77fe700 1 --2- 172.21.15.26:0/3322459073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89e80a0a30 0x7f89e80a0e00 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f89d80098f0 tx=0x7f89d8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef58f396b46034a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:04.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.114+0000 7f89e67fc700 1 -- 172.21.15.26:0/3322459073 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d8011830 con 0x7f89e80a0a30 2023-10-01T08:01:04.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.114+0000 7f89e67fc700 1 -- 172.21.15.26:0/3322459073 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d8011990 con 0x7f89e80a0a30 2023-10-01T08:01:04.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.114+0000 7f89e67fc700 1 -- 172.21.15.26:0/3322459073 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d8011d20 con 0x7f89e80a0a30 2023-10-01T08:01:04.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.114+0000 7f89edf4c700 1 -- 172.21.15.26:0/3322459073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89e80a0a30 msgr2=0x7f89e80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:04.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.114+0000 7f89edf4c700 1 --2- 172.21.15.26:0/3322459073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89e80a0a30 0x7f89e80a0e00 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f89d80098f0 tx=0x7f89d8009c00 comp rx=0 tx=0).stop 2023-10-01T08:01:04.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.114+0000 7f89edf4c700 1 -- 172.21.15.26:0/3322459073 shutdown_connections 2023-10-01T08:01:04.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.114+0000 7f89edf4c700 1 --2- 172.21.15.26:0/3322459073 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89e8133fa0 0x7f89e8134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:04.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.114+0000 7f89edf4c700 1 --2- 172.21.15.26:0/3322459073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89e80a0a30 0x7f89e80a0e00 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:04.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.114+0000 7f89edf4c700 1 --2- 172.21.15.26:0/3322459073 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89e80a1340 0x7f89e8133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:04.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.114+0000 7f89edf4c700 1 -- 172.21.15.26:0/3322459073 >> 172.21.15.26:0/3322459073 conn(0x7f89e80a6550 msgr2=0x7f89e80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:04.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.114+0000 7f89edf4c700 1 -- 172.21.15.26:0/3322459073 shutdown_connections 2023-10-01T08:01:04.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.114+0000 7f89edf4c700 1 -- 172.21.15.26:0/3322459073 wait complete. 2023-10-01T08:01:04.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.116+0000 7f89edf4c700 1 Processor -- start 2023-10-01T08:01:04.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.116+0000 7f89edf4c700 1 -- start start 2023-10-01T08:01:04.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.117+0000 7f89edf4c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89e80a0a30 0x7f89e8120380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:04.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.117+0000 7f89edf4c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89e80a1340 0x7f89e81208c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:04.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.117+0000 7f89edf4c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89e8133fa0 0x7f89e8120e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:04.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.117+0000 7f89edf4c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e8133770 con 0x7f89e8133fa0 2023-10-01T08:01:04.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.117+0000 7f89edf4c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e81231e0 con 0x7f89e80a1340 2023-10-01T08:01:04.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.117+0000 7f89edf4c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89e8122570 con 0x7f89e80a0a30 2023-10-01T08:01:04.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.117+0000 7f89e6ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89e80a1340 0x7f89e81208c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:04.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.117+0000 7f89e6ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89e80a1340 0x7f89e81208c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51218/0 (socket says 172.21.15.26:51218) 2023-10-01T08:01:04.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.117+0000 7f89e6ffd700 1 -- 172.21.15.26:0/2195410925 learned_addr learned my addr 172.21.15.26:0/2195410925 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:04.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.117+0000 7f89e7fff700 1 --2- 172.21.15.26:0/2195410925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89e8133fa0 0x7f89e8120e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:04.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.117+0000 7f89e77fe700 1 --2- 172.21.15.26:0/2195410925 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89e80a0a30 0x7f89e8120380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:04.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.117+0000 7f89e6ffd700 1 -- 172.21.15.26:0/2195410925 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89e80a0a30 msgr2=0x7f89e8120380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:04.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.117+0000 7f89e6ffd700 1 --2- 172.21.15.26:0/2195410925 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89e80a0a30 0x7f89e8120380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:04.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.117+0000 7f89e6ffd700 1 -- 172.21.15.26:0/2195410925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89e8133fa0 msgr2=0x7f89e8120e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:04.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.117+0000 7f89e6ffd700 1 --2- 172.21.15.26:0/2195410925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89e8133fa0 0x7f89e8120e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:04.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.118+0000 7f89e6ffd700 1 -- 172.21.15.26:0/2195410925 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89dc0094a0 con 0x7f89e80a1340 2023-10-01T08:01:04.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.118+0000 7f89e6ffd700 1 --2- 172.21.15.26:0/2195410925 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89e80a1340 0x7f89e81208c0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f89dc00ec10 tx=0x7f89dc00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:04.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.118+0000 7f89cffff700 1 -- 172.21.15.26:0/2195410925 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc00c910 con 0x7f89e80a1340 2023-10-01T08:01:04.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.118+0000 7f89cffff700 1 -- 172.21.15.26:0/2195410925 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89dc00ca70 con 0x7f89e80a1340 2023-10-01T08:01:04.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.118+0000 7f89edf4c700 1 -- 172.21.15.26:0/2195410925 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89d8009550 con 0x7f89e80a1340 2023-10-01T08:01:04.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.118+0000 7f89cffff700 1 -- 172.21.15.26:0/2195410925 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc00cde0 con 0x7f89e80a1340 2023-10-01T08:01:04.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.118+0000 7f89edf4c700 1 -- 172.21.15.26:0/2195410925 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e80a3410 con 0x7f89e80a1340 2023-10-01T08:01:04.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.119+0000 7f89cffff700 1 -- 172.21.15.26:0/2195410925 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f89dc013470 con 0x7f89e80a1340 2023-10-01T08:01:04.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.119+0000 7f89cffff700 1 -- 172.21.15.26:0/2195410925 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f89dc03f8c0 con 0x7f89e80a1340 2023-10-01T08:01:04.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.119+0000 7f89edf4c700 1 -- 172.21.15.26:0/2195410925 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89e80a0280 con 0x7f89e80a1340 2023-10-01T08:01:04.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.129+0000 7f89cffff700 1 -- 172.21.15.26:0/2195410925 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f89dc0232f0 con 0x7f89e80a1340 2023-10-01T08:01:04.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.138+0000 7fb646b41700 1 -- 172.21.15.26:0/1056834787 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb640074ea0 con 0x7fb640133fa0 2023-10-01T08:01:04.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.139+0000 7fb63d7fa700 1 -- 172.21.15.26:0/1056834787 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb638024810 con 0x7fb640133fa0 2023-10-01T08:01:04.139 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:04.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.141+0000 7fb646b41700 1 -- 172.21.15.26:0/1056834787 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb640133fa0 msgr2=0x7fb64011f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:04.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.141+0000 7fb646b41700 1 --2- 172.21.15.26:0/1056834787 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb640133fa0 0x7fb64011f220 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb638014620 tx=0x7fb638014930 comp rx=0 tx=0).stop 2023-10-01T08:01:04.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.141+0000 7fb646b41700 1 -- 172.21.15.26:0/1056834787 shutdown_connections 2023-10-01T08:01:04.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.141+0000 7fb646b41700 1 --2- 172.21.15.26:0/1056834787 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb640133fa0 0x7fb64011f220 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:04.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.141+0000 7fb646b41700 1 --2- 172.21.15.26:0/1056834787 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb6400a0a30 0x7fb64011e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:04.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.141+0000 7fb646b41700 1 --2- 172.21.15.26:0/1056834787 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6400a1340 0x7fb64011ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:04.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.141+0000 7fb646b41700 1 -- 172.21.15.26:0/1056834787 >> 172.21.15.26:0/1056834787 conn(0x7fb6400a6550 msgr2=0x7fb6401b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:04.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.141+0000 7fb646b41700 1 -- 172.21.15.26:0/1056834787 shutdown_connections 2023-10-01T08:01:04.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.141+0000 7fb646b41700 1 -- 172.21.15.26:0/1056834787 wait complete. 2023-10-01T08:01:04.157 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:04.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.294+0000 7f3bf46cb700 1 -- 172.21.15.26:0/2725199461 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3bec123df0 con 0x7f3bec09d630 2023-10-01T08:01:04.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.294+0000 7f3be2ffd700 1 -- 172.21.15.26:0/2725199461 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3bec123df0 con 0x7f3bec09d630 2023-10-01T08:01:04.295 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:04.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.296+0000 7f3bf46cb700 1 -- 172.21.15.26:0/2725199461 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3bec09d630 msgr2=0x7f3bec120670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:04.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.296+0000 7f3bf46cb700 1 --2- 172.21.15.26:0/2725199461 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3bec09d630 0x7f3bec120670 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f3be800c4e0 tx=0x7f3be800c7f0 comp rx=0 tx=0).stop 2023-10-01T08:01:04.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.297+0000 7f3bf46cb700 1 -- 172.21.15.26:0/2725199461 shutdown_connections 2023-10-01T08:01:04.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.297+0000 7f3bf46cb700 1 --2- 172.21.15.26:0/2725199461 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3bec138d80 0x7f3bec1210f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:04.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.297+0000 7f3bf46cb700 1 --2- 172.21.15.26:0/2725199461 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3bec09d630 0x7f3bec120670 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:04.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.297+0000 7f3bf46cb700 1 --2- 172.21.15.26:0/2725199461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bec0a0a30 0x7f3bec120bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:04.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.297+0000 7f3bf46cb700 1 -- 172.21.15.26:0/2725199461 >> 172.21.15.26:0/2725199461 conn(0x7f3bec0a3050 msgr2=0x7f3bec09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:04.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.297+0000 7f3bf46cb700 1 -- 172.21.15.26:0/2725199461 shutdown_connections 2023-10-01T08:01:04.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.297+0000 7f3bf46cb700 1 -- 172.21.15.26:0/2725199461 wait complete. 2023-10-01T08:01:04.311 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:04.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.334+0000 7f89edf4c700 1 -- 172.21.15.26:0/2195410925 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f89e8074ea0 con 0x7f89e80a1340 2023-10-01T08:01:04.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.335+0000 7f89cffff700 1 -- 172.21.15.26:0/2195410925 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f89dc01bb60 con 0x7f89e80a1340 2023-10-01T08:01:04.335 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:04.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.337+0000 7f89edf4c700 1 -- 172.21.15.26:0/2195410925 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89e80a1340 msgr2=0x7f89e81208c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:04.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.337+0000 7f89edf4c700 1 --2- 172.21.15.26:0/2195410925 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89e80a1340 0x7f89e81208c0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f89dc00ec10 tx=0x7f89dc00ef20 comp rx=0 tx=0).stop 2023-10-01T08:01:04.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.337+0000 7f89edf4c700 1 -- 172.21.15.26:0/2195410925 shutdown_connections 2023-10-01T08:01:04.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.337+0000 7f89edf4c700 1 --2- 172.21.15.26:0/2195410925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89e8133fa0 0x7f89e8120e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:04.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.337+0000 7f89edf4c700 1 --2- 172.21.15.26:0/2195410925 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f89e80a0a30 0x7f89e8120380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:04.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.337+0000 7f89edf4c700 1 --2- 172.21.15.26:0/2195410925 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f89e80a1340 0x7f89e81208c0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:04.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.337+0000 7f89edf4c700 1 -- 172.21.15.26:0/2195410925 >> 172.21.15.26:0/2195410925 conn(0x7f89e80a6550 msgr2=0x7f89e81baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:04.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.337+0000 7f89edf4c700 1 -- 172.21.15.26:0/2195410925 shutdown_connections 2023-10-01T08:01:04.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.337+0000 7f89edf4c700 1 -- 172.21.15.26:0/2195410925 wait complete. 2023-10-01T08:01:04.353 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:04.732 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:04.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.877+0000 7f397e11e700 1 Processor -- start 2023-10-01T08:01:04.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.878+0000 7f397e11e700 1 -- start start 2023-10-01T08:01:04.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.878+0000 7f397e11e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f397809e1d0 0x7f3978138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:04.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.878+0000 7f397e11e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3978139170 0x7f397813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:04.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.878+0000 7f397e11e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f397809b120 con 0x7f397809d6f0 2023-10-01T08:01:04.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.878+0000 7f397e11e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f397806b460 con 0x7f3978139170 2023-10-01T08:01:04.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.878+0000 7f397e11e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f397809a7e0 con 0x7f397809e1d0 2023-10-01T08:01:04.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.878+0000 7f3977fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3978139170 0x7f397813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:04.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.878+0000 7f3977fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3978139170 0x7f397813b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55028/0 (socket says 172.21.15.26:55028) 2023-10-01T08:01:04.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.878+0000 7f3976ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f397809e1d0 0x7f3978138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:04.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.878+0000 7f3977fff700 1 -- 172.21.15.26:0/2960773574 learned_addr learned my addr 172.21.15.26:0/2960773574 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:04.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.879+0000 7f3977fff700 1 -- 172.21.15.26:0/2960773574 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f397809e1d0 msgr2=0x7f3978138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:04.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.879+0000 7f3977fff700 1 --2- 172.21.15.26:0/2960773574 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f397809e1d0 0x7f3978138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:04.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.879+0000 7f3977fff700 1 -- 172.21.15.26:0/2960773574 >> v1:172.21.15.26:6789/0 conn(0x7f397809d6f0 legacy=0x7f397809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:04.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.879+0000 7f3977fff700 1 -- 172.21.15.26:0/2960773574 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f397809a500 con 0x7f3978139170 2023-10-01T08:01:04.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.879+0000 7f3976ffd700 1 --2- 172.21.15.26:0/2960773574 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f397809e1d0 0x7f3978138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:04.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.879+0000 7f3977fff700 1 --2- 172.21.15.26:0/2960773574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3978139170 0x7f397813b550 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f3970009e50 tx=0x7f397000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bcc62e11faf5e72 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:04.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.879+0000 7f39767fc700 1 -- 172.21.15.26:0/2960773574 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397000e070 con 0x7f3978139170 2023-10-01T08:01:04.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.879+0000 7f39767fc700 1 -- 172.21.15.26:0/2960773574 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397000b910 con 0x7f3978139170 2023-10-01T08:01:04.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.879+0000 7f39767fc700 1 -- 172.21.15.26:0/2960773574 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397000bcc0 con 0x7f3978139170 2023-10-01T08:01:04.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.879+0000 7f397e11e700 1 -- 172.21.15.26:0/2960773574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3978139170 msgr2=0x7f397813b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:04.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.879+0000 7f397e11e700 1 --2- 172.21.15.26:0/2960773574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3978139170 0x7f397813b550 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f3970009e50 tx=0x7f397000b330 comp rx=0 tx=0).stop 2023-10-01T08:01:04.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.880+0000 7f397e11e700 1 -- 172.21.15.26:0/2960773574 shutdown_connections 2023-10-01T08:01:04.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.880+0000 7f397e11e700 1 --2- 172.21.15.26:0/2960773574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3978139170 0x7f397813b550 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:04.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.880+0000 7f397e11e700 1 --2- 172.21.15.26:0/2960773574 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f397809e1d0 0x7f3978138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:04.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.880+0000 7f397e11e700 1 -- 172.21.15.26:0/2960773574 >> 172.21.15.26:0/2960773574 conn(0x7f3978066f50 msgr2=0x7f397809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:04.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.880+0000 7f397e11e700 1 -- 172.21.15.26:0/2960773574 shutdown_connections 2023-10-01T08:01:04.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.880+0000 7f397e11e700 1 -- 172.21.15.26:0/2960773574 wait complete. 2023-10-01T08:01:04.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.881+0000 7f397e11e700 1 Processor -- start 2023-10-01T08:01:04.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.881+0000 7f397e11e700 1 -- start start 2023-10-01T08:01:04.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.881+0000 7f397e11e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f397809d6f0 0x7f39781c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:04.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.881+0000 7f397e11e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f397809e1d0 0x7f39781c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:04.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.881+0000 7f397e11e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3978139170 0x7f397811e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:04.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.881+0000 7f397e11e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3978120560 con 0x7f397809e1d0 2023-10-01T08:01:04.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.881+0000 7f397e11e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3978120370 con 0x7f397809d6f0 2023-10-01T08:01:04.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.881+0000 7f397e11e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3978121ad0 con 0x7f3978139170 2023-10-01T08:01:04.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.881+0000 7f3976ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f397809e1d0 0x7f39781c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:04.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.881+0000 7f39777fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f397809d6f0 0x7f39781c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:04.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.881+0000 7f3977fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3978139170 0x7f397811e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:04.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.881+0000 7f3976ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f397809e1d0 0x7f39781c8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55044/0 (socket says 172.21.15.26:55044) 2023-10-01T08:01:04.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.881+0000 7f3976ffd700 1 -- 172.21.15.26:0/3063023255 learned_addr learned my addr 172.21.15.26:0/3063023255 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:04.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.882+0000 7f3977fff700 1 -- 172.21.15.26:0/3063023255 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f397809d6f0 msgr2=0x7f39781c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:04.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.882+0000 7f3977fff700 1 --2- 172.21.15.26:0/3063023255 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f397809d6f0 0x7f39781c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:04.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.882+0000 7f3977fff700 1 -- 172.21.15.26:0/3063023255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f397809e1d0 msgr2=0x7f39781c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:04.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.882+0000 7f3977fff700 1 --2- 172.21.15.26:0/3063023255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f397809e1d0 0x7f39781c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:04.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.882+0000 7f3977fff700 1 -- 172.21.15.26:0/3063023255 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39600094a0 con 0x7f3978139170 2023-10-01T08:01:04.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.882+0000 7f3976ffd700 1 --2- 172.21.15.26:0/3063023255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f397809e1d0 0x7f39781c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:04.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.882+0000 7f3977fff700 1 --2- 172.21.15.26:0/3063023255 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3978139170 0x7f397811e8e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f3970015000 tx=0x7f3970004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:04.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.882+0000 7f396ffff700 1 -- 172.21.15.26:0/3063023255 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3970004880 con 0x7f3978139170 2023-10-01T08:01:04.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.882+0000 7f396ffff700 1 -- 172.21.15.26:0/3063023255 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39700092e0 con 0x7f3978139170 2023-10-01T08:01:04.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.882+0000 7f397e11e700 1 -- 172.21.15.26:0/3063023255 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3970009b30 con 0x7f3978139170 2023-10-01T08:01:04.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.882+0000 7f396ffff700 1 -- 172.21.15.26:0/3063023255 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397001c660 con 0x7f3978139170 2023-10-01T08:01:04.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.882+0000 7f397e11e700 1 -- 172.21.15.26:0/3063023255 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3978121fa0 con 0x7f3978139170 2023-10-01T08:01:04.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.883+0000 7f396ffff700 1 -- 172.21.15.26:0/3063023255 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f397001c7c0 con 0x7f3978139170 2023-10-01T08:01:04.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.883+0000 7f397e11e700 1 -- 172.21.15.26:0/3063023255 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3978074ea0 con 0x7f3978139170 2023-10-01T08:01:04.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.883+0000 7f396ffff700 1 -- 172.21.15.26:0/3063023255 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3970040f50 con 0x7f3978139170 2023-10-01T08:01:04.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:04.888+0000 7f396ffff700 1 -- 172.21.15.26:0/3063023255 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f39700123f0 con 0x7f3978139170 2023-10-01T08:01:05.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.096+0000 7f397e11e700 1 -- 172.21.15.26:0/3063023255 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3978120b60 con 0x7f3978139170 2023-10-01T08:01:05.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.096+0000 7f396ffff700 1 -- 172.21.15.26:0/3063023255 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f39700243b0 con 0x7f3978139170 2023-10-01T08:01:05.097 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:05.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.098+0000 7f397e11e700 1 -- 172.21.15.26:0/3063023255 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3978139170 msgr2=0x7f397811e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:05.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.098+0000 7f397e11e700 1 --2- 172.21.15.26:0/3063023255 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3978139170 0x7f397811e8e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f3970015000 tx=0x7f3970004ad0 comp rx=0 tx=0).stop 2023-10-01T08:01:05.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.098+0000 7f397e11e700 1 -- 172.21.15.26:0/3063023255 shutdown_connections 2023-10-01T08:01:05.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.098+0000 7f397e11e700 1 --2- 172.21.15.26:0/3063023255 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3978139170 0x7f397811e8e0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:05.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.098+0000 7f397e11e700 1 --2- 172.21.15.26:0/3063023255 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f397809d6f0 0x7f39781c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:05.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.098+0000 7f397e11e700 1 --2- 172.21.15.26:0/3063023255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f397809e1d0 0x7f39781c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:05.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.098+0000 7f397e11e700 1 -- 172.21.15.26:0/3063023255 >> 172.21.15.26:0/3063023255 conn(0x7f3978066f50 msgr2=0x7f39780a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:05.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.098+0000 7f397e11e700 1 -- 172.21.15.26:0/3063023255 shutdown_connections 2023-10-01T08:01:05.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.098+0000 7f397e11e700 1 -- 172.21.15.26:0/3063023255 wait complete. 2023-10-01T08:01:05.113 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:05.158 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:05.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.297+0000 7f5dcac44700 1 Processor -- start 2023-10-01T08:01:05.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.297+0000 7f5dcac44700 1 -- start start 2023-10-01T08:01:05.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.298+0000 7f5dcac44700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5dc409d6f0 0x7f5dc409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:05.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.298+0000 7f5dcac44700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5dc409e410 0x7f5dc4130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:05.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.298+0000 7f5dcac44700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dc409f130 con 0x7f5dc409e000 2023-10-01T08:01:05.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.298+0000 7f5dcac44700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc409f520 con 0x7f5dc409d6f0 2023-10-01T08:01:05.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.298+0000 7f5dcac44700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc409e930 con 0x7f5dc409e410 2023-10-01T08:01:05.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.298+0000 7f5dc89e0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5dc409d6f0 0x7f5dc409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:05.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.298+0000 7f5dc3fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5dc409e000 0x7f5dc4130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49230/0 (socket says 172.21.15.26:49230) 2023-10-01T08:01:05.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.298+0000 7f5dc3fff700 1 -- 172.21.15.26:0/2481616750 learned_addr learned my addr 172.21.15.26:0/2481616750 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:01:05.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.298+0000 7f5dc91e1700 1 --2- 172.21.15.26:0/2481616750 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5dc409e410 0x7f5dc4130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:05.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.298+0000 7f5dc37fe700 1 -- 172.21.15.26:0/2481616750 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2043608996 0 0) 0x7f5dc409f130 con 0x7f5dc409e000 2023-10-01T08:01:05.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.298+0000 7f5dc89e0700 1 -- 172.21.15.26:0/2481616750 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5dc409e410 msgr2=0x7f5dc4130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:05.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.298+0000 7f5dc89e0700 1 --2- 172.21.15.26:0/2481616750 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5dc409e410 0x7f5dc4130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:05.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.298+0000 7f5dc89e0700 1 -- 172.21.15.26:0/2481616750 >> v1:172.21.15.26:6789/0 conn(0x7f5dc409e000 legacy=0x7f5dc4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:05.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.298+0000 7f5dc89e0700 1 -- 172.21.15.26:0/2481616750 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc409b2d0 con 0x7f5dc409d6f0 2023-10-01T08:01:05.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.298+0000 7f5dc91e1700 1 --2- 172.21.15.26:0/2481616750 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5dc409e410 0x7f5dc4130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:05.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.298+0000 7f5dc89e0700 1 --2- 172.21.15.26:0/2481616750 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5dc409d6f0 0x7f5dc409dac0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f5db40098d0 tx=0x7f5db4009be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ca0b5ca437bed86 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:05.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.299+0000 7f5dc37fe700 1 -- 172.21.15.26:0/2481616750 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db4012b80 con 0x7f5dc409d6f0 2023-10-01T08:01:05.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.299+0000 7f5dc37fe700 1 -- 172.21.15.26:0/2481616750 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db4012ce0 con 0x7f5dc409d6f0 2023-10-01T08:01:05.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.299+0000 7f5dc37fe700 1 -- 172.21.15.26:0/2481616750 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db4004270 con 0x7f5dc409d6f0 2023-10-01T08:01:05.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.299+0000 7f5dcac44700 1 -- 172.21.15.26:0/2481616750 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5dc409d6f0 msgr2=0x7f5dc409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:05.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.299+0000 7f5dcac44700 1 --2- 172.21.15.26:0/2481616750 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5dc409d6f0 0x7f5dc409dac0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f5db40098d0 tx=0x7f5db4009be0 comp rx=0 tx=0).stop 2023-10-01T08:01:05.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.299+0000 7f5dcac44700 1 -- 172.21.15.26:0/2481616750 shutdown_connections 2023-10-01T08:01:05.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.299+0000 7f5dcac44700 1 --2- 172.21.15.26:0/2481616750 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5dc409e410 0x7f5dc4130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:05.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.299+0000 7f5dcac44700 1 --2- 172.21.15.26:0/2481616750 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5dc409d6f0 0x7f5dc409dac0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:05.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.299+0000 7f5dcac44700 1 -- 172.21.15.26:0/2481616750 >> 172.21.15.26:0/2481616750 conn(0x7f5dc4066f50 msgr2=0x7f5dc409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:05.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.299+0000 7f5dcac44700 1 -- 172.21.15.26:0/2481616750 shutdown_connections 2023-10-01T08:01:05.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.299+0000 7f5dcac44700 1 -- 172.21.15.26:0/2481616750 wait complete. 2023-10-01T08:01:05.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.300+0000 7f5dcac44700 1 Processor -- start 2023-10-01T08:01:05.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.300+0000 7f5dcac44700 1 -- start start 2023-10-01T08:01:05.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.301+0000 7f5dcac44700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5dc409d6f0 0x7f5dc411e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:05.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.301+0000 7f5dcac44700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5dc409e000 0x7f5dc411e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:05.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.301+0000 7f5dcac44700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5dc409e410 0x7f5dc411eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:05.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.301+0000 7f5dcac44700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc4121b50 con 0x7f5dc409d6f0 2023-10-01T08:01:05.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.301+0000 7f5dcac44700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc409c770 con 0x7f5dc409e410 2023-10-01T08:01:05.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.301+0000 7f5dcac44700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc4072150 con 0x7f5dc409e000 2023-10-01T08:01:05.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.301+0000 7f5dc89e0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5dc409d6f0 0x7f5dc411e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:05.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.301+0000 7f5dc3fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5dc409e000 0x7f5dc411e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:05.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.301+0000 7f5dc91e1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5dc409e410 0x7f5dc411eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:05.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.301+0000 7f5dc89e0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5dc409d6f0 0x7f5dc411e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55054/0 (socket says 172.21.15.26:55054) 2023-10-01T08:01:05.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.301+0000 7f5dc91e1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5dc409e410 0x7f5dc411eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51242/0 (socket says 172.21.15.26:51242) 2023-10-01T08:01:05.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.301+0000 7f5dc3fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5dc409e000 0x7f5dc411e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56796/0 (socket says 172.21.15.26:56796) 2023-10-01T08:01:05.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.301+0000 7f5dc89e0700 1 -- 172.21.15.26:0/3611047995 learned_addr learned my addr 172.21.15.26:0/3611047995 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:05.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.301+0000 7f5dc91e1700 1 -- 172.21.15.26:0/3611047995 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5dc409e000 msgr2=0x7f5dc411e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:05.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.301+0000 7f5dc91e1700 1 --2- 172.21.15.26:0/3611047995 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5dc409e000 0x7f5dc411e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:05.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.301+0000 7f5dc91e1700 1 -- 172.21.15.26:0/3611047995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5dc409d6f0 msgr2=0x7f5dc411e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:05.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.301+0000 7f5dc91e1700 1 --2- 172.21.15.26:0/3611047995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5dc409d6f0 0x7f5dc411e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:05.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.302+0000 7f5dc91e1700 1 -- 172.21.15.26:0/3611047995 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dbc009a70 con 0x7f5dc409e410 2023-10-01T08:01:05.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.302+0000 7f5dc89e0700 1 --2- 172.21.15.26:0/3611047995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5dc409d6f0 0x7f5dc411e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:05.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.302+0000 7f5dc91e1700 1 --2- 172.21.15.26:0/3611047995 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5dc409e410 0x7f5dc411eab0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc00efc0 tx=0x7f5dbc00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:05.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.302+0000 7f5dc17fa700 1 -- 172.21.15.26:0/3611047995 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc00ca90 con 0x7f5dc409e410 2023-10-01T08:01:05.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.302+0000 7f5dc17fa700 1 -- 172.21.15.26:0/3611047995 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dbc00f040 con 0x7f5dc409e410 2023-10-01T08:01:05.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.302+0000 7f5dcac44700 1 -- 172.21.15.26:0/3611047995 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5db40094a0 con 0x7f5dc409e410 2023-10-01T08:01:05.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.302+0000 7f5dc17fa700 1 -- 172.21.15.26:0/3611047995 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc00ce30 con 0x7f5dc409e410 2023-10-01T08:01:05.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.302+0000 7f5dcac44700 1 -- 172.21.15.26:0/3611047995 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc41215b0 con 0x7f5dc409e410 2023-10-01T08:01:05.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.303+0000 7f5dc17fa700 1 -- 172.21.15.26:0/3611047995 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5dbc014480 con 0x7f5dc409e410 2023-10-01T08:01:05.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.303+0000 7f5dcac44700 1 -- 172.21.15.26:0/3611047995 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dc411ac20 con 0x7f5dc409e410 2023-10-01T08:01:05.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.303+0000 7f5dc17fa700 1 -- 172.21.15.26:0/3611047995 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5dbc03fd20 con 0x7f5dc409e410 2023-10-01T08:01:05.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.308+0000 7f5dc17fa700 1 -- 172.21.15.26:0/3611047995 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5dbc044070 con 0x7f5dc409e410 2023-10-01T08:01:05.311 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:05.354 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:05.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.450+0000 7fa4e6789700 1 Processor -- start 2023-10-01T08:01:05.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.450+0000 7fa4e6789700 1 -- start start 2023-10-01T08:01:05.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.451+0000 7fa4e6789700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa4e009f330 0x7fa4e0138e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:05.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.451+0000 7fa4e6789700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa4e0139370 0x7fa4e013b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:05.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.451+0000 7fa4e6789700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4e006bc50 con 0x7fa4e009e850 2023-10-01T08:01:05.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.451+0000 7fa4e6789700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e009ae60 con 0x7fa4e009f330 2023-10-01T08:01:05.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.451+0000 7fa4e6789700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e006b990 con 0x7fa4e0139370 2023-10-01T08:01:05.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.451+0000 7fa4df7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa4e009f330 0x7fa4e0138e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:05.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.451+0000 7fa4e4d26700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa4e0139370 0x7fa4e013b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:05.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.451+0000 7fa4df7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa4e009f330 0x7fa4e0138e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51252/0 (socket says 172.21.15.26:51252) 2023-10-01T08:01:05.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.451+0000 7fa4df7fe700 1 -- 172.21.15.26:0/131110518 learned_addr learned my addr 172.21.15.26:0/131110518 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:05.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.451+0000 7fa4e4d26700 1 --2- 172.21.15.26:0/131110518 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa4e0139370 0x7fa4e013b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56804/0 (socket says 172.21.15.26:56804) 2023-10-01T08:01:05.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.451+0000 7fa4deffd700 1 -- 172.21.15.26:0/131110518 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4186819329 0 0) 0x7fa4e006bc50 con 0x7fa4e009e850 2023-10-01T08:01:05.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.451+0000 7fa4e4d26700 1 -- 172.21.15.26:0/131110518 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa4e009f330 msgr2=0x7fa4e0138e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:05.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.451+0000 7fa4e4d26700 1 --2- 172.21.15.26:0/131110518 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa4e009f330 0x7fa4e0138e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:05.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.451+0000 7fa4e4d26700 1 -- 172.21.15.26:0/131110518 >> v1:172.21.15.26:6789/0 conn(0x7fa4e009e850 legacy=0x7fa4e009ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:05.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.451+0000 7fa4e4d26700 1 -- 172.21.15.26:0/131110518 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e006cb10 con 0x7fa4e0139370 2023-10-01T08:01:05.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.452+0000 7fa4df7fe700 1 --2- 172.21.15.26:0/131110518 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa4e009f330 0x7fa4e0138e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:05.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.452+0000 7fa4e4d26700 1 --2- 172.21.15.26:0/131110518 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa4e0139370 0x7fa4e013b750 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009dc0 tx=0x7fa4d800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3431741a66c46 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:05.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.452+0000 7fa4deffd700 1 -- 172.21.15.26:0/131110518 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d800e070 con 0x7fa4e0139370 2023-10-01T08:01:05.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.452+0000 7fa4deffd700 1 -- 172.21.15.26:0/131110518 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d800bb20 con 0x7fa4e0139370 2023-10-01T08:01:05.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.452+0000 7fa4deffd700 1 -- 172.21.15.26:0/131110518 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d8012430 con 0x7fa4e0139370 2023-10-01T08:01:05.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.453+0000 7fa4e6789700 1 -- 172.21.15.26:0/131110518 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa4e0139370 msgr2=0x7fa4e013b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:05.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.453+0000 7fa4e6789700 1 --2- 172.21.15.26:0/131110518 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa4e0139370 0x7fa4e013b750 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009dc0 tx=0x7fa4d800b330 comp rx=0 tx=0).stop 2023-10-01T08:01:05.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.453+0000 7fa4e6789700 1 -- 172.21.15.26:0/131110518 shutdown_connections 2023-10-01T08:01:05.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.453+0000 7fa4e6789700 1 --2- 172.21.15.26:0/131110518 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa4e0139370 0x7fa4e013b750 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:05.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.453+0000 7fa4e6789700 1 --2- 172.21.15.26:0/131110518 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa4e009f330 0x7fa4e0138e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:05.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.453+0000 7fa4e6789700 1 -- 172.21.15.26:0/131110518 >> 172.21.15.26:0/131110518 conn(0x7fa4e00a3f70 msgr2=0x7fa4e00a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:05.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.453+0000 7fa4e6789700 1 -- 172.21.15.26:0/131110518 shutdown_connections 2023-10-01T08:01:05.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.453+0000 7fa4e6789700 1 -- 172.21.15.26:0/131110518 wait complete. 2023-10-01T08:01:05.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.454+0000 7fa4e6789700 1 Processor -- start 2023-10-01T08:01:05.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.454+0000 7fa4e6789700 1 -- start start 2023-10-01T08:01:05.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.454+0000 7fa4e6789700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4e009e850 0x7fa4e011ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:05.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.454+0000 7fa4e6789700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa4e009f330 0x7fa4e011efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:05.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.454+0000 7fa4e6789700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa4e0139370 0x7fa4e011f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:05.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.454+0000 7fa4e6789700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e006faa0 con 0x7fa4e009e850 2023-10-01T08:01:05.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.454+0000 7fa4e6789700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e0134490 con 0x7fa4e009f330 2023-10-01T08:01:05.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.454+0000 7fa4e6789700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e0121c30 con 0x7fa4e0139370 2023-10-01T08:01:05.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.455+0000 7fa4df7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa4e009f330 0x7fa4e011efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:05.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.455+0000 7fa4df7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa4e009f330 0x7fa4e011efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51256/0 (socket says 172.21.15.26:51256) 2023-10-01T08:01:05.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.455+0000 7fa4df7fe700 1 -- 172.21.15.26:0/1450911584 learned_addr learned my addr 172.21.15.26:0/1450911584 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:05.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.455+0000 7fa4dffff700 1 --2- 172.21.15.26:0/1450911584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4e009e850 0x7fa4e011ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:05.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.455+0000 7fa4e4d26700 1 --2- 172.21.15.26:0/1450911584 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa4e0139370 0x7fa4e011f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:05.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.455+0000 7fa4df7fe700 1 -- 172.21.15.26:0/1450911584 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa4e0139370 msgr2=0x7fa4e011f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:05.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.455+0000 7fa4df7fe700 1 --2- 172.21.15.26:0/1450911584 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa4e0139370 0x7fa4e011f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:05.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.455+0000 7fa4df7fe700 1 -- 172.21.15.26:0/1450911584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4e009e850 msgr2=0x7fa4e011ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:05.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.455+0000 7fa4df7fe700 1 --2- 172.21.15.26:0/1450911584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4e009e850 0x7fa4e011ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:05.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.455+0000 7fa4df7fe700 1 -- 172.21.15.26:0/1450911584 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d4009550 con 0x7fa4e009f330 2023-10-01T08:01:05.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.455+0000 7fa4df7fe700 1 --2- 172.21.15.26:0/1450911584 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa4e009f330 0x7fa4e011efa0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fa4d400ebe0 tx=0x7fa4d400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:05.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.455+0000 7fa4dcff9700 1 -- 172.21.15.26:0/1450911584 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d400c850 con 0x7fa4e009f330 2023-10-01T08:01:05.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.455+0000 7fa4dcff9700 1 -- 172.21.15.26:0/1450911584 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d400c9b0 con 0x7fa4e009f330 2023-10-01T08:01:05.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.455+0000 7fa4dcff9700 1 -- 172.21.15.26:0/1450911584 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d400cd40 con 0x7fa4e009f330 2023-10-01T08:01:05.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.456+0000 7fa4e6789700 1 -- 172.21.15.26:0/1450911584 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d8009a70 con 0x7fa4e009f330 2023-10-01T08:01:05.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.456+0000 7fa4e6789700 1 -- 172.21.15.26:0/1450911584 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e0121f20 con 0x7fa4e009f330 2023-10-01T08:01:05.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.457+0000 7fa4e6789700 1 -- 172.21.15.26:0/1450911584 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4e00747f0 con 0x7fa4e009f330 2023-10-01T08:01:05.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.457+0000 7fa4dcff9700 1 -- 172.21.15.26:0/1450911584 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa4d4013470 con 0x7fa4e009f330 2023-10-01T08:01:05.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.457+0000 7fa4dcff9700 1 -- 172.21.15.26:0/1450911584 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa4d4040140 con 0x7fa4e009f330 2023-10-01T08:01:05.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.462+0000 7fa4dcff9700 1 -- 172.21.15.26:0/1450911584 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa4d4011760 con 0x7fa4e009f330 2023-10-01T08:01:05.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.511+0000 7f5d60f1c700 1 Processor -- start 2023-10-01T08:01:05.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.511+0000 7f5d60f1c700 1 -- start start 2023-10-01T08:01:05.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.511+0000 7f5d60f1c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5d5c09d6f0 0x7f5d5c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:05.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.511+0000 7f5d60f1c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5d5c09e440 0x7f5d5c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:05.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.511+0000 7f5d60f1c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d5c09b120 con 0x7f5d5c09e000 2023-10-01T08:01:05.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.512+0000 7f5d60f1c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d5c06b460 con 0x7f5d5c09d6f0 2023-10-01T08:01:05.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.512+0000 7f5d60f1c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5c09a7e0 con 0x7f5d5c09e440 2023-10-01T08:01:05.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.512+0000 7f5d5a59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5d5c09d6f0 0x7f5d5c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:05.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.512+0000 7f5d5ad9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5d5c09e440 0x7f5d5c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:05.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.512+0000 7f5d5a59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5d5c09d6f0 0x7f5d5c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55070/0 (socket says 172.21.15.26:55070) 2023-10-01T08:01:05.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.512+0000 7f5d5a59c700 1 -- 172.21.15.26:0/1582116692 learned_addr learned my addr 172.21.15.26:0/1582116692 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:05.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.512+0000 7f5d59d9b700 1 --1- 172.21.15.26:0/1582116692 >> v1:172.21.15.26:6789/0 conn(0x7f5d5c09e000 0x7f5d5c1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49252/0 (socket says 172.21.15.26:49252) 2023-10-01T08:01:05.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.512+0000 7f5d5ad9d700 1 -- 172.21.15.26:0/1582116692 >> v2:172.21.15.26:3300/0 conn(0x7f5d5c09d6f0 msgr2=0x7f5d5c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:05.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.512+0000 7f5d5ad9d700 1 --2- 172.21.15.26:0/1582116692 >> v2:172.21.15.26:3300/0 conn(0x7f5d5c09d6f0 0x7f5d5c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:05.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.512+0000 7f5d5ad9d700 1 -- 172.21.15.26:0/1582116692 >> v1:172.21.15.26:6789/0 conn(0x7f5d5c09e000 legacy=0x7f5d5c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:05.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.512+0000 7f5d5ad9d700 1 -- 172.21.15.26:0/1582116692 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5c09a500 con 0x7f5d5c09e440 2023-10-01T08:01:05.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.512+0000 7f5d5ad9d700 1 --2- 172.21.15.26:0/1582116692 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5d5c09e440 0x7f5d5c134100 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f5d54009dc0 tx=0x7f5d5400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5eb1018672f3ac1b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:05.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.512+0000 7f5d5959a700 1 -- 172.21.15.26:0/1582116692 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5400e070 con 0x7f5d5c09e440 2023-10-01T08:01:05.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.513+0000 7f5d5959a700 1 -- 172.21.15.26:0/1582116692 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5400bae0 con 0x7f5d5c09e440 2023-10-01T08:01:05.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.513+0000 7f5d5959a700 1 -- 172.21.15.26:0/1582116692 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5400be90 con 0x7f5d5c09e440 2023-10-01T08:01:05.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.513+0000 7f5d60f1c700 1 -- 172.21.15.26:0/1582116692 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5d5c09e440 msgr2=0x7f5d5c134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:05.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.513+0000 7f5d60f1c700 1 --2- 172.21.15.26:0/1582116692 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5d5c09e440 0x7f5d5c134100 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f5d54009dc0 tx=0x7f5d5400b330 comp rx=0 tx=0).stop 2023-10-01T08:01:05.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.513+0000 7f5d60f1c700 1 -- 172.21.15.26:0/1582116692 shutdown_connections 2023-10-01T08:01:05.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.513+0000 7f5d60f1c700 1 --2- 172.21.15.26:0/1582116692 >> v2:172.21.15.26:3300/0 conn(0x7f5d5c09d6f0 0x7f5d5c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:05.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.513+0000 7f5d60f1c700 1 --2- 172.21.15.26:0/1582116692 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5d5c09e440 0x7f5d5c134100 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:05.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.513+0000 7f5d60f1c700 1 -- 172.21.15.26:0/1582116692 >> 172.21.15.26:0/1582116692 conn(0x7f5d5c066f50 msgr2=0x7f5d5c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:05.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.513+0000 7f5d60f1c700 1 -- 172.21.15.26:0/1582116692 shutdown_connections 2023-10-01T08:01:05.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.513+0000 7f5d60f1c700 1 -- 172.21.15.26:0/1582116692 wait complete. 2023-10-01T08:01:05.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.515+0000 7f5d60f1c700 1 Processor -- start 2023-10-01T08:01:05.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.515+0000 7f5d60f1c700 1 -- start start 2023-10-01T08:01:05.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.515+0000 7f5d60f1c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5d5c09d6f0 0x7f5d5c1a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:05.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.515+0000 7f5d60f1c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d5c09e000 0x7f5d5c1a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:05.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.515+0000 7f5d60f1c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5d5c09e440 0x7f5d5c1a6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:05.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.515+0000 7f5d60f1c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5c1aa360 con 0x7f5d5c09e000 2023-10-01T08:01:05.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.515+0000 7f5d60f1c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5c1a99a0 con 0x7f5d5c09d6f0 2023-10-01T08:01:05.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.515+0000 7f5d60f1c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5c1a8ce0 con 0x7f5d5c09e440 2023-10-01T08:01:05.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.515+0000 7f5d5a59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5d5c09d6f0 0x7f5d5c1a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:05.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.515+0000 7f5d5a59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5d5c09d6f0 0x7f5d5c1a5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51274/0 (socket says 172.21.15.26:51274) 2023-10-01T08:01:05.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.515+0000 7f5d5a59c700 1 -- 172.21.15.26:0/542769905 learned_addr learned my addr 172.21.15.26:0/542769905 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:05.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.515+0000 7f5d59d9b700 1 --2- 172.21.15.26:0/542769905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d5c09e000 0x7f5d5c1a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:05.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.515+0000 7f5d5ad9d700 1 --2- 172.21.15.26:0/542769905 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5d5c09e440 0x7f5d5c1a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:05.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.516+0000 7f5d5a59c700 1 -- 172.21.15.26:0/542769905 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5d5c09e440 msgr2=0x7f5d5c1a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:05.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.516+0000 7f5d5a59c700 1 --2- 172.21.15.26:0/542769905 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5d5c09e440 0x7f5d5c1a6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:05.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.516+0000 7f5d5a59c700 1 -- 172.21.15.26:0/542769905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d5c09e000 msgr2=0x7f5d5c1a6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:05.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.516+0000 7f5d5a59c700 1 --2- 172.21.15.26:0/542769905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d5c09e000 0x7f5d5c1a6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:05.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.516+0000 7f5d5a59c700 1 -- 172.21.15.26:0/542769905 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d54009a70 con 0x7f5d5c09d6f0 2023-10-01T08:01:05.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.516+0000 7f5d5a59c700 1 --2- 172.21.15.26:0/542769905 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5d5c09d6f0 0x7f5d5c1a5ed0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c00e940 tx=0x7f5d4c00ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:05.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.516+0000 7f5d4affd700 1 -- 172.21.15.26:0/542769905 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c0096a0 con 0x7f5d5c09d6f0 2023-10-01T08:01:05.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.516+0000 7f5d4affd700 1 -- 172.21.15.26:0/542769905 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4c013680 con 0x7f5d5c09d6f0 2023-10-01T08:01:05.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.516+0000 7f5d60f1c700 1 -- 172.21.15.26:0/542769905 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d5c0a2000 con 0x7f5d5c09d6f0 2023-10-01T08:01:05.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.516+0000 7f5d4affd700 1 -- 172.21.15.26:0/542769905 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c013a30 con 0x7f5d5c09d6f0 2023-10-01T08:01:05.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.516+0000 7f5d60f1c700 1 -- 172.21.15.26:0/542769905 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d5c09c760 con 0x7f5d5c09d6f0 2023-10-01T08:01:05.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.517+0000 7f5d60f1c700 1 -- 172.21.15.26:0/542769905 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d5c074ea0 con 0x7f5d5c09d6f0 2023-10-01T08:01:05.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.518+0000 7f5d4affd700 1 -- 172.21.15.26:0/542769905 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5d4c013b90 con 0x7f5d5c09d6f0 2023-10-01T08:01:05.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.518+0000 7f5d4affd700 1 -- 172.21.15.26:0/542769905 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5d4c03ff80 con 0x7f5d5c09d6f0 2023-10-01T08:01:05.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.519+0000 7f5dcac44700 1 -- 172.21.15.26:0/3611047995 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5dc4074ea0 con 0x7f5dc409e410 2023-10-01T08:01:05.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.522+0000 7f5dc17fa700 1 -- 172.21.15.26:0/3611047995 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5dbc012930 con 0x7f5dc409e410 2023-10-01T08:01:05.523 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:05.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.522+0000 7f5d4affd700 1 -- 172.21.15.26:0/542769905 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5d4c026430 con 0x7f5d5c09d6f0 2023-10-01T08:01:05.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.525+0000 7f5dcac44700 1 -- 172.21.15.26:0/3611047995 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5dc409e410 msgr2=0x7f5dc411eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:05.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.525+0000 7f5dcac44700 1 --2- 172.21.15.26:0/3611047995 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5dc409e410 0x7f5dc411eab0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc00efc0 tx=0x7f5dbc00c3a0 comp rx=0 tx=0).stop 2023-10-01T08:01:05.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.525+0000 7f5dcac44700 1 -- 172.21.15.26:0/3611047995 shutdown_connections 2023-10-01T08:01:05.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.525+0000 7f5dcac44700 1 --2- 172.21.15.26:0/3611047995 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5dc409e410 0x7f5dc411eab0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:05.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.525+0000 7f5dcac44700 1 --2- 172.21.15.26:0/3611047995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5dc409d6f0 0x7f5dc411e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:05.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.525+0000 7f5dcac44700 1 --2- 172.21.15.26:0/3611047995 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5dc409e000 0x7f5dc411e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:05.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.525+0000 7f5dcac44700 1 -- 172.21.15.26:0/3611047995 >> 172.21.15.26:0/3611047995 conn(0x7f5dc4066f50 msgr2=0x7f5dc4130a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:05.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.525+0000 7f5dcac44700 1 -- 172.21.15.26:0/3611047995 shutdown_connections 2023-10-01T08:01:05.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.525+0000 7f5dcac44700 1 -- 172.21.15.26:0/3611047995 wait complete. 2023-10-01T08:01:05.540 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:05.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.689+0000 7fa4e6789700 1 -- 172.21.15.26:0/1450911584 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa4e0072840 con 0x7fa4e009f330 2023-10-01T08:01:05.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.689+0000 7fa4dcff9700 1 -- 172.21.15.26:0/1450911584 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa4d4017070 con 0x7fa4e009f330 2023-10-01T08:01:05.691 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:05.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.692+0000 7fa4e6789700 1 -- 172.21.15.26:0/1450911584 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa4e009f330 msgr2=0x7fa4e011efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:05.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.692+0000 7fa4e6789700 1 --2- 172.21.15.26:0/1450911584 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa4e009f330 0x7fa4e011efa0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fa4d400ebe0 tx=0x7fa4d400eef0 comp rx=0 tx=0).stop 2023-10-01T08:01:05.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.692+0000 7fa4e6789700 1 -- 172.21.15.26:0/1450911584 shutdown_connections 2023-10-01T08:01:05.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.692+0000 7fa4e6789700 1 --2- 172.21.15.26:0/1450911584 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa4e0139370 0x7fa4e011f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:05.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.692+0000 7fa4e6789700 1 --2- 172.21.15.26:0/1450911584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4e009e850 0x7fa4e011ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:05.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.692+0000 7fa4e6789700 1 --2- 172.21.15.26:0/1450911584 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa4e009f330 0x7fa4e011efa0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:05.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.692+0000 7fa4e6789700 1 -- 172.21.15.26:0/1450911584 >> 172.21.15.26:0/1450911584 conn(0x7fa4e00a3f70 msgr2=0x7fa4e0138320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:05.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.692+0000 7fa4e6789700 1 -- 172.21.15.26:0/1450911584 shutdown_connections 2023-10-01T08:01:05.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.692+0000 7fa4e6789700 1 -- 172.21.15.26:0/1450911584 wait complete. 2023-10-01T08:01:05.706 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:05.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.729+0000 7f5d60f1c700 1 -- 172.21.15.26:0/542769905 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5d5c09f420 con 0x7f5d5c09d6f0 2023-10-01T08:01:05.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.729+0000 7f5d4affd700 1 -- 172.21.15.26:0/542769905 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5d4c021070 con 0x7f5d5c09d6f0 2023-10-01T08:01:05.730 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:05.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.731+0000 7f5d60f1c700 1 -- 172.21.15.26:0/542769905 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5d5c09d6f0 msgr2=0x7f5d5c1a5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:05.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.731+0000 7f5d60f1c700 1 --2- 172.21.15.26:0/542769905 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5d5c09d6f0 0x7f5d5c1a5ed0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c00e940 tx=0x7f5d4c00ec50 comp rx=0 tx=0).stop 2023-10-01T08:01:05.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.731+0000 7f5d60f1c700 1 -- 172.21.15.26:0/542769905 shutdown_connections 2023-10-01T08:01:05.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.731+0000 7f5d60f1c700 1 --2- 172.21.15.26:0/542769905 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5d5c09e440 0x7f5d5c1a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:05.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.731+0000 7f5d60f1c700 1 --2- 172.21.15.26:0/542769905 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5d5c09d6f0 0x7f5d5c1a5ed0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:05.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.731+0000 7f5d60f1c700 1 --2- 172.21.15.26:0/542769905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d5c09e000 0x7f5d5c1a6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:05.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.731+0000 7f5d60f1c700 1 -- 172.21.15.26:0/542769905 >> 172.21.15.26:0/542769905 conn(0x7f5d5c066f50 msgr2=0x7f5d5c1baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:05.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.732+0000 7f5d60f1c700 1 -- 172.21.15.26:0/542769905 shutdown_connections 2023-10-01T08:01:05.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:05.732+0000 7f5d60f1c700 1 -- 172.21.15.26:0/542769905 wait complete. 2023-10-01T08:01:05.746 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:06.114 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:06.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.262+0000 7f51644d7700 1 Processor -- start 2023-10-01T08:01:06.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.262+0000 7f51644d7700 1 -- start start 2023-10-01T08:01:06.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.263+0000 7f51644d7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f515c09f410 0x7f515c136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:06.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.263+0000 7f51644d7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f515c136fe0 0x7f515c1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:06.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.263+0000 7f51644d7700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f515c070940 con 0x7f515c09e930 2023-10-01T08:01:06.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.263+0000 7f51644d7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f515c06fd60 con 0x7f515c09f410 2023-10-01T08:01:06.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.263+0000 7f51644d7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f515c06fa80 con 0x7f515c136fe0 2023-10-01T08:01:06.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.263+0000 7f5161a72700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f515c09f410 0x7f515c136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:06.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.263+0000 7f5162a74700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f515c136fe0 0x7f515c1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:06.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.263+0000 7f5161a72700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f515c09f410 0x7f515c136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55078/0 (socket says 172.21.15.26:55078) 2023-10-01T08:01:06.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.263+0000 7f5162a74700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f515c136fe0 0x7f515c1393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51286/0 (socket says 172.21.15.26:51286) 2023-10-01T08:01:06.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.263+0000 7f5161a72700 1 -- 172.21.15.26:0/2025542898 learned_addr learned my addr 172.21.15.26:0/2025542898 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:06.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.263+0000 7f5162273700 1 --1- 172.21.15.26:0/2025542898 >> v1:172.21.15.26:6789/0 conn(0x7f515c09e930 0x7f515c09ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49266/0 (socket says 172.21.15.26:49266) 2023-10-01T08:01:06.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.264+0000 7f5161a72700 1 -- 172.21.15.26:0/2025542898 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f515c136fe0 msgr2=0x7f515c1393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:06.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.264+0000 7f5161a72700 1 --2- 172.21.15.26:0/2025542898 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f515c136fe0 0x7f515c1393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:06.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.264+0000 7f5161a72700 1 -- 172.21.15.26:0/2025542898 >> v1:172.21.15.26:6789/0 conn(0x7f515c09e930 legacy=0x7f515c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:06.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.264+0000 7f5161a72700 1 -- 172.21.15.26:0/2025542898 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515c09fb60 con 0x7f515c09f410 2023-10-01T08:01:06.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.264+0000 7f5162a74700 1 --2- 172.21.15.26:0/2025542898 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f515c136fe0 0x7f515c1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:06.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.264+0000 7f5161a72700 1 --2- 172.21.15.26:0/2025542898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f515c09f410 0x7f515c136aa0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f51500098f0 tx=0x7f5150009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=433ef894a969e90 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:06.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.264+0000 7f5161271700 1 -- 172.21.15.26:0/2025542898 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5150011830 con 0x7f515c09f410 2023-10-01T08:01:06.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.264+0000 7f5161271700 1 -- 172.21.15.26:0/2025542898 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5150011990 con 0x7f515c09f410 2023-10-01T08:01:06.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.264+0000 7f5161271700 1 -- 172.21.15.26:0/2025542898 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5150011d20 con 0x7f515c09f410 2023-10-01T08:01:06.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.264+0000 7f51644d7700 1 -- 172.21.15.26:0/2025542898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f515c09f410 msgr2=0x7f515c136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:06.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.264+0000 7f51644d7700 1 --2- 172.21.15.26:0/2025542898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f515c09f410 0x7f515c136aa0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f51500098f0 tx=0x7f5150009c00 comp rx=0 tx=0).stop 2023-10-01T08:01:06.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.265+0000 7f51644d7700 1 -- 172.21.15.26:0/2025542898 shutdown_connections 2023-10-01T08:01:06.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.265+0000 7f51644d7700 1 --2- 172.21.15.26:0/2025542898 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f515c136fe0 0x7f515c1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:06.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.265+0000 7f51644d7700 1 --2- 172.21.15.26:0/2025542898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f515c09f410 0x7f515c136aa0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:06.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.265+0000 7f51644d7700 1 -- 172.21.15.26:0/2025542898 >> 172.21.15.26:0/2025542898 conn(0x7f515c0a4210 msgr2=0x7f515c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:06.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.265+0000 7f51644d7700 1 -- 172.21.15.26:0/2025542898 shutdown_connections 2023-10-01T08:01:06.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.265+0000 7f51644d7700 1 -- 172.21.15.26:0/2025542898 wait complete. 2023-10-01T08:01:06.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.266+0000 7f51644d7700 1 Processor -- start 2023-10-01T08:01:06.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.266+0000 7f51644d7700 1 -- start start 2023-10-01T08:01:06.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.267+0000 7f51644d7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f515c09e930 0x7f515c11c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:06.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.267+0000 7f51644d7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f515c09f410 0x7f515c11cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:06.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.267+0000 7f51644d7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f515c136fe0 0x7f515c11d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:06.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.267+0000 7f51644d7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515c071d20 con 0x7f515c09e930 2023-10-01T08:01:06.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.267+0000 7f51644d7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f515c0a2f40 con 0x7f515c09f410 2023-10-01T08:01:06.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.267+0000 7f51644d7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f515c11e2e0 con 0x7f515c136fe0 2023-10-01T08:01:06.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.267+0000 7f5162273700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f515c09e930 0x7f515c11c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:06.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.267+0000 7f5161a72700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f515c09f410 0x7f515c11cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:06.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.267+0000 7f5162273700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f515c09e930 0x7f515c11c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55088/0 (socket says 172.21.15.26:55088) 2023-10-01T08:01:06.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.267+0000 7f5162273700 1 -- 172.21.15.26:0/3236468535 learned_addr learned my addr 172.21.15.26:0/3236468535 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:06.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.267+0000 7f5162a74700 1 --2- 172.21.15.26:0/3236468535 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f515c136fe0 0x7f515c11d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:06.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.267+0000 7f5161a72700 1 -- 172.21.15.26:0/3236468535 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f515c136fe0 msgr2=0x7f515c11d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:06.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.267+0000 7f5161a72700 1 --2- 172.21.15.26:0/3236468535 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f515c136fe0 0x7f515c11d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:06.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.267+0000 7f5161a72700 1 -- 172.21.15.26:0/3236468535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f515c09e930 msgr2=0x7f515c11c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:06.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.267+0000 7f5161a72700 1 --2- 172.21.15.26:0/3236468535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f515c09e930 0x7f515c11c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:06.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.267+0000 7f5161a72700 1 -- 172.21.15.26:0/3236468535 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5154009a70 con 0x7f515c09f410 2023-10-01T08:01:06.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.267+0000 7f5162273700 1 --2- 172.21.15.26:0/3236468535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f515c09e930 0x7f515c11c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:06.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.267+0000 7f5161a72700 1 --2- 172.21.15.26:0/3236468535 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f515c09f410 0x7f515c11cb70 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f5150016000 tx=0x7f5150004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:06.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.268+0000 7f514effd700 1 -- 172.21.15.26:0/3236468535 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51500045d0 con 0x7f515c09f410 2023-10-01T08:01:06.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.268+0000 7f514effd700 1 -- 172.21.15.26:0/3236468535 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f515001f070 con 0x7f515c09f410 2023-10-01T08:01:06.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.268+0000 7f51644d7700 1 -- 172.21.15.26:0/3236468535 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5150009550 con 0x7f515c09f410 2023-10-01T08:01:06.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.268+0000 7f514effd700 1 -- 172.21.15.26:0/3236468535 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51500038e0 con 0x7f515c09f410 2023-10-01T08:01:06.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.268+0000 7f51644d7700 1 -- 172.21.15.26:0/3236468535 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f515c11fe70 con 0x7f515c09f410 2023-10-01T08:01:06.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.268+0000 7f514effd700 1 -- 172.21.15.26:0/3236468535 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5150003b00 con 0x7f515c09f410 2023-10-01T08:01:06.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.269+0000 7f514effd700 1 -- 172.21.15.26:0/3236468535 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5150021070 con 0x7f515c09f410 2023-10-01T08:01:06.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.269+0000 7f51644d7700 1 -- 172.21.15.26:0/3236468535 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f515c074ea0 con 0x7f515c09f410 2023-10-01T08:01:06.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.274+0000 7f514effd700 1 -- 172.21.15.26:0/3236468535 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5150015020 con 0x7f515c09f410 2023-10-01T08:01:06.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.479+0000 7f51644d7700 1 -- 172.21.15.26:0/3236468535 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f515c06b250 con 0x7f515c09f410 2023-10-01T08:01:06.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.479+0000 7f514effd700 1 -- 172.21.15.26:0/3236468535 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5150034070 con 0x7f515c09f410 2023-10-01T08:01:06.480 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:06.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.482+0000 7f51644d7700 1 -- 172.21.15.26:0/3236468535 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f515c09f410 msgr2=0x7f515c11cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:06.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.482+0000 7f51644d7700 1 --2- 172.21.15.26:0/3236468535 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f515c09f410 0x7f515c11cb70 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f5150016000 tx=0x7f5150004750 comp rx=0 tx=0).stop 2023-10-01T08:01:06.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.482+0000 7f51644d7700 1 -- 172.21.15.26:0/3236468535 shutdown_connections 2023-10-01T08:01:06.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.482+0000 7f51644d7700 1 --2- 172.21.15.26:0/3236468535 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f515c136fe0 0x7f515c11d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:06.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.482+0000 7f51644d7700 1 --2- 172.21.15.26:0/3236468535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f515c09e930 0x7f515c11c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:06.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.482+0000 7f51644d7700 1 --2- 172.21.15.26:0/3236468535 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f515c09f410 0x7f515c11cb70 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:06.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.482+0000 7f51644d7700 1 -- 172.21.15.26:0/3236468535 >> 172.21.15.26:0/3236468535 conn(0x7f515c0a4210 msgr2=0x7f515c0a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:06.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.482+0000 7f51644d7700 1 -- 172.21.15.26:0/3236468535 shutdown_connections 2023-10-01T08:01:06.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.482+0000 7f51644d7700 1 -- 172.21.15.26:0/3236468535 wait complete. 2023-10-01T08:01:06.496 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:06.542 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:06.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.681+0000 7f8125847700 1 Processor -- start 2023-10-01T08:01:06.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.682+0000 7f8125847700 1 -- start start 2023-10-01T08:01:06.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.682+0000 7f8125847700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81200a09c0 0x7f81200a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:06.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.682+0000 7f8125847700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f812009d5c0 0x7f81200a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:06.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.682+0000 7f8125847700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81200a1810 con 0x7f8120133920 2023-10-01T08:01:06.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.682+0000 7f8125847700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812009ea10 con 0x7f81200a09c0 2023-10-01T08:01:06.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.682+0000 7f8125847700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f812009e210 con 0x7f812009d5c0 2023-10-01T08:01:06.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.682+0000 7f811e7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f812009d5c0 0x7f81200a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:06.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.682+0000 7f811effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81200a09c0 0x7f81200a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:06.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.682+0000 7f811f7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8120133920 0x7f8120133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49274/0 (socket says 172.21.15.26:49274) 2023-10-01T08:01:06.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.682+0000 7f811f7fe700 1 -- 172.21.15.26:0/774626862 learned_addr learned my addr 172.21.15.26:0/774626862 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:01:06.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.683+0000 7f811effd700 1 -- 172.21.15.26:0/774626862 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f812009d5c0 msgr2=0x7f81200a12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:06.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.683+0000 7f811effd700 1 --2- 172.21.15.26:0/774626862 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f812009d5c0 0x7f81200a12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:06.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.683+0000 7f811dffb700 1 -- 172.21.15.26:0/774626862 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2383500030 0 0) 0x7f81200a1810 con 0x7f8120133920 2023-10-01T08:01:06.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.683+0000 7f811effd700 1 -- 172.21.15.26:0/774626862 >> v1:172.21.15.26:6789/0 conn(0x7f8120133920 legacy=0x7f8120133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:06.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.683+0000 7f811effd700 1 -- 172.21.15.26:0/774626862 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81200a26f0 con 0x7f81200a09c0 2023-10-01T08:01:06.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.683+0000 7f811e7fc700 1 --2- 172.21.15.26:0/774626862 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f812009d5c0 0x7f81200a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:06.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.683+0000 7f811effd700 1 --2- 172.21.15.26:0/774626862 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81200a09c0 0x7f81200a0d90 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f8110009870 tx=0x7f8110009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32599b3068516477 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:06.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.683+0000 7f811dffb700 1 -- 172.21.15.26:0/774626862 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8110011830 con 0x7f81200a09c0 2023-10-01T08:01:06.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.683+0000 7f811dffb700 1 -- 172.21.15.26:0/774626862 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8110011990 con 0x7f81200a09c0 2023-10-01T08:01:06.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.683+0000 7f811dffb700 1 -- 172.21.15.26:0/774626862 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8110011d20 con 0x7f81200a09c0 2023-10-01T08:01:06.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.684+0000 7f8125847700 1 -- 172.21.15.26:0/774626862 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81200a09c0 msgr2=0x7f81200a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:06.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.684+0000 7f8125847700 1 --2- 172.21.15.26:0/774626862 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81200a09c0 0x7f81200a0d90 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f8110009870 tx=0x7f8110009b80 comp rx=0 tx=0).stop 2023-10-01T08:01:06.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.684+0000 7f8125847700 1 -- 172.21.15.26:0/774626862 shutdown_connections 2023-10-01T08:01:06.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.684+0000 7f8125847700 1 --2- 172.21.15.26:0/774626862 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81200a09c0 0x7f81200a0d90 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:06.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.684+0000 7f8125847700 1 --2- 172.21.15.26:0/774626862 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f812009d5c0 0x7f81200a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:06.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.684+0000 7f8125847700 1 -- 172.21.15.26:0/774626862 >> 172.21.15.26:0/774626862 conn(0x7f81200a2fe0 msgr2=0x7f81200a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:06.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.684+0000 7f8125847700 1 -- 172.21.15.26:0/774626862 shutdown_connections 2023-10-01T08:01:06.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.684+0000 7f8125847700 1 -- 172.21.15.26:0/774626862 wait complete. 2023-10-01T08:01:06.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.685+0000 7f8125847700 1 Processor -- start 2023-10-01T08:01:06.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.685+0000 7f8125847700 1 -- start start 2023-10-01T08:01:06.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.686+0000 7f8125847700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f812009d5c0 0x7f812011ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:06.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.686+0000 7f8125847700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81200a09c0 0x7f812011f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:06.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.686+0000 7f8125847700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8120133920 0x7f812011f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:06.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.686+0000 7f8125847700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8120120720 con 0x7f8120133920 2023-10-01T08:01:06.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.686+0000 7f8125847700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81200a5850 con 0x7f81200a09c0 2023-10-01T08:01:06.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.686+0000 7f8125847700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f812009cec0 con 0x7f812009d5c0 2023-10-01T08:01:06.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.686+0000 7f811effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f812009d5c0 0x7f812011ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:06.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.686+0000 7f811e7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81200a09c0 0x7f812011f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:06.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.686+0000 7f811effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f812009d5c0 0x7f812011ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56848/0 (socket says 172.21.15.26:56848) 2023-10-01T08:01:06.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.686+0000 7f811effd700 1 -- 172.21.15.26:0/4003791990 learned_addr learned my addr 172.21.15.26:0/4003791990 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:06.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.686+0000 7f811f7fe700 1 --2- 172.21.15.26:0/4003791990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8120133920 0x7f812011f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:06.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.687+0000 7f811e7fc700 1 -- 172.21.15.26:0/4003791990 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f812009d5c0 msgr2=0x7f812011ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:06.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.687+0000 7f811e7fc700 1 --2- 172.21.15.26:0/4003791990 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f812009d5c0 0x7f812011ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:06.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.687+0000 7f811e7fc700 1 -- 172.21.15.26:0/4003791990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8120133920 msgr2=0x7f812011f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:06.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.687+0000 7f811e7fc700 1 --2- 172.21.15.26:0/4003791990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8120133920 0x7f812011f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:06.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.687+0000 7f811e7fc700 1 -- 172.21.15.26:0/4003791990 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81140094a0 con 0x7f81200a09c0 2023-10-01T08:01:06.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.687+0000 7f811effd700 1 --2- 172.21.15.26:0/4003791990 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f812009d5c0 0x7f812011ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:06.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.687+0000 7f811f7fe700 1 --2- 172.21.15.26:0/4003791990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8120133920 0x7f812011f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:06.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.687+0000 7f811e7fc700 1 --2- 172.21.15.26:0/4003791990 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81200a09c0 0x7f812011f200 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f811400e980 tx=0x7f811400ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:06.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.687+0000 7f8107fff700 1 -- 172.21.15.26:0/4003791990 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811400c690 con 0x7f81200a09c0 2023-10-01T08:01:06.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.687+0000 7f8107fff700 1 -- 172.21.15.26:0/4003791990 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811400c7f0 con 0x7f81200a09c0 2023-10-01T08:01:06.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.687+0000 7f8125847700 1 -- 172.21.15.26:0/4003791990 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81100094a0 con 0x7f81200a09c0 2023-10-01T08:01:06.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.687+0000 7f8107fff700 1 -- 172.21.15.26:0/4003791990 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811400cb80 con 0x7f81200a09c0 2023-10-01T08:01:06.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.687+0000 7f8125847700 1 -- 172.21.15.26:0/4003791990 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8120122e30 con 0x7f81200a09c0 2023-10-01T08:01:06.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.688+0000 7f8107fff700 1 -- 172.21.15.26:0/4003791990 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f811400cce0 con 0x7f81200a09c0 2023-10-01T08:01:06.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.688+0000 7f8107fff700 1 -- 172.21.15.26:0/4003791990 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f811403f740 con 0x7f81200a09c0 2023-10-01T08:01:06.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.688+0000 7f8125847700 1 -- 172.21.15.26:0/4003791990 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81200747f0 con 0x7f81200a09c0 2023-10-01T08:01:06.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.693+0000 7f8107fff700 1 -- 172.21.15.26:0/4003791990 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8114017020 con 0x7f81200a09c0 2023-10-01T08:01:06.707 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:06.746 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:06.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.849+0000 7fc97de2b700 1 Processor -- start 2023-10-01T08:01:06.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.849+0000 7fc97de2b700 1 -- start start 2023-10-01T08:01:06.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.850+0000 7fc97de2b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc97809e930 0x7fc97809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:06.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.850+0000 7fc97de2b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc97809f650 0x7fc978131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:06.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.850+0000 7fc97de2b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc978070940 con 0x7fc97809f240 2023-10-01T08:01:06.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.850+0000 7fc97de2b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc97806fd60 con 0x7fc97809f650 2023-10-01T08:01:06.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.850+0000 7fc97de2b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97806fa80 con 0x7fc97809e930 2023-10-01T08:01:06.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.850+0000 7fc9777fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc97809e930 0x7fc97809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:06.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.850+0000 7fc977fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc97809f650 0x7fc978131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:06.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.850+0000 7fc9777fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc97809e930 0x7fc97809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51330/0 (socket says 172.21.15.26:51330) 2023-10-01T08:01:06.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.850+0000 7fc9777fe700 1 -- 172.21.15.26:0/1570848094 learned_addr learned my addr 172.21.15.26:0/1570848094 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:06.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.850+0000 7fc977fff700 1 -- 172.21.15.26:0/1570848094 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc97809e930 msgr2=0x7fc97809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:06.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.850+0000 7fc977fff700 1 --2- 172.21.15.26:0/1570848094 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc97809e930 0x7fc97809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:06.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.850+0000 7fc977fff700 1 -- 172.21.15.26:0/1570848094 >> v1:172.21.15.26:6789/0 conn(0x7fc97809f240 legacy=0x7fc9781317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:06.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.850+0000 7fc977fff700 1 -- 172.21.15.26:0/1570848094 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97809fb60 con 0x7fc97809f650 2023-10-01T08:01:06.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.850+0000 7fc9777fe700 1 --2- 172.21.15.26:0/1570848094 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc97809e930 0x7fc97809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:06.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.851+0000 7fc977fff700 1 --2- 172.21.15.26:0/1570848094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc97809f650 0x7fc978131f00 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fc97000f370 tx=0x7fc97000f680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=532b2b21218db672 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:06.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.851+0000 7fc9767fc700 1 -- 172.21.15.26:0/1570848094 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc970012070 con 0x7fc97809f650 2023-10-01T08:01:06.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.851+0000 7fc9767fc700 1 -- 172.21.15.26:0/1570848094 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97000fe70 con 0x7fc97809f650 2023-10-01T08:01:06.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.851+0000 7fc9767fc700 1 -- 172.21.15.26:0/1570848094 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97000d2f0 con 0x7fc97809f650 2023-10-01T08:01:06.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.851+0000 7fc97de2b700 1 -- 172.21.15.26:0/1570848094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc97809f650 msgr2=0x7fc978131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:06.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.851+0000 7fc97de2b700 1 --2- 172.21.15.26:0/1570848094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc97809f650 0x7fc978131f00 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fc97000f370 tx=0x7fc97000f680 comp rx=0 tx=0).stop 2023-10-01T08:01:06.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.851+0000 7fc97de2b700 1 -- 172.21.15.26:0/1570848094 shutdown_connections 2023-10-01T08:01:06.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.851+0000 7fc97de2b700 1 --2- 172.21.15.26:0/1570848094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc97809f650 0x7fc978131f00 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:06.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.851+0000 7fc97de2b700 1 --2- 172.21.15.26:0/1570848094 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc97809e930 0x7fc97809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:06.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.851+0000 7fc97de2b700 1 -- 172.21.15.26:0/1570848094 >> 172.21.15.26:0/1570848094 conn(0x7fc9780a4210 msgr2=0x7fc9780a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:06.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.852+0000 7fc97de2b700 1 -- 172.21.15.26:0/1570848094 shutdown_connections 2023-10-01T08:01:06.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.852+0000 7fc97de2b700 1 -- 172.21.15.26:0/1570848094 wait complete. 2023-10-01T08:01:06.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.852+0000 7fc97de2b700 1 Processor -- start 2023-10-01T08:01:06.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.853+0000 7fc97de2b700 1 -- start start 2023-10-01T08:01:06.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.853+0000 7fc97de2b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc97809e930 0x7fc9781a1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:06.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.853+0000 7fc97de2b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc97809f240 0x7fc9781a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:06.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.853+0000 7fc97de2b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc97809f650 0x7fc9781c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:06.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.853+0000 7fc97de2b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9781a3f10 con 0x7fc97809f240 2023-10-01T08:01:06.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.853+0000 7fc97de2b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9781a40f0 con 0x7fc97809f650 2023-10-01T08:01:06.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.853+0000 7fc97de2b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9781b4f60 con 0x7fc97809e930 2023-10-01T08:01:06.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.853+0000 7fc976ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc97809f240 0x7fc9781a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:06.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.853+0000 7fc977fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc97809f650 0x7fc9781c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:06.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.853+0000 7fc976ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc97809f240 0x7fc9781a1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55120/0 (socket says 172.21.15.26:55120) 2023-10-01T08:01:06.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.853+0000 7fc976ffd700 1 -- 172.21.15.26:0/3977663721 learned_addr learned my addr 172.21.15.26:0/3977663721 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:06.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.854+0000 7fc9777fe700 1 --2- 172.21.15.26:0/3977663721 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc97809e930 0x7fc9781a1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:06.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.854+0000 7fc976ffd700 1 -- 172.21.15.26:0/3977663721 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc97809e930 msgr2=0x7fc9781a1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:06.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.854+0000 7fc976ffd700 1 --2- 172.21.15.26:0/3977663721 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc97809e930 0x7fc9781a1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:06.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.854+0000 7fc976ffd700 1 -- 172.21.15.26:0/3977663721 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc97809f650 msgr2=0x7fc9781c3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:06.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.854+0000 7fc976ffd700 1 --2- 172.21.15.26:0/3977663721 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc97809f650 0x7fc9781c3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:06.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.854+0000 7fc976ffd700 1 -- 172.21.15.26:0/3977663721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc968009550 con 0x7fc97809f240 2023-10-01T08:01:06.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.854+0000 7fc977fff700 1 --2- 172.21.15.26:0/3977663721 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc97809f650 0x7fc9781c3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:06.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.854+0000 7fc976ffd700 1 --2- 172.21.15.26:0/3977663721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc97809f240 0x7fc9781a1570 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7fc96c00c4e0 tx=0x7fc96c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:06.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.854+0000 7fc95ffff700 1 -- 172.21.15.26:0/3977663721 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c0052d0 con 0x7fc97809f240 2023-10-01T08:01:06.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.854+0000 7fc95ffff700 1 -- 172.21.15.26:0/3977663721 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96c005430 con 0x7fc97809f240 2023-10-01T08:01:06.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.854+0000 7fc95ffff700 1 -- 172.21.15.26:0/3977663721 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c0038a0 con 0x7fc97809f240 2023-10-01T08:01:06.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.854+0000 7fc97de2b700 1 -- 172.21.15.26:0/3977663721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc97000f050 con 0x7fc97809f240 2023-10-01T08:01:06.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.854+0000 7fc97de2b700 1 -- 172.21.15.26:0/3977663721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9780a0190 con 0x7fc97809f240 2023-10-01T08:01:06.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.855+0000 7fc95ffff700 1 -- 172.21.15.26:0/3977663721 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc96c003a00 con 0x7fc97809f240 2023-10-01T08:01:06.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.855+0000 7fc95ffff700 1 -- 172.21.15.26:0/3977663721 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc96c03ea20 con 0x7fc97809f240 2023-10-01T08:01:06.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.856+0000 7fc97de2b700 1 -- 172.21.15.26:0/3977663721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9781a1ab0 con 0x7fc97809f240 2023-10-01T08:01:06.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.861+0000 7fc95ffff700 1 -- 172.21.15.26:0/3977663721 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc96c017080 con 0x7fc97809f240 2023-10-01T08:01:06.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.891+0000 7f4c5f029700 1 Processor -- start 2023-10-01T08:01:06.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.891+0000 7f4c5f029700 1 -- start start 2023-10-01T08:01:06.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.891+0000 7f4c5f029700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c580a0a30 0x7f4c580a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:06.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.891+0000 7f4c5f029700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4c5809d630 0x7f4c580a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:06.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.891+0000 7f4c5f029700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c58133930 0x7f4c58133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:06.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.891+0000 7f4c5f029700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c580a2a70 con 0x7f4c5809d630 2023-10-01T08:01:06.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.891+0000 7f4c5f029700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c580a01d0 con 0x7f4c580a0a30 2023-10-01T08:01:06.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.891+0000 7f4c5f029700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5809e2b0 con 0x7f4c58133930 2023-10-01T08:01:06.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.891+0000 7f4c5d5c6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c58133930 0x7f4c58133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:06.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.891+0000 7f4c4ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4c5809d630 0x7f4c580a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:06.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.891+0000 7f4c5d5c6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c58133930 0x7f4c58133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56862/0 (socket says 172.21.15.26:56862) 2023-10-01T08:01:06.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.891+0000 7f4c4ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4c5809d630 0x7f4c580a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55126/0 (socket says 172.21.15.26:55126) 2023-10-01T08:01:06.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.891+0000 7f4c5d5c6700 1 -- 172.21.15.26:0/3838583092 learned_addr learned my addr 172.21.15.26:0/3838583092 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:06.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.892+0000 7f4c5cdc5700 1 --2- 172.21.15.26:0/3838583092 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c580a0a30 0x7f4c580a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:06.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.892+0000 7f4c5d5c6700 1 -- 172.21.15.26:0/3838583092 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c580a0a30 msgr2=0x7f4c580a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:06.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.892+0000 7f4c5d5c6700 1 --2- 172.21.15.26:0/3838583092 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c580a0a30 0x7f4c580a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:06.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.892+0000 7f4c5d5c6700 1 -- 172.21.15.26:0/3838583092 >> v2:172.21.15.26:3300/0 conn(0x7f4c5809d630 msgr2=0x7f4c580a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:06.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.892+0000 7f4c5d5c6700 1 --2- 172.21.15.26:0/3838583092 >> v2:172.21.15.26:3300/0 conn(0x7f4c5809d630 0x7f4c580a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:06.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.892+0000 7f4c5d5c6700 1 -- 172.21.15.26:0/3838583092 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c5809dc50 con 0x7f4c58133930 2023-10-01T08:01:06.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.892+0000 7f4c4ffff700 1 --2- 172.21.15.26:0/3838583092 >> v2:172.21.15.26:3300/0 conn(0x7f4c5809d630 0x7f4c580a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:06.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.892+0000 7f4c5d5c6700 1 --2- 172.21.15.26:0/3838583092 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c58133930 0x7f4c58133dd0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f4c50009e50 tx=0x7f4c5000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c1c8571d88f87 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:06.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.892+0000 7f4c4f7fe700 1 -- 172.21.15.26:0/3838583092 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5000e070 con 0x7f4c58133930 2023-10-01T08:01:06.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.892+0000 7f4c4f7fe700 1 -- 172.21.15.26:0/3838583092 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5000b910 con 0x7f4c58133930 2023-10-01T08:01:06.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.892+0000 7f4c4f7fe700 1 -- 172.21.15.26:0/3838583092 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5000bcc0 con 0x7f4c58133930 2023-10-01T08:01:06.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.893+0000 7f4c5f029700 1 -- 172.21.15.26:0/3838583092 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c58133930 msgr2=0x7f4c58133dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:06.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.893+0000 7f4c5f029700 1 --2- 172.21.15.26:0/3838583092 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c58133930 0x7f4c58133dd0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f4c50009e50 tx=0x7f4c5000b330 comp rx=0 tx=0).stop 2023-10-01T08:01:06.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.893+0000 7f4c5f029700 1 -- 172.21.15.26:0/3838583092 shutdown_connections 2023-10-01T08:01:06.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.893+0000 7f4c5f029700 1 --2- 172.21.15.26:0/3838583092 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c58133930 0x7f4c58133dd0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:06.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.893+0000 7f4c5f029700 1 --2- 172.21.15.26:0/3838583092 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c580a0a30 0x7f4c580a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:06.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.893+0000 7f4c5f029700 1 --2- 172.21.15.26:0/3838583092 >> v2:172.21.15.26:3300/0 conn(0x7f4c5809d630 0x7f4c580a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:06.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.893+0000 7f4c5f029700 1 -- 172.21.15.26:0/3838583092 >> 172.21.15.26:0/3838583092 conn(0x7f4c580a3050 msgr2=0x7f4c580a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:06.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.893+0000 7f4c5f029700 1 -- 172.21.15.26:0/3838583092 shutdown_connections 2023-10-01T08:01:06.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.893+0000 7f4c5f029700 1 -- 172.21.15.26:0/3838583092 wait complete. 2023-10-01T08:01:06.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.894+0000 7f4c5f029700 1 Processor -- start 2023-10-01T08:01:06.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.894+0000 7f4c5f029700 1 -- start start 2023-10-01T08:01:06.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.895+0000 7f4c5f029700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c5809d630 0x7f4c58132b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:06.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.895+0000 7f4c5f029700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c580a0a30 0x7f4c58133040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:06.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.895+0000 7f4c5f029700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c58133930 0x7f4c581c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:06.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.895+0000 7f4c5f029700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c581225b0 con 0x7f4c5809d630 2023-10-01T08:01:06.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.895+0000 7f4c5f029700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c580a0410 con 0x7f4c58133930 2023-10-01T08:01:06.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.895+0000 7f4c5f029700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c581208a0 con 0x7f4c580a0a30 2023-10-01T08:01:06.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.895+0000 7f4c4ffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c580a0a30 0x7f4c58133040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:06.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.895+0000 7f4c5d5c6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c58133930 0x7f4c581c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:06.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.895+0000 7f4c4ffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c580a0a30 0x7f4c58133040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56864/0 (socket says 172.21.15.26:56864) 2023-10-01T08:01:06.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.895+0000 7f4c5d5c6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c58133930 0x7f4c581c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51340/0 (socket says 172.21.15.26:51340) 2023-10-01T08:01:06.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.895+0000 7f4c4ffff700 1 -- 172.21.15.26:0/2539135329 learned_addr learned my addr 172.21.15.26:0/2539135329 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:06.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.895+0000 7f4c5cdc5700 1 --2- 172.21.15.26:0/2539135329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c5809d630 0x7f4c58132b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:06.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.895+0000 7f4c4ffff700 1 -- 172.21.15.26:0/2539135329 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c58133930 msgr2=0x7f4c581c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:06.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.895+0000 7f4c4ffff700 1 --2- 172.21.15.26:0/2539135329 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c58133930 0x7f4c581c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:06.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.895+0000 7f4c4ffff700 1 -- 172.21.15.26:0/2539135329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c5809d630 msgr2=0x7f4c58132b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:06.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.895+0000 7f4c4ffff700 1 --2- 172.21.15.26:0/2539135329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c5809d630 0x7f4c58132b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:06.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.895+0000 7f4c4ffff700 1 -- 172.21.15.26:0/2539135329 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c480094a0 con 0x7f4c580a0a30 2023-10-01T08:01:06.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.895+0000 7f4c5cdc5700 1 --2- 172.21.15.26:0/2539135329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c5809d630 0x7f4c58132b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:06.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.896+0000 7f4c4ffff700 1 --2- 172.21.15.26:0/2539135329 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c580a0a30 0x7f4c58133040 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f4c4800ebe0 tx=0x7f4c4800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:06.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.896+0000 7f4c4d7fa700 1 -- 172.21.15.26:0/2539135329 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4800c850 con 0x7f4c580a0a30 2023-10-01T08:01:06.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.896+0000 7f4c4d7fa700 1 -- 172.21.15.26:0/2539135329 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4800c9b0 con 0x7f4c580a0a30 2023-10-01T08:01:06.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.896+0000 7f4c5f029700 1 -- 172.21.15.26:0/2539135329 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c50009b30 con 0x7f4c580a0a30 2023-10-01T08:01:06.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.896+0000 7f4c4d7fa700 1 -- 172.21.15.26:0/2539135329 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4800cd40 con 0x7f4c580a0a30 2023-10-01T08:01:06.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.896+0000 7f4c5f029700 1 -- 172.21.15.26:0/2539135329 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c581218b0 con 0x7f4c580a0a30 2023-10-01T08:01:06.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.897+0000 7f4c4d7fa700 1 -- 172.21.15.26:0/2539135329 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4c48013470 con 0x7f4c580a0a30 2023-10-01T08:01:06.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.897+0000 7f4c4d7fa700 1 -- 172.21.15.26:0/2539135329 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4c4803f770 con 0x7f4c580a0a30 2023-10-01T08:01:06.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.897+0000 7f4c5f029700 1 -- 172.21.15.26:0/2539135329 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c58122270 con 0x7f4c580a0a30 2023-10-01T08:01:06.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.902+0000 7f4c4d7fa700 1 -- 172.21.15.26:0/2539135329 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4c58122270 con 0x7f4c580a0a30 2023-10-01T08:01:06.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.910+0000 7f8125847700 1 -- 172.21.15.26:0/4003791990 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8120122160 con 0x7f81200a09c0 2023-10-01T08:01:06.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.910+0000 7f8107fff700 1 -- 172.21.15.26:0/4003791990 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8120122160 con 0x7f81200a09c0 2023-10-01T08:01:06.911 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:06.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.913+0000 7f8125847700 1 -- 172.21.15.26:0/4003791990 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81200a09c0 msgr2=0x7f812011f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:06.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.913+0000 7f8125847700 1 --2- 172.21.15.26:0/4003791990 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81200a09c0 0x7f812011f200 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f811400e980 tx=0x7f811400ec90 comp rx=0 tx=0).stop 2023-10-01T08:01:06.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.913+0000 7f8125847700 1 -- 172.21.15.26:0/4003791990 shutdown_connections 2023-10-01T08:01:06.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.913+0000 7f8125847700 1 --2- 172.21.15.26:0/4003791990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8120133920 0x7f812011f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:06.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.913+0000 7f8125847700 1 --2- 172.21.15.26:0/4003791990 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f812009d5c0 0x7f812011ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:06.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.913+0000 7f8125847700 1 --2- 172.21.15.26:0/4003791990 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81200a09c0 0x7f812011f200 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:06.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.913+0000 7f8125847700 1 -- 172.21.15.26:0/4003791990 >> 172.21.15.26:0/4003791990 conn(0x7f81200a2fe0 msgr2=0x7f812009ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:06.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.913+0000 7f8125847700 1 -- 172.21.15.26:0/4003791990 shutdown_connections 2023-10-01T08:01:06.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:06.913+0000 7f8125847700 1 -- 172.21.15.26:0/4003791990 wait complete. 2023-10-01T08:01:06.927 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:07.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.095+0000 7fc97de2b700 1 -- 172.21.15.26:0/3977663721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc97809ffe0 con 0x7fc97809f240 2023-10-01T08:01:07.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.095+0000 7fc95ffff700 1 -- 172.21.15.26:0/3977663721 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc96c018260 con 0x7fc97809f240 2023-10-01T08:01:07.096 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:07.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.097+0000 7fc97de2b700 1 -- 172.21.15.26:0/3977663721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc97809f240 msgr2=0x7fc9781a1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:07.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.097+0000 7fc97de2b700 1 --2- 172.21.15.26:0/3977663721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc97809f240 0x7fc9781a1570 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7fc96c00c4e0 tx=0x7fc96c00c7f0 comp rx=0 tx=0).stop 2023-10-01T08:01:07.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.097+0000 7fc97de2b700 1 -- 172.21.15.26:0/3977663721 shutdown_connections 2023-10-01T08:01:07.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.097+0000 7fc97de2b700 1 --2- 172.21.15.26:0/3977663721 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc97809f650 0x7fc9781c3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:07.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.097+0000 7fc97de2b700 1 --2- 172.21.15.26:0/3977663721 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc97809e930 0x7fc9781a1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:07.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.097+0000 7fc97de2b700 1 --2- 172.21.15.26:0/3977663721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc97809f240 0x7fc9781a1570 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:07.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.097+0000 7fc97de2b700 1 -- 172.21.15.26:0/3977663721 >> 172.21.15.26:0/3977663721 conn(0x7fc9780a4210 msgr2=0x7fc97806c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:07.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.098+0000 7fc97de2b700 1 -- 172.21.15.26:0/3977663721 shutdown_connections 2023-10-01T08:01:07.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.098+0000 7fc97de2b700 1 -- 172.21.15.26:0/3977663721 wait complete. 2023-10-01T08:01:07.112 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:07.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.133+0000 7f4c5f029700 1 -- 172.21.15.26:0/2539135329 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4c58122270 con 0x7f4c580a0a30 2023-10-01T08:01:07.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.133+0000 7f4c4d7fa700 1 -- 172.21.15.26:0/2539135329 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4c58122270 con 0x7f4c580a0a30 2023-10-01T08:01:07.135 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.136+0000 7f4c5f029700 1 -- 172.21.15.26:0/2539135329 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c580a0a30 msgr2=0x7f4c58133040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.136+0000 7f4c5f029700 1 --2- 172.21.15.26:0/2539135329 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c580a0a30 0x7f4c58133040 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f4c4800ebe0 tx=0x7f4c4800eef0 comp rx=0 tx=0).stop 2023-10-01T08:01:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.136+0000 7f4c5f029700 1 -- 172.21.15.26:0/2539135329 shutdown_connections 2023-10-01T08:01:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.136+0000 7f4c5f029700 1 --2- 172.21.15.26:0/2539135329 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4c58133930 0x7f4c581c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:07.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.136+0000 7f4c5f029700 1 --2- 172.21.15.26:0/2539135329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c5809d630 0x7f4c58132b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:07.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.136+0000 7f4c5f029700 1 --2- 172.21.15.26:0/2539135329 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4c580a0a30 0x7f4c58133040 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:07.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.136+0000 7f4c5f029700 1 -- 172.21.15.26:0/2539135329 >> 172.21.15.26:0/2539135329 conn(0x7f4c580a3050 msgr2=0x7f4c5809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:07.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.136+0000 7f4c5f029700 1 -- 172.21.15.26:0/2539135329 shutdown_connections 2023-10-01T08:01:07.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.136+0000 7f4c5f029700 1 -- 172.21.15.26:0/2539135329 wait complete. 2023-10-01T08:01:07.150 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:07.497 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:07.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.642+0000 7f1015f20700 1 Processor -- start 2023-10-01T08:01:07.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.642+0000 7f1015f20700 1 -- start start 2023-10-01T08:01:07.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.643+0000 7f1015f20700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1010133420 0x7f10101337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:07.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.643+0000 7f1015f20700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1010133e30 0x7f101012ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:07.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.643+0000 7f1015f20700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1010134260 0x7f10101304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:07.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.643+0000 7f1015f20700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f101006b990 con 0x7f1010133420 2023-10-01T08:01:07.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.643+0000 7f1015f20700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10100a0590 con 0x7f1010133e30 2023-10-01T08:01:07.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.643+0000 7f1015f20700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f101009fb80 con 0x7f1010134260 2023-10-01T08:01:07.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.643+0000 7f100f7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1010133420 0x7f10101337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:07.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.643+0000 7f100effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1010133e30 0x7f101012ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:07.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.643+0000 7f100effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1010133e30 0x7f101012ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51348/0 (socket says 172.21.15.26:51348) 2023-10-01T08:01:07.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.643+0000 7f100ffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1010134260 0x7f10101304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:07.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.643+0000 7f100effd700 1 -- 172.21.15.26:0/3178944012 learned_addr learned my addr 172.21.15.26:0/3178944012 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:07.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.643+0000 7f100f7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1010133420 0x7f10101337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55150/0 (socket says 172.21.15.26:55150) 2023-10-01T08:01:07.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.643+0000 7f100f7fe700 1 -- 172.21.15.26:0/3178944012 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1010134260 msgr2=0x7f10101304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:07.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.643+0000 7f100f7fe700 1 --2- 172.21.15.26:0/3178944012 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1010134260 0x7f10101304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:07.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.643+0000 7f100f7fe700 1 -- 172.21.15.26:0/3178944012 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1010133e30 msgr2=0x7f101012ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:07.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.643+0000 7f100f7fe700 1 --2- 172.21.15.26:0/3178944012 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1010133e30 0x7f101012ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:07.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.643+0000 7f100f7fe700 1 -- 172.21.15.26:0/3178944012 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10100a0030 con 0x7f1010133420 2023-10-01T08:01:07.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.643+0000 7f100effd700 1 --2- 172.21.15.26:0/3178944012 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1010133e30 0x7f101012ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:07.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.643+0000 7f100ffff700 1 --2- 172.21.15.26:0/3178944012 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1010134260 0x7f10101304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:07.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.643+0000 7f100f7fe700 1 --2- 172.21.15.26:0/3178944012 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1010133420 0x7f10101337f0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f1000009840 tx=0x7f1000009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b942e0cd4660ef20 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:07.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.644+0000 7f100e7fc700 1 -- 172.21.15.26:0/3178944012 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1000011830 con 0x7f1010133420 2023-10-01T08:01:07.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.644+0000 7f100e7fc700 1 -- 172.21.15.26:0/3178944012 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1000011990 con 0x7f1010133420 2023-10-01T08:01:07.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.644+0000 7f100e7fc700 1 -- 172.21.15.26:0/3178944012 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1000011d20 con 0x7f1010133420 2023-10-01T08:01:07.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.644+0000 7f1015f20700 1 -- 172.21.15.26:0/3178944012 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1010133420 msgr2=0x7f10101337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:07.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.644+0000 7f1015f20700 1 --2- 172.21.15.26:0/3178944012 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1010133420 0x7f10101337f0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f1000009840 tx=0x7f1000009b50 comp rx=0 tx=0).stop 2023-10-01T08:01:07.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.644+0000 7f1015f20700 1 -- 172.21.15.26:0/3178944012 shutdown_connections 2023-10-01T08:01:07.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.644+0000 7f1015f20700 1 --2- 172.21.15.26:0/3178944012 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1010134260 0x7f10101304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:07.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.644+0000 7f1015f20700 1 --2- 172.21.15.26:0/3178944012 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1010133420 0x7f10101337f0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:07.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.644+0000 7f1015f20700 1 --2- 172.21.15.26:0/3178944012 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1010133e30 0x7f101012ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:07.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.644+0000 7f1015f20700 1 -- 172.21.15.26:0/3178944012 >> 172.21.15.26:0/3178944012 conn(0x7f10100a4210 msgr2=0x7f10100a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:07.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.644+0000 7f1015f20700 1 -- 172.21.15.26:0/3178944012 shutdown_connections 2023-10-01T08:01:07.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.644+0000 7f1015f20700 1 -- 172.21.15.26:0/3178944012 wait complete. 2023-10-01T08:01:07.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.645+0000 7f1015f20700 1 Processor -- start 2023-10-01T08:01:07.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.645+0000 7f1015f20700 1 -- start start 2023-10-01T08:01:07.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.646+0000 7f1015f20700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1010133420 0x7f101009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:07.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.646+0000 7f1015f20700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1010133e30 0x7f101009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:07.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.646+0000 7f1015f20700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1010134260 0x7f101009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:07.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.646+0000 7f1015f20700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101009d8e0 con 0x7f1010134260 2023-10-01T08:01:07.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.646+0000 7f1015f20700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f101011f4d0 con 0x7f1010133e30 2023-10-01T08:01:07.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.646+0000 7f1015f20700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f101011ee60 con 0x7f1010133420 2023-10-01T08:01:07.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.646+0000 7f100effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1010133e30 0x7f101009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:07.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.646+0000 7f100ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1010134260 0x7f101009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:07.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.646+0000 7f100effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1010133e30 0x7f101009c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51362/0 (socket says 172.21.15.26:51362) 2023-10-01T08:01:07.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.646+0000 7f100effd700 1 -- 172.21.15.26:0/344489908 learned_addr learned my addr 172.21.15.26:0/344489908 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:07.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.646+0000 7f100f7fe700 1 --2- 172.21.15.26:0/344489908 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1010133420 0x7f101009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:07.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.646+0000 7f100effd700 1 -- 172.21.15.26:0/344489908 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1010133420 msgr2=0x7f101009c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:07.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.646+0000 7f100effd700 1 --2- 172.21.15.26:0/344489908 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1010133420 0x7f101009c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:07.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.646+0000 7f100effd700 1 -- 172.21.15.26:0/344489908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1010134260 msgr2=0x7f101009cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:07.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.646+0000 7f100effd700 1 --2- 172.21.15.26:0/344489908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1010134260 0x7f101009cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:07.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.646+0000 7f100effd700 1 -- 172.21.15.26:0/344489908 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1004009550 con 0x7f1010133e30 2023-10-01T08:01:07.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.646+0000 7f100ffff700 1 --2- 172.21.15.26:0/344489908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1010134260 0x7f101009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:07.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.646+0000 7f100f7fe700 1 --2- 172.21.15.26:0/344489908 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1010133420 0x7f101009c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:07.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.647+0000 7f100effd700 1 --2- 172.21.15.26:0/344489908 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1010133e30 0x7f101009c9c0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f100400ebe0 tx=0x7f100400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:07.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.647+0000 7f0ff7fff700 1 -- 172.21.15.26:0/344489908 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100400c850 con 0x7f1010133e30 2023-10-01T08:01:07.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.647+0000 7f0ff7fff700 1 -- 172.21.15.26:0/344489908 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100400c9b0 con 0x7f1010133e30 2023-10-01T08:01:07.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.647+0000 7f0ff7fff700 1 -- 172.21.15.26:0/344489908 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100400cd40 con 0x7f1010133e30 2023-10-01T08:01:07.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.647+0000 7f1015f20700 1 -- 172.21.15.26:0/344489908 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1008009a70 con 0x7f1010133e30 2023-10-01T08:01:07.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.647+0000 7f1015f20700 1 -- 172.21.15.26:0/344489908 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10000094a0 con 0x7f1010133e30 2023-10-01T08:01:07.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.648+0000 7f0ff7fff700 1 -- 172.21.15.26:0/344489908 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1004013470 con 0x7f1010133e30 2023-10-01T08:01:07.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.648+0000 7f1015f20700 1 -- 172.21.15.26:0/344489908 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1010074ea0 con 0x7f1010133e30 2023-10-01T08:01:07.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.648+0000 7f0ff7fff700 1 -- 172.21.15.26:0/344489908 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f100403fd30 con 0x7f1010133e30 2023-10-01T08:01:07.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.653+0000 7f0ff7fff700 1 -- 172.21.15.26:0/344489908 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f100401b3b0 con 0x7f1010133e30 2023-10-01T08:01:07.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.859+0000 7f1015f20700 1 -- 172.21.15.26:0/344489908 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f101011fd40 con 0x7f1010133e30 2023-10-01T08:01:07.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.859+0000 7f0ff7fff700 1 -- 172.21.15.26:0/344489908 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1004011ca0 con 0x7f1010133e30 2023-10-01T08:01:07.860 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:07.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.862+0000 7f1015f20700 1 -- 172.21.15.26:0/344489908 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1010133e30 msgr2=0x7f101009c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:07.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.862+0000 7f1015f20700 1 --2- 172.21.15.26:0/344489908 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1010133e30 0x7f101009c9c0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f100400ebe0 tx=0x7f100400eef0 comp rx=0 tx=0).stop 2023-10-01T08:01:07.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.862+0000 7f1015f20700 1 -- 172.21.15.26:0/344489908 shutdown_connections 2023-10-01T08:01:07.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.862+0000 7f1015f20700 1 --2- 172.21.15.26:0/344489908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1010134260 0x7f101009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:07.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.862+0000 7f1015f20700 1 --2- 172.21.15.26:0/344489908 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1010133420 0x7f101009c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:07.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.862+0000 7f1015f20700 1 --2- 172.21.15.26:0/344489908 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1010133e30 0x7f101009c9c0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:07.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.862+0000 7f1015f20700 1 -- 172.21.15.26:0/344489908 >> 172.21.15.26:0/344489908 conn(0x7f10100a4210 msgr2=0x7f10100a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:07.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.862+0000 7f1015f20700 1 -- 172.21.15.26:0/344489908 shutdown_connections 2023-10-01T08:01:07.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:07.862+0000 7f1015f20700 1 -- 172.21.15.26:0/344489908 wait complete. 2023-10-01T08:01:07.877 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:07.928 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:08.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.068+0000 7fda0f0d7700 1 Processor -- start 2023-10-01T08:01:08.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.068+0000 7fda0f0d7700 1 -- start start 2023-10-01T08:01:08.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.069+0000 7fda0f0d7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fda08133420 0x7fda081337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:08.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.069+0000 7fda0f0d7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fda08134260 0x7fda081306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:08.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.069+0000 7fda0f0d7700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda0806b990 con 0x7fda08133e30 2023-10-01T08:01:08.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.069+0000 7fda0f0d7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda080a0590 con 0x7fda08133420 2023-10-01T08:01:08.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.069+0000 7fda0f0d7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda0809fb80 con 0x7fda08134260 2023-10-01T08:01:08.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.069+0000 7fda0ce73700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fda08133420 0x7fda081337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:08.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.069+0000 7fda0d674700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fda08134260 0x7fda081306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:08.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.069+0000 7fda07fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fda08133e30 0x7fda0812ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49292/0 (socket says 172.21.15.26:49292) 2023-10-01T08:01:08.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.069+0000 7fda07fff700 1 -- 172.21.15.26:0/3362714490 learned_addr learned my addr 172.21.15.26:0/3362714490 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:01:08.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.069+0000 7fda0d674700 1 -- 172.21.15.26:0/3362714490 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fda08133420 msgr2=0x7fda081337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:08.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.069+0000 7fda0d674700 1 --2- 172.21.15.26:0/3362714490 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fda08133420 0x7fda081337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:08.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.069+0000 7fda077fe700 1 -- 172.21.15.26:0/3362714490 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4065596313 0 0) 0x7fda0806b990 con 0x7fda08133e30 2023-10-01T08:01:08.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.069+0000 7fda0d674700 1 -- 172.21.15.26:0/3362714490 >> v1:172.21.15.26:6789/0 conn(0x7fda08133e30 legacy=0x7fda0812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:08.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.069+0000 7fda0d674700 1 -- 172.21.15.26:0/3362714490 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda080a0030 con 0x7fda08134260 2023-10-01T08:01:08.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.069+0000 7fda0ce73700 1 --2- 172.21.15.26:0/3362714490 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fda08133420 0x7fda081337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:08.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.069+0000 7fda0d674700 1 --2- 172.21.15.26:0/3362714490 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fda08134260 0x7fda081306a0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fda00009dc0 tx=0x7fda0000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8787f6b4408dc298 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:08.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.070+0000 7fda077fe700 1 -- 172.21.15.26:0/3362714490 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0000e070 con 0x7fda08134260 2023-10-01T08:01:08.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.070+0000 7fda077fe700 1 -- 172.21.15.26:0/3362714490 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0000bb20 con 0x7fda08134260 2023-10-01T08:01:08.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.070+0000 7fda077fe700 1 -- 172.21.15.26:0/3362714490 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda00012430 con 0x7fda08134260 2023-10-01T08:01:08.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.070+0000 7fda0f0d7700 1 -- 172.21.15.26:0/3362714490 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fda08134260 msgr2=0x7fda081306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:08.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.070+0000 7fda0f0d7700 1 --2- 172.21.15.26:0/3362714490 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fda08134260 0x7fda081306a0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fda00009dc0 tx=0x7fda0000b330 comp rx=0 tx=0).stop 2023-10-01T08:01:08.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.070+0000 7fda0f0d7700 1 -- 172.21.15.26:0/3362714490 shutdown_connections 2023-10-01T08:01:08.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.070+0000 7fda0f0d7700 1 --2- 172.21.15.26:0/3362714490 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fda08134260 0x7fda081306a0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:08.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.070+0000 7fda0f0d7700 1 --2- 172.21.15.26:0/3362714490 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fda08133420 0x7fda081337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:08.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.070+0000 7fda0f0d7700 1 -- 172.21.15.26:0/3362714490 >> 172.21.15.26:0/3362714490 conn(0x7fda080a4210 msgr2=0x7fda080a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:08.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.070+0000 7fda0f0d7700 1 -- 172.21.15.26:0/3362714490 shutdown_connections 2023-10-01T08:01:08.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.070+0000 7fda0f0d7700 1 -- 172.21.15.26:0/3362714490 wait complete. 2023-10-01T08:01:08.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.071+0000 7fda0f0d7700 1 Processor -- start 2023-10-01T08:01:08.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.072+0000 7fda0f0d7700 1 -- start start 2023-10-01T08:01:08.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.072+0000 7fda0f0d7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda08133420 0x7fda0809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:08.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.072+0000 7fda0f0d7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fda08133e30 0x7fda0809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:08.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.072+0000 7fda0f0d7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fda08134260 0x7fda0809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:08.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.072+0000 7fda0f0d7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0809df70 con 0x7fda08133420 2023-10-01T08:01:08.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.072+0000 7fda0f0d7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda0809dd80 con 0x7fda08133e30 2023-10-01T08:01:08.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.072+0000 7fda0f0d7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda081200c0 con 0x7fda08134260 2023-10-01T08:01:08.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.073+0000 7fda0ce73700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda08133420 0x7fda0809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:08.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.073+0000 7fda0d674700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fda08134260 0x7fda0809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:08.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.073+0000 7fda0ce73700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda08133420 0x7fda0809c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55162/0 (socket says 172.21.15.26:55162) 2023-10-01T08:01:08.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.073+0000 7fda0ce73700 1 -- 172.21.15.26:0/673882269 learned_addr learned my addr 172.21.15.26:0/673882269 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:08.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.073+0000 7fda07fff700 1 --2- 172.21.15.26:0/673882269 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fda08133e30 0x7fda0809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:08.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.073+0000 7fda0d674700 1 -- 172.21.15.26:0/673882269 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fda08133e30 msgr2=0x7fda0809c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:08.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.073+0000 7fda0d674700 1 --2- 172.21.15.26:0/673882269 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fda08133e30 0x7fda0809c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:08.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.073+0000 7fda0d674700 1 -- 172.21.15.26:0/673882269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda08133420 msgr2=0x7fda0809c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:08.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.073+0000 7fda0d674700 1 --2- 172.21.15.26:0/673882269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda08133420 0x7fda0809c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:08.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.073+0000 7fda0d674700 1 -- 172.21.15.26:0/673882269 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f80094a0 con 0x7fda08134260 2023-10-01T08:01:08.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.073+0000 7fda0ce73700 1 --2- 172.21.15.26:0/673882269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda08133420 0x7fda0809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:08.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.073+0000 7fda0d674700 1 --2- 172.21.15.26:0/673882269 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fda08134260 0x7fda0809cf00 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fda00016000 tx=0x7fda00004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:08.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.073+0000 7fda057fa700 1 -- 172.21.15.26:0/673882269 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda00012430 con 0x7fda08134260 2023-10-01T08:01:08.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.073+0000 7fda057fa700 1 -- 172.21.15.26:0/673882269 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda00020070 con 0x7fda08134260 2023-10-01T08:01:08.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.073+0000 7fda057fa700 1 -- 172.21.15.26:0/673882269 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda00004280 con 0x7fda08134260 2023-10-01T08:01:08.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.073+0000 7fda0f0d7700 1 -- 172.21.15.26:0/673882269 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda00009a70 con 0x7fda08134260 2023-10-01T08:01:08.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.073+0000 7fda0f0d7700 1 -- 172.21.15.26:0/673882269 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda0811f400 con 0x7fda08134260 2023-10-01T08:01:08.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.075+0000 7fda0f0d7700 1 -- 172.21.15.26:0/673882269 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda08074ea0 con 0x7fda08134260 2023-10-01T08:01:08.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.075+0000 7fda057fa700 1 -- 172.21.15.26:0/673882269 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fda000043e0 con 0x7fda08134260 2023-10-01T08:01:08.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.075+0000 7fda057fa700 1 -- 172.21.15.26:0/673882269 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fda00022070 con 0x7fda08134260 2023-10-01T08:01:08.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.081+0000 7fda057fa700 1 -- 172.21.15.26:0/673882269 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fda0001b400 con 0x7fda08134260 2023-10-01T08:01:08.114 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:08.151 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:08.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.255+0000 7faa9cbdc700 1 Processor -- start 2023-10-01T08:01:08.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.255+0000 7faa9cbdc700 1 -- start start 2023-10-01T08:01:08.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.256+0000 7faa9cbdc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7faa98133a80 0x7faa98133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:08.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.256+0000 7faa9cbdc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa98130a70 0x7faa9813b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:08.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.256+0000 7faa9cbdc700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa9806bc00 con 0x7faa9812ff20 2023-10-01T08:01:08.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.256+0000 7faa9cbdc700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa9806c570 con 0x7faa98133a80 2023-10-01T08:01:08.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.256+0000 7faa9cbdc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa980a0040 con 0x7faa98130a70 2023-10-01T08:01:08.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.256+0000 7faa9659c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7faa98133a80 0x7faa98133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:08.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.256+0000 7faa9659c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7faa98133a80 0x7faa98133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55176/0 (socket says 172.21.15.26:55176) 2023-10-01T08:01:08.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.256+0000 7faa9659c700 1 -- 172.21.15.26:0/692971533 learned_addr learned my addr 172.21.15.26:0/692971533 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:08.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.256+0000 7faa96d9d700 1 --2- 172.21.15.26:0/692971533 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa98130a70 0x7faa9813b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:08.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.256+0000 7faa9659c700 1 -- 172.21.15.26:0/692971533 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa98130a70 msgr2=0x7faa9813b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:08.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.256+0000 7faa9659c700 1 --2- 172.21.15.26:0/692971533 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa98130a70 0x7faa9813b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:08.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.256+0000 7faa9659c700 1 -- 172.21.15.26:0/692971533 >> v1:172.21.15.26:6789/0 conn(0x7faa9812ff20 legacy=0x7faa98130360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:08.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.256+0000 7faa9659c700 1 -- 172.21.15.26:0/692971533 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa98133860 con 0x7faa98133a80 2023-10-01T08:01:08.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.256+0000 7faa96d9d700 1 --2- 172.21.15.26:0/692971533 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa98130a70 0x7faa9813b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:08.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.257+0000 7faa9659c700 1 --2- 172.21.15.26:0/692971533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa98133a80 0x7faa98133e50 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7faa880098f0 tx=0x7faa88009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa7c8ce4841c639e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:08.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.257+0000 7faa9559a700 1 -- 172.21.15.26:0/692971533 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa88011830 con 0x7faa98133a80 2023-10-01T08:01:08.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.257+0000 7faa9559a700 1 -- 172.21.15.26:0/692971533 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa88011990 con 0x7faa98133a80 2023-10-01T08:01:08.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.257+0000 7faa9559a700 1 -- 172.21.15.26:0/692971533 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa88011d20 con 0x7faa98133a80 2023-10-01T08:01:08.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.258+0000 7faa9cbdc700 1 -- 172.21.15.26:0/692971533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa98133a80 msgr2=0x7faa98133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:08.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.258+0000 7faa9cbdc700 1 --2- 172.21.15.26:0/692971533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa98133a80 0x7faa98133e50 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7faa880098f0 tx=0x7faa88009c00 comp rx=0 tx=0).stop 2023-10-01T08:01:08.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.258+0000 7faa9cbdc700 1 -- 172.21.15.26:0/692971533 shutdown_connections 2023-10-01T08:01:08.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.258+0000 7faa9cbdc700 1 --2- 172.21.15.26:0/692971533 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa98130a70 0x7faa9813b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:08.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.258+0000 7faa9cbdc700 1 --2- 172.21.15.26:0/692971533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa98133a80 0x7faa98133e50 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:08.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.258+0000 7faa9cbdc700 1 -- 172.21.15.26:0/692971533 >> 172.21.15.26:0/692971533 conn(0x7faa980a4210 msgr2=0x7faa980a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:08.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.258+0000 7faa9cbdc700 1 -- 172.21.15.26:0/692971533 shutdown_connections 2023-10-01T08:01:08.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.258+0000 7faa9cbdc700 1 -- 172.21.15.26:0/692971533 wait complete. 2023-10-01T08:01:08.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.259+0000 7faa9cbdc700 1 Processor -- start 2023-10-01T08:01:08.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.259+0000 7faa9cbdc700 1 -- start start 2023-10-01T08:01:08.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.259+0000 7faa9cbdc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa9812ff20 0x7faa9809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:08.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.259+0000 7faa9cbdc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa98130a70 0x7faa9809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:08.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.259+0000 7faa9cbdc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa98133a80 0x7faa9809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:08.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.260+0000 7faa9cbdc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa9811ed70 con 0x7faa98133a80 2023-10-01T08:01:08.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.260+0000 7faa9cbdc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa9811ea90 con 0x7faa9812ff20 2023-10-01T08:01:08.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.260+0000 7faa9cbdc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa98120090 con 0x7faa98130a70 2023-10-01T08:01:08.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.260+0000 7faa9659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa9812ff20 0x7faa9809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:08.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.260+0000 7faa9659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa9812ff20 0x7faa9809c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51388/0 (socket says 172.21.15.26:51388) 2023-10-01T08:01:08.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.260+0000 7faa9659c700 1 -- 172.21.15.26:0/4050103897 learned_addr learned my addr 172.21.15.26:0/4050103897 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:08.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.260+0000 7faa96d9d700 1 --2- 172.21.15.26:0/4050103897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa98133a80 0x7faa9809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:08.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.260+0000 7faa95d9b700 1 --2- 172.21.15.26:0/4050103897 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa98130a70 0x7faa9809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:08.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.260+0000 7faa96d9d700 1 -- 172.21.15.26:0/4050103897 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa98130a70 msgr2=0x7faa9809c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:08.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.260+0000 7faa96d9d700 1 --2- 172.21.15.26:0/4050103897 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa98130a70 0x7faa9809c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:08.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.260+0000 7faa96d9d700 1 -- 172.21.15.26:0/4050103897 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa9812ff20 msgr2=0x7faa9809c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:08.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.260+0000 7faa96d9d700 1 --2- 172.21.15.26:0/4050103897 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa9812ff20 0x7faa9809c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:08.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.260+0000 7faa96d9d700 1 -- 172.21.15.26:0/4050103897 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa90009a70 con 0x7faa98133a80 2023-10-01T08:01:08.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.260+0000 7faa9659c700 1 --2- 172.21.15.26:0/4050103897 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa9812ff20 0x7faa9809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:08.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.260+0000 7faa96d9d700 1 --2- 172.21.15.26:0/4050103897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa98133a80 0x7faa9809cf00 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7faa90009e50 tx=0x7faa9000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:08.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.261+0000 7faa86ffd700 1 -- 172.21.15.26:0/4050103897 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9000cc90 con 0x7faa98133a80 2023-10-01T08:01:08.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.261+0000 7faa86ffd700 1 -- 172.21.15.26:0/4050103897 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9000f040 con 0x7faa98133a80 2023-10-01T08:01:08.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.261+0000 7faa9cbdc700 1 -- 172.21.15.26:0/4050103897 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa88009550 con 0x7faa98133a80 2023-10-01T08:01:08.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.261+0000 7faa86ffd700 1 -- 172.21.15.26:0/4050103897 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa90014480 con 0x7faa98133a80 2023-10-01T08:01:08.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.261+0000 7faa9cbdc700 1 -- 172.21.15.26:0/4050103897 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa9812d300 con 0x7faa98133a80 2023-10-01T08:01:08.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.262+0000 7faa86ffd700 1 -- 172.21.15.26:0/4050103897 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faa900145e0 con 0x7faa98133a80 2023-10-01T08:01:08.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.262+0000 7faa9cbdc700 1 -- 172.21.15.26:0/4050103897 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa98074ea0 con 0x7faa98133a80 2023-10-01T08:01:08.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.262+0000 7faa86ffd700 1 -- 172.21.15.26:0/4050103897 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faa90040300 con 0x7faa98133a80 2023-10-01T08:01:08.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.267+0000 7faa86ffd700 1 -- 172.21.15.26:0/4050103897 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faa90007920 con 0x7faa98133a80 2023-10-01T08:01:08.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.293+0000 7fda0f0d7700 1 -- 172.21.15.26:0/673882269 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fda0806b250 con 0x7fda08134260 2023-10-01T08:01:08.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.293+0000 7fda057fa700 1 -- 172.21.15.26:0/673882269 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fda0001a700 con 0x7fda08134260 2023-10-01T08:01:08.294 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:08.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.295+0000 7fda0f0d7700 1 -- 172.21.15.26:0/673882269 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fda08134260 msgr2=0x7fda0809cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:08.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.295+0000 7fda0f0d7700 1 --2- 172.21.15.26:0/673882269 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fda08134260 0x7fda0809cf00 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fda00016000 tx=0x7fda00004ad0 comp rx=0 tx=0).stop 2023-10-01T08:01:08.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.296+0000 7fda0f0d7700 1 -- 172.21.15.26:0/673882269 shutdown_connections 2023-10-01T08:01:08.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.296+0000 7fda0f0d7700 1 --2- 172.21.15.26:0/673882269 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fda08134260 0x7fda0809cf00 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:08.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.296+0000 7fda0f0d7700 1 --2- 172.21.15.26:0/673882269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda08133420 0x7fda0809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:08.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.296+0000 7fda0f0d7700 1 --2- 172.21.15.26:0/673882269 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fda08133e30 0x7fda0809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:08.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.296+0000 7fda0f0d7700 1 -- 172.21.15.26:0/673882269 >> 172.21.15.26:0/673882269 conn(0x7fda080a4210 msgr2=0x7fda080a3080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:08.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.296+0000 7fda0f0d7700 1 -- 172.21.15.26:0/673882269 shutdown_connections 2023-10-01T08:01:08.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.296+0000 7fda0f0d7700 1 -- 172.21.15.26:0/673882269 wait complete. 2023-10-01T08:01:08.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.296+0000 7f44647bc700 1 Processor -- start 2023-10-01T08:01:08.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.296+0000 7f44647bc700 1 -- start start 2023-10-01T08:01:08.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.297+0000 7f44647bc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f445c0a0a30 0x7f445c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:08.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.297+0000 7f44647bc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f445c138d80 0x7f445c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:08.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.297+0000 7f44647bc700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f445c0a2a70 con 0x7f445c09d630 2023-10-01T08:01:08.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.297+0000 7f44647bc700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f445c0a01d0 con 0x7f445c138d80 2023-10-01T08:01:08.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.297+0000 7f44647bc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445c09e2b0 con 0x7f445c0a0a30 2023-10-01T08:01:08.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.298+0000 7f4462558700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f445c0a0a30 0x7f445c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:08.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.298+0000 7f4462d59700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f445c138d80 0x7f445c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:08.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.298+0000 7f4462558700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f445c0a0a30 0x7f445c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51390/0 (socket says 172.21.15.26:51390) 2023-10-01T08:01:08.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.298+0000 7f4462558700 1 -- 172.21.15.26:0/371338301 learned_addr learned my addr 172.21.15.26:0/371338301 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:08.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.298+0000 7f4462558700 1 -- 172.21.15.26:0/371338301 >> v2:172.21.15.26:3300/0 conn(0x7f445c138d80 msgr2=0x7f445c13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:08.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.298+0000 7f4462558700 1 --2- 172.21.15.26:0/371338301 >> v2:172.21.15.26:3300/0 conn(0x7f445c138d80 0x7f445c13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:08.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.298+0000 7f4462558700 1 -- 172.21.15.26:0/371338301 >> v1:172.21.15.26:6789/0 conn(0x7f445c09d630 legacy=0x7f445c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:08.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.298+0000 7f4462558700 1 -- 172.21.15.26:0/371338301 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445c09dc50 con 0x7f445c0a0a30 2023-10-01T08:01:08.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.298+0000 7f4462d59700 1 --2- 172.21.15.26:0/371338301 >> v2:172.21.15.26:3300/0 conn(0x7f445c138d80 0x7f445c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:08.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.298+0000 7f4462558700 1 --2- 172.21.15.26:0/371338301 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f445c0a0a30 0x7f445c0a0e00 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f44580098f0 tx=0x7f4458009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f6bb24a515e5cfa server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:08.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.298+0000 7f4461556700 1 -- 172.21.15.26:0/371338301 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4458004230 con 0x7f445c0a0a30 2023-10-01T08:01:08.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.298+0000 7f4461556700 1 -- 172.21.15.26:0/371338301 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4458004390 con 0x7f445c0a0a30 2023-10-01T08:01:08.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.298+0000 7f4461556700 1 -- 172.21.15.26:0/371338301 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44580036a0 con 0x7f445c0a0a30 2023-10-01T08:01:08.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.299+0000 7f44647bc700 1 -- 172.21.15.26:0/371338301 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f445c0a0a30 msgr2=0x7f445c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:08.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.299+0000 7f44647bc700 1 --2- 172.21.15.26:0/371338301 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f445c0a0a30 0x7f445c0a0e00 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f44580098f0 tx=0x7f4458009c00 comp rx=0 tx=0).stop 2023-10-01T08:01:08.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.299+0000 7f44647bc700 1 -- 172.21.15.26:0/371338301 shutdown_connections 2023-10-01T08:01:08.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.299+0000 7f44647bc700 1 --2- 172.21.15.26:0/371338301 >> v2:172.21.15.26:3300/0 conn(0x7f445c138d80 0x7f445c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:08.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.299+0000 7f44647bc700 1 --2- 172.21.15.26:0/371338301 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f445c0a0a30 0x7f445c0a0e00 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:08.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.299+0000 7f44647bc700 1 -- 172.21.15.26:0/371338301 >> 172.21.15.26:0/371338301 conn(0x7f445c0a3050 msgr2=0x7f445c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:08.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.299+0000 7f44647bc700 1 -- 172.21.15.26:0/371338301 shutdown_connections 2023-10-01T08:01:08.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.299+0000 7f44647bc700 1 -- 172.21.15.26:0/371338301 wait complete. 2023-10-01T08:01:08.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.301+0000 7f44647bc700 1 Processor -- start 2023-10-01T08:01:08.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.301+0000 7f44647bc700 1 -- start start 2023-10-01T08:01:08.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.302+0000 7f44647bc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f445c09d630 0x7f445c1207c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:08.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.302+0000 7f44647bc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f445c0a0a30 0x7f445c120d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:08.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.302+0000 7f44647bc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f445c138d80 0x7f445c121240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:08.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.302+0000 7f44647bc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445c123140 con 0x7f445c138d80 2023-10-01T08:01:08.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.302+0000 7f44647bc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445c122340 con 0x7f445c0a0a30 2023-10-01T08:01:08.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.302+0000 7f44647bc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f445c123690 con 0x7f445c09d630 2023-10-01T08:01:08.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.302+0000 7f4462558700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f445c09d630 0x7f445c1207c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:08.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.302+0000 7f4462558700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f445c09d630 0x7f445c1207c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56934/0 (socket says 172.21.15.26:56934) 2023-10-01T08:01:08.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.302+0000 7f4462558700 1 -- 172.21.15.26:0/79090312 learned_addr learned my addr 172.21.15.26:0/79090312 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:08.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.302+0000 7f4462d59700 1 --2- 172.21.15.26:0/79090312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f445c138d80 0x7f445c121240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:08.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.302+0000 7f4461d57700 1 --2- 172.21.15.26:0/79090312 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f445c0a0a30 0x7f445c120d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:08.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.302+0000 7f4462558700 1 -- 172.21.15.26:0/79090312 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f445c0a0a30 msgr2=0x7f445c120d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:08.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.302+0000 7f4462558700 1 --2- 172.21.15.26:0/79090312 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f445c0a0a30 0x7f445c120d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:08.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.302+0000 7f4462558700 1 -- 172.21.15.26:0/79090312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f445c138d80 msgr2=0x7f445c121240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:08.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.302+0000 7f4462558700 1 --2- 172.21.15.26:0/79090312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f445c138d80 0x7f445c121240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:08.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.302+0000 7f4462558700 1 -- 172.21.15.26:0/79090312 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4454009a70 con 0x7f445c09d630 2023-10-01T08:01:08.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.302+0000 7f4461d57700 1 --2- 172.21.15.26:0/79090312 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f445c0a0a30 0x7f445c120d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:08.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.303+0000 7f4462558700 1 --2- 172.21.15.26:0/79090312 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f445c09d630 0x7f445c1207c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f445c09e3f0 tx=0x7f4458004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:08.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.303+0000 7f4452ffd700 1 -- 172.21.15.26:0/79090312 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4458003ae0 con 0x7f445c09d630 2023-10-01T08:01:08.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.303+0000 7f4452ffd700 1 -- 172.21.15.26:0/79090312 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445801f070 con 0x7f445c09d630 2023-10-01T08:01:08.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.303+0000 7f44647bc700 1 -- 172.21.15.26:0/79090312 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4458009550 con 0x7f445c09d630 2023-10-01T08:01:08.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.303+0000 7f4452ffd700 1 -- 172.21.15.26:0/79090312 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4458003e40 con 0x7f445c09d630 2023-10-01T08:01:08.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.303+0000 7f44647bc700 1 -- 172.21.15.26:0/79090312 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f445c0a0410 con 0x7f445c09d630 2023-10-01T08:01:08.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.304+0000 7f4452ffd700 1 -- 172.21.15.26:0/79090312 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4458021030 con 0x7f445c09d630 2023-10-01T08:01:08.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.304+0000 7f4452ffd700 1 -- 172.21.15.26:0/79090312 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f44580409e0 con 0x7f445c09d630 2023-10-01T08:01:08.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.305+0000 7f44647bc700 1 -- 172.21.15.26:0/79090312 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f445c123b90 con 0x7f445c09d630 2023-10-01T08:01:08.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.310+0000 7f4452ffd700 1 -- 172.21.15.26:0/79090312 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f44580199b0 con 0x7f445c09d630 2023-10-01T08:01:08.313 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:08.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.478+0000 7faa9cbdc700 1 -- 172.21.15.26:0/4050103897 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faa981201d0 con 0x7faa98133a80 2023-10-01T08:01:08.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.478+0000 7faa86ffd700 1 -- 172.21.15.26:0/4050103897 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faa90018030 con 0x7faa98133a80 2023-10-01T08:01:08.479 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:08.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.480+0000 7faa9cbdc700 1 -- 172.21.15.26:0/4050103897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa98133a80 msgr2=0x7faa9809cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:08.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.480+0000 7faa9cbdc700 1 --2- 172.21.15.26:0/4050103897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa98133a80 0x7faa9809cf00 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7faa90009e50 tx=0x7faa9000c3a0 comp rx=0 tx=0).stop 2023-10-01T08:01:08.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.480+0000 7faa9cbdc700 1 -- 172.21.15.26:0/4050103897 shutdown_connections 2023-10-01T08:01:08.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.480+0000 7faa9cbdc700 1 --2- 172.21.15.26:0/4050103897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa98133a80 0x7faa9809cf00 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:08.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.480+0000 7faa9cbdc700 1 --2- 172.21.15.26:0/4050103897 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa9812ff20 0x7faa9809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:08.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.480+0000 7faa9cbdc700 1 --2- 172.21.15.26:0/4050103897 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7faa98130a70 0x7faa9809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:08.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.480+0000 7faa9cbdc700 1 -- 172.21.15.26:0/4050103897 >> 172.21.15.26:0/4050103897 conn(0x7faa980a4210 msgr2=0x7faa9809e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:08.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.480+0000 7faa9cbdc700 1 -- 172.21.15.26:0/4050103897 shutdown_connections 2023-10-01T08:01:08.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.480+0000 7faa9cbdc700 1 -- 172.21.15.26:0/4050103897 wait complete. 2023-10-01T08:01:08.494 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:08.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.516+0000 7f44647bc700 1 -- 172.21.15.26:0/79090312 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f445c123b90 con 0x7f445c09d630 2023-10-01T08:01:08.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.517+0000 7f4452ffd700 1 -- 172.21.15.26:0/79090312 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f44580193c0 con 0x7f445c09d630 2023-10-01T08:01:08.518 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:08.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.519+0000 7f44647bc700 1 -- 172.21.15.26:0/79090312 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f445c09d630 msgr2=0x7f445c1207c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:08.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.519+0000 7f44647bc700 1 --2- 172.21.15.26:0/79090312 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f445c09d630 0x7f445c1207c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f445c09e3f0 tx=0x7f4458004750 comp rx=0 tx=0).stop 2023-10-01T08:01:08.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.519+0000 7f44647bc700 1 -- 172.21.15.26:0/79090312 shutdown_connections 2023-10-01T08:01:08.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.519+0000 7f44647bc700 1 --2- 172.21.15.26:0/79090312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f445c138d80 0x7f445c121240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:08.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.519+0000 7f44647bc700 1 --2- 172.21.15.26:0/79090312 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f445c09d630 0x7f445c1207c0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:08.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.519+0000 7f44647bc700 1 --2- 172.21.15.26:0/79090312 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f445c0a0a30 0x7f445c120d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:08.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.519+0000 7f44647bc700 1 -- 172.21.15.26:0/79090312 >> 172.21.15.26:0/79090312 conn(0x7f445c0a3050 msgr2=0x7f445c09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:08.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.519+0000 7f44647bc700 1 -- 172.21.15.26:0/79090312 shutdown_connections 2023-10-01T08:01:08.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:08.519+0000 7f44647bc700 1 -- 172.21.15.26:0/79090312 wait complete. 2023-10-01T08:01:08.533 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:08.877 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:09.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.022+0000 7f830fac3700 1 Processor -- start 2023-10-01T08:01:09.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.022+0000 7f830fac3700 1 -- start start 2023-10-01T08:01:09.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.023+0000 7f830fac3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f830809e1d0 0x7f8308135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:09.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.023+0000 7f830fac3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8308135e50 0x7f8308138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:09.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.023+0000 7f830fac3700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f830809f130 con 0x7f830809d6f0 2023-10-01T08:01:09.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.023+0000 7f830fac3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f830809f520 con 0x7f8308135e50 2023-10-01T08:01:09.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.023+0000 7f830fac3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f830809e930 con 0x7f830809e1d0 2023-10-01T08:01:09.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.023+0000 7f830e060700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8308135e50 0x7f8308138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:09.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.023+0000 7f830d05e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f830809e1d0 0x7f8308135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:09.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.023+0000 7f830e060700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8308135e50 0x7f8308138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55216/0 (socket says 172.21.15.26:55216) 2023-10-01T08:01:09.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.023+0000 7f830d05e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f830809e1d0 0x7f8308135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56936/0 (socket says 172.21.15.26:56936) 2023-10-01T08:01:09.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.023+0000 7f830e060700 1 -- 172.21.15.26:0/1792576282 learned_addr learned my addr 172.21.15.26:0/1792576282 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:09.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.023+0000 7f830d05e700 1 -- 172.21.15.26:0/1792576282 >> v2:172.21.15.26:3300/0 conn(0x7f8308135e50 msgr2=0x7f8308138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:09.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.023+0000 7f830d05e700 1 --2- 172.21.15.26:0/1792576282 >> v2:172.21.15.26:3300/0 conn(0x7f8308135e50 0x7f8308138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:09.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.023+0000 7f830d05e700 1 -- 172.21.15.26:0/1792576282 >> v1:172.21.15.26:6789/0 conn(0x7f830809d6f0 legacy=0x7f830809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:09.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.023+0000 7f830d05e700 1 -- 172.21.15.26:0/1792576282 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f830809b2d0 con 0x7f830809e1d0 2023-10-01T08:01:09.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.023+0000 7f830e060700 1 --2- 172.21.15.26:0/1792576282 >> v2:172.21.15.26:3300/0 conn(0x7f8308135e50 0x7f8308138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:09.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.024+0000 7f830d05e700 1 --2- 172.21.15.26:0/1792576282 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f830809e1d0 0x7f8308135910 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f82fc009870 tx=0x7f82fc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a58d14930c68f6e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:09.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.024+0000 7f830c85d700 1 -- 172.21.15.26:0/1792576282 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82fc011830 con 0x7f830809e1d0 2023-10-01T08:01:09.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.024+0000 7f830c85d700 1 -- 172.21.15.26:0/1792576282 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82fc011990 con 0x7f830809e1d0 2023-10-01T08:01:09.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.024+0000 7f830c85d700 1 -- 172.21.15.26:0/1792576282 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82fc011d20 con 0x7f830809e1d0 2023-10-01T08:01:09.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.024+0000 7f830fac3700 1 -- 172.21.15.26:0/1792576282 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f830809e1d0 msgr2=0x7f8308135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:09.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.024+0000 7f830fac3700 1 --2- 172.21.15.26:0/1792576282 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f830809e1d0 0x7f8308135910 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f82fc009870 tx=0x7f82fc009b80 comp rx=0 tx=0).stop 2023-10-01T08:01:09.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.024+0000 7f830fac3700 1 -- 172.21.15.26:0/1792576282 shutdown_connections 2023-10-01T08:01:09.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.024+0000 7f830fac3700 1 --2- 172.21.15.26:0/1792576282 >> v2:172.21.15.26:3300/0 conn(0x7f8308135e50 0x7f8308138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:09.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.024+0000 7f830fac3700 1 --2- 172.21.15.26:0/1792576282 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f830809e1d0 0x7f8308135910 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:09.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.024+0000 7f830fac3700 1 -- 172.21.15.26:0/1792576282 >> 172.21.15.26:0/1792576282 conn(0x7f8308066f50 msgr2=0x7f830809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:09.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.024+0000 7f830fac3700 1 -- 172.21.15.26:0/1792576282 shutdown_connections 2023-10-01T08:01:09.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.024+0000 7f830fac3700 1 -- 172.21.15.26:0/1792576282 wait complete. 2023-10-01T08:01:09.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.026+0000 7f830fac3700 1 Processor -- start 2023-10-01T08:01:09.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.026+0000 7f830fac3700 1 -- start start 2023-10-01T08:01:09.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.027+0000 7f830fac3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f830809d6f0 0x7f830811b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:09.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.027+0000 7f830fac3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f830809e1d0 0x7f830811ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:09.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.027+0000 7f830fac3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8308135e50 0x7f830811bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:09.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.027+0000 7f830fac3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830806e8b0 con 0x7f8308135e50 2023-10-01T08:01:09.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.027+0000 7f830fac3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f830809c700 con 0x7f830809e1d0 2023-10-01T08:01:09.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.027+0000 7f830fac3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f830811d1f0 con 0x7f830809d6f0 2023-10-01T08:01:09.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.027+0000 7f830e060700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8308135e50 0x7f830811bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:09.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.027+0000 7f830d05e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f830809e1d0 0x7f830811ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:09.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.027+0000 7f830e060700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8308135e50 0x7f830811bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55224/0 (socket says 172.21.15.26:55224) 2023-10-01T08:01:09.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.027+0000 7f830e060700 1 -- 172.21.15.26:0/1831736504 learned_addr learned my addr 172.21.15.26:0/1831736504 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:09.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.027+0000 7f830d85f700 1 --2- 172.21.15.26:0/1831736504 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f830809d6f0 0x7f830811b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:09.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.027+0000 7f830e060700 1 -- 172.21.15.26:0/1831736504 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f830809d6f0 msgr2=0x7f830811b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:09.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.027+0000 7f830e060700 1 --2- 172.21.15.26:0/1831736504 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f830809d6f0 0x7f830811b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:09.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.027+0000 7f830e060700 1 -- 172.21.15.26:0/1831736504 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f830809e1d0 msgr2=0x7f830811ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:09.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.027+0000 7f830e060700 1 --2- 172.21.15.26:0/1831736504 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f830809e1d0 0x7f830811ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:09.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.027+0000 7f830e060700 1 -- 172.21.15.26:0/1831736504 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8300009b30 con 0x7f8308135e50 2023-10-01T08:01:09.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.027+0000 7f830d05e700 1 --2- 172.21.15.26:0/1831736504 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f830809e1d0 0x7f830811ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:09.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.027+0000 7f830e060700 1 --2- 172.21.15.26:0/1831736504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8308135e50 0x7f830811bfa0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f830000ef90 tx=0x7f830000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:09.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.027+0000 7f82fa7fc700 1 -- 172.21.15.26:0/1831736504 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8300003c20 con 0x7f8308135e50 2023-10-01T08:01:09.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.027+0000 7f82fa7fc700 1 -- 172.21.15.26:0/1831736504 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830000f040 con 0x7f8308135e50 2023-10-01T08:01:09.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.027+0000 7f830fac3700 1 -- 172.21.15.26:0/1831736504 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82fc0094a0 con 0x7f8308135e50 2023-10-01T08:01:09.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.028+0000 7f82fa7fc700 1 -- 172.21.15.26:0/1831736504 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830000c880 con 0x7f8308135e50 2023-10-01T08:01:09.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.028+0000 7f830fac3700 1 -- 172.21.15.26:0/1831736504 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f830811d890 con 0x7f8308135e50 2023-10-01T08:01:09.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.028+0000 7f82fa7fc700 1 -- 172.21.15.26:0/1831736504 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f830000c9e0 con 0x7f8308135e50 2023-10-01T08:01:09.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.029+0000 7f82fa7fc700 1 -- 172.21.15.26:0/1831736504 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f830003fa80 con 0x7f8308135e50 2023-10-01T08:01:09.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.029+0000 7f830fac3700 1 -- 172.21.15.26:0/1831736504 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8308074ea0 con 0x7f8308135e50 2023-10-01T08:01:09.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.034+0000 7f82fa7fc700 1 -- 172.21.15.26:0/1831736504 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8300014440 con 0x7f8308135e50 2023-10-01T08:01:09.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.239+0000 7f830fac3700 1 -- 172.21.15.26:0/1831736504 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f830811e9b0 con 0x7f8308135e50 2023-10-01T08:01:09.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.239+0000 7f82fa7fc700 1 -- 172.21.15.26:0/1831736504 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f830811e9b0 con 0x7f8308135e50 2023-10-01T08:01:09.240 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:09.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.241+0000 7f830fac3700 1 -- 172.21.15.26:0/1831736504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8308135e50 msgr2=0x7f830811bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:09.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.241+0000 7f830fac3700 1 --2- 172.21.15.26:0/1831736504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8308135e50 0x7f830811bfa0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f830000ef90 tx=0x7f830000c3a0 comp rx=0 tx=0).stop 2023-10-01T08:01:09.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.241+0000 7f830fac3700 1 -- 172.21.15.26:0/1831736504 shutdown_connections 2023-10-01T08:01:09.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.241+0000 7f830fac3700 1 --2- 172.21.15.26:0/1831736504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8308135e50 0x7f830811bfa0 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:09.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.242+0000 7f830fac3700 1 --2- 172.21.15.26:0/1831736504 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f830809d6f0 0x7f830811b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:09.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.242+0000 7f830fac3700 1 --2- 172.21.15.26:0/1831736504 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f830809e1d0 0x7f830811ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:09.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.242+0000 7f830fac3700 1 -- 172.21.15.26:0/1831736504 >> 172.21.15.26:0/1831736504 conn(0x7f8308066f50 msgr2=0x7f83081339c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:09.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.242+0000 7f830fac3700 1 -- 172.21.15.26:0/1831736504 shutdown_connections 2023-10-01T08:01:09.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.242+0000 7f830fac3700 1 -- 172.21.15.26:0/1831736504 wait complete. 2023-10-01T08:01:09.258 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:09.314 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:09.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.453+0000 7f40ac5a8700 1 Processor -- start 2023-10-01T08:01:09.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.453+0000 7f40ac5a8700 1 -- start start 2023-10-01T08:01:09.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.453+0000 7f40ac5a8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f40a409d6f0 0x7f40a409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:09.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.453+0000 7f40ac5a8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f40a409e410 0x7f40a4134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:09.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.453+0000 7f40ac5a8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40a409b120 con 0x7f40a409e000 2023-10-01T08:01:09.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.453+0000 7f40ac5a8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40a406b460 con 0x7f40a409e410 2023-10-01T08:01:09.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.453+0000 7f40ac5a8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40a409a7e0 con 0x7f40a409d6f0 2023-10-01T08:01:09.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.454+0000 7f40aab45700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f40a409e410 0x7f40a4134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:09.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.454+0000 7f40aab45700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f40a409e410 0x7f40a4134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55230/0 (socket says 172.21.15.26:55230) 2023-10-01T08:01:09.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.454+0000 7f40aab45700 1 -- 172.21.15.26:0/3359112673 learned_addr learned my addr 172.21.15.26:0/3359112673 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:09.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.454+0000 7f40aa344700 1 --2- 172.21.15.26:0/3359112673 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f40a409d6f0 0x7f40a409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:09.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.454+0000 7f40aab45700 1 -- 172.21.15.26:0/3359112673 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f40a409d6f0 msgr2=0x7f40a409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:09.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.454+0000 7f40aab45700 1 --2- 172.21.15.26:0/3359112673 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f40a409d6f0 0x7f40a409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:09.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.454+0000 7f40aab45700 1 -- 172.21.15.26:0/3359112673 >> v1:172.21.15.26:6789/0 conn(0x7f40a409e000 legacy=0x7f40a41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:09.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.454+0000 7f40aab45700 1 -- 172.21.15.26:0/3359112673 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a409a500 con 0x7f40a409e410 2023-10-01T08:01:09.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.454+0000 7f40a9342700 1 -- 172.21.15.26:0/3359112673 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2357754045 0 0) 0x7f40a409b120 con 0x7f40a409e000 2023-10-01T08:01:09.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.454+0000 7f40aa344700 1 --2- 172.21.15.26:0/3359112673 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f40a409d6f0 0x7f40a409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:09.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.454+0000 7f40aab45700 1 --2- 172.21.15.26:0/3359112673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40a409e410 0x7f40a4134100 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f409c009e50 tx=0x7f409c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=450c8a8ee088461d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:09.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.454+0000 7f40a9342700 1 -- 172.21.15.26:0/3359112673 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c00e070 con 0x7f40a409e410 2023-10-01T08:01:09.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.454+0000 7f40a9342700 1 -- 172.21.15.26:0/3359112673 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409c00b910 con 0x7f40a409e410 2023-10-01T08:01:09.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.454+0000 7f40a9342700 1 -- 172.21.15.26:0/3359112673 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c00bcc0 con 0x7f40a409e410 2023-10-01T08:01:09.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.455+0000 7f40ac5a8700 1 -- 172.21.15.26:0/3359112673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40a409e410 msgr2=0x7f40a4134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:09.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.455+0000 7f40ac5a8700 1 --2- 172.21.15.26:0/3359112673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40a409e410 0x7f40a4134100 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f409c009e50 tx=0x7f409c00b330 comp rx=0 tx=0).stop 2023-10-01T08:01:09.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.455+0000 7f40ac5a8700 1 -- 172.21.15.26:0/3359112673 shutdown_connections 2023-10-01T08:01:09.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.455+0000 7f40ac5a8700 1 --2- 172.21.15.26:0/3359112673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40a409e410 0x7f40a4134100 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:09.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.455+0000 7f40ac5a8700 1 --2- 172.21.15.26:0/3359112673 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f40a409d6f0 0x7f40a409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:09.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.455+0000 7f40ac5a8700 1 -- 172.21.15.26:0/3359112673 >> 172.21.15.26:0/3359112673 conn(0x7f40a4066f50 msgr2=0x7f40a409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:09.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.455+0000 7f40ac5a8700 1 -- 172.21.15.26:0/3359112673 shutdown_connections 2023-10-01T08:01:09.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.455+0000 7f40ac5a8700 1 -- 172.21.15.26:0/3359112673 wait complete. 2023-10-01T08:01:09.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.456+0000 7f40ac5a8700 1 Processor -- start 2023-10-01T08:01:09.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.456+0000 7f40ac5a8700 1 -- start start 2023-10-01T08:01:09.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.457+0000 7f40ac5a8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40a409d6f0 0x7f40a41c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:09.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.457+0000 7f40ac5a8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f40a409e000 0x7f40a41c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:09.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.457+0000 7f40ac5a8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f40a409e410 0x7f40a41c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:09.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.457+0000 7f40ac5a8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a41a8a30 con 0x7f40a409d6f0 2023-10-01T08:01:09.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.457+0000 7f40ac5a8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a41a9780 con 0x7f40a409e000 2023-10-01T08:01:09.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.457+0000 7f40ac5a8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40a41c8e80 con 0x7f40a409e410 2023-10-01T08:01:09.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.457+0000 7f40aa344700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40a409d6f0 0x7f40a41c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:09.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.457+0000 7f40aa344700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40a409d6f0 0x7f40a41c8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55244/0 (socket says 172.21.15.26:55244) 2023-10-01T08:01:09.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.457+0000 7f40a9b43700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f40a409e000 0x7f40a41c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:09.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.457+0000 7f40aa344700 1 -- 172.21.15.26:0/1196600447 learned_addr learned my addr 172.21.15.26:0/1196600447 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:09.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.457+0000 7f40aab45700 1 --2- 172.21.15.26:0/1196600447 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f40a409e410 0x7f40a41c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:09.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.457+0000 7f40aa344700 1 -- 172.21.15.26:0/1196600447 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f40a409e410 msgr2=0x7f40a41c49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:09.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.457+0000 7f40aa344700 1 --2- 172.21.15.26:0/1196600447 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f40a409e410 0x7f40a41c49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:09.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.457+0000 7f40aa344700 1 -- 172.21.15.26:0/1196600447 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f40a409e000 msgr2=0x7f40a41c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:09.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.457+0000 7f40aa344700 1 --2- 172.21.15.26:0/1196600447 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f40a409e000 0x7f40a41c8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:09.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.457+0000 7f40aa344700 1 -- 172.21.15.26:0/1196600447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a00094a0 con 0x7f40a409d6f0 2023-10-01T08:01:09.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.457+0000 7f40aab45700 1 --2- 172.21.15.26:0/1196600447 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f40a409e410 0x7f40a41c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:09.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.457+0000 7f40aa344700 1 --2- 172.21.15.26:0/1196600447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40a409d6f0 0x7f40a41c8400 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f40a000ebe0 tx=0x7f40a000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:09.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.458+0000 7f409affd700 1 -- 172.21.15.26:0/1196600447 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a000c850 con 0x7f40a409d6f0 2023-10-01T08:01:09.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.458+0000 7f409affd700 1 -- 172.21.15.26:0/1196600447 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a000c9b0 con 0x7f40a409d6f0 2023-10-01T08:01:09.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.458+0000 7f40ac5a8700 1 -- 172.21.15.26:0/1196600447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f409c009b30 con 0x7f40a409d6f0 2023-10-01T08:01:09.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.458+0000 7f409affd700 1 -- 172.21.15.26:0/1196600447 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a000cd40 con 0x7f40a409d6f0 2023-10-01T08:01:09.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.458+0000 7f40ac5a8700 1 -- 172.21.15.26:0/1196600447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a41a85e0 con 0x7f40a409d6f0 2023-10-01T08:01:09.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.458+0000 7f409affd700 1 -- 172.21.15.26:0/1196600447 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f40a0013470 con 0x7f40a409d6f0 2023-10-01T08:01:09.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.459+0000 7f409affd700 1 -- 172.21.15.26:0/1196600447 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f40a003f7a0 con 0x7f40a409d6f0 2023-10-01T08:01:09.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.459+0000 7f40ac5a8700 1 -- 172.21.15.26:0/1196600447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a41a78d0 con 0x7f40a409d6f0 2023-10-01T08:01:09.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.464+0000 7f409affd700 1 -- 172.21.15.26:0/1196600447 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f40a0021020 con 0x7f40a409d6f0 2023-10-01T08:01:09.496 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:09.534 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:09.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.637+0000 7f8d0dfba700 1 Processor -- start 2023-10-01T08:01:09.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.637+0000 7f8d0dfba700 1 -- start start 2023-10-01T08:01:09.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.637+0000 7f8d0dfba700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d080a1510 0x7f8d08138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:09.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.637+0000 7f8d0dfba700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8d08139250 0x7f8d0813b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:09.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.637+0000 7f8d0dfba700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d0809edd0 con 0x7f8d080a0a30 2023-10-01T08:01:09.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.638+0000 7f8d0dfba700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d080a18e0 con 0x7f8d08139250 2023-10-01T08:01:09.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.638+0000 7f8d0dfba700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0809e1f0 con 0x7f8d080a1510 2023-10-01T08:01:09.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.638+0000 7f8d077fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8d080a0a30 0x7f8d080a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49332/0 (socket says 172.21.15.26:49332) 2023-10-01T08:01:09.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.638+0000 7f8d077fe700 1 -- 172.21.15.26:0/1923456329 learned_addr learned my addr 172.21.15.26:0/1923456329 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:01:09.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.638+0000 7f8d07fff700 1 --2- 172.21.15.26:0/1923456329 >> v2:172.21.15.26:3300/0 conn(0x7f8d08139250 0x7f8d0813b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:09.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.638+0000 7f8cfeffd700 1 --2- 172.21.15.26:0/1923456329 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d080a1510 0x7f8d08138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:09.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.638+0000 7f8cfeffd700 1 -- 172.21.15.26:0/1923456329 >> v2:172.21.15.26:3300/0 conn(0x7f8d08139250 msgr2=0x7f8d0813b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:09.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.638+0000 7f8cfeffd700 1 --2- 172.21.15.26:0/1923456329 >> v2:172.21.15.26:3300/0 conn(0x7f8d08139250 0x7f8d0813b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:09.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.638+0000 7f8cfeffd700 1 -- 172.21.15.26:0/1923456329 >> v1:172.21.15.26:6789/0 conn(0x7f8d080a0a30 legacy=0x7f8d080a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:09.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.638+0000 7f8cfeffd700 1 -- 172.21.15.26:0/1923456329 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0809dc50 con 0x7f8d080a1510 2023-10-01T08:01:09.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.638+0000 7f8cfeffd700 1 --2- 172.21.15.26:0/1923456329 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d080a1510 0x7f8d08138d10 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0009870 tx=0x7f8cf0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=895a0a8f477092c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:09.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.639+0000 7f8d06ffd700 1 -- 172.21.15.26:0/1923456329 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0011830 con 0x7f8d080a1510 2023-10-01T08:01:09.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.639+0000 7f8d06ffd700 1 -- 172.21.15.26:0/1923456329 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf0011990 con 0x7f8d080a1510 2023-10-01T08:01:09.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.639+0000 7f8d06ffd700 1 -- 172.21.15.26:0/1923456329 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0011d20 con 0x7f8d080a1510 2023-10-01T08:01:09.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.639+0000 7f8d0dfba700 1 -- 172.21.15.26:0/1923456329 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d080a1510 msgr2=0x7f8d08138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:09.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.639+0000 7f8d0dfba700 1 --2- 172.21.15.26:0/1923456329 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d080a1510 0x7f8d08138d10 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0009870 tx=0x7f8cf0009b80 comp rx=0 tx=0).stop 2023-10-01T08:01:09.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.639+0000 7f8d0dfba700 1 -- 172.21.15.26:0/1923456329 shutdown_connections 2023-10-01T08:01:09.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.639+0000 7f8d0dfba700 1 --2- 172.21.15.26:0/1923456329 >> v2:172.21.15.26:3300/0 conn(0x7f8d08139250 0x7f8d0813b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:09.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.639+0000 7f8d0dfba700 1 --2- 172.21.15.26:0/1923456329 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d080a1510 0x7f8d08138d10 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:09.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.639+0000 7f8d0dfba700 1 -- 172.21.15.26:0/1923456329 >> 172.21.15.26:0/1923456329 conn(0x7f8d080a6550 msgr2=0x7f8d080a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:09.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.639+0000 7f8d0dfba700 1 -- 172.21.15.26:0/1923456329 shutdown_connections 2023-10-01T08:01:09.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.640+0000 7f8d0dfba700 1 -- 172.21.15.26:0/1923456329 wait complete. 2023-10-01T08:01:09.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.640+0000 7f8d0dfba700 1 Processor -- start 2023-10-01T08:01:09.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.641+0000 7f8d0dfba700 1 -- start start 2023-10-01T08:01:09.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.641+0000 7f8d0dfba700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d080a0a30 0x7f8d081222e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:09.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.641+0000 7f8d0dfba700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d08139250 0x7f8d08122820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:09.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.641+0000 7f8d0dfba700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d081c85b0 0x7f8d081c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:09.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.641+0000 7f8d0dfba700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d08123ec0 con 0x7f8d08139250 2023-10-01T08:01:09.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.641+0000 7f8d0dfba700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d081220a0 con 0x7f8d081c85b0 2023-10-01T08:01:09.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.641+0000 7f8d0dfba700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d08138ea0 con 0x7f8d080a0a30 2023-10-01T08:01:09.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.641+0000 7f8d077fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d080a0a30 0x7f8d081222e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:09.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.641+0000 7f8d07fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d081c85b0 0x7f8d081c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:09.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.641+0000 7f8d077fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d080a0a30 0x7f8d081222e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56974/0 (socket says 172.21.15.26:56974) 2023-10-01T08:01:09.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.641+0000 7f8d077fe700 1 -- 172.21.15.26:0/4059736853 learned_addr learned my addr 172.21.15.26:0/4059736853 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:09.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.641+0000 7f8cfeffd700 1 --2- 172.21.15.26:0/4059736853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d08139250 0x7f8d08122820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:09.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.642+0000 7f8d07fff700 1 -- 172.21.15.26:0/4059736853 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d080a0a30 msgr2=0x7f8d081222e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:09.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.642+0000 7f8d07fff700 1 --2- 172.21.15.26:0/4059736853 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d080a0a30 0x7f8d081222e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:09.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.642+0000 7f8d07fff700 1 -- 172.21.15.26:0/4059736853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d08139250 msgr2=0x7f8d08122820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:09.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.642+0000 7f8d07fff700 1 --2- 172.21.15.26:0/4059736853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d08139250 0x7f8d08122820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:09.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.642+0000 7f8d07fff700 1 -- 172.21.15.26:0/4059736853 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf00094a0 con 0x7f8d081c85b0 2023-10-01T08:01:09.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.642+0000 7f8d077fe700 1 --2- 172.21.15.26:0/4059736853 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d080a0a30 0x7f8d081222e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:09.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.642+0000 7f8cfeffd700 1 --2- 172.21.15.26:0/4059736853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d08139250 0x7f8d08122820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:09.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.642+0000 7f8d07fff700 1 --2- 172.21.15.26:0/4059736853 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d081c85b0 0x7f8d081c8a50 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f8d0000efc0 tx=0x7f8d0000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:09.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.642+0000 7f8d04ff9700 1 -- 172.21.15.26:0/4059736853 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0000cc90 con 0x7f8d081c85b0 2023-10-01T08:01:09.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.642+0000 7f8d04ff9700 1 -- 172.21.15.26:0/4059736853 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0000f040 con 0x7f8d081c85b0 2023-10-01T08:01:09.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.642+0000 7f8d04ff9700 1 -- 172.21.15.26:0/4059736853 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d00009e60 con 0x7f8d081c85b0 2023-10-01T08:01:09.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.643+0000 7f8d0dfba700 1 -- 172.21.15.26:0/4059736853 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d080a0220 con 0x7f8d081c85b0 2023-10-01T08:01:09.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.643+0000 7f8d0dfba700 1 -- 172.21.15.26:0/4059736853 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d08125570 con 0x7f8d081c85b0 2023-10-01T08:01:09.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.644+0000 7f8d04ff9700 1 -- 172.21.15.26:0/4059736853 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8d00014480 con 0x7f8d081c85b0 2023-10-01T08:01:09.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.644+0000 7f8d04ff9700 1 -- 172.21.15.26:0/4059736853 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8d0003fec0 con 0x7f8d081c85b0 2023-10-01T08:01:09.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.644+0000 7f8d0dfba700 1 -- 172.21.15.26:0/4059736853 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d08074ea0 con 0x7f8d081c85b0 2023-10-01T08:01:09.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.649+0000 7f8d04ff9700 1 -- 172.21.15.26:0/4059736853 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8d00018020 con 0x7f8d081c85b0 2023-10-01T08:01:09.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.690+0000 7fa3e800f700 1 Processor -- start 2023-10-01T08:01:09.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.690+0000 7fa3e800f700 1 -- start start 2023-10-01T08:01:09.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.690+0000 7fa3e800f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa3e009c650 0x7fa3e009ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:09.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.690+0000 7fa3e800f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa3e00a0090 0x7fa3e009cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:09.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.691+0000 7fa3e800f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e009ba70 con 0x7fa3e0131970 2023-10-01T08:01:09.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.691+0000 7fa3e800f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e009d4a0 con 0x7fa3e00a0090 2023-10-01T08:01:09.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.691+0000 7fa3e800f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e009e8f0 con 0x7fa3e009c650 2023-10-01T08:01:09.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.691+0000 7fa3e5dab700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa3e009c650 0x7fa3e009ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:09.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.691+0000 7fa3e65ac700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa3e0131970 0x7fa3e0131dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49346/0 (socket says 172.21.15.26:49346) 2023-10-01T08:01:09.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.691+0000 7fa3e65ac700 1 -- 172.21.15.26:0/4133456090 learned_addr learned my addr 172.21.15.26:0/4133456090 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:01:09.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.691+0000 7fa3e55aa700 1 --2- 172.21.15.26:0/4133456090 >> v2:172.21.15.26:3300/0 conn(0x7fa3e00a0090 0x7fa3e009cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:09.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.691+0000 7fa3e5dab700 1 -- 172.21.15.26:0/4133456090 >> v2:172.21.15.26:3300/0 conn(0x7fa3e00a0090 msgr2=0x7fa3e009cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:09.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.691+0000 7fa3e5dab700 1 --2- 172.21.15.26:0/4133456090 >> v2:172.21.15.26:3300/0 conn(0x7fa3e00a0090 0x7fa3e009cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:09.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.691+0000 7fa3e5dab700 1 -- 172.21.15.26:0/4133456090 >> v1:172.21.15.26:6789/0 conn(0x7fa3e0131970 legacy=0x7fa3e0131dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:09.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.691+0000 7fa3e5dab700 1 -- 172.21.15.26:0/4133456090 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e00a0760 con 0x7fa3e009c650 2023-10-01T08:01:09.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.691+0000 7fa3e4da9700 1 -- 172.21.15.26:0/4133456090 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4272581971 0 0) 0x7fa3e009ba70 con 0x7fa3e0131970 2023-10-01T08:01:09.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.691+0000 7fa3e5dab700 1 --2- 172.21.15.26:0/4133456090 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa3e009c650 0x7fa3e009ca20 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc009840 tx=0x7fa3dc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=beeb75dcad62f9e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:09.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.691+0000 7fa3e4da9700 1 -- 172.21.15.26:0/4133456090 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc011830 con 0x7fa3e009c650 2023-10-01T08:01:09.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.692+0000 7fa3e4da9700 1 -- 172.21.15.26:0/4133456090 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3dc011990 con 0x7fa3e009c650 2023-10-01T08:01:09.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.692+0000 7fa3e4da9700 1 -- 172.21.15.26:0/4133456090 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc011d20 con 0x7fa3e009c650 2023-10-01T08:01:09.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.692+0000 7fa3e800f700 1 -- 172.21.15.26:0/4133456090 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa3e009c650 msgr2=0x7fa3e009ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:09.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.692+0000 7fa3e800f700 1 --2- 172.21.15.26:0/4133456090 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa3e009c650 0x7fa3e009ca20 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc009840 tx=0x7fa3dc009b50 comp rx=0 tx=0).stop 2023-10-01T08:01:09.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.692+0000 7fa3e800f700 1 -- 172.21.15.26:0/4133456090 shutdown_connections 2023-10-01T08:01:09.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.692+0000 7fa3e800f700 1 --2- 172.21.15.26:0/4133456090 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa3e009c650 0x7fa3e009ca20 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:09.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.692+0000 7fa3e800f700 1 --2- 172.21.15.26:0/4133456090 >> v2:172.21.15.26:3300/0 conn(0x7fa3e00a0090 0x7fa3e009cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:09.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.692+0000 7fa3e800f700 1 -- 172.21.15.26:0/4133456090 >> 172.21.15.26:0/4133456090 conn(0x7fa3e00a3f70 msgr2=0x7fa3e00a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:09.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.692+0000 7fa3e800f700 1 -- 172.21.15.26:0/4133456090 shutdown_connections 2023-10-01T08:01:09.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.692+0000 7fa3e800f700 1 -- 172.21.15.26:0/4133456090 wait complete. 2023-10-01T08:01:09.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.693+0000 7f40ac5a8700 1 -- 172.21.15.26:0/1196600447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f40a4074ea0 con 0x7f40a409d6f0 2023-10-01T08:01:09.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.693+0000 7fa3e800f700 1 Processor -- start 2023-10-01T08:01:09.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.693+0000 7f409affd700 1 -- 172.21.15.26:0/1196600447 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f40a000cea0 con 0x7f40a409d6f0 2023-10-01T08:01:09.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.693+0000 7fa3e800f700 1 -- start start 2023-10-01T08:01:09.696 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:09.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.694+0000 7fa3e800f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3e009c650 0x7fa3e011a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:09.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.694+0000 7fa3e800f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa3e00a0090 0x7fa3e011ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:09.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.694+0000 7fa3e800f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3e0131970 0x7fa3e011b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:09.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.694+0000 7fa3e800f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e011e340 con 0x7fa3e009c650 2023-10-01T08:01:09.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.694+0000 7fa3e800f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e011ba70 con 0x7fa3e0131970 2023-10-01T08:01:09.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.694+0000 7fa3e800f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e011c090 con 0x7fa3e00a0090 2023-10-01T08:01:09.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.694+0000 7fa3e65ac700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3e0131970 0x7fa3e011b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:09.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.694+0000 7fa3e65ac700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3e0131970 0x7fa3e011b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51428/0 (socket says 172.21.15.26:51428) 2023-10-01T08:01:09.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.694+0000 7fa3e55aa700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa3e00a0090 0x7fa3e011ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:09.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.694+0000 7fa3e65ac700 1 -- 172.21.15.26:0/4226832435 learned_addr learned my addr 172.21.15.26:0/4226832435 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:09.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.694+0000 7fa3e5dab700 1 --2- 172.21.15.26:0/4226832435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3e009c650 0x7fa3e011a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:09.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.695+0000 7fa3e65ac700 1 -- 172.21.15.26:0/4226832435 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa3e00a0090 msgr2=0x7fa3e011ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:09.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.695+0000 7fa3e65ac700 1 --2- 172.21.15.26:0/4226832435 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa3e00a0090 0x7fa3e011ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:09.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.695+0000 7fa3e65ac700 1 -- 172.21.15.26:0/4226832435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3e009c650 msgr2=0x7fa3e011a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:09.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.695+0000 7fa3e65ac700 1 --2- 172.21.15.26:0/4226832435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3e009c650 0x7fa3e011a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:09.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.695+0000 7fa3e65ac700 1 -- 172.21.15.26:0/4226832435 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3dc0094a0 con 0x7fa3e0131970 2023-10-01T08:01:09.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.695+0000 7fa3e5dab700 1 --2- 172.21.15.26:0/4226832435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3e009c650 0x7fa3e011a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:09.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.695+0000 7fa3e65ac700 1 --2- 172.21.15.26:0/4226832435 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3e0131970 0x7fa3e011b0a0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fa3d800cc70 tx=0x7fa3d800cf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:09.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.695+0000 7fa3d67fc700 1 -- 172.21.15.26:0/4226832435 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d800aac0 con 0x7fa3e0131970 2023-10-01T08:01:09.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.695+0000 7fa3d67fc700 1 -- 172.21.15.26:0/4226832435 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d800ac40 con 0x7fa3e0131970 2023-10-01T08:01:09.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.695+0000 7fa3e800f700 1 -- 172.21.15.26:0/4226832435 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e011ccc0 con 0x7fa3e0131970 2023-10-01T08:01:09.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.695+0000 7fa3d67fc700 1 -- 172.21.15.26:0/4226832435 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d80070d0 con 0x7fa3e0131970 2023-10-01T08:01:09.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.695+0000 7fa3e800f700 1 -- 172.21.15.26:0/4226832435 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e012fdd0 con 0x7fa3e0131970 2023-10-01T08:01:09.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.696+0000 7fa3e800f700 1 -- 172.21.15.26:0/4226832435 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e009d9e0 con 0x7fa3e0131970 2023-10-01T08:01:09.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.697+0000 7fa3d67fc700 1 -- 172.21.15.26:0/4226832435 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa3d8007250 con 0x7fa3e0131970 2023-10-01T08:01:09.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.697+0000 7f40ac5a8700 1 -- 172.21.15.26:0/1196600447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40a409d6f0 msgr2=0x7f40a41c8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:09.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.697+0000 7f40ac5a8700 1 --2- 172.21.15.26:0/1196600447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40a409d6f0 0x7f40a41c8400 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f40a000ebe0 tx=0x7f40a000eef0 comp rx=0 tx=0).stop 2023-10-01T08:01:09.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.697+0000 7f40ac5a8700 1 -- 172.21.15.26:0/1196600447 shutdown_connections 2023-10-01T08:01:09.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.697+0000 7f40ac5a8700 1 --2- 172.21.15.26:0/1196600447 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f40a409e410 0x7f40a41c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:09.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.697+0000 7f40ac5a8700 1 --2- 172.21.15.26:0/1196600447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40a409d6f0 0x7f40a41c8400 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:09.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.697+0000 7f40ac5a8700 1 --2- 172.21.15.26:0/1196600447 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f40a409e000 0x7f40a41c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:09.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.697+0000 7f40ac5a8700 1 -- 172.21.15.26:0/1196600447 >> 172.21.15.26:0/1196600447 conn(0x7f40a4066f50 msgr2=0x7f40a41bacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:09.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.697+0000 7f40ac5a8700 1 -- 172.21.15.26:0/1196600447 shutdown_connections 2023-10-01T08:01:09.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.697+0000 7f40ac5a8700 1 -- 172.21.15.26:0/1196600447 wait complete. 2023-10-01T08:01:09.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.697+0000 7fa3d67fc700 1 -- 172.21.15.26:0/4226832435 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa3d803f4e0 con 0x7fa3e0131970 2023-10-01T08:01:09.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.706+0000 7fa3d67fc700 1 -- 172.21.15.26:0/4226832435 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa3d8007500 con 0x7fa3e0131970 2023-10-01T08:01:09.711 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:09.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.860+0000 7f8d0dfba700 1 -- 172.21.15.26:0/4059736853 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8d081251d0 con 0x7f8d081c85b0 2023-10-01T08:01:09.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.860+0000 7f8d04ff9700 1 -- 172.21.15.26:0/4059736853 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8d081251d0 con 0x7f8d081c85b0 2023-10-01T08:01:09.861 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:09.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.862+0000 7f8d0dfba700 1 -- 172.21.15.26:0/4059736853 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d081c85b0 msgr2=0x7f8d081c8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:09.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.862+0000 7f8d0dfba700 1 --2- 172.21.15.26:0/4059736853 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d081c85b0 0x7f8d081c8a50 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f8d0000efc0 tx=0x7f8d0000c3a0 comp rx=0 tx=0).stop 2023-10-01T08:01:09.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.863+0000 7f8d0dfba700 1 -- 172.21.15.26:0/4059736853 shutdown_connections 2023-10-01T08:01:09.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.863+0000 7f8d0dfba700 1 --2- 172.21.15.26:0/4059736853 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d081c85b0 0x7f8d081c8a50 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:09.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.863+0000 7f8d0dfba700 1 --2- 172.21.15.26:0/4059736853 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d080a0a30 0x7f8d081222e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:09.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.863+0000 7f8d0dfba700 1 --2- 172.21.15.26:0/4059736853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d08139250 0x7f8d08122820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:09.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.863+0000 7f8d0dfba700 1 -- 172.21.15.26:0/4059736853 >> 172.21.15.26:0/4059736853 conn(0x7f8d080a6550 msgr2=0x7f8d08137bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:09.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.863+0000 7f8d0dfba700 1 -- 172.21.15.26:0/4059736853 shutdown_connections 2023-10-01T08:01:09.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.863+0000 7f8d0dfba700 1 -- 172.21.15.26:0/4059736853 wait complete. 2023-10-01T08:01:09.877 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:09.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.913+0000 7fa3e800f700 1 -- 172.21.15.26:0/4226832435 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa3e01b8dd0 con 0x7fa3e0131970 2023-10-01T08:01:09.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.914+0000 7fa3d67fc700 1 -- 172.21.15.26:0/4226832435 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa3d8018020 con 0x7fa3e0131970 2023-10-01T08:01:09.914 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:09.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.916+0000 7fa3e800f700 1 -- 172.21.15.26:0/4226832435 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3e0131970 msgr2=0x7fa3e011b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:09.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.916+0000 7fa3e800f700 1 --2- 172.21.15.26:0/4226832435 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3e0131970 0x7fa3e011b0a0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fa3d800cc70 tx=0x7fa3d800cf80 comp rx=0 tx=0).stop 2023-10-01T08:01:09.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.916+0000 7fa3e800f700 1 -- 172.21.15.26:0/4226832435 shutdown_connections 2023-10-01T08:01:09.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.916+0000 7fa3e800f700 1 --2- 172.21.15.26:0/4226832435 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3e0131970 0x7fa3e011b0a0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:09.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.916+0000 7fa3e800f700 1 --2- 172.21.15.26:0/4226832435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3e009c650 0x7fa3e011a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:09.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.916+0000 7fa3e800f700 1 --2- 172.21.15.26:0/4226832435 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa3e00a0090 0x7fa3e011ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:09.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.916+0000 7fa3e800f700 1 -- 172.21.15.26:0/4226832435 >> 172.21.15.26:0/4226832435 conn(0x7fa3e00a3f70 msgr2=0x7fa3e012ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:09.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.916+0000 7fa3e800f700 1 -- 172.21.15.26:0/4226832435 shutdown_connections 2023-10-01T08:01:09.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:09.916+0000 7fa3e800f700 1 -- 172.21.15.26:0/4226832435 wait complete. 2023-10-01T08:01:09.930 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:10.259 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:10.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.404+0000 7f1de3b11700 1 Processor -- start 2023-10-01T08:01:10.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.404+0000 7f1de3b11700 1 -- start start 2023-10-01T08:01:10.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.404+0000 7f1de3b11700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ddc133420 0x7f1ddc1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:10.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.404+0000 7f1de3b11700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1ddc134260 0x7f1ddc1306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:10.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.404+0000 7f1de3b11700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ddc06b990 con 0x7f1ddc133e30 2023-10-01T08:01:10.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.404+0000 7f1de3b11700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ddc0a0590 con 0x7f1ddc134260 2023-10-01T08:01:10.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.404+0000 7f1de3b11700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc09fb80 con 0x7f1ddc133420 2023-10-01T08:01:10.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.405+0000 7f1de18ad700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ddc133420 0x7f1ddc1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:10.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.405+0000 7f1de20ae700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1ddc134260 0x7f1ddc1306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:10.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.405+0000 7f1de20ae700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1ddc134260 0x7f1ddc1306a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55298/0 (socket says 172.21.15.26:55298) 2023-10-01T08:01:10.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.405+0000 7f1de20ae700 1 -- 172.21.15.26:0/2364325562 learned_addr learned my addr 172.21.15.26:0/2364325562 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:10.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.405+0000 7f1de18ad700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ddc133420 0x7f1ddc1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51444/0 (socket says 172.21.15.26:51444) 2023-10-01T08:01:10.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.405+0000 7f1de20ae700 1 -- 172.21.15.26:0/2364325562 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ddc133420 msgr2=0x7f1ddc1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:10.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.405+0000 7f1de20ae700 1 --2- 172.21.15.26:0/2364325562 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ddc133420 0x7f1ddc1337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:10.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.405+0000 7f1de20ae700 1 -- 172.21.15.26:0/2364325562 >> v1:172.21.15.26:6789/0 conn(0x7f1ddc133e30 legacy=0x7f1ddc12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:10.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.405+0000 7f1de20ae700 1 -- 172.21.15.26:0/2364325562 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ddc0a0030 con 0x7f1ddc134260 2023-10-01T08:01:10.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.405+0000 7f1de18ad700 1 --2- 172.21.15.26:0/2364325562 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ddc133420 0x7f1ddc1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:10.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.405+0000 7f1de20ae700 1 --2- 172.21.15.26:0/2364325562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ddc134260 0x7f1ddc1306a0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4009e50 tx=0x7f1dd400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba72d3f5a7aaf38d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:10.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.405+0000 7f1de08ab700 1 -- 172.21.15.26:0/2364325562 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd400e070 con 0x7f1ddc134260 2023-10-01T08:01:10.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.405+0000 7f1de08ab700 1 -- 172.21.15.26:0/2364325562 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd400b910 con 0x7f1ddc134260 2023-10-01T08:01:10.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.405+0000 7f1de08ab700 1 -- 172.21.15.26:0/2364325562 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd400bcc0 con 0x7f1ddc134260 2023-10-01T08:01:10.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.406+0000 7f1de3b11700 1 -- 172.21.15.26:0/2364325562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ddc134260 msgr2=0x7f1ddc1306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:10.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.406+0000 7f1de3b11700 1 --2- 172.21.15.26:0/2364325562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ddc134260 0x7f1ddc1306a0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4009e50 tx=0x7f1dd400b330 comp rx=0 tx=0).stop 2023-10-01T08:01:10.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.406+0000 7f1de3b11700 1 -- 172.21.15.26:0/2364325562 shutdown_connections 2023-10-01T08:01:10.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.406+0000 7f1de3b11700 1 --2- 172.21.15.26:0/2364325562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ddc134260 0x7f1ddc1306a0 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:10.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.406+0000 7f1de3b11700 1 --2- 172.21.15.26:0/2364325562 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ddc133420 0x7f1ddc1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:10.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.406+0000 7f1de3b11700 1 -- 172.21.15.26:0/2364325562 >> 172.21.15.26:0/2364325562 conn(0x7f1ddc0a4210 msgr2=0x7f1ddc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:10.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.406+0000 7f1de3b11700 1 -- 172.21.15.26:0/2364325562 shutdown_connections 2023-10-01T08:01:10.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.406+0000 7f1de3b11700 1 -- 172.21.15.26:0/2364325562 wait complete. 2023-10-01T08:01:10.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.407+0000 7f1de3b11700 1 Processor -- start 2023-10-01T08:01:10.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.407+0000 7f1de3b11700 1 -- start start 2023-10-01T08:01:10.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.407+0000 7f1de3b11700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ddc133420 0x7f1ddc09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:10.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.407+0000 7f1de3b11700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ddc133e30 0x7f1ddc09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:10.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.407+0000 7f1de3b11700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ddc134260 0x7f1ddc09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:10.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.407+0000 7f1de3b11700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc09d850 con 0x7f1ddc133e30 2023-10-01T08:01:10.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.407+0000 7f1de3b11700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc09ddf0 con 0x7f1ddc134260 2023-10-01T08:01:10.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.407+0000 7f1de3b11700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc1202d0 con 0x7f1ddc133420 2023-10-01T08:01:10.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.408+0000 7f1de18ad700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ddc133420 0x7f1ddc09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:10.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.408+0000 7f1de10ac700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ddc133e30 0x7f1ddc09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:10.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.408+0000 7f1de20ae700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ddc134260 0x7f1ddc09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:10.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.408+0000 7f1de18ad700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ddc133420 0x7f1ddc09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57008/0 (socket says 172.21.15.26:57008) 2023-10-01T08:01:10.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.408+0000 7f1de18ad700 1 -- 172.21.15.26:0/3046097594 learned_addr learned my addr 172.21.15.26:0/3046097594 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:10.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.408+0000 7f1de18ad700 1 -- 172.21.15.26:0/3046097594 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ddc134260 msgr2=0x7f1ddc09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:10.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.408+0000 7f1de18ad700 1 --2- 172.21.15.26:0/3046097594 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ddc134260 0x7f1ddc09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:10.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.408+0000 7f1de18ad700 1 -- 172.21.15.26:0/3046097594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ddc133e30 msgr2=0x7f1ddc09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:10.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.408+0000 7f1de18ad700 1 --2- 172.21.15.26:0/3046097594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ddc133e30 0x7f1ddc09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:10.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.408+0000 7f1de18ad700 1 -- 172.21.15.26:0/3046097594 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd80094a0 con 0x7f1ddc133420 2023-10-01T08:01:10.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.408+0000 7f1de20ae700 1 --2- 172.21.15.26:0/3046097594 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ddc134260 0x7f1ddc09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:10.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.408+0000 7f1de10ac700 1 --2- 172.21.15.26:0/3046097594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ddc133e30 0x7f1ddc09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:10.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.408+0000 7f1de18ad700 1 --2- 172.21.15.26:0/3046097594 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ddc133420 0x7f1ddc09c480 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f1dd800ebe0 tx=0x7f1dd800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:10.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.408+0000 7f1dd27fc700 1 -- 172.21.15.26:0/3046097594 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd800c850 con 0x7f1ddc133420 2023-10-01T08:01:10.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.408+0000 7f1dd27fc700 1 -- 172.21.15.26:0/3046097594 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd800c9b0 con 0x7f1ddc133420 2023-10-01T08:01:10.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.408+0000 7f1de3b11700 1 -- 172.21.15.26:0/3046097594 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd4009b30 con 0x7f1ddc133420 2023-10-01T08:01:10.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.408+0000 7f1dd27fc700 1 -- 172.21.15.26:0/3046097594 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd800cd40 con 0x7f1ddc133420 2023-10-01T08:01:10.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.408+0000 7f1de3b11700 1 -- 172.21.15.26:0/3046097594 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ddc12d190 con 0x7f1ddc133420 2023-10-01T08:01:10.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.409+0000 7f1dd27fc700 1 -- 172.21.15.26:0/3046097594 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1dd8013470 con 0x7f1ddc133420 2023-10-01T08:01:10.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.409+0000 7f1dd27fc700 1 -- 172.21.15.26:0/3046097594 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1dd803fb00 con 0x7f1ddc133420 2023-10-01T08:01:10.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.410+0000 7f1de3b11700 1 -- 172.21.15.26:0/3046097594 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ddc09e420 con 0x7f1ddc133420 2023-10-01T08:01:10.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.415+0000 7f1dd27fc700 1 -- 172.21.15.26:0/3046097594 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1dd8013720 con 0x7f1ddc133420 2023-10-01T08:01:10.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.620+0000 7f1de3b11700 1 -- 172.21.15.26:0/3046097594 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1ddc074ea0 con 0x7f1ddc133420 2023-10-01T08:01:10.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.620+0000 7f1dd27fc700 1 -- 172.21.15.26:0/3046097594 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1dd8017020 con 0x7f1ddc133420 2023-10-01T08:01:10.621 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:10.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.622+0000 7f1de3b11700 1 -- 172.21.15.26:0/3046097594 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ddc133420 msgr2=0x7f1ddc09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:10.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.622+0000 7f1de3b11700 1 --2- 172.21.15.26:0/3046097594 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ddc133420 0x7f1ddc09c480 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f1dd800ebe0 tx=0x7f1dd800eef0 comp rx=0 tx=0).stop 2023-10-01T08:01:10.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.623+0000 7f1de3b11700 1 -- 172.21.15.26:0/3046097594 shutdown_connections 2023-10-01T08:01:10.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.623+0000 7f1de3b11700 1 --2- 172.21.15.26:0/3046097594 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1ddc134260 0x7f1ddc09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:10.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.623+0000 7f1de3b11700 1 --2- 172.21.15.26:0/3046097594 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1ddc133420 0x7f1ddc09c480 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:10.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.623+0000 7f1de3b11700 1 --2- 172.21.15.26:0/3046097594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ddc133e30 0x7f1ddc09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:10.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.623+0000 7f1de3b11700 1 -- 172.21.15.26:0/3046097594 >> 172.21.15.26:0/3046097594 conn(0x7f1ddc0a4210 msgr2=0x7f1ddc0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:10.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.623+0000 7f1de3b11700 1 -- 172.21.15.26:0/3046097594 shutdown_connections 2023-10-01T08:01:10.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.623+0000 7f1de3b11700 1 -- 172.21.15.26:0/3046097594 wait complete. 2023-10-01T08:01:10.637 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:10.712 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:10.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.853+0000 7fe3b9557700 1 Processor -- start 2023-10-01T08:01:10.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.853+0000 7fe3b9557700 1 -- start start 2023-10-01T08:01:10.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.853+0000 7fe3b9557700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe3b409e850 0x7fe3b409ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:10.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.853+0000 7fe3b9557700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3b409f160 0x7fe3b4133bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:10.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.854+0000 7fe3b9557700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b406bf30 con 0x7fe3b409f5b0 2023-10-01T08:01:10.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.854+0000 7fe3b9557700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b409ffb0 con 0x7fe3b409e850 2023-10-01T08:01:10.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.854+0000 7fe3b9557700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b406cb10 con 0x7fe3b409f160 2023-10-01T08:01:10.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.854+0000 7fe3b2ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe3b409e850 0x7fe3b409ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:10.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.854+0000 7fe3b27fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3b409f160 0x7fe3b4133bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:10.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.854+0000 7fe3b2ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe3b409e850 0x7fe3b409ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55312/0 (socket says 172.21.15.26:55312) 2023-10-01T08:01:10.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.854+0000 7fe3b2ffd700 1 -- 172.21.15.26:0/2643601890 learned_addr learned my addr 172.21.15.26:0/2643601890 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:10.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.854+0000 7fe3b2ffd700 1 -- 172.21.15.26:0/2643601890 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3b409f160 msgr2=0x7fe3b4133bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:10.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.854+0000 7fe3b2ffd700 1 --2- 172.21.15.26:0/2643601890 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3b409f160 0x7fe3b4133bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:10.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.854+0000 7fe3b2ffd700 1 -- 172.21.15.26:0/2643601890 >> v1:172.21.15.26:6789/0 conn(0x7fe3b409f5b0 legacy=0x7fe3b4134130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:10.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.854+0000 7fe3b1ffb700 1 -- 172.21.15.26:0/2643601890 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4027634595 0 0) 0x7fe3b406bf30 con 0x7fe3b409f5b0 2023-10-01T08:01:10.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.854+0000 7fe3b2ffd700 1 -- 172.21.15.26:0/2643601890 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b40a0270 con 0x7fe3b409e850 2023-10-01T08:01:10.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.854+0000 7fe3b27fc700 1 --2- 172.21.15.26:0/2643601890 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3b409f160 0x7fe3b4133bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:10.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.854+0000 7fe3b2ffd700 1 --2- 172.21.15.26:0/2643601890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3b409e850 0x7fe3b409ec20 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40098f0 tx=0x7fe3a4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3686d7bec393120 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:10.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.854+0000 7fe3b1ffb700 1 -- 172.21.15.26:0/2643601890 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4011830 con 0x7fe3b409e850 2023-10-01T08:01:10.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.854+0000 7fe3b1ffb700 1 -- 172.21.15.26:0/2643601890 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a4011990 con 0x7fe3b409e850 2023-10-01T08:01:10.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.854+0000 7fe3b1ffb700 1 -- 172.21.15.26:0/2643601890 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4011d20 con 0x7fe3b409e850 2023-10-01T08:01:10.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.855+0000 7fe3b9557700 1 -- 172.21.15.26:0/2643601890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3b409e850 msgr2=0x7fe3b409ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:10.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.855+0000 7fe3b9557700 1 --2- 172.21.15.26:0/2643601890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3b409e850 0x7fe3b409ec20 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40098f0 tx=0x7fe3a4009c00 comp rx=0 tx=0).stop 2023-10-01T08:01:10.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.855+0000 7fe3b9557700 1 -- 172.21.15.26:0/2643601890 shutdown_connections 2023-10-01T08:01:10.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.855+0000 7fe3b9557700 1 --2- 172.21.15.26:0/2643601890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3b409e850 0x7fe3b409ec20 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:10.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.855+0000 7fe3b9557700 1 --2- 172.21.15.26:0/2643601890 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3b409f160 0x7fe3b4133bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:10.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.855+0000 7fe3b9557700 1 -- 172.21.15.26:0/2643601890 >> 172.21.15.26:0/2643601890 conn(0x7fe3b40a3f70 msgr2=0x7fe3b40a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:10.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.855+0000 7fe3b9557700 1 -- 172.21.15.26:0/2643601890 shutdown_connections 2023-10-01T08:01:10.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.855+0000 7fe3b9557700 1 -- 172.21.15.26:0/2643601890 wait complete. 2023-10-01T08:01:10.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.856+0000 7fe3b9557700 1 Processor -- start 2023-10-01T08:01:10.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.856+0000 7fe3b9557700 1 -- start start 2023-10-01T08:01:10.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.857+0000 7fe3b9557700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3b409e850 0x7fe3b4122420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:10.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.857+0000 7fe3b9557700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe3b409f160 0x7fe3b4122960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:10.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.857+0000 7fe3b9557700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3b409f5b0 0x7fe3b4122ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:10.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.857+0000 7fe3b9557700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b406fa80 con 0x7fe3b409f5b0 2023-10-01T08:01:10.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.857+0000 7fe3b9557700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b41252f0 con 0x7fe3b409e850 2023-10-01T08:01:10.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.857+0000 7fe3b9557700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b4124140 con 0x7fe3b409f160 2023-10-01T08:01:10.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.857+0000 7fe3b2ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3b409e850 0x7fe3b4122420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:10.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.857+0000 7fe3b27fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe3b409f160 0x7fe3b4122960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:10.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.857+0000 7fe3b37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3b409f5b0 0x7fe3b4122ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:10.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.857+0000 7fe3b2ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3b409e850 0x7fe3b4122420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51470/0 (socket says 172.21.15.26:51470) 2023-10-01T08:01:10.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.857+0000 7fe3b2ffd700 1 -- 172.21.15.26:0/3397389625 learned_addr learned my addr 172.21.15.26:0/3397389625 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:10.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.857+0000 7fe3b2ffd700 1 -- 172.21.15.26:0/3397389625 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe3b409f160 msgr2=0x7fe3b4122960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:10.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.857+0000 7fe3b2ffd700 1 --2- 172.21.15.26:0/3397389625 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe3b409f160 0x7fe3b4122960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:10.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.857+0000 7fe3b2ffd700 1 -- 172.21.15.26:0/3397389625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3b409f5b0 msgr2=0x7fe3b4122ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:10.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.857+0000 7fe3b2ffd700 1 --2- 172.21.15.26:0/3397389625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3b409f5b0 0x7fe3b4122ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:10.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.857+0000 7fe3b2ffd700 1 -- 172.21.15.26:0/3397389625 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39c0094a0 con 0x7fe3b409e850 2023-10-01T08:01:10.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.857+0000 7fe3b37fe700 1 --2- 172.21.15.26:0/3397389625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3b409f5b0 0x7fe3b4122ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:10.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.857+0000 7fe3b2ffd700 1 --2- 172.21.15.26:0/3397389625 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3b409e850 0x7fe3b4122420 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4009c40 tx=0x7fe3a4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:10.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.858+0000 7fe3ab7fe700 1 -- 172.21.15.26:0/3397389625 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4004510 con 0x7fe3b409e850 2023-10-01T08:01:10.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.858+0000 7fe3ab7fe700 1 -- 172.21.15.26:0/3397389625 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a401e070 con 0x7fe3b409e850 2023-10-01T08:01:10.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.858+0000 7fe3b9557700 1 -- 172.21.15.26:0/3397389625 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a4009550 con 0x7fe3b409e850 2023-10-01T08:01:10.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.858+0000 7fe3ab7fe700 1 -- 172.21.15.26:0/3397389625 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a40038c0 con 0x7fe3b409e850 2023-10-01T08:01:10.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.858+0000 7fe3b9557700 1 -- 172.21.15.26:0/3397389625 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b41259f0 con 0x7fe3b409e850 2023-10-01T08:01:10.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.858+0000 7fe3ab7fe700 1 -- 172.21.15.26:0/3397389625 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe3a4003a20 con 0x7fe3b409e850 2023-10-01T08:01:10.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.859+0000 7fe3ab7fe700 1 -- 172.21.15.26:0/3397389625 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe3a4040450 con 0x7fe3b409e850 2023-10-01T08:01:10.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.859+0000 7fe3b9557700 1 -- 172.21.15.26:0/3397389625 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3b40747f0 con 0x7fe3b409e850 2023-10-01T08:01:10.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:10.864+0000 7fe3ab7fe700 1 -- 172.21.15.26:0/3397389625 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe3a402d7d0 con 0x7fe3b409e850 2023-10-01T08:01:10.878 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:10.931 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:11.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.016+0000 7f406296d700 1 Processor -- start 2023-10-01T08:01:11.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.017+0000 7f406296d700 1 -- start start 2023-10-01T08:01:11.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.017+0000 7f406296d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f405c0a0a30 0x7f405c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:11.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.017+0000 7f406296d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f405c0a1340 0x7f405c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:11.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.017+0000 7f406296d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f405c09edd0 con 0x7f405c133fa0 2023-10-01T08:01:11.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.017+0000 7f406296d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f405c09e1f0 con 0x7f405c0a1340 2023-10-01T08:01:11.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.017+0000 7f406296d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f405c09dc50 con 0x7f405c0a0a30 2023-10-01T08:01:11.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.017+0000 7f405bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f405c0a0a30 0x7f405c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:11.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.017+0000 7f405bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f405c0a0a30 0x7f405c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51482/0 (socket says 172.21.15.26:51482) 2023-10-01T08:01:11.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.017+0000 7f405bfff700 1 -- 172.21.15.26:0/3747333754 learned_addr learned my addr 172.21.15.26:0/3747333754 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:11.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.017+0000 7f405b7fe700 1 --2- 172.21.15.26:0/3747333754 >> v2:172.21.15.26:3300/0 conn(0x7f405c0a1340 0x7f405c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:11.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.018+0000 7f405bfff700 1 -- 172.21.15.26:0/3747333754 >> v2:172.21.15.26:3300/0 conn(0x7f405c0a1340 msgr2=0x7f405c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:11.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.018+0000 7f405bfff700 1 --2- 172.21.15.26:0/3747333754 >> v2:172.21.15.26:3300/0 conn(0x7f405c0a1340 0x7f405c133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:11.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.018+0000 7f405bfff700 1 -- 172.21.15.26:0/3747333754 >> v1:172.21.15.26:6789/0 conn(0x7f405c133fa0 legacy=0x7f405c13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:11.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.018+0000 7f405bfff700 1 -- 172.21.15.26:0/3747333754 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405c0a1fe0 con 0x7f405c0a0a30 2023-10-01T08:01:11.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.018+0000 7f405bfff700 1 --2- 172.21.15.26:0/3747333754 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f405c0a0a30 0x7f405c0a0e00 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f404c0098f0 tx=0x7f404c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec824aad09e3e1be server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:11.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.018+0000 7f405affd700 1 -- 172.21.15.26:0/3747333754 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c011830 con 0x7f405c0a0a30 2023-10-01T08:01:11.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.018+0000 7f405affd700 1 -- 172.21.15.26:0/3747333754 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404c011990 con 0x7f405c0a0a30 2023-10-01T08:01:11.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.018+0000 7f405affd700 1 -- 172.21.15.26:0/3747333754 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c011d20 con 0x7f405c0a0a30 2023-10-01T08:01:11.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.019+0000 7f406296d700 1 -- 172.21.15.26:0/3747333754 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f405c0a0a30 msgr2=0x7f405c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:11.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.019+0000 7f406296d700 1 --2- 172.21.15.26:0/3747333754 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f405c0a0a30 0x7f405c0a0e00 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f404c0098f0 tx=0x7f404c009c00 comp rx=0 tx=0).stop 2023-10-01T08:01:11.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.019+0000 7f406296d700 1 -- 172.21.15.26:0/3747333754 shutdown_connections 2023-10-01T08:01:11.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.019+0000 7f406296d700 1 --2- 172.21.15.26:0/3747333754 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f405c0a0a30 0x7f405c0a0e00 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:11.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.019+0000 7f406296d700 1 --2- 172.21.15.26:0/3747333754 >> v2:172.21.15.26:3300/0 conn(0x7f405c0a1340 0x7f405c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:11.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.019+0000 7f406296d700 1 -- 172.21.15.26:0/3747333754 >> 172.21.15.26:0/3747333754 conn(0x7f405c0a6550 msgr2=0x7f405c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:11.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.019+0000 7f406296d700 1 -- 172.21.15.26:0/3747333754 shutdown_connections 2023-10-01T08:01:11.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.019+0000 7f406296d700 1 -- 172.21.15.26:0/3747333754 wait complete. 2023-10-01T08:01:11.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.020+0000 7f406296d700 1 Processor -- start 2023-10-01T08:01:11.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.020+0000 7f406296d700 1 -- start start 2023-10-01T08:01:11.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.020+0000 7f406296d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f405c0a0a30 0x7f405c11e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:11.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.021+0000 7f406296d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f405c0a1340 0x7f405c11ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:11.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.021+0000 7f406296d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f405c133fa0 0x7f405c11f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:11.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.021+0000 7f406296d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405c120520 con 0x7f405c0a1340 2023-10-01T08:01:11.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.021+0000 7f406296d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f405c0a37e0 con 0x7f405c0a0a30 2023-10-01T08:01:11.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.021+0000 7f406296d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f405c120980 con 0x7f405c133fa0 2023-10-01T08:01:11.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.021+0000 7f405bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f405c0a0a30 0x7f405c11e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:11.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.021+0000 7f405b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f405c0a1340 0x7f405c11ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:11.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.021+0000 7f405bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f405c0a0a30 0x7f405c11e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51486/0 (socket says 172.21.15.26:51486) 2023-10-01T08:01:11.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.021+0000 7f405bfff700 1 -- 172.21.15.26:0/1065644786 learned_addr learned my addr 172.21.15.26:0/1065644786 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:11.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.021+0000 7f4060f0a700 1 --2- 172.21.15.26:0/1065644786 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f405c133fa0 0x7f405c11f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:11.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.021+0000 7f4060f0a700 1 -- 172.21.15.26:0/1065644786 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f405c0a0a30 msgr2=0x7f405c11e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:11.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.021+0000 7f4060f0a700 1 --2- 172.21.15.26:0/1065644786 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f405c0a0a30 0x7f405c11e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:11.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.021+0000 7f4060f0a700 1 -- 172.21.15.26:0/1065644786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f405c0a1340 msgr2=0x7f405c11ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:11.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.021+0000 7f4060f0a700 1 --2- 172.21.15.26:0/1065644786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f405c0a1340 0x7f405c11ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:11.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.021+0000 7f4060f0a700 1 -- 172.21.15.26:0/1065644786 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f404c009550 con 0x7f405c133fa0 2023-10-01T08:01:11.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.021+0000 7f4060f0a700 1 --2- 172.21.15.26:0/1065644786 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f405c133fa0 0x7f405c11f2a0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f405400cb90 tx=0x7f405400cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:11.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.022+0000 7f4058ff9700 1 -- 172.21.15.26:0/1065644786 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4054003c00 con 0x7f405c133fa0 2023-10-01T08:01:11.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.022+0000 7f4058ff9700 1 -- 172.21.15.26:0/1065644786 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4054003d60 con 0x7f405c133fa0 2023-10-01T08:01:11.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.022+0000 7f406296d700 1 -- 172.21.15.26:0/1065644786 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f405c0a0220 con 0x7f405c133fa0 2023-10-01T08:01:11.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.022+0000 7f4058ff9700 1 -- 172.21.15.26:0/1065644786 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405400aa80 con 0x7f405c133fa0 2023-10-01T08:01:11.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.022+0000 7f406296d700 1 -- 172.21.15.26:0/1065644786 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f405c122080 con 0x7f405c133fa0 2023-10-01T08:01:11.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.023+0000 7f406296d700 1 -- 172.21.15.26:0/1065644786 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f405c121e50 con 0x7f405c133fa0 2023-10-01T08:01:11.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.023+0000 7f4058ff9700 1 -- 172.21.15.26:0/1065644786 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f405400abe0 con 0x7f405c133fa0 2023-10-01T08:01:11.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.024+0000 7f4058ff9700 1 -- 172.21.15.26:0/1065644786 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4054040000 con 0x7f405c133fa0 2023-10-01T08:01:11.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.032+0000 7f4058ff9700 1 -- 172.21.15.26:0/1065644786 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4054011560 con 0x7f405c133fa0 2023-10-01T08:01:11.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.073+0000 7f213b417700 1 Processor -- start 2023-10-01T08:01:11.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.073+0000 7f213b417700 1 -- start start 2023-10-01T08:01:11.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.073+0000 7f213b417700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21341338a0 0x7f2134133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:11.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.073+0000 7f213b417700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f213409de50 0x7f213409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:11.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.073+0000 7f213b417700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f213409e760 0x7f213413a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:11.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.073+0000 7f213b417700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f213406fef0 con 0x7f213409e760 2023-10-01T08:01:11.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.073+0000 7f213b417700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f213406ef30 con 0x7f21341338a0 2023-10-01T08:01:11.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.073+0000 7f213b417700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21341334b0 con 0x7f213409de50 2023-10-01T08:01:11.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.074+0000 7f21389b2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f213409de50 0x7f213409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:11.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.074+0000 7f21399b4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f213409e760 0x7f213413a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:11.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.074+0000 7f21391b3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21341338a0 0x7f2134133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:11.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.074+0000 7f21391b3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21341338a0 0x7f2134133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51498/0 (socket says 172.21.15.26:51498) 2023-10-01T08:01:11.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.074+0000 7f21389b2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f213409de50 0x7f213409e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57022/0 (socket says 172.21.15.26:57022) 2023-10-01T08:01:11.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.074+0000 7f21399b4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f213409e760 0x7f213413a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55344/0 (socket says 172.21.15.26:55344) 2023-10-01T08:01:11.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.074+0000 7f21391b3700 1 -- 172.21.15.26:0/82101925 learned_addr learned my addr 172.21.15.26:0/82101925 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:11.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.074+0000 7fe3b9557700 1 -- 172.21.15.26:0/3397389625 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe3b406bbb0 con 0x7fe3b409e850 2023-10-01T08:01:11.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.074+0000 7f21399b4700 1 -- 172.21.15.26:0/82101925 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f213409de50 msgr2=0x7f213409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:11.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.074+0000 7f21399b4700 1 --2- 172.21.15.26:0/82101925 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f213409de50 0x7f213409e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:11.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.074+0000 7f21399b4700 1 -- 172.21.15.26:0/82101925 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21341338a0 msgr2=0x7f2134133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:11.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.074+0000 7f21399b4700 1 --2- 172.21.15.26:0/82101925 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21341338a0 0x7f2134133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:11.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.074+0000 7f21399b4700 1 -- 172.21.15.26:0/82101925 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f213406fc30 con 0x7f213409e760 2023-10-01T08:01:11.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.074+0000 7f21391b3700 1 --2- 172.21.15.26:0/82101925 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21341338a0 0x7f2134133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:11.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.074+0000 7f21399b4700 1 --2- 172.21.15.26:0/82101925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f213409e760 0x7f213413a730 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f212c009d90 tx=0x7f212c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b35f982fc827b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:11.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.074+0000 7fe3ab7fe700 1 -- 172.21.15.26:0/3397389625 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe3a4023ba0 con 0x7fe3b409e850 2023-10-01T08:01:11.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.075+0000 7f212bfff700 1 -- 172.21.15.26:0/82101925 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c00e070 con 0x7f213409e760 2023-10-01T08:01:11.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.075+0000 7f212bfff700 1 -- 172.21.15.26:0/82101925 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212c00bb20 con 0x7f213409e760 2023-10-01T08:01:11.078 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:11.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.075+0000 7f212bfff700 1 -- 172.21.15.26:0/82101925 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c012430 con 0x7f213409e760 2023-10-01T08:01:11.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.075+0000 7f213b417700 1 -- 172.21.15.26:0/82101925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f213409e760 msgr2=0x7f213413a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:11.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.075+0000 7f213b417700 1 --2- 172.21.15.26:0/82101925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f213409e760 0x7f213413a730 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f212c009d90 tx=0x7f212c00b330 comp rx=0 tx=0).stop 2023-10-01T08:01:11.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.076+0000 7f213b417700 1 -- 172.21.15.26:0/82101925 shutdown_connections 2023-10-01T08:01:11.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.076+0000 7f213b417700 1 --2- 172.21.15.26:0/82101925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f213409e760 0x7f213413a730 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:11.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.076+0000 7f213b417700 1 --2- 172.21.15.26:0/82101925 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21341338a0 0x7f2134133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:11.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.076+0000 7f213b417700 1 --2- 172.21.15.26:0/82101925 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f213409de50 0x7f213409e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:11.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.076+0000 7f213b417700 1 -- 172.21.15.26:0/82101925 >> 172.21.15.26:0/82101925 conn(0x7f21340a2aa0 msgr2=0x7f21340a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:11.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.076+0000 7f213b417700 1 -- 172.21.15.26:0/82101925 shutdown_connections 2023-10-01T08:01:11.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.076+0000 7f213b417700 1 -- 172.21.15.26:0/82101925 wait complete. 2023-10-01T08:01:11.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.077+0000 7f213b417700 1 Processor -- start 2023-10-01T08:01:11.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.077+0000 7f213b417700 1 -- start start 2023-10-01T08:01:11.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.078+0000 7fe3b9557700 1 -- 172.21.15.26:0/3397389625 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3b409e850 msgr2=0x7fe3b4122420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:11.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.078+0000 7fe3b9557700 1 --2- 172.21.15.26:0/3397389625 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3b409e850 0x7fe3b4122420 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4009c40 tx=0x7fe3a4004750 comp rx=0 tx=0).stop 2023-10-01T08:01:11.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.078+0000 7fe3b9557700 1 -- 172.21.15.26:0/3397389625 shutdown_connections 2023-10-01T08:01:11.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.078+0000 7fe3b9557700 1 --2- 172.21.15.26:0/3397389625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3b409f5b0 0x7fe3b4122ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:11.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.078+0000 7fe3b9557700 1 --2- 172.21.15.26:0/3397389625 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3b409e850 0x7fe3b4122420 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:11.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.078+0000 7fe3b9557700 1 --2- 172.21.15.26:0/3397389625 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe3b409f160 0x7fe3b4122960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:11.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.078+0000 7fe3b9557700 1 -- 172.21.15.26:0/3397389625 >> 172.21.15.26:0/3397389625 conn(0x7fe3b40a3f70 msgr2=0x7fe3b4133f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:11.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.078+0000 7f213b417700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f213409de50 0x7f21341c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:11.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.078+0000 7f213b417700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f213409e760 0x7f21341c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:11.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.078+0000 7f213b417700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21341338a0 0x7f213411ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:11.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.078+0000 7f213b417700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2134123480 con 0x7f213409de50 2023-10-01T08:01:11.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.078+0000 7f213b417700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2134122650 con 0x7f21341338a0 2023-10-01T08:01:11.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.078+0000 7f213b417700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21341228a0 con 0x7f213409e760 2023-10-01T08:01:11.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.078+0000 7f21399b4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21341338a0 0x7f213411ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:11.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.078+0000 7f21399b4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21341338a0 0x7f213411ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51506/0 (socket says 172.21.15.26:51506) 2023-10-01T08:01:11.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.078+0000 7f21399b4700 1 -- 172.21.15.26:0/1050095160 learned_addr learned my addr 172.21.15.26:0/1050095160 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:11.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.078+0000 7f21391b3700 1 --2- 172.21.15.26:0/1050095160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f213409de50 0x7f21341c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:11.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.078+0000 7f21389b2700 1 --2- 172.21.15.26:0/1050095160 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f213409e760 0x7f21341c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:11.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.079+0000 7fe3b9557700 1 -- 172.21.15.26:0/3397389625 shutdown_connections 2023-10-01T08:01:11.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.079+0000 7fe3b9557700 1 -- 172.21.15.26:0/3397389625 wait complete. 2023-10-01T08:01:11.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.079+0000 7f21399b4700 1 -- 172.21.15.26:0/1050095160 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f213409e760 msgr2=0x7f21341c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:11.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.079+0000 7f21399b4700 1 --2- 172.21.15.26:0/1050095160 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f213409e760 0x7f21341c8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:11.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.079+0000 7f21399b4700 1 -- 172.21.15.26:0/1050095160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f213409de50 msgr2=0x7f21341c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:11.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.079+0000 7f21399b4700 1 --2- 172.21.15.26:0/1050095160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f213409de50 0x7f21341c8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:11.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.079+0000 7f21399b4700 1 -- 172.21.15.26:0/1050095160 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2130009550 con 0x7f21341338a0 2023-10-01T08:01:11.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.079+0000 7f21391b3700 1 --2- 172.21.15.26:0/1050095160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f213409de50 0x7f21341c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:11.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.079+0000 7f21399b4700 1 --2- 172.21.15.26:0/1050095160 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21341338a0 0x7f213411ed80 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f212c00b680 tx=0x7f212c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:11.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.079+0000 7f2129ffb700 1 -- 172.21.15.26:0/1050095160 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c0048b0 con 0x7f21341338a0 2023-10-01T08:01:11.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.079+0000 7f2129ffb700 1 -- 172.21.15.26:0/1050095160 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212c020070 con 0x7f21341338a0 2023-10-01T08:01:11.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.079+0000 7f213b417700 1 -- 172.21.15.26:0/1050095160 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f212c009a70 con 0x7f21341338a0 2023-10-01T08:01:11.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.079+0000 7f2129ffb700 1 -- 172.21.15.26:0/1050095160 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c0276c0 con 0x7f21341338a0 2023-10-01T08:01:11.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.079+0000 7f213b417700 1 -- 172.21.15.26:0/1050095160 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21340a0fb0 con 0x7f21341338a0 2023-10-01T08:01:11.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.080+0000 7f2129ffb700 1 -- 172.21.15.26:0/1050095160 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f212c012430 con 0x7f21341338a0 2023-10-01T08:01:11.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.081+0000 7f213b417700 1 -- 172.21.15.26:0/1050095160 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f213404ea50 con 0x7f21341338a0 2023-10-01T08:01:11.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.081+0000 7f2129ffb700 1 -- 172.21.15.26:0/1050095160 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f212c022070 con 0x7f21341338a0 2023-10-01T08:01:11.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.090+0000 7f2129ffb700 1 -- 172.21.15.26:0/1050095160 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f212c0267f0 con 0x7f21341338a0 2023-10-01T08:01:11.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:11.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.247+0000 7f406296d700 1 -- 172.21.15.26:0/1065644786 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f405c074ea0 con 0x7f405c133fa0 2023-10-01T08:01:11.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.247+0000 7f4058ff9700 1 -- 172.21.15.26:0/1065644786 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4054011380 con 0x7f405c133fa0 2023-10-01T08:01:11.248 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:11.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.250+0000 7f406296d700 1 -- 172.21.15.26:0/1065644786 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f405c133fa0 msgr2=0x7f405c11f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:11.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.250+0000 7f406296d700 1 --2- 172.21.15.26:0/1065644786 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f405c133fa0 0x7f405c11f2a0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f405400cb90 tx=0x7f405400cea0 comp rx=0 tx=0).stop 2023-10-01T08:01:11.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.250+0000 7f406296d700 1 -- 172.21.15.26:0/1065644786 shutdown_connections 2023-10-01T08:01:11.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.250+0000 7f406296d700 1 --2- 172.21.15.26:0/1065644786 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f405c133fa0 0x7f405c11f2a0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:11.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.250+0000 7f406296d700 1 --2- 172.21.15.26:0/1065644786 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f405c0a0a30 0x7f405c11e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:11.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.250+0000 7f406296d700 1 --2- 172.21.15.26:0/1065644786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f405c0a1340 0x7f405c11ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:11.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.250+0000 7f406296d700 1 -- 172.21.15.26:0/1065644786 >> 172.21.15.26:0/1065644786 conn(0x7f405c0a6550 msgr2=0x7f405c09a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:11.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.250+0000 7f406296d700 1 -- 172.21.15.26:0/1065644786 shutdown_connections 2023-10-01T08:01:11.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.250+0000 7f406296d700 1 -- 172.21.15.26:0/1065644786 wait complete. 2023-10-01T08:01:11.264 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:11.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.297+0000 7f213b417700 1 -- 172.21.15.26:0/1050095160 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2134074ea0 con 0x7f21341338a0 2023-10-01T08:01:11.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.297+0000 7f2129ffb700 1 -- 172.21.15.26:0/1050095160 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f212c025380 con 0x7f21341338a0 2023-10-01T08:01:11.298 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:11.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.300+0000 7f213b417700 1 -- 172.21.15.26:0/1050095160 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21341338a0 msgr2=0x7f213411ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:11.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.300+0000 7f213b417700 1 --2- 172.21.15.26:0/1050095160 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21341338a0 0x7f213411ed80 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f212c00b680 tx=0x7f212c004ad0 comp rx=0 tx=0).stop 2023-10-01T08:01:11.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.300+0000 7f213b417700 1 -- 172.21.15.26:0/1050095160 shutdown_connections 2023-10-01T08:01:11.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.300+0000 7f213b417700 1 --2- 172.21.15.26:0/1050095160 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f21341338a0 0x7f213411ed80 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:11.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.300+0000 7f213b417700 1 --2- 172.21.15.26:0/1050095160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f213409de50 0x7f21341c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:11.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.300+0000 7f213b417700 1 --2- 172.21.15.26:0/1050095160 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f213409e760 0x7f21341c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:11.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.300+0000 7f213b417700 1 -- 172.21.15.26:0/1050095160 >> 172.21.15.26:0/1050095160 conn(0x7f21340a2aa0 msgr2=0x7f213409ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:11.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.300+0000 7f213b417700 1 -- 172.21.15.26:0/1050095160 shutdown_connections 2023-10-01T08:01:11.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.300+0000 7f213b417700 1 -- 172.21.15.26:0/1050095160 wait complete. 2023-10-01T08:01:11.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:11.638 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:11.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.783+0000 7f873a2be700 1 Processor -- start 2023-10-01T08:01:11.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.783+0000 7f873a2be700 1 -- start start 2023-10-01T08:01:11.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.783+0000 7f873a2be700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f873409d630 0x7f87340a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:11.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.783+0000 7f873a2be700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8734138d80 0x7f873413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:11.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.783+0000 7f873a2be700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87340a2a70 con 0x7f87340a0a30 2023-10-01T08:01:11.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.783+0000 7f873a2be700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87340a01d0 con 0x7f873409d630 2023-10-01T08:01:11.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.783+0000 7f873a2be700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f873409e2b0 con 0x7f8734138d80 2023-10-01T08:01:11.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.784+0000 7f87337fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f873409d630 0x7f87340a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:11.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.784+0000 7f873885b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8734138d80 0x7f873413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:11.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.784+0000 7f873885b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8734138d80 0x7f873413b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51508/0 (socket says 172.21.15.26:51508) 2023-10-01T08:01:11.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.784+0000 7f87337fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f873409d630 0x7f87340a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55358/0 (socket says 172.21.15.26:55358) 2023-10-01T08:01:11.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.784+0000 7f873885b700 1 -- 172.21.15.26:0/3000299120 learned_addr learned my addr 172.21.15.26:0/3000299120 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:11.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.784+0000 7f873885b700 1 -- 172.21.15.26:0/3000299120 >> v2:172.21.15.26:3300/0 conn(0x7f873409d630 msgr2=0x7f87340a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:11.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.784+0000 7f873885b700 1 --2- 172.21.15.26:0/3000299120 >> v2:172.21.15.26:3300/0 conn(0x7f873409d630 0x7f87340a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:11.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.784+0000 7f873885b700 1 -- 172.21.15.26:0/3000299120 >> v1:172.21.15.26:6789/0 conn(0x7f87340a0a30 legacy=0x7f87340a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:11.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.784+0000 7f873885b700 1 -- 172.21.15.26:0/3000299120 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873409dc50 con 0x7f8734138d80 2023-10-01T08:01:11.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.784+0000 7f87337fe700 1 --2- 172.21.15.26:0/3000299120 >> v2:172.21.15.26:3300/0 conn(0x7f873409d630 0x7f87340a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:11.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.784+0000 7f873885b700 1 --2- 172.21.15.26:0/3000299120 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8734138d80 0x7f873413b160 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f872c009e50 tx=0x7f872c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62ca5df89c9700e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:11.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.784+0000 7f8732ffd700 1 -- 172.21.15.26:0/3000299120 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c00e070 con 0x7f8734138d80 2023-10-01T08:01:11.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.784+0000 7f8732ffd700 1 -- 172.21.15.26:0/3000299120 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872c00b910 con 0x7f8734138d80 2023-10-01T08:01:11.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.784+0000 7f8732ffd700 1 -- 172.21.15.26:0/3000299120 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c00bcc0 con 0x7f8734138d80 2023-10-01T08:01:11.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.785+0000 7f873a2be700 1 -- 172.21.15.26:0/3000299120 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8734138d80 msgr2=0x7f873413b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:11.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.785+0000 7f873a2be700 1 --2- 172.21.15.26:0/3000299120 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8734138d80 0x7f873413b160 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f872c009e50 tx=0x7f872c00b330 comp rx=0 tx=0).stop 2023-10-01T08:01:11.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.785+0000 7f873a2be700 1 -- 172.21.15.26:0/3000299120 shutdown_connections 2023-10-01T08:01:11.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.785+0000 7f873a2be700 1 --2- 172.21.15.26:0/3000299120 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8734138d80 0x7f873413b160 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:11.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.785+0000 7f873a2be700 1 --2- 172.21.15.26:0/3000299120 >> v2:172.21.15.26:3300/0 conn(0x7f873409d630 0x7f87340a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:11.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.785+0000 7f873a2be700 1 -- 172.21.15.26:0/3000299120 >> 172.21.15.26:0/3000299120 conn(0x7f87340a3050 msgr2=0x7f87340a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:11.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.785+0000 7f873a2be700 1 -- 172.21.15.26:0/3000299120 shutdown_connections 2023-10-01T08:01:11.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.785+0000 7f873a2be700 1 -- 172.21.15.26:0/3000299120 wait complete. 2023-10-01T08:01:11.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.786+0000 7f873a2be700 1 Processor -- start 2023-10-01T08:01:11.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.786+0000 7f873a2be700 1 -- start start 2023-10-01T08:01:11.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.787+0000 7f873a2be700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f873409d630 0x7f8734120620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:11.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.787+0000 7f873a2be700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87340a0a30 0x7f8734120b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:11.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.787+0000 7f873a2be700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8734138d80 0x7f87341210a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:11.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.787+0000 7f873a2be700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8734124140 con 0x7f87340a0a30 2023-10-01T08:01:11.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.787+0000 7f873a2be700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87341234f0 con 0x7f873409d630 2023-10-01T08:01:11.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.787+0000 7f873a2be700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8734138b20 con 0x7f8734138d80 2023-10-01T08:01:11.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.787+0000 7f8733fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f873409d630 0x7f8734120620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:11.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.787+0000 7f87337fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87340a0a30 0x7f8734120b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:11.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.787+0000 7f8733fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f873409d630 0x7f8734120620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51524/0 (socket says 172.21.15.26:51524) 2023-10-01T08:01:11.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.787+0000 7f8733fff700 1 -- 172.21.15.26:0/1440102869 learned_addr learned my addr 172.21.15.26:0/1440102869 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:11.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.787+0000 7f87337fe700 1 --2- 172.21.15.26:0/1440102869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87340a0a30 0x7f8734120b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55366/0 (socket says 172.21.15.26:55366) 2023-10-01T08:01:11.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.787+0000 7f873885b700 1 --2- 172.21.15.26:0/1440102869 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8734138d80 0x7f87341210a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:11.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.787+0000 7f8733fff700 1 -- 172.21.15.26:0/1440102869 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8734138d80 msgr2=0x7f87341210a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:11.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.787+0000 7f8733fff700 1 --2- 172.21.15.26:0/1440102869 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8734138d80 0x7f87341210a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:11.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.787+0000 7f8733fff700 1 -- 172.21.15.26:0/1440102869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87340a0a30 msgr2=0x7f8734120b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:11.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.787+0000 7f8733fff700 1 --2- 172.21.15.26:0/1440102869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87340a0a30 0x7f8734120b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:11.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.787+0000 7f8733fff700 1 -- 172.21.15.26:0/1440102869 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87280094a0 con 0x7f873409d630 2023-10-01T08:01:11.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.787+0000 7f87337fe700 1 --2- 172.21.15.26:0/1440102869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87340a0a30 0x7f8734120b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:11.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.787+0000 7f8733fff700 1 --2- 172.21.15.26:0/1440102869 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f873409d630 0x7f8734120620 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f872400c4e0 tx=0x7f872400c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:11.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.787+0000 7f8730ff9700 1 -- 172.21.15.26:0/1440102869 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87240052d0 con 0x7f873409d630 2023-10-01T08:01:11.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.788+0000 7f8730ff9700 1 -- 172.21.15.26:0/1440102869 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8724005430 con 0x7f873409d630 2023-10-01T08:01:11.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.788+0000 7f873a2be700 1 -- 172.21.15.26:0/1440102869 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f872c009b30 con 0x7f873409d630 2023-10-01T08:01:11.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.788+0000 7f8730ff9700 1 -- 172.21.15.26:0/1440102869 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87240038c0 con 0x7f873409d630 2023-10-01T08:01:11.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.788+0000 7f873a2be700 1 -- 172.21.15.26:0/1440102869 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87340a0460 con 0x7f873409d630 2023-10-01T08:01:11.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.788+0000 7f8730ff9700 1 -- 172.21.15.26:0/1440102869 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8724003a20 con 0x7f873409d630 2023-10-01T08:01:11.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.789+0000 7f8730ff9700 1 -- 172.21.15.26:0/1440102869 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f872403eb90 con 0x7f873409d630 2023-10-01T08:01:11.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.789+0000 7f873a2be700 1 -- 172.21.15.26:0/1440102869 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8734124990 con 0x7f873409d630 2023-10-01T08:01:11.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.793+0000 7f8730ff9700 1 -- 172.21.15.26:0/1440102869 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8724017070 con 0x7f873409d630 2023-10-01T08:01:11.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.997+0000 7f873a2be700 1 -- 172.21.15.26:0/1440102869 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f87340747f0 con 0x7f873409d630 2023-10-01T08:01:11.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:11.998+0000 7f8730ff9700 1 -- 172.21.15.26:0/1440102869 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8724019e60 con 0x7f873409d630 2023-10-01T08:01:11.999 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:12.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.000+0000 7f873a2be700 1 -- 172.21.15.26:0/1440102869 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f873409d630 msgr2=0x7f8734120620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:12.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.000+0000 7f873a2be700 1 --2- 172.21.15.26:0/1440102869 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f873409d630 0x7f8734120620 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f872400c4e0 tx=0x7f872400c7f0 comp rx=0 tx=0).stop 2023-10-01T08:01:12.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.000+0000 7f873a2be700 1 -- 172.21.15.26:0/1440102869 shutdown_connections 2023-10-01T08:01:12.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.000+0000 7f873a2be700 1 --2- 172.21.15.26:0/1440102869 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8734138d80 0x7f87341210a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:12.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.000+0000 7f873a2be700 1 --2- 172.21.15.26:0/1440102869 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f873409d630 0x7f8734120620 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:12.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.000+0000 7f873a2be700 1 --2- 172.21.15.26:0/1440102869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87340a0a30 0x7f8734120b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:12.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.000+0000 7f873a2be700 1 -- 172.21.15.26:0/1440102869 >> 172.21.15.26:0/1440102869 conn(0x7f87340a3050 msgr2=0x7f8734139150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:12.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.000+0000 7f873a2be700 1 -- 172.21.15.26:0/1440102869 shutdown_connections 2023-10-01T08:01:12.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.000+0000 7f873a2be700 1 -- 172.21.15.26:0/1440102869 wait complete. 2023-10-01T08:01:12.015 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:12.096 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:12.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.237+0000 7fb8526bb700 1 Processor -- start 2023-10-01T08:01:12.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.237+0000 7fb8526bb700 1 -- start start 2023-10-01T08:01:12.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.237+0000 7fb8526bb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb84c09d6f0 0x7fb84c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:12.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.237+0000 7fb8526bb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb84c09e000 0x7fb84c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:12.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.237+0000 7fb8526bb700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb84c09f130 con 0x7fb84c09e410 2023-10-01T08:01:12.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.237+0000 7fb8526bb700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb84c09f520 con 0x7fb84c09d6f0 2023-10-01T08:01:12.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.237+0000 7fb8526bb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb84c09e930 con 0x7fb84c09e000 2023-10-01T08:01:12.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.237+0000 7fb84bfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb84c09d6f0 0x7fb84c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:12.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.237+0000 7fb84b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb84c09e000 0x7fb84c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:12.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.237+0000 7fb84bfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb84c09d6f0 0x7fb84c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55378/0 (socket says 172.21.15.26:55378) 2023-10-01T08:01:12.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.237+0000 7fb84b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb84c09e000 0x7fb84c130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51532/0 (socket says 172.21.15.26:51532) 2023-10-01T08:01:12.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.237+0000 7fb84bfff700 1 -- 172.21.15.26:0/551509414 learned_addr learned my addr 172.21.15.26:0/551509414 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:12.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.238+0000 7fb84bfff700 1 -- 172.21.15.26:0/551509414 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb84c09e000 msgr2=0x7fb84c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:12.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.238+0000 7fb84bfff700 1 --2- 172.21.15.26:0/551509414 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb84c09e000 0x7fb84c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:12.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.238+0000 7fb84bfff700 1 -- 172.21.15.26:0/551509414 >> v1:172.21.15.26:6789/0 conn(0x7fb84c09e410 legacy=0x7fb84c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:12.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.238+0000 7fb84bfff700 1 -- 172.21.15.26:0/551509414 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84c09b2d0 con 0x7fb84c09d6f0 2023-10-01T08:01:12.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.238+0000 7fb84affd700 1 -- 172.21.15.26:0/551509414 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1633298081 0 0) 0x7fb84c09f130 con 0x7fb84c09e410 2023-10-01T08:01:12.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.238+0000 7fb84b7fe700 1 --2- 172.21.15.26:0/551509414 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb84c09e000 0x7fb84c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:12.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.238+0000 7fb84bfff700 1 --2- 172.21.15.26:0/551509414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb84c09d6f0 0x7fb84c09dac0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7fb83c0098f0 tx=0x7fb83c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acfdfd77fa226b53 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:12.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.238+0000 7fb84affd700 1 -- 172.21.15.26:0/551509414 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c011830 con 0x7fb84c09d6f0 2023-10-01T08:01:12.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.238+0000 7fb84affd700 1 -- 172.21.15.26:0/551509414 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83c011990 con 0x7fb84c09d6f0 2023-10-01T08:01:12.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.238+0000 7fb84affd700 1 -- 172.21.15.26:0/551509414 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c011d20 con 0x7fb84c09d6f0 2023-10-01T08:01:12.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.239+0000 7fb8526bb700 1 -- 172.21.15.26:0/551509414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb84c09d6f0 msgr2=0x7fb84c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:12.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.239+0000 7fb8526bb700 1 --2- 172.21.15.26:0/551509414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb84c09d6f0 0x7fb84c09dac0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7fb83c0098f0 tx=0x7fb83c009c00 comp rx=0 tx=0).stop 2023-10-01T08:01:12.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.239+0000 7fb8526bb700 1 -- 172.21.15.26:0/551509414 shutdown_connections 2023-10-01T08:01:12.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.239+0000 7fb8526bb700 1 --2- 172.21.15.26:0/551509414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb84c09d6f0 0x7fb84c09dac0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:12.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.239+0000 7fb8526bb700 1 --2- 172.21.15.26:0/551509414 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb84c09e000 0x7fb84c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:12.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.239+0000 7fb8526bb700 1 -- 172.21.15.26:0/551509414 >> 172.21.15.26:0/551509414 conn(0x7fb84c066f50 msgr2=0x7fb84c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:12.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.239+0000 7fb8526bb700 1 -- 172.21.15.26:0/551509414 shutdown_connections 2023-10-01T08:01:12.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.239+0000 7fb8526bb700 1 -- 172.21.15.26:0/551509414 wait complete. 2023-10-01T08:01:12.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.240+0000 7fb8526bb700 1 Processor -- start 2023-10-01T08:01:12.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.240+0000 7fb8526bb700 1 -- start start 2023-10-01T08:01:12.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.241+0000 7fb8526bb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb84c09d6f0 0x7fb84c11eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:12.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.241+0000 7fb8526bb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb84c09e000 0x7fb84c11f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:12.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.241+0000 7fb8526bb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb84c09e410 0x7fb84c11f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:12.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.241+0000 7fb8526bb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84c120ab0 con 0x7fb84c09e000 2023-10-01T08:01:12.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.241+0000 7fb8526bb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb84c120300 con 0x7fb84c09d6f0 2023-10-01T08:01:12.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.241+0000 7fb8526bb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb84c121940 con 0x7fb84c09e410 2023-10-01T08:01:12.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.241+0000 7fb84bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb84c09d6f0 0x7fb84c11eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:12.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.241+0000 7fb84bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb84c09d6f0 0x7fb84c11eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51544/0 (socket says 172.21.15.26:51544) 2023-10-01T08:01:12.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.241+0000 7fb84bfff700 1 -- 172.21.15.26:0/4038535119 learned_addr learned my addr 172.21.15.26:0/4038535119 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:12.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.241+0000 7fb84b7fe700 1 --2- 172.21.15.26:0/4038535119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb84c09e000 0x7fb84c11f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:12.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.241+0000 7fb850c58700 1 --2- 172.21.15.26:0/4038535119 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb84c09e410 0x7fb84c11f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:12.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.241+0000 7fb84bfff700 1 -- 172.21.15.26:0/4038535119 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb84c09e410 msgr2=0x7fb84c11f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:12.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.241+0000 7fb84bfff700 1 --2- 172.21.15.26:0/4038535119 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb84c09e410 0x7fb84c11f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:12.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.241+0000 7fb84bfff700 1 -- 172.21.15.26:0/4038535119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb84c09e000 msgr2=0x7fb84c11f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:12.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.242+0000 7fb84bfff700 1 --2- 172.21.15.26:0/4038535119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb84c09e000 0x7fb84c11f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:12.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.242+0000 7fb84bfff700 1 -- 172.21.15.26:0/4038535119 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8400094a0 con 0x7fb84c09d6f0 2023-10-01T08:01:12.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.242+0000 7fb84b7fe700 1 --2- 172.21.15.26:0/4038535119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb84c09e000 0x7fb84c11f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:12.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.242+0000 7fb84bfff700 1 --2- 172.21.15.26:0/4038535119 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb84c09d6f0 0x7fb84c11eea0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fb84c09b9e0 tx=0x7fb83c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:12.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.242+0000 7fb848ff9700 1 -- 172.21.15.26:0/4038535119 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c004300 con 0x7fb84c09d6f0 2023-10-01T08:01:12.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.242+0000 7fb848ff9700 1 -- 172.21.15.26:0/4038535119 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83c01f070 con 0x7fb84c09d6f0 2023-10-01T08:01:12.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.242+0000 7fb8526bb700 1 -- 172.21.15.26:0/4038535119 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb83c009550 con 0x7fb84c09d6f0 2023-10-01T08:01:12.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.242+0000 7fb848ff9700 1 -- 172.21.15.26:0/4038535119 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c0036a0 con 0x7fb84c09d6f0 2023-10-01T08:01:12.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.242+0000 7fb8526bb700 1 -- 172.21.15.26:0/4038535119 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb84c072620 con 0x7fb84c09d6f0 2023-10-01T08:01:12.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.243+0000 7fb848ff9700 1 -- 172.21.15.26:0/4038535119 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb83c021030 con 0x7fb84c09d6f0 2023-10-01T08:01:12.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.243+0000 7fb848ff9700 1 -- 172.21.15.26:0/4038535119 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb83c0409b0 con 0x7fb84c09d6f0 2023-10-01T08:01:12.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.243+0000 7fb8526bb700 1 -- 172.21.15.26:0/4038535119 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb84c074ea0 con 0x7fb84c09d6f0 2023-10-01T08:01:12.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.248+0000 7fb848ff9700 1 -- 172.21.15.26:0/4038535119 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb83c015080 con 0x7fb84c09d6f0 2023-10-01T08:01:12.265 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:12.315 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:12.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.406+0000 7fafdad26700 1 Processor -- start 2023-10-01T08:01:12.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.406+0000 7fafdad26700 1 -- start start 2023-10-01T08:01:12.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.406+0000 7fafdad26700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fafd4131810 0x7fafd4131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:12.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.406+0000 7fafdad26700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fafd409a580 0x7fafd4139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:12.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.406+0000 7fafdad26700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd41313c0 con 0x7fafd4099a40 2023-10-01T08:01:12.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.406+0000 7fafdad26700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd406e8c0 con 0x7fafd4131810 2023-10-01T08:01:12.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.406+0000 7fafdad26700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fafd4071d20 con 0x7fafd409a580 2023-10-01T08:01:12.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.406+0000 7fafd8ac2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fafd4131810 0x7fafd4131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:12.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.406+0000 7fafd8ac2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fafd4131810 0x7fafd4131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51556/0 (socket says 172.21.15.26:51556) 2023-10-01T08:01:12.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.407+0000 7fafd8ac2700 1 -- 172.21.15.26:0/1891502407 learned_addr learned my addr 172.21.15.26:0/1891502407 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:12.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.407+0000 7fafd92c3700 1 --2- 172.21.15.26:0/1891502407 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fafd409a580 0x7fafd4139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:12.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.407+0000 7fafd8ac2700 1 -- 172.21.15.26:0/1891502407 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fafd409a580 msgr2=0x7fafd4139660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:12.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.407+0000 7fafd8ac2700 1 --2- 172.21.15.26:0/1891502407 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fafd409a580 0x7fafd4139660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:12.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.407+0000 7fafd8ac2700 1 -- 172.21.15.26:0/1891502407 >> v1:172.21.15.26:6789/0 conn(0x7fafd4099a40 legacy=0x7fafd4099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:12.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.407+0000 7fafd8ac2700 1 -- 172.21.15.26:0/1891502407 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd40721a0 con 0x7fafd4131810 2023-10-01T08:01:12.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.407+0000 7fafd8ac2700 1 --2- 172.21.15.26:0/1891502407 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fafd4131810 0x7fafd4131be0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fafc8009920 tx=0x7fafc8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c647beb4076ca5b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:12.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.407+0000 7fafd37fe700 1 -- 172.21.15.26:0/1891502407 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc8011830 con 0x7fafd4131810 2023-10-01T08:01:12.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.407+0000 7fafd37fe700 1 -- 172.21.15.26:0/1891502407 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc8011990 con 0x7fafd4131810 2023-10-01T08:01:12.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.407+0000 7fafd37fe700 1 -- 172.21.15.26:0/1891502407 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc8011d20 con 0x7fafd4131810 2023-10-01T08:01:12.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.408+0000 7fafdad26700 1 -- 172.21.15.26:0/1891502407 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fafd4131810 msgr2=0x7fafd4131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:12.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.408+0000 7fafdad26700 1 --2- 172.21.15.26:0/1891502407 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fafd4131810 0x7fafd4131be0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fafc8009920 tx=0x7fafc8009c30 comp rx=0 tx=0).stop 2023-10-01T08:01:12.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.408+0000 7fafdad26700 1 -- 172.21.15.26:0/1891502407 shutdown_connections 2023-10-01T08:01:12.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.408+0000 7fafdad26700 1 --2- 172.21.15.26:0/1891502407 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fafd409a580 0x7fafd4139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:12.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.408+0000 7fafdad26700 1 --2- 172.21.15.26:0/1891502407 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fafd4131810 0x7fafd4131be0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:12.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.408+0000 7fafdad26700 1 -- 172.21.15.26:0/1891502407 >> 172.21.15.26:0/1891502407 conn(0x7fafd40a2aa0 msgr2=0x7fafd40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:12.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.408+0000 7fafdad26700 1 -- 172.21.15.26:0/1891502407 shutdown_connections 2023-10-01T08:01:12.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.408+0000 7fafdad26700 1 -- 172.21.15.26:0/1891502407 wait complete. 2023-10-01T08:01:12.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.409+0000 7fafdad26700 1 Processor -- start 2023-10-01T08:01:12.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.409+0000 7fafdad26700 1 -- start start 2023-10-01T08:01:12.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.410+0000 7fafdad26700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fafd4099a40 0x7fafd411b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:12.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.410+0000 7fafdad26700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafd409a580 0x7fafd411bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:12.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.410+0000 7fafdad26700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fafd4131810 0x7fafd411c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:12.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.410+0000 7fafdad26700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd411cd60 con 0x7fafd409a580 2023-10-01T08:01:12.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.410+0000 7fafdad26700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd412ebf0 con 0x7fafd4131810 2023-10-01T08:01:12.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.410+0000 7fafdad26700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fafd411e660 con 0x7fafd4099a40 2023-10-01T08:01:12.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.410+0000 7fafd8ac2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fafd4099a40 0x7fafd411b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:12.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.410+0000 7fafd8ac2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fafd4099a40 0x7fafd411b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57054/0 (socket says 172.21.15.26:57054) 2023-10-01T08:01:12.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.410+0000 7fafd8ac2700 1 -- 172.21.15.26:0/777941703 learned_addr learned my addr 172.21.15.26:0/777941703 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:12.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.410+0000 7fafd92c3700 1 --2- 172.21.15.26:0/777941703 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fafd4131810 0x7fafd411c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:12.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.410+0000 7fafd3fff700 1 --2- 172.21.15.26:0/777941703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafd409a580 0x7fafd411bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:12.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.410+0000 7fafd8ac2700 1 -- 172.21.15.26:0/777941703 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fafd4131810 msgr2=0x7fafd411c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:12.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.410+0000 7fafd8ac2700 1 --2- 172.21.15.26:0/777941703 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fafd4131810 0x7fafd411c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:12.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.410+0000 7fafd8ac2700 1 -- 172.21.15.26:0/777941703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafd409a580 msgr2=0x7fafd411bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:12.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.410+0000 7fafd8ac2700 1 --2- 172.21.15.26:0/777941703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafd409a580 0x7fafd411bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:12.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.410+0000 7fafd8ac2700 1 -- 172.21.15.26:0/777941703 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc8009550 con 0x7fafd4099a40 2023-10-01T08:01:12.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.411+0000 7fafd8ac2700 1 --2- 172.21.15.26:0/777941703 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fafd4099a40 0x7fafd411b890 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fafc800a010 tx=0x7fafc8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:12.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.411+0000 7fafd17fa700 1 -- 172.21.15.26:0/777941703 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc8004450 con 0x7fafd4099a40 2023-10-01T08:01:12.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.411+0000 7fafd17fa700 1 -- 172.21.15.26:0/777941703 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc80045b0 con 0x7fafd4099a40 2023-10-01T08:01:12.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.411+0000 7fafd17fa700 1 -- 172.21.15.26:0/777941703 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc80038e0 con 0x7fafd4099a40 2023-10-01T08:01:12.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.411+0000 7fafdad26700 1 -- 172.21.15.26:0/777941703 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd411f040 con 0x7fafd4099a40 2023-10-01T08:01:12.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.411+0000 7fafdad26700 1 -- 172.21.15.26:0/777941703 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd411da30 con 0x7fafd4099a40 2023-10-01T08:01:12.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.412+0000 7fafdad26700 1 -- 172.21.15.26:0/777941703 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd406eb00 con 0x7fafd4099a40 2023-10-01T08:01:12.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.412+0000 7fafd17fa700 1 -- 172.21.15.26:0/777941703 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fafc8003a40 con 0x7fafd4099a40 2023-10-01T08:01:12.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.413+0000 7fafd17fa700 1 -- 172.21.15.26:0/777941703 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fafc80406e0 con 0x7fafd4099a40 2023-10-01T08:01:12.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.422+0000 7fafd17fa700 1 -- 172.21.15.26:0/777941703 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fafc802b3a0 con 0x7fafd4099a40 2023-10-01T08:01:12.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.457+0000 7f9b2232f700 1 Processor -- start 2023-10-01T08:01:12.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.457+0000 7f9b2232f700 1 -- start start 2023-10-01T08:01:12.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.458+0000 7f9b2232f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9b1c09d630 0x7f9b1c0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:12.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.458+0000 7f9b2232f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9b1c138d80 0x7f9b1c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:12.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.458+0000 7f9b2232f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b1c0a2a70 con 0x7f9b1c0a0a30 2023-10-01T08:01:12.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.458+0000 7f9b2232f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b1c0a01d0 con 0x7f9b1c138d80 2023-10-01T08:01:12.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.458+0000 7f9b2232f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c09e2b0 con 0x7f9b1c09d630 2023-10-01T08:01:12.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.458+0000 7f9b1b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9b1c09d630 0x7f9b1c0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:12.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.458+0000 7f9b1b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9b1c09d630 0x7f9b1c0a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51576/0 (socket says 172.21.15.26:51576) 2023-10-01T08:01:12.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.458+0000 7f9b1b7fe700 1 -- 172.21.15.26:0/1717472294 learned_addr learned my addr 172.21.15.26:0/1717472294 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:12.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.458+0000 7f9b208cc700 1 --2- 172.21.15.26:0/1717472294 >> v2:172.21.15.26:3300/0 conn(0x7f9b1c138d80 0x7f9b1c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:12.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.458+0000 7f9b208cc700 1 -- 172.21.15.26:0/1717472294 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9b1c09d630 msgr2=0x7f9b1c0a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:12.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.458+0000 7f9b208cc700 1 --2- 172.21.15.26:0/1717472294 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9b1c09d630 0x7f9b1c0a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:12.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.458+0000 7f9b208cc700 1 -- 172.21.15.26:0/1717472294 >> v1:172.21.15.26:6789/0 conn(0x7f9b1c0a0a30 legacy=0x7f9b1c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:12.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.458+0000 7f9b208cc700 1 -- 172.21.15.26:0/1717472294 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b1c09dc50 con 0x7f9b1c138d80 2023-10-01T08:01:12.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.458+0000 7f9b1b7fe700 1 --2- 172.21.15.26:0/1717472294 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9b1c09d630 0x7f9b1c0a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:12.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.459+0000 7f9b208cc700 1 --2- 172.21.15.26:0/1717472294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b1c138d80 0x7f9b1c13b160 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f9b14009d90 tx=0x7f9b1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7180c41e3395c757 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:12.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.459+0000 7f9b1affd700 1 -- 172.21.15.26:0/1717472294 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1400e070 con 0x7f9b1c138d80 2023-10-01T08:01:12.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.459+0000 7f9b1affd700 1 -- 172.21.15.26:0/1717472294 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1400bb20 con 0x7f9b1c138d80 2023-10-01T08:01:12.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.459+0000 7f9b1affd700 1 -- 172.21.15.26:0/1717472294 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b14012430 con 0x7f9b1c138d80 2023-10-01T08:01:12.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.460+0000 7f9b2232f700 1 -- 172.21.15.26:0/1717472294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b1c138d80 msgr2=0x7f9b1c13b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:12.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.460+0000 7f9b2232f700 1 --2- 172.21.15.26:0/1717472294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b1c138d80 0x7f9b1c13b160 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f9b14009d90 tx=0x7f9b1400b330 comp rx=0 tx=0).stop 2023-10-01T08:01:12.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.460+0000 7f9b2232f700 1 -- 172.21.15.26:0/1717472294 shutdown_connections 2023-10-01T08:01:12.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.460+0000 7f9b2232f700 1 --2- 172.21.15.26:0/1717472294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b1c138d80 0x7f9b1c13b160 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:12.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.460+0000 7f9b2232f700 1 --2- 172.21.15.26:0/1717472294 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9b1c09d630 0x7f9b1c0a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:12.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.460+0000 7f9b2232f700 1 -- 172.21.15.26:0/1717472294 >> 172.21.15.26:0/1717472294 conn(0x7f9b1c0a3050 msgr2=0x7f9b1c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:12.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.460+0000 7f9b2232f700 1 -- 172.21.15.26:0/1717472294 shutdown_connections 2023-10-01T08:01:12.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.460+0000 7f9b2232f700 1 -- 172.21.15.26:0/1717472294 wait complete. 2023-10-01T08:01:12.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.461+0000 7f9b2232f700 1 Processor -- start 2023-10-01T08:01:12.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.461+0000 7f9b2232f700 1 -- start start 2023-10-01T08:01:12.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.462+0000 7f9b2232f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b1c09d630 0x7f9b1c133750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:12.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.462+0000 7f9b2232f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b1c0a0a30 0x7f9b1c133c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:12.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.462+0000 7f9b2232f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9b1c138d80 0x7f9b1c1341d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:12.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.462+0000 7f9b2232f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c134bb0 con 0x7f9b1c09d630 2023-10-01T08:01:12.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.462+0000 7f9b2232f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c136c40 con 0x7f9b1c138d80 2023-10-01T08:01:12.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.462+0000 7f9b2232f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c1389f0 con 0x7f9b1c0a0a30 2023-10-01T08:01:12.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.462+0000 7f9b1bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b1c09d630 0x7f9b1c133750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:12.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.462+0000 7f9b1bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b1c09d630 0x7f9b1c133750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55414/0 (socket says 172.21.15.26:55414) 2023-10-01T08:01:12.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.462+0000 7f9b1bfff700 1 -- 172.21.15.26:0/3248841279 learned_addr learned my addr 172.21.15.26:0/3248841279 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:12.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.462+0000 7f9b208cc700 1 --2- 172.21.15.26:0/3248841279 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9b1c138d80 0x7f9b1c1341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:12.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.462+0000 7f9b1b7fe700 1 --2- 172.21.15.26:0/3248841279 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b1c0a0a30 0x7f9b1c133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:12.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.462+0000 7f9b1bfff700 1 -- 172.21.15.26:0/3248841279 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b1c0a0a30 msgr2=0x7f9b1c133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:12.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.462+0000 7f9b1bfff700 1 --2- 172.21.15.26:0/3248841279 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b1c0a0a30 0x7f9b1c133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:12.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.462+0000 7f9b1bfff700 1 -- 172.21.15.26:0/3248841279 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9b1c138d80 msgr2=0x7f9b1c1341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:12.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.462+0000 7f9b1bfff700 1 --2- 172.21.15.26:0/3248841279 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9b1c138d80 0x7f9b1c1341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:12.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.462+0000 7f9b1bfff700 1 -- 172.21.15.26:0/3248841279 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b10009550 con 0x7f9b1c09d630 2023-10-01T08:01:12.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.462+0000 7f9b1b7fe700 1 --2- 172.21.15.26:0/3248841279 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b1c0a0a30 0x7f9b1c133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:12.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.463+0000 7f9b208cc700 1 --2- 172.21.15.26:0/3248841279 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9b1c138d80 0x7f9b1c1341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:12.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.463+0000 7f9b1bfff700 1 --2- 172.21.15.26:0/3248841279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b1c09d630 0x7f9b1c133750 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c00c4e0 tx=0x7f9b0c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:12.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.463+0000 7f9b18ff9700 1 -- 172.21.15.26:0/3248841279 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c0052d0 con 0x7f9b1c09d630 2023-10-01T08:01:12.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.463+0000 7f9b18ff9700 1 -- 172.21.15.26:0/3248841279 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0c005430 con 0x7f9b1c09d630 2023-10-01T08:01:12.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.463+0000 7f9b2232f700 1 -- 172.21.15.26:0/3248841279 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b14009a70 con 0x7f9b1c09d630 2023-10-01T08:01:12.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.463+0000 7f9b18ff9700 1 -- 172.21.15.26:0/3248841279 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c0038c0 con 0x7f9b1c09d630 2023-10-01T08:01:12.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.463+0000 7f9b2232f700 1 -- 172.21.15.26:0/3248841279 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b1c0a0410 con 0x7f9b1c09d630 2023-10-01T08:01:12.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.464+0000 7f9b18ff9700 1 -- 172.21.15.26:0/3248841279 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9b0c003a20 con 0x7f9b1c09d630 2023-10-01T08:01:12.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.464+0000 7f9b18ff9700 1 -- 172.21.15.26:0/3248841279 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9b0c03ea90 con 0x7f9b1c09d630 2023-10-01T08:01:12.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.465+0000 7f9b2232f700 1 -- 172.21.15.26:0/3248841279 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b1c0747f0 con 0x7f9b1c09d630 2023-10-01T08:01:12.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.469+0000 7f9b18ff9700 1 -- 172.21.15.26:0/3248841279 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9b0c018260 con 0x7f9b1c09d630 2023-10-01T08:01:12.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.471+0000 7fb8526bb700 1 -- 172.21.15.26:0/4038535119 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb84c06c360 con 0x7fb84c09d6f0 2023-10-01T08:01:12.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.472+0000 7fb848ff9700 1 -- 172.21.15.26:0/4038535119 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb83c0199a0 con 0x7fb84c09d6f0 2023-10-01T08:01:12.508 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:12.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.474+0000 7fb8526bb700 1 -- 172.21.15.26:0/4038535119 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb84c09d6f0 msgr2=0x7fb84c11eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:12.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.474+0000 7fb8526bb700 1 --2- 172.21.15.26:0/4038535119 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb84c09d6f0 0x7fb84c11eea0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fb84c09b9e0 tx=0x7fb83c004750 comp rx=0 tx=0).stop 2023-10-01T08:01:12.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.474+0000 7fb8526bb700 1 -- 172.21.15.26:0/4038535119 shutdown_connections 2023-10-01T08:01:12.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.474+0000 7fb8526bb700 1 --2- 172.21.15.26:0/4038535119 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb84c09e410 0x7fb84c11f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:12.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.474+0000 7fb8526bb700 1 --2- 172.21.15.26:0/4038535119 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb84c09d6f0 0x7fb84c11eea0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:12.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.474+0000 7fb8526bb700 1 --2- 172.21.15.26:0/4038535119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb84c09e000 0x7fb84c11f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:12.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.474+0000 7fb8526bb700 1 -- 172.21.15.26:0/4038535119 >> 172.21.15.26:0/4038535119 conn(0x7fb84c066f50 msgr2=0x7fb84c130990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:12.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.475+0000 7fb8526bb700 1 -- 172.21.15.26:0/4038535119 shutdown_connections 2023-10-01T08:01:12.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.475+0000 7fb8526bb700 1 -- 172.21.15.26:0/4038535119 wait complete. 2023-10-01T08:01:12.511 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:12.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.633+0000 7fafdad26700 1 -- 172.21.15.26:0/777941703 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fafd4074ea0 con 0x7fafd4099a40 2023-10-01T08:01:12.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.633+0000 7fafd17fa700 1 -- 172.21.15.26:0/777941703 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fafc8015030 con 0x7fafd4099a40 2023-10-01T08:01:12.634 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:12.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.635+0000 7fafdad26700 1 -- 172.21.15.26:0/777941703 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fafd4099a40 msgr2=0x7fafd411b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:12.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.635+0000 7fafdad26700 1 --2- 172.21.15.26:0/777941703 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fafd4099a40 0x7fafd411b890 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fafc800a010 tx=0x7fafc8004750 comp rx=0 tx=0).stop 2023-10-01T08:01:12.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.635+0000 7fafdad26700 1 -- 172.21.15.26:0/777941703 shutdown_connections 2023-10-01T08:01:12.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.635+0000 7fafdad26700 1 --2- 172.21.15.26:0/777941703 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fafd4131810 0x7fafd411c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:12.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.635+0000 7fafdad26700 1 --2- 172.21.15.26:0/777941703 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fafd4099a40 0x7fafd411b890 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:12.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.635+0000 7fafdad26700 1 --2- 172.21.15.26:0/777941703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafd409a580 0x7fafd411bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:12.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.635+0000 7fafdad26700 1 -- 172.21.15.26:0/777941703 >> 172.21.15.26:0/777941703 conn(0x7fafd40a2aa0 msgr2=0x7fafd40a0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:12.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.635+0000 7fafdad26700 1 -- 172.21.15.26:0/777941703 shutdown_connections 2023-10-01T08:01:12.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.635+0000 7fafdad26700 1 -- 172.21.15.26:0/777941703 wait complete. 2023-10-01T08:01:12.650 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:12.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.679+0000 7f9b2232f700 1 -- 172.21.15.26:0/3248841279 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9b1c072980 con 0x7f9b1c09d630 2023-10-01T08:01:12.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.679+0000 7f9b18ff9700 1 -- 172.21.15.26:0/3248841279 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9b0c017020 con 0x7f9b1c09d630 2023-10-01T08:01:12.680 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:12.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.682+0000 7f9b2232f700 1 -- 172.21.15.26:0/3248841279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b1c09d630 msgr2=0x7f9b1c133750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:12.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.682+0000 7f9b2232f700 1 --2- 172.21.15.26:0/3248841279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b1c09d630 0x7f9b1c133750 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c00c4e0 tx=0x7f9b0c00c7f0 comp rx=0 tx=0).stop 2023-10-01T08:01:12.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.682+0000 7f9b2232f700 1 -- 172.21.15.26:0/3248841279 shutdown_connections 2023-10-01T08:01:12.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.682+0000 7f9b2232f700 1 --2- 172.21.15.26:0/3248841279 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9b1c138d80 0x7f9b1c1341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:12.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.682+0000 7f9b2232f700 1 --2- 172.21.15.26:0/3248841279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b1c09d630 0x7f9b1c133750 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:12.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.682+0000 7f9b2232f700 1 --2- 172.21.15.26:0/3248841279 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9b1c0a0a30 0x7f9b1c133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:12.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.682+0000 7f9b2232f700 1 -- 172.21.15.26:0/3248841279 >> 172.21.15.26:0/3248841279 conn(0x7f9b1c0a3050 msgr2=0x7f9b1c09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:12.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.682+0000 7f9b2232f700 1 -- 172.21.15.26:0/3248841279 shutdown_connections 2023-10-01T08:01:12.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:12.682+0000 7f9b2232f700 1 -- 172.21.15.26:0/3248841279 wait complete. 2023-10-01T08:01:12.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:13.016 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:13.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.175+0000 7f3144d38700 1 Processor -- start 2023-10-01T08:01:13.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.175+0000 7f3144d38700 1 -- start start 2023-10-01T08:01:13.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.176+0000 7f3144d38700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f314009d6f0 0x7f314009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:13.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.176+0000 7f3144d38700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f314009e000 0x7f3140130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:13.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.176+0000 7f3144d38700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f314009f130 con 0x7f314009e410 2023-10-01T08:01:13.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.176+0000 7f3144d38700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f314009f520 con 0x7f314009d6f0 2023-10-01T08:01:13.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.176+0000 7f3144d38700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f314009e930 con 0x7f314009e000 2023-10-01T08:01:13.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.176+0000 7f313e59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f314009d6f0 0x7f314009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:13.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.176+0000 7f313dd9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f314009e000 0x7f3140130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:13.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.176+0000 7f313ed9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f314009e410 0x7f3140130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49440/0 (socket says 172.21.15.26:49440) 2023-10-01T08:01:13.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.176+0000 7f313ed9d700 1 -- 172.21.15.26:0/1573050581 learned_addr learned my addr 172.21.15.26:0/1573050581 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:01:13.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.176+0000 7f313d59a700 1 -- 172.21.15.26:0/1573050581 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3535891277 0 0) 0x7f314009f130 con 0x7f314009e410 2023-10-01T08:01:13.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.176+0000 7f313dd9b700 1 -- 172.21.15.26:0/1573050581 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f314009d6f0 msgr2=0x7f314009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:13.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.176+0000 7f313dd9b700 1 --2- 172.21.15.26:0/1573050581 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f314009d6f0 0x7f314009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:13.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.176+0000 7f313dd9b700 1 -- 172.21.15.26:0/1573050581 >> v1:172.21.15.26:6789/0 conn(0x7f314009e410 legacy=0x7f3140130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:13.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.176+0000 7f313dd9b700 1 -- 172.21.15.26:0/1573050581 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314009b2d0 con 0x7f314009e000 2023-10-01T08:01:13.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.176+0000 7f313e59c700 1 --2- 172.21.15.26:0/1573050581 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f314009d6f0 0x7f314009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:13.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.177+0000 7f313dd9b700 1 --2- 172.21.15.26:0/1573050581 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f314009e000 0x7f3140130660 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f31300098a0 tx=0x7f3130009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d3ba100d6a269b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:13.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.177+0000 7f313d59a700 1 -- 172.21.15.26:0/1573050581 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3130011830 con 0x7f314009e000 2023-10-01T08:01:13.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.177+0000 7f313d59a700 1 -- 172.21.15.26:0/1573050581 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3130011990 con 0x7f314009e000 2023-10-01T08:01:13.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.177+0000 7f313d59a700 1 -- 172.21.15.26:0/1573050581 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3130011d20 con 0x7f314009e000 2023-10-01T08:01:13.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.177+0000 7f3144d38700 1 -- 172.21.15.26:0/1573050581 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f314009e000 msgr2=0x7f3140130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:13.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.177+0000 7f3144d38700 1 --2- 172.21.15.26:0/1573050581 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f314009e000 0x7f3140130660 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f31300098a0 tx=0x7f3130009bb0 comp rx=0 tx=0).stop 2023-10-01T08:01:13.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.178+0000 7f3144d38700 1 -- 172.21.15.26:0/1573050581 shutdown_connections 2023-10-01T08:01:13.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.178+0000 7f3144d38700 1 --2- 172.21.15.26:0/1573050581 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f314009d6f0 0x7f314009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:13.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.178+0000 7f3144d38700 1 --2- 172.21.15.26:0/1573050581 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f314009e000 0x7f3140130660 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:13.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.178+0000 7f3144d38700 1 -- 172.21.15.26:0/1573050581 >> 172.21.15.26:0/1573050581 conn(0x7f3140066f50 msgr2=0x7f314009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:13.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.178+0000 7f3144d38700 1 -- 172.21.15.26:0/1573050581 shutdown_connections 2023-10-01T08:01:13.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.178+0000 7f3144d38700 1 -- 172.21.15.26:0/1573050581 wait complete. 2023-10-01T08:01:13.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.179+0000 7f3144d38700 1 Processor -- start 2023-10-01T08:01:13.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.179+0000 7f3144d38700 1 -- start start 2023-10-01T08:01:13.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.180+0000 7f3144d38700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f314009d6f0 0x7f314011dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:13.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.180+0000 7f3144d38700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f314009e000 0x7f314011e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:13.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.180+0000 7f3144d38700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f314009e410 0x7f314011e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:13.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.180+0000 7f3144d38700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31401218b0 con 0x7f314009d6f0 2023-10-01T08:01:13.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.180+0000 7f3144d38700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3140120c80 con 0x7f314009e410 2023-10-01T08:01:13.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.180+0000 7f3144d38700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3140122250 con 0x7f314009e000 2023-10-01T08:01:13.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.180+0000 7f313ed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f314009e410 0x7f314011e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:13.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.180+0000 7f313e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f314009d6f0 0x7f314011dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:13.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.180+0000 7f313ed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f314009e410 0x7f314011e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51586/0 (socket says 172.21.15.26:51586) 2023-10-01T08:01:13.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.180+0000 7f313ed9d700 1 -- 172.21.15.26:0/1089020538 learned_addr learned my addr 172.21.15.26:0/1089020538 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:13.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.180+0000 7f313dd9b700 1 --2- 172.21.15.26:0/1089020538 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f314009e000 0x7f314011e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:13.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.180+0000 7f313ed9d700 1 -- 172.21.15.26:0/1089020538 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f314009e000 msgr2=0x7f314011e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:13.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.180+0000 7f313ed9d700 1 --2- 172.21.15.26:0/1089020538 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f314009e000 0x7f314011e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:13.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.180+0000 7f313ed9d700 1 -- 172.21.15.26:0/1089020538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f314009d6f0 msgr2=0x7f314011dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:13.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.180+0000 7f313ed9d700 1 --2- 172.21.15.26:0/1089020538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f314009d6f0 0x7f314011dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:13.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.180+0000 7f313ed9d700 1 -- 172.21.15.26:0/1089020538 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31280094a0 con 0x7f314009e410 2023-10-01T08:01:13.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.180+0000 7f313dd9b700 1 --2- 172.21.15.26:0/1089020538 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f314009e000 0x7f314011e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:13.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.180+0000 7f313e59c700 1 --2- 172.21.15.26:0/1089020538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f314009d6f0 0x7f314011dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:13.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.181+0000 7f313ed9d700 1 --2- 172.21.15.26:0/1089020538 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f314009e410 0x7f314011e810 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f313800cc70 tx=0x7f313800cf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:13.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.181+0000 7f3136ffd700 1 -- 172.21.15.26:0/1089020538 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313800aa60 con 0x7f314009e410 2023-10-01T08:01:13.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.181+0000 7f3136ffd700 1 -- 172.21.15.26:0/1089020538 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313800abe0 con 0x7f314009e410 2023-10-01T08:01:13.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.181+0000 7f3144d38700 1 -- 172.21.15.26:0/1089020538 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31300094a0 con 0x7f314009e410 2023-10-01T08:01:13.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.181+0000 7f3136ffd700 1 -- 172.21.15.26:0/1089020538 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31380070d0 con 0x7f314009e410 2023-10-01T08:01:13.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.181+0000 7f3144d38700 1 -- 172.21.15.26:0/1089020538 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f314009c700 con 0x7f314009e410 2023-10-01T08:01:13.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.182+0000 7f3136ffd700 1 -- 172.21.15.26:0/1089020538 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3138007230 con 0x7f314009e410 2023-10-01T08:01:13.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.182+0000 7f3136ffd700 1 -- 172.21.15.26:0/1089020538 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f313803f530 con 0x7f314009e410 2023-10-01T08:01:13.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.182+0000 7f3144d38700 1 -- 172.21.15.26:0/1089020538 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f314011ac20 con 0x7f314009e410 2023-10-01T08:01:13.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.187+0000 7f3136ffd700 1 -- 172.21.15.26:0/1089020538 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3138018070 con 0x7f314009e410 2023-10-01T08:01:13.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.391+0000 7f3144d38700 1 -- 172.21.15.26:0/1089020538 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3140074ea0 con 0x7f314009e410 2023-10-01T08:01:13.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.391+0000 7f3136ffd700 1 -- 172.21.15.26:0/1089020538 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f313801a8b0 con 0x7f314009e410 2023-10-01T08:01:13.392 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:13.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.394+0000 7f3144d38700 1 -- 172.21.15.26:0/1089020538 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f314009e410 msgr2=0x7f314011e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:13.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.394+0000 7f3144d38700 1 --2- 172.21.15.26:0/1089020538 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f314009e410 0x7f314011e810 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f313800cc70 tx=0x7f313800cf80 comp rx=0 tx=0).stop 2023-10-01T08:01:13.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.394+0000 7f3144d38700 1 -- 172.21.15.26:0/1089020538 shutdown_connections 2023-10-01T08:01:13.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.394+0000 7f3144d38700 1 --2- 172.21.15.26:0/1089020538 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f314009e410 0x7f314011e810 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:13.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.394+0000 7f3144d38700 1 --2- 172.21.15.26:0/1089020538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f314009d6f0 0x7f314011dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:13.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.394+0000 7f3144d38700 1 --2- 172.21.15.26:0/1089020538 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f314009e000 0x7f314011e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:13.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.394+0000 7f3144d38700 1 -- 172.21.15.26:0/1089020538 >> 172.21.15.26:0/1089020538 conn(0x7f3140066f50 msgr2=0x7f3140130a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:13.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.394+0000 7f3144d38700 1 -- 172.21.15.26:0/1089020538 shutdown_connections 2023-10-01T08:01:13.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.394+0000 7f3144d38700 1 -- 172.21.15.26:0/1089020538 wait complete. 2023-10-01T08:01:13.408 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:13.512 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:13.651 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:13.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.653+0000 7f83314b4700 1 Processor -- start 2023-10-01T08:01:13.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.654+0000 7f83314b4700 1 -- start start 2023-10-01T08:01:13.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.654+0000 7f83314b4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f832c0a0a30 0x7f832c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:13.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.654+0000 7f83314b4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f832c138d80 0x7f832c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:13.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.654+0000 7f83314b4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f832c0a2a70 con 0x7f832c09d630 2023-10-01T08:01:13.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.654+0000 7f83314b4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f832c0a01d0 con 0x7f832c0a0a30 2023-10-01T08:01:13.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.654+0000 7f83314b4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f832c09e2b0 con 0x7f832c138d80 2023-10-01T08:01:13.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.654+0000 7f832b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f832c138d80 0x7f832c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:13.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.654+0000 7f832affd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f832c0a0a30 0x7f832c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:13.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.654+0000 7f832b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f832c138d80 0x7f832c13b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37260/0 (socket says 172.21.15.26:37260) 2023-10-01T08:01:13.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.654+0000 7f832affd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f832c0a0a30 0x7f832c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44560/0 (socket says 172.21.15.26:44560) 2023-10-01T08:01:13.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.654+0000 7f832b7fe700 1 -- 172.21.15.26:0/4075566838 learned_addr learned my addr 172.21.15.26:0/4075566838 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:13.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.655+0000 7f832b7fe700 1 -- 172.21.15.26:0/4075566838 >> v2:172.21.15.26:3300/0 conn(0x7f832c0a0a30 msgr2=0x7f832c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:13.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.655+0000 7f832b7fe700 1 --2- 172.21.15.26:0/4075566838 >> v2:172.21.15.26:3300/0 conn(0x7f832c0a0a30 0x7f832c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:13.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.655+0000 7f832b7fe700 1 -- 172.21.15.26:0/4075566838 >> v1:172.21.15.26:6789/0 conn(0x7f832c09d630 legacy=0x7f832c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:13.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.655+0000 7f832b7fe700 1 -- 172.21.15.26:0/4075566838 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832c09dc50 con 0x7f832c138d80 2023-10-01T08:01:13.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.655+0000 7f832affd700 1 --2- 172.21.15.26:0/4075566838 >> v2:172.21.15.26:3300/0 conn(0x7f832c0a0a30 0x7f832c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:13.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.655+0000 7f832b7fe700 1 --2- 172.21.15.26:0/4075566838 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f832c138d80 0x7f832c13b160 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f8324009e50 tx=0x7f832400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=126d6ab0d139beb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:13.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.655+0000 7f8329ffb700 1 -- 172.21.15.26:0/4075566838 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832400e070 con 0x7f832c138d80 2023-10-01T08:01:13.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.655+0000 7f8329ffb700 1 -- 172.21.15.26:0/4075566838 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f832400b910 con 0x7f832c138d80 2023-10-01T08:01:13.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.655+0000 7f8329ffb700 1 -- 172.21.15.26:0/4075566838 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832400bcc0 con 0x7f832c138d80 2023-10-01T08:01:13.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.656+0000 7f83314b4700 1 -- 172.21.15.26:0/4075566838 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f832c138d80 msgr2=0x7f832c13b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:13.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.656+0000 7f83314b4700 1 --2- 172.21.15.26:0/4075566838 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f832c138d80 0x7f832c13b160 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f8324009e50 tx=0x7f832400b330 comp rx=0 tx=0).stop 2023-10-01T08:01:13.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.656+0000 7f83314b4700 1 -- 172.21.15.26:0/4075566838 shutdown_connections 2023-10-01T08:01:13.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.656+0000 7f83314b4700 1 --2- 172.21.15.26:0/4075566838 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f832c138d80 0x7f832c13b160 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:13.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.656+0000 7f83314b4700 1 --2- 172.21.15.26:0/4075566838 >> v2:172.21.15.26:3300/0 conn(0x7f832c0a0a30 0x7f832c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:13.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.656+0000 7f83314b4700 1 -- 172.21.15.26:0/4075566838 >> 172.21.15.26:0/4075566838 conn(0x7f832c0a3050 msgr2=0x7f832c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:13.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.656+0000 7f83314b4700 1 -- 172.21.15.26:0/4075566838 shutdown_connections 2023-10-01T08:01:13.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.656+0000 7f83314b4700 1 -- 172.21.15.26:0/4075566838 wait complete. 2023-10-01T08:01:13.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.657+0000 7f83314b4700 1 Processor -- start 2023-10-01T08:01:13.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.658+0000 7f83314b4700 1 -- start start 2023-10-01T08:01:13.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.658+0000 7f83314b4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f832c09d630 0x7f832c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:13.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.658+0000 7f83314b4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f832c0a0a30 0x7f832c133f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:13.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.658+0000 7f83314b4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f832c138d80 0x7f832c1344b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:13.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.658+0000 7f83314b4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832c136b90 con 0x7f832c138d80 2023-10-01T08:01:13.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.658+0000 7f83314b4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832c138090 con 0x7f832c0a0a30 2023-10-01T08:01:13.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.658+0000 7f83314b4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f832c1374b0 con 0x7f832c09d630 2023-10-01T08:01:13.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.658+0000 7f832affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f832c09d630 0x7f832c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:13.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.658+0000 7f832affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f832c09d630 0x7f832c133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37262/0 (socket says 172.21.15.26:37262) 2023-10-01T08:01:13.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.658+0000 7f832affd700 1 -- 172.21.15.26:0/1047041788 learned_addr learned my addr 172.21.15.26:0/1047041788 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:13.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.659+0000 7f832a7fc700 1 --2- 172.21.15.26:0/1047041788 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f832c0a0a30 0x7f832c133f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:13.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.659+0000 7f832affd700 1 -- 172.21.15.26:0/1047041788 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f832c0a0a30 msgr2=0x7f832c133f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:13.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.659+0000 7f832affd700 1 --2- 172.21.15.26:0/1047041788 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f832c0a0a30 0x7f832c133f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:13.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.659+0000 7f832affd700 1 -- 172.21.15.26:0/1047041788 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f832c138d80 msgr2=0x7f832c1344b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T08:01:13.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.659+0000 7f832affd700 1 --2- 172.21.15.26:0/1047041788 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f832c138d80 0x7f832c1344b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:13.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.659+0000 7f832affd700 1 -- 172.21.15.26:0/1047041788 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831c0094a0 con 0x7f832c09d630 2023-10-01T08:01:13.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.659+0000 7f832affd700 1 --2- 172.21.15.26:0/1047041788 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f832c09d630 0x7f832c133a30 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f831c00ec10 tx=0x7f831c00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:13.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.659+0000 7f83137fe700 1 -- 172.21.15.26:0/1047041788 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c00c910 con 0x7f832c09d630 2023-10-01T08:01:13.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.659+0000 7f83137fe700 1 -- 172.21.15.26:0/1047041788 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831c00ca70 con 0x7f832c09d630 2023-10-01T08:01:13.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.659+0000 7f83314b4700 1 -- 172.21.15.26:0/1047041788 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8324009b30 con 0x7f832c09d630 2023-10-01T08:01:13.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.659+0000 7f83137fe700 1 -- 172.21.15.26:0/1047041788 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c00cde0 con 0x7f832c09d630 2023-10-01T08:01:13.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.659+0000 7f83314b4700 1 -- 172.21.15.26:0/1047041788 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f832c1371d0 con 0x7f832c09d630 2023-10-01T08:01:13.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.661+0000 7f83314b4700 1 -- 172.21.15.26:0/1047041788 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f832c0747f0 con 0x7f832c09d630 2023-10-01T08:01:13.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.661+0000 7f83137fe700 1 -- 172.21.15.26:0/1047041788 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f831c013470 con 0x7f832c09d630 2023-10-01T08:01:13.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.662+0000 7f83137fe700 1 -- 172.21.15.26:0/1047041788 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f831c0400a0 con 0x7f832c09d630 2023-10-01T08:01:13.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.666+0000 7f83137fe700 1 -- 172.21.15.26:0/1047041788 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f831c024350 con 0x7f832c09d630 2023-10-01T08:01:13.697 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:13.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.790+0000 7f98f2186700 1 Processor -- start 2023-10-01T08:01:13.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.790+0000 7f98f2186700 1 -- start start 2023-10-01T08:01:13.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.791+0000 7f98f2186700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98ec136710 0x7f98ec138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:13.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.791+0000 7f98f2186700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f98ec139030 0x7f98ec13b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:13.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.791+0000 7f98f2186700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98ec06ef30 con 0x7f98ec1338a0 2023-10-01T08:01:13.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.791+0000 7f98f2186700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec06fef0 con 0x7f98ec139030 2023-10-01T08:01:13.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.791+0000 7f98f2186700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec1334b0 con 0x7f98ec136710 2023-10-01T08:01:13.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.791+0000 7f98ebfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f98ec139030 0x7f98ec13b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:13.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.791+0000 7f98ebfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f98ec139030 0x7f98ec13b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37756/0 (socket says 172.21.15.26:37756) 2023-10-01T08:01:13.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.791+0000 7f98ebfff700 1 -- 172.21.15.26:0/782548229 learned_addr learned my addr 172.21.15.26:0/782548229 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:13.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.791+0000 7f98eaffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98ec136710 0x7f98ec138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:13.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.791+0000 7f98ebfff700 1 -- 172.21.15.26:0/782548229 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98ec136710 msgr2=0x7f98ec138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:13.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.791+0000 7f98ebfff700 1 --2- 172.21.15.26:0/782548229 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98ec136710 0x7f98ec138af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:13.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.791+0000 7f98ebfff700 1 -- 172.21.15.26:0/782548229 >> v1:172.21.15.26:6789/0 conn(0x7f98ec1338a0 legacy=0x7f98ec133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:13.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.791+0000 7f98ea7fc700 1 -- 172.21.15.26:0/782548229 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 741910449 0 0) 0x7f98ec06ef30 con 0x7f98ec1338a0 2023-10-01T08:01:13.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.791+0000 7f98ebfff700 1 -- 172.21.15.26:0/782548229 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ec06fc30 con 0x7f98ec139030 2023-10-01T08:01:13.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.791+0000 7f98eaffd700 1 --2- 172.21.15.26:0/782548229 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98ec136710 0x7f98ec138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:13.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.792+0000 7f98ebfff700 1 --2- 172.21.15.26:0/782548229 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f98ec139030 0x7f98ec13b410 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f98e4009e80 tx=0x7f98e400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a98e3f88cdabe53 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:13.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.792+0000 7f98ea7fc700 1 -- 172.21.15.26:0/782548229 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e400e070 con 0x7f98ec139030 2023-10-01T08:01:13.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.792+0000 7f98ea7fc700 1 -- 172.21.15.26:0/782548229 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e400b910 con 0x7f98ec139030 2023-10-01T08:01:13.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.792+0000 7f98ea7fc700 1 -- 172.21.15.26:0/782548229 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e400bcc0 con 0x7f98ec139030 2023-10-01T08:01:13.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.793+0000 7f98f2186700 1 -- 172.21.15.26:0/782548229 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f98ec139030 msgr2=0x7f98ec13b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:13.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.793+0000 7f98f2186700 1 --2- 172.21.15.26:0/782548229 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f98ec139030 0x7f98ec13b410 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f98e4009e80 tx=0x7f98e400b330 comp rx=0 tx=0).stop 2023-10-01T08:01:13.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.793+0000 7f98f2186700 1 -- 172.21.15.26:0/782548229 shutdown_connections 2023-10-01T08:01:13.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.793+0000 7f98f2186700 1 --2- 172.21.15.26:0/782548229 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f98ec139030 0x7f98ec13b410 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:13.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.793+0000 7f98f2186700 1 --2- 172.21.15.26:0/782548229 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98ec136710 0x7f98ec138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:13.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.793+0000 7f98f2186700 1 -- 172.21.15.26:0/782548229 >> 172.21.15.26:0/782548229 conn(0x7f98ec0a2aa0 msgr2=0x7f98ec0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:13.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.793+0000 7f98f2186700 1 -- 172.21.15.26:0/782548229 shutdown_connections 2023-10-01T08:01:13.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.793+0000 7f98f2186700 1 -- 172.21.15.26:0/782548229 wait complete. 2023-10-01T08:01:13.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.794+0000 7f98f2186700 1 Processor -- start 2023-10-01T08:01:13.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.794+0000 7f98f2186700 1 -- start start 2023-10-01T08:01:13.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.795+0000 7f98f2186700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f98ec1338a0 0x7f98ec119d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:13.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.795+0000 7f98f2186700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98ec136710 0x7f98ec11a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:13.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.795+0000 7f98f2186700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98ec139030 0x7f98ec11a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:13.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.795+0000 7f98f2186700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec11d4e0 con 0x7f98ec136710 2023-10-01T08:01:13.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.795+0000 7f98f2186700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec11d6c0 con 0x7f98ec1338a0 2023-10-01T08:01:13.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.795+0000 7f98f2186700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec138cb0 con 0x7f98ec139030 2023-10-01T08:01:13.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.795+0000 7f98eb7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f98ec1338a0 0x7f98ec119d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:13.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.795+0000 7f98eaffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98ec136710 0x7f98ec11a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:13.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.795+0000 7f98eb7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f98ec1338a0 0x7f98ec119d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37758/0 (socket says 172.21.15.26:37758) 2023-10-01T08:01:13.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.795+0000 7f98eb7fe700 1 -- 172.21.15.26:0/4189938863 learned_addr learned my addr 172.21.15.26:0/4189938863 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:13.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.795+0000 7f98ebfff700 1 --2- 172.21.15.26:0/4189938863 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98ec139030 0x7f98ec11a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:13.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.796+0000 7f98eaffd700 1 -- 172.21.15.26:0/4189938863 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98ec139030 msgr2=0x7f98ec11a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:13.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.796+0000 7f98eaffd700 1 --2- 172.21.15.26:0/4189938863 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98ec139030 0x7f98ec11a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:13.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.796+0000 7f98eaffd700 1 -- 172.21.15.26:0/4189938863 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f98ec1338a0 msgr2=0x7f98ec119d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:13.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.796+0000 7f98eaffd700 1 --2- 172.21.15.26:0/4189938863 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f98ec1338a0 0x7f98ec119d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:13.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.796+0000 7f98eaffd700 1 -- 172.21.15.26:0/4189938863 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e00094a0 con 0x7f98ec136710 2023-10-01T08:01:13.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.796+0000 7f98eb7fe700 1 --2- 172.21.15.26:0/4189938863 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f98ec1338a0 0x7f98ec119d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:13.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.796+0000 7f98eaffd700 1 --2- 172.21.15.26:0/4189938863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98ec136710 0x7f98ec11a260 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f98e000e9b0 tx=0x7f98e000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:13.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.796+0000 7f98d3fff700 1 -- 172.21.15.26:0/4189938863 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e000ee50 con 0x7f98ec136710 2023-10-01T08:01:13.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.796+0000 7f98d3fff700 1 -- 172.21.15.26:0/4189938863 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e000c850 con 0x7f98ec136710 2023-10-01T08:01:13.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.796+0000 7f98f2186700 1 -- 172.21.15.26:0/4189938863 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e4009b30 con 0x7f98ec136710 2023-10-01T08:01:13.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.796+0000 7f98d3fff700 1 -- 172.21.15.26:0/4189938863 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e000cc00 con 0x7f98ec136710 2023-10-01T08:01:13.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.796+0000 7f98f2186700 1 -- 172.21.15.26:0/4189938863 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98ec12fa70 con 0x7f98ec136710 2023-10-01T08:01:13.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.797+0000 7f98f2186700 1 -- 172.21.15.26:0/4189938863 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98ec074ea0 con 0x7f98ec136710 2023-10-01T08:01:13.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.797+0000 7f98d3fff700 1 -- 172.21.15.26:0/4189938863 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f98e0013470 con 0x7f98ec136710 2023-10-01T08:01:13.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.798+0000 7f98d3fff700 1 -- 172.21.15.26:0/4189938863 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f98e003fab0 con 0x7f98ec136710 2023-10-01T08:01:13.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.802+0000 7f98d3fff700 1 -- 172.21.15.26:0/4189938863 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f98e0013720 con 0x7f98ec136710 2023-10-01T08:01:13.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.837+0000 7f9fd75d8700 1 Processor -- start 2023-10-01T08:01:13.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.837+0000 7f9fd75d8700 1 -- start start 2023-10-01T08:01:13.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.838+0000 7f9fd75d8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9fd0133a80 0x7f9fd0133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:13.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.838+0000 7f9fd75d8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fd012ff20 0x7f9fd0130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:13.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.838+0000 7f9fd75d8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fd006bc00 con 0x7f9fd0130870 2023-10-01T08:01:13.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.838+0000 7f9fd75d8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fd006c570 con 0x7f9fd0133a80 2023-10-01T08:01:13.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.838+0000 7f9fd75d8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd00a0040 con 0x7f9fd012ff20 2023-10-01T08:01:13.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.838+0000 7f9fd5374700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9fd0133a80 0x7f9fd0133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:13.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.838+0000 7f9fd4b73700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fd012ff20 0x7f9fd0130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:13.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.838+0000 7f9fd5374700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9fd0133a80 0x7f9fd0133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44576/0 (socket says 172.21.15.26:44576) 2023-10-01T08:01:13.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.838+0000 7f9fd4b73700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fd012ff20 0x7f9fd0130330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37298/0 (socket says 172.21.15.26:37298) 2023-10-01T08:01:13.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.838+0000 7f9fd5374700 1 -- 172.21.15.26:0/2845748641 learned_addr learned my addr 172.21.15.26:0/2845748641 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:13.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.839+0000 7f9fd4b73700 1 -- 172.21.15.26:0/2845748641 >> v2:172.21.15.26:3300/0 conn(0x7f9fd0133a80 msgr2=0x7f9fd0133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:13.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.839+0000 7f9fd4b73700 1 --2- 172.21.15.26:0/2845748641 >> v2:172.21.15.26:3300/0 conn(0x7f9fd0133a80 0x7f9fd0133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:13.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.839+0000 7f9fd4b73700 1 -- 172.21.15.26:0/2845748641 >> v1:172.21.15.26:6789/0 conn(0x7f9fd0130870 legacy=0x7f9fd013a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:13.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.839+0000 7f9fd4b73700 1 -- 172.21.15.26:0/2845748641 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd0133860 con 0x7f9fd012ff20 2023-10-01T08:01:13.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.839+0000 7f9fc7fff700 1 -- 172.21.15.26:0/2845748641 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1054107472 0 0) 0x7f9fd006bc00 con 0x7f9fd0130870 2023-10-01T08:01:13.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.839+0000 7f9fd5374700 1 --2- 172.21.15.26:0/2845748641 >> v2:172.21.15.26:3300/0 conn(0x7f9fd0133a80 0x7f9fd0133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:13.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.839+0000 7f9fd4b73700 1 --2- 172.21.15.26:0/2845748641 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fd012ff20 0x7f9fd0130330 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0009840 tx=0x7f9fc0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97e4fa0f94289e54 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:13.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.839+0000 7f9fc7fff700 1 -- 172.21.15.26:0/2845748641 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc0011830 con 0x7f9fd012ff20 2023-10-01T08:01:13.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.839+0000 7f9fc7fff700 1 -- 172.21.15.26:0/2845748641 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc0011990 con 0x7f9fd012ff20 2023-10-01T08:01:13.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.839+0000 7f9fc7fff700 1 -- 172.21.15.26:0/2845748641 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc0011d20 con 0x7f9fd012ff20 2023-10-01T08:01:13.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.840+0000 7f9fd75d8700 1 -- 172.21.15.26:0/2845748641 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fd012ff20 msgr2=0x7f9fd0130330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:13.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.840+0000 7f9fd75d8700 1 --2- 172.21.15.26:0/2845748641 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fd012ff20 0x7f9fd0130330 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0009840 tx=0x7f9fc0009b50 comp rx=0 tx=0).stop 2023-10-01T08:01:13.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.840+0000 7f9fd75d8700 1 -- 172.21.15.26:0/2845748641 shutdown_connections 2023-10-01T08:01:13.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.840+0000 7f9fd75d8700 1 --2- 172.21.15.26:0/2845748641 >> v2:172.21.15.26:3300/0 conn(0x7f9fd0133a80 0x7f9fd0133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:13.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.840+0000 7f9fd75d8700 1 --2- 172.21.15.26:0/2845748641 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fd012ff20 0x7f9fd0130330 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:13.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.840+0000 7f9fd75d8700 1 -- 172.21.15.26:0/2845748641 >> 172.21.15.26:0/2845748641 conn(0x7f9fd00a4210 msgr2=0x7f9fd00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:13.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.840+0000 7f9fd75d8700 1 -- 172.21.15.26:0/2845748641 shutdown_connections 2023-10-01T08:01:13.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.840+0000 7f9fd75d8700 1 -- 172.21.15.26:0/2845748641 wait complete. 2023-10-01T08:01:13.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.841+0000 7f9fd75d8700 1 Processor -- start 2023-10-01T08:01:13.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.841+0000 7f9fd75d8700 1 -- start start 2023-10-01T08:01:13.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.841+0000 7f9fd75d8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9fd012ff20 0x7f9fd009c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:13.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.841+0000 7f9fd75d8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fd0130870 0x7f9fd009c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:13.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.841+0000 7f9fd75d8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fd0133a80 0x7f9fd009ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:13.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.841+0000 7f9fd75d8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd011f440 con 0x7f9fd0133a80 2023-10-01T08:01:13.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.841+0000 7f9fd75d8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd009df40 con 0x7f9fd012ff20 2023-10-01T08:01:13.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.841+0000 7f9fd75d8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd011f080 con 0x7f9fd0130870 2023-10-01T08:01:13.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.842+0000 7f9fd4b73700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fd0130870 0x7f9fd009c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:13.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.842+0000 7f9fd5b75700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fd0133a80 0x7f9fd009ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:13.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.842+0000 7f9fd4b73700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fd0130870 0x7f9fd009c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37308/0 (socket says 172.21.15.26:37308) 2023-10-01T08:01:13.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.842+0000 7f9fd5b75700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fd0133a80 0x7f9fd009ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44586/0 (socket says 172.21.15.26:44586) 2023-10-01T08:01:13.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.842+0000 7f9fd4b73700 1 -- 172.21.15.26:0/1475188168 learned_addr learned my addr 172.21.15.26:0/1475188168 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:13.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.842+0000 7f9fd5374700 1 --2- 172.21.15.26:0/1475188168 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9fd012ff20 0x7f9fd009c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:13.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.842+0000 7f9fd4b73700 1 -- 172.21.15.26:0/1475188168 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9fd012ff20 msgr2=0x7f9fd009c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.842+0000 7f9fd4b73700 1 --2- 172.21.15.26:0/1475188168 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9fd012ff20 0x7f9fd009c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.842+0000 7f9fd4b73700 1 -- 172.21.15.26:0/1475188168 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fd0133a80 msgr2=0x7f9fd009ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.842+0000 7f9fd4b73700 1 --2- 172.21.15.26:0/1475188168 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fd0133a80 0x7f9fd009ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.842+0000 7f9fd4b73700 1 -- 172.21.15.26:0/1475188168 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fcc009550 con 0x7f9fd0130870 2023-10-01T08:01:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.842+0000 7f9fd5b75700 1 --2- 172.21.15.26:0/1475188168 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fd0133a80 0x7f9fd009ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.842+0000 7f9fd4b73700 1 --2- 172.21.15.26:0/1475188168 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fd0130870 0x7f9fd009c7b0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0009fd0 tx=0x7f9fc0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.842+0000 7f9fc5ffb700 1 -- 172.21.15.26:0/1475188168 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc00036a0 con 0x7f9fd0130870 2023-10-01T08:01:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.842+0000 7f9fc5ffb700 1 -- 172.21.15.26:0/1475188168 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc001f070 con 0x7f9fd0130870 2023-10-01T08:01:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.842+0000 7f9fd75d8700 1 -- 172.21.15.26:0/1475188168 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc00094a0 con 0x7f9fd0130870 2023-10-01T08:01:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.842+0000 7f9fc5ffb700 1 -- 172.21.15.26:0/1475188168 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc0003a20 con 0x7f9fd0130870 2023-10-01T08:01:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.843+0000 7f9fd75d8700 1 -- 172.21.15.26:0/1475188168 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fd00a2050 con 0x7f9fd0130870 2023-10-01T08:01:13.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.844+0000 7f9fc5ffb700 1 -- 172.21.15.26:0/1475188168 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9fc0003b80 con 0x7f9fd0130870 2023-10-01T08:01:13.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.844+0000 7f9fc5ffb700 1 -- 172.21.15.26:0/1475188168 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9fc0021070 con 0x7f9fd0130870 2023-10-01T08:01:13.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.844+0000 7f9fd75d8700 1 -- 172.21.15.26:0/1475188168 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fd0074ea0 con 0x7f9fd0130870 2023-10-01T08:01:13.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.853+0000 7f9fc5ffb700 1 -- 172.21.15.26:0/1475188168 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9fc0015080 con 0x7f9fd0130870 2023-10-01T08:01:13.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.883+0000 7f83314b4700 1 -- 172.21.15.26:0/1047041788 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f832c072980 con 0x7f832c09d630 2023-10-01T08:01:13.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.883+0000 7f83137fe700 1 -- 172.21.15.26:0/1047041788 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f831c02a090 con 0x7f832c09d630 2023-10-01T08:01:13.884 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:13.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.886+0000 7f83314b4700 1 -- 172.21.15.26:0/1047041788 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f832c09d630 msgr2=0x7f832c133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:13.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.886+0000 7f83314b4700 1 --2- 172.21.15.26:0/1047041788 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f832c09d630 0x7f832c133a30 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f831c00ec10 tx=0x7f831c00ef20 comp rx=0 tx=0).stop 2023-10-01T08:01:13.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.886+0000 7f83314b4700 1 -- 172.21.15.26:0/1047041788 shutdown_connections 2023-10-01T08:01:13.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.886+0000 7f83314b4700 1 --2- 172.21.15.26:0/1047041788 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f832c138d80 0x7f832c1344b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:13.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.886+0000 7f83314b4700 1 --2- 172.21.15.26:0/1047041788 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f832c09d630 0x7f832c133a30 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:13.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.886+0000 7f83314b4700 1 --2- 172.21.15.26:0/1047041788 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f832c0a0a30 0x7f832c133f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:13.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.886+0000 7f83314b4700 1 -- 172.21.15.26:0/1047041788 >> 172.21.15.26:0/1047041788 conn(0x7f832c0a3050 msgr2=0x7f832c09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:13.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.886+0000 7f83314b4700 1 -- 172.21.15.26:0/1047041788 shutdown_connections 2023-10-01T08:01:13.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:13.886+0000 7f83314b4700 1 -- 172.21.15.26:0/1047041788 wait complete. 2023-10-01T08:01:13.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:14.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.020+0000 7f98f2186700 1 -- 172.21.15.26:0/4189938863 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f98ec11deb0 con 0x7f98ec136710 2023-10-01T08:01:14.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.020+0000 7f98d3fff700 1 -- 172.21.15.26:0/4189938863 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f98e0017030 con 0x7f98ec136710 2023-10-01T08:01:14.022 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:14.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.023+0000 7f98f2186700 1 -- 172.21.15.26:0/4189938863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98ec136710 msgr2=0x7f98ec11a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:14.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.023+0000 7f98f2186700 1 --2- 172.21.15.26:0/4189938863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98ec136710 0x7f98ec11a260 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f98e000e9b0 tx=0x7f98e000ecc0 comp rx=0 tx=0).stop 2023-10-01T08:01:14.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.023+0000 7f98f2186700 1 -- 172.21.15.26:0/4189938863 shutdown_connections 2023-10-01T08:01:14.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.023+0000 7f98f2186700 1 --2- 172.21.15.26:0/4189938863 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f98ec139030 0x7f98ec11a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:14.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.023+0000 7f98f2186700 1 --2- 172.21.15.26:0/4189938863 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f98ec1338a0 0x7f98ec119d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:14.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.023+0000 7f98f2186700 1 --2- 172.21.15.26:0/4189938863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98ec136710 0x7f98ec11a260 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:14.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.023+0000 7f98f2186700 1 -- 172.21.15.26:0/4189938863 >> 172.21.15.26:0/4189938863 conn(0x7f98ec0a2aa0 msgr2=0x7f98ec130050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:14.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.023+0000 7f98f2186700 1 -- 172.21.15.26:0/4189938863 shutdown_connections 2023-10-01T08:01:14.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.023+0000 7f98f2186700 1 -- 172.21.15.26:0/4189938863 wait complete. 2023-10-01T08:01:14.038 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:14.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.062+0000 7f9fd75d8700 1 -- 172.21.15.26:0/1475188168 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9fd006b250 con 0x7f9fd0130870 2023-10-01T08:01:14.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.062+0000 7f9fc5ffb700 1 -- 172.21.15.26:0/1475188168 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9fc001a430 con 0x7f9fd0130870 2023-10-01T08:01:14.064 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:14.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.064+0000 7f9fd75d8700 1 -- 172.21.15.26:0/1475188168 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fd0130870 msgr2=0x7f9fd009c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:14.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.064+0000 7f9fd75d8700 1 --2- 172.21.15.26:0/1475188168 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fd0130870 0x7f9fd009c7b0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0009fd0 tx=0x7f9fc0004750 comp rx=0 tx=0).stop 2023-10-01T08:01:14.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.064+0000 7f9fd75d8700 1 -- 172.21.15.26:0/1475188168 shutdown_connections 2023-10-01T08:01:14.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.064+0000 7f9fd75d8700 1 --2- 172.21.15.26:0/1475188168 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fd0133a80 0x7f9fd009ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:14.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.064+0000 7f9fd75d8700 1 --2- 172.21.15.26:0/1475188168 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9fd012ff20 0x7f9fd009c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:14.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.064+0000 7f9fd75d8700 1 --2- 172.21.15.26:0/1475188168 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9fd0130870 0x7f9fd009c7b0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:14.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.064+0000 7f9fd75d8700 1 -- 172.21.15.26:0/1475188168 >> 172.21.15.26:0/1475188168 conn(0x7f9fd00a4210 msgr2=0x7f9fd012f700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:14.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.064+0000 7f9fd75d8700 1 -- 172.21.15.26:0/1475188168 shutdown_connections 2023-10-01T08:01:14.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.064+0000 7f9fd75d8700 1 -- 172.21.15.26:0/1475188168 wait complete. 2023-10-01T08:01:14.080 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:14.409 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:14.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.553+0000 7f091a288700 1 Processor -- start 2023-10-01T08:01:14.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.554+0000 7f091a288700 1 -- start start 2023-10-01T08:01:14.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.554+0000 7f091a288700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f091409e1d0 0x7f0914138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:14.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.554+0000 7f091a288700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0914139170 0x7f091413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:14.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.554+0000 7f091a288700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f091409b120 con 0x7f091409d6f0 2023-10-01T08:01:14.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.554+0000 7f091a288700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f091406b460 con 0x7f0914139170 2023-10-01T08:01:14.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.554+0000 7f091a288700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f091409a7e0 con 0x7f091409e1d0 2023-10-01T08:01:14.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.554+0000 7f0918825700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0914139170 0x7f091413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:14.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.554+0000 7f09137fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f091409e1d0 0x7f0914138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:14.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.554+0000 7f0918825700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0914139170 0x7f091413b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44596/0 (socket says 172.21.15.26:44596) 2023-10-01T08:01:14.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.554+0000 7f0918825700 1 -- 172.21.15.26:0/3070082994 learned_addr learned my addr 172.21.15.26:0/3070082994 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:14.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.555+0000 7f0918825700 1 -- 172.21.15.26:0/3070082994 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f091409e1d0 msgr2=0x7f0914138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:14.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.555+0000 7f0918825700 1 --2- 172.21.15.26:0/3070082994 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f091409e1d0 0x7f0914138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:14.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.555+0000 7f0918825700 1 -- 172.21.15.26:0/3070082994 >> v1:172.21.15.26:6789/0 conn(0x7f091409d6f0 legacy=0x7f091409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:14.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.555+0000 7f0918825700 1 -- 172.21.15.26:0/3070082994 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f091409a500 con 0x7f0914139170 2023-10-01T08:01:14.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.555+0000 7f0918825700 1 --2- 172.21.15.26:0/3070082994 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0914139170 0x7f091413b550 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f090c009e50 tx=0x7f090c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22ae13571a74481 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:14.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.555+0000 7f0912ffd700 1 -- 172.21.15.26:0/3070082994 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c00e070 con 0x7f0914139170 2023-10-01T08:01:14.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.555+0000 7f0912ffd700 1 -- 172.21.15.26:0/3070082994 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090c00b910 con 0x7f0914139170 2023-10-01T08:01:14.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.555+0000 7f0912ffd700 1 -- 172.21.15.26:0/3070082994 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c00bcc0 con 0x7f0914139170 2023-10-01T08:01:14.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.555+0000 7f091a288700 1 -- 172.21.15.26:0/3070082994 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0914139170 msgr2=0x7f091413b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:14.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.555+0000 7f091a288700 1 --2- 172.21.15.26:0/3070082994 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0914139170 0x7f091413b550 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f090c009e50 tx=0x7f090c00b330 comp rx=0 tx=0).stop 2023-10-01T08:01:14.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.556+0000 7f091a288700 1 -- 172.21.15.26:0/3070082994 shutdown_connections 2023-10-01T08:01:14.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.556+0000 7f091a288700 1 --2- 172.21.15.26:0/3070082994 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0914139170 0x7f091413b550 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:14.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.556+0000 7f091a288700 1 --2- 172.21.15.26:0/3070082994 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f091409e1d0 0x7f0914138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:14.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.556+0000 7f091a288700 1 -- 172.21.15.26:0/3070082994 >> 172.21.15.26:0/3070082994 conn(0x7f0914066f50 msgr2=0x7f091409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:14.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.556+0000 7f091a288700 1 -- 172.21.15.26:0/3070082994 shutdown_connections 2023-10-01T08:01:14.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.556+0000 7f091a288700 1 -- 172.21.15.26:0/3070082994 wait complete. 2023-10-01T08:01:14.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.557+0000 7f091a288700 1 Processor -- start 2023-10-01T08:01:14.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.557+0000 7f091a288700 1 -- start start 2023-10-01T08:01:14.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.558+0000 7f091a288700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f091409d6f0 0x7f09141c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:14.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.558+0000 7f091a288700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f091409e1d0 0x7f09141c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:14.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.558+0000 7f091a288700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0914139170 0x7f091411e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:14.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.558+0000 7f091a288700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0914120560 con 0x7f0914139170 2023-10-01T08:01:14.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.558+0000 7f091a288700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0914120370 con 0x7f091409d6f0 2023-10-01T08:01:14.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.558+0000 7f091a288700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0914121ad0 con 0x7f091409e1d0 2023-10-01T08:01:14.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.558+0000 7f09137fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f091409e1d0 0x7f09141c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:14.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.558+0000 7f0918825700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0914139170 0x7f091411e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:14.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.558+0000 7f0913fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f091409d6f0 0x7f09141c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:14.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.558+0000 7f09137fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f091409e1d0 0x7f09141c8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37332/0 (socket says 172.21.15.26:37332) 2023-10-01T08:01:14.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.558+0000 7f09137fe700 1 -- 172.21.15.26:0/1245639948 learned_addr learned my addr 172.21.15.26:0/1245639948 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:14.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.558+0000 7f0918825700 1 -- 172.21.15.26:0/1245639948 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f091409e1d0 msgr2=0x7f09141c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:14.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.558+0000 7f0918825700 1 --2- 172.21.15.26:0/1245639948 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f091409e1d0 0x7f09141c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:14.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.558+0000 7f0918825700 1 -- 172.21.15.26:0/1245639948 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f091409d6f0 msgr2=0x7f09141c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:14.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.558+0000 7f0918825700 1 --2- 172.21.15.26:0/1245639948 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f091409d6f0 0x7f09141c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:14.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.558+0000 7f0918825700 1 -- 172.21.15.26:0/1245639948 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090c009b30 con 0x7f0914139170 2023-10-01T08:01:14.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.559+0000 7f0918825700 1 --2- 172.21.15.26:0/1245639948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0914139170 0x7f091411e8e0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f090c015000 tx=0x7f090c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:14.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.559+0000 7f0910ff9700 1 -- 172.21.15.26:0/1245639948 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c004880 con 0x7f0914139170 2023-10-01T08:01:14.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.559+0000 7f0910ff9700 1 -- 172.21.15.26:0/1245639948 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090c0092e0 con 0x7f0914139170 2023-10-01T08:01:14.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.559+0000 7f091a288700 1 -- 172.21.15.26:0/1245639948 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09140a29d0 con 0x7f0914139170 2023-10-01T08:01:14.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.559+0000 7f0910ff9700 1 -- 172.21.15.26:0/1245639948 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c01c660 con 0x7f0914139170 2023-10-01T08:01:14.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.559+0000 7f091a288700 1 -- 172.21.15.26:0/1245639948 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0914121fa0 con 0x7f0914139170 2023-10-01T08:01:14.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.560+0000 7f0910ff9700 1 -- 172.21.15.26:0/1245639948 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f090c01c7c0 con 0x7f0914139170 2023-10-01T08:01:14.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.560+0000 7f091a288700 1 -- 172.21.15.26:0/1245639948 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0914074ea0 con 0x7f0914139170 2023-10-01T08:01:14.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.560+0000 7f0910ff9700 1 -- 172.21.15.26:0/1245639948 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f090c040ff0 con 0x7f0914139170 2023-10-01T08:01:14.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.565+0000 7f0910ff9700 1 -- 172.21.15.26:0/1245639948 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f090c0123f0 con 0x7f0914139170 2023-10-01T08:01:14.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.768+0000 7f091a288700 1 -- 172.21.15.26:0/1245639948 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0914120b60 con 0x7f0914139170 2023-10-01T08:01:14.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.769+0000 7f0910ff9700 1 -- 172.21.15.26:0/1245639948 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f090c0243b0 con 0x7f0914139170 2023-10-01T08:01:14.770 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:14.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.771+0000 7f091a288700 1 -- 172.21.15.26:0/1245639948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0914139170 msgr2=0x7f091411e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:14.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.771+0000 7f091a288700 1 --2- 172.21.15.26:0/1245639948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0914139170 0x7f091411e8e0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f090c015000 tx=0x7f090c004ad0 comp rx=0 tx=0).stop 2023-10-01T08:01:14.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.771+0000 7f091a288700 1 -- 172.21.15.26:0/1245639948 shutdown_connections 2023-10-01T08:01:14.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.771+0000 7f091a288700 1 --2- 172.21.15.26:0/1245639948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0914139170 0x7f091411e8e0 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:14.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.771+0000 7f091a288700 1 --2- 172.21.15.26:0/1245639948 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f091409d6f0 0x7f09141c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:14.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.771+0000 7f091a288700 1 --2- 172.21.15.26:0/1245639948 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f091409e1d0 0x7f09141c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:14.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.771+0000 7f091a288700 1 -- 172.21.15.26:0/1245639948 >> 172.21.15.26:0/1245639948 conn(0x7f0914066f50 msgr2=0x7f09140a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:14.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.771+0000 7f091a288700 1 -- 172.21.15.26:0/1245639948 shutdown_connections 2023-10-01T08:01:14.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:14.771+0000 7f091a288700 1 -- 172.21.15.26:0/1245639948 wait complete. 2023-10-01T08:01:14.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:14.907 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:15.039 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:15.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.048+0000 7f48a575f700 1 Processor -- start 2023-10-01T08:01:15.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.048+0000 7f48a575f700 1 -- start start 2023-10-01T08:01:15.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.049+0000 7f48a575f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48a009e1d0 0x7f48a0135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:15.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.049+0000 7f48a575f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48a0135e50 0x7f48a0138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:15.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.049+0000 7f48a575f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a009f130 con 0x7f48a009d6f0 2023-10-01T08:01:15.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.049+0000 7f48a575f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a009f520 con 0x7f48a009e1d0 2023-10-01T08:01:15.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.049+0000 7f48a575f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48a009e930 con 0x7f48a0135e50 2023-10-01T08:01:15.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.049+0000 7f489f7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48a0135e50 0x7f48a0138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:15.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.049+0000 7f489effd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f48a009d6f0 0x7f48a009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39102/0 (socket says 172.21.15.26:39102) 2023-10-01T08:01:15.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.049+0000 7f489effd700 1 -- 172.21.15.26:0/435275573 learned_addr learned my addr 172.21.15.26:0/435275573 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:01:15.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.049+0000 7f489f7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48a0135e50 0x7f48a0138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37336/0 (socket says 172.21.15.26:37336) 2023-10-01T08:01:15.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.049+0000 7f489e7fc700 1 --2- 172.21.15.26:0/435275573 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48a009e1d0 0x7f48a0135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:15.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.049+0000 7f489f7fe700 1 -- 172.21.15.26:0/435275573 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48a009e1d0 msgr2=0x7f48a0135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:15.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.049+0000 7f489f7fe700 1 --2- 172.21.15.26:0/435275573 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48a009e1d0 0x7f48a0135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:15.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.049+0000 7f489f7fe700 1 -- 172.21.15.26:0/435275573 >> v1:172.21.15.26:6789/0 conn(0x7f48a009d6f0 legacy=0x7f48a009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:15.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.049+0000 7f489dffb700 1 -- 172.21.15.26:0/435275573 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1264046543 0 0) 0x7f48a009f130 con 0x7f48a009d6f0 2023-10-01T08:01:15.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.049+0000 7f489f7fe700 1 -- 172.21.15.26:0/435275573 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a009b2d0 con 0x7f48a0135e50 2023-10-01T08:01:15.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.050+0000 7f489f7fe700 1 --2- 172.21.15.26:0/435275573 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48a0135e50 0x7f48a0138230 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f489800be60 tx=0x7f4898009290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ac70563d54b8117 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:15.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.050+0000 7f489dffb700 1 -- 172.21.15.26:0/435275573 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489800c890 con 0x7f48a0135e50 2023-10-01T08:01:15.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.050+0000 7f489dffb700 1 -- 172.21.15.26:0/435275573 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489800c9f0 con 0x7f48a0135e50 2023-10-01T08:01:15.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.050+0000 7f489dffb700 1 -- 172.21.15.26:0/435275573 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489800cda0 con 0x7f48a0135e50 2023-10-01T08:01:15.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.051+0000 7f48a575f700 1 -- 172.21.15.26:0/435275573 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48a0135e50 msgr2=0x7f48a0138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:15.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.051+0000 7f48a575f700 1 --2- 172.21.15.26:0/435275573 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48a0135e50 0x7f48a0138230 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f489800be60 tx=0x7f4898009290 comp rx=0 tx=0).stop 2023-10-01T08:01:15.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.051+0000 7f48a575f700 1 -- 172.21.15.26:0/435275573 shutdown_connections 2023-10-01T08:01:15.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.051+0000 7f48a575f700 1 --2- 172.21.15.26:0/435275573 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48a0135e50 0x7f48a0138230 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:15.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.051+0000 7f48a575f700 1 --2- 172.21.15.26:0/435275573 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48a009e1d0 0x7f48a0135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:15.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.051+0000 7f48a575f700 1 -- 172.21.15.26:0/435275573 >> 172.21.15.26:0/435275573 conn(0x7f48a0066f50 msgr2=0x7f48a009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:15.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.051+0000 7f48a575f700 1 -- 172.21.15.26:0/435275573 shutdown_connections 2023-10-01T08:01:15.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.051+0000 7f48a575f700 1 -- 172.21.15.26:0/435275573 wait complete. 2023-10-01T08:01:15.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.052+0000 7f48a575f700 1 Processor -- start 2023-10-01T08:01:15.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.052+0000 7f48a575f700 1 -- start start 2023-10-01T08:01:15.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.052+0000 7f48a575f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48a009d6f0 0x7f48a011b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:15.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.052+0000 7f48a575f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48a009e1d0 0x7f48a011b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:15.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.052+0000 7f48a575f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48a0135e50 0x7f48a011bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:15.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.052+0000 7f48a575f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a011d190 con 0x7f48a009e1d0 2023-10-01T08:01:15.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.052+0000 7f48a575f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a011ecb0 con 0x7f48a009d6f0 2023-10-01T08:01:15.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.052+0000 7f48a575f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48a00a20d0 con 0x7f48a0135e50 2023-10-01T08:01:15.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.053+0000 7f489effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48a009d6f0 0x7f48a011b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:15.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.053+0000 7f489e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48a009e1d0 0x7f48a011b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:15.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.053+0000 7f489effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48a009d6f0 0x7f48a011b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37786/0 (socket says 172.21.15.26:37786) 2023-10-01T08:01:15.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.053+0000 7f489e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48a009e1d0 0x7f48a011b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44608/0 (socket says 172.21.15.26:44608) 2023-10-01T08:01:15.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.053+0000 7f489effd700 1 -- 172.21.15.26:0/1881996274 learned_addr learned my addr 172.21.15.26:0/1881996274 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:15.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.053+0000 7f489f7fe700 1 --2- 172.21.15.26:0/1881996274 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48a0135e50 0x7f48a011bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:15.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.053+0000 7f489f7fe700 1 -- 172.21.15.26:0/1881996274 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48a009d6f0 msgr2=0x7f48a011b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:15.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.053+0000 7f489f7fe700 1 --2- 172.21.15.26:0/1881996274 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48a009d6f0 0x7f48a011b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:15.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.053+0000 7f489f7fe700 1 -- 172.21.15.26:0/1881996274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48a009e1d0 msgr2=0x7f48a011b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:15.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.053+0000 7f489f7fe700 1 --2- 172.21.15.26:0/1881996274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48a009e1d0 0x7f48a011b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:15.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.053+0000 7f489f7fe700 1 -- 172.21.15.26:0/1881996274 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f489800ba90 con 0x7f48a0135e50 2023-10-01T08:01:15.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.053+0000 7f489effd700 1 --2- 172.21.15.26:0/1881996274 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48a009d6f0 0x7f48a011b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:15.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.053+0000 7f489e7fc700 1 --2- 172.21.15.26:0/1881996274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48a009e1d0 0x7f48a011b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:15.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.053+0000 7f489f7fe700 1 --2- 172.21.15.26:0/1881996274 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48a0135e50 0x7f48a011bef0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f4898015000 tx=0x7f4898004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:15.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.053+0000 7f48877fe700 1 -- 172.21.15.26:0/1881996274 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489800c890 con 0x7f48a0135e50 2023-10-01T08:01:15.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.053+0000 7f48877fe700 1 -- 172.21.15.26:0/1881996274 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4898003e50 con 0x7f48a0135e50 2023-10-01T08:01:15.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.053+0000 7f48a575f700 1 -- 172.21.15.26:0/1881996274 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a009c700 con 0x7f48a0135e50 2023-10-01T08:01:15.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.053+0000 7f48877fe700 1 -- 172.21.15.26:0/1881996274 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4898009b90 con 0x7f48a0135e50 2023-10-01T08:01:15.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.054+0000 7f48a575f700 1 -- 172.21.15.26:0/1881996274 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a011f720 con 0x7f48a0135e50 2023-10-01T08:01:15.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.055+0000 7f48a575f700 1 -- 172.21.15.26:0/1881996274 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48a009dcd0 con 0x7f48a0135e50 2023-10-01T08:01:15.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.055+0000 7f48877fe700 1 -- 172.21.15.26:0/1881996274 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f489801a030 con 0x7f48a0135e50 2023-10-01T08:01:15.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.055+0000 7f48877fe700 1 -- 172.21.15.26:0/1881996274 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4898041050 con 0x7f48a0135e50 2023-10-01T08:01:15.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.060+0000 7f48877fe700 1 -- 172.21.15.26:0/1881996274 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4898024d30 con 0x7f48a0135e50 2023-10-01T08:01:15.081 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:15.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.181+0000 7f7238554700 1 Processor -- start 2023-10-01T08:01:15.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.181+0000 7f7238554700 1 -- start start 2023-10-01T08:01:15.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.182+0000 7f7238554700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f72300a1510 0x7f7230138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:15.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.182+0000 7f7238554700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7230139250 0x7f723013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:15.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.182+0000 7f7238554700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f723009edd0 con 0x7f72300a0a30 2023-10-01T08:01:15.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.182+0000 7f7238554700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72300a18e0 con 0x7f72300a1510 2023-10-01T08:01:15.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.182+0000 7f7238554700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f723009e1f0 con 0x7f7230139250 2023-10-01T08:01:15.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.182+0000 7f7235aef700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f72300a1510 0x7f7230138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:15.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.182+0000 7f7235aef700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f72300a1510 0x7f7230138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44616/0 (socket says 172.21.15.26:44616) 2023-10-01T08:01:15.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.182+0000 7f7235aef700 1 -- 172.21.15.26:0/2822281200 learned_addr learned my addr 172.21.15.26:0/2822281200 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:15.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.182+0000 7f7236af1700 1 --2- 172.21.15.26:0/2822281200 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7230139250 0x7f723013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:15.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.182+0000 7f72352ee700 1 -- 172.21.15.26:0/2822281200 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1463946920 0 0) 0x7f723009edd0 con 0x7f72300a0a30 2023-10-01T08:01:15.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.182+0000 7f72352ee700 1 -- 172.21.15.26:0/2822281200 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72180035b0 con 0x7f72300a0a30 2023-10-01T08:01:15.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.182+0000 7f7236af1700 1 -- 172.21.15.26:0/2822281200 >> v2:172.21.15.26:3300/0 conn(0x7f72300a1510 msgr2=0x7f7230138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:15.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.182+0000 7f7236af1700 1 --2- 172.21.15.26:0/2822281200 >> v2:172.21.15.26:3300/0 conn(0x7f72300a1510 0x7f7230138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:15.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.182+0000 7f7236af1700 1 -- 172.21.15.26:0/2822281200 >> v1:172.21.15.26:6789/0 conn(0x7f72300a0a30 legacy=0x7f72300a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:15.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.182+0000 7f7236af1700 1 -- 172.21.15.26:0/2822281200 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f723009dc50 con 0x7f7230139250 2023-10-01T08:01:15.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.183+0000 7f7236af1700 1 --2- 172.21.15.26:0/2822281200 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7230139250 0x7f723013b630 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f7228009840 tx=0x7f7228009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75d9f0989721e74 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:15.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.183+0000 7f72352ee700 1 -- 172.21.15.26:0/2822281200 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7228011830 con 0x7f7230139250 2023-10-01T08:01:15.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.183+0000 7f72352ee700 1 -- 172.21.15.26:0/2822281200 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7228011990 con 0x7f7230139250 2023-10-01T08:01:15.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.183+0000 7f72352ee700 1 -- 172.21.15.26:0/2822281200 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7228011d20 con 0x7f7230139250 2023-10-01T08:01:15.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.183+0000 7f7238554700 1 -- 172.21.15.26:0/2822281200 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7230139250 msgr2=0x7f723013b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:15.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.183+0000 7f7238554700 1 --2- 172.21.15.26:0/2822281200 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7230139250 0x7f723013b630 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f7228009840 tx=0x7f7228009b50 comp rx=0 tx=0).stop 2023-10-01T08:01:15.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.184+0000 7f7238554700 1 -- 172.21.15.26:0/2822281200 shutdown_connections 2023-10-01T08:01:15.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.184+0000 7f7238554700 1 --2- 172.21.15.26:0/2822281200 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7230139250 0x7f723013b630 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:15.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.184+0000 7f7238554700 1 --2- 172.21.15.26:0/2822281200 >> v2:172.21.15.26:3300/0 conn(0x7f72300a1510 0x7f7230138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:15.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.184+0000 7f7238554700 1 -- 172.21.15.26:0/2822281200 >> 172.21.15.26:0/2822281200 conn(0x7f72300a6550 msgr2=0x7f72300a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:15.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.184+0000 7f7238554700 1 -- 172.21.15.26:0/2822281200 shutdown_connections 2023-10-01T08:01:15.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.184+0000 7f7238554700 1 -- 172.21.15.26:0/2822281200 wait complete. 2023-10-01T08:01:15.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.185+0000 7f7238554700 1 Processor -- start 2023-10-01T08:01:15.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.185+0000 7f7238554700 1 -- start start 2023-10-01T08:01:15.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.185+0000 7f7238554700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72300a0a30 0x7f7230122920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:15.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.185+0000 7f7238554700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f72300a1510 0x7f7230122e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:15.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.185+0000 7f7238554700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7230139250 0x7f72301233a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:15.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.185+0000 7f7238554700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72301261d0 con 0x7f72300a0a30 2023-10-01T08:01:15.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.185+0000 7f7238554700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72301263b0 con 0x7f7230139250 2023-10-01T08:01:15.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.185+0000 7f7238554700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7230125e10 con 0x7f72300a1510 2023-10-01T08:01:15.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.185+0000 7f72362f0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72300a0a30 0x7f7230122920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:15.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.185+0000 7f72362f0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72300a0a30 0x7f7230122920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44632/0 (socket says 172.21.15.26:44632) 2023-10-01T08:01:15.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.185+0000 7f72362f0700 1 -- 172.21.15.26:0/2446684957 learned_addr learned my addr 172.21.15.26:0/2446684957 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:15.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.185+0000 7f7236af1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7230139250 0x7f72301233a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:15.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.185+0000 7f7235aef700 1 --2- 172.21.15.26:0/2446684957 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f72300a1510 0x7f7230122e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:15.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.186+0000 7f7235aef700 1 -- 172.21.15.26:0/2446684957 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7230139250 msgr2=0x7f72301233a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:15.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.186+0000 7f7235aef700 1 --2- 172.21.15.26:0/2446684957 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7230139250 0x7f72301233a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:15.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.186+0000 7f7235aef700 1 -- 172.21.15.26:0/2446684957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72300a0a30 msgr2=0x7f7230122920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:15.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.186+0000 7f7235aef700 1 --2- 172.21.15.26:0/2446684957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72300a0a30 0x7f7230122920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:15.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.186+0000 7f7235aef700 1 -- 172.21.15.26:0/2446684957 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72280094a0 con 0x7f72300a1510 2023-10-01T08:01:15.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.186+0000 7f7236af1700 1 --2- 172.21.15.26:0/2446684957 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7230139250 0x7f72301233a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:15.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.186+0000 7f7235aef700 1 --2- 172.21.15.26:0/2446684957 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f72300a1510 0x7f7230122e60 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f722400e910 tx=0x7f722400ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:15.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.186+0000 7f722effd700 1 -- 172.21.15.26:0/2446684957 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7224013680 con 0x7f72300a1510 2023-10-01T08:01:15.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.186+0000 7f722effd700 1 -- 172.21.15.26:0/2446684957 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72240137e0 con 0x7f72300a1510 2023-10-01T08:01:15.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.186+0000 7f7238554700 1 -- 172.21.15.26:0/2446684957 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72301245a0 con 0x7f72300a1510 2023-10-01T08:01:15.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.186+0000 7f722effd700 1 -- 172.21.15.26:0/2446684957 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7224013b50 con 0x7f72300a1510 2023-10-01T08:01:15.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.186+0000 7f7238554700 1 -- 172.21.15.26:0/2446684957 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72301389c0 con 0x7f72300a1510 2023-10-01T08:01:15.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.187+0000 7f722effd700 1 -- 172.21.15.26:0/2446684957 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7224013cb0 con 0x7f72300a1510 2023-10-01T08:01:15.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.188+0000 7f722effd700 1 -- 172.21.15.26:0/2446684957 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f722403f490 con 0x7f72300a1510 2023-10-01T08:01:15.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.188+0000 7f7238554700 1 -- 172.21.15.26:0/2446684957 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f723004ea50 con 0x7f72300a1510 2023-10-01T08:01:15.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.193+0000 7f722effd700 1 -- 172.21.15.26:0/2446684957 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7224017080 con 0x7f72300a1510 2023-10-01T08:01:15.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.222+0000 7fc6655ab700 1 Processor -- start 2023-10-01T08:01:15.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.222+0000 7fc6655ab700 1 -- start start 2023-10-01T08:01:15.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.223+0000 7fc6655ab700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc66009d6f0 0x7fc66009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:15.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.223+0000 7fc6655ab700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc66009e410 0x7fc660130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:15.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.223+0000 7fc6655ab700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc66009f130 con 0x7fc66009e000 2023-10-01T08:01:15.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.223+0000 7fc6655ab700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc66009f520 con 0x7fc66009e410 2023-10-01T08:01:15.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.223+0000 7fc6655ab700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc66009e930 con 0x7fc66009d6f0 2023-10-01T08:01:15.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.223+0000 7fc65effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc66009d6f0 0x7fc66009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:15.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.223+0000 7fc65e7fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc66009e000 0x7fc660130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39130/0 (socket says 172.21.15.26:39130) 2023-10-01T08:01:15.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.223+0000 7fc65e7fc700 1 -- 172.21.15.26:0/3947761194 learned_addr learned my addr 172.21.15.26:0/3947761194 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:01:15.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.223+0000 7fc65effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc66009d6f0 0x7fc66009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37366/0 (socket says 172.21.15.26:37366) 2023-10-01T08:01:15.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.223+0000 7fc65f7fe700 1 --2- 172.21.15.26:0/3947761194 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc66009e410 0x7fc660130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:15.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.223+0000 7fc65effd700 1 -- 172.21.15.26:0/3947761194 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc66009e410 msgr2=0x7fc660130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:15.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.223+0000 7fc65effd700 1 --2- 172.21.15.26:0/3947761194 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc66009e410 0x7fc660130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:15.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.223+0000 7fc65effd700 1 -- 172.21.15.26:0/3947761194 >> v1:172.21.15.26:6789/0 conn(0x7fc66009e000 legacy=0x7fc660130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:15.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.223+0000 7fc65dffb700 1 -- 172.21.15.26:0/3947761194 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 426674265 0 0) 0x7fc66009f130 con 0x7fc66009e000 2023-10-01T08:01:15.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.223+0000 7fc65effd700 1 -- 172.21.15.26:0/3947761194 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc66009b2d0 con 0x7fc66009d6f0 2023-10-01T08:01:15.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.223+0000 7fc65effd700 1 --2- 172.21.15.26:0/3947761194 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc66009d6f0 0x7fc66009dac0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fc65000b920 tx=0x7fc65000bc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc89801ddc513141 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:15.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.224+0000 7fc65dffb700 1 -- 172.21.15.26:0/3947761194 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65000ca30 con 0x7fc66009d6f0 2023-10-01T08:01:15.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.224+0000 7fc65dffb700 1 -- 172.21.15.26:0/3947761194 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65000cb90 con 0x7fc66009d6f0 2023-10-01T08:01:15.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.224+0000 7fc65dffb700 1 -- 172.21.15.26:0/3947761194 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65000f460 con 0x7fc66009d6f0 2023-10-01T08:01:15.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.225+0000 7fc6655ab700 1 -- 172.21.15.26:0/3947761194 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc66009d6f0 msgr2=0x7fc66009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:15.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.225+0000 7fc6655ab700 1 --2- 172.21.15.26:0/3947761194 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc66009d6f0 0x7fc66009dac0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fc65000b920 tx=0x7fc65000bc30 comp rx=0 tx=0).stop 2023-10-01T08:01:15.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.225+0000 7fc6655ab700 1 -- 172.21.15.26:0/3947761194 shutdown_connections 2023-10-01T08:01:15.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.225+0000 7fc6655ab700 1 --2- 172.21.15.26:0/3947761194 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc66009d6f0 0x7fc66009dac0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:15.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.225+0000 7fc6655ab700 1 --2- 172.21.15.26:0/3947761194 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc66009e410 0x7fc660130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:15.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.225+0000 7fc6655ab700 1 -- 172.21.15.26:0/3947761194 >> 172.21.15.26:0/3947761194 conn(0x7fc660066f50 msgr2=0x7fc66009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:15.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.225+0000 7fc6655ab700 1 -- 172.21.15.26:0/3947761194 shutdown_connections 2023-10-01T08:01:15.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.225+0000 7fc6655ab700 1 -- 172.21.15.26:0/3947761194 wait complete. 2023-10-01T08:01:15.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.226+0000 7fc6655ab700 1 Processor -- start 2023-10-01T08:01:15.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.226+0000 7fc6655ab700 1 -- start start 2023-10-01T08:01:15.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.227+0000 7fc6655ab700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc66009d6f0 0x7fc66011e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:15.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.227+0000 7fc6655ab700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc66009e000 0x7fc66011e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:15.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.227+0000 7fc6655ab700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc66009e410 0x7fc66011ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:15.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.227+0000 7fc6655ab700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc660122830 con 0x7fc66009e410 2023-10-01T08:01:15.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.227+0000 7fc6655ab700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc660121970 con 0x7fc66009d6f0 2023-10-01T08:01:15.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.227+0000 7fc6655ab700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc660072600 con 0x7fc66009e000 2023-10-01T08:01:15.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.227+0000 7fc65e7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc66009e000 0x7fc66011e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:15.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.227+0000 7fc65effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc66009d6f0 0x7fc66011e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:15.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.227+0000 7fc65e7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc66009e000 0x7fc66011e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37380/0 (socket says 172.21.15.26:37380) 2023-10-01T08:01:15.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.227+0000 7fc65effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc66009d6f0 0x7fc66011e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37808/0 (socket says 172.21.15.26:37808) 2023-10-01T08:01:15.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.227+0000 7fc65e7fc700 1 -- 172.21.15.26:0/1352400449 learned_addr learned my addr 172.21.15.26:0/1352400449 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:15.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.227+0000 7fc65f7fe700 1 --2- 172.21.15.26:0/1352400449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc66009e410 0x7fc66011ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:15.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.228+0000 7fc65e7fc700 1 -- 172.21.15.26:0/1352400449 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc66009d6f0 msgr2=0x7fc66011e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:15.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.228+0000 7fc65e7fc700 1 --2- 172.21.15.26:0/1352400449 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc66009d6f0 0x7fc66011e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:15.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.228+0000 7fc65e7fc700 1 -- 172.21.15.26:0/1352400449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc66009e410 msgr2=0x7fc66011ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:15.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.228+0000 7fc65e7fc700 1 --2- 172.21.15.26:0/1352400449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc66009e410 0x7fc66011ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:15.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.228+0000 7fc65e7fc700 1 -- 172.21.15.26:0/1352400449 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc65000b550 con 0x7fc66009e000 2023-10-01T08:01:15.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.228+0000 7fc65e7fc700 1 --2- 172.21.15.26:0/1352400449 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc66009e000 0x7fc66011e740 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fc654001eb0 tx=0x7fc65400c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:15.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.228+0000 7fc6477fe700 1 -- 172.21.15.26:0/1352400449 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc654004c80 con 0x7fc66009e000 2023-10-01T08:01:15.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.228+0000 7fc6477fe700 1 -- 172.21.15.26:0/1352400449 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc654004de0 con 0x7fc66009e000 2023-10-01T08:01:15.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.228+0000 7fc6655ab700 1 -- 172.21.15.26:0/1352400449 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6601216b0 con 0x7fc66009e000 2023-10-01T08:01:15.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.228+0000 7fc6477fe700 1 -- 172.21.15.26:0/1352400449 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc654007310 con 0x7fc66009e000 2023-10-01T08:01:15.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.228+0000 7fc6655ab700 1 -- 172.21.15.26:0/1352400449 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6601223e0 con 0x7fc66009e000 2023-10-01T08:01:15.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.229+0000 7fc6655ab700 1 -- 172.21.15.26:0/1352400449 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc66009a520 con 0x7fc66009e000 2023-10-01T08:01:15.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.230+0000 7fc6477fe700 1 -- 172.21.15.26:0/1352400449 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc654007470 con 0x7fc66009e000 2023-10-01T08:01:15.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.230+0000 7fc6477fe700 1 -- 172.21.15.26:0/1352400449 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc65403fa60 con 0x7fc66009e000 2023-10-01T08:01:15.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.234+0000 7fc6477fe700 1 -- 172.21.15.26:0/1352400449 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc6540133c0 con 0x7fc66009e000 2023-10-01T08:01:15.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.274+0000 7f48a575f700 1 -- 172.21.15.26:0/1881996274 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f48a0074ea0 con 0x7f48a0135e50 2023-10-01T08:01:15.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.275+0000 7f48877fe700 1 -- 172.21.15.26:0/1881996274 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4898018070 con 0x7f48a0135e50 2023-10-01T08:01:15.277 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:15.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.278+0000 7f48a575f700 1 -- 172.21.15.26:0/1881996274 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48a0135e50 msgr2=0x7f48a011bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:15.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.278+0000 7f48a575f700 1 --2- 172.21.15.26:0/1881996274 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48a0135e50 0x7f48a011bef0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f4898015000 tx=0x7f4898004ad0 comp rx=0 tx=0).stop 2023-10-01T08:01:15.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.278+0000 7f48a575f700 1 -- 172.21.15.26:0/1881996274 shutdown_connections 2023-10-01T08:01:15.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.278+0000 7f48a575f700 1 --2- 172.21.15.26:0/1881996274 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f48a0135e50 0x7f48a011bef0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:15.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.278+0000 7f48a575f700 1 --2- 172.21.15.26:0/1881996274 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48a009d6f0 0x7f48a011b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:15.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.278+0000 7f48a575f700 1 --2- 172.21.15.26:0/1881996274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48a009e1d0 0x7f48a011b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:15.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.278+0000 7f48a575f700 1 -- 172.21.15.26:0/1881996274 >> 172.21.15.26:0/1881996274 conn(0x7f48a0066f50 msgr2=0x7f48a0132710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:15.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.278+0000 7f48a575f700 1 -- 172.21.15.26:0/1881996274 shutdown_connections 2023-10-01T08:01:15.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.278+0000 7f48a575f700 1 -- 172.21.15.26:0/1881996274 wait complete. 2023-10-01T08:01:15.299 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:15.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.405+0000 7f7238554700 1 -- 172.21.15.26:0/2446684957 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7230124540 con 0x7f72300a1510 2023-10-01T08:01:15.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.405+0000 7f722effd700 1 -- 172.21.15.26:0/2446684957 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7224021020 con 0x7f72300a1510 2023-10-01T08:01:15.407 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:15.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.407+0000 7f7238554700 1 -- 172.21.15.26:0/2446684957 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f72300a1510 msgr2=0x7f7230122e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:15.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.407+0000 7f7238554700 1 --2- 172.21.15.26:0/2446684957 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f72300a1510 0x7f7230122e60 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f722400e910 tx=0x7f722400ec20 comp rx=0 tx=0).stop 2023-10-01T08:01:15.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.407+0000 7f7238554700 1 -- 172.21.15.26:0/2446684957 shutdown_connections 2023-10-01T08:01:15.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.407+0000 7f7238554700 1 --2- 172.21.15.26:0/2446684957 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7230139250 0x7f72301233a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:15.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.408+0000 7f7238554700 1 --2- 172.21.15.26:0/2446684957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72300a0a30 0x7f7230122920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:15.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.408+0000 7f7238554700 1 --2- 172.21.15.26:0/2446684957 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f72300a1510 0x7f7230122e60 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:15.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.408+0000 7f7238554700 1 -- 172.21.15.26:0/2446684957 >> 172.21.15.26:0/2446684957 conn(0x7f72300a6550 msgr2=0x7f723011c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:15.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.408+0000 7f7238554700 1 -- 172.21.15.26:0/2446684957 shutdown_connections 2023-10-01T08:01:15.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.408+0000 7f7238554700 1 -- 172.21.15.26:0/2446684957 wait complete. 2023-10-01T08:01:15.423 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:15.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.452+0000 7fc6655ab700 1 -- 172.21.15.26:0/1352400449 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc660074ea0 con 0x7fc66009e000 2023-10-01T08:01:15.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.453+0000 7fc6477fe700 1 -- 172.21.15.26:0/1352400449 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc6540102c0 con 0x7fc66009e000 2023-10-01T08:01:15.455 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:15.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.455+0000 7fc6655ab700 1 -- 172.21.15.26:0/1352400449 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc66009e000 msgr2=0x7fc66011e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:15.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.455+0000 7fc6655ab700 1 --2- 172.21.15.26:0/1352400449 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc66009e000 0x7fc66011e740 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fc654001eb0 tx=0x7fc65400c800 comp rx=0 tx=0).stop 2023-10-01T08:01:15.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.455+0000 7fc6655ab700 1 -- 172.21.15.26:0/1352400449 shutdown_connections 2023-10-01T08:01:15.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.455+0000 7fc6655ab700 1 --2- 172.21.15.26:0/1352400449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc66009e410 0x7fc66011ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:15.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.455+0000 7fc6655ab700 1 --2- 172.21.15.26:0/1352400449 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc66009d6f0 0x7fc66011e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:15.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.455+0000 7fc6655ab700 1 --2- 172.21.15.26:0/1352400449 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc66009e000 0x7fc66011e740 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:15.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.455+0000 7fc6655ab700 1 -- 172.21.15.26:0/1352400449 >> 172.21.15.26:0/1352400449 conn(0x7fc660066f50 msgr2=0x7fc6600a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:15.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.455+0000 7fc6655ab700 1 -- 172.21.15.26:0/1352400449 shutdown_connections 2023-10-01T08:01:15.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.455+0000 7fc6655ab700 1 -- 172.21.15.26:0/1352400449 wait complete. 2023-10-01T08:01:15.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:15.788 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:15.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.939+0000 7f6be7e43700 1 Processor -- start 2023-10-01T08:01:15.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.939+0000 7f6be7e43700 1 -- start start 2023-10-01T08:01:15.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.940+0000 7f6be7e43700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6be009e930 0x7f6be009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:15.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.940+0000 7f6be7e43700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6be009f650 0x7f6be0131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:15.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.940+0000 7f6be7e43700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be0070940 con 0x7f6be009f240 2023-10-01T08:01:15.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.940+0000 7f6be7e43700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be006fd60 con 0x7f6be009f650 2023-10-01T08:01:15.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.940+0000 7f6be7e43700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6be006fa80 con 0x7f6be009e930 2023-10-01T08:01:15.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.940+0000 7f6be63e0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6be009f650 0x7f6be0131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:15.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.940+0000 7f6be5bdf700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6be009e930 0x7f6be009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:15.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.940+0000 7f6be63e0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6be009f650 0x7f6be0131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37822/0 (socket says 172.21.15.26:37822) 2023-10-01T08:01:15.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.940+0000 7f6be63e0700 1 -- 172.21.15.26:0/2472604967 learned_addr learned my addr 172.21.15.26:0/2472604967 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:15.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.940+0000 7f6be53de700 1 --1- 172.21.15.26:0/2472604967 >> v1:172.21.15.26:6789/0 conn(0x7f6be009f240 0x7f6be01317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39140/0 (socket says 172.21.15.26:39140) 2023-10-01T08:01:15.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.940+0000 7f6be63e0700 1 -- 172.21.15.26:0/2472604967 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6be009e930 msgr2=0x7f6be009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:15.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.940+0000 7f6be63e0700 1 --2- 172.21.15.26:0/2472604967 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6be009e930 0x7f6be009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:15.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.940+0000 7f6be63e0700 1 -- 172.21.15.26:0/2472604967 >> v1:172.21.15.26:6789/0 conn(0x7f6be009f240 legacy=0x7f6be01317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:15.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.940+0000 7f6be4bdd700 1 -- 172.21.15.26:0/2472604967 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 97684887 0 0) 0x7f6be0070940 con 0x7f6be009f240 2023-10-01T08:01:15.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.940+0000 7f6be63e0700 1 -- 172.21.15.26:0/2472604967 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be009fb60 con 0x7f6be009f650 2023-10-01T08:01:15.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.940+0000 7f6be5bdf700 1 --2- 172.21.15.26:0/2472604967 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6be009e930 0x7f6be009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:15.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.941+0000 7f6be63e0700 1 --2- 172.21.15.26:0/2472604967 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6be009f650 0x7f6be0131f00 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8009e80 tx=0x7f6bd800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a04295cc65fff3a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:15.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.941+0000 7f6be4bdd700 1 -- 172.21.15.26:0/2472604967 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd800e070 con 0x7f6be009f650 2023-10-01T08:01:15.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.941+0000 7f6be4bdd700 1 -- 172.21.15.26:0/2472604967 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd800b910 con 0x7f6be009f650 2023-10-01T08:01:15.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.941+0000 7f6be4bdd700 1 -- 172.21.15.26:0/2472604967 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd800bcc0 con 0x7f6be009f650 2023-10-01T08:01:15.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.941+0000 7f6be7e43700 1 -- 172.21.15.26:0/2472604967 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6be009f650 msgr2=0x7f6be0131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:15.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.941+0000 7f6be7e43700 1 --2- 172.21.15.26:0/2472604967 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6be009f650 0x7f6be0131f00 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8009e80 tx=0x7f6bd800b330 comp rx=0 tx=0).stop 2023-10-01T08:01:15.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.941+0000 7f6be7e43700 1 -- 172.21.15.26:0/2472604967 shutdown_connections 2023-10-01T08:01:15.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.941+0000 7f6be7e43700 1 --2- 172.21.15.26:0/2472604967 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6be009e930 0x7f6be009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:15.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.941+0000 7f6be7e43700 1 --2- 172.21.15.26:0/2472604967 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6be009f650 0x7f6be0131f00 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:15.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.941+0000 7f6be7e43700 1 -- 172.21.15.26:0/2472604967 >> 172.21.15.26:0/2472604967 conn(0x7f6be00a4210 msgr2=0x7f6be00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:15.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.941+0000 7f6be7e43700 1 -- 172.21.15.26:0/2472604967 shutdown_connections 2023-10-01T08:01:15.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.941+0000 7f6be7e43700 1 -- 172.21.15.26:0/2472604967 wait complete. 2023-10-01T08:01:15.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.942+0000 7f6be7e43700 1 Processor -- start 2023-10-01T08:01:15.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.942+0000 7f6be7e43700 1 -- start start 2023-10-01T08:01:15.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.943+0000 7f6be7e43700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6be009e930 0x7f6be006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:15.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.943+0000 7f6be7e43700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6be009f240 0x7f6be006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:15.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.943+0000 7f6be7e43700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6be009f650 0x7f6be006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:15.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.943+0000 7f6be7e43700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be01a8790 con 0x7f6be009e930 2023-10-01T08:01:15.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.943+0000 7f6be7e43700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be01a97d0 con 0x7f6be009f650 2023-10-01T08:01:15.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.943+0000 7f6be7e43700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6be00a3400 con 0x7f6be009f240 2023-10-01T08:01:15.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.943+0000 7f6be5bdf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6be009e930 0x7f6be006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:15.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.943+0000 7f6be53de700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6be009f240 0x7f6be006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:15.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.943+0000 7f6be5bdf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6be009e930 0x7f6be006b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44636/0 (socket says 172.21.15.26:44636) 2023-10-01T08:01:15.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.943+0000 7f6be5bdf700 1 -- 172.21.15.26:0/3139271581 learned_addr learned my addr 172.21.15.26:0/3139271581 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:15.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.943+0000 7f6be63e0700 1 --2- 172.21.15.26:0/3139271581 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6be009f650 0x7f6be006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:15.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.943+0000 7f6be5bdf700 1 -- 172.21.15.26:0/3139271581 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6be009f240 msgr2=0x7f6be006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:15.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.943+0000 7f6be5bdf700 1 --2- 172.21.15.26:0/3139271581 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6be009f240 0x7f6be006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:15.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.943+0000 7f6be5bdf700 1 -- 172.21.15.26:0/3139271581 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6be009f650 msgr2=0x7f6be006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:15.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.943+0000 7f6be5bdf700 1 --2- 172.21.15.26:0/3139271581 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6be009f650 0x7f6be006c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:15.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.943+0000 7f6be5bdf700 1 -- 172.21.15.26:0/3139271581 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd40094a0 con 0x7f6be009e930 2023-10-01T08:01:15.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.943+0000 7f6be53de700 1 --2- 172.21.15.26:0/3139271581 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6be009f240 0x7f6be006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:15.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.944+0000 7f6be5bdf700 1 --2- 172.21.15.26:0/3139271581 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6be009e930 0x7f6be006b8b0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f6bd400ebe0 tx=0x7f6bd400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:15.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.944+0000 7f6bd27fc700 1 -- 172.21.15.26:0/3139271581 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd400c850 con 0x7f6be009e930 2023-10-01T08:01:15.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.944+0000 7f6bd27fc700 1 -- 172.21.15.26:0/3139271581 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd400c9b0 con 0x7f6be009e930 2023-10-01T08:01:15.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.944+0000 7f6bd27fc700 1 -- 172.21.15.26:0/3139271581 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd400cd40 con 0x7f6be009e930 2023-10-01T08:01:15.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.944+0000 7f6be7e43700 1 -- 172.21.15.26:0/3139271581 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd8009b30 con 0x7f6be009e930 2023-10-01T08:01:15.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.944+0000 7f6be7e43700 1 -- 172.21.15.26:0/3139271581 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be00a0190 con 0x7f6be009e930 2023-10-01T08:01:15.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.945+0000 7f6bd27fc700 1 -- 172.21.15.26:0/3139271581 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6bd4013470 con 0x7f6be009e930 2023-10-01T08:01:15.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.945+0000 7f6bd27fc700 1 -- 172.21.15.26:0/3139271581 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6bd403f730 con 0x7f6be009e930 2023-10-01T08:01:15.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.945+0000 7f6be7e43700 1 -- 172.21.15.26:0/3139271581 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be01a0b30 con 0x7f6be009e930 2023-10-01T08:01:15.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:15.950+0000 7f6bd27fc700 1 -- 172.21.15.26:0/3139271581 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6bd4013720 con 0x7f6be009e930 2023-10-01T08:01:16.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.160+0000 7f6be7e43700 1 -- 172.21.15.26:0/3139271581 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6be009ffe0 con 0x7f6be009e930 2023-10-01T08:01:16.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.161+0000 7f6bd27fc700 1 -- 172.21.15.26:0/3139271581 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6bd4021020 con 0x7f6be009e930 2023-10-01T08:01:16.163 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:16.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.163+0000 7f6be7e43700 1 -- 172.21.15.26:0/3139271581 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6be009e930 msgr2=0x7f6be006b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:16.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.163+0000 7f6be7e43700 1 --2- 172.21.15.26:0/3139271581 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6be009e930 0x7f6be006b8b0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f6bd400ebe0 tx=0x7f6bd400eef0 comp rx=0 tx=0).stop 2023-10-01T08:01:16.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.163+0000 7f6be7e43700 1 -- 172.21.15.26:0/3139271581 shutdown_connections 2023-10-01T08:01:16.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.163+0000 7f6be7e43700 1 --2- 172.21.15.26:0/3139271581 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6be009f650 0x7f6be006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:16.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.163+0000 7f6be7e43700 1 --2- 172.21.15.26:0/3139271581 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6be009e930 0x7f6be006b8b0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:16.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.163+0000 7f6be7e43700 1 --2- 172.21.15.26:0/3139271581 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6be009f240 0x7f6be006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:16.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.163+0000 7f6be7e43700 1 -- 172.21.15.26:0/3139271581 >> 172.21.15.26:0/3139271581 conn(0x7f6be00a4210 msgr2=0x7f6be01b89f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:16.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.163+0000 7f6be7e43700 1 -- 172.21.15.26:0/3139271581 shutdown_connections 2023-10-01T08:01:16.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.163+0000 7f6be7e43700 1 -- 172.21.15.26:0/3139271581 wait complete. 2023-10-01T08:01:16.179 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:16.300 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:16.425 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:16.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.442+0000 7fd20842c700 1 Processor -- start 2023-10-01T08:01:16.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.442+0000 7fd20842c700 1 -- start start 2023-10-01T08:01:16.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.443+0000 7fd20842c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd20009d6f0 0x7fd20009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:16.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.443+0000 7fd20842c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd20009e410 0x7fd200134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:16.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.443+0000 7fd20842c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd20009b120 con 0x7fd20009e000 2023-10-01T08:01:16.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.443+0000 7fd20842c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd20006b460 con 0x7fd20009e410 2023-10-01T08:01:16.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.443+0000 7fd20842c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20009a7e0 con 0x7fd20009d6f0 2023-10-01T08:01:16.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.443+0000 7fd2069c9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd20009e410 0x7fd200134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:16.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.443+0000 7fd2061c8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd20009d6f0 0x7fd20009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:16.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.443+0000 7fd2069c9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd20009e410 0x7fd200134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44652/0 (socket says 172.21.15.26:44652) 2023-10-01T08:01:16.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.443+0000 7fd2069c9700 1 -- 172.21.15.26:0/3871381679 learned_addr learned my addr 172.21.15.26:0/3871381679 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:16.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.443+0000 7fd2061c8700 1 -- 172.21.15.26:0/3871381679 >> v2:172.21.15.26:3300/0 conn(0x7fd20009e410 msgr2=0x7fd200134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:16.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.443+0000 7fd2061c8700 1 --2- 172.21.15.26:0/3871381679 >> v2:172.21.15.26:3300/0 conn(0x7fd20009e410 0x7fd200134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:16.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.443+0000 7fd2061c8700 1 -- 172.21.15.26:0/3871381679 >> v1:172.21.15.26:6789/0 conn(0x7fd20009e000 legacy=0x7fd2001339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:16.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.443+0000 7fd2061c8700 1 -- 172.21.15.26:0/3871381679 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20009a500 con 0x7fd20009d6f0 2023-10-01T08:01:16.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.443+0000 7fd2069c9700 1 --2- 172.21.15.26:0/3871381679 >> v2:172.21.15.26:3300/0 conn(0x7fd20009e410 0x7fd200134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:16.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.444+0000 7fd2061c8700 1 --2- 172.21.15.26:0/3871381679 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd20009d6f0 0x7fd20009dac0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc009870 tx=0x7fd1fc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd1b620b2d1908fe server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:16.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.444+0000 7fd2051c6700 1 -- 172.21.15.26:0/3871381679 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc011830 con 0x7fd20009d6f0 2023-10-01T08:01:16.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.444+0000 7fd2051c6700 1 -- 172.21.15.26:0/3871381679 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1fc011990 con 0x7fd20009d6f0 2023-10-01T08:01:16.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.444+0000 7fd2051c6700 1 -- 172.21.15.26:0/3871381679 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc011d20 con 0x7fd20009d6f0 2023-10-01T08:01:16.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.444+0000 7fd20842c700 1 -- 172.21.15.26:0/3871381679 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd20009d6f0 msgr2=0x7fd20009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:16.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.444+0000 7fd20842c700 1 --2- 172.21.15.26:0/3871381679 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd20009d6f0 0x7fd20009dac0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc009870 tx=0x7fd1fc009b80 comp rx=0 tx=0).stop 2023-10-01T08:01:16.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.445+0000 7fd20842c700 1 -- 172.21.15.26:0/3871381679 shutdown_connections 2023-10-01T08:01:16.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.445+0000 7fd20842c700 1 --2- 172.21.15.26:0/3871381679 >> v2:172.21.15.26:3300/0 conn(0x7fd20009e410 0x7fd200134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:16.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.445+0000 7fd20842c700 1 --2- 172.21.15.26:0/3871381679 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd20009d6f0 0x7fd20009dac0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:16.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.445+0000 7fd20842c700 1 -- 172.21.15.26:0/3871381679 >> 172.21.15.26:0/3871381679 conn(0x7fd200066f50 msgr2=0x7fd20009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:16.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.445+0000 7fd20842c700 1 -- 172.21.15.26:0/3871381679 shutdown_connections 2023-10-01T08:01:16.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.445+0000 7fd20842c700 1 -- 172.21.15.26:0/3871381679 wait complete. 2023-10-01T08:01:16.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.446+0000 7fd20842c700 1 Processor -- start 2023-10-01T08:01:16.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.446+0000 7fd20842c700 1 -- start start 2023-10-01T08:01:16.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.446+0000 7fd20842c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd20009d6f0 0x7fd2001a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:16.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.446+0000 7fd20842c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd20009e000 0x7fd2001a65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:16.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.446+0000 7fd20842c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd20009e410 0x7fd2001a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:16.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.446+0000 7fd20842c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2001a9b00 con 0x7fd20009e410 2023-10-01T08:01:16.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.446+0000 7fd20842c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2001a81d0 con 0x7fd20009e000 2023-10-01T08:01:16.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.446+0000 7fd20842c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2001a9290 con 0x7fd20009d6f0 2023-10-01T08:01:16.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.446+0000 7fd2069c9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd20009e410 0x7fd2001a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:16.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.446+0000 7fd2061c8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd20009d6f0 0x7fd2001a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:16.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.446+0000 7fd2059c7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd20009e000 0x7fd2001a65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:16.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.446+0000 7fd2069c9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd20009e410 0x7fd2001a6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44668/0 (socket says 172.21.15.26:44668) 2023-10-01T08:01:16.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.446+0000 7fd2069c9700 1 -- 172.21.15.26:0/1265050743 learned_addr learned my addr 172.21.15.26:0/1265050743 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:16.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.446+0000 7fd2061c8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd20009d6f0 0x7fd2001a6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37400/0 (socket says 172.21.15.26:37400) 2023-10-01T08:01:16.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.447+0000 7fd2069c9700 1 -- 172.21.15.26:0/1265050743 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd20009d6f0 msgr2=0x7fd2001a6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:16.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.447+0000 7fd2069c9700 1 --2- 172.21.15.26:0/1265050743 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd20009d6f0 0x7fd2001a6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:16.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.447+0000 7fd2069c9700 1 -- 172.21.15.26:0/1265050743 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd20009e000 msgr2=0x7fd2001a65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:16.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.447+0000 7fd2069c9700 1 --2- 172.21.15.26:0/1265050743 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd20009e000 0x7fd2001a65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:16.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.447+0000 7fd2069c9700 1 -- 172.21.15.26:0/1265050743 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f8009b30 con 0x7fd20009e410 2023-10-01T08:01:16.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.447+0000 7fd2059c7700 1 --2- 172.21.15.26:0/1265050743 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd20009e000 0x7fd2001a65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:16.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.447+0000 7fd2061c8700 1 --2- 172.21.15.26:0/1265050743 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd20009d6f0 0x7fd2001a6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:16.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.447+0000 7fd2069c9700 1 --2- 172.21.15.26:0/1265050743 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd20009e410 0x7fd2001a6af0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8009f10 tx=0x7fd1f800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:16.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.447+0000 7fd1f6ffd700 1 -- 172.21.15.26:0/1265050743 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8018070 con 0x7fd20009e410 2023-10-01T08:01:16.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.447+0000 7fd1f6ffd700 1 -- 172.21.15.26:0/1265050743 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f800f040 con 0x7fd20009e410 2023-10-01T08:01:16.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.447+0000 7fd20842c700 1 -- 172.21.15.26:0/1265050743 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1fc0094a0 con 0x7fd20009e410 2023-10-01T08:01:16.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.447+0000 7fd1f6ffd700 1 -- 172.21.15.26:0/1265050743 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8003c40 con 0x7fd20009e410 2023-10-01T08:01:16.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.447+0000 7fd20842c700 1 -- 172.21.15.26:0/1265050743 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2000a3340 con 0x7fd20009e410 2023-10-01T08:01:16.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.448+0000 7fd1f6ffd700 1 -- 172.21.15.26:0/1265050743 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd1f800c940 con 0x7fd20009e410 2023-10-01T08:01:16.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.448+0000 7fd1f6ffd700 1 -- 172.21.15.26:0/1265050743 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd1f803f7f0 con 0x7fd20009e410 2023-10-01T08:01:16.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.449+0000 7fd20842c700 1 -- 172.21.15.26:0/1265050743 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2001a7c50 con 0x7fd20009e410 2023-10-01T08:01:16.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.455+0000 7fd1f6ffd700 1 -- 172.21.15.26:0/1265050743 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd1f8014480 con 0x7fd20009e410 2023-10-01T08:01:16.471 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:16.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.566+0000 7f77a3c2a700 1 Processor -- start 2023-10-01T08:01:16.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.566+0000 7f77a3c2a700 1 -- start start 2023-10-01T08:01:16.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.567+0000 7f77a3c2a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779c0a0a30 0x7f779c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:16.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.567+0000 7f77a3c2a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779c0a1340 0x7f779c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:16.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.567+0000 7f77a3c2a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f779c133fa0 0x7f779c134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:16.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.567+0000 7f77a3c2a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f779c09edd0 con 0x7f779c133fa0 2023-10-01T08:01:16.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.567+0000 7f77a3c2a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f779c09e1f0 con 0x7f779c0a0a30 2023-10-01T08:01:16.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.567+0000 7f77a3c2a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f779c09dc50 con 0x7f779c0a1340 2023-10-01T08:01:16.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.567+0000 7f77a19c6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779c0a0a30 0x7f779c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:16.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.567+0000 7f77a19c6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779c0a0a30 0x7f779c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37862/0 (socket says 172.21.15.26:37862) 2023-10-01T08:01:16.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.567+0000 7f77a19c6700 1 -- 172.21.15.26:0/266422499 learned_addr learned my addr 172.21.15.26:0/266422499 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:16.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.567+0000 7f77a11c5700 1 --2- 172.21.15.26:0/266422499 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779c0a1340 0x7f779c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:16.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.567+0000 7f77a21c7700 1 --2- 172.21.15.26:0/266422499 >> v2:172.21.15.26:3300/0 conn(0x7f779c133fa0 0x7f779c134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:16.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.568+0000 7f77a19c6700 1 -- 172.21.15.26:0/266422499 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779c0a1340 msgr2=0x7f779c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:16.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.568+0000 7f77a19c6700 1 --2- 172.21.15.26:0/266422499 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779c0a1340 0x7f779c133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:16.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.568+0000 7f77a19c6700 1 -- 172.21.15.26:0/266422499 >> v2:172.21.15.26:3300/0 conn(0x7f779c133fa0 msgr2=0x7f779c134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:16.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.568+0000 7f77a19c6700 1 --2- 172.21.15.26:0/266422499 >> v2:172.21.15.26:3300/0 conn(0x7f779c133fa0 0x7f779c134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:16.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.568+0000 7f77a19c6700 1 -- 172.21.15.26:0/266422499 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779c0a1fe0 con 0x7f779c0a0a30 2023-10-01T08:01:16.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.568+0000 7f77a11c5700 1 --2- 172.21.15.26:0/266422499 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779c0a1340 0x7f779c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:16.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.568+0000 7f77a21c7700 1 --2- 172.21.15.26:0/266422499 >> v2:172.21.15.26:3300/0 conn(0x7f779c133fa0 0x7f779c134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:16.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.568+0000 7f77a19c6700 1 --2- 172.21.15.26:0/266422499 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779c0a0a30 0x7f779c0a0e00 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f7798009e50 tx=0x7f779800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10c6b7b7097412c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:16.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.568+0000 7f77a09c4700 1 -- 172.21.15.26:0/266422499 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779800e070 con 0x7f779c0a0a30 2023-10-01T08:01:16.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.568+0000 7f77a09c4700 1 -- 172.21.15.26:0/266422499 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779800b910 con 0x7f779c0a0a30 2023-10-01T08:01:16.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.568+0000 7f77a09c4700 1 -- 172.21.15.26:0/266422499 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779800bcc0 con 0x7f779c0a0a30 2023-10-01T08:01:16.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.569+0000 7f77a3c2a700 1 -- 172.21.15.26:0/266422499 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779c0a0a30 msgr2=0x7f779c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:16.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.569+0000 7f77a3c2a700 1 --2- 172.21.15.26:0/266422499 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779c0a0a30 0x7f779c0a0e00 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f7798009e50 tx=0x7f779800b330 comp rx=0 tx=0).stop 2023-10-01T08:01:16.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.569+0000 7f77a3c2a700 1 -- 172.21.15.26:0/266422499 shutdown_connections 2023-10-01T08:01:16.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.569+0000 7f77a3c2a700 1 --2- 172.21.15.26:0/266422499 >> v2:172.21.15.26:3300/0 conn(0x7f779c133fa0 0x7f779c134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:16.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.569+0000 7f77a3c2a700 1 --2- 172.21.15.26:0/266422499 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779c0a0a30 0x7f779c0a0e00 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:16.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.569+0000 7f77a3c2a700 1 --2- 172.21.15.26:0/266422499 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779c0a1340 0x7f779c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:16.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.569+0000 7f77a3c2a700 1 -- 172.21.15.26:0/266422499 >> 172.21.15.26:0/266422499 conn(0x7f779c0a6550 msgr2=0x7f779c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:16.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.569+0000 7f77a3c2a700 1 -- 172.21.15.26:0/266422499 shutdown_connections 2023-10-01T08:01:16.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.569+0000 7f77a3c2a700 1 -- 172.21.15.26:0/266422499 wait complete. 2023-10-01T08:01:16.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.570+0000 7f77a3c2a700 1 Processor -- start 2023-10-01T08:01:16.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.571+0000 7f77a3c2a700 1 -- start start 2023-10-01T08:01:16.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.571+0000 7f77a3c2a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f779c0a0a30 0x7f779c120160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:16.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.571+0000 7f77a3c2a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779c0a1340 0x7f779c1206a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:16.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.571+0000 7f77a3c2a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779c133fa0 0x7f779c120be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:16.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.571+0000 7f77a3c2a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779c123650 con 0x7f779c0a0a30 2023-10-01T08:01:16.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.571+0000 7f77a3c2a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f779c0a0220 con 0x7f779c0a1340 2023-10-01T08:01:16.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.571+0000 7f77a3c2a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f779c121df0 con 0x7f779c133fa0 2023-10-01T08:01:16.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.571+0000 7f77a19c6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f779c0a0a30 0x7f779c120160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:16.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.571+0000 7f77a19c6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f779c0a0a30 0x7f779c120160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44672/0 (socket says 172.21.15.26:44672) 2023-10-01T08:01:16.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.572+0000 7f77a11c5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779c0a1340 0x7f779c1206a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:16.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.572+0000 7f77a19c6700 1 -- 172.21.15.26:0/1328060610 learned_addr learned my addr 172.21.15.26:0/1328060610 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:16.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.572+0000 7f77a21c7700 1 --2- 172.21.15.26:0/1328060610 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779c133fa0 0x7f779c120be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:16.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.572+0000 7f77a11c5700 1 -- 172.21.15.26:0/1328060610 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779c133fa0 msgr2=0x7f779c120be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:16.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.572+0000 7f77a11c5700 1 --2- 172.21.15.26:0/1328060610 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779c133fa0 0x7f779c120be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:16.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.572+0000 7f77a11c5700 1 -- 172.21.15.26:0/1328060610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f779c0a0a30 msgr2=0x7f779c120160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:16.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.572+0000 7f77a11c5700 1 --2- 172.21.15.26:0/1328060610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f779c0a0a30 0x7f779c120160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:16.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.572+0000 7f77a11c5700 1 -- 172.21.15.26:0/1328060610 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f778c0094a0 con 0x7f779c0a1340 2023-10-01T08:01:16.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.572+0000 7f77a19c6700 1 --2- 172.21.15.26:0/1328060610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f779c0a0a30 0x7f779c120160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:16.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.572+0000 7f77a21c7700 1 --2- 172.21.15.26:0/1328060610 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779c133fa0 0x7f779c120be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:16.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.572+0000 7f77a11c5700 1 --2- 172.21.15.26:0/1328060610 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779c0a1340 0x7f779c1206a0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f778c00e9b0 tx=0x7f778c00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:16.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.572+0000 7f77927fc700 1 -- 172.21.15.26:0/1328060610 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778c00ee40 con 0x7f779c0a1340 2023-10-01T08:01:16.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.572+0000 7f77927fc700 1 -- 172.21.15.26:0/1328060610 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778c00c850 con 0x7f779c0a1340 2023-10-01T08:01:16.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.572+0000 7f77a3c2a700 1 -- 172.21.15.26:0/1328060610 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77940094a0 con 0x7f779c0a1340 2023-10-01T08:01:16.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.572+0000 7f77927fc700 1 -- 172.21.15.26:0/1328060610 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778c00cc00 con 0x7f779c0a1340 2023-10-01T08:01:16.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.572+0000 7f77a3c2a700 1 -- 172.21.15.26:0/1328060610 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7798009b30 con 0x7f779c0a1340 2023-10-01T08:01:16.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.573+0000 7f77927fc700 1 -- 172.21.15.26:0/1328060610 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f778c013470 con 0x7f779c0a1340 2023-10-01T08:01:16.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.574+0000 7f77a3c2a700 1 -- 172.21.15.26:0/1328060610 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f779c074ea0 con 0x7f779c0a1340 2023-10-01T08:01:16.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.574+0000 7f77927fc700 1 -- 172.21.15.26:0/1328060610 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f778c03fa30 con 0x7f779c0a1340 2023-10-01T08:01:16.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.583+0000 7f77927fc700 1 -- 172.21.15.26:0/1328060610 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f778c021020 con 0x7f779c0a1340 2023-10-01T08:01:16.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.613+0000 7fede49de700 1 Processor -- start 2023-10-01T08:01:16.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.613+0000 7fede49de700 1 -- start start 2023-10-01T08:01:16.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.614+0000 7fede49de700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fede00a0a30 0x7fede00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:16.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.614+0000 7fede49de700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fede0138d80 0x7fede013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:16.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.614+0000 7fede49de700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fede00a2a70 con 0x7fede009d630 2023-10-01T08:01:16.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.614+0000 7fede49de700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fede00a01d0 con 0x7fede00a0a30 2023-10-01T08:01:16.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.614+0000 7fede49de700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede009e2b0 con 0x7fede0138d80 2023-10-01T08:01:16.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.614+0000 7fedde59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fede00a0a30 0x7fede00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:16.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.614+0000 7fedddd9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fede009d630 0x7fede00a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39158/0 (socket says 172.21.15.26:39158) 2023-10-01T08:01:16.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.614+0000 7fedddd9b700 1 -- 172.21.15.26:0/2277000311 learned_addr learned my addr 172.21.15.26:0/2277000311 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:01:16.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.614+0000 7fedded9d700 1 --2- 172.21.15.26:0/2277000311 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fede0138d80 0x7fede013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:16.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.615+0000 7fedde59c700 1 -- 172.21.15.26:0/2277000311 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fede0138d80 msgr2=0x7fede013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:16.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.615+0000 7fedde59c700 1 --2- 172.21.15.26:0/2277000311 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fede0138d80 0x7fede013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:16.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.615+0000 7fedde59c700 1 -- 172.21.15.26:0/2277000311 >> v1:172.21.15.26:6789/0 conn(0x7fede009d630 legacy=0x7fede00a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:16.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.615+0000 7fedde59c700 1 -- 172.21.15.26:0/2277000311 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede009dc50 con 0x7fede00a0a30 2023-10-01T08:01:16.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.615+0000 7fedde59c700 1 --2- 172.21.15.26:0/2277000311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fede00a0a30 0x7fede00a0e00 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fedd0009840 tx=0x7fedd0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77519e6941ab96e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:16.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.615+0000 7feddd59a700 1 -- 172.21.15.26:0/2277000311 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd0011830 con 0x7fede00a0a30 2023-10-01T08:01:16.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.615+0000 7feddd59a700 1 -- 172.21.15.26:0/2277000311 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd0011990 con 0x7fede00a0a30 2023-10-01T08:01:16.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.615+0000 7feddd59a700 1 -- 172.21.15.26:0/2277000311 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd0011d20 con 0x7fede00a0a30 2023-10-01T08:01:16.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.616+0000 7fede49de700 1 -- 172.21.15.26:0/2277000311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fede00a0a30 msgr2=0x7fede00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:16.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.616+0000 7fede49de700 1 --2- 172.21.15.26:0/2277000311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fede00a0a30 0x7fede00a0e00 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fedd0009840 tx=0x7fedd0009b50 comp rx=0 tx=0).stop 2023-10-01T08:01:16.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.616+0000 7fede49de700 1 -- 172.21.15.26:0/2277000311 shutdown_connections 2023-10-01T08:01:16.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.616+0000 7fede49de700 1 --2- 172.21.15.26:0/2277000311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fede00a0a30 0x7fede00a0e00 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:16.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.616+0000 7fede49de700 1 --2- 172.21.15.26:0/2277000311 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fede0138d80 0x7fede013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:16.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.616+0000 7fede49de700 1 -- 172.21.15.26:0/2277000311 >> 172.21.15.26:0/2277000311 conn(0x7fede00a3050 msgr2=0x7fede00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:16.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.616+0000 7fede49de700 1 -- 172.21.15.26:0/2277000311 shutdown_connections 2023-10-01T08:01:16.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.616+0000 7fede49de700 1 -- 172.21.15.26:0/2277000311 wait complete. 2023-10-01T08:01:16.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.618+0000 7fede49de700 1 Processor -- start 2023-10-01T08:01:16.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.618+0000 7fede49de700 1 -- start start 2023-10-01T08:01:16.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.619+0000 7fede49de700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fede009d630 0x7fede0120700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:16.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.619+0000 7fede49de700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fede00a0a30 0x7fede0120c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:16.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.619+0000 7fede49de700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fede0138d80 0x7fede0121180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:16.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.619+0000 7fede49de700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede0123110 con 0x7fede0138d80 2023-10-01T08:01:16.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.619+0000 7fede49de700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede0122be0 con 0x7fede009d630 2023-10-01T08:01:16.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.619+0000 7fede49de700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fede0122310 con 0x7fede00a0a30 2023-10-01T08:01:16.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.619+0000 7fedded9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fede0138d80 0x7fede0121180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:16.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.619+0000 7fedded9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fede0138d80 0x7fede0121180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44686/0 (socket says 172.21.15.26:44686) 2023-10-01T08:01:16.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.619+0000 7fedded9d700 1 -- 172.21.15.26:0/686523286 learned_addr learned my addr 172.21.15.26:0/686523286 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:16.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.619+0000 7fedde59c700 1 --2- 172.21.15.26:0/686523286 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fede009d630 0x7fede0120700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:16.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.619+0000 7fedddd9b700 1 --2- 172.21.15.26:0/686523286 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fede00a0a30 0x7fede0120c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:16.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.619+0000 7fedded9d700 1 -- 172.21.15.26:0/686523286 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fede00a0a30 msgr2=0x7fede0120c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:16.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.619+0000 7fedded9d700 1 --2- 172.21.15.26:0/686523286 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fede00a0a30 0x7fede0120c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:16.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.619+0000 7fedded9d700 1 -- 172.21.15.26:0/686523286 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fede009d630 msgr2=0x7fede0120700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:16.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.619+0000 7fedded9d700 1 --2- 172.21.15.26:0/686523286 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fede009d630 0x7fede0120700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:16.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.619+0000 7fedded9d700 1 -- 172.21.15.26:0/686523286 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd00094a0 con 0x7fede0138d80 2023-10-01T08:01:16.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.620+0000 7fedded9d700 1 --2- 172.21.15.26:0/686523286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fede0138d80 0x7fede0121180 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fedd8009e30 tx=0x7fedd800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:16.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.620+0000 7fedceffd700 1 -- 172.21.15.26:0/686523286 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd8009ca0 con 0x7fede0138d80 2023-10-01T08:01:16.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.620+0000 7fedceffd700 1 -- 172.21.15.26:0/686523286 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd800f040 con 0x7fede0138d80 2023-10-01T08:01:16.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.620+0000 7fede49de700 1 -- 172.21.15.26:0/686523286 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede0121b60 con 0x7fede0138d80 2023-10-01T08:01:16.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.620+0000 7fedceffd700 1 -- 172.21.15.26:0/686523286 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd8014480 con 0x7fede0138d80 2023-10-01T08:01:16.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.620+0000 7fede49de700 1 -- 172.21.15.26:0/686523286 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede00a0410 con 0x7fede0138d80 2023-10-01T08:01:16.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.621+0000 7fedceffd700 1 -- 172.21.15.26:0/686523286 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fedd80145e0 con 0x7fede0138d80 2023-10-01T08:01:16.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.621+0000 7fedceffd700 1 -- 172.21.15.26:0/686523286 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fedd80402f0 con 0x7fede0138d80 2023-10-01T08:01:16.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.621+0000 7fede49de700 1 -- 172.21.15.26:0/686523286 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede00747f0 con 0x7fede0138d80 2023-10-01T08:01:16.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.626+0000 7fedceffd700 1 -- 172.21.15.26:0/686523286 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fedd8018020 con 0x7fede0138d80 2023-10-01T08:01:16.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.671+0000 7fd20842c700 1 -- 172.21.15.26:0/1265050743 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd200074ea0 con 0x7fd20009e410 2023-10-01T08:01:16.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.672+0000 7fd1f6ffd700 1 -- 172.21.15.26:0/1265050743 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd1f801cbb0 con 0x7fd20009e410 2023-10-01T08:01:16.674 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:16.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.674+0000 7fd20842c700 1 -- 172.21.15.26:0/1265050743 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd20009e410 msgr2=0x7fd2001a6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:16.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.674+0000 7fd20842c700 1 --2- 172.21.15.26:0/1265050743 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd20009e410 0x7fd2001a6af0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8009f10 tx=0x7fd1f800c3a0 comp rx=0 tx=0).stop 2023-10-01T08:01:16.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.674+0000 7fd20842c700 1 -- 172.21.15.26:0/1265050743 shutdown_connections 2023-10-01T08:01:16.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.674+0000 7fd20842c700 1 --2- 172.21.15.26:0/1265050743 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd20009e410 0x7fd2001a6af0 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:16.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.674+0000 7fd20842c700 1 --2- 172.21.15.26:0/1265050743 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd20009d6f0 0x7fd2001a6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:16.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.674+0000 7fd20842c700 1 --2- 172.21.15.26:0/1265050743 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd20009e000 0x7fd2001a65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:16.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.674+0000 7fd20842c700 1 -- 172.21.15.26:0/1265050743 >> 172.21.15.26:0/1265050743 conn(0x7fd200066f50 msgr2=0x7fd2001baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:16.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.674+0000 7fd20842c700 1 -- 172.21.15.26:0/1265050743 shutdown_connections 2023-10-01T08:01:16.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.674+0000 7fd20842c700 1 -- 172.21.15.26:0/1265050743 wait complete. 2023-10-01T08:01:16.690 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:16.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.795+0000 7f77a3c2a700 1 -- 172.21.15.26:0/1328060610 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f779c1237c0 con 0x7f779c0a1340 2023-10-01T08:01:16.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.796+0000 7f77927fc700 1 -- 172.21.15.26:0/1328060610 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f778c017070 con 0x7f779c0a1340 2023-10-01T08:01:16.798 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:16.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.798+0000 7f77a3c2a700 1 -- 172.21.15.26:0/1328060610 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779c0a1340 msgr2=0x7f779c1206a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:16.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.798+0000 7f77a3c2a700 1 --2- 172.21.15.26:0/1328060610 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779c0a1340 0x7f779c1206a0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f778c00e9b0 tx=0x7f778c00ecc0 comp rx=0 tx=0).stop 2023-10-01T08:01:16.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.798+0000 7f77a3c2a700 1 -- 172.21.15.26:0/1328060610 shutdown_connections 2023-10-01T08:01:16.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.798+0000 7f77a3c2a700 1 --2- 172.21.15.26:0/1328060610 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f779c133fa0 0x7f779c120be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:16.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.798+0000 7f77a3c2a700 1 --2- 172.21.15.26:0/1328060610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f779c0a0a30 0x7f779c120160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:16.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.798+0000 7f77a3c2a700 1 --2- 172.21.15.26:0/1328060610 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779c0a1340 0x7f779c1206a0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:16.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.798+0000 7f77a3c2a700 1 -- 172.21.15.26:0/1328060610 >> 172.21.15.26:0/1328060610 conn(0x7f779c0a6550 msgr2=0x7f779c1bafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:16.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.798+0000 7f77a3c2a700 1 -- 172.21.15.26:0/1328060610 shutdown_connections 2023-10-01T08:01:16.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.798+0000 7f77a3c2a700 1 -- 172.21.15.26:0/1328060610 wait complete. 2023-10-01T08:01:16.814 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:16.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.838+0000 7fede49de700 1 -- 172.21.15.26:0/686523286 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fede0123fa0 con 0x7fede0138d80 2023-10-01T08:01:16.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.838+0000 7fedceffd700 1 -- 172.21.15.26:0/686523286 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fedd802b090 con 0x7fede0138d80 2023-10-01T08:01:16.840 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:16.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.840+0000 7fede49de700 1 -- 172.21.15.26:0/686523286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fede0138d80 msgr2=0x7fede0121180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:16.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.840+0000 7fede49de700 1 --2- 172.21.15.26:0/686523286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fede0138d80 0x7fede0121180 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fedd8009e30 tx=0x7fedd800c3a0 comp rx=0 tx=0).stop 2023-10-01T08:01:16.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.840+0000 7fede49de700 1 -- 172.21.15.26:0/686523286 shutdown_connections 2023-10-01T08:01:16.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.840+0000 7fede49de700 1 --2- 172.21.15.26:0/686523286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fede0138d80 0x7fede0121180 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:16.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.840+0000 7fede49de700 1 --2- 172.21.15.26:0/686523286 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fede009d630 0x7fede0120700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:16.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.840+0000 7fede49de700 1 --2- 172.21.15.26:0/686523286 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fede00a0a30 0x7fede0120c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:16.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.840+0000 7fede49de700 1 -- 172.21.15.26:0/686523286 >> 172.21.15.26:0/686523286 conn(0x7fede00a3050 msgr2=0x7fede009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:16.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.840+0000 7fede49de700 1 -- 172.21.15.26:0/686523286 shutdown_connections 2023-10-01T08:01:16.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:16.841+0000 7fede49de700 1 -- 172.21.15.26:0/686523286 wait complete. 2023-10-01T08:01:16.856 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:17.179 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:17.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.325+0000 7ff7ddbc6700 1 Processor -- start 2023-10-01T08:01:17.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.325+0000 7ff7ddbc6700 1 -- start start 2023-10-01T08:01:17.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.326+0000 7ff7ddbc6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7d806a770 0x7ff7d806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:17.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.326+0000 7ff7ddbc6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff7d8131d10 0x7ff7d8139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:17.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.326+0000 7ff7ddbc6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7d809ece0 con 0x7ff7d806b080 2023-10-01T08:01:17.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.326+0000 7ff7ddbc6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d809e760 con 0x7ff7d806a770 2023-10-01T08:01:17.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.326+0000 7ff7ddbc6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d809e040 con 0x7ff7d8131d10 2023-10-01T08:01:17.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.326+0000 7ff7d77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7d806a770 0x7ff7d806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:17.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.326+0000 7ff7d7fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff7d8131d10 0x7ff7d8139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:17.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.326+0000 7ff7d6ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff7d806b080 0x7ff7d8131600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39172/0 (socket says 172.21.15.26:39172) 2023-10-01T08:01:17.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.326+0000 7ff7d7fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff7d8131d10 0x7ff7d8139860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37440/0 (socket says 172.21.15.26:37440) 2023-10-01T08:01:17.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.326+0000 7ff7d6ffd700 1 -- 172.21.15.26:0/4247690155 learned_addr learned my addr 172.21.15.26:0/4247690155 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:01:17.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.326+0000 7ff7d77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7d806a770 0x7ff7d806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37900/0 (socket says 172.21.15.26:37900) 2023-10-01T08:01:17.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.326+0000 7ff7d7fff700 1 -- 172.21.15.26:0/4247690155 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7d806a770 msgr2=0x7ff7d806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:17.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.326+0000 7ff7d7fff700 1 --2- 172.21.15.26:0/4247690155 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7d806a770 0x7ff7d806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:17.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.326+0000 7ff7d7fff700 1 -- 172.21.15.26:0/4247690155 >> v1:172.21.15.26:6789/0 conn(0x7ff7d806b080 legacy=0x7ff7d8131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:17.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.326+0000 7ff7d67fc700 1 -- 172.21.15.26:0/4247690155 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2244997372 0 0) 0x7ff7d809ece0 con 0x7ff7d806b080 2023-10-01T08:01:17.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.327+0000 7ff7d7fff700 1 -- 172.21.15.26:0/4247690155 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d809f630 con 0x7ff7d8131d10 2023-10-01T08:01:17.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.327+0000 7ff7d77fe700 1 --2- 172.21.15.26:0/4247690155 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7d806a770 0x7ff7d806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:17.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.327+0000 7ff7d7fff700 1 --2- 172.21.15.26:0/4247690155 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff7d8131d10 0x7ff7d8139860 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0009dc0 tx=0x7ff7d000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e03a59e8ad0aa97 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:17.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.327+0000 7ff7d67fc700 1 -- 172.21.15.26:0/4247690155 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d000e070 con 0x7ff7d8131d10 2023-10-01T08:01:17.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.327+0000 7ff7d67fc700 1 -- 172.21.15.26:0/4247690155 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7d000bb20 con 0x7ff7d8131d10 2023-10-01T08:01:17.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.327+0000 7ff7d67fc700 1 -- 172.21.15.26:0/4247690155 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d0012430 con 0x7ff7d8131d10 2023-10-01T08:01:17.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.327+0000 7ff7ddbc6700 1 -- 172.21.15.26:0/4247690155 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff7d8131d10 msgr2=0x7ff7d8139860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:17.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.327+0000 7ff7ddbc6700 1 --2- 172.21.15.26:0/4247690155 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff7d8131d10 0x7ff7d8139860 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0009dc0 tx=0x7ff7d000b330 comp rx=0 tx=0).stop 2023-10-01T08:01:17.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.327+0000 7ff7ddbc6700 1 -- 172.21.15.26:0/4247690155 shutdown_connections 2023-10-01T08:01:17.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.328+0000 7ff7ddbc6700 1 --2- 172.21.15.26:0/4247690155 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff7d8131d10 0x7ff7d8139860 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:17.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.328+0000 7ff7ddbc6700 1 --2- 172.21.15.26:0/4247690155 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7d806a770 0x7ff7d806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:17.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.328+0000 7ff7ddbc6700 1 -- 172.21.15.26:0/4247690155 >> 172.21.15.26:0/4247690155 conn(0x7ff7d8066f50 msgr2=0x7ff7d809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:17.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.328+0000 7ff7ddbc6700 1 -- 172.21.15.26:0/4247690155 shutdown_connections 2023-10-01T08:01:17.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.328+0000 7ff7ddbc6700 1 -- 172.21.15.26:0/4247690155 wait complete. 2023-10-01T08:01:17.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.329+0000 7ff7ddbc6700 1 Processor -- start 2023-10-01T08:01:17.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.329+0000 7ff7ddbc6700 1 -- start start 2023-10-01T08:01:17.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.330+0000 7ff7ddbc6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7d806a770 0x7ff7d8120430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:17.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.330+0000 7ff7ddbc6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff7d806b080 0x7ff7d8120970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:17.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.330+0000 7ff7ddbc6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7d8131d10 0x7ff7d8120eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:17.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.330+0000 7ff7ddbc6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d8121900 con 0x7ff7d8131d10 2023-10-01T08:01:17.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.330+0000 7ff7ddbc6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d81313f0 con 0x7ff7d806a770 2023-10-01T08:01:17.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.330+0000 7ff7ddbc6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d8131620 con 0x7ff7d806b080 2023-10-01T08:01:17.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.330+0000 7ff7d77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7d806a770 0x7ff7d8120430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:17.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.330+0000 7ff7d77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7d806a770 0x7ff7d8120430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37908/0 (socket says 172.21.15.26:37908) 2023-10-01T08:01:17.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.330+0000 7ff7d77fe700 1 -- 172.21.15.26:0/281372630 learned_addr learned my addr 172.21.15.26:0/281372630 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:17.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.330+0000 7ff7d7fff700 1 --2- 172.21.15.26:0/281372630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7d8131d10 0x7ff7d8120eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:17.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.330+0000 7ff7d6ffd700 1 --2- 172.21.15.26:0/281372630 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff7d806b080 0x7ff7d8120970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:17.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.330+0000 7ff7d77fe700 1 -- 172.21.15.26:0/281372630 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff7d806b080 msgr2=0x7ff7d8120970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:17.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.330+0000 7ff7d77fe700 1 --2- 172.21.15.26:0/281372630 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff7d806b080 0x7ff7d8120970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:17.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.330+0000 7ff7d77fe700 1 -- 172.21.15.26:0/281372630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7d8131d10 msgr2=0x7ff7d8120eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:17.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.330+0000 7ff7d77fe700 1 --2- 172.21.15.26:0/281372630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7d8131d10 0x7ff7d8120eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:17.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.330+0000 7ff7d77fe700 1 -- 172.21.15.26:0/281372630 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c80094a0 con 0x7ff7d806a770 2023-10-01T08:01:17.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.330+0000 7ff7d7fff700 1 --2- 172.21.15.26:0/281372630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7d8131d10 0x7ff7d8120eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:17.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.331+0000 7ff7d77fe700 1 --2- 172.21.15.26:0/281372630 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7d806a770 0x7ff7d8120430 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7ff7c800ebe0 tx=0x7ff7c800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:17.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.331+0000 7ff7cffff700 1 -- 172.21.15.26:0/281372630 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c800c850 con 0x7ff7d806a770 2023-10-01T08:01:17.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.331+0000 7ff7cffff700 1 -- 172.21.15.26:0/281372630 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c800c9b0 con 0x7ff7d806a770 2023-10-01T08:01:17.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.331+0000 7ff7ddbc6700 1 -- 172.21.15.26:0/281372630 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7d0009a70 con 0x7ff7d806a770 2023-10-01T08:01:17.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.331+0000 7ff7cffff700 1 -- 172.21.15.26:0/281372630 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c800cd40 con 0x7ff7d806a770 2023-10-01T08:01:17.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.331+0000 7ff7ddbc6700 1 -- 172.21.15.26:0/281372630 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7d8123c70 con 0x7ff7d806a770 2023-10-01T08:01:17.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.332+0000 7ff7cffff700 1 -- 172.21.15.26:0/281372630 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff7c8013470 con 0x7ff7d806a770 2023-10-01T08:01:17.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.332+0000 7ff7cffff700 1 -- 172.21.15.26:0/281372630 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff7c803f850 con 0x7ff7d806a770 2023-10-01T08:01:17.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.332+0000 7ff7ddbc6700 1 -- 172.21.15.26:0/281372630 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7d81247a0 con 0x7ff7d806a770 2023-10-01T08:01:17.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.337+0000 7ff7cffff700 1 -- 172.21.15.26:0/281372630 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff7c8017020 con 0x7ff7d806a770 2023-10-01T08:01:17.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.542+0000 7ff7ddbc6700 1 -- 172.21.15.26:0/281372630 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff7d8074ea0 con 0x7ff7d806a770 2023-10-01T08:01:17.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.542+0000 7ff7cffff700 1 -- 172.21.15.26:0/281372630 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff7c8013720 con 0x7ff7d806a770 2023-10-01T08:01:17.544 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:17.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.546+0000 7ff7ddbc6700 1 -- 172.21.15.26:0/281372630 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7d806a770 msgr2=0x7ff7d8120430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:17.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.546+0000 7ff7ddbc6700 1 --2- 172.21.15.26:0/281372630 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7d806a770 0x7ff7d8120430 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7ff7c800ebe0 tx=0x7ff7c800eef0 comp rx=0 tx=0).stop 2023-10-01T08:01:17.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.546+0000 7ff7ddbc6700 1 -- 172.21.15.26:0/281372630 shutdown_connections 2023-10-01T08:01:17.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.546+0000 7ff7ddbc6700 1 --2- 172.21.15.26:0/281372630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7d8131d10 0x7ff7d8120eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:17.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.546+0000 7ff7ddbc6700 1 --2- 172.21.15.26:0/281372630 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7d806a770 0x7ff7d8120430 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:17.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.546+0000 7ff7ddbc6700 1 --2- 172.21.15.26:0/281372630 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff7d806b080 0x7ff7d8120970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:17.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.546+0000 7ff7ddbc6700 1 -- 172.21.15.26:0/281372630 >> 172.21.15.26:0/281372630 conn(0x7ff7d8066f50 msgr2=0x7ff7d806ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:17.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.546+0000 7ff7ddbc6700 1 -- 172.21.15.26:0/281372630 shutdown_connections 2023-10-01T08:01:17.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.546+0000 7ff7ddbc6700 1 -- 172.21.15.26:0/281372630 wait complete. 2023-10-01T08:01:17.560 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:17.691 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:17.815 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:17.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.834+0000 7f3ed2fb7700 1 Processor -- start 2023-10-01T08:01:17.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.834+0000 7f3ed2fb7700 1 -- start start 2023-10-01T08:01:17.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.834+0000 7f3ed2fb7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ecc1338a0 0x7f3ecc133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:17.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.834+0000 7f3ed2fb7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ecc09e930 0x7f3ecc13b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:17.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.834+0000 7f3ed2fb7700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ecc06ef30 con 0x7f3ecc09de50 2023-10-01T08:01:17.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.834+0000 7f3ed2fb7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc06fef0 con 0x7f3ecc1338a0 2023-10-01T08:01:17.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.834+0000 7f3ed2fb7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc1334b0 con 0x7f3ecc09e930 2023-10-01T08:01:17.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.834+0000 7f3ed1554700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ecc09e930 0x7f3ecc13b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:17.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.834+0000 7f3ed0d53700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ecc1338a0 0x7f3ecc133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:17.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.834+0000 7f3ed0d53700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ecc1338a0 0x7f3ecc133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37924/0 (socket says 172.21.15.26:37924) 2023-10-01T08:01:17.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.834+0000 7f3ed1554700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ecc09e930 0x7f3ecc13b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37464/0 (socket says 172.21.15.26:37464) 2023-10-01T08:01:17.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.834+0000 7f3ecbfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3ecc09de50 0x7f3ecc09e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39180/0 (socket says 172.21.15.26:39180) 2023-10-01T08:01:17.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.834+0000 7f3ed0d53700 1 -- 172.21.15.26:0/2179473831 learned_addr learned my addr 172.21.15.26:0/2179473831 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:17.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.835+0000 7f3ed0d53700 1 -- 172.21.15.26:0/2179473831 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ecc09e930 msgr2=0x7f3ecc13b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:17.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.835+0000 7f3ed0d53700 1 --2- 172.21.15.26:0/2179473831 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ecc09e930 0x7f3ecc13b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:17.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.835+0000 7f3ecb7fe700 1 -- 172.21.15.26:0/2179473831 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2745962248 0 0) 0x7f3ecc06ef30 con 0x7f3ecc09de50 2023-10-01T08:01:17.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.835+0000 7f3ed0d53700 1 -- 172.21.15.26:0/2179473831 >> v1:172.21.15.26:6789/0 conn(0x7f3ecc09de50 legacy=0x7f3ecc09e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:17.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.835+0000 7f3ed0d53700 1 -- 172.21.15.26:0/2179473831 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ecc06fc30 con 0x7f3ecc1338a0 2023-10-01T08:01:17.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.835+0000 7f3ed1554700 1 --2- 172.21.15.26:0/2179473831 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ecc09e930 0x7f3ecc13b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:17.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.835+0000 7f3ed0d53700 1 --2- 172.21.15.26:0/2179473831 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ecc1338a0 0x7f3ecc133c70 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc009920 tx=0x7f3ebc009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4396c25caf0ad02a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:17.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.835+0000 7f3ecb7fe700 1 -- 172.21.15.26:0/2179473831 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc011830 con 0x7f3ecc1338a0 2023-10-01T08:01:17.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.835+0000 7f3ecb7fe700 1 -- 172.21.15.26:0/2179473831 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ebc011990 con 0x7f3ecc1338a0 2023-10-01T08:01:17.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.835+0000 7f3ecb7fe700 1 -- 172.21.15.26:0/2179473831 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc011d20 con 0x7f3ecc1338a0 2023-10-01T08:01:17.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.836+0000 7f3ed2fb7700 1 -- 172.21.15.26:0/2179473831 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ecc1338a0 msgr2=0x7f3ecc133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:17.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.836+0000 7f3ed2fb7700 1 --2- 172.21.15.26:0/2179473831 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ecc1338a0 0x7f3ecc133c70 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc009920 tx=0x7f3ebc009c30 comp rx=0 tx=0).stop 2023-10-01T08:01:17.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.836+0000 7f3ed2fb7700 1 -- 172.21.15.26:0/2179473831 shutdown_connections 2023-10-01T08:01:17.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.836+0000 7f3ed2fb7700 1 --2- 172.21.15.26:0/2179473831 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ecc09e930 0x7f3ecc13b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:17.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.836+0000 7f3ed2fb7700 1 --2- 172.21.15.26:0/2179473831 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ecc1338a0 0x7f3ecc133c70 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:17.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.836+0000 7f3ed2fb7700 1 -- 172.21.15.26:0/2179473831 >> 172.21.15.26:0/2179473831 conn(0x7f3ecc0a2aa0 msgr2=0x7f3ecc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:17.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.836+0000 7f3ed2fb7700 1 -- 172.21.15.26:0/2179473831 shutdown_connections 2023-10-01T08:01:17.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.836+0000 7f3ed2fb7700 1 -- 172.21.15.26:0/2179473831 wait complete. 2023-10-01T08:01:17.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.837+0000 7f3ed2fb7700 1 Processor -- start 2023-10-01T08:01:17.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.837+0000 7f3ed2fb7700 1 -- start start 2023-10-01T08:01:17.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.838+0000 7f3ed2fb7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ecc09de50 0x7f3ecc11d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:17.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.838+0000 7f3ed2fb7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ecc09e930 0x7f3ecc11dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:17.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.838+0000 7f3ed2fb7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ecc1338a0 0x7f3ecc11e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:17.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.838+0000 7f3ed2fb7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc130d30 con 0x7f3ecc09e930 2023-10-01T08:01:17.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.838+0000 7f3ed2fb7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc1211b0 con 0x7f3ecc1338a0 2023-10-01T08:01:17.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.838+0000 7f3ed2fb7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc11f230 con 0x7f3ecc09de50 2023-10-01T08:01:17.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.838+0000 7f3ed1554700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ecc1338a0 0x7f3ecc11e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:17.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.838+0000 7f3ed0d53700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ecc09de50 0x7f3ecc11d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:17.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.838+0000 7f3ecbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ecc09e930 0x7f3ecc11dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:17.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.838+0000 7f3ed0d53700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ecc09de50 0x7f3ecc11d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37478/0 (socket says 172.21.15.26:37478) 2023-10-01T08:01:17.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.838+0000 7f3ed1554700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ecc1338a0 0x7f3ecc11e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37940/0 (socket says 172.21.15.26:37940) 2023-10-01T08:01:17.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.838+0000 7f3ed0d53700 1 -- 172.21.15.26:0/763828305 learned_addr learned my addr 172.21.15.26:0/763828305 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:17.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.838+0000 7f3ed0d53700 1 -- 172.21.15.26:0/763828305 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ecc1338a0 msgr2=0x7f3ecc11e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:17.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.838+0000 7f3ed0d53700 1 --2- 172.21.15.26:0/763828305 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ecc1338a0 0x7f3ecc11e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:17.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.838+0000 7f3ed0d53700 1 -- 172.21.15.26:0/763828305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ecc09e930 msgr2=0x7f3ecc11dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:17.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.838+0000 7f3ed0d53700 1 --2- 172.21.15.26:0/763828305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ecc09e930 0x7f3ecc11dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:17.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.838+0000 7f3ed0d53700 1 -- 172.21.15.26:0/763828305 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec4009a70 con 0x7f3ecc09de50 2023-10-01T08:01:17.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.838+0000 7f3ed1554700 1 --2- 172.21.15.26:0/763828305 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ecc1338a0 0x7f3ecc11e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:17.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.838+0000 7f3ecbfff700 1 --2- 172.21.15.26:0/763828305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ecc09e930 0x7f3ecc11dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:17.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.838+0000 7f3ed0d53700 1 --2- 172.21.15.26:0/763828305 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ecc09de50 0x7f3ecc11d710 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc00a010 tx=0x7f3ebc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:17.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.839+0000 7f3ec97fa700 1 -- 172.21.15.26:0/763828305 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc004450 con 0x7f3ecc09de50 2023-10-01T08:01:17.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.839+0000 7f3ec97fa700 1 -- 172.21.15.26:0/763828305 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ebc0045b0 con 0x7f3ecc09de50 2023-10-01T08:01:17.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.839+0000 7f3ec97fa700 1 -- 172.21.15.26:0/763828305 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc0038e0 con 0x7f3ecc09de50 2023-10-01T08:01:17.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.839+0000 7f3ed2fb7700 1 -- 172.21.15.26:0/763828305 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ebc009550 con 0x7f3ecc09de50 2023-10-01T08:01:17.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.839+0000 7f3ed2fb7700 1 -- 172.21.15.26:0/763828305 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ecc120c10 con 0x7f3ecc09de50 2023-10-01T08:01:17.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.840+0000 7f3ec97fa700 1 -- 172.21.15.26:0/763828305 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3ebc003a40 con 0x7f3ecc09de50 2023-10-01T08:01:17.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.840+0000 7f3ec97fa700 1 -- 172.21.15.26:0/763828305 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3ebc040830 con 0x7f3ecc09de50 2023-10-01T08:01:17.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.840+0000 7f3ed2fb7700 1 -- 172.21.15.26:0/763828305 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ecc120510 con 0x7f3ecc09de50 2023-10-01T08:01:17.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.845+0000 7f3ec97fa700 1 -- 172.21.15.26:0/763828305 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ebc015080 con 0x7f3ecc09de50 2023-10-01T08:01:17.857 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:17.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.957+0000 7f6b0e786700 1 Processor -- start 2023-10-01T08:01:17.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.957+0000 7f6b0e786700 1 -- start start 2023-10-01T08:01:17.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.958+0000 7f6b0e786700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b080954c0 0x7f6b08095890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:17.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.958+0000 7f6b0e786700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6b08099680 0x7f6b08099ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:17.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.958+0000 7f6b0e786700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b0809c280 con 0x7f6b08099ff0 2023-10-01T08:01:17.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.958+0000 7f6b0e786700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b0809aaf0 con 0x7f6b08099680 2023-10-01T08:01:17.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.958+0000 7f6b0e786700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0809b960 con 0x7f6b080954c0 2023-10-01T08:01:17.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.958+0000 7f6b077fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6b08099680 0x7f6b08099ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:17.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.958+0000 7f6b07fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b080954c0 0x7f6b08095890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:17.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.958+0000 7f6b077fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6b08099680 0x7f6b08099ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44714/0 (socket says 172.21.15.26:44714) 2023-10-01T08:01:17.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.958+0000 7f6b077fe700 1 -- 172.21.15.26:0/1566919584 learned_addr learned my addr 172.21.15.26:0/1566919584 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:17.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.958+0000 7f6b0cd23700 1 --1- 172.21.15.26:0/1566919584 >> v1:172.21.15.26:6789/0 conn(0x7f6b08099ff0 0x7f6b08137590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39188/0 (socket says 172.21.15.26:39188) 2023-10-01T08:01:17.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.958+0000 7f6b077fe700 1 -- 172.21.15.26:0/1566919584 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b080954c0 msgr2=0x7f6b08095890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:17.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.958+0000 7f6b077fe700 1 --2- 172.21.15.26:0/1566919584 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b080954c0 0x7f6b08095890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:17.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.958+0000 7f6b077fe700 1 -- 172.21.15.26:0/1566919584 >> v1:172.21.15.26:6789/0 conn(0x7f6b08099ff0 legacy=0x7f6b08137590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:17.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.959+0000 7f6b077fe700 1 -- 172.21.15.26:0/1566919584 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b0809a7b0 con 0x7f6b08099680 2023-10-01T08:01:17.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.959+0000 7f6b07fff700 1 --2- 172.21.15.26:0/1566919584 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b080954c0 0x7f6b08095890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:17.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.959+0000 7f6b077fe700 1 --2- 172.21.15.26:0/1566919584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b08099680 0x7f6b08099ab0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f6afc00dd20 tx=0x7f6afc00f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8c02f487fc33347 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:17.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.959+0000 7f6b06ffd700 1 -- 172.21.15.26:0/1566919584 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc012070 con 0x7f6b08099680 2023-10-01T08:01:17.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.959+0000 7f6b06ffd700 1 -- 172.21.15.26:0/1566919584 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6afc00de70 con 0x7f6b08099680 2023-10-01T08:01:17.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.959+0000 7f6b06ffd700 1 -- 172.21.15.26:0/1566919584 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc00fd20 con 0x7f6b08099680 2023-10-01T08:01:17.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.960+0000 7f6b0e786700 1 -- 172.21.15.26:0/1566919584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b08099680 msgr2=0x7f6b08099ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:17.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.960+0000 7f6b0e786700 1 --2- 172.21.15.26:0/1566919584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b08099680 0x7f6b08099ab0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f6afc00dd20 tx=0x7f6afc00f330 comp rx=0 tx=0).stop 2023-10-01T08:01:17.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.960+0000 7f6b0e786700 1 -- 172.21.15.26:0/1566919584 shutdown_connections 2023-10-01T08:01:17.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.960+0000 7f6b0e786700 1 --2- 172.21.15.26:0/1566919584 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b080954c0 0x7f6b08095890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:17.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.960+0000 7f6b0e786700 1 --2- 172.21.15.26:0/1566919584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b08099680 0x7f6b08099ab0 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:17.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.960+0000 7f6b0e786700 1 -- 172.21.15.26:0/1566919584 >> 172.21.15.26:0/1566919584 conn(0x7f6b080a2360 msgr2=0x7f6b080a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:17.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.960+0000 7f6b0e786700 1 -- 172.21.15.26:0/1566919584 shutdown_connections 2023-10-01T08:01:17.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.960+0000 7f6b0e786700 1 -- 172.21.15.26:0/1566919584 wait complete. 2023-10-01T08:01:17.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.961+0000 7f6b0e786700 1 Processor -- start 2023-10-01T08:01:17.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.961+0000 7f6b0e786700 1 -- start start 2023-10-01T08:01:17.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.961+0000 7f6b0e786700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b080954c0 0x7f6b08127240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:17.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.961+0000 7f6b0e786700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b08099680 0x7f6b08127780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:17.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.962+0000 7f6b0e786700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b08099ff0 0x7f6b08127cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:17.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.962+0000 7f6b0e786700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b080721a0 con 0x7f6b08099680 2023-10-01T08:01:17.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.962+0000 7f6b0e786700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b080727c0 con 0x7f6b08099ff0 2023-10-01T08:01:17.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.962+0000 7f6b0e786700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b08128a50 con 0x7f6b080954c0 2023-10-01T08:01:17.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.962+0000 7f6b0cd23700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b08099ff0 0x7f6b08127cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:17.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.962+0000 7f6b07fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b080954c0 0x7f6b08127240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:17.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.962+0000 7f6b0cd23700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b08099ff0 0x7f6b08127cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37964/0 (socket says 172.21.15.26:37964) 2023-10-01T08:01:17.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.962+0000 7f6b0cd23700 1 -- 172.21.15.26:0/2934369137 learned_addr learned my addr 172.21.15.26:0/2934369137 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:17.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.962+0000 7f6b07fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b080954c0 0x7f6b08127240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37484/0 (socket says 172.21.15.26:37484) 2023-10-01T08:01:17.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.962+0000 7f6b077fe700 1 --2- 172.21.15.26:0/2934369137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b08099680 0x7f6b08127780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:17.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.962+0000 7f6b077fe700 1 -- 172.21.15.26:0/2934369137 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b080954c0 msgr2=0x7f6b08127240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:17.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.962+0000 7f6b077fe700 1 --2- 172.21.15.26:0/2934369137 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b080954c0 0x7f6b08127240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:17.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.962+0000 7f6b077fe700 1 -- 172.21.15.26:0/2934369137 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b08099ff0 msgr2=0x7f6b08127cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:17.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.962+0000 7f6b077fe700 1 --2- 172.21.15.26:0/2934369137 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b08099ff0 0x7f6b08127cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:17.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.962+0000 7f6b077fe700 1 -- 172.21.15.26:0/2934369137 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af80094a0 con 0x7f6b08099680 2023-10-01T08:01:17.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.962+0000 7f6b0cd23700 1 --2- 172.21.15.26:0/2934369137 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b08099ff0 0x7f6b08127cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:17.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.962+0000 7f6b077fe700 1 --2- 172.21.15.26:0/2934369137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b08099680 0x7f6b08127780 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f6afc01a000 tx=0x7f6afc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:17.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.963+0000 7f6b04ff9700 1 -- 172.21.15.26:0/2934369137 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc004560 con 0x7f6b08099680 2023-10-01T08:01:17.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.963+0000 7f6b04ff9700 1 -- 172.21.15.26:0/2934369137 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6afc016430 con 0x7f6b08099680 2023-10-01T08:01:17.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.963+0000 7f6b0e786700 1 -- 172.21.15.26:0/2934369137 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6afc00da00 con 0x7f6b08099680 2023-10-01T08:01:17.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.963+0000 7f6b04ff9700 1 -- 172.21.15.26:0/2934369137 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc0167a0 con 0x7f6b08099680 2023-10-01T08:01:17.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.963+0000 7f6b0e786700 1 -- 172.21.15.26:0/2934369137 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b080a0c10 con 0x7f6b08099680 2023-10-01T08:01:17.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.963+0000 7f6b04ff9700 1 -- 172.21.15.26:0/2934369137 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6afc016900 con 0x7f6b08099680 2023-10-01T08:01:17.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.964+0000 7f6b04ff9700 1 -- 172.21.15.26:0/2934369137 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6afc044b50 con 0x7f6b08099680 2023-10-01T08:01:17.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.964+0000 7f6b0e786700 1 -- 172.21.15.26:0/2934369137 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b0809b060 con 0x7f6b08099680 2023-10-01T08:01:17.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:17.973+0000 7f6b04ff9700 1 -- 172.21.15.26:0/2934369137 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6afc01f3f0 con 0x7f6b08099680 2023-10-01T08:01:18.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.000+0000 7f099bc5a700 1 Processor -- start 2023-10-01T08:01:18.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.000+0000 7f099bc5a700 1 -- start start 2023-10-01T08:01:18.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.000+0000 7f099bc5a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f09940a0a30 0x7f09940a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:18.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.001+0000 7f099bc5a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0994134170 0x7f099413bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:18.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.001+0000 7f099bc5a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f099409edd0 con 0x7f09940a1340 2023-10-01T08:01:18.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.001+0000 7f099bc5a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f099409e1f0 con 0x7f09940a0a30 2023-10-01T08:01:18.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.001+0000 7f099bc5a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f099409dc50 con 0x7f0994134170 2023-10-01T08:01:18.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.001+0000 7f09991f5700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f09940a1340 0x7f0994133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39190/0 (socket says 172.21.15.26:39190) 2023-10-01T08:01:18.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.001+0000 7f09999f6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f09940a0a30 0x7f09940a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:18.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.001+0000 7f09991f5700 1 -- 172.21.15.26:0/2533156464 learned_addr learned my addr 172.21.15.26:0/2533156464 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:01:18.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.001+0000 7f099a1f7700 1 --2- 172.21.15.26:0/2533156464 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0994134170 0x7f099413bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:18.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.001+0000 7f09999f6700 1 -- 172.21.15.26:0/2533156464 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0994134170 msgr2=0x7f099413bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:18.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.001+0000 7f09999f6700 1 --2- 172.21.15.26:0/2533156464 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0994134170 0x7f099413bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:18.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.001+0000 7f09999f6700 1 -- 172.21.15.26:0/2533156464 >> v1:172.21.15.26:6789/0 conn(0x7f09940a1340 legacy=0x7f0994133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:18.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.001+0000 7f09989f4700 1 -- 172.21.15.26:0/2533156464 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2402599416 0 0) 0x7f099409edd0 con 0x7f09940a1340 2023-10-01T08:01:18.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.001+0000 7f09999f6700 1 -- 172.21.15.26:0/2533156464 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09940a1fe0 con 0x7f09940a0a30 2023-10-01T08:01:18.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.001+0000 7f09999f6700 1 --2- 172.21.15.26:0/2533156464 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f09940a0a30 0x7f09940a0e00 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f0990009870 tx=0x7f0990009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf3db8085d065d50 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:18.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.002+0000 7f09989f4700 1 -- 172.21.15.26:0/2533156464 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0990011830 con 0x7f09940a0a30 2023-10-01T08:01:18.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.002+0000 7f09989f4700 1 -- 172.21.15.26:0/2533156464 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0990011990 con 0x7f09940a0a30 2023-10-01T08:01:18.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.002+0000 7f09989f4700 1 -- 172.21.15.26:0/2533156464 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0990011d20 con 0x7f09940a0a30 2023-10-01T08:01:18.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.002+0000 7f099bc5a700 1 -- 172.21.15.26:0/2533156464 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f09940a0a30 msgr2=0x7f09940a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:18.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.002+0000 7f099bc5a700 1 --2- 172.21.15.26:0/2533156464 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f09940a0a30 0x7f09940a0e00 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f0990009870 tx=0x7f0990009b80 comp rx=0 tx=0).stop 2023-10-01T08:01:18.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.002+0000 7f099bc5a700 1 -- 172.21.15.26:0/2533156464 shutdown_connections 2023-10-01T08:01:18.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.002+0000 7f099bc5a700 1 --2- 172.21.15.26:0/2533156464 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0994134170 0x7f099413bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:18.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.002+0000 7f099bc5a700 1 --2- 172.21.15.26:0/2533156464 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f09940a0a30 0x7f09940a0e00 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:18.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.002+0000 7f099bc5a700 1 -- 172.21.15.26:0/2533156464 >> 172.21.15.26:0/2533156464 conn(0x7f09940a6550 msgr2=0x7f09940a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:18.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.003+0000 7f099bc5a700 1 -- 172.21.15.26:0/2533156464 shutdown_connections 2023-10-01T08:01:18.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.003+0000 7f099bc5a700 1 -- 172.21.15.26:0/2533156464 wait complete. 2023-10-01T08:01:18.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.004+0000 7f099bc5a700 1 Processor -- start 2023-10-01T08:01:18.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.004+0000 7f099bc5a700 1 -- start start 2023-10-01T08:01:18.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.004+0000 7f099bc5a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f09940a0a30 0x7f0994122790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:18.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.004+0000 7f099bc5a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09940a1340 0x7f0994122cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:18.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.004+0000 7f099bc5a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0994134170 0x7f0994123210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:18.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.004+0000 7f099bc5a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0994124350 con 0x7f09940a1340 2023-10-01T08:01:18.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.004+0000 7f099bc5a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0994125cc0 con 0x7f0994134170 2023-10-01T08:01:18.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.004+0000 7f099bc5a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0994126340 con 0x7f09940a0a30 2023-10-01T08:01:18.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.004+0000 7f09999f6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f09940a0a30 0x7f0994122790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:18.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.004+0000 7f09991f5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09940a1340 0x7f0994122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:18.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.004+0000 7f09999f6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f09940a0a30 0x7f0994122790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37496/0 (socket says 172.21.15.26:37496) 2023-10-01T08:01:18.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.004+0000 7f09999f6700 1 -- 172.21.15.26:0/4145473924 learned_addr learned my addr 172.21.15.26:0/4145473924 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:18.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.004+0000 7f099a1f7700 1 --2- 172.21.15.26:0/4145473924 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0994134170 0x7f0994123210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:18.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.005+0000 7f09999f6700 1 -- 172.21.15.26:0/4145473924 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0994134170 msgr2=0x7f0994123210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:18.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.005+0000 7f09999f6700 1 --2- 172.21.15.26:0/4145473924 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0994134170 0x7f0994123210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:18.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.005+0000 7f09999f6700 1 -- 172.21.15.26:0/4145473924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09940a1340 msgr2=0x7f0994122cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:18.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.005+0000 7f09999f6700 1 --2- 172.21.15.26:0/4145473924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09940a1340 0x7f0994122cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:18.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.005+0000 7f09999f6700 1 -- 172.21.15.26:0/4145473924 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09900094a0 con 0x7f09940a0a30 2023-10-01T08:01:18.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.005+0000 7f09999f6700 1 --2- 172.21.15.26:0/4145473924 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f09940a0a30 0x7f0994122790 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f0990009840 tx=0x7f0990004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:18.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.005+0000 7f098a7fc700 1 -- 172.21.15.26:0/4145473924 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0990004510 con 0x7f09940a0a30 2023-10-01T08:01:18.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.005+0000 7f098a7fc700 1 -- 172.21.15.26:0/4145473924 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099001f070 con 0x7f09940a0a30 2023-10-01T08:01:18.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.005+0000 7f099bc5a700 1 -- 172.21.15.26:0/4145473924 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09940a25e0 con 0x7f09940a0a30 2023-10-01T08:01:18.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.005+0000 7f098a7fc700 1 -- 172.21.15.26:0/4145473924 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09900038e0 con 0x7f09940a0a30 2023-10-01T08:01:18.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.005+0000 7f099bc5a700 1 -- 172.21.15.26:0/4145473924 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0994133690 con 0x7f09940a0a30 2023-10-01T08:01:18.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.006+0000 7f098a7fc700 1 -- 172.21.15.26:0/4145473924 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0990003a40 con 0x7f09940a0a30 2023-10-01T08:01:18.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.006+0000 7f098a7fc700 1 -- 172.21.15.26:0/4145473924 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0990021070 con 0x7f09940a0a30 2023-10-01T08:01:18.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.006+0000 7f099bc5a700 1 -- 172.21.15.26:0/4145473924 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0994074ea0 con 0x7f09940a0a30 2023-10-01T08:01:18.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.011+0000 7f098a7fc700 1 -- 172.21.15.26:0/4145473924 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f09900253e0 con 0x7f09940a0a30 2023-10-01T08:01:18.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.061+0000 7f3ed2fb7700 1 -- 172.21.15.26:0/763828305 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3ecc11a470 con 0x7f3ecc09de50 2023-10-01T08:01:18.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.061+0000 7f3ec97fa700 1 -- 172.21.15.26:0/763828305 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3ebc02b3a0 con 0x7f3ecc09de50 2023-10-01T08:01:18.062 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:18.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.063+0000 7f3ed2fb7700 1 -- 172.21.15.26:0/763828305 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ecc09de50 msgr2=0x7f3ecc11d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:18.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.063+0000 7f3ed2fb7700 1 --2- 172.21.15.26:0/763828305 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ecc09de50 0x7f3ecc11d710 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc00a010 tx=0x7f3ebc004750 comp rx=0 tx=0).stop 2023-10-01T08:01:18.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.063+0000 7f3ed2fb7700 1 -- 172.21.15.26:0/763828305 shutdown_connections 2023-10-01T08:01:18.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.063+0000 7f3ed2fb7700 1 --2- 172.21.15.26:0/763828305 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ecc1338a0 0x7f3ecc11e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:18.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.063+0000 7f3ed2fb7700 1 --2- 172.21.15.26:0/763828305 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ecc09de50 0x7f3ecc11d710 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:18.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.063+0000 7f3ed2fb7700 1 --2- 172.21.15.26:0/763828305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ecc09e930 0x7f3ecc11dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:18.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.063+0000 7f3ed2fb7700 1 -- 172.21.15.26:0/763828305 >> 172.21.15.26:0/763828305 conn(0x7f3ecc0a2aa0 msgr2=0x7f3ecc1bad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:18.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.063+0000 7f3ed2fb7700 1 -- 172.21.15.26:0/763828305 shutdown_connections 2023-10-01T08:01:18.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.063+0000 7f3ed2fb7700 1 -- 172.21.15.26:0/763828305 wait complete. 2023-10-01T08:01:18.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:18.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.185+0000 7f6b0e786700 1 -- 172.21.15.26:0/2934369137 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6b08129370 con 0x7f6b08099680 2023-10-01T08:01:18.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.185+0000 7f6b04ff9700 1 -- 172.21.15.26:0/2934369137 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6afc02e020 con 0x7f6b08099680 2023-10-01T08:01:18.186 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:18.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.187+0000 7f6b0e786700 1 -- 172.21.15.26:0/2934369137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b08099680 msgr2=0x7f6b08127780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:18.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.187+0000 7f6b0e786700 1 --2- 172.21.15.26:0/2934369137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b08099680 0x7f6b08127780 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f6afc01a000 tx=0x7f6afc004750 comp rx=0 tx=0).stop 2023-10-01T08:01:18.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.187+0000 7f6b0e786700 1 -- 172.21.15.26:0/2934369137 shutdown_connections 2023-10-01T08:01:18.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.187+0000 7f6b0e786700 1 --2- 172.21.15.26:0/2934369137 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b08099ff0 0x7f6b08127cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:18.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.187+0000 7f6b0e786700 1 --2- 172.21.15.26:0/2934369137 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b080954c0 0x7f6b08127240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:18.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.187+0000 7f6b0e786700 1 --2- 172.21.15.26:0/2934369137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b08099680 0x7f6b08127780 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:18.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.187+0000 7f6b0e786700 1 -- 172.21.15.26:0/2934369137 >> 172.21.15.26:0/2934369137 conn(0x7f6b080a2360 msgr2=0x7f6b08130ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:18.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.187+0000 7f6b0e786700 1 -- 172.21.15.26:0/2934369137 shutdown_connections 2023-10-01T08:01:18.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.187+0000 7f6b0e786700 1 -- 172.21.15.26:0/2934369137 wait complete. 2023-10-01T08:01:18.201 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:18.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.217+0000 7f099bc5a700 1 -- 172.21.15.26:0/4145473924 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f09940a28e0 con 0x7f09940a0a30 2023-10-01T08:01:18.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.218+0000 7f098a7fc700 1 -- 172.21.15.26:0/4145473924 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0990010b70 con 0x7f09940a0a30 2023-10-01T08:01:18.219 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:18.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.220+0000 7f099bc5a700 1 -- 172.21.15.26:0/4145473924 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f09940a0a30 msgr2=0x7f0994122790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:18.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.220+0000 7f099bc5a700 1 --2- 172.21.15.26:0/4145473924 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f09940a0a30 0x7f0994122790 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f0990009840 tx=0x7f0990004750 comp rx=0 tx=0).stop 2023-10-01T08:01:18.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.220+0000 7f099bc5a700 1 -- 172.21.15.26:0/4145473924 shutdown_connections 2023-10-01T08:01:18.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.220+0000 7f099bc5a700 1 --2- 172.21.15.26:0/4145473924 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0994134170 0x7f0994123210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:18.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.220+0000 7f099bc5a700 1 --2- 172.21.15.26:0/4145473924 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f09940a0a30 0x7f0994122790 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:18.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.220+0000 7f099bc5a700 1 --2- 172.21.15.26:0/4145473924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09940a1340 0x7f0994122cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:18.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.220+0000 7f099bc5a700 1 -- 172.21.15.26:0/4145473924 >> 172.21.15.26:0/4145473924 conn(0x7f09940a6550 msgr2=0x7f099409edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:18.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.220+0000 7f099bc5a700 1 -- 172.21.15.26:0/4145473924 shutdown_connections 2023-10-01T08:01:18.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.220+0000 7f099bc5a700 1 -- 172.21.15.26:0/4145473924 wait complete. 2023-10-01T08:01:18.234 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:18.561 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:18.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.708+0000 7fd2fa318700 1 Processor -- start 2023-10-01T08:01:18.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.708+0000 7fd2fa318700 1 -- start start 2023-10-01T08:01:18.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.708+0000 7fd2fa318700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd2f409f410 0x7fd2f4136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:18.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.708+0000 7fd2fa318700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2f4136fe0 0x7fd2f41393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:18.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.709+0000 7fd2fa318700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2f4070940 con 0x7fd2f409e930 2023-10-01T08:01:18.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.709+0000 7fd2fa318700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2f406fd60 con 0x7fd2f409f410 2023-10-01T08:01:18.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.709+0000 7fd2fa318700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f406fa80 con 0x7fd2f4136fe0 2023-10-01T08:01:18.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.709+0000 7fd2f37fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd2f409f410 0x7fd2f4136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:18.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.709+0000 7fd2f37fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd2f409f410 0x7fd2f4136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44742/0 (socket says 172.21.15.26:44742) 2023-10-01T08:01:18.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.709+0000 7fd2f88b5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2f4136fe0 0x7fd2f41393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:18.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.709+0000 7fd2f37fe700 1 -- 172.21.15.26:0/2509609355 learned_addr learned my addr 172.21.15.26:0/2509609355 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:18.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.709+0000 7fd2f88b5700 1 -- 172.21.15.26:0/2509609355 >> v2:172.21.15.26:3300/0 conn(0x7fd2f409f410 msgr2=0x7fd2f4136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:18.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.709+0000 7fd2f88b5700 1 --2- 172.21.15.26:0/2509609355 >> v2:172.21.15.26:3300/0 conn(0x7fd2f409f410 0x7fd2f4136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:18.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.709+0000 7fd2f88b5700 1 -- 172.21.15.26:0/2509609355 >> v1:172.21.15.26:6789/0 conn(0x7fd2f409e930 legacy=0x7fd2f409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:18.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.709+0000 7fd2f88b5700 1 -- 172.21.15.26:0/2509609355 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f409fb60 con 0x7fd2f4136fe0 2023-10-01T08:01:18.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.709+0000 7fd2f37fe700 1 --2- 172.21.15.26:0/2509609355 >> v2:172.21.15.26:3300/0 conn(0x7fd2f409f410 0x7fd2f4136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:18.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.709+0000 7fd2f88b5700 1 --2- 172.21.15.26:0/2509609355 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2f4136fe0 0x7fd2f41393c0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec009d90 tx=0x7fd2ec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83235c04805138dc server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:18.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.709+0000 7fd2f2ffd700 1 -- 172.21.15.26:0/2509609355 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec00e070 con 0x7fd2f4136fe0 2023-10-01T08:01:18.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.709+0000 7fd2f2ffd700 1 -- 172.21.15.26:0/2509609355 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ec00bb20 con 0x7fd2f4136fe0 2023-10-01T08:01:18.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.709+0000 7fd2f2ffd700 1 -- 172.21.15.26:0/2509609355 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec012430 con 0x7fd2f4136fe0 2023-10-01T08:01:18.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.710+0000 7fd2fa318700 1 -- 172.21.15.26:0/2509609355 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2f4136fe0 msgr2=0x7fd2f41393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:18.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.710+0000 7fd2fa318700 1 --2- 172.21.15.26:0/2509609355 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2f4136fe0 0x7fd2f41393c0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec009d90 tx=0x7fd2ec00b330 comp rx=0 tx=0).stop 2023-10-01T08:01:18.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.710+0000 7fd2fa318700 1 -- 172.21.15.26:0/2509609355 shutdown_connections 2023-10-01T08:01:18.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.710+0000 7fd2fa318700 1 --2- 172.21.15.26:0/2509609355 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2f4136fe0 0x7fd2f41393c0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:18.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.710+0000 7fd2fa318700 1 --2- 172.21.15.26:0/2509609355 >> v2:172.21.15.26:3300/0 conn(0x7fd2f409f410 0x7fd2f4136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:18.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.710+0000 7fd2fa318700 1 -- 172.21.15.26:0/2509609355 >> 172.21.15.26:0/2509609355 conn(0x7fd2f40a4210 msgr2=0x7fd2f40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:18.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.710+0000 7fd2fa318700 1 -- 172.21.15.26:0/2509609355 shutdown_connections 2023-10-01T08:01:18.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.710+0000 7fd2fa318700 1 -- 172.21.15.26:0/2509609355 wait complete. 2023-10-01T08:01:18.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.711+0000 7fd2fa318700 1 Processor -- start 2023-10-01T08:01:18.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.711+0000 7fd2fa318700 1 -- start start 2023-10-01T08:01:18.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.712+0000 7fd2fa318700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2f409e930 0x7fd2f411c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:18.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.712+0000 7fd2fa318700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2f409f410 0x7fd2f411ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:18.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.712+0000 7fd2fa318700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2f4136fe0 0x7fd2f411cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:18.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.712+0000 7fd2fa318700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f4071db0 con 0x7fd2f409f410 2023-10-01T08:01:18.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.712+0000 7fd2fa318700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f40a33f0 con 0x7fd2f409e930 2023-10-01T08:01:18.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.712+0000 7fd2fa318700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f411f820 con 0x7fd2f4136fe0 2023-10-01T08:01:18.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.712+0000 7fd2f3fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2f409e930 0x7fd2f411c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:18.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.712+0000 7fd2f88b5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2f4136fe0 0x7fd2f411cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:18.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.712+0000 7fd2f88b5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2f4136fe0 0x7fd2f411cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37512/0 (socket says 172.21.15.26:37512) 2023-10-01T08:01:18.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.712+0000 7fd2f3fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2f409e930 0x7fd2f411c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37982/0 (socket says 172.21.15.26:37982) 2023-10-01T08:01:18.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.712+0000 7fd2f37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2f409f410 0x7fd2f411ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:18.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.712+0000 7fd2f88b5700 1 -- 172.21.15.26:0/3497309 learned_addr learned my addr 172.21.15.26:0/3497309 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:18.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.712+0000 7fd2f88b5700 1 -- 172.21.15.26:0/3497309 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2f409e930 msgr2=0x7fd2f411c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:18.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.712+0000 7fd2f88b5700 1 --2- 172.21.15.26:0/3497309 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2f409e930 0x7fd2f411c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:18.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.712+0000 7fd2f88b5700 1 -- 172.21.15.26:0/3497309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2f409f410 msgr2=0x7fd2f411ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:18.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.712+0000 7fd2f88b5700 1 --2- 172.21.15.26:0/3497309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2f409f410 0x7fd2f411ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:18.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.712+0000 7fd2f88b5700 1 -- 172.21.15.26:0/3497309 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e4009550 con 0x7fd2f4136fe0 2023-10-01T08:01:18.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.712+0000 7fd2f37fe700 1 --2- 172.21.15.26:0/3497309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2f409f410 0x7fd2f411ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:18.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.712+0000 7fd2f3fff700 1 --2- 172.21.15.26:0/3497309 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2f409e930 0x7fd2f411c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:18.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.713+0000 7fd2f88b5700 1 --2- 172.21.15.26:0/3497309 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2f4136fe0 0x7fd2f411cfd0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fd2f406fbc0 tx=0x7fd2ec004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:18.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.713+0000 7fd2f0ff9700 1 -- 172.21.15.26:0/3497309 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec012430 con 0x7fd2f4136fe0 2023-10-01T08:01:18.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.713+0000 7fd2f0ff9700 1 -- 172.21.15.26:0/3497309 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ec020070 con 0x7fd2f4136fe0 2023-10-01T08:01:18.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.713+0000 7fd2fa318700 1 -- 172.21.15.26:0/3497309 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2ec009a70 con 0x7fd2f4136fe0 2023-10-01T08:01:18.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.713+0000 7fd2f0ff9700 1 -- 172.21.15.26:0/3497309 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec003ea0 con 0x7fd2f4136fe0 2023-10-01T08:01:18.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.713+0000 7fd2fa318700 1 -- 172.21.15.26:0/3497309 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2f411fd90 con 0x7fd2f4136fe0 2023-10-01T08:01:18.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.713+0000 7fd2f0ff9700 1 -- 172.21.15.26:0/3497309 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd2ec004040 con 0x7fd2f4136fe0 2023-10-01T08:01:18.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.714+0000 7fd2f0ff9700 1 -- 172.21.15.26:0/3497309 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd2ec022070 con 0x7fd2f4136fe0 2023-10-01T08:01:18.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.714+0000 7fd2fa318700 1 -- 172.21.15.26:0/3497309 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2f4074ea0 con 0x7fd2f4136fe0 2023-10-01T08:01:18.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.719+0000 7fd2f0ff9700 1 -- 172.21.15.26:0/3497309 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd2ec01a970 con 0x7fd2f4136fe0 2023-10-01T08:01:18.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.922+0000 7fd2fa318700 1 -- 172.21.15.26:0/3497309 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd2f406b250 con 0x7fd2f4136fe0 2023-10-01T08:01:18.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.923+0000 7fd2f0ff9700 1 -- 172.21.15.26:0/3497309 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd2ec01a380 con 0x7fd2f4136fe0 2023-10-01T08:01:18.924 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:18.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.925+0000 7fd2fa318700 1 -- 172.21.15.26:0/3497309 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2f4136fe0 msgr2=0x7fd2f411cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:18.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.925+0000 7fd2fa318700 1 --2- 172.21.15.26:0/3497309 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2f4136fe0 0x7fd2f411cfd0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fd2f406fbc0 tx=0x7fd2ec004ad0 comp rx=0 tx=0).stop 2023-10-01T08:01:18.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.925+0000 7fd2fa318700 1 -- 172.21.15.26:0/3497309 shutdown_connections 2023-10-01T08:01:18.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.925+0000 7fd2fa318700 1 --2- 172.21.15.26:0/3497309 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd2f4136fe0 0x7fd2f411cfd0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:18.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.925+0000 7fd2fa318700 1 --2- 172.21.15.26:0/3497309 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2f409e930 0x7fd2f411c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:18.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.925+0000 7fd2fa318700 1 --2- 172.21.15.26:0/3497309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2f409f410 0x7fd2f411ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:18.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.925+0000 7fd2fa318700 1 -- 172.21.15.26:0/3497309 >> 172.21.15.26:0/3497309 conn(0x7fd2f40a4210 msgr2=0x7fd2f4135c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:18.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.925+0000 7fd2fa318700 1 -- 172.21.15.26:0/3497309 shutdown_connections 2023-10-01T08:01:18.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:18.925+0000 7fd2fa318700 1 -- 172.21.15.26:0/3497309 wait complete. 2023-10-01T08:01:18.940 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:19.080 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:19.203 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:19.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.222+0000 7f97f2f90700 1 Processor -- start 2023-10-01T08:01:19.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.222+0000 7f97f2f90700 1 -- start start 2023-10-01T08:01:19.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.223+0000 7f97f2f90700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97ec09d6f0 0x7f97ec09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:19.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.223+0000 7f97f2f90700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97ec09e000 0x7f97ec1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:19.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.223+0000 7f97f2f90700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f97ec09e410 0x7f97ec133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:19.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.223+0000 7f97f2f90700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97ec06b460 con 0x7f97ec09e410 2023-10-01T08:01:19.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.223+0000 7f97f2f90700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec09b120 con 0x7f97ec09e000 2023-10-01T08:01:19.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.223+0000 7f97f2f90700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec09a7e0 con 0x7f97ec09d6f0 2023-10-01T08:01:19.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.223+0000 7f97ebfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97ec09e000 0x7f97ec1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:19.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.223+0000 7f97f0d2c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97ec09d6f0 0x7f97ec09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:19.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.223+0000 7f97ebfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97ec09e000 0x7f97ec1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37986/0 (socket says 172.21.15.26:37986) 2023-10-01T08:01:19.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.223+0000 7f97ebfff700 1 -- 172.21.15.26:0/762518990 learned_addr learned my addr 172.21.15.26:0/762518990 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:19.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.223+0000 7f97f152d700 1 --2- 172.21.15.26:0/762518990 >> v2:172.21.15.26:3300/0 conn(0x7f97ec09e410 0x7f97ec133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:19.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.223+0000 7f97f0d2c700 1 -- 172.21.15.26:0/762518990 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97ec09e000 msgr2=0x7f97ec1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:19.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.223+0000 7f97f0d2c700 1 --2- 172.21.15.26:0/762518990 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97ec09e000 0x7f97ec1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:19.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.223+0000 7f97f0d2c700 1 -- 172.21.15.26:0/762518990 >> v2:172.21.15.26:3300/0 conn(0x7f97ec09e410 msgr2=0x7f97ec133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:19.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.223+0000 7f97f0d2c700 1 --2- 172.21.15.26:0/762518990 >> v2:172.21.15.26:3300/0 conn(0x7f97ec09e410 0x7f97ec133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:19.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.223+0000 7f97f0d2c700 1 -- 172.21.15.26:0/762518990 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ec09a500 con 0x7f97ec09d6f0 2023-10-01T08:01:19.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.223+0000 7f97ebfff700 1 --2- 172.21.15.26:0/762518990 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97ec09e000 0x7f97ec1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:19.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.223+0000 7f97f152d700 1 --2- 172.21.15.26:0/762518990 >> v2:172.21.15.26:3300/0 conn(0x7f97ec09e410 0x7f97ec133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:19.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.223+0000 7f97f0d2c700 1 --2- 172.21.15.26:0/762518990 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97ec09d6f0 0x7f97ec09dac0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f97e0009870 tx=0x7f97e0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df2b254796901438 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:19.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.224+0000 7f97eb7fe700 1 -- 172.21.15.26:0/762518990 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e0011830 con 0x7f97ec09d6f0 2023-10-01T08:01:19.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.224+0000 7f97eb7fe700 1 -- 172.21.15.26:0/762518990 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e0011990 con 0x7f97ec09d6f0 2023-10-01T08:01:19.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.224+0000 7f97eb7fe700 1 -- 172.21.15.26:0/762518990 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e0011d20 con 0x7f97ec09d6f0 2023-10-01T08:01:19.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.224+0000 7f97f2f90700 1 -- 172.21.15.26:0/762518990 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97ec09d6f0 msgr2=0x7f97ec09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:19.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.224+0000 7f97f2f90700 1 --2- 172.21.15.26:0/762518990 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97ec09d6f0 0x7f97ec09dac0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f97e0009870 tx=0x7f97e0009b80 comp rx=0 tx=0).stop 2023-10-01T08:01:19.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.224+0000 7f97f2f90700 1 -- 172.21.15.26:0/762518990 shutdown_connections 2023-10-01T08:01:19.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.224+0000 7f97f2f90700 1 --2- 172.21.15.26:0/762518990 >> v2:172.21.15.26:3300/0 conn(0x7f97ec09e410 0x7f97ec133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:19.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.224+0000 7f97f2f90700 1 --2- 172.21.15.26:0/762518990 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97ec09d6f0 0x7f97ec09dac0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:19.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.224+0000 7f97f2f90700 1 --2- 172.21.15.26:0/762518990 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97ec09e000 0x7f97ec1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:19.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.224+0000 7f97f2f90700 1 -- 172.21.15.26:0/762518990 >> 172.21.15.26:0/762518990 conn(0x7f97ec066f50 msgr2=0x7f97ec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:19.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.224+0000 7f97f2f90700 1 -- 172.21.15.26:0/762518990 shutdown_connections 2023-10-01T08:01:19.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.224+0000 7f97f2f90700 1 -- 172.21.15.26:0/762518990 wait complete. 2023-10-01T08:01:19.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.225+0000 7f97f2f90700 1 Processor -- start 2023-10-01T08:01:19.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.225+0000 7f97f2f90700 1 -- start start 2023-10-01T08:01:19.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.226+0000 7f97f2f90700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97ec09d6f0 0x7f97ec1a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:19.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.226+0000 7f97f2f90700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97ec09e000 0x7f97ec1a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:19.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.226+0000 7f97f2f90700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97ec09e410 0x7f97ec1c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:19.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.226+0000 7f97f2f90700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec1a8190 con 0x7f97ec09d6f0 2023-10-01T08:01:19.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.226+0000 7f97f2f90700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec1a8370 con 0x7f97ec09e000 2023-10-01T08:01:19.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.226+0000 7f97f2f90700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec1b91e0 con 0x7f97ec09e410 2023-10-01T08:01:19.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.226+0000 7f97ebfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97ec09e000 0x7f97ec1a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:19.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.226+0000 7f97f0d2c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97ec09d6f0 0x7f97ec1a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:19.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.226+0000 7f97ebfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97ec09e000 0x7f97ec1a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38000/0 (socket says 172.21.15.26:38000) 2023-10-01T08:01:19.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.226+0000 7f97ebfff700 1 -- 172.21.15.26:0/779914524 learned_addr learned my addr 172.21.15.26:0/779914524 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:19.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.226+0000 7f97f0d2c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97ec09d6f0 0x7f97ec1a52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44776/0 (socket says 172.21.15.26:44776) 2023-10-01T08:01:19.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.226+0000 7f97f152d700 1 --2- 172.21.15.26:0/779914524 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97ec09e410 0x7f97ec1c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:19.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.227+0000 7f97ebfff700 1 -- 172.21.15.26:0/779914524 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97ec09e410 msgr2=0x7f97ec1c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:19.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.227+0000 7f97ebfff700 1 --2- 172.21.15.26:0/779914524 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97ec09e410 0x7f97ec1c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:19.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.227+0000 7f97ebfff700 1 -- 172.21.15.26:0/779914524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97ec09d6f0 msgr2=0x7f97ec1a52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:19.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.227+0000 7f97ebfff700 1 --2- 172.21.15.26:0/779914524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97ec09d6f0 0x7f97ec1a52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:19.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.227+0000 7f97ebfff700 1 -- 172.21.15.26:0/779914524 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d8009550 con 0x7f97ec09e000 2023-10-01T08:01:19.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.227+0000 7f97f152d700 1 --2- 172.21.15.26:0/779914524 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97ec09e410 0x7f97ec1c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:19.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.227+0000 7f97f0d2c700 1 --2- 172.21.15.26:0/779914524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97ec09d6f0 0x7f97ec1a52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:19.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.227+0000 7f97ebfff700 1 --2- 172.21.15.26:0/779914524 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97ec09e000 0x7f97ec1a57f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f97d800ebe0 tx=0x7f97d800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:19.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.227+0000 7f97e97fa700 1 -- 172.21.15.26:0/779914524 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d800c850 con 0x7f97ec09e000 2023-10-01T08:01:19.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.227+0000 7f97e97fa700 1 -- 172.21.15.26:0/779914524 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d800c9b0 con 0x7f97ec09e000 2023-10-01T08:01:19.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.227+0000 7f97f2f90700 1 -- 172.21.15.26:0/779914524 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e4009a70 con 0x7f97ec09e000 2023-10-01T08:01:19.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.227+0000 7f97e97fa700 1 -- 172.21.15.26:0/779914524 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d800cd60 con 0x7f97ec09e000 2023-10-01T08:01:19.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.227+0000 7f97f2f90700 1 -- 172.21.15.26:0/779914524 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e00094a0 con 0x7f97ec09e000 2023-10-01T08:01:19.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.228+0000 7f97f2f90700 1 -- 172.21.15.26:0/779914524 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97ec0a3000 con 0x7f97ec09e000 2023-10-01T08:01:19.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.228+0000 7f97e97fa700 1 -- 172.21.15.26:0/779914524 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f97d8013470 con 0x7f97ec09e000 2023-10-01T08:01:19.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.229+0000 7f97e97fa700 1 -- 172.21.15.26:0/779914524 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f97d803f7a0 con 0x7f97ec09e000 2023-10-01T08:01:19.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.234+0000 7f97e97fa700 1 -- 172.21.15.26:0/779914524 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f97d80232f0 con 0x7f97ec09e000 2023-10-01T08:01:19.235 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:19.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.352+0000 7f085a674700 1 Processor -- start 2023-10-01T08:01:19.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.352+0000 7f085a674700 1 -- start start 2023-10-01T08:01:19.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.353+0000 7f085a674700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f085409d6f0 0x7f085409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:19.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.353+0000 7f085a674700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f085409e000 0x7f0854130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:19.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.353+0000 7f085a674700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f085409e410 0x7f0854130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:19.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.353+0000 7f085a674700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f085409f520 con 0x7f085409e000 2023-10-01T08:01:19.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.353+0000 7f085a674700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f085409f130 con 0x7f085409e410 2023-10-01T08:01:19.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.353+0000 7f085a674700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f085409e930 con 0x7f085409d6f0 2023-10-01T08:01:19.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.353+0000 7f0858c11700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f085409e410 0x7f0854130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:19.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.353+0000 7f0858c11700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f085409e410 0x7f0854130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38016/0 (socket says 172.21.15.26:38016) 2023-10-01T08:01:19.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.353+0000 7f08537fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f085409e000 0x7f0854130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:19.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.353+0000 7f0858c11700 1 -- 172.21.15.26:0/1817270548 learned_addr learned my addr 172.21.15.26:0/1817270548 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:19.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.353+0000 7f0853fff700 1 --2- 172.21.15.26:0/1817270548 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f085409d6f0 0x7f085409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:19.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.354+0000 7f0858c11700 1 -- 172.21.15.26:0/1817270548 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f085409d6f0 msgr2=0x7f085409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:19.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.354+0000 7f0858c11700 1 --2- 172.21.15.26:0/1817270548 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f085409d6f0 0x7f085409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:19.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.354+0000 7f0858c11700 1 -- 172.21.15.26:0/1817270548 >> v2:172.21.15.26:3300/0 conn(0x7f085409e000 msgr2=0x7f0854130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:19.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.354+0000 7f0858c11700 1 --2- 172.21.15.26:0/1817270548 >> v2:172.21.15.26:3300/0 conn(0x7f085409e000 0x7f0854130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:19.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.354+0000 7f0858c11700 1 -- 172.21.15.26:0/1817270548 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f085409b2d0 con 0x7f085409e410 2023-10-01T08:01:19.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.354+0000 7f08537fe700 1 --2- 172.21.15.26:0/1817270548 >> v2:172.21.15.26:3300/0 conn(0x7f085409e000 0x7f0854130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:19.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.354+0000 7f0858c11700 1 --2- 172.21.15.26:0/1817270548 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f085409e410 0x7f0854130ba0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f084c009e50 tx=0x7f084c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7db4be6fd40908 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:19.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.354+0000 7f0852ffd700 1 -- 172.21.15.26:0/1817270548 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084c00e070 con 0x7f085409e410 2023-10-01T08:01:19.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.354+0000 7f0852ffd700 1 -- 172.21.15.26:0/1817270548 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084c00bb10 con 0x7f085409e410 2023-10-01T08:01:19.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.354+0000 7f0852ffd700 1 -- 172.21.15.26:0/1817270548 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084c0126e0 con 0x7f085409e410 2023-10-01T08:01:19.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.355+0000 7f085a674700 1 -- 172.21.15.26:0/1817270548 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f085409e410 msgr2=0x7f0854130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:19.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.355+0000 7f085a674700 1 --2- 172.21.15.26:0/1817270548 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f085409e410 0x7f0854130ba0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f084c009e50 tx=0x7f084c00b330 comp rx=0 tx=0).stop 2023-10-01T08:01:19.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.355+0000 7f085a674700 1 -- 172.21.15.26:0/1817270548 shutdown_connections 2023-10-01T08:01:19.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.355+0000 7f085a674700 1 --2- 172.21.15.26:0/1817270548 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f085409e410 0x7f0854130ba0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:19.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.355+0000 7f085a674700 1 --2- 172.21.15.26:0/1817270548 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f085409d6f0 0x7f085409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:19.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.355+0000 7f085a674700 1 --2- 172.21.15.26:0/1817270548 >> v2:172.21.15.26:3300/0 conn(0x7f085409e000 0x7f0854130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:19.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.355+0000 7f085a674700 1 -- 172.21.15.26:0/1817270548 >> 172.21.15.26:0/1817270548 conn(0x7f0854066f50 msgr2=0x7f085409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:19.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.355+0000 7f085a674700 1 -- 172.21.15.26:0/1817270548 shutdown_connections 2023-10-01T08:01:19.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.355+0000 7f085a674700 1 -- 172.21.15.26:0/1817270548 wait complete. 2023-10-01T08:01:19.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.356+0000 7f085a674700 1 Processor -- start 2023-10-01T08:01:19.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.357+0000 7f085a674700 1 -- start start 2023-10-01T08:01:19.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.357+0000 7f085a674700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f085409d6f0 0x7f085411ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:19.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.357+0000 7f085a674700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f085409e000 0x7f085411e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:19.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.357+0000 7f085a674700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f085409e410 0x7f085411e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:19.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.357+0000 7f085a674700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085411f270 con 0x7f085409e000 2023-10-01T08:01:19.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.357+0000 7f085a674700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f085411f980 con 0x7f085409d6f0 2023-10-01T08:01:19.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.357+0000 7f085a674700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0854120bd0 con 0x7f085409e410 2023-10-01T08:01:19.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.357+0000 7f0853fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f085409d6f0 0x7f085411ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:19.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.357+0000 7f0853fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f085409d6f0 0x7f085411ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38018/0 (socket says 172.21.15.26:38018) 2023-10-01T08:01:19.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.357+0000 7f0853fff700 1 -- 172.21.15.26:0/1439390934 learned_addr learned my addr 172.21.15.26:0/1439390934 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:19.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.357+0000 7f0858c11700 1 --2- 172.21.15.26:0/1439390934 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f085409e410 0x7f085411e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:19.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.357+0000 7f08537fe700 1 --2- 172.21.15.26:0/1439390934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f085409e000 0x7f085411e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:19.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.358+0000 7f0853fff700 1 -- 172.21.15.26:0/1439390934 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f085409e410 msgr2=0x7f085411e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:19.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.358+0000 7f0853fff700 1 --2- 172.21.15.26:0/1439390934 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f085409e410 0x7f085411e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:19.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.358+0000 7f0853fff700 1 -- 172.21.15.26:0/1439390934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f085409e000 msgr2=0x7f085411e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:19.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.358+0000 7f0853fff700 1 --2- 172.21.15.26:0/1439390934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f085409e000 0x7f085411e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:19.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.358+0000 7f0853fff700 1 -- 172.21.15.26:0/1439390934 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08480094a0 con 0x7f085409d6f0 2023-10-01T08:01:19.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.358+0000 7f0853fff700 1 --2- 172.21.15.26:0/1439390934 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f085409d6f0 0x7f085411ddc0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f084400e930 tx=0x7f084400ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:19.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.358+0000 7f0850ff9700 1 -- 172.21.15.26:0/1439390934 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0844013680 con 0x7f085409d6f0 2023-10-01T08:01:19.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.358+0000 7f0850ff9700 1 -- 172.21.15.26:0/1439390934 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08440137e0 con 0x7f085409d6f0 2023-10-01T08:01:19.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.358+0000 7f085a674700 1 -- 172.21.15.26:0/1439390934 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f084c009b30 con 0x7f085409d6f0 2023-10-01T08:01:19.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.358+0000 7f0850ff9700 1 -- 172.21.15.26:0/1439390934 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0844013b70 con 0x7f085409d6f0 2023-10-01T08:01:19.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.358+0000 7f085a674700 1 -- 172.21.15.26:0/1439390934 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08540a1600 con 0x7f085409d6f0 2023-10-01T08:01:19.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.359+0000 7f0850ff9700 1 -- 172.21.15.26:0/1439390934 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0844013cd0 con 0x7f085409d6f0 2023-10-01T08:01:19.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.359+0000 7f0850ff9700 1 -- 172.21.15.26:0/1439390934 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f084403f660 con 0x7f085409d6f0 2023-10-01T08:01:19.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.361+0000 7f085a674700 1 -- 172.21.15.26:0/1439390934 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f085411ac20 con 0x7f085409d6f0 2023-10-01T08:01:19.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.365+0000 7f0850ff9700 1 -- 172.21.15.26:0/1439390934 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0844017080 con 0x7f085409d6f0 2023-10-01T08:01:19.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.375+0000 7fbeae155700 1 Processor -- start 2023-10-01T08:01:19.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.375+0000 7fbeae155700 1 -- start start 2023-10-01T08:01:19.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.376+0000 7fbeae155700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbea80a0a30 0x7fbea80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:19.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.376+0000 7fbeae155700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbea8138d80 0x7fbea813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:19.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.376+0000 7fbeae155700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbea80a2a70 con 0x7fbea809d630 2023-10-01T08:01:19.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.376+0000 7fbeae155700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea80a01d0 con 0x7fbea8138d80 2023-10-01T08:01:19.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.376+0000 7fbeae155700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbea809e2b0 con 0x7fbea80a0a30 2023-10-01T08:01:19.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.376+0000 7fbea77fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbea80a0a30 0x7fbea80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:19.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.376+0000 7fbea77fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbea80a0a30 0x7fbea80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37570/0 (socket says 172.21.15.26:37570) 2023-10-01T08:01:19.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.376+0000 7fbea77fe700 1 -- 172.21.15.26:0/3819032689 learned_addr learned my addr 172.21.15.26:0/3819032689 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:19.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.376+0000 7fbea7fff700 1 --2- 172.21.15.26:0/3819032689 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbea8138d80 0x7fbea813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:19.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.377+0000 7fbea77fe700 1 -- 172.21.15.26:0/3819032689 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbea8138d80 msgr2=0x7fbea813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:19.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.377+0000 7fbea77fe700 1 --2- 172.21.15.26:0/3819032689 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbea8138d80 0x7fbea813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:19.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.377+0000 7fbea77fe700 1 -- 172.21.15.26:0/3819032689 >> v1:172.21.15.26:6789/0 conn(0x7fbea809d630 legacy=0x7fbea80a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:19.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.377+0000 7fbea77fe700 1 -- 172.21.15.26:0/3819032689 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea809dc50 con 0x7fbea80a0a30 2023-10-01T08:01:19.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.377+0000 7fbea67fc700 1 -- 172.21.15.26:0/3819032689 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 225599283 0 0) 0x7fbea80a2a70 con 0x7fbea809d630 2023-10-01T08:01:19.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.377+0000 7fbea77fe700 1 --2- 172.21.15.26:0/3819032689 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbea80a0a30 0x7fbea80a0e00 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fbea0009e80 tx=0x7fbea000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bb09c4ca10a5c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:19.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.377+0000 7fbea67fc700 1 -- 172.21.15.26:0/3819032689 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea000e070 con 0x7fbea80a0a30 2023-10-01T08:01:19.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.377+0000 7fbea67fc700 1 -- 172.21.15.26:0/3819032689 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea000b910 con 0x7fbea80a0a30 2023-10-01T08:01:19.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.377+0000 7fbea67fc700 1 -- 172.21.15.26:0/3819032689 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea000bcc0 con 0x7fbea80a0a30 2023-10-01T08:01:19.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.378+0000 7fbeae155700 1 -- 172.21.15.26:0/3819032689 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbea80a0a30 msgr2=0x7fbea80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:19.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.378+0000 7fbeae155700 1 --2- 172.21.15.26:0/3819032689 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbea80a0a30 0x7fbea80a0e00 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fbea0009e80 tx=0x7fbea000b330 comp rx=0 tx=0).stop 2023-10-01T08:01:19.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.378+0000 7fbeae155700 1 -- 172.21.15.26:0/3819032689 shutdown_connections 2023-10-01T08:01:19.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.378+0000 7fbeae155700 1 --2- 172.21.15.26:0/3819032689 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbea80a0a30 0x7fbea80a0e00 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:19.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.378+0000 7fbeae155700 1 --2- 172.21.15.26:0/3819032689 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbea8138d80 0x7fbea813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:19.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.378+0000 7fbeae155700 1 -- 172.21.15.26:0/3819032689 >> 172.21.15.26:0/3819032689 conn(0x7fbea80a3050 msgr2=0x7fbea80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:19.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.378+0000 7fbeae155700 1 -- 172.21.15.26:0/3819032689 shutdown_connections 2023-10-01T08:01:19.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.378+0000 7fbeae155700 1 -- 172.21.15.26:0/3819032689 wait complete. 2023-10-01T08:01:19.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.379+0000 7fbeae155700 1 Processor -- start 2023-10-01T08:01:19.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.379+0000 7fbeae155700 1 -- start start 2023-10-01T08:01:19.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.380+0000 7fbeae155700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbea809d630 0x7fbea81337e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:19.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.380+0000 7fbeae155700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbea80a0a30 0x7fbea8133d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:19.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.380+0000 7fbeae155700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbea8138d80 0x7fbea8134260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:19.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.380+0000 7fbeae155700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea8136f80 con 0x7fbea80a0a30 2023-10-01T08:01:19.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.380+0000 7fbeae155700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea8135970 con 0x7fbea8138d80 2023-10-01T08:01:19.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.380+0000 7fbeae155700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbea80a0480 con 0x7fbea809d630 2023-10-01T08:01:19.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.380+0000 7fbea77fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbea809d630 0x7fbea81337e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:19.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.380+0000 7fbea77fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbea809d630 0x7fbea81337e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37572/0 (socket says 172.21.15.26:37572) 2023-10-01T08:01:19.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.380+0000 7fbea77fe700 1 -- 172.21.15.26:0/383096403 learned_addr learned my addr 172.21.15.26:0/383096403 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:19.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.380+0000 7fbea6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbea80a0a30 0x7fbea8133d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:19.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.380+0000 7fbea7fff700 1 --2- 172.21.15.26:0/383096403 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbea8138d80 0x7fbea8134260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:19.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.381+0000 7fbea7fff700 1 -- 172.21.15.26:0/383096403 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbea809d630 msgr2=0x7fbea81337e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:19.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.381+0000 7fbea7fff700 1 --2- 172.21.15.26:0/383096403 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbea809d630 0x7fbea81337e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:19.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.381+0000 7fbea7fff700 1 -- 172.21.15.26:0/383096403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbea80a0a30 msgr2=0x7fbea8133d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:19.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.381+0000 7fbea7fff700 1 --2- 172.21.15.26:0/383096403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbea80a0a30 0x7fbea8133d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:19.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.381+0000 7fbea7fff700 1 -- 172.21.15.26:0/383096403 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea0009b30 con 0x7fbea8138d80 2023-10-01T08:01:19.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.381+0000 7fbea7fff700 1 --2- 172.21.15.26:0/383096403 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbea8138d80 0x7fbea8134260 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fbea809ff90 tx=0x7fbe9800eb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:19.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.381+0000 7fbe9ffff700 1 -- 172.21.15.26:0/383096403 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe98013680 con 0x7fbea8138d80 2023-10-01T08:01:19.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.381+0000 7fbe9ffff700 1 -- 172.21.15.26:0/383096403 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe980137e0 con 0x7fbea8138d80 2023-10-01T08:01:19.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.381+0000 7fbeae155700 1 -- 172.21.15.26:0/383096403 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea8136cc0 con 0x7fbea8138d80 2023-10-01T08:01:19.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.381+0000 7fbe9ffff700 1 -- 172.21.15.26:0/383096403 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe98013b90 con 0x7fbea8138d80 2023-10-01T08:01:19.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.381+0000 7fbeae155700 1 -- 172.21.15.26:0/383096403 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea813ac90 con 0x7fbea8138d80 2023-10-01T08:01:19.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.382+0000 7fbeae155700 1 -- 172.21.15.26:0/383096403 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea813b620 con 0x7fbea8138d80 2023-10-01T08:01:19.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.382+0000 7fbe9ffff700 1 -- 172.21.15.26:0/383096403 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbe98013cf0 con 0x7fbea8138d80 2023-10-01T08:01:19.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.383+0000 7fbe9ffff700 1 -- 172.21.15.26:0/383096403 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbe9803fd90 con 0x7fbea8138d80 2023-10-01T08:01:19.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.387+0000 7fbe9ffff700 1 -- 172.21.15.26:0/383096403 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe98011350 con 0x7fbea8138d80 2023-10-01T08:01:19.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.477+0000 7f97f2f90700 1 -- 172.21.15.26:0/779914524 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f97ec09c710 con 0x7f97ec09e000 2023-10-01T08:01:19.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.478+0000 7f97e97fa700 1 -- 172.21.15.26:0/779914524 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f97d8011350 con 0x7f97ec09e000 2023-10-01T08:01:19.479 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:19.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.480+0000 7f97f2f90700 1 -- 172.21.15.26:0/779914524 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97ec09e000 msgr2=0x7f97ec1a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:19.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.480+0000 7f97f2f90700 1 --2- 172.21.15.26:0/779914524 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97ec09e000 0x7f97ec1a57f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f97d800ebe0 tx=0x7f97d800eef0 comp rx=0 tx=0).stop 2023-10-01T08:01:19.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.480+0000 7f97f2f90700 1 -- 172.21.15.26:0/779914524 shutdown_connections 2023-10-01T08:01:19.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.480+0000 7f97f2f90700 1 --2- 172.21.15.26:0/779914524 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97ec09e410 0x7f97ec1c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:19.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.480+0000 7f97f2f90700 1 --2- 172.21.15.26:0/779914524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97ec09d6f0 0x7f97ec1a52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:19.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.480+0000 7f97f2f90700 1 --2- 172.21.15.26:0/779914524 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97ec09e000 0x7f97ec1a57f0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:19.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.480+0000 7f97f2f90700 1 -- 172.21.15.26:0/779914524 >> 172.21.15.26:0/779914524 conn(0x7f97ec066f50 msgr2=0x7f97ec06f350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:19.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.480+0000 7f97f2f90700 1 -- 172.21.15.26:0/779914524 shutdown_connections 2023-10-01T08:01:19.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.480+0000 7f97f2f90700 1 -- 172.21.15.26:0/779914524 wait complete. 2023-10-01T08:01:19.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:19.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.592+0000 7fbeae155700 1 -- 172.21.15.26:0/383096403 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbea80747f0 con 0x7fbea8138d80 2023-10-01T08:01:19.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.592+0000 7f085a674700 1 -- 172.21.15.26:0/1439390934 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f085409c700 con 0x7f085409d6f0 2023-10-01T08:01:19.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.592+0000 7fbe9ffff700 1 -- 172.21.15.26:0/383096403 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbe98017070 con 0x7fbea8138d80 2023-10-01T08:01:19.593 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:19.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.592+0000 7f0850ff9700 1 -- 172.21.15.26:0/1439390934 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0844021020 con 0x7f085409d6f0 2023-10-01T08:01:19.594 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:19.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.595+0000 7f085a674700 1 -- 172.21.15.26:0/1439390934 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f085409d6f0 msgr2=0x7f085411ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:19.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.595+0000 7f085a674700 1 --2- 172.21.15.26:0/1439390934 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f085409d6f0 0x7f085411ddc0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f084400e930 tx=0x7f084400ec40 comp rx=0 tx=0).stop 2023-10-01T08:01:19.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.595+0000 7fbeae155700 1 -- 172.21.15.26:0/383096403 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbea8138d80 msgr2=0x7fbea8134260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:19.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.595+0000 7fbeae155700 1 --2- 172.21.15.26:0/383096403 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbea8138d80 0x7fbea8134260 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fbea809ff90 tx=0x7fbe9800eb30 comp rx=0 tx=0).stop 2023-10-01T08:01:19.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.595+0000 7f085a674700 1 -- 172.21.15.26:0/1439390934 shutdown_connections 2023-10-01T08:01:19.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.595+0000 7f085a674700 1 --2- 172.21.15.26:0/1439390934 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f085409e410 0x7f085411e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:19.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.595+0000 7f085a674700 1 --2- 172.21.15.26:0/1439390934 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f085409d6f0 0x7f085411ddc0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:19.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.595+0000 7f085a674700 1 --2- 172.21.15.26:0/1439390934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f085409e000 0x7f085411e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:19.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.595+0000 7f085a674700 1 -- 172.21.15.26:0/1439390934 >> 172.21.15.26:0/1439390934 conn(0x7f0854066f50 msgr2=0x7f0854130800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:19.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.595+0000 7fbeae155700 1 -- 172.21.15.26:0/383096403 shutdown_connections 2023-10-01T08:01:19.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.595+0000 7fbeae155700 1 --2- 172.21.15.26:0/383096403 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbea8138d80 0x7fbea8134260 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:19.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.595+0000 7fbeae155700 1 --2- 172.21.15.26:0/383096403 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbea809d630 0x7fbea81337e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:19.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.595+0000 7fbeae155700 1 --2- 172.21.15.26:0/383096403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbea80a0a30 0x7fbea8133d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:19.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.595+0000 7fbeae155700 1 -- 172.21.15.26:0/383096403 >> 172.21.15.26:0/383096403 conn(0x7fbea80a3050 msgr2=0x7fbea80a6960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:19.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.595+0000 7f085a674700 1 -- 172.21.15.26:0/1439390934 shutdown_connections 2023-10-01T08:01:19.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.595+0000 7f085a674700 1 -- 172.21.15.26:0/1439390934 wait complete. 2023-10-01T08:01:19.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.595+0000 7fbeae155700 1 -- 172.21.15.26:0/383096403 shutdown_connections 2023-10-01T08:01:19.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:19.595+0000 7fbeae155700 1 -- 172.21.15.26:0/383096403 wait complete. 2023-10-01T08:01:19.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:19.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:19.940 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:20.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.086+0000 7f2f4525b700 1 Processor -- start 2023-10-01T08:01:20.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.086+0000 7f2f4525b700 1 -- start start 2023-10-01T08:01:20.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.086+0000 7f2f4525b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2f40133a80 0x7f2f40133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:20.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.086+0000 7f2f4525b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f40130a70 0x7f2f4013b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:20.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.086+0000 7f2f4525b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f4006bc00 con 0x7f2f4012ff20 2023-10-01T08:01:20.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.086+0000 7f2f4525b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f4006c570 con 0x7f2f40133a80 2023-10-01T08:01:20.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.086+0000 7f2f4525b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f400a0040 con 0x7f2f40130a70 2023-10-01T08:01:20.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.087+0000 7f2f3f59e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f40130a70 0x7f2f4013b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:20.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.087+0000 7f2f3ed9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2f40133a80 0x7f2f40133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:20.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.087+0000 7f2f3f59e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f40130a70 0x7f2f4013b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38032/0 (socket says 172.21.15.26:38032) 2023-10-01T08:01:20.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.087+0000 7f2f3f59e700 1 -- 172.21.15.26:0/609093133 learned_addr learned my addr 172.21.15.26:0/609093133 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:20.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.087+0000 7f2f3ed9d700 1 -- 172.21.15.26:0/609093133 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f40130a70 msgr2=0x7f2f4013b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:20.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.087+0000 7f2f3ed9d700 1 --2- 172.21.15.26:0/609093133 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f40130a70 0x7f2f4013b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:20.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.087+0000 7f2f3ed9d700 1 -- 172.21.15.26:0/609093133 >> v1:172.21.15.26:6789/0 conn(0x7f2f4012ff20 legacy=0x7f2f40130360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:20.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.087+0000 7f2f3ed9d700 1 -- 172.21.15.26:0/609093133 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f40133860 con 0x7f2f40133a80 2023-10-01T08:01:20.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.087+0000 7f2f3f59e700 1 --2- 172.21.15.26:0/609093133 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f40130a70 0x7f2f4013b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:20.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.087+0000 7f2f3ed9d700 1 --2- 172.21.15.26:0/609093133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f40133a80 0x7f2f40133e50 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f2f30009840 tx=0x7f2f30009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e80ea788943cae server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:20.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.087+0000 7f2f3dd9b700 1 -- 172.21.15.26:0/609093133 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f30011830 con 0x7f2f40133a80 2023-10-01T08:01:20.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.087+0000 7f2f3dd9b700 1 -- 172.21.15.26:0/609093133 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f30011990 con 0x7f2f40133a80 2023-10-01T08:01:20.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.087+0000 7f2f3dd9b700 1 -- 172.21.15.26:0/609093133 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f30011d20 con 0x7f2f40133a80 2023-10-01T08:01:20.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.088+0000 7f2f4525b700 1 -- 172.21.15.26:0/609093133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f40133a80 msgr2=0x7f2f40133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:20.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.088+0000 7f2f4525b700 1 --2- 172.21.15.26:0/609093133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f40133a80 0x7f2f40133e50 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f2f30009840 tx=0x7f2f30009b50 comp rx=0 tx=0).stop 2023-10-01T08:01:20.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.088+0000 7f2f4525b700 1 -- 172.21.15.26:0/609093133 shutdown_connections 2023-10-01T08:01:20.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.088+0000 7f2f4525b700 1 --2- 172.21.15.26:0/609093133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f40133a80 0x7f2f40133e50 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:20.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.088+0000 7f2f4525b700 1 --2- 172.21.15.26:0/609093133 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f40130a70 0x7f2f4013b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:20.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.088+0000 7f2f4525b700 1 -- 172.21.15.26:0/609093133 >> 172.21.15.26:0/609093133 conn(0x7f2f400a4210 msgr2=0x7f2f400a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:20.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.088+0000 7f2f4525b700 1 -- 172.21.15.26:0/609093133 shutdown_connections 2023-10-01T08:01:20.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.088+0000 7f2f4525b700 1 -- 172.21.15.26:0/609093133 wait complete. 2023-10-01T08:01:20.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.089+0000 7f2f4525b700 1 Processor -- start 2023-10-01T08:01:20.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.089+0000 7f2f4525b700 1 -- start start 2023-10-01T08:01:20.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.090+0000 7f2f4525b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f4012ff20 0x7f2f4009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:20.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.090+0000 7f2f4525b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f40130a70 0x7f2f4009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:20.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.090+0000 7f2f4525b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f40133a80 0x7f2f4009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:20.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.090+0000 7f2f4525b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4011ed70 con 0x7f2f40133a80 2023-10-01T08:01:20.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.090+0000 7f2f4525b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4011ea90 con 0x7f2f40130a70 2023-10-01T08:01:20.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.090+0000 7f2f4525b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f40120090 con 0x7f2f4012ff20 2023-10-01T08:01:20.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.090+0000 7f2f3f59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f40133a80 0x7f2f4009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:20.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.090+0000 7f2f3e59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f40130a70 0x7f2f4009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:20.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.090+0000 7f2f3ed9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f4012ff20 0x7f2f4009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:20.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.090+0000 7f2f3f59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f40133a80 0x7f2f4009cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44844/0 (socket says 172.21.15.26:44844) 2023-10-01T08:01:20.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.090+0000 7f2f3f59e700 1 -- 172.21.15.26:0/1065230452 learned_addr learned my addr 172.21.15.26:0/1065230452 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:20.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.090+0000 7f2f3e59c700 1 -- 172.21.15.26:0/1065230452 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f4012ff20 msgr2=0x7f2f4009c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:20.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.090+0000 7f2f3e59c700 1 --2- 172.21.15.26:0/1065230452 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f4012ff20 0x7f2f4009c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:20.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.090+0000 7f2f3e59c700 1 -- 172.21.15.26:0/1065230452 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f40133a80 msgr2=0x7f2f4009cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:20.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.090+0000 7f2f3e59c700 1 --2- 172.21.15.26:0/1065230452 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f40133a80 0x7f2f4009cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:20.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.090+0000 7f2f3e59c700 1 -- 172.21.15.26:0/1065230452 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f38009b30 con 0x7f2f40130a70 2023-10-01T08:01:20.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.090+0000 7f2f3f59e700 1 --2- 172.21.15.26:0/1065230452 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f40133a80 0x7f2f4009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:20.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.091+0000 7f2f3e59c700 1 --2- 172.21.15.26:0/1065230452 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f40130a70 0x7f2f4009c9c0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f2f3400c450 tx=0x7f2f3400c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:20.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.091+0000 7f2f277fe700 1 -- 172.21.15.26:0/1065230452 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f340052d0 con 0x7f2f40130a70 2023-10-01T08:01:20.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.091+0000 7f2f277fe700 1 -- 172.21.15.26:0/1065230452 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f34005430 con 0x7f2f40130a70 2023-10-01T08:01:20.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.091+0000 7f2f4525b700 1 -- 172.21.15.26:0/1065230452 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f300094a0 con 0x7f2f40130a70 2023-10-01T08:01:20.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.091+0000 7f2f277fe700 1 -- 172.21.15.26:0/1065230452 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f340038c0 con 0x7f2f40130a70 2023-10-01T08:01:20.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.091+0000 7f2f4525b700 1 -- 172.21.15.26:0/1065230452 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f4012d300 con 0x7f2f40130a70 2023-10-01T08:01:20.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.091+0000 7f2f277fe700 1 -- 172.21.15.26:0/1065230452 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2f34003a20 con 0x7f2f40130a70 2023-10-01T08:01:20.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.092+0000 7f2f277fe700 1 -- 172.21.15.26:0/1065230452 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2f3403e9b0 con 0x7f2f40130a70 2023-10-01T08:01:20.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.092+0000 7f2f4525b700 1 -- 172.21.15.26:0/1065230452 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f401201d0 con 0x7f2f40130a70 2023-10-01T08:01:20.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.097+0000 7f2f277fe700 1 -- 172.21.15.26:0/1065230452 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2f34017020 con 0x7f2f40130a70 2023-10-01T08:01:20.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.301+0000 7f2f4525b700 1 -- 172.21.15.26:0/1065230452 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2f40074ea0 con 0x7f2f40130a70 2023-10-01T08:01:20.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.301+0000 7f2f277fe700 1 -- 172.21.15.26:0/1065230452 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2f34011590 con 0x7f2f40130a70 2023-10-01T08:01:20.302 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:20.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.304+0000 7f2f4525b700 1 -- 172.21.15.26:0/1065230452 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f40130a70 msgr2=0x7f2f4009c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:20.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.304+0000 7f2f4525b700 1 --2- 172.21.15.26:0/1065230452 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f40130a70 0x7f2f4009c9c0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f2f3400c450 tx=0x7f2f3400c760 comp rx=0 tx=0).stop 2023-10-01T08:01:20.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.304+0000 7f2f4525b700 1 -- 172.21.15.26:0/1065230452 shutdown_connections 2023-10-01T08:01:20.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.304+0000 7f2f4525b700 1 --2- 172.21.15.26:0/1065230452 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f40133a80 0x7f2f4009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:20.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.304+0000 7f2f4525b700 1 --2- 172.21.15.26:0/1065230452 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2f4012ff20 0x7f2f4009c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:20.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.304+0000 7f2f4525b700 1 --2- 172.21.15.26:0/1065230452 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2f40130a70 0x7f2f4009c9c0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:20.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.304+0000 7f2f4525b700 1 -- 172.21.15.26:0/1065230452 >> 172.21.15.26:0/1065230452 conn(0x7f2f400a4210 msgr2=0x7f2f4009e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:20.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.304+0000 7f2f4525b700 1 -- 172.21.15.26:0/1065230452 shutdown_connections 2023-10-01T08:01:20.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.304+0000 7f2f4525b700 1 -- 172.21.15.26:0/1065230452 wait complete. 2023-10-01T08:01:20.318 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:20.496 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:20.612 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:20.612 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:20.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.643+0000 7fc8e3450700 1 Processor -- start 2023-10-01T08:01:20.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.644+0000 7fc8e3450700 1 -- start start 2023-10-01T08:01:20.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.644+0000 7fc8e3450700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc8dc1338a0 0x7fc8dc133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:20.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.644+0000 7fc8e3450700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc8dc09e930 0x7fc8dc13b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:20.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.645+0000 7fc8e3450700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8dc06ef30 con 0x7fc8dc09de50 2023-10-01T08:01:20.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.645+0000 7fc8e3450700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8dc06fef0 con 0x7fc8dc1338a0 2023-10-01T08:01:20.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.645+0000 7fc8e3450700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc1334b0 con 0x7fc8dc09e930 2023-10-01T08:01:20.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.645+0000 7fc8e11ec700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc8dc1338a0 0x7fc8dc133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:20.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.645+0000 7fc8e11ec700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc8dc1338a0 0x7fc8dc133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44846/0 (socket says 172.21.15.26:44846) 2023-10-01T08:01:20.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.645+0000 7fc8e11ec700 1 -- 172.21.15.26:0/3736507797 learned_addr learned my addr 172.21.15.26:0/3736507797 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:20.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.645+0000 7fc8e19ed700 1 --2- 172.21.15.26:0/3736507797 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc8dc09e930 0x7fc8dc13b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:20.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.645+0000 7fc8e11ec700 1 -- 172.21.15.26:0/3736507797 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc8dc09e930 msgr2=0x7fc8dc13b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:20.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.645+0000 7fc8e11ec700 1 --2- 172.21.15.26:0/3736507797 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc8dc09e930 0x7fc8dc13b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:20.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.645+0000 7fc8e11ec700 1 -- 172.21.15.26:0/3736507797 >> v1:172.21.15.26:6789/0 conn(0x7fc8dc09de50 legacy=0x7fc8dc09e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:20.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.645+0000 7fc8e11ec700 1 -- 172.21.15.26:0/3736507797 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8dc06fc30 con 0x7fc8dc1338a0 2023-10-01T08:01:20.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.645+0000 7fc8e11ec700 1 --2- 172.21.15.26:0/3736507797 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8dc1338a0 0x7fc8dc133c70 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80098f0 tx=0x7fc8d8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e566dec1f3d43a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:20.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.646+0000 7fc8d3fff700 1 -- 172.21.15.26:0/3736507797 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d8014e90 con 0x7fc8dc1338a0 2023-10-01T08:01:20.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.646+0000 7fc8d3fff700 1 -- 172.21.15.26:0/3736507797 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d801c440 con 0x7fc8dc1338a0 2023-10-01T08:01:20.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.646+0000 7fc8d3fff700 1 -- 172.21.15.26:0/3736507797 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d801c7d0 con 0x7fc8dc1338a0 2023-10-01T08:01:20.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.647+0000 7fc8e3450700 1 -- 172.21.15.26:0/3736507797 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8dc1338a0 msgr2=0x7fc8dc133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:20.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.647+0000 7fc8e3450700 1 --2- 172.21.15.26:0/3736507797 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8dc1338a0 0x7fc8dc133c70 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80098f0 tx=0x7fc8d8009c00 comp rx=0 tx=0).stop 2023-10-01T08:01:20.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.647+0000 7fc8e3450700 1 -- 172.21.15.26:0/3736507797 shutdown_connections 2023-10-01T08:01:20.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.647+0000 7fc8e3450700 1 --2- 172.21.15.26:0/3736507797 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc8dc09e930 0x7fc8dc13b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:20.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.647+0000 7fc8e3450700 1 --2- 172.21.15.26:0/3736507797 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8dc1338a0 0x7fc8dc133c70 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:20.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.647+0000 7fc8e3450700 1 -- 172.21.15.26:0/3736507797 >> 172.21.15.26:0/3736507797 conn(0x7fc8dc0a2aa0 msgr2=0x7fc8dc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:20.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.647+0000 7fc8e3450700 1 -- 172.21.15.26:0/3736507797 shutdown_connections 2023-10-01T08:01:20.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.647+0000 7fc8e3450700 1 -- 172.21.15.26:0/3736507797 wait complete. 2023-10-01T08:01:20.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.648+0000 7fc8e3450700 1 Processor -- start 2023-10-01T08:01:20.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.648+0000 7fc8e3450700 1 -- start start 2023-10-01T08:01:20.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.649+0000 7fc8e3450700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc8dc09de50 0x7fc8dc119d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:20.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.649+0000 7fc8e3450700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc8dc09e930 0x7fc8dc11a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:20.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.649+0000 7fc8e3450700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8dc1338a0 0x7fc8dc11a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:20.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.649+0000 7fc8e3450700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc11d750 con 0x7fc8dc1338a0 2023-10-01T08:01:20.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.649+0000 7fc8e3450700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc0a0db0 con 0x7fc8dc09e930 2023-10-01T08:01:20.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.649+0000 7fc8e3450700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc06f640 con 0x7fc8dc09de50 2023-10-01T08:01:20.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.649+0000 7fc8e09eb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc8dc09e930 0x7fc8dc11a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:20.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.649+0000 7fc8e19ed700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8dc1338a0 0x7fc8dc11a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:20.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.649+0000 7fc8e09eb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc8dc09e930 0x7fc8dc11a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38050/0 (socket says 172.21.15.26:38050) 2023-10-01T08:01:20.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.649+0000 7fc8e09eb700 1 -- 172.21.15.26:0/3322590048 learned_addr learned my addr 172.21.15.26:0/3322590048 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:20.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.650+0000 7fc8e19ed700 1 -- 172.21.15.26:0/3322590048 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc8dc09de50 msgr2=0x7fc8dc119d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:20.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.650+0000 7fc8e19ed700 1 --2- 172.21.15.26:0/3322590048 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc8dc09de50 0x7fc8dc119d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:20.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.650+0000 7fc8e19ed700 1 -- 172.21.15.26:0/3322590048 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc8dc09e930 msgr2=0x7fc8dc11a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:20.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.650+0000 7fc8e19ed700 1 --2- 172.21.15.26:0/3322590048 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc8dc09e930 0x7fc8dc11a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:20.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.650+0000 7fc8e19ed700 1 -- 172.21.15.26:0/3322590048 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d8009550 con 0x7fc8dc1338a0 2023-10-01T08:01:20.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.650+0000 7fc8e19ed700 1 --2- 172.21.15.26:0/3322590048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8dc1338a0 0x7fc8dc11a7a0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fc8d400efc0 tx=0x7fc8d400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:20.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.650+0000 7fc8d1ffb700 1 -- 172.21.15.26:0/3322590048 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d400cd40 con 0x7fc8dc1338a0 2023-10-01T08:01:20.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.650+0000 7fc8d1ffb700 1 -- 172.21.15.26:0/3322590048 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d400f040 con 0x7fc8dc1338a0 2023-10-01T08:01:20.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.650+0000 7fc8d1ffb700 1 -- 172.21.15.26:0/3322590048 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d40146c0 con 0x7fc8dc1338a0 2023-10-01T08:01:20.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.650+0000 7fc8e3450700 1 -- 172.21.15.26:0/3322590048 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8dc11d350 con 0x7fc8dc1338a0 2023-10-01T08:01:20.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.651+0000 7fc8e3450700 1 -- 172.21.15.26:0/3322590048 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8dc11c0d0 con 0x7fc8dc1338a0 2023-10-01T08:01:20.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.652+0000 7fc8d1ffb700 1 -- 172.21.15.26:0/3322590048 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc8d4014820 con 0x7fc8dc1338a0 2023-10-01T08:01:20.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.652+0000 7fc8e3450700 1 -- 172.21.15.26:0/3322590048 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8dc06ea40 con 0x7fc8dc1338a0 2023-10-01T08:01:20.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.652+0000 7fc8d1ffb700 1 -- 172.21.15.26:0/3322590048 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc8d4040290 con 0x7fc8dc1338a0 2023-10-01T08:01:20.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.661+0000 7fc8d1ffb700 1 -- 172.21.15.26:0/3322590048 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc8d4007900 con 0x7fc8dc1338a0 2023-10-01T08:01:20.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.754+0000 7f5751905700 1 Processor -- start 2023-10-01T08:01:20.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.754+0000 7f5751905700 1 -- start start 2023-10-01T08:01:20.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.755+0000 7f5751905700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f574c0a0a30 0x7f574c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:20.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.755+0000 7f5751905700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f574c0a1340 0x7f574c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:20.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.755+0000 7f5751905700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f574c09edd0 con 0x7f574c133fa0 2023-10-01T08:01:20.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.755+0000 7f5751905700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f574c09e1f0 con 0x7f574c0a0a30 2023-10-01T08:01:20.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.755+0000 7f5751905700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f574c09dc50 con 0x7f574c0a1340 2023-10-01T08:01:20.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.755+0000 7f5743fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f574c0a1340 0x7f574c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:20.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.755+0000 7f574affd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f574c0a0a30 0x7f574c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:20.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.755+0000 7f5743fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f574c0a1340 0x7f574c133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37620/0 (socket says 172.21.15.26:37620) 2023-10-01T08:01:20.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.755+0000 7f5743fff700 1 -- 172.21.15.26:0/4078057912 learned_addr learned my addr 172.21.15.26:0/4078057912 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:20.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.755+0000 7f574b7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f574c133fa0 0x7f574c13ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39216/0 (socket says 172.21.15.26:39216) 2023-10-01T08:01:20.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.756+0000 7f574affd700 1 -- 172.21.15.26:0/4078057912 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f574c0a1340 msgr2=0x7f574c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:20.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.756+0000 7f574affd700 1 --2- 172.21.15.26:0/4078057912 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f574c0a1340 0x7f574c133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:20.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.756+0000 7f574affd700 1 -- 172.21.15.26:0/4078057912 >> v1:172.21.15.26:6789/0 conn(0x7f574c133fa0 legacy=0x7f574c13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:20.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.756+0000 7f574affd700 1 -- 172.21.15.26:0/4078057912 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f574c0a1fe0 con 0x7f574c0a0a30 2023-10-01T08:01:20.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.756+0000 7f574a7fc700 1 -- 172.21.15.26:0/4078057912 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499119159 0 0) 0x7f574c09edd0 con 0x7f574c133fa0 2023-10-01T08:01:20.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.756+0000 7f574affd700 1 --2- 172.21.15.26:0/4078057912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f574c0a0a30 0x7f574c0a0e00 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f573c009840 tx=0x7f573c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32367eb5669837c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:20.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.756+0000 7f574a7fc700 1 -- 172.21.15.26:0/4078057912 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c011830 con 0x7f574c0a0a30 2023-10-01T08:01:20.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.756+0000 7f574a7fc700 1 -- 172.21.15.26:0/4078057912 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573c011990 con 0x7f574c0a0a30 2023-10-01T08:01:20.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.756+0000 7f574a7fc700 1 -- 172.21.15.26:0/4078057912 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c011d20 con 0x7f574c0a0a30 2023-10-01T08:01:20.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.757+0000 7f8fdc5df700 1 Processor -- start 2023-10-01T08:01:20.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.757+0000 7f8fdc5df700 1 -- start start 2023-10-01T08:01:20.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.757+0000 7f5751905700 1 -- 172.21.15.26:0/4078057912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f574c0a0a30 msgr2=0x7f574c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:20.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.757+0000 7f5751905700 1 --2- 172.21.15.26:0/4078057912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f574c0a0a30 0x7f574c0a0e00 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f573c009840 tx=0x7f573c009b50 comp rx=0 tx=0).stop 2023-10-01T08:01:20.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.757+0000 7f5751905700 1 -- 172.21.15.26:0/4078057912 shutdown_connections 2023-10-01T08:01:20.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.757+0000 7f5751905700 1 --2- 172.21.15.26:0/4078057912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f574c0a0a30 0x7f574c0a0e00 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:20.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.757+0000 7f5751905700 1 --2- 172.21.15.26:0/4078057912 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f574c0a1340 0x7f574c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:20.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.757+0000 7f5751905700 1 -- 172.21.15.26:0/4078057912 >> 172.21.15.26:0/4078057912 conn(0x7f574c0a6550 msgr2=0x7f574c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:20.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.757+0000 7f8fdc5df700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8fd409e1d0 0x7f8fd4135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:20.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.758+0000 7f8fdc5df700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fd4135e50 0x7f8fd4138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:20.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.758+0000 7f8fdc5df700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd409f130 con 0x7f8fd409d6f0 2023-10-01T08:01:20.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.758+0000 7f8fdc5df700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd409f520 con 0x7f8fd409e1d0 2023-10-01T08:01:20.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.758+0000 7f8fdc5df700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd409e930 con 0x7f8fd4135e50 2023-10-01T08:01:20.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.758+0000 7f5751905700 1 -- 172.21.15.26:0/4078057912 shutdown_connections 2023-10-01T08:01:20.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.758+0000 7f5751905700 1 -- 172.21.15.26:0/4078057912 wait complete. 2023-10-01T08:01:20.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.758+0000 7f8fd9b7a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8fd409e1d0 0x7f8fd4135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:20.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.758+0000 7f8fdab7c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fd4135e50 0x7f8fd4138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:20.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.758+0000 7f8fd9b7a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8fd409e1d0 0x7f8fd4135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44882/0 (socket says 172.21.15.26:44882) 2023-10-01T08:01:20.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.758+0000 7f8fd9b7a700 1 -- 172.21.15.26:0/2466707427 learned_addr learned my addr 172.21.15.26:0/2466707427 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:20.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.758+0000 7f8fd9b7a700 1 -- 172.21.15.26:0/2466707427 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fd4135e50 msgr2=0x7f8fd4138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:20.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.758+0000 7f8fd9b7a700 1 --2- 172.21.15.26:0/2466707427 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fd4135e50 0x7f8fd4138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:20.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.758+0000 7f8fd9b7a700 1 -- 172.21.15.26:0/2466707427 >> v1:172.21.15.26:6789/0 conn(0x7f8fd409d6f0 legacy=0x7f8fd409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:20.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.758+0000 7f8fd9b7a700 1 -- 172.21.15.26:0/2466707427 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd409b2d0 con 0x7f8fd409e1d0 2023-10-01T08:01:20.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.758+0000 7f8fd9b7a700 1 --2- 172.21.15.26:0/2466707427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8fd409e1d0 0x7f8fd4135910 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f8fc400b9a0 tx=0x7f8fc400bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff2cae29a034ea4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:20.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.758+0000 7f8fd9379700 1 -- 172.21.15.26:0/2466707427 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4004230 con 0x7f8fd409e1d0 2023-10-01T08:01:20.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.758+0000 7f8fd9379700 1 -- 172.21.15.26:0/2466707427 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc4004390 con 0x7f8fd409e1d0 2023-10-01T08:01:20.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.759+0000 7f8fd9379700 1 -- 172.21.15.26:0/2466707427 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc400c860 con 0x7f8fd409e1d0 2023-10-01T08:01:20.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.759+0000 7f5751905700 1 Processor -- start 2023-10-01T08:01:20.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.759+0000 7f5751905700 1 -- start start 2023-10-01T08:01:20.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.759+0000 7f8fdc5df700 1 -- 172.21.15.26:0/2466707427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8fd409e1d0 msgr2=0x7f8fd4135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:20.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.759+0000 7f8fdc5df700 1 --2- 172.21.15.26:0/2466707427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8fd409e1d0 0x7f8fd4135910 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f8fc400b9a0 tx=0x7f8fc400bcb0 comp rx=0 tx=0).stop 2023-10-01T08:01:20.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.759+0000 7f8fdc5df700 1 -- 172.21.15.26:0/2466707427 shutdown_connections 2023-10-01T08:01:20.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.759+0000 7f8fdc5df700 1 --2- 172.21.15.26:0/2466707427 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fd4135e50 0x7f8fd4138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:20.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.759+0000 7f8fdc5df700 1 --2- 172.21.15.26:0/2466707427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8fd409e1d0 0x7f8fd4135910 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:20.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.759+0000 7f8fdc5df700 1 -- 172.21.15.26:0/2466707427 >> 172.21.15.26:0/2466707427 conn(0x7f8fd4066f50 msgr2=0x7f8fd409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:20.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.759+0000 7f8fdc5df700 1 -- 172.21.15.26:0/2466707427 shutdown_connections 2023-10-01T08:01:20.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.760+0000 7f5751905700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f574c0a0a30 0x7f574c122790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:20.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.760+0000 7f5751905700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f574c0a1340 0x7f574c122cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:20.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.760+0000 7f5751905700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f574c133fa0 0x7f574c123210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:20.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.760+0000 7f5751905700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f574c124520 con 0x7f574c133fa0 2023-10-01T08:01:20.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.760+0000 7f5751905700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f574c133320 con 0x7f574c0a0a30 2023-10-01T08:01:20.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.760+0000 7f5751905700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f574c1262b0 con 0x7f574c0a1340 2023-10-01T08:01:20.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.760+0000 7f574b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f574c133fa0 0x7f574c123210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:20.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.760+0000 7f574affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f574c0a0a30 0x7f574c122790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:20.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.760+0000 7f574b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f574c133fa0 0x7f574c123210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44898/0 (socket says 172.21.15.26:44898) 2023-10-01T08:01:20.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.760+0000 7f574affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f574c0a0a30 0x7f574c122790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38076/0 (socket says 172.21.15.26:38076) 2023-10-01T08:01:20.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.760+0000 7f574b7fe700 1 -- 172.21.15.26:0/2609420089 learned_addr learned my addr 172.21.15.26:0/2609420089 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:20.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.760+0000 7f5743fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f574c0a1340 0x7f574c122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:20.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.760+0000 7f574b7fe700 1 -- 172.21.15.26:0/2609420089 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f574c0a1340 msgr2=0x7f574c122cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:20.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.760+0000 7f574b7fe700 1 --2- 172.21.15.26:0/2609420089 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f574c0a1340 0x7f574c122cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:20.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.760+0000 7f574b7fe700 1 -- 172.21.15.26:0/2609420089 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f574c0a0a30 msgr2=0x7f574c122790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:20.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.760+0000 7f574b7fe700 1 --2- 172.21.15.26:0/2609420089 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f574c0a0a30 0x7f574c122790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:20.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.760+0000 7f574b7fe700 1 -- 172.21.15.26:0/2609420089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573c0094a0 con 0x7f574c133fa0 2023-10-01T08:01:20.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.760+0000 7f574b7fe700 1 --2- 172.21.15.26:0/2609420089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f574c133fa0 0x7f574c123210 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f574400cc70 tx=0x7f574400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:20.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.761+0000 7f5748ff9700 1 -- 172.21.15.26:0/2609420089 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574400aac0 con 0x7f574c133fa0 2023-10-01T08:01:20.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.761+0000 7f5748ff9700 1 -- 172.21.15.26:0/2609420089 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f574400ac40 con 0x7f574c133fa0 2023-10-01T08:01:20.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.761+0000 7f5751905700 1 -- 172.21.15.26:0/2609420089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f574c0a5220 con 0x7f574c133fa0 2023-10-01T08:01:20.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.761+0000 7f5748ff9700 1 -- 172.21.15.26:0/2609420089 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57440070d0 con 0x7f574c133fa0 2023-10-01T08:01:20.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.761+0000 7f5751905700 1 -- 172.21.15.26:0/2609420089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f574c125fd0 con 0x7f574c133fa0 2023-10-01T08:01:20.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.760+0000 7f8fdc5df700 1 -- 172.21.15.26:0/2466707427 wait complete. 2023-10-01T08:01:20.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.761+0000 7f8fdc5df700 1 Processor -- start 2023-10-01T08:01:20.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.761+0000 7f8fdc5df700 1 -- start start 2023-10-01T08:01:20.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.762+0000 7f8fdc5df700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fd409d6f0 0x7f8fd41d50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:20.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.762+0000 7f8fdc5df700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8fd409e1d0 0x7f8fd41d5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:20.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.762+0000 7f8fdc5df700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fd4135e50 0x7f8fd41d5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:20.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.762+0000 7f8fdc5df700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd4132f40 con 0x7f8fd409e1d0 2023-10-01T08:01:20.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.762+0000 7f8fdc5df700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd40a1d20 con 0x7f8fd4135e50 2023-10-01T08:01:20.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.762+0000 7f8fdc5df700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd409c700 con 0x7f8fd409d6f0 2023-10-01T08:01:20.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.762+0000 7f5748ff9700 1 -- 172.21.15.26:0/2609420089 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5744007250 con 0x7f574c133fa0 2023-10-01T08:01:20.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.762+0000 7f8fda37b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fd409d6f0 0x7f8fd41d50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:20.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.762+0000 7f8fdab7c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fd4135e50 0x7f8fd41d5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:20.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.762+0000 7f8fda37b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fd409d6f0 0x7f8fd41d50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37636/0 (socket says 172.21.15.26:37636) 2023-10-01T08:01:20.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.762+0000 7f8fda37b700 1 -- 172.21.15.26:0/1993141321 learned_addr learned my addr 172.21.15.26:0/1993141321 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:20.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.762+0000 7f8fdab7c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fd4135e50 0x7f8fd41d5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38080/0 (socket says 172.21.15.26:38080) 2023-10-01T08:01:20.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.762+0000 7f8fd9b7a700 1 --2- 172.21.15.26:0/1993141321 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8fd409e1d0 0x7f8fd41d5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:20.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.762+0000 7f5748ff9700 1 -- 172.21.15.26:0/2609420089 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f574403f5d0 con 0x7f574c133fa0 2023-10-01T08:01:20.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.762+0000 7f5751905700 1 -- 172.21.15.26:0/2609420089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57300052e0 con 0x7f574c133fa0 2023-10-01T08:01:20.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.762+0000 7f8fda37b700 1 -- 172.21.15.26:0/1993141321 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fd4135e50 msgr2=0x7f8fd41d5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:20.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.762+0000 7f8fda37b700 1 --2- 172.21.15.26:0/1993141321 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fd4135e50 0x7f8fd41d5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:20.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.762+0000 7f8fda37b700 1 -- 172.21.15.26:0/1993141321 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8fd409e1d0 msgr2=0x7f8fd41d5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:20.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.762+0000 7f8fda37b700 1 --2- 172.21.15.26:0/1993141321 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8fd409e1d0 0x7f8fd41d5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:20.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.762+0000 7f8fda37b700 1 -- 172.21.15.26:0/1993141321 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc400b600 con 0x7f8fd409d6f0 2023-10-01T08:01:20.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.762+0000 7f8fdab7c700 1 --2- 172.21.15.26:0/1993141321 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fd4135e50 0x7f8fd41d5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:20.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.763+0000 7f8fda37b700 1 --2- 172.21.15.26:0/1993141321 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fd409d6f0 0x7f8fd41d50d0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000b470 tx=0x7f8fd000b780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:20.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.763+0000 7f8fcaffd700 1 -- 172.21.15.26:0/1993141321 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0011830 con 0x7f8fd409d6f0 2023-10-01T08:01:20.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.763+0000 7f8fcaffd700 1 -- 172.21.15.26:0/1993141321 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd00119b0 con 0x7f8fd409d6f0 2023-10-01T08:01:20.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.763+0000 7f8fdc5df700 1 -- 172.21.15.26:0/1993141321 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd4132c60 con 0x7f8fd409d6f0 2023-10-01T08:01:20.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.763+0000 7f8fcaffd700 1 -- 172.21.15.26:0/1993141321 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0011d60 con 0x7f8fd409d6f0 2023-10-01T08:01:20.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.763+0000 7f8fdc5df700 1 -- 172.21.15.26:0/1993141321 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd4131710 con 0x7f8fd409d6f0 2023-10-01T08:01:20.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.764+0000 7f8fcaffd700 1 -- 172.21.15.26:0/1993141321 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8fd001a400 con 0x7f8fd409d6f0 2023-10-01T08:01:20.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.764+0000 7f8fdc5df700 1 -- 172.21.15.26:0/1993141321 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd41352c0 con 0x7f8fd409d6f0 2023-10-01T08:01:20.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.764+0000 7f8fcaffd700 1 -- 172.21.15.26:0/1993141321 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8fd003f6b0 con 0x7f8fd409d6f0 2023-10-01T08:01:20.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.768+0000 7f5748ff9700 1 -- 172.21.15.26:0/2609420089 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5744018070 con 0x7f574c133fa0 2023-10-01T08:01:20.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.769+0000 7f8fcaffd700 1 -- 172.21.15.26:0/1993141321 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8fd000f8d0 con 0x7f8fd409d6f0 2023-10-01T08:01:20.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.893+0000 7fc8e3450700 1 -- 172.21.15.26:0/3322590048 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc8dc074ea0 con 0x7fc8dc1338a0 2023-10-01T08:01:20.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.894+0000 7fc8d1ffb700 1 -- 172.21.15.26:0/3322590048 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc8d4018020 con 0x7fc8dc1338a0 2023-10-01T08:01:20.894 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:20.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.897+0000 7fc8e3450700 1 -- 172.21.15.26:0/3322590048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8dc1338a0 msgr2=0x7fc8dc11a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:20.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.897+0000 7fc8e3450700 1 --2- 172.21.15.26:0/3322590048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8dc1338a0 0x7fc8dc11a7a0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fc8d400efc0 tx=0x7fc8d400c3a0 comp rx=0 tx=0).stop 2023-10-01T08:01:20.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.897+0000 7fc8e3450700 1 -- 172.21.15.26:0/3322590048 shutdown_connections 2023-10-01T08:01:20.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.897+0000 7fc8e3450700 1 --2- 172.21.15.26:0/3322590048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8dc1338a0 0x7fc8dc11a7a0 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:20.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.897+0000 7fc8e3450700 1 --2- 172.21.15.26:0/3322590048 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc8dc09de50 0x7fc8dc119d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:20.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.897+0000 7fc8e3450700 1 --2- 172.21.15.26:0/3322590048 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc8dc09e930 0x7fc8dc11a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:20.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.897+0000 7fc8e3450700 1 -- 172.21.15.26:0/3322590048 >> 172.21.15.26:0/3322590048 conn(0x7fc8dc0a2aa0 msgr2=0x7fc8dc09ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:20.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.897+0000 7fc8e3450700 1 -- 172.21.15.26:0/3322590048 shutdown_connections 2023-10-01T08:01:20.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.897+0000 7fc8e3450700 1 -- 172.21.15.26:0/3322590048 wait complete. 2023-10-01T08:01:20.916 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:20.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.978+0000 7f5751905700 1 -- 172.21.15.26:0/2609420089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5730005590 con 0x7f574c133fa0 2023-10-01T08:01:20.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.978+0000 7f5748ff9700 1 -- 172.21.15.26:0/2609420089 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5744007500 con 0x7f574c133fa0 2023-10-01T08:01:20.979 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:20.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.980+0000 7f5751905700 1 -- 172.21.15.26:0/2609420089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f574c133fa0 msgr2=0x7f574c123210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:20.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.980+0000 7f5751905700 1 --2- 172.21.15.26:0/2609420089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f574c133fa0 0x7f574c123210 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f574400cc70 tx=0x7f574400cf80 comp rx=0 tx=0).stop 2023-10-01T08:01:20.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.980+0000 7f5751905700 1 -- 172.21.15.26:0/2609420089 shutdown_connections 2023-10-01T08:01:20.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.980+0000 7f5751905700 1 --2- 172.21.15.26:0/2609420089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f574c133fa0 0x7f574c123210 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:20.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.980+0000 7f5751905700 1 --2- 172.21.15.26:0/2609420089 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f574c0a0a30 0x7f574c122790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:20.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.980+0000 7f5751905700 1 --2- 172.21.15.26:0/2609420089 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f574c0a1340 0x7f574c122cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:20.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.980+0000 7f5751905700 1 -- 172.21.15.26:0/2609420089 >> 172.21.15.26:0/2609420089 conn(0x7f574c0a6550 msgr2=0x7f574c0a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:20.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.980+0000 7f5751905700 1 -- 172.21.15.26:0/2609420089 shutdown_connections 2023-10-01T08:01:20.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:20.980+0000 7f5751905700 1 -- 172.21.15.26:0/2609420089 wait complete. 2023-10-01T08:01:20.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:21.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.006+0000 7f8fdc5df700 1 -- 172.21.15.26:0/1993141321 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8fd4074ea0 con 0x7f8fd409d6f0 2023-10-01T08:01:21.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.006+0000 7f8fcaffd700 1 -- 172.21.15.26:0/1993141321 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8fd0015030 con 0x7f8fd409d6f0 2023-10-01T08:01:21.007 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:21.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.008+0000 7f8fdc5df700 1 -- 172.21.15.26:0/1993141321 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fd409d6f0 msgr2=0x7f8fd41d50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:21.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.008+0000 7f8fdc5df700 1 --2- 172.21.15.26:0/1993141321 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fd409d6f0 0x7f8fd41d50d0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000b470 tx=0x7f8fd000b780 comp rx=0 tx=0).stop 2023-10-01T08:01:21.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.008+0000 7f8fdc5df700 1 -- 172.21.15.26:0/1993141321 shutdown_connections 2023-10-01T08:01:21.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.008+0000 7f8fdc5df700 1 --2- 172.21.15.26:0/1993141321 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8fd4135e50 0x7f8fd41d5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:21.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.008+0000 7f8fdc5df700 1 --2- 172.21.15.26:0/1993141321 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8fd409d6f0 0x7f8fd41d50d0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:21.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.008+0000 7f8fdc5df700 1 --2- 172.21.15.26:0/1993141321 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8fd409e1d0 0x7f8fd41d5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:21.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.009+0000 7f8fdc5df700 1 -- 172.21.15.26:0/1993141321 >> 172.21.15.26:0/1993141321 conn(0x7f8fd4066f50 msgr2=0x7f8fd406f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:21.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.009+0000 7f8fdc5df700 1 -- 172.21.15.26:0/1993141321 shutdown_connections 2023-10-01T08:01:21.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.009+0000 7f8fdc5df700 1 -- 172.21.15.26:0/1993141321 wait complete. 2023-10-01T08:01:21.023 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:21.319 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:21.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.465+0000 7fab11bdb700 1 Processor -- start 2023-10-01T08:01:21.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.465+0000 7fab11bdb700 1 -- start start 2023-10-01T08:01:21.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.465+0000 7fab11bdb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab0c09d6f0 0x7fab0c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:21.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.465+0000 7fab11bdb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fab0c09e000 0x7fab0c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:21.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.465+0000 7fab11bdb700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab0c09b120 con 0x7fab0c09e410 2023-10-01T08:01:21.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.465+0000 7fab11bdb700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab0c06b460 con 0x7fab0c09e000 2023-10-01T08:01:21.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.465+0000 7fab11bdb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab0c09a7e0 con 0x7fab0c09d6f0 2023-10-01T08:01:21.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.466+0000 7fab0affd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fab0c09e000 0x7fab0c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:21.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.466+0000 7fab0b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab0c09d6f0 0x7fab0c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:21.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.466+0000 7fab0affd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fab0c09e000 0x7fab0c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44912/0 (socket says 172.21.15.26:44912) 2023-10-01T08:01:21.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.466+0000 7fab0affd700 1 -- 172.21.15.26:0/703040832 learned_addr learned my addr 172.21.15.26:0/703040832 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:21.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.466+0000 7fab0b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab0c09d6f0 0x7fab0c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38088/0 (socket says 172.21.15.26:38088) 2023-10-01T08:01:21.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.466+0000 7fab0affd700 1 -- 172.21.15.26:0/703040832 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab0c09d6f0 msgr2=0x7fab0c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:21.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.466+0000 7fab0affd700 1 --2- 172.21.15.26:0/703040832 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab0c09d6f0 0x7fab0c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:21.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.466+0000 7fab0affd700 1 -- 172.21.15.26:0/703040832 >> v1:172.21.15.26:6789/0 conn(0x7fab0c09e410 legacy=0x7fab0c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:21.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.466+0000 7fab0affd700 1 -- 172.21.15.26:0/703040832 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab0c09a500 con 0x7fab0c09e000 2023-10-01T08:01:21.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.466+0000 7fab0b7fe700 1 --2- 172.21.15.26:0/703040832 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab0c09d6f0 0x7fab0c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:21.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.466+0000 7fab0affd700 1 --2- 172.21.15.26:0/703040832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab0c09e000 0x7fab0c1339f0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7faaf40098f0 tx=0x7faaf4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79d5bcba975dc2a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:21.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.466+0000 7fab0a7fc700 1 -- 172.21.15.26:0/703040832 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf4011830 con 0x7fab0c09e000 2023-10-01T08:01:21.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.466+0000 7fab0a7fc700 1 -- 172.21.15.26:0/703040832 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf4011990 con 0x7fab0c09e000 2023-10-01T08:01:21.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.466+0000 7fab0a7fc700 1 -- 172.21.15.26:0/703040832 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf4011d20 con 0x7fab0c09e000 2023-10-01T08:01:21.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.467+0000 7fab11bdb700 1 -- 172.21.15.26:0/703040832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab0c09e000 msgr2=0x7fab0c1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:21.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.467+0000 7fab11bdb700 1 --2- 172.21.15.26:0/703040832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab0c09e000 0x7fab0c1339f0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7faaf40098f0 tx=0x7faaf4009c00 comp rx=0 tx=0).stop 2023-10-01T08:01:21.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.467+0000 7fab11bdb700 1 -- 172.21.15.26:0/703040832 shutdown_connections 2023-10-01T08:01:21.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.467+0000 7fab11bdb700 1 --2- 172.21.15.26:0/703040832 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab0c09d6f0 0x7fab0c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:21.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.467+0000 7fab11bdb700 1 --2- 172.21.15.26:0/703040832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab0c09e000 0x7fab0c1339f0 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:21.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.467+0000 7fab11bdb700 1 -- 172.21.15.26:0/703040832 >> 172.21.15.26:0/703040832 conn(0x7fab0c066f50 msgr2=0x7fab0c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:21.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.467+0000 7fab11bdb700 1 -- 172.21.15.26:0/703040832 shutdown_connections 2023-10-01T08:01:21.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.467+0000 7fab11bdb700 1 -- 172.21.15.26:0/703040832 wait complete. 2023-10-01T08:01:21.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.468+0000 7fab11bdb700 1 Processor -- start 2023-10-01T08:01:21.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.468+0000 7fab11bdb700 1 -- start start 2023-10-01T08:01:21.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.469+0000 7fab11bdb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab0c09d6f0 0x7fab0c1a5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:21.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.469+0000 7fab11bdb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab0c09e000 0x7fab0c1a6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:21.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.469+0000 7fab11bdb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab0c09e410 0x7fab0c1a6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:21.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.469+0000 7fab11bdb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0c1a91f0 con 0x7fab0c09d6f0 2023-10-01T08:01:21.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.469+0000 7fab11bdb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab0c09c710 con 0x7fab0c09e410 2023-10-01T08:01:21.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.469+0000 7fab11bdb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab0c0a3160 con 0x7fab0c09e000 2023-10-01T08:01:21.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.469+0000 7fab0affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab0c09e000 0x7fab0c1a6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:21.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.469+0000 7fab0bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab0c09e410 0x7fab0c1a6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:21.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.469+0000 7fab0b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab0c09d6f0 0x7fab0c1a5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:21.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.469+0000 7fab0bfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab0c09e410 0x7fab0c1a6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38100/0 (socket says 172.21.15.26:38100) 2023-10-01T08:01:21.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.469+0000 7fab0affd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab0c09e000 0x7fab0c1a6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37652/0 (socket says 172.21.15.26:37652) 2023-10-01T08:01:21.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.469+0000 7fab0bfff700 1 -- 172.21.15.26:0/1195622349 learned_addr learned my addr 172.21.15.26:0/1195622349 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:21.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.469+0000 7fab0b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab0c09d6f0 0x7fab0c1a5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44922/0 (socket says 172.21.15.26:44922) 2023-10-01T08:01:21.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.469+0000 7fab0b7fe700 1 -- 172.21.15.26:0/1195622349 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab0c09e000 msgr2=0x7fab0c1a6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:21.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.469+0000 7fab0b7fe700 1 --2- 172.21.15.26:0/1195622349 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab0c09e000 0x7fab0c1a6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:21.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.469+0000 7fab0b7fe700 1 -- 172.21.15.26:0/1195622349 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab0c09e410 msgr2=0x7fab0c1a6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:21.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.469+0000 7fab0b7fe700 1 --2- 172.21.15.26:0/1195622349 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab0c09e410 0x7fab0c1a6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:21.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.469+0000 7fab0b7fe700 1 -- 172.21.15.26:0/1195622349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faafc0094a0 con 0x7fab0c09d6f0 2023-10-01T08:01:21.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.469+0000 7fab0b7fe700 1 --2- 172.21.15.26:0/1195622349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab0c09d6f0 0x7fab0c1a5fd0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7faafc00e9b0 tx=0x7faafc00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:21.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.469+0000 7fab03fff700 1 -- 172.21.15.26:0/1195622349 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc00ee50 con 0x7fab0c09d6f0 2023-10-01T08:01:21.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.470+0000 7fab03fff700 1 -- 172.21.15.26:0/1195622349 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faafc00c850 con 0x7fab0c09d6f0 2023-10-01T08:01:21.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.470+0000 7fab11bdb700 1 -- 172.21.15.26:0/1195622349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf4009550 con 0x7fab0c09d6f0 2023-10-01T08:01:21.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.470+0000 7fab03fff700 1 -- 172.21.15.26:0/1195622349 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc00cc00 con 0x7fab0c09d6f0 2023-10-01T08:01:21.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.470+0000 7fab11bdb700 1 -- 172.21.15.26:0/1195622349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab0c1a8da0 con 0x7fab0c09d6f0 2023-10-01T08:01:21.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.470+0000 7fab03fff700 1 -- 172.21.15.26:0/1195622349 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faafc013470 con 0x7fab0c09d6f0 2023-10-01T08:01:21.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.470+0000 7fab03fff700 1 -- 172.21.15.26:0/1195622349 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faafc03f6e0 con 0x7fab0c09d6f0 2023-10-01T08:01:21.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.471+0000 7fab11bdb700 1 -- 172.21.15.26:0/1195622349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab0c074ea0 con 0x7fab0c09d6f0 2023-10-01T08:01:21.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.476+0000 7fab03fff700 1 -- 172.21.15.26:0/1195622349 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faafc013720 con 0x7fab0c09d6f0 2023-10-01T08:01:21.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.679+0000 7fab11bdb700 1 -- 172.21.15.26:0/1195622349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fab0c06c360 con 0x7fab0c09d6f0 2023-10-01T08:01:21.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.679+0000 7fab03fff700 1 -- 172.21.15.26:0/1195622349 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faafc021030 con 0x7fab0c09d6f0 2023-10-01T08:01:21.680 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:21.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.682+0000 7fab11bdb700 1 -- 172.21.15.26:0/1195622349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab0c09d6f0 msgr2=0x7fab0c1a5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:21.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.682+0000 7fab11bdb700 1 --2- 172.21.15.26:0/1195622349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab0c09d6f0 0x7fab0c1a5fd0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7faafc00e9b0 tx=0x7faafc00ecc0 comp rx=0 tx=0).stop 2023-10-01T08:01:21.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.682+0000 7fab11bdb700 1 -- 172.21.15.26:0/1195622349 shutdown_connections 2023-10-01T08:01:21.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.682+0000 7fab11bdb700 1 --2- 172.21.15.26:0/1195622349 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fab0c09e410 0x7fab0c1a6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:21.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.682+0000 7fab11bdb700 1 --2- 172.21.15.26:0/1195622349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab0c09d6f0 0x7fab0c1a5fd0 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:21.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.682+0000 7fab11bdb700 1 --2- 172.21.15.26:0/1195622349 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fab0c09e000 0x7fab0c1a6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:21.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.682+0000 7fab11bdb700 1 -- 172.21.15.26:0/1195622349 >> 172.21.15.26:0/1195622349 conn(0x7fab0c066f50 msgr2=0x7fab0c1baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:21.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.682+0000 7fab11bdb700 1 -- 172.21.15.26:0/1195622349 shutdown_connections 2023-10-01T08:01:21.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:21.682+0000 7fab11bdb700 1 -- 172.21.15.26:0/1195622349 wait complete. 2023-10-01T08:01:21.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:21.917 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:21.996 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:22.024 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:22.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.068+0000 7f3fc4749700 1 Processor -- start 2023-10-01T08:01:22.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.068+0000 7f3fc4749700 1 -- start start 2023-10-01T08:01:22.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.069+0000 7f3fc4749700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fbc06e570 0x7f3fbc06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:22.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.069+0000 7f3fc4749700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3fbc09eca0 0x7f3fbc06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:22.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.069+0000 7f3fc4749700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fbc070ee0 con 0x7f3fbc134610 2023-10-01T08:01:22.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.069+0000 7f3fc4749700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fbc071480 con 0x7f3fbc09eca0 2023-10-01T08:01:22.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.069+0000 7f3fc4749700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc06f3c0 con 0x7f3fbc06e570 2023-10-01T08:01:22.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.069+0000 7f3fc24e5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fbc06e570 0x7f3fbc06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:22.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.069+0000 7f3fc24e5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fbc06e570 0x7f3fbc06e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38112/0 (socket says 172.21.15.26:38112) 2023-10-01T08:01:22.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.069+0000 7f3fc24e5700 1 -- 172.21.15.26:0/2005097989 learned_addr learned my addr 172.21.15.26:0/2005097989 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:22.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.069+0000 7f3fc1ce4700 1 --2- 172.21.15.26:0/2005097989 >> v2:172.21.15.26:3300/0 conn(0x7f3fbc09eca0 0x7f3fbc06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:22.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.069+0000 7f3fc24e5700 1 -- 172.21.15.26:0/2005097989 >> v2:172.21.15.26:3300/0 conn(0x7f3fbc09eca0 msgr2=0x7f3fbc06ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:22.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.069+0000 7f3fc24e5700 1 --2- 172.21.15.26:0/2005097989 >> v2:172.21.15.26:3300/0 conn(0x7f3fbc09eca0 0x7f3fbc06ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:22.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.069+0000 7f3fc24e5700 1 -- 172.21.15.26:0/2005097989 >> v1:172.21.15.26:6789/0 conn(0x7f3fbc134610 legacy=0x7f3fbc134a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:22.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.069+0000 7f3fc24e5700 1 -- 172.21.15.26:0/2005097989 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fbc071b90 con 0x7f3fbc06e570 2023-10-01T08:01:22.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.070+0000 7f3fc24e5700 1 --2- 172.21.15.26:0/2005097989 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fbc06e570 0x7f3fbc06e940 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f3fb80098f0 tx=0x7f3fb8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21817fd373d891a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:22.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.070+0000 7f3fc14e3700 1 -- 172.21.15.26:0/2005097989 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8004230 con 0x7f3fbc06e570 2023-10-01T08:01:22.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.070+0000 7f3fc14e3700 1 -- 172.21.15.26:0/2005097989 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb8004390 con 0x7f3fbc06e570 2023-10-01T08:01:22.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.070+0000 7f3fc14e3700 1 -- 172.21.15.26:0/2005097989 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb80036a0 con 0x7f3fbc06e570 2023-10-01T08:01:22.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.071+0000 7f3fc4749700 1 -- 172.21.15.26:0/2005097989 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fbc06e570 msgr2=0x7f3fbc06e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:22.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.071+0000 7f3fc4749700 1 --2- 172.21.15.26:0/2005097989 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fbc06e570 0x7f3fbc06e940 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f3fb80098f0 tx=0x7f3fb8009c00 comp rx=0 tx=0).stop 2023-10-01T08:01:22.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.071+0000 7f3fc4749700 1 -- 172.21.15.26:0/2005097989 shutdown_connections 2023-10-01T08:01:22.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.071+0000 7f3fc4749700 1 --2- 172.21.15.26:0/2005097989 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fbc06e570 0x7f3fbc06e940 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:22.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.071+0000 7f3fc4749700 1 --2- 172.21.15.26:0/2005097989 >> v2:172.21.15.26:3300/0 conn(0x7f3fbc09eca0 0x7f3fbc06ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:22.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.071+0000 7f3fc4749700 1 -- 172.21.15.26:0/2005097989 >> 172.21.15.26:0/2005097989 conn(0x7f3fbc0a2aa0 msgr2=0x7f3fbc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:22.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.071+0000 7f3fc4749700 1 -- 172.21.15.26:0/2005097989 shutdown_connections 2023-10-01T08:01:22.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.071+0000 7f3fc4749700 1 -- 172.21.15.26:0/2005097989 wait complete. 2023-10-01T08:01:22.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.072+0000 7f3fc4749700 1 Processor -- start 2023-10-01T08:01:22.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.072+0000 7f3fc4749700 1 -- start start 2023-10-01T08:01:22.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.073+0000 7f3fc4749700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3fbc06e570 0x7f3fbc1231b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:22.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.073+0000 7f3fc4749700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fbc134610 0x7f3fbc1236f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:22.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.073+0000 7f3fc4749700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fbc123c30 0x7f3fbc1cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:22.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.073+0000 7f3fc4749700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc124680 con 0x7f3fbc123c30 2023-10-01T08:01:22.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.073+0000 7f3fc4749700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc126ad0 con 0x7f3fbc134610 2023-10-01T08:01:22.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.073+0000 7f3fc4749700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc133cb0 con 0x7f3fbc06e570 2023-10-01T08:01:22.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.073+0000 7f3fc1ce4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fbc134610 0x7f3fbc1236f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:22.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.073+0000 7f3fc1ce4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fbc134610 0x7f3fbc1236f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38120/0 (socket says 172.21.15.26:38120) 2023-10-01T08:01:22.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.073+0000 7f3fc1ce4700 1 -- 172.21.15.26:0/3124384641 learned_addr learned my addr 172.21.15.26:0/3124384641 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:22.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.073+0000 7f3fc2ce6700 1 --2- 172.21.15.26:0/3124384641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fbc123c30 0x7f3fbc1cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:22.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.074+0000 7f3fc1ce4700 1 -- 172.21.15.26:0/3124384641 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3fbc06e570 msgr2=0x7f3fbc1231b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:22.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.074+0000 7f3fc1ce4700 1 --2- 172.21.15.26:0/3124384641 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3fbc06e570 0x7f3fbc1231b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:22.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.074+0000 7f3fc1ce4700 1 -- 172.21.15.26:0/3124384641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fbc123c30 msgr2=0x7f3fbc1cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:22.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.074+0000 7f3fc1ce4700 1 --2- 172.21.15.26:0/3124384641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fbc123c30 0x7f3fbc1cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:22.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.074+0000 7f3fc1ce4700 1 -- 172.21.15.26:0/3124384641 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb8009550 con 0x7f3fbc134610 2023-10-01T08:01:22.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.074+0000 7f3fc1ce4700 1 --2- 172.21.15.26:0/3124384641 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fbc134610 0x7f3fbc1236f0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f3fac00e7e0 tx=0x7f3fac00eaf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:22.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.074+0000 7f3fb2ffd700 1 -- 172.21.15.26:0/3124384641 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac013610 con 0x7f3fbc134610 2023-10-01T08:01:22.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.074+0000 7f3fb2ffd700 1 -- 172.21.15.26:0/3124384641 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fac013770 con 0x7f3fbc134610 2023-10-01T08:01:22.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.074+0000 7f3fc4749700 1 -- 172.21.15.26:0/3124384641 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fbc0a23b0 con 0x7f3fbc134610 2023-10-01T08:01:22.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.074+0000 7f3fb2ffd700 1 -- 172.21.15.26:0/3124384641 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac013ae0 con 0x7f3fbc134610 2023-10-01T08:01:22.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.074+0000 7f3fc4749700 1 -- 172.21.15.26:0/3124384641 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fbc126730 con 0x7f3fbc134610 2023-10-01T08:01:22.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.075+0000 7f3fb2ffd700 1 -- 172.21.15.26:0/3124384641 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3fac013c40 con 0x7f3fbc134610 2023-10-01T08:01:22.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.075+0000 7f3fb2ffd700 1 -- 172.21.15.26:0/3124384641 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3fac03f400 con 0x7f3fbc134610 2023-10-01T08:01:22.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.076+0000 7f3fc4749700 1 -- 172.21.15.26:0/3124384641 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fbc074ea0 con 0x7f3fbc134610 2023-10-01T08:01:22.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.081+0000 7f3fb2ffd700 1 -- 172.21.15.26:0/3124384641 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3fac012370 con 0x7f3fbc134610 2023-10-01T08:01:22.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.142+0000 7f29e2e09700 1 Processor -- start 2023-10-01T08:01:22.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.143+0000 7f29e2e09700 1 -- start start 2023-10-01T08:01:22.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.143+0000 7f29e2e09700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29dc0a0a30 0x7f29dc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:22.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.143+0000 7f29e2e09700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29dc0a1340 0x7f29dc133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:22.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.143+0000 7f29e2e09700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29dc09edd0 con 0x7f29dc133fa0 2023-10-01T08:01:22.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.143+0000 7f29e2e09700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc09e1f0 con 0x7f29dc0a0a30 2023-10-01T08:01:22.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.143+0000 7f29e2e09700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc09dc50 con 0x7f29dc0a1340 2023-10-01T08:01:22.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.143+0000 7f29dbfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29dc0a1340 0x7f29dc133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:22.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.143+0000 7f29e0ba5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29dc0a0a30 0x7f29dc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:22.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.143+0000 7f29dbfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29dc0a1340 0x7f29dc133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37676/0 (socket says 172.21.15.26:37676) 2023-10-01T08:01:22.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.143+0000 7f29dbfff700 1 -- 172.21.15.26:0/1857768241 learned_addr learned my addr 172.21.15.26:0/1857768241 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:22.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.144+0000 7f29e0ba5700 1 -- 172.21.15.26:0/1857768241 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29dc0a1340 msgr2=0x7f29dc133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:22.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.144+0000 7f29e0ba5700 1 --2- 172.21.15.26:0/1857768241 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29dc0a1340 0x7f29dc133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:22.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.144+0000 7f29e0ba5700 1 -- 172.21.15.26:0/1857768241 >> v1:172.21.15.26:6789/0 conn(0x7f29dc133fa0 legacy=0x7f29dc13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:22.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.144+0000 7f29e0ba5700 1 -- 172.21.15.26:0/1857768241 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29dc0a1fe0 con 0x7f29dc0a0a30 2023-10-01T08:01:22.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.144+0000 7f29db7fe700 1 -- 172.21.15.26:0/1857768241 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2208716597 0 0) 0x7f29dc09edd0 con 0x7f29dc133fa0 2023-10-01T08:01:22.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.144+0000 7f29e0ba5700 1 --2- 172.21.15.26:0/1857768241 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29dc0a0a30 0x7f29dc0a0e00 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f29d0009870 tx=0x7f29d0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=139b95b9489789e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:22.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.144+0000 7f29db7fe700 1 -- 172.21.15.26:0/1857768241 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d0011830 con 0x7f29dc0a0a30 2023-10-01T08:01:22.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.144+0000 7f29db7fe700 1 -- 172.21.15.26:0/1857768241 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d0011990 con 0x7f29dc0a0a30 2023-10-01T08:01:22.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.144+0000 7f29db7fe700 1 -- 172.21.15.26:0/1857768241 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d0011d20 con 0x7f29dc0a0a30 2023-10-01T08:01:22.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.145+0000 7f29e2e09700 1 -- 172.21.15.26:0/1857768241 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29dc0a0a30 msgr2=0x7f29dc0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:22.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.145+0000 7f29e2e09700 1 --2- 172.21.15.26:0/1857768241 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29dc0a0a30 0x7f29dc0a0e00 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f29d0009870 tx=0x7f29d0009b80 comp rx=0 tx=0).stop 2023-10-01T08:01:22.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.145+0000 7f29e2e09700 1 -- 172.21.15.26:0/1857768241 shutdown_connections 2023-10-01T08:01:22.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.145+0000 7f29e2e09700 1 --2- 172.21.15.26:0/1857768241 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29dc0a0a30 0x7f29dc0a0e00 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:22.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.145+0000 7f29e2e09700 1 --2- 172.21.15.26:0/1857768241 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29dc0a1340 0x7f29dc133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:22.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.145+0000 7f29e2e09700 1 -- 172.21.15.26:0/1857768241 >> 172.21.15.26:0/1857768241 conn(0x7f29dc0a6550 msgr2=0x7f29dc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:22.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.145+0000 7f29e2e09700 1 -- 172.21.15.26:0/1857768241 shutdown_connections 2023-10-01T08:01:22.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.145+0000 7f29e2e09700 1 -- 172.21.15.26:0/1857768241 wait complete. 2023-10-01T08:01:22.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.147+0000 7f29e2e09700 1 Processor -- start 2023-10-01T08:01:22.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.147+0000 7f29e2e09700 1 -- start start 2023-10-01T08:01:22.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.147+0000 7f29e2e09700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29dc0a0a30 0x7f29dc1c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:22.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.147+0000 7f29e2e09700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29dc0a1340 0x7f29dc1c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:22.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.147+0000 7f29e2e09700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29dc133fa0 0x7f29dc1c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:22.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.147+0000 7f29e2e09700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc1244c0 con 0x7f29dc133fa0 2023-10-01T08:01:22.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.147+0000 7f29e2e09700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc124d90 con 0x7f29dc0a0a30 2023-10-01T08:01:22.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.147+0000 7f29e2e09700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc1263d0 con 0x7f29dc0a1340 2023-10-01T08:01:22.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.148+0000 7f29e0ba5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29dc0a0a30 0x7f29dc1c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:22.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.148+0000 7f29e0ba5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29dc0a0a30 0x7f29dc1c8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38130/0 (socket says 172.21.15.26:38130) 2023-10-01T08:01:22.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.148+0000 7f29e0ba5700 1 -- 172.21.15.26:0/1703586953 learned_addr learned my addr 172.21.15.26:0/1703586953 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:22.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.148+0000 7f29dbfff700 1 --2- 172.21.15.26:0/1703586953 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29dc0a1340 0x7f29dc1c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:22.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.148+0000 7f29e13a6700 1 --2- 172.21.15.26:0/1703586953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29dc133fa0 0x7f29dc1c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:22.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.148+0000 7f29dbfff700 1 -- 172.21.15.26:0/1703586953 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29dc0a0a30 msgr2=0x7f29dc1c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:22.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.148+0000 7f29dbfff700 1 --2- 172.21.15.26:0/1703586953 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29dc0a0a30 0x7f29dc1c8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:22.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.148+0000 7f29dbfff700 1 -- 172.21.15.26:0/1703586953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29dc133fa0 msgr2=0x7f29dc1c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:22.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.148+0000 7f29dbfff700 1 --2- 172.21.15.26:0/1703586953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29dc133fa0 0x7f29dc1c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:22.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.148+0000 7f29dbfff700 1 -- 172.21.15.26:0/1703586953 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d00094a0 con 0x7f29dc0a1340 2023-10-01T08:01:22.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.148+0000 7f29e0ba5700 1 --2- 172.21.15.26:0/1703586953 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29dc0a0a30 0x7f29dc1c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:22.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.148+0000 7f29dbfff700 1 --2- 172.21.15.26:0/1703586953 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29dc0a1340 0x7f29dc1c87c0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f29c800e8e0 tx=0x7f29c800ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:22.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.148+0000 7f29d97fa700 1 -- 172.21.15.26:0/1703586953 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c8013680 con 0x7f29dc0a1340 2023-10-01T08:01:22.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.149+0000 7f29d97fa700 1 -- 172.21.15.26:0/1703586953 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c80137e0 con 0x7f29dc0a1340 2023-10-01T08:01:22.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.149+0000 7f29e2e09700 1 -- 172.21.15.26:0/1703586953 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29dc0a25e0 con 0x7f29dc0a1340 2023-10-01T08:01:22.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.149+0000 7f29d97fa700 1 -- 172.21.15.26:0/1703586953 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c8013b70 con 0x7f29dc0a1340 2023-10-01T08:01:22.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.149+0000 7f29e2e09700 1 -- 172.21.15.26:0/1703586953 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29dc0a0220 con 0x7f29dc0a1340 2023-10-01T08:01:22.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.150+0000 7f29e2e09700 1 -- 172.21.15.26:0/1703586953 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29dc074ea0 con 0x7f29dc0a1340 2023-10-01T08:01:22.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.150+0000 7f29d97fa700 1 -- 172.21.15.26:0/1703586953 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f29c8013cd0 con 0x7f29dc0a1340 2023-10-01T08:01:22.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.150+0000 7f29d97fa700 1 -- 172.21.15.26:0/1703586953 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f29c80128f0 con 0x7f29dc0a1340 2023-10-01T08:01:22.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.155+0000 7f29d97fa700 1 -- 172.21.15.26:0/1703586953 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f29c8044060 con 0x7f29dc0a1340 2023-10-01T08:01:22.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.189+0000 7f9dd1dd5700 1 Processor -- start 2023-10-01T08:01:22.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.189+0000 7f9dd1dd5700 1 -- start start 2023-10-01T08:01:22.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.189+0000 7f9dd1dd5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9dcc0a0a30 0x7f9dcc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:22.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.189+0000 7f9dd1dd5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9dcc0a1340 0x7f9dcc133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:22.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.189+0000 7f9dd1dd5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dcc09edd0 con 0x7f9dcc133fa0 2023-10-01T08:01:22.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.189+0000 7f9dd1dd5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dcc09e1f0 con 0x7f9dcc0a0a30 2023-10-01T08:01:22.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.189+0000 7f9dd1dd5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc09dc50 con 0x7f9dcc0a1340 2023-10-01T08:01:22.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.190+0000 7f9dcaffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9dcc0a1340 0x7f9dcc133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:22.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.190+0000 7f9dcaffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9dcc0a1340 0x7f9dcc133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37686/0 (socket says 172.21.15.26:37686) 2023-10-01T08:01:22.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.190+0000 7f9dcaffd700 1 -- 172.21.15.26:0/2863654749 learned_addr learned my addr 172.21.15.26:0/2863654749 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:22.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.190+0000 7f9dcb7fe700 1 --2- 172.21.15.26:0/2863654749 >> v2:172.21.15.26:3300/0 conn(0x7f9dcc0a0a30 0x7f9dcc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:22.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.190+0000 7f9dcaffd700 1 -- 172.21.15.26:0/2863654749 >> v2:172.21.15.26:3300/0 conn(0x7f9dcc0a0a30 msgr2=0x7f9dcc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:22.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.190+0000 7f9dcaffd700 1 --2- 172.21.15.26:0/2863654749 >> v2:172.21.15.26:3300/0 conn(0x7f9dcc0a0a30 0x7f9dcc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:22.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.190+0000 7f9dcaffd700 1 -- 172.21.15.26:0/2863654749 >> v1:172.21.15.26:6789/0 conn(0x7f9dcc133fa0 legacy=0x7f9dcc13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:22.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.190+0000 7f9dcaffd700 1 -- 172.21.15.26:0/2863654749 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dcc0a1fe0 con 0x7f9dcc0a1340 2023-10-01T08:01:22.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.190+0000 7f9dcaffd700 1 --2- 172.21.15.26:0/2863654749 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9dcc0a1340 0x7f9dcc133a60 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00098f0 tx=0x7f9dc0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b89a8692ef8aea0a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:22.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.190+0000 7f9dca7fc700 1 -- 172.21.15.26:0/2863654749 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc0011830 con 0x7f9dcc0a1340 2023-10-01T08:01:22.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.190+0000 7f9dca7fc700 1 -- 172.21.15.26:0/2863654749 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc0011990 con 0x7f9dcc0a1340 2023-10-01T08:01:22.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.190+0000 7f9dca7fc700 1 -- 172.21.15.26:0/2863654749 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc0011d20 con 0x7f9dcc0a1340 2023-10-01T08:01:22.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.191+0000 7f9dd1dd5700 1 -- 172.21.15.26:0/2863654749 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9dcc0a1340 msgr2=0x7f9dcc133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:22.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.191+0000 7f9dd1dd5700 1 --2- 172.21.15.26:0/2863654749 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9dcc0a1340 0x7f9dcc133a60 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00098f0 tx=0x7f9dc0009c00 comp rx=0 tx=0).stop 2023-10-01T08:01:22.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.191+0000 7f9dd1dd5700 1 -- 172.21.15.26:0/2863654749 shutdown_connections 2023-10-01T08:01:22.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.191+0000 7f9dd1dd5700 1 --2- 172.21.15.26:0/2863654749 >> v2:172.21.15.26:3300/0 conn(0x7f9dcc0a0a30 0x7f9dcc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:22.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.191+0000 7f9dd1dd5700 1 --2- 172.21.15.26:0/2863654749 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9dcc0a1340 0x7f9dcc133a60 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:22.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.191+0000 7f9dd1dd5700 1 -- 172.21.15.26:0/2863654749 >> 172.21.15.26:0/2863654749 conn(0x7f9dcc0a6550 msgr2=0x7f9dcc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:22.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.191+0000 7f9dd1dd5700 1 -- 172.21.15.26:0/2863654749 shutdown_connections 2023-10-01T08:01:22.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.191+0000 7f9dd1dd5700 1 -- 172.21.15.26:0/2863654749 wait complete. 2023-10-01T08:01:22.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.193+0000 7f9dd1dd5700 1 Processor -- start 2023-10-01T08:01:22.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.193+0000 7f9dd1dd5700 1 -- start start 2023-10-01T08:01:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.194+0000 7f9dd1dd5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9dcc0a0a30 0x7f9dcc123330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.194+0000 7f9dd1dd5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dcc0a1340 0x7f9dcc123870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.194+0000 7f9dd1dd5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9dcc133fa0 0x7f9dcc1c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.194+0000 7f9dd1dd5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc0a0290 con 0x7f9dcc0a1340 2023-10-01T08:01:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.194+0000 7f9dd1dd5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc122f50 con 0x7f9dcc133fa0 2023-10-01T08:01:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.194+0000 7f9dd1dd5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc133410 con 0x7f9dcc0a0a30 2023-10-01T08:01:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.194+0000 7f9dcbfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9dcc133fa0 0x7f9dcc1c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.194+0000 7f9dcb7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9dcc0a0a30 0x7f9dcc123330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.194+0000 7f9dcaffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dcc0a1340 0x7f9dcc123870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.194+0000 7f9dcbfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9dcc133fa0 0x7f9dcc1c8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38144/0 (socket says 172.21.15.26:38144) 2023-10-01T08:01:22.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.194+0000 7f9dcb7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9dcc0a0a30 0x7f9dcc123330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37702/0 (socket says 172.21.15.26:37702) 2023-10-01T08:01:22.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.194+0000 7f9dcbfff700 1 -- 172.21.15.26:0/14315223 learned_addr learned my addr 172.21.15.26:0/14315223 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:22.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.194+0000 7f9dcaffd700 1 -- 172.21.15.26:0/14315223 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9dcc0a0a30 msgr2=0x7f9dcc123330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:22.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.194+0000 7f9dcaffd700 1 --2- 172.21.15.26:0/14315223 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9dcc0a0a30 0x7f9dcc123330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:22.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.194+0000 7f9dcaffd700 1 -- 172.21.15.26:0/14315223 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9dcc133fa0 msgr2=0x7f9dcc1c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:22.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.194+0000 7f9dcaffd700 1 --2- 172.21.15.26:0/14315223 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9dcc133fa0 0x7f9dcc1c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:22.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.194+0000 7f9dcaffd700 1 -- 172.21.15.26:0/14315223 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc0009550 con 0x7f9dcc0a1340 2023-10-01T08:01:22.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.194+0000 7f9dcb7fe700 1 --2- 172.21.15.26:0/14315223 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9dcc0a0a30 0x7f9dcc123330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:22.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.194+0000 7f9dcbfff700 1 --2- 172.21.15.26:0/14315223 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9dcc133fa0 0x7f9dcc1c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:22.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.194+0000 7f9dcaffd700 1 --2- 172.21.15.26:0/14315223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dcc0a1340 0x7f9dcc123870 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0016000 tx=0x7f9dc0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:22.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.195+0000 7f9db3fff700 1 -- 172.21.15.26:0/14315223 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc0004400 con 0x7f9dcc0a1340 2023-10-01T08:01:22.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.195+0000 7f9dd1dd5700 1 -- 172.21.15.26:0/14315223 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dcc123db0 con 0x7f9dcc0a1340 2023-10-01T08:01:22.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.195+0000 7f9dd1dd5700 1 -- 172.21.15.26:0/14315223 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dcc126150 con 0x7f9dcc0a1340 2023-10-01T08:01:22.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.195+0000 7f9db3fff700 1 -- 172.21.15.26:0/14315223 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc001f070 con 0x7f9dcc0a1340 2023-10-01T08:01:22.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.195+0000 7f9db3fff700 1 -- 172.21.15.26:0/14315223 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc00038a0 con 0x7f9dcc0a1340 2023-10-01T08:01:22.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.196+0000 7f9db3fff700 1 -- 172.21.15.26:0/14315223 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9dc0021030 con 0x7f9dcc0a1340 2023-10-01T08:01:22.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.196+0000 7f9db3fff700 1 -- 172.21.15.26:0/14315223 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9dc0040a30 con 0x7f9dcc0a1340 2023-10-01T08:01:22.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.196+0000 7f9dd1dd5700 1 -- 172.21.15.26:0/14315223 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dac0052e0 con 0x7f9dcc0a1340 2023-10-01T08:01:22.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.201+0000 7f9db3fff700 1 -- 172.21.15.26:0/14315223 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9dc0015020 con 0x7f9dcc0a1340 2023-10-01T08:01:22.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.302+0000 7f3fc4749700 1 -- 172.21.15.26:0/3124384641 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3fbc071100 con 0x7f3fbc134610 2023-10-01T08:01:22.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.302+0000 7f3fb2ffd700 1 -- 172.21.15.26:0/3124384641 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3fac021030 con 0x7f3fbc134610 2023-10-01T08:01:22.303 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:22.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.304+0000 7f3fc4749700 1 -- 172.21.15.26:0/3124384641 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fbc134610 msgr2=0x7f3fbc1236f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:22.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.304+0000 7f3fc4749700 1 --2- 172.21.15.26:0/3124384641 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fbc134610 0x7f3fbc1236f0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f3fac00e7e0 tx=0x7f3fac00eaf0 comp rx=0 tx=0).stop 2023-10-01T08:01:22.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.304+0000 7f3fc4749700 1 -- 172.21.15.26:0/3124384641 shutdown_connections 2023-10-01T08:01:22.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.304+0000 7f3fc4749700 1 --2- 172.21.15.26:0/3124384641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fbc123c30 0x7f3fbc1cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:22.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.304+0000 7f3fc4749700 1 --2- 172.21.15.26:0/3124384641 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3fbc06e570 0x7f3fbc1231b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:22.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.304+0000 7f3fc4749700 1 --2- 172.21.15.26:0/3124384641 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3fbc134610 0x7f3fbc1236f0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:22.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.305+0000 7f3fc4749700 1 -- 172.21.15.26:0/3124384641 >> 172.21.15.26:0/3124384641 conn(0x7f3fbc0a2aa0 msgr2=0x7f3fbc0a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:22.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.305+0000 7f3fc4749700 1 -- 172.21.15.26:0/3124384641 shutdown_connections 2023-10-01T08:01:22.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.305+0000 7f3fc4749700 1 -- 172.21.15.26:0/3124384641 wait complete. 2023-10-01T08:01:22.320 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:22.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.364+0000 7f29e2e09700 1 -- 172.21.15.26:0/1703586953 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f29dc0a28e0 con 0x7f29dc0a1340 2023-10-01T08:01:22.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.364+0000 7f29d97fa700 1 -- 172.21.15.26:0/1703586953 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f29c8017020 con 0x7f29dc0a1340 2023-10-01T08:01:22.366 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:22.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.367+0000 7f29e2e09700 1 -- 172.21.15.26:0/1703586953 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29dc0a1340 msgr2=0x7f29dc1c87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:22.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.367+0000 7f29e2e09700 1 --2- 172.21.15.26:0/1703586953 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29dc0a1340 0x7f29dc1c87c0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f29c800e8e0 tx=0x7f29c800ebf0 comp rx=0 tx=0).stop 2023-10-01T08:01:22.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.367+0000 7f29e2e09700 1 -- 172.21.15.26:0/1703586953 shutdown_connections 2023-10-01T08:01:22.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.367+0000 7f29e2e09700 1 --2- 172.21.15.26:0/1703586953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29dc133fa0 0x7f29dc1c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:22.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.367+0000 7f29e2e09700 1 --2- 172.21.15.26:0/1703586953 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29dc0a0a30 0x7f29dc1c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:22.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.367+0000 7f29e2e09700 1 --2- 172.21.15.26:0/1703586953 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f29dc0a1340 0x7f29dc1c87c0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:22.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.367+0000 7f29e2e09700 1 -- 172.21.15.26:0/1703586953 >> 172.21.15.26:0/1703586953 conn(0x7f29dc0a6550 msgr2=0x7f29dc11c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:22.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.367+0000 7f29e2e09700 1 -- 172.21.15.26:0/1703586953 shutdown_connections 2023-10-01T08:01:22.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.367+0000 7f29e2e09700 1 -- 172.21.15.26:0/1703586953 wait complete. 2023-10-01T08:01:22.381 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:22.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.410+0000 7f9dd1dd5700 1 -- 172.21.15.26:0/14315223 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9dac005150 con 0x7f9dcc0a1340 2023-10-01T08:01:22.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.410+0000 7f9db3fff700 1 -- 172.21.15.26:0/14315223 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9dc0015020 con 0x7f9dcc0a1340 2023-10-01T08:01:22.411 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:22.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.412+0000 7f9dd1dd5700 1 -- 172.21.15.26:0/14315223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dcc0a1340 msgr2=0x7f9dcc123870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:22.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.412+0000 7f9dd1dd5700 1 --2- 172.21.15.26:0/14315223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dcc0a1340 0x7f9dcc123870 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0016000 tx=0x7f9dc0004750 comp rx=0 tx=0).stop 2023-10-01T08:01:22.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.412+0000 7f9dd1dd5700 1 -- 172.21.15.26:0/14315223 shutdown_connections 2023-10-01T08:01:22.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.412+0000 7f9dd1dd5700 1 --2- 172.21.15.26:0/14315223 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9dcc133fa0 0x7f9dcc1c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:22.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.412+0000 7f9dd1dd5700 1 --2- 172.21.15.26:0/14315223 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9dcc0a0a30 0x7f9dcc123330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:22.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.412+0000 7f9dd1dd5700 1 --2- 172.21.15.26:0/14315223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dcc0a1340 0x7f9dcc123870 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:22.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.412+0000 7f9dd1dd5700 1 -- 172.21.15.26:0/14315223 >> 172.21.15.26:0/14315223 conn(0x7f9dcc0a6550 msgr2=0x7f9dcc0a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:22.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.412+0000 7f9dd1dd5700 1 -- 172.21.15.26:0/14315223 shutdown_connections 2023-10-01T08:01:22.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.412+0000 7f9dd1dd5700 1 -- 172.21.15.26:0/14315223 wait complete. 2023-10-01T08:01:22.426 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:22.697 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:22.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.842+0000 7fb28c7d5700 1 Processor -- start 2023-10-01T08:01:22.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.842+0000 7fb28c7d5700 1 -- start start 2023-10-01T08:01:22.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.843+0000 7fb28c7d5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb28406a770 0x7fb28406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:22.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.843+0000 7fb28c7d5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb28406b080 0x7fb284131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:22.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.843+0000 7fb28c7d5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb28409ece0 con 0x7fb284131b40 2023-10-01T08:01:22.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.843+0000 7fb28c7d5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb28409e760 con 0x7fb28406a770 2023-10-01T08:01:22.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.843+0000 7fb28c7d5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb28409e040 con 0x7fb28406b080 2023-10-01T08:01:22.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.843+0000 7fb289d70700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb28406b080 0x7fb284131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:22.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.843+0000 7fb28a571700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb28406a770 0x7fb28406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:22.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.843+0000 7fb289d70700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb28406b080 0x7fb284131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:37704/0 (socket says 172.21.15.26:37704) 2023-10-01T08:01:22.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.843+0000 7fb28a571700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb28406a770 0x7fb28406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44982/0 (socket says 172.21.15.26:44982) 2023-10-01T08:01:22.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.843+0000 7fb289d70700 1 -- 172.21.15.26:0/175518212 learned_addr learned my addr 172.21.15.26:0/175518212 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:22.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.843+0000 7fb28a571700 1 -- 172.21.15.26:0/175518212 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb28406b080 msgr2=0x7fb284131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:22.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.843+0000 7fb28a571700 1 --2- 172.21.15.26:0/175518212 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb28406b080 0x7fb284131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:22.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.843+0000 7fb28a571700 1 -- 172.21.15.26:0/175518212 >> v1:172.21.15.26:6789/0 conn(0x7fb284131b40 legacy=0x7fb284138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:22.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.843+0000 7fb28a571700 1 -- 172.21.15.26:0/175518212 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28409f630 con 0x7fb28406a770 2023-10-01T08:01:22.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.843+0000 7fb28956f700 1 -- 172.21.15.26:0/175518212 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 845596314 0 0) 0x7fb28409ece0 con 0x7fb284131b40 2023-10-01T08:01:22.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.843+0000 7fb289d70700 1 --2- 172.21.15.26:0/175518212 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb28406b080 0x7fb284131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:22.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.843+0000 7fb28a571700 1 --2- 172.21.15.26:0/175518212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb28406a770 0x7fb28406ab40 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fb274009840 tx=0x7fb274009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d55274d2dba750e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:22.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.843+0000 7fb28956f700 1 -- 172.21.15.26:0/175518212 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb274011830 con 0x7fb28406a770 2023-10-01T08:01:22.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.844+0000 7fb28956f700 1 -- 172.21.15.26:0/175518212 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb274011990 con 0x7fb28406a770 2023-10-01T08:01:22.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.844+0000 7fb28956f700 1 -- 172.21.15.26:0/175518212 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb274011d20 con 0x7fb28406a770 2023-10-01T08:01:22.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.844+0000 7fb28c7d5700 1 -- 172.21.15.26:0/175518212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb28406a770 msgr2=0x7fb28406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:22.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.844+0000 7fb28c7d5700 1 --2- 172.21.15.26:0/175518212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb28406a770 0x7fb28406ab40 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fb274009840 tx=0x7fb274009b50 comp rx=0 tx=0).stop 2023-10-01T08:01:22.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.844+0000 7fb28c7d5700 1 -- 172.21.15.26:0/175518212 shutdown_connections 2023-10-01T08:01:22.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.844+0000 7fb28c7d5700 1 --2- 172.21.15.26:0/175518212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb28406a770 0x7fb28406ab40 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:22.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.844+0000 7fb28c7d5700 1 --2- 172.21.15.26:0/175518212 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb28406b080 0x7fb284131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:22.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.844+0000 7fb28c7d5700 1 -- 172.21.15.26:0/175518212 >> 172.21.15.26:0/175518212 conn(0x7fb284066f50 msgr2=0x7fb28409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:22.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.844+0000 7fb28c7d5700 1 -- 172.21.15.26:0/175518212 shutdown_connections 2023-10-01T08:01:22.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.844+0000 7fb28c7d5700 1 -- 172.21.15.26:0/175518212 wait complete. 2023-10-01T08:01:22.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.845+0000 7fb28c7d5700 1 Processor -- start 2023-10-01T08:01:22.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.845+0000 7fb28c7d5700 1 -- start start 2023-10-01T08:01:22.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.846+0000 7fb28c7d5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb28406a770 0x7fb284120e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:22.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.846+0000 7fb28c7d5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb28406b080 0x7fb284121340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:22.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.846+0000 7fb28c7d5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb284131b40 0x7fb2841c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:22.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.846+0000 7fb28c7d5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28406ebe0 con 0x7fb284131b40 2023-10-01T08:01:22.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.846+0000 7fb28c7d5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb284071e60 con 0x7fb28406a770 2023-10-01T08:01:22.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.846+0000 7fb28c7d5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb284123ab0 con 0x7fb28406b080 2023-10-01T08:01:22.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.846+0000 7fb28a571700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb28406a770 0x7fb284120e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:22.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.846+0000 7fb28a571700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb28406a770 0x7fb284120e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:38152/0 (socket says 172.21.15.26:38152) 2023-10-01T08:01:22.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.846+0000 7fb28a571700 1 -- 172.21.15.26:0/1279308023 learned_addr learned my addr 172.21.15.26:0/1279308023 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:22.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.846+0000 7fb289d70700 1 --2- 172.21.15.26:0/1279308023 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb28406b080 0x7fb284121340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:22.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.846+0000 7fb28ad72700 1 --2- 172.21.15.26:0/1279308023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb284131b40 0x7fb2841c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:22.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.846+0000 7fb28a571700 1 -- 172.21.15.26:0/1279308023 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb28406b080 msgr2=0x7fb284121340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:22.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.846+0000 7fb28a571700 1 --2- 172.21.15.26:0/1279308023 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb28406b080 0x7fb284121340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:22.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.846+0000 7fb28a571700 1 -- 172.21.15.26:0/1279308023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb284131b40 msgr2=0x7fb2841c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:22.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.846+0000 7fb28a571700 1 --2- 172.21.15.26:0/1279308023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb284131b40 0x7fb2841c5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:22.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.846+0000 7fb28a571700 1 -- 172.21.15.26:0/1279308023 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb280009550 con 0x7fb28406a770 2023-10-01T08:01:22.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.846+0000 7fb289d70700 1 --2- 172.21.15.26:0/1279308023 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb28406b080 0x7fb284121340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:22.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.846+0000 7fb28a571700 1 --2- 172.21.15.26:0/1279308023 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb28406a770 0x7fb284120e00 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fb274009fd0 tx=0x7fb274004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:22.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.847+0000 7fb27affd700 1 -- 172.21.15.26:0/1279308023 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb274004550 con 0x7fb28406a770 2023-10-01T08:01:22.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.847+0000 7fb27affd700 1 -- 172.21.15.26:0/1279308023 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27401f070 con 0x7fb28406a770 2023-10-01T08:01:22.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.847+0000 7fb27affd700 1 -- 172.21.15.26:0/1279308023 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2740038e0 con 0x7fb28406a770 2023-10-01T08:01:22.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.847+0000 7fb28c7d5700 1 -- 172.21.15.26:0/1279308023 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2740094a0 con 0x7fb28406a770 2023-10-01T08:01:22.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.847+0000 7fb28c7d5700 1 -- 172.21.15.26:0/1279308023 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2841247e0 con 0x7fb28406a770 2023-10-01T08:01:22.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.847+0000 7fb27affd700 1 -- 172.21.15.26:0/1279308023 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb274003a40 con 0x7fb28406a770 2023-10-01T08:01:22.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.848+0000 7fb27affd700 1 -- 172.21.15.26:0/1279308023 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb274021070 con 0x7fb28406a770 2023-10-01T08:01:22.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.848+0000 7fb28c7d5700 1 -- 172.21.15.26:0/1279308023 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb284074ea0 con 0x7fb28406a770 2023-10-01T08:01:22.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:22.853+0000 7fb27affd700 1 -- 172.21.15.26:0/1279308023 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb27401a7b0 con 0x7fb28406a770 2023-10-01T08:01:23.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.058+0000 7fb28c7d5700 1 -- 172.21.15.26:0/1279308023 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb28406c360 con 0x7fb28406a770 2023-10-01T08:01:23.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.059+0000 7fb27affd700 1 -- 172.21.15.26:0/1279308023 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb274015020 con 0x7fb28406a770 2023-10-01T08:01:23.059 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:23.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.061+0000 7fb28c7d5700 1 -- 172.21.15.26:0/1279308023 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb28406a770 msgr2=0x7fb284120e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:23.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.061+0000 7fb28c7d5700 1 --2- 172.21.15.26:0/1279308023 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb28406a770 0x7fb284120e00 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fb274009fd0 tx=0x7fb274004750 comp rx=0 tx=0).stop 2023-10-01T08:01:23.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.061+0000 7fb28c7d5700 1 -- 172.21.15.26:0/1279308023 shutdown_connections 2023-10-01T08:01:23.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.061+0000 7fb28c7d5700 1 --2- 172.21.15.26:0/1279308023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb284131b40 0x7fb2841c5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:23.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.061+0000 7fb28c7d5700 1 --2- 172.21.15.26:0/1279308023 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb28406a770 0x7fb284120e00 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:23.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.061+0000 7fb28c7d5700 1 --2- 172.21.15.26:0/1279308023 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb28406b080 0x7fb284121340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:23.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.061+0000 7fb28c7d5700 1 -- 172.21.15.26:0/1279308023 >> 172.21.15.26:0/1279308023 conn(0x7fb284066f50 msgr2=0x7fb284070010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:23.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.061+0000 7fb28c7d5700 1 -- 172.21.15.26:0/1279308023 shutdown_connections 2023-10-01T08:01:23.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.061+0000 7fb28c7d5700 1 -- 172.21.15.26:0/1279308023 wait complete. 2023-10-01T08:01:23.077 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:23.320 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:23.383 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:23.428 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:23.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.470+0000 7fb92a35c700 1 Processor -- start 2023-10-01T08:01:23.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.470+0000 7fb92a35c700 1 -- start start 2023-10-01T08:01:23.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.470+0000 7fb92a35c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb924133420 0x7fb9241337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:23.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.470+0000 7fb92a35c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb924133e30 0x7fb92412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:23.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.470+0000 7fb92a35c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb92406b990 con 0x7fb924134260 2023-10-01T08:01:23.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.470+0000 7fb92a35c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9240a0590 con 0x7fb924133420 2023-10-01T08:01:23.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.470+0000 7fb92a35c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb92409fb80 con 0x7fb924133e30 2023-10-01T08:01:23.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.471+0000 7fb923fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb924133420 0x7fb9241337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:23.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.471+0000 7fb923fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb924133420 0x7fb9241337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51338/0 (socket says 172.21.15.26:51338) 2023-10-01T08:01:23.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.471+0000 7fb9288f9700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb924134260 0x7fb9241304d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59428/0 (socket says 172.21.15.26:59428) 2023-10-01T08:01:23.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.471+0000 7fb923fff700 1 -- 172.21.15.26:0/864255434 learned_addr learned my addr 172.21.15.26:0/864255434 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:23.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.471+0000 7fb9237fe700 1 --2- 172.21.15.26:0/864255434 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb924133e30 0x7fb92412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:23.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.471+0000 7fb923fff700 1 -- 172.21.15.26:0/864255434 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb924133e30 msgr2=0x7fb92412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:23.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.471+0000 7fb923fff700 1 --2- 172.21.15.26:0/864255434 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb924133e30 0x7fb92412ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:23.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.471+0000 7fb923fff700 1 -- 172.21.15.26:0/864255434 >> v1:172.21.15.26:6789/0 conn(0x7fb924134260 legacy=0x7fb9241304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:23.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.471+0000 7fb923fff700 1 -- 172.21.15.26:0/864255434 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9240a0030 con 0x7fb924133420 2023-10-01T08:01:23.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.471+0000 7fb9237fe700 1 --2- 172.21.15.26:0/864255434 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb924133e30 0x7fb92412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:23.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.471+0000 7fb923fff700 1 --2- 172.21.15.26:0/864255434 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb924133420 0x7fb9241337f0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fb914009920 tx=0x7fb914009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=711cc98ced772607 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:23.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.471+0000 7fb922ffd700 1 -- 172.21.15.26:0/864255434 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb914011830 con 0x7fb924133420 2023-10-01T08:01:23.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.471+0000 7fb922ffd700 1 -- 172.21.15.26:0/864255434 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb914011990 con 0x7fb924133420 2023-10-01T08:01:23.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.471+0000 7fb922ffd700 1 -- 172.21.15.26:0/864255434 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb914011d20 con 0x7fb924133420 2023-10-01T08:01:23.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.472+0000 7fb92a35c700 1 -- 172.21.15.26:0/864255434 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb924133420 msgr2=0x7fb9241337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:23.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.472+0000 7fb92a35c700 1 --2- 172.21.15.26:0/864255434 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb924133420 0x7fb9241337f0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fb914009920 tx=0x7fb914009c30 comp rx=0 tx=0).stop 2023-10-01T08:01:23.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.472+0000 7fb92a35c700 1 -- 172.21.15.26:0/864255434 shutdown_connections 2023-10-01T08:01:23.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.472+0000 7fb92a35c700 1 --2- 172.21.15.26:0/864255434 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb924133420 0x7fb9241337f0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:23.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.472+0000 7fb92a35c700 1 --2- 172.21.15.26:0/864255434 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb924133e30 0x7fb92412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:23.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.472+0000 7fb92a35c700 1 -- 172.21.15.26:0/864255434 >> 172.21.15.26:0/864255434 conn(0x7fb9240a4210 msgr2=0x7fb9240a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:23.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.472+0000 7fb92a35c700 1 -- 172.21.15.26:0/864255434 shutdown_connections 2023-10-01T08:01:23.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.472+0000 7fb92a35c700 1 -- 172.21.15.26:0/864255434 wait complete. 2023-10-01T08:01:23.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.474+0000 7fb92a35c700 1 Processor -- start 2023-10-01T08:01:23.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.474+0000 7fb92a35c700 1 -- start start 2023-10-01T08:01:23.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.474+0000 7fb92a35c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb924133420 0x7fb92409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:23.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.474+0000 7fb92a35c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb924133e30 0x7fb92409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:23.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.475+0000 7fb92a35c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb924134260 0x7fb92409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:23.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.475+0000 7fb92a35c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb924131a20 con 0x7fb924134260 2023-10-01T08:01:23.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.475+0000 7fb92a35c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb924120f50 con 0x7fb924133420 2023-10-01T08:01:23.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.475+0000 7fb92a35c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb924120510 con 0x7fb924133e30 2023-10-01T08:01:23.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.475+0000 7fb9237fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb924133e30 0x7fb92409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:23.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.475+0000 7fb9288f9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb924134260 0x7fb92409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:23.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.475+0000 7fb9237fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb924133e30 0x7fb92409c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:54154/0 (socket says 172.21.15.26:54154) 2023-10-01T08:01:23.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.475+0000 7fb9237fe700 1 -- 172.21.15.26:0/188771900 learned_addr learned my addr 172.21.15.26:0/188771900 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:23.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.475+0000 7fb923fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb924133420 0x7fb92409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:23.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.475+0000 7fb9237fe700 1 -- 172.21.15.26:0/188771900 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb924133420 msgr2=0x7fb92409c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:23.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.475+0000 7fb9237fe700 1 --2- 172.21.15.26:0/188771900 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb924133420 0x7fb92409c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:23.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.475+0000 7fb9237fe700 1 -- 172.21.15.26:0/188771900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb924134260 msgr2=0x7fb92409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:23.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.475+0000 7fb9237fe700 1 --2- 172.21.15.26:0/188771900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb924134260 0x7fb92409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:23.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.475+0000 7fb9237fe700 1 -- 172.21.15.26:0/188771900 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9180094a0 con 0x7fb924133e30 2023-10-01T08:01:23.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.475+0000 7fb923fff700 1 --2- 172.21.15.26:0/188771900 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb924133420 0x7fb92409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:23.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.475+0000 7fb9237fe700 1 --2- 172.21.15.26:0/188771900 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb924133e30 0x7fb92409c9c0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fb91800ebb0 tx=0x7fb91800eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:23.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.476+0000 7fb920ff9700 1 -- 172.21.15.26:0/188771900 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91800c850 con 0x7fb924133e30 2023-10-01T08:01:23.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.476+0000 7fb920ff9700 1 -- 172.21.15.26:0/188771900 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91800c9b0 con 0x7fb924133e30 2023-10-01T08:01:23.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.476+0000 7fb92a35c700 1 -- 172.21.15.26:0/188771900 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb914009550 con 0x7fb924133e30 2023-10-01T08:01:23.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.476+0000 7fb92a35c700 1 -- 172.21.15.26:0/188771900 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb92412db70 con 0x7fb924133e30 2023-10-01T08:01:23.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.477+0000 7fb920ff9700 1 -- 172.21.15.26:0/188771900 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91800cd40 con 0x7fb924133e30 2023-10-01T08:01:23.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.477+0000 7fb920ff9700 1 -- 172.21.15.26:0/188771900 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb918013470 con 0x7fb924133e30 2023-10-01T08:01:23.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.477+0000 7fb920ff9700 1 -- 172.21.15.26:0/188771900 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb91803f7d0 con 0x7fb924133e30 2023-10-01T08:01:23.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.477+0000 7fb92a35c700 1 -- 172.21.15.26:0/188771900 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9040052e0 con 0x7fb924133e30 2023-10-01T08:01:23.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.482+0000 7fb920ff9700 1 -- 172.21.15.26:0/188771900 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb918021080 con 0x7fb924133e30 2023-10-01T08:01:23.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.526+0000 7f7c7bd6e700 1 Processor -- start 2023-10-01T08:01:23.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.527+0000 7f7c7bd6e700 1 -- start start 2023-10-01T08:01:23.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.527+0000 7f7c7bd6e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7c740a0a30 0x7f7c740a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:23.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.527+0000 7f7c7bd6e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c740a1340 0x7f7c74133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:23.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.527+0000 7f7c7bd6e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c7409edd0 con 0x7f7c74133fa0 2023-10-01T08:01:23.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.527+0000 7f7c7bd6e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7409e1f0 con 0x7f7c740a0a30 2023-10-01T08:01:23.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.527+0000 7f7c7bd6e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7409dc50 con 0x7f7c740a1340 2023-10-01T08:01:23.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.527+0000 7f7c79b0a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7c740a0a30 0x7f7c740a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:23.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.527+0000 7f7c79309700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c740a1340 0x7f7c74133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:23.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.527+0000 7f7c79b0a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7c740a0a30 0x7f7c740a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55592/0 (socket says 172.21.15.26:55592) 2023-10-01T08:01:23.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.527+0000 7f7c79b0a700 1 -- 172.21.15.26:0/1660229311 learned_addr learned my addr 172.21.15.26:0/1660229311 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:23.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.528+0000 7f7c79309700 1 -- 172.21.15.26:0/1660229311 >> v2:172.21.15.26:3300/0 conn(0x7f7c740a0a30 msgr2=0x7f7c740a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:23.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.528+0000 7f7c79309700 1 --2- 172.21.15.26:0/1660229311 >> v2:172.21.15.26:3300/0 conn(0x7f7c740a0a30 0x7f7c740a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:23.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.528+0000 7f7c79309700 1 -- 172.21.15.26:0/1660229311 >> v1:172.21.15.26:6789/0 conn(0x7f7c74133fa0 legacy=0x7f7c7413ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:23.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.528+0000 7f7c79309700 1 -- 172.21.15.26:0/1660229311 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c740a1fe0 con 0x7f7c740a1340 2023-10-01T08:01:23.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.528+0000 7f7c78b08700 1 -- 172.21.15.26:0/1660229311 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2351993089 0 0) 0x7f7c7409edd0 con 0x7f7c74133fa0 2023-10-01T08:01:23.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.528+0000 7f7c79b0a700 1 --2- 172.21.15.26:0/1660229311 >> v2:172.21.15.26:3300/0 conn(0x7f7c740a0a30 0x7f7c740a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:23.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.528+0000 7f7c79309700 1 --2- 172.21.15.26:0/1660229311 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c740a1340 0x7f7c74133a60 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f7c64009840 tx=0x7f7c64009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=833b1713abe5f84a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:23.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.528+0000 7f7c78b08700 1 -- 172.21.15.26:0/1660229311 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c64011830 con 0x7f7c740a1340 2023-10-01T08:01:23.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.528+0000 7f7c78b08700 1 -- 172.21.15.26:0/1660229311 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c64011990 con 0x7f7c740a1340 2023-10-01T08:01:23.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.528+0000 7f7c78b08700 1 -- 172.21.15.26:0/1660229311 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c64011d20 con 0x7f7c740a1340 2023-10-01T08:01:23.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.529+0000 7f7c7bd6e700 1 -- 172.21.15.26:0/1660229311 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c740a1340 msgr2=0x7f7c74133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:23.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.529+0000 7f7c7bd6e700 1 --2- 172.21.15.26:0/1660229311 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c740a1340 0x7f7c74133a60 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f7c64009840 tx=0x7f7c64009b50 comp rx=0 tx=0).stop 2023-10-01T08:01:23.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.529+0000 7f7c7bd6e700 1 -- 172.21.15.26:0/1660229311 shutdown_connections 2023-10-01T08:01:23.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.529+0000 7f7c7bd6e700 1 --2- 172.21.15.26:0/1660229311 >> v2:172.21.15.26:3300/0 conn(0x7f7c740a0a30 0x7f7c740a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:23.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.529+0000 7f7c7bd6e700 1 --2- 172.21.15.26:0/1660229311 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c740a1340 0x7f7c74133a60 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:23.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.529+0000 7f7c7bd6e700 1 -- 172.21.15.26:0/1660229311 >> 172.21.15.26:0/1660229311 conn(0x7f7c740a6550 msgr2=0x7f7c740a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:23.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.529+0000 7f7c7bd6e700 1 -- 172.21.15.26:0/1660229311 shutdown_connections 2023-10-01T08:01:23.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.529+0000 7f7c7bd6e700 1 -- 172.21.15.26:0/1660229311 wait complete. 2023-10-01T08:01:23.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.530+0000 7f7c7bd6e700 1 Processor -- start 2023-10-01T08:01:23.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.530+0000 7f7c7bd6e700 1 -- start start 2023-10-01T08:01:23.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.531+0000 7f7c7bd6e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c740a0a30 0x7f7c7411e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:23.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.531+0000 7f7c7bd6e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c740a1340 0x7f7c7411ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:23.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.531+0000 7f7c7bd6e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7c74133fa0 0x7f7c7411f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:23.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.531+0000 7f7c7bd6e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c74121810 con 0x7f7c740a1340 2023-10-01T08:01:23.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.531+0000 7f7c7bd6e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c74120a80 con 0x7f7c740a0a30 2023-10-01T08:01:23.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.531+0000 7f7c7bd6e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c74122130 con 0x7f7c74133fa0 2023-10-01T08:01:23.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.531+0000 7f7c79b0a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c740a0a30 0x7f7c7411e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:23.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.531+0000 7f7c79b0a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c740a0a30 0x7f7c7411e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51370/0 (socket says 172.21.15.26:51370) 2023-10-01T08:01:23.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.531+0000 7f7c79b0a700 1 -- 172.21.15.26:0/4175958868 learned_addr learned my addr 172.21.15.26:0/4175958868 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:23.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.531+0000 7f7c79309700 1 --2- 172.21.15.26:0/4175958868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c740a1340 0x7f7c7411ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:23.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.531+0000 7f7c7a30b700 1 --2- 172.21.15.26:0/4175958868 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7c74133fa0 0x7f7c7411f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:23.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.531+0000 7f7c79b0a700 1 -- 172.21.15.26:0/4175958868 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7c74133fa0 msgr2=0x7f7c7411f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:23.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.531+0000 7f7c79b0a700 1 --2- 172.21.15.26:0/4175958868 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7c74133fa0 0x7f7c7411f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:23.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.531+0000 7f7c79b0a700 1 -- 172.21.15.26:0/4175958868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c740a1340 msgr2=0x7f7c7411ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:23.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.531+0000 7f7c79b0a700 1 --2- 172.21.15.26:0/4175958868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c740a1340 0x7f7c7411ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:23.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.531+0000 7f7c79b0a700 1 -- 172.21.15.26:0/4175958868 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c70009b30 con 0x7f7c740a0a30 2023-10-01T08:01:23.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.531+0000 7f7c79b0a700 1 --2- 172.21.15.26:0/4175958868 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c740a0a30 0x7f7c7411e720 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000efc0 tx=0x7f7c7000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:23.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.532+0000 7f7c6a7fc700 1 -- 172.21.15.26:0/4175958868 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7000cb00 con 0x7f7c740a0a30 2023-10-01T08:01:23.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.532+0000 7f7c6a7fc700 1 -- 172.21.15.26:0/4175958868 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7000f040 con 0x7f7c740a0a30 2023-10-01T08:01:23.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.532+0000 7f7c6a7fc700 1 -- 172.21.15.26:0/4175958868 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7000ce80 con 0x7f7c740a0a30 2023-10-01T08:01:23.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.532+0000 7f7c7bd6e700 1 -- 172.21.15.26:0/4175958868 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c640094a0 con 0x7f7c740a0a30 2023-10-01T08:01:23.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.532+0000 7f7c7bd6e700 1 -- 172.21.15.26:0/4175958868 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c740a3650 con 0x7f7c740a0a30 2023-10-01T08:01:23.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.533+0000 7f7c7bd6e700 1 -- 172.21.15.26:0/4175958868 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c74121ac0 con 0x7f7c740a0a30 2023-10-01T08:01:23.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.533+0000 7f7c6a7fc700 1 -- 172.21.15.26:0/4175958868 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7c70014480 con 0x7f7c740a0a30 2023-10-01T08:01:23.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.533+0000 7f7c6a7fc700 1 -- 172.21.15.26:0/4175958868 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7c70040ca0 con 0x7f7c740a0a30 2023-10-01T08:01:23.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.542+0000 7f7c6a7fc700 1 -- 172.21.15.26:0/4175958868 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7c70026750 con 0x7f7c740a0a30 2023-10-01T08:01:23.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.571+0000 7f0e9f005700 1 Processor -- start 2023-10-01T08:01:23.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.571+0000 7f0e9f005700 1 -- start start 2023-10-01T08:01:23.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.571+0000 7f0e9f005700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0e980a0a30 0x7f0e980a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:23.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.571+0000 7f0e9f005700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0e9809d630 0x7f0e980a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:23.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.572+0000 7f0e9f005700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e98133930 0x7f0e98133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:23.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.572+0000 7f0e9f005700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e980a2a70 con 0x7f0e9809d630 2023-10-01T08:01:23.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.572+0000 7f0e9f005700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e980a01d0 con 0x7f0e980a0a30 2023-10-01T08:01:23.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.572+0000 7f0e9f005700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9809e2b0 con 0x7f0e98133930 2023-10-01T08:01:23.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.572+0000 7f0e9d5a2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e98133930 0x7f0e98133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:23.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.572+0000 7f0e97fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0e9809d630 0x7f0e980a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:23.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.572+0000 7f0e9d5a2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e98133930 0x7f0e98133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:54176/0 (socket says 172.21.15.26:54176) 2023-10-01T08:01:23.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.572+0000 7f0e9d5a2700 1 -- 172.21.15.26:0/1041707456 learned_addr learned my addr 172.21.15.26:0/1041707456 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:23.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.572+0000 7f0e9cda1700 1 --2- 172.21.15.26:0/1041707456 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0e980a0a30 0x7f0e980a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:23.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.572+0000 7f0e97fff700 1 -- 172.21.15.26:0/1041707456 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e98133930 msgr2=0x7f0e98133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:23.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.572+0000 7f0e97fff700 1 --2- 172.21.15.26:0/1041707456 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e98133930 0x7f0e98133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:23.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.572+0000 7f0e97fff700 1 -- 172.21.15.26:0/1041707456 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0e980a0a30 msgr2=0x7f0e980a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:23.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.572+0000 7f0e97fff700 1 --2- 172.21.15.26:0/1041707456 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0e980a0a30 0x7f0e980a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:23.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.572+0000 7f0e97fff700 1 -- 172.21.15.26:0/1041707456 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9809dc50 con 0x7f0e9809d630 2023-10-01T08:01:23.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.572+0000 7f0e9d5a2700 1 --2- 172.21.15.26:0/1041707456 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e98133930 0x7f0e98133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:23.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.572+0000 7f0e9cda1700 1 --2- 172.21.15.26:0/1041707456 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0e980a0a30 0x7f0e980a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:23.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.572+0000 7f0e97fff700 1 --2- 172.21.15.26:0/1041707456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e9809d630 0x7f0e980a1340 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f0e84009840 tx=0x7f0e84009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=951beb3a637352e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:23.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.573+0000 7f0e977fe700 1 -- 172.21.15.26:0/1041707456 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e84011830 con 0x7f0e9809d630 2023-10-01T08:01:23.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.573+0000 7f0e977fe700 1 -- 172.21.15.26:0/1041707456 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e84011990 con 0x7f0e9809d630 2023-10-01T08:01:23.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.573+0000 7f0e977fe700 1 -- 172.21.15.26:0/1041707456 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e84011d20 con 0x7f0e9809d630 2023-10-01T08:01:23.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.573+0000 7f0e9f005700 1 -- 172.21.15.26:0/1041707456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e9809d630 msgr2=0x7f0e980a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:23.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.573+0000 7f0e9f005700 1 --2- 172.21.15.26:0/1041707456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e9809d630 0x7f0e980a1340 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f0e84009840 tx=0x7f0e84009b50 comp rx=0 tx=0).stop 2023-10-01T08:01:23.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.573+0000 7f0e9f005700 1 -- 172.21.15.26:0/1041707456 shutdown_connections 2023-10-01T08:01:23.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.573+0000 7f0e9f005700 1 --2- 172.21.15.26:0/1041707456 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e98133930 0x7f0e98133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:23.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.573+0000 7f0e9f005700 1 --2- 172.21.15.26:0/1041707456 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0e980a0a30 0x7f0e980a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:23.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.573+0000 7f0e9f005700 1 --2- 172.21.15.26:0/1041707456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e9809d630 0x7f0e980a1340 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:23.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.573+0000 7f0e9f005700 1 -- 172.21.15.26:0/1041707456 >> 172.21.15.26:0/1041707456 conn(0x7f0e980a3050 msgr2=0x7f0e980a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:23.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.573+0000 7f0e9f005700 1 -- 172.21.15.26:0/1041707456 shutdown_connections 2023-10-01T08:01:23.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.573+0000 7f0e9f005700 1 -- 172.21.15.26:0/1041707456 wait complete. 2023-10-01T08:01:23.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.574+0000 7f0e9f005700 1 Processor -- start 2023-10-01T08:01:23.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.574+0000 7f0e9f005700 1 -- start start 2023-10-01T08:01:23.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.575+0000 7f0e9f005700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e9809d630 0x7f0e9811f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:23.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.575+0000 7f0e9f005700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0e980a0a30 0x7f0e9811fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:23.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.575+0000 7f0e9f005700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e98133930 0x7f0e981c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:23.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.575+0000 7f0e9f005700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e981221d0 con 0x7f0e98133930 2023-10-01T08:01:23.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.575+0000 7f0e9f005700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e981212a0 con 0x7f0e980a0a30 2023-10-01T08:01:23.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.575+0000 7f0e9f005700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e98133320 con 0x7f0e9809d630 2023-10-01T08:01:23.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.575+0000 7f0e9d5a2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e98133930 0x7f0e981c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:23.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.575+0000 7f0e9cda1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e9809d630 0x7f0e9811f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:23.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.575+0000 7f0e9d5a2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e98133930 0x7f0e981c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55620/0 (socket says 172.21.15.26:55620) 2023-10-01T08:01:23.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.575+0000 7f0e9d5a2700 1 -- 172.21.15.26:0/2985467141 learned_addr learned my addr 172.21.15.26:0/2985467141 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:23.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.575+0000 7f0e9cda1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e9809d630 0x7f0e9811f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:54188/0 (socket says 172.21.15.26:54188) 2023-10-01T08:01:23.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.575+0000 7f0e97fff700 1 --2- 172.21.15.26:0/2985467141 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0e980a0a30 0x7f0e9811fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:23.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.576+0000 7f0e9d5a2700 1 -- 172.21.15.26:0/2985467141 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e9809d630 msgr2=0x7f0e9811f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:23.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.576+0000 7f0e9d5a2700 1 --2- 172.21.15.26:0/2985467141 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e9809d630 0x7f0e9811f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:23.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.576+0000 7f0e9d5a2700 1 -- 172.21.15.26:0/2985467141 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0e980a0a30 msgr2=0x7f0e9811fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:23.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.576+0000 7f0e9d5a2700 1 --2- 172.21.15.26:0/2985467141 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0e980a0a30 0x7f0e9811fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:23.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.576+0000 7f0e9d5a2700 1 -- 172.21.15.26:0/2985467141 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e8c0094a0 con 0x7f0e98133930 2023-10-01T08:01:23.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.576+0000 7f0e9d5a2700 1 --2- 172.21.15.26:0/2985467141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e98133930 0x7f0e981c8090 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f0e9000efc0 tx=0x7f0e9000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:23.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.576+0000 7f0e957fa700 1 -- 172.21.15.26:0/2985467141 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e90018070 con 0x7f0e98133930 2023-10-01T08:01:23.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.576+0000 7f0e957fa700 1 -- 172.21.15.26:0/2985467141 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9000f040 con 0x7f0e98133930 2023-10-01T08:01:23.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.576+0000 7f0e957fa700 1 -- 172.21.15.26:0/2985467141 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e90003c20 con 0x7f0e98133930 2023-10-01T08:01:23.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.576+0000 7f0e9f005700 1 -- 172.21.15.26:0/2985467141 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e90009b30 con 0x7f0e98133930 2023-10-01T08:01:23.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.576+0000 7f0e9f005700 1 -- 172.21.15.26:0/2985467141 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e840094a0 con 0x7f0e98133930 2023-10-01T08:01:23.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.577+0000 7f0e957fa700 1 -- 172.21.15.26:0/2985467141 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0e9000c880 con 0x7f0e98133930 2023-10-01T08:01:23.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.577+0000 7f0e957fa700 1 -- 172.21.15.26:0/2985467141 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0e9003f750 con 0x7f0e98133930 2023-10-01T08:01:23.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.578+0000 7f0e9f005700 1 -- 172.21.15.26:0/2985467141 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e98121fd0 con 0x7f0e98133930 2023-10-01T08:01:23.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.583+0000 7f0e957fa700 1 -- 172.21.15.26:0/2985467141 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0e90014480 con 0x7f0e98133930 2023-10-01T08:01:23.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.698+0000 7fb92a35c700 1 -- 172.21.15.26:0/188771900 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb904005590 con 0x7fb924133e30 2023-10-01T08:01:23.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.698+0000 7fb920ff9700 1 -- 172.21.15.26:0/188771900 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb918017020 con 0x7fb924133e30 2023-10-01T08:01:23.699 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:23.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.700+0000 7fb92a35c700 1 -- 172.21.15.26:0/188771900 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb924133e30 msgr2=0x7fb92409c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:23.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.701+0000 7fb92a35c700 1 --2- 172.21.15.26:0/188771900 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb924133e30 0x7fb92409c9c0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fb91800ebb0 tx=0x7fb91800eec0 comp rx=0 tx=0).stop 2023-10-01T08:01:23.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.701+0000 7fb92a35c700 1 -- 172.21.15.26:0/188771900 shutdown_connections 2023-10-01T08:01:23.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.701+0000 7fb92a35c700 1 --2- 172.21.15.26:0/188771900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb924134260 0x7fb92409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:23.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.701+0000 7fb92a35c700 1 --2- 172.21.15.26:0/188771900 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb924133420 0x7fb92409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:23.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.701+0000 7fb92a35c700 1 --2- 172.21.15.26:0/188771900 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb924133e30 0x7fb92409c9c0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:23.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.701+0000 7fb92a35c700 1 -- 172.21.15.26:0/188771900 >> 172.21.15.26:0/188771900 conn(0x7fb9240a4210 msgr2=0x7fb9240a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:23.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.701+0000 7fb92a35c700 1 -- 172.21.15.26:0/188771900 shutdown_connections 2023-10-01T08:01:23.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.701+0000 7fb92a35c700 1 -- 172.21.15.26:0/188771900 wait complete. 2023-10-01T08:01:23.715 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:23.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.754+0000 7f7c7bd6e700 1 -- 172.21.15.26:0/4175958868 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7c740a0220 con 0x7f7c740a0a30 2023-10-01T08:01:23.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.754+0000 7f7c6a7fc700 1 -- 172.21.15.26:0/4175958868 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7c70026390 con 0x7f7c740a0a30 2023-10-01T08:01:23.755 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:23.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.757+0000 7f7c7bd6e700 1 -- 172.21.15.26:0/4175958868 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c740a0a30 msgr2=0x7f7c7411e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:23.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.757+0000 7f7c7bd6e700 1 --2- 172.21.15.26:0/4175958868 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c740a0a30 0x7f7c7411e720 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000efc0 tx=0x7f7c7000c3a0 comp rx=0 tx=0).stop 2023-10-01T08:01:23.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.757+0000 7f7c7bd6e700 1 -- 172.21.15.26:0/4175958868 shutdown_connections 2023-10-01T08:01:23.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.757+0000 7f7c7bd6e700 1 --2- 172.21.15.26:0/4175958868 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7c74133fa0 0x7f7c7411f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:23.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.757+0000 7f7c7bd6e700 1 --2- 172.21.15.26:0/4175958868 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c740a0a30 0x7f7c7411e720 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:23.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.757+0000 7f7c7bd6e700 1 --2- 172.21.15.26:0/4175958868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c740a1340 0x7f7c7411ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:23.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.757+0000 7f7c7bd6e700 1 -- 172.21.15.26:0/4175958868 >> 172.21.15.26:0/4175958868 conn(0x7f7c740a6550 msgr2=0x7f7c740a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:23.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.757+0000 7f7c7bd6e700 1 -- 172.21.15.26:0/4175958868 shutdown_connections 2023-10-01T08:01:23.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.757+0000 7f7c7bd6e700 1 -- 172.21.15.26:0/4175958868 wait complete. 2023-10-01T08:01:23.771 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:23.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.788+0000 7f0e9f005700 1 -- 172.21.15.26:0/2985467141 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0e980747f0 con 0x7f0e98133930 2023-10-01T08:01:23.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.788+0000 7f0e957fa700 1 -- 172.21.15.26:0/2985467141 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0e9002c090 con 0x7f0e98133930 2023-10-01T08:01:23.789 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:23.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.791+0000 7f0e9f005700 1 -- 172.21.15.26:0/2985467141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e98133930 msgr2=0x7f0e981c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:23.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.791+0000 7f0e9f005700 1 --2- 172.21.15.26:0/2985467141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e98133930 0x7f0e981c8090 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f0e9000efc0 tx=0x7f0e9000c3a0 comp rx=0 tx=0).stop 2023-10-01T08:01:23.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.791+0000 7f0e9f005700 1 -- 172.21.15.26:0/2985467141 shutdown_connections 2023-10-01T08:01:23.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.791+0000 7f0e9f005700 1 --2- 172.21.15.26:0/2985467141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e98133930 0x7f0e981c8090 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:23.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.791+0000 7f0e9f005700 1 --2- 172.21.15.26:0/2985467141 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0e9809d630 0x7f0e9811f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:23.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.791+0000 7f0e9f005700 1 --2- 172.21.15.26:0/2985467141 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0e980a0a30 0x7f0e9811fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:23.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.791+0000 7f0e9f005700 1 -- 172.21.15.26:0/2985467141 >> 172.21.15.26:0/2985467141 conn(0x7f0e980a3050 msgr2=0x7f0e9809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:23.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.791+0000 7f0e9f005700 1 -- 172.21.15.26:0/2985467141 shutdown_connections 2023-10-01T08:01:23.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:23.791+0000 7f0e9f005700 1 -- 172.21.15.26:0/2985467141 wait complete. 2023-10-01T08:01:23.805 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:24.077 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:24.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.222+0000 7f5662d9b700 1 Processor -- start 2023-10-01T08:01:24.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.222+0000 7f5662d9b700 1 -- start start 2023-10-01T08:01:24.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.223+0000 7f5662d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f565c133a80 0x7f565c133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:24.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.223+0000 7f5662d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f565c12ff20 0x7f565c130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:24.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.223+0000 7f5662d9b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f565c06bc00 con 0x7f565c130870 2023-10-01T08:01:24.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.223+0000 7f5662d9b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f565c06c570 con 0x7f565c133a80 2023-10-01T08:01:24.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.223+0000 7f5662d9b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f565c0a0040 con 0x7f565c12ff20 2023-10-01T08:01:24.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.223+0000 7f5660b37700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f565c133a80 0x7f565c133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:24.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.223+0000 7f565bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f565c12ff20 0x7f565c130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:24.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.223+0000 7f5660b37700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f565c133a80 0x7f565c133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55624/0 (socket says 172.21.15.26:55624) 2023-10-01T08:01:24.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.223+0000 7f565bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f565c12ff20 0x7f565c130330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:54190/0 (socket says 172.21.15.26:54190) 2023-10-01T08:01:24.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.223+0000 7f5660b37700 1 -- 172.21.15.26:0/3550673272 learned_addr learned my addr 172.21.15.26:0/3550673272 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:24.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.223+0000 7f5660b37700 1 -- 172.21.15.26:0/3550673272 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f565c12ff20 msgr2=0x7f565c130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:24.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.223+0000 7f5660b37700 1 --2- 172.21.15.26:0/3550673272 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f565c12ff20 0x7f565c130330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:24.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.223+0000 7f5660b37700 1 -- 172.21.15.26:0/3550673272 >> v1:172.21.15.26:6789/0 conn(0x7f565c130870 legacy=0x7f565c13a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:24.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.223+0000 7f5660b37700 1 -- 172.21.15.26:0/3550673272 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565c133860 con 0x7f565c133a80 2023-10-01T08:01:24.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.223+0000 7f565b7fe700 1 -- 172.21.15.26:0/3550673272 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2006357350 0 0) 0x7f565c06bc00 con 0x7f565c130870 2023-10-01T08:01:24.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.223+0000 7f565bfff700 1 --2- 172.21.15.26:0/3550673272 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f565c12ff20 0x7f565c130330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:24.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.223+0000 7f5660b37700 1 --2- 172.21.15.26:0/3550673272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f565c133a80 0x7f565c133e50 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f564c0098f0 tx=0x7f564c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4041214966dd429b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:24.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.224+0000 7f565b7fe700 1 -- 172.21.15.26:0/3550673272 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c011830 con 0x7f565c133a80 2023-10-01T08:01:24.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.224+0000 7f565b7fe700 1 -- 172.21.15.26:0/3550673272 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564c011990 con 0x7f565c133a80 2023-10-01T08:01:24.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.224+0000 7f565b7fe700 1 -- 172.21.15.26:0/3550673272 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c011d20 con 0x7f565c133a80 2023-10-01T08:01:24.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.224+0000 7f5662d9b700 1 -- 172.21.15.26:0/3550673272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f565c133a80 msgr2=0x7f565c133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:24.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.224+0000 7f5662d9b700 1 --2- 172.21.15.26:0/3550673272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f565c133a80 0x7f565c133e50 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f564c0098f0 tx=0x7f564c009c00 comp rx=0 tx=0).stop 2023-10-01T08:01:24.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.224+0000 7f5662d9b700 1 -- 172.21.15.26:0/3550673272 shutdown_connections 2023-10-01T08:01:24.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.224+0000 7f5662d9b700 1 --2- 172.21.15.26:0/3550673272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f565c133a80 0x7f565c133e50 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:24.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.224+0000 7f5662d9b700 1 --2- 172.21.15.26:0/3550673272 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f565c12ff20 0x7f565c130330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:24.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.224+0000 7f5662d9b700 1 -- 172.21.15.26:0/3550673272 >> 172.21.15.26:0/3550673272 conn(0x7f565c0a4210 msgr2=0x7f565c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:24.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.224+0000 7f5662d9b700 1 -- 172.21.15.26:0/3550673272 shutdown_connections 2023-10-01T08:01:24.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.224+0000 7f5662d9b700 1 -- 172.21.15.26:0/3550673272 wait complete. 2023-10-01T08:01:24.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.225+0000 7f5662d9b700 1 Processor -- start 2023-10-01T08:01:24.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.225+0000 7f5662d9b700 1 -- start start 2023-10-01T08:01:24.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.226+0000 7f5662d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f565c12ff20 0x7f565c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:24.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.226+0000 7f5662d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f565c130870 0x7f565c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:24.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.226+0000 7f5662d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f565c133a80 0x7f565c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:24.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.226+0000 7f5662d9b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565c09deb0 con 0x7f565c130870 2023-10-01T08:01:24.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.226+0000 7f5662d9b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565c11fb20 con 0x7f565c12ff20 2023-10-01T08:01:24.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.226+0000 7f5662d9b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f565c1201a0 con 0x7f565c133a80 2023-10-01T08:01:24.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.226+0000 7f565bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f565c130870 0x7f565c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:24.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.226+0000 7f5660b37700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f565c12ff20 0x7f565c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:24.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.226+0000 7f565bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f565c130870 0x7f565c09c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55634/0 (socket says 172.21.15.26:55634) 2023-10-01T08:01:24.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.226+0000 7f5661338700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f565c133a80 0x7f565c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:24.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.226+0000 7f565bfff700 1 -- 172.21.15.26:0/3600109380 learned_addr learned my addr 172.21.15.26:0/3600109380 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:24.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.226+0000 7f565bfff700 1 -- 172.21.15.26:0/3600109380 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f565c133a80 msgr2=0x7f565c09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:24.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.226+0000 7f565bfff700 1 --2- 172.21.15.26:0/3600109380 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f565c133a80 0x7f565c09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:24.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.226+0000 7f565bfff700 1 -- 172.21.15.26:0/3600109380 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f565c12ff20 msgr2=0x7f565c09c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:24.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.226+0000 7f565bfff700 1 --2- 172.21.15.26:0/3600109380 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f565c12ff20 0x7f565c09c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:24.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.226+0000 7f565bfff700 1 -- 172.21.15.26:0/3600109380 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56500094a0 con 0x7f565c130870 2023-10-01T08:01:24.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.227+0000 7f565bfff700 1 --2- 172.21.15.26:0/3600109380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f565c130870 0x7f565c09c9c0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f565000ebe0 tx=0x7f565000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:24.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.227+0000 7f56597fa700 1 -- 172.21.15.26:0/3600109380 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565000c850 con 0x7f565c130870 2023-10-01T08:01:24.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.227+0000 7f56597fa700 1 -- 172.21.15.26:0/3600109380 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565000c9b0 con 0x7f565c130870 2023-10-01T08:01:24.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.227+0000 7f5662d9b700 1 -- 172.21.15.26:0/3600109380 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f564c009550 con 0x7f565c130870 2023-10-01T08:01:24.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.227+0000 7f56597fa700 1 -- 172.21.15.26:0/3600109380 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565000cd40 con 0x7f565c130870 2023-10-01T08:01:24.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.227+0000 7f5662d9b700 1 -- 172.21.15.26:0/3600109380 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f565c11f420 con 0x7f565c130870 2023-10-01T08:01:24.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.228+0000 7f56597fa700 1 -- 172.21.15.26:0/3600109380 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5650013470 con 0x7f565c130870 2023-10-01T08:01:24.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.228+0000 7f56597fa700 1 -- 172.21.15.26:0/3600109380 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f565003fb50 con 0x7f565c130870 2023-10-01T08:01:24.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.228+0000 7f5662d9b700 1 -- 172.21.15.26:0/3600109380 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f565c120910 con 0x7f565c130870 2023-10-01T08:01:24.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.233+0000 7f56597fa700 1 -- 172.21.15.26:0/3600109380 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5650013720 con 0x7f565c130870 2023-10-01T08:01:24.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.437+0000 7f5662d9b700 1 -- 172.21.15.26:0/3600109380 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f565c074ea0 con 0x7f565c130870 2023-10-01T08:01:24.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.437+0000 7f56597fa700 1 -- 172.21.15.26:0/3600109380 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5650021030 con 0x7f565c130870 2023-10-01T08:01:24.438 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:24.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.440+0000 7f5662d9b700 1 -- 172.21.15.26:0/3600109380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f565c130870 msgr2=0x7f565c09c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:24.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.440+0000 7f5662d9b700 1 --2- 172.21.15.26:0/3600109380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f565c130870 0x7f565c09c9c0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f565000ebe0 tx=0x7f565000eef0 comp rx=0 tx=0).stop 2023-10-01T08:01:24.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.440+0000 7f5662d9b700 1 -- 172.21.15.26:0/3600109380 shutdown_connections 2023-10-01T08:01:24.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.440+0000 7f5662d9b700 1 --2- 172.21.15.26:0/3600109380 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f565c133a80 0x7f565c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:24.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.440+0000 7f5662d9b700 1 --2- 172.21.15.26:0/3600109380 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f565c12ff20 0x7f565c09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:24.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.440+0000 7f5662d9b700 1 --2- 172.21.15.26:0/3600109380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f565c130870 0x7f565c09c9c0 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:24.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.440+0000 7f5662d9b700 1 -- 172.21.15.26:0/3600109380 >> 172.21.15.26:0/3600109380 conn(0x7f565c0a4210 msgr2=0x7f565c09e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:24.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.440+0000 7f5662d9b700 1 -- 172.21.15.26:0/3600109380 shutdown_connections 2023-10-01T08:01:24.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.440+0000 7f5662d9b700 1 -- 172.21.15.26:0/3600109380 wait complete. 2023-10-01T08:01:24.454 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:24.716 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:24.772 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:24.805 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:24.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.866+0000 7f7012c24700 1 Processor -- start 2023-10-01T08:01:24.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.866+0000 7f7012c24700 1 -- start start 2023-10-01T08:01:24.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.867+0000 7f7012c24700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f700c09d6f0 0x7f700c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:24.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.867+0000 7f7012c24700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f700c09e000 0x7f700c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:24.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.867+0000 7f7012c24700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f700c09e410 0x7f700c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:24.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.867+0000 7f7012c24700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f700c09f520 con 0x7f700c09d6f0 2023-10-01T08:01:24.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.867+0000 7f7012c24700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f700c09f130 con 0x7f700c09e410 2023-10-01T08:01:24.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.867+0000 7f7012c24700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f700c09e930 con 0x7f700c09e000 2023-10-01T08:01:24.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.867+0000 7f700bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f700c09e000 0x7f700c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:24.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.867+0000 7f70109c0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f700c09d6f0 0x7f700c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:24.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.867+0000 7f700bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f700c09e000 0x7f700c130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:54212/0 (socket says 172.21.15.26:54212) 2023-10-01T08:01:24.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.868+0000 7f700bfff700 1 -- 172.21.15.26:0/2281761975 learned_addr learned my addr 172.21.15.26:0/2281761975 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:24.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.868+0000 7f70111c1700 1 --2- 172.21.15.26:0/2281761975 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f700c09e410 0x7f700c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:24.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.868+0000 7f70109c0700 1 -- 172.21.15.26:0/2281761975 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f700c09e000 msgr2=0x7f700c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:24.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.868+0000 7f70109c0700 1 --2- 172.21.15.26:0/2281761975 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f700c09e000 0x7f700c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:24.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.868+0000 7f70109c0700 1 -- 172.21.15.26:0/2281761975 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f700c09e410 msgr2=0x7f700c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:24.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.868+0000 7f70109c0700 1 --2- 172.21.15.26:0/2281761975 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f700c09e410 0x7f700c130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:24.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.868+0000 7f70109c0700 1 -- 172.21.15.26:0/2281761975 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f700c09b2d0 con 0x7f700c09d6f0 2023-10-01T08:01:24.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.868+0000 7f700bfff700 1 --2- 172.21.15.26:0/2281761975 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f700c09e000 0x7f700c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:24.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.868+0000 7f70109c0700 1 --2- 172.21.15.26:0/2281761975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f700c09d6f0 0x7f700c09dac0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f7000009870 tx=0x7f7000009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=621ee36b2b4f2ad2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:24.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.868+0000 7f700b7fe700 1 -- 172.21.15.26:0/2281761975 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7000011830 con 0x7f700c09d6f0 2023-10-01T08:01:24.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.868+0000 7f700b7fe700 1 -- 172.21.15.26:0/2281761975 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7000011990 con 0x7f700c09d6f0 2023-10-01T08:01:24.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.868+0000 7f700b7fe700 1 -- 172.21.15.26:0/2281761975 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7000011d20 con 0x7f700c09d6f0 2023-10-01T08:01:24.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.869+0000 7f7012c24700 1 -- 172.21.15.26:0/2281761975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f700c09d6f0 msgr2=0x7f700c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:24.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.869+0000 7f7012c24700 1 --2- 172.21.15.26:0/2281761975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f700c09d6f0 0x7f700c09dac0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f7000009870 tx=0x7f7000009b80 comp rx=0 tx=0).stop 2023-10-01T08:01:24.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.869+0000 7f7012c24700 1 -- 172.21.15.26:0/2281761975 shutdown_connections 2023-10-01T08:01:24.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.869+0000 7f7012c24700 1 --2- 172.21.15.26:0/2281761975 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f700c09e410 0x7f700c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:24.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.869+0000 7f7012c24700 1 --2- 172.21.15.26:0/2281761975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f700c09d6f0 0x7f700c09dac0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:24.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.869+0000 7f7012c24700 1 --2- 172.21.15.26:0/2281761975 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f700c09e000 0x7f700c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:24.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.869+0000 7f7012c24700 1 -- 172.21.15.26:0/2281761975 >> 172.21.15.26:0/2281761975 conn(0x7f700c066f50 msgr2=0x7f700c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:24.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.869+0000 7f7012c24700 1 -- 172.21.15.26:0/2281761975 shutdown_connections 2023-10-01T08:01:24.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.869+0000 7f7012c24700 1 -- 172.21.15.26:0/2281761975 wait complete. 2023-10-01T08:01:24.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.870+0000 7f7012c24700 1 Processor -- start 2023-10-01T08:01:24.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.871+0000 7f7012c24700 1 -- start start 2023-10-01T08:01:24.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.871+0000 7f7012c24700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f700c09d6f0 0x7f700c122430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:24.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.871+0000 7f7012c24700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f700c09e000 0x7f700c122970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:24.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.871+0000 7f7012c24700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f700c09e410 0x7f700c122eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:24.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.871+0000 7f7012c24700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700c123fc0 con 0x7f700c09e000 2023-10-01T08:01:24.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.871+0000 7f7012c24700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f700c125b50 con 0x7f700c09d6f0 2023-10-01T08:01:24.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.871+0000 7f7012c24700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f700c0a16b0 con 0x7f700c09e410 2023-10-01T08:01:24.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.871+0000 7f700bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f700c09e000 0x7f700c122970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:24.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.871+0000 7f70109c0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f700c09d6f0 0x7f700c122430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:24.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.871+0000 7f700bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f700c09e000 0x7f700c122970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55654/0 (socket says 172.21.15.26:55654) 2023-10-01T08:01:24.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.871+0000 7f700bfff700 1 -- 172.21.15.26:0/4253288533 learned_addr learned my addr 172.21.15.26:0/4253288533 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:24.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.872+0000 7f70111c1700 1 --2- 172.21.15.26:0/4253288533 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f700c09e410 0x7f700c122eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:24.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.872+0000 7f700bfff700 1 -- 172.21.15.26:0/4253288533 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f700c09e410 msgr2=0x7f700c122eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:24.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.872+0000 7f700bfff700 1 --2- 172.21.15.26:0/4253288533 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f700c09e410 0x7f700c122eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:24.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.872+0000 7f700bfff700 1 -- 172.21.15.26:0/4253288533 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f700c09d6f0 msgr2=0x7f700c122430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:24.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.872+0000 7f700bfff700 1 --2- 172.21.15.26:0/4253288533 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f700c09d6f0 0x7f700c122430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:24.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.872+0000 7f700bfff700 1 -- 172.21.15.26:0/4253288533 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff800b7f0 con 0x7f700c09e000 2023-10-01T08:01:24.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.872+0000 7f70109c0700 1 --2- 172.21.15.26:0/4253288533 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f700c09d6f0 0x7f700c122430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:24.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.872+0000 7f700bfff700 1 --2- 172.21.15.26:0/4253288533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f700c09e000 0x7f700c122970 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f6ff800ecf0 tx=0x7f6ff800bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:24.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.872+0000 7f70097fa700 1 -- 172.21.15.26:0/4253288533 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff800dd10 con 0x7f700c09e000 2023-10-01T08:01:24.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.872+0000 7f70097fa700 1 -- 172.21.15.26:0/4253288533 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff800de70 con 0x7f700c09e000 2023-10-01T08:01:24.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.872+0000 7f7012c24700 1 -- 172.21.15.26:0/4253288533 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70000094a0 con 0x7f700c09e000 2023-10-01T08:01:24.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.872+0000 7f70097fa700 1 -- 172.21.15.26:0/4253288533 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff8004230 con 0x7f700c09e000 2023-10-01T08:01:24.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.872+0000 7f7012c24700 1 -- 172.21.15.26:0/4253288533 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f700c124710 con 0x7f700c09e000 2023-10-01T08:01:24.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.873+0000 7f70097fa700 1 -- 172.21.15.26:0/4253288533 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6ff8004390 con 0x7f700c09e000 2023-10-01T08:01:24.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.874+0000 7f70097fa700 1 -- 172.21.15.26:0/4253288533 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6ff8014070 con 0x7f700c09e000 2023-10-01T08:01:24.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.874+0000 7f7012c24700 1 -- 172.21.15.26:0/4253288533 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f700c1258c0 con 0x7f700c09e000 2023-10-01T08:01:24.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.879+0000 7f70097fa700 1 -- 172.21.15.26:0/4253288533 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6ff8010440 con 0x7f700c09e000 2023-10-01T08:01:24.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.915+0000 7fc577b77700 1 Processor -- start 2023-10-01T08:01:24.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.915+0000 7fc577b77700 1 -- start start 2023-10-01T08:01:24.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.916+0000 7fc577b77700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc57009d6f0 0x7fc57009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:24.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.916+0000 7fc577b77700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc57009e440 0x7fc570134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:24.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.916+0000 7fc577b77700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc57009b120 con 0x7fc57009e000 2023-10-01T08:01:24.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.916+0000 7fc577b77700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc57006b460 con 0x7fc57009d6f0 2023-10-01T08:01:24.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.916+0000 7fc577b77700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc57009a7e0 con 0x7fc57009e440 2023-10-01T08:01:24.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.916+0000 7fc575913700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc57009d6f0 0x7fc57009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:24.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.916+0000 7fc576114700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc57009e440 0x7fc570134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:24.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.916+0000 7fc575913700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc57009d6f0 0x7fc57009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55666/0 (socket says 172.21.15.26:55666) 2023-10-01T08:01:24.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.916+0000 7fc575913700 1 -- 172.21.15.26:0/2901188410 learned_addr learned my addr 172.21.15.26:0/2901188410 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:24.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.916+0000 7fc575913700 1 -- 172.21.15.26:0/2901188410 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc57009e440 msgr2=0x7fc570134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:24.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.916+0000 7fc575913700 1 --2- 172.21.15.26:0/2901188410 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc57009e440 0x7fc570134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:24.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.916+0000 7fc575913700 1 -- 172.21.15.26:0/2901188410 >> v1:172.21.15.26:6789/0 conn(0x7fc57009e000 legacy=0x7fc5701339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:24.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.916+0000 7fc575913700 1 -- 172.21.15.26:0/2901188410 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57009a500 con 0x7fc57009d6f0 2023-10-01T08:01:24.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.916+0000 7fc574911700 1 -- 172.21.15.26:0/2901188410 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3217868941 0 0) 0x7fc57009b120 con 0x7fc57009e000 2023-10-01T08:01:24.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.917+0000 7fc575913700 1 --2- 172.21.15.26:0/2901188410 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc57009d6f0 0x7fc57009dac0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fc56c009e80 tx=0x7fc56c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46cfb68f42774191 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:24.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.917+0000 7fc574911700 1 -- 172.21.15.26:0/2901188410 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56c00e070 con 0x7fc57009d6f0 2023-10-01T08:01:24.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.917+0000 7fc574911700 1 -- 172.21.15.26:0/2901188410 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56c00b8d0 con 0x7fc57009d6f0 2023-10-01T08:01:24.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.917+0000 7fc574911700 1 -- 172.21.15.26:0/2901188410 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56c00bc80 con 0x7fc57009d6f0 2023-10-01T08:01:24.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.918+0000 7fc577b77700 1 -- 172.21.15.26:0/2901188410 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc57009d6f0 msgr2=0x7fc57009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:24.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.918+0000 7fc577b77700 1 --2- 172.21.15.26:0/2901188410 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc57009d6f0 0x7fc57009dac0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fc56c009e80 tx=0x7fc56c00b330 comp rx=0 tx=0).stop 2023-10-01T08:01:24.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.918+0000 7fc577b77700 1 -- 172.21.15.26:0/2901188410 shutdown_connections 2023-10-01T08:01:24.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.918+0000 7fc577b77700 1 --2- 172.21.15.26:0/2901188410 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc57009e440 0x7fc570134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:24.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.918+0000 7fc577b77700 1 --2- 172.21.15.26:0/2901188410 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc57009d6f0 0x7fc57009dac0 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:24.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.918+0000 7fc577b77700 1 -- 172.21.15.26:0/2901188410 >> 172.21.15.26:0/2901188410 conn(0x7fc570066f50 msgr2=0x7fc57009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:24.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.918+0000 7fc577b77700 1 -- 172.21.15.26:0/2901188410 shutdown_connections 2023-10-01T08:01:24.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.918+0000 7fc577b77700 1 -- 172.21.15.26:0/2901188410 wait complete. 2023-10-01T08:01:24.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.919+0000 7fc577b77700 1 Processor -- start 2023-10-01T08:01:24.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.919+0000 7fc577b77700 1 -- start start 2023-10-01T08:01:24.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.919+0000 7fc577b77700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc57009d6f0 0x7fc5701a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:24.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.919+0000 7fc577b77700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc57009e000 0x7fc5701a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:24.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.919+0000 7fc577b77700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc57009e440 0x7fc5701c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:24.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.919+0000 7fc577b77700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5701a5000 con 0x7fc57009e000 2023-10-01T08:01:24.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.919+0000 7fc577b77700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5701a7ec0 con 0x7fc57009e440 2023-10-01T08:01:24.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.919+0000 7fc577b77700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5701a5e40 con 0x7fc57009d6f0 2023-10-01T08:01:24.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.920+0000 7fc575913700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc57009d6f0 0x7fc5701a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:24.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.920+0000 7fc575913700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc57009d6f0 0x7fc5701a53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:54230/0 (socket says 172.21.15.26:54230) 2023-10-01T08:01:24.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.920+0000 7fc575913700 1 -- 172.21.15.26:0/3323153913 learned_addr learned my addr 172.21.15.26:0/3323153913 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:24.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.920+0000 7fc576114700 1 --2- 172.21.15.26:0/3323153913 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc57009e440 0x7fc5701c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:24.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.920+0000 7fc575112700 1 --2- 172.21.15.26:0/3323153913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc57009e000 0x7fc5701a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:24.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.920+0000 7fc576114700 1 -- 172.21.15.26:0/3323153913 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc57009d6f0 msgr2=0x7fc5701a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:24.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.920+0000 7fc576114700 1 --2- 172.21.15.26:0/3323153913 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc57009d6f0 0x7fc5701a53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:24.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.920+0000 7fc576114700 1 -- 172.21.15.26:0/3323153913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc57009e000 msgr2=0x7fc5701a5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:24.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.920+0000 7fc576114700 1 --2- 172.21.15.26:0/3323153913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc57009e000 0x7fc5701a5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:24.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.920+0000 7fc576114700 1 -- 172.21.15.26:0/3323153913 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56c009b30 con 0x7fc57009e440 2023-10-01T08:01:24.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.920+0000 7fc576114700 1 --2- 172.21.15.26:0/3323153913 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc57009e440 0x7fc5701c81c0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fc56800e880 tx=0x7fc56800eb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:24.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.920+0000 7fc5667fc700 1 -- 172.21.15.26:0/3323153913 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc568013680 con 0x7fc57009e440 2023-10-01T08:01:24.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.921+0000 7fc5667fc700 1 -- 172.21.15.26:0/3323153913 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5680137e0 con 0x7fc57009e440 2023-10-01T08:01:24.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.921+0000 7fc577b77700 1 -- 172.21.15.26:0/3323153913 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5701a6db0 con 0x7fc57009e440 2023-10-01T08:01:24.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.921+0000 7fc5667fc700 1 -- 172.21.15.26:0/3323153913 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc568013b70 con 0x7fc57009e440 2023-10-01T08:01:24.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.921+0000 7fc577b77700 1 -- 172.21.15.26:0/3323153913 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5701b9440 con 0x7fc57009e440 2023-10-01T08:01:24.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.922+0000 7fc577b77700 1 -- 172.21.15.26:0/3323153913 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5701a8cb0 con 0x7fc57009e440 2023-10-01T08:01:24.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.922+0000 7fc5667fc700 1 -- 172.21.15.26:0/3323153913 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc568013cd0 con 0x7fc57009e440 2023-10-01T08:01:24.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.923+0000 7fc5667fc700 1 -- 172.21.15.26:0/3323153913 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc56803ff40 con 0x7fc57009e440 2023-10-01T08:01:24.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.931+0000 7fc5667fc700 1 -- 172.21.15.26:0/3323153913 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc56801adc0 con 0x7fc57009e440 2023-10-01T08:01:24.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.961+0000 7f59e2fdc700 1 Processor -- start 2023-10-01T08:01:24.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.961+0000 7f59e2fdc700 1 -- start start 2023-10-01T08:01:24.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.962+0000 7f59e2fdc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f59dc09e930 0x7f59dc09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:24.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.962+0000 7f59e2fdc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f59dc09f650 0x7f59dc131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:24.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.962+0000 7f59e2fdc700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59dc070940 con 0x7f59dc09f240 2023-10-01T08:01:24.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.962+0000 7f59e2fdc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc06fd60 con 0x7f59dc09f650 2023-10-01T08:01:24.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.962+0000 7f59e2fdc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc06fa80 con 0x7f59dc09e930 2023-10-01T08:01:24.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.962+0000 7f59dbfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f59dc09f240 0x7f59dc1317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59470/0 (socket says 172.21.15.26:59470) 2023-10-01T08:01:24.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.962+0000 7f59e1579700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f59dc09f650 0x7f59dc131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:24.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.962+0000 7f59dbfff700 1 -- 172.21.15.26:0/405854551 learned_addr learned my addr 172.21.15.26:0/405854551 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:01:24.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.962+0000 7f59e0d78700 1 --2- 172.21.15.26:0/405854551 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f59dc09e930 0x7f59dc09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:24.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.963+0000 7f59e1579700 1 -- 172.21.15.26:0/405854551 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f59dc09e930 msgr2=0x7f59dc09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:24.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.963+0000 7f59e1579700 1 --2- 172.21.15.26:0/405854551 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f59dc09e930 0x7f59dc09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:24.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.963+0000 7f59e1579700 1 -- 172.21.15.26:0/405854551 >> v1:172.21.15.26:6789/0 conn(0x7f59dc09f240 legacy=0x7f59dc1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:24.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.963+0000 7f59e1579700 1 -- 172.21.15.26:0/405854551 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59dc09fb60 con 0x7f59dc09f650 2023-10-01T08:01:24.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.963+0000 7f59db7fe700 1 -- 172.21.15.26:0/405854551 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3920511716 0 0) 0x7f59dc070940 con 0x7f59dc09f240 2023-10-01T08:01:24.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.963+0000 7f59e0d78700 1 --2- 172.21.15.26:0/405854551 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f59dc09e930 0x7f59dc09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:24.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.963+0000 7f59e1579700 1 --2- 172.21.15.26:0/405854551 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f59dc09f650 0x7f59dc131f00 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f59d4009dc0 tx=0x7f59d400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd1f220d996fd13b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:24.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.963+0000 7f59db7fe700 1 -- 172.21.15.26:0/405854551 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d400e070 con 0x7f59dc09f650 2023-10-01T08:01:24.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.963+0000 7f59db7fe700 1 -- 172.21.15.26:0/405854551 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d400bb20 con 0x7f59dc09f650 2023-10-01T08:01:24.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.963+0000 7f59db7fe700 1 -- 172.21.15.26:0/405854551 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d4012430 con 0x7f59dc09f650 2023-10-01T08:01:24.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.964+0000 7f59e2fdc700 1 -- 172.21.15.26:0/405854551 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f59dc09f650 msgr2=0x7f59dc131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:24.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.964+0000 7f59e2fdc700 1 --2- 172.21.15.26:0/405854551 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f59dc09f650 0x7f59dc131f00 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f59d4009dc0 tx=0x7f59d400b330 comp rx=0 tx=0).stop 2023-10-01T08:01:24.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.964+0000 7f59e2fdc700 1 -- 172.21.15.26:0/405854551 shutdown_connections 2023-10-01T08:01:24.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.964+0000 7f59e2fdc700 1 --2- 172.21.15.26:0/405854551 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f59dc09e930 0x7f59dc09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:24.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.964+0000 7f59e2fdc700 1 --2- 172.21.15.26:0/405854551 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f59dc09f650 0x7f59dc131f00 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:24.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.964+0000 7f59e2fdc700 1 -- 172.21.15.26:0/405854551 >> 172.21.15.26:0/405854551 conn(0x7f59dc0a4210 msgr2=0x7f59dc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:24.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.964+0000 7f59e2fdc700 1 -- 172.21.15.26:0/405854551 shutdown_connections 2023-10-01T08:01:24.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.964+0000 7f59e2fdc700 1 -- 172.21.15.26:0/405854551 wait complete. 2023-10-01T08:01:24.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.966+0000 7f59e2fdc700 1 Processor -- start 2023-10-01T08:01:24.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.966+0000 7f59e2fdc700 1 -- start start 2023-10-01T08:01:24.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.967+0000 7f59e2fdc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f59dc09e930 0x7f59dc1c2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:24.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.967+0000 7f59e2fdc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59dc09f240 0x7f59dc1c3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:24.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.967+0000 7f59e2fdc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f59dc09f650 0x7f59dc1c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:24.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.967+0000 7f59e2fdc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc1a6e40 con 0x7f59dc09f240 2023-10-01T08:01:24.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.967+0000 7f59e2fdc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc1c3880 con 0x7f59dc09f650 2023-10-01T08:01:24.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.967+0000 7f59e2fdc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc1a56c0 con 0x7f59dc09e930 2023-10-01T08:01:24.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.967+0000 7f59e0d78700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f59dc09e930 0x7f59dc1c2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:24.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.967+0000 7f59e0d78700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f59dc09e930 0x7f59dc1c2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:54234/0 (socket says 172.21.15.26:54234) 2023-10-01T08:01:24.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.967+0000 7f59e0d78700 1 -- 172.21.15.26:0/847523982 learned_addr learned my addr 172.21.15.26:0/847523982 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:24.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.967+0000 7f59dbfff700 1 --2- 172.21.15.26:0/847523982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59dc09f240 0x7f59dc1c3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:24.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.967+0000 7f59e1579700 1 --2- 172.21.15.26:0/847523982 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f59dc09f650 0x7f59dc1c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:24.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.967+0000 7f59e0d78700 1 -- 172.21.15.26:0/847523982 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f59dc09f650 msgr2=0x7f59dc1c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:24.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.967+0000 7f59e0d78700 1 --2- 172.21.15.26:0/847523982 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f59dc09f650 0x7f59dc1c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:24.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.967+0000 7f59e0d78700 1 -- 172.21.15.26:0/847523982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59dc09f240 msgr2=0x7f59dc1c3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:24.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.967+0000 7f59e0d78700 1 --2- 172.21.15.26:0/847523982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59dc09f240 0x7f59dc1c3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:24.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.967+0000 7f59e0d78700 1 -- 172.21.15.26:0/847523982 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59cc0094a0 con 0x7f59dc09e930 2023-10-01T08:01:24.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.967+0000 7f59e0d78700 1 --2- 172.21.15.26:0/847523982 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f59dc09e930 0x7f59dc1c2e00 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f59cc00ec10 tx=0x7f59cc00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:24.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.968+0000 7f59d97fa700 1 -- 172.21.15.26:0/847523982 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59cc00c850 con 0x7f59dc09e930 2023-10-01T08:01:24.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.968+0000 7f59d97fa700 1 -- 172.21.15.26:0/847523982 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59cc00c9b0 con 0x7f59dc09e930 2023-10-01T08:01:24.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.968+0000 7f59e2fdc700 1 -- 172.21.15.26:0/847523982 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d4009a70 con 0x7f59dc09e930 2023-10-01T08:01:24.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.968+0000 7f59d97fa700 1 -- 172.21.15.26:0/847523982 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59cc00cd20 con 0x7f59dc09e930 2023-10-01T08:01:24.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.968+0000 7f59e2fdc700 1 -- 172.21.15.26:0/847523982 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59dc0a0190 con 0x7f59dc09e930 2023-10-01T08:01:24.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.969+0000 7f59d97fa700 1 -- 172.21.15.26:0/847523982 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f59cc013470 con 0x7f59dc09e930 2023-10-01T08:01:24.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.969+0000 7f59e2fdc700 1 -- 172.21.15.26:0/847523982 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59dc071d80 con 0x7f59dc09e930 2023-10-01T08:01:24.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.969+0000 7f59d97fa700 1 -- 172.21.15.26:0/847523982 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f59cc03f7a0 con 0x7f59dc09e930 2023-10-01T08:01:24.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:24.974+0000 7f59d97fa700 1 -- 172.21.15.26:0/847523982 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f59cc013720 con 0x7f59dc09e930 2023-10-01T08:01:25.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.091+0000 7f7012c24700 1 -- 172.21.15.26:0/4253288533 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f700c074ea0 con 0x7f700c09e000 2023-10-01T08:01:25.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.092+0000 7f70097fa700 1 -- 172.21.15.26:0/4253288533 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6ff801d020 con 0x7f700c09e000 2023-10-01T08:01:25.093 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:25.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.094+0000 7f7012c24700 1 -- 172.21.15.26:0/4253288533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f700c09e000 msgr2=0x7f700c122970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:25.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.094+0000 7f7012c24700 1 --2- 172.21.15.26:0/4253288533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f700c09e000 0x7f700c122970 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f6ff800ecf0 tx=0x7f6ff800bef0 comp rx=0 tx=0).stop 2023-10-01T08:01:25.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.094+0000 7f7012c24700 1 -- 172.21.15.26:0/4253288533 shutdown_connections 2023-10-01T08:01:25.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.094+0000 7f7012c24700 1 --2- 172.21.15.26:0/4253288533 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f700c09e410 0x7f700c122eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:25.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.094+0000 7f7012c24700 1 --2- 172.21.15.26:0/4253288533 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f700c09d6f0 0x7f700c122430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:25.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.094+0000 7f7012c24700 1 --2- 172.21.15.26:0/4253288533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f700c09e000 0x7f700c122970 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:25.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.094+0000 7f7012c24700 1 -- 172.21.15.26:0/4253288533 >> 172.21.15.26:0/4253288533 conn(0x7f700c066f50 msgr2=0x7f700c130920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:25.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.094+0000 7f7012c24700 1 -- 172.21.15.26:0/4253288533 shutdown_connections 2023-10-01T08:01:25.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.094+0000 7f7012c24700 1 -- 172.21.15.26:0/4253288533 wait complete. 2023-10-01T08:01:25.113 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:25.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.142+0000 7fc577b77700 1 -- 172.21.15.26:0/3323153913 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc5701a8050 con 0x7fc57009e440 2023-10-01T08:01:25.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.143+0000 7fc5667fc700 1 -- 172.21.15.26:0/3323153913 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc568017020 con 0x7fc57009e440 2023-10-01T08:01:25.144 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:25.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.145+0000 7fc577b77700 1 -- 172.21.15.26:0/3323153913 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc57009e440 msgr2=0x7fc5701c81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:25.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.145+0000 7fc577b77700 1 --2- 172.21.15.26:0/3323153913 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc57009e440 0x7fc5701c81c0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fc56800e880 tx=0x7fc56800eb90 comp rx=0 tx=0).stop 2023-10-01T08:01:25.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.145+0000 7fc577b77700 1 -- 172.21.15.26:0/3323153913 shutdown_connections 2023-10-01T08:01:25.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.145+0000 7fc577b77700 1 --2- 172.21.15.26:0/3323153913 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc57009e440 0x7fc5701c81c0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:25.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.145+0000 7fc577b77700 1 --2- 172.21.15.26:0/3323153913 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc57009d6f0 0x7fc5701a53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:25.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.145+0000 7fc577b77700 1 --2- 172.21.15.26:0/3323153913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc57009e000 0x7fc5701a5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:25.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.145+0000 7fc577b77700 1 -- 172.21.15.26:0/3323153913 >> 172.21.15.26:0/3323153913 conn(0x7fc570066f50 msgr2=0x7fc5701bbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:25.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.145+0000 7fc577b77700 1 -- 172.21.15.26:0/3323153913 shutdown_connections 2023-10-01T08:01:25.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.145+0000 7fc577b77700 1 -- 172.21.15.26:0/3323153913 wait complete. 2023-10-01T08:01:25.160 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:25.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.188+0000 7f59e2fdc700 1 -- 172.21.15.26:0/847523982 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f59dc074ea0 con 0x7f59dc09e930 2023-10-01T08:01:25.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.189+0000 7f59d97fa700 1 -- 172.21.15.26:0/847523982 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f59cc021070 con 0x7f59dc09e930 2023-10-01T08:01:25.190 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:25.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.191+0000 7f59e2fdc700 1 -- 172.21.15.26:0/847523982 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f59dc09e930 msgr2=0x7f59dc1c2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:25.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.191+0000 7f59e2fdc700 1 --2- 172.21.15.26:0/847523982 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f59dc09e930 0x7f59dc1c2e00 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f59cc00ec10 tx=0x7f59cc00ef20 comp rx=0 tx=0).stop 2023-10-01T08:01:25.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.191+0000 7f59e2fdc700 1 -- 172.21.15.26:0/847523982 shutdown_connections 2023-10-01T08:01:25.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.191+0000 7f59e2fdc700 1 --2- 172.21.15.26:0/847523982 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f59dc09f650 0x7f59dc1c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:25.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.191+0000 7f59e2fdc700 1 --2- 172.21.15.26:0/847523982 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f59dc09e930 0x7f59dc1c2e00 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:25.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.191+0000 7f59e2fdc700 1 --2- 172.21.15.26:0/847523982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59dc09f240 0x7f59dc1c3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:25.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.191+0000 7f59e2fdc700 1 -- 172.21.15.26:0/847523982 >> 172.21.15.26:0/847523982 conn(0x7f59dc0a4210 msgr2=0x7f59dc1b89f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:25.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.191+0000 7f59e2fdc700 1 -- 172.21.15.26:0/847523982 shutdown_connections 2023-10-01T08:01:25.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.191+0000 7f59e2fdc700 1 -- 172.21.15.26:0/847523982 wait complete. 2023-10-01T08:01:25.206 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:25.455 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:25.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.601+0000 7fb20bea2700 1 Processor -- start 2023-10-01T08:01:25.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.601+0000 7fb20bea2700 1 -- start start 2023-10-01T08:01:25.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.602+0000 7fb20bea2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb20409e1d0 0x7fb204135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:25.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.602+0000 7fb20bea2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb204135e50 0x7fb204138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:25.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.602+0000 7fb20bea2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb20409f130 con 0x7fb20409d6f0 2023-10-01T08:01:25.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.602+0000 7fb20bea2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb20409f520 con 0x7fb20409e1d0 2023-10-01T08:01:25.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.602+0000 7fb20bea2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20409e930 con 0x7fb204135e50 2023-10-01T08:01:25.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.602+0000 7fb20943d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb20409e1d0 0x7fb204135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:25.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.602+0000 7fb20a43f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb204135e50 0x7fb204138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:25.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.602+0000 7fb20943d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb20409e1d0 0x7fb204135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55692/0 (socket says 172.21.15.26:55692) 2023-10-01T08:01:25.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.602+0000 7fb20943d700 1 -- 172.21.15.26:0/466404886 learned_addr learned my addr 172.21.15.26:0/466404886 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:25.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.602+0000 7fb20943d700 1 -- 172.21.15.26:0/466404886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb204135e50 msgr2=0x7fb204138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:25.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.602+0000 7fb20943d700 1 --2- 172.21.15.26:0/466404886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb204135e50 0x7fb204138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:25.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.602+0000 7fb20943d700 1 -- 172.21.15.26:0/466404886 >> v1:172.21.15.26:6789/0 conn(0x7fb20409d6f0 legacy=0x7fb20409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:25.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.602+0000 7fb20943d700 1 -- 172.21.15.26:0/466404886 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20409b2d0 con 0x7fb20409e1d0 2023-10-01T08:01:25.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.602+0000 7fb208c3c700 1 -- 172.21.15.26:0/466404886 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3703456965 0 0) 0x7fb20409f130 con 0x7fb20409d6f0 2023-10-01T08:01:25.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.602+0000 7fb20a43f700 1 --2- 172.21.15.26:0/466404886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb204135e50 0x7fb204138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:25.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.602+0000 7fb20943d700 1 --2- 172.21.15.26:0/466404886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb20409e1d0 0x7fb204135910 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fb1f80098f0 tx=0x7fb1f8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=199b7b07f6e7043b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:25.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.603+0000 7fb208c3c700 1 -- 172.21.15.26:0/466404886 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f8011830 con 0x7fb20409e1d0 2023-10-01T08:01:25.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.603+0000 7fb208c3c700 1 -- 172.21.15.26:0/466404886 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f8011990 con 0x7fb20409e1d0 2023-10-01T08:01:25.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.603+0000 7fb208c3c700 1 -- 172.21.15.26:0/466404886 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f8011d20 con 0x7fb20409e1d0 2023-10-01T08:01:25.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.603+0000 7fb20bea2700 1 -- 172.21.15.26:0/466404886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb20409e1d0 msgr2=0x7fb204135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:25.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.603+0000 7fb20bea2700 1 --2- 172.21.15.26:0/466404886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb20409e1d0 0x7fb204135910 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fb1f80098f0 tx=0x7fb1f8009c00 comp rx=0 tx=0).stop 2023-10-01T08:01:25.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.603+0000 7fb20bea2700 1 -- 172.21.15.26:0/466404886 shutdown_connections 2023-10-01T08:01:25.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.603+0000 7fb20bea2700 1 --2- 172.21.15.26:0/466404886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb204135e50 0x7fb204138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:25.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.603+0000 7fb20bea2700 1 --2- 172.21.15.26:0/466404886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb20409e1d0 0x7fb204135910 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:25.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.603+0000 7fb20bea2700 1 -- 172.21.15.26:0/466404886 >> 172.21.15.26:0/466404886 conn(0x7fb204066f50 msgr2=0x7fb20409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:25.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.603+0000 7fb20bea2700 1 -- 172.21.15.26:0/466404886 shutdown_connections 2023-10-01T08:01:25.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.603+0000 7fb20bea2700 1 -- 172.21.15.26:0/466404886 wait complete. 2023-10-01T08:01:25.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.604+0000 7fb20bea2700 1 Processor -- start 2023-10-01T08:01:25.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.604+0000 7fb20bea2700 1 -- start start 2023-10-01T08:01:25.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.605+0000 7fb20bea2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb20409d6f0 0x7fb20411c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:25.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.605+0000 7fb20bea2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb20409e1d0 0x7fb20411c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:25.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.605+0000 7fb20bea2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb204135e50 0x7fb20411cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:25.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.605+0000 7fb20bea2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20411dde0 con 0x7fb204135e50 2023-10-01T08:01:25.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.605+0000 7fb20bea2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20411f030 con 0x7fb20409d6f0 2023-10-01T08:01:25.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.605+0000 7fb20bea2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb20411e640 con 0x7fb20409e1d0 2023-10-01T08:01:25.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.605+0000 7fb209c3e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb20409d6f0 0x7fb20411c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:25.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.605+0000 7fb209c3e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb20409d6f0 0x7fb20411c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51438/0 (socket says 172.21.15.26:51438) 2023-10-01T08:01:25.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.605+0000 7fb20a43f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb204135e50 0x7fb20411cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:25.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.605+0000 7fb209c3e700 1 -- 172.21.15.26:0/2966407493 learned_addr learned my addr 172.21.15.26:0/2966407493 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:25.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.605+0000 7fb20943d700 1 --2- 172.21.15.26:0/2966407493 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb20409e1d0 0x7fb20411c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:25.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.605+0000 7fb209c3e700 1 -- 172.21.15.26:0/2966407493 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb20409e1d0 msgr2=0x7fb20411c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:25.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.605+0000 7fb209c3e700 1 --2- 172.21.15.26:0/2966407493 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb20409e1d0 0x7fb20411c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:25.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.605+0000 7fb209c3e700 1 -- 172.21.15.26:0/2966407493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb204135e50 msgr2=0x7fb20411cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:25.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.605+0000 7fb209c3e700 1 --2- 172.21.15.26:0/2966407493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb204135e50 0x7fb20411cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:25.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.605+0000 7fb209c3e700 1 -- 172.21.15.26:0/2966407493 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1fc009a70 con 0x7fb20409d6f0 2023-10-01T08:01:25.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.605+0000 7fb20a43f700 1 --2- 172.21.15.26:0/2966407493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb204135e50 0x7fb20411cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:25.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.606+0000 7fb209c3e700 1 --2- 172.21.15.26:0/2966407493 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb20409d6f0 0x7fb20411c1d0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fb20000c480 tx=0x7fb20000c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:25.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.606+0000 7fb1f67fc700 1 -- 172.21.15.26:0/2966407493 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2000054e0 con 0x7fb20409d6f0 2023-10-01T08:01:25.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.606+0000 7fb1f67fc700 1 -- 172.21.15.26:0/2966407493 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb20000ce40 con 0x7fb20409d6f0 2023-10-01T08:01:25.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.606+0000 7fb20bea2700 1 -- 172.21.15.26:0/2966407493 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1f8009550 con 0x7fb20409d6f0 2023-10-01T08:01:25.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.606+0000 7fb1f67fc700 1 -- 172.21.15.26:0/2966407493 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2000038c0 con 0x7fb20409d6f0 2023-10-01T08:01:25.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.606+0000 7fb20bea2700 1 -- 172.21.15.26:0/2966407493 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2040a3b80 con 0x7fb20409d6f0 2023-10-01T08:01:25.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.607+0000 7fb1f67fc700 1 -- 172.21.15.26:0/2966407493 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb200003a20 con 0x7fb20409d6f0 2023-10-01T08:01:25.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.607+0000 7fb1f67fc700 1 -- 172.21.15.26:0/2966407493 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb20003ea50 con 0x7fb20409d6f0 2023-10-01T08:01:25.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.607+0000 7fb20bea2700 1 -- 172.21.15.26:0/2966407493 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb20406b0a0 con 0x7fb20409d6f0 2023-10-01T08:01:25.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.612+0000 7fb1f67fc700 1 -- 172.21.15.26:0/2966407493 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb200019cd0 con 0x7fb20409d6f0 2023-10-01T08:01:25.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.814+0000 7fb20bea2700 1 -- 172.21.15.26:0/2966407493 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb204074ea0 con 0x7fb20409d6f0 2023-10-01T08:01:25.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.815+0000 7fb1f67fc700 1 -- 172.21.15.26:0/2966407493 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb200017030 con 0x7fb20409d6f0 2023-10-01T08:01:25.816 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:25.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.817+0000 7fb20bea2700 1 -- 172.21.15.26:0/2966407493 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb20409d6f0 msgr2=0x7fb20411c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:25.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.817+0000 7fb20bea2700 1 --2- 172.21.15.26:0/2966407493 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb20409d6f0 0x7fb20411c1d0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fb20000c480 tx=0x7fb20000c790 comp rx=0 tx=0).stop 2023-10-01T08:01:25.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.817+0000 7fb20bea2700 1 -- 172.21.15.26:0/2966407493 shutdown_connections 2023-10-01T08:01:25.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.817+0000 7fb20bea2700 1 --2- 172.21.15.26:0/2966407493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb204135e50 0x7fb20411cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:25.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.817+0000 7fb20bea2700 1 --2- 172.21.15.26:0/2966407493 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb20409d6f0 0x7fb20411c1d0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:25.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.817+0000 7fb20bea2700 1 --2- 172.21.15.26:0/2966407493 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb20409e1d0 0x7fb20411c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:25.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.817+0000 7fb20bea2700 1 -- 172.21.15.26:0/2966407493 >> 172.21.15.26:0/2966407493 conn(0x7fb204066f50 msgr2=0x7fb20406ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:25.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.817+0000 7fb20bea2700 1 -- 172.21.15.26:0/2966407493 shutdown_connections 2023-10-01T08:01:25.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:25.817+0000 7fb20bea2700 1 -- 172.21.15.26:0/2966407493 wait complete. 2023-10-01T08:01:25.831 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:26.115 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:26.161 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:26.217 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:26.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.262+0000 7f5bd7a4e700 1 Processor -- start 2023-10-01T08:01:26.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.263+0000 7f5bd7a4e700 1 -- start start 2023-10-01T08:01:26.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.263+0000 7f5bd7a4e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5bd0130540 0x7f5bd0130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:26.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.263+0000 7f5bd7a4e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bd0130e50 0x7f5bd006f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:26.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.263+0000 7f5bd7a4e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bd006fb20 0x7f5bd006ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:26.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.263+0000 7f5bd7a4e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bd009a390 con 0x7f5bd0130540 2023-10-01T08:01:26.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.263+0000 7f5bd7a4e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd00716a0 con 0x7f5bd0130e50 2023-10-01T08:01:26.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.263+0000 7f5bd7a4e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd0071290 con 0x7f5bd006fb20 2023-10-01T08:01:26.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.264+0000 7f5bd4fe9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bd0130e50 0x7f5bd006f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:26.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.264+0000 7f5bd57ea700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5bd0130540 0x7f5bd0130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:26.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.264+0000 7f5bd4fe9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bd0130e50 0x7f5bd006f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51446/0 (socket says 172.21.15.26:51446) 2023-10-01T08:01:26.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.264+0000 7f5bd4fe9700 1 -- 172.21.15.26:0/2580122405 learned_addr learned my addr 172.21.15.26:0/2580122405 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:26.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.264+0000 7f5bd5feb700 1 --2- 172.21.15.26:0/2580122405 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bd006fb20 0x7f5bd006ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:26.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.264+0000 7f5bd5feb700 1 -- 172.21.15.26:0/2580122405 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bd0130e50 msgr2=0x7f5bd006f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.264+0000 7f5bd5feb700 1 --2- 172.21.15.26:0/2580122405 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bd0130e50 0x7f5bd006f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.264+0000 7f5bd5feb700 1 -- 172.21.15.26:0/2580122405 >> v2:172.21.15.26:3300/0 conn(0x7f5bd0130540 msgr2=0x7f5bd0130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.264+0000 7f5bd5feb700 1 --2- 172.21.15.26:0/2580122405 >> v2:172.21.15.26:3300/0 conn(0x7f5bd0130540 0x7f5bd0130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.264+0000 7f5bd5feb700 1 -- 172.21.15.26:0/2580122405 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd0130340 con 0x7f5bd006fb20 2023-10-01T08:01:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.264+0000 7f5bd57ea700 1 --2- 172.21.15.26:0/2580122405 >> v2:172.21.15.26:3300/0 conn(0x7f5bd0130540 0x7f5bd0130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.264+0000 7f5bd5feb700 1 --2- 172.21.15.26:0/2580122405 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bd006fb20 0x7f5bd006ffa0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f5bc8009d90 tx=0x7f5bc800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb1c63d09d4b9a89 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.264+0000 7f5bc7fff700 1 -- 172.21.15.26:0/2580122405 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc800e070 con 0x7f5bd006fb20 2023-10-01T08:01:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.265+0000 7f5bc7fff700 1 -- 172.21.15.26:0/2580122405 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc800bb20 con 0x7f5bd006fb20 2023-10-01T08:01:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.265+0000 7f5bc7fff700 1 -- 172.21.15.26:0/2580122405 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc8012430 con 0x7f5bd006fb20 2023-10-01T08:01:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.265+0000 7f5bd7a4e700 1 -- 172.21.15.26:0/2580122405 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bd006fb20 msgr2=0x7f5bd006ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:26.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.265+0000 7f5bd7a4e700 1 --2- 172.21.15.26:0/2580122405 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bd006fb20 0x7f5bd006ffa0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f5bc8009d90 tx=0x7f5bc800b330 comp rx=0 tx=0).stop 2023-10-01T08:01:26.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.265+0000 7f5bd7a4e700 1 -- 172.21.15.26:0/2580122405 shutdown_connections 2023-10-01T08:01:26.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.265+0000 7f5bd7a4e700 1 --2- 172.21.15.26:0/2580122405 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bd006fb20 0x7f5bd006ffa0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.265+0000 7f5bd7a4e700 1 --2- 172.21.15.26:0/2580122405 >> v2:172.21.15.26:3300/0 conn(0x7f5bd0130540 0x7f5bd0130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.265+0000 7f5bd7a4e700 1 --2- 172.21.15.26:0/2580122405 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bd0130e50 0x7f5bd006f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.265+0000 7f5bd7a4e700 1 -- 172.21.15.26:0/2580122405 >> 172.21.15.26:0/2580122405 conn(0x7f5bd00a2aa0 msgr2=0x7f5bd00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:26.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.265+0000 7f5bd7a4e700 1 -- 172.21.15.26:0/2580122405 shutdown_connections 2023-10-01T08:01:26.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.266+0000 7f5bd7a4e700 1 -- 172.21.15.26:0/2580122405 wait complete. 2023-10-01T08:01:26.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.267+0000 7f5bd7a4e700 1 Processor -- start 2023-10-01T08:01:26.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.267+0000 7f5bd7a4e700 1 -- start start 2023-10-01T08:01:26.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.268+0000 7f5bd7a4e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bd006fb20 0x7f5bd011a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:26.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.268+0000 7f5bd7a4e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bd0130540 0x7f5bd011ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:26.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.268+0000 7f5bd7a4e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bd0130e50 0x7f5bd011b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:26.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.268+0000 7f5bd7a4e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd011ba80 con 0x7f5bd006fb20 2023-10-01T08:01:26.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.268+0000 7f5bd7a4e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd011c140 con 0x7f5bd0130540 2023-10-01T08:01:26.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.268+0000 7f5bd7a4e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd011e050 con 0x7f5bd0130e50 2023-10-01T08:01:26.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.268+0000 7f5bd57ea700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bd006fb20 0x7f5bd011a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:26.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.268+0000 7f5bd57ea700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bd006fb20 0x7f5bd011a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55720/0 (socket says 172.21.15.26:55720) 2023-10-01T08:01:26.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.268+0000 7f5bd57ea700 1 -- 172.21.15.26:0/140413531 learned_addr learned my addr 172.21.15.26:0/140413531 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:26.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.268+0000 7f5bd4fe9700 1 --2- 172.21.15.26:0/140413531 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bd0130540 0x7f5bd011ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:26.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.268+0000 7f5bd5feb700 1 --2- 172.21.15.26:0/140413531 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bd0130e50 0x7f5bd011b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:26.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.268+0000 7f5bd57ea700 1 -- 172.21.15.26:0/140413531 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bd0130e50 msgr2=0x7f5bd011b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:26.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.268+0000 7f5bd57ea700 1 --2- 172.21.15.26:0/140413531 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bd0130e50 0x7f5bd011b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.268+0000 7f5bd57ea700 1 -- 172.21.15.26:0/140413531 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bd0130540 msgr2=0x7f5bd011ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:26.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.268+0000 7f5bd57ea700 1 --2- 172.21.15.26:0/140413531 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bd0130540 0x7f5bd011ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.268+0000 7f5bd57ea700 1 -- 172.21.15.26:0/140413531 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bcc0094a0 con 0x7f5bd006fb20 2023-10-01T08:01:26.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.268+0000 7f5bd5feb700 1 --2- 172.21.15.26:0/140413531 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bd0130e50 0x7f5bd011b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:26.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.268+0000 7f5bd4fe9700 1 --2- 172.21.15.26:0/140413531 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bd0130540 0x7f5bd011ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T08:01:26.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.269+0000 7f5bd57ea700 1 --2- 172.21.15.26:0/140413531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bd006fb20 0x7f5bd011a5d0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc00ec10 tx=0x7f5bcc00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:26.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.269+0000 7f5bc5ffb700 1 -- 172.21.15.26:0/140413531 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc00c910 con 0x7f5bd006fb20 2023-10-01T08:01:26.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.269+0000 7f5bc5ffb700 1 -- 172.21.15.26:0/140413531 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bcc00ca70 con 0x7f5bd006fb20 2023-10-01T08:01:26.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.269+0000 7f5bc5ffb700 1 -- 172.21.15.26:0/140413531 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc00cde0 con 0x7f5bd006fb20 2023-10-01T08:01:26.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.269+0000 7f5bd7a4e700 1 -- 172.21.15.26:0/140413531 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bc8009a70 con 0x7f5bd006fb20 2023-10-01T08:01:26.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.269+0000 7f5bd7a4e700 1 -- 172.21.15.26:0/140413531 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bd00718e0 con 0x7f5bd006fb20 2023-10-01T08:01:26.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.270+0000 7f5bc5ffb700 1 -- 172.21.15.26:0/140413531 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5bcc013470 con 0x7f5bd006fb20 2023-10-01T08:01:26.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.270+0000 7f5bc5ffb700 1 -- 172.21.15.26:0/140413531 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5bcc03fc00 con 0x7f5bd006fb20 2023-10-01T08:01:26.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.270+0000 7f5bd7a4e700 1 -- 172.21.15.26:0/140413531 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bd009cd40 con 0x7f5bd006fb20 2023-10-01T08:01:26.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.275+0000 7f5bc5ffb700 1 -- 172.21.15.26:0/140413531 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5bcc01b3b0 con 0x7f5bd006fb20 2023-10-01T08:01:26.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.360+0000 7fc2725cb700 1 Processor -- start 2023-10-01T08:01:26.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.360+0000 7fc2725cb700 1 -- start start 2023-10-01T08:01:26.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.361+0000 7fc2725cb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc26c09d6f0 0x7fc26c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:26.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.361+0000 7fc2725cb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc26c09e000 0x7fc26c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:26.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.361+0000 7fc2725cb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc26c09e410 0x7fc26c133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:26.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.361+0000 7fc2725cb700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc26c06b460 con 0x7fc26c09e410 2023-10-01T08:01:26.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.361+0000 7fc2725cb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c09b120 con 0x7fc26c09e000 2023-10-01T08:01:26.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.361+0000 7fc2725cb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c09a7e0 con 0x7fc26c09d6f0 2023-10-01T08:01:26.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.361+0000 7fc270b68700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc26c09e410 0x7fc26c133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:26.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.361+0000 7fc270b68700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc26c09e410 0x7fc26c133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55732/0 (socket says 172.21.15.26:55732) 2023-10-01T08:01:26.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.361+0000 7fc270b68700 1 -- 172.21.15.26:0/517285789 learned_addr learned my addr 172.21.15.26:0/517285789 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:26.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.361+0000 7fc26b7fe700 1 --2- 172.21.15.26:0/517285789 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc26c09e000 0x7fc26c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:26.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.361+0000 7fc26bfff700 1 --2- 172.21.15.26:0/517285789 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc26c09d6f0 0x7fc26c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:26.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.361+0000 7fc270b68700 1 -- 172.21.15.26:0/517285789 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc26c09d6f0 msgr2=0x7fc26c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:26.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.361+0000 7fc270b68700 1 --2- 172.21.15.26:0/517285789 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc26c09d6f0 0x7fc26c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.361+0000 7fc270b68700 1 -- 172.21.15.26:0/517285789 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc26c09e000 msgr2=0x7fc26c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:26.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.361+0000 7fc270b68700 1 --2- 172.21.15.26:0/517285789 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc26c09e000 0x7fc26c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.361+0000 7fc270b68700 1 -- 172.21.15.26:0/517285789 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc26c09a500 con 0x7fc26c09e410 2023-10-01T08:01:26.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.361+0000 7fc26b7fe700 1 --2- 172.21.15.26:0/517285789 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc26c09e000 0x7fc26c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:26.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.362+0000 7fc270b68700 1 --2- 172.21.15.26:0/517285789 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc26c09e410 0x7fc26c133f30 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fc264009e50 tx=0x7fc26400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a26e023dbef4d214 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:26.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.362+0000 7fc26affd700 1 -- 172.21.15.26:0/517285789 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26400e070 con 0x7fc26c09e410 2023-10-01T08:01:26.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.362+0000 7fc26affd700 1 -- 172.21.15.26:0/517285789 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26400b910 con 0x7fc26c09e410 2023-10-01T08:01:26.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.362+0000 7fc26affd700 1 -- 172.21.15.26:0/517285789 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26400bcc0 con 0x7fc26c09e410 2023-10-01T08:01:26.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.362+0000 7fc2725cb700 1 -- 172.21.15.26:0/517285789 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc26c09e410 msgr2=0x7fc26c133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:26.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.362+0000 7fc2725cb700 1 --2- 172.21.15.26:0/517285789 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc26c09e410 0x7fc26c133f30 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fc264009e50 tx=0x7fc26400b330 comp rx=0 tx=0).stop 2023-10-01T08:01:26.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.363+0000 7fc2725cb700 1 -- 172.21.15.26:0/517285789 shutdown_connections 2023-10-01T08:01:26.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.363+0000 7fc2725cb700 1 --2- 172.21.15.26:0/517285789 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc26c09e410 0x7fc26c133f30 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.363+0000 7fc2725cb700 1 --2- 172.21.15.26:0/517285789 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc26c09d6f0 0x7fc26c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.363+0000 7fc2725cb700 1 --2- 172.21.15.26:0/517285789 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc26c09e000 0x7fc26c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.363+0000 7fc2725cb700 1 -- 172.21.15.26:0/517285789 >> 172.21.15.26:0/517285789 conn(0x7fc26c066f50 msgr2=0x7fc26c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:26.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.363+0000 7fc2725cb700 1 -- 172.21.15.26:0/517285789 shutdown_connections 2023-10-01T08:01:26.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.363+0000 7fc2725cb700 1 -- 172.21.15.26:0/517285789 wait complete. 2023-10-01T08:01:26.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.364+0000 7fc2725cb700 1 Processor -- start 2023-10-01T08:01:26.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.364+0000 7fc2725cb700 1 -- start start 2023-10-01T08:01:26.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.364+0000 7fc2725cb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc26c09d6f0 0x7fc26c1a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:26.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.364+0000 7fc2725cb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc26c09e000 0x7fc26c1a5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:26.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.364+0000 7fc2725cb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc26c09e410 0x7fc26c1c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:26.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.364+0000 7fc2725cb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c1a5c90 con 0x7fc26c09e000 2023-10-01T08:01:26.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.364+0000 7fc2725cb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c1b9140 con 0x7fc26c09e410 2023-10-01T08:01:26.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.364+0000 7fc2725cb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c1a4d20 con 0x7fc26c09d6f0 2023-10-01T08:01:26.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.365+0000 7fc26b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc26c09e000 0x7fc26c1a5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:26.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.365+0000 7fc26b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc26c09e000 0x7fc26c1a5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55734/0 (socket says 172.21.15.26:55734) 2023-10-01T08:01:26.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.365+0000 7fc26b7fe700 1 -- 172.21.15.26:0/1472706637 learned_addr learned my addr 172.21.15.26:0/1472706637 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:26.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.365+0000 7fc26bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc26c09d6f0 0x7fc26c1a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:26.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.365+0000 7fc26b7fe700 1 -- 172.21.15.26:0/1472706637 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc26c09d6f0 msgr2=0x7fc26c1a5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:26.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.365+0000 7fc26b7fe700 1 --2- 172.21.15.26:0/1472706637 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc26c09d6f0 0x7fc26c1a5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.365+0000 7fc26b7fe700 1 -- 172.21.15.26:0/1472706637 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc26c09e410 msgr2=0x7fc26c1c8020 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T08:01:26.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.365+0000 7fc26b7fe700 1 --2- 172.21.15.26:0/1472706637 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc26c09e410 0x7fc26c1c8020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.365+0000 7fc26b7fe700 1 -- 172.21.15.26:0/1472706637 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2600094a0 con 0x7fc26c09e000 2023-10-01T08:01:26.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.365+0000 7fc26b7fe700 1 --2- 172.21.15.26:0/1472706637 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc26c09e000 0x7fc26c1a5750 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fc26000ebb0 tx=0x7fc26000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:26.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.365+0000 7fc268ff9700 1 -- 172.21.15.26:0/1472706637 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26000c850 con 0x7fc26c09e000 2023-10-01T08:01:26.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.365+0000 7fc268ff9700 1 -- 172.21.15.26:0/1472706637 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26000c9b0 con 0x7fc26c09e000 2023-10-01T08:01:26.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.365+0000 7fc268ff9700 1 -- 172.21.15.26:0/1472706637 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26000cd20 con 0x7fc26c09e000 2023-10-01T08:01:26.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.365+0000 7fc2725cb700 1 -- 172.21.15.26:0/1472706637 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc264009b30 con 0x7fc26c09e000 2023-10-01T08:01:26.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.365+0000 7fc2725cb700 1 -- 172.21.15.26:0/1472706637 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc26c1a8420 con 0x7fc26c09e000 2023-10-01T08:01:26.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.366+0000 7fc268ff9700 1 -- 172.21.15.26:0/1472706637 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc260013470 con 0x7fc26c09e000 2023-10-01T08:01:26.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.366+0000 7fc268ff9700 1 -- 172.21.15.26:0/1472706637 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc26003fbb0 con 0x7fc26c09e000 2023-10-01T08:01:26.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.367+0000 7fc2725cb700 1 -- 172.21.15.26:0/1472706637 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc26c1a7e50 con 0x7fc26c09e000 2023-10-01T08:01:26.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.370+0000 7f60becd3700 1 Processor -- start 2023-10-01T08:01:26.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.370+0000 7f60becd3700 1 -- start start 2023-10-01T08:01:26.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.370+0000 7f60becd3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60b809d6f0 0x7f60b809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:26.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.370+0000 7f60becd3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f60b809e000 0x7f60b8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:26.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.370+0000 7f60becd3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f60b809e410 0x7f60b8130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:26.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.370+0000 7f60becd3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60b809f520 con 0x7f60b809e410 2023-10-01T08:01:26.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.370+0000 7f60becd3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b809f130 con 0x7f60b809d6f0 2023-10-01T08:01:26.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.370+0000 7f60becd3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60b809e930 con 0x7f60b809e000 2023-10-01T08:01:26.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.370+0000 7f60bca6f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60b809d6f0 0x7f60b809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:26.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.370+0000 7f60bca6f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60b809d6f0 0x7f60b809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51472/0 (socket says 172.21.15.26:51472) 2023-10-01T08:01:26.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.370+0000 7f60bca6f700 1 -- 172.21.15.26:0/2309003845 learned_addr learned my addr 172.21.15.26:0/2309003845 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:26.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.370+0000 7f60b7fff700 1 --2- 172.21.15.26:0/2309003845 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f60b809e000 0x7f60b8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:26.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.371+0000 7f60bd270700 1 --2- 172.21.15.26:0/2309003845 >> v2:172.21.15.26:3300/0 conn(0x7f60b809e410 0x7f60b8130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:26.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.371+0000 7f60bca6f700 1 -- 172.21.15.26:0/2309003845 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f60b809e000 msgr2=0x7f60b8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:26.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.371+0000 7f60bca6f700 1 --2- 172.21.15.26:0/2309003845 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f60b809e000 0x7f60b8130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.371+0000 7f60bca6f700 1 -- 172.21.15.26:0/2309003845 >> v2:172.21.15.26:3300/0 conn(0x7f60b809e410 msgr2=0x7f60b8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:26.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.371+0000 7f60bca6f700 1 --2- 172.21.15.26:0/2309003845 >> v2:172.21.15.26:3300/0 conn(0x7f60b809e410 0x7f60b8130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.371+0000 7f60bca6f700 1 -- 172.21.15.26:0/2309003845 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b809b2d0 con 0x7f60b809d6f0 2023-10-01T08:01:26.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.371+0000 7f60bca6f700 1 --2- 172.21.15.26:0/2309003845 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60b809d6f0 0x7f60b809dac0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f60ac009920 tx=0x7f60ac009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=621c468c5447b559 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:26.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.372+0000 7f60b77fe700 1 -- 172.21.15.26:0/2309003845 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac011830 con 0x7f60b809d6f0 2023-10-01T08:01:26.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.372+0000 7f60b77fe700 1 -- 172.21.15.26:0/2309003845 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ac011990 con 0x7f60b809d6f0 2023-10-01T08:01:26.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.372+0000 7f60b77fe700 1 -- 172.21.15.26:0/2309003845 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac011d00 con 0x7f60b809d6f0 2023-10-01T08:01:26.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.372+0000 7fc268ff9700 1 -- 172.21.15.26:0/1472706637 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc26c1a7e50 con 0x7fc26c09e000 2023-10-01T08:01:26.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.373+0000 7f60becd3700 1 -- 172.21.15.26:0/2309003845 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60b809d6f0 msgr2=0x7f60b809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:26.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.373+0000 7f60becd3700 1 --2- 172.21.15.26:0/2309003845 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60b809d6f0 0x7f60b809dac0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f60ac009920 tx=0x7f60ac009c30 comp rx=0 tx=0).stop 2023-10-01T08:01:26.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.373+0000 7f60becd3700 1 -- 172.21.15.26:0/2309003845 shutdown_connections 2023-10-01T08:01:26.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.373+0000 7f60becd3700 1 --2- 172.21.15.26:0/2309003845 >> v2:172.21.15.26:3300/0 conn(0x7f60b809e410 0x7f60b8130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.373+0000 7f60becd3700 1 --2- 172.21.15.26:0/2309003845 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60b809d6f0 0x7f60b809dac0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.373+0000 7f60becd3700 1 --2- 172.21.15.26:0/2309003845 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f60b809e000 0x7f60b8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.373+0000 7f60becd3700 1 -- 172.21.15.26:0/2309003845 >> 172.21.15.26:0/2309003845 conn(0x7f60b8066f50 msgr2=0x7f60b809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:26.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.373+0000 7f60becd3700 1 -- 172.21.15.26:0/2309003845 shutdown_connections 2023-10-01T08:01:26.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.373+0000 7f60becd3700 1 -- 172.21.15.26:0/2309003845 wait complete. 2023-10-01T08:01:26.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.374+0000 7f60becd3700 1 Processor -- start 2023-10-01T08:01:26.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.374+0000 7f60becd3700 1 -- start start 2023-10-01T08:01:26.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.375+0000 7f60becd3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f60b809d6f0 0x7f60b81d5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:26.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.375+0000 7f60becd3700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60b809e000 0x7f60b81d5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:26.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.375+0000 7f60becd3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60b809e410 0x7f60b81d1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:26.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.375+0000 7f60becd3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b81b76c0 con 0x7f60b809e410 2023-10-01T08:01:26.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.375+0000 7f60becd3700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b81b6a20 con 0x7f60b809e000 2023-10-01T08:01:26.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.375+0000 7f60becd3700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60b81b8870 con 0x7f60b809d6f0 2023-10-01T08:01:26.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.375+0000 7f60bca6f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f60b809d6f0 0x7f60b81d5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:26.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.375+0000 7f60bca6f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f60b809d6f0 0x7f60b81d5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:54300/0 (socket says 172.21.15.26:54300) 2023-10-01T08:01:26.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.375+0000 7f60bca6f700 1 -- 172.21.15.26:0/4116115690 learned_addr learned my addr 172.21.15.26:0/4116115690 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:26.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.375+0000 7f60b7fff700 1 --2- 172.21.15.26:0/4116115690 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60b809e000 0x7f60b81d5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:26.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.375+0000 7f60bd270700 1 --2- 172.21.15.26:0/4116115690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60b809e410 0x7f60b81d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:26.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.375+0000 7f60bca6f700 1 -- 172.21.15.26:0/4116115690 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60b809e000 msgr2=0x7f60b81d5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:26.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.375+0000 7f60bca6f700 1 --2- 172.21.15.26:0/4116115690 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60b809e000 0x7f60b81d5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.375+0000 7f60bca6f700 1 -- 172.21.15.26:0/4116115690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60b809e410 msgr2=0x7f60b81d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:26.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.375+0000 7f60bca6f700 1 --2- 172.21.15.26:0/4116115690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60b809e410 0x7f60b81d1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.375+0000 7f60bca6f700 1 -- 172.21.15.26:0/4116115690 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ac009550 con 0x7f60b809d6f0 2023-10-01T08:01:26.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.375+0000 7f60bca6f700 1 --2- 172.21.15.26:0/4116115690 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f60b809d6f0 0x7f60b81d5330 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f60ac000c00 tx=0x7f60ac004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:26.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.376+0000 7f60b57fa700 1 -- 172.21.15.26:0/4116115690 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac004450 con 0x7f60b809d6f0 2023-10-01T08:01:26.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.376+0000 7f60b57fa700 1 -- 172.21.15.26:0/4116115690 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ac0045d0 con 0x7f60b809d6f0 2023-10-01T08:01:26.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.376+0000 7f60becd3700 1 -- 172.21.15.26:0/4116115690 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60b81309c0 con 0x7f60b809d6f0 2023-10-01T08:01:26.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.376+0000 7f60b57fa700 1 -- 172.21.15.26:0/4116115690 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac0038e0 con 0x7f60b809d6f0 2023-10-01T08:01:26.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.376+0000 7f60becd3700 1 -- 172.21.15.26:0/4116115690 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b81b8c90 con 0x7f60b809d6f0 2023-10-01T08:01:26.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.377+0000 7f60b57fa700 1 -- 172.21.15.26:0/4116115690 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f60ac021070 con 0x7f60b809d6f0 2023-10-01T08:01:26.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.377+0000 7f60becd3700 1 -- 172.21.15.26:0/4116115690 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b8074ea0 con 0x7f60b809d6f0 2023-10-01T08:01:26.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.377+0000 7f60b57fa700 1 -- 172.21.15.26:0/4116115690 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f60ac040930 con 0x7f60b809d6f0 2023-10-01T08:01:26.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.387+0000 7f60b57fa700 1 -- 172.21.15.26:0/4116115690 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f60ac02d990 con 0x7f60b809d6f0 2023-10-01T08:01:26.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.496+0000 7f5bd7a4e700 1 -- 172.21.15.26:0/140413531 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5bd0074ea0 con 0x7f5bd006fb20 2023-10-01T08:01:26.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.496+0000 7f5bc5ffb700 1 -- 172.21.15.26:0/140413531 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5bcc021030 con 0x7f5bd006fb20 2023-10-01T08:01:26.497 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:26.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.499+0000 7f5bd7a4e700 1 -- 172.21.15.26:0/140413531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bd006fb20 msgr2=0x7f5bd011a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.499+0000 7f5bd7a4e700 1 --2- 172.21.15.26:0/140413531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bd006fb20 0x7f5bd011a5d0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc00ec10 tx=0x7f5bcc00ef20 comp rx=0 tx=0).stop 2023-10-01T08:01:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.499+0000 7f5bd7a4e700 1 -- 172.21.15.26:0/140413531 shutdown_connections 2023-10-01T08:01:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.499+0000 7f5bd7a4e700 1 --2- 172.21.15.26:0/140413531 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5bd0130e50 0x7f5bd011b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.499+0000 7f5bd7a4e700 1 --2- 172.21.15.26:0/140413531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bd006fb20 0x7f5bd011a5d0 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.499+0000 7f5bd7a4e700 1 --2- 172.21.15.26:0/140413531 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5bd0130540 0x7f5bd011ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.499+0000 7f5bd7a4e700 1 -- 172.21.15.26:0/140413531 >> 172.21.15.26:0/140413531 conn(0x7f5bd00a2aa0 msgr2=0x7f5bd012d470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.499+0000 7f5bd7a4e700 1 -- 172.21.15.26:0/140413531 shutdown_connections 2023-10-01T08:01:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.499+0000 7f5bd7a4e700 1 -- 172.21.15.26:0/140413531 wait complete. 2023-10-01T08:01:26.513 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:26.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.599+0000 7fc2725cb700 1 -- 172.21.15.26:0/1472706637 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc26c1a7e50 con 0x7fc26c09e000 2023-10-01T08:01:26.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.599+0000 7fc268ff9700 1 -- 172.21.15.26:0/1472706637 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc26c1a7e50 con 0x7fc26c09e000 2023-10-01T08:01:26.600 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:26.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.602+0000 7fc2725cb700 1 -- 172.21.15.26:0/1472706637 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc26c09e000 msgr2=0x7fc26c1a5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:26.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.602+0000 7fc2725cb700 1 --2- 172.21.15.26:0/1472706637 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc26c09e000 0x7fc26c1a5750 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fc26000ebb0 tx=0x7fc26000eec0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.602+0000 7fc2725cb700 1 -- 172.21.15.26:0/1472706637 shutdown_connections 2023-10-01T08:01:26.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.602+0000 7fc2725cb700 1 --2- 172.21.15.26:0/1472706637 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc26c09e410 0x7fc26c1c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.602+0000 7fc2725cb700 1 --2- 172.21.15.26:0/1472706637 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc26c09d6f0 0x7fc26c1a5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.602+0000 7fc2725cb700 1 --2- 172.21.15.26:0/1472706637 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc26c09e000 0x7fc26c1a5750 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.602+0000 7fc2725cb700 1 -- 172.21.15.26:0/1472706637 >> 172.21.15.26:0/1472706637 conn(0x7fc26c066f50 msgr2=0x7fc26c1bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:26.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.602+0000 7fc2725cb700 1 -- 172.21.15.26:0/1472706637 shutdown_connections 2023-10-01T08:01:26.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.602+0000 7fc2725cb700 1 -- 172.21.15.26:0/1472706637 wait complete. 2023-10-01T08:01:26.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.607+0000 7f60becd3700 1 -- 172.21.15.26:0/4116115690 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f60b806c360 con 0x7f60b809d6f0 2023-10-01T08:01:26.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.607+0000 7f60b57fa700 1 -- 172.21.15.26:0/4116115690 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f60ac029030 con 0x7f60b809d6f0 2023-10-01T08:01:26.608 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:26.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.610+0000 7f60becd3700 1 -- 172.21.15.26:0/4116115690 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f60b809d6f0 msgr2=0x7f60b81d5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:26.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.610+0000 7f60becd3700 1 --2- 172.21.15.26:0/4116115690 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f60b809d6f0 0x7f60b81d5330 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f60ac000c00 tx=0x7f60ac004750 comp rx=0 tx=0).stop 2023-10-01T08:01:26.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.610+0000 7f60becd3700 1 -- 172.21.15.26:0/4116115690 shutdown_connections 2023-10-01T08:01:26.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.610+0000 7f60becd3700 1 --2- 172.21.15.26:0/4116115690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60b809e410 0x7f60b81d1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.610+0000 7f60becd3700 1 --2- 172.21.15.26:0/4116115690 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f60b809d6f0 0x7f60b81d5330 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.610+0000 7f60becd3700 1 --2- 172.21.15.26:0/4116115690 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60b809e000 0x7f60b81d5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.610+0000 7f60becd3700 1 -- 172.21.15.26:0/4116115690 >> 172.21.15.26:0/4116115690 conn(0x7f60b8066f50 msgr2=0x7f60b80718b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:26.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.610+0000 7f60becd3700 1 -- 172.21.15.26:0/4116115690 shutdown_connections 2023-10-01T08:01:26.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.610+0000 7f60becd3700 1 -- 172.21.15.26:0/4116115690 wait complete. 2023-10-01T08:01:26.618 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:26.625 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:26.833 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:26.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.978+0000 7f96ced52700 1 Processor -- start 2023-10-01T08:01:26.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.978+0000 7f96ced52700 1 -- start start 2023-10-01T08:01:26.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.978+0000 7f96ced52700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96c809d6f0 0x7f96c809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:26.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.978+0000 7f96ced52700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f96c809e000 0x7f96c81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:26.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.978+0000 7f96ced52700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96c809e410 0x7f96c8133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:26.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.978+0000 7f96ced52700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96c806b460 con 0x7f96c809e000 2023-10-01T08:01:26.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.978+0000 7f96ced52700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c809b120 con 0x7f96c809e410 2023-10-01T08:01:26.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.978+0000 7f96ced52700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96c809a7e0 con 0x7f96c809d6f0 2023-10-01T08:01:26.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.978+0000 7f96cd2ef700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96c809e410 0x7f96c8133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:26.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.978+0000 7f96c7fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f96c809e000 0x7f96c81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:26.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.979+0000 7f96cd2ef700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96c809e410 0x7f96c8133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51476/0 (socket says 172.21.15.26:51476) 2023-10-01T08:01:26.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.979+0000 7f96cd2ef700 1 -- 172.21.15.26:0/1712372833 learned_addr learned my addr 172.21.15.26:0/1712372833 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:26.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.979+0000 7f96ccaee700 1 --2- 172.21.15.26:0/1712372833 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96c809d6f0 0x7f96c809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:26.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.979+0000 7f96c7fff700 1 -- 172.21.15.26:0/1712372833 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96c809d6f0 msgr2=0x7f96c809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:26.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.979+0000 7f96c7fff700 1 --2- 172.21.15.26:0/1712372833 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96c809d6f0 0x7f96c809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.979+0000 7f96c7fff700 1 -- 172.21.15.26:0/1712372833 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96c809e410 msgr2=0x7f96c8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:26.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.979+0000 7f96c7fff700 1 --2- 172.21.15.26:0/1712372833 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96c809e410 0x7f96c8133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.979+0000 7f96c7fff700 1 -- 172.21.15.26:0/1712372833 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c809a500 con 0x7f96c809e000 2023-10-01T08:01:26.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.979+0000 7f96cd2ef700 1 --2- 172.21.15.26:0/1712372833 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96c809e410 0x7f96c8133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:26.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.979+0000 7f96ccaee700 1 --2- 172.21.15.26:0/1712372833 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96c809d6f0 0x7f96c809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:26.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.979+0000 7f96c7fff700 1 --2- 172.21.15.26:0/1712372833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96c809e000 0x7f96c81339f0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f96b0009840 tx=0x7f96b0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c745466c0f8329 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:26.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.979+0000 7f96c77fe700 1 -- 172.21.15.26:0/1712372833 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b0011830 con 0x7f96c809e000 2023-10-01T08:01:26.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.979+0000 7f96c77fe700 1 -- 172.21.15.26:0/1712372833 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b0011990 con 0x7f96c809e000 2023-10-01T08:01:26.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.979+0000 7f96c77fe700 1 -- 172.21.15.26:0/1712372833 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b0011d20 con 0x7f96c809e000 2023-10-01T08:01:26.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.980+0000 7f96ced52700 1 -- 172.21.15.26:0/1712372833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96c809e000 msgr2=0x7f96c81339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:26.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.980+0000 7f96ced52700 1 --2- 172.21.15.26:0/1712372833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96c809e000 0x7f96c81339f0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f96b0009840 tx=0x7f96b0009b50 comp rx=0 tx=0).stop 2023-10-01T08:01:26.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.980+0000 7f96ced52700 1 -- 172.21.15.26:0/1712372833 shutdown_connections 2023-10-01T08:01:26.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.980+0000 7f96ced52700 1 --2- 172.21.15.26:0/1712372833 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96c809e410 0x7f96c8133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.980+0000 7f96ced52700 1 --2- 172.21.15.26:0/1712372833 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96c809d6f0 0x7f96c809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.980+0000 7f96ced52700 1 --2- 172.21.15.26:0/1712372833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96c809e000 0x7f96c81339f0 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.980+0000 7f96ced52700 1 -- 172.21.15.26:0/1712372833 >> 172.21.15.26:0/1712372833 conn(0x7f96c8066f50 msgr2=0x7f96c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:26.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.980+0000 7f96ced52700 1 -- 172.21.15.26:0/1712372833 shutdown_connections 2023-10-01T08:01:26.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.980+0000 7f96ced52700 1 -- 172.21.15.26:0/1712372833 wait complete. 2023-10-01T08:01:26.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.981+0000 7f96ced52700 1 Processor -- start 2023-10-01T08:01:26.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.981+0000 7f96ced52700 1 -- start start 2023-10-01T08:01:26.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.982+0000 7f96ced52700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96c809d6f0 0x7f96c81a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:26.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.982+0000 7f96ced52700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96c809e000 0x7f96c81a6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:26.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.982+0000 7f96ced52700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96c809e410 0x7f96c81a69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:26.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.982+0000 7f96ced52700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c80a2090 con 0x7f96c809e000 2023-10-01T08:01:26.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.982+0000 7f96ced52700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c81a9310 con 0x7f96c809d6f0 2023-10-01T08:01:26.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.982+0000 7f96ced52700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96c809c710 con 0x7f96c809e410 2023-10-01T08:01:26.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.982+0000 7f96ccaee700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96c809d6f0 0x7f96c81a5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:26.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.982+0000 7f96c7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96c809e000 0x7f96c81a6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:26.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.982+0000 7f96ccaee700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96c809d6f0 0x7f96c81a5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51488/0 (socket says 172.21.15.26:51488) 2023-10-01T08:01:26.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.982+0000 7f96cd2ef700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96c809e410 0x7f96c81a69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:26.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.982+0000 7f96ccaee700 1 -- 172.21.15.26:0/899710219 learned_addr learned my addr 172.21.15.26:0/899710219 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:26.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.982+0000 7f96c7fff700 1 -- 172.21.15.26:0/899710219 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96c809e410 msgr2=0x7f96c81a69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:26.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.982+0000 7f96c7fff700 1 --2- 172.21.15.26:0/899710219 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96c809e410 0x7f96c81a69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.982+0000 7f96c7fff700 1 -- 172.21.15.26:0/899710219 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96c809d6f0 msgr2=0x7f96c81a5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:26.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.982+0000 7f96c7fff700 1 --2- 172.21.15.26:0/899710219 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96c809d6f0 0x7f96c81a5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:26.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.982+0000 7f96c7fff700 1 -- 172.21.15.26:0/899710219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b80094a0 con 0x7f96c809e000 2023-10-01T08:01:26.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.982+0000 7f96cd2ef700 1 --2- 172.21.15.26:0/899710219 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96c809e410 0x7f96c81a69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:26.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.982+0000 7f96ccaee700 1 --2- 172.21.15.26:0/899710219 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96c809d6f0 0x7f96c81a5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:26.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.982+0000 7f96c7fff700 1 --2- 172.21.15.26:0/899710219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96c809e000 0x7f96c81a6480 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f96c806e510 tx=0x7f96b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:26.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.982+0000 7f96c57fa700 1 -- 172.21.15.26:0/899710219 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b0004450 con 0x7f96c809e000 2023-10-01T08:01:26.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.983+0000 7f96c57fa700 1 -- 172.21.15.26:0/899710219 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b001f070 con 0x7f96c809e000 2023-10-01T08:01:26.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.983+0000 7f96c57fa700 1 -- 172.21.15.26:0/899710219 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b00038c0 con 0x7f96c809e000 2023-10-01T08:01:26.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.983+0000 7f96ced52700 1 -- 172.21.15.26:0/899710219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96c0009b30 con 0x7f96c809e000 2023-10-01T08:01:26.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.983+0000 7f96ced52700 1 -- 172.21.15.26:0/899710219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b00094a0 con 0x7f96c809e000 2023-10-01T08:01:26.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.983+0000 7f96c57fa700 1 -- 172.21.15.26:0/899710219 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f96b0003a20 con 0x7f96c809e000 2023-10-01T08:01:26.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.984+0000 7f96c57fa700 1 -- 172.21.15.26:0/899710219 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f96b0021070 con 0x7f96c809e000 2023-10-01T08:01:26.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.984+0000 7f96ced52700 1 -- 172.21.15.26:0/899710219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96c81a7ab0 con 0x7f96c809e000 2023-10-01T08:01:26.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:26.989+0000 7f96c57fa700 1 -- 172.21.15.26:0/899710219 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f96b002b070 con 0x7f96c809e000 2023-10-01T08:01:27.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.192+0000 7f96ced52700 1 -- 172.21.15.26:0/899710219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f96c8074ea0 con 0x7f96c809e000 2023-10-01T08:01:27.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.192+0000 7f96c57fa700 1 -- 172.21.15.26:0/899710219 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f96b0015030 con 0x7f96c809e000 2023-10-01T08:01:27.193 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:27.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.194+0000 7f96ced52700 1 -- 172.21.15.26:0/899710219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96c809e000 msgr2=0x7f96c81a6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:27.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.194+0000 7f96ced52700 1 --2- 172.21.15.26:0/899710219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96c809e000 0x7f96c81a6480 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f96c806e510 tx=0x7f96b0004750 comp rx=0 tx=0).stop 2023-10-01T08:01:27.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.194+0000 7f96ced52700 1 -- 172.21.15.26:0/899710219 shutdown_connections 2023-10-01T08:01:27.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.194+0000 7f96ced52700 1 --2- 172.21.15.26:0/899710219 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f96c809e410 0x7f96c81a69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:27.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.194+0000 7f96ced52700 1 --2- 172.21.15.26:0/899710219 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f96c809d6f0 0x7f96c81a5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:27.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.194+0000 7f96ced52700 1 --2- 172.21.15.26:0/899710219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96c809e000 0x7f96c81a6480 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:27.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.194+0000 7f96ced52700 1 -- 172.21.15.26:0/899710219 >> 172.21.15.26:0/899710219 conn(0x7f96c8066f50 msgr2=0x7f96c81bae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:27.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.194+0000 7f96ced52700 1 -- 172.21.15.26:0/899710219 shutdown_connections 2023-10-01T08:01:27.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.195+0000 7f96ced52700 1 -- 172.21.15.26:0/899710219 wait complete. 2023-10-01T08:01:27.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:27.514 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:27.619 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:27.626 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:27.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.662+0000 7f1c21cc1700 1 Processor -- start 2023-10-01T08:01:27.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.662+0000 7f1c21cc1700 1 -- start start 2023-10-01T08:01:27.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.662+0000 7f1c21cc1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c1c0a0a30 0x7f1c1c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:27.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.662+0000 7f1c21cc1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1c1c0a1340 0x7f1c1c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:27.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.662+0000 7f1c21cc1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c1c09edd0 con 0x7f1c1c133fa0 2023-10-01T08:01:27.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.662+0000 7f1c21cc1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c1c09e1f0 con 0x7f1c1c0a1340 2023-10-01T08:01:27.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.662+0000 7f1c21cc1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c09dc50 con 0x7f1c1c0a0a30 2023-10-01T08:01:27.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.662+0000 7f1c1b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c1c0a0a30 0x7f1c1c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:27.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.662+0000 7f1c1affd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1c1c0a1340 0x7f1c1c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:27.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.662+0000 7f1c1b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c1c0a0a30 0x7f1c1c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51494/0 (socket says 172.21.15.26:51494) 2023-10-01T08:01:27.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.662+0000 7f1c1b7fe700 1 -- 172.21.15.26:0/252737207 learned_addr learned my addr 172.21.15.26:0/252737207 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:27.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.663+0000 7f1c1b7fe700 1 -- 172.21.15.26:0/252737207 >> v2:172.21.15.26:3300/0 conn(0x7f1c1c0a1340 msgr2=0x7f1c1c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:27.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.663+0000 7f1c1b7fe700 1 --2- 172.21.15.26:0/252737207 >> v2:172.21.15.26:3300/0 conn(0x7f1c1c0a1340 0x7f1c1c133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:27.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.663+0000 7f1c1b7fe700 1 -- 172.21.15.26:0/252737207 >> v1:172.21.15.26:6789/0 conn(0x7f1c1c133fa0 legacy=0x7f1c1c13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:27.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.663+0000 7f1c1b7fe700 1 -- 172.21.15.26:0/252737207 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1c0a1fe0 con 0x7f1c1c0a0a30 2023-10-01T08:01:27.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.663+0000 7f1c1b7fe700 1 --2- 172.21.15.26:0/252737207 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c1c0a0a30 0x7f1c1c0a0e00 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009e50 tx=0x7f1c0c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e757c51b493f8a3d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:27.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.663+0000 7f1c1a7fc700 1 -- 172.21.15.26:0/252737207 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c00e070 con 0x7f1c1c0a0a30 2023-10-01T08:01:27.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.663+0000 7f1c1a7fc700 1 -- 172.21.15.26:0/252737207 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0c00b910 con 0x7f1c1c0a0a30 2023-10-01T08:01:27.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.663+0000 7f1c1a7fc700 1 -- 172.21.15.26:0/252737207 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c00bcc0 con 0x7f1c1c0a0a30 2023-10-01T08:01:27.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.664+0000 7f1c21cc1700 1 -- 172.21.15.26:0/252737207 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c1c0a0a30 msgr2=0x7f1c1c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:27.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.664+0000 7f1c21cc1700 1 --2- 172.21.15.26:0/252737207 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c1c0a0a30 0x7f1c1c0a0e00 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009e50 tx=0x7f1c0c00b330 comp rx=0 tx=0).stop 2023-10-01T08:01:27.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.665+0000 7f1c21cc1700 1 -- 172.21.15.26:0/252737207 shutdown_connections 2023-10-01T08:01:27.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.665+0000 7f1c21cc1700 1 --2- 172.21.15.26:0/252737207 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c1c0a0a30 0x7f1c1c0a0e00 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:27.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.665+0000 7f1c21cc1700 1 --2- 172.21.15.26:0/252737207 >> v2:172.21.15.26:3300/0 conn(0x7f1c1c0a1340 0x7f1c1c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:27.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.665+0000 7f1c21cc1700 1 -- 172.21.15.26:0/252737207 >> 172.21.15.26:0/252737207 conn(0x7f1c1c0a6550 msgr2=0x7f1c1c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:27.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.665+0000 7f1c21cc1700 1 -- 172.21.15.26:0/252737207 shutdown_connections 2023-10-01T08:01:27.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.665+0000 7f1c21cc1700 1 -- 172.21.15.26:0/252737207 wait complete. 2023-10-01T08:01:27.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.667+0000 7f1c21cc1700 1 Processor -- start 2023-10-01T08:01:27.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.667+0000 7f1c21cc1700 1 -- start start 2023-10-01T08:01:27.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.668+0000 7f1c21cc1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c1c0a0a30 0x7f1c1c11e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:27.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.668+0000 7f1c21cc1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c1c0a1340 0x7f1c1c11ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:27.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.668+0000 7f1c21cc1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c1c133fa0 0x7f1c1c11f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:27.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.668+0000 7f1c21cc1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c121f50 con 0x7f1c1c0a1340 2023-10-01T08:01:27.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.668+0000 7f1c21cc1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c120430 con 0x7f1c1c0a0a30 2023-10-01T08:01:27.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.668+0000 7f1c21cc1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c0a37e0 con 0x7f1c1c133fa0 2023-10-01T08:01:27.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.668+0000 7f1c1affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c1c0a1340 0x7f1c1c11ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:27.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.668+0000 7f1c1affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c1c0a1340 0x7f1c1c11ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55788/0 (socket says 172.21.15.26:55788) 2023-10-01T08:01:27.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.668+0000 7f1c1b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c1c0a0a30 0x7f1c1c11e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:27.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.668+0000 7f1c1affd700 1 -- 172.21.15.26:0/1987410023 learned_addr learned my addr 172.21.15.26:0/1987410023 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:27.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.668+0000 7f1c1bfff700 1 --2- 172.21.15.26:0/1987410023 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c1c133fa0 0x7f1c1c11f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:27.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.668+0000 7f1c1b7fe700 1 -- 172.21.15.26:0/1987410023 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c1c133fa0 msgr2=0x7f1c1c11f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:27.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.668+0000 7f1c1b7fe700 1 --2- 172.21.15.26:0/1987410023 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c1c133fa0 0x7f1c1c11f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:27.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.668+0000 7f1c1b7fe700 1 -- 172.21.15.26:0/1987410023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c1c0a1340 msgr2=0x7f1c1c11ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:27.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.668+0000 7f1c1b7fe700 1 --2- 172.21.15.26:0/1987410023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c1c0a1340 0x7f1c1c11ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:27.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.668+0000 7f1c1b7fe700 1 -- 172.21.15.26:0/1987410023 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0c009b30 con 0x7f1c1c0a0a30 2023-10-01T08:01:27.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.668+0000 7f1c1bfff700 1 --2- 172.21.15.26:0/1987410023 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c1c133fa0 0x7f1c1c11f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:27.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.669+0000 7f1c1b7fe700 1 --2- 172.21.15.26:0/1987410023 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c1c0a0a30 0x7f1c1c11e7a0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0673c0 tx=0x7f1c0c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:27.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.669+0000 7f1c03fff700 1 -- 172.21.15.26:0/1987410023 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c004930 con 0x7f1c1c0a0a30 2023-10-01T08:01:27.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.669+0000 7f1c03fff700 1 -- 172.21.15.26:0/1987410023 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0c0092e0 con 0x7f1c1c0a0a30 2023-10-01T08:01:27.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.669+0000 7f1c21cc1700 1 -- 172.21.15.26:0/1987410023 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c1c0a0220 con 0x7f1c1c0a0a30 2023-10-01T08:01:27.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.669+0000 7f1c03fff700 1 -- 172.21.15.26:0/1987410023 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c01c660 con 0x7f1c1c0a0a30 2023-10-01T08:01:27.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.669+0000 7f1c21cc1700 1 -- 172.21.15.26:0/1987410023 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c1c1229c0 con 0x7f1c1c0a0a30 2023-10-01T08:01:27.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.670+0000 7f1c03fff700 1 -- 172.21.15.26:0/1987410023 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1c0c01c7c0 con 0x7f1c1c0a0a30 2023-10-01T08:01:27.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.670+0000 7f1c21cc1700 1 -- 172.21.15.26:0/1987410023 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c1c074ea0 con 0x7f1c1c0a0a30 2023-10-01T08:01:27.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.670+0000 7f1c03fff700 1 -- 172.21.15.26:0/1987410023 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1c0c040f30 con 0x7f1c1c0a0a30 2023-10-01T08:01:27.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.675+0000 7f1c03fff700 1 -- 172.21.15.26:0/1987410023 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1c0c0249a0 con 0x7f1c1c0a0a30 2023-10-01T08:01:27.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.763+0000 7f60a30d9700 1 Processor -- start 2023-10-01T08:01:27.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.763+0000 7f60a30d9700 1 -- start start 2023-10-01T08:01:27.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.763+0000 7f60a30d9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f609c09e1b0 0x7f609c138a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:27.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.764+0000 7f60a30d9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f609c138f50 0x7f609c13b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:27.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.764+0000 7f60a30d9700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f609c09a570 con 0x7f609c09d6d0 2023-10-01T08:01:27.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.764+0000 7f60a30d9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609c09e5a0 con 0x7f609c09e1b0 2023-10-01T08:01:27.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.764+0000 7f60a30d9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f609c09b1c0 con 0x7f609c138f50 2023-10-01T08:01:27.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.764+0000 7f60a0e75700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f609c09d6d0 0x7f609c09daa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59490/0 (socket says 172.21.15.26:59490) 2023-10-01T08:01:27.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.764+0000 7f60a0e75700 1 -- 172.21.15.26:0/3828369910 learned_addr learned my addr 172.21.15.26:0/3828369910 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:01:27.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.764+0000 7f60a1676700 1 --2- 172.21.15.26:0/3828369910 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f609c138f50 0x7f609c13b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:27.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.764+0000 7f609bfff700 1 --2- 172.21.15.26:0/3828369910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f609c09e1b0 0x7f609c138a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:27.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.764+0000 7f609b7fe700 1 -- 172.21.15.26:0/3828369910 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1655361925 0 0) 0x7f609c09a570 con 0x7f609c09d6d0 2023-10-01T08:01:27.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.764+0000 7f609b7fe700 1 -- 172.21.15.26:0/3828369910 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f608c0035b0 con 0x7f609c09d6d0 2023-10-01T08:01:27.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.764+0000 7f60a1676700 1 -- 172.21.15.26:0/3828369910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f609c09e1b0 msgr2=0x7f609c138a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:27.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.764+0000 7f60a1676700 1 --2- 172.21.15.26:0/3828369910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f609c09e1b0 0x7f609c138a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:27.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.764+0000 7f60a1676700 1 -- 172.21.15.26:0/3828369910 >> v1:172.21.15.26:6789/0 conn(0x7f609c09d6d0 legacy=0x7f609c09daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:27.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.764+0000 7f60a1676700 1 -- 172.21.15.26:0/3828369910 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609c09f240 con 0x7f609c138f50 2023-10-01T08:01:27.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.764+0000 7f609bfff700 1 --2- 172.21.15.26:0/3828369910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f609c09e1b0 0x7f609c138a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:27.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.764+0000 7f60a1676700 1 --2- 172.21.15.26:0/3828369910 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f609c138f50 0x7f609c13b330 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f6094009df0 tx=0x7f609400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e44e91bfb34edc2d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:27.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.765+0000 7f609b7fe700 1 -- 172.21.15.26:0/3828369910 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609400e070 con 0x7f609c138f50 2023-10-01T08:01:27.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.765+0000 7f609b7fe700 1 -- 172.21.15.26:0/3828369910 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609400bae0 con 0x7f609c138f50 2023-10-01T08:01:27.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.765+0000 7f609b7fe700 1 -- 172.21.15.26:0/3828369910 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609400be50 con 0x7f609c138f50 2023-10-01T08:01:27.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.765+0000 7f60a30d9700 1 -- 172.21.15.26:0/3828369910 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f609c138f50 msgr2=0x7f609c13b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:27.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.765+0000 7f60a30d9700 1 --2- 172.21.15.26:0/3828369910 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f609c138f50 0x7f609c13b330 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f6094009df0 tx=0x7f609400b330 comp rx=0 tx=0).stop 2023-10-01T08:01:27.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.765+0000 7f60a30d9700 1 -- 172.21.15.26:0/3828369910 shutdown_connections 2023-10-01T08:01:27.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.765+0000 7f60a30d9700 1 --2- 172.21.15.26:0/3828369910 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f609c138f50 0x7f609c13b330 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:27.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.765+0000 7f60a30d9700 1 --2- 172.21.15.26:0/3828369910 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f609c09e1b0 0x7f609c138a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:27.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.765+0000 7f60a30d9700 1 -- 172.21.15.26:0/3828369910 >> 172.21.15.26:0/3828369910 conn(0x7f609c099c20 msgr2=0x7f609c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:27.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.766+0000 7f60a30d9700 1 -- 172.21.15.26:0/3828369910 shutdown_connections 2023-10-01T08:01:27.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.766+0000 7f60a30d9700 1 -- 172.21.15.26:0/3828369910 wait complete. 2023-10-01T08:01:27.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.766+0000 7f60a30d9700 1 Processor -- start 2023-10-01T08:01:27.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.767+0000 7f60a30d9700 1 -- start start 2023-10-01T08:01:27.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.767+0000 7f60a30d9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f609c09d6d0 0x7f609c119420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:27.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.767+0000 7f60a30d9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f609c09e1b0 0x7f609c119960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:27.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.767+0000 7f60a30d9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f609c138f50 0x7f609c119ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:27.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.767+0000 7f60a30d9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c12daf0 con 0x7f609c138f50 2023-10-01T08:01:27.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.767+0000 7f60a30d9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609c11a870 con 0x7f609c09d6d0 2023-10-01T08:01:27.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.767+0000 7f60a30d9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f609c09c900 con 0x7f609c09e1b0 2023-10-01T08:01:27.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.767+0000 7f609bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f609c09e1b0 0x7f609c119960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:27.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.767+0000 7f609bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f609c09e1b0 0x7f609c119960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:54334/0 (socket says 172.21.15.26:54334) 2023-10-01T08:01:27.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.767+0000 7f609bfff700 1 -- 172.21.15.26:0/890996418 learned_addr learned my addr 172.21.15.26:0/890996418 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:27.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.767+0000 7f60a1676700 1 --2- 172.21.15.26:0/890996418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f609c138f50 0x7f609c119ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:27.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.768+0000 7f60a0e75700 1 --2- 172.21.15.26:0/890996418 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f609c09d6d0 0x7f609c119420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:27.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.768+0000 7f60a1676700 1 -- 172.21.15.26:0/890996418 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f609c09e1b0 msgr2=0x7f609c119960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:27.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.768+0000 7f60a1676700 1 --2- 172.21.15.26:0/890996418 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f609c09e1b0 0x7f609c119960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:27.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.768+0000 7f60a1676700 1 -- 172.21.15.26:0/890996418 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f609c09d6d0 msgr2=0x7f609c119420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:27.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.768+0000 7f60a1676700 1 --2- 172.21.15.26:0/890996418 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f609c09d6d0 0x7f609c119420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:27.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.768+0000 7f60a1676700 1 -- 172.21.15.26:0/890996418 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60880094a0 con 0x7f609c138f50 2023-10-01T08:01:27.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.768+0000 7f609bfff700 1 --2- 172.21.15.26:0/890996418 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f609c09e1b0 0x7f609c119960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:27.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.768+0000 7f60a0e75700 1 --2- 172.21.15.26:0/890996418 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f609c09d6d0 0x7f609c119420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:27.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.768+0000 7f60a1676700 1 --2- 172.21.15.26:0/890996418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f609c138f50 0x7f609c119ea0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f6094009df0 tx=0x7f6094004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:27.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.768+0000 7f60997fa700 1 -- 172.21.15.26:0/890996418 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6094012c70 con 0x7f609c138f50 2023-10-01T08:01:27.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.768+0000 7f60997fa700 1 -- 172.21.15.26:0/890996418 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6094012dd0 con 0x7f609c138f50 2023-10-01T08:01:27.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.768+0000 7f60997fa700 1 -- 172.21.15.26:0/890996418 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6094025630 con 0x7f609c138f50 2023-10-01T08:01:27.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.768+0000 7f60a30d9700 1 -- 172.21.15.26:0/890996418 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6094009a70 con 0x7f609c138f50 2023-10-01T08:01:27.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.768+0000 7f60a30d9700 1 -- 172.21.15.26:0/890996418 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609c12e0b0 con 0x7f609c138f50 2023-10-01T08:01:27.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.770+0000 7f60997fa700 1 -- 172.21.15.26:0/890996418 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f609401b3f0 con 0x7f609c138f50 2023-10-01T08:01:27.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.770+0000 7f60a30d9700 1 -- 172.21.15.26:0/890996418 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f609c0a2540 con 0x7f609c138f50 2023-10-01T08:01:27.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.770+0000 7f60997fa700 1 -- 172.21.15.26:0/890996418 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6094040e00 con 0x7f609c138f50 2023-10-01T08:01:27.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.779+0000 7f60997fa700 1 -- 172.21.15.26:0/890996418 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f609402c710 con 0x7f609c138f50 2023-10-01T08:01:27.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.804+0000 7f0fa1f66700 1 Processor -- start 2023-10-01T08:01:27.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.804+0000 7f0fa1f66700 1 -- start start 2023-10-01T08:01:27.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.805+0000 7f0fa1f66700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f9c0a1510 0x7f0f9c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:27.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.805+0000 7f0fa1f66700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0f9c139250 0x7f0f9c13b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:27.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.805+0000 7f0fa1f66700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f9c09edd0 con 0x7f0f9c0a0a30 2023-10-01T08:01:27.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.805+0000 7f0fa1f66700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f9c0a18e0 con 0x7f0f9c139250 2023-10-01T08:01:27.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.805+0000 7f0fa1f66700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c09e1f0 con 0x7f0f9c0a1510 2023-10-01T08:01:27.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.805+0000 7f0f9affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f9c0a1510 0x7f0f9c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:27.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.805+0000 7f0f9affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f9c0a1510 0x7f0f9c138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51534/0 (socket says 172.21.15.26:51534) 2023-10-01T08:01:27.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.805+0000 7f0f9affd700 1 -- 172.21.15.26:0/531916787 learned_addr learned my addr 172.21.15.26:0/531916787 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:27.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.805+0000 7f0f9bfff700 1 --2- 172.21.15.26:0/531916787 >> v2:172.21.15.26:3300/0 conn(0x7f0f9c139250 0x7f0f9c13b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:27.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.806+0000 7f0f9affd700 1 -- 172.21.15.26:0/531916787 >> v2:172.21.15.26:3300/0 conn(0x7f0f9c139250 msgr2=0x7f0f9c13b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:27.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.806+0000 7f0f9affd700 1 --2- 172.21.15.26:0/531916787 >> v2:172.21.15.26:3300/0 conn(0x7f0f9c139250 0x7f0f9c13b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:27.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.806+0000 7f0f9affd700 1 -- 172.21.15.26:0/531916787 >> v1:172.21.15.26:6789/0 conn(0x7f0f9c0a0a30 legacy=0x7f0f9c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:27.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.806+0000 7f0f9affd700 1 -- 172.21.15.26:0/531916787 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9c09dc50 con 0x7f0f9c0a1510 2023-10-01T08:01:27.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.806+0000 7f0f9affd700 1 --2- 172.21.15.26:0/531916787 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f9c0a1510 0x7f0f9c138d10 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f0f90009920 tx=0x7f0f90009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b330741a976de427 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:27.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.806+0000 7f0f9a7fc700 1 -- 172.21.15.26:0/531916787 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f90011830 con 0x7f0f9c0a1510 2023-10-01T08:01:27.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.806+0000 7f0f9a7fc700 1 -- 172.21.15.26:0/531916787 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f90011990 con 0x7f0f9c0a1510 2023-10-01T08:01:27.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.806+0000 7f0f9a7fc700 1 -- 172.21.15.26:0/531916787 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f90011d20 con 0x7f0f9c0a1510 2023-10-01T08:01:27.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.807+0000 7f0fa1f66700 1 -- 172.21.15.26:0/531916787 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f9c0a1510 msgr2=0x7f0f9c138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:27.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.807+0000 7f0fa1f66700 1 --2- 172.21.15.26:0/531916787 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f9c0a1510 0x7f0f9c138d10 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f0f90009920 tx=0x7f0f90009c30 comp rx=0 tx=0).stop 2023-10-01T08:01:27.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.807+0000 7f0fa1f66700 1 -- 172.21.15.26:0/531916787 shutdown_connections 2023-10-01T08:01:27.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.807+0000 7f0fa1f66700 1 --2- 172.21.15.26:0/531916787 >> v2:172.21.15.26:3300/0 conn(0x7f0f9c139250 0x7f0f9c13b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:27.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.807+0000 7f0fa1f66700 1 --2- 172.21.15.26:0/531916787 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f9c0a1510 0x7f0f9c138d10 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:27.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.807+0000 7f0fa1f66700 1 -- 172.21.15.26:0/531916787 >> 172.21.15.26:0/531916787 conn(0x7f0f9c0a6550 msgr2=0x7f0f9c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:27.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.807+0000 7f0fa1f66700 1 -- 172.21.15.26:0/531916787 shutdown_connections 2023-10-01T08:01:27.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.807+0000 7f0fa1f66700 1 -- 172.21.15.26:0/531916787 wait complete. 2023-10-01T08:01:27.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.808+0000 7f0fa1f66700 1 Processor -- start 2023-10-01T08:01:27.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.809+0000 7f0fa1f66700 1 -- start start 2023-10-01T08:01:27.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.809+0000 7f0fa1f66700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f9c0a0a30 0x7f0f9c1218c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:27.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.809+0000 7f0fa1f66700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f9c0a1510 0x7f0f9c121e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:27.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.809+0000 7f0fa1f66700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f9c139250 0x7f0f9c122340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:27.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.809+0000 7f0fa1f66700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c1236c0 con 0x7f0f9c0a1510 2023-10-01T08:01:27.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.809+0000 7f0fa1f66700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c1234d0 con 0x7f0f9c0a0a30 2023-10-01T08:01:27.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.809+0000 7f0fa1f66700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c1253e0 con 0x7f0f9c139250 2023-10-01T08:01:27.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.809+0000 7f0f9b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f9c0a0a30 0x7f0f9c1218c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:27.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.810+0000 7f0f9b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f9c0a0a30 0x7f0f9c1218c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51538/0 (socket says 172.21.15.26:51538) 2023-10-01T08:01:27.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.810+0000 7f0f9b7fe700 1 -- 172.21.15.26:0/3625918622 learned_addr learned my addr 172.21.15.26:0/3625918622 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:27.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.810+0000 7f0f9bfff700 1 --2- 172.21.15.26:0/3625918622 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f9c139250 0x7f0f9c122340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:27.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.810+0000 7f0f9affd700 1 --2- 172.21.15.26:0/3625918622 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f9c0a1510 0x7f0f9c121e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:27.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.810+0000 7f0f9b7fe700 1 -- 172.21.15.26:0/3625918622 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f9c139250 msgr2=0x7f0f9c122340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:27.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.810+0000 7f0f9b7fe700 1 --2- 172.21.15.26:0/3625918622 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f9c139250 0x7f0f9c122340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:27.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.810+0000 7f0f9b7fe700 1 -- 172.21.15.26:0/3625918622 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f9c0a1510 msgr2=0x7f0f9c121e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:27.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.810+0000 7f0f9b7fe700 1 --2- 172.21.15.26:0/3625918622 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f9c0a1510 0x7f0f9c121e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:27.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.810+0000 7f0f9b7fe700 1 -- 172.21.15.26:0/3625918622 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f90009550 con 0x7f0f9c0a0a30 2023-10-01T08:01:27.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.810+0000 7f0f9bfff700 1 --2- 172.21.15.26:0/3625918622 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f9c139250 0x7f0f9c122340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:27.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.810+0000 7f0f9b7fe700 1 --2- 172.21.15.26:0/3625918622 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f9c0a0a30 0x7f0f9c1218c0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c00c4e0 tx=0x7f0f8c00c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:27.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.810+0000 7f0f83fff700 1 -- 172.21.15.26:0/3625918622 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c0052d0 con 0x7f0f9c0a0a30 2023-10-01T08:01:27.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.810+0000 7f0f83fff700 1 -- 172.21.15.26:0/3625918622 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8c005430 con 0x7f0f9c0a0a30 2023-10-01T08:01:27.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.810+0000 7f0fa1f66700 1 -- 172.21.15.26:0/3625918622 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f9c138bd0 con 0x7f0f9c0a0a30 2023-10-01T08:01:27.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.810+0000 7f0f83fff700 1 -- 172.21.15.26:0/3625918622 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c0038c0 con 0x7f0f9c0a0a30 2023-10-01T08:01:27.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.811+0000 7f0fa1f66700 1 -- 172.21.15.26:0/3625918622 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f9c123cc0 con 0x7f0f9c0a0a30 2023-10-01T08:01:27.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.812+0000 7f0fa1f66700 1 -- 172.21.15.26:0/3625918622 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f9c074ea0 con 0x7f0f9c0a0a30 2023-10-01T08:01:27.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.812+0000 7f0f83fff700 1 -- 172.21.15.26:0/3625918622 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f8c003a20 con 0x7f0f9c0a0a30 2023-10-01T08:01:27.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.812+0000 7f0f83fff700 1 -- 172.21.15.26:0/3625918622 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0f8c040a70 con 0x7f0f9c0a0a30 2023-10-01T08:01:27.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.817+0000 7f0f83fff700 1 -- 172.21.15.26:0/3625918622 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f8c044060 con 0x7f0f9c0a0a30 2023-10-01T08:01:27.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.892+0000 7f1c21cc1700 1 -- 172.21.15.26:0/1987410023 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1c1c0a28e0 con 0x7f1c1c0a0a30 2023-10-01T08:01:27.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.892+0000 7f1c03fff700 1 -- 172.21.15.26:0/1987410023 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1c0c0243b0 con 0x7f1c1c0a0a30 2023-10-01T08:01:27.893 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:27.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.896+0000 7f1c21cc1700 1 -- 172.21.15.26:0/1987410023 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c1c0a0a30 msgr2=0x7f1c1c11e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.896+0000 7f1c21cc1700 1 --2- 172.21.15.26:0/1987410023 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c1c0a0a30 0x7f1c1c11e7a0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0673c0 tx=0x7f1c0c004ad0 comp rx=0 tx=0).stop 2023-10-01T08:01:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.896+0000 7f1c21cc1700 1 -- 172.21.15.26:0/1987410023 shutdown_connections 2023-10-01T08:01:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.896+0000 7f1c21cc1700 1 --2- 172.21.15.26:0/1987410023 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1c1c133fa0 0x7f1c1c11f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.896+0000 7f1c21cc1700 1 --2- 172.21.15.26:0/1987410023 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c1c0a0a30 0x7f1c1c11e7a0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.896+0000 7f1c21cc1700 1 --2- 172.21.15.26:0/1987410023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c1c0a1340 0x7f1c1c11ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.896+0000 7f1c21cc1700 1 -- 172.21.15.26:0/1987410023 >> 172.21.15.26:0/1987410023 conn(0x7f1c1c0a6550 msgr2=0x7f1c1c1b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.896+0000 7f1c21cc1700 1 -- 172.21.15.26:0/1987410023 shutdown_connections 2023-10-01T08:01:27.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.896+0000 7f1c21cc1700 1 -- 172.21.15.26:0/1987410023 wait complete. 2023-10-01T08:01:27.915 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:27.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.988+0000 7f60a30d9700 1 -- 172.21.15.26:0/890996418 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f609c04f2a0 con 0x7f609c138f50 2023-10-01T08:01:27.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.988+0000 7f60997fa700 1 -- 172.21.15.26:0/890996418 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6094042020 con 0x7f609c138f50 2023-10-01T08:01:27.989 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:27.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.990+0000 7f60a30d9700 1 -- 172.21.15.26:0/890996418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f609c138f50 msgr2=0x7f609c119ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:27.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.990+0000 7f60a30d9700 1 --2- 172.21.15.26:0/890996418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f609c138f50 0x7f609c119ea0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f6094009df0 tx=0x7f6094004ad0 comp rx=0 tx=0).stop 2023-10-01T08:01:27.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.990+0000 7f60a30d9700 1 -- 172.21.15.26:0/890996418 shutdown_connections 2023-10-01T08:01:27.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.990+0000 7f60a30d9700 1 --2- 172.21.15.26:0/890996418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f609c138f50 0x7f609c119ea0 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:27.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.990+0000 7f60a30d9700 1 --2- 172.21.15.26:0/890996418 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f609c09d6d0 0x7f609c119420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:27.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.990+0000 7f60a30d9700 1 --2- 172.21.15.26:0/890996418 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f609c09e1b0 0x7f609c119960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:27.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.990+0000 7f60a30d9700 1 -- 172.21.15.26:0/890996418 >> 172.21.15.26:0/890996418 conn(0x7f609c099c20 msgr2=0x7f609c133a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:27.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.990+0000 7f60a30d9700 1 -- 172.21.15.26:0/890996418 shutdown_connections 2023-10-01T08:01:27.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:27.990+0000 7f60a30d9700 1 -- 172.21.15.26:0/890996418 wait complete. 2023-10-01T08:01:28.005 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:28.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.033+0000 7f0fa1f66700 1 -- 172.21.15.26:0/3625918622 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0f9c124d50 con 0x7f0f9c0a0a30 2023-10-01T08:01:28.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.033+0000 7f0f83fff700 1 -- 172.21.15.26:0/3625918622 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0f8c044020 con 0x7f0f9c0a0a30 2023-10-01T08:01:28.034 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:28.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.036+0000 7f0fa1f66700 1 -- 172.21.15.26:0/3625918622 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f9c0a0a30 msgr2=0x7f0f9c1218c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:28.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.036+0000 7f0fa1f66700 1 --2- 172.21.15.26:0/3625918622 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f9c0a0a30 0x7f0f9c1218c0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c00c4e0 tx=0x7f0f8c00c7f0 comp rx=0 tx=0).stop 2023-10-01T08:01:28.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.036+0000 7f0fa1f66700 1 -- 172.21.15.26:0/3625918622 shutdown_connections 2023-10-01T08:01:28.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.036+0000 7f0fa1f66700 1 --2- 172.21.15.26:0/3625918622 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f9c139250 0x7f0f9c122340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:28.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.036+0000 7f0fa1f66700 1 --2- 172.21.15.26:0/3625918622 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f9c0a0a30 0x7f0f9c1218c0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:28.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.036+0000 7f0fa1f66700 1 --2- 172.21.15.26:0/3625918622 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f9c0a1510 0x7f0f9c121e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:28.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.036+0000 7f0fa1f66700 1 -- 172.21.15.26:0/3625918622 >> 172.21.15.26:0/3625918622 conn(0x7f0f9c0a6550 msgr2=0x7f0f9c137b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:28.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.036+0000 7f0fa1f66700 1 -- 172.21.15.26:0/3625918622 shutdown_connections 2023-10-01T08:01:28.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.036+0000 7f0fa1f66700 1 -- 172.21.15.26:0/3625918622 wait complete. 2023-10-01T08:01:28.050 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:28.210 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:28.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.356+0000 7feba5f46700 1 Processor -- start 2023-10-01T08:01:28.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.356+0000 7feba5f46700 1 -- start start 2023-10-01T08:01:28.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.356+0000 7feba5f46700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feba0134630 0x7feba0136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:28.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.357+0000 7feba5f46700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feba0136f50 0x7feba0139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:28.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.357+0000 7feba5f46700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba009b4f0 con 0x7feba0131810 2023-10-01T08:01:28.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.357+0000 7feba5f46700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba01313c0 con 0x7feba0136f50 2023-10-01T08:01:28.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.357+0000 7feba5f46700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feba006e8c0 con 0x7feba0134630 2023-10-01T08:01:28.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.357+0000 7feb9ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feba0136f50 0x7feba0139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:28.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.357+0000 7feb9effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feba0134630 0x7feba0136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:28.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.357+0000 7feb9ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feba0136f50 0x7feba0139330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55818/0 (socket says 172.21.15.26:55818) 2023-10-01T08:01:28.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.357+0000 7feb9ffff700 1 -- 172.21.15.26:0/2821909176 learned_addr learned my addr 172.21.15.26:0/2821909176 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:28.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.357+0000 7feb9ffff700 1 -- 172.21.15.26:0/2821909176 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feba0134630 msgr2=0x7feba0136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:28.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.357+0000 7feb9ffff700 1 --2- 172.21.15.26:0/2821909176 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feba0134630 0x7feba0136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:28.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.357+0000 7feb9ffff700 1 -- 172.21.15.26:0/2821909176 >> v1:172.21.15.26:6789/0 conn(0x7feba0131810 legacy=0x7feba0131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:28.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.357+0000 7feb9ffff700 1 -- 172.21.15.26:0/2821909176 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba0071d20 con 0x7feba0136f50 2023-10-01T08:01:28.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.357+0000 7feb9effd700 1 --2- 172.21.15.26:0/2821909176 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feba0134630 0x7feba0136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:28.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.357+0000 7feb9ffff700 1 --2- 172.21.15.26:0/2821909176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feba0136f50 0x7feba0139330 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7feb98009e50 tx=0x7feb9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e742cdca097737 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:28.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.357+0000 7feb9e7fc700 1 -- 172.21.15.26:0/2821909176 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9800e070 con 0x7feba0136f50 2023-10-01T08:01:28.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.357+0000 7feb9e7fc700 1 -- 172.21.15.26:0/2821909176 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9800b910 con 0x7feba0136f50 2023-10-01T08:01:28.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.357+0000 7feb9e7fc700 1 -- 172.21.15.26:0/2821909176 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9800bcc0 con 0x7feba0136f50 2023-10-01T08:01:28.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.358+0000 7feba5f46700 1 -- 172.21.15.26:0/2821909176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feba0136f50 msgr2=0x7feba0139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:28.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.358+0000 7feba5f46700 1 --2- 172.21.15.26:0/2821909176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feba0136f50 0x7feba0139330 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7feb98009e50 tx=0x7feb9800b330 comp rx=0 tx=0).stop 2023-10-01T08:01:28.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.358+0000 7feba5f46700 1 -- 172.21.15.26:0/2821909176 shutdown_connections 2023-10-01T08:01:28.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.358+0000 7feba5f46700 1 --2- 172.21.15.26:0/2821909176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feba0136f50 0x7feba0139330 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:28.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.358+0000 7feba5f46700 1 --2- 172.21.15.26:0/2821909176 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feba0134630 0x7feba0136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:28.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.358+0000 7feba5f46700 1 -- 172.21.15.26:0/2821909176 >> 172.21.15.26:0/2821909176 conn(0x7feba00a2aa0 msgr2=0x7feba00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:28.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.358+0000 7feba5f46700 1 -- 172.21.15.26:0/2821909176 shutdown_connections 2023-10-01T08:01:28.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.358+0000 7feba5f46700 1 -- 172.21.15.26:0/2821909176 wait complete. 2023-10-01T08:01:28.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.359+0000 7feba5f46700 1 Processor -- start 2023-10-01T08:01:28.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.359+0000 7feba5f46700 1 -- start start 2023-10-01T08:01:28.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.360+0000 7feba5f46700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feba0131810 0x7feba01c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:28.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.360+0000 7feba5f46700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feba0134630 0x7feba01c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:28.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.360+0000 7feba5f46700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feba0136f50 0x7feba01c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:28.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.360+0000 7feba5f46700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba006fa90 con 0x7feba0131810 2023-10-01T08:01:28.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.360+0000 7feba5f46700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba00711f0 con 0x7feba0136f50 2023-10-01T08:01:28.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.360+0000 7feba5f46700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feba00a2040 con 0x7feba0134630 2023-10-01T08:01:28.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.360+0000 7feb9f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feba0131810 0x7feba01c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:28.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.360+0000 7feb9ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feba0136f50 0x7feba01c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:28.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.360+0000 7feb9f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feba0131810 0x7feba01c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55824/0 (socket says 172.21.15.26:55824) 2023-10-01T08:01:28.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.360+0000 7feb9f7fe700 1 -- 172.21.15.26:0/1294865623 learned_addr learned my addr 172.21.15.26:0/1294865623 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:28.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.360+0000 7feb9ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feba0136f50 0x7feba01c8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51540/0 (socket says 172.21.15.26:51540) 2023-10-01T08:01:28.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.360+0000 7feb9effd700 1 --2- 172.21.15.26:0/1294865623 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feba0134630 0x7feba01c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:28.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.360+0000 7feb9f7fe700 1 -- 172.21.15.26:0/1294865623 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feba0134630 msgr2=0x7feba01c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:28.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.360+0000 7feb9f7fe700 1 --2- 172.21.15.26:0/1294865623 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feba0134630 0x7feba01c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:28.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.360+0000 7feb9f7fe700 1 -- 172.21.15.26:0/1294865623 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feba0136f50 msgr2=0x7feba01c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:28.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.360+0000 7feb9f7fe700 1 --2- 172.21.15.26:0/1294865623 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feba0136f50 0x7feba01c8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:28.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.360+0000 7feb9f7fe700 1 -- 172.21.15.26:0/1294865623 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb880094a0 con 0x7feba0131810 2023-10-01T08:01:28.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.360+0000 7feb9ffff700 1 --2- 172.21.15.26:0/1294865623 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feba0136f50 0x7feba01c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:28.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.360+0000 7feb9f7fe700 1 --2- 172.21.15.26:0/1294865623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feba0131810 0x7feba01c82d0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7feb9000c450 tx=0x7feb9000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:28.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.361+0000 7feb97fff700 1 -- 172.21.15.26:0/1294865623 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb900052d0 con 0x7feba0131810 2023-10-01T08:01:28.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.361+0000 7feb97fff700 1 -- 172.21.15.26:0/1294865623 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb90005430 con 0x7feba0131810 2023-10-01T08:01:28.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.361+0000 7feba5f46700 1 -- 172.21.15.26:0/1294865623 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb98009b30 con 0x7feba0131810 2023-10-01T08:01:28.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.361+0000 7feb97fff700 1 -- 172.21.15.26:0/1294865623 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb900038c0 con 0x7feba0131810 2023-10-01T08:01:28.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.361+0000 7feba5f46700 1 -- 172.21.15.26:0/1294865623 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba006eb50 con 0x7feba0131810 2023-10-01T08:01:28.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.361+0000 7feb97fff700 1 -- 172.21.15.26:0/1294865623 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feb90003a20 con 0x7feba0131810 2023-10-01T08:01:28.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.362+0000 7feb97fff700 1 -- 172.21.15.26:0/1294865623 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7feb9003ea00 con 0x7feba0131810 2023-10-01T08:01:28.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.362+0000 7feba5f46700 1 -- 172.21.15.26:0/1294865623 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba011f2b0 con 0x7feba0131810 2023-10-01T08:01:28.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.367+0000 7feb97fff700 1 -- 172.21.15.26:0/1294865623 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feb90017070 con 0x7feba0131810 2023-10-01T08:01:28.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.571+0000 7feba5f46700 1 -- 172.21.15.26:0/1294865623 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7feba009b0c0 con 0x7feba0131810 2023-10-01T08:01:28.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.572+0000 7feb97fff700 1 -- 172.21.15.26:0/1294865623 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feb90011590 con 0x7feba0131810 2023-10-01T08:01:28.572 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:28.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.574+0000 7feba5f46700 1 -- 172.21.15.26:0/1294865623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feba0131810 msgr2=0x7feba01c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:28.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.574+0000 7feba5f46700 1 --2- 172.21.15.26:0/1294865623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feba0131810 0x7feba01c82d0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7feb9000c450 tx=0x7feb9000c760 comp rx=0 tx=0).stop 2023-10-01T08:01:28.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.574+0000 7feba5f46700 1 -- 172.21.15.26:0/1294865623 shutdown_connections 2023-10-01T08:01:28.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.574+0000 7feba5f46700 1 --2- 172.21.15.26:0/1294865623 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feba0136f50 0x7feba01c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:28.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.574+0000 7feba5f46700 1 --2- 172.21.15.26:0/1294865623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feba0131810 0x7feba01c82d0 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:28.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.574+0000 7feba5f46700 1 --2- 172.21.15.26:0/1294865623 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feba0134630 0x7feba01c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:28.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.574+0000 7feba5f46700 1 -- 172.21.15.26:0/1294865623 >> 172.21.15.26:0/1294865623 conn(0x7feba00a2aa0 msgr2=0x7feba0133130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:28.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.574+0000 7feba5f46700 1 -- 172.21.15.26:0/1294865623 shutdown_connections 2023-10-01T08:01:28.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:28.574+0000 7feba5f46700 1 -- 172.21.15.26:0/1294865623 wait complete. 2023-10-01T08:01:28.588 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:28.916 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:29.005 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:29.051 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:29.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.066+0000 7f4be569d700 1 Processor -- start 2023-10-01T08:01:29.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.066+0000 7f4be569d700 1 -- start start 2023-10-01T08:01:29.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.067+0000 7f4be569d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4be009d6f0 0x7f4be009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:29.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.067+0000 7f4be569d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4be009e410 0x7f4be0130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:29.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.067+0000 7f4be569d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4be009f130 con 0x7f4be009e000 2023-10-01T08:01:29.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.067+0000 7f4be569d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4be009f520 con 0x7f4be009e410 2023-10-01T08:01:29.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.067+0000 7f4be569d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be009e930 con 0x7f4be009d6f0 2023-10-01T08:01:29.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.067+0000 7f4bdeffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4be009d6f0 0x7f4be009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:29.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.067+0000 7f4bdeffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4be009d6f0 0x7f4be009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51552/0 (socket says 172.21.15.26:51552) 2023-10-01T08:01:29.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.067+0000 7f4bdeffd700 1 -- 172.21.15.26:0/1210335175 learned_addr learned my addr 172.21.15.26:0/1210335175 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:29.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.067+0000 7f4bdeffd700 1 -- 172.21.15.26:0/1210335175 >> v2:172.21.15.26:3300/0 conn(0x7f4be009e410 msgr2=0x7f4be0130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:29.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.067+0000 7f4bdf7fe700 1 --2- 172.21.15.26:0/1210335175 >> v2:172.21.15.26:3300/0 conn(0x7f4be009e410 0x7f4be0130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:29.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.067+0000 7f4bdeffd700 1 --2- 172.21.15.26:0/1210335175 >> v2:172.21.15.26:3300/0 conn(0x7f4be009e410 0x7f4be0130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:29.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.067+0000 7f4bdeffd700 1 -- 172.21.15.26:0/1210335175 >> v1:172.21.15.26:6789/0 conn(0x7f4be009e000 legacy=0x7f4be0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:29.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.067+0000 7f4bdeffd700 1 -- 172.21.15.26:0/1210335175 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be009b2d0 con 0x7f4be009d6f0 2023-10-01T08:01:29.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.067+0000 7f4bdf7fe700 1 --2- 172.21.15.26:0/1210335175 >> v2:172.21.15.26:3300/0 conn(0x7f4be009e410 0x7f4be0130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T08:01:29.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.068+0000 7f4bdeffd700 1 --2- 172.21.15.26:0/1210335175 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4be009d6f0 0x7f4be009dac0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f4bd00098f0 tx=0x7f4bd0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9348d6c8d92c5bd server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:29.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.068+0000 7f4bddffb700 1 -- 172.21.15.26:0/1210335175 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0004230 con 0x7f4be009d6f0 2023-10-01T08:01:29.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.068+0000 7f4bddffb700 1 -- 172.21.15.26:0/1210335175 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd0004390 con 0x7f4be009d6f0 2023-10-01T08:01:29.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.068+0000 7f4bddffb700 1 -- 172.21.15.26:0/1210335175 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd00036a0 con 0x7f4be009d6f0 2023-10-01T08:01:29.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.069+0000 7f4be569d700 1 -- 172.21.15.26:0/1210335175 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4be009d6f0 msgr2=0x7f4be009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:29.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.069+0000 7f4be569d700 1 --2- 172.21.15.26:0/1210335175 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4be009d6f0 0x7f4be009dac0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f4bd00098f0 tx=0x7f4bd0009c00 comp rx=0 tx=0).stop 2023-10-01T08:01:29.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.069+0000 7f4be569d700 1 -- 172.21.15.26:0/1210335175 shutdown_connections 2023-10-01T08:01:29.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.069+0000 7f4be569d700 1 --2- 172.21.15.26:0/1210335175 >> v2:172.21.15.26:3300/0 conn(0x7f4be009e410 0x7f4be0130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:29.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.069+0000 7f4be569d700 1 --2- 172.21.15.26:0/1210335175 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4be009d6f0 0x7f4be009dac0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:29.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.069+0000 7f4be569d700 1 -- 172.21.15.26:0/1210335175 >> 172.21.15.26:0/1210335175 conn(0x7f4be0066f50 msgr2=0x7f4be009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:29.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.069+0000 7f4be569d700 1 -- 172.21.15.26:0/1210335175 shutdown_connections 2023-10-01T08:01:29.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.069+0000 7f4be569d700 1 -- 172.21.15.26:0/1210335175 wait complete. 2023-10-01T08:01:29.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.070+0000 7f4be569d700 1 Processor -- start 2023-10-01T08:01:29.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.070+0000 7f4be569d700 1 -- start start 2023-10-01T08:01:29.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.071+0000 7f4be569d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4be009d6f0 0x7f4be0139840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:29.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.071+0000 7f4be569d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4be009e000 0x7f4be0139d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:29.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.071+0000 7f4be569d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4be009e410 0x7f4be013a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:29.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.071+0000 7f4be569d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be01366b0 con 0x7f4be009d6f0 2023-10-01T08:01:29.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.071+0000 7f4be569d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be0136370 con 0x7f4be009e000 2023-10-01T08:01:29.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.071+0000 7f4be569d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4be013adf0 con 0x7f4be009e410 2023-10-01T08:01:29.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.071+0000 7f4bde7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4be009e000 0x7f4be0139d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:29.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.071+0000 7f4bdf7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4be009e410 0x7f4be013a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:29.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.071+0000 7f4bde7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4be009e000 0x7f4be0139d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51566/0 (socket says 172.21.15.26:51566) 2023-10-01T08:01:29.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.071+0000 7f4bde7fc700 1 -- 172.21.15.26:0/2392837099 learned_addr learned my addr 172.21.15.26:0/2392837099 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:29.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.071+0000 7f4bdeffd700 1 --2- 172.21.15.26:0/2392837099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4be009d6f0 0x7f4be0139840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:29.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.071+0000 7f4bdf7fe700 1 -- 172.21.15.26:0/2392837099 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4be009e000 msgr2=0x7f4be0139d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:29.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.071+0000 7f4bdf7fe700 1 --2- 172.21.15.26:0/2392837099 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4be009e000 0x7f4be0139d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:29.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.072+0000 7f4bdf7fe700 1 -- 172.21.15.26:0/2392837099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4be009d6f0 msgr2=0x7f4be0139840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:29.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.072+0000 7f4bdf7fe700 1 --2- 172.21.15.26:0/2392837099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4be009d6f0 0x7f4be0139840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:29.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.072+0000 7f4bdf7fe700 1 -- 172.21.15.26:0/2392837099 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd0009550 con 0x7f4be009e410 2023-10-01T08:01:29.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.072+0000 7f4bde7fc700 1 --2- 172.21.15.26:0/2392837099 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4be009e000 0x7f4be0139d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:29.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.072+0000 7f4bdf7fe700 1 --2- 172.21.15.26:0/2392837099 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4be009e410 0x7f4be013a2c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f4bd8007fd0 tx=0x7f4bd800ce10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:29.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.072+0000 7f4bc77fe700 1 -- 172.21.15.26:0/2392837099 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd800ac80 con 0x7f4be009e410 2023-10-01T08:01:29.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.072+0000 7f4bc77fe700 1 -- 172.21.15.26:0/2392837099 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd800ae00 con 0x7f4be009e410 2023-10-01T08:01:29.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.072+0000 7f4be569d700 1 -- 172.21.15.26:0/2392837099 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be0135de0 con 0x7f4be009e410 2023-10-01T08:01:29.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.072+0000 7f4bc77fe700 1 -- 172.21.15.26:0/2392837099 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd8003c60 con 0x7f4be009e410 2023-10-01T08:01:29.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.072+0000 7f4be569d700 1 -- 172.21.15.26:0/2392837099 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be0130c40 con 0x7f4be009e410 2023-10-01T08:01:29.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.073+0000 7f4bc77fe700 1 -- 172.21.15.26:0/2392837099 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4bd8015440 con 0x7f4be009e410 2023-10-01T08:01:29.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.073+0000 7f4bc77fe700 1 -- 172.21.15.26:0/2392837099 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4bd803fac0 con 0x7f4be009e410 2023-10-01T08:01:29.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.073+0000 7f4be569d700 1 -- 172.21.15.26:0/2392837099 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4be0136820 con 0x7f4be009e410 2023-10-01T08:01:29.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.079+0000 7f4bc77fe700 1 -- 172.21.15.26:0/2392837099 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4be0136820 con 0x7f4be009e410 2023-10-01T08:01:29.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.153+0000 7f776c14a700 1 Processor -- start 2023-10-01T08:01:29.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.153+0000 7f776c14a700 1 -- start start 2023-10-01T08:01:29.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.154+0000 7f776c14a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f776409e930 0x7f776409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:29.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.154+0000 7f776c14a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f776409f240 0x7f77641317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:29.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.154+0000 7f776c14a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7764070940 con 0x7f776409f650 2023-10-01T08:01:29.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.154+0000 7f776c14a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f776406fd60 con 0x7f776409f240 2023-10-01T08:01:29.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.154+0000 7f776c14a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f776406fa80 con 0x7f776409e930 2023-10-01T08:01:29.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.154+0000 7f7769ee6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f776409e930 0x7f776409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:29.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.154+0000 7f77696e5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f776409f240 0x7f77641317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:29.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.154+0000 7f7769ee6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f776409e930 0x7f776409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51582/0 (socket says 172.21.15.26:51582) 2023-10-01T08:01:29.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.154+0000 7f77696e5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f776409f240 0x7f77641317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55858/0 (socket says 172.21.15.26:55858) 2023-10-01T08:01:29.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.154+0000 7f7769ee6700 1 -- 172.21.15.26:0/2027992955 learned_addr learned my addr 172.21.15.26:0/2027992955 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:29.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.155+0000 7f77696e5700 1 -- 172.21.15.26:0/2027992955 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f776409e930 msgr2=0x7f776409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:29.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.155+0000 7f77696e5700 1 --2- 172.21.15.26:0/2027992955 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f776409e930 0x7f776409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:29.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.155+0000 7f77696e5700 1 -- 172.21.15.26:0/2027992955 >> v1:172.21.15.26:6789/0 conn(0x7f776409f650 legacy=0x7f7764131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:29.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.155+0000 7f77696e5700 1 -- 172.21.15.26:0/2027992955 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776409fb60 con 0x7f776409f240 2023-10-01T08:01:29.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.155+0000 7f77696e5700 1 --2- 172.21.15.26:0/2027992955 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f776409f240 0x7f77641317f0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f7754009840 tx=0x7f7754009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c36a164fc63b190 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:29.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.155+0000 7f7768ee4700 1 -- 172.21.15.26:0/2027992955 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7754011830 con 0x7f776409f240 2023-10-01T08:01:29.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.155+0000 7f7768ee4700 1 -- 172.21.15.26:0/2027992955 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7754011990 con 0x7f776409f240 2023-10-01T08:01:29.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.155+0000 7f7768ee4700 1 -- 172.21.15.26:0/2027992955 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7754011d20 con 0x7f776409f240 2023-10-01T08:01:29.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.156+0000 7f776c14a700 1 -- 172.21.15.26:0/2027992955 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f776409f240 msgr2=0x7f77641317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:29.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.156+0000 7f776c14a700 1 --2- 172.21.15.26:0/2027992955 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f776409f240 0x7f77641317f0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f7754009840 tx=0x7f7754009b50 comp rx=0 tx=0).stop 2023-10-01T08:01:29.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.156+0000 7f776c14a700 1 -- 172.21.15.26:0/2027992955 shutdown_connections 2023-10-01T08:01:29.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.156+0000 7f776c14a700 1 --2- 172.21.15.26:0/2027992955 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f776409e930 0x7f776409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:29.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.156+0000 7f776c14a700 1 --2- 172.21.15.26:0/2027992955 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f776409f240 0x7f77641317f0 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:29.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.156+0000 7f776c14a700 1 -- 172.21.15.26:0/2027992955 >> 172.21.15.26:0/2027992955 conn(0x7f77640a4210 msgr2=0x7f77640a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:29.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.156+0000 7f776c14a700 1 -- 172.21.15.26:0/2027992955 shutdown_connections 2023-10-01T08:01:29.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.156+0000 7f776c14a700 1 -- 172.21.15.26:0/2027992955 wait complete. 2023-10-01T08:01:29.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.158+0000 7f776c14a700 1 Processor -- start 2023-10-01T08:01:29.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.158+0000 7f776c14a700 1 -- start start 2023-10-01T08:01:29.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.158+0000 7f776c14a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f776409e930 0x7f776406b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:29.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.158+0000 7f776c14a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f776409f240 0x7f776406bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:29.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.158+0000 7f776c14a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f776409f650 0x7f776406c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:29.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.158+0000 7f776c14a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776406cce0 con 0x7f776409e930 2023-10-01T08:01:29.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.159+0000 7f776c14a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77641a9af0 con 0x7f776409f240 2023-10-01T08:01:29.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.159+0000 7f776c14a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77641a8a90 con 0x7f776409f650 2023-10-01T08:01:29.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.159+0000 7f7769ee6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f776409e930 0x7f776406b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:29.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.159+0000 7f7769ee6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f776409e930 0x7f776406b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55868/0 (socket says 172.21.15.26:55868) 2023-10-01T08:01:29.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.159+0000 7f7769ee6700 1 -- 172.21.15.26:0/1370954835 learned_addr learned my addr 172.21.15.26:0/1370954835 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:29.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.159+0000 7f77696e5700 1 --2- 172.21.15.26:0/1370954835 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f776409f240 0x7f776406bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:29.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.159+0000 7f776a6e7700 1 --2- 172.21.15.26:0/1370954835 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f776409f650 0x7f776406c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:29.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.159+0000 7f77696e5700 1 -- 172.21.15.26:0/1370954835 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f776409f650 msgr2=0x7f776406c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:29.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.159+0000 7f77696e5700 1 --2- 172.21.15.26:0/1370954835 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f776409f650 0x7f776406c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:29.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.159+0000 7f77696e5700 1 -- 172.21.15.26:0/1370954835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f776409e930 msgr2=0x7f776406b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:29.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.159+0000 7f77696e5700 1 --2- 172.21.15.26:0/1370954835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f776409e930 0x7f776406b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:29.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.159+0000 7f77696e5700 1 -- 172.21.15.26:0/1370954835 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77540094a0 con 0x7f776409f240 2023-10-01T08:01:29.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.159+0000 7f7769ee6700 1 --2- 172.21.15.26:0/1370954835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f776409e930 0x7f776406b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:29.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.159+0000 7f77696e5700 1 --2- 172.21.15.26:0/1370954835 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f776409f240 0x7f776406bdc0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f7754016000 tx=0x7f7754004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:29.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.160+0000 7f775a7fc700 1 -- 172.21.15.26:0/1370954835 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77540036a0 con 0x7f776409f240 2023-10-01T08:01:29.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.160+0000 7f775a7fc700 1 -- 172.21.15.26:0/1370954835 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f775401f070 con 0x7f776409f240 2023-10-01T08:01:29.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.160+0000 7f776c14a700 1 -- 172.21.15.26:0/1370954835 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77640a0190 con 0x7f776409f240 2023-10-01T08:01:29.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.160+0000 7f775a7fc700 1 -- 172.21.15.26:0/1370954835 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7754003a60 con 0x7f776409f240 2023-10-01T08:01:29.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.160+0000 7f776c14a700 1 -- 172.21.15.26:0/1370954835 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77641a92e0 con 0x7f776409f240 2023-10-01T08:01:29.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.160+0000 7f775a7fc700 1 -- 172.21.15.26:0/1370954835 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7754003bc0 con 0x7f776409f240 2023-10-01T08:01:29.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.161+0000 7f775a7fc700 1 -- 172.21.15.26:0/1370954835 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7754021070 con 0x7f776409f240 2023-10-01T08:01:29.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.161+0000 7f776c14a700 1 -- 172.21.15.26:0/1370954835 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77641a9280 con 0x7f776409f240 2023-10-01T08:01:29.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.166+0000 7f775a7fc700 1 -- 172.21.15.26:0/1370954835 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7754015080 con 0x7f776409f240 2023-10-01T08:01:29.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.197+0000 7f6e6dac5700 1 Processor -- start 2023-10-01T08:01:29.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.197+0000 7f6e6dac5700 1 -- start start 2023-10-01T08:01:29.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.198+0000 7f6e6dac5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e680a0a30 0x7f6e680a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:29.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.198+0000 7f6e6dac5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e680a1340 0x7f6e68133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:29.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.198+0000 7f6e6dac5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e68133fa0 0x7f6e68134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:29.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.198+0000 7f6e6dac5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e6809edd0 con 0x7f6e680a1340 2023-10-01T08:01:29.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.198+0000 7f6e6dac5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6809e1f0 con 0x7f6e680a0a30 2023-10-01T08:01:29.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.198+0000 7f6e6dac5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6809dc50 con 0x7f6e68133fa0 2023-10-01T08:01:29.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.198+0000 7f6e677fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e680a0a30 0x7f6e680a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:29.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.198+0000 7f6e677fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e680a0a30 0x7f6e680a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51602/0 (socket says 172.21.15.26:51602) 2023-10-01T08:01:29.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.198+0000 7f6e677fe700 1 -- 172.21.15.26:0/3331723180 learned_addr learned my addr 172.21.15.26:0/3331723180 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:29.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.198+0000 7f6e66ffd700 1 --2- 172.21.15.26:0/3331723180 >> v2:172.21.15.26:3300/0 conn(0x7f6e680a1340 0x7f6e68133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:29.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.198+0000 7f6e67fff700 1 --2- 172.21.15.26:0/3331723180 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e68133fa0 0x7f6e68134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:29.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.198+0000 7f6e66ffd700 1 -- 172.21.15.26:0/3331723180 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e68133fa0 msgr2=0x7f6e68134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:29.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.198+0000 7f6e66ffd700 1 --2- 172.21.15.26:0/3331723180 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e68133fa0 0x7f6e68134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:29.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.198+0000 7f6e66ffd700 1 -- 172.21.15.26:0/3331723180 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e680a0a30 msgr2=0x7f6e680a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:29.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.198+0000 7f6e66ffd700 1 --2- 172.21.15.26:0/3331723180 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e680a0a30 0x7f6e680a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:29.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.198+0000 7f6e66ffd700 1 -- 172.21.15.26:0/3331723180 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e680a1fe0 con 0x7f6e680a1340 2023-10-01T08:01:29.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.198+0000 7f6e677fe700 1 --2- 172.21.15.26:0/3331723180 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e680a0a30 0x7f6e680a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:29.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.199+0000 7f6e66ffd700 1 --2- 172.21.15.26:0/3331723180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e680a1340 0x7f6e68133a60 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c009840 tx=0x7f6e5c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b06f4650f1288895 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:29.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.199+0000 7f6e667fc700 1 -- 172.21.15.26:0/3331723180 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c011830 con 0x7f6e680a1340 2023-10-01T08:01:29.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.199+0000 7f6e667fc700 1 -- 172.21.15.26:0/3331723180 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5c011990 con 0x7f6e680a1340 2023-10-01T08:01:29.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.199+0000 7f6e667fc700 1 -- 172.21.15.26:0/3331723180 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c011d20 con 0x7f6e680a1340 2023-10-01T08:01:29.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.199+0000 7f6e6dac5700 1 -- 172.21.15.26:0/3331723180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e680a1340 msgr2=0x7f6e68133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:29.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.199+0000 7f6e6dac5700 1 --2- 172.21.15.26:0/3331723180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e680a1340 0x7f6e68133a60 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c009840 tx=0x7f6e5c009b50 comp rx=0 tx=0).stop 2023-10-01T08:01:29.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.199+0000 7f6e6dac5700 1 -- 172.21.15.26:0/3331723180 shutdown_connections 2023-10-01T08:01:29.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.199+0000 7f6e6dac5700 1 --2- 172.21.15.26:0/3331723180 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e68133fa0 0x7f6e68134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:29.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.199+0000 7f6e6dac5700 1 --2- 172.21.15.26:0/3331723180 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e680a0a30 0x7f6e680a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:29.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.199+0000 7f6e6dac5700 1 --2- 172.21.15.26:0/3331723180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e680a1340 0x7f6e68133a60 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:29.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.199+0000 7f6e6dac5700 1 -- 172.21.15.26:0/3331723180 >> 172.21.15.26:0/3331723180 conn(0x7f6e680a6550 msgr2=0x7f6e680a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:29.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.200+0000 7f6e6dac5700 1 -- 172.21.15.26:0/3331723180 shutdown_connections 2023-10-01T08:01:29.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.200+0000 7f6e6dac5700 1 -- 172.21.15.26:0/3331723180 wait complete. 2023-10-01T08:01:29.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.201+0000 7f6e6dac5700 1 Processor -- start 2023-10-01T08:01:29.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.201+0000 7f6e6dac5700 1 -- start start 2023-10-01T08:01:29.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.201+0000 7f6e6dac5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e680a0a30 0x7f6e681200e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:29.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.201+0000 7f6e6dac5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e680a1340 0x7f6e68120620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:29.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.201+0000 7f6e6dac5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e68133fa0 0x7f6e68120b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:29.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.201+0000 7f6e6dac5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e68121cf0 con 0x7f6e680a1340 2023-10-01T08:01:29.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.201+0000 7f6e6dac5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e68122310 con 0x7f6e68133fa0 2023-10-01T08:01:29.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.201+0000 7f6e6dac5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e68122f40 con 0x7f6e680a0a30 2023-10-01T08:01:29.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.201+0000 7f6e677fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e680a0a30 0x7f6e681200e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:29.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.201+0000 7f6e677fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e680a0a30 0x7f6e681200e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:54402/0 (socket says 172.21.15.26:54402) 2023-10-01T08:01:29.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.201+0000 7f6e677fe700 1 -- 172.21.15.26:0/3338222221 learned_addr learned my addr 172.21.15.26:0/3338222221 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:29.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.202+0000 7f6e67fff700 1 --2- 172.21.15.26:0/3338222221 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e68133fa0 0x7f6e68120b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:29.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.202+0000 7f6e66ffd700 1 --2- 172.21.15.26:0/3338222221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e680a1340 0x7f6e68120620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:29.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.202+0000 7f6e677fe700 1 -- 172.21.15.26:0/3338222221 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e68133fa0 msgr2=0x7f6e68120b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:29.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.202+0000 7f6e677fe700 1 --2- 172.21.15.26:0/3338222221 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e68133fa0 0x7f6e68120b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:29.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.202+0000 7f6e677fe700 1 -- 172.21.15.26:0/3338222221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e680a1340 msgr2=0x7f6e68120620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:29.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.202+0000 7f6e677fe700 1 --2- 172.21.15.26:0/3338222221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e680a1340 0x7f6e68120620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:29.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.202+0000 7f6e677fe700 1 -- 172.21.15.26:0/3338222221 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e58009550 con 0x7f6e680a0a30 2023-10-01T08:01:29.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.202+0000 7f6e677fe700 1 --2- 172.21.15.26:0/3338222221 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e680a0a30 0x7f6e681200e0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f6e5800ebe0 tx=0x7f6e5800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:29.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.202+0000 7f6e4ffff700 1 -- 172.21.15.26:0/3338222221 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5800c850 con 0x7f6e680a0a30 2023-10-01T08:01:29.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.202+0000 7f6e4ffff700 1 -- 172.21.15.26:0/3338222221 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5800c9b0 con 0x7f6e680a0a30 2023-10-01T08:01:29.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.202+0000 7f6e6dac5700 1 -- 172.21.15.26:0/3338222221 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e5c0094a0 con 0x7f6e680a0a30 2023-10-01T08:01:29.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.202+0000 7f6e4ffff700 1 -- 172.21.15.26:0/3338222221 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5800cd40 con 0x7f6e680a0a30 2023-10-01T08:01:29.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.202+0000 7f6e6dac5700 1 -- 172.21.15.26:0/3338222221 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e680a0220 con 0x7f6e680a0a30 2023-10-01T08:01:29.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.203+0000 7f6e4ffff700 1 -- 172.21.15.26:0/3338222221 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6e58013470 con 0x7f6e680a0a30 2023-10-01T08:01:29.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.203+0000 7f6e4ffff700 1 -- 172.21.15.26:0/3338222221 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6e5803fb80 con 0x7f6e680a0a30 2023-10-01T08:01:29.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.204+0000 7f6e6dac5700 1 -- 172.21.15.26:0/3338222221 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e68074ea0 con 0x7f6e680a0a30 2023-10-01T08:01:29.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.213+0000 7f6e4ffff700 1 -- 172.21.15.26:0/3338222221 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6e5803fe60 con 0x7f6e680a0a30 2023-10-01T08:01:29.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.305+0000 7f4be569d700 1 -- 172.21.15.26:0/2392837099 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4be0136820 con 0x7f4be009e410 2023-10-01T08:01:29.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.306+0000 7f4bc77fe700 1 -- 172.21.15.26:0/2392837099 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4be0136820 con 0x7f4be009e410 2023-10-01T08:01:29.307 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:29.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.308+0000 7f4be569d700 1 -- 172.21.15.26:0/2392837099 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4be009e410 msgr2=0x7f4be013a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:29.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.308+0000 7f4be569d700 1 --2- 172.21.15.26:0/2392837099 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4be009e410 0x7f4be013a2c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f4bd8007fd0 tx=0x7f4bd800ce10 comp rx=0 tx=0).stop 2023-10-01T08:01:29.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.308+0000 7f4be569d700 1 -- 172.21.15.26:0/2392837099 shutdown_connections 2023-10-01T08:01:29.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.308+0000 7f4be569d700 1 --2- 172.21.15.26:0/2392837099 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f4be009e410 0x7f4be013a2c0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:29.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.308+0000 7f4be569d700 1 --2- 172.21.15.26:0/2392837099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4be009d6f0 0x7f4be0139840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:29.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.308+0000 7f4be569d700 1 --2- 172.21.15.26:0/2392837099 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4be009e000 0x7f4be0139d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:29.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.308+0000 7f4be569d700 1 -- 172.21.15.26:0/2392837099 >> 172.21.15.26:0/2392837099 conn(0x7f4be0066f50 msgr2=0x7f4be00a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:29.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.308+0000 7f4be569d700 1 -- 172.21.15.26:0/2392837099 shutdown_connections 2023-10-01T08:01:29.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.308+0000 7f4be569d700 1 -- 172.21.15.26:0/2392837099 wait complete. 2023-10-01T08:01:29.323 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:29.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.383+0000 7f776c14a700 1 -- 172.21.15.26:0/1370954835 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7764071d20 con 0x7f776409f240 2023-10-01T08:01:29.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.383+0000 7f775a7fc700 1 -- 172.21.15.26:0/1370954835 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f775402b020 con 0x7f776409f240 2023-10-01T08:01:29.384 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:29.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.385+0000 7f776c14a700 1 -- 172.21.15.26:0/1370954835 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f776409f240 msgr2=0x7f776406bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:29.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.385+0000 7f776c14a700 1 --2- 172.21.15.26:0/1370954835 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f776409f240 0x7f776406bdc0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f7754016000 tx=0x7f7754004750 comp rx=0 tx=0).stop 2023-10-01T08:01:29.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.386+0000 7f776c14a700 1 -- 172.21.15.26:0/1370954835 shutdown_connections 2023-10-01T08:01:29.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.386+0000 7f776c14a700 1 --2- 172.21.15.26:0/1370954835 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f776409f650 0x7f776406c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:29.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.386+0000 7f776c14a700 1 --2- 172.21.15.26:0/1370954835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f776409e930 0x7f776406b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:29.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.386+0000 7f776c14a700 1 --2- 172.21.15.26:0/1370954835 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f776409f240 0x7f776406bdc0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:29.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.386+0000 7f776c14a700 1 -- 172.21.15.26:0/1370954835 >> 172.21.15.26:0/1370954835 conn(0x7f77640a4210 msgr2=0x7f77641b8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:29.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.386+0000 7f776c14a700 1 -- 172.21.15.26:0/1370954835 shutdown_connections 2023-10-01T08:01:29.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.386+0000 7f776c14a700 1 -- 172.21.15.26:0/1370954835 wait complete. 2023-10-01T08:01:29.400 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:29.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.422+0000 7f6e6dac5700 1 -- 172.21.15.26:0/3338222221 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6e680a28e0 con 0x7f6e680a0a30 2023-10-01T08:01:29.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.422+0000 7f6e4ffff700 1 -- 172.21.15.26:0/3338222221 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6e5801b3b0 con 0x7f6e680a0a30 2023-10-01T08:01:29.423 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:29.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.425+0000 7f6e6dac5700 1 -- 172.21.15.26:0/3338222221 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e680a0a30 msgr2=0x7f6e681200e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:29.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.425+0000 7f6e6dac5700 1 --2- 172.21.15.26:0/3338222221 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e680a0a30 0x7f6e681200e0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f6e5800ebe0 tx=0x7f6e5800eef0 comp rx=0 tx=0).stop 2023-10-01T08:01:29.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.425+0000 7f6e6dac5700 1 -- 172.21.15.26:0/3338222221 shutdown_connections 2023-10-01T08:01:29.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.425+0000 7f6e6dac5700 1 --2- 172.21.15.26:0/3338222221 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e68133fa0 0x7f6e68120b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:29.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.425+0000 7f6e6dac5700 1 --2- 172.21.15.26:0/3338222221 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6e680a0a30 0x7f6e681200e0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:29.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.425+0000 7f6e6dac5700 1 --2- 172.21.15.26:0/3338222221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e680a1340 0x7f6e68120620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:29.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.425+0000 7f6e6dac5700 1 -- 172.21.15.26:0/3338222221 >> 172.21.15.26:0/3338222221 conn(0x7f6e680a6550 msgr2=0x7f6e681bafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:29.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.425+0000 7f6e6dac5700 1 -- 172.21.15.26:0/3338222221 shutdown_connections 2023-10-01T08:01:29.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.425+0000 7f6e6dac5700 1 -- 172.21.15.26:0/3338222221 wait complete. 2023-10-01T08:01:29.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:29.589 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:29.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.731+0000 7f97efd9e700 1 Processor -- start 2023-10-01T08:01:29.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.732+0000 7f97efd9e700 1 -- start start 2023-10-01T08:01:29.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.732+0000 7f97efd9e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97e809e930 0x7f97e809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:29.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.732+0000 7f97efd9e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97e809f240 0x7f97e81317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:29.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.732+0000 7f97efd9e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97e8070940 con 0x7f97e809f650 2023-10-01T08:01:29.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.732+0000 7f97efd9e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e806fd60 con 0x7f97e809f240 2023-10-01T08:01:29.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.732+0000 7f97efd9e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97e806fa80 con 0x7f97e809e930 2023-10-01T08:01:29.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.732+0000 7f97ed339700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97e809f240 0x7f97e81317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:29.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.732+0000 7f97edb3a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97e809e930 0x7f97e809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:29.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.732+0000 7f97ed339700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97e809f240 0x7f97e81317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51622/0 (socket says 172.21.15.26:51622) 2023-10-01T08:01:29.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.732+0000 7f97ed339700 1 -- 172.21.15.26:0/447623584 learned_addr learned my addr 172.21.15.26:0/447623584 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:29.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.732+0000 7f97ed339700 1 -- 172.21.15.26:0/447623584 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97e809e930 msgr2=0x7f97e809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:29.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.732+0000 7f97ed339700 1 --2- 172.21.15.26:0/447623584 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97e809e930 0x7f97e809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:29.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.732+0000 7f97ed339700 1 -- 172.21.15.26:0/447623584 >> v1:172.21.15.26:6789/0 conn(0x7f97e809f650 legacy=0x7f97e8131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:29.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.733+0000 7f97ecb38700 1 -- 172.21.15.26:0/447623584 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1508461962 0 0) 0x7f97e8070940 con 0x7f97e809f650 2023-10-01T08:01:29.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.733+0000 7f97ed339700 1 -- 172.21.15.26:0/447623584 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e809fb60 con 0x7f97e809f240 2023-10-01T08:01:29.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.733+0000 7f97edb3a700 1 --2- 172.21.15.26:0/447623584 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97e809e930 0x7f97e809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:29.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.733+0000 7f97ed339700 1 --2- 172.21.15.26:0/447623584 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97e809f240 0x7f97e81317f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f97d8009920 tx=0x7f97d8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=169f2b79fd452a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:29.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.733+0000 7f97ecb38700 1 -- 172.21.15.26:0/447623584 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d8011830 con 0x7f97e809f240 2023-10-01T08:01:29.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.733+0000 7f97ecb38700 1 -- 172.21.15.26:0/447623584 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d8011990 con 0x7f97e809f240 2023-10-01T08:01:29.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.733+0000 7f97ecb38700 1 -- 172.21.15.26:0/447623584 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d8011d20 con 0x7f97e809f240 2023-10-01T08:01:29.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.733+0000 7f97efd9e700 1 -- 172.21.15.26:0/447623584 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97e809f240 msgr2=0x7f97e81317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:29.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.733+0000 7f97efd9e700 1 --2- 172.21.15.26:0/447623584 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97e809f240 0x7f97e81317f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f97d8009920 tx=0x7f97d8009c30 comp rx=0 tx=0).stop 2023-10-01T08:01:29.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.734+0000 7f97efd9e700 1 -- 172.21.15.26:0/447623584 shutdown_connections 2023-10-01T08:01:29.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.734+0000 7f97efd9e700 1 --2- 172.21.15.26:0/447623584 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97e809e930 0x7f97e809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:29.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.734+0000 7f97efd9e700 1 --2- 172.21.15.26:0/447623584 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97e809f240 0x7f97e81317f0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:29.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.734+0000 7f97efd9e700 1 -- 172.21.15.26:0/447623584 >> 172.21.15.26:0/447623584 conn(0x7f97e80a4210 msgr2=0x7f97e80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:29.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.734+0000 7f97efd9e700 1 -- 172.21.15.26:0/447623584 shutdown_connections 2023-10-01T08:01:29.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.734+0000 7f97efd9e700 1 -- 172.21.15.26:0/447623584 wait complete. 2023-10-01T08:01:29.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.735+0000 7f97efd9e700 1 Processor -- start 2023-10-01T08:01:29.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.735+0000 7f97efd9e700 1 -- start start 2023-10-01T08:01:29.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.735+0000 7f97efd9e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97e809e930 0x7f97e81a3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:29.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.735+0000 7f97efd9e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97e809f240 0x7f97e81a4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:29.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.735+0000 7f97efd9e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97e809f650 0x7f97e81a4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:29.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.735+0000 7f97efd9e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e81a5f20 con 0x7f97e809e930 2023-10-01T08:01:29.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.735+0000 7f97efd9e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e81a81a0 con 0x7f97e809f240 2023-10-01T08:01:29.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.735+0000 7f97efd9e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97e81a77e0 con 0x7f97e809f650 2023-10-01T08:01:29.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.735+0000 7f97edb3a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97e809e930 0x7f97e81a3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:29.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.735+0000 7f97edb3a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97e809e930 0x7f97e81a3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55898/0 (socket says 172.21.15.26:55898) 2023-10-01T08:01:29.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.735+0000 7f97edb3a700 1 -- 172.21.15.26:0/4078511428 learned_addr learned my addr 172.21.15.26:0/4078511428 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:29.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.735+0000 7f97ed339700 1 --2- 172.21.15.26:0/4078511428 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97e809f240 0x7f97e81a4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:29.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.735+0000 7f97ee33b700 1 --2- 172.21.15.26:0/4078511428 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97e809f650 0x7f97e81a4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:29.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.736+0000 7f97edb3a700 1 -- 172.21.15.26:0/4078511428 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97e809f650 msgr2=0x7f97e81a4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:29.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.736+0000 7f97edb3a700 1 --2- 172.21.15.26:0/4078511428 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97e809f650 0x7f97e81a4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:29.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.736+0000 7f97edb3a700 1 -- 172.21.15.26:0/4078511428 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97e809f240 msgr2=0x7f97e81a4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:29.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.736+0000 7f97edb3a700 1 --2- 172.21.15.26:0/4078511428 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97e809f240 0x7f97e81a4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:29.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.736+0000 7f97edb3a700 1 -- 172.21.15.26:0/4078511428 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e40094a0 con 0x7f97e809e930 2023-10-01T08:01:29.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.736+0000 7f97ed339700 1 --2- 172.21.15.26:0/4078511428 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97e809f240 0x7f97e81a4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:29.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.736+0000 7f97edb3a700 1 --2- 172.21.15.26:0/4078511428 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97e809e930 0x7f97e81a3cc0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f97e400ec40 tx=0x7f97e400ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:29.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.736+0000 7f97de7fc700 1 -- 172.21.15.26:0/4078511428 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e400c850 con 0x7f97e809e930 2023-10-01T08:01:29.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.736+0000 7f97de7fc700 1 -- 172.21.15.26:0/4078511428 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e400c9b0 con 0x7f97e809e930 2023-10-01T08:01:29.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.736+0000 7f97efd9e700 1 -- 172.21.15.26:0/4078511428 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97d8009550 con 0x7f97e809e930 2023-10-01T08:01:29.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.736+0000 7f97de7fc700 1 -- 172.21.15.26:0/4078511428 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e400cd20 con 0x7f97e809e930 2023-10-01T08:01:29.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.736+0000 7f97efd9e700 1 -- 172.21.15.26:0/4078511428 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e80a0190 con 0x7f97e809e930 2023-10-01T08:01:29.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.737+0000 7f97de7fc700 1 -- 172.21.15.26:0/4078511428 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f97e4013470 con 0x7f97e809e930 2023-10-01T08:01:29.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.737+0000 7f97efd9e700 1 -- 172.21.15.26:0/4078511428 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e8071d20 con 0x7f97e809e930 2023-10-01T08:01:29.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.737+0000 7f97de7fc700 1 -- 172.21.15.26:0/4078511428 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f97e403f8c0 con 0x7f97e809e930 2023-10-01T08:01:29.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.742+0000 7f97de7fc700 1 -- 172.21.15.26:0/4078511428 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f97e4013720 con 0x7f97e809e930 2023-10-01T08:01:29.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.946+0000 7f97efd9e700 1 -- 172.21.15.26:0/4078511428 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f97e8074ea0 con 0x7f97e809e930 2023-10-01T08:01:29.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.946+0000 7f97de7fc700 1 -- 172.21.15.26:0/4078511428 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f97e401ae80 con 0x7f97e809e930 2023-10-01T08:01:29.947 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:29.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.948+0000 7f97efd9e700 1 -- 172.21.15.26:0/4078511428 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97e809e930 msgr2=0x7f97e81a3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:29.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.948+0000 7f97efd9e700 1 --2- 172.21.15.26:0/4078511428 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97e809e930 0x7f97e81a3cc0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f97e400ec40 tx=0x7f97e400ef50 comp rx=0 tx=0).stop 2023-10-01T08:01:29.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.949+0000 7f97efd9e700 1 -- 172.21.15.26:0/4078511428 shutdown_connections 2023-10-01T08:01:29.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.949+0000 7f97efd9e700 1 --2- 172.21.15.26:0/4078511428 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97e809f650 0x7f97e81a4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:29.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.949+0000 7f97efd9e700 1 --2- 172.21.15.26:0/4078511428 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97e809e930 0x7f97e81a3cc0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:29.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.949+0000 7f97efd9e700 1 --2- 172.21.15.26:0/4078511428 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97e809f240 0x7f97e81a4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:29.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.949+0000 7f97efd9e700 1 -- 172.21.15.26:0/4078511428 >> 172.21.15.26:0/4078511428 conn(0x7f97e80a4210 msgr2=0x7f97e81b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:29.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.949+0000 7f97efd9e700 1 -- 172.21.15.26:0/4078511428 shutdown_connections 2023-10-01T08:01:29.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:29.949+0000 7f97efd9e700 1 -- 172.21.15.26:0/4078511428 wait complete. 2023-10-01T08:01:29.963 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:30.324 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:30.400 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:30.440 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:30.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.472+0000 7f1a3ac50700 1 Processor -- start 2023-10-01T08:01:30.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.472+0000 7f1a3ac50700 1 -- start start 2023-10-01T08:01:30.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.473+0000 7f1a3ac50700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1a3409d6f0 0x7f1a3409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:30.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.473+0000 7f1a3ac50700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1a3409e000 0x7f1a341339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:30.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.473+0000 7f1a3ac50700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1a3409e410 0x7f1a34133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:30.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.473+0000 7f1a3ac50700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a3406b460 con 0x7f1a3409e000 2023-10-01T08:01:30.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.473+0000 7f1a3ac50700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3409b120 con 0x7f1a3409e410 2023-10-01T08:01:30.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.473+0000 7f1a3ac50700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3409a7e0 con 0x7f1a3409d6f0 2023-10-01T08:01:30.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.473+0000 7f1a33fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1a3409e000 0x7f1a341339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:30.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.473+0000 7f1a391ed700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1a3409e410 0x7f1a34133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:30.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.473+0000 7f1a391ed700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1a3409e410 0x7f1a34133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51640/0 (socket says 172.21.15.26:51640) 2023-10-01T08:01:30.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.473+0000 7f1a33fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1a3409e000 0x7f1a341339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55902/0 (socket says 172.21.15.26:55902) 2023-10-01T08:01:30.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.473+0000 7f1a391ed700 1 -- 172.21.15.26:0/1332355344 learned_addr learned my addr 172.21.15.26:0/1332355344 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:30.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.473+0000 7f1a389ec700 1 --2- 172.21.15.26:0/1332355344 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1a3409d6f0 0x7f1a3409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:30.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.474+0000 7f1a33fff700 1 -- 172.21.15.26:0/1332355344 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1a3409d6f0 msgr2=0x7f1a3409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:30.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.474+0000 7f1a33fff700 1 --2- 172.21.15.26:0/1332355344 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1a3409d6f0 0x7f1a3409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:30.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.474+0000 7f1a33fff700 1 -- 172.21.15.26:0/1332355344 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1a3409e410 msgr2=0x7f1a34133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:30.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.474+0000 7f1a33fff700 1 --2- 172.21.15.26:0/1332355344 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1a3409e410 0x7f1a34133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:30.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.474+0000 7f1a33fff700 1 -- 172.21.15.26:0/1332355344 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a3409a500 con 0x7f1a3409e000 2023-10-01T08:01:30.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.474+0000 7f1a389ec700 1 --2- 172.21.15.26:0/1332355344 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1a3409d6f0 0x7f1a3409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:30.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.474+0000 7f1a33fff700 1 --2- 172.21.15.26:0/1332355344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a3409e000 0x7f1a341339f0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009840 tx=0x7f1a20009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a090cbc6823e969 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:30.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.474+0000 7f1a337fe700 1 -- 172.21.15.26:0/1332355344 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a20011830 con 0x7f1a3409e000 2023-10-01T08:01:30.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.474+0000 7f1a337fe700 1 -- 172.21.15.26:0/1332355344 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a20011990 con 0x7f1a3409e000 2023-10-01T08:01:30.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.474+0000 7f1a337fe700 1 -- 172.21.15.26:0/1332355344 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a20011d20 con 0x7f1a3409e000 2023-10-01T08:01:30.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.475+0000 7f1a3ac50700 1 -- 172.21.15.26:0/1332355344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a3409e000 msgr2=0x7f1a341339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:30.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.475+0000 7f1a3ac50700 1 --2- 172.21.15.26:0/1332355344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a3409e000 0x7f1a341339f0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009840 tx=0x7f1a20009b50 comp rx=0 tx=0).stop 2023-10-01T08:01:30.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.475+0000 7f1a3ac50700 1 -- 172.21.15.26:0/1332355344 shutdown_connections 2023-10-01T08:01:30.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.475+0000 7f1a3ac50700 1 --2- 172.21.15.26:0/1332355344 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1a3409e410 0x7f1a34133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:30.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.475+0000 7f1a3ac50700 1 --2- 172.21.15.26:0/1332355344 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1a3409d6f0 0x7f1a3409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:30.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.475+0000 7f1a3ac50700 1 --2- 172.21.15.26:0/1332355344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a3409e000 0x7f1a341339f0 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:30.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.475+0000 7f1a3ac50700 1 -- 172.21.15.26:0/1332355344 >> 172.21.15.26:0/1332355344 conn(0x7f1a34066f50 msgr2=0x7f1a3409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:30.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.475+0000 7f1a3ac50700 1 -- 172.21.15.26:0/1332355344 shutdown_connections 2023-10-01T08:01:30.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.475+0000 7f1a3ac50700 1 -- 172.21.15.26:0/1332355344 wait complete. 2023-10-01T08:01:30.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.476+0000 7f1a3ac50700 1 Processor -- start 2023-10-01T08:01:30.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.476+0000 7f1a3ac50700 1 -- start start 2023-10-01T08:01:30.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.477+0000 7f1a3ac50700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1a3409d6f0 0x7f1a341a5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:30.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.477+0000 7f1a3ac50700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1a3409e000 0x7f1a341a6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:30.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.477+0000 7f1a3ac50700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a3409e410 0x7f1a341a6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:30.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.477+0000 7f1a3ac50700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a341a7b50 con 0x7f1a3409e410 2023-10-01T08:01:30.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.477+0000 7f1a3ac50700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a341a8170 con 0x7f1a3409e000 2023-10-01T08:01:30.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.477+0000 7f1a3ac50700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a341a8da0 con 0x7f1a3409d6f0 2023-10-01T08:01:30.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.477+0000 7f1a33fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1a3409e000 0x7f1a341a6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:30.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.477+0000 7f1a33fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1a3409e000 0x7f1a341a6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51654/0 (socket says 172.21.15.26:51654) 2023-10-01T08:01:30.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.477+0000 7f1a33fff700 1 -- 172.21.15.26:0/1534545361 learned_addr learned my addr 172.21.15.26:0/1534545361 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:30.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.477+0000 7f1a33fff700 1 -- 172.21.15.26:0/1534545361 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1a3409d6f0 msgr2=0x7f1a341a5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:30.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.477+0000 7f1a33fff700 1 --2- 172.21.15.26:0/1534545361 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1a3409d6f0 0x7f1a341a5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:30.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.477+0000 7f1a33fff700 1 -- 172.21.15.26:0/1534545361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a3409e410 msgr2=0x7f1a341a6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:30.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.477+0000 7f1a33fff700 1 --2- 172.21.15.26:0/1534545361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a3409e410 0x7f1a341a6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:30.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.477+0000 7f1a33fff700 1 -- 172.21.15.26:0/1534545361 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a280094a0 con 0x7f1a3409e000 2023-10-01T08:01:30.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.478+0000 7f1a33fff700 1 --2- 172.21.15.26:0/1534545361 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1a3409e000 0x7f1a341a6510 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f1a200090b0 tx=0x7f1a20004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:30.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.478+0000 7f1a317fa700 1 -- 172.21.15.26:0/1534545361 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a20004510 con 0x7f1a3409e000 2023-10-01T08:01:30.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.478+0000 7f1a317fa700 1 -- 172.21.15.26:0/1534545361 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2001f070 con 0x7f1a3409e000 2023-10-01T08:01:30.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.478+0000 7f1a3ac50700 1 -- 172.21.15.26:0/1534545361 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a200094a0 con 0x7f1a3409e000 2023-10-01T08:01:30.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.478+0000 7f1a317fa700 1 -- 172.21.15.26:0/1534545361 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a200038e0 con 0x7f1a3409e000 2023-10-01T08:01:30.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.478+0000 7f1a3ac50700 1 -- 172.21.15.26:0/1534545361 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a340a2000 con 0x7f1a3409e000 2023-10-01T08:01:30.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.479+0000 7f1a317fa700 1 -- 172.21.15.26:0/1534545361 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1a20003a40 con 0x7f1a3409e000 2023-10-01T08:01:30.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.479+0000 7f1a317fa700 1 -- 172.21.15.26:0/1534545361 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1a20021070 con 0x7f1a3409e000 2023-10-01T08:01:30.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.480+0000 7f1a3ac50700 1 -- 172.21.15.26:0/1534545361 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a3409dd30 con 0x7f1a3409e000 2023-10-01T08:01:30.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.489+0000 7f1a317fa700 1 -- 172.21.15.26:0/1534545361 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1a20015080 con 0x7f1a3409e000 2023-10-01T08:01:30.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.543+0000 7f271c719700 1 Processor -- start 2023-10-01T08:01:30.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.543+0000 7f271c719700 1 -- start start 2023-10-01T08:01:30.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.544+0000 7f271c719700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2714136820 0x7f2714138c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:30.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.544+0000 7f271c719700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2714139140 0x7f271413b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:30.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.544+0000 7f271c719700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f271406bc00 con 0x7f2714133a80 2023-10-01T08:01:30.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.544+0000 7f271c719700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f271406c570 con 0x7f2714139140 2023-10-01T08:01:30.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.544+0000 7f271c719700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27140a0040 con 0x7f2714136820 2023-10-01T08:01:30.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.544+0000 7f271acb6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2714139140 0x7f271413b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:30.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.544+0000 7f2719cb4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2714136820 0x7f2714138c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:30.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.544+0000 7f271acb6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2714139140 0x7f271413b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55930/0 (socket says 172.21.15.26:55930) 2023-10-01T08:01:30.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.544+0000 7f271acb6700 1 -- 172.21.15.26:0/2038651589 learned_addr learned my addr 172.21.15.26:0/2038651589 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:30.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.545+0000 7f2719cb4700 1 -- 172.21.15.26:0/2038651589 >> v2:172.21.15.26:3300/0 conn(0x7f2714139140 msgr2=0x7f271413b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:30.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.545+0000 7f2719cb4700 1 --2- 172.21.15.26:0/2038651589 >> v2:172.21.15.26:3300/0 conn(0x7f2714139140 0x7f271413b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:30.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.545+0000 7f2719cb4700 1 -- 172.21.15.26:0/2038651589 >> v1:172.21.15.26:6789/0 conn(0x7f2714133a80 legacy=0x7f2714133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:30.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.545+0000 7f2719cb4700 1 -- 172.21.15.26:0/2038651589 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2714133860 con 0x7f2714136820 2023-10-01T08:01:30.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.545+0000 7f27194b3700 1 -- 172.21.15.26:0/2038651589 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 311444105 0 0) 0x7f271406bc00 con 0x7f2714133a80 2023-10-01T08:01:30.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.545+0000 7f271acb6700 1 --2- 172.21.15.26:0/2038651589 >> v2:172.21.15.26:3300/0 conn(0x7f2714139140 0x7f271413b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:30.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.545+0000 7f2719cb4700 1 --2- 172.21.15.26:0/2038651589 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2714136820 0x7f2714138c00 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f2704009840 tx=0x7f2704009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f509232781a52d66 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:30.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.545+0000 7f27194b3700 1 -- 172.21.15.26:0/2038651589 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2704011830 con 0x7f2714136820 2023-10-01T08:01:30.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.545+0000 7f27194b3700 1 -- 172.21.15.26:0/2038651589 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2704011990 con 0x7f2714136820 2023-10-01T08:01:30.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.545+0000 7f27194b3700 1 -- 172.21.15.26:0/2038651589 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2704011d20 con 0x7f2714136820 2023-10-01T08:01:30.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.546+0000 7f271c719700 1 -- 172.21.15.26:0/2038651589 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2714136820 msgr2=0x7f2714138c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:30.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.546+0000 7f271c719700 1 --2- 172.21.15.26:0/2038651589 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2714136820 0x7f2714138c00 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f2704009840 tx=0x7f2704009b50 comp rx=0 tx=0).stop 2023-10-01T08:01:30.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.546+0000 7f271c719700 1 -- 172.21.15.26:0/2038651589 shutdown_connections 2023-10-01T08:01:30.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.546+0000 7f271c719700 1 --2- 172.21.15.26:0/2038651589 >> v2:172.21.15.26:3300/0 conn(0x7f2714139140 0x7f271413b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:30.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.546+0000 7f271c719700 1 --2- 172.21.15.26:0/2038651589 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2714136820 0x7f2714138c00 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:30.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.546+0000 7f271c719700 1 -- 172.21.15.26:0/2038651589 >> 172.21.15.26:0/2038651589 conn(0x7f27140a4210 msgr2=0x7f27140a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:30.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.546+0000 7f271c719700 1 -- 172.21.15.26:0/2038651589 shutdown_connections 2023-10-01T08:01:30.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.546+0000 7f271c719700 1 -- 172.21.15.26:0/2038651589 wait complete. 2023-10-01T08:01:30.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.547+0000 7f271c719700 1 Processor -- start 2023-10-01T08:01:30.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.548+0000 7f271c719700 1 -- start start 2023-10-01T08:01:30.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.548+0000 7f271c719700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2714133a80 0x7f271409b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:30.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.548+0000 7f271c719700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2714136820 0x7f271409b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:30.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.548+0000 7f271c719700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2714139140 0x7f271409beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:30.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.548+0000 7f271c719700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271409dcd0 con 0x7f2714136820 2023-10-01T08:01:30.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.548+0000 7f271c719700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27141363d0 con 0x7f2714139140 2023-10-01T08:01:30.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.548+0000 7f271c719700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f271409deb0 con 0x7f2714133a80 2023-10-01T08:01:30.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.548+0000 7f271a4b5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2714133a80 0x7f271409b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:30.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.548+0000 7f271a4b5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2714133a80 0x7f271409b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:54450/0 (socket says 172.21.15.26:54450) 2023-10-01T08:01:30.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.548+0000 7f271a4b5700 1 -- 172.21.15.26:0/3184601200 learned_addr learned my addr 172.21.15.26:0/3184601200 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:30.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.548+0000 7f271acb6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2714139140 0x7f271409beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:30.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.549+0000 7f2719cb4700 1 --2- 172.21.15.26:0/3184601200 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2714136820 0x7f271409b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:30.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.549+0000 7f271a4b5700 1 -- 172.21.15.26:0/3184601200 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2714139140 msgr2=0x7f271409beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:30.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.549+0000 7f271a4b5700 1 --2- 172.21.15.26:0/3184601200 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2714139140 0x7f271409beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:30.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.549+0000 7f271a4b5700 1 -- 172.21.15.26:0/3184601200 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2714136820 msgr2=0x7f271409b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:30.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.549+0000 7f271a4b5700 1 --2- 172.21.15.26:0/3184601200 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2714136820 0x7f271409b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:30.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.549+0000 7f271a4b5700 1 -- 172.21.15.26:0/3184601200 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f270c009b30 con 0x7f2714133a80 2023-10-01T08:01:30.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.549+0000 7f271acb6700 1 --2- 172.21.15.26:0/3184601200 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2714139140 0x7f271409beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:30.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.549+0000 7f2719cb4700 1 --2- 172.21.15.26:0/3184601200 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2714136820 0x7f271409b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:30.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.549+0000 7f271a4b5700 1 --2- 172.21.15.26:0/3184601200 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2714133a80 0x7f271409b430 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f2710001eb0 tx=0x7f271000c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:30.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.549+0000 7f270affd700 1 -- 172.21.15.26:0/3184601200 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27100054e0 con 0x7f2714133a80 2023-10-01T08:01:30.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.549+0000 7f270affd700 1 -- 172.21.15.26:0/3184601200 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2710003680 con 0x7f2714133a80 2023-10-01T08:01:30.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.549+0000 7f270affd700 1 -- 172.21.15.26:0/3184601200 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27100039f0 con 0x7f2714133a80 2023-10-01T08:01:30.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.549+0000 7f271c719700 1 -- 172.21.15.26:0/3184601200 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27040094a0 con 0x7f2714133a80 2023-10-01T08:01:30.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.549+0000 7f271c719700 1 -- 172.21.15.26:0/3184601200 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f271409ca70 con 0x7f2714133a80 2023-10-01T08:01:30.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.550+0000 7f270affd700 1 -- 172.21.15.26:0/3184601200 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2710003b50 con 0x7f2714133a80 2023-10-01T08:01:30.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.551+0000 7f270affd700 1 -- 172.21.15.26:0/3184601200 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f271003ea50 con 0x7f2714133a80 2023-10-01T08:01:30.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.551+0000 7f271c719700 1 -- 172.21.15.26:0/3184601200 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f271409db30 con 0x7f2714133a80 2023-10-01T08:01:30.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.556+0000 7f270affd700 1 -- 172.21.15.26:0/3184601200 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f271409db30 con 0x7f2714133a80 2023-10-01T08:01:30.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.593+0000 7fa51bc1e700 1 Processor -- start 2023-10-01T08:01:30.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.593+0000 7fa51bc1e700 1 -- start start 2023-10-01T08:01:30.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.593+0000 7fa51bc1e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa5141338a0 0x7fa514133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:30.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.593+0000 7fa51bc1e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa51409de50 0x7fa51409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:30.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.593+0000 7fa51bc1e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa51409e760 0x7fa51413a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:30.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.593+0000 7fa51bc1e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa51406fef0 con 0x7fa5141338a0 2023-10-01T08:01:30.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.593+0000 7fa51bc1e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa51406ef30 con 0x7fa51409e760 2023-10-01T08:01:30.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.593+0000 7fa51bc1e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5141334b0 con 0x7fa51409de50 2023-10-01T08:01:30.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.594+0000 7fa5199ba700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa5141338a0 0x7fa514133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:30.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.594+0000 7fa5191b9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa51409de50 0x7fa51409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:30.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.594+0000 7fa5191b9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa51409de50 0x7fa51409e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:54464/0 (socket says 172.21.15.26:54464) 2023-10-01T08:01:30.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.594+0000 7fa5199ba700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa5141338a0 0x7fa514133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55944/0 (socket says 172.21.15.26:55944) 2023-10-01T08:01:30.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.594+0000 7fa5191b9700 1 -- 172.21.15.26:0/3825122240 learned_addr learned my addr 172.21.15.26:0/3825122240 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:30.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.594+0000 7fa51a1bb700 1 --2- 172.21.15.26:0/3825122240 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa51409e760 0x7fa51413a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:30.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.594+0000 7fa5199ba700 1 -- 172.21.15.26:0/3825122240 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa51409de50 msgr2=0x7fa51409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:30.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.594+0000 7fa5199ba700 1 --2- 172.21.15.26:0/3825122240 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa51409de50 0x7fa51409e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:30.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.594+0000 7fa5199ba700 1 -- 172.21.15.26:0/3825122240 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa51409e760 msgr2=0x7fa51413a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:30.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.594+0000 7fa5199ba700 1 --2- 172.21.15.26:0/3825122240 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa51409e760 0x7fa51413a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:30.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.594+0000 7fa5199ba700 1 -- 172.21.15.26:0/3825122240 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51406fc30 con 0x7fa5141338a0 2023-10-01T08:01:30.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.594+0000 7fa5199ba700 1 --2- 172.21.15.26:0/3825122240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5141338a0 0x7fa514133c70 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7fa510009840 tx=0x7fa510009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f27848d9a734dc server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:30.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.594+0000 7fa5189b8700 1 -- 172.21.15.26:0/3825122240 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa510011830 con 0x7fa5141338a0 2023-10-01T08:01:30.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.594+0000 7fa5189b8700 1 -- 172.21.15.26:0/3825122240 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa510011990 con 0x7fa5141338a0 2023-10-01T08:01:30.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.594+0000 7fa5189b8700 1 -- 172.21.15.26:0/3825122240 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa510011d20 con 0x7fa5141338a0 2023-10-01T08:01:30.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.595+0000 7fa51bc1e700 1 -- 172.21.15.26:0/3825122240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5141338a0 msgr2=0x7fa514133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:30.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.595+0000 7fa51bc1e700 1 --2- 172.21.15.26:0/3825122240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5141338a0 0x7fa514133c70 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7fa510009840 tx=0x7fa510009b50 comp rx=0 tx=0).stop 2023-10-01T08:01:30.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.595+0000 7fa51bc1e700 1 -- 172.21.15.26:0/3825122240 shutdown_connections 2023-10-01T08:01:30.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.595+0000 7fa51bc1e700 1 --2- 172.21.15.26:0/3825122240 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa51409e760 0x7fa51413a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:30.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.595+0000 7fa51bc1e700 1 --2- 172.21.15.26:0/3825122240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5141338a0 0x7fa514133c70 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:30.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.595+0000 7fa51bc1e700 1 --2- 172.21.15.26:0/3825122240 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa51409de50 0x7fa51409e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:30.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.595+0000 7fa51bc1e700 1 -- 172.21.15.26:0/3825122240 >> 172.21.15.26:0/3825122240 conn(0x7fa5140a2aa0 msgr2=0x7fa5140a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:30.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.595+0000 7fa51bc1e700 1 -- 172.21.15.26:0/3825122240 shutdown_connections 2023-10-01T08:01:30.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.595+0000 7fa51bc1e700 1 -- 172.21.15.26:0/3825122240 wait complete. 2023-10-01T08:01:30.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.596+0000 7fa51bc1e700 1 Processor -- start 2023-10-01T08:01:30.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.596+0000 7fa51bc1e700 1 -- start start 2023-10-01T08:01:30.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.597+0000 7fa51bc1e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa51409de50 0x7fa51411d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:30.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.597+0000 7fa51bc1e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa51409e760 0x7fa51411db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:30.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.597+0000 7fa51bc1e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5141338a0 0x7fa51411e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:30.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.597+0000 7fa51bc1e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5141208e0 con 0x7fa5141338a0 2023-10-01T08:01:30.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.597+0000 7fa51bc1e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa51411f200 con 0x7fa51409e760 2023-10-01T08:01:30.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.597+0000 7fa51bc1e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa514120d90 con 0x7fa51409de50 2023-10-01T08:01:30.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.597+0000 7fa5191b9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa51409e760 0x7fa51411db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:30.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.597+0000 7fa5191b9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa51409e760 0x7fa51411db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51684/0 (socket says 172.21.15.26:51684) 2023-10-01T08:01:30.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.597+0000 7fa5191b9700 1 -- 172.21.15.26:0/550845418 learned_addr learned my addr 172.21.15.26:0/550845418 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:30.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.597+0000 7fa51a1bb700 1 --2- 172.21.15.26:0/550845418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5141338a0 0x7fa51411e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:30.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.597+0000 7fa5191b9700 1 -- 172.21.15.26:0/550845418 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa51409de50 msgr2=0x7fa51411d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:30.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.597+0000 7fa5191b9700 1 --2- 172.21.15.26:0/550845418 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa51409de50 0x7fa51411d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:30.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.597+0000 7fa5191b9700 1 -- 172.21.15.26:0/550845418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5141338a0 msgr2=0x7fa51411e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:30.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.597+0000 7fa5191b9700 1 --2- 172.21.15.26:0/550845418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5141338a0 0x7fa51411e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:30.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.597+0000 7fa5191b9700 1 -- 172.21.15.26:0/550845418 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5100094a0 con 0x7fa51409e760 2023-10-01T08:01:30.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.597+0000 7fa5191b9700 1 --2- 172.21.15.26:0/550845418 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa51409e760 0x7fa51411db20 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fa50400e8e0 tx=0x7fa50400eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:30.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.598+0000 7fa50a7fc700 1 -- 172.21.15.26:0/550845418 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa504009600 con 0x7fa51409e760 2023-10-01T08:01:30.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.598+0000 7fa50a7fc700 1 -- 172.21.15.26:0/550845418 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50400c850 con 0x7fa51409e760 2023-10-01T08:01:30.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.598+0000 7fa51bc1e700 1 -- 172.21.15.26:0/550845418 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5140a0f90 con 0x7fa51409e760 2023-10-01T08:01:30.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.598+0000 7fa50a7fc700 1 -- 172.21.15.26:0/550845418 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50400eee0 con 0x7fa51409e760 2023-10-01T08:01:30.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.598+0000 7fa51bc1e700 1 -- 172.21.15.26:0/550845418 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa51406f690 con 0x7fa51409e760 2023-10-01T08:01:30.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.599+0000 7fa50a7fc700 1 -- 172.21.15.26:0/550845418 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa50400cc00 con 0x7fa51409e760 2023-10-01T08:01:30.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.599+0000 7fa51bc1e700 1 -- 172.21.15.26:0/550845418 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa51411a470 con 0x7fa51409e760 2023-10-01T08:01:30.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.599+0000 7fa50a7fc700 1 -- 172.21.15.26:0/550845418 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa50403fa90 con 0x7fa51409e760 2023-10-01T08:01:30.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.608+0000 7fa50a7fc700 1 -- 172.21.15.26:0/550845418 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa50401b3b0 con 0x7fa51409e760 2023-10-01T08:01:30.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.706+0000 7f1a3ac50700 1 -- 172.21.15.26:0/1534545361 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1a34074ea0 con 0x7f1a3409e000 2023-10-01T08:01:30.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.706+0000 7f1a317fa700 1 -- 172.21.15.26:0/1534545361 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1a2002b030 con 0x7f1a3409e000 2023-10-01T08:01:30.707 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:30.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.708+0000 7f1a3ac50700 1 -- 172.21.15.26:0/1534545361 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1a3409e000 msgr2=0x7f1a341a6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:30.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.708+0000 7f1a3ac50700 1 --2- 172.21.15.26:0/1534545361 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1a3409e000 0x7f1a341a6510 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f1a200090b0 tx=0x7f1a20004750 comp rx=0 tx=0).stop 2023-10-01T08:01:30.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.709+0000 7f1a3ac50700 1 -- 172.21.15.26:0/1534545361 shutdown_connections 2023-10-01T08:01:30.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.709+0000 7f1a3ac50700 1 --2- 172.21.15.26:0/1534545361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a3409e410 0x7f1a341a6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:30.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.709+0000 7f1a3ac50700 1 --2- 172.21.15.26:0/1534545361 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1a3409d6f0 0x7f1a341a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:30.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.709+0000 7f1a3ac50700 1 --2- 172.21.15.26:0/1534545361 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1a3409e000 0x7f1a341a6510 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:30.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.709+0000 7f1a3ac50700 1 -- 172.21.15.26:0/1534545361 >> 172.21.15.26:0/1534545361 conn(0x7f1a34066f50 msgr2=0x7f1a341bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:30.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.709+0000 7f1a3ac50700 1 -- 172.21.15.26:0/1534545361 shutdown_connections 2023-10-01T08:01:30.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.709+0000 7f1a3ac50700 1 -- 172.21.15.26:0/1534545361 wait complete. 2023-10-01T08:01:30.723 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:30.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.769+0000 7f271c719700 1 -- 172.21.15.26:0/3184601200 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f271409db30 con 0x7f2714133a80 2023-10-01T08:01:30.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.770+0000 7f270affd700 1 -- 172.21.15.26:0/3184601200 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f271409db30 con 0x7f2714133a80 2023-10-01T08:01:30.771 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:30.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.772+0000 7f271c719700 1 -- 172.21.15.26:0/3184601200 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2714133a80 msgr2=0x7f271409b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:30.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.772+0000 7f271c719700 1 --2- 172.21.15.26:0/3184601200 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2714133a80 0x7f271409b430 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f2710001eb0 tx=0x7f271000c800 comp rx=0 tx=0).stop 2023-10-01T08:01:30.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.772+0000 7f271c719700 1 -- 172.21.15.26:0/3184601200 shutdown_connections 2023-10-01T08:01:30.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.772+0000 7f271c719700 1 --2- 172.21.15.26:0/3184601200 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2714139140 0x7f271409beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:30.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.772+0000 7f271c719700 1 --2- 172.21.15.26:0/3184601200 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2714133a80 0x7f271409b430 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:30.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.772+0000 7f271c719700 1 --2- 172.21.15.26:0/3184601200 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2714136820 0x7f271409b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:30.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.772+0000 7f271c719700 1 -- 172.21.15.26:0/3184601200 >> 172.21.15.26:0/3184601200 conn(0x7f27140a4210 msgr2=0x7f27140a0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:30.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.772+0000 7f271c719700 1 -- 172.21.15.26:0/3184601200 shutdown_connections 2023-10-01T08:01:30.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.772+0000 7f271c719700 1 -- 172.21.15.26:0/3184601200 wait complete. 2023-10-01T08:01:30.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:30.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.813+0000 7fa51bc1e700 1 -- 172.21.15.26:0/550845418 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa514121190 con 0x7fa51409e760 2023-10-01T08:01:30.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.813+0000 7fa50a7fc700 1 -- 172.21.15.26:0/550845418 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa504017070 con 0x7fa51409e760 2023-10-01T08:01:30.814 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.815+0000 7fa51bc1e700 1 -- 172.21.15.26:0/550845418 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa51409e760 msgr2=0x7fa51411db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:30.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.815+0000 7fa51bc1e700 1 --2- 172.21.15.26:0/550845418 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa51409e760 0x7fa51411db20 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fa50400e8e0 tx=0x7fa50400eca0 comp rx=0 tx=0).stop 2023-10-01T08:01:30.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.816+0000 7fa51bc1e700 1 -- 172.21.15.26:0/550845418 shutdown_connections 2023-10-01T08:01:30.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.816+0000 7fa51bc1e700 1 --2- 172.21.15.26:0/550845418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5141338a0 0x7fa51411e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:30.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.816+0000 7fa51bc1e700 1 --2- 172.21.15.26:0/550845418 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa51409de50 0x7fa51411d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:30.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.816+0000 7fa51bc1e700 1 --2- 172.21.15.26:0/550845418 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa51409e760 0x7fa51411db20 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:30.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.816+0000 7fa51bc1e700 1 -- 172.21.15.26:0/550845418 >> 172.21.15.26:0/550845418 conn(0x7fa5140a2aa0 msgr2=0x7fa5141baea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:30.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.816+0000 7fa51bc1e700 1 -- 172.21.15.26:0/550845418 shutdown_connections 2023-10-01T08:01:30.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:30.816+0000 7fa51bc1e700 1 -- 172.21.15.26:0/550845418 wait complete. 2023-10-01T08:01:30.830 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:30.964 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:31.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.108+0000 7f3d99745700 1 Processor -- start 2023-10-01T08:01:31.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.108+0000 7f3d99745700 1 -- start start 2023-10-01T08:01:31.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.108+0000 7f3d99745700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d940a0a30 0x7f3d940a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:31.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.108+0000 7f3d99745700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3d9409d630 0x7f3d940a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:31.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.108+0000 7f3d99745700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3d94133930 0x7f3d94133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:31.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.109+0000 7f3d99745700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d940a2a70 con 0x7f3d94133930 2023-10-01T08:01:31.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.109+0000 7f3d99745700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d940a01d0 con 0x7f3d940a0a30 2023-10-01T08:01:31.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.109+0000 7f3d99745700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9409e2b0 con 0x7f3d9409d630 2023-10-01T08:01:31.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.109+0000 7f3d927fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3d9409d630 0x7f3d940a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:31.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.109+0000 7f3d937fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3d94133930 0x7f3d94133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:31.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.109+0000 7f3d92ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d940a0a30 0x7f3d940a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:31.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.109+0000 7f3d937fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3d94133930 0x7f3d94133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55960/0 (socket says 172.21.15.26:55960) 2023-10-01T08:01:31.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.109+0000 7f3d937fe700 1 -- 172.21.15.26:0/2454711342 learned_addr learned my addr 172.21.15.26:0/2454711342 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:31.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.109+0000 7f3d927fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3d9409d630 0x7f3d940a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:54480/0 (socket says 172.21.15.26:54480) 2023-10-01T08:01:31.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.109+0000 7f3d937fe700 1 -- 172.21.15.26:0/2454711342 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3d9409d630 msgr2=0x7f3d940a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:31.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.109+0000 7f3d937fe700 1 --2- 172.21.15.26:0/2454711342 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3d9409d630 0x7f3d940a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:31.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.109+0000 7f3d937fe700 1 -- 172.21.15.26:0/2454711342 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d940a0a30 msgr2=0x7f3d940a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:31.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.109+0000 7f3d937fe700 1 --2- 172.21.15.26:0/2454711342 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d940a0a30 0x7f3d940a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:31.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.109+0000 7f3d937fe700 1 -- 172.21.15.26:0/2454711342 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9409dc50 con 0x7f3d94133930 2023-10-01T08:01:31.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.109+0000 7f3d92ffd700 1 --2- 172.21.15.26:0/2454711342 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d940a0a30 0x7f3d940a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:31.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.109+0000 7f3d937fe700 1 --2- 172.21.15.26:0/2454711342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d94133930 0x7f3d94133dd0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c0098f0 tx=0x7f3d8c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8041b8c9b490d5d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:31.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.109+0000 7f3d91ffb700 1 -- 172.21.15.26:0/2454711342 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c011830 con 0x7f3d94133930 2023-10-01T08:01:31.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.109+0000 7f3d91ffb700 1 -- 172.21.15.26:0/2454711342 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8c011990 con 0x7f3d94133930 2023-10-01T08:01:31.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.109+0000 7f3d91ffb700 1 -- 172.21.15.26:0/2454711342 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c011d20 con 0x7f3d94133930 2023-10-01T08:01:31.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.110+0000 7f3d99745700 1 -- 172.21.15.26:0/2454711342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d94133930 msgr2=0x7f3d94133dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:31.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.110+0000 7f3d99745700 1 --2- 172.21.15.26:0/2454711342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d94133930 0x7f3d94133dd0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c0098f0 tx=0x7f3d8c009c00 comp rx=0 tx=0).stop 2023-10-01T08:01:31.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.110+0000 7f3d99745700 1 -- 172.21.15.26:0/2454711342 shutdown_connections 2023-10-01T08:01:31.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.110+0000 7f3d99745700 1 --2- 172.21.15.26:0/2454711342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d94133930 0x7f3d94133dd0 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:31.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.110+0000 7f3d99745700 1 --2- 172.21.15.26:0/2454711342 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d940a0a30 0x7f3d940a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:31.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.110+0000 7f3d99745700 1 --2- 172.21.15.26:0/2454711342 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3d9409d630 0x7f3d940a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:31.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.110+0000 7f3d99745700 1 -- 172.21.15.26:0/2454711342 >> 172.21.15.26:0/2454711342 conn(0x7f3d940a3050 msgr2=0x7f3d940a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:31.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.110+0000 7f3d99745700 1 -- 172.21.15.26:0/2454711342 shutdown_connections 2023-10-01T08:01:31.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.110+0000 7f3d99745700 1 -- 172.21.15.26:0/2454711342 wait complete. 2023-10-01T08:01:31.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.112+0000 7f3d99745700 1 Processor -- start 2023-10-01T08:01:31.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.112+0000 7f3d99745700 1 -- start start 2023-10-01T08:01:31.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.112+0000 7f3d99745700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3d9409d630 0x7f3d941c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:31.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.112+0000 7f3d99745700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d940a0a30 0x7f3d941c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:31.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.112+0000 7f3d99745700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d94133930 0x7f3d941c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:31.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.112+0000 7f3d99745700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d94122100 con 0x7f3d940a0a30 2023-10-01T08:01:31.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.112+0000 7f3d99745700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d941205e0 con 0x7f3d94133930 2023-10-01T08:01:31.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.112+0000 7f3d99745700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d94133420 con 0x7f3d9409d630 2023-10-01T08:01:31.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.113+0000 7f3d92ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3d9409d630 0x7f3d941c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:31.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.113+0000 7f3d92ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3d9409d630 0x7f3d941c7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:54484/0 (socket says 172.21.15.26:54484) 2023-10-01T08:01:31.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.113+0000 7f3d927fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d940a0a30 0x7f3d941c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:31.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.113+0000 7f3d92ffd700 1 -- 172.21.15.26:0/2434457407 learned_addr learned my addr 172.21.15.26:0/2434457407 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:31.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.113+0000 7f3d937fe700 1 --2- 172.21.15.26:0/2434457407 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d94133930 0x7f3d941c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:31.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.113+0000 7f3d92ffd700 1 -- 172.21.15.26:0/2434457407 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d94133930 msgr2=0x7f3d941c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:31.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.113+0000 7f3d92ffd700 1 --2- 172.21.15.26:0/2434457407 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d94133930 0x7f3d941c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:31.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.113+0000 7f3d92ffd700 1 -- 172.21.15.26:0/2434457407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d940a0a30 msgr2=0x7f3d941c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:31.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.113+0000 7f3d92ffd700 1 --2- 172.21.15.26:0/2434457407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d940a0a30 0x7f3d941c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:31.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.113+0000 7f3d92ffd700 1 -- 172.21.15.26:0/2434457407 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d84009a70 con 0x7f3d9409d630 2023-10-01T08:01:31.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.113+0000 7f3d927fc700 1 --2- 172.21.15.26:0/2434457407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d940a0a30 0x7f3d941c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:31.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.113+0000 7f3d92ffd700 1 --2- 172.21.15.26:0/2434457407 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3d9409d630 0x7f3d941c7fb0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400efc0 tx=0x7f3d8400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:31.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.113+0000 7f3d8b7fe700 1 -- 172.21.15.26:0/2434457407 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8400cdd0 con 0x7f3d9409d630 2023-10-01T08:01:31.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.113+0000 7f3d8b7fe700 1 -- 172.21.15.26:0/2434457407 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8400f040 con 0x7f3d9409d630 2023-10-01T08:01:31.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.113+0000 7f3d99745700 1 -- 172.21.15.26:0/2434457407 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d8c009550 con 0x7f3d9409d630 2023-10-01T08:01:31.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.113+0000 7f3d8b7fe700 1 -- 172.21.15.26:0/2434457407 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d840146a0 con 0x7f3d9409d630 2023-10-01T08:01:31.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.113+0000 7f3d99745700 1 -- 172.21.15.26:0/2434457407 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d94120a40 con 0x7f3d9409d630 2023-10-01T08:01:31.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.114+0000 7f3d8b7fe700 1 -- 172.21.15.26:0/2434457407 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3d84014800 con 0x7f3d9409d630 2023-10-01T08:01:31.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.114+0000 7f3d8b7fe700 1 -- 172.21.15.26:0/2434457407 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3d84040420 con 0x7f3d9409d630 2023-10-01T08:01:31.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.114+0000 7f3d99745700 1 -- 172.21.15.26:0/2434457407 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d94120d20 con 0x7f3d9409d630 2023-10-01T08:01:31.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.121+0000 7f3d8b7fe700 1 -- 172.21.15.26:0/2434457407 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3d8401d400 con 0x7f3d9409d630 2023-10-01T08:01:31.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.324+0000 7f3d99745700 1 -- 172.21.15.26:0/2434457407 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3d940747f0 con 0x7f3d9409d630 2023-10-01T08:01:31.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.324+0000 7f3d8b7fe700 1 -- 172.21.15.26:0/2434457407 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3d8402c090 con 0x7f3d9409d630 2023-10-01T08:01:31.328 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:31.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.326+0000 7f3d99745700 1 -- 172.21.15.26:0/2434457407 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3d9409d630 msgr2=0x7f3d941c7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:31.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.326+0000 7f3d99745700 1 --2- 172.21.15.26:0/2434457407 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3d9409d630 0x7f3d941c7fb0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400efc0 tx=0x7f3d8400c3a0 comp rx=0 tx=0).stop 2023-10-01T08:01:31.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.326+0000 7f3d99745700 1 -- 172.21.15.26:0/2434457407 shutdown_connections 2023-10-01T08:01:31.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.326+0000 7f3d99745700 1 --2- 172.21.15.26:0/2434457407 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d94133930 0x7f3d941c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:31.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.326+0000 7f3d99745700 1 --2- 172.21.15.26:0/2434457407 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3d9409d630 0x7f3d941c7fb0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:31.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.326+0000 7f3d99745700 1 --2- 172.21.15.26:0/2434457407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d940a0a30 0x7f3d941c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:31.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.326+0000 7f3d99745700 1 -- 172.21.15.26:0/2434457407 >> 172.21.15.26:0/2434457407 conn(0x7f3d940a3050 msgr2=0x7f3d9409ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:31.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.326+0000 7f3d99745700 1 -- 172.21.15.26:0/2434457407 shutdown_connections 2023-10-01T08:01:31.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.326+0000 7f3d99745700 1 -- 172.21.15.26:0/2434457407 wait complete. 2023-10-01T08:01:31.342 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:31.725 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:31.787 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:31.831 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:31.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.873+0000 7f9ec91cd700 1 Processor -- start 2023-10-01T08:01:31.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.873+0000 7f9ec91cd700 1 -- start start 2023-10-01T08:01:31.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.874+0000 7f9ec91cd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9ec409d6f0 0x7f9ec409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:31.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.874+0000 7f9ec91cd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ec409e000 0x7f9ec4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:31.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.874+0000 7f9ec91cd700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec409f130 con 0x7f9ec409e410 2023-10-01T08:01:31.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.874+0000 7f9ec91cd700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec409f520 con 0x7f9ec409d6f0 2023-10-01T08:01:31.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.874+0000 7f9ec91cd700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec409e930 con 0x7f9ec409e000 2023-10-01T08:01:31.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.874+0000 7f9ec2d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9ec409d6f0 0x7f9ec409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:31.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.874+0000 7f9ec259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ec409e000 0x7f9ec4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:31.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.874+0000 7f9ec2d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9ec409d6f0 0x7f9ec409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55964/0 (socket says 172.21.15.26:55964) 2023-10-01T08:01:31.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.874+0000 7f9ec2d9d700 1 -- 172.21.15.26:0/2958884105 learned_addr learned my addr 172.21.15.26:0/2958884105 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:31.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.874+0000 7f9ec259c700 1 -- 172.21.15.26:0/2958884105 >> v2:172.21.15.26:3300/0 conn(0x7f9ec409d6f0 msgr2=0x7f9ec409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:31.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.874+0000 7f9ec259c700 1 --2- 172.21.15.26:0/2958884105 >> v2:172.21.15.26:3300/0 conn(0x7f9ec409d6f0 0x7f9ec409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:31.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.874+0000 7f9ec259c700 1 -- 172.21.15.26:0/2958884105 >> v1:172.21.15.26:6789/0 conn(0x7f9ec409e410 legacy=0x7f9ec4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:31.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.875+0000 7f9ec259c700 1 -- 172.21.15.26:0/2958884105 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec409b2d0 con 0x7f9ec409e000 2023-10-01T08:01:31.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.875+0000 7f9ec259c700 1 --2- 172.21.15.26:0/2958884105 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ec409e000 0x7f9ec4130660 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8009840 tx=0x7f9eb8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6488c99e8eb812af server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:31.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.875+0000 7f9ec1d9b700 1 -- 172.21.15.26:0/2958884105 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8011830 con 0x7f9ec409e000 2023-10-01T08:01:31.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.875+0000 7f9ec1d9b700 1 -- 172.21.15.26:0/2958884105 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb8011990 con 0x7f9ec409e000 2023-10-01T08:01:31.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.875+0000 7f9ec1d9b700 1 -- 172.21.15.26:0/2958884105 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8011d20 con 0x7f9ec409e000 2023-10-01T08:01:31.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.876+0000 7f9ec91cd700 1 -- 172.21.15.26:0/2958884105 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ec409e000 msgr2=0x7f9ec4130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:31.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.876+0000 7f9ec91cd700 1 --2- 172.21.15.26:0/2958884105 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ec409e000 0x7f9ec4130660 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8009840 tx=0x7f9eb8009b50 comp rx=0 tx=0).stop 2023-10-01T08:01:31.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.876+0000 7f9ec91cd700 1 -- 172.21.15.26:0/2958884105 shutdown_connections 2023-10-01T08:01:31.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.876+0000 7f9ec91cd700 1 --2- 172.21.15.26:0/2958884105 >> v2:172.21.15.26:3300/0 conn(0x7f9ec409d6f0 0x7f9ec409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:31.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.876+0000 7f9ec91cd700 1 --2- 172.21.15.26:0/2958884105 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ec409e000 0x7f9ec4130660 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:31.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.876+0000 7f9ec91cd700 1 -- 172.21.15.26:0/2958884105 >> 172.21.15.26:0/2958884105 conn(0x7f9ec4066f50 msgr2=0x7f9ec409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:31.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.876+0000 7f9ec91cd700 1 -- 172.21.15.26:0/2958884105 shutdown_connections 2023-10-01T08:01:31.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.876+0000 7f9ec91cd700 1 -- 172.21.15.26:0/2958884105 wait complete. 2023-10-01T08:01:31.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.877+0000 7f9ec91cd700 1 Processor -- start 2023-10-01T08:01:31.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.877+0000 7f9ec91cd700 1 -- start start 2023-10-01T08:01:31.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.878+0000 7f9ec91cd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ec409d6f0 0x7f9ec4139940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:31.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.878+0000 7f9ec91cd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ec409e000 0x7f9ec4139e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:31.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.878+0000 7f9ec91cd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ec409e410 0x7f9ec413a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:31.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.878+0000 7f9ec91cd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec4131130 con 0x7f9ec409e410 2023-10-01T08:01:31.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.878+0000 7f9ec91cd700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec4136740 con 0x7f9ec409d6f0 2023-10-01T08:01:31.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.878+0000 7f9ec91cd700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec41372a0 con 0x7f9ec409e000 2023-10-01T08:01:31.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.878+0000 7f9ec2d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ec409d6f0 0x7f9ec4139940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:31.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.878+0000 7f9ec259c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ec409e000 0x7f9ec4139e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:31.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.878+0000 7f9ec2d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ec409d6f0 0x7f9ec4139940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51720/0 (socket says 172.21.15.26:51720) 2023-10-01T08:01:31.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.878+0000 7f9ec2d9d700 1 -- 172.21.15.26:0/2543971380 learned_addr learned my addr 172.21.15.26:0/2543971380 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:31.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.878+0000 7f9ec359e700 1 --2- 172.21.15.26:0/2543971380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ec409e410 0x7f9ec413a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:31.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.878+0000 7f9ec259c700 1 -- 172.21.15.26:0/2543971380 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ec409d6f0 msgr2=0x7f9ec4139940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:31.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.878+0000 7f9ec259c700 1 --2- 172.21.15.26:0/2543971380 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ec409d6f0 0x7f9ec4139940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:31.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.878+0000 7f9ec259c700 1 -- 172.21.15.26:0/2543971380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ec409e410 msgr2=0x7f9ec413a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:31.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.878+0000 7f9ec259c700 1 --2- 172.21.15.26:0/2543971380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ec409e410 0x7f9ec413a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:31.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.878+0000 7f9ec259c700 1 -- 172.21.15.26:0/2543971380 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb80094a0 con 0x7f9ec409e000 2023-10-01T08:01:31.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.878+0000 7f9ec2d9d700 1 --2- 172.21.15.26:0/2543971380 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ec409d6f0 0x7f9ec4139940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:31.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.879+0000 7f9ec259c700 1 --2- 172.21.15.26:0/2543971380 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ec409e000 0x7f9ec4139e80 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f9ec40a3e80 tx=0x7f9eb8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:31.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.879+0000 7f9eab7fe700 1 -- 172.21.15.26:0/2543971380 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8004550 con 0x7f9ec409e000 2023-10-01T08:01:31.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.879+0000 7f9eab7fe700 1 -- 172.21.15.26:0/2543971380 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb801f070 con 0x7f9ec409e000 2023-10-01T08:01:31.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.879+0000 7f9ec91cd700 1 -- 172.21.15.26:0/2543971380 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec4135b40 con 0x7f9ec409e000 2023-10-01T08:01:31.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.879+0000 7f9eab7fe700 1 -- 172.21.15.26:0/2543971380 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb80038e0 con 0x7f9ec409e000 2023-10-01T08:01:31.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.879+0000 7f9ec91cd700 1 -- 172.21.15.26:0/2543971380 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec4136a00 con 0x7f9ec409e000 2023-10-01T08:01:31.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.880+0000 7f9eab7fe700 1 -- 172.21.15.26:0/2543971380 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9eb8003a40 con 0x7f9ec409e000 2023-10-01T08:01:31.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.880+0000 7f9eab7fe700 1 -- 172.21.15.26:0/2543971380 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9eb8021070 con 0x7f9ec409e000 2023-10-01T08:01:31.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.880+0000 7f9ec91cd700 1 -- 172.21.15.26:0/2543971380 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec41396a0 con 0x7f9ec409e000 2023-10-01T08:01:31.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.889+0000 7f9eab7fe700 1 -- 172.21.15.26:0/2543971380 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9eb802b020 con 0x7f9ec409e000 2023-10-01T08:01:31.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.930+0000 7f05573ab700 1 Processor -- start 2023-10-01T08:01:31.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.931+0000 7f05573ab700 1 -- start start 2023-10-01T08:01:31.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.931+0000 7f05573ab700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f055009d6f0 0x7f055009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:31.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.931+0000 7f05573ab700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f055009e000 0x7f05501339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:31.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.931+0000 7f05573ab700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f055009b120 con 0x7f055009e410 2023-10-01T08:01:31.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.931+0000 7f05573ab700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055006b460 con 0x7f055009e000 2023-10-01T08:01:31.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.931+0000 7f05573ab700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055009a7e0 con 0x7f055009d6f0 2023-10-01T08:01:31.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.931+0000 7f0555147700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f055009d6f0 0x7f055009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:31.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.932+0000 7f0555147700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f055009d6f0 0x7f055009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51734/0 (socket says 172.21.15.26:51734) 2023-10-01T08:01:31.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.932+0000 7f0555948700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f055009e410 0x7f0550133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59550/0 (socket says 172.21.15.26:59550) 2023-10-01T08:01:31.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.932+0000 7f0555147700 1 -- 172.21.15.26:0/2824645106 learned_addr learned my addr 172.21.15.26:0/2824645106 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:31.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.932+0000 7f0554946700 1 --2- 172.21.15.26:0/2824645106 >> v2:172.21.15.26:3300/0 conn(0x7f055009e000 0x7f05501339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:31.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.932+0000 7f0554946700 1 -- 172.21.15.26:0/2824645106 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f055009d6f0 msgr2=0x7f055009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:31.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.932+0000 7f0554946700 1 --2- 172.21.15.26:0/2824645106 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f055009d6f0 0x7f055009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:31.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.932+0000 7f0554946700 1 -- 172.21.15.26:0/2824645106 >> v1:172.21.15.26:6789/0 conn(0x7f055009e410 legacy=0x7f0550133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:31.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.932+0000 7f0554946700 1 -- 172.21.15.26:0/2824645106 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055009a500 con 0x7f055009e000 2023-10-01T08:01:31.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.932+0000 7f0547fff700 1 -- 172.21.15.26:0/2824645106 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1821256576 0 0) 0x7f055009b120 con 0x7f055009e410 2023-10-01T08:01:31.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.932+0000 7f0555147700 1 --2- 172.21.15.26:0/2824645106 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f055009d6f0 0x7f055009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:31.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.932+0000 7f0554946700 1 --2- 172.21.15.26:0/2824645106 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f055009e000 0x7f05501339f0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f0540009840 tx=0x7f0540009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c079b63d6b733a8d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:31.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.932+0000 7f0547fff700 1 -- 172.21.15.26:0/2824645106 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0540011830 con 0x7f055009e000 2023-10-01T08:01:31.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.932+0000 7f0547fff700 1 -- 172.21.15.26:0/2824645106 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0540011990 con 0x7f055009e000 2023-10-01T08:01:31.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.932+0000 7f0547fff700 1 -- 172.21.15.26:0/2824645106 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0540011d20 con 0x7f055009e000 2023-10-01T08:01:31.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.933+0000 7f05573ab700 1 -- 172.21.15.26:0/2824645106 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f055009e000 msgr2=0x7f05501339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:31.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.933+0000 7f05573ab700 1 --2- 172.21.15.26:0/2824645106 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f055009e000 0x7f05501339f0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f0540009840 tx=0x7f0540009b50 comp rx=0 tx=0).stop 2023-10-01T08:01:31.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.933+0000 7f05573ab700 1 -- 172.21.15.26:0/2824645106 shutdown_connections 2023-10-01T08:01:31.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.933+0000 7f05573ab700 1 --2- 172.21.15.26:0/2824645106 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f055009d6f0 0x7f055009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:31.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.933+0000 7f05573ab700 1 --2- 172.21.15.26:0/2824645106 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f055009e000 0x7f05501339f0 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:31.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.933+0000 7f05573ab700 1 -- 172.21.15.26:0/2824645106 >> 172.21.15.26:0/2824645106 conn(0x7f0550066f50 msgr2=0x7f055009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:31.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.933+0000 7f05573ab700 1 -- 172.21.15.26:0/2824645106 shutdown_connections 2023-10-01T08:01:31.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.933+0000 7f05573ab700 1 -- 172.21.15.26:0/2824645106 wait complete. 2023-10-01T08:01:31.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.935+0000 7f05573ab700 1 Processor -- start 2023-10-01T08:01:31.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.935+0000 7f05573ab700 1 -- start start 2023-10-01T08:01:31.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.935+0000 7f05573ab700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f055009d6f0 0x7f05501a5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:31.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.935+0000 7f05573ab700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f055009e000 0x7f05501a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:31.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.935+0000 7f05573ab700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f055009e410 0x7f05501a6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:31.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.935+0000 7f05573ab700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05501a9150 con 0x7f055009e000 2023-10-01T08:01:31.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.935+0000 7f05573ab700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055009c710 con 0x7f055009d6f0 2023-10-01T08:01:31.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.935+0000 7f05573ab700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05500a2e40 con 0x7f055009e410 2023-10-01T08:01:31.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.936+0000 7f0554946700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f055009e000 0x7f05501a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:31.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.936+0000 7f0554946700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f055009e000 0x7f05501a63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55994/0 (socket says 172.21.15.26:55994) 2023-10-01T08:01:31.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.936+0000 7f0554946700 1 -- 172.21.15.26:0/3924052367 learned_addr learned my addr 172.21.15.26:0/3924052367 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:31.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.936+0000 7f0555948700 1 --2- 172.21.15.26:0/3924052367 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f055009e410 0x7f05501a6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:31.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.936+0000 7f0555147700 1 --2- 172.21.15.26:0/3924052367 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f055009d6f0 0x7f05501a5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:31.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.936+0000 7f0554946700 1 -- 172.21.15.26:0/3924052367 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f055009e410 msgr2=0x7f05501a6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:31.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.936+0000 7f0554946700 1 --2- 172.21.15.26:0/3924052367 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f055009e410 0x7f05501a6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:31.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.936+0000 7f0554946700 1 -- 172.21.15.26:0/3924052367 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f055009d6f0 msgr2=0x7f05501a5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:31.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.936+0000 7f0554946700 1 --2- 172.21.15.26:0/3924052367 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f055009d6f0 0x7f05501a5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:31.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.936+0000 7f0554946700 1 -- 172.21.15.26:0/3924052367 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054c009550 con 0x7f055009e000 2023-10-01T08:01:31.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.936+0000 7f0555147700 1 --2- 172.21.15.26:0/3924052367 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f055009d6f0 0x7f05501a5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T08:01:31.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.936+0000 7f0554946700 1 --2- 172.21.15.26:0/3924052367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f055009e000 0x7f05501a63e0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f0540000c00 tx=0x7f0540004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:31.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.936+0000 7f0545ffb700 1 -- 172.21.15.26:0/3924052367 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054001a860 con 0x7f055009e000 2023-10-01T08:01:31.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.936+0000 7f0545ffb700 1 -- 172.21.15.26:0/3924052367 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054001a9c0 con 0x7f055009e000 2023-10-01T08:01:31.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.936+0000 7f05573ab700 1 -- 172.21.15.26:0/3924052367 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05400094a0 con 0x7f055009e000 2023-10-01T08:01:31.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.936+0000 7f0545ffb700 1 -- 172.21.15.26:0/3924052367 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054001ad50 con 0x7f055009e000 2023-10-01T08:01:31.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.937+0000 7f05573ab700 1 -- 172.21.15.26:0/3924052367 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05501a8d00 con 0x7f055009e000 2023-10-01T08:01:31.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.937+0000 7f0545ffb700 1 -- 172.21.15.26:0/3924052367 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0540022070 con 0x7f055009e000 2023-10-01T08:01:31.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.938+0000 7f0545ffb700 1 -- 172.21.15.26:0/3924052367 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f05400406c0 con 0x7f055009e000 2023-10-01T08:01:31.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.938+0000 7f05573ab700 1 -- 172.21.15.26:0/3924052367 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0550074ea0 con 0x7f055009e000 2023-10-01T08:01:31.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.943+0000 7f0545ffb700 1 -- 172.21.15.26:0/3924052367 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0540029080 con 0x7f055009e000 2023-10-01T08:01:31.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.977+0000 7f04752f0700 1 Processor -- start 2023-10-01T08:01:31.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.977+0000 7f04752f0700 1 -- start start 2023-10-01T08:01:31.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.978+0000 7f04752f0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f047009d630 0x7f04700a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:31.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.978+0000 7f04752f0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0470138d80 0x7f047013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:31.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.978+0000 7f04752f0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04700a2a70 con 0x7f04700a0a30 2023-10-01T08:01:31.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.978+0000 7f04752f0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04700a01d0 con 0x7f0470138d80 2023-10-01T08:01:31.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.978+0000 7f04752f0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f047009e2b0 con 0x7f047009d630 2023-10-01T08:01:31.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.978+0000 7f046f7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0470138d80 0x7f047013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:31.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.978+0000 7f046e7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f047009d630 0x7f04700a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:31.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.978+0000 7f046effd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f04700a0a30 0x7f04700a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59564/0 (socket says 172.21.15.26:59564) 2023-10-01T08:01:31.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.978+0000 7f046effd700 1 -- 172.21.15.26:0/1307384041 learned_addr learned my addr 172.21.15.26:0/1307384041 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:01:31.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.978+0000 7f046dffb700 1 -- 172.21.15.26:0/1307384041 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1529137378 0 0) 0x7f04700a2a70 con 0x7f04700a0a30 2023-10-01T08:01:31.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.978+0000 7f046dffb700 1 -- 172.21.15.26:0/1307384041 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04580035b0 con 0x7f04700a0a30 2023-10-01T08:01:31.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.978+0000 7f046e7fc700 1 -- 172.21.15.26:0/1307384041 >> v2:172.21.15.26:3300/0 conn(0x7f0470138d80 msgr2=0x7f047013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:31.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.978+0000 7f046e7fc700 1 --2- 172.21.15.26:0/1307384041 >> v2:172.21.15.26:3300/0 conn(0x7f0470138d80 0x7f047013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:31.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.978+0000 7f046e7fc700 1 -- 172.21.15.26:0/1307384041 >> v1:172.21.15.26:6789/0 conn(0x7f04700a0a30 legacy=0x7f04700a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:31.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.979+0000 7f046e7fc700 1 -- 172.21.15.26:0/1307384041 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f047009dc50 con 0x7f047009d630 2023-10-01T08:01:31.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.979+0000 7f046f7fe700 1 --2- 172.21.15.26:0/1307384041 >> v2:172.21.15.26:3300/0 conn(0x7f0470138d80 0x7f047013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:31.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.979+0000 7f046e7fc700 1 --2- 172.21.15.26:0/1307384041 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f047009d630 0x7f04700a1510 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f0464009840 tx=0x7f0464009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d01308d1e31e7d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:31.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.979+0000 7f046dffb700 1 -- 172.21.15.26:0/1307384041 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0464011830 con 0x7f047009d630 2023-10-01T08:01:31.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.979+0000 7f046dffb700 1 -- 172.21.15.26:0/1307384041 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0464011990 con 0x7f047009d630 2023-10-01T08:01:31.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.979+0000 7f046dffb700 1 -- 172.21.15.26:0/1307384041 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0464011d00 con 0x7f047009d630 2023-10-01T08:01:31.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.980+0000 7f04752f0700 1 -- 172.21.15.26:0/1307384041 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f047009d630 msgr2=0x7f04700a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:31.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.980+0000 7f04752f0700 1 --2- 172.21.15.26:0/1307384041 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f047009d630 0x7f04700a1510 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f0464009840 tx=0x7f0464009b50 comp rx=0 tx=0).stop 2023-10-01T08:01:31.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.980+0000 7f04752f0700 1 -- 172.21.15.26:0/1307384041 shutdown_connections 2023-10-01T08:01:31.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.980+0000 7f04752f0700 1 --2- 172.21.15.26:0/1307384041 >> v2:172.21.15.26:3300/0 conn(0x7f0470138d80 0x7f047013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:31.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.980+0000 7f04752f0700 1 --2- 172.21.15.26:0/1307384041 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f047009d630 0x7f04700a1510 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:31.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.980+0000 7f04752f0700 1 -- 172.21.15.26:0/1307384041 >> 172.21.15.26:0/1307384041 conn(0x7f04700a3050 msgr2=0x7f04700a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:31.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.980+0000 7f04752f0700 1 -- 172.21.15.26:0/1307384041 shutdown_connections 2023-10-01T08:01:31.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.980+0000 7f04752f0700 1 -- 172.21.15.26:0/1307384041 wait complete. 2023-10-01T08:01:31.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.981+0000 7f04752f0700 1 Processor -- start 2023-10-01T08:01:31.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.981+0000 7f04752f0700 1 -- start start 2023-10-01T08:01:31.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.981+0000 7f04752f0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f047009d630 0x7f0470133700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:31.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.981+0000 7f04752f0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04700a0a30 0x7f0470133c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:31.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.981+0000 7f04752f0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0470138d80 0x7f0470134180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:31.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.981+0000 7f04752f0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0470136540 con 0x7f04700a0a30 2023-10-01T08:01:31.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.981+0000 7f04752f0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0470136eb0 con 0x7f0470138d80 2023-10-01T08:01:31.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.981+0000 7f04752f0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f047013ac20 con 0x7f047009d630 2023-10-01T08:01:31.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.982+0000 7f046e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04700a0a30 0x7f0470133c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:31.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.982+0000 7f046e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04700a0a30 0x7f0470133c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56016/0 (socket says 172.21.15.26:56016) 2023-10-01T08:01:31.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.982+0000 7f046e7fc700 1 -- 172.21.15.26:0/2193093814 learned_addr learned my addr 172.21.15.26:0/2193093814 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:31.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.982+0000 7f046f7fe700 1 --2- 172.21.15.26:0/2193093814 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0470138d80 0x7f0470134180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:31.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.982+0000 7f046effd700 1 --2- 172.21.15.26:0/2193093814 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f047009d630 0x7f0470133700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:31.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.982+0000 7f046e7fc700 1 -- 172.21.15.26:0/2193093814 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f047009d630 msgr2=0x7f0470133700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:31.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.982+0000 7f046e7fc700 1 --2- 172.21.15.26:0/2193093814 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f047009d630 0x7f0470133700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:31.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.982+0000 7f046e7fc700 1 -- 172.21.15.26:0/2193093814 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0470138d80 msgr2=0x7f0470134180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:31.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.982+0000 7f046e7fc700 1 --2- 172.21.15.26:0/2193093814 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0470138d80 0x7f0470134180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:31.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.982+0000 7f046e7fc700 1 -- 172.21.15.26:0/2193093814 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04680094a0 con 0x7f04700a0a30 2023-10-01T08:01:31.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.982+0000 7f046e7fc700 1 --2- 172.21.15.26:0/2193093814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04700a0a30 0x7f0470133c40 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f04640090b0 tx=0x7f0464004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:31.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.982+0000 7f04577fe700 1 -- 172.21.15.26:0/2193093814 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0464004340 con 0x7f04700a0a30 2023-10-01T08:01:31.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.982+0000 7f04577fe700 1 -- 172.21.15.26:0/2193093814 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046401f070 con 0x7f04700a0a30 2023-10-01T08:01:31.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.982+0000 7f04752f0700 1 -- 172.21.15.26:0/2193093814 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04640094a0 con 0x7f04700a0a30 2023-10-01T08:01:31.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.982+0000 7f04577fe700 1 -- 172.21.15.26:0/2193093814 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04640036a0 con 0x7f04700a0a30 2023-10-01T08:01:31.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.983+0000 7f04752f0700 1 -- 172.21.15.26:0/2193093814 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0470134ad0 con 0x7f04700a0a30 2023-10-01T08:01:31.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.983+0000 7f04577fe700 1 -- 172.21.15.26:0/2193093814 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0464021030 con 0x7f04700a0a30 2023-10-01T08:01:31.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.983+0000 7f04577fe700 1 -- 172.21.15.26:0/2193093814 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f04640407e0 con 0x7f04700a0a30 2023-10-01T08:01:31.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.984+0000 7f04752f0700 1 -- 172.21.15.26:0/2193093814 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04700747f0 con 0x7f04700a0a30 2023-10-01T08:01:31.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:31.989+0000 7f04577fe700 1 -- 172.21.15.26:0/2193093814 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f04640239c0 con 0x7f04700a0a30 2023-10-01T08:01:32.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.107+0000 7f9ec91cd700 1 -- 172.21.15.26:0/2543971380 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9ec4074ea0 con 0x7f9ec409e000 2023-10-01T08:01:32.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.107+0000 7f9eab7fe700 1 -- 172.21.15.26:0/2543971380 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9eb8015070 con 0x7f9ec409e000 2023-10-01T08:01:32.108 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:32.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.109+0000 7f9ec91cd700 1 -- 172.21.15.26:0/2543971380 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ec409e000 msgr2=0x7f9ec4139e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:32.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.109+0000 7f9ec91cd700 1 --2- 172.21.15.26:0/2543971380 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ec409e000 0x7f9ec4139e80 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f9ec40a3e80 tx=0x7f9eb8004750 comp rx=0 tx=0).stop 2023-10-01T08:01:32.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.109+0000 7f9ec91cd700 1 -- 172.21.15.26:0/2543971380 shutdown_connections 2023-10-01T08:01:32.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.109+0000 7f9ec91cd700 1 --2- 172.21.15.26:0/2543971380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ec409e410 0x7f9ec413a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:32.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.109+0000 7f9ec91cd700 1 --2- 172.21.15.26:0/2543971380 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ec409d6f0 0x7f9ec4139940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:32.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.109+0000 7f9ec91cd700 1 --2- 172.21.15.26:0/2543971380 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9ec409e000 0x7f9ec4139e80 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:32.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.109+0000 7f9ec91cd700 1 -- 172.21.15.26:0/2543971380 >> 172.21.15.26:0/2543971380 conn(0x7f9ec4066f50 msgr2=0x7f9ec40a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:32.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.109+0000 7f9ec91cd700 1 -- 172.21.15.26:0/2543971380 shutdown_connections 2023-10-01T08:01:32.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.110+0000 7f9ec91cd700 1 -- 172.21.15.26:0/2543971380 wait complete. 2023-10-01T08:01:32.125 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:32.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.155+0000 7f05573ab700 1 -- 172.21.15.26:0/3924052367 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f05501a9540 con 0x7f055009e000 2023-10-01T08:01:32.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.156+0000 7f0545ffb700 1 -- 172.21.15.26:0/3924052367 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0540015020 con 0x7f055009e000 2023-10-01T08:01:32.157 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:32.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.158+0000 7f05573ab700 1 -- 172.21.15.26:0/3924052367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f055009e000 msgr2=0x7f05501a63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:32.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.158+0000 7f05573ab700 1 --2- 172.21.15.26:0/3924052367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f055009e000 0x7f05501a63e0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f0540000c00 tx=0x7f0540004750 comp rx=0 tx=0).stop 2023-10-01T08:01:32.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.158+0000 7f05573ab700 1 -- 172.21.15.26:0/3924052367 shutdown_connections 2023-10-01T08:01:32.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.158+0000 7f05573ab700 1 --2- 172.21.15.26:0/3924052367 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f055009e410 0x7f05501a6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:32.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.158+0000 7f05573ab700 1 --2- 172.21.15.26:0/3924052367 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f055009d6f0 0x7f05501a5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:32.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.158+0000 7f05573ab700 1 --2- 172.21.15.26:0/3924052367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f055009e000 0x7f05501a63e0 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:32.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.158+0000 7f05573ab700 1 -- 172.21.15.26:0/3924052367 >> 172.21.15.26:0/3924052367 conn(0x7f0550066f50 msgr2=0x7f05501bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:32.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.158+0000 7f05573ab700 1 -- 172.21.15.26:0/3924052367 shutdown_connections 2023-10-01T08:01:32.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.158+0000 7f05573ab700 1 -- 172.21.15.26:0/3924052367 wait complete. 2023-10-01T08:01:32.172 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:32.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.202+0000 7f04752f0700 1 -- 172.21.15.26:0/2193093814 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0470072980 con 0x7f04700a0a30 2023-10-01T08:01:32.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.202+0000 7f04577fe700 1 -- 172.21.15.26:0/2193093814 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0464015020 con 0x7f04700a0a30 2023-10-01T08:01:32.203 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:32.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.205+0000 7f04752f0700 1 -- 172.21.15.26:0/2193093814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04700a0a30 msgr2=0x7f0470133c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:32.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.205+0000 7f04752f0700 1 --2- 172.21.15.26:0/2193093814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04700a0a30 0x7f0470133c40 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f04640090b0 tx=0x7f0464004750 comp rx=0 tx=0).stop 2023-10-01T08:01:32.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.205+0000 7f04752f0700 1 -- 172.21.15.26:0/2193093814 shutdown_connections 2023-10-01T08:01:32.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.205+0000 7f04752f0700 1 --2- 172.21.15.26:0/2193093814 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0470138d80 0x7f0470134180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:32.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.205+0000 7f04752f0700 1 --2- 172.21.15.26:0/2193093814 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f047009d630 0x7f0470133700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:32.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.205+0000 7f04752f0700 1 --2- 172.21.15.26:0/2193093814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04700a0a30 0x7f0470133c40 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:32.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.205+0000 7f04752f0700 1 -- 172.21.15.26:0/2193093814 >> 172.21.15.26:0/2193093814 conn(0x7f04700a3050 msgr2=0x7f047009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:32.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.205+0000 7f04752f0700 1 -- 172.21.15.26:0/2193093814 shutdown_connections 2023-10-01T08:01:32.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.205+0000 7f04752f0700 1 -- 172.21.15.26:0/2193093814 wait complete. 2023-10-01T08:01:32.219 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:32.344 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:32.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.486+0000 7f95946a8700 1 Processor -- start 2023-10-01T08:01:32.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.486+0000 7f95946a8700 1 -- start start 2023-10-01T08:01:32.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.487+0000 7f95946a8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f958c06a770 0x7f958c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:32.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.487+0000 7f95946a8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f958c06b080 0x7f958c131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:32.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.487+0000 7f95946a8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f958c09ece0 con 0x7f958c131b40 2023-10-01T08:01:32.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.487+0000 7f95946a8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f958c09e760 con 0x7f958c06b080 2023-10-01T08:01:32.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.487+0000 7f95946a8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f958c09e040 con 0x7f958c06a770 2023-10-01T08:01:32.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.487+0000 7f9592444700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f958c06a770 0x7f958c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:32.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.487+0000 7f9592444700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f958c06a770 0x7f958c06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:54540/0 (socket says 172.21.15.26:54540) 2023-10-01T08:01:32.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.487+0000 7f9591c43700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f958c06b080 0x7f958c131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:32.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.487+0000 7f9592444700 1 -- 172.21.15.26:0/4068613559 learned_addr learned my addr 172.21.15.26:0/4068613559 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:32.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.487+0000 7f9592444700 1 -- 172.21.15.26:0/4068613559 >> v2:172.21.15.26:3300/0 conn(0x7f958c06b080 msgr2=0x7f958c131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:32.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.487+0000 7f9592444700 1 --2- 172.21.15.26:0/4068613559 >> v2:172.21.15.26:3300/0 conn(0x7f958c06b080 0x7f958c131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:32.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.487+0000 7f9592444700 1 -- 172.21.15.26:0/4068613559 >> v1:172.21.15.26:6789/0 conn(0x7f958c131b40 legacy=0x7f958c138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:32.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.487+0000 7f9592444700 1 -- 172.21.15.26:0/4068613559 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f958c09f630 con 0x7f958c06a770 2023-10-01T08:01:32.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.487+0000 7f9591c43700 1 --2- 172.21.15.26:0/4068613559 >> v2:172.21.15.26:3300/0 conn(0x7f958c06b080 0x7f958c131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:32.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.487+0000 7f9592444700 1 --2- 172.21.15.26:0/4068613559 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f958c06a770 0x7f958c06ab40 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f95880098f0 tx=0x7f9588009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3baf8be81591e4c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:32.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.488+0000 7f9591442700 1 -- 172.21.15.26:0/4068613559 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9588011830 con 0x7f958c06a770 2023-10-01T08:01:32.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.488+0000 7f9591442700 1 -- 172.21.15.26:0/4068613559 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9588011990 con 0x7f958c06a770 2023-10-01T08:01:32.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.488+0000 7f9591442700 1 -- 172.21.15.26:0/4068613559 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9588011d20 con 0x7f958c06a770 2023-10-01T08:01:32.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.488+0000 7f95946a8700 1 -- 172.21.15.26:0/4068613559 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f958c06a770 msgr2=0x7f958c06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:32.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.488+0000 7f95946a8700 1 --2- 172.21.15.26:0/4068613559 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f958c06a770 0x7f958c06ab40 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f95880098f0 tx=0x7f9588009c00 comp rx=0 tx=0).stop 2023-10-01T08:01:32.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.488+0000 7f95946a8700 1 -- 172.21.15.26:0/4068613559 shutdown_connections 2023-10-01T08:01:32.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.488+0000 7f95946a8700 1 --2- 172.21.15.26:0/4068613559 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f958c06a770 0x7f958c06ab40 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:32.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.488+0000 7f95946a8700 1 --2- 172.21.15.26:0/4068613559 >> v2:172.21.15.26:3300/0 conn(0x7f958c06b080 0x7f958c131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:32.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.488+0000 7f95946a8700 1 -- 172.21.15.26:0/4068613559 >> 172.21.15.26:0/4068613559 conn(0x7f958c066f50 msgr2=0x7f958c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:32.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.488+0000 7f95946a8700 1 -- 172.21.15.26:0/4068613559 shutdown_connections 2023-10-01T08:01:32.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.488+0000 7f95946a8700 1 -- 172.21.15.26:0/4068613559 wait complete. 2023-10-01T08:01:32.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.489+0000 7f95946a8700 1 Processor -- start 2023-10-01T08:01:32.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.489+0000 7f95946a8700 1 -- start start 2023-10-01T08:01:32.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.490+0000 7f95946a8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f958c06a770 0x7f958c11d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:32.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.490+0000 7f95946a8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f958c06b080 0x7f958c11d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:32.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.490+0000 7f95946a8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f958c131b40 0x7f958c1c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:32.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.490+0000 7f95946a8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958c11fc40 con 0x7f958c131b40 2023-10-01T08:01:32.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.490+0000 7f95946a8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f958c11dbf0 con 0x7f958c06b080 2023-10-01T08:01:32.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.490+0000 7f95946a8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f958c11e2d0 con 0x7f958c06a770 2023-10-01T08:01:32.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.490+0000 7f9592444700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f958c06a770 0x7f958c11d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:32.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.490+0000 7f9591c43700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f958c06b080 0x7f958c11d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:32.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.490+0000 7f9592c45700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f958c131b40 0x7f958c1c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:32.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.490+0000 7f9592444700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f958c06a770 0x7f958c11d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:54544/0 (socket says 172.21.15.26:54544) 2023-10-01T08:01:32.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.490+0000 7f9592444700 1 -- 172.21.15.26:0/97905231 learned_addr learned my addr 172.21.15.26:0/97905231 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:32.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.490+0000 7f9591c43700 1 -- 172.21.15.26:0/97905231 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f958c06a770 msgr2=0x7f958c11d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:32.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.490+0000 7f9591c43700 1 --2- 172.21.15.26:0/97905231 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f958c06a770 0x7f958c11d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:32.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.490+0000 7f9591c43700 1 -- 172.21.15.26:0/97905231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f958c131b40 msgr2=0x7f958c1c61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:32.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.490+0000 7f9591c43700 1 --2- 172.21.15.26:0/97905231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f958c131b40 0x7f958c1c61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:32.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.490+0000 7f9591c43700 1 -- 172.21.15.26:0/97905231 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95800094a0 con 0x7f958c06b080 2023-10-01T08:01:32.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.490+0000 7f9592c45700 1 --2- 172.21.15.26:0/97905231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f958c131b40 0x7f958c1c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:32.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.490+0000 7f9591c43700 1 --2- 172.21.15.26:0/97905231 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f958c06b080 0x7f958c11d6b0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f958000e980 tx=0x7f958000ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:32.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.491+0000 7f957effd700 1 -- 172.21.15.26:0/97905231 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958000c690 con 0x7f958c06b080 2023-10-01T08:01:32.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.491+0000 7f957effd700 1 -- 172.21.15.26:0/97905231 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958000c7f0 con 0x7f958c06b080 2023-10-01T08:01:32.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.491+0000 7f95946a8700 1 -- 172.21.15.26:0/97905231 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9588009550 con 0x7f958c06b080 2023-10-01T08:01:32.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.491+0000 7f957effd700 1 -- 172.21.15.26:0/97905231 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958000cb80 con 0x7f958c06b080 2023-10-01T08:01:32.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.491+0000 7f95946a8700 1 -- 172.21.15.26:0/97905231 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f958c09a0c0 con 0x7f958c06b080 2023-10-01T08:01:32.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.492+0000 7f95946a8700 1 -- 172.21.15.26:0/97905231 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f958c071e60 con 0x7f958c06b080 2023-10-01T08:01:32.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.492+0000 7f957effd700 1 -- 172.21.15.26:0/97905231 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f958000cce0 con 0x7f958c06b080 2023-10-01T08:01:32.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.492+0000 7f957effd700 1 -- 172.21.15.26:0/97905231 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f958003ff50 con 0x7f958c06b080 2023-10-01T08:01:32.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.497+0000 7f957effd700 1 -- 172.21.15.26:0/97905231 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9580011350 con 0x7f958c06b080 2023-10-01T08:01:32.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.698+0000 7f95946a8700 1 -- 172.21.15.26:0/97905231 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f958c074ea0 con 0x7f958c06b080 2023-10-01T08:01:32.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.699+0000 7f957effd700 1 -- 172.21.15.26:0/97905231 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9580017030 con 0x7f958c06b080 2023-10-01T08:01:32.700 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:32.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.701+0000 7f95946a8700 1 -- 172.21.15.26:0/97905231 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f958c06b080 msgr2=0x7f958c11d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:32.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.701+0000 7f95946a8700 1 --2- 172.21.15.26:0/97905231 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f958c06b080 0x7f958c11d6b0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f958000e980 tx=0x7f958000ec90 comp rx=0 tx=0).stop 2023-10-01T08:01:32.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.701+0000 7f95946a8700 1 -- 172.21.15.26:0/97905231 shutdown_connections 2023-10-01T08:01:32.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.701+0000 7f95946a8700 1 --2- 172.21.15.26:0/97905231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f958c131b40 0x7f958c1c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:32.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.701+0000 7f95946a8700 1 --2- 172.21.15.26:0/97905231 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f958c06a770 0x7f958c11d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:32.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.701+0000 7f95946a8700 1 --2- 172.21.15.26:0/97905231 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f958c06b080 0x7f958c11d6b0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:32.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.701+0000 7f95946a8700 1 -- 172.21.15.26:0/97905231 >> 172.21.15.26:0/97905231 conn(0x7f958c066f50 msgr2=0x7f958c070160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:32.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.701+0000 7f95946a8700 1 -- 172.21.15.26:0/97905231 shutdown_connections 2023-10-01T08:01:32.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:32.701+0000 7f95946a8700 1 -- 172.21.15.26:0/97905231 wait complete. 2023-10-01T08:01:32.715 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:33.126 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:33.173 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:33.220 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:33.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.275+0000 7f0236437700 1 Processor -- start 2023-10-01T08:01:33.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.276+0000 7f0236437700 1 -- start start 2023-10-01T08:01:33.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.276+0000 7f0236437700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f023009d6f0 0x7f023009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:33.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.276+0000 7f0236437700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f023009e000 0x7f02301339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:33.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.276+0000 7f0236437700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f023009e410 0x7f0230133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:33.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.276+0000 7f0236437700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f023006b460 con 0x7f023009e410 2023-10-01T08:01:33.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.276+0000 7f0236437700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f023009b120 con 0x7f023009d6f0 2023-10-01T08:01:33.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.276+0000 7f0236437700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f023009a7e0 con 0x7f023009e000 2023-10-01T08:01:33.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.276+0000 7f022ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f023009d6f0 0x7f023009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:33.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.276+0000 7f022ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f023009d6f0 0x7f023009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51770/0 (socket says 172.21.15.26:51770) 2023-10-01T08:01:33.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.276+0000 7f022ffff700 1 -- 172.21.15.26:0/3210647851 learned_addr learned my addr 172.21.15.26:0/3210647851 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:33.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.276+0000 7f02349d4700 1 --2- 172.21.15.26:0/3210647851 >> v2:172.21.15.26:3300/0 conn(0x7f023009e410 0x7f0230133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:33.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.277+0000 7f022f7fe700 1 --2- 172.21.15.26:0/3210647851 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f023009e000 0x7f02301339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:33.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.277+0000 7f02349d4700 1 -- 172.21.15.26:0/3210647851 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f023009e000 msgr2=0x7f02301339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:33.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.277+0000 7f02349d4700 1 --2- 172.21.15.26:0/3210647851 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f023009e000 0x7f02301339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:33.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.277+0000 7f02349d4700 1 -- 172.21.15.26:0/3210647851 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f023009d6f0 msgr2=0x7f023009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:33.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.277+0000 7f02349d4700 1 --2- 172.21.15.26:0/3210647851 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f023009d6f0 0x7f023009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:33.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.277+0000 7f02349d4700 1 -- 172.21.15.26:0/3210647851 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023009a500 con 0x7f023009e410 2023-10-01T08:01:33.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.277+0000 7f022f7fe700 1 --2- 172.21.15.26:0/3210647851 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f023009e000 0x7f02301339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T08:01:33.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.277+0000 7f02349d4700 1 --2- 172.21.15.26:0/3210647851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f023009e410 0x7f0230133f30 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f0228009d90 tx=0x7f022800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d4cf44b59490fe server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:33.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.277+0000 7f022effd700 1 -- 172.21.15.26:0/3210647851 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022800e070 con 0x7f023009e410 2023-10-01T08:01:33.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.277+0000 7f022effd700 1 -- 172.21.15.26:0/3210647851 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022800bb20 con 0x7f023009e410 2023-10-01T08:01:33.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.277+0000 7f022effd700 1 -- 172.21.15.26:0/3210647851 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0228012430 con 0x7f023009e410 2023-10-01T08:01:33.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.278+0000 7f0236437700 1 -- 172.21.15.26:0/3210647851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f023009e410 msgr2=0x7f0230133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:33.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.278+0000 7f0236437700 1 --2- 172.21.15.26:0/3210647851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f023009e410 0x7f0230133f30 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f0228009d90 tx=0x7f022800b330 comp rx=0 tx=0).stop 2023-10-01T08:01:33.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.278+0000 7f0236437700 1 -- 172.21.15.26:0/3210647851 shutdown_connections 2023-10-01T08:01:33.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.278+0000 7f0236437700 1 --2- 172.21.15.26:0/3210647851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f023009e410 0x7f0230133f30 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:33.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.278+0000 7f0236437700 1 --2- 172.21.15.26:0/3210647851 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f023009d6f0 0x7f023009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:33.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.278+0000 7f0236437700 1 --2- 172.21.15.26:0/3210647851 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f023009e000 0x7f02301339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:33.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.278+0000 7f0236437700 1 -- 172.21.15.26:0/3210647851 >> 172.21.15.26:0/3210647851 conn(0x7f0230066f50 msgr2=0x7f023009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:33.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.278+0000 7f0236437700 1 -- 172.21.15.26:0/3210647851 shutdown_connections 2023-10-01T08:01:33.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.278+0000 7f0236437700 1 -- 172.21.15.26:0/3210647851 wait complete. 2023-10-01T08:01:33.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.279+0000 7f0236437700 1 Processor -- start 2023-10-01T08:01:33.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.280+0000 7f0236437700 1 -- start start 2023-10-01T08:01:33.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.280+0000 7f0236437700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f023009d6f0 0x7f02301a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:33.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.280+0000 7f0236437700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f023009e000 0x7f02301a5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:33.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.280+0000 7f0236437700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f023009e410 0x7f02301c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:33.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.280+0000 7f0236437700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02301a6540 con 0x7f023009e410 2023-10-01T08:01:33.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.280+0000 7f0236437700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02301a6350 con 0x7f023009e000 2023-10-01T08:01:33.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.280+0000 7f0236437700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02301b90d0 con 0x7f023009d6f0 2023-10-01T08:01:33.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.280+0000 7f022f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f023009e000 0x7f02301a5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:33.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.280+0000 7f022f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f023009e000 0x7f02301a5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51774/0 (socket says 172.21.15.26:51774) 2023-10-01T08:01:33.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.280+0000 7f022f7fe700 1 -- 172.21.15.26:0/1380467059 learned_addr learned my addr 172.21.15.26:0/1380467059 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:33.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.280+0000 7f022ffff700 1 --2- 172.21.15.26:0/1380467059 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f023009d6f0 0x7f02301a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:33.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.280+0000 7f02349d4700 1 --2- 172.21.15.26:0/1380467059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f023009e410 0x7f02301c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:33.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.281+0000 7f022ffff700 1 -- 172.21.15.26:0/1380467059 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f023009e000 msgr2=0x7f02301a5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:33.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.281+0000 7f022ffff700 1 --2- 172.21.15.26:0/1380467059 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f023009e000 0x7f02301a5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:33.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.281+0000 7f022ffff700 1 -- 172.21.15.26:0/1380467059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f023009e410 msgr2=0x7f02301c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:33.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.281+0000 7f022ffff700 1 --2- 172.21.15.26:0/1380467059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f023009e410 0x7f02301c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:33.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.281+0000 7f022ffff700 1 -- 172.21.15.26:0/1380467059 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0228009a70 con 0x7f023009d6f0 2023-10-01T08:01:33.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.281+0000 7f02349d4700 1 --2- 172.21.15.26:0/1380467059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f023009e410 0x7f02301c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:33.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.281+0000 7f022f7fe700 1 --2- 172.21.15.26:0/1380467059 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f023009e000 0x7f02301a5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:33.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.281+0000 7f022ffff700 1 --2- 172.21.15.26:0/1380467059 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f023009d6f0 0x7f02301a5210 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f022000e8e0 tx=0x7f022000ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:33.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.281+0000 7f022cff9700 1 -- 172.21.15.26:0/1380467059 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220013680 con 0x7f023009d6f0 2023-10-01T08:01:33.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.281+0000 7f022cff9700 1 -- 172.21.15.26:0/1380467059 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02200137e0 con 0x7f023009d6f0 2023-10-01T08:01:33.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.281+0000 7f022cff9700 1 -- 172.21.15.26:0/1380467059 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220013b70 con 0x7f023009d6f0 2023-10-01T08:01:33.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.281+0000 7f0236437700 1 -- 172.21.15.26:0/1380467059 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02300a2ee0 con 0x7f023009d6f0 2023-10-01T08:01:33.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.281+0000 7f0236437700 1 -- 172.21.15.26:0/1380467059 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f023009c760 con 0x7f023009d6f0 2023-10-01T08:01:33.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.283+0000 7f0236437700 1 -- 172.21.15.26:0/1380467059 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0230074ea0 con 0x7f023009d6f0 2023-10-01T08:01:33.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.283+0000 7f022cff9700 1 -- 172.21.15.26:0/1380467059 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0220013cd0 con 0x7f023009d6f0 2023-10-01T08:01:33.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.283+0000 7f022cff9700 1 -- 172.21.15.26:0/1380467059 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f022003fe70 con 0x7f023009d6f0 2023-10-01T08:01:33.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.288+0000 7f022cff9700 1 -- 172.21.15.26:0/1380467059 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0220024350 con 0x7f023009d6f0 2023-10-01T08:01:33.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.321+0000 7f772a455700 1 Processor -- start 2023-10-01T08:01:33.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.321+0000 7f772a455700 1 -- start start 2023-10-01T08:01:33.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.322+0000 7f772a455700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f772409e930 0x7f772409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:33.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.322+0000 7f772a455700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f772409f240 0x7f77241317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:33.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.322+0000 7f772a455700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7724070940 con 0x7f772409f650 2023-10-01T08:01:33.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.322+0000 7f772a455700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f772406fd60 con 0x7f772409e930 2023-10-01T08:01:33.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.322+0000 7f772a455700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f772406fa80 con 0x7f772409f240 2023-10-01T08:01:33.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.322+0000 7f7723fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f772409e930 0x7f772409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:33.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.322+0000 7f77237fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f772409f240 0x7f77241317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:33.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.322+0000 7f7723fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f772409e930 0x7f772409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56058/0 (socket says 172.21.15.26:56058) 2023-10-01T08:01:33.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.322+0000 7f7723fff700 1 -- 172.21.15.26:0/3688837836 learned_addr learned my addr 172.21.15.26:0/3688837836 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:33.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.322+0000 7f77237fe700 1 --2- 172.21.15.26:0/3688837836 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f772409f240 0x7f77241317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51784/0 (socket says 172.21.15.26:51784) 2023-10-01T08:01:33.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.322+0000 7f7723fff700 1 -- 172.21.15.26:0/3688837836 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f772409f240 msgr2=0x7f77241317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:33.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.322+0000 7f7723fff700 1 --2- 172.21.15.26:0/3688837836 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f772409f240 0x7f77241317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:33.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.322+0000 7f7723fff700 1 -- 172.21.15.26:0/3688837836 >> v1:172.21.15.26:6789/0 conn(0x7f772409f650 legacy=0x7f7724131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:33.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.322+0000 7f7723fff700 1 -- 172.21.15.26:0/3688837836 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f772409fb60 con 0x7f772409e930 2023-10-01T08:01:33.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.322+0000 7f77237fe700 1 --2- 172.21.15.26:0/3688837836 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f772409f240 0x7f77241317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:33.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.322+0000 7f7723fff700 1 --2- 172.21.15.26:0/3688837836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f772409e930 0x7f772409ed00 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f77140098f0 tx=0x7f7714009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e70ff39bf44e60e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:33.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.323+0000 7f7722ffd700 1 -- 172.21.15.26:0/3688837836 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7714011830 con 0x7f772409e930 2023-10-01T08:01:33.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.323+0000 7f7722ffd700 1 -- 172.21.15.26:0/3688837836 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7714011990 con 0x7f772409e930 2023-10-01T08:01:33.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.323+0000 7f7722ffd700 1 -- 172.21.15.26:0/3688837836 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7714011d20 con 0x7f772409e930 2023-10-01T08:01:33.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.323+0000 7f772a455700 1 -- 172.21.15.26:0/3688837836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f772409e930 msgr2=0x7f772409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:33.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.323+0000 7f772a455700 1 --2- 172.21.15.26:0/3688837836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f772409e930 0x7f772409ed00 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f77140098f0 tx=0x7f7714009c00 comp rx=0 tx=0).stop 2023-10-01T08:01:33.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.323+0000 7f772a455700 1 -- 172.21.15.26:0/3688837836 shutdown_connections 2023-10-01T08:01:33.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.323+0000 7f772a455700 1 --2- 172.21.15.26:0/3688837836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f772409e930 0x7f772409ed00 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:33.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.323+0000 7f772a455700 1 --2- 172.21.15.26:0/3688837836 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f772409f240 0x7f77241317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:33.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.323+0000 7f772a455700 1 -- 172.21.15.26:0/3688837836 >> 172.21.15.26:0/3688837836 conn(0x7f77240a4210 msgr2=0x7f77240a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:33.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.324+0000 7f772a455700 1 -- 172.21.15.26:0/3688837836 shutdown_connections 2023-10-01T08:01:33.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.324+0000 7f772a455700 1 -- 172.21.15.26:0/3688837836 wait complete. 2023-10-01T08:01:33.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.325+0000 7f772a455700 1 Processor -- start 2023-10-01T08:01:33.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.325+0000 7f772a455700 1 -- start start 2023-10-01T08:01:33.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.325+0000 7f772a455700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f772409e930 0x7f772406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:33.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.325+0000 7f772a455700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f772409f240 0x7f772406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:33.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.325+0000 7f772a455700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f772409f650 0x7f772406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:33.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.325+0000 7f772a455700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77241b7350 con 0x7f772409f650 2023-10-01T08:01:33.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.325+0000 7f772a455700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77241a9500 con 0x7f772409f240 2023-10-01T08:01:33.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.325+0000 7f772a455700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77241a8a20 con 0x7f772409e930 2023-10-01T08:01:33.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.326+0000 7f77237fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f772409f240 0x7f772406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:33.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.326+0000 7f77237fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f772409f240 0x7f772406bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51792/0 (socket says 172.21.15.26:51792) 2023-10-01T08:01:33.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.326+0000 7f77237fe700 1 -- 172.21.15.26:0/658787618 learned_addr learned my addr 172.21.15.26:0/658787618 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:33.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.326+0000 7f7723fff700 1 --2- 172.21.15.26:0/658787618 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f772409e930 0x7f772406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:33.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.326+0000 7f77289f2700 1 --2- 172.21.15.26:0/658787618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f772409f650 0x7f772406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:33.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.326+0000 7f7723fff700 1 -- 172.21.15.26:0/658787618 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f772409f240 msgr2=0x7f772406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:33.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.326+0000 7f7723fff700 1 --2- 172.21.15.26:0/658787618 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f772409f240 0x7f772406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:33.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.326+0000 7f7723fff700 1 -- 172.21.15.26:0/658787618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f772409f650 msgr2=0x7f772406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:33.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.326+0000 7f7723fff700 1 --2- 172.21.15.26:0/658787618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f772409f650 0x7f772406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:33.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.326+0000 7f7723fff700 1 -- 172.21.15.26:0/658787618 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77180094a0 con 0x7f772409e930 2023-10-01T08:01:33.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.326+0000 7f7723fff700 1 --2- 172.21.15.26:0/658787618 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f772409e930 0x7f772406b8b0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f7714016000 tx=0x7f7714004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:33.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.326+0000 7f7720ff9700 1 -- 172.21.15.26:0/658787618 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77140036a0 con 0x7f772409e930 2023-10-01T08:01:33.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.326+0000 7f7720ff9700 1 -- 172.21.15.26:0/658787618 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7714003800 con 0x7f772409e930 2023-10-01T08:01:33.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.327+0000 7f772a455700 1 -- 172.21.15.26:0/658787618 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7714009550 con 0x7f772409e930 2023-10-01T08:01:33.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.327+0000 7f7720ff9700 1 -- 172.21.15.26:0/658787618 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7714003b90 con 0x7f772409e930 2023-10-01T08:01:33.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.327+0000 7f772a455700 1 -- 172.21.15.26:0/658787618 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77240a0190 con 0x7f772409e930 2023-10-01T08:01:33.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.327+0000 7f7720ff9700 1 -- 172.21.15.26:0/658787618 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7714021070 con 0x7f772409e930 2023-10-01T08:01:33.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.328+0000 7f7720ff9700 1 -- 172.21.15.26:0/658787618 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7714040bd0 con 0x7f772409e930 2023-10-01T08:01:33.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.328+0000 7f772a455700 1 -- 172.21.15.26:0/658787618 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77241a8de0 con 0x7f772409e930 2023-10-01T08:01:33.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.333+0000 7f7720ff9700 1 -- 172.21.15.26:0/658787618 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7714040e60 con 0x7f772409e930 2023-10-01T08:01:33.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.363+0000 7f7d1f8c7700 1 Processor -- start 2023-10-01T08:01:33.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.364+0000 7f7d1f8c7700 1 -- start start 2023-10-01T08:01:33.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.364+0000 7f7d1f8c7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7d180a0a30 0x7f7d180a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:33.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.364+0000 7f7d1f8c7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7d18134170 0x7f7d1813bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:33.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.364+0000 7f7d1f8c7700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d1809edd0 con 0x7f7d180a1340 2023-10-01T08:01:33.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.364+0000 7f7d1f8c7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1809e1f0 con 0x7f7d18134170 2023-10-01T08:01:33.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.364+0000 7f7d1f8c7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1809dc50 con 0x7f7d180a0a30 2023-10-01T08:01:33.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.364+0000 7f7d1de64700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7d18134170 0x7f7d1813bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:33.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.364+0000 7f7d1de64700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7d18134170 0x7f7d1813bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51800/0 (socket says 172.21.15.26:51800) 2023-10-01T08:01:33.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.364+0000 7f7d1de64700 1 -- 172.21.15.26:0/3620253794 learned_addr learned my addr 172.21.15.26:0/3620253794 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:33.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.364+0000 7f7d1ce62700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7d180a1340 0x7f7d18133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59588/0 (socket says 172.21.15.26:59588) 2023-10-01T08:01:33.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.364+0000 7f7d1d663700 1 --2- 172.21.15.26:0/3620253794 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7d180a0a30 0x7f7d180a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:33.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.365+0000 7f7d1de64700 1 -- 172.21.15.26:0/3620253794 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7d180a0a30 msgr2=0x7f7d180a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:33.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.365+0000 7f7d1de64700 1 --2- 172.21.15.26:0/3620253794 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7d180a0a30 0x7f7d180a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:33.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.365+0000 7f7d1de64700 1 -- 172.21.15.26:0/3620253794 >> v1:172.21.15.26:6789/0 conn(0x7f7d180a1340 legacy=0x7f7d18133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:33.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.365+0000 7f7d0ffff700 1 -- 172.21.15.26:0/3620253794 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1111113164 0 0) 0x7f7d1809edd0 con 0x7f7d180a1340 2023-10-01T08:01:33.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.365+0000 7f7d1de64700 1 -- 172.21.15.26:0/3620253794 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d180a1fe0 con 0x7f7d18134170 2023-10-01T08:01:33.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.365+0000 7f7d1de64700 1 --2- 172.21.15.26:0/3620253794 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7d18134170 0x7f7d1813bd30 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f7d10009920 tx=0x7f7d10009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4657bf38bc387e95 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:33.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.365+0000 7f7d0ffff700 1 -- 172.21.15.26:0/3620253794 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d10011830 con 0x7f7d18134170 2023-10-01T08:01:33.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.365+0000 7f7d0ffff700 1 -- 172.21.15.26:0/3620253794 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d10011990 con 0x7f7d18134170 2023-10-01T08:01:33.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.365+0000 7f7d0ffff700 1 -- 172.21.15.26:0/3620253794 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d10011d20 con 0x7f7d18134170 2023-10-01T08:01:33.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.366+0000 7f7d1f8c7700 1 -- 172.21.15.26:0/3620253794 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7d18134170 msgr2=0x7f7d1813bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:33.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.366+0000 7f7d1f8c7700 1 --2- 172.21.15.26:0/3620253794 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7d18134170 0x7f7d1813bd30 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f7d10009920 tx=0x7f7d10009c30 comp rx=0 tx=0).stop 2023-10-01T08:01:33.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.366+0000 7f7d1f8c7700 1 -- 172.21.15.26:0/3620253794 shutdown_connections 2023-10-01T08:01:33.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.366+0000 7f7d1f8c7700 1 --2- 172.21.15.26:0/3620253794 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7d180a0a30 0x7f7d180a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:33.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.366+0000 7f7d1f8c7700 1 --2- 172.21.15.26:0/3620253794 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7d18134170 0x7f7d1813bd30 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:33.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.366+0000 7f7d1f8c7700 1 -- 172.21.15.26:0/3620253794 >> 172.21.15.26:0/3620253794 conn(0x7f7d180a6550 msgr2=0x7f7d180a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:33.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.366+0000 7f7d1f8c7700 1 -- 172.21.15.26:0/3620253794 shutdown_connections 2023-10-01T08:01:33.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.366+0000 7f7d1f8c7700 1 -- 172.21.15.26:0/3620253794 wait complete. 2023-10-01T08:01:33.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.367+0000 7f7d1f8c7700 1 Processor -- start 2023-10-01T08:01:33.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.367+0000 7f7d1f8c7700 1 -- start start 2023-10-01T08:01:33.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.368+0000 7f7d1f8c7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7d180a0a30 0x7f7d181c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:33.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.368+0000 7f7d1f8c7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7d180a1340 0x7f7d181c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:33.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.368+0000 7f7d1f8c7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d18134170 0x7f7d18122800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:33.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.368+0000 7f7d1f8c7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d18124500 con 0x7f7d18134170 2023-10-01T08:01:33.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.368+0000 7f7d1f8c7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d181337c0 con 0x7f7d180a0a30 2023-10-01T08:01:33.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.368+0000 7f7d1f8c7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d18125cf0 con 0x7f7d180a1340 2023-10-01T08:01:33.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.368+0000 7f7d1d663700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7d180a0a30 0x7f7d181c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:33.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.368+0000 7f7d1d663700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7d180a0a30 0x7f7d181c8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:51802/0 (socket says 172.21.15.26:51802) 2023-10-01T08:01:33.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.368+0000 7f7d1d663700 1 -- 172.21.15.26:0/378699040 learned_addr learned my addr 172.21.15.26:0/378699040 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:33.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.368+0000 7f7d1de64700 1 --2- 172.21.15.26:0/378699040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d18134170 0x7f7d18122800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:33.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.368+0000 7f7d1ce62700 1 --2- 172.21.15.26:0/378699040 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7d180a1340 0x7f7d181c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:33.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.368+0000 7f7d1de64700 1 -- 172.21.15.26:0/378699040 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7d180a1340 msgr2=0x7f7d181c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:33.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.368+0000 7f7d1de64700 1 --2- 172.21.15.26:0/378699040 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7d180a1340 0x7f7d181c8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:33.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.368+0000 7f7d1de64700 1 -- 172.21.15.26:0/378699040 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7d180a0a30 msgr2=0x7f7d181c8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:33.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.368+0000 7f7d1de64700 1 --2- 172.21.15.26:0/378699040 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7d180a0a30 0x7f7d181c8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:33.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.368+0000 7f7d1de64700 1 -- 172.21.15.26:0/378699040 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d10009550 con 0x7f7d18134170 2023-10-01T08:01:33.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.368+0000 7f7d1d663700 1 --2- 172.21.15.26:0/378699040 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7d180a0a30 0x7f7d181c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:33.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.368+0000 7f7d1de64700 1 --2- 172.21.15.26:0/378699040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d18134170 0x7f7d18122800 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f7d10016000 tx=0x7f7d10004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:33.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.369+0000 7f7d0dffb700 1 -- 172.21.15.26:0/378699040 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d10004450 con 0x7f7d18134170 2023-10-01T08:01:33.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.369+0000 7f7d0dffb700 1 -- 172.21.15.26:0/378699040 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d100045b0 con 0x7f7d18134170 2023-10-01T08:01:33.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.369+0000 7f7d1f8c7700 1 -- 172.21.15.26:0/378699040 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d180a25e0 con 0x7f7d18134170 2023-10-01T08:01:33.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.369+0000 7f7d0dffb700 1 -- 172.21.15.26:0/378699040 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d100038c0 con 0x7f7d18134170 2023-10-01T08:01:33.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.369+0000 7f7d1f8c7700 1 -- 172.21.15.26:0/378699040 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d180a0220 con 0x7f7d18134170 2023-10-01T08:01:33.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.370+0000 7f7d0dffb700 1 -- 172.21.15.26:0/378699040 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7d10003a20 con 0x7f7d18134170 2023-10-01T08:01:33.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.370+0000 7f7d1f8c7700 1 -- 172.21.15.26:0/378699040 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d18074ea0 con 0x7f7d18134170 2023-10-01T08:01:33.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.370+0000 7f7d0dffb700 1 -- 172.21.15.26:0/378699040 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7d10040690 con 0x7f7d18134170 2023-10-01T08:01:33.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.379+0000 7f7d0dffb700 1 -- 172.21.15.26:0/378699040 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d1002b3a0 con 0x7f7d18134170 2023-10-01T08:01:33.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.498+0000 7f0236437700 1 -- 172.21.15.26:0/1380467059 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f023006c360 con 0x7f023009d6f0 2023-10-01T08:01:33.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.498+0000 7f022cff9700 1 -- 172.21.15.26:0/1380467059 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f022002a090 con 0x7f023009d6f0 2023-10-01T08:01:33.499 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:33.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.502+0000 7f0236437700 1 -- 172.21.15.26:0/1380467059 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f023009d6f0 msgr2=0x7f02301a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:33.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.502+0000 7f0236437700 1 --2- 172.21.15.26:0/1380467059 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f023009d6f0 0x7f02301a5210 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f022000e8e0 tx=0x7f022000ebf0 comp rx=0 tx=0).stop 2023-10-01T08:01:33.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.502+0000 7f0236437700 1 -- 172.21.15.26:0/1380467059 shutdown_connections 2023-10-01T08:01:33.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.502+0000 7f0236437700 1 --2- 172.21.15.26:0/1380467059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f023009e410 0x7f02301c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:33.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.502+0000 7f0236437700 1 --2- 172.21.15.26:0/1380467059 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f023009d6f0 0x7f02301a5210 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:33.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.502+0000 7f0236437700 1 --2- 172.21.15.26:0/1380467059 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f023009e000 0x7f02301a5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:33.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.502+0000 7f0236437700 1 -- 172.21.15.26:0/1380467059 >> 172.21.15.26:0/1380467059 conn(0x7f0230066f50 msgr2=0x7f023006f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:33.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.502+0000 7f0236437700 1 -- 172.21.15.26:0/1380467059 shutdown_connections 2023-10-01T08:01:33.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.502+0000 7f0236437700 1 -- 172.21.15.26:0/1380467059 wait complete. 2023-10-01T08:01:33.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:33.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.557+0000 7f772a455700 1 -- 172.21.15.26:0/658787618 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f77240a3530 con 0x7f772409e930 2023-10-01T08:01:33.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.557+0000 7f7720ff9700 1 -- 172.21.15.26:0/658787618 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7714015080 con 0x7f772409e930 2023-10-01T08:01:33.558 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:33.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.560+0000 7f772a455700 1 -- 172.21.15.26:0/658787618 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f772409e930 msgr2=0x7f772406b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:33.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.560+0000 7f772a455700 1 --2- 172.21.15.26:0/658787618 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f772409e930 0x7f772406b8b0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f7714016000 tx=0x7f7714004750 comp rx=0 tx=0).stop 2023-10-01T08:01:33.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.560+0000 7f772a455700 1 -- 172.21.15.26:0/658787618 shutdown_connections 2023-10-01T08:01:33.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.560+0000 7f772a455700 1 --2- 172.21.15.26:0/658787618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f772409f650 0x7f772406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:33.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.560+0000 7f772a455700 1 --2- 172.21.15.26:0/658787618 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f772409e930 0x7f772406b8b0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:33.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.560+0000 7f772a455700 1 --2- 172.21.15.26:0/658787618 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f772409f240 0x7f772406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:33.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.560+0000 7f772a455700 1 -- 172.21.15.26:0/658787618 >> 172.21.15.26:0/658787618 conn(0x7f77240a4210 msgr2=0x7f77241b8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:33.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.560+0000 7f772a455700 1 -- 172.21.15.26:0/658787618 shutdown_connections 2023-10-01T08:01:33.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.560+0000 7f772a455700 1 -- 172.21.15.26:0/658787618 wait complete. 2023-10-01T08:01:33.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:33.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.586+0000 7f7d1f8c7700 1 -- 172.21.15.26:0/378699040 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7d181c91a0 con 0x7f7d18134170 2023-10-01T08:01:33.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.586+0000 7f7d0dffb700 1 -- 172.21.15.26:0/378699040 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7d10015030 con 0x7f7d18134170 2023-10-01T08:01:33.587 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:33.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.588+0000 7f7d1f8c7700 1 -- 172.21.15.26:0/378699040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d18134170 msgr2=0x7f7d18122800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:33.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.588+0000 7f7d1f8c7700 1 --2- 172.21.15.26:0/378699040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d18134170 0x7f7d18122800 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f7d10016000 tx=0x7f7d10004750 comp rx=0 tx=0).stop 2023-10-01T08:01:33.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.588+0000 7f7d1f8c7700 1 -- 172.21.15.26:0/378699040 shutdown_connections 2023-10-01T08:01:33.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.588+0000 7f7d1f8c7700 1 --2- 172.21.15.26:0/378699040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d18134170 0x7f7d18122800 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:33.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.588+0000 7f7d1f8c7700 1 --2- 172.21.15.26:0/378699040 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7d180a0a30 0x7f7d181c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:33.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.588+0000 7f7d1f8c7700 1 --2- 172.21.15.26:0/378699040 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7d180a1340 0x7f7d181c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:33.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.588+0000 7f7d1f8c7700 1 -- 172.21.15.26:0/378699040 >> 172.21.15.26:0/378699040 conn(0x7f7d180a6550 msgr2=0x7f7d1809edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:33.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.588+0000 7f7d1f8c7700 1 -- 172.21.15.26:0/378699040 shutdown_connections 2023-10-01T08:01:33.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.588+0000 7f7d1f8c7700 1 -- 172.21.15.26:0/378699040 wait complete. 2023-10-01T08:01:33.602 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:33.716 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:33.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.858+0000 7fa79a083700 1 Processor -- start 2023-10-01T08:01:33.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.858+0000 7fa79a083700 1 -- start start 2023-10-01T08:01:33.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.859+0000 7fa79a083700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa79409e1d0 0x7fa794138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:33.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.859+0000 7fa79a083700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa794139170 0x7fa79413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:33.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.859+0000 7fa79a083700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa79409b120 con 0x7fa79409d6f0 2023-10-01T08:01:33.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.859+0000 7fa79a083700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79406b460 con 0x7fa794139170 2023-10-01T08:01:33.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.859+0000 7fa79a083700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa79409a7e0 con 0x7fa79409e1d0 2023-10-01T08:01:33.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.859+0000 7fa792ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa79409e1d0 0x7fa794138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:33.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.859+0000 7fa793fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa794139170 0x7fa79413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:33.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.859+0000 7fa792ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa79409e1d0 0x7fa794138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59542/0 (socket says 172.21.15.26:59542) 2023-10-01T08:01:33.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.859+0000 7fa793fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa794139170 0x7fa79413b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44700/0 (socket says 172.21.15.26:44700) 2023-10-01T08:01:33.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.859+0000 7fa792ffd700 1 -- 172.21.15.26:0/1921885872 learned_addr learned my addr 172.21.15.26:0/1921885872 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:33.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.859+0000 7fa7937fe700 1 --1- 172.21.15.26:0/1921885872 >> v1:172.21.15.26:6789/0 conn(0x7fa79409d6f0 0x7fa79409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44180/0 (socket says 172.21.15.26:44180) 2023-10-01T08:01:33.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.859+0000 7fa792ffd700 1 -- 172.21.15.26:0/1921885872 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa794139170 msgr2=0x7fa79413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:33.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.859+0000 7fa792ffd700 1 --2- 172.21.15.26:0/1921885872 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa794139170 0x7fa79413b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:33.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.859+0000 7fa7927fc700 1 -- 172.21.15.26:0/1921885872 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628747781 0 0) 0x7fa79409b120 con 0x7fa79409d6f0 2023-10-01T08:01:33.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.859+0000 7fa792ffd700 1 -- 172.21.15.26:0/1921885872 >> v1:172.21.15.26:6789/0 conn(0x7fa79409d6f0 legacy=0x7fa79409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:33.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.859+0000 7fa792ffd700 1 -- 172.21.15.26:0/1921885872 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79409a500 con 0x7fa79409e1d0 2023-10-01T08:01:33.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.859+0000 7fa793fff700 1 --2- 172.21.15.26:0/1921885872 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa794139170 0x7fa79413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:33.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.860+0000 7fa792ffd700 1 --2- 172.21.15.26:0/1921885872 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa79409e1d0 0x7fa794138c30 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fa77c009950 tx=0x7fa77c009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c55371fbbd760018 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:33.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.860+0000 7fa7927fc700 1 -- 172.21.15.26:0/1921885872 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c011830 con 0x7fa79409e1d0 2023-10-01T08:01:33.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.860+0000 7fa7927fc700 1 -- 172.21.15.26:0/1921885872 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77c011990 con 0x7fa79409e1d0 2023-10-01T08:01:33.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.860+0000 7fa7927fc700 1 -- 172.21.15.26:0/1921885872 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c011d40 con 0x7fa79409e1d0 2023-10-01T08:01:33.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.860+0000 7fa79a083700 1 -- 172.21.15.26:0/1921885872 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa79409e1d0 msgr2=0x7fa794138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:33.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.860+0000 7fa79a083700 1 --2- 172.21.15.26:0/1921885872 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa79409e1d0 0x7fa794138c30 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fa77c009950 tx=0x7fa77c009c60 comp rx=0 tx=0).stop 2023-10-01T08:01:33.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.860+0000 7fa79a083700 1 -- 172.21.15.26:0/1921885872 shutdown_connections 2023-10-01T08:01:33.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.860+0000 7fa79a083700 1 --2- 172.21.15.26:0/1921885872 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa794139170 0x7fa79413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:33.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.860+0000 7fa79a083700 1 --2- 172.21.15.26:0/1921885872 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa79409e1d0 0x7fa794138c30 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:33.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.860+0000 7fa79a083700 1 -- 172.21.15.26:0/1921885872 >> 172.21.15.26:0/1921885872 conn(0x7fa794066f50 msgr2=0x7fa79409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:33.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.860+0000 7fa79a083700 1 -- 172.21.15.26:0/1921885872 shutdown_connections 2023-10-01T08:01:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.860+0000 7fa79a083700 1 -- 172.21.15.26:0/1921885872 wait complete. 2023-10-01T08:01:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.862+0000 7fa79a083700 1 Processor -- start 2023-10-01T08:01:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.862+0000 7fa79a083700 1 -- start start 2023-10-01T08:01:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.863+0000 7fa79a083700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa79409d6f0 0x7fa7941c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.863+0000 7fa79a083700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa79409e1d0 0x7fa7941c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.863+0000 7fa79a083700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa794139170 0x7fa7941c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.863+0000 7fa79a083700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa794072210 con 0x7fa79409e1d0 2023-10-01T08:01:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.863+0000 7fa79a083700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa794120680 con 0x7fa794139170 2023-10-01T08:01:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.863+0000 7fa79a083700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa794121d20 con 0x7fa79409d6f0 2023-10-01T08:01:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.863+0000 7fa7937fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa79409d6f0 0x7fa7941c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.863+0000 7fa792ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa79409e1d0 0x7fa7941c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.863+0000 7fa7937fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa79409d6f0 0x7fa7941c8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59556/0 (socket says 172.21.15.26:59556) 2023-10-01T08:01:33.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.863+0000 7fa7937fe700 1 -- 172.21.15.26:0/478854167 learned_addr learned my addr 172.21.15.26:0/478854167 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:33.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.863+0000 7fa793fff700 1 --2- 172.21.15.26:0/478854167 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa794139170 0x7fa7941c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:33.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.863+0000 7fa792ffd700 1 -- 172.21.15.26:0/478854167 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa79409d6f0 msgr2=0x7fa7941c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:33.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.863+0000 7fa792ffd700 1 --2- 172.21.15.26:0/478854167 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa79409d6f0 0x7fa7941c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:33.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.863+0000 7fa792ffd700 1 -- 172.21.15.26:0/478854167 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa794139170 msgr2=0x7fa7941c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:33.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.863+0000 7fa792ffd700 1 --2- 172.21.15.26:0/478854167 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa794139170 0x7fa7941c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:33.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.863+0000 7fa792ffd700 1 -- 172.21.15.26:0/478854167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa78c009a70 con 0x7fa79409e1d0 2023-10-01T08:01:33.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.863+0000 7fa7937fe700 1 --2- 172.21.15.26:0/478854167 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa79409d6f0 0x7fa7941c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:33.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.863+0000 7fa792ffd700 1 --2- 172.21.15.26:0/478854167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa79409e1d0 0x7fa7941c89a0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7fa77c016000 tx=0x7fa77c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:33.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.864+0000 7fa78bfff700 1 -- 172.21.15.26:0/478854167 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c01a840 con 0x7fa79409e1d0 2023-10-01T08:01:33.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.864+0000 7fa78bfff700 1 -- 172.21.15.26:0/478854167 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77c01f070 con 0x7fa79409e1d0 2023-10-01T08:01:33.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.864+0000 7fa79a083700 1 -- 172.21.15.26:0/478854167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa77c009550 con 0x7fa79409e1d0 2023-10-01T08:01:33.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.864+0000 7fa78bfff700 1 -- 172.21.15.26:0/478854167 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c01ac00 con 0x7fa79409e1d0 2023-10-01T08:01:33.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.864+0000 7fa79a083700 1 -- 172.21.15.26:0/478854167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7941222b0 con 0x7fa79409e1d0 2023-10-01T08:01:33.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.864+0000 7fa78bfff700 1 -- 172.21.15.26:0/478854167 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa77c01b430 con 0x7fa79409e1d0 2023-10-01T08:01:33.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.865+0000 7fa78bfff700 1 -- 172.21.15.26:0/478854167 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa77c021070 con 0x7fa79409e1d0 2023-10-01T08:01:33.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.865+0000 7fa79a083700 1 -- 172.21.15.26:0/478854167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7941224a0 con 0x7fa79409e1d0 2023-10-01T08:01:33.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:33.870+0000 7fa78bfff700 1 -- 172.21.15.26:0/478854167 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa77c015020 con 0x7fa79409e1d0 2023-10-01T08:01:34.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.075+0000 7fa79a083700 1 -- 172.21.15.26:0/478854167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa7940a1dd0 con 0x7fa79409e1d0 2023-10-01T08:01:34.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.076+0000 7fa78bfff700 1 -- 172.21.15.26:0/478854167 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa77c01b6e0 con 0x7fa79409e1d0 2023-10-01T08:01:34.077 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:34.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.078+0000 7fa79a083700 1 -- 172.21.15.26:0/478854167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa79409e1d0 msgr2=0x7fa7941c89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:34.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.078+0000 7fa79a083700 1 --2- 172.21.15.26:0/478854167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa79409e1d0 0x7fa7941c89a0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7fa77c016000 tx=0x7fa77c004750 comp rx=0 tx=0).stop 2023-10-01T08:01:34.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.078+0000 7fa79a083700 1 -- 172.21.15.26:0/478854167 shutdown_connections 2023-10-01T08:01:34.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.078+0000 7fa79a083700 1 --2- 172.21.15.26:0/478854167 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa794139170 0x7fa7941c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:34.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.078+0000 7fa79a083700 1 --2- 172.21.15.26:0/478854167 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa79409d6f0 0x7fa7941c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:34.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.078+0000 7fa79a083700 1 --2- 172.21.15.26:0/478854167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa79409e1d0 0x7fa7941c89a0 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:34.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.078+0000 7fa79a083700 1 -- 172.21.15.26:0/478854167 >> 172.21.15.26:0/478854167 conn(0x7fa794066f50 msgr2=0x7fa794136b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:34.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.078+0000 7fa79a083700 1 -- 172.21.15.26:0/478854167 shutdown_connections 2023-10-01T08:01:34.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.078+0000 7fa79a083700 1 -- 172.21.15.26:0/478854167 wait complete. 2023-10-01T08:01:34.093 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:34.522 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:34.575 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:34.603 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:34.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.672+0000 7f0d12334700 1 Processor -- start 2023-10-01T08:01:34.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.672+0000 7f0d12334700 1 -- start start 2023-10-01T08:01:34.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.673+0000 7f0d12334700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0d0c09d630 0x7f0d0c0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:34.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.673+0000 7f0d12334700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d0c138d80 0x7f0d0c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:34.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.673+0000 7f0d12334700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d0c0a2a70 con 0x7f0d0c0a0a30 2023-10-01T08:01:34.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.673+0000 7f0d12334700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d0c0a01d0 con 0x7f0d0c09d630 2023-10-01T08:01:34.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.673+0000 7f0d12334700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c09e2b0 con 0x7f0d0c138d80 2023-10-01T08:01:34.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.673+0000 7f0d0b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0d0c09d630 0x7f0d0c0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:34.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.673+0000 7f0d0b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0d0c09d630 0x7f0d0c0a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44064/0 (socket says 172.21.15.26:44064) 2023-10-01T08:01:34.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.673+0000 7f0d0b7fe700 1 -- 172.21.15.26:0/2911216284 learned_addr learned my addr 172.21.15.26:0/2911216284 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:34.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.673+0000 7f0d108d1700 1 --2- 172.21.15.26:0/2911216284 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d0c138d80 0x7f0d0c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:34.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.673+0000 7f0d0b7fe700 1 -- 172.21.15.26:0/2911216284 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d0c138d80 msgr2=0x7f0d0c13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:34.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.673+0000 7f0d0b7fe700 1 --2- 172.21.15.26:0/2911216284 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d0c138d80 0x7f0d0c13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:34.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.673+0000 7f0d0b7fe700 1 -- 172.21.15.26:0/2911216284 >> v1:172.21.15.26:6789/0 conn(0x7f0d0c0a0a30 legacy=0x7f0d0c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:34.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.673+0000 7f0d0b7fe700 1 -- 172.21.15.26:0/2911216284 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0c09dc50 con 0x7f0d0c09d630 2023-10-01T08:01:34.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.673+0000 7f0d108d1700 1 --2- 172.21.15.26:0/2911216284 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d0c138d80 0x7f0d0c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:34.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.674+0000 7f0d0b7fe700 1 --2- 172.21.15.26:0/2911216284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d0c09d630 0x7f0d0c0a1510 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f0d000098f0 tx=0x7f0d00009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bca5b94555d3da6 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:34.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.674+0000 7f0d0affd700 1 -- 172.21.15.26:0/2911216284 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d00011830 con 0x7f0d0c09d630 2023-10-01T08:01:34.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.674+0000 7f0d0affd700 1 -- 172.21.15.26:0/2911216284 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d00011990 con 0x7f0d0c09d630 2023-10-01T08:01:34.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.674+0000 7f0d0affd700 1 -- 172.21.15.26:0/2911216284 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d00011d20 con 0x7f0d0c09d630 2023-10-01T08:01:34.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.675+0000 7f0d12334700 1 -- 172.21.15.26:0/2911216284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d0c09d630 msgr2=0x7f0d0c0a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:34.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.675+0000 7f0d12334700 1 --2- 172.21.15.26:0/2911216284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d0c09d630 0x7f0d0c0a1510 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f0d000098f0 tx=0x7f0d00009c00 comp rx=0 tx=0).stop 2023-10-01T08:01:34.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.675+0000 7f0d12334700 1 -- 172.21.15.26:0/2911216284 shutdown_connections 2023-10-01T08:01:34.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.675+0000 7f0d12334700 1 --2- 172.21.15.26:0/2911216284 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d0c138d80 0x7f0d0c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:34.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.675+0000 7f0d12334700 1 --2- 172.21.15.26:0/2911216284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d0c09d630 0x7f0d0c0a1510 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:34.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.675+0000 7f0d12334700 1 -- 172.21.15.26:0/2911216284 >> 172.21.15.26:0/2911216284 conn(0x7f0d0c0a3050 msgr2=0x7f0d0c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:34.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.675+0000 7f0d12334700 1 -- 172.21.15.26:0/2911216284 shutdown_connections 2023-10-01T08:01:34.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.675+0000 7f0d12334700 1 -- 172.21.15.26:0/2911216284 wait complete. 2023-10-01T08:01:34.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.676+0000 7f0d12334700 1 Processor -- start 2023-10-01T08:01:34.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.676+0000 7f0d12334700 1 -- start start 2023-10-01T08:01:34.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.676+0000 7f0d12334700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d0c09d630 0x7f0d0c133970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:34.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.676+0000 7f0d12334700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d0c0a0a30 0x7f0d0c133eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:34.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.677+0000 7f0d12334700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d0c138d80 0x7f0d0c1343f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:34.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.677+0000 7f0d12334700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c138040 con 0x7f0d0c138d80 2023-10-01T08:01:34.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.677+0000 7f0d12334700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c0a4d40 con 0x7f0d0c0a0a30 2023-10-01T08:01:34.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.677+0000 7f0d12334700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c136de0 con 0x7f0d0c09d630 2023-10-01T08:01:34.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.677+0000 7f0d0b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d0c0a0a30 0x7f0d0c133eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:34.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.677+0000 7f0d0b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d0c0a0a30 0x7f0d0c133eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44736/0 (socket says 172.21.15.26:44736) 2023-10-01T08:01:34.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.677+0000 7f0d0b7fe700 1 -- 172.21.15.26:0/1969602264 learned_addr learned my addr 172.21.15.26:0/1969602264 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:34.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.677+0000 7f0d108d1700 1 --2- 172.21.15.26:0/1969602264 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d0c138d80 0x7f0d0c1343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:34.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.677+0000 7f0d0b7fe700 1 -- 172.21.15.26:0/1969602264 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d0c09d630 msgr2=0x7f0d0c133970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:34.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.677+0000 7f0d0b7fe700 1 --2- 172.21.15.26:0/1969602264 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d0c09d630 0x7f0d0c133970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:34.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.677+0000 7f0d0b7fe700 1 -- 172.21.15.26:0/1969602264 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d0c138d80 msgr2=0x7f0d0c1343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:34.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.677+0000 7f0d0b7fe700 1 --2- 172.21.15.26:0/1969602264 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d0c138d80 0x7f0d0c1343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:34.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.677+0000 7f0d0b7fe700 1 -- 172.21.15.26:0/1969602264 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d04009a70 con 0x7f0d0c0a0a30 2023-10-01T08:01:34.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.677+0000 7f0d108d1700 1 --2- 172.21.15.26:0/1969602264 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d0c138d80 0x7f0d0c1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:34.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.677+0000 7f0d0b7fe700 1 --2- 172.21.15.26:0/1969602264 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d0c0a0a30 0x7f0d0c133eb0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f0d00000c00 tx=0x7f0d00004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:34.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.678+0000 7f0d08ff9700 1 -- 172.21.15.26:0/1969602264 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d00004480 con 0x7f0d0c0a0a30 2023-10-01T08:01:34.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.678+0000 7f0d08ff9700 1 -- 172.21.15.26:0/1969602264 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0001f070 con 0x7f0d0c0a0a30 2023-10-01T08:01:34.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.678+0000 7f0d08ff9700 1 -- 172.21.15.26:0/1969602264 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d000038c0 con 0x7f0d0c0a0a30 2023-10-01T08:01:34.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.678+0000 7f0d12334700 1 -- 172.21.15.26:0/1969602264 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d00009550 con 0x7f0d0c0a0a30 2023-10-01T08:01:34.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.678+0000 7f0d12334700 1 -- 172.21.15.26:0/1969602264 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d0c135c60 con 0x7f0d0c0a0a30 2023-10-01T08:01:34.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.679+0000 7f0d12334700 1 -- 172.21.15.26:0/1969602264 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d0c0747f0 con 0x7f0d0c0a0a30 2023-10-01T08:01:34.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.679+0000 7f0d08ff9700 1 -- 172.21.15.26:0/1969602264 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0d00021030 con 0x7f0d0c0a0a30 2023-10-01T08:01:34.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.679+0000 7f0d08ff9700 1 -- 172.21.15.26:0/1969602264 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0d00040a50 con 0x7f0d0c0a0a30 2023-10-01T08:01:34.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.684+0000 7f0d08ff9700 1 -- 172.21.15.26:0/1969602264 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0d000199a0 con 0x7f0d0c0a0a30 2023-10-01T08:01:34.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.722+0000 7f55674ae700 1 Processor -- start 2023-10-01T08:01:34.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.722+0000 7f55674ae700 1 -- start start 2023-10-01T08:01:34.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.723+0000 7f55674ae700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f55600a0a30 0x7f55600a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:34.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.723+0000 7f55674ae700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f556009d630 0x7f55600a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:34.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.723+0000 7f55674ae700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55600a2a70 con 0x7f5560133930 2023-10-01T08:01:34.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.723+0000 7f55674ae700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55600a01d0 con 0x7f55600a0a30 2023-10-01T08:01:34.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.723+0000 7f55674ae700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f556009e2b0 con 0x7f556009d630 2023-10-01T08:01:34.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.723+0000 7f5564a49700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f556009d630 0x7f55600a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:34.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.723+0000 7f5565a4b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5560133930 0x7f5560133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44204/0 (socket says 172.21.15.26:44204) 2023-10-01T08:01:34.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.723+0000 7f5565a4b700 1 -- 172.21.15.26:0/2545632216 learned_addr learned my addr 172.21.15.26:0/2545632216 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:01:34.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.724+0000 7f556524a700 1 --2- 172.21.15.26:0/2545632216 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f55600a0a30 0x7f55600a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.724+0000 7f5564a49700 1 -- 172.21.15.26:0/2545632216 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f55600a0a30 msgr2=0x7f55600a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.724+0000 7f5564a49700 1 --2- 172.21.15.26:0/2545632216 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f55600a0a30 0x7f55600a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.724+0000 7f5564a49700 1 -- 172.21.15.26:0/2545632216 >> v1:172.21.15.26:6789/0 conn(0x7f5560133930 legacy=0x7f5560133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.724+0000 7f5557fff700 1 -- 172.21.15.26:0/2545632216 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 658367014 0 0) 0x7f55600a2a70 con 0x7f5560133930 2023-10-01T08:01:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.724+0000 7f5564a49700 1 -- 172.21.15.26:0/2545632216 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f556009dc50 con 0x7f556009d630 2023-10-01T08:01:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.724+0000 7f5564a49700 1 --2- 172.21.15.26:0/2545632216 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f556009d630 0x7f55600a1340 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f5550009870 tx=0x7f5550009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c65153b2f175d8b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.724+0000 7f5557fff700 1 -- 172.21.15.26:0/2545632216 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5550011830 con 0x7f556009d630 2023-10-01T08:01:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.724+0000 7f5557fff700 1 -- 172.21.15.26:0/2545632216 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5550011990 con 0x7f556009d630 2023-10-01T08:01:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.724+0000 7f5557fff700 1 -- 172.21.15.26:0/2545632216 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5550011d20 con 0x7f556009d630 2023-10-01T08:01:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.725+0000 7f55674ae700 1 -- 172.21.15.26:0/2545632216 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f556009d630 msgr2=0x7f55600a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.725+0000 7f55674ae700 1 --2- 172.21.15.26:0/2545632216 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f556009d630 0x7f55600a1340 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f5550009870 tx=0x7f5550009b80 comp rx=0 tx=0).stop 2023-10-01T08:01:34.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.725+0000 7f55674ae700 1 -- 172.21.15.26:0/2545632216 shutdown_connections 2023-10-01T08:01:34.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.725+0000 7f55674ae700 1 --2- 172.21.15.26:0/2545632216 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f55600a0a30 0x7f55600a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:34.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.725+0000 7f55674ae700 1 --2- 172.21.15.26:0/2545632216 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f556009d630 0x7f55600a1340 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:34.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.725+0000 7f55674ae700 1 -- 172.21.15.26:0/2545632216 >> 172.21.15.26:0/2545632216 conn(0x7f55600a3050 msgr2=0x7f55600a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:34.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.725+0000 7f55674ae700 1 -- 172.21.15.26:0/2545632216 shutdown_connections 2023-10-01T08:01:34.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.725+0000 7f55674ae700 1 -- 172.21.15.26:0/2545632216 wait complete. 2023-10-01T08:01:34.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.726+0000 7f55674ae700 1 Processor -- start 2023-10-01T08:01:34.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.726+0000 7f55674ae700 1 -- start start 2023-10-01T08:01:34.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.727+0000 7f55674ae700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f556009d630 0x7f556011e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:34.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.727+0000 7f55674ae700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55600a0a30 0x7f556011edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:34.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.727+0000 7f55674ae700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5560133930 0x7f556011f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.727+0000 7f55674ae700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55600a5de0 con 0x7f55600a0a30 2023-10-01T08:01:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.727+0000 7f55674ae700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55600a0410 con 0x7f556009d630 2023-10-01T08:01:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.727+0000 7f55674ae700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5560120550 con 0x7f5560133930 2023-10-01T08:01:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.727+0000 7f5564a49700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55600a0a30 0x7f556011edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.727+0000 7f5564a49700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55600a0a30 0x7f556011edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44088/0 (socket says 172.21.15.26:44088) 2023-10-01T08:01:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.727+0000 7f5564a49700 1 -- 172.21.15.26:0/3160020396 learned_addr learned my addr 172.21.15.26:0/3160020396 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.727+0000 7f556524a700 1 --2- 172.21.15.26:0/3160020396 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f556009d630 0x7f556011e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.727+0000 7f5565a4b700 1 --2- 172.21.15.26:0/3160020396 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5560133930 0x7f556011f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.727+0000 7f556524a700 1 -- 172.21.15.26:0/3160020396 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5560133930 msgr2=0x7f556011f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.727+0000 7f556524a700 1 --2- 172.21.15.26:0/3160020396 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5560133930 0x7f556011f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.727+0000 7f556524a700 1 -- 172.21.15.26:0/3160020396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55600a0a30 msgr2=0x7f556011edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.727+0000 7f556524a700 1 --2- 172.21.15.26:0/3160020396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55600a0a30 0x7f556011edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:34.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.727+0000 7f556524a700 1 -- 172.21.15.26:0/3160020396 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55500094a0 con 0x7f556009d630 2023-10-01T08:01:34.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.727+0000 7f556524a700 1 --2- 172.21.15.26:0/3160020396 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f556009d630 0x7f556011e8b0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f555c007e90 tx=0x7f555c00e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:34.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.728+0000 7f5555ffb700 1 -- 172.21.15.26:0/3160020396 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c00ed30 con 0x7f556009d630 2023-10-01T08:01:34.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.728+0000 7f5555ffb700 1 -- 172.21.15.26:0/3160020396 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555c00ee90 con 0x7f556009d630 2023-10-01T08:01:34.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.728+0000 7f55674ae700 1 -- 172.21.15.26:0/3160020396 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5560122070 con 0x7f556009d630 2023-10-01T08:01:34.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.728+0000 7f5555ffb700 1 -- 172.21.15.26:0/3160020396 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c014660 con 0x7f556009d630 2023-10-01T08:01:34.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.728+0000 7f55674ae700 1 -- 172.21.15.26:0/3160020396 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5560122ae0 con 0x7f556009d630 2023-10-01T08:01:34.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.729+0000 7f5555ffb700 1 -- 172.21.15.26:0/3160020396 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f555c0147c0 con 0x7f556009d630 2023-10-01T08:01:34.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.729+0000 7f5555ffb700 1 -- 172.21.15.26:0/3160020396 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f555c03fd70 con 0x7f556009d630 2023-10-01T08:01:34.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.729+0000 7f55674ae700 1 -- 172.21.15.26:0/3160020396 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55600747f0 con 0x7f556009d630 2023-10-01T08:01:34.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.734+0000 7f5555ffb700 1 -- 172.21.15.26:0/3160020396 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f555c01e460 con 0x7f556009d630 2023-10-01T08:01:34.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.764+0000 7f029a6b6700 1 Processor -- start 2023-10-01T08:01:34.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.764+0000 7f029a6b6700 1 -- start start 2023-10-01T08:01:34.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.764+0000 7f029a6b6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f029409d6f0 0x7f029409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:34.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.764+0000 7f029a6b6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f029409e000 0x7f02941339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:34.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.764+0000 7f029a6b6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f029409b120 con 0x7f029409e410 2023-10-01T08:01:34.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.764+0000 7f029a6b6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f029406b460 con 0x7f029409e000 2023-10-01T08:01:34.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.764+0000 7f029a6b6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029409a7e0 con 0x7f029409d6f0 2023-10-01T08:01:34.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.765+0000 7f0293fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f029409d6f0 0x7f029409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:34.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.765+0000 7f0298c53700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f029409e410 0x7f0294133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44208/0 (socket says 172.21.15.26:44208) 2023-10-01T08:01:34.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.765+0000 7f0298c53700 1 -- 172.21.15.26:0/2944815217 learned_addr learned my addr 172.21.15.26:0/2944815217 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:01:34.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.765+0000 7f02937fe700 1 --2- 172.21.15.26:0/2944815217 >> v2:172.21.15.26:3300/0 conn(0x7f029409e000 0x7f02941339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:34.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.765+0000 7f0293fff700 1 -- 172.21.15.26:0/2944815217 >> v2:172.21.15.26:3300/0 conn(0x7f029409e000 msgr2=0x7f02941339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:34.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.765+0000 7f0293fff700 1 --2- 172.21.15.26:0/2944815217 >> v2:172.21.15.26:3300/0 conn(0x7f029409e000 0x7f02941339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:34.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.765+0000 7f0293fff700 1 -- 172.21.15.26:0/2944815217 >> v1:172.21.15.26:6789/0 conn(0x7f029409e410 legacy=0x7f0294133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:34.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.765+0000 7f0293fff700 1 -- 172.21.15.26:0/2944815217 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029409a500 con 0x7f029409d6f0 2023-10-01T08:01:34.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.765+0000 7f0293fff700 1 --2- 172.21.15.26:0/2944815217 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f029409d6f0 0x7f029409dac0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f0284009870 tx=0x7f0284009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a577e1ca2d34594f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:34.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.765+0000 7f0292ffd700 1 -- 172.21.15.26:0/2944815217 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0284011830 con 0x7f029409d6f0 2023-10-01T08:01:34.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.765+0000 7f0292ffd700 1 -- 172.21.15.26:0/2944815217 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0284011990 con 0x7f029409d6f0 2023-10-01T08:01:34.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.765+0000 7f0292ffd700 1 -- 172.21.15.26:0/2944815217 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0284011d20 con 0x7f029409d6f0 2023-10-01T08:01:34.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.766+0000 7f029a6b6700 1 -- 172.21.15.26:0/2944815217 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f029409d6f0 msgr2=0x7f029409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:34.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.766+0000 7f029a6b6700 1 --2- 172.21.15.26:0/2944815217 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f029409d6f0 0x7f029409dac0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f0284009870 tx=0x7f0284009b80 comp rx=0 tx=0).stop 2023-10-01T08:01:34.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.766+0000 7f029a6b6700 1 -- 172.21.15.26:0/2944815217 shutdown_connections 2023-10-01T08:01:34.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.766+0000 7f029a6b6700 1 --2- 172.21.15.26:0/2944815217 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f029409d6f0 0x7f029409dac0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:34.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.766+0000 7f029a6b6700 1 --2- 172.21.15.26:0/2944815217 >> v2:172.21.15.26:3300/0 conn(0x7f029409e000 0x7f02941339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:34.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.766+0000 7f029a6b6700 1 -- 172.21.15.26:0/2944815217 >> 172.21.15.26:0/2944815217 conn(0x7f0294066f50 msgr2=0x7f029409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:34.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.766+0000 7f029a6b6700 1 -- 172.21.15.26:0/2944815217 shutdown_connections 2023-10-01T08:01:34.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.766+0000 7f029a6b6700 1 -- 172.21.15.26:0/2944815217 wait complete. 2023-10-01T08:01:34.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.767+0000 7f029a6b6700 1 Processor -- start 2023-10-01T08:01:34.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.767+0000 7f029a6b6700 1 -- start start 2023-10-01T08:01:34.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.768+0000 7f029a6b6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f029409d6f0 0x7f02941c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:34.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.768+0000 7f029a6b6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f029409e000 0x7f02941c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:34.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.768+0000 7f029a6b6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f029409e410 0x7f02941c4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:34.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.768+0000 7f029a6b6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02941a9640 con 0x7f029409d6f0 2023-10-01T08:01:34.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.768+0000 7f029a6b6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02941aab30 con 0x7f029409e410 2023-10-01T08:01:34.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.768+0000 7f029a6b6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02940a30c0 con 0x7f029409e000 2023-10-01T08:01:34.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.768+0000 7f0298c53700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f029409e410 0x7f02941c4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:34.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.768+0000 7f0298c53700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f029409e410 0x7f02941c4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44764/0 (socket says 172.21.15.26:44764) 2023-10-01T08:01:34.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.768+0000 7f0298c53700 1 -- 172.21.15.26:0/622917293 learned_addr learned my addr 172.21.15.26:0/622917293 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:34.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.768+0000 7f0293fff700 1 --2- 172.21.15.26:0/622917293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f029409d6f0 0x7f02941c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:34.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.768+0000 7f02937fe700 1 --2- 172.21.15.26:0/622917293 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f029409e000 0x7f02941c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:34.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.768+0000 7f0298c53700 1 -- 172.21.15.26:0/622917293 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f029409e000 msgr2=0x7f02941c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:34.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.768+0000 7f0298c53700 1 --2- 172.21.15.26:0/622917293 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f029409e000 0x7f02941c8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:34.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.768+0000 7f0298c53700 1 -- 172.21.15.26:0/622917293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f029409d6f0 msgr2=0x7f02941c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:34.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.768+0000 7f0298c53700 1 --2- 172.21.15.26:0/622917293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f029409d6f0 0x7f02941c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:34.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.768+0000 7f0298c53700 1 -- 172.21.15.26:0/622917293 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02840094a0 con 0x7f029409e410 2023-10-01T08:01:34.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.768+0000 7f02937fe700 1 --2- 172.21.15.26:0/622917293 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f029409e000 0x7f02941c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T08:01:34.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.769+0000 7f0298c53700 1 --2- 172.21.15.26:0/622917293 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f029409e410 0x7f02941c4af0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f028c00cbc0 tx=0x7f028c00ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:34.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.769+0000 7f0290ff9700 1 -- 172.21.15.26:0/622917293 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028c00aaa0 con 0x7f029409e410 2023-10-01T08:01:34.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.769+0000 7f0290ff9700 1 -- 172.21.15.26:0/622917293 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028c00ac00 con 0x7f029409e410 2023-10-01T08:01:34.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.769+0000 7f029a6b6700 1 -- 172.21.15.26:0/622917293 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f029409c710 con 0x7f029409e410 2023-10-01T08:01:34.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.769+0000 7f0290ff9700 1 -- 172.21.15.26:0/622917293 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028c012400 con 0x7f029409e410 2023-10-01T08:01:34.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.769+0000 7f029a6b6700 1 -- 172.21.15.26:0/622917293 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02941a9ef0 con 0x7f029409e410 2023-10-01T08:01:34.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.770+0000 7f0290ff9700 1 -- 172.21.15.26:0/622917293 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f028c01b3b0 con 0x7f029409e410 2023-10-01T08:01:34.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.770+0000 7f0290ff9700 1 -- 172.21.15.26:0/622917293 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f028c03f150 con 0x7f029409e410 2023-10-01T08:01:34.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.770+0000 7f029a6b6700 1 -- 172.21.15.26:0/622917293 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02941a9ef0 con 0x7f029409e410 2023-10-01T08:01:34.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.780+0000 7f0290ff9700 1 -- 172.21.15.26:0/622917293 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f02941a9ef0 con 0x7f029409e410 2023-10-01T08:01:34.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.893+0000 7f0d12334700 1 -- 172.21.15.26:0/1969602264 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0d0c1359a0 con 0x7f0d0c0a0a30 2023-10-01T08:01:34.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.893+0000 7f0d08ff9700 1 -- 172.21.15.26:0/1969602264 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0d00015030 con 0x7f0d0c0a0a30 2023-10-01T08:01:34.894 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:34.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.896+0000 7f0d12334700 1 -- 172.21.15.26:0/1969602264 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d0c0a0a30 msgr2=0x7f0d0c133eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:34.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.896+0000 7f0d12334700 1 --2- 172.21.15.26:0/1969602264 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d0c0a0a30 0x7f0d0c133eb0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f0d00000c00 tx=0x7f0d00004750 comp rx=0 tx=0).stop 2023-10-01T08:01:34.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.896+0000 7f0d12334700 1 -- 172.21.15.26:0/1969602264 shutdown_connections 2023-10-01T08:01:34.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.896+0000 7f0d12334700 1 --2- 172.21.15.26:0/1969602264 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d0c138d80 0x7f0d0c1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:34.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.896+0000 7f0d12334700 1 --2- 172.21.15.26:0/1969602264 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d0c09d630 0x7f0d0c133970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:34.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.896+0000 7f0d12334700 1 --2- 172.21.15.26:0/1969602264 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d0c0a0a30 0x7f0d0c133eb0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:34.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.896+0000 7f0d12334700 1 -- 172.21.15.26:0/1969602264 >> 172.21.15.26:0/1969602264 conn(0x7f0d0c0a3050 msgr2=0x7f0d0c09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:34.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.896+0000 7f0d12334700 1 -- 172.21.15.26:0/1969602264 shutdown_connections 2023-10-01T08:01:34.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.896+0000 7f0d12334700 1 -- 172.21.15.26:0/1969602264 wait complete. 2023-10-01T08:01:34.910 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:34.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.947+0000 7f55674ae700 1 -- 172.21.15.26:0/3160020396 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5560121ed0 con 0x7f556009d630 2023-10-01T08:01:34.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.947+0000 7f5555ffb700 1 -- 172.21.15.26:0/3160020396 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5560121ed0 con 0x7f556009d630 2023-10-01T08:01:34.948 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:34.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.951+0000 7f55674ae700 1 -- 172.21.15.26:0/3160020396 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f556009d630 msgr2=0x7f556011e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:34.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.951+0000 7f55674ae700 1 --2- 172.21.15.26:0/3160020396 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f556009d630 0x7f556011e8b0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f555c007e90 tx=0x7f555c00e3c0 comp rx=0 tx=0).stop 2023-10-01T08:01:34.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.951+0000 7f55674ae700 1 -- 172.21.15.26:0/3160020396 shutdown_connections 2023-10-01T08:01:34.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.951+0000 7f55674ae700 1 --2- 172.21.15.26:0/3160020396 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5560133930 0x7f556011f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:34.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.951+0000 7f55674ae700 1 --2- 172.21.15.26:0/3160020396 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f556009d630 0x7f556011e8b0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:34.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.951+0000 7f55674ae700 1 --2- 172.21.15.26:0/3160020396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55600a0a30 0x7f556011edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:34.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.951+0000 7f55674ae700 1 -- 172.21.15.26:0/3160020396 >> 172.21.15.26:0/3160020396 conn(0x7f55600a3050 msgr2=0x7f556009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:34.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.951+0000 7f55674ae700 1 -- 172.21.15.26:0/3160020396 shutdown_connections 2023-10-01T08:01:34.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.951+0000 7f55674ae700 1 -- 172.21.15.26:0/3160020396 wait complete. 2023-10-01T08:01:34.970 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:34.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.995+0000 7f029a6b6700 1 -- 172.21.15.26:0/622917293 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f02941a9ef0 con 0x7f029409e410 2023-10-01T08:01:34.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.995+0000 7f0290ff9700 1 -- 172.21.15.26:0/622917293 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f02941a9ef0 con 0x7f029409e410 2023-10-01T08:01:34.996 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:34.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.998+0000 7f029a6b6700 1 -- 172.21.15.26:0/622917293 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f029409e410 msgr2=0x7f02941c4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:34.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.998+0000 7f029a6b6700 1 --2- 172.21.15.26:0/622917293 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f029409e410 0x7f02941c4af0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f028c00cbc0 tx=0x7f028c00ced0 comp rx=0 tx=0).stop 2023-10-01T08:01:34.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.998+0000 7f029a6b6700 1 -- 172.21.15.26:0/622917293 shutdown_connections 2023-10-01T08:01:34.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.998+0000 7f029a6b6700 1 --2- 172.21.15.26:0/622917293 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f029409e410 0x7f02941c4af0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:34.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.998+0000 7f029a6b6700 1 --2- 172.21.15.26:0/622917293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f029409d6f0 0x7f02941c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:34.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.998+0000 7f029a6b6700 1 --2- 172.21.15.26:0/622917293 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f029409e000 0x7f02941c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:34.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.998+0000 7f029a6b6700 1 -- 172.21.15.26:0/622917293 >> 172.21.15.26:0/622917293 conn(0x7f0294066f50 msgr2=0x7f02940708e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:34.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.998+0000 7f029a6b6700 1 -- 172.21.15.26:0/622917293 shutdown_connections 2023-10-01T08:01:34.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:34.998+0000 7f029a6b6700 1 -- 172.21.15.26:0/622917293 wait complete. 2023-10-01T08:01:35.012 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:35.094 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:35.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.235+0000 7f1e30d52700 1 Processor -- start 2023-10-01T08:01:35.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.235+0000 7f1e30d52700 1 -- start start 2023-10-01T08:01:35.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.235+0000 7f1e30d52700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e2c09d6f0 0x7f1e2c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:35.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.235+0000 7f1e30d52700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e2c09e410 0x7f1e2c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:35.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.235+0000 7f1e30d52700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e2c09b120 con 0x7f1e2c09e000 2023-10-01T08:01:35.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.235+0000 7f1e30d52700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c06b460 con 0x7f1e2c09e410 2023-10-01T08:01:35.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.235+0000 7f1e30d52700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c09a7e0 con 0x7f1e2c09d6f0 2023-10-01T08:01:35.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.235+0000 7f1e2ad9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e2c09e410 0x7f1e2c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:35.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.235+0000 7f1e2a59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e2c09d6f0 0x7f1e2c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:35.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.236+0000 7f1e29d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1e2c09e000 0x7f1e2c1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44212/0 (socket says 172.21.15.26:44212) 2023-10-01T08:01:35.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.236+0000 7f1e29d9b700 1 -- 172.21.15.26:0/2324374785 learned_addr learned my addr 172.21.15.26:0/2324374785 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:01:35.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.236+0000 7f1e2ad9d700 1 -- 172.21.15.26:0/2324374785 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e2c09d6f0 msgr2=0x7f1e2c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:35.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.236+0000 7f1e2ad9d700 1 --2- 172.21.15.26:0/2324374785 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e2c09d6f0 0x7f1e2c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:35.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.236+0000 7f1e2ad9d700 1 -- 172.21.15.26:0/2324374785 >> v1:172.21.15.26:6789/0 conn(0x7f1e2c09e000 legacy=0x7f1e2c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:35.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.236+0000 7f1e2959a700 1 -- 172.21.15.26:0/2324374785 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 764837460 0 0) 0x7f1e2c09b120 con 0x7f1e2c09e000 2023-10-01T08:01:35.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.236+0000 7f1e2ad9d700 1 -- 172.21.15.26:0/2324374785 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e2c09a500 con 0x7f1e2c09e410 2023-10-01T08:01:35.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.236+0000 7f1e2a59c700 1 --2- 172.21.15.26:0/2324374785 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e2c09d6f0 0x7f1e2c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:35.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.236+0000 7f1e2ad9d700 1 --2- 172.21.15.26:0/2324374785 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e2c09e410 0x7f1e2c134100 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f1e24009dc0 tx=0x7f1e2400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a3aa2979628f009 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:35.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.236+0000 7f1e2959a700 1 -- 172.21.15.26:0/2324374785 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2400e070 con 0x7f1e2c09e410 2023-10-01T08:01:35.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.236+0000 7f1e2959a700 1 -- 172.21.15.26:0/2324374785 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2400bb20 con 0x7f1e2c09e410 2023-10-01T08:01:35.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.236+0000 7f1e2959a700 1 -- 172.21.15.26:0/2324374785 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e24012430 con 0x7f1e2c09e410 2023-10-01T08:01:35.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.237+0000 7f1e30d52700 1 -- 172.21.15.26:0/2324374785 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e2c09e410 msgr2=0x7f1e2c134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:35.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.237+0000 7f1e30d52700 1 --2- 172.21.15.26:0/2324374785 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e2c09e410 0x7f1e2c134100 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f1e24009dc0 tx=0x7f1e2400b330 comp rx=0 tx=0).stop 2023-10-01T08:01:35.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.237+0000 7f1e30d52700 1 -- 172.21.15.26:0/2324374785 shutdown_connections 2023-10-01T08:01:35.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.237+0000 7f1e30d52700 1 --2- 172.21.15.26:0/2324374785 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e2c09d6f0 0x7f1e2c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:35.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.237+0000 7f1e30d52700 1 --2- 172.21.15.26:0/2324374785 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e2c09e410 0x7f1e2c134100 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:35.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.237+0000 7f1e30d52700 1 -- 172.21.15.26:0/2324374785 >> 172.21.15.26:0/2324374785 conn(0x7f1e2c066f50 msgr2=0x7f1e2c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:35.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.237+0000 7f1e30d52700 1 -- 172.21.15.26:0/2324374785 shutdown_connections 2023-10-01T08:01:35.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.237+0000 7f1e30d52700 1 -- 172.21.15.26:0/2324374785 wait complete. 2023-10-01T08:01:35.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.238+0000 7f1e30d52700 1 Processor -- start 2023-10-01T08:01:35.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.238+0000 7f1e30d52700 1 -- start start 2023-10-01T08:01:35.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.239+0000 7f1e30d52700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e2c09d6f0 0x7f1e2c1223c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:35.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.239+0000 7f1e30d52700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e2c09e000 0x7f1e2c122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:35.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.239+0000 7f1e30d52700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e2c09e410 0x7f1e2c122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:35.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.239+0000 7f1e30d52700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c123890 con 0x7f1e2c09e000 2023-10-01T08:01:35.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.239+0000 7f1e30d52700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c133700 con 0x7f1e2c09d6f0 2023-10-01T08:01:35.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.239+0000 7f1e30d52700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c124dd0 con 0x7f1e2c09e410 2023-10-01T08:01:35.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.239+0000 7f1e2a59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e2c09d6f0 0x7f1e2c1223c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:35.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.239+0000 7f1e2ad9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e2c09e410 0x7f1e2c122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:35.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.239+0000 7f1e2a59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e2c09d6f0 0x7f1e2c1223c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44780/0 (socket says 172.21.15.26:44780) 2023-10-01T08:01:35.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.239+0000 7f1e2a59c700 1 -- 172.21.15.26:0/4268888807 learned_addr learned my addr 172.21.15.26:0/4268888807 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:35.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.239+0000 7f1e29d9b700 1 --2- 172.21.15.26:0/4268888807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e2c09e000 0x7f1e2c122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:35.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.239+0000 7f1e2a59c700 1 -- 172.21.15.26:0/4268888807 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e2c09e410 msgr2=0x7f1e2c122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:35.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.239+0000 7f1e2a59c700 1 --2- 172.21.15.26:0/4268888807 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e2c09e410 0x7f1e2c122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:35.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.239+0000 7f1e2a59c700 1 -- 172.21.15.26:0/4268888807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e2c09e000 msgr2=0x7f1e2c122900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:35.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.239+0000 7f1e2a59c700 1 --2- 172.21.15.26:0/4268888807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e2c09e000 0x7f1e2c122900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:35.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.239+0000 7f1e2a59c700 1 -- 172.21.15.26:0/4268888807 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c0094a0 con 0x7f1e2c09d6f0 2023-10-01T08:01:35.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.239+0000 7f1e2ad9d700 1 --2- 172.21.15.26:0/4268888807 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e2c09e410 0x7f1e2c122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:35.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.239+0000 7f1e2a59c700 1 --2- 172.21.15.26:0/4268888807 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e2c09d6f0 0x7f1e2c1223c0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c00ec40 tx=0x7f1e1c00ef50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:35.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.240+0000 7f1e1affd700 1 -- 172.21.15.26:0/4268888807 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c00c850 con 0x7f1e2c09d6f0 2023-10-01T08:01:35.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.240+0000 7f1e1affd700 1 -- 172.21.15.26:0/4268888807 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1c00c9b0 con 0x7f1e2c09d6f0 2023-10-01T08:01:35.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.240+0000 7f1e30d52700 1 -- 172.21.15.26:0/4268888807 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e24009a70 con 0x7f1e2c09d6f0 2023-10-01T08:01:35.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.240+0000 7f1e1affd700 1 -- 172.21.15.26:0/4268888807 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c00cd20 con 0x7f1e2c09d6f0 2023-10-01T08:01:35.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.240+0000 7f1e30d52700 1 -- 172.21.15.26:0/4268888807 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e2c1255e0 con 0x7f1e2c09d6f0 2023-10-01T08:01:35.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.241+0000 7f1e30d52700 1 -- 172.21.15.26:0/4268888807 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e2c125190 con 0x7f1e2c09d6f0 2023-10-01T08:01:35.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.241+0000 7f1e1affd700 1 -- 172.21.15.26:0/4268888807 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e1c004020 con 0x7f1e2c09d6f0 2023-10-01T08:01:35.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.241+0000 7f1e1affd700 1 -- 172.21.15.26:0/4268888807 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1e1c03fbe0 con 0x7f1e2c09d6f0 2023-10-01T08:01:35.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.246+0000 7f1e1affd700 1 -- 172.21.15.26:0/4268888807 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e1c0042d0 con 0x7f1e2c09d6f0 2023-10-01T08:01:35.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.451+0000 7f1e30d52700 1 -- 172.21.15.26:0/4268888807 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1e2c09c710 con 0x7f1e2c09d6f0 2023-10-01T08:01:35.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.451+0000 7f1e1affd700 1 -- 172.21.15.26:0/4268888807 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e1c017070 con 0x7f1e2c09d6f0 2023-10-01T08:01:35.452 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:35.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.454+0000 7f1e30d52700 1 -- 172.21.15.26:0/4268888807 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e2c09d6f0 msgr2=0x7f1e2c1223c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:35.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.454+0000 7f1e30d52700 1 --2- 172.21.15.26:0/4268888807 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e2c09d6f0 0x7f1e2c1223c0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c00ec40 tx=0x7f1e1c00ef50 comp rx=0 tx=0).stop 2023-10-01T08:01:35.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.454+0000 7f1e30d52700 1 -- 172.21.15.26:0/4268888807 shutdown_connections 2023-10-01T08:01:35.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.454+0000 7f1e30d52700 1 --2- 172.21.15.26:0/4268888807 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1e2c09e410 0x7f1e2c122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:35.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.454+0000 7f1e30d52700 1 --2- 172.21.15.26:0/4268888807 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1e2c09d6f0 0x7f1e2c1223c0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:35.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.454+0000 7f1e30d52700 1 --2- 172.21.15.26:0/4268888807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e2c09e000 0x7f1e2c122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:35.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.454+0000 7f1e30d52700 1 -- 172.21.15.26:0/4268888807 >> 172.21.15.26:0/4268888807 conn(0x7f1e2c066f50 msgr2=0x7f1e2c070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:35.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.454+0000 7f1e30d52700 1 -- 172.21.15.26:0/4268888807 shutdown_connections 2023-10-01T08:01:35.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:35.454+0000 7f1e30d52700 1 -- 172.21.15.26:0/4268888807 wait complete. 2023-10-01T08:01:35.468 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:35.911 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:35.970 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:36.013 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:36.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.059+0000 7fa509c19700 1 Processor -- start 2023-10-01T08:01:36.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.059+0000 7fa509c19700 1 -- start start 2023-10-01T08:01:36.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.059+0000 7fa509c19700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa50409d6f0 0x7fa50409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:36.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.059+0000 7fa509c19700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa50409e410 0x7fa504130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:36.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.059+0000 7fa509c19700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa50409f130 con 0x7fa50409e000 2023-10-01T08:01:36.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.059+0000 7fa509c19700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50409f520 con 0x7fa50409d6f0 2023-10-01T08:01:36.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.059+0000 7fa509c19700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa50409e930 con 0x7fa50409e410 2023-10-01T08:01:36.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.060+0000 7fa5037fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa50409d6f0 0x7fa50409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:36.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.060+0000 7fa503fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa50409e410 0x7fa504130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:36.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.060+0000 7fa5037fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa50409d6f0 0x7fa50409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44794/0 (socket says 172.21.15.26:44794) 2023-10-01T08:01:36.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.060+0000 7fa503fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa50409e410 0x7fa504130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59620/0 (socket says 172.21.15.26:59620) 2023-10-01T08:01:36.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.060+0000 7fa5037fe700 1 -- 172.21.15.26:0/338656382 learned_addr learned my addr 172.21.15.26:0/338656382 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:36.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.060+0000 7fa5037fe700 1 -- 172.21.15.26:0/338656382 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa50409e410 msgr2=0x7fa504130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:36.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.060+0000 7fa5037fe700 1 --2- 172.21.15.26:0/338656382 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa50409e410 0x7fa504130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:36.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.060+0000 7fa5027fc700 1 -- 172.21.15.26:0/338656382 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 399559137 0 0) 0x7fa50409f130 con 0x7fa50409e000 2023-10-01T08:01:36.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.060+0000 7fa5037fe700 1 -- 172.21.15.26:0/338656382 >> v1:172.21.15.26:6789/0 conn(0x7fa50409e000 legacy=0x7fa504130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:36.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.060+0000 7fa5037fe700 1 -- 172.21.15.26:0/338656382 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50409b2d0 con 0x7fa50409d6f0 2023-10-01T08:01:36.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.060+0000 7fa503fff700 1 --2- 172.21.15.26:0/338656382 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa50409e410 0x7fa504130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:36.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.060+0000 7fa5037fe700 1 --2- 172.21.15.26:0/338656382 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa50409d6f0 0x7fa50409dac0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4009950 tx=0x7fa4f4009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5185fe252206c84 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:36.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.060+0000 7fa5027fc700 1 -- 172.21.15.26:0/338656382 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4011830 con 0x7fa50409d6f0 2023-10-01T08:01:36.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.060+0000 7fa5027fc700 1 -- 172.21.15.26:0/338656382 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f4011990 con 0x7fa50409d6f0 2023-10-01T08:01:36.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.060+0000 7fa5027fc700 1 -- 172.21.15.26:0/338656382 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4011d40 con 0x7fa50409d6f0 2023-10-01T08:01:36.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.061+0000 7fa509c19700 1 -- 172.21.15.26:0/338656382 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa50409d6f0 msgr2=0x7fa50409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:36.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.061+0000 7fa509c19700 1 --2- 172.21.15.26:0/338656382 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa50409d6f0 0x7fa50409dac0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4009950 tx=0x7fa4f4009c60 comp rx=0 tx=0).stop 2023-10-01T08:01:36.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.061+0000 7fa509c19700 1 -- 172.21.15.26:0/338656382 shutdown_connections 2023-10-01T08:01:36.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.061+0000 7fa509c19700 1 --2- 172.21.15.26:0/338656382 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa50409e410 0x7fa504130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:36.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.061+0000 7fa509c19700 1 --2- 172.21.15.26:0/338656382 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa50409d6f0 0x7fa50409dac0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:36.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.061+0000 7fa509c19700 1 -- 172.21.15.26:0/338656382 >> 172.21.15.26:0/338656382 conn(0x7fa504066f50 msgr2=0x7fa50409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:36.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.061+0000 7fa509c19700 1 -- 172.21.15.26:0/338656382 shutdown_connections 2023-10-01T08:01:36.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.061+0000 7fa509c19700 1 -- 172.21.15.26:0/338656382 wait complete. 2023-10-01T08:01:36.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.062+0000 7fa509c19700 1 Processor -- start 2023-10-01T08:01:36.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.063+0000 7fa509c19700 1 -- start start 2023-10-01T08:01:36.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.063+0000 7fa509c19700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa50409d6f0 0x7fa504139940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:36.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.063+0000 7fa509c19700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa50409e000 0x7fa504139e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:36.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.063+0000 7fa509c19700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa50409e410 0x7fa50413a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:36.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.063+0000 7fa509c19700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50409c770 con 0x7fa50409e410 2023-10-01T08:01:36.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.063+0000 7fa509c19700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5041364f0 con 0x7fa50409e000 2023-10-01T08:01:36.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.063+0000 7fa509c19700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa50413ae50 con 0x7fa50409d6f0 2023-10-01T08:01:36.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.063+0000 7fa502ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa50409e000 0x7fa504139e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:36.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.063+0000 7fa502ffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa50409e000 0x7fa504139e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44804/0 (socket says 172.21.15.26:44804) 2023-10-01T08:01:36.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.063+0000 7fa502ffd700 1 -- 172.21.15.26:0/1791143864 learned_addr learned my addr 172.21.15.26:0/1791143864 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:36.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.063+0000 7fa503fff700 1 --2- 172.21.15.26:0/1791143864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa50409e410 0x7fa50413a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:36.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.063+0000 7fa5037fe700 1 --2- 172.21.15.26:0/1791143864 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa50409d6f0 0x7fa504139940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:36.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.064+0000 7fa502ffd700 1 -- 172.21.15.26:0/1791143864 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa50409d6f0 msgr2=0x7fa504139940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:36.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.064+0000 7fa502ffd700 1 --2- 172.21.15.26:0/1791143864 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa50409d6f0 0x7fa504139940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:36.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.064+0000 7fa502ffd700 1 -- 172.21.15.26:0/1791143864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa50409e410 msgr2=0x7fa50413a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:36.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.064+0000 7fa502ffd700 1 --2- 172.21.15.26:0/1791143864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa50409e410 0x7fa50413a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:36.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.064+0000 7fa502ffd700 1 -- 172.21.15.26:0/1791143864 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4fc009a70 con 0x7fa50409e000 2023-10-01T08:01:36.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.064+0000 7fa503fff700 1 --2- 172.21.15.26:0/1791143864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa50409e410 0x7fa50413a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:36.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.064+0000 7fa502ffd700 1 --2- 172.21.15.26:0/1791143864 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa50409e000 0x7fa504139e80 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fa4f800c5b0 tx=0x7fa4f800c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:36.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.064+0000 7fa4ebfff700 1 -- 172.21.15.26:0/1791143864 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f80054e0 con 0x7fa50409e000 2023-10-01T08:01:36.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.064+0000 7fa4ebfff700 1 -- 172.21.15.26:0/1791143864 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f8003680 con 0x7fa50409e000 2023-10-01T08:01:36.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.064+0000 7fa509c19700 1 -- 172.21.15.26:0/1791143864 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4f4009550 con 0x7fa50409e000 2023-10-01T08:01:36.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.064+0000 7fa4ebfff700 1 -- 172.21.15.26:0/1791143864 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f8003a30 con 0x7fa50409e000 2023-10-01T08:01:36.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.064+0000 7fa509c19700 1 -- 172.21.15.26:0/1791143864 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa504136ae0 con 0x7fa50409e000 2023-10-01T08:01:36.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.065+0000 7fa4ebfff700 1 -- 172.21.15.26:0/1791143864 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa4f8003b90 con 0x7fa50409e000 2023-10-01T08:01:36.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.065+0000 7fa4ebfff700 1 -- 172.21.15.26:0/1791143864 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa4f803e900 con 0x7fa50409e000 2023-10-01T08:01:36.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.065+0000 7fa509c19700 1 -- 172.21.15.26:0/1791143864 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa504136ae0 con 0x7fa50409e000 2023-10-01T08:01:36.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.070+0000 7fa4ebfff700 1 -- 172.21.15.26:0/1791143864 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa504136ae0 con 0x7fa50409e000 2023-10-01T08:01:36.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.115+0000 7effa83be700 1 Processor -- start 2023-10-01T08:01:36.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.115+0000 7effa83be700 1 -- start start 2023-10-01T08:01:36.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.116+0000 7effa83be700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7effa00a0a30 0x7effa00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:36.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.116+0000 7effa83be700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effa0134170 0x7effa013bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:36.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.116+0000 7effa83be700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa009edd0 con 0x7effa00a1340 2023-10-01T08:01:36.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.116+0000 7effa83be700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effa009e1f0 con 0x7effa00a0a30 2023-10-01T08:01:36.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.116+0000 7effa83be700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa009dc50 con 0x7effa0134170 2023-10-01T08:01:36.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.116+0000 7effa695b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effa0134170 0x7effa013bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:36.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.116+0000 7effa615a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7effa00a0a30 0x7effa00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:36.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.116+0000 7effa695b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effa0134170 0x7effa013bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44820/0 (socket says 172.21.15.26:44820) 2023-10-01T08:01:36.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.116+0000 7effa695b700 1 -- 172.21.15.26:0/3317549821 learned_addr learned my addr 172.21.15.26:0/3317549821 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:36.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.116+0000 7effa615a700 1 -- 172.21.15.26:0/3317549821 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effa0134170 msgr2=0x7effa013bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:36.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.116+0000 7effa615a700 1 --2- 172.21.15.26:0/3317549821 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effa0134170 0x7effa013bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:36.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.116+0000 7effa615a700 1 -- 172.21.15.26:0/3317549821 >> v1:172.21.15.26:6789/0 conn(0x7effa00a1340 legacy=0x7effa0133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:36.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.116+0000 7effa615a700 1 -- 172.21.15.26:0/3317549821 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa00a1fe0 con 0x7effa00a0a30 2023-10-01T08:01:36.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.116+0000 7effa695b700 1 --2- 172.21.15.26:0/3317549821 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effa0134170 0x7effa013bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:36.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.117+0000 7effa615a700 1 --2- 172.21.15.26:0/3317549821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effa00a0a30 0x7effa00a0e00 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7eff9c009840 tx=0x7eff9c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1d033c0f0ae82f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:36.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.117+0000 7effa5158700 1 -- 172.21.15.26:0/3317549821 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c011830 con 0x7effa00a0a30 2023-10-01T08:01:36.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.117+0000 7effa5158700 1 -- 172.21.15.26:0/3317549821 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9c011990 con 0x7effa00a0a30 2023-10-01T08:01:36.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.117+0000 7effa5158700 1 -- 172.21.15.26:0/3317549821 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c011d20 con 0x7effa00a0a30 2023-10-01T08:01:36.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.118+0000 7effa83be700 1 -- 172.21.15.26:0/3317549821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effa00a0a30 msgr2=0x7effa00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:36.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.118+0000 7effa83be700 1 --2- 172.21.15.26:0/3317549821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effa00a0a30 0x7effa00a0e00 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7eff9c009840 tx=0x7eff9c009b50 comp rx=0 tx=0).stop 2023-10-01T08:01:36.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.118+0000 7effa83be700 1 -- 172.21.15.26:0/3317549821 shutdown_connections 2023-10-01T08:01:36.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.118+0000 7effa83be700 1 --2- 172.21.15.26:0/3317549821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effa00a0a30 0x7effa00a0e00 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:36.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.118+0000 7effa83be700 1 --2- 172.21.15.26:0/3317549821 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effa0134170 0x7effa013bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:36.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.118+0000 7effa83be700 1 -- 172.21.15.26:0/3317549821 >> 172.21.15.26:0/3317549821 conn(0x7effa00a6550 msgr2=0x7effa00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:36.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.118+0000 7effa83be700 1 -- 172.21.15.26:0/3317549821 shutdown_connections 2023-10-01T08:01:36.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.118+0000 7effa83be700 1 -- 172.21.15.26:0/3317549821 wait complete. 2023-10-01T08:01:36.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.119+0000 7effa83be700 1 Processor -- start 2023-10-01T08:01:36.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.119+0000 7effa83be700 1 -- start start 2023-10-01T08:01:36.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.119+0000 7effa83be700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effa00a0a30 0x7effa01c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:36.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.120+0000 7effa83be700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effa00a1340 0x7effa01c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:36.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.120+0000 7effa83be700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effa0134170 0x7effa01c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:36.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.120+0000 7effa83be700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa01246b0 con 0x7effa00a1340 2023-10-01T08:01:36.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.120+0000 7effa83be700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa00a0220 con 0x7effa0134170 2023-10-01T08:01:36.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.120+0000 7effa83be700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effa0126190 con 0x7effa00a0a30 2023-10-01T08:01:36.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.120+0000 7effa615a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effa00a0a30 0x7effa01c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:36.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.120+0000 7effa615a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effa00a0a30 0x7effa01c8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59640/0 (socket says 172.21.15.26:59640) 2023-10-01T08:01:36.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.120+0000 7effa615a700 1 -- 172.21.15.26:0/2277835858 learned_addr learned my addr 172.21.15.26:0/2277835858 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:36.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.120+0000 7effa695b700 1 --2- 172.21.15.26:0/2277835858 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effa0134170 0x7effa01c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:36.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.120+0000 7effa5959700 1 --2- 172.21.15.26:0/2277835858 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effa00a1340 0x7effa01c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:36.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.120+0000 7effa695b700 1 -- 172.21.15.26:0/2277835858 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effa00a0a30 msgr2=0x7effa01c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:36.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.120+0000 7effa695b700 1 --2- 172.21.15.26:0/2277835858 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effa00a0a30 0x7effa01c8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:36.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.120+0000 7effa695b700 1 -- 172.21.15.26:0/2277835858 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effa00a1340 msgr2=0x7effa01c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:36.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.120+0000 7effa695b700 1 --2- 172.21.15.26:0/2277835858 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effa00a1340 0x7effa01c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:36.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.120+0000 7effa695b700 1 -- 172.21.15.26:0/2277835858 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff98009b30 con 0x7effa0134170 2023-10-01T08:01:36.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.120+0000 7effa5959700 1 --2- 172.21.15.26:0/2277835858 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effa00a1340 0x7effa01c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:36.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.122+0000 7effa615a700 1 --2- 172.21.15.26:0/2277835858 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effa00a0a30 0x7effa01c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:36.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.122+0000 7effa695b700 1 --2- 172.21.15.26:0/2277835858 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effa0134170 0x7effa01c8f00 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7eff98009e50 tx=0x7eff9800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:36.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.123+0000 7eff96ffd700 1 -- 172.21.15.26:0/2277835858 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff98018070 con 0x7effa0134170 2023-10-01T08:01:36.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.123+0000 7eff96ffd700 1 -- 172.21.15.26:0/2277835858 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9800f040 con 0x7effa0134170 2023-10-01T08:01:36.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.123+0000 7eff96ffd700 1 -- 172.21.15.26:0/2277835858 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff98003c40 con 0x7effa0134170 2023-10-01T08:01:36.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.123+0000 7effa83be700 1 -- 172.21.15.26:0/2277835858 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff9c0094a0 con 0x7effa0134170 2023-10-01T08:01:36.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.123+0000 7effa83be700 1 -- 172.21.15.26:0/2277835858 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa00a25e0 con 0x7effa0134170 2023-10-01T08:01:36.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.124+0000 7eff96ffd700 1 -- 172.21.15.26:0/2277835858 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7eff9800c880 con 0x7effa0134170 2023-10-01T08:01:36.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.124+0000 7eff96ffd700 1 -- 172.21.15.26:0/2277835858 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7eff9803f880 con 0x7effa0134170 2023-10-01T08:01:36.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.124+0000 7effa83be700 1 -- 172.21.15.26:0/2277835858 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa0074ea0 con 0x7effa0134170 2023-10-01T08:01:36.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.129+0000 7eff96ffd700 1 -- 172.21.15.26:0/2277835858 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7eff9800cb30 con 0x7effa0134170 2023-10-01T08:01:36.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.160+0000 7f628e0f1700 1 Processor -- start 2023-10-01T08:01:36.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.160+0000 7f628e0f1700 1 -- start start 2023-10-01T08:01:36.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.161+0000 7f628e0f1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f62880a0a30 0x7f62880a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:36.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.161+0000 7f628e0f1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f628809d630 0x7f62880a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:36.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.161+0000 7f628e0f1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62880a2a70 con 0x7f6288133930 2023-10-01T08:01:36.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.161+0000 7f628e0f1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62880a01d0 con 0x7f62880a0a30 2023-10-01T08:01:36.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.161+0000 7f628e0f1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f628809e2b0 con 0x7f628809d630 2023-10-01T08:01:36.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.161+0000 7f6286ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f628809d630 0x7f62880a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:36.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.161+0000 7f6286ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f628809d630 0x7f62880a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59652/0 (socket says 172.21.15.26:59652) 2023-10-01T08:01:36.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.161+0000 7f6286ffd700 1 -- 172.21.15.26:0/1633043568 learned_addr learned my addr 172.21.15.26:0/1633043568 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:36.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.161+0000 7f6287fff700 1 --1- 172.21.15.26:0/1633043568 >> v1:172.21.15.26:6789/0 conn(0x7f6288133930 0x7f6288133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44236/0 (socket says 172.21.15.26:44236) 2023-10-01T08:01:36.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.161+0000 7f62877fe700 1 --2- 172.21.15.26:0/1633043568 >> v2:172.21.15.26:3300/0 conn(0x7f62880a0a30 0x7f62880a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:36.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.161+0000 7f6286ffd700 1 -- 172.21.15.26:0/1633043568 >> v2:172.21.15.26:3300/0 conn(0x7f62880a0a30 msgr2=0x7f62880a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:36.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.161+0000 7f6286ffd700 1 --2- 172.21.15.26:0/1633043568 >> v2:172.21.15.26:3300/0 conn(0x7f62880a0a30 0x7f62880a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:36.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.161+0000 7f6286ffd700 1 -- 172.21.15.26:0/1633043568 >> v1:172.21.15.26:6789/0 conn(0x7f6288133930 legacy=0x7f6288133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:36.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.161+0000 7f6286ffd700 1 -- 172.21.15.26:0/1633043568 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f628809dc50 con 0x7f628809d630 2023-10-01T08:01:36.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.162+0000 7f6286ffd700 1 --2- 172.21.15.26:0/1633043568 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f628809d630 0x7f62880a1340 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f627c0098f0 tx=0x7f627c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be33ebaf8ca0012b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:36.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.162+0000 7f62867fc700 1 -- 172.21.15.26:0/1633043568 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627c011830 con 0x7f628809d630 2023-10-01T08:01:36.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.162+0000 7f62867fc700 1 -- 172.21.15.26:0/1633043568 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627c011990 con 0x7f628809d630 2023-10-01T08:01:36.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.162+0000 7f62867fc700 1 -- 172.21.15.26:0/1633043568 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627c011d20 con 0x7f628809d630 2023-10-01T08:01:36.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.162+0000 7f628e0f1700 1 -- 172.21.15.26:0/1633043568 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f628809d630 msgr2=0x7f62880a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:36.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.162+0000 7f628e0f1700 1 --2- 172.21.15.26:0/1633043568 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f628809d630 0x7f62880a1340 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f627c0098f0 tx=0x7f627c009c00 comp rx=0 tx=0).stop 2023-10-01T08:01:36.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.162+0000 7f628e0f1700 1 -- 172.21.15.26:0/1633043568 shutdown_connections 2023-10-01T08:01:36.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.162+0000 7f628e0f1700 1 --2- 172.21.15.26:0/1633043568 >> v2:172.21.15.26:3300/0 conn(0x7f62880a0a30 0x7f62880a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:36.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.162+0000 7f628e0f1700 1 --2- 172.21.15.26:0/1633043568 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f628809d630 0x7f62880a1340 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:36.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.162+0000 7f628e0f1700 1 -- 172.21.15.26:0/1633043568 >> 172.21.15.26:0/1633043568 conn(0x7f62880a3050 msgr2=0x7f62880a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:36.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.162+0000 7f628e0f1700 1 -- 172.21.15.26:0/1633043568 shutdown_connections 2023-10-01T08:01:36.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.162+0000 7f628e0f1700 1 -- 172.21.15.26:0/1633043568 wait complete. 2023-10-01T08:01:36.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.163+0000 7f628e0f1700 1 Processor -- start 2023-10-01T08:01:36.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.164+0000 7f628e0f1700 1 -- start start 2023-10-01T08:01:36.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.164+0000 7f628e0f1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f628809d630 0x7f6288121100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:36.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.164+0000 7f628e0f1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62880a0a30 0x7f6288121640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:36.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.164+0000 7f628e0f1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6288133930 0x7f6288121b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:36.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.164+0000 7f628e0f1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62881225b0 con 0x7f628809d630 2023-10-01T08:01:36.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.164+0000 7f628e0f1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6288124bd0 con 0x7f62880a0a30 2023-10-01T08:01:36.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.164+0000 7f628e0f1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6288124630 con 0x7f6288133930 2023-10-01T08:01:36.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.164+0000 7f6287fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6288133930 0x7f6288121b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:36.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.164+0000 7f6287fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6288133930 0x7f6288121b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59656/0 (socket says 172.21.15.26:59656) 2023-10-01T08:01:36.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.164+0000 7f6287fff700 1 -- 172.21.15.26:0/1720378003 learned_addr learned my addr 172.21.15.26:0/1720378003 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:36.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.164+0000 7f62877fe700 1 --2- 172.21.15.26:0/1720378003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f628809d630 0x7f6288121100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:36.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.164+0000 7f6286ffd700 1 --2- 172.21.15.26:0/1720378003 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62880a0a30 0x7f6288121640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:36.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.165+0000 7f62877fe700 1 -- 172.21.15.26:0/1720378003 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6288133930 msgr2=0x7f6288121b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:36.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.165+0000 7f62877fe700 1 --2- 172.21.15.26:0/1720378003 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6288133930 0x7f6288121b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:36.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.165+0000 7f62877fe700 1 -- 172.21.15.26:0/1720378003 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62880a0a30 msgr2=0x7f6288121640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:36.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.165+0000 7f62877fe700 1 --2- 172.21.15.26:0/1720378003 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62880a0a30 0x7f6288121640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:36.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.165+0000 7f62877fe700 1 -- 172.21.15.26:0/1720378003 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627c009550 con 0x7f628809d630 2023-10-01T08:01:36.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.165+0000 7f6287fff700 1 --2- 172.21.15.26:0/1720378003 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6288133930 0x7f6288121b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:36.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.165+0000 7f62877fe700 1 --2- 172.21.15.26:0/1720378003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f628809d630 0x7f6288121100 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f627800e900 tx=0x7f627800ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:36.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.165+0000 7f626ffff700 1 -- 172.21.15.26:0/1720378003 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6278013680 con 0x7f628809d630 2023-10-01T08:01:36.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.165+0000 7f626ffff700 1 -- 172.21.15.26:0/1720378003 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62780137e0 con 0x7f628809d630 2023-10-01T08:01:36.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.165+0000 7f628e0f1700 1 -- 172.21.15.26:0/1720378003 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6288122dc0 con 0x7f628809d630 2023-10-01T08:01:36.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.165+0000 7f626ffff700 1 -- 172.21.15.26:0/1720378003 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6278013b50 con 0x7f628809d630 2023-10-01T08:01:36.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.165+0000 7f628e0f1700 1 -- 172.21.15.26:0/1720378003 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6288123ac0 con 0x7f628809d630 2023-10-01T08:01:36.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.166+0000 7f626ffff700 1 -- 172.21.15.26:0/1720378003 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6278013cb0 con 0x7f628809d630 2023-10-01T08:01:36.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.166+0000 7f628e0f1700 1 -- 172.21.15.26:0/1720378003 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f628811df60 con 0x7f628809d630 2023-10-01T08:01:36.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.167+0000 7f626ffff700 1 -- 172.21.15.26:0/1720378003 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f627803f7a0 con 0x7f628809d630 2023-10-01T08:01:36.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.172+0000 7f626ffff700 1 -- 172.21.15.26:0/1720378003 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f627801ab90 con 0x7f628809d630 2023-10-01T08:01:36.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.284+0000 7fa509c19700 1 -- 172.21.15.26:0/1791143864 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa504136ae0 con 0x7fa50409e000 2023-10-01T08:01:36.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.284+0000 7fa4ebfff700 1 -- 172.21.15.26:0/1791143864 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa504136ae0 con 0x7fa50409e000 2023-10-01T08:01:36.285 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:36.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.286+0000 7fa509c19700 1 -- 172.21.15.26:0/1791143864 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa50409e000 msgr2=0x7fa504139e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:36.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.286+0000 7fa509c19700 1 --2- 172.21.15.26:0/1791143864 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa50409e000 0x7fa504139e80 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fa4f800c5b0 tx=0x7fa4f800c8c0 comp rx=0 tx=0).stop 2023-10-01T08:01:36.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.286+0000 7fa509c19700 1 -- 172.21.15.26:0/1791143864 shutdown_connections 2023-10-01T08:01:36.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.286+0000 7fa509c19700 1 --2- 172.21.15.26:0/1791143864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa50409e410 0x7fa50413a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:36.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.286+0000 7fa509c19700 1 --2- 172.21.15.26:0/1791143864 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa50409d6f0 0x7fa504139940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:36.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.286+0000 7fa509c19700 1 --2- 172.21.15.26:0/1791143864 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa50409e000 0x7fa504139e80 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:36.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.286+0000 7fa509c19700 1 -- 172.21.15.26:0/1791143864 >> 172.21.15.26:0/1791143864 conn(0x7fa504066f50 msgr2=0x7fa504070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:36.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.286+0000 7fa509c19700 1 -- 172.21.15.26:0/1791143864 shutdown_connections 2023-10-01T08:01:36.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.286+0000 7fa509c19700 1 -- 172.21.15.26:0/1791143864 wait complete. 2023-10-01T08:01:36.301 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:36.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.339+0000 7effa83be700 1 -- 172.21.15.26:0/2277835858 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7effa00a28e0 con 0x7effa0134170 2023-10-01T08:01:36.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.339+0000 7eff96ffd700 1 -- 172.21.15.26:0/2277835858 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7eff9802c090 con 0x7effa0134170 2023-10-01T08:01:36.340 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:36.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.341+0000 7effa83be700 1 -- 172.21.15.26:0/2277835858 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effa0134170 msgr2=0x7effa01c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:36.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.341+0000 7effa83be700 1 --2- 172.21.15.26:0/2277835858 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effa0134170 0x7effa01c8f00 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7eff98009e50 tx=0x7eff9800c3a0 comp rx=0 tx=0).stop 2023-10-01T08:01:36.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.342+0000 7effa83be700 1 -- 172.21.15.26:0/2277835858 shutdown_connections 2023-10-01T08:01:36.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.342+0000 7effa83be700 1 --2- 172.21.15.26:0/2277835858 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effa0134170 0x7effa01c8f00 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:36.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.342+0000 7effa83be700 1 --2- 172.21.15.26:0/2277835858 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7effa00a0a30 0x7effa01c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:36.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.342+0000 7effa83be700 1 --2- 172.21.15.26:0/2277835858 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effa00a1340 0x7effa01c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:36.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.342+0000 7effa83be700 1 -- 172.21.15.26:0/2277835858 >> 172.21.15.26:0/2277835858 conn(0x7effa00a6550 msgr2=0x7effa011c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:36.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.342+0000 7effa83be700 1 -- 172.21.15.26:0/2277835858 shutdown_connections 2023-10-01T08:01:36.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.342+0000 7effa83be700 1 -- 172.21.15.26:0/2277835858 wait complete. 2023-10-01T08:01:36.356 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:36.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.378+0000 7f628e0f1700 1 -- 172.21.15.26:0/1720378003 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6288124850 con 0x7f628809d630 2023-10-01T08:01:36.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.379+0000 7f626ffff700 1 -- 172.21.15.26:0/1720378003 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6288124850 con 0x7f628809d630 2023-10-01T08:01:36.379 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:36.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.381+0000 7f628e0f1700 1 -- 172.21.15.26:0/1720378003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f628809d630 msgr2=0x7f6288121100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:36.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.381+0000 7f628e0f1700 1 --2- 172.21.15.26:0/1720378003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f628809d630 0x7f6288121100 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f627800e900 tx=0x7f627800ec10 comp rx=0 tx=0).stop 2023-10-01T08:01:36.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.381+0000 7f628e0f1700 1 -- 172.21.15.26:0/1720378003 shutdown_connections 2023-10-01T08:01:36.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.381+0000 7f628e0f1700 1 --2- 172.21.15.26:0/1720378003 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6288133930 0x7f6288121b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:36.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.381+0000 7f628e0f1700 1 --2- 172.21.15.26:0/1720378003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f628809d630 0x7f6288121100 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:36.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.381+0000 7f628e0f1700 1 --2- 172.21.15.26:0/1720378003 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62880a0a30 0x7f6288121640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:36.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.381+0000 7f628e0f1700 1 -- 172.21.15.26:0/1720378003 >> 172.21.15.26:0/1720378003 conn(0x7f62880a3050 msgr2=0x7f6288133210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:36.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.381+0000 7f628e0f1700 1 -- 172.21.15.26:0/1720378003 shutdown_connections 2023-10-01T08:01:36.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.381+0000 7f628e0f1700 1 -- 172.21.15.26:0/1720378003 wait complete. 2023-10-01T08:01:36.395 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:36.469 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:36.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.609+0000 7f8d4c5cd700 1 Processor -- start 2023-10-01T08:01:36.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.609+0000 7f8d4c5cd700 1 -- start start 2023-10-01T08:01:36.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.609+0000 7f8d4c5cd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d4409e1d0 0x7f8d44135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:36.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.609+0000 7f8d4c5cd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d44135e50 0x7f8d44138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:36.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.609+0000 7f8d4c5cd700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d4409f130 con 0x7f8d4409d6f0 2023-10-01T08:01:36.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.609+0000 7f8d4c5cd700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4409f520 con 0x7f8d44135e50 2023-10-01T08:01:36.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.609+0000 7f8d4c5cd700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4409e930 con 0x7f8d4409e1d0 2023-10-01T08:01:36.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.609+0000 7f8d49b68700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d4409e1d0 0x7f8d44135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:36.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.609+0000 7f8d4a369700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8d4409d6f0 0x7f8d4409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44246/0 (socket says 172.21.15.26:44246) 2023-10-01T08:01:36.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.610+0000 7f8d4a369700 1 -- 172.21.15.26:0/2816024981 learned_addr learned my addr 172.21.15.26:0/2816024981 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:01:36.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.609+0000 7f8d4ab6a700 1 --2- 172.21.15.26:0/2816024981 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d44135e50 0x7f8d44138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:36.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.610+0000 7f8d49367700 1 -- 172.21.15.26:0/2816024981 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3904818989 0 0) 0x7f8d4409f130 con 0x7f8d4409d6f0 2023-10-01T08:01:36.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.610+0000 7f8d49367700 1 -- 172.21.15.26:0/2816024981 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d300035b0 con 0x7f8d4409d6f0 2023-10-01T08:01:36.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.610+0000 7f8d4ab6a700 1 -- 172.21.15.26:0/2816024981 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d4409e1d0 msgr2=0x7f8d44135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:36.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.610+0000 7f8d4ab6a700 1 --2- 172.21.15.26:0/2816024981 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d4409e1d0 0x7f8d44135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:36.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.610+0000 7f8d4ab6a700 1 -- 172.21.15.26:0/2816024981 >> v1:172.21.15.26:6789/0 conn(0x7f8d4409d6f0 legacy=0x7f8d4409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:36.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.610+0000 7f8d4ab6a700 1 -- 172.21.15.26:0/2816024981 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d4409b2d0 con 0x7f8d44135e50 2023-10-01T08:01:36.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.610+0000 7f8d49b68700 1 --2- 172.21.15.26:0/2816024981 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d4409e1d0 0x7f8d44135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:36.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.610+0000 7f8d4ab6a700 1 --2- 172.21.15.26:0/2816024981 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d44135e50 0x7f8d44138230 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c009dc0 tx=0x7f8d3c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7a99a81e11affc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:36.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.610+0000 7f8d49367700 1 -- 172.21.15.26:0/2816024981 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c00e070 con 0x7f8d44135e50 2023-10-01T08:01:36.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.610+0000 7f8d49367700 1 -- 172.21.15.26:0/2816024981 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3c00bb20 con 0x7f8d44135e50 2023-10-01T08:01:36.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.610+0000 7f8d49367700 1 -- 172.21.15.26:0/2816024981 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c012430 con 0x7f8d44135e50 2023-10-01T08:01:36.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.611+0000 7f8d4c5cd700 1 -- 172.21.15.26:0/2816024981 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d44135e50 msgr2=0x7f8d44138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:36.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.611+0000 7f8d4c5cd700 1 --2- 172.21.15.26:0/2816024981 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d44135e50 0x7f8d44138230 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c009dc0 tx=0x7f8d3c00b330 comp rx=0 tx=0).stop 2023-10-01T08:01:36.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.611+0000 7f8d4c5cd700 1 -- 172.21.15.26:0/2816024981 shutdown_connections 2023-10-01T08:01:36.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.611+0000 7f8d4c5cd700 1 --2- 172.21.15.26:0/2816024981 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d44135e50 0x7f8d44138230 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:36.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.611+0000 7f8d4c5cd700 1 --2- 172.21.15.26:0/2816024981 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d4409e1d0 0x7f8d44135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:36.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.611+0000 7f8d4c5cd700 1 -- 172.21.15.26:0/2816024981 >> 172.21.15.26:0/2816024981 conn(0x7f8d44066f50 msgr2=0x7f8d4409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:36.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.611+0000 7f8d4c5cd700 1 -- 172.21.15.26:0/2816024981 shutdown_connections 2023-10-01T08:01:36.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.611+0000 7f8d4c5cd700 1 -- 172.21.15.26:0/2816024981 wait complete. 2023-10-01T08:01:36.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.612+0000 7f8d4c5cd700 1 Processor -- start 2023-10-01T08:01:36.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.612+0000 7f8d4c5cd700 1 -- start start 2023-10-01T08:01:36.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.612+0000 7f8d4c5cd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d4409d6f0 0x7f8d441c8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:36.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.612+0000 7f8d4c5cd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d4409e1d0 0x7f8d441c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:36.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.612+0000 7f8d4c5cd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d44135e50 0x7f8d441c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:36.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.612+0000 7f8d4c5cd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d44070480 con 0x7f8d4409e1d0 2023-10-01T08:01:36.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.612+0000 7f8d4c5cd700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d44122e50 con 0x7f8d44135e50 2023-10-01T08:01:36.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.612+0000 7f8d4c5cd700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d441230c0 con 0x7f8d4409d6f0 2023-10-01T08:01:36.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.613+0000 7f8d4a369700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d4409d6f0 0x7f8d441c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:36.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.613+0000 7f8d4ab6a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d44135e50 0x7f8d441c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:36.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.613+0000 7f8d4ab6a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d44135e50 0x7f8d441c8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44858/0 (socket says 172.21.15.26:44858) 2023-10-01T08:01:36.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.613+0000 7f8d4a369700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d4409d6f0 0x7f8d441c8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59686/0 (socket says 172.21.15.26:59686) 2023-10-01T08:01:36.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.613+0000 7f8d4ab6a700 1 -- 172.21.15.26:0/3914703700 learned_addr learned my addr 172.21.15.26:0/3914703700 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:36.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.613+0000 7f8d49b68700 1 --2- 172.21.15.26:0/3914703700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d4409e1d0 0x7f8d441c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:36.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.613+0000 7f8d4ab6a700 1 -- 172.21.15.26:0/3914703700 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d4409d6f0 msgr2=0x7f8d441c8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:36.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.613+0000 7f8d4ab6a700 1 --2- 172.21.15.26:0/3914703700 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d4409d6f0 0x7f8d441c8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:36.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.613+0000 7f8d4ab6a700 1 -- 172.21.15.26:0/3914703700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d4409e1d0 msgr2=0x7f8d441c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:36.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.613+0000 7f8d4ab6a700 1 --2- 172.21.15.26:0/3914703700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d4409e1d0 0x7f8d441c85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:36.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.613+0000 7f8d4ab6a700 1 -- 172.21.15.26:0/3914703700 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d380094a0 con 0x7f8d44135e50 2023-10-01T08:01:36.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.613+0000 7f8d4ab6a700 1 --2- 172.21.15.26:0/3914703700 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d44135e50 0x7f8d441c8af0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c014040 tx=0x7f8d3c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:36.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.613+0000 7f8d36ffd700 1 -- 172.21.15.26:0/3914703700 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c004800 con 0x7f8d44135e50 2023-10-01T08:01:36.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.613+0000 7f8d36ffd700 1 -- 172.21.15.26:0/3914703700 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3c020070 con 0x7f8d44135e50 2023-10-01T08:01:36.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.613+0000 7f8d4c5cd700 1 -- 172.21.15.26:0/3914703700 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d3c009a70 con 0x7f8d44135e50 2023-10-01T08:01:36.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.613+0000 7f8d36ffd700 1 -- 172.21.15.26:0/3914703700 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c0276c0 con 0x7f8d44135e50 2023-10-01T08:01:36.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.613+0000 7f8d4c5cd700 1 -- 172.21.15.26:0/3914703700 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d4409c700 con 0x7f8d44135e50 2023-10-01T08:01:36.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.614+0000 7f8d36ffd700 1 -- 172.21.15.26:0/3914703700 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8d3c012430 con 0x7f8d44135e50 2023-10-01T08:01:36.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.614+0000 7f8d36ffd700 1 -- 172.21.15.26:0/3914703700 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8d3c022070 con 0x7f8d44135e50 2023-10-01T08:01:36.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.614+0000 7f8d4c5cd700 1 -- 172.21.15.26:0/3914703700 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d44122a80 con 0x7f8d44135e50 2023-10-01T08:01:36.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.619+0000 7f8d36ffd700 1 -- 172.21.15.26:0/3914703700 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8d3c01c400 con 0x7f8d44135e50 2023-10-01T08:01:36.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.823+0000 7f8d4c5cd700 1 -- 172.21.15.26:0/3914703700 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8d44074ea0 con 0x7f8d44135e50 2023-10-01T08:01:36.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.823+0000 7f8d36ffd700 1 -- 172.21.15.26:0/3914703700 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8d3c02f390 con 0x7f8d44135e50 2023-10-01T08:01:36.824 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:36.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.826+0000 7f8d4c5cd700 1 -- 172.21.15.26:0/3914703700 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d44135e50 msgr2=0x7f8d441c8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:36.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.826+0000 7f8d4c5cd700 1 --2- 172.21.15.26:0/3914703700 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d44135e50 0x7f8d441c8af0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c014040 tx=0x7f8d3c004ad0 comp rx=0 tx=0).stop 2023-10-01T08:01:36.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.826+0000 7f8d4c5cd700 1 -- 172.21.15.26:0/3914703700 shutdown_connections 2023-10-01T08:01:36.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.826+0000 7f8d4c5cd700 1 --2- 172.21.15.26:0/3914703700 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d44135e50 0x7f8d441c8af0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:36.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.826+0000 7f8d4c5cd700 1 --2- 172.21.15.26:0/3914703700 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8d4409d6f0 0x7f8d441c8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:36.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.826+0000 7f8d4c5cd700 1 --2- 172.21.15.26:0/3914703700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d4409e1d0 0x7f8d441c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:36.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.826+0000 7f8d4c5cd700 1 -- 172.21.15.26:0/3914703700 >> 172.21.15.26:0/3914703700 conn(0x7f8d44066f50 msgr2=0x7f8d44071110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:36.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.826+0000 7f8d4c5cd700 1 -- 172.21.15.26:0/3914703700 shutdown_connections 2023-10-01T08:01:36.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:36.826+0000 7f8d4c5cd700 1 -- 172.21.15.26:0/3914703700 wait complete. 2023-10-01T08:01:36.840 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:37.302 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:37.357 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:37.395 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:37.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.450+0000 7f1d74e9d700 1 Processor -- start 2023-10-01T08:01:37.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.451+0000 7f1d74e9d700 1 -- start start 2023-10-01T08:01:37.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.451+0000 7f1d74e9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1d7009e1d0 0x7f1d70138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:37.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.451+0000 7f1d74e9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d70139170 0x7f1d7013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:37.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.451+0000 7f1d74e9d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d7009b120 con 0x7f1d7009d6f0 2023-10-01T08:01:37.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.451+0000 7f1d74e9d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d7006b460 con 0x7f1d7009e1d0 2023-10-01T08:01:37.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.451+0000 7f1d74e9d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7009a7e0 con 0x7f1d70139170 2023-10-01T08:01:37.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.451+0000 7f1d6ed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d70139170 0x7f1d7013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:37.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.452+0000 7f1d6ed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d70139170 0x7f1d7013b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44864/0 (socket says 172.21.15.26:44864) 2023-10-01T08:01:37.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.452+0000 7f1d6ed9d700 1 -- 172.21.15.26:0/1129962484 learned_addr learned my addr 172.21.15.26:0/1129962484 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:37.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.452+0000 7f1d6dd9b700 1 --2- 172.21.15.26:0/1129962484 >> v2:172.21.15.26:3300/0 conn(0x7f1d7009e1d0 0x7f1d70138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:37.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.452+0000 7f1d6ed9d700 1 -- 172.21.15.26:0/1129962484 >> v2:172.21.15.26:3300/0 conn(0x7f1d7009e1d0 msgr2=0x7f1d70138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:37.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.452+0000 7f1d6ed9d700 1 --2- 172.21.15.26:0/1129962484 >> v2:172.21.15.26:3300/0 conn(0x7f1d7009e1d0 0x7f1d70138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:37.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.452+0000 7f1d6ed9d700 1 -- 172.21.15.26:0/1129962484 >> v1:172.21.15.26:6789/0 conn(0x7f1d7009d6f0 legacy=0x7f1d7009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:37.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.452+0000 7f1d6ed9d700 1 -- 172.21.15.26:0/1129962484 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7009a500 con 0x7f1d70139170 2023-10-01T08:01:37.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.452+0000 7f1d6ed9d700 1 --2- 172.21.15.26:0/1129962484 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d70139170 0x7f1d7013b550 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f1d68009e80 tx=0x7f1d6800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d315f8764281dec4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:37.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.452+0000 7f1d6d59a700 1 -- 172.21.15.26:0/1129962484 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6800e070 con 0x7f1d70139170 2023-10-01T08:01:37.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.452+0000 7f1d6d59a700 1 -- 172.21.15.26:0/1129962484 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6800b8d0 con 0x7f1d70139170 2023-10-01T08:01:37.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.452+0000 7f1d6d59a700 1 -- 172.21.15.26:0/1129962484 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6800bc80 con 0x7f1d70139170 2023-10-01T08:01:37.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.453+0000 7f1d74e9d700 1 -- 172.21.15.26:0/1129962484 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d70139170 msgr2=0x7f1d7013b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:37.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.453+0000 7f1d74e9d700 1 --2- 172.21.15.26:0/1129962484 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d70139170 0x7f1d7013b550 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f1d68009e80 tx=0x7f1d6800b330 comp rx=0 tx=0).stop 2023-10-01T08:01:37.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.453+0000 7f1d74e9d700 1 -- 172.21.15.26:0/1129962484 shutdown_connections 2023-10-01T08:01:37.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.453+0000 7f1d74e9d700 1 --2- 172.21.15.26:0/1129962484 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d70139170 0x7f1d7013b550 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:37.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.453+0000 7f1d74e9d700 1 --2- 172.21.15.26:0/1129962484 >> v2:172.21.15.26:3300/0 conn(0x7f1d7009e1d0 0x7f1d70138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:37.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.453+0000 7f1d74e9d700 1 -- 172.21.15.26:0/1129962484 >> 172.21.15.26:0/1129962484 conn(0x7f1d70066f50 msgr2=0x7f1d7009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:37.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.453+0000 7f1d74e9d700 1 -- 172.21.15.26:0/1129962484 shutdown_connections 2023-10-01T08:01:37.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.453+0000 7f1d74e9d700 1 -- 172.21.15.26:0/1129962484 wait complete. 2023-10-01T08:01:37.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.454+0000 7f1d74e9d700 1 Processor -- start 2023-10-01T08:01:37.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.454+0000 7f1d74e9d700 1 -- start start 2023-10-01T08:01:37.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.455+0000 7f1d74e9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d7009d6f0 0x7f1d7011e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:37.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.455+0000 7f1d74e9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1d7009e1d0 0x7f1d7011ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:37.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.455+0000 7f1d74e9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d70139170 0x7f1d7011f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:37.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.455+0000 7f1d74e9d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d70134370 con 0x7f1d70139170 2023-10-01T08:01:37.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.455+0000 7f1d74e9d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d70121dc0 con 0x7f1d7009d6f0 2023-10-01T08:01:37.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.455+0000 7f1d74e9d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d70072070 con 0x7f1d7009e1d0 2023-10-01T08:01:37.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.455+0000 7f1d6dd9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1d7009e1d0 0x7f1d7011ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:37.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.455+0000 7f1d6dd9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1d7009e1d0 0x7f1d7011ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59696/0 (socket says 172.21.15.26:59696) 2023-10-01T08:01:37.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.455+0000 7f1d6ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d70139170 0x7f1d7011f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:37.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.455+0000 7f1d6dd9b700 1 -- 172.21.15.26:0/601100934 learned_addr learned my addr 172.21.15.26:0/601100934 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:37.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.455+0000 7f1d6e59c700 1 --2- 172.21.15.26:0/601100934 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d7009d6f0 0x7f1d7011e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:37.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.455+0000 7f1d6dd9b700 1 -- 172.21.15.26:0/601100934 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d7009d6f0 msgr2=0x7f1d7011e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:37.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.456+0000 7f1d6dd9b700 1 --2- 172.21.15.26:0/601100934 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d7009d6f0 0x7f1d7011e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:37.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.456+0000 7f1d6dd9b700 1 -- 172.21.15.26:0/601100934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d70139170 msgr2=0x7f1d7011f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:37.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.456+0000 7f1d6dd9b700 1 --2- 172.21.15.26:0/601100934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d70139170 0x7f1d7011f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:37.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.456+0000 7f1d6dd9b700 1 -- 172.21.15.26:0/601100934 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d68009b30 con 0x7f1d7009e1d0 2023-10-01T08:01:37.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.456+0000 7f1d6ed9d700 1 --2- 172.21.15.26:0/601100934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d70139170 0x7f1d7011f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:37.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.456+0000 7f1d6e59c700 1 --2- 172.21.15.26:0/601100934 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d7009d6f0 0x7f1d7011e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:37.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.456+0000 7f1d6dd9b700 1 --2- 172.21.15.26:0/601100934 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1d7009e1d0 0x7f1d7011ee20 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f1d6400e9b0 tx=0x7f1d6400ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:37.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.456+0000 7f1d5effd700 1 -- 172.21.15.26:0/601100934 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d64009710 con 0x7f1d7009e1d0 2023-10-01T08:01:37.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.456+0000 7f1d5effd700 1 -- 172.21.15.26:0/601100934 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6400ee50 con 0x7f1d7009e1d0 2023-10-01T08:01:37.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.456+0000 7f1d5effd700 1 -- 172.21.15.26:0/601100934 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6400ca50 con 0x7f1d7009e1d0 2023-10-01T08:01:37.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.456+0000 7f1d74e9d700 1 -- 172.21.15.26:0/601100934 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d7009c710 con 0x7f1d7009e1d0 2023-10-01T08:01:37.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.456+0000 7f1d74e9d700 1 -- 172.21.15.26:0/601100934 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d70134730 con 0x7f1d7009e1d0 2023-10-01T08:01:37.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.457+0000 7f1d5effd700 1 -- 172.21.15.26:0/601100934 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1d6400cbb0 con 0x7f1d7009e1d0 2023-10-01T08:01:37.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.457+0000 7f1d5effd700 1 -- 172.21.15.26:0/601100934 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1d6403fab0 con 0x7f1d7009e1d0 2023-10-01T08:01:37.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.457+0000 7f1d74e9d700 1 -- 172.21.15.26:0/601100934 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d70122160 con 0x7f1d7009e1d0 2023-10-01T08:01:37.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.463+0000 7f1d5effd700 1 -- 172.21.15.26:0/601100934 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1d6401b3b0 con 0x7f1d7009e1d0 2023-10-01T08:01:37.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.520+0000 7f7389447700 1 Processor -- start 2023-10-01T08:01:37.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.520+0000 7f7389447700 1 -- start start 2023-10-01T08:01:37.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.521+0000 7f7389447700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7384130540 0x7f7384130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:37.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.521+0000 7f7389447700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7384130e50 0x7f738406f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:37.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.521+0000 7f7389447700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73840716a0 con 0x7f738406fb20 2023-10-01T08:01:37.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.521+0000 7f7389447700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f738409a390 con 0x7f7384130540 2023-10-01T08:01:37.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.521+0000 7f7389447700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7384071290 con 0x7f7384130e50 2023-10-01T08:01:37.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.521+0000 7f73827fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7384130e50 0x7f738406f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:37.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.521+0000 7f73827fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7384130e50 0x7f738406f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44882/0 (socket says 172.21.15.26:44882) 2023-10-01T08:01:37.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.521+0000 7f73827fc700 1 -- 172.21.15.26:0/1072093434 learned_addr learned my addr 172.21.15.26:0/1072093434 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:37.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.521+0000 7f7382ffd700 1 --2- 172.21.15.26:0/1072093434 >> v2:172.21.15.26:3300/0 conn(0x7f7384130540 0x7f7384130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:37.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.521+0000 7f73827fc700 1 -- 172.21.15.26:0/1072093434 >> v2:172.21.15.26:3300/0 conn(0x7f7384130540 msgr2=0x7f7384130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:37.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.521+0000 7f73827fc700 1 --2- 172.21.15.26:0/1072093434 >> v2:172.21.15.26:3300/0 conn(0x7f7384130540 0x7f7384130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:37.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.521+0000 7f73827fc700 1 -- 172.21.15.26:0/1072093434 >> v1:172.21.15.26:6789/0 conn(0x7f738406fb20 legacy=0x7f7384137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:37.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.521+0000 7f73827fc700 1 -- 172.21.15.26:0/1072093434 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7384130340 con 0x7f7384130e50 2023-10-01T08:01:37.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.522+0000 7f73827fc700 1 --2- 172.21.15.26:0/1072093434 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7384130e50 0x7f738406f5e0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f7378009920 tx=0x7f7378009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48aa103387745a85 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:37.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.522+0000 7f7381ffb700 1 -- 172.21.15.26:0/1072093434 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7378011830 con 0x7f7384130e50 2023-10-01T08:01:37.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.522+0000 7f7381ffb700 1 -- 172.21.15.26:0/1072093434 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7378011990 con 0x7f7384130e50 2023-10-01T08:01:37.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.522+0000 7f7381ffb700 1 -- 172.21.15.26:0/1072093434 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7378011d20 con 0x7f7384130e50 2023-10-01T08:01:37.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.523+0000 7f7389447700 1 -- 172.21.15.26:0/1072093434 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7384130e50 msgr2=0x7f738406f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:37.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.523+0000 7f7389447700 1 --2- 172.21.15.26:0/1072093434 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7384130e50 0x7f738406f5e0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f7378009920 tx=0x7f7378009c30 comp rx=0 tx=0).stop 2023-10-01T08:01:37.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.523+0000 7f7389447700 1 -- 172.21.15.26:0/1072093434 shutdown_connections 2023-10-01T08:01:37.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.523+0000 7f7389447700 1 --2- 172.21.15.26:0/1072093434 >> v2:172.21.15.26:3300/0 conn(0x7f7384130540 0x7f7384130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:37.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.523+0000 7f7389447700 1 --2- 172.21.15.26:0/1072093434 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7384130e50 0x7f738406f5e0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:37.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.523+0000 7f7389447700 1 -- 172.21.15.26:0/1072093434 >> 172.21.15.26:0/1072093434 conn(0x7f73840a2aa0 msgr2=0x7f73840a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:37.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.523+0000 7f7389447700 1 -- 172.21.15.26:0/1072093434 shutdown_connections 2023-10-01T08:01:37.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.523+0000 7f7389447700 1 -- 172.21.15.26:0/1072093434 wait complete. 2023-10-01T08:01:37.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.524+0000 7f7389447700 1 Processor -- start 2023-10-01T08:01:37.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.524+0000 7f7389447700 1 -- start start 2023-10-01T08:01:37.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.525+0000 7f7389447700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f738406fb20 0x7f738411a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:37.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.525+0000 7f7389447700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7384130540 0x7f738411ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:37.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.525+0000 7f7389447700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7384130e50 0x7f738411b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:37.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.525+0000 7f7389447700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738411e110 con 0x7f7384130e50 2023-10-01T08:01:37.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.525+0000 7f7389447700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f738411d4c0 con 0x7f7384130540 2023-10-01T08:01:37.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.525+0000 7f7389447700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f738411c2a0 con 0x7f738406fb20 2023-10-01T08:01:37.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.525+0000 7f73827fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7384130540 0x7f738411ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:37.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.525+0000 7f73827fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7384130540 0x7f738411ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44884/0 (socket says 172.21.15.26:44884) 2023-10-01T08:01:37.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.525+0000 7f73827fc700 1 -- 172.21.15.26:0/3957217480 learned_addr learned my addr 172.21.15.26:0/3957217480 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:37.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.525+0000 7f73837fe700 1 --2- 172.21.15.26:0/3957217480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7384130e50 0x7f738411b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:37.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.526+0000 7f73827fc700 1 -- 172.21.15.26:0/3957217480 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f738406fb20 msgr2=0x7f738411a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:37.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.526+0000 7f73827fc700 1 --2- 172.21.15.26:0/3957217480 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f738406fb20 0x7f738411a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:37.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.526+0000 7f73827fc700 1 -- 172.21.15.26:0/3957217480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7384130e50 msgr2=0x7f738411b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:37.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.526+0000 7f73827fc700 1 --2- 172.21.15.26:0/3957217480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7384130e50 0x7f738411b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:37.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.526+0000 7f73827fc700 1 -- 172.21.15.26:0/3957217480 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7378009550 con 0x7f7384130540 2023-10-01T08:01:37.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.526+0000 7f73827fc700 1 --2- 172.21.15.26:0/3957217480 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7384130540 0x7f738411ab30 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f7378009870 tx=0x7f7378004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:37.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.526+0000 7f736b7fe700 1 -- 172.21.15.26:0/3957217480 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7378004590 con 0x7f7384130540 2023-10-01T08:01:37.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.526+0000 7f736b7fe700 1 -- 172.21.15.26:0/3957217480 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73780036a0 con 0x7f7384130540 2023-10-01T08:01:37.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.526+0000 7f7389447700 1 -- 172.21.15.26:0/3957217480 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73840a0b50 con 0x7f7384130540 2023-10-01T08:01:37.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.526+0000 7f736b7fe700 1 -- 172.21.15.26:0/3957217480 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7378003a50 con 0x7f7384130540 2023-10-01T08:01:37.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.526+0000 7f7389447700 1 -- 172.21.15.26:0/3957217480 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f738411e610 con 0x7f7384130540 2023-10-01T08:01:37.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.528+0000 7f7389447700 1 -- 172.21.15.26:0/3957217480 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f738409cd40 con 0x7f7384130540 2023-10-01T08:01:37.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.528+0000 7f736b7fe700 1 -- 172.21.15.26:0/3957217480 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7378003bb0 con 0x7f7384130540 2023-10-01T08:01:37.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.528+0000 7f736b7fe700 1 -- 172.21.15.26:0/3957217480 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7378040ab0 con 0x7f7384130540 2023-10-01T08:01:37.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.537+0000 7f736b7fe700 1 -- 172.21.15.26:0/3957217480 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f737801a420 con 0x7f7384130540 2023-10-01T08:01:37.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.546+0000 7ff1edceb700 1 Processor -- start 2023-10-01T08:01:37.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.546+0000 7ff1edceb700 1 -- start start 2023-10-01T08:01:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.546+0000 7ff1edceb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff1e80a0a30 0x7ff1e80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.546+0000 7ff1edceb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1e80a1340 0x7ff1e8133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.546+0000 7ff1edceb700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e809edd0 con 0x7ff1e8133fa0 2023-10-01T08:01:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.546+0000 7ff1edceb700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1e809e1f0 con 0x7ff1e80a0a30 2023-10-01T08:01:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.546+0000 7ff1edceb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e809dc50 con 0x7ff1e80a1340 2023-10-01T08:01:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.547+0000 7ff1e77fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff1e80a0a30 0x7ff1e80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.547+0000 7ff1e6ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1e80a1340 0x7ff1e8133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.547+0000 7ff1e77fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff1e80a0a30 0x7ff1e80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44212/0 (socket says 172.21.15.26:44212) 2023-10-01T08:01:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.547+0000 7ff1e77fe700 1 -- 172.21.15.26:0/2848280312 learned_addr learned my addr 172.21.15.26:0/2848280312 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.547+0000 7ff1e6ffd700 1 --2- 172.21.15.26:0/2848280312 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1e80a1340 0x7ff1e8133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59708/0 (socket says 172.21.15.26:59708) 2023-10-01T08:01:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.547+0000 7ff1e77fe700 1 -- 172.21.15.26:0/2848280312 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1e80a1340 msgr2=0x7ff1e8133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:37.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.547+0000 7ff1e77fe700 1 --2- 172.21.15.26:0/2848280312 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1e80a1340 0x7ff1e8133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:37.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.547+0000 7ff1e77fe700 1 -- 172.21.15.26:0/2848280312 >> v1:172.21.15.26:6789/0 conn(0x7ff1e8133fa0 legacy=0x7ff1e813ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:37.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.547+0000 7ff1e77fe700 1 -- 172.21.15.26:0/2848280312 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e80a1fe0 con 0x7ff1e80a0a30 2023-10-01T08:01:37.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.547+0000 7ff1e6ffd700 1 --2- 172.21.15.26:0/2848280312 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1e80a1340 0x7ff1e8133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:37.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.547+0000 7ff1e77fe700 1 --2- 172.21.15.26:0/2848280312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1e80a0a30 0x7ff1e80a0e00 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7ff1d80098f0 tx=0x7ff1d8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc033a821fe2d155 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:37.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.547+0000 7ff1e67fc700 1 -- 172.21.15.26:0/2848280312 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8011830 con 0x7ff1e80a0a30 2023-10-01T08:01:37.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.548+0000 7ff1e67fc700 1 -- 172.21.15.26:0/2848280312 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d8011990 con 0x7ff1e80a0a30 2023-10-01T08:01:37.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.548+0000 7ff1e67fc700 1 -- 172.21.15.26:0/2848280312 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8011d20 con 0x7ff1e80a0a30 2023-10-01T08:01:37.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.548+0000 7ff1edceb700 1 -- 172.21.15.26:0/2848280312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1e80a0a30 msgr2=0x7ff1e80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:37.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.548+0000 7ff1edceb700 1 --2- 172.21.15.26:0/2848280312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1e80a0a30 0x7ff1e80a0e00 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7ff1d80098f0 tx=0x7ff1d8009c00 comp rx=0 tx=0).stop 2023-10-01T08:01:37.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.548+0000 7ff1edceb700 1 -- 172.21.15.26:0/2848280312 shutdown_connections 2023-10-01T08:01:37.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.548+0000 7ff1edceb700 1 --2- 172.21.15.26:0/2848280312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1e80a0a30 0x7ff1e80a0e00 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:37.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.548+0000 7ff1edceb700 1 --2- 172.21.15.26:0/2848280312 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1e80a1340 0x7ff1e8133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:37.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.548+0000 7ff1edceb700 1 -- 172.21.15.26:0/2848280312 >> 172.21.15.26:0/2848280312 conn(0x7ff1e80a6550 msgr2=0x7ff1e80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:37.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.548+0000 7ff1edceb700 1 -- 172.21.15.26:0/2848280312 shutdown_connections 2023-10-01T08:01:37.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.548+0000 7ff1edceb700 1 -- 172.21.15.26:0/2848280312 wait complete. 2023-10-01T08:01:37.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.550+0000 7ff1edceb700 1 Processor -- start 2023-10-01T08:01:37.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.550+0000 7ff1edceb700 1 -- start start 2023-10-01T08:01:37.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.551+0000 7ff1edceb700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1e80a0a30 0x7ff1e81c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:37.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.551+0000 7ff1edceb700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff1e80a1340 0x7ff1e81cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:37.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.551+0000 7ff1edceb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1e8133fa0 0x7ff1e81ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:37.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.551+0000 7ff1edceb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e81263d0 con 0x7ff1e8133fa0 2023-10-01T08:01:37.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.551+0000 7ff1edceb700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e81246c0 con 0x7ff1e80a1340 2023-10-01T08:01:37.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.551+0000 7ff1edceb700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e8124c70 con 0x7ff1e80a0a30 2023-10-01T08:01:37.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.551+0000 7ff1e77fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1e80a0a30 0x7ff1e81c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:37.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.551+0000 7ff1e77fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1e80a0a30 0x7ff1e81c9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59722/0 (socket says 172.21.15.26:59722) 2023-10-01T08:01:37.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.551+0000 7ff1e77fe700 1 -- 172.21.15.26:0/3157532746 learned_addr learned my addr 172.21.15.26:0/3157532746 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:37.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.551+0000 7ff1e7fff700 1 --2- 172.21.15.26:0/3157532746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1e8133fa0 0x7ff1e81ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:37.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.551+0000 7ff1e6ffd700 1 --2- 172.21.15.26:0/3157532746 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff1e80a1340 0x7ff1e81cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:37.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.551+0000 7ff1e77fe700 1 -- 172.21.15.26:0/3157532746 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff1e80a1340 msgr2=0x7ff1e81cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:37.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.551+0000 7ff1e77fe700 1 --2- 172.21.15.26:0/3157532746 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff1e80a1340 0x7ff1e81cbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:37.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.551+0000 7ff1e77fe700 1 -- 172.21.15.26:0/3157532746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1e8133fa0 msgr2=0x7ff1e81ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:37.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.551+0000 7ff1e77fe700 1 --2- 172.21.15.26:0/3157532746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1e8133fa0 0x7ff1e81ce2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:37.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.551+0000 7ff1e77fe700 1 -- 172.21.15.26:0/3157532746 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1dc0094a0 con 0x7ff1e80a0a30 2023-10-01T08:01:37.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.552+0000 7ff1e77fe700 1 --2- 172.21.15.26:0/3157532746 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1e80a0a30 0x7ff1e81c9810 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8000c00 tx=0x7ff1d8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:37.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.552+0000 7ff1cffff700 1 -- 172.21.15.26:0/3157532746 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8004400 con 0x7ff1e80a0a30 2023-10-01T08:01:37.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.552+0000 7ff1cffff700 1 -- 172.21.15.26:0/3157532746 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d801f070 con 0x7ff1e80a0a30 2023-10-01T08:01:37.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.552+0000 7ff1edceb700 1 -- 172.21.15.26:0/3157532746 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1d8009550 con 0x7ff1e80a0a30 2023-10-01T08:01:37.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.552+0000 7ff1cffff700 1 -- 172.21.15.26:0/3157532746 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d80038e0 con 0x7ff1e80a0a30 2023-10-01T08:01:37.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.552+0000 7ff1edceb700 1 -- 172.21.15.26:0/3157532746 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e80a0220 con 0x7ff1e80a0a30 2023-10-01T08:01:37.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.553+0000 7ff1cffff700 1 -- 172.21.15.26:0/3157532746 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff1d8021030 con 0x7ff1e80a0a30 2023-10-01T08:01:37.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.553+0000 7ff1edceb700 1 -- 172.21.15.26:0/3157532746 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e8074ea0 con 0x7ff1e80a0a30 2023-10-01T08:01:37.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.553+0000 7ff1cffff700 1 -- 172.21.15.26:0/3157532746 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff1d80408c0 con 0x7ff1e80a0a30 2023-10-01T08:01:37.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.558+0000 7ff1cffff700 1 -- 172.21.15.26:0/3157532746 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff1d80199a0 con 0x7ff1e80a0a30 2023-10-01T08:01:37.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.698+0000 7f1d74e9d700 1 -- 172.21.15.26:0/601100934 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1d7009f420 con 0x7f1d7009e1d0 2023-10-01T08:01:37.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.698+0000 7f1d5effd700 1 -- 172.21.15.26:0/601100934 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1d64017020 con 0x7f1d7009e1d0 2023-10-01T08:01:37.699 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:37.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.701+0000 7f1d74e9d700 1 -- 172.21.15.26:0/601100934 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1d7009e1d0 msgr2=0x7f1d7011ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:37.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.701+0000 7f1d74e9d700 1 --2- 172.21.15.26:0/601100934 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1d7009e1d0 0x7f1d7011ee20 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f1d6400e9b0 tx=0x7f1d6400ecc0 comp rx=0 tx=0).stop 2023-10-01T08:01:37.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.701+0000 7f1d74e9d700 1 -- 172.21.15.26:0/601100934 shutdown_connections 2023-10-01T08:01:37.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.701+0000 7f1d74e9d700 1 --2- 172.21.15.26:0/601100934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d70139170 0x7f1d7011f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:37.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.701+0000 7f1d74e9d700 1 --2- 172.21.15.26:0/601100934 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d7009d6f0 0x7f1d7011e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:37.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.701+0000 7f1d74e9d700 1 --2- 172.21.15.26:0/601100934 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f1d7009e1d0 0x7f1d7011ee20 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:37.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.701+0000 7f1d74e9d700 1 -- 172.21.15.26:0/601100934 >> 172.21.15.26:0/601100934 conn(0x7f1d70066f50 msgr2=0x7f1d70136cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:37.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.701+0000 7f1d74e9d700 1 -- 172.21.15.26:0/601100934 shutdown_connections 2023-10-01T08:01:37.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.702+0000 7f1d74e9d700 1 -- 172.21.15.26:0/601100934 wait complete. 2023-10-01T08:01:37.716 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:37.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.747+0000 7f7389447700 1 -- 172.21.15.26:0/3957217480 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f738411dad0 con 0x7f7384130540 2023-10-01T08:01:37.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.748+0000 7f736b7fe700 1 -- 172.21.15.26:0/3957217480 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7378028020 con 0x7f7384130540 2023-10-01T08:01:37.749 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:37.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.750+0000 7f7389447700 1 -- 172.21.15.26:0/3957217480 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7384130540 msgr2=0x7f738411ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:37.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.750+0000 7f7389447700 1 --2- 172.21.15.26:0/3957217480 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7384130540 0x7f738411ab30 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f7378009870 tx=0x7f7378004750 comp rx=0 tx=0).stop 2023-10-01T08:01:37.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.750+0000 7f7389447700 1 -- 172.21.15.26:0/3957217480 shutdown_connections 2023-10-01T08:01:37.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.750+0000 7f7389447700 1 --2- 172.21.15.26:0/3957217480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7384130e50 0x7f738411b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:37.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.750+0000 7f7389447700 1 --2- 172.21.15.26:0/3957217480 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f738406fb20 0x7f738411a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:37.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.750+0000 7f7389447700 1 --2- 172.21.15.26:0/3957217480 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7384130540 0x7f738411ab30 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:37.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.750+0000 7f7389447700 1 -- 172.21.15.26:0/3957217480 >> 172.21.15.26:0/3957217480 conn(0x7f73840a2aa0 msgr2=0x7f738412d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:37.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.750+0000 7f7389447700 1 -- 172.21.15.26:0/3957217480 shutdown_connections 2023-10-01T08:01:37.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.750+0000 7f7389447700 1 -- 172.21.15.26:0/3957217480 wait complete. 2023-10-01T08:01:37.764 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:37.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.766+0000 7ff1edceb700 1 -- 172.21.15.26:0/3157532746 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff1e80a28e0 con 0x7ff1e80a0a30 2023-10-01T08:01:37.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.767+0000 7ff1cffff700 1 -- 172.21.15.26:0/3157532746 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff1d8015030 con 0x7ff1e80a0a30 2023-10-01T08:01:37.767 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:37.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.769+0000 7ff1edceb700 1 -- 172.21.15.26:0/3157532746 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1e80a0a30 msgr2=0x7ff1e81c9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:37.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.769+0000 7ff1edceb700 1 --2- 172.21.15.26:0/3157532746 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1e80a0a30 0x7ff1e81c9810 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8000c00 tx=0x7ff1d8004750 comp rx=0 tx=0).stop 2023-10-01T08:01:37.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.769+0000 7ff1edceb700 1 -- 172.21.15.26:0/3157532746 shutdown_connections 2023-10-01T08:01:37.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.769+0000 7ff1edceb700 1 --2- 172.21.15.26:0/3157532746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1e8133fa0 0x7ff1e81ce2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:37.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.769+0000 7ff1edceb700 1 --2- 172.21.15.26:0/3157532746 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff1e80a0a30 0x7ff1e81c9810 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:37.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.769+0000 7ff1edceb700 1 --2- 172.21.15.26:0/3157532746 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff1e80a1340 0x7ff1e81cbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:37.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.769+0000 7ff1edceb700 1 -- 172.21.15.26:0/3157532746 >> 172.21.15.26:0/3157532746 conn(0x7ff1e80a6550 msgr2=0x7ff1e80a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:37.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.769+0000 7ff1edceb700 1 -- 172.21.15.26:0/3157532746 shutdown_connections 2023-10-01T08:01:37.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.769+0000 7ff1edceb700 1 -- 172.21.15.26:0/3157532746 wait complete. 2023-10-01T08:01:37.783 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:37.841 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:37.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.980+0000 7febc9fb0700 1 Processor -- start 2023-10-01T08:01:37.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.981+0000 7febc9fb0700 1 -- start start 2023-10-01T08:01:37.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.981+0000 7febc9fb0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febc406a770 0x7febc406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:37.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.981+0000 7febc9fb0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7febc4131d10 0x7febc4139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:37.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.981+0000 7febc9fb0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc409ece0 con 0x7febc406b080 2023-10-01T08:01:37.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.981+0000 7febc9fb0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc409e760 con 0x7febc4131d10 2023-10-01T08:01:37.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.981+0000 7febc9fb0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc409e040 con 0x7febc406a770 2023-10-01T08:01:37.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.981+0000 7febc37fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febc406a770 0x7febc406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:37.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.981+0000 7febc37fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febc406a770 0x7febc406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44902/0 (socket says 172.21.15.26:44902) 2023-10-01T08:01:37.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.981+0000 7febc3fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7febc4131d10 0x7febc4139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:37.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.981+0000 7febc37fe700 1 -- 172.21.15.26:0/905687814 learned_addr learned my addr 172.21.15.26:0/905687814 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:37.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.982+0000 7febc37fe700 1 -- 172.21.15.26:0/905687814 >> v2:172.21.15.26:3300/0 conn(0x7febc4131d10 msgr2=0x7febc4139860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:37.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.982+0000 7febc37fe700 1 --2- 172.21.15.26:0/905687814 >> v2:172.21.15.26:3300/0 conn(0x7febc4131d10 0x7febc4139860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:37.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.982+0000 7febc37fe700 1 -- 172.21.15.26:0/905687814 >> v1:172.21.15.26:6789/0 conn(0x7febc406b080 legacy=0x7febc4131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:37.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.982+0000 7febc37fe700 1 -- 172.21.15.26:0/905687814 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc409f630 con 0x7febc406a770 2023-10-01T08:01:37.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.982+0000 7febc3fff700 1 --2- 172.21.15.26:0/905687814 >> v2:172.21.15.26:3300/0 conn(0x7febc4131d10 0x7febc4139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:37.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.982+0000 7febc37fe700 1 --2- 172.21.15.26:0/905687814 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febc406a770 0x7febc406ab40 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7febb40098f0 tx=0x7febb4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dac2046e845d4452 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:37.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.982+0000 7febc27fc700 1 -- 172.21.15.26:0/905687814 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb4011830 con 0x7febc406a770 2023-10-01T08:01:37.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.982+0000 7febc27fc700 1 -- 172.21.15.26:0/905687814 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb4011990 con 0x7febc406a770 2023-10-01T08:01:37.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.982+0000 7febc27fc700 1 -- 172.21.15.26:0/905687814 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb4011d20 con 0x7febc406a770 2023-10-01T08:01:37.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.983+0000 7febc9fb0700 1 -- 172.21.15.26:0/905687814 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febc406a770 msgr2=0x7febc406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:37.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.983+0000 7febc9fb0700 1 --2- 172.21.15.26:0/905687814 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febc406a770 0x7febc406ab40 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7febb40098f0 tx=0x7febb4009c00 comp rx=0 tx=0).stop 2023-10-01T08:01:37.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.983+0000 7febc9fb0700 1 -- 172.21.15.26:0/905687814 shutdown_connections 2023-10-01T08:01:37.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.983+0000 7febc9fb0700 1 --2- 172.21.15.26:0/905687814 >> v2:172.21.15.26:3300/0 conn(0x7febc4131d10 0x7febc4139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:37.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.983+0000 7febc9fb0700 1 --2- 172.21.15.26:0/905687814 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febc406a770 0x7febc406ab40 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:37.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.983+0000 7febc9fb0700 1 -- 172.21.15.26:0/905687814 >> 172.21.15.26:0/905687814 conn(0x7febc4066f50 msgr2=0x7febc409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:37.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.983+0000 7febc9fb0700 1 -- 172.21.15.26:0/905687814 shutdown_connections 2023-10-01T08:01:37.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.983+0000 7febc9fb0700 1 -- 172.21.15.26:0/905687814 wait complete. 2023-10-01T08:01:37.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.984+0000 7febc9fb0700 1 Processor -- start 2023-10-01T08:01:37.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.984+0000 7febc9fb0700 1 -- start start 2023-10-01T08:01:37.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.984+0000 7febc9fb0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febc406a770 0x7febc41c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:37.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.984+0000 7febc9fb0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febc406b080 0x7febc41c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:37.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.984+0000 7febc9fb0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febc4131d10 0x7febc41c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:37.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.984+0000 7febc9fb0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc41265a0 con 0x7febc4131d10 2023-10-01T08:01:37.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.984+0000 7febc9fb0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc41253f0 con 0x7febc406a770 2023-10-01T08:01:37.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.984+0000 7febc9fb0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febc4125e70 con 0x7febc406b080 2023-10-01T08:01:37.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.984+0000 7febc37fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febc406a770 0x7febc41c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:37.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.984+0000 7febc37fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febc406a770 0x7febc41c8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44912/0 (socket says 172.21.15.26:44912) 2023-10-01T08:01:37.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.984+0000 7febc37fe700 1 -- 172.21.15.26:0/1562420443 learned_addr learned my addr 172.21.15.26:0/1562420443 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:37.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.984+0000 7febc3fff700 1 --2- 172.21.15.26:0/1562420443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febc4131d10 0x7febc41c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:37.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.984+0000 7febc2ffd700 1 --2- 172.21.15.26:0/1562420443 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febc406b080 0x7febc41c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:37.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.985+0000 7febc3fff700 1 -- 172.21.15.26:0/1562420443 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febc406b080 msgr2=0x7febc41c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:37.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.985+0000 7febc3fff700 1 --2- 172.21.15.26:0/1562420443 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febc406b080 0x7febc41c8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:37.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.985+0000 7febc3fff700 1 -- 172.21.15.26:0/1562420443 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febc406a770 msgr2=0x7febc41c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:37.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.985+0000 7febc3fff700 1 --2- 172.21.15.26:0/1562420443 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febc406a770 0x7febc41c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:37.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.985+0000 7febc3fff700 1 -- 172.21.15.26:0/1562420443 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febbc009a70 con 0x7febc4131d10 2023-10-01T08:01:37.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.985+0000 7febc3fff700 1 --2- 172.21.15.26:0/1562420443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febc4131d10 0x7febc41c8cd0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7febbc00efc0 tx=0x7febbc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:37.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.985+0000 7febabfff700 1 -- 172.21.15.26:0/1562420443 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc00ca90 con 0x7febc4131d10 2023-10-01T08:01:37.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.985+0000 7febabfff700 1 -- 172.21.15.26:0/1562420443 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febbc00f040 con 0x7febc4131d10 2023-10-01T08:01:37.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.985+0000 7febc9fb0700 1 -- 172.21.15.26:0/1562420443 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febb4009550 con 0x7febc4131d10 2023-10-01T08:01:37.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.985+0000 7febabfff700 1 -- 172.21.15.26:0/1562420443 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc00ce30 con 0x7febc4131d10 2023-10-01T08:01:37.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.985+0000 7febc9fb0700 1 -- 172.21.15.26:0/1562420443 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc4126ba0 con 0x7febc4131d10 2023-10-01T08:01:37.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.986+0000 7febabfff700 1 -- 172.21.15.26:0/1562420443 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7febbc014480 con 0x7febc4131d10 2023-10-01T08:01:37.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.986+0000 7febabfff700 1 -- 172.21.15.26:0/1562420443 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7febbc03fc80 con 0x7febc4131d10 2023-10-01T08:01:37.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.986+0000 7febc9fb0700 1 -- 172.21.15.26:0/1562420443 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc4126210 con 0x7febc4131d10 2023-10-01T08:01:37.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:37.991+0000 7febabfff700 1 -- 172.21.15.26:0/1562420443 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7febbc012930 con 0x7febc4131d10 2023-10-01T08:01:38.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.195+0000 7febc9fb0700 1 -- 172.21.15.26:0/1562420443 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7febc4074ea0 con 0x7febc4131d10 2023-10-01T08:01:38.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.196+0000 7febabfff700 1 -- 172.21.15.26:0/1562420443 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7febbc012340 con 0x7febc4131d10 2023-10-01T08:01:38.197 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.198+0000 7febc9fb0700 1 -- 172.21.15.26:0/1562420443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febc4131d10 msgr2=0x7febc41c8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.198+0000 7febc9fb0700 1 --2- 172.21.15.26:0/1562420443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febc4131d10 0x7febc41c8cd0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7febbc00efc0 tx=0x7febbc00c3a0 comp rx=0 tx=0).stop 2023-10-01T08:01:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.198+0000 7febc9fb0700 1 -- 172.21.15.26:0/1562420443 shutdown_connections 2023-10-01T08:01:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.198+0000 7febc9fb0700 1 --2- 172.21.15.26:0/1562420443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febc4131d10 0x7febc41c8cd0 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.198+0000 7febc9fb0700 1 --2- 172.21.15.26:0/1562420443 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7febc406a770 0x7febc41c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.198+0000 7febc9fb0700 1 --2- 172.21.15.26:0/1562420443 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7febc406b080 0x7febc41c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.198+0000 7febc9fb0700 1 -- 172.21.15.26:0/1562420443 >> 172.21.15.26:0/1562420443 conn(0x7febc4066f50 msgr2=0x7febc40a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.198+0000 7febc9fb0700 1 -- 172.21.15.26:0/1562420443 shutdown_connections 2023-10-01T08:01:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.198+0000 7febc9fb0700 1 -- 172.21.15.26:0/1562420443 wait complete. 2023-10-01T08:01:38.212 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:38.717 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:38.765 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:38.784 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:38.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.866+0000 7f0afa88a700 1 Processor -- start 2023-10-01T08:01:38.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.867+0000 7f0afa88a700 1 -- start start 2023-10-01T08:01:38.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.867+0000 7f0afa88a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0af406a770 0x7f0af406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:38.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.867+0000 7f0afa88a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0af406b080 0x7f0af4131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:38.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.867+0000 7f0afa88a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af409ece0 con 0x7f0af4131b40 2023-10-01T08:01:38.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.867+0000 7f0afa88a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af409e760 con 0x7f0af406a770 2023-10-01T08:01:38.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.867+0000 7f0afa88a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af409e040 con 0x7f0af406b080 2023-10-01T08:01:38.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.867+0000 7f0af37fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0af406b080 0x7f0af4131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:38.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.867+0000 7f0af3fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0af406a770 0x7f0af406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:38.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.867+0000 7f0af8e27700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0af4131b40 0x7f0af4138850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44292/0 (socket says 172.21.15.26:44292) 2023-10-01T08:01:38.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.867+0000 7f0af37fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0af406b080 0x7f0af4131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44924/0 (socket says 172.21.15.26:44924) 2023-10-01T08:01:38.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.867+0000 7f0af8e27700 1 -- 172.21.15.26:0/2774485341 learned_addr learned my addr 172.21.15.26:0/2774485341 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:01:38.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.868+0000 7f0af37fe700 1 -- 172.21.15.26:0/2774485341 >> v2:172.21.15.26:3300/0 conn(0x7f0af406a770 msgr2=0x7f0af406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:38.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.868+0000 7f0af37fe700 1 --2- 172.21.15.26:0/2774485341 >> v2:172.21.15.26:3300/0 conn(0x7f0af406a770 0x7f0af406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:38.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.868+0000 7f0af37fe700 1 -- 172.21.15.26:0/2774485341 >> v1:172.21.15.26:6789/0 conn(0x7f0af4131b40 legacy=0x7f0af4138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:38.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.868+0000 7f0af37fe700 1 -- 172.21.15.26:0/2774485341 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af409f630 con 0x7f0af406b080 2023-10-01T08:01:38.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.868+0000 7f0af37fe700 1 --2- 172.21.15.26:0/2774485341 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0af406b080 0x7f0af4131600 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8009840 tx=0x7f0ae8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=491f9ca3d04c435d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:38.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.868+0000 7f0af2ffd700 1 -- 172.21.15.26:0/2774485341 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8011830 con 0x7f0af406b080 2023-10-01T08:01:38.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.868+0000 7f0af2ffd700 1 -- 172.21.15.26:0/2774485341 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae8011990 con 0x7f0af406b080 2023-10-01T08:01:38.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.868+0000 7f0af2ffd700 1 -- 172.21.15.26:0/2774485341 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8011d20 con 0x7f0af406b080 2023-10-01T08:01:38.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.869+0000 7f0afa88a700 1 -- 172.21.15.26:0/2774485341 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0af406b080 msgr2=0x7f0af4131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:38.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.869+0000 7f0afa88a700 1 --2- 172.21.15.26:0/2774485341 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0af406b080 0x7f0af4131600 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8009840 tx=0x7f0ae8009b50 comp rx=0 tx=0).stop 2023-10-01T08:01:38.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.869+0000 7f0afa88a700 1 -- 172.21.15.26:0/2774485341 shutdown_connections 2023-10-01T08:01:38.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.869+0000 7f0afa88a700 1 --2- 172.21.15.26:0/2774485341 >> v2:172.21.15.26:3300/0 conn(0x7f0af406a770 0x7f0af406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:38.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.869+0000 7f0afa88a700 1 --2- 172.21.15.26:0/2774485341 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0af406b080 0x7f0af4131600 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:38.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.869+0000 7f0afa88a700 1 -- 172.21.15.26:0/2774485341 >> 172.21.15.26:0/2774485341 conn(0x7f0af4066f50 msgr2=0x7f0af409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:38.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.869+0000 7f0afa88a700 1 -- 172.21.15.26:0/2774485341 shutdown_connections 2023-10-01T08:01:38.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.869+0000 7f0afa88a700 1 -- 172.21.15.26:0/2774485341 wait complete. 2023-10-01T08:01:38.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.871+0000 7f0afa88a700 1 Processor -- start 2023-10-01T08:01:38.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.871+0000 7f0afa88a700 1 -- start start 2023-10-01T08:01:38.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.871+0000 7f0afa88a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0af406a770 0x7f0af41c6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:38.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.871+0000 7f0afa88a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0af406b080 0x7f0af41c6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:38.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.871+0000 7f0afa88a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0af4131b40 0x7f0af41c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:38.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.871+0000 7f0afa88a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af411e390 con 0x7f0af406b080 2023-10-01T08:01:38.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.871+0000 7f0afa88a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af4131690 con 0x7f0af4131b40 2023-10-01T08:01:38.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.871+0000 7f0afa88a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0af4071e60 con 0x7f0af406a770 2023-10-01T08:01:38.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.872+0000 7f0af37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0af406b080 0x7f0af41c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:38.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.872+0000 7f0af37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0af406b080 0x7f0af41c6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44262/0 (socket says 172.21.15.26:44262) 2023-10-01T08:01:38.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.872+0000 7f0af37fe700 1 -- 172.21.15.26:0/1503331086 learned_addr learned my addr 172.21.15.26:0/1503331086 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:38.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.872+0000 7f0af8e27700 1 --2- 172.21.15.26:0/1503331086 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0af4131b40 0x7f0af41c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:38.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.872+0000 7f0af3fff700 1 --2- 172.21.15.26:0/1503331086 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0af406a770 0x7f0af41c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:38.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.872+0000 7f0af37fe700 1 -- 172.21.15.26:0/1503331086 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0af406a770 msgr2=0x7f0af41c6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:38.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.872+0000 7f0af37fe700 1 --2- 172.21.15.26:0/1503331086 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0af406a770 0x7f0af41c6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:38.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.872+0000 7f0af37fe700 1 -- 172.21.15.26:0/1503331086 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0af4131b40 msgr2=0x7f0af41c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:38.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.872+0000 7f0af37fe700 1 --2- 172.21.15.26:0/1503331086 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0af4131b40 0x7f0af41c6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:38.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.872+0000 7f0af37fe700 1 -- 172.21.15.26:0/1503331086 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae80094a0 con 0x7f0af406b080 2023-10-01T08:01:38.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.872+0000 7f0af8e27700 1 --2- 172.21.15.26:0/1503331086 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0af4131b40 0x7f0af41c6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:38.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.872+0000 7f0af37fe700 1 --2- 172.21.15.26:0/1503331086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0af406b080 0x7f0af41c6560 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8009fd0 tx=0x7f0ae8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:38.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.872+0000 7f0af0ff9700 1 -- 172.21.15.26:0/1503331086 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae80036a0 con 0x7f0af406b080 2023-10-01T08:01:38.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.873+0000 7f0af0ff9700 1 -- 172.21.15.26:0/1503331086 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae801f070 con 0x7f0af406b080 2023-10-01T08:01:38.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.873+0000 7f0af0ff9700 1 -- 172.21.15.26:0/1503331086 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8003a40 con 0x7f0af406b080 2023-10-01T08:01:38.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.873+0000 7f0afa88a700 1 -- 172.21.15.26:0/1503331086 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af411fe40 con 0x7f0af406b080 2023-10-01T08:01:38.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.873+0000 7f0afa88a700 1 -- 172.21.15.26:0/1503331086 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af411ee80 con 0x7f0af406b080 2023-10-01T08:01:38.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.874+0000 7f0af0ff9700 1 -- 172.21.15.26:0/1503331086 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0ae8003ba0 con 0x7f0af406b080 2023-10-01T08:01:38.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.874+0000 7f0afa88a700 1 -- 172.21.15.26:0/1503331086 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af411fae0 con 0x7f0af406b080 2023-10-01T08:01:38.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.874+0000 7f0af0ff9700 1 -- 172.21.15.26:0/1503331086 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0ae8021070 con 0x7f0af406b080 2023-10-01T08:01:38.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.883+0000 7f0af0ff9700 1 -- 172.21.15.26:0/1503331086 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0af411fae0 con 0x7f0af406b080 2023-10-01T08:01:38.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.914+0000 7f0ebb97b700 1 Processor -- start 2023-10-01T08:01:38.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.914+0000 7f0ebb97b700 1 -- start start 2023-10-01T08:01:38.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.915+0000 7f0ebb97b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0eb4136830 0x7f0eb4138c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:38.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.915+0000 7f0ebb97b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0eb4139150 0x7f0eb413b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:38.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.915+0000 7f0ebb97b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb406f720 con 0x7f0eb41338c0 2023-10-01T08:01:38.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.915+0000 7f0ebb97b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb4070c80 con 0x7f0eb4139150 2023-10-01T08:01:38.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.915+0000 7f0ebb97b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb406fce0 con 0x7f0eb4136830 2023-10-01T08:01:38.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.915+0000 7f0eb8f16700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0eb4136830 0x7f0eb4138c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:38.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.915+0000 7f0eb8f16700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0eb4136830 0x7f0eb4138c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44938/0 (socket says 172.21.15.26:44938) 2023-10-01T08:01:38.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.915+0000 7f0eb8f16700 1 -- 172.21.15.26:0/3306293643 learned_addr learned my addr 172.21.15.26:0/3306293643 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:38.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.915+0000 7f0eb9f18700 1 --2- 172.21.15.26:0/3306293643 >> v2:172.21.15.26:3300/0 conn(0x7f0eb4139150 0x7f0eb413b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:38.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.915+0000 7f0eb8f16700 1 -- 172.21.15.26:0/3306293643 >> v2:172.21.15.26:3300/0 conn(0x7f0eb4139150 msgr2=0x7f0eb413b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:38.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.915+0000 7f0eb8f16700 1 --2- 172.21.15.26:0/3306293643 >> v2:172.21.15.26:3300/0 conn(0x7f0eb4139150 0x7f0eb413b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:38.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.915+0000 7f0eb8f16700 1 -- 172.21.15.26:0/3306293643 >> v1:172.21.15.26:6789/0 conn(0x7f0eb41338c0 legacy=0x7f0eb4133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:38.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.915+0000 7f0eb8f16700 1 -- 172.21.15.26:0/3306293643 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb41336a0 con 0x7f0eb4136830 2023-10-01T08:01:38.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.916+0000 7f0eb8f16700 1 --2- 172.21.15.26:0/3306293643 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0eb4136830 0x7f0eb4138c10 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f0ea40098f0 tx=0x7f0ea4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8388ffc8207f9a47 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:38.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.916+0000 7f0eabfff700 1 -- 172.21.15.26:0/3306293643 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea4011830 con 0x7f0eb4136830 2023-10-01T08:01:38.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.916+0000 7f0eabfff700 1 -- 172.21.15.26:0/3306293643 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea4011990 con 0x7f0eb4136830 2023-10-01T08:01:38.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.916+0000 7f0eabfff700 1 -- 172.21.15.26:0/3306293643 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea4011d20 con 0x7f0eb4136830 2023-10-01T08:01:38.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.917+0000 7f0ebb97b700 1 -- 172.21.15.26:0/3306293643 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0eb4136830 msgr2=0x7f0eb4138c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:38.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.917+0000 7f0ebb97b700 1 --2- 172.21.15.26:0/3306293643 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0eb4136830 0x7f0eb4138c10 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f0ea40098f0 tx=0x7f0ea4009c00 comp rx=0 tx=0).stop 2023-10-01T08:01:38.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.917+0000 7f0ebb97b700 1 -- 172.21.15.26:0/3306293643 shutdown_connections 2023-10-01T08:01:38.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.917+0000 7f0ebb97b700 1 --2- 172.21.15.26:0/3306293643 >> v2:172.21.15.26:3300/0 conn(0x7f0eb4139150 0x7f0eb413b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:38.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.917+0000 7f0ebb97b700 1 --2- 172.21.15.26:0/3306293643 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0eb4136830 0x7f0eb4138c10 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:38.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.917+0000 7f0ebb97b700 1 -- 172.21.15.26:0/3306293643 >> 172.21.15.26:0/3306293643 conn(0x7f0eb40a2aa0 msgr2=0x7f0eb40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:38.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.917+0000 7f0ebb97b700 1 -- 172.21.15.26:0/3306293643 shutdown_connections 2023-10-01T08:01:38.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.917+0000 7f0ebb97b700 1 -- 172.21.15.26:0/3306293643 wait complete. 2023-10-01T08:01:38.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.919+0000 7f0ebb97b700 1 Processor -- start 2023-10-01T08:01:38.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.919+0000 7f0ebb97b700 1 -- start start 2023-10-01T08:01:38.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.919+0000 7f0ebb97b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0eb41338c0 0x7f0eb41c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:38.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.919+0000 7f0ebb97b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0eb4136830 0x7f0eb41c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:38.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.919+0000 7f0ebb97b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0eb4139150 0x7f0eb41c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:38.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.919+0000 7f0ebb97b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb41361d0 con 0x7f0eb4139150 2023-10-01T08:01:38.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.919+0000 7f0ebb97b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb406f960 con 0x7f0eb4136830 2023-10-01T08:01:38.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.919+0000 7f0ebb97b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb411bd70 con 0x7f0eb41338c0 2023-10-01T08:01:38.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.920+0000 7f0eb9717700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0eb41338c0 0x7f0eb41c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:38.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.920+0000 7f0eb9717700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0eb41338c0 0x7f0eb41c8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59744/0 (socket says 172.21.15.26:59744) 2023-10-01T08:01:38.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.920+0000 7f0eb9717700 1 -- 172.21.15.26:0/2937723011 learned_addr learned my addr 172.21.15.26:0/2937723011 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:38.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.920+0000 7f0eb8f16700 1 --2- 172.21.15.26:0/2937723011 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0eb4136830 0x7f0eb41c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:38.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.920+0000 7f0eb9f18700 1 --2- 172.21.15.26:0/2937723011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0eb4139150 0x7f0eb41c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:38.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.920+0000 7f0eb9717700 1 -- 172.21.15.26:0/2937723011 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0eb4136830 msgr2=0x7f0eb41c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:38.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.920+0000 7f0eb9717700 1 --2- 172.21.15.26:0/2937723011 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0eb4136830 0x7f0eb41c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:38.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.920+0000 7f0eb9717700 1 -- 172.21.15.26:0/2937723011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0eb4139150 msgr2=0x7f0eb41c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:38.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.920+0000 7f0eb9717700 1 --2- 172.21.15.26:0/2937723011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0eb4139150 0x7f0eb41c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:38.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.920+0000 7f0eb9717700 1 -- 172.21.15.26:0/2937723011 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea4009550 con 0x7f0eb41338c0 2023-10-01T08:01:38.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.920+0000 7f0eb9717700 1 --2- 172.21.15.26:0/2937723011 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0eb41338c0 0x7f0eb41c8440 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f0eb000c510 tx=0x7f0eb000c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:38.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.920+0000 7f0ea9ffb700 1 -- 172.21.15.26:0/2937723011 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb00052d0 con 0x7f0eb41338c0 2023-10-01T08:01:38.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.920+0000 7f0ea9ffb700 1 -- 172.21.15.26:0/2937723011 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb0005430 con 0x7f0eb41338c0 2023-10-01T08:01:38.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.920+0000 7f0ebb97b700 1 -- 172.21.15.26:0/2937723011 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb411d5d0 con 0x7f0eb41338c0 2023-10-01T08:01:38.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.921+0000 7f0ea9ffb700 1 -- 172.21.15.26:0/2937723011 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb00038c0 con 0x7f0eb41338c0 2023-10-01T08:01:38.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.921+0000 7f0ebb97b700 1 -- 172.21.15.26:0/2937723011 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb411c8d0 con 0x7f0eb41338c0 2023-10-01T08:01:38.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.921+0000 7f0ea9ffb700 1 -- 172.21.15.26:0/2937723011 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0eb0003a20 con 0x7f0eb41338c0 2023-10-01T08:01:38.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.922+0000 7f0ea9ffb700 1 -- 172.21.15.26:0/2937723011 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0eb003eab0 con 0x7f0eb41338c0 2023-10-01T08:01:38.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.922+0000 7f0ebb97b700 1 -- 172.21.15.26:0/2937723011 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb404ea50 con 0x7f0eb41338c0 2023-10-01T08:01:38.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.927+0000 7f0ea9ffb700 1 -- 172.21.15.26:0/2937723011 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0eb0017080 con 0x7f0eb41338c0 2023-10-01T08:01:38.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.956+0000 7f19945d6700 1 Processor -- start 2023-10-01T08:01:38.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.956+0000 7f19945d6700 1 -- start start 2023-10-01T08:01:38.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.957+0000 7f19945d6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f198c09d6f0 0x7f198c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:38.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.957+0000 7f19945d6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f198c09e410 0x7f198c130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:38.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.957+0000 7f19945d6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f198c09f130 con 0x7f198c09e000 2023-10-01T08:01:38.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.957+0000 7f19945d6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f198c09f520 con 0x7f198c09d6f0 2023-10-01T08:01:38.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.957+0000 7f19945d6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f198c09e930 con 0x7f198c09e410 2023-10-01T08:01:38.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.957+0000 7f1992372700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f198c09d6f0 0x7f198c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:38.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.957+0000 7f1992372700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f198c09d6f0 0x7f198c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44280/0 (socket says 172.21.15.26:44280) 2023-10-01T08:01:38.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.957+0000 7f1991b71700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f198c09e000 0x7f198c130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44312/0 (socket says 172.21.15.26:44312) 2023-10-01T08:01:38.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.957+0000 7f1992372700 1 -- 172.21.15.26:0/3791031688 learned_addr learned my addr 172.21.15.26:0/3791031688 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:38.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.958+0000 7f1992b73700 1 --2- 172.21.15.26:0/3791031688 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f198c09e410 0x7f198c130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:38.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.958+0000 7f1992372700 1 -- 172.21.15.26:0/3791031688 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f198c09e410 msgr2=0x7f198c130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:38.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.958+0000 7f1992372700 1 --2- 172.21.15.26:0/3791031688 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f198c09e410 0x7f198c130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:38.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.958+0000 7f1992372700 1 -- 172.21.15.26:0/3791031688 >> v1:172.21.15.26:6789/0 conn(0x7f198c09e000 legacy=0x7f198c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:38.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.958+0000 7f1992372700 1 -- 172.21.15.26:0/3791031688 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198c09b2d0 con 0x7f198c09d6f0 2023-10-01T08:01:38.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.958+0000 7f1991370700 1 -- 172.21.15.26:0/3791031688 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3456790226 0 0) 0x7f198c09f130 con 0x7f198c09e000 2023-10-01T08:01:38.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.958+0000 7f1992372700 1 --2- 172.21.15.26:0/3791031688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f198c09d6f0 0x7f198c09dac0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f19880098f0 tx=0x7f1988009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b93f25a85c88e76a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:38.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.958+0000 7f1991370700 1 -- 172.21.15.26:0/3791031688 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1988011830 con 0x7f198c09d6f0 2023-10-01T08:01:38.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.958+0000 7f1991370700 1 -- 172.21.15.26:0/3791031688 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1988011990 con 0x7f198c09d6f0 2023-10-01T08:01:38.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.958+0000 7f1991370700 1 -- 172.21.15.26:0/3791031688 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1988011d20 con 0x7f198c09d6f0 2023-10-01T08:01:38.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.959+0000 7f19945d6700 1 -- 172.21.15.26:0/3791031688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f198c09d6f0 msgr2=0x7f198c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:38.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.959+0000 7f19945d6700 1 --2- 172.21.15.26:0/3791031688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f198c09d6f0 0x7f198c09dac0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f19880098f0 tx=0x7f1988009c00 comp rx=0 tx=0).stop 2023-10-01T08:01:38.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.959+0000 7f19945d6700 1 -- 172.21.15.26:0/3791031688 shutdown_connections 2023-10-01T08:01:38.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.959+0000 7f19945d6700 1 --2- 172.21.15.26:0/3791031688 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f198c09e410 0x7f198c130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:38.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.959+0000 7f19945d6700 1 --2- 172.21.15.26:0/3791031688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f198c09d6f0 0x7f198c09dac0 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:38.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.959+0000 7f19945d6700 1 -- 172.21.15.26:0/3791031688 >> 172.21.15.26:0/3791031688 conn(0x7f198c066f50 msgr2=0x7f198c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:38.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.959+0000 7f19945d6700 1 -- 172.21.15.26:0/3791031688 shutdown_connections 2023-10-01T08:01:38.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.959+0000 7f19945d6700 1 -- 172.21.15.26:0/3791031688 wait complete. 2023-10-01T08:01:38.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.960+0000 7f19945d6700 1 Processor -- start 2023-10-01T08:01:38.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.960+0000 7f19945d6700 1 -- start start 2023-10-01T08:01:38.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.961+0000 7f19945d6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f198c09d6f0 0x7f198c11ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:38.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.961+0000 7f19945d6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f198c09e000 0x7f198c11f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:38.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.961+0000 7f19945d6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f198c09e410 0x7f198c11f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:38.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.961+0000 7f19945d6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198c122730 con 0x7f198c09e000 2023-10-01T08:01:38.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.961+0000 7f19945d6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f198c120a60 con 0x7f198c09e410 2023-10-01T08:01:38.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.961+0000 7f19945d6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f198c1218f0 con 0x7f198c09d6f0 2023-10-01T08:01:38.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.961+0000 7f1991b71700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f198c09e000 0x7f198c11f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:38.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.961+0000 7f1992372700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f198c09d6f0 0x7f198c11ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:38.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.961+0000 7f1992372700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f198c09d6f0 0x7f198c11ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59762/0 (socket says 172.21.15.26:59762) 2023-10-01T08:01:38.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.961+0000 7f1991b71700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f198c09e000 0x7f198c11f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44288/0 (socket says 172.21.15.26:44288) 2023-10-01T08:01:38.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.961+0000 7f1992372700 1 -- 172.21.15.26:0/3760592055 learned_addr learned my addr 172.21.15.26:0/3760592055 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:38.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.961+0000 7f1992b73700 1 --2- 172.21.15.26:0/3760592055 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f198c09e410 0x7f198c11f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:38.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.961+0000 7f1991b71700 1 -- 172.21.15.26:0/3760592055 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f198c09d6f0 msgr2=0x7f198c11ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:38.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.961+0000 7f1991b71700 1 --2- 172.21.15.26:0/3760592055 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f198c09d6f0 0x7f198c11ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:38.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.961+0000 7f1991b71700 1 -- 172.21.15.26:0/3760592055 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f198c09e410 msgr2=0x7f198c11f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:38.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.961+0000 7f1991b71700 1 --2- 172.21.15.26:0/3760592055 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f198c09e410 0x7f198c11f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:38.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.961+0000 7f1991b71700 1 -- 172.21.15.26:0/3760592055 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1988009550 con 0x7f198c09e000 2023-10-01T08:01:38.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.961+0000 7f1991b71700 1 --2- 172.21.15.26:0/3760592055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f198c09e000 0x7f198c11f390 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f197c00c4a0 tx=0x7f197c00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:38.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.962+0000 7f1982ffd700 1 -- 172.21.15.26:0/3760592055 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c004c80 con 0x7f198c09e000 2023-10-01T08:01:38.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.962+0000 7f1982ffd700 1 -- 172.21.15.26:0/3760592055 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197c004de0 con 0x7f198c09e000 2023-10-01T08:01:38.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.962+0000 7f19945d6700 1 -- 172.21.15.26:0/3760592055 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f198c1223d0 con 0x7f198c09e000 2023-10-01T08:01:38.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.962+0000 7f1982ffd700 1 -- 172.21.15.26:0/3760592055 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c007310 con 0x7f198c09e000 2023-10-01T08:01:38.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.962+0000 7f19945d6700 1 -- 172.21.15.26:0/3760592055 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198c122100 con 0x7f198c09e000 2023-10-01T08:01:38.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.963+0000 7f19945d6700 1 -- 172.21.15.26:0/3760592055 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f198c121cb0 con 0x7f198c09e000 2023-10-01T08:01:38.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.963+0000 7f1982ffd700 1 -- 172.21.15.26:0/3760592055 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f197c007470 con 0x7f198c09e000 2023-10-01T08:01:38.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.963+0000 7f1982ffd700 1 -- 172.21.15.26:0/3760592055 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f197c03f870 con 0x7f198c09e000 2023-10-01T08:01:38.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:38.972+0000 7f1982ffd700 1 -- 172.21.15.26:0/3760592055 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f197c007720 con 0x7f198c09e000 2023-10-01T08:01:39.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.102+0000 7f0afa88a700 1 -- 172.21.15.26:0/1503331086 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0af411fae0 con 0x7f0af406b080 2023-10-01T08:01:39.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.103+0000 7f0af0ff9700 1 -- 172.21.15.26:0/1503331086 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0af411fae0 con 0x7f0af406b080 2023-10-01T08:01:39.104 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:39.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.105+0000 7f0afa88a700 1 -- 172.21.15.26:0/1503331086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0af406b080 msgr2=0x7f0af41c6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:39.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.105+0000 7f0afa88a700 1 --2- 172.21.15.26:0/1503331086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0af406b080 0x7f0af41c6560 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8009fd0 tx=0x7f0ae8004750 comp rx=0 tx=0).stop 2023-10-01T08:01:39.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.105+0000 7f0afa88a700 1 -- 172.21.15.26:0/1503331086 shutdown_connections 2023-10-01T08:01:39.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.105+0000 7f0afa88a700 1 --2- 172.21.15.26:0/1503331086 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0af4131b40 0x7f0af41c6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:39.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.105+0000 7f0afa88a700 1 --2- 172.21.15.26:0/1503331086 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0af406a770 0x7f0af41c6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:39.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.105+0000 7f0afa88a700 1 --2- 172.21.15.26:0/1503331086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0af406b080 0x7f0af41c6560 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:39.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.105+0000 7f0afa88a700 1 -- 172.21.15.26:0/1503331086 >> 172.21.15.26:0/1503331086 conn(0x7f0af4066f50 msgr2=0x7f0af4070270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:39.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.105+0000 7f0afa88a700 1 -- 172.21.15.26:0/1503331086 shutdown_connections 2023-10-01T08:01:39.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.105+0000 7f0afa88a700 1 -- 172.21.15.26:0/1503331086 wait complete. 2023-10-01T08:01:39.120 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:39.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.139+0000 7f0ebb97b700 1 -- 172.21.15.26:0/2937723011 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0eb4074ea0 con 0x7f0eb41338c0 2023-10-01T08:01:39.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.139+0000 7f0ea9ffb700 1 -- 172.21.15.26:0/2937723011 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0eb0018260 con 0x7f0eb41338c0 2023-10-01T08:01:39.140 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:39.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.141+0000 7f0ebb97b700 1 -- 172.21.15.26:0/2937723011 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0eb41338c0 msgr2=0x7f0eb41c8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:39.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.141+0000 7f0ebb97b700 1 --2- 172.21.15.26:0/2937723011 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0eb41338c0 0x7f0eb41c8440 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f0eb000c510 tx=0x7f0eb000c820 comp rx=0 tx=0).stop 2023-10-01T08:01:39.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.141+0000 7f0ebb97b700 1 -- 172.21.15.26:0/2937723011 shutdown_connections 2023-10-01T08:01:39.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.141+0000 7f0ebb97b700 1 --2- 172.21.15.26:0/2937723011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0eb4139150 0x7f0eb41c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:39.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.141+0000 7f0ebb97b700 1 --2- 172.21.15.26:0/2937723011 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0eb41338c0 0x7f0eb41c8440 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:39.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.141+0000 7f0ebb97b700 1 --2- 172.21.15.26:0/2937723011 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0eb4136830 0x7f0eb41c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:39.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.141+0000 7f0ebb97b700 1 -- 172.21.15.26:0/2937723011 >> 172.21.15.26:0/2937723011 conn(0x7f0eb40a2aa0 msgr2=0x7f0eb409de50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:39.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.141+0000 7f0ebb97b700 1 -- 172.21.15.26:0/2937723011 shutdown_connections 2023-10-01T08:01:39.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.141+0000 7f0ebb97b700 1 -- 172.21.15.26:0/2937723011 wait complete. 2023-10-01T08:01:39.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:39.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.182+0000 7f19945d6700 1 -- 172.21.15.26:0/3760592055 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f198c11bc30 con 0x7f198c09e000 2023-10-01T08:01:39.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.182+0000 7f1982ffd700 1 -- 172.21.15.26:0/3760592055 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f197c01bb30 con 0x7f198c09e000 2023-10-01T08:01:39.183 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:39.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.184+0000 7f19945d6700 1 -- 172.21.15.26:0/3760592055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f198c09e000 msgr2=0x7f198c11f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:39.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.184+0000 7f19945d6700 1 --2- 172.21.15.26:0/3760592055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f198c09e000 0x7f198c11f390 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f197c00c4a0 tx=0x7f197c00c7b0 comp rx=0 tx=0).stop 2023-10-01T08:01:39.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.184+0000 7f19945d6700 1 -- 172.21.15.26:0/3760592055 shutdown_connections 2023-10-01T08:01:39.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.184+0000 7f19945d6700 1 --2- 172.21.15.26:0/3760592055 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f198c09e410 0x7f198c11f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:39.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.184+0000 7f19945d6700 1 --2- 172.21.15.26:0/3760592055 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f198c09d6f0 0x7f198c11ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:39.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.184+0000 7f19945d6700 1 --2- 172.21.15.26:0/3760592055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f198c09e000 0x7f198c11f390 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:39.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.184+0000 7f19945d6700 1 -- 172.21.15.26:0/3760592055 >> 172.21.15.26:0/3760592055 conn(0x7f198c066f50 msgr2=0x7f198c130b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:39.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.185+0000 7f19945d6700 1 -- 172.21.15.26:0/3760592055 shutdown_connections 2023-10-01T08:01:39.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.185+0000 7f19945d6700 1 -- 172.21.15.26:0/3760592055 wait complete. 2023-10-01T08:01:39.198 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:39.213 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:39.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.377+0000 7fbf9c4d0700 1 Processor -- start 2023-10-01T08:01:39.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.377+0000 7fbf9c4d0700 1 -- start start 2023-10-01T08:01:39.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.378+0000 7fbf9c4d0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf9409d6f0 0x7fbf9409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:39.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.378+0000 7fbf9c4d0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf9409e410 0x7fbf94134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:39.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.378+0000 7fbf9c4d0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf9409b120 con 0x7fbf9409e000 2023-10-01T08:01:39.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.378+0000 7fbf9c4d0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9406b460 con 0x7fbf9409e410 2023-10-01T08:01:39.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.378+0000 7fbf9c4d0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9409a7e0 con 0x7fbf9409d6f0 2023-10-01T08:01:39.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.378+0000 7fbf9a26c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf9409d6f0 0x7fbf9409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:39.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.378+0000 7fbf9aa6d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf9409e410 0x7fbf94134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:39.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.378+0000 7fbf99a6b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbf9409e000 0x7fbf941339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44326/0 (socket says 172.21.15.26:44326) 2023-10-01T08:01:39.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.378+0000 7fbf99a6b700 1 -- 172.21.15.26:0/2806936765 learned_addr learned my addr 172.21.15.26:0/2806936765 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:01:39.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.379+0000 7fbf9a26c700 1 -- 172.21.15.26:0/2806936765 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf9409e410 msgr2=0x7fbf94134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:39.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.379+0000 7fbf9a26c700 1 --2- 172.21.15.26:0/2806936765 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf9409e410 0x7fbf94134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:39.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.379+0000 7fbf9926a700 1 -- 172.21.15.26:0/2806936765 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 330486725 0 0) 0x7fbf9409b120 con 0x7fbf9409e000 2023-10-01T08:01:39.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.379+0000 7fbf9a26c700 1 -- 172.21.15.26:0/2806936765 >> v1:172.21.15.26:6789/0 conn(0x7fbf9409e000 legacy=0x7fbf941339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:39.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.379+0000 7fbf9a26c700 1 -- 172.21.15.26:0/2806936765 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf9409a500 con 0x7fbf9409d6f0 2023-10-01T08:01:39.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.379+0000 7fbf9aa6d700 1 --2- 172.21.15.26:0/2806936765 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf9409e410 0x7fbf94134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:39.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.379+0000 7fbf9a26c700 1 --2- 172.21.15.26:0/2806936765 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf9409d6f0 0x7fbf9409dac0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fbf900098a0 tx=0x7fbf90009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=860f42c20f94e722 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:39.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.379+0000 7fbf9926a700 1 -- 172.21.15.26:0/2806936765 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf90011830 con 0x7fbf9409d6f0 2023-10-01T08:01:39.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.379+0000 7fbf9926a700 1 -- 172.21.15.26:0/2806936765 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf90011990 con 0x7fbf9409d6f0 2023-10-01T08:01:39.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.379+0000 7fbf9926a700 1 -- 172.21.15.26:0/2806936765 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf90011d20 con 0x7fbf9409d6f0 2023-10-01T08:01:39.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.380+0000 7fbf9c4d0700 1 -- 172.21.15.26:0/2806936765 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf9409d6f0 msgr2=0x7fbf9409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:39.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.380+0000 7fbf9c4d0700 1 --2- 172.21.15.26:0/2806936765 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf9409d6f0 0x7fbf9409dac0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fbf900098a0 tx=0x7fbf90009bb0 comp rx=0 tx=0).stop 2023-10-01T08:01:39.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.380+0000 7fbf9c4d0700 1 -- 172.21.15.26:0/2806936765 shutdown_connections 2023-10-01T08:01:39.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.380+0000 7fbf9c4d0700 1 --2- 172.21.15.26:0/2806936765 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf9409d6f0 0x7fbf9409dac0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:39.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.380+0000 7fbf9c4d0700 1 --2- 172.21.15.26:0/2806936765 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf9409e410 0x7fbf94134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:39.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.380+0000 7fbf9c4d0700 1 -- 172.21.15.26:0/2806936765 >> 172.21.15.26:0/2806936765 conn(0x7fbf94066f50 msgr2=0x7fbf9409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:39.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.380+0000 7fbf9c4d0700 1 -- 172.21.15.26:0/2806936765 shutdown_connections 2023-10-01T08:01:39.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.380+0000 7fbf9c4d0700 1 -- 172.21.15.26:0/2806936765 wait complete. 2023-10-01T08:01:39.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.381+0000 7fbf9c4d0700 1 Processor -- start 2023-10-01T08:01:39.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.381+0000 7fbf9c4d0700 1 -- start start 2023-10-01T08:01:39.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.381+0000 7fbf9c4d0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf9409d6f0 0x7fbf94122450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:39.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.381+0000 7fbf9c4d0700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf9409e000 0x7fbf94122990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:39.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.381+0000 7fbf9c4d0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf9409e410 0x7fbf94122ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:39.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.381+0000 7fbf9c4d0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf940a1ba0 con 0x7fbf9409d6f0 2023-10-01T08:01:39.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.381+0000 7fbf9c4d0700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf941248b0 con 0x7fbf9409e000 2023-10-01T08:01:39.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.381+0000 7fbf9c4d0700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9409c710 con 0x7fbf9409e410 2023-10-01T08:01:39.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.381+0000 7fbf9a26c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf9409d6f0 0x7fbf94122450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:39.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.381+0000 7fbf9aa6d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf9409e410 0x7fbf94122ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:39.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.381+0000 7fbf9a26c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf9409d6f0 0x7fbf94122450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44300/0 (socket says 172.21.15.26:44300) 2023-10-01T08:01:39.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.381+0000 7fbf9a26c700 1 -- 172.21.15.26:0/783465251 learned_addr learned my addr 172.21.15.26:0/783465251 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:39.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.381+0000 7fbf99a6b700 1 --2- 172.21.15.26:0/783465251 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf9409e000 0x7fbf94122990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:39.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.382+0000 7fbf9a26c700 1 -- 172.21.15.26:0/783465251 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf9409e410 msgr2=0x7fbf94122ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:39.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.382+0000 7fbf9a26c700 1 --2- 172.21.15.26:0/783465251 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf9409e410 0x7fbf94122ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:39.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.382+0000 7fbf9a26c700 1 -- 172.21.15.26:0/783465251 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf9409e000 msgr2=0x7fbf94122990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:39.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.382+0000 7fbf9a26c700 1 --2- 172.21.15.26:0/783465251 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf9409e000 0x7fbf94122990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:39.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.382+0000 7fbf9a26c700 1 -- 172.21.15.26:0/783465251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8c009a70 con 0x7fbf9409d6f0 2023-10-01T08:01:39.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.382+0000 7fbf9aa6d700 1 --2- 172.21.15.26:0/783465251 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf9409e410 0x7fbf94122ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:39.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.382+0000 7fbf99a6b700 1 --2- 172.21.15.26:0/783465251 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf9409e000 0x7fbf94122990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:39.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.382+0000 7fbf9a26c700 1 --2- 172.21.15.26:0/783465251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf9409d6f0 0x7fbf94122450 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7fbf90009870 tx=0x7fbf90004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:39.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.382+0000 7fbf8affd700 1 -- 172.21.15.26:0/783465251 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf900044d0 con 0x7fbf9409d6f0 2023-10-01T08:01:39.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.382+0000 7fbf8affd700 1 -- 172.21.15.26:0/783465251 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9001f070 con 0x7fbf9409d6f0 2023-10-01T08:01:39.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.382+0000 7fbf9c4d0700 1 -- 172.21.15.26:0/783465251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf900094a0 con 0x7fbf9409d6f0 2023-10-01T08:01:39.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.382+0000 7fbf8affd700 1 -- 172.21.15.26:0/783465251 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf900038e0 con 0x7fbf9409d6f0 2023-10-01T08:01:39.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.382+0000 7fbf9c4d0700 1 -- 172.21.15.26:0/783465251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf94126010 con 0x7fbf9409d6f0 2023-10-01T08:01:39.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.383+0000 7fbf8affd700 1 -- 172.21.15.26:0/783465251 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbf90003a40 con 0x7fbf9409d6f0 2023-10-01T08:01:39.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.383+0000 7fbf8affd700 1 -- 172.21.15.26:0/783465251 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbf90021070 con 0x7fbf9409d6f0 2023-10-01T08:01:39.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.383+0000 7fbf9c4d0700 1 -- 172.21.15.26:0/783465251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf940729a0 con 0x7fbf9409d6f0 2023-10-01T08:01:39.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.388+0000 7fbf8affd700 1 -- 172.21.15.26:0/783465251 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbf90040e60 con 0x7fbf9409d6f0 2023-10-01T08:01:39.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.593+0000 7fbf9c4d0700 1 -- 172.21.15.26:0/783465251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbf94074ea0 con 0x7fbf9409d6f0 2023-10-01T08:01:39.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.593+0000 7fbf8affd700 1 -- 172.21.15.26:0/783465251 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbf90034070 con 0x7fbf9409d6f0 2023-10-01T08:01:39.594 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:39.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.595+0000 7fbf9c4d0700 1 -- 172.21.15.26:0/783465251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf9409d6f0 msgr2=0x7fbf94122450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:39.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.595+0000 7fbf9c4d0700 1 --2- 172.21.15.26:0/783465251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf9409d6f0 0x7fbf94122450 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7fbf90009870 tx=0x7fbf90004750 comp rx=0 tx=0).stop 2023-10-01T08:01:39.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.595+0000 7fbf9c4d0700 1 -- 172.21.15.26:0/783465251 shutdown_connections 2023-10-01T08:01:39.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.595+0000 7fbf9c4d0700 1 --2- 172.21.15.26:0/783465251 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbf9409e410 0x7fbf94122ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:39.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.595+0000 7fbf9c4d0700 1 --2- 172.21.15.26:0/783465251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf9409d6f0 0x7fbf94122450 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:39.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.595+0000 7fbf9c4d0700 1 --2- 172.21.15.26:0/783465251 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbf9409e000 0x7fbf94122990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:39.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.595+0000 7fbf9c4d0700 1 -- 172.21.15.26:0/783465251 >> 172.21.15.26:0/783465251 conn(0x7fbf94066f50 msgr2=0x7fbf9409b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:39.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.595+0000 7fbf9c4d0700 1 -- 172.21.15.26:0/783465251 shutdown_connections 2023-10-01T08:01:39.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:39.596+0000 7fbf9c4d0700 1 -- 172.21.15.26:0/783465251 wait complete. 2023-10-01T08:01:39.610 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:40.121 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:40.157 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:40.199 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:40.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.278+0000 7f8ce7299700 1 Processor -- start 2023-10-01T08:01:40.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.278+0000 7f8ce7299700 1 -- start start 2023-10-01T08:01:40.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.279+0000 7f8ce7299700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8ce00954c0 0x7f8ce0095890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:40.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.279+0000 7f8ce7299700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ce0099680 0x7f8ce0099ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:40.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.279+0000 7f8ce7299700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce009c280 con 0x7f8ce0099ff0 2023-10-01T08:01:40.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.279+0000 7f8ce7299700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce009aaf0 con 0x7f8ce00954c0 2023-10-01T08:01:40.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.279+0000 7f8ce7299700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce009b960 con 0x7f8ce0099680 2023-10-01T08:01:40.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.279+0000 7f8ce4834700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ce0099680 0x7f8ce0099ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:40.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.279+0000 7f8ce5035700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8ce00954c0 0x7f8ce0095890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:40.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.279+0000 7f8ce4834700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ce0099680 0x7f8ce0099ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44982/0 (socket says 172.21.15.26:44982) 2023-10-01T08:01:40.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.279+0000 7f8ce4834700 1 -- 172.21.15.26:0/270321725 learned_addr learned my addr 172.21.15.26:0/270321725 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:40.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.279+0000 7f8ce5035700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8ce00954c0 0x7f8ce0095890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44312/0 (socket says 172.21.15.26:44312) 2023-10-01T08:01:40.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.279+0000 7f8ce4834700 1 -- 172.21.15.26:0/270321725 >> v2:172.21.15.26:3300/0 conn(0x7f8ce00954c0 msgr2=0x7f8ce0095890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:40.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.279+0000 7f8ce4834700 1 --2- 172.21.15.26:0/270321725 >> v2:172.21.15.26:3300/0 conn(0x7f8ce00954c0 0x7f8ce0095890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:40.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.279+0000 7f8ce4834700 1 -- 172.21.15.26:0/270321725 >> v1:172.21.15.26:6789/0 conn(0x7f8ce0099ff0 legacy=0x7f8ce0137590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:40.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.280+0000 7f8ce4834700 1 -- 172.21.15.26:0/270321725 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce009a7b0 con 0x7f8ce0099680 2023-10-01T08:01:40.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.280+0000 7f8ce5035700 1 --2- 172.21.15.26:0/270321725 >> v2:172.21.15.26:3300/0 conn(0x7f8ce00954c0 0x7f8ce0095890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:40.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.280+0000 7f8ce4834700 1 --2- 172.21.15.26:0/270321725 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ce0099680 0x7f8ce0099ab0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f8cd00098f0 tx=0x7f8cd0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61aa764975cf3886 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:40.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.280+0000 7f8cd7fff700 1 -- 172.21.15.26:0/270321725 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0011830 con 0x7f8ce0099680 2023-10-01T08:01:40.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.280+0000 7f8cd7fff700 1 -- 172.21.15.26:0/270321725 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd0011990 con 0x7f8ce0099680 2023-10-01T08:01:40.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.280+0000 7f8cd7fff700 1 -- 172.21.15.26:0/270321725 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0011d20 con 0x7f8ce0099680 2023-10-01T08:01:40.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.281+0000 7f8ce7299700 1 -- 172.21.15.26:0/270321725 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ce0099680 msgr2=0x7f8ce0099ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:40.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.281+0000 7f8ce7299700 1 --2- 172.21.15.26:0/270321725 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ce0099680 0x7f8ce0099ab0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f8cd00098f0 tx=0x7f8cd0009c00 comp rx=0 tx=0).stop 2023-10-01T08:01:40.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.281+0000 7f8ce7299700 1 -- 172.21.15.26:0/270321725 shutdown_connections 2023-10-01T08:01:40.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.281+0000 7f8ce7299700 1 --2- 172.21.15.26:0/270321725 >> v2:172.21.15.26:3300/0 conn(0x7f8ce00954c0 0x7f8ce0095890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:40.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.281+0000 7f8ce7299700 1 --2- 172.21.15.26:0/270321725 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ce0099680 0x7f8ce0099ab0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:40.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.281+0000 7f8ce7299700 1 -- 172.21.15.26:0/270321725 >> 172.21.15.26:0/270321725 conn(0x7f8ce00a2360 msgr2=0x7f8ce00a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:40.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.281+0000 7f8ce7299700 1 -- 172.21.15.26:0/270321725 shutdown_connections 2023-10-01T08:01:40.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.281+0000 7f8ce7299700 1 -- 172.21.15.26:0/270321725 wait complete. 2023-10-01T08:01:40.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.282+0000 7f8ce7299700 1 Processor -- start 2023-10-01T08:01:40.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.282+0000 7f8ce7299700 1 -- start start 2023-10-01T08:01:40.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.282+0000 7f8ce7299700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ce00954c0 0x7f8ce00933a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:40.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.282+0000 7f8ce7299700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ce0099680 0x7f8ce00938e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:40.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.282+0000 7f8ce7299700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8ce0099ff0 0x7f8ce0093e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:40.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.282+0000 7f8ce7299700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce00925c0 con 0x7f8ce0099680 2023-10-01T08:01:40.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.282+0000 7f8ce7299700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce013b900 con 0x7f8ce00954c0 2023-10-01T08:01:40.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.282+0000 7f8ce7299700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce0092220 con 0x7f8ce0099ff0 2023-10-01T08:01:40.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.282+0000 7f8ce5035700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ce00954c0 0x7f8ce00933a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:40.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.282+0000 7f8ce5035700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ce00954c0 0x7f8ce00933a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:44994/0 (socket says 172.21.15.26:44994) 2023-10-01T08:01:40.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.283+0000 7f8ce5035700 1 -- 172.21.15.26:0/231874303 learned_addr learned my addr 172.21.15.26:0/231874303 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:40.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.283+0000 7f8ce5836700 1 --2- 172.21.15.26:0/231874303 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8ce0099ff0 0x7f8ce0093e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:40.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.283+0000 7f8ce5035700 1 -- 172.21.15.26:0/231874303 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8ce0099ff0 msgr2=0x7f8ce0093e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:40.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.283+0000 7f8ce5035700 1 --2- 172.21.15.26:0/231874303 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8ce0099ff0 0x7f8ce0093e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:40.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.283+0000 7f8ce5035700 1 -- 172.21.15.26:0/231874303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ce0099680 msgr2=0x7f8ce00938e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:40.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.283+0000 7f8ce5035700 1 --2- 172.21.15.26:0/231874303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ce0099680 0x7f8ce00938e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:40.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.283+0000 7f8ce5035700 1 -- 172.21.15.26:0/231874303 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cdc0094a0 con 0x7f8ce00954c0 2023-10-01T08:01:40.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.283+0000 7f8ce5035700 1 --2- 172.21.15.26:0/231874303 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ce00954c0 0x7f8ce00933a0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc00ebe0 tx=0x7f8cdc00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:40.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.283+0000 7f8cd5ffb700 1 -- 172.21.15.26:0/231874303 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc009800 con 0x7f8ce00954c0 2023-10-01T08:01:40.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.283+0000 7f8cd5ffb700 1 -- 172.21.15.26:0/231874303 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cdc00c910 con 0x7f8ce00954c0 2023-10-01T08:01:40.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.283+0000 7f8ce7299700 1 -- 172.21.15.26:0/231874303 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd0009550 con 0x7f8ce00954c0 2023-10-01T08:01:40.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.283+0000 7f8cd5ffb700 1 -- 172.21.15.26:0/231874303 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc00cc80 con 0x7f8ce00954c0 2023-10-01T08:01:40.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.284+0000 7f8ce7299700 1 -- 172.21.15.26:0/231874303 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce009b000 con 0x7f8ce00954c0 2023-10-01T08:01:40.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.285+0000 7f8cd5ffb700 1 -- 172.21.15.26:0/231874303 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8cdc013470 con 0x7f8ce00954c0 2023-10-01T08:01:40.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.285+0000 7f8ce7299700 1 -- 172.21.15.26:0/231874303 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce00712e0 con 0x7f8ce00954c0 2023-10-01T08:01:40.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.285+0000 7f8cd5ffb700 1 -- 172.21.15.26:0/231874303 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8cdc03fc20 con 0x7f8ce00954c0 2023-10-01T08:01:40.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.290+0000 7f8cd5ffb700 1 -- 172.21.15.26:0/231874303 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8cdc013720 con 0x7f8ce00954c0 2023-10-01T08:01:40.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.313+0000 7f63b0044700 1 Processor -- start 2023-10-01T08:01:40.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.313+0000 7f63b0044700 1 -- start start 2023-10-01T08:01:40.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.314+0000 7f63b0044700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f63a81337f0 0x7f63a8138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:40.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.314+0000 7f63b0044700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f63a8138dc0 0x7f63a813b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:40.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.314+0000 7f63b0044700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63a806b990 con 0x7f63a8133420 2023-10-01T08:01:40.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.314+0000 7f63b0044700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63a809b0e0 con 0x7f63a81337f0 2023-10-01T08:01:40.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.314+0000 7f63b0044700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a8133c20 con 0x7f63a8138dc0 2023-10-01T08:01:40.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.314+0000 7f63ad5df700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f63a81337f0 0x7f63a8138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:40.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.314+0000 7f63ae5e1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f63a8138dc0 0x7f63a813b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:40.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.314+0000 7f63ad5df700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f63a81337f0 0x7f63a8138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44316/0 (socket says 172.21.15.26:44316) 2023-10-01T08:01:40.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.314+0000 7f63ad5df700 1 -- 172.21.15.26:0/3261761638 learned_addr learned my addr 172.21.15.26:0/3261761638 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:40.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.314+0000 7f63ad5df700 1 -- 172.21.15.26:0/3261761638 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f63a8138dc0 msgr2=0x7f63a813b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:40.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.314+0000 7f63ad5df700 1 --2- 172.21.15.26:0/3261761638 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f63a8138dc0 0x7f63a813b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:40.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.315+0000 7f63ad5df700 1 -- 172.21.15.26:0/3261761638 >> v1:172.21.15.26:6789/0 conn(0x7f63a8133420 legacy=0x7f63a8133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:40.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.315+0000 7f63ad5df700 1 -- 172.21.15.26:0/3261761638 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a80a0590 con 0x7f63a81337f0 2023-10-01T08:01:40.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.315+0000 7f63ae5e1700 1 --2- 172.21.15.26:0/3261761638 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f63a8138dc0 0x7f63a813b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:40.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.315+0000 7f63ad5df700 1 --2- 172.21.15.26:0/3261761638 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63a81337f0 0x7f63a8138880 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f63980098f0 tx=0x7f6398009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=179867cbcf2bbed3 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:40.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.315+0000 7f63acdde700 1 -- 172.21.15.26:0/3261761638 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6398011830 con 0x7f63a81337f0 2023-10-01T08:01:40.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.315+0000 7f63acdde700 1 -- 172.21.15.26:0/3261761638 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6398011990 con 0x7f63a81337f0 2023-10-01T08:01:40.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.315+0000 7f63acdde700 1 -- 172.21.15.26:0/3261761638 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6398011d20 con 0x7f63a81337f0 2023-10-01T08:01:40.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.316+0000 7f63b0044700 1 -- 172.21.15.26:0/3261761638 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63a81337f0 msgr2=0x7f63a8138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:40.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.316+0000 7f63b0044700 1 --2- 172.21.15.26:0/3261761638 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63a81337f0 0x7f63a8138880 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f63980098f0 tx=0x7f6398009c00 comp rx=0 tx=0).stop 2023-10-01T08:01:40.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.316+0000 7f63b0044700 1 -- 172.21.15.26:0/3261761638 shutdown_connections 2023-10-01T08:01:40.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.316+0000 7f63b0044700 1 --2- 172.21.15.26:0/3261761638 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f63a8138dc0 0x7f63a813b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:40.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.316+0000 7f63b0044700 1 --2- 172.21.15.26:0/3261761638 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63a81337f0 0x7f63a8138880 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:40.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.316+0000 7f63b0044700 1 -- 172.21.15.26:0/3261761638 >> 172.21.15.26:0/3261761638 conn(0x7f63a80a4210 msgr2=0x7f63a80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:40.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.316+0000 7f63b0044700 1 -- 172.21.15.26:0/3261761638 shutdown_connections 2023-10-01T08:01:40.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.316+0000 7f63b0044700 1 -- 172.21.15.26:0/3261761638 wait complete. 2023-10-01T08:01:40.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.317+0000 7f63b0044700 1 Processor -- start 2023-10-01T08:01:40.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.317+0000 7f63b0044700 1 -- start start 2023-10-01T08:01:40.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.318+0000 7f63b0044700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f63a8133420 0x7f63a809c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:40.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.318+0000 7f63b0044700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f63a81337f0 0x7f63a809cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:40.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.318+0000 7f63b0044700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63a8138dc0 0x7f63a809d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:40.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.318+0000 7f63b0044700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a812df60 con 0x7f63a8138dc0 2023-10-01T08:01:40.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.318+0000 7f63b0044700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a812f950 con 0x7f63a81337f0 2023-10-01T08:01:40.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.318+0000 7f63b0044700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63a8130780 con 0x7f63a8133420 2023-10-01T08:01:40.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.318+0000 7f63ad5df700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f63a81337f0 0x7f63a809cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:40.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.318+0000 7f63adde0700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f63a8133420 0x7f63a809c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:40.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.318+0000 7f63ad5df700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f63a81337f0 0x7f63a809cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45010/0 (socket says 172.21.15.26:45010) 2023-10-01T08:01:40.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.318+0000 7f63ad5df700 1 -- 172.21.15.26:0/2346621513 learned_addr learned my addr 172.21.15.26:0/2346621513 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:40.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.318+0000 7f63ae5e1700 1 --2- 172.21.15.26:0/2346621513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63a8138dc0 0x7f63a809d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:40.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.318+0000 7f63adde0700 1 -- 172.21.15.26:0/2346621513 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f63a81337f0 msgr2=0x7f63a809cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:40.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.318+0000 7f63adde0700 1 --2- 172.21.15.26:0/2346621513 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f63a81337f0 0x7f63a809cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:40.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.318+0000 7f63adde0700 1 -- 172.21.15.26:0/2346621513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63a8138dc0 msgr2=0x7f63a809d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:40.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.318+0000 7f63adde0700 1 --2- 172.21.15.26:0/2346621513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63a8138dc0 0x7f63a809d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:40.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.318+0000 7f63adde0700 1 -- 172.21.15.26:0/2346621513 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a0009a70 con 0x7f63a8133420 2023-10-01T08:01:40.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.318+0000 7f63ad5df700 1 --2- 172.21.15.26:0/2346621513 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f63a81337f0 0x7f63a809cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:40.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.319+0000 7f63adde0700 1 --2- 172.21.15.26:0/2346621513 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f63a8133420 0x7f63a809c9e0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f63a400c450 tx=0x7f63a400c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:40.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.319+0000 7f639e7fc700 1 -- 172.21.15.26:0/2346621513 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a40052d0 con 0x7f63a8133420 2023-10-01T08:01:40.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.319+0000 7f639e7fc700 1 -- 172.21.15.26:0/2346621513 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a4005430 con 0x7f63a8133420 2023-10-01T08:01:40.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.319+0000 7f639e7fc700 1 -- 172.21.15.26:0/2346621513 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a40038c0 con 0x7f63a8133420 2023-10-01T08:01:40.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.319+0000 7f63b0044700 1 -- 172.21.15.26:0/2346621513 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6398009550 con 0x7f63a8133420 2023-10-01T08:01:40.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.319+0000 7f63b0044700 1 -- 172.21.15.26:0/2346621513 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a8130d40 con 0x7f63a8133420 2023-10-01T08:01:40.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.320+0000 7f639e7fc700 1 -- 172.21.15.26:0/2346621513 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f63a4003a20 con 0x7f63a8133420 2023-10-01T08:01:40.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.320+0000 7f63b0044700 1 -- 172.21.15.26:0/2346621513 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63a8074ea0 con 0x7f63a8133420 2023-10-01T08:01:40.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.320+0000 7f639e7fc700 1 -- 172.21.15.26:0/2346621513 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f63a403e9b0 con 0x7f63a8133420 2023-10-01T08:01:40.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.325+0000 7f639e7fc700 1 -- 172.21.15.26:0/2346621513 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f63a4011590 con 0x7f63a8133420 2023-10-01T08:01:40.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.356+0000 7fb8f9417700 1 Processor -- start 2023-10-01T08:01:40.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.356+0000 7fb8f9417700 1 -- start start 2023-10-01T08:01:40.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.356+0000 7fb8f9417700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb8f409d6f0 0x7fb8f409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:40.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.356+0000 7fb8f9417700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb8f409e000 0x7fb8f4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:40.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.356+0000 7fb8f9417700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f409f130 con 0x7fb8f409e410 2023-10-01T08:01:40.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.356+0000 7fb8f9417700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f409f520 con 0x7fb8f409d6f0 2023-10-01T08:01:40.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.356+0000 7fb8f9417700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f409e930 con 0x7fb8f409e000 2023-10-01T08:01:40.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.357+0000 7fb8f27fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb8f409e000 0x7fb8f4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:40.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.356+0000 7fb8f2ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb8f409d6f0 0x7fb8f409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:40.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.357+0000 7fb8f27fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb8f409e000 0x7fb8f4130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59808/0 (socket says 172.21.15.26:59808) 2023-10-01T08:01:40.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.357+0000 7fb8f2ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb8f409d6f0 0x7fb8f409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44348/0 (socket says 172.21.15.26:44348) 2023-10-01T08:01:40.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.357+0000 7fb8f27fc700 1 -- 172.21.15.26:0/2417640103 learned_addr learned my addr 172.21.15.26:0/2417640103 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:40.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.357+0000 7fb8f2ffd700 1 -- 172.21.15.26:0/2417640103 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb8f409e000 msgr2=0x7fb8f4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:40.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.357+0000 7fb8f2ffd700 1 --2- 172.21.15.26:0/2417640103 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb8f409e000 0x7fb8f4130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:40.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.357+0000 7fb8f2ffd700 1 -- 172.21.15.26:0/2417640103 >> v1:172.21.15.26:6789/0 conn(0x7fb8f409e410 legacy=0x7fb8f4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:40.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.357+0000 7fb8f2ffd700 1 -- 172.21.15.26:0/2417640103 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f409b2d0 con 0x7fb8f409d6f0 2023-10-01T08:01:40.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.357+0000 7fb8f27fc700 1 --2- 172.21.15.26:0/2417640103 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb8f409e000 0x7fb8f4130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:40.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.357+0000 7fb8f2ffd700 1 --2- 172.21.15.26:0/2417640103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8f409d6f0 0x7fb8f409dac0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4009840 tx=0x7fb8e4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6b461aafe227b36 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:40.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.357+0000 7fb8f1ffb700 1 -- 172.21.15.26:0/2417640103 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e400f6a0 con 0x7fb8f409d6f0 2023-10-01T08:01:40.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.357+0000 7fb8f1ffb700 1 -- 172.21.15.26:0/2417640103 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e400f800 con 0x7fb8f409d6f0 2023-10-01T08:01:40.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.357+0000 7fb8f1ffb700 1 -- 172.21.15.26:0/2417640103 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e400fb90 con 0x7fb8f409d6f0 2023-10-01T08:01:40.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.358+0000 7fb8f9417700 1 -- 172.21.15.26:0/2417640103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8f409d6f0 msgr2=0x7fb8f409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:40.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.358+0000 7fb8f9417700 1 --2- 172.21.15.26:0/2417640103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8f409d6f0 0x7fb8f409dac0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4009840 tx=0x7fb8e4009b50 comp rx=0 tx=0).stop 2023-10-01T08:01:40.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.358+0000 7fb8f9417700 1 -- 172.21.15.26:0/2417640103 shutdown_connections 2023-10-01T08:01:40.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.358+0000 7fb8f9417700 1 --2- 172.21.15.26:0/2417640103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8f409d6f0 0x7fb8f409dac0 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:40.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.358+0000 7fb8f9417700 1 --2- 172.21.15.26:0/2417640103 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb8f409e000 0x7fb8f4130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:40.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.358+0000 7fb8f9417700 1 -- 172.21.15.26:0/2417640103 >> 172.21.15.26:0/2417640103 conn(0x7fb8f4066f50 msgr2=0x7fb8f409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:40.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.358+0000 7fb8f9417700 1 -- 172.21.15.26:0/2417640103 shutdown_connections 2023-10-01T08:01:40.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.358+0000 7fb8f9417700 1 -- 172.21.15.26:0/2417640103 wait complete. 2023-10-01T08:01:40.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.359+0000 7fb8f9417700 1 Processor -- start 2023-10-01T08:01:40.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.359+0000 7fb8f9417700 1 -- start start 2023-10-01T08:01:40.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.360+0000 7fb8f9417700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb8f409d6f0 0x7fb8f411e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:40.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.360+0000 7fb8f9417700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb8f409e000 0x7fb8f411e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:40.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.360+0000 7fb8f9417700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8f409e410 0x7fb8f411eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:40.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.360+0000 7fb8f9417700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f4120580 con 0x7fb8f409e410 2023-10-01T08:01:40.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.360+0000 7fb8f9417700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f4121bc0 con 0x7fb8f409e000 2023-10-01T08:01:40.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.360+0000 7fb8f9417700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f4120260 con 0x7fb8f409d6f0 2023-10-01T08:01:40.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.360+0000 7fb8f2ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb8f409d6f0 0x7fb8f411e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:40.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.360+0000 7fb8f27fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb8f409e000 0x7fb8f411e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:40.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.360+0000 7fb8f2ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb8f409d6f0 0x7fb8f411e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59822/0 (socket says 172.21.15.26:59822) 2023-10-01T08:01:40.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.360+0000 7fb8f27fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb8f409e000 0x7fb8f411e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45022/0 (socket says 172.21.15.26:45022) 2023-10-01T08:01:40.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.360+0000 7fb8f2ffd700 1 -- 172.21.15.26:0/3628626881 learned_addr learned my addr 172.21.15.26:0/3628626881 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:40.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.360+0000 7fb8f37fe700 1 --2- 172.21.15.26:0/3628626881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8f409e410 0x7fb8f411eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:40.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.360+0000 7fb8f2ffd700 1 -- 172.21.15.26:0/3628626881 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb8f409e000 msgr2=0x7fb8f411e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:40.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.361+0000 7fb8f2ffd700 1 --2- 172.21.15.26:0/3628626881 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb8f409e000 0x7fb8f411e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:40.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.361+0000 7fb8f2ffd700 1 -- 172.21.15.26:0/3628626881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8f409e410 msgr2=0x7fb8f411eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:40.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.361+0000 7fb8f2ffd700 1 --2- 172.21.15.26:0/3628626881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8f409e410 0x7fb8f411eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:40.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.361+0000 7fb8f2ffd700 1 -- 172.21.15.26:0/3628626881 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e8009550 con 0x7fb8f409d6f0 2023-10-01T08:01:40.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.361+0000 7fb8f27fc700 1 --2- 172.21.15.26:0/3628626881 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb8f409e000 0x7fb8f411e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:40.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.361+0000 7fb8f2ffd700 1 --2- 172.21.15.26:0/3628626881 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb8f409d6f0 0x7fb8f411e0a0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fb8e40090b0 tx=0x7fb8e4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:40.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.361+0000 7fb8db7fe700 1 -- 172.21.15.26:0/3628626881 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e401e070 con 0x7fb8f409d6f0 2023-10-01T08:01:40.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.361+0000 7fb8db7fe700 1 -- 172.21.15.26:0/3628626881 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e400e1b0 con 0x7fb8f409d6f0 2023-10-01T08:01:40.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.361+0000 7fb8f9417700 1 -- 172.21.15.26:0/3628626881 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e40094a0 con 0x7fb8f409d6f0 2023-10-01T08:01:40.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.361+0000 7fb8db7fe700 1 -- 172.21.15.26:0/3628626881 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e400fb90 con 0x7fb8f409d6f0 2023-10-01T08:01:40.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.361+0000 7fb8f9417700 1 -- 172.21.15.26:0/3628626881 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f4121620 con 0x7fb8f409d6f0 2023-10-01T08:01:40.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.362+0000 7fb8db7fe700 1 -- 172.21.15.26:0/3628626881 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb8e4022070 con 0x7fb8f409d6f0 2023-10-01T08:01:40.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.362+0000 7fb8db7fe700 1 -- 172.21.15.26:0/3628626881 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb8e40403e0 con 0x7fb8f409d6f0 2023-10-01T08:01:40.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.362+0000 7fb8f9417700 1 -- 172.21.15.26:0/3628626881 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f4072450 con 0x7fb8f409d6f0 2023-10-01T08:01:40.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.367+0000 7fb8db7fe700 1 -- 172.21.15.26:0/3628626881 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb8e4029080 con 0x7fb8f409d6f0 2023-10-01T08:01:40.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.500+0000 7f8ce7299700 1 -- 172.21.15.26:0/231874303 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8ce0074ea0 con 0x7f8ce00954c0 2023-10-01T08:01:40.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.500+0000 7f8cd5ffb700 1 -- 172.21.15.26:0/231874303 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8cdc021030 con 0x7f8ce00954c0 2023-10-01T08:01:40.501 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:40.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.503+0000 7f8ce7299700 1 -- 172.21.15.26:0/231874303 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ce00954c0 msgr2=0x7f8ce00933a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:40.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.503+0000 7f8ce7299700 1 --2- 172.21.15.26:0/231874303 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ce00954c0 0x7f8ce00933a0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc00ebe0 tx=0x7f8cdc00eef0 comp rx=0 tx=0).stop 2023-10-01T08:01:40.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.503+0000 7f8ce7299700 1 -- 172.21.15.26:0/231874303 shutdown_connections 2023-10-01T08:01:40.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.503+0000 7f8ce7299700 1 --2- 172.21.15.26:0/231874303 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8ce0099ff0 0x7f8ce0093e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:40.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.503+0000 7f8ce7299700 1 --2- 172.21.15.26:0/231874303 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ce00954c0 0x7f8ce00933a0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:40.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.503+0000 7f8ce7299700 1 --2- 172.21.15.26:0/231874303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ce0099680 0x7f8ce00938e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:40.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.503+0000 7f8ce7299700 1 -- 172.21.15.26:0/231874303 >> 172.21.15.26:0/231874303 conn(0x7f8ce00a2360 msgr2=0x7f8ce00980c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:40.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.503+0000 7f8ce7299700 1 -- 172.21.15.26:0/231874303 shutdown_connections 2023-10-01T08:01:40.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.503+0000 7f8ce7299700 1 -- 172.21.15.26:0/231874303 wait complete. 2023-10-01T08:01:40.517 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:40.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.534+0000 7f63b0044700 1 -- 172.21.15.26:0/2346621513 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f63a806b250 con 0x7f63a8133420 2023-10-01T08:01:40.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.535+0000 7f639e7fc700 1 -- 172.21.15.26:0/2346621513 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f63a4017020 con 0x7f63a8133420 2023-10-01T08:01:40.536 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:40.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.537+0000 7f63b0044700 1 -- 172.21.15.26:0/2346621513 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f63a8133420 msgr2=0x7f63a809c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:40.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.537+0000 7f63b0044700 1 --2- 172.21.15.26:0/2346621513 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f63a8133420 0x7f63a809c9e0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f63a400c450 tx=0x7f63a400c760 comp rx=0 tx=0).stop 2023-10-01T08:01:40.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.537+0000 7f63b0044700 1 -- 172.21.15.26:0/2346621513 shutdown_connections 2023-10-01T08:01:40.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.537+0000 7f63b0044700 1 --2- 172.21.15.26:0/2346621513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63a8138dc0 0x7f63a809d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:40.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.537+0000 7f63b0044700 1 --2- 172.21.15.26:0/2346621513 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f63a8133420 0x7f63a809c9e0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:40.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.537+0000 7f63b0044700 1 --2- 172.21.15.26:0/2346621513 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f63a81337f0 0x7f63a809cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:40.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.537+0000 7f63b0044700 1 -- 172.21.15.26:0/2346621513 >> 172.21.15.26:0/2346621513 conn(0x7f63a80a4210 msgr2=0x7f63a80a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:40.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.537+0000 7f63b0044700 1 -- 172.21.15.26:0/2346621513 shutdown_connections 2023-10-01T08:01:40.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.537+0000 7f63b0044700 1 -- 172.21.15.26:0/2346621513 wait complete. 2023-10-01T08:01:40.551 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:40.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.576+0000 7fb8f9417700 1 -- 172.21.15.26:0/3628626881 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb8f4074ea0 con 0x7fb8f409d6f0 2023-10-01T08:01:40.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.577+0000 7fb8db7fe700 1 -- 172.21.15.26:0/3628626881 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb8e402c770 con 0x7fb8f409d6f0 2023-10-01T08:01:40.578 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:40.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.579+0000 7fb8f9417700 1 -- 172.21.15.26:0/3628626881 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb8f409d6f0 msgr2=0x7fb8f411e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:40.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.579+0000 7fb8f9417700 1 --2- 172.21.15.26:0/3628626881 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb8f409d6f0 0x7fb8f411e0a0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fb8e40090b0 tx=0x7fb8e4004750 comp rx=0 tx=0).stop 2023-10-01T08:01:40.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.579+0000 7fb8f9417700 1 -- 172.21.15.26:0/3628626881 shutdown_connections 2023-10-01T08:01:40.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.579+0000 7fb8f9417700 1 --2- 172.21.15.26:0/3628626881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8f409e410 0x7fb8f411eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:40.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.579+0000 7fb8f9417700 1 --2- 172.21.15.26:0/3628626881 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb8f409d6f0 0x7fb8f411e0a0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:40.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.579+0000 7fb8f9417700 1 --2- 172.21.15.26:0/3628626881 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb8f409e000 0x7fb8f411e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:40.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.579+0000 7fb8f9417700 1 -- 172.21.15.26:0/3628626881 >> 172.21.15.26:0/3628626881 conn(0x7fb8f4066f50 msgr2=0x7fb8f406efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:40.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.579+0000 7fb8f9417700 1 -- 172.21.15.26:0/3628626881 shutdown_connections 2023-10-01T08:01:40.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.579+0000 7fb8f9417700 1 -- 172.21.15.26:0/3628626881 wait complete. 2023-10-01T08:01:40.594 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:40.611 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:40.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.773+0000 7f5acb584700 1 Processor -- start 2023-10-01T08:01:40.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.773+0000 7f5acb584700 1 -- start start 2023-10-01T08:01:40.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.773+0000 7f5acb584700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5ac4133420 0x7f5ac41337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:40.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.773+0000 7f5acb584700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5ac4133e30 0x7f5ac412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:40.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.773+0000 7f5acb584700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5ac4134260 0x7f5ac41304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:40.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.773+0000 7f5acb584700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ac406b990 con 0x7f5ac4133420 2023-10-01T08:01:40.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.773+0000 7f5acb584700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac40a0590 con 0x7f5ac4133e30 2023-10-01T08:01:40.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.773+0000 7f5acb584700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac409fb80 con 0x7f5ac4134260 2023-10-01T08:01:40.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.774+0000 7f5ac8b1f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5ac4133e30 0x7f5ac412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:40.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.774+0000 7f5ac9320700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5ac4133420 0x7f5ac41337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:40.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.774+0000 7f5ac9b21700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5ac4134260 0x7f5ac41304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:40.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.774+0000 7f5ac9320700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5ac4133420 0x7f5ac41337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44366/0 (socket says 172.21.15.26:44366) 2023-10-01T08:01:40.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.774+0000 7f5ac8b1f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5ac4133e30 0x7f5ac412ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45024/0 (socket says 172.21.15.26:45024) 2023-10-01T08:01:40.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.774+0000 7f5ac9320700 1 -- 172.21.15.26:0/2618065727 learned_addr learned my addr 172.21.15.26:0/2618065727 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:40.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.774+0000 7f5ac9320700 1 -- 172.21.15.26:0/2618065727 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5ac4134260 msgr2=0x7f5ac41304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:40.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.774+0000 7f5ac9320700 1 --2- 172.21.15.26:0/2618065727 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5ac4134260 0x7f5ac41304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:40.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.774+0000 7f5ac9320700 1 -- 172.21.15.26:0/2618065727 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5ac4133e30 msgr2=0x7f5ac412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:40.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.774+0000 7f5ac9320700 1 --2- 172.21.15.26:0/2618065727 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5ac4133e30 0x7f5ac412ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:40.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.774+0000 7f5ac9320700 1 -- 172.21.15.26:0/2618065727 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac40a0030 con 0x7f5ac4133420 2023-10-01T08:01:40.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.774+0000 7f5ac8b1f700 1 --2- 172.21.15.26:0/2618065727 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5ac4133e30 0x7f5ac412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:40.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.774+0000 7f5ac9b21700 1 --2- 172.21.15.26:0/2618065727 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5ac4134260 0x7f5ac41304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:40.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.774+0000 7f5ac9320700 1 --2- 172.21.15.26:0/2618065727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ac4133420 0x7f5ac41337f0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f5ac00098f0 tx=0x7f5ac0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f40b4e5a54764ca server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:40.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.774+0000 7f5abbfff700 1 -- 172.21.15.26:0/2618065727 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac0011830 con 0x7f5ac4133420 2023-10-01T08:01:40.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.774+0000 7f5abbfff700 1 -- 172.21.15.26:0/2618065727 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac0011990 con 0x7f5ac4133420 2023-10-01T08:01:40.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.774+0000 7f5abbfff700 1 -- 172.21.15.26:0/2618065727 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac0011d20 con 0x7f5ac4133420 2023-10-01T08:01:40.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.775+0000 7f5acb584700 1 -- 172.21.15.26:0/2618065727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ac4133420 msgr2=0x7f5ac41337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:40.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.775+0000 7f5acb584700 1 --2- 172.21.15.26:0/2618065727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ac4133420 0x7f5ac41337f0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f5ac00098f0 tx=0x7f5ac0009c00 comp rx=0 tx=0).stop 2023-10-01T08:01:40.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.775+0000 7f5acb584700 1 -- 172.21.15.26:0/2618065727 shutdown_connections 2023-10-01T08:01:40.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.775+0000 7f5acb584700 1 --2- 172.21.15.26:0/2618065727 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5ac4134260 0x7f5ac41304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:40.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.775+0000 7f5acb584700 1 --2- 172.21.15.26:0/2618065727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ac4133420 0x7f5ac41337f0 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:40.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.775+0000 7f5acb584700 1 --2- 172.21.15.26:0/2618065727 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5ac4133e30 0x7f5ac412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:40.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.775+0000 7f5acb584700 1 -- 172.21.15.26:0/2618065727 >> 172.21.15.26:0/2618065727 conn(0x7f5ac40a4210 msgr2=0x7f5ac40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:40.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.775+0000 7f5acb584700 1 -- 172.21.15.26:0/2618065727 shutdown_connections 2023-10-01T08:01:40.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.775+0000 7f5acb584700 1 -- 172.21.15.26:0/2618065727 wait complete. 2023-10-01T08:01:40.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.776+0000 7f5acb584700 1 Processor -- start 2023-10-01T08:01:40.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.776+0000 7f5acb584700 1 -- start start 2023-10-01T08:01:40.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.777+0000 7f5acb584700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5ac4133420 0x7f5ac409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:40.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.777+0000 7f5acb584700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5ac4133e30 0x7f5ac409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:40.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.777+0000 7f5acb584700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ac4134260 0x7f5ac409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:40.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.777+0000 7f5acb584700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac4131470 con 0x7f5ac4134260 2023-10-01T08:01:40.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.777+0000 7f5acb584700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac4120170 con 0x7f5ac4133e30 2023-10-01T08:01:40.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.777+0000 7f5acb584700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac409d950 con 0x7f5ac4133420 2023-10-01T08:01:40.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.777+0000 7f5ac9320700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5ac4133420 0x7f5ac409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:40.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.777+0000 7f5ac9b21700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ac4134260 0x7f5ac409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:40.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.777+0000 7f5ac9320700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5ac4133420 0x7f5ac409c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59836/0 (socket says 172.21.15.26:59836) 2023-10-01T08:01:40.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.777+0000 7f5ac9320700 1 -- 172.21.15.26:0/4103396585 learned_addr learned my addr 172.21.15.26:0/4103396585 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:40.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.777+0000 7f5ac8b1f700 1 --2- 172.21.15.26:0/4103396585 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5ac4133e30 0x7f5ac409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:40.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.777+0000 7f5ac9320700 1 -- 172.21.15.26:0/4103396585 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5ac4133e30 msgr2=0x7f5ac409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:40.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.777+0000 7f5ac9320700 1 --2- 172.21.15.26:0/4103396585 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5ac4133e30 0x7f5ac409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:40.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.777+0000 7f5ac9320700 1 -- 172.21.15.26:0/4103396585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ac4134260 msgr2=0x7f5ac409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:40.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.777+0000 7f5ac9320700 1 --2- 172.21.15.26:0/4103396585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ac4134260 0x7f5ac409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:40.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.777+0000 7f5ac9320700 1 -- 172.21.15.26:0/4103396585 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab40094a0 con 0x7f5ac4133420 2023-10-01T08:01:40.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.777+0000 7f5ac9b21700 1 --2- 172.21.15.26:0/4103396585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ac4134260 0x7f5ac409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:40.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.777+0000 7f5ac9320700 1 --2- 172.21.15.26:0/4103396585 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5ac4133420 0x7f5ac409c480 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0000c00 tx=0x7f5ac0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:40.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.777+0000 7f5ab9ffb700 1 -- 172.21.15.26:0/4103396585 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac0004450 con 0x7f5ac4133420 2023-10-01T08:01:40.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.778+0000 7f5ab9ffb700 1 -- 172.21.15.26:0/4103396585 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac00045b0 con 0x7f5ac4133420 2023-10-01T08:01:40.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.778+0000 7f5acb584700 1 -- 172.21.15.26:0/4103396585 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5abc009a70 con 0x7f5ac4133420 2023-10-01T08:01:40.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.778+0000 7f5ab9ffb700 1 -- 172.21.15.26:0/4103396585 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac00038e0 con 0x7f5ac4133420 2023-10-01T08:01:40.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.778+0000 7f5acb584700 1 -- 172.21.15.26:0/4103396585 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac0009550 con 0x7f5ac4133420 2023-10-01T08:01:40.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.779+0000 7f5ab9ffb700 1 -- 172.21.15.26:0/4103396585 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5ac0021070 con 0x7f5ac4133420 2023-10-01T08:01:40.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.779+0000 7f5ab9ffb700 1 -- 172.21.15.26:0/4103396585 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5ac0040ac0 con 0x7f5ac4133420 2023-10-01T08:01:40.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.779+0000 7f5acb584700 1 -- 172.21.15.26:0/4103396585 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ac4074ea0 con 0x7f5ac4133420 2023-10-01T08:01:40.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.784+0000 7f5ab9ffb700 1 -- 172.21.15.26:0/4103396585 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5ac0015020 con 0x7f5ac4133420 2023-10-01T08:01:40.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.988+0000 7f5acb584700 1 -- 172.21.15.26:0/4103396585 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5ac406b250 con 0x7f5ac4133420 2023-10-01T08:01:40.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.988+0000 7f5ab9ffb700 1 -- 172.21.15.26:0/4103396585 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5ac0003a40 con 0x7f5ac4133420 2023-10-01T08:01:40.989 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:40.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.990+0000 7f5acb584700 1 -- 172.21.15.26:0/4103396585 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5ac4133420 msgr2=0x7f5ac409c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:40.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.990+0000 7f5acb584700 1 --2- 172.21.15.26:0/4103396585 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5ac4133420 0x7f5ac409c480 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0000c00 tx=0x7f5ac0004750 comp rx=0 tx=0).stop 2023-10-01T08:01:40.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.990+0000 7f5acb584700 1 -- 172.21.15.26:0/4103396585 shutdown_connections 2023-10-01T08:01:40.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.990+0000 7f5acb584700 1 --2- 172.21.15.26:0/4103396585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ac4134260 0x7f5ac409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:40.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.990+0000 7f5acb584700 1 --2- 172.21.15.26:0/4103396585 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5ac4133420 0x7f5ac409c480 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:40.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.990+0000 7f5acb584700 1 --2- 172.21.15.26:0/4103396585 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5ac4133e30 0x7f5ac409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:40.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.990+0000 7f5acb584700 1 -- 172.21.15.26:0/4103396585 >> 172.21.15.26:0/4103396585 conn(0x7f5ac40a4210 msgr2=0x7f5ac4130250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:40.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.991+0000 7f5acb584700 1 -- 172.21.15.26:0/4103396585 shutdown_connections 2023-10-01T08:01:40.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:40.991+0000 7f5acb584700 1 -- 172.21.15.26:0/4103396585 wait complete. 2023-10-01T08:01:41.005 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:41.518 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:41.552 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:41.594 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:41.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.669+0000 7f3b16480700 1 Processor -- start 2023-10-01T08:01:41.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.669+0000 7f3b16480700 1 -- start start 2023-10-01T08:01:41.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.669+0000 7f3b16480700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3b1009e930 0x7f3b1009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:41.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.670+0000 7f3b16480700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3b1009f650 0x7f3b10131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:41.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.670+0000 7f3b16480700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b10070940 con 0x7f3b1009f240 2023-10-01T08:01:41.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.670+0000 7f3b16480700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1006fd60 con 0x7f3b1009f650 2023-10-01T08:01:41.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.670+0000 7f3b16480700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1006fa80 con 0x7f3b1009e930 2023-10-01T08:01:41.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.670+0000 7f3b0ffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3b1009e930 0x7f3b1009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:41.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.670+0000 7f3b0ffff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3b1009e930 0x7f3b1009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59840/0 (socket says 172.21.15.26:59840) 2023-10-01T08:01:41.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.670+0000 7f3b0ffff700 1 -- 172.21.15.26:0/3143119781 learned_addr learned my addr 172.21.15.26:0/3143119781 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:41.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.670+0000 7f3b14a1d700 1 --2- 172.21.15.26:0/3143119781 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3b1009f650 0x7f3b10131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:41.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.670+0000 7f3b14a1d700 1 -- 172.21.15.26:0/3143119781 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3b1009e930 msgr2=0x7f3b1009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:41.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.670+0000 7f3b14a1d700 1 --2- 172.21.15.26:0/3143119781 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3b1009e930 0x7f3b1009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:41.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.670+0000 7f3b14a1d700 1 -- 172.21.15.26:0/3143119781 >> v1:172.21.15.26:6789/0 conn(0x7f3b1009f240 legacy=0x7f3b101317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:41.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.670+0000 7f3b0effd700 1 -- 172.21.15.26:0/3143119781 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 651470507 0 0) 0x7f3b10070940 con 0x7f3b1009f240 2023-10-01T08:01:41.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.670+0000 7f3b14a1d700 1 -- 172.21.15.26:0/3143119781 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b1009fb60 con 0x7f3b1009f650 2023-10-01T08:01:41.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.670+0000 7f3b0ffff700 1 --2- 172.21.15.26:0/3143119781 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3b1009e930 0x7f3b1009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:41.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.670+0000 7f3b14a1d700 1 --2- 172.21.15.26:0/3143119781 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3b1009f650 0x7f3b10131f00 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f3b08009dc0 tx=0x7f3b0800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a73bbf6a6a3b8d04 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:41.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.671+0000 7f3b0effd700 1 -- 172.21.15.26:0/3143119781 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0800e070 con 0x7f3b1009f650 2023-10-01T08:01:41.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.671+0000 7f3b0effd700 1 -- 172.21.15.26:0/3143119781 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0800bb20 con 0x7f3b1009f650 2023-10-01T08:01:41.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.671+0000 7f3b0effd700 1 -- 172.21.15.26:0/3143119781 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b08012430 con 0x7f3b1009f650 2023-10-01T08:01:41.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.671+0000 7f3b16480700 1 -- 172.21.15.26:0/3143119781 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3b1009f650 msgr2=0x7f3b10131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:41.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.671+0000 7f3b16480700 1 --2- 172.21.15.26:0/3143119781 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3b1009f650 0x7f3b10131f00 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f3b08009dc0 tx=0x7f3b0800b330 comp rx=0 tx=0).stop 2023-10-01T08:01:41.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.671+0000 7f3b16480700 1 -- 172.21.15.26:0/3143119781 shutdown_connections 2023-10-01T08:01:41.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.671+0000 7f3b16480700 1 --2- 172.21.15.26:0/3143119781 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3b1009e930 0x7f3b1009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:41.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.671+0000 7f3b16480700 1 --2- 172.21.15.26:0/3143119781 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3b1009f650 0x7f3b10131f00 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:41.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.671+0000 7f3b16480700 1 -- 172.21.15.26:0/3143119781 >> 172.21.15.26:0/3143119781 conn(0x7f3b100a4210 msgr2=0x7f3b100a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:41.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.672+0000 7f3b16480700 1 -- 172.21.15.26:0/3143119781 shutdown_connections 2023-10-01T08:01:41.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.672+0000 7f3b16480700 1 -- 172.21.15.26:0/3143119781 wait complete. 2023-10-01T08:01:41.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.673+0000 7f3b16480700 1 Processor -- start 2023-10-01T08:01:41.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.673+0000 7f3b16480700 1 -- start start 2023-10-01T08:01:41.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.673+0000 7f3b16480700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3b1009e930 0x7f3b101c8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:41.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.673+0000 7f3b16480700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3b1009f240 0x7f3b101c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:41.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.673+0000 7f3b16480700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b1009f650 0x7f3b101c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:41.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.673+0000 7f3b16480700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1006d380 con 0x7f3b1009f650 2023-10-01T08:01:41.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.673+0000 7f3b16480700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b101a7470 con 0x7f3b1009e930 2023-10-01T08:01:41.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.673+0000 7f3b16480700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b101a79c0 con 0x7f3b1009f240 2023-10-01T08:01:41.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.674+0000 7f3b0f7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3b1009f240 0x7f3b101c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:41.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.674+0000 7f3b0ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3b1009e930 0x7f3b101c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:41.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.674+0000 7f3b0f7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3b1009f240 0x7f3b101c85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:59848/0 (socket says 172.21.15.26:59848) 2023-10-01T08:01:41.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.674+0000 7f3b0ffff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3b1009e930 0x7f3b101c8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45046/0 (socket says 172.21.15.26:45046) 2023-10-01T08:01:41.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.674+0000 7f3b0f7fe700 1 -- 172.21.15.26:0/3860458322 learned_addr learned my addr 172.21.15.26:0/3860458322 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:41.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.674+0000 7f3b14a1d700 1 --2- 172.21.15.26:0/3860458322 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b1009f650 0x7f3b101c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:41.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.674+0000 7f3b0f7fe700 1 -- 172.21.15.26:0/3860458322 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3b1009e930 msgr2=0x7f3b101c8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:41.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.674+0000 7f3b0f7fe700 1 --2- 172.21.15.26:0/3860458322 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3b1009e930 0x7f3b101c8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:41.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.674+0000 7f3b0f7fe700 1 -- 172.21.15.26:0/3860458322 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b1009f650 msgr2=0x7f3b101c8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:41.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.674+0000 7f3b0f7fe700 1 --2- 172.21.15.26:0/3860458322 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b1009f650 0x7f3b101c8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:41.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.674+0000 7f3b0f7fe700 1 -- 172.21.15.26:0/3860458322 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b00009550 con 0x7f3b1009f240 2023-10-01T08:01:41.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.674+0000 7f3b0f7fe700 1 --2- 172.21.15.26:0/3860458322 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3b1009f240 0x7f3b101c85b0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f3b0400c550 tx=0x7f3b0400c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:41.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.674+0000 7f3b0cff9700 1 -- 172.21.15.26:0/3860458322 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b040054e0 con 0x7f3b1009f240 2023-10-01T08:01:41.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.674+0000 7f3b0cff9700 1 -- 172.21.15.26:0/3860458322 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b04003680 con 0x7f3b1009f240 2023-10-01T08:01:41.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.674+0000 7f3b16480700 1 -- 172.21.15.26:0/3860458322 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b08009a70 con 0x7f3b1009f240 2023-10-01T08:01:41.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.675+0000 7f3b0cff9700 1 -- 172.21.15.26:0/3860458322 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b04003a30 con 0x7f3b1009f240 2023-10-01T08:01:41.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.675+0000 7f3b16480700 1 -- 172.21.15.26:0/3860458322 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b100a0190 con 0x7f3b1009f240 2023-10-01T08:01:41.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.675+0000 7f3b0cff9700 1 -- 172.21.15.26:0/3860458322 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3b04003b90 con 0x7f3b1009f240 2023-10-01T08:01:41.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.676+0000 7f3b0cff9700 1 -- 172.21.15.26:0/3860458322 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3b0403eb80 con 0x7f3b1009f240 2023-10-01T08:01:41.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.676+0000 7f3b16480700 1 -- 172.21.15.26:0/3860458322 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b10074ea0 con 0x7f3b1009f240 2023-10-01T08:01:41.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.685+0000 7f3b0cff9700 1 -- 172.21.15.26:0/3860458322 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3b04017020 con 0x7f3b1009f240 2023-10-01T08:01:41.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.710+0000 7f0f8cf25700 1 Processor -- start 2023-10-01T08:01:41.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.710+0000 7f0f8cf25700 1 -- start start 2023-10-01T08:01:41.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.711+0000 7f0f8cf25700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f8809d6f0 0x7f0f8809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:41.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.711+0000 7f0f8cf25700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f8809e000 0x7f0f881339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:41.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.711+0000 7f0f8cf25700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0f8809e410 0x7f0f88133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:41.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.711+0000 7f0f8cf25700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f8806b460 con 0x7f0f8809e410 2023-10-01T08:01:41.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.711+0000 7f0f8cf25700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8809b120 con 0x7f0f8809d6f0 2023-10-01T08:01:41.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.711+0000 7f0f8cf25700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8809a7e0 con 0x7f0f8809e000 2023-10-01T08:01:41.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.711+0000 7f0f8659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f8809d6f0 0x7f0f8809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:41.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.711+0000 7f0f8659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f8809d6f0 0x7f0f8809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45048/0 (socket says 172.21.15.26:45048) 2023-10-01T08:01:41.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.711+0000 7f0f8659c700 1 -- 172.21.15.26:0/1515561704 learned_addr learned my addr 172.21.15.26:0/1515561704 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:41.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.711+0000 7f0f85d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f8809e000 0x7f0f881339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:41.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.712+0000 7f0f86d9d700 1 --2- 172.21.15.26:0/1515561704 >> v2:172.21.15.26:3300/0 conn(0x7f0f8809e410 0x7f0f88133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:41.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.712+0000 7f0f8659c700 1 -- 172.21.15.26:0/1515561704 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f8809e000 msgr2=0x7f0f881339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:41.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.712+0000 7f0f8659c700 1 --2- 172.21.15.26:0/1515561704 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f8809e000 0x7f0f881339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:41.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.712+0000 7f0f8659c700 1 -- 172.21.15.26:0/1515561704 >> v2:172.21.15.26:3300/0 conn(0x7f0f8809e410 msgr2=0x7f0f88133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:41.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.712+0000 7f0f8659c700 1 --2- 172.21.15.26:0/1515561704 >> v2:172.21.15.26:3300/0 conn(0x7f0f8809e410 0x7f0f88133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:41.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.712+0000 7f0f8659c700 1 -- 172.21.15.26:0/1515561704 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f8809a500 con 0x7f0f8809d6f0 2023-10-01T08:01:41.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.712+0000 7f0f86d9d700 1 --2- 172.21.15.26:0/1515561704 >> v2:172.21.15.26:3300/0 conn(0x7f0f8809e410 0x7f0f88133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T08:01:41.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.712+0000 7f0f8659c700 1 --2- 172.21.15.26:0/1515561704 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f8809d6f0 0x7f0f8809dac0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f0f78009920 tx=0x7f0f78009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9171717b97df60ee server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:41.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.712+0000 7f0f8559a700 1 -- 172.21.15.26:0/1515561704 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f78011830 con 0x7f0f8809d6f0 2023-10-01T08:01:41.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.712+0000 7f0f8559a700 1 -- 172.21.15.26:0/1515561704 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f78011990 con 0x7f0f8809d6f0 2023-10-01T08:01:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.712+0000 7f0f8559a700 1 -- 172.21.15.26:0/1515561704 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f78011d20 con 0x7f0f8809d6f0 2023-10-01T08:01:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.713+0000 7f0f8cf25700 1 -- 172.21.15.26:0/1515561704 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f8809d6f0 msgr2=0x7f0f8809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.713+0000 7f0f8cf25700 1 --2- 172.21.15.26:0/1515561704 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f8809d6f0 0x7f0f8809dac0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f0f78009920 tx=0x7f0f78009c30 comp rx=0 tx=0).stop 2023-10-01T08:01:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.713+0000 7f0f8cf25700 1 -- 172.21.15.26:0/1515561704 shutdown_connections 2023-10-01T08:01:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.713+0000 7f0f8cf25700 1 --2- 172.21.15.26:0/1515561704 >> v2:172.21.15.26:3300/0 conn(0x7f0f8809e410 0x7f0f88133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.713+0000 7f0f8cf25700 1 --2- 172.21.15.26:0/1515561704 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f8809d6f0 0x7f0f8809dac0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.713+0000 7f0f8cf25700 1 --2- 172.21.15.26:0/1515561704 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f8809e000 0x7f0f881339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.713+0000 7f0f8cf25700 1 -- 172.21.15.26:0/1515561704 >> 172.21.15.26:0/1515561704 conn(0x7f0f88066f50 msgr2=0x7f0f8809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.713+0000 7f0f8cf25700 1 -- 172.21.15.26:0/1515561704 shutdown_connections 2023-10-01T08:01:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.713+0000 7f0f8cf25700 1 -- 172.21.15.26:0/1515561704 wait complete. 2023-10-01T08:01:41.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.715+0000 7f0f8cf25700 1 Processor -- start 2023-10-01T08:01:41.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.715+0000 7f0f8cf25700 1 -- start start 2023-10-01T08:01:41.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.716+0000 7f0f8cf25700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f8809d6f0 0x7f0f881a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:41.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.716+0000 7f0f8cf25700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f8809e000 0x7f0f881a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:41.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.716+0000 7f0f8cf25700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f8809e410 0x7f0f881c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:41.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.716+0000 7f0f8cf25700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f881a81a0 con 0x7f0f8809d6f0 2023-10-01T08:01:41.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.716+0000 7f0f8cf25700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f881a8380 con 0x7f0f8809e410 2023-10-01T08:01:41.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.716+0000 7f0f8cf25700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f881b91f0 con 0x7f0f8809e000 2023-10-01T08:01:41.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.716+0000 7f0f8659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f8809d6f0 0x7f0f881a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:41.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.716+0000 7f0f8659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f8809d6f0 0x7f0f881a52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44410/0 (socket says 172.21.15.26:44410) 2023-10-01T08:01:41.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.716+0000 7f0f8659c700 1 -- 172.21.15.26:0/4035866886 learned_addr learned my addr 172.21.15.26:0/4035866886 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:41.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.716+0000 7f0f85d9b700 1 --2- 172.21.15.26:0/4035866886 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f8809e000 0x7f0f881a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:41.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.716+0000 7f0f86d9d700 1 --2- 172.21.15.26:0/4035866886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f8809e410 0x7f0f881c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:41.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.716+0000 7f0f8659c700 1 -- 172.21.15.26:0/4035866886 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f8809e000 msgr2=0x7f0f881a5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:41.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.716+0000 7f0f8659c700 1 --2- 172.21.15.26:0/4035866886 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f8809e000 0x7f0f881a5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:41.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.716+0000 7f0f8659c700 1 -- 172.21.15.26:0/4035866886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f8809e410 msgr2=0x7f0f881c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:41.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.716+0000 7f0f8659c700 1 --2- 172.21.15.26:0/4035866886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f8809e410 0x7f0f881c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:41.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.717+0000 7f0f8659c700 1 -- 172.21.15.26:0/4035866886 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f78009550 con 0x7f0f8809d6f0 2023-10-01T08:01:41.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.717+0000 7f0f8659c700 1 --2- 172.21.15.26:0/4035866886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f8809d6f0 0x7f0f881a52c0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f0f78009c70 tx=0x7f0f78004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:41.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.717+0000 7f0f76ffd700 1 -- 172.21.15.26:0/4035866886 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f78004300 con 0x7f0f8809d6f0 2023-10-01T08:01:41.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.717+0000 7f0f76ffd700 1 -- 172.21.15.26:0/4035866886 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7801f070 con 0x7f0f8809d6f0 2023-10-01T08:01:41.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.717+0000 7f0f8cf25700 1 -- 172.21.15.26:0/4035866886 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f881a4d20 con 0x7f0f8809d6f0 2023-10-01T08:01:41.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.717+0000 7f0f76ffd700 1 -- 172.21.15.26:0/4035866886 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f780036a0 con 0x7f0f8809d6f0 2023-10-01T08:01:41.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.717+0000 7f0f8cf25700 1 -- 172.21.15.26:0/4035866886 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f881a6c60 con 0x7f0f8809d6f0 2023-10-01T08:01:41.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.718+0000 7f0f8cf25700 1 -- 172.21.15.26:0/4035866886 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f88074ea0 con 0x7f0f8809d6f0 2023-10-01T08:01:41.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.718+0000 7f0f76ffd700 1 -- 172.21.15.26:0/4035866886 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f78021030 con 0x7f0f8809d6f0 2023-10-01T08:01:41.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.719+0000 7f0f76ffd700 1 -- 172.21.15.26:0/4035866886 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0f7801a450 con 0x7f0f8809d6f0 2023-10-01T08:01:41.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.724+0000 7f0f76ffd700 1 -- 172.21.15.26:0/4035866886 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f7800b9d0 con 0x7f0f8809d6f0 2023-10-01T08:01:41.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.767+0000 7fb22f333700 1 Processor -- start 2023-10-01T08:01:41.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.767+0000 7fb22f333700 1 -- start start 2023-10-01T08:01:41.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.768+0000 7fb22f333700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb2280a0a30 0x7fb2280a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:41.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.768+0000 7fb22f333700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb22809d630 0x7fb2280a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:41.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.768+0000 7fb22f333700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2280a2a70 con 0x7fb228133930 2023-10-01T08:01:41.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.768+0000 7fb22f333700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2280a01d0 con 0x7fb2280a0a30 2023-10-01T08:01:41.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.768+0000 7fb22f333700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb22809e2b0 con 0x7fb22809d630 2023-10-01T08:01:41.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.768+0000 7fb22d0cf700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb2280a0a30 0x7fb2280a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:41.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.768+0000 7fb22c8ce700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb22809d630 0x7fb2280a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:41.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.768+0000 7fb22d8d0700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb228133930 0x7fb228133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44372/0 (socket says 172.21.15.26:44372) 2023-10-01T08:01:41.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.768+0000 7fb22d8d0700 1 -- 172.21.15.26:0/1449833632 learned_addr learned my addr 172.21.15.26:0/1449833632 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:01:41.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.768+0000 7fb21ffff700 1 -- 172.21.15.26:0/1449833632 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1544481629 0 0) 0x7fb2280a2a70 con 0x7fb228133930 2023-10-01T08:01:41.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.768+0000 7fb21ffff700 1 -- 172.21.15.26:0/1449833632 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2140035b0 con 0x7fb228133930 2023-10-01T08:01:41.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.769+0000 7fb22c8ce700 1 -- 172.21.15.26:0/1449833632 >> v2:172.21.15.26:3300/0 conn(0x7fb2280a0a30 msgr2=0x7fb2280a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:41.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.769+0000 7fb22c8ce700 1 --2- 172.21.15.26:0/1449833632 >> v2:172.21.15.26:3300/0 conn(0x7fb2280a0a30 0x7fb2280a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:41.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.769+0000 7fb22c8ce700 1 -- 172.21.15.26:0/1449833632 >> v1:172.21.15.26:6789/0 conn(0x7fb228133930 legacy=0x7fb228133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:41.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.769+0000 7fb22c8ce700 1 -- 172.21.15.26:0/1449833632 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb22809dc50 con 0x7fb22809d630 2023-10-01T08:01:41.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.769+0000 7fb22d0cf700 1 --2- 172.21.15.26:0/1449833632 >> v2:172.21.15.26:3300/0 conn(0x7fb2280a0a30 0x7fb2280a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:41.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.769+0000 7fb22c8ce700 1 --2- 172.21.15.26:0/1449833632 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb22809d630 0x7fb2280a1340 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fb218009840 tx=0x7fb218009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf501ddfcc75142e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:41.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.769+0000 7fb21ffff700 1 -- 172.21.15.26:0/1449833632 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb218011830 con 0x7fb22809d630 2023-10-01T08:01:41.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.769+0000 7fb21ffff700 1 -- 172.21.15.26:0/1449833632 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb218011990 con 0x7fb22809d630 2023-10-01T08:01:41.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.769+0000 7fb21ffff700 1 -- 172.21.15.26:0/1449833632 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb218011d20 con 0x7fb22809d630 2023-10-01T08:01:41.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.770+0000 7fb22f333700 1 -- 172.21.15.26:0/1449833632 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb22809d630 msgr2=0x7fb2280a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:41.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.770+0000 7fb22f333700 1 --2- 172.21.15.26:0/1449833632 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb22809d630 0x7fb2280a1340 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fb218009840 tx=0x7fb218009b50 comp rx=0 tx=0).stop 2023-10-01T08:01:41.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.770+0000 7fb22f333700 1 -- 172.21.15.26:0/1449833632 shutdown_connections 2023-10-01T08:01:41.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.770+0000 7fb22f333700 1 --2- 172.21.15.26:0/1449833632 >> v2:172.21.15.26:3300/0 conn(0x7fb2280a0a30 0x7fb2280a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:41.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.770+0000 7fb22f333700 1 --2- 172.21.15.26:0/1449833632 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb22809d630 0x7fb2280a1340 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:41.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.770+0000 7fb22f333700 1 -- 172.21.15.26:0/1449833632 >> 172.21.15.26:0/1449833632 conn(0x7fb2280a3050 msgr2=0x7fb2280a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:41.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.770+0000 7fb22f333700 1 -- 172.21.15.26:0/1449833632 shutdown_connections 2023-10-01T08:01:41.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.770+0000 7fb22f333700 1 -- 172.21.15.26:0/1449833632 wait complete. 2023-10-01T08:01:41.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.771+0000 7fb22f333700 1 Processor -- start 2023-10-01T08:01:41.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.771+0000 7fb22f333700 1 -- start start 2023-10-01T08:01:41.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.772+0000 7fb22f333700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb22809d630 0x7fb22811f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:41.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.772+0000 7fb22f333700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb2280a0a30 0x7fb22811f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:41.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.772+0000 7fb22f333700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb228133930 0x7fb2281c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:41.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.772+0000 7fb22f333700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2281222f0 con 0x7fb22809d630 2023-10-01T08:01:41.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.772+0000 7fb22f333700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2281224d0 con 0x7fb228133930 2023-10-01T08:01:41.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.772+0000 7fb22f333700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb228133570 con 0x7fb2280a0a30 2023-10-01T08:01:41.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.772+0000 7fb22d0cf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb22809d630 0x7fb22811f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:41.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.772+0000 7fb22d0cf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb22809d630 0x7fb22811f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44432/0 (socket says 172.21.15.26:44432) 2023-10-01T08:01:41.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.772+0000 7fb22d0cf700 1 -- 172.21.15.26:0/2320360408 learned_addr learned my addr 172.21.15.26:0/2320360408 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:41.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.772+0000 7fb22c8ce700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb2280a0a30 0x7fb22811f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:41.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.772+0000 7fb22d8d0700 1 --2- 172.21.15.26:0/2320360408 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb228133930 0x7fb2281c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:41.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.773+0000 7fb22c8ce700 1 -- 172.21.15.26:0/2320360408 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb228133930 msgr2=0x7fb2281c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:41.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.773+0000 7fb22c8ce700 1 --2- 172.21.15.26:0/2320360408 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb228133930 0x7fb2281c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:41.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.773+0000 7fb22c8ce700 1 -- 172.21.15.26:0/2320360408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb22809d630 msgr2=0x7fb22811f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:41.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.773+0000 7fb22c8ce700 1 --2- 172.21.15.26:0/2320360408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb22809d630 0x7fb22811f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:41.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.773+0000 7fb22c8ce700 1 -- 172.21.15.26:0/2320360408 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2240094a0 con 0x7fb2280a0a30 2023-10-01T08:01:41.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.773+0000 7fb22c8ce700 1 --2- 172.21.15.26:0/2320360408 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb2280a0a30 0x7fb22811f9e0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fb218016000 tx=0x7fb218004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:41.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.773+0000 7fb21dffb700 1 -- 172.21.15.26:0/2320360408 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb218004590 con 0x7fb2280a0a30 2023-10-01T08:01:41.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.773+0000 7fb21dffb700 1 -- 172.21.15.26:0/2320360408 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21801f070 con 0x7fb2280a0a30 2023-10-01T08:01:41.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.773+0000 7fb22f333700 1 -- 172.21.15.26:0/2320360408 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2180094a0 con 0x7fb2280a0a30 2023-10-01T08:01:41.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.773+0000 7fb21dffb700 1 -- 172.21.15.26:0/2320360408 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2180038e0 con 0x7fb2280a0a30 2023-10-01T08:01:41.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.773+0000 7fb22f333700 1 -- 172.21.15.26:0/2320360408 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2280a0410 con 0x7fb2280a0a30 2023-10-01T08:01:41.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.774+0000 7fb21dffb700 1 -- 172.21.15.26:0/2320360408 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb218003a40 con 0x7fb2280a0a30 2023-10-01T08:01:41.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.774+0000 7fb21dffb700 1 -- 172.21.15.26:0/2320360408 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb218021070 con 0x7fb2280a0a30 2023-10-01T08:01:41.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.775+0000 7fb22f333700 1 -- 172.21.15.26:0/2320360408 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2280747f0 con 0x7fb2280a0a30 2023-10-01T08:01:41.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.780+0000 7fb21dffb700 1 -- 172.21.15.26:0/2320360408 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb218040e60 con 0x7fb2280a0a30 2023-10-01T08:01:41.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.900+0000 7f3b16480700 1 -- 172.21.15.26:0/3860458322 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3b101a7da0 con 0x7f3b1009f240 2023-10-01T08:01:41.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.900+0000 7f3b0cff9700 1 -- 172.21.15.26:0/3860458322 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3b04003e40 con 0x7f3b1009f240 2023-10-01T08:01:41.901 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:41.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.903+0000 7f3b16480700 1 -- 172.21.15.26:0/3860458322 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3b1009f240 msgr2=0x7f3b101c85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:41.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.903+0000 7f3b16480700 1 --2- 172.21.15.26:0/3860458322 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3b1009f240 0x7f3b101c85b0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f3b0400c550 tx=0x7f3b0400c860 comp rx=0 tx=0).stop 2023-10-01T08:01:41.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.903+0000 7f3b16480700 1 -- 172.21.15.26:0/3860458322 shutdown_connections 2023-10-01T08:01:41.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.903+0000 7f3b16480700 1 --2- 172.21.15.26:0/3860458322 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b1009f650 0x7f3b101c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:41.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.903+0000 7f3b16480700 1 --2- 172.21.15.26:0/3860458322 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3b1009e930 0x7f3b101c8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:41.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.903+0000 7f3b16480700 1 --2- 172.21.15.26:0/3860458322 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3b1009f240 0x7f3b101c85b0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:41.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.903+0000 7f3b16480700 1 -- 172.21.15.26:0/3860458322 >> 172.21.15.26:0/3860458322 conn(0x7f3b100a4210 msgr2=0x7f3b101b9920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:41.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.904+0000 7f3b16480700 1 -- 172.21.15.26:0/3860458322 shutdown_connections 2023-10-01T08:01:41.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.904+0000 7f3b16480700 1 -- 172.21.15.26:0/3860458322 wait complete. 2023-10-01T08:01:41.918 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:41.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.997+0000 7f0f8cf25700 1 -- 172.21.15.26:0/4035866886 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0f881a6470 con 0x7f0f8809d6f0 2023-10-01T08:01:41.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:41.998+0000 7f0f76ffd700 1 -- 172.21.15.26:0/4035866886 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0f780233d0 con 0x7f0f8809d6f0 2023-10-01T08:01:41.999 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:42.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.000+0000 7f0f8cf25700 1 -- 172.21.15.26:0/4035866886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f8809d6f0 msgr2=0x7f0f881a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:42.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.000+0000 7f0f8cf25700 1 --2- 172.21.15.26:0/4035866886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f8809d6f0 0x7f0f881a52c0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f0f78009c70 tx=0x7f0f78004750 comp rx=0 tx=0).stop 2023-10-01T08:01:42.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.000+0000 7f0f8cf25700 1 -- 172.21.15.26:0/4035866886 shutdown_connections 2023-10-01T08:01:42.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.000+0000 7f0f8cf25700 1 --2- 172.21.15.26:0/4035866886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0f8809e410 0x7f0f881c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:42.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.000+0000 7f0f8cf25700 1 --2- 172.21.15.26:0/4035866886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f8809d6f0 0x7f0f881a52c0 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:42.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.000+0000 7f0f8cf25700 1 --2- 172.21.15.26:0/4035866886 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0f8809e000 0x7f0f881a5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:42.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.000+0000 7f0f8cf25700 1 -- 172.21.15.26:0/4035866886 >> 172.21.15.26:0/4035866886 conn(0x7f0f88066f50 msgr2=0x7f0f881bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:42.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.000+0000 7f0f8cf25700 1 -- 172.21.15.26:0/4035866886 shutdown_connections 2023-10-01T08:01:42.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.000+0000 7f0f8cf25700 1 -- 172.21.15.26:0/4035866886 wait complete. 2023-10-01T08:01:42.005 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:42.014 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:42.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.040+0000 7fb22f333700 1 -- 172.21.15.26:0/2320360408 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb228120db0 con 0x7fb2280a0a30 2023-10-01T08:01:42.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.040+0000 7fb21dffb700 1 -- 172.21.15.26:0/2320360408 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb218015070 con 0x7fb2280a0a30 2023-10-01T08:01:42.041 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:42.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.043+0000 7fb22f333700 1 -- 172.21.15.26:0/2320360408 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb2280a0a30 msgr2=0x7fb22811f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:42.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.043+0000 7fb22f333700 1 --2- 172.21.15.26:0/2320360408 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb2280a0a30 0x7fb22811f9e0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fb218016000 tx=0x7fb218004750 comp rx=0 tx=0).stop 2023-10-01T08:01:42.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.043+0000 7fb22f333700 1 -- 172.21.15.26:0/2320360408 shutdown_connections 2023-10-01T08:01:42.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.043+0000 7fb22f333700 1 --2- 172.21.15.26:0/2320360408 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb228133930 0x7fb2281c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:42.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.043+0000 7fb22f333700 1 --2- 172.21.15.26:0/2320360408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb22809d630 0x7fb22811f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:42.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.043+0000 7fb22f333700 1 --2- 172.21.15.26:0/2320360408 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb2280a0a30 0x7fb22811f9e0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:42.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.043+0000 7fb22f333700 1 -- 172.21.15.26:0/2320360408 >> 172.21.15.26:0/2320360408 conn(0x7fb2280a3050 msgr2=0x7fb2281bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:42.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.043+0000 7fb22f333700 1 -- 172.21.15.26:0/2320360408 shutdown_connections 2023-10-01T08:01:42.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.043+0000 7fb22f333700 1 -- 172.21.15.26:0/2320360408 wait complete. 2023-10-01T08:01:42.057 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:42.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.143+0000 7f2c357cc700 1 Processor -- start 2023-10-01T08:01:42.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.143+0000 7f2c357cc700 1 -- start start 2023-10-01T08:01:42.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.144+0000 7f2c357cc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c300a0a30 0x7f2c300a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:42.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.144+0000 7f2c357cc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2c300a1340 0x7f2c30133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:42.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.144+0000 7f2c357cc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c30133fa0 0x7f2c30134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:42.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.144+0000 7f2c357cc700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c3009edd0 con 0x7f2c300a1340 2023-10-01T08:01:42.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.144+0000 7f2c357cc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3009e1f0 con 0x7f2c300a0a30 2023-10-01T08:01:42.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.144+0000 7f2c357cc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3009dc50 con 0x7f2c30133fa0 2023-10-01T08:01:42.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.144+0000 7f2c2e7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2c300a1340 0x7f2c30133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:42.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.144+0000 7f2c2effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c300a0a30 0x7f2c300a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:42.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.144+0000 7f2c2f7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c30133fa0 0x7f2c30134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:42.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.144+0000 7f2c2e7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2c300a1340 0x7f2c30133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44442/0 (socket says 172.21.15.26:44442) 2023-10-01T08:01:42.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.144+0000 7f2c2effd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c300a0a30 0x7f2c300a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45060/0 (socket says 172.21.15.26:45060) 2023-10-01T08:01:42.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.144+0000 7f2c2e7fc700 1 -- 172.21.15.26:0/434989844 learned_addr learned my addr 172.21.15.26:0/434989844 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:42.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.144+0000 7f2c2f7fe700 1 -- 172.21.15.26:0/434989844 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c300a0a30 msgr2=0x7f2c300a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:42.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.144+0000 7f2c2f7fe700 1 --2- 172.21.15.26:0/434989844 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c300a0a30 0x7f2c300a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:42.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.144+0000 7f2c2f7fe700 1 -- 172.21.15.26:0/434989844 >> v2:172.21.15.26:3300/0 conn(0x7f2c300a1340 msgr2=0x7f2c30133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:42.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.144+0000 7f2c2f7fe700 1 --2- 172.21.15.26:0/434989844 >> v2:172.21.15.26:3300/0 conn(0x7f2c300a1340 0x7f2c30133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:42.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.144+0000 7f2c2f7fe700 1 -- 172.21.15.26:0/434989844 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c300a1fe0 con 0x7f2c30133fa0 2023-10-01T08:01:42.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.144+0000 7f2c2e7fc700 1 --2- 172.21.15.26:0/434989844 >> v2:172.21.15.26:3300/0 conn(0x7f2c300a1340 0x7f2c30133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:42.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.144+0000 7f2c2effd700 1 --2- 172.21.15.26:0/434989844 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c300a0a30 0x7f2c300a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:42.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.145+0000 7f2c2f7fe700 1 --2- 172.21.15.26:0/434989844 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c30133fa0 0x7f2c30134410 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f2c28009dc0 tx=0x7f2c2800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6aaa8f119c850537 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:42.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.145+0000 7f2c2dffb700 1 -- 172.21.15.26:0/434989844 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2800e070 con 0x7f2c30133fa0 2023-10-01T08:01:42.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.145+0000 7f2c2dffb700 1 -- 172.21.15.26:0/434989844 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2800bae0 con 0x7f2c30133fa0 2023-10-01T08:01:42.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.145+0000 7f2c2dffb700 1 -- 172.21.15.26:0/434989844 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2800be90 con 0x7f2c30133fa0 2023-10-01T08:01:42.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.145+0000 7f2c357cc700 1 -- 172.21.15.26:0/434989844 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c30133fa0 msgr2=0x7f2c30134410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:42.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.145+0000 7f2c357cc700 1 --2- 172.21.15.26:0/434989844 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c30133fa0 0x7f2c30134410 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f2c28009dc0 tx=0x7f2c2800b330 comp rx=0 tx=0).stop 2023-10-01T08:01:42.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.145+0000 7f2c357cc700 1 -- 172.21.15.26:0/434989844 shutdown_connections 2023-10-01T08:01:42.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.145+0000 7f2c357cc700 1 --2- 172.21.15.26:0/434989844 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c30133fa0 0x7f2c30134410 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:42.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.145+0000 7f2c357cc700 1 --2- 172.21.15.26:0/434989844 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c300a0a30 0x7f2c300a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:42.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.145+0000 7f2c357cc700 1 --2- 172.21.15.26:0/434989844 >> v2:172.21.15.26:3300/0 conn(0x7f2c300a1340 0x7f2c30133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:42.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.145+0000 7f2c357cc700 1 -- 172.21.15.26:0/434989844 >> 172.21.15.26:0/434989844 conn(0x7f2c300a6550 msgr2=0x7f2c300a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:42.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.145+0000 7f2c357cc700 1 -- 172.21.15.26:0/434989844 shutdown_connections 2023-10-01T08:01:42.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.145+0000 7f2c357cc700 1 -- 172.21.15.26:0/434989844 wait complete. 2023-10-01T08:01:42.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.147+0000 7f2c357cc700 1 Processor -- start 2023-10-01T08:01:42.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.147+0000 7f2c357cc700 1 -- start start 2023-10-01T08:01:42.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.147+0000 7f2c357cc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c300a0a30 0x7f2c30120130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:42.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.147+0000 7f2c357cc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c300a1340 0x7f2c30120670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:42.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.147+0000 7f2c357cc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c30133fa0 0x7f2c30120bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:42.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.147+0000 7f2c357cc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c30121570 con 0x7f2c300a1340 2023-10-01T08:01:42.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.147+0000 7f2c357cc700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c30122f50 con 0x7f2c300a0a30 2023-10-01T08:01:42.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.147+0000 7f2c357cc700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c30121da0 con 0x7f2c30133fa0 2023-10-01T08:01:42.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.147+0000 7f2c2e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c300a1340 0x7f2c30120670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:42.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.147+0000 7f2c2e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c300a1340 0x7f2c30120670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44454/0 (socket says 172.21.15.26:44454) 2023-10-01T08:01:42.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.147+0000 7f2c2e7fc700 1 -- 172.21.15.26:0/3540583642 learned_addr learned my addr 172.21.15.26:0/3540583642 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:42.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.147+0000 7f2c2f7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c30133fa0 0x7f2c30120bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:42.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.147+0000 7f2c2effd700 1 --2- 172.21.15.26:0/3540583642 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c300a0a30 0x7f2c30120130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:42.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.148+0000 7f2c2e7fc700 1 -- 172.21.15.26:0/3540583642 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c30133fa0 msgr2=0x7f2c30120bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:42.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.148+0000 7f2c2e7fc700 1 --2- 172.21.15.26:0/3540583642 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c30133fa0 0x7f2c30120bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:42.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.148+0000 7f2c2e7fc700 1 -- 172.21.15.26:0/3540583642 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c300a0a30 msgr2=0x7f2c30120130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:42.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.148+0000 7f2c2e7fc700 1 --2- 172.21.15.26:0/3540583642 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c300a0a30 0x7f2c30120130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:42.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.148+0000 7f2c2e7fc700 1 -- 172.21.15.26:0/3540583642 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c200094a0 con 0x7f2c300a1340 2023-10-01T08:01:42.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.148+0000 7f2c2f7fe700 1 --2- 172.21.15.26:0/3540583642 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c30133fa0 0x7f2c30120bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:42.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.148+0000 7f2c2effd700 1 --2- 172.21.15.26:0/3540583642 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c300a0a30 0x7f2c30120130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:42.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.148+0000 7f2c2e7fc700 1 --2- 172.21.15.26:0/3540583642 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c300a1340 0x7f2c30120670 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f2c2400ebe0 tx=0x7f2c2400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:42.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.148+0000 7f2c177fe700 1 -- 172.21.15.26:0/3540583642 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2400c850 con 0x7f2c300a1340 2023-10-01T08:01:42.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.148+0000 7f2c177fe700 1 -- 172.21.15.26:0/3540583642 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2400c9b0 con 0x7f2c300a1340 2023-10-01T08:01:42.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.148+0000 7f2c357cc700 1 -- 172.21.15.26:0/3540583642 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c24009550 con 0x7f2c300a1340 2023-10-01T08:01:42.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.148+0000 7f2c177fe700 1 -- 172.21.15.26:0/3540583642 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2400cd40 con 0x7f2c300a1340 2023-10-01T08:01:42.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.148+0000 7f2c357cc700 1 -- 172.21.15.26:0/3540583642 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c28009a70 con 0x7f2c300a1340 2023-10-01T08:01:42.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.149+0000 7f2c177fe700 1 -- 172.21.15.26:0/3540583642 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2c24013470 con 0x7f2c300a1340 2023-10-01T08:01:42.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.149+0000 7f2c177fe700 1 -- 172.21.15.26:0/3540583642 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2c2403fcc0 con 0x7f2c300a1340 2023-10-01T08:01:42.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.149+0000 7f2c357cc700 1 -- 172.21.15.26:0/3540583642 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c300a0220 con 0x7f2c300a1340 2023-10-01T08:01:42.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.154+0000 7f2c177fe700 1 -- 172.21.15.26:0/3540583642 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2c2401b3b0 con 0x7f2c300a1340 2023-10-01T08:01:42.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.360+0000 7f2c357cc700 1 -- 172.21.15.26:0/3540583642 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2c30074ea0 con 0x7f2c300a1340 2023-10-01T08:01:42.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.360+0000 7f2c177fe700 1 -- 172.21.15.26:0/3540583642 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2c24024350 con 0x7f2c300a1340 2023-10-01T08:01:42.361 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:42.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.363+0000 7f2c357cc700 1 -- 172.21.15.26:0/3540583642 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c300a1340 msgr2=0x7f2c30120670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:42.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.363+0000 7f2c357cc700 1 --2- 172.21.15.26:0/3540583642 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c300a1340 0x7f2c30120670 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f2c2400ebe0 tx=0x7f2c2400eef0 comp rx=0 tx=0).stop 2023-10-01T08:01:42.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.363+0000 7f2c357cc700 1 -- 172.21.15.26:0/3540583642 shutdown_connections 2023-10-01T08:01:42.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.363+0000 7f2c357cc700 1 --2- 172.21.15.26:0/3540583642 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c30133fa0 0x7f2c30120bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:42.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.363+0000 7f2c357cc700 1 --2- 172.21.15.26:0/3540583642 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c300a0a30 0x7f2c30120130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:42.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.363+0000 7f2c357cc700 1 --2- 172.21.15.26:0/3540583642 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c300a1340 0x7f2c30120670 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:42.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.363+0000 7f2c357cc700 1 -- 172.21.15.26:0/3540583642 >> 172.21.15.26:0/3540583642 conn(0x7f2c300a6550 msgr2=0x7f2c301baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:42.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.363+0000 7f2c357cc700 1 -- 172.21.15.26:0/3540583642 shutdown_connections 2023-10-01T08:01:42.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:42.363+0000 7f2c357cc700 1 -- 172.21.15.26:0/3540583642 wait complete. 2023-10-01T08:01:42.377 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:42.919 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:43.015 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:43.059 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:43.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.065+0000 7fdb70351700 1 Processor -- start 2023-10-01T08:01:43.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.065+0000 7fdb70351700 1 -- start start 2023-10-01T08:01:43.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.066+0000 7fdb70351700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb6809f410 0x7fdb68136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:43.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.066+0000 7fdb70351700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdb68136fe0 0x7fdb681393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:43.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.066+0000 7fdb70351700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb68070940 con 0x7fdb6809e930 2023-10-01T08:01:43.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.066+0000 7fdb70351700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb6806fd60 con 0x7fdb68136fe0 2023-10-01T08:01:43.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.066+0000 7fdb70351700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6806fa80 con 0x7fdb6809f410 2023-10-01T08:01:43.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.066+0000 7fdb6e8ee700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdb68136fe0 0x7fdb681393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:43.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.066+0000 7fdb6e8ee700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdb68136fe0 0x7fdb681393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44470/0 (socket says 172.21.15.26:44470) 2023-10-01T08:01:43.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.066+0000 7fdb6e8ee700 1 -- 172.21.15.26:0/3380207827 learned_addr learned my addr 172.21.15.26:0/3380207827 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:43.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.066+0000 7fdb6d8ec700 1 --2- 172.21.15.26:0/3380207827 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb6809f410 0x7fdb68136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:43.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.066+0000 7fdb6e8ee700 1 -- 172.21.15.26:0/3380207827 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb6809f410 msgr2=0x7fdb68136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:43.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.066+0000 7fdb6e8ee700 1 --2- 172.21.15.26:0/3380207827 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb6809f410 0x7fdb68136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.066+0000 7fdb6e8ee700 1 -- 172.21.15.26:0/3380207827 >> v1:172.21.15.26:6789/0 conn(0x7fdb6809e930 legacy=0x7fdb6809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:43.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.066+0000 7fdb6e8ee700 1 -- 172.21.15.26:0/3380207827 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6809fb60 con 0x7fdb68136fe0 2023-10-01T08:01:43.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.066+0000 7fdb6d0eb700 1 -- 172.21.15.26:0/3380207827 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 421581965 0 0) 0x7fdb68070940 con 0x7fdb6809e930 2023-10-01T08:01:43.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.067+0000 7fdb6d8ec700 1 --2- 172.21.15.26:0/3380207827 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb6809f410 0x7fdb68136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:43.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.067+0000 7fdb6e8ee700 1 --2- 172.21.15.26:0/3380207827 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb68136fe0 0x7fdb681393c0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009e50 tx=0x7fdb6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a07d8c24a31f524 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:43.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.067+0000 7fdb6d0eb700 1 -- 172.21.15.26:0/3380207827 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6000e070 con 0x7fdb68136fe0 2023-10-01T08:01:43.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.067+0000 7fdb6d0eb700 1 -- 172.21.15.26:0/3380207827 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6000b910 con 0x7fdb68136fe0 2023-10-01T08:01:43.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.067+0000 7fdb6d0eb700 1 -- 172.21.15.26:0/3380207827 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6000bcc0 con 0x7fdb68136fe0 2023-10-01T08:01:43.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.068+0000 7fdb70351700 1 -- 172.21.15.26:0/3380207827 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb68136fe0 msgr2=0x7fdb681393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:43.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.068+0000 7fdb70351700 1 --2- 172.21.15.26:0/3380207827 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb68136fe0 0x7fdb681393c0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009e50 tx=0x7fdb6000b330 comp rx=0 tx=0).stop 2023-10-01T08:01:43.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.068+0000 7fdb70351700 1 -- 172.21.15.26:0/3380207827 shutdown_connections 2023-10-01T08:01:43.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.068+0000 7fdb70351700 1 --2- 172.21.15.26:0/3380207827 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb68136fe0 0x7fdb681393c0 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.068+0000 7fdb70351700 1 --2- 172.21.15.26:0/3380207827 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb6809f410 0x7fdb68136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.068+0000 7fdb70351700 1 -- 172.21.15.26:0/3380207827 >> 172.21.15.26:0/3380207827 conn(0x7fdb680a4210 msgr2=0x7fdb680a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:43.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.068+0000 7fdb70351700 1 -- 172.21.15.26:0/3380207827 shutdown_connections 2023-10-01T08:01:43.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.068+0000 7fdb70351700 1 -- 172.21.15.26:0/3380207827 wait complete. 2023-10-01T08:01:43.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.069+0000 7fdb70351700 1 Processor -- start 2023-10-01T08:01:43.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.069+0000 7fdb70351700 1 -- start start 2023-10-01T08:01:43.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.069+0000 7fdb70351700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb6809e930 0x7fdb6811c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:43.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.069+0000 7fdb70351700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb6809f410 0x7fdb6811cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:43.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.069+0000 7fdb70351700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb68136fe0 0x7fdb6811d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:43.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.069+0000 7fdb70351700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb68120280 con 0x7fdb68136fe0 2023-10-01T08:01:43.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.069+0000 7fdb70351700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6811fe80 con 0x7fdb6809f410 2023-10-01T08:01:43.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.069+0000 7fdb70351700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6809b220 con 0x7fdb6809e930 2023-10-01T08:01:43.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.069+0000 7fdb6e8ee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb68136fe0 0x7fdb6811d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:43.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.069+0000 7fdb6e0ed700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb6809e930 0x7fdb6811c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:43.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.069+0000 7fdb6e8ee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb68136fe0 0x7fdb6811d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44480/0 (socket says 172.21.15.26:44480) 2023-10-01T08:01:43.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.069+0000 7fdb6e8ee700 1 -- 172.21.15.26:0/1325222473 learned_addr learned my addr 172.21.15.26:0/1325222473 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:43.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.070+0000 7fdb6e0ed700 1 -- 172.21.15.26:0/1325222473 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb6809f410 msgr2=0x7fdb6811cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:43.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.070+0000 7fdb6e0ed700 1 --2- 172.21.15.26:0/1325222473 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb6809f410 0x7fdb6811cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.070+0000 7fdb6e0ed700 1 -- 172.21.15.26:0/1325222473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb68136fe0 msgr2=0x7fdb6811d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:43.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.070+0000 7fdb6e0ed700 1 --2- 172.21.15.26:0/1325222473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb68136fe0 0x7fdb6811d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.070+0000 7fdb6e0ed700 1 -- 172.21.15.26:0/1325222473 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb580094a0 con 0x7fdb6809e930 2023-10-01T08:01:43.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.070+0000 7fdb6e8ee700 1 --2- 172.21.15.26:0/1325222473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb68136fe0 0x7fdb6811d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:43.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.070+0000 7fdb6e0ed700 1 --2- 172.21.15.26:0/1325222473 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb6809e930 0x7fdb6811c640 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fdb6400c430 tx=0x7fdb6400c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:43.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.070+0000 7fdb5effd700 1 -- 172.21.15.26:0/1325222473 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb640054e0 con 0x7fdb6809e930 2023-10-01T08:01:43.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.070+0000 7fdb5effd700 1 -- 172.21.15.26:0/1325222473 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb64003680 con 0x7fdb6809e930 2023-10-01T08:01:43.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.070+0000 7fdb70351700 1 -- 172.21.15.26:0/1325222473 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb60009b30 con 0x7fdb6809e930 2023-10-01T08:01:43.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.070+0000 7fdb5effd700 1 -- 172.21.15.26:0/1325222473 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb64003a30 con 0x7fdb6809e930 2023-10-01T08:01:43.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.070+0000 7fdb70351700 1 -- 172.21.15.26:0/1325222473 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb6811ea40 con 0x7fdb6809e930 2023-10-01T08:01:43.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.071+0000 7fdb5effd700 1 -- 172.21.15.26:0/1325222473 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb64003b90 con 0x7fdb6809e930 2023-10-01T08:01:43.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.072+0000 7fdb5effd700 1 -- 172.21.15.26:0/1325222473 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdb6403eae0 con 0x7fdb6809e930 2023-10-01T08:01:43.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.072+0000 7fdb70351700 1 -- 172.21.15.26:0/1325222473 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb68074ea0 con 0x7fdb6809e930 2023-10-01T08:01:43.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.077+0000 7fdb5effd700 1 -- 172.21.15.26:0/1325222473 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb64017070 con 0x7fdb6809e930 2023-10-01T08:01:43.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.160+0000 7fe9f759e700 1 Processor -- start 2023-10-01T08:01:43.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.160+0000 7fe9f759e700 1 -- start start 2023-10-01T08:01:43.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.161+0000 7fe9f759e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe9f809d800 0x7fe9f809dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:43.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.161+0000 7fe9f759e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe9f809e110 0x7fe9f8133860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:43.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.161+0000 7fe9f759e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe9f8133da0 0x7fe9f8134240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:43.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.161+0000 7fe9f759e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f809f560 con 0x7fe9f809e110 2023-10-01T08:01:43.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.161+0000 7fe9f759e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f8099e10 con 0x7fe9f809d800 2023-10-01T08:01:43.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.161+0000 7fe9f759e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f806b4d0 con 0x7fe9f8133da0 2023-10-01T08:01:43.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.161+0000 7fe9f5d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe9f809e110 0x7fe9f8133860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:43.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.161+0000 7fe9f5d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe9f809e110 0x7fe9f8133860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44484/0 (socket says 172.21.15.26:44484) 2023-10-01T08:01:43.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.161+0000 7fe9f5d9b700 1 -- 172.21.15.26:0/2679833555 learned_addr learned my addr 172.21.15.26:0/2679833555 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:43.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.161+0000 7fe9f6d9d700 1 --2- 172.21.15.26:0/2679833555 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe9f8133da0 0x7fe9f8134240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:43.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.161+0000 7fe9f659c700 1 --2- 172.21.15.26:0/2679833555 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe9f809d800 0x7fe9f809dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:43.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.161+0000 7fe9f5d9b700 1 -- 172.21.15.26:0/2679833555 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe9f8133da0 msgr2=0x7fe9f8134240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:43.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.161+0000 7fe9f5d9b700 1 --2- 172.21.15.26:0/2679833555 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe9f8133da0 0x7fe9f8134240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.161+0000 7fe9f5d9b700 1 -- 172.21.15.26:0/2679833555 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe9f809d800 msgr2=0x7fe9f809dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:43.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.161+0000 7fe9f5d9b700 1 --2- 172.21.15.26:0/2679833555 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe9f809d800 0x7fe9f809dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.161+0000 7fe9f5d9b700 1 -- 172.21.15.26:0/2679833555 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f809a060 con 0x7fe9f809e110 2023-10-01T08:01:43.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.161+0000 7fe9f6d9d700 1 --2- 172.21.15.26:0/2679833555 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe9f8133da0 0x7fe9f8134240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:43.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.162+0000 7fe9f5d9b700 1 --2- 172.21.15.26:0/2679833555 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9f809e110 0x7fe9f8133860 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec006fd0 tx=0x7fe9ec009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a49c64df9cef1d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:43.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.162+0000 7fe9f559a700 1 -- 172.21.15.26:0/2679833555 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec005e30 con 0x7fe9f809e110 2023-10-01T08:01:43.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.162+0000 7fe9f559a700 1 -- 172.21.15.26:0/2679833555 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ec004030 con 0x7fe9f809e110 2023-10-01T08:01:43.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.162+0000 7fe9f559a700 1 -- 172.21.15.26:0/2679833555 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec0043e0 con 0x7fe9f809e110 2023-10-01T08:01:43.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.163+0000 7fe9f759e700 1 -- 172.21.15.26:0/2679833555 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9f809e110 msgr2=0x7fe9f8133860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:43.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.163+0000 7fe9f759e700 1 --2- 172.21.15.26:0/2679833555 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9f809e110 0x7fe9f8133860 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec006fd0 tx=0x7fe9ec009bd0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.163+0000 7fe9f759e700 1 -- 172.21.15.26:0/2679833555 shutdown_connections 2023-10-01T08:01:43.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.163+0000 7fe9f759e700 1 --2- 172.21.15.26:0/2679833555 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe9f8133da0 0x7fe9f8134240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.163+0000 7fe9f759e700 1 --2- 172.21.15.26:0/2679833555 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe9f809d800 0x7fe9f809dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.163+0000 7fe9f759e700 1 --2- 172.21.15.26:0/2679833555 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9f809e110 0x7fe9f8133860 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.163+0000 7fe9f759e700 1 -- 172.21.15.26:0/2679833555 >> 172.21.15.26:0/2679833555 conn(0x7fe9f80a2e20 msgr2=0x7fe9f80a3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:43.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.163+0000 7fe9f759e700 1 -- 172.21.15.26:0/2679833555 shutdown_connections 2023-10-01T08:01:43.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.163+0000 7fe9f759e700 1 -- 172.21.15.26:0/2679833555 wait complete. 2023-10-01T08:01:43.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.164+0000 7fe9f759e700 1 Processor -- start 2023-10-01T08:01:43.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.164+0000 7fe9f759e700 1 -- start start 2023-10-01T08:01:43.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.164+0000 7fe9f759e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe9f809d800 0x7fe9f81221a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:43.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.165+0000 7fe9f759e700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe9f809e110 0x7fe9f81226e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:43.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.165+0000 7fe9f759e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9f8133da0 0x7fe9f8122c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:43.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.165+0000 7fe9f759e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f8133570 con 0x7fe9f8133da0 2023-10-01T08:01:43.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.165+0000 7fe9f759e700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f8123600 con 0x7fe9f809d800 2023-10-01T08:01:43.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.165+0000 7fe9f759e700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f8124c40 con 0x7fe9f809e110 2023-10-01T08:01:43.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.165+0000 7fe9f659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe9f809d800 0x7fe9f81221a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:43.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.165+0000 7fe9f6d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9f8133da0 0x7fe9f8122c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:43.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.165+0000 7fe9f659c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe9f809d800 0x7fe9f81221a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45094/0 (socket says 172.21.15.26:45094) 2023-10-01T08:01:43.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.165+0000 7fe9f659c700 1 -- 172.21.15.26:0/523182105 learned_addr learned my addr 172.21.15.26:0/523182105 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:43.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.165+0000 7fe9f5d9b700 1 --2- 172.21.15.26:0/523182105 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe9f809e110 0x7fe9f81226e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:43.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.165+0000 7fe9f6d9d700 1 -- 172.21.15.26:0/523182105 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe9f809e110 msgr2=0x7fe9f81226e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:43.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.165+0000 7fe9f6d9d700 1 --2- 172.21.15.26:0/523182105 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe9f809e110 0x7fe9f81226e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.165+0000 7fe9f6d9d700 1 -- 172.21.15.26:0/523182105 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe9f809d800 msgr2=0x7fe9f81221a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:43.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.165+0000 7fe9f6d9d700 1 --2- 172.21.15.26:0/523182105 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe9f809d800 0x7fe9f81221a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.165+0000 7fe9f6d9d700 1 -- 172.21.15.26:0/523182105 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f0009a70 con 0x7fe9f8133da0 2023-10-01T08:01:43.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.165+0000 7fe9f659c700 1 --2- 172.21.15.26:0/523182105 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe9f809d800 0x7fe9f81221a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:43.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.165+0000 7fe9f6d9d700 1 --2- 172.21.15.26:0/523182105 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9f8133da0 0x7fe9f8122c20 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0009e50 tx=0x7fe9f000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:43.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.166+0000 7fe9e6ffd700 1 -- 172.21.15.26:0/523182105 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f000ca90 con 0x7fe9f8133da0 2023-10-01T08:01:43.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.166+0000 7fe9e6ffd700 1 -- 172.21.15.26:0/523182105 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f000f040 con 0x7fe9f8133da0 2023-10-01T08:01:43.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.166+0000 7fe9f759e700 1 -- 172.21.15.26:0/523182105 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9ec009500 con 0x7fe9f8133da0 2023-10-01T08:01:43.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.166+0000 7fe9e6ffd700 1 -- 172.21.15.26:0/523182105 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f000ce50 con 0x7fe9f8133da0 2023-10-01T08:01:43.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.166+0000 7fe9f759e700 1 -- 172.21.15.26:0/523182105 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f80a1dc0 con 0x7fe9f8133da0 2023-10-01T08:01:43.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.167+0000 7fe9e6ffd700 1 -- 172.21.15.26:0/523182105 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe9f0014480 con 0x7fe9f8133da0 2023-10-01T08:01:43.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.167+0000 7fe9e6ffd700 1 -- 172.21.15.26:0/523182105 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe9f003fc10 con 0x7fe9f8133da0 2023-10-01T08:01:43.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.167+0000 7fe9f759e700 1 -- 172.21.15.26:0/523182105 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9f809c570 con 0x7fe9f8133da0 2023-10-01T08:01:43.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.176+0000 7fe9e6ffd700 1 -- 172.21.15.26:0/523182105 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe9f0012910 con 0x7fe9f8133da0 2023-10-01T08:01:43.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.202+0000 7f9351675700 1 Processor -- start 2023-10-01T08:01:43.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.202+0000 7f9351675700 1 -- start start 2023-10-01T08:01:43.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.203+0000 7f9351675700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f934c09d6f0 0x7f934c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:43.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.203+0000 7f9351675700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f934c09e410 0x7f934c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:43.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.203+0000 7f9351675700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f934c09b120 con 0x7f934c09e000 2023-10-01T08:01:43.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.203+0000 7f9351675700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f934c06b460 con 0x7f934c09e410 2023-10-01T08:01:43.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.203+0000 7f9351675700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934c09a7e0 con 0x7f934c09d6f0 2023-10-01T08:01:43.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.203+0000 7f934affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f934c09d6f0 0x7f934c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:43.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.203+0000 7f934a7fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f934c09e000 0x7f934c1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44386/0 (socket says 172.21.15.26:44386) 2023-10-01T08:01:43.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.203+0000 7f934a7fc700 1 -- 172.21.15.26:0/3412091873 learned_addr learned my addr 172.21.15.26:0/3412091873 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:01:43.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.203+0000 7f934b7fe700 1 --2- 172.21.15.26:0/3412091873 >> v2:172.21.15.26:3300/0 conn(0x7f934c09e410 0x7f934c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:43.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.203+0000 7f9349ffb700 1 -- 172.21.15.26:0/3412091873 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2488086305 0 0) 0x7f934c09b120 con 0x7f934c09e000 2023-10-01T08:01:43.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.203+0000 7f9349ffb700 1 -- 172.21.15.26:0/3412091873 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93340035b0 con 0x7f934c09e000 2023-10-01T08:01:43.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.204+0000 7f934affd700 1 -- 172.21.15.26:0/3412091873 >> v2:172.21.15.26:3300/0 conn(0x7f934c09e410 msgr2=0x7f934c134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:43.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.204+0000 7f934affd700 1 --2- 172.21.15.26:0/3412091873 >> v2:172.21.15.26:3300/0 conn(0x7f934c09e410 0x7f934c134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.204+0000 7f934affd700 1 -- 172.21.15.26:0/3412091873 >> v1:172.21.15.26:6789/0 conn(0x7f934c09e000 legacy=0x7f934c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:43.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.204+0000 7f934affd700 1 -- 172.21.15.26:0/3412091873 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c09a500 con 0x7f934c09d6f0 2023-10-01T08:01:43.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.204+0000 7f934b7fe700 1 --2- 172.21.15.26:0/3412091873 >> v2:172.21.15.26:3300/0 conn(0x7f934c09e410 0x7f934c134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:43.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.204+0000 7f934affd700 1 --2- 172.21.15.26:0/3412091873 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f934c09d6f0 0x7f934c09dac0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f933c009870 tx=0x7f933c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fd8536f673eeb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:43.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.204+0000 7f9349ffb700 1 -- 172.21.15.26:0/3412091873 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933c011830 con 0x7f934c09d6f0 2023-10-01T08:01:43.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.204+0000 7f9349ffb700 1 -- 172.21.15.26:0/3412091873 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933c011990 con 0x7f934c09d6f0 2023-10-01T08:01:43.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.204+0000 7f9349ffb700 1 -- 172.21.15.26:0/3412091873 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933c011d20 con 0x7f934c09d6f0 2023-10-01T08:01:43.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.205+0000 7f9351675700 1 -- 172.21.15.26:0/3412091873 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f934c09d6f0 msgr2=0x7f934c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:43.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.205+0000 7f9351675700 1 --2- 172.21.15.26:0/3412091873 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f934c09d6f0 0x7f934c09dac0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f933c009870 tx=0x7f933c009b80 comp rx=0 tx=0).stop 2023-10-01T08:01:43.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.205+0000 7f9351675700 1 -- 172.21.15.26:0/3412091873 shutdown_connections 2023-10-01T08:01:43.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.205+0000 7f9351675700 1 --2- 172.21.15.26:0/3412091873 >> v2:172.21.15.26:3300/0 conn(0x7f934c09e410 0x7f934c134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.205+0000 7f9351675700 1 --2- 172.21.15.26:0/3412091873 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f934c09d6f0 0x7f934c09dac0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.205+0000 7f9351675700 1 -- 172.21.15.26:0/3412091873 >> 172.21.15.26:0/3412091873 conn(0x7f934c066f50 msgr2=0x7f934c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:43.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.205+0000 7f9351675700 1 -- 172.21.15.26:0/3412091873 shutdown_connections 2023-10-01T08:01:43.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.205+0000 7f9351675700 1 -- 172.21.15.26:0/3412091873 wait complete. 2023-10-01T08:01:43.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.206+0000 7f9351675700 1 Processor -- start 2023-10-01T08:01:43.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.206+0000 7f9351675700 1 -- start start 2023-10-01T08:01:43.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.206+0000 7f9351675700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f934c09d6f0 0x7f934c1c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:43.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.206+0000 7f9351675700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f934c09e000 0x7f934c1c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:43.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.206+0000 7f9351675700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f934c09e410 0x7f934c1a4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:43.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.206+0000 7f9351675700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934c1b91e0 con 0x7f934c09e000 2023-10-01T08:01:43.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.206+0000 7f9351675700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934c1bcfa0 con 0x7f934c09d6f0 2023-10-01T08:01:43.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.207+0000 7f9351675700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f934c1a8140 con 0x7f934c09e410 2023-10-01T08:01:43.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.207+0000 7f934affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f934c09d6f0 0x7f934c1c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:43.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.207+0000 7f934affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f934c09d6f0 0x7f934c1c8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:45116/0 (socket says 172.21.15.26:45116) 2023-10-01T08:01:43.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.207+0000 7f934affd700 1 -- 172.21.15.26:0/3844862091 learned_addr learned my addr 172.21.15.26:0/3844862091 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:43.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.207+0000 7f934a7fc700 1 --2- 172.21.15.26:0/3844862091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f934c09e000 0x7f934c1c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:43.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.207+0000 7f934b7fe700 1 --2- 172.21.15.26:0/3844862091 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f934c09e410 0x7f934c1a4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:43.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.207+0000 7f934affd700 1 -- 172.21.15.26:0/3844862091 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f934c09e410 msgr2=0x7f934c1a4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:43.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.207+0000 7f934affd700 1 --2- 172.21.15.26:0/3844862091 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f934c09e410 0x7f934c1a4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.207+0000 7f934affd700 1 -- 172.21.15.26:0/3844862091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f934c09e000 msgr2=0x7f934c1c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:43.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.207+0000 7f934affd700 1 --2- 172.21.15.26:0/3844862091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f934c09e000 0x7f934c1c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.207+0000 7f934affd700 1 -- 172.21.15.26:0/3844862091 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9344009a70 con 0x7f934c09d6f0 2023-10-01T08:01:43.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.207+0000 7f934a7fc700 1 --2- 172.21.15.26:0/3844862091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f934c09e000 0x7f934c1c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T08:01:43.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.207+0000 7f934affd700 1 --2- 172.21.15.26:0/3844862091 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f934c09d6f0 0x7f934c1c8390 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f933c000c00 tx=0x7f933c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:43.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.207+0000 7f93337fe700 1 -- 172.21.15.26:0/3844862091 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933c0036a0 con 0x7f934c09d6f0 2023-10-01T08:01:43.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.207+0000 7f93337fe700 1 -- 172.21.15.26:0/3844862091 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933c01f070 con 0x7f934c09d6f0 2023-10-01T08:01:43.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.207+0000 7f93337fe700 1 -- 172.21.15.26:0/3844862091 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933c003a20 con 0x7f934c09d6f0 2023-10-01T08:01:43.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.207+0000 7f9351675700 1 -- 172.21.15.26:0/3844862091 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f933c0094a0 con 0x7f934c09d6f0 2023-10-01T08:01:43.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.208+0000 7f9351675700 1 -- 172.21.15.26:0/3844862091 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f934c1a7ba0 con 0x7f934c09d6f0 2023-10-01T08:01:43.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.208+0000 7f93337fe700 1 -- 172.21.15.26:0/3844862091 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f933c003b80 con 0x7f934c09d6f0 2023-10-01T08:01:43.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.209+0000 7f9351675700 1 -- 172.21.15.26:0/3844862091 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f934c074ea0 con 0x7f934c09d6f0 2023-10-01T08:01:43.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.209+0000 7f93337fe700 1 -- 172.21.15.26:0/3844862091 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f933c021070 con 0x7f934c09d6f0 2023-10-01T08:01:43.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.218+0000 7f93337fe700 1 -- 172.21.15.26:0/3844862091 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f933c026480 con 0x7f934c09d6f0 2023-10-01T08:01:43.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.298+0000 7fdb70351700 1 -- 172.21.15.26:0/1325222473 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdb680a3310 con 0x7fdb6809e930 2023-10-01T08:01:43.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.298+0000 7fdb5effd700 1 -- 172.21.15.26:0/1325222473 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdb64003e40 con 0x7fdb6809e930 2023-10-01T08:01:43.299 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:43.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.301+0000 7fdb70351700 1 -- 172.21.15.26:0/1325222473 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb6809e930 msgr2=0x7fdb6811c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:43.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.301+0000 7fdb70351700 1 --2- 172.21.15.26:0/1325222473 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb6809e930 0x7fdb6811c640 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fdb6400c430 tx=0x7fdb6400c740 comp rx=0 tx=0).stop 2023-10-01T08:01:43.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.301+0000 7fdb70351700 1 -- 172.21.15.26:0/1325222473 shutdown_connections 2023-10-01T08:01:43.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.301+0000 7fdb70351700 1 --2- 172.21.15.26:0/1325222473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb68136fe0 0x7fdb6811d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.301+0000 7fdb70351700 1 --2- 172.21.15.26:0/1325222473 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fdb6809e930 0x7fdb6811c640 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.301+0000 7fdb70351700 1 --2- 172.21.15.26:0/1325222473 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb6809f410 0x7fdb6811cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.301+0000 7fdb70351700 1 -- 172.21.15.26:0/1325222473 >> 172.21.15.26:0/1325222473 conn(0x7fdb680a4210 msgr2=0x7fdb680a47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:43.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.301+0000 7fdb70351700 1 -- 172.21.15.26:0/1325222473 shutdown_connections 2023-10-01T08:01:43.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.301+0000 7fdb70351700 1 -- 172.21.15.26:0/1325222473 wait complete. 2023-10-01T08:01:43.315 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:43.378 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:43.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.390+0000 7fe9f759e700 1 -- 172.21.15.26:0/523182105 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe9f811eea0 con 0x7fe9f8133da0 2023-10-01T08:01:43.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.390+0000 7fe9e6ffd700 1 -- 172.21.15.26:0/523182105 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe9f0012340 con 0x7fe9f8133da0 2023-10-01T08:01:43.391 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:43.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.392+0000 7fe9f759e700 1 -- 172.21.15.26:0/523182105 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9f8133da0 msgr2=0x7fe9f8122c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:43.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.392+0000 7fe9f759e700 1 --2- 172.21.15.26:0/523182105 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9f8133da0 0x7fe9f8122c20 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0009e50 tx=0x7fe9f000c3a0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.393+0000 7fe9f759e700 1 -- 172.21.15.26:0/523182105 shutdown_connections 2023-10-01T08:01:43.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.393+0000 7fe9f759e700 1 --2- 172.21.15.26:0/523182105 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9f8133da0 0x7fe9f8122c20 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.393+0000 7fe9f759e700 1 --2- 172.21.15.26:0/523182105 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe9f809d800 0x7fe9f81221a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.393+0000 7fe9f759e700 1 --2- 172.21.15.26:0/523182105 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe9f809e110 0x7fe9f81226e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.393+0000 7fe9f759e700 1 -- 172.21.15.26:0/523182105 >> 172.21.15.26:0/523182105 conn(0x7fe9f80a2e20 msgr2=0x7fe9f8071ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:43.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.393+0000 7fe9f759e700 1 -- 172.21.15.26:0/523182105 shutdown_connections 2023-10-01T08:01:43.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.393+0000 7fe9f759e700 1 -- 172.21.15.26:0/523182105 wait complete. 2023-10-01T08:01:43.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:43.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.429+0000 7f9351675700 1 -- 172.21.15.26:0/3844862091 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f934c06c360 con 0x7f934c09d6f0 2023-10-01T08:01:43.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.430+0000 7f93337fe700 1 -- 172.21.15.26:0/3844862091 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f933c010b70 con 0x7f934c09d6f0 2023-10-01T08:01:43.430 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:43.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.432+0000 7f9351675700 1 -- 172.21.15.26:0/3844862091 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f934c09d6f0 msgr2=0x7f934c1c8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:43.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.432+0000 7f9351675700 1 --2- 172.21.15.26:0/3844862091 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f934c09d6f0 0x7f934c1c8390 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f933c000c00 tx=0x7f933c004750 comp rx=0 tx=0).stop 2023-10-01T08:01:43.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.432+0000 7f9351675700 1 -- 172.21.15.26:0/3844862091 shutdown_connections 2023-10-01T08:01:43.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.432+0000 7f9351675700 1 --2- 172.21.15.26:0/3844862091 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f934c09e410 0x7f934c1a4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.432+0000 7f9351675700 1 --2- 172.21.15.26:0/3844862091 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f934c09d6f0 0x7f934c1c8390 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.432+0000 7f9351675700 1 --2- 172.21.15.26:0/3844862091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f934c09e000 0x7f934c1c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.432+0000 7f9351675700 1 -- 172.21.15.26:0/3844862091 >> 172.21.15.26:0/3844862091 conn(0x7f934c066f50 msgr2=0x7f934c0a3700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:43.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.432+0000 7f9351675700 1 -- 172.21.15.26:0/3844862091 shutdown_connections 2023-10-01T08:01:43.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.432+0000 7f9351675700 1 -- 172.21.15.26:0/3844862091 wait complete. 2023-10-01T08:01:43.447 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:43.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.518+0000 7fe995989700 1 Processor -- start 2023-10-01T08:01:43.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.518+0000 7fe995989700 1 -- start start 2023-10-01T08:01:43.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.519+0000 7fe995989700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe99009f410 0x7fe990136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:43.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.519+0000 7fe995989700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe990136fe0 0x7fe9901393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:43.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.519+0000 7fe995989700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe990070940 con 0x7fe99009e930 2023-10-01T08:01:43.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.519+0000 7fe995989700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe99006fd60 con 0x7fe990136fe0 2023-10-01T08:01:43.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.519+0000 7fe995989700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe99006fa80 con 0x7fe99009f410 2023-10-01T08:01:43.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.519+0000 7fe98e7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe99009f410 0x7fe990136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:43.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.519+0000 7fe98f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe990136fe0 0x7fe9901393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:43.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.519+0000 7fe98e7fc700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe99009f410 0x7fe990136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49360/0 (socket says 172.21.15.26:49360) 2023-10-01T08:01:43.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.519+0000 7fe98f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe990136fe0 0x7fe9901393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35388/0 (socket says 172.21.15.26:35388) 2023-10-01T08:01:43.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.519+0000 7fe98effd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe99009e930 0x7fe99009ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39488/0 (socket says 172.21.15.26:39488) 2023-10-01T08:01:43.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.519+0000 7fe98e7fc700 1 -- 172.21.15.26:0/836957839 learned_addr learned my addr 172.21.15.26:0/836957839 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:43.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.519+0000 7fe98dffb700 1 -- 172.21.15.26:0/836957839 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144462200 0 0) 0x7fe990070940 con 0x7fe99009e930 2023-10-01T08:01:43.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.519+0000 7fe98e7fc700 1 -- 172.21.15.26:0/836957839 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe990136fe0 msgr2=0x7fe9901393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:43.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.519+0000 7fe98e7fc700 1 --2- 172.21.15.26:0/836957839 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe990136fe0 0x7fe9901393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.519+0000 7fe98e7fc700 1 -- 172.21.15.26:0/836957839 >> v1:172.21.15.26:6789/0 conn(0x7fe99009e930 legacy=0x7fe99009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:43.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.519+0000 7fe98e7fc700 1 -- 172.21.15.26:0/836957839 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe99009fb60 con 0x7fe99009f410 2023-10-01T08:01:43.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.519+0000 7fe98f7fe700 1 --2- 172.21.15.26:0/836957839 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe990136fe0 0x7fe9901393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:43.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.519+0000 7fe98e7fc700 1 --2- 172.21.15.26:0/836957839 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe99009f410 0x7fe990136aa0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fe984009920 tx=0x7fe984009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d63125b71084f818 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:43.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.520+0000 7fe98dffb700 1 -- 172.21.15.26:0/836957839 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe984011830 con 0x7fe99009f410 2023-10-01T08:01:43.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.520+0000 7fe98dffb700 1 -- 172.21.15.26:0/836957839 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe984011990 con 0x7fe99009f410 2023-10-01T08:01:43.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.520+0000 7fe98dffb700 1 -- 172.21.15.26:0/836957839 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe984011d20 con 0x7fe99009f410 2023-10-01T08:01:43.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.520+0000 7fe995989700 1 -- 172.21.15.26:0/836957839 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe99009f410 msgr2=0x7fe990136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:43.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.520+0000 7fe995989700 1 --2- 172.21.15.26:0/836957839 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe99009f410 0x7fe990136aa0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fe984009920 tx=0x7fe984009c30 comp rx=0 tx=0).stop 2023-10-01T08:01:43.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.520+0000 7fe995989700 1 -- 172.21.15.26:0/836957839 shutdown_connections 2023-10-01T08:01:43.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.520+0000 7fe995989700 1 --2- 172.21.15.26:0/836957839 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe990136fe0 0x7fe9901393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.520+0000 7fe995989700 1 --2- 172.21.15.26:0/836957839 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe99009f410 0x7fe990136aa0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.520+0000 7fe995989700 1 -- 172.21.15.26:0/836957839 >> 172.21.15.26:0/836957839 conn(0x7fe9900a4210 msgr2=0x7fe9900a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:43.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.520+0000 7fe995989700 1 -- 172.21.15.26:0/836957839 shutdown_connections 2023-10-01T08:01:43.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.520+0000 7fe995989700 1 -- 172.21.15.26:0/836957839 wait complete. 2023-10-01T08:01:43.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.521+0000 7fe995989700 1 Processor -- start 2023-10-01T08:01:43.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.522+0000 7fe995989700 1 -- start start 2023-10-01T08:01:43.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.522+0000 7fe995989700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe99009e930 0x7fe99011c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:43.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.522+0000 7fe995989700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe99009f410 0x7fe99011ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:43.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.522+0000 7fe995989700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe990136fe0 0x7fe99011cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:43.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.522+0000 7fe995989700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe990120040 con 0x7fe990136fe0 2023-10-01T08:01:43.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.522+0000 7fe995989700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe990071d20 con 0x7fe99009f410 2023-10-01T08:01:43.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.522+0000 7fe995989700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe99011f7f0 con 0x7fe99009e930 2023-10-01T08:01:43.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.522+0000 7fe98effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe99009e930 0x7fe99011c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:43.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.522+0000 7fe98e7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe99009f410 0x7fe99011ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:43.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.522+0000 7fe98effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe99009e930 0x7fe99011c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49374/0 (socket says 172.21.15.26:49374) 2023-10-01T08:01:43.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.522+0000 7fe98effd700 1 -- 172.21.15.26:0/2244551045 learned_addr learned my addr 172.21.15.26:0/2244551045 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:43.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.522+0000 7fe98f7fe700 1 --2- 172.21.15.26:0/2244551045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe990136fe0 0x7fe99011cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:43.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.522+0000 7fe98e7fc700 1 -- 172.21.15.26:0/2244551045 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe99009e930 msgr2=0x7fe99011c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:43.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.522+0000 7fe98e7fc700 1 --2- 172.21.15.26:0/2244551045 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe99009e930 0x7fe99011c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.522+0000 7fe98e7fc700 1 -- 172.21.15.26:0/2244551045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe990136fe0 msgr2=0x7fe99011cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:43.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.522+0000 7fe98e7fc700 1 --2- 172.21.15.26:0/2244551045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe990136fe0 0x7fe99011cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.522+0000 7fe98e7fc700 1 -- 172.21.15.26:0/2244551045 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe988009a70 con 0x7fe99009f410 2023-10-01T08:01:43.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.522+0000 7fe98effd700 1 --2- 172.21.15.26:0/2244551045 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe99009e930 0x7fe99011c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:43.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.523+0000 7fe98e7fc700 1 --2- 172.21.15.26:0/2244551045 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe99009f410 0x7fe99011ca60 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fe984016000 tx=0x7fe984004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:43.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.523+0000 7fe977fff700 1 -- 172.21.15.26:0/2244551045 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe984004450 con 0x7fe99009f410 2023-10-01T08:01:43.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.523+0000 7fe995989700 1 -- 172.21.15.26:0/2244551045 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe984009550 con 0x7fe99009f410 2023-10-01T08:01:43.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.523+0000 7fe977fff700 1 -- 172.21.15.26:0/2244551045 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe98401f070 con 0x7fe99009f410 2023-10-01T08:01:43.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.523+0000 7fe977fff700 1 -- 172.21.15.26:0/2244551045 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9840038e0 con 0x7fe99009f410 2023-10-01T08:01:43.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.523+0000 7fe995989700 1 -- 172.21.15.26:0/2244551045 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe99011faa0 con 0x7fe99009f410 2023-10-01T08:01:43.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.524+0000 7fe995989700 1 -- 172.21.15.26:0/2244551045 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9901324a0 con 0x7fe99009f410 2023-10-01T08:01:43.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.524+0000 7fe977fff700 1 -- 172.21.15.26:0/2244551045 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe984003a40 con 0x7fe99009f410 2023-10-01T08:01:43.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.524+0000 7fe977fff700 1 -- 172.21.15.26:0/2244551045 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe984021070 con 0x7fe99009f410 2023-10-01T08:01:43.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.529+0000 7fe977fff700 1 -- 172.21.15.26:0/2244551045 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe9840045b0 con 0x7fe99009f410 2023-10-01T08:01:43.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.731+0000 7fe995989700 1 -- 172.21.15.26:0/2244551045 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe990074ea0 con 0x7fe99009f410 2023-10-01T08:01:43.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.731+0000 7fe977fff700 1 -- 172.21.15.26:0/2244551045 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe98402a070 con 0x7fe99009f410 2023-10-01T08:01:43.732 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:43.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.733+0000 7fe995989700 1 -- 172.21.15.26:0/2244551045 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe99009f410 msgr2=0x7fe99011ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:43.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.733+0000 7fe995989700 1 --2- 172.21.15.26:0/2244551045 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe99009f410 0x7fe99011ca60 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fe984016000 tx=0x7fe984004750 comp rx=0 tx=0).stop 2023-10-01T08:01:43.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.733+0000 7fe995989700 1 -- 172.21.15.26:0/2244551045 shutdown_connections 2023-10-01T08:01:43.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.733+0000 7fe995989700 1 --2- 172.21.15.26:0/2244551045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe990136fe0 0x7fe99011cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.733+0000 7fe995989700 1 --2- 172.21.15.26:0/2244551045 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fe99009e930 0x7fe99011c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.733+0000 7fe995989700 1 --2- 172.21.15.26:0/2244551045 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe99009f410 0x7fe99011ca60 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:43.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.733+0000 7fe995989700 1 -- 172.21.15.26:0/2244551045 >> 172.21.15.26:0/2244551045 conn(0x7fe9900a4210 msgr2=0x7fe9900a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:43.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.734+0000 7fe995989700 1 -- 172.21.15.26:0/2244551045 shutdown_connections 2023-10-01T08:01:43.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:43.734+0000 7fe995989700 1 -- 172.21.15.26:0/2244551045 wait complete. 2023-10-01T08:01:43.748 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:44.317 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:44.409 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:44.447 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:44.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.466+0000 7f8f0037a700 1 Processor -- start 2023-10-01T08:01:44.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.466+0000 7f8f0037a700 1 -- start start 2023-10-01T08:01:44.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.467+0000 7f8f0037a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8ef8136710 0x7f8ef8138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:44.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.467+0000 7f8f0037a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ef8139030 0x7f8ef813b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:44.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.467+0000 7f8f0037a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef806ef30 con 0x7f8ef81338a0 2023-10-01T08:01:44.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.467+0000 7f8f0037a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef806fef0 con 0x7f8ef8136710 2023-10-01T08:01:44.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.467+0000 7f8f0037a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef81334b0 con 0x7f8ef8139030 2023-10-01T08:01:44.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.467+0000 7f8efd915700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8ef8136710 0x7f8ef8138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:44.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.467+0000 7f8efe917700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ef8139030 0x7f8ef813b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:44.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.467+0000 7f8efd915700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8ef8136710 0x7f8ef8138af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55668/0 (socket says 172.21.15.26:55668) 2023-10-01T08:01:44.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.467+0000 7f8efe917700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ef8139030 0x7f8ef813b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35418/0 (socket says 172.21.15.26:35418) 2023-10-01T08:01:44.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.467+0000 7f8efd915700 1 -- 172.21.15.26:0/2891475123 learned_addr learned my addr 172.21.15.26:0/2891475123 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:44.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.468+0000 7f8efe917700 1 -- 172.21.15.26:0/2891475123 >> v2:172.21.15.26:3300/0 conn(0x7f8ef8136710 msgr2=0x7f8ef8138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:44.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.468+0000 7f8efe917700 1 --2- 172.21.15.26:0/2891475123 >> v2:172.21.15.26:3300/0 conn(0x7f8ef8136710 0x7f8ef8138af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:44.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.468+0000 7f8efe917700 1 -- 172.21.15.26:0/2891475123 >> v1:172.21.15.26:6789/0 conn(0x7f8ef81338a0 legacy=0x7f8ef8133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:44.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.468+0000 7f8efe917700 1 -- 172.21.15.26:0/2891475123 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef806fc30 con 0x7f8ef8139030 2023-10-01T08:01:44.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.468+0000 7f8efe917700 1 --2- 172.21.15.26:0/2891475123 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ef8139030 0x7f8ef813b410 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0009d90 tx=0x7f8ef000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21234d1124a49f34 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:44.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.468+0000 7f8efd114700 1 -- 172.21.15.26:0/2891475123 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef000e070 con 0x7f8ef8139030 2023-10-01T08:01:44.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.468+0000 7f8efd114700 1 -- 172.21.15.26:0/2891475123 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef000bb20 con 0x7f8ef8139030 2023-10-01T08:01:44.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.468+0000 7f8efd114700 1 -- 172.21.15.26:0/2891475123 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef0012430 con 0x7f8ef8139030 2023-10-01T08:01:44.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.469+0000 7f8f0037a700 1 -- 172.21.15.26:0/2891475123 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ef8139030 msgr2=0x7f8ef813b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:44.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.469+0000 7f8f0037a700 1 --2- 172.21.15.26:0/2891475123 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ef8139030 0x7f8ef813b410 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0009d90 tx=0x7f8ef000b330 comp rx=0 tx=0).stop 2023-10-01T08:01:44.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.469+0000 7f8f0037a700 1 -- 172.21.15.26:0/2891475123 shutdown_connections 2023-10-01T08:01:44.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.469+0000 7f8f0037a700 1 --2- 172.21.15.26:0/2891475123 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ef8139030 0x7f8ef813b410 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:44.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.469+0000 7f8f0037a700 1 --2- 172.21.15.26:0/2891475123 >> v2:172.21.15.26:3300/0 conn(0x7f8ef8136710 0x7f8ef8138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:44.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.469+0000 7f8f0037a700 1 -- 172.21.15.26:0/2891475123 >> 172.21.15.26:0/2891475123 conn(0x7f8ef80a2aa0 msgr2=0x7f8ef80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:44.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.469+0000 7f8f0037a700 1 -- 172.21.15.26:0/2891475123 shutdown_connections 2023-10-01T08:01:44.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.470+0000 7f8f0037a700 1 -- 172.21.15.26:0/2891475123 wait complete. 2023-10-01T08:01:44.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.471+0000 7f8f0037a700 1 Processor -- start 2023-10-01T08:01:44.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.471+0000 7f8f0037a700 1 -- start start 2023-10-01T08:01:44.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.472+0000 7f8f0037a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ef81338a0 0x7f8ef811ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:44.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.472+0000 7f8f0037a700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8ef8136710 0x7f8ef811b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:44.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.472+0000 7f8f0037a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ef8139030 0x7f8ef811b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:44.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.472+0000 7f8f0037a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef811e550 con 0x7f8ef8139030 2023-10-01T08:01:44.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.472+0000 7f8f0037a700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef8138d90 con 0x7f8ef81338a0 2023-10-01T08:01:44.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.472+0000 7f8f0037a700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef806f640 con 0x7f8ef8136710 2023-10-01T08:01:44.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.472+0000 7f8efe116700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ef81338a0 0x7f8ef811ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:44.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.472+0000 7f8efe116700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ef81338a0 0x7f8ef811ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35434/0 (socket says 172.21.15.26:35434) 2023-10-01T08:01:44.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.472+0000 7f8efe116700 1 -- 172.21.15.26:0/3578829536 learned_addr learned my addr 172.21.15.26:0/3578829536 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:44.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.472+0000 7f8efd915700 1 --2- 172.21.15.26:0/3578829536 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8ef8136710 0x7f8ef811b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:44.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.472+0000 7f8efe116700 1 -- 172.21.15.26:0/3578829536 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8ef8136710 msgr2=0x7f8ef811b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:44.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.472+0000 7f8efe116700 1 --2- 172.21.15.26:0/3578829536 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8ef8136710 0x7f8ef811b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:44.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.472+0000 7f8efe116700 1 -- 172.21.15.26:0/3578829536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ef8139030 msgr2=0x7f8ef811b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:44.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.472+0000 7f8efe116700 1 --2- 172.21.15.26:0/3578829536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ef8139030 0x7f8ef811b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:44.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.472+0000 7f8efe116700 1 -- 172.21.15.26:0/3578829536 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef0009a70 con 0x7f8ef81338a0 2023-10-01T08:01:44.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.472+0000 7f8efd915700 1 --2- 172.21.15.26:0/3578829536 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8ef8136710 0x7f8ef811b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:44.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.472+0000 7f8efe116700 1 --2- 172.21.15.26:0/3578829536 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ef81338a0 0x7f8ef811ad10 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f8ef400c4e0 tx=0x7f8ef400c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:44.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.473+0000 7f8eeeffd700 1 -- 172.21.15.26:0/3578829536 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef40052d0 con 0x7f8ef81338a0 2023-10-01T08:01:44.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.473+0000 7f8eeeffd700 1 -- 172.21.15.26:0/3578829536 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef4005430 con 0x7f8ef81338a0 2023-10-01T08:01:44.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.473+0000 7f8eeeffd700 1 -- 172.21.15.26:0/3578829536 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef40038c0 con 0x7f8ef81338a0 2023-10-01T08:01:44.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.473+0000 7f8f0037a700 1 -- 172.21.15.26:0/3578829536 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef811ca30 con 0x7f8ef81338a0 2023-10-01T08:01:44.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.473+0000 7f8f0037a700 1 -- 172.21.15.26:0/3578829536 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef811efc0 con 0x7f8ef81338a0 2023-10-01T08:01:44.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.474+0000 7f8eeeffd700 1 -- 172.21.15.26:0/3578829536 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8ef4003a20 con 0x7f8ef81338a0 2023-10-01T08:01:44.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.474+0000 7f8eeeffd700 1 -- 172.21.15.26:0/3578829536 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8ef403eb50 con 0x7f8ef81338a0 2023-10-01T08:01:44.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.474+0000 7f8f0037a700 1 -- 172.21.15.26:0/3578829536 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef811e1f0 con 0x7f8ef81338a0 2023-10-01T08:01:44.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.479+0000 7f8eeeffd700 1 -- 172.21.15.26:0/3578829536 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ef4017080 con 0x7f8ef81338a0 2023-10-01T08:01:44.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.569+0000 7f9a46ebd700 1 Processor -- start 2023-10-01T08:01:44.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.569+0000 7f9a46ebd700 1 -- start start 2023-10-01T08:01:44.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.570+0000 7f9a46ebd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a400a0a30 0x7f9a400a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:44.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.570+0000 7f9a46ebd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9a40134170 0x7f9a4013bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:44.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.570+0000 7f9a46ebd700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a4009edd0 con 0x7f9a400a1340 2023-10-01T08:01:44.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.570+0000 7f9a46ebd700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a4009e1f0 con 0x7f9a40134170 2023-10-01T08:01:44.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.570+0000 7f9a46ebd700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4009dc50 con 0x7f9a400a0a30 2023-10-01T08:01:44.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.570+0000 7f9a44c59700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a400a0a30 0x7f9a400a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:44.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.570+0000 7f9a4545a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9a40134170 0x7f9a4013bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:44.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.570+0000 7f9a44c59700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a400a0a30 0x7f9a400a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35436/0 (socket says 172.21.15.26:35436) 2023-10-01T08:01:44.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.570+0000 7f9a4545a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9a40134170 0x7f9a4013bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55694/0 (socket says 172.21.15.26:55694) 2023-10-01T08:01:44.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.570+0000 7f9a44c59700 1 -- 172.21.15.26:0/3450163254 learned_addr learned my addr 172.21.15.26:0/3450163254 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:44.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.570+0000 7f9a44c59700 1 -- 172.21.15.26:0/3450163254 >> v2:172.21.15.26:3300/0 conn(0x7f9a40134170 msgr2=0x7f9a4013bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:44.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.570+0000 7f9a44c59700 1 --2- 172.21.15.26:0/3450163254 >> v2:172.21.15.26:3300/0 conn(0x7f9a40134170 0x7f9a4013bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:44.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.570+0000 7f9a44c59700 1 -- 172.21.15.26:0/3450163254 >> v1:172.21.15.26:6789/0 conn(0x7f9a400a1340 legacy=0x7f9a40133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:44.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.570+0000 7f9a44c59700 1 -- 172.21.15.26:0/3450163254 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a400a1fe0 con 0x7f9a400a0a30 2023-10-01T08:01:44.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.570+0000 7f9a4545a700 1 --2- 172.21.15.26:0/3450163254 >> v2:172.21.15.26:3300/0 conn(0x7f9a40134170 0x7f9a4013bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:44.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.571+0000 7f9a44c59700 1 --2- 172.21.15.26:0/3450163254 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a400a0a30 0x7f9a400a0e00 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0098f0 tx=0x7f9a3c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6e31918737f82f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:44.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.571+0000 7f9a377fe700 1 -- 172.21.15.26:0/3450163254 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c011830 con 0x7f9a400a0a30 2023-10-01T08:01:44.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.571+0000 7f9a377fe700 1 -- 172.21.15.26:0/3450163254 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3c011990 con 0x7f9a400a0a30 2023-10-01T08:01:44.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.571+0000 7f9a377fe700 1 -- 172.21.15.26:0/3450163254 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c011d20 con 0x7f9a400a0a30 2023-10-01T08:01:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.572+0000 7f9a46ebd700 1 -- 172.21.15.26:0/3450163254 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a400a0a30 msgr2=0x7f9a400a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.572+0000 7f9a46ebd700 1 --2- 172.21.15.26:0/3450163254 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a400a0a30 0x7f9a400a0e00 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0098f0 tx=0x7f9a3c009c00 comp rx=0 tx=0).stop 2023-10-01T08:01:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.572+0000 7f9a46ebd700 1 -- 172.21.15.26:0/3450163254 shutdown_connections 2023-10-01T08:01:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.572+0000 7f9a46ebd700 1 --2- 172.21.15.26:0/3450163254 >> v2:172.21.15.26:3300/0 conn(0x7f9a40134170 0x7f9a4013bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.572+0000 7f9a46ebd700 1 --2- 172.21.15.26:0/3450163254 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a400a0a30 0x7f9a400a0e00 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.572+0000 7f9a46ebd700 1 -- 172.21.15.26:0/3450163254 >> 172.21.15.26:0/3450163254 conn(0x7f9a400a6550 msgr2=0x7f9a400a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.572+0000 7f9a46ebd700 1 -- 172.21.15.26:0/3450163254 shutdown_connections 2023-10-01T08:01:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.572+0000 7f9a46ebd700 1 -- 172.21.15.26:0/3450163254 wait complete. 2023-10-01T08:01:44.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.573+0000 7f9a46ebd700 1 Processor -- start 2023-10-01T08:01:44.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.573+0000 7f9a46ebd700 1 -- start start 2023-10-01T08:01:44.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.573+0000 7f9a46ebd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a400a0a30 0x7f9a40122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:44.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.573+0000 7f9a46ebd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a400a1340 0x7f9a40122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:44.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.573+0000 7f9a46ebd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a40134170 0x7f9a40123380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:44.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.573+0000 7f9a46ebd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a40124690 con 0x7f9a400a0a30 2023-10-01T08:01:44.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.573+0000 7f9a46ebd700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a400a4f40 con 0x7f9a40134170 2023-10-01T08:01:44.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.573+0000 7f9a46ebd700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a40126420 con 0x7f9a400a1340 2023-10-01T08:01:44.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.574+0000 7f9a4545a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a40134170 0x7f9a40123380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:44.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.574+0000 7f9a4545a700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a40134170 0x7f9a40123380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35440/0 (socket says 172.21.15.26:35440) 2023-10-01T08:01:44.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.574+0000 7f9a4545a700 1 -- 172.21.15.26:0/1275864468 learned_addr learned my addr 172.21.15.26:0/1275864468 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:44.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.574+0000 7f9a37fff700 1 --2- 172.21.15.26:0/1275864468 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a400a1340 0x7f9a40122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:44.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.574+0000 7f9a44c59700 1 --2- 172.21.15.26:0/1275864468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a400a0a30 0x7f9a40122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:44.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.574+0000 7f9a4545a700 1 -- 172.21.15.26:0/1275864468 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a400a1340 msgr2=0x7f9a40122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:44.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.574+0000 7f9a4545a700 1 --2- 172.21.15.26:0/1275864468 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a400a1340 0x7f9a40122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:44.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.574+0000 7f9a4545a700 1 -- 172.21.15.26:0/1275864468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a400a0a30 msgr2=0x7f9a40122900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:44.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.574+0000 7f9a4545a700 1 --2- 172.21.15.26:0/1275864468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a400a0a30 0x7f9a40122900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:44.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.574+0000 7f9a4545a700 1 -- 172.21.15.26:0/1275864468 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a38009a70 con 0x7f9a40134170 2023-10-01T08:01:44.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.574+0000 7f9a4545a700 1 --2- 172.21.15.26:0/1275864468 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a40134170 0x7f9a40123380 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f9a3800efc0 tx=0x7f9a3800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:44.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.574+0000 7f9a357fa700 1 -- 172.21.15.26:0/1275864468 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3800ca90 con 0x7f9a40134170 2023-10-01T08:01:44.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.574+0000 7f9a357fa700 1 -- 172.21.15.26:0/1275864468 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3800f040 con 0x7f9a40134170 2023-10-01T08:01:44.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.574+0000 7f9a357fa700 1 -- 172.21.15.26:0/1275864468 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3800ce10 con 0x7f9a40134170 2023-10-01T08:01:44.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.574+0000 7f9a46ebd700 1 -- 172.21.15.26:0/1275864468 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a3c009550 con 0x7f9a40134170 2023-10-01T08:01:44.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.574+0000 7f9a46ebd700 1 -- 172.21.15.26:0/1275864468 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a40133420 con 0x7f9a40134170 2023-10-01T08:01:44.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.575+0000 7f9a357fa700 1 -- 172.21.15.26:0/1275864468 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9a38014480 con 0x7f9a40134170 2023-10-01T08:01:44.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.575+0000 7f9a357fa700 1 -- 172.21.15.26:0/1275864468 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9a3803fd50 con 0x7f9a40134170 2023-10-01T08:01:44.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.576+0000 7f9a46ebd700 1 -- 172.21.15.26:0/1275864468 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a400a1d40 con 0x7f9a40134170 2023-10-01T08:01:44.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.581+0000 7f9a357fa700 1 -- 172.21.15.26:0/1275864468 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9a38012930 con 0x7f9a40134170 2023-10-01T08:01:44.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.594+0000 7f395fbd1700 1 Processor -- start 2023-10-01T08:01:44.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.594+0000 7f395fbd1700 1 -- start start 2023-10-01T08:01:44.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.595+0000 7f395fbd1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f395809d6f0 0x7f395809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:44.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.595+0000 7f395fbd1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f395809e410 0x7f3958134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:44.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.595+0000 7f395fbd1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f395809b120 con 0x7f395809e000 2023-10-01T08:01:44.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.595+0000 7f395fbd1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f395806b460 con 0x7f395809e410 2023-10-01T08:01:44.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.595+0000 7f395fbd1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f395809a7e0 con 0x7f395809d6f0 2023-10-01T08:01:44.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.595+0000 7f395e16e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f395809e410 0x7f3958134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:44.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.595+0000 7f395e16e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f395809e410 0x7f3958134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55706/0 (socket says 172.21.15.26:55706) 2023-10-01T08:01:44.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.595+0000 7f395d16c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f395809e000 0x7f39581339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39506/0 (socket says 172.21.15.26:39506) 2023-10-01T08:01:44.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.595+0000 7f395e16e700 1 -- 172.21.15.26:0/3428802383 learned_addr learned my addr 172.21.15.26:0/3428802383 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:44.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.595+0000 7f395d96d700 1 --2- 172.21.15.26:0/3428802383 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f395809d6f0 0x7f395809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:44.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.595+0000 7f395e16e700 1 -- 172.21.15.26:0/3428802383 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f395809d6f0 msgr2=0x7f395809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:44.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.595+0000 7f395e16e700 1 --2- 172.21.15.26:0/3428802383 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f395809d6f0 0x7f395809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:44.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.595+0000 7f395e16e700 1 -- 172.21.15.26:0/3428802383 >> v1:172.21.15.26:6789/0 conn(0x7f395809e000 legacy=0x7f39581339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:44.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.596+0000 7f395e16e700 1 -- 172.21.15.26:0/3428802383 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f395809a500 con 0x7f395809e410 2023-10-01T08:01:44.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.595+0000 7f395c96b700 1 -- 172.21.15.26:0/3428802383 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3585786971 0 0) 0x7f395809b120 con 0x7f395809e000 2023-10-01T08:01:44.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.596+0000 7f395d96d700 1 --2- 172.21.15.26:0/3428802383 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f395809d6f0 0x7f395809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:44.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.596+0000 7f395e16e700 1 --2- 172.21.15.26:0/3428802383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f395809e410 0x7f3958134100 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f3950009e50 tx=0x7f395000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d43aaa135f4264 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:44.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.596+0000 7f395c96b700 1 -- 172.21.15.26:0/3428802383 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395000e070 con 0x7f395809e410 2023-10-01T08:01:44.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.596+0000 7f395c96b700 1 -- 172.21.15.26:0/3428802383 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395000b910 con 0x7f395809e410 2023-10-01T08:01:44.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.596+0000 7f395c96b700 1 -- 172.21.15.26:0/3428802383 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395000bcc0 con 0x7f395809e410 2023-10-01T08:01:44.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.597+0000 7f395fbd1700 1 -- 172.21.15.26:0/3428802383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f395809e410 msgr2=0x7f3958134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:44.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.597+0000 7f395fbd1700 1 --2- 172.21.15.26:0/3428802383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f395809e410 0x7f3958134100 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f3950009e50 tx=0x7f395000b330 comp rx=0 tx=0).stop 2023-10-01T08:01:44.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.597+0000 7f395fbd1700 1 -- 172.21.15.26:0/3428802383 shutdown_connections 2023-10-01T08:01:44.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.597+0000 7f395fbd1700 1 --2- 172.21.15.26:0/3428802383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f395809e410 0x7f3958134100 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:44.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.597+0000 7f395fbd1700 1 --2- 172.21.15.26:0/3428802383 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f395809d6f0 0x7f395809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:44.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.597+0000 7f395fbd1700 1 -- 172.21.15.26:0/3428802383 >> 172.21.15.26:0/3428802383 conn(0x7f3958066f50 msgr2=0x7f395809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:44.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.597+0000 7f395fbd1700 1 -- 172.21.15.26:0/3428802383 shutdown_connections 2023-10-01T08:01:44.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.597+0000 7f395fbd1700 1 -- 172.21.15.26:0/3428802383 wait complete. 2023-10-01T08:01:44.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.598+0000 7f395fbd1700 1 Processor -- start 2023-10-01T08:01:44.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.598+0000 7f395fbd1700 1 -- start start 2023-10-01T08:01:44.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.599+0000 7f395fbd1700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f395809d6f0 0x7f39581c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:44.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.599+0000 7f395fbd1700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f395809e000 0x7f39581c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:44.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.599+0000 7f395fbd1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f395809e410 0x7f39581c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:44.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.599+0000 7f395fbd1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39581a8a30 con 0x7f395809e410 2023-10-01T08:01:44.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.599+0000 7f395fbd1700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39581a9780 con 0x7f395809d6f0 2023-10-01T08:01:44.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.599+0000 7f395fbd1700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39581c8e80 con 0x7f395809e000 2023-10-01T08:01:44.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.599+0000 7f395e16e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f395809e410 0x7f39581c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:44.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.599+0000 7f395d16c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f395809e000 0x7f39581c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:44.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.599+0000 7f395e16e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f395809e410 0x7f39581c49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55712/0 (socket says 172.21.15.26:55712) 2023-10-01T08:01:44.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.599+0000 7f395e16e700 1 -- 172.21.15.26:0/3648353064 learned_addr learned my addr 172.21.15.26:0/3648353064 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:44.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.599+0000 7f395d96d700 1 --2- 172.21.15.26:0/3648353064 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f395809d6f0 0x7f39581c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:44.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.599+0000 7f395e16e700 1 -- 172.21.15.26:0/3648353064 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f395809e000 msgr2=0x7f39581c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:44.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.599+0000 7f395e16e700 1 --2- 172.21.15.26:0/3648353064 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f395809e000 0x7f39581c8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:44.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.599+0000 7f395e16e700 1 -- 172.21.15.26:0/3648353064 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f395809d6f0 msgr2=0x7f39581c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:44.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.599+0000 7f395e16e700 1 --2- 172.21.15.26:0/3648353064 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f395809d6f0 0x7f39581c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:44.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.599+0000 7f395e16e700 1 -- 172.21.15.26:0/3648353064 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39540094a0 con 0x7f395809e410 2023-10-01T08:01:44.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.599+0000 7f395d16c700 1 --2- 172.21.15.26:0/3648353064 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f395809e000 0x7f39581c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:44.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.600+0000 7f395e16e700 1 --2- 172.21.15.26:0/3648353064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f395809e410 0x7f39581c49d0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f395000b680 tx=0x7f3950004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:44.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.600+0000 7f394e7fc700 1 -- 172.21.15.26:0/3648353064 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395001c640 con 0x7f395809e410 2023-10-01T08:01:44.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.600+0000 7f394e7fc700 1 -- 172.21.15.26:0/3648353064 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395001c7a0 con 0x7f395809e410 2023-10-01T08:01:44.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.600+0000 7f395fbd1700 1 -- 172.21.15.26:0/3648353064 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3950009b30 con 0x7f395809e410 2023-10-01T08:01:44.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.600+0000 7f394e7fc700 1 -- 172.21.15.26:0/3648353064 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395001cb50 con 0x7f395809e410 2023-10-01T08:01:44.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.600+0000 7f395fbd1700 1 -- 172.21.15.26:0/3648353064 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39581a85e0 con 0x7f395809e410 2023-10-01T08:01:44.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.601+0000 7f394e7fc700 1 -- 172.21.15.26:0/3648353064 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f395001ccb0 con 0x7f395809e410 2023-10-01T08:01:44.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.601+0000 7f395fbd1700 1 -- 172.21.15.26:0/3648353064 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39581a94e0 con 0x7f395809e410 2023-10-01T08:01:44.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.601+0000 7f394e7fc700 1 -- 172.21.15.26:0/3648353064 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f39500413e0 con 0x7f395809e410 2023-10-01T08:01:44.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.606+0000 7f394e7fc700 1 -- 172.21.15.26:0/3648353064 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f39581a94e0 con 0x7f395809e410 2023-10-01T08:01:44.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.711+0000 7f8f0037a700 1 -- 172.21.15.26:0/3578829536 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8ef8074ea0 con 0x7f8ef81338a0 2023-10-01T08:01:44.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.712+0000 7f8eeeffd700 1 -- 172.21.15.26:0/3578829536 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ef4018260 con 0x7f8ef81338a0 2023-10-01T08:01:44.713 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:44.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.714+0000 7f8f0037a700 1 -- 172.21.15.26:0/3578829536 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ef81338a0 msgr2=0x7f8ef811ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:44.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.714+0000 7f8f0037a700 1 --2- 172.21.15.26:0/3578829536 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ef81338a0 0x7f8ef811ad10 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f8ef400c4e0 tx=0x7f8ef400c7f0 comp rx=0 tx=0).stop 2023-10-01T08:01:44.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.714+0000 7f8f0037a700 1 -- 172.21.15.26:0/3578829536 shutdown_connections 2023-10-01T08:01:44.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.714+0000 7f8f0037a700 1 --2- 172.21.15.26:0/3578829536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ef8139030 0x7f8ef811b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:44.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.714+0000 7f8f0037a700 1 --2- 172.21.15.26:0/3578829536 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8ef81338a0 0x7f8ef811ad10 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:44.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.714+0000 7f8f0037a700 1 --2- 172.21.15.26:0/3578829536 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8ef8136710 0x7f8ef811b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:44.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.714+0000 7f8f0037a700 1 -- 172.21.15.26:0/3578829536 >> 172.21.15.26:0/3578829536 conn(0x7f8ef80a2aa0 msgr2=0x7f8ef81344d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:44.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.714+0000 7f8f0037a700 1 -- 172.21.15.26:0/3578829536 shutdown_connections 2023-10-01T08:01:44.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.714+0000 7f8f0037a700 1 -- 172.21.15.26:0/3578829536 wait complete. 2023-10-01T08:01:44.729 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:44.748 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:44.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.791+0000 7f9a46ebd700 1 -- 172.21.15.26:0/1275864468 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9a40074ea0 con 0x7f9a40134170 2023-10-01T08:01:44.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.792+0000 7f9a357fa700 1 -- 172.21.15.26:0/1275864468 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9a38012340 con 0x7f9a40134170 2023-10-01T08:01:44.792 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:44.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.794+0000 7f9a46ebd700 1 -- 172.21.15.26:0/1275864468 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a40134170 msgr2=0x7f9a40123380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:44.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.794+0000 7f9a46ebd700 1 --2- 172.21.15.26:0/1275864468 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a40134170 0x7f9a40123380 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f9a3800efc0 tx=0x7f9a3800c3a0 comp rx=0 tx=0).stop 2023-10-01T08:01:44.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.794+0000 7f9a46ebd700 1 -- 172.21.15.26:0/1275864468 shutdown_connections 2023-10-01T08:01:44.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.794+0000 7f9a46ebd700 1 --2- 172.21.15.26:0/1275864468 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a40134170 0x7f9a40123380 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:44.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.794+0000 7f9a46ebd700 1 --2- 172.21.15.26:0/1275864468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a400a0a30 0x7f9a40122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:44.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.794+0000 7f9a46ebd700 1 --2- 172.21.15.26:0/1275864468 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9a400a1340 0x7f9a40122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:44.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.794+0000 7f9a46ebd700 1 -- 172.21.15.26:0/1275864468 >> 172.21.15.26:0/1275864468 conn(0x7f9a400a6550 msgr2=0x7f9a4009ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:44.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.794+0000 7f9a46ebd700 1 -- 172.21.15.26:0/1275864468 shutdown_connections 2023-10-01T08:01:44.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.794+0000 7f9a46ebd700 1 -- 172.21.15.26:0/1275864468 wait complete. 2023-10-01T08:01:44.810 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:44.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.814+0000 7f395fbd1700 1 -- 172.21.15.26:0/3648353064 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f39581a94e0 con 0x7f395809e410 2023-10-01T08:01:44.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.815+0000 7f394e7fc700 1 -- 172.21.15.26:0/3648353064 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f39581a94e0 con 0x7f395809e410 2023-10-01T08:01:44.816 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:44.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.817+0000 7f395fbd1700 1 -- 172.21.15.26:0/3648353064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f395809e410 msgr2=0x7f39581c49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:44.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.817+0000 7f395fbd1700 1 --2- 172.21.15.26:0/3648353064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f395809e410 0x7f39581c49d0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f395000b680 tx=0x7f3950004ad0 comp rx=0 tx=0).stop 2023-10-01T08:01:44.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.817+0000 7f395fbd1700 1 -- 172.21.15.26:0/3648353064 shutdown_connections 2023-10-01T08:01:44.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.817+0000 7f395fbd1700 1 --2- 172.21.15.26:0/3648353064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f395809e410 0x7f39581c49d0 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:44.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.817+0000 7f395fbd1700 1 --2- 172.21.15.26:0/3648353064 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f395809d6f0 0x7f39581c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:44.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.817+0000 7f395fbd1700 1 --2- 172.21.15.26:0/3648353064 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f395809e000 0x7f39581c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:44.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.817+0000 7f395fbd1700 1 -- 172.21.15.26:0/3648353064 >> 172.21.15.26:0/3648353064 conn(0x7f3958066f50 msgr2=0x7f39581bacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:44.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.817+0000 7f395fbd1700 1 -- 172.21.15.26:0/3648353064 shutdown_connections 2023-10-01T08:01:44.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.818+0000 7f395fbd1700 1 -- 172.21.15.26:0/3648353064 wait complete. 2023-10-01T08:01:44.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:44.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.914+0000 7f3c251e2700 1 Processor -- start 2023-10-01T08:01:44.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.914+0000 7f3c251e2700 1 -- start start 2023-10-01T08:01:44.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.914+0000 7f3c251e2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3c2009d9f0 0x7f3c20136530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:44.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.915+0000 7f3c251e2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3c20136a70 0x7f3c20138e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:44.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.915+0000 7f3c251e2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c2009e130 con 0x7f3c201316c0 2023-10-01T08:01:44.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.915+0000 7f3c251e2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c201321a0 con 0x7f3c2009d9f0 2023-10-01T08:01:44.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.915+0000 7f3c251e2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c201312b0 con 0x7f3c20136a70 2023-10-01T08:01:44.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.915+0000 7f3c1e59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3c2009d9f0 0x7f3c20136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:44.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.915+0000 7f3c1e59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3c2009d9f0 0x7f3c20136530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55722/0 (socket says 172.21.15.26:55722) 2023-10-01T08:01:44.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.915+0000 7f3c1f59e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3c20136a70 0x7f3c20138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:44.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.915+0000 7f3c1e59c700 1 -- 172.21.15.26:0/3062817452 learned_addr learned my addr 172.21.15.26:0/3062817452 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:44.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.915+0000 7f3c1e59c700 1 -- 172.21.15.26:0/3062817452 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3c20136a70 msgr2=0x7f3c20138e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:44.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.915+0000 7f3c1e59c700 1 --2- 172.21.15.26:0/3062817452 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3c20136a70 0x7f3c20138e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:44.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.915+0000 7f3c1e59c700 1 -- 172.21.15.26:0/3062817452 >> v1:172.21.15.26:6789/0 conn(0x7f3c201316c0 legacy=0x7f3c20131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:44.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.915+0000 7f3c1e59c700 1 -- 172.21.15.26:0/3062817452 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c2009f6e0 con 0x7f3c2009d9f0 2023-10-01T08:01:44.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.915+0000 7f3c1f59e700 1 --2- 172.21.15.26:0/3062817452 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3c20136a70 0x7f3c20138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:44.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.915+0000 7f3c1e59c700 1 --2- 172.21.15.26:0/3062817452 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c2009d9f0 0x7f3c20136530 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f3c140098f0 tx=0x7f3c14009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a1a0b02bf4e6e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:44.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.915+0000 7f3c1dd9b700 1 -- 172.21.15.26:0/3062817452 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c14011830 con 0x7f3c2009d9f0 2023-10-01T08:01:44.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.915+0000 7f3c1dd9b700 1 -- 172.21.15.26:0/3062817452 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c14011990 con 0x7f3c2009d9f0 2023-10-01T08:01:44.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.916+0000 7f3c1dd9b700 1 -- 172.21.15.26:0/3062817452 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c14011d20 con 0x7f3c2009d9f0 2023-10-01T08:01:44.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.916+0000 7f3c251e2700 1 -- 172.21.15.26:0/3062817452 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c2009d9f0 msgr2=0x7f3c20136530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:44.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.916+0000 7f3c251e2700 1 --2- 172.21.15.26:0/3062817452 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c2009d9f0 0x7f3c20136530 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f3c140098f0 tx=0x7f3c14009c00 comp rx=0 tx=0).stop 2023-10-01T08:01:44.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.916+0000 7f3c251e2700 1 -- 172.21.15.26:0/3062817452 shutdown_connections 2023-10-01T08:01:44.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.916+0000 7f3c251e2700 1 --2- 172.21.15.26:0/3062817452 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3c20136a70 0x7f3c20138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:44.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.916+0000 7f3c251e2700 1 --2- 172.21.15.26:0/3062817452 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c2009d9f0 0x7f3c20136530 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:44.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.916+0000 7f3c251e2700 1 -- 172.21.15.26:0/3062817452 >> 172.21.15.26:0/3062817452 conn(0x7f3c20066f50 msgr2=0x7f3c2009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:44.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.916+0000 7f3c251e2700 1 -- 172.21.15.26:0/3062817452 shutdown_connections 2023-10-01T08:01:44.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.916+0000 7f3c251e2700 1 -- 172.21.15.26:0/3062817452 wait complete. 2023-10-01T08:01:44.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.917+0000 7f3c251e2700 1 Processor -- start 2023-10-01T08:01:44.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.918+0000 7f3c251e2700 1 -- start start 2023-10-01T08:01:44.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.918+0000 7f3c251e2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3c2009d9f0 0x7f3c2012abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:44.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.918+0000 7f3c251e2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c201316c0 0x7f3c2012b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:44.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.918+0000 7f3c251e2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3c20136a70 0x7f3c20134390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:44.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.918+0000 7f3c251e2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c200727d0 con 0x7f3c201316c0 2023-10-01T08:01:44.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.918+0000 7f3c251e2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2012b650 con 0x7f3c20136a70 2023-10-01T08:01:44.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.918+0000 7f3c251e2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2009bcf0 con 0x7f3c2009d9f0 2023-10-01T08:01:44.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.918+0000 7f3c1e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c201316c0 0x7f3c2012b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:44.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.918+0000 7f3c1f59e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3c20136a70 0x7f3c20134390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:44.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.918+0000 7f3c1f59e700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3c20136a70 0x7f3c20134390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35456/0 (socket says 172.21.15.26:35456) 2023-10-01T08:01:44.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.918+0000 7f3c1e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c201316c0 0x7f3c2012b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55730/0 (socket says 172.21.15.26:55730) 2023-10-01T08:01:44.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.918+0000 7f3c1f59e700 1 -- 172.21.15.26:0/1587805595 learned_addr learned my addr 172.21.15.26:0/1587805595 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:44.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.918+0000 7f3c1ed9d700 1 --2- 172.21.15.26:0/1587805595 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3c2009d9f0 0x7f3c2012abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:44.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.919+0000 7f3c1e59c700 1 -- 172.21.15.26:0/1587805595 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3c2009d9f0 msgr2=0x7f3c2012abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:44.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.919+0000 7f3c1e59c700 1 --2- 172.21.15.26:0/1587805595 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3c2009d9f0 0x7f3c2012abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:44.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.919+0000 7f3c1e59c700 1 -- 172.21.15.26:0/1587805595 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3c20136a70 msgr2=0x7f3c20134390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:44.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.919+0000 7f3c1e59c700 1 --2- 172.21.15.26:0/1587805595 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3c20136a70 0x7f3c20134390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:44.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.919+0000 7f3c1e59c700 1 -- 172.21.15.26:0/1587805595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c18009a70 con 0x7f3c201316c0 2023-10-01T08:01:44.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.919+0000 7f3c1f59e700 1 --2- 172.21.15.26:0/1587805595 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3c20136a70 0x7f3c20134390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:44.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.919+0000 7f3c1ed9d700 1 --2- 172.21.15.26:0/1587805595 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3c2009d9f0 0x7f3c2012abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:44.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.919+0000 7f3c1e59c700 1 --2- 172.21.15.26:0/1587805595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c201316c0 0x7f3c2012b110 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f3c140098f0 tx=0x7f3c14004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:44.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.919+0000 7f3c077fe700 1 -- 172.21.15.26:0/1587805595 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c14004300 con 0x7f3c201316c0 2023-10-01T08:01:44.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.919+0000 7f3c077fe700 1 -- 172.21.15.26:0/1587805595 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1401f070 con 0x7f3c201316c0 2023-10-01T08:01:44.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.919+0000 7f3c251e2700 1 -- 172.21.15.26:0/1587805595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c14009550 con 0x7f3c201316c0 2023-10-01T08:01:44.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.919+0000 7f3c077fe700 1 -- 172.21.15.26:0/1587805595 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c140036a0 con 0x7f3c201316c0 2023-10-01T08:01:44.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.919+0000 7f3c251e2700 1 -- 172.21.15.26:0/1587805595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c2006e8e0 con 0x7f3c201316c0 2023-10-01T08:01:44.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.920+0000 7f3c077fe700 1 -- 172.21.15.26:0/1587805595 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3c14021030 con 0x7f3c201316c0 2023-10-01T08:01:44.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.920+0000 7f3c077fe700 1 -- 172.21.15.26:0/1587805595 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3c140408d0 con 0x7f3c201316c0 2023-10-01T08:01:44.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.920+0000 7f3c251e2700 1 -- 172.21.15.26:0/1587805595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c20074ea0 con 0x7f3c201316c0 2023-10-01T08:01:44.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:44.925+0000 7f3c077fe700 1 -- 172.21.15.26:0/1587805595 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3c140239c0 con 0x7f3c201316c0 2023-10-01T08:01:45.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.127+0000 7f3c251e2700 1 -- 172.21.15.26:0/1587805595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3c2009e980 con 0x7f3c201316c0 2023-10-01T08:01:45.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.128+0000 7f3c077fe700 1 -- 172.21.15.26:0/1587805595 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3c14015020 con 0x7f3c201316c0 2023-10-01T08:01:45.128 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:45.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.130+0000 7f3c251e2700 1 -- 172.21.15.26:0/1587805595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c201316c0 msgr2=0x7f3c2012b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:45.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.130+0000 7f3c251e2700 1 --2- 172.21.15.26:0/1587805595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c201316c0 0x7f3c2012b110 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f3c140098f0 tx=0x7f3c14004750 comp rx=0 tx=0).stop 2023-10-01T08:01:45.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.130+0000 7f3c251e2700 1 -- 172.21.15.26:0/1587805595 shutdown_connections 2023-10-01T08:01:45.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.130+0000 7f3c251e2700 1 --2- 172.21.15.26:0/1587805595 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3c20136a70 0x7f3c20134390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:45.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.130+0000 7f3c251e2700 1 --2- 172.21.15.26:0/1587805595 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3c2009d9f0 0x7f3c2012abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:45.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.130+0000 7f3c251e2700 1 --2- 172.21.15.26:0/1587805595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c201316c0 0x7f3c2012b110 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:45.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.130+0000 7f3c251e2700 1 -- 172.21.15.26:0/1587805595 >> 172.21.15.26:0/1587805595 conn(0x7f3c20066f50 msgr2=0x7f3c20136e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:45.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.131+0000 7f3c251e2700 1 -- 172.21.15.26:0/1587805595 shutdown_connections 2023-10-01T08:01:45.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.131+0000 7f3c251e2700 1 -- 172.21.15.26:0/1587805595 wait complete. 2023-10-01T08:01:45.145 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:45.730 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:45.810 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:45.837 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:45.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.879+0000 7f2d87b7f700 1 Processor -- start 2023-10-01T08:01:45.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.879+0000 7f2d87b7f700 1 -- start start 2023-10-01T08:01:45.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.880+0000 7f2d87b7f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2d8009d6f0 0x7f2d8009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:45.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.880+0000 7f2d87b7f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d8009e440 0x7f2d80134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:45.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.880+0000 7f2d87b7f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d8009b120 con 0x7f2d8009e000 2023-10-01T08:01:45.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.880+0000 7f2d87b7f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d8006b460 con 0x7f2d8009d6f0 2023-10-01T08:01:45.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.880+0000 7f2d87b7f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8009a7e0 con 0x7f2d8009e440 2023-10-01T08:01:45.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.880+0000 7f2d8591b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2d8009d6f0 0x7f2d8009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:45.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.880+0000 7f2d8591b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2d8009d6f0 0x7f2d8009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55738/0 (socket says 172.21.15.26:55738) 2023-10-01T08:01:45.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.880+0000 7f2d8591b700 1 -- 172.21.15.26:0/1003070751 learned_addr learned my addr 172.21.15.26:0/1003070751 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:45.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.880+0000 7f2d8591b700 1 -- 172.21.15.26:0/1003070751 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d8009e440 msgr2=0x7f2d80134100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-01T08:01:45.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.880+0000 7f2d84919700 1 -- 172.21.15.26:0/1003070751 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3421608150 0 0) 0x7f2d8009b120 con 0x7f2d8009e000 2023-10-01T08:01:45.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.881+0000 7f2d8591b700 1 --2- 172.21.15.26:0/1003070751 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d8009e440 0x7f2d80134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:45.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.881+0000 7f2d8591b700 1 -- 172.21.15.26:0/1003070751 >> v1:172.21.15.26:6789/0 conn(0x7f2d8009e000 legacy=0x7f2d801339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:45.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.881+0000 7f2d8591b700 1 -- 172.21.15.26:0/1003070751 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d8009a500 con 0x7f2d8009d6f0 2023-10-01T08:01:45.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.881+0000 7f2d8591b700 1 --2- 172.21.15.26:0/1003070751 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d8009d6f0 0x7f2d8009dac0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c009920 tx=0x7f2d7c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d35b14b6b7e15d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:45.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.881+0000 7f2d84919700 1 -- 172.21.15.26:0/1003070751 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c00ba20 con 0x7f2d8009d6f0 2023-10-01T08:01:45.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.881+0000 7f2d84919700 1 -- 172.21.15.26:0/1003070751 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7c00bb80 con 0x7f2d8009d6f0 2023-10-01T08:01:45.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.881+0000 7f2d84919700 1 -- 172.21.15.26:0/1003070751 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c009e70 con 0x7f2d8009d6f0 2023-10-01T08:01:45.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.882+0000 7f2d87b7f700 1 -- 172.21.15.26:0/1003070751 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d8009d6f0 msgr2=0x7f2d8009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:45.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.882+0000 7f2d87b7f700 1 --2- 172.21.15.26:0/1003070751 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d8009d6f0 0x7f2d8009dac0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c009920 tx=0x7f2d7c009c30 comp rx=0 tx=0).stop 2023-10-01T08:01:45.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.882+0000 7f2d87b7f700 1 -- 172.21.15.26:0/1003070751 shutdown_connections 2023-10-01T08:01:45.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.882+0000 7f2d87b7f700 1 --2- 172.21.15.26:0/1003070751 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d8009d6f0 0x7f2d8009dac0 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:45.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.882+0000 7f2d87b7f700 1 --2- 172.21.15.26:0/1003070751 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d8009e440 0x7f2d80134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:45.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.882+0000 7f2d87b7f700 1 -- 172.21.15.26:0/1003070751 >> 172.21.15.26:0/1003070751 conn(0x7f2d80066f50 msgr2=0x7f2d8009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:45.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.882+0000 7f2d87b7f700 1 -- 172.21.15.26:0/1003070751 shutdown_connections 2023-10-01T08:01:45.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.882+0000 7f2d87b7f700 1 -- 172.21.15.26:0/1003070751 wait complete. 2023-10-01T08:01:45.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.884+0000 7f2d87b7f700 1 Processor -- start 2023-10-01T08:01:45.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.884+0000 7f2d87b7f700 1 -- start start 2023-10-01T08:01:45.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.884+0000 7f2d87b7f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d8009d6f0 0x7f2d801a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:45.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.884+0000 7f2d87b7f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d8009e000 0x7f2d801a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:45.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.885+0000 7f2d87b7f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d8009e440 0x7f2d801c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:45.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.885+0000 7f2d87b7f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d801a4e00 con 0x7f2d8009d6f0 2023-10-01T08:01:45.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.885+0000 7f2d87b7f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d801a5cd0 con 0x7f2d8009e440 2023-10-01T08:01:45.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.885+0000 7f2d87b7f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8009c710 con 0x7f2d8009e000 2023-10-01T08:01:45.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.885+0000 7f2d8611c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d8009e440 0x7f2d801c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:45.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.885+0000 7f2d8611c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d8009e440 0x7f2d801c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35472/0 (socket says 172.21.15.26:35472) 2023-10-01T08:01:45.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.885+0000 7f2d8611c700 1 -- 172.21.15.26:0/511452497 learned_addr learned my addr 172.21.15.26:0/511452497 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:45.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.885+0000 7f2d8591b700 1 --2- 172.21.15.26:0/511452497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d8009d6f0 0x7f2d801a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:45.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.885+0000 7f2d8611c700 1 -- 172.21.15.26:0/511452497 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d8009e000 msgr2=0x7f2d801a5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:45.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.885+0000 7f2d8611c700 1 --2- 172.21.15.26:0/511452497 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d8009e000 0x7f2d801a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:45.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.885+0000 7f2d8611c700 1 -- 172.21.15.26:0/511452497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d8009d6f0 msgr2=0x7f2d801a5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:45.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.885+0000 7f2d8611c700 1 --2- 172.21.15.26:0/511452497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d8009d6f0 0x7f2d801a5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:45.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.885+0000 7f2d8611c700 1 -- 172.21.15.26:0/511452497 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d7c009550 con 0x7f2d8009e440 2023-10-01T08:01:45.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.885+0000 7f2d8591b700 1 --2- 172.21.15.26:0/511452497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d8009d6f0 0x7f2d801a5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T08:01:45.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.886+0000 7f2d8611c700 1 --2- 172.21.15.26:0/511452497 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d8009e440 0x7f2d801c8090 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f2d7800b9a0 tx=0x7f2d7800bd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:45.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.886+0000 7f2d767fc700 1 -- 172.21.15.26:0/511452497 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7800c9b0 con 0x7f2d8009e440 2023-10-01T08:01:45.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.886+0000 7f2d767fc700 1 -- 172.21.15.26:0/511452497 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7800cb30 con 0x7f2d8009e440 2023-10-01T08:01:45.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.886+0000 7f2d767fc700 1 -- 172.21.15.26:0/511452497 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d78014440 con 0x7f2d8009e440 2023-10-01T08:01:45.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.886+0000 7f2d87b7f700 1 -- 172.21.15.26:0/511452497 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d801a7d40 con 0x7f2d8009e440 2023-10-01T08:01:45.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.886+0000 7f2d87b7f700 1 -- 172.21.15.26:0/511452497 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d801a7040 con 0x7f2d8009e440 2023-10-01T08:01:45.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.887+0000 7f2d767fc700 1 -- 172.21.15.26:0/511452497 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d7801d3b0 con 0x7f2d8009e440 2023-10-01T08:01:45.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.887+0000 7f2d87b7f700 1 -- 172.21.15.26:0/511452497 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d80074ea0 con 0x7f2d8009e440 2023-10-01T08:01:45.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.887+0000 7f2d767fc700 1 -- 172.21.15.26:0/511452497 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2d78006e40 con 0x7f2d8009e440 2023-10-01T08:01:45.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.892+0000 7f2d767fc700 1 -- 172.21.15.26:0/511452497 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d78019070 con 0x7f2d8009e440 2023-10-01T08:01:45.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.954+0000 7f8e9b5e4700 1 Processor -- start 2023-10-01T08:01:45.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.954+0000 7f8e9b5e4700 1 -- start start 2023-10-01T08:01:45.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.955+0000 7f8e9b5e4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e9409d6f0 0x7f8e9409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:45.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.955+0000 7f8e9b5e4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e9409e000 0x7f8e941339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:45.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.955+0000 7f8e9b5e4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8e9409e410 0x7f8e94133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:45.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.955+0000 7f8e9b5e4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e9406b460 con 0x7f8e9409e410 2023-10-01T08:01:45.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.955+0000 7f8e9b5e4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9409b120 con 0x7f8e9409e000 2023-10-01T08:01:45.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.955+0000 7f8e9b5e4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9409a7e0 con 0x7f8e9409d6f0 2023-10-01T08:01:45.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.955+0000 7f8e98b7f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e9409e000 0x7f8e941339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:45.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.955+0000 7f8e99380700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e9409d6f0 0x7f8e9409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:45.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.955+0000 7f8e98b7f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e9409e000 0x7f8e941339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35476/0 (socket says 172.21.15.26:35476) 2023-10-01T08:01:45.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.955+0000 7f8e99380700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e9409d6f0 0x7f8e9409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49432/0 (socket says 172.21.15.26:49432) 2023-10-01T08:01:45.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.955+0000 7f8e98b7f700 1 -- 172.21.15.26:0/881306317 learned_addr learned my addr 172.21.15.26:0/881306317 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:45.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.955+0000 7f8e99b81700 1 --2- 172.21.15.26:0/881306317 >> v2:172.21.15.26:3300/0 conn(0x7f8e9409e410 0x7f8e94133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:45.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.956+0000 7f8e98b7f700 1 -- 172.21.15.26:0/881306317 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e9409d6f0 msgr2=0x7f8e9409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:45.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.956+0000 7f8e98b7f700 1 --2- 172.21.15.26:0/881306317 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e9409d6f0 0x7f8e9409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:45.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.956+0000 7f8e98b7f700 1 -- 172.21.15.26:0/881306317 >> v2:172.21.15.26:3300/0 conn(0x7f8e9409e410 msgr2=0x7f8e94133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:45.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.956+0000 7f8e98b7f700 1 --2- 172.21.15.26:0/881306317 >> v2:172.21.15.26:3300/0 conn(0x7f8e9409e410 0x7f8e94133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:45.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.956+0000 7f8e98b7f700 1 -- 172.21.15.26:0/881306317 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9409a500 con 0x7f8e9409e000 2023-10-01T08:01:45.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.956+0000 7f8e98b7f700 1 --2- 172.21.15.26:0/881306317 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e9409e000 0x7f8e941339f0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f8e84009920 tx=0x7f8e84009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2844d7bdde4d01e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:45.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.956+0000 7f8e8bfff700 1 -- 172.21.15.26:0/881306317 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e84011830 con 0x7f8e9409e000 2023-10-01T08:01:45.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.956+0000 7f8e8bfff700 1 -- 172.21.15.26:0/881306317 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e84011990 con 0x7f8e9409e000 2023-10-01T08:01:45.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.956+0000 7f8e8bfff700 1 -- 172.21.15.26:0/881306317 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e84011d20 con 0x7f8e9409e000 2023-10-01T08:01:45.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.957+0000 7f8e9b5e4700 1 -- 172.21.15.26:0/881306317 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e9409e000 msgr2=0x7f8e941339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:45.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.957+0000 7f8e9b5e4700 1 --2- 172.21.15.26:0/881306317 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e9409e000 0x7f8e941339f0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f8e84009920 tx=0x7f8e84009c30 comp rx=0 tx=0).stop 2023-10-01T08:01:45.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.957+0000 7f8e9b5e4700 1 -- 172.21.15.26:0/881306317 shutdown_connections 2023-10-01T08:01:45.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.957+0000 7f8e9b5e4700 1 --2- 172.21.15.26:0/881306317 >> v2:172.21.15.26:3300/0 conn(0x7f8e9409e410 0x7f8e94133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:45.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.957+0000 7f8e9b5e4700 1 --2- 172.21.15.26:0/881306317 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e9409d6f0 0x7f8e9409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:45.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.957+0000 7f8e9b5e4700 1 --2- 172.21.15.26:0/881306317 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e9409e000 0x7f8e941339f0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:45.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.957+0000 7f8e9b5e4700 1 -- 172.21.15.26:0/881306317 >> 172.21.15.26:0/881306317 conn(0x7f8e94066f50 msgr2=0x7f8e9409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:45.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.957+0000 7f8e9b5e4700 1 -- 172.21.15.26:0/881306317 shutdown_connections 2023-10-01T08:01:45.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.957+0000 7f8e9b5e4700 1 -- 172.21.15.26:0/881306317 wait complete. 2023-10-01T08:01:45.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.958+0000 7f8e9b5e4700 1 Processor -- start 2023-10-01T08:01:45.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.958+0000 7f8e9b5e4700 1 -- start start 2023-10-01T08:01:45.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.959+0000 7f8e9b5e4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e9409d6f0 0x7f8e941a6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:45.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.959+0000 7f8e9b5e4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e9409e000 0x7f8e941a65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:45.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.959+0000 7f8e9b5e4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e9409e410 0x7f8e941a6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:45.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.959+0000 7f8e9b5e4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e941b9390 con 0x7f8e9409e000 2023-10-01T08:01:45.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.959+0000 7f8e9b5e4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e941a74e0 con 0x7f8e9409d6f0 2023-10-01T08:01:45.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.959+0000 7f8e9b5e4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e941a8e00 con 0x7f8e9409e410 2023-10-01T08:01:45.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.959+0000 7f8e99380700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e9409d6f0 0x7f8e941a6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:45.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.959+0000 7f8e99b81700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e9409e410 0x7f8e941a6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:45.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.959+0000 7f8e99380700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e9409d6f0 0x7f8e941a6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35484/0 (socket says 172.21.15.26:35484) 2023-10-01T08:01:45.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.959+0000 7f8e99380700 1 -- 172.21.15.26:0/1342993417 learned_addr learned my addr 172.21.15.26:0/1342993417 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:45.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.959+0000 7f8e98b7f700 1 --2- 172.21.15.26:0/1342993417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e9409e000 0x7f8e941a65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:45.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.959+0000 7f8e99b81700 1 -- 172.21.15.26:0/1342993417 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e9409d6f0 msgr2=0x7f8e941a6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:45.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.959+0000 7f8e99b81700 1 --2- 172.21.15.26:0/1342993417 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e9409d6f0 0x7f8e941a6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:45.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.959+0000 7f8e99b81700 1 -- 172.21.15.26:0/1342993417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e9409e000 msgr2=0x7f8e941a65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:45.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.959+0000 7f8e99b81700 1 --2- 172.21.15.26:0/1342993417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e9409e000 0x7f8e941a65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:45.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.959+0000 7f8e99b81700 1 -- 172.21.15.26:0/1342993417 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e84009550 con 0x7f8e9409e410 2023-10-01T08:01:45.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.959+0000 7f8e99b81700 1 --2- 172.21.15.26:0/1342993417 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e9409e410 0x7f8e941a6b00 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c00efc0 tx=0x7f8e8c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:45.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.959+0000 7f8e89ffb700 1 -- 172.21.15.26:0/1342993417 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c00cc90 con 0x7f8e9409e410 2023-10-01T08:01:45.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.960+0000 7f8e89ffb700 1 -- 172.21.15.26:0/1342993417 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8c00f040 con 0x7f8e9409e410 2023-10-01T08:01:45.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.960+0000 7f8e9b5e4700 1 -- 172.21.15.26:0/1342993417 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e941a8190 con 0x7f8e9409e410 2023-10-01T08:01:45.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.960+0000 7f8e89ffb700 1 -- 172.21.15.26:0/1342993417 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c009e60 con 0x7f8e9409e410 2023-10-01T08:01:45.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.960+0000 7f8e9b5e4700 1 -- 172.21.15.26:0/1342993417 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e940a30d0 con 0x7f8e9409e410 2023-10-01T08:01:45.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.961+0000 7f8e89ffb700 1 -- 172.21.15.26:0/1342993417 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e8c014480 con 0x7f8e9409e410 2023-10-01T08:01:45.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.961+0000 7f8e89ffb700 1 -- 172.21.15.26:0/1342993417 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8e8c040130 con 0x7f8e9409e410 2023-10-01T08:01:45.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.961+0000 7f8e9b5e4700 1 -- 172.21.15.26:0/1342993417 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e940723c0 con 0x7f8e9409e410 2023-10-01T08:01:45.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.966+0000 7f8e89ffb700 1 -- 172.21.15.26:0/1342993417 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e8c007920 con 0x7f8e9409e410 2023-10-01T08:01:45.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.995+0000 7ff0d88fe700 1 Processor -- start 2023-10-01T08:01:45.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.995+0000 7ff0d88fe700 1 -- start start 2023-10-01T08:01:45.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.996+0000 7ff0d88fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0d40a0a30 0x7ff0d40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:45.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.996+0000 7ff0d88fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0d4138d80 0x7ff0d413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:45.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.996+0000 7ff0d88fe700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d40a2a70 con 0x7ff0d409d630 2023-10-01T08:01:45.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.996+0000 7ff0d88fe700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d40a01d0 con 0x7ff0d40a0a30 2023-10-01T08:01:45.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.996+0000 7ff0d88fe700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d409e2b0 con 0x7ff0d4138d80 2023-10-01T08:01:45.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.996+0000 7ff0d1d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff0d409d630 0x7ff0d40a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39528/0 (socket says 172.21.15.26:39528) 2023-10-01T08:01:45.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.996+0000 7ff0d1d9b700 1 -- 172.21.15.26:0/1913637963 learned_addr learned my addr 172.21.15.26:0/1913637963 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:01:45.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.996+0000 7ff0d259c700 1 --2- 172.21.15.26:0/1913637963 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0d40a0a30 0x7ff0d40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:45.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.996+0000 7ff0d2d9d700 1 --2- 172.21.15.26:0/1913637963 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0d4138d80 0x7ff0d413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:45.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.997+0000 7ff0d259c700 1 -- 172.21.15.26:0/1913637963 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0d4138d80 msgr2=0x7ff0d413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:45.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.997+0000 7ff0d259c700 1 --2- 172.21.15.26:0/1913637963 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0d4138d80 0x7ff0d413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:45.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.997+0000 7ff0d259c700 1 -- 172.21.15.26:0/1913637963 >> v1:172.21.15.26:6789/0 conn(0x7ff0d409d630 legacy=0x7ff0d40a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:45.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.997+0000 7ff0d259c700 1 -- 172.21.15.26:0/1913637963 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d409dc50 con 0x7ff0d40a0a30 2023-10-01T08:01:45.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.997+0000 7ff0d259c700 1 --2- 172.21.15.26:0/1913637963 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0d40a0a30 0x7ff0d40a0e00 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4009dc0 tx=0x7ff0c400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6b3d1d2345bd4e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:45.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.997+0000 7ff0d159a700 1 -- 172.21.15.26:0/1913637963 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c400e070 con 0x7ff0d40a0a30 2023-10-01T08:01:45.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.997+0000 7ff0d159a700 1 -- 172.21.15.26:0/1913637963 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c400bbd0 con 0x7ff0d40a0a30 2023-10-01T08:01:45.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.997+0000 7ff0d159a700 1 -- 172.21.15.26:0/1913637963 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c4012430 con 0x7ff0d40a0a30 2023-10-01T08:01:46.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.998+0000 7ff0d88fe700 1 -- 172.21.15.26:0/1913637963 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0d40a0a30 msgr2=0x7ff0d40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:46.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.998+0000 7ff0d88fe700 1 --2- 172.21.15.26:0/1913637963 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0d40a0a30 0x7ff0d40a0e00 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4009dc0 tx=0x7ff0c400b330 comp rx=0 tx=0).stop 2023-10-01T08:01:46.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.998+0000 7ff0d88fe700 1 -- 172.21.15.26:0/1913637963 shutdown_connections 2023-10-01T08:01:46.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.998+0000 7ff0d88fe700 1 --2- 172.21.15.26:0/1913637963 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0d4138d80 0x7ff0d413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:46.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.998+0000 7ff0d88fe700 1 --2- 172.21.15.26:0/1913637963 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0d40a0a30 0x7ff0d40a0e00 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:46.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.998+0000 7ff0d88fe700 1 -- 172.21.15.26:0/1913637963 >> 172.21.15.26:0/1913637963 conn(0x7ff0d40a3050 msgr2=0x7ff0d40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:46.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.998+0000 7ff0d88fe700 1 -- 172.21.15.26:0/1913637963 shutdown_connections 2023-10-01T08:01:46.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.998+0000 7ff0d88fe700 1 -- 172.21.15.26:0/1913637963 wait complete. 2023-10-01T08:01:46.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.999+0000 7ff0d88fe700 1 Processor -- start 2023-10-01T08:01:46.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:45.999+0000 7ff0d88fe700 1 -- start start 2023-10-01T08:01:46.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.000+0000 7ff0d88fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0d409d630 0x7ff0d411d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:46.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.000+0000 7ff0d88fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0d40a0a30 0x7ff0d411da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:46.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.000+0000 7ff0d88fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0d4138d80 0x7ff0d411dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:46.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.000+0000 7ff0d88fe700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d40a4e60 con 0x7ff0d40a0a30 2023-10-01T08:01:46.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.000+0000 7ff0d88fe700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d40a0410 con 0x7ff0d409d630 2023-10-01T08:01:46.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.000+0000 7ff0d88fe700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d4120740 con 0x7ff0d4138d80 2023-10-01T08:01:46.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.000+0000 7ff0d1d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0d40a0a30 0x7ff0d411da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:46.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.000+0000 7ff0d2d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0d4138d80 0x7ff0d411dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:46.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.000+0000 7ff0d2d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0d4138d80 0x7ff0d411dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49468/0 (socket says 172.21.15.26:49468) 2023-10-01T08:01:46.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.000+0000 7ff0d1d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0d40a0a30 0x7ff0d411da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55768/0 (socket says 172.21.15.26:55768) 2023-10-01T08:01:46.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.000+0000 7ff0d2d9d700 1 -- 172.21.15.26:0/202123926 learned_addr learned my addr 172.21.15.26:0/202123926 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:46.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.000+0000 7ff0d259c700 1 --2- 172.21.15.26:0/202123926 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0d409d630 0x7ff0d411d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:46.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.000+0000 7ff0d2d9d700 1 -- 172.21.15.26:0/202123926 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0d409d630 msgr2=0x7ff0d411d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:46.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.000+0000 7ff0d2d9d700 1 --2- 172.21.15.26:0/202123926 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0d409d630 0x7ff0d411d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:46.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.000+0000 7ff0d2d9d700 1 -- 172.21.15.26:0/202123926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0d40a0a30 msgr2=0x7ff0d411da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:46.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.000+0000 7ff0d2d9d700 1 --2- 172.21.15.26:0/202123926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0d40a0a30 0x7ff0d411da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:46.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.000+0000 7ff0d2d9d700 1 -- 172.21.15.26:0/202123926 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c4009a70 con 0x7ff0d4138d80 2023-10-01T08:01:46.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.000+0000 7ff0d259c700 1 --2- 172.21.15.26:0/202123926 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0d409d630 0x7ff0d411d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:46.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.000+0000 7ff0d1d9b700 1 --2- 172.21.15.26:0/202123926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0d40a0a30 0x7ff0d411da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:46.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.001+0000 7ff0d2d9d700 1 --2- 172.21.15.26:0/202123926 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0d4138d80 0x7ff0d411dfa0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc00e7e0 tx=0x7ff0cc00eaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:46.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.001+0000 7ff0c2ffd700 1 -- 172.21.15.26:0/202123926 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc00c070 con 0x7ff0d4138d80 2023-10-01T08:01:46.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.001+0000 7ff0c2ffd700 1 -- 172.21.15.26:0/202123926 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0cc013610 con 0x7ff0d4138d80 2023-10-01T08:01:46.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.001+0000 7ff0d88fe700 1 -- 172.21.15.26:0/202123926 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d4120cd0 con 0x7ff0d4138d80 2023-10-01T08:01:46.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.001+0000 7ff0c2ffd700 1 -- 172.21.15.26:0/202123926 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc0139c0 con 0x7ff0d4138d80 2023-10-01T08:01:46.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.001+0000 7ff0d88fe700 1 -- 172.21.15.26:0/202123926 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d4121740 con 0x7ff0d4138d80 2023-10-01T08:01:46.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.002+0000 7ff0c2ffd700 1 -- 172.21.15.26:0/202123926 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff0cc013b20 con 0x7ff0d4138d80 2023-10-01T08:01:46.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.002+0000 7ff0c2ffd700 1 -- 172.21.15.26:0/202123926 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff0cc03f420 con 0x7ff0d4138d80 2023-10-01T08:01:46.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.002+0000 7ff0d88fe700 1 -- 172.21.15.26:0/202123926 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d40747f0 con 0x7ff0d4138d80 2023-10-01T08:01:46.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.007+0000 7ff0c2ffd700 1 -- 172.21.15.26:0/202123926 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff0cc017070 con 0x7ff0d4138d80 2023-10-01T08:01:46.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.103+0000 7f2d87b7f700 1 -- 172.21.15.26:0/511452497 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2d8009f420 con 0x7f2d8009e440 2023-10-01T08:01:46.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.104+0000 7f2d767fc700 1 -- 172.21.15.26:0/511452497 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d78007370 con 0x7f2d8009e440 2023-10-01T08:01:46.105 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:46.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.106+0000 7f2d87b7f700 1 -- 172.21.15.26:0/511452497 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d8009e440 msgr2=0x7f2d801c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:46.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.106+0000 7f2d87b7f700 1 --2- 172.21.15.26:0/511452497 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d8009e440 0x7f2d801c8090 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f2d7800b9a0 tx=0x7f2d7800bd60 comp rx=0 tx=0).stop 2023-10-01T08:01:46.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.106+0000 7f2d87b7f700 1 -- 172.21.15.26:0/511452497 shutdown_connections 2023-10-01T08:01:46.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.106+0000 7f2d87b7f700 1 --2- 172.21.15.26:0/511452497 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2d8009e440 0x7f2d801c8090 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:46.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.106+0000 7f2d87b7f700 1 --2- 172.21.15.26:0/511452497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d8009d6f0 0x7f2d801a5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:46.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.106+0000 7f2d87b7f700 1 --2- 172.21.15.26:0/511452497 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2d8009e000 0x7f2d801a5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:46.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.106+0000 7f2d87b7f700 1 -- 172.21.15.26:0/511452497 >> 172.21.15.26:0/511452497 conn(0x7f2d80066f50 msgr2=0x7f2d801bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:46.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.106+0000 7f2d87b7f700 1 -- 172.21.15.26:0/511452497 shutdown_connections 2023-10-01T08:01:46.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.106+0000 7f2d87b7f700 1 -- 172.21.15.26:0/511452497 wait complete. 2023-10-01T08:01:46.121 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:46.146 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:46.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.182+0000 7f8e9b5e4700 1 -- 172.21.15.26:0/1342993417 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8e9409c710 con 0x7f8e9409e410 2023-10-01T08:01:46.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.183+0000 7f8e89ffb700 1 -- 172.21.15.26:0/1342993417 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8e8c02c090 con 0x7f8e9409e410 2023-10-01T08:01:46.183 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:46.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.185+0000 7f8e9b5e4700 1 -- 172.21.15.26:0/1342993417 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e9409e410 msgr2=0x7f8e941a6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:46.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.185+0000 7f8e9b5e4700 1 --2- 172.21.15.26:0/1342993417 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e9409e410 0x7f8e941a6b00 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c00efc0 tx=0x7f8e8c00c3a0 comp rx=0 tx=0).stop 2023-10-01T08:01:46.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.185+0000 7f8e9b5e4700 1 -- 172.21.15.26:0/1342993417 shutdown_connections 2023-10-01T08:01:46.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.185+0000 7f8e9b5e4700 1 --2- 172.21.15.26:0/1342993417 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f8e9409e410 0x7f8e941a6b00 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:46.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.185+0000 7f8e9b5e4700 1 --2- 172.21.15.26:0/1342993417 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e9409d6f0 0x7f8e941a6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:46.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.185+0000 7f8e9b5e4700 1 --2- 172.21.15.26:0/1342993417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e9409e000 0x7f8e941a65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:46.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.185+0000 7f8e9b5e4700 1 -- 172.21.15.26:0/1342993417 >> 172.21.15.26:0/1342993417 conn(0x7f8e94066f50 msgr2=0x7f8e940a3620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:46.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.185+0000 7f8e9b5e4700 1 -- 172.21.15.26:0/1342993417 shutdown_connections 2023-10-01T08:01:46.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.186+0000 7f8e9b5e4700 1 -- 172.21.15.26:0/1342993417 wait complete. 2023-10-01T08:01:46.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:46.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.216+0000 7ff0d88fe700 1 -- 172.21.15.26:0/202123926 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff0d41202f0 con 0x7ff0d4138d80 2023-10-01T08:01:46.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.217+0000 7ff0c2ffd700 1 -- 172.21.15.26:0/202123926 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff0cc0236c0 con 0x7ff0d4138d80 2023-10-01T08:01:46.217 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:46.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.219+0000 7ff0d88fe700 1 -- 172.21.15.26:0/202123926 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0d4138d80 msgr2=0x7ff0d411dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:46.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.219+0000 7ff0d88fe700 1 --2- 172.21.15.26:0/202123926 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0d4138d80 0x7ff0d411dfa0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc00e7e0 tx=0x7ff0cc00eaf0 comp rx=0 tx=0).stop 2023-10-01T08:01:46.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.219+0000 7ff0d88fe700 1 -- 172.21.15.26:0/202123926 shutdown_connections 2023-10-01T08:01:46.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.219+0000 7ff0d88fe700 1 --2- 172.21.15.26:0/202123926 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff0d4138d80 0x7ff0d411dfa0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:46.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.219+0000 7ff0d88fe700 1 --2- 172.21.15.26:0/202123926 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0d409d630 0x7ff0d411d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:46.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.219+0000 7ff0d88fe700 1 --2- 172.21.15.26:0/202123926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0d40a0a30 0x7ff0d411da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:46.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.219+0000 7ff0d88fe700 1 -- 172.21.15.26:0/202123926 >> 172.21.15.26:0/202123926 conn(0x7ff0d40a3050 msgr2=0x7ff0d409ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:46.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.219+0000 7ff0d88fe700 1 -- 172.21.15.26:0/202123926 shutdown_connections 2023-10-01T08:01:46.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.219+0000 7ff0d88fe700 1 -- 172.21.15.26:0/202123926 wait complete. 2023-10-01T08:01:46.234 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:46.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.302+0000 7f52174d9700 1 Processor -- start 2023-10-01T08:01:46.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.302+0000 7f52174d9700 1 -- start start 2023-10-01T08:01:46.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.303+0000 7f52174d9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f52100a0a30 0x7f52100a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:46.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.303+0000 7f52174d9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f521009d630 0x7f52100a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:46.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.303+0000 7f52174d9700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52100a2a70 con 0x7f5210133930 2023-10-01T08:01:46.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.303+0000 7f52174d9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52100a01d0 con 0x7f521009d630 2023-10-01T08:01:46.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.303+0000 7f52174d9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f521009e2b0 con 0x7f52100a0a30 2023-10-01T08:01:46.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.303+0000 7f5215275700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f52100a0a30 0x7f52100a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:46.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.303+0000 7f5214a74700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f521009d630 0x7f52100a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:46.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.303+0000 7f5215275700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f52100a0a30 0x7f52100a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49484/0 (socket says 172.21.15.26:49484) 2023-10-01T08:01:46.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.303+0000 7f5214a74700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f521009d630 0x7f52100a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35498/0 (socket says 172.21.15.26:35498) 2023-10-01T08:01:46.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.303+0000 7f5215275700 1 -- 172.21.15.26:0/1282414560 learned_addr learned my addr 172.21.15.26:0/1282414560 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:46.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.303+0000 7f5215275700 1 -- 172.21.15.26:0/1282414560 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f521009d630 msgr2=0x7f52100a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:46.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.303+0000 7f5215275700 1 --2- 172.21.15.26:0/1282414560 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f521009d630 0x7f52100a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:46.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.303+0000 7f5207fff700 1 -- 172.21.15.26:0/1282414560 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1140456666 0 0) 0x7f52100a2a70 con 0x7f5210133930 2023-10-01T08:01:46.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.303+0000 7f5215275700 1 -- 172.21.15.26:0/1282414560 >> v1:172.21.15.26:6789/0 conn(0x7f5210133930 legacy=0x7f5210133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:46.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.303+0000 7f5215275700 1 -- 172.21.15.26:0/1282414560 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521009dc50 con 0x7f52100a0a30 2023-10-01T08:01:46.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.303+0000 7f5215275700 1 --2- 172.21.15.26:0/1282414560 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f52100a0a30 0x7f52100a0e00 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f520c009920 tx=0x7f520c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e24c075a51c7518 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:46.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.304+0000 7f5207fff700 1 -- 172.21.15.26:0/1282414560 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c011830 con 0x7f52100a0a30 2023-10-01T08:01:46.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.304+0000 7f5207fff700 1 -- 172.21.15.26:0/1282414560 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520c011990 con 0x7f52100a0a30 2023-10-01T08:01:46.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.304+0000 7f5207fff700 1 -- 172.21.15.26:0/1282414560 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c011d20 con 0x7f52100a0a30 2023-10-01T08:01:46.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.304+0000 7f52174d9700 1 -- 172.21.15.26:0/1282414560 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f52100a0a30 msgr2=0x7f52100a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:46.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.304+0000 7f52174d9700 1 --2- 172.21.15.26:0/1282414560 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f52100a0a30 0x7f52100a0e00 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f520c009920 tx=0x7f520c009c30 comp rx=0 tx=0).stop 2023-10-01T08:01:46.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.304+0000 7f52174d9700 1 -- 172.21.15.26:0/1282414560 shutdown_connections 2023-10-01T08:01:46.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.304+0000 7f52174d9700 1 --2- 172.21.15.26:0/1282414560 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f52100a0a30 0x7f52100a0e00 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:46.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.304+0000 7f52174d9700 1 --2- 172.21.15.26:0/1282414560 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f521009d630 0x7f52100a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:46.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.304+0000 7f52174d9700 1 -- 172.21.15.26:0/1282414560 >> 172.21.15.26:0/1282414560 conn(0x7f52100a3050 msgr2=0x7f52100a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:46.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.304+0000 7f52174d9700 1 -- 172.21.15.26:0/1282414560 shutdown_connections 2023-10-01T08:01:46.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.304+0000 7f52174d9700 1 -- 172.21.15.26:0/1282414560 wait complete. 2023-10-01T08:01:46.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.305+0000 7f52174d9700 1 Processor -- start 2023-10-01T08:01:46.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.305+0000 7f52174d9700 1 -- start start 2023-10-01T08:01:46.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.306+0000 7f52174d9700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f521009d630 0x7f521011f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:46.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.306+0000 7f52174d9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52100a0a30 0x7f521011fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:46.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.306+0000 7f52174d9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5210133930 0x7f52101c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:46.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.306+0000 7f52174d9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5210122680 con 0x7f52100a0a30 2023-10-01T08:01:46.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.306+0000 7f52174d9700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52101334f0 con 0x7f521009d630 2023-10-01T08:01:46.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.306+0000 7f52174d9700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52100a0410 con 0x7f5210133930 2023-10-01T08:01:46.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.306+0000 7f5215275700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f521009d630 0x7f521011f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:46.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.306+0000 7f5214a74700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52100a0a30 0x7f521011fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:46.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.306+0000 7f5215a76700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5210133930 0x7f52101c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:46.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.306+0000 7f5215275700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f521009d630 0x7f521011f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35502/0 (socket says 172.21.15.26:35502) 2023-10-01T08:01:46.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.306+0000 7f5215275700 1 -- 172.21.15.26:0/612443281 learned_addr learned my addr 172.21.15.26:0/612443281 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:46.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.306+0000 7f5215275700 1 -- 172.21.15.26:0/612443281 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5210133930 msgr2=0x7f52101c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:46.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.306+0000 7f5215275700 1 --2- 172.21.15.26:0/612443281 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5210133930 0x7f52101c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:46.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.306+0000 7f5215275700 1 -- 172.21.15.26:0/612443281 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52100a0a30 msgr2=0x7f521011fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:46.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.306+0000 7f5215275700 1 --2- 172.21.15.26:0/612443281 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52100a0a30 0x7f521011fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:46.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.306+0000 7f5215275700 1 -- 172.21.15.26:0/612443281 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520c009550 con 0x7f521009d630 2023-10-01T08:01:46.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.306+0000 7f5215275700 1 --2- 172.21.15.26:0/612443281 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f521009d630 0x7f521011f580 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f521009e3f0 tx=0x7f520c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:46.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.307+0000 7f5205ffb700 1 -- 172.21.15.26:0/612443281 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c004450 con 0x7f521009d630 2023-10-01T08:01:46.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.307+0000 7f5205ffb700 1 -- 172.21.15.26:0/612443281 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520c0045b0 con 0x7f521009d630 2023-10-01T08:01:46.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.307+0000 7f52174d9700 1 -- 172.21.15.26:0/612443281 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5210120000 con 0x7f521009d630 2023-10-01T08:01:46.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.307+0000 7f5205ffb700 1 -- 172.21.15.26:0/612443281 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c0038c0 con 0x7f521009d630 2023-10-01T08:01:46.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.307+0000 7f52174d9700 1 -- 172.21.15.26:0/612443281 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5210121660 con 0x7f521009d630 2023-10-01T08:01:46.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.308+0000 7f52174d9700 1 -- 172.21.15.26:0/612443281 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52100747f0 con 0x7f521009d630 2023-10-01T08:01:46.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.308+0000 7f5205ffb700 1 -- 172.21.15.26:0/612443281 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f520c003a20 con 0x7f521009d630 2023-10-01T08:01:46.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.308+0000 7f5205ffb700 1 -- 172.21.15.26:0/612443281 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f520c021030 con 0x7f521009d630 2023-10-01T08:01:46.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.313+0000 7f5205ffb700 1 -- 172.21.15.26:0/612443281 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f520c030480 con 0x7f521009d630 2023-10-01T08:01:46.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.517+0000 7f52174d9700 1 -- 172.21.15.26:0/612443281 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5210120770 con 0x7f521009d630 2023-10-01T08:01:46.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.518+0000 7f5205ffb700 1 -- 172.21.15.26:0/612443281 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f520c02b070 con 0x7f521009d630 2023-10-01T08:01:46.519 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:46.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.520+0000 7f52174d9700 1 -- 172.21.15.26:0/612443281 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f521009d630 msgr2=0x7f521011f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:46.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.520+0000 7f52174d9700 1 --2- 172.21.15.26:0/612443281 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f521009d630 0x7f521011f580 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f521009e3f0 tx=0x7f520c004750 comp rx=0 tx=0).stop 2023-10-01T08:01:46.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.520+0000 7f52174d9700 1 -- 172.21.15.26:0/612443281 shutdown_connections 2023-10-01T08:01:46.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.520+0000 7f52174d9700 1 --2- 172.21.15.26:0/612443281 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5210133930 0x7f52101c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:46.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.520+0000 7f52174d9700 1 --2- 172.21.15.26:0/612443281 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f521009d630 0x7f521011f580 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:46.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.520+0000 7f52174d9700 1 --2- 172.21.15.26:0/612443281 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52100a0a30 0x7f521011fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:46.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.520+0000 7f52174d9700 1 -- 172.21.15.26:0/612443281 >> 172.21.15.26:0/612443281 conn(0x7f52100a3050 msgr2=0x7f521009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:46.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.520+0000 7f52174d9700 1 -- 172.21.15.26:0/612443281 shutdown_connections 2023-10-01T08:01:46.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:46.520+0000 7f52174d9700 1 -- 172.21.15.26:0/612443281 wait complete. 2023-10-01T08:01:46.535 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:47.122 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:47.202 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:47.235 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:47.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.270+0000 7f25e8b4b700 1 Processor -- start 2023-10-01T08:01:47.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.270+0000 7f25e8b4b700 1 -- start start 2023-10-01T08:01:47.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.271+0000 7f25e8b4b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25e409d6f0 0x7f25e409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:47.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.271+0000 7f25e8b4b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f25e409e410 0x7f25e4134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:47.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.271+0000 7f25e8b4b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e409b120 con 0x7f25e409e000 2023-10-01T08:01:47.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.271+0000 7f25e8b4b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e406b460 con 0x7f25e409e410 2023-10-01T08:01:47.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.271+0000 7f25e8b4b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e409a7e0 con 0x7f25e409d6f0 2023-10-01T08:01:47.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.271+0000 7f25e259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25e409d6f0 0x7f25e409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:47.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.271+0000 7f25e259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25e409d6f0 0x7f25e409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35504/0 (socket says 172.21.15.26:35504) 2023-10-01T08:01:47.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.271+0000 7f25e2d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f25e409e410 0x7f25e4134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:47.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.271+0000 7f25e259c700 1 -- 172.21.15.26:0/2385873262 learned_addr learned my addr 172.21.15.26:0/2385873262 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:47.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.271+0000 7f25e259c700 1 -- 172.21.15.26:0/2385873262 >> v2:172.21.15.26:3300/0 conn(0x7f25e409e410 msgr2=0x7f25e4134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:47.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.271+0000 7f25e259c700 1 --2- 172.21.15.26:0/2385873262 >> v2:172.21.15.26:3300/0 conn(0x7f25e409e410 0x7f25e4134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.271+0000 7f25e259c700 1 -- 172.21.15.26:0/2385873262 >> v1:172.21.15.26:6789/0 conn(0x7f25e409e000 legacy=0x7f25e41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:47.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.271+0000 7f25e259c700 1 -- 172.21.15.26:0/2385873262 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e409a500 con 0x7f25e409d6f0 2023-10-01T08:01:47.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.271+0000 7f25e2d9d700 1 --2- 172.21.15.26:0/2385873262 >> v2:172.21.15.26:3300/0 conn(0x7f25e409e410 0x7f25e4134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:47.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.271+0000 7f25e259c700 1 --2- 172.21.15.26:0/2385873262 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25e409d6f0 0x7f25e409dac0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f25d4009920 tx=0x7f25d4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1e4eb3e108f7d96 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:47.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.272+0000 7f25e159a700 1 -- 172.21.15.26:0/2385873262 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d4011830 con 0x7f25e409d6f0 2023-10-01T08:01:47.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.272+0000 7f25e159a700 1 -- 172.21.15.26:0/2385873262 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d4011990 con 0x7f25e409d6f0 2023-10-01T08:01:47.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.272+0000 7f25e159a700 1 -- 172.21.15.26:0/2385873262 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d4011d20 con 0x7f25e409d6f0 2023-10-01T08:01:47.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.272+0000 7f25e8b4b700 1 -- 172.21.15.26:0/2385873262 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25e409d6f0 msgr2=0x7f25e409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:47.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.272+0000 7f25e8b4b700 1 --2- 172.21.15.26:0/2385873262 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25e409d6f0 0x7f25e409dac0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f25d4009920 tx=0x7f25d4009c30 comp rx=0 tx=0).stop 2023-10-01T08:01:47.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.272+0000 7f25e8b4b700 1 -- 172.21.15.26:0/2385873262 shutdown_connections 2023-10-01T08:01:47.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.272+0000 7f25e8b4b700 1 --2- 172.21.15.26:0/2385873262 >> v2:172.21.15.26:3300/0 conn(0x7f25e409e410 0x7f25e4134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.272+0000 7f25e8b4b700 1 --2- 172.21.15.26:0/2385873262 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25e409d6f0 0x7f25e409dac0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.272+0000 7f25e8b4b700 1 -- 172.21.15.26:0/2385873262 >> 172.21.15.26:0/2385873262 conn(0x7f25e4066f50 msgr2=0x7f25e409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:47.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.273+0000 7f25e8b4b700 1 -- 172.21.15.26:0/2385873262 shutdown_connections 2023-10-01T08:01:47.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.273+0000 7f25e8b4b700 1 -- 172.21.15.26:0/2385873262 wait complete. 2023-10-01T08:01:47.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.274+0000 7f25e8b4b700 1 Processor -- start 2023-10-01T08:01:47.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.274+0000 7f25e8b4b700 1 -- start start 2023-10-01T08:01:47.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.275+0000 7f25e8b4b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25e409d6f0 0x7f25e41a4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:47.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.275+0000 7f25e8b4b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25e409e000 0x7f25e41a5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:47.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.275+0000 7f25e8b4b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25e409e410 0x7f25e41a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:47.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.275+0000 7f25e8b4b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e40a3480 con 0x7f25e409d6f0 2023-10-01T08:01:47.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.275+0000 7f25e8b4b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e41a6b90 con 0x7f25e409e410 2023-10-01T08:01:47.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.275+0000 7f25e8b4b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25e41a7d40 con 0x7f25e409e000 2023-10-01T08:01:47.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.275+0000 7f25e259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25e409d6f0 0x7f25e41a4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:47.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.275+0000 7f25e2d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25e409e410 0x7f25e41a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:47.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.275+0000 7f25e1d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25e409e000 0x7f25e41a5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:47.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.275+0000 7f25e1d9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25e409e000 0x7f25e41a5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49504/0 (socket says 172.21.15.26:49504) 2023-10-01T08:01:47.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.275+0000 7f25e259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25e409d6f0 0x7f25e41a4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55812/0 (socket says 172.21.15.26:55812) 2023-10-01T08:01:47.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.275+0000 7f25e2d9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25e409e410 0x7f25e41a5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35516/0 (socket says 172.21.15.26:35516) 2023-10-01T08:01:47.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.275+0000 7f25e1d9b700 1 -- 172.21.15.26:0/3303616651 learned_addr learned my addr 172.21.15.26:0/3303616651 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:47.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.275+0000 7f25e2d9d700 1 -- 172.21.15.26:0/3303616651 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25e409e000 msgr2=0x7f25e41a5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:47.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.275+0000 7f25e2d9d700 1 --2- 172.21.15.26:0/3303616651 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25e409e000 0x7f25e41a5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.275+0000 7f25e2d9d700 1 -- 172.21.15.26:0/3303616651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25e409d6f0 msgr2=0x7f25e41a4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:47.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.275+0000 7f25e2d9d700 1 --2- 172.21.15.26:0/3303616651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25e409d6f0 0x7f25e41a4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.275+0000 7f25e2d9d700 1 -- 172.21.15.26:0/3303616651 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25dc009a70 con 0x7f25e409e410 2023-10-01T08:01:47.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.275+0000 7f25e1d9b700 1 --2- 172.21.15.26:0/3303616651 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25e409e000 0x7f25e41a5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:47.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.275+0000 7f25e259c700 1 --2- 172.21.15.26:0/3303616651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25e409d6f0 0x7f25e41a4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:47.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.276+0000 7f25e2d9d700 1 --2- 172.21.15.26:0/3303616651 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25e409e410 0x7f25e41a5980 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f25dc00efc0 tx=0x7f25dc00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:47.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.276+0000 7f25d2ffd700 1 -- 172.21.15.26:0/3303616651 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc00ca90 con 0x7f25e409e410 2023-10-01T08:01:47.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.276+0000 7f25d2ffd700 1 -- 172.21.15.26:0/3303616651 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25dc00f040 con 0x7f25e409e410 2023-10-01T08:01:47.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.276+0000 7f25e8b4b700 1 -- 172.21.15.26:0/3303616651 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d4009550 con 0x7f25e409e410 2023-10-01T08:01:47.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.276+0000 7f25d2ffd700 1 -- 172.21.15.26:0/3303616651 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc00ce30 con 0x7f25e409e410 2023-10-01T08:01:47.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.276+0000 7f25e8b4b700 1 -- 172.21.15.26:0/3303616651 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e409c760 con 0x7f25e409e410 2023-10-01T08:01:47.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.277+0000 7f25d2ffd700 1 -- 172.21.15.26:0/3303616651 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f25dc014480 con 0x7f25e409e410 2023-10-01T08:01:47.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.277+0000 7f25e8b4b700 1 -- 172.21.15.26:0/3303616651 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25e41a82d0 con 0x7f25e409e410 2023-10-01T08:01:47.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.277+0000 7f25d2ffd700 1 -- 172.21.15.26:0/3303616651 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f25dc03fc80 con 0x7f25e409e410 2023-10-01T08:01:47.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.282+0000 7f25d2ffd700 1 -- 172.21.15.26:0/3303616651 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25dc045020 con 0x7f25e409e410 2023-10-01T08:01:47.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.346+0000 7f7050336700 1 Processor -- start 2023-10-01T08:01:47.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.346+0000 7f7050336700 1 -- start start 2023-10-01T08:01:47.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.347+0000 7f7050336700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f704809d6f0 0x7f704809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:47.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.347+0000 7f7050336700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f704809e000 0x7f7048130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:47.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.347+0000 7f7050336700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f704809f130 con 0x7f704809e410 2023-10-01T08:01:47.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.347+0000 7f7050336700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f704809f520 con 0x7f704809e000 2023-10-01T08:01:47.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.347+0000 7f7050336700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f704809e930 con 0x7f704809d6f0 2023-10-01T08:01:47.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.347+0000 7f704e0d2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f704809d6f0 0x7f704809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:47.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.347+0000 7f704d8d1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f704809e000 0x7f7048130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:47.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.347+0000 7f704d8d1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f704809e000 0x7f7048130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55820/0 (socket says 172.21.15.26:55820) 2023-10-01T08:01:47.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.347+0000 7f704e0d2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f704809d6f0 0x7f704809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49514/0 (socket says 172.21.15.26:49514) 2023-10-01T08:01:47.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.347+0000 7f704d8d1700 1 -- 172.21.15.26:0/1496224259 learned_addr learned my addr 172.21.15.26:0/1496224259 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:47.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.348+0000 7f704e0d2700 1 -- 172.21.15.26:0/1496224259 >> v2:172.21.15.26:3300/0 conn(0x7f704809e000 msgr2=0x7f7048130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:47.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.348+0000 7f704e0d2700 1 --2- 172.21.15.26:0/1496224259 >> v2:172.21.15.26:3300/0 conn(0x7f704809e000 0x7f7048130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.348+0000 7f704e0d2700 1 -- 172.21.15.26:0/1496224259 >> v1:172.21.15.26:6789/0 conn(0x7f704809e410 legacy=0x7f7048130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:47.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.348+0000 7f704e0d2700 1 -- 172.21.15.26:0/1496224259 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f704809b2d0 con 0x7f704809d6f0 2023-10-01T08:01:47.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.348+0000 7f704d8d1700 1 --2- 172.21.15.26:0/1496224259 >> v2:172.21.15.26:3300/0 conn(0x7f704809e000 0x7f7048130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:47.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.348+0000 7f704e0d2700 1 --2- 172.21.15.26:0/1496224259 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f704809d6f0 0x7f704809dac0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f7044009840 tx=0x7f7044009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=656078a42ba07ba3 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:47.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.348+0000 7f704d0d0700 1 -- 172.21.15.26:0/1496224259 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7044011830 con 0x7f704809d6f0 2023-10-01T08:01:47.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.348+0000 7f704d0d0700 1 -- 172.21.15.26:0/1496224259 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7044011990 con 0x7f704809d6f0 2023-10-01T08:01:47.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.348+0000 7f704d0d0700 1 -- 172.21.15.26:0/1496224259 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7044011d20 con 0x7f704809d6f0 2023-10-01T08:01:47.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.349+0000 7f7050336700 1 -- 172.21.15.26:0/1496224259 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f704809d6f0 msgr2=0x7f704809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:47.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.349+0000 7f7050336700 1 --2- 172.21.15.26:0/1496224259 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f704809d6f0 0x7f704809dac0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f7044009840 tx=0x7f7044009b50 comp rx=0 tx=0).stop 2023-10-01T08:01:47.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.349+0000 7f7050336700 1 -- 172.21.15.26:0/1496224259 shutdown_connections 2023-10-01T08:01:47.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.349+0000 7f7050336700 1 --2- 172.21.15.26:0/1496224259 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f704809d6f0 0x7f704809dac0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.349+0000 7f7050336700 1 --2- 172.21.15.26:0/1496224259 >> v2:172.21.15.26:3300/0 conn(0x7f704809e000 0x7f7048130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.349+0000 7f7050336700 1 -- 172.21.15.26:0/1496224259 >> 172.21.15.26:0/1496224259 conn(0x7f7048066f50 msgr2=0x7f704809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:47.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.349+0000 7f7050336700 1 -- 172.21.15.26:0/1496224259 shutdown_connections 2023-10-01T08:01:47.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.349+0000 7f7050336700 1 -- 172.21.15.26:0/1496224259 wait complete. 2023-10-01T08:01:47.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.350+0000 7f7050336700 1 Processor -- start 2023-10-01T08:01:47.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.350+0000 7f7050336700 1 -- start start 2023-10-01T08:01:47.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.351+0000 7f7050336700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f704809d6f0 0x7f704812e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:47.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.351+0000 7f7050336700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f704809e000 0x7f704812e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:47.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.351+0000 7f7050336700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f704809e410 0x7f704812eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:47.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.351+0000 7f7050336700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7048130810 con 0x7f704809e000 2023-10-01T08:01:47.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.351+0000 7f7050336700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704812f990 con 0x7f704809d6f0 2023-10-01T08:01:47.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.351+0000 7f7050336700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70481321b0 con 0x7f704809e410 2023-10-01T08:01:47.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.351+0000 7f704e8d3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f704809e410 0x7f704812eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:47.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.351+0000 7f704e8d3700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f704809e410 0x7f704812eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49518/0 (socket says 172.21.15.26:49518) 2023-10-01T08:01:47.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.351+0000 7f704e8d3700 1 -- 172.21.15.26:0/2213849228 learned_addr learned my addr 172.21.15.26:0/2213849228 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:47.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.351+0000 7f704d8d1700 1 --2- 172.21.15.26:0/2213849228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f704809e000 0x7f704812e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:47.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.351+0000 7f704e8d3700 1 -- 172.21.15.26:0/2213849228 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f704809d6f0 msgr2=0x7f704812e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:47.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.351+0000 7f704e8d3700 1 --2- 172.21.15.26:0/2213849228 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f704809d6f0 0x7f704812e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.351+0000 7f704e8d3700 1 -- 172.21.15.26:0/2213849228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f704809e000 msgr2=0x7f704812e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:47.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.351+0000 7f704e8d3700 1 --2- 172.21.15.26:0/2213849228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f704809e000 0x7f704812e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.351+0000 7f704e8d3700 1 -- 172.21.15.26:0/2213849228 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7038009550 con 0x7f704809e410 2023-10-01T08:01:47.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.351+0000 7f704e8d3700 1 --2- 172.21.15.26:0/2213849228 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f704809e410 0x7f704812eb70 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f704000cbf0 tx=0x7f704000cf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:47.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.351+0000 7f703effd700 1 -- 172.21.15.26:0/2213849228 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7040003c00 con 0x7f704809e410 2023-10-01T08:01:47.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.352+0000 7f703effd700 1 -- 172.21.15.26:0/2213849228 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7040003d60 con 0x7f704809e410 2023-10-01T08:01:47.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.352+0000 7f7050336700 1 -- 172.21.15.26:0/2213849228 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70440094a0 con 0x7f704809e410 2023-10-01T08:01:47.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.352+0000 7f703effd700 1 -- 172.21.15.26:0/2213849228 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704000ab50 con 0x7f704809e410 2023-10-01T08:01:47.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.352+0000 7f7050336700 1 -- 172.21.15.26:0/2213849228 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f704809c760 con 0x7f704809e410 2023-10-01T08:01:47.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.352+0000 7f703effd700 1 -- 172.21.15.26:0/2213849228 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f704000acb0 con 0x7f704809e410 2023-10-01T08:01:47.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.353+0000 7f703effd700 1 -- 172.21.15.26:0/2213849228 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f704003f6b0 con 0x7f704809e410 2023-10-01T08:01:47.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.353+0000 7f7050336700 1 -- 172.21.15.26:0/2213849228 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7048074ea0 con 0x7f704809e410 2023-10-01T08:01:47.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.358+0000 7f703effd700 1 -- 172.21.15.26:0/2213849228 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f70400198f0 con 0x7f704809e410 2023-10-01T08:01:47.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.392+0000 7f3eea2c5700 1 Processor -- start 2023-10-01T08:01:47.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.392+0000 7f3eea2c5700 1 -- start start 2023-10-01T08:01:47.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.393+0000 7f3eea2c5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3ee409d6f0 0x7f3ee409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:47.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.393+0000 7f3eea2c5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ee409e000 0x7f3ee4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:47.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.393+0000 7f3eea2c5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ee409e410 0x7f3ee4130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:47.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.393+0000 7f3eea2c5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ee409f520 con 0x7f3ee409d6f0 2023-10-01T08:01:47.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.393+0000 7f3eea2c5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee409f130 con 0x7f3ee409e410 2023-10-01T08:01:47.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.393+0000 7f3eea2c5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee409e930 con 0x7f3ee409e000 2023-10-01T08:01:47.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.393+0000 7f3ee8862700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ee409e410 0x7f3ee4130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:47.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.393+0000 7f3ee3fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3ee409d6f0 0x7f3ee409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:47.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.393+0000 7f3ee8862700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ee409e410 0x7f3ee4130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35538/0 (socket says 172.21.15.26:35538) 2023-10-01T08:01:47.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.393+0000 7f3ee3fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3ee409d6f0 0x7f3ee409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55842/0 (socket says 172.21.15.26:55842) 2023-10-01T08:01:47.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.393+0000 7f3ee8862700 1 -- 172.21.15.26:0/1018641405 learned_addr learned my addr 172.21.15.26:0/1018641405 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:47.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.393+0000 7f3ee37fe700 1 --2- 172.21.15.26:0/1018641405 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ee409e000 0x7f3ee4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:47.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.393+0000 7f3ee8862700 1 -- 172.21.15.26:0/1018641405 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ee409e000 msgr2=0x7f3ee4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:47.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.393+0000 7f3ee8862700 1 --2- 172.21.15.26:0/1018641405 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ee409e000 0x7f3ee4130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.393+0000 7f3ee8862700 1 -- 172.21.15.26:0/1018641405 >> v2:172.21.15.26:3300/0 conn(0x7f3ee409d6f0 msgr2=0x7f3ee409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:47.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.393+0000 7f3ee8862700 1 --2- 172.21.15.26:0/1018641405 >> v2:172.21.15.26:3300/0 conn(0x7f3ee409d6f0 0x7f3ee409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.393+0000 7f3ee8862700 1 -- 172.21.15.26:0/1018641405 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee409b2d0 con 0x7f3ee409e410 2023-10-01T08:01:47.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.393+0000 7f3ee3fff700 1 --2- 172.21.15.26:0/1018641405 >> v2:172.21.15.26:3300/0 conn(0x7f3ee409d6f0 0x7f3ee409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:47.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.393+0000 7f3ee37fe700 1 --2- 172.21.15.26:0/1018641405 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ee409e000 0x7f3ee4130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:47.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.394+0000 7f3ee8862700 1 --2- 172.21.15.26:0/1018641405 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ee409e410 0x7f3ee4130ba0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f3edc009e50 tx=0x7f3edc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33b82c8db20a4366 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:47.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.394+0000 7f3ee2ffd700 1 -- 172.21.15.26:0/1018641405 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc00e070 con 0x7f3ee409e410 2023-10-01T08:01:47.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.394+0000 7f3ee2ffd700 1 -- 172.21.15.26:0/1018641405 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3edc00b910 con 0x7f3ee409e410 2023-10-01T08:01:47.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.394+0000 7f3ee2ffd700 1 -- 172.21.15.26:0/1018641405 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc00bcc0 con 0x7f3ee409e410 2023-10-01T08:01:47.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.395+0000 7f3eea2c5700 1 -- 172.21.15.26:0/1018641405 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ee409e410 msgr2=0x7f3ee4130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:47.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.395+0000 7f3eea2c5700 1 --2- 172.21.15.26:0/1018641405 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ee409e410 0x7f3ee4130ba0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f3edc009e50 tx=0x7f3edc00b330 comp rx=0 tx=0).stop 2023-10-01T08:01:47.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.395+0000 7f3eea2c5700 1 -- 172.21.15.26:0/1018641405 shutdown_connections 2023-10-01T08:01:47.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.395+0000 7f3eea2c5700 1 --2- 172.21.15.26:0/1018641405 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ee409e410 0x7f3ee4130ba0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.395+0000 7f3eea2c5700 1 --2- 172.21.15.26:0/1018641405 >> v2:172.21.15.26:3300/0 conn(0x7f3ee409d6f0 0x7f3ee409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.395+0000 7f3eea2c5700 1 --2- 172.21.15.26:0/1018641405 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ee409e000 0x7f3ee4130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.395+0000 7f3eea2c5700 1 -- 172.21.15.26:0/1018641405 >> 172.21.15.26:0/1018641405 conn(0x7f3ee4066f50 msgr2=0x7f3ee409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:47.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.395+0000 7f3eea2c5700 1 -- 172.21.15.26:0/1018641405 shutdown_connections 2023-10-01T08:01:47.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.395+0000 7f3eea2c5700 1 -- 172.21.15.26:0/1018641405 wait complete. 2023-10-01T08:01:47.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.396+0000 7f3eea2c5700 1 Processor -- start 2023-10-01T08:01:47.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.396+0000 7f3eea2c5700 1 -- start start 2023-10-01T08:01:47.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.397+0000 7f3eea2c5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ee409d6f0 0x7f3ee4137170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:47.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.397+0000 7f3eea2c5700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ee409e000 0x7f3ee41376b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:47.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.397+0000 7f3eea2c5700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ee409e410 0x7f3ee41c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:47.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.397+0000 7f3eea2c5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee4072320 con 0x7f3ee409d6f0 2023-10-01T08:01:47.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.397+0000 7f3eea2c5700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee4119c70 con 0x7f3ee409e410 2023-10-01T08:01:47.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.397+0000 7f3eea2c5700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee4119630 con 0x7f3ee409e000 2023-10-01T08:01:47.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.397+0000 7f3ee37fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ee409e000 0x7f3ee41376b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:47.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.397+0000 7f3ee37fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ee409e000 0x7f3ee41376b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49532/0 (socket says 172.21.15.26:49532) 2023-10-01T08:01:47.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.397+0000 7f3ee37fe700 1 -- 172.21.15.26:0/3730155638 learned_addr learned my addr 172.21.15.26:0/3730155638 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:47.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.397+0000 7f3ee8862700 1 --2- 172.21.15.26:0/3730155638 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ee409e410 0x7f3ee41c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:47.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.397+0000 7f3ee3fff700 1 --2- 172.21.15.26:0/3730155638 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ee409d6f0 0x7f3ee4137170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:47.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.397+0000 7f3ee37fe700 1 -- 172.21.15.26:0/3730155638 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ee409e410 msgr2=0x7f3ee41c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:47.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.398+0000 7f3ee37fe700 1 --2- 172.21.15.26:0/3730155638 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ee409e410 0x7f3ee41c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.398+0000 7f3ee37fe700 1 -- 172.21.15.26:0/3730155638 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ee409d6f0 msgr2=0x7f3ee4137170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:47.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.398+0000 7f3ee37fe700 1 --2- 172.21.15.26:0/3730155638 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ee409d6f0 0x7f3ee4137170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.398+0000 7f3ee37fe700 1 -- 172.21.15.26:0/3730155638 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed40094a0 con 0x7f3ee409e000 2023-10-01T08:01:47.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.398+0000 7f3ee37fe700 1 --2- 172.21.15.26:0/3730155638 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ee409e000 0x7f3ee41376b0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800ec10 tx=0x7f3ed800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:47.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.398+0000 7f3ee0ff9700 1 -- 172.21.15.26:0/3730155638 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed800c910 con 0x7f3ee409e000 2023-10-01T08:01:47.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.398+0000 7f3ee0ff9700 1 -- 172.21.15.26:0/3730155638 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed800ca70 con 0x7f3ee409e000 2023-10-01T08:01:47.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.398+0000 7f3eea2c5700 1 -- 172.21.15.26:0/3730155638 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed80094a0 con 0x7f3ee409e000 2023-10-01T08:01:47.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.398+0000 7f3ee0ff9700 1 -- 172.21.15.26:0/3730155638 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed800cde0 con 0x7f3ee409e000 2023-10-01T08:01:47.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.398+0000 7f3eea2c5700 1 -- 172.21.15.26:0/3730155638 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3edc009b30 con 0x7f3ee409e000 2023-10-01T08:01:47.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.399+0000 7f3eea2c5700 1 -- 172.21.15.26:0/3730155638 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ee4074ea0 con 0x7f3ee409e000 2023-10-01T08:01:47.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.400+0000 7f3ee0ff9700 1 -- 172.21.15.26:0/3730155638 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3ed8013470 con 0x7f3ee409e000 2023-10-01T08:01:47.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.400+0000 7f3ee0ff9700 1 -- 172.21.15.26:0/3730155638 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3ed803f830 con 0x7f3ee409e000 2023-10-01T08:01:47.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.404+0000 7f3ee0ff9700 1 -- 172.21.15.26:0/3730155638 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ed801b3b0 con 0x7f3ee409e000 2023-10-01T08:01:47.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.504+0000 7f25e8b4b700 1 -- 172.21.15.26:0/3303616651 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f25e41a8520 con 0x7f25e409e410 2023-10-01T08:01:47.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.504+0000 7f25d2ffd700 1 -- 172.21.15.26:0/3303616651 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f25dc012930 con 0x7f25e409e410 2023-10-01T08:01:47.505 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:47.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.506+0000 7f25e8b4b700 1 -- 172.21.15.26:0/3303616651 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25e409e410 msgr2=0x7f25e41a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:47.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.506+0000 7f25e8b4b700 1 --2- 172.21.15.26:0/3303616651 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25e409e410 0x7f25e41a5980 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f25dc00efc0 tx=0x7f25dc00c3a0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.507+0000 7f25e8b4b700 1 -- 172.21.15.26:0/3303616651 shutdown_connections 2023-10-01T08:01:47.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.507+0000 7f25e8b4b700 1 --2- 172.21.15.26:0/3303616651 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f25e409e410 0x7f25e41a5980 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.507+0000 7f25e8b4b700 1 --2- 172.21.15.26:0/3303616651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25e409d6f0 0x7f25e41a4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.507+0000 7f25e8b4b700 1 --2- 172.21.15.26:0/3303616651 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f25e409e000 0x7f25e41a5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.507+0000 7f25e8b4b700 1 -- 172.21.15.26:0/3303616651 >> 172.21.15.26:0/3303616651 conn(0x7f25e4066f50 msgr2=0x7f25e41bb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:47.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.507+0000 7f25e8b4b700 1 -- 172.21.15.26:0/3303616651 shutdown_connections 2023-10-01T08:01:47.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.507+0000 7f25e8b4b700 1 -- 172.21.15.26:0/3303616651 wait complete. 2023-10-01T08:01:47.522 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:47.536 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:47.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.579+0000 7f7050336700 1 -- 172.21.15.26:0/2213849228 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7048132400 con 0x7f704809e410 2023-10-01T08:01:47.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.579+0000 7f703effd700 1 -- 172.21.15.26:0/2213849228 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7040019300 con 0x7f704809e410 2023-10-01T08:01:47.581 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:47.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.582+0000 7f7050336700 1 -- 172.21.15.26:0/2213849228 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f704809e410 msgr2=0x7f704812eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:47.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.582+0000 7f7050336700 1 --2- 172.21.15.26:0/2213849228 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f704809e410 0x7f704812eb70 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f704000cbf0 tx=0x7f704000cf00 comp rx=0 tx=0).stop 2023-10-01T08:01:47.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.582+0000 7f7050336700 1 -- 172.21.15.26:0/2213849228 shutdown_connections 2023-10-01T08:01:47.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.582+0000 7f7050336700 1 --2- 172.21.15.26:0/2213849228 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f704809e410 0x7f704812eb70 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.582+0000 7f7050336700 1 --2- 172.21.15.26:0/2213849228 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f704809d6f0 0x7f704812e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.582+0000 7f7050336700 1 --2- 172.21.15.26:0/2213849228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f704809e000 0x7f704812e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.582+0000 7f7050336700 1 -- 172.21.15.26:0/2213849228 >> 172.21.15.26:0/2213849228 conn(0x7f7048066f50 msgr2=0x7f70480a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:47.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.582+0000 7f7050336700 1 -- 172.21.15.26:0/2213849228 shutdown_connections 2023-10-01T08:01:47.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.582+0000 7f7050336700 1 -- 172.21.15.26:0/2213849228 wait complete. 2023-10-01T08:01:47.598 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:47.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.613+0000 7f3eea2c5700 1 -- 172.21.15.26:0/3730155638 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3ee4138b10 con 0x7f3ee409e000 2023-10-01T08:01:47.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.613+0000 7f3ee0ff9700 1 -- 172.21.15.26:0/3730155638 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3ed8021020 con 0x7f3ee409e000 2023-10-01T08:01:47.614 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:47.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.616+0000 7f3eea2c5700 1 -- 172.21.15.26:0/3730155638 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ee409e000 msgr2=0x7f3ee41376b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:47.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.616+0000 7f3eea2c5700 1 --2- 172.21.15.26:0/3730155638 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ee409e000 0x7f3ee41376b0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800ec10 tx=0x7f3ed800ef20 comp rx=0 tx=0).stop 2023-10-01T08:01:47.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.616+0000 7f3eea2c5700 1 -- 172.21.15.26:0/3730155638 shutdown_connections 2023-10-01T08:01:47.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.616+0000 7f3eea2c5700 1 --2- 172.21.15.26:0/3730155638 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ee409e410 0x7f3ee41c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.616+0000 7f3eea2c5700 1 --2- 172.21.15.26:0/3730155638 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ee409d6f0 0x7f3ee4137170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.616+0000 7f3eea2c5700 1 --2- 172.21.15.26:0/3730155638 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ee409e000 0x7f3ee41376b0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.616+0000 7f3eea2c5700 1 -- 172.21.15.26:0/3730155638 >> 172.21.15.26:0/3730155638 conn(0x7f3ee4066f50 msgr2=0x7f3ee40a18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:47.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.616+0000 7f3eea2c5700 1 -- 172.21.15.26:0/3730155638 shutdown_connections 2023-10-01T08:01:47.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.616+0000 7f3eea2c5700 1 -- 172.21.15.26:0/3730155638 wait complete. 2023-10-01T08:01:47.631 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:47.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.702+0000 7ff01ee3d700 1 Processor -- start 2023-10-01T08:01:47.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.703+0000 7ff01ee3d700 1 -- start start 2023-10-01T08:01:47.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.703+0000 7ff01ee3d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff01809d6f0 0x7ff01809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:47.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.703+0000 7ff01ee3d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff01809e000 0x7ff0181339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:47.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.703+0000 7ff01ee3d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff01809e410 0x7ff018133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:47.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.703+0000 7ff01ee3d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff01806b460 con 0x7ff01809e410 2023-10-01T08:01:47.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.703+0000 7ff01ee3d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff01809b120 con 0x7ff01809e000 2023-10-01T08:01:47.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.703+0000 7ff01ee3d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff01809a7e0 con 0x7ff01809d6f0 2023-10-01T08:01:47.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.703+0000 7ff017fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff01809e000 0x7ff0181339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:47.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.703+0000 7ff01cbd9700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff01809d6f0 0x7ff01809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:47.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.703+0000 7ff017fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff01809e000 0x7ff0181339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35558/0 (socket says 172.21.15.26:35558) 2023-10-01T08:01:47.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.703+0000 7ff01d3da700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff01809e410 0x7ff018133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:47.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.703+0000 7ff017fff700 1 -- 172.21.15.26:0/270023725 learned_addr learned my addr 172.21.15.26:0/270023725 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:47.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.704+0000 7ff017fff700 1 -- 172.21.15.26:0/270023725 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff01809d6f0 msgr2=0x7ff01809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:47.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.704+0000 7ff017fff700 1 --2- 172.21.15.26:0/270023725 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff01809d6f0 0x7ff01809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.704+0000 7ff017fff700 1 -- 172.21.15.26:0/270023725 >> v2:172.21.15.26:3300/0 conn(0x7ff01809e410 msgr2=0x7ff018133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:47.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.704+0000 7ff017fff700 1 --2- 172.21.15.26:0/270023725 >> v2:172.21.15.26:3300/0 conn(0x7ff01809e410 0x7ff018133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.704+0000 7ff017fff700 1 -- 172.21.15.26:0/270023725 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01809a500 con 0x7ff01809e000 2023-10-01T08:01:47.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.704+0000 7ff01cbd9700 1 --2- 172.21.15.26:0/270023725 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff01809d6f0 0x7ff01809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:47.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.704+0000 7ff01d3da700 1 --2- 172.21.15.26:0/270023725 >> v2:172.21.15.26:3300/0 conn(0x7ff01809e410 0x7ff018133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:47.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.704+0000 7ff017fff700 1 --2- 172.21.15.26:0/270023725 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff01809e000 0x7ff0181339f0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7ff000009920 tx=0x7ff000009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5b299d4ea5c44bb server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:47.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.704+0000 7ff0177fe700 1 -- 172.21.15.26:0/270023725 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff000011830 con 0x7ff01809e000 2023-10-01T08:01:47.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.704+0000 7ff0177fe700 1 -- 172.21.15.26:0/270023725 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff000011990 con 0x7ff01809e000 2023-10-01T08:01:47.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.704+0000 7ff0177fe700 1 -- 172.21.15.26:0/270023725 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff000011d20 con 0x7ff01809e000 2023-10-01T08:01:47.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.705+0000 7ff01ee3d700 1 -- 172.21.15.26:0/270023725 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff01809e000 msgr2=0x7ff0181339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:47.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.705+0000 7ff01ee3d700 1 --2- 172.21.15.26:0/270023725 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff01809e000 0x7ff0181339f0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7ff000009920 tx=0x7ff000009c30 comp rx=0 tx=0).stop 2023-10-01T08:01:47.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.705+0000 7ff01ee3d700 1 -- 172.21.15.26:0/270023725 shutdown_connections 2023-10-01T08:01:47.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.705+0000 7ff01ee3d700 1 --2- 172.21.15.26:0/270023725 >> v2:172.21.15.26:3300/0 conn(0x7ff01809e410 0x7ff018133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.705+0000 7ff01ee3d700 1 --2- 172.21.15.26:0/270023725 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff01809d6f0 0x7ff01809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.705+0000 7ff01ee3d700 1 --2- 172.21.15.26:0/270023725 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff01809e000 0x7ff0181339f0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.705+0000 7ff01ee3d700 1 -- 172.21.15.26:0/270023725 >> 172.21.15.26:0/270023725 conn(0x7ff018066f50 msgr2=0x7ff01809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:47.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.705+0000 7ff01ee3d700 1 -- 172.21.15.26:0/270023725 shutdown_connections 2023-10-01T08:01:47.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.705+0000 7ff01ee3d700 1 -- 172.21.15.26:0/270023725 wait complete. 2023-10-01T08:01:47.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.706+0000 7ff01ee3d700 1 Processor -- start 2023-10-01T08:01:47.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.706+0000 7ff01ee3d700 1 -- start start 2023-10-01T08:01:47.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.707+0000 7ff01ee3d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff01809d6f0 0x7ff0181b91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:47.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.707+0000 7ff01ee3d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff01809e000 0x7ff0181a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:47.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.707+0000 7ff01ee3d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff01809e410 0x7ff0181a6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:47.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.707+0000 7ff01ee3d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0181aa2c0 con 0x7ff01809d6f0 2023-10-01T08:01:47.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.707+0000 7ff01ee3d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0181a9900 con 0x7ff01809e000 2023-10-01T08:01:47.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.707+0000 7ff01ee3d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0181a9090 con 0x7ff01809e410 2023-10-01T08:01:47.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.707+0000 7ff01cbd9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff01809d6f0 0x7ff0181b91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:47.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.707+0000 7ff01cbd9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff01809d6f0 0x7ff0181b91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55872/0 (socket says 172.21.15.26:55872) 2023-10-01T08:01:47.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.707+0000 7ff01cbd9700 1 -- 172.21.15.26:0/4093230244 learned_addr learned my addr 172.21.15.26:0/4093230244 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:47.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.707+0000 7ff017fff700 1 --2- 172.21.15.26:0/4093230244 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff01809e000 0x7ff0181a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:47.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.707+0000 7ff01d3da700 1 --2- 172.21.15.26:0/4093230244 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff01809e410 0x7ff0181a6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:47.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.707+0000 7ff01cbd9700 1 -- 172.21.15.26:0/4093230244 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff01809e410 msgr2=0x7ff0181a6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:47.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.707+0000 7ff01cbd9700 1 --2- 172.21.15.26:0/4093230244 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff01809e410 0x7ff0181a6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.707+0000 7ff01cbd9700 1 -- 172.21.15.26:0/4093230244 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff01809e000 msgr2=0x7ff0181a5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:47.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.707+0000 7ff01cbd9700 1 --2- 172.21.15.26:0/4093230244 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff01809e000 0x7ff0181a5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.708+0000 7ff01cbd9700 1 -- 172.21.15.26:0/4093230244 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0080094a0 con 0x7ff01809d6f0 2023-10-01T08:01:47.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.708+0000 7ff01cbd9700 1 --2- 172.21.15.26:0/4093230244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff01809d6f0 0x7ff0181b91d0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7ff00800ebe0 tx=0x7ff00800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:47.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.708+0000 7ff0157fa700 1 -- 172.21.15.26:0/4093230244 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00800c850 con 0x7ff01809d6f0 2023-10-01T08:01:47.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.708+0000 7ff0157fa700 1 -- 172.21.15.26:0/4093230244 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00800c9b0 con 0x7ff01809d6f0 2023-10-01T08:01:47.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.708+0000 7ff01ee3d700 1 -- 172.21.15.26:0/4093230244 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff010009a70 con 0x7ff01809d6f0 2023-10-01T08:01:47.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.708+0000 7ff0157fa700 1 -- 172.21.15.26:0/4093230244 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00800cd40 con 0x7ff01809d6f0 2023-10-01T08:01:47.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.708+0000 7ff01ee3d700 1 -- 172.21.15.26:0/4093230244 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff000009550 con 0x7ff01809d6f0 2023-10-01T08:01:47.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.709+0000 7ff0157fa700 1 -- 172.21.15.26:0/4093230244 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff008013470 con 0x7ff01809d6f0 2023-10-01T08:01:47.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.709+0000 7ff0157fa700 1 -- 172.21.15.26:0/4093230244 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff00803fb00 con 0x7ff01809d6f0 2023-10-01T08:01:47.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.709+0000 7ff01ee3d700 1 -- 172.21.15.26:0/4093230244 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff018074ea0 con 0x7ff01809d6f0 2023-10-01T08:01:47.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.714+0000 7ff0157fa700 1 -- 172.21.15.26:0/4093230244 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff008013720 con 0x7ff01809d6f0 2023-10-01T08:01:47.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.920+0000 7ff01ee3d700 1 -- 172.21.15.26:0/4093230244 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff0181a79f0 con 0x7ff01809d6f0 2023-10-01T08:01:47.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.920+0000 7ff0157fa700 1 -- 172.21.15.26:0/4093230244 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff008021030 con 0x7ff01809d6f0 2023-10-01T08:01:47.921 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:47.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.923+0000 7ff01ee3d700 1 -- 172.21.15.26:0/4093230244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff01809d6f0 msgr2=0x7ff0181b91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:47.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.923+0000 7ff01ee3d700 1 --2- 172.21.15.26:0/4093230244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff01809d6f0 0x7ff0181b91d0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7ff00800ebe0 tx=0x7ff00800eef0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.923+0000 7ff01ee3d700 1 -- 172.21.15.26:0/4093230244 shutdown_connections 2023-10-01T08:01:47.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.923+0000 7ff01ee3d700 1 --2- 172.21.15.26:0/4093230244 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ff01809e410 0x7ff0181a6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.923+0000 7ff01ee3d700 1 --2- 172.21.15.26:0/4093230244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff01809d6f0 0x7ff0181b91d0 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.923+0000 7ff01ee3d700 1 --2- 172.21.15.26:0/4093230244 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff01809e000 0x7ff0181a5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:47.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.923+0000 7ff01ee3d700 1 -- 172.21.15.26:0/4093230244 >> 172.21.15.26:0/4093230244 conn(0x7ff018066f50 msgr2=0x7ff0181badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:47.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.923+0000 7ff01ee3d700 1 -- 172.21.15.26:0/4093230244 shutdown_connections 2023-10-01T08:01:47.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:47.923+0000 7ff01ee3d700 1 -- 172.21.15.26:0/4093230244 wait complete. 2023-10-01T08:01:47.937 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:48.523 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:48.599 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:48.632 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:48.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.673+0000 7fbcc1637700 1 Processor -- start 2023-10-01T08:01:48.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.673+0000 7fbcc1637700 1 -- start start 2023-10-01T08:01:48.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.674+0000 7fbcc1637700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbcbc09e1d0 0x7fbcbc138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:48.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.674+0000 7fbcc1637700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbcbc139170 0x7fbcbc13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:48.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.674+0000 7fbcc1637700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcbc09b120 con 0x7fbcbc09d6f0 2023-10-01T08:01:48.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.674+0000 7fbcc1637700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc06b460 con 0x7fbcbc139170 2023-10-01T08:01:48.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.674+0000 7fbcc1637700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc09a7e0 con 0x7fbcbc09e1d0 2023-10-01T08:01:48.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.674+0000 7fbcbaffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbcbc09d6f0 0x7fbcbc09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39568/0 (socket says 172.21.15.26:39568) 2023-10-01T08:01:48.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.674+0000 7fbcbaffd700 1 -- 172.21.15.26:0/2584617485 learned_addr learned my addr 172.21.15.26:0/2584617485 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:01:48.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.674+0000 7fbcba7fc700 1 --2- 172.21.15.26:0/2584617485 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbcbc09e1d0 0x7fbcbc138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:48.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.674+0000 7fbcbb7fe700 1 --2- 172.21.15.26:0/2584617485 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbcbc139170 0x7fbcbc13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:48.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.675+0000 7fbcb9ffb700 1 -- 172.21.15.26:0/2584617485 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4231693590 0 0) 0x7fbcbc09b120 con 0x7fbcbc09d6f0 2023-10-01T08:01:48.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.675+0000 7fbcb9ffb700 1 -- 172.21.15.26:0/2584617485 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbca40035b0 con 0x7fbcbc09d6f0 2023-10-01T08:01:48.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.675+0000 7fbcbb7fe700 1 -- 172.21.15.26:0/2584617485 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbcbc09e1d0 msgr2=0x7fbcbc138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:48.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.675+0000 7fbcbb7fe700 1 --2- 172.21.15.26:0/2584617485 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbcbc09e1d0 0x7fbcbc138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:48.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.675+0000 7fbcbb7fe700 1 -- 172.21.15.26:0/2584617485 >> v1:172.21.15.26:6789/0 conn(0x7fbcbc09d6f0 legacy=0x7fbcbc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:48.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.675+0000 7fbcbb7fe700 1 -- 172.21.15.26:0/2584617485 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcbc09a500 con 0x7fbcbc139170 2023-10-01T08:01:48.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.675+0000 7fbcbb7fe700 1 --2- 172.21.15.26:0/2584617485 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbcbc139170 0x7fbcbc13b550 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4009dc0 tx=0x7fbcb400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb29da39e4c8861f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:48.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.675+0000 7fbcba7fc700 1 --2- 172.21.15.26:0/2584617485 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbcbc09e1d0 0x7fbcbc138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:48.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.675+0000 7fbcb9ffb700 1 -- 172.21.15.26:0/2584617485 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb400e070 con 0x7fbcbc139170 2023-10-01T08:01:48.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.675+0000 7fbcb9ffb700 1 -- 172.21.15.26:0/2584617485 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb400bb20 con 0x7fbcbc139170 2023-10-01T08:01:48.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.675+0000 7fbcb9ffb700 1 -- 172.21.15.26:0/2584617485 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb4012430 con 0x7fbcbc139170 2023-10-01T08:01:48.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.676+0000 7fbcc1637700 1 -- 172.21.15.26:0/2584617485 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbcbc139170 msgr2=0x7fbcbc13b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:48.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.676+0000 7fbcc1637700 1 --2- 172.21.15.26:0/2584617485 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbcbc139170 0x7fbcbc13b550 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4009dc0 tx=0x7fbcb400b330 comp rx=0 tx=0).stop 2023-10-01T08:01:48.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.676+0000 7fbcc1637700 1 -- 172.21.15.26:0/2584617485 shutdown_connections 2023-10-01T08:01:48.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.676+0000 7fbcc1637700 1 --2- 172.21.15.26:0/2584617485 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbcbc139170 0x7fbcbc13b550 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:48.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.676+0000 7fbcc1637700 1 --2- 172.21.15.26:0/2584617485 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbcbc09e1d0 0x7fbcbc138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:48.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.676+0000 7fbcc1637700 1 -- 172.21.15.26:0/2584617485 >> 172.21.15.26:0/2584617485 conn(0x7fbcbc066f50 msgr2=0x7fbcbc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:48.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.676+0000 7fbcc1637700 1 -- 172.21.15.26:0/2584617485 shutdown_connections 2023-10-01T08:01:48.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.676+0000 7fbcc1637700 1 -- 172.21.15.26:0/2584617485 wait complete. 2023-10-01T08:01:48.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.677+0000 7fbcc1637700 1 Processor -- start 2023-10-01T08:01:48.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.677+0000 7fbcc1637700 1 -- start start 2023-10-01T08:01:48.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.678+0000 7fbcc1637700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbcbc09d6f0 0x7fbcbc1205f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:48.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.678+0000 7fbcc1637700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbcbc09e1d0 0x7fbcbc120b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:48.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.678+0000 7fbcc1637700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbcbc139170 0x7fbcbc121070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:48.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.678+0000 7fbcc1637700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc1240c0 con 0x7fbcbc139170 2023-10-01T08:01:48.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.678+0000 7fbcc1637700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc123490 con 0x7fbcbc09e1d0 2023-10-01T08:01:48.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.678+0000 7fbcc1637700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc0a1730 con 0x7fbcbc09d6f0 2023-10-01T08:01:48.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.678+0000 7fbcbaffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbcbc09d6f0 0x7fbcbc1205f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:48.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.678+0000 7fbcbb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbcbc139170 0x7fbcbc121070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:48.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.678+0000 7fbcba7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbcbc09e1d0 0x7fbcbc120b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:48.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.678+0000 7fbcbaffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbcbc09d6f0 0x7fbcbc1205f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49562/0 (socket says 172.21.15.26:49562) 2023-10-01T08:01:48.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.678+0000 7fbcba7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbcbc09e1d0 0x7fbcbc120b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35580/0 (socket says 172.21.15.26:35580) 2023-10-01T08:01:48.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.678+0000 7fbcbb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbcbc139170 0x7fbcbc121070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55878/0 (socket says 172.21.15.26:55878) 2023-10-01T08:01:48.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.678+0000 7fbcbaffd700 1 -- 172.21.15.26:0/2561267059 learned_addr learned my addr 172.21.15.26:0/2561267059 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:48.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.678+0000 7fbcba7fc700 1 -- 172.21.15.26:0/2561267059 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbcbc09d6f0 msgr2=0x7fbcbc1205f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:48.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.678+0000 7fbcba7fc700 1 --2- 172.21.15.26:0/2561267059 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbcbc09d6f0 0x7fbcbc1205f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:48.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.678+0000 7fbcba7fc700 1 -- 172.21.15.26:0/2561267059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbcbc139170 msgr2=0x7fbcbc121070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:48.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.678+0000 7fbcba7fc700 1 --2- 172.21.15.26:0/2561267059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbcbc139170 0x7fbcbc121070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:48.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.678+0000 7fbcba7fc700 1 -- 172.21.15.26:0/2561267059 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb00094a0 con 0x7fbcbc09e1d0 2023-10-01T08:01:48.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.679+0000 7fbcbb7fe700 1 --2- 172.21.15.26:0/2561267059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbcbc139170 0x7fbcbc121070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:48.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.679+0000 7fbcba7fc700 1 --2- 172.21.15.26:0/2561267059 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbcbc09e1d0 0x7fbcbc120b30 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fbcb000e9b0 tx=0x7fbcb000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:48.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.679+0000 7fbca37fe700 1 -- 172.21.15.26:0/2561267059 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb000ee50 con 0x7fbcbc09e1d0 2023-10-01T08:01:48.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.679+0000 7fbca37fe700 1 -- 172.21.15.26:0/2561267059 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb000c850 con 0x7fbcbc09e1d0 2023-10-01T08:01:48.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.679+0000 7fbcc1637700 1 -- 172.21.15.26:0/2561267059 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcb4009a70 con 0x7fbcbc09e1d0 2023-10-01T08:01:48.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.679+0000 7fbca37fe700 1 -- 172.21.15.26:0/2561267059 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb000cc00 con 0x7fbcbc09e1d0 2023-10-01T08:01:48.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.679+0000 7fbcc1637700 1 -- 172.21.15.26:0/2561267059 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcbc09c710 con 0x7fbcbc09e1d0 2023-10-01T08:01:48.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.680+0000 7fbca37fe700 1 -- 172.21.15.26:0/2561267059 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbcb0013470 con 0x7fbcbc09e1d0 2023-10-01T08:01:48.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.680+0000 7fbca37fe700 1 -- 172.21.15.26:0/2561267059 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbcb003fab0 con 0x7fbcbc09e1d0 2023-10-01T08:01:48.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.680+0000 7fbcc1637700 1 -- 172.21.15.26:0/2561267059 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcbc122210 con 0x7fbcbc09e1d0 2023-10-01T08:01:48.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.685+0000 7fbca37fe700 1 -- 172.21.15.26:0/2561267059 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbcb0021020 con 0x7fbcbc09e1d0 2023-10-01T08:01:48.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.744+0000 7fefffb82700 1 Processor -- start 2023-10-01T08:01:48.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.744+0000 7fefffb82700 1 -- start start 2023-10-01T08:01:48.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.745+0000 7fefffb82700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feff8133a80 0x7feff8133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:48.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.745+0000 7fefffb82700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feff8130a40 0x7feff813b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:48.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.745+0000 7fefffb82700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feff806bc00 con 0x7feff812ff20 2023-10-01T08:01:48.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.745+0000 7fefffb82700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff806c570 con 0x7feff8133a80 2023-10-01T08:01:48.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.745+0000 7fefffb82700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feff80a0040 con 0x7feff8130a40 2023-10-01T08:01:48.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.745+0000 7feffd11d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7feff812ff20 0x7feff8130330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39570/0 (socket says 172.21.15.26:39570) 2023-10-01T08:01:48.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.745+0000 7feffd11d700 1 -- 172.21.15.26:0/1106057628 learned_addr learned my addr 172.21.15.26:0/1106057628 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:01:48.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.745+0000 7feffd91e700 1 --2- 172.21.15.26:0/1106057628 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feff8133a80 0x7feff8133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:48.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.745+0000 7feffe11f700 1 --2- 172.21.15.26:0/1106057628 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feff8130a40 0x7feff813b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:48.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.746+0000 7feffc91c700 1 -- 172.21.15.26:0/1106057628 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3390964615 0 0) 0x7feff806bc00 con 0x7feff812ff20 2023-10-01T08:01:48.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.746+0000 7feffc91c700 1 -- 172.21.15.26:0/1106057628 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefe40035b0 con 0x7feff812ff20 2023-10-01T08:01:48.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.746+0000 7feffd91e700 1 -- 172.21.15.26:0/1106057628 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feff8130a40 msgr2=0x7feff813b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:48.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.746+0000 7feffd91e700 1 --2- 172.21.15.26:0/1106057628 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feff8130a40 0x7feff813b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:48.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.746+0000 7feffd91e700 1 -- 172.21.15.26:0/1106057628 >> v1:172.21.15.26:6789/0 conn(0x7feff812ff20 legacy=0x7feff8130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:48.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.746+0000 7feffd91e700 1 -- 172.21.15.26:0/1106057628 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff8133860 con 0x7feff8133a80 2023-10-01T08:01:48.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.746+0000 7feffe11f700 1 --2- 172.21.15.26:0/1106057628 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feff8130a40 0x7feff813b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:48.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.746+0000 7feffd91e700 1 --2- 172.21.15.26:0/1106057628 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feff8133a80 0x7feff8133e50 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7feff4009870 tx=0x7feff4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd02bb00a87eb26c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:48.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.746+0000 7feffc91c700 1 -- 172.21.15.26:0/1106057628 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff4011830 con 0x7feff8133a80 2023-10-01T08:01:48.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.746+0000 7feffc91c700 1 -- 172.21.15.26:0/1106057628 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff4011990 con 0x7feff8133a80 2023-10-01T08:01:48.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.746+0000 7feffc91c700 1 -- 172.21.15.26:0/1106057628 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff4011d20 con 0x7feff8133a80 2023-10-01T08:01:48.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.747+0000 7fefffb82700 1 -- 172.21.15.26:0/1106057628 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feff8133a80 msgr2=0x7feff8133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:48.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.747+0000 7fefffb82700 1 --2- 172.21.15.26:0/1106057628 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feff8133a80 0x7feff8133e50 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7feff4009870 tx=0x7feff4009b80 comp rx=0 tx=0).stop 2023-10-01T08:01:48.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.747+0000 7fefffb82700 1 -- 172.21.15.26:0/1106057628 shutdown_connections 2023-10-01T08:01:48.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.747+0000 7fefffb82700 1 --2- 172.21.15.26:0/1106057628 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feff8130a40 0x7feff813b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:48.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.747+0000 7fefffb82700 1 --2- 172.21.15.26:0/1106057628 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feff8133a80 0x7feff8133e50 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:48.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.747+0000 7fefffb82700 1 -- 172.21.15.26:0/1106057628 >> 172.21.15.26:0/1106057628 conn(0x7feff80a4210 msgr2=0x7feff80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:48.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.747+0000 7fefffb82700 1 -- 172.21.15.26:0/1106057628 shutdown_connections 2023-10-01T08:01:48.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.747+0000 7fefffb82700 1 -- 172.21.15.26:0/1106057628 wait complete. 2023-10-01T08:01:48.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.749+0000 7fefffb82700 1 Processor -- start 2023-10-01T08:01:48.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.749+0000 7fefffb82700 1 -- start start 2023-10-01T08:01:48.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.749+0000 7fefffb82700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feff812ff20 0x7feff809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:48.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.749+0000 7fefffb82700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feff8130a40 0x7feff809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:48.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.749+0000 7fefffb82700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feff8133a80 0x7feff809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:48.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.749+0000 7fefffb82700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff8120810 con 0x7feff812ff20 2023-10-01T08:01:48.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.749+0000 7fefffb82700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff811fbf0 con 0x7feff8133a80 2023-10-01T08:01:48.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.749+0000 7fefffb82700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feff811eff0 con 0x7feff8130a40 2023-10-01T08:01:48.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.750+0000 7feffd11d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feff8130a40 0x7feff809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:48.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.750+0000 7feffe11f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feff8133a80 0x7feff809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:48.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.750+0000 7feffd11d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feff8130a40 0x7feff809c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49578/0 (socket says 172.21.15.26:49578) 2023-10-01T08:01:48.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.750+0000 7feffd11d700 1 -- 172.21.15.26:0/176044168 learned_addr learned my addr 172.21.15.26:0/176044168 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:48.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.750+0000 7feffd91e700 1 --2- 172.21.15.26:0/176044168 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feff812ff20 0x7feff809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:48.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.750+0000 7feffd11d700 1 -- 172.21.15.26:0/176044168 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feff8133a80 msgr2=0x7feff809cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:48.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.750+0000 7feffd11d700 1 --2- 172.21.15.26:0/176044168 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feff8133a80 0x7feff809cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:48.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.750+0000 7feffd11d700 1 -- 172.21.15.26:0/176044168 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feff812ff20 msgr2=0x7feff809c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:48.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.750+0000 7feffd11d700 1 --2- 172.21.15.26:0/176044168 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feff812ff20 0x7feff809c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:48.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.750+0000 7feffd11d700 1 -- 172.21.15.26:0/176044168 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff0009a70 con 0x7feff8130a40 2023-10-01T08:01:48.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.750+0000 7feffd11d700 1 --2- 172.21.15.26:0/176044168 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feff8130a40 0x7feff809c9c0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fefe8005910 tx=0x7fefe800c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:48.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.751+0000 7fefee7fc700 1 -- 172.21.15.26:0/176044168 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe8005d70 con 0x7feff8130a40 2023-10-01T08:01:48.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.751+0000 7fefee7fc700 1 -- 172.21.15.26:0/176044168 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe80070d0 con 0x7feff8130a40 2023-10-01T08:01:48.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.751+0000 7fefffb82700 1 -- 172.21.15.26:0/176044168 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff40094a0 con 0x7feff8130a40 2023-10-01T08:01:48.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.751+0000 7fefee7fc700 1 -- 172.21.15.26:0/176044168 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe8007440 con 0x7feff8130a40 2023-10-01T08:01:48.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.751+0000 7fefffb82700 1 -- 172.21.15.26:0/176044168 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff809e0b0 con 0x7feff8130a40 2023-10-01T08:01:48.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.752+0000 7fefee7fc700 1 -- 172.21.15.26:0/176044168 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fefe80075a0 con 0x7feff8130a40 2023-10-01T08:01:48.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.752+0000 7fefffb82700 1 -- 172.21.15.26:0/176044168 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feff8074ea0 con 0x7feff8130a40 2023-10-01T08:01:48.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.752+0000 7fefee7fc700 1 -- 172.21.15.26:0/176044168 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fefe803ea90 con 0x7feff8130a40 2023-10-01T08:01:48.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.761+0000 7fefee7fc700 1 -- 172.21.15.26:0/176044168 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fefe8019b40 con 0x7feff8130a40 2023-10-01T08:01:48.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.784+0000 7f50b1ad8700 1 Processor -- start 2023-10-01T08:01:48.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.784+0000 7f50b1ad8700 1 -- start start 2023-10-01T08:01:48.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.784+0000 7f50b1ad8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f50ac09d6f0 0x7f50ac09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:48.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.785+0000 7f50b1ad8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f50ac09e000 0x7f50ac130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:48.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.785+0000 7f50b1ad8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f50ac09e410 0x7f50ac130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:48.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.785+0000 7f50b1ad8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50ac09f520 con 0x7f50ac09e000 2023-10-01T08:01:48.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.785+0000 7f50b1ad8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50ac09f130 con 0x7f50ac09e410 2023-10-01T08:01:48.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.785+0000 7f50b1ad8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50ac09e930 con 0x7f50ac09d6f0 2023-10-01T08:01:48.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.785+0000 7f50ab7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f50ac09d6f0 0x7f50ac09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:48.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.785+0000 7f50abfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f50ac09e410 0x7f50ac130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:48.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.785+0000 7f50aaffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f50ac09e000 0x7f50ac130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:48.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.785+0000 7f50ab7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f50ac09d6f0 0x7f50ac09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49586/0 (socket says 172.21.15.26:49586) 2023-10-01T08:01:48.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.785+0000 7f50ab7fe700 1 -- 172.21.15.26:0/2851270475 learned_addr learned my addr 172.21.15.26:0/2851270475 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:48.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.785+0000 7f50abfff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f50ac09e410 0x7f50ac130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35596/0 (socket says 172.21.15.26:35596) 2023-10-01T08:01:48.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.785+0000 7f50ab7fe700 1 -- 172.21.15.26:0/2851270475 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f50ac09e410 msgr2=0x7f50ac130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:48.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.785+0000 7f50ab7fe700 1 --2- 172.21.15.26:0/2851270475 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f50ac09e410 0x7f50ac130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:48.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.785+0000 7f50ab7fe700 1 -- 172.21.15.26:0/2851270475 >> v2:172.21.15.26:3300/0 conn(0x7f50ac09e000 msgr2=0x7f50ac130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:48.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.785+0000 7f50ab7fe700 1 --2- 172.21.15.26:0/2851270475 >> v2:172.21.15.26:3300/0 conn(0x7f50ac09e000 0x7f50ac130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:48.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.785+0000 7f50ab7fe700 1 -- 172.21.15.26:0/2851270475 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50ac09b2d0 con 0x7f50ac09d6f0 2023-10-01T08:01:48.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.785+0000 7f50aaffd700 1 --2- 172.21.15.26:0/2851270475 >> v2:172.21.15.26:3300/0 conn(0x7f50ac09e000 0x7f50ac130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:48.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.785+0000 7f50abfff700 1 --2- 172.21.15.26:0/2851270475 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f50ac09e410 0x7f50ac130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:48.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.785+0000 7f50ab7fe700 1 --2- 172.21.15.26:0/2851270475 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f50ac09d6f0 0x7f50ac09dac0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f509c009920 tx=0x7f509c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65235337cfcd2487 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:48.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.786+0000 7f50aa7fc700 1 -- 172.21.15.26:0/2851270475 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509c011830 con 0x7f50ac09d6f0 2023-10-01T08:01:48.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.786+0000 7f50aa7fc700 1 -- 172.21.15.26:0/2851270475 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509c011990 con 0x7f50ac09d6f0 2023-10-01T08:01:48.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.786+0000 7f50aa7fc700 1 -- 172.21.15.26:0/2851270475 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509c011d20 con 0x7f50ac09d6f0 2023-10-01T08:01:48.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.786+0000 7f50b1ad8700 1 -- 172.21.15.26:0/2851270475 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f50ac09d6f0 msgr2=0x7f50ac09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:48.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.786+0000 7f50b1ad8700 1 --2- 172.21.15.26:0/2851270475 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f50ac09d6f0 0x7f50ac09dac0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f509c009920 tx=0x7f509c009c30 comp rx=0 tx=0).stop 2023-10-01T08:01:48.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.786+0000 7f50b1ad8700 1 -- 172.21.15.26:0/2851270475 shutdown_connections 2023-10-01T08:01:48.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.786+0000 7f50b1ad8700 1 --2- 172.21.15.26:0/2851270475 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f50ac09e410 0x7f50ac130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:48.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.786+0000 7f50b1ad8700 1 --2- 172.21.15.26:0/2851270475 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f50ac09d6f0 0x7f50ac09dac0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:48.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.786+0000 7f50b1ad8700 1 --2- 172.21.15.26:0/2851270475 >> v2:172.21.15.26:3300/0 conn(0x7f50ac09e000 0x7f50ac130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:48.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.786+0000 7f50b1ad8700 1 -- 172.21.15.26:0/2851270475 >> 172.21.15.26:0/2851270475 conn(0x7f50ac066f50 msgr2=0x7f50ac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:48.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.786+0000 7f50b1ad8700 1 -- 172.21.15.26:0/2851270475 shutdown_connections 2023-10-01T08:01:48.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.786+0000 7f50b1ad8700 1 -- 172.21.15.26:0/2851270475 wait complete. 2023-10-01T08:01:48.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.788+0000 7f50b1ad8700 1 Processor -- start 2023-10-01T08:01:48.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.788+0000 7f50b1ad8700 1 -- start start 2023-10-01T08:01:48.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.789+0000 7f50b1ad8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f50ac09d6f0 0x7f50ac137510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:48.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.789+0000 7f50b1ad8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f50ac09e000 0x7f50ac137a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:48.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.789+0000 7f50b1ad8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50ac09e410 0x7f50ac137f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:48.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.789+0000 7f50b1ad8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ac1388e0 con 0x7f50ac09e410 2023-10-01T08:01:48.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.789+0000 7f50b1ad8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50ac139100 con 0x7f50ac09e000 2023-10-01T08:01:48.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.789+0000 7f50b1ad8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50ac11a640 con 0x7f50ac09d6f0 2023-10-01T08:01:48.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.789+0000 7f50aaffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f50ac09e000 0x7f50ac137a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:48.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.789+0000 7f50aaffd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f50ac09e000 0x7f50ac137a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35608/0 (socket says 172.21.15.26:35608) 2023-10-01T08:01:48.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.789+0000 7f50aaffd700 1 -- 172.21.15.26:0/3518272242 learned_addr learned my addr 172.21.15.26:0/3518272242 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:48.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.789+0000 7f50abfff700 1 --2- 172.21.15.26:0/3518272242 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50ac09e410 0x7f50ac137f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:48.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.789+0000 7f50ab7fe700 1 --2- 172.21.15.26:0/3518272242 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f50ac09d6f0 0x7f50ac137510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:48.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.789+0000 7f50aaffd700 1 -- 172.21.15.26:0/3518272242 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f50ac09d6f0 msgr2=0x7f50ac137510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:48.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.789+0000 7f50aaffd700 1 --2- 172.21.15.26:0/3518272242 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f50ac09d6f0 0x7f50ac137510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:48.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.789+0000 7f50aaffd700 1 -- 172.21.15.26:0/3518272242 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50ac09e410 msgr2=0x7f50ac137f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:48.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.789+0000 7f50aaffd700 1 --2- 172.21.15.26:0/3518272242 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50ac09e410 0x7f50ac137f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:48.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.789+0000 7f50aaffd700 1 -- 172.21.15.26:0/3518272242 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a00094a0 con 0x7f50ac09e000 2023-10-01T08:01:48.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.790+0000 7f50abfff700 1 --2- 172.21.15.26:0/3518272242 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50ac09e410 0x7f50ac137f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:48.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.790+0000 7f50aaffd700 1 --2- 172.21.15.26:0/3518272242 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f50ac09e000 0x7f50ac137a50 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f50a000ebb0 tx=0x7f50a000eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:48.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.790+0000 7f5093fff700 1 -- 172.21.15.26:0/3518272242 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a0009e80 con 0x7f50ac09e000 2023-10-01T08:01:48.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.790+0000 7f5093fff700 1 -- 172.21.15.26:0/3518272242 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a000c850 con 0x7f50ac09e000 2023-10-01T08:01:48.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.790+0000 7f50b1ad8700 1 -- 172.21.15.26:0/3518272242 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a4009a70 con 0x7f50ac09e000 2023-10-01T08:01:48.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.790+0000 7f5093fff700 1 -- 172.21.15.26:0/3518272242 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a000cbc0 con 0x7f50ac09e000 2023-10-01T08:01:48.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.790+0000 7f50b1ad8700 1 -- 172.21.15.26:0/3518272242 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f509c009550 con 0x7f50ac09e000 2023-10-01T08:01:48.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.791+0000 7f50b1ad8700 1 -- 172.21.15.26:0/3518272242 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50ac074ea0 con 0x7f50ac09e000 2023-10-01T08:01:48.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.792+0000 7f5093fff700 1 -- 172.21.15.26:0/3518272242 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f50a000cd20 con 0x7f50ac09e000 2023-10-01T08:01:48.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.792+0000 7f5093fff700 1 -- 172.21.15.26:0/3518272242 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f50a003fbc0 con 0x7f50ac09e000 2023-10-01T08:01:48.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.796+0000 7f5093fff700 1 -- 172.21.15.26:0/3518272242 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f50a001b3b0 con 0x7f50ac09e000 2023-10-01T08:01:48.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.901+0000 7fbcc1637700 1 -- 172.21.15.26:0/2561267059 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbcbc074ea0 con 0x7fbcbc09e1d0 2023-10-01T08:01:48.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.901+0000 7fbca37fe700 1 -- 172.21.15.26:0/2561267059 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbcb0013720 con 0x7fbcbc09e1d0 2023-10-01T08:01:48.902 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:48.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.904+0000 7fbcc1637700 1 -- 172.21.15.26:0/2561267059 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbcbc09e1d0 msgr2=0x7fbcbc120b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:48.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.904+0000 7fbcc1637700 1 --2- 172.21.15.26:0/2561267059 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbcbc09e1d0 0x7fbcbc120b30 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fbcb000e9b0 tx=0x7fbcb000ecc0 comp rx=0 tx=0).stop 2023-10-01T08:01:48.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.904+0000 7fbcc1637700 1 -- 172.21.15.26:0/2561267059 shutdown_connections 2023-10-01T08:01:48.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.904+0000 7fbcc1637700 1 --2- 172.21.15.26:0/2561267059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbcbc139170 0x7fbcbc121070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:48.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.904+0000 7fbcc1637700 1 --2- 172.21.15.26:0/2561267059 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fbcbc09d6f0 0x7fbcbc1205f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:48.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.904+0000 7fbcc1637700 1 --2- 172.21.15.26:0/2561267059 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbcbc09e1d0 0x7fbcbc120b30 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:48.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.904+0000 7fbcc1637700 1 -- 172.21.15.26:0/2561267059 >> 172.21.15.26:0/2561267059 conn(0x7fbcbc066f50 msgr2=0x7fbcbc09b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:48.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.904+0000 7fbcc1637700 1 -- 172.21.15.26:0/2561267059 shutdown_connections 2023-10-01T08:01:48.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.904+0000 7fbcc1637700 1 -- 172.21.15.26:0/2561267059 wait complete. 2023-10-01T08:01:48.919 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:48.938 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-01T08:01:48.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.970+0000 7fefffb82700 1 -- 172.21.15.26:0/176044168 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7feff81201c0 con 0x7feff8130a40 2023-10-01T08:01:48.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.970+0000 7fefee7fc700 1 -- 172.21.15.26:0/176044168 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fefe8017030 con 0x7feff8130a40 2023-10-01T08:01:48.971 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:48.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.973+0000 7fefffb82700 1 -- 172.21.15.26:0/176044168 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feff8130a40 msgr2=0x7feff809c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:48.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.973+0000 7fefffb82700 1 --2- 172.21.15.26:0/176044168 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feff8130a40 0x7feff809c9c0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fefe8005910 tx=0x7fefe800c9e0 comp rx=0 tx=0).stop 2023-10-01T08:01:48.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.973+0000 7fefffb82700 1 -- 172.21.15.26:0/176044168 shutdown_connections 2023-10-01T08:01:48.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.973+0000 7fefffb82700 1 --2- 172.21.15.26:0/176044168 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feff8133a80 0x7feff809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:48.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.973+0000 7fefffb82700 1 --2- 172.21.15.26:0/176044168 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feff812ff20 0x7feff809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:48.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.973+0000 7fefffb82700 1 --2- 172.21.15.26:0/176044168 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7feff8130a40 0x7feff809c9c0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:48.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.973+0000 7fefffb82700 1 -- 172.21.15.26:0/176044168 >> 172.21.15.26:0/176044168 conn(0x7feff80a4210 msgr2=0x7feff809e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:48.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.973+0000 7fefffb82700 1 -- 172.21.15.26:0/176044168 shutdown_connections 2023-10-01T08:01:48.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:48.973+0000 7fefffb82700 1 -- 172.21.15.26:0/176044168 wait complete. 2023-10-01T08:01:48.988 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:49.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.005+0000 7f50b1ad8700 1 -- 172.21.15.26:0/3518272242 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f50ac1395e0 con 0x7f50ac09e000 2023-10-01T08:01:49.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.006+0000 7f5093fff700 1 -- 172.21.15.26:0/3518272242 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f50a0021070 con 0x7f50ac09e000 2023-10-01T08:01:49.006 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:49.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.008+0000 7f50b1ad8700 1 -- 172.21.15.26:0/3518272242 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f50ac09e000 msgr2=0x7f50ac137a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:49.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.008+0000 7f50b1ad8700 1 --2- 172.21.15.26:0/3518272242 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f50ac09e000 0x7f50ac137a50 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f50a000ebb0 tx=0x7f50a000eec0 comp rx=0 tx=0).stop 2023-10-01T08:01:49.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.008+0000 7f50b1ad8700 1 -- 172.21.15.26:0/3518272242 shutdown_connections 2023-10-01T08:01:49.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.008+0000 7f50b1ad8700 1 --2- 172.21.15.26:0/3518272242 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50ac09e410 0x7f50ac137f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:49.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.008+0000 7f50b1ad8700 1 --2- 172.21.15.26:0/3518272242 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f50ac09d6f0 0x7f50ac137510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:49.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.008+0000 7f50b1ad8700 1 --2- 172.21.15.26:0/3518272242 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f50ac09e000 0x7f50ac137a50 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:49.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.008+0000 7f50b1ad8700 1 -- 172.21.15.26:0/3518272242 >> 172.21.15.26:0/3518272242 conn(0x7f50ac066f50 msgr2=0x7f50ac06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:49.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.008+0000 7f50b1ad8700 1 -- 172.21.15.26:0/3518272242 shutdown_connections 2023-10-01T08:01:49.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.008+0000 7f50b1ad8700 1 -- 172.21.15.26:0/3518272242 wait complete. 2023-10-01T08:01:49.023 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:49.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.099+0000 7f6b488be700 1 Processor -- start 2023-10-01T08:01:49.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.099+0000 7f6b488be700 1 -- start start 2023-10-01T08:01:49.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.100+0000 7f6b488be700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b4409d6f0 0x7f6b4409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:49.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.100+0000 7f6b488be700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b4409e410 0x7f6b44130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:49.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.100+0000 7f6b488be700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b4409f130 con 0x7f6b4409e000 2023-10-01T08:01:49.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.100+0000 7f6b488be700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4409f520 con 0x7f6b4409d6f0 2023-10-01T08:01:49.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.100+0000 7f6b488be700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4409e930 con 0x7f6b4409e410 2023-10-01T08:01:49.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.100+0000 7f6b4259c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b4409d6f0 0x7f6b4409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:49.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.100+0000 7f6b41d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6b4409e000 0x7f6b44130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39584/0 (socket says 172.21.15.26:39584) 2023-10-01T08:01:49.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.100+0000 7f6b41d9b700 1 -- 172.21.15.26:0/449856959 learned_addr learned my addr 172.21.15.26:0/449856959 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-10-01T08:01:49.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.100+0000 7f6b42d9d700 1 --2- 172.21.15.26:0/449856959 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b4409e410 0x7f6b44130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:49.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.100+0000 7f6b4259c700 1 -- 172.21.15.26:0/449856959 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b4409e410 msgr2=0x7f6b44130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:49.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.100+0000 7f6b4259c700 1 --2- 172.21.15.26:0/449856959 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b4409e410 0x7f6b44130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:49.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.100+0000 7f6b4259c700 1 -- 172.21.15.26:0/449856959 >> v1:172.21.15.26:6789/0 conn(0x7f6b4409e000 legacy=0x7f6b44130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:49.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.100+0000 7f6b4159a700 1 -- 172.21.15.26:0/449856959 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3686413285 0 0) 0x7f6b4409f130 con 0x7f6b4409e000 2023-10-01T08:01:49.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.100+0000 7f6b4259c700 1 -- 172.21.15.26:0/449856959 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4409b2d0 con 0x7f6b4409d6f0 2023-10-01T08:01:49.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.100+0000 7f6b42d9d700 1 --2- 172.21.15.26:0/449856959 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b4409e410 0x7f6b44130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:49.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.100+0000 7f6b4259c700 1 --2- 172.21.15.26:0/449856959 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b4409d6f0 0x7f6b4409dac0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f6b34009870 tx=0x7f6b34009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d235c1a0c5a2c3a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:49.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.100+0000 7f6b4159a700 1 -- 172.21.15.26:0/449856959 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3400f8a0 con 0x7f6b4409d6f0 2023-10-01T08:01:49.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.101+0000 7f6b4159a700 1 -- 172.21.15.26:0/449856959 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3400fa00 con 0x7f6b4409d6f0 2023-10-01T08:01:49.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.101+0000 7f6b4159a700 1 -- 172.21.15.26:0/449856959 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3400fd90 con 0x7f6b4409d6f0 2023-10-01T08:01:49.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.101+0000 7f6b488be700 1 -- 172.21.15.26:0/449856959 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b4409d6f0 msgr2=0x7f6b4409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:49.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.101+0000 7f6b488be700 1 --2- 172.21.15.26:0/449856959 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b4409d6f0 0x7f6b4409dac0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f6b34009870 tx=0x7f6b34009b80 comp rx=0 tx=0).stop 2023-10-01T08:01:49.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.101+0000 7f6b488be700 1 -- 172.21.15.26:0/449856959 shutdown_connections 2023-10-01T08:01:49.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.101+0000 7f6b488be700 1 --2- 172.21.15.26:0/449856959 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b4409e410 0x7f6b44130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:49.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.101+0000 7f6b488be700 1 --2- 172.21.15.26:0/449856959 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b4409d6f0 0x7f6b4409dac0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:49.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.101+0000 7f6b488be700 1 -- 172.21.15.26:0/449856959 >> 172.21.15.26:0/449856959 conn(0x7f6b44066f50 msgr2=0x7f6b4409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:49.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.101+0000 7f6b488be700 1 -- 172.21.15.26:0/449856959 shutdown_connections 2023-10-01T08:01:49.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.101+0000 7f6b488be700 1 -- 172.21.15.26:0/449856959 wait complete. 2023-10-01T08:01:49.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.102+0000 7f6b488be700 1 Processor -- start 2023-10-01T08:01:49.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.102+0000 7f6b488be700 1 -- start start 2023-10-01T08:01:49.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.103+0000 7f6b488be700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b4409d6f0 0x7f6b4411de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:49.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.103+0000 7f6b488be700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b4409e000 0x7f6b4411e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:49.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.103+0000 7f6b488be700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b4409e410 0x7f6b4411e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:49.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.103+0000 7f6b488be700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4411fa90 con 0x7f6b4409d6f0 2023-10-01T08:01:49.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.103+0000 7f6b488be700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b44120ce0 con 0x7f6b4409e000 2023-10-01T08:01:49.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.103+0000 7f6b488be700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b44120070 con 0x7f6b4409e410 2023-10-01T08:01:49.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.103+0000 7f6b4259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b4409d6f0 0x7f6b4411de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:49.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.103+0000 7f6b41d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b4409e000 0x7f6b4411e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:49.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.103+0000 7f6b42d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b4409e410 0x7f6b4411e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:49.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.103+0000 7f6b4259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b4409d6f0 0x7f6b4411de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55918/0 (socket says 172.21.15.26:55918) 2023-10-01T08:01:49.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.103+0000 7f6b42d9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b4409e410 0x7f6b4411e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49596/0 (socket says 172.21.15.26:49596) 2023-10-01T08:01:49.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.103+0000 7f6b41d9b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b4409e000 0x7f6b4411e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35618/0 (socket says 172.21.15.26:35618) 2023-10-01T08:01:49.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.103+0000 7f6b4259c700 1 -- 172.21.15.26:0/4012354893 learned_addr learned my addr 172.21.15.26:0/4012354893 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:49.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.103+0000 7f6b4259c700 1 -- 172.21.15.26:0/4012354893 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b4409e410 msgr2=0x7f6b4411e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:49.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.103+0000 7f6b4259c700 1 --2- 172.21.15.26:0/4012354893 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b4409e410 0x7f6b4411e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:49.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.103+0000 7f6b4259c700 1 -- 172.21.15.26:0/4012354893 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b4409e000 msgr2=0x7f6b4411e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:49.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.103+0000 7f6b4259c700 1 --2- 172.21.15.26:0/4012354893 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b4409e000 0x7f6b4411e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:49.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.103+0000 7f6b4259c700 1 -- 172.21.15.26:0/4012354893 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b3c009a70 con 0x7f6b4409d6f0 2023-10-01T08:01:49.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.103+0000 7f6b42d9d700 1 --2- 172.21.15.26:0/4012354893 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b4409e410 0x7f6b4411e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:49.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.104+0000 7f6b4259c700 1 --2- 172.21.15.26:0/4012354893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b4409d6f0 0x7f6b4411de80 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f6b34009840 tx=0x7f6b34004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:49.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.104+0000 7f6b3affd700 1 -- 172.21.15.26:0/4012354893 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b340038a0 con 0x7f6b4409d6f0 2023-10-01T08:01:49.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.104+0000 7f6b3affd700 1 -- 172.21.15.26:0/4012354893 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b34003a00 con 0x7f6b4409d6f0 2023-10-01T08:01:49.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.104+0000 7f6b488be700 1 -- 172.21.15.26:0/4012354893 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b340094a0 con 0x7f6b4409d6f0 2023-10-01T08:01:49.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.104+0000 7f6b3affd700 1 -- 172.21.15.26:0/4012354893 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b34003db0 con 0x7f6b4409d6f0 2023-10-01T08:01:49.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.104+0000 7f6b488be700 1 -- 172.21.15.26:0/4012354893 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b44121190 con 0x7f6b4409d6f0 2023-10-01T08:01:49.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.105+0000 7f6b3affd700 1 -- 172.21.15.26:0/4012354893 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6b3402c430 con 0x7f6b4409d6f0 2023-10-01T08:01:49.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.105+0000 7f6b3affd700 1 -- 172.21.15.26:0/4012354893 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6b340408a0 con 0x7f6b4409d6f0 2023-10-01T08:01:49.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.105+0000 7f6b488be700 1 -- 172.21.15.26:0/4012354893 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b4409c760 con 0x7f6b4409d6f0 2023-10-01T08:01:49.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.110+0000 7f6b3affd700 1 -- 172.21.15.26:0/4012354893 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6b340178f0 con 0x7f6b4409d6f0 2023-10-01T08:01:49.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.320+0000 7f6b488be700 1 -- 172.21.15.26:0/4012354893 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6b44121130 con 0x7f6b4409d6f0 2023-10-01T08:01:49.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.320+0000 7f6b3affd700 1 -- 172.21.15.26:0/4012354893 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6b340223a0 con 0x7f6b4409d6f0 2023-10-01T08:01:49.321 INFO:teuthology.orchestra.run.smithi026.stdout:137438953474 2023-10-01T08:01:49.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.323+0000 7f6b488be700 1 -- 172.21.15.26:0/4012354893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b4409d6f0 msgr2=0x7f6b4411de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:49.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.323+0000 7f6b488be700 1 --2- 172.21.15.26:0/4012354893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b4409d6f0 0x7f6b4411de80 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f6b34009840 tx=0x7f6b34004750 comp rx=0 tx=0).stop 2023-10-01T08:01:49.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.323+0000 7f6b488be700 1 -- 172.21.15.26:0/4012354893 shutdown_connections 2023-10-01T08:01:49.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.323+0000 7f6b488be700 1 --2- 172.21.15.26:0/4012354893 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f6b4409e410 0x7f6b4411e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:49.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.323+0000 7f6b488be700 1 --2- 172.21.15.26:0/4012354893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b4409d6f0 0x7f6b4411de80 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:49.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.323+0000 7f6b488be700 1 --2- 172.21.15.26:0/4012354893 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6b4409e000 0x7f6b4411e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:49.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.323+0000 7f6b488be700 1 -- 172.21.15.26:0/4012354893 >> 172.21.15.26:0/4012354893 conn(0x7f6b44066f50 msgr2=0x7f6b44070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:49.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.323+0000 7f6b488be700 1 -- 172.21.15.26:0/4012354893 shutdown_connections 2023-10-01T08:01:49.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:49.323+0000 7f6b488be700 1 -- 172.21.15.26:0/4012354893 wait complete. 2023-10-01T08:01:49.337 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-10-01T08:01:49.921 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:49.989 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:50.023 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:50.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.069+0000 7f9d81e90700 1 Processor -- start 2023-10-01T08:01:50.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.069+0000 7f9d81e90700 1 -- start start 2023-10-01T08:01:50.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.070+0000 7f9d81e90700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d7c1338a0 0x7f9d7c133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:50.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.070+0000 7f9d81e90700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9d7c09de50 0x7f9d7c09e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:50.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.070+0000 7f9d81e90700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d7c06ef30 con 0x7f9d7c09e760 2023-10-01T08:01:50.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.070+0000 7f9d81e90700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d7c06fef0 con 0x7f9d7c09de50 2023-10-01T08:01:50.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.070+0000 7f9d81e90700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c1334b0 con 0x7f9d7c1338a0 2023-10-01T08:01:50.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.070+0000 7f9d7b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d7c1338a0 0x7f9d7c133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:50.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.070+0000 7f9d7affd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9d7c09de50 0x7f9d7c09e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:50.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.070+0000 7f9d7affd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9d7c09de50 0x7f9d7c09e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55928/0 (socket says 172.21.15.26:55928) 2023-10-01T08:01:50.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.070+0000 7f9d7b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d7c1338a0 0x7f9d7c133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49610/0 (socket says 172.21.15.26:49610) 2023-10-01T08:01:50.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.070+0000 7f9d7affd700 1 -- 172.21.15.26:0/492215376 learned_addr learned my addr 172.21.15.26:0/492215376 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:50.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.070+0000 7f9d7affd700 1 -- 172.21.15.26:0/492215376 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d7c1338a0 msgr2=0x7f9d7c133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:50.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.070+0000 7f9d7affd700 1 --2- 172.21.15.26:0/492215376 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d7c1338a0 0x7f9d7c133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:50.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.070+0000 7f9d7affd700 1 -- 172.21.15.26:0/492215376 >> v1:172.21.15.26:6789/0 conn(0x7f9d7c09e760 legacy=0x7f9d7c13a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:50.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.070+0000 7f9d7affd700 1 -- 172.21.15.26:0/492215376 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7c06fc30 con 0x7f9d7c09de50 2023-10-01T08:01:50.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.071+0000 7f9d7affd700 1 --2- 172.21.15.26:0/492215376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d7c09de50 0x7f9d7c09e220 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f9d700098f0 tx=0x7f9d70009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74c3b94868656879 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:50.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.071+0000 7f9d7a7fc700 1 -- 172.21.15.26:0/492215376 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d70011830 con 0x7f9d7c09de50 2023-10-01T08:01:50.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.071+0000 7f9d7a7fc700 1 -- 172.21.15.26:0/492215376 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d70011990 con 0x7f9d7c09de50 2023-10-01T08:01:50.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.071+0000 7f9d7a7fc700 1 -- 172.21.15.26:0/492215376 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d70011d20 con 0x7f9d7c09de50 2023-10-01T08:01:50.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.071+0000 7f9d81e90700 1 -- 172.21.15.26:0/492215376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d7c09de50 msgr2=0x7f9d7c09e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:50.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.071+0000 7f9d81e90700 1 --2- 172.21.15.26:0/492215376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d7c09de50 0x7f9d7c09e220 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f9d700098f0 tx=0x7f9d70009c00 comp rx=0 tx=0).stop 2023-10-01T08:01:50.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.071+0000 7f9d81e90700 1 -- 172.21.15.26:0/492215376 shutdown_connections 2023-10-01T08:01:50.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.071+0000 7f9d81e90700 1 --2- 172.21.15.26:0/492215376 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d7c1338a0 0x7f9d7c133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:50.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.071+0000 7f9d81e90700 1 --2- 172.21.15.26:0/492215376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d7c09de50 0x7f9d7c09e220 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:50.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.071+0000 7f9d81e90700 1 -- 172.21.15.26:0/492215376 >> 172.21.15.26:0/492215376 conn(0x7f9d7c0a2aa0 msgr2=0x7f9d7c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:50.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.072+0000 7f9d81e90700 1 -- 172.21.15.26:0/492215376 shutdown_connections 2023-10-01T08:01:50.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.072+0000 7f9d81e90700 1 -- 172.21.15.26:0/492215376 wait complete. 2023-10-01T08:01:50.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.073+0000 7f9d81e90700 1 Processor -- start 2023-10-01T08:01:50.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.073+0000 7f9d81e90700 1 -- start start 2023-10-01T08:01:50.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.074+0000 7f9d81e90700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d7c09de50 0x7f9d7c11eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:50.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.074+0000 7f9d81e90700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d7c09e760 0x7f9d7c11f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:50.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.074+0000 7f9d81e90700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d7c1338a0 0x7f9d7c11f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:50.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.074+0000 7f9d81e90700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c11ffd0 con 0x7f9d7c1338a0 2023-10-01T08:01:50.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.074+0000 7f9d81e90700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c12f660 con 0x7f9d7c09e760 2023-10-01T08:01:50.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.074+0000 7f9d81e90700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c122050 con 0x7f9d7c09de50 2023-10-01T08:01:50.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.074+0000 7f9d7affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d7c09e760 0x7f9d7c11f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:50.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.074+0000 7f9d7bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d7c1338a0 0x7f9d7c11f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:50.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.074+0000 7f9d7affd700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d7c09e760 0x7f9d7c11f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35624/0 (socket says 172.21.15.26:35624) 2023-10-01T08:01:50.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.074+0000 7f9d7affd700 1 -- 172.21.15.26:0/1084508149 learned_addr learned my addr 172.21.15.26:0/1084508149 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:50.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.074+0000 7f9d7b7fe700 1 --2- 172.21.15.26:0/1084508149 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d7c09de50 0x7f9d7c11eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:50.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.074+0000 7f9d7affd700 1 -- 172.21.15.26:0/1084508149 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d7c09de50 msgr2=0x7f9d7c11eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:50.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.074+0000 7f9d7affd700 1 --2- 172.21.15.26:0/1084508149 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d7c09de50 0x7f9d7c11eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:50.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.074+0000 7f9d7affd700 1 -- 172.21.15.26:0/1084508149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d7c1338a0 msgr2=0x7f9d7c11f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:50.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.074+0000 7f9d7affd700 1 --2- 172.21.15.26:0/1084508149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d7c1338a0 0x7f9d7c11f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:50.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.074+0000 7f9d7affd700 1 -- 172.21.15.26:0/1084508149 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d70009550 con 0x7f9d7c09e760 2023-10-01T08:01:50.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.074+0000 7f9d7bfff700 1 --2- 172.21.15.26:0/1084508149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d7c1338a0 0x7f9d7c11f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:50.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.074+0000 7f9d7affd700 1 --2- 172.21.15.26:0/1084508149 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d7c09e760 0x7f9d7c11f0b0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f9d70009c40 tx=0x7f9d70004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:50.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.075+0000 7f9d63fff700 1 -- 172.21.15.26:0/1084508149 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d70004510 con 0x7f9d7c09e760 2023-10-01T08:01:50.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.075+0000 7f9d63fff700 1 -- 172.21.15.26:0/1084508149 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7001e070 con 0x7f9d7c09e760 2023-10-01T08:01:50.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.075+0000 7f9d81e90700 1 -- 172.21.15.26:0/1084508149 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d7c1225f0 con 0x7f9d7c09e760 2023-10-01T08:01:50.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.075+0000 7f9d63fff700 1 -- 172.21.15.26:0/1084508149 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d700038e0 con 0x7f9d7c09e760 2023-10-01T08:01:50.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.075+0000 7f9d81e90700 1 -- 172.21.15.26:0/1084508149 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d7c06f640 con 0x7f9d7c09e760 2023-10-01T08:01:50.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.076+0000 7f9d63fff700 1 -- 172.21.15.26:0/1084508149 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d70003a40 con 0x7f9d7c09e760 2023-10-01T08:01:50.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.076+0000 7f9d63fff700 1 -- 172.21.15.26:0/1084508149 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9d70040500 con 0x7f9d7c09e760 2023-10-01T08:01:50.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.076+0000 7f9d81e90700 1 -- 172.21.15.26:0/1084508149 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d7c134130 con 0x7f9d7c09e760 2023-10-01T08:01:50.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.081+0000 7f9d63fff700 1 -- 172.21.15.26:0/1084508149 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d7002d7d0 con 0x7f9d7c09e760 2023-10-01T08:01:50.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.143+0000 7fa41d6fe700 1 Processor -- start 2023-10-01T08:01:50.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.144+0000 7fa41d6fe700 1 -- start start 2023-10-01T08:01:50.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.144+0000 7fa41d6fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa41809d6f0 0x7fa41809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:50.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.144+0000 7fa41d6fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa41809e000 0x7fa418130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:50.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.144+0000 7fa41d6fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa41809e410 0x7fa418130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:50.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.144+0000 7fa41d6fe700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa41809f520 con 0x7fa41809d6f0 2023-10-01T08:01:50.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.144+0000 7fa41d6fe700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa41809f130 con 0x7fa41809e000 2023-10-01T08:01:50.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.144+0000 7fa41d6fe700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa41809e930 con 0x7fa41809e410 2023-10-01T08:01:50.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.144+0000 7fa4167fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa41809e000 0x7fa418130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:50.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.144+0000 7fa4167fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa41809e000 0x7fa418130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35634/0 (socket says 172.21.15.26:35634) 2023-10-01T08:01:50.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.144+0000 7fa4167fc700 1 -- 172.21.15.26:0/3395004224 learned_addr learned my addr 172.21.15.26:0/3395004224 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:50.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.144+0000 7fa4177fe700 1 --2- 172.21.15.26:0/3395004224 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa41809e410 0x7fa418130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:50.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.144+0000 7fa416ffd700 1 --2- 172.21.15.26:0/3395004224 >> v2:172.21.15.26:3300/0 conn(0x7fa41809d6f0 0x7fa41809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:50.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.145+0000 7fa4167fc700 1 -- 172.21.15.26:0/3395004224 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa41809e410 msgr2=0x7fa418130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:50.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.145+0000 7fa4167fc700 1 --2- 172.21.15.26:0/3395004224 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa41809e410 0x7fa418130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:50.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.145+0000 7fa4167fc700 1 -- 172.21.15.26:0/3395004224 >> v2:172.21.15.26:3300/0 conn(0x7fa41809d6f0 msgr2=0x7fa41809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:50.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.145+0000 7fa4167fc700 1 --2- 172.21.15.26:0/3395004224 >> v2:172.21.15.26:3300/0 conn(0x7fa41809d6f0 0x7fa41809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:50.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.145+0000 7fa4167fc700 1 -- 172.21.15.26:0/3395004224 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa41809b2d0 con 0x7fa41809e000 2023-10-01T08:01:50.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.145+0000 7fa4167fc700 1 --2- 172.21.15.26:0/3395004224 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa41809e000 0x7fa418130660 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fa40c0098f0 tx=0x7fa40c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d3388414fa1543a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:50.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.145+0000 7fa415ffb700 1 -- 172.21.15.26:0/3395004224 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40c011830 con 0x7fa41809e000 2023-10-01T08:01:50.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.145+0000 7fa415ffb700 1 -- 172.21.15.26:0/3395004224 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa40c011990 con 0x7fa41809e000 2023-10-01T08:01:50.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.145+0000 7fa415ffb700 1 -- 172.21.15.26:0/3395004224 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40c011d20 con 0x7fa41809e000 2023-10-01T08:01:50.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.146+0000 7fa41d6fe700 1 -- 172.21.15.26:0/3395004224 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa41809e000 msgr2=0x7fa418130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:50.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.146+0000 7fa41d6fe700 1 --2- 172.21.15.26:0/3395004224 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa41809e000 0x7fa418130660 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fa40c0098f0 tx=0x7fa40c009c00 comp rx=0 tx=0).stop 2023-10-01T08:01:50.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.146+0000 7fa41d6fe700 1 -- 172.21.15.26:0/3395004224 shutdown_connections 2023-10-01T08:01:50.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.146+0000 7fa41d6fe700 1 --2- 172.21.15.26:0/3395004224 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa41809e410 0x7fa418130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:50.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.146+0000 7fa41d6fe700 1 --2- 172.21.15.26:0/3395004224 >> v2:172.21.15.26:3300/0 conn(0x7fa41809d6f0 0x7fa41809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:50.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.146+0000 7fa41d6fe700 1 --2- 172.21.15.26:0/3395004224 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa41809e000 0x7fa418130660 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:50.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.146+0000 7fa41d6fe700 1 -- 172.21.15.26:0/3395004224 >> 172.21.15.26:0/3395004224 conn(0x7fa418066f50 msgr2=0x7fa41809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:50.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.146+0000 7fa41d6fe700 1 -- 172.21.15.26:0/3395004224 shutdown_connections 2023-10-01T08:01:50.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.146+0000 7fa41d6fe700 1 -- 172.21.15.26:0/3395004224 wait complete. 2023-10-01T08:01:50.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.147+0000 7fa41d6fe700 1 Processor -- start 2023-10-01T08:01:50.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.147+0000 7fa41d6fe700 1 -- start start 2023-10-01T08:01:50.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.148+0000 7fa41d6fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa41809d6f0 0x7fa4181225d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:50.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.148+0000 7fa41d6fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa41809e000 0x7fa418122b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:50.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.148+0000 7fa41d6fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa41809e410 0x7fa418123050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:50.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.148+0000 7fa41d6fe700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa418125b50 con 0x7fa41809d6f0 2023-10-01T08:01:50.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.148+0000 7fa41d6fe700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa418125ef0 con 0x7fa41809e000 2023-10-01T08:01:50.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.148+0000 7fa41d6fe700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4181260f0 con 0x7fa41809e410 2023-10-01T08:01:50.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.148+0000 7fa4167fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa41809e000 0x7fa418122b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:50.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.148+0000 7fa4167fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa41809e000 0x7fa418122b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35642/0 (socket says 172.21.15.26:35642) 2023-10-01T08:01:50.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.148+0000 7fa4167fc700 1 -- 172.21.15.26:0/1039760444 learned_addr learned my addr 172.21.15.26:0/1039760444 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:50.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.148+0000 7fa416ffd700 1 --2- 172.21.15.26:0/1039760444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa41809d6f0 0x7fa4181225d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:50.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.148+0000 7fa4177fe700 1 --2- 172.21.15.26:0/1039760444 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa41809e410 0x7fa418123050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:50.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.148+0000 7fa4167fc700 1 -- 172.21.15.26:0/1039760444 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa41809e410 msgr2=0x7fa418123050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:50.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.148+0000 7fa4167fc700 1 --2- 172.21.15.26:0/1039760444 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa41809e410 0x7fa418123050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:50.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.148+0000 7fa4167fc700 1 -- 172.21.15.26:0/1039760444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa41809d6f0 msgr2=0x7fa4181225d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:50.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.148+0000 7fa4167fc700 1 --2- 172.21.15.26:0/1039760444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa41809d6f0 0x7fa4181225d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:50.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.148+0000 7fa4167fc700 1 -- 172.21.15.26:0/1039760444 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa40c009550 con 0x7fa41809e000 2023-10-01T08:01:50.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.149+0000 7fa4167fc700 1 --2- 172.21.15.26:0/1039760444 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa41809e000 0x7fa418122b10 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fa40c011db0 tx=0x7fa40c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:50.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.149+0000 7fa3ff7fe700 1 -- 172.21.15.26:0/1039760444 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40c004240 con 0x7fa41809e000 2023-10-01T08:01:50.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.149+0000 7fa3ff7fe700 1 -- 172.21.15.26:0/1039760444 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa40c01f070 con 0x7fa41809e000 2023-10-01T08:01:50.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.149+0000 7fa41d6fe700 1 -- 172.21.15.26:0/1039760444 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa418130940 con 0x7fa41809e000 2023-10-01T08:01:50.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.149+0000 7fa3ff7fe700 1 -- 172.21.15.26:0/1039760444 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40c0045a0 con 0x7fa41809e000 2023-10-01T08:01:50.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.149+0000 7fa41d6fe700 1 -- 172.21.15.26:0/1039760444 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa418124990 con 0x7fa41809e000 2023-10-01T08:01:50.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.150+0000 7fa3ff7fe700 1 -- 172.21.15.26:0/1039760444 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa40c021030 con 0x7fa41809e000 2023-10-01T08:01:50.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.150+0000 7fa41d6fe700 1 -- 172.21.15.26:0/1039760444 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4181304f0 con 0x7fa41809e000 2023-10-01T08:01:50.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.150+0000 7fa3ff7fe700 1 -- 172.21.15.26:0/1039760444 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa40c040710 con 0x7fa41809e000 2023-10-01T08:01:50.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.155+0000 7fa3ff7fe700 1 -- 172.21.15.26:0/1039760444 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa40c0036a0 con 0x7fa41809e000 2023-10-01T08:01:50.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.183+0000 7fb6c3f2b700 1 Processor -- start 2023-10-01T08:01:50.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.184+0000 7fb6c3f2b700 1 -- start start 2023-10-01T08:01:50.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.184+0000 7fb6c3f2b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb6bc0a1510 0x7fb6bc138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:50.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.184+0000 7fb6c3f2b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb6bc139250 0x7fb6bc13b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:50.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.184+0000 7fb6c3f2b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6bc09edd0 con 0x7fb6bc0a0a30 2023-10-01T08:01:50.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.184+0000 7fb6c3f2b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6bc0a18e0 con 0x7fb6bc139250 2023-10-01T08:01:50.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.184+0000 7fb6c3f2b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc09e1f0 con 0x7fb6bc0a1510 2023-10-01T08:01:50.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.184+0000 7fb6c14c6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb6bc0a1510 0x7fb6bc138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:50.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.184+0000 7fb6c14c6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb6bc0a1510 0x7fb6bc138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35658/0 (socket says 172.21.15.26:35658) 2023-10-01T08:01:50.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.184+0000 7fb6c14c6700 1 -- 172.21.15.26:0/3129107784 learned_addr learned my addr 172.21.15.26:0/3129107784 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:50.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.184+0000 7fb6c24c8700 1 --2- 172.21.15.26:0/3129107784 >> v2:172.21.15.26:3300/0 conn(0x7fb6bc139250 0x7fb6bc13b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:50.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.185+0000 7fb6c14c6700 1 -- 172.21.15.26:0/3129107784 >> v2:172.21.15.26:3300/0 conn(0x7fb6bc139250 msgr2=0x7fb6bc13b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:50.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.185+0000 7fb6c14c6700 1 --2- 172.21.15.26:0/3129107784 >> v2:172.21.15.26:3300/0 conn(0x7fb6bc139250 0x7fb6bc13b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:50.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.185+0000 7fb6c14c6700 1 -- 172.21.15.26:0/3129107784 >> v1:172.21.15.26:6789/0 conn(0x7fb6bc0a0a30 legacy=0x7fb6bc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:50.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.185+0000 7fb6c14c6700 1 -- 172.21.15.26:0/3129107784 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6bc09dc50 con 0x7fb6bc0a1510 2023-10-01T08:01:50.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.185+0000 7fb6c14c6700 1 --2- 172.21.15.26:0/3129107784 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb6bc0a1510 0x7fb6bc138d10 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac009920 tx=0x7fb6ac009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99d8881a463f5083 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:50.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.185+0000 7fb6c0cc5700 1 -- 172.21.15.26:0/3129107784 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac011830 con 0x7fb6bc0a1510 2023-10-01T08:01:50.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.185+0000 7fb6c0cc5700 1 -- 172.21.15.26:0/3129107784 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ac011990 con 0x7fb6bc0a1510 2023-10-01T08:01:50.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.185+0000 7fb6c0cc5700 1 -- 172.21.15.26:0/3129107784 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac011d20 con 0x7fb6bc0a1510 2023-10-01T08:01:50.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.186+0000 7fb6c3f2b700 1 -- 172.21.15.26:0/3129107784 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb6bc0a1510 msgr2=0x7fb6bc138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:50.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.186+0000 7fb6c3f2b700 1 --2- 172.21.15.26:0/3129107784 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb6bc0a1510 0x7fb6bc138d10 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac009920 tx=0x7fb6ac009c30 comp rx=0 tx=0).stop 2023-10-01T08:01:50.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.186+0000 7fb6c3f2b700 1 -- 172.21.15.26:0/3129107784 shutdown_connections 2023-10-01T08:01:50.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.186+0000 7fb6c3f2b700 1 --2- 172.21.15.26:0/3129107784 >> v2:172.21.15.26:3300/0 conn(0x7fb6bc139250 0x7fb6bc13b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:50.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.186+0000 7fb6c3f2b700 1 --2- 172.21.15.26:0/3129107784 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb6bc0a1510 0x7fb6bc138d10 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:50.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.186+0000 7fb6c3f2b700 1 -- 172.21.15.26:0/3129107784 >> 172.21.15.26:0/3129107784 conn(0x7fb6bc0a6550 msgr2=0x7fb6bc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:50.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.186+0000 7fb6c3f2b700 1 -- 172.21.15.26:0/3129107784 shutdown_connections 2023-10-01T08:01:50.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.186+0000 7fb6c3f2b700 1 -- 172.21.15.26:0/3129107784 wait complete. 2023-10-01T08:01:50.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.187+0000 7fb6c3f2b700 1 Processor -- start 2023-10-01T08:01:50.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.187+0000 7fb6c3f2b700 1 -- start start 2023-10-01T08:01:50.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.187+0000 7fb6c3f2b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb6bc0a0a30 0x7fb6bc1218c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:50.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.187+0000 7fb6c3f2b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb6bc0a1510 0x7fb6bc121e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:50.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.187+0000 7fb6c3f2b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6bc139250 0x7fb6bc122340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:50.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.187+0000 7fb6c3f2b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc1236c0 con 0x7fb6bc139250 2023-10-01T08:01:50.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.187+0000 7fb6c3f2b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc1234d0 con 0x7fb6bc0a1510 2023-10-01T08:01:50.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.187+0000 7fb6c3f2b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc1253e0 con 0x7fb6bc0a0a30 2023-10-01T08:01:50.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.188+0000 7fb6c14c6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb6bc0a1510 0x7fb6bc121e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:50.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.188+0000 7fb6c24c8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6bc139250 0x7fb6bc122340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:50.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.188+0000 7fb6c14c6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb6bc0a1510 0x7fb6bc121e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35664/0 (socket says 172.21.15.26:35664) 2023-10-01T08:01:50.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.188+0000 7fb6c14c6700 1 -- 172.21.15.26:0/2197024352 learned_addr learned my addr 172.21.15.26:0/2197024352 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:50.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.188+0000 7fb6c24c8700 1 -- 172.21.15.26:0/2197024352 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb6bc0a0a30 msgr2=0x7fb6bc1218c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:50.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.188+0000 7fb6c24c8700 1 --2- 172.21.15.26:0/2197024352 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb6bc0a0a30 0x7fb6bc1218c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:50.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.188+0000 7fb6c24c8700 1 -- 172.21.15.26:0/2197024352 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb6bc0a1510 msgr2=0x7fb6bc121e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:50.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.188+0000 7fb6c24c8700 1 --2- 172.21.15.26:0/2197024352 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb6bc0a1510 0x7fb6bc121e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:50.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.188+0000 7fb6c24c8700 1 -- 172.21.15.26:0/2197024352 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ac009550 con 0x7fb6bc139250 2023-10-01T08:01:50.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.188+0000 7fb6c14c6700 1 --2- 172.21.15.26:0/2197024352 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb6bc0a1510 0x7fb6bc121e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:50.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.188+0000 7fb6c24c8700 1 --2- 172.21.15.26:0/2197024352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6bc139250 0x7fb6bc122340 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc0a23f0 tx=0x7fb6b400eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:50.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.188+0000 7fb6b27fc700 1 -- 172.21.15.26:0/2197024352 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4013680 con 0x7fb6bc139250 2023-10-01T08:01:50.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.188+0000 7fb6b27fc700 1 -- 172.21.15.26:0/2197024352 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b40137e0 con 0x7fb6bc139250 2023-10-01T08:01:50.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.188+0000 7fb6c3f2b700 1 -- 172.21.15.26:0/2197024352 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6bc138bd0 con 0x7fb6bc139250 2023-10-01T08:01:50.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.188+0000 7fb6b27fc700 1 -- 172.21.15.26:0/2197024352 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4013b90 con 0x7fb6bc139250 2023-10-01T08:01:50.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.188+0000 7fb6c3f2b700 1 -- 172.21.15.26:0/2197024352 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6bc123cc0 con 0x7fb6bc139250 2023-10-01T08:01:50.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.189+0000 7fb6b27fc700 1 -- 172.21.15.26:0/2197024352 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb6b4013cf0 con 0x7fb6bc139250 2023-10-01T08:01:50.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.189+0000 7fb6b27fc700 1 -- 172.21.15.26:0/2197024352 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb6b403f7e0 con 0x7fb6bc139250 2023-10-01T08:01:50.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.189+0000 7fb6c3f2b700 1 -- 172.21.15.26:0/2197024352 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6bc074ea0 con 0x7fb6bc139250 2023-10-01T08:01:50.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.194+0000 7fb6b27fc700 1 -- 172.21.15.26:0/2197024352 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb6b401bdf0 con 0x7fb6bc139250 2023-10-01T08:01:50.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.294+0000 7f9d81e90700 1 -- 172.21.15.26:0/1084508149 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9d7c074ea0 con 0x7f9d7c09e760 2023-10-01T08:01:50.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.295+0000 7f9d63fff700 1 -- 172.21.15.26:0/1084508149 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9d70023ba0 con 0x7f9d7c09e760 2023-10-01T08:01:50.295 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:50.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.297+0000 7f9d81e90700 1 -- 172.21.15.26:0/1084508149 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d7c09e760 msgr2=0x7f9d7c11f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:50.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.297+0000 7f9d81e90700 1 --2- 172.21.15.26:0/1084508149 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d7c09e760 0x7f9d7c11f0b0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f9d70009c40 tx=0x7f9d70004750 comp rx=0 tx=0).stop 2023-10-01T08:01:50.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.297+0000 7f9d81e90700 1 -- 172.21.15.26:0/1084508149 shutdown_connections 2023-10-01T08:01:50.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.297+0000 7f9d81e90700 1 --2- 172.21.15.26:0/1084508149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d7c1338a0 0x7f9d7c11f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:50.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.297+0000 7f9d81e90700 1 --2- 172.21.15.26:0/1084508149 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f9d7c09de50 0x7f9d7c11eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:50.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.297+0000 7f9d81e90700 1 --2- 172.21.15.26:0/1084508149 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9d7c09e760 0x7f9d7c11f0b0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:50.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.297+0000 7f9d81e90700 1 -- 172.21.15.26:0/1084508149 >> 172.21.15.26:0/1084508149 conn(0x7f9d7c0a2aa0 msgr2=0x7f9d7c09edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:50.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.297+0000 7f9d81e90700 1 -- 172.21.15.26:0/1084508149 shutdown_connections 2023-10-01T08:01:50.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.297+0000 7f9d81e90700 1 -- 172.21.15.26:0/1084508149 wait complete. 2023-10-01T08:01:50.312 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:50.338 INFO:tasks.ceph:ignoring flush pg stats error, probably testing upgrade: timed out waiting for mon to be updated with osd.3: 137438953474 < 137438953475 2023-10-01T08:01:50.339 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-01T08:01:50.339 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-01T08:01:50.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.363+0000 7fa41d6fe700 1 -- 172.21.15.26:0/1039760444 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa418074ea0 con 0x7fa41809e000 2023-10-01T08:01:50.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.364+0000 7fa3ff7fe700 1 -- 172.21.15.26:0/1039760444 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa40c015070 con 0x7fa41809e000 2023-10-01T08:01:50.364 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:50.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.366+0000 7fa41d6fe700 1 -- 172.21.15.26:0/1039760444 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa41809e000 msgr2=0x7fa418122b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:50.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.366+0000 7fa41d6fe700 1 --2- 172.21.15.26:0/1039760444 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa41809e000 0x7fa418122b10 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fa40c011db0 tx=0x7fa40c004750 comp rx=0 tx=0).stop 2023-10-01T08:01:50.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.366+0000 7fa41d6fe700 1 -- 172.21.15.26:0/1039760444 shutdown_connections 2023-10-01T08:01:50.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.366+0000 7fa41d6fe700 1 --2- 172.21.15.26:0/1039760444 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fa41809e410 0x7fa418123050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:50.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.366+0000 7fa41d6fe700 1 --2- 172.21.15.26:0/1039760444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa41809d6f0 0x7fa4181225d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:50.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.366+0000 7fa41d6fe700 1 --2- 172.21.15.26:0/1039760444 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa41809e000 0x7fa418122b10 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:50.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.366+0000 7fa41d6fe700 1 -- 172.21.15.26:0/1039760444 >> 172.21.15.26:0/1039760444 conn(0x7fa418066f50 msgr2=0x7fa4180a1630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:50.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.366+0000 7fa41d6fe700 1 -- 172.21.15.26:0/1039760444 shutdown_connections 2023-10-01T08:01:50.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.366+0000 7fa41d6fe700 1 -- 172.21.15.26:0/1039760444 wait complete. 2023-10-01T08:01:50.381 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:50.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.403+0000 7fb6c3f2b700 1 -- 172.21.15.26:0/2197024352 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb6bc0a28e0 con 0x7fb6bc139250 2023-10-01T08:01:50.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.404+0000 7fb6b27fc700 1 -- 172.21.15.26:0/2197024352 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb6b401b3b0 con 0x7fb6bc139250 2023-10-01T08:01:50.405 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:50.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.406+0000 7fb6c3f2b700 1 -- 172.21.15.26:0/2197024352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6bc139250 msgr2=0x7fb6bc122340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:50.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.406+0000 7fb6c3f2b700 1 --2- 172.21.15.26:0/2197024352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6bc139250 0x7fb6bc122340 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc0a23f0 tx=0x7fb6b400eb30 comp rx=0 tx=0).stop 2023-10-01T08:01:50.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.406+0000 7fb6c3f2b700 1 -- 172.21.15.26:0/2197024352 shutdown_connections 2023-10-01T08:01:50.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.406+0000 7fb6c3f2b700 1 --2- 172.21.15.26:0/2197024352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6bc139250 0x7fb6bc122340 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:50.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.406+0000 7fb6c3f2b700 1 --2- 172.21.15.26:0/2197024352 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb6bc0a0a30 0x7fb6bc1218c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:50.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.406+0000 7fb6c3f2b700 1 --2- 172.21.15.26:0/2197024352 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb6bc0a1510 0x7fb6bc121e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:50.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.406+0000 7fb6c3f2b700 1 -- 172.21.15.26:0/2197024352 >> 172.21.15.26:0/2197024352 conn(0x7fb6bc0a6550 msgr2=0x7fb6bc137b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:50.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.406+0000 7fb6c3f2b700 1 -- 172.21.15.26:0/2197024352 shutdown_connections 2023-10-01T08:01:50.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.407+0000 7fb6c3f2b700 1 -- 172.21.15.26:0/2197024352 wait complete. 2023-10-01T08:01:50.422 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:01:50.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.491+0000 7fd41e79b700 1 Processor -- start 2023-10-01T08:01:50.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.491+0000 7fd41e79b700 1 -- start start 2023-10-01T08:01:50.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.491+0000 7fd41e79b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd418133420 0x7fd4181337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:50.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.491+0000 7fd41e79b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd418133e30 0x7fd41812ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:50.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.491+0000 7fd41e79b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd41806b990 con 0x7fd418134260 2023-10-01T08:01:50.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.491+0000 7fd41e79b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4180a0590 con 0x7fd418133e30 2023-10-01T08:01:50.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.491+0000 7fd41e79b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd41809fb80 con 0x7fd418133420 2023-10-01T08:01:50.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.491+0000 7fd417fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd418133420 0x7fd4181337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:50.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.491+0000 7fd4177fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd418133e30 0x7fd41812ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:50.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.492+0000 7fd417fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd418133420 0x7fd4181337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49662/0 (socket says 172.21.15.26:49662) 2023-10-01T08:01:50.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.492+0000 7fd4177fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd418133e30 0x7fd41812ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55996/0 (socket says 172.21.15.26:55996) 2023-10-01T08:01:50.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.492+0000 7fd417fff700 1 -- 172.21.15.26:0/2160320674 learned_addr learned my addr 172.21.15.26:0/2160320674 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:50.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.492+0000 7fd417fff700 1 -- 172.21.15.26:0/2160320674 >> v2:172.21.15.26:3300/0 conn(0x7fd418133e30 msgr2=0x7fd41812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:50.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.492+0000 7fd417fff700 1 --2- 172.21.15.26:0/2160320674 >> v2:172.21.15.26:3300/0 conn(0x7fd418133e30 0x7fd41812ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:50.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.492+0000 7fd417fff700 1 -- 172.21.15.26:0/2160320674 >> v1:172.21.15.26:6789/0 conn(0x7fd418134260 legacy=0x7fd4181304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:50.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.492+0000 7fd417fff700 1 -- 172.21.15.26:0/2160320674 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4180a0030 con 0x7fd418133420 2023-10-01T08:01:50.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.492+0000 7fd4177fe700 1 --2- 172.21.15.26:0/2160320674 >> v2:172.21.15.26:3300/0 conn(0x7fd418133e30 0x7fd41812ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:50.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.492+0000 7fd417fff700 1 --2- 172.21.15.26:0/2160320674 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd418133420 0x7fd4181337f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fd4080098f0 tx=0x7fd408009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a7c3f0f3c308c65 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:50.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.492+0000 7fd416ffd700 1 -- 172.21.15.26:0/2160320674 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd408011830 con 0x7fd418133420 2023-10-01T08:01:50.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.492+0000 7fd416ffd700 1 -- 172.21.15.26:0/2160320674 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd408011990 con 0x7fd418133420 2023-10-01T08:01:50.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.492+0000 7fd416ffd700 1 -- 172.21.15.26:0/2160320674 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd408011d20 con 0x7fd418133420 2023-10-01T08:01:50.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.493+0000 7fd41e79b700 1 -- 172.21.15.26:0/2160320674 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd418133420 msgr2=0x7fd4181337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:50.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.493+0000 7fd41e79b700 1 --2- 172.21.15.26:0/2160320674 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd418133420 0x7fd4181337f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fd4080098f0 tx=0x7fd408009c00 comp rx=0 tx=0).stop 2023-10-01T08:01:50.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.493+0000 7fd41e79b700 1 -- 172.21.15.26:0/2160320674 shutdown_connections 2023-10-01T08:01:50.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.493+0000 7fd41e79b700 1 --2- 172.21.15.26:0/2160320674 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd418133420 0x7fd4181337f0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:50.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.493+0000 7fd41e79b700 1 --2- 172.21.15.26:0/2160320674 >> v2:172.21.15.26:3300/0 conn(0x7fd418133e30 0x7fd41812ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:50.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.493+0000 7fd41e79b700 1 -- 172.21.15.26:0/2160320674 >> 172.21.15.26:0/2160320674 conn(0x7fd4180a4210 msgr2=0x7fd4180a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:50.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.493+0000 7fd41e79b700 1 -- 172.21.15.26:0/2160320674 shutdown_connections 2023-10-01T08:01:50.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.493+0000 7fd41e79b700 1 -- 172.21.15.26:0/2160320674 wait complete. 2023-10-01T08:01:50.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.494+0000 7fd41e79b700 1 Processor -- start 2023-10-01T08:01:50.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.495+0000 7fd41e79b700 1 -- start start 2023-10-01T08:01:50.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.495+0000 7fd41e79b700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd418133420 0x7fd41809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:50.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.495+0000 7fd41e79b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd418133e30 0x7fd41809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:50.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.495+0000 7fd41e79b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd418134260 0x7fd41809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:50.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.495+0000 7fd41e79b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41809dcd0 con 0x7fd418134260 2023-10-01T08:01:50.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.495+0000 7fd41e79b700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd41811fe90 con 0x7fd418133420 2023-10-01T08:01:50.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.495+0000 7fd41e79b700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd41809df30 con 0x7fd418133e30 2023-10-01T08:01:50.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.495+0000 7fd417fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd418133420 0x7fd41809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:50.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.495+0000 7fd417fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd418133420 0x7fd41809c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35680/0 (socket says 172.21.15.26:35680) 2023-10-01T08:01:50.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.495+0000 7fd417fff700 1 -- 172.21.15.26:0/3049140877 learned_addr learned my addr 172.21.15.26:0/3049140877 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:50.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.495+0000 7fd4177fe700 1 --2- 172.21.15.26:0/3049140877 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd418133e30 0x7fd41809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:50.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.495+0000 7fd41cd38700 1 --2- 172.21.15.26:0/3049140877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd418134260 0x7fd41809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:50.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.496+0000 7fd417fff700 1 -- 172.21.15.26:0/3049140877 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd418133e30 msgr2=0x7fd41809c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:50.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.496+0000 7fd417fff700 1 --2- 172.21.15.26:0/3049140877 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd418133e30 0x7fd41809c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:50.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.496+0000 7fd417fff700 1 -- 172.21.15.26:0/3049140877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd418134260 msgr2=0x7fd41809cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:50.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.496+0000 7fd417fff700 1 --2- 172.21.15.26:0/3049140877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd418134260 0x7fd41809cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:50.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.496+0000 7fd417fff700 1 -- 172.21.15.26:0/3049140877 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40c0094a0 con 0x7fd418133420 2023-10-01T08:01:50.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.496+0000 7fd4177fe700 1 --2- 172.21.15.26:0/3049140877 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fd418133e30 0x7fd41809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:50.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.496+0000 7fd41cd38700 1 --2- 172.21.15.26:0/3049140877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd418134260 0x7fd41809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:50.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.496+0000 7fd417fff700 1 --2- 172.21.15.26:0/3049140877 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd418133420 0x7fd41809c480 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fd408009c40 tx=0x7fd408004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:50.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.496+0000 7fd414ff9700 1 -- 172.21.15.26:0/3049140877 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd408004400 con 0x7fd418133420 2023-10-01T08:01:50.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.496+0000 7fd414ff9700 1 -- 172.21.15.26:0/3049140877 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40801f070 con 0x7fd418133420 2023-10-01T08:01:50.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.496+0000 7fd41e79b700 1 -- 172.21.15.26:0/3049140877 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd408009550 con 0x7fd418133420 2023-10-01T08:01:50.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.496+0000 7fd414ff9700 1 -- 172.21.15.26:0/3049140877 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4080038e0 con 0x7fd418133420 2023-10-01T08:01:50.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.496+0000 7fd41e79b700 1 -- 172.21.15.26:0/3049140877 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd41811fb60 con 0x7fd418133420 2023-10-01T08:01:50.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.497+0000 7fd414ff9700 1 -- 172.21.15.26:0/3049140877 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd408021030 con 0x7fd418133420 2023-10-01T08:01:50.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.497+0000 7fd414ff9700 1 -- 172.21.15.26:0/3049140877 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd408040bb0 con 0x7fd418133420 2023-10-01T08:01:50.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.497+0000 7fd41e79b700 1 -- 172.21.15.26:0/3049140877 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd41811fcf0 con 0x7fd418133420 2023-10-01T08:01:50.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:50.502+0000 7fd414ff9700 1 -- 172.21.15.26:0/3049140877 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd41811fcf0 con 0x7fd418133420 2023-10-01T08:01:51.313 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-01T08:01:51.382 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-01T08:01:51.422 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-01T08:01:51.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.460+0000 7f988266f700 1 Processor -- start 2023-10-01T08:01:51.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.460+0000 7f988266f700 1 -- start start 2023-10-01T08:01:51.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.461+0000 7f988266f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f987c130540 0x7f987c130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:51.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.461+0000 7f988266f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f987c130e50 0x7f987c06f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:51.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.461+0000 7f988266f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f987c06fb20 0x7f987c06ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:51.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.461+0000 7f988266f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f987c09a390 con 0x7f987c130540 2023-10-01T08:01:51.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.461+0000 7f988266f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f987c0716a0 con 0x7f987c130e50 2023-10-01T08:01:51.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.461+0000 7f988266f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f987c071290 con 0x7f987c06fb20 2023-10-01T08:01:51.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.461+0000 7f987bfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f987c130540 0x7f987c130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:51.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.461+0000 7f9880c0c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f987c06fb20 0x7f987c06ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:51.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.461+0000 7f987bfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f987c130540 0x7f987c130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56008/0 (socket says 172.21.15.26:56008) 2023-10-01T08:01:51.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.461+0000 7f987bfff700 1 -- 172.21.15.26:0/1900493351 learned_addr learned my addr 172.21.15.26:0/1900493351 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:51.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.461+0000 7f987b7fe700 1 --2- 172.21.15.26:0/1900493351 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f987c130e50 0x7f987c06f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:51.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.461+0000 7f9880c0c700 1 -- 172.21.15.26:0/1900493351 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f987c130e50 msgr2=0x7f987c06f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:51.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.461+0000 7f9880c0c700 1 --2- 172.21.15.26:0/1900493351 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f987c130e50 0x7f987c06f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:51.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.461+0000 7f9880c0c700 1 -- 172.21.15.26:0/1900493351 >> v2:172.21.15.26:3300/0 conn(0x7f987c130540 msgr2=0x7f987c130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:51.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.461+0000 7f9880c0c700 1 --2- 172.21.15.26:0/1900493351 >> v2:172.21.15.26:3300/0 conn(0x7f987c130540 0x7f987c130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:51.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.461+0000 7f9880c0c700 1 -- 172.21.15.26:0/1900493351 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f987c130340 con 0x7f987c06fb20 2023-10-01T08:01:51.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.462+0000 7f9880c0c700 1 --2- 172.21.15.26:0/1900493351 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f987c06fb20 0x7f987c06ffa0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f9874009d90 tx=0x7f987400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a4278019aa119c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:51.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.462+0000 7f987affd700 1 -- 172.21.15.26:0/1900493351 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987400e070 con 0x7f987c06fb20 2023-10-01T08:01:51.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.462+0000 7f987affd700 1 -- 172.21.15.26:0/1900493351 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987400bb20 con 0x7f987c06fb20 2023-10-01T08:01:51.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.462+0000 7f987affd700 1 -- 172.21.15.26:0/1900493351 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9874012430 con 0x7f987c06fb20 2023-10-01T08:01:51.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.463+0000 7f988266f700 1 -- 172.21.15.26:0/1900493351 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f987c06fb20 msgr2=0x7f987c06ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:51.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.463+0000 7f988266f700 1 --2- 172.21.15.26:0/1900493351 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f987c06fb20 0x7f987c06ffa0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f9874009d90 tx=0x7f987400b330 comp rx=0 tx=0).stop 2023-10-01T08:01:51.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.463+0000 7f988266f700 1 -- 172.21.15.26:0/1900493351 shutdown_connections 2023-10-01T08:01:51.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.463+0000 7f988266f700 1 --2- 172.21.15.26:0/1900493351 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f987c06fb20 0x7f987c06ffa0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:51.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.463+0000 7f988266f700 1 --2- 172.21.15.26:0/1900493351 >> v2:172.21.15.26:3300/0 conn(0x7f987c130540 0x7f987c130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:51.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.463+0000 7f988266f700 1 --2- 172.21.15.26:0/1900493351 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f987c130e50 0x7f987c06f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:51.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.463+0000 7f988266f700 1 -- 172.21.15.26:0/1900493351 >> 172.21.15.26:0/1900493351 conn(0x7f987c0a2aa0 msgr2=0x7f987c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:51.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.463+0000 7f988266f700 1 -- 172.21.15.26:0/1900493351 shutdown_connections 2023-10-01T08:01:51.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.463+0000 7f988266f700 1 -- 172.21.15.26:0/1900493351 wait complete. 2023-10-01T08:01:51.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.464+0000 7f988266f700 1 Processor -- start 2023-10-01T08:01:51.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.465+0000 7f988266f700 1 -- start start 2023-10-01T08:01:51.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.465+0000 7f988266f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f987c06fb20 0x7f987c11a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:51.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.465+0000 7f988266f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f987c130540 0x7f987c11ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:51.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.465+0000 7f988266f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f987c130e50 0x7f987c11b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:51.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.465+0000 7f988266f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f987c11ba80 con 0x7f987c06fb20 2023-10-01T08:01:51.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.465+0000 7f988266f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f987c11c140 con 0x7f987c130540 2023-10-01T08:01:51.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.465+0000 7f988266f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f987c11e050 con 0x7f987c130e50 2023-10-01T08:01:51.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.466+0000 7f987b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f987c130540 0x7f987c11ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:51.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.466+0000 7f987b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f987c130540 0x7f987c11ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35704/0 (socket says 172.21.15.26:35704) 2023-10-01T08:01:51.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.466+0000 7f987b7fe700 1 -- 172.21.15.26:0/3221686828 learned_addr learned my addr 172.21.15.26:0/3221686828 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:51.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.466+0000 7f987bfff700 1 --2- 172.21.15.26:0/3221686828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f987c06fb20 0x7f987c11a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:51.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.466+0000 7f987b7fe700 1 -- 172.21.15.26:0/3221686828 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f987c130e50 msgr2=0x7f987c11b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:51.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.466+0000 7f9880c0c700 1 --2- 172.21.15.26:0/3221686828 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f987c130e50 0x7f987c11b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:51.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.466+0000 7f987b7fe700 1 --2- 172.21.15.26:0/3221686828 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f987c130e50 0x7f987c11b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:51.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.466+0000 7f987b7fe700 1 -- 172.21.15.26:0/3221686828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f987c06fb20 msgr2=0x7f987c11a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:51.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.466+0000 7f987b7fe700 1 --2- 172.21.15.26:0/3221686828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f987c06fb20 0x7f987c11a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:51.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.466+0000 7f987b7fe700 1 -- 172.21.15.26:0/3221686828 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9874009a70 con 0x7f987c130540 2023-10-01T08:01:51.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.466+0000 7f9880c0c700 1 --2- 172.21.15.26:0/3221686828 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f987c130e50 0x7f987c11b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T08:01:51.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.466+0000 7f987b7fe700 1 --2- 172.21.15.26:0/3221686828 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f987c130540 0x7f987c11ab10 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f987000e9b0 tx=0x7f987000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:51.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.467+0000 7f9878ff9700 1 -- 172.21.15.26:0/3221686828 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9870009710 con 0x7f987c130540 2023-10-01T08:01:51.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.467+0000 7f9878ff9700 1 -- 172.21.15.26:0/3221686828 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987000c850 con 0x7f987c130540 2023-10-01T08:01:51.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.467+0000 7f9878ff9700 1 -- 172.21.15.26:0/3221686828 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987000cbc0 con 0x7f987c130540 2023-10-01T08:01:51.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.467+0000 7f988266f700 1 -- 172.21.15.26:0/3221686828 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f987c11d400 con 0x7f987c130540 2023-10-01T08:01:51.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.467+0000 7f988266f700 1 -- 172.21.15.26:0/3221686828 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f987c0a09a0 con 0x7f987c130540 2023-10-01T08:01:51.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.467+0000 7f9878ff9700 1 -- 172.21.15.26:0/3221686828 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f987000cd20 con 0x7f987c130540 2023-10-01T08:01:51.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.468+0000 7f9878ff9700 1 -- 172.21.15.26:0/3221686828 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f987003fa90 con 0x7f987c130540 2023-10-01T08:01:51.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.470+0000 7f988266f700 1 -- 172.21.15.26:0/3221686828 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f987c09cd40 con 0x7f987c130540 2023-10-01T08:01:51.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.475+0000 7f9878ff9700 1 -- 172.21.15.26:0/3221686828 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9870017080 con 0x7f987c130540 2023-10-01T08:01:51.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.537+0000 7fb114cc2700 1 Processor -- start 2023-10-01T08:01:51.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.537+0000 7fb114cc2700 1 -- start start 2023-10-01T08:01:51.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.538+0000 7fb114cc2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb1100a0a30 0x7fb1100a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:51.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.538+0000 7fb114cc2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb110138d80 0x7fb11013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:51.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.538+0000 7fb114cc2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1100a2a70 con 0x7fb11009d630 2023-10-01T08:01:51.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.538+0000 7fb114cc2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1100a01d0 con 0x7fb110138d80 2023-10-01T08:01:51.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.538+0000 7fb114cc2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb11009e2b0 con 0x7fb1100a0a30 2023-10-01T08:01:51.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.538+0000 7fb10e59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb1100a0a30 0x7fb1100a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:51.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.538+0000 7fb10ed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb110138d80 0x7fb11013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:51.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.538+0000 7fb10e59c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb1100a0a30 0x7fb1100a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49694/0 (socket says 172.21.15.26:49694) 2023-10-01T08:01:51.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.538+0000 7fb10ed9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb110138d80 0x7fb11013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35718/0 (socket says 172.21.15.26:35718) 2023-10-01T08:01:51.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.538+0000 7fb10e59c700 1 -- 172.21.15.26:0/2744466160 learned_addr learned my addr 172.21.15.26:0/2744466160 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:51.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.539+0000 7fb10e59c700 1 -- 172.21.15.26:0/2744466160 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb110138d80 msgr2=0x7fb11013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:51.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.539+0000 7fb10e59c700 1 --2- 172.21.15.26:0/2744466160 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb110138d80 0x7fb11013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:51.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.539+0000 7fb10e59c700 1 -- 172.21.15.26:0/2744466160 >> v1:172.21.15.26:6789/0 conn(0x7fb11009d630 legacy=0x7fb1100a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:51.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.539+0000 7fb10e59c700 1 -- 172.21.15.26:0/2744466160 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11009dc50 con 0x7fb1100a0a30 2023-10-01T08:01:51.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.539+0000 7fb10ed9d700 1 --2- 172.21.15.26:0/2744466160 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb110138d80 0x7fb11013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:51.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.539+0000 7fb10e59c700 1 --2- 172.21.15.26:0/2744466160 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb1100a0a30 0x7fb1100a0e00 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fb100009920 tx=0x7fb100009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3126222cb8835c13 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:51.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.539+0000 7fb10d59a700 1 -- 172.21.15.26:0/2744466160 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb100011830 con 0x7fb1100a0a30 2023-10-01T08:01:51.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.539+0000 7fb10d59a700 1 -- 172.21.15.26:0/2744466160 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb100011990 con 0x7fb1100a0a30 2023-10-01T08:01:51.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.539+0000 7fb10d59a700 1 -- 172.21.15.26:0/2744466160 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb100011d20 con 0x7fb1100a0a30 2023-10-01T08:01:51.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.540+0000 7fb114cc2700 1 -- 172.21.15.26:0/2744466160 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb1100a0a30 msgr2=0x7fb1100a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:51.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.540+0000 7fb114cc2700 1 --2- 172.21.15.26:0/2744466160 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb1100a0a30 0x7fb1100a0e00 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fb100009920 tx=0x7fb100009c30 comp rx=0 tx=0).stop 2023-10-01T08:01:51.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.540+0000 7fb114cc2700 1 -- 172.21.15.26:0/2744466160 shutdown_connections 2023-10-01T08:01:51.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.540+0000 7fb114cc2700 1 --2- 172.21.15.26:0/2744466160 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb1100a0a30 0x7fb1100a0e00 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:51.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.540+0000 7fb114cc2700 1 --2- 172.21.15.26:0/2744466160 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb110138d80 0x7fb11013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:51.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.540+0000 7fb114cc2700 1 -- 172.21.15.26:0/2744466160 >> 172.21.15.26:0/2744466160 conn(0x7fb1100a3050 msgr2=0x7fb1100a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:51.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.540+0000 7fb114cc2700 1 -- 172.21.15.26:0/2744466160 shutdown_connections 2023-10-01T08:01:51.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.540+0000 7fb114cc2700 1 -- 172.21.15.26:0/2744466160 wait complete. 2023-10-01T08:01:51.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.541+0000 7fb114cc2700 1 Processor -- start 2023-10-01T08:01:51.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.541+0000 7fb114cc2700 1 -- start start 2023-10-01T08:01:51.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.542+0000 7fb114cc2700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb11009d630 0x7fb1101208a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:51.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.542+0000 7fb114cc2700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb1100a0a30 0x7fb110120de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:51.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.542+0000 7fb114cc2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb110138d80 0x7fb110121320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:51.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.542+0000 7fb114cc2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb110121d60 con 0x7fb110138d80 2023-10-01T08:01:51.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.542+0000 7fb114cc2700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb110122420 con 0x7fb11009d630 2023-10-01T08:01:51.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.542+0000 7fb114cc2700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb110124330 con 0x7fb1100a0a30 2023-10-01T08:01:51.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.542+0000 7fb10e59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb11009d630 0x7fb1101208a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:51.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.542+0000 7fb10e59c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb11009d630 0x7fb1101208a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35732/0 (socket says 172.21.15.26:35732) 2023-10-01T08:01:51.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.542+0000 7fb10dd9b700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb1100a0a30 0x7fb110120de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:51.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.542+0000 7fb10e59c700 1 -- 172.21.15.26:0/1173672141 learned_addr learned my addr 172.21.15.26:0/1173672141 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:51.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.542+0000 7fb10ed9d700 1 --2- 172.21.15.26:0/1173672141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb110138d80 0x7fb110121320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:51.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.542+0000 7fb10e59c700 1 -- 172.21.15.26:0/1173672141 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb1100a0a30 msgr2=0x7fb110120de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:51.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.542+0000 7fb10e59c700 1 --2- 172.21.15.26:0/1173672141 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb1100a0a30 0x7fb110120de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:51.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.542+0000 7fb10e59c700 1 -- 172.21.15.26:0/1173672141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb110138d80 msgr2=0x7fb110121320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:51.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.542+0000 7fb10e59c700 1 --2- 172.21.15.26:0/1173672141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb110138d80 0x7fb110121320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:51.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.542+0000 7fb10e59c700 1 -- 172.21.15.26:0/1173672141 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb108009a70 con 0x7fb11009d630 2023-10-01T08:01:51.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.543+0000 7fb10e59c700 1 --2- 172.21.15.26:0/1173672141 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb11009d630 0x7fb1101208a0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fb100000c00 tx=0x7fb100004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:51.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.543+0000 7fb0feffd700 1 -- 172.21.15.26:0/1173672141 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb100004450 con 0x7fb11009d630 2023-10-01T08:01:51.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.543+0000 7fb0feffd700 1 -- 172.21.15.26:0/1173672141 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1000045b0 con 0x7fb11009d630 2023-10-01T08:01:51.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.543+0000 7fb114cc2700 1 -- 172.21.15.26:0/1173672141 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb100009550 con 0x7fb11009d630 2023-10-01T08:01:51.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.543+0000 7fb0feffd700 1 -- 172.21.15.26:0/1173672141 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1000038c0 con 0x7fb11009d630 2023-10-01T08:01:51.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.543+0000 7fb114cc2700 1 -- 172.21.15.26:0/1173672141 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb110123730 con 0x7fb11009d630 2023-10-01T08:01:51.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.544+0000 7fb0feffd700 1 -- 172.21.15.26:0/1173672141 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb100003a20 con 0x7fb11009d630 2023-10-01T08:01:51.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.544+0000 7fb0feffd700 1 -- 172.21.15.26:0/1173672141 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb100021030 con 0x7fb11009d630 2023-10-01T08:01:51.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.545+0000 7fb114cc2700 1 -- 172.21.15.26:0/1173672141 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1100747f0 con 0x7fb11009d630 2023-10-01T08:01:51.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.554+0000 7fb0feffd700 1 -- 172.21.15.26:0/1173672141 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb10001a7b0 con 0x7fb11009d630 2023-10-01T08:01:51.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.570+0000 7f40047c6700 1 Processor -- start 2023-10-01T08:01:51.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.570+0000 7f40047c6700 1 -- start start 2023-10-01T08:01:51.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.571+0000 7f40047c6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ffc0a0a30 0x7f3ffc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:51.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.571+0000 7f40047c6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3ffc09d630 0x7f3ffc0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:51.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.571+0000 7f40047c6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ffc133930 0x7f3ffc133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:51.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.571+0000 7f40047c6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ffc0a2a70 con 0x7f3ffc09d630 2023-10-01T08:01:51.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.571+0000 7f40047c6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc0a01d0 con 0x7f3ffc133930 2023-10-01T08:01:51.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.571+0000 7f40047c6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc09e2b0 con 0x7f3ffc0a0a30 2023-10-01T08:01:51.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.571+0000 7f4001d61700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3ffc09d630 0x7f3ffc0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:51.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.571+0000 7f4002d63700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ffc133930 0x7f3ffc133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:51.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.571+0000 7f4002d63700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ffc133930 0x7f3ffc133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35744/0 (socket says 172.21.15.26:35744) 2023-10-01T08:01:51.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.571+0000 7f4001d61700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3ffc09d630 0x7f3ffc0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56032/0 (socket says 172.21.15.26:56032) 2023-10-01T08:01:51.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.571+0000 7f4002d63700 1 -- 172.21.15.26:0/722340512 learned_addr learned my addr 172.21.15.26:0/722340512 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:51.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.571+0000 7f4002562700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ffc0a0a30 0x7f3ffc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:51.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.572+0000 7f4001d61700 1 -- 172.21.15.26:0/722340512 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ffc0a0a30 msgr2=0x7f3ffc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:51.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.572+0000 7f4001d61700 1 --2- 172.21.15.26:0/722340512 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ffc0a0a30 0x7f3ffc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:51.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.572+0000 7f4001d61700 1 -- 172.21.15.26:0/722340512 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ffc133930 msgr2=0x7f3ffc133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:01:51.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.572+0000 7f4001d61700 1 --2- 172.21.15.26:0/722340512 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ffc133930 0x7f3ffc133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:51.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.572+0000 7f4001d61700 1 -- 172.21.15.26:0/722340512 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ffc09dc50 con 0x7f3ffc09d630 2023-10-01T08:01:51.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.572+0000 7f4002d63700 1 --2- 172.21.15.26:0/722340512 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ffc133930 0x7f3ffc133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:51.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.572+0000 7f4001d61700 1 --2- 172.21.15.26:0/722340512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ffc09d630 0x7f3ffc0a1340 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f3fec009840 tx=0x7f3fec009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3293462dfba9295 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:51.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.572+0000 7f4001560700 1 -- 172.21.15.26:0/722340512 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fec011830 con 0x7f3ffc09d630 2023-10-01T08:01:51.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.572+0000 7f4001560700 1 -- 172.21.15.26:0/722340512 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fec011990 con 0x7f3ffc09d630 2023-10-01T08:01:51.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.572+0000 7f4001560700 1 -- 172.21.15.26:0/722340512 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fec011d20 con 0x7f3ffc09d630 2023-10-01T08:01:51.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.573+0000 7f40047c6700 1 -- 172.21.15.26:0/722340512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ffc09d630 msgr2=0x7f3ffc0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:51.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.573+0000 7f40047c6700 1 --2- 172.21.15.26:0/722340512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ffc09d630 0x7f3ffc0a1340 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f3fec009840 tx=0x7f3fec009b50 comp rx=0 tx=0).stop 2023-10-01T08:01:51.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.573+0000 7f40047c6700 1 -- 172.21.15.26:0/722340512 shutdown_connections 2023-10-01T08:01:51.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.573+0000 7f40047c6700 1 --2- 172.21.15.26:0/722340512 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ffc133930 0x7f3ffc133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:51.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.573+0000 7f40047c6700 1 --2- 172.21.15.26:0/722340512 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ffc0a0a30 0x7f3ffc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:51.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.573+0000 7f40047c6700 1 --2- 172.21.15.26:0/722340512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ffc09d630 0x7f3ffc0a1340 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:51.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.573+0000 7f40047c6700 1 -- 172.21.15.26:0/722340512 >> 172.21.15.26:0/722340512 conn(0x7f3ffc0a3050 msgr2=0x7f3ffc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:51.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.573+0000 7f40047c6700 1 -- 172.21.15.26:0/722340512 shutdown_connections 2023-10-01T08:01:51.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.573+0000 7f40047c6700 1 -- 172.21.15.26:0/722340512 wait complete. 2023-10-01T08:01:51.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.574+0000 7f40047c6700 1 Processor -- start 2023-10-01T08:01:51.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.574+0000 7f40047c6700 1 -- start start 2023-10-01T08:01:51.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.575+0000 7f40047c6700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ffc09d630 0x7f3ffc121240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:51.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.575+0000 7f40047c6700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ffc0a0a30 0x7f3ffc121780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:51.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.575+0000 7f40047c6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ffc133930 0x7f3ffc121cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:01:51.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.575+0000 7f40047c6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc122dc0 con 0x7f3ffc133930 2023-10-01T08:01:51.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.575+0000 7f40047c6700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc123c50 con 0x7f3ffc09d630 2023-10-01T08:01:51.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.575+0000 7f40047c6700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc124730 con 0x7f3ffc0a0a30 2023-10-01T08:01:51.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.575+0000 7f4002562700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ffc09d630 0x7f3ffc121240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:51.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.575+0000 7f4001d61700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ffc0a0a30 0x7f3ffc121780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:51.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.575+0000 7f4002562700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ffc09d630 0x7f3ffc121240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:35756/0 (socket says 172.21.15.26:35756) 2023-10-01T08:01:51.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.575+0000 7f4001d61700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ffc0a0a30 0x7f3ffc121780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:49738/0 (socket says 172.21.15.26:49738) 2023-10-01T08:01:51.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.575+0000 7f4002562700 1 -- 172.21.15.26:0/1549322480 learned_addr learned my addr 172.21.15.26:0/1549322480 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:01:51.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.575+0000 7f4002d63700 1 --2- 172.21.15.26:0/1549322480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ffc133930 0x7f3ffc121cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:01:51.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.575+0000 7f4002562700 1 -- 172.21.15.26:0/1549322480 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ffc0a0a30 msgr2=0x7f3ffc121780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:51.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.575+0000 7f4002562700 1 --2- 172.21.15.26:0/1549322480 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ffc0a0a30 0x7f3ffc121780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:51.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.575+0000 7f4002562700 1 -- 172.21.15.26:0/1549322480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ffc133930 msgr2=0x7f3ffc121cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:51.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.575+0000 7f4002562700 1 --2- 172.21.15.26:0/1549322480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ffc133930 0x7f3ffc121cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:51.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.575+0000 7f4002562700 1 -- 172.21.15.26:0/1549322480 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff4009b30 con 0x7f3ffc09d630 2023-10-01T08:01:51.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.575+0000 7f4001d61700 1 --2- 172.21.15.26:0/1549322480 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ffc0a0a30 0x7f3ffc121780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:01:51.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.575+0000 7f4002562700 1 --2- 172.21.15.26:0/1549322480 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ffc09d630 0x7f3ffc121240 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f3ff800e9e0 tx=0x7f3ff800ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:01:51.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.576+0000 7f3ff2ffd700 1 -- 172.21.15.26:0/1549322480 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8009710 con 0x7f3ffc09d630 2023-10-01T08:01:51.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.576+0000 7f3ff2ffd700 1 -- 172.21.15.26:0/1549322480 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff800ee80 con 0x7f3ffc09d630 2023-10-01T08:01:51.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.576+0000 7f3ff2ffd700 1 -- 172.21.15.26:0/1549322480 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff800ca50 con 0x7f3ffc09d630 2023-10-01T08:01:51.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.576+0000 7f40047c6700 1 -- 172.21.15.26:0/1549322480 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fec0094a0 con 0x7f3ffc09d630 2023-10-01T08:01:51.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.576+0000 7f40047c6700 1 -- 172.21.15.26:0/1549322480 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ffc0a5040 con 0x7f3ffc09d630 2023-10-01T08:01:51.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.576+0000 7f3ff2ffd700 1 -- 172.21.15.26:0/1549322480 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3ff800cbb0 con 0x7f3ffc09d630 2023-10-01T08:01:51.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.577+0000 7f3ff2ffd700 1 -- 172.21.15.26:0/1549322480 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3ff803fa90 con 0x7f3ffc09d630 2023-10-01T08:01:51.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.577+0000 7f40047c6700 1 -- 172.21.15.26:0/1549322480 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ffc124010 con 0x7f3ffc09d630 2023-10-01T08:01:51.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.582+0000 7f3ff2ffd700 1 -- 172.21.15.26:0/1549322480 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ff801b3b0 con 0x7f3ffc09d630 2023-10-01T08:01:51.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.722+0000 7f988266f700 1 -- 172.21.15.26:0/3221686828 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f987c11de90 con 0x7f987c130540 2023-10-01T08:01:51.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.723+0000 7f9878ff9700 1 -- 172.21.15.26:0/3221686828 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9870021020 con 0x7f987c130540 2023-10-01T08:01:51.723 INFO:teuthology.orchestra.run.smithi026.stdout:128849018882 2023-10-01T08:01:51.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.726+0000 7f988266f700 1 -- 172.21.15.26:0/3221686828 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f987c130540 msgr2=0x7f987c11ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:51.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.726+0000 7f988266f700 1 --2- 172.21.15.26:0/3221686828 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f987c130540 0x7f987c11ab10 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f987000e9b0 tx=0x7f987000ecc0 comp rx=0 tx=0).stop 2023-10-01T08:01:51.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.726+0000 7f988266f700 1 -- 172.21.15.26:0/3221686828 shutdown_connections 2023-10-01T08:01:51.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.726+0000 7f988266f700 1 --2- 172.21.15.26:0/3221686828 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f987c130e50 0x7f987c11b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:51.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.726+0000 7f988266f700 1 --2- 172.21.15.26:0/3221686828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f987c06fb20 0x7f987c11a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:51.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.726+0000 7f988266f700 1 --2- 172.21.15.26:0/3221686828 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f987c130540 0x7f987c11ab10 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:51.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.726+0000 7f988266f700 1 -- 172.21.15.26:0/3221686828 >> 172.21.15.26:0/3221686828 conn(0x7f987c0a2aa0 msgr2=0x7f987c12d470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:51.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.726+0000 7f988266f700 1 -- 172.21.15.26:0/3221686828 shutdown_connections 2023-10-01T08:01:51.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.726+0000 7f988266f700 1 -- 172.21.15.26:0/3221686828 wait complete. 2023-10-01T08:01:51.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018882 for osd.1 2023-10-01T08:01:51.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.784+0000 7fb114cc2700 1 -- 172.21.15.26:0/1173672141 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb110072980 con 0x7fb11009d630 2023-10-01T08:01:51.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.784+0000 7fb0feffd700 1 -- 172.21.15.26:0/1173672141 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb100015030 con 0x7fb11009d630 2023-10-01T08:01:51.785 INFO:teuthology.orchestra.run.smithi026.stdout:133143986178 2023-10-01T08:01:51.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.786+0000 7fb114cc2700 1 -- 172.21.15.26:0/1173672141 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb11009d630 msgr2=0x7fb1101208a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:51.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.786+0000 7fb114cc2700 1 --2- 172.21.15.26:0/1173672141 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb11009d630 0x7fb1101208a0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fb100000c00 tx=0x7fb100004750 comp rx=0 tx=0).stop 2023-10-01T08:01:51.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.786+0000 7fb114cc2700 1 -- 172.21.15.26:0/1173672141 shutdown_connections 2023-10-01T08:01:51.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.786+0000 7fb114cc2700 1 --2- 172.21.15.26:0/1173672141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb110138d80 0x7fb110121320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:51.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.786+0000 7fb114cc2700 1 --2- 172.21.15.26:0/1173672141 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb11009d630 0x7fb1101208a0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:51.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.786+0000 7fb114cc2700 1 --2- 172.21.15.26:0/1173672141 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb1100a0a30 0x7fb110120de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:51.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.786+0000 7fb114cc2700 1 -- 172.21.15.26:0/1173672141 >> 172.21.15.26:0/1173672141 conn(0x7fb1100a3050 msgr2=0x7fb1100a5250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:51.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.786+0000 7fb114cc2700 1 -- 172.21.15.26:0/1173672141 shutdown_connections 2023-10-01T08:01:51.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.787+0000 7fb114cc2700 1 -- 172.21.15.26:0/1173672141 wait complete. 2023-10-01T08:01:51.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.799+0000 7f40047c6700 1 -- 172.21.15.26:0/1549322480 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3ffc11df60 con 0x7f3ffc09d630 2023-10-01T08:01:51.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.799+0000 7f3ff2ffd700 1 -- 172.21.15.26:0/1549322480 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3ff8021020 con 0x7f3ffc09d630 2023-10-01T08:01:51.800 INFO:teuthology.orchestra.run.smithi026.stdout:124554051586 2023-10-01T08:01:51.801 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.2 2023-10-01T08:01:51.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.802+0000 7f40047c6700 1 -- 172.21.15.26:0/1549322480 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ffc09d630 msgr2=0x7f3ffc121240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:01:51.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.802+0000 7f40047c6700 1 --2- 172.21.15.26:0/1549322480 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ffc09d630 0x7f3ffc121240 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f3ff800e9e0 tx=0x7f3ff800ecf0 comp rx=0 tx=0).stop 2023-10-01T08:01:51.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.802+0000 7f40047c6700 1 -- 172.21.15.26:0/1549322480 shutdown_connections 2023-10-01T08:01:51.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.802+0000 7f40047c6700 1 --2- 172.21.15.26:0/1549322480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ffc133930 0x7f3ffc121cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:51.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.802+0000 7f40047c6700 1 --2- 172.21.15.26:0/1549322480 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ffc09d630 0x7f3ffc121240 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:51.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.802+0000 7f40047c6700 1 --2- 172.21.15.26:0/1549322480 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f3ffc0a0a30 0x7f3ffc121780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:01:51.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.802+0000 7f40047c6700 1 -- 172.21.15.26:0/1549322480 >> 172.21.15.26:0/1549322480 conn(0x7f3ffc0a3050 msgr2=0x7f3ffc133180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:01:51.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.802+0000 7f40047c6700 1 -- 172.21.15.26:0/1549322480 shutdown_connections 2023-10-01T08:01:51.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:01:51.802+0000 7f40047c6700 1 -- 172.21.15.26:0/1549322480 wait complete. 2023-10-01T08:01:51.815 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-10-01T08:03:50.390 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-10-01T08:03:50.391 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1496, in healthy manager.wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi026 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-01T08:03:50.539 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=9ff286bf56c24588b3a8cc00d90a7b1c Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1496, in healthy manager.wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi026 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-01T08:03:50.544 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2023-10-01T08:03:50.553 DEBUG:teuthology.run_tasks:Unwinding manager ceph.stop 2023-10-01T08:03:50.572 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2023-10-01T08:03:50.605 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2023-10-01T08:03:50.639 DEBUG:teuthology.run_tasks:Unwinding manager install.upgrade 2023-10-01T08:03:50.673 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-10-01T08:03:50.706 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-10-01T08:03:50.706 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-01T08:03:50.706 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-01T08:03:50.735 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-01T08:03:50.735 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-01T08:03:50.798 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-01T08:03:50.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.941+0000 7f50520b7700 1 Processor -- start 2023-10-01T08:03:50.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.941+0000 7f50520b7700 1 -- start start 2023-10-01T08:03:50.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.942+0000 7f50520b7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f504c133420 0x7f504c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:50.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.942+0000 7f50520b7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f504c133e30 0x7f504c12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:50.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.942+0000 7f50520b7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f504c134260 0x7f504c1304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:50.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.942+0000 7f50520b7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f504c06b990 con 0x7f504c133e30 2023-10-01T08:03:50.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.942+0000 7f50520b7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504c0a0590 con 0x7f504c133420 2023-10-01T08:03:50.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.942+0000 7f50520b7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f504c09fb80 con 0x7f504c134260 2023-10-01T08:03:50.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.942+0000 7f504affd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f504c133e30 0x7f504c12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:50.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.942+0000 7f504bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f504c134260 0x7f504c1304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:50.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.942+0000 7f504b7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f504c133420 0x7f504c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:50.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.942+0000 7f504affd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f504c133e30 0x7f504c12ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47964/0 (socket says 172.21.15.26:47964) 2023-10-01T08:03:50.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.942+0000 7f504bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f504c134260 0x7f504c1304d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56964/0 (socket says 172.21.15.26:56964) 2023-10-01T08:03:50.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.942+0000 7f504affd700 1 -- 172.21.15.26:0/2981102147 learned_addr learned my addr 172.21.15.26:0/2981102147 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:03:50.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.942+0000 7f504affd700 1 -- 172.21.15.26:0/2981102147 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f504c134260 msgr2=0x7f504c1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:03:50.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.942+0000 7f504affd700 1 --2- 172.21.15.26:0/2981102147 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f504c134260 0x7f504c1304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:50.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.942+0000 7f504affd700 1 -- 172.21.15.26:0/2981102147 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f504c133420 msgr2=0x7f504c1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:03:50.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.942+0000 7f504affd700 1 --2- 172.21.15.26:0/2981102147 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f504c133420 0x7f504c1337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:50.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.942+0000 7f504affd700 1 -- 172.21.15.26:0/2981102147 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504c0a0030 con 0x7f504c133e30 2023-10-01T08:03:50.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.942+0000 7f504bfff700 1 --2- 172.21.15.26:0/2981102147 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f504c134260 0x7f504c1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:03:50.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.942+0000 7f504b7fe700 1 --2- 172.21.15.26:0/2981102147 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f504c133420 0x7f504c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:03:50.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.942+0000 7f504affd700 1 --2- 172.21.15.26:0/2981102147 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f504c133e30 0x7f504c12ff90 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f503c0098f0 tx=0x7f503c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e4c079249dbe13b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:03:50.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.943+0000 7f504a7fc700 1 -- 172.21.15.26:0/2981102147 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c011830 con 0x7f504c133e30 2023-10-01T08:03:50.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.943+0000 7f504a7fc700 1 -- 172.21.15.26:0/2981102147 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503c011990 con 0x7f504c133e30 2023-10-01T08:03:50.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.943+0000 7f504a7fc700 1 -- 172.21.15.26:0/2981102147 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c011d20 con 0x7f504c133e30 2023-10-01T08:03:50.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.943+0000 7f50520b7700 1 -- 172.21.15.26:0/2981102147 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f504c133e30 msgr2=0x7f504c12ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:50.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.943+0000 7f50520b7700 1 --2- 172.21.15.26:0/2981102147 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f504c133e30 0x7f504c12ff90 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f503c0098f0 tx=0x7f503c009c00 comp rx=0 tx=0).stop 2023-10-01T08:03:50.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.943+0000 7f50520b7700 1 -- 172.21.15.26:0/2981102147 shutdown_connections 2023-10-01T08:03:50.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.943+0000 7f50520b7700 1 --2- 172.21.15.26:0/2981102147 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f504c134260 0x7f504c1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:50.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.943+0000 7f50520b7700 1 --2- 172.21.15.26:0/2981102147 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f504c133420 0x7f504c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:50.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.943+0000 7f50520b7700 1 --2- 172.21.15.26:0/2981102147 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f504c133e30 0x7f504c12ff90 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:50.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.943+0000 7f50520b7700 1 -- 172.21.15.26:0/2981102147 >> 172.21.15.26:0/2981102147 conn(0x7f504c0a4210 msgr2=0x7f504c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:03:50.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.943+0000 7f50520b7700 1 -- 172.21.15.26:0/2981102147 shutdown_connections 2023-10-01T08:03:50.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.943+0000 7f50520b7700 1 -- 172.21.15.26:0/2981102147 wait complete. 2023-10-01T08:03:50.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.945+0000 7f50520b7700 1 Processor -- start 2023-10-01T08:03:50.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.945+0000 7f50520b7700 1 -- start start 2023-10-01T08:03:50.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.946+0000 7f50520b7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f504c133420 0x7f504c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:50.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.946+0000 7f50520b7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f504c133e30 0x7f504c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:50.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.946+0000 7f50520b7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f504c134260 0x7f504c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:50.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.946+0000 7f50520b7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504c09d850 con 0x7f504c133420 2023-10-01T08:03:50.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.946+0000 7f50520b7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504c12da20 con 0x7f504c133e30 2023-10-01T08:03:50.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.946+0000 7f50520b7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f504c11ff20 con 0x7f504c134260 2023-10-01T08:03:50.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.946+0000 7f504b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f504c133420 0x7f504c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:50.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.946+0000 7f504b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f504c133420 0x7f504c09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47974/0 (socket says 172.21.15.26:47974) 2023-10-01T08:03:50.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.946+0000 7f504b7fe700 1 -- 172.21.15.26:0/2128162852 learned_addr learned my addr 172.21.15.26:0/2128162852 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:03:50.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.946+0000 7f504bfff700 1 --2- 172.21.15.26:0/2128162852 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f504c134260 0x7f504c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:50.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.946+0000 7f504affd700 1 --2- 172.21.15.26:0/2128162852 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f504c133e30 0x7f504c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:50.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.946+0000 7f504b7fe700 1 -- 172.21.15.26:0/2128162852 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f504c134260 msgr2=0x7f504c09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:50.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.946+0000 7f504b7fe700 1 --2- 172.21.15.26:0/2128162852 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f504c134260 0x7f504c09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:50.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.946+0000 7f504b7fe700 1 -- 172.21.15.26:0/2128162852 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f504c133e30 msgr2=0x7f504c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:50.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.946+0000 7f504b7fe700 1 --2- 172.21.15.26:0/2128162852 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f504c133e30 0x7f504c09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:50.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.946+0000 7f504b7fe700 1 -- 172.21.15.26:0/2128162852 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50400094a0 con 0x7f504c133420 2023-10-01T08:03:50.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.946+0000 7f504b7fe700 1 --2- 172.21.15.26:0/2128162852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f504c133420 0x7f504c09c480 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f504000ec10 tx=0x7f504000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:03:50.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.946+0000 7f5033fff700 1 -- 172.21.15.26:0/2128162852 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504000c850 con 0x7f504c133420 2023-10-01T08:03:50.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.947+0000 7f5033fff700 1 -- 172.21.15.26:0/2128162852 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504000c9b0 con 0x7f504c133420 2023-10-01T08:03:50.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.947+0000 7f50520b7700 1 -- 172.21.15.26:0/2128162852 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5044009a70 con 0x7f504c133420 2023-10-01T08:03:50.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.947+0000 7f5033fff700 1 -- 172.21.15.26:0/2128162852 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504000cd20 con 0x7f504c133420 2023-10-01T08:03:50.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.947+0000 7f50520b7700 1 -- 172.21.15.26:0/2128162852 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f503c009550 con 0x7f504c133420 2023-10-01T08:03:50.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.947+0000 7f5033fff700 1 -- 172.21.15.26:0/2128162852 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5040013470 con 0x7f504c133420 2023-10-01T08:03:50.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.948+0000 7f5033fff700 1 -- 172.21.15.26:0/2128162852 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f504003f7a0 con 0x7f504c133420 2023-10-01T08:03:50.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.948+0000 7f50520b7700 1 -- 172.21.15.26:0/2128162852 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f504c09de90 con 0x7f504c133420 2023-10-01T08:03:50.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:50.953+0000 7f5033fff700 1 -- 172.21.15.26:0/2128162852 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f504c09de90 con 0x7f504c133420 2023-10-01T08:03:51.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.156+0000 7f50520b7700 1 -- 172.21.15.26:0/2128162852 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f504c09de90 con 0x7f504c133420 2023-10-01T08:03:51.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.157+0000 7f5033fff700 1 -- 172.21.15.26:0/2128162852 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+13445 (secure 0 0 0) 0x7f504c09de90 con 0x7f504c133420 2023-10-01T08:03:51.158 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T08:03:51.158 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":40,"fsid":"c29fb19d-520c-42a6-90f4-e7f86de96e8e","created":"2023-10-01T07:51:40.702414+0000","modified":"2023-10-01T07:55:13.986312+0000","last_up_change":"2023-10-01T07:54:35.033170+0000","last_in_change":"2023-10-01T07:51:42.084736+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-01T07:51:48.906889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-01T07:51:50.071599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-01T07:51:54.981575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-01T07:51:56.286318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46569ce3-81d1-44a1-a649-691de3e6f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6800","nonce":129479}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6801","nonce":129479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6803","nonce":129479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6802","nonce":129479}]},"public_addr":"172.21.15.26:6800/129479","cluster_addr":"172.21.15.26:6801/129479","heartbeat_back_addr":"172.21.15.26:6803/129479","heartbeat_front_addr":"172.21.15.26:6802/129479","state":["exists","up"]},{"osd":1,"uuid":"1fc1ba9b-4110-4d31-96d6-794937578cff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6804","nonce":129577}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6805","nonce":129577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6807","nonce":129577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6806","nonce":129577}]},"public_addr":"172.21.15.26:6804/129577","cluster_addr":"172.21.15.26:6805/129577","heartbeat_back_addr":"172.21.15.26:6807/129577","heartbeat_front_addr":"172.21.15.26:6806/129577","state":["exists","up"]},{"osd":2,"uuid":"37de933d-3b8e-4b94-87bd-2f36896c7ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6808","nonce":129687}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6809","nonce":129687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6811","nonce":129687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6810","nonce":129687}]},"public_addr":"172.21.15.26:6808/129687","cluster_addr":"172.21.15.26:6809/129687","heartbeat_back_addr":"172.21.15.26:6811/129687","heartbeat_front_addr":"172.21.15.26:6810/129687","state":["exists","up"]},{"osd":3,"uuid":"bd020309-5fd2-4d97-b36a-67e159fa3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6812","nonce":130029}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6813","nonce":130029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6815","nonce":130029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6814","nonce":130029}]},"public_addr":"172.21.15.26:6812/130029","cluster_addr":"172.21.15.26:6813/130029","heartbeat_back_addr":"172.21.15.26:6815/130029","heartbeat_front_addr":"172.21.15.26:6814/130029","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.029993+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.266503+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.273540+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-10-01T07:54:29.008198+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.229731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.e","mappings":[{"from":3,"to":0}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.39","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:6816/126763":"2023-10-02T07:55:13.986258+0000","172.21.15.26:0/3996608962":"2023-10-02T07:55:13.986258+0000","172.21.15.26:0/1290599107":"2023-10-02T07:54:14.803384+0000","172.21.15.26:0/1542035933":"2023-10-02T07:55:13.986258+0000","172.21.15.26:6816/118178":"2023-10-02T07:54:14.803384+0000","172.21.15.26:6817/2857714939":"2023-10-02T07:54:39.862609+0000","172.21.15.26:0/616154075":"2023-10-02T07:54:14.803384+0000","172.21.15.26:0/3455045759":"2023-10-02T07:55:13.986258+0000","172.21.15.26:0/2793881876":"2023-10-02T07:55:13.986258+0000","172.21.15.26:0/3315382155":"2023-10-02T07:55:13.986258+0000","172.21.15.26:0/3694083100":"2023-10-02T07:55:13.986258+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-01T08:03:51.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.159+0000 7f50520b7700 1 -- 172.21.15.26:0/2128162852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f504c133420 msgr2=0x7f504c09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:51.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.159+0000 7f50520b7700 1 --2- 172.21.15.26:0/2128162852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f504c133420 0x7f504c09c480 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f504000ec10 tx=0x7f504000ef20 comp rx=0 tx=0).stop 2023-10-01T08:03:51.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.159+0000 7f50520b7700 1 -- 172.21.15.26:0/2128162852 shutdown_connections 2023-10-01T08:03:51.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.159+0000 7f50520b7700 1 --2- 172.21.15.26:0/2128162852 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f504c134260 0x7f504c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:51.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.159+0000 7f50520b7700 1 --2- 172.21.15.26:0/2128162852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f504c133420 0x7f504c09c480 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:51.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.159+0000 7f50520b7700 1 --2- 172.21.15.26:0/2128162852 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f504c133e30 0x7f504c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:51.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.159+0000 7f50520b7700 1 -- 172.21.15.26:0/2128162852 >> 172.21.15.26:0/2128162852 conn(0x7f504c0a4210 msgr2=0x7f504c0a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:03:51.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.159+0000 7f50520b7700 1 -- 172.21.15.26:0/2128162852 shutdown_connections 2023-10-01T08:03:51.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.159+0000 7f50520b7700 1 -- 172.21.15.26:0/2128162852 wait complete. 2023-10-01T08:03:51.174 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-01T07:51:48.906889+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-01T07:51:50.071599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-01T07:51:54.981575+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-01T07:51:56.286318+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-01T08:03:51.175 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-01T08:03:51.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.314+0000 7f52480b8700 1 Processor -- start 2023-10-01T08:03:51.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.314+0000 7f52480b8700 1 -- start start 2023-10-01T08:03:51.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.315+0000 7f52480b8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5240131760 0x7f5240131b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:51.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.315+0000 7f52480b8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f524006a770 0x7f524006abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:51.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.315+0000 7f52480b8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5240131350 con 0x7f524006b100 2023-10-01T08:03:51.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.315+0000 7f52480b8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f524009ea40 con 0x7f5240131760 2023-10-01T08:03:51.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.315+0000 7f52480b8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f524009dfc0 con 0x7f524006a770 2023-10-01T08:03:51.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.315+0000 7f5245653700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f524006a770 0x7f524006abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:51.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.315+0000 7f5245e54700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5240131760 0x7f5240131b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:51.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.315+0000 7f5245653700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f524006a770 0x7f524006abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37348/0 (socket says 172.21.15.26:37348) 2023-10-01T08:03:51.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.315+0000 7f5245653700 1 -- 172.21.15.26:0/2254607754 learned_addr learned my addr 172.21.15.26:0/2254607754 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:03:51.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.315+0000 7f5245e54700 1 --2- 172.21.15.26:0/2254607754 >> v2:172.21.15.26:3300/0 conn(0x7f5240131760 0x7f5240131b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47976/0 (socket says 172.21.15.26:47976) 2023-10-01T08:03:51.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.315+0000 7f5245e54700 1 -- 172.21.15.26:0/2254607754 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f524006a770 msgr2=0x7f524006abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:03:51.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.315+0000 7f5245e54700 1 --2- 172.21.15.26:0/2254607754 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f524006a770 0x7f524006abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:51.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.315+0000 7f5245e54700 1 -- 172.21.15.26:0/2254607754 >> v1:172.21.15.26:6789/0 conn(0x7f524006b100 legacy=0x7f52401385e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:51.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.315+0000 7f5245e54700 1 -- 172.21.15.26:0/2254607754 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524009e210 con 0x7f5240131760 2023-10-01T08:03:51.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.315+0000 7f5245653700 1 --2- 172.21.15.26:0/2254607754 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f524006a770 0x7f524006abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:03:51.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.316+0000 7f5245e54700 1 --2- 172.21.15.26:0/2254607754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5240131760 0x7f5240131b30 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f523c009840 tx=0x7f523c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a8f67046f6348b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:03:51.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.316+0000 7f5244e52700 1 -- 172.21.15.26:0/2254607754 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c011830 con 0x7f5240131760 2023-10-01T08:03:51.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.316+0000 7f5244e52700 1 -- 172.21.15.26:0/2254607754 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523c011990 con 0x7f5240131760 2023-10-01T08:03:51.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.316+0000 7f5244e52700 1 -- 172.21.15.26:0/2254607754 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c011d20 con 0x7f5240131760 2023-10-01T08:03:51.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.316+0000 7f52480b8700 1 -- 172.21.15.26:0/2254607754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5240131760 msgr2=0x7f5240131b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:51.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.316+0000 7f52480b8700 1 --2- 172.21.15.26:0/2254607754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5240131760 0x7f5240131b30 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f523c009840 tx=0x7f523c009b50 comp rx=0 tx=0).stop 2023-10-01T08:03:51.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.316+0000 7f52480b8700 1 -- 172.21.15.26:0/2254607754 shutdown_connections 2023-10-01T08:03:51.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.316+0000 7f52480b8700 1 --2- 172.21.15.26:0/2254607754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5240131760 0x7f5240131b30 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:51.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.316+0000 7f52480b8700 1 --2- 172.21.15.26:0/2254607754 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f524006a770 0x7f524006abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:51.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.316+0000 7f52480b8700 1 -- 172.21.15.26:0/2254607754 >> 172.21.15.26:0/2254607754 conn(0x7f5240066d70 msgr2=0x7f52400a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:03:51.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.316+0000 7f52480b8700 1 -- 172.21.15.26:0/2254607754 shutdown_connections 2023-10-01T08:03:51.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.316+0000 7f52480b8700 1 -- 172.21.15.26:0/2254607754 wait complete. 2023-10-01T08:03:51.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.317+0000 7f52480b8700 1 Processor -- start 2023-10-01T08:03:51.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.317+0000 7f52480b8700 1 -- start start 2023-10-01T08:03:51.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.318+0000 7f52480b8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f524006a770 0x7f524011d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:51.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.318+0000 7f52480b8700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f524006b100 0x7f524011de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:51.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.318+0000 7f52480b8700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5240131760 0x7f524011e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:51.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.318+0000 7f52480b8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524012b770 con 0x7f524006a770 2023-10-01T08:03:51.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.318+0000 7f52480b8700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f524012ba10 con 0x7f524006b100 2023-10-01T08:03:51.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.318+0000 7f52480b8700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f524012d850 con 0x7f5240131760 2023-10-01T08:03:51.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.318+0000 7f5245e54700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f524006a770 0x7f524011d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:51.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.318+0000 7f5245653700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f524006b100 0x7f524011de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:51.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.318+0000 7f5245e54700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f524006a770 0x7f524011d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47982/0 (socket says 172.21.15.26:47982) 2023-10-01T08:03:51.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.318+0000 7f5245e54700 1 -- 172.21.15.26:0/1827419008 learned_addr learned my addr 172.21.15.26:0/1827419008 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:03:51.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.318+0000 7f5246655700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5240131760 0x7f524011e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:51.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.318+0000 7f5245653700 1 -- 172.21.15.26:0/1827419008 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5240131760 msgr2=0x7f524011e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:51.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.318+0000 7f5245653700 1 --2- 172.21.15.26:0/1827419008 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5240131760 0x7f524011e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:51.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.318+0000 7f5245653700 1 -- 172.21.15.26:0/1827419008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f524006a770 msgr2=0x7f524011d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:51.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.318+0000 7f5245653700 1 --2- 172.21.15.26:0/1827419008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f524006a770 0x7f524011d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:51.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.318+0000 7f5245653700 1 -- 172.21.15.26:0/1827419008 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5230009550 con 0x7f524006b100 2023-10-01T08:03:51.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.319+0000 7f5245653700 1 --2- 172.21.15.26:0/1827419008 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f524006b100 0x7f524011de70 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f523000e980 tx=0x7f523000ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:03:51.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.319+0000 7f52367fc700 1 -- 172.21.15.26:0/1827419008 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5230004030 con 0x7f524006b100 2023-10-01T08:03:51.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.319+0000 7f52367fc700 1 -- 172.21.15.26:0/1827419008 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5230004190 con 0x7f524006b100 2023-10-01T08:03:51.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.319+0000 7f52367fc700 1 -- 172.21.15.26:0/1827419008 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5230004520 con 0x7f524006b100 2023-10-01T08:03:51.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.319+0000 7f52480b8700 1 -- 172.21.15.26:0/1827419008 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f523c0094a0 con 0x7f524006b100 2023-10-01T08:03:51.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.319+0000 7f52480b8700 1 -- 172.21.15.26:0/1827419008 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f524011ffa0 con 0x7f524006b100 2023-10-01T08:03:51.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.320+0000 7f52367fc700 1 -- 172.21.15.26:0/1827419008 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f52300036a0 con 0x7f524006b100 2023-10-01T08:03:51.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.320+0000 7f52367fc700 1 -- 172.21.15.26:0/1827419008 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f523003f890 con 0x7f524006b100 2023-10-01T08:03:51.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.320+0000 7f52480b8700 1 -- 172.21.15.26:0/1827419008 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f524004f2a0 con 0x7f524006b100 2023-10-01T08:03:51.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.325+0000 7f52367fc700 1 -- 172.21.15.26:0/1827419008 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5230020020 con 0x7f524006b100 2023-10-01T08:03:51.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.526+0000 7f52480b8700 1 -- 172.21.15.26:0/1827419008 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f524011eb60 con 0x7f524006b100 2023-10-01T08:03:51.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.526+0000 7f52367fc700 1 -- 172.21.15.26:0/1827419008 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5230011bd0 con 0x7f524006b100 2023-10-01T08:03:51.528 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-01T08:03:51.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.528+0000 7f52480b8700 1 -- 172.21.15.26:0/1827419008 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f524006b100 msgr2=0x7f524011de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:51.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.528+0000 7f52480b8700 1 --2- 172.21.15.26:0/1827419008 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f524006b100 0x7f524011de70 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f523000e980 tx=0x7f523000ec90 comp rx=0 tx=0).stop 2023-10-01T08:03:51.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.528+0000 7f52480b8700 1 -- 172.21.15.26:0/1827419008 shutdown_connections 2023-10-01T08:03:51.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.528+0000 7f52480b8700 1 --2- 172.21.15.26:0/1827419008 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f5240131760 0x7f524011e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:51.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.528+0000 7f52480b8700 1 --2- 172.21.15.26:0/1827419008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f524006a770 0x7f524011d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:51.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.528+0000 7f52480b8700 1 --2- 172.21.15.26:0/1827419008 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f524006b100 0x7f524011de70 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:51.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.528+0000 7f52480b8700 1 -- 172.21.15.26:0/1827419008 >> 172.21.15.26:0/1827419008 conn(0x7f5240066d70 msgr2=0x7f524012f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:03:51.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.529+0000 7f52480b8700 1 -- 172.21.15.26:0/1827419008 shutdown_connections 2023-10-01T08:03:51.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.529+0000 7f52480b8700 1 -- 172.21.15.26:0/1827419008 wait complete. 2023-10-01T08:03:51.543 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-01T08:03:51.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.682+0000 7fc432057700 1 Processor -- start 2023-10-01T08:03:51.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.682+0000 7fc432057700 1 -- start start 2023-10-01T08:03:51.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.683+0000 7fc432057700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc42c133cc0 0x7fc42c134090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:51.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.683+0000 7fc432057700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc42c0a1140 0x7fc42c13bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:51.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.683+0000 7fc432057700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc42c09e1f0 con 0x7fc42c1345d0 2023-10-01T08:03:51.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.683+0000 7fc432057700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc42c0a23b0 con 0x7fc42c133cc0 2023-10-01T08:03:51.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.683+0000 7fc432057700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc42c09df30 con 0x7fc42c0a1140 2023-10-01T08:03:51.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.683+0000 7fc42b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc42c133cc0 0x7fc42c134090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:51.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.683+0000 7fc42bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc42c0a1140 0x7fc42c13bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:51.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.683+0000 7fc42b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc42c133cc0 0x7fc42c134090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47988/0 (socket says 172.21.15.26:47988) 2023-10-01T08:03:51.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.683+0000 7fc42bfff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc42c0a1140 0x7fc42c13bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56976/0 (socket says 172.21.15.26:56976) 2023-10-01T08:03:51.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.683+0000 7fc42b7fe700 1 -- 172.21.15.26:0/2082754640 learned_addr learned my addr 172.21.15.26:0/2082754640 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:03:51.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.683+0000 7fc42bfff700 1 -- 172.21.15.26:0/2082754640 >> v2:172.21.15.26:3300/0 conn(0x7fc42c133cc0 msgr2=0x7fc42c134090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:03:51.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.683+0000 7fc42bfff700 1 --2- 172.21.15.26:0/2082754640 >> v2:172.21.15.26:3300/0 conn(0x7fc42c133cc0 0x7fc42c134090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:51.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.683+0000 7fc42bfff700 1 -- 172.21.15.26:0/2082754640 >> v1:172.21.15.26:6789/0 conn(0x7fc42c1345d0 legacy=0x7fc42c0a0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:51.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.683+0000 7fc42bfff700 1 -- 172.21.15.26:0/2082754640 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc42c09d960 con 0x7fc42c0a1140 2023-10-01T08:03:51.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.683+0000 7fc42b7fe700 1 --2- 172.21.15.26:0/2082754640 >> v2:172.21.15.26:3300/0 conn(0x7fc42c133cc0 0x7fc42c134090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:03:51.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.683+0000 7fc42bfff700 1 --2- 172.21.15.26:0/2082754640 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc42c0a1140 0x7fc42c13bc40 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fc424009d90 tx=0x7fc42400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=873d6aca8568d44d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:03:51.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.684+0000 7fc42a7fc700 1 -- 172.21.15.26:0/2082754640 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42400e070 con 0x7fc42c0a1140 2023-10-01T08:03:51.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.684+0000 7fc42a7fc700 1 -- 172.21.15.26:0/2082754640 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42400bb20 con 0x7fc42c0a1140 2023-10-01T08:03:51.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.684+0000 7fc42a7fc700 1 -- 172.21.15.26:0/2082754640 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc424012430 con 0x7fc42c0a1140 2023-10-01T08:03:51.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.684+0000 7fc432057700 1 -- 172.21.15.26:0/2082754640 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc42c0a1140 msgr2=0x7fc42c13bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:51.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.684+0000 7fc432057700 1 --2- 172.21.15.26:0/2082754640 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc42c0a1140 0x7fc42c13bc40 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fc424009d90 tx=0x7fc42400b330 comp rx=0 tx=0).stop 2023-10-01T08:03:51.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.684+0000 7fc432057700 1 -- 172.21.15.26:0/2082754640 shutdown_connections 2023-10-01T08:03:51.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.684+0000 7fc432057700 1 --2- 172.21.15.26:0/2082754640 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc42c0a1140 0x7fc42c13bc40 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:51.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.684+0000 7fc432057700 1 --2- 172.21.15.26:0/2082754640 >> v2:172.21.15.26:3300/0 conn(0x7fc42c133cc0 0x7fc42c134090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:51.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.684+0000 7fc432057700 1 -- 172.21.15.26:0/2082754640 >> 172.21.15.26:0/2082754640 conn(0x7fc42c0a3050 msgr2=0x7fc42c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:03:51.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.684+0000 7fc432057700 1 -- 172.21.15.26:0/2082754640 shutdown_connections 2023-10-01T08:03:51.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.684+0000 7fc432057700 1 -- 172.21.15.26:0/2082754640 wait complete. 2023-10-01T08:03:51.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.685+0000 7fc432057700 1 Processor -- start 2023-10-01T08:03:51.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.686+0000 7fc432057700 1 -- start start 2023-10-01T08:03:51.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.686+0000 7fc432057700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc42c0a1140 0x7fc42c11e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:51.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.686+0000 7fc432057700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc42c133cc0 0x7fc42c11e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:51.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.686+0000 7fc432057700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc42c1345d0 0x7fc42c11ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:51.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.686+0000 7fc432057700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42c121eb0 con 0x7fc42c1345d0 2023-10-01T08:03:51.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.686+0000 7fc432057700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc42c120580 con 0x7fc42c133cc0 2023-10-01T08:03:51.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.686+0000 7fc432057700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc42c121640 con 0x7fc42c0a1140 2023-10-01T08:03:51.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.686+0000 7fc42b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc42c0a1140 0x7fc42c11e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:51.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.686+0000 7fc42b7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc42c0a1140 0x7fc42c11e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:56988/0 (socket says 172.21.15.26:56988) 2023-10-01T08:03:51.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.686+0000 7fc42b7fe700 1 -- 172.21.15.26:0/3314822415 learned_addr learned my addr 172.21.15.26:0/3314822415 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:03:51.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.686+0000 7fc42bfff700 1 --2- 172.21.15.26:0/3314822415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc42c1345d0 0x7fc42c11ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:51.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.686+0000 7fc42affd700 1 --2- 172.21.15.26:0/3314822415 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc42c133cc0 0x7fc42c11e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:51.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.687+0000 7fc42b7fe700 1 -- 172.21.15.26:0/3314822415 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc42c133cc0 msgr2=0x7fc42c11e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:51.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.687+0000 7fc42b7fe700 1 --2- 172.21.15.26:0/3314822415 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc42c133cc0 0x7fc42c11e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:51.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.687+0000 7fc42b7fe700 1 -- 172.21.15.26:0/3314822415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc42c1345d0 msgr2=0x7fc42c11ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:51.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.687+0000 7fc42b7fe700 1 --2- 172.21.15.26:0/3314822415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc42c1345d0 0x7fc42c11ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:51.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.687+0000 7fc42b7fe700 1 -- 172.21.15.26:0/3314822415 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc41c009550 con 0x7fc42c0a1140 2023-10-01T08:03:51.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.687+0000 7fc42affd700 1 --2- 172.21.15.26:0/3314822415 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc42c133cc0 0x7fc42c11e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:03:51.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.687+0000 7fc42bfff700 1 --2- 172.21.15.26:0/3314822415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc42c1345d0 0x7fc42c11ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:03:51.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.687+0000 7fc42b7fe700 1 --2- 172.21.15.26:0/3314822415 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc42c0a1140 0x7fc42c11e390 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fc41c00ec10 tx=0x7fc41c00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:03:51.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.687+0000 7fc423fff700 1 -- 172.21.15.26:0/3314822415 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c00c850 con 0x7fc42c0a1140 2023-10-01T08:03:51.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.687+0000 7fc423fff700 1 -- 172.21.15.26:0/3314822415 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc41c00c9b0 con 0x7fc42c0a1140 2023-10-01T08:03:51.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.687+0000 7fc432057700 1 -- 172.21.15.26:0/3314822415 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc424009a70 con 0x7fc42c0a1140 2023-10-01T08:03:51.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.687+0000 7fc423fff700 1 -- 172.21.15.26:0/3314822415 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c00cd40 con 0x7fc42c0a1140 2023-10-01T08:03:51.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.687+0000 7fc432057700 1 -- 172.21.15.26:0/3314822415 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc42c09cac0 con 0x7fc42c0a1140 2023-10-01T08:03:51.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.688+0000 7fc423fff700 1 -- 172.21.15.26:0/3314822415 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc41c013470 con 0x7fc42c0a1140 2023-10-01T08:03:51.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.688+0000 7fc423fff700 1 -- 172.21.15.26:0/3314822415 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc41c03f830 con 0x7fc42c0a1140 2023-10-01T08:03:51.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.688+0000 7fc432057700 1 -- 172.21.15.26:0/3314822415 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc42c0a57f0 con 0x7fc42c0a1140 2023-10-01T08:03:51.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.693+0000 7fc423fff700 1 -- 172.21.15.26:0/3314822415 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc41c021080 con 0x7fc42c0a1140 2023-10-01T08:03:51.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.897+0000 7fc432057700 1 -- 172.21.15.26:0/3314822415 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc42c1219d0 con 0x7fc42c0a1140 2023-10-01T08:03:51.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.897+0000 7fc423fff700 1 -- 172.21.15.26:0/3314822415 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v40) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc41c013720 con 0x7fc42c0a1140 2023-10-01T08:03:51.899 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 8 2023-10-01T08:03:51.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.899+0000 7fc432057700 1 -- 172.21.15.26:0/3314822415 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc42c0a1140 msgr2=0x7fc42c11e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:51.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.899+0000 7fc432057700 1 --2- 172.21.15.26:0/3314822415 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc42c0a1140 0x7fc42c11e390 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fc41c00ec10 tx=0x7fc41c00ef20 comp rx=0 tx=0).stop 2023-10-01T08:03:51.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.900+0000 7fc432057700 1 -- 172.21.15.26:0/3314822415 shutdown_connections 2023-10-01T08:03:51.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.900+0000 7fc432057700 1 --2- 172.21.15.26:0/3314822415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc42c1345d0 0x7fc42c11ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:51.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.900+0000 7fc432057700 1 --2- 172.21.15.26:0/3314822415 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fc42c0a1140 0x7fc42c11e390 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:51.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.900+0000 7fc432057700 1 --2- 172.21.15.26:0/3314822415 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc42c133cc0 0x7fc42c11e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:51.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.900+0000 7fc432057700 1 -- 172.21.15.26:0/3314822415 >> 172.21.15.26:0/3314822415 conn(0x7fc42c0a3050 msgr2=0x7fc42c133250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:03:51.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.900+0000 7fc432057700 1 -- 172.21.15.26:0/3314822415 shutdown_connections 2023-10-01T08:03:51.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:51.900+0000 7fc432057700 1 -- 172.21.15.26:0/3314822415 wait complete. 2023-10-01T08:03:51.914 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-01T08:03:52.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.053+0000 7fb7d635d700 1 Processor -- start 2023-10-01T08:03:52.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.053+0000 7fb7d635d700 1 -- start start 2023-10-01T08:03:52.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.054+0000 7fb7d635d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7d00a09c0 0x7fb7d00a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:52.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.054+0000 7fb7d635d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb7d009d5c0 0x7fb7d00a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:52.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.054+0000 7fb7d635d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7d00a1810 con 0x7fb7d0133920 2023-10-01T08:03:52.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.054+0000 7fb7d635d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7d009ea10 con 0x7fb7d009d5c0 2023-10-01T08:03:52.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.054+0000 7fb7d635d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d009e210 con 0x7fb7d00a09c0 2023-10-01T08:03:52.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.054+0000 7fb7cf7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb7d009d5c0 0x7fb7d00a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:52.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.054+0000 7fb7cf7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb7d009d5c0 0x7fb7d00a12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48016/0 (socket says 172.21.15.26:48016) 2023-10-01T08:03:52.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.054+0000 7fb7cf7fe700 1 -- 172.21.15.26:0/1905380153 learned_addr learned my addr 172.21.15.26:0/1905380153 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:03:52.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.054+0000 7fb7cffff700 1 --2- 172.21.15.26:0/1905380153 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7d00a09c0 0x7fb7d00a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:52.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.054+0000 7fb7cf7fe700 1 -- 172.21.15.26:0/1905380153 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7d00a09c0 msgr2=0x7fb7d00a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:03:52.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.054+0000 7fb7cf7fe700 1 --2- 172.21.15.26:0/1905380153 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7d00a09c0 0x7fb7d00a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:52.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.054+0000 7fb7cf7fe700 1 -- 172.21.15.26:0/1905380153 >> v1:172.21.15.26:6789/0 conn(0x7fb7d0133920 legacy=0x7fb7d0133da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:52.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.054+0000 7fb7cf7fe700 1 -- 172.21.15.26:0/1905380153 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d00a26f0 con 0x7fb7d009d5c0 2023-10-01T08:03:52.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.054+0000 7fb7cffff700 1 --2- 172.21.15.26:0/1905380153 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7d00a09c0 0x7fb7d00a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:03:52.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.054+0000 7fb7cf7fe700 1 --2- 172.21.15.26:0/1905380153 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7d009d5c0 0x7fb7d00a12d0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fb7c40098f0 tx=0x7fb7c4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87bbe89464578f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:03:52.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.054+0000 7fb7ceffd700 1 -- 172.21.15.26:0/1905380153 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4011830 con 0x7fb7d009d5c0 2023-10-01T08:03:52.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.055+0000 7fb7ceffd700 1 -- 172.21.15.26:0/1905380153 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c4011990 con 0x7fb7d009d5c0 2023-10-01T08:03:52.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.055+0000 7fb7ceffd700 1 -- 172.21.15.26:0/1905380153 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4011d20 con 0x7fb7d009d5c0 2023-10-01T08:03:52.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.055+0000 7fb7d635d700 1 -- 172.21.15.26:0/1905380153 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7d009d5c0 msgr2=0x7fb7d00a12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:52.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.055+0000 7fb7d635d700 1 --2- 172.21.15.26:0/1905380153 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7d009d5c0 0x7fb7d00a12d0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fb7c40098f0 tx=0x7fb7c4009c00 comp rx=0 tx=0).stop 2023-10-01T08:03:52.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.055+0000 7fb7d635d700 1 -- 172.21.15.26:0/1905380153 shutdown_connections 2023-10-01T08:03:52.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.055+0000 7fb7d635d700 1 --2- 172.21.15.26:0/1905380153 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7d00a09c0 0x7fb7d00a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:52.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.055+0000 7fb7d635d700 1 --2- 172.21.15.26:0/1905380153 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7d009d5c0 0x7fb7d00a12d0 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:52.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.055+0000 7fb7d635d700 1 -- 172.21.15.26:0/1905380153 >> 172.21.15.26:0/1905380153 conn(0x7fb7d00a2fe0 msgr2=0x7fb7d00a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:03:52.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.055+0000 7fb7d635d700 1 -- 172.21.15.26:0/1905380153 shutdown_connections 2023-10-01T08:03:52.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.055+0000 7fb7d635d700 1 -- 172.21.15.26:0/1905380153 wait complete. 2023-10-01T08:03:52.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.056+0000 7fb7d635d700 1 Processor -- start 2023-10-01T08:03:52.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.056+0000 7fb7d635d700 1 -- start start 2023-10-01T08:03:52.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.057+0000 7fb7d635d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7d009d5c0 0x7fb7d011f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:52.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.057+0000 7fb7d635d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7d00a09c0 0x7fb7d011f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:52.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.057+0000 7fb7d635d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7d0133920 0x7fb7d01c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:52.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.057+0000 7fb7d635d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d00a5a00 con 0x7fb7d009d5c0 2023-10-01T08:03:52.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.057+0000 7fb7d635d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d01222b0 con 0x7fb7d0133920 2023-10-01T08:03:52.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.057+0000 7fb7d635d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d0133400 con 0x7fb7d00a09c0 2023-10-01T08:03:52.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.057+0000 7fb7cffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7d009d5c0 0x7fb7d011f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:52.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.057+0000 7fb7cf7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7d00a09c0 0x7fb7d011f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:52.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.057+0000 7fb7cffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7d009d5c0 0x7fb7d011f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48020/0 (socket says 172.21.15.26:48020) 2023-10-01T08:03:52.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.057+0000 7fb7cffff700 1 -- 172.21.15.26:0/2410227107 learned_addr learned my addr 172.21.15.26:0/2410227107 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:03:52.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.057+0000 7fb7d48fa700 1 --2- 172.21.15.26:0/2410227107 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7d0133920 0x7fb7d01c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:52.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.057+0000 7fb7cffff700 1 -- 172.21.15.26:0/2410227107 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7d00a09c0 msgr2=0x7fb7d011f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:52.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.057+0000 7fb7cffff700 1 --2- 172.21.15.26:0/2410227107 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7d00a09c0 0x7fb7d011f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:52.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.057+0000 7fb7cffff700 1 -- 172.21.15.26:0/2410227107 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7d0133920 msgr2=0x7fb7d01c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:52.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.057+0000 7fb7cffff700 1 --2- 172.21.15.26:0/2410227107 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7d0133920 0x7fb7d01c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:52.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.057+0000 7fb7cffff700 1 -- 172.21.15.26:0/2410227107 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c00094a0 con 0x7fb7d009d5c0 2023-10-01T08:03:52.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.057+0000 7fb7cf7fe700 1 --2- 172.21.15.26:0/2410227107 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7d00a09c0 0x7fb7d011f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:03:52.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.058+0000 7fb7cffff700 1 --2- 172.21.15.26:0/2410227107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7d009d5c0 0x7fb7d011f340 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7fb7c000ec40 tx=0x7fb7c000ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:03:52.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.058+0000 7fb7ccff9700 1 -- 172.21.15.26:0/2410227107 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c000c850 con 0x7fb7d009d5c0 2023-10-01T08:03:52.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.058+0000 7fb7ccff9700 1 -- 172.21.15.26:0/2410227107 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c000c9b0 con 0x7fb7d009d5c0 2023-10-01T08:03:52.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.058+0000 7fb7ccff9700 1 -- 172.21.15.26:0/2410227107 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c000cd20 con 0x7fb7d009d5c0 2023-10-01T08:03:52.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.058+0000 7fb7d635d700 1 -- 172.21.15.26:0/2410227107 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7c4009550 con 0x7fb7d009d5c0 2023-10-01T08:03:52.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.058+0000 7fb7d635d700 1 -- 172.21.15.26:0/2410227107 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7d0120e70 con 0x7fb7d009d5c0 2023-10-01T08:03:52.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.059+0000 7fb7ccff9700 1 -- 172.21.15.26:0/2410227107 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb7c0013470 con 0x7fb7d009d5c0 2023-10-01T08:03:52.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.059+0000 7fb7ccff9700 1 -- 172.21.15.26:0/2410227107 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb7c003fb30 con 0x7fb7d009d5c0 2023-10-01T08:03:52.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.059+0000 7fb7d635d700 1 -- 172.21.15.26:0/2410227107 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7d0120740 con 0x7fb7d009d5c0 2023-10-01T08:03:52.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.064+0000 7fb7ccff9700 1 -- 172.21.15.26:0/2410227107 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb7c0021020 con 0x7fb7d009d5c0 2023-10-01T08:03:52.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.269+0000 7fb7d635d700 1 -- 172.21.15.26:0/2410227107 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb7d004f2a0 con 0x7fb7d009d5c0 2023-10-01T08:03:52.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.270+0000 7fb7ccff9700 1 -- 172.21.15.26:0/2410227107 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb7c0017070 con 0x7fb7d009d5c0 2023-10-01T08:03:52.271 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-01T08:03:52.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.272+0000 7fb7d635d700 1 -- 172.21.15.26:0/2410227107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7d009d5c0 msgr2=0x7fb7d011f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:52.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.272+0000 7fb7d635d700 1 --2- 172.21.15.26:0/2410227107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7d009d5c0 0x7fb7d011f340 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7fb7c000ec40 tx=0x7fb7c000ef50 comp rx=0 tx=0).stop 2023-10-01T08:03:52.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.272+0000 7fb7d635d700 1 -- 172.21.15.26:0/2410227107 shutdown_connections 2023-10-01T08:03:52.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.272+0000 7fb7d635d700 1 --2- 172.21.15.26:0/2410227107 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb7d0133920 0x7fb7d01c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:52.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.272+0000 7fb7d635d700 1 --2- 172.21.15.26:0/2410227107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7d009d5c0 0x7fb7d011f340 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:52.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.272+0000 7fb7d635d700 1 --2- 172.21.15.26:0/2410227107 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7fb7d00a09c0 0x7fb7d011f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:52.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.272+0000 7fb7d635d700 1 -- 172.21.15.26:0/2410227107 >> 172.21.15.26:0/2410227107 conn(0x7fb7d00a2fe0 msgr2=0x7fb7d01bbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:03:52.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.272+0000 7fb7d635d700 1 -- 172.21.15.26:0/2410227107 shutdown_connections 2023-10-01T08:03:52.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.273+0000 7fb7d635d700 1 -- 172.21.15.26:0/2410227107 wait complete. 2023-10-01T08:03:52.287 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-01T08:03:52.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.425+0000 7f97eea1d700 1 Processor -- start 2023-10-01T08:03:52.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.425+0000 7f97eea1d700 1 -- start start 2023-10-01T08:03:52.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.426+0000 7f97eea1d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97e809d7d0 0x7f97e809dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:52.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.426+0000 7f97eea1d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97e809e0e0 0x7f97e8130770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:52.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.426+0000 7f97eea1d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97e809b800 con 0x7f97e8130cb0 2023-10-01T08:03:52.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.426+0000 7f97eea1d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e809b620 con 0x7f97e809e0e0 2023-10-01T08:03:52.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.426+0000 7f97eea1d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97e809f370 con 0x7f97e809d7d0 2023-10-01T08:03:52.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.426+0000 7f97e77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97e809e0e0 0x7f97e8130770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:52.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.426+0000 7f97e7fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97e809d7d0 0x7f97e809dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:52.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.426+0000 7f97e77fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97e809e0e0 0x7f97e8130770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37384/0 (socket says 172.21.15.26:37384) 2023-10-01T08:03:52.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.426+0000 7f97e77fe700 1 -- 172.21.15.26:0/186115242 learned_addr learned my addr 172.21.15.26:0/186115242 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:03:52.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.426+0000 7f97e77fe700 1 -- 172.21.15.26:0/186115242 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97e809d7d0 msgr2=0x7f97e809dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:03:52.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.426+0000 7f97e77fe700 1 --2- 172.21.15.26:0/186115242 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97e809d7d0 0x7f97e809dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:52.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.426+0000 7f97e6ffd700 1 -- 172.21.15.26:0/186115242 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 991858089 0 0) 0x7f97e809b800 con 0x7f97e8130cb0 2023-10-01T08:03:52.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.426+0000 7f97e77fe700 1 -- 172.21.15.26:0/186115242 >> v1:172.21.15.26:6789/0 conn(0x7f97e8130cb0 legacy=0x7f97e8137a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:52.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.426+0000 7f97e77fe700 1 -- 172.21.15.26:0/186115242 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e809ef80 con 0x7f97e809e0e0 2023-10-01T08:03:52.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.426+0000 7f97e7fff700 1 --2- 172.21.15.26:0/186115242 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97e809d7d0 0x7f97e809dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:03:52.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.427+0000 7f97e77fe700 1 --2- 172.21.15.26:0/186115242 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97e809e0e0 0x7f97e8130770 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f97d0009920 tx=0x7f97d0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b16d82685368c11 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:03:52.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.427+0000 7f97e6ffd700 1 -- 172.21.15.26:0/186115242 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d0011830 con 0x7f97e809e0e0 2023-10-01T08:03:52.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.427+0000 7f97e6ffd700 1 -- 172.21.15.26:0/186115242 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d0011990 con 0x7f97e809e0e0 2023-10-01T08:03:52.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.427+0000 7f97e6ffd700 1 -- 172.21.15.26:0/186115242 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d0011d20 con 0x7f97e809e0e0 2023-10-01T08:03:52.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.427+0000 7f97eea1d700 1 -- 172.21.15.26:0/186115242 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97e809e0e0 msgr2=0x7f97e8130770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:52.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.427+0000 7f97eea1d700 1 --2- 172.21.15.26:0/186115242 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97e809e0e0 0x7f97e8130770 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f97d0009920 tx=0x7f97d0009c30 comp rx=0 tx=0).stop 2023-10-01T08:03:52.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.427+0000 7f97eea1d700 1 -- 172.21.15.26:0/186115242 shutdown_connections 2023-10-01T08:03:52.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.427+0000 7f97eea1d700 1 --2- 172.21.15.26:0/186115242 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97e809d7d0 0x7f97e809dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:52.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.427+0000 7f97eea1d700 1 --2- 172.21.15.26:0/186115242 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97e809e0e0 0x7f97e8130770 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:52.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.427+0000 7f97eea1d700 1 -- 172.21.15.26:0/186115242 >> 172.21.15.26:0/186115242 conn(0x7f97e8066d70 msgr2=0x7f97e80a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:03:52.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.427+0000 7f97eea1d700 1 -- 172.21.15.26:0/186115242 shutdown_connections 2023-10-01T08:03:52.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.427+0000 7f97eea1d700 1 -- 172.21.15.26:0/186115242 wait complete. 2023-10-01T08:03:52.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.428+0000 7f97eea1d700 1 Processor -- start 2023-10-01T08:03:52.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.429+0000 7f97eea1d700 1 -- start start 2023-10-01T08:03:52.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.429+0000 7f97eea1d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97e809d7d0 0x7f97e811e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:52.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.429+0000 7f97eea1d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97e809e0e0 0x7f97e811e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:52.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.429+0000 7f97eea1d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97e8130cb0 0x7f97e811eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:52.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.429+0000 7f97eea1d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e81303f0 con 0x7f97e809d7d0 2023-10-01T08:03:52.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.429+0000 7f97eea1d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e809c720 con 0x7f97e8130cb0 2023-10-01T08:03:52.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.429+0000 7f97eea1d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97e811f890 con 0x7f97e809e0e0 2023-10-01T08:03:52.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.429+0000 7f97e77fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97e809e0e0 0x7f97e811e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:52.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.429+0000 7f97ecfba700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97e8130cb0 0x7f97e811eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:52.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.429+0000 7f97e77fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97e809e0e0 0x7f97e811e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57034/0 (socket says 172.21.15.26:57034) 2023-10-01T08:03:52.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.429+0000 7f97e77fe700 1 -- 172.21.15.26:0/2132376007 learned_addr learned my addr 172.21.15.26:0/2132376007 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:03:52.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.429+0000 7f97e7fff700 1 --2- 172.21.15.26:0/2132376007 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97e809d7d0 0x7f97e811e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:52.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.430+0000 7f97e77fe700 1 -- 172.21.15.26:0/2132376007 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97e8130cb0 msgr2=0x7f97e811eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:52.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.430+0000 7f97e77fe700 1 --2- 172.21.15.26:0/2132376007 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97e8130cb0 0x7f97e811eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:52.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.430+0000 7f97e77fe700 1 -- 172.21.15.26:0/2132376007 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97e809d7d0 msgr2=0x7f97e811e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:52.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.430+0000 7f97e77fe700 1 --2- 172.21.15.26:0/2132376007 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97e809d7d0 0x7f97e811e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:52.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.430+0000 7f97e77fe700 1 -- 172.21.15.26:0/2132376007 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d80094a0 con 0x7f97e809e0e0 2023-10-01T08:03:52.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.430+0000 7f97e77fe700 1 --2- 172.21.15.26:0/2132376007 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97e809e0e0 0x7f97e811e990 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f97d0009c70 tx=0x7f97d0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:03:52.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.430+0000 7f97e4ff9700 1 -- 172.21.15.26:0/2132376007 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d0004240 con 0x7f97e809e0e0 2023-10-01T08:03:52.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.430+0000 7f97e4ff9700 1 -- 172.21.15.26:0/2132376007 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d001f070 con 0x7f97e809e0e0 2023-10-01T08:03:52.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.430+0000 7f97eea1d700 1 -- 172.21.15.26:0/2132376007 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97d0009550 con 0x7f97e809e0e0 2023-10-01T08:03:52.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.430+0000 7f97e4ff9700 1 -- 172.21.15.26:0/2132376007 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d00045a0 con 0x7f97e809e0e0 2023-10-01T08:03:52.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.430+0000 7f97eea1d700 1 -- 172.21.15.26:0/2132376007 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e806b540 con 0x7f97e809e0e0 2023-10-01T08:03:52.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.431+0000 7f97eea1d700 1 -- 172.21.15.26:0/2132376007 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e8120070 con 0x7f97e809e0e0 2023-10-01T08:03:52.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.431+0000 7f97e4ff9700 1 -- 172.21.15.26:0/2132376007 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f97d0021030 con 0x7f97e809e0e0 2023-10-01T08:03:52.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.432+0000 7f97e4ff9700 1 -- 172.21.15.26:0/2132376007 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f97d0040c40 con 0x7f97e809e0e0 2023-10-01T08:03:52.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.436+0000 7f97e4ff9700 1 -- 172.21.15.26:0/2132376007 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f97d00036a0 con 0x7f97e809e0e0 2023-10-01T08:03:52.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.637+0000 7f97eea1d700 1 -- 172.21.15.26:0/2132376007 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f97e804f2a0 con 0x7f97e809e0e0 2023-10-01T08:03:52.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.637+0000 7f97e4ff9700 1 -- 172.21.15.26:0/2132376007 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7f97d0015030 con 0x7f97e809e0e0 2023-10-01T08:03:52.638 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-01T08:03:52.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.639+0000 7f97eea1d700 1 -- 172.21.15.26:0/2132376007 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97e809e0e0 msgr2=0x7f97e811e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:52.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.639+0000 7f97eea1d700 1 --2- 172.21.15.26:0/2132376007 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97e809e0e0 0x7f97e811e990 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f97d0009c70 tx=0x7f97d0004750 comp rx=0 tx=0).stop 2023-10-01T08:03:52.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.639+0000 7f97eea1d700 1 -- 172.21.15.26:0/2132376007 shutdown_connections 2023-10-01T08:03:52.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.639+0000 7f97eea1d700 1 --2- 172.21.15.26:0/2132376007 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97e8130cb0 0x7f97e811eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:52.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.639+0000 7f97eea1d700 1 --2- 172.21.15.26:0/2132376007 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97e809d7d0 0x7f97e811e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:52.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.639+0000 7f97eea1d700 1 --2- 172.21.15.26:0/2132376007 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f97e809e0e0 0x7f97e811e990 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:52.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.639+0000 7f97eea1d700 1 -- 172.21.15.26:0/2132376007 >> 172.21.15.26:0/2132376007 conn(0x7f97e8066d70 msgr2=0x7f97e80a0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:03:52.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.640+0000 7f97eea1d700 1 -- 172.21.15.26:0/2132376007 shutdown_connections 2023-10-01T08:03:52.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.640+0000 7f97eea1d700 1 -- 172.21.15.26:0/2132376007 wait complete. 2023-10-01T08:03:52.654 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-01T08:03:52.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.791+0000 7f27207a4700 1 Processor -- start 2023-10-01T08:03:52.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.791+0000 7f27207a4700 1 -- start start 2023-10-01T08:03:52.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.791+0000 7f27207a4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f271809d6f0 0x7f271809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:52.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.791+0000 7f27207a4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f271809e000 0x7f27181339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:52.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.791+0000 7f27207a4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f271809e410 0x7f2718133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:52.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.791+0000 7f27207a4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f271806b460 con 0x7f271809e000 2023-10-01T08:03:52.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.791+0000 7f27207a4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271809b120 con 0x7f271809e410 2023-10-01T08:03:52.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.791+0000 7f27207a4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f271809a7e0 con 0x7f271809d6f0 2023-10-01T08:03:52.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.791+0000 7f271e540700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f271809d6f0 0x7f271809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:52.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.791+0000 7f271dd3f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f271809e000 0x7f27181339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:52.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.792+0000 7f271e540700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f271809d6f0 0x7f271809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:57042/0 (socket says 172.21.15.26:57042) 2023-10-01T08:03:52.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.792+0000 7f271ed41700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f271809e410 0x7f2718133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:52.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.792+0000 7f271dd3f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f271809e000 0x7f27181339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48026/0 (socket says 172.21.15.26:48026) 2023-10-01T08:03:52.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.792+0000 7f271e540700 1 -- 172.21.15.26:0/634718615 learned_addr learned my addr 172.21.15.26:0/634718615 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:03:52.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.792+0000 7f271ed41700 1 -- 172.21.15.26:0/634718615 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f271809d6f0 msgr2=0x7f271809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:03:52.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.792+0000 7f271ed41700 1 --2- 172.21.15.26:0/634718615 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f271809d6f0 0x7f271809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:52.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.792+0000 7f271ed41700 1 -- 172.21.15.26:0/634718615 >> v2:172.21.15.26:3300/0 conn(0x7f271809e000 msgr2=0x7f27181339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:03:52.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.792+0000 7f271ed41700 1 --2- 172.21.15.26:0/634718615 >> v2:172.21.15.26:3300/0 conn(0x7f271809e000 0x7f27181339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:52.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.792+0000 7f271ed41700 1 -- 172.21.15.26:0/634718615 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271809a500 con 0x7f271809e410 2023-10-01T08:03:52.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.792+0000 7f271e540700 1 --2- 172.21.15.26:0/634718615 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f271809d6f0 0x7f271809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:03:52.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.792+0000 7f271ed41700 1 --2- 172.21.15.26:0/634718615 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f271809e410 0x7f2718133f30 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f2710009dc0 tx=0x7f271000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33215f17db4f7caf server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:03:52.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.792+0000 7f271d53e700 1 -- 172.21.15.26:0/634718615 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271000e070 con 0x7f271809e410 2023-10-01T08:03:52.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.792+0000 7f271d53e700 1 -- 172.21.15.26:0/634718615 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271000bae0 con 0x7f271809e410 2023-10-01T08:03:52.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.792+0000 7f271d53e700 1 -- 172.21.15.26:0/634718615 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271000be90 con 0x7f271809e410 2023-10-01T08:03:52.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.793+0000 7f27207a4700 1 -- 172.21.15.26:0/634718615 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f271809e410 msgr2=0x7f2718133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:52.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.793+0000 7f27207a4700 1 --2- 172.21.15.26:0/634718615 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f271809e410 0x7f2718133f30 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f2710009dc0 tx=0x7f271000b330 comp rx=0 tx=0).stop 2023-10-01T08:03:52.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.793+0000 7f27207a4700 1 -- 172.21.15.26:0/634718615 shutdown_connections 2023-10-01T08:03:52.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.793+0000 7f27207a4700 1 --2- 172.21.15.26:0/634718615 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f271809e410 0x7f2718133f30 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:52.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.793+0000 7f27207a4700 1 --2- 172.21.15.26:0/634718615 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f271809d6f0 0x7f271809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:52.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.793+0000 7f27207a4700 1 --2- 172.21.15.26:0/634718615 >> v2:172.21.15.26:3300/0 conn(0x7f271809e000 0x7f27181339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:52.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.793+0000 7f27207a4700 1 -- 172.21.15.26:0/634718615 >> 172.21.15.26:0/634718615 conn(0x7f2718066f50 msgr2=0x7f271809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:03:52.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.793+0000 7f27207a4700 1 -- 172.21.15.26:0/634718615 shutdown_connections 2023-10-01T08:03:52.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.793+0000 7f27207a4700 1 -- 172.21.15.26:0/634718615 wait complete. 2023-10-01T08:03:52.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.794+0000 7f27207a4700 1 Processor -- start 2023-10-01T08:03:52.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.794+0000 7f27207a4700 1 -- start start 2023-10-01T08:03:52.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.795+0000 7f27207a4700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f271809d6f0 0x7f27181c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:52.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.795+0000 7f27207a4700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f271809e000 0x7f27181c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:52.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.795+0000 7f27207a4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f271809e410 0x7f27181c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:52.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.795+0000 7f27207a4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27181a6420 con 0x7f271809e410 2023-10-01T08:03:52.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.795+0000 7f27207a4700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27181a7c10 con 0x7f271809d6f0 2023-10-01T08:03:52.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.795+0000 7f27207a4700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f271809c710 con 0x7f271809e000 2023-10-01T08:03:52.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.795+0000 7f271e540700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f271809d6f0 0x7f27181c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:52.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.795+0000 7f271e540700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f271809d6f0 0x7f27181c7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:37404/0 (socket says 172.21.15.26:37404) 2023-10-01T08:03:52.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.795+0000 7f271e540700 1 -- 172.21.15.26:0/550143258 learned_addr learned my addr 172.21.15.26:0/550143258 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:03:52.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.795+0000 7f271ed41700 1 --2- 172.21.15.26:0/550143258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f271809e410 0x7f27181c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:52.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.795+0000 7f271dd3f700 1 --2- 172.21.15.26:0/550143258 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f271809e000 0x7f27181c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:52.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.795+0000 7f271ed41700 1 -- 172.21.15.26:0/550143258 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f271809e000 msgr2=0x7f27181c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:52.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.795+0000 7f271ed41700 1 --2- 172.21.15.26:0/550143258 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f271809e000 0x7f27181c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:52.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.795+0000 7f271ed41700 1 -- 172.21.15.26:0/550143258 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f271809d6f0 msgr2=0x7f27181c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:52.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.795+0000 7f271ed41700 1 --2- 172.21.15.26:0/550143258 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f271809d6f0 0x7f27181c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:52.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.795+0000 7f271ed41700 1 -- 172.21.15.26:0/550143258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2714009550 con 0x7f271809e410 2023-10-01T08:03:52.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.795+0000 7f271e540700 1 --2- 172.21.15.26:0/550143258 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f271809d6f0 0x7f27181c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:03:52.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.795+0000 7f271ed41700 1 --2- 172.21.15.26:0/550143258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f271809e410 0x7f27181c8a30 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f2710016000 tx=0x7f2710004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:03:52.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.795+0000 7f270effd700 1 -- 172.21.15.26:0/550143258 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710004550 con 0x7f271809e410 2023-10-01T08:03:52.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.795+0000 7f270effd700 1 -- 172.21.15.26:0/550143258 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2710020070 con 0x7f271809e410 2023-10-01T08:03:52.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.795+0000 7f270effd700 1 -- 172.21.15.26:0/550143258 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710004950 con 0x7f271809e410 2023-10-01T08:03:52.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.795+0000 7f27207a4700 1 -- 172.21.15.26:0/550143258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2710009a70 con 0x7f271809e410 2023-10-01T08:03:52.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.796+0000 7f27207a4700 1 -- 172.21.15.26:0/550143258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27181a6f10 con 0x7f271809e410 2023-10-01T08:03:52.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.796+0000 7f270effd700 1 -- 172.21.15.26:0/550143258 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2710027480 con 0x7f271809e410 2023-10-01T08:03:52.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.796+0000 7f27207a4700 1 -- 172.21.15.26:0/550143258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2718074ea0 con 0x7f271809e410 2023-10-01T08:03:52.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.796+0000 7f270effd700 1 -- 172.21.15.26:0/550143258 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2710022070 con 0x7f271809e410 2023-10-01T08:03:52.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:52.801+0000 7f270effd700 1 -- 172.21.15.26:0/550143258 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f271002c030 con 0x7f271809e410 2023-10-01T08:03:53.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.021+0000 7f27207a4700 1 -- 172.21.15.26:0/550143258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f271806c360 con 0x7f271809e410 2023-10-01T08:03:53.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.022+0000 7f270effd700 1 -- 172.21.15.26:0/550143258 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 11 entries v40) v1 ==== 81+0+638 (secure 0 0 0) 0x7f2710035080 con 0x7f271809e410 2023-10-01T08:03:53.023 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6816/126763 2023-10-02T07:55:13.986258+0000 2023-10-01T08:03:53.023 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/3996608962 2023-10-02T07:55:13.986258+0000 2023-10-01T08:03:53.023 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/1290599107 2023-10-02T07:54:14.803384+0000 2023-10-01T08:03:53.023 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/1542035933 2023-10-02T07:55:13.986258+0000 2023-10-01T08:03:53.023 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6816/118178 2023-10-02T07:54:14.803384+0000 2023-10-01T08:03:53.024 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6817/2857714939 2023-10-02T07:54:39.862609+0000 2023-10-01T08:03:53.024 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/616154075 2023-10-02T07:54:14.803384+0000 2023-10-01T08:03:53.024 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/3455045759 2023-10-02T07:55:13.986258+0000 2023-10-01T08:03:53.024 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/2793881876 2023-10-02T07:55:13.986258+0000 2023-10-01T08:03:53.024 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/3315382155 2023-10-02T07:55:13.986258+0000 2023-10-01T08:03:53.024 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/3694083100 2023-10-02T07:55:13.986258+0000 2023-10-01T08:03:53.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.024+0000 7f27207a4700 1 -- 172.21.15.26:0/550143258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f271809e410 msgr2=0x7f27181c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:53.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.024+0000 7f27207a4700 1 --2- 172.21.15.26:0/550143258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f271809e410 0x7f27181c8a30 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f2710016000 tx=0x7f2710004ad0 comp rx=0 tx=0).stop 2023-10-01T08:03:53.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.024+0000 7f27207a4700 1 -- 172.21.15.26:0/550143258 shutdown_connections 2023-10-01T08:03:53.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.024+0000 7f27207a4700 1 --2- 172.21.15.26:0/550143258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f271809e410 0x7f27181c8a30 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:53.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.024+0000 7f27207a4700 1 --2- 172.21.15.26:0/550143258 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f271809d6f0 0x7f27181c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:53.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.024+0000 7f27207a4700 1 --2- 172.21.15.26:0/550143258 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f271809e000 0x7f27181c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:53.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.024+0000 7f27207a4700 1 -- 172.21.15.26:0/550143258 >> 172.21.15.26:0/550143258 conn(0x7f2718066f50 msgr2=0x7f27181bbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:03:53.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.024+0000 7f27207a4700 1 -- 172.21.15.26:0/550143258 shutdown_connections 2023-10-01T08:03:53.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.024+0000 7f27207a4700 1 -- 172.21.15.26:0/550143258 wait complete. 2023-10-01T08:03:53.027 INFO:teuthology.orchestra.run.smithi026.stderr:listed 11 entries 2023-10-01T08:03:53.038 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-01T08:03:53.039 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-01T08:03:53.062 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-01T08:03:53.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.199+0000 7ffa6857c700 1 Processor -- start 2023-10-01T08:03:53.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.199+0000 7ffa6857c700 1 -- start start 2023-10-01T08:03:53.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.199+0000 7ffa6857c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffa6009d6f0 0x7ffa6009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:53.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.199+0000 7ffa6857c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa6009e000 0x7ffa60130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:53.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.199+0000 7ffa6857c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa6009f130 con 0x7ffa6009e410 2023-10-01T08:03:53.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.199+0000 7ffa6857c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa6009f520 con 0x7ffa6009d6f0 2023-10-01T08:03:53.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.199+0000 7ffa6857c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6009e930 con 0x7ffa6009e000 2023-10-01T08:03:53.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.200+0000 7ffa66318700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffa6009d6f0 0x7ffa6009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:53.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.200+0000 7ffa66318700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffa6009d6f0 0x7ffa6009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48044/0 (socket says 172.21.15.26:48044) 2023-10-01T08:03:53.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.200+0000 7ffa65b17700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa6009e000 0x7ffa60130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:53.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.200+0000 7ffa66318700 1 -- 172.21.15.26:0/404370849 learned_addr learned my addr 172.21.15.26:0/404370849 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:03:53.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.200+0000 7ffa66b19700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ffa6009e410 0x7ffa60130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45340/0 (socket says 172.21.15.26:45340) 2023-10-01T08:03:53.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.200+0000 7ffa66318700 1 -- 172.21.15.26:0/404370849 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa6009e000 msgr2=0x7ffa60130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:03:53.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.200+0000 7ffa66318700 1 --2- 172.21.15.26:0/404370849 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa6009e000 0x7ffa60130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:53.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.200+0000 7ffa66318700 1 -- 172.21.15.26:0/404370849 >> v1:172.21.15.26:6789/0 conn(0x7ffa6009e410 legacy=0x7ffa60130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:53.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.200+0000 7ffa66318700 1 -- 172.21.15.26:0/404370849 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6009b2d0 con 0x7ffa6009d6f0 2023-10-01T08:03:53.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.200+0000 7ffa65b17700 1 --2- 172.21.15.26:0/404370849 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa6009e000 0x7ffa60130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:03:53.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.200+0000 7ffa66318700 1 --2- 172.21.15.26:0/404370849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa6009d6f0 0x7ffa6009dac0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c0098f0 tx=0x7ffa5c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bc2d01776cdf47c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:03:53.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.200+0000 7ffa65316700 1 -- 172.21.15.26:0/404370849 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c00f8a0 con 0x7ffa6009d6f0 2023-10-01T08:03:53.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.200+0000 7ffa65316700 1 -- 172.21.15.26:0/404370849 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5c00fa00 con 0x7ffa6009d6f0 2023-10-01T08:03:53.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.200+0000 7ffa65316700 1 -- 172.21.15.26:0/404370849 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c00fd90 con 0x7ffa6009d6f0 2023-10-01T08:03:53.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.201+0000 7ffa6857c700 1 -- 172.21.15.26:0/404370849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa6009d6f0 msgr2=0x7ffa6009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:53.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.201+0000 7ffa6857c700 1 --2- 172.21.15.26:0/404370849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa6009d6f0 0x7ffa6009dac0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c0098f0 tx=0x7ffa5c009c00 comp rx=0 tx=0).stop 2023-10-01T08:03:53.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.201+0000 7ffa6857c700 1 -- 172.21.15.26:0/404370849 shutdown_connections 2023-10-01T08:03:53.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.201+0000 7ffa6857c700 1 --2- 172.21.15.26:0/404370849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa6009d6f0 0x7ffa6009dac0 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:53.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.201+0000 7ffa6857c700 1 --2- 172.21.15.26:0/404370849 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa6009e000 0x7ffa60130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:53.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.201+0000 7ffa6857c700 1 -- 172.21.15.26:0/404370849 >> 172.21.15.26:0/404370849 conn(0x7ffa60066f50 msgr2=0x7ffa6009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:03:53.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.201+0000 7ffa6857c700 1 -- 172.21.15.26:0/404370849 shutdown_connections 2023-10-01T08:03:53.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.201+0000 7ffa6857c700 1 -- 172.21.15.26:0/404370849 wait complete. 2023-10-01T08:03:53.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.202+0000 7ffa6857c700 1 Processor -- start 2023-10-01T08:03:53.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.202+0000 7ffa6857c700 1 -- start start 2023-10-01T08:03:53.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.203+0000 7ffa6857c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa6009d6f0 0x7ffa60122400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:53.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.203+0000 7ffa6857c700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffa6009e000 0x7ffa60122940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:53.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.203+0000 7ffa6857c700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa6009e410 0x7ffa60122e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:53.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.203+0000 7ffa6857c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa60130350 con 0x7ffa6009d6f0 2023-10-01T08:03:53.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.203+0000 7ffa6857c700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa60124070 con 0x7ffa6009e000 2023-10-01T08:03:53.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.203+0000 7ffa6857c700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa60125c00 con 0x7ffa6009e410 2023-10-01T08:03:53.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.203+0000 7ffa66318700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa6009d6f0 0x7ffa60122400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:53.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.203+0000 7ffa66b19700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa6009e410 0x7ffa60122e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:53.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.203+0000 7ffa65b17700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffa6009e000 0x7ffa60122940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:53.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.203+0000 7ffa66318700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa6009d6f0 0x7ffa60122400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48048/0 (socket says 172.21.15.26:48048) 2023-10-01T08:03:53.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.203+0000 7ffa66318700 1 -- 172.21.15.26:0/2338332479 learned_addr learned my addr 172.21.15.26:0/2338332479 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:03:53.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.203+0000 7ffa66b19700 1 -- 172.21.15.26:0/2338332479 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffa6009e000 msgr2=0x7ffa60122940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:53.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.203+0000 7ffa66b19700 1 --2- 172.21.15.26:0/2338332479 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffa6009e000 0x7ffa60122940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:53.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.203+0000 7ffa66b19700 1 -- 172.21.15.26:0/2338332479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa6009d6f0 msgr2=0x7ffa60122400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:53.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.203+0000 7ffa66b19700 1 --2- 172.21.15.26:0/2338332479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa6009d6f0 0x7ffa60122400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:53.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.203+0000 7ffa66b19700 1 -- 172.21.15.26:0/2338332479 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa500094a0 con 0x7ffa6009e410 2023-10-01T08:03:53.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.203+0000 7ffa66318700 1 --2- 172.21.15.26:0/2338332479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa6009d6f0 0x7ffa60122400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:03:53.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.203+0000 7ffa65b17700 1 --2- 172.21.15.26:0/2338332479 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffa6009e000 0x7ffa60122940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:03:53.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.203+0000 7ffa66b19700 1 --2- 172.21.15.26:0/2338332479 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa6009e410 0x7ffa60122e80 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7ffa5800cb10 tx=0x7ffa5800ce20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:03:53.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.203+0000 7ffa56ffd700 1 -- 172.21.15.26:0/2338332479 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5800a9e0 con 0x7ffa6009e410 2023-10-01T08:03:53.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.203+0000 7ffa56ffd700 1 -- 172.21.15.26:0/2338332479 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5800ab40 con 0x7ffa6009e410 2023-10-01T08:03:53.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.203+0000 7ffa56ffd700 1 -- 172.21.15.26:0/2338332479 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa58007070 con 0x7ffa6009e410 2023-10-01T08:03:53.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.203+0000 7ffa6857c700 1 -- 172.21.15.26:0/2338332479 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa5c009550 con 0x7ffa6009e410 2023-10-01T08:03:53.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.204+0000 7ffa6857c700 1 -- 172.21.15.26:0/2338332479 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa601247c0 con 0x7ffa6009e410 2023-10-01T08:03:53.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.204+0000 7ffa56ffd700 1 -- 172.21.15.26:0/2338332479 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffa580071d0 con 0x7ffa6009e410 2023-10-01T08:03:53.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.204+0000 7ffa56ffd700 1 -- 172.21.15.26:0/2338332479 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ffa5803f330 con 0x7ffa6009e410 2023-10-01T08:03:53.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.204+0000 7ffa6857c700 1 -- 172.21.15.26:0/2338332479 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa601258a0 con 0x7ffa6009e410 2023-10-01T08:03:53.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.209+0000 7ffa56ffd700 1 -- 172.21.15.26:0/2338332479 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa58017070 con 0x7ffa6009e410 2023-10-01T08:03:53.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.416+0000 7ffa6857c700 1 -- 172.21.15.26:0/2338332479 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa60074ea0 con 0x7ffa6009e410 2023-10-01T08:03:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.417+0000 7ffa56ffd700 1 -- 172.21.15.26:0/2338332479 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+13445 (secure 0 0 0) 0x7ffa5801b3b0 con 0x7ffa6009e410 2023-10-01T08:03:53.418 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-10-01T08:03:53.418 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":40,"fsid":"c29fb19d-520c-42a6-90f4-e7f86de96e8e","created":"2023-10-01T07:51:40.702414+0000","modified":"2023-10-01T07:55:13.986312+0000","last_up_change":"2023-10-01T07:54:35.033170+0000","last_in_change":"2023-10-01T07:51:42.084736+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-01T07:51:48.906889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-01T07:51:50.071599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-01T07:51:54.981575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-01T07:51:56.286318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46569ce3-81d1-44a1-a649-691de3e6f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6800","nonce":129479}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6801","nonce":129479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6803","nonce":129479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6802","nonce":129479}]},"public_addr":"172.21.15.26:6800/129479","cluster_addr":"172.21.15.26:6801/129479","heartbeat_back_addr":"172.21.15.26:6803/129479","heartbeat_front_addr":"172.21.15.26:6802/129479","state":["exists","up"]},{"osd":1,"uuid":"1fc1ba9b-4110-4d31-96d6-794937578cff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6804","nonce":129577}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6805","nonce":129577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6807","nonce":129577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6806","nonce":129577}]},"public_addr":"172.21.15.26:6804/129577","cluster_addr":"172.21.15.26:6805/129577","heartbeat_back_addr":"172.21.15.26:6807/129577","heartbeat_front_addr":"172.21.15.26:6806/129577","state":["exists","up"]},{"osd":2,"uuid":"37de933d-3b8e-4b94-87bd-2f36896c7ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6808","nonce":129687}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6809","nonce":129687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6811","nonce":129687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6810","nonce":129687}]},"public_addr":"172.21.15.26:6808/129687","cluster_addr":"172.21.15.26:6809/129687","heartbeat_back_addr":"172.21.15.26:6811/129687","heartbeat_front_addr":"172.21.15.26:6810/129687","state":["exists","up"]},{"osd":3,"uuid":"bd020309-5fd2-4d97-b36a-67e159fa3ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6812","nonce":130029}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6813","nonce":130029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6815","nonce":130029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.26:6814","nonce":130029}]},"public_addr":"172.21.15.26:6812/130029","cluster_addr":"172.21.15.26:6813/130029","heartbeat_back_addr":"172.21.15.26:6815/130029","heartbeat_front_addr":"172.21.15.26:6814/130029","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.029993+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.266503+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.273540+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-10-01T07:54:29.008198+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-01T07:51:47.229731+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.e","mappings":[{"from":3,"to":0}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.39","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:6816/126763":"2023-10-02T07:55:13.986258+0000","172.21.15.26:0/3996608962":"2023-10-02T07:55:13.986258+0000","172.21.15.26:0/1290599107":"2023-10-02T07:54:14.803384+0000","172.21.15.26:0/1542035933":"2023-10-02T07:55:13.986258+0000","172.21.15.26:6816/118178":"2023-10-02T07:54:14.803384+0000","172.21.15.26:6817/2857714939":"2023-10-02T07:54:39.862609+0000","172.21.15.26:0/616154075":"2023-10-02T07:54:14.803384+0000","172.21.15.26:0/3455045759":"2023-10-02T07:55:13.986258+0000","172.21.15.26:0/2793881876":"2023-10-02T07:55:13.986258+0000","172.21.15.26:0/3315382155":"2023-10-02T07:55:13.986258+0000","172.21.15.26:0/3694083100":"2023-10-02T07:55:13.986258+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-01T08:03:53.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.419+0000 7ffa6857c700 1 -- 172.21.15.26:0/2338332479 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa6009e410 msgr2=0x7ffa60122e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:53.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.419+0000 7ffa6857c700 1 --2- 172.21.15.26:0/2338332479 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa6009e410 0x7ffa60122e80 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7ffa5800cb10 tx=0x7ffa5800ce20 comp rx=0 tx=0).stop 2023-10-01T08:03:53.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.420+0000 7ffa6857c700 1 -- 172.21.15.26:0/2338332479 shutdown_connections 2023-10-01T08:03:53.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.420+0000 7ffa6857c700 1 --2- 172.21.15.26:0/2338332479 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7ffa6009e410 0x7ffa60122e80 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:53.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.420+0000 7ffa6857c700 1 --2- 172.21.15.26:0/2338332479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa6009d6f0 0x7ffa60122400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:53.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.420+0000 7ffa6857c700 1 --2- 172.21.15.26:0/2338332479 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffa6009e000 0x7ffa60122940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:53.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.420+0000 7ffa6857c700 1 -- 172.21.15.26:0/2338332479 >> 172.21.15.26:0/2338332479 conn(0x7ffa60066f50 msgr2=0x7ffa6006f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:03:53.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.420+0000 7ffa6857c700 1 -- 172.21.15.26:0/2338332479 shutdown_connections 2023-10-01T08:03:53.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.420+0000 7ffa6857c700 1 -- 172.21.15.26:0/2338332479 wait complete. 2023-10-01T08:03:53.435 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-01T07:51:48.906889+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-01T07:51:50.071599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-01T07:51:54.981575+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-01T07:51:56.286318+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-01T08:03:53.435 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-01T08:03:53.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.578+0000 7f2c7f151700 1 Processor -- start 2023-10-01T08:03:53.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.579+0000 7f2c7f151700 1 -- start start 2023-10-01T08:03:53.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.579+0000 7f2c7f151700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c78071cd0 0x7f2c780720a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:53.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.579+0000 7f2c7f151700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c7809f350 0x7f2c7813bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:53.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.579+0000 7f2c7f151700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c7806bcc0 con 0x7f2c7809e850 2023-10-01T08:03:53.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.579+0000 7f2c7f151700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7806cbf0 con 0x7f2c78071cd0 2023-10-01T08:03:53.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.579+0000 7f2c7f151700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7806ba00 con 0x7f2c7809f350 2023-10-01T08:03:53.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.579+0000 7f2c7d6ee700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c7809f350 0x7f2c7813bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:53.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.579+0000 7f2c7d6ee700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c7809f350 0x7f2c7813bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:40752/0 (socket says 172.21.15.26:40752) 2023-10-01T08:03:53.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.579+0000 7f2c7d6ee700 1 -- 172.21.15.26:0/3024650789 learned_addr learned my addr 172.21.15.26:0/3024650789 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:03:53.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.579+0000 7f2c7ceed700 1 --2- 172.21.15.26:0/3024650789 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c78071cd0 0x7f2c780720a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:53.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.579+0000 7f2c77fff700 1 --1- 172.21.15.26:0/3024650789 >> v1:172.21.15.26:6789/0 conn(0x7f2c7809e850 0x7f2c7809ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:51042/0 (socket says 172.21.15.26:51042) 2023-10-01T08:03:53.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.580+0000 7f2c7ceed700 1 -- 172.21.15.26:0/3024650789 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c7809f350 msgr2=0x7f2c7813bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:03:53.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.580+0000 7f2c7ceed700 1 --2- 172.21.15.26:0/3024650789 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c7809f350 0x7f2c7813bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:53.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.580+0000 7f2c7ceed700 1 -- 172.21.15.26:0/3024650789 >> v1:172.21.15.26:6789/0 conn(0x7f2c7809e850 legacy=0x7f2c7809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:53.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.580+0000 7f2c777fe700 1 -- 172.21.15.26:0/3024650789 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1289909073 0 0) 0x7f2c7806bcc0 con 0x7f2c7809e850 2023-10-01T08:03:53.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.580+0000 7f2c7ceed700 1 -- 172.21.15.26:0/3024650789 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c7806c0f0 con 0x7f2c78071cd0 2023-10-01T08:03:53.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.580+0000 7f2c7d6ee700 1 --2- 172.21.15.26:0/3024650789 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c7809f350 0x7f2c7813bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:03:53.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.580+0000 7f2c7ceed700 1 --2- 172.21.15.26:0/3024650789 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c78071cd0 0x7f2c780720a0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f2c68009870 tx=0x7f2c68009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f52a0ed163c14aac server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:03:53.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.580+0000 7f2c777fe700 1 -- 172.21.15.26:0/3024650789 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c68011830 con 0x7f2c78071cd0 2023-10-01T08:03:53.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.580+0000 7f2c777fe700 1 -- 172.21.15.26:0/3024650789 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c68011990 con 0x7f2c78071cd0 2023-10-01T08:03:53.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.580+0000 7f2c777fe700 1 -- 172.21.15.26:0/3024650789 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c68011d20 con 0x7f2c78071cd0 2023-10-01T08:03:53.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.581+0000 7f2c7f151700 1 -- 172.21.15.26:0/3024650789 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c78071cd0 msgr2=0x7f2c780720a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:53.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.581+0000 7f2c7f151700 1 --2- 172.21.15.26:0/3024650789 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c78071cd0 0x7f2c780720a0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f2c68009870 tx=0x7f2c68009b80 comp rx=0 tx=0).stop 2023-10-01T08:03:53.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.581+0000 7f2c7f151700 1 -- 172.21.15.26:0/3024650789 shutdown_connections 2023-10-01T08:03:53.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.581+0000 7f2c7f151700 1 --2- 172.21.15.26:0/3024650789 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c7809f350 0x7f2c7813bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:53.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.581+0000 7f2c7f151700 1 --2- 172.21.15.26:0/3024650789 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c78071cd0 0x7f2c780720a0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:53.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.581+0000 7f2c7f151700 1 -- 172.21.15.26:0/3024650789 >> 172.21.15.26:0/3024650789 conn(0x7f2c780a4130 msgr2=0x7f2c780a4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:03:53.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.581+0000 7f2c7f151700 1 -- 172.21.15.26:0/3024650789 shutdown_connections 2023-10-01T08:03:53.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.581+0000 7f2c7f151700 1 -- 172.21.15.26:0/3024650789 wait complete. 2023-10-01T08:03:53.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.582+0000 7f2c7f151700 1 Processor -- start 2023-10-01T08:03:53.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.582+0000 7f2c7f151700 1 -- start start 2023-10-01T08:03:53.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.582+0000 7f2c7f151700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c78071cd0 0x7f2c781a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:53.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.582+0000 7f2c7f151700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c7809e850 0x7f2c781a3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:53.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.582+0000 7f2c7f151700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c7809f350 0x7f2c781a41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:53.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.582+0000 7f2c7f151700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c781a52c0 con 0x7f2c7809f350 2023-10-01T08:03:53.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.582+0000 7f2c7f151700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7806cda0 con 0x7f2c7809e850 2023-10-01T08:03:53.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.582+0000 7f2c7f151700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c781a6670 con 0x7f2c78071cd0 2023-10-01T08:03:53.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.583+0000 7f2c7ceed700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c78071cd0 0x7f2c781a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:53.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.583+0000 7f2c7d6ee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c7809f350 0x7f2c781a41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:53.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.583+0000 7f2c7ceed700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c78071cd0 0x7f2c781a3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:40754/0 (socket says 172.21.15.26:40754) 2023-10-01T08:03:53.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.583+0000 7f2c77fff700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c7809e850 0x7f2c781a3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:53.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.583+0000 7f2c7ceed700 1 -- 172.21.15.26:0/4042729448 learned_addr learned my addr 172.21.15.26:0/4042729448 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:03:53.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.583+0000 7f2c7d6ee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c7809f350 0x7f2c781a41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35312/0 (socket says 172.21.15.26:35312) 2023-10-01T08:03:53.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.583+0000 7f2c77fff700 1 -- 172.21.15.26:0/4042729448 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c78071cd0 msgr2=0x7f2c781a3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:53.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.583+0000 7f2c77fff700 1 --2- 172.21.15.26:0/4042729448 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c78071cd0 0x7f2c781a3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:53.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.583+0000 7f2c77fff700 1 -- 172.21.15.26:0/4042729448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c7809f350 msgr2=0x7f2c781a41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:53.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.583+0000 7f2c77fff700 1 --2- 172.21.15.26:0/4042729448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c7809f350 0x7f2c781a41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:53.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.583+0000 7f2c77fff700 1 -- 172.21.15.26:0/4042729448 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c70009b30 con 0x7f2c7809e850 2023-10-01T08:03:53.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.583+0000 7f2c7d6ee700 1 --2- 172.21.15.26:0/4042729448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c7809f350 0x7f2c781a41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:03:53.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.583+0000 7f2c77fff700 1 --2- 172.21.15.26:0/4042729448 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c7809e850 0x7f2c781a3c60 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f2c7806f170 tx=0x7f2c6000c750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:03:53.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.583+0000 7f2c757fa700 1 -- 172.21.15.26:0/4042729448 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c60004c80 con 0x7f2c7809e850 2023-10-01T08:03:53.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.583+0000 7f2c757fa700 1 -- 172.21.15.26:0/4042729448 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c60004de0 con 0x7f2c7809e850 2023-10-01T08:03:53.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.583+0000 7f2c7f151700 1 -- 172.21.15.26:0/4042729448 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c680094a0 con 0x7f2c7809e850 2023-10-01T08:03:53.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.583+0000 7f2c757fa700 1 -- 172.21.15.26:0/4042729448 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c60007310 con 0x7f2c7809e850 2023-10-01T08:03:53.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.583+0000 7f2c7f151700 1 -- 172.21.15.26:0/4042729448 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c781a5bb0 con 0x7f2c7809e850 2023-10-01T08:03:53.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.584+0000 7f2c757fa700 1 -- 172.21.15.26:0/4042729448 <== mon.1 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2c60007470 con 0x7f2c7809e850 2023-10-01T08:03:53.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.584+0000 7f2c757fa700 1 -- 172.21.15.26:0/4042729448 <== mon.1 v2:172.21.15.26:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2c6003f210 con 0x7f2c7809e850 2023-10-01T08:03:53.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.584+0000 7f2c7f151700 1 -- 172.21.15.26:0/4042729448 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c780a1480 con 0x7f2c7809e850 2023-10-01T08:03:53.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.589+0000 7f2c757fa700 1 -- 172.21.15.26:0/4042729448 <== mon.1 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2c60007720 con 0x7f2c7809e850 2023-10-01T08:03:53.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.792+0000 7f2c7f151700 1 -- 172.21.15.26:0/4042729448 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2c7804f2a0 con 0x7f2c7809e850 2023-10-01T08:03:53.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.793+0000 7f2c757fa700 1 -- 172.21.15.26:0/4042729448 <== mon.1 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2c6001b7b0 con 0x7f2c7809e850 2023-10-01T08:03:53.794 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-10-01T08:03:53.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.795+0000 7f2c7f151700 1 -- 172.21.15.26:0/4042729448 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c7809e850 msgr2=0x7f2c781a3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:53.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.795+0000 7f2c7f151700 1 --2- 172.21.15.26:0/4042729448 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c7809e850 0x7f2c781a3c60 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f2c7806f170 tx=0x7f2c6000c750 comp rx=0 tx=0).stop 2023-10-01T08:03:53.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.795+0000 7f2c7f151700 1 -- 172.21.15.26:0/4042729448 shutdown_connections 2023-10-01T08:03:53.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.795+0000 7f2c7f151700 1 --2- 172.21.15.26:0/4042729448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c7809f350 0x7f2c781a41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:53.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.795+0000 7f2c7f151700 1 --2- 172.21.15.26:0/4042729448 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f2c78071cd0 0x7f2c781a3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:53.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.795+0000 7f2c7f151700 1 --2- 172.21.15.26:0/4042729448 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2c7809e850 0x7f2c781a3c60 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:53.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.795+0000 7f2c7f151700 1 -- 172.21.15.26:0/4042729448 >> 172.21.15.26:0/4042729448 conn(0x7f2c780a4130 msgr2=0x7f2c781b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:03:53.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.795+0000 7f2c7f151700 1 -- 172.21.15.26:0/4042729448 shutdown_connections 2023-10-01T08:03:53.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.795+0000 7f2c7f151700 1 -- 172.21.15.26:0/4042729448 wait complete. 2023-10-01T08:03:53.810 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-01T08:03:53.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.951+0000 7f53d9d7f700 1 Processor -- start 2023-10-01T08:03:53.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.951+0000 7f53d9d7f700 1 -- start start 2023-10-01T08:03:53.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.952+0000 7f53d9d7f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f53d41303c0 0x7f53d4130790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:53.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.952+0000 7f53d9d7f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f53d406a770 0x7f53d406ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:53.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.952+0000 7f53d9d7f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d409f620 con 0x7f53d406b0c0 2023-10-01T08:03:53.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.952+0000 7f53d9d7f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d4130250 con 0x7f53d41303c0 2023-10-01T08:03:53.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.952+0000 7f53d9d7f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53d409e1b0 con 0x7f53d406a770 2023-10-01T08:03:53.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.952+0000 7f53d2ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f53d406a770 0x7f53d406ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:53.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.952+0000 7f53d2ffd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f53d406a770 0x7f53d406ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:40758/0 (socket says 172.21.15.26:40758) 2023-10-01T08:03:53.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.952+0000 7f53d37fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f53d41303c0 0x7f53d4130790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:53.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.952+0000 7f53d2ffd700 1 -- 172.21.15.26:0/3261180065 learned_addr learned my addr 172.21.15.26:0/3261180065 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:03:53.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.952+0000 7f53d2ffd700 1 -- 172.21.15.26:0/3261180065 >> v2:172.21.15.26:3300/0 conn(0x7f53d41303c0 msgr2=0x7f53d4130790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:03:53.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.952+0000 7f53d2ffd700 1 --2- 172.21.15.26:0/3261180065 >> v2:172.21.15.26:3300/0 conn(0x7f53d41303c0 0x7f53d4130790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:53.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.952+0000 7f53d2ffd700 1 -- 172.21.15.26:0/3261180065 >> v1:172.21.15.26:6789/0 conn(0x7f53d406b0c0 legacy=0x7f53d413a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:53.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.952+0000 7f53d2ffd700 1 -- 172.21.15.26:0/3261180065 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d406b520 con 0x7f53d406a770 2023-10-01T08:03:53.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.952+0000 7f53d37fe700 1 --2- 172.21.15.26:0/3261180065 >> v2:172.21.15.26:3300/0 conn(0x7f53d41303c0 0x7f53d4130790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:03:53.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.953+0000 7f53d2ffd700 1 --2- 172.21.15.26:0/3261180065 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f53d406a770 0x7f53d406ab80 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f53c80098f0 tx=0x7f53c8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7057d16b69cbd2b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:03:53.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.953+0000 7f53d27fc700 1 -- 172.21.15.26:0/3261180065 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c8011830 con 0x7f53d406a770 2023-10-01T08:03:53.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.953+0000 7f53d27fc700 1 -- 172.21.15.26:0/3261180065 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c8011990 con 0x7f53d406a770 2023-10-01T08:03:53.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.953+0000 7f53d27fc700 1 -- 172.21.15.26:0/3261180065 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c8011d20 con 0x7f53d406a770 2023-10-01T08:03:53.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.953+0000 7f53d9d7f700 1 -- 172.21.15.26:0/3261180065 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f53d406a770 msgr2=0x7f53d406ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:53.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.953+0000 7f53d9d7f700 1 --2- 172.21.15.26:0/3261180065 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f53d406a770 0x7f53d406ab80 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f53c80098f0 tx=0x7f53c8009c00 comp rx=0 tx=0).stop 2023-10-01T08:03:53.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.953+0000 7f53d9d7f700 1 -- 172.21.15.26:0/3261180065 shutdown_connections 2023-10-01T08:03:53.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.953+0000 7f53d9d7f700 1 --2- 172.21.15.26:0/3261180065 >> v2:172.21.15.26:3300/0 conn(0x7f53d41303c0 0x7f53d4130790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:53.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.953+0000 7f53d9d7f700 1 --2- 172.21.15.26:0/3261180065 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f53d406a770 0x7f53d406ab80 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:53.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.953+0000 7f53d9d7f700 1 -- 172.21.15.26:0/3261180065 >> 172.21.15.26:0/3261180065 conn(0x7f53d4066d70 msgr2=0x7f53d40a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:03:53.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.953+0000 7f53d9d7f700 1 -- 172.21.15.26:0/3261180065 shutdown_connections 2023-10-01T08:03:53.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.953+0000 7f53d9d7f700 1 -- 172.21.15.26:0/3261180065 wait complete. 2023-10-01T08:03:53.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.954+0000 7f53d9d7f700 1 Processor -- start 2023-10-01T08:03:53.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.955+0000 7f53d9d7f700 1 -- start start 2023-10-01T08:03:53.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.955+0000 7f53d9d7f700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f53d406a770 0x7f53d411d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:53.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.955+0000 7f53d9d7f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53d406b0c0 0x7f53d411de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:53.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.955+0000 7f53d9d7f700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f53d41303c0 0x7f53d411e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:53.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.955+0000 7f53d9d7f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d4120360 con 0x7f53d406b0c0 2023-10-01T08:03:53.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.955+0000 7f53d9d7f700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d411fcc0 con 0x7f53d406a770 2023-10-01T08:03:53.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.955+0000 7f53d9d7f700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53d412d260 con 0x7f53d41303c0 2023-10-01T08:03:53.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.955+0000 7f53d37fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f53d406a770 0x7f53d411d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:53.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.955+0000 7f53d37fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f53d406a770 0x7f53d411d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:59166/0 (socket says 172.21.15.26:59166) 2023-10-01T08:03:53.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.955+0000 7f53d3fff700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f53d41303c0 0x7f53d411e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:53.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.955+0000 7f53d37fe700 1 -- 172.21.15.26:0/4170799560 learned_addr learned my addr 172.21.15.26:0/4170799560 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:03:53.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.955+0000 7f53d2ffd700 1 --2- 172.21.15.26:0/4170799560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53d406b0c0 0x7f53d411de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:53.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.956+0000 7f53d2ffd700 1 -- 172.21.15.26:0/4170799560 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f53d41303c0 msgr2=0x7f53d411e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:53.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.956+0000 7f53d2ffd700 1 --2- 172.21.15.26:0/4170799560 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f53d41303c0 0x7f53d411e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:53.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.956+0000 7f53d2ffd700 1 -- 172.21.15.26:0/4170799560 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f53d406a770 msgr2=0x7f53d411d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:53.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.956+0000 7f53d2ffd700 1 --2- 172.21.15.26:0/4170799560 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f53d406a770 0x7f53d411d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:53.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.956+0000 7f53d2ffd700 1 -- 172.21.15.26:0/4170799560 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c40094a0 con 0x7f53d406b0c0 2023-10-01T08:03:53.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.956+0000 7f53d3fff700 1 --2- 172.21.15.26:0/4170799560 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f53d41303c0 0x7f53d411e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:03:53.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.956+0000 7f53d2ffd700 1 --2- 172.21.15.26:0/4170799560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53d406b0c0 0x7f53d411de70 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f53c8016000 tx=0x7f53c8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:03:53.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.956+0000 7f53bbfff700 1 -- 172.21.15.26:0/4170799560 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c80036a0 con 0x7f53d406b0c0 2023-10-01T08:03:53.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.956+0000 7f53bbfff700 1 -- 172.21.15.26:0/4170799560 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c8003800 con 0x7f53d406b0c0 2023-10-01T08:03:53.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.956+0000 7f53bbfff700 1 -- 172.21.15.26:0/4170799560 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c8003b90 con 0x7f53d406b0c0 2023-10-01T08:03:53.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.956+0000 7f53d9d7f700 1 -- 172.21.15.26:0/4170799560 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c8009550 con 0x7f53d406b0c0 2023-10-01T08:03:53.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.956+0000 7f53d9d7f700 1 -- 172.21.15.26:0/4170799560 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d4130dc0 con 0x7f53d406b0c0 2023-10-01T08:03:53.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.957+0000 7f53bbfff700 1 -- 172.21.15.26:0/4170799560 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f53c8021070 con 0x7f53d406b0c0 2023-10-01T08:03:53.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.957+0000 7f53bbfff700 1 -- 172.21.15.26:0/4170799560 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f53c8040a50 con 0x7f53d406b0c0 2023-10-01T08:03:53.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.957+0000 7f53d9d7f700 1 -- 172.21.15.26:0/4170799560 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d404f2a0 con 0x7f53d406b0c0 2023-10-01T08:03:53.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:53.962+0000 7f53bbfff700 1 -- 172.21.15.26:0/4170799560 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f53c8029020 con 0x7f53d406b0c0 2023-10-01T08:03:54.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.166+0000 7f53d9d7f700 1 -- 172.21.15.26:0/4170799560 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f53d4120110 con 0x7f53d406b0c0 2023-10-01T08:03:54.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.167+0000 7f53bbfff700 1 -- 172.21.15.26:0/4170799560 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v40) v1 ==== 92+0+10 (secure 0 0 0) 0x7f53c8015070 con 0x7f53d406b0c0 2023-10-01T08:03:54.168 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 8 2023-10-01T08:03:54.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.169+0000 7f53d9d7f700 1 -- 172.21.15.26:0/4170799560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53d406b0c0 msgr2=0x7f53d411de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:54.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.169+0000 7f53d9d7f700 1 --2- 172.21.15.26:0/4170799560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53d406b0c0 0x7f53d411de70 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f53c8016000 tx=0x7f53c8004750 comp rx=0 tx=0).stop 2023-10-01T08:03:54.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.169+0000 7f53d9d7f700 1 -- 172.21.15.26:0/4170799560 shutdown_connections 2023-10-01T08:03:54.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.169+0000 7f53d9d7f700 1 --2- 172.21.15.26:0/4170799560 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f53d41303c0 0x7f53d411e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:54.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.169+0000 7f53d9d7f700 1 --2- 172.21.15.26:0/4170799560 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f53d406a770 0x7f53d411d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:54.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.169+0000 7f53d9d7f700 1 --2- 172.21.15.26:0/4170799560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53d406b0c0 0x7f53d411de70 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:54.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.169+0000 7f53d9d7f700 1 -- 172.21.15.26:0/4170799560 >> 172.21.15.26:0/4170799560 conn(0x7f53d4066d70 msgr2=0x7f53d409b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:03:54.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.169+0000 7f53d9d7f700 1 -- 172.21.15.26:0/4170799560 shutdown_connections 2023-10-01T08:03:54.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.169+0000 7f53d9d7f700 1 -- 172.21.15.26:0/4170799560 wait complete. 2023-10-01T08:03:54.184 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-01T08:03:54.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.323+0000 7f33bade7700 1 Processor -- start 2023-10-01T08:03:54.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.323+0000 7f33bade7700 1 -- start start 2023-10-01T08:03:54.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.324+0000 7f33bade7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f33b41367a0 0x7f33b4138b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:54.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.324+0000 7f33bade7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33b41390c0 0x7f33b413b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:54.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.324+0000 7f33bade7700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b41337a0 con 0x7f33b41339a0 2023-10-01T08:03:54.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.324+0000 7f33bade7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b409e770 con 0x7f33b41367a0 2023-10-01T08:03:54.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.324+0000 7f33bade7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33b409e900 con 0x7f33b41390c0 2023-10-01T08:03:54.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.324+0000 7f33b3fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f33b41367a0 0x7f33b4138b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:54.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.324+0000 7f33b9384700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33b41390c0 0x7f33b413b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:54.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.324+0000 7f33b3fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f33b41367a0 0x7f33b4138b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35336/0 (socket says 172.21.15.26:35336) 2023-10-01T08:03:54.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.324+0000 7f33b9384700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33b41390c0 0x7f33b413b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:40774/0 (socket says 172.21.15.26:40774) 2023-10-01T08:03:54.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.324+0000 7f33b3fff700 1 -- 172.21.15.26:0/697574827 learned_addr learned my addr 172.21.15.26:0/697574827 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:03:54.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.324+0000 7f33b8b83700 1 --1- 172.21.15.26:0/697574827 >> v1:172.21.15.26:6789/0 conn(0x7f33b41339a0 0x7f33b4133d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:51058/0 (socket says 172.21.15.26:51058) 2023-10-01T08:03:54.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.324+0000 7f33b9384700 1 -- 172.21.15.26:0/697574827 >> v2:172.21.15.26:3300/0 conn(0x7f33b41367a0 msgr2=0x7f33b4138b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:03:54.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.324+0000 7f33b9384700 1 --2- 172.21.15.26:0/697574827 >> v2:172.21.15.26:3300/0 conn(0x7f33b41367a0 0x7f33b4138b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:54.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.324+0000 7f33b9384700 1 -- 172.21.15.26:0/697574827 >> v1:172.21.15.26:6789/0 conn(0x7f33b41339a0 legacy=0x7f33b4133d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:54.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.324+0000 7f33b9384700 1 -- 172.21.15.26:0/697574827 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b409f670 con 0x7f33b41390c0 2023-10-01T08:03:54.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.324+0000 7f33b3fff700 1 --2- 172.21.15.26:0/697574827 >> v2:172.21.15.26:3300/0 conn(0x7f33b41367a0 0x7f33b4138b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:03:54.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.324+0000 7f33b9384700 1 --2- 172.21.15.26:0/697574827 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33b41390c0 0x7f33b413b4a0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f33ac009dc0 tx=0x7f33ac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c039fc2d3cf5288 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:03:54.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.324+0000 7f33b37fe700 1 -- 172.21.15.26:0/697574827 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac00e070 con 0x7f33b41390c0 2023-10-01T08:03:54.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.325+0000 7f33b37fe700 1 -- 172.21.15.26:0/697574827 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ac00bae0 con 0x7f33b41390c0 2023-10-01T08:03:54.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.325+0000 7f33b37fe700 1 -- 172.21.15.26:0/697574827 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac00be90 con 0x7f33b41390c0 2023-10-01T08:03:54.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.325+0000 7f33bade7700 1 -- 172.21.15.26:0/697574827 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33b41390c0 msgr2=0x7f33b413b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:54.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.325+0000 7f33bade7700 1 --2- 172.21.15.26:0/697574827 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33b41390c0 0x7f33b413b4a0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f33ac009dc0 tx=0x7f33ac00b330 comp rx=0 tx=0).stop 2023-10-01T08:03:54.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.325+0000 7f33bade7700 1 -- 172.21.15.26:0/697574827 shutdown_connections 2023-10-01T08:03:54.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.325+0000 7f33bade7700 1 --2- 172.21.15.26:0/697574827 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33b41390c0 0x7f33b413b4a0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:54.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.325+0000 7f33bade7700 1 --2- 172.21.15.26:0/697574827 >> v2:172.21.15.26:3300/0 conn(0x7f33b41367a0 0x7f33b4138b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:54.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.325+0000 7f33bade7700 1 -- 172.21.15.26:0/697574827 >> 172.21.15.26:0/697574827 conn(0x7f33b4066d70 msgr2=0x7f33b40a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:03:54.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.325+0000 7f33bade7700 1 -- 172.21.15.26:0/697574827 shutdown_connections 2023-10-01T08:03:54.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.325+0000 7f33bade7700 1 -- 172.21.15.26:0/697574827 wait complete. 2023-10-01T08:03:54.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.326+0000 7f33bade7700 1 Processor -- start 2023-10-01T08:03:54.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.326+0000 7f33bade7700 1 -- start start 2023-10-01T08:03:54.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.327+0000 7f33bade7700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33b41339a0 0x7f33b4071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:54.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.327+0000 7f33bade7700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33b41367a0 0x7f33b4072130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:54.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.327+0000 7f33bade7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33b41390c0 0x7f33b41c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:54.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.327+0000 7f33bade7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b4130a10 con 0x7f33b41390c0 2023-10-01T08:03:54.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.327+0000 7f33bade7700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b4138bc0 con 0x7f33b41339a0 2023-10-01T08:03:54.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.327+0000 7f33bade7700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33b412db80 con 0x7f33b41367a0 2023-10-01T08:03:54.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.327+0000 7f33b8b83700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33b41339a0 0x7f33b4071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:54.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.327+0000 7f33b9384700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33b41390c0 0x7f33b41c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:54.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.327+0000 7f33b8b83700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33b41339a0 0x7f33b4071bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:59174/0 (socket says 172.21.15.26:59174) 2023-10-01T08:03:54.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.327+0000 7f33b8b83700 1 -- 172.21.15.26:0/188141861 learned_addr learned my addr 172.21.15.26:0/188141861 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:03:54.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.327+0000 7f33b3fff700 1 --2- 172.21.15.26:0/188141861 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33b41367a0 0x7f33b4072130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:54.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.327+0000 7f33b9384700 1 -- 172.21.15.26:0/188141861 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33b41367a0 msgr2=0x7f33b4072130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:54.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.327+0000 7f33b9384700 1 --2- 172.21.15.26:0/188141861 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33b41367a0 0x7f33b4072130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:54.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.327+0000 7f33b9384700 1 -- 172.21.15.26:0/188141861 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33b41339a0 msgr2=0x7f33b4071bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:54.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.327+0000 7f33b9384700 1 --2- 172.21.15.26:0/188141861 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33b41339a0 0x7f33b4071bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:54.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.327+0000 7f33b9384700 1 -- 172.21.15.26:0/188141861 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a0009550 con 0x7f33b41390c0 2023-10-01T08:03:54.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.327+0000 7f33b8b83700 1 --2- 172.21.15.26:0/188141861 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33b41339a0 0x7f33b4071bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:03:54.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.328+0000 7f33b9384700 1 --2- 172.21.15.26:0/188141861 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33b41390c0 0x7f33b41c84c0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f33ac016000 tx=0x7f33ac004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:03:54.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.328+0000 7f33b17fa700 1 -- 172.21.15.26:0/188141861 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac0045d0 con 0x7f33b41390c0 2023-10-01T08:03:54.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.328+0000 7f33b17fa700 1 -- 172.21.15.26:0/188141861 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ac020070 con 0x7f33b41390c0 2023-10-01T08:03:54.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.328+0000 7f33bade7700 1 -- 172.21.15.26:0/188141861 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33ac009a70 con 0x7f33b41390c0 2023-10-01T08:03:54.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.328+0000 7f33b17fa700 1 -- 172.21.15.26:0/188141861 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac027480 con 0x7f33b41390c0 2023-10-01T08:03:54.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.328+0000 7f33bade7700 1 -- 172.21.15.26:0/188141861 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b409a480 con 0x7f33b41390c0 2023-10-01T08:03:54.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.329+0000 7f33b17fa700 1 -- 172.21.15.26:0/188141861 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f33ac0275e0 con 0x7f33b41390c0 2023-10-01T08:03:54.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.329+0000 7f33b17fa700 1 -- 172.21.15.26:0/188141861 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f33ac022070 con 0x7f33b41390c0 2023-10-01T08:03:54.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.329+0000 7f33bade7700 1 -- 172.21.15.26:0/188141861 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33b404f2a0 con 0x7f33b41390c0 2023-10-01T08:03:54.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.334+0000 7f33b17fa700 1 -- 172.21.15.26:0/188141861 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f33ac027890 con 0x7f33b41390c0 2023-10-01T08:03:54.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.536+0000 7f33bade7700 1 -- 172.21.15.26:0/188141861 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f33b406b500 con 0x7f33b41390c0 2023-10-01T08:03:54.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.537+0000 7f33b17fa700 1 -- 172.21.15.26:0/188141861 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7f33ac035020 con 0x7f33b41390c0 2023-10-01T08:03:54.538 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-10-01T08:03:54.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.539+0000 7f33bade7700 1 -- 172.21.15.26:0/188141861 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33b41390c0 msgr2=0x7f33b41c84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:54.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.539+0000 7f33bade7700 1 --2- 172.21.15.26:0/188141861 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33b41390c0 0x7f33b41c84c0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f33ac016000 tx=0x7f33ac004ad0 comp rx=0 tx=0).stop 2023-10-01T08:03:54.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.539+0000 7f33bade7700 1 -- 172.21.15.26:0/188141861 shutdown_connections 2023-10-01T08:03:54.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.539+0000 7f33bade7700 1 --2- 172.21.15.26:0/188141861 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33b41390c0 0x7f33b41c84c0 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:54.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.539+0000 7f33bade7700 1 --2- 172.21.15.26:0/188141861 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33b41339a0 0x7f33b4071bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:54.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.539+0000 7f33bade7700 1 --2- 172.21.15.26:0/188141861 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f33b41367a0 0x7f33b4072130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:54.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.539+0000 7f33bade7700 1 -- 172.21.15.26:0/188141861 >> 172.21.15.26:0/188141861 conn(0x7f33b4066d70 msgr2=0x7f33b4134540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:03:54.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.539+0000 7f33bade7700 1 -- 172.21.15.26:0/188141861 shutdown_connections 2023-10-01T08:03:54.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.539+0000 7f33bade7700 1 -- 172.21.15.26:0/188141861 wait complete. 2023-10-01T08:03:54.553 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-01T08:03:54.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.692+0000 7f7db8077700 1 Processor -- start 2023-10-01T08:03:54.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.692+0000 7f7db8077700 1 -- start start 2023-10-01T08:03:54.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.692+0000 7f7db8077700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7db009d7d0 0x7f7db009dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:54.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.692+0000 7f7db8077700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7db009e0e0 0x7f7db0130770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:54.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.693+0000 7f7db8077700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7db009b800 con 0x7f7db0130cb0 2023-10-01T08:03:54.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.693+0000 7f7db8077700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7db009b620 con 0x7f7db009d7d0 2023-10-01T08:03:54.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.693+0000 7f7db8077700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db009f370 con 0x7f7db009e0e0 2023-10-01T08:03:54.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.693+0000 7f7db5612700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7db009e0e0 0x7f7db0130770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:54.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.693+0000 7f7db5612700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7db009e0e0 0x7f7db0130770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:59188/0 (socket says 172.21.15.26:59188) 2023-10-01T08:03:54.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.693+0000 7f7db5612700 1 -- 172.21.15.26:0/1240970290 learned_addr learned my addr 172.21.15.26:0/1240970290 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:03:54.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.693+0000 7f7db5e13700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7db009d7d0 0x7f7db009dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:54.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.693+0000 7f7db5e13700 1 -- 172.21.15.26:0/1240970290 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7db009e0e0 msgr2=0x7f7db0130770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:03:54.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.693+0000 7f7db5e13700 1 --2- 172.21.15.26:0/1240970290 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7db009e0e0 0x7f7db0130770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:54.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.693+0000 7f7db5e13700 1 -- 172.21.15.26:0/1240970290 >> v1:172.21.15.26:6789/0 conn(0x7f7db0130cb0 legacy=0x7f7db0137a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:54.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.693+0000 7f7db5e13700 1 -- 172.21.15.26:0/1240970290 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db009ef80 con 0x7f7db009d7d0 2023-10-01T08:03:54.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.693+0000 7f7db5e13700 1 --2- 172.21.15.26:0/1240970290 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7db009d7d0 0x7f7db009dba0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f7dac009840 tx=0x7f7dac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbed24c2ac5f3753 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:03:54.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.693+0000 7f7db4e11700 1 -- 172.21.15.26:0/1240970290 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dac011830 con 0x7f7db009d7d0 2023-10-01T08:03:54.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.693+0000 7f7db4e11700 1 -- 172.21.15.26:0/1240970290 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dac011990 con 0x7f7db009d7d0 2023-10-01T08:03:54.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.693+0000 7f7db4e11700 1 -- 172.21.15.26:0/1240970290 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dac011d20 con 0x7f7db009d7d0 2023-10-01T08:03:54.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.694+0000 7f7db8077700 1 -- 172.21.15.26:0/1240970290 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7db009d7d0 msgr2=0x7f7db009dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:54.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.694+0000 7f7db8077700 1 --2- 172.21.15.26:0/1240970290 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7db009d7d0 0x7f7db009dba0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f7dac009840 tx=0x7f7dac009b50 comp rx=0 tx=0).stop 2023-10-01T08:03:54.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.694+0000 7f7db8077700 1 -- 172.21.15.26:0/1240970290 shutdown_connections 2023-10-01T08:03:54.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.694+0000 7f7db8077700 1 --2- 172.21.15.26:0/1240970290 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7db009d7d0 0x7f7db009dba0 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:54.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.694+0000 7f7db8077700 1 --2- 172.21.15.26:0/1240970290 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7db009e0e0 0x7f7db0130770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:54.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.694+0000 7f7db8077700 1 -- 172.21.15.26:0/1240970290 >> 172.21.15.26:0/1240970290 conn(0x7f7db0066d70 msgr2=0x7f7db00a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:03:54.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.694+0000 7f7db8077700 1 -- 172.21.15.26:0/1240970290 shutdown_connections 2023-10-01T08:03:54.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.694+0000 7f7db8077700 1 -- 172.21.15.26:0/1240970290 wait complete. 2023-10-01T08:03:54.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.695+0000 7f7db8077700 1 Processor -- start 2023-10-01T08:03:54.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.695+0000 7f7db8077700 1 -- start start 2023-10-01T08:03:54.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.696+0000 7f7db8077700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7db009d7d0 0x7f7db011e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:54.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.696+0000 7f7db8077700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7db009e0e0 0x7f7db011eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:54.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.696+0000 7f7db8077700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7db0130cb0 0x7f7db011f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:54.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.696+0000 7f7db8077700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db0120230 con 0x7f7db0130cb0 2023-10-01T08:03:54.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.696+0000 7f7db8077700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db0071c30 con 0x7f7db009e0e0 2023-10-01T08:03:54.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.696+0000 7f7db8077700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7db01207e0 con 0x7f7db009d7d0 2023-10-01T08:03:54.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.696+0000 7f7db5e13700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7db009d7d0 0x7f7db011e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:54.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.696+0000 7f7db5e13700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7db009d7d0 0x7f7db011e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:40804/0 (socket says 172.21.15.26:40804) 2023-10-01T08:03:54.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.696+0000 7f7db6614700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7db0130cb0 0x7f7db011f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:54.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.696+0000 7f7db5e13700 1 -- 172.21.15.26:0/2692645133 learned_addr learned my addr 172.21.15.26:0/2692645133 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:03:54.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.696+0000 7f7db5612700 1 --2- 172.21.15.26:0/2692645133 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7db009e0e0 0x7f7db011eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:54.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.696+0000 7f7db5e13700 1 -- 172.21.15.26:0/2692645133 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7db009e0e0 msgr2=0x7f7db011eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:54.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.696+0000 7f7db5e13700 1 --2- 172.21.15.26:0/2692645133 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7db009e0e0 0x7f7db011eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:54.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.696+0000 7f7db5e13700 1 -- 172.21.15.26:0/2692645133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7db0130cb0 msgr2=0x7f7db011f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:54.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.696+0000 7f7db5e13700 1 --2- 172.21.15.26:0/2692645133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7db0130cb0 0x7f7db011f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:54.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.696+0000 7f7db5e13700 1 -- 172.21.15.26:0/2692645133 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dac0094a0 con 0x7f7db009d7d0 2023-10-01T08:03:54.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.696+0000 7f7db6614700 1 --2- 172.21.15.26:0/2692645133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7db0130cb0 0x7f7db011f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:03:54.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.696+0000 7f7db5e13700 1 --2- 172.21.15.26:0/2692645133 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7db009d7d0 0x7f7db011e620 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f7dac009fd0 tx=0x7f7dac004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:03:54.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.697+0000 7f7da27fc700 1 -- 172.21.15.26:0/2692645133 <== mon.2 v2:172.21.15.26:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dac0036a0 con 0x7f7db009d7d0 2023-10-01T08:03:54.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.697+0000 7f7da27fc700 1 -- 172.21.15.26:0/2692645133 <== mon.2 v2:172.21.15.26:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dac01e070 con 0x7f7db009d7d0 2023-10-01T08:03:54.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.697+0000 7f7da27fc700 1 -- 172.21.15.26:0/2692645133 <== mon.2 v2:172.21.15.26:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dac003a40 con 0x7f7db009d7d0 2023-10-01T08:03:54.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.697+0000 7f7db8077700 1 -- 172.21.15.26:0/2692645133 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7db009c720 con 0x7f7db009d7d0 2023-10-01T08:03:54.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.697+0000 7f7db8077700 1 -- 172.21.15.26:0/2692645133 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7db01228d0 con 0x7f7db009d7d0 2023-10-01T08:03:54.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.697+0000 7f7da27fc700 1 -- 172.21.15.26:0/2692645133 <== mon.2 v2:172.21.15.26:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7dac003ba0 con 0x7f7db009d7d0 2023-10-01T08:03:54.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.698+0000 7f7da27fc700 1 -- 172.21.15.26:0/2692645133 <== mon.2 v2:172.21.15.26:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7dac0405a0 con 0x7f7db009d7d0 2023-10-01T08:03:54.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.698+0000 7f7db8077700 1 -- 172.21.15.26:0/2692645133 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7db004f2a0 con 0x7f7db009d7d0 2023-10-01T08:03:54.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.703+0000 7f7da27fc700 1 -- 172.21.15.26:0/2692645133 <== mon.2 v2:172.21.15.26:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7dac015020 con 0x7f7db009d7d0 2023-10-01T08:03:54.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.904+0000 7f7db8077700 1 -- 172.21.15.26:0/2692645133 --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7db006c380 con 0x7f7db009d7d0 2023-10-01T08:03:54.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.905+0000 7f7da27fc700 1 -- 172.21.15.26:0/2692645133 <== mon.2 v2:172.21.15.26:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7dac02d7d0 con 0x7f7db009d7d0 2023-10-01T08:03:54.906 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-10-01T08:03:54.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.907+0000 7f7db8077700 1 -- 172.21.15.26:0/2692645133 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7db009d7d0 msgr2=0x7f7db011e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:54.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.907+0000 7f7db8077700 1 --2- 172.21.15.26:0/2692645133 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7db009d7d0 0x7f7db011e620 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f7dac009fd0 tx=0x7f7dac004750 comp rx=0 tx=0).stop 2023-10-01T08:03:54.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.907+0000 7f7db8077700 1 -- 172.21.15.26:0/2692645133 shutdown_connections 2023-10-01T08:03:54.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.907+0000 7f7db8077700 1 --2- 172.21.15.26:0/2692645133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7db0130cb0 0x7f7db011f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:54.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.907+0000 7f7db8077700 1 --2- 172.21.15.26:0/2692645133 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f7db009d7d0 0x7f7db011e620 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:54.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.907+0000 7f7db8077700 1 --2- 172.21.15.26:0/2692645133 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7db009e0e0 0x7f7db011eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:54.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.907+0000 7f7db8077700 1 -- 172.21.15.26:0/2692645133 >> 172.21.15.26:0/2692645133 conn(0x7f7db0066d70 msgr2=0x7f7db00709f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:03:54.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.907+0000 7f7db8077700 1 -- 172.21.15.26:0/2692645133 shutdown_connections 2023-10-01T08:03:54.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:54.907+0000 7f7db8077700 1 -- 172.21.15.26:0/2692645133 wait complete. 2023-10-01T08:03:54.921 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-01T08:03:55.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.058+0000 7f92452aa700 1 Processor -- start 2023-10-01T08:03:55.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.058+0000 7f92452aa700 1 -- start start 2023-10-01T08:03:55.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.058+0000 7f92452aa700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f92400a09c0 0x7f92400a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:55.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.058+0000 7f92452aa700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92400a12d0 0x7f9240134030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:55.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.058+0000 7f92452aa700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f924009ea10 con 0x7f924009d5c0 2023-10-01T08:03:55.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.058+0000 7f92452aa700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f924009e210 con 0x7f92400a09c0 2023-10-01T08:03:55.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.058+0000 7f92452aa700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92400a26f0 con 0x7f92400a12d0 2023-10-01T08:03:55.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.058+0000 7f923effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f92400a09c0 0x7f92400a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:55.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.058+0000 7f923f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92400a12d0 0x7f9240134030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:55.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.058+0000 7f923effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f92400a09c0 0x7f92400a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35376/0 (socket says 172.21.15.26:35376) 2023-10-01T08:03:55.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.058+0000 7f923f7fe700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92400a12d0 0x7f9240134030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:59200/0 (socket says 172.21.15.26:59200) 2023-10-01T08:03:55.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.058+0000 7f923effd700 1 -- 172.21.15.26:0/883378932 learned_addr learned my addr 172.21.15.26:0/883378932 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:03:55.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.059+0000 7f923f7fe700 1 -- 172.21.15.26:0/883378932 >> v2:172.21.15.26:3300/0 conn(0x7f92400a09c0 msgr2=0x7f92400a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:03:55.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.059+0000 7f923f7fe700 1 --2- 172.21.15.26:0/883378932 >> v2:172.21.15.26:3300/0 conn(0x7f92400a09c0 0x7f92400a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:55.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.059+0000 7f923f7fe700 1 -- 172.21.15.26:0/883378932 >> v1:172.21.15.26:6789/0 conn(0x7f924009d5c0 legacy=0x7f9240133920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:55.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.059+0000 7f923f7fe700 1 -- 172.21.15.26:0/883378932 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f924009db70 con 0x7f92400a12d0 2023-10-01T08:03:55.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.059+0000 7f923effd700 1 --2- 172.21.15.26:0/883378932 >> v2:172.21.15.26:3300/0 conn(0x7f92400a09c0 0x7f92400a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:03:55.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.059+0000 7f923f7fe700 1 --2- 172.21.15.26:0/883378932 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92400a12d0 0x7f9240134030 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f9230009d90 tx=0x7f923000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec1be80c87d33d70 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:03:55.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.059+0000 7f923dffb700 1 -- 172.21.15.26:0/883378932 <== mon.1 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923000e070 con 0x7f92400a12d0 2023-10-01T08:03:55.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.059+0000 7f923dffb700 1 -- 172.21.15.26:0/883378932 <== mon.1 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923000bb20 con 0x7f92400a12d0 2023-10-01T08:03:55.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.059+0000 7f923dffb700 1 -- 172.21.15.26:0/883378932 <== mon.1 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9230012430 con 0x7f92400a12d0 2023-10-01T08:03:55.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.060+0000 7f92452aa700 1 -- 172.21.15.26:0/883378932 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92400a12d0 msgr2=0x7f9240134030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:55.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.060+0000 7f92452aa700 1 --2- 172.21.15.26:0/883378932 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92400a12d0 0x7f9240134030 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f9230009d90 tx=0x7f923000b330 comp rx=0 tx=0).stop 2023-10-01T08:03:55.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.060+0000 7f92452aa700 1 -- 172.21.15.26:0/883378932 shutdown_connections 2023-10-01T08:03:55.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.060+0000 7f92452aa700 1 --2- 172.21.15.26:0/883378932 >> v2:172.21.15.26:3300/0 conn(0x7f92400a09c0 0x7f92400a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:55.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.060+0000 7f92452aa700 1 --2- 172.21.15.26:0/883378932 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92400a12d0 0x7f9240134030 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:55.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.060+0000 7f92452aa700 1 -- 172.21.15.26:0/883378932 >> 172.21.15.26:0/883378932 conn(0x7f92400a2fe0 msgr2=0x7f92400a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:03:55.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.060+0000 7f92452aa700 1 -- 172.21.15.26:0/883378932 shutdown_connections 2023-10-01T08:03:55.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.060+0000 7f92452aa700 1 -- 172.21.15.26:0/883378932 wait complete. 2023-10-01T08:03:55.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.061+0000 7f92452aa700 1 Processor -- start 2023-10-01T08:03:55.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.061+0000 7f92452aa700 1 -- start start 2023-10-01T08:03:55.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.061+0000 7f92452aa700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f924009d5c0 0x7f92401c51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:55.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.061+0000 7f92452aa700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92400a09c0 0x7f92401c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:55.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.061+0000 7f92452aa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92400a12d0 0x7f92401c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:03:55.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.061+0000 7f92452aa700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92401347d0 con 0x7f92400a12d0 2023-10-01T08:03:55.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.061+0000 7f92452aa700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9240124970 con 0x7f92400a09c0 2023-10-01T08:03:55.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.061+0000 7f92452aa700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92401243d0 con 0x7f924009d5c0 2023-10-01T08:03:55.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.062+0000 7f923e7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92400a09c0 0x7f92401c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:55.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.062+0000 7f923effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f924009d5c0 0x7f92401c51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:55.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.062+0000 7f923f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92400a12d0 0x7f92401c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:03:55.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.062+0000 7f923effd700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f924009d5c0 0x7f92401c51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:40820/0 (socket says 172.21.15.26:40820) 2023-10-01T08:03:55.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.062+0000 7f923effd700 1 -- 172.21.15.26:0/477827584 learned_addr learned my addr 172.21.15.26:0/477827584 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:03:55.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.062+0000 7f923e7fc700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92400a09c0 0x7f92401c56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:59204/0 (socket says 172.21.15.26:59204) 2023-10-01T08:03:55.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.062+0000 7f923f7fe700 1 -- 172.21.15.26:0/477827584 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f924009d5c0 msgr2=0x7f92401c51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:55.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.062+0000 7f923f7fe700 1 --2- 172.21.15.26:0/477827584 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f924009d5c0 0x7f92401c51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:55.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.062+0000 7f923f7fe700 1 -- 172.21.15.26:0/477827584 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92400a09c0 msgr2=0x7f92401c56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:55.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.062+0000 7f923f7fe700 1 --2- 172.21.15.26:0/477827584 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92400a09c0 0x7f92401c56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:55.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.062+0000 7f923f7fe700 1 -- 172.21.15.26:0/477827584 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9238009550 con 0x7f92400a12d0 2023-10-01T08:03:55.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.062+0000 7f923f7fe700 1 --2- 172.21.15.26:0/477827584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92400a12d0 0x7f92401c80f0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f9230016000 tx=0x7f9230004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:03:55.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.062+0000 7f92377fe700 1 -- 172.21.15.26:0/477827584 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9230012430 con 0x7f92400a12d0 2023-10-01T08:03:55.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.062+0000 7f92377fe700 1 -- 172.21.15.26:0/477827584 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9230020070 con 0x7f92400a12d0 2023-10-01T08:03:55.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.062+0000 7f92452aa700 1 -- 172.21.15.26:0/477827584 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9230009a70 con 0x7f92400a12d0 2023-10-01T08:03:55.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.062+0000 7f92377fe700 1 -- 172.21.15.26:0/477827584 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9230004040 con 0x7f92400a12d0 2023-10-01T08:03:55.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.062+0000 7f92452aa700 1 -- 172.21.15.26:0/477827584 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92401236d0 con 0x7f92400a12d0 2023-10-01T08:03:55.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.063+0000 7f92377fe700 1 -- 172.21.15.26:0/477827584 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f92300041a0 con 0x7f92400a12d0 2023-10-01T08:03:55.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.063+0000 7f92377fe700 1 -- 172.21.15.26:0/477827584 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9230022070 con 0x7f92400a12d0 2023-10-01T08:03:55.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.063+0000 7f92452aa700 1 -- 172.21.15.26:0/477827584 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92401238c0 con 0x7f92400a12d0 2023-10-01T08:03:55.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.068+0000 7f92377fe700 1 -- 172.21.15.26:0/477827584 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f92401238c0 con 0x7f92400a12d0 2023-10-01T08:03:55.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.287+0000 7f92452aa700 1 -- 172.21.15.26:0/477827584 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f92401238c0 con 0x7f92400a12d0 2023-10-01T08:03:55.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.288+0000 7f92377fe700 1 -- 172.21.15.26:0/477827584 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 11 entries v40) v1 ==== 81+0+638 (secure 0 0 0) 0x7f92401238c0 con 0x7f92400a12d0 2023-10-01T08:03:55.289 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6816/126763 2023-10-02T07:55:13.986258+0000 2023-10-01T08:03:55.289 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/3996608962 2023-10-02T07:55:13.986258+0000 2023-10-01T08:03:55.289 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/1290599107 2023-10-02T07:54:14.803384+0000 2023-10-01T08:03:55.289 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/1542035933 2023-10-02T07:55:13.986258+0000 2023-10-01T08:03:55.290 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6816/118178 2023-10-02T07:54:14.803384+0000 2023-10-01T08:03:55.290 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6817/2857714939 2023-10-02T07:54:39.862609+0000 2023-10-01T08:03:55.290 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/616154075 2023-10-02T07:54:14.803384+0000 2023-10-01T08:03:55.290 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/3455045759 2023-10-02T07:55:13.986258+0000 2023-10-01T08:03:55.290 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/2793881876 2023-10-02T07:55:13.986258+0000 2023-10-01T08:03:55.290 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/3315382155 2023-10-02T07:55:13.986258+0000 2023-10-01T08:03:55.290 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/3694083100 2023-10-02T07:55:13.986258+0000 2023-10-01T08:03:55.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.290+0000 7f92452aa700 1 -- 172.21.15.26:0/477827584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92400a12d0 msgr2=0x7f92401c80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:03:55.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.290+0000 7f92452aa700 1 --2- 172.21.15.26:0/477827584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92400a12d0 0x7f92401c80f0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f9230016000 tx=0x7f9230004ad0 comp rx=0 tx=0).stop 2023-10-01T08:03:55.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.290+0000 7f92452aa700 1 -- 172.21.15.26:0/477827584 shutdown_connections 2023-10-01T08:03:55.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.290+0000 7f92452aa700 1 --2- 172.21.15.26:0/477827584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92400a12d0 0x7f92401c80f0 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:55.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.290+0000 7f92452aa700 1 --2- 172.21.15.26:0/477827584 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f924009d5c0 0x7f92401c51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:55.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.290+0000 7f92452aa700 1 --2- 172.21.15.26:0/477827584 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92400a09c0 0x7f92401c56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:03:55.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.290+0000 7f92452aa700 1 -- 172.21.15.26:0/477827584 >> 172.21.15.26:0/477827584 conn(0x7f92400a2fe0 msgr2=0x7f92401badc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:03:55.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.290+0000 7f92452aa700 1 -- 172.21.15.26:0/477827584 shutdown_connections 2023-10-01T08:03:55.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:03:55.290+0000 7f92452aa700 1 -- 172.21.15.26:0/477827584 wait complete. 2023-10-01T08:03:55.293 INFO:teuthology.orchestra.run.smithi026.stderr:listed 11 entries 2023-10-01T08:03:55.304 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi092.front.sepia.ceph.com... 2023-10-01T08:03:55.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-01T08:03:55.305 DEBUG:teuthology.orchestra.run.smithi092:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-01T08:03:55.349 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi092.stderr:ceph-fuse[112237]: fuse finished with error 0 and tester_r 0 2023-10-01T08:03:55.351 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T08:04:01.453 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi092.front.sepia.ceph.com 2023-10-01T08:04:01.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-01T08:04:01.453 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-01T08:04:01.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-01T08:04:01.487 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2023-10-01T08:04:01.549 INFO:teuthology.orchestra.run.smithi092.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-01T08:04:01.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-01T08:04:01.549 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-01T08:04:01.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-01T08:04:01.635 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link delete ceph-brx 2023-10-01T08:04:01.707 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-01T08:04:01.719 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-01T08:04:01.719 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-01T08:04:01.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.861+0000 7f0d25e9d700 1 Processor -- start 2023-10-01T08:04:01.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.861+0000 7f0d25e9d700 1 -- start start 2023-10-01T08:04:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.862+0000 7f0d25e9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d2009d6f0 0x7f0d2009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:04:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.862+0000 7f0d25e9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0d2009e000 0x7f0d201339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:04:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.862+0000 7f0d25e9d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d2009b120 con 0x7f0d2009e410 2023-10-01T08:04:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.862+0000 7f0d25e9d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d2006b460 con 0x7f0d2009e000 2023-10-01T08:04:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.862+0000 7f0d25e9d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2009a7e0 con 0x7f0d2009d6f0 2023-10-01T08:04:01.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.862+0000 7f0d1f7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d2009d6f0 0x7f0d2009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:04:01.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.862+0000 7f0d1effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0d2009e000 0x7f0d201339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:04:01.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.862+0000 7f0d1effd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0d2009e000 0x7f0d201339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35390/0 (socket says 172.21.15.26:35390) 2023-10-01T08:04:01.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.862+0000 7f0d1f7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d2009d6f0 0x7f0d2009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3302/0 says I am v2:172.21.15.26:40834/0 (socket says 172.21.15.26:40834) 2023-10-01T08:04:01.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.862+0000 7f0d1effd700 1 -- 172.21.15.26:0/1731916760 learned_addr learned my addr 172.21.15.26:0/1731916760 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:04:01.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.862+0000 7f0d1effd700 1 -- 172.21.15.26:0/1731916760 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d2009d6f0 msgr2=0x7f0d2009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T08:04:01.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.862+0000 7f0d1effd700 1 --2- 172.21.15.26:0/1731916760 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d2009d6f0 0x7f0d2009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:04:01.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.863+0000 7f0d1effd700 1 -- 172.21.15.26:0/1731916760 >> v1:172.21.15.26:6789/0 conn(0x7f0d2009e410 legacy=0x7f0d20133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:04:01.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.863+0000 7f0d1effd700 1 -- 172.21.15.26:0/1731916760 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2009a500 con 0x7f0d2009e000 2023-10-01T08:04:01.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.863+0000 7f0d1f7fe700 1 --2- 172.21.15.26:0/1731916760 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d2009d6f0 0x7f0d2009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:04:01.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.863+0000 7f0d1effd700 1 --2- 172.21.15.26:0/1731916760 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d2009e000 0x7f0d201339f0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f0d080098f0 tx=0x7f0d08009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9afb1c004becc429 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:04:01.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.863+0000 7f0d1e7fc700 1 -- 172.21.15.26:0/1731916760 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d08011830 con 0x7f0d2009e000 2023-10-01T08:04:01.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.863+0000 7f0d1e7fc700 1 -- 172.21.15.26:0/1731916760 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d08011990 con 0x7f0d2009e000 2023-10-01T08:04:01.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.863+0000 7f0d1e7fc700 1 -- 172.21.15.26:0/1731916760 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d08011d20 con 0x7f0d2009e000 2023-10-01T08:04:01.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.863+0000 7f0d25e9d700 1 -- 172.21.15.26:0/1731916760 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d2009e000 msgr2=0x7f0d201339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:04:01.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.863+0000 7f0d25e9d700 1 --2- 172.21.15.26:0/1731916760 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d2009e000 0x7f0d201339f0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f0d080098f0 tx=0x7f0d08009c00 comp rx=0 tx=0).stop 2023-10-01T08:04:01.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.863+0000 7f0d25e9d700 1 -- 172.21.15.26:0/1731916760 shutdown_connections 2023-10-01T08:04:01.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.863+0000 7f0d25e9d700 1 --2- 172.21.15.26:0/1731916760 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d2009d6f0 0x7f0d2009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:04:01.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.863+0000 7f0d25e9d700 1 --2- 172.21.15.26:0/1731916760 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d2009e000 0x7f0d201339f0 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:04:01.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.863+0000 7f0d25e9d700 1 -- 172.21.15.26:0/1731916760 >> 172.21.15.26:0/1731916760 conn(0x7f0d20066f50 msgr2=0x7f0d2009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T08:04:01.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.864+0000 7f0d25e9d700 1 -- 172.21.15.26:0/1731916760 shutdown_connections 2023-10-01T08:04:01.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.864+0000 7f0d25e9d700 1 -- 172.21.15.26:0/1731916760 wait complete. 2023-10-01T08:04:01.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.865+0000 7f0d25e9d700 1 Processor -- start 2023-10-01T08:04:01.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.865+0000 7f0d25e9d700 1 -- start start 2023-10-01T08:04:01.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.865+0000 7f0d25e9d700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d2009d6f0 0x7f0d201a5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:04:01.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.865+0000 7f0d25e9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d2009e000 0x7f0d201a6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:04:01.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.865+0000 7f0d25e9d700 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d2009e410 0x7f0d201a6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T08:04:01.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.865+0000 7f0d25e9d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d201a91f0 con 0x7f0d2009e000 2023-10-01T08:04:01.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.865+0000 7f0d25e9d700 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2009c710 con 0x7f0d2009e410 2023-10-01T08:04:01.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.865+0000 7f0d25e9d700 1 -- --> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d200a3160 con 0x7f0d2009d6f0 2023-10-01T08:04:01.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.865+0000 7f0d1effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d2009e000 0x7f0d201a6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:04:01.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.865+0000 7f0d1effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d2009e000 0x7f0d201a6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35392/0 (socket says 172.21.15.26:35392) 2023-10-01T08:04:01.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.865+0000 7f0d1effd700 1 -- 172.21.15.26:0/2551129130 learned_addr learned my addr 172.21.15.26:0/2551129130 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-10-01T08:04:01.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.865+0000 7f0d1f7fe700 1 --2- >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d2009d6f0 0x7f0d201a5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:04:01.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.865+0000 7f0d1ffff700 1 --2- 172.21.15.26:0/2551129130 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d2009e410 0x7f0d201a6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T08:04:01.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.866+0000 7f0d1effd700 1 -- 172.21.15.26:0/2551129130 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d2009d6f0 msgr2=0x7f0d201a5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:04:01.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.866+0000 7f0d1effd700 1 --2- 172.21.15.26:0/2551129130 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d2009d6f0 0x7f0d201a5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:04:01.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.866+0000 7f0d1effd700 1 -- 172.21.15.26:0/2551129130 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d2009e410 msgr2=0x7f0d201a6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T08:04:01.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.866+0000 7f0d1effd700 1 --2- 172.21.15.26:0/2551129130 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d2009e410 0x7f0d201a6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T08:04:01.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.866+0000 7f0d1effd700 1 -- 172.21.15.26:0/2551129130 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d100094a0 con 0x7f0d2009e000 2023-10-01T08:04:01.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.866+0000 7f0d1f7fe700 1 --2- 172.21.15.26:0/2551129130 >> [v2:172.21.15.26:3302/0,v1:172.21.15.26:6791/0] conn(0x7f0d2009d6f0 0x7f0d201a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:04:01.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.866+0000 7f0d1ffff700 1 --2- 172.21.15.26:0/2551129130 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0d2009e410 0x7f0d201a6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T08:04:01.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.866+0000 7f0d1effd700 1 --2- 172.21.15.26:0/2551129130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d2009e000 0x7f0d201a6510 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f0d08009c40 tx=0x7f0d08004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T08:04:01.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.866+0000 7f0d17fff700 1 -- 172.21.15.26:0/2551129130 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d08004300 con 0x7f0d2009e000 2023-10-01T08:04:01.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.866+0000 7f0d17fff700 1 -- 172.21.15.26:0/2551129130 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0801f070 con 0x7f0d2009e000 2023-10-01T08:04:01.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.866+0000 7f0d25e9d700 1 -- 172.21.15.26:0/2551129130 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d08009550 con 0x7f0d2009e000 2023-10-01T08:04:01.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.866+0000 7f0d17fff700 1 -- 172.21.15.26:0/2551129130 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d080036a0 con 0x7f0d2009e000 2023-10-01T08:04:01.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.866+0000 7f0d25e9d700 1 -- 172.21.15.26:0/2551129130 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d201a8da0 con 0x7f0d2009e000 2023-10-01T08:04:01.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.867+0000 7f0d17fff700 1 -- 172.21.15.26:0/2551129130 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0d08021030 con 0x7f0d2009e000 2023-10-01T08:04:01.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.867+0000 7f0d17fff700 1 -- 172.21.15.26:0/2551129130 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0d08040910 con 0x7f0d2009e000 2023-10-01T08:04:01.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.867+0000 7f0d25e9d700 1 -- 172.21.15.26:0/2551129130 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d201a9420 con 0x7f0d2009e000 2023-10-01T08:04:01.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-10-01T08:04:01.872+0000 7f0d17fff700 1 -- 172.21.15.26:0/2551129130 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0d201a9420 con 0x7f0d2009e000 2023-10-01T08:06:01.760 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-10-01T08:06:01.762 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi026 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-01T08:06:01.772 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-01T08:06:01.772 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-01T08:06:01.772 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T08:06:01.787 INFO:tasks.ceph.mds.a:Stopped 2023-10-01T08:06:01.787 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-01T08:06:01.787 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-01T08:06:01.788 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T08:06:01.858 INFO:tasks.ceph.osd.0:Stopped 2023-10-01T08:06:01.858 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-01T08:06:01.858 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T08:06:01.937 INFO:tasks.ceph.osd.1:Stopped 2023-10-01T08:06:01.938 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-01T08:06:01.938 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T08:06:02.006 INFO:tasks.ceph.osd.2:Stopped 2023-10-01T08:06:02.006 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-01T08:06:02.006 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T08:06:02.074 INFO:tasks.ceph.osd.3:Stopped 2023-10-01T08:06:02.074 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-01T08:06:02.075 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-01T08:06:02.075 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T08:06:02.075 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-01T08:06:02.075 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi026 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi026 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' 2023-10-01T08:06:02.089 INFO:tasks.ceph.mgr.x:Stopped 2023-10-01T08:06:02.090 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-01T08:06:02.090 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-01T08:06:02.090 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T08:06:02.129 INFO:tasks.ceph.mon.a:Stopped 2023-10-01T08:06:02.129 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-01T08:06:02.129 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T08:06:02.182 INFO:tasks.ceph.mon.b:Stopped 2023-10-01T08:06:02.183 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-01T08:06:02.183 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T08:06:02.235 INFO:tasks.ceph.mon.c:Stopped 2023-10-01T08:06:02.236 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-01T08:06:02.236 DEBUG:teuthology.orchestra.run.smithi026:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(FS_' | egrep -v '\(MDS_' | egrep -v '\(OSD_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(CACHE_POOL_' | egrep -v '\(POOL_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v 'Monitor daemon marked osd' | egrep -v 'Behind on trimming' | egrep -v 'Manager daemon' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'scrub mismatch' | egrep -v ScrubResult | egrep -v 'wrongly marked' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_MSGR2_NOT_ENABLED\)' | egrep -v 'slow request' | head -n 1 2023-10-01T08:06:02.325 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi026.front.sepia.ceph.com 2023-10-01T08:06:02.325 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-01T08:06:02.525 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi026.front.sepia.ceph.com 2023-10-01T08:06:02.525 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-01T08:06:02.636 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi026.front.sepia.ceph.com 2023-10-01T08:06:02.636 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-01T08:06:02.744 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi026.front.sepia.ceph.com 2023-10-01T08:06:02.744 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-01T08:06:02.862 INFO:tasks.ceph:Archiving mon data... 2023-10-01T08:06:02.864 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/dparmar-2023-10-01_07:32:21-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408165/data/mon.a.tgz 2023-10-01T08:06:02.864 DEBUG:teuthology.orchestra.run.smithi026:> mktemp 2023-10-01T08:06:02.887 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.z4EHU2gJ1r 2023-10-01T08:06:02.887 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.z4EHU2gJ1r 2023-10-01T08:06:03.041 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.z4EHU2gJ1r 2023-10-01T08:06:03.137 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.z4EHU2gJ1r is 318KB 2023-10-01T08:06:03.232 DEBUG:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.z4EHU2gJ1r 2023-10-01T08:06:03.254 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/dparmar-2023-10-01_07:32:21-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408165/data/mon.b.tgz 2023-10-01T08:06:03.254 DEBUG:teuthology.orchestra.run.smithi026:> mktemp 2023-10-01T08:06:03.316 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.KhfUdzqwmp 2023-10-01T08:06:03.317 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.KhfUdzqwmp 2023-10-01T08:06:03.458 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.KhfUdzqwmp 2023-10-01T08:06:03.553 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.KhfUdzqwmp is 319KB 2023-10-01T08:06:03.647 DEBUG:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.KhfUdzqwmp 2023-10-01T08:06:03.670 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/dparmar-2023-10-01_07:32:21-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408165/data/mon.c.tgz 2023-10-01T08:06:03.670 DEBUG:teuthology.orchestra.run.smithi026:> mktemp 2023-10-01T08:06:03.732 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.9rbNbxLiGc 2023-10-01T08:06:03.732 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.9rbNbxLiGc 2023-10-01T08:06:03.870 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.9rbNbxLiGc 2023-10-01T08:06:03.965 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.9rbNbxLiGc is 319KB 2023-10-01T08:06:04.037 DEBUG:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.9rbNbxLiGc 2023-10-01T08:06:04.060 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-01T08:06:04.061 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-01T08:06:04.102 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-01T08:06:04.140 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-01T08:06:04.140 DEBUG:teuthology.orchestra.run.smithi026:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-01T08:06:04.178 DEBUG:teuthology.orchestra.run.smithi092:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-01T08:06:04.212 INFO:teuthology.orchestra.run.smithi026.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-01T08:06:04.212 INFO:teuthology.orchestra.run.smithi092.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-01T08:06:04.220 INFO:tasks.ceph:Archiving crash dumps... 2023-10-01T08:06:04.221 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/lib/ceph/crash to /home/teuthworker/archive/dparmar-2023-10-01_07:32:21-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408165/remote/smithi026/crash 2023-10-01T08:06:04.222 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-01T08:06:04.294 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/lib/ceph/crash to /home/teuthworker/archive/dparmar-2023-10-01_07:32:21-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408165/remote/smithi092/crash 2023-10-01T08:06:04.295 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-01T08:06:04.346 INFO:tasks.ceph:Compressing logs... 2023-10-01T08:06:04.346 DEBUG:teuthology.orchestra.run.smithi026:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-01T08:06:04.349 DEBUG:teuthology.orchestra.run.smithi092:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-01T08:06:04.377 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112237.log 2023-10-01T08:06:04.382 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170593.log 2023-10-01T08:06:04.383 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148249.log 2023-10-01T08:06:04.384 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.170593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129063.log 2023-10-01T08:06:04.384 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.170593.log.gz 2023-10-01T08:06:04.384 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.148249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189446.log 2023-10-01T08:06:04.384 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.148249.log.gz 2023-10-01T08:06:04.384 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156465.log 2023-10-01T08:06:04.385 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.0.112237.log: 96.6% -- replaced with /var/log/ceph/ceph-client.0.112237.log.gz 2023-10-01T08:06:04.391 INFO:teuthology.orchestra.run.smithi092.stderr: 2023-10-01T08:06:04.392 INFO:teuthology.orchestra.run.smithi092.stderr:real 0m0.019s 2023-10-01T08:06:04.392 INFO:teuthology.orchestra.run.smithi092.stderr:user 0m0.018s 2023-10-01T08:06:04.392 INFO:teuthology.orchestra.run.smithi092.stderr:sys 0m0.009s 2023-10-01T08:06:04.401 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.129063.log: /var/log/ceph/ceph-client.admin.189446.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.129063.log.gz 2023-10-01T08:06:04.401 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173337.log 2023-10-01T08:06:04.401 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.189446.log.gz 2023-10-01T08:06:04.401 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153476.log 2023-10-01T08:06:04.401 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.156465.log.gz 2023-10-01T08:06:04.401 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184726.log 2023-10-01T08:06:04.402 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.153476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180406.log 2023-10-01T08:06:04.402 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.173337.log.gz 2023-10-01T08:06:04.402 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.153476.log.gz 2023-10-01T08:06:04.402 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141605.log 2023-10-01T08:06:04.402 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.184726.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.184726.log.gz 2023-10-01T08:06:04.402 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.180406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122857.log 2023-10-01T08:06:04.402 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.141605.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.180406.log.gz 2023-10-01T08:06:04.402 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153380.log 2023-10-01T08:06:04.403 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.141605.log.gz 2023-10-01T08:06:04.403 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.122857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125490.log 2023-10-01T08:06:04.403 INFO:teuthology.orchestra.run.smithi026.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.122857.log.gz 2023-10-01T08:06:04.403 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.153380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134927.log 2023-10-01T08:06:04.403 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.125490.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.153380.log.gz 2023-10-01T08:06:04.403 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143942.log 2023-10-01T08:06:04.403 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.134927.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.125490.log.gz 2023-10-01T08:06:04.403 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159162.log 2023-10-01T08:06:04.404 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.134927.log.gz 2023-10-01T08:06:04.404 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.143942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165489.log 2023-10-01T08:06:04.404 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.143942.log.gz 2023-10-01T08:06:04.404 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182096.log 2023-10-01T08:06:04.404 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159162.log: /var/log/ceph/ceph-client.admin.165489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190111.log 2023-10-01T08:06:04.404 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.159162.log.gz 2023-10-01T08:06:04.404 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.165489.log.gz 2023-10-01T08:06:04.404 INFO:teuthology.orchestra.run.smithi026.stderr:gzip /var/log/ceph/ceph-client.admin.182096.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.136656.log 2023-10-01T08:06:04.405 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.190111.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.182096.log.gz 2023-10-01T08:06:04.405 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143106.log 2023-10-01T08:06:04.405 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.190111.log.gz 2023-10-01T08:06:04.405 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.136656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190230.log 2023-10-01T08:06:04.405 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.136656.log.gz 2023-10-01T08:06:04.405 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174001.log 2023-10-01T08:06:04.405 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.143106.log: /var/log/ceph/ceph-client.admin.190230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129308.log 2023-10-01T08:06:04.405 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.143106.log.gz 2023-10-01T08:06:04.406 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.190230.log.gz 2023-10-01T08:06:04.406 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 /var/log/ceph/ceph-client.admin.174001.log: --verbose -- /var/log/ceph/ceph-client.admin.162601.log 2023-10-01T08:06:04.406 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.129308.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.174001.log.gz 2023-10-01T08:06:04.406 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125588.log 2023-10-01T08:06:04.406 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.129308.log.gz 2023-10-01T08:06:04.406 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163333.log 2023-10-01T08:06:04.406 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.162601.log.gz 2023-10-01T08:06:04.406 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.125588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164783.log 2023-10-01T08:06:04.407 INFO:teuthology.orchestra.run.smithi026.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.125588.log.gz 2023-10-01T08:06:04.407 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.163333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189940.log 2023-10-01T08:06:04.407 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164783.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.163333.log.gz 2023-10-01T08:06:04.407 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127886.log 2023-10-01T08:06:04.407 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.164783.log.gz 2023-10-01T08:06:04.407 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.189940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149817.log 2023-10-01T08:06:04.407 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.189940.log.gz 2023-10-01T08:06:04.407 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.127886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183076.log 2023-10-01T08:06:04.408 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.149817.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.127886.log.gz 2023-10-01T08:06:04.408 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175160.log 2023-10-01T08:06:04.408 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.149817.log.gz 2023-10-01T08:06:04.408 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.183076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155733.log 2023-10-01T08:06:04.408 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.183076.log.gz 2023-10-01T08:06:04.408 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.175160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138198.log 2023-10-01T08:06:04.408 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.175160.log.gz 2023-10-01T08:06:04.408 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.155733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178080.log 2023-10-01T08:06:04.408 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.155733.log.gz 2023-10-01T08:06:04.409 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.138198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169639.log 2023-10-01T08:06:04.409 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.138198.log.gz 2023-10-01T08:06:04.409 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.178080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180504.log 2023-10-01T08:06:04.409 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169639.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.178080.log.gz 2023-10-01T08:06:04.409 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153773.log 2023-10-01T08:06:04.409 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.169639.log.gz 2023-10-01T08:06:04.409 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.180504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140427.log 2023-10-01T08:06:04.409 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.180504.log.gz 2023-10-01T08:06:04.410 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.153773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162013.log 2023-10-01T08:06:04.410 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.140427.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.153773.log.gz 2023-10-01T08:06:04.410 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148027.log 2023-10-01T08:06:04.410 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.140427.log.gz 2023-10-01T08:06:04.410 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143498.log 2023-10-01T08:06:04.410 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.162013.log.gz 2023-10-01T08:06:04.410 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.148027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165515.log 2023-10-01T08:06:04.410 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.143498.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.148027.log.gz 2023-10-01T08:06:04.411 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154652.log 2023-10-01T08:06:04.411 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.143498.log.gz 2023-10-01T08:06:04.411 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.165515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177684.log 2023-10-01T08:06:04.411 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.165515.log.gz 2023-10-01T08:06:04.411 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.154652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164142.log 2023-10-01T08:06:04.411 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.177684.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.154652.log.gz 2023-10-01T08:06:04.411 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183354.log 2023-10-01T08:06:04.411 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.177684.log.gz 2023-10-01T08:06:04.412 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146852.log 2023-10-01T08:06:04.412 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.164142.log.gz 2023-10-01T08:06:04.412 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.183354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186625.log 2023-10-01T08:06:04.412 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.146852.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.183354.log.gz 2023-10-01T08:06:04.412 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187532.log 2023-10-01T08:06:04.412 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.146852.log.gz 2023-10-01T08:06:04.412 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.186625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137778.log 2023-10-01T08:06:04.412 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.186625.log.gz 2023-10-01T08:06:04.413 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.187532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149033.log 2023-10-01T08:06:04.413 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.137778.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.187532.log.gz 2023-10-01T08:06:04.413 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183403.log 2023-10-01T08:06:04.413 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.137778.log.gz 2023-10-01T08:06:04.413 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.149033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172749.log 2023-10-01T08:06:04.413 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.149033.log.gz 2023-10-01T08:06:04.469 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.183403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177168.log 2023-10-01T08:06:04.470 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.172749.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.183403.log.gz 2023-10-01T08:06:04.470 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159805.log 2023-10-01T08:06:04.470 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.172749.log.gz 2023-10-01T08:06:04.470 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.177168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154186.log 2023-10-01T08:06:04.470 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.177168.log.gz 2023-10-01T08:06:04.470 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175383.log 2023-10-01T08:06:04.470 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.154186.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.159805.log.gz 2023-10-01T08:06:04.471 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160811.log 2023-10-01T08:06:04.471 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.154186.log.gz 2023-10-01T08:06:04.471 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.175383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135844.log 2023-10-01T08:06:04.471 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.175383.log.gz 2023-10-01T08:06:04.471 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.160811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153329.log 2023-10-01T08:06:04.471 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.160811.log.gz 2023-10-01T08:06:04.471 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.135844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150021.log 2023-10-01T08:06:04.472 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.135844.log.gz 2023-10-01T08:06:04.472 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.153329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145040.log 2023-10-01T08:06:04.472 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.153329.log.gz 2023-10-01T08:06:04.472 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.150021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156517.log 2023-10-01T08:06:04.472 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.145040.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.150021.log.gz 2023-10-01T08:06:04.472 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169613.log 2023-10-01T08:06:04.472 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.145040.log.gz 2023-10-01T08:06:04.472 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189521.log 2023-10-01T08:06:04.473 INFO:teuthology.orchestra.run.smithi026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.156517.log.gz 2023-10-01T08:06:04.473 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154848.log 2023-10-01T08:06:04.473 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.189521.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.169613.log.gz 2023-10-01T08:06:04.473 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143916.log 2023-10-01T08:06:04.473 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.189521.log.gz 2023-10-01T08:06:04.473 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.154848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191659.log 2023-10-01T08:06:04.473 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.154848.log.gz 2023-10-01T08:06:04.473 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.143916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123016.log 2023-10-01T08:06:04.474 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.191659.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.143916.log.gz 2023-10-01T08:06:04.474 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156713.log 2023-10-01T08:06:04.474 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.191659.log.gz 2023-10-01T08:06:04.474 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.123016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147980.log 2023-10-01T08:06:04.474 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.123016.log.gz 2023-10-01T08:06:04.474 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138812.log 2023-10-01T08:06:04.474 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.156713.log.gz 2023-10-01T08:06:04.474 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.147980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151834.log 2023-10-01T08:06:04.475 INFO:teuthology.orchestra.run.smithi026.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.147980.log.gz 2023-10-01T08:06:04.475 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.138812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180453.log 2023-10-01T08:06:04.475 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.138812.log.gz 2023-10-01T08:06:04.475 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.151834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153577.log 2023-10-01T08:06:04.475 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.180453.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.151834.log.gz 2023-10-01T08:06:04.475 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128818.log 2023-10-01T08:06:04.475 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.180453.log.gz 2023-10-01T08:06:04.475 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.153577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161276.log 2023-10-01T08:06:04.476 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.153577.log.gz 2023-10-01T08:06:04.476 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.128818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146655.log 2023-10-01T08:06:04.476 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161276.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.128818.log.gz 2023-10-01T08:06:04.476 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188071.log 2023-10-01T08:06:04.476 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.161276.log.gz 2023-10-01T08:06:04.476 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.146655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182880.log 2023-10-01T08:06:04.476 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.146655.log.gz 2023-10-01T08:06:04.476 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.188071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166725.log 2023-10-01T08:06:04.477 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.182880.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.188071.log.gz 2023-10-01T08:06:04.477 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153381.log 2023-10-01T08:06:04.477 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.182880.log.gz 2023-10-01T08:06:04.477 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182954.log 2023-10-01T08:06:04.477 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166725.log.gz 2023-10-01T08:06:04.477 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.153381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168659.log 2023-10-01T08:06:04.477 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.153381.log.gz 2023-10-01T08:06:04.477 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.182954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167483.log 2023-10-01T08:06:04.477 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.182954.log.gz 2023-10-01T08:06:04.478 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.168659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135426.log 2023-10-01T08:06:04.478 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.168659.log.gz 2023-10-01T08:06:04.478 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128573.log 2023-10-01T08:06:04.478 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.167483.log.gz 2023-10-01T08:06:04.478 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.135426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123312.log 2023-10-01T08:06:04.478 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.135426.log.gz 2023-10-01T08:06:04.478 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.128573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138838.log 2023-10-01T08:06:04.479 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.128573.log.gz 2023-10-01T08:06:04.479 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.123312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175993.log 2023-10-01T08:06:04.479 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.138838.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.123312.log.gz 2023-10-01T08:06:04.479 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125076.log 2023-10-01T08:06:04.479 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.138838.log.gz 2023-10-01T08:06:04.479 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.175993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122563.log 2023-10-01T08:06:04.479 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.175993.log.gz 2023-10-01T08:06:04.479 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.125076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183942.log 2023-10-01T08:06:04.479 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.125076.log.gz 2023-10-01T08:06:04.480 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.122563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142375.log 2023-10-01T08:06:04.480 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.122563.log.gz 2023-10-01T08:06:04.480 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.183942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166077.log 2023-10-01T08:06:04.480 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.183942.log.gz 2023-10-01T08:06:04.480 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.142375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176481.log 2023-10-01T08:06:04.480 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.142375.log.gz 2023-10-01T08:06:04.480 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155485.log 2023-10-01T08:06:04.480 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166077.log.gz 2023-10-01T08:06:04.481 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166673.log 2023-10-01T08:06:04.481 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.176481.log.gz 2023-10-01T08:06:04.481 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.155485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123973.log 2023-10-01T08:06:04.481 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8%/var/log/ceph/ceph-client.admin.166673.log: -- replaced with /var/log/ceph/ceph-client.admin.155485.log.gz 2023-10-01T08:06:04.481 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185632.log 2023-10-01T08:06:04.481 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.166673.log.gz 2023-10-01T08:06:04.481 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.123973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143915.log 2023-10-01T08:06:04.481 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.123973.log.gz 2023-10-01T08:06:04.482 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.185632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123829.log 2023-10-01T08:06:04.482 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.185632.log.gz 2023-10-01T08:06:04.482 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.143915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170201.log 2023-10-01T08:06:04.482 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.143915.log.gz 2023-10-01T08:06:04.482 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.123829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168829.log 2023-10-01T08:06:04.482 INFO:teuthology.orchestra.run.smithi026.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.123829.log.gz 2023-10-01T08:06:04.482 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.170201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171281.log 2023-10-01T08:06:04.482 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.170201.log.gz 2023-10-01T08:06:04.483 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.168829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123508.log 2023-10-01T08:06:04.483 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171281.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.168829.log.gz 2023-10-01T08:06:04.483 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167065.log 2023-10-01T08:06:04.483 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.171281.log.gz 2023-10-01T08:06:04.483 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.123508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163236.log 2023-10-01T08:06:04.483 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167065.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.123508.log.gz 2023-10-01T08:06:04.483 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176115.log 2023-10-01T08:06:04.484 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.167065.log.gz 2023-10-01T08:06:04.484 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.163236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188562.log 2023-10-01T08:06:04.484 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.163236.log.gz 2023-10-01T08:06:04.484 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150340.log 2023-10-01T08:06:04.484 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0%/var/log/ceph/ceph-client.admin.188562.log: -- replaced with /var/log/ceph/ceph-client.admin.176115.log.gz 2023-10-01T08:06:04.484 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147831.log 2023-10-01T08:06:04.484 INFO:teuthology.orchestra.run.smithi026.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.188562.log.gz 2023-10-01T08:06:04.484 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.150340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158877.log 2023-10-01T08:06:04.485 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.150340.log.gz 2023-10-01T08:06:04.485 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.147831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164561.log 2023-10-01T08:06:04.485 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.147831.log.gz 2023-10-01T08:06:04.485 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143557.log 2023-10-01T08:06:04.485 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158877.log.gz 2023-10-01T08:06:04.485 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187875.log 2023-10-01T08:06:04.485 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.164561.log.gz 2023-10-01T08:06:04.486 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.143557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165355.log 2023-10-01T08:06:04.486 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.143557.log.gz 2023-10-01T08:06:04.486 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.187875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125441.log 2023-10-01T08:06:04.486 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.187875.log.gz 2023-10-01T08:06:04.486 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.165355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164363.log 2023-10-01T08:06:04.486 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.165355.log.gz 2023-10-01T08:06:04.486 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.125441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178054.log 2023-10-01T08:06:04.486 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164363.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.125441.log.gz 2023-10-01T08:06:04.487 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192588.log 2023-10-01T08:06:04.487 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.164363.log.gz 2023-10-01T08:06:04.487 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.178054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127351.log 2023-10-01T08:06:04.487 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.192588.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.178054.log.gz 2023-10-01T08:06:04.487 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162404.log 2023-10-01T08:06:04.487 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.192588.log.gz 2023-10-01T08:06:04.487 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.127351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127967.log 2023-10-01T08:06:04.487 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.127351.log.gz 2023-10-01T08:06:04.488 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128867.log 2023-10-01T08:06:04.488 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.127967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127426.log 2023-10-01T08:06:04.488 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.162404.log.gz 2023-10-01T08:06:04.488 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.127967.log.gz 2023-10-01T08:06:04.488 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.128867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193422.log 2023-10-01T08:06:04.488 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.128867.log.gz 2023-10-01T08:06:04.488 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134864.log 2023-10-01T08:06:04.488 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.127426.log: /var/log/ceph/ceph-client.admin.193422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141360.log 2023-10-01T08:06:04.489 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.127426.log.gz 2023-10-01T08:06:04.489 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.193422.log.gz 2023-10-01T08:06:04.489 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142936.log 2023-10-01T08:06:04.489 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.134864.log: 88.6%/var/log/ceph/ceph-client.admin.141360.log: -- replaced with /var/log/ceph/ceph-client.admin.134864.log.gz 2023-10-01T08:06:04.489 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191116.log 2023-10-01T08:06:04.489 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.142936.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.141360.log.gz 2023-10-01T08:06:04.489 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170619.log 2023-10-01T08:06:04.489 INFO:teuthology.orchestra.run.smithi026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.142936.log.gz 2023-10-01T08:06:04.490 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.191116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162995.log 2023-10-01T08:06:04.490 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.191116.log.gz 2023-10-01T08:06:04.490 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.170619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181655.log 2023-10-01T08:06:04.490 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162995.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.170619.log.gz 2023-10-01T08:06:04.490 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161961.log 2023-10-01T08:06:04.490 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.162995.log.gz 2023-10-01T08:06:04.490 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.181655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166967.log 2023-10-01T08:06:04.490 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.181655.log.gz 2023-10-01T08:06:04.491 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180798.log 2023-10-01T08:06:04.491 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166967.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.161961.log.gz 2023-10-01T08:06:04.491 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171625.log 2023-10-01T08:06:04.491 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.166967.log.gz 2023-10-01T08:06:04.491 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.180798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146485.log 2023-10-01T08:06:04.491 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.180798.log.gz 2023-10-01T08:06:04.491 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152545.log 2023-10-01T08:06:04.491 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.146485.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.171625.log.gz 2023-10-01T08:06:04.491 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157693.log 2023-10-01T08:06:04.492 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.146485.log.gz 2023-10-01T08:06:04.492 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.152545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124929.log 2023-10-01T08:06:04.492 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152545.log.gz 2023-10-01T08:06:04.492 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165907.log 2023-10-01T08:06:04.492 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.124929.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.157693.log.gz 2023-10-01T08:06:04.492 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164756.log 2023-10-01T08:06:04.492 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.124929.log.gz 2023-10-01T08:06:04.492 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.165907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185559.log 2023-10-01T08:06:04.493 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.165907.log.gz 2023-10-01T08:06:04.493 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135502.log 2023-10-01T08:06:04.493 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.164756.log.gz 2023-10-01T08:06:04.493 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.185559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170841.log 2023-10-01T08:06:04.493 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.185559.log.gz 2023-10-01T08:06:04.493 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.135502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185044.log 2023-10-01T08:06:04.493 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.135502.log.gz 2023-10-01T08:06:04.493 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.170841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190501.log 2023-10-01T08:06:04.494 INFO:teuthology.orchestra.run.smithi026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.170841.log.gz 2023-10-01T08:06:04.494 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.185044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158459.log 2023-10-01T08:06:04.494 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.185044.log.gz 2023-10-01T08:06:04.494 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.190501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128163.log 2023-10-01T08:06:04.494 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.190501.log.gz 2023-10-01T08:06:04.494 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156661.log 2023-10-01T08:06:04.494 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.158459.log.gz 2023-10-01T08:06:04.495 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.128163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144452.log 2023-10-01T08:06:04.495 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.128163.log.gz 2023-10-01T08:06:04.495 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183599.log 2023-10-01T08:06:04.495 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.156661.log.gz 2023-10-01T08:06:04.495 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.144452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159413.log 2023-10-01T08:06:04.495 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.183599.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.144452.log.gz 2023-10-01T08:06:04.495 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166155.log 2023-10-01T08:06:04.495 INFO:teuthology.orchestra.run.smithi026.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.183599.log.gz 2023-10-01T08:06:04.496 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155240.log 2023-10-01T08:06:04.496 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.159413.log.gz 2023-10-01T08:06:04.496 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172945.log 2023-10-01T08:06:04.496 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.155240.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.166155.log.gz 2023-10-01T08:06:04.496 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160122.log 2023-10-01T08:06:04.496 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.155240.log.gz 2023-10-01T08:06:04.496 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.172945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128524.log 2023-10-01T08:06:04.496 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172945.log.gz 2023-10-01T08:06:04.497 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.160122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161668.log 2023-10-01T08:06:04.497 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.128524.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.160122.log.gz 2023-10-01T08:06:04.497 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147295.log 2023-10-01T08:06:04.497 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.128524.log.gz 2023-10-01T08:06:04.497 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160691.log 2023-10-01T08:06:04.497 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.161668.log.gz 2023-10-01T08:06:04.497 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.147295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137020.log 2023-10-01T08:06:04.497 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.160691.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.147295.log.gz 2023-10-01T08:06:04.498 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140720.log 2023-10-01T08:06:04.498 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.160691.log.gz 2023-10-01T08:06:04.498 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.137020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163190.log 2023-10-01T08:06:04.498 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.137020.log.gz 2023-10-01T08:06:04.498 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.140720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146459.log 2023-10-01T08:06:04.498 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.163190.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.140720.log.gz 2023-10-01T08:06:04.498 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128720.log 2023-10-01T08:06:04.499 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.163190.log.gz 2023-10-01T08:06:04.499 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.146459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158876.log 2023-10-01T08:06:04.499 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.146459.log.gz 2023-10-01T08:06:04.499 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.128720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149007.log 2023-10-01T08:06:04.499 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158876.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.128720.log.gz 2023-10-01T08:06:04.499 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140994.log 2023-10-01T08:06:04.499 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.158876.log.gz 2023-10-01T08:06:04.499 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.149007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190919.log 2023-10-01T08:06:04.500 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.149007.log.gz 2023-10-01T08:06:04.500 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.140994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122253.log 2023-10-01T08:06:04.500 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140994.log.gz 2023-10-01T08:06:04.500 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.190919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181974.log 2023-10-01T08:06:04.500 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.190919.log.gz 2023-10-01T08:06:04.500 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.122253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143302.log 2023-10-01T08:06:04.500 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.122253.log.gz 2023-10-01T08:06:04.500 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.181974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166772.log 2023-10-01T08:06:04.501 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.143302.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.181974.log.gz 2023-10-01T08:06:04.501 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153185.log 2023-10-01T08:06:04.501 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143302.log.gz 2023-10-01T08:06:04.501 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188366.log 2023-10-01T08:06:04.501 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.166772.log.gz 2023-10-01T08:06:04.501 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.153185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185118.log 2023-10-01T08:06:04.501 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.188366.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.153185.log.gz 2023-10-01T08:06:04.501 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192103.log 2023-10-01T08:06:04.501 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.188366.log.gz 2023-10-01T08:06:04.502 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.185118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165765.log 2023-10-01T08:06:04.502 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.185118.log.gz 2023-10-01T08:06:04.502 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.192103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135329.log 2023-10-01T08:06:04.502 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.165765.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.192103.log.gz 2023-10-01T08:06:04.502 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147047.log 2023-10-01T08:06:04.502 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.135329.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.165765.log.gz 2023-10-01T08:06:04.502 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187605.log 2023-10-01T08:06:04.502 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.135329.log.gz 2023-10-01T08:06:04.503 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.147047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193253.log 2023-10-01T08:06:04.503 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.187605.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.147047.log.gz 2023-10-01T08:06:04.503 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170005.log 2023-10-01T08:06:04.503 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.187605.log.gz 2023-10-01T08:06:04.503 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.193253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122445.log 2023-10-01T08:06:04.503 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.193253.log.gz 2023-10-01T08:06:04.503 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.170005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148865.log 2023-10-01T08:06:04.504 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.122445.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.170005.log.gz 2023-10-01T08:06:04.504 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138271.log 2023-10-01T08:06:04.504 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.122445.log.gz 2023-10-01T08:06:04.504 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.148865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158966.log 2023-10-01T08:06:04.504 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.148865.log.gz 2023-10-01T08:06:04.504 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171084.log 2023-10-01T08:06:04.504 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.138271.log: /var/log/ceph/ceph-client.admin.158966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185436.log 2023-10-01T08:06:04.504 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.138271.log.gz 2023-10-01T08:06:04.505 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178545.log 2023-10-01T08:06:04.505 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.158966.log.gz 2023-10-01T08:06:04.505 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.171084.log.gz 2023-10-01T08:06:04.505 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.185436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156857.log 2023-10-01T08:06:04.505 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.185436.log.gz 2023-10-01T08:06:04.505 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.178545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142688.log 2023-10-01T08:06:04.505 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.178545.log.gz 2023-10-01T08:06:04.505 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118615.log 2023-10-01T08:06:04.505 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.156857.log.gz 2023-10-01T08:06:04.506 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142688.log: /var/log/ceph/ceph-client.admin.156712.log 2023-10-01T08:06:04.506 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.118615.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.142688.log.gz 2023-10-01T08:06:04.506 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168685.log 2023-10-01T08:06:04.506 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.118615.log.gz 2023-10-01T08:06:04.506 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157396.log 2023-10-01T08:06:04.506 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.156712.log.gz 2023-10-01T08:06:04.506 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.168685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187017.log 2023-10-01T08:06:04.507 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.168685.log.gz 2023-10-01T08:06:04.507 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193094.log 2023-10-01T08:06:04.507 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.187017.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.157396.log.gz 2023-10-01T08:06:04.507 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144308.log 2023-10-01T08:06:04.507 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.187017.log.gz 2023-10-01T08:06:04.507 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167902.log 2023-10-01T08:06:04.507 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.193094.log: /var/log/ceph/ceph-client.admin.144308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184260.log 2023-10-01T08:06:04.508 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.193094.log.gz 2023-10-01T08:06:04.508 INFO:teuthology.orchestra.run.smithi026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.144308.log.gz 2023-10-01T08:06:04.508 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180014.log 2023-10-01T08:06:04.508 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.184260.log: 87.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.167902.log.gz-5 2023-10-01T08:06:04.508 INFO:teuthology.orchestra.run.smithi026.stderr:--verbose -- /var/log/ceph/ceph-client.admin.175775.log 2023-10-01T08:06:04.508 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.184260.log.gz 2023-10-01T08:06:04.508 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.180014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175723.log 2023-10-01T08:06:04.508 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.180014.log.gz 2023-10-01T08:06:04.509 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.175775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159681.log 2023-10-01T08:06:04.509 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.175723.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.175775.log.gz 2023-10-01T08:06:04.509 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139544.log 2023-10-01T08:06:04.509 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.175723.log.gz 2023-10-01T08:06:04.509 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191014.log 2023-10-01T08:06:04.509 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.159681.log.gz 2023-10-01T08:06:04.509 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.139544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160318.log 2023-10-01T08:06:04.509 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.191014.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.139544.log.gz 2023-10-01T08:06:04.510 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127171.log 2023-10-01T08:06:04.510 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.191014.log.gz 2023-10-01T08:06:04.510 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.160318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140328.log 2023-10-01T08:06:04.510 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.160318.log.gz 2023-10-01T08:06:04.510 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.127171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180994.log 2023-10-01T08:06:04.510 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.140328.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.127171.log.gz 2023-10-01T08:06:04.511 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173807.log 2023-10-01T08:06:04.511 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.140328.log.gz 2023-10-01T08:06:04.511 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.180994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174199.log 2023-10-01T08:06:04.511 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180994.log.gz 2023-10-01T08:06:04.511 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182021.log 2023-10-01T08:06:04.511 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174199.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.173807.log.gz 2023-10-01T08:06:04.512 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145262.log 2023-10-01T08:06:04.512 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.174199.log.gz 2023-10-01T08:06:04.512 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.182021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169321.log 2023-10-01T08:06:04.512 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.182021.log.gz 2023-10-01T08:06:04.512 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.145262.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-01T08:06:04.512 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169321.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.145262.log.gz 2023-10-01T08:06:04.512 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148472.log 2023-10-01T08:06:04.513 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.169321.log.gz 2023-10-01T08:06:04.513 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174991.log 2023-10-01T08:06:04.513 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.148472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172457.log 2023-10-01T08:06:04.513 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174991.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.148472.log.gz 2023-10-01T08:06:04.513 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181263.log 2023-10-01T08:06:04.513 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.174991.log.gz 2023-10-01T08:06:04.513 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.172457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191610.log 2023-10-01T08:06:04.514 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.172457.log.gz 2023-10-01T08:06:04.514 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.181263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141708.log 2023-10-01T08:06:04.514 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.181263.log.gz 2023-10-01T08:06:04.514 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186821.log 2023-10-01T08:06:04.514 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.191610.log: /var/log/ceph/ceph-client.admin.141708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142100.log 2023-10-01T08:06:04.514 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.191610.log.gz 2023-10-01T08:06:04.514 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.141708.log.gz 2023-10-01T08:06:04.515 INFO:teuthology.orchestra.run.smithi026.stderr:gzip /var/log/ceph/ceph-client.admin.186821.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.178838.log 2023-10-01T08:06:04.515 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134838.log 2023-10-01T08:06:04.515 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.142100.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.186821.log.gz 2023-10-01T08:06:04.515 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127657.log 2023-10-01T08:06:04.515 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.178838.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.142100.log.gz 2023-10-01T08:06:04.515 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.134838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176677.log 2023-10-01T08:06:04.515 INFO:teuthology.orchestra.run.smithi026.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.178838.log.gz 2023-10-01T08:06:04.516 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.134838.log.gz 2023-10-01T08:06:04.516 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.127657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177884.log 2023-10-01T08:06:04.516 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.127657.log.gz 2023-10-01T08:06:04.516 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153772.log 2023-10-01T08:06:04.516 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176677.log: /var/log/ceph/ceph-client.admin.177884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167509.log 2023-10-01T08:06:04.516 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.176677.log.gz 2023-10-01T08:06:04.516 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.177884.log.gz 2023-10-01T08:06:04.517 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.153772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163163.log 2023-10-01T08:06:04.517 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 87.5%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.153772.log.gz/var/log/ceph/ceph-client.admin.164979.log 2023-10-01T08:06:04.517 INFO:teuthology.orchestra.run.smithi026.stderr: 2023-10-01T08:06:04.517 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167509.log: /var/log/ceph/ceph-client.admin.163163.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.167509.log.gz 2023-10-01T08:06:04.517 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184626.log 2023-10-01T08:06:04.517 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.163163.log.gz 2023-10-01T08:06:04.517 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149595.log 2023-10-01T08:06:04.517 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.164979.log.gz 2023-10-01T08:06:04.518 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.184626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157301.log 2023-10-01T08:06:04.518 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.184626.log.gz 2023-10-01T08:06:04.518 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.149595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179818.log 2023-10-01T08:06:04.518 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.149595.log.gz/var/log/ceph/ceph-client.admin.157301.log: 2023-10-01T08:06:04.518 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127224.log 2023-10-01T08:06:04.518 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.157301.log.gz 2023-10-01T08:06:04.518 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149399.log 2023-10-01T08:06:04.518 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.127224.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.179818.log.gz 2023-10-01T08:06:04.519 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151003.log 2023-10-01T08:06:04.519 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1%/var/log/ceph/ceph-client.admin.149399.log: -- replaced with /var/log/ceph/ceph-client.admin.127224.log.gz 2023-10-01T08:06:04.519 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157788.log 2023-10-01T08:06:04.519 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.149399.log.gz 2023-10-01T08:06:04.519 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.151003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141557.log 2023-10-01T08:06:04.519 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.151003.log.gz 2023-10-01T08:06:04.519 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157889.log 2023-10-01T08:06:04.519 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.141557.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.157788.log.gz 2023-10-01T08:06:04.520 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168855.log 2023-10-01T08:06:04.520 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.141557.log.gz 2023-10-01T08:06:04.520 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176899.log 2023-10-01T08:06:04.520 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.157889.log.gz 2023-10-01T08:06:04.520 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.168855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166699.log 2023-10-01T08:06:04.520 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176899.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.168855.log.gz 2023-10-01T08:06:04.520 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140773.log 2023-10-01T08:06:04.520 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.176899.log.gz 2023-10-01T08:06:04.521 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182609.log 2023-10-01T08:06:04.521 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.166699.log.gz 2023-10-01T08:06:04.521 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.140773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151983.log 2023-10-01T08:06:04.521 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.182609.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140773.log.gz 2023-10-01T08:06:04.521 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123361.log 2023-10-01T08:06:04.521 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.182609.log.gz 2023-10-01T08:06:04.521 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.151983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186416.log 2023-10-01T08:06:04.521 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.151983.log.gz 2023-10-01T08:06:04.522 INFO:teuthology.orchestra.run.smithi026.stderr:gzip /var/log/ceph/ceph-client.admin.123361.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.161177.log 2023-10-01T08:06:04.522 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.186416.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.123361.log.gz 2023-10-01T08:06:04.522 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175893.log 2023-10-01T08:06:04.522 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.186416.log.gz 2023-10-01T08:06:04.522 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142374.log 2023-10-01T08:06:04.522 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.161177.log.gz 2023-10-01T08:06:04.522 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.175893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155119.log 2023-10-01T08:06:04.522 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.142374.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.175893.log.gz 2023-10-01T08:06:04.523 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166103.log 2023-10-01T08:06:04.523 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.142374.log.gz 2023-10-01T08:06:04.523 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.155119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193448.log 2023-10-01T08:06:04.523 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.155119.log.gz 2023-10-01T08:06:04.523 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164560.log 2023-10-01T08:06:04.523 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.193448.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.166103.log.gz 2023-10-01T08:06:04.523 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154260.log 2023-10-01T08:06:04.523 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.193448.log.gz 2023-10-01T08:06:04.524 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144503.log 2023-10-01T08:06:04.524 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.164560.log.gz 2023-10-01T08:06:04.524 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.154260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165711.log 2023-10-01T08:06:04.524 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.144503.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.154260.log.gz 2023-10-01T08:06:04.524 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155903.log 2023-10-01T08:06:04.524 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.144503.log.gz 2023-10-01T08:06:04.524 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.165711.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.111892.log 2023-10-01T08:06:04.524 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.165711.log.gz 2023-10-01T08:06:04.525 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.155903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188270.log 2023-10-01T08:06:04.651 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph.tmp-client.admin.111892.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.155903.log.gz 2023-10-01T08:06:04.652 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134524.log 2023-10-01T08:06:04.652 INFO:teuthology.orchestra.run.smithi026.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.111892.log.gz 2023-10-01T08:06:04.652 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.188270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192247.log 2023-10-01T08:06:04.652 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.188270.log.gz 2023-10-01T08:06:04.652 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.134524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128965.log 2023-10-01T08:06:04.652 INFO:teuthology.orchestra.run.smithi026.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.134524.log.gz 2023-10-01T08:06:04.653 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.192247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174002.log 2023-10-01T08:06:04.653 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.128965.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.192247.log.gz 2023-10-01T08:06:04.653 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148176.log 2023-10-01T08:06:04.653 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.128965.log.gz 2023-10-01T08:06:04.653 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138394.log 2023-10-01T08:06:04.653 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.174002.log.gz 2023-10-01T08:06:04.653 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.148176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142152.log 2023-10-01T08:06:04.653 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.138394.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.148176.log.gz 2023-10-01T08:06:04.654 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151124.log 2023-10-01T08:06:04.654 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.138394.log.gz 2023-10-01T08:06:04.654 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.142152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191481.log 2023-10-01T08:06:04.654 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.142152.log.gz 2023-10-01T08:06:04.654 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.151124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192077.log 2023-10-01T08:06:04.654 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.151124.log.gz 2023-10-01T08:06:04.654 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.191481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140942.log 2023-10-01T08:06:04.654 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.191481.log.gz 2023-10-01T08:06:04.655 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.192077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172187.log 2023-10-01T08:06:04.655 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.192077.log.gz 2023-10-01T08:06:04.655 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.140942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136897.log 2023-10-01T08:06:04.655 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.140942.log.gz 2023-10-01T08:06:04.655 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.172187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137608.log 2023-10-01T08:06:04.655 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.172187.log.gz 2023-10-01T08:06:04.655 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.136897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149156.log 2023-10-01T08:06:04.655 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.136897.log.gz 2023-10-01T08:06:04.656 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.137608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140993.log 2023-10-01T08:06:04.656 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.137608.log.gz 2023-10-01T08:06:04.656 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.149156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150387.log 2023-10-01T08:06:04.656 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.140993.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.149156.log.gz 2023-10-01T08:06:04.656 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174769.log 2023-10-01T08:06:04.656 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.150387.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.140993.log.gz 2023-10-01T08:06:04.656 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129617.log 2023-10-01T08:06:04.656 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.150387.log.gz 2023-10-01T08:06:04.657 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146216.log 2023-10-01T08:06:04.657 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.174769.log.gz 2023-10-01T08:06:04.657 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.129617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170057.log 2023-10-01T08:06:04.657 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.146216.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.129617.log.gz 2023-10-01T08:06:04.657 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157105.log 2023-10-01T08:06:04.657 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.146216.log.gz 2023-10-01T08:06:04.657 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.170057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162650.log 2023-10-01T08:06:04.657 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.170057.log.gz 2023-10-01T08:06:04.658 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180087.log 2023-10-01T08:06:04.658 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.157105.log.gz 2023-10-01T08:06:04.658 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184922.log 2023-10-01T08:06:04.658 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.162650.log.gz 2023-10-01T08:06:04.658 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.180087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124586.log 2023-10-01T08:06:04.658 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.184922.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.180087.log.gz 2023-10-01T08:06:04.658 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144700.log 2023-10-01T08:06:04.659 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.184922.log.gz 2023-10-01T08:06:04.659 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.124586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124026.log 2023-10-01T08:06:04.659 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124586.log.gz 2023-10-01T08:06:04.659 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.144700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164755.log 2023-10-01T08:06:04.659 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.144700.log.gz 2023-10-01T08:06:04.659 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.124026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148568.log 2023-10-01T08:06:04.659 INFO:teuthology.orchestra.run.smithi026.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.124026.log.gz 2023-10-01T08:06:04.659 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136092.log 2023-10-01T08:06:04.660 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.164755.log.gz 2023-10-01T08:06:04.660 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.148568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180310.log 2023-10-01T08:06:04.660 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.148568.log.gz 2023-10-01T08:06:04.660 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.136092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150442.log 2023-10-01T08:06:04.660 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.136092.log.gz 2023-10-01T08:06:04.660 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.180310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152988.log 2023-10-01T08:06:04.660 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.180310.log.gz 2023-10-01T08:06:04.660 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.150442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136824.log 2023-10-01T08:06:04.661 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.150442.log.gz 2023-10-01T08:06:04.661 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.152988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156416.log 2023-10-01T08:06:04.661 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.152988.log.gz 2023-10-01T08:06:04.661 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.136824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144504.log 2023-10-01T08:06:04.661 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.136824.log.gz 2023-10-01T08:06:04.661 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146804.log 2023-10-01T08:06:04.661 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.156416.log.gz 2023-10-01T08:06:04.661 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.144504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147392.log 2023-10-01T08:06:04.662 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1%/var/log/ceph/ceph-client.admin.146804.log: -- replaced with /var/log/ceph/ceph-client.admin.144504.log.gz 2023-10-01T08:06:04.662 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169273.log 2023-10-01T08:06:04.662 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.146804.log.gz 2023-10-01T08:06:04.662 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.147392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141397.log 2023-10-01T08:06:04.662 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169273.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.147392.log.gz 2023-10-01T08:06:04.662 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193977.log 2023-10-01T08:06:04.662 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.169273.log.gz 2023-10-01T08:06:04.662 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.141397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184456.log 2023-10-01T08:06:04.663 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141397.log.gz 2023-10-01T08:06:04.663 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.193977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166869.log 2023-10-01T08:06:04.663 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.184456.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.193977.log.gz 2023-10-01T08:06:04.663 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180701.log 2023-10-01T08:06:04.663 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7%/var/log/ceph/ceph-client.admin.166869.log: -- replaced with /var/log/ceph/ceph-client.admin.184456.log.gz 2023-10-01T08:06:04.663 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150536.log 2023-10-01T08:06:04.663 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166869.log.gz 2023-10-01T08:06:04.664 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.180701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151591.log 2023-10-01T08:06:04.664 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.180701.log.gz 2023-10-01T08:06:04.664 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.150536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173533.log 2023-10-01T08:06:04.664 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.150536.log.gz 2023-10-01T08:06:04.664 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.151591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188711.log 2023-10-01T08:06:04.664 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.151591.log.gz 2023-10-01T08:06:04.664 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172553.log 2023-10-01T08:06:04.664 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.173533.log.gz 2023-10-01T08:06:04.665 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.188711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154950.log 2023-10-01T08:06:04.665 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.172553.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.188711.log.gz 2023-10-01T08:06:04.665 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183746.log 2023-10-01T08:06:04.665 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.172553.log.gz 2023-10-01T08:06:04.665 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.154950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169861.log 2023-10-01T08:06:04.665 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.154950.log.gz 2023-10-01T08:06:04.665 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.183746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151712.log 2023-10-01T08:06:04.665 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169861.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.183746.log.gz 2023-10-01T08:06:04.666 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129259.log 2023-10-01T08:06:04.666 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.151712.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.169861.log.gz 2023-10-01T08:06:04.666 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181291.log 2023-10-01T08:06:04.666 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.151712.log.gz 2023-10-01T08:06:04.666 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.129259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139962.log 2023-10-01T08:06:04.666 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.181291.log: 88.2%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.129259.log.gz--verbose 2023-10-01T08:06:04.666 INFO:teuthology.orchestra.run.smithi026.stderr:-- /var/log/ceph/ceph-client.admin.134153.log 2023-10-01T08:06:04.666 INFO:teuthology.orchestra.run.smithi026.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.181291.log.gz 2023-10-01T08:06:04.667 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.139962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183626.log 2023-10-01T08:06:04.667 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.139962.log.gz 2023-10-01T08:06:04.667 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.134153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167482.log 2023-10-01T08:06:04.667 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.183626.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.134153.log.gz 2023-10-01T08:06:04.667 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123831.log 2023-10-01T08:06:04.667 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.183626.log.gz 2023-10-01T08:06:04.667 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146877.log 2023-10-01T08:06:04.667 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.167482.log.gz 2023-10-01T08:06:04.668 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.123831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170083.log 2023-10-01T08:06:04.668 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.146877.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.123831.log.gz 2023-10-01T08:06:04.668 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179720.log 2023-10-01T08:06:04.668 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.146877.log.gz 2023-10-01T08:06:04.668 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.170083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163973.log 2023-10-01T08:06:04.668 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179720.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.170083.log.gz 2023-10-01T08:06:04.668 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157641.log 2023-10-01T08:06:04.668 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.179720.log.gz 2023-10-01T08:06:04.668 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.163973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139034.log 2023-10-01T08:06:04.669 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.163973.log.gz 2023-10-01T08:06:04.669 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191881.log 2023-10-01T08:06:04.669 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.139034.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.157641.log.gz 2023-10-01T08:06:04.669 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124439.log 2023-10-01T08:06:04.669 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139034.log.gz 2023-10-01T08:06:04.669 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.191881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182441.log 2023-10-01T08:06:04.669 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.191881.log.gz 2023-10-01T08:06:04.669 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.124439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178472.log 2023-10-01T08:06:04.670 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.182441.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.124439.log.gz 2023-10-01T08:06:04.670 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170789.log 2023-10-01T08:06:04.670 INFO:teuthology.orchestra.run.smithi026.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.182441.log.gz 2023-10-01T08:06:04.670 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.178472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136472.log 2023-10-01T08:06:04.670 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.178472.log.gz 2023-10-01T08:06:04.670 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.170789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158825.log 2023-10-01T08:06:04.670 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.136472.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.170789.log.gz 2023-10-01T08:06:04.670 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193732.log 2023-10-01T08:06:04.671 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.136472.log.gz 2023-10-01T08:06:04.671 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129727.log 2023-10-01T08:06:04.671 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.158825.log.gz 2023-10-01T08:06:04.671 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.193732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146608.log 2023-10-01T08:06:04.671 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.129727.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.193732.log.gz 2023-10-01T08:06:04.671 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180602.log 2023-10-01T08:06:04.671 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.129727.log.gz 2023-10-01T08:06:04.671 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.146608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186748.log 2023-10-01T08:06:04.672 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.146608.log.gz 2023-10-01T08:06:04.672 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.180602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141760.log 2023-10-01T08:06:04.672 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.186748.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.180602.log.gz 2023-10-01T08:06:04.672 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146336.log 2023-10-01T08:06:04.672 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.141760.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.186748.log.gz 2023-10-01T08:06:04.672 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153672.log 2023-10-01T08:06:04.672 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.141760.log.gz 2023-10-01T08:06:04.672 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.146336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189166.log 2023-10-01T08:06:04.673 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.153672.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.146336.log.gz 2023-10-01T08:06:04.673 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192470.log 2023-10-01T08:06:04.673 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.153672.log.gz 2023-10-01T08:06:04.673 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.189166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150217.log 2023-10-01T08:06:04.673 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.189166.log.gz 2023-10-01T08:06:04.673 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.192470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150611.log 2023-10-01T08:06:04.673 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.150217.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.192470.log.gz 2023-10-01T08:06:04.673 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141955.log 2023-10-01T08:06:04.674 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.150217.log.gz 2023-10-01T08:06:04.674 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.150611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174395.log 2023-10-01T08:06:04.674 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.150611.log.gz 2023-10-01T08:06:04.674 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.141955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194173.log 2023-10-01T08:06:04.674 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174395.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.141955.log.gz 2023-10-01T08:06:04.674 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180257.log 2023-10-01T08:06:04.674 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.174395.log.gz 2023-10-01T08:06:04.674 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.194173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168071.log 2023-10-01T08:06:04.675 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.194173.log.gz 2023-10-01T08:06:04.675 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.180257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174003.log 2023-10-01T08:06:04.675 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.168071.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.180257.log.gz 2023-10-01T08:06:04.675 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184187.log 2023-10-01T08:06:04.675 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.168071.log.gz 2023-10-01T08:06:04.675 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156320.log 2023-10-01T08:06:04.675 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.174003.log.gz 2023-10-01T08:06:04.675 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.184187.log: -- /var/log/ceph/ceph-client.admin.134179.log 2023-10-01T08:06:04.676 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156320.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.184187.log.gz 2023-10-01T08:06:04.676 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165123.log 2023-10-01T08:06:04.676 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.156320.log.gz 2023-10-01T08:06:04.676 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.134179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177658.log 2023-10-01T08:06:04.676 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.134179.log.gz 2023-10-01T08:06:04.676 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.165123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177462.log 2023-10-01T08:06:04.676 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.165123.log.gz 2023-10-01T08:06:04.676 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.177658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150928.log 2023-10-01T08:06:04.677 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.177462.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.177658.log.gz 2023-10-01T08:06:04.677 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190475.log 2023-10-01T08:06:04.677 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.177462.log.gz 2023-10-01T08:06:04.677 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.150928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185216.log 2023-10-01T08:06:04.677 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.150928.log.gz 2023-10-01T08:06:04.677 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.190475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163385.log 2023-10-01T08:06:04.677 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.190475.log.gz 2023-10-01T08:06:04.677 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.185216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127025.log 2023-10-01T08:06:04.678 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.185216.log.gz 2023-10-01T08:06:04.678 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.163385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171599.log 2023-10-01T08:06:04.678 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.163385.log.gz 2023-10-01T08:06:04.678 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.127025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138616.log 2023-10-01T08:06:04.678 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171599.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.127025.log.gz 2023-10-01T08:06:04.678 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133850.log 2023-10-01T08:06:04.678 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.171599.log.gz 2023-10-01T08:06:04.679 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.138616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158033.log 2023-10-01T08:06:04.679 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.138616.log.gz 2023-10-01T08:06:04.679 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.133850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169835.log 2023-10-01T08:06:04.679 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158033.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.133850.log.gz 2023-10-01T08:06:04.679 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169124.log 2023-10-01T08:06:04.679 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.158033.log.gz 2023-10-01T08:06:04.679 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172849.log 2023-10-01T08:06:04.679 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.169835.log.gz 2023-10-01T08:06:04.680 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158574.log 2023-10-01T08:06:04.680 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.169124.log.gz/var/log/ceph/ceph-client.admin.172849.log: 2023-10-01T08:06:04.680 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165541.log 2023-10-01T08:06:04.680 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.172849.log.gz 2023-10-01T08:06:04.680 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156125.log 2023-10-01T08:06:04.680 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158574.log.gz 2023-10-01T08:06:04.680 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.165541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185755.log 2023-10-01T08:06:04.680 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156125.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.165541.log.gz 2023-10-01T08:06:04.681 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182413.log 2023-10-01T08:06:04.681 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.156125.log.gz 2023-10-01T08:06:04.681 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.185755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166895.log 2023-10-01T08:06:04.681 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.185755.log.gz 2023-10-01T08:06:04.681 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.182413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173193.log 2023-10-01T08:06:04.681 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166895.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.182413.log.gz 2023-10-01T08:06:04.681 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133932.log 2023-10-01T08:06:04.681 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.166895.log.gz 2023-10-01T08:06:04.682 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158433.log 2023-10-01T08:06:04.682 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.173193.log.gz 2023-10-01T08:06:04.682 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.133932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186147.log 2023-10-01T08:06:04.682 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158433.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.133932.log.gz 2023-10-01T08:06:04.682 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137289.log 2023-10-01T08:06:04.682 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.158433.log.gz 2023-10-01T08:06:04.682 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.186147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161007.log 2023-10-01T08:06:04.683 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.186147.log.gz 2023-10-01T08:06:04.683 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.137289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147784.log 2023-10-01T08:06:04.683 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161007.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.137289.log.gz 2023-10-01T08:06:04.683 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151369.log 2023-10-01T08:06:04.683 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.147784.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.161007.log.gz 2023-10-01T08:06:04.683 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139740.log 2023-10-01T08:06:04.683 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.147784.log.gz 2023-10-01T08:06:04.683 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.151369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136210.log 2023-10-01T08:06:04.684 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.151369.log.gz 2023-10-01T08:06:04.684 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.139740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183001.log 2023-10-01T08:06:04.684 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139740.log.gz 2023-10-01T08:06:04.684 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.136210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186552.log 2023-10-01T08:06:04.684 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.136210.log.gz 2023-10-01T08:06:04.684 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.183001.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-01T08:06:04.684 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.186552.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.183001.log.gz 2023-10-01T08:06:04.684 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142492.log 2023-10-01T08:06:04.685 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.186552.log.gz 2023-10-01T08:06:04.685 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147857.log 2023-10-01T08:06:04.685 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.142492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145139.log 2023-10-01T08:06:04.685 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.142492.log.gz 2023-10-01T08:06:04.685 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.147857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154113.log 2023-10-01T08:06:04.685 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.147857.log.gz 2023-10-01T08:06:04.685 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168489.log 2023-10-01T08:06:04.685 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.145139.log: /var/log/ceph/ceph-client.admin.154113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181433.log 2023-10-01T08:06:04.686 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.145139.log.gz 2023-10-01T08:06:04.686 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.154113.log.gz 2023-10-01T08:06:04.686 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161472.log 2023-10-01T08:06:04.686 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.168489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189250.log 2023-10-01T08:06:04.686 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.181433.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.168489.log.gz 2023-10-01T08:06:04.686 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161472.log: gzip 89.2%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.181433.log.gz-- 2023-10-01T08:06:04.686 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.128401.log 2023-10-01T08:06:04.686 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.161472.log.gz 2023-10-01T08:06:04.687 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.189250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180283.log 2023-10-01T08:06:04.687 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.128401.log: gzip -5 --verbose -- 88.7%/var/log/ceph/ceph-client.admin.191312.log 2023-10-01T08:06:04.687 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.189250.log.gz 2023-10-01T08:06:04.687 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.128401.log.gz 2023-10-01T08:06:04.687 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.180283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181684.log 2023-10-01T08:06:04.687 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3%/var/log/ceph/ceph-client.admin.191312.log: -- replaced with /var/log/ceph/ceph-client.admin.180283.log.gz 2023-10-01T08:06:04.687 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139007.log 2023-10-01T08:06:04.687 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.181684.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.191312.log.gz 2023-10-01T08:06:04.688 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190034.log 2023-10-01T08:06:04.688 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.181684.log.gz 2023-10-01T08:06:04.688 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 /var/log/ceph/ceph-client.admin.139007.log: --verbose -- /var/log/ceph/ceph-client.admin.152226.log 2023-10-01T08:06:04.688 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161987.log 2023-10-01T08:06:04.688 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.190034.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.139007.log.gz 2023-10-01T08:06:04.688 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.152226.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.190034.log.gz 2023-10-01T08:06:04.688 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136874.log 2023-10-01T08:06:04.689 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.152226.log.gz 2023-10-01T08:06:04.689 INFO:teuthology.orchestra.run.smithi026.stderr:gzip /var/log/ceph/ceph-client.admin.161987.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.154576.log 2023-10-01T08:06:04.689 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.136874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128064.log 2023-10-01T08:06:04.689 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.161987.log.gz 2023-10-01T08:06:04.689 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.136874.log.gz 2023-10-01T08:06:04.689 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.154576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149275.log 2023-10-01T08:06:04.689 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189495.log 2023-10-01T08:06:04.689 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.128064.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.154576.log.gz 2023-10-01T08:06:04.690 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.149275.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.128064.log.gz 2023-10-01T08:06:04.690 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191711.log 2023-10-01T08:06:04.690 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.149275.log.gz 2023-10-01T08:06:04.690 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182562.log 2023-10-01T08:06:04.690 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.189495.log: /var/log/ceph/ceph-client.admin.191711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160223.log 2023-10-01T08:06:04.690 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.189495.log.gz 2023-10-01T08:06:04.690 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.191711.log.gz 2023-10-01T08:06:04.691 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.182562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186699.log 2023-10-01T08:06:04.691 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152104.log 88.6% 2023-10-01T08:06:04.691 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.182562.log.gz 2023-10-01T08:06:04.691 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.160223.log: /var/log/ceph/ceph-client.admin.186699.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.160223.log.gz 2023-10-01T08:06:04.691 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178936.log 2023-10-01T08:06:04.691 INFO:teuthology.orchestra.run.smithi026.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.186699.log.gz 2023-10-01T08:06:04.691 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165319.log 2023-10-01T08:06:04.691 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.152104.log: /var/log/ceph/ceph-client.admin.178936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137485.log 2023-10-01T08:06:04.692 INFO:teuthology.orchestra.run.smithi026.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.152104.log.gz 2023-10-01T08:06:04.692 INFO:teuthology.orchestra.run.smithi026.stderr: 95.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-01T08:06:04.692 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.178936.log.gz 2023-10-01T08:06:04.692 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.165319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162405.log 2023-10-01T08:06:04.692 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172357.log 2023-10-01T08:06:04.692 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0%/var/log/ceph/ceph-client.admin.137485.log: -- replaced with /var/log/ceph/ceph-client.admin.165319.log.gz 2023-10-01T08:06:04.692 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150583.log 2023-10-01T08:06:04.692 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.137485.log.gz 2023-10-01T08:06:04.693 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.162405.log.gz 2023-10-01T08:06:04.693 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128137.log 2023-10-01T08:06:04.693 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.172357.log: /var/log/ceph/ceph-client.admin.150583.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.172357.log.gz 2023-10-01T08:06:04.693 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152571.log 2023-10-01T08:06:04.693 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.150583.log.gz 2023-10-01T08:06:04.693 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.128137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163777.log 2023-10-01T08:06:04.693 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.128137.log.gz 2023-10-01T08:06:04.693 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.152571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171403.log 2023-10-01T08:06:04.694 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.163777.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152571.log.gz 2023-10-01T08:06:04.694 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167339.log 2023-10-01T08:06:04.694 INFO:teuthology.orchestra.run.smithi026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.163777.log.gz 2023-10-01T08:06:04.694 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130026.log 2023-10-01T08:06:04.694 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.171403.log.gz 2023-10-01T08:06:04.694 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168437.log 2023-10-01T08:06:04.694 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.130026.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.167339.log.gz 2023-10-01T08:06:04.695 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122371.log 2023-10-01T08:06:04.695 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.130026.log.gz 2023-10-01T08:06:04.695 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.168437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169908.log 2023-10-01T08:06:04.695 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.168437.log.gz 2023-10-01T08:06:04.695 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.122371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184215.log 2023-10-01T08:06:04.695 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169908.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.122371.log.gz 2023-10-01T08:06:04.695 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156024.log 2023-10-01T08:06:04.695 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.169908.log.gz 2023-10-01T08:06:04.695 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.184215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136994.log 2023-10-01T08:06:04.696 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.184215.log.gz 2023-10-01T08:06:04.696 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134397.log 2023-10-01T08:06:04.696 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.136994.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.156024.log.gz 2023-10-01T08:06:04.696 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140158.log 2023-10-01T08:06:04.696 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.136994.log.gz 2023-10-01T08:06:04.696 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.134397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145944.log 2023-10-01T08:06:04.696 INFO:teuthology.orchestra.run.smithi026.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.134397.log.gz 2023-10-01T08:06:04.697 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.140158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157471.log 2023-10-01T08:06:04.697 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140158.log.gz 2023-10-01T08:06:04.697 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.145944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171235.log 2023-10-01T08:06:04.697 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157471.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.145944.log.gz 2023-10-01T08:06:04.697 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125833.log 2023-10-01T08:06:04.697 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.157471.log.gz 2023-10-01T08:06:04.697 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161204.log 2023-10-01T08:06:04.697 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.171235.log.gz 2023-10-01T08:06:04.698 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.125833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149548.log 2023-10-01T08:06:04.698 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187971.log 2023-10-01T08:06:04.698 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.161204.log.gz 2023-10-01T08:06:04.698 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.149548.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.125833.log.gz 2023-10-01T08:06:04.698 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151395.log 2023-10-01T08:06:04.698 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.149548.log.gz 2023-10-01T08:06:04.698 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.187971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184971.log 2023-10-01T08:06:04.698 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.187971.log.gz 2023-10-01T08:06:04.699 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.151395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180871.log 2023-10-01T08:06:04.699 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.184971.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.151395.log.gz 2023-10-01T08:06:04.699 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159536.log 2023-10-01T08:06:04.699 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.184971.log.gz 2023-10-01T08:06:04.699 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.180871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137288.log 2023-10-01T08:06:04.699 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.180871.log.gz 2023-10-01T08:06:04.699 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153280.log 2023-10-01T08:06:04.699 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.137288.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.159536.log.gz 2023-10-01T08:06:04.700 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134250.log 2023-10-01T08:06:04.700 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.153280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148641.log 2023-10-01T08:06:04.700 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.137288.log.gz 2023-10-01T08:06:04.700 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.134250.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.153280.log.gz 2023-10-01T08:06:04.700 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156883.log 2023-10-01T08:06:04.700 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.134250.log.gz 2023-10-01T08:06:04.700 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.148641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137484.log 2023-10-01T08:06:04.700 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156883.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.148641.log.gz 2023-10-01T08:06:04.701 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138368.log 2023-10-01T08:06:04.701 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156883.log.gz 2023-10-01T08:06:04.701 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.137484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137681.log 2023-10-01T08:06:04.701 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.137484.log.gz 2023-10-01T08:06:04.701 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.138368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123606.log 2023-10-01T08:06:04.701 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.137681.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.138368.log.gz 2023-10-01T08:06:04.701 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155147.log 2023-10-01T08:06:04.701 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.137681.log.gz 2023-10-01T08:06:04.702 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.123606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162745.log 2023-10-01T08:06:04.702 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.123606.log.gz 2023-10-01T08:06:04.702 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.155147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128375.log 2023-10-01T08:06:04.702 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162745.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.155147.log.gz 2023-10-01T08:06:04.702 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140916.log 2023-10-01T08:06:04.702 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.162745.log.gz 2023-10-01T08:06:04.702 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 /var/log/ceph/ceph-client.admin.128375.log: --verbose -- /var/log/ceph/ceph-client.admin.128671.log 2023-10-01T08:06:04.703 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.128375.log.gz 2023-10-01T08:06:04.703 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.140916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167875.log 2023-10-01T08:06:04.703 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.128671.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.140916.log.gz 2023-10-01T08:06:04.703 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128427.log 2023-10-01T08:06:04.703 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.128671.log.gz 2023-10-01T08:06:04.703 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135701.log 2023-10-01T08:06:04.703 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.167875.log.gz 2023-10-01T08:06:04.703 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.128427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177535.log 2023-10-01T08:06:04.704 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.135701.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.128427.log.gz 2023-10-01T08:06:04.704 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141504.log 2023-10-01T08:06:04.704 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.135701.log.gz 2023-10-01T08:06:04.704 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.177535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176508.log 2023-10-01T08:06:04.704 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.177535.log.gz 2023-10-01T08:06:04.704 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.141504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184530.log 2023-10-01T08:06:04.704 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176508.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141504.log.gz 2023-10-01T08:06:04.704 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138785.log 2023-10-01T08:06:04.705 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.176508.log.gz 2023-10-01T08:06:04.705 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.184530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143276.log 2023-10-01T08:06:04.705 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.184530.log.gz 2023-10-01T08:06:04.705 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.138785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185606.log 2023-10-01T08:06:04.705 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.138785.log.gz 2023-10-01T08:06:04.705 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.143276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166968.log 2023-10-01T08:06:04.705 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.143276.log.gz 2023-10-01T08:06:04.705 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.185606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182758.log 2023-10-01T08:06:04.706 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166968.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.185606.log.gz 2023-10-01T08:06:04.706 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149229.log 2023-10-01T08:06:04.706 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166968.log.gz 2023-10-01T08:06:04.706 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.182758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194026.log 2023-10-01T08:06:04.706 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.182758.log.gz 2023-10-01T08:06:04.706 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.149229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136040.log 2023-10-01T08:06:04.706 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.149229.log.gz 2023-10-01T08:06:04.706 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.194026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179277.log 2023-10-01T08:06:04.707 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.194026.log.gz 2023-10-01T08:06:04.707 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.136040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179721.log 2023-10-01T08:06:04.707 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.136040.log.gz 2023-10-01T08:06:04.707 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123655.log 2023-10-01T08:06:04.707 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.179277.log.gz 2023-10-01T08:06:04.707 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124145.log 2023-10-01T08:06:04.707 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.179721.log.gz 2023-10-01T08:06:04.707 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.123655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176285.log 2023-10-01T08:06:04.708 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.123655.log.gz 2023-10-01T08:06:04.708 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.124145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184411.log 2023-10-01T08:06:04.708 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.124145.log.gz 2023-10-01T08:06:04.708 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184334.log 2023-10-01T08:06:04.708 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.184411.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.176285.log.gz 2023-10-01T08:06:04.708 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160589.log 2023-10-01T08:06:04.708 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.184411.log.gz 2023-10-01T08:06:04.708 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.184334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147492.log 2023-10-01T08:06:04.709 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.184334.log.gz 2023-10-01T08:06:04.709 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.160589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163137.log 2023-10-01T08:06:04.709 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.160589.log.gz 2023-10-01T08:06:04.709 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156099.log 2023-10-01T08:06:04.709 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.147492.log: /var/log/ceph/ceph-client.admin.163137.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.147492.log.gz 2023-10-01T08:06:04.709 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178865.log 2023-10-01T08:06:04.709 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.163137.log.gz 2023-10-01T08:06:04.709 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162452.log 2023-10-01T08:06:04.710 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.156099.log.gz 2023-10-01T08:06:04.710 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.178865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179426.log 2023-10-01T08:06:04.710 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.178865.log.gz 2023-10-01T08:06:04.710 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173611.log 2023-10-01T08:06:04.710 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179426.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.162452.log.gz 2023-10-01T08:06:04.710 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160513.log 2023-10-01T08:06:04.710 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.179426.log.gz 2023-10-01T08:06:04.710 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157984.log 2023-10-01T08:06:04.711 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.160513.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.173611.log.gz 2023-10-01T08:06:04.711 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171011.log 2023-10-01T08:06:04.711 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.160513.log.gz 2023-10-01T08:06:04.711 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184138.log 2023-10-01T08:06:04.711 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.157984.log.gz 2023-10-01T08:06:04.711 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125294.log 2023-10-01T08:06:04.711 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.184138.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.171011.log.gz 2023-10-01T08:06:04.711 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158485.log 2023-10-01T08:06:04.712 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.184138.log.gz 2023-10-01T08:06:04.712 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.125294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172161.log 2023-10-01T08:06:04.712 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.125294.log.gz 2023-10-01T08:06:04.712 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183158.log 2023-10-01T08:06:04.712 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.172161.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.158485.log.gz 2023-10-01T08:06:04.712 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145484.log 2023-10-01T08:06:04.713 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.172161.log.gz 2023-10-01T08:06:04.713 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.183158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187579.log 2023-10-01T08:06:04.713 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.183158.log.gz 2023-10-01T08:06:04.713 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.145484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143694.log 2023-10-01T08:06:04.713 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.187579.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.145484.log.gz 2023-10-01T08:06:04.713 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170423.log 2023-10-01T08:06:04.713 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.187579.log.gz 2023-10-01T08:06:04.713 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.143694.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-01T08:06:04.714 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.143694.log.gz 2023-10-01T08:06:04.714 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.170423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181067.log 2023-10-01T08:06:04.714 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-osd.3.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.170423.log.gz 2023-10-01T08:06:04.714 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134056.log 2023-10-01T08:06:04.714 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.181067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185363.log 2023-10-01T08:06:04.714 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.181067.log.gz 2023-10-01T08:06:04.714 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.134056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179499.log 2023-10-01T08:06:04.715 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.134056.log.gz 2023-10-01T08:06:04.715 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.185363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128111.log 2023-10-01T08:06:04.715 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145314.log 2023-10-01T08:06:04.715 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.185363.log.gz 2023-10-01T08:06:04.715 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.179499.log.gz 2023-10-01T08:06:04.715 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.128111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129014.log 2023-10-01T08:06:04.715 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125735.log 2023-10-01T08:06:04.715 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.128111.log.gz 2023-10-01T08:06:04.716 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.145314.log: /var/log/ceph/ceph-client.admin.129014.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.145314.log.gz 2023-10-01T08:06:04.716 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161054.log 2023-10-01T08:06:04.716 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.129014.log.gz 2023-10-01T08:06:04.716 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144922.log 2023-10-01T08:06:04.716 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.125735.log: /var/log/ceph/ceph-client.admin.161054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144060.log 2023-10-01T08:06:04.716 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.125735.log.gz 2023-10-01T08:06:04.716 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.161054.log.gz 2023-10-01T08:06:04.717 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.144922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177266.log 2023-10-01T08:06:04.717 INFO:teuthology.orchestra.run.smithi026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.144922.log.gz 2023-10-01T08:06:04.717 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 /var/log/ceph/ceph-client.admin.144060.log: --verbose -- /var/log/ceph/ceph-client.admin.188392.log 2023-10-01T08:06:04.717 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.177266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173022.log 2023-10-01T08:06:04.717 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.144060.log.gz 2023-10-01T08:06:04.717 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.177266.log.gz 2023-10-01T08:06:04.717 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.188392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155632.log 2023-10-01T08:06:04.718 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.188392.log.gz/var/log/ceph/ceph-client.admin.173022.log: 2023-10-01T08:06:04.718 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135648.log 2023-10-01T08:06:04.718 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.173022.log.gz 2023-10-01T08:06:04.718 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.155632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144307.log 2023-10-01T08:06:04.718 INFO:teuthology.orchestra.run.smithi026.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.155632.log.gz 2023-10-01T08:06:04.718 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.135648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129357.log 2023-10-01T08:06:04.718 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184383.log 2023-10-01T08:06:04.718 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.135648.log.gz 2023-10-01T08:06:04.719 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.144307.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.144307.log.gz 2023-10-01T08:06:04.719 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.129357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165150.log 2023-10-01T08:06:04.719 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175161.log 2023-10-01T08:06:04.719 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.184383.log: /var/log/ceph/ceph-client.admin.165150.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.184383.log.gz 2023-10-01T08:06:04.719 INFO:teuthology.orchestra.run.smithi026.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.129357.log.gz 2023-10-01T08:06:04.719 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.165150.log.gz 2023-10-01T08:06:04.719 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.175161.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.175161.log.gz 2023-10-01T08:06:04.719 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140184.log 2023-10-01T08:06:04.720 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140354.log 2023-10-01T08:06:04.720 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.140184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168537.log 2023-10-01T08:06:04.720 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.140184.log.gz 2023-10-01T08:06:04.720 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.140354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183991.log 2023-10-01T08:06:04.720 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144112.log 2023-10-01T08:06:04.720 INFO:teuthology.orchestra.run.smithi026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.140354.log.gz 2023-10-01T08:06:04.720 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.168537.log: /var/log/ceph/ceph-client.admin.183991.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.168537.log.gz 2023-10-01T08:06:04.720 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190543.log 2023-10-01T08:06:04.721 INFO:teuthology.orchestra.run.smithi026.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.183991.log.gz 2023-10-01T08:06:04.721 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154456.log /var/log/ceph/ceph-client.admin.144112.log: 2023-10-01T08:06:04.721 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177069.log 2023-10-01T08:06:04.721 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.144112.log.gz 2023-10-01T08:06:04.721 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.190543.log: /var/log/ceph/ceph-client.admin.154456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148615.log 2023-10-01T08:06:04.721 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.190543.log.gz 2023-10-01T08:06:04.721 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.177069.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.154456.log.gz 2023-10-01T08:06:04.721 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125686.log 2023-10-01T08:06:04.722 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.177069.log.gz 2023-10-01T08:06:04.722 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.148615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191855.log 2023-10-01T08:06:04.722 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.125686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144111.log 2023-10-01T08:06:04.722 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.148615.log.gz 2023-10-01T08:06:04.722 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.191855.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.125686.log.gz 2023-10-01T08:06:04.722 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-01T08:06:04.722 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.191855.log.gz 2023-10-01T08:06:04.723 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.144111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163041.log 2023-10-01T08:06:04.723 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.144111.log.gz 2023-10-01T08:06:04.723 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187997.log 2023-10-01T08:06:04.723 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.163041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122661.log 2023-10-01T08:06:04.723 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.163041.log.gz 2023-10-01T08:06:04.723 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.187997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144138.log 2023-10-01T08:06:04.723 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156808.log 2023-10-01T08:06:04.723 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.122661.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.187997.log.gz 2023-10-01T08:06:04.724 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.122661.log.gz 2023-10-01T08:06:04.724 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.144138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187336.log 2023-10-01T08:06:04.724 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.144138.log.gz 2023-10-01T08:06:04.724 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156808.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.156808.log.gz 2023-10-01T08:06:04.724 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.187336.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.187336.log.gz 2023-10-01T08:06:04.724 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171821.log 2023-10-01T08:06:04.724 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118469.log 2023-10-01T08:06:04.724 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189165.log 2023-10-01T08:06:04.725 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.118469.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.171821.log.gz 2023-10-01T08:06:04.725 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192908.log 2023-10-01T08:06:04.725 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.118469.log.gz 2023-10-01T08:06:04.725 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.189165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190279.log 2023-10-01T08:06:04.725 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.189165.log.gz 2023-10-01T08:06:04.725 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.192908.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.192908.log.gz 2023-10-01T08:06:04.725 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.190279.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.190279.log.gz 2023-10-01T08:06:04.725 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193830.log 2023-10-01T08:06:04.726 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127941.log 2023-10-01T08:06:04.726 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.193830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171430.log 2023-10-01T08:06:04.726 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.193830.log.gz 2023-10-01T08:06:04.726 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.127941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178250.log 2023-10-01T08:06:04.726 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187775.log 2023-10-01T08:06:04.726 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171430.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.127941.log.gz 2023-10-01T08:06:04.726 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.178250.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.171430.log.gz 2023-10-01T08:06:04.727 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.178250.log.gz 2023-10-01T08:06:04.727 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.187775.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.187775.log.gz 2023-10-01T08:06:04.727 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161083.log 2023-10-01T08:06:04.727 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167653.log 2023-10-01T08:06:04.727 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171476.log 2023-10-01T08:06:04.727 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167653.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.161083.log.gz 2023-10-01T08:06:04.727 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.167653.log.gz 2023-10-01T08:06:04.727 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171476.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.171476.log.gz 2023-10-01T08:06:04.728 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147243.log 2023-10-01T08:06:04.728 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189838.log 2023-10-01T08:06:04.728 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.147243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146903.log 2023-10-01T08:06:04.728 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.189838.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.147243.log.gz 2023-10-01T08:06:04.728 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171851.log 2023-10-01T08:06:04.728 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.189838.log.gz 2023-10-01T08:06:04.728 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.146903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149454.log 2023-10-01T08:06:04.728 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.146903.log.gz 2023-10-01T08:06:04.729 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139792.log 2023-10-01T08:06:04.729 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.171851.log.gz 2023-10-01T08:06:04.729 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186895.log 2023-10-01T08:06:04.729 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.149454.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.149454.log.gz 2023-10-01T08:06:04.729 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.139792.log: /var/log/ceph/ceph-client.admin.186895.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.139792.log.gz 2023-10-01T08:06:04.729 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.186895.log.gz 2023-10-01T08:06:04.729 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118772.log 2023-10-01T08:06:04.729 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169025.log 2023-10-01T08:06:04.730 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.118772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154064.log 2023-10-01T08:06:04.730 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.118772.log.gz 2023-10-01T08:06:04.730 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124488.log 2023-10-01T08:06:04.730 INFO:teuthology.orchestra.run.smithi026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.169025.log.gz 2023-10-01T08:06:04.730 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.154064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154140.log 2023-10-01T08:06:04.730 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.154064.log.gz 2023-10-01T08:06:04.730 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.124488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178642.log 2023-10-01T08:06:04.730 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124488.log.gz 2023-10-01T08:06:04.731 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.154140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122514.log 2023-10-01T08:06:04.731 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150191.log 2023-10-01T08:06:04.731 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.154140.log.gz 2023-10-01T08:06:04.731 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.178642.log: /var/log/ceph/ceph-client.admin.122514.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.178642.log.gz 2023-10-01T08:06:04.731 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189717.log 2023-10-01T08:06:04.731 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.122514.log.gz 2023-10-01T08:06:04.731 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.150191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139622.log 2023-10-01T08:06:04.731 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.150191.log.gz 2023-10-01T08:06:04.732 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.189717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151908.log 2023-10-01T08:06:04.732 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175356.log 2023-10-01T08:06:04.732 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.189717.log.gz/var/log/ceph/ceph-client.admin.139622.log: 2023-10-01T08:06:04.732 INFO:teuthology.orchestra.run.smithi026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.139622.log.gz 2023-10-01T08:06:04.732 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.151908.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.151908.log.gz 2023-10-01T08:06:04.732 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.175356.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.175356.log.gz 2023-10-01T08:06:04.732 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176383.log 2023-10-01T08:06:04.732 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148960.log 2023-10-01T08:06:04.733 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136236.log 2023-10-01T08:06:04.733 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.148960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181459.log 2023-10-01T08:06:04.733 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.176383.log.gz 2023-10-01T08:06:04.733 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.148960.log.gz 2023-10-01T08:06:04.733 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.136236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140623.log 2023-10-01T08:06:04.733 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.136236.log.gz 2023-10-01T08:06:04.733 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.181459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171573.log 2023-10-01T08:06:04.733 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.140623.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.181459.log.gz 2023-10-01T08:06:04.734 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161446.log 2023-10-01T08:06:04.734 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.140623.log.gz 2023-10-01T08:06:04.734 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171573.log: /var/log/ceph/ceph-client.admin.145066.log 2023-10-01T08:06:04.734 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161446.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.171573.log.gz 2023-10-01T08:06:04.734 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158770.log 2023-10-01T08:06:04.734 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.145066.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.161446.log.gz 2023-10-01T08:06:04.737 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.145066.log.gz 2023-10-01T08:06:04.737 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158770.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.158770.log.gz 2023-10-01T08:06:04.737 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152030.log 2023-10-01T08:06:04.737 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141308.log 2023-10-01T08:06:04.738 INFO:teuthology.orchestra.run.smithi026.stderr:gzip /var/log/ceph/ceph-client.admin.152030.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.185418.log 2023-10-01T08:06:04.738 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.141308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155315.log 2023-10-01T08:06:04.738 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.152030.log.gz 2023-10-01T08:06:04.738 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.141308.log.gz 2023-10-01T08:06:04.738 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.185418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125245.log 2023-10-01T08:06:04.738 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.185418.log.gz 2023-10-01T08:06:04.738 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.155315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139791.log 2023-10-01T08:06:04.739 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.125245.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.155315.log.gz 2023-10-01T08:06:04.739 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.125245.log.gz 2023-10-01T08:06:04.739 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.139791.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.139791.log.gz 2023-10-01T08:06:04.739 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166529.log 2023-10-01T08:06:04.739 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145824.log 2023-10-01T08:06:04.739 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174198.log 2023-10-01T08:06:04.739 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.166529.log.gz 2023-10-01T08:06:04.739 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.145824.log: /var/log/ceph/ceph-client.admin.174198.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.145824.log.gz 2023-10-01T08:06:04.740 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171377.log 2023-10-01T08:06:04.740 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.174198.log.gz 2023-10-01T08:06:04.740 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129519.log 2023-10-01T08:06:04.740 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176579.log 2023-10-01T08:06:04.740 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171377.log: /var/log/ceph/ceph-client.admin.129519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138642.log 2023-10-01T08:06:04.740 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.171377.log.gz 2023-10-01T08:06:04.740 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176579.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.129519.log.gz 2023-10-01T08:06:04.740 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181629.log 2023-10-01T08:06:04.741 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.176579.log.gz/var/log/ceph/ceph-client.admin.138642.log: 2023-10-01T08:06:04.741 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135034.log 2023-10-01T08:06:04.741 INFO:teuthology.orchestra.run.smithi026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.138642.log.gz 2023-10-01T08:06:04.741 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.181629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118174.log 2023-10-01T08:06:04.741 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.181629.log.gz 2023-10-01T08:06:04.741 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.135034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164197.log 2023-10-01T08:06:04.741 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163529.log 2023-10-01T08:06:04.741 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.135034.log.gz 2023-10-01T08:06:04.742 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.118174.log: /var/log/ceph/ceph-client.admin.164197.log: gzip -5 --verbose -- 89.8%/var/log/ceph/ceph-client.admin.134105.log 2023-10-01T08:06:04.742 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.118174.log.gz 2023-10-01T08:06:04.742 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.164197.log.gz 2023-10-01T08:06:04.742 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.163529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138615.log 2023-10-01T08:06:04.742 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.134105.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.163529.log.gz 2023-10-01T08:06:04.742 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173363.log 2023-10-01T08:06:04.742 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8%/var/log/ceph/ceph-client.admin.138615.log: -- replaced with /var/log/ceph/ceph-client.admin.134105.log.gz 2023-10-01T08:06:04.742 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190724.log 2023-10-01T08:06:04.743 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.138615.log.gz 2023-10-01T08:06:04.743 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191063.log 2023-10-01T08:06:04.743 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169665.log 2023-10-01T08:06:04.743 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.173363.log.gz 2023-10-01T08:06:04.743 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.190724.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.190724.log.gz 2023-10-01T08:06:04.743 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.191063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150732.log 2023-10-01T08:06:04.743 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.191063.log.gz 2023-10-01T08:06:04.743 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141334.log 2023-10-01T08:06:04.744 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169665.log: /var/log/ceph/ceph-client.admin.150732.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.169665.log.gz 2023-10-01T08:06:04.744 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.141334.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.150732.log.gz 2023-10-01T08:06:04.744 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.141334.log.gz 2023-10-01T08:06:04.744 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193372.log 2023-10-01T08:06:04.744 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194075.log 2023-10-01T08:06:04.744 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.193372.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.193372.log.gz 2023-10-01T08:06:04.744 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.194075.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.194075.log.gz 2023-10-01T08:06:04.744 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153184.log 2023-10-01T08:06:04.745 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165588.log 2023-10-01T08:06:04.745 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.153184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155044.log 2023-10-01T08:06:04.745 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.165588.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.153184.log.gz 2023-10-01T08:06:04.745 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173141.log 2023-10-01T08:06:04.745 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.165588.log.gz 2023-10-01T08:06:04.745 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.155044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163607.log 2023-10-01T08:06:04.745 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.155044.log.gz 2023-10-01T08:06:04.745 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122808.log 2023-10-01T08:06:04.746 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146244.log 2023-10-01T08:06:04.746 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.173141.log.gz 2023-10-01T08:06:04.746 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.163607.log: /var/log/ceph/ceph-client.admin.122808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158240.log 2023-10-01T08:06:04.746 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.163607.log.gz 2023-10-01T08:06:04.746 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.146244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160393.log 2023-10-01T08:06:04.746 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.122808.log.gz 2023-10-01T08:06:04.746 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.146244.log.gz 2023-10-01T08:06:04.746 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158240.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.158240.log.gz 2023-10-01T08:06:04.747 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.160393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187187.log 2023-10-01T08:06:04.747 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.160393.log.gz 2023-10-01T08:06:04.747 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160250.log 2023-10-01T08:06:04.747 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.187187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176873.log 2023-10-01T08:06:04.747 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.187187.log.gz 2023-10-01T08:06:04.747 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.160250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151957.log 2023-10-01T08:06:04.747 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178446.log 2023-10-01T08:06:04.748 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176873.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.160250.log.gz 2023-10-01T08:06:04.748 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.151957.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.176873.log.gz 2023-10-01T08:06:04.748 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182292.log 2023-10-01T08:06:04.748 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.178446.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.151957.log.gz 2023-10-01T08:06:04.748 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144256.log 2023-10-01T08:06:04.748 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.178446.log.gz 2023-10-01T08:06:04.748 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.182292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160447.log 2023-10-01T08:06:04.748 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- 89.0%/var/log/ceph/ceph-client.admin.186220.log 2023-10-01T08:06:04.749 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.182292.log.gz 2023-10-01T08:06:04.749 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.144256.log: /var/log/ceph/ceph-client.admin.160447.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.144256.log.gz 2023-10-01T08:06:04.749 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189744.log 2023-10-01T08:06:04.749 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.160447.log.gz 2023-10-01T08:06:04.749 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193585.log 2023-10-01T08:06:04.749 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.186220.log: /var/log/ceph/ceph-client.admin.189744.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.186220.log.gz 2023-10-01T08:06:04.749 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169077.log 2023-10-01T08:06:04.750 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138050.log 2023-10-01T08:06:04.750 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.193585.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.189744.log.gz 2023-10-01T08:06:04.750 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169077.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.193585.log.gz 2023-10-01T08:06:04.750 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.138050.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.169077.log.gz 2023-10-01T08:06:04.750 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.138050.log.gz 2023-10-01T08:06:04.750 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149621.log 2023-10-01T08:06:04.750 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158289.log 2023-10-01T08:06:04.750 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.149621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152767.log 2023-10-01T08:06:04.751 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.149621.log.gz 2023-10-01T08:06:04.751 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173434.log 2023-10-01T08:06:04.751 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.158289.log.gz 2023-10-01T08:06:04.751 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145531.log 2023-10-01T08:06:04.751 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.152767.log: /var/log/ceph/ceph-client.admin.173434.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.152767.log.gz 2023-10-01T08:06:04.751 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.145531.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.173434.log.gz 2023-10-01T08:06:04.751 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.145531.log.gz 2023-10-01T08:06:04.752 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161864.log 2023-10-01T08:06:04.752 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141190.log 2023-10-01T08:06:04.752 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162058.log 2023-10-01T08:06:04.752 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.161864.log.gz 2023-10-01T08:06:04.752 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.141190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168633.log 2023-10-01T08:06:04.752 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127024.log 2023-10-01T08:06:04.752 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.141190.log.gz 2023-10-01T08:06:04.752 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162058.log: /var/log/ceph/ceph-client.admin.168633.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.162058.log.gz 2023-10-01T08:06:04.752 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175526.log 2023-10-01T08:06:04.753 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.168633.log.gz 2023-10-01T08:06:04.753 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.127024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174591.log 2023-10-01T08:06:04.753 INFO:teuthology.orchestra.run.smithi026.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.127024.log.gz 2023-10-01T08:06:04.753 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.175526.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.175526.log.gz 2023-10-01T08:06:04.753 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137074.log 2023-10-01T08:06:04.753 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.174591.log.gz 2023-10-01T08:06:04.753 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124390.log 2023-10-01T08:06:04.753 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191406.log 2023-10-01T08:06:04.754 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.137074.log: /var/log/ceph/ceph-client.admin.124390.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.137074.log.gz 2023-10-01T08:06:04.754 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.191406.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.124390.log.gz 2023-10-01T08:06:04.754 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.191406.log.gz 2023-10-01T08:06:04.754 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193634.log 2023-10-01T08:06:04.754 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144530.log 2023-10-01T08:06:04.754 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.193634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189939.log 2023-10-01T08:06:04.754 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.193634.log.gz 2023-10-01T08:06:04.754 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.144530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189371.log 2023-10-01T08:06:04.755 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145261.log 2023-10-01T08:06:04.755 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.189939.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.144530.log.gz 2023-10-01T08:06:04.755 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.189371.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.189939.log.gz 2023-10-01T08:06:04.755 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.145261.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.189371.log.gz 2023-10-01T08:06:04.755 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.145261.log.gz 2023-10-01T08:06:04.755 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180113.log 2023-10-01T08:06:04.755 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160197.log 2023-10-01T08:06:04.755 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.180113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155929.log 2023-10-01T08:06:04.756 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.180113.log.gz 2023-10-01T08:06:04.756 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.160197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175774.log 2023-10-01T08:06:04.756 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135060.log 2023-10-01T08:06:04.756 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.155929.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.160197.log.gz 2023-10-01T08:06:04.756 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.175774.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.155929.log.gz 2023-10-01T08:06:04.756 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.135060.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.175774.log.gz 2023-10-01T08:06:04.756 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.135060.log.gz 2023-10-01T08:06:04.756 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139426.log 2023-10-01T08:06:04.757 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124635.log 2023-10-01T08:06:04.757 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.139426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172213.log 2023-10-01T08:06:04.757 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.139426.log.gz 2023-10-01T08:06:04.757 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.124635.log: /var/log/ceph/ceph-client.admin.172213.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.124635.log.gz 2023-10-01T08:06:04.757 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.172213.log.gz 2023-10-01T08:06:04.757 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171181.log 2023-10-01T08:06:04.757 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192516.log 2023-10-01T08:06:04.757 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162256.log 2023-10-01T08:06:04.757 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.171181.log.gz 2023-10-01T08:06:04.758 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.192516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168340.log 2023-10-01T08:06:04.758 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162183.log 2023-10-01T08:06:04.758 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.192516.log.gz 2023-10-01T08:06:04.758 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162256.log: /var/log/ceph/ceph-client.admin.168340.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.162256.log.gz 2023-10-01T08:06:04.758 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162183.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.168340.log.gz 2023-10-01T08:06:04.758 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.162183.log.gz 2023-10-01T08:06:04.758 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173192.log 2023-10-01T08:06:04.759 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167743.log 2023-10-01T08:06:04.759 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184848.log 2023-10-01T08:06:04.759 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.173192.log.gz 2023-10-01T08:06:04.759 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150245.log 2023-10-01T08:06:04.759 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170815.log 2023-10-01T08:06:04.759 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.184848.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.167743.log.gz 2023-10-01T08:06:04.759 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.150245.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.184848.log.gz 2023-10-01T08:06:04.759 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.170815.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.150245.log.gz 2023-10-01T08:06:04.760 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.170815.log.gz 2023-10-01T08:06:04.760 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124880.log 2023-10-01T08:06:04.760 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124341.log 2023-10-01T08:06:04.760 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.124880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175946.log 2023-10-01T08:06:04.760 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124880.log.gz 2023-10-01T08:06:04.760 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.124341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166372.log 2023-10-01T08:06:04.760 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 /var/log/ceph/ceph-client.admin.175946.log: --verbose -- /var/log/ceph/ceph-client.admin.123263.log 2023-10-01T08:06:04.760 INFO:teuthology.orchestra.run.smithi026.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.124341.log.gz 2023-10-01T08:06:04.761 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166372.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.175946.log.gz 2023-10-01T08:06:04.761 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167679.log 2023-10-01T08:06:04.761 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.166372.log.gz 2023-10-01T08:06:04.761 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.123263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124733.log 2023-10-01T08:06:04.761 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142296.log 2023-10-01T08:06:04.761 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.123263.log.gz 2023-10-01T08:06:04.761 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167679.log: /var/log/ceph/ceph-client.admin.124733.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.167679.log.gz 2023-10-01T08:06:04.761 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178133.log 2023-10-01T08:06:04.762 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124733.log.gz 2023-10-01T08:06:04.762 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.142296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190697.log 2023-10-01T08:06:04.762 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.142296.log.gz 2023-10-01T08:06:04.762 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182217.log 2023-10-01T08:06:04.762 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.178133.log: /var/log/ceph/ceph-client.admin.190697.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.178133.log.gz 2023-10-01T08:06:04.762 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.190697.log.gz 2023-10-01T08:06:04.762 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.182217.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.182217.log.gz 2023-10-01T08:06:04.762 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123557.log 2023-10-01T08:06:04.763 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174565.log 2023-10-01T08:06:04.763 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.123557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136309.log 2023-10-01T08:06:04.763 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174565.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.123557.log.gz 2023-10-01T08:06:04.763 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.174565.log.gz 2023-10-01T08:06:04.763 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.136309.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.136309.log.gz 2023-10-01T08:06:04.763 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152692.log 2023-10-01T08:06:04.763 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118567.log 2023-10-01T08:06:04.763 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.152692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161373.log 2023-10-01T08:06:04.764 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152692.log.gz 2023-10-01T08:06:04.764 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.118567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192002.log 2023-10-01T08:06:04.764 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161373.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118567.log.gz 2023-10-01T08:06:04.764 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142178.log 2023-10-01T08:06:04.764 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.161373.log.gz 2023-10-01T08:06:04.764 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.192002.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.192002.log.gz 2023-10-01T08:06:04.764 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.142178.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.142178.log.gz 2023-10-01T08:06:04.764 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127452.log 2023-10-01T08:06:04.765 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133023.log 2023-10-01T08:06:04.765 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.127452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188196.log 2023-10-01T08:06:04.765 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.133023.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.127452.log.gz 2023-10-01T08:06:04.765 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125027.log 2023-10-01T08:06:04.765 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.133023.log.gz 2023-10-01T08:06:04.765 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141759.log 2023-10-01T08:06:04.765 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.188196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134663.log 2023-10-01T08:06:04.765 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.188196.log.gz 2023-10-01T08:06:04.765 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.125027.log: /var/log/ceph/ceph-client.admin.141759.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.125027.log.gz 2023-10-01T08:06:04.766 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.141759.log.gz 2023-10-01T08:06:04.766 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.134663.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.134663.log.gz 2023-10-01T08:06:04.766 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127022.log 2023-10-01T08:06:04.766 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156612.log 2023-10-01T08:06:04.766 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.127022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177148.log 2023-10-01T08:06:04.766 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156612.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.127022.log.gz 2023-10-01T08:06:04.766 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152349.log 2023-10-01T08:06:04.766 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.156612.log.gz 2023-10-01T08:06:04.767 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.177148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140013.log 2023-10-01T08:06:04.767 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170985.log 2023-10-01T08:06:04.767 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.152349.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.177148.log.gz 2023-10-01T08:06:04.767 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.140013.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.152349.log.gz 2023-10-01T08:06:04.767 INFO:teuthology.orchestra.run.smithi026.stderr: 87.4%/var/log/ceph/ceph-client.admin.170985.log: -- replaced with /var/log/ceph/ceph-client.admin.140013.log.gz 2023-10-01T08:06:04.767 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.170985.log.gz 2023-10-01T08:06:04.767 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188784.log 2023-10-01T08:06:04.767 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139400.log 2023-10-01T08:06:04.768 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.188784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134299.log 2023-10-01T08:06:04.768 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.188784.log.gz 2023-10-01T08:06:04.768 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.139400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145628.log 2023-10-01T08:06:04.768 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162941.log 2023-10-01T08:06:04.768 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.139400.log.gz 2023-10-01T08:06:04.768 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.134299.log: /var/log/ceph/ceph-client.admin.145628.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.134299.log.gz 2023-10-01T08:06:04.768 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162941.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.145628.log.gz 2023-10-01T08:06:04.768 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.162941.log.gz 2023-10-01T08:06:04.769 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176089.log 2023-10-01T08:06:04.769 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165097.log 2023-10-01T08:06:04.769 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163822.log 2023-10-01T08:06:04.769 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.176089.log.gz 2023-10-01T08:06:04.769 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.165097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136432.log 2023-10-01T08:06:04.769 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146138.log 2023-10-01T08:06:04.769 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.163822.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.165097.log.gz 2023-10-01T08:06:04.769 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.136432.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.163822.log.gz 2023-10-01T08:06:04.770 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.136432.log.gz 2023-10-01T08:06:04.770 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.146138.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.146138.log.gz 2023-10-01T08:06:04.770 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175187.log 2023-10-01T08:06:04.770 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158085.log 2023-10-01T08:06:04.770 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.175187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170397.log 2023-10-01T08:06:04.770 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158085.log: gzip -5 --verbose -- 89.0%/var/log/ceph/ceph-client.admin.138172.log 2023-10-01T08:06:04.770 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.175187.log.gz 2023-10-01T08:06:04.770 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.158085.log.gz 2023-10-01T08:06:04.771 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.170397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187728.log 2023-10-01T08:06:04.771 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.170397.log.gz 2023-10-01T08:06:04.771 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.138172.log: /var/log/ceph/ceph-client.admin.187728.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.138172.log.gz 2023-10-01T08:06:04.771 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.187728.log.gz 2023-10-01T08:06:04.771 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179034.log 2023-10-01T08:06:04.771 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161569.log 2023-10-01T08:06:04.771 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148372.log 2023-10-01T08:06:04.771 INFO:teuthology.orchestra.run.smithi026.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.179034.log.gz 2023-10-01T08:06:04.772 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140014.log 2023-10-01T08:06:04.772 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.148372.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.161569.log.gz 2023-10-01T08:06:04.772 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.148372.log.gz 2023-10-01T08:06:04.772 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.140014.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.140014.log.gz 2023-10-01T08:06:04.772 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137386.log 2023-10-01T08:06:04.772 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174938.log 2023-10-01T08:06:04.772 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.137386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149648.log 2023-10-01T08:06:04.772 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.137386.log.gz 2023-10-01T08:06:04.773 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146708.log 2023-10-01T08:06:04.773 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.174938.log.gz/var/log/ceph/ceph-client.admin.149648.log: 2023-10-01T08:06:04.773 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152300.log 2023-10-01T08:06:04.773 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.146708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181386.log 2023-10-01T08:06:04.773 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.149648.log.gz 2023-10-01T08:06:04.773 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.146708.log.gz 2023-10-01T08:06:04.773 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.152300.log: /var/log/ceph/ceph-client.admin.181386.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.152300.log.gz 2023-10-01T08:06:04.773 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.181386.log.gz 2023-10-01T08:06:04.774 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181488.log 2023-10-01T08:06:04.774 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166576.log 2023-10-01T08:06:04.774 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.181488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136014.log 2023-10-01T08:06:04.774 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166576.log: gzip 89.2%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.181488.log.gz-- 2023-10-01T08:06:04.774 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.183672.log 2023-10-01T08:06:04.774 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.136014.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.166576.log.gz 2023-10-01T08:06:04.774 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193227.log 2023-10-01T08:06:04.774 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.136014.log.gz 2023-10-01T08:06:04.775 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.183672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123165.log 2023-10-01T08:06:04.775 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.193227.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.183672.log.gz 2023-10-01T08:06:04.775 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161621.log 2023-10-01T08:06:04.775 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.193227.log.gz 2023-10-01T08:06:04.775 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.123165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164953.log 2023-10-01T08:06:04.775 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129112.log 2023-10-01T08:06:04.775 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.123165.log.gz 2023-10-01T08:06:04.775 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161621.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.161621.log.gz 2023-10-01T08:06:04.776 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154756.log 2023-10-01T08:06:04.776 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.164953.log.gz 2023-10-01T08:06:04.776 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.129112.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.129112.log.gz 2023-10-01T08:06:04.776 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.154756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185167.log 2023-10-01T08:06:04.776 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.154756.log.gz 2023-10-01T08:06:04.776 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177938.log 2023-10-01T08:06:04.776 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138224.log 2023-10-01T08:06:04.776 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.185167.log: /var/log/ceph/ceph-client.admin.177938.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.185167.log.gz 2023-10-01T08:06:04.777 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.177938.log.gz 2023-10-01T08:06:04.777 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.138224.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.138224.log.gz 2023-10-01T08:06:04.777 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179526.log 2023-10-01T08:06:04.777 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185951.log 2023-10-01T08:06:04.777 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154897.log 2023-10-01T08:06:04.777 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.179526.log.gz 2023-10-01T08:06:04.777 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.185951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135086.log 2023-10-01T08:06:04.777 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.185951.log.gz 2023-10-01T08:06:04.778 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.154897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183205.log 2023-10-01T08:06:04.778 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167542.log 2023-10-01T08:06:04.778 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.154897.log.gz 2023-10-01T08:06:04.778 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.135086.log: /var/log/ceph/ceph-client.admin.183205.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.135086.log.gz 2023-10-01T08:06:04.778 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191508.log 2023-10-01T08:06:04.778 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.183205.log.gz 2023-10-01T08:06:04.778 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169809.log 2023-10-01T08:06:04.778 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.167542.log.gz 2023-10-01T08:06:04.779 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.191508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183476.log 2023-10-01T08:06:04.779 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.191508.log.gz--verbose 2023-10-01T08:06:04.779 INFO:teuthology.orchestra.run.smithi026.stderr:-- /var/log/ceph/ceph-client.admin.157837.log 2023-10-01T08:06:04.779 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169809.log: /var/log/ceph/ceph-client.admin.183476.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.169809.log.gz 2023-10-01T08:06:04.779 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.183476.log.gz 2023-10-01T08:06:04.779 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157837.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.157837.log.gz 2023-10-01T08:06:04.779 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175357.log 2023-10-01T08:06:04.779 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151199.log 2023-10-01T08:06:04.780 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.175357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159243.log 2023-10-01T08:06:04.780 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.175357.log.gz 2023-10-01T08:06:04.780 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.151199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157249.log 2023-10-01T08:06:04.780 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.151199.log.gz 2023-10-01T08:06:04.780 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158382.log 2023-10-01T08:06:04.780 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150807.log 2023-10-01T08:06:04.780 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157249.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.159243.log.gz 2023-10-01T08:06:04.780 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.157249.log.gz 2023-10-01T08:06:04.781 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155511.log 2023-10-01T08:06:04.781 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170889.log 2023-10-01T08:06:04.781 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1%/var/log/ceph/ceph-client.admin.150807.log: -- replaced with /var/log/ceph/ceph-client.admin.158382.log.gz 2023-10-01T08:06:04.781 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.150807.log.gz 2023-10-01T08:06:04.781 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.155511.log: 88.1%/var/log/ceph/ceph-client.admin.170889.log: -- replaced with /var/log/ceph/ceph-client.admin.155511.log.gz 2023-10-01T08:06:04.781 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.170889.log.gz 2023-10-01T08:06:04.781 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185510.log 2023-10-01T08:06:04.781 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148667.log 2023-10-01T08:06:04.782 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.185510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125125.log 2023-10-01T08:06:04.782 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.148667.log: gzip -5 89.6%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.185510.log.gz/var/log/ceph/ceph-client.admin.172260.log 2023-10-01T08:06:04.782 INFO:teuthology.orchestra.run.smithi026.stderr: 2023-10-01T08:06:04.782 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.125125.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.148667.log.gz 2023-10-01T08:06:04.782 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-01T08:06:04.782 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.125125.log.gz 2023-10-01T08:06:04.782 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.172260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151442.log 2023-10-01T08:06:04.832 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mgr.x.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.172260.log.gz 2023-10-01T08:06:04.832 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140746.log 2023-10-01T08:06:04.832 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.151442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192835.log 2023-10-01T08:06:04.833 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.151442.log.gz 2023-10-01T08:06:04.833 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.140746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188758.log 2023-10-01T08:06:04.833 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.140746.log.gz 2023-10-01T08:06:04.833 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.192835.log: /var/log/ceph/ceph-client.admin.188758.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.192835.log.gz 2023-10-01T08:06:04.833 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.188758.log.gz 2023-10-01T08:06:04.833 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160884.log 2023-10-01T08:06:04.833 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159729.log 2023-10-01T08:06:04.833 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.160884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176797.log 2023-10-01T08:06:04.834 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.160884.log.gz 2023-10-01T08:06:04.834 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159729.log: /var/log/ceph/ceph-client.admin.176797.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.159729.log.gz 2023-10-01T08:06:04.834 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.176797.log.gz 2023-10-01T08:06:04.834 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186991.log 2023-10-01T08:06:04.834 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178668.log 2023-10-01T08:06:04.834 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.186991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123830.log 2023-10-01T08:06:04.834 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.178668.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.186991.log.gz 2023-10-01T08:06:04.834 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.123830.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.178668.log.gz 2023-10-01T08:06:04.835 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.123830.log.gz 2023-10-01T08:06:04.835 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155877.log 2023-10-01T08:06:04.835 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173805.log 2023-10-01T08:06:04.835 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.155877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147100.log 2023-10-01T08:06:04.835 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.155877.log.gz 2023-10-01T08:06:04.835 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151761.log 2023-10-01T08:06:04.835 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.147100.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.173805.log.gz 2023-10-01T08:06:04.836 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179917.log 2023-10-01T08:06:04.836 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.147100.log.gz 2023-10-01T08:06:04.836 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.151761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150049.log 2023-10-01T08:06:04.836 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.151761.log.gz 2023-10-01T08:06:04.836 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179917.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.179917.log.gz 2023-10-01T08:06:04.836 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.150049.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.150049.log.gz 2023-10-01T08:06:04.836 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169469.log 2023-10-01T08:06:04.836 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150637.log 2023-10-01T08:06:04.836 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174717.log 2023-10-01T08:06:04.837 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.150637.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.169469.log.gz 2023-10-01T08:06:04.837 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.150637.log.gz 2023-10-01T08:06:04.837 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174717.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.174717.log.gz 2023-10-01T08:06:04.837 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148248.log 2023-10-01T08:06:04.837 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180210.log 2023-10-01T08:06:04.837 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.148248.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.148248.log.gz 2023-10-01T08:06:04.837 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.180210.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.180210.log.gz 2023-10-01T08:06:04.837 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147635.log 2023-10-01T08:06:04.838 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151172.log 2023-10-01T08:06:04.838 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.147635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179303.log 2023-10-01T08:06:04.838 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.147635.log.gz 2023-10-01T08:06:04.838 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.151172.log: /var/log/ceph/ceph-client.admin.179303.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.151172.log.gz 2023-10-01T08:06:04.838 INFO:teuthology.orchestra.run.smithi026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.179303.log.gz 2023-10-01T08:06:04.838 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164757.log 2023-10-01T08:06:04.838 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192711.log 2023-10-01T08:06:04.838 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186343.log 2023-10-01T08:06:04.839 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.164757.log.gz 2023-10-01T08:06:04.839 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.192711.log: /var/log/ceph/ceph-client.admin.186343.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.192711.log.gz 2023-10-01T08:06:04.839 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136406.log 2023-10-01T08:06:04.839 INFO:teuthology.orchestra.run.smithi026.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.186343.log.gz 2023-10-01T08:06:04.839 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128769.log 2023-10-01T08:06:04.839 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137865.log 2023-10-01T08:06:04.839 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.136406.log: /var/log/ceph/ceph-client.admin.128769.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.136406.log.gz 2023-10-01T08:06:04.839 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.137865.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.128769.log.gz 2023-10-01T08:06:04.840 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.137865.log.gz 2023-10-01T08:06:04.840 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182488.log 2023-10-01T08:06:04.840 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179622.log 2023-10-01T08:06:04.840 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.182488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170056.log 2023-10-01T08:06:04.840 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.182488.log.gz 2023-10-01T08:06:04.840 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179622.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.179622.log.gz 2023-10-01T08:06:04.840 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.170056.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.170056.log.gz 2023-10-01T08:06:04.840 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137680.log 2023-10-01T08:06:04.841 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170279.log 2023-10-01T08:06:04.841 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.137680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180870.log 2023-10-01T08:06:04.841 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.170279.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.137680.log.gz 2023-10-01T08:06:04.841 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.180870.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.170279.log.gz 2023-10-01T08:06:04.841 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.180870.log.gz 2023-10-01T08:06:04.841 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189642.log 2023-10-01T08:06:04.841 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139596.log 2023-10-01T08:06:04.841 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.189642.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.189642.log.gz 2023-10-01T08:06:04.842 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.139596.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.139596.log.gz 2023-10-01T08:06:04.842 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141189.log 2023-10-01T08:06:04.842 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182684.log 2023-10-01T08:06:04.842 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.141189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134668.log 2023-10-01T08:06:04.842 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.141189.log.gz 2023-10-01T08:06:04.842 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.182684.log: /var/log/ceph/ceph-client.admin.134668.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.182684.log.gz 2023-10-01T08:06:04.842 INFO:teuthology.orchestra.run.smithi026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.134668.log.gz 2023-10-01T08:06:04.842 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124027.log 2023-10-01T08:06:04.843 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178937.log 2023-10-01T08:06:04.843 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188980.log 2023-10-01T08:06:04.843 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.124027.log: /var/log/ceph/ceph-client.admin.178937.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.124027.log.gz 2023-10-01T08:06:04.843 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.178937.log.gz 2023-10-01T08:06:04.843 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.188980.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.188980.log.gz 2023-10-01T08:06:04.843 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179230.log 2023-10-01T08:06:04.843 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155342.log 2023-10-01T08:06:04.843 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189887.log 2023-10-01T08:06:04.844 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.155342.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.179230.log.gz 2023-10-01T08:06:04.844 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.189887.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.155342.log.gz 2023-10-01T08:06:04.844 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.189887.log.gz 2023-10-01T08:06:04.844 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122959.log 2023-10-01T08:06:04.844 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186024.log 2023-10-01T08:06:04.844 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.122959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167142.log 2023-10-01T08:06:04.844 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.186024.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.122959.log.gz 2023-10-01T08:06:04.844 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167142.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.186024.log.gz 2023-10-01T08:06:04.845 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.167142.log.gz 2023-10-01T08:06:04.845 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149791.log 2023-10-01T08:06:04.845 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140224.log 2023-10-01T08:06:04.845 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.149791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190818.log 2023-10-01T08:06:04.845 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3%/var/log/ceph/ceph-client.admin.140224.log: -- replaced with /var/log/ceph/ceph-client.admin.149791.log.gz 2023-10-01T08:06:04.845 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.190818.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.140224.log.gz 2023-10-01T08:06:04.845 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.190818.log.gz 2023-10-01T08:06:04.845 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155707.log 2023-10-01T08:06:04.846 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127762.log 2023-10-01T08:06:04.846 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.155707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134719.log 2023-10-01T08:06:04.846 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.127762.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.155707.log.gz 2023-10-01T08:06:04.846 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.134719.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.127762.log.gz 2023-10-01T08:06:04.846 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.134719.log.gz 2023-10-01T08:06:04.846 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168928.log 2023-10-01T08:06:04.846 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181851.log 2023-10-01T08:06:04.846 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.168928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176312.log 2023-10-01T08:06:04.847 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.168928.log.gz 2023-10-01T08:06:04.847 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.181851.log: /var/log/ceph/ceph-client.admin.176312.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.181851.log.gz 2023-10-01T08:06:04.847 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.176312.log.gz 2023-10-01T08:06:04.847 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159073.log 2023-10-01T08:06:04.847 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166500.log 2023-10-01T08:06:04.847 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146047.log 2023-10-01T08:06:04.847 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.159073.log.gz 2023-10-01T08:06:04.847 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166500.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166500.log.gz 2023-10-01T08:06:04.848 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.146047.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.146047.log.gz 2023-10-01T08:06:04.848 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188466.log 2023-10-01T08:06:04.848 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142910.log 2023-10-01T08:06:04.848 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.188466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145432.log 2023-10-01T08:06:04.848 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.142910.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.188466.log.gz 2023-10-01T08:06:04.848 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.142910.log.gz 2023-10-01T08:06:04.848 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.145432.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.145432.log.gz 2023-10-01T08:06:04.848 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170252.log 2023-10-01T08:06:04.849 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163921.log 2023-10-01T08:06:04.849 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.170252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169702.log 2023-10-01T08:06:04.849 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.170252.log.gz 2023-10-01T08:06:04.849 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.163921.log: /var/log/ceph/ceph-client.admin.169702.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.163921.log.gz 2023-10-01T08:06:04.849 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.169702.log.gz 2023-10-01T08:06:04.849 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179134.log 2023-10-01T08:06:04.849 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135897.log 2023-10-01T08:06:04.849 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188954.log 2023-10-01T08:06:04.850 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.179134.log.gz 2023-10-01T08:06:04.850 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.135897.log: /var/log/ceph/ceph-client.admin.188954.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.135897.log.gz 2023-10-01T08:06:04.850 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.188954.log.gz 2023-10-01T08:06:04.850 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152376.log 2023-10-01T08:06:04.850 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168241.log 2023-10-01T08:06:04.850 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.152376.log: /var/log/ceph/ceph-client.admin.168241.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.152376.log.gz 2023-10-01T08:06:04.850 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.168241.log.gz 2023-10-01T08:06:04.851 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176142.log 2023-10-01T08:06:04.851 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150836.log 2023-10-01T08:06:04.851 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152987.log 2023-10-01T08:06:04.851 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.176142.log.gz 2023-10-01T08:06:04.851 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.150836.log: 90.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-01T08:06:04.851 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.152987.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.150836.log.gz 2023-10-01T08:06:04.851 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.152987.log.gz 2023-10-01T08:06:04.852 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138786.log 2023-10-01T08:06:04.852 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127026.log 2023-10-01T08:06:04.852 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.138786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146020.log 2023-10-01T08:06:04.852 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.138786.log.gz 2023-10-01T08:06:04.852 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.127026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168881.log 2023-10-01T08:06:04.852 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134890.log 2023-10-01T08:06:04.852 INFO:teuthology.orchestra.run.smithi026.stderr: 86.8%/var/log/ceph/ceph-client.admin.146020.log: -- replaced with /var/log/ceph/ceph-client.admin.127026.log.gz 2023-10-01T08:06:04.852 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.168881.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.146020.log.gz 2023-10-01T08:06:04.853 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122612.log 2023-10-01T08:06:04.853 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.168881.log.gz 2023-10-01T08:06:04.853 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.134890.log: /var/log/ceph/ceph-client.admin.122612.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.134890.log.gz 2023-10-01T08:06:04.853 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.122612.log.gz 2023-10-01T08:06:04.853 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178348.log 2023-10-01T08:06:04.853 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173610.log 2023-10-01T08:06:04.853 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.178348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144726.log 2023-10-01T08:06:04.853 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.178348.log.gz 2023-10-01T08:06:04.854 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147196.log 2023-10-01T08:06:04.854 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.173610.log.gz 2023-10-01T08:06:04.854 INFO:teuthology.orchestra.run.smithi026.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.129430.log 2023-10-01T08:06:04.854 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.144726.log: /var/log/ceph/ceph-client.admin.147196.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.144726.log.gz 2023-10-01T08:06:04.854 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.129430.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.147196.log.gz 2023-10-01T08:06:04.854 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.129430.log.gz 2023-10-01T08:06:04.854 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137582.log 2023-10-01T08:06:04.854 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142884.log 2023-10-01T08:06:04.855 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.137582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123704.log 2023-10-01T08:06:04.855 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.137582.log.gz 2023-10-01T08:06:04.855 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.142884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147687.log 2023-10-01T08:06:04.855 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192443.log 2023-10-01T08:06:04.855 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.123704.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.142884.log.gz 2023-10-01T08:06:04.855 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.147687.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.123704.log.gz 2023-10-01T08:06:04.855 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148275.log 2023-10-01T08:06:04.855 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.147687.log.gz 2023-10-01T08:06:04.856 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.192443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157275.log 2023-10-01T08:06:04.856 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.192443.log.gz 2023-10-01T08:06:04.856 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.148275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143668.log 2023-10-01T08:06:04.856 INFO:teuthology.orchestra.run.smithi026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.148275.log.gz 2023-10-01T08:06:04.856 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157275.log: /var/log/ceph/ceph-client.admin.143668.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.157275.log.gz 2023-10-01T08:06:04.856 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.143668.log.gz 2023-10-01T08:06:04.856 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137868.log 2023-10-01T08:06:04.856 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149425.log 2023-10-01T08:06:04.857 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.137868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152422.log 2023-10-01T08:06:04.857 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.137868.log.gz 2023-10-01T08:06:04.857 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.149425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177360.log 2023-10-01T08:06:04.857 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174939.log 2023-10-01T08:06:04.857 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149425.log.gz 2023-10-01T08:06:04.857 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.152422.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.152422.log.gz 2023-10-01T08:06:04.857 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.177360.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.177360.log.gz 2023-10-01T08:06:04.857 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174939.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.174939.log.gz 2023-10-01T08:06:04.858 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138445.log 2023-10-01T08:06:04.858 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123459.log 2023-10-01T08:06:04.858 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.138445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174343.log 2023-10-01T08:06:04.858 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.138445.log.gz 2023-10-01T08:06:04.858 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.123459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160981.log 2023-10-01T08:06:04.858 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.123459.log.gz 2023-10-01T08:06:04.858 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159217.log 2023-10-01T08:06:04.858 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174343.log: /var/log/ceph/ceph-client.admin.160981.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.174343.log.gz 2023-10-01T08:06:04.859 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159217.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.160981.log.gz 2023-10-01T08:06:04.859 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.159217.log.gz 2023-10-01T08:06:04.859 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129210.log 2023-10-01T08:06:04.859 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163580.log 2023-10-01T08:06:04.859 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.129210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188319.log 2023-10-01T08:06:04.859 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.129210.log.gz 2023-10-01T08:06:04.859 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.163580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179473.log 2023-10-01T08:06:04.859 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161765.log 2023-10-01T08:06:04.860 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.188319.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.163580.log.gz 2023-10-01T08:06:04.860 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179473.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.188319.log.gz 2023-10-01T08:06:04.860 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161765.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.179473.log.gz 2023-10-01T08:06:04.860 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.161765.log.gz 2023-10-01T08:06:04.860 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148053.log 2023-10-01T08:06:04.860 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141956.log 2023-10-01T08:06:04.860 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.148053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187091.log 2023-10-01T08:06:04.861 INFO:teuthology.orchestra.run.smithi026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.148053.log.gz 2023-10-01T08:06:04.861 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.141956.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.141956.log.gz 2023-10-01T08:06:04.861 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.187091.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.187091.log.gz 2023-10-01T08:06:04.861 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145898.log 2023-10-01T08:06:04.861 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141904.log 2023-10-01T08:06:04.861 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.145898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134203.log 2023-10-01T08:06:04.861 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.145898.log.gz 2023-10-01T08:06:04.861 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.141904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147073.log 2023-10-01T08:06:04.862 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140550.log 2023-10-01T08:06:04.862 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.141904.log.gz 2023-10-01T08:06:04.862 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.134203.log: /var/log/ceph/ceph-client.admin.147073.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.134203.log.gz 2023-10-01T08:06:04.862 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.140550.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.147073.log.gz 2023-10-01T08:06:04.862 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140550.log.gz 2023-10-01T08:06:04.862 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135622.log 2023-10-01T08:06:04.862 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174513.log 2023-10-01T08:06:04.862 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.135622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136262.log 2023-10-01T08:06:04.863 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.135622.log.gz 2023-10-01T08:06:04.863 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138002.log 2023-10-01T08:06:04.863 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.174513.log.gz 2023-10-01T08:06:04.863 INFO:teuthology.orchestra.run.smithi026.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.136505.log 2023-10-01T08:06:04.863 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.136262.log: /var/log/ceph/ceph-client.admin.138002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143080.log 2023-10-01T08:06:04.863 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.136262.log.gz 2023-10-01T08:06:04.863 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.138002.log.gz 2023-10-01T08:06:04.863 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.136505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139230.log 2023-10-01T08:06:04.864 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.136505.log.gz 2023-10-01T08:06:04.864 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.143080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193781.log 2023-10-01T08:06:04.864 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143080.log.gz 2023-10-01T08:06:04.864 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.139230.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.139230.log.gz 2023-10-01T08:06:04.864 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.193781.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.193781.log.gz 2023-10-01T08:06:04.864 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155537.log 2023-10-01T08:06:04.864 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148079.log 2023-10-01T08:06:04.864 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.155537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186390.log 2023-10-01T08:06:04.865 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.155537.log.gz 2023-10-01T08:06:04.865 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.148079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174990.log 2023-10-01T08:06:04.865 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145654.log 2023-10-01T08:06:04.865 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.148079.log.gz 2023-10-01T08:06:04.865 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.186390.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.186390.log.gz 2023-10-01T08:06:04.865 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189103.log 2023-10-01T08:06:04.865 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3%/var/log/ceph/ceph-client.admin.145654.log: -- replaced with /var/log/ceph/ceph-client.admin.174990.log.gz 2023-10-01T08:06:04.865 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188588.log 2023-10-01T08:06:04.866 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.145654.log.gz 2023-10-01T08:06:04.866 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.189103.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.189103.log.gz 2023-10-01T08:06:04.866 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.188588.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.188588.log.gz 2023-10-01T08:06:04.866 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164143.log 2023-10-01T08:06:04.866 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146093.log 2023-10-01T08:06:04.866 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149064.log 2023-10-01T08:06:04.866 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.146093.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.164143.log.gz 2023-10-01T08:06:04.866 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179081.log 2023-10-01T08:06:04.867 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.146093.log.gz 2023-10-01T08:06:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.149064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172062.log 2023-10-01T08:06:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158681.log 2023-10-01T08:06:04.867 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.149064.log.gz 2023-10-01T08:06:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179081.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.179081.log.gz 2023-10-01T08:06:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.172062.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172062.log.gz 2023-10-01T08:06:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158681.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.158681.log.gz 2023-10-01T08:06:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140381.log 2023-10-01T08:06:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179669.log 2023-10-01T08:06:04.868 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.140381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157497.log 2023-10-01T08:06:04.868 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179669.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.140381.log.gz 2023-10-01T08:06:04.868 INFO:teuthology.orchestra.run.smithi026.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.172017.log 2023-10-01T08:06:04.868 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.179669.log.gz 2023-10-01T08:06:04.868 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141530.log 2023-10-01T08:06:04.868 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.157497.log.gz 2023-10-01T08:06:04.868 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.172017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134129.log 2023-10-01T08:06:04.868 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.172017.log.gz 2023-10-01T08:06:04.869 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.141530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152989.log 2023-10-01T08:06:04.869 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.134129.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.141530.log.gz 2023-10-01T08:06:04.869 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153133.log 2023-10-01T08:06:04.869 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.134129.log.gz 2023-10-01T08:06:04.869 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.152989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177562.log 2023-10-01T08:06:04.869 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- 88.1%/var/log/ceph/ceph-client.admin.163384.log 2023-10-01T08:06:04.869 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.152989.log.gz 2023-10-01T08:06:04.869 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.153133.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.153133.log.gz 2023-10-01T08:06:04.870 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.177562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153721.log 2023-10-01T08:06:04.870 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.177562.log.gz 2023-10-01T08:06:04.870 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.163384.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.163384.log.gz 2023-10-01T08:06:04.870 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.153721.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.153721.log.gz 2023-10-01T08:06:04.870 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160641.log 2023-10-01T08:06:04.870 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135133.log 2023-10-01T08:06:04.870 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.160641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135327.log 2023-10-01T08:06:04.871 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.160641.log.gz 2023-10-01T08:06:04.871 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.135133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190083.log 2023-10-01T08:06:04.871 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.135133.log.gz 2023-10-01T08:06:04.871 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.135327.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-01T08:06:04.871 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156073.log 2023-10-01T08:06:04.871 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.135327.log.gz 2023-10-01T08:06:04.871 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.190083.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.190083.log.gz 2023-10-01T08:06:04.871 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143472.log 2023-10-01T08:06:04.872 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156909.log 2023-10-01T08:06:04.872 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.156073.log.gz 2023-10-01T08:06:04.872 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.143472.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.143472.log.gz 2023-10-01T08:06:04.872 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156909.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.156909.log.gz 2023-10-01T08:06:04.872 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153084.log 2023-10-01T08:06:04.872 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166273.log 2023-10-01T08:06:04.872 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.153084.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.153084.log.gz 2023-10-01T08:06:04.872 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166273.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.166273.log.gz 2023-10-01T08:06:04.873 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191806.log 2023-10-01T08:06:04.873 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165293.log 2023-10-01T08:06:04.873 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.191806.log: /var/log/ceph/ceph-client.admin.165293.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.191806.log.gz 2023-10-01T08:06:04.873 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.165293.log.gz 2023-10-01T08:06:04.873 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139399.log 2023-10-01T08:06:04.873 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191285.log 2023-10-01T08:06:04.873 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.139399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174564.log 2023-10-01T08:06:04.873 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139399.log.gz 2023-10-01T08:06:04.874 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.191285.log: /var/log/ceph/ceph-client.admin.174564.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.191285.log.gz 2023-10-01T08:06:04.874 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.174564.log.gz 2023-10-01T08:06:04.874 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186294.log 2023-10-01T08:06:04.874 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191907.log 2023-10-01T08:06:04.874 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.186294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165959.log 2023-10-01T08:06:04.874 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.186294.log.gz 2023-10-01T08:06:04.874 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.191907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167141.log 2023-10-01T08:06:04.874 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.165959.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.191907.log.gz 2023-10-01T08:06:04.875 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136091.log 2023-10-01T08:06:04.875 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.165959.log.gz 2023-10-01T08:06:04.875 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177365.log 2023-10-01T08:06:04.875 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.167141.log.gz 2023-10-01T08:06:04.875 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.136091.log: /var/log/ceph/ceph-client.admin.177365.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.136091.log.gz 2023-10-01T08:06:04.875 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.177365.log.gz 2023-10-01T08:06:04.875 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183280.log 2023-10-01T08:06:04.876 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-01T08:06:04.876 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.183280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152741.log 2023-10-01T08:06:04.876 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.183280.log.gz 2023-10-01T08:06:04.876 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.152741.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-01T08:06:04.876 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152741.log.gz 2023-10-01T08:06:04.876 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165393.log 2023-10-01T08:06:04.876 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.165393.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.165393.log.gz 2023-10-01T08:06:04.876 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158263.log 2023-10-01T08:06:04.877 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158263.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.158263.log.gz 2023-10-01T08:06:04.877 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127158.log 2023-10-01T08:06:04.877 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.127158.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.127158.log.gz 2023-10-01T08:06:04.877 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183822.log 2023-10-01T08:06:04.877 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.183822.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.183822.log.gz 2023-10-01T08:06:04.877 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139204.log 2023-10-01T08:06:04.877 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.139204.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.139204.log.gz 2023-10-01T08:06:04.877 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168108.log 2023-10-01T08:06:04.878 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.168108.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.168108.log.gz 2023-10-01T08:06:04.878 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154335.log 2023-10-01T08:06:04.878 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.154335.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.154335.log.gz 2023-10-01T08:06:04.878 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174394.log 2023-10-01T08:06:04.878 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174394.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.174394.log.gz 2023-10-01T08:06:04.878 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151788.log 2023-10-01T08:06:04.878 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.151788.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.151788.log.gz 2023-10-01T08:06:04.879 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141786.log 2023-10-01T08:06:04.879 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.141786.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.141786.log.gz 2023-10-01T08:06:04.879 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145730.log 2023-10-01T08:06:04.879 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.145730.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.145730.log.gz 2023-10-01T08:06:04.879 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162575.log 2023-10-01T08:06:04.879 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162575.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.162575.log.gz 2023-10-01T08:06:04.879 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176946.log 2023-10-01T08:06:04.880 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176946.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.176946.log.gz 2023-10-01T08:06:04.880 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122759.log 2023-10-01T08:06:04.880 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.122759.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.122759.log.gz 2023-10-01T08:06:04.880 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171991.log 2023-10-01T08:06:04.880 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171991.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.171991.log.gz 2023-10-01T08:06:04.880 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126745.log 2023-10-01T08:06:04.880 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.126745.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.126745.log.gz 2023-10-01T08:06:04.880 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159609.log 2023-10-01T08:06:04.881 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159609.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.159609.log.gz 2023-10-01T08:06:04.881 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192320.log 2023-10-01T08:06:04.881 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.192320.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.192320.log.gz 2023-10-01T08:06:04.881 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178277.log 2023-10-01T08:06:04.881 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.178277.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.178277.log.gz 2023-10-01T08:06:04.881 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179107.log 2023-10-01T08:06:04.881 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179107.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.179107.log.gz 2023-10-01T08:06:04.881 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147661.log 2023-10-01T08:06:04.882 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.147661.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.147661.log.gz 2023-10-01T08:06:04.882 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142571.log 2023-10-01T08:06:04.882 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.142571.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.142571.log.gz 2023-10-01T08:06:04.882 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150975.log 2023-10-01T08:06:04.882 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.150975.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.150975.log.gz 2023-10-01T08:06:04.882 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166325.log 2023-10-01T08:06:04.882 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166325.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166325.log.gz 2023-10-01T08:06:04.882 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147465.log 2023-10-01T08:06:04.883 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.147465.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.147465.log.gz 2023-10-01T08:06:04.883 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177957.log 2023-10-01T08:06:04.883 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.177957.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.177957.log.gz 2023-10-01T08:06:04.883 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152888.log 2023-10-01T08:06:04.883 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.152888.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.152888.log.gz 2023-10-01T08:06:04.883 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159439.log 2023-10-01T08:06:04.883 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159439.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.159439.log.gz 2023-10-01T08:06:04.883 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187140.log 2023-10-01T08:06:04.884 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.187140.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.187140.log.gz 2023-10-01T08:06:04.884 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160027.log 2023-10-01T08:06:04.884 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.160027.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.160027.log.gz 2023-10-01T08:06:04.884 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139595.log 2023-10-01T08:06:04.884 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.139595.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139595.log.gz 2023-10-01T08:06:04.884 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157445.log 2023-10-01T08:06:04.884 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157445.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.157445.log.gz 2023-10-01T08:06:04.885 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180649.log 2023-10-01T08:06:04.885 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.180649.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.180649.log.gz 2023-10-01T08:06:04.885 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125784.log 2023-10-01T08:06:04.885 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.125784.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.125784.log.gz 2023-10-01T08:06:04.885 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184775.log 2023-10-01T08:06:04.885 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.184775.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.184775.log.gz 2023-10-01T08:06:04.885 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190426.log 2023-10-01T08:06:04.885 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.190426.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.190426.log.gz 2023-10-01T08:06:04.886 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164365.log 2023-10-01T08:06:04.886 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164365.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.164365.log.gz 2023-10-01T08:06:04.886 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124831.log 2023-10-01T08:06:04.886 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.124831.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.124831.log.gz 2023-10-01T08:06:04.886 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135896.log 2023-10-01T08:06:04.886 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.135896.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.135896.log.gz 2023-10-01T08:06:04.886 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183868.log 2023-10-01T08:06:04.886 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.183868.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.183868.log.gz 2023-10-01T08:06:04.887 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183550.log 2023-10-01T08:06:04.887 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.183550.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.183550.log.gz 2023-10-01T08:06:04.887 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128315.log 2023-10-01T08:06:04.887 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.128315.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.128315.log.gz 2023-10-01T08:06:04.887 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142980.log 2023-10-01T08:06:04.887 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.142980.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.142980.log.gz 2023-10-01T08:06:04.887 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190867.log 2023-10-01T08:06:04.887 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181880.log 2023-10-01T08:06:04.888 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.190867.log: /var/log/ceph/ceph-client.admin.181880.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.190867.log.gz 2023-10-01T08:06:04.888 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.181880.log.gz 2023-10-01T08:06:04.888 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161817.log 2023-10-01T08:06:04.888 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161817.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.161817.log.gz 2023-10-01T08:06:04.888 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145691.log 2023-10-01T08:06:04.888 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.145691.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.145691.log.gz 2023-10-01T08:06:04.888 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159831.log 2023-10-01T08:06:04.888 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159831.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.159831.log.gz 2023-10-01T08:06:04.889 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193057.log 2023-10-01T08:06:04.889 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.193057.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.193057.log.gz 2023-10-01T08:06:04.889 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171795.log 2023-10-01T08:06:04.889 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171795.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.171795.log.gz 2023-10-01T08:06:04.889 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148837.log 2023-10-01T08:06:04.889 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.148837.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.148837.log.gz 2023-10-01T08:06:04.889 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-01T08:06:04.889 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mon.c.log: 94.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-01T08:06:04.890 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143375.log 2023-10-01T08:06:04.890 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136798.log 2023-10-01T08:06:04.890 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.143375.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.143375.log.gz 2023-10-01T08:06:04.890 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.136798.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.136798.log.gz 2023-10-01T08:06:04.890 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179890.log 2023-10-01T08:06:04.890 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150413.log 2023-10-01T08:06:04.890 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179890.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.179890.log.gz 2023-10-01T08:06:04.890 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.150413.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.150413.log.gz 2023-10-01T08:06:04.891 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143768.log 2023-10-01T08:06:04.891 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124245.log 2023-10-01T08:06:04.891 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.143768.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.143768.log.gz 2023-10-01T08:06:04.891 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.124245.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.124245.log.gz 2023-10-01T08:06:04.891 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157863.log 2023-10-01T08:06:04.891 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188907.log 2023-10-01T08:06:04.891 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157863.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.157863.log.gz 2023-10-01T08:06:04.891 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.188907.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.188907.log.gz 2023-10-01T08:06:04.892 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187409.log 2023-10-01T08:06:04.892 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170646.log 2023-10-01T08:06:04.892 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.187409.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.187409.log.gz 2023-10-01T08:06:04.892 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.170646.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.170646.log.gz 2023-10-01T08:06:04.892 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189691.log 2023-10-01T08:06:04.892 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.189691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142322.log 2023-10-01T08:06:04.892 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.189691.log.gz 2023-10-01T08:06:04.892 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.142322.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.142322.log.gz 2023-10-01T08:06:04.893 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139008.log 2023-10-01T08:06:04.893 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153968.log 2023-10-01T08:06:04.893 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.139008.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139008.log.gz 2023-10-01T08:06:04.893 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.153968.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.153968.log.gz 2023-10-01T08:06:04.893 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159635.log 2023-10-01T08:06:04.893 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159860.log 2023-10-01T08:06:04.893 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159635.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.159635.log.gz 2023-10-01T08:06:04.893 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159860.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.159860.log.gz 2023-10-01T08:06:04.894 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179891.log 2023-10-01T08:06:04.894 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143571.log 2023-10-01T08:06:04.894 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179891.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.179891.log.gz 2023-10-01T08:06:04.894 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.143571.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143571.log.gz 2023-10-01T08:06:04.894 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161399.log 2023-10-01T08:06:04.908 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152180.log 2023-10-01T08:06:04.908 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161399.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.161399.log.gz 2023-10-01T08:06:04.909 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.152180.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.152180.log.gz 2023-10-01T08:06:04.909 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134009.log 2023-10-01T08:06:04.909 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.134009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187679.log 2023-10-01T08:06:04.909 INFO:teuthology.orchestra.run.smithi026.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.134009.log.gz 2023-10-01T08:06:04.909 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.187679.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.187679.log.gz 2023-10-01T08:06:04.909 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187483.log 2023-10-01T08:06:04.909 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.187483.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.187483.log.gz 2023-10-01T08:06:04.909 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169443.log 2023-10-01T08:06:04.910 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169443.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.169443.log.gz 2023-10-01T08:06:04.910 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174795.log 2023-10-01T08:06:04.910 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174795.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.174795.log.gz 2023-10-01T08:06:04.910 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177749.log 2023-10-01T08:06:04.910 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.177749.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.177749.log.gz 2023-10-01T08:06:04.910 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134348.log 2023-10-01T08:06:04.910 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.134348.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.134348.log.gz 2023-10-01T08:06:04.911 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178735.log 2023-10-01T08:06:04.911 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.178735.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.178735.log.gz 2023-10-01T08:06:04.911 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178132.log 2023-10-01T08:06:04.911 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.178132.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.178132.log.gz 2023-10-01T08:06:04.911 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153868.log 2023-10-01T08:06:04.911 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.153868.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.153868.log.gz 2023-10-01T08:06:04.911 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185240.log 2023-10-01T08:06:04.911 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.185240.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.185240.log.gz 2023-10-01T08:06:04.912 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125637.log 2023-10-01T08:06:04.912 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.125637.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.125637.log.gz 2023-10-01T08:06:04.912 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124171.log 2023-10-01T08:06:04.912 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.124171.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.124171.log.gz 2023-10-01T08:06:04.912 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193031.log 2023-10-01T08:06:04.912 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.193031.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.193031.log.gz 2023-10-01T08:06:04.912 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168293.log 2023-10-01T08:06:04.912 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.168293.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.168293.log.gz 2023-10-01T08:06:04.913 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137216.log 2023-10-01T08:06:04.913 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.137216.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.137216.log.gz 2023-10-01T08:06:04.913 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187213.log 2023-10-01T08:06:04.913 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.187213.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.187213.log.gz 2023-10-01T08:06:04.913 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163411.log 2023-10-01T08:06:04.913 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.163411.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.163411.log.gz 2023-10-01T08:06:04.913 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164019.log 2023-10-01T08:06:04.913 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164019.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.164019.log.gz 2023-10-01T08:06:04.914 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138075.log 2023-10-01T08:06:04.914 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.138075.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.138075.log.gz 2023-10-01T08:06:04.914 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154531.log 2023-10-01T08:06:04.914 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.154531.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.154531.log.gz 2023-10-01T08:06:04.914 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135256.log 2023-10-01T08:06:04.914 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.135256.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.135256.log.gz 2023-10-01T08:06:04.914 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151516.log 2023-10-01T08:06:04.914 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.151516.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.151516.log.gz 2023-10-01T08:06:04.915 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151637.log 2023-10-01T08:06:04.915 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.151637.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.151637.log.gz 2023-10-01T08:06:04.915 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124782.log 2023-10-01T08:06:04.915 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.124782.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.124782.log.gz 2023-10-01T08:06:04.915 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172652.log 2023-10-01T08:06:04.915 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.172652.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.172652.log.gz 2023-10-01T08:06:04.915 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177757.log 2023-10-01T08:06:04.916 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.177757.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.177757.log.gz 2023-10-01T08:06:04.916 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125343.log 2023-10-01T08:06:04.916 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.125343.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.125343.log.gz 2023-10-01T08:06:04.916 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173806.log 2023-10-01T08:06:04.916 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173806.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.173806.log.gz 2023-10-01T08:06:04.916 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176704.log 2023-10-01T08:06:04.916 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176704.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.176704.log.gz 2023-10-01T08:06:04.916 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173023.log 2023-10-01T08:06:04.917 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173023.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.173023.log.gz 2023-10-01T08:06:04.917 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192980.log 2023-10-01T08:06:04.917 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.192980.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.192980.log.gz 2023-10-01T08:06:04.917 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191685.log 2023-10-01T08:06:04.917 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.191685.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.191685.log.gz 2023-10-01T08:06:04.917 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154923.log 2023-10-01T08:06:04.917 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.154923.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.154923.log.gz 2023-10-01T08:06:04.917 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193879.log 2023-10-01T08:06:04.918 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-01T08:06:04.918 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.193879.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.193879.log.gz 2023-10-01T08:06:04.918 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph.log: 94.2% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-01T08:06:04.918 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176384.log 2023-10-01T08:06:04.918 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176384.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.176384.log.gz 2023-10-01T08:06:04.918 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139819.log 2023-10-01T08:06:04.918 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.139819.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.139819.log.gz 2023-10-01T08:06:04.919 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135230.log 2023-10-01T08:06:04.919 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.135230.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.135230.log.gz 2023-10-01T08:06:04.919 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168463.log 2023-10-01T08:06:04.919 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.168463.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.168463.log.gz 2023-10-01T08:06:04.919 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141138.log 2023-10-01T08:06:04.919 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.141138.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.141138.log.gz 2023-10-01T08:06:04.919 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164587.log 2023-10-01T08:06:04.919 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164587.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.164587.log.gz 2023-10-01T08:06:04.920 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124684.log 2023-10-01T08:06:04.920 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.124684.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.124684.log.gz 2023-10-01T08:06:04.920 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144896.log 2023-10-01T08:06:04.920 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.144896.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.144896.log.gz 2023-10-01T08:06:04.920 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151226.log 2023-10-01T08:06:04.920 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.151226.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.151226.log.gz 2023-10-01T08:06:04.920 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190305.log 2023-10-01T08:06:04.920 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.190305.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.190305.log.gz 2023-10-01T08:06:04.921 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141112.log 2023-10-01T08:06:04.921 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.141112.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.141112.log.gz 2023-10-01T08:06:04.921 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190156.log 2023-10-01T08:06:04.921 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.190156.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.190156.log.gz 2023-10-01T08:06:04.921 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184652.log 2023-10-01T08:06:04.921 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.184652.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.184652.log.gz 2023-10-01T08:06:04.921 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147000.log 2023-10-01T08:06:04.921 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.147000.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.147000.log.gz 2023-10-01T08:06:04.922 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157004.log 2023-10-01T08:06:04.922 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157004.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.157004.log.gz 2023-10-01T08:06:04.922 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149744.log 2023-10-01T08:06:04.922 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175919.log 2023-10-01T08:06:04.922 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.149744.log: /var/log/ceph/ceph-client.admin.175919.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.149744.log.gz 2023-10-01T08:06:04.922 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.175919.log.gz 2023-10-01T08:06:04.922 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142543.log 2023-10-01T08:06:04.922 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172606.log 2023-10-01T08:06:04.923 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.142543.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.142543.log.gz 2023-10-01T08:06:04.923 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.172606.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.172606.log.gz 2023-10-01T08:06:04.923 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149948.log 2023-10-01T08:06:04.923 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149845.log 2023-10-01T08:06:04.923 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.149948.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.149948.log.gz 2023-10-01T08:06:04.923 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.149845.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.149845.log.gz 2023-10-01T08:06:04.923 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188662.log 2023-10-01T08:06:04.923 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.188662.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.188662.log.gz 2023-10-01T08:06:04.924 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135698.log 2023-10-01T08:06:04.924 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135452.log 2023-10-01T08:06:04.927 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.135698.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.135698.log.gz 2023-10-01T08:06:04.927 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.135452.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.135452.log.gz 2023-10-01T08:06:04.927 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124537.log 2023-10-01T08:06:04.928 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.124537.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.124537.log.gz 2023-10-01T08:06:04.928 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152814.log 2023-10-01T08:06:04.928 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.152814.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.152814.log.gz 2023-10-01T08:06:04.928 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137412.log 2023-10-01T08:06:04.928 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.137412.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.137412.log.gz 2023-10-01T08:06:04.928 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123065.log 2023-10-01T08:06:04.928 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.123065.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.123065.log.gz 2023-10-01T08:06:04.928 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161595.log 2023-10-01T08:06:04.929 INFO:teuthology.orchestra.run.smithi026.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-01T08:06:04.929 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148764.log 2023-10-01T08:06:04.929 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.161595.log.gz 2023-10-01T08:06:04.929 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162209.log 2023-10-01T08:06:04.929 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.148764.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.148764.log.gz 2023-10-01T08:06:04.929 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181582.log 2023-10-01T08:06:04.929 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.162209.log.gz 2023-10-01T08:06:04.929 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155093.log 2023-10-01T08:06:04.930 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165958.log 2023-10-01T08:06:04.930 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.181582.log: /var/log/ceph/ceph-client.admin.155093.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.181582.log.gz 2023-10-01T08:06:04.930 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.165958.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.155093.log.gz 2023-10-01T08:06:04.930 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.165958.log.gz 2023-10-01T08:06:04.930 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127379.log 2023-10-01T08:06:04.930 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191259.log 2023-10-01T08:06:04.930 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.127379.log: /var/log/ceph/ceph-client.admin.191259.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.127379.log.gz 2023-10-01T08:06:04.931 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.191259.log.gz 2023-10-01T08:06:04.931 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149995.log 2023-10-01T08:06:04.931 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181237.log 2023-10-01T08:06:04.931 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.149995.log: /var/log/ceph/ceph-client.admin.181237.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.149995.log.gz 2023-10-01T08:06:04.931 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.181237.log.gz 2023-10-01T08:06:04.931 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183430.log 2023-10-01T08:06:04.931 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118518.log 2023-10-01T08:06:04.931 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.183430.log: /var/log/ceph/ceph-client.admin.118518.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.183430.log.gz 2023-10-01T08:06:04.932 INFO:teuthology.orchestra.run.smithi026.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.118518.log.gz 2023-10-01T08:06:04.932 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158680.log 2023-10-01T08:06:04.932 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149352.log 2023-10-01T08:06:04.932 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158680.log: /var/log/ceph/ceph-client.admin.149352.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.158680.log.gz 2023-10-01T08:06:04.932 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149352.log.gz 2023-10-01T08:06:04.932 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164901.log 2023-10-01T08:06:04.932 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182170.log 2023-10-01T08:06:04.932 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164901.log: /var/log/ceph/ceph-client.admin.182170.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.164901.log.gz 2023-10-01T08:06:04.933 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.182170.log.gz 2023-10-01T08:06:04.933 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153525.log 2023-10-01T08:06:04.933 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175722.log 2023-10-01T08:06:04.933 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.153525.log: /var/log/ceph/ceph-client.admin.175722.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.153525.log.gz 2023-10-01T08:06:04.933 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.175722.log.gz 2023-10-01T08:06:04.933 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192392.log 2023-10-01T08:06:04.933 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192639.log 2023-10-01T08:06:04.933 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.192392.log: /var/log/ceph/ceph-client.admin.192639.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.192392.log.gz 2023-10-01T08:06:04.934 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.192639.log.gz 2023-10-01T08:06:04.934 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122908.log 2023-10-01T08:06:04.936 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169221.log 2023-10-01T08:06:04.936 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.122908.log: /var/log/ceph/ceph-client.admin.169221.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.122908.log.gz 2023-10-01T08:06:04.936 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.169221.log.gz 2023-10-01T08:06:04.936 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181778.log 2023-10-01T08:06:04.936 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157592.log 2023-10-01T08:06:04.936 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.181778.log: /var/log/ceph/ceph-client.admin.157592.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.181778.log.gz 2023-10-01T08:06:04.936 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.157592.log.gz 2023-10-01T08:06:04.937 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174768.log 2023-10-01T08:06:04.937 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139348.log 2023-10-01T08:06:04.937 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174768.log: /var/log/ceph/ceph-client.admin.139348.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.174768.log.gz 2023-10-01T08:06:04.937 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.139348.log.gz 2023-10-01T08:06:04.937 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144844.log 2023-10-01T08:06:04.937 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136602.log 2023-10-01T08:06:04.937 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.144844.log: /var/log/ceph/ceph-client.admin.136602.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.144844.log.gz 2023-10-01T08:06:04.937 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.136602.log.gz 2023-10-01T08:06:04.938 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128916.log 2023-10-01T08:06:04.938 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152618.log 2023-10-01T08:06:04.938 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.128916.log: /var/log/ceph/ceph-client.admin.152618.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.128916.log.gz 2023-10-01T08:06:04.938 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152618.log.gz 2023-10-01T08:06:04.938 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162771.log 2023-10-01T08:06:04.938 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163751.log 2023-10-01T08:06:04.938 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162771.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.162771.log.gz 2023-10-01T08:06:04.938 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.163751.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.163751.log.gz 2023-10-01T08:06:04.939 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168267.log 2023-10-01T08:06:04.943 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144699.log 2023-10-01T08:06:04.943 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.168267.log: /var/log/ceph/ceph-client.admin.144699.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.168267.log.gz 2023-10-01T08:06:04.944 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.144699.log.gz 2023-10-01T08:06:04.944 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171662.log 2023-10-01T08:06:04.944 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147883.log 2023-10-01T08:06:04.944 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171662.log: /var/log/ceph/ceph-client.admin.147883.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.171662.log.gz 2023-10-01T08:06:04.944 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.147883.log.gz 2023-10-01T08:06:04.944 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163725.log 2023-10-01T08:06:04.944 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143720.log 2023-10-01T08:06:04.944 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.163725.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.163725.log.gz 2023-10-01T08:06:04.945 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161791.log 2023-10-01T08:06:04.945 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.143720.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143720.log.gz 2023-10-01T08:06:04.945 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177096.log 2023-10-01T08:06:04.945 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161791.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.161791.log.gz 2023-10-01T08:06:04.945 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160001.log 2023-10-01T08:06:04.945 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.177096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180505.log 2023-10-01T08:06:04.945 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.177096.log.gz 2023-10-01T08:06:04.945 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.160001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164952.log 2023-10-01T08:06:04.946 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.180505.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.160001.log.gz 2023-10-01T08:06:04.946 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.180505.log.gz 2023-10-01T08:06:04.946 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150144.log 2023-10-01T08:06:04.946 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164952.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.164952.log.gz 2023-10-01T08:06:04.947 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186503.log 2023-10-01T08:06:04.947 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.150144.log: /var/log/ceph/ceph-client.admin.186503.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.150144.log.gz 2023-10-01T08:06:04.948 INFO:teuthology.orchestra.run.smithi026.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.186503.log.gz 2023-10-01T08:06:04.948 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123975.log 2023-10-01T08:06:04.948 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162549.log 2023-10-01T08:06:04.948 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.123975.log: /var/log/ceph/ceph-client.admin.162549.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.123975.log.gz 2023-10-01T08:06:04.948 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.162549.log.gz 2023-10-01T08:06:04.948 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149203.log 2023-10-01T08:06:04.948 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127556.log 2023-10-01T08:06:04.949 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.149203.log: /var/log/ceph/ceph-client.admin.127556.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.149203.log.gz 2023-10-01T08:06:04.949 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.127556.log.gz 2023-10-01T08:06:04.949 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176580.log 2023-10-01T08:06:04.949 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142151.log 2023-10-01T08:06:04.950 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176580.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.176580.log.gz 2023-10-01T08:06:04.950 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139152.log 2023-10-01T08:06:04.950 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.142151.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.142151.log.gz 2023-10-01T08:06:04.950 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183235.log 2023-10-01T08:06:04.951 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.139152.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.139152.log.gz 2023-10-01T08:06:04.951 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163581.log 2023-10-01T08:06:04.952 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.183235.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.183235.log.gz 2023-10-01T08:06:04.952 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155289.log 2023-10-01T08:06:04.952 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.163581.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.163581.log.gz 2023-10-01T08:06:04.952 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.155289.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.155289.log.gz 2023-10-01T08:06:04.952 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154309.log 2023-10-01T08:06:04.953 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165737.log 2023-10-01T08:06:04.954 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.154309.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.154309.log.gz 2023-10-01T08:06:04.954 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.165737.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.165737.log.gz 2023-10-01T08:06:04.954 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190671.log 2023-10-01T08:06:04.954 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189325.log 2023-10-01T08:06:04.954 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.190671.log: /var/log/ceph/ceph-client.admin.189325.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.190671.log.gz 2023-10-01T08:06:04.955 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.189325.log.gz 2023-10-01T08:06:04.956 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180061.log 2023-10-01T08:06:04.956 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146412.log 2023-10-01T08:06:04.956 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.180061.log: /var/log/ceph/ceph-client.admin.146412.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.180061.log.gz 2023-10-01T08:06:04.956 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194124.log 2023-10-01T08:06:04.956 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.146412.log.gz 2023-10-01T08:06:04.956 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167753.log 2023-10-01T08:06:04.957 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.194124.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.194124.log.gz 2023-10-01T08:06:04.957 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164391.log 2023-10-01T08:06:04.958 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.167753.log.gz 2023-10-01T08:06:04.958 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185802.log 2023-10-01T08:06:04.958 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.164391.log.gz 2023-10-01T08:06:04.958 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137073.log 2023-10-01T08:06:04.959 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.185802.log: /var/log/ceph/ceph-client.admin.137073.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.185802.log.gz 2023-10-01T08:06:04.959 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.137073.log.gz 2023-10-01T08:06:04.959 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179329.log 2023-10-01T08:06:04.960 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160837.log 2023-10-01T08:06:04.960 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.179329.log: /var/log/ceph/ceph-client.admin.160837.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.179329.log.gz 2023-10-01T08:06:04.960 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.160837.log.gz 2023-10-01T08:06:04.961 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192784.log 2023-10-01T08:06:04.961 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160615.log 2023-10-01T08:06:04.961 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.192784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145092.log 2023-10-01T08:06:04.962 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.192784.log.gz 2023-10-01T08:06:04.962 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.160615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134522.log 2023-10-01T08:06:04.962 INFO:teuthology.orchestra.run.smithi026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.160615.log.gz 2023-10-01T08:06:04.962 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.145092.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.145092.log.gz 2023-10-01T08:06:04.962 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.134522.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.134522.log.gz 2023-10-01T08:06:04.962 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180700.log 2023-10-01T08:06:04.963 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182366.log 2023-10-01T08:06:04.963 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.180700.log: /var/log/ceph/ceph-client.admin.182366.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.180700.log.gz 2023-10-01T08:06:04.963 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.182366.log.gz 2023-10-01T08:06:04.963 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137190.log 2023-10-01T08:06:04.964 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122322.log 2023-10-01T08:06:04.964 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.137190.log: /var/log/ceph/ceph-client.admin.122322.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.137190.log.gz 2023-10-01T08:06:04.965 INFO:teuthology.orchestra.run.smithi026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.122322.log.gz 2023-10-01T08:06:04.965 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180897.log 2023-10-01T08:06:04.966 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173389.log 2023-10-01T08:06:04.966 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.180897.log: /var/log/ceph/ceph-client.admin.173389.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.180897.log.gz 2023-10-01T08:06:04.966 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.173389.log.gz 2023-10-01T08:06:04.966 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147588.log 2023-10-01T08:06:04.967 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139203.log 2023-10-01T08:06:04.967 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.147588.log: /var/log/ceph/ceph-client.admin.139203.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.147588.log.gz 2023-10-01T08:06:04.967 INFO:teuthology.orchestra.run.smithi026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.139203.log.gz 2023-10-01T08:06:04.968 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126845.log 2023-10-01T08:06:04.968 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162845.log 2023-10-01T08:06:04.968 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.126845.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.126845.log.gz 2023-10-01T08:06:04.969 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167287.log 2023-10-01T08:06:04.969 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162845.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.162845.log.gz 2023-10-01T08:06:04.969 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142544.log 2023-10-01T08:06:04.970 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167287.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.167287.log.gz 2023-10-01T08:06:04.970 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158629.log 2023-10-01T08:06:04.970 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.142544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186944.log 2023-10-01T08:06:04.971 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.142544.log.gz 2023-10-01T08:06:04.971 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158629.log: /var/log/ceph/ceph-client.admin.186944.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.158629.log.gz 2023-10-01T08:06:04.971 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.186944.log.gz 2023-10-01T08:06:04.972 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168732.log 2023-10-01T08:06:04.972 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154505.log 2023-10-01T08:06:04.972 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.168732.log: /var/log/ceph/ceph-client.admin.154505.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.168732.log.gz 2023-10-01T08:06:04.973 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.154505.log.gz 2023-10-01T08:06:04.973 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160785.log 2023-10-01T08:06:04.973 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123114.log 2023-10-01T08:06:04.974 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.160785.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.160785.log.gz 2023-10-01T08:06:04.974 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167338.log 2023-10-01T08:06:04.975 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.123114.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.123114.log.gz 2023-10-01T08:06:04.975 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166299.log 2023-10-01T08:06:04.975 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167338.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.167338.log.gz 2023-10-01T08:06:04.976 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166299.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.166299.log.gz 2023-10-01T08:06:04.976 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175579.log 2023-10-01T08:06:04.976 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164559.log 2023-10-01T08:06:04.977 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.175579.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.175579.log.gz 2023-10-01T08:06:04.977 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164559.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.164559.log.gz 2023-10-01T08:06:04.977 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125392.log 2023-10-01T08:06:04.978 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178544.log 2023-10-01T08:06:04.978 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.125392.log: /var/log/ceph/ceph-client.admin.178544.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.125392.log.gz 2023-10-01T08:06:04.978 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.178544.log.gz 2023-10-01T08:06:04.979 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168147.log 2023-10-01T08:06:04.979 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187924.log 2023-10-01T08:06:04.980 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.168147.log: /var/log/ceph/ceph-client.admin.187924.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.168147.log.gz 2023-10-01T08:06:04.980 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.187924.log.gz 2023-10-01T08:06:04.980 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189054.log 2023-10-01T08:06:04.981 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183795.log 2023-10-01T08:06:04.981 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.189054.log: /var/log/ceph/ceph-client.admin.183795.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.189054.log.gz 2023-10-01T08:06:04.981 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.183795.log.gz 2023-10-01T08:06:04.981 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193282.log 2023-10-01T08:06:04.982 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190352.log 2023-10-01T08:06:04.982 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.193282.log: /var/log/ceph/ceph-client.admin.190352.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.193282.log.gz 2023-10-01T08:06:04.983 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.190352.log.gz 2023-10-01T08:06:04.983 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125539.log 2023-10-01T08:06:04.983 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172410.log 2023-10-01T08:06:04.984 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.125539.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.125539.log.gz 2023-10-01T08:06:04.984 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.172410.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.172410.log.gz 2023-10-01T08:06:04.984 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185314.log 2023-10-01T08:06:04.985 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128622.log 2023-10-01T08:06:04.985 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.185314.log: /var/log/ceph/ceph-client.admin.128622.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.185314.log.gz 2023-10-01T08:06:04.985 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.128622.log.gz 2023-10-01T08:06:04.985 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172383.log 2023-10-01T08:06:04.986 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158180.log 2023-10-01T08:06:04.986 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.172383.log: /var/log/ceph/ceph-client.admin.158180.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.172383.log.gz 2023-10-01T08:06:04.987 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.158180.log.gz 2023-10-01T08:06:04.987 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166469.log 2023-10-01T08:06:04.987 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185706.log 2023-10-01T08:06:04.987 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166469.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166469.log.gz 2023-10-01T08:06:04.988 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.185706.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.185706.log.gz 2023-10-01T08:06:04.988 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176750.log 2023-10-01T08:06:04.989 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163947.log 2023-10-01T08:06:04.989 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176750.log: /var/log/ceph/ceph-client.admin.163947.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.176750.log.gz 2023-10-01T08:06:04.989 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.163947.log.gz 2023-10-01T08:06:04.989 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177292.log 2023-10-01T08:06:04.990 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191455.log 2023-10-01T08:06:04.990 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.177292.log: 88.3%/var/log/ceph/ceph-client.admin.191455.log: -- replaced with /var/log/ceph/ceph-client.admin.177292.log.gz 2023-10-01T08:06:04.991 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.191455.log.gz 2023-10-01T08:06:04.991 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165710.log 2023-10-01T08:06:04.991 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144648.log 2023-10-01T08:06:04.992 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.165710.log: /var/log/ceph/ceph-client.admin.144648.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.165710.log.gz 2023-10-01T08:06:04.992 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.144648.log.gz 2023-10-01T08:06:04.992 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153969.log 2023-10-01T08:06:04.993 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142767.log 2023-10-01T08:06:04.993 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.153969.log: /var/log/ceph/ceph-client.admin.142767.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.153969.log.gz 2023-10-01T08:06:04.993 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.142767.log.gz 2023-10-01T08:06:04.993 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184019.log 2023-10-01T08:06:04.994 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147269.log 2023-10-01T08:06:04.994 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.184019.log: /var/log/ceph/ceph-client.admin.147269.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.184019.log.gz 2023-10-01T08:06:04.995 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.147269.log.gz 2023-10-01T08:06:04.995 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135505.log 2023-10-01T08:06:04.995 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191210.log 2023-10-01T08:06:04.996 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.135505.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.135505.log.gz 2023-10-01T08:06:04.996 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.191210.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.191210.log.gz 2023-10-01T08:06:04.996 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154727.log 2023-10-01T08:06:04.997 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156321.log 2023-10-01T08:06:04.997 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.154727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178741.log 2023-10-01T08:06:04.997 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.154727.log.gz 2023-10-01T08:06:04.998 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156321.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.156321.log.gz 2023-10-01T08:06:04.999 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157079.log 2023-10-01T08:06:04.999 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.178741.log: /var/log/ceph/ceph-client.admin.157079.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.178741.log.gz 2023-10-01T08:06:04.999 INFO:teuthology.orchestra.run.smithi026.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.157079.log.gz 2023-10-01T08:06:04.999 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142740.log 2023-10-01T08:06:05.000 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184804.log 2023-10-01T08:06:05.000 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.142740.log: /var/log/ceph/ceph-client.admin.184804.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.142740.log.gz 2023-10-01T08:06:05.000 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.184804.log.gz 2023-10-01T08:06:05.000 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181096.log 2023-10-01T08:06:05.001 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134720.log 2023-10-01T08:06:05.002 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.181096.log: /var/log/ceph/ceph-client.admin.134720.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.181096.log.gz 2023-10-01T08:06:05.002 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.134720.log.gz 2023-10-01T08:06:05.002 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175305.log 2023-10-01T08:06:05.003 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174342.log 2023-10-01T08:06:05.003 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.175305.log: /var/log/ceph/ceph-client.admin.174342.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.175305.log.gz 2023-10-01T08:06:05.003 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.174342.log.gz 2023-10-01T08:06:05.003 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188858.log 2023-10-01T08:06:05.004 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134521.log 2023-10-01T08:06:05.004 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.188858.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.188858.log.gz 2023-10-01T08:06:05.004 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.134521.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.134521.log.gz 2023-10-01T08:06:05.005 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143132.log 2023-10-01T08:06:05.006 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169247.log 2023-10-01T08:06:05.006 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.143132.log: /var/log/ceph/ceph-client.admin.169247.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.143132.log.gz 2023-10-01T08:06:05.006 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.169247.log.gz 2023-10-01T08:06:05.006 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143374.log 2023-10-01T08:06:05.007 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165196.log 2023-10-01T08:06:05.007 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.143374.log: /var/log/ceph/ceph-client.admin.165196.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.143374.log.gz 2023-10-01T08:06:05.007 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.165196.log.gz 2023-10-01T08:06:05.007 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151565.log 2023-10-01T08:06:05.008 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151320.log 2023-10-01T08:06:05.008 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.151565.log: /var/log/ceph/ceph-client.admin.151320.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.151565.log.gz 2023-10-01T08:06:05.009 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.151320.log.gz 2023-10-01T08:06:05.009 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166154.log 2023-10-01T08:06:05.009 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156220.log 2023-10-01T08:06:05.009 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.166154.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.166154.log.gz 2023-10-01T08:06:05.010 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156220.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.156220.log.gz 2023-10-01T08:06:05.010 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159269.log 2023-10-01T08:06:05.011 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182245.log 2023-10-01T08:06:05.011 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159269.log: /var/log/ceph/ceph-client.admin.182245.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.159269.log.gz 2023-10-01T08:06:05.011 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.182245.log.gz 2023-10-01T08:06:05.011 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154701.log 2023-10-01T08:06:05.012 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171207.log 2023-10-01T08:06:05.012 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.154701.log: /var/log/ceph/ceph-client.admin.171207.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.154701.log.gz 2023-10-01T08:06:05.013 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.171207.log.gz 2023-10-01T08:06:05.013 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173729.log 2023-10-01T08:06:05.014 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155681.log 2023-10-01T08:06:05.014 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173729.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.173729.log.gz 2023-10-01T08:06:05.014 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.155681.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.155681.log.gz 2023-10-01T08:06:05.014 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191089.log 2023-10-01T08:06:05.015 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174147.log 2023-10-01T08:06:05.015 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.191089.log: /var/log/ceph/ceph-client.admin.174147.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.191089.log.gz 2023-10-01T08:06:05.015 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.174147.log.gz 2023-10-01T08:06:05.015 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167286.log 2023-10-01T08:06:05.016 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141982.log 2023-10-01T08:06:05.016 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167286.log: /var/log/ceph/ceph-client.admin.141982.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.167286.log.gz 2023-10-01T08:06:05.016 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159358.log 2023-10-01T08:06:05.017 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.141982.log.gz 2023-10-01T08:06:05.017 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160054.log 2023-10-01T08:06:05.018 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159358.log: /var/log/ceph/ceph-client.admin.160054.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.159358.log.gz 2023-10-01T08:06:05.018 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.160054.log.gz 2023-10-01T08:06:05.018 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190622.log 2023-10-01T08:06:05.019 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187383.log 2023-10-01T08:06:05.019 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.190622.log: /var/log/ceph/ceph-client.admin.187383.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.190622.log.gz 2023-10-01T08:06:05.019 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.187383.log.gz 2023-10-01T08:06:05.019 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145850.log 2023-10-01T08:06:05.020 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176972.log 2023-10-01T08:06:05.020 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.145850.log: /var/log/ceph/ceph-client.admin.176972.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.145850.log.gz 2023-10-01T08:06:05.020 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.176972.log.gz 2023-10-01T08:06:05.020 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167143.log 2023-10-01T08:06:05.021 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177493.log 2023-10-01T08:06:05.021 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167143.log: /var/log/ceph/ceph-client.admin.177493.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.167143.log.gz 2023-10-01T08:06:05.022 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.177493.log.gz 2023-10-01T08:06:05.022 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146512.log 2023-10-01T08:06:05.023 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136628.log 2023-10-01T08:06:05.023 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.146512.log: /var/log/ceph/ceph-client.admin.136628.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.146512.log.gz 2023-10-01T08:06:05.023 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.136628.log.gz 2023-10-01T08:06:05.023 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145458.log 2023-10-01T08:06:05.024 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144895.log 2023-10-01T08:06:05.024 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.145458.log: /var/log/ceph/ceph-client.admin.144895.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.145458.log.gz 2023-10-01T08:06:05.024 INFO:teuthology.orchestra.run.smithi026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.144895.log.gz 2023-10-01T08:06:05.024 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125174.log 2023-10-01T08:06:05.025 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193176.log 2023-10-01T08:06:05.025 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.125174.log: /var/log/ceph/ceph-client.admin.193176.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.193176.log.gz 2023-10-01T08:06:05.025 INFO:teuthology.orchestra.run.smithi026.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.125174.log.gz 2023-10-01T08:06:05.026 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135818.log 2023-10-01T08:06:05.026 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192665.log 2023-10-01T08:06:05.027 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.135818.log: /var/log/ceph/ceph-client.admin.192665.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.135818.log.gz 2023-10-01T08:06:05.027 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.192665.log.gz 2023-10-01T08:06:05.027 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169051.log 2023-10-01T08:06:05.028 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188515.log 2023-10-01T08:06:05.028 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169051.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.169051.log.gz 2023-10-01T08:06:05.028 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.188515.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.188515.log.gz 2023-10-01T08:06:05.028 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136701.log 2023-10-01T08:06:05.029 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155436.log 2023-10-01T08:06:05.029 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.136701.log: /var/log/ceph/ceph-client.admin.155436.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.136701.log.gz 2023-10-01T08:06:05.029 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.155436.log.gz 2023-10-01T08:06:05.029 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183031.log 2023-10-01T08:06:05.030 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165881.log 2023-10-01T08:06:05.030 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.183031.log: /var/log/ceph/ceph-client.admin.165881.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.183031.log.gz 2023-10-01T08:06:05.031 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.165881.log.gz 2023-10-01T08:06:05.031 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152496.log 2023-10-01T08:06:05.032 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137804.log 2023-10-01T08:06:05.032 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.152496.log: /var/log/ceph/ceph-client.admin.137804.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.152496.log.gz 2023-10-01T08:06:05.032 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.137804.log.gz 2023-10-01T08:06:05.032 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160419.log 2023-10-01T08:06:05.032 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175578.log 2023-10-01T08:06:05.033 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.160419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186795.log 2023-10-01T08:06:05.033 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.160419.log.gz 2023-10-01T08:06:05.033 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.175578.log: /var/log/ceph/ceph-client.admin.186795.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.175578.log.gz 2023-10-01T08:06:05.033 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161250.log 2023-10-01T08:06:05.034 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.186795.log.gz 2023-10-01T08:06:05.034 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126897.log 2023-10-01T08:06:05.035 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.161250.log: /var/log/ceph/ceph-client.admin.126897.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.161250.log.gz 2023-10-01T08:06:05.035 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.126897.log.gz 2023-10-01T08:06:05.035 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151031.log 2023-10-01T08:06:05.036 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186098.log 2023-10-01T08:06:05.036 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.151031.log: /var/log/ceph/ceph-client.admin.186098.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.151031.log.gz 2023-10-01T08:06:05.036 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.186098.log.gz 2023-10-01T08:06:05.036 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192861.log 2023-10-01T08:06:05.037 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152153.log 2023-10-01T08:06:05.037 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.192861.log: /var/log/ceph/ceph-client.admin.152153.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.192861.log.gz 2023-10-01T08:06:05.037 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.152153.log.gz 2023-10-01T08:06:05.037 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140132.log 2023-10-01T08:06:05.038 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181041.log 2023-10-01T08:06:05.039 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.140132.log: /var/log/ceph/ceph-client.admin.181041.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.140132.log.gz 2023-10-01T08:06:05.039 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155828.log 2023-10-01T08:06:05.039 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.181041.log.gz 2023-10-01T08:06:05.039 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147439.log 2023-10-01T08:06:05.040 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.155828.log: /var/log/ceph/ceph-client.admin.147439.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.155828.log.gz 2023-10-01T08:06:05.040 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.147439.log.gz 2023-10-01T08:06:05.040 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122710.log 2023-10-01T08:06:05.040 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162967.log 2023-10-01T08:06:05.041 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.122710.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.122710.log.gz 2023-10-01T08:06:05.041 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162967.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.162967.log.gz 2023-10-01T08:06:05.042 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146289.log 2023-10-01T08:06:05.042 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192196.log 2023-10-01T08:06:05.043 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.146289.log: /var/log/ceph/ceph-client.admin.192196.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.146289.log.gz 2023-10-01T08:06:05.043 INFO:teuthology.orchestra.run.smithi026.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.192196.log.gz 2023-10-01T08:06:05.043 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124978.log 2023-10-01T08:06:05.043 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189549.log 2023-10-01T08:06:05.043 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.124978.log: /var/log/ceph/ceph-client.admin.189549.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124978.log.gz 2023-10-01T08:06:05.044 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.189549.log.gz 2023-10-01T08:06:05.045 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153576.log 2023-10-01T08:06:05.045 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156269.log 2023-10-01T08:06:05.045 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.153576.log: /var/log/ceph/ceph-client.admin.156269.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.153576.log.gz 2023-10-01T08:06:05.045 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.156269.log.gz 2023-10-01T08:06:05.045 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185998.log 2023-10-01T08:06:05.046 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157667.log 2023-10-01T08:06:05.046 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.185998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140524.log 2023-10-01T08:06:05.046 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.185998.log.gz 2023-10-01T08:06:05.047 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158059.log 2023-10-01T08:06:05.047 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.157667.log.gz 2023-10-01T08:06:05.047 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.140524.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.140524.log.gz 2023-10-01T08:06:05.048 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162800.log 2023-10-01T08:06:05.048 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.158059.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.158059.log.gz 2023-10-01T08:06:05.048 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185902.log 2023-10-01T08:06:05.048 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162800.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.162800.log.gz 2023-10-01T08:06:05.049 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181825.log 2023-10-01T08:06:05.049 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.185902.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.185902.log.gz 2023-10-01T08:06:05.049 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172579.log 2023-10-01T08:06:05.050 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.181825.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.181825.log.gz 2023-10-01T08:06:05.050 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188123.log 2023-10-01T08:06:05.051 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.172579.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.172579.log.gz 2023-10-01T08:06:05.051 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138956.log 2023-10-01T08:06:05.051 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.188123.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.188123.log.gz 2023-10-01T08:06:05.052 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124197.log 2023-10-01T08:06:05.052 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.138956.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.138956.log.gz 2023-10-01T08:06:05.053 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-01T08:06:05.053 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.124197.log: 87.5%/var/log/ceph/ceph-osd.1.log: -- replaced with /var/log/ceph/ceph-client.admin.124197.log.gz 2023-10-01T08:06:05.056 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170253.log 2023-10-01T08:06:05.057 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.170253.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.170253.log.gz 2023-10-01T08:06:05.057 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186194.log 2023-10-01T08:06:05.058 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.186194.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.186194.log.gz 2023-10-01T08:06:05.058 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154382.log 2023-10-01T08:06:05.059 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.154382.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.154382.log.gz 2023-10-01T08:06:05.060 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170450.log 2023-10-01T08:06:05.061 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.170450.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.170450.log.gz 2023-10-01T08:06:05.061 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173925.log 2023-10-01T08:06:05.062 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173925.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.173925.log.gz 2023-10-01T08:06:05.062 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172804.log 2023-10-01T08:06:05.063 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.172804.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.172804.log.gz 2023-10-01T08:06:05.063 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156516.log 2023-10-01T08:06:05.064 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.156516.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.156516.log.gz 2023-10-01T08:06:05.064 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167849.log 2023-10-01T08:06:05.065 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167849.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.167849.log.gz 2023-10-01T08:06:05.065 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140578.log 2023-10-01T08:06:05.066 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.140578.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.140578.log.gz 2023-10-01T08:06:05.066 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193683.log 2023-10-01T08:06:05.067 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.193683.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.193683.log.gz 2023-10-01T08:06:05.067 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144334.log 2023-10-01T08:06:05.068 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.144334.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.144334.log.gz 2023-10-01T08:06:05.069 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139936.log 2023-10-01T08:06:05.070 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.139936.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.139936.log.gz 2023-10-01T08:06:05.070 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143179.log 2023-10-01T08:06:05.071 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.143179.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143179.log.gz 2023-10-01T08:06:05.071 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172971.log 2023-10-01T08:06:05.072 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.172971.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.172971.log.gz 2023-10-01T08:06:05.072 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184579.log 2023-10-01T08:06:05.072 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150779.log 2023-10-01T08:06:05.073 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.184579.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.184579.log.gz 2023-10-01T08:06:05.074 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.150779.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.150779.log.gz 2023-10-01T08:06:05.074 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159072.log 2023-10-01T08:06:05.076 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159072.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.159072.log.gz 2023-10-01T08:06:05.076 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123410.log 2023-10-01T08:06:05.083 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.123410.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.123410.log.gz 2023-10-01T08:06:05.083 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145288.log 2023-10-01T08:06:05.083 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.145288.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.145288.log.gz 2023-10-01T08:06:05.083 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159021.log 2023-10-01T08:06:05.084 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159021.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.159021.log.gz 2023-10-01T08:06:05.084 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170496.log 2023-10-01T08:06:05.084 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.170496.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.170496.log.gz 2023-10-01T08:06:05.084 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170692.log 2023-10-01T08:06:05.084 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.170692.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.170692.log.gz 2023-10-01T08:06:05.084 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193928.log 2023-10-01T08:06:05.085 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159466.log 2023-10-01T08:06:05.085 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.193928.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.193928.log.gz 2023-10-01T08:06:05.085 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159466.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.159466.log.gz 2023-10-01T08:06:05.085 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162157.log 2023-10-01T08:06:05.086 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162157.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.162157.log.gz 2023-10-01T08:06:05.086 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186599.log 2023-10-01T08:06:05.087 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.186599.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.186599.log.gz 2023-10-01T08:06:05.087 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181190.log 2023-10-01T08:06:05.088 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.181190.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.181190.log.gz 2023-10-01T08:06:05.088 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140819.log 2023-10-01T08:06:05.089 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.140819.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.140819.log.gz 2023-10-01T08:06:05.089 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178349.log 2023-10-01T08:06:05.090 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.178349.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.178349.log.gz 2023-10-01T08:06:05.090 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171039.log 2023-10-01T08:06:05.091 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171039.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.171039.log.gz 2023-10-01T08:06:05.091 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138446.log 2023-10-01T08:06:05.092 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.138446.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.138446.log.gz 2023-10-01T08:06:05.093 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172775.log 2023-10-01T08:06:05.094 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.172775.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.172775.log.gz 2023-10-01T08:06:05.094 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148811.log 2023-10-01T08:06:05.095 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.148811.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.148811.log.gz 2023-10-01T08:06:05.095 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169417.log 2023-10-01T08:06:05.096 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169417.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.169417.log.gz 2023-10-01T08:06:05.096 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193482.log 2023-10-01T08:06:05.097 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.193482.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.193482.log.gz 2023-10-01T08:06:05.097 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189299.log 2023-10-01T08:06:05.098 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.189299.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.189299.log.gz 2023-10-01T08:06:05.098 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182049.log 2023-10-01T08:06:05.099 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.182049.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.182049.log.gz 2023-10-01T08:06:05.099 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187287.log 2023-10-01T08:06:05.100 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.187287.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.187287.log.gz 2023-10-01T08:06:05.100 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127223.log 2023-10-01T08:06:05.101 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.127223.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.127223.log.gz 2023-10-01T08:06:05.102 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146681.log 2023-10-01T08:06:05.102 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.146681.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.146681.log.gz 2023-10-01T08:06:05.103 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157200.log 2023-10-01T08:06:05.104 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157200.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.157200.log.gz 2023-10-01T08:06:05.104 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153917.log 2023-10-01T08:06:05.105 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.153917.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.153917.log.gz 2023-10-01T08:06:05.105 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192274.log 2023-10-01T08:06:05.106 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.192274.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.192274.log.gz 2023-10-01T08:06:05.106 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167949.log 2023-10-01T08:06:05.107 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.167949.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.167949.log.gz 2023-10-01T08:06:05.107 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129161.log 2023-10-01T08:06:05.108 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.129161.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.129161.log.gz 2023-10-01T08:06:05.108 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171794.log 2023-10-01T08:06:05.109 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171794.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.171794.log.gz 2023-10-01T08:06:05.109 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162353.log 2023-10-01T08:06:05.110 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.162353.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.162353.log.gz 2023-10-01T08:06:05.110 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173219.log 2023-10-01T08:06:05.111 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173219.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.173219.log.gz 2023-10-01T08:06:05.111 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127631.log 2023-10-01T08:06:05.112 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.127631.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.127631.log.gz 2023-10-01T08:06:05.113 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177856.log 2023-10-01T08:06:05.113 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.177856.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.177856.log.gz 2023-10-01T08:06:05.114 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188170.log 2023-10-01T08:06:05.114 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.188170.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.188170.log.gz 2023-10-01T08:06:05.115 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174121.log 2023-10-01T08:06:05.116 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.174121.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.174121.log.gz 2023-10-01T08:06:05.116 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118885.log 2023-10-01T08:06:05.117 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.118885.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.118885.log.gz 2023-10-01T08:06:05.117 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127630.log 2023-10-01T08:06:05.118 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.127630.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.127630.log.gz 2023-10-01T08:06:05.118 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182637.log 2023-10-01T08:06:05.119 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.182637.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.182637.log.gz 2023-10-01T08:06:05.119 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159925.log 2023-10-01T08:06:05.120 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.159925.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.159925.log.gz 2023-10-01T08:06:05.120 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123828.log 2023-10-01T08:06:05.121 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.123828.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.123828.log.gz 2023-10-01T08:06:05.121 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157053.log 2023-10-01T08:06:05.122 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.157053.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.157053.log.gz 2023-10-01T08:06:05.122 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173609.log 2023-10-01T08:06:05.123 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.173609.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.173609.log.gz 2023-10-01T08:06:05.124 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148419.log 2023-10-01T08:06:05.124 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.148419.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.148419.log.gz 2023-10-01T08:06:05.125 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187801.log 2023-10-01T08:06:05.126 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.187801.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.187801.log.gz 2023-10-01T08:06:05.126 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182833.log 2023-10-01T08:06:05.127 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.182833.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.182833.log.gz 2023-10-01T08:06:05.127 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184064.log 2023-10-01T08:06:05.128 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.184064.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.184064.log.gz 2023-10-01T08:06:05.128 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176188.log 2023-10-01T08:06:05.129 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.176188.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.176188.log.gz 2023-10-01T08:06:05.129 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192051.log 2023-10-01T08:06:05.130 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.192051.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.192051.log.gz 2023-10-01T08:06:05.130 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164364.log 2023-10-01T08:06:05.130 INFO:teuthology.orchestra.run.smithi026.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-01T08:06:05.131 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171965.log 2023-10-01T08:06:05.131 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164364.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.164364.log.gz 2023-10-01T08:06:05.132 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.171965.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.171965.log.gz 2023-10-01T08:06:05.132 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138564.log 2023-10-01T08:06:05.132 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137975.log 2023-10-01T08:06:05.133 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.138564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168045.log 2023-10-01T08:06:05.133 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.138564.log.gz 2023-10-01T08:06:05.134 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.137975.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.137975.log.gz 2023-10-01T08:06:05.134 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.168045.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.168045.log.gz 2023-10-01T08:06:05.134 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185828.log 2023-10-01T08:06:05.135 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175109.log 2023-10-01T08:06:05.135 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.185828.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.185828.log.gz 2023-10-01T08:06:05.135 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.175109.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.175109.log.gz 2023-10-01T08:06:05.135 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164169.log 2023-10-01T08:06:05.136 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190893.log 2023-10-01T08:06:05.136 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.164169.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.164169.log.gz 2023-10-01T08:06:05.136 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.190893.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.190893.log.gz 2023-10-01T08:06:05.136 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148445.log 2023-10-01T08:06:05.137 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142739.log 2023-10-01T08:06:05.137 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.148445.log: /var/log/ceph/ceph-client.admin.142739.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.148445.log.gz 2023-10-01T08:06:05.138 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.142739.log.gz 2023-10-01T08:06:05.138 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175527.log 2023-10-01T08:06:05.138 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123214.log 2023-10-01T08:06:05.139 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.175527.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.175527.log.gz 2023-10-01T08:06:05.139 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.123214.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.123214.log.gz 2023-10-01T08:06:05.139 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143864.log 2023-10-01T08:06:05.140 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.143864.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.143864.log.gz 2023-10-01T08:06:05.140 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185018.log 2023-10-01T08:06:05.140 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134523.log 2023-10-01T08:06:05.141 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.185018.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.185018.log.gz 2023-10-01T08:06:05.141 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.134523.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.134523.log.gz 2023-10-01T08:06:05.141 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169516.log 2023-10-01T08:06:05.142 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182805.log 2023-10-01T08:06:05.142 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.169516.log: /var/log/ceph/ceph-client.admin.182805.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.169516.log.gz 2023-10-01T08:06:05.143 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.182805.log.gz 2023-10-01T08:06:05.167 INFO:teuthology.orchestra.run.smithi026.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-01T08:06:05.236 INFO:teuthology.orchestra.run.smithi026.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-01T08:06:05.261 INFO:teuthology.orchestra.run.smithi026.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-01T08:06:05.407 INFO:teuthology.orchestra.run.smithi026.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-01T08:06:05.521 INFO:teuthology.orchestra.run.smithi026.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-01T08:06:05.523 INFO:teuthology.orchestra.run.smithi026.stderr: 2023-10-01T08:06:05.523 INFO:teuthology.orchestra.run.smithi026.stderr:real 0m1.154s 2023-10-01T08:06:05.523 INFO:teuthology.orchestra.run.smithi026.stderr:user 0m4.321s 2023-10-01T08:06:05.523 INFO:teuthology.orchestra.run.smithi026.stderr:sys 0m0.966s 2023-10-01T08:06:05.524 INFO:tasks.ceph:Archiving logs... 2023-10-01T08:06:05.524 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/log/ceph to /home/teuthworker/archive/dparmar-2023-10-01_07:32:21-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408165/remote/smithi026/log 2023-10-01T08:06:05.525 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-01T08:06:07.123 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/log/ceph to /home/teuthworker/archive/dparmar-2023-10-01_07:32:21-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408165/remote/smithi092/log 2023-10-01T08:06:07.124 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-01T08:06:07.159 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi026 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-01T08:06:07.168 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-01T08:06:07.185 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi026 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-01T08:06:07.189 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-01T08:06:07.189 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-01T08:06:07.198 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-01T08:06:07.314 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-01T08:06:07.326 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-01T08:06:07.326 DEBUG:teuthology.orchestra.run.smithi026:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-01T08:06:07.329 DEBUG:teuthology.orchestra.run.smithi092:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-01T08:06:07.347 INFO:teuthology.orchestra.run.smithi092.stderr:bash: ntpq: command not found 2023-10-01T08:06:07.348 INFO:teuthology.orchestra.run.smithi026.stderr:bash: ntpq: command not found 2023-10-01T08:06:07.352 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-01T08:06:07.352 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2023-10-01T08:06:07.352 INFO:teuthology.orchestra.run.smithi092.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 52 -109us[ -194us] +/- 91ms 2023-10-01T08:06:07.353 INFO:teuthology.orchestra.run.smithi092.stdout:^* hv02.front.sepia.ceph.com 3 6 377 51 -865us[ -950us] +/- 47ms 2023-10-01T08:06:07.353 INFO:teuthology.orchestra.run.smithi092.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 55 +1159us[+1074us] +/- 63ms 2023-10-01T08:06:07.353 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-01T08:06:07.354 INFO:teuthology.orchestra.run.smithi026.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-01T08:06:07.354 INFO:teuthology.orchestra.run.smithi026.stdout:=============================================================================== 2023-10-01T08:06:07.354 INFO:teuthology.orchestra.run.smithi026.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 53 -108us[ -215us] +/- 91ms 2023-10-01T08:06:07.354 INFO:teuthology.orchestra.run.smithi026.stdout:^* hv02.front.sepia.ceph.com 3 6 377 52 -874us[ -982us] +/- 47ms 2023-10-01T08:06:07.354 INFO:teuthology.orchestra.run.smithi026.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 53 +1165us[+1058us] +/- 63ms 2023-10-01T08:06:07.355 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-01T08:06:07.355 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-01T08:06:07.367 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-01T08:06:07.367 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-01T08:06:07.392 DEBUG:teuthology.orchestra.run.smithi026:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-01T08:06:07.455 DEBUG:teuthology.orchestra.run.smithi092:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-01T08:06:07.545 DEBUG:teuthology.orchestra.run.smithi026:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-01T08:06:07.582 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-01T08:06:07.583 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-01T08:06:07.615 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-01T08:06:07.615 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-01T08:06:07.627 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-01T08:06:07.654 INFO:teuthology.task.internal:Duration was 1521.625398 seconds 2023-10-01T08:06:07.654 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-01T08:06:07.685 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-01T08:06:07.685 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-01T08:06:07.688 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-01T08:06:07.735 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-01T08:06:07.746 INFO:teuthology.orchestra.run.smithi026.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-01T08:06:08.020 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-01T08:06:08.020 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi026.front.sepia.ceph.com 2023-10-01T08:06:08.020 DEBUG:teuthology.orchestra.run.smithi026:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-01T08:06:08.049 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi092.front.sepia.ceph.com 2023-10-01T08:06:08.050 DEBUG:teuthology.orchestra.run.smithi092:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-01T08:06:08.074 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-01T08:06:08.074 DEBUG:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-01T08:06:08.092 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-01T08:06:08.152 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-01T08:06:08.153 DEBUG:teuthology.orchestra.run.smithi026:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-01T08:06:08.155 DEBUG:teuthology.orchestra.run.smithi092:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-01T08:06:08.281 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-01T08:06:08.293 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-01T08:06:08.294 DEBUG:teuthology.orchestra.run.smithi026:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-01T08:06:08.325 DEBUG:teuthology.orchestra.run.smithi092:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-01T08:06:08.352 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-01T08:06:08.364 DEBUG:teuthology.orchestra.run.smithi026:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-01T08:06:08.368 DEBUG:teuthology.orchestra.run.smithi092:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-01T08:06:08.398 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern = core 2023-10-01T08:06:08.418 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = core 2023-10-01T08:06:08.432 DEBUG:teuthology.orchestra.run.smithi026:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-01T08:06:08.493 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi026.front.sepia.ceph.com, flagging run as failed 2023-10-01T08:06:08.493 DEBUG:teuthology.orchestra.run.smithi092:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-01T08:06:08.510 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-01T08:06:08.510 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-01T08:06:08.523 INFO:teuthology.task.internal:Transferring archived files... 2023-10-01T08:06:08.524 DEBUG:teuthology.misc:Transferring archived files from smithi026:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/dparmar-2023-10-01_07:32:21-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408165/remote/smithi026 2023-10-01T08:06:08.524 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-01T08:07:32.209 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2023-10-01T08:07:32.811 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/dparmar-2023-10-01_07:32:21-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408165/remote/smithi026/coredump/1696146881.126763.core.gz: gzip compressed data, was "1696146881.126763.core", last modified: Sun Oct 1 08:06:08 2023, max compression, original size modulo 2^32 1365295104 2023-10-01T08:07:32.812 INFO:teuthology.task.internal:core is compressed, try accessing gzip file ... 2023-10-01T08:07:38.962 INFO:teuthology.task.internal: core looks like: /tmp/tmp0onck391: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mgr -f --cluster ceph -i x', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mgr', platform: 'x86_64' 2023-10-01T08:07:39.213 INFO:teuthology.task.internal: dump_program: ceph-mgr -f --cluster ceph -i x 2023-10-01T08:07:39.214 DEBUG:teuthology.orchestra.run.smithi026:> which 'ceph-mgr -f --cluster ceph -i x' 2023-10-01T08:07:39.239 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/which: invalid option -- 'f' 2023-10-01T08:07:39.239 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/which: unrecognized option '--cluster' 2023-10-01T08:07:39.239 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/which: no x in (/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin) 2023-10-01T08:07:39.240 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-01T08:07:39.240 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph-mgr 2023-10-01T08:07:39.240 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph 2023-10-01T08:07:39.241 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 392, in archive yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi026 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 96, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi026 with status 1: "which 'ceph-mgr -f --cluster ceph -i x'" 2023-10-01T08:07:39.256 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-01T08:07:39.269 INFO:teuthology.task.internal:Not uploading archives. 2023-10-01T08:07:39.270 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-01T08:07:39.298 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-01T08:07:39.298 DEBUG:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-01T08:07:39.322 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-01T08:07:39.336 INFO:teuthology.orchestra.run.smithi026.stdout: 525357 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Oct 1 08:06 /home/ubuntu/cephtest 2023-10-01T08:07:39.336 INFO:teuthology.orchestra.run.smithi026.stdout: 525358 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Oct 1 08:06 /home/ubuntu/cephtest/archive 2023-10-01T08:07:39.337 INFO:teuthology.orchestra.run.smithi026.stdout: 525359 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 1 07:54 /home/ubuntu/cephtest/archive/coredump 2023-10-01T08:07:39.337 INFO:teuthology.orchestra.run.smithi026.stdout: 525598 364796 -rw------- 1 root root 1365295104 Oct 1 07:54 /home/ubuntu/cephtest/archive/coredump/1696146881.126763.core 2023-10-01T08:07:39.337 INFO:teuthology.orchestra.run.smithi026.stdout: 655783 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Oct 1 08:06 /home/ubuntu/cephtest/archive/audit 2023-10-01T08:07:39.337 INFO:teuthology.orchestra.run.smithi026.stdout: 655821 28 -rw------- 1 ubuntu ubuntu 25730 Oct 1 08:06 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2023-10-01T08:07:39.337 INFO:teuthology.orchestra.run.smithi026.stdout: 525360 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 1 08:06 /home/ubuntu/cephtest/archive/syslog 2023-10-01T08:07:39.338 INFO:teuthology.orchestra.run.smithi026.stdout: 525482 4 -rw-rw-rw- 1 ubuntu ubuntu 771 Oct 1 08:06 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-10-01T08:07:39.338 INFO:teuthology.orchestra.run.smithi026.stdout: 525362 112 -rw-rw-r-- 1 ubuntu ubuntu 114039 Oct 1 08:06 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-01T08:07:39.338 INFO:teuthology.orchestra.run.smithi026.stdout: 525361 132 -rw-rw-rw- 1 ubuntu ubuntu 133644 Oct 1 08:06 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-10-01T08:07:39.339 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-01T08:07:39.340 INFO:teuthology.orchestra.run.smithi026.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-10-01T08:07:39.341 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi026 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi026 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-10-01T08:07:39.360 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-01T08:07:39.375 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-01T08:07:39.399 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi026 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-01T08:07:39.399 INFO:teuthology.nuke:Checking targets against current locks 2023-10-01T08:07:39.407 INFO:teuthology.orchestra.run.smithi092.stdout: 526080 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Oct 1 08:06 /home/ubuntu/cephtest 2023-10-01T08:07:39.407 INFO:teuthology.orchestra.run.smithi092.stdout: 526081 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Oct 1 08:06 /home/ubuntu/cephtest/archive 2023-10-01T08:07:39.408 INFO:teuthology.orchestra.run.smithi092.stdout: 655785 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Oct 1 08:06 /home/ubuntu/cephtest/archive/audit 2023-10-01T08:07:39.408 INFO:teuthology.orchestra.run.smithi092.stdout: 655787 220 -rw------- 1 ubuntu ubuntu 223337 Oct 1 08:06 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2023-10-01T08:07:39.408 INFO:teuthology.orchestra.run.smithi092.stdout: 525365 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 1 08:06 /home/ubuntu/cephtest/archive/syslog 2023-10-01T08:07:39.408 INFO:teuthology.orchestra.run.smithi092.stdout: 525479 4 -rw-rw-rw- 1 ubuntu ubuntu 889 Oct 1 08:04 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-10-01T08:07:39.408 INFO:teuthology.orchestra.run.smithi092.stdout: 525358 92 -rw-rw-r-- 1 ubuntu ubuntu 92236 Oct 1 08:06 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-01T08:07:39.408 INFO:teuthology.orchestra.run.smithi092.stdout: 525357 88 -rw-rw-rw- 1 ubuntu ubuntu 86340 Oct 1 08:06 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-10-01T08:07:39.409 INFO:teuthology.orchestra.run.smithi092.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-10-01T08:07:39.431 DEBUG:teuthology.nuke:shortname: smithi026 2023-10-01T08:07:39.431 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-01T08:07:39.450 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-01_07:32:21-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408165', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-01 07:32:57.086519', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPcv1WJET6ZJGQyR3vKmVxrKOjNwO+heVTJQhMFy39ThJkz5t0YlxifNbq8OKWY+KZ9Xvr3xx+66D7KX6SxOsNw='} 2023-10-01T08:07:39.454 DEBUG:teuthology.nuke:shortname: smithi092 2023-10-01T08:07:39.454 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-01T08:07:39.473 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-01_07:32:21-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408165', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-01 07:32:57.084579', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHMiSJIByvhJ8065ut6VaB+jx3WSzaIu6RYIbTppw3Z0iKf7dkMcWLxkgW58r1MvHpDhFogaFVkHOVVL+5tX46s='} 2023-10-01T08:07:39.500 INFO:teuthology.orchestra.console.smithi026:Power off 2023-10-01T08:07:39.501 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-01T08:07:39.525 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off 2023-10-01T08:07:39.525 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T08:07:39.540 INFO:teuthology.orchestra.console.smithi092:Power off 2023-10-01T08:07:39.541 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-01T08:07:39.550 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2023-10-01T08:07:39.563 DEBUG:teuthology.orchestra.console.smithi092:power off output: Chassis Power Control: Down/Off 2023-10-01T08:07:39.563 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T08:07:39.589 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-10-01T08:07:43.552 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T08:07:43.590 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T08:07:43.663 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2023-10-01T08:07:43.700 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-10-01T08:07:47.668 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T08:07:47.701 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T08:07:47.779 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2023-10-01T08:07:47.811 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2023-10-01T08:07:47.880 INFO:teuthology.orchestra.console.smithi026:Power off completed 2023-10-01T08:07:47.912 INFO:teuthology.orchestra.console.smithi092:Power off completed 2023-10-01T08:07:48.017 INFO:teuthology.run:Summary data: description: fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/stress_tests/{0-client-upgrade 1-tests/fsstress}}} duration: 1521.62539768219 failure_reason: 'Command failed on smithi026 with status 124: ''sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json''' flavor: default owner: scheduled_dparmar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=9ff286bf56c24588b3a8cc00d90a7b1c status: fail success: false 2023-10-01T08:07:48.020 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:07:48.093 INFO:teuthology.run:FAIL